[2023-02-24 17:22:57,839][177119] Saving configuration to /home/besa/source/rl/train_dir/default_experiment/config.json... [2023-02-24 17:22:57,840][177119] Rollout worker 0 uses device cpu [2023-02-24 17:22:57,840][177119] Rollout worker 1 uses device cpu [2023-02-24 17:22:57,840][177119] Rollout worker 2 uses device cpu [2023-02-24 17:22:57,840][177119] Rollout worker 3 uses device cpu [2023-02-24 17:22:57,840][177119] Rollout worker 4 uses device cpu [2023-02-24 17:22:57,840][177119] Rollout worker 5 uses device cpu [2023-02-24 17:22:57,840][177119] Rollout worker 6 uses device cpu [2023-02-24 17:22:57,840][177119] Rollout worker 7 uses device cpu [2023-02-24 17:22:57,884][177119] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2023-02-24 17:22:57,884][177119] InferenceWorker_p0-w0: min num requests: 2 [2023-02-24 17:22:57,901][177119] Starting all processes... [2023-02-24 17:22:57,901][177119] Starting process learner_proc0 [2023-02-24 17:22:58,524][177119] Starting all processes... [2023-02-24 17:22:58,527][177140] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2023-02-24 17:22:58,527][177119] Starting process inference_proc0-0 [2023-02-24 17:22:58,528][177140] Set environment var CUDA_VISIBLE_DEVICES to '0' (GPU indices [0]) for learning process 0 [2023-02-24 17:22:58,528][177119] Starting process rollout_proc0 [2023-02-24 17:22:58,528][177119] Starting process rollout_proc1 [2023-02-24 17:22:58,528][177119] Starting process rollout_proc2 [2023-02-24 17:22:58,531][177119] Starting process rollout_proc3 [2023-02-24 17:22:58,538][177140] Num visible devices: 1 [2023-02-24 17:22:58,534][177119] Starting process rollout_proc4 [2023-02-24 17:22:58,536][177119] Starting process rollout_proc5 [2023-02-24 17:22:58,538][177119] Starting process rollout_proc6 [2023-02-24 17:22:58,541][177119] Starting process rollout_proc7 [2023-02-24 17:22:58,580][177140] Starting seed is not provided [2023-02-24 17:22:58,581][177140] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2023-02-24 17:22:58,581][177140] Initializing actor-critic model on device cuda:0 [2023-02-24 17:22:58,581][177140] RunningMeanStd input shape: (23,) [2023-02-24 17:22:58,581][177140] RunningMeanStd input shape: (3, 72, 128) [2023-02-24 17:22:58,582][177140] RunningMeanStd input shape: (1,) [2023-02-24 17:22:58,597][177140] ConvEncoder: input_channels=3 [2023-02-24 17:22:58,733][177140] Conv encoder output size: 512 [2023-02-24 17:22:58,733][177140] Policy head output size: 512 [2023-02-24 17:22:58,747][177140] Created Actor Critic model with architecture: [2023-02-24 17:22:58,747][177140] ActorCriticSharedWeights( (obs_normalizer): ObservationNormalizer( (running_mean_std): RunningMeanStdDictInPlace( (running_mean_std): ModuleDict( (measurements): RunningMeanStdInPlace() (obs): RunningMeanStdInPlace() ) ) ) (returns_normalizer): RecursiveScriptModule(original_name=RunningMeanStdInPlace) (encoder): VizdoomEncoder( (basic_encoder): ConvEncoder( (enc): RecursiveScriptModule( original_name=ConvEncoderImpl (conv_head): RecursiveScriptModule( original_name=Sequential (0): RecursiveScriptModule(original_name=Conv2d) (1): RecursiveScriptModule(original_name=ELU) (2): RecursiveScriptModule(original_name=Conv2d) (3): RecursiveScriptModule(original_name=ELU) (4): RecursiveScriptModule(original_name=Conv2d) (5): RecursiveScriptModule(original_name=ELU) ) (mlp_layers): RecursiveScriptModule( original_name=Sequential (0): RecursiveScriptModule(original_name=Linear) (1): RecursiveScriptModule(original_name=ELU) ) ) ) ) (core): ModelCoreRNN( (core): GRU(512, 512) ) (decoder): MlpDecoder( (mlp): Identity() ) (critic_linear): Linear(in_features=512, out_features=1, bias=True) (action_parameterization): ActionParameterizationDefault( (distribution_linear): Linear(in_features=512, out_features=39, bias=True) ) ) [2023-02-24 17:22:59,652][177153] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2023-02-24 17:22:59,652][177153] Set environment var CUDA_VISIBLE_DEVICES to '0' (GPU indices [0]) for inference process 0 [2023-02-24 17:22:59,665][177153] Num visible devices: 1 [2023-02-24 17:22:59,689][177171] Worker 6 uses CPU cores [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] [2023-02-24 17:22:59,692][177157] Worker 3 uses CPU cores [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] [2023-02-24 17:22:59,771][177170] Worker 5 uses CPU cores [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] [2023-02-24 17:22:59,827][177158] Worker 4 uses CPU cores [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] [2023-02-24 17:22:59,845][177154] Worker 0 uses CPU cores [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] [2023-02-24 17:22:59,854][177156] Worker 2 uses CPU cores [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] [2023-02-24 17:22:59,886][177155] Worker 1 uses CPU cores [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] [2023-02-24 17:22:59,916][177172] Worker 7 uses CPU cores [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] [2023-02-24 17:23:00,568][177140] Using optimizer [2023-02-24 17:23:00,569][177140] No checkpoints found [2023-02-24 17:23:00,569][177140] Did not load from checkpoint, starting from scratch! [2023-02-24 17:23:00,569][177140] Initialized policy 0 weights for model version 0 [2023-02-24 17:23:00,570][177140] LearnerWorker_p0 finished initialization! [2023-02-24 17:23:00,570][177140] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2023-02-24 17:23:00,979][177153] RunningMeanStd input shape: (23,) [2023-02-24 17:23:00,979][177153] RunningMeanStd input shape: (3, 72, 128) [2023-02-24 17:23:00,980][177153] RunningMeanStd input shape: (1,) [2023-02-24 17:23:00,987][177153] ConvEncoder: input_channels=3 [2023-02-24 17:23:01,041][177153] Conv encoder output size: 512 [2023-02-24 17:23:01,041][177153] Policy head output size: 512 [2023-02-24 17:23:01,357][177119] Inference worker 0-0 is ready! [2023-02-24 17:23:01,358][177119] All inference workers are ready! Signal rollout workers to start! [2023-02-24 17:23:01,377][177119] Fps is (10 sec: nan, 60 sec: nan, 300 sec: nan). Total num frames: 0. Throughput: 0: nan. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2023-02-24 17:23:01,393][177172] Doom resolution: 160x120, resize resolution: (128, 72) [2023-02-24 17:23:01,393][177154] Doom resolution: 160x120, resize resolution: (128, 72) [2023-02-24 17:23:01,394][177154] Port 40300 is available [2023-02-24 17:23:01,394][177172] Port 41000 is available [2023-02-24 17:23:01,395][177154] Using port 40300 [2023-02-24 17:23:01,395][177172] Using port 41000 [2023-02-24 17:23:01,407][177158] Doom resolution: 160x120, resize resolution: (128, 72) [2023-02-24 17:23:01,407][177170] Doom resolution: 160x120, resize resolution: (128, 72) [2023-02-24 17:23:01,408][177157] Doom resolution: 160x120, resize resolution: (128, 72) [2023-02-24 17:23:01,408][177155] Doom resolution: 160x120, resize resolution: (128, 72) [2023-02-24 17:23:01,408][177156] Doom resolution: 160x120, resize resolution: (128, 72) [2023-02-24 17:23:01,409][177171] Doom resolution: 160x120, resize resolution: (128, 72) [2023-02-24 17:23:01,409][177158] Port 40700 is available [2023-02-24 17:23:01,409][177157] Port 40600 is available [2023-02-24 17:23:01,409][177170] Port 40800 is available [2023-02-24 17:23:01,410][177158] Using port 40700 [2023-02-24 17:23:01,410][177157] Using port 40600 [2023-02-24 17:23:01,410][177170] Using port 40800 [2023-02-24 17:23:01,410][177156] Port 40500 is available [2023-02-24 17:23:01,410][177155] Port 40400 is available [2023-02-24 17:23:01,410][177155] Using port 40400 [2023-02-24 17:23:01,410][177156] Using port 40500 [2023-02-24 17:23:01,410][177171] Port 40900 is available [2023-02-24 17:23:01,411][177171] Using port 40900 [2023-02-24 17:23:01,419][177172] Port 41001 is available [2023-02-24 17:23:01,419][177172] Using port 41001 [2023-02-24 17:23:01,419][177154] Port 40301 is available [2023-02-24 17:23:01,420][177154] Using port 40301 [2023-02-24 17:23:01,421][177172] Using port 41000 on host... [2023-02-24 17:23:01,421][177154] Using port 40300 on host... [2023-02-24 17:23:01,448][177157] Port 40601 is available [2023-02-24 17:23:01,448][177157] Using port 40601 [2023-02-24 17:23:01,448][177170] Port 40801 is available [2023-02-24 17:23:01,449][177170] Using port 40801 [2023-02-24 17:23:01,449][177156] Port 40501 is available [2023-02-24 17:23:01,449][177156] Using port 40501 [2023-02-24 17:23:01,449][177158] Port 40701 is available [2023-02-24 17:23:01,449][177158] Using port 40701 [2023-02-24 17:23:01,449][177155] Port 40401 is available [2023-02-24 17:23:01,450][177155] Using port 40401 [2023-02-24 17:23:01,450][177157] Using port 40600 on host... [2023-02-24 17:23:01,450][177170] Using port 40800 on host... [2023-02-24 17:23:01,450][177171] Port 40901 is available [2023-02-24 17:23:01,450][177171] Using port 40901 [2023-02-24 17:23:01,450][177156] Using port 40500 on host... [2023-02-24 17:23:01,451][177158] Using port 40700 on host... [2023-02-24 17:23:01,451][177155] Using port 40400 on host... [2023-02-24 17:23:01,452][177171] Using port 40900 on host... [2023-02-24 17:23:01,776][177155] Initialized w:1 v:0 player:0 [2023-02-24 17:23:01,777][177155] Decorrelating experience for 0 frames... [2023-02-24 17:23:01,777][177155] Using port 40401 on host... [2023-02-24 17:23:01,852][177172] Initialized w:7 v:0 player:0 [2023-02-24 17:23:01,853][177172] Decorrelating experience for 0 frames... [2023-02-24 17:23:01,853][177172] Using port 41001 on host... [2023-02-24 17:23:01,853][177157] Initialized w:3 v:0 player:0 [2023-02-24 17:23:01,855][177157] Decorrelating experience for 0 frames... [2023-02-24 17:23:01,855][177158] Initialized w:4 v:0 player:0 [2023-02-24 17:23:01,855][177157] Using port 40601 on host... [2023-02-24 17:23:01,856][177158] Decorrelating experience for 0 frames... [2023-02-24 17:23:01,856][177170] Initialized w:5 v:0 player:0 [2023-02-24 17:23:01,856][177158] Using port 40701 on host... [2023-02-24 17:23:01,857][177170] Decorrelating experience for 0 frames... [2023-02-24 17:23:01,857][177154] Initialized w:0 v:0 player:0 [2023-02-24 17:23:01,858][177170] Using port 40801 on host... [2023-02-24 17:23:01,859][177154] Decorrelating experience for 0 frames... [2023-02-24 17:23:01,858][177171] Initialized w:6 v:0 player:0 [2023-02-24 17:23:01,859][177154] Using port 40301 on host... [2023-02-24 17:23:01,859][177156] Initialized w:2 v:0 player:0 [2023-02-24 17:23:01,859][177171] Decorrelating experience for 0 frames... [2023-02-24 17:23:01,860][177171] Using port 40901 on host... [2023-02-24 17:23:01,860][177156] Decorrelating experience for 0 frames... [2023-02-24 17:23:01,861][177156] Using port 40501 on host... [2023-02-24 17:23:01,946][177155] Initialized w:1 v:1 player:0 [2023-02-24 17:23:01,947][177155] Decorrelating experience for 32 frames... [2023-02-24 17:23:01,984][177155] Port 40402 is available [2023-02-24 17:23:01,984][177155] Using port 40402 [2023-02-24 17:23:01,996][177155] Port 40403 is available [2023-02-24 17:23:01,996][177155] Using port 40403 [2023-02-24 17:23:01,997][177155] Using port 40402 on host... [2023-02-24 17:23:02,029][177157] Initialized w:3 v:1 player:0 [2023-02-24 17:23:02,030][177157] Decorrelating experience for 32 frames... [2023-02-24 17:23:02,032][177158] Initialized w:4 v:1 player:0 [2023-02-24 17:23:02,032][177158] Decorrelating experience for 32 frames... [2023-02-24 17:23:02,046][177156] Initialized w:2 v:1 player:0 [2023-02-24 17:23:02,047][177156] Decorrelating experience for 32 frames... [2023-02-24 17:23:02,071][177157] Port 40602 is available [2023-02-24 17:23:02,071][177157] Using port 40602 [2023-02-24 17:23:02,080][177158] Port 40702 is available [2023-02-24 17:23:02,080][177158] Using port 40702 [2023-02-24 17:23:02,087][177157] Port 40603 is available [2023-02-24 17:23:02,088][177157] Using port 40603 [2023-02-24 17:23:02,087][177172] Initialized w:7 v:1 player:0 [2023-02-24 17:23:02,088][177171] Initialized w:6 v:1 player:0 [2023-02-24 17:23:02,088][177170] Initialized w:5 v:1 player:0 [2023-02-24 17:23:02,089][177171] Decorrelating experience for 32 frames... [2023-02-24 17:23:02,089][177172] Decorrelating experience for 32 frames... [2023-02-24 17:23:02,090][177170] Decorrelating experience for 32 frames... [2023-02-24 17:23:02,090][177157] Using port 40602 on host... [2023-02-24 17:23:02,093][177154] Initialized w:0 v:1 player:0 [2023-02-24 17:23:02,094][177154] Decorrelating experience for 32 frames... [2023-02-24 17:23:02,097][177156] Port 40502 is available [2023-02-24 17:23:02,097][177156] Using port 40502 [2023-02-24 17:23:02,098][177158] Port 40703 is available [2023-02-24 17:23:02,098][177158] Using port 40703 [2023-02-24 17:23:02,100][177158] Using port 40702 on host... [2023-02-24 17:23:02,111][177156] Port 40503 is available [2023-02-24 17:23:02,111][177156] Using port 40503 [2023-02-24 17:23:02,112][177156] Using port 40502 on host... [2023-02-24 17:23:02,140][177154] Port 40302 is available [2023-02-24 17:23:02,140][177154] Using port 40302 [2023-02-24 17:23:02,144][177172] Port 41002 is available [2023-02-24 17:23:02,144][177172] Using port 41002 [2023-02-24 17:23:02,154][177171] Port 40902 is available [2023-02-24 17:23:02,155][177171] Using port 40902 [2023-02-24 17:23:02,158][177170] Port 40802 is available [2023-02-24 17:23:02,158][177170] Using port 40802 [2023-02-24 17:23:02,160][177172] Port 41003 is available [2023-02-24 17:23:02,161][177172] Using port 41003 [2023-02-24 17:23:02,162][177172] Using port 41002 on host... [2023-02-24 17:23:02,162][177154] Port 40303 is available [2023-02-24 17:23:02,163][177154] Using port 40303 [2023-02-24 17:23:02,164][177154] Using port 40302 on host... [2023-02-24 17:23:02,170][177171] Port 40903 is available [2023-02-24 17:23:02,170][177171] Using port 40903 [2023-02-24 17:23:02,171][177171] Using port 40902 on host... [2023-02-24 17:23:02,174][177170] Port 40803 is available [2023-02-24 17:23:02,174][177170] Using port 40803 [2023-02-24 17:23:02,175][177170] Using port 40802 on host... [2023-02-24 17:23:02,203][177155] Initialized w:1 v:2 player:0 [2023-02-24 17:23:02,203][177155] Decorrelating experience for 64 frames... [2023-02-24 17:23:02,261][177155] Using port 40403 on host... [2023-02-24 17:23:02,267][177158] Initialized w:4 v:2 player:0 [2023-02-24 17:23:02,268][177158] Decorrelating experience for 64 frames... [2023-02-24 17:23:02,273][177157] Initialized w:3 v:2 player:0 [2023-02-24 17:23:02,274][177157] Decorrelating experience for 64 frames... [2023-02-24 17:23:02,326][177156] Initialized w:2 v:2 player:0 [2023-02-24 17:23:02,327][177156] Decorrelating experience for 64 frames... [2023-02-24 17:23:02,330][177157] Using port 40603 on host... [2023-02-24 17:23:02,335][177158] Using port 40703 on host... [2023-02-24 17:23:02,351][177172] Initialized w:7 v:2 player:0 [2023-02-24 17:23:02,351][177172] Decorrelating experience for 64 frames... [2023-02-24 17:23:02,356][177171] Initialized w:6 v:2 player:0 [2023-02-24 17:23:02,356][177171] Decorrelating experience for 64 frames... [2023-02-24 17:23:02,391][177156] Using port 40503 on host... [2023-02-24 17:23:02,392][177154] Initialized w:0 v:2 player:0 [2023-02-24 17:23:02,393][177154] Decorrelating experience for 64 frames... [2023-02-24 17:23:02,400][177170] Initialized w:5 v:2 player:0 [2023-02-24 17:23:02,401][177170] Decorrelating experience for 64 frames... [2023-02-24 17:23:02,408][177172] Using port 41003 on host... [2023-02-24 17:23:02,420][177171] Using port 40903 on host... [2023-02-24 17:23:02,446][177155] Initialized w:1 v:3 player:0 [2023-02-24 17:23:02,447][177155] Decorrelating experience for 96 frames... [2023-02-24 17:23:02,452][177154] Using port 40303 on host... [2023-02-24 17:23:02,459][177170] Using port 40803 on host... [2023-02-24 17:23:02,509][177157] Initialized w:3 v:3 player:0 [2023-02-24 17:23:02,510][177157] Decorrelating experience for 96 frames... [2023-02-24 17:23:02,526][177158] Initialized w:4 v:3 player:0 [2023-02-24 17:23:02,526][177158] Decorrelating experience for 96 frames... [2023-02-24 17:23:02,579][177156] Initialized w:2 v:3 player:0 [2023-02-24 17:23:02,580][177156] Decorrelating experience for 96 frames... [2023-02-24 17:23:02,605][177171] Initialized w:6 v:3 player:0 [2023-02-24 17:23:02,607][177171] Decorrelating experience for 96 frames... [2023-02-24 17:23:02,618][177172] Initialized w:7 v:3 player:0 [2023-02-24 17:23:02,619][177172] Decorrelating experience for 96 frames... [2023-02-24 17:23:02,647][177170] Initialized w:5 v:3 player:0 [2023-02-24 17:23:02,648][177170] Decorrelating experience for 96 frames... [2023-02-24 17:23:02,666][177154] Initialized w:0 v:3 player:0 [2023-02-24 17:23:02,667][177154] Decorrelating experience for 96 frames... [2023-02-24 17:23:03,497][177140] Signal inference workers to stop experience collection... [2023-02-24 17:23:03,504][177153] InferenceWorker_p0-w0: stopping experience collection [2023-02-24 17:23:04,253][177140] Signal inference workers to resume experience collection... [2023-02-24 17:23:04,254][177153] InferenceWorker_p0-w0: resuming experience collection [2023-02-24 17:23:06,376][177119] Fps is (10 sec: 5735.0, 60 sec: 5735.0, 300 sec: 5735.0). Total num frames: 28672. Throughput: 0: 454.8. Samples: 2274. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-02-24 17:23:06,943][177153] Updated weights for policy 0, policy_version 10 (0.0343) [2023-02-24 17:23:09,766][177153] Updated weights for policy 0, policy_version 20 (0.0008) [2023-02-24 17:23:11,376][177119] Fps is (10 sec: 10240.6, 60 sec: 10240.6, 300 sec: 10240.6). Total num frames: 102400. Throughput: 0: 2304.9. Samples: 23048. Policy #0 lag: (min: 0.0, avg: 0.3, max: 1.0) [2023-02-24 17:23:12,551][177153] Updated weights for policy 0, policy_version 30 (0.0008) [2023-02-24 17:23:15,345][177153] Updated weights for policy 0, policy_version 40 (0.0008) [2023-02-24 17:23:16,376][177119] Fps is (10 sec: 14745.6, 60 sec: 11742.3, 300 sec: 11742.3). Total num frames: 176128. Throughput: 0: 3001.3. Samples: 45018. Policy #0 lag: (min: 0.0, avg: 0.3, max: 1.0) [2023-02-24 17:23:17,880][177119] Heartbeat connected on Batcher_0 [2023-02-24 17:23:17,882][177119] Heartbeat connected on LearnerWorker_p0 [2023-02-24 17:23:17,887][177119] Heartbeat connected on RolloutWorker_w0 [2023-02-24 17:23:17,890][177119] Heartbeat connected on InferenceWorker_p0-w0 [2023-02-24 17:23:17,894][177119] Heartbeat connected on RolloutWorker_w3 [2023-02-24 17:23:17,895][177119] Heartbeat connected on RolloutWorker_w1 [2023-02-24 17:23:17,898][177119] Heartbeat connected on RolloutWorker_w2 [2023-02-24 17:23:17,900][177119] Heartbeat connected on RolloutWorker_w6 [2023-02-24 17:23:17,900][177119] Heartbeat connected on RolloutWorker_w5 [2023-02-24 17:23:17,901][177119] Heartbeat connected on RolloutWorker_w7 [2023-02-24 17:23:17,901][177119] Heartbeat connected on RolloutWorker_w4 [2023-02-24 17:23:18,150][177153] Updated weights for policy 0, policy_version 50 (0.0008) [2023-02-24 17:23:20,948][177153] Updated weights for policy 0, policy_version 60 (0.0008) [2023-02-24 17:23:21,376][177119] Fps is (10 sec: 14745.3, 60 sec: 12493.0, 300 sec: 12493.0). Total num frames: 249856. Throughput: 0: 2801.8. Samples: 56036. Policy #0 lag: (min: 0.0, avg: 0.3, max: 1.0) [2023-02-24 17:23:21,459][177170] DAMAGECOUNT value on done: 45.0 [2023-02-24 17:23:21,590][177155] DAMAGECOUNT value on done: 208.0 [2023-02-24 17:23:21,590][177155] Sum rewards: -3.434, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.822', 'AMMO5': '0.003', 'AMMO2': '0.021', 'HITCOUNT': '0.030', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.085', 'ARMOR': '0.088', 'weapon4': '0.092', 'AMMO4': '0.107', 'WEAPON4': '0.200', 'weapon3': '0.408', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.624', 'weapon2': '0.940', 'FRAGCOUNT': '1.000'} [2023-02-24 17:23:21,604][177156] DAMAGECOUNT value on done: 15.0 [2023-02-24 17:23:21,604][177157] DAMAGECOUNT value on done: 24.0 [2023-02-24 17:23:21,607][177154] DAMAGECOUNT value on done: 100.0 [2023-02-24 17:23:21,608][177154] Sum rewards: -10.536, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.684', 'AMMO2': '0.012', 'HITCOUNT': '0.050', 'AMMO4': '0.057', 'weapon4': '0.062', 'ARMOR': '0.064', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'DAMAGECOUNT': '0.300', 'weapon3': '0.418', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.060'} [2023-02-24 17:23:21,623][177158] DAMAGECOUNT value on done: 5.0 [2023-02-24 17:23:21,624][177158] Sum rewards: -7.351, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.259', 'AMMO5': '0.009', 'HITCOUNT': '0.010', 'AMMO2': '0.013', 'DAMAGECOUNT': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.028', 'weapon4': '0.034', 'ARMOR': '0.036', 'AMMO4': '0.063', 'AMMO3': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.650', 'weapon3': '0.686', 'weapon2': '0.876'} [2023-02-24 17:23:21,626][177171] DAMAGECOUNT value on done: 37.0 [2023-02-24 17:23:21,627][177171] Sum rewards: -5.650, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.024', 'HITCOUNT': '0.040', 'AMMO4': '0.050', 'ARMOR': '0.080', 'AMMO3': '0.089', 'weapon3': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.102', 'DAMAGECOUNT': '0.111', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon2': '1.090'} [2023-02-24 17:23:21,636][177172] DAMAGECOUNT value on done: 35.0 [2023-02-24 17:23:21,637][177172] Sum rewards: -9.925, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.010', 'AMMO5': '0.003', 'weapon4': '0.006', 'AMMO2': '0.010', 'weapon5': '0.016', 'ARMOR': '0.024', 'HITCOUNT': '0.030', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'AMMO3': '0.067', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.105', 'WEAPON3': '0.350', 'weapon3': '0.442', 'weapon2': '1.086'} [2023-02-24 17:23:21,766][177170] DAMAGECOUNT value on done: 56.0 [2023-02-24 17:23:21,883][177155] DAMAGECOUNT value on done: 40.0 [2023-02-24 17:23:21,883][177155] Sum rewards: -5.609, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.604', 'AMMO5': '0.003', 'weapon5': '0.006', 'weapon4': '0.008', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'HITCOUNT': '0.040', 'AMMO4': '0.041', 'ARMOR': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.120', 'weapon3': '0.394', 'WEAPON3': '0.500', 'weapon2': '1.070'} [2023-02-24 17:23:21,891][177157] DAMAGECOUNT value on done: 20.0 [2023-02-24 17:23:21,894][177156] DAMAGECOUNT value on done: 135.0 [2023-02-24 17:23:21,895][177156] Sum rewards: -4.907, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.196', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.050', 'HITCOUNT': '0.090', 'ARMOR': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.156', 'weapon4': '0.208', 'DAMAGECOUNT': '0.405', 'weapon2': '0.714', 'weapon3': '0.794', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000'} [2023-02-24 17:23:21,903][177158] DAMAGECOUNT value on done: 79.0 [2023-02-24 17:23:21,903][177158] Sum rewards: -3.952, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.616', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.028', 'ARMOR': '0.044', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'HITCOUNT': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'DAMAGECOUNT': '0.237', 'WEAPON3': '0.650', 'weapon2': '0.774', 'weapon3': '0.786', 'FRAGCOUNT': '2.000'} [2023-02-24 17:23:21,904][177154] DAMAGECOUNT value on done: 20.0 [2023-02-24 17:23:21,918][177172] DAMAGECOUNT value on done: 35.0 [2023-02-24 17:23:21,927][177171] DAMAGECOUNT value on done: 10.0 [2023-02-24 17:23:22,043][177170] DAMAGECOUNT value on done: 35.0 [2023-02-24 17:23:22,168][177155] DAMAGECOUNT value on done: 70.0 [2023-02-24 17:23:22,180][177156] DAMAGECOUNT value on done: 15.0 [2023-02-24 17:23:22,180][177157] DAMAGECOUNT value on done: 12.0 [2023-02-24 17:23:22,198][177158] DAMAGECOUNT value on done: 5.0 [2023-02-24 17:23:22,201][177154] DAMAGECOUNT value on done: 40.0 [2023-02-24 17:23:22,201][177154] Sum rewards: -11.180, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-3.000', 'HEALTH': '-1.120', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'HITCOUNT': '0.040', 'weapon5': '0.052', 'DAMAGECOUNT': '0.120', 'AMMO3': '0.129', 'WEAPON5': '0.200', 'weapon3': '0.546', 'WEAPON3': '0.550', 'weapon2': '0.984'} [2023-02-24 17:23:22,216][177172] DAMAGECOUNT value on done: 62.0 [2023-02-24 17:23:22,219][177171] DAMAGECOUNT value on done: 0.0 [2023-02-24 17:23:22,333][177170] DAMAGECOUNT value on done: 40.0 [2023-02-24 17:23:22,334][177170] Sum rewards: -6.738, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.749', 'AMMO5': '0.005', 'AMMO2': '0.036', 'HITCOUNT': '0.060', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.120', 'AMMO3': '0.122', 'weapon4': '0.140', 'AMMO4': '0.178', 'WEAPON4': '0.200', 'weapon3': '0.514', 'WEAPON3': '0.650', 'weapon2': '0.886', 'FRAGCOUNT': '1.000'} [2023-02-24 17:23:22,450][177156] DAMAGECOUNT value on done: 0.0 [2023-02-24 17:23:22,453][177155] DAMAGECOUNT value on done: 0.0 [2023-02-24 17:23:22,464][177157] DAMAGECOUNT value on done: 5.0 [2023-02-24 17:23:22,483][177158] DAMAGECOUNT value on done: 0.0 [2023-02-24 17:23:22,492][177154] DAMAGECOUNT value on done: 140.0 [2023-02-24 17:23:22,513][177172] DAMAGECOUNT value on done: 0.0 [2023-02-24 17:23:22,513][177171] DAMAGECOUNT value on done: 15.0 [2023-02-24 17:23:23,780][177153] Updated weights for policy 0, policy_version 70 (0.0008) [2023-02-24 17:23:26,376][177119] Fps is (10 sec: 14745.6, 60 sec: 12943.6, 300 sec: 12943.6). Total num frames: 323584. Throughput: 0: 3115.7. Samples: 77890. Policy #0 lag: (min: 0.0, avg: 0.3, max: 1.0) [2023-02-24 17:23:26,376][177119] Avg episode reward: [(0, '-6.865')] [2023-02-24 17:23:26,378][177140] Saving new best policy, reward=-6.865! [2023-02-24 17:23:26,568][177153] Updated weights for policy 0, policy_version 80 (0.0008) [2023-02-24 17:23:29,441][177153] Updated weights for policy 0, policy_version 90 (0.0008) [2023-02-24 17:23:31,376][177119] Fps is (10 sec: 14336.2, 60 sec: 13107.4, 300 sec: 13107.4). Total num frames: 393216. Throughput: 0: 3322.7. Samples: 99678. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 17:23:31,376][177119] Avg episode reward: [(0, '-6.865')] [2023-02-24 17:23:32,247][177153] Updated weights for policy 0, policy_version 100 (0.0008) [2023-02-24 17:23:35,091][177153] Updated weights for policy 0, policy_version 110 (0.0008) [2023-02-24 17:23:36,376][177119] Fps is (10 sec: 14336.0, 60 sec: 13341.5, 300 sec: 13341.5). Total num frames: 466944. Throughput: 0: 3157.5. Samples: 110510. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 17:23:36,376][177119] Avg episode reward: [(0, '-6.865')] [2023-02-24 17:23:36,814][177155] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 17:23:37,922][177153] Updated weights for policy 0, policy_version 120 (0.0008) [2023-02-24 17:23:40,058][177170] DAMAGECOUNT value on done: 75.0 [2023-02-24 17:23:40,118][177172] DAMAGECOUNT value on done: 45.0 [2023-02-24 17:23:40,124][177154] DAMAGECOUNT value on done: 100.0 [2023-02-24 17:23:40,161][177155] DAMAGECOUNT value on done: 258.0 [2023-02-24 17:23:40,161][177155] Sum rewards: -5.453, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.950', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon4': '0.026', 'HITCOUNT': '0.050', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'ARMOR': '0.104', 'AMMO4': '0.105', 'AMMO3': '0.106', 'DAMAGECOUNT': '0.150', 'WEAPON3': '0.500', 'weapon3': '0.678', 'weapon2': '0.978'} [2023-02-24 17:23:40,195][177171] DAMAGECOUNT value on done: 107.0 [2023-02-24 17:23:40,213][177156] DAMAGECOUNT value on done: 90.0 [2023-02-24 17:23:40,213][177156] Sum rewards: -7.237, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.870', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.003', 'weapon4': '0.010', 'weapon5': '0.012', 'AMMO2': '0.016', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'HITCOUNT': '0.060', 'AMMO4': '0.080', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.225', 'WEAPON3': '0.550', 'weapon3': '0.684', 'weapon2': '0.956'} [2023-02-24 17:23:40,242][177157] DAMAGECOUNT value on done: 146.0 [2023-02-24 17:23:40,268][177158] DAMAGECOUNT value on done: 90.0 [2023-02-24 17:23:40,268][177158] Sum rewards: -10.828, reward structure: {'DEATHCOUNT': '-11.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.072', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.018', 'weapon4': '0.022', 'AMMO4': '0.023', 'HITCOUNT': '0.050', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.140', 'DAMAGECOUNT': '0.255', 'weapon3': '0.712', 'WEAPON3': '0.750', 'weapon2': '0.916'} [2023-02-24 17:23:40,374][177170] DAMAGECOUNT value on done: 212.0 [2023-02-24 17:23:40,374][177170] Sum rewards: -8.135, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.550', 'AMMO5': '0.005', 'AMMO2': '0.012', 'HITCOUNT': '0.020', 'ARMOR': '0.040', 'weapon5': '0.042', 'AMMO4': '0.058', 'WEAPON5': '0.100', 'weapon4': '0.122', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.468', 'weapon3': '0.534', 'WEAPON3': '0.700', 'weapon2': '0.782', 'FRAGCOUNT': '1.000'} [2023-02-24 17:23:40,415][177172] DAMAGECOUNT value on done: 101.0 [2023-02-24 17:23:40,436][177154] DAMAGECOUNT value on done: 35.0 [2023-02-24 17:23:40,477][177155] DAMAGECOUNT value on done: 45.0 [2023-02-24 17:23:40,478][177155] Sum rewards: -4.045, reward structure: {'DEATHCOUNT': '-4.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.664', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.008', 'HITCOUNT': '0.010', 'weapon5': '0.012', 'DAMAGECOUNT': '0.015', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.089', 'weapon4': '0.162', 'WEAPON3': '0.400', 'ARMOR': '0.468', 'weapon3': '0.510', 'weapon2': '0.820'} [2023-02-24 17:23:40,500][177171] DAMAGECOUNT value on done: 130.0 [2023-02-24 17:23:40,501][177171] Sum rewards: -6.539, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.650', 'AMMO2': '0.024', 'ARMOR': '0.040', 'AMMO4': '0.118', 'HITCOUNT': '0.120', 'AMMO3': '0.139', 'weapon4': '0.244', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.360', 'weapon3': '0.628', 'weapon2': '0.638', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000'} [2023-02-24 17:23:40,536][177156] DAMAGECOUNT value on done: 190.0 [2023-02-24 17:23:40,558][177157] DAMAGECOUNT value on done: 80.0 [2023-02-24 17:23:40,558][177157] Sum rewards: -8.730, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.079', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.032', 'AMMO4': '0.033', 'HITCOUNT': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'DAMAGECOUNT': '0.180', 'weapon3': '0.292', 'ARMOR': '0.408', 'WEAPON3': '0.550', 'weapon2': '0.972'} [2023-02-24 17:23:40,593][177158] DAMAGECOUNT value on done: 94.0 [2023-02-24 17:23:40,673][177170] DAMAGECOUNT value on done: 60.0 [2023-02-24 17:23:40,673][177170] Sum rewards: -6.466, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.078', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.014', 'ARMOR': '0.016', 'HITCOUNT': '0.020', 'weapon4': '0.032', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'DAMAGECOUNT': '0.075', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'WEAPON3': '0.500', 'weapon3': '0.678', 'weapon2': '0.974'} [2023-02-24 17:23:40,712][177172] DAMAGECOUNT value on done: 87.0 [2023-02-24 17:23:40,721][177154] DAMAGECOUNT value on done: 205.0 [2023-02-24 17:23:40,776][177155] DAMAGECOUNT value on done: 79.0 [2023-02-24 17:23:40,795][177171] DAMAGECOUNT value on done: 0.0 [2023-02-24 17:23:40,829][177156] DAMAGECOUNT value on done: 33.0 [2023-02-24 17:23:40,842][177157] DAMAGECOUNT value on done: 112.0 [2023-02-24 17:23:40,861][177153] Updated weights for policy 0, policy_version 130 (0.0009) [2023-02-24 17:23:40,884][177158] DAMAGECOUNT value on done: 147.0 [2023-02-24 17:23:40,884][177158] Sum rewards: -7.184, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.478', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.020', 'weapon4': '0.024', 'HITCOUNT': '0.080', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.149', 'DAMAGECOUNT': '0.426', 'WEAPON3': '0.800', 'weapon3': '0.828', 'weapon2': '0.998', 'FRAGCOUNT': '2.000'} [2023-02-24 17:23:40,963][177170] DAMAGECOUNT value on done: 40.0 [2023-02-24 17:23:41,002][177172] DAMAGECOUNT value on done: 0.0 [2023-02-24 17:23:41,002][177172] Sum rewards: -9.415, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.455', 'AMMO5': '0.008', 'AMMO2': '0.012', 'weapon5': '0.052', 'AMMO4': '0.061', 'weapon4': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'weapon3': '0.536', 'WEAPON3': '0.650', 'weapon2': '0.776'} [2023-02-24 17:23:41,016][177154] DAMAGECOUNT value on done: 145.0 [2023-02-24 17:23:41,075][177155] DAMAGECOUNT value on done: 18.0 [2023-02-24 17:23:41,084][177171] DAMAGECOUNT value on done: 46.0 [2023-02-24 17:23:41,085][177171] Sum rewards: -9.546, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.282', 'FRAGCOUNT': '-1.500', 'ARMOR': '0.004', 'AMMO2': '0.011', 'AMMO5': '0.015', 'weapon5': '0.024', 'HITCOUNT': '0.040', 'AMMO4': '0.054', 'weapon4': '0.068', 'DAMAGECOUNT': '0.093', 'WEAPON4': '0.100', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'weapon3': '0.630', 'WEAPON3': '0.850', 'weapon2': '0.894'} [2023-02-24 17:23:41,120][177156] DAMAGECOUNT value on done: 44.0 [2023-02-24 17:23:41,130][177157] DAMAGECOUNT value on done: 5.0 [2023-02-24 17:23:41,177][177158] DAMAGECOUNT value on done: 120.0 [2023-02-24 17:23:41,178][177158] Sum rewards: -3.032, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.018', 'AMMO5': '0.005', 'weapon4': '0.012', 'AMMO2': '0.012', 'weapon5': '0.020', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.060', 'HITCOUNT': '0.070', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.550', 'weapon3': '0.716', 'weapon2': '0.896', 'FRAGCOUNT': '1.000'} [2023-02-24 17:23:41,376][177119] Fps is (10 sec: 14336.2, 60 sec: 13414.6, 300 sec: 13414.6). Total num frames: 536576. Throughput: 0: 3298.2. Samples: 131926. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 17:23:41,376][177119] Avg episode reward: [(0, '-6.756')] [2023-02-24 17:23:41,377][177140] Saving new best policy, reward=-6.756! [2023-02-24 17:23:43,702][177153] Updated weights for policy 0, policy_version 140 (0.0008) [2023-02-24 17:23:46,376][177119] Fps is (10 sec: 14336.0, 60 sec: 13562.5, 300 sec: 13562.5). Total num frames: 610304. Throughput: 0: 3414.4. Samples: 153644. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 17:23:46,376][177119] Avg episode reward: [(0, '-6.756')] [2023-02-24 17:23:46,501][177153] Updated weights for policy 0, policy_version 150 (0.0008) [2023-02-24 17:23:49,344][177153] Updated weights for policy 0, policy_version 160 (0.0008) [2023-02-24 17:23:51,376][177119] Fps is (10 sec: 14745.7, 60 sec: 13680.8, 300 sec: 13680.8). Total num frames: 684032. Throughput: 0: 3604.1. Samples: 164458. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 17:23:51,376][177119] Avg episode reward: [(0, '-6.756')] [2023-02-24 17:23:52,196][177153] Updated weights for policy 0, policy_version 170 (0.0008) [2023-02-24 17:23:55,030][177153] Updated weights for policy 0, policy_version 180 (0.0008) [2023-02-24 17:23:56,376][177119] Fps is (10 sec: 14336.0, 60 sec: 13703.1, 300 sec: 13703.1). Total num frames: 753664. Throughput: 0: 3624.0. Samples: 186128. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:23:56,376][177119] Avg episode reward: [(0, '-6.756')] [2023-02-24 17:23:57,861][177153] Updated weights for policy 0, policy_version 190 (0.0008) [2023-02-24 17:23:58,682][177170] DAMAGECOUNT value on done: 182.0 [2023-02-24 17:23:58,682][177170] Sum rewards: -6.326, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.636', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.008', 'ARMOR': '0.074', 'HITCOUNT': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.161', 'DAMAGECOUNT': '0.321', 'weapon3': '0.628', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.088'} [2023-02-24 17:23:58,746][177172] DAMAGECOUNT value on done: 141.0 [2023-02-24 17:23:58,746][177172] Sum rewards: -12.958, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.948', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.026', 'AMMO4': '0.048', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.161', 'DAMAGECOUNT': '0.288', 'ARMOR': '0.404', 'FRAGCOUNT': '0.500', 'weapon3': '0.530', 'WEAPON3': '0.800', 'weapon2': '1.174'} [2023-02-24 17:23:58,758][177155] DAMAGECOUNT value on done: 356.0 [2023-02-24 17:23:58,759][177155] Sum rewards: -4.323, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.410', 'AMMO5': '0.003', 'weapon5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon4': '0.042', 'WEAPON5': '0.050', 'ARMOR': '0.076', 'HITCOUNT': '0.080', 'AMMO3': '0.084', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.294', 'weapon3': '0.440', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon2': '1.012'} [2023-02-24 17:23:58,792][177171] DAMAGECOUNT value on done: 182.0 [2023-02-24 17:23:58,793][177171] Sum rewards: -4.851, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.740', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'ARMOR': '0.024', 'AMMO4': '0.066', 'weapon4': '0.086', 'HITCOUNT': '0.090', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.225', 'WEAPON3': '0.600', 'weapon3': '0.770', 'weapon2': '0.968', 'FRAGCOUNT': '1.000'} [2023-02-24 17:23:58,810][177154] DAMAGECOUNT value on done: 255.0 [2023-02-24 17:23:58,811][177154] Sum rewards: -5.490, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.022', 'HEALTH': '0.092', 'WEAPON5': '0.100', 'HITCOUNT': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.119', 'weapon4': '0.146', 'WEAPON4': '0.200', 'weapon3': '0.440', 'DAMAGECOUNT': '0.465', 'ARMOR': '0.514', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.086'} [2023-02-24 17:23:58,819][177158] DAMAGECOUNT value on done: 105.0 [2023-02-24 17:23:58,820][177157] DAMAGECOUNT value on done: 341.0 [2023-02-24 17:23:58,820][177157] Sum rewards: -3.298, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.434', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.026', 'HITCOUNT': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'weapon4': '0.078', 'AMMO3': '0.092', 'WEAPON4': '0.150', 'WEAPON3': '0.450', 'weapon3': '0.480', 'ARMOR': '0.490', 'DAMAGECOUNT': '0.585', 'FRAGCOUNT': '1.000', 'weapon2': '1.106'} [2023-02-24 17:23:58,932][177156] DAMAGECOUNT value on done: 185.0 [2023-02-24 17:23:58,932][177156] Sum rewards: -5.356, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.210', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.075', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'HITCOUNT': '0.100', 'DAMAGECOUNT': '0.285', 'WEAPON3': '0.400', 'weapon2': '0.898', 'weapon3': '1.056'} [2023-02-24 17:23:58,983][177170] DAMAGECOUNT value on done: 212.0 [2023-02-24 17:23:59,047][177172] DAMAGECOUNT value on done: 116.0 [2023-02-24 17:23:59,048][177172] Sum rewards: -9.685, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.892', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.010', 'AMMO2': '0.010', 'HITCOUNT': '0.010', 'WEAPON1': '0.020', 'weapon5': '0.020', 'DAMAGECOUNT': '0.045', 'AMMO4': '0.049', 'WEAPON5': '0.100', 'AMMO3': '0.124', 'weapon4': '0.142', 'WEAPON4': '0.150', 'weapon3': '0.406', 'ARMOR': '0.499', 'WEAPON3': '0.650', 'weapon2': '1.222'} [2023-02-24 17:23:59,053][177155] DAMAGECOUNT value on done: 196.0 [2023-02-24 17:23:59,053][177155] Sum rewards: -6.661, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.280', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.007', 'AMMO2': '0.012', 'ARMOR': '0.020', 'weapon5': '0.030', 'weapon4': '0.032', 'HITCOUNT': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.095', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.453', 'WEAPON3': '0.550', 'weapon3': '0.614', 'weapon2': '1.148'} [2023-02-24 17:23:59,099][177171] DAMAGECOUNT value on done: 140.0 [2023-02-24 17:23:59,100][177171] Sum rewards: -5.228, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.510', 'AMMO5': '0.005', 'AMMO2': '0.009', 'HITCOUNT': '0.010', 'weapon4': '0.020', 'weapon5': '0.020', 'DAMAGECOUNT': '0.030', 'ARMOR': '0.040', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'WEAPON3': '0.700', 'weapon2': '0.736', 'weapon3': '0.834', 'FRAGCOUNT': '1.000'} [2023-02-24 17:23:59,102][177154] DAMAGECOUNT value on done: 75.0 [2023-02-24 17:23:59,103][177154] Sum rewards: -8.908, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.804', 'AMMO2': '0.014', 'HITCOUNT': '0.050', 'AMMO4': '0.069', 'ARMOR': '0.088', 'DAMAGECOUNT': '0.120', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'weapon4': '0.216', 'weapon3': '0.482', 'WEAPON3': '0.700', 'weapon2': '0.864', 'FRAGCOUNT': '1.000'} [2023-02-24 17:23:59,115][177158] DAMAGECOUNT value on done: 186.0 [2023-02-24 17:23:59,118][177157] DAMAGECOUNT value on done: 225.0 [2023-02-24 17:23:59,221][177156] DAMAGECOUNT value on done: 225.0 [2023-02-24 17:23:59,222][177156] Sum rewards: -11.816, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.454', 'FRAGCOUNT': '-1.500', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon4': '0.020', 'AMMO4': '0.025', 'HITCOUNT': '0.030', 'WEAPON5': '0.050', 'ARMOR': '0.052', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.105', 'AMMO3': '0.145', 'weapon3': '0.488', 'WEAPON3': '0.650', 'weapon2': '0.958'} [2023-02-24 17:23:59,276][177170] DAMAGECOUNT value on done: 210.0 [2023-02-24 17:23:59,277][177170] Sum rewards: -5.331, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.302', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.020', 'weapon4': '0.066', 'AMMO4': '0.090', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.120', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.450', 'ARMOR': '0.512', 'WEAPON3': '0.550', 'weapon3': '0.724', 'FRAGCOUNT': '1.000', 'weapon2': '1.066'} [2023-02-24 17:23:59,339][177172] DAMAGECOUNT value on done: 175.0 [2023-02-24 17:23:59,345][177155] DAMAGECOUNT value on done: 99.0 [2023-02-24 17:23:59,393][177154] DAMAGECOUNT value on done: 285.0 [2023-02-24 17:23:59,394][177154] Sum rewards: -5.856, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.730', 'AMMO5': '0.003', 'AMMO2': '0.019', 'ARMOR': '0.028', 'AMMO3': '0.073', 'HITCOUNT': '0.080', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.240', 'weapon4': '0.282', 'WEAPON3': '0.400', 'weapon3': '0.556', 'weapon2': '0.896', 'FRAGCOUNT': '1.000'} [2023-02-24 17:23:59,396][177171] DAMAGECOUNT value on done: 14.0 [2023-02-24 17:23:59,402][177158] DAMAGECOUNT value on done: 257.0 [2023-02-24 17:23:59,408][177157] DAMAGECOUNT value on done: 137.0 [2023-02-24 17:23:59,509][177156] DAMAGECOUNT value on done: 78.0 [2023-02-24 17:23:59,563][177170] DAMAGECOUNT value on done: 185.0 [2023-02-24 17:23:59,635][177155] DAMAGECOUNT value on done: 63.0 [2023-02-24 17:23:59,635][177172] DAMAGECOUNT value on done: 180.0 [2023-02-24 17:23:59,635][177155] Sum rewards: -4.417, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.586', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.046', 'WEAPON5': '0.050', 'HITCOUNT': '0.050', 'ARMOR': '0.068', 'AMMO4': '0.078', 'AMMO3': '0.097', 'DAMAGECOUNT': '0.135', 'weapon4': '0.146', 'WEAPON4': '0.200', 'weapon3': '0.216', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon2': '1.114'} [2023-02-24 17:23:59,636][177172] Sum rewards: -8.599, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.984', 'AMMO5': '0.010', 'AMMO2': '0.013', 'HITCOUNT': '0.030', 'AMMO4': '0.065', 'weapon5': '0.088', 'weapon4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'ARMOR': '0.416', 'DAMAGECOUNT': '0.540', 'weapon3': '0.592', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.066'} [2023-02-24 17:23:59,684][177171] DAMAGECOUNT value on done: 46.0 [2023-02-24 17:23:59,686][177158] DAMAGECOUNT value on done: 195.0 [2023-02-24 17:23:59,689][177154] DAMAGECOUNT value on done: 260.0 [2023-02-24 17:23:59,690][177154] Sum rewards: -7.845, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.425', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.100', 'AMMO3': '0.157', 'DAMAGECOUNT': '0.345', 'weapon2': '0.736', 'WEAPON3': '0.800', 'weapon3': '0.856', 'FRAGCOUNT': '1.000'} [2023-02-24 17:23:59,699][177157] DAMAGECOUNT value on done: 135.0 [2023-02-24 17:23:59,699][177157] Sum rewards: -3.873, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.500', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'weapon5': '0.032', 'HITCOUNT': '0.110', 'AMMO3': '0.149', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.390', 'ARMOR': '0.485', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.020', 'weapon3': '1.040'} [2023-02-24 17:23:59,796][177156] DAMAGECOUNT value on done: 134.0 [2023-02-24 17:23:59,797][177156] Sum rewards: -2.055, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.850', 'AMMO2': '0.005', 'AMMO4': '0.027', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.085', 'weapon4': '0.086', 'HITCOUNT': '0.100', 'DAMAGECOUNT': '0.270', 'WEAPON3': '0.400', 'weapon3': '0.952', 'FRAGCOUNT': '1.000', 'weapon2': '1.038'} [2023-02-24 17:24:00,736][177153] Updated weights for policy 0, policy_version 200 (0.0008) [2023-02-24 17:24:01,376][177119] Fps is (10 sec: 14335.9, 60 sec: 13790.0, 300 sec: 13790.0). Total num frames: 827392. Throughput: 0: 3614.8. Samples: 207682. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:24:01,376][177119] Avg episode reward: [(0, '-6.584')] [2023-02-24 17:24:01,377][177140] Saving new best policy, reward=-6.584! [2023-02-24 17:24:03,576][177153] Updated weights for policy 0, policy_version 210 (0.0009) [2023-02-24 17:24:06,376][177119] Fps is (10 sec: 14745.7, 60 sec: 14540.8, 300 sec: 13863.5). Total num frames: 901120. Throughput: 0: 3613.7. Samples: 218650. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:24:06,376][177119] Avg episode reward: [(0, '-6.584')] [2023-02-24 17:24:06,378][177153] Updated weights for policy 0, policy_version 220 (0.0008) [2023-02-24 17:24:09,223][177153] Updated weights for policy 0, policy_version 230 (0.0008) [2023-02-24 17:24:11,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14472.5, 300 sec: 13868.0). Total num frames: 970752. Throughput: 0: 3607.6. Samples: 240234. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:24:11,376][177119] Avg episode reward: [(0, '-6.584')] [2023-02-24 17:24:12,082][177153] Updated weights for policy 0, policy_version 240 (0.0008) [2023-02-24 17:24:14,898][177153] Updated weights for policy 0, policy_version 250 (0.0009) [2023-02-24 17:24:16,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14472.5, 300 sec: 13926.5). Total num frames: 1044480. Throughput: 0: 3602.2. Samples: 261776. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:24:16,376][177119] Avg episode reward: [(0, '-6.584')] [2023-02-24 17:24:17,281][177170] DAMAGECOUNT value on done: 202.0 [2023-02-24 17:24:17,413][177158] DAMAGECOUNT value on done: 130.0 [2023-02-24 17:24:17,414][177158] Sum rewards: -5.826, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.826', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.024', 'HITCOUNT': '0.040', 'DAMAGECOUNT': '0.075', 'weapon4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'AMMO4': '0.120', 'WEAPON4': '0.250', 'WEAPON3': '0.500', 'weapon3': '0.584', 'FRAGCOUNT': '1.000', 'weapon2': '1.090'} [2023-02-24 17:24:17,427][177172] DAMAGECOUNT value on done: 196.0 [2023-02-24 17:24:17,428][177172] Sum rewards: -5.741, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.866', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.006', 'AMMO4': '0.029', 'HITCOUNT': '0.060', 'ARMOR': '0.068', 'weapon4': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.128', 'DAMAGECOUNT': '0.165', 'weapon3': '0.570', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.104'} [2023-02-24 17:24:17,449][177155] DAMAGECOUNT value on done: 356.0 [2023-02-24 17:24:17,501][177157] DAMAGECOUNT value on done: 386.0 [2023-02-24 17:24:17,502][177157] Sum rewards: -5.621, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.530', 'weapon4': '0.002', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.013', 'HITCOUNT': '0.040', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'DAMAGECOUNT': '0.135', 'AMMO3': '0.175', 'ARMOR': '0.455', 'weapon2': '0.904', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon3': '1.058'} [2023-02-24 17:24:17,516][177154] DAMAGECOUNT value on done: 310.0 [2023-02-24 17:24:17,523][177171] DAMAGECOUNT value on done: 222.0 [2023-02-24 17:24:17,581][177170] DAMAGECOUNT value on done: 1072.0 [2023-02-24 17:24:17,582][177170] Sum rewards: -1.004, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.479', 'AMMO5': '0.003', 'AMMO2': '0.011', 'ARMOR': '0.028', 'weapon4': '0.028', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'weapon7': '0.106', 'HITCOUNT': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.450', 'weapon3': '0.686', 'weapon2': '0.956', 'DAMAGECOUNT': '1.080', 'FRAGCOUNT': '2.000'} [2023-02-24 17:24:17,626][177156] DAMAGECOUNT value on done: 205.0 [2023-02-24 17:24:17,706][177158] DAMAGECOUNT value on done: 196.0 [2023-02-24 17:24:17,739][177172] DAMAGECOUNT value on done: 126.0 [2023-02-24 17:24:17,758][177155] DAMAGECOUNT value on done: 251.0 [2023-02-24 17:24:17,758][177155] Sum rewards: -10.203, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.090', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.042', 'HITCOUNT': '0.050', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.165', 'weapon4': '0.166', 'AMMO4': '0.196', 'AMMO3': '0.196', 'WEAPON4': '0.350', 'weapon3': '0.684', 'weapon2': '0.884', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000'} [2023-02-24 17:24:17,781][177153] Updated weights for policy 0, policy_version 260 (0.0008) [2023-02-24 17:24:17,797][177157] DAMAGECOUNT value on done: 235.0 [2023-02-24 17:24:17,816][177154] DAMAGECOUNT value on done: 90.0 [2023-02-24 17:24:17,817][177171] DAMAGECOUNT value on done: 160.0 [2023-02-24 17:24:17,868][177170] DAMAGECOUNT value on done: 247.0 [2023-02-24 17:24:17,934][177156] DAMAGECOUNT value on done: 237.0 [2023-02-24 17:24:17,984][177158] DAMAGECOUNT value on done: 362.0 [2023-02-24 17:24:17,985][177158] Sum rewards: -3.643, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.149', 'WEAPON1': '0.010', 'ARMOR': '0.028', 'AMMO2': '0.047', 'HITCOUNT': '0.050', 'AMMO3': '0.064', 'weapon4': '0.138', 'AMMO4': '0.232', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.315', 'WEAPON3': '0.350', 'weapon3': '0.518', 'weapon2': '0.954', 'FRAGCOUNT': '1.000'} [2023-02-24 17:24:18,017][177172] DAMAGECOUNT value on done: 220.0 [2023-02-24 17:24:18,050][177155] DAMAGECOUNT value on done: 124.0 [2023-02-24 17:24:18,051][177155] Sum rewards: -9.057, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.240', 'AMMO2': '0.017', 'ARMOR': '0.024', 'HITCOUNT': '0.030', 'weapon4': '0.072', 'DAMAGECOUNT': '0.075', 'AMMO4': '0.085', 'AMMO3': '0.138', 'WEAPON4': '0.200', 'weapon3': '0.570', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.322'} [2023-02-24 17:24:18,100][177171] DAMAGECOUNT value on done: 14.0 [2023-02-24 17:24:18,104][177154] DAMAGECOUNT value on done: 330.0 [2023-02-24 17:24:18,104][177157] DAMAGECOUNT value on done: 157.0 [2023-02-24 17:24:18,164][177170] DAMAGECOUNT value on done: 272.0 [2023-02-24 17:24:18,234][177156] DAMAGECOUNT value on done: 113.0 [2023-02-24 17:24:18,274][177158] DAMAGECOUNT value on done: 255.0 [2023-02-24 17:24:18,274][177158] Sum rewards: -5.358, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.028', 'HITCOUNT': '0.040', 'AMMO3': '0.076', 'WEAPON5': '0.100', 'weapon4': '0.130', 'AMMO4': '0.134', 'DAMAGECOUNT': '0.180', 'WEAPON4': '0.200', 'WEAPON3': '0.400', 'HEALTH': '0.452', 'weapon3': '0.668', 'weapon2': '0.952'} [2023-02-24 17:24:18,313][177172] DAMAGECOUNT value on done: 230.0 [2023-02-24 17:24:18,313][177172] Sum rewards: -7.449, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.716', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.012', 'ARMOR': '0.040', 'HITCOUNT': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'weapon4': '0.062', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.150', 'AMMO3': '0.153', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.800', 'weapon3': '0.838', 'weapon2': '0.956'} [2023-02-24 17:24:18,339][177155] DAMAGECOUNT value on done: 143.0 [2023-02-24 17:24:18,391][177171] DAMAGECOUNT value on done: 56.0 [2023-02-24 17:24:18,391][177171] Sum rewards: -6.058, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.508', 'AMMO5': '0.003', 'HITCOUNT': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.015', 'DAMAGECOUNT': '0.030', 'weapon5': '0.036', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.073', 'AMMO3': '0.084', 'weapon4': '0.100', 'WEAPON3': '0.450', 'weapon3': '0.540', 'weapon2': '1.248'} [2023-02-24 17:24:18,399][177154] DAMAGECOUNT value on done: 275.0 [2023-02-24 17:24:18,399][177157] DAMAGECOUNT value on done: 180.0 [2023-02-24 17:24:18,539][177156] DAMAGECOUNT value on done: 147.0 [2023-02-24 17:24:20,618][177153] Updated weights for policy 0, policy_version 270 (0.0008) [2023-02-24 17:24:21,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14404.3, 300 sec: 13926.5). Total num frames: 1114112. Throughput: 0: 3598.9. Samples: 272460. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 17:24:21,376][177119] Avg episode reward: [(0, '-6.508')] [2023-02-24 17:24:21,377][177140] Saving new best policy, reward=-6.508! [2023-02-24 17:24:23,475][177153] Updated weights for policy 0, policy_version 280 (0.0008) [2023-02-24 17:24:26,290][177153] Updated weights for policy 0, policy_version 290 (0.0008) [2023-02-24 17:24:26,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14404.3, 300 sec: 13974.7). Total num frames: 1187840. Throughput: 0: 3604.5. Samples: 294130. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 17:24:26,376][177119] Avg episode reward: [(0, '-6.508')] [2023-02-24 17:24:29,151][177153] Updated weights for policy 0, policy_version 300 (0.0009) [2023-02-24 17:24:31,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14404.3, 300 sec: 13972.0). Total num frames: 1257472. Throughput: 0: 3600.6. Samples: 315670. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 17:24:31,376][177119] Avg episode reward: [(0, '-6.508')] [2023-02-24 17:24:31,995][177153] Updated weights for policy 0, policy_version 310 (0.0008) [2023-02-24 17:24:34,873][177153] Updated weights for policy 0, policy_version 320 (0.0008) [2023-02-24 17:24:35,996][177170] DAMAGECOUNT value on done: 225.0 [2023-02-24 17:24:36,032][177158] DAMAGECOUNT value on done: 495.0 [2023-02-24 17:24:36,033][177158] Sum rewards: -2.720, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.507', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.014', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'HITCOUNT': '0.220', 'WEAPON3': '0.650', 'weapon2': '0.768', 'DAMAGECOUNT': '1.095', 'weapon3': '1.162', 'FRAGCOUNT': '2.000'} [2023-02-24 17:24:36,150][177155] DAMAGECOUNT value on done: 381.0 [2023-02-24 17:24:36,151][177172] DAMAGECOUNT value on done: 201.0 [2023-02-24 17:24:36,168][177171] DAMAGECOUNT value on done: 302.0 [2023-02-24 17:24:36,169][177171] Sum rewards: -3.521, reward structure: {'DEATHCOUNT': '-8.250', 'ARMOR': '0.004', 'AMMO2': '0.012', 'AMMO5': '0.017', 'weapon4': '0.022', 'AMMO4': '0.059', 'HITCOUNT': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.104', 'AMMO3': '0.124', 'HEALTH': '0.141', 'DAMAGECOUNT': '0.240', 'WEAPON5': '0.250', 'WEAPON3': '0.650', 'weapon2': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.046'} [2023-02-24 17:24:36,204][177154] DAMAGECOUNT value on done: 423.0 [2023-02-24 17:24:36,204][177154] Sum rewards: -2.384, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.014', 'AMMO5': '0.007', 'AMMO2': '0.023', 'ARMOR': '0.028', 'WEAPON1': '0.030', 'weapon5': '0.046', 'weapon4': '0.066', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'AMMO4': '0.113', 'HITCOUNT': '0.120', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.339', 'WEAPON3': '0.450', 'weapon2': '0.892', 'weapon3': '0.916', 'FRAGCOUNT': '1.000'} [2023-02-24 17:24:36,207][177157] DAMAGECOUNT value on done: 411.0 [2023-02-24 17:24:36,308][177170] DAMAGECOUNT value on done: 1107.0 [2023-02-24 17:24:36,309][177170] Sum rewards: -5.114, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.596', 'FRAGCOUNT': '-1.500', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'HITCOUNT': '0.030', 'AMMO2': '0.041', 'AMMO3': '0.061', 'weapon5': '0.070', 'DAMAGECOUNT': '0.105', 'weapon4': '0.166', 'AMMO4': '0.203', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'weapon3': '0.550', 'weapon2': '1.084'} [2023-02-24 17:24:36,328][177158] DAMAGECOUNT value on done: 246.0 [2023-02-24 17:24:36,328][177158] Sum rewards: -6.890, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-3.018', 'AMMO5': '0.005', 'AMMO2': '0.016', 'ARMOR': '0.040', 'weapon5': '0.044', 'HITCOUNT': '0.060', 'AMMO4': '0.078', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'weapon4': '0.120', 'DAMAGECOUNT': '0.150', 'WEAPON4': '0.200', 'weapon3': '0.474', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.442'} [2023-02-24 17:24:36,376][177119] Fps is (10 sec: 14335.9, 60 sec: 14404.3, 300 sec: 14012.7). Total num frames: 1331200. Throughput: 0: 3600.1. Samples: 326464. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:24:36,376][177119] Avg episode reward: [(0, '-6.154')] [2023-02-24 17:24:36,380][177140] Saving new best policy, reward=-6.154! [2023-02-24 17:24:36,447][177156] DAMAGECOUNT value on done: 334.0 [2023-02-24 17:24:36,448][177156] Sum rewards: -5.540, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.943', 'FRAGCOUNT': '-0.500', 'weapon4': '0.002', 'ARMOR': '0.004', 'AMMO2': '0.011', 'AMMO5': '0.013', 'weapon5': '0.022', 'AMMO4': '0.056', 'HITCOUNT': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.387', 'WEAPON3': '0.750', 'weapon2': '0.948', 'weapon3': '1.274'} [2023-02-24 17:24:36,450][177172] DAMAGECOUNT value on done: 126.0 [2023-02-24 17:24:36,458][177155] DAMAGECOUNT value on done: 301.0 [2023-02-24 17:24:36,459][177155] Sum rewards: -7.587, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.595', 'ARMOR': '0.020', 'AMMO2': '0.033', 'HITCOUNT': '0.050', 'weapon4': '0.116', 'AMMO3': '0.122', 'DAMAGECOUNT': '0.150', 'AMMO4': '0.163', 'WEAPON4': '0.250', 'WEAPON3': '0.650', 'weapon3': '0.882', 'FRAGCOUNT': '1.000', 'weapon2': '1.072'} [2023-02-24 17:24:36,483][177171] DAMAGECOUNT value on done: 194.0 [2023-02-24 17:24:36,484][177171] Sum rewards: -7.223, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.492', 'AMMO5': '0.007', 'AMMO2': '0.016', 'ARMOR': '0.036', 'HITCOUNT': '0.040', 'weapon5': '0.068', 'AMMO4': '0.080', 'DAMAGECOUNT': '0.102', 'AMMO3': '0.105', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.346', 'weapon3': '0.438', 'WEAPON3': '0.550', 'weapon2': '1.180'} [2023-02-24 17:24:36,519][177157] DAMAGECOUNT value on done: 290.0 [2023-02-24 17:24:36,522][177154] DAMAGECOUNT value on done: 105.0 [2023-02-24 17:24:36,601][177170] DAMAGECOUNT value on done: 295.0 [2023-02-24 17:24:36,636][177158] DAMAGECOUNT value on done: 422.0 [2023-02-24 17:24:36,637][177158] Sum rewards: -8.701, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.575', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.020', 'HITCOUNT': '0.060', 'weapon4': '0.066', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'AMMO3': '0.126', 'DAMAGECOUNT': '0.180', 'WEAPON4': '0.250', 'weapon3': '0.680', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.084'} [2023-02-24 17:24:36,744][177172] DAMAGECOUNT value on done: 280.0 [2023-02-24 17:24:36,744][177172] Sum rewards: -0.644, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.446', 'weapon5': '0.014', 'AMMO5': '0.018', 'ARMOR': '0.036', 'AMMO2': '0.046', 'HITCOUNT': '0.060', 'AMMO3': '0.084', 'DAMAGECOUNT': '0.180', 'AMMO4': '0.230', 'WEAPON5': '0.300', 'weapon4': '0.364', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'weapon3': '0.700', 'weapon2': '0.920', 'FRAGCOUNT': '2.000'} [2023-02-24 17:24:36,748][177156] DAMAGECOUNT value on done: 242.0 [2023-02-24 17:24:36,765][177155] DAMAGECOUNT value on done: 182.0 [2023-02-24 17:24:36,765][177155] Sum rewards: -6.636, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.512', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'AMMO2': '0.022', 'HITCOUNT': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.115', 'weapon4': '0.146', 'DAMAGECOUNT': '0.174', 'WEAPON4': '0.250', 'WEAPON3': '0.650', 'weapon3': '0.722', 'FRAGCOUNT': '1.000', 'weapon2': '1.234'} [2023-02-24 17:24:36,771][177171] DAMAGECOUNT value on done: 48.0 [2023-02-24 17:24:36,771][177171] Sum rewards: -9.562, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.674', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.010', 'weapon5': '0.014', 'WEAPON1': '0.020', 'HITCOUNT': '0.020', 'AMMO2': '0.029', 'ARMOR': '0.080', 'weapon4': '0.094', 'DAMAGECOUNT': '0.102', 'AMMO3': '0.130', 'AMMO4': '0.143', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON3': '0.650', 'weapon3': '0.676', 'weapon2': '0.994'} [2023-02-24 17:24:36,807][177154] DAMAGECOUNT value on done: 476.0 [2023-02-24 17:24:36,808][177157] DAMAGECOUNT value on done: 427.0 [2023-02-24 17:24:36,808][177154] Sum rewards: -3.177, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.199', 'AMMO2': '0.003', 'AMMO4': '0.015', 'WEAPON4': '0.050', 'weapon4': '0.056', 'AMMO3': '0.092', 'HITCOUNT': '0.110', 'DAMAGECOUNT': '0.438', 'WEAPON3': '0.550', 'weapon3': '0.784', 'weapon2': '1.174', 'FRAGCOUNT': '3.000'} [2023-02-24 17:24:36,808][177157] Sum rewards: -3.989, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.790', 'AMMO2': '0.003', 'AMMO4': '0.013', 'WEAPON4': '0.100', 'AMMO3': '0.147', 'HITCOUNT': '0.210', 'weapon4': '0.220', 'WEAPON3': '0.700', 'weapon3': '0.702', 'DAMAGECOUNT': '0.810', 'weapon2': '1.146', 'FRAGCOUNT': '2.000'} [2023-02-24 17:24:36,897][177170] DAMAGECOUNT value on done: 337.0 [2023-02-24 17:24:36,929][177158] DAMAGECOUNT value on done: 305.0 [2023-02-24 17:24:37,036][177172] DAMAGECOUNT value on done: 235.0 [2023-02-24 17:24:37,038][177156] DAMAGECOUNT value on done: 158.0 [2023-02-24 17:24:37,038][177156] Sum rewards: -8.331, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.740', 'AMMO2': '0.015', 'ARMOR': '0.028', 'weapon4': '0.030', 'HITCOUNT': '0.050', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.135', 'AMMO3': '0.157', 'WEAPON3': '0.750', 'weapon3': '0.782', 'FRAGCOUNT': '1.000', 'weapon2': '1.038'} [2023-02-24 17:24:37,051][177155] DAMAGECOUNT value on done: 170.0 [2023-02-24 17:24:37,063][177171] DAMAGECOUNT value on done: 71.0 [2023-02-24 17:24:37,064][177171] Sum rewards: -7.718, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.546', 'AMMO5': '0.005', 'AMMO2': '0.012', 'HITCOUNT': '0.020', 'DAMAGECOUNT': '0.045', 'AMMO4': '0.061', 'weapon5': '0.080', 'AMMO3': '0.146', 'WEAPON5': '0.150', 'WEAPON3': '0.650', 'weapon3': '0.910', 'FRAGCOUNT': '1.000', 'weapon2': '1.248'} [2023-02-24 17:24:37,090][177154] DAMAGECOUNT value on done: 310.0 [2023-02-24 17:24:37,099][177157] DAMAGECOUNT value on done: 317.0 [2023-02-24 17:24:37,332][177156] DAMAGECOUNT value on done: 162.0 [2023-02-24 17:24:37,758][177153] Updated weights for policy 0, policy_version 330 (0.0008) [2023-02-24 17:24:40,550][177153] Updated weights for policy 0, policy_version 340 (0.0008) [2023-02-24 17:24:41,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14404.3, 300 sec: 14008.4). Total num frames: 1400832. Throughput: 0: 3597.1. Samples: 347996. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 17:24:41,376][177119] Avg episode reward: [(0, '-6.171')] [2023-02-24 17:24:43,385][177153] Updated weights for policy 0, policy_version 350 (0.0009) [2023-02-24 17:24:46,234][177153] Updated weights for policy 0, policy_version 360 (0.0008) [2023-02-24 17:24:46,376][177119] Fps is (10 sec: 14336.1, 60 sec: 14404.3, 300 sec: 14043.5). Total num frames: 1474560. Throughput: 0: 3597.7. Samples: 369580. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 17:24:46,376][177119] Avg episode reward: [(0, '-6.171')] [2023-02-24 17:24:49,094][177153] Updated weights for policy 0, policy_version 370 (0.0008) [2023-02-24 17:24:51,376][177119] Fps is (10 sec: 14745.5, 60 sec: 14404.3, 300 sec: 14075.4). Total num frames: 1548288. Throughput: 0: 3592.8. Samples: 380328. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 17:24:51,376][177119] Avg episode reward: [(0, '-6.171')] [2023-02-24 17:24:51,944][177153] Updated weights for policy 0, policy_version 380 (0.0008) [2023-02-24 17:24:54,512][177170] DAMAGECOUNT value on done: 340.0 [2023-02-24 17:24:54,512][177170] Sum rewards: -6.465, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.960', 'AMMO2': '0.029', 'ARMOR': '0.080', 'AMMO3': '0.108', 'HITCOUNT': '0.120', 'weapon4': '0.142', 'AMMO4': '0.143', 'DAMAGECOUNT': '0.345', 'WEAPON4': '0.400', 'WEAPON3': '0.600', 'weapon3': '0.734', 'FRAGCOUNT': '1.000', 'weapon2': '1.544'} [2023-02-24 17:24:54,711][177158] DAMAGECOUNT value on done: 585.0 [2023-02-24 17:24:54,711][177158] Sum rewards: -6.351, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.068', 'AMMO5': '0.003', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'ARMOR': '0.016', 'AMMO4': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.054', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.116', 'AMMO3': '0.143', 'DAMAGECOUNT': '0.270', 'WEAPON3': '0.700', 'weapon3': '0.784', 'FRAGCOUNT': '1.000', 'weapon2': '1.104'} [2023-02-24 17:24:54,812][177153] Updated weights for policy 0, policy_version 390 (0.0008) [2023-02-24 17:24:54,820][177170] DAMAGECOUNT value on done: 1162.0 [2023-02-24 17:24:54,846][177171] DAMAGECOUNT value on done: 351.0 [2023-02-24 17:24:54,892][177172] DAMAGECOUNT value on done: 216.0 [2023-02-24 17:24:54,935][177155] DAMAGECOUNT value on done: 527.0 [2023-02-24 17:24:54,935][177155] Sum rewards: -4.779, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.942', 'AMMO5': '0.005', 'AMMO2': '0.005', 'ARMOR': '0.012', 'AMMO4': '0.027', 'WEAPON1': '0.030', 'weapon5': '0.042', 'WEAPON5': '0.050', 'HITCOUNT': '0.090', 'AMMO3': '0.116', 'DAMAGECOUNT': '0.438', 'WEAPON3': '0.650', 'weapon2': '0.858', 'FRAGCOUNT': '1.000', 'weapon3': '1.090'} [2023-02-24 17:24:54,950][177154] DAMAGECOUNT value on done: 712.0 [2023-02-24 17:24:54,950][177154] Sum rewards: -0.825, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.029', 'HEALTH': '0.042', 'ARMOR': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'AMMO4': '0.144', 'HITCOUNT': '0.180', 'weapon4': '0.252', 'WEAPON3': '0.650', 'weapon3': '0.688', 'DAMAGECOUNT': '0.867', 'weapon2': '1.256', 'FRAGCOUNT': '3.000'} [2023-02-24 17:24:54,955][177157] DAMAGECOUNT value on done: 438.0 [2023-02-24 17:24:55,000][177158] DAMAGECOUNT value on done: 321.0 [2023-02-24 17:24:55,001][177158] Sum rewards: -4.878, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.848', 'AMMO2': '0.006', 'weapon4': '0.022', 'AMMO4': '0.029', 'HITCOUNT': '0.080', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.225', 'WEAPON3': '0.350', 'weapon3': '0.386', 'ARMOR': '0.846', 'FRAGCOUNT': '1.000', 'weapon2': '1.838'} [2023-02-24 17:24:55,088][177170] DAMAGECOUNT value on done: 295.0 [2023-02-24 17:24:55,088][177170] Sum rewards: -8.835, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.486', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.026', 'weapon4': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'ARMOR': '0.476', 'WEAPON3': '0.600', 'weapon3': '0.688', 'weapon2': '1.484'} [2023-02-24 17:24:55,141][177171] DAMAGECOUNT value on done: 254.0 [2023-02-24 17:24:55,192][177172] DAMAGECOUNT value on done: 191.0 [2023-02-24 17:24:55,233][177155] DAMAGECOUNT value on done: 316.0 [2023-02-24 17:24:55,249][177157] DAMAGECOUNT value on done: 402.0 [2023-02-24 17:24:55,249][177154] DAMAGECOUNT value on done: 227.0 [2023-02-24 17:24:55,250][177154] Sum rewards: -3.502, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.793', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.038', 'ARMOR': '0.044', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'WEAPON4': '0.200', 'weapon4': '0.262', 'DAMAGECOUNT': '0.366', 'WEAPON3': '0.500', 'weapon3': '0.754', 'weapon2': '1.316', 'FRAGCOUNT': '2.000'} [2023-02-24 17:24:55,267][177156] DAMAGECOUNT value on done: 459.0 [2023-02-24 17:24:55,267][177156] Sum rewards: -10.277, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.435', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.007', 'AMMO4': '0.035', 'WEAPON5': '0.050', 'weapon4': '0.070', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.208', 'DAMAGECOUNT': '0.375', 'ARMOR': '0.404', 'weapon3': '0.926', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.050', 'weapon2': '1.304'} [2023-02-24 17:24:55,294][177158] DAMAGECOUNT value on done: 477.0 [2023-02-24 17:24:55,380][177170] DAMAGECOUNT value on done: 587.0 [2023-02-24 17:24:55,381][177170] Sum rewards: -4.060, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.820', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'HITCOUNT': '0.060', 'weapon5': '0.114', 'AMMO3': '0.131', 'WEAPON5': '0.150', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.750', 'weapon3': '0.980', 'FRAGCOUNT': '1.000', 'weapon2': '1.038'} [2023-02-24 17:24:55,422][177171] DAMAGECOUNT value on done: 106.0 [2023-02-24 17:24:55,483][177172] DAMAGECOUNT value on done: 325.0 [2023-02-24 17:24:55,484][177172] Sum rewards: -8.081, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.362', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon4': '0.018', 'weapon5': '0.024', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'HITCOUNT': '0.050', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.125', 'DAMAGECOUNT': '0.135', 'WEAPON3': '0.700', 'weapon3': '1.004', 'weapon2': '1.434'} [2023-02-24 17:24:55,525][177155] DAMAGECOUNT value on done: 257.0 [2023-02-24 17:24:55,525][177154] DAMAGECOUNT value on done: 486.0 [2023-02-24 17:24:55,540][177157] DAMAGECOUNT value on done: 548.0 [2023-02-24 17:24:55,540][177157] Sum rewards: -8.094, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.806', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.003', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'weapon5': '0.042', 'WEAPON5': '0.050', 'HITCOUNT': '0.090', 'AMMO3': '0.215', 'DAMAGECOUNT': '0.363', 'weapon3': '0.740', 'WEAPON3': '1.050', 'weapon2': '1.390'} [2023-02-24 17:24:55,564][177156] DAMAGECOUNT value on done: 272.0 [2023-02-24 17:24:55,593][177158] DAMAGECOUNT value on done: 329.0 [2023-02-24 17:24:55,715][177171] DAMAGECOUNT value on done: 130.0 [2023-02-24 17:24:55,773][177172] DAMAGECOUNT value on done: 330.0 [2023-02-24 17:24:55,801][177154] DAMAGECOUNT value on done: 362.0 [2023-02-24 17:24:55,818][177155] DAMAGECOUNT value on done: 205.0 [2023-02-24 17:24:55,835][177157] DAMAGECOUNT value on done: 357.0 [2023-02-24 17:24:55,858][177156] DAMAGECOUNT value on done: 168.0 [2023-02-24 17:24:56,141][177156] DAMAGECOUNT value on done: 332.0 [2023-02-24 17:24:56,141][177156] Sum rewards: -6.561, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.177', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'HITCOUNT': '0.130', 'WEAPON4': '0.300', 'weapon4': '0.406', 'ARMOR': '0.436', 'weapon3': '0.488', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.238'} [2023-02-24 17:24:56,376][177119] Fps is (10 sec: 14336.1, 60 sec: 14404.3, 300 sec: 14068.9). Total num frames: 1617920. Throughput: 0: 3590.3. Samples: 401798. Policy #0 lag: (min: 0.0, avg: 0.4, max: 2.0) [2023-02-24 17:24:56,376][177119] Avg episode reward: [(0, '-6.137')] [2023-02-24 17:24:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000000395_1617920.pth... [2023-02-24 17:24:56,438][177140] Saving new best policy, reward=-6.137! [2023-02-24 17:24:56,869][177157] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 17:24:57,706][177153] Updated weights for policy 0, policy_version 400 (0.0009) [2023-02-24 17:25:00,532][177153] Updated weights for policy 0, policy_version 410 (0.0009) [2023-02-24 17:25:01,376][177119] Fps is (10 sec: 13926.5, 60 sec: 14336.0, 300 sec: 14063.0). Total num frames: 1687552. Throughput: 0: 3591.5. Samples: 423394. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:25:01,376][177119] Avg episode reward: [(0, '-6.137')] [2023-02-24 17:25:03,412][177153] Updated weights for policy 0, policy_version 420 (0.0008) [2023-02-24 17:25:06,287][177153] Updated weights for policy 0, policy_version 430 (0.0009) [2023-02-24 17:25:06,376][177119] Fps is (10 sec: 14335.8, 60 sec: 14336.0, 300 sec: 14090.3). Total num frames: 1761280. Throughput: 0: 3593.4. Samples: 434162. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:25:06,376][177119] Avg episode reward: [(0, '-6.137')] [2023-02-24 17:25:09,162][177153] Updated weights for policy 0, policy_version 440 (0.0008) [2023-02-24 17:25:11,376][177119] Fps is (10 sec: 14335.9, 60 sec: 14336.0, 300 sec: 14084.0). Total num frames: 1830912. Throughput: 0: 3589.1. Samples: 455640. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:25:11,376][177119] Avg episode reward: [(0, '-6.137')] [2023-02-24 17:25:12,016][177153] Updated weights for policy 0, policy_version 450 (0.0008) [2023-02-24 17:25:13,241][177170] DAMAGECOUNT value on done: 471.0 [2023-02-24 17:25:13,241][177170] Sum rewards: -9.125, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.388', 'AMMO2': '0.014', 'weapon4': '0.044', 'ARMOR': '0.048', 'AMMO4': '0.067', 'HITCOUNT': '0.120', 'AMMO3': '0.129', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.393', 'WEAPON3': '0.750', 'weapon3': '0.916', 'FRAGCOUNT': '1.000', 'weapon2': '1.582'} [2023-02-24 17:25:13,362][177158] DAMAGECOUNT value on done: 735.0 [2023-02-24 17:25:13,362][177158] Sum rewards: -4.627, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.149', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO3': '0.140', 'HITCOUNT': '0.140', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.118', 'weapon2': '1.122'} [2023-02-24 17:25:13,536][177170] DAMAGECOUNT value on done: 1207.0 [2023-02-24 17:25:13,546][177154] DAMAGECOUNT value on done: 828.0 [2023-02-24 17:25:13,547][177154] Sum rewards: -4.544, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.721', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'HITCOUNT': '0.020', 'AMMO3': '0.072', 'ARMOR': '0.080', 'weapon5': '0.100', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.348', 'WEAPON3': '0.400', 'weapon3': '0.696', 'FRAGCOUNT': '1.000', 'weapon2': '1.404'} [2023-02-24 17:25:13,581][177171] DAMAGECOUNT value on done: 378.0 [2023-02-24 17:25:13,596][177172] DAMAGECOUNT value on done: 261.0 [2023-02-24 17:25:13,654][177158] DAMAGECOUNT value on done: 351.0 [2023-02-24 17:25:13,654][177158] Sum rewards: -3.305, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.010', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.027', 'HITCOUNT': '0.030', 'ARMOR': '0.048', 'DAMAGECOUNT': '0.090', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.112', 'AMMO4': '0.135', 'WEAPON3': '0.550', 'weapon2': '0.954', 'FRAGCOUNT': '1.000', 'weapon3': '1.190'} [2023-02-24 17:25:13,714][177157] DAMAGECOUNT value on done: 698.0 [2023-02-24 17:25:13,715][177157] Sum rewards: -3.238, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.514', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.012', 'ARMOR': '0.047', 'AMMO4': '0.057', 'AMMO3': '0.081', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'weapon4': '0.192', 'WEAPON3': '0.450', 'weapon3': '0.768', 'DAMAGECOUNT': '0.780', 'weapon2': '1.204', 'FRAGCOUNT': '1.500'} [2023-02-24 17:25:13,821][177170] DAMAGECOUNT value on done: 408.0 [2023-02-24 17:25:13,821][177170] Sum rewards: -6.670, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.280', 'AMMO2': '0.014', 'ARMOR': '0.040', 'weapon4': '0.046', 'AMMO4': '0.069', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.152', 'DAMAGECOUNT': '0.339', 'WEAPON3': '0.800', 'weapon3': '0.866', 'FRAGCOUNT': '1.000', 'weapon2': '1.584'} [2023-02-24 17:25:13,833][177155] DAMAGECOUNT value on done: 537.0 [2023-02-24 17:25:13,844][177154] DAMAGECOUNT value on done: 330.0 [2023-02-24 17:25:13,845][177154] Sum rewards: -4.812, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.300', 'AMMO5': '0.004', 'AMMO2': '0.013', 'weapon5': '0.028', 'ARMOR': '0.036', 'AMMO4': '0.064', 'HITCOUNT': '0.080', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'weapon4': '0.148', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.309', 'WEAPON3': '0.550', 'weapon2': '1.052', 'weapon3': '1.112'} [2023-02-24 17:25:13,872][177171] DAMAGECOUNT value on done: 280.0 [2023-02-24 17:25:13,873][177171] Sum rewards: -8.809, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.660', 'AMMO2': '0.007', 'AMMO5': '0.009', 'AMMO4': '0.034', 'HITCOUNT': '0.040', 'weapon5': '0.040', 'weapon4': '0.044', 'DAMAGECOUNT': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.154', 'ARMOR': '0.533', 'WEAPON3': '0.750', 'weapon3': '0.968', 'FRAGCOUNT': '1.000', 'weapon2': '1.244'} [2023-02-24 17:25:13,886][177172] DAMAGECOUNT value on done: 319.0 [2023-02-24 17:25:13,886][177172] Sum rewards: -9.108, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.438', 'AMMO2': '0.006', 'AMMO4': '0.027', 'weapon4': '0.028', 'WEAPON4': '0.050', 'HITCOUNT': '0.130', 'AMMO3': '0.135', 'DAMAGECOUNT': '0.384', 'ARMOR': '0.448', 'WEAPON3': '0.550', 'weapon3': '0.728', 'FRAGCOUNT': '1.000', 'weapon2': '1.844'} [2023-02-24 17:25:13,988][177158] DAMAGECOUNT value on done: 506.0 [2023-02-24 17:25:14,021][177157] DAMAGECOUNT value on done: 457.0 [2023-02-24 17:25:14,021][177157] Sum rewards: -6.250, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.460', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.016', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'HITCOUNT': '0.060', 'AMMO4': '0.061', 'AMMO3': '0.065', 'DAMAGECOUNT': '0.165', 'weapon4': '0.216', 'WEAPON3': '0.350', 'weapon3': '0.664', 'weapon2': '1.454'} [2023-02-24 17:25:14,118][177170] DAMAGECOUNT value on done: 799.0 [2023-02-24 17:25:14,118][177170] Sum rewards: -2.678, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.760', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'FRAGCOUNT': '0.000', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'weapon5': '0.090', 'AMMO3': '0.101', 'weapon7': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.140', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.636', 'WEAPON3': '0.650', 'weapon2': '0.778', 'weapon3': '1.168'} [2023-02-24 17:25:14,128][177155] DAMAGECOUNT value on done: 376.0 [2023-02-24 17:25:14,129][177155] Sum rewards: -5.824, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.463', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'weapon4': '0.028', 'AMMO4': '0.052', 'HITCOUNT': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'DAMAGECOUNT': '0.180', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.080', 'weapon3': '1.412'} [2023-02-24 17:25:14,139][177154] DAMAGECOUNT value on done: 611.0 [2023-02-24 17:25:14,149][177156] DAMAGECOUNT value on done: 599.0 [2023-02-24 17:25:14,164][177171] DAMAGECOUNT value on done: 189.0 [2023-02-24 17:25:14,165][177171] Sum rewards: -6.041, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.846', 'AMMO5': '0.009', 'AMMO2': '0.010', 'weapon5': '0.022', 'HITCOUNT': '0.040', 'AMMO4': '0.050', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.249', 'weapon4': '0.264', 'ARMOR': '0.475', 'WEAPON3': '0.500', 'weapon3': '0.688', 'weapon2': '1.352', 'FRAGCOUNT': '2.000'} [2023-02-24 17:25:14,189][177172] DAMAGECOUNT value on done: 350.0 [2023-02-24 17:25:14,285][177158] DAMAGECOUNT value on done: 521.0 [2023-02-24 17:25:14,286][177158] Sum rewards: -6.671, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.692', 'AMMO5': '0.010', 'weapon5': '0.024', 'AMMO2': '0.025', 'ARMOR': '0.028', 'weapon4': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'HITCOUNT': '0.150', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.576', 'WEAPON3': '0.850', 'weapon3': '0.880', 'FRAGCOUNT': '1.000', 'weapon2': '1.276'} [2023-02-24 17:25:14,312][177157] DAMAGECOUNT value on done: 628.0 [2023-02-24 17:25:14,313][177157] Sum rewards: -6.346, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.650', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.020', 'ARMOR': '0.040', 'HITCOUNT': '0.060', 'AMMO4': '0.083', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.144', 'DAMAGECOUNT': '0.240', 'WEAPON3': '0.500', 'weapon3': '0.676', 'weapon2': '1.232'} [2023-02-24 17:25:14,365][177155] DAMAGECOUNT value on done: 297.0 [2023-02-24 17:25:14,366][177155] Sum rewards: -5.427, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.466', 'AMMO5': '0.009', 'weapon5': '0.020', 'AMMO2': '0.032', 'HITCOUNT': '0.040', 'AMMO3': '0.063', 'ARMOR': '0.068', 'DAMAGECOUNT': '0.120', 'AMMO4': '0.159', 'WEAPON5': '0.200', 'weapon4': '0.202', 'WEAPON4': '0.300', 'weapon3': '0.302', 'WEAPON3': '0.350', 'FRAGCOUNT': '1.000', 'weapon2': '1.924'} [2023-02-24 17:25:14,440][177154] DAMAGECOUNT value on done: 387.0 [2023-02-24 17:25:14,448][177156] DAMAGECOUNT value on done: 282.0 [2023-02-24 17:25:14,466][177171] DAMAGECOUNT value on done: 172.0 [2023-02-24 17:25:14,481][177172] DAMAGECOUNT value on done: 352.0 [2023-02-24 17:25:14,603][177157] DAMAGECOUNT value on done: 402.0 [2023-02-24 17:25:14,661][177155] DAMAGECOUNT value on done: 220.0 [2023-02-24 17:25:14,740][177156] DAMAGECOUNT value on done: 189.0 [2023-02-24 17:25:14,933][177153] Updated weights for policy 0, policy_version 460 (0.0008) [2023-02-24 17:25:15,024][177156] DAMAGECOUNT value on done: 392.0 [2023-02-24 17:25:16,376][177119] Fps is (10 sec: 14336.1, 60 sec: 14336.0, 300 sec: 14108.5). Total num frames: 1904640. Throughput: 0: 3584.7. Samples: 476982. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:25:16,376][177119] Avg episode reward: [(0, '-6.178')] [2023-02-24 17:25:17,780][177153] Updated weights for policy 0, policy_version 470 (0.0008) [2023-02-24 17:25:20,609][177153] Updated weights for policy 0, policy_version 480 (0.0008) [2023-02-24 17:25:21,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14336.0, 300 sec: 14102.0). Total num frames: 1974272. Throughput: 0: 3586.5. Samples: 487858. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:25:21,376][177119] Avg episode reward: [(0, '-6.178')] [2023-02-24 17:25:23,436][177153] Updated weights for policy 0, policy_version 490 (0.0009) [2023-02-24 17:25:26,283][177153] Updated weights for policy 0, policy_version 500 (0.0008) [2023-02-24 17:25:26,376][177119] Fps is (10 sec: 14336.1, 60 sec: 14336.0, 300 sec: 14124.2). Total num frames: 2048000. Throughput: 0: 3585.5. Samples: 509342. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:25:26,376][177119] Avg episode reward: [(0, '-6.178')] [2023-02-24 17:25:29,142][177153] Updated weights for policy 0, policy_version 510 (0.0008) [2023-02-24 17:25:31,376][177119] Fps is (10 sec: 14336.2, 60 sec: 14336.0, 300 sec: 14117.6). Total num frames: 2117632. Throughput: 0: 3584.6. Samples: 530886. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:25:31,376][177119] Avg episode reward: [(0, '-6.178')] [2023-02-24 17:25:31,949][177170] DAMAGECOUNT value on done: 590.0 [2023-02-24 17:25:31,949][177170] Sum rewards: -6.751, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.334', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.012', 'weapon5': '0.016', 'AMMO2': '0.018', 'HITCOUNT': '0.070', 'weapon4': '0.084', 'AMMO4': '0.088', 'AMMO3': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.357', 'ARMOR': '0.460', 'WEAPON3': '0.700', 'weapon3': '1.112', 'weapon2': '1.490'} [2023-02-24 17:25:32,009][177153] Updated weights for policy 0, policy_version 520 (0.0008) [2023-02-24 17:25:32,095][177158] DAMAGECOUNT value on done: 755.0 [2023-02-24 17:25:32,249][177170] DAMAGECOUNT value on done: 1472.0 [2023-02-24 17:25:32,249][177170] Sum rewards: -0.240, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.280', 'AMMO2': '0.012', 'AMMO4': '0.059', 'ARMOR': '0.064', 'AMMO3': '0.086', 'HITCOUNT': '0.200', 'weapon4': '0.232', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.795', 'weapon3': '1.142', 'weapon2': '1.350', 'FRAGCOUNT': '3.000'} [2023-02-24 17:25:32,353][177154] DAMAGECOUNT value on done: 915.0 [2023-02-24 17:25:32,353][177154] Sum rewards: -2.642, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.240', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'weapon5': '0.064', 'weapon4': '0.070', 'HITCOUNT': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.128', 'DAMAGECOUNT': '0.261', 'WEAPON3': '0.450', 'weapon3': '0.624', 'FRAGCOUNT': '1.000', 'weapon2': '1.480'} [2023-02-24 17:25:32,378][177171] DAMAGECOUNT value on done: 483.0 [2023-02-24 17:25:32,379][177171] Sum rewards: -1.937, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.510', 'AMMO2': '0.005', 'weapon4': '0.016', 'ARMOR': '0.020', 'AMMO4': '0.022', 'HITCOUNT': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'DAMAGECOUNT': '0.315', 'WEAPON3': '0.400', 'FRAGCOUNT': '1.000', 'weapon2': '1.026', 'weapon3': '1.508'} [2023-02-24 17:25:32,386][177158] DAMAGECOUNT value on done: 381.0 [2023-02-24 17:25:32,400][177172] DAMAGECOUNT value on done: 326.0 [2023-02-24 17:25:32,508][177157] DAMAGECOUNT value on done: 875.0 [2023-02-24 17:25:32,509][177157] Sum rewards: -7.229, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.065', 'AMMO5': '0.004', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon5': '0.044', 'ARMOR': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'HITCOUNT': '0.110', 'weapon4': '0.118', 'AMMO3': '0.127', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.531', 'WEAPON3': '0.700', 'weapon3': '0.826', 'FRAGCOUNT': '1.000', 'weapon2': '1.816'} [2023-02-24 17:25:32,535][177170] DAMAGECOUNT value on done: 463.0 [2023-02-24 17:25:32,535][177170] Sum rewards: -3.978, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.685', 'AMMO5': '0.005', 'AMMO2': '0.011', 'HITCOUNT': '0.050', 'AMMO3': '0.055', 'AMMO4': '0.057', 'DAMAGECOUNT': '0.165', 'weapon4': '0.248', 'WEAPON4': '0.300', 'WEAPON3': '0.300', 'weapon3': '0.626', 'FRAGCOUNT': '1.000', 'weapon2': '1.640'} [2023-02-24 17:25:32,629][177155] DAMAGECOUNT value on done: 677.0 [2023-02-24 17:25:32,629][177155] Sum rewards: -3.316, reward structure: {'DEATHCOUNT': '-4.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.467', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO4': '0.020', 'weapon5': '0.038', 'ARMOR': '0.058', 'AMMO3': '0.086', 'HITCOUNT': '0.110', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.318', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.450', 'weapon3': '1.108', 'weapon2': '1.166'} [2023-02-24 17:25:32,653][177154] DAMAGECOUNT value on done: 385.0 [2023-02-24 17:25:32,654][177154] Sum rewards: -5.915, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.718', 'AMMO5': '0.010', 'AMMO2': '0.018', 'HITCOUNT': '0.050', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO3': '0.142', 'DAMAGECOUNT': '0.165', 'WEAPON4': '0.200', 'weapon4': '0.272', 'ARMOR': '0.486', 'WEAPON3': '0.750', 'weapon3': '0.834', 'weapon2': '1.322'} [2023-02-24 17:25:32,681][177171] DAMAGECOUNT value on done: 385.0 [2023-02-24 17:25:32,681][177171] Sum rewards: -0.555, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.164', 'AMMO2': '0.020', 'AMMO3': '0.093', 'AMMO4': '0.098', 'HITCOUNT': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.220', 'DAMAGECOUNT': '0.315', 'WEAPON3': '0.400', 'weapon3': '0.676', 'ARMOR': '1.341', 'weapon2': '1.646', 'FRAGCOUNT': '2.000'} [2023-02-24 17:25:32,685][177172] DAMAGECOUNT value on done: 603.0 [2023-02-24 17:25:32,686][177172] Sum rewards: -6.920, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.690', 'FRAGCOUNT': '-1.500', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.048', 'AMMO3': '0.095', 'WEAPON5': '0.250', 'HITCOUNT': '0.300', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.852', 'weapon3': '1.164', 'weapon2': '1.308'} [2023-02-24 17:25:32,718][177158] DAMAGECOUNT value on done: 588.0 [2023-02-24 17:25:32,805][177157] DAMAGECOUNT value on done: 492.0 [2023-02-24 17:25:32,826][177170] DAMAGECOUNT value on done: 874.0 [2023-02-24 17:25:32,924][177155] DAMAGECOUNT value on done: 453.0 [2023-02-24 17:25:32,925][177155] Sum rewards: -5.234, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.478', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'weapon5': '0.046', 'AMMO4': '0.084', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'weapon4': '0.182', 'DAMAGECOUNT': '0.231', 'ARMOR': '0.408', 'WEAPON3': '0.600', 'weapon3': '0.744', 'FRAGCOUNT': '1.000', 'weapon2': '1.434'} [2023-02-24 17:25:32,946][177154] DAMAGECOUNT value on done: 756.0 [2023-02-24 17:25:32,980][177171] DAMAGECOUNT value on done: 254.0 [2023-02-24 17:25:32,980][177171] Sum rewards: -7.010, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.330', 'AMMO2': '0.011', 'ARMOR': '0.038', 'AMMO4': '0.054', 'HITCOUNT': '0.070', 'AMMO3': '0.128', 'weapon4': '0.194', 'DAMAGECOUNT': '0.195', 'WEAPON4': '0.250', 'WEAPON3': '0.650', 'weapon3': '0.832', 'FRAGCOUNT': '1.000', 'weapon2': '1.648'} [2023-02-24 17:25:32,986][177172] DAMAGECOUNT value on done: 537.0 [2023-02-24 17:25:32,986][177172] Sum rewards: -0.925, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.385', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO3': '0.146', 'HITCOUNT': '0.150', 'DAMAGECOUNT': '0.561', 'weapon2': '0.816', 'WEAPON3': '0.850', 'weapon3': '1.578', 'FRAGCOUNT': '3.000'} [2023-02-24 17:25:32,990][177156] DAMAGECOUNT value on done: 616.0 [2023-02-24 17:25:33,016][177158] DAMAGECOUNT value on done: 626.0 [2023-02-24 17:25:33,017][177158] Sum rewards: -7.529, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.140', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.045', 'weapon4': '0.056', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'DAMAGECOUNT': '0.315', 'WEAPON3': '0.700', 'weapon3': '0.936', 'FRAGCOUNT': '1.000', 'weapon2': '1.468'} [2023-02-24 17:25:33,099][177157] DAMAGECOUNT value on done: 808.0 [2023-02-24 17:25:33,100][177157] Sum rewards: -1.689, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.198', 'AMMO2': '0.002', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO4': '0.009', 'weapon5': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.133', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.540', 'WEAPON3': '0.700', 'weapon2': '0.990', 'FRAGCOUNT': '1.000', 'weapon3': '1.658'} [2023-02-24 17:25:33,188][177155] DAMAGECOUNT value on done: 434.0 [2023-02-24 17:25:33,247][177154] DAMAGECOUNT value on done: 657.0 [2023-02-24 17:25:33,248][177154] Sum rewards: -6.108, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.002', 'AMMO5': '0.008', 'AMMO2': '0.010', 'weapon4': '0.016', 'ARMOR': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.046', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.810', 'WEAPON3': '0.850', 'weapon3': '0.866', 'weapon2': '1.632'} [2023-02-24 17:25:33,274][177171] DAMAGECOUNT value on done: 326.0 [2023-02-24 17:25:33,274][177171] Sum rewards: -3.461, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.562', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.025', 'AMMO3': '0.045', 'ARMOR': '0.056', 'HITCOUNT': '0.080', 'weapon5': '0.086', 'AMMO4': '0.126', 'WEAPON5': '0.250', 'WEAPON3': '0.250', 'weapon4': '0.340', 'WEAPON4': '0.350', 'DAMAGECOUNT': '0.462', 'weapon3': '0.518', 'FRAGCOUNT': '1.000', 'weapon2': '1.738'} [2023-02-24 17:25:33,281][177172] DAMAGECOUNT value on done: 434.0 [2023-02-24 17:25:33,291][177156] DAMAGECOUNT value on done: 377.0 [2023-02-24 17:25:33,291][177156] Sum rewards: -6.183, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.742', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.079', 'HITCOUNT': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'DAMAGECOUNT': '0.285', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.270', 'weapon2': '1.386'} [2023-02-24 17:25:33,384][177157] DAMAGECOUNT value on done: 452.0 [2023-02-24 17:25:33,481][177155] DAMAGECOUNT value on done: 264.0 [2023-02-24 17:25:33,481][177155] Sum rewards: -13.477, reward structure: {'DEATHCOUNT': '-12.750', 'FRAGCOUNT': '-3.000', 'HEALTH': '-2.218', 'AMMO5': '0.018', 'AMMO2': '0.033', 'HITCOUNT': '0.040', 'ARMOR': '0.084', 'weapon4': '0.086', 'DAMAGECOUNT': '0.132', 'weapon5': '0.144', 'AMMO3': '0.155', 'AMMO4': '0.163', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon3': '0.650', 'WEAPON3': '0.850', 'weapon2': '1.586'} [2023-02-24 17:25:33,580][177156] DAMAGECOUNT value on done: 269.0 [2023-02-24 17:25:33,882][177156] DAMAGECOUNT value on done: 612.0 [2023-02-24 17:25:33,883][177156] Sum rewards: -4.624, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.322', 'AMMO2': '0.013', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'HITCOUNT': '0.150', 'weapon4': '0.182', 'ARMOR': '0.460', 'DAMAGECOUNT': '0.660', 'WEAPON3': '0.700', 'weapon3': '0.966', 'weapon2': '1.522', 'FRAGCOUNT': '2.000'} [2023-02-24 17:25:34,879][177153] Updated weights for policy 0, policy_version 530 (0.0008) [2023-02-24 17:25:36,376][177119] Fps is (10 sec: 14335.9, 60 sec: 14336.0, 300 sec: 14137.9). Total num frames: 2191360. Throughput: 0: 3577.8. Samples: 541328. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 17:25:36,376][177119] Avg episode reward: [(0, '-5.861')] [2023-02-24 17:25:36,379][177140] Saving new best policy, reward=-5.861! [2023-02-24 17:25:37,747][177153] Updated weights for policy 0, policy_version 540 (0.0008) [2023-02-24 17:25:40,624][177153] Updated weights for policy 0, policy_version 550 (0.0008) [2023-02-24 17:25:41,376][177119] Fps is (10 sec: 14335.9, 60 sec: 14336.0, 300 sec: 14131.3). Total num frames: 2260992. Throughput: 0: 3578.4. Samples: 562824. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 17:25:41,376][177119] Avg episode reward: [(0, '-5.861')] [2023-02-24 17:25:41,981][177155] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 17:25:43,484][177153] Updated weights for policy 0, policy_version 560 (0.0008) [2023-02-24 17:25:46,370][177153] Updated weights for policy 0, policy_version 570 (0.0008) [2023-02-24 17:25:46,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14336.0, 300 sec: 14149.9). Total num frames: 2334720. Throughput: 0: 3575.1. Samples: 584274. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 17:25:46,376][177119] Avg episode reward: [(0, '-5.861')] [2023-02-24 17:25:49,222][177153] Updated weights for policy 0, policy_version 580 (0.0008) [2023-02-24 17:25:50,801][177170] DAMAGECOUNT value on done: 835.0 [2023-02-24 17:25:50,801][177170] Sum rewards: -2.479, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.952', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.052', 'AMMO4': '0.059', 'AMMO3': '0.145', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.735', 'WEAPON3': '0.750', 'weapon3': '0.860', 'weapon2': '2.046', 'FRAGCOUNT': '4.000'} [2023-02-24 17:25:50,936][177158] DAMAGECOUNT value on done: 760.0 [2023-02-24 17:25:51,090][177170] DAMAGECOUNT value on done: 1694.0 [2023-02-24 17:25:51,091][177170] Sum rewards: -1.972, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.776', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.125', 'HITCOUNT': '0.150', 'weapon4': '0.240', 'WEAPON4': '0.250', 'ARMOR': '0.566', 'DAMAGECOUNT': '0.666', 'WEAPON3': '0.700', 'weapon3': '0.868', 'weapon2': '1.668', 'FRAGCOUNT': '2.000'} [2023-02-24 17:25:51,116][177154] DAMAGECOUNT value on done: 1065.0 [2023-02-24 17:25:51,138][177172] DAMAGECOUNT value on done: 381.0 [2023-02-24 17:25:51,138][177172] Sum rewards: -10.780, reward structure: {'DEATHCOUNT': '-12.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.998', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'weapon5': '0.048', 'HITCOUNT': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'DAMAGECOUNT': '0.165', 'AMMO3': '0.215', 'weapon3': '1.044', 'WEAPON3': '1.050', 'weapon2': '1.624'} [2023-02-24 17:25:51,234][177158] DAMAGECOUNT value on done: 526.0 [2023-02-24 17:25:51,234][177158] Sum rewards: -7.167, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.790', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.026', 'AMMO4': '0.066', 'HITCOUNT': '0.090', 'weapon4': '0.114', 'AMMO3': '0.143', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.024', 'weapon2': '1.754'} [2023-02-24 17:25:51,311][177171] DAMAGECOUNT value on done: 548.0 [2023-02-24 17:25:51,371][177157] DAMAGECOUNT value on done: 950.0 [2023-02-24 17:25:51,371][177157] Sum rewards: -4.607, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.056', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.012', 'AMMO4': '0.057', 'HITCOUNT': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.142', 'DAMAGECOUNT': '0.225', 'ARMOR': '0.432', 'WEAPON3': '0.650', 'weapon3': '0.946', 'FRAGCOUNT': '1.000', 'weapon2': '1.814'} [2023-02-24 17:25:51,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14267.7, 300 sec: 14143.3). Total num frames: 2404352. Throughput: 0: 3574.7. Samples: 595022. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:25:51,376][177119] Avg episode reward: [(0, '-5.815')] [2023-02-24 17:25:51,377][177140] Saving new best policy, reward=-5.815! [2023-02-24 17:25:51,380][177170] DAMAGECOUNT value on done: 518.0 [2023-02-24 17:25:51,381][177170] Sum rewards: -8.552, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.742', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.012', 'AMMO2': '0.032', 'HITCOUNT': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.110', 'weapon4': '0.118', 'AMMO4': '0.162', 'DAMAGECOUNT': '0.165', 'WEAPON4': '0.250', 'weapon3': '0.470', 'WEAPON3': '0.600', 'weapon2': '2.174'} [2023-02-24 17:25:51,416][177154] DAMAGECOUNT value on done: 442.0 [2023-02-24 17:25:51,454][177172] DAMAGECOUNT value on done: 738.0 [2023-02-24 17:25:51,454][177172] Sum rewards: -4.691, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.494', 'AMMO2': '0.007', 'weapon4': '0.018', 'AMMO4': '0.033', 'HITCOUNT': '0.080', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.450', 'weapon3': '0.944', 'FRAGCOUNT': '1.000', 'weapon2': '1.856'} [2023-02-24 17:25:51,455][177155] DAMAGECOUNT value on done: 712.0 [2023-02-24 17:25:51,592][177158] DAMAGECOUNT value on done: 708.0 [2023-02-24 17:25:51,593][177158] Sum rewards: -6.049, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.250', 'AMMO5': '0.004', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.027', 'weapon5': '0.042', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.154', 'DAMAGECOUNT': '0.360', 'ARMOR': '0.454', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.158', 'weapon2': '1.616'} [2023-02-24 17:25:51,622][177171] DAMAGECOUNT value on done: 435.0 [2023-02-24 17:25:51,622][177171] Sum rewards: -5.071, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.528', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.014', 'AMMO2': '0.014', 'weapon4': '0.054', 'HITCOUNT': '0.060', 'ARMOR': '0.071', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'AMMO3': '0.143', 'DAMAGECOUNT': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.650', 'weapon3': '0.988', 'weapon2': '1.974'} [2023-02-24 17:25:51,677][177157] DAMAGECOUNT value on done: 522.0 [2023-02-24 17:25:51,695][177170] DAMAGECOUNT value on done: 1079.0 [2023-02-24 17:25:51,718][177154] DAMAGECOUNT value on done: 806.0 [2023-02-24 17:25:51,743][177155] DAMAGECOUNT value on done: 482.0 [2023-02-24 17:25:51,751][177172] DAMAGECOUNT value on done: 582.0 [2023-02-24 17:25:51,883][177158] DAMAGECOUNT value on done: 731.0 [2023-02-24 17:25:51,915][177171] DAMAGECOUNT value on done: 423.0 [2023-02-24 17:25:51,916][177171] Sum rewards: -8.816, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.542', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.025', 'ARMOR': '0.080', 'WEAPON5': '0.100', 'weapon4': '0.118', 'AMMO4': '0.125', 'HITCOUNT': '0.130', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.507', 'WEAPON3': '0.600', 'weapon3': '0.606', 'weapon2': '2.384'} [2023-02-24 17:25:51,921][177156] DAMAGECOUNT value on done: 730.0 [2023-02-24 17:25:51,921][177156] Sum rewards: -1.559, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.688', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.007', 'weapon5': '0.034', 'WEAPON5': '0.050', 'ARMOR': '0.068', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'weapon4': '0.168', 'DAMAGECOUNT': '0.342', 'WEAPON3': '0.600', 'weapon3': '0.878', 'FRAGCOUNT': '1.000', 'weapon2': '1.658'} [2023-02-24 17:25:51,968][177157] DAMAGECOUNT value on done: 898.0 [2023-02-24 17:25:52,018][177154] DAMAGECOUNT value on done: 896.0 [2023-02-24 17:25:52,018][177154] Sum rewards: -1.121, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.076', 'AMMO5': '0.005', 'AMMO2': '0.010', 'ARMOR': '0.020', 'weapon5': '0.040', 'weapon4': '0.044', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'HITCOUNT': '0.200', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.717', 'weapon3': '1.290', 'weapon2': '1.484', 'FRAGCOUNT': '2.000'} [2023-02-24 17:25:52,028][177155] DAMAGECOUNT value on done: 591.0 [2023-02-24 17:25:52,029][177155] Sum rewards: -5.219, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.086', 'AMMO2': '0.017', 'ARMOR': '0.042', 'weapon4': '0.050', 'AMMO4': '0.083', 'AMMO3': '0.118', 'HITCOUNT': '0.120', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.471', 'WEAPON3': '0.650', 'weapon3': '0.918', 'FRAGCOUNT': '1.000', 'weapon2': '1.898'} [2023-02-24 17:25:52,056][177172] DAMAGECOUNT value on done: 513.0 [2023-02-24 17:25:52,162][177153] Updated weights for policy 0, policy_version 590 (0.0008) [2023-02-24 17:25:52,210][177171] DAMAGECOUNT value on done: 536.0 [2023-02-24 17:25:52,211][177171] Sum rewards: -10.846, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.238', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'weapon5': '0.008', 'weapon4': '0.014', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.130', 'AMMO3': '0.166', 'DAMAGECOUNT': '0.630', 'WEAPON3': '0.900', 'weapon3': '0.998', 'weapon2': '1.818'} [2023-02-24 17:25:52,219][177156] DAMAGECOUNT value on done: 392.0 [2023-02-24 17:25:52,259][177157] DAMAGECOUNT value on done: 575.0 [2023-02-24 17:25:52,330][177155] DAMAGECOUNT value on done: 400.0 [2023-02-24 17:25:52,331][177155] Sum rewards: -2.257, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.936', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.012', 'ARMOR': '0.036', 'weapon4': '0.038', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'DAMAGECOUNT': '0.408', 'WEAPON3': '0.500', 'FRAGCOUNT': '0.500', 'weapon3': '0.830', 'weapon2': '1.958'} [2023-02-24 17:25:52,507][177156] DAMAGECOUNT value on done: 309.0 [2023-02-24 17:25:52,792][177156] DAMAGECOUNT value on done: 819.0 [2023-02-24 17:25:54,999][177153] Updated weights for policy 0, policy_version 600 (0.0008) [2023-02-24 17:25:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14267.7, 300 sec: 14137.1). Total num frames: 2473984. Throughput: 0: 3572.0. Samples: 616380. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:25:56,376][177119] Avg episode reward: [(0, '-5.663')] [2023-02-24 17:25:56,386][177140] Saving new best policy, reward=-5.663! [2023-02-24 17:25:57,826][177153] Updated weights for policy 0, policy_version 610 (0.0008) [2023-02-24 17:26:00,694][177153] Updated weights for policy 0, policy_version 620 (0.0009) [2023-02-24 17:26:01,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14336.0, 300 sec: 14154.0). Total num frames: 2547712. Throughput: 0: 3575.6. Samples: 637886. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 17:26:01,376][177119] Avg episode reward: [(0, '-5.663')] [2023-02-24 17:26:03,551][177153] Updated weights for policy 0, policy_version 630 (0.0007) [2023-02-24 17:26:06,376][177119] Fps is (10 sec: 14335.7, 60 sec: 14267.7, 300 sec: 14147.8). Total num frames: 2617344. Throughput: 0: 3572.1. Samples: 648602. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 17:26:06,377][177119] Avg episode reward: [(0, '-5.663')] [2023-02-24 17:26:06,423][177153] Updated weights for policy 0, policy_version 640 (0.0008) [2023-02-24 17:26:09,307][177153] Updated weights for policy 0, policy_version 650 (0.0009) [2023-02-24 17:26:09,664][177170] DAMAGECOUNT value on done: 927.0 [2023-02-24 17:26:09,759][177158] DAMAGECOUNT value on done: 910.0 [2023-02-24 17:26:09,760][177158] Sum rewards: -4.592, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.176', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'ARMOR': '0.025', 'AMMO3': '0.065', 'HITCOUNT': '0.100', 'weapon4': '0.102', 'AMMO4': '0.104', 'weapon5': '0.108', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.450', 'FRAGCOUNT': '0.500', 'weapon3': '0.592', 'weapon2': '1.938'} [2023-02-24 17:26:09,826][177154] DAMAGECOUNT value on done: 1195.0 [2023-02-24 17:26:09,826][177154] Sum rewards: -5.465, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.986', 'AMMO2': '0.013', 'AMMO5': '0.022', 'ARMOR': '0.028', 'WEAPON1': '0.040', 'AMMO4': '0.066', 'weapon5': '0.074', 'HITCOUNT': '0.080', 'AMMO3': '0.084', 'weapon4': '0.196', 'WEAPON4': '0.200', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.390', 'WEAPON5': '0.450', 'weapon3': '0.646', 'FRAGCOUNT': '1.000', 'weapon2': '1.882'} [2023-02-24 17:26:09,959][177170] DAMAGECOUNT value on done: 1909.0 [2023-02-24 17:26:10,057][177158] DAMAGECOUNT value on done: 649.0 [2023-02-24 17:26:10,057][177158] Sum rewards: -2.335, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.676', 'AMMO5': '0.008', 'AMMO2': '0.023', 'ARMOR': '0.044', 'weapon5': '0.078', 'HITCOUNT': '0.090', 'AMMO3': '0.114', 'AMMO4': '0.116', 'WEAPON5': '0.200', 'weapon4': '0.250', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.369', 'WEAPON3': '0.600', 'weapon3': '0.740', 'FRAGCOUNT': '1.000', 'weapon2': '1.908'} [2023-02-24 17:26:10,101][177172] DAMAGECOUNT value on done: 491.0 [2023-02-24 17:26:10,101][177172] Sum rewards: -10.487, reward structure: {'DEATHCOUNT': '-11.250', 'FRAGCOUNT': '-3.000', 'HEALTH': '-1.560', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO5': '0.015', 'AMMO4': '0.065', 'weapon5': '0.072', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.147', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.330', 'ARMOR': '0.487', 'WEAPON3': '0.800', 'weapon3': '0.972', 'weapon2': '1.902'} [2023-02-24 17:26:10,109][177171] DAMAGECOUNT value on done: 683.0 [2023-02-24 17:26:10,110][177171] Sum rewards: -7.581, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.518', 'AMMO5': '0.009', 'ARMOR': '0.025', 'AMMO2': '0.028', 'weapon5': '0.072', 'weapon4': '0.110', 'AMMO3': '0.119', 'HITCOUNT': '0.120', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.405', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.650', 'weapon3': '0.994', 'weapon2': '1.664'} [2023-02-24 17:26:10,131][177154] DAMAGECOUNT value on done: 571.0 [2023-02-24 17:26:10,132][177154] Sum rewards: -2.615, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.126', 'AMMO5': '0.007', 'AMMO2': '0.008', 'weapon4': '0.024', 'AMMO4': '0.037', 'WEAPON1': '0.040', 'weapon5': '0.052', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'DAMAGECOUNT': '0.387', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.306', 'weapon2': '1.544'} [2023-02-24 17:26:10,215][177157] DAMAGECOUNT value on done: 1020.0 [2023-02-24 17:26:10,227][177155] DAMAGECOUNT value on done: 854.0 [2023-02-24 17:26:10,227][177155] Sum rewards: -0.152, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.140', 'AMMO2': '0.012', 'weapon4': '0.032', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.059', 'weapon7': '0.066', 'HITCOUNT': '0.090', 'AMMO3': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'DAMAGECOUNT': '0.426', 'WEAPON3': '0.450', 'weapon2': '0.930', 'weapon3': '0.936', 'FRAGCOUNT': '1.000'} [2023-02-24 17:26:10,260][177170] DAMAGECOUNT value on done: 623.0 [2023-02-24 17:26:10,393][177172] DAMAGECOUNT value on done: 934.0 [2023-02-24 17:26:10,393][177172] Sum rewards: -4.004, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.770', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.009', 'AMMO2': '0.020', 'ARMOR': '0.060', 'weapon4': '0.086', 'AMMO3': '0.089', 'AMMO4': '0.098', 'weapon5': '0.116', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.250', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.588', 'weapon3': '0.760', 'weapon2': '1.890'} [2023-02-24 17:26:10,394][177158] DAMAGECOUNT value on done: 818.0 [2023-02-24 17:26:10,409][177171] DAMAGECOUNT value on done: 465.0 [2023-02-24 17:26:10,410][177154] DAMAGECOUNT value on done: 1102.0 [2023-02-24 17:26:10,410][177154] Sum rewards: -5.248, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.008', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.028', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'AMMO3': '0.128', 'WEAPON5': '0.150', 'HITCOUNT': '0.220', 'HEALTH': '0.330', 'WEAPON3': '0.550', 'weapon3': '0.812', 'DAMAGECOUNT': '0.888', 'FRAGCOUNT': '2.000', 'weapon2': '2.170'} [2023-02-24 17:26:10,507][177157] DAMAGECOUNT value on done: 587.0 [2023-02-24 17:26:10,521][177155] DAMAGECOUNT value on done: 552.0 [2023-02-24 17:26:10,522][177155] Sum rewards: -3.751, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.902', 'AMMO5': '0.007', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'weapon5': '0.020', 'AMMO2': '0.022', 'HITCOUNT': '0.080', 'AMMO3': '0.083', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'weapon4': '0.196', 'DAMAGECOUNT': '0.210', 'WEAPON4': '0.250', 'WEAPON3': '0.500', 'weapon3': '0.892', 'weapon2': '1.814'} [2023-02-24 17:26:10,550][177170] DAMAGECOUNT value on done: 1220.0 [2023-02-24 17:26:10,550][177170] Sum rewards: -6.240, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-2.000', 'HEALTH': '-0.564', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.057', 'HITCOUNT': '0.060', 'weapon4': '0.080', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.423', 'WEAPON3': '0.550', 'weapon3': '1.174', 'weapon2': '1.720'} [2023-02-24 17:26:10,689][177158] DAMAGECOUNT value on done: 826.0 [2023-02-24 17:26:10,690][177172] DAMAGECOUNT value on done: 671.0 [2023-02-24 17:26:10,690][177172] Sum rewards: -7.356, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.168', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.074', 'HITCOUNT': '0.090', 'ARMOR': '0.120', 'weapon4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'DAMAGECOUNT': '0.267', 'WEAPON4': '0.300', 'weapon3': '0.806', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '2.094'} [2023-02-24 17:26:10,698][177171] DAMAGECOUNT value on done: 453.0 [2023-02-24 17:26:10,699][177171] Sum rewards: -5.460, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.535', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.020', 'HITCOUNT': '0.030', 'ARMOR': '0.036', 'WEAPON1': '0.040', 'DAMAGECOUNT': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'weapon4': '0.130', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.072', 'weapon2': '1.586'} [2023-02-24 17:26:10,701][177154] DAMAGECOUNT value on done: 1132.0 [2023-02-24 17:26:10,702][177154] Sum rewards: -3.737, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.595', 'AMMO5': '0.009', 'AMMO2': '0.031', 'AMMO3': '0.058', 'weapon4': '0.090', 'weapon5': '0.110', 'HITCOUNT': '0.140', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'WEAPON3': '0.300', 'WEAPON4': '0.400', 'FRAGCOUNT': '0.500', 'ARMOR': '0.505', 'weapon3': '0.608', 'DAMAGECOUNT': '0.708', 'weapon2': '2.344'} [2023-02-24 17:26:10,735][177156] DAMAGECOUNT value on done: 780.0 [2023-02-24 17:26:10,736][177156] Sum rewards: -0.350, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.028', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'HITCOUNT': '0.050', 'AMMO3': '0.063', 'weapon4': '0.140', 'ARMOR': '0.143', 'DAMAGECOUNT': '0.150', 'WEAPON4': '0.150', 'WEAPON3': '0.400', 'weapon3': '0.880', 'FRAGCOUNT': '1.000', 'weapon2': '2.220'} [2023-02-24 17:26:10,792][177157] DAMAGECOUNT value on done: 1126.0 [2023-02-24 17:26:10,793][177157] Sum rewards: -0.665, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.009', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'AMMO3': '0.074', 'weapon7': '0.086', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.116', 'WEAPON4': '0.150', 'HEALTH': '0.171', 'HITCOUNT': '0.180', 'weapon4': '0.242', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.469', 'weapon3': '0.650', 'DAMAGECOUNT': '0.684', 'FRAGCOUNT': '1.000', 'weapon2': '1.970'} [2023-02-24 17:26:10,834][177155] DAMAGECOUNT value on done: 794.0 [2023-02-24 17:26:10,835][177155] Sum rewards: -0.804, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.326', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'weapon5': '0.034', 'weapon4': '0.050', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'HITCOUNT': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.609', 'weapon3': '1.042', 'weapon2': '1.300', 'FRAGCOUNT': '2.000'} [2023-02-24 17:26:10,982][177172] DAMAGECOUNT value on done: 635.0 [2023-02-24 17:26:10,983][177172] Sum rewards: -7.554, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-2.000', 'HEALTH': '-1.214', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO4': '0.023', 'HITCOUNT': '0.080', 'AMMO3': '0.161', 'weapon5': '0.162', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.366', 'WEAPON3': '0.800', 'weapon3': '1.118', 'weapon2': '1.616'} [2023-02-24 17:26:11,000][177171] DAMAGECOUNT value on done: 661.0 [2023-02-24 17:26:11,025][177156] DAMAGECOUNT value on done: 437.0 [2023-02-24 17:26:11,093][177157] DAMAGECOUNT value on done: 755.0 [2023-02-24 17:26:11,093][177157] Sum rewards: -5.990, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.783', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.010', 'weapon4': '0.014', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'HITCOUNT': '0.120', 'AMMO3': '0.220', 'DAMAGECOUNT': '0.540', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon3': '1.120', 'weapon2': '1.860'} [2023-02-24 17:26:11,126][177155] DAMAGECOUNT value on done: 410.0 [2023-02-24 17:26:11,302][177156] DAMAGECOUNT value on done: 474.0 [2023-02-24 17:26:11,303][177156] Sum rewards: -7.666, reward structure: {'DEATHCOUNT': '-10.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.430', 'AMMO5': '0.007', 'AMMO2': '0.012', 'ARMOR': '0.040', 'AMMO4': '0.057', 'weapon5': '0.068', 'weapon4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.170', 'AMMO3': '0.173', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.950', 'weapon3': '1.052', 'weapon2': '1.402'} [2023-02-24 17:26:11,376][177119] Fps is (10 sec: 13926.5, 60 sec: 14267.8, 300 sec: 14142.0). Total num frames: 2686976. Throughput: 0: 3567.9. Samples: 669896. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:26:11,376][177119] Avg episode reward: [(0, '-5.240')] [2023-02-24 17:26:11,376][177140] Saving new best policy, reward=-5.240! [2023-02-24 17:26:11,598][177156] DAMAGECOUNT value on done: 959.0 [2023-02-24 17:26:11,599][177156] Sum rewards: -7.331, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.216', 'AMMO5': '0.008', 'weapon5': '0.014', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.081', 'HITCOUNT': '0.100', 'AMMO3': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.750', 'ARMOR': '0.828', 'weapon3': '0.870', 'FRAGCOUNT': '1.000', 'weapon2': '2.080'} [2023-02-24 17:26:12,239][177153] Updated weights for policy 0, policy_version 660 (0.0009) [2023-02-24 17:26:15,116][177153] Updated weights for policy 0, policy_version 670 (0.0008) [2023-02-24 17:26:16,376][177119] Fps is (10 sec: 14336.4, 60 sec: 14267.7, 300 sec: 14157.5). Total num frames: 2760704. Throughput: 0: 3564.3. Samples: 691280. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:26:16,376][177119] Avg episode reward: [(0, '-5.188')] [2023-02-24 17:26:16,380][177140] Saving new best policy, reward=-5.188! [2023-02-24 17:26:17,963][177153] Updated weights for policy 0, policy_version 680 (0.0008) [2023-02-24 17:26:20,800][177153] Updated weights for policy 0, policy_version 690 (0.0008) [2023-02-24 17:26:21,376][177119] Fps is (10 sec: 14335.8, 60 sec: 14267.7, 300 sec: 14151.7). Total num frames: 2830336. Throughput: 0: 3569.5. Samples: 701956. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 17:26:21,376][177119] Avg episode reward: [(0, '-5.188')] [2023-02-24 17:26:23,683][177153] Updated weights for policy 0, policy_version 700 (0.0008) [2023-02-24 17:26:26,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14267.7, 300 sec: 14166.2). Total num frames: 2904064. Throughput: 0: 3568.3. Samples: 723396. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 17:26:26,376][177119] Avg episode reward: [(0, '-5.188')] [2023-02-24 17:26:26,548][177153] Updated weights for policy 0, policy_version 710 (0.0008) [2023-02-24 17:26:28,512][177170] DAMAGECOUNT value on done: 1072.0 [2023-02-24 17:26:28,513][177170] Sum rewards: -8.465, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.192', 'AMMO2': '0.009', 'ARMOR': '0.012', 'AMMO5': '0.024', 'weapon5': '0.030', 'AMMO4': '0.047', 'weapon4': '0.114', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.435', 'FRAGCOUNT': '0.500', 'WEAPON3': '1.000', 'weapon3': '1.242', 'weapon2': '1.558'} [2023-02-24 17:26:28,653][177158] DAMAGECOUNT value on done: 984.0 [2023-02-24 17:26:28,653][177158] Sum rewards: -5.034, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.554', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.037', 'HITCOUNT': '0.070', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'DAMAGECOUNT': '0.222', 'WEAPON3': '0.450', 'weapon3': '0.912', 'weapon2': '2.276'} [2023-02-24 17:26:28,720][177154] DAMAGECOUNT value on done: 1350.0 [2023-02-24 17:26:28,720][177154] Sum rewards: -4.910, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.940', 'AMMO5': '0.006', 'AMMO2': '0.019', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'weapon5': '0.074', 'AMMO4': '0.095', 'AMMO3': '0.098', 'weapon4': '0.106', 'HITCOUNT': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.465', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.550', 'weapon3': '0.668', 'weapon2': '1.966'} [2023-02-24 17:26:28,814][177170] DAMAGECOUNT value on done: 2074.0 [2023-02-24 17:26:28,814][177170] Sum rewards: -4.992, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.610', 'AMMO5': '0.008', 'weapon4': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'ARMOR': '0.024', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.470', 'weapon2': '1.634'} [2023-02-24 17:26:28,875][177172] DAMAGECOUNT value on done: 641.0 [2023-02-24 17:26:28,875][177172] Sum rewards: -8.438, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.320', 'FRAGCOUNT': '-2.000', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'weapon5': '0.074', 'weapon4': '0.088', 'HITCOUNT': '0.090', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.600', 'weapon3': '0.702', 'weapon2': '2.136'} [2023-02-24 17:26:28,955][177158] DAMAGECOUNT value on done: 804.0 [2023-02-24 17:26:28,956][177158] Sum rewards: -6.104, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.660', 'FRAGCOUNT': '0.000', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.016', 'ARMOR': '0.029', 'AMMO4': '0.078', 'HITCOUNT': '0.100', 'AMMO3': '0.129', 'weapon5': '0.138', 'WEAPON5': '0.150', 'weapon4': '0.244', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.465', 'WEAPON3': '0.650', 'weapon3': '0.978', 'weapon2': '1.804'} [2023-02-24 17:26:29,024][177154] DAMAGECOUNT value on done: 786.0 [2023-02-24 17:26:29,025][177154] Sum rewards: -2.536, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.990', 'weapon7': '0.006', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.034', 'weapon4': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.148', 'HITCOUNT': '0.170', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.645', 'weapon3': '1.160', 'weapon2': '1.908', 'FRAGCOUNT': '3.000'} [2023-02-24 17:26:29,056][177171] DAMAGECOUNT value on done: 778.0 [2023-02-24 17:26:29,102][177157] DAMAGECOUNT value on done: 1265.0 [2023-02-24 17:26:29,103][177157] Sum rewards: -5.046, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.605', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'HITCOUNT': '0.090', 'weapon4': '0.112', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'ARMOR': '0.487', 'DAMAGECOUNT': '0.735', 'WEAPON3': '0.850', 'weapon3': '1.034', 'weapon2': '1.990', 'FRAGCOUNT': '2.000'} [2023-02-24 17:26:29,105][177170] DAMAGECOUNT value on done: 693.0 [2023-02-24 17:26:29,105][177170] Sum rewards: -4.826, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.260', 'AMMO2': '0.017', 'ARMOR': '0.040', 'HITCOUNT': '0.060', 'AMMO4': '0.086', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.210', 'weapon4': '0.236', 'WEAPON3': '0.550', 'weapon3': '0.786', 'FRAGCOUNT': '1.000', 'weapon2': '1.942'} [2023-02-24 17:26:29,108][177155] DAMAGECOUNT value on done: 982.0 [2023-02-24 17:26:29,109][177155] Sum rewards: -6.286, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.041', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.040', 'weapon7': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.171', 'weapon4': '0.172', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.384', 'WEAPON3': '0.800', 'weapon3': '0.928', 'weapon2': '1.638'} [2023-02-24 17:26:29,156][177172] DAMAGECOUNT value on done: 1019.0 [2023-02-24 17:26:29,156][177172] Sum rewards: -5.860, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.336', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'ARMOR': '0.036', 'weapon5': '0.076', 'HITCOUNT': '0.080', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.255', 'WEAPON3': '0.850', 'weapon3': '0.934', 'FRAGCOUNT': '1.000', 'weapon2': '1.898'} [2023-02-24 17:26:29,300][177158] DAMAGECOUNT value on done: 1137.0 [2023-02-24 17:26:29,301][177158] Sum rewards: 2.526, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.579', 'AMMO2': '0.002', 'AMMO5': '0.008', 'AMMO4': '0.010', 'weapon4': '0.084', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.106', 'AMMO3': '0.109', 'WEAPON5': '0.200', 'WEAPON3': '0.400', 'ARMOR': '0.491', 'DAMAGECOUNT': '0.948', 'weapon3': '1.190', 'weapon2': '1.856', 'FRAGCOUNT': '2.000'} [2023-02-24 17:26:29,301][177154] DAMAGECOUNT value on done: 1181.0 [2023-02-24 17:26:29,302][177154] Sum rewards: -5.205, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.162', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.018', 'AMMO4': '0.046', 'HITCOUNT': '0.050', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'weapon4': '0.204', 'DAMAGECOUNT': '0.237', 'ARMOR': '0.432', 'WEAPON3': '0.500', 'weapon3': '0.966', 'weapon2': '1.986'} [2023-02-24 17:26:29,355][177171] DAMAGECOUNT value on done: 669.0 [2023-02-24 17:26:29,355][177171] Sum rewards: -1.924, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.128', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.015', 'weapon5': '0.052', 'weapon7': '0.054', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.130', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.250', 'ARMOR': '0.428', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.612', 'weapon3': '0.686', 'weapon2': '1.686', 'FRAGCOUNT': '2.000'} [2023-02-24 17:26:29,407][177170] DAMAGECOUNT value on done: 1387.0 [2023-02-24 17:26:29,407][177170] Sum rewards: -7.568, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.750', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.007', 'AMMO5': '0.007', 'ARMOR': '0.008', 'weapon5': '0.010', 'AMMO4': '0.036', 'WEAPON5': '0.050', 'weapon4': '0.084', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.184', 'DAMAGECOUNT': '0.501', 'WEAPON3': '1.000', 'weapon3': '1.010', 'weapon2': '2.004'} [2023-02-24 17:26:29,412][177157] DAMAGECOUNT value on done: 732.0 [2023-02-24 17:26:29,412][177157] Sum rewards: -1.732, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.834', 'AMMO2': '0.005', 'AMMO5': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'HITCOUNT': '0.070', 'weapon5': '0.106', 'AMMO3': '0.135', 'weapon4': '0.136', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.700', 'weapon3': '1.316', 'weapon2': '1.396', 'FRAGCOUNT': '2.000'} [2023-02-24 17:26:29,418][177155] DAMAGECOUNT value on done: 892.0 [2023-02-24 17:26:29,418][177155] Sum rewards: -2.455, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.920', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'weapon4': '0.208', 'HITCOUNT': '0.250', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.020', 'weapon3': '1.036', 'weapon2': '1.822', 'FRAGCOUNT': '2.000'} [2023-02-24 17:26:29,463][177172] DAMAGECOUNT value on done: 708.0 [2023-02-24 17:26:29,504][177153] Updated weights for policy 0, policy_version 720 (0.0008) [2023-02-24 17:26:29,594][177157] DAMAGECOUNT value on done: 1334.0 [2023-02-24 17:26:29,594][177157] Sum rewards: -2.566, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.158', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.128', 'HITCOUNT': '0.150', 'weapon4': '0.172', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.624', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.208', 'weapon2': '1.488'} [2023-02-24 17:26:29,601][177156] DAMAGECOUNT value on done: 877.0 [2023-02-24 17:26:29,601][177156] Sum rewards: -6.101, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.672', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON1': '0.030', 'ARMOR': '0.048', 'AMMO4': '0.056', 'weapon4': '0.070', 'HITCOUNT': '0.090', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'DAMAGECOUNT': '0.291', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.156', 'weapon2': '1.764'} [2023-02-24 17:26:29,614][177158] DAMAGECOUNT value on done: 886.0 [2023-02-24 17:26:29,615][177158] Sum rewards: -4.736, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.739', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'HITCOUNT': '0.070', 'AMMO3': '0.131', 'weapon5': '0.166', 'DAMAGECOUNT': '0.180', 'WEAPON5': '0.200', 'ARMOR': '0.495', 'WEAPON3': '0.550', 'weapon3': '0.870', 'weapon2': '2.258'} [2023-02-24 17:26:29,618][177154] DAMAGECOUNT value on done: 1355.0 [2023-02-24 17:26:29,618][177154] Sum rewards: -7.207, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.160', 'AMMO5': '0.011', 'ARMOR': '0.015', 'AMMO2': '0.016', 'weapon4': '0.058', 'weapon5': '0.062', 'AMMO4': '0.080', 'HITCOUNT': '0.090', 'AMMO3': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.669', 'WEAPON3': '0.950', 'weapon3': '1.058', 'FRAGCOUNT': '2.000', 'weapon2': '2.024'} [2023-02-24 17:26:29,655][177171] DAMAGECOUNT value on done: 612.0 [2023-02-24 17:26:29,656][177171] Sum rewards: -3.009, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.540', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'weapon5': '0.030', 'weapon4': '0.066', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.158', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.477', 'WEAPON3': '0.650', 'weapon3': '1.276', 'weapon2': '1.674', 'FRAGCOUNT': '2.000'} [2023-02-24 17:26:29,703][177155] DAMAGECOUNT value on done: 1085.0 [2023-02-24 17:26:29,703][177155] Sum rewards: -3.188, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.368', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'ARMOR': '0.060', 'AMMO4': '0.076', 'AMMO3': '0.084', 'weapon5': '0.114', 'WEAPON4': '0.150', 'HITCOUNT': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.160', 'weapon3': '0.372', 'WEAPON3': '0.450', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.873', 'weapon2': '2.488'} [2023-02-24 17:26:29,767][177172] DAMAGECOUNT value on done: 700.0 [2023-02-24 17:26:29,768][177172] Sum rewards: -1.565, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.850', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'ARMOR': '0.017', 'weapon4': '0.020', 'AMMO2': '0.024', 'weapon5': '0.040', 'HITCOUNT': '0.070', 'AMMO3': '0.083', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'DAMAGECOUNT': '0.195', 'WEAPON4': '0.200', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.012', 'weapon2': '1.940'} [2023-02-24 17:26:29,886][177157] DAMAGECOUNT value on done: 804.0 [2023-02-24 17:26:29,889][177156] DAMAGECOUNT value on done: 574.0 [2023-02-24 17:26:29,948][177171] DAMAGECOUNT value on done: 694.0 [2023-02-24 17:26:29,949][177171] Sum rewards: -10.475, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-4.500', 'HEALTH': '-0.945', 'AMMO5': '0.020', 'AMMO2': '0.027', 'HITCOUNT': '0.040', 'weapon4': '0.064', 'DAMAGECOUNT': '0.099', 'AMMO4': '0.133', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'weapon5': '0.202', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'weapon3': '1.212', 'weapon2': '1.470'} [2023-02-24 17:26:29,993][177155] DAMAGECOUNT value on done: 617.0 [2023-02-24 17:26:29,993][177155] Sum rewards: -3.413, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.672', 'AMMO2': '0.005', 'AMMO5': '0.009', 'AMMO4': '0.025', 'weapon4': '0.042', 'weapon5': '0.064', 'ARMOR': '0.068', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.134', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.621', 'WEAPON3': '0.750', 'weapon3': '0.990', 'FRAGCOUNT': '1.000', 'weapon2': '2.130'} [2023-02-24 17:26:30,164][177156] DAMAGECOUNT value on done: 649.0 [2023-02-24 17:26:30,165][177156] Sum rewards: -9.304, reward structure: {'DEATHCOUNT': '-10.500', 'FRAGCOUNT': '-3.000', 'HEALTH': '-0.694', 'ARMOR': '0.008', 'AMMO2': '0.014', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.067', 'weapon5': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'HITCOUNT': '0.150', 'weapon4': '0.272', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.525', 'WEAPON3': '0.600', 'weapon3': '0.726', 'weapon2': '1.896'} [2023-02-24 17:26:30,444][177156] DAMAGECOUNT value on done: 1064.0 [2023-02-24 17:26:30,445][177156] Sum rewards: -11.144, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.290', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.042', 'ARMOR': '0.064', 'HITCOUNT': '0.070', 'weapon5': '0.086', 'WEAPON5': '0.100', 'weapon4': '0.102', 'AMMO3': '0.168', 'AMMO4': '0.211', 'DAMAGECOUNT': '0.285', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'weapon3': '1.030', 'weapon2': '1.872'} [2023-02-24 17:26:31,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14267.7, 300 sec: 14160.5). Total num frames: 2973696. Throughput: 0: 3563.8. Samples: 744646. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:26:31,376][177119] Avg episode reward: [(0, '-5.260')] [2023-02-24 17:26:32,324][177153] Updated weights for policy 0, policy_version 730 (0.0009) [2023-02-24 17:26:35,160][177153] Updated weights for policy 0, policy_version 740 (0.0008) [2023-02-24 17:26:36,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14267.7, 300 sec: 14174.1). Total num frames: 3047424. Throughput: 0: 3564.5. Samples: 755424. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 17:26:36,376][177119] Avg episode reward: [(0, '-5.260')] [2023-02-24 17:26:38,051][177153] Updated weights for policy 0, policy_version 750 (0.0008) [2023-02-24 17:26:40,923][177153] Updated weights for policy 0, policy_version 760 (0.0008) [2023-02-24 17:26:41,376][177119] Fps is (10 sec: 14336.1, 60 sec: 14267.7, 300 sec: 14168.5). Total num frames: 3117056. Throughput: 0: 3564.3. Samples: 776774. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 17:26:41,376][177119] Avg episode reward: [(0, '-5.260')] [2023-02-24 17:26:43,807][177153] Updated weights for policy 0, policy_version 770 (0.0009) [2023-02-24 17:26:46,376][177119] Fps is (10 sec: 13926.5, 60 sec: 14199.5, 300 sec: 14163.1). Total num frames: 3186688. Throughput: 0: 3561.6. Samples: 798156. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 17:26:46,376][177119] Avg episode reward: [(0, '-5.260')] [2023-02-24 17:26:46,670][177153] Updated weights for policy 0, policy_version 780 (0.0008) [2023-02-24 17:26:47,386][177170] DAMAGECOUNT value on done: 1327.0 [2023-02-24 17:26:47,387][177170] Sum rewards: -4.493, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.440', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon4': '0.052', 'weapon5': '0.054', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'HITCOUNT': '0.130', 'WEAPON5': '0.150', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.765', 'weapon3': '0.826', 'FRAGCOUNT': '1.500', 'weapon2': '2.064'} [2023-02-24 17:26:47,595][177154] DAMAGECOUNT value on done: 1700.0 [2023-02-24 17:26:47,595][177158] DAMAGECOUNT value on done: 1104.0 [2023-02-24 17:26:47,596][177158] Sum rewards: -6.215, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.796', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.044', 'HITCOUNT': '0.070', 'ARMOR': '0.072', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.142', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.700', 'weapon3': '0.912', 'FRAGCOUNT': '1.000', 'weapon2': '2.046'} [2023-02-24 17:26:47,596][177154] Sum rewards: -5.667, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.522', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon4': '0.078', 'weapon5': '0.086', 'AMMO4': '0.104', 'ARMOR': '0.112', 'AMMO3': '0.154', 'HITCOUNT': '0.240', 'WEAPON4': '0.250', 'WEAPON3': '0.800', 'weapon3': '0.808', 'DAMAGECOUNT': '1.050', 'FRAGCOUNT': '2.000', 'weapon2': '2.100'} [2023-02-24 17:26:47,657][177172] DAMAGECOUNT value on done: 686.0 [2023-02-24 17:26:47,684][177170] DAMAGECOUNT value on done: 2183.0 [2023-02-24 17:26:47,684][177170] Sum rewards: -3.011, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.069', 'AMMO2': '0.017', 'ARMOR': '0.040', 'weapon4': '0.078', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'HITCOUNT': '0.120', 'DAMAGECOUNT': '0.327', 'WEAPON3': '0.650', 'weapon3': '0.958', 'FRAGCOUNT': '1.000', 'weapon2': '2.076'} [2023-02-24 17:26:47,886][177171] DAMAGECOUNT value on done: 818.0 [2023-02-24 17:26:47,888][177154] DAMAGECOUNT value on done: 816.0 [2023-02-24 17:26:47,895][177158] DAMAGECOUNT value on done: 860.0 [2023-02-24 17:26:47,943][177170] DAMAGECOUNT value on done: 753.0 [2023-02-24 17:26:47,943][177170] Sum rewards: -5.817, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.862', 'AMMO5': '0.009', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'weapon5': '0.026', 'HITCOUNT': '0.050', 'AMMO3': '0.069', 'AMMO4': '0.071', 'weapon4': '0.072', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.180', 'WEAPON5': '0.200', 'WEAPON3': '0.350', 'weapon3': '0.444', 'ARMOR': '0.935', 'weapon2': '2.254'} [2023-02-24 17:26:47,951][177172] DAMAGECOUNT value on done: 1143.0 [2023-02-24 17:26:47,952][177172] Sum rewards: -5.449, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.125', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'weapon5': '0.022', 'ARMOR': '0.040', 'AMMO4': '0.056', 'weapon4': '0.094', 'HITCOUNT': '0.100', 'AMMO3': '0.137', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.372', 'weapon3': '0.716', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '2.050'} [2023-02-24 17:26:47,993][177155] DAMAGECOUNT value on done: 1127.0 [2023-02-24 17:26:47,994][177155] Sum rewards: -3.317, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.929', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'weapon4': '0.014', 'ARMOR': '0.020', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.140', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.600', 'weapon3': '0.956', 'FRAGCOUNT': '1.000', 'weapon2': '2.040'} [2023-02-24 17:26:47,996][177157] DAMAGECOUNT value on done: 1640.0 [2023-02-24 17:26:47,997][177157] Sum rewards: -3.811, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.390', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon4': '0.016', 'weapon5': '0.042', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.136', 'HITCOUNT': '0.160', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.125', 'weapon3': '1.208', 'weapon2': '1.652', 'FRAGCOUNT': '3.000'} [2023-02-24 17:26:48,161][177154] DAMAGECOUNT value on done: 1390.0 [2023-02-24 17:26:48,162][177154] Sum rewards: 0.620, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO3': '0.080', 'AMMO4': '0.089', 'weapon4': '0.098', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'HEALTH': '0.180', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.627', 'weapon3': '1.046', 'weapon2': '1.742', 'FRAGCOUNT': '2.000'} [2023-02-24 17:26:48,182][177171] DAMAGECOUNT value on done: 779.0 [2023-02-24 17:26:48,183][177171] Sum rewards: -7.264, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.580', 'FRAGCOUNT': '-0.500', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.027', 'HITCOUNT': '0.080', 'AMMO3': '0.094', 'weapon5': '0.104', 'AMMO4': '0.134', 'WEAPON5': '0.250', 'weapon4': '0.254', 'DAMAGECOUNT': '0.330', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'weapon3': '0.522', 'weapon2': '1.886'} [2023-02-24 17:26:48,240][177158] DAMAGECOUNT value on done: 1217.0 [2023-02-24 17:26:48,241][177158] Sum rewards: -2.936, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.924', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.020', 'HITCOUNT': '0.090', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.142', 'AMMO3': '0.155', 'DAMAGECOUNT': '0.240', 'WEAPON3': '0.700', 'weapon3': '0.808', 'FRAGCOUNT': '1.000', 'weapon2': '2.014'} [2023-02-24 17:26:48,244][177170] DAMAGECOUNT value on done: 1557.0 [2023-02-24 17:26:48,245][177170] Sum rewards: -3.964, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.768', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'weapon4': '0.016', 'AMMO4': '0.030', 'weapon5': '0.056', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.155', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.510', 'ARMOR': '0.800', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.198', 'weapon2': '1.750'} [2023-02-24 17:26:48,252][177172] DAMAGECOUNT value on done: 738.0 [2023-02-24 17:26:48,287][177155] DAMAGECOUNT value on done: 1042.0 [2023-02-24 17:26:48,287][177155] Sum rewards: -4.269, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.238', 'FRAGCOUNT': '-0.500', 'weapon5': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.013', 'AMMO4': '0.063', 'HITCOUNT': '0.110', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.214', 'ARMOR': '0.444', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.600', 'weapon3': '0.812', 'weapon2': '1.812'} [2023-02-24 17:26:48,298][177157] DAMAGECOUNT value on done: 807.0 [2023-02-24 17:26:48,299][177157] Sum rewards: -1.224, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.007', 'weapon4': '0.010', 'AMMO2': '0.027', 'weapon5': '0.060', 'ARMOR': '0.076', 'AMMO3': '0.080', 'HITCOUNT': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.225', 'WEAPON3': '0.400', 'HEALTH': '0.506', 'weapon3': '0.790', 'weapon2': '2.082', 'FRAGCOUNT': '3.000'} [2023-02-24 17:26:48,404][177156] DAMAGECOUNT value on done: 957.0 [2023-02-24 17:26:48,460][177154] DAMAGECOUNT value on done: 1460.0 [2023-02-24 17:26:48,460][177154] Sum rewards: -6.732, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.408', 'AMMO2': '0.016', 'ARMOR': '0.068', 'AMMO4': '0.080', 'HITCOUNT': '0.090', 'weapon4': '0.128', 'AMMO3': '0.129', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.315', 'WEAPON3': '0.650', 'weapon3': '0.960', 'FRAGCOUNT': '1.000', 'weapon2': '1.790'} [2023-02-24 17:26:48,461][177157] DAMAGECOUNT value on done: 1349.0 [2023-02-24 17:26:48,462][177157] Sum rewards: -9.169, reward structure: {'DEATHCOUNT': '-10.500', 'FRAGCOUNT': '-3.000', 'HEALTH': '-0.056', 'AMMO5': '0.012', 'AMMO2': '0.020', 'HITCOUNT': '0.020', 'weapon4': '0.020', 'DAMAGECOUNT': '0.045', 'AMMO4': '0.098', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'weapon5': '0.198', 'WEAPON5': '0.200', 'ARMOR': '0.440', 'WEAPON3': '0.600', 'weapon3': '0.754', 'weapon2': '1.706'} [2023-02-24 17:26:48,476][177171] DAMAGECOUNT value on done: 772.0 [2023-02-24 17:26:48,536][177158] DAMAGECOUNT value on done: 971.0 [2023-02-24 17:26:48,536][177158] Sum rewards: -4.266, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.480', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'weapon5': '0.002', 'AMMO5': '0.010', 'ARMOR': '0.028', 'WEAPON1': '0.030', 'HITCOUNT': '0.080', 'AMMO3': '0.085', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.255', 'WEAPON3': '0.500', 'weapon3': '0.684', 'FRAGCOUNT': '1.000', 'weapon2': '1.860'} [2023-02-24 17:26:48,557][177172] DAMAGECOUNT value on done: 765.0 [2023-02-24 17:26:48,563][177155] DAMAGECOUNT value on done: 1183.0 [2023-02-24 17:26:48,707][177156] DAMAGECOUNT value on done: 664.0 [2023-02-24 17:26:48,707][177156] Sum rewards: -4.174, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.866', 'AMMO2': '0.025', 'weapon4': '0.050', 'HITCOUNT': '0.070', 'AMMO3': '0.094', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.270', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon3': '0.474', 'FRAGCOUNT': '2.000', 'weapon2': '2.332'} [2023-02-24 17:26:48,754][177157] DAMAGECOUNT value on done: 874.0 [2023-02-24 17:26:48,779][177171] DAMAGECOUNT value on done: 816.0 [2023-02-24 17:26:48,856][177155] DAMAGECOUNT value on done: 672.0 [2023-02-24 17:26:48,857][177155] Sum rewards: -6.987, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.390', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.027', 'ARMOR': '0.032', 'weapon4': '0.034', 'HITCOUNT': '0.050', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'DAMAGECOUNT': '0.165', 'WEAPON4': '0.200', 'WEAPON3': '0.400', 'weapon3': '0.600', 'weapon2': '2.312'} [2023-02-24 17:26:48,986][177156] DAMAGECOUNT value on done: 849.0 [2023-02-24 17:26:48,987][177156] Sum rewards: -4.655, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.532', 'weapon4': '0.002', 'AMMO2': '0.024', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'AMMO4': '0.121', 'HITCOUNT': '0.180', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.600', 'weapon3': '0.916', 'FRAGCOUNT': '1.000', 'weapon2': '2.144'} [2023-02-24 17:26:49,272][177156] DAMAGECOUNT value on done: 1208.0 [2023-02-24 17:26:49,572][177153] Updated weights for policy 0, policy_version 790 (0.0008) [2023-02-24 17:26:51,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14267.7, 300 sec: 14175.8). Total num frames: 3260416. Throughput: 0: 3559.3. Samples: 808768. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 17:26:51,376][177119] Avg episode reward: [(0, '-4.924')] [2023-02-24 17:26:51,377][177140] Saving new best policy, reward=-4.924! [2023-02-24 17:26:52,434][177153] Updated weights for policy 0, policy_version 800 (0.0008) [2023-02-24 17:26:55,279][177153] Updated weights for policy 0, policy_version 810 (0.0008) [2023-02-24 17:26:56,376][177119] Fps is (10 sec: 14335.9, 60 sec: 14267.7, 300 sec: 14170.5). Total num frames: 3330048. Throughput: 0: 3564.5. Samples: 830300. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:26:56,376][177119] Avg episode reward: [(0, '-4.924')] [2023-02-24 17:26:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000000813_3330048.pth... [2023-02-24 17:26:58,153][177153] Updated weights for policy 0, policy_version 820 (0.0008) [2023-02-24 17:27:01,021][177153] Updated weights for policy 0, policy_version 830 (0.0008) [2023-02-24 17:27:01,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14267.7, 300 sec: 14182.4). Total num frames: 3403776. Throughput: 0: 3564.7. Samples: 851690. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 17:27:01,376][177119] Avg episode reward: [(0, '-4.924')] [2023-02-24 17:27:03,920][177153] Updated weights for policy 0, policy_version 840 (0.0008) [2023-02-24 17:27:06,228][177170] DAMAGECOUNT value on done: 1412.0 [2023-02-24 17:27:06,376][177119] Fps is (10 sec: 14335.9, 60 sec: 14267.8, 300 sec: 14177.2). Total num frames: 3473408. Throughput: 0: 3565.7. Samples: 862412. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:27:06,376][177119] Avg episode reward: [(0, '-4.885')] [2023-02-24 17:27:06,380][177140] Saving new best policy, reward=-4.885! [2023-02-24 17:27:06,389][177158] DAMAGECOUNT value on done: 1274.0 [2023-02-24 17:27:06,389][177158] Sum rewards: -2.780, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.516', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'weapon4': '0.042', 'weapon5': '0.088', 'ARMOR': '0.122', 'AMMO3': '0.124', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'HITCOUNT': '0.170', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.096', 'weapon2': '1.512'} [2023-02-24 17:27:06,396][177154] DAMAGECOUNT value on done: 1924.0 [2023-02-24 17:27:06,396][177154] Sum rewards: -4.940, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.061', 'AMMO5': '0.010', 'weapon5': '0.012', 'AMMO2': '0.030', 'ARMOR': '0.032', 'AMMO3': '0.139', 'AMMO4': '0.148', 'weapon4': '0.162', 'WEAPON5': '0.200', 'HITCOUNT': '0.200', 'WEAPON4': '0.400', 'WEAPON3': '0.550', 'weapon3': '0.600', 'DAMAGECOUNT': '0.672', 'FRAGCOUNT': '1.000', 'weapon2': '1.966'} [2023-02-24 17:27:06,543][177170] DAMAGECOUNT value on done: 2328.0 [2023-02-24 17:27:06,543][177170] Sum rewards: -5.487, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.910', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.006', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.027', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'HITCOUNT': '0.120', 'weapon4': '0.134', 'DAMAGECOUNT': '0.435', 'weapon3': '0.476', 'WEAPON3': '0.600', 'weapon2': '2.096'} [2023-02-24 17:27:06,545][177172] DAMAGECOUNT value on done: 781.0 [2023-02-24 17:27:06,545][177172] Sum rewards: -9.329, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.480', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon4': '0.026', 'AMMO4': '0.057', 'HITCOUNT': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.207', 'DAMAGECOUNT': '0.285', 'weapon3': '0.730', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.100', 'weapon2': '2.138'} [2023-02-24 17:27:06,693][177171] DAMAGECOUNT value on done: 878.0 [2023-02-24 17:27:06,693][177158] DAMAGECOUNT value on done: 992.0 [2023-02-24 17:27:06,693][177171] Sum rewards: -3.195, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.078', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.017', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'HITCOUNT': '0.070', 'weapon5': '0.078', 'AMMO4': '0.086', 'ARMOR': '0.096', 'AMMO3': '0.097', 'weapon4': '0.158', 'DAMAGECOUNT': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon3': '0.678', 'weapon2': '1.734'} [2023-02-24 17:27:06,693][177158] Sum rewards: -2.222, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.967', 'AMMO2': '0.005', 'AMMO4': '0.026', 'ARMOR': '0.044', 'WEAPON4': '0.050', 'HITCOUNT': '0.100', 'AMMO3': '0.117', 'weapon4': '0.118', 'DAMAGECOUNT': '0.396', 'WEAPON3': '0.650', 'weapon3': '1.158', 'weapon2': '1.580', 'FRAGCOUNT': '2.000'} [2023-02-24 17:27:06,701][177154] DAMAGECOUNT value on done: 866.0 [2023-02-24 17:27:06,723][177170] DAMAGECOUNT value on done: 768.0 [2023-02-24 17:27:06,838][177153] Updated weights for policy 0, policy_version 850 (0.0008) [2023-02-24 17:27:06,838][177172] DAMAGECOUNT value on done: 1333.0 [2023-02-24 17:27:06,838][177172] Sum rewards: -4.745, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.346', 'AMMO2': '0.021', 'weapon4': '0.030', 'AMMO4': '0.102', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'ARMOR': '0.455', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.098', 'weapon2': '1.722'} [2023-02-24 17:27:06,847][177157] DAMAGECOUNT value on done: 1665.0 [2023-02-24 17:27:06,879][177155] DAMAGECOUNT value on done: 1265.0 [2023-02-24 17:27:06,879][177155] Sum rewards: -10.132, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.254', 'FRAGCOUNT': '-1.500', 'AMMO2': '0.008', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.039', 'ARMOR': '0.040', 'HITCOUNT': '0.060', 'weapon4': '0.066', 'WEAPON4': '0.150', 'weapon5': '0.158', 'AMMO3': '0.184', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.414', 'weapon3': '0.510', 'WEAPON3': '0.950', 'weapon2': '2.014'} [2023-02-24 17:27:06,968][177154] DAMAGECOUNT value on done: 1580.0 [2023-02-24 17:27:06,968][177154] Sum rewards: -3.942, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.737', 'AMMO4': '-0.062', 'AMMO2': '-0.012', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'weapon5': '0.036', 'HITCOUNT': '0.040', 'AMMO3': '0.125', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.700', 'weapon3': '0.804', 'weapon2': '1.614', 'FRAGCOUNT': '2.000'} [2023-02-24 17:27:06,997][177171] DAMAGECOUNT value on done: 864.0 [2023-02-24 17:27:07,020][177170] DAMAGECOUNT value on done: 1672.0 [2023-02-24 17:27:07,020][177170] Sum rewards: -4.114, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.982', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.085', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.135', 'DAMAGECOUNT': '0.345', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.126', 'weapon2': '1.810'} [2023-02-24 17:27:07,062][177158] DAMAGECOUNT value on done: 1232.0 [2023-02-24 17:27:07,117][177172] DAMAGECOUNT value on done: 738.0 [2023-02-24 17:27:07,151][177157] DAMAGECOUNT value on done: 907.0 [2023-02-24 17:27:07,175][177155] DAMAGECOUNT value on done: 1242.0 [2023-02-24 17:27:07,175][177155] Sum rewards: -2.939, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.057', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'weapon4': '0.018', 'AMMO2': '0.029', 'weapon5': '0.066', 'HITCOUNT': '0.070', 'AMMO3': '0.121', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.650', 'weapon3': '1.104', 'weapon2': '1.746', 'FRAGCOUNT': '3.000'} [2023-02-24 17:27:07,261][177154] DAMAGECOUNT value on done: 1590.0 [2023-02-24 17:27:07,262][177154] Sum rewards: -5.359, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.972', 'AMMO2': '0.010', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon4': '0.032', 'weapon5': '0.034', 'AMMO4': '0.049', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.850', 'weapon3': '1.336', 'weapon2': '1.596', 'FRAGCOUNT': '2.000'} [2023-02-24 17:27:07,269][177157] DAMAGECOUNT value on done: 1499.0 [2023-02-24 17:27:07,269][177157] Sum rewards: -5.701, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.766', 'AMMO5': '0.010', 'AMMO2': '0.010', 'weapon5': '0.034', 'ARMOR': '0.048', 'AMMO4': '0.051', 'weapon4': '0.084', 'AMMO3': '0.139', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.144', 'weapon2': '1.584'} [2023-02-24 17:27:07,297][177171] DAMAGECOUNT value on done: 885.0 [2023-02-24 17:27:07,297][177171] Sum rewards: -4.225, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.704', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.021', 'weapon5': '0.034', 'WEAPON5': '0.050', 'HITCOUNT': '0.060', 'weapon4': '0.094', 'AMMO4': '0.107', 'AMMO3': '0.107', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.339', 'WEAPON3': '0.600', 'weapon3': '0.802', 'FRAGCOUNT': '1.000', 'weapon2': '1.996'} [2023-02-24 17:27:07,366][177158] DAMAGECOUNT value on done: 1028.0 [2023-02-24 17:27:07,411][177172] DAMAGECOUNT value on done: 880.0 [2023-02-24 17:27:07,434][177156] DAMAGECOUNT value on done: 992.0 [2023-02-24 17:27:07,462][177155] DAMAGECOUNT value on done: 1508.0 [2023-02-24 17:27:07,463][177155] Sum rewards: 0.307, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.994', 'AMMO5': '0.005', 'AMMO2': '0.016', 'ARMOR': '0.028', 'weapon4': '0.032', 'WEAPON4': '0.050', 'AMMO4': '0.081', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'HITCOUNT': '0.240', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.975', 'weapon3': '1.362', 'weapon2': '1.416', 'FRAGCOUNT': '3.000'} [2023-02-24 17:27:07,557][177157] DAMAGECOUNT value on done: 928.0 [2023-02-24 17:27:07,600][177171] DAMAGECOUNT value on done: 941.0 [2023-02-24 17:27:07,600][177171] Sum rewards: -7.235, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.408', 'AMMO2': '0.016', 'ARMOR': '0.054', 'AMMO4': '0.079', 'HITCOUNT': '0.120', 'weapon4': '0.120', 'AMMO3': '0.163', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.375', 'weapon3': '0.736', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.960'} [2023-02-24 17:27:07,727][177156] DAMAGECOUNT value on done: 713.0 [2023-02-24 17:27:07,758][177155] DAMAGECOUNT value on done: 717.0 [2023-02-24 17:27:07,759][177155] Sum rewards: -3.773, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.492', 'AMMO5': '0.005', 'AMMO2': '0.017', 'HITCOUNT': '0.040', 'ARMOR': '0.043', 'AMMO4': '0.087', 'weapon4': '0.088', 'weapon5': '0.090', 'AMMO3': '0.107', 'DAMAGECOUNT': '0.135', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.600', 'weapon3': '0.836', 'FRAGCOUNT': '1.000', 'weapon2': '1.570'} [2023-02-24 17:27:07,981][177156] DAMAGECOUNT value on done: 859.0 [2023-02-24 17:27:08,269][177156] DAMAGECOUNT value on done: 1268.0 [2023-02-24 17:27:08,269][177156] Sum rewards: -4.814, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.280', 'WEAPON1': '0.020', 'AMMO2': '0.043', 'ARMOR': '0.048', 'HITCOUNT': '0.060', 'weapon4': '0.076', 'AMMO3': '0.088', 'DAMAGECOUNT': '0.180', 'AMMO4': '0.216', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'weapon3': '0.982', 'FRAGCOUNT': '1.000', 'weapon2': '1.902'} [2023-02-24 17:27:09,694][177153] Updated weights for policy 0, policy_version 860 (0.0009) [2023-02-24 17:27:11,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14267.7, 300 sec: 14172.2). Total num frames: 3543040. Throughput: 0: 3564.2. Samples: 883786. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:27:11,377][177119] Avg episode reward: [(0, '-4.914')] [2023-02-24 17:27:12,550][177153] Updated weights for policy 0, policy_version 870 (0.0008) [2023-02-24 17:27:15,427][177153] Updated weights for policy 0, policy_version 880 (0.0009) [2023-02-24 17:27:16,376][177119] Fps is (10 sec: 14336.1, 60 sec: 14267.7, 300 sec: 14183.4). Total num frames: 3616768. Throughput: 0: 3571.1. Samples: 905346. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:27:16,376][177119] Avg episode reward: [(0, '-4.914')] [2023-02-24 17:27:18,295][177153] Updated weights for policy 0, policy_version 890 (0.0009) [2023-02-24 17:27:21,188][177153] Updated weights for policy 0, policy_version 900 (0.0009) [2023-02-24 17:27:21,376][177119] Fps is (10 sec: 14336.2, 60 sec: 14267.8, 300 sec: 14178.5). Total num frames: 3686400. Throughput: 0: 3567.6. Samples: 915964. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:27:21,376][177119] Avg episode reward: [(0, '-4.914')] [2023-02-24 17:27:24,100][177153] Updated weights for policy 0, policy_version 910 (0.0008) [2023-02-24 17:27:25,175][177154] DAMAGECOUNT value on done: 2119.0 [2023-02-24 17:27:25,176][177154] Sum rewards: -3.210, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.787', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.148', 'AMMO3': '0.163', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.585', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.392', 'weapon2': '1.518'} [2023-02-24 17:27:25,176][177170] DAMAGECOUNT value on done: 1607.0 [2023-02-24 17:27:25,176][177170] Sum rewards: -1.516, reward structure: {'DEATHCOUNT': '-8.250', 'ARMOR': '0.016', 'AMMO2': '0.018', 'weapon4': '0.042', 'HEALTH': '0.060', 'AMMO4': '0.090', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.170', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.585', 'weapon3': '1.124', 'weapon2': '1.928', 'FRAGCOUNT': '2.000'} [2023-02-24 17:27:25,202][177158] DAMAGECOUNT value on done: 1632.0 [2023-02-24 17:27:25,203][177158] Sum rewards: 0.934, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'ARMOR': '0.084', 'AMMO3': '0.111', 'HEALTH': '0.179', 'HITCOUNT': '0.230', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.074', 'weapon3': '1.246', 'weapon2': '1.820', 'FRAGCOUNT': '3.000'} [2023-02-24 17:27:25,359][177172] DAMAGECOUNT value on done: 956.0 [2023-02-24 17:27:25,359][177172] Sum rewards: -3.626, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.244', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'ARMOR': '0.040', 'WEAPON1': '0.040', 'AMMO3': '0.154', 'HITCOUNT': '0.170', 'DAMAGECOUNT': '0.525', 'WEAPON3': '0.750', 'weapon3': '1.172', 'weapon2': '1.784', 'FRAGCOUNT': '2.000'} [2023-02-24 17:27:25,475][177154] DAMAGECOUNT value on done: 1189.0 [2023-02-24 17:27:25,476][177154] Sum rewards: -0.284, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.908', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.016', 'weapon5': '0.040', 'weapon4': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'HITCOUNT': '0.230', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.969', 'weapon3': '1.358', 'weapon2': '1.664', 'FRAGCOUNT': '2.000'} [2023-02-24 17:27:25,477][177170] DAMAGECOUNT value on done: 2375.0 [2023-02-24 17:27:25,490][177170] DAMAGECOUNT value on done: 920.0 [2023-02-24 17:27:25,503][177158] DAMAGECOUNT value on done: 1114.0 [2023-02-24 17:27:25,504][177158] Sum rewards: -6.579, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.470', 'AMMO2': '0.009', 'ARMOR': '0.012', 'AMMO4': '0.046', 'HITCOUNT': '0.110', 'AMMO3': '0.146', 'DAMAGECOUNT': '0.366', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.076', 'weapon2': '1.926'} [2023-02-24 17:27:25,527][177171] DAMAGECOUNT value on done: 988.0 [2023-02-24 17:27:25,527][177171] Sum rewards: -3.455, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.410', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'weapon5': '0.022', 'AMMO4': '0.043', 'ARMOR': '0.048', 'HITCOUNT': '0.080', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.150', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.550', 'weapon3': '0.718', 'FRAGCOUNT': '1.000', 'weapon2': '2.136'} [2023-02-24 17:27:25,655][177172] DAMAGECOUNT value on done: 1596.0 [2023-02-24 17:27:25,655][177172] Sum rewards: -5.988, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.942', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.018', 'ARMOR': '0.024', 'AMMO3': '0.167', 'HITCOUNT': '0.170', 'weapon5': '0.220', 'WEAPON5': '0.250', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.789', 'WEAPON3': '0.900', 'weapon3': '1.238', 'weapon2': '1.460'} [2023-02-24 17:27:25,713][177157] DAMAGECOUNT value on done: 1815.0 [2023-02-24 17:27:25,759][177154] DAMAGECOUNT value on done: 1645.0 [2023-02-24 17:27:25,759][177155] DAMAGECOUNT value on done: 1490.0 [2023-02-24 17:27:25,759][177155] Sum rewards: 0.145, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.007', 'AMMO5': '0.007', 'weapon5': '0.024', 'WEAPON1': '0.030', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'AMMO3': '0.106', 'HITCOUNT': '0.140', 'WEAPON5': '0.150', 'ARMOR': '0.432', 'HEALTH': '0.518', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.675', 'weapon2': '1.228', 'weapon3': '1.642', 'FRAGCOUNT': '2.000'} [2023-02-24 17:27:25,799][177170] DAMAGECOUNT value on done: 1762.0 [2023-02-24 17:27:25,800][177170] Sum rewards: -4.864, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.105', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.024', 'AMMO4': '0.055', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.138', 'weapon4': '0.150', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.270', 'ARMOR': '0.498', 'weapon3': '0.740', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '2.140'} [2023-02-24 17:27:25,826][177171] DAMAGECOUNT value on done: 959.0 [2023-02-24 17:27:25,891][177158] DAMAGECOUNT value on done: 1312.0 [2023-02-24 17:27:25,891][177158] Sum rewards: -8.162, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.676', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'ARMOR': '0.016', 'weapon4': '0.028', 'HITCOUNT': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.166', 'DAMAGECOUNT': '0.240', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.000', 'weapon2': '2.120'} [2023-02-24 17:27:26,019][177157] DAMAGECOUNT value on done: 1037.0 [2023-02-24 17:27:26,020][177157] Sum rewards: 1.480, reward structure: {'DEATHCOUNT': '-6.750', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.078', 'HITCOUNT': '0.080', 'weapon4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'HEALTH': '0.224', 'DAMAGECOUNT': '0.390', 'ARMOR': '0.499', 'WEAPON3': '0.600', 'weapon3': '1.180', 'weapon2': '1.846', 'FRAGCOUNT': '3.000'} [2023-02-24 17:27:26,041][177172] DAMAGECOUNT value on done: 862.0 [2023-02-24 17:27:26,055][177155] DAMAGECOUNT value on done: 1278.0 [2023-02-24 17:27:26,065][177154] DAMAGECOUNT value on done: 1772.0 [2023-02-24 17:27:26,114][177157] DAMAGECOUNT value on done: 1595.0 [2023-02-24 17:27:26,118][177171] DAMAGECOUNT value on done: 969.0 [2023-02-24 17:27:26,119][177171] Sum rewards: -5.415, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.776', 'AMMO2': '0.006', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.030', 'HITCOUNT': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.156', 'AMMO3': '0.188', 'DAMAGECOUNT': '0.252', 'weapon3': '0.754', 'WEAPON3': '0.800', 'FRAGCOUNT': '2.000', 'weapon2': '2.388'} [2023-02-24 17:27:26,191][177158] DAMAGECOUNT value on done: 1138.0 [2023-02-24 17:27:26,192][177158] Sum rewards: -2.370, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.345', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.009', 'weapon4': '0.022', 'weapon5': '0.030', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.600', 'weapon3': '0.870', 'ARMOR': '0.914', 'FRAGCOUNT': '2.000', 'weapon2': '2.202'} [2023-02-24 17:27:26,325][177172] DAMAGECOUNT value on done: 950.0 [2023-02-24 17:27:26,325][177172] Sum rewards: -9.132, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.389', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.070', 'HITCOUNT': '0.080', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.210', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon3': '1.030', 'weapon2': '2.094'} [2023-02-24 17:27:26,341][177155] DAMAGECOUNT value on done: 1597.0 [2023-02-24 17:27:26,342][177155] Sum rewards: -5.484, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.482', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.067', 'ARMOR': '0.068', 'HITCOUNT': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'weapon4': '0.168', 'DAMAGECOUNT': '0.267', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.124', 'weapon2': '1.618'} [2023-02-24 17:27:26,360][177156] DAMAGECOUNT value on done: 1042.0 [2023-02-24 17:27:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14199.5, 300 sec: 14173.7). Total num frames: 3756032. Throughput: 0: 3564.5. Samples: 937178. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 17:27:26,376][177119] Avg episode reward: [(0, '-4.696')] [2023-02-24 17:27:26,380][177140] Saving new best policy, reward=-4.696! [2023-02-24 17:27:26,413][177171] DAMAGECOUNT value on done: 951.0 [2023-02-24 17:27:26,417][177157] DAMAGECOUNT value on done: 928.0 [2023-02-24 17:27:26,658][177155] DAMAGECOUNT value on done: 1007.0 [2023-02-24 17:27:26,659][177155] Sum rewards: -3.160, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.141', 'AMMO2': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.038', 'weapon5': '0.042', 'AMMO3': '0.139', 'HITCOUNT': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.870', 'weapon3': '1.184', 'FRAGCOUNT': '2.000', 'weapon2': '2.018'} [2023-02-24 17:27:26,662][177156] DAMAGECOUNT value on done: 782.0 [2023-02-24 17:27:26,663][177156] Sum rewards: -4.301, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.670', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'weapon4': '0.050', 'HITCOUNT': '0.080', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.136', 'DAMAGECOUNT': '0.207', 'WEAPON3': '0.650', 'weapon3': '0.930', 'FRAGCOUNT': '1.000', 'weapon2': '2.062'} [2023-02-24 17:27:26,952][177156] DAMAGECOUNT value on done: 939.0 [2023-02-24 17:27:27,027][177153] Updated weights for policy 0, policy_version 920 (0.0008) [2023-02-24 17:27:27,266][177156] DAMAGECOUNT value on done: 1313.0 [2023-02-24 17:27:29,843][177153] Updated weights for policy 0, policy_version 930 (0.0008) [2023-02-24 17:27:31,376][177119] Fps is (10 sec: 14335.9, 60 sec: 14267.8, 300 sec: 14184.3). Total num frames: 3829760. Throughput: 0: 3563.4. Samples: 958508. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:27:31,376][177119] Avg episode reward: [(0, '-4.754')] [2023-02-24 17:27:32,724][177153] Updated weights for policy 0, policy_version 940 (0.0008) [2023-02-24 17:27:35,562][177153] Updated weights for policy 0, policy_version 950 (0.0008) [2023-02-24 17:27:36,376][177119] Fps is (10 sec: 14335.7, 60 sec: 14199.4, 300 sec: 14179.6). Total num frames: 3899392. Throughput: 0: 3565.8. Samples: 969228. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 17:27:36,377][177119] Avg episode reward: [(0, '-4.754')] [2023-02-24 17:27:38,455][177153] Updated weights for policy 0, policy_version 960 (0.0008) [2023-02-24 17:27:41,347][177153] Updated weights for policy 0, policy_version 970 (0.0009) [2023-02-24 17:27:41,376][177119] Fps is (10 sec: 14336.1, 60 sec: 14267.7, 300 sec: 14189.7). Total num frames: 3973120. Throughput: 0: 3560.4. Samples: 990520. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:27:41,376][177119] Avg episode reward: [(0, '-4.754')] [2023-02-24 17:27:44,058][177170] DAMAGECOUNT value on done: 1722.0 [2023-02-24 17:27:44,058][177170] Sum rewards: -4.130, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.680', 'AMMO2': '0.002', 'weapon4': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.009', 'ARMOR': '0.043', 'WEAPON4': '0.050', 'HITCOUNT': '0.120', 'AMMO3': '0.130', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.750', 'weapon3': '0.834', 'FRAGCOUNT': '2.000', 'weapon2': '2.260'} [2023-02-24 17:27:44,119][177158] DAMAGECOUNT value on done: 1677.0 [2023-02-24 17:27:44,146][177154] DAMAGECOUNT value on done: 2219.0 [2023-02-24 17:27:44,147][177154] Sum rewards: -7.928, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.560', 'AMMO5': '0.007', 'AMMO2': '0.014', 'ARMOR': '0.032', 'AMMO4': '0.071', 'weapon5': '0.076', 'weapon4': '0.102', 'HITCOUNT': '0.120', 'AMMO3': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.700', 'weapon3': '0.812', 'FRAGCOUNT': '1.000', 'weapon2': '2.172'} [2023-02-24 17:27:44,210][177172] DAMAGECOUNT value on done: 1091.0 [2023-02-24 17:27:44,211][177172] Sum rewards: -3.021, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.979', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON1': '0.030', 'AMMO4': '0.057', 'weapon5': '0.096', 'AMMO3': '0.107', 'HITCOUNT': '0.130', 'weapon4': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.600', 'ARMOR': '0.844', 'weapon3': '0.844', 'FRAGCOUNT': '2.000', 'weapon2': '2.098'} [2023-02-24 17:27:44,279][177153] Updated weights for policy 0, policy_version 980 (0.0008) [2023-02-24 17:27:44,358][177170] DAMAGECOUNT value on done: 1116.0 [2023-02-24 17:27:44,367][177170] DAMAGECOUNT value on done: 2615.0 [2023-02-24 17:27:44,368][177170] Sum rewards: -2.021, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.568', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.016', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'weapon5': '0.114', 'WEAPON5': '0.150', 'HITCOUNT': '0.170', 'AMMO3': '0.171', 'DAMAGECOUNT': '0.720', 'WEAPON3': '0.950', 'weapon2': '1.176', 'weapon3': '1.636', 'FRAGCOUNT': '3.000'} [2023-02-24 17:27:44,415][177158] DAMAGECOUNT value on done: 1184.0 [2023-02-24 17:27:44,438][177154] DAMAGECOUNT value on done: 1407.0 [2023-02-24 17:27:44,439][177154] Sum rewards: -5.021, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.828', 'ARMOR': '0.004', 'AMMO2': '0.013', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.146', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.654', 'WEAPON3': '0.850', 'weapon3': '1.484', 'weapon2': '1.564', 'FRAGCOUNT': '2.000'} [2023-02-24 17:27:44,504][177172] DAMAGECOUNT value on done: 1648.0 [2023-02-24 17:27:44,504][177172] Sum rewards: -4.615, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.719', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'HITCOUNT': '0.060', 'weapon4': '0.066', 'weapon5': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'DAMAGECOUNT': '0.156', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.086', 'weapon2': '1.598'} [2023-02-24 17:27:44,520][177171] DAMAGECOUNT value on done: 1128.0 [2023-02-24 17:27:44,521][177171] Sum rewards: -3.353, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.669', 'AMMO5': '0.012', 'AMMO2': '0.014', 'ARMOR': '0.040', 'weapon4': '0.066', 'AMMO4': '0.070', 'weapon5': '0.088', 'HITCOUNT': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.157', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.750', 'weapon3': '0.946', 'weapon2': '1.992', 'FRAGCOUNT': '2.000'} [2023-02-24 17:27:44,635][177157] DAMAGECOUNT value on done: 2111.0 [2023-02-24 17:27:44,635][177157] Sum rewards: -7.978, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.300', 'ARMOR': '0.012', 'AMMO5': '0.013', 'weapon4': '0.014', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon5': '0.042', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'HITCOUNT': '0.220', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.888', 'weapon3': '1.232', 'WEAPON3': '1.250', 'weapon2': '1.950', 'FRAGCOUNT': '3.000'} [2023-02-24 17:27:44,649][177155] DAMAGECOUNT value on done: 1515.0 [2023-02-24 17:27:44,664][177170] DAMAGECOUNT value on done: 2042.0 [2023-02-24 17:27:44,664][177170] Sum rewards: -1.179, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.070', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'weapon4': '0.108', 'weapon5': '0.120', 'AMMO4': '0.167', 'HITCOUNT': '0.200', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.840', 'weapon3': '0.870', 'FRAGCOUNT': '2.000', 'weapon2': '2.072'} [2023-02-24 17:27:44,730][177154] DAMAGECOUNT value on done: 1722.0 [2023-02-24 17:27:44,797][177158] DAMAGECOUNT value on done: 1462.0 [2023-02-24 17:27:44,818][177171] DAMAGECOUNT value on done: 1059.0 [2023-02-24 17:27:44,818][177171] Sum rewards: -6.175, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.476', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.013', 'AMMO2': '0.017', 'ARMOR': '0.028', 'weapon5': '0.034', 'weapon4': '0.036', 'AMMO4': '0.083', 'AMMO3': '0.100', 'HITCOUNT': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.600', 'weapon3': '1.370', 'weapon2': '1.720'} [2023-02-24 17:27:44,922][177157] DAMAGECOUNT value on done: 1128.0 [2023-02-24 17:27:44,944][177155] DAMAGECOUNT value on done: 1548.0 [2023-02-24 17:27:44,945][177155] Sum rewards: -1.577, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.500', 'AMMO2': '0.017', 'ARMOR': '0.076', 'weapon4': '0.082', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'AMMO3': '0.125', 'HITCOUNT': '0.180', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.810', 'weapon3': '0.950', 'FRAGCOUNT': '2.000', 'weapon2': '2.046'} [2023-02-24 17:27:44,946][177172] DAMAGECOUNT value on done: 949.0 [2023-02-24 17:27:44,946][177172] Sum rewards: -2.772, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.050', 'AMMO2': '0.019', 'weapon4': '0.042', 'WEAPON4': '0.050', 'AMMO4': '0.093', 'HITCOUNT': '0.100', 'AMMO3': '0.149', 'DAMAGECOUNT': '0.261', 'ARMOR': '0.452', 'WEAPON3': '0.900', 'weapon3': '1.262', 'weapon2': '1.950', 'FRAGCOUNT': '2.000'} [2023-02-24 17:27:44,987][177157] DAMAGECOUNT value on done: 1815.0 [2023-02-24 17:27:44,987][177157] Sum rewards: -5.381, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.179', 'AMMO5': '0.005', 'weapon5': '0.022', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO3': '0.126', 'AMMO4': '0.134', 'HITCOUNT': '0.170', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.660', 'FRAGCOUNT': '1.000', 'weapon3': '1.180', 'weapon2': '2.024'} [2023-02-24 17:27:45,021][177154] DAMAGECOUNT value on done: 1957.0 [2023-02-24 17:27:45,084][177158] DAMAGECOUNT value on done: 1218.0 [2023-02-24 17:27:45,085][177158] Sum rewards: -2.549, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.272', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.056', 'HITCOUNT': '0.060', 'ARMOR': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.154', 'weapon4': '0.174', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.240', 'WEAPON3': '0.850', 'weapon3': '1.102', 'weapon2': '1.940', 'FRAGCOUNT': '2.000'} [2023-02-24 17:27:45,106][177171] DAMAGECOUNT value on done: 1003.0 [2023-02-24 17:27:45,239][177155] DAMAGECOUNT value on done: 1722.0 [2023-02-24 17:27:45,239][177172] DAMAGECOUNT value on done: 975.0 [2023-02-24 17:27:45,239][177155] Sum rewards: -4.177, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.686', 'AMMO2': '0.011', 'AMMO5': '0.011', 'WEAPON1': '0.030', 'weapon4': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'HITCOUNT': '0.100', 'AMMO3': '0.102', 'WEAPON5': '0.150', 'weapon5': '0.172', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.166', 'weapon2': '1.748'} [2023-02-24 17:27:45,269][177157] DAMAGECOUNT value on done: 1096.0 [2023-02-24 17:27:45,269][177157] Sum rewards: -7.833, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.114', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon5': '0.076', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.116', 'weapon4': '0.164', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.504', 'WEAPON3': '0.600', 'weapon3': '0.866', 'weapon2': '2.108'} [2023-02-24 17:27:45,335][177156] DAMAGECOUNT value on done: 1230.0 [2023-02-24 17:27:45,336][177156] Sum rewards: -1.413, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.344', 'AMMO5': '0.008', 'AMMO2': '0.009', 'ARMOR': '0.024', 'weapon5': '0.044', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'weapon4': '0.070', 'AMMO3': '0.077', 'HITCOUNT': '0.130', 'WEAPON5': '0.150', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.564', 'FRAGCOUNT': '1.000', 'weapon3': '1.260', 'weapon2': '1.800'} [2023-02-24 17:27:45,415][177171] DAMAGECOUNT value on done: 966.0 [2023-02-24 17:27:45,415][177171] Sum rewards: -6.883, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.120', 'FRAGCOUNT': '-1.500', 'AMMO2': '0.005', 'AMMO5': '0.010', 'HITCOUNT': '0.010', 'WEAPON1': '0.020', 'weapon5': '0.022', 'AMMO4': '0.025', 'ARMOR': '0.040', 'DAMAGECOUNT': '0.045', 'WEAPON4': '0.100', 'weapon4': '0.102', 'AMMO3': '0.148', 'WEAPON5': '0.200', 'WEAPON3': '0.750', 'weapon3': '0.766', 'weapon2': '1.994'} [2023-02-24 17:27:45,529][177155] DAMAGECOUNT value on done: 1022.0 [2023-02-24 17:27:45,632][177156] DAMAGECOUNT value on done: 842.0 [2023-02-24 17:27:45,632][177156] Sum rewards: -1.330, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.857', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'HITCOUNT': '0.060', 'ARMOR': '0.065', 'AMMO3': '0.069', 'AMMO4': '0.178', 'DAMAGECOUNT': '0.180', 'weapon4': '0.180', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'weapon3': '0.906', 'FRAGCOUNT': '1.000', 'weapon2': '1.978'} [2023-02-24 17:27:45,927][177156] DAMAGECOUNT value on done: 1079.0 [2023-02-24 17:27:46,219][177156] DAMAGECOUNT value on done: 1437.0 [2023-02-24 17:27:46,220][177156] Sum rewards: -7.933, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.832', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.012', 'weapon4': '0.028', 'AMMO4': '0.061', 'ARMOR': '0.064', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.130', 'AMMO3': '0.171', 'DAMAGECOUNT': '0.372', 'FRAGCOUNT': '0.500', 'weapon3': '0.670', 'WEAPON3': '0.750', 'weapon2': '2.678'} [2023-02-24 17:27:46,376][177119] Fps is (10 sec: 14336.2, 60 sec: 14267.7, 300 sec: 14185.1). Total num frames: 4042752. Throughput: 0: 3554.1. Samples: 1011624. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:27:46,376][177119] Avg episode reward: [(0, '-4.501')] [2023-02-24 17:27:46,380][177140] Saving new best policy, reward=-4.501! [2023-02-24 17:27:47,190][177153] Updated weights for policy 0, policy_version 990 (0.0008) [2023-02-24 17:27:50,066][177153] Updated weights for policy 0, policy_version 1000 (0.0009) [2023-02-24 17:27:51,376][177119] Fps is (10 sec: 13926.5, 60 sec: 14199.5, 300 sec: 14180.7). Total num frames: 4112384. Throughput: 0: 3553.8. Samples: 1022334. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:27:51,376][177119] Avg episode reward: [(0, '-4.501')] [2023-02-24 17:27:52,924][177153] Updated weights for policy 0, policy_version 1010 (0.0009) [2023-02-24 17:27:55,755][177153] Updated weights for policy 0, policy_version 1020 (0.0008) [2023-02-24 17:27:56,376][177119] Fps is (10 sec: 14336.1, 60 sec: 14267.7, 300 sec: 14190.2). Total num frames: 4186112. Throughput: 0: 3554.9. Samples: 1043754. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:27:56,376][177119] Avg episode reward: [(0, '-4.501')] [2023-02-24 17:27:58,599][177153] Updated weights for policy 0, policy_version 1030 (0.0008) [2023-02-24 17:28:01,376][177119] Fps is (10 sec: 14335.8, 60 sec: 14199.5, 300 sec: 14329.1). Total num frames: 4255744. Throughput: 0: 3550.2. Samples: 1065104. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:28:01,376][177119] Avg episode reward: [(0, '-4.501')] [2023-02-24 17:28:01,495][177153] Updated weights for policy 0, policy_version 1040 (0.0009) [2023-02-24 17:28:02,916][177170] DAMAGECOUNT value on done: 1832.0 [2023-02-24 17:28:03,000][177154] DAMAGECOUNT value on done: 2329.0 [2023-02-24 17:28:03,000][177154] Sum rewards: -3.217, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.867', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.042', 'weapon4': '0.062', 'ARMOR': '0.072', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'AMMO4': '0.153', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.026', 'weapon2': '2.120'} [2023-02-24 17:28:03,027][177158] DAMAGECOUNT value on done: 2054.0 [2023-02-24 17:28:03,027][177158] Sum rewards: -4.817, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.378', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.006', 'weapon4': '0.018', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.149', 'HITCOUNT': '0.240', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.131', 'weapon3': '1.146', 'weapon2': '2.086', 'FRAGCOUNT': '3.000'} [2023-02-24 17:28:03,105][177172] DAMAGECOUNT value on done: 1131.0 [2023-02-24 17:28:03,105][177172] Sum rewards: -7.663, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.410', 'AMMO2': '0.006', 'weapon4': '0.028', 'AMMO4': '0.030', 'HITCOUNT': '0.040', 'ARMOR': '0.112', 'DAMAGECOUNT': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.156', 'WEAPON3': '0.850', 'weapon3': '0.956', 'FRAGCOUNT': '1.000', 'weapon2': '2.298'} [2023-02-24 17:28:03,185][177170] DAMAGECOUNT value on done: 1125.0 [2023-02-24 17:28:03,186][177170] Sum rewards: -2.303, reward structure: {'DEATHCOUNT': '-4.500', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.003', 'AMMO2': '0.009', 'HITCOUNT': '0.010', 'DAMAGECOUNT': '0.027', 'ARMOR': '0.032', 'weapon5': '0.032', 'AMMO4': '0.043', 'WEAPON5': '0.050', 'HEALTH': '0.060', 'weapon4': '0.074', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'WEAPON3': '0.400', 'weapon3': '1.180', 'weapon2': '1.594'} [2023-02-24 17:28:03,219][177170] DAMAGECOUNT value on done: 2727.0 [2023-02-24 17:28:03,301][177154] DAMAGECOUNT value on done: 1497.0 [2023-02-24 17:28:03,306][177171] DAMAGECOUNT value on done: 1170.0 [2023-02-24 17:28:03,329][177158] DAMAGECOUNT value on done: 1319.0 [2023-02-24 17:28:03,329][177158] Sum rewards: 0.979, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.252', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'AMMO3': '0.096', 'AMMO4': '0.108', 'HITCOUNT': '0.150', 'DAMAGECOUNT': '0.405', 'ARMOR': '0.444', 'WEAPON3': '0.500', 'weapon3': '1.390', 'weapon2': '1.566', 'FRAGCOUNT': '4.000'} [2023-02-24 17:28:03,405][177172] DAMAGECOUNT value on done: 1805.0 [2023-02-24 17:28:03,406][177172] Sum rewards: -1.303, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.101', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon7': '0.050', 'HITCOUNT': '0.060', 'AMMO4': '0.070', 'AMMO3': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'ARMOR': '0.152', 'weapon4': '0.154', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.471', 'WEAPON3': '0.500', 'weapon3': '0.500', 'FRAGCOUNT': '1.000', 'weapon2': '2.170'} [2023-02-24 17:28:03,486][177170] DAMAGECOUNT value on done: 2141.0 [2023-02-24 17:28:03,608][177154] DAMAGECOUNT value on done: 1767.0 [2023-02-24 17:28:03,609][177154] Sum rewards: -7.444, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.504', 'AMMO2': '0.019', 'HITCOUNT': '0.040', 'AMMO4': '0.094', 'AMMO3': '0.126', 'DAMAGECOUNT': '0.135', 'WEAPON4': '0.200', 'weapon4': '0.218', 'ARMOR': '0.452', 'weapon3': '0.622', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '2.454'} [2023-02-24 17:28:03,613][177157] DAMAGECOUNT value on done: 2371.0 [2023-02-24 17:28:03,614][177157] Sum rewards: -0.861, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.460', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'ARMOR': '0.015', 'weapon4': '0.052', 'AMMO4': '0.065', 'AMMO3': '0.065', 'WEAPON5': '0.100', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.780', 'weapon3': '1.040', 'FRAGCOUNT': '2.000', 'weapon2': '2.234'} [2023-02-24 17:28:03,615][177171] DAMAGECOUNT value on done: 1224.0 [2023-02-24 17:28:03,615][177171] Sum rewards: -5.444, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.679', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'weapon4': '0.040', 'AMMO4': '0.081', 'HITCOUNT': '0.120', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.208', 'weapon2': '1.916'} [2023-02-24 17:28:03,643][177155] DAMAGECOUNT value on done: 1670.0 [2023-02-24 17:28:03,644][177155] Sum rewards: -1.193, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.436', 'AMMO2': '0.017', 'ARMOR': '0.040', 'AMMO3': '0.067', 'AMMO4': '0.084', 'weapon4': '0.098', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.465', 'weapon3': '0.984', 'FRAGCOUNT': '1.000', 'weapon2': '1.998'} [2023-02-24 17:28:03,699][177158] DAMAGECOUNT value on done: 1497.0 [2023-02-24 17:28:03,873][177172] DAMAGECOUNT value on done: 974.0 [2023-02-24 17:28:03,873][177172] Sum rewards: -6.320, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.576', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'HITCOUNT': '0.030', 'AMMO3': '0.046', 'ARMOR': '0.060', 'DAMAGECOUNT': '0.075', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'weapon5': '0.110', 'weapon4': '0.120', 'WEAPON4': '0.150', 'weapon3': '0.150', 'WEAPON3': '0.250', 'weapon2': '2.792'} [2023-02-24 17:28:03,908][177154] DAMAGECOUNT value on done: 2200.0 [2023-02-24 17:28:03,914][177157] DAMAGECOUNT value on done: 1158.0 [2023-02-24 17:28:03,915][177171] DAMAGECOUNT value on done: 1108.0 [2023-02-24 17:28:03,915][177171] Sum rewards: -7.370, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.850', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.012', 'AMMO2': '0.017', 'ARMOR': '0.040', 'weapon5': '0.040', 'AMMO3': '0.056', 'AMMO4': '0.082', 'HITCOUNT': '0.100', 'weapon4': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.315', 'WEAPON3': '0.400', 'weapon3': '0.780', 'weapon2': '2.584'} [2023-02-24 17:28:03,945][177155] DAMAGECOUNT value on done: 1793.0 [2023-02-24 17:28:03,945][177155] Sum rewards: -4.218, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.688', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'weapon5': '0.014', 'AMMO5': '0.015', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'ARMOR': '0.052', 'weapon4': '0.084', 'AMMO3': '0.158', 'HITCOUNT': '0.160', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.735', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.174', 'weapon2': '1.764'} [2023-02-24 17:28:03,971][177157] DAMAGECOUNT value on done: 1930.0 [2023-02-24 17:28:03,996][177158] DAMAGECOUNT value on done: 1348.0 [2023-02-24 17:28:03,996][177158] Sum rewards: -4.076, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.478', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.021', 'weapon7': '0.038', 'ARMOR': '0.076', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.105', 'HITCOUNT': '0.130', 'weapon4': '0.140', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.600', 'weapon3': '0.936', 'FRAGCOUNT': '1.000', 'weapon2': '2.046'} [2023-02-24 17:28:04,165][177172] DAMAGECOUNT value on done: 1010.0 [2023-02-24 17:28:04,165][177172] Sum rewards: -2.309, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.232', 'AMMO5': '0.003', 'AMMO2': '0.032', 'HITCOUNT': '0.040', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'AMMO3': '0.095', 'DAMAGECOUNT': '0.105', 'AMMO4': '0.159', 'WEAPON4': '0.250', 'weapon4': '0.264', 'WEAPON3': '0.450', 'weapon3': '0.766', 'FRAGCOUNT': '1.000', 'weapon2': '2.150'} [2023-02-24 17:28:04,215][177171] DAMAGECOUNT value on done: 990.0 [2023-02-24 17:28:04,238][177155] DAMAGECOUNT value on done: 1842.0 [2023-02-24 17:28:04,270][177157] DAMAGECOUNT value on done: 1276.0 [2023-02-24 17:28:04,270][177157] Sum rewards: -2.054, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.927', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'ARMOR': '0.060', 'AMMO3': '0.125', 'HITCOUNT': '0.140', 'WEAPON4': '0.200', 'weapon4': '0.258', 'DAMAGECOUNT': '0.540', 'WEAPON3': '0.700', 'weapon3': '0.996', 'weapon2': '1.692', 'FRAGCOUNT': '3.000'} [2023-02-24 17:28:04,294][177156] DAMAGECOUNT value on done: 1257.0 [2023-02-24 17:28:04,435][177153] Updated weights for policy 0, policy_version 1050 (0.0008) [2023-02-24 17:28:04,538][177155] DAMAGECOUNT value on done: 1149.0 [2023-02-24 17:28:04,593][177156] DAMAGECOUNT value on done: 1143.0 [2023-02-24 17:28:04,594][177156] Sum rewards: 0.725, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.805', 'AMMO5': '0.009', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.078', 'weapon4': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.152', 'HITCOUNT': '0.170', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'weapon3': '0.644', 'DAMAGECOUNT': '0.903', 'FRAGCOUNT': '2.000', 'weapon2': '2.612'} [2023-02-24 17:28:04,894][177156] DAMAGECOUNT value on done: 1151.0 [2023-02-24 17:28:04,895][177156] Sum rewards: -4.504, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.964', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.032', 'ARMOR': '0.056', 'HITCOUNT': '0.070', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.216', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.164', 'weapon2': '1.658'} [2023-02-24 17:28:05,187][177156] DAMAGECOUNT value on done: 1472.0 [2023-02-24 17:28:06,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14199.5, 300 sec: 14315.2). Total num frames: 4325376. Throughput: 0: 3547.5. Samples: 1075602. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:28:06,376][177119] Avg episode reward: [(0, '-4.349')] [2023-02-24 17:28:06,380][177140] Saving new best policy, reward=-4.349! [2023-02-24 17:28:07,284][177153] Updated weights for policy 0, policy_version 1060 (0.0009) [2023-02-24 17:28:10,130][177153] Updated weights for policy 0, policy_version 1070 (0.0009) [2023-02-24 17:28:11,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14267.7, 300 sec: 14315.2). Total num frames: 4399104. Throughput: 0: 3554.4. Samples: 1097124. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:28:11,376][177119] Avg episode reward: [(0, '-4.349')] [2023-02-24 17:28:13,016][177153] Updated weights for policy 0, policy_version 1080 (0.0008) [2023-02-24 17:28:15,916][177153] Updated weights for policy 0, policy_version 1090 (0.0008) [2023-02-24 17:28:16,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14199.5, 300 sec: 14301.3). Total num frames: 4468736. Throughput: 0: 3553.7. Samples: 1118424. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:28:16,376][177119] Avg episode reward: [(0, '-4.349')] [2023-02-24 17:28:18,810][177153] Updated weights for policy 0, policy_version 1100 (0.0008) [2023-02-24 17:28:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14199.4, 300 sec: 14287.4). Total num frames: 4538368. Throughput: 0: 3552.2. Samples: 1129076. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:28:21,376][177119] Avg episode reward: [(0, '-4.349')] [2023-02-24 17:28:21,682][177153] Updated weights for policy 0, policy_version 1110 (0.0009) [2023-02-24 17:28:21,812][177170] DAMAGECOUNT value on done: 1907.0 [2023-02-24 17:28:21,813][177170] Sum rewards: -1.061, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.434', 'AMMO5': '0.007', 'weapon5': '0.014', 'AMMO2': '0.025', 'HITCOUNT': '0.070', 'weapon4': '0.078', 'weapon7': '0.078', 'AMMO3': '0.095', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.225', 'WEAPON3': '0.500', 'weapon3': '1.034', 'weapon2': '1.974', 'FRAGCOUNT': '2.000'} [2023-02-24 17:28:21,842][177158] DAMAGECOUNT value on done: 2234.0 [2023-02-24 17:28:21,843][177158] Sum rewards: -7.232, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.489', 'weapon4': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'HITCOUNT': '0.160', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'DAMAGECOUNT': '0.540', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.100', 'weapon3': '1.506', 'weapon2': '1.564'} [2023-02-24 17:28:21,871][177154] DAMAGECOUNT value on done: 2401.0 [2023-02-24 17:28:21,871][177154] Sum rewards: -4.697, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.884', 'AMMO2': '0.004', 'AMMO5': '0.016', 'AMMO4': '0.020', 'weapon5': '0.050', 'HITCOUNT': '0.060', 'weapon7': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'DAMAGECOUNT': '0.171', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.464', 'WEAPON3': '0.550', 'weapon3': '0.988', 'weapon2': '1.938'} [2023-02-24 17:28:21,930][177172] DAMAGECOUNT value on done: 1271.0 [2023-02-24 17:28:21,931][177172] Sum rewards: -1.304, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.007', 'weapon5': '0.024', 'AMMO2': '0.031', 'ARMOR': '0.032', 'HITCOUNT': '0.080', 'weapon4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.156', 'HEALTH': '0.366', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.202', 'weapon2': '1.920'} [2023-02-24 17:28:22,059][177170] DAMAGECOUNT value on done: 1129.0 [2023-02-24 17:28:22,123][177170] DAMAGECOUNT value on done: 2849.0 [2023-02-24 17:28:22,123][177170] Sum rewards: -5.791, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.090', 'AMMO5': '0.010', 'AMMO2': '0.020', 'ARMOR': '0.024', 'weapon4': '0.054', 'weapon5': '0.096', 'AMMO4': '0.100', 'AMMO3': '0.109', 'HITCOUNT': '0.110', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.366', 'WEAPON3': '0.550', 'weapon3': '0.770', 'FRAGCOUNT': '1.000', 'weapon2': '2.390'} [2023-02-24 17:28:22,146][177158] DAMAGECOUNT value on done: 1379.0 [2023-02-24 17:28:22,165][177154] DAMAGECOUNT value on done: 1679.0 [2023-02-24 17:28:22,166][177154] Sum rewards: -2.280, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.587', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon4': '0.066', 'AMMO4': '0.097', 'ARMOR': '0.100', 'AMMO3': '0.103', 'HITCOUNT': '0.110', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.546', 'WEAPON3': '0.600', 'weapon3': '0.848', 'FRAGCOUNT': '1.000', 'weapon2': '2.248'} [2023-02-24 17:28:22,236][177172] DAMAGECOUNT value on done: 2042.0 [2023-02-24 17:28:22,237][177172] Sum rewards: -0.710, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.704', 'AMMO5': '0.005', 'weapon7': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'ARMOR': '0.104', 'AMMO3': '0.108', 'HITCOUNT': '0.130', 'weapon4': '0.166', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.711', 'weapon3': '0.804', 'FRAGCOUNT': '1.000', 'weapon2': '2.066'} [2023-02-24 17:28:22,323][177171] DAMAGECOUNT value on done: 1320.0 [2023-02-24 17:28:22,323][177171] Sum rewards: -3.476, reward structure: {'DEATHCOUNT': '-9.750', 'weapon4': '0.002', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'ARMOR': '0.066', 'AMMO4': '0.074', 'AMMO3': '0.086', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.450', 'HEALTH': '0.672', 'weapon3': '0.780', 'FRAGCOUNT': '1.000', 'weapon2': '2.410'} [2023-02-24 17:28:22,370][177170] DAMAGECOUNT value on done: 2246.0 [2023-02-24 17:28:22,442][177157] DAMAGECOUNT value on done: 2431.0 [2023-02-24 17:28:22,458][177154] DAMAGECOUNT value on done: 1902.0 [2023-02-24 17:28:22,459][177154] Sum rewards: -3.049, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.778', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.046', 'WEAPON5': '0.050', 'ARMOR': '0.084', 'weapon4': '0.108', 'AMMO4': '0.116', 'AMMO3': '0.126', 'HITCOUNT': '0.130', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.700', 'weapon3': '0.904', 'FRAGCOUNT': '1.000', 'weapon2': '2.034'} [2023-02-24 17:28:22,515][177158] DAMAGECOUNT value on done: 1552.0 [2023-02-24 17:28:22,515][177158] Sum rewards: -5.269, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.712', 'weapon5': '0.004', 'AMMO5': '0.005', 'ARMOR': '0.018', 'AMMO2': '0.028', 'HITCOUNT': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'AMMO3': '0.156', 'DAMAGECOUNT': '0.165', 'weapon4': '0.178', 'WEAPON4': '0.200', 'WEAPON3': '0.800', 'weapon3': '0.924', 'FRAGCOUNT': '1.000', 'weapon2': '2.168'} [2023-02-24 17:28:22,615][177171] DAMAGECOUNT value on done: 1319.0 [2023-02-24 17:28:22,623][177155] DAMAGECOUNT value on done: 1870.0 [2023-02-24 17:28:22,624][177155] Sum rewards: -5.516, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.693', 'AMMO2': '0.010', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.048', 'weapon5': '0.066', 'HITCOUNT': '0.130', 'AMMO3': '0.133', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.408', 'weapon2': '1.652'} [2023-02-24 17:28:22,736][177157] DAMAGECOUNT value on done: 1180.0 [2023-02-24 17:28:22,756][177172] DAMAGECOUNT value on done: 1052.0 [2023-02-24 17:28:22,767][177154] DAMAGECOUNT value on done: 2248.0 [2023-02-24 17:28:22,792][177157] DAMAGECOUNT value on done: 2218.0 [2023-02-24 17:28:22,792][177157] Sum rewards: -4.549, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.580', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.006', 'WEAPON1': '0.030', 'weapon7': '0.056', 'weapon5': '0.090', 'HITCOUNT': '0.140', 'WEAPON5': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO3': '0.167', 'WEAPON7': '0.200', 'ARMOR': '0.451', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.864', 'weapon3': '1.184', 'weapon2': '1.784'} [2023-02-24 17:28:22,810][177158] DAMAGECOUNT value on done: 1368.0 [2023-02-24 17:28:22,916][177171] DAMAGECOUNT value on done: 1199.0 [2023-02-24 17:28:22,916][177171] Sum rewards: -6.970, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.277', 'AMMO2': '0.006', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'HITCOUNT': '0.060', 'weapon4': '0.072', 'AMMO3': '0.105', 'weapon5': '0.106', 'DAMAGECOUNT': '0.273', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'weapon3': '1.022', 'weapon2': '1.746'} [2023-02-24 17:28:22,919][177155] DAMAGECOUNT value on done: 1975.0 [2023-02-24 17:28:22,920][177155] Sum rewards: -1.962, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.500', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO3': '0.095', 'AMMO4': '0.122', 'HITCOUNT': '0.140', 'weapon4': '0.184', 'WEAPON4': '0.350', 'DAMAGECOUNT': '0.546', 'ARMOR': '0.548', 'WEAPON3': '0.550', 'weapon3': '0.884', 'FRAGCOUNT': '1.000', 'weapon2': '2.284'} [2023-02-24 17:28:23,061][177172] DAMAGECOUNT value on done: 1170.0 [2023-02-24 17:28:23,061][177172] Sum rewards: -6.278, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.865', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.008', 'WEAPON1': '0.040', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'HITCOUNT': '0.120', 'DAMAGECOUNT': '0.480', 'ARMOR': '0.482', 'WEAPON3': '0.550', 'weapon3': '1.370', 'weapon2': '1.544'} [2023-02-24 17:28:23,082][177157] DAMAGECOUNT value on done: 1388.0 [2023-02-24 17:28:23,200][177155] DAMAGECOUNT value on done: 2052.0 [2023-02-24 17:28:23,207][177171] DAMAGECOUNT value on done: 1030.0 [2023-02-24 17:28:23,272][177156] DAMAGECOUNT value on done: 1292.0 [2023-02-24 17:28:23,497][177155] DAMAGECOUNT value on done: 1276.0 [2023-02-24 17:28:23,497][177155] Sum rewards: -4.408, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.505', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.010', 'ARMOR': '0.040', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.136', 'DAMAGECOUNT': '0.381', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.242', 'weapon2': '1.822'} [2023-02-24 17:28:23,570][177156] DAMAGECOUNT value on done: 1432.0 [2023-02-24 17:28:23,570][177156] Sum rewards: -0.525, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.544', 'AMMO4': '-0.048', 'AMMO2': '-0.010', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'weapon5': '0.132', 'AMMO3': '0.158', 'HITCOUNT': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.436', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.867', 'weapon3': '1.254', 'weapon2': '1.988', 'FRAGCOUNT': '3.000'} [2023-02-24 17:28:23,911][177156] DAMAGECOUNT value on done: 1240.0 [2023-02-24 17:28:24,201][177156] DAMAGECOUNT value on done: 1472.0 [2023-02-24 17:28:24,608][177153] Updated weights for policy 0, policy_version 1120 (0.0008) [2023-02-24 17:28:26,376][177119] Fps is (10 sec: 14336.1, 60 sec: 14267.7, 300 sec: 14301.3). Total num frames: 4612096. Throughput: 0: 3551.8. Samples: 1150352. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:28:26,376][177119] Avg episode reward: [(0, '-4.397')] [2023-02-24 17:28:27,485][177153] Updated weights for policy 0, policy_version 1130 (0.0008) [2023-02-24 17:28:30,354][177153] Updated weights for policy 0, policy_version 1140 (0.0009) [2023-02-24 17:28:31,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14199.5, 300 sec: 14287.4). Total num frames: 4681728. Throughput: 0: 3556.2. Samples: 1171652. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:28:31,376][177119] Avg episode reward: [(0, '-4.397')] [2023-02-24 17:28:33,263][177153] Updated weights for policy 0, policy_version 1150 (0.0008) [2023-02-24 17:28:35,196][177155] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 17:28:36,145][177153] Updated weights for policy 0, policy_version 1160 (0.0009) [2023-02-24 17:28:36,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14199.5, 300 sec: 14287.4). Total num frames: 4751360. Throughput: 0: 3555.6. Samples: 1182338. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:28:36,376][177119] Avg episode reward: [(0, '-4.397')] [2023-02-24 17:28:39,018][177153] Updated weights for policy 0, policy_version 1170 (0.0009) [2023-02-24 17:28:40,696][177170] DAMAGECOUNT value on done: 2062.0 [2023-02-24 17:28:40,696][177170] Sum rewards: -5.027, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.234', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.027', 'AMMO3': '0.095', 'HITCOUNT': '0.110', 'DAMAGECOUNT': '0.465', 'WEAPON3': '0.550', 'ARMOR': '0.556', 'FRAGCOUNT': '1.000', 'weapon3': '1.236', 'weapon2': '1.892'} [2023-02-24 17:28:40,826][177158] DAMAGECOUNT value on done: 2571.0 [2023-02-24 17:28:40,826][177158] Sum rewards: -2.536, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.465', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon5': '0.036', 'weapon4': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.122', 'AMMO4': '0.137', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'ARMOR': '0.492', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.011', 'weapon3': '1.110', 'FRAGCOUNT': '1.500', 'weapon2': '1.868'} [2023-02-24 17:28:40,866][177154] DAMAGECOUNT value on done: 2485.0 [2023-02-24 17:28:40,866][177154] Sum rewards: -7.222, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.068', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.007', 'weapon5': '0.026', 'AMMO2': '0.027', 'ARMOR': '0.068', 'AMMO3': '0.087', 'weapon4': '0.088', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'DAMAGECOUNT': '0.252', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'weapon3': '0.612', 'weapon2': '2.602'} [2023-02-24 17:28:40,920][177172] DAMAGECOUNT value on done: 1286.0 [2023-02-24 17:28:40,947][177170] DAMAGECOUNT value on done: 1293.0 [2023-02-24 17:28:40,947][177170] Sum rewards: 0.384, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.047', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'weapon4': '0.116', 'HITCOUNT': '0.160', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.492', 'ARMOR': '0.982', 'weapon3': '1.136', 'FRAGCOUNT': '2.000', 'weapon2': '2.256'} [2023-02-24 17:28:41,007][177170] DAMAGECOUNT value on done: 3094.0 [2023-02-24 17:28:41,007][177170] Sum rewards: -4.886, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.678', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'ARMOR': '0.032', 'weapon5': '0.054', 'HITCOUNT': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'weapon3': '0.704', 'DAMAGECOUNT': '0.735', 'WEAPON3': '0.800', 'FRAGCOUNT': '2.000', 'weapon2': '2.574'} [2023-02-24 17:28:41,137][177158] DAMAGECOUNT value on done: 1704.0 [2023-02-24 17:28:41,137][177158] Sum rewards: -3.751, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.374', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'AMMO5': '0.010', 'ARMOR': '0.048', 'WEAPON5': '0.200', 'HITCOUNT': '0.200', 'AMMO3': '0.202', 'DAMAGECOUNT': '0.975', 'WEAPON3': '1.150', 'weapon3': '1.236', 'weapon2': '1.902', 'FRAGCOUNT': '4.000'} [2023-02-24 17:28:41,166][177154] DAMAGECOUNT value on done: 1819.0 [2023-02-24 17:28:41,167][177154] Sum rewards: -6.179, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.830', 'AMMO4': '-0.060', 'AMMO2': '-0.012', 'ARMOR': '0.012', 'AMMO5': '0.022', 'weapon5': '0.032', 'HITCOUNT': '0.140', 'AMMO3': '0.157', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.170', 'weapon2': '2.020'} [2023-02-24 17:28:41,226][177172] DAMAGECOUNT value on done: 2109.0 [2023-02-24 17:28:41,247][177170] DAMAGECOUNT value on done: 2411.0 [2023-02-24 17:28:41,247][177170] Sum rewards: -2.950, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.090', 'AMMO2': '0.007', 'AMMO5': '0.010', 'weapon5': '0.018', 'ARMOR': '0.032', 'AMMO4': '0.035', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.102', 'AMMO3': '0.106', 'HITCOUNT': '0.140', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.495', 'FRAGCOUNT': '1.000', 'weapon3': '1.068', 'weapon2': '2.026'} [2023-02-24 17:28:41,277][177171] DAMAGECOUNT value on done: 1448.0 [2023-02-24 17:28:41,376][177119] Fps is (10 sec: 13926.6, 60 sec: 14131.2, 300 sec: 14273.5). Total num frames: 4820992. Throughput: 0: 3551.9. Samples: 1203588. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:28:41,376][177119] Avg episode reward: [(0, '-4.293')] [2023-02-24 17:28:41,377][177140] Saving new best policy, reward=-4.293! [2023-02-24 17:28:41,441][177157] DAMAGECOUNT value on done: 2526.0 [2023-02-24 17:28:41,449][177158] DAMAGECOUNT value on done: 1582.0 [2023-02-24 17:28:41,491][177154] DAMAGECOUNT value on done: 1982.0 [2023-02-24 17:28:41,576][177155] DAMAGECOUNT value on done: 1914.0 [2023-02-24 17:28:41,576][177155] Sum rewards: -7.930, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.100', 'AMMO5': '0.009', 'AMMO2': '0.015', 'weapon5': '0.040', 'HITCOUNT': '0.050', 'weapon4': '0.062', 'AMMO4': '0.074', 'DAMAGECOUNT': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'weapon3': '0.856', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '2.450'} [2023-02-24 17:28:41,595][177171] DAMAGECOUNT value on done: 1479.0 [2023-02-24 17:28:41,748][177157] DAMAGECOUNT value on done: 2406.0 [2023-02-24 17:28:41,749][177157] Sum rewards: -7.904, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.688', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.014', 'ARMOR': '0.048', 'AMMO4': '0.064', 'weapon4': '0.108', 'HITCOUNT': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.564', 'weapon3': '0.704', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '2.586'} [2023-02-24 17:28:41,752][177172] DAMAGECOUNT value on done: 1297.0 [2023-02-24 17:28:41,752][177172] Sum rewards: -0.449, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.759', 'AMMO2': '0.014', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.024', 'AMMO4': '0.071', 'ARMOR': '0.076', 'weapon4': '0.098', 'AMMO3': '0.120', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.735', 'weapon3': '1.260', 'weapon2': '1.716', 'FRAGCOUNT': '3.000'} [2023-02-24 17:28:41,758][177157] DAMAGECOUNT value on done: 1465.0 [2023-02-24 17:28:41,758][177157] Sum rewards: -0.399, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'weapon5': '0.034', 'weapon4': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HEALTH': '0.110', 'AMMO3': '0.119', 'AMMO4': '0.153', 'HITCOUNT': '0.220', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.855', 'weapon3': '1.134', 'weapon2': '1.846', 'FRAGCOUNT': '2.500'} [2023-02-24 17:28:41,759][177158] DAMAGECOUNT value on done: 1373.0 [2023-02-24 17:28:41,760][177158] Sum rewards: -3.110, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-1.500', 'HITCOUNT': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO5': '0.012', 'DAMAGECOUNT': '0.015', 'AMMO4': '0.051', 'AMMO3': '0.069', 'weapon5': '0.104', 'HEALTH': '0.214', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'ARMOR': '0.440', 'weapon3': '1.192', 'weapon2': '1.662'} [2023-02-24 17:28:41,788][177154] DAMAGECOUNT value on done: 2283.0 [2023-02-24 17:28:41,788][177154] Sum rewards: -4.953, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.829', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON1': '0.030', 'HITCOUNT': '0.040', 'AMMO4': '0.057', 'ARMOR': '0.066', 'weapon5': '0.098', 'DAMAGECOUNT': '0.105', 'weapon4': '0.112', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.400', 'weapon3': '0.684', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '2.420'} [2023-02-24 17:28:41,865][177155] DAMAGECOUNT value on done: 2231.0 [2023-02-24 17:28:41,865][177155] Sum rewards: 0.397, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.304', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'ARMOR': '0.024', 'AMMO2': '0.031', 'AMMO3': '0.069', 'HITCOUNT': '0.120', 'weapon4': '0.120', 'weapon5': '0.126', 'AMMO4': '0.154', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.768', 'weapon3': '0.848', 'weapon2': '1.970', 'FRAGCOUNT': '3.000'} [2023-02-24 17:28:41,894][177171] DAMAGECOUNT value on done: 1224.0 [2023-02-24 17:28:41,895][177171] Sum rewards: -8.349, reward structure: {'DEATHCOUNT': '-10.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.276', 'AMMO5': '0.010', 'AMMO2': '0.027', 'HITCOUNT': '0.030', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'DAMAGECOUNT': '0.075', 'weapon5': '0.076', 'weapon4': '0.106', 'AMMO3': '0.119', 'AMMO4': '0.135', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon3': '0.598', 'WEAPON3': '0.650', 'weapon2': '2.530'} [2023-02-24 17:28:41,976][177153] Updated weights for policy 0, policy_version 1180 (0.0008) [2023-02-24 17:28:42,048][177172] DAMAGECOUNT value on done: 1375.0 [2023-02-24 17:28:42,048][177172] Sum rewards: -1.034, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.929', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.021', 'WEAPON1': '0.030', 'AMMO3': '0.078', 'weapon5': '0.132', 'HITCOUNT': '0.160', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.615', 'FRAGCOUNT': '1.000', 'weapon3': '1.144', 'weapon2': '1.868'} [2023-02-24 17:28:42,056][177157] DAMAGECOUNT value on done: 1831.0 [2023-02-24 17:28:42,056][177157] Sum rewards: -2.889, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.307', 'AMMO5': '0.012', 'AMMO2': '0.013', 'weapon4': '0.016', 'ARMOR': '0.032', 'AMMO4': '0.063', 'weapon5': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.141', 'HITCOUNT': '0.300', 'WEAPON3': '0.700', 'weapon3': '0.882', 'DAMAGECOUNT': '1.329', 'FRAGCOUNT': '2.000', 'weapon2': '2.158'} [2023-02-24 17:28:42,157][177155] DAMAGECOUNT value on done: 2200.0 [2023-02-24 17:28:42,157][177155] Sum rewards: -6.958, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.272', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon4': '0.088', 'ARMOR': '0.096', 'WEAPON4': '0.100', 'HITCOUNT': '0.140', 'AMMO3': '0.152', 'DAMAGECOUNT': '0.444', 'WEAPON3': '0.700', 'weapon3': '0.910', 'FRAGCOUNT': '2.000', 'weapon2': '2.400'} [2023-02-24 17:28:42,172][177171] DAMAGECOUNT value on done: 1205.0 [2023-02-24 17:28:42,173][177171] Sum rewards: -3.158, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.852', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.088', 'AMMO3': '0.139', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.525', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.152', 'weapon2': '2.072'} [2023-02-24 17:28:42,296][177156] DAMAGECOUNT value on done: 1557.0 [2023-02-24 17:28:42,296][177156] Sum rewards: -1.547, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.832', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.010', 'weapon5': '0.042', 'AMMO4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.088', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'HITCOUNT': '0.150', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.795', 'weapon3': '0.840', 'FRAGCOUNT': '1.000', 'weapon2': '2.146'} [2023-02-24 17:28:42,449][177155] DAMAGECOUNT value on done: 1691.0 [2023-02-24 17:28:42,449][177155] Sum rewards: -3.492, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.370', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'weapon5': '0.044', 'weapon4': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.153', 'WEAPON5': '0.200', 'HITCOUNT': '0.270', 'WEAPON3': '0.900', 'weapon3': '1.142', 'DAMAGECOUNT': '1.245', 'weapon2': '1.970', 'FRAGCOUNT': '2.500'} [2023-02-24 17:28:42,589][177156] DAMAGECOUNT value on done: 1591.0 [2023-02-24 17:28:42,589][177156] Sum rewards: -8.420, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.648', 'AMMO2': '0.021', 'AMMO5': '0.026', 'ARMOR': '0.045', 'weapon4': '0.086', 'AMMO4': '0.104', 'weapon5': '0.120', 'HITCOUNT': '0.130', 'AMMO3': '0.153', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'DAMAGECOUNT': '0.477', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.000', 'weapon2': '1.966'} [2023-02-24 17:28:42,904][177156] DAMAGECOUNT value on done: 1399.0 [2023-02-24 17:28:43,199][177156] DAMAGECOUNT value on done: 1537.0 [2023-02-24 17:28:43,199][177156] Sum rewards: -8.012, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.460', 'AMMO2': '0.006', 'AMMO5': '0.008', 'weapon4': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.031', 'weapon5': '0.036', 'HITCOUNT': '0.060', 'ARMOR': '0.064', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.195', 'WEAPON3': '0.600', 'weapon3': '1.042', 'weapon2': '2.220'} [2023-02-24 17:28:44,855][177153] Updated weights for policy 0, policy_version 1190 (0.0009) [2023-02-24 17:28:46,376][177119] Fps is (10 sec: 14335.9, 60 sec: 14199.5, 300 sec: 14273.5). Total num frames: 4894720. Throughput: 0: 3549.0. Samples: 1224810. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:28:46,376][177119] Avg episode reward: [(0, '-4.335')] [2023-02-24 17:28:47,734][177153] Updated weights for policy 0, policy_version 1200 (0.0008) [2023-02-24 17:28:50,617][177153] Updated weights for policy 0, policy_version 1210 (0.0008) [2023-02-24 17:28:51,376][177119] Fps is (10 sec: 14335.8, 60 sec: 14199.4, 300 sec: 14273.5). Total num frames: 4964352. Throughput: 0: 3552.2. Samples: 1235452. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:28:51,376][177119] Avg episode reward: [(0, '-4.335')] [2023-02-24 17:28:53,514][177153] Updated weights for policy 0, policy_version 1220 (0.0008) [2023-02-24 17:28:56,376][177119] Fps is (10 sec: 13926.6, 60 sec: 14131.2, 300 sec: 14259.6). Total num frames: 5033984. Throughput: 0: 3546.7. Samples: 1256726. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:28:56,376][177119] Avg episode reward: [(0, '-4.335')] [2023-02-24 17:28:56,381][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000001230_5038080.pth... [2023-02-24 17:28:56,384][177153] Updated weights for policy 0, policy_version 1230 (0.0009) [2023-02-24 17:28:56,439][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000000395_1617920.pth [2023-02-24 17:28:59,298][177153] Updated weights for policy 0, policy_version 1240 (0.0008) [2023-02-24 17:28:59,551][177170] DAMAGECOUNT value on done: 2251.0 [2023-02-24 17:28:59,552][177170] Sum rewards: -6.420, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.140', 'AMMO2': '0.009', 'AMMO5': '0.017', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'weapon5': '0.124', 'HITCOUNT': '0.160', 'AMMO3': '0.177', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.567', 'WEAPON3': '0.900', 'weapon3': '0.966', 'FRAGCOUNT': '1.000', 'weapon2': '1.854'} [2023-02-24 17:28:59,794][177170] DAMAGECOUNT value on done: 1363.0 [2023-02-24 17:28:59,808][177154] DAMAGECOUNT value on done: 2813.0 [2023-02-24 17:28:59,809][177154] Sum rewards: -4.917, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.894', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.040', 'ARMOR': '0.056', 'weapon5': '0.092', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'HITCOUNT': '0.230', 'WEAPON4': '0.350', 'WEAPON3': '0.750', 'weapon3': '0.844', 'DAMAGECOUNT': '0.984', 'FRAGCOUNT': '2.000', 'weapon2': '2.142'} [2023-02-24 17:28:59,852][177170] DAMAGECOUNT value on done: 3179.0 [2023-02-24 17:28:59,852][177170] Sum rewards: -4.864, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-3.156', 'AMMO2': '0.010', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon4': '0.020', 'weapon5': '0.026', 'ARMOR': '0.032', 'AMMO4': '0.048', 'HITCOUNT': '0.090', 'AMMO3': '0.107', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.255', 'WEAPON4': '0.300', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.146', 'weapon2': '1.828'} [2023-02-24 17:28:59,894][177158] DAMAGECOUNT value on done: 2676.0 [2023-02-24 17:28:59,895][177158] Sum rewards: -4.888, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.480', 'AMMO2': '0.001', 'AMMO4': '0.007', 'weapon4': '0.010', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'HITCOUNT': '0.060', 'weapon5': '0.068', 'AMMO3': '0.111', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.315', 'ARMOR': '0.520', 'WEAPON3': '0.650', 'weapon3': '1.256', 'weapon2': '1.512'} [2023-02-24 17:28:59,914][177172] DAMAGECOUNT value on done: 1480.0 [2023-02-24 17:28:59,915][177172] Sum rewards: -3.505, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.612', 'AMMO2': '0.009', 'AMMO5': '0.015', 'AMMO4': '0.047', 'HITCOUNT': '0.140', 'weapon5': '0.142', 'AMMO3': '0.144', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.582', 'WEAPON3': '0.750', 'weapon3': '0.890', 'weapon2': '1.888', 'FRAGCOUNT': '2.000'} [2023-02-24 17:29:00,107][177170] DAMAGECOUNT value on done: 2573.0 [2023-02-24 17:29:00,107][177170] Sum rewards: -3.962, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.250', 'AMMO4': '-0.055', 'AMMO2': '-0.011', 'AMMO5': '0.005', 'weapon4': '0.046', 'ARMOR': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.120', 'DAMAGECOUNT': '0.486', 'WEAPON3': '0.700', 'weapon3': '0.764', 'FRAGCOUNT': '1.000', 'weapon2': '2.374'} [2023-02-24 17:29:00,110][177154] DAMAGECOUNT value on done: 2079.0 [2023-02-24 17:29:00,110][177154] Sum rewards: -2.714, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.624', 'AMMO5': '0.010', 'weapon4': '0.014', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'ARMOR': '0.056', 'AMMO4': '0.074', 'HITCOUNT': '0.080', 'AMMO3': '0.116', 'weapon5': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.780', 'weapon3': '0.936', 'FRAGCOUNT': '1.000', 'weapon2': '1.862'} [2023-02-24 17:29:00,181][177158] DAMAGECOUNT value on done: 1883.0 [2023-02-24 17:29:00,182][177158] Sum rewards: -5.821, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-2.000', 'HEALTH': '-0.993', 'AMMO5': '0.009', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'ARMOR': '0.090', 'weapon4': '0.098', 'weapon5': '0.130', 'AMMO4': '0.134', 'AMMO3': '0.153', 'HITCOUNT': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.537', 'WEAPON3': '0.750', 'weapon3': '0.826', 'weapon2': '1.968'} [2023-02-24 17:29:00,214][177172] DAMAGECOUNT value on done: 2159.0 [2023-02-24 17:29:00,214][177172] Sum rewards: -1.313, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.130', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'ARMOR': '0.012', 'weapon5': '0.018', 'weapon4': '0.038', 'HITCOUNT': '0.050', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.101', 'DAMAGECOUNT': '0.150', 'WEAPON3': '0.500', 'weapon3': '0.994', 'FRAGCOUNT': '1.000', 'weapon2': '2.022'} [2023-02-24 17:29:00,256][177171] DAMAGECOUNT value on done: 1505.0 [2023-02-24 17:29:00,257][177171] Sum rewards: -7.680, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.882', 'AMMO2': '0.013', 'AMMO5': '0.023', 'weapon5': '0.026', 'weapon4': '0.032', 'ARMOR': '0.036', 'HITCOUNT': '0.060', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'DAMAGECOUNT': '0.171', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'weapon3': '0.838', 'weapon2': '2.080'} [2023-02-24 17:29:00,399][177154] DAMAGECOUNT value on done: 2250.0 [2023-02-24 17:29:00,399][177154] Sum rewards: -1.559, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.760', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.016', 'WEAPON4': '0.050', 'weapon5': '0.054', 'AMMO4': '0.077', 'HITCOUNT': '0.120', 'AMMO3': '0.130', 'WEAPON5': '0.150', 'ARMOR': '0.416', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.804', 'weapon3': '0.974', 'weapon2': '1.938', 'FRAGCOUNT': '2.000'} [2023-02-24 17:29:00,471][177157] DAMAGECOUNT value on done: 2623.0 [2023-02-24 17:29:00,477][177158] DAMAGECOUNT value on done: 1727.0 [2023-02-24 17:29:00,477][177158] Sum rewards: 0.065, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.445', 'AMMO2': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon4': '0.022', 'AMMO4': '0.033', 'HITCOUNT': '0.090', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'weapon5': '0.144', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.435', 'ARMOR': '0.440', 'WEAPON3': '0.500', 'weapon3': '0.904', 'weapon2': '2.206', 'FRAGCOUNT': '3.000'} [2023-02-24 17:29:00,552][177171] DAMAGECOUNT value on done: 1504.0 [2023-02-24 17:29:00,552][177171] Sum rewards: -4.786, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.702', 'AMMO2': '0.004', 'AMMO5': '0.009', 'AMMO4': '0.019', 'WEAPON1': '0.020', 'HITCOUNT': '0.030', 'DAMAGECOUNT': '0.075', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.168', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'weapon3': '0.978', 'weapon2': '1.812'} [2023-02-24 17:29:00,554][177155] DAMAGECOUNT value on done: 2041.0 [2023-02-24 17:29:00,554][177155] Sum rewards: -5.627, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.800', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.038', 'ARMOR': '0.057', 'WEAPON4': '0.100', 'AMMO4': '0.127', 'HITCOUNT': '0.140', 'weapon4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'DAMAGECOUNT': '0.381', 'WEAPON3': '0.800', 'weapon3': '0.922', 'FRAGCOUNT': '2.000', 'weapon2': '2.114'} [2023-02-24 17:29:00,692][177154] DAMAGECOUNT value on done: 2335.0 [2023-02-24 17:29:00,759][177157] DAMAGECOUNT value on done: 2471.0 [2023-02-24 17:29:00,760][177172] DAMAGECOUNT value on done: 1446.0 [2023-02-24 17:29:00,760][177172] Sum rewards: -2.199, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.504', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.056', 'ARMOR': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'HITCOUNT': '0.150', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.447', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.070', 'weapon2': '2.018'} [2023-02-24 17:29:00,767][177157] DAMAGECOUNT value on done: 1764.0 [2023-02-24 17:29:00,767][177157] Sum rewards: -3.392, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.730', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'weapon4': '0.024', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.114', 'HITCOUNT': '0.120', 'AMMO3': '0.125', 'weapon3': '0.566', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.897', 'FRAGCOUNT': '1.000', 'weapon2': '2.566'} [2023-02-24 17:29:00,771][177158] DAMAGECOUNT value on done: 1430.0 [2023-02-24 17:29:00,771][177158] Sum rewards: -7.024, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.204', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.018', 'ARMOR': '0.032', 'HITCOUNT': '0.060', 'AMMO4': '0.076', 'weapon4': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.155', 'DAMAGECOUNT': '0.171', 'WEAPON4': '0.250', 'WEAPON3': '0.850', 'weapon3': '0.984', 'FRAGCOUNT': '1.000', 'weapon2': '1.888'} [2023-02-24 17:29:00,846][177155] DAMAGECOUNT value on done: 2571.0 [2023-02-24 17:29:00,846][177155] Sum rewards: -4.239, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.070', 'FRAGCOUNT': '0.000', 'ARMOR': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'weapon4': '0.072', 'AMMO4': '0.084', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.020', 'weapon3': '1.338', 'weapon2': '1.660'} [2023-02-24 17:29:00,851][177171] DAMAGECOUNT value on done: 1439.0 [2023-02-24 17:29:00,851][177171] Sum rewards: -5.220, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.170', 'ARMOR': '0.020', 'AMMO2': '0.035', 'weapon4': '0.054', 'AMMO3': '0.137', 'AMMO4': '0.176', 'HITCOUNT': '0.200', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.650', 'weapon3': '0.666', 'FRAGCOUNT': '1.000', 'weapon2': '2.616'} [2023-02-24 17:29:01,057][177157] DAMAGECOUNT value on done: 1981.0 [2023-02-24 17:29:01,057][177157] Sum rewards: -4.004, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.981', 'AMMO2': '0.002', 'weapon4': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'weapon5': '0.032', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'HITCOUNT': '0.130', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.032', 'weapon2': '2.246'} [2023-02-24 17:29:01,060][177172] DAMAGECOUNT value on done: 1675.0 [2023-02-24 17:29:01,061][177172] Sum rewards: -6.322, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.899', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.133', 'HITCOUNT': '0.230', 'WEAPON3': '0.600', 'weapon3': '0.834', 'DAMAGECOUNT': '0.900', 'FRAGCOUNT': '2.000', 'weapon2': '2.300'} [2023-02-24 17:29:01,134][177155] DAMAGECOUNT value on done: 2313.0 [2023-02-24 17:29:01,135][177155] Sum rewards: -9.576, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.815', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon4': '0.060', 'AMMO4': '0.069', 'HITCOUNT': '0.090', 'ARMOR': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.125', 'DAMAGECOUNT': '0.339', 'WEAPON3': '0.700', 'weapon3': '0.738', 'weapon2': '2.356'} [2023-02-24 17:29:01,144][177171] DAMAGECOUNT value on done: 1484.0 [2023-02-24 17:29:01,145][177171] Sum rewards: -1.934, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.172', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'weapon5': '0.058', 'AMMO4': '0.072', 'AMMO3': '0.072', 'weapon4': '0.084', 'HITCOUNT': '0.130', 'WEAPON4': '0.250', 'weapon3': '0.332', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.837', 'FRAGCOUNT': '2.000', 'weapon2': '3.120'} [2023-02-24 17:29:01,305][177156] DAMAGECOUNT value on done: 1895.0 [2023-02-24 17:29:01,306][177156] Sum rewards: 1.401, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.707', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'weapon5': '0.036', 'AMMO3': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.122', 'HITCOUNT': '0.190', 'WEAPON3': '0.300', 'ARMOR': '0.511', 'weapon3': '0.876', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.014', 'weapon2': '1.560'} [2023-02-24 17:29:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14131.2, 300 sec: 14245.7). Total num frames: 5103616. Throughput: 0: 3540.9. Samples: 1277764. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:29:01,376][177119] Avg episode reward: [(0, '-4.436')] [2023-02-24 17:29:01,430][177155] DAMAGECOUNT value on done: 1826.0 [2023-02-24 17:29:01,431][177155] Sum rewards: -5.552, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.019', 'weapon4': '0.006', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'AMMO4': '0.066', 'weapon5': '0.076', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.650', 'weapon3': '0.792', 'FRAGCOUNT': '1.000', 'weapon2': '2.402'} [2023-02-24 17:29:01,609][177156] DAMAGECOUNT value on done: 1733.0 [2023-02-24 17:29:01,898][177156] DAMAGECOUNT value on done: 1578.0 [2023-02-24 17:29:01,898][177156] Sum rewards: -4.589, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.920', 'AMMO5': '0.017', 'AMMO2': '0.018', 'ARMOR': '0.036', 'HITCOUNT': '0.060', 'weapon5': '0.060', 'weapon4': '0.078', 'AMMO4': '0.090', 'AMMO3': '0.141', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.537', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.134', 'weapon2': '1.910'} [2023-02-24 17:29:02,198][177156] DAMAGECOUNT value on done: 1772.0 [2023-02-24 17:29:02,198][177156] Sum rewards: -8.262, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.496', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'weapon4': '0.008', 'AMMO5': '0.012', 'ARMOR': '0.024', 'WEAPON4': '0.050', 'HITCOUNT': '0.070', 'weapon5': '0.078', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'DAMAGECOUNT': '0.705', 'weapon3': '0.784', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '2.132'} [2023-02-24 17:29:02,225][177153] Updated weights for policy 0, policy_version 1250 (0.0008) [2023-02-24 17:29:05,117][177153] Updated weights for policy 0, policy_version 1260 (0.0008) [2023-02-24 17:29:06,376][177119] Fps is (10 sec: 14335.8, 60 sec: 14199.5, 300 sec: 14259.6). Total num frames: 5177344. Throughput: 0: 3541.5. Samples: 1288442. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:29:06,376][177119] Avg episode reward: [(0, '-4.456')] [2023-02-24 17:29:07,976][177153] Updated weights for policy 0, policy_version 1270 (0.0008) [2023-02-24 17:29:10,855][177153] Updated weights for policy 0, policy_version 1280 (0.0009) [2023-02-24 17:29:11,376][177119] Fps is (10 sec: 14336.1, 60 sec: 14131.2, 300 sec: 14245.7). Total num frames: 5246976. Throughput: 0: 3543.0. Samples: 1309786. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:29:11,376][177119] Avg episode reward: [(0, '-4.456')] [2023-02-24 17:29:13,764][177153] Updated weights for policy 0, policy_version 1290 (0.0008) [2023-02-24 17:29:16,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14199.5, 300 sec: 14259.6). Total num frames: 5320704. Throughput: 0: 3541.5. Samples: 1331020. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:29:16,376][177119] Avg episode reward: [(0, '-4.456')] [2023-02-24 17:29:16,672][177153] Updated weights for policy 0, policy_version 1300 (0.0008) [2023-02-24 17:29:18,539][177170] DAMAGECOUNT value on done: 2263.0 [2023-02-24 17:29:18,825][177154] DAMAGECOUNT value on done: 2853.0 [2023-02-24 17:29:18,826][177154] Sum rewards: -6.400, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.152', 'AMMO2': '0.013', 'AMMO5': '0.018', 'HITCOUNT': '0.040', 'WEAPON4': '0.050', 'weapon5': '0.050', 'weapon7': '0.056', 'AMMO4': '0.067', 'ARMOR': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'DAMAGECOUNT': '0.120', 'weapon4': '0.140', 'AMMO3': '0.164', 'WEAPON5': '0.250', 'weapon3': '0.772', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '2.044'} [2023-02-24 17:29:18,840][177170] DAMAGECOUNT value on done: 1508.0 [2023-02-24 17:29:18,840][177170] Sum rewards: -4.054, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.882', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'ARMOR': '0.060', 'AMMO4': '0.084', 'weapon4': '0.086', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.700', 'weapon3': '0.954', 'FRAGCOUNT': '1.000', 'weapon2': '2.036'} [2023-02-24 17:29:18,849][177170] DAMAGECOUNT value on done: 3379.0 [2023-02-24 17:29:18,850][177170] Sum rewards: 1.365, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.110', 'AMMO5': '0.010', 'AMMO2': '0.011', 'weapon4': '0.038', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'weapon5': '0.058', 'AMMO3': '0.110', 'HITCOUNT': '0.160', 'WEAPON5': '0.200', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.600', 'weapon3': '0.986', 'FRAGCOUNT': '2.000', 'weapon2': '2.098'} [2023-02-24 17:29:18,879][177172] DAMAGECOUNT value on done: 1710.0 [2023-02-24 17:29:18,880][177172] Sum rewards: -2.626, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.324', 'AMMO2': '0.001', 'AMMO4': '0.005', 'weapon4': '0.006', 'AMMO5': '0.010', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'HITCOUNT': '0.210', 'DAMAGECOUNT': '0.690', 'WEAPON3': '0.700', 'weapon3': '0.878', 'FRAGCOUNT': '1.000', 'weapon2': '2.370'} [2023-02-24 17:29:18,886][177158] DAMAGECOUNT value on done: 3028.0 [2023-02-24 17:29:18,886][177158] Sum rewards: -5.084, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.228', 'AMMO2': '0.018', 'weapon4': '0.020', 'AMMO5': '0.023', 'ARMOR': '0.045', 'AMMO4': '0.088', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'weapon5': '0.158', 'HITCOUNT': '0.210', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon3': '0.720', 'DAMAGECOUNT': '1.056', 'weapon2': '2.418'} [2023-02-24 17:29:19,126][177154] DAMAGECOUNT value on done: 2089.0 [2023-02-24 17:29:19,127][177154] Sum rewards: -3.237, reward structure: {'DEATHCOUNT': '-3.750', 'FRAGCOUNT': '-3.000', 'HEALTH': '-0.375', 'weapon4': '0.006', 'HITCOUNT': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.028', 'DAMAGECOUNT': '0.030', 'ARMOR': '0.036', 'WEAPON1': '0.040', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'AMMO4': '0.139', 'WEAPON5': '0.200', 'weapon5': '0.240', 'WEAPON3': '0.300', 'weapon3': '0.818', 'weapon2': '1.858'} [2023-02-24 17:29:19,142][177170] DAMAGECOUNT value on done: 2618.0 [2023-02-24 17:29:19,173][177172] DAMAGECOUNT value on done: 2289.0 [2023-02-24 17:29:19,173][177172] Sum rewards: -6.177, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.852', 'AMMO2': '0.007', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.033', 'ARMOR': '0.040', 'weapon5': '0.092', 'AMMO3': '0.149', 'HITCOUNT': '0.160', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.154', 'weapon2': '1.872'} [2023-02-24 17:29:19,191][177158] DAMAGECOUNT value on done: 2048.0 [2023-02-24 17:29:19,192][177158] Sum rewards: -3.886, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.379', 'AMMO5': '0.005', 'weapon5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon4': '0.070', 'weapon7': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.124', 'HITCOUNT': '0.130', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.206', 'weapon2': '1.728'} [2023-02-24 17:29:19,252][177171] DAMAGECOUNT value on done: 1759.0 [2023-02-24 17:29:19,253][177171] Sum rewards: -1.070, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.012', 'HEALTH': '0.016', 'AMMO2': '0.025', 'weapon5': '0.072', 'weapon4': '0.086', 'AMMO3': '0.122', 'AMMO4': '0.124', 'HITCOUNT': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.473', 'WEAPON3': '0.650', 'weapon3': '0.738', 'DAMAGECOUNT': '0.762', 'FRAGCOUNT': '2.000', 'weapon2': '2.260'} [2023-02-24 17:29:19,386][177157] DAMAGECOUNT value on done: 2807.0 [2023-02-24 17:29:19,431][177154] DAMAGECOUNT value on done: 2520.0 [2023-02-24 17:29:19,432][177154] Sum rewards: -4.367, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.928', 'WEAPON1': '0.010', 'weapon4': '0.020', 'AMMO2': '0.021', 'ARMOR': '0.036', 'AMMO4': '0.104', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'weapon3': '0.682', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.810', 'FRAGCOUNT': '2.000', 'weapon2': '2.916'} [2023-02-24 17:29:19,485][177155] DAMAGECOUNT value on done: 2221.0 [2023-02-24 17:29:19,486][177155] Sum rewards: -9.153, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.650', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.024', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.100', 'AMMO3': '0.198', 'HITCOUNT': '0.200', 'DAMAGECOUNT': '0.540', 'weapon3': '0.890', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.100', 'weapon2': '2.268'} [2023-02-24 17:29:19,500][177158] DAMAGECOUNT value on done: 1814.0 [2023-02-24 17:29:19,500][177158] Sum rewards: -6.190, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.546', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'ARMOR': '0.016', 'weapon5': '0.020', 'AMMO4': '0.076', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.155', 'DAMAGECOUNT': '0.261', 'WEAPON3': '0.750', 'weapon3': '0.786', 'FRAGCOUNT': '1.000', 'weapon2': '2.322'} [2023-02-24 17:29:19,552][177171] DAMAGECOUNT value on done: 1624.0 [2023-02-24 17:29:19,553][177171] Sum rewards: -2.556, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.034', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.056', 'AMMO3': '0.090', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'ARMOR': '0.128', 'weapon4': '0.182', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.450', 'weapon3': '0.694', 'weapon2': '2.488'} [2023-02-24 17:29:19,587][177153] Updated weights for policy 0, policy_version 1310 (0.0008) [2023-02-24 17:29:19,682][177157] DAMAGECOUNT value on done: 1949.0 [2023-02-24 17:29:19,682][177157] Sum rewards: -3.277, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.370', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'weapon5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'ARMOR': '0.068', 'AMMO3': '0.125', 'AMMO4': '0.129', 'HITCOUNT': '0.140', 'weapon4': '0.194', 'WEAPON4': '0.350', 'DAMAGECOUNT': '0.555', 'WEAPON3': '0.650', 'weapon3': '0.742', 'weapon2': '2.280'} [2023-02-24 17:29:19,703][177157] DAMAGECOUNT value on done: 2567.0 [2023-02-24 17:29:19,729][177172] DAMAGECOUNT value on done: 1600.0 [2023-02-24 17:29:19,729][177172] Sum rewards: -4.174, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.795', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.003', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.014', 'ARMOR': '0.036', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.121', 'HITCOUNT': '0.140', 'DAMAGECOUNT': '0.462', 'WEAPON3': '0.650', 'weapon3': '1.098', 'weapon2': '1.892'} [2023-02-24 17:29:19,733][177154] DAMAGECOUNT value on done: 2575.0 [2023-02-24 17:29:19,733][177154] Sum rewards: -0.752, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.292', 'weapon4': '0.016', 'AMMO2': '0.018', 'ARMOR': '0.040', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.156', 'HITCOUNT': '0.200', 'DAMAGECOUNT': '0.720', 'WEAPON3': '0.850', 'weapon3': '1.160', 'weapon2': '2.188', 'FRAGCOUNT': '4.000'} [2023-02-24 17:29:19,781][177155] DAMAGECOUNT value on done: 2711.0 [2023-02-24 17:29:19,782][177155] Sum rewards: -2.407, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.916', 'AMMO2': '0.021', 'ARMOR': '0.080', 'AMMO4': '0.107', 'weapon4': '0.108', 'AMMO3': '0.109', 'HITCOUNT': '0.110', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.650', 'weapon3': '0.880', 'FRAGCOUNT': '1.000', 'weapon2': '2.374'} [2023-02-24 17:29:19,796][177158] DAMAGECOUNT value on done: 1677.0 [2023-02-24 17:29:19,796][177158] Sum rewards: -5.364, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.250', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.005', 'weapon4': '0.012', 'ARMOR': '0.020', 'AMMO5': '0.023', 'AMMO4': '0.023', 'weapon5': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.094', 'HITCOUNT': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.741', 'weapon3': '1.226', 'weapon2': '2.012'} [2023-02-24 17:29:19,837][177171] DAMAGECOUNT value on done: 1619.0 [2023-02-24 17:29:19,837][177171] Sum rewards: -2.356, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.666', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.060', 'HITCOUNT': '0.070', 'AMMO3': '0.086', 'ARMOR': '0.096', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'weapon4': '0.180', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.540', 'weapon3': '0.954', 'weapon2': '2.202'} [2023-02-24 17:29:20,004][177157] DAMAGECOUNT value on done: 2106.0 [2023-02-24 17:29:20,005][177157] Sum rewards: -3.828, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.030', 'weapon5': '0.006', 'AMMO5': '0.009', 'weapon4': '0.014', 'AMMO2': '0.020', 'ARMOR': '0.060', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'HITCOUNT': '0.130', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.700', 'weapon3': '0.942', 'FRAGCOUNT': '2.000', 'weapon2': '2.148'} [2023-02-24 17:29:20,026][177172] DAMAGECOUNT value on done: 1900.0 [2023-02-24 17:29:20,027][177172] Sum rewards: -4.742, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.232', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.045', 'ARMOR': '0.108', 'AMMO3': '0.122', 'HITCOUNT': '0.140', 'WEAPON4': '0.200', 'WEAPON3': '0.600', 'weapon3': '0.642', 'DAMAGECOUNT': '0.675', 'FRAGCOUNT': '1.000', 'weapon2': '2.932'} [2023-02-24 17:29:20,074][177155] DAMAGECOUNT value on done: 2341.0 [2023-02-24 17:29:20,123][177171] DAMAGECOUNT value on done: 1600.0 [2023-02-24 17:29:20,298][177156] DAMAGECOUNT value on done: 2040.0 [2023-02-24 17:29:20,298][177156] Sum rewards: 0.095, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.026', 'HEALTH': '0.036', 'AMMO3': '0.050', 'weapon5': '0.092', 'HITCOUNT': '0.130', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.250', 'weapon4': '0.268', 'DAMAGECOUNT': '0.435', 'weapon3': '0.632', 'FRAGCOUNT': '1.500', 'weapon2': '2.154'} [2023-02-24 17:29:20,374][177155] DAMAGECOUNT value on done: 2081.0 [2023-02-24 17:29:20,374][177155] Sum rewards: 4.165, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO3': '0.066', 'weapon4': '0.078', 'weapon7': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.146', 'HITCOUNT': '0.180', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'HEALTH': '0.690', 'DAMAGECOUNT': '0.765', 'weapon3': '0.890', 'weapon2': '2.306', 'FRAGCOUNT': '3.000'} [2023-02-24 17:29:20,602][177156] DAMAGECOUNT value on done: 1899.0 [2023-02-24 17:29:20,603][177156] Sum rewards: -2.163, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.553', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'weapon4': '0.062', 'AMMO4': '0.063', 'weapon5': '0.090', 'AMMO3': '0.119', 'HITCOUNT': '0.140', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.498', 'WEAPON3': '0.650', 'weapon3': '0.684', 'FRAGCOUNT': '2.000', 'weapon2': '2.212'} [2023-02-24 17:29:20,911][177156] DAMAGECOUNT value on done: 1693.0 [2023-02-24 17:29:20,911][177156] Sum rewards: -3.085, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.330', 'AMMO5': '0.012', 'AMMO2': '0.014', 'ARMOR': '0.024', 'weapon4': '0.034', 'WEAPON4': '0.050', 'AMMO4': '0.070', 'weapon5': '0.096', 'HITCOUNT': '0.100', 'AMMO3': '0.118', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.650', 'weapon3': '0.882', 'weapon2': '2.100'} [2023-02-24 17:29:21,204][177156] DAMAGECOUNT value on done: 1776.0 [2023-02-24 17:29:21,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14199.5, 300 sec: 14245.7). Total num frames: 5390336. Throughput: 0: 3537.6. Samples: 1341532. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 17:29:21,376][177119] Avg episode reward: [(0, '-4.209')] [2023-02-24 17:29:21,377][177140] Saving new best policy, reward=-4.209! [2023-02-24 17:29:21,516][177157] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 17:29:22,499][177153] Updated weights for policy 0, policy_version 1320 (0.0008) [2023-02-24 17:29:25,340][177153] Updated weights for policy 0, policy_version 1330 (0.0008) [2023-02-24 17:29:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14131.2, 300 sec: 14245.7). Total num frames: 5459968. Throughput: 0: 3536.3. Samples: 1362720. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:29:26,376][177119] Avg episode reward: [(0, '-4.209')] [2023-02-24 17:29:28,237][177153] Updated weights for policy 0, policy_version 1340 (0.0008) [2023-02-24 17:29:31,160][177153] Updated weights for policy 0, policy_version 1350 (0.0008) [2023-02-24 17:29:31,376][177119] Fps is (10 sec: 13926.5, 60 sec: 14131.2, 300 sec: 14231.9). Total num frames: 5529600. Throughput: 0: 3536.5. Samples: 1383954. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:29:31,376][177119] Avg episode reward: [(0, '-4.209')] [2023-02-24 17:29:34,014][177153] Updated weights for policy 0, policy_version 1360 (0.0008) [2023-02-24 17:29:36,376][177119] Fps is (10 sec: 14335.9, 60 sec: 14199.5, 300 sec: 14245.7). Total num frames: 5603328. Throughput: 0: 3536.8. Samples: 1394606. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:29:36,376][177119] Avg episode reward: [(0, '-4.209')] [2023-02-24 17:29:36,897][177153] Updated weights for policy 0, policy_version 1370 (0.0008) [2023-02-24 17:29:37,555][177170] DAMAGECOUNT value on done: 2313.0 [2023-02-24 17:29:37,555][177170] Sum rewards: -8.639, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.620', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.008', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.039', 'weapon5': '0.046', 'weapon4': '0.048', 'ARMOR': '0.054', 'HITCOUNT': '0.060', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon3': '0.948', 'WEAPON3': '1.000', 'weapon2': '2.172'} [2023-02-24 17:29:37,830][177154] DAMAGECOUNT value on done: 3090.0 [2023-02-24 17:29:37,830][177154] Sum rewards: 0.475, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.439', 'weapon4': '0.006', 'AMMO2': '0.010', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.081', 'HITCOUNT': '0.090', 'weapon5': '0.122', 'WEAPON5': '0.200', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.711', 'weapon3': '0.776', 'FRAGCOUNT': '2.000', 'weapon2': '2.296'} [2023-02-24 17:29:37,847][177170] DAMAGECOUNT value on done: 1655.0 [2023-02-24 17:29:37,847][177170] Sum rewards: -8.277, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.218', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'ARMOR': '0.040', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.179', 'DAMAGECOUNT': '0.441', 'WEAPON3': '0.850', 'weapon3': '0.882', 'FRAGCOUNT': '1.000', 'weapon2': '2.358'} [2023-02-24 17:29:37,857][177170] DAMAGECOUNT value on done: 3459.0 [2023-02-24 17:29:37,927][177158] DAMAGECOUNT value on done: 3153.0 [2023-02-24 17:29:37,927][177158] Sum rewards: -7.761, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-2.000', 'HEALTH': '-1.689', 'AMMO2': '0.002', 'AMMO4': '0.011', 'weapon4': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.139', 'weapon5': '0.144', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.750', 'weapon3': '1.196', 'weapon2': '1.822'} [2023-02-24 17:29:37,938][177172] DAMAGECOUNT value on done: 1880.0 [2023-02-24 17:29:37,939][177172] Sum rewards: 0.263, reward structure: {'DEATHCOUNT': '-3.750', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.010', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'HITCOUNT': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.072', 'weapon5': '0.136', 'WEAPON5': '0.200', 'HEALTH': '0.220', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.510', 'weapon3': '1.032', 'weapon2': '1.762'} [2023-02-24 17:29:38,128][177154] DAMAGECOUNT value on done: 2151.0 [2023-02-24 17:29:38,147][177170] DAMAGECOUNT value on done: 2843.0 [2023-02-24 17:29:38,147][177170] Sum rewards: -2.424, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.402', 'AMMO5': '0.005', 'AMMO2': '0.011', 'ARMOR': '0.016', 'AMMO4': '0.055', 'weapon4': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'weapon3': '0.628', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.675', 'FRAGCOUNT': '2.000', 'weapon2': '2.538'} [2023-02-24 17:29:38,211][177158] DAMAGECOUNT value on done: 2203.0 [2023-02-24 17:29:38,224][177172] DAMAGECOUNT value on done: 2421.0 [2023-02-24 17:29:38,224][177172] Sum rewards: -4.899, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.296', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.099', 'AMMO2': '-0.020', 'AMMO5': '0.003', 'weapon5': '0.026', 'WEAPON5': '0.050', 'ARMOR': '0.076', 'AMMO3': '0.117', 'HITCOUNT': '0.120', 'DAMAGECOUNT': '0.396', 'WEAPON3': '0.700', 'weapon3': '0.894', 'weapon2': '2.384'} [2023-02-24 17:29:38,257][177171] DAMAGECOUNT value on done: 1783.0 [2023-02-24 17:29:38,258][177171] Sum rewards: -8.255, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.928', 'FRAGCOUNT': '-1.500', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'HITCOUNT': '0.030', 'weapon5': '0.070', 'DAMAGECOUNT': '0.072', 'WEAPON4': '0.100', 'weapon4': '0.118', 'AMMO3': '0.146', 'WEAPON5': '0.250', 'weapon3': '0.674', 'WEAPON3': '0.700', 'weapon2': '1.986'} [2023-02-24 17:29:38,361][177157] DAMAGECOUNT value on done: 2887.0 [2023-02-24 17:29:38,362][177157] Sum rewards: -8.825, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.396', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.012', 'AMMO5': '0.014', 'weapon4': '0.026', 'weapon5': '0.034', 'ARMOR': '0.046', 'AMMO4': '0.060', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.240', 'weapon3': '0.964', 'WEAPON3': '1.000', 'weapon2': '2.096'} [2023-02-24 17:29:38,432][177154] DAMAGECOUNT value on done: 2570.0 [2023-02-24 17:29:38,432][177154] Sum rewards: -4.896, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.341', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.014', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'HITCOUNT': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.138', 'DAMAGECOUNT': '0.150', 'ARMOR': '0.478', 'WEAPON3': '0.700', 'weapon3': '0.822', 'FRAGCOUNT': '1.000', 'weapon2': '2.394'} [2023-02-24 17:29:38,462][177155] DAMAGECOUNT value on done: 2384.0 [2023-02-24 17:29:38,462][177155] Sum rewards: -5.317, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.505', 'AMMO2': '0.005', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO4': '0.023', 'weapon4': '0.042', 'weapon5': '0.068', 'WEAPON4': '0.150', 'HITCOUNT': '0.150', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.489', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.196', 'weapon2': '1.828'} [2023-02-24 17:29:38,508][177158] DAMAGECOUNT value on done: 1999.0 [2023-02-24 17:29:38,559][177171] DAMAGECOUNT value on done: 1817.0 [2023-02-24 17:29:38,560][177171] Sum rewards: -4.468, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.056', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'ARMOR': '0.052', 'AMMO3': '0.109', 'HITCOUNT': '0.150', 'weapon3': '0.514', 'DAMAGECOUNT': '0.579', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '2.606'} [2023-02-24 17:29:38,663][177157] DAMAGECOUNT value on done: 2384.0 [2023-02-24 17:29:38,664][177157] Sum rewards: -0.858, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.458', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'weapon5': '0.016', 'AMMO4': '0.047', 'weapon4': '0.050', 'ARMOR': '0.052', 'WEAPON4': '0.150', 'AMMO3': '0.158', 'WEAPON5': '0.200', 'HITCOUNT': '0.300', 'WEAPON3': '0.850', 'weapon3': '0.950', 'DAMAGECOUNT': '1.305', 'weapon2': '2.240', 'FRAGCOUNT': '4.000'} [2023-02-24 17:29:38,692][177157] DAMAGECOUNT value on done: 2792.0 [2023-02-24 17:29:38,692][177157] Sum rewards: -9.041, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.644', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.015', 'ARMOR': '0.016', 'weapon5': '0.046', 'HITCOUNT': '0.150', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.675', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.100', 'weapon3': '1.292', 'weapon2': '1.710'} [2023-02-24 17:29:38,736][177154] DAMAGECOUNT value on done: 2785.0 [2023-02-24 17:29:38,737][177154] Sum rewards: -1.811, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.248', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.024', 'ARMOR': '0.040', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.135', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.630', 'WEAPON3': '0.800', 'weapon3': '0.946', 'weapon2': '1.892', 'FRAGCOUNT': '3.000'} [2023-02-24 17:29:38,771][177155] DAMAGECOUNT value on done: 3126.0 [2023-02-24 17:29:38,771][177155] Sum rewards: -3.538, reward structure: {'DEATHCOUNT': '-10.500', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.018', 'weapon5': '0.046', 'WEAPON4': '0.050', 'weapon4': '0.074', 'AMMO4': '0.088', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'HITCOUNT': '0.310', 'FRAGCOUNT': '0.500', 'HEALTH': '0.583', 'WEAPON3': '0.800', 'weapon3': '1.006', 'DAMAGECOUNT': '1.245', 'weapon2': '1.860'} [2023-02-24 17:29:38,781][177172] DAMAGECOUNT value on done: 1630.0 [2023-02-24 17:29:38,804][177158] DAMAGECOUNT value on done: 1677.0 [2023-02-24 17:29:38,858][177171] DAMAGECOUNT value on done: 1806.0 [2023-02-24 17:29:38,859][177171] Sum rewards: -5.130, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.390', 'AMMO2': '0.004', 'AMMO5': '0.013', 'AMMO4': '0.020', 'ARMOR': '0.044', 'WEAPON1': '0.050', 'weapon5': '0.052', 'weapon4': '0.078', 'AMMO3': '0.123', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.561', 'WEAPON3': '0.650', 'weapon3': '0.990', 'FRAGCOUNT': '1.000', 'weapon2': '1.886'} [2023-02-24 17:29:38,997][177157] DAMAGECOUNT value on done: 2241.0 [2023-02-24 17:29:38,998][177157] Sum rewards: -3.681, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.740', 'AMMO5': '0.012', 'AMMO2': '0.022', 'ARMOR': '0.032', 'weapon4': '0.042', 'weapon5': '0.060', 'AMMO4': '0.109', 'AMMO3': '0.142', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.750', 'weapon3': '0.952', 'FRAGCOUNT': '1.000', 'weapon2': '1.984'} [2023-02-24 17:29:39,074][177155] DAMAGECOUNT value on done: 2376.0 [2023-02-24 17:29:39,080][177172] DAMAGECOUNT value on done: 1970.0 [2023-02-24 17:29:39,155][177171] DAMAGECOUNT value on done: 1825.0 [2023-02-24 17:29:39,155][177171] Sum rewards: -6.293, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.078', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'weapon4': '0.038', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.181', 'HITCOUNT': '0.220', 'ARMOR': '0.518', 'DAMAGECOUNT': '0.675', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon3': '1.002', 'weapon2': '2.018'} [2023-02-24 17:29:39,376][177155] DAMAGECOUNT value on done: 2196.0 [2023-02-24 17:29:39,377][177155] Sum rewards: -3.405, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.484', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.045', 'ARMOR': '0.056', 'HITCOUNT': '0.070', 'weapon4': '0.100', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.600', 'weapon3': '0.820', 'FRAGCOUNT': '1.000', 'weapon2': '2.248'} [2023-02-24 17:29:39,484][177156] DAMAGECOUNT value on done: 2130.0 [2023-02-24 17:29:39,485][177156] Sum rewards: -10.699, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.083', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.007', 'AMMO2': '0.008', 'weapon5': '0.012', 'AMMO4': '0.040', 'weapon4': '0.078', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'ARMOR': '0.130', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.270', 'weapon3': '0.628', 'WEAPON3': '0.700', 'weapon2': '2.530'} [2023-02-24 17:29:39,777][177156] DAMAGECOUNT value on done: 2011.0 [2023-02-24 17:29:39,778][177156] Sum rewards: -3.778, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.693', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.012', 'weapon5': '0.018', 'WEAPON1': '0.020', 'weapon4': '0.034', 'WEAPON4': '0.050', 'ARMOR': '0.084', 'WEAPON5': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.150', 'DAMAGECOUNT': '0.336', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.016', 'weapon2': '2.168'} [2023-02-24 17:29:39,850][177153] Updated weights for policy 0, policy_version 1380 (0.0008) [2023-02-24 17:29:40,081][177156] DAMAGECOUNT value on done: 2033.0 [2023-02-24 17:29:40,081][177156] Sum rewards: 1.109, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.335', 'AMMO5': '0.012', 'AMMO2': '0.016', 'ARMOR': '0.020', 'weapon4': '0.020', 'WEAPON1': '0.040', 'AMMO4': '0.080', 'AMMO3': '0.095', 'weapon5': '0.098', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.250', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.020', 'weapon3': '1.156', 'weapon2': '1.736', 'FRAGCOUNT': '3.000'} [2023-02-24 17:29:40,386][177156] DAMAGECOUNT value on done: 1941.0 [2023-02-24 17:29:40,387][177156] Sum rewards: -4.876, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.212', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.028', 'AMMO3': '0.135', 'HITCOUNT': '0.170', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.650', 'weapon3': '0.998', 'FRAGCOUNT': '2.000', 'weapon2': '2.344'} [2023-02-24 17:29:41,376][177119] Fps is (10 sec: 14335.9, 60 sec: 14199.4, 300 sec: 14231.9). Total num frames: 5672960. Throughput: 0: 3532.9. Samples: 1415706. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:29:41,376][177119] Avg episode reward: [(0, '-4.489')] [2023-02-24 17:29:42,693][177153] Updated weights for policy 0, policy_version 1390 (0.0008) [2023-02-24 17:29:45,595][177153] Updated weights for policy 0, policy_version 1400 (0.0009) [2023-02-24 17:29:46,376][177119] Fps is (10 sec: 13926.5, 60 sec: 14131.2, 300 sec: 14218.0). Total num frames: 5742592. Throughput: 0: 3540.6. Samples: 1437092. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:29:46,376][177119] Avg episode reward: [(0, '-4.489')] [2023-02-24 17:29:48,479][177153] Updated weights for policy 0, policy_version 1410 (0.0008) [2023-02-24 17:29:51,348][177153] Updated weights for policy 0, policy_version 1420 (0.0008) [2023-02-24 17:29:51,376][177119] Fps is (10 sec: 14336.1, 60 sec: 14199.5, 300 sec: 14231.9). Total num frames: 5816320. Throughput: 0: 3539.1. Samples: 1447702. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:29:51,376][177119] Avg episode reward: [(0, '-4.489')] [2023-02-24 17:29:54,251][177153] Updated weights for policy 0, policy_version 1430 (0.0008) [2023-02-24 17:29:56,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14199.4, 300 sec: 14231.9). Total num frames: 5885952. Throughput: 0: 3539.4. Samples: 1469058. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:29:56,376][177119] Avg episode reward: [(0, '-4.489')] [2023-02-24 17:29:56,403][177170] DAMAGECOUNT value on done: 2378.0 [2023-02-24 17:29:56,404][177170] Sum rewards: -4.517, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.176', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon4': '0.016', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.054', 'HITCOUNT': '0.060', 'ARMOR': '0.064', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'DAMAGECOUNT': '0.195', 'WEAPON3': '0.600', 'weapon3': '0.990', 'weapon2': '1.534'} [2023-02-24 17:29:56,694][177170] DAMAGECOUNT value on done: 3579.0 [2023-02-24 17:29:56,723][177170] DAMAGECOUNT value on done: 1800.0 [2023-02-24 17:29:56,723][177170] Sum rewards: -5.841, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.196', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'weapon5': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'HITCOUNT': '0.130', 'AMMO3': '0.164', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.010', 'weapon2': '2.064'} [2023-02-24 17:29:56,750][177154] DAMAGECOUNT value on done: 3165.0 [2023-02-24 17:29:56,781][177172] DAMAGECOUNT value on done: 2057.0 [2023-02-24 17:29:56,782][177172] Sum rewards: -2.869, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.720', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'ARMOR': '0.004', 'AMMO5': '0.004', 'WEAPON1': '0.020', 'weapon5': '0.066', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.138', 'AMMO3': '0.141', 'DAMAGECOUNT': '0.531', 'WEAPON3': '0.700', 'weapon3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.818'} [2023-02-24 17:29:56,861][177158] DAMAGECOUNT value on done: 3216.0 [2023-02-24 17:29:57,017][177170] DAMAGECOUNT value on done: 2873.0 [2023-02-24 17:29:57,040][177154] DAMAGECOUNT value on done: 2316.0 [2023-02-24 17:29:57,041][177154] Sum rewards: -1.749, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.553', 'weapon5': '0.002', 'AMMO5': '0.005', 'weapon4': '0.008', 'AMMO2': '0.009', 'ARMOR': '0.028', 'AMMO4': '0.045', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.248', 'weapon2': '2.026'} [2023-02-24 17:29:57,075][177172] DAMAGECOUNT value on done: 2576.0 [2023-02-24 17:29:57,157][177153] Updated weights for policy 0, policy_version 1440 (0.0008) [2023-02-24 17:29:57,157][177158] DAMAGECOUNT value on done: 2233.0 [2023-02-24 17:29:57,194][177171] DAMAGECOUNT value on done: 1847.0 [2023-02-24 17:29:57,194][177171] Sum rewards: -7.064, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.492', 'AMMO2': '0.001', 'AMMO4': '0.003', 'WEAPON1': '0.020', 'weapon4': '0.050', 'HITCOUNT': '0.070', 'ARMOR': '0.080', 'AMMO3': '0.174', 'DAMAGECOUNT': '0.192', 'WEAPON4': '0.200', 'weapon3': '0.450', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '2.788'} [2023-02-24 17:29:57,323][177157] DAMAGECOUNT value on done: 2932.0 [2023-02-24 17:29:57,324][177157] Sum rewards: -7.853, reward structure: {'DEATHCOUNT': '-10.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.328', 'AMMO5': '0.007', 'weapon4': '0.012', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'HITCOUNT': '0.050', 'weapon5': '0.058', 'AMMO4': '0.061', 'DAMAGECOUNT': '0.135', 'AMMO3': '0.136', 'WEAPON5': '0.150', 'WEAPON3': '0.650', 'weapon3': '0.956', 'weapon2': '2.198'} [2023-02-24 17:29:57,341][177154] DAMAGECOUNT value on done: 2610.0 [2023-02-24 17:29:57,453][177155] DAMAGECOUNT value on done: 2606.0 [2023-02-24 17:29:57,453][177155] Sum rewards: -5.362, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.718', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.005', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.024', 'ARMOR': '0.036', 'HITCOUNT': '0.060', 'AMMO3': '0.143', 'weapon5': '0.166', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.666', 'WEAPON3': '0.700', 'weapon3': '0.706', 'weapon2': '2.320'} [2023-02-24 17:29:57,457][177158] DAMAGECOUNT value on done: 2079.0 [2023-02-24 17:29:57,494][177171] DAMAGECOUNT value on done: 1922.0 [2023-02-24 17:29:57,495][177171] Sum rewards: -5.948, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.685', 'AMMO5': '0.012', 'weapon5': '0.014', 'AMMO2': '0.031', 'ARMOR': '0.068', 'HITCOUNT': '0.090', 'AMMO3': '0.147', 'AMMO4': '0.157', 'weapon4': '0.162', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.315', 'weapon3': '0.480', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '2.210'} [2023-02-24 17:29:57,624][177172] DAMAGECOUNT value on done: 1798.0 [2023-02-24 17:29:57,639][177157] DAMAGECOUNT value on done: 2524.0 [2023-02-24 17:29:57,639][177157] Sum rewards: -5.619, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.863', 'AMMO5': '0.003', 'AMMO2': '0.020', 'ARMOR': '0.040', 'weapon4': '0.044', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'HITCOUNT': '0.070', 'AMMO4': '0.097', 'AMMO3': '0.115', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.600', 'weapon3': '0.670', 'FRAGCOUNT': '1.000', 'weapon2': '2.522'} [2023-02-24 17:29:57,646][177154] DAMAGECOUNT value on done: 3035.0 [2023-02-24 17:29:57,647][177154] Sum rewards: -1.913, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.385', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.019', 'WEAPON1': '0.040', 'HITCOUNT': '0.060', 'AMMO3': '0.117', 'weapon5': '0.176', 'WEAPON5': '0.250', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.750', 'weapon3': '0.914', 'weapon2': '1.932', 'FRAGCOUNT': '2.000'} [2023-02-24 17:29:57,677][177157] DAMAGECOUNT value on done: 2967.0 [2023-02-24 17:29:57,677][177157] Sum rewards: -4.623, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.842', 'AMMO2': '0.019', 'ARMOR': '0.052', 'AMMO4': '0.092', 'AMMO3': '0.123', 'weapon4': '0.124', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.525', 'WEAPON3': '0.650', 'weapon3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '2.074'} [2023-02-24 17:29:57,755][177158] DAMAGECOUNT value on done: 1722.0 [2023-02-24 17:29:57,763][177155] DAMAGECOUNT value on done: 3131.0 [2023-02-24 17:29:57,788][177171] DAMAGECOUNT value on done: 1928.0 [2023-02-24 17:29:57,922][177172] DAMAGECOUNT value on done: 1990.0 [2023-02-24 17:29:57,979][177157] DAMAGECOUNT value on done: 2311.0 [2023-02-24 17:29:58,066][177155] DAMAGECOUNT value on done: 2376.0 [2023-02-24 17:29:58,095][177171] DAMAGECOUNT value on done: 1825.0 [2023-02-24 17:29:58,370][177155] DAMAGECOUNT value on done: 2276.0 [2023-02-24 17:29:58,371][177155] Sum rewards: -5.430, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.222', 'AMMO5': '0.014', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.060', 'ARMOR': '0.064', 'AMMO4': '0.074', 'HITCOUNT': '0.080', 'AMMO3': '0.113', 'WEAPON5': '0.200', 'weapon4': '0.206', 'DAMAGECOUNT': '0.240', 'WEAPON3': '0.600', 'weapon3': '0.934', 'weapon2': '1.872'} [2023-02-24 17:29:58,520][177156] DAMAGECOUNT value on done: 2417.0 [2023-02-24 17:29:58,520][177156] Sum rewards: -5.465, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.044', 'AMMO5': '0.003', 'AMMO2': '0.007', 'ARMOR': '0.008', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'weapon4': '0.058', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'HITCOUNT': '0.130', 'WEAPON3': '0.700', 'weapon3': '0.742', 'DAMAGECOUNT': '0.861', 'FRAGCOUNT': '1.000', 'weapon2': '2.160'} [2023-02-24 17:29:58,809][177156] DAMAGECOUNT value on done: 2056.0 [2023-02-24 17:29:58,810][177156] Sum rewards: -9.414, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.180', 'FRAGCOUNT': '-1.500', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.018', 'weapon5': '0.034', 'weapon4': '0.036', 'HITCOUNT': '0.040', 'ARMOR': '0.048', 'DAMAGECOUNT': '0.135', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.184', 'weapon3': '0.812', 'WEAPON3': '1.000', 'weapon2': '2.148'} [2023-02-24 17:29:59,100][177156] DAMAGECOUNT value on done: 2158.0 [2023-02-24 17:29:59,101][177156] Sum rewards: -7.841, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.646', 'AMMO2': '0.004', 'AMMO5': '0.014', 'AMMO4': '0.019', 'ARMOR': '0.032', 'weapon5': '0.056', 'AMMO3': '0.123', 'HITCOUNT': '0.130', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.375', 'weapon3': '0.590', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '2.512'} [2023-02-24 17:29:59,387][177156] DAMAGECOUNT value on done: 2106.0 [2023-02-24 17:29:59,387][177156] Sum rewards: -2.058, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.185', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.020', 'ARMOR': '0.029', 'AMMO4': '0.078', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.150', 'HITCOUNT': '0.170', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.382', 'weapon3': '1.386'} [2023-02-24 17:30:00,078][177153] Updated weights for policy 0, policy_version 1450 (0.0008) [2023-02-24 17:30:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14199.5, 300 sec: 14218.0). Total num frames: 5955584. Throughput: 0: 3537.9. Samples: 1490224. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:30:01,376][177119] Avg episode reward: [(0, '-4.712')] [2023-02-24 17:30:02,934][177153] Updated weights for policy 0, policy_version 1460 (0.0008) [2023-02-24 17:30:05,851][177153] Updated weights for policy 0, policy_version 1470 (0.0008) [2023-02-24 17:30:06,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14131.2, 300 sec: 14218.0). Total num frames: 6025216. Throughput: 0: 3534.8. Samples: 1500600. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:30:06,376][177119] Avg episode reward: [(0, '-4.712')] [2023-02-24 17:30:08,735][177153] Updated weights for policy 0, policy_version 1480 (0.0008) [2023-02-24 17:30:11,376][177119] Fps is (10 sec: 14336.1, 60 sec: 14199.5, 300 sec: 14218.0). Total num frames: 6098944. Throughput: 0: 3536.1. Samples: 1521842. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 17:30:11,376][177119] Avg episode reward: [(0, '-4.712')] [2023-02-24 17:30:11,620][177153] Updated weights for policy 0, policy_version 1490 (0.0008) [2023-02-24 17:30:14,520][177153] Updated weights for policy 0, policy_version 1500 (0.0008) [2023-02-24 17:30:15,385][177170] DAMAGECOUNT value on done: 2513.0 [2023-02-24 17:30:15,672][177172] DAMAGECOUNT value on done: 2207.0 [2023-02-24 17:30:15,673][177172] Sum rewards: -4.731, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.408', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.007', 'weapon5': '0.014', 'weapon4': '0.038', 'WEAPON4': '0.050', 'ARMOR': '0.052', 'HITCOUNT': '0.120', 'AMMO3': '0.136', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.450', 'weapon3': '0.732', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '2.200'} [2023-02-24 17:30:15,673][177170] DAMAGECOUNT value on done: 3618.0 [2023-02-24 17:30:15,703][177170] DAMAGECOUNT value on done: 1830.0 [2023-02-24 17:30:15,759][177154] DAMAGECOUNT value on done: 3188.0 [2023-02-24 17:30:15,760][177154] Sum rewards: -1.280, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.070', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'weapon5': '0.002', 'AMMO5': '0.005', 'HITCOUNT': '0.020', 'ARMOR': '0.024', 'AMMO3': '0.060', 'DAMAGECOUNT': '0.069', 'WEAPON5': '0.100', 'WEAPON3': '0.350', 'weapon3': '0.532', 'FRAGCOUNT': '1.000', 'weapon2': '1.404'} [2023-02-24 17:30:15,929][177158] DAMAGECOUNT value on done: 3471.0 [2023-02-24 17:30:15,929][177158] Sum rewards: -6.533, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.874', 'AMMO2': '0.005', 'AMMO5': '0.015', 'weapon4': '0.020', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.122', 'weapon5': '0.158', 'HITCOUNT': '0.210', 'WEAPON5': '0.250', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.765', 'FRAGCOUNT': '1.000', 'weapon3': '1.010', 'weapon2': '2.060'} [2023-02-24 17:30:15,963][177172] DAMAGECOUNT value on done: 2696.0 [2023-02-24 17:30:15,964][177172] Sum rewards: -5.454, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.870', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'weapon4': '0.032', 'ARMOR': '0.043', 'WEAPON4': '0.050', 'weapon5': '0.074', 'HITCOUNT': '0.100', 'AMMO3': '0.161', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.900', 'weapon3': '1.034', 'weapon2': '1.954', 'FRAGCOUNT': '2.000'} [2023-02-24 17:30:16,002][177170] DAMAGECOUNT value on done: 2873.0 [2023-02-24 17:30:16,041][177154] DAMAGECOUNT value on done: 2360.0 [2023-02-24 17:30:16,235][177158] DAMAGECOUNT value on done: 2443.0 [2023-02-24 17:30:16,236][177158] Sum rewards: -9.486, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.838', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.010', 'ARMOR': '0.036', 'weapon4': '0.046', 'weapon5': '0.094', 'WEAPON4': '0.100', 'HITCOUNT': '0.160', 'AMMO3': '0.199', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.630', 'weapon3': '0.870', 'WEAPON3': '1.050', 'weapon2': '2.148'} [2023-02-24 17:30:16,335][177171] DAMAGECOUNT value on done: 2132.0 [2023-02-24 17:30:16,335][177171] Sum rewards: -6.279, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.315', 'weapon4': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'ARMOR': '0.072', 'WEAPON5': '0.100', 'weapon5': '0.106', 'HITCOUNT': '0.120', 'AMMO3': '0.186', 'DAMAGECOUNT': '0.855', 'WEAPON3': '0.950', 'weapon3': '0.992', 'FRAGCOUNT': '1.000', 'weapon2': '2.022'} [2023-02-24 17:30:16,348][177154] DAMAGECOUNT value on done: 2848.0 [2023-02-24 17:30:16,349][177154] Sum rewards: -1.622, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.011', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon4': '0.024', 'ARMOR': '0.076', 'AMMO4': '0.083', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.124', 'HITCOUNT': '0.150', 'WEAPON3': '0.500', 'weapon3': '0.612', 'DAMAGECOUNT': '0.714', 'FRAGCOUNT': '2.000', 'weapon2': '2.270'} [2023-02-24 17:30:16,376][177119] Fps is (10 sec: 14336.3, 60 sec: 14131.2, 300 sec: 14218.0). Total num frames: 6168576. Throughput: 0: 3535.9. Samples: 1543068. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 17:30:16,376][177119] Avg episode reward: [(0, '-4.866')] [2023-02-24 17:30:16,468][177157] DAMAGECOUNT value on done: 3026.0 [2023-02-24 17:30:16,468][177157] Sum rewards: -7.755, reward structure: {'DEATHCOUNT': '-10.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.546', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.053', 'weapon5': '0.058', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'ARMOR': '0.112', 'weapon4': '0.118', 'AMMO3': '0.149', 'DAMAGECOUNT': '0.282', 'WEAPON3': '0.700', 'weapon3': '0.910', 'weapon2': '2.086'} [2023-02-24 17:30:16,490][177155] DAMAGECOUNT value on done: 2781.0 [2023-02-24 17:30:16,490][177155] Sum rewards: -7.146, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.377', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.032', 'ARMOR': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'weapon4': '0.060', 'HITCOUNT': '0.100', 'AMMO3': '0.132', 'DAMAGECOUNT': '0.525', 'WEAPON3': '0.600', 'weapon3': '0.714', 'weapon2': '2.600', 'FRAGCOUNT': '3.000'} [2023-02-24 17:30:16,515][177158] DAMAGECOUNT value on done: 2159.0 [2023-02-24 17:30:16,515][177158] Sum rewards: -0.949, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'weapon4': '0.030', 'AMMO2': '0.033', 'ARMOR': '0.040', 'HEALTH': '0.062', 'HITCOUNT': '0.080', 'weapon5': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'DAMAGECOUNT': '0.240', 'WEAPON3': '0.650', 'weapon3': '1.050', 'weapon2': '1.718', 'FRAGCOUNT': '2.000'} [2023-02-24 17:30:16,586][177172] DAMAGECOUNT value on done: 1881.0 [2023-02-24 17:30:16,635][177171] DAMAGECOUNT value on done: 1937.0 [2023-02-24 17:30:16,646][177154] DAMAGECOUNT value on done: 3084.0 [2023-02-24 17:30:16,647][177154] Sum rewards: -4.213, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.228', 'AMMO5': '0.004', 'AMMO2': '0.005', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.024', 'HITCOUNT': '0.050', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'DAMAGECOUNT': '0.147', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.154', 'weapon2': '1.946'} [2023-02-24 17:30:16,775][177157] DAMAGECOUNT value on done: 2669.0 [2023-02-24 17:30:16,790][177155] DAMAGECOUNT value on done: 3306.0 [2023-02-24 17:30:16,791][177155] Sum rewards: -7.218, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.916', 'weapon5': '0.006', 'AMMO5': '0.008', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'ARMOR': '0.044', 'weapon4': '0.046', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.525', 'WEAPON3': '0.600', 'weapon3': '0.776', 'weapon2': '2.350'} [2023-02-24 17:30:16,815][177158] DAMAGECOUNT value on done: 1857.0 [2023-02-24 17:30:16,816][177158] Sum rewards: -5.665, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.505', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'ARMOR': '0.028', 'HITCOUNT': '0.120', 'AMMO3': '0.151', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.210', 'weapon2': '1.830'} [2023-02-24 17:30:16,824][177157] DAMAGECOUNT value on done: 3007.0 [2023-02-24 17:30:16,879][177172] DAMAGECOUNT value on done: 2035.0 [2023-02-24 17:30:16,920][177171] DAMAGECOUNT value on done: 2183.0 [2023-02-24 17:30:16,920][177171] Sum rewards: -1.632, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.035', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'AMMO5': '0.008', 'weapon4': '0.046', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'ARMOR': '0.116', 'AMMO3': '0.124', 'HITCOUNT': '0.200', 'weapon3': '0.670', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.765', 'FRAGCOUNT': '2.000', 'weapon2': '2.298'} [2023-02-24 17:30:17,078][177155] DAMAGECOUNT value on done: 2536.0 [2023-02-24 17:30:17,078][177155] Sum rewards: -6.704, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.200', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'ARMOR': '0.056', 'HITCOUNT': '0.130', 'AMMO3': '0.169', 'DAMAGECOUNT': '0.480', 'weapon3': '0.804', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '2.702'} [2023-02-24 17:30:17,103][177157] DAMAGECOUNT value on done: 2402.0 [2023-02-24 17:30:17,104][177157] Sum rewards: -4.667, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.012', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'weapon5': '0.078', 'weapon4': '0.092', 'AMMO4': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.273', 'WEAPON3': '0.650', 'weapon3': '0.792', 'weapon2': '2.288'} [2023-02-24 17:30:17,224][177171] DAMAGECOUNT value on done: 2084.0 [2023-02-24 17:30:17,224][177171] Sum rewards: -4.507, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.530', 'AMMO2': '0.001', 'AMMO4': '0.005', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.050', 'AMMO3': '0.173', 'HITCOUNT': '0.240', 'DAMAGECOUNT': '0.777', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.018', 'weapon2': '1.888'} [2023-02-24 17:30:17,367][177155] DAMAGECOUNT value on done: 2311.0 [2023-02-24 17:30:17,459][177153] Updated weights for policy 0, policy_version 1510 (0.0009) [2023-02-24 17:30:17,667][177156] DAMAGECOUNT value on done: 2512.0 [2023-02-24 17:30:17,667][177156] Sum rewards: -9.727, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.346', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'ARMOR': '0.109', 'AMMO3': '0.203', 'DAMAGECOUNT': '0.285', 'weapon3': '0.896', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.050', 'weapon2': '2.442'} [2023-02-24 17:30:17,962][177156] DAMAGECOUNT value on done: 2366.0 [2023-02-24 17:30:17,962][177156] Sum rewards: -3.291, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.375', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'weapon4': '0.050', 'AMMO4': '0.052', 'ARMOR': '0.092', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'HITCOUNT': '0.220', 'weapon3': '0.772', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.930', 'FRAGCOUNT': '2.000', 'weapon2': '2.480'} [2023-02-24 17:30:18,245][177156] DAMAGECOUNT value on done: 2205.0 [2023-02-24 17:30:18,246][177156] Sum rewards: -7.752, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.316', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.015', 'AMMO2': '0.017', 'ARMOR': '0.032', 'HITCOUNT': '0.050', 'AMMO4': '0.083', 'weapon5': '0.088', 'weapon4': '0.110', 'AMMO3': '0.116', 'DAMAGECOUNT': '0.141', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON3': '0.600', 'weapon3': '0.648', 'weapon2': '2.264'} [2023-02-24 17:30:18,548][177156] DAMAGECOUNT value on done: 2241.0 [2023-02-24 17:30:18,549][177156] Sum rewards: -6.887, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.511', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'weapon5': '0.004', 'AMMO5': '0.015', 'HITCOUNT': '0.120', 'AMMO3': '0.174', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.405', 'WEAPON3': '1.000', 'weapon3': '1.182', 'weapon2': '1.956', 'FRAGCOUNT': '2.000'} [2023-02-24 17:30:20,305][177153] Updated weights for policy 0, policy_version 1520 (0.0009) [2023-02-24 17:30:21,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14131.2, 300 sec: 14204.1). Total num frames: 6238208. Throughput: 0: 3536.2. Samples: 1553734. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:30:21,376][177119] Avg episode reward: [(0, '-5.134')] [2023-02-24 17:30:23,172][177153] Updated weights for policy 0, policy_version 1530 (0.0008) [2023-02-24 17:30:26,093][177153] Updated weights for policy 0, policy_version 1540 (0.0009) [2023-02-24 17:30:26,376][177119] Fps is (10 sec: 14335.9, 60 sec: 14199.5, 300 sec: 14218.0). Total num frames: 6311936. Throughput: 0: 3539.0. Samples: 1574962. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 17:30:26,376][177119] Avg episode reward: [(0, '-5.134')] [2023-02-24 17:30:28,959][177153] Updated weights for policy 0, policy_version 1550 (0.0008) [2023-02-24 17:30:31,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14199.5, 300 sec: 14204.1). Total num frames: 6381568. Throughput: 0: 3536.3. Samples: 1596226. Policy #0 lag: (min: 0.0, avg: 0.4, max: 2.0) [2023-02-24 17:30:31,376][177119] Avg episode reward: [(0, '-5.134')] [2023-02-24 17:30:31,842][177153] Updated weights for policy 0, policy_version 1560 (0.0008) [2023-02-24 17:30:34,317][177170] DAMAGECOUNT value on done: 2714.0 [2023-02-24 17:30:34,599][177172] DAMAGECOUNT value on done: 2337.0 [2023-02-24 17:30:34,612][177170] DAMAGECOUNT value on done: 3663.0 [2023-02-24 17:30:34,613][177170] Sum rewards: -8.083, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.980', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.036', 'HITCOUNT': '0.060', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.135', 'weapon4': '0.162', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'weapon3': '0.712', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '2.490'} [2023-02-24 17:30:34,641][177170] DAMAGECOUNT value on done: 2032.0 [2023-02-24 17:30:34,642][177170] Sum rewards: -2.047, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.140', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'ARMOR': '0.076', 'WEAPON4': '0.100', 'weapon4': '0.134', 'AMMO3': '0.147', 'HITCOUNT': '0.200', 'DAMAGECOUNT': '0.606', 'WEAPON3': '0.700', 'weapon3': '0.738', 'FRAGCOUNT': '2.000', 'weapon2': '2.472'} [2023-02-24 17:30:34,721][177154] DAMAGECOUNT value on done: 3330.0 [2023-02-24 17:30:34,722][177154] Sum rewards: -3.120, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.520', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'weapon4': '0.028', 'WEAPON4': '0.050', 'AMMO4': '0.080', 'AMMO3': '0.098', 'weapon5': '0.116', 'HITCOUNT': '0.130', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.426', 'WEAPON3': '0.500', 'weapon3': '0.992', 'FRAGCOUNT': '1.000', 'weapon2': '2.042'} [2023-02-24 17:30:34,753][177153] Updated weights for policy 0, policy_version 1570 (0.0008) [2023-02-24 17:30:34,860][177158] DAMAGECOUNT value on done: 3656.0 [2023-02-24 17:30:34,861][177158] Sum rewards: 0.016, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.950', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.014', 'ARMOR': '0.064', 'AMMO4': '0.070', 'AMMO3': '0.071', 'weapon4': '0.078', 'WEAPON5': '0.100', 'HITCOUNT': '0.140', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.555', 'weapon3': '0.574', 'FRAGCOUNT': '1.000', 'weapon2': '2.830'} [2023-02-24 17:30:34,912][177172] DAMAGECOUNT value on done: 2808.0 [2023-02-24 17:30:34,913][177172] Sum rewards: -2.680, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.007', 'AMMO2': '0.012', 'HEALTH': '0.033', 'weapon5': '0.058', 'AMMO4': '0.061', 'AMMO3': '0.076', 'HITCOUNT': '0.110', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.336', 'WEAPON3': '0.400', 'weapon3': '0.760', 'FRAGCOUNT': '1.000', 'weapon2': '2.566'} [2023-02-24 17:30:34,945][177170] DAMAGECOUNT value on done: 2888.0 [2023-02-24 17:30:35,033][177154] DAMAGECOUNT value on done: 2415.0 [2023-02-24 17:30:35,165][177158] DAMAGECOUNT value on done: 2468.0 [2023-02-24 17:30:35,166][177158] Sum rewards: -5.981, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.933', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.007', 'AMMO5': '0.010', 'HITCOUNT': '0.020', 'AMMO4': '0.033', 'ARMOR': '0.044', 'weapon5': '0.058', 'DAMAGECOUNT': '0.075', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.232', 'weapon3': '0.544', 'WEAPON3': '0.750', 'weapon2': '2.100'} [2023-02-24 17:30:35,300][177154] DAMAGECOUNT value on done: 2973.0 [2023-02-24 17:30:35,300][177154] Sum rewards: -0.689, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.920', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'ARMOR': '0.028', 'weapon4': '0.044', 'HITCOUNT': '0.070', 'AMMO3': '0.083', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'weapon5': '0.150', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.500', 'weapon3': '0.918', 'FRAGCOUNT': '2.000', 'weapon2': '2.230'} [2023-02-24 17:30:35,369][177171] DAMAGECOUNT value on done: 2227.0 [2023-02-24 17:30:35,369][177171] Sum rewards: -2.925, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.926', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.016', 'WEAPON4': '0.050', 'weapon5': '0.068', 'weapon4': '0.072', 'HITCOUNT': '0.090', 'ARMOR': '0.096', 'AMMO3': '0.190', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.285', 'FRAGCOUNT': '0.500', 'weapon3': '0.728', 'WEAPON3': '0.750', 'weapon2': '2.420'} [2023-02-24 17:30:35,459][177158] DAMAGECOUNT value on done: 2349.0 [2023-02-24 17:30:35,459][177158] Sum rewards: -1.751, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.160', 'AMMO2': '0.013', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'weapon4': '0.028', 'AMMO4': '0.064', 'HITCOUNT': '0.100', 'AMMO3': '0.127', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.198', 'weapon2': '1.666'} [2023-02-24 17:30:35,487][177157] DAMAGECOUNT value on done: 3087.0 [2023-02-24 17:30:35,521][177172] DAMAGECOUNT value on done: 1961.0 [2023-02-24 17:30:35,522][177172] Sum rewards: -8.454, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.615', 'weapon5': '0.002', 'AMMO5': '0.007', 'weapon4': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'HITCOUNT': '0.080', 'ARMOR': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.221', 'DAMAGECOUNT': '0.240', 'WEAPON4': '0.400', 'weapon3': '0.852', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.150', 'weapon2': '2.482'} [2023-02-24 17:30:35,573][177155] DAMAGECOUNT value on done: 2911.0 [2023-02-24 17:30:35,574][177155] Sum rewards: -0.513, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'HITCOUNT': '0.090', 'AMMO3': '0.101', 'DAMAGECOUNT': '0.390', 'HEALTH': '0.497', 'WEAPON3': '0.500', 'ARMOR': '0.588', 'FRAGCOUNT': '1.000', 'weapon3': '1.018', 'weapon2': '1.908'} [2023-02-24 17:30:35,600][177154] DAMAGECOUNT value on done: 3249.0 [2023-02-24 17:30:35,600][177154] Sum rewards: -1.602, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.068', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'weapon4': '0.026', 'weapon5': '0.062', 'AMMO3': '0.085', 'ARMOR': '0.090', 'WEAPON4': '0.100', 'HITCOUNT': '0.150', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.495', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.500', 'weapon3': '0.736', 'weapon2': '2.484'} [2023-02-24 17:30:35,670][177171] DAMAGECOUNT value on done: 2086.0 [2023-02-24 17:30:35,671][177171] Sum rewards: -4.498, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.898', 'AMMO2': '0.031', 'ARMOR': '0.076', 'AMMO3': '0.084', 'HITCOUNT': '0.130', 'AMMO4': '0.154', 'weapon4': '0.158', 'WEAPON4': '0.350', 'weapon3': '0.380', 'DAMAGECOUNT': '0.447', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon2': '2.890'} [2023-02-24 17:30:35,761][177158] DAMAGECOUNT value on done: 1891.0 [2023-02-24 17:30:35,789][177157] DAMAGECOUNT value on done: 2784.0 [2023-02-24 17:30:35,789][177157] Sum rewards: -2.887, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.510', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'WEAPON1': '0.020', 'weapon4': '0.056', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.144', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.700', 'weapon3': '0.966', 'FRAGCOUNT': '1.000', 'weapon2': '1.952'} [2023-02-24 17:30:35,816][177172] DAMAGECOUNT value on done: 2234.0 [2023-02-24 17:30:35,816][177172] Sum rewards: -4.166, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.767', 'AMMO4': '-0.100', 'AMMO2': '-0.020', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'HITCOUNT': '0.070', 'weapon5': '0.072', 'WEAPON5': '0.100', 'ARMOR': '0.104', 'AMMO3': '0.174', 'DAMAGECOUNT': '0.597', 'weapon3': '0.672', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '2.410'} [2023-02-24 17:30:35,829][177157] DAMAGECOUNT value on done: 3187.0 [2023-02-24 17:30:35,830][177157] Sum rewards: -3.882, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.657', 'weapon4': '0.002', 'ARMOR': '0.004', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.079', 'AMMO3': '0.108', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.540', 'WEAPON3': '0.600', 'weapon3': '0.704', 'FRAGCOUNT': '1.000', 'weapon2': '2.422'} [2023-02-24 17:30:35,872][177155] DAMAGECOUNT value on done: 3436.0 [2023-02-24 17:30:35,872][177155] Sum rewards: -2.962, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.879', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'ARMOR': '0.048', 'weapon4': '0.064', 'AMMO4': '0.086', 'AMMO3': '0.113', 'HITCOUNT': '0.150', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.650', 'weapon3': '0.806', 'FRAGCOUNT': '1.000', 'weapon2': '2.572'} [2023-02-24 17:30:35,983][177171] DAMAGECOUNT value on done: 2585.0 [2023-02-24 17:30:35,983][177171] Sum rewards: -4.039, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.298', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'AMMO4': '0.073', 'weapon4': '0.084', 'weapon5': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'WEAPON5': '0.150', 'HITCOUNT': '0.190', 'WEAPON3': '0.500', 'weapon3': '0.680', 'DAMAGECOUNT': '1.206', 'FRAGCOUNT': '2.000', 'weapon2': '2.476'} [2023-02-24 17:30:36,123][177157] DAMAGECOUNT value on done: 2447.0 [2023-02-24 17:30:36,124][177157] Sum rewards: -3.999, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.554', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.004', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.021', 'weapon4': '0.038', 'ARMOR': '0.048', 'WEAPON4': '0.050', 'weapon5': '0.054', 'HITCOUNT': '0.070', 'AMMO3': '0.109', 'DAMAGECOUNT': '0.135', 'WEAPON5': '0.150', 'WEAPON3': '0.600', 'weapon3': '1.078', 'weapon2': '2.180'} [2023-02-24 17:30:36,164][177155] DAMAGECOUNT value on done: 2560.0 [2023-02-24 17:30:36,260][177171] DAMAGECOUNT value on done: 2119.0 [2023-02-24 17:30:36,261][177171] Sum rewards: -11.458, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.228', 'FRAGCOUNT': '-1.500', 'AMMO2': '0.003', 'AMMO5': '0.015', 'AMMO4': '0.016', 'HITCOUNT': '0.030', 'weapon5': '0.048', 'weapon4': '0.048', 'ARMOR': '0.060', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.105', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon3': '0.798', 'WEAPON3': '1.250', 'weapon2': '2.368'} [2023-02-24 17:30:36,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14131.2, 300 sec: 14204.1). Total num frames: 6451200. Throughput: 0: 3537.2. Samples: 1606874. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:30:36,376][177119] Avg episode reward: [(0, '-4.937')] [2023-02-24 17:30:36,459][177155] DAMAGECOUNT value on done: 2400.0 [2023-02-24 17:30:36,680][177156] DAMAGECOUNT value on done: 2597.0 [2023-02-24 17:30:36,681][177156] Sum rewards: -3.259, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.012', 'ARMOR': '0.028', 'weapon4': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'HITCOUNT': '0.080', 'HEALTH': '0.117', 'AMMO3': '0.138', 'DAMAGECOUNT': '0.255', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.158', 'weapon2': '2.100'} [2023-02-24 17:30:36,984][177156] DAMAGECOUNT value on done: 2521.0 [2023-02-24 17:30:36,984][177156] Sum rewards: 0.235, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.382', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.078', 'weapon5': '0.086', 'HITCOUNT': '0.090', 'AMMO4': '0.114', 'weapon4': '0.204', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.465', 'weapon3': '0.652', 'FRAGCOUNT': '2.000', 'weapon2': '2.156'} [2023-02-24 17:30:37,270][177156] DAMAGECOUNT value on done: 2230.0 [2023-02-24 17:30:37,271][177156] Sum rewards: -7.512, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.236', 'AMMO2': '0.003', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.012', 'AMMO4': '0.017', 'weapon4': '0.022', 'HITCOUNT': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'DAMAGECOUNT': '0.075', 'AMMO3': '0.144', 'WEAPON3': '0.600', 'weapon3': '0.962', 'weapon2': '2.234'} [2023-02-24 17:30:37,562][177156] DAMAGECOUNT value on done: 2520.0 [2023-02-24 17:30:37,562][177156] Sum rewards: 0.791, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.520', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'ARMOR': '0.064', 'weapon4': '0.080', 'AMMO3': '0.097', 'AMMO4': '0.106', 'weapon5': '0.122', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'WEAPON5': '0.200', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.837', 'weapon3': '1.090', 'weapon2': '1.534', 'FRAGCOUNT': '3.000'} [2023-02-24 17:30:37,679][177153] Updated weights for policy 0, policy_version 1580 (0.0008) [2023-02-24 17:30:40,564][177153] Updated weights for policy 0, policy_version 1590 (0.0008) [2023-02-24 17:30:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14131.2, 300 sec: 14190.2). Total num frames: 6520832. Throughput: 0: 3532.9. Samples: 1628040. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 17:30:41,376][177119] Avg episode reward: [(0, '-4.887')] [2023-02-24 17:30:43,459][177153] Updated weights for policy 0, policy_version 1600 (0.0008) [2023-02-24 17:30:46,356][177153] Updated weights for policy 0, policy_version 1610 (0.0008) [2023-02-24 17:30:46,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14199.5, 300 sec: 14204.1). Total num frames: 6594560. Throughput: 0: 3534.3. Samples: 1649266. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 17:30:46,376][177119] Avg episode reward: [(0, '-4.887')] [2023-02-24 17:30:49,256][177153] Updated weights for policy 0, policy_version 1620 (0.0008) [2023-02-24 17:30:51,376][177119] Fps is (10 sec: 14335.9, 60 sec: 14131.2, 300 sec: 14204.1). Total num frames: 6664192. Throughput: 0: 3540.2. Samples: 1659908. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:30:51,376][177119] Avg episode reward: [(0, '-4.887')] [2023-02-24 17:30:52,145][177153] Updated weights for policy 0, policy_version 1630 (0.0009) [2023-02-24 17:30:53,245][177170] DAMAGECOUNT value on done: 2827.0 [2023-02-24 17:30:53,245][177170] Sum rewards: -2.161, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.545', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'ARMOR': '0.062', 'weapon4': '0.064', 'HITCOUNT': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.120', 'DAMAGECOUNT': '0.339', 'WEAPON4': '0.350', 'WEAPON3': '0.600', 'weapon3': '0.768', 'FRAGCOUNT': '2.000', 'weapon2': '2.346'} [2023-02-24 17:30:53,535][177172] DAMAGECOUNT value on done: 2515.0 [2023-02-24 17:30:53,536][177172] Sum rewards: -2.416, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.442', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.028', 'weapon5': '0.034', 'WEAPON5': '0.050', 'ARMOR': '0.051', 'AMMO3': '0.128', 'HITCOUNT': '0.130', 'AMMO4': '0.140', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.534', 'WEAPON3': '0.600', 'weapon3': '0.924', 'FRAGCOUNT': '1.000', 'weapon2': '2.384'} [2023-02-24 17:30:53,556][177170] DAMAGECOUNT value on done: 3768.0 [2023-02-24 17:30:53,600][177170] DAMAGECOUNT value on done: 2217.0 [2023-02-24 17:30:53,762][177158] DAMAGECOUNT value on done: 3711.0 [2023-02-24 17:30:53,762][177158] Sum rewards: -6.793, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.280', 'AMMO2': '0.001', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO4': '0.005', 'WEAPON1': '0.020', 'weapon4': '0.042', 'WEAPON4': '0.050', 'HITCOUNT': '0.050', 'WEAPON5': '0.050', 'DAMAGECOUNT': '0.165', 'AMMO3': '0.228', 'weapon3': '0.590', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '2.830'} [2023-02-24 17:30:53,768][177154] DAMAGECOUNT value on done: 3564.0 [2023-02-24 17:30:53,768][177154] Sum rewards: -1.269, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.051', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'ARMOR': '0.048', 'AMMO4': '0.070', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'weapon4': '0.110', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.702', 'weapon3': '0.882', 'FRAGCOUNT': '2.000', 'weapon2': '2.260'} [2023-02-24 17:30:53,838][177172] DAMAGECOUNT value on done: 2873.0 [2023-02-24 17:30:53,899][177170] DAMAGECOUNT value on done: 2948.0 [2023-02-24 17:30:54,055][177158] DAMAGECOUNT value on done: 2720.0 [2023-02-24 17:30:54,055][177158] Sum rewards: 0.445, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.724', 'AMMO2': '0.003', 'AMMO4': '0.013', 'ARMOR': '0.080', 'AMMO3': '0.123', 'HITCOUNT': '0.190', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.756', 'weapon3': '1.202', 'FRAGCOUNT': '2.000', 'weapon2': '2.152'} [2023-02-24 17:30:54,073][177154] DAMAGECOUNT value on done: 2550.0 [2023-02-24 17:30:54,073][177154] Sum rewards: -2.284, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.698', 'AMMO5': '0.007', 'AMMO2': '0.029', 'ARMOR': '0.040', 'weapon4': '0.056', 'weapon5': '0.064', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'HITCOUNT': '0.140', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.450', 'weapon3': '0.624', 'FRAGCOUNT': '1.000', 'weapon2': '2.562'} [2023-02-24 17:30:54,309][177154] DAMAGECOUNT value on done: 3258.0 [2023-02-24 17:30:54,309][177154] Sum rewards: -2.568, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.346', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.026', 'AMMO4': '0.034', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'ARMOR': '0.064', 'AMMO3': '0.193', 'HITCOUNT': '0.230', 'DAMAGECOUNT': '0.855', 'WEAPON3': '0.950', 'weapon3': '1.092', 'FRAGCOUNT': '2.000', 'weapon2': '2.224'} [2023-02-24 17:30:54,333][177171] DAMAGECOUNT value on done: 2471.0 [2023-02-24 17:30:54,333][177171] Sum rewards: -3.171, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.596', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.023', 'weapon4': '0.050', 'ARMOR': '0.052', 'weapon5': '0.056', 'HITCOUNT': '0.080', 'AMMO3': '0.087', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'weapon3': '0.416', 'DAMAGECOUNT': '0.732', 'weapon2': '2.564'} [2023-02-24 17:30:54,347][177158] DAMAGECOUNT value on done: 2383.0 [2023-02-24 17:30:54,458][177172] DAMAGECOUNT value on done: 2061.0 [2023-02-24 17:30:54,459][177172] Sum rewards: -3.890, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.590', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.003', 'weapon5': '0.010', 'WEAPON1': '0.010', 'weapon4': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'ARMOR': '0.090', 'HITCOUNT': '0.090', 'AMMO3': '0.160', 'DAMAGECOUNT': '0.300', 'weapon3': '0.788', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '2.566'} [2023-02-24 17:30:54,504][177157] DAMAGECOUNT value on done: 3477.0 [2023-02-24 17:30:54,504][177157] Sum rewards: -2.838, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.609', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.017', 'ARMOR': '0.068', 'AMMO4': '0.083', 'weapon5': '0.104', 'HITCOUNT': '0.150', 'AMMO3': '0.180', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.158', 'weapon3': '1.408', 'weapon2': '1.728', 'FRAGCOUNT': '3.000'} [2023-02-24 17:30:54,603][177154] DAMAGECOUNT value on done: 3435.0 [2023-02-24 17:30:54,607][177155] DAMAGECOUNT value on done: 2986.0 [2023-02-24 17:30:54,637][177171] DAMAGECOUNT value on done: 2336.0 [2023-02-24 17:30:54,638][177171] Sum rewards: 0.199, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.710', 'AMMO2': '0.012', 'AMMO4': '0.058', 'ARMOR': '0.080', 'WEAPON4': '0.100', 'HITCOUNT': '0.140', 'AMMO3': '0.145', 'WEAPON3': '0.650', 'weapon3': '0.678', 'DAMAGECOUNT': '0.750', 'weapon2': '2.796', 'FRAGCOUNT': '3.000'} [2023-02-24 17:30:54,645][177158] DAMAGECOUNT value on done: 1956.0 [2023-02-24 17:30:54,742][177172] DAMAGECOUNT value on done: 2297.0 [2023-02-24 17:30:54,807][177157] DAMAGECOUNT value on done: 2907.0 [2023-02-24 17:30:54,807][177157] Sum rewards: -9.434, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.155', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.009', 'weapon4': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.036', 'ARMOR': '0.052', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.369', 'weapon3': '0.966', 'WEAPON3': '1.050', 'weapon2': '2.378'} [2023-02-24 17:30:54,846][177157] DAMAGECOUNT value on done: 3304.0 [2023-02-24 17:30:54,847][177157] Sum rewards: -6.580, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.955', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'weapon4': '0.026', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'HITCOUNT': '0.120', 'AMMO3': '0.142', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.351', 'weapon3': '0.668', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '2.704'} [2023-02-24 17:30:54,901][177155] DAMAGECOUNT value on done: 3575.0 [2023-02-24 17:30:54,902][177155] Sum rewards: -5.984, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.958', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'weapon4': '0.042', 'AMMO4': '0.064', 'ARMOR': '0.076', 'weapon5': '0.098', 'HITCOUNT': '0.100', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.417', 'weapon3': '0.666', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '2.622'} [2023-02-24 17:30:54,944][177171] DAMAGECOUNT value on done: 2764.0 [2023-02-24 17:30:54,945][177171] Sum rewards: -1.108, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.015', 'HEALTH': '0.048', 'AMMO4': '0.074', 'weapon4': '0.086', 'ARMOR': '0.088', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.136', 'DAMAGECOUNT': '0.537', 'WEAPON3': '0.650', 'weapon3': '1.076', 'FRAGCOUNT': '2.000', 'weapon2': '2.212'} [2023-02-24 17:30:55,070][177153] Updated weights for policy 0, policy_version 1640 (0.0009) [2023-02-24 17:30:55,136][177155] DAMAGECOUNT value on done: 2752.0 [2023-02-24 17:30:55,136][177155] Sum rewards: -3.833, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.046', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.009', 'AMMO2': '0.015', 'AMMO4': '0.073', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'weapon5': '0.102', 'weapon4': '0.102', 'HITCOUNT': '0.140', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.576', 'weapon3': '0.728', 'weapon2': '2.526'} [2023-02-24 17:30:55,149][177157] DAMAGECOUNT value on done: 2587.0 [2023-02-24 17:30:55,150][177157] Sum rewards: -2.961, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.724', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'ARMOR': '0.032', 'HITCOUNT': '0.110', 'AMMO3': '0.157', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.420', 'weapon3': '0.740', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '2.544'} [2023-02-24 17:30:55,238][177171] DAMAGECOUNT value on done: 2229.0 [2023-02-24 17:30:55,440][177155] DAMAGECOUNT value on done: 2470.0 [2023-02-24 17:30:55,441][177155] Sum rewards: -9.492, reward structure: {'DEATHCOUNT': '-12.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.906', 'AMMO5': '0.003', 'AMMO2': '0.007', 'ARMOR': '0.008', 'weapon4': '0.008', 'WEAPON1': '0.030', 'AMMO4': '0.034', 'WEAPON5': '0.050', 'HITCOUNT': '0.070', 'WEAPON4': '0.100', 'weapon5': '0.128', 'AMMO3': '0.195', 'DAMAGECOUNT': '0.210', 'weapon3': '0.524', 'WEAPON3': '1.000', 'weapon2': '2.548'} [2023-02-24 17:30:55,779][177156] DAMAGECOUNT value on done: 2752.0 [2023-02-24 17:30:55,780][177156] Sum rewards: -7.145, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.016', 'AMMO5': '0.003', 'ARMOR': '0.005', 'WEAPON1': '0.010', 'weapon4': '0.010', 'weapon5': '0.016', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.094', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'DAMAGECOUNT': '0.465', 'WEAPON3': '0.750', 'weapon3': '1.050', 'FRAGCOUNT': '2.000', 'weapon2': '2.434'} [2023-02-24 17:30:56,076][177156] DAMAGECOUNT value on done: 3031.0 [2023-02-24 17:30:56,076][177156] Sum rewards: 2.992, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.005', 'weapon4': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.120', 'weapon5': '0.130', 'HITCOUNT': '0.400', 'WEAPON3': '0.600', 'HEALTH': '0.725', 'weapon3': '1.248', 'DAMAGECOUNT': '1.530', 'weapon2': '1.694', 'FRAGCOUNT': '4.500'} [2023-02-24 17:30:56,367][177156] DAMAGECOUNT value on done: 2283.0 [2023-02-24 17:30:56,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14131.2, 300 sec: 14190.2). Total num frames: 6733824. Throughput: 0: 3537.1. Samples: 1681014. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:30:56,376][177119] Avg episode reward: [(0, '-4.544')] [2023-02-24 17:30:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000001644_6733824.pth... [2023-02-24 17:30:56,435][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000000813_3330048.pth [2023-02-24 17:30:56,673][177156] DAMAGECOUNT value on done: 2573.0 [2023-02-24 17:30:57,988][177153] Updated weights for policy 0, policy_version 1650 (0.0008) [2023-02-24 17:31:00,871][177153] Updated weights for policy 0, policy_version 1660 (0.0008) [2023-02-24 17:31:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14131.2, 300 sec: 14190.2). Total num frames: 6803456. Throughput: 0: 3540.2. Samples: 1702376. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:31:01,376][177119] Avg episode reward: [(0, '-4.496')] [2023-02-24 17:31:03,769][177153] Updated weights for policy 0, policy_version 1670 (0.0009) [2023-02-24 17:31:06,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14199.5, 300 sec: 14204.1). Total num frames: 6877184. Throughput: 0: 3537.0. Samples: 1712900. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:31:06,376][177119] Avg episode reward: [(0, '-4.496')] [2023-02-24 17:31:06,645][177153] Updated weights for policy 0, policy_version 1680 (0.0008) [2023-02-24 17:31:09,530][177153] Updated weights for policy 0, policy_version 1690 (0.0008) [2023-02-24 17:31:11,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14131.2, 300 sec: 14190.2). Total num frames: 6946816. Throughput: 0: 3538.9. Samples: 1734212. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:31:11,376][177119] Avg episode reward: [(0, '-4.496')] [2023-02-24 17:31:12,271][177170] DAMAGECOUNT value on done: 2962.0 [2023-02-24 17:31:12,272][177170] Sum rewards: -1.251, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.364', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'weapon5': '0.088', 'AMMO3': '0.106', 'HITCOUNT': '0.110', 'ARMOR': '0.112', 'weapon4': '0.118', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.550', 'weapon3': '0.708', 'FRAGCOUNT': '2.000', 'weapon2': '2.200'} [2023-02-24 17:31:12,429][177153] Updated weights for policy 0, policy_version 1700 (0.0008) [2023-02-24 17:31:12,532][177172] DAMAGECOUNT value on done: 2731.0 [2023-02-24 17:31:12,533][177172] Sum rewards: -4.408, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.274', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.067', 'ARMOR': '0.076', 'weapon4': '0.084', 'weapon7': '0.098', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.138', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.648', 'WEAPON3': '0.750', 'weapon3': '0.924', 'weapon2': '1.912', 'FRAGCOUNT': '2.000'} [2023-02-24 17:31:12,567][177170] DAMAGECOUNT value on done: 4512.0 [2023-02-24 17:31:12,568][177170] Sum rewards: 0.788, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.147', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.004', 'WEAPON1': '0.020', 'weapon4': '0.024', 'weapon5': '0.036', 'ARMOR': '0.073', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'HITCOUNT': '0.310', 'WEAPON3': '0.650', 'weapon3': '1.058', 'weapon2': '2.214', 'DAMAGECOUNT': '2.232', 'FRAGCOUNT': '4.000'} [2023-02-24 17:31:12,595][177170] DAMAGECOUNT value on done: 2401.0 [2023-02-24 17:31:12,596][177170] Sum rewards: -3.341, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.306', 'AMMO2': '0.007', 'AMMO5': '0.019', 'weapon4': '0.024', 'ARMOR': '0.028', 'weapon5': '0.034', 'AMMO4': '0.036', 'AMMO3': '0.088', 'HITCOUNT': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.552', 'FRAGCOUNT': '1.000', 'weapon3': '1.416', 'weapon2': '1.960'} [2023-02-24 17:31:12,740][177154] DAMAGECOUNT value on done: 3592.0 [2023-02-24 17:31:12,740][177154] Sum rewards: -3.946, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.625', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'HITCOUNT': '0.040', 'weapon4': '0.046', 'ARMOR': '0.048', 'DAMAGECOUNT': '0.084', 'weapon5': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.147', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'WEAPON3': '0.700', 'weapon3': '0.902', 'FRAGCOUNT': '1.000', 'weapon2': '2.148'} [2023-02-24 17:31:12,798][177158] DAMAGECOUNT value on done: 3731.0 [2023-02-24 17:31:12,826][177172] DAMAGECOUNT value on done: 2906.0 [2023-02-24 17:31:12,897][177170] DAMAGECOUNT value on done: 3045.0 [2023-02-24 17:31:12,898][177170] Sum rewards: -4.427, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.664', 'AMMO2': '0.004', 'AMMO4': '0.019', 'WEAPON1': '0.020', 'weapon4': '0.020', 'ARMOR': '0.064', 'HITCOUNT': '0.090', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.291', 'weapon3': '0.792', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '2.594'} [2023-02-24 17:31:13,032][177154] DAMAGECOUNT value on done: 2569.0 [2023-02-24 17:31:13,088][177158] DAMAGECOUNT value on done: 2865.0 [2023-02-24 17:31:13,229][177154] DAMAGECOUNT value on done: 3473.0 [2023-02-24 17:31:13,230][177154] Sum rewards: -3.055, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.100', 'AMMO5': '0.003', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.088', 'weapon4': '0.136', 'HITCOUNT': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.645', 'weapon3': '0.794', 'FRAGCOUNT': '1.000', 'weapon2': '2.562'} [2023-02-24 17:31:13,302][177158] DAMAGECOUNT value on done: 2513.0 [2023-02-24 17:31:13,303][177158] Sum rewards: -2.785, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.320', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon4': '0.022', 'AMMO2': '0.023', 'weapon5': '0.058', 'weapon7': '0.066', 'ARMOR': '0.070', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.143', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.390', 'weapon3': '0.514', 'WEAPON3': '0.650', 'FRAGCOUNT': '2.000', 'weapon2': '2.580'} [2023-02-24 17:31:13,387][177171] DAMAGECOUNT value on done: 2521.0 [2023-02-24 17:31:13,388][177171] Sum rewards: -8.704, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.725', 'AMMO2': '0.004', 'AMMO5': '0.010', 'weapon5': '0.020', 'AMMO4': '0.022', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'HITCOUNT': '0.050', 'ARMOR': '0.080', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.150', 'AMMO3': '0.176', 'WEAPON3': '0.850', 'weapon3': '0.884', 'FRAGCOUNT': '1.000', 'weapon2': '2.344'} [2023-02-24 17:31:13,457][177172] DAMAGECOUNT value on done: 2086.0 [2023-02-24 17:31:13,472][177157] DAMAGECOUNT value on done: 3699.0 [2023-02-24 17:31:13,473][177157] Sum rewards: -6.537, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.059', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.010', 'AMMO5': '0.012', 'weapon4': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.049', 'weapon5': '0.060', 'ARMOR': '0.080', 'WEAPON4': '0.100', 'HITCOUNT': '0.160', 'AMMO3': '0.171', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.666', 'WEAPON3': '0.950', 'weapon3': '1.034', 'weapon2': '2.196'} [2023-02-24 17:31:13,530][177154] DAMAGECOUNT value on done: 3470.0 [2023-02-24 17:31:13,530][177154] Sum rewards: -7.781, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.088', 'AMMO5': '0.003', 'weapon4': '0.010', 'AMMO2': '0.011', 'HITCOUNT': '0.030', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'ARMOR': '0.104', 'DAMAGECOUNT': '0.105', 'AMMO3': '0.148', 'weapon3': '0.640', 'WEAPON3': '0.650', 'weapon2': '2.658'} [2023-02-24 17:31:13,594][177158] DAMAGECOUNT value on done: 2113.0 [2023-02-24 17:31:13,595][177158] Sum rewards: -6.026, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.818', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'ARMOR': '0.052', 'AMMO4': '0.057', 'weapon4': '0.116', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'weapon5': '0.150', 'AMMO3': '0.158', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.471', 'WEAPON3': '0.800', 'weapon3': '1.012', 'weapon2': '1.852'} [2023-02-24 17:31:13,641][177155] DAMAGECOUNT value on done: 3001.0 [2023-02-24 17:31:13,683][177171] DAMAGECOUNT value on done: 2379.0 [2023-02-24 17:31:13,754][177172] DAMAGECOUNT value on done: 2562.0 [2023-02-24 17:31:13,755][177172] Sum rewards: -3.314, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.810', 'AMMO5': '0.010', 'weapon4': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'ARMOR': '0.090', 'AMMO3': '0.117', 'AMMO4': '0.128', 'HITCOUNT': '0.130', 'weapon5': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.795', 'weapon3': '0.886', 'FRAGCOUNT': '1.000', 'weapon2': '2.300'} [2023-02-24 17:31:13,778][177157] DAMAGECOUNT value on done: 3087.0 [2023-02-24 17:31:13,778][177157] Sum rewards: -9.151, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.090', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'AMMO5': '0.010', 'weapon5': '0.010', 'weapon4': '0.054', 'ARMOR': '0.068', 'WEAPON4': '0.100', 'HITCOUNT': '0.160', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'DAMAGECOUNT': '0.540', 'weapon3': '0.732', 'WEAPON3': '1.150', 'weapon2': '2.502'} [2023-02-24 17:31:13,816][177157] DAMAGECOUNT value on done: 3384.0 [2023-02-24 17:31:13,817][177157] Sum rewards: -3.105, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.240', 'AMMO5': '0.006', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'weapon4': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.058', 'AMMO4': '0.064', 'HITCOUNT': '0.090', 'AMMO3': '0.113', 'ARMOR': '0.140', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.240', 'WEAPON3': '0.650', 'weapon3': '0.746', 'weapon2': '2.274'} [2023-02-24 17:31:13,945][177155] DAMAGECOUNT value on done: 3762.0 [2023-02-24 17:31:13,946][177155] Sum rewards: -2.224, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon5': '0.038', 'weapon4': '0.056', 'ARMOR': '0.064', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'HITCOUNT': '0.150', 'HEALTH': '0.188', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.561', 'weapon3': '1.006', 'weapon2': '2.140'} [2023-02-24 17:31:13,999][177171] DAMAGECOUNT value on done: 2872.0 [2023-02-24 17:31:14,000][177171] Sum rewards: -3.570, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.088', 'AMMO2': '0.001', 'AMMO4': '0.004', 'weapon4': '0.014', 'AMMO5': '0.017', 'weapon5': '0.040', 'HITCOUNT': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.324', 'weapon3': '0.560', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '2.402'} [2023-02-24 17:31:14,122][177157] DAMAGECOUNT value on done: 2661.0 [2023-02-24 17:31:14,144][177155] DAMAGECOUNT value on done: 3085.0 [2023-02-24 17:31:14,144][177155] Sum rewards: -8.886, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.228', 'AMMO5': '0.003', 'weapon4': '0.006', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'weapon5': '0.078', 'ARMOR': '0.084', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'HITCOUNT': '0.310', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.999', 'weapon3': '1.018', 'WEAPON3': '1.100', 'weapon2': '2.260'} [2023-02-24 17:31:14,292][177171] DAMAGECOUNT value on done: 2498.0 [2023-02-24 17:31:14,292][177171] Sum rewards: -2.270, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.990', 'AMMO5': '0.007', 'weapon5': '0.010', 'WEAPON1': '0.020', 'weapon4': '0.022', 'AMMO2': '0.023', 'ARMOR': '0.072', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'HITCOUNT': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.807', 'weapon3': '0.978', 'FRAGCOUNT': '2.000', 'weapon2': '2.112'} [2023-02-24 17:31:14,434][177155] DAMAGECOUNT value on done: 2555.0 [2023-02-24 17:31:14,861][177156] DAMAGECOUNT value on done: 2802.0 [2023-02-24 17:31:14,861][177156] Sum rewards: -1.950, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'ARMOR': '0.048', 'HITCOUNT': '0.050', 'weapon5': '0.064', 'HEALTH': '0.075', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.134', 'DAMAGECOUNT': '0.150', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.024', 'weapon2': '2.092'} [2023-02-24 17:31:15,145][177156] DAMAGECOUNT value on done: 3085.0 [2023-02-24 17:31:15,354][177153] Updated weights for policy 0, policy_version 1710 (0.0009) [2023-02-24 17:31:15,438][177156] DAMAGECOUNT value on done: 2418.0 [2023-02-24 17:31:15,438][177156] Sum rewards: -5.585, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.200', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'weapon5': '0.016', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'weapon4': '0.024', 'ARMOR': '0.032', 'WEAPON4': '0.100', 'HITCOUNT': '0.150', 'AMMO3': '0.205', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.405', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.050', 'weapon3': '1.484', 'weapon2': '1.564'} [2023-02-24 17:31:15,731][177156] DAMAGECOUNT value on done: 2921.0 [2023-02-24 17:31:15,732][177156] Sum rewards: 0.830, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.092', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'weapon4': '0.068', 'AMMO4': '0.068', 'weapon5': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'HITCOUNT': '0.140', 'WEAPON3': '0.500', 'weapon3': '0.866', 'DAMAGECOUNT': '1.044', 'weapon2': '1.824', 'FRAGCOUNT': '2.000'} [2023-02-24 17:31:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14131.2, 300 sec: 14190.2). Total num frames: 7016448. Throughput: 0: 3536.1. Samples: 1755350. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:31:16,376][177119] Avg episode reward: [(0, '-4.022')] [2023-02-24 17:31:16,380][177140] Saving new best policy, reward=-4.022! [2023-02-24 17:31:18,233][177153] Updated weights for policy 0, policy_version 1720 (0.0008) [2023-02-24 17:31:21,127][177153] Updated weights for policy 0, policy_version 1730 (0.0008) [2023-02-24 17:31:21,376][177119] Fps is (10 sec: 13926.0, 60 sec: 14131.1, 300 sec: 14176.3). Total num frames: 7086080. Throughput: 0: 3536.2. Samples: 1766002. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:31:21,377][177119] Avg episode reward: [(0, '-4.022')] [2023-02-24 17:31:24,116][177153] Updated weights for policy 0, policy_version 1740 (0.0009) [2023-02-24 17:31:26,376][177119] Fps is (10 sec: 13926.5, 60 sec: 14062.9, 300 sec: 14176.3). Total num frames: 7155712. Throughput: 0: 3526.7. Samples: 1786740. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:31:26,376][177119] Avg episode reward: [(0, '-4.022')] [2023-02-24 17:31:27,155][177153] Updated weights for policy 0, policy_version 1750 (0.0009) [2023-02-24 17:31:30,066][177153] Updated weights for policy 0, policy_version 1760 (0.0009) [2023-02-24 17:31:31,376][177119] Fps is (10 sec: 13926.8, 60 sec: 14062.9, 300 sec: 14162.4). Total num frames: 7225344. Throughput: 0: 3515.1. Samples: 1807444. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:31:31,376][177119] Avg episode reward: [(0, '-4.022')] [2023-02-24 17:31:31,467][177170] DAMAGECOUNT value on done: 3131.0 [2023-02-24 17:31:31,467][177170] Sum rewards: 1.544, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.589', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'weapon4': '0.056', 'AMMO4': '0.066', 'ARMOR': '0.072', 'AMMO3': '0.118', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.200', 'DAMAGECOUNT': '0.507', 'WEAPON3': '0.600', 'weapon3': '1.348', 'weapon2': '1.626', 'FRAGCOUNT': '3.000'} [2023-02-24 17:31:31,753][177170] DAMAGECOUNT value on done: 2551.0 [2023-02-24 17:31:31,772][177170] DAMAGECOUNT value on done: 4586.0 [2023-02-24 17:31:31,788][177172] DAMAGECOUNT value on done: 2948.0 [2023-02-24 17:31:31,788][177172] Sum rewards: 0.973, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.042', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.028', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'AMMO4': '0.078', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'weapon5': '0.104', 'HITCOUNT': '0.150', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.651', 'weapon3': '1.186', 'FRAGCOUNT': '2.000', 'weapon2': '2.046'} [2023-02-24 17:31:31,974][177154] DAMAGECOUNT value on done: 3834.0 [2023-02-24 17:31:31,975][177154] Sum rewards: -3.731, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.258', 'ARMOR': '0.016', 'AMMO5': '0.018', 'weapon4': '0.018', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'weapon5': '0.074', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'HITCOUNT': '0.260', 'DAMAGECOUNT': '0.726', 'WEAPON3': '1.050', 'weapon3': '1.460', 'weapon2': '1.532', 'FRAGCOUNT': '3.000'} [2023-02-24 17:31:32,060][177170] DAMAGECOUNT value on done: 3674.0 [2023-02-24 17:31:32,060][177170] Sum rewards: 5.843, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.570', 'AMMO5': '0.015', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'AMMO3': '0.089', 'AMMO4': '0.115', 'weapon5': '0.136', 'HITCOUNT': '0.190', 'weapon4': '0.206', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.500', 'ARMOR': '0.500', 'weapon3': '1.078', 'DAMAGECOUNT': '1.887', 'weapon2': '1.984', 'FRAGCOUNT': '6.000'} [2023-02-24 17:31:32,068][177158] DAMAGECOUNT value on done: 3891.0 [2023-02-24 17:31:32,068][177158] Sum rewards: -3.007, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.038', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'weapon5': '0.046', 'ARMOR': '0.052', 'weapon4': '0.060', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.150', 'AMMO3': '0.151', 'AMMO4': '0.164', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.600', 'weapon3': '0.752', 'FRAGCOUNT': '2.000', 'weapon2': '2.318'} [2023-02-24 17:31:32,082][177172] DAMAGECOUNT value on done: 2935.0 [2023-02-24 17:31:32,082][177172] Sum rewards: -4.045, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.364', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.011', 'WEAPON1': '0.040', 'HITCOUNT': '0.050', 'ARMOR': '0.052', 'weapon4': '0.058', 'weapon5': '0.064', 'DAMAGECOUNT': '0.087', 'AMMO3': '0.115', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'weapon3': '0.974', 'weapon2': '2.134'} [2023-02-24 17:31:32,267][177154] DAMAGECOUNT value on done: 2888.0 [2023-02-24 17:31:32,267][177154] Sum rewards: -3.655, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.995', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.034', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.081', 'AMMO3': '0.131', 'HITCOUNT': '0.140', 'WEAPON5': '0.200', 'weapon5': '0.214', 'ARMOR': '0.471', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.957', 'weapon3': '1.380', 'weapon2': '1.658'} [2023-02-24 17:31:32,365][177158] DAMAGECOUNT value on done: 3111.0 [2023-02-24 17:31:32,366][177158] Sum rewards: -5.029, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.650', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.062', 'AMMO2': '-0.012', 'AMMO5': '0.019', 'WEAPON1': '0.050', 'HITCOUNT': '0.120', 'AMMO3': '0.128', 'weapon5': '0.206', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.738', 'weapon3': '1.344', 'weapon2': '1.790'} [2023-02-24 17:31:32,478][177154] DAMAGECOUNT value on done: 3723.0 [2023-02-24 17:31:32,479][177154] Sum rewards: -0.336, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.428', 'AMMO2': '0.011', 'AMMO5': '0.011', 'weapon4': '0.024', 'WEAPON1': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'weapon5': '0.154', 'HITCOUNT': '0.160', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'ARMOR': '0.493', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.750', 'weapon3': '1.220', 'weapon2': '2.038'} [2023-02-24 17:31:32,558][177158] DAMAGECOUNT value on done: 2745.0 [2023-02-24 17:31:32,558][177158] Sum rewards: -0.379, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.435', 'AMMO5': '0.015', 'AMMO2': '0.030', 'WEAPON1': '0.030', 'ARMOR': '0.044', 'AMMO3': '0.090', 'weapon4': '0.100', 'weapon5': '0.148', 'AMMO4': '0.149', 'HITCOUNT': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.696', 'weapon3': '0.924', 'weapon2': '2.040', 'FRAGCOUNT': '3.000'} [2023-02-24 17:31:32,699][177172] DAMAGECOUNT value on done: 2326.0 [2023-02-24 17:31:32,700][177172] Sum rewards: -2.883, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.614', 'weapon4': '0.002', 'AMMO2': '0.009', 'AMMO5': '0.014', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'WEAPON1': '0.050', 'ARMOR': '0.056', 'weapon5': '0.142', 'AMMO3': '0.165', 'HITCOUNT': '0.170', 'WEAPON5': '0.300', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.720', 'weapon3': '1.170', 'weapon2': '1.890'} [2023-02-24 17:31:32,772][177154] DAMAGECOUNT value on done: 3678.0 [2023-02-24 17:31:32,773][177154] Sum rewards: -2.742, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-1.000', 'HEALTH': '-0.920', 'AMMO5': '0.022', 'AMMO2': '0.027', 'HITCOUNT': '0.060', 'WEAPON1': '0.060', 'AMMO3': '0.110', 'AMMO4': '0.136', 'weapon5': '0.172', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.624', 'WEAPON3': '0.700', 'weapon2': '1.102', 'weapon3': '1.764'} [2023-02-24 17:31:32,781][177171] DAMAGECOUNT value on done: 2652.0 [2023-02-24 17:31:32,781][177171] Sum rewards: -3.792, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.100', 'weapon4': '0.006', 'AMMO5': '0.014', 'AMMO2': '0.019', 'ARMOR': '0.040', 'WEAPON1': '0.070', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.167', 'weapon5': '0.190', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.393', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.380', 'weapon2': '1.466'} [2023-02-24 17:31:32,789][177157] DAMAGECOUNT value on done: 3803.0 [2023-02-24 17:31:32,790][177157] Sum rewards: -9.214, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.058', 'FRAGCOUNT': '-1.500', 'weapon5': '0.014', 'AMMO2': '0.017', 'AMMO5': '0.020', 'ARMOR': '0.040', 'weapon4': '0.060', 'AMMO4': '0.087', 'HITCOUNT': '0.120', 'AMMO3': '0.148', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.312', 'WEAPON3': '0.750', 'weapon3': '0.884', 'weapon2': '2.592'} [2023-02-24 17:31:32,857][177158] DAMAGECOUNT value on done: 2273.0 [2023-02-24 17:31:32,857][177158] Sum rewards: -3.660, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'weapon4': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'ARMOR': '0.080', 'AMMO4': '0.081', 'weapon5': '0.084', 'HITCOUNT': '0.130', 'AMMO3': '0.139', 'WEAPON5': '0.150', 'HEALTH': '0.242', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.480', 'weapon3': '1.386', 'weapon2': '2.028'} [2023-02-24 17:31:32,931][177155] DAMAGECOUNT value on done: 3121.0 [2023-02-24 17:31:32,931][177155] Sum rewards: -3.435, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.530', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon5': '0.030', 'ARMOR': '0.064', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'HITCOUNT': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.240', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.600', 'weapon3': '0.916', 'FRAGCOUNT': '1.000', 'weapon2': '2.220'} [2023-02-24 17:31:32,989][177172] DAMAGECOUNT value on done: 2787.0 [2023-02-24 17:31:32,989][177172] Sum rewards: -4.765, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.377', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO5': '0.015', 'ARMOR': '0.036', 'weapon4': '0.036', 'AMMO4': '0.066', 'weapon7': '0.068', 'weapon5': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.159', 'HITCOUNT': '0.190', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.675', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.524', 'weapon3': '1.584'} [2023-02-24 17:31:33,020][177153] Updated weights for policy 0, policy_version 1770 (0.0009) [2023-02-24 17:31:33,075][177171] DAMAGECOUNT value on done: 2639.0 [2023-02-24 17:31:33,076][177171] Sum rewards: -0.172, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.450', 'AMMO2': '0.011', 'AMMO5': '0.012', 'ARMOR': '0.028', 'weapon4': '0.044', 'AMMO4': '0.056', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'weapon5': '0.172', 'HITCOUNT': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.780', 'weapon3': '1.414', 'weapon2': '1.630', 'FRAGCOUNT': '3.000'} [2023-02-24 17:31:33,088][177157] DAMAGECOUNT value on done: 3314.0 [2023-02-24 17:31:33,088][177157] Sum rewards: -2.268, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.158', 'AMMO2': '0.001', 'AMMO4': '0.003', 'ARMOR': '0.008', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'weapon4': '0.040', 'weapon5': '0.056', 'AMMO3': '0.102', 'WEAPON4': '0.200', 'HITCOUNT': '0.230', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.681', 'weapon3': '1.096', 'weapon2': '1.976', 'FRAGCOUNT': '2.000'} [2023-02-24 17:31:33,127][177157] DAMAGECOUNT value on done: 3699.0 [2023-02-24 17:31:33,128][177157] Sum rewards: -5.768, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.199', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'AMMO2': '0.030', 'weapon4': '0.058', 'HITCOUNT': '0.120', 'weapon5': '0.132', 'AMMO3': '0.133', 'AMMO4': '0.150', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.945', 'weapon3': '1.392', 'FRAGCOUNT': '1.500', 'weapon2': '1.728'} [2023-02-24 17:31:33,232][177155] DAMAGECOUNT value on done: 3882.0 [2023-02-24 17:31:33,233][177155] Sum rewards: -1.099, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.336', 'AMMO2': '0.006', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.031', 'ARMOR': '0.032', 'HITCOUNT': '0.040', 'weapon4': '0.058', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.190', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.360', 'weapon3': '0.972', 'weapon2': '1.402', 'FRAGCOUNT': '2.000'} [2023-02-24 17:31:33,395][177171] DAMAGECOUNT value on done: 3256.0 [2023-02-24 17:31:33,395][177171] Sum rewards: -0.978, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.015', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'ARMOR': '0.044', 'WEAPON4': '0.050', 'AMMO4': '0.075', 'HEALTH': '0.099', 'AMMO3': '0.100', 'weapon5': '0.100', 'HITCOUNT': '0.230', 'WEAPON5': '0.350', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.152', 'weapon2': '1.548', 'weapon3': '1.602'} [2023-02-24 17:31:33,427][177157] DAMAGECOUNT value on done: 2779.0 [2023-02-24 17:31:33,428][177157] Sum rewards: -3.935, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.493', 'AMMO2': '0.011', 'AMMO5': '0.020', 'weapon4': '0.026', 'ARMOR': '0.032', 'AMMO4': '0.055', 'WEAPON1': '0.080', 'HITCOUNT': '0.080', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon5': '0.158', 'DAMAGECOUNT': '0.354', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon2': '1.116', 'weapon3': '1.680'} [2023-02-24 17:31:33,435][177155] DAMAGECOUNT value on done: 3294.0 [2023-02-24 17:31:33,435][177155] Sum rewards: -2.888, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.000', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'weapon4': '0.048', 'AMMO3': '0.060', 'AMMO4': '0.111', 'weapon5': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.210', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.627', 'HEALTH': '0.800', 'weapon3': '1.180', 'weapon2': '1.604'} [2023-02-24 17:31:33,698][177171] DAMAGECOUNT value on done: 2811.0 [2023-02-24 17:31:33,698][177171] Sum rewards: -6.116, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-2.000', 'HEALTH': '-0.579', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.035', 'WEAPON1': '0.070', 'weapon4': '0.094', 'weapon5': '0.116', 'AMMO3': '0.155', 'AMMO4': '0.175', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.939', 'weapon3': '1.086', 'weapon2': '2.176'} [2023-02-24 17:31:33,739][177155] DAMAGECOUNT value on done: 2908.0 [2023-02-24 17:31:33,740][177155] Sum rewards: -2.530, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.040', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon4': '0.018', 'WEAPON1': '0.030', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.167', 'HITCOUNT': '0.320', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.059', 'weapon3': '1.482', 'weapon2': '2.086', 'FRAGCOUNT': '3.000'} [2023-02-24 17:31:34,137][177156] DAMAGECOUNT value on done: 2943.0 [2023-02-24 17:31:34,137][177156] Sum rewards: -1.901, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.090', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'HITCOUNT': '0.060', 'AMMO4': '0.091', 'AMMO3': '0.118', 'weapon5': '0.120', 'WEAPON5': '0.150', 'weapon4': '0.192', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.423', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.044', 'weapon2': '1.742'} [2023-02-24 17:31:34,436][177156] DAMAGECOUNT value on done: 3222.0 [2023-02-24 17:31:34,748][177156] DAMAGECOUNT value on done: 2468.0 [2023-02-24 17:31:34,749][177156] Sum rewards: -4.602, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.620', 'FRAGCOUNT': '-1.500', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.025', 'ARMOR': '0.028', 'weapon4': '0.038', 'AMMO4': '0.039', 'weapon5': '0.044', 'HITCOUNT': '0.050', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.150', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'weapon3': '0.736', 'weapon2': '1.762'} [2023-02-24 17:31:35,044][177156] DAMAGECOUNT value on done: 3181.0 [2023-02-24 17:31:35,933][177153] Updated weights for policy 0, policy_version 1780 (0.0009) [2023-02-24 17:31:36,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14062.9, 300 sec: 14162.4). Total num frames: 7294976. Throughput: 0: 3510.8. Samples: 1817892. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:31:36,376][177119] Avg episode reward: [(0, '-3.389')] [2023-02-24 17:31:36,379][177140] Saving new best policy, reward=-3.389! [2023-02-24 17:31:38,887][177153] Updated weights for policy 0, policy_version 1790 (0.0008) [2023-02-24 17:31:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 14162.4). Total num frames: 7364608. Throughput: 0: 3504.0. Samples: 1838696. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:31:41,376][177119] Avg episode reward: [(0, '-3.389')] [2023-02-24 17:31:41,913][177153] Updated weights for policy 0, policy_version 1800 (0.0009) [2023-02-24 17:31:45,189][177153] Updated weights for policy 0, policy_version 1810 (0.0009) [2023-02-24 17:31:46,376][177119] Fps is (10 sec: 13516.9, 60 sec: 13926.4, 300 sec: 14134.7). Total num frames: 7430144. Throughput: 0: 3462.5. Samples: 1858186. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:31:46,376][177119] Avg episode reward: [(0, '-3.389')] [2023-02-24 17:31:48,198][177153] Updated weights for policy 0, policy_version 1820 (0.0008) [2023-02-24 17:31:51,258][177153] Updated weights for policy 0, policy_version 1830 (0.0009) [2023-02-24 17:31:51,376][177119] Fps is (10 sec: 13107.2, 60 sec: 13858.1, 300 sec: 14120.8). Total num frames: 7495680. Throughput: 0: 3449.7. Samples: 1868136. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:31:51,376][177119] Avg episode reward: [(0, '-3.389')] [2023-02-24 17:31:51,377][177170] DAMAGECOUNT value on done: 3141.0 [2023-02-24 17:31:51,637][177172] DAMAGECOUNT value on done: 3142.0 [2023-02-24 17:31:51,676][177170] DAMAGECOUNT value on done: 4621.0 [2023-02-24 17:31:51,711][177170] DAMAGECOUNT value on done: 2760.0 [2023-02-24 17:31:51,711][177170] Sum rewards: 0.895, reward structure: {'DEATHCOUNT': '-6.750', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO5': '0.028', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.095', 'HITCOUNT': '0.100', 'weapon4': '0.150', 'HEALTH': '0.165', 'weapon5': '0.166', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.627', 'weapon3': '1.148', 'weapon2': '1.734', 'FRAGCOUNT': '2.500'} [2023-02-24 17:31:51,859][177154] DAMAGECOUNT value on done: 4083.0 [2023-02-24 17:31:51,859][177154] Sum rewards: -5.171, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.330', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.015', 'weapon4': '0.036', 'AMMO2': '0.037', 'WEAPON1': '0.050', 'HITCOUNT': '0.070', 'ARMOR': '0.072', 'weapon5': '0.090', 'AMMO3': '0.102', 'AMMO4': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.747', 'weapon3': '1.146', 'weapon2': '2.108'} [2023-02-24 17:31:51,940][177172] DAMAGECOUNT value on done: 2970.0 [2023-02-24 17:31:51,940][177172] Sum rewards: -6.524, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-3.000', 'HEALTH': '-0.375', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'ARMOR': '0.040', 'weapon4': '0.042', 'WEAPON4': '0.050', 'HITCOUNT': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'DAMAGECOUNT': '0.105', 'AMMO3': '0.137', 'weapon5': '0.150', 'WEAPON3': '0.650', 'weapon2': '1.344', 'weapon3': '1.516'} [2023-02-24 17:31:51,976][177158] DAMAGECOUNT value on done: 4270.0 [2023-02-24 17:31:51,976][177158] Sum rewards: -2.946, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.850', 'AMMO2': '0.009', 'weapon4': '0.010', 'AMMO5': '0.026', 'AMMO4': '0.045', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.125', 'weapon5': '0.142', 'HITCOUNT': '0.200', 'WEAPON5': '0.400', 'ARMOR': '0.462', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.137', 'weapon2': '1.404', 'weapon3': '1.734'} [2023-02-24 17:31:52,009][177170] DAMAGECOUNT value on done: 3774.0 [2023-02-24 17:31:52,009][177170] Sum rewards: -1.098, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.391', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'weapon4': '0.012', 'WEAPON1': '0.030', 'HITCOUNT': '0.050', 'AMMO3': '0.073', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.400', 'FRAGCOUNT': '1.000', 'weapon3': '1.090', 'weapon2': '1.504'} [2023-02-24 17:31:52,152][177154] DAMAGECOUNT value on done: 2928.0 [2023-02-24 17:31:52,271][177158] DAMAGECOUNT value on done: 3178.0 [2023-02-24 17:31:52,343][177154] DAMAGECOUNT value on done: 4123.0 [2023-02-24 17:31:52,343][177154] Sum rewards: -5.954, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.100', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.013', 'weapon5': '0.014', 'WEAPON1': '0.040', 'ARMOR': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'HITCOUNT': '0.260', 'WEAPON3': '1.050', 'DAMAGECOUNT': '1.200', 'weapon3': '1.594', 'weapon2': '1.736', 'FRAGCOUNT': '2.000'} [2023-02-24 17:31:52,459][177158] DAMAGECOUNT value on done: 2963.0 [2023-02-24 17:31:52,460][177158] Sum rewards: -0.532, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.310', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO5': '0.019', 'WEAPON1': '0.030', 'AMMO3': '0.077', 'weapon5': '0.080', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.116', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.508', 'DAMAGECOUNT': '0.654', 'weapon3': '0.858', 'weapon2': '0.882', 'FRAGCOUNT': '1.500'} [2023-02-24 17:31:52,557][177172] DAMAGECOUNT value on done: 2500.0 [2023-02-24 17:31:52,558][177172] Sum rewards: -0.242, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.158', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.013', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO3': '0.079', 'HITCOUNT': '0.130', 'WEAPON3': '0.350', 'ARMOR': '0.487', 'DAMAGECOUNT': '0.522', 'FRAGCOUNT': '1.000', 'weapon3': '1.128', 'weapon2': '1.320'} [2023-02-24 17:31:52,641][177154] DAMAGECOUNT value on done: 3803.0 [2023-02-24 17:31:52,642][177154] Sum rewards: -1.817, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.015', 'AMMO5': '0.015', 'ARMOR': '0.016', 'WEAPON1': '0.030', 'AMMO4': '0.073', 'weapon5': '0.082', 'HEALTH': '0.097', 'HITCOUNT': '0.120', 'AMMO3': '0.136', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.274', 'weapon3': '1.500'} [2023-02-24 17:31:52,685][177171] DAMAGECOUNT value on done: 3142.0 [2023-02-24 17:31:52,686][177171] Sum rewards: 0.818, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.754', 'AMMO2': '0.006', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.031', 'AMMO3': '0.062', 'ARMOR': '0.064', 'weapon5': '0.086', 'WEAPON4': '0.100', 'weapon4': '0.162', 'HITCOUNT': '0.220', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'weapon3': '1.030', 'DAMAGECOUNT': '1.470', 'weapon2': '1.608', 'FRAGCOUNT': '2.000'} [2023-02-24 17:31:52,712][177157] DAMAGECOUNT value on done: 3885.0 [2023-02-24 17:31:52,759][177158] DAMAGECOUNT value on done: 2368.0 [2023-02-24 17:31:52,760][177158] Sum rewards: -5.066, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.240', 'AMMO5': '0.005', 'AMMO2': '0.032', 'WEAPON1': '0.060', 'HITCOUNT': '0.060', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO4': '0.160', 'weapon4': '0.198', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.285', 'WEAPON3': '0.450', 'weapon3': '1.258', 'weapon2': '1.670'} [2023-02-24 17:31:52,847][177172] DAMAGECOUNT value on done: 2937.0 [2023-02-24 17:31:52,848][177172] Sum rewards: -5.518, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.965', 'weapon5': '0.012', 'AMMO2': '0.017', 'AMMO5': '0.018', 'AMMO4': '0.085', 'ARMOR': '0.088', 'weapon4': '0.120', 'HITCOUNT': '0.150', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.450', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.050', 'weapon3': '1.324', 'weapon2': '1.902'} [2023-02-24 17:31:52,963][177155] DAMAGECOUNT value on done: 3192.0 [2023-02-24 17:31:52,983][177171] DAMAGECOUNT value on done: 2948.0 [2023-02-24 17:31:52,984][177171] Sum rewards: -2.602, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.440', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'AMMO4': '0.081', 'weapon4': '0.084', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'weapon5': '0.220', 'WEAPON5': '0.250', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.927', 'FRAGCOUNT': '1.000', 'weapon3': '1.092', 'weapon2': '1.924'} [2023-02-24 17:31:53,008][177157] DAMAGECOUNT value on done: 3453.0 [2023-02-24 17:31:53,008][177157] Sum rewards: 0.919, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.010', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'weapon4': '0.084', 'weapon5': '0.094', 'AMMO4': '0.106', 'AMMO3': '0.118', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.417', 'WEAPON3': '0.600', 'HEALTH': '0.710', 'weapon2': '1.298', 'weapon3': '1.690', 'FRAGCOUNT': '2.000'} [2023-02-24 17:31:53,063][177157] DAMAGECOUNT value on done: 3900.0 [2023-02-24 17:31:53,262][177155] DAMAGECOUNT value on done: 4145.0 [2023-02-24 17:31:53,263][177155] Sum rewards: -3.886, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.515', 'AMMO5': '0.017', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'ARMOR': '0.040', 'weapon5': '0.066', 'AMMO4': '0.110', 'AMMO3': '0.184', 'HITCOUNT': '0.200', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.789', 'WEAPON3': '1.050', 'weapon3': '1.424', 'weapon2': '1.838', 'FRAGCOUNT': '2.000'} [2023-02-24 17:31:53,283][177171] DAMAGECOUNT value on done: 3437.0 [2023-02-24 17:31:53,284][177171] Sum rewards: -3.951, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.677', 'AMMO2': '0.007', 'AMMO5': '0.014', 'AMMO4': '0.034', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'HITCOUNT': '0.090', 'weapon4': '0.126', 'AMMO3': '0.132', 'weapon5': '0.134', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.543', 'WEAPON3': '0.750', 'weapon2': '1.300', 'weapon3': '1.446'} [2023-02-24 17:31:53,360][177157] DAMAGECOUNT value on done: 2952.0 [2023-02-24 17:31:53,361][177157] Sum rewards: -1.001, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.385', 'AMMO5': '0.011', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'HITCOUNT': '0.060', 'AMMO3': '0.067', 'AMMO4': '0.078', 'ARMOR': '0.080', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.340', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.519', 'weapon3': '0.812', 'FRAGCOUNT': '1.000', 'weapon2': '1.630'} [2023-02-24 17:31:53,495][177155] DAMAGECOUNT value on done: 3539.0 [2023-02-24 17:31:53,495][177155] Sum rewards: -9.478, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.874', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'weapon5': '0.060', 'AMMO3': '0.187', 'HITCOUNT': '0.220', 'WEAPON5': '0.300', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.735', 'WEAPON3': '0.900', 'weapon2': '1.284', 'weapon3': '1.654'} [2023-02-24 17:31:53,588][177171] DAMAGECOUNT value on done: 3121.0 [2023-02-24 17:31:53,588][177171] Sum rewards: -1.711, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.549', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'weapon4': '0.024', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'weapon5': '0.110', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.930', 'weapon3': '1.578', 'weapon2': '1.614', 'FRAGCOUNT': '2.000'} [2023-02-24 17:31:53,792][177155] DAMAGECOUNT value on done: 2943.0 [2023-02-24 17:31:54,076][177156] DAMAGECOUNT value on done: 3198.0 [2023-02-24 17:31:54,076][177156] Sum rewards: -2.213, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.249', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'weapon5': '0.036', 'AMMO4': '0.080', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'HITCOUNT': '0.200', 'DAMAGECOUNT': '0.765', 'WEAPON3': '0.800', 'weapon3': '1.574', 'weapon2': '1.676', 'FRAGCOUNT': '3.000'} [2023-02-24 17:31:54,189][177153] Updated weights for policy 0, policy_version 1840 (0.0009) [2023-02-24 17:31:54,370][177156] DAMAGECOUNT value on done: 3397.0 [2023-02-24 17:31:54,370][177156] Sum rewards: -4.617, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.660', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.017', 'AMMO2': '0.026', 'ARMOR': '0.032', 'WEAPON1': '0.060', 'weapon4': '0.064', 'HITCOUNT': '0.100', 'AMMO4': '0.129', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'weapon5': '0.328', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.525', 'WEAPON3': '0.700', 'weapon3': '1.220', 'weapon2': '1.652'} [2023-02-24 17:31:54,664][177156] DAMAGECOUNT value on done: 2782.0 [2023-02-24 17:31:54,664][177156] Sum rewards: -5.495, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-2.500', 'HEALTH': '-0.276', 'AMMO2': '0.005', 'AMMO5': '0.017', 'AMMO4': '0.026', 'WEAPON1': '0.050', 'HITCOUNT': '0.080', 'AMMO3': '0.096', 'weapon5': '0.152', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.942', 'weapon2': '1.526', 'weapon3': '1.736'} [2023-02-24 17:31:54,965][177156] DAMAGECOUNT value on done: 3281.0 [2023-02-24 17:31:54,966][177156] Sum rewards: -7.539, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.316', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'ARMOR': '0.035', 'weapon5': '0.052', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.178', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.900', 'weapon3': '1.126', 'weapon2': '2.012'} [2023-02-24 17:31:56,376][177119] Fps is (10 sec: 13516.6, 60 sec: 13858.1, 300 sec: 14106.9). Total num frames: 7565312. Throughput: 0: 3438.7. Samples: 1888952. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:31:56,376][177119] Avg episode reward: [(0, '-3.174')] [2023-02-24 17:31:56,380][177140] Saving new best policy, reward=-3.174! [2023-02-24 17:31:57,078][177153] Updated weights for policy 0, policy_version 1850 (0.0009) [2023-02-24 17:32:00,035][177153] Updated weights for policy 0, policy_version 1860 (0.0008) [2023-02-24 17:32:01,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.2, 300 sec: 14106.9). Total num frames: 7634944. Throughput: 0: 3432.9. Samples: 1909832. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:32:01,376][177119] Avg episode reward: [(0, '-3.174')] [2023-02-24 17:32:02,983][177153] Updated weights for policy 0, policy_version 1870 (0.0009) [2023-02-24 17:32:05,972][177153] Updated weights for policy 0, policy_version 1880 (0.0008) [2023-02-24 17:32:06,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13789.9, 300 sec: 14106.9). Total num frames: 7704576. Throughput: 0: 3428.1. Samples: 1920264. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:32:06,376][177119] Avg episode reward: [(0, '-3.174')] [2023-02-24 17:32:09,103][177153] Updated weights for policy 0, policy_version 1890 (0.0008) [2023-02-24 17:32:10,911][177170] DAMAGECOUNT value on done: 3166.0 [2023-02-24 17:32:11,173][177172] DAMAGECOUNT value on done: 3307.0 [2023-02-24 17:32:11,174][177172] Sum rewards: -3.967, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.064', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.028', 'WEAPON1': '0.030', 'AMMO4': '0.065', 'AMMO3': '0.104', 'HITCOUNT': '0.110', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.538', 'weapon2': '1.906'} [2023-02-24 17:32:11,207][177170] DAMAGECOUNT value on done: 4801.0 [2023-02-24 17:32:11,207][177170] Sum rewards: -3.599, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-2.000', 'HEALTH': '-0.531', 'AMMO4': '-0.072', 'AMMO2': '-0.014', 'AMMO5': '0.014', 'WEAPON1': '0.030', 'HITCOUNT': '0.040', 'ARMOR': '0.048', 'AMMO3': '0.112', 'weapon5': '0.140', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.540', 'weapon3': '1.670', 'weapon2': '1.674'} [2023-02-24 17:32:11,219][177170] DAMAGECOUNT value on done: 2870.0 [2023-02-24 17:32:11,219][177170] Sum rewards: -12.257, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.300', 'FRAGCOUNT': '-1.500', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.028', 'WEAPON1': '0.030', 'ARMOR': '0.084', 'WEAPON5': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.171', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.950', 'weapon3': '1.074', 'weapon2': '2.168'} [2023-02-24 17:32:11,376][177119] Fps is (10 sec: 13516.7, 60 sec: 13721.6, 300 sec: 14079.1). Total num frames: 7770112. Throughput: 0: 3413.1. Samples: 1940328. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:32:11,376][177119] Avg episode reward: [(0, '-3.332')] [2023-02-24 17:32:11,392][177154] DAMAGECOUNT value on done: 4283.0 [2023-02-24 17:32:11,393][177154] Sum rewards: -1.472, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.280', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO5': '0.010', 'weapon5': '0.010', 'ARMOR': '0.040', 'AMMO3': '0.081', 'WEAPON5': '0.150', 'HITCOUNT': '0.190', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.600', 'weapon3': '1.118', 'weapon2': '1.964', 'FRAGCOUNT': '2.000'} [2023-02-24 17:32:11,460][177172] DAMAGECOUNT value on done: 3072.0 [2023-02-24 17:32:11,460][177172] Sum rewards: -3.003, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.890', 'AMMO4': '-0.066', 'AMMO2': '-0.013', 'AMMO5': '0.008', 'WEAPON1': '0.050', 'ARMOR': '0.060', 'HITCOUNT': '0.070', 'weapon5': '0.114', 'AMMO3': '0.134', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.306', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.248', 'weapon2': '1.826'} [2023-02-24 17:32:11,469][177158] DAMAGECOUNT value on done: 4470.0 [2023-02-24 17:32:11,469][177158] Sum rewards: 1.723, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.970', 'AMMO4': '-0.057', 'AMMO2': '-0.011', 'AMMO5': '0.009', 'WEAPON1': '0.040', 'ARMOR': '0.050', 'weapon5': '0.068', 'AMMO3': '0.080', 'HITCOUNT': '0.140', 'WEAPON5': '0.200', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.600', 'weapon3': '1.192', 'weapon2': '1.332', 'FRAGCOUNT': '3.000'} [2023-02-24 17:32:11,513][177170] DAMAGECOUNT value on done: 4049.0 [2023-02-24 17:32:11,514][177170] Sum rewards: -6.304, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.149', 'AMMO2': '0.020', 'AMMO5': '0.025', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'HITCOUNT': '0.150', 'weapon5': '0.160', 'AMMO3': '0.199', 'WEAPON5': '0.450', 'DAMAGECOUNT': '0.825', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.150', 'weapon2': '1.296', 'weapon3': '1.578'} [2023-02-24 17:32:11,711][177154] DAMAGECOUNT value on done: 2953.0 [2023-02-24 17:32:11,711][177154] Sum rewards: -4.973, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.510', 'AMMO5': '0.005', 'weapon4': '0.012', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'HITCOUNT': '0.030', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.062', 'DAMAGECOUNT': '0.075', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.147', 'WEAPON3': '0.800', 'weapon2': '1.204', 'weapon3': '1.884'} [2023-02-24 17:32:11,790][177158] DAMAGECOUNT value on done: 3433.0 [2023-02-24 17:32:11,791][177158] Sum rewards: -0.656, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.258', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO5': '0.010', 'WEAPON1': '0.050', 'AMMO3': '0.124', 'HITCOUNT': '0.180', 'weapon5': '0.216', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.765', 'FRAGCOUNT': '1.000', 'weapon2': '1.424', 'weapon3': '1.760'} [2023-02-24 17:32:11,918][177154] DAMAGECOUNT value on done: 4266.0 [2023-02-24 17:32:11,919][177154] Sum rewards: -0.805, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.082', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'ARMOR': '0.049', 'AMMO3': '0.100', 'HITCOUNT': '0.130', 'weapon5': '0.166', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.429', 'WEAPON3': '0.500', 'weapon3': '1.022', 'FRAGCOUNT': '2.000', 'weapon2': '2.118'} [2023-02-24 17:32:11,950][177158] DAMAGECOUNT value on done: 3088.0 [2023-02-24 17:32:11,951][177158] Sum rewards: -0.930, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.766', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.024', 'WEAPON1': '0.060', 'HITCOUNT': '0.080', 'ARMOR': '0.080', 'AMMO3': '0.087', 'weapon5': '0.126', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.550', 'weapon2': '0.974', 'weapon3': '1.918', 'FRAGCOUNT': '2.000'} [2023-02-24 17:32:12,098][177153] Updated weights for policy 0, policy_version 1900 (0.0008) [2023-02-24 17:32:12,108][177172] DAMAGECOUNT value on done: 2610.0 [2023-02-24 17:32:12,108][177172] Sum rewards: -1.410, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.640', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON1': '0.030', 'weapon5': '0.042', 'HITCOUNT': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'ARMOR': '0.084', 'AMMO3': '0.100', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.130', 'weapon2': '1.746'} [2023-02-24 17:32:12,176][177171] DAMAGECOUNT value on done: 3327.0 [2023-02-24 17:32:12,177][177171] Sum rewards: -3.147, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.442', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon5': '0.038', 'ARMOR': '0.056', 'AMMO4': '0.109', 'AMMO3': '0.118', 'HITCOUNT': '0.150', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.555', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.336', 'weapon2': '1.976'} [2023-02-24 17:32:12,220][177154] DAMAGECOUNT value on done: 4006.0 [2023-02-24 17:32:12,221][177154] Sum rewards: -1.978, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.196', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'ARMOR': '0.120', 'HITCOUNT': '0.120', 'AMMO4': '0.131', 'AMMO3': '0.149', 'DAMAGECOUNT': '0.609', 'WEAPON3': '0.850', 'weapon3': '1.518', 'weapon2': '1.578', 'FRAGCOUNT': '2.000'} [2023-02-24 17:32:12,246][177157] DAMAGECOUNT value on done: 4064.0 [2023-02-24 17:32:12,247][177157] Sum rewards: -5.135, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.215', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'ARMOR': '0.016', 'AMMO5': '0.018', 'WEAPON1': '0.030', 'HITCOUNT': '0.080', 'AMMO3': '0.122', 'weapon5': '0.192', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.537', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.088', 'weapon2': '1.952'} [2023-02-24 17:32:12,254][177158] DAMAGECOUNT value on done: 2624.0 [2023-02-24 17:32:12,255][177158] Sum rewards: -3.629, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.990', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.010', 'weapon4': '0.024', 'weapon5': '0.030', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.768', 'WEAPON3': '0.850', 'weapon2': '1.232', 'weapon3': '1.812', 'FRAGCOUNT': '2.000'} [2023-02-24 17:32:12,429][177172] DAMAGECOUNT value on done: 2952.0 [2023-02-24 17:32:12,486][177171] DAMAGECOUNT value on done: 3211.0 [2023-02-24 17:32:12,486][177171] Sum rewards: -6.454, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.324', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon4': '0.016', 'weapon5': '0.044', 'ARMOR': '0.056', 'WEAPON4': '0.100', 'HITCOUNT': '0.170', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.789', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon3': '1.518', 'weapon2': '1.810'} [2023-02-24 17:32:12,501][177155] DAMAGECOUNT value on done: 3251.0 [2023-02-24 17:32:12,501][177155] Sum rewards: -0.631, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.802', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.015', 'weapon7': '0.032', 'weapon5': '0.060', 'AMMO3': '0.068', 'ARMOR': '0.068', 'HITCOUNT': '0.070', 'DAMAGECOUNT': '0.177', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.184', 'weapon2': '1.482'} [2023-02-24 17:32:12,557][177157] DAMAGECOUNT value on done: 3587.0 [2023-02-24 17:32:12,558][177157] Sum rewards: -4.353, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.150', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.019', 'WEAPON1': '0.060', 'ARMOR': '0.064', 'AMMO3': '0.114', 'weapon5': '0.126', 'HITCOUNT': '0.150', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.402', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.054', 'weapon3': '1.900'} [2023-02-24 17:32:12,595][177157] DAMAGECOUNT value on done: 4018.0 [2023-02-24 17:32:12,799][177171] DAMAGECOUNT value on done: 3541.0 [2023-02-24 17:32:12,799][177171] Sum rewards: -4.689, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.554', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'WEAPON1': '0.020', 'AMMO5': '0.026', 'HITCOUNT': '0.090', 'AMMO3': '0.102', 'weapon5': '0.142', 'DAMAGECOUNT': '0.312', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'ARMOR': '0.503', 'weapon3': '1.264', 'weapon2': '1.570'} [2023-02-24 17:32:12,801][177155] DAMAGECOUNT value on done: 4296.0 [2023-02-24 17:32:12,896][177157] DAMAGECOUNT value on done: 3047.0 [2023-02-24 17:32:13,042][177155] DAMAGECOUNT value on done: 3781.0 [2023-02-24 17:32:13,043][177155] Sum rewards: 1.402, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.174', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.020', 'WEAPON1': '0.050', 'AMMO3': '0.082', 'ARMOR': '0.100', 'HITCOUNT': '0.170', 'WEAPON5': '0.200', 'weapon5': '0.200', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.726', 'FRAGCOUNT': '1.000', 'weapon3': '1.338', 'weapon2': '1.678'} [2023-02-24 17:32:13,106][177171] DAMAGECOUNT value on done: 3369.0 [2023-02-24 17:32:13,339][177155] DAMAGECOUNT value on done: 3073.0 [2023-02-24 17:32:13,340][177155] Sum rewards: -0.367, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.676', 'AMMO5': '0.004', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'weapon5': '0.068', 'weapon4': '0.070', 'ARMOR': '0.076', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'HITCOUNT': '0.120', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.700', 'weapon2': '1.362', 'weapon3': '1.748', 'FRAGCOUNT': '2.000'} [2023-02-24 17:32:13,766][177156] DAMAGECOUNT value on done: 3451.0 [2023-02-24 17:32:13,767][177156] Sum rewards: -3.308, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.463', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon5': '0.104', 'weapon4': '0.108', 'HITCOUNT': '0.120', 'ARMOR': '0.133', 'AMMO3': '0.134', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.759', 'weapon3': '0.860', 'FRAGCOUNT': '1.000', 'weapon2': '2.284'} [2023-02-24 17:32:14,077][177156] DAMAGECOUNT value on done: 3792.0 [2023-02-24 17:32:14,077][177156] Sum rewards: -1.654, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.362', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'ARMOR': '0.024', 'AMMO4': '0.030', 'AMMO3': '0.150', 'HITCOUNT': '0.210', 'weapon5': '0.226', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.185', 'weapon2': '1.452', 'weapon3': '1.750', 'FRAGCOUNT': '4.000'} [2023-02-24 17:32:14,395][177156] DAMAGECOUNT value on done: 2829.0 [2023-02-24 17:32:14,395][177156] Sum rewards: -5.319, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.890', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.010', 'weapon5': '0.040', 'HITCOUNT': '0.050', 'WEAPON1': '0.050', 'ARMOR': '0.066', 'DAMAGECOUNT': '0.141', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'WEAPON3': '1.050', 'weapon3': '1.562', 'weapon2': '1.752', 'FRAGCOUNT': '2.000'} [2023-02-24 17:32:14,692][177156] DAMAGECOUNT value on done: 3430.0 [2023-02-24 17:32:15,046][177153] Updated weights for policy 0, policy_version 1910 (0.0009) [2023-02-24 17:32:16,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13721.6, 300 sec: 14079.1). Total num frames: 7839744. Throughput: 0: 3416.4. Samples: 1961180. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:32:16,376][177119] Avg episode reward: [(0, '-3.014')] [2023-02-24 17:32:16,380][177140] Saving new best policy, reward=-3.014! [2023-02-24 17:32:17,978][177153] Updated weights for policy 0, policy_version 1920 (0.0008) [2023-02-24 17:32:21,351][177153] Updated weights for policy 0, policy_version 1930 (0.0010) [2023-02-24 17:32:21,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13653.4, 300 sec: 14065.2). Total num frames: 7905280. Throughput: 0: 3417.9. Samples: 1971698. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:32:21,376][177119] Avg episode reward: [(0, '-3.014')] [2023-02-24 17:32:24,589][177153] Updated weights for policy 0, policy_version 1940 (0.0009) [2023-02-24 17:32:26,376][177119] Fps is (10 sec: 12697.6, 60 sec: 13516.8, 300 sec: 14023.6). Total num frames: 7966720. Throughput: 0: 3358.1. Samples: 1989812. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:32:26,376][177119] Avg episode reward: [(0, '-3.014')] [2023-02-24 17:32:27,735][177153] Updated weights for policy 0, policy_version 1950 (0.0009) [2023-02-24 17:32:31,376][177119] Fps is (10 sec: 11878.1, 60 sec: 13312.0, 300 sec: 13981.9). Total num frames: 8024064. Throughput: 0: 3322.0. Samples: 2007676. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:32:31,377][177119] Avg episode reward: [(0, '-3.014')] [2023-02-24 17:32:31,425][177153] Updated weights for policy 0, policy_version 1960 (0.0010) [2023-02-24 17:32:31,960][177170] DAMAGECOUNT value on done: 3166.0 [2023-02-24 17:32:32,158][177172] DAMAGECOUNT value on done: 3412.0 [2023-02-24 17:32:32,159][177172] Sum rewards: -0.475, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.055', 'AMMO5': '0.004', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'AMMO4': '0.030', 'weapon4': '0.044', 'HITCOUNT': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'weapon5': '0.124', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.315', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.326', 'weapon2': '1.968'} [2023-02-24 17:32:32,271][177170] DAMAGECOUNT value on done: 2950.0 [2023-02-24 17:32:32,293][177170] DAMAGECOUNT value on done: 5042.0 [2023-02-24 17:32:32,294][177170] Sum rewards: 1.109, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.966', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.010', 'weapon5': '0.038', 'WEAPON1': '0.040', 'weapon4': '0.044', 'AMMO3': '0.085', 'ARMOR': '0.092', 'weapon7': '0.098', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.723', 'FRAGCOUNT': '1.000', 'weapon3': '1.440', 'weapon2': '1.514'} [2023-02-24 17:32:32,370][177154] DAMAGECOUNT value on done: 4483.0 [2023-02-24 17:32:32,370][177154] Sum rewards: -2.544, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.748', 'AMMO2': '0.005', 'AMMO5': '0.005', 'weapon4': '0.024', 'AMMO4': '0.024', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.135', 'weapon5': '0.136', 'WEAPON5': '0.150', 'ARMOR': '0.521', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.436', 'weapon3': '1.658'} [2023-02-24 17:32:32,437][177158] DAMAGECOUNT value on done: 4609.0 [2023-02-24 17:32:32,437][177158] Sum rewards: -3.044, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.110', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.417', 'weapon3': '0.720', 'FRAGCOUNT': '1.000', 'weapon2': '1.234'} [2023-02-24 17:32:32,490][177172] DAMAGECOUNT value on done: 3179.0 [2023-02-24 17:32:32,490][177172] Sum rewards: -5.512, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.455', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.036', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.184', 'DAMAGECOUNT': '0.321', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.050', 'weapon3': '1.344', 'weapon2': '2.264'} [2023-02-24 17:32:32,592][177170] DAMAGECOUNT value on done: 4245.0 [2023-02-24 17:32:32,593][177170] Sum rewards: -6.323, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.584', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'HITCOUNT': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.156', 'weapon5': '0.228', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.588', 'WEAPON3': '0.750', 'weapon3': '1.054', 'weapon2': '2.136'} [2023-02-24 17:32:32,663][177154] DAMAGECOUNT value on done: 3103.0 [2023-02-24 17:32:32,664][177154] Sum rewards: -3.985, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.759', 'AMMO5': '0.007', 'weapon4': '0.018', 'AMMO2': '0.029', 'WEAPON1': '0.040', 'ARMOR': '0.056', 'HITCOUNT': '0.120', 'AMMO3': '0.142', 'AMMO4': '0.143', 'weapon5': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.170', 'weapon2': '2.206'} [2023-02-24 17:32:32,740][177158] DAMAGECOUNT value on done: 3523.0 [2023-02-24 17:32:32,740][177158] Sum rewards: -2.604, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.291', 'AMMO2': '0.012', 'AMMO5': '0.012', 'weapon4': '0.026', 'WEAPON4': '0.050', 'weapon5': '0.052', 'AMMO4': '0.059', 'WEAPON1': '0.070', 'HITCOUNT': '0.100', 'AMMO3': '0.158', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.270', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.594', 'weapon3': '1.734'} [2023-02-24 17:32:32,861][177154] DAMAGECOUNT value on done: 4696.0 [2023-02-24 17:32:32,861][177154] Sum rewards: -4.632, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.202', 'weapon7': '0.002', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.013', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'weapon5': '0.098', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.122', 'WEAPON5': '0.150', 'HITCOUNT': '0.270', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.290', 'weapon3': '1.454', 'weapon2': '1.802'} [2023-02-24 17:32:32,884][177158] DAMAGECOUNT value on done: 3217.0 [2023-02-24 17:32:32,884][177158] Sum rewards: -4.505, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.433', 'AMMO5': '0.008', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'HITCOUNT': '0.060', 'weapon4': '0.066', 'AMMO4': '0.086', 'weapon5': '0.088', 'ARMOR': '0.136', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.387', 'weapon3': '0.894', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '2.456'} [2023-02-24 17:32:33,158][177154] DAMAGECOUNT value on done: 4106.0 [2023-02-24 17:32:33,158][177154] Sum rewards: -2.009, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.119', 'AMMO2': '0.012', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'HITCOUNT': '0.050', 'AMMO4': '0.062', 'weapon5': '0.096', 'AMMO3': '0.123', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.238', 'weapon2': '1.264'} [2023-02-24 17:32:33,168][177157] DAMAGECOUNT value on done: 4130.0 [2023-02-24 17:32:33,168][177157] Sum rewards: -4.552, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.202', 'AMMO4': '-0.079', 'AMMO2': '-0.016', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.066', 'WEAPON1': '0.070', 'HITCOUNT': '0.100', 'DAMAGECOUNT': '0.198', 'AMMO3': '0.224', 'weapon3': '0.716', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '2.568'} [2023-02-24 17:32:33,170][177172] DAMAGECOUNT value on done: 2830.0 [2023-02-24 17:32:33,171][177172] Sum rewards: -2.112, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.576', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'weapon5': '0.020', 'weapon4': '0.022', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'HITCOUNT': '0.200', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.660', 'weapon2': '1.664', 'weapon3': '1.822', 'FRAGCOUNT': '2.000'} [2023-02-24 17:32:33,173][177158] DAMAGECOUNT value on done: 2711.0 [2023-02-24 17:32:33,174][177158] Sum rewards: 0.596, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.246', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.016', 'WEAPON1': '0.020', 'weapon4': '0.024', 'AMMO4': '0.037', 'ARMOR': '0.076', 'HITCOUNT': '0.080', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.261', 'WEAPON3': '0.550', 'weapon3': '1.484', 'weapon2': '1.486', 'FRAGCOUNT': '2.000'} [2023-02-24 17:32:33,306][177171] DAMAGECOUNT value on done: 3635.0 [2023-02-24 17:32:33,306][177171] Sum rewards: -3.844, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.150', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'AMMO5': '0.024', 'AMMO4': '0.029', 'AMMO3': '0.157', 'HITCOUNT': '0.190', 'weapon5': '0.220', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.924', 'weapon3': '1.252', 'weapon2': '1.964', 'FRAGCOUNT': '4.000'} [2023-02-24 17:32:33,461][177155] DAMAGECOUNT value on done: 3323.0 [2023-02-24 17:32:33,468][177172] DAMAGECOUNT value on done: 3233.0 [2023-02-24 17:32:33,469][177172] Sum rewards: -2.451, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.943', 'AMMO2': '0.005', 'AMMO5': '0.013', 'weapon5': '0.020', 'AMMO4': '0.023', 'AMMO3': '0.134', 'WEAPON5': '0.200', 'HITCOUNT': '0.260', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.843', 'FRAGCOUNT': '1.000', 'weapon3': '1.692', 'weapon2': '1.752'} [2023-02-24 17:32:33,470][177157] DAMAGECOUNT value on done: 3862.0 [2023-02-24 17:32:33,470][177157] Sum rewards: 2.444, reward structure: {'DEATHCOUNT': '-6.000', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.089', 'HITCOUNT': '0.160', 'WEAPON5': '0.200', 'weapon5': '0.280', 'weapon4': '0.324', 'WEAPON3': '0.400', 'HEALTH': '0.468', 'weapon3': '0.676', 'DAMAGECOUNT': '0.825', 'weapon2': '1.842', 'FRAGCOUNT': '3.000'} [2023-02-24 17:32:33,510][177157] DAMAGECOUNT value on done: 4063.0 [2023-02-24 17:32:33,612][177171] DAMAGECOUNT value on done: 3575.0 [2023-02-24 17:32:33,612][177171] Sum rewards: -2.964, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.666', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'weapon4': '0.050', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'WEAPON5': '0.200', 'weapon5': '0.252', 'HITCOUNT': '0.270', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.092', 'FRAGCOUNT': '1.500', 'weapon2': '1.508', 'weapon3': '1.606'} [2023-02-24 17:32:33,805][177155] DAMAGECOUNT value on done: 4813.0 [2023-02-24 17:32:33,805][177155] Sum rewards: -3.601, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.022', 'AMMO2': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.033', 'ARMOR': '0.092', 'WEAPON4': '0.100', 'weapon5': '0.128', 'AMMO3': '0.138', 'WEAPON5': '0.200', 'HITCOUNT': '0.220', 'WEAPON3': '0.750', 'weapon3': '0.886', 'DAMAGECOUNT': '1.551', 'weapon2': '2.526', 'FRAGCOUNT': '3.000'} [2023-02-24 17:32:33,872][177157] DAMAGECOUNT value on done: 3254.0 [2023-02-24 17:32:33,872][177157] Sum rewards: -0.218, reward structure: {'DEATHCOUNT': '-7.500', 'weapon4': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.024', 'ARMOR': '0.030', 'HEALTH': '0.048', 'WEAPON1': '0.050', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.120', 'weapon5': '0.122', 'HITCOUNT': '0.170', 'WEAPON5': '0.200', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.621', 'weapon2': '1.374', 'weapon3': '1.808', 'FRAGCOUNT': '2.000'} [2023-02-24 17:32:33,962][177171] DAMAGECOUNT value on done: 3940.0 [2023-02-24 17:32:33,963][177171] Sum rewards: -2.350, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.189', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'AMMO3': '0.093', 'WEAPON5': '0.150', 'weapon5': '0.150', 'HITCOUNT': '0.230', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.197', 'weapon2': '1.258', 'weapon3': '1.884', 'FRAGCOUNT': '2.000'} [2023-02-24 17:32:34,083][177155] DAMAGECOUNT value on done: 4013.0 [2023-02-24 17:32:34,084][177155] Sum rewards: -8.316, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.114', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.009', 'AMMO5': '0.020', 'weapon4': '0.022', 'WEAPON1': '0.030', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'HITCOUNT': '0.130', 'weapon5': '0.140', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.696', 'WEAPON3': '0.750', 'weapon3': '1.326', 'weapon2': '2.004'} [2023-02-24 17:32:34,270][177171] DAMAGECOUNT value on done: 3609.0 [2023-02-24 17:32:34,270][177171] Sum rewards: -2.233, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.084', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'ARMOR': '0.004', 'AMMO5': '0.015', 'WEAPON1': '0.050', 'HITCOUNT': '0.160', 'AMMO3': '0.162', 'weapon5': '0.232', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.720', 'WEAPON3': '0.900', 'weapon3': '1.496', 'weapon2': '1.524', 'FRAGCOUNT': '3.000'} [2023-02-24 17:32:34,389][177155] DAMAGECOUNT value on done: 3337.0 [2023-02-24 17:32:34,389][177155] Sum rewards: -0.627, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.556', 'AMMO5': '0.005', 'weapon4': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'weapon5': '0.022', 'AMMO4': '0.062', 'ARMOR': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'HITCOUNT': '0.180', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.792', 'FRAGCOUNT': '1.000', 'weapon3': '1.768', 'weapon2': '1.812'} [2023-02-24 17:32:34,523][177153] Updated weights for policy 0, policy_version 1970 (0.0008) [2023-02-24 17:32:35,011][177156] DAMAGECOUNT value on done: 3576.0 [2023-02-24 17:32:35,011][177156] Sum rewards: -5.905, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.082', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'HITCOUNT': '0.130', 'weapon5': '0.144', 'AMMO3': '0.182', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon3': '1.464', 'weapon2': '1.890'} [2023-02-24 17:32:35,309][177156] DAMAGECOUNT value on done: 4112.0 [2023-02-24 17:32:35,553][177156] DAMAGECOUNT value on done: 3020.0 [2023-02-24 17:32:35,553][177156] Sum rewards: -0.103, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.311', 'AMMO5': '0.008', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'HITCOUNT': '0.070', 'ARMOR': '0.076', 'AMMO4': '0.077', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon5': '0.336', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.573', 'FRAGCOUNT': '1.000', 'weapon3': '1.012', 'weapon2': '1.364'} [2023-02-24 17:32:35,860][177156] DAMAGECOUNT value on done: 3465.0 [2023-02-24 17:32:36,376][177119] Fps is (10 sec: 12288.1, 60 sec: 13243.8, 300 sec: 13954.2). Total num frames: 8089600. Throughput: 0: 3320.5. Samples: 2017560. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:32:36,376][177119] Avg episode reward: [(0, '-3.157')] [2023-02-24 17:32:37,069][177170] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 17:32:37,593][177153] Updated weights for policy 0, policy_version 1980 (0.0008) [2023-02-24 17:32:40,575][177153] Updated weights for policy 0, policy_version 1990 (0.0009) [2023-02-24 17:32:41,376][177119] Fps is (10 sec: 13517.1, 60 sec: 13243.7, 300 sec: 13954.2). Total num frames: 8159232. Throughput: 0: 3306.8. Samples: 2037758. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:32:41,376][177119] Avg episode reward: [(0, '-3.157')] [2023-02-24 17:32:43,533][177153] Updated weights for policy 0, policy_version 2000 (0.0009) [2023-02-24 17:32:46,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13312.0, 300 sec: 13954.2). Total num frames: 8228864. Throughput: 0: 3305.4. Samples: 2058576. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:32:46,376][177119] Avg episode reward: [(0, '-3.157')] [2023-02-24 17:32:46,480][177153] Updated weights for policy 0, policy_version 2010 (0.0009) [2023-02-24 17:32:49,547][177153] Updated weights for policy 0, policy_version 2020 (0.0009) [2023-02-24 17:32:51,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13380.3, 300 sec: 13940.3). Total num frames: 8298496. Throughput: 0: 3296.2. Samples: 2068594. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:32:51,376][177119] Avg episode reward: [(0, '-3.157')] [2023-02-24 17:32:51,631][177170] DAMAGECOUNT value on done: 3306.0 [2023-02-24 17:32:51,631][177170] Sum rewards: -7.385, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.480', 'FRAGCOUNT': '-1.500', 'AMMO2': '0.003', 'AMMO5': '0.009', 'weapon5': '0.016', 'AMMO4': '0.016', 'WEAPON1': '0.050', 'ARMOR': '0.064', 'WEAPON4': '0.100', 'HITCOUNT': '0.150', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.950', 'weapon3': '1.576', 'weapon2': '1.844'} [2023-02-24 17:32:51,931][177172] DAMAGECOUNT value on done: 3437.0 [2023-02-24 17:32:51,944][177170] DAMAGECOUNT value on done: 5175.0 [2023-02-24 17:32:52,015][177170] DAMAGECOUNT value on done: 3131.0 [2023-02-24 17:32:52,016][177170] Sum rewards: -0.435, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.501', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.018', 'ARMOR': '0.048', 'WEAPON1': '0.060', 'HITCOUNT': '0.060', 'AMMO3': '0.093', 'weapon5': '0.316', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.543', 'WEAPON3': '0.600', 'weapon3': '1.232', 'weapon2': '1.532', 'FRAGCOUNT': '3.000'} [2023-02-24 17:32:52,098][177154] DAMAGECOUNT value on done: 4559.0 [2023-02-24 17:32:52,146][177158] DAMAGECOUNT value on done: 4811.0 [2023-02-24 17:32:52,147][177158] Sum rewards: -3.932, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.726', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.078', 'AMMO4': '0.080', 'ARMOR': '0.088', 'HITCOUNT': '0.090', 'weapon5': '0.098', 'AMMO3': '0.174', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.606', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon3': '1.386', 'weapon2': '1.816'} [2023-02-24 17:32:52,248][177172] DAMAGECOUNT value on done: 3459.0 [2023-02-24 17:32:52,249][177172] Sum rewards: -2.175, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.786', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO4': '0.043', 'weapon4': '0.046', 'ARMOR': '0.100', 'weapon5': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'HITCOUNT': '0.230', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.840', 'WEAPON3': '0.950', 'weapon3': '1.670', 'weapon2': '1.708', 'FRAGCOUNT': '3.000'} [2023-02-24 17:32:52,318][177170] DAMAGECOUNT value on done: 4565.0 [2023-02-24 17:32:52,319][177170] Sum rewards: 1.169, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.718', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'weapon5': '0.050', 'weapon4': '0.056', 'AMMO4': '0.080', 'ARMOR': '0.104', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'HITCOUNT': '0.240', 'WEAPON4': '0.250', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.960', 'weapon3': '1.474', 'weapon2': '1.980', 'FRAGCOUNT': '3.000'} [2023-02-24 17:32:52,396][177154] DAMAGECOUNT value on done: 3202.0 [2023-02-24 17:32:52,397][177154] Sum rewards: -1.742, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.019', 'AMMO5': '0.009', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'HITCOUNT': '0.020', 'ARMOR': '0.056', 'weapon4': '0.066', 'AMMO4': '0.088', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'weapon5': '0.150', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.297', 'WEAPON3': '0.550', 'weapon3': '0.772', 'FRAGCOUNT': '1.000', 'weapon2': '2.532'} [2023-02-24 17:32:52,440][177158] DAMAGECOUNT value on done: 3743.0 [2023-02-24 17:32:52,518][177153] Updated weights for policy 0, policy_version 2030 (0.0008) [2023-02-24 17:32:52,610][177158] DAMAGECOUNT value on done: 3287.0 [2023-02-24 17:32:52,634][177154] DAMAGECOUNT value on done: 4811.0 [2023-02-24 17:32:52,634][177154] Sum rewards: -4.433, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.912', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.034', 'weapon4': '0.048', 'ARMOR': '0.052', 'HITCOUNT': '0.090', 'AMMO4': '0.096', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.600', 'weapon3': '0.902', 'weapon2': '2.556'} [2023-02-24 17:32:52,917][177157] DAMAGECOUNT value on done: 4314.0 [2023-02-24 17:32:52,918][177157] Sum rewards: -3.423, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.660', 'AMMO2': '0.006', 'AMMO5': '0.009', 'weapon4': '0.026', 'AMMO4': '0.032', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'ARMOR': '0.052', 'HITCOUNT': '0.140', 'weapon5': '0.142', 'AMMO3': '0.154', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.552', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.052', 'weapon2': '1.920'} [2023-02-24 17:32:52,926][177158] DAMAGECOUNT value on done: 3001.0 [2023-02-24 17:32:52,927][177158] Sum rewards: -6.662, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.264', 'AMMO5': '0.009', 'AMMO2': '0.015', 'weapon4': '0.020', 'WEAPON1': '0.060', 'weapon5': '0.068', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'HITCOUNT': '0.240', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.870', 'weapon2': '1.436', 'weapon3': '1.994'} [2023-02-24 17:32:52,930][177154] DAMAGECOUNT value on done: 4273.0 [2023-02-24 17:32:52,941][177172] DAMAGECOUNT value on done: 2930.0 [2023-02-24 17:32:52,941][177172] Sum rewards: -5.592, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.798', 'AMMO2': '0.004', 'AMMO5': '0.012', 'AMMO4': '0.022', 'ARMOR': '0.040', 'weapon5': '0.046', 'HITCOUNT': '0.110', 'AMMO3': '0.201', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.300', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.100', 'weapon3': '1.368', 'weapon2': '2.252'} [2023-02-24 17:32:53,004][177171] DAMAGECOUNT value on done: 3640.0 [2023-02-24 17:32:53,004][177171] Sum rewards: -4.980, reward structure: {'DEATHCOUNT': '-4.500', 'FRAGCOUNT': '-3.000', 'HEALTH': '-0.930', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'HITCOUNT': '0.010', 'AMMO5': '0.013', 'DAMAGECOUNT': '0.015', 'WEAPON1': '0.030', 'ARMOR': '0.036', 'weapon5': '0.094', 'AMMO3': '0.096', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'weapon2': '0.798', 'weapon3': '1.568'} [2023-02-24 17:32:53,193][177155] DAMAGECOUNT value on done: 3358.0 [2023-02-24 17:32:53,213][177157] DAMAGECOUNT value on done: 4090.0 [2023-02-24 17:32:53,214][177157] Sum rewards: 0.479, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.756', 'weapon4': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'WEAPON4': '0.050', 'ARMOR': '0.052', 'AMMO3': '0.084', 'AMMO4': '0.138', 'HITCOUNT': '0.160', 'weapon5': '0.168', 'WEAPON5': '0.200', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.684', 'weapon3': '0.730', 'FRAGCOUNT': '2.000', 'weapon2': '2.558'} [2023-02-24 17:32:53,225][177157] DAMAGECOUNT value on done: 4193.0 [2023-02-24 17:32:53,244][177172] DAMAGECOUNT value on done: 3503.0 [2023-02-24 17:32:53,244][177172] Sum rewards: -4.719, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.270', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO5': '0.026', 'weapon4': '0.040', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'AMMO3': '0.148', 'HITCOUNT': '0.190', 'weapon5': '0.304', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.810', 'FRAGCOUNT': '1.000', 'weapon2': '1.494', 'weapon3': '1.760'} [2023-02-24 17:32:53,298][177171] DAMAGECOUNT value on done: 3792.0 [2023-02-24 17:32:53,298][177171] Sum rewards: 3.450, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.765', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO3': '0.040', 'WEAPON1': '0.040', 'HITCOUNT': '0.060', 'AMMO4': '0.140', 'WEAPON5': '0.200', 'WEAPON3': '0.300', 'weapon5': '0.354', 'DAMAGECOUNT': '0.651', 'weapon3': '0.788', 'FRAGCOUNT': '1.000', 'weapon2': '2.106'} [2023-02-24 17:32:53,486][177155] DAMAGECOUNT value on done: 5009.0 [2023-02-24 17:32:53,487][177155] Sum rewards: -0.319, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.786', 'AMMO5': '0.015', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.075', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'weapon4': '0.104', 'HITCOUNT': '0.130', 'ARMOR': '0.132', 'weapon5': '0.154', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.588', 'weapon3': '0.796', 'FRAGCOUNT': '2.000', 'weapon2': '2.256'} [2023-02-24 17:32:53,519][177157] DAMAGECOUNT value on done: 3429.0 [2023-02-24 17:32:53,519][177157] Sum rewards: -0.553, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.286', 'weapon4': '0.016', 'AMMO2': '0.019', 'ARMOR': '0.020', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'HITCOUNT': '0.080', 'AMMO3': '0.092', 'AMMO4': '0.093', 'weapon5': '0.332', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.525', 'weapon3': '1.536', 'weapon2': '1.568', 'FRAGCOUNT': '2.000'} [2023-02-24 17:32:53,595][177171] DAMAGECOUNT value on done: 4147.0 [2023-02-24 17:32:53,595][177171] Sum rewards: 2.228, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.180', 'AMMO2': '0.002', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.009', 'WEAPON1': '0.030', 'AMMO3': '0.097', 'HITCOUNT': '0.190', 'WEAPON5': '0.200', 'weapon5': '0.392', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.621', 'weapon3': '1.068', 'weapon2': '2.238', 'FRAGCOUNT': '3.000'} [2023-02-24 17:32:53,791][177155] DAMAGECOUNT value on done: 4243.0 [2023-02-24 17:32:53,791][177155] Sum rewards: -0.785, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.227', 'AMMO2': '0.002', 'AMMO5': '0.006', 'AMMO4': '0.009', 'WEAPON1': '0.030', 'ARMOR': '0.064', 'AMMO3': '0.104', 'WEAPON5': '0.150', 'HITCOUNT': '0.160', 'weapon5': '0.196', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.690', 'FRAGCOUNT': '1.000', 'weapon2': '1.564', 'weapon3': '1.816'} [2023-02-24 17:32:53,890][177171] DAMAGECOUNT value on done: 3771.0 [2023-02-24 17:32:53,891][177171] Sum rewards: 0.899, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.904', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'ARMOR': '0.064', 'weapon4': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'AMMO4': '0.111', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'weapon5': '0.186', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.486', 'weapon3': '0.668', 'FRAGCOUNT': '2.000', 'weapon2': '2.482'} [2023-02-24 17:32:54,103][177155] DAMAGECOUNT value on done: 3412.0 [2023-02-24 17:32:54,714][177156] DAMAGECOUNT value on done: 3818.0 [2023-02-24 17:32:54,714][177156] Sum rewards: 0.906, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.272', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.027', 'WEAPON1': '0.040', 'AMMO3': '0.087', 'HITCOUNT': '0.130', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'weapon5': '0.568', 'DAMAGECOUNT': '0.726', 'weapon3': '1.286', 'weapon2': '1.596', 'FRAGCOUNT': '2.000'} [2023-02-24 17:32:55,012][177156] DAMAGECOUNT value on done: 4444.0 [2023-02-24 17:32:55,013][177156] Sum rewards: -4.161, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.690', 'weapon4': '0.010', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'ARMOR': '0.044', 'weapon5': '0.090', 'AMMO4': '0.129', 'AMMO3': '0.131', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.996', 'FRAGCOUNT': '1.000', 'weapon3': '1.284', 'weapon2': '2.256'} [2023-02-24 17:32:55,262][177156] DAMAGECOUNT value on done: 3237.0 [2023-02-24 17:32:55,263][177156] Sum rewards: -7.516, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.076', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon5': '0.024', 'weapon4': '0.046', 'ARMOR': '0.048', 'WEAPON4': '0.100', 'HITCOUNT': '0.170', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.651', 'weapon3': '0.850', 'WEAPON3': '1.000', 'FRAGCOUNT': '2.000', 'weapon2': '2.752'} [2023-02-24 17:32:55,458][177153] Updated weights for policy 0, policy_version 2040 (0.0009) [2023-02-24 17:32:55,552][177156] DAMAGECOUNT value on done: 3530.0 [2023-02-24 17:32:56,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13380.3, 300 sec: 13940.3). Total num frames: 8368128. Throughput: 0: 3314.8. Samples: 2089496. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:32:56,376][177119] Avg episode reward: [(0, '-3.147')] [2023-02-24 17:32:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000002043_8368128.pth... [2023-02-24 17:32:56,433][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000001230_5038080.pth [2023-02-24 17:32:58,397][177153] Updated weights for policy 0, policy_version 2050 (0.0009) [2023-02-24 17:33:01,349][177153] Updated weights for policy 0, policy_version 2060 (0.0008) [2023-02-24 17:33:01,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13380.3, 300 sec: 13940.3). Total num frames: 8437760. Throughput: 0: 3313.1. Samples: 2110268. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:33:01,376][177119] Avg episode reward: [(0, '-3.147')] [2023-02-24 17:33:01,462][177154] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 17:33:04,383][177153] Updated weights for policy 0, policy_version 2070 (0.0008) [2023-02-24 17:33:06,376][177119] Fps is (10 sec: 13516.5, 60 sec: 13311.9, 300 sec: 13912.5). Total num frames: 8503296. Throughput: 0: 3303.8. Samples: 2120370. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:33:06,377][177119] Avg episode reward: [(0, '-3.147')] [2023-02-24 17:33:06,615][177170] Large shaping reward -2.516 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.267, -89.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 17:33:07,310][177153] Updated weights for policy 0, policy_version 2080 (0.0009) [2023-02-24 17:33:10,229][177153] Updated weights for policy 0, policy_version 2090 (0.0008) [2023-02-24 17:33:10,973][177170] DAMAGECOUNT value on done: 3518.0 [2023-02-24 17:33:10,974][177170] Sum rewards: -9.622, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.900', 'FRAGCOUNT': '-1.000', 'AMMO2': '0.009', 'weapon4': '0.014', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'AMMO3': '0.135', 'HITCOUNT': '0.170', 'weapon5': '0.190', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.636', 'WEAPON3': '0.800', 'weapon2': '1.088', 'weapon3': '1.710'} [2023-02-24 17:33:11,264][177170] DAMAGECOUNT value on done: 5305.0 [2023-02-24 17:33:11,360][177170] DAMAGECOUNT value on done: 3219.0 [2023-02-24 17:33:11,361][177170] Sum rewards: -4.888, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.750', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'weapon4': '0.012', 'weapon5': '0.014', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'ARMOR': '0.068', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'DAMAGECOUNT': '0.264', 'WEAPON3': '0.650', 'weapon3': '0.960', 'FRAGCOUNT': '1.000', 'weapon2': '2.518'} [2023-02-24 17:33:11,368][177154] DAMAGECOUNT value on done: 4735.0 [2023-02-24 17:33:11,369][177154] Sum rewards: -1.000, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.167', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.050', 'AMMO3': '0.059', 'AMMO4': '0.085', 'HITCOUNT': '0.130', 'weapon4': '0.178', 'weapon5': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.528', 'weapon2': '1.380', 'weapon3': '1.448', 'FRAGCOUNT': '2.000'} [2023-02-24 17:33:11,371][177172] DAMAGECOUNT value on done: 3597.0 [2023-02-24 17:33:11,371][177172] Sum rewards: -0.753, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.100', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.030', 'weapon4': '0.038', 'weapon7': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.170', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.480', 'ARMOR': '0.506', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.472', 'weapon2': '1.812'} [2023-02-24 17:33:11,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13448.5, 300 sec: 13926.4). Total num frames: 8577024. Throughput: 0: 3370.4. Samples: 2141480. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:33:11,376][177119] Avg episode reward: [(0, '-3.188')] [2023-02-24 17:33:11,473][177158] DAMAGECOUNT value on done: 5026.0 [2023-02-24 17:33:11,473][177158] Sum rewards: -4.286, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.407', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.022', 'ARMOR': '0.096', 'AMMO4': '0.096', 'HITCOUNT': '0.100', 'weapon4': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.850', 'weapon3': '1.064', 'FRAGCOUNT': '2.000', 'weapon2': '2.080'} [2023-02-24 17:33:11,647][177170] DAMAGECOUNT value on done: 4730.0 [2023-02-24 17:33:11,648][177170] Sum rewards: -1.621, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.098', 'AMMO4': '0.102', 'weapon4': '0.118', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'HEALTH': '0.300', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.600', 'weapon3': '1.420', 'weapon2': '1.728', 'FRAGCOUNT': '2.000'} [2023-02-24 17:33:11,659][177154] DAMAGECOUNT value on done: 3432.0 [2023-02-24 17:33:11,659][177154] Sum rewards: -3.688, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.335', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO5': '0.031', 'weapon4': '0.042', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'weapon5': '0.174', 'HITCOUNT': '0.230', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.690', 'FRAGCOUNT': '1.000', 'weapon3': '1.096', 'weapon2': '1.856'} [2023-02-24 17:33:11,668][177172] DAMAGECOUNT value on done: 3673.0 [2023-02-24 17:33:11,668][177172] Sum rewards: -2.741, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.808', 'ARMOR': '0.020', 'AMMO5': '0.026', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'weapon4': '0.112', 'AMMO3': '0.113', 'AMMO4': '0.129', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'weapon5': '0.232', 'WEAPON5': '0.450', 'DAMAGECOUNT': '0.642', 'WEAPON3': '0.700', 'weapon2': '1.232', 'weapon3': '1.726', 'FRAGCOUNT': '2.000'} [2023-02-24 17:33:11,770][177158] DAMAGECOUNT value on done: 4130.0 [2023-02-24 17:33:11,771][177158] Sum rewards: -3.245, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.842', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.020', 'weapon4': '0.026', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'WEAPON4': '0.100', 'HITCOUNT': '0.140', 'AMMO3': '0.179', 'weapon5': '0.238', 'WEAPON5': '0.250', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.161', 'weapon3': '1.514', 'weapon2': '1.606', 'FRAGCOUNT': '2.000'} [2023-02-24 17:33:11,945][177158] DAMAGECOUNT value on done: 3397.0 [2023-02-24 17:33:11,945][177158] Sum rewards: -1.573, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.091', 'AMMO2': '0.001', 'AMMO4': '0.002', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'ARMOR': '0.036', 'weapon5': '0.054', 'HITCOUNT': '0.070', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'weapon4': '0.228', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.168', 'weapon2': '1.424'} [2023-02-24 17:33:11,958][177154] DAMAGECOUNT value on done: 5015.0 [2023-02-24 17:33:11,959][177154] Sum rewards: -1.240, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.330', 'AMMO5': '0.014', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.024', 'weapon4': '0.038', 'ARMOR': '0.076', 'AMMO4': '0.085', 'AMMO3': '0.124', 'HITCOUNT': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.612', 'WEAPON3': '0.650', 'weapon3': '1.156', 'weapon2': '2.124', 'FRAGCOUNT': '4.000'} [2023-02-24 17:33:12,239][177158] DAMAGECOUNT value on done: 3146.0 [2023-02-24 17:33:12,239][177158] Sum rewards: -4.804, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-2.000', 'HEALTH': '-1.334', 'AMMO2': '0.012', 'HITCOUNT': '0.020', 'AMMO5': '0.024', 'ARMOR': '0.036', 'WEAPON1': '0.050', 'AMMO4': '0.059', 'weapon4': '0.070', 'AMMO3': '0.133', 'weapon5': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.550', 'weapon3': '1.014', 'weapon2': '2.048'} [2023-02-24 17:33:12,250][177154] DAMAGECOUNT value on done: 4640.0 [2023-02-24 17:33:12,251][177154] Sum rewards: -6.390, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.500', 'FRAGCOUNT': '-1.000', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.019', 'weapon4': '0.020', 'ARMOR': '0.036', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon5': '0.108', 'AMMO3': '0.129', 'HITCOUNT': '0.170', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon3': '1.084', 'DAMAGECOUNT': '1.101', 'weapon2': '2.098'} [2023-02-24 17:33:12,258][177171] DAMAGECOUNT value on done: 3640.0 [2023-02-24 17:33:12,268][177157] DAMAGECOUNT value on done: 4393.0 [2023-02-24 17:33:12,269][177157] Sum rewards: -2.300, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.816', 'AMMO5': '0.003', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'weapon4': '0.014', 'AMMO4': '0.023', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'weapon7': '0.066', 'HITCOUNT': '0.090', 'AMMO3': '0.093', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.237', 'WEAPON3': '0.550', 'weapon3': '1.190', 'weapon2': '1.810', 'FRAGCOUNT': '2.000'} [2023-02-24 17:33:12,315][177172] DAMAGECOUNT value on done: 2992.0 [2023-02-24 17:33:12,316][177172] Sum rewards: -3.859, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.640', 'AMMO2': '0.001', 'AMMO4': '0.006', 'weapon5': '0.010', 'ARMOR': '0.016', 'AMMO5': '0.025', 'weapon4': '0.056', 'HITCOUNT': '0.070', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.186', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'weapon3': '1.480', 'weapon2': '1.846', 'FRAGCOUNT': '2.000'} [2023-02-24 17:33:12,473][177155] DAMAGECOUNT value on done: 3492.0 [2023-02-24 17:33:12,473][177155] Sum rewards: -3.055, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.800', 'AMMO5': '0.011', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'AMMO3': '0.109', 'AMMO4': '0.144', 'HITCOUNT': '0.150', 'weapon5': '0.150', 'weapon4': '0.150', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.402', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.138', 'weapon2': '1.792'} [2023-02-24 17:33:12,555][177171] DAMAGECOUNT value on done: 4037.0 [2023-02-24 17:33:12,555][177171] Sum rewards: -6.022, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.906', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'weapon4': '0.006', 'AMMO5': '0.017', 'weapon5': '0.032', 'WEAPON1': '0.050', 'ARMOR': '0.056', 'WEAPON4': '0.100', 'HITCOUNT': '0.140', 'AMMO3': '0.150', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.735', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.508', 'weapon2': '1.876'} [2023-02-24 17:33:12,562][177157] DAMAGECOUNT value on done: 4657.0 [2023-02-24 17:33:12,563][177157] Sum rewards: -3.853, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.120', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.010', 'weapon5': '0.018', 'ARMOR': '0.085', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.169', 'weapon4': '0.212', 'HITCOUNT': '0.370', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.392', 'weapon3': '1.530', 'weapon2': '1.724', 'FRAGCOUNT': '2.000'} [2023-02-24 17:33:12,572][177157] DAMAGECOUNT value on done: 4340.0 [2023-02-24 17:33:12,573][177157] Sum rewards: -2.142, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.642', 'AMMO2': '0.015', 'AMMO5': '0.017', 'ARMOR': '0.024', 'WEAPON1': '0.040', 'AMMO4': '0.077', 'weapon5': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon4': '0.222', 'HITCOUNT': '0.240', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.234', 'weapon2': '1.876'} [2023-02-24 17:33:12,603][177172] DAMAGECOUNT value on done: 3791.0 [2023-02-24 17:33:12,603][177172] Sum rewards: -3.245, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon5': '0.038', 'ARMOR': '0.052', 'weapon4': '0.078', 'AMMO3': '0.090', 'AMMO4': '0.130', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.220', 'HEALTH': '0.350', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.864', 'weapon3': '1.096', 'FRAGCOUNT': '2.000', 'weapon2': '2.180'} [2023-02-24 17:33:12,770][177155] DAMAGECOUNT value on done: 5404.0 [2023-02-24 17:33:12,770][177155] Sum rewards: -1.500, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.695', 'AMMO2': '0.014', 'AMMO5': '0.025', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'weapon5': '0.038', 'AMMO4': '0.069', 'weapon4': '0.088', 'AMMO3': '0.124', 'WEAPON4': '0.200', 'HITCOUNT': '0.310', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.185', 'weapon3': '1.336', 'weapon2': '1.844', 'FRAGCOUNT': '2.000'} [2023-02-24 17:33:12,854][177171] DAMAGECOUNT value on done: 4361.0 [2023-02-24 17:33:12,854][177171] Sum rewards: -1.564, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.018', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'HITCOUNT': '0.150', 'weapon5': '0.154', 'WEAPON3': '0.600', 'HEALTH': '0.628', 'DAMAGECOUNT': '0.642', 'weapon3': '1.134', 'weapon2': '1.646', 'FRAGCOUNT': '2.000'} [2023-02-24 17:33:12,866][177157] DAMAGECOUNT value on done: 3654.0 [2023-02-24 17:33:12,866][177157] Sum rewards: -2.299, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.697', 'AMMO2': '0.018', 'AMMO5': '0.022', 'weapon5': '0.026', 'ARMOR': '0.032', 'AMMO4': '0.089', 'AMMO3': '0.153', 'HITCOUNT': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.308', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.675', 'FRAGCOUNT': '1.000', 'weapon3': '1.260', 'weapon2': '1.604'} [2023-02-24 17:33:13,021][177155] DAMAGECOUNT value on done: 4391.0 [2023-02-24 17:33:13,021][177155] Sum rewards: -2.018, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.370', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'weapon5': '0.026', 'AMMO2': '0.027', 'ARMOR': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.114', 'HITCOUNT': '0.130', 'AMMO4': '0.133', 'AMMO3': '0.135', 'weapon4': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.444', 'WEAPON3': '0.650', 'weapon3': '0.976', 'FRAGCOUNT': '1.000', 'weapon2': '2.016'} [2023-02-24 17:33:13,127][177153] Updated weights for policy 0, policy_version 2100 (0.0009) [2023-02-24 17:33:13,149][177171] DAMAGECOUNT value on done: 4058.0 [2023-02-24 17:33:13,150][177171] Sum rewards: -1.470, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.403', 'weapon5': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.015', 'ARMOR': '0.060', 'weapon7': '0.066', 'AMMO4': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.138', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'HITCOUNT': '0.260', 'WEAPON4': '0.300', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.861', 'FRAGCOUNT': '1.000', 'weapon3': '1.422', 'weapon2': '1.796'} [2023-02-24 17:33:13,315][177155] DAMAGECOUNT value on done: 3512.0 [2023-02-24 17:33:13,316][177155] Sum rewards: -1.811, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.152', 'AMMO2': '0.002', 'AMMO5': '0.008', 'AMMO4': '0.010', 'weapon4': '0.030', 'WEAPON1': '0.040', 'weapon5': '0.068', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.186', 'weapon2': '1.702'} [2023-02-24 17:33:14,050][177156] DAMAGECOUNT value on done: 3843.0 [2023-02-24 17:33:14,347][177156] DAMAGECOUNT value on done: 4554.0 [2023-02-24 17:33:14,602][177156] DAMAGECOUNT value on done: 3482.0 [2023-02-24 17:33:14,602][177156] Sum rewards: -2.887, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.390', 'weapon4': '0.002', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.160', 'weapon5': '0.250', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.735', 'weapon3': '1.126', 'weapon2': '1.704'} [2023-02-24 17:33:14,896][177156] DAMAGECOUNT value on done: 3785.0 [2023-02-24 17:33:15,972][177153] Updated weights for policy 0, policy_version 2110 (0.0008) [2023-02-24 17:33:16,376][177119] Fps is (10 sec: 14336.4, 60 sec: 13448.5, 300 sec: 13926.4). Total num frames: 8646656. Throughput: 0: 3446.2. Samples: 2162754. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:33:16,376][177119] Avg episode reward: [(0, '-2.989')] [2023-02-24 17:33:16,380][177140] Saving new best policy, reward=-2.989! [2023-02-24 17:33:18,846][177153] Updated weights for policy 0, policy_version 2120 (0.0008) [2023-02-24 17:33:21,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13516.8, 300 sec: 13912.5). Total num frames: 8716288. Throughput: 0: 3463.5. Samples: 2173416. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:33:21,376][177119] Avg episode reward: [(0, '-2.989')] [2023-02-24 17:33:21,746][177153] Updated weights for policy 0, policy_version 2130 (0.0008) [2023-02-24 17:33:24,658][177153] Updated weights for policy 0, policy_version 2140 (0.0009) [2023-02-24 17:33:26,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13653.3, 300 sec: 13912.5). Total num frames: 8785920. Throughput: 0: 3485.3. Samples: 2194596. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:33:26,376][177119] Avg episode reward: [(0, '-2.989')] [2023-02-24 17:33:27,557][177153] Updated weights for policy 0, policy_version 2150 (0.0008) [2023-02-24 17:33:29,825][177170] DAMAGECOUNT value on done: 3802.0 [2023-02-24 17:33:29,825][177170] Sum rewards: -1.848, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.750', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.010', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'weapon5': '0.112', 'AMMO3': '0.127', 'HITCOUNT': '0.240', 'WEAPON5': '0.250', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.852', 'weapon3': '1.120', 'weapon2': '1.592', 'FRAGCOUNT': '2.000'} [2023-02-24 17:33:30,128][177170] DAMAGECOUNT value on done: 5601.0 [2023-02-24 17:33:30,129][177170] Sum rewards: -0.908, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.158', 'AMMO5': '0.007', 'weapon5': '0.028', 'AMMO2': '0.042', 'ARMOR': '0.080', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'HITCOUNT': '0.180', 'AMMO4': '0.208', 'weapon4': '0.384', 'WEAPON4': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.888', 'FRAGCOUNT': '1.000', 'weapon3': '1.134', 'weapon2': '1.656'} [2023-02-24 17:33:30,225][177170] DAMAGECOUNT value on done: 3504.0 [2023-02-24 17:33:30,226][177170] Sum rewards: -1.200, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.010', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon4': '0.026', 'AMMO4': '0.048', 'ARMOR': '0.049', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon5': '0.100', 'HITCOUNT': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.300', 'HEALTH': '0.332', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.855', 'weapon3': '0.896', 'weapon2': '1.944'} [2023-02-24 17:33:30,304][177172] DAMAGECOUNT value on done: 3759.0 [2023-02-24 17:33:30,320][177154] DAMAGECOUNT value on done: 4764.0 [2023-02-24 17:33:30,321][177154] Sum rewards: -5.189, reward structure: {'DEATHCOUNT': '-5.250', 'FRAGCOUNT': '-3.000', 'HEALTH': '-1.050', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'weapon4': '0.022', 'HITCOUNT': '0.030', 'WEAPON1': '0.040', 'AMMO3': '0.068', 'DAMAGECOUNT': '0.087', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'WEAPON3': '0.450', 'ARMOR': '0.532', 'weapon3': '0.896', 'weapon2': '1.590'} [2023-02-24 17:33:30,462][177153] Updated weights for policy 0, policy_version 2160 (0.0008) [2023-02-24 17:33:30,488][177158] DAMAGECOUNT value on done: 5212.0 [2023-02-24 17:33:30,511][177170] DAMAGECOUNT value on done: 4815.0 [2023-02-24 17:33:30,512][177170] Sum rewards: -4.763, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.995', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO4': '0.022', 'ARMOR': '0.036', 'AMMO3': '0.077', 'HITCOUNT': '0.100', 'weapon5': '0.110', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.255', 'WEAPON3': '0.350', 'weapon3': '1.448', 'weapon2': '1.808'} [2023-02-24 17:33:30,603][177172] DAMAGECOUNT value on done: 3878.0 [2023-02-24 17:33:30,619][177154] DAMAGECOUNT value on done: 3587.0 [2023-02-24 17:33:30,619][177154] Sum rewards: -2.788, reward structure: {'DEATHCOUNT': '-5.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.858', 'AMMO5': '0.010', 'weapon4': '0.016', 'AMMO2': '0.019', 'ARMOR': '0.036', 'AMMO3': '0.061', 'WEAPON1': '0.070', 'AMMO4': '0.096', 'weapon5': '0.102', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.465', 'weapon3': '1.270', 'weapon2': '1.664'} [2023-02-24 17:33:30,785][177158] DAMAGECOUNT value on done: 4475.0 [2023-02-24 17:33:30,785][177158] Sum rewards: -1.235, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.696', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.038', 'WEAPON1': '0.040', 'WEAPON5': '0.050', 'ARMOR': '0.108', 'AMMO3': '0.110', 'weapon4': '0.114', 'HITCOUNT': '0.180', 'AMMO4': '0.191', 'WEAPON4': '0.400', 'WEAPON3': '0.550', 'weapon3': '0.870', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.035', 'weapon2': '2.264'} [2023-02-24 17:33:30,922][177154] DAMAGECOUNT value on done: 5400.0 [2023-02-24 17:33:30,923][177154] Sum rewards: -8.234, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.437', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.011', 'WEAPON1': '0.050', 'weapon5': '0.062', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'HITCOUNT': '0.300', 'WEAPON3': '1.150', 'DAMAGECOUNT': '1.155', 'weapon3': '1.340', 'weapon2': '1.432', 'FRAGCOUNT': '2.000'} [2023-02-24 17:33:30,953][177158] DAMAGECOUNT value on done: 3502.0 [2023-02-24 17:33:31,222][177154] DAMAGECOUNT value on done: 4872.0 [2023-02-24 17:33:31,222][177154] Sum rewards: -3.361, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.666', 'weapon7': '0.002', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'ARMOR': '0.032', 'weapon5': '0.054', 'weapon4': '0.114', 'AMMO4': '0.118', 'AMMO3': '0.135', 'HITCOUNT': '0.170', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.696', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.150', 'weapon2': '1.780'} [2023-02-24 17:33:31,246][177158] DAMAGECOUNT value on done: 3359.0 [2023-02-24 17:33:31,246][177158] Sum rewards: -2.814, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.696', 'AMMO2': '0.009', 'AMMO5': '0.024', 'AMMO4': '0.046', 'WEAPON1': '0.050', 'AMMO3': '0.107', 'HITCOUNT': '0.140', 'weapon5': '0.196', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.639', 'FRAGCOUNT': '1.000', 'weapon3': '1.122', 'weapon2': '1.798'} [2023-02-24 17:33:31,263][177172] DAMAGECOUNT value on done: 3062.0 [2023-02-24 17:33:31,297][177171] DAMAGECOUNT value on done: 3768.0 [2023-02-24 17:33:31,324][177157] DAMAGECOUNT value on done: 4502.0 [2023-02-24 17:33:31,325][177157] Sum rewards: -2.759, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.952', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'weapon4': '0.006', 'AMMO5': '0.012', 'ARMOR': '0.032', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'HITCOUNT': '0.120', 'AMMO3': '0.146', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.327', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.038', 'weapon2': '2.060'} [2023-02-24 17:33:31,376][177119] Fps is (10 sec: 14335.9, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 8859648. Throughput: 0: 3492.4. Samples: 2215734. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:33:31,376][177119] Avg episode reward: [(0, '-2.957')] [2023-02-24 17:33:31,377][177140] Saving new best policy, reward=-2.957! [2023-02-24 17:33:31,544][177155] DAMAGECOUNT value on done: 3665.0 [2023-02-24 17:33:31,566][177172] DAMAGECOUNT value on done: 4125.0 [2023-02-24 17:33:31,566][177172] Sum rewards: -3.026, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.840', 'AMMO5': '0.018', 'AMMO2': '0.028', 'WEAPON1': '0.050', 'weapon5': '0.074', 'AMMO3': '0.135', 'AMMO4': '0.141', 'weapon4': '0.224', 'HITCOUNT': '0.250', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.002', 'ARMOR': '1.034', 'weapon3': '1.076', 'weapon2': '1.882', 'FRAGCOUNT': '2.000'} [2023-02-24 17:33:31,611][177171] DAMAGECOUNT value on done: 4262.0 [2023-02-24 17:33:31,621][177157] DAMAGECOUNT value on done: 4822.0 [2023-02-24 17:33:31,622][177157] Sum rewards: -4.309, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.840', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'HITCOUNT': '0.130', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.500', 'weapon3': '1.466', 'weapon2': '1.644'} [2023-02-24 17:33:31,632][177157] DAMAGECOUNT value on done: 4410.0 [2023-02-24 17:33:31,843][177155] DAMAGECOUNT value on done: 5621.0 [2023-02-24 17:33:31,914][177171] DAMAGECOUNT value on done: 4651.0 [2023-02-24 17:33:31,915][177171] Sum rewards: -3.109, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.720', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.017', 'weapon5': '0.036', 'AMMO4': '0.087', 'weapon4': '0.088', 'AMMO3': '0.133', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.855', 'weapon3': '1.290', 'weapon2': '1.814', 'FRAGCOUNT': '2.000'} [2023-02-24 17:33:31,931][177157] DAMAGECOUNT value on done: 3949.0 [2023-02-24 17:33:31,931][177157] Sum rewards: -1.676, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.660', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'weapon4': '0.016', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon5': '0.090', 'AMMO3': '0.093', 'WEAPON5': '0.150', 'HITCOUNT': '0.220', 'WEAPON3': '0.500', 'weapon3': '0.858', 'DAMAGECOUNT': '0.885', 'FRAGCOUNT': '2.000', 'weapon2': '2.364'} [2023-02-24 17:33:32,121][177155] DAMAGECOUNT value on done: 4525.0 [2023-02-24 17:33:32,206][177171] DAMAGECOUNT value on done: 4273.0 [2023-02-24 17:33:32,207][177171] Sum rewards: -5.583, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.160', 'AMMO5': '0.013', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'weapon4': '0.046', 'weapon5': '0.074', 'ARMOR': '0.076', 'AMMO4': '0.117', 'HITCOUNT': '0.120', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.645', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.050', 'weapon3': '1.400', 'weapon2': '1.802'} [2023-02-24 17:33:32,415][177155] DAMAGECOUNT value on done: 3701.0 [2023-02-24 17:33:32,416][177155] Sum rewards: -7.203, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.656', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.002', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.010', 'weapon4': '0.020', 'WEAPON4': '0.050', 'ARMOR': '0.060', 'weapon5': '0.072', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'DAMAGECOUNT': '0.567', 'WEAPON3': '1.000', 'weapon3': '1.426', 'weapon2': '1.844'} [2023-02-24 17:33:33,053][177156] DAMAGECOUNT value on done: 4223.0 [2023-02-24 17:33:33,054][177156] Sum rewards: -5.461, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.826', 'FRAGCOUNT': '-0.500', 'weapon4': '0.012', 'AMMO2': '0.014', 'ARMOR': '0.032', 'AMMO5': '0.033', 'weapon5': '0.044', 'WEAPON1': '0.060', 'AMMO4': '0.069', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'HITCOUNT': '0.300', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.140', 'weapon3': '1.498', 'weapon2': '1.594'} [2023-02-24 17:33:33,348][177156] DAMAGECOUNT value on done: 4832.0 [2023-02-24 17:33:33,349][177156] Sum rewards: -4.223, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.932', 'weapon5': '0.002', 'AMMO5': '0.015', 'AMMO2': '0.020', 'ARMOR': '0.028', 'WEAPON1': '0.040', 'weapon4': '0.040', 'WEAPON4': '0.100', 'AMMO4': '0.100', 'AMMO3': '0.133', 'WEAPON5': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.834', 'weapon3': '1.334', 'weapon2': '2.072', 'FRAGCOUNT': '3.000'} [2023-02-24 17:33:33,390][177153] Updated weights for policy 0, policy_version 2170 (0.0008) [2023-02-24 17:33:33,594][177156] DAMAGECOUNT value on done: 3552.0 [2023-02-24 17:33:33,595][177156] Sum rewards: -2.705, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.405', 'AMMO5': '0.009', 'AMMO2': '0.010', 'WEAPON1': '0.040', 'AMMO4': '0.052', 'weapon5': '0.068', 'HITCOUNT': '0.070', 'AMMO3': '0.099', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.210', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.180', 'weapon3': '1.212'} [2023-02-24 17:33:33,881][177156] DAMAGECOUNT value on done: 3899.0 [2023-02-24 17:33:33,881][177156] Sum rewards: -7.262, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.144', 'AMMO5': '0.015', 'weapon5': '0.016', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon4': '0.026', 'ARMOR': '0.047', 'AMMO4': '0.093', 'HITCOUNT': '0.110', 'AMMO3': '0.126', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.342', 'WEAPON3': '0.700', 'weapon3': '1.248', 'weapon2': '1.870'} [2023-02-24 17:33:36,258][177153] Updated weights for policy 0, policy_version 2180 (0.0008) [2023-02-24 17:33:36,376][177119] Fps is (10 sec: 14336.0, 60 sec: 13994.7, 300 sec: 13926.4). Total num frames: 8929280. Throughput: 0: 3505.0. Samples: 2226318. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:33:36,376][177119] Avg episode reward: [(0, '-3.231')] [2023-02-24 17:33:39,145][177153] Updated weights for policy 0, policy_version 2190 (0.0008) [2023-02-24 17:33:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13912.5). Total num frames: 8998912. Throughput: 0: 3511.8. Samples: 2247528. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:33:41,376][177119] Avg episode reward: [(0, '-3.231')] [2023-02-24 17:33:42,027][177153] Updated weights for policy 0, policy_version 2200 (0.0008) [2023-02-24 17:33:44,926][177153] Updated weights for policy 0, policy_version 2210 (0.0008) [2023-02-24 17:33:46,376][177119] Fps is (10 sec: 14335.9, 60 sec: 14062.9, 300 sec: 13926.4). Total num frames: 9072640. Throughput: 0: 3522.4. Samples: 2268778. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:33:46,376][177119] Avg episode reward: [(0, '-3.231')] [2023-02-24 17:33:47,816][177153] Updated weights for policy 0, policy_version 2220 (0.0008) [2023-02-24 17:33:48,790][177170] DAMAGECOUNT value on done: 3952.0 [2023-02-24 17:33:48,791][177170] Sum rewards: -5.178, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.479', 'AMMO5': '0.005', 'weapon5': '0.010', 'WEAPON1': '0.020', 'weapon4': '0.032', 'AMMO2': '0.036', 'ARMOR': '0.052', 'WEAPON5': '0.100', 'weapon7': '0.100', 'AMMO3': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.130', 'AMMO4': '0.181', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.216', 'weapon2': '2.068'} [2023-02-24 17:33:49,090][177170] DAMAGECOUNT value on done: 5601.0 [2023-02-24 17:33:49,181][177170] DAMAGECOUNT value on done: 3968.0 [2023-02-24 17:33:49,181][177170] Sum rewards: -0.493, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.582', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'ARMOR': '0.076', 'weapon4': '0.088', 'AMMO3': '0.091', 'weapon5': '0.134', 'WEAPON4': '0.150', 'HITCOUNT': '0.260', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'weapon3': '1.230', 'DAMAGECOUNT': '1.392', 'weapon2': '1.666', 'FRAGCOUNT': '2.500'} [2023-02-24 17:33:49,288][177154] DAMAGECOUNT value on done: 4876.0 [2023-02-24 17:33:49,288][177154] Sum rewards: -3.782, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.846', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'ARMOR': '0.032', 'AMMO4': '0.048', 'weapon5': '0.062', 'weapon4': '0.064', 'HITCOUNT': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.336', 'weapon3': '0.748', 'WEAPON3': '0.750', 'FRAGCOUNT': '2.000', 'weapon2': '2.076'} [2023-02-24 17:33:49,364][177172] DAMAGECOUNT value on done: 4064.0 [2023-02-24 17:33:49,365][177172] Sum rewards: -2.459, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.526', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.022', 'WEAPON1': '0.030', 'weapon5': '0.050', 'ARMOR': '0.056', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'HITCOUNT': '0.200', 'WEAPON3': '0.900', 'DAMAGECOUNT': '0.915', 'weapon3': '1.182', 'weapon2': '1.982', 'FRAGCOUNT': '3.000'} [2023-02-24 17:33:49,461][177158] DAMAGECOUNT value on done: 5527.0 [2023-02-24 17:33:49,462][177158] Sum rewards: -3.504, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.860', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'weapon4': '0.006', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.100', 'AMMO3': '0.149', 'HITCOUNT': '0.260', 'WEAPON5': '0.350', 'ARMOR': '0.505', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.945', 'weapon3': '1.064', 'weapon2': '2.078', 'FRAGCOUNT': '4.000'} [2023-02-24 17:33:49,478][177170] DAMAGECOUNT value on done: 5049.0 [2023-02-24 17:33:49,593][177154] DAMAGECOUNT value on done: 3894.0 [2023-02-24 17:33:49,593][177154] Sum rewards: -3.844, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.471', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO5': '0.017', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.060', 'weapon5': '0.134', 'AMMO3': '0.141', 'HITCOUNT': '0.170', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.921', 'FRAGCOUNT': '1.000', 'weapon3': '1.048', 'weapon2': '1.574'} [2023-02-24 17:33:49,666][177172] DAMAGECOUNT value on done: 4248.0 [2023-02-24 17:33:49,667][177172] Sum rewards: -3.595, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.461', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.042', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'HITCOUNT': '0.250', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.550', 'weapon3': '0.854', 'DAMAGECOUNT': '1.110', 'weapon2': '2.272'} [2023-02-24 17:33:49,759][177158] DAMAGECOUNT value on done: 4787.0 [2023-02-24 17:33:49,760][177158] Sum rewards: 0.271, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.014', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'weapon4': '0.086', 'AMMO3': '0.105', 'AMMO4': '0.106', 'weapon5': '0.130', 'HITCOUNT': '0.180', 'HEALTH': '0.212', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.936', 'FRAGCOUNT': '1.000', 'weapon2': '1.212', 'weapon3': '1.908'} [2023-02-24 17:33:49,885][177154] DAMAGECOUNT value on done: 5431.0 [2023-02-24 17:33:49,943][177158] DAMAGECOUNT value on done: 3536.0 [2023-02-24 17:33:49,944][177158] Sum rewards: -11.325, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.727', 'FRAGCOUNT': '-1.500', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.034', 'weapon5': '0.036', 'HITCOUNT': '0.040', 'ARMOR': '0.076', 'DAMAGECOUNT': '0.102', 'AMMO4': '0.149', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon3': '0.842', 'WEAPON3': '1.050', 'weapon2': '2.380'} [2023-02-24 17:33:50,186][177154] DAMAGECOUNT value on done: 5073.0 [2023-02-24 17:33:50,186][177154] Sum rewards: -0.272, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'AMMO2': '0.013', 'ARMOR': '0.020', 'WEAPON1': '0.040', 'weapon4': '0.044', 'AMMO4': '0.062', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'HITCOUNT': '0.160', 'weapon5': '0.164', 'WEAPON5': '0.200', 'WEAPON3': '0.350', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.603', 'HEALTH': '0.634', 'weapon3': '0.920', 'weapon2': '1.840'} [2023-02-24 17:33:50,246][177158] DAMAGECOUNT value on done: 4384.0 [2023-02-24 17:33:50,246][177158] Sum rewards: 2.783, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.780', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.034', 'ARMOR': '0.085', 'weapon4': '0.098', 'AMMO3': '0.122', 'weapon7': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.290', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.800', 'weapon3': '1.272', 'weapon2': '1.708', 'DAMAGECOUNT': '1.875', 'FRAGCOUNT': '5.000'} [2023-02-24 17:33:50,328][177172] DAMAGECOUNT value on done: 3182.0 [2023-02-24 17:33:50,329][177172] Sum rewards: -8.199, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.052', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO5': '0.022', 'weapon4': '0.040', 'ARMOR': '0.072', 'AMMO4': '0.092', 'HITCOUNT': '0.100', 'weapon5': '0.130', 'AMMO3': '0.142', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.360', 'weapon3': '0.732', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '2.484'} [2023-02-24 17:33:50,334][177171] DAMAGECOUNT value on done: 4247.0 [2023-02-24 17:33:50,335][177171] Sum rewards: -3.308, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.382', 'weapon4': '0.012', 'AMMO2': '0.014', 'AMMO5': '0.015', 'ARMOR': '0.028', 'WEAPON1': '0.050', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'weapon5': '0.110', 'AMMO3': '0.140', 'HITCOUNT': '0.220', 'WEAPON5': '0.250', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.800', 'weapon2': '1.432', 'DAMAGECOUNT': '1.437', 'weapon3': '1.644'} [2023-02-24 17:33:50,457][177157] DAMAGECOUNT value on done: 4617.0 [2023-02-24 17:33:50,458][177157] Sum rewards: -5.719, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.930', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.014', 'WEAPON1': '0.030', 'weapon4': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.078', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.450', 'weapon3': '1.304', 'weapon2': '1.722'} [2023-02-24 17:33:50,539][177155] DAMAGECOUNT value on done: 3815.0 [2023-02-24 17:33:50,539][177155] Sum rewards: -3.848, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.014', 'weapon5': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.020', 'AMMO4': '0.053', 'ARMOR': '0.056', 'weapon4': '0.096', 'HITCOUNT': '0.130', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.600', 'weapon3': '1.202', 'FRAGCOUNT': '2.000', 'weapon2': '2.200'} [2023-02-24 17:33:50,632][177172] DAMAGECOUNT value on done: 4467.0 [2023-02-24 17:33:50,633][177172] Sum rewards: -7.712, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.200', 'AMMO5': '0.023', 'AMMO2': '0.024', 'ARMOR': '0.059', 'WEAPON1': '0.060', 'weapon4': '0.088', 'weapon5': '0.096', 'AMMO4': '0.118', 'AMMO3': '0.195', 'HITCOUNT': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.026', 'weapon3': '1.136', 'FRAGCOUNT': '2.000', 'weapon2': '2.084'} [2023-02-24 17:33:50,651][177171] DAMAGECOUNT value on done: 4418.0 [2023-02-24 17:33:50,651][177171] Sum rewards: -3.710, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.214', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'HITCOUNT': '0.050', 'ARMOR': '0.052', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.114', 'weapon4': '0.156', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.468', 'WEAPON3': '0.650', 'weapon3': '1.142', 'weapon2': '2.002'} [2023-02-24 17:33:50,748][177153] Updated weights for policy 0, policy_version 2230 (0.0008) [2023-02-24 17:33:50,757][177157] DAMAGECOUNT value on done: 5131.0 [2023-02-24 17:33:50,758][177157] Sum rewards: -5.173, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.626', 'AMMO2': '0.020', 'AMMO5': '0.025', 'ARMOR': '0.052', 'WEAPON1': '0.070', 'AMMO3': '0.086', 'AMMO4': '0.101', 'weapon4': '0.108', 'HITCOUNT': '0.210', 'weapon5': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.927', 'weapon3': '1.080', 'weapon2': '1.758'} [2023-02-24 17:33:50,766][177157] DAMAGECOUNT value on done: 4784.0 [2023-02-24 17:33:50,767][177157] Sum rewards: 0.285, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.638', 'AMMO2': '0.002', 'AMMO5': '0.010', 'AMMO4': '0.010', 'weapon4': '0.022', 'ARMOR': '0.024', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon5': '0.076', 'AMMO3': '0.082', 'HITCOUNT': '0.210', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.122', 'weapon3': '1.380', 'weapon2': '1.454', 'FRAGCOUNT': '2.500'} [2023-02-24 17:33:50,839][177155] DAMAGECOUNT value on done: 5753.0 [2023-02-24 17:33:50,946][177171] DAMAGECOUNT value on done: 5050.0 [2023-02-24 17:33:50,946][177171] Sum rewards: -5.933, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.065', 'AMMO2': '0.011', 'AMMO5': '0.016', 'WEAPON1': '0.040', 'AMMO4': '0.052', 'weapon5': '0.098', 'AMMO3': '0.130', 'HITCOUNT': '0.140', 'weapon4': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.197', 'weapon2': '1.516', 'weapon3': '1.530'} [2023-02-24 17:33:51,060][177157] DAMAGECOUNT value on done: 3997.0 [2023-02-24 17:33:51,118][177155] DAMAGECOUNT value on done: 4635.0 [2023-02-24 17:33:51,118][177155] Sum rewards: -7.453, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.640', 'FRAGCOUNT': '-0.500', 'weapon5': '0.010', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.137', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'weapon4': '0.196', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.750', 'weapon3': '1.042', 'weapon2': '2.132'} [2023-02-24 17:33:51,239][177171] DAMAGECOUNT value on done: 4876.0 [2023-02-24 17:33:51,239][177171] Sum rewards: 0.540, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.634', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'AMMO2': '0.020', 'weapon5': '0.064', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'HITCOUNT': '0.370', 'WEAPON3': '1.000', 'weapon3': '1.528', 'weapon2': '1.646', 'DAMAGECOUNT': '1.809', 'FRAGCOUNT': '5.000'} [2023-02-24 17:33:51,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14062.9, 300 sec: 13926.4). Total num frames: 9142272. Throughput: 0: 3534.5. Samples: 2279420. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:33:51,376][177119] Avg episode reward: [(0, '-3.356')] [2023-02-24 17:33:51,408][177155] DAMAGECOUNT value on done: 3943.0 [2023-02-24 17:33:51,409][177155] Sum rewards: -7.257, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.392', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'weapon4': '0.018', 'ARMOR': '0.048', 'AMMO4': '0.072', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO3': '0.140', 'DAMAGECOUNT': '0.726', 'WEAPON3': '0.750', 'weapon3': '0.758', 'weapon2': '2.194'} [2023-02-24 17:33:52,086][177156] DAMAGECOUNT value on done: 4305.0 [2023-02-24 17:33:52,087][177156] Sum rewards: -3.107, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.716', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon5': '0.052', 'ARMOR': '0.065', 'AMMO4': '0.076', 'AMMO3': '0.081', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.184', 'DAMAGECOUNT': '0.246', 'WEAPON3': '0.450', 'weapon3': '0.948', 'FRAGCOUNT': '1.000', 'weapon2': '1.634'} [2023-02-24 17:33:52,381][177156] DAMAGECOUNT value on done: 5010.0 [2023-02-24 17:33:52,630][177156] DAMAGECOUNT value on done: 4216.0 [2023-02-24 17:33:52,631][177156] Sum rewards: 1.124, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.250', 'weapon4': '0.012', 'AMMO2': '0.026', 'AMMO5': '0.027', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.094', 'AMMO4': '0.127', 'weapon5': '0.218', 'HITCOUNT': '0.290', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon3': '1.176', 'weapon2': '1.862', 'DAMAGECOUNT': '1.992', 'FRAGCOUNT': '2.000'} [2023-02-24 17:33:52,925][177156] DAMAGECOUNT value on done: 4353.0 [2023-02-24 17:33:52,926][177156] Sum rewards: 1.490, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.464', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.015', 'ARMOR': '0.016', 'weapon5': '0.056', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'WEAPON4': '0.200', 'HITCOUNT': '0.260', 'WEAPON3': '0.700', 'weapon3': '1.282', 'DAMAGECOUNT': '1.362', 'weapon2': '2.002', 'FRAGCOUNT': '4.000'} [2023-02-24 17:33:53,621][177153] Updated weights for policy 0, policy_version 2240 (0.0008) [2023-02-24 17:33:56,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 13926.4). Total num frames: 9211904. Throughput: 0: 3536.0. Samples: 2300598. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:33:56,376][177119] Avg episode reward: [(0, '-3.407')] [2023-02-24 17:33:56,501][177153] Updated weights for policy 0, policy_version 2250 (0.0008) [2023-02-24 17:33:59,408][177153] Updated weights for policy 0, policy_version 2260 (0.0008) [2023-02-24 17:34:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 13912.5). Total num frames: 9281536. Throughput: 0: 3536.1. Samples: 2321878. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:34:01,376][177119] Avg episode reward: [(0, '-3.407')] [2023-02-24 17:34:01,976][177170] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 17:34:02,309][177153] Updated weights for policy 0, policy_version 2270 (0.0009) [2023-02-24 17:34:05,202][177153] Updated weights for policy 0, policy_version 2280 (0.0008) [2023-02-24 17:34:06,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14199.5, 300 sec: 13926.4). Total num frames: 9355264. Throughput: 0: 3534.0. Samples: 2332444. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:34:06,376][177119] Avg episode reward: [(0, '-3.407')] [2023-02-24 17:34:07,717][177170] DAMAGECOUNT value on done: 4187.0 [2023-02-24 17:34:07,718][177170] Sum rewards: -5.394, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.092', 'AMMO5': '0.015', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'weapon4': '0.030', 'ARMOR': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.112', 'HITCOUNT': '0.140', 'weapon5': '0.158', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.705', 'weapon3': '1.074', 'FRAGCOUNT': '2.000', 'weapon2': '2.310'} [2023-02-24 17:34:08,013][177170] DAMAGECOUNT value on done: 6103.0 [2023-02-24 17:34:08,014][177170] Sum rewards: -0.742, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.922', 'weapon4': '0.006', 'AMMO5': '0.017', 'AMMO2': '0.020', 'weapon7': '0.064', 'ARMOR': '0.076', 'WEAPON1': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.101', 'weapon5': '0.112', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'HITCOUNT': '0.230', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'weapon3': '1.108', 'DAMAGECOUNT': '1.260', 'FRAGCOUNT': '1.500', 'weapon2': '1.622'} [2023-02-24 17:34:08,111][177153] Updated weights for policy 0, policy_version 2290 (0.0009) [2023-02-24 17:34:08,121][177170] DAMAGECOUNT value on done: 4231.0 [2023-02-24 17:34:08,122][177170] Sum rewards: -3.509, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.612', 'AMMO5': '0.009', 'weapon5': '0.018', 'AMMO2': '0.020', 'weapon4': '0.092', 'AMMO4': '0.100', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'HITCOUNT': '0.200', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.789', 'WEAPON3': '0.900', 'weapon3': '1.450', 'weapon2': '1.910', 'FRAGCOUNT': '4.000'} [2023-02-24 17:34:08,256][177172] DAMAGECOUNT value on done: 4416.0 [2023-02-24 17:34:08,256][177172] Sum rewards: -0.946, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.851', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.014', 'ARMOR': '0.036', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'weapon5': '0.110', 'AMMO3': '0.163', 'HITCOUNT': '0.240', 'WEAPON5': '0.350', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.056', 'weapon3': '1.420', 'weapon2': '1.908', 'FRAGCOUNT': '2.000'} [2023-02-24 17:34:08,348][177154] DAMAGECOUNT value on done: 5291.0 [2023-02-24 17:34:08,349][177154] Sum rewards: -0.016, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.309', 'AMMO5': '0.015', 'AMMO2': '0.018', 'weapon5': '0.022', 'weapon4': '0.050', 'WEAPON1': '0.070', 'weapon7': '0.070', 'ARMOR': '0.072', 'AMMO4': '0.091', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.105', 'WEAPON4': '0.200', 'HITCOUNT': '0.260', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'weapon3': '1.076', 'DAMAGECOUNT': '1.245', 'weapon2': '2.098', 'FRAGCOUNT': '3.000'} [2023-02-24 17:34:08,419][177170] DAMAGECOUNT value on done: 5224.0 [2023-02-24 17:34:08,419][177170] Sum rewards: -4.661, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.676', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.015', 'AMMO2': '0.028', 'ARMOR': '0.032', 'weapon5': '0.038', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.056', 'AMMO4': '0.138', 'HITCOUNT': '0.150', 'AMMO3': '0.165', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.525', 'WEAPON3': '0.850', 'weapon3': '1.340', 'weapon2': '1.828'} [2023-02-24 17:34:08,441][177158] DAMAGECOUNT value on done: 5697.0 [2023-02-24 17:34:08,442][177158] Sum rewards: -3.986, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.812', 'weapon4': '0.022', 'AMMO5': '0.023', 'AMMO2': '0.023', 'ARMOR': '0.052', 'WEAPON1': '0.060', 'weapon5': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.115', 'HITCOUNT': '0.150', 'WEAPON5': '0.500', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.556', 'weapon3': '1.726'} [2023-02-24 17:34:08,551][177172] DAMAGECOUNT value on done: 4368.0 [2023-02-24 17:34:08,552][177172] Sum rewards: -6.969, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.990', 'FRAGCOUNT': '-1.500', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO5': '0.020', 'WEAPON1': '0.050', 'ARMOR': '0.069', 'HITCOUNT': '0.110', 'weapon5': '0.114', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.900', 'weapon3': '1.032', 'weapon2': '2.102'} [2023-02-24 17:34:08,647][177154] DAMAGECOUNT value on done: 4239.0 [2023-02-24 17:34:08,647][177154] Sum rewards: 0.318, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.372', 'AMMO2': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon5': '0.016', 'ARMOR': '0.032', 'AMMO4': '0.042', 'AMMO3': '0.147', 'WEAPON5': '0.150', 'HITCOUNT': '0.310', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.035', 'weapon3': '1.416', 'weapon2': '1.814', 'FRAGCOUNT': '4.000'} [2023-02-24 17:34:08,743][177158] DAMAGECOUNT value on done: 4866.0 [2023-02-24 17:34:08,743][177158] Sum rewards: -6.875, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.290', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.027', 'ARMOR': '0.036', 'WEAPON1': '0.050', 'weapon4': '0.078', 'HITCOUNT': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'weapon5': '0.152', 'DAMAGECOUNT': '0.237', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'weapon3': '0.782', 'weapon2': '2.338'} [2023-02-24 17:34:08,936][177158] DAMAGECOUNT value on done: 3982.0 [2023-02-24 17:34:08,937][177158] Sum rewards: 1.052, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.698', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO5': '0.021', 'WEAPON1': '0.040', 'AMMO3': '0.109', 'HITCOUNT': '0.160', 'weapon5': '0.326', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'weapon3': '1.080', 'DAMAGECOUNT': '1.338', 'weapon2': '2.012', 'FRAGCOUNT': '4.000'} [2023-02-24 17:34:08,939][177154] DAMAGECOUNT value on done: 5923.0 [2023-02-24 17:34:08,940][177154] Sum rewards: -1.230, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.818', 'weapon4': '0.010', 'AMMO2': '0.016', 'AMMO5': '0.028', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'WEAPON1': '0.100', 'AMMO3': '0.110', 'weapon5': '0.208', 'HITCOUNT': '0.270', 'ARMOR': '0.465', 'FRAGCOUNT': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'weapon2': '1.412', 'DAMAGECOUNT': '1.476', 'weapon3': '1.762'} [2023-02-24 17:34:09,207][177172] DAMAGECOUNT value on done: 3217.0 [2023-02-24 17:34:09,226][177158] DAMAGECOUNT value on done: 4684.0 [2023-02-24 17:34:09,227][177158] Sum rewards: -1.273, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.161', 'AMMO2': '0.009', 'AMMO5': '0.012', 'AMMO4': '0.047', 'AMMO3': '0.060', 'weapon4': '0.060', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'weapon5': '0.134', 'HITCOUNT': '0.220', 'WEAPON3': '0.300', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.232', 'weapon2': '1.892'} [2023-02-24 17:34:09,234][177154] DAMAGECOUNT value on done: 5502.0 [2023-02-24 17:34:09,235][177154] Sum rewards: 0.671, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.043', 'AMMO2': '0.016', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'weapon4': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.080', 'AMMO3': '0.125', 'weapon5': '0.156', 'WEAPON5': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.287', 'weapon2': '1.614', 'weapon3': '1.652', 'FRAGCOUNT': '2.000'} [2023-02-24 17:34:09,378][177171] DAMAGECOUNT value on done: 4407.0 [2023-02-24 17:34:09,378][177171] Sum rewards: -3.834, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.840', 'AMMO5': '0.011', 'AMMO2': '0.018', 'ARMOR': '0.040', 'WEAPON1': '0.060', 'AMMO3': '0.069', 'weapon4': '0.070', 'AMMO4': '0.088', 'weapon5': '0.114', 'HITCOUNT': '0.170', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.094', 'weapon2': '1.942'} [2023-02-24 17:34:09,504][177157] DAMAGECOUNT value on done: 4841.0 [2023-02-24 17:34:09,504][177157] Sum rewards: -0.065, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.748', 'AMMO5': '0.012', 'AMMO2': '0.016', 'weapon4': '0.018', 'WEAPON1': '0.020', 'ARMOR': '0.052', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.108', 'AMMO3': '0.126', 'WEAPON5': '0.150', 'HITCOUNT': '0.150', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.672', 'weapon3': '1.562', 'weapon2': '1.716'} [2023-02-24 17:34:09,510][177172] DAMAGECOUNT value on done: 4626.0 [2023-02-24 17:34:09,511][177172] Sum rewards: -3.658, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.988', 'weapon5': '0.002', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'ARMOR': '0.036', 'weapon4': '0.084', 'AMMO3': '0.109', 'HITCOUNT': '0.130', 'AMMO4': '0.143', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.477', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.164', 'weapon2': '2.024'} [2023-02-24 17:34:09,602][177155] DAMAGECOUNT value on done: 4018.0 [2023-02-24 17:34:09,602][177155] Sum rewards: 0.288, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.090', 'AMMO4': '-0.048', 'AMMO2': '-0.010', 'AMMO5': '0.015', 'ARMOR': '0.032', 'WEAPON1': '0.060', 'AMMO3': '0.135', 'HITCOUNT': '0.140', 'weapon5': '0.152', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.609', 'WEAPON3': '0.750', 'weapon2': '1.504', 'weapon3': '1.688', 'FRAGCOUNT': '2.000'} [2023-02-24 17:34:09,678][177171] DAMAGECOUNT value on done: 4685.0 [2023-02-24 17:34:09,678][177171] Sum rewards: -1.789, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.671', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.030', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'weapon5': '0.074', 'WEAPON1': '0.080', 'HITCOUNT': '0.140', 'AMMO3': '0.146', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.801', 'WEAPON3': '0.850', 'weapon2': '1.314', 'weapon3': '1.790', 'FRAGCOUNT': '3.000'} [2023-02-24 17:34:09,714][177157] DAMAGECOUNT value on done: 5564.0 [2023-02-24 17:34:09,714][177157] Sum rewards: -2.145, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.928', 'ARMOR': '0.012', 'AMMO5': '0.012', 'weapon4': '0.016', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'AMMO4': '0.113', 'AMMO3': '0.118', 'weapon5': '0.130', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.042', 'DAMAGECOUNT': '1.299', 'weapon2': '1.958'} [2023-02-24 17:34:09,809][177157] DAMAGECOUNT value on done: 5186.0 [2023-02-24 17:34:09,810][177157] Sum rewards: -0.013, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.080', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.032', 'WEAPON1': '0.040', 'weapon5': '0.104', 'HITCOUNT': '0.120', 'AMMO3': '0.149', 'WEAPON5': '0.250', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.206', 'weapon3': '1.572', 'weapon2': '1.578', 'FRAGCOUNT': '2.500'} [2023-02-24 17:34:09,904][177155] DAMAGECOUNT value on done: 6032.0 [2023-02-24 17:34:09,905][177155] Sum rewards: -1.180, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.428', 'ARMOR': '0.004', 'AMMO2': '0.004', 'AMMO5': '0.012', 'weapon4': '0.016', 'AMMO4': '0.022', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'HITCOUNT': '0.180', 'weapon5': '0.256', 'WEAPON5': '0.300', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.837', 'weapon3': '1.470', 'weapon2': '1.602'} [2023-02-24 17:34:09,989][177171] DAMAGECOUNT value on done: 5555.0 [2023-02-24 17:34:09,990][177171] Sum rewards: 0.983, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.148', 'weapon4': '0.014', 'AMMO5': '0.015', 'AMMO2': '0.022', 'ARMOR': '0.028', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.109', 'AMMO4': '0.111', 'HITCOUNT': '0.140', 'weapon5': '0.210', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'weapon3': '1.318', 'DAMAGECOUNT': '1.515', 'weapon2': '1.758', 'FRAGCOUNT': '2.500'} [2023-02-24 17:34:10,016][177157] DAMAGECOUNT value on done: 4468.0 [2023-02-24 17:34:10,017][177157] Sum rewards: 7.818, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.088', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.004', 'WEAPON1': '0.020', 'weapon5': '0.032', 'ARMOR': '0.071', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'HITCOUNT': '0.320', 'WEAPON3': '0.450', 'weapon2': '1.358', 'DAMAGECOUNT': '1.413', 'weapon3': '1.766', 'FRAGCOUNT': '6.000'} [2023-02-24 17:34:10,187][177155] DAMAGECOUNT value on done: 4862.0 [2023-02-24 17:34:10,188][177155] Sum rewards: -5.875, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.554', 'AMMO4': '-0.057', 'AMMO2': '-0.011', 'weapon4': '0.002', 'AMMO5': '0.011', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'ARMOR': '0.052', 'weapon5': '0.082', 'HITCOUNT': '0.150', 'AMMO3': '0.174', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.681', 'weapon3': '0.790', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '2.264'} [2023-02-24 17:34:10,287][177171] DAMAGECOUNT value on done: 5018.0 [2023-02-24 17:34:10,490][177155] DAMAGECOUNT value on done: 4098.0 [2023-02-24 17:34:10,490][177155] Sum rewards: -3.718, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.460', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.014', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'WEAPON5': '0.100', 'weapon5': '0.116', 'HITCOUNT': '0.130', 'AMMO3': '0.172', 'DAMAGECOUNT': '0.465', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.750', 'weapon3': '1.506', 'weapon2': '1.810'} [2023-02-24 17:34:11,010][177153] Updated weights for policy 0, policy_version 2300 (0.0009) [2023-02-24 17:34:11,138][177156] DAMAGECOUNT value on done: 4744.0 [2023-02-24 17:34:11,139][177156] Sum rewards: -1.689, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.992', 'AMMO2': '0.007', 'AMMO5': '0.017', 'AMMO4': '0.033', 'weapon4': '0.038', 'ARMOR': '0.039', 'WEAPON1': '0.050', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'weapon5': '0.174', 'HITCOUNT': '0.220', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'weapon3': '1.280', 'DAMAGECOUNT': '1.317', 'FRAGCOUNT': '1.500', 'weapon2': '1.784'} [2023-02-24 17:34:11,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14131.2, 300 sec: 13912.5). Total num frames: 9424896. Throughput: 0: 3533.0. Samples: 2353580. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:34:11,376][177119] Avg episode reward: [(0, '-3.109')] [2023-02-24 17:34:11,427][177156] DAMAGECOUNT value on done: 5100.0 [2023-02-24 17:34:11,427][177156] Sum rewards: -4.043, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.000', 'HEALTH': '-0.442', 'weapon4': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'HITCOUNT': '0.070', 'AMMO4': '0.084', 'AMMO3': '0.109', 'weapon5': '0.144', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.270', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'weapon3': '1.458', 'weapon2': '1.562'} [2023-02-24 17:34:11,683][177156] DAMAGECOUNT value on done: 4216.0 [2023-02-24 17:34:11,975][177156] DAMAGECOUNT value on done: 4898.0 [2023-02-24 17:34:11,976][177156] Sum rewards: -3.191, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.943', 'AMMO2': '0.020', 'AMMO5': '0.029', 'ARMOR': '0.032', 'WEAPON1': '0.090', 'AMMO3': '0.099', 'AMMO4': '0.101', 'weapon5': '0.146', 'weapon4': '0.198', 'WEAPON4': '0.200', 'HITCOUNT': '0.320', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'weapon3': '1.032', 'weapon2': '1.450', 'DAMAGECOUNT': '1.635', 'FRAGCOUNT': '2.000'} [2023-02-24 17:34:13,905][177153] Updated weights for policy 0, policy_version 2310 (0.0008) [2023-02-24 17:34:16,376][177119] Fps is (10 sec: 13926.5, 60 sec: 14131.2, 300 sec: 13912.5). Total num frames: 9494528. Throughput: 0: 3537.6. Samples: 2374926. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:34:16,376][177119] Avg episode reward: [(0, '-3.133')] [2023-02-24 17:34:16,787][177153] Updated weights for policy 0, policy_version 2320 (0.0008) [2023-02-24 17:34:19,698][177153] Updated weights for policy 0, policy_version 2330 (0.0008) [2023-02-24 17:34:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14131.2, 300 sec: 13912.5). Total num frames: 9564160. Throughput: 0: 3538.5. Samples: 2385550. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:34:21,377][177119] Avg episode reward: [(0, '-3.133')] [2023-02-24 17:34:22,565][177153] Updated weights for policy 0, policy_version 2340 (0.0008) [2023-02-24 17:34:25,431][177153] Updated weights for policy 0, policy_version 2350 (0.0008) [2023-02-24 17:34:26,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14199.5, 300 sec: 13926.4). Total num frames: 9637888. Throughput: 0: 3539.6. Samples: 2406808. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:34:26,376][177119] Avg episode reward: [(0, '-3.133')] [2023-02-24 17:34:26,696][177170] DAMAGECOUNT value on done: 4415.0 [2023-02-24 17:34:26,696][177170] Sum rewards: -4.858, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.030', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO3': '0.086', 'weapon5': '0.130', 'HITCOUNT': '0.240', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.684', 'WEAPON3': '0.700', 'weapon2': '1.230', 'weapon3': '1.742'} [2023-02-24 17:34:26,988][177170] DAMAGECOUNT value on done: 6420.0 [2023-02-24 17:34:26,988][177170] Sum rewards: -3.051, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.988', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'AMMO4': '0.040', 'AMMO3': '0.119', 'weapon5': '0.126', 'HITCOUNT': '0.170', 'WEAPON5': '0.200', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.951', 'weapon3': '1.628', 'weapon2': '1.826'} [2023-02-24 17:34:27,032][177170] DAMAGECOUNT value on done: 4340.0 [2023-02-24 17:34:27,033][177170] Sum rewards: -5.259, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.010', 'AMMO2': '0.014', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'weapon5': '0.118', 'AMMO3': '0.150', 'WEAPON5': '0.200', 'HEALTH': '0.216', 'weapon4': '0.302', 'DAMAGECOUNT': '0.327', 'WEAPON3': '0.550', 'weapon3': '0.740', 'weapon2': '2.262'} [2023-02-24 17:34:27,246][177172] DAMAGECOUNT value on done: 4651.0 [2023-02-24 17:34:27,247][177172] Sum rewards: -0.912, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.706', 'AMMO5': '0.017', 'AMMO2': '0.033', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.076', 'AMMO3': '0.083', 'AMMO4': '0.164', 'HITCOUNT': '0.220', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.705', 'FRAGCOUNT': '1.000', 'weapon3': '1.488', 'weapon2': '1.708'} [2023-02-24 17:34:27,323][177170] DAMAGECOUNT value on done: 5269.0 [2023-02-24 17:34:27,352][177158] DAMAGECOUNT value on done: 5935.0 [2023-02-24 17:34:27,353][177158] Sum rewards: -0.207, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.823', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.052', 'HITCOUNT': '0.060', 'ARMOR': '0.068', 'AMMO3': '0.078', 'AMMO4': '0.096', 'weapon4': '0.186', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.690', 'weapon3': '0.898', 'FRAGCOUNT': '1.000', 'weapon2': '1.936'} [2023-02-24 17:34:27,370][177154] DAMAGECOUNT value on done: 6011.0 [2023-02-24 17:34:27,371][177154] Sum rewards: -1.944, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.056', 'AMMO2': '0.007', 'AMMO5': '0.012', 'weapon4': '0.024', 'WEAPON1': '0.030', 'AMMO4': '0.033', 'ARMOR': '0.052', 'WEAPON4': '0.100', 'weapon5': '0.100', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'HITCOUNT': '0.440', 'WEAPON3': '1.100', 'weapon3': '1.228', 'weapon2': '1.884', 'DAMAGECOUNT': '2.160', 'FRAGCOUNT': '4.500'} [2023-02-24 17:34:27,538][177172] DAMAGECOUNT value on done: 4540.0 [2023-02-24 17:34:27,538][177172] Sum rewards: -1.170, reward structure: {'DEATHCOUNT': '-5.250', 'FRAGCOUNT': '-0.500', 'HEALTH': '0.010', 'AMMO5': '0.014', 'ARMOR': '0.020', 'AMMO2': '0.027', 'WEAPON1': '0.040', 'AMMO3': '0.060', 'HITCOUNT': '0.100', 'AMMO4': '0.133', 'weapon5': '0.156', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.516', 'weapon3': '1.376', 'weapon2': '1.478'} [2023-02-24 17:34:27,662][177158] DAMAGECOUNT value on done: 4933.0 [2023-02-24 17:34:27,662][177158] Sum rewards: 0.144, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.619', 'AMMO5': '0.007', 'AMMO2': '0.017', 'ARMOR': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.049', 'weapon5': '0.056', 'HITCOUNT': '0.070', 'AMMO4': '0.085', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.201', 'WEAPON3': '0.250', 'weapon3': '0.304', 'FRAGCOUNT': '1.000', 'weapon2': '2.266'} [2023-02-24 17:34:27,682][177154] DAMAGECOUNT value on done: 4439.0 [2023-02-24 17:34:27,683][177154] Sum rewards: -1.689, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.628', 'AMMO5': '0.003', 'weapon4': '0.006', 'AMMO2': '0.009', 'ARMOR': '0.024', 'AMMO4': '0.042', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.161', 'HITCOUNT': '0.170', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.750', 'weapon2': '1.636', 'weapon3': '1.638', 'FRAGCOUNT': '2.000'} [2023-02-24 17:34:27,906][177158] DAMAGECOUNT value on done: 4278.0 [2023-02-24 17:34:27,907][177158] Sum rewards: -2.586, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.096', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.015', 'ARMOR': '0.040', 'WEAPON1': '0.040', 'weapon5': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon4': '0.116', 'HITCOUNT': '0.180', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.888', 'weapon3': '1.570', 'weapon2': '1.622'} [2023-02-24 17:34:27,989][177154] DAMAGECOUNT value on done: 6081.0 [2023-02-24 17:34:27,990][177154] Sum rewards: -8.600, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.202', 'WEAPON1': '0.010', 'ARMOR': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.023', 'weapon4': '0.034', 'weapon5': '0.044', 'HITCOUNT': '0.110', 'AMMO4': '0.114', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.429', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon3': '1.432', 'weapon2': '1.956'} [2023-02-24 17:34:28,207][177158] DAMAGECOUNT value on done: 4913.0 [2023-02-24 17:34:28,207][177158] Sum rewards: -4.825, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.674', 'FRAGCOUNT': '0.000', 'AMMO5': '0.006', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'weapon5': '0.096', 'AMMO4': '0.110', 'AMMO3': '0.113', 'weapon4': '0.144', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.687', 'WEAPON3': '0.700', 'weapon2': '1.524', 'weapon3': '1.596'} [2023-02-24 17:34:28,223][177172] DAMAGECOUNT value on done: 3491.0 [2023-02-24 17:34:28,223][177172] Sum rewards: -1.577, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.207', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon5': '0.070', 'weapon4': '0.090', 'AMMO4': '0.097', 'AMMO3': '0.116', 'WEAPON5': '0.200', 'HITCOUNT': '0.200', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.822', 'weapon3': '1.146', 'FRAGCOUNT': '2.000', 'weapon2': '2.232'} [2023-02-24 17:34:28,286][177154] DAMAGECOUNT value on done: 5612.0 [2023-02-24 17:34:28,361][177153] Updated weights for policy 0, policy_version 2360 (0.0008) [2023-02-24 17:34:28,394][177171] DAMAGECOUNT value on done: 4657.0 [2023-02-24 17:34:28,394][177171] Sum rewards: -0.946, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.666', 'AMMO5': '0.017', 'AMMO2': '0.032', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'ARMOR': '0.072', 'weapon5': '0.082', 'weapon4': '0.096', 'AMMO3': '0.130', 'AMMO4': '0.161', 'HITCOUNT': '0.210', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.750', 'WEAPON3': '0.900', 'weapon2': '1.604', 'weapon3': '1.676', 'FRAGCOUNT': '2.000'} [2023-02-24 17:34:28,488][177157] DAMAGECOUNT value on done: 5146.0 [2023-02-24 17:34:28,488][177157] Sum rewards: -1.179, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.102', 'AMMO5': '0.015', 'AMMO2': '0.018', 'ARMOR': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.089', 'AMMO3': '0.100', 'weapon5': '0.168', 'HITCOUNT': '0.230', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.915', 'weapon3': '1.400', 'weapon2': '1.688', 'FRAGCOUNT': '2.000'} [2023-02-24 17:34:28,526][177172] DAMAGECOUNT value on done: 4686.0 [2023-02-24 17:34:28,527][177172] Sum rewards: -6.139, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.032', 'AMMO5': '0.011', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'weapon5': '0.030', 'HITCOUNT': '0.060', 'ARMOR': '0.064', 'weapon7': '0.066', 'AMMO3': '0.087', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.147', 'DAMAGECOUNT': '0.180', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'weapon4': '0.442', 'weapon3': '0.706', 'weapon2': '2.090'} [2023-02-24 17:34:28,634][177157] DAMAGECOUNT value on done: 5812.0 [2023-02-24 17:34:28,635][177157] Sum rewards: -0.461, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.284', 'AMMO2': '0.014', 'AMMO5': '0.019', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.069', 'AMMO3': '0.079', 'HITCOUNT': '0.170', 'weapon4': '0.188', 'weapon5': '0.190', 'WEAPON5': '0.350', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.744', 'weapon2': '1.394', 'weapon3': '1.410'} [2023-02-24 17:34:28,635][177155] DAMAGECOUNT value on done: 4157.0 [2023-02-24 17:34:28,636][177155] Sum rewards: -2.506, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.286', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.013', 'ARMOR': '0.040', 'AMMO4': '0.066', 'weapon4': '0.066', 'AMMO3': '0.114', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.417', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.452', 'weapon2': '1.962'} [2023-02-24 17:34:28,697][177171] DAMAGECOUNT value on done: 4952.0 [2023-02-24 17:34:28,697][177171] Sum rewards: -0.828, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.612', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'ARMOR': '0.024', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'weapon4': '0.100', 'weapon5': '0.120', 'AMMO3': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.210', 'WEAPON3': '0.750', 'weapon3': '0.776', 'DAMAGECOUNT': '0.801', 'weapon2': '2.480', 'FRAGCOUNT': '4.000'} [2023-02-24 17:34:28,786][177157] DAMAGECOUNT value on done: 5201.0 [2023-02-24 17:34:28,786][177157] Sum rewards: -3.068, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.008', 'AMMO2': '0.008', 'HITCOUNT': '0.010', 'ARMOR': '0.032', 'AMMO4': '0.038', 'WEAPON1': '0.040', 'DAMAGECOUNT': '0.045', 'weapon5': '0.068', 'AMMO3': '0.081', 'WEAPON5': '0.150', 'HEALTH': '0.152', 'WEAPON3': '0.500', 'weapon3': '1.434', 'weapon2': '1.866'} [2023-02-24 17:34:28,933][177155] DAMAGECOUNT value on done: 6132.0 [2023-02-24 17:34:28,933][177155] Sum rewards: -6.879, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.385', 'weapon5': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.020', 'HITCOUNT': '0.090', 'weapon4': '0.090', 'AMMO4': '0.099', 'AMMO3': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.300', 'ARMOR': '0.510', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.128', 'weapon2': '1.806'} [2023-02-24 17:34:28,940][177157] DAMAGECOUNT value on done: 4557.0 [2023-02-24 17:34:28,941][177157] Sum rewards: -3.039, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.170', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'weapon4': '0.002', 'AMMO5': '0.007', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'weapon5': '0.054', 'HITCOUNT': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.128', 'DAMAGECOUNT': '0.267', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.534', 'weapon3': '1.544'} [2023-02-24 17:34:28,999][177171] DAMAGECOUNT value on done: 5819.0 [2023-02-24 17:34:28,999][177171] Sum rewards: -5.105, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.370', 'AMMO2': '0.007', 'AMMO5': '0.027', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'AMMO4': '0.035', 'weapon4': '0.104', 'weapon5': '0.112', 'AMMO3': '0.146', 'HITCOUNT': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.792', 'weapon3': '1.032', 'FRAGCOUNT': '1.500', 'weapon2': '2.238'} [2023-02-24 17:34:29,202][177155] DAMAGECOUNT value on done: 5132.0 [2023-02-24 17:34:29,203][177155] Sum rewards: -7.486, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.990', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.058', 'AMMO3': '0.143', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'weapon4': '0.188', 'HITCOUNT': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.810', 'weapon3': '0.922', 'FRAGCOUNT': '2.000', 'weapon2': '2.392'} [2023-02-24 17:34:29,294][177171] DAMAGECOUNT value on done: 5137.0 [2023-02-24 17:34:29,502][177155] DAMAGECOUNT value on done: 4321.0 [2023-02-24 17:34:30,163][177156] DAMAGECOUNT value on done: 5045.0 [2023-02-24 17:34:30,455][177156] DAMAGECOUNT value on done: 5437.0 [2023-02-24 17:34:30,456][177156] Sum rewards: -5.309, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.376', 'AMMO5': '0.003', 'weapon5': '0.008', 'weapon4': '0.018', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'AMMO3': '0.213', 'HITCOUNT': '0.310', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.011', 'weapon3': '1.458', 'weapon2': '1.764', 'FRAGCOUNT': '2.000'} [2023-02-24 17:34:30,702][177156] DAMAGECOUNT value on done: 4539.0 [2023-02-24 17:34:30,703][177156] Sum rewards: -1.374, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.510', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'weapon5': '0.124', 'AMMO3': '0.140', 'HITCOUNT': '0.190', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.969', 'weapon2': '1.448', 'weapon3': '1.456', 'FRAGCOUNT': '2.000'} [2023-02-24 17:34:30,996][177156] DAMAGECOUNT value on done: 5218.0 [2023-02-24 17:34:30,997][177156] Sum rewards: 0.572, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.285', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO5': '0.027', 'ARMOR': '0.040', 'weapon5': '0.084', 'weapon4': '0.084', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'AMMO4': '0.117', 'HITCOUNT': '0.240', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.960', 'FRAGCOUNT': '1.000', 'weapon3': '1.492', 'weapon2': '1.578'} [2023-02-24 17:34:31,237][177153] Updated weights for policy 0, policy_version 2370 (0.0008) [2023-02-24 17:34:31,376][177119] Fps is (10 sec: 14336.1, 60 sec: 14131.2, 300 sec: 13912.5). Total num frames: 9707520. Throughput: 0: 3536.9. Samples: 2427938. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:34:31,376][177119] Avg episode reward: [(0, '-2.993')] [2023-02-24 17:34:34,103][177153] Updated weights for policy 0, policy_version 2380 (0.0008) [2023-02-24 17:34:36,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14131.2, 300 sec: 13912.5). Total num frames: 9777152. Throughput: 0: 3537.9. Samples: 2438624. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:34:36,376][177119] Avg episode reward: [(0, '-2.993')] [2023-02-24 17:34:36,987][177153] Updated weights for policy 0, policy_version 2390 (0.0008) [2023-02-24 17:34:39,854][177153] Updated weights for policy 0, policy_version 2400 (0.0009) [2023-02-24 17:34:41,376][177119] Fps is (10 sec: 14335.9, 60 sec: 14199.5, 300 sec: 13926.4). Total num frames: 9850880. Throughput: 0: 3539.6. Samples: 2459878. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 17:34:41,376][177119] Avg episode reward: [(0, '-2.993')] [2023-02-24 17:34:42,763][177153] Updated weights for policy 0, policy_version 2410 (0.0008) [2023-02-24 17:34:45,537][177170] DAMAGECOUNT value on done: 4560.0 [2023-02-24 17:34:45,538][177170] Sum rewards: -4.305, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.194', 'AMMO5': '0.005', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'weapon4': '0.034', 'AMMO3': '0.115', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.152', 'AMMO4': '0.168', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.466', 'weapon2': '2.012'} [2023-02-24 17:34:45,659][177153] Updated weights for policy 0, policy_version 2420 (0.0008) [2023-02-24 17:34:45,836][177170] DAMAGECOUNT value on done: 7094.0 [2023-02-24 17:34:45,836][177170] Sum rewards: -2.995, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.622', 'ARMOR': '0.008', 'AMMO2': '0.025', 'AMMO5': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.147', 'HITCOUNT': '0.160', 'weapon4': '0.194', 'WEAPON4': '0.200', 'weapon5': '0.248', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon3': '1.044', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '2.010', 'weapon2': '2.192'} [2023-02-24 17:34:45,902][177170] DAMAGECOUNT value on done: 4600.0 [2023-02-24 17:34:45,903][177170] Sum rewards: -1.019, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.540', 'AMMO5': '0.012', 'AMMO2': '0.017', 'weapon4': '0.040', 'AMMO3': '0.064', 'AMMO4': '0.082', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'HITCOUNT': '0.200', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.780', 'FRAGCOUNT': '1.000', 'weapon3': '1.064', 'weapon2': '2.270'} [2023-02-24 17:34:46,180][177172] DAMAGECOUNT value on done: 4690.0 [2023-02-24 17:34:46,181][177172] Sum rewards: -6.213, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.136', 'weapon4': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO5': '0.027', 'HITCOUNT': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.108', 'DAMAGECOUNT': '0.117', 'weapon5': '0.162', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'weapon3': '1.676', 'weapon2': '1.696'} [2023-02-24 17:34:46,201][177170] DAMAGECOUNT value on done: 5445.0 [2023-02-24 17:34:46,202][177170] Sum rewards: 0.776, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.110', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.012', 'ARMOR': '0.016', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'weapon5': '0.070', 'AMMO3': '0.081', 'weapon7': '0.084', 'weapon4': '0.104', 'HITCOUNT': '0.120', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.528', 'weapon3': '1.074', 'weapon2': '1.670', 'FRAGCOUNT': '2.000'} [2023-02-24 17:34:46,376][177119] Fps is (10 sec: 14336.1, 60 sec: 14131.2, 300 sec: 13912.5). Total num frames: 9920512. Throughput: 0: 3537.2. Samples: 2481052. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 17:34:46,376][177119] Avg episode reward: [(0, '-2.882')] [2023-02-24 17:34:46,380][177140] Saving new best policy, reward=-2.882! [2023-02-24 17:34:46,397][177158] DAMAGECOUNT value on done: 6075.0 [2023-02-24 17:34:46,398][177158] Sum rewards: -9.483, reward structure: {'DEATHCOUNT': '-12.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.470', 'AMMO5': '0.011', 'AMMO2': '0.031', 'ARMOR': '0.032', 'HITCOUNT': '0.070', 'weapon4': '0.096', 'AMMO3': '0.104', 'weapon5': '0.148', 'AMMO4': '0.157', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.600', 'weapon3': '0.860', 'weapon2': '2.408'} [2023-02-24 17:34:46,407][177154] DAMAGECOUNT value on done: 6205.0 [2023-02-24 17:34:46,487][177172] DAMAGECOUNT value on done: 4769.0 [2023-02-24 17:34:46,487][177172] Sum rewards: -3.207, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.340', 'FRAGCOUNT': '-0.500', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO3': '0.078', 'weapon4': '0.090', 'ARMOR': '0.094', 'HITCOUNT': '0.120', 'AMMO4': '0.150', 'weapon5': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'weapon3': '0.628', 'DAMAGECOUNT': '0.687', 'weapon2': '2.298'} [2023-02-24 17:34:46,704][177158] DAMAGECOUNT value on done: 5225.0 [2023-02-24 17:34:46,718][177154] DAMAGECOUNT value on done: 4958.0 [2023-02-24 17:34:46,719][177154] Sum rewards: 3.404, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.327', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'weapon7': '0.016', 'weapon4': '0.042', 'AMMO4': '0.061', 'ARMOR': '0.072', 'weapon5': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.800', 'weapon3': '1.502', 'DAMAGECOUNT': '1.557', 'weapon2': '1.854', 'FRAGCOUNT': '5.000'} [2023-02-24 17:34:46,954][177158] DAMAGECOUNT value on done: 4453.0 [2023-02-24 17:34:46,955][177158] Sum rewards: -5.281, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.005', 'weapon5': '0.002', 'AMMO2': '0.016', 'AMMO5': '0.018', 'weapon4': '0.056', 'ARMOR': '0.072', 'AMMO4': '0.081', 'AMMO3': '0.094', 'HITCOUNT': '0.110', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.525', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.430', 'weapon2': '2.020'} [2023-02-24 17:34:47,018][177154] DAMAGECOUNT value on done: 6278.0 [2023-02-24 17:34:47,018][177154] Sum rewards: -5.773, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.056', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.008', 'AMMO2': '0.024', 'ARMOR': '0.036', 'WEAPON1': '0.040', 'AMMO4': '0.120', 'weapon5': '0.126', 'HITCOUNT': '0.130', 'AMMO3': '0.146', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.352', 'DAMAGECOUNT': '0.591', 'weapon3': '0.746', 'WEAPON3': '0.800', 'weapon2': '1.914'} [2023-02-24 17:34:47,185][177172] DAMAGECOUNT value on done: 3637.0 [2023-02-24 17:34:47,185][177172] Sum rewards: -5.271, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.673', 'AMMO5': '0.019', 'ARMOR': '0.036', 'AMMO2': '0.046', 'weapon5': '0.058', 'AMMO3': '0.094', 'HITCOUNT': '0.110', 'AMMO4': '0.229', 'weapon4': '0.290', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.438', 'WEAPON4': '0.500', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.550', 'weapon3': '0.594', 'weapon2': '2.138'} [2023-02-24 17:34:47,254][177158] DAMAGECOUNT value on done: 5449.0 [2023-02-24 17:34:47,255][177158] Sum rewards: -2.090, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.858', 'AMMO5': '0.012', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'weapon4': '0.042', 'AMMO3': '0.127', 'AMMO4': '0.139', 'weapon5': '0.172', 'HITCOUNT': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.436', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.600', 'weapon3': '1.180', 'DAMAGECOUNT': '1.608', 'weapon2': '2.134'} [2023-02-24 17:34:47,317][177154] DAMAGECOUNT value on done: 5787.0 [2023-02-24 17:34:47,317][177154] Sum rewards: -0.178, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.160', 'AMMO2': '0.004', 'AMMO5': '0.017', 'AMMO4': '0.019', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'weapon4': '0.162', 'weapon5': '0.186', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'ARMOR': '0.497', 'DAMAGECOUNT': '0.525', 'weapon3': '0.828', 'FRAGCOUNT': '2.000', 'weapon2': '2.382'} [2023-02-24 17:34:47,395][177171] DAMAGECOUNT value on done: 5185.0 [2023-02-24 17:34:47,395][177171] Sum rewards: -1.963, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.442', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.096', 'weapon5': '0.104', 'AMMO4': '0.133', 'WEAPON4': '0.150', 'AMMO3': '0.154', 'WEAPON5': '0.250', 'HITCOUNT': '0.270', 'ARMOR': '0.440', 'WEAPON3': '0.850', 'weapon3': '1.308', 'DAMAGECOUNT': '1.584', 'weapon2': '2.102', 'FRAGCOUNT': '4.000'} [2023-02-24 17:34:47,482][177172] DAMAGECOUNT value on done: 5041.0 [2023-02-24 17:34:47,482][177172] Sum rewards: -3.142, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.336', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.013', 'ARMOR': '0.028', 'WEAPON1': '0.040', 'HITCOUNT': '0.100', 'AMMO3': '0.111', 'weapon5': '0.222', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.065', 'weapon3': '1.266', 'weapon2': '1.858', 'FRAGCOUNT': '3.000'} [2023-02-24 17:34:47,551][177157] DAMAGECOUNT value on done: 5556.0 [2023-02-24 17:34:47,552][177157] Sum rewards: 0.564, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.414', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO3': '0.046', 'AMMO4': '0.054', 'weapon5': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'WEAPON3': '0.250', 'weapon4': '0.314', 'weapon3': '0.518', 'DAMAGECOUNT': '1.230', 'weapon2': '2.516', 'FRAGCOUNT': '3.000'} [2023-02-24 17:34:47,590][177155] DAMAGECOUNT value on done: 4791.0 [2023-02-24 17:34:47,590][177155] Sum rewards: -6.119, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.430', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO2': '0.050', 'AMMO3': '0.129', 'weapon4': '0.146', 'weapon5': '0.180', 'AMMO4': '0.252', 'HITCOUNT': '0.280', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.750', 'weapon3': '1.094', 'DAMAGECOUNT': '1.902', 'weapon2': '1.978'} [2023-02-24 17:34:47,695][177171] DAMAGECOUNT value on done: 5025.0 [2023-02-24 17:34:47,695][177171] Sum rewards: -3.915, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.666', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.014', 'AMMO2': '0.026', 'HITCOUNT': '0.070', 'weapon5': '0.076', 'AMMO3': '0.091', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.200', 'DAMAGECOUNT': '0.219', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'weapon3': '1.018', 'weapon2': '2.056'} [2023-02-24 17:34:47,697][177157] DAMAGECOUNT value on done: 5962.0 [2023-02-24 17:34:47,697][177157] Sum rewards: -10.148, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.783', 'AMMO5': '0.005', 'AMMO2': '0.023', 'ARMOR': '0.028', 'weapon5': '0.072', 'AMMO4': '0.114', 'AMMO3': '0.121', 'HITCOUNT': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.278', 'WEAPON4': '0.350', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.096', 'weapon2': '2.098'} [2023-02-24 17:34:47,852][177157] DAMAGECOUNT value on done: 5270.0 [2023-02-24 17:34:47,891][177155] DAMAGECOUNT value on done: 6393.0 [2023-02-24 17:34:47,891][177155] Sum rewards: 0.775, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.253', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'ARMOR': '0.040', 'weapon4': '0.066', 'AMMO3': '0.114', 'HITCOUNT': '0.130', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'weapon5': '0.176', 'WEAPON4': '0.200', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.783', 'weapon3': '1.122', 'weapon2': '1.844', 'FRAGCOUNT': '4.000'} [2023-02-24 17:34:47,998][177157] DAMAGECOUNT value on done: 5251.0 [2023-02-24 17:34:47,998][177157] Sum rewards: -0.514, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.583', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'weapon4': '0.044', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'weapon5': '0.118', 'HITCOUNT': '0.280', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'weapon3': '1.442', 'DAMAGECOUNT': '1.773', 'weapon2': '2.030', 'FRAGCOUNT': '3.500'} [2023-02-24 17:34:48,006][177171] DAMAGECOUNT value on done: 6081.0 [2023-02-24 17:34:48,007][177171] Sum rewards: -0.259, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.998', 'AMMO5': '0.011', 'AMMO2': '0.014', 'weapon4': '0.034', 'WEAPON1': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.088', 'weapon5': '0.098', 'WEAPON4': '0.100', 'HITCOUNT': '0.180', 'WEAPON5': '0.200', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.786', 'weapon3': '1.450', 'weapon2': '1.806', 'FRAGCOUNT': '2.000'} [2023-02-24 17:34:48,181][177155] DAMAGECOUNT value on done: 5703.0 [2023-02-24 17:34:48,181][177155] Sum rewards: -1.722, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.897', 'weapon7': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.031', 'AMMO3': '0.098', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.156', 'weapon5': '0.176', 'HITCOUNT': '0.250', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.454', 'ARMOR': '0.509', 'WEAPON3': '0.550', 'weapon3': '0.806', 'DAMAGECOUNT': '1.713', 'FRAGCOUNT': '2.000', 'weapon2': '2.062'} [2023-02-24 17:34:48,304][177171] DAMAGECOUNT value on done: 5292.0 [2023-02-24 17:34:48,304][177171] Sum rewards: -7.953, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.188', 'FRAGCOUNT': '-1.000', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.043', 'HITCOUNT': '0.050', 'ARMOR': '0.051', 'AMMO3': '0.069', 'weapon5': '0.132', 'WEAPON5': '0.200', 'AMMO4': '0.217', 'weapon4': '0.312', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.465', 'weapon3': '0.896', 'weapon2': '2.220'} [2023-02-24 17:34:48,477][177155] DAMAGECOUNT value on done: 4486.0 [2023-02-24 17:34:48,477][177155] Sum rewards: -3.898, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.047', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.012', 'AMMO2': '0.035', 'WEAPON1': '0.040', 'AMMO3': '0.068', 'HITCOUNT': '0.110', 'weapon4': '0.152', 'AMMO4': '0.175', 'weapon5': '0.244', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'WEAPON4': '0.400', 'ARMOR': '0.436', 'DAMAGECOUNT': '0.495', 'weapon3': '0.688', 'weapon2': '2.394'} [2023-02-24 17:34:48,619][177153] Updated weights for policy 0, policy_version 2430 (0.0008) [2023-02-24 17:34:49,266][177156] DAMAGECOUNT value on done: 5406.0 [2023-02-24 17:34:49,267][177156] Sum rewards: -1.014, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.795', 'AMMO5': '0.005', 'AMMO2': '0.033', 'WEAPON1': '0.040', 'weapon5': '0.044', 'ARMOR': '0.084', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.162', 'weapon4': '0.272', 'HITCOUNT': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.083', 'weapon3': '1.130', 'weapon2': '1.910'} [2023-02-24 17:34:49,557][177156] DAMAGECOUNT value on done: 5669.0 [2023-02-24 17:34:49,557][177156] Sum rewards: -6.600, reward structure: {'DEATHCOUNT': '-12.000', 'FRAGCOUNT': '-0.500', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.025', 'HEALTH': '0.042', 'weapon4': '0.072', 'weapon5': '0.086', 'AMMO4': '0.124', 'AMMO3': '0.126', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.696', 'WEAPON3': '0.750', 'weapon2': '1.636', 'weapon3': '1.668'} [2023-02-24 17:34:49,797][177156] DAMAGECOUNT value on done: 4599.0 [2023-02-24 17:34:49,798][177156] Sum rewards: -8.278, reward structure: {'DEATHCOUNT': '-11.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.740', 'AMMO5': '0.016', 'AMMO2': '0.037', 'weapon5': '0.038', 'HITCOUNT': '0.070', 'AMMO3': '0.071', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.180', 'AMMO4': '0.187', 'weapon4': '0.338', 'WEAPON3': '0.400', 'WEAPON4': '0.400', 'weapon3': '0.808', 'weapon2': '2.516'} [2023-02-24 17:34:50,092][177156] DAMAGECOUNT value on done: 5362.0 [2023-02-24 17:34:50,092][177156] Sum rewards: -3.046, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.288', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon4': '0.064', 'HITCOUNT': '0.070', 'AMMO4': '0.076', 'AMMO3': '0.102', 'WEAPON4': '0.150', 'weapon5': '0.192', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.432', 'WEAPON3': '0.550', 'weapon3': '0.964', 'FRAGCOUNT': '1.000', 'weapon2': '2.186'} [2023-02-24 17:34:51,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14131.2, 300 sec: 13912.5). Total num frames: 9990144. Throughput: 0: 3535.1. Samples: 2491524. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 17:34:51,376][177119] Avg episode reward: [(0, '-2.852')] [2023-02-24 17:34:51,377][177140] Saving new best policy, reward=-2.852! [2023-02-24 17:34:51,526][177153] Updated weights for policy 0, policy_version 2440 (0.0009) [2023-02-24 17:34:54,439][177153] Updated weights for policy 0, policy_version 2450 (0.0008) [2023-02-24 17:34:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14131.2, 300 sec: 13912.5). Total num frames: 10059776. Throughput: 0: 3535.1. Samples: 2512660. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:34:56,376][177119] Avg episode reward: [(0, '-2.852')] [2023-02-24 17:34:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000002456_10059776.pth... [2023-02-24 17:34:56,438][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000001644_6733824.pth [2023-02-24 17:34:57,356][177153] Updated weights for policy 0, policy_version 2460 (0.0009) [2023-02-24 17:35:00,251][177153] Updated weights for policy 0, policy_version 2470 (0.0008) [2023-02-24 17:35:01,376][177119] Fps is (10 sec: 13926.5, 60 sec: 14131.2, 300 sec: 13912.5). Total num frames: 10129408. Throughput: 0: 3531.7. Samples: 2533852. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:35:01,376][177119] Avg episode reward: [(0, '-2.852')] [2023-02-24 17:35:03,146][177153] Updated weights for policy 0, policy_version 2480 (0.0008) [2023-02-24 17:35:04,627][177170] DAMAGECOUNT value on done: 5111.0 [2023-02-24 17:35:04,628][177170] Sum rewards: 2.237, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.062', 'weapon4': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.087', 'weapon5': '0.272', 'HITCOUNT': '0.370', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'weapon3': '1.298', 'DAMAGECOUNT': '1.653', 'weapon2': '1.686', 'FRAGCOUNT': '5.000'} [2023-02-24 17:35:04,919][177170] DAMAGECOUNT value on done: 7542.0 [2023-02-24 17:35:04,920][177170] Sum rewards: -6.974, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.810', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'weapon4': '0.048', 'AMMO4': '0.052', 'ARMOR': '0.064', 'weapon5': '0.068', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'WEAPON5': '0.250', 'HITCOUNT': '0.350', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.344', 'weapon3': '1.350', 'weapon2': '1.960'} [2023-02-24 17:35:04,983][177170] DAMAGECOUNT value on done: 4832.0 [2023-02-24 17:35:04,984][177170] Sum rewards: -5.381, reward structure: {'DEATHCOUNT': '-12.000', 'ARMOR': '0.012', 'AMMO5': '0.022', 'AMMO2': '0.037', 'WEAPON1': '0.050', 'AMMO3': '0.089', 'weapon4': '0.098', 'HITCOUNT': '0.120', 'AMMO4': '0.186', 'weapon5': '0.206', 'WEAPON4': '0.250', 'HEALTH': '0.340', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'weapon3': '0.642', 'DAMAGECOUNT': '0.696', 'FRAGCOUNT': '1.000', 'weapon2': '2.020'} [2023-02-24 17:35:05,257][177172] DAMAGECOUNT value on done: 5295.0 [2023-02-24 17:35:05,257][177172] Sum rewards: 0.344, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.621', 'AMMO2': '0.013', 'AMMO5': '0.027', 'WEAPON1': '0.060', 'AMMO4': '0.065', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'weapon5': '0.154', 'weapon4': '0.162', 'HITCOUNT': '0.450', 'WEAPON5': '0.450', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.550', 'weapon3': '1.460', 'weapon2': '1.754', 'DAMAGECOUNT': '1.815'} [2023-02-24 17:35:05,282][177170] DAMAGECOUNT value on done: 6199.0 [2023-02-24 17:35:05,283][177170] Sum rewards: 2.064, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.264', 'weapon4': '0.010', 'AMMO2': '0.010', 'ARMOR': '0.013', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'weapon5': '0.208', 'WEAPON5': '0.350', 'HITCOUNT': '0.450', 'WEAPON3': '0.650', 'weapon3': '1.532', 'weapon2': '1.772', 'DAMAGECOUNT': '2.262', 'FRAGCOUNT': '3.000'} [2023-02-24 17:35:05,494][177154] DAMAGECOUNT value on done: 6300.0 [2023-02-24 17:35:05,494][177154] Sum rewards: -5.169, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.142', 'AMMO2': '0.012', 'AMMO5': '0.025', 'weapon4': '0.048', 'WEAPON1': '0.060', 'AMMO4': '0.062', 'ARMOR': '0.068', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.122', 'AMMO3': '0.161', 'DAMAGECOUNT': '0.285', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.584', 'weapon2': '1.706'} [2023-02-24 17:35:05,519][177158] DAMAGECOUNT value on done: 6530.0 [2023-02-24 17:35:05,520][177158] Sum rewards: 1.467, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.634', 'AMMO5': '0.012', 'AMMO2': '0.027', 'ARMOR': '0.028', 'WEAPON1': '0.050', 'AMMO3': '0.052', 'AMMO4': '0.136', 'weapon5': '0.158', 'weapon4': '0.202', 'HITCOUNT': '0.220', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.350', 'weapon3': '0.928', 'DAMAGECOUNT': '1.365', 'weapon2': '2.172', 'FRAGCOUNT': '2.500'} [2023-02-24 17:35:05,554][177172] DAMAGECOUNT value on done: 5034.0 [2023-02-24 17:35:05,554][177172] Sum rewards: -4.843, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.537', 'AMMO2': '0.000', 'AMMO4': '0.002', 'weapon5': '0.008', 'ARMOR': '0.008', 'AMMO5': '0.013', 'weapon4': '0.014', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.142', 'HITCOUNT': '0.150', 'WEAPON5': '0.250', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.795', 'FRAGCOUNT': '1.000', 'weapon3': '1.206', 'weapon2': '1.986'} [2023-02-24 17:35:05,784][177154] DAMAGECOUNT value on done: 5148.0 [2023-02-24 17:35:05,785][177154] Sum rewards: -3.143, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.430', 'AMMO2': '0.014', 'AMMO5': '0.015', 'weapon4': '0.062', 'WEAPON1': '0.070', 'AMMO4': '0.070', 'AMMO3': '0.083', 'weapon5': '0.142', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.570', 'weapon3': '0.790', 'weapon2': '2.260'} [2023-02-24 17:35:05,811][177158] DAMAGECOUNT value on done: 5587.0 [2023-02-24 17:35:05,812][177158] Sum rewards: -0.141, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.020', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.052', 'AMMO3': '0.131', 'AMMO4': '0.138', 'weapon5': '0.150', 'HITCOUNT': '0.210', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HEALTH': '0.868', 'FRAGCOUNT': '1.000', 'weapon3': '1.014', 'DAMAGECOUNT': '1.086', 'weapon2': '1.782'} [2023-02-24 17:35:06,055][177158] DAMAGECOUNT value on done: 4603.0 [2023-02-24 17:35:06,055][177158] Sum rewards: -3.991, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.552', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.011', 'AMMO5': '0.027', 'AMMO4': '0.052', 'WEAPON1': '0.060', 'HITCOUNT': '0.090', 'AMMO3': '0.139', 'weapon5': '0.194', 'DAMAGECOUNT': '0.450', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'weapon3': '1.508', 'weapon2': '1.730'} [2023-02-24 17:35:06,070][177153] Updated weights for policy 0, policy_version 2490 (0.0008) [2023-02-24 17:35:06,089][177154] DAMAGECOUNT value on done: 6493.0 [2023-02-24 17:35:06,089][177154] Sum rewards: -2.307, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.838', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON1': '0.050', 'ARMOR': '0.052', 'weapon4': '0.062', 'weapon5': '0.064', 'AMMO4': '0.086', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.750', 'weapon3': '1.314', 'FRAGCOUNT': '2.000', 'weapon2': '2.110'} [2023-02-24 17:35:06,240][177172] DAMAGECOUNT value on done: 3968.0 [2023-02-24 17:35:06,241][177172] Sum rewards: -4.122, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.643', 'AMMO5': '0.014', 'AMMO2': '0.019', 'ARMOR': '0.032', 'WEAPON1': '0.050', 'weapon4': '0.064', 'AMMO4': '0.096', 'weapon5': '0.098', 'AMMO3': '0.122', 'HITCOUNT': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'weapon3': '0.790', 'DAMAGECOUNT': '0.993', 'FRAGCOUNT': '2.000', 'weapon2': '2.282'} [2023-02-24 17:35:06,351][177158] DAMAGECOUNT value on done: 5574.0 [2023-02-24 17:35:06,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14131.2, 300 sec: 13912.5). Total num frames: 10203136. Throughput: 0: 3529.9. Samples: 2544394. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:35:06,377][177119] Avg episode reward: [(0, '-2.838')] [2023-02-24 17:35:06,379][177140] Saving new best policy, reward=-2.838! [2023-02-24 17:35:06,397][177154] DAMAGECOUNT value on done: 5925.0 [2023-02-24 17:35:06,398][177154] Sum rewards: -4.333, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-2.000', 'HEALTH': '-0.607', 'AMMO2': '0.013', 'AMMO5': '0.016', 'WEAPON1': '0.040', 'ARMOR': '0.048', 'HITCOUNT': '0.050', 'AMMO4': '0.062', 'weapon4': '0.066', 'AMMO3': '0.093', 'weapon5': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.414', 'WEAPON3': '0.500', 'weapon3': '1.148', 'weapon2': '1.872'} [2023-02-24 17:35:06,422][177171] DAMAGECOUNT value on done: 5205.0 [2023-02-24 17:35:06,423][177171] Sum rewards: -6.750, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-3.000', 'HEALTH': '-0.876', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'HITCOUNT': '0.020', 'AMMO2': '0.041', 'AMMO3': '0.050', 'DAMAGECOUNT': '0.060', 'weapon5': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon7': '0.130', 'weapon4': '0.142', 'AMMO4': '0.204', 'WEAPON3': '0.250', 'WEAPON4': '0.450', 'weapon3': '0.802', 'weapon2': '1.980'} [2023-02-24 17:35:06,553][177172] DAMAGECOUNT value on done: 5259.0 [2023-02-24 17:35:06,554][177172] Sum rewards: -3.333, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.339', 'AMMO2': '0.007', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.034', 'ARMOR': '0.053', 'HITCOUNT': '0.060', 'weapon5': '0.062', 'weapon4': '0.092', 'AMMO3': '0.135', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.654', 'WEAPON3': '0.850', 'weapon3': '1.360', 'FRAGCOUNT': '2.000', 'weapon2': '2.054'} [2023-02-24 17:35:06,635][177157] DAMAGECOUNT value on done: 5826.0 [2023-02-24 17:35:06,636][177157] Sum rewards: -5.320, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.001', 'FRAGCOUNT': '-0.500', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.045', 'ARMOR': '0.066', 'HITCOUNT': '0.080', 'AMMO3': '0.080', 'weapon4': '0.112', 'weapon5': '0.190', 'WEAPON5': '0.200', 'AMMO4': '0.227', 'WEAPON3': '0.400', 'WEAPON4': '0.500', 'weapon3': '0.568', 'DAMAGECOUNT': '0.810', 'weapon2': '2.630'} [2023-02-24 17:35:06,729][177171] DAMAGECOUNT value on done: 5570.0 [2023-02-24 17:35:06,730][177171] Sum rewards: -1.454, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.296', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'weapon5': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'weapon4': '0.188', 'HITCOUNT': '0.420', 'WEAPON3': '0.650', 'weapon3': '1.378', 'weapon2': '1.618', 'DAMAGECOUNT': '1.635', 'FRAGCOUNT': '2.000'} [2023-02-24 17:35:06,743][177155] DAMAGECOUNT value on done: 5000.0 [2023-02-24 17:35:06,744][177155] Sum rewards: -5.557, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.661', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO2': '0.046', 'AMMO3': '0.059', 'HITCOUNT': '0.120', 'weapon5': '0.182', 'AMMO4': '0.230', 'weapon4': '0.240', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'DAMAGECOUNT': '0.627', 'weapon3': '0.834', 'weapon2': '1.870'} [2023-02-24 17:35:06,793][177157] DAMAGECOUNT value on done: 6187.0 [2023-02-24 17:35:06,793][177157] Sum rewards: -2.324, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.118', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.030', 'WEAPON1': '0.050', 'HITCOUNT': '0.060', 'AMMO3': '0.095', 'AMMO4': '0.126', 'weapon5': '0.132', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.675', 'FRAGCOUNT': '1.000', 'weapon3': '1.062', 'weapon2': '2.068'} [2023-02-24 17:35:06,949][177157] DAMAGECOUNT value on done: 5658.0 [2023-02-24 17:35:06,950][177157] Sum rewards: 2.633, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.992', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON1': '0.060', 'weapon5': '0.078', 'AMMO3': '0.113', 'WEAPON5': '0.150', 'HITCOUNT': '0.350', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.164', 'weapon2': '1.560', 'weapon3': '1.784', 'FRAGCOUNT': '3.000'} [2023-02-24 17:35:07,027][177171] DAMAGECOUNT value on done: 6326.0 [2023-02-24 17:35:07,028][177171] Sum rewards: -1.822, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.834', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.031', 'WEAPON1': '0.050', 'weapon4': '0.058', 'AMMO3': '0.096', 'HITCOUNT': '0.120', 'weapon5': '0.136', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.735', 'weapon3': '1.000', 'FRAGCOUNT': '2.000', 'weapon2': '2.170'} [2023-02-24 17:35:07,040][177155] DAMAGECOUNT value on done: 6498.0 [2023-02-24 17:35:07,041][177155] Sum rewards: -2.320, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.292', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.054', 'WEAPON1': '0.060', 'ARMOR': '0.060', 'AMMO4': '0.063', 'AMMO3': '0.100', 'HITCOUNT': '0.110', 'WEAPON5': '0.150', 'weapon5': '0.150', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.315', 'WEAPON3': '0.350', 'weapon3': '0.982', 'FRAGCOUNT': '1.000', 'weapon2': '2.108'} [2023-02-24 17:35:07,094][177157] DAMAGECOUNT value on done: 5448.0 [2023-02-24 17:35:07,095][177157] Sum rewards: -4.548, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.422', 'AMMO5': '0.012', 'AMMO2': '0.013', 'weapon4': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'WEAPON1': '0.070', 'AMMO3': '0.122', 'weapon5': '0.148', 'HITCOUNT': '0.170', 'WEAPON5': '0.300', 'ARMOR': '0.445', 'DAMAGECOUNT': '0.591', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.320', 'weapon2': '2.100'} [2023-02-24 17:35:07,315][177155] DAMAGECOUNT value on done: 6046.0 [2023-02-24 17:35:07,315][177155] Sum rewards: -1.098, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.626', 'weapon4': '0.014', 'AMMO5': '0.027', 'AMMO2': '0.032', 'WEAPON1': '0.040', 'HITCOUNT': '0.110', 'AMMO3': '0.120', 'AMMO4': '0.162', 'WEAPON4': '0.200', 'weapon5': '0.202', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.029', 'weapon3': '1.682', 'weapon2': '1.760', 'FRAGCOUNT': '3.000'} [2023-02-24 17:35:07,331][177171] DAMAGECOUNT value on done: 5582.0 [2023-02-24 17:35:07,332][177171] Sum rewards: -1.238, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.174', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.053', 'WEAPON1': '0.060', 'AMMO3': '0.102', 'weapon4': '0.126', 'HITCOUNT': '0.150', 'weapon5': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'ARMOR': '0.493', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.870', 'FRAGCOUNT': '1.000', 'weapon3': '1.062', 'weapon2': '1.728'} [2023-02-24 17:35:07,621][177155] DAMAGECOUNT value on done: 4937.0 [2023-02-24 17:35:07,622][177155] Sum rewards: -5.690, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.010', 'AMMO2': '0.007', 'AMMO5': '0.009', 'AMMO4': '0.033', 'WEAPON1': '0.060', 'AMMO3': '0.134', 'weapon5': '0.136', 'WEAPON5': '0.200', 'HITCOUNT': '0.210', 'WEAPON3': '0.700', 'weapon3': '1.032', 'DAMAGECOUNT': '1.353', 'FRAGCOUNT': '2.000', 'weapon2': '2.196'} [2023-02-24 17:35:08,486][177156] DAMAGECOUNT value on done: 5675.0 [2023-02-24 17:35:08,486][177156] Sum rewards: -5.462, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.730', 'AMMO5': '0.005', 'ARMOR': '0.012', 'WEAPON1': '0.040', 'AMMO2': '0.041', 'weapon5': '0.074', 'weapon4': '0.082', 'AMMO3': '0.127', 'WEAPON5': '0.150', 'AMMO4': '0.205', 'HITCOUNT': '0.260', 'WEAPON4': '0.350', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.807', 'weapon3': '1.364', 'weapon2': '1.950', 'FRAGCOUNT': '2.000'} [2023-02-24 17:35:08,786][177156] DAMAGECOUNT value on done: 6003.0 [2023-02-24 17:35:08,787][177156] Sum rewards: -5.472, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.815', 'AMMO2': '0.022', 'AMMO5': '0.024', 'ARMOR': '0.036', 'weapon4': '0.050', 'WEAPON1': '0.060', 'weapon5': '0.066', 'AMMO4': '0.107', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'HITCOUNT': '0.280', 'WEAPON5': '0.400', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.002', 'weapon2': '1.326', 'weapon3': '1.838'} [2023-02-24 17:35:09,015][177153] Updated weights for policy 0, policy_version 2500 (0.0008) [2023-02-24 17:35:09,021][177156] DAMAGECOUNT value on done: 5079.0 [2023-02-24 17:35:09,022][177156] Sum rewards: -2.494, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.644', 'AMMO2': '0.011', 'ARMOR': '0.012', 'AMMO5': '0.013', 'weapon4': '0.038', 'AMMO4': '0.056', 'WEAPON1': '0.070', 'AMMO3': '0.127', 'weapon5': '0.128', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.400', 'WEAPON3': '0.700', 'weapon3': '1.330', 'DAMAGECOUNT': '1.440', 'FRAGCOUNT': '2.000', 'weapon2': '2.024'} [2023-02-24 17:35:09,320][177156] DAMAGECOUNT value on done: 5827.0 [2023-02-24 17:35:09,321][177156] Sum rewards: -1.050, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.090', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.034', 'AMMO3': '0.082', 'weapon4': '0.120', 'WEAPON4': '0.150', 'HITCOUNT': '0.370', 'WEAPON3': '0.550', 'weapon3': '1.234', 'DAMAGECOUNT': '1.395', 'FRAGCOUNT': '2.000', 'weapon2': '2.328'} [2023-02-24 17:35:11,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14131.2, 300 sec: 13912.5). Total num frames: 10272768. Throughput: 0: 3524.8. Samples: 2565426. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:35:11,376][177119] Avg episode reward: [(0, '-3.162')] [2023-02-24 17:35:11,929][177153] Updated weights for policy 0, policy_version 2510 (0.0008) [2023-02-24 17:35:14,830][177153] Updated weights for policy 0, policy_version 2520 (0.0008) [2023-02-24 17:35:16,376][177119] Fps is (10 sec: 13926.5, 60 sec: 14131.2, 300 sec: 13912.5). Total num frames: 10342400. Throughput: 0: 3524.0. Samples: 2586518. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:35:16,376][177119] Avg episode reward: [(0, '-3.162')] [2023-02-24 17:35:17,735][177153] Updated weights for policy 0, policy_version 2530 (0.0008) [2023-02-24 17:35:20,623][177153] Updated weights for policy 0, policy_version 2540 (0.0008) [2023-02-24 17:35:21,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14131.2, 300 sec: 13898.6). Total num frames: 10412032. Throughput: 0: 3521.8. Samples: 2597106. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:35:21,376][177119] Avg episode reward: [(0, '-3.162')] [2023-02-24 17:35:23,553][177153] Updated weights for policy 0, policy_version 2550 (0.0008) [2023-02-24 17:35:23,756][177170] DAMAGECOUNT value on done: 5511.0 [2023-02-24 17:35:23,756][177170] Sum rewards: 0.038, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.480', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.018', 'ARMOR': '0.060', 'weapon5': '0.076', 'AMMO4': '0.089', 'weapon4': '0.160', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'HITCOUNT': '0.260', 'WEAPON4': '0.300', 'WEAPON3': '0.800', 'weapon3': '1.040', 'DAMAGECOUNT': '1.200', 'weapon2': '2.110', 'FRAGCOUNT': '4.000'} [2023-02-24 17:35:24,045][177170] DAMAGECOUNT value on done: 7908.0 [2023-02-24 17:35:24,045][177170] Sum rewards: -0.878, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.841', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.023', 'ARMOR': '0.024', 'WEAPON1': '0.100', 'AMMO3': '0.122', 'weapon5': '0.122', 'HITCOUNT': '0.280', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.098', 'weapon2': '1.628', 'weapon3': '1.784', 'FRAGCOUNT': '2.000'} [2023-02-24 17:35:24,125][177170] DAMAGECOUNT value on done: 5041.0 [2023-02-24 17:35:24,125][177170] Sum rewards: -5.097, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.556', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'AMMO4': '0.044', 'weapon5': '0.076', 'weapon4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.170', 'AMMO3': '0.185', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.627', 'WEAPON3': '0.750', 'weapon3': '1.352', 'weapon2': '1.832'} [2023-02-24 17:35:24,408][177172] DAMAGECOUNT value on done: 5345.0 [2023-02-24 17:35:24,409][177172] Sum rewards: -3.358, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.548', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'HITCOUNT': '0.060', 'AMMO3': '0.068', 'weapon5': '0.074', 'AMMO4': '0.097', 'DAMAGECOUNT': '0.150', 'weapon4': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.250', 'ARMOR': '0.528', 'weapon3': '0.642', 'weapon2': '2.096'} [2023-02-24 17:35:24,422][177170] DAMAGECOUNT value on done: 6421.0 [2023-02-24 17:35:24,423][177170] Sum rewards: -2.844, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.799', 'AMMO5': '0.015', 'AMMO2': '0.019', 'WEAPON1': '0.070', 'AMMO3': '0.085', 'AMMO4': '0.094', 'weapon4': '0.114', 'HITCOUNT': '0.120', 'weapon5': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.666', 'weapon3': '0.696', 'FRAGCOUNT': '2.000', 'weapon2': '2.034'} [2023-02-24 17:35:24,541][177158] DAMAGECOUNT value on done: 7087.0 [2023-02-24 17:35:24,542][177158] Sum rewards: -1.436, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.910', 'AMMO2': '0.007', 'AMMO5': '0.024', 'AMMO4': '0.033', 'WEAPON1': '0.070', 'AMMO3': '0.151', 'HITCOUNT': '0.170', 'weapon5': '0.358', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.488', 'weapon2': '1.502', 'DAMAGECOUNT': '1.671'} [2023-02-24 17:35:24,553][177154] DAMAGECOUNT value on done: 6524.0 [2023-02-24 17:35:24,702][177172] DAMAGECOUNT value on done: 5424.0 [2023-02-24 17:35:24,703][177172] Sum rewards: -2.035, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.716', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'ARMOR': '0.088', 'weapon4': '0.088', 'AMMO3': '0.115', 'HITCOUNT': '0.290', 'WEAPON4': '0.300', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.170', 'weapon3': '1.354', 'FRAGCOUNT': '2.000', 'weapon2': '2.214'} [2023-02-24 17:35:24,844][177158] DAMAGECOUNT value on done: 5734.0 [2023-02-24 17:35:24,844][177158] Sum rewards: -7.786, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.376', 'AMMO2': '0.012', 'AMMO5': '0.012', 'weapon4': '0.024', 'ARMOR': '0.032', 'AMMO4': '0.062', 'WEAPON1': '0.080', 'weapon5': '0.096', 'HITCOUNT': '0.110', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.441', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon3': '1.050', 'weapon2': '2.012'} [2023-02-24 17:35:24,849][177154] DAMAGECOUNT value on done: 5326.0 [2023-02-24 17:35:24,849][177154] Sum rewards: -7.068, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.970', 'AMMO5': '0.028', 'AMMO2': '0.036', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'weapon5': '0.130', 'AMMO3': '0.153', 'HITCOUNT': '0.160', 'weapon4': '0.164', 'AMMO4': '0.181', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'DAMAGECOUNT': '0.534', 'WEAPON3': '0.900', 'weapon3': '0.998', 'FRAGCOUNT': '2.000', 'weapon2': '2.178'} [2023-02-24 17:35:25,100][177158] DAMAGECOUNT value on done: 4893.0 [2023-02-24 17:35:25,101][177158] Sum rewards: -5.969, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.691', 'AMMO5': '0.017', 'AMMO2': '0.035', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'weapon4': '0.070', 'weapon5': '0.120', 'AMMO3': '0.149', 'HITCOUNT': '0.160', 'AMMO4': '0.172', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.870', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.334', 'weapon3': '1.684'} [2023-02-24 17:35:25,161][177154] DAMAGECOUNT value on done: 6598.0 [2023-02-24 17:35:25,162][177154] Sum rewards: -1.817, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.782', 'AMMO5': '0.015', 'AMMO2': '0.018', 'ARMOR': '0.024', 'WEAPON1': '0.050', 'weapon5': '0.072', 'AMMO4': '0.091', 'AMMO3': '0.115', 'HITCOUNT': '0.120', 'weapon4': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.315', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.550', 'weapon3': '1.516', 'weapon2': '1.706'} [2023-02-24 17:35:25,397][177158] DAMAGECOUNT value on done: 5835.0 [2023-02-24 17:35:25,398][177158] Sum rewards: -0.373, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.127', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'ARMOR': '0.076', 'AMMO3': '0.084', 'weapon5': '0.088', 'weapon4': '0.106', 'HITCOUNT': '0.110', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.783', 'weapon3': '0.998', 'FRAGCOUNT': '1.000', 'weapon2': '1.826'} [2023-02-24 17:35:25,433][177172] DAMAGECOUNT value on done: 4329.0 [2023-02-24 17:35:25,434][177172] Sum rewards: 1.213, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.064', 'AMMO2': '0.010', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'weapon4': '0.072', 'WEAPON1': '0.080', 'AMMO3': '0.101', 'weapon5': '0.116', 'HITCOUNT': '0.290', 'WEAPON5': '0.350', 'ARMOR': '0.500', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.083', 'weapon2': '1.468', 'weapon3': '1.788', 'FRAGCOUNT': '3.000'} [2023-02-24 17:35:25,465][177154] DAMAGECOUNT value on done: 6235.0 [2023-02-24 17:35:25,466][177154] Sum rewards: -2.147, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.283', 'AMMO5': '0.017', 'AMMO2': '0.034', 'WEAPON1': '0.040', 'weapon5': '0.084', 'weapon4': '0.096', 'AMMO3': '0.136', 'AMMO4': '0.169', 'WEAPON4': '0.200', 'HITCOUNT': '0.320', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.930', 'weapon3': '1.266', 'weapon2': '2.044', 'FRAGCOUNT': '3.000'} [2023-02-24 17:35:25,506][177171] DAMAGECOUNT value on done: 5534.0 [2023-02-24 17:35:25,507][177171] Sum rewards: -1.858, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.715', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.014', 'ARMOR': '0.024', 'WEAPON1': '0.040', 'weapon4': '0.102', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'HITCOUNT': '0.200', 'weapon5': '0.214', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'weapon3': '0.894', 'DAMAGECOUNT': '0.987', 'FRAGCOUNT': '2.000', 'weapon2': '2.374'} [2023-02-24 17:35:25,736][177172] DAMAGECOUNT value on done: 5374.0 [2023-02-24 17:35:25,737][177172] Sum rewards: -2.035, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.345', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.019', 'ARMOR': '0.032', 'WEAPON1': '0.060', 'HITCOUNT': '0.090', 'weapon4': '0.102', 'AMMO3': '0.106', 'weapon5': '0.200', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.345', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon3': '0.930', 'FRAGCOUNT': '1.000', 'weapon2': '2.020'} [2023-02-24 17:35:25,791][177171] DAMAGECOUNT value on done: 5729.0 [2023-02-24 17:35:25,791][177171] Sum rewards: -2.378, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.920', 'AMMO2': '0.009', 'AMMO5': '0.013', 'weapon7': '0.042', 'AMMO4': '0.046', 'WEAPON1': '0.050', 'ARMOR': '0.072', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'weapon5': '0.130', 'AMMO3': '0.132', 'weapon4': '0.146', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.477', 'WEAPON3': '0.700', 'weapon3': '0.888', 'FRAGCOUNT': '1.000', 'weapon2': '1.966'} [2023-02-24 17:35:25,799][177157] DAMAGECOUNT value on done: 6513.0 [2023-02-24 17:35:25,799][177157] Sum rewards: -0.970, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.774', 'AMMO5': '0.016', 'AMMO2': '0.022', 'ARMOR': '0.044', 'weapon4': '0.044', 'WEAPON1': '0.090', 'AMMO3': '0.103', 'AMMO4': '0.109', 'WEAPON4': '0.150', 'weapon5': '0.220', 'HITCOUNT': '0.330', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.500', 'weapon2': '1.502', 'weapon3': '1.612', 'DAMAGECOUNT': '2.061'} [2023-02-24 17:35:25,884][177155] DAMAGECOUNT value on done: 5266.0 [2023-02-24 17:35:25,885][177155] Sum rewards: -1.334, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.781', 'AMMO2': '0.012', 'AMMO5': '0.015', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'AMMO4': '0.060', 'weapon5': '0.074', 'AMMO3': '0.086', 'HITCOUNT': '0.220', 'WEAPON5': '0.250', 'weapon4': '0.278', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.798', 'weapon3': '1.016', 'weapon2': '1.998', 'FRAGCOUNT': '2.000'} [2023-02-24 17:35:25,960][177157] DAMAGECOUNT value on done: 6660.0 [2023-02-24 17:35:25,960][177157] Sum rewards: 1.453, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.742', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'weapon7': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.149', 'AMMO4': '0.158', 'weapon5': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.216', 'HITCOUNT': '0.270', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'weapon3': '1.416', 'DAMAGECOUNT': '1.419', 'weapon2': '1.528', 'FRAGCOUNT': '4.000'} [2023-02-24 17:35:26,106][177171] DAMAGECOUNT value on done: 6978.0 [2023-02-24 17:35:26,106][177171] Sum rewards: 1.279, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.824', 'AMMO2': '0.010', 'AMMO5': '0.019', 'AMMO4': '0.048', 'WEAPON1': '0.080', 'weapon5': '0.092', 'AMMO3': '0.111', 'weapon4': '0.148', 'WEAPON4': '0.200', 'HITCOUNT': '0.420', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'weapon3': '1.612', 'weapon2': '1.656', 'DAMAGECOUNT': '1.956', 'FRAGCOUNT': '3.000'} [2023-02-24 17:35:26,107][177157] DAMAGECOUNT value on done: 6138.0 [2023-02-24 17:35:26,107][177157] Sum rewards: -0.710, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.502', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.037', 'ARMOR': '0.060', 'weapon7': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.121', 'weapon5': '0.128', 'AMMO4': '0.187', 'WEAPON7': '0.200', 'weapon4': '0.214', 'WEAPON5': '0.250', 'HITCOUNT': '0.260', 'WEAPON4': '0.450', 'WEAPON3': '0.600', 'weapon3': '0.902', 'DAMAGECOUNT': '1.440', 'weapon2': '2.112', 'FRAGCOUNT': '3.000'} [2023-02-24 17:35:26,186][177155] DAMAGECOUNT value on done: 6641.0 [2023-02-24 17:35:26,187][177155] Sum rewards: -4.410, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.015', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'weapon4': '0.042', 'HEALTH': '0.084', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'HITCOUNT': '0.140', 'weapon5': '0.158', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.429', 'WEAPON3': '0.550', 'weapon3': '1.414', 'weapon2': '1.894'} [2023-02-24 17:35:26,258][177157] DAMAGECOUNT value on done: 5647.0 [2023-02-24 17:35:26,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14062.9, 300 sec: 13898.6). Total num frames: 10481664. Throughput: 0: 3515.8. Samples: 2618090. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:35:26,376][177119] Avg episode reward: [(0, '-2.984')] [2023-02-24 17:35:26,409][177171] DAMAGECOUNT value on done: 6112.0 [2023-02-24 17:35:26,410][177171] Sum rewards: -1.467, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.866', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'weapon4': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.112', 'weapon7': '0.136', 'AMMO3': '0.146', 'HITCOUNT': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'weapon2': '1.418', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.578', 'weapon3': '1.670'} [2023-02-24 17:35:26,453][177155] DAMAGECOUNT value on done: 6337.0 [2023-02-24 17:35:26,453][177155] Sum rewards: -2.515, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.164', 'AMMO5': '0.018', 'AMMO2': '0.029', 'WEAPON1': '0.050', 'weapon5': '0.072', 'weapon7': '0.072', 'HITCOUNT': '0.110', 'AMMO3': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.142', 'AMMO4': '0.144', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'ARMOR': '0.472', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.873', 'weapon2': '1.308', 'FRAGCOUNT': '1.500', 'weapon3': '1.602'} [2023-02-24 17:35:26,506][177153] Updated weights for policy 0, policy_version 2560 (0.0008) [2023-02-24 17:35:26,745][177155] DAMAGECOUNT value on done: 5366.0 [2023-02-24 17:35:26,746][177155] Sum rewards: 1.412, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.833', 'AMMO2': '0.004', 'AMMO5': '0.015', 'AMMO4': '0.021', 'ARMOR': '0.036', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.148', 'weapon5': '0.176', 'weapon4': '0.184', 'HITCOUNT': '0.280', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.287', 'weapon2': '1.450', 'weapon3': '1.614', 'FRAGCOUNT': '5.000'} [2023-02-24 17:35:27,640][177156] DAMAGECOUNT value on done: 6020.0 [2023-02-24 17:35:27,640][177156] Sum rewards: -5.467, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.919', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'weapon4': '0.034', 'ARMOR': '0.044', 'AMMO3': '0.083', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.035', 'weapon3': '1.300', 'FRAGCOUNT': '2.000', 'weapon2': '2.120'} [2023-02-24 17:35:27,928][177156] DAMAGECOUNT value on done: 6340.0 [2023-02-24 17:35:27,929][177156] Sum rewards: -1.744, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.563', 'AMMO5': '0.007', 'weapon4': '0.026', 'AMMO2': '0.028', 'ARMOR': '0.060', 'weapon5': '0.060', 'WEAPON1': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'AMMO4': '0.139', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'WEAPON3': '0.600', 'weapon3': '0.980', 'DAMAGECOUNT': '1.011', 'FRAGCOUNT': '2.000', 'weapon2': '2.344'} [2023-02-24 17:35:28,141][177156] DAMAGECOUNT value on done: 5185.0 [2023-02-24 17:35:28,430][177156] DAMAGECOUNT value on done: 6114.0 [2023-02-24 17:35:28,431][177156] Sum rewards: -0.484, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.980', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'ARMOR': '0.032', 'weapon5': '0.076', 'AMMO4': '0.088', 'AMMO3': '0.136', 'WEAPON5': '0.150', 'weapon4': '0.198', 'HITCOUNT': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.861', 'weapon3': '1.374', 'weapon2': '1.796', 'FRAGCOUNT': '3.000'} [2023-02-24 17:35:29,349][177153] Updated weights for policy 0, policy_version 2570 (0.0009) [2023-02-24 17:35:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 13898.6). Total num frames: 10551296. Throughput: 0: 3516.2. Samples: 2639280. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 17:35:31,376][177119] Avg episode reward: [(0, '-2.850')] [2023-02-24 17:35:32,255][177153] Updated weights for policy 0, policy_version 2580 (0.0008) [2023-02-24 17:35:35,181][177153] Updated weights for policy 0, policy_version 2590 (0.0009) [2023-02-24 17:35:36,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14131.2, 300 sec: 13912.5). Total num frames: 10625024. Throughput: 0: 3518.0. Samples: 2649836. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:35:36,376][177119] Avg episode reward: [(0, '-2.850')] [2023-02-24 17:35:38,102][177153] Updated weights for policy 0, policy_version 2600 (0.0008) [2023-02-24 17:35:40,977][177153] Updated weights for policy 0, policy_version 2610 (0.0008) [2023-02-24 17:35:41,376][177119] Fps is (10 sec: 14335.9, 60 sec: 14062.9, 300 sec: 13898.6). Total num frames: 10694656. Throughput: 0: 3518.7. Samples: 2671000. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 17:35:41,376][177119] Avg episode reward: [(0, '-2.850')] [2023-02-24 17:35:42,207][177157] Large shaping reward 2.595 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5730000000000001, 191.0), ('weapon5', 0.002)] [2023-02-24 17:35:42,860][177170] DAMAGECOUNT value on done: 5572.0 [2023-02-24 17:35:42,860][177170] Sum rewards: -3.002, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.582', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.021', 'AMMO5': '0.022', 'weapon4': '0.038', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'HITCOUNT': '0.080', 'AMMO3': '0.084', 'AMMO4': '0.103', 'weapon5': '0.168', 'DAMAGECOUNT': '0.183', 'WEAPON5': '0.400', 'WEAPON3': '0.400', 'weapon3': '1.130', 'weapon2': '2.060'} [2023-02-24 17:35:43,156][177170] DAMAGECOUNT value on done: 8321.0 [2023-02-24 17:35:43,157][177170] Sum rewards: -3.449, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.632', 'AMMO2': '0.006', 'ARMOR': '0.020', 'AMMO5': '0.025', 'AMMO4': '0.029', 'weapon4': '0.096', 'WEAPON1': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.158', 'weapon5': '0.190', 'HITCOUNT': '0.320', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.239', 'weapon2': '1.284', 'weapon3': '1.716', 'FRAGCOUNT': '2.000'} [2023-02-24 17:35:43,221][177170] DAMAGECOUNT value on done: 5333.0 [2023-02-24 17:35:43,221][177170] Sum rewards: -2.589, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.332', 'AMMO5': '0.007', 'AMMO2': '0.036', 'WEAPON1': '0.050', 'AMMO3': '0.102', 'WEAPON5': '0.150', 'weapon5': '0.152', 'AMMO4': '0.181', 'HITCOUNT': '0.190', 'WEAPON4': '0.350', 'weapon4': '0.368', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.876', 'FRAGCOUNT': '1.000', 'weapon3': '1.158', 'weapon2': '1.572'} [2023-02-24 17:35:43,438][177172] DAMAGECOUNT value on done: 5703.0 [2023-02-24 17:35:43,438][177172] Sum rewards: -1.725, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.629', 'AMMO5': '0.015', 'AMMO2': '0.020', 'WEAPON1': '0.070', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'AMMO3': '0.139', 'HITCOUNT': '0.220', 'weapon4': '0.248', 'weapon5': '0.258', 'WEAPON5': '0.300', 'ARMOR': '0.503', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.074', 'weapon3': '1.444', 'weapon2': '1.564', 'FRAGCOUNT': '2.000'} [2023-02-24 17:35:43,524][177170] DAMAGECOUNT value on done: 7159.0 [2023-02-24 17:35:43,525][177170] Sum rewards: 4.864, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.022', 'ARMOR': '0.036', 'WEAPON1': '0.040', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'WEAPON5': '0.200', 'weapon5': '0.252', 'HITCOUNT': '0.260', 'HEALTH': '0.274', 'WEAPON3': '0.300', 'weapon3': '1.112', 'weapon2': '1.860', 'DAMAGECOUNT': '2.190', 'FRAGCOUNT': '4.000'} [2023-02-24 17:35:43,597][177158] DAMAGECOUNT value on done: 7536.0 [2023-02-24 17:35:43,598][177158] Sum rewards: 1.829, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.603', 'AMMO2': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.033', 'ARMOR': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.390', 'WEAPON3': '0.600', 'weapon3': '1.168', 'DAMAGECOUNT': '1.347', 'weapon2': '1.986', 'FRAGCOUNT': '3.000'} [2023-02-24 17:35:43,662][177154] DAMAGECOUNT value on done: 6746.0 [2023-02-24 17:35:43,663][177154] Sum rewards: -3.993, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.475', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.012', 'weapon5': '0.022', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.052', 'AMMO3': '0.131', 'HITCOUNT': '0.220', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.666', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.618', 'weapon2': '1.676'} [2023-02-24 17:35:43,743][177172] DAMAGECOUNT value on done: 5907.0 [2023-02-24 17:35:43,744][177172] Sum rewards: -6.513, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.180', 'AMMO2': '0.003', 'AMMO4': '0.014', 'ARMOR': '0.020', 'AMMO5': '0.024', 'AMMO3': '0.103', 'WEAPON1': '0.110', 'HITCOUNT': '0.260', 'weapon5': '0.316', 'WEAPON3': '0.550', 'WEAPON5': '0.550', 'weapon3': '0.832', 'DAMAGECOUNT': '1.449', 'FRAGCOUNT': '1.500', 'weapon2': '1.936'} [2023-02-24 17:35:43,909][177153] Updated weights for policy 0, policy_version 2620 (0.0008) [2023-02-24 17:35:43,909][177158] DAMAGECOUNT value on done: 5964.0 [2023-02-24 17:35:43,910][177158] Sum rewards: -5.570, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.396', 'weapon4': '0.006', 'AMMO2': '0.010', 'AMMO5': '0.010', 'AMMO4': '0.048', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'ARMOR': '0.060', 'weapon5': '0.086', 'HITCOUNT': '0.150', 'AMMO3': '0.160', 'WEAPON5': '0.250', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.690', 'WEAPON3': '0.850', 'weapon3': '1.698', 'weapon2': '1.708'} [2023-02-24 17:35:43,966][177154] DAMAGECOUNT value on done: 5684.0 [2023-02-24 17:35:43,967][177154] Sum rewards: -2.010, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.393', 'AMMO2': '0.007', 'AMMO5': '0.017', 'AMMO4': '0.035', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.064', 'AMMO3': '0.125', 'weapon5': '0.236', 'HITCOUNT': '0.300', 'WEAPON5': '0.400', 'ARMOR': '0.408', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.074', 'weapon3': '1.414', 'weapon2': '1.752'} [2023-02-24 17:35:44,132][177158] DAMAGECOUNT value on done: 5238.0 [2023-02-24 17:35:44,133][177158] Sum rewards: 2.505, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'AMMO2': '0.017', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'HEALTH': '0.053', 'weapon5': '0.054', 'WEAPON1': '0.060', 'AMMO4': '0.086', 'AMMO3': '0.120', 'weapon4': '0.148', 'WEAPON5': '0.250', 'HITCOUNT': '0.270', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.035', 'weapon2': '1.242', 'weapon3': '1.574', 'FRAGCOUNT': '3.000'} [2023-02-24 17:35:44,259][177154] DAMAGECOUNT value on done: 6847.0 [2023-02-24 17:35:44,259][177154] Sum rewards: -2.109, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.020', 'AMMO2': '0.027', 'AMMO5': '0.028', 'WEAPON1': '0.030', 'ARMOR': '0.068', 'weapon4': '0.084', 'AMMO4': '0.134', 'HITCOUNT': '0.150', 'weapon5': '0.152', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.650', 'DAMAGECOUNT': '0.747', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.500', 'weapon3': '1.520', 'weapon2': '1.668'} [2023-02-24 17:35:44,433][177158] DAMAGECOUNT value on done: 6060.0 [2023-02-24 17:35:44,433][177158] Sum rewards: 0.010, reward structure: {'DEATHCOUNT': '-9.000', 'weapon5': '0.010', 'AMMO2': '0.019', 'AMMO5': '0.025', 'weapon4': '0.036', 'WEAPON1': '0.070', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.143', 'HITCOUNT': '0.200', 'HEALTH': '0.250', 'WEAPON5': '0.500', 'DAMAGECOUNT': '0.675', 'WEAPON3': '0.750', 'weapon2': '1.018', 'weapon3': '2.120', 'FRAGCOUNT': '3.000'} [2023-02-24 17:35:44,477][177172] DAMAGECOUNT value on done: 4833.0 [2023-02-24 17:35:44,478][177172] Sum rewards: 2.245, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.651', 'AMMO5': '0.005', 'AMMO2': '0.028', 'ARMOR': '0.040', 'WEAPON1': '0.040', 'AMMO3': '0.079', 'weapon5': '0.104', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'HITCOUNT': '0.290', 'weapon4': '0.418', 'WEAPON3': '0.500', 'weapon3': '0.904', 'DAMAGECOUNT': '1.512', 'weapon2': '1.936', 'FRAGCOUNT': '4.000'} [2023-02-24 17:35:44,559][177154] DAMAGECOUNT value on done: 6541.0 [2023-02-24 17:35:44,559][177154] Sum rewards: -0.999, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.250', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon7': '0.038', 'ARMOR': '0.040', 'WEAPON1': '0.060', 'weapon4': '0.118', 'AMMO3': '0.130', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'weapon5': '0.154', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.230', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.918', 'weapon3': '1.148', 'weapon2': '1.948', 'FRAGCOUNT': '2.000'} [2023-02-24 17:35:44,639][177171] DAMAGECOUNT value on done: 5804.0 [2023-02-24 17:35:44,640][177171] Sum rewards: -2.251, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.920', 'ARMOR': '0.008', 'AMMO2': '0.013', 'AMMO5': '0.024', 'weapon4': '0.060', 'AMMO4': '0.066', 'AMMO3': '0.068', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.138', 'HITCOUNT': '0.150', 'WEAPON3': '0.300', 'WEAPON5': '0.450', 'FRAGCOUNT': '0.500', 'weapon3': '0.772', 'DAMAGECOUNT': '0.810', 'weapon2': '1.880'} [2023-02-24 17:35:44,786][177172] DAMAGECOUNT value on done: 5693.0 [2023-02-24 17:35:44,787][177172] Sum rewards: -1.971, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.354', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'AMMO4': '0.098', 'weapon5': '0.106', 'AMMO3': '0.112', 'WEAPON4': '0.150', 'weapon4': '0.184', 'HITCOUNT': '0.230', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'weapon3': '0.846', 'DAMAGECOUNT': '0.957', 'weapon2': '1.760', 'FRAGCOUNT': '2.000'} [2023-02-24 17:35:44,900][177157] DAMAGECOUNT value on done: 6646.0 [2023-02-24 17:35:44,935][177171] DAMAGECOUNT value on done: 5897.0 [2023-02-24 17:35:44,936][177171] Sum rewards: 1.019, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.179', 'AMMO5': '0.015', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.055', 'WEAPON1': '0.070', 'AMMO4': '0.102', 'HITCOUNT': '0.160', 'weapon4': '0.176', 'WEAPON3': '0.250', 'weapon5': '0.272', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.504', 'weapon3': '0.824', 'FRAGCOUNT': '1.000', 'weapon2': '1.850'} [2023-02-24 17:35:44,985][177155] DAMAGECOUNT value on done: 5381.0 [2023-02-24 17:35:45,039][177157] DAMAGECOUNT value on done: 7346.0 [2023-02-24 17:35:45,040][177157] Sum rewards: -6.019, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.556', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.019', 'WEAPON1': '0.050', 'AMMO4': '0.094', 'AMMO3': '0.125', 'weapon5': '0.162', 'HITCOUNT': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.412', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.046', 'weapon2': '1.732', 'DAMAGECOUNT': '2.058'} [2023-02-24 17:35:45,200][177157] DAMAGECOUNT value on done: 6511.0 [2023-02-24 17:35:45,201][177157] Sum rewards: -1.230, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.302', 'AMMO2': '0.012', 'AMMO5': '0.020', 'AMMO4': '0.062', 'ARMOR': '0.064', 'AMMO3': '0.120', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'weapon5': '0.216', 'weapon4': '0.248', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.119', 'weapon2': '1.394', 'weapon3': '1.496', 'FRAGCOUNT': '2.000'} [2023-02-24 17:35:45,235][177171] DAMAGECOUNT value on done: 7130.0 [2023-02-24 17:35:45,283][177155] DAMAGECOUNT value on done: 6955.0 [2023-02-24 17:35:45,284][177155] Sum rewards: -5.414, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.178', 'FRAGCOUNT': '0.000', 'AMMO5': '0.017', 'AMMO2': '0.028', 'ARMOR': '0.032', 'weapon4': '0.044', 'WEAPON1': '0.060', 'AMMO4': '0.137', 'AMMO3': '0.138', 'HITCOUNT': '0.160', 'weapon5': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.942', 'weapon3': '1.116', 'weapon2': '2.164'} [2023-02-24 17:35:45,347][177157] DAMAGECOUNT value on done: 5864.0 [2023-02-24 17:35:45,348][177157] Sum rewards: -4.776, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.822', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon5': '0.042', 'WEAPON1': '0.050', 'ARMOR': '0.052', 'weapon7': '0.054', 'weapon4': '0.088', 'AMMO3': '0.107', 'AMMO4': '0.111', 'HITCOUNT': '0.160', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.651', 'weapon3': '1.204', 'weapon2': '1.872'} [2023-02-24 17:35:45,529][177171] DAMAGECOUNT value on done: 6380.0 [2023-02-24 17:35:45,530][177171] Sum rewards: -4.220, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.764', 'AMMO5': '0.012', 'ARMOR': '0.020', 'weapon5': '0.022', 'WEAPON1': '0.030', 'AMMO2': '0.033', 'AMMO3': '0.113', 'AMMO4': '0.163', 'HITCOUNT': '0.190', 'WEAPON5': '0.250', 'weapon4': '0.268', 'WEAPON4': '0.350', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.804', 'weapon3': '1.120', 'weapon2': '1.768'} [2023-02-24 17:35:45,561][177155] DAMAGECOUNT value on done: 6852.0 [2023-02-24 17:35:45,561][177155] Sum rewards: 0.812, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.122', 'AMMO5': '0.015', 'ARMOR': '0.024', 'AMMO2': '0.028', 'WEAPON1': '0.050', 'weapon5': '0.120', 'AMMO3': '0.127', 'AMMO4': '0.141', 'HITCOUNT': '0.250', 'weapon4': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'weapon2': '1.332', 'DAMAGECOUNT': '1.545', 'weapon3': '1.698', 'FRAGCOUNT': '3.000'} [2023-02-24 17:35:45,867][177155] DAMAGECOUNT value on done: 5763.0 [2023-02-24 17:35:45,867][177155] Sum rewards: -3.214, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.000', 'HEALTH': '-0.240', 'AMMO5': '0.018', 'AMMO2': '0.027', 'ARMOR': '0.032', 'weapon4': '0.032', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.097', 'AMMO4': '0.133', 'HITCOUNT': '0.230', 'weapon5': '0.278', 'WEAPON3': '0.450', 'WEAPON5': '0.500', 'DAMAGECOUNT': '1.191', 'weapon3': '1.344', 'weapon2': '1.834'} [2023-02-24 17:35:46,376][177119] Fps is (10 sec: 13926.5, 60 sec: 14062.9, 300 sec: 13898.6). Total num frames: 10764288. Throughput: 0: 3512.7. Samples: 2691924. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 17:35:46,376][177119] Avg episode reward: [(0, '-2.540')] [2023-02-24 17:35:46,379][177140] Saving new best policy, reward=-2.540! [2023-02-24 17:35:46,786][177156] DAMAGECOUNT value on done: 6299.0 [2023-02-24 17:35:46,786][177156] Sum rewards: -4.469, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.520', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.029', 'ARMOR': '0.040', 'WEAPON1': '0.040', 'HITCOUNT': '0.100', 'AMMO3': '0.122', 'weapon5': '0.182', 'weapon4': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon3': '0.768', 'DAMAGECOUNT': '0.837', 'FRAGCOUNT': '2.000', 'weapon2': '2.092'} [2023-02-24 17:35:46,877][177153] Updated weights for policy 0, policy_version 2630 (0.0008) [2023-02-24 17:35:47,087][177156] DAMAGECOUNT value on done: 6759.0 [2023-02-24 17:35:47,087][177156] Sum rewards: -2.544, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.782', 'AMMO5': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.050', 'weapon4': '0.072', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'HITCOUNT': '0.210', 'weapon5': '0.294', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'weapon3': '0.668', 'DAMAGECOUNT': '1.257', 'weapon2': '2.268', 'FRAGCOUNT': '3.000'} [2023-02-24 17:35:47,321][177156] DAMAGECOUNT value on done: 5457.0 [2023-02-24 17:35:47,322][177156] Sum rewards: -2.172, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.216', 'AMMO2': '0.005', 'AMMO5': '0.015', 'weapon4': '0.018', 'AMMO4': '0.022', 'ARMOR': '0.028', 'AMMO3': '0.074', 'WEAPON1': '0.090', 'weapon5': '0.162', 'WEAPON4': '0.200', 'HITCOUNT': '0.230', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.816', 'weapon2': '1.472', 'weapon3': '1.562', 'FRAGCOUNT': '2.000'} [2023-02-24 17:35:47,618][177156] DAMAGECOUNT value on done: 6510.0 [2023-02-24 17:35:47,619][177156] Sum rewards: -4.626, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.546', 'FRAGCOUNT': '-0.500', 'ARMOR': '0.020', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO2': '0.029', 'AMMO3': '0.077', 'weapon4': '0.086', 'AMMO4': '0.143', 'HITCOUNT': '0.220', 'WEAPON4': '0.300', 'weapon5': '0.382', 'WEAPON3': '0.400', 'WEAPON5': '0.550', 'weapon3': '0.576', 'DAMAGECOUNT': '1.188', 'weapon2': '2.408'} [2023-02-24 17:35:49,791][177153] Updated weights for policy 0, policy_version 2640 (0.0009) [2023-02-24 17:35:51,376][177119] Fps is (10 sec: 13926.5, 60 sec: 14062.9, 300 sec: 13898.6). Total num frames: 10833920. Throughput: 0: 3513.0. Samples: 2702480. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:35:51,376][177119] Avg episode reward: [(0, '-2.540')] [2023-02-24 17:35:52,705][177153] Updated weights for policy 0, policy_version 2650 (0.0008) [2023-02-24 17:35:55,611][177153] Updated weights for policy 0, policy_version 2660 (0.0009) [2023-02-24 17:35:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14062.9, 300 sec: 13898.6). Total num frames: 10903552. Throughput: 0: 3514.4. Samples: 2723574. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:35:56,376][177119] Avg episode reward: [(0, '-2.540')] [2023-02-24 17:35:58,531][177153] Updated weights for policy 0, policy_version 2670 (0.0008) [2023-02-24 17:36:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 13884.7). Total num frames: 10973184. Throughput: 0: 3517.5. Samples: 2744804. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:36:01,376][177119] Avg episode reward: [(0, '-2.540')] [2023-02-24 17:36:01,435][177153] Updated weights for policy 0, policy_version 2680 (0.0008) [2023-02-24 17:36:01,960][177170] DAMAGECOUNT value on done: 5808.0 [2023-02-24 17:36:01,961][177170] Sum rewards: -4.752, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.050', 'AMMO5': '0.012', 'AMMO2': '0.015', 'ARMOR': '0.036', 'WEAPON1': '0.060', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'weapon5': '0.132', 'AMMO3': '0.169', 'weapon4': '0.176', 'HITCOUNT': '0.210', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.708', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.274', 'weapon3': '1.628'} [2023-02-24 17:36:02,290][177170] DAMAGECOUNT value on done: 8927.0 [2023-02-24 17:36:02,291][177170] Sum rewards: 1.909, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.803', 'AMMO2': '0.006', 'ARMOR': '0.024', 'AMMO5': '0.025', 'AMMO4': '0.028', 'weapon4': '0.052', 'WEAPON1': '0.070', 'WEAPON4': '0.150', 'AMMO3': '0.154', 'weapon5': '0.158', 'HITCOUNT': '0.330', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'weapon3': '1.378', 'DAMAGECOUNT': '1.818', 'weapon2': '1.920', 'FRAGCOUNT': '6.000'} [2023-02-24 17:36:02,361][177170] DAMAGECOUNT value on done: 5838.0 [2023-02-24 17:36:02,361][177170] Sum rewards: 2.224, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.255', 'AMMO2': '0.008', 'AMMO5': '0.013', 'AMMO4': '0.039', 'WEAPON1': '0.060', 'weapon5': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'weapon4': '0.162', 'WEAPON5': '0.250', 'HITCOUNT': '0.250', 'WEAPON3': '0.650', 'weapon2': '1.216', 'DAMAGECOUNT': '1.515', 'weapon3': '1.524', 'FRAGCOUNT': '5.000'} [2023-02-24 17:36:02,600][177172] DAMAGECOUNT value on done: 5913.0 [2023-02-24 17:36:02,600][177172] Sum rewards: 0.062, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.580', 'AMMO5': '0.015', 'AMMO2': '0.017', 'ARMOR': '0.032', 'WEAPON1': '0.050', 'AMMO4': '0.085', 'AMMO3': '0.104', 'weapon5': '0.148', 'HITCOUNT': '0.150', 'weapon4': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.630', 'weapon3': '1.326', 'weapon2': '1.706', 'FRAGCOUNT': '2.000'} [2023-02-24 17:36:02,657][177170] DAMAGECOUNT value on done: 7679.0 [2023-02-24 17:36:02,658][177170] Sum rewards: -0.995, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.515', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.021', 'ARMOR': '0.040', 'WEAPON1': '0.040', 'weapon5': '0.058', 'weapon4': '0.074', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.360', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.560', 'weapon2': '1.592', 'weapon3': '1.862', 'FRAGCOUNT': '2.000'} [2023-02-24 17:36:02,658][177158] DAMAGECOUNT value on done: 7930.0 [2023-02-24 17:36:02,659][177158] Sum rewards: 1.879, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.434', 'AMMO5': '0.021', 'AMMO2': '0.024', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'AMMO4': '0.118', 'weapon5': '0.138', 'HITCOUNT': '0.320', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.182', 'weapon3': '1.598', 'weapon2': '1.678', 'FRAGCOUNT': '2.000'} [2023-02-24 17:36:02,748][177154] DAMAGECOUNT value on done: 6885.0 [2023-02-24 17:36:02,749][177154] Sum rewards: -3.977, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.164', 'AMMO5': '0.025', 'AMMO2': '0.030', 'ARMOR': '0.036', 'WEAPON1': '0.050', 'weapon5': '0.090', 'weapon4': '0.092', 'HITCOUNT': '0.140', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'AMMO4': '0.151', 'DAMAGECOUNT': '0.417', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.706', 'weapon3': '1.706'} [2023-02-24 17:36:02,894][177172] DAMAGECOUNT value on done: 5992.0 [2023-02-24 17:36:02,894][177172] Sum rewards: -8.665, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.900', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.011', 'AMMO5': '0.014', 'WEAPON1': '0.040', 'AMMO4': '0.054', 'AMMO3': '0.063', 'HITCOUNT': '0.080', 'weapon4': '0.080', 'weapon5': '0.172', 'WEAPON4': '0.200', 'WEAPON3': '0.250', 'DAMAGECOUNT': '0.255', 'WEAPON5': '0.350', 'weapon3': '0.512', 'weapon2': '2.904'} [2023-02-24 17:36:02,952][177158] DAMAGECOUNT value on done: 6080.0 [2023-02-24 17:36:02,953][177158] Sum rewards: -0.522, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.840', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO4': '0.036', 'AMMO3': '0.050', 'weapon5': '0.064', 'ARMOR': '0.073', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon7': '0.234', 'weapon4': '0.242', 'WEAPON3': '0.300', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.348', 'weapon3': '0.646', 'FRAGCOUNT': '1.000', 'weapon2': '1.520'} [2023-02-24 17:36:03,045][177154] DAMAGECOUNT value on done: 5880.0 [2023-02-24 17:36:03,045][177154] Sum rewards: -1.487, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.334', 'AMMO2': '0.015', 'AMMO5': '0.020', 'weapon4': '0.040', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.077', 'weapon5': '0.086', 'AMMO3': '0.127', 'HITCOUNT': '0.140', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'DAMAGECOUNT': '0.588', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.746', 'weapon2': '1.748'} [2023-02-24 17:36:03,172][177158] DAMAGECOUNT value on done: 5628.0 [2023-02-24 17:36:03,172][177158] Sum rewards: -1.757, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.897', 'AMMO5': '0.025', 'AMMO2': '0.032', 'WEAPON1': '0.040', 'weapon5': '0.084', 'AMMO4': '0.160', 'AMMO3': '0.166', 'weapon4': '0.192', 'WEAPON4': '0.300', 'HITCOUNT': '0.300', 'WEAPON5': '0.400', 'ARMOR': '0.548', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.170', 'weapon3': '1.542', 'weapon2': '1.630'} [2023-02-24 17:36:03,362][177154] DAMAGECOUNT value on done: 7436.0 [2023-02-24 17:36:03,362][177154] Sum rewards: -2.322, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.314', 'AMMO2': '0.015', 'AMMO5': '0.020', 'WEAPON1': '0.050', 'weapon4': '0.054', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'weapon5': '0.210', 'WEAPON5': '0.350', 'HITCOUNT': '0.460', 'WEAPON3': '0.850', 'weapon3': '1.280', 'DAMAGECOUNT': '1.767', 'weapon2': '1.784', 'FRAGCOUNT': '3.000'} [2023-02-24 17:36:03,471][177158] DAMAGECOUNT value on done: 6307.0 [2023-02-24 17:36:03,471][177158] Sum rewards: 2.439, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.010', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'HITCOUNT': '0.050', 'weapon4': '0.052', 'weapon7': '0.060', 'ARMOR': '0.064', 'AMMO3': '0.065', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'HEALTH': '0.140', 'weapon5': '0.154', 'WEAPON5': '0.200', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.741', 'FRAGCOUNT': '1.000', 'weapon3': '1.052', 'weapon2': '1.842'} [2023-02-24 17:36:03,648][177154] DAMAGECOUNT value on done: 6931.0 [2023-02-24 17:36:03,649][177154] Sum rewards: 1.917, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.282', 'AMMO2': '0.008', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO4': '0.039', 'WEAPON1': '0.070', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'weapon7': '0.114', 'weapon5': '0.154', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.202', 'HITCOUNT': '0.220', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'weapon3': '1.134', 'DAMAGECOUNT': '1.170', 'weapon2': '1.310', 'FRAGCOUNT': '4.000'} [2023-02-24 17:36:03,656][177172] DAMAGECOUNT value on done: 4937.0 [2023-02-24 17:36:03,656][177172] Sum rewards: -5.233, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.450', 'AMMO5': '0.018', 'weapon5': '0.024', 'AMMO2': '0.053', 'WEAPON1': '0.060', 'HITCOUNT': '0.090', 'weapon4': '0.098', 'ARMOR': '0.100', 'AMMO3': '0.199', 'AMMO4': '0.263', 'DAMAGECOUNT': '0.312', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '1.650', 'weapon2': '1.700', 'FRAGCOUNT': '2.000'} [2023-02-24 17:36:03,796][177171] DAMAGECOUNT value on done: 6146.0 [2023-02-24 17:36:03,796][177171] Sum rewards: -2.793, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.208', 'AMMO2': '0.008', 'AMMO5': '0.017', 'weapon5': '0.018', 'ARMOR': '0.032', 'AMMO4': '0.041', 'WEAPON1': '0.070', 'AMMO3': '0.142', 'HITCOUNT': '0.270', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.026', 'weapon2': '1.522', 'weapon3': '1.768', 'FRAGCOUNT': '2.000'} [2023-02-24 17:36:03,957][177172] DAMAGECOUNT value on done: 5962.0 [2023-02-24 17:36:03,957][177172] Sum rewards: -1.048, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.697', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.032', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.092', 'weapon5': '0.120', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.807', 'weapon3': '0.998', 'FRAGCOUNT': '2.000', 'weapon2': '2.056'} [2023-02-24 17:36:04,082][177157] DAMAGECOUNT value on done: 6971.0 [2023-02-24 17:36:04,082][177157] Sum rewards: -3.525, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.088', 'AMMO5': '0.018', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'AMMO3': '0.100', 'AMMO4': '0.116', 'weapon5': '0.162', 'WEAPON4': '0.250', 'weapon4': '0.276', 'WEAPON3': '0.300', 'HITCOUNT': '0.370', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.975', 'weapon3': '1.184', 'weapon2': '1.848'} [2023-02-24 17:36:04,095][177171] DAMAGECOUNT value on done: 6027.0 [2023-02-24 17:36:04,096][177171] Sum rewards: -0.861, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.793', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.021', 'WEAPON1': '0.050', 'weapon7': '0.064', 'AMMO3': '0.066', 'HITCOUNT': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'weapon5': '0.198', 'weapon4': '0.200', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.400', 'weapon3': '0.620', 'FRAGCOUNT': '1.000', 'weapon2': '2.014'} [2023-02-24 17:36:04,109][177155] DAMAGECOUNT value on done: 5832.0 [2023-02-24 17:36:04,110][177155] Sum rewards: -3.025, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.109', 'AMMO2': '0.014', 'AMMO5': '0.028', 'AMMO4': '0.068', 'WEAPON1': '0.070', 'weapon5': '0.136', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'HITCOUNT': '0.260', 'weapon4': '0.406', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon2': '1.222', 'DAMAGECOUNT': '1.353', 'weapon3': '1.430', 'FRAGCOUNT': '2.000'} [2023-02-24 17:36:04,258][177157] DAMAGECOUNT value on done: 7771.0 [2023-02-24 17:36:04,258][177157] Sum rewards: -1.276, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.385', 'AMMO2': '0.009', 'AMMO5': '0.022', 'AMMO4': '0.043', 'AMMO3': '0.112', 'WEAPON1': '0.120', 'weapon5': '0.212', 'HITCOUNT': '0.280', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.275', 'weapon2': '1.328', 'weapon3': '1.708', 'FRAGCOUNT': '3.000'} [2023-02-24 17:36:04,378][177153] Updated weights for policy 0, policy_version 2690 (0.0009) [2023-02-24 17:36:04,399][177157] DAMAGECOUNT value on done: 6891.0 [2023-02-24 17:36:04,399][177157] Sum rewards: 4.761, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.012', 'AMMO2': '0.028', 'ARMOR': '0.032', 'WEAPON1': '0.060', 'AMMO3': '0.070', 'AMMO4': '0.140', 'weapon5': '0.174', 'HEALTH': '0.194', 'HITCOUNT': '0.210', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'DAMAGECOUNT': '1.140', 'weapon2': '1.174', 'weapon3': '1.576', 'FRAGCOUNT': '3.000'} [2023-02-24 17:36:04,407][177171] DAMAGECOUNT value on done: 7475.0 [2023-02-24 17:36:04,407][177171] Sum rewards: -4.269, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.925', 'AMMO2': '0.022', 'AMMO5': '0.036', 'weapon5': '0.066', 'weapon7': '0.074', 'WEAPON1': '0.080', 'AMMO4': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.136', 'WEAPON7': '0.200', 'weapon4': '0.268', 'HITCOUNT': '0.270', 'WEAPON4': '0.400', 'WEAPON5': '0.650', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.035', 'weapon3': '1.234', 'weapon2': '1.684', 'FRAGCOUNT': '2.000'} [2023-02-24 17:36:04,412][177155] DAMAGECOUNT value on done: 7532.0 [2023-02-24 17:36:04,413][177155] Sum rewards: -1.113, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.912', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.026', 'AMMO2': '0.041', 'weapon7': '0.070', 'ARMOR': '0.097', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.127', 'WEAPON7': '0.200', 'AMMO4': '0.204', 'weapon4': '0.242', 'WEAPON5': '0.250', 'HITCOUNT': '0.310', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'weapon3': '1.126', 'DAMAGECOUNT': '1.731', 'weapon2': '1.852', 'FRAGCOUNT': '2.000'} [2023-02-24 17:36:04,570][177157] DAMAGECOUNT value on done: 6077.0 [2023-02-24 17:36:04,692][177155] DAMAGECOUNT value on done: 7634.0 [2023-02-24 17:36:04,693][177155] Sum rewards: 3.856, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.794', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO5': '0.015', 'WEAPON1': '0.070', 'AMMO3': '0.106', 'weapon5': '0.264', 'HITCOUNT': '0.290', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'weapon3': '1.110', 'weapon2': '1.786', 'DAMAGECOUNT': '2.346', 'FRAGCOUNT': '4.500'} [2023-02-24 17:36:04,709][177171] DAMAGECOUNT value on done: 6638.0 [2023-02-24 17:36:04,710][177171] Sum rewards: -1.439, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.262', 'AMMO2': '0.015', 'AMMO5': '0.024', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.074', 'WEAPON1': '0.080', 'weapon4': '0.090', 'AMMO3': '0.124', 'weapon5': '0.180', 'HITCOUNT': '0.200', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.774', 'FRAGCOUNT': '1.000', 'weapon3': '1.396', 'weapon2': '1.476'} [2023-02-24 17:36:04,991][177155] DAMAGECOUNT value on done: 6110.0 [2023-02-24 17:36:04,991][177155] Sum rewards: -1.005, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.161', 'AMMO5': '0.025', 'AMMO2': '0.032', 'ARMOR': '0.060', 'WEAPON1': '0.070', 'weapon5': '0.082', 'AMMO3': '0.131', 'AMMO4': '0.160', 'HITCOUNT': '0.180', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.448', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'weapon3': '0.892', 'DAMAGECOUNT': '1.041', 'FRAGCOUNT': '2.000', 'weapon2': '2.034'} [2023-02-24 17:36:06,017][177156] DAMAGECOUNT value on done: 6613.0 [2023-02-24 17:36:06,018][177156] Sum rewards: 0.280, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.402', 'AMMO2': '0.008', 'ARMOR': '0.020', 'AMMO5': '0.032', 'AMMO4': '0.041', 'WEAPON1': '0.090', 'AMMO3': '0.120', 'weapon5': '0.146', 'HITCOUNT': '0.220', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.942', 'weapon2': '1.324', 'weapon3': '1.888', 'FRAGCOUNT': '3.000'} [2023-02-24 17:36:06,324][177156] DAMAGECOUNT value on done: 7047.0 [2023-02-24 17:36:06,325][177156] Sum rewards: -2.384, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.816', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO5': '0.015', 'ARMOR': '0.020', 'AMMO3': '0.087', 'WEAPON1': '0.090', 'HITCOUNT': '0.160', 'weapon5': '0.264', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.864', 'FRAGCOUNT': '1.000', 'weapon3': '1.100', 'weapon2': '2.010'} [2023-02-24 17:36:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13884.7). Total num frames: 11042816. Throughput: 0: 3513.3. Samples: 2755204. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:36:06,376][177119] Avg episode reward: [(0, '-1.990')] [2023-02-24 17:36:06,408][177140] Saving new best policy, reward=-1.990! [2023-02-24 17:36:06,480][177156] DAMAGECOUNT value on done: 5673.0 [2023-02-24 17:36:06,481][177156] Sum rewards: -0.199, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.715', 'AMMO5': '0.022', 'ARMOR': '0.040', 'AMMO2': '0.043', 'WEAPON1': '0.080', 'AMMO3': '0.081', 'weapon5': '0.098', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'AMMO4': '0.215', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.648', 'weapon4': '0.734', 'weapon3': '0.946', 'weapon2': '1.118', 'FRAGCOUNT': '2.000'} [2023-02-24 17:36:06,775][177156] DAMAGECOUNT value on done: 7175.0 [2023-02-24 17:36:06,776][177156] Sum rewards: 3.011, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.799', 'weapon4': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.064', 'weapon5': '0.124', 'AMMO3': '0.140', 'WEAPON5': '0.300', 'HITCOUNT': '0.420', 'WEAPON3': '0.700', 'weapon3': '1.554', 'weapon2': '1.616', 'DAMAGECOUNT': '1.995', 'FRAGCOUNT': '5.000'} [2023-02-24 17:36:07,293][177153] Updated weights for policy 0, policy_version 2700 (0.0009) [2023-02-24 17:36:10,201][177153] Updated weights for policy 0, policy_version 2710 (0.0008) [2023-02-24 17:36:10,412][177157] Large shaping reward 2.583 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.561, 187.0), ('weapon2', 0.002)] [2023-02-24 17:36:11,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14062.9, 300 sec: 13898.6). Total num frames: 11116544. Throughput: 0: 3515.7. Samples: 2776298. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:36:11,376][177119] Avg episode reward: [(0, '-1.893')] [2023-02-24 17:36:11,377][177140] Saving new best policy, reward=-1.893! [2023-02-24 17:36:13,102][177153] Updated weights for policy 0, policy_version 2720 (0.0008) [2023-02-24 17:36:16,032][177153] Updated weights for policy 0, policy_version 2730 (0.0008) [2023-02-24 17:36:16,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14062.9, 300 sec: 13898.6). Total num frames: 11186176. Throughput: 0: 3512.9. Samples: 2797362. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:36:16,376][177119] Avg episode reward: [(0, '-1.893')] [2023-02-24 17:36:18,966][177153] Updated weights for policy 0, policy_version 2740 (0.0008) [2023-02-24 17:36:21,134][177170] DAMAGECOUNT value on done: 5932.0 [2023-02-24 17:36:21,135][177170] Sum rewards: -3.247, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.018', 'AMMO2': '0.009', 'AMMO5': '0.015', 'ARMOR': '0.036', 'AMMO4': '0.047', 'WEAPON1': '0.050', 'AMMO3': '0.094', 'HITCOUNT': '0.110', 'weapon5': '0.162', 'weapon4': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.372', 'weapon3': '0.786', 'FRAGCOUNT': '2.000', 'weapon2': '2.014'} [2023-02-24 17:36:21,376][177119] Fps is (10 sec: 13926.5, 60 sec: 14063.0, 300 sec: 13898.6). Total num frames: 11255808. Throughput: 0: 3512.8. Samples: 2807910. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:36:21,376][177119] Avg episode reward: [(0, '-1.871')] [2023-02-24 17:36:21,376][177140] Saving new best policy, reward=-1.871! [2023-02-24 17:36:21,449][177170] DAMAGECOUNT value on done: 9181.0 [2023-02-24 17:36:21,449][177170] Sum rewards: 2.335, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.668', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.030', 'weapon5': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.093', 'weapon7': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.190', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.404', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.762', 'ARMOR': '0.881', 'FRAGCOUNT': '1.000', 'weapon2': '1.044', 'weapon3': '1.522'} [2023-02-24 17:36:21,512][177170] DAMAGECOUNT value on done: 6228.0 [2023-02-24 17:36:21,512][177170] Sum rewards: 1.192, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.424', 'weapon4': '0.012', 'AMMO2': '0.016', 'AMMO5': '0.028', 'ARMOR': '0.032', 'WEAPON1': '0.070', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'AMMO3': '0.149', 'weapon5': '0.150', 'HITCOUNT': '0.210', 'WEAPON3': '0.550', 'WEAPON5': '0.600', 'weapon3': '1.130', 'DAMAGECOUNT': '1.170', 'weapon2': '2.068', 'FRAGCOUNT': '3.000'} [2023-02-24 17:36:21,697][177172] DAMAGECOUNT value on done: 6277.0 [2023-02-24 17:36:21,697][177172] Sum rewards: -0.383, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.480', 'AMMO2': '0.004', 'AMMO5': '0.017', 'AMMO4': '0.018', 'ARMOR': '0.024', 'WEAPON1': '0.050', 'AMMO3': '0.057', 'WEAPON4': '0.100', 'HITCOUNT': '0.160', 'weapon5': '0.190', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.092', 'weapon3': '1.092', 'weapon2': '2.242'} [2023-02-24 17:36:21,769][177158] DAMAGECOUNT value on done: 8683.0 [2023-02-24 17:36:21,769][177158] Sum rewards: 5.417, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.480', 'ARMOR': '0.008', 'AMMO2': '0.009', 'AMMO5': '0.015', 'AMMO4': '0.044', 'WEAPON1': '0.050', 'AMMO3': '0.068', 'weapon4': '0.078', 'WEAPON4': '0.200', 'weapon5': '0.206', 'WEAPON5': '0.350', 'HITCOUNT': '0.390', 'WEAPON3': '0.500', 'weapon3': '1.382', 'weapon2': '1.838', 'DAMAGECOUNT': '2.259', 'FRAGCOUNT': '7.000'} [2023-02-24 17:36:21,816][177170] DAMAGECOUNT value on done: 7858.0 [2023-02-24 17:36:21,817][177170] Sum rewards: -8.225, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.829', 'AMMO5': '0.011', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'ARMOR': '0.044', 'AMMO4': '0.077', 'weapon4': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.120', 'AMMO3': '0.170', 'HITCOUNT': '0.180', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.537', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '1.638', 'weapon3': '1.800'} [2023-02-24 17:36:21,877][177153] Updated weights for policy 0, policy_version 2750 (0.0008) [2023-02-24 17:36:21,914][177154] DAMAGECOUNT value on done: 7244.0 [2023-02-24 17:36:21,915][177154] Sum rewards: -1.643, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.118', 'AMMO5': '0.012', 'AMMO2': '0.030', 'ARMOR': '0.040', 'weapon7': '0.058', 'WEAPON1': '0.060', 'AMMO3': '0.106', 'weapon4': '0.136', 'AMMO4': '0.149', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon5': '0.164', 'WEAPON7': '0.200', 'HITCOUNT': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'weapon3': '0.826', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.077', 'weapon2': '2.266'} [2023-02-24 17:36:21,994][177172] DAMAGECOUNT value on done: 6151.0 [2023-02-24 17:36:21,995][177172] Sum rewards: -0.248, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.270', 'AMMO2': '0.012', 'AMMO5': '0.018', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO4': '0.061', 'weapon5': '0.110', 'AMMO3': '0.122', 'HITCOUNT': '0.140', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.477', 'WEAPON3': '0.550', 'weapon3': '1.322', 'weapon2': '1.760', 'FRAGCOUNT': '2.000'} [2023-02-24 17:36:22,071][177158] DAMAGECOUNT value on done: 6221.0 [2023-02-24 17:36:22,071][177158] Sum rewards: -1.565, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.010', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'AMMO3': '0.090', 'HITCOUNT': '0.130', 'AMMO4': '0.141', 'weapon5': '0.166', 'weapon4': '0.176', 'WEAPON4': '0.200', 'HEALTH': '0.232', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.423', 'WEAPON3': '0.500', 'weapon2': '1.306', 'weapon3': '1.670', 'FRAGCOUNT': '2.000'} [2023-02-24 17:36:22,212][177154] DAMAGECOUNT value on done: 6460.0 [2023-02-24 17:36:22,212][177154] Sum rewards: -4.589, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.468', 'AMMO5': '0.018', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'ARMOR': '0.050', 'weapon4': '0.084', 'AMMO4': '0.137', 'weapon5': '0.158', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'HITCOUNT': '0.330', 'WEAPON5': '0.400', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.850', 'weapon3': '1.628', 'DAMAGECOUNT': '1.740', 'weapon2': '1.792'} [2023-02-24 17:36:22,310][177158] DAMAGECOUNT value on done: 6396.0 [2023-02-24 17:36:22,310][177158] Sum rewards: 2.612, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.990', 'AMMO5': '0.015', 'AMMO2': '0.020', 'ARMOR': '0.040', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'AMMO4': '0.100', 'weapon4': '0.106', 'AMMO3': '0.110', 'weapon5': '0.256', 'HITCOUNT': '0.390', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'weapon3': '1.490', 'weapon2': '1.740', 'DAMAGECOUNT': '2.304', 'FRAGCOUNT': '4.000'} [2023-02-24 17:36:22,519][177154] DAMAGECOUNT value on done: 8087.0 [2023-02-24 17:36:22,519][177154] Sum rewards: 5.011, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.231', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'ARMOR': '0.034', 'AMMO2': '0.050', 'AMMO3': '0.101', 'weapon5': '0.148', 'WEAPON5': '0.200', 'weapon4': '0.236', 'AMMO4': '0.249', 'HITCOUNT': '0.340', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'weapon3': '1.322', 'DAMAGECOUNT': '1.953', 'weapon2': '1.976', 'FRAGCOUNT': '6.000'} [2023-02-24 17:36:22,604][177158] DAMAGECOUNT value on done: 6459.0 [2023-02-24 17:36:22,604][177158] Sum rewards: -1.767, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.017', 'FRAGCOUNT': '-0.500', 'weapon4': '0.002', 'AMMO2': '0.007', 'ARMOR': '0.012', 'AMMO5': '0.019', 'AMMO4': '0.033', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'weapon5': '0.108', 'HITCOUNT': '0.110', 'AMMO3': '0.116', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.456', 'WEAPON3': '0.650', 'weapon2': '1.328', 'weapon3': '1.608'} [2023-02-24 17:36:22,831][177154] DAMAGECOUNT value on done: 7320.0 [2023-02-24 17:36:22,831][177154] Sum rewards: -4.024, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.623', 'AMMO2': '0.008', 'AMMO5': '0.026', 'AMMO4': '0.038', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.112', 'weapon5': '0.190', 'AMMO3': '0.191', 'HITCOUNT': '0.230', 'WEAPON5': '0.600', 'DAMAGECOUNT': '0.822', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.610', 'weapon3': '1.642'} [2023-02-24 17:36:22,855][177172] DAMAGECOUNT value on done: 5330.0 [2023-02-24 17:36:22,855][177172] Sum rewards: 3.447, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.030', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.029', 'WEAPON1': '0.070', 'AMMO3': '0.093', 'weapon4': '0.106', 'AMMO4': '0.143', 'HITCOUNT': '0.160', 'weapon5': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.179', 'weapon3': '1.310', 'weapon2': '1.748', 'FRAGCOUNT': '5.000'} [2023-02-24 17:36:22,952][177171] DAMAGECOUNT value on done: 6662.0 [2023-02-24 17:36:22,952][177171] Sum rewards: -0.218, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.136', 'AMMO5': '0.020', 'ARMOR': '0.020', 'AMMO2': '0.028', 'WEAPON1': '0.090', 'AMMO3': '0.128', 'weapon4': '0.136', 'AMMO4': '0.140', 'weapon5': '0.164', 'WEAPON4': '0.200', 'HITCOUNT': '0.330', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon3': '1.290', 'DAMAGECOUNT': '1.548', 'weapon2': '1.574', 'FRAGCOUNT': '4.000'} [2023-02-24 17:36:23,148][177172] DAMAGECOUNT value on done: 6181.0 [2023-02-24 17:36:23,148][177172] Sum rewards: -3.346, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.110', 'AMMO2': '0.000', 'AMMO4': '0.000', 'weapon4': '0.010', 'AMMO5': '0.017', 'ARMOR': '0.020', 'WEAPON4': '0.050', 'WEAPON1': '0.080', 'weapon5': '0.086', 'AMMO3': '0.111', 'HITCOUNT': '0.250', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.657', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.570', 'weapon2': '1.712'} [2023-02-24 17:36:23,200][177157] DAMAGECOUNT value on done: 7348.0 [2023-02-24 17:36:23,201][177157] Sum rewards: -0.566, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.279', 'AMMO5': '0.022', 'ARMOR': '0.028', 'AMMO2': '0.031', 'AMMO3': '0.052', 'WEAPON1': '0.070', 'AMMO4': '0.153', 'weapon5': '0.180', 'HITCOUNT': '0.240', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'weapon4': '0.440', 'WEAPON5': '0.450', 'weapon3': '0.578', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.131', 'weapon2': '1.688'} [2023-02-24 17:36:23,247][177171] DAMAGECOUNT value on done: 6674.0 [2023-02-24 17:36:23,248][177171] Sum rewards: 1.599, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.880', 'AMMO5': '0.017', 'AMMO2': '0.021', 'ARMOR': '0.052', 'WEAPON1': '0.070', 'AMMO4': '0.104', 'AMMO3': '0.143', 'weapon5': '0.144', 'weapon4': '0.152', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'HITCOUNT': '0.490', 'WEAPON3': '0.900', 'weapon2': '1.476', 'weapon3': '1.518', 'DAMAGECOUNT': '1.941', 'FRAGCOUNT': '4.000'} [2023-02-24 17:36:23,302][177155] DAMAGECOUNT value on done: 6002.0 [2023-02-24 17:36:23,303][177155] Sum rewards: -3.380, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.231', 'ARMOR': '0.012', 'AMMO2': '0.016', 'AMMO5': '0.027', 'WEAPON4': '0.050', 'AMMO4': '0.077', 'weapon5': '0.092', 'WEAPON1': '0.110', 'AMMO3': '0.132', 'weapon4': '0.138', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.550', 'WEAPON5': '0.550', 'weapon3': '1.268', 'weapon2': '1.908', 'FRAGCOUNT': '2.000'} [2023-02-24 17:36:23,396][177157] DAMAGECOUNT value on done: 8254.0 [2023-02-24 17:36:23,396][177157] Sum rewards: -1.847, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.286', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'ARMOR': '0.052', 'weapon5': '0.106', 'HITCOUNT': '0.140', 'AMMO3': '0.142', 'AMMO4': '0.143', 'weapon4': '0.282', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'weapon3': '1.128', 'DAMAGECOUNT': '1.449', 'weapon2': '1.930', 'FRAGCOUNT': '3.000'} [2023-02-24 17:36:23,509][177157] DAMAGECOUNT value on done: 7505.0 [2023-02-24 17:36:23,510][177157] Sum rewards: -0.440, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.430', 'AMMO2': '0.015', 'AMMO5': '0.018', 'WEAPON1': '0.050', 'AMMO4': '0.073', 'AMMO3': '0.077', 'weapon7': '0.086', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.198', 'HITCOUNT': '0.340', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon2': '1.426', 'DAMAGECOUNT': '1.584', 'weapon3': '1.602', 'FRAGCOUNT': '3.000'} [2023-02-24 17:36:23,556][177171] DAMAGECOUNT value on done: 7687.0 [2023-02-24 17:36:23,556][177171] Sum rewards: -1.517, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.750', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'AMMO3': '0.107', 'weapon5': '0.140', 'weapon4': '0.148', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'WEAPON5': '0.200', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.636', 'weapon3': '1.176', 'weapon2': '1.802'} [2023-02-24 17:36:23,603][177155] DAMAGECOUNT value on done: 8057.0 [2023-02-24 17:36:23,604][177155] Sum rewards: -0.539, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.482', 'AMMO2': '0.026', 'AMMO5': '0.030', 'WEAPON1': '0.060', 'weapon4': '0.074', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.125', 'AMMO4': '0.129', 'weapon5': '0.240', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'weapon3': '1.412', 'DAMAGECOUNT': '1.575', 'weapon2': '1.962', 'FRAGCOUNT': '2.000'} [2023-02-24 17:36:23,702][177157] DAMAGECOUNT value on done: 6698.0 [2023-02-24 17:36:23,702][177157] Sum rewards: 0.771, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.285', 'AMMO5': '0.012', 'AMMO2': '0.021', 'ARMOR': '0.032', 'weapon4': '0.040', 'WEAPON1': '0.050', 'AMMO4': '0.103', 'weapon5': '0.142', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'HITCOUNT': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.900', 'weapon2': '1.238', 'weapon3': '1.708', 'DAMAGECOUNT': '1.863', 'FRAGCOUNT': '4.000'} [2023-02-24 17:36:23,858][177171] DAMAGECOUNT value on done: 7024.0 [2023-02-24 17:36:23,859][177171] Sum rewards: -4.382, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.395', 'AMMO5': '0.027', 'ARMOR': '0.044', 'AMMO2': '0.049', 'WEAPON1': '0.070', 'AMMO3': '0.122', 'HITCOUNT': '0.180', 'weapon5': '0.230', 'AMMO4': '0.246', 'WEAPON4': '0.250', 'weapon4': '0.250', 'FRAGCOUNT': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.158', 'weapon3': '1.316', 'weapon2': '1.770'} [2023-02-24 17:36:23,886][177155] DAMAGECOUNT value on done: 8368.0 [2023-02-24 17:36:23,887][177155] Sum rewards: 5.812, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.960', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO5': '0.018', 'AMMO3': '0.020', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.194', 'WEAPON3': '0.200', 'weapon5': '0.260', 'HITCOUNT': '0.290', 'WEAPON5': '0.450', 'weapon3': '0.524', 'weapon2': '2.174', 'DAMAGECOUNT': '2.202', 'FRAGCOUNT': '4.000'} [2023-02-24 17:36:24,183][177155] DAMAGECOUNT value on done: 6501.0 [2023-02-24 17:36:24,183][177155] Sum rewards: -2.901, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.984', 'AMMO2': '0.028', 'AMMO5': '0.029', 'weapon5': '0.076', 'ARMOR': '0.080', 'WEAPON1': '0.080', 'weapon4': '0.098', 'AMMO3': '0.138', 'AMMO4': '0.141', 'WEAPON4': '0.200', 'HITCOUNT': '0.280', 'WEAPON5': '0.600', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.173', 'weapon2': '1.404', 'weapon3': '1.906', 'FRAGCOUNT': '3.000'} [2023-02-24 17:36:24,841][177153] Updated weights for policy 0, policy_version 2760 (0.0008) [2023-02-24 17:36:25,208][177156] DAMAGECOUNT value on done: 6948.0 [2023-02-24 17:36:25,208][177156] Sum rewards: -4.376, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.812', 'ARMOR': '0.016', 'AMMO2': '0.021', 'AMMO5': '0.021', 'weapon4': '0.046', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.151', 'HITCOUNT': '0.210', 'weapon5': '0.292', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'weapon3': '0.860', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.005', 'weapon2': '2.162'} [2023-02-24 17:36:25,498][177156] DAMAGECOUNT value on done: 7338.0 [2023-02-24 17:36:25,499][177156] Sum rewards: -0.586, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.570', 'AMMO2': '0.024', 'AMMO5': '0.030', 'WEAPON1': '0.040', 'weapon5': '0.058', 'ARMOR': '0.072', 'AMMO3': '0.089', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'weapon4': '0.202', 'HITCOUNT': '0.230', 'WEAPON5': '0.500', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.873', 'weapon3': '0.874', 'weapon2': '1.724', 'FRAGCOUNT': '2.000'} [2023-02-24 17:36:25,622][177156] DAMAGECOUNT value on done: 6108.0 [2023-02-24 17:36:25,623][177156] Sum rewards: 0.252, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.031', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'ARMOR': '0.066', 'AMMO4': '0.066', 'weapon4': '0.110', 'weapon7': '0.124', 'weapon5': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.350', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.305', 'weapon3': '1.450', 'weapon2': '1.508', 'FRAGCOUNT': '4.000'} [2023-02-24 17:36:25,919][177156] DAMAGECOUNT value on done: 8003.0 [2023-02-24 17:36:25,919][177156] Sum rewards: 3.911, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.329', 'AMMO2': '0.007', 'AMMO5': '0.025', 'AMMO4': '0.033', 'WEAPON1': '0.060', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon4': '0.118', 'weapon5': '0.230', 'HITCOUNT': '0.350', 'WEAPON3': '0.550', 'WEAPON5': '0.550', 'weapon3': '0.932', 'weapon2': '2.206', 'DAMAGECOUNT': '2.484', 'FRAGCOUNT': '5.000'} [2023-02-24 17:36:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 13898.6). Total num frames: 11325440. Throughput: 0: 3508.7. Samples: 2828892. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:36:26,376][177119] Avg episode reward: [(0, '-1.369')] [2023-02-24 17:36:26,379][177140] Saving new best policy, reward=-1.369! [2023-02-24 17:36:27,751][177153] Updated weights for policy 0, policy_version 2770 (0.0008) [2023-02-24 17:36:30,650][177153] Updated weights for policy 0, policy_version 2780 (0.0009) [2023-02-24 17:36:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 13898.6). Total num frames: 11395072. Throughput: 0: 3512.0. Samples: 2849962. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:36:31,376][177119] Avg episode reward: [(0, '-1.369')] [2023-02-24 17:36:33,564][177153] Updated weights for policy 0, policy_version 2790 (0.0008) [2023-02-24 17:36:36,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13898.6). Total num frames: 11464704. Throughput: 0: 3511.7. Samples: 2860506. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:36:36,376][177119] Avg episode reward: [(0, '-1.369')] [2023-02-24 17:36:36,502][177153] Updated weights for policy 0, policy_version 2800 (0.0009) [2023-02-24 17:36:39,412][177153] Updated weights for policy 0, policy_version 2810 (0.0008) [2023-02-24 17:36:40,247][177170] DAMAGECOUNT value on done: 6112.0 [2023-02-24 17:36:40,248][177170] Sum rewards: -1.893, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.080', 'AMMO5': '0.014', 'AMMO2': '0.023', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.099', 'AMMO4': '0.113', 'weapon4': '0.132', 'HITCOUNT': '0.140', 'weapon5': '0.162', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.540', 'WEAPON3': '0.650', 'weapon2': '1.426', 'weapon3': '1.728', 'FRAGCOUNT': '2.000'} [2023-02-24 17:36:40,547][177170] DAMAGECOUNT value on done: 9550.0 [2023-02-24 17:36:40,547][177170] Sum rewards: 2.559, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.036', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.052', 'weapon5': '0.054', 'ARMOR': '0.068', 'AMMO3': '0.096', 'WEAPON5': '0.150', 'HITCOUNT': '0.170', 'weapon4': '0.226', 'AMMO4': '0.260', 'WEAPON4': '0.550', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.107', 'weapon3': '1.118', 'weapon2': '1.876', 'FRAGCOUNT': '4.000'} [2023-02-24 17:36:40,619][177170] DAMAGECOUNT value on done: 6419.0 [2023-02-24 17:36:40,620][177170] Sum rewards: 0.941, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.358', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'ARMOR': '0.052', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'weapon5': '0.132', 'WEAPON3': '0.300', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.573', 'FRAGCOUNT': '1.000', 'weapon3': '1.086', 'weapon2': '1.930'} [2023-02-24 17:36:40,801][177172] DAMAGECOUNT value on done: 6533.0 [2023-02-24 17:36:40,801][177172] Sum rewards: -2.153, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO2': '0.027', 'AMMO5': '0.030', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'AMMO4': '0.135', 'HITCOUNT': '0.190', 'weapon5': '0.286', 'weapon4': '0.320', 'HEALTH': '0.391', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.768', 'FRAGCOUNT': '1.000', 'weapon2': '1.102', 'weapon3': '1.828'} [2023-02-24 17:36:40,896][177158] DAMAGECOUNT value on done: 9038.0 [2023-02-24 17:36:40,896][177158] Sum rewards: -1.436, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.020', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'ARMOR': '0.019', 'AMMO2': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO3': '0.073', 'AMMO4': '0.199', 'HITCOUNT': '0.230', 'WEAPON3': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.432', 'DAMAGECOUNT': '1.065', 'weapon3': '1.108', 'weapon2': '1.792', 'FRAGCOUNT': '2.000'} [2023-02-24 17:36:40,916][177170] DAMAGECOUNT value on done: 8017.0 [2023-02-24 17:36:40,916][177170] Sum rewards: -2.280, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.612', 'AMMO2': '0.017', 'AMMO5': '0.018', 'ARMOR': '0.034', 'WEAPON1': '0.070', 'AMMO4': '0.083', 'weapon5': '0.114', 'AMMO3': '0.124', 'HITCOUNT': '0.170', 'weapon4': '0.258', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.477', 'WEAPON3': '0.700', 'weapon3': '1.402', 'weapon2': '1.516', 'FRAGCOUNT': '2.000'} [2023-02-24 17:36:41,088][177154] DAMAGECOUNT value on done: 7754.0 [2023-02-24 17:36:41,088][177154] Sum rewards: 1.290, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.537', 'AMMO5': '0.016', 'ARMOR': '0.016', 'AMMO2': '0.023', 'WEAPON1': '0.070', 'weapon5': '0.102', 'AMMO4': '0.113', 'AMMO3': '0.161', 'WEAPON5': '0.350', 'HITCOUNT': '0.420', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.530', 'weapon2': '1.538', 'weapon3': '2.038', 'FRAGCOUNT': '3.000'} [2023-02-24 17:36:41,096][177172] DAMAGECOUNT value on done: 6457.0 [2023-02-24 17:36:41,096][177172] Sum rewards: 0.645, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.622', 'weapon4': '0.016', 'ARMOR': '0.024', 'AMMO5': '0.024', 'AMMO2': '0.026', 'AMMO3': '0.056', 'WEAPON1': '0.090', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'weapon5': '0.200', 'WEAPON3': '0.400', 'WEAPON5': '0.500', 'DAMAGECOUNT': '0.918', 'weapon3': '1.156', 'FRAGCOUNT': '2.000', 'weapon2': '2.168'} [2023-02-24 17:36:41,200][177158] DAMAGECOUNT value on done: 6594.0 [2023-02-24 17:36:41,200][177158] Sum rewards: -3.671, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.190', 'weapon4': '0.014', 'AMMO2': '0.015', 'AMMO5': '0.017', 'ARMOR': '0.028', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO4': '0.075', 'AMMO3': '0.125', 'weapon5': '0.160', 'HITCOUNT': '0.240', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.119', 'weapon3': '1.688', 'weapon2': '1.768'} [2023-02-24 17:36:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13912.5). Total num frames: 11534336. Throughput: 0: 3511.7. Samples: 2881600. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:36:41,376][177119] Avg episode reward: [(0, '-1.238')] [2023-02-24 17:36:41,377][177140] Saving new best policy, reward=-1.238! [2023-02-24 17:36:41,386][177154] DAMAGECOUNT value on done: 6856.0 [2023-02-24 17:36:41,387][177154] Sum rewards: -5.812, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.559', 'weapon4': '0.002', 'AMMO2': '0.018', 'AMMO5': '0.025', 'weapon5': '0.066', 'WEAPON1': '0.070', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'AMMO3': '0.212', 'HITCOUNT': '0.370', 'WEAPON5': '0.450', 'weapon2': '1.138', 'DAMAGECOUNT': '1.188', 'WEAPON3': '1.300', 'FRAGCOUNT': '2.000', 'weapon3': '2.216'} [2023-02-24 17:36:41,440][177158] DAMAGECOUNT value on done: 7087.0 [2023-02-24 17:36:41,442][177158] Sum rewards: -0.116, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.574', 'ARMOR': '0.004', 'AMMO5': '0.030', 'AMMO2': '0.034', 'weapon4': '0.074', 'WEAPON1': '0.080', 'AMMO3': '0.141', 'AMMO4': '0.168', 'WEAPON4': '0.250', 'weapon5': '0.254', 'HITCOUNT': '0.300', 'WEAPON5': '0.650', 'WEAPON3': '0.900', 'weapon2': '1.256', 'weapon3': '1.744', 'DAMAGECOUNT': '2.073', 'FRAGCOUNT': '4.000'} [2023-02-24 17:36:41,687][177154] DAMAGECOUNT value on done: 8237.0 [2023-02-24 17:36:41,688][177154] Sum rewards: 0.052, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.652', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'weapon5': '0.054', 'AMMO4': '0.063', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'HITCOUNT': '0.150', 'DAMAGECOUNT': '0.450', 'weapon4': '0.454', 'WEAPON3': '0.600', 'weapon3': '0.882', 'FRAGCOUNT': '1.000', 'weapon2': '1.902'} [2023-02-24 17:36:41,737][177158] DAMAGECOUNT value on done: 6651.0 [2023-02-24 17:36:41,738][177158] Sum rewards: -1.642, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.304', 'AMMO5': '0.015', 'AMMO2': '0.028', 'ARMOR': '0.048', 'WEAPON1': '0.060', 'AMMO3': '0.092', 'weapon4': '0.126', 'HITCOUNT': '0.130', 'AMMO4': '0.141', 'weapon5': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.576', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.246', 'weapon3': '1.452'} [2023-02-24 17:36:41,972][177154] DAMAGECOUNT value on done: 7738.0 [2023-02-24 17:36:41,972][177154] Sum rewards: 0.546, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.302', 'AMMO5': '0.013', 'AMMO2': '0.023', 'AMMO3': '0.060', 'WEAPON1': '0.060', 'AMMO4': '0.114', 'weapon5': '0.238', 'HITCOUNT': '0.280', 'WEAPON3': '0.300', 'WEAPON5': '0.350', 'weapon3': '0.972', 'DAMAGECOUNT': '1.254', 'weapon2': '2.184', 'FRAGCOUNT': '2.500'} [2023-02-24 17:36:42,005][177172] DAMAGECOUNT value on done: 5660.0 [2023-02-24 17:36:42,005][177172] Sum rewards: 1.914, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.074', 'AMMO5': '0.016', 'WEAPON1': '0.030', 'AMMO2': '0.034', 'AMMO3': '0.048', 'AMMO4': '0.168', 'HITCOUNT': '0.170', 'weapon4': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'weapon5': '0.300', 'weapon3': '0.882', 'DAMAGECOUNT': '0.990', 'weapon2': '1.660', 'FRAGCOUNT': '2.000'} [2023-02-24 17:36:42,100][177171] DAMAGECOUNT value on done: 7156.0 [2023-02-24 17:36:42,100][177171] Sum rewards: -0.469, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.396', 'AMMO5': '0.022', 'AMMO2': '0.028', 'WEAPON1': '0.090', 'AMMO3': '0.091', 'weapon5': '0.130', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'weapon4': '0.190', 'HITCOUNT': '0.270', 'WEAPON5': '0.450', 'WEAPON3': '0.450', 'weapon3': '0.982', 'DAMAGECOUNT': '1.482', 'weapon2': '2.202', 'FRAGCOUNT': '2.500'} [2023-02-24 17:36:42,299][177172] DAMAGECOUNT value on done: 6262.0 [2023-02-24 17:36:42,360][177153] Updated weights for policy 0, policy_version 2820 (0.0009) [2023-02-24 17:36:42,376][177157] DAMAGECOUNT value on done: 7783.0 [2023-02-24 17:36:42,376][177157] Sum rewards: 2.841, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.183', 'ARMOR': '0.004', 'AMMO2': '0.014', 'AMMO5': '0.020', 'AMMO3': '0.050', 'AMMO4': '0.067', 'WEAPON1': '0.070', 'HITCOUNT': '0.220', 'WEAPON3': '0.300', 'weapon5': '0.398', 'WEAPON5': '0.550', 'weapon3': '1.038', 'DAMAGECOUNT': '1.305', 'weapon2': '1.738', 'FRAGCOUNT': '4.000'} [2023-02-24 17:36:42,402][177171] DAMAGECOUNT value on done: 7055.0 [2023-02-24 17:36:42,403][177171] Sum rewards: -2.066, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.745', 'AMMO5': '0.018', 'ARMOR': '0.020', 'AMMO2': '0.035', 'WEAPON1': '0.070', 'weapon4': '0.074', 'AMMO3': '0.091', 'HITCOUNT': '0.150', 'AMMO4': '0.174', 'weapon5': '0.212', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.143', 'weapon3': '1.576', 'weapon2': '1.666', 'FRAGCOUNT': '2.000'} [2023-02-24 17:36:42,416][177155] DAMAGECOUNT value on done: 6354.0 [2023-02-24 17:36:42,416][177155] Sum rewards: -1.769, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.371', 'AMMO5': '0.017', 'AMMO2': '0.035', 'WEAPON1': '0.050', 'ARMOR': '0.056', 'AMMO3': '0.057', 'HITCOUNT': '0.140', 'AMMO4': '0.176', 'weapon5': '0.222', 'WEAPON4': '0.250', 'weapon4': '0.310', 'WEAPON3': '0.350', 'WEAPON5': '0.450', 'weapon3': '0.684', 'DAMAGECOUNT': '1.056', 'weapon2': '1.748', 'FRAGCOUNT': '3.000'} [2023-02-24 17:36:42,597][177157] DAMAGECOUNT value on done: 8612.0 [2023-02-24 17:36:42,597][177157] Sum rewards: -3.228, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.147', 'ARMOR': '0.004', 'AMMO5': '0.031', 'AMMO2': '0.032', 'WEAPON1': '0.100', 'AMMO3': '0.133', 'AMMO4': '0.161', 'WEAPON4': '0.200', 'weapon5': '0.220', 'HITCOUNT': '0.260', 'weapon4': '0.440', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.074', 'weapon2': '1.424', 'FRAGCOUNT': '1.500', 'weapon3': '1.540'} [2023-02-24 17:36:42,687][177157] DAMAGECOUNT value on done: 7660.0 [2023-02-24 17:36:42,688][177157] Sum rewards: -0.295, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.544', 'AMMO2': '0.008', 'AMMO5': '0.012', 'AMMO4': '0.041', 'WEAPON1': '0.060', 'HITCOUNT': '0.070', 'ARMOR': '0.101', 'AMMO3': '0.109', 'weapon4': '0.132', 'WEAPON4': '0.150', 'weapon5': '0.152', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.465', 'weapon3': '0.874', 'FRAGCOUNT': '1.000', 'weapon2': '2.324'} [2023-02-24 17:36:42,708][177171] DAMAGECOUNT value on done: 7891.0 [2023-02-24 17:36:42,709][177171] Sum rewards: -1.789, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.841', 'AMMO5': '0.016', 'WEAPON1': '0.030', 'AMMO2': '0.031', 'ARMOR': '0.064', 'weapon5': '0.104', 'AMMO3': '0.116', 'HITCOUNT': '0.130', 'AMMO4': '0.156', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.538', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.612', 'weapon3': '0.974', 'FRAGCOUNT': '1.000', 'weapon2': '1.630'} [2023-02-24 17:36:42,717][177155] DAMAGECOUNT value on done: 8496.0 [2023-02-24 17:36:42,717][177155] Sum rewards: 0.544, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.796', 'AMMO5': '0.012', 'AMMO2': '0.026', 'WEAPON1': '0.040', 'AMMO3': '0.105', 'weapon5': '0.114', 'AMMO4': '0.131', 'WEAPON4': '0.200', 'weapon4': '0.258', 'WEAPON5': '0.300', 'HITCOUNT': '0.310', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.138', 'DAMAGECOUNT': '1.317', 'weapon2': '1.888'} [2023-02-24 17:36:42,913][177157] DAMAGECOUNT value on done: 7063.0 [2023-02-24 17:36:42,914][177157] Sum rewards: -2.537, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.017', 'AMMO2': '0.018', 'ARMOR': '0.035', 'WEAPON1': '0.050', 'HEALTH': '0.074', 'AMMO4': '0.087', 'weapon4': '0.110', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'weapon5': '0.226', 'HITCOUNT': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.095', 'weapon3': '1.258', 'weapon2': '1.826'} [2023-02-24 17:36:42,991][177155] DAMAGECOUNT value on done: 8607.0 [2023-02-24 17:36:42,992][177155] Sum rewards: -3.013, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.289', 'AMMO5': '0.010', 'AMMO2': '0.023', 'ARMOR': '0.024', 'WEAPON1': '0.030', 'weapon4': '0.100', 'AMMO4': '0.116', 'weapon5': '0.142', 'HITCOUNT': '0.150', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.717', 'WEAPON3': '0.800', 'weapon3': '1.500', 'FRAGCOUNT': '2.000', 'weapon2': '2.062'} [2023-02-24 17:36:43,002][177171] DAMAGECOUNT value on done: 7154.0 [2023-02-24 17:36:43,003][177171] Sum rewards: 0.043, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.020', 'AMMO2': '0.037', 'WEAPON1': '0.050', 'AMMO3': '0.071', 'weapon4': '0.086', 'WEAPON4': '0.100', 'HITCOUNT': '0.130', 'HEALTH': '0.176', 'AMMO4': '0.183', 'weapon5': '0.228', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.450', 'weapon2': '1.598', 'weapon3': '1.674', 'FRAGCOUNT': '2.000'} [2023-02-24 17:36:43,289][177155] DAMAGECOUNT value on done: 6912.0 [2023-02-24 17:36:43,290][177155] Sum rewards: 2.093, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.050', 'AMMO2': '0.008', 'AMMO5': '0.012', 'ARMOR': '0.028', 'AMMO4': '0.040', 'WEAPON1': '0.070', 'AMMO3': '0.099', 'weapon5': '0.260', 'HITCOUNT': '0.290', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'weapon3': '1.212', 'DAMAGECOUNT': '1.233', 'weapon2': '1.690', 'FRAGCOUNT': '3.000'} [2023-02-24 17:36:44,395][177156] DAMAGECOUNT value on done: 7309.0 [2023-02-24 17:36:44,395][177156] Sum rewards: -0.630, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.154', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.022', 'WEAPON1': '0.060', 'AMMO3': '0.122', 'HITCOUNT': '0.180', 'weapon5': '0.224', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'weapon2': '1.066', 'DAMAGECOUNT': '1.083', 'weapon3': '1.756', 'FRAGCOUNT': '3.000'} [2023-02-24 17:36:44,691][177156] DAMAGECOUNT value on done: 7996.0 [2023-02-24 17:36:44,692][177156] Sum rewards: 1.703, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.812', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.015', 'WEAPON1': '0.080', 'AMMO3': '0.119', 'weapon5': '0.224', 'WEAPON5': '0.250', 'HITCOUNT': '0.330', 'ARMOR': '0.460', 'WEAPON3': '0.750', 'weapon3': '1.360', 'weapon2': '1.458', 'DAMAGECOUNT': '1.974', 'FRAGCOUNT': '3.000'} [2023-02-24 17:36:44,812][177156] DAMAGECOUNT value on done: 6619.0 [2023-02-24 17:36:44,812][177156] Sum rewards: -5.197, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.345', 'AMMO5': '0.022', 'AMMO2': '0.039', 'ARMOR': '0.048', 'WEAPON1': '0.060', 'weapon4': '0.106', 'weapon5': '0.112', 'AMMO3': '0.138', 'AMMO4': '0.197', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.274', 'DAMAGECOUNT': '1.533', 'weapon3': '1.998'} [2023-02-24 17:36:45,108][177156] DAMAGECOUNT value on done: 8615.0 [2023-02-24 17:36:45,109][177156] Sum rewards: 1.085, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.239', 'AMMO5': '0.019', 'AMMO2': '0.029', 'WEAPON1': '0.050', 'weapon5': '0.126', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon4': '0.282', 'HITCOUNT': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'weapon2': '1.400', 'weapon3': '1.728', 'DAMAGECOUNT': '1.836', 'FRAGCOUNT': '5.000'} [2023-02-24 17:36:45,223][177153] Updated weights for policy 0, policy_version 2830 (0.0008) [2023-02-24 17:36:46,376][177119] Fps is (10 sec: 14336.1, 60 sec: 14062.9, 300 sec: 13940.3). Total num frames: 11608064. Throughput: 0: 3508.8. Samples: 2902698. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:36:46,376][177119] Avg episode reward: [(0, '-0.863')] [2023-02-24 17:36:46,379][177140] Saving new best policy, reward=-0.863! [2023-02-24 17:36:47,008][177170] Large shaping reward 2.650 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-24 17:36:48,124][177153] Updated weights for policy 0, policy_version 2840 (0.0008) [2023-02-24 17:36:51,023][177153] Updated weights for policy 0, policy_version 2850 (0.0008) [2023-02-24 17:36:51,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14062.9, 300 sec: 13940.3). Total num frames: 11677696. Throughput: 0: 3512.8. Samples: 2913282. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:36:51,376][177119] Avg episode reward: [(0, '-0.863')] [2023-02-24 17:36:53,938][177153] Updated weights for policy 0, policy_version 2860 (0.0008) [2023-02-24 17:36:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14062.9, 300 sec: 13940.3). Total num frames: 11747328. Throughput: 0: 3513.3. Samples: 2934396. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:36:56,376][177119] Avg episode reward: [(0, '-0.863')] [2023-02-24 17:36:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000002868_11747328.pth... [2023-02-24 17:36:56,436][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000002043_8368128.pth [2023-02-24 17:36:56,849][177153] Updated weights for policy 0, policy_version 2870 (0.0008) [2023-02-24 17:36:59,378][177170] DAMAGECOUNT value on done: 6672.0 [2023-02-24 17:36:59,378][177170] Sum rewards: 2.891, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.778', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO2': '0.061', 'weapon7': '0.066', 'AMMO3': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'ARMOR': '0.106', 'weapon5': '0.182', 'HITCOUNT': '0.240', 'AMMO4': '0.307', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'WEAPON4': '0.500', 'weapon3': '0.550', 'weapon4': '0.758', 'DAMAGECOUNT': '1.221', 'weapon2': '1.986', 'FRAGCOUNT': '4.000'} [2023-02-24 17:36:59,685][177170] DAMAGECOUNT value on done: 9918.0 [2023-02-24 17:36:59,686][177170] Sum rewards: -1.177, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.090', 'AMMO5': '0.019', 'AMMO2': '0.027', 'WEAPON1': '0.050', 'ARMOR': '0.060', 'AMMO4': '0.134', 'AMMO3': '0.155', 'weapon5': '0.172', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'weapon4': '0.448', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.104', 'weapon2': '1.266', 'weapon3': '1.448', 'FRAGCOUNT': '3.000'} [2023-02-24 17:36:59,732][177153] Updated weights for policy 0, policy_version 2880 (0.0009) [2023-02-24 17:36:59,774][177170] DAMAGECOUNT value on done: 6895.0 [2023-02-24 17:36:59,775][177170] Sum rewards: -1.775, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.083', 'AMMO5': '0.017', 'AMMO2': '0.020', 'weapon5': '0.068', 'WEAPON1': '0.080', 'AMMO4': '0.098', 'AMMO3': '0.186', 'WEAPON5': '0.350', 'HITCOUNT': '0.360', 'WEAPON3': '0.950', 'weapon2': '1.184', 'DAMAGECOUNT': '1.428', 'FRAGCOUNT': '2.000', 'weapon3': '2.316'} [2023-02-24 17:36:59,958][177172] DAMAGECOUNT value on done: 6758.0 [2023-02-24 17:36:59,959][177172] Sum rewards: 1.753, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.380', 'AMMO5': '0.010', 'AMMO2': '0.011', 'ARMOR': '0.030', 'AMMO4': '0.056', 'WEAPON1': '0.060', 'AMMO3': '0.089', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.150', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.675', 'weapon2': '1.410', 'weapon3': '1.992', 'FRAGCOUNT': '2.000'} [2023-02-24 17:37:00,015][177158] DAMAGECOUNT value on done: 9348.0 [2023-02-24 17:37:00,015][177158] Sum rewards: -1.995, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.248', 'ARMOR': '0.016', 'AMMO2': '0.023', 'AMMO5': '0.031', 'WEAPON1': '0.070', 'AMMO4': '0.116', 'AMMO3': '0.132', 'HITCOUNT': '0.160', 'weapon5': '0.168', 'WEAPON4': '0.200', 'weapon4': '0.334', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.930', 'FRAGCOUNT': '1.000', 'weapon2': '1.410', 'weapon3': '1.612'} [2023-02-24 17:37:00,070][177170] DAMAGECOUNT value on done: 8315.0 [2023-02-24 17:37:00,070][177170] Sum rewards: -3.194, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.962', 'AMMO5': '0.018', 'AMMO2': '0.023', 'ARMOR': '0.040', 'WEAPON1': '0.070', 'AMMO4': '0.113', 'AMMO3': '0.145', 'weapon5': '0.162', 'weapon4': '0.174', 'WEAPON4': '0.200', 'HITCOUNT': '0.270', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.894', 'WEAPON3': '0.950', 'weapon2': '1.084', 'weapon3': '1.976', 'FRAGCOUNT': '2.000'} [2023-02-24 17:37:00,159][177154] DAMAGECOUNT value on done: 7845.0 [2023-02-24 17:37:00,257][177172] DAMAGECOUNT value on done: 6723.0 [2023-02-24 17:37:00,258][177172] Sum rewards: 1.355, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.640', 'AMMO5': '0.007', 'ARMOR': '0.025', 'WEAPON1': '0.040', 'AMMO2': '0.041', 'AMMO3': '0.073', 'weapon7': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.170', 'WEAPON7': '0.200', 'AMMO4': '0.207', 'weapon5': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.358', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.798', 'weapon3': '0.914', 'weapon2': '2.008', 'FRAGCOUNT': '3.000'} [2023-02-24 17:37:00,316][177158] DAMAGECOUNT value on done: 7043.0 [2023-02-24 17:37:00,316][177158] Sum rewards: -4.209, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.550', 'AMMO5': '0.025', 'WEAPON1': '0.040', 'AMMO2': '0.041', 'AMMO3': '0.109', 'weapon5': '0.120', 'AMMO4': '0.207', 'weapon4': '0.228', 'HITCOUNT': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.347', 'weapon2': '1.412', 'weapon3': '1.462', 'FRAGCOUNT': '2.000'} [2023-02-24 17:37:00,457][177154] DAMAGECOUNT value on done: 6978.0 [2023-02-24 17:37:00,541][177158] DAMAGECOUNT value on done: 7282.0 [2023-02-24 17:37:00,541][177158] Sum rewards: -0.686, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.460', 'AMMO5': '0.010', 'AMMO2': '0.011', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.096', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.190', 'weapon4': '0.216', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.585', 'weapon2': '1.470', 'weapon3': '1.500', 'FRAGCOUNT': '2.000'} [2023-02-24 17:37:00,740][177154] DAMAGECOUNT value on done: 8741.0 [2023-02-24 17:37:00,740][177154] Sum rewards: 1.832, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.293', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'ARMOR': '0.056', 'AMMO3': '0.077', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'weapon5': '0.180', 'HITCOUNT': '0.320', 'WEAPON4': '0.400', 'weapon4': '0.430', 'WEAPON3': '0.500', 'weapon3': '1.176', 'DAMAGECOUNT': '1.512', 'weapon2': '1.662', 'FRAGCOUNT': '2.500'} [2023-02-24 17:37:00,831][177158] DAMAGECOUNT value on done: 6759.0 [2023-02-24 17:37:00,832][177158] Sum rewards: -1.244, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.208', 'AMMO2': '0.004', 'AMMO5': '0.017', 'AMMO4': '0.021', 'WEAPON1': '0.060', 'AMMO3': '0.085', 'HITCOUNT': '0.090', 'DAMAGECOUNT': '0.324', 'WEAPON5': '0.350', 'weapon5': '0.450', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.022', 'weapon3': '1.740'} [2023-02-24 17:37:01,029][177154] DAMAGECOUNT value on done: 7758.0 [2023-02-24 17:37:01,029][177154] Sum rewards: 0.860, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.800', 'weapon5': '0.002', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'HITCOUNT': '0.030', 'DAMAGECOUNT': '0.060', 'AMMO3': '0.079', 'WEAPON5': '0.100', 'AMMO4': '0.141', 'weapon4': '0.228', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.494', 'weapon2': '0.818', 'weapon3': '0.900', 'FRAGCOUNT': '1.000'} [2023-02-24 17:37:01,129][177172] DAMAGECOUNT value on done: 6471.0 [2023-02-24 17:37:01,129][177172] Sum rewards: 7.071, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.306', 'AMMO5': '0.007', 'AMMO2': '0.036', 'WEAPON1': '0.080', 'AMMO3': '0.111', 'AMMO4': '0.181', 'WEAPON5': '0.200', 'weapon5': '0.244', 'HITCOUNT': '0.270', 'WEAPON3': '0.500', 'weapon3': '1.406', 'weapon2': '1.658', 'DAMAGECOUNT': '2.433', 'FRAGCOUNT': '7.000'} [2023-02-24 17:37:01,237][177171] DAMAGECOUNT value on done: 7349.0 [2023-02-24 17:37:01,237][177171] Sum rewards: -4.646, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.993', 'AMMO5': '0.022', 'weapon4': '0.024', 'AMMO2': '0.026', 'ARMOR': '0.028', 'WEAPON1': '0.090', 'HITCOUNT': '0.100', 'AMMO3': '0.106', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'weapon5': '0.268', 'WEAPON5': '0.500', 'DAMAGECOUNT': '0.579', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.472', 'weapon2': '1.654'} [2023-02-24 17:37:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 13940.3). Total num frames: 11816960. Throughput: 0: 3511.6. Samples: 2955386. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:37:01,376][177119] Avg episode reward: [(0, '-0.666')] [2023-02-24 17:37:01,377][177140] Saving new best policy, reward=-0.666! [2023-02-24 17:37:01,441][177172] DAMAGECOUNT value on done: 6490.0 [2023-02-24 17:37:01,441][177172] Sum rewards: -4.148, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.380', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'ARMOR': '0.060', 'AMMO3': '0.090', 'AMMO4': '0.116', 'weapon4': '0.128', 'WEAPON5': '0.200', 'weapon5': '0.234', 'HITCOUNT': '0.240', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.684', 'weapon3': '1.576', 'weapon2': '1.648'} [2023-02-24 17:37:01,456][177155] DAMAGECOUNT value on done: 6534.0 [2023-02-24 17:37:01,456][177155] Sum rewards: -2.147, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.022', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.080', 'HITCOUNT': '0.090', 'weapon4': '0.176', 'weapon5': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.500', 'DAMAGECOUNT': '0.540', 'FRAGCOUNT': '1.000', 'weapon3': '1.258', 'weapon2': '1.556'} [2023-02-24 17:37:01,486][177157] DAMAGECOUNT value on done: 8018.0 [2023-02-24 17:37:01,486][177157] Sum rewards: -0.491, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.845', 'ARMOR': '0.012', 'AMMO5': '0.020', 'AMMO2': '0.029', 'WEAPON1': '0.080', 'AMMO3': '0.088', 'HITCOUNT': '0.090', 'AMMO4': '0.142', 'weapon5': '0.308', 'WEAPON5': '0.400', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.705', 'FRAGCOUNT': '1.000', 'weapon3': '1.120', 'weapon2': '1.960'} [2023-02-24 17:37:01,555][177171] DAMAGECOUNT value on done: 7292.0 [2023-02-24 17:37:01,555][177171] Sum rewards: -0.584, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.804', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.040', 'WEAPON1': '0.060', 'AMMO3': '0.122', 'HITCOUNT': '0.180', 'AMMO4': '0.199', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.444', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.711', 'weapon2': '1.264', 'weapon3': '1.476', 'FRAGCOUNT': '2.000'} [2023-02-24 17:37:01,712][177157] DAMAGECOUNT value on done: 9345.0 [2023-02-24 17:37:01,712][177157] Sum rewards: -0.723, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.098', 'AMMO5': '0.027', 'AMMO2': '0.036', 'ARMOR': '0.040', 'weapon5': '0.054', 'WEAPON1': '0.090', 'AMMO3': '0.166', 'AMMO4': '0.179', 'weapon4': '0.214', 'WEAPON4': '0.250', 'HITCOUNT': '0.440', 'WEAPON5': '0.500', 'weapon2': '0.940', 'WEAPON3': '1.000', 'DAMAGECOUNT': '2.199', 'weapon3': '2.240', 'FRAGCOUNT': '4.000'} [2023-02-24 17:37:01,751][177155] DAMAGECOUNT value on done: 9046.0 [2023-02-24 17:37:01,752][177155] Sum rewards: 3.990, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.016', 'AMMO5': '0.020', 'AMMO3': '0.074', 'AMMO4': '0.079', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.146', 'HEALTH': '0.209', 'HITCOUNT': '0.320', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.472', 'weapon2': '1.000', 'DAMAGECOUNT': '1.650', 'weapon3': '1.774', 'FRAGCOUNT': '4.000'} [2023-02-24 17:37:01,787][177157] DAMAGECOUNT value on done: 8114.0 [2023-02-24 17:37:01,787][177157] Sum rewards: 0.448, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.691', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO2': '0.047', 'weapon5': '0.068', 'ARMOR': '0.072', 'AMMO3': '0.106', 'WEAPON5': '0.200', 'HITCOUNT': '0.210', 'AMMO4': '0.235', 'WEAPON4': '0.450', 'WEAPON3': '0.550', 'weapon4': '0.550', 'weapon3': '1.042', 'DAMAGECOUNT': '1.362', 'weapon2': '1.696', 'FRAGCOUNT': '2.000'} [2023-02-24 17:37:01,859][177171] DAMAGECOUNT value on done: 8136.0 [2023-02-24 17:37:02,007][177157] DAMAGECOUNT value on done: 7436.0 [2023-02-24 17:37:02,007][177157] Sum rewards: 2.625, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.438', 'AMMO5': '0.007', 'AMMO2': '0.012', 'ARMOR': '0.016', 'WEAPON1': '0.030', 'AMMO4': '0.061', 'weapon5': '0.100', 'AMMO3': '0.127', 'weapon4': '0.128', 'WEAPON5': '0.150', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.119', 'weapon2': '1.484', 'weapon3': '1.618', 'FRAGCOUNT': '4.000'} [2023-02-24 17:37:02,029][177155] DAMAGECOUNT value on done: 8994.0 [2023-02-24 17:37:02,029][177155] Sum rewards: -3.298, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.144', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.027', 'WEAPON1': '0.060', 'weapon4': '0.098', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'weapon5': '0.182', 'HITCOUNT': '0.210', 'WEAPON5': '0.250', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.161', 'weapon2': '1.298', 'weapon3': '1.876', 'FRAGCOUNT': '2.500'} [2023-02-24 17:37:02,150][177171] DAMAGECOUNT value on done: 7730.0 [2023-02-24 17:37:02,151][177171] Sum rewards: -1.713, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.698', 'AMMO2': '0.024', 'AMMO5': '0.027', 'WEAPON1': '0.070', 'AMMO4': '0.119', 'AMMO3': '0.119', 'weapon5': '0.276', 'HITCOUNT': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.550', 'WEAPON3': '0.550', 'weapon4': '0.758', 'weapon3': '1.016', 'weapon2': '1.408', 'DAMAGECOUNT': '1.728', 'FRAGCOUNT': '3.000'} [2023-02-24 17:37:02,324][177155] DAMAGECOUNT value on done: 7122.0 [2023-02-24 17:37:02,325][177155] Sum rewards: 0.329, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.560', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO3': '0.057', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'HITCOUNT': '0.150', 'weapon5': '0.214', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.630', 'weapon4': '0.636', 'weapon3': '0.826', 'weapon2': '1.358', 'FRAGCOUNT': '2.000'} [2023-02-24 17:37:02,686][177153] Updated weights for policy 0, policy_version 2890 (0.0008) [2023-02-24 17:37:03,486][177156] DAMAGECOUNT value on done: 7849.0 [2023-02-24 17:37:03,487][177156] Sum rewards: 0.906, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.724', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.032', 'WEAPON1': '0.040', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'AMMO4': '0.159', 'weapon5': '0.202', 'weapon4': '0.226', 'HITCOUNT': '0.330', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'weapon2': '1.192', 'DAMAGECOUNT': '1.620', 'weapon3': '1.936', 'FRAGCOUNT': '5.000'} [2023-02-24 17:37:03,778][177156] DAMAGECOUNT value on done: 8985.0 [2023-02-24 17:37:03,779][177156] Sum rewards: 1.745, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.892', 'ARMOR': '0.012', 'AMMO2': '0.013', 'AMMO5': '0.026', 'AMMO4': '0.063', 'WEAPON1': '0.100', 'AMMO3': '0.130', 'weapon5': '0.248', 'WEAPON4': '0.250', 'HITCOUNT': '0.430', 'weapon4': '0.472', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'weapon2': '0.806', 'weapon3': '1.726', 'DAMAGECOUNT': '2.811', 'FRAGCOUNT': '5.000'} [2023-02-24 17:37:03,925][177156] DAMAGECOUNT value on done: 6769.0 [2023-02-24 17:37:03,926][177156] Sum rewards: -2.744, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.106', 'AMMO5': '0.024', 'ARMOR': '0.040', 'AMMO2': '0.041', 'WEAPON1': '0.090', 'AMMO3': '0.104', 'weapon5': '0.122', 'HITCOUNT': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.202', 'AMMO4': '0.203', 'DAMAGECOUNT': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.268', 'weapon3': '1.468'} [2023-02-24 17:37:04,225][177156] DAMAGECOUNT value on done: 8872.0 [2023-02-24 17:37:04,226][177156] Sum rewards: -4.721, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.612', 'AMMO2': '0.020', 'AMMO5': '0.027', 'ARMOR': '0.036', 'weapon5': '0.062', 'weapon4': '0.074', 'WEAPON1': '0.080', 'AMMO3': '0.089', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.771', 'FRAGCOUNT': '1.000', 'weapon2': '1.664', 'weapon3': '1.726'} [2023-02-24 17:37:05,558][177153] Updated weights for policy 0, policy_version 2900 (0.0008) [2023-02-24 17:37:06,376][177119] Fps is (10 sec: 13926.5, 60 sec: 14062.9, 300 sec: 13954.2). Total num frames: 11886592. Throughput: 0: 3512.1. Samples: 2965954. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:37:06,376][177119] Avg episode reward: [(0, '-0.671')] [2023-02-24 17:37:08,469][177153] Updated weights for policy 0, policy_version 2910 (0.0009) [2023-02-24 17:37:11,354][177153] Updated weights for policy 0, policy_version 2920 (0.0008) [2023-02-24 17:37:11,376][177119] Fps is (10 sec: 14336.1, 60 sec: 14062.9, 300 sec: 13968.1). Total num frames: 11960320. Throughput: 0: 3519.1. Samples: 2987252. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:37:11,376][177119] Avg episode reward: [(0, '-0.671')] [2023-02-24 17:37:14,291][177153] Updated weights for policy 0, policy_version 2930 (0.0008) [2023-02-24 17:37:16,376][177119] Fps is (10 sec: 14335.9, 60 sec: 14062.9, 300 sec: 13981.9). Total num frames: 12029952. Throughput: 0: 3518.1. Samples: 3008276. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:37:16,376][177119] Avg episode reward: [(0, '-0.671')] [2023-02-24 17:37:17,208][177153] Updated weights for policy 0, policy_version 2940 (0.0009) [2023-02-24 17:37:18,497][177170] DAMAGECOUNT value on done: 6969.0 [2023-02-24 17:37:18,498][177170] Sum rewards: 0.615, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.856', 'AMMO5': '0.017', 'ARMOR': '0.024', 'AMMO2': '0.027', 'weapon4': '0.044', 'WEAPON1': '0.070', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'AMMO4': '0.135', 'weapon5': '0.146', 'HITCOUNT': '0.260', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.891', 'weapon3': '1.526', 'weapon2': '1.750', 'FRAGCOUNT': '3.000'} [2023-02-24 17:37:18,800][177170] DAMAGECOUNT value on done: 10088.0 [2023-02-24 17:37:18,800][177170] Sum rewards: 0.770, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.012', 'HEALTH': '0.022', 'AMMO2': '0.026', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'AMMO3': '0.053', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'AMMO4': '0.129', 'weapon5': '0.158', 'WEAPON5': '0.250', 'weapon4': '0.268', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.510', 'FRAGCOUNT': '1.000', 'weapon3': '1.064', 'weapon2': '1.878'} [2023-02-24 17:37:18,867][177170] DAMAGECOUNT value on done: 7280.0 [2023-02-24 17:37:18,867][177170] Sum rewards: -3.407, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.826', 'AMMO5': '0.011', 'AMMO2': '0.014', 'ARMOR': '0.020', 'WEAPON1': '0.060', 'AMMO4': '0.070', 'weapon5': '0.080', 'AMMO3': '0.143', 'WEAPON5': '0.250', 'HITCOUNT': '0.400', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.155', 'weapon2': '1.316', 'weapon3': '2.300'} [2023-02-24 17:37:19,058][177172] DAMAGECOUNT value on done: 6995.0 [2023-02-24 17:37:19,059][177172] Sum rewards: 4.534, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.146', 'AMMO5': '0.010', 'AMMO2': '0.022', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'ARMOR': '0.056', 'AMMO3': '0.060', 'AMMO4': '0.110', 'weapon5': '0.154', 'HITCOUNT': '0.190', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.711', 'weapon3': '1.650', 'weapon2': '1.766', 'FRAGCOUNT': '3.000'} [2023-02-24 17:37:19,094][177158] DAMAGECOUNT value on done: 9601.0 [2023-02-24 17:37:19,094][177158] Sum rewards: 2.225, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'weapon4': '0.042', 'HEALTH': '0.054', 'AMMO3': '0.064', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'AMMO4': '0.139', 'weapon5': '0.140', 'WEAPON5': '0.150', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.759', 'weapon3': '1.012', 'FRAGCOUNT': '2.000', 'weapon2': '2.430'} [2023-02-24 17:37:19,159][177170] DAMAGECOUNT value on done: 8765.0 [2023-02-24 17:37:19,159][177170] Sum rewards: -0.434, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.612', 'AMMO2': '0.014', 'weapon4': '0.016', 'AMMO5': '0.018', 'WEAPON1': '0.060', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'weapon5': '0.106', 'AMMO3': '0.145', 'HITCOUNT': '0.280', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.350', 'weapon3': '1.462', 'weapon2': '2.006', 'FRAGCOUNT': '4.000'} [2023-02-24 17:37:19,274][177154] DAMAGECOUNT value on done: 8141.0 [2023-02-24 17:37:19,274][177154] Sum rewards: -2.966, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.789', 'AMMO2': '0.008', 'weapon4': '0.012', 'AMMO5': '0.019', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'WEAPON1': '0.080', 'AMMO3': '0.083', 'HITCOUNT': '0.090', 'weapon5': '0.376', 'WEAPON3': '0.450', 'WEAPON5': '0.500', 'DAMAGECOUNT': '0.888', 'weapon3': '1.192', 'weapon2': '1.784', 'FRAGCOUNT': '3.000'} [2023-02-24 17:37:19,351][177172] DAMAGECOUNT value on done: 6984.0 [2023-02-24 17:37:19,351][177172] Sum rewards: -3.165, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.318', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'ARMOR': '0.064', 'weapon5': '0.092', 'AMMO3': '0.108', 'weapon4': '0.140', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.290', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.783', 'weapon3': '1.592', 'weapon2': '1.920', 'FRAGCOUNT': '3.000'} [2023-02-24 17:37:19,395][177158] DAMAGECOUNT value on done: 7298.0 [2023-02-24 17:37:19,396][177158] Sum rewards: -2.815, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.013', 'AMMO2': '0.018', 'AMMO5': '0.020', 'WEAPON1': '0.060', 'AMMO4': '0.092', 'AMMO3': '0.123', 'HITCOUNT': '0.150', 'weapon5': '0.302', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.765', 'weapon3': '1.214', 'FRAGCOUNT': '2.000', 'weapon2': '2.104'} [2023-02-24 17:37:19,570][177154] DAMAGECOUNT value on done: 7361.0 [2023-02-24 17:37:19,570][177154] Sum rewards: -0.306, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.482', 'weapon4': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.025', 'ARMOR': '0.036', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.125', 'HITCOUNT': '0.160', 'weapon5': '0.312', 'WEAPON5': '0.350', 'WEAPON3': '0.350', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '1.149', 'weapon3': '1.196', 'weapon2': '1.780'} [2023-02-24 17:37:19,634][177158] DAMAGECOUNT value on done: 7430.0 [2023-02-24 17:37:19,634][177158] Sum rewards: -2.415, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.010', 'AMMO5': '0.011', 'AMMO2': '0.011', 'WEAPON1': '0.040', 'HITCOUNT': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.101', 'weapon5': '0.146', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.444', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.242', 'weapon2': '1.344'} [2023-02-24 17:37:19,820][177154] DAMAGECOUNT value on done: 9194.0 [2023-02-24 17:37:19,820][177154] Sum rewards: 2.220, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.206', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.039', 'weapon5': '0.066', 'ARMOR': '0.080', 'AMMO3': '0.114', 'AMMO4': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.296', 'HITCOUNT': '0.370', 'WEAPON3': '0.650', 'weapon3': '1.114', 'DAMAGECOUNT': '1.359', 'weapon2': '2.102', 'FRAGCOUNT': '3.000'} [2023-02-24 17:37:19,939][177158] DAMAGECOUNT value on done: 7052.0 [2023-02-24 17:37:19,939][177158] Sum rewards: -0.566, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.334', 'AMMO2': '0.013', 'AMMO5': '0.017', 'ARMOR': '0.024', 'WEAPON1': '0.040', 'AMMO3': '0.060', 'AMMO4': '0.066', 'weapon7': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.180', 'weapon5': '0.202', 'WEAPON5': '0.350', 'WEAPON3': '0.350', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.879', 'weapon3': '1.062', 'weapon2': '1.644'} [2023-02-24 17:37:20,117][177154] DAMAGECOUNT value on done: 7902.0 [2023-02-24 17:37:20,118][177154] Sum rewards: 1.443, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.800', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.013', 'weapon4': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.055', 'WEAPON1': '0.070', 'HITCOUNT': '0.080', 'weapon5': '0.240', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.432', 'weapon3': '1.098', 'weapon2': '1.848', 'FRAGCOUNT': '2.000'} [2023-02-24 17:37:20,156][177153] Updated weights for policy 0, policy_version 2950 (0.0008) [2023-02-24 17:37:20,238][177172] DAMAGECOUNT value on done: 6643.0 [2023-02-24 17:37:20,375][177171] DAMAGECOUNT value on done: 7665.0 [2023-02-24 17:37:20,375][177171] Sum rewards: 0.865, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.600', 'AMMO5': '0.007', 'weapon4': '0.010', 'AMMO2': '0.010', 'ARMOR': '0.024', 'WEAPON1': '0.030', 'AMMO4': '0.050', 'AMMO3': '0.081', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.160', 'WEAPON3': '0.400', 'weapon3': '0.788', 'DAMAGECOUNT': '0.948', 'weapon2': '1.868', 'FRAGCOUNT': '2.000'} [2023-02-24 17:37:20,515][177157] DAMAGECOUNT value on done: 8173.0 [2023-02-24 17:37:20,531][177155] DAMAGECOUNT value on done: 6729.0 [2023-02-24 17:37:20,531][177155] Sum rewards: 1.026, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.391', 'AMMO5': '0.008', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.022', 'weapon4': '0.036', 'ARMOR': '0.064', 'AMMO4': '0.096', 'AMMO3': '0.117', 'HITCOUNT': '0.140', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.585', 'WEAPON3': '0.650', 'weapon3': '1.618', 'weapon2': '1.842', 'FRAGCOUNT': '4.000'} [2023-02-24 17:37:20,535][177172] DAMAGECOUNT value on done: 6558.0 [2023-02-24 17:37:20,674][177171] DAMAGECOUNT value on done: 7757.0 [2023-02-24 17:37:20,674][177171] Sum rewards: -2.380, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.508', 'AMMO5': '0.017', 'AMMO2': '0.037', 'ARMOR': '0.048', 'WEAPON1': '0.060', 'AMMO3': '0.094', 'weapon4': '0.158', 'AMMO4': '0.186', 'weapon5': '0.194', 'HITCOUNT': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon2': '1.362', 'DAMAGECOUNT': '1.395', 'weapon3': '1.626', 'FRAGCOUNT': '2.000'} [2023-02-24 17:37:20,756][177157] DAMAGECOUNT value on done: 9657.0 [2023-02-24 17:37:20,756][177157] Sum rewards: -0.396, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.634', 'AMMO2': '0.013', 'AMMO5': '0.017', 'weapon4': '0.030', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'ARMOR': '0.056', 'AMMO3': '0.059', 'AMMO4': '0.066', 'HITCOUNT': '0.170', 'weapon5': '0.236', 'WEAPON5': '0.400', 'WEAPON3': '0.400', 'weapon3': '0.608', 'DAMAGECOUNT': '0.936', 'FRAGCOUNT': '2.000', 'weapon2': '2.656'} [2023-02-24 17:37:20,811][177157] DAMAGECOUNT value on done: 8498.0 [2023-02-24 17:37:20,811][177157] Sum rewards: 0.272, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.010', 'AMMO2': '0.031', 'ARMOR': '0.044', 'WEAPON1': '0.050', 'HITCOUNT': '0.120', 'HEALTH': '0.128', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'AMMO4': '0.156', 'weapon5': '0.182', 'weapon4': '0.236', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'weapon3': '0.710', 'DAMAGECOUNT': '1.152', 'weapon2': '2.166', 'FRAGCOUNT': '3.000'} [2023-02-24 17:37:20,835][177155] DAMAGECOUNT value on done: 9721.0 [2023-02-24 17:37:20,836][177155] Sum rewards: 8.086, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.196', 'AMMO5': '0.017', 'AMMO2': '0.028', 'WEAPON1': '0.070', 'AMMO3': '0.077', 'AMMO4': '0.142', 'HITCOUNT': '0.260', 'weapon5': '0.278', 'WEAPON3': '0.350', 'WEAPON5': '0.400', 'weapon3': '1.274', 'weapon2': '1.860', 'DAMAGECOUNT': '2.025', 'FRAGCOUNT': '6.000'} [2023-02-24 17:37:20,981][177171] DAMAGECOUNT value on done: 8431.0 [2023-02-24 17:37:20,981][177171] Sum rewards: -1.755, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.400', 'AMMO2': '0.028', 'AMMO5': '0.035', 'WEAPON1': '0.080', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'weapon5': '0.132', 'AMMO4': '0.138', 'HITCOUNT': '0.160', 'WEAPON5': '0.600', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.885', 'weapon2': '1.440', 'weapon3': '1.932', 'FRAGCOUNT': '3.000'} [2023-02-24 17:37:21,048][177157] DAMAGECOUNT value on done: 7573.0 [2023-02-24 17:37:21,109][177155] DAMAGECOUNT value on done: 9149.0 [2023-02-24 17:37:21,109][177155] Sum rewards: 3.211, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.356', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'AMMO3': '0.070', 'ARMOR': '0.085', 'AMMO4': '0.096', 'HITCOUNT': '0.130', 'weapon5': '0.132', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.292', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.465', 'weapon3': '0.516', 'weapon2': '2.422', 'FRAGCOUNT': '3.000'} [2023-02-24 17:37:21,285][177171] DAMAGECOUNT value on done: 8119.0 [2023-02-24 17:37:21,285][177171] Sum rewards: 1.058, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.010', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'AMMO3': '0.052', 'WEAPON1': '0.080', 'AMMO4': '0.103', 'HEALTH': '0.149', 'HITCOUNT': '0.200', 'WEAPON5': '0.300', 'weapon5': '0.312', 'WEAPON3': '0.350', 'DAMAGECOUNT': '1.167', 'weapon3': '1.336', 'weapon2': '1.678', 'FRAGCOUNT': '2.000'} [2023-02-24 17:37:21,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14062.9, 300 sec: 14009.7). Total num frames: 12099584. Throughput: 0: 3516.7. Samples: 3018758. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:37:21,376][177119] Avg episode reward: [(0, '-0.621')] [2023-02-24 17:37:21,377][177140] Saving new best policy, reward=-0.621! [2023-02-24 17:37:21,414][177155] DAMAGECOUNT value on done: 7473.0 [2023-02-24 17:37:21,415][177155] Sum rewards: -5.353, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.745', 'AMMO5': '0.012', 'AMMO2': '0.015', 'ARMOR': '0.016', 'WEAPON1': '0.030', 'AMMO4': '0.072', 'weapon5': '0.136', 'AMMO3': '0.142', 'weapon4': '0.174', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.672', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.522', 'weapon3': '1.640'} [2023-02-24 17:37:22,637][177156] DAMAGECOUNT value on done: 8228.0 [2023-02-24 17:37:22,637][177156] Sum rewards: 0.044, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.026', 'AMMO5': '0.031', 'AMMO3': '0.067', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'AMMO4': '0.130', 'HITCOUNT': '0.140', 'WEAPON3': '0.300', 'weapon4': '0.356', 'weapon5': '0.372', 'HEALTH': '0.424', 'WEAPON5': '0.550', 'weapon3': '0.784', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.137', 'weapon2': '2.046'} [2023-02-24 17:37:22,935][177156] DAMAGECOUNT value on done: 9440.0 [2023-02-24 17:37:22,936][177156] Sum rewards: 4.048, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.120', 'AMMO5': '0.015', 'AMMO2': '0.027', 'WEAPON1': '0.040', 'AMMO3': '0.103', 'HITCOUNT': '0.130', 'AMMO4': '0.136', 'weapon5': '0.186', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.365', 'weapon2': '1.616', 'weapon3': '1.900', 'FRAGCOUNT': '3.000'} [2023-02-24 17:37:23,098][177153] Updated weights for policy 0, policy_version 2960 (0.0009) [2023-02-24 17:37:23,136][177156] DAMAGECOUNT value on done: 7320.0 [2023-02-24 17:37:23,137][177156] Sum rewards: 3.859, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.474', 'weapon4': '0.002', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.028', 'WEAPON4': '0.050', 'AMMO3': '0.067', 'WEAPON1': '0.070', 'AMMO4': '0.137', 'HITCOUNT': '0.170', 'WEAPON3': '0.300', 'weapon5': '0.300', 'WEAPON5': '0.400', 'weapon3': '0.458', 'DAMAGECOUNT': '1.653', 'weapon2': '2.170', 'FRAGCOUNT': '3.000'} [2023-02-24 17:37:23,433][177156] DAMAGECOUNT value on done: 9291.0 [2023-02-24 17:37:23,434][177156] Sum rewards: 1.086, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.054', 'WEAPON1': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.020', 'AMMO5': '0.031', 'AMMO4': '0.100', 'AMMO3': '0.110', 'HITCOUNT': '0.180', 'weapon5': '0.264', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.257', 'weapon2': '1.602', 'weapon3': '1.696', 'FRAGCOUNT': '4.000'} [2023-02-24 17:37:25,997][177153] Updated weights for policy 0, policy_version 2970 (0.0008) [2023-02-24 17:37:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 12169216. Throughput: 0: 3516.1. Samples: 3039826. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:37:26,376][177119] Avg episode reward: [(0, '-0.572')] [2023-02-24 17:37:26,379][177140] Saving new best policy, reward=-0.572! [2023-02-24 17:37:28,928][177153] Updated weights for policy 0, policy_version 2980 (0.0008) [2023-02-24 17:37:31,376][177119] Fps is (10 sec: 13926.6, 60 sec: 14062.9, 300 sec: 14065.2). Total num frames: 12238848. Throughput: 0: 3515.0. Samples: 3060874. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:37:31,376][177119] Avg episode reward: [(0, '-0.572')] [2023-02-24 17:37:31,841][177153] Updated weights for policy 0, policy_version 2990 (0.0008) [2023-02-24 17:37:34,775][177153] Updated weights for policy 0, policy_version 3000 (0.0008) [2023-02-24 17:37:36,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 14065.2). Total num frames: 12308480. Throughput: 0: 3513.2. Samples: 3071378. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:37:36,376][177119] Avg episode reward: [(0, '-0.572')] [2023-02-24 17:37:37,568][177170] DAMAGECOUNT value on done: 7360.0 [2023-02-24 17:37:37,569][177170] Sum rewards: 3.367, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.950', 'AMMO5': '0.009', 'weapon4': '0.016', 'AMMO2': '0.025', 'ARMOR': '0.032', 'WEAPON1': '0.050', 'weapon5': '0.078', 'WEAPON4': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.131', 'HITCOUNT': '0.230', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.173', 'weapon2': '1.610', 'weapon3': '1.888', 'FRAGCOUNT': '4.000'} [2023-02-24 17:37:37,671][177153] Updated weights for policy 0, policy_version 3010 (0.0008) [2023-02-24 17:37:37,860][177170] DAMAGECOUNT value on done: 10363.0 [2023-02-24 17:37:37,861][177170] Sum rewards: 2.213, reward structure: {'DEATHCOUNT': '-6.750', 'weapon4': '0.002', 'AMMO5': '0.017', 'AMMO2': '0.021', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO3': '0.085', 'AMMO4': '0.107', 'HITCOUNT': '0.170', 'HEALTH': '0.217', 'weapon5': '0.268', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.825', 'weapon3': '1.274', 'weapon2': '1.970', 'FRAGCOUNT': '3.000'} [2023-02-24 17:37:37,932][177170] DAMAGECOUNT value on done: 7506.0 [2023-02-24 17:37:37,932][177170] Sum rewards: -0.892, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.238', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO2': '0.041', 'weapon4': '0.048', 'ARMOR': '0.060', 'AMMO3': '0.064', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'weapon5': '0.190', 'AMMO4': '0.203', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.678', 'FRAGCOUNT': '1.000', 'weapon3': '1.078', 'weapon2': '1.824'} [2023-02-24 17:37:38,168][177172] DAMAGECOUNT value on done: 7005.0 [2023-02-24 17:37:38,176][177158] DAMAGECOUNT value on done: 9921.0 [2023-02-24 17:37:38,177][177158] Sum rewards: -3.402, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.656', 'ARMOR': '0.012', 'AMMO2': '0.013', 'weapon4': '0.014', 'AMMO5': '0.015', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'weapon5': '0.112', 'AMMO3': '0.134', 'HITCOUNT': '0.270', 'WEAPON5': '0.300', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.960', 'FRAGCOUNT': '1.000', 'weapon3': '1.638', 'weapon2': '1.822'} [2023-02-24 17:37:38,231][177170] DAMAGECOUNT value on done: 9159.0 [2023-02-24 17:37:38,231][177170] Sum rewards: 0.973, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.550', 'AMMO5': '0.010', 'AMMO2': '0.011', 'ARMOR': '0.028', 'AMMO4': '0.056', 'WEAPON1': '0.070', 'AMMO3': '0.121', 'weapon5': '0.196', 'WEAPON5': '0.300', 'HITCOUNT': '0.320', 'WEAPON3': '0.700', 'weapon3': '1.166', 'DAMAGECOUNT': '1.182', 'weapon2': '1.862', 'FRAGCOUNT': '3.000'} [2023-02-24 17:37:38,466][177172] DAMAGECOUNT value on done: 7194.0 [2023-02-24 17:37:38,473][177154] DAMAGECOUNT value on done: 8792.0 [2023-02-24 17:37:38,474][177154] Sum rewards: 1.102, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO2': '0.014', 'AMMO5': '0.028', 'ARMOR': '0.044', 'AMMO4': '0.070', 'WEAPON1': '0.070', 'weapon5': '0.092', 'weapon4': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'HITCOUNT': '0.330', 'HEALTH': '0.498', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'weapon2': '1.358', 'DAMAGECOUNT': '1.473', 'weapon3': '1.980', 'FRAGCOUNT': '4.000'} [2023-02-24 17:37:38,475][177158] DAMAGECOUNT value on done: 7323.0 [2023-02-24 17:37:38,706][177158] DAMAGECOUNT value on done: 7769.0 [2023-02-24 17:37:38,707][177158] Sum rewards: 1.464, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.006', 'weapon4': '0.006', 'AMMO5': '0.012', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'ARMOR': '0.072', 'AMMO3': '0.076', 'HITCOUNT': '0.080', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon5': '0.236', 'WEAPON3': '0.300', 'weapon3': '0.864', 'DAMAGECOUNT': '1.017', 'FRAGCOUNT': '2.000', 'weapon2': '2.350'} [2023-02-24 17:37:38,774][177154] DAMAGECOUNT value on done: 7495.0 [2023-02-24 17:37:38,774][177154] Sum rewards: -5.351, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.504', 'AMMO2': '0.014', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.030', 'AMMO4': '0.068', 'HITCOUNT': '0.150', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'weapon4': '0.264', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.402', 'WEAPON3': '1.100', 'weapon2': '1.354', 'weapon3': '1.918', 'FRAGCOUNT': '2.000'} [2023-02-24 17:37:39,007][177158] DAMAGECOUNT value on done: 7182.0 [2023-02-24 17:37:39,007][177158] Sum rewards: -7.278, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.551', 'AMMO5': '0.022', 'AMMO2': '0.023', 'ARMOR': '0.040', 'weapon4': '0.052', 'WEAPON1': '0.070', 'HITCOUNT': '0.090', 'AMMO4': '0.113', 'AMMO3': '0.167', 'weapon5': '0.198', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.390', 'WEAPON5': '0.450', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.750', 'weapon2': '1.492', 'weapon3': '1.716'} [2023-02-24 17:37:39,028][177154] DAMAGECOUNT value on done: 9459.0 [2023-02-24 17:37:39,029][177154] Sum rewards: -1.803, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.882', 'AMMO5': '0.020', 'AMMO2': '0.036', 'weapon5': '0.038', 'WEAPON1': '0.070', 'AMMO3': '0.118', 'AMMO4': '0.180', 'HITCOUNT': '0.190', 'weapon4': '0.338', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.795', 'weapon2': '1.084', 'weapon3': '1.560', 'FRAGCOUNT': '3.000'} [2023-02-24 17:37:39,324][177154] DAMAGECOUNT value on done: 8276.0 [2023-02-24 17:37:39,325][177154] Sum rewards: 1.013, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.049', 'AMMO5': '0.009', 'ARMOR': '0.028', 'AMMO2': '0.034', 'WEAPON1': '0.040', 'weapon4': '0.126', 'AMMO3': '0.136', 'weapon5': '0.160', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'HITCOUNT': '0.220', 'WEAPON4': '0.250', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.122', 'weapon3': '1.310', 'weapon2': '1.754', 'FRAGCOUNT': '5.000'} [2023-02-24 17:37:39,357][177172] DAMAGECOUNT value on done: 6957.0 [2023-02-24 17:37:39,357][177172] Sum rewards: -2.484, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.552', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.030', 'ARMOR': '0.032', 'weapon5': '0.050', 'WEAPON1': '0.060', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'HITCOUNT': '0.280', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.942', 'FRAGCOUNT': '1.000', 'weapon3': '1.580', 'weapon2': '1.712'} [2023-02-24 17:37:39,505][177171] DAMAGECOUNT value on done: 7999.0 [2023-02-24 17:37:39,505][177171] Sum rewards: -2.228, reward structure: {'DEATHCOUNT': '-9.750', 'ARMOR': '0.012', 'AMMO5': '0.014', 'AMMO2': '0.024', 'weapon4': '0.030', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.096', 'AMMO4': '0.117', 'weapon5': '0.140', 'HITCOUNT': '0.290', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HEALTH': '0.634', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.002', 'weapon2': '1.482', 'weapon3': '1.780'} [2023-02-24 17:37:39,648][177172] DAMAGECOUNT value on done: 6694.0 [2023-02-24 17:37:39,649][177172] Sum rewards: -2.595, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.005', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon5': '0.062', 'ARMOR': '0.064', 'AMMO4': '0.081', 'AMMO3': '0.088', 'HITCOUNT': '0.100', 'weapon6': '0.146', 'AMMO6': '0.178', 'AMMO7': '0.178', 'WEAPON6': '0.200', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.408', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.368', 'weapon2': '1.768'} [2023-02-24 17:37:39,654][177157] DAMAGECOUNT value on done: 8544.0 [2023-02-24 17:37:39,654][177157] Sum rewards: 0.320, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.250', 'AMMO2': '0.017', 'AMMO5': '0.024', 'AMMO4': '0.085', 'WEAPON1': '0.090', 'AMMO3': '0.115', 'weapon5': '0.208', 'HITCOUNT': '0.250', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.113', 'weapon3': '1.594', 'weapon2': '1.824', 'FRAGCOUNT': '4.000'} [2023-02-24 17:37:39,742][177155] DAMAGECOUNT value on done: 7361.0 [2023-02-24 17:37:39,743][177155] Sum rewards: -0.819, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.395', 'AMMO4': '-0.054', 'AMMO2': '-0.011', 'AMMO5': '0.019', 'ARMOR': '0.036', 'WEAPON1': '0.080', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'weapon5': '0.158', 'HITCOUNT': '0.190', 'weapon4': '0.208', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'weapon3': '1.242', 'DAMAGECOUNT': '1.416', 'weapon2': '1.552', 'FRAGCOUNT': '3.000'} [2023-02-24 17:37:39,804][177171] DAMAGECOUNT value on done: 7972.0 [2023-02-24 17:37:39,805][177171] Sum rewards: -0.643, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.072', 'AMMO2': '0.000', 'AMMO4': '0.001', 'ARMOR': '0.004', 'AMMO5': '0.015', 'WEAPON4': '0.050', 'WEAPON1': '0.080', 'weapon4': '0.104', 'AMMO3': '0.107', 'HITCOUNT': '0.120', 'weapon5': '0.146', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.650', 'weapon2': '1.408', 'weapon3': '1.448', 'FRAGCOUNT': '2.000'} [2023-02-24 17:37:39,938][177157] DAMAGECOUNT value on done: 9917.0 [2023-02-24 17:37:39,938][177157] Sum rewards: -1.138, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.066', 'AMMO5': '0.017', 'ARMOR': '0.020', 'AMMO2': '0.024', 'weapon4': '0.046', 'WEAPON1': '0.060', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'AMMO4': '0.122', 'weapon5': '0.140', 'HITCOUNT': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.780', 'FRAGCOUNT': '1.000', 'weapon2': '1.710', 'weapon3': '1.810'} [2023-02-24 17:37:39,968][177157] DAMAGECOUNT value on done: 8812.0 [2023-02-24 17:37:39,969][177157] Sum rewards: -2.918, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.079', 'AMMO5': '0.005', 'AMMO2': '0.013', 'ARMOR': '0.040', 'weapon4': '0.040', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.066', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'HITCOUNT': '0.160', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.942', 'weapon3': '1.542', 'weapon2': '1.776', 'FRAGCOUNT': '2.000'} [2023-02-24 17:37:40,042][177155] DAMAGECOUNT value on done: 9781.0 [2023-02-24 17:37:40,110][177171] DAMAGECOUNT value on done: 8606.0 [2023-02-24 17:37:40,111][177171] Sum rewards: 0.853, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.218', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO3': '0.047', 'WEAPON1': '0.050', 'AMMO4': '0.051', 'ARMOR': '0.056', 'weapon4': '0.074', 'weapon5': '0.090', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'WEAPON5': '0.200', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.525', 'FRAGCOUNT': '1.000', 'weapon3': '1.084', 'weapon2': '2.006'} [2023-02-24 17:37:40,244][177157] DAMAGECOUNT value on done: 7885.0 [2023-02-24 17:37:40,245][177157] Sum rewards: 2.222, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.011', 'WEAPON1': '0.030', 'AMMO2': '0.039', 'ARMOR': '0.040', 'AMMO3': '0.070', 'weapon5': '0.096', 'weapon4': '0.116', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'AMMO4': '0.196', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'HEALTH': '0.795', 'DAMAGECOUNT': '0.936', 'weapon3': '1.316', 'weapon2': '2.106', 'FRAGCOUNT': '3.000'} [2023-02-24 17:37:40,324][177155] DAMAGECOUNT value on done: 9653.0 [2023-02-24 17:37:40,324][177155] Sum rewards: 3.119, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.429', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.039', 'WEAPON1': '0.060', 'AMMO3': '0.084', 'weapon5': '0.230', 'WEAPON5': '0.300', 'HITCOUNT': '0.350', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.512', 'weapon2': '1.566', 'weapon3': '1.784', 'FRAGCOUNT': '3.000'} [2023-02-24 17:37:40,413][177171] DAMAGECOUNT value on done: 8506.0 [2023-02-24 17:37:40,414][177171] Sum rewards: -1.675, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.434', 'AMMO5': '0.019', 'ARMOR': '0.024', 'AMMO2': '0.039', 'WEAPON1': '0.040', 'AMMO3': '0.094', 'weapon5': '0.180', 'HITCOUNT': '0.190', 'AMMO4': '0.194', 'weapon4': '0.290', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'weapon3': '0.970', 'DAMAGECOUNT': '1.161', 'weapon2': '2.158', 'FRAGCOUNT': '3.000'} [2023-02-24 17:37:40,601][177153] Updated weights for policy 0, policy_version 3020 (0.0008) [2023-02-24 17:37:40,634][177155] DAMAGECOUNT value on done: 7829.0 [2023-02-24 17:37:40,634][177155] Sum rewards: -0.871, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.392', 'weapon4': '0.006', 'ARMOR': '0.016', 'AMMO2': '0.020', 'AMMO5': '0.020', 'WEAPON1': '0.080', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'HITCOUNT': '0.160', 'weapon5': '0.174', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.068', 'weapon3': '1.186', 'weapon2': '1.986'} [2023-02-24 17:37:41,376][177119] Fps is (10 sec: 13926.2, 60 sec: 14062.9, 300 sec: 14065.2). Total num frames: 12378112. Throughput: 0: 3510.0. Samples: 3092346. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 17:37:41,376][177119] Avg episode reward: [(0, '-0.602')] [2023-02-24 17:37:41,840][177156] DAMAGECOUNT value on done: 8593.0 [2023-02-24 17:37:41,840][177156] Sum rewards: -1.923, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.630', 'AMMO5': '0.015', 'AMMO2': '0.020', 'WEAPON1': '0.050', 'ARMOR': '0.072', 'weapon5': '0.082', 'AMMO4': '0.098', 'AMMO3': '0.167', 'HITCOUNT': '0.260', 'WEAPON5': '0.300', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.095', 'weapon2': '1.432', 'weapon3': '1.866', 'FRAGCOUNT': '3.000'} [2023-02-24 17:37:42,133][177156] DAMAGECOUNT value on done: 9610.0 [2023-02-24 17:37:42,134][177156] Sum rewards: -0.182, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.514', 'weapon4': '0.002', 'AMMO2': '0.012', 'AMMO5': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.061', 'WEAPON1': '0.070', 'AMMO3': '0.087', 'HITCOUNT': '0.130', 'weapon5': '0.244', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.510', 'FRAGCOUNT': '1.000', 'weapon3': '1.226', 'weapon2': '2.074'} [2023-02-24 17:37:42,327][177156] DAMAGECOUNT value on done: 7389.0 [2023-02-24 17:37:42,629][177156] DAMAGECOUNT value on done: 9800.0 [2023-02-24 17:37:42,629][177156] Sum rewards: 0.969, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.502', 'AMMO5': '0.015', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.097', 'AMMO3': '0.120', 'weapon5': '0.160', 'HITCOUNT': '0.210', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon3': '1.424', 'DAMAGECOUNT': '1.527', 'weapon2': '1.668', 'FRAGCOUNT': '2.000'} [2023-02-24 17:37:43,503][177153] Updated weights for policy 0, policy_version 3030 (0.0008) [2023-02-24 17:37:46,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14065.2). Total num frames: 12447744. Throughput: 0: 3516.4. Samples: 3113624. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:37:46,376][177119] Avg episode reward: [(0, '-0.643')] [2023-02-24 17:37:46,401][177153] Updated weights for policy 0, policy_version 3040 (0.0008) [2023-02-24 17:37:49,293][177153] Updated weights for policy 0, policy_version 3050 (0.0008) [2023-02-24 17:37:51,376][177119] Fps is (10 sec: 14336.1, 60 sec: 14062.9, 300 sec: 14079.1). Total num frames: 12521472. Throughput: 0: 3516.7. Samples: 3124204. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:37:51,376][177119] Avg episode reward: [(0, '-0.643')] [2023-02-24 17:37:52,188][177153] Updated weights for policy 0, policy_version 3060 (0.0008) [2023-02-24 17:37:55,109][177153] Updated weights for policy 0, policy_version 3070 (0.0008) [2023-02-24 17:37:56,376][177119] Fps is (10 sec: 14336.1, 60 sec: 14063.0, 300 sec: 14079.1). Total num frames: 12591104. Throughput: 0: 3513.9. Samples: 3145376. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:37:56,376][177119] Avg episode reward: [(0, '-0.643')] [2023-02-24 17:37:56,576][177170] DAMAGECOUNT value on done: 7900.0 [2023-02-24 17:37:56,577][177170] Sum rewards: 5.090, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.440', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.054', 'AMMO4': '0.077', 'AMMO3': '0.084', 'weapon4': '0.180', 'WEAPON5': '0.200', 'HITCOUNT': '0.390', 'WEAPON3': '0.500', 'weapon3': '1.568', 'DAMAGECOUNT': '1.620', 'weapon2': '1.732', 'FRAGCOUNT': '5.000'} [2023-02-24 17:37:56,868][177170] DAMAGECOUNT value on done: 10608.0 [2023-02-24 17:37:56,869][177170] Sum rewards: -3.560, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.936', 'AMMO2': '0.015', 'AMMO5': '0.025', 'weapon4': '0.054', 'WEAPON1': '0.070', 'AMMO4': '0.074', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'weapon5': '0.172', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.735', 'WEAPON3': '0.900', 'weapon2': '1.296', 'weapon3': '1.684', 'FRAGCOUNT': '2.000'} [2023-02-24 17:37:56,952][177170] DAMAGECOUNT value on done: 7996.0 [2023-02-24 17:37:56,952][177170] Sum rewards: 1.242, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.686', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'ARMOR': '0.076', 'weapon4': '0.078', 'AMMO3': '0.121', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.174', 'HITCOUNT': '0.280', 'WEAPON3': '0.700', 'weapon3': '1.046', 'DAMAGECOUNT': '1.470', 'weapon2': '2.006', 'FRAGCOUNT': '3.000'} [2023-02-24 17:37:57,250][177170] DAMAGECOUNT value on done: 9453.0 [2023-02-24 17:37:57,250][177158] DAMAGECOUNT value on done: 10169.0 [2023-02-24 17:37:57,251][177158] Sum rewards: 2.440, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.484', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON1': '0.030', 'weapon4': '0.036', 'AMMO4': '0.061', 'AMMO3': '0.062', 'ARMOR': '0.063', 'weapon5': '0.074', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.230', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.744', 'weapon3': '1.066', 'FRAGCOUNT': '2.000', 'weapon2': '2.390'} [2023-02-24 17:37:57,251][177170] Sum rewards: -4.062, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.709', 'AMMO5': '0.016', 'AMMO2': '0.034', 'WEAPON1': '0.070', 'AMMO3': '0.071', 'HITCOUNT': '0.130', 'weapon5': '0.146', 'AMMO4': '0.168', 'WEAPON3': '0.400', 'weapon3': '0.432', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.474', 'ARMOR': '0.543', 'DAMAGECOUNT': '0.882', 'FRAGCOUNT': '1.000', 'weapon2': '2.130'} [2023-02-24 17:37:57,252][177172] DAMAGECOUNT value on done: 7514.0 [2023-02-24 17:37:57,253][177172] Sum rewards: 1.326, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.688', 'AMMO2': '0.010', 'AMMO5': '0.020', 'AMMO4': '0.049', 'WEAPON1': '0.080', 'AMMO3': '0.126', 'weapon5': '0.198', 'HITCOUNT': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'weapon2': '1.516', 'DAMAGECOUNT': '1.527', 'weapon3': '1.688', 'FRAGCOUNT': '2.000'} [2023-02-24 17:37:57,556][177154] DAMAGECOUNT value on done: 9052.0 [2023-02-24 17:37:57,556][177154] Sum rewards: 1.404, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon4': '0.048', 'weapon5': '0.052', 'AMMO3': '0.070', 'AMMO4': '0.076', 'HEALTH': '0.102', 'HITCOUNT': '0.110', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON3': '0.400', 'ARMOR': '0.491', 'DAMAGECOUNT': '0.780', 'weapon3': '1.120', 'weapon2': '1.812', 'FRAGCOUNT': '2.000'} [2023-02-24 17:37:57,557][177172] DAMAGECOUNT value on done: 7344.0 [2023-02-24 17:37:57,557][177172] Sum rewards: -5.451, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.421', 'AMMO5': '0.007', 'AMMO2': '0.017', 'ARMOR': '0.032', 'weapon5': '0.052', 'WEAPON1': '0.080', 'AMMO4': '0.083', 'weapon4': '0.084', 'HITCOUNT': '0.160', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.182', 'weapon2': '2.048'} [2023-02-24 17:37:57,562][177158] DAMAGECOUNT value on done: 7560.0 [2023-02-24 17:37:57,563][177158] Sum rewards: -0.814, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.510', 'AMMO5': '0.022', 'AMMO2': '0.029', 'WEAPON1': '0.070', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'AMMO4': '0.142', 'weapon5': '0.200', 'HITCOUNT': '0.230', 'WEAPON5': '0.450', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.711', 'weapon3': '1.174', 'weapon2': '1.542', 'FRAGCOUNT': '2.000'} [2023-02-24 17:37:57,826][177158] DAMAGECOUNT value on done: 8139.0 [2023-02-24 17:37:57,827][177158] Sum rewards: -1.197, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.883', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon4': '0.072', 'ARMOR': '0.096', 'weapon5': '0.102', 'AMMO3': '0.110', 'AMMO4': '0.116', 'WEAPON4': '0.250', 'HITCOUNT': '0.320', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.110', 'weapon3': '1.570', 'weapon2': '1.876', 'FRAGCOUNT': '2.000'} [2023-02-24 17:37:57,848][177154] DAMAGECOUNT value on done: 7550.0 [2023-02-24 17:37:58,043][177153] Updated weights for policy 0, policy_version 3080 (0.0008) [2023-02-24 17:37:58,117][177154] DAMAGECOUNT value on done: 9642.0 [2023-02-24 17:37:58,118][177154] Sum rewards: -4.401, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.150', 'AMMO5': '0.020', 'AMMO2': '0.033', 'weapon4': '0.034', 'WEAPON1': '0.090', 'HITCOUNT': '0.100', 'AMMO3': '0.138', 'AMMO4': '0.165', 'WEAPON4': '0.200', 'weapon5': '0.240', 'DAMAGECOUNT': '0.549', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.434', 'weapon2': '1.496'} [2023-02-24 17:37:58,119][177158] DAMAGECOUNT value on done: 7642.0 [2023-02-24 17:37:58,120][177158] Sum rewards: -1.650, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.932', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.042', 'ARMOR': '0.051', 'weapon5': '0.052', 'WEAPON1': '0.060', 'AMMO4': '0.100', 'AMMO3': '0.119', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.330', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.380', 'weapon3': '1.644', 'weapon2': '1.774', 'FRAGCOUNT': '3.000'} [2023-02-24 17:37:58,412][177154] DAMAGECOUNT value on done: 8563.0 [2023-02-24 17:37:58,441][177172] DAMAGECOUNT value on done: 7573.0 [2023-02-24 17:37:58,441][177172] Sum rewards: -1.973, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.812', 'AMMO2': '0.014', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'weapon4': '0.066', 'AMMO4': '0.067', 'ARMOR': '0.080', 'AMMO3': '0.092', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'weapon5': '0.258', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'weapon3': '1.146', 'FRAGCOUNT': '1.500', 'weapon2': '1.672', 'DAMAGECOUNT': '1.716'} [2023-02-24 17:37:58,542][177171] DAMAGECOUNT value on done: 8224.0 [2023-02-24 17:37:58,543][177171] Sum rewards: -1.121, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.740', 'AMMO5': '0.010', 'AMMO2': '0.029', 'WEAPON1': '0.050', 'weapon5': '0.050', 'weapon4': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'AMMO4': '0.146', 'HITCOUNT': '0.190', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.675', 'WEAPON3': '0.750', 'weapon2': '1.338', 'weapon3': '1.864', 'FRAGCOUNT': '3.000'} [2023-02-24 17:37:58,723][177157] DAMAGECOUNT value on done: 8865.0 [2023-02-24 17:37:58,723][177157] Sum rewards: -1.588, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.301', 'AMMO2': '0.016', 'AMMO5': '0.025', 'ARMOR': '0.028', 'WEAPON1': '0.060', 'AMMO3': '0.066', 'AMMO4': '0.081', 'HITCOUNT': '0.200', 'weapon5': '0.272', 'WEAPON3': '0.400', 'WEAPON5': '0.450', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.963', 'weapon3': '1.296', 'weapon2': '1.856'} [2023-02-24 17:37:58,732][177172] DAMAGECOUNT value on done: 7037.0 [2023-02-24 17:37:58,733][177172] Sum rewards: 3.891, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.504', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'ARMOR': '0.072', 'AMMO3': '0.075', 'AMMO4': '0.088', 'weapon5': '0.114', 'WEAPON5': '0.150', 'HITCOUNT': '0.350', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.029', 'weapon3': '1.360', 'weapon2': '2.004', 'FRAGCOUNT': '3.000'} [2023-02-24 17:37:58,833][177171] DAMAGECOUNT value on done: 8121.0 [2023-02-24 17:37:58,863][177155] DAMAGECOUNT value on done: 7791.0 [2023-02-24 17:37:58,864][177155] Sum rewards: 0.060, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.945', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.033', 'WEAPON1': '0.070', 'AMMO3': '0.106', 'weapon4': '0.120', 'weapon5': '0.164', 'AMMO4': '0.166', 'HITCOUNT': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.290', 'weapon3': '1.502', 'weapon2': '1.690', 'FRAGCOUNT': '2.000'} [2023-02-24 17:37:59,023][177157] DAMAGECOUNT value on done: 10326.0 [2023-02-24 17:37:59,023][177157] Sum rewards: -3.537, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.550', 'AMMO2': '0.011', 'AMMO5': '0.012', 'ARMOR': '0.032', 'AMMO4': '0.054', 'WEAPON1': '0.080', 'weapon5': '0.118', 'AMMO3': '0.131', 'HITCOUNT': '0.200', 'weapon4': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'weapon3': '0.830', 'DAMAGECOUNT': '1.227', 'weapon2': '2.038', 'FRAGCOUNT': '4.000'} [2023-02-24 17:37:59,032][177157] DAMAGECOUNT value on done: 9319.0 [2023-02-24 17:37:59,032][177157] Sum rewards: -0.684, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.185', 'AMMO2': '0.010', 'weapon4': '0.010', 'ARMOR': '0.016', 'AMMO5': '0.018', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'weapon5': '0.064', 'WEAPON1': '0.070', 'AMMO3': '0.169', 'HITCOUNT': '0.390', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'weapon2': '1.334', 'DAMAGECOUNT': '1.521', 'weapon3': '2.150', 'FRAGCOUNT': '3.000'} [2023-02-24 17:37:59,142][177171] DAMAGECOUNT value on done: 9138.0 [2023-02-24 17:37:59,143][177171] Sum rewards: -0.374, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.918', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'AMMO5': '0.038', 'AMMO4': '0.100', 'AMMO3': '0.107', 'HITCOUNT': '0.210', 'weapon5': '0.266', 'weapon4': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon3': '1.002', 'DAMAGECOUNT': '1.596', 'weapon2': '1.700', 'FRAGCOUNT': '3.000'} [2023-02-24 17:37:59,165][177155] DAMAGECOUNT value on done: 9926.0 [2023-02-24 17:37:59,166][177155] Sum rewards: -2.767, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.652', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon5': '0.114', 'AMMO3': '0.115', 'AMMO4': '0.117', 'weapon4': '0.126', 'HITCOUNT': '0.150', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.435', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.700', 'weapon3': '0.906', 'weapon2': '2.090'} [2023-02-24 17:37:59,331][177157] DAMAGECOUNT value on done: 8385.0 [2023-02-24 17:37:59,331][177157] Sum rewards: 2.504, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.659', 'AMMO5': '0.022', 'AMMO2': '0.033', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'AMMO4': '0.164', 'weapon5': '0.176', 'weapon4': '0.322', 'WEAPON5': '0.400', 'HITCOUNT': '0.410', 'WEAPON3': '0.600', 'weapon3': '1.298', 'DAMAGECOUNT': '1.500', 'weapon2': '1.652', 'FRAGCOUNT': '3.000'} [2023-02-24 17:37:59,442][177155] DAMAGECOUNT value on done: 9899.0 [2023-02-24 17:37:59,443][177155] Sum rewards: -0.255, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.946', 'ARMOR': '0.008', 'AMMO2': '0.013', 'AMMO5': '0.019', 'WEAPON1': '0.060', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'weapon5': '0.128', 'HITCOUNT': '0.190', 'weapon4': '0.298', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.738', 'WEAPON3': '0.800', 'weapon2': '1.110', 'weapon3': '1.442', 'FRAGCOUNT': '2.000'} [2023-02-24 17:37:59,445][177171] DAMAGECOUNT value on done: 8561.0 [2023-02-24 17:37:59,445][177171] Sum rewards: -1.475, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.535', 'AMMO2': '0.005', 'weapon5': '0.006', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO4': '0.025', 'HITCOUNT': '0.040', 'WEAPON1': '0.040', 'weapon4': '0.044', 'AMMO3': '0.135', 'DAMAGECOUNT': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.530', 'weapon3': '1.940'} [2023-02-24 17:37:59,747][177155] DAMAGECOUNT value on done: 8143.0 [2023-02-24 17:37:59,748][177155] Sum rewards: -2.124, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.962', 'AMMO2': '0.013', 'AMMO5': '0.015', 'ARMOR': '0.020', 'WEAPON1': '0.040', 'AMMO4': '0.067', 'weapon5': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.125', 'weapon4': '0.172', 'WEAPON5': '0.300', 'HITCOUNT': '0.320', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.942', 'FRAGCOUNT': '1.000', 'weapon3': '1.470', 'weapon2': '1.686'} [2023-02-24 17:38:00,905][177156] DAMAGECOUNT value on done: 8904.0 [2023-02-24 17:38:00,906][177156] Sum rewards: 1.813, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.026', 'AMMO5': '0.015', 'weapon4': '0.026', 'AMMO2': '0.039', 'WEAPON1': '0.040', 'ARMOR': '0.048', 'AMMO3': '0.099', 'HITCOUNT': '0.130', 'weapon5': '0.170', 'AMMO4': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'weapon3': '0.876', 'DAMAGECOUNT': '0.933', 'weapon2': '2.070', 'FRAGCOUNT': '3.000'} [2023-02-24 17:38:00,943][177153] Updated weights for policy 0, policy_version 3090 (0.0009) [2023-02-24 17:38:01,204][177156] DAMAGECOUNT value on done: 9852.0 [2023-02-24 17:38:01,204][177156] Sum rewards: -1.176, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.590', 'AMMO5': '0.012', 'AMMO2': '0.025', 'WEAPON1': '0.060', 'weapon5': '0.078', 'ARMOR': '0.113', 'AMMO3': '0.121', 'AMMO4': '0.126', 'HITCOUNT': '0.230', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.416', 'DAMAGECOUNT': '0.726', 'WEAPON3': '0.750', 'weapon3': '0.976', 'FRAGCOUNT': '1.000', 'weapon2': '1.830'} [2023-02-24 17:38:01,376][177119] Fps is (10 sec: 13926.6, 60 sec: 14063.0, 300 sec: 14093.0). Total num frames: 12660736. Throughput: 0: 3513.8. Samples: 3166398. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:38:01,376][177119] Avg episode reward: [(0, '-0.679')] [2023-02-24 17:38:01,388][177156] DAMAGECOUNT value on done: 7506.0 [2023-02-24 17:38:01,389][177156] Sum rewards: -4.143, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.128', 'AMMO5': '0.009', 'AMMO2': '0.024', 'ARMOR': '0.028', 'weapon4': '0.034', 'WEAPON1': '0.050', 'weapon5': '0.082', 'AMMO4': '0.120', 'AMMO3': '0.138', 'HITCOUNT': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.351', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.030', 'weapon2': '1.978'} [2023-02-24 17:38:01,686][177156] DAMAGECOUNT value on done: 9971.0 [2023-02-24 17:38:01,687][177156] Sum rewards: 3.098, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.087', 'weapon5': '0.132', 'WEAPON5': '0.150', 'HEALTH': '0.154', 'HITCOUNT': '0.160', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.513', 'weapon3': '1.296', 'weapon2': '1.624', 'FRAGCOUNT': '3.000'} [2023-02-24 17:38:03,848][177153] Updated weights for policy 0, policy_version 3100 (0.0009) [2023-02-24 17:38:06,376][177119] Fps is (10 sec: 13926.2, 60 sec: 14062.9, 300 sec: 14079.1). Total num frames: 12730368. Throughput: 0: 3516.4. Samples: 3176998. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:38:06,376][177119] Avg episode reward: [(0, '-0.676')] [2023-02-24 17:38:06,511][177158] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 17:38:06,770][177153] Updated weights for policy 0, policy_version 3110 (0.0009) [2023-02-24 17:38:09,697][177153] Updated weights for policy 0, policy_version 3120 (0.0008) [2023-02-24 17:38:11,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 14079.1). Total num frames: 12800000. Throughput: 0: 3514.6. Samples: 3197982. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:38:11,376][177119] Avg episode reward: [(0, '-0.676')] [2023-02-24 17:38:12,618][177153] Updated weights for policy 0, policy_version 3130 (0.0008) [2023-02-24 17:38:15,535][177153] Updated weights for policy 0, policy_version 3140 (0.0008) [2023-02-24 17:38:15,696][177170] DAMAGECOUNT value on done: 8426.0 [2023-02-24 17:38:15,697][177170] Sum rewards: 2.771, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.201', 'AMMO5': '0.009', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.076', 'AMMO4': '0.088', 'AMMO3': '0.113', 'weapon5': '0.124', 'WEAPON5': '0.200', 'HITCOUNT': '0.330', 'WEAPON3': '0.600', 'weapon3': '1.558', 'DAMAGECOUNT': '1.578', 'weapon2': '1.688', 'FRAGCOUNT': '4.000'} [2023-02-24 17:38:15,997][177170] DAMAGECOUNT value on done: 10908.0 [2023-02-24 17:38:16,091][177170] DAMAGECOUNT value on done: 8221.0 [2023-02-24 17:38:16,091][177170] Sum rewards: -1.916, reward structure: {'DEATHCOUNT': '-9.000', 'ARMOR': '0.008', 'HEALTH': '0.014', 'AMMO5': '0.015', 'AMMO2': '0.034', 'WEAPON1': '0.060', 'weapon4': '0.062', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'AMMO4': '0.167', 'HITCOUNT': '0.180', 'weapon5': '0.192', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.675', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.560', 'weapon2': '1.844'} [2023-02-24 17:38:16,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 14079.1). Total num frames: 12869632. Throughput: 0: 3513.7. Samples: 3218990. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:38:16,376][177119] Avg episode reward: [(0, '-0.728')] [2023-02-24 17:38:16,388][177170] DAMAGECOUNT value on done: 10015.0 [2023-02-24 17:38:16,388][177170] Sum rewards: 2.986, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.904', 'AMMO5': '0.018', 'AMMO2': '0.062', 'WEAPON1': '0.100', 'AMMO3': '0.110', 'weapon4': '0.158', 'weapon5': '0.172', 'WEAPON4': '0.200', 'AMMO4': '0.309', 'ARMOR': '0.400', 'HITCOUNT': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'weapon2': '1.292', 'DAMAGECOUNT': '1.686', 'weapon3': '1.782', 'FRAGCOUNT': '5.000'} [2023-02-24 17:38:16,416][177172] DAMAGECOUNT value on done: 7682.0 [2023-02-24 17:38:16,416][177172] Sum rewards: -0.087, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.662', 'AMMO5': '0.015', 'AMMO2': '0.030', 'WEAPON1': '0.040', 'AMMO3': '0.069', 'weapon4': '0.086', 'AMMO4': '0.149', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.192', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.504', 'weapon3': '0.870', 'FRAGCOUNT': '1.000', 'weapon2': '2.020'} [2023-02-24 17:38:16,427][177158] DAMAGECOUNT value on done: 10564.0 [2023-02-24 17:38:16,427][177158] Sum rewards: 0.115, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.036', 'AMMO2': '0.030', 'AMMO5': '0.030', 'WEAPON1': '0.060', 'weapon5': '0.068', 'AMMO3': '0.099', 'AMMO4': '0.148', 'HITCOUNT': '0.330', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'ARMOR': '0.509', 'weapon4': '0.558', 'WEAPON3': '0.700', 'weapon2': '1.108', 'DAMAGECOUNT': '1.185', 'weapon3': '1.626', 'FRAGCOUNT': '3.000'} [2023-02-24 17:38:16,714][177172] DAMAGECOUNT value on done: 7894.0 [2023-02-24 17:38:16,715][177172] Sum rewards: 3.023, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.578', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'AMMO3': '0.076', 'weapon5': '0.082', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'HITCOUNT': '0.400', 'weapon4': '0.438', 'WEAPON3': '0.550', 'weapon2': '0.774', 'DAMAGECOUNT': '1.650', 'weapon3': '1.812', 'FRAGCOUNT': '3.000'} [2023-02-24 17:38:16,721][177158] DAMAGECOUNT value on done: 7825.0 [2023-02-24 17:38:16,722][177158] Sum rewards: -1.092, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.330', 'AMMO5': '0.019', 'AMMO2': '0.020', 'weapon5': '0.088', 'WEAPON1': '0.090', 'AMMO4': '0.101', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'HITCOUNT': '0.240', 'WEAPON5': '0.350', 'weapon4': '0.554', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.795', 'weapon2': '1.110', 'weapon3': '1.838', 'FRAGCOUNT': '3.000'} [2023-02-24 17:38:16,730][177154] DAMAGECOUNT value on done: 9323.0 [2023-02-24 17:38:16,730][177154] Sum rewards: -4.662, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.280', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.034', 'WEAPON1': '0.040', 'AMMO3': '0.142', 'AMMO4': '0.171', 'HITCOUNT': '0.210', 'weapon4': '0.228', 'weapon5': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.813', 'FRAGCOUNT': '1.000', 'weapon3': '1.088', 'weapon2': '1.734'} [2023-02-24 17:38:17,019][177154] DAMAGECOUNT value on done: 7885.0 [2023-02-24 17:38:17,019][177154] Sum rewards: -3.979, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.758', 'ARMOR': '0.008', 'AMMO5': '0.021', 'AMMO2': '0.031', 'WEAPON1': '0.050', 'weapon5': '0.132', 'AMMO4': '0.154', 'AMMO3': '0.176', 'weapon4': '0.176', 'HITCOUNT': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.005', 'weapon2': '1.218', 'weapon3': '1.948', 'FRAGCOUNT': '3.000'} [2023-02-24 17:38:17,037][177158] DAMAGECOUNT value on done: 8224.0 [2023-02-24 17:38:17,038][177158] Sum rewards: -0.147, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.834', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'HITCOUNT': '0.070', 'AMMO4': '0.075', 'weapon5': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.250', 'DAMAGECOUNT': '0.255', 'weapon4': '0.428', 'ARMOR': '0.512', 'weapon3': '0.920', 'FRAGCOUNT': '1.000', 'weapon2': '1.104'} [2023-02-24 17:38:17,306][177154] DAMAGECOUNT value on done: 9893.0 [2023-02-24 17:38:17,306][177154] Sum rewards: 1.477, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.592', 'AMMO2': '0.015', 'AMMO5': '0.017', 'WEAPON1': '0.070', 'AMMO4': '0.075', 'AMMO3': '0.084', 'HITCOUNT': '0.110', 'weapon5': '0.126', 'WEAPON4': '0.150', 'weapon4': '0.248', 'WEAPON5': '0.400', 'ARMOR': '0.478', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.753', 'weapon2': '1.480', 'weapon3': '1.512', 'FRAGCOUNT': '3.000'} [2023-02-24 17:38:17,338][177158] DAMAGECOUNT value on done: 8241.0 [2023-02-24 17:38:17,338][177158] Sum rewards: 1.758, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.420', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO2': '0.026', 'weapon5': '0.094', 'AMMO3': '0.113', 'AMMO4': '0.127', 'weapon4': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'HITCOUNT': '0.390', 'WEAPON3': '0.650', 'weapon2': '1.586', 'DAMAGECOUNT': '1.797', 'weapon3': '1.840', 'FRAGCOUNT': '7.000'} [2023-02-24 17:38:17,597][177172] DAMAGECOUNT value on done: 8027.0 [2023-02-24 17:38:17,597][177172] Sum rewards: -2.404, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.381', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'weapon5': '0.110', 'AMMO3': '0.151', 'WEAPON5': '0.200', 'weapon4': '0.202', 'HITCOUNT': '0.330', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.362', 'weapon2': '1.370', 'weapon3': '1.736', 'FRAGCOUNT': '3.000'} [2023-02-24 17:38:17,598][177154] DAMAGECOUNT value on done: 8778.0 [2023-02-24 17:38:17,599][177154] Sum rewards: -3.975, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.115', 'AMMO2': '0.008', 'AMMO5': '0.012', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'weapon4': '0.122', 'weapon5': '0.122', 'AMMO3': '0.133', 'HITCOUNT': '0.170', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.592', 'weapon2': '1.936'} [2023-02-24 17:38:17,752][177171] DAMAGECOUNT value on done: 8636.0 [2023-02-24 17:38:17,753][177171] Sum rewards: 0.106, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.469', 'AMMO5': '0.010', 'AMMO2': '0.022', 'ARMOR': '0.036', 'WEAPON1': '0.060', 'AMMO3': '0.096', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'weapon5': '0.152', 'WEAPON5': '0.250', 'weapon4': '0.278', 'HITCOUNT': '0.300', 'WEAPON3': '0.600', 'weapon3': '0.940', 'DAMAGECOUNT': '1.236', 'weapon2': '2.084', 'FRAGCOUNT': '4.000'} [2023-02-24 17:38:17,899][177172] DAMAGECOUNT value on done: 7402.0 [2023-02-24 17:38:17,899][177172] Sum rewards: -0.234, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.298', 'AMMO2': '0.013', 'AMMO5': '0.025', 'WEAPON1': '0.060', 'AMMO4': '0.066', 'AMMO3': '0.117', 'HITCOUNT': '0.210', 'weapon5': '0.306', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.095', 'weapon3': '1.528', 'weapon2': '1.744', 'FRAGCOUNT': '3.000'} [2023-02-24 17:38:17,931][177157] DAMAGECOUNT value on done: 9301.0 [2023-02-24 17:38:17,932][177157] Sum rewards: -3.712, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.488', 'AMMO2': '0.018', 'AMMO5': '0.022', 'ARMOR': '0.024', 'WEAPON1': '0.060', 'weapon5': '0.080', 'AMMO4': '0.089', 'AMMO3': '0.171', 'WEAPON4': '0.250', 'HITCOUNT': '0.280', 'WEAPON5': '0.350', 'WEAPON3': '0.950', 'weapon2': '1.050', 'DAMAGECOUNT': '1.308', 'FRAGCOUNT': '2.000', 'weapon3': '2.374'} [2023-02-24 17:38:18,054][177171] DAMAGECOUNT value on done: 8292.0 [2023-02-24 17:38:18,055][177171] Sum rewards: 1.590, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.286', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO2': '0.025', 'weapon5': '0.048', 'AMMO3': '0.096', 'weapon4': '0.124', 'AMMO4': '0.125', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'ARMOR': '0.440', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.513', 'weapon3': '1.222', 'weapon2': '1.812', 'FRAGCOUNT': '3.000'} [2023-02-24 17:38:18,068][177155] DAMAGECOUNT value on done: 8451.0 [2023-02-24 17:38:18,069][177155] Sum rewards: 2.523, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.427', 'AMMO2': '0.017', 'AMMO5': '0.017', 'weapon4': '0.018', 'ARMOR': '0.056', 'WEAPON1': '0.080', 'AMMO4': '0.086', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'weapon5': '0.238', 'HITCOUNT': '0.290', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.278', 'weapon3': '1.822', 'DAMAGECOUNT': '1.980', 'FRAGCOUNT': '4.000'} [2023-02-24 17:38:18,237][177157] DAMAGECOUNT value on done: 10667.0 [2023-02-24 17:38:18,237][177157] Sum rewards: -1.272, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.286', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.034', 'WEAPON1': '0.060', 'AMMO3': '0.107', 'HITCOUNT': '0.150', 'AMMO4': '0.172', 'weapon5': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.500', 'weapon4': '0.512', 'DAMAGECOUNT': '1.023', 'weapon2': '1.280', 'weapon3': '1.378'} [2023-02-24 17:38:18,247][177157] DAMAGECOUNT value on done: 9794.0 [2023-02-24 17:38:18,247][177157] Sum rewards: 1.923, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.435', 'AMMO2': '0.007', 'weapon4': '0.010', 'AMMO5': '0.022', 'ARMOR': '0.032', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'AMMO3': '0.090', 'WEAPON1': '0.100', 'weapon5': '0.150', 'HITCOUNT': '0.370', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'weapon2': '1.322', 'DAMAGECOUNT': '1.425', 'weapon3': '2.042', 'FRAGCOUNT': '3.000'} [2023-02-24 17:38:18,356][177171] DAMAGECOUNT value on done: 9699.0 [2023-02-24 17:38:18,356][177171] Sum rewards: 0.653, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.064', 'AMMO2': '0.019', 'ARMOR': '0.020', 'AMMO5': '0.024', 'weapon4': '0.038', 'WEAPON4': '0.050', 'weapon5': '0.058', 'weapon7': '0.076', 'AMMO4': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON1': '0.110', 'AMMO3': '0.117', 'HITCOUNT': '0.350', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'weapon2': '1.302', 'DAMAGECOUNT': '1.683', 'weapon3': '1.826', 'FRAGCOUNT': '4.000'} [2023-02-24 17:38:18,367][177155] DAMAGECOUNT value on done: 10307.0 [2023-02-24 17:38:18,367][177155] Sum rewards: 0.587, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.035', 'AMMO5': '0.017', 'AMMO2': '0.026', 'WEAPON1': '0.080', 'AMMO3': '0.100', 'AMMO4': '0.131', 'weapon4': '0.134', 'weapon5': '0.142', 'WEAPON4': '0.200', 'HITCOUNT': '0.280', 'WEAPON5': '0.350', 'ARMOR': '0.456', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.143', 'weapon3': '1.560', 'weapon2': '1.652', 'FRAGCOUNT': '3.000'} [2023-02-24 17:38:18,472][177153] Updated weights for policy 0, policy_version 3150 (0.0008) [2023-02-24 17:38:18,549][177157] DAMAGECOUNT value on done: 8805.0 [2023-02-24 17:38:18,549][177157] Sum rewards: 1.230, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.650', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'AMMO4': '0.091', 'AMMO3': '0.092', 'weapon5': '0.136', 'weapon4': '0.170', 'WEAPON4': '0.200', 'HITCOUNT': '0.240', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'weapon3': '1.004', 'DAMAGECOUNT': '1.230', 'weapon2': '2.248', 'FRAGCOUNT': '3.000'} [2023-02-24 17:38:18,646][177171] DAMAGECOUNT value on done: 8737.0 [2023-02-24 17:38:18,646][177171] Sum rewards: 0.451, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.497', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'AMMO3': '0.046', 'WEAPON1': '0.060', 'HITCOUNT': '0.160', 'weapon5': '0.196', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.528', 'weapon3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '2.158'} [2023-02-24 17:38:18,650][177155] DAMAGECOUNT value on done: 10327.0 [2023-02-24 17:38:18,651][177155] Sum rewards: 2.494, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'HEALTH': '0.042', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon5': '0.136', 'weapon4': '0.210', 'HITCOUNT': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.284', 'weapon2': '1.410', 'weapon3': '1.466', 'FRAGCOUNT': '3.000'} [2023-02-24 17:38:18,943][177155] DAMAGECOUNT value on done: 8531.0 [2023-02-24 17:38:18,944][177155] Sum rewards: -1.695, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.958', 'AMMO5': '0.015', 'ARMOR': '0.052', 'AMMO2': '0.057', 'weapon4': '0.064', 'WEAPON1': '0.070', 'AMMO3': '0.116', 'weapon5': '0.154', 'HITCOUNT': '0.240', 'AMMO4': '0.285', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.164', 'weapon3': '1.528', 'weapon2': '1.718', 'FRAGCOUNT': '3.000'} [2023-02-24 17:38:20,082][177156] DAMAGECOUNT value on done: 9059.0 [2023-02-24 17:38:20,083][177156] Sum rewards: -6.541, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.100', 'AMMO2': '0.013', 'AMMO5': '0.019', 'AMMO4': '0.067', 'ARMOR': '0.068', 'WEAPON1': '0.070', 'HITCOUNT': '0.090', 'AMMO3': '0.139', 'weapon5': '0.152', 'weapon4': '0.308', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'DAMAGECOUNT': '0.465', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.162', 'weapon2': '1.756'} [2023-02-24 17:38:20,383][177156] DAMAGECOUNT value on done: 10132.0 [2023-02-24 17:38:20,383][177156] Sum rewards: 5.041, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'AMMO4': '0.072', 'AMMO3': '0.078', 'weapon5': '0.116', 'WEAPON5': '0.150', 'HITCOUNT': '0.160', 'HEALTH': '0.283', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.840', 'weapon3': '1.452', 'weapon2': '1.788', 'FRAGCOUNT': '3.000'} [2023-02-24 17:38:20,574][177156] DAMAGECOUNT value on done: 7975.0 [2023-02-24 17:38:20,575][177156] Sum rewards: 3.421, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.017', 'ARMOR': '0.030', 'AMMO2': '0.030', 'WEAPON1': '0.060', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon5': '0.128', 'AMMO4': '0.150', 'HITCOUNT': '0.310', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'HEALTH': '0.916', 'DAMAGECOUNT': '1.407', 'weapon3': '1.566', 'weapon2': '1.836', 'FRAGCOUNT': '2.000'} [2023-02-24 17:38:20,867][177156] DAMAGECOUNT value on done: 10240.0 [2023-02-24 17:38:20,867][177156] Sum rewards: -4.974, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.710', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.017', 'weapon4': '0.052', 'WEAPON4': '0.100', 'WEAPON1': '0.100', 'AMMO3': '0.113', 'weapon5': '0.138', 'HITCOUNT': '0.170', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.807', 'FRAGCOUNT': '1.000', 'weapon3': '1.464', 'weapon2': '1.648'} [2023-02-24 17:38:21,359][177153] Updated weights for policy 0, policy_version 3160 (0.0009) [2023-02-24 17:38:21,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14062.9, 300 sec: 14093.0). Total num frames: 12943360. Throughput: 0: 3511.2. Samples: 3229380. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:38:21,376][177119] Avg episode reward: [(0, '-0.585')] [2023-02-24 17:38:24,260][177153] Updated weights for policy 0, policy_version 3170 (0.0009) [2023-02-24 17:38:26,376][177119] Fps is (10 sec: 14335.9, 60 sec: 14062.9, 300 sec: 14079.1). Total num frames: 13012992. Throughput: 0: 3516.8. Samples: 3250602. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:38:26,376][177119] Avg episode reward: [(0, '-0.585')] [2023-02-24 17:38:27,179][177153] Updated weights for policy 0, policy_version 3180 (0.0008) [2023-02-24 17:38:30,100][177153] Updated weights for policy 0, policy_version 3190 (0.0008) [2023-02-24 17:38:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 14079.1). Total num frames: 13082624. Throughput: 0: 3511.6. Samples: 3271646. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:38:31,376][177119] Avg episode reward: [(0, '-0.585')] [2023-02-24 17:38:33,026][177153] Updated weights for policy 0, policy_version 3200 (0.0008) [2023-02-24 17:38:34,828][177170] DAMAGECOUNT value on done: 8576.0 [2023-02-24 17:38:34,829][177170] Sum rewards: -8.818, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.346', 'FRAGCOUNT': '-1.000', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.048', 'weapon5': '0.100', 'HITCOUNT': '0.140', 'AMMO3': '0.212', 'AMMO4': '0.238', 'weapon4': '0.278', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'DAMAGECOUNT': '0.450', 'ARMOR': '0.454', 'WEAPON3': '1.100', 'weapon3': '1.358', 'weapon2': '1.758'} [2023-02-24 17:38:35,125][177170] DAMAGECOUNT value on done: 11096.0 [2023-02-24 17:38:35,125][177170] Sum rewards: -2.840, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.196', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon5': '0.036', 'WEAPON1': '0.050', 'AMMO3': '0.120', 'HITCOUNT': '0.170', 'AMMO4': '0.177', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.354', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.564', 'WEAPON3': '0.700', 'weapon3': '1.020', 'weapon2': '1.862', 'FRAGCOUNT': '2.000'} [2023-02-24 17:38:35,213][177170] DAMAGECOUNT value on done: 8572.0 [2023-02-24 17:38:35,214][177170] Sum rewards: -2.300, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.078', 'ARMOR': '0.005', 'AMMO5': '0.015', 'AMMO2': '0.030', 'WEAPON1': '0.050', 'AMMO3': '0.146', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'weapon4': '0.168', 'HITCOUNT': '0.190', 'WEAPON5': '0.300', 'weapon5': '0.328', 'WEAPON3': '0.700', 'weapon3': '1.038', 'DAMAGECOUNT': '1.053', 'weapon2': '1.456', 'FRAGCOUNT': '2.000'} [2023-02-24 17:38:35,513][177170] DAMAGECOUNT value on done: 10366.0 [2023-02-24 17:38:35,513][177170] Sum rewards: 1.152, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.410', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.023', 'WEAPON1': '0.070', 'weapon5': '0.078', 'AMMO3': '0.086', 'AMMO4': '0.115', 'HITCOUNT': '0.160', 'WEAPON4': '0.250', 'weapon4': '0.324', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.053', 'weapon2': '1.342', 'weapon3': '1.790', 'FRAGCOUNT': '3.000'} [2023-02-24 17:38:35,541][177172] DAMAGECOUNT value on done: 8159.0 [2023-02-24 17:38:35,541][177172] Sum rewards: 1.176, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.081', 'AMMO2': '0.015', 'AMMO5': '0.024', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON1': '0.110', 'AMMO3': '0.127', 'weapon4': '0.154', 'HITCOUNT': '0.200', 'weapon5': '0.202', 'WEAPON3': '0.550', 'WEAPON5': '0.550', 'weapon3': '1.218', 'DAMAGECOUNT': '1.431', 'weapon2': '1.752', 'FRAGCOUNT': '3.500'} [2023-02-24 17:38:35,572][177158] DAMAGECOUNT value on done: 10856.0 [2023-02-24 17:38:35,572][177158] Sum rewards: 1.273, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.015', 'AMMO5': '0.022', 'AMMO4': '0.074', 'WEAPON1': '0.080', 'AMMO3': '0.110', 'weapon5': '0.128', 'HITCOUNT': '0.220', 'HEALTH': '0.312', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.876', 'weapon2': '0.990', 'FRAGCOUNT': '2.000', 'weapon3': '2.096'} [2023-02-24 17:38:35,833][177154] DAMAGECOUNT value on done: 9944.0 [2023-02-24 17:38:35,834][177154] Sum rewards: 1.717, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.940', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon5': '0.074', 'AMMO3': '0.106', 'AMMO4': '0.152', 'WEAPON5': '0.300', 'HITCOUNT': '0.380', 'WEAPON4': '0.400', 'ARMOR': '0.464', 'WEAPON3': '0.500', 'weapon4': '0.542', 'weapon3': '0.982', 'weapon2': '1.840', 'DAMAGECOUNT': '1.863', 'FRAGCOUNT': '4.000'} [2023-02-24 17:38:35,841][177172] DAMAGECOUNT value on done: 8009.0 [2023-02-24 17:38:35,841][177172] Sum rewards: 1.227, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'HITCOUNT': '0.060', 'weapon5': '0.060', 'AMMO3': '0.061', 'HEALTH': '0.065', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'weapon4': '0.234', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.350', 'ARMOR': '0.488', 'weapon2': '0.792', 'FRAGCOUNT': '1.000', 'weapon3': '1.190'} [2023-02-24 17:38:35,870][177158] DAMAGECOUNT value on done: 8070.0 [2023-02-24 17:38:35,973][177153] Updated weights for policy 0, policy_version 3210 (0.0009) [2023-02-24 17:38:36,130][177154] DAMAGECOUNT value on done: 8586.0 [2023-02-24 17:38:36,131][177154] Sum rewards: -0.747, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.428', 'AMMO5': '0.017', 'AMMO2': '0.022', 'weapon7': '0.054', 'WEAPON1': '0.060', 'weapon5': '0.082', 'AMMO4': '0.109', 'AMMO3': '0.130', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.358', 'HITCOUNT': '0.430', 'ARMOR': '0.472', 'WEAPON3': '0.800', 'weapon3': '1.342', 'weapon2': '1.552', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.103'} [2023-02-24 17:38:36,184][177158] DAMAGECOUNT value on done: 8523.0 [2023-02-24 17:38:36,185][177158] Sum rewards: -0.784, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.345', 'AMMO2': '0.007', 'AMMO5': '0.022', 'ARMOR': '0.032', 'AMMO4': '0.034', 'WEAPON1': '0.060', 'weapon5': '0.074', 'AMMO3': '0.102', 'HITCOUNT': '0.240', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.897', 'weapon3': '1.742', 'weapon2': '1.750', 'FRAGCOUNT': '2.000'} [2023-02-24 17:38:36,376][177119] Fps is (10 sec: 13926.5, 60 sec: 14062.9, 300 sec: 14079.1). Total num frames: 13152256. Throughput: 0: 3509.4. Samples: 3282126. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:38:36,376][177119] Avg episode reward: [(0, '-0.819')] [2023-02-24 17:38:36,429][177154] DAMAGECOUNT value on done: 10419.0 [2023-02-24 17:38:36,430][177154] Sum rewards: 2.407, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.582', 'AMMO5': '0.013', 'ARMOR': '0.020', 'weapon4': '0.020', 'AMMO2': '0.032', 'WEAPON1': '0.050', 'weapon7': '0.056', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.158', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.244', 'HITCOUNT': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'weapon3': '1.264', 'DAMAGECOUNT': '1.578', 'weapon2': '1.954', 'FRAGCOUNT': '3.000'} [2023-02-24 17:38:36,483][177158] DAMAGECOUNT value on done: 8702.0 [2023-02-24 17:38:36,484][177158] Sum rewards: 1.433, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.542', 'AMMO5': '0.017', 'AMMO2': '0.019', 'ARMOR': '0.024', 'weapon4': '0.034', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.094', 'AMMO3': '0.119', 'HITCOUNT': '0.150', 'weapon5': '0.190', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.383', 'weapon2': '1.592', 'weapon3': '1.892', 'FRAGCOUNT': '3.000'} [2023-02-24 17:38:36,724][177172] DAMAGECOUNT value on done: 8298.0 [2023-02-24 17:38:36,725][177172] Sum rewards: -2.278, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.840', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'ARMOR': '0.060', 'AMMO3': '0.118', 'weapon5': '0.132', 'weapon4': '0.164', 'WEAPON4': '0.200', 'HITCOUNT': '0.260', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.813', 'weapon3': '1.110', 'weapon2': '1.848', 'FRAGCOUNT': '2.000'} [2023-02-24 17:38:36,736][177154] DAMAGECOUNT value on done: 9033.0 [2023-02-24 17:38:36,737][177154] Sum rewards: -3.604, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.856', 'AMMO5': '0.010', 'AMMO2': '0.015', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'AMMO4': '0.075', 'weapon5': '0.096', 'AMMO3': '0.131', 'weapon4': '0.150', 'HITCOUNT': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.765', 'FRAGCOUNT': '1.000', 'weapon3': '1.464', 'weapon2': '1.856'} [2023-02-24 17:38:36,879][177171] DAMAGECOUNT value on done: 8796.0 [2023-02-24 17:38:37,024][177172] DAMAGECOUNT value on done: 7752.0 [2023-02-24 17:38:37,025][177172] Sum rewards: 2.531, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.832', 'AMMO5': '0.010', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'ARMOR': '0.040', 'weapon5': '0.072', 'AMMO3': '0.110', 'AMMO4': '0.112', 'WEAPON5': '0.200', 'weapon4': '0.204', 'HITCOUNT': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.050', 'weapon3': '1.550', 'weapon2': '1.702', 'FRAGCOUNT': '4.000'} [2023-02-24 17:38:37,164][177157] DAMAGECOUNT value on done: 9582.0 [2023-02-24 17:38:37,164][177157] Sum rewards: -4.760, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-2.000', 'HEALTH': '-0.904', 'AMMO5': '0.015', 'AMMO2': '0.018', 'WEAPON1': '0.060', 'weapon4': '0.082', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'weapon5': '0.128', 'HITCOUNT': '0.220', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.843', 'weapon2': '1.232', 'weapon3': '1.746'} [2023-02-24 17:38:37,170][177171] DAMAGECOUNT value on done: 8681.0 [2023-02-24 17:38:37,171][177171] Sum rewards: -3.098, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.616', 'ARMOR': '0.008', 'AMMO2': '0.013', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.066', 'weapon5': '0.084', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'HITCOUNT': '0.220', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.167', 'weapon3': '1.780', 'weapon2': '1.848'} [2023-02-24 17:38:37,233][177155] DAMAGECOUNT value on done: 8599.0 [2023-02-24 17:38:37,234][177155] Sum rewards: 0.703, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.526', 'AMMO2': '0.015', 'AMMO5': '0.020', 'WEAPON1': '0.060', 'AMMO4': '0.074', 'AMMO3': '0.096', 'HITCOUNT': '0.120', 'weapon5': '0.190', 'DAMAGECOUNT': '0.444', 'WEAPON3': '0.500', 'WEAPON5': '0.500', 'weapon3': '1.536', 'weapon2': '1.674', 'FRAGCOUNT': '2.000'} [2023-02-24 17:38:37,455][177157] DAMAGECOUNT value on done: 11588.0 [2023-02-24 17:38:37,455][177157] Sum rewards: 5.997, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.476', 'AMMO5': '0.017', 'AMMO2': '0.026', 'ARMOR': '0.044', 'WEAPON1': '0.080', 'weapon5': '0.098', 'AMMO4': '0.131', 'AMMO3': '0.141', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.438', 'HITCOUNT': '0.660', 'WEAPON3': '0.700', 'weapon3': '1.460', 'weapon2': '1.564', 'DAMAGECOUNT': '2.763', 'FRAGCOUNT': '6.000'} [2023-02-24 17:38:37,464][177157] DAMAGECOUNT value on done: 10083.0 [2023-02-24 17:38:37,464][177157] Sum rewards: -0.781, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.622', 'AMMO2': '0.017', 'AMMO5': '0.017', 'WEAPON1': '0.050', 'weapon5': '0.072', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'HITCOUNT': '0.310', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.867', 'FRAGCOUNT': '1.500', 'weapon2': '1.626', 'weapon3': '1.638'} [2023-02-24 17:38:37,474][177171] DAMAGECOUNT value on done: 9959.0 [2023-02-24 17:38:37,475][177171] Sum rewards: 2.622, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.466', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.077', 'weapon4': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.108', 'HITCOUNT': '0.210', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.780', 'weapon3': '1.584', 'weapon2': '1.684', 'FRAGCOUNT': '2.000'} [2023-02-24 17:38:37,531][177155] DAMAGECOUNT value on done: 10529.0 [2023-02-24 17:38:37,532][177155] Sum rewards: -0.560, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.015', 'AMMO2': '0.023', 'ARMOR': '0.053', 'WEAPON1': '0.060', 'HEALTH': '0.086', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.122', 'HITCOUNT': '0.210', 'weapon5': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.666', 'weapon2': '1.306', 'weapon3': '1.794', 'FRAGCOUNT': '2.000'} [2023-02-24 17:38:37,753][177157] DAMAGECOUNT value on done: 9279.0 [2023-02-24 17:38:37,754][177157] Sum rewards: -1.140, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.886', 'AMMO5': '0.010', 'AMMO2': '0.016', 'ARMOR': '0.032', 'WEAPON1': '0.060', 'AMMO4': '0.077', 'weapon5': '0.164', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'HITCOUNT': '0.230', 'WEAPON5': '0.250', 'weapon4': '0.672', 'weapon2': '0.750', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.422', 'weapon3': '1.548', 'FRAGCOUNT': '3.000'} [2023-02-24 17:38:37,774][177171] DAMAGECOUNT value on done: 9325.0 [2023-02-24 17:38:37,774][177171] Sum rewards: -2.856, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.132', 'ARMOR': '0.012', 'AMMO5': '0.037', 'AMMO2': '0.051', 'WEAPON1': '0.120', 'AMMO3': '0.125', 'weapon5': '0.128', 'AMMO4': '0.256', 'HITCOUNT': '0.270', 'WEAPON4': '0.400', 'weapon4': '0.460', 'WEAPON5': '0.800', 'weapon2': '0.824', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.764', 'weapon3': '1.878', 'FRAGCOUNT': '2.500'} [2023-02-24 17:38:37,807][177155] DAMAGECOUNT value on done: 11145.0 [2023-02-24 17:38:37,807][177155] Sum rewards: -4.664, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.340', 'AMMO2': '0.005', 'AMMO4': '0.024', 'AMMO5': '0.026', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'weapon7': '0.064', 'weapon4': '0.080', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.124', 'AMMO3': '0.251', 'HITCOUNT': '0.300', 'WEAPON5': '0.600', 'weapon2': '1.300', 'WEAPON3': '1.350', 'weapon3': '1.868', 'DAMAGECOUNT': '2.274', 'FRAGCOUNT': '5.000'} [2023-02-24 17:38:38,097][177155] DAMAGECOUNT value on done: 9174.0 [2023-02-24 17:38:38,097][177155] Sum rewards: -1.043, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.190', 'AMMO5': '0.011', 'AMMO2': '0.029', 'WEAPON1': '0.050', 'weapon5': '0.110', 'AMMO4': '0.144', 'AMMO3': '0.160', 'weapon4': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.360', 'WEAPON3': '1.000', 'weapon2': '1.252', 'weapon3': '1.804', 'DAMAGECOUNT': '1.929', 'FRAGCOUNT': '4.000'} [2023-02-24 17:38:38,861][177153] Updated weights for policy 0, policy_version 3220 (0.0008) [2023-02-24 17:38:39,255][177156] DAMAGECOUNT value on done: 9648.0 [2023-02-24 17:38:39,256][177156] Sum rewards: -2.558, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.674', 'FRAGCOUNT': '0.000', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.039', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO3': '0.063', 'ARMOR': '0.080', 'weapon4': '0.128', 'WEAPON4': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon5': '0.224', 'HITCOUNT': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'weapon3': '0.998', 'DAMAGECOUNT': '1.767', 'weapon2': '2.224'} [2023-02-24 17:38:39,558][177156] DAMAGECOUNT value on done: 10480.0 [2023-02-24 17:38:39,558][177156] Sum rewards: 1.339, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.844', 'AMMO2': '0.008', 'AMMO5': '0.012', 'AMMO4': '0.041', 'ARMOR': '0.050', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'weapon5': '0.126', 'HITCOUNT': '0.130', 'weapon4': '0.170', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.044', 'weapon3': '1.102', 'weapon2': '1.916', 'FRAGCOUNT': '4.000'} [2023-02-24 17:38:39,749][177156] DAMAGECOUNT value on done: 8483.0 [2023-02-24 17:38:39,749][177156] Sum rewards: -0.294, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'HEALTH': '0.128', 'AMMO4': '0.181', 'weapon4': '0.196', 'HITCOUNT': '0.240', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.524', 'weapon2': '1.650', 'weapon3': '1.698'} [2023-02-24 17:38:40,050][177156] DAMAGECOUNT value on done: 10450.0 [2023-02-24 17:38:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 14065.2). Total num frames: 13221888. Throughput: 0: 3506.5. Samples: 3303168. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:38:41,376][177119] Avg episode reward: [(0, '-0.774')] [2023-02-24 17:38:41,783][177153] Updated weights for policy 0, policy_version 3230 (0.0008) [2023-02-24 17:38:44,675][177153] Updated weights for policy 0, policy_version 3240 (0.0008) [2023-02-24 17:38:46,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14062.9, 300 sec: 14065.2). Total num frames: 13291520. Throughput: 0: 3509.4. Samples: 3324322. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:38:46,376][177119] Avg episode reward: [(0, '-0.774')] [2023-02-24 17:38:47,605][177153] Updated weights for policy 0, policy_version 3250 (0.0008) [2023-02-24 17:38:50,553][177153] Updated weights for policy 0, policy_version 3260 (0.0008) [2023-02-24 17:38:51,376][177119] Fps is (10 sec: 13926.1, 60 sec: 13994.6, 300 sec: 14065.2). Total num frames: 13361152. Throughput: 0: 3506.9. Samples: 3334808. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:38:51,377][177119] Avg episode reward: [(0, '-0.774')] [2023-02-24 17:38:53,454][177153] Updated weights for policy 0, policy_version 3270 (0.0009) [2023-02-24 17:38:53,917][177170] DAMAGECOUNT value on done: 8951.0 [2023-02-24 17:38:53,918][177170] Sum rewards: -1.857, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.988', 'AMMO5': '0.017', 'AMMO2': '0.018', 'ARMOR': '0.058', 'WEAPON1': '0.080', 'AMMO4': '0.090', 'weapon5': '0.090', 'weapon4': '0.110', 'AMMO3': '0.131', 'WEAPON4': '0.200', 'HITCOUNT': '0.280', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'weapon2': '0.978', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.125', 'weapon3': '2.054'} [2023-02-24 17:38:54,213][177170] DAMAGECOUNT value on done: 11337.0 [2023-02-24 17:38:54,213][177170] Sum rewards: -7.534, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.500', 'AMMO2': '0.009', 'AMMO5': '0.025', 'ARMOR': '0.036', 'AMMO4': '0.043', 'WEAPON1': '0.050', 'weapon5': '0.096', 'WEAPON4': '0.100', 'HITCOUNT': '0.140', 'AMMO3': '0.187', 'weapon4': '0.210', 'WEAPON5': '0.450', 'DAMAGECOUNT': '0.723', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon3': '1.338', 'weapon2': '1.858'} [2023-02-24 17:38:54,307][177170] DAMAGECOUNT value on done: 8860.0 [2023-02-24 17:38:54,307][177170] Sum rewards: -1.423, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.996', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO2': '0.046', 'weapon5': '0.048', 'AMMO3': '0.115', 'HITCOUNT': '0.120', 'weapon4': '0.128', 'WEAPON5': '0.200', 'AMMO4': '0.230', 'WEAPON4': '0.300', 'ARMOR': '0.448', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.864', 'weapon3': '1.004', 'weapon2': '1.620', 'FRAGCOUNT': '2.000'} [2023-02-24 17:38:54,607][177170] DAMAGECOUNT value on done: 10968.0 [2023-02-24 17:38:54,607][177170] Sum rewards: -0.698, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.442', 'weapon7': '0.006', 'AMMO2': '0.009', 'AMMO5': '0.010', 'ARMOR': '0.040', 'AMMO4': '0.046', 'WEAPON1': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.126', 'AMMO3': '0.137', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.320', 'weapon4': '0.394', 'WEAPON3': '0.600', 'weapon3': '1.100', 'weapon2': '1.600', 'DAMAGECOUNT': '1.806', 'FRAGCOUNT': '2.500'} [2023-02-24 17:38:54,677][177172] DAMAGECOUNT value on done: 8365.0 [2023-02-24 17:38:54,677][177172] Sum rewards: -3.369, reward structure: {'DEATHCOUNT': '-5.250', 'FRAGCOUNT': '-2.000', 'HEALTH': '-0.733', 'AMMO2': '0.011', 'AMMO5': '0.015', 'weapon4': '0.048', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'HITCOUNT': '0.090', 'AMMO3': '0.103', 'weapon5': '0.202', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.618', 'weapon3': '0.946', 'weapon2': '1.774'} [2023-02-24 17:38:54,689][177158] DAMAGECOUNT value on done: 11006.0 [2023-02-24 17:38:54,972][177172] DAMAGECOUNT value on done: 8378.0 [2023-02-24 17:38:54,973][177172] Sum rewards: 2.406, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '0.000', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.017', 'WEAPON1': '0.060', 'AMMO3': '0.128', 'weapon5': '0.158', 'WEAPON5': '0.250', 'HITCOUNT': '0.250', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.107', 'weapon2': '1.458', 'weapon3': '2.016', 'FRAGCOUNT': '3.000'} [2023-02-24 17:38:54,991][177158] DAMAGECOUNT value on done: 8280.0 [2023-02-24 17:38:54,991][177158] Sum rewards: -5.838, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.476', 'weapon5': '0.002', 'AMMO5': '0.018', 'AMMO2': '0.033', 'WEAPON1': '0.040', 'ARMOR': '0.080', 'AMMO3': '0.143', 'weapon4': '0.158', 'AMMO4': '0.166', 'HITCOUNT': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'DAMAGECOUNT': '0.630', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.366', 'weapon2': '1.862'} [2023-02-24 17:38:54,995][177154] DAMAGECOUNT value on done: 10737.0 [2023-02-24 17:38:54,996][177154] Sum rewards: 4.767, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.456', 'AMMO5': '0.015', 'ARMOR': '0.020', 'AMMO2': '0.030', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.120', 'AMMO4': '0.149', 'weapon4': '0.202', 'weapon5': '0.218', 'WEAPON5': '0.350', 'HITCOUNT': '0.370', 'WEAPON3': '0.600', 'weapon3': '1.330', 'weapon2': '1.580', 'DAMAGECOUNT': '2.379', 'FRAGCOUNT': '4.500'} [2023-02-24 17:38:55,293][177154] DAMAGECOUNT value on done: 8933.0 [2023-02-24 17:38:55,293][177154] Sum rewards: 1.636, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.856', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'WEAPON1': '0.050', 'ARMOR': '0.060', 'weapon5': '0.100', 'AMMO3': '0.125', 'weapon4': '0.152', 'WEAPON5': '0.250', 'HITCOUNT': '0.280', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.041', 'weapon2': '1.144', 'weapon3': '1.998', 'FRAGCOUNT': '4.000'} [2023-02-24 17:38:55,294][177158] DAMAGECOUNT value on done: 8725.0 [2023-02-24 17:38:55,294][177158] Sum rewards: 0.968, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.205', 'AMMO2': '0.006', 'weapon7': '0.014', 'AMMO5': '0.020', 'AMMO4': '0.028', 'WEAPON1': '0.060', 'weapon5': '0.070', 'AMMO3': '0.079', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'HITCOUNT': '0.190', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.606', 'FRAGCOUNT': '1.000', 'weapon2': '1.010', 'weapon3': '1.440'} [2023-02-24 17:38:55,585][177158] DAMAGECOUNT value on done: 8975.0 [2023-02-24 17:38:55,586][177158] Sum rewards: 2.613, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.474', 'AMMO2': '0.006', 'AMMO5': '0.007', 'ARMOR': '0.028', 'AMMO4': '0.031', 'WEAPON1': '0.060', 'AMMO3': '0.067', 'weapon4': '0.068', 'WEAPON4': '0.100', 'weapon5': '0.148', 'HITCOUNT': '0.230', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.819', 'weapon3': '1.410', 'weapon2': '1.912', 'FRAGCOUNT': '2.000'} [2023-02-24 17:38:55,589][177154] DAMAGECOUNT value on done: 10582.0 [2023-02-24 17:38:55,833][177172] DAMAGECOUNT value on done: 8598.0 [2023-02-24 17:38:55,833][177172] Sum rewards: 1.159, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.518', 'AMMO5': '0.010', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'ARMOR': '0.040', 'weapon5': '0.094', 'WEAPON4': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.119', 'weapon4': '0.132', 'WEAPON5': '0.200', 'HITCOUNT': '0.260', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.900', 'weapon3': '1.328', 'weapon2': '1.674', 'FRAGCOUNT': '2.000'} [2023-02-24 17:38:55,884][177154] DAMAGECOUNT value on done: 9524.0 [2023-02-24 17:38:55,885][177154] Sum rewards: -1.470, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.907', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.023', 'weapon4': '0.030', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'weapon5': '0.132', 'AMMO3': '0.139', 'WEAPON5': '0.200', 'HITCOUNT': '0.320', 'WEAPON3': '0.900', 'weapon2': '1.354', 'DAMAGECOUNT': '1.473', 'weapon3': '1.932', 'FRAGCOUNT': '3.500'} [2023-02-24 17:38:55,937][177171] DAMAGECOUNT value on done: 9221.0 [2023-02-24 17:38:55,937][177171] Sum rewards: 1.803, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.684', 'AMMO2': '0.014', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'weapon5': '0.062', 'AMMO4': '0.068', 'ARMOR': '0.096', 'AMMO3': '0.128', 'weapon4': '0.138', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.275', 'weapon2': '1.402', 'weapon3': '2.094', 'FRAGCOUNT': '4.000'} [2023-02-24 17:38:56,130][177172] DAMAGECOUNT value on done: 8099.0 [2023-02-24 17:38:56,130][177172] Sum rewards: -1.932, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO2': '0.033', 'ARMOR': '0.079', 'weapon5': '0.094', 'AMMO3': '0.123', 'WEAPON5': '0.150', 'weapon4': '0.162', 'AMMO4': '0.167', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'HEALTH': '0.362', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.978', 'FRAGCOUNT': '1.000', 'weapon3': '1.034', 'weapon2': '1.878'} [2023-02-24 17:38:56,236][177171] DAMAGECOUNT value on done: 8778.0 [2023-02-24 17:38:56,257][177157] DAMAGECOUNT value on done: 9815.0 [2023-02-24 17:38:56,257][177157] Sum rewards: -7.392, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.542', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.034', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.158', 'weapon5': '0.172', 'HITCOUNT': '0.210', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.699', 'WEAPON3': '0.800', 'weapon2': '1.678', 'weapon3': '1.788'} [2023-02-24 17:38:56,370][177155] DAMAGECOUNT value on done: 8764.0 [2023-02-24 17:38:56,371][177155] Sum rewards: 0.109, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.308', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO5': '0.016', 'WEAPON1': '0.060', 'AMMO3': '0.078', 'weapon5': '0.158', 'HITCOUNT': '0.160', 'WEAPON5': '0.450', 'ARMOR': '0.464', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.416', 'weapon2': '1.830'} [2023-02-24 17:38:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.6, 300 sec: 14065.2). Total num frames: 13430784. Throughput: 0: 3507.9. Samples: 3355838. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:38:56,376][177119] Avg episode reward: [(0, '-0.785')] [2023-02-24 17:38:56,394][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000003280_13434880.pth... [2023-02-24 17:38:56,395][177153] Updated weights for policy 0, policy_version 3280 (0.0009) [2023-02-24 17:38:56,452][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000002456_10059776.pth [2023-02-24 17:38:56,558][177171] DAMAGECOUNT value on done: 10576.0 [2023-02-24 17:38:56,558][177171] Sum rewards: -2.922, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.626', 'AMMO5': '0.020', 'AMMO2': '0.031', 'ARMOR': '0.032', 'WEAPON1': '0.050', 'weapon4': '0.052', 'weapon5': '0.106', 'AMMO4': '0.154', 'AMMO3': '0.166', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.360', 'WEAPON3': '0.800', 'weapon2': '1.434', 'FRAGCOUNT': '1.500', 'weapon3': '1.848', 'DAMAGECOUNT': '1.851'} [2023-02-24 17:38:56,563][177157] DAMAGECOUNT value on done: 11783.0 [2023-02-24 17:38:56,563][177157] Sum rewards: -0.026, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.778', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'ARMOR': '0.056', 'weapon4': '0.074', 'AMMO3': '0.075', 'weapon5': '0.096', 'AMMO4': '0.129', 'HITCOUNT': '0.140', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.585', 'weapon3': '1.238', 'weapon2': '1.448', 'FRAGCOUNT': '2.000'} [2023-02-24 17:38:56,573][177157] DAMAGECOUNT value on done: 10429.0 [2023-02-24 17:38:56,573][177157] Sum rewards: -0.759, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.124', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon4': '0.068', 'WEAPON1': '0.070', 'AMMO4': '0.094', 'weapon5': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.143', 'HITCOUNT': '0.150', 'WEAPON5': '0.300', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.038', 'weapon2': '1.116', 'weapon3': '1.856', 'FRAGCOUNT': '2.000'} [2023-02-24 17:38:56,682][177155] DAMAGECOUNT value on done: 10713.0 [2023-02-24 17:38:56,682][177155] Sum rewards: -0.637, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.007', 'weapon7': '0.008', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'weapon4': '0.038', 'HITCOUNT': '0.060', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'weapon5': '0.134', 'AMMO3': '0.137', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'ARMOR': '0.444', 'HEALTH': '0.536', 'DAMAGECOUNT': '0.552', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.230', 'weapon2': '1.810'} [2023-02-24 17:38:56,852][177171] DAMAGECOUNT value on done: 9495.0 [2023-02-24 17:38:56,852][177171] Sum rewards: -2.500, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.200', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.022', 'WEAPON1': '0.030', 'AMMO4': '0.097', 'AMMO3': '0.100', 'HITCOUNT': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.246', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.510', 'FRAGCOUNT': '1.000', 'weapon3': '1.370', 'weapon2': '1.578'} [2023-02-24 17:38:56,858][177157] DAMAGECOUNT value on done: 9552.0 [2023-02-24 17:38:56,858][177157] Sum rewards: -1.813, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.926', 'AMMO2': '0.012', 'ARMOR': '0.016', 'AMMO5': '0.025', 'AMMO4': '0.058', 'WEAPON1': '0.070', 'AMMO3': '0.103', 'weapon5': '0.168', 'HITCOUNT': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon4': '0.538', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.819', 'FRAGCOUNT': '1.000', 'weapon2': '1.012', 'weapon3': '1.482'} [2023-02-24 17:38:56,951][177155] DAMAGECOUNT value on done: 11602.0 [2023-02-24 17:38:56,952][177155] Sum rewards: -1.885, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.524', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'AMMO4': '0.090', 'weapon4': '0.094', 'weapon5': '0.096', 'AMMO3': '0.144', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.330', 'ARMOR': '0.556', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.371', 'weapon3': '1.476', 'weapon2': '1.674', 'FRAGCOUNT': '3.000'} [2023-02-24 17:38:57,256][177155] DAMAGECOUNT value on done: 9383.0 [2023-02-24 17:38:57,256][177155] Sum rewards: -2.241, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.258', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.101', 'WEAPON1': '0.110', 'weapon5': '0.112', 'AMMO3': '0.118', 'HITCOUNT': '0.190', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.627', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.510', 'weapon2': '1.666'} [2023-02-24 17:38:58,498][177156] DAMAGECOUNT value on done: 9810.0 [2023-02-24 17:38:58,796][177156] DAMAGECOUNT value on done: 10674.0 [2023-02-24 17:38:58,797][177156] Sum rewards: 3.043, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.680', 'AMMO2': '0.010', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.050', 'weapon5': '0.064', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'weapon4': '0.122', 'WEAPON5': '0.150', 'HITCOUNT': '0.170', 'WEAPON3': '0.450', 'ARMOR': '0.500', 'DAMAGECOUNT': '0.582', 'weapon2': '1.070', 'weapon3': '1.344', 'FRAGCOUNT': '2.000'} [2023-02-24 17:38:58,939][177156] DAMAGECOUNT value on done: 8772.0 [2023-02-24 17:38:58,940][177156] Sum rewards: -1.381, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.852', 'AMMO5': '0.010', 'AMMO2': '0.017', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'AMMO4': '0.085', 'weapon5': '0.096', 'AMMO3': '0.099', 'HITCOUNT': '0.110', 'weapon4': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.867', 'weapon3': '1.114', 'FRAGCOUNT': '2.000', 'weapon2': '2.044'} [2023-02-24 17:38:59,231][177156] DAMAGECOUNT value on done: 10927.0 [2023-02-24 17:38:59,231][177156] Sum rewards: -0.439, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.566', 'AMMO2': '0.001', 'AMMO4': '0.004', 'ARMOR': '0.022', 'AMMO5': '0.030', 'WEAPON1': '0.070', 'AMMO3': '0.105', 'weapon5': '0.120', 'WEAPON4': '0.150', 'HITCOUNT': '0.280', 'weapon4': '0.296', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'weapon2': '1.306', 'DAMAGECOUNT': '1.431', 'weapon3': '1.712', 'FRAGCOUNT': '2.500'} [2023-02-24 17:38:59,300][177153] Updated weights for policy 0, policy_version 3290 (0.0008) [2023-02-24 17:38:59,923][177170] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 17:39:01,376][177119] Fps is (10 sec: 14336.3, 60 sec: 14062.9, 300 sec: 14065.2). Total num frames: 13504512. Throughput: 0: 3510.5. Samples: 3376964. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:39:01,376][177119] Avg episode reward: [(0, '-0.796')] [2023-02-24 17:39:02,215][177153] Updated weights for policy 0, policy_version 3300 (0.0008) [2023-02-24 17:39:05,138][177153] Updated weights for policy 0, policy_version 3310 (0.0008) [2023-02-24 17:39:06,376][177119] Fps is (10 sec: 14336.1, 60 sec: 14063.0, 300 sec: 14065.2). Total num frames: 13574144. Throughput: 0: 3514.4. Samples: 3387526. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:39:06,376][177119] Avg episode reward: [(0, '-0.796')] [2023-02-24 17:39:08,073][177153] Updated weights for policy 0, policy_version 3320 (0.0008) [2023-02-24 17:39:10,968][177153] Updated weights for policy 0, policy_version 3330 (0.0008) [2023-02-24 17:39:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 14065.2). Total num frames: 13643776. Throughput: 0: 3511.4. Samples: 3408614. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:39:11,376][177119] Avg episode reward: [(0, '-0.796')] [2023-02-24 17:39:12,931][177170] DAMAGECOUNT value on done: 9286.0 [2023-02-24 17:39:12,932][177170] Sum rewards: 0.621, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.410', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO2': '0.026', 'weapon5': '0.114', 'AMMO3': '0.125', 'AMMO4': '0.132', 'HITCOUNT': '0.240', 'WEAPON4': '0.250', 'weapon4': '0.250', 'WEAPON5': '0.450', 'ARMOR': '0.554', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.005', 'weapon2': '1.090', 'weapon3': '1.600', 'FRAGCOUNT': '2.000'} [2023-02-24 17:39:13,230][177170] DAMAGECOUNT value on done: 11362.0 [2023-02-24 17:39:13,339][177170] DAMAGECOUNT value on done: 8996.0 [2023-02-24 17:39:13,339][177170] Sum rewards: -6.180, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.288', 'AMMO2': '0.022', 'AMMO5': '0.034', 'weapon4': '0.046', 'WEAPON1': '0.050', 'AMMO4': '0.108', 'AMMO3': '0.128', 'HITCOUNT': '0.130', 'weapon5': '0.194', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.408', 'ARMOR': '0.496', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'weapon2': '1.198', 'weapon3': '1.944'} [2023-02-24 17:39:13,634][177170] DAMAGECOUNT value on done: 11382.0 [2023-02-24 17:39:13,634][177170] Sum rewards: 2.922, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.596', 'AMMO2': '0.011', 'AMMO5': '0.012', 'AMMO4': '0.053', 'AMMO3': '0.072', 'WEAPON1': '0.100', 'weapon5': '0.218', 'HITCOUNT': '0.340', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon3': '1.222', 'DAMAGECOUNT': '1.242', 'weapon2': '1.548', 'FRAGCOUNT': '4.000'} [2023-02-24 17:39:13,806][177172] DAMAGECOUNT value on done: 8518.0 [2023-02-24 17:39:13,807][177172] Sum rewards: -4.446, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.520', 'FRAGCOUNT': '-1.000', 'AMMO2': '0.016', 'AMMO5': '0.024', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.058', 'AMMO4': '0.078', 'HITCOUNT': '0.130', 'AMMO3': '0.141', 'weapon5': '0.216', 'WEAPON5': '0.450', 'DAMAGECOUNT': '0.459', 'WEAPON3': '0.750', 'weapon2': '1.536', 'weapon3': '1.626'} [2023-02-24 17:39:13,824][177158] DAMAGECOUNT value on done: 11183.0 [2023-02-24 17:39:13,825][177158] Sum rewards: -1.807, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.181', 'AMMO2': '0.007', 'AMMO5': '0.020', 'AMMO4': '0.035', 'weapon4': '0.036', 'ARMOR': '0.040', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.154', 'weapon5': '0.164', 'HITCOUNT': '0.190', 'WEAPON5': '0.500', 'DAMAGECOUNT': '0.531', 'WEAPON3': '0.650', 'weapon3': '1.324', 'weapon2': '1.792', 'FRAGCOUNT': '2.000'} [2023-02-24 17:39:13,901][177153] Updated weights for policy 0, policy_version 3340 (0.0009) [2023-02-24 17:39:14,101][177172] DAMAGECOUNT value on done: 8551.0 [2023-02-24 17:39:14,102][177172] Sum rewards: 1.818, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.880', 'AMMO2': '0.008', 'AMMO5': '0.016', 'WEAPON1': '0.040', 'AMMO4': '0.041', 'weapon5': '0.102', 'AMMO3': '0.112', 'HITCOUNT': '0.170', 'WEAPON5': '0.300', 'ARMOR': '0.495', 'DAMAGECOUNT': '0.519', 'WEAPON3': '0.550', 'weapon2': '1.044', 'weapon3': '1.800', 'FRAGCOUNT': '2.000'} [2023-02-24 17:39:14,122][177158] DAMAGECOUNT value on done: 8937.0 [2023-02-24 17:39:14,122][177158] Sum rewards: 2.044, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.772', 'AMMO5': '0.007', 'AMMO2': '0.017', 'ARMOR': '0.036', 'WEAPON1': '0.060', 'AMMO4': '0.086', 'weapon5': '0.100', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'weapon4': '0.156', 'WEAPON5': '0.200', 'HITCOUNT': '0.370', 'WEAPON3': '0.550', 'weapon3': '1.424', 'weapon2': '1.572', 'DAMAGECOUNT': '1.971', 'FRAGCOUNT': '5.000'} [2023-02-24 17:39:14,139][177154] DAMAGECOUNT value on done: 11176.0 [2023-02-24 17:39:14,139][177154] Sum rewards: -2.713, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.177', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.010', 'WEAPON1': '0.050', 'ARMOR': '0.060', 'weapon5': '0.106', 'AMMO3': '0.143', 'WEAPON5': '0.250', 'HITCOUNT': '0.260', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.317', 'weapon2': '1.370', 'FRAGCOUNT': '2.000', 'weapon3': '2.000'} [2023-02-24 17:39:14,429][177158] DAMAGECOUNT value on done: 9150.0 [2023-02-24 17:39:14,430][177158] Sum rewards: 0.614, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.696', 'AMMO2': '0.011', 'AMMO5': '0.012', 'weapon4': '0.052', 'AMMO4': '0.052', 'WEAPON1': '0.060', 'ARMOR': '0.075', 'WEAPON4': '0.100', 'weapon5': '0.140', 'AMMO3': '0.177', 'WEAPON5': '0.300', 'HITCOUNT': '0.330', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.275', 'weapon3': '1.444', 'weapon2': '1.782', 'FRAGCOUNT': '3.000'} [2023-02-24 17:39:14,431][177154] DAMAGECOUNT value on done: 9099.0 [2023-02-24 17:39:14,726][177158] DAMAGECOUNT value on done: 9193.0 [2023-02-24 17:39:14,726][177158] Sum rewards: -2.499, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.190', 'AMMO2': '0.006', 'AMMO5': '0.011', 'AMMO4': '0.030', 'WEAPON1': '0.050', 'AMMO3': '0.101', 'weapon5': '0.122', 'HITCOUNT': '0.170', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.654', 'FRAGCOUNT': '1.000', 'weapon3': '1.126', 'weapon2': '1.920'} [2023-02-24 17:39:14,733][177154] DAMAGECOUNT value on done: 10747.0 [2023-02-24 17:39:14,734][177154] Sum rewards: -1.227, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.622', 'weapon4': '0.010', 'AMMO2': '0.013', 'AMMO5': '0.017', 'ARMOR': '0.028', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'HITCOUNT': '0.060', 'AMMO4': '0.062', 'AMMO3': '0.090', 'weapon5': '0.158', 'WEAPON5': '0.450', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.132', 'weapon2': '2.120'} [2023-02-24 17:39:15,001][177172] DAMAGECOUNT value on done: 9004.0 [2023-02-24 17:39:15,002][177172] Sum rewards: -3.479, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.100', 'AMMO5': '0.004', 'ARMOR': '0.016', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.042', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'weapon4': '0.354', 'WEAPON3': '0.550', 'weapon3': '1.076', 'DAMAGECOUNT': '1.218', 'weapon2': '1.870', 'FRAGCOUNT': '3.000'} [2023-02-24 17:39:15,035][177154] DAMAGECOUNT value on done: 9843.0 [2023-02-24 17:39:15,035][177154] Sum rewards: -0.965, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.520', 'AMMO5': '0.014', 'AMMO2': '0.023', 'weapon4': '0.064', 'WEAPON1': '0.070', 'AMMO3': '0.107', 'AMMO4': '0.117', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'weapon5': '0.210', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.957', 'weapon2': '1.414', 'FRAGCOUNT': '1.500', 'weapon3': '1.508'} [2023-02-24 17:39:15,047][177171] DAMAGECOUNT value on done: 9497.0 [2023-02-24 17:39:15,048][177171] Sum rewards: -4.093, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.208', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.017', 'weapon4': '0.022', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.064', 'AMMO3': '0.112', 'HITCOUNT': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.828', 'FRAGCOUNT': '1.000', 'weapon2': '1.464', 'weapon3': '1.884'} [2023-02-24 17:39:15,305][177172] DAMAGECOUNT value on done: 8749.0 [2023-02-24 17:39:15,306][177172] Sum rewards: 1.152, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.653', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.025', 'ARMOR': '0.036', 'weapon7': '0.046', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon4': '0.122', 'AMMO4': '0.124', 'weapon5': '0.144', 'AMMO6': '0.160', 'AMMO7': '0.160', 'HITCOUNT': '0.170', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'weapon3': '1.484', 'weapon2': '1.486', 'DAMAGECOUNT': '1.950', 'FRAGCOUNT': '2.000'} [2023-02-24 17:39:15,344][177171] DAMAGECOUNT value on done: 8893.0 [2023-02-24 17:39:15,413][177157] DAMAGECOUNT value on done: 10393.0 [2023-02-24 17:39:15,414][177157] Sum rewards: 3.098, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.837', 'AMMO2': '0.012', 'AMMO5': '0.022', 'weapon7': '0.038', 'AMMO4': '0.057', 'AMMO3': '0.060', 'WEAPON1': '0.070', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.226', 'HITCOUNT': '0.240', 'WEAPON3': '0.400', 'WEAPON5': '0.450', 'weapon2': '1.462', 'weapon3': '1.622', 'DAMAGECOUNT': '1.725', 'FRAGCOUNT': '4.000'} [2023-02-24 17:39:15,506][177155] DAMAGECOUNT value on done: 9434.0 [2023-02-24 17:39:15,507][177155] Sum rewards: -2.856, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.287', 'weapon4': '0.006', 'AMMO2': '0.018', 'AMMO5': '0.019', 'WEAPON4': '0.050', 'AMMO4': '0.092', 'WEAPON1': '0.100', 'AMMO3': '0.141', 'weapon5': '0.148', 'ARMOR': '0.470', 'WEAPON5': '0.500', 'HITCOUNT': '0.580', 'WEAPON3': '0.900', 'weapon2': '1.248', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.010', 'weapon3': '2.148'} [2023-02-24 17:39:15,655][177171] DAMAGECOUNT value on done: 10839.0 [2023-02-24 17:39:15,656][177171] Sum rewards: -2.382, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.350', 'AMMO5': '0.025', 'AMMO2': '0.031', 'ARMOR': '0.048', 'WEAPON1': '0.080', 'weapon5': '0.080', 'weapon4': '0.110', 'AMMO3': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.136', 'WEAPON4': '0.150', 'AMMO4': '0.154', 'WEAPON7': '0.200', 'HITCOUNT': '0.200', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.789', 'weapon2': '1.410', 'weapon3': '1.646', 'FRAGCOUNT': '2.000'} [2023-02-24 17:39:15,711][177157] DAMAGECOUNT value on done: 12214.0 [2023-02-24 17:39:15,711][177157] Sum rewards: -2.775, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.412', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'weapon7': '0.016', 'AMMO5': '0.017', 'AMMO4': '0.028', 'ARMOR': '0.044', 'weapon4': '0.052', 'WEAPON4': '0.100', 'weapon5': '0.138', 'AMMO3': '0.153', 'HITCOUNT': '0.170', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.350', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.293', 'weapon2': '1.608', 'weapon3': '1.702'} [2023-02-24 17:39:15,722][177157] DAMAGECOUNT value on done: 10558.0 [2023-02-24 17:39:15,723][177157] Sum rewards: -1.090, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.705', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.023', 'ARMOR': '0.036', 'WEAPON1': '0.060', 'weapon5': '0.074', 'HITCOUNT': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.157', 'DAMAGECOUNT': '0.387', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'weapon2': '1.532', 'weapon3': '1.558', 'FRAGCOUNT': '2.000'} [2023-02-24 17:39:15,809][177155] DAMAGECOUNT value on done: 10852.0 [2023-02-24 17:39:15,809][177155] Sum rewards: -3.264, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.210', 'ARMOR': '0.012', 'AMMO2': '0.016', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.032', 'AMMO4': '0.080', 'AMMO3': '0.097', 'HITCOUNT': '0.120', 'weapon4': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.417', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.346', 'weapon2': '1.580'} [2023-02-24 17:39:15,950][177171] DAMAGECOUNT value on done: 9567.0 [2023-02-24 17:39:16,010][177157] DAMAGECOUNT value on done: 10028.0 [2023-02-24 17:39:16,010][177157] Sum rewards: 2.518, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.348', 'AMMO5': '0.013', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'weapon4': '0.068', 'ARMOR': '0.080', 'AMMO4': '0.109', 'AMMO3': '0.132', 'weapon5': '0.178', 'HITCOUNT': '0.280', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.428', 'weapon3': '1.574', 'weapon2': '1.622', 'FRAGCOUNT': '3.000'} [2023-02-24 17:39:16,088][177155] DAMAGECOUNT value on done: 11954.0 [2023-02-24 17:39:16,088][177155] Sum rewards: -1.978, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.396', 'AMMO5': '0.022', 'AMMO2': '0.023', 'ARMOR': '0.040', 'WEAPON1': '0.070', 'AMMO4': '0.116', 'weapon5': '0.136', 'AMMO3': '0.150', 'HITCOUNT': '0.210', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.056', 'weapon2': '1.280', 'weapon3': '2.014'} [2023-02-24 17:39:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 14065.2). Total num frames: 13713408. Throughput: 0: 3509.6. Samples: 3429578. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:39:16,376][177119] Avg episode reward: [(0, '-1.041')] [2023-02-24 17:39:16,383][177155] DAMAGECOUNT value on done: 9765.0 [2023-02-24 17:39:16,384][177155] Sum rewards: 1.663, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.019', 'AMMO5': '0.028', 'weapon4': '0.042', 'WEAPON4': '0.050', 'WEAPON1': '0.080', 'AMMO4': '0.095', 'weapon5': '0.112', 'AMMO3': '0.124', 'HITCOUNT': '0.250', 'WEAPON5': '0.550', 'HEALTH': '0.567', 'WEAPON3': '0.700', 'weapon2': '1.052', 'DAMAGECOUNT': '1.146', 'weapon3': '2.098', 'FRAGCOUNT': '3.000'} [2023-02-24 17:39:16,828][177153] Updated weights for policy 0, policy_version 3350 (0.0008) [2023-02-24 17:39:17,649][177156] DAMAGECOUNT value on done: 10102.0 [2023-02-24 17:39:17,649][177156] Sum rewards: 3.720, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.211', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.012', 'WEAPON1': '0.030', 'AMMO3': '0.055', 'HITCOUNT': '0.120', 'WEAPON5': '0.150', 'weapon5': '0.198', 'WEAPON3': '0.400', 'ARMOR': '0.534', 'DAMAGECOUNT': '0.876', 'weapon3': '0.950', 'weapon2': '1.596', 'FRAGCOUNT': '2.000'} [2023-02-24 17:39:17,966][177156] DAMAGECOUNT value on done: 11015.0 [2023-02-24 17:39:17,966][177156] Sum rewards: -2.210, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.510', 'weapon4': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.029', 'WEAPON4': '0.050', 'WEAPON1': '0.090', 'AMMO3': '0.109', 'AMMO4': '0.143', 'HITCOUNT': '0.150', 'weapon5': '0.224', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.023', 'weapon2': '1.218', 'weapon3': '1.886', 'FRAGCOUNT': '2.000'} [2023-02-24 17:39:18,100][177156] DAMAGECOUNT value on done: 9097.0 [2023-02-24 17:39:18,100][177156] Sum rewards: -2.586, reward structure: {'DEATHCOUNT': '-9.750', 'weapon7': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.018', 'WEAPON1': '0.050', 'AMMO4': '0.091', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.118', 'AMMO3': '0.119', 'weapon4': '0.212', 'HITCOUNT': '0.250', 'WEAPON5': '0.300', 'FRAGCOUNT': '0.500', 'HEALTH': '0.548', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.975', 'weapon2': '1.468', 'weapon3': '1.496'} [2023-02-24 17:39:18,401][177156] DAMAGECOUNT value on done: 11157.0 [2023-02-24 17:39:18,401][177156] Sum rewards: -0.278, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.363', 'AMMO2': '0.001', 'AMMO4': '0.007', 'weapon5': '0.008', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO3': '0.131', 'WEAPON4': '0.200', 'HITCOUNT': '0.220', 'weapon4': '0.238', 'WEAPON5': '0.400', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.690', 'weapon3': '1.362', 'weapon2': '1.882'} [2023-02-24 17:39:19,675][177153] Updated weights for policy 0, policy_version 3360 (0.0009) [2023-02-24 17:39:21,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 14051.4). Total num frames: 13783040. Throughput: 0: 3513.4. Samples: 3440230. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:39:21,376][177119] Avg episode reward: [(0, '-1.068')] [2023-02-24 17:39:22,586][177153] Updated weights for policy 0, policy_version 3370 (0.0008) [2023-02-24 17:39:25,487][177153] Updated weights for policy 0, policy_version 3380 (0.0008) [2023-02-24 17:39:26,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13994.7, 300 sec: 14051.4). Total num frames: 13852672. Throughput: 0: 3515.9. Samples: 3461384. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:39:26,376][177119] Avg episode reward: [(0, '-1.068')] [2023-02-24 17:39:28,417][177153] Updated weights for policy 0, policy_version 3390 (0.0009) [2023-02-24 17:39:31,347][177153] Updated weights for policy 0, policy_version 3400 (0.0008) [2023-02-24 17:39:31,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14063.0, 300 sec: 14065.3). Total num frames: 13926400. Throughput: 0: 3511.6. Samples: 3482344. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:39:31,376][177119] Avg episode reward: [(0, '-1.068')] [2023-02-24 17:39:32,062][177170] DAMAGECOUNT value on done: 9444.0 [2023-02-24 17:39:32,062][177170] Sum rewards: -1.085, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.854', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'weapon5': '0.058', 'AMMO3': '0.089', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'HITCOUNT': '0.160', 'WEAPON4': '0.300', 'weapon4': '0.374', 'DAMAGECOUNT': '0.474', 'WEAPON3': '0.500', 'ARMOR': '0.907', 'weapon3': '1.108', 'weapon2': '1.694', 'FRAGCOUNT': '2.000'} [2023-02-24 17:39:32,352][177170] DAMAGECOUNT value on done: 9386.0 [2023-02-24 17:39:32,353][177170] Sum rewards: 0.248, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.256', 'AMMO5': '0.021', 'AMMO2': '0.034', 'weapon5': '0.054', 'WEAPON1': '0.060', 'ARMOR': '0.072', 'AMMO4': '0.168', 'AMMO3': '0.170', 'HITCOUNT': '0.210', 'weapon4': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.170', 'weapon2': '1.200', 'weapon3': '1.858', 'FRAGCOUNT': '3.000'} [2023-02-24 17:39:32,361][177170] DAMAGECOUNT value on done: 11542.0 [2023-02-24 17:39:32,362][177170] Sum rewards: 0.140, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.525', 'AMMO5': '0.015', 'AMMO2': '0.022', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'AMMO3': '0.073', 'AMMO4': '0.109', 'weapon5': '0.146', 'WEAPON4': '0.150', 'weapon4': '0.160', 'HITCOUNT': '0.170', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.540', 'weapon3': '0.942', 'FRAGCOUNT': '1.000', 'weapon2': '1.666'} [2023-02-24 17:39:32,650][177170] DAMAGECOUNT value on done: 11572.0 [2023-02-24 17:39:32,651][177170] Sum rewards: -1.448, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.879', 'AMMO5': '0.015', 'AMMO2': '0.035', 'WEAPON1': '0.050', 'ARMOR': '0.068', 'HITCOUNT': '0.070', 'weapon4': '0.128', 'weapon5': '0.140', 'AMMO3': '0.144', 'AMMO4': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.750', 'weapon3': '1.260', 'weapon2': '1.924', 'FRAGCOUNT': '2.000'} [2023-02-24 17:39:32,860][177158] DAMAGECOUNT value on done: 11604.0 [2023-02-24 17:39:32,860][177158] Sum rewards: -1.240, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.486', 'AMMO2': '0.012', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.062', 'ARMOR': '0.064', 'AMMO3': '0.127', 'weapon5': '0.140', 'weapon4': '0.162', 'HITCOUNT': '0.250', 'WEAPON5': '0.300', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.263', 'weapon3': '1.392', 'weapon2': '1.746'} [2023-02-24 17:39:32,943][177172] DAMAGECOUNT value on done: 8673.0 [2023-02-24 17:39:32,943][177172] Sum rewards: -1.206, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.784', 'AMMO2': '0.010', 'weapon4': '0.024', 'AMMO5': '0.025', 'HITCOUNT': '0.040', 'AMMO4': '0.049', 'weapon7': '0.050', 'WEAPON1': '0.090', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.136', 'AMMO3': '0.140', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.465', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'weapon3': '1.426', 'weapon2': '1.734', 'FRAGCOUNT': '2.000'} [2023-02-24 17:39:33,159][177158] DAMAGECOUNT value on done: 9413.0 [2023-02-24 17:39:33,160][177158] Sum rewards: -1.458, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.562', 'ARMOR': '0.015', 'AMMO2': '0.029', 'AMMO5': '0.029', 'WEAPON1': '0.100', 'AMMO4': '0.144', 'weapon5': '0.148', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'weapon4': '0.200', 'HITCOUNT': '0.330', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'weapon3': '1.062', 'DAMAGECOUNT': '1.428', 'weapon2': '1.864', 'FRAGCOUNT': '3.000'} [2023-02-24 17:39:33,242][177172] DAMAGECOUNT value on done: 8738.0 [2023-02-24 17:39:33,289][177154] DAMAGECOUNT value on done: 11698.0 [2023-02-24 17:39:33,290][177154] Sum rewards: 4.625, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.382', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.060', 'AMMO4': '0.065', 'AMMO3': '0.066', 'WEAPON4': '0.100', 'HITCOUNT': '0.210', 'weapon5': '0.226', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'weapon3': '1.490', 'DAMAGECOUNT': '1.566', 'weapon2': '1.848', 'FRAGCOUNT': '4.000'} [2023-02-24 17:39:33,515][177158] DAMAGECOUNT value on done: 9366.0 [2023-02-24 17:39:33,516][177158] Sum rewards: 0.162, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.090', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.022', 'WEAPON1': '0.040', 'ARMOR': '0.056', 'HITCOUNT': '0.070', 'AMMO3': '0.116', 'weapon5': '0.178', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.648', 'weapon3': '1.250', 'weapon2': '1.870', 'FRAGCOUNT': '2.000'} [2023-02-24 17:39:33,588][177154] DAMAGECOUNT value on done: 9428.0 [2023-02-24 17:39:33,589][177154] Sum rewards: -0.966, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.067', 'AMMO2': '0.012', 'AMMO5': '0.018', 'WEAPON1': '0.060', 'AMMO4': '0.060', 'weapon4': '0.094', 'weapon5': '0.100', 'AMMO3': '0.135', 'WEAPON4': '0.200', 'HITCOUNT': '0.230', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.987', 'weapon2': '1.254', 'weapon3': '1.950', 'FRAGCOUNT': '3.000'} [2023-02-24 17:39:33,816][177158] DAMAGECOUNT value on done: 9398.0 [2023-02-24 17:39:33,816][177158] Sum rewards: -0.125, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.058', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'weapon5': '0.052', 'weapon4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'HITCOUNT': '0.160', 'WEAPON5': '0.200', 'ARMOR': '0.539', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.615', 'FRAGCOUNT': '1.000', 'weapon3': '1.124', 'weapon2': '1.598'} [2023-02-24 17:39:33,895][177154] DAMAGECOUNT value on done: 10912.0 [2023-02-24 17:39:33,896][177154] Sum rewards: 0.901, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.397', 'ARMOR': '0.004', 'AMMO2': '0.011', 'weapon4': '0.022', 'AMMO5': '0.024', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'weapon5': '0.116', 'AMMO3': '0.131', 'HITCOUNT': '0.140', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon2': '1.082', 'weapon3': '1.830'} [2023-02-24 17:39:34,132][177172] DAMAGECOUNT value on done: 9210.0 [2023-02-24 17:39:34,133][177172] Sum rewards: -1.074, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.736', 'AMMO5': '0.011', 'AMMO2': '0.015', 'weapon4': '0.024', 'WEAPON1': '0.060', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'HITCOUNT': '0.140', 'weapon5': '0.210', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.618', 'weapon3': '0.906', 'weapon2': '1.790'} [2023-02-24 17:39:34,199][177154] DAMAGECOUNT value on done: 10422.0 [2023-02-24 17:39:34,200][177154] Sum rewards: 2.683, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.628', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'weapon5': '0.112', 'AMMO3': '0.160', 'HITCOUNT': '0.360', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon2': '1.400', 'DAMAGECOUNT': '1.737', 'weapon3': '2.072', 'FRAGCOUNT': '6.000'} [2023-02-24 17:39:34,273][177171] DAMAGECOUNT value on done: 9859.0 [2023-02-24 17:39:34,274][177171] Sum rewards: -4.655, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.515', 'AMMO2': '0.013', 'AMMO5': '0.022', 'weapon4': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'WEAPON1': '0.070', 'weapon5': '0.078', 'AMMO3': '0.156', 'HITCOUNT': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.086', 'weapon2': '1.640', 'weapon3': '1.948', 'FRAGCOUNT': '2.000'} [2023-02-24 17:39:34,312][177153] Updated weights for policy 0, policy_version 3410 (0.0008) [2023-02-24 17:39:34,437][177172] DAMAGECOUNT value on done: 9119.0 [2023-02-24 17:39:34,438][177172] Sum rewards: -1.104, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.637', 'AMMO5': '0.012', 'ARMOR': '0.028', 'AMMO2': '0.040', 'weapon4': '0.046', 'WEAPON1': '0.050', 'AMMO3': '0.122', 'weapon5': '0.126', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'AMMO4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.110', 'weapon3': '1.496', 'FRAGCOUNT': '2.000', 'weapon2': '2.032'} [2023-02-24 17:39:34,492][177157] DAMAGECOUNT value on done: 10595.0 [2023-02-24 17:39:34,492][177157] Sum rewards: 3.017, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '0.000', 'AMMO5': '0.004', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'weapon5': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'weapon4': '0.108', 'HITCOUNT': '0.160', 'WEAPON3': '0.200', 'DAMAGECOUNT': '0.606', 'weapon2': '1.050', 'weapon3': '1.476', 'FRAGCOUNT': '2.000'} [2023-02-24 17:39:34,579][177171] DAMAGECOUNT value on done: 9128.0 [2023-02-24 17:39:34,579][177171] Sum rewards: -3.014, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.225', 'AMMO2': '0.009', 'AMMO5': '0.031', 'AMMO4': '0.044', 'AMMO3': '0.126', 'WEAPON1': '0.140', 'HITCOUNT': '0.190', 'weapon5': '0.314', 'WEAPON5': '0.700', 'DAMAGECOUNT': '0.705', 'WEAPON3': '0.800', 'weapon2': '0.930', 'weapon3': '1.972', 'FRAGCOUNT': '2.000'} [2023-02-24 17:39:34,659][177155] DAMAGECOUNT value on done: 9916.0 [2023-02-24 17:39:34,660][177155] Sum rewards: 1.888, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.520', 'AMMO2': '0.010', 'AMMO5': '0.017', 'ARMOR': '0.024', 'AMMO4': '0.047', 'AMMO3': '0.061', 'WEAPON1': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.136', 'weapon5': '0.248', 'WEAPON3': '0.350', 'WEAPON5': '0.400', 'HITCOUNT': '0.420', 'weapon3': '1.286', 'DAMAGECOUNT': '1.446', 'weapon2': '1.522', 'FRAGCOUNT': '3.000'} [2023-02-24 17:39:34,791][177157] DAMAGECOUNT value on done: 12377.0 [2023-02-24 17:39:34,791][177157] Sum rewards: -2.607, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.756', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'ARMOR': '0.072', 'AMMO3': '0.094', 'weapon5': '0.108', 'HITCOUNT': '0.150', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.489', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.550', 'weapon3': '1.876'} [2023-02-24 17:39:34,800][177157] DAMAGECOUNT value on done: 11098.0 [2023-02-24 17:39:34,800][177157] Sum rewards: 1.641, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.833', 'AMMO2': '0.007', 'AMMO5': '0.016', 'AMMO4': '0.033', 'ARMOR': '0.036', 'WEAPON1': '0.040', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'weapon7': '0.124', 'HITCOUNT': '0.190', 'AMMO6': '0.280', 'AMMO7': '0.280', 'weapon5': '0.294', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'WEAPON3': '0.600', 'weapon3': '1.084', 'DAMAGECOUNT': '1.620', 'weapon2': '1.926', 'FRAGCOUNT': '2.000'} [2023-02-24 17:39:34,879][177171] DAMAGECOUNT value on done: 11010.0 [2023-02-24 17:39:34,879][177171] Sum rewards: -1.568, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.398', 'AMMO5': '0.005', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'ARMOR': '0.036', 'AMMO3': '0.083', 'weapon5': '0.096', 'weapon4': '0.104', 'AMMO4': '0.144', 'HITCOUNT': '0.150', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.513', 'weapon3': '0.912', 'FRAGCOUNT': '1.000', 'weapon2': '1.878'} [2023-02-24 17:39:34,957][177155] DAMAGECOUNT value on done: 11218.0 [2023-02-24 17:39:34,957][177155] Sum rewards: -3.503, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.674', 'AMMO5': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'weapon5': '0.066', 'AMMO4': '0.072', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.154', 'HITCOUNT': '0.160', 'AMMO3': '0.179', 'WEAPON3': '1.050', 'DAMAGECOUNT': '1.098', 'weapon2': '1.344', 'weapon3': '1.900', 'FRAGCOUNT': '2.000'} [2023-02-24 17:39:35,098][177157] DAMAGECOUNT value on done: 10079.0 [2023-02-24 17:39:35,099][177157] Sum rewards: -3.152, reward structure: {'DEATHCOUNT': '-5.250', 'FRAGCOUNT': '-1.500', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.016', 'WEAPON1': '0.020', 'HEALTH': '0.040', 'HITCOUNT': '0.050', 'weapon5': '0.082', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.153', 'WEAPON3': '0.550', 'weapon2': '1.168', 'weapon3': '1.312'} [2023-02-24 17:39:35,175][177171] DAMAGECOUNT value on done: 9860.0 [2023-02-24 17:39:35,176][177171] Sum rewards: -1.355, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.710', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.012', 'ARMOR': '0.032', 'WEAPON1': '0.080', 'weapon5': '0.134', 'HITCOUNT': '0.140', 'AMMO3': '0.180', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.879', 'FRAGCOUNT': '1.500', 'weapon2': '1.512', 'weapon3': '1.536'} [2023-02-24 17:39:35,233][177155] DAMAGECOUNT value on done: 12324.0 [2023-02-24 17:39:35,233][177155] Sum rewards: 0.442, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.000', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.050', 'AMMO3': '0.055', 'AMMO4': '0.090', 'weapon5': '0.174', 'HITCOUNT': '0.240', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.110', 'weapon3': '1.174', 'FRAGCOUNT': '1.500', 'weapon2': '2.218'} [2023-02-24 17:39:35,528][177155] DAMAGECOUNT value on done: 10282.0 [2023-02-24 17:39:35,529][177155] Sum rewards: 0.410, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.920', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon7': '0.022', 'WEAPON1': '0.070', 'ARMOR': '0.080', 'AMMO4': '0.096', 'AMMO3': '0.117', 'weapon5': '0.132', 'weapon4': '0.170', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'weapon3': '1.338', 'DAMAGECOUNT': '1.551', 'weapon2': '1.862', 'FRAGCOUNT': '3.000'} [2023-02-24 17:39:36,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 13996032. Throughput: 0: 3510.0. Samples: 3492758. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:39:36,376][177119] Avg episode reward: [(0, '-1.073')] [2023-02-24 17:39:36,886][177156] DAMAGECOUNT value on done: 10761.0 [2023-02-24 17:39:36,886][177156] Sum rewards: 6.469, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.883', 'AMMO5': '0.017', 'AMMO2': '0.021', 'AMMO3': '0.072', 'WEAPON1': '0.090', 'AMMO4': '0.106', 'weapon5': '0.270', 'HITCOUNT': '0.320', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon2': '1.440', 'weapon3': '1.588', 'DAMAGECOUNT': '1.977', 'FRAGCOUNT': '5.000'} [2023-02-24 17:39:37,185][177153] Updated weights for policy 0, policy_version 3420 (0.0008) [2023-02-24 17:39:37,186][177156] DAMAGECOUNT value on done: 11325.0 [2023-02-24 17:39:37,186][177156] Sum rewards: 3.678, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.165', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'ARMOR': '0.008', 'AMMO5': '0.009', 'WEAPON1': '0.050', 'weapon5': '0.078', 'AMMO3': '0.090', 'HITCOUNT': '0.190', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'weapon3': '0.916', 'DAMAGECOUNT': '0.930', 'weapon2': '2.388', 'FRAGCOUNT': '4.000'} [2023-02-24 17:39:37,362][177156] DAMAGECOUNT value on done: 9417.0 [2023-02-24 17:39:37,363][177156] Sum rewards: 1.998, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.308', 'AMMO5': '0.010', 'AMMO2': '0.022', 'WEAPON1': '0.050', 'ARMOR': '0.052', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'AMMO4': '0.107', 'weapon5': '0.170', 'HITCOUNT': '0.230', 'weapon4': '0.244', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.960', 'weapon3': '1.112', 'weapon2': '1.674', 'FRAGCOUNT': '2.000'} [2023-02-24 17:39:37,655][177156] DAMAGECOUNT value on done: 11656.0 [2023-02-24 17:39:37,656][177156] Sum rewards: -1.919, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.406', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'AMMO4': '0.079', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'weapon4': '0.170', 'weapon5': '0.196', 'WEAPON5': '0.300', 'HITCOUNT': '0.320', 'ARMOR': '0.455', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.700', 'weapon2': '1.418', 'DAMAGECOUNT': '1.497', 'weapon3': '1.770'} [2023-02-24 17:39:40,112][177153] Updated weights for policy 0, policy_version 3430 (0.0009) [2023-02-24 17:39:41,376][177119] Fps is (10 sec: 13926.2, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 14065664. Throughput: 0: 3513.3. Samples: 3513936. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:39:41,376][177119] Avg episode reward: [(0, '-0.874')] [2023-02-24 17:39:43,039][177153] Updated weights for policy 0, policy_version 3440 (0.0008) [2023-02-24 17:39:45,916][177153] Updated weights for policy 0, policy_version 3450 (0.0008) [2023-02-24 17:39:46,376][177119] Fps is (10 sec: 13926.2, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 14135296. Throughput: 0: 3514.6. Samples: 3535120. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:39:46,376][177119] Avg episode reward: [(0, '-0.874')] [2023-02-24 17:39:48,818][177153] Updated weights for policy 0, policy_version 3460 (0.0008) [2023-02-24 17:39:49,893][177171] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-24 17:39:51,135][177170] DAMAGECOUNT value on done: 9949.0 [2023-02-24 17:39:51,135][177170] Sum rewards: 3.288, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.205', 'AMMO5': '0.010', 'AMMO2': '0.011', 'ARMOR': '0.024', 'AMMO4': '0.055', 'WEAPON1': '0.060', 'AMMO3': '0.111', 'weapon5': '0.118', 'WEAPON5': '0.200', 'HITCOUNT': '0.330', 'WEAPON3': '0.700', 'weapon3': '1.336', 'DAMAGECOUNT': '1.515', 'weapon2': '1.522', 'FRAGCOUNT': '5.000'} [2023-02-24 17:39:51,376][177119] Fps is (10 sec: 13926.1, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 14204928. Throughput: 0: 3514.4. Samples: 3545676. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:39:51,377][177119] Avg episode reward: [(0, '-0.816')] [2023-02-24 17:39:51,426][177170] DAMAGECOUNT value on done: 9716.0 [2023-02-24 17:39:51,427][177170] Sum rewards: -5.508, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.657', 'AMMO2': '0.008', 'AMMO5': '0.019', 'AMMO4': '0.040', 'WEAPON1': '0.060', 'HITCOUNT': '0.110', 'AMMO3': '0.155', 'weapon5': '0.214', 'WEAPON5': '0.450', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.990', 'weapon3': '1.518', 'weapon2': '1.784'} [2023-02-24 17:39:51,448][177170] DAMAGECOUNT value on done: 11902.0 [2023-02-24 17:39:51,448][177170] Sum rewards: -0.015, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.085', 'AMMO5': '0.009', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'weapon4': '0.046', 'WEAPON4': '0.050', 'weapon5': '0.080', 'weapon7': '0.084', 'AMMO3': '0.088', 'AMMO4': '0.099', 'HITCOUNT': '0.140', 'WEAPON5': '0.200', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.080', 'weapon3': '1.366', 'weapon2': '1.618', 'FRAGCOUNT': '2.000'} [2023-02-24 17:39:51,730][177170] DAMAGECOUNT value on done: 11803.0 [2023-02-24 17:39:51,730][177170] Sum rewards: -6.491, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.684', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO5': '0.017', 'AMMO4': '0.038', 'weapon5': '0.076', 'WEAPON1': '0.090', 'AMMO3': '0.155', 'weapon4': '0.176', 'HITCOUNT': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.693', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.292', 'weapon3': '1.874'} [2023-02-24 17:39:51,734][177153] Updated weights for policy 0, policy_version 3470 (0.0008) [2023-02-24 17:39:51,866][177158] DAMAGECOUNT value on done: 12078.0 [2023-02-24 17:39:51,867][177158] Sum rewards: -1.561, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.059', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.024', 'AMMO4': '0.056', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'weapon4': '0.116', 'HITCOUNT': '0.200', 'weapon5': '0.240', 'WEAPON5': '0.400', 'WEAPON3': '0.400', 'ARMOR': '0.436', 'weapon3': '0.968', 'DAMAGECOUNT': '1.422', 'weapon2': '1.782', 'FRAGCOUNT': '3.000'} [2023-02-24 17:39:52,044][177172] DAMAGECOUNT value on done: 9020.0 [2023-02-24 17:39:52,045][177172] Sum rewards: -1.529, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.710', 'AMMO5': '0.010', 'AMMO2': '0.031', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'AMMO3': '0.109', 'weapon5': '0.134', 'AMMO4': '0.154', 'HITCOUNT': '0.160', 'weapon4': '0.176', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.041', 'weapon3': '1.210', 'weapon2': '1.766', 'FRAGCOUNT': '4.000'} [2023-02-24 17:39:52,156][177158] DAMAGECOUNT value on done: 9702.0 [2023-02-24 17:39:52,157][177158] Sum rewards: -0.606, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.494', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.030', 'ARMOR': '0.060', 'WEAPON1': '0.060', 'AMMO3': '0.069', 'weapon5': '0.118', 'HITCOUNT': '0.180', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'weapon4': '0.512', 'weapon3': '0.604', 'DAMAGECOUNT': '0.867', 'weapon2': '1.872', 'FRAGCOUNT': '3.000'} [2023-02-24 17:39:52,335][177172] DAMAGECOUNT value on done: 9015.0 [2023-02-24 17:39:52,360][177154] DAMAGECOUNT value on done: 12102.0 [2023-02-24 17:39:52,361][177154] Sum rewards: 3.410, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.879', 'AMMO2': '0.011', 'AMMO5': '0.014', 'ARMOR': '0.036', 'AMMO4': '0.056', 'AMMO3': '0.057', 'WEAPON1': '0.070', 'HITCOUNT': '0.110', 'weapon5': '0.274', 'WEAPON3': '0.400', 'WEAPON5': '0.450', 'weapon3': '1.046', 'DAMAGECOUNT': '1.212', 'weapon2': '2.052', 'FRAGCOUNT': '3.000'} [2023-02-24 17:39:52,629][177158] DAMAGECOUNT value on done: 9726.0 [2023-02-24 17:39:52,630][177158] Sum rewards: 0.153, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.278', 'AMMO2': '0.016', 'AMMO5': '0.025', 'ARMOR': '0.036', 'WEAPON1': '0.060', 'AMMO4': '0.081', 'AMMO3': '0.114', 'weapon5': '0.132', 'WEAPON4': '0.150', 'weapon4': '0.162', 'HITCOUNT': '0.260', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.080', 'weapon2': '1.318', 'weapon3': '1.846', 'FRAGCOUNT': '3.000'} [2023-02-24 17:39:52,659][177154] DAMAGECOUNT value on done: 9884.0 [2023-02-24 17:39:52,660][177154] Sum rewards: -0.355, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.902', 'AMMO2': '0.017', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.085', 'AMMO3': '0.105', 'weapon4': '0.142', 'weapon5': '0.234', 'HITCOUNT': '0.370', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.344', 'DAMAGECOUNT': '1.368', 'weapon3': '1.704', 'FRAGCOUNT': '3.000'} [2023-02-24 17:39:52,924][177158] DAMAGECOUNT value on done: 9608.0 [2023-02-24 17:39:52,924][177158] Sum rewards: 2.705, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.456', 'AMMO2': '0.001', 'weapon4': '0.002', 'AMMO4': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'weapon5': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.103', 'HITCOUNT': '0.120', 'WEAPON5': '0.200', 'ARMOR': '0.466', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.630', 'weapon2': '1.600', 'weapon3': '1.852', 'FRAGCOUNT': '2.000'} [2023-02-24 17:39:52,949][177154] DAMAGECOUNT value on done: 11199.0 [2023-02-24 17:39:52,950][177154] Sum rewards: -1.174, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.790', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.017', 'ARMOR': '0.024', 'AMMO3': '0.062', 'WEAPON1': '0.100', 'HITCOUNT': '0.150', 'weapon5': '0.244', 'WEAPON3': '0.350', 'WEAPON5': '0.450', 'DAMAGECOUNT': '0.861', 'weapon3': '0.876', 'weapon2': '1.972', 'FRAGCOUNT': '2.000'} [2023-02-24 17:39:53,211][177172] DAMAGECOUNT value on done: 9468.0 [2023-02-24 17:39:53,211][177172] Sum rewards: -4.467, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.417', 'AMMO5': '0.007', 'AMMO2': '0.016', 'ARMOR': '0.024', 'WEAPON1': '0.050', 'weapon5': '0.076', 'AMMO4': '0.077', 'HITCOUNT': '0.120', 'AMMO3': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.356', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.684', 'weapon3': '0.846', 'FRAGCOUNT': '1.000', 'weapon2': '2.258'} [2023-02-24 17:39:53,234][177154] DAMAGECOUNT value on done: 10628.0 [2023-02-24 17:39:53,235][177154] Sum rewards: 0.760, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.918', 'AMMO5': '0.007', 'AMMO2': '0.025', 'WEAPON1': '0.050', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'AMMO4': '0.127', 'HITCOUNT': '0.170', 'weapon5': '0.170', 'WEAPON5': '0.250', 'weapon4': '0.324', 'WEAPON3': '0.450', 'ARMOR': '0.556', 'DAMAGECOUNT': '0.618', 'weapon3': '0.830', 'FRAGCOUNT': '1.000', 'weapon2': '1.440'} [2023-02-24 17:39:53,410][177171] DAMAGECOUNT value on done: 10472.0 [2023-02-24 17:39:53,411][177171] Sum rewards: -0.234, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.701', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.017', 'weapon4': '0.028', 'WEAPON1': '0.050', 'weapon5': '0.114', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.320', 'ARMOR': '0.532', 'WEAPON3': '0.950', 'weapon3': '1.490', 'weapon2': '1.786', 'DAMAGECOUNT': '1.806', 'FRAGCOUNT': '3.000'} [2023-02-24 17:39:53,509][177172] DAMAGECOUNT value on done: 9521.0 [2023-02-24 17:39:53,510][177172] Sum rewards: 0.686, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.190', 'AMMO2': '0.010', 'AMMO5': '0.014', 'AMMO4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.073', 'HITCOUNT': '0.190', 'weapon5': '0.252', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.206', 'weapon3': '1.448', 'weapon2': '1.472', 'FRAGCOUNT': '3.000'} [2023-02-24 17:39:53,655][177157] DAMAGECOUNT value on done: 10988.0 [2023-02-24 17:39:53,656][177157] Sum rewards: -1.362, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.614', 'AMMO2': '0.022', 'AMMO5': '0.022', 'ARMOR': '0.036', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.111', 'AMMO3': '0.111', 'weapon4': '0.196', 'HITCOUNT': '0.240', 'weapon5': '0.280', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.179', 'weapon2': '1.310', 'weapon3': '1.344', 'FRAGCOUNT': '3.000'} [2023-02-24 17:39:53,700][177155] DAMAGECOUNT value on done: 10328.0 [2023-02-24 17:39:53,701][177155] Sum rewards: 0.344, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO2': '0.032', 'AMMO5': '0.035', 'WEAPON4': '0.050', 'HEALTH': '0.078', 'WEAPON1': '0.100', 'AMMO3': '0.119', 'weapon5': '0.144', 'AMMO4': '0.158', 'HITCOUNT': '0.180', 'ARMOR': '0.424', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.236', 'weapon2': '1.396', 'weapon3': '1.792', 'FRAGCOUNT': '3.000'} [2023-02-24 17:39:53,703][177171] DAMAGECOUNT value on done: 9327.0 [2023-02-24 17:39:53,704][177171] Sum rewards: 0.954, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.221', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'ARMOR': '0.044', 'AMMO3': '0.051', 'AMMO4': '0.102', 'weapon4': '0.114', 'weapon5': '0.180', 'WEAPON4': '0.200', 'HITCOUNT': '0.200', 'WEAPON3': '0.200', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.597', 'weapon3': '0.626', 'weapon2': '1.758', 'FRAGCOUNT': '2.000'} [2023-02-24 17:39:53,950][177157] DAMAGECOUNT value on done: 12782.0 [2023-02-24 17:39:53,951][177157] Sum rewards: -3.767, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.138', 'AMMO5': '0.012', 'weapon5': '0.014', 'AMMO2': '0.033', 'WEAPON1': '0.080', 'AMMO3': '0.128', 'AMMO4': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.300', 'weapon4': '0.722', 'WEAPON3': '0.800', 'weapon2': '0.834', 'DAMAGECOUNT': '1.215', 'weapon3': '1.818', 'FRAGCOUNT': '2.000'} [2023-02-24 17:39:53,960][177157] DAMAGECOUNT value on done: 11662.0 [2023-02-24 17:39:53,960][177157] Sum rewards: 2.576, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.030', 'AMMO5': '0.007', 'weapon4': '0.010', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'ARMOR': '0.036', 'WEAPON4': '0.100', 'weapon5': '0.102', 'AMMO3': '0.126', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'HITCOUNT': '0.300', 'WEAPON3': '0.700', 'weapon3': '1.548', 'DAMAGECOUNT': '1.566', 'weapon2': '1.770', 'FRAGCOUNT': '5.000'} [2023-02-24 17:39:54,007][177155] DAMAGECOUNT value on done: 11459.0 [2023-02-24 17:39:54,008][177155] Sum rewards: 0.674, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.632', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'weapon5': '0.068', 'AMMO3': '0.081', 'HITCOUNT': '0.140', 'WEAPON5': '0.150', 'WEAPON3': '0.350', 'ARMOR': '0.494', 'DAMAGECOUNT': '0.723', 'weapon2': '0.754', 'FRAGCOUNT': '1.000', 'weapon3': '1.278'} [2023-02-24 17:39:54,009][177171] DAMAGECOUNT value on done: 11218.0 [2023-02-24 17:39:54,009][177171] Sum rewards: -1.679, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.340', 'AMMO5': '0.019', 'AMMO2': '0.025', 'WEAPON1': '0.070', 'AMMO3': '0.111', 'HITCOUNT': '0.120', 'AMMO4': '0.123', 'weapon5': '0.206', 'weapon4': '0.230', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.624', 'weapon3': '1.096', 'weapon2': '1.536', 'FRAGCOUNT': '2.000'} [2023-02-24 17:39:54,256][177157] DAMAGECOUNT value on done: 10229.0 [2023-02-24 17:39:54,282][177155] DAMAGECOUNT value on done: 12784.0 [2023-02-24 17:39:54,283][177155] Sum rewards: 1.347, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.360', 'AMMO5': '0.022', 'AMMO2': '0.024', 'WEAPON1': '0.100', 'AMMO3': '0.104', 'AMMO4': '0.121', 'weapon5': '0.162', 'WEAPON4': '0.200', 'HITCOUNT': '0.410', 'weapon4': '0.494', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon2': '1.300', 'DAMAGECOUNT': '1.380', 'weapon3': '1.540', 'FRAGCOUNT': '3.000'} [2023-02-24 17:39:54,296][177171] DAMAGECOUNT value on done: 10264.0 [2023-02-24 17:39:54,297][177171] Sum rewards: -1.679, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.560', 'ARMOR': '0.004', 'AMMO2': '0.015', 'AMMO5': '0.021', 'AMMO4': '0.075', 'WEAPON1': '0.110', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'weapon4': '0.166', 'weapon5': '0.212', 'HITCOUNT': '0.220', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.212', 'weapon2': '1.242', 'FRAGCOUNT': '1.500', 'weapon3': '1.706'} [2023-02-24 17:39:54,571][177155] DAMAGECOUNT value on done: 10646.0 [2023-02-24 17:39:54,572][177155] Sum rewards: 1.005, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.202', 'weapon7': '0.006', 'AMMO5': '0.014', 'AMMO2': '0.017', 'weapon4': '0.030', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'ARMOR': '0.076', 'HITCOUNT': '0.080', 'AMMO4': '0.083', 'AMMO3': '0.097', 'weapon5': '0.146', 'WEAPON5': '0.350', 'AMMO6': '0.400', 'WEAPON7': '0.400', 'AMMO7': '0.400', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.092', 'weapon2': '1.240', 'weapon3': '1.676', 'FRAGCOUNT': '2.000'} [2023-02-24 17:39:54,628][177153] Updated weights for policy 0, policy_version 3480 (0.0009) [2023-02-24 17:39:55,958][177156] DAMAGECOUNT value on done: 11066.0 [2023-02-24 17:39:55,959][177156] Sum rewards: -8.592, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.366', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.020', 'AMMO2': '0.023', 'ARMOR': '0.064', 'WEAPON1': '0.110', 'AMMO4': '0.113', 'AMMO3': '0.131', 'HITCOUNT': '0.140', 'weapon4': '0.226', 'WEAPON4': '0.250', 'weapon5': '0.250', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon3': '0.786', 'DAMAGECOUNT': '0.915', 'weapon2': '1.996'} [2023-02-24 17:39:56,251][177156] DAMAGECOUNT value on done: 11675.0 [2023-02-24 17:39:56,251][177156] Sum rewards: -0.107, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.392', 'AMMO2': '0.014', 'AMMO5': '0.030', 'ARMOR': '0.044', 'WEAPON1': '0.060', 'AMMO4': '0.069', 'weapon4': '0.070', 'AMMO3': '0.132', 'weapon5': '0.136', 'WEAPON4': '0.150', 'HITCOUNT': '0.280', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.050', 'weapon2': '1.644', 'weapon3': '1.706', 'FRAGCOUNT': '2.000'} [2023-02-24 17:39:56,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14131.2, 300 sec: 14065.2). Total num frames: 14278656. Throughput: 0: 3514.8. Samples: 3566782. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:39:56,376][177119] Avg episode reward: [(0, '-0.734')] [2023-02-24 17:39:56,442][177156] DAMAGECOUNT value on done: 9773.0 [2023-02-24 17:39:56,443][177156] Sum rewards: -0.836, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.325', 'AMMO5': '0.015', 'AMMO2': '0.023', 'ARMOR': '0.062', 'WEAPON1': '0.070', 'AMMO3': '0.103', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'weapon5': '0.156', 'HITCOUNT': '0.190', 'weapon4': '0.298', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.068', 'weapon3': '1.346', 'weapon2': '1.392'} [2023-02-24 17:39:56,745][177156] DAMAGECOUNT value on done: 12019.0 [2023-02-24 17:39:56,745][177156] Sum rewards: -0.854, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.204', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.022', 'ARMOR': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.086', 'weapon5': '0.104', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.294', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.089', 'weapon3': '1.228', 'weapon2': '1.764', 'FRAGCOUNT': '2.000'} [2023-02-24 17:39:57,504][177153] Updated weights for policy 0, policy_version 3490 (0.0008) [2023-02-24 17:40:00,399][177153] Updated weights for policy 0, policy_version 3500 (0.0009) [2023-02-24 17:40:01,376][177119] Fps is (10 sec: 14336.3, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 14348288. Throughput: 0: 3521.2. Samples: 3588030. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:40:01,376][177119] Avg episode reward: [(0, '-0.709')] [2023-02-24 17:40:03,335][177153] Updated weights for policy 0, policy_version 3510 (0.0008) [2023-02-24 17:40:06,228][177153] Updated weights for policy 0, policy_version 3520 (0.0008) [2023-02-24 17:40:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 14417920. Throughput: 0: 3519.0. Samples: 3598584. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:40:06,376][177119] Avg episode reward: [(0, '-0.709')] [2023-02-24 17:40:09,119][177153] Updated weights for policy 0, policy_version 3530 (0.0008) [2023-02-24 17:40:10,212][177170] DAMAGECOUNT value on done: 10189.0 [2023-02-24 17:40:10,512][177170] DAMAGECOUNT value on done: 12489.0 [2023-02-24 17:40:10,512][177170] Sum rewards: -1.227, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.434', 'AMMO5': '0.018', 'AMMO2': '0.020', 'ARMOR': '0.044', 'weapon4': '0.062', 'AMMO4': '0.098', 'WEAPON1': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon5': '0.192', 'HITCOUNT': '0.290', 'WEAPON5': '0.450', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.800', 'weapon3': '1.548', 'weapon2': '1.612', 'DAMAGECOUNT': '1.755'} [2023-02-24 17:40:10,524][177170] DAMAGECOUNT value on done: 10071.0 [2023-02-24 17:40:10,525][177170] Sum rewards: 3.283, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.180', 'AMMO2': '0.015', 'AMMO5': '0.018', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'weapon5': '0.064', 'AMMO4': '0.076', 'weapon4': '0.132', 'AMMO3': '0.155', 'HITCOUNT': '0.230', 'WEAPON5': '0.400', 'ARMOR': '0.408', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.065', 'weapon2': '1.632', 'weapon3': '1.758', 'FRAGCOUNT': '5.000'} [2023-02-24 17:40:10,769][177158] DAMAGECOUNT value on done: 12237.0 [2023-02-24 17:40:10,770][177158] Sum rewards: -0.984, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.154', 'AMMO5': '0.013', 'AMMO2': '0.014', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.090', 'HITCOUNT': '0.090', 'weapon4': '0.106', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.477', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.266', 'weapon3': '1.724'} [2023-02-24 17:40:10,821][177170] DAMAGECOUNT value on done: 12093.0 [2023-02-24 17:40:10,821][177170] Sum rewards: -1.512, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.560', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.027', 'WEAPON1': '0.080', 'AMMO3': '0.129', 'weapon5': '0.140', 'HITCOUNT': '0.290', 'WEAPON5': '0.600', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.870', 'FRAGCOUNT': '1.000', 'weapon3': '1.280', 'weapon2': '1.796'} [2023-02-24 17:40:11,072][177158] DAMAGECOUNT value on done: 10115.0 [2023-02-24 17:40:11,073][177158] Sum rewards: -5.144, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.529', 'FRAGCOUNT': '0.000', 'ARMOR': '0.008', 'AMMO2': '0.013', 'AMMO5': '0.015', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.134', 'weapon5': '0.172', 'HITCOUNT': '0.210', 'weapon4': '0.212', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'weapon3': '1.190', 'DAMAGECOUNT': '1.239', 'weapon2': '1.728'} [2023-02-24 17:40:11,167][177172] DAMAGECOUNT value on done: 9267.0 [2023-02-24 17:40:11,167][177172] Sum rewards: 0.951, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.682', 'AMMO2': '0.008', 'AMMO5': '0.017', 'AMMO4': '0.040', 'WEAPON1': '0.060', 'AMMO3': '0.100', 'weapon5': '0.134', 'HITCOUNT': '0.190', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.741', 'weapon2': '1.142', 'weapon3': '1.350', 'FRAGCOUNT': '2.000'} [2023-02-24 17:40:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 14487552. Throughput: 0: 3518.2. Samples: 3619702. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:40:11,376][177119] Avg episode reward: [(0, '-0.760')] [2023-02-24 17:40:11,401][177154] DAMAGECOUNT value on done: 12395.0 [2023-02-24 17:40:11,402][177154] Sum rewards: -3.655, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.872', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'ARMOR': '0.024', 'AMMO5': '0.030', 'weapon4': '0.088', 'WEAPON1': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.134', 'weapon5': '0.282', 'WEAPON3': '0.700', 'WEAPON5': '0.750', 'DAMAGECOUNT': '0.879', 'weapon3': '0.934', 'weapon2': '1.844', 'FRAGCOUNT': '3.000'} [2023-02-24 17:40:11,462][177172] DAMAGECOUNT value on done: 9448.0 [2023-02-24 17:40:11,463][177172] Sum rewards: 2.086, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.532', 'AMMO5': '0.012', 'AMMO2': '0.022', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.068', 'AMMO4': '0.109', 'weapon4': '0.112', 'HITCOUNT': '0.260', 'WEAPON5': '0.300', 'weapon5': '0.338', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.132', 'DAMAGECOUNT': '1.299', 'weapon2': '1.816'} [2023-02-24 17:40:11,553][177158] DAMAGECOUNT value on done: 10137.0 [2023-02-24 17:40:11,554][177158] Sum rewards: 3.171, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.015', 'weapon4': '0.026', 'AMMO2': '0.029', 'ARMOR': '0.056', 'WEAPON1': '0.070', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'AMMO4': '0.145', 'HEALTH': '0.156', 'weapon5': '0.204', 'HITCOUNT': '0.310', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'DAMAGECOUNT': '1.233', 'weapon3': '1.312', 'weapon2': '1.742', 'FRAGCOUNT': '3.000'} [2023-02-24 17:40:11,701][177154] DAMAGECOUNT value on done: 10113.0 [2023-02-24 17:40:11,701][177154] Sum rewards: -5.458, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.938', 'AMMO2': '0.001', 'AMMO4': '0.004', 'weapon5': '0.014', 'weapon4': '0.018', 'AMMO5': '0.025', 'WEAPON1': '0.030', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'HITCOUNT': '0.160', 'AMMO3': '0.215', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.687', 'weapon2': '0.956', 'WEAPON3': '1.350', 'FRAGCOUNT': '2.000', 'weapon3': '2.534'} [2023-02-24 17:40:11,858][177158] DAMAGECOUNT value on done: 9803.0 [2023-02-24 17:40:11,859][177158] Sum rewards: -1.354, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.370', 'AMMO5': '0.007', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'AMMO4': '0.109', 'weapon5': '0.134', 'AMMO3': '0.144', 'HITCOUNT': '0.160', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.478', 'ARMOR': '0.486', 'DAMAGECOUNT': '0.585', 'WEAPON3': '0.800', 'weapon2': '1.150', 'weapon3': '1.600', 'FRAGCOUNT': '2.000'} [2023-02-24 17:40:12,008][177154] DAMAGECOUNT value on done: 11576.0 [2023-02-24 17:40:12,009][177154] Sum rewards: -0.126, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.742', 'AMMO2': '0.008', 'AMMO5': '0.015', 'ARMOR': '0.024', 'AMMO4': '0.038', 'weapon4': '0.040', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO3': '0.114', 'HITCOUNT': '0.160', 'weapon5': '0.176', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.131', 'weapon2': '1.418', 'weapon3': '1.672', 'FRAGCOUNT': '3.000'} [2023-02-24 17:40:12,053][177153] Updated weights for policy 0, policy_version 3540 (0.0008) [2023-02-24 17:40:12,307][177154] DAMAGECOUNT value on done: 11099.0 [2023-02-24 17:40:12,308][177154] Sum rewards: 0.849, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.830', 'AMMO2': '0.014', 'AMMO5': '0.017', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'AMMO4': '0.067', 'weapon4': '0.090', 'AMMO3': '0.124', 'HITCOUNT': '0.140', 'WEAPON4': '0.200', 'weapon5': '0.242', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.413', 'weapon3': '1.510', 'weapon2': '1.572', 'FRAGCOUNT': '2.000'} [2023-02-24 17:40:12,341][177172] DAMAGECOUNT value on done: 10284.0 [2023-02-24 17:40:12,341][177172] Sum rewards: 4.686, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.768', 'AMMO2': '0.017', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO4': '0.086', 'AMMO3': '0.111', 'weapon4': '0.162', 'weapon5': '0.194', 'HITCOUNT': '0.270', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon2': '1.472', 'weapon3': '1.756', 'DAMAGECOUNT': '2.448', 'FRAGCOUNT': '6.000'} [2023-02-24 17:40:12,499][177171] DAMAGECOUNT value on done: 10988.0 [2023-02-24 17:40:12,500][177171] Sum rewards: 4.571, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.770', 'AMMO2': '0.007', 'AMMO5': '0.015', 'AMMO4': '0.035', 'WEAPON1': '0.070', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'HITCOUNT': '0.210', 'weapon5': '0.252', 'weapon4': '0.336', 'WEAPON5': '0.450', 'WEAPON3': '0.450', 'ARMOR': '0.456', 'weapon3': '1.016', 'DAMAGECOUNT': '1.548', 'weapon2': '1.574', 'FRAGCOUNT': '4.000'} [2023-02-24 17:40:12,639][177172] DAMAGECOUNT value on done: 9839.0 [2023-02-24 17:40:12,639][177172] Sum rewards: -3.811, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.950', 'ARMOR': '0.036', 'AMMO2': '0.036', 'AMMO5': '0.037', 'WEAPON1': '0.100', 'weapon5': '0.110', 'weapon4': '0.132', 'AMMO3': '0.143', 'AMMO4': '0.182', 'HITCOUNT': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.650', 'WEAPON3': '0.900', 'weapon2': '0.950', 'DAMAGECOUNT': '0.954', 'weapon3': '2.098', 'FRAGCOUNT': '4.000'} [2023-02-24 17:40:12,691][177157] DAMAGECOUNT value on done: 11460.0 [2023-02-24 17:40:12,691][177157] Sum rewards: 0.244, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.607', 'weapon4': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'WEAPON1': '0.080', 'AMMO4': '0.102', 'AMMO3': '0.108', 'weapon5': '0.222', 'HITCOUNT': '0.270', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'weapon2': '1.360', 'DAMAGECOUNT': '1.416', 'weapon3': '1.544', 'FRAGCOUNT': '2.000'} [2023-02-24 17:40:12,776][177155] DAMAGECOUNT value on done: 10328.0 [2023-02-24 17:40:12,791][177171] DAMAGECOUNT value on done: 10020.0 [2023-02-24 17:40:12,792][177171] Sum rewards: 7.310, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.635', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.024', 'AMMO3': '0.065', 'WEAPON1': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.288', 'weapon5': '0.302', 'HITCOUNT': '0.330', 'WEAPON3': '0.550', 'WEAPON5': '0.650', 'weapon2': '1.032', 'weapon3': '1.608', 'DAMAGECOUNT': '2.079', 'FRAGCOUNT': '7.000'} [2023-02-24 17:40:12,980][177157] DAMAGECOUNT value on done: 13007.0 [2023-02-24 17:40:12,981][177157] Sum rewards: -4.251, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.942', 'AMMO2': '0.008', 'AMMO5': '0.013', 'weapon5': '0.018', 'AMMO4': '0.040', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.175', 'HITCOUNT': '0.190', 'WEAPON5': '0.250', 'weapon4': '0.290', 'ARMOR': '0.444', 'DAMAGECOUNT': '0.675', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.592', 'weapon3': '1.656'} [2023-02-24 17:40:12,991][177157] DAMAGECOUNT value on done: 11996.0 [2023-02-24 17:40:12,991][177157] Sum rewards: -1.761, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.013', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'HEALTH': '0.056', 'ARMOR': '0.064', 'AMMO3': '0.090', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'weapon4': '0.162', 'weapon5': '0.164', 'HITCOUNT': '0.270', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.002', 'weapon3': '1.202', 'weapon2': '2.010'} [2023-02-24 17:40:13,071][177155] DAMAGECOUNT value on done: 11657.0 [2023-02-24 17:40:13,071][177155] Sum rewards: -4.199, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.240', 'AMMO5': '0.015', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'ARMOR': '0.064', 'weapon4': '0.070', 'AMMO4': '0.095', 'weapon5': '0.116', 'AMMO3': '0.122', 'HITCOUNT': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.594', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.368', 'weapon3': '1.948'} [2023-02-24 17:40:13,085][177171] DAMAGECOUNT value on done: 11377.0 [2023-02-24 17:40:13,086][177171] Sum rewards: 0.074, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.615', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO3': '0.064', 'WEAPON1': '0.080', 'ARMOR': '0.084', 'HITCOUNT': '0.110', 'AMMO4': '0.148', 'weapon5': '0.180', 'weapon4': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.477', 'weapon3': '0.994', 'FRAGCOUNT': '1.000', 'weapon2': '2.314'} [2023-02-24 17:40:13,284][177157] DAMAGECOUNT value on done: 10707.0 [2023-02-24 17:40:13,285][177157] Sum rewards: -4.983, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.718', 'AMMO2': '0.030', 'AMMO5': '0.032', 'ARMOR': '0.040', 'WEAPON1': '0.100', 'AMMO3': '0.107', 'AMMO4': '0.150', 'weapon4': '0.202', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'weapon5': '0.292', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.700', 'WEAPON5': '0.750', 'weapon3': '1.104', 'DAMAGECOUNT': '1.434', 'weapon2': '1.524'} [2023-02-24 17:40:13,316][177155] DAMAGECOUNT value on done: 12993.0 [2023-02-24 17:40:13,316][177155] Sum rewards: 2.941, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.034', 'AMMO2': '0.002', 'weapon4': '0.010', 'AMMO4': '0.011', 'AMMO5': '0.012', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'WEAPON1': '0.060', 'HITCOUNT': '0.180', 'weapon5': '0.192', 'WEAPON5': '0.400', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.627', 'weapon3': '1.374', 'weapon2': '1.806', 'FRAGCOUNT': '3.000'} [2023-02-24 17:40:13,382][177171] DAMAGECOUNT value on done: 10469.0 [2023-02-24 17:40:13,383][177171] Sum rewards: -2.638, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.040', 'weapon4': '0.014', 'AMMO5': '0.015', 'AMMO2': '0.015', 'ARMOR': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.076', 'WEAPON1': '0.080', 'AMMO3': '0.149', 'weapon5': '0.182', 'HITCOUNT': '0.210', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.615', 'WEAPON3': '0.850', 'weapon3': '1.442', 'FRAGCOUNT': '2.000', 'weapon2': '2.084'} [2023-02-24 17:40:13,609][177155] DAMAGECOUNT value on done: 10800.0 [2023-02-24 17:40:13,609][177155] Sum rewards: -0.642, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.685', 'AMMO5': '0.012', 'ARMOR': '0.024', 'AMMO2': '0.030', 'WEAPON1': '0.050', 'AMMO3': '0.098', 'HITCOUNT': '0.100', 'weapon5': '0.106', 'WEAPON4': '0.150', 'AMMO4': '0.152', 'WEAPON5': '0.250', 'weapon4': '0.356', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.462', 'weapon3': '0.886', 'FRAGCOUNT': '1.000', 'weapon2': '1.966'} [2023-02-24 17:40:14,934][177153] Updated weights for policy 0, policy_version 3550 (0.0008) [2023-02-24 17:40:15,064][177156] DAMAGECOUNT value on done: 11426.0 [2023-02-24 17:40:15,065][177156] Sum rewards: -4.055, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.603', 'AMMO2': '0.012', 'AMMO5': '0.016', 'AMMO4': '0.060', 'WEAPON1': '0.080', 'ARMOR': '0.084', 'weapon5': '0.108', 'AMMO3': '0.163', 'weapon4': '0.264', 'HITCOUNT': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.080', 'weapon3': '1.334', 'weapon2': '1.726', 'FRAGCOUNT': '4.000'} [2023-02-24 17:40:15,369][177156] DAMAGECOUNT value on done: 11965.0 [2023-02-24 17:40:15,369][177156] Sum rewards: -0.681, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.868', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.007', 'AMMO2': '0.036', 'WEAPON1': '0.050', 'weapon5': '0.104', 'ARMOR': '0.111', 'AMMO3': '0.121', 'WEAPON5': '0.150', 'AMMO4': '0.178', 'HITCOUNT': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.318', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.870', 'weapon2': '1.314', 'weapon3': '1.548'} [2023-02-24 17:40:15,560][177156] DAMAGECOUNT value on done: 10669.0 [2023-02-24 17:40:15,560][177156] Sum rewards: 3.513, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.246', 'AMMO5': '0.010', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'ARMOR': '0.036', 'AMMO3': '0.067', 'AMMO4': '0.125', 'weapon4': '0.136', 'weapon5': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'HITCOUNT': '0.400', 'WEAPON3': '0.450', 'weapon3': '1.132', 'weapon2': '2.124', 'DAMAGECOUNT': '2.688', 'FRAGCOUNT': '3.500'} [2023-02-24 17:40:15,859][177156] DAMAGECOUNT value on done: 12327.0 [2023-02-24 17:40:15,860][177156] Sum rewards: -1.672, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.130', 'AMMO5': '0.022', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'ARMOR': '0.060', 'HITCOUNT': '0.090', 'AMMO4': '0.113', 'AMMO3': '0.135', 'weapon5': '0.168', 'weapon4': '0.176', 'WEAPON4': '0.300', 'WEAPON5': '0.550', 'DAMAGECOUNT': '0.924', 'WEAPON3': '0.950', 'weapon2': '1.208', 'weapon3': '1.958', 'FRAGCOUNT': '2.000'} [2023-02-24 17:40:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 14557184. Throughput: 0: 3521.6. Samples: 3640816. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:40:16,376][177119] Avg episode reward: [(0, '-0.558')] [2023-02-24 17:40:16,405][177140] Saving new best policy, reward=-0.558! [2023-02-24 17:40:17,872][177153] Updated weights for policy 0, policy_version 3560 (0.0008) [2023-02-24 17:40:20,758][177153] Updated weights for policy 0, policy_version 3570 (0.0008) [2023-02-24 17:40:21,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14131.2, 300 sec: 14065.3). Total num frames: 14630912. Throughput: 0: 3525.3. Samples: 3651398. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:40:21,376][177119] Avg episode reward: [(0, '-0.558')] [2023-02-24 17:40:23,656][177153] Updated weights for policy 0, policy_version 3580 (0.0008) [2023-02-24 17:40:26,376][177119] Fps is (10 sec: 14335.9, 60 sec: 14131.2, 300 sec: 14065.2). Total num frames: 14700544. Throughput: 0: 3527.5. Samples: 3672672. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:40:26,376][177119] Avg episode reward: [(0, '-0.558')] [2023-02-24 17:40:26,554][177153] Updated weights for policy 0, policy_version 3590 (0.0008) [2023-02-24 17:40:29,272][177170] DAMAGECOUNT value on done: 10747.0 [2023-02-24 17:40:29,273][177170] Sum rewards: -1.242, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.797', 'AMMO2': '0.022', 'AMMO5': '0.027', 'AMMO3': '0.108', 'AMMO4': '0.111', 'WEAPON1': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.154', 'HITCOUNT': '0.190', 'weapon4': '0.240', 'WEAPON5': '0.650', 'WEAPON3': '0.750', 'weapon2': '1.144', 'DAMAGECOUNT': '1.674', 'weapon3': '1.964', 'FRAGCOUNT': '3.000'} [2023-02-24 17:40:29,466][177153] Updated weights for policy 0, policy_version 3600 (0.0008) [2023-02-24 17:40:29,569][177170] DAMAGECOUNT value on done: 10547.0 [2023-02-24 17:40:29,570][177170] Sum rewards: -3.567, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.774', 'AMMO5': '0.016', 'AMMO2': '0.025', 'ARMOR': '0.056', 'WEAPON1': '0.060', 'weapon4': '0.098', 'AMMO4': '0.127', 'weapon5': '0.130', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'HITCOUNT': '0.270', 'WEAPON5': '0.300', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.428', 'weapon3': '1.594', 'weapon2': '1.770', 'FRAGCOUNT': '2.000'} [2023-02-24 17:40:29,579][177170] DAMAGECOUNT value on done: 12993.0 [2023-02-24 17:40:29,579][177170] Sum rewards: -2.010, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.349', 'AMMO2': '0.021', 'AMMO5': '0.024', 'ARMOR': '0.032', 'weapon4': '0.036', 'WEAPON1': '0.050', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'weapon5': '0.158', 'AMMO3': '0.188', 'HITCOUNT': '0.300', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon2': '1.240', 'DAMAGECOUNT': '1.512', 'weapon3': '2.124', 'FRAGCOUNT': '3.000'} [2023-02-24 17:40:29,850][177158] DAMAGECOUNT value on done: 12728.0 [2023-02-24 17:40:29,850][177158] Sum rewards: 2.424, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.168', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.017', 'ARMOR': '0.024', 'WEAPON1': '0.070', 'AMMO3': '0.098', 'weapon5': '0.210', 'HITCOUNT': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon3': '1.388', 'DAMAGECOUNT': '1.473', 'weapon2': '1.758', 'FRAGCOUNT': '3.000'} [2023-02-24 17:40:29,881][177170] DAMAGECOUNT value on done: 12638.0 [2023-02-24 17:40:29,881][177170] Sum rewards: -0.012, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.845', 'AMMO2': '0.011', 'AMMO5': '0.027', 'AMMO4': '0.057', 'AMMO3': '0.112', 'WEAPON1': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.318', 'weapon4': '0.426', 'HITCOUNT': '0.450', 'WEAPON3': '0.700', 'WEAPON5': '0.750', 'weapon2': '1.004', 'weapon3': '1.542', 'DAMAGECOUNT': '1.635', 'FRAGCOUNT': '3.500'} [2023-02-24 17:40:30,150][177158] DAMAGECOUNT value on done: 10701.0 [2023-02-24 17:40:30,150][177158] Sum rewards: 4.483, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.022', 'AMMO5': '0.024', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'weapon4': '0.088', 'AMMO3': '0.091', 'AMMO4': '0.109', 'weapon5': '0.222', 'HITCOUNT': '0.330', 'HEALTH': '0.376', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon2': '1.324', 'DAMAGECOUNT': '1.758', 'weapon3': '1.830', 'FRAGCOUNT': '4.000'} [2023-02-24 17:40:30,204][177172] DAMAGECOUNT value on done: 9357.0 [2023-02-24 17:40:30,205][177172] Sum rewards: -0.135, reward structure: {'DEATHCOUNT': '-2.250', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.110', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.020', 'AMMO3': '0.058', 'HITCOUNT': '0.080', 'WEAPON5': '0.100', 'WEAPON3': '0.250', 'DAMAGECOUNT': '0.270', 'ARMOR': '0.449', 'weapon2': '0.490', 'weapon3': '1.010'} [2023-02-24 17:40:30,409][177154] DAMAGECOUNT value on done: 12633.0 [2023-02-24 17:40:30,410][177154] Sum rewards: -1.758, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.536', 'AMMO5': '0.015', 'AMMO2': '0.024', 'WEAPON1': '0.050', 'AMMO3': '0.094', 'weapon4': '0.112', 'AMMO4': '0.121', 'ARMOR': '0.138', 'HITCOUNT': '0.190', 'weapon5': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.714', 'weapon3': '0.848', 'weapon2': '2.038'} [2023-02-24 17:40:30,501][177172] DAMAGECOUNT value on done: 9608.0 [2023-02-24 17:40:30,594][177158] DAMAGECOUNT value on done: 10637.0 [2023-02-24 17:40:30,595][177158] Sum rewards: 3.495, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.275', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.008', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.151', 'HITCOUNT': '0.360', 'WEAPON3': '0.700', 'weapon2': '0.902', 'DAMAGECOUNT': '1.500', 'weapon3': '1.732', 'FRAGCOUNT': '5.000'} [2023-02-24 17:40:30,718][177154] DAMAGECOUNT value on done: 10468.0 [2023-02-24 17:40:30,719][177154] Sum rewards: 2.500, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.654', 'AMMO5': '0.007', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'AMMO3': '0.094', 'weapon4': '0.118', 'AMMO4': '0.126', 'weapon5': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.220', 'ARMOR': '0.458', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.065', 'weapon2': '1.536', 'weapon3': '1.630', 'FRAGCOUNT': '2.000'} [2023-02-24 17:40:30,896][177158] DAMAGECOUNT value on done: 10293.0 [2023-02-24 17:40:30,898][177158] Sum rewards: -1.797, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.443', 'AMMO2': '0.006', 'AMMO5': '0.017', 'AMMO4': '0.032', 'WEAPON1': '0.070', 'AMMO3': '0.130', 'weapon5': '0.192', 'HITCOUNT': '0.330', 'WEAPON5': '0.350', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.470', 'weapon3': '1.512', 'weapon2': '1.536'} [2023-02-24 17:40:31,019][177154] DAMAGECOUNT value on done: 12077.0 [2023-02-24 17:40:31,019][177154] Sum rewards: 0.487, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.052', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.060', 'AMMO3': '0.083', 'AMMO4': '0.091', 'weapon5': '0.224', 'HITCOUNT': '0.240', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'weapon3': '1.044', 'DAMAGECOUNT': '1.503', 'weapon2': '1.764', 'FRAGCOUNT': '3.000'} [2023-02-24 17:40:31,318][177154] DAMAGECOUNT value on done: 11387.0 [2023-02-24 17:40:31,319][177154] Sum rewards: -4.794, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.678', 'AMMO5': '0.021', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'WEAPON4': '0.100', 'weapon5': '0.100', 'AMMO4': '0.112', 'HITCOUNT': '0.140', 'AMMO3': '0.182', 'weapon4': '0.236', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.864', 'weapon2': '1.432', 'weapon3': '1.794', 'FRAGCOUNT': '2.000'} [2023-02-24 17:40:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 14770176. Throughput: 0: 3523.6. Samples: 3693680. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:40:31,376][177119] Avg episode reward: [(0, '-0.522')] [2023-02-24 17:40:31,377][177140] Saving new best policy, reward=-0.522! [2023-02-24 17:40:31,391][177172] DAMAGECOUNT value on done: 10639.0 [2023-02-24 17:40:31,392][177172] Sum rewards: -0.286, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.234', 'AMMO4': '-0.064', 'AMMO2': '-0.013', 'AMMO5': '0.022', 'WEAPON4': '0.100', 'WEAPON1': '0.110', 'AMMO3': '0.117', 'weapon4': '0.152', 'HITCOUNT': '0.200', 'weapon5': '0.216', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'weapon3': '0.986', 'DAMAGECOUNT': '1.065', 'weapon2': '1.456', 'FRAGCOUNT': '3.000'} [2023-02-24 17:40:31,563][177171] DAMAGECOUNT value on done: 11158.0 [2023-02-24 17:40:31,564][177171] Sum rewards: -6.426, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.904', 'weapon4': '0.002', 'AMMO5': '0.017', 'AMMO2': '0.017', 'ARMOR': '0.036', 'WEAPON1': '0.060', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'AMMO3': '0.134', 'HITCOUNT': '0.160', 'weapon5': '0.170', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.750', 'weapon3': '1.354', 'weapon2': '1.982'} [2023-02-24 17:40:31,722][177172] DAMAGECOUNT value on done: 9969.0 [2023-02-24 17:40:31,761][177157] DAMAGECOUNT value on done: 11555.0 [2023-02-24 17:40:31,762][177157] Sum rewards: -0.941, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.385', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.017', 'WEAPON1': '0.060', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'weapon4': '0.208', 'weapon5': '0.226', 'DAMAGECOUNT': '0.285', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.328', 'weapon2': '1.400'} [2023-02-24 17:40:31,849][177171] DAMAGECOUNT value on done: 10512.0 [2023-02-24 17:40:31,850][177171] Sum rewards: 1.653, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.690', 'AMMO2': '0.018', 'AMMO5': '0.020', 'WEAPON1': '0.060', 'AMMO4': '0.090', 'AMMO3': '0.094', 'WEAPON4': '0.150', 'weapon5': '0.184', 'weapon4': '0.272', 'HITCOUNT': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.476', 'weapon2': '1.570', 'weapon3': '1.658', 'FRAGCOUNT': '3.000'} [2023-02-24 17:40:31,952][177155] DAMAGECOUNT value on done: 10779.0 [2023-02-24 17:40:31,952][177155] Sum rewards: 0.126, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.009', 'AMMO2': '0.017', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'ARMOR': '0.052', 'AMMO4': '0.087', 'AMMO3': '0.088', 'HEALTH': '0.098', 'weapon5': '0.144', 'weapon4': '0.198', 'WEAPON5': '0.200', 'HITCOUNT': '0.280', 'WEAPON3': '0.400', 'weapon3': '0.940', 'DAMAGECOUNT': '1.353', 'weapon2': '2.160', 'FRAGCOUNT': '3.000'} [2023-02-24 17:40:32,062][177157] DAMAGECOUNT value on done: 13192.0 [2023-02-24 17:40:32,062][177157] Sum rewards: 4.367, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.370', 'AMMO2': '0.010', 'AMMO5': '0.020', 'AMMO4': '0.050', 'AMMO3': '0.050', 'WEAPON1': '0.070', 'weapon5': '0.078', 'WEAPON4': '0.100', 'HITCOUNT': '0.170', 'weapon4': '0.238', 'WEAPON5': '0.350', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.555', 'weapon3': '1.308', 'weapon2': '1.638', 'FRAGCOUNT': '2.000'} [2023-02-24 17:40:32,071][177157] DAMAGECOUNT value on done: 12646.0 [2023-02-24 17:40:32,071][177157] Sum rewards: 5.703, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.936', 'AMMO5': '0.012', 'AMMO2': '0.020', 'WEAPON1': '0.060', 'AMMO3': '0.091', 'AMMO4': '0.100', 'weapon4': '0.114', 'weapon5': '0.196', 'WEAPON4': '0.200', 'HITCOUNT': '0.280', 'WEAPON5': '0.350', 'ARMOR': '0.491', 'WEAPON3': '0.600', 'weapon3': '1.190', 'DAMAGECOUNT': '1.950', 'weapon2': '1.984', 'FRAGCOUNT': '5.000'} [2023-02-24 17:40:32,142][177171] DAMAGECOUNT value on done: 11695.0 [2023-02-24 17:40:32,142][177171] Sum rewards: -0.456, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.602', 'AMMO2': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.050', 'AMMO3': '0.076', 'WEAPON1': '0.080', 'ARMOR': '0.090', 'HITCOUNT': '0.200', 'weapon5': '0.234', 'WEAPON5': '0.400', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.954', 'weapon3': '1.060', 'FRAGCOUNT': '2.000', 'weapon2': '2.074'} [2023-02-24 17:40:32,250][177155] DAMAGECOUNT value on done: 11992.0 [2023-02-24 17:40:32,250][177155] Sum rewards: -0.542, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.848', 'AMMO2': '0.012', 'AMMO5': '0.029', 'AMMO4': '0.059', 'ARMOR': '0.062', 'AMMO3': '0.095', 'WEAPON1': '0.110', 'weapon5': '0.196', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'weapon4': '0.286', 'WEAPON3': '0.500', 'WEAPON5': '0.650', 'DAMAGECOUNT': '1.005', 'weapon3': '1.426', 'weapon2': '1.466', 'FRAGCOUNT': '3.000'} [2023-02-24 17:40:32,370][177157] DAMAGECOUNT value on done: 10802.0 [2023-02-24 17:40:32,371][177157] Sum rewards: 1.191, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.000', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.012', 'ARMOR': '0.040', 'WEAPON1': '0.040', 'AMMO3': '0.088', 'HITCOUNT': '0.090', 'weapon5': '0.118', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.285', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon2': '1.046', 'weapon3': '1.830'} [2023-02-24 17:40:32,443][177171] DAMAGECOUNT value on done: 10714.0 [2023-02-24 17:40:32,443][177171] Sum rewards: 0.310, reward structure: {'DEATHCOUNT': '-8.250', 'weapon7': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.024', 'ARMOR': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'weapon4': '0.052', 'AMMO3': '0.117', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.220', 'HEALTH': '0.356', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.735', 'weapon3': '1.614', 'weapon2': '1.914', 'FRAGCOUNT': '2.000'} [2023-02-24 17:40:32,448][177153] Updated weights for policy 0, policy_version 3610 (0.0008) [2023-02-24 17:40:32,458][177155] DAMAGECOUNT value on done: 13374.0 [2023-02-24 17:40:32,458][177155] Sum rewards: 3.224, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.452', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.058', 'WEAPON1': '0.070', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'HITCOUNT': '0.170', 'AMMO4': '0.175', 'weapon5': '0.186', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.143', 'weapon3': '1.388', 'weapon2': '1.850', 'FRAGCOUNT': '2.000'} [2023-02-24 17:40:32,754][177155] DAMAGECOUNT value on done: 11310.0 [2023-02-24 17:40:32,754][177155] Sum rewards: 0.428, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.426', 'AMMO2': '0.006', 'ARMOR': '0.012', 'AMMO5': '0.021', 'AMMO4': '0.030', 'WEAPON1': '0.100', 'AMMO3': '0.106', 'weapon5': '0.176', 'HITCOUNT': '0.260', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'weapon2': '0.946', 'weapon3': '1.466', 'DAMAGECOUNT': '1.530', 'FRAGCOUNT': '2.500'} [2023-02-24 17:40:34,227][177156] DAMAGECOUNT value on done: 11596.0 [2023-02-24 17:40:34,228][177156] Sum rewards: -0.623, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.139', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'AMMO5': '0.010', 'AMMO3': '0.020', 'ARMOR': '0.032', 'WEAPON1': '0.080', 'HITCOUNT': '0.120', 'WEAPON3': '0.200', 'weapon5': '0.204', 'WEAPON5': '0.350', 'weapon3': '0.478', 'DAMAGECOUNT': '0.510', 'FRAGCOUNT': '2.000', 'weapon2': '2.558'} [2023-02-24 17:40:34,530][177156] DAMAGECOUNT value on done: 12005.0 [2023-02-24 17:40:34,704][177156] DAMAGECOUNT value on done: 11008.0 [2023-02-24 17:40:34,705][177156] Sum rewards: 1.113, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.394', 'AMMO5': '0.015', 'AMMO2': '0.018', 'ARMOR': '0.036', 'WEAPON1': '0.060', 'AMMO4': '0.091', 'AMMO3': '0.106', 'HITCOUNT': '0.170', 'weapon5': '0.216', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.017', 'weapon3': '1.144', 'weapon2': '1.534', 'FRAGCOUNT': '3.000'} [2023-02-24 17:40:34,989][177156] DAMAGECOUNT value on done: 13040.0 [2023-02-24 17:40:34,989][177156] Sum rewards: 1.149, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.872', 'AMMO2': '0.019', 'AMMO5': '0.025', 'WEAPON1': '0.050', 'weapon5': '0.092', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon4': '0.148', 'WEAPON5': '0.400', 'HITCOUNT': '0.600', 'WEAPON3': '0.700', 'weapon2': '1.424', 'weapon3': '1.876', 'DAMAGECOUNT': '2.139', 'FRAGCOUNT': '2.500'} [2023-02-24 17:40:35,347][177153] Updated weights for policy 0, policy_version 3620 (0.0009) [2023-02-24 17:40:36,376][177119] Fps is (10 sec: 13926.6, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 14839808. Throughput: 0: 3521.3. Samples: 3704132. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:40:36,376][177119] Avg episode reward: [(0, '-0.334')] [2023-02-24 17:40:36,379][177140] Saving new best policy, reward=-0.334! [2023-02-24 17:40:38,262][177153] Updated weights for policy 0, policy_version 3630 (0.0009) [2023-02-24 17:40:41,187][177153] Updated weights for policy 0, policy_version 3640 (0.0008) [2023-02-24 17:40:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 14909440. Throughput: 0: 3519.4. Samples: 3725156. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:40:41,376][177119] Avg episode reward: [(0, '-0.334')] [2023-02-24 17:40:44,136][177153] Updated weights for policy 0, policy_version 3650 (0.0008) [2023-02-24 17:40:46,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 14979072. Throughput: 0: 3516.4. Samples: 3746266. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:40:46,376][177119] Avg episode reward: [(0, '-0.334')] [2023-02-24 17:40:47,050][177153] Updated weights for policy 0, policy_version 3660 (0.0008) [2023-02-24 17:40:48,491][177170] DAMAGECOUNT value on done: 11054.0 [2023-02-24 17:40:48,491][177170] Sum rewards: -0.111, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.820', 'AMMO2': '0.026', 'AMMO5': '0.028', 'ARMOR': '0.032', 'WEAPON1': '0.100', 'AMMO3': '0.110', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'weapon5': '0.202', 'HITCOUNT': '0.250', 'weapon4': '0.270', 'WEAPON3': '0.400', 'WEAPON5': '0.600', 'DAMAGECOUNT': '0.921', 'weapon3': '1.104', 'weapon2': '1.888', 'FRAGCOUNT': '2.000'} [2023-02-24 17:40:48,779][177170] DAMAGECOUNT value on done: 13427.0 [2023-02-24 17:40:48,779][177170] Sum rewards: 4.492, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.134', 'AMMO2': '0.013', 'AMMO5': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.065', 'ARMOR': '0.072', 'WEAPON1': '0.080', 'AMMO3': '0.102', 'HITCOUNT': '0.250', 'weapon5': '0.256', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon3': '1.250', 'DAMAGECOUNT': '1.302', 'weapon2': '2.066', 'FRAGCOUNT': '5.000'} [2023-02-24 17:40:48,794][177170] DAMAGECOUNT value on done: 11029.0 [2023-02-24 17:40:48,794][177170] Sum rewards: -0.372, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.225', 'AMMO5': '0.009', 'AMMO2': '0.017', 'WEAPON1': '0.050', 'weapon4': '0.064', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon5': '0.158', 'WEAPON5': '0.250', 'HITCOUNT': '0.350', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.372', 'DAMAGECOUNT': '1.446', 'weapon2': '1.836'} [2023-02-24 17:40:49,072][177158] DAMAGECOUNT value on done: 12840.0 [2023-02-24 17:40:49,072][177158] Sum rewards: 1.509, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.276', 'AMMO5': '0.007', 'AMMO2': '0.009', 'HITCOUNT': '0.040', 'weapon4': '0.044', 'AMMO4': '0.045', 'AMMO3': '0.049', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'weapon5': '0.204', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.336', 'WEAPON3': '0.350', 'weapon3': '0.704', 'FRAGCOUNT': '1.000', 'weapon2': '1.596'} [2023-02-24 17:40:49,090][177170] DAMAGECOUNT value on done: 12918.0 [2023-02-24 17:40:49,090][177170] Sum rewards: -4.672, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.486', 'AMMO2': '0.008', 'AMMO5': '0.035', 'AMMO4': '0.039', 'ARMOR': '0.080', 'WEAPON1': '0.100', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'weapon5': '0.152', 'HITCOUNT': '0.240', 'weapon4': '0.428', 'WEAPON5': '0.650', 'DAMAGECOUNT': '0.840', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.402', 'weapon2': '1.404'} [2023-02-24 17:40:49,365][177158] DAMAGECOUNT value on done: 10906.0 [2023-02-24 17:40:49,365][177158] Sum rewards: -0.518, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.786', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.022', 'ARMOR': '0.047', 'WEAPON1': '0.080', 'AMMO3': '0.092', 'HITCOUNT': '0.100', 'weapon5': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.284', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.615', 'weapon3': '0.790', 'FRAGCOUNT': '1.000', 'weapon2': '1.834'} [2023-02-24 17:40:49,415][177172] DAMAGECOUNT value on done: 9682.0 [2023-02-24 17:40:49,416][177172] Sum rewards: -2.690, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.590', 'AMMO2': '0.016', 'ARMOR': '0.024', 'AMMO5': '0.025', 'WEAPON1': '0.070', 'AMMO4': '0.082', 'weapon5': '0.108', 'AMMO3': '0.178', 'HITCOUNT': '0.260', 'WEAPON5': '0.400', 'weapon2': '0.818', 'DAMAGECOUNT': '0.975', 'WEAPON3': '1.100', 'FRAGCOUNT': '2.000', 'weapon3': '2.594'} [2023-02-24 17:40:49,627][177154] DAMAGECOUNT value on done: 13015.0 [2023-02-24 17:40:49,627][177154] Sum rewards: -0.609, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.348', 'AMMO5': '0.022', 'AMMO2': '0.026', 'ARMOR': '0.076', 'WEAPON1': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.144', 'weapon5': '0.148', 'HITCOUNT': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.466', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.146', 'weapon2': '1.230', 'weapon3': '1.348', 'FRAGCOUNT': '3.000'} [2023-02-24 17:40:49,666][177158] DAMAGECOUNT value on done: 10977.0 [2023-02-24 17:40:49,666][177158] Sum rewards: -3.721, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.470', 'AMMO2': '0.007', 'AMMO5': '0.020', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'weapon4': '0.056', 'WEAPON1': '0.060', 'AMMO3': '0.145', 'weapon5': '0.148', 'HITCOUNT': '0.240', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.020', 'weapon3': '1.596', 'weapon2': '1.920'} [2023-02-24 17:40:49,715][177172] DAMAGECOUNT value on done: 9990.0 [2023-02-24 17:40:49,716][177172] Sum rewards: -0.789, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.362', 'AMMO2': '0.004', 'ARMOR': '0.016', 'AMMO5': '0.020', 'AMMO4': '0.021', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.100', 'weapon5': '0.174', 'AMMO3': '0.214', 'HITCOUNT': '0.260', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'DAMAGECOUNT': '1.146', 'weapon2': '1.658', 'weapon3': '1.740', 'FRAGCOUNT': '5.000'} [2023-02-24 17:40:49,920][177154] DAMAGECOUNT value on done: 10672.0 [2023-02-24 17:40:49,921][177154] Sum rewards: 1.634, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.469', 'AMMO5': '0.007', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'ARMOR': '0.076', 'AMMO3': '0.077', 'AMMO4': '0.114', 'HITCOUNT': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.180', 'WEAPON5': '0.200', 'weapon4': '0.212', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.612', 'FRAGCOUNT': '1.000', 'weapon3': '1.046', 'weapon2': '2.296'} [2023-02-24 17:40:49,959][177153] Updated weights for policy 0, policy_version 3670 (0.0008) [2023-02-24 17:40:49,963][177158] DAMAGECOUNT value on done: 11015.0 [2023-02-24 17:40:49,964][177158] Sum rewards: 4.876, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.306', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.060', 'AMMO4': '0.063', 'AMMO3': '0.070', 'weapon5': '0.206', 'WEAPON5': '0.300', 'WEAPON3': '0.300', 'HITCOUNT': '0.380', 'weapon3': '0.794', 'DAMAGECOUNT': '2.166', 'weapon2': '2.320', 'FRAGCOUNT': '6.000'} [2023-02-24 17:40:50,213][177154] DAMAGECOUNT value on done: 12457.0 [2023-02-24 17:40:50,213][177154] Sum rewards: -2.800, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.286', 'AMMO2': '0.012', 'AMMO5': '0.025', 'WEAPON1': '0.040', 'weapon5': '0.056', 'AMMO4': '0.061', 'ARMOR': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.179', 'HITCOUNT': '0.330', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'DAMAGECOUNT': '1.140', 'weapon2': '1.454', 'FRAGCOUNT': '2.000', 'weapon3': '2.062'} [2023-02-24 17:40:50,512][177154] DAMAGECOUNT value on done: 11789.0 [2023-02-24 17:40:50,512][177154] Sum rewards: 1.575, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.266', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.007', 'WEAPON1': '0.060', 'AMMO3': '0.077', 'weapon5': '0.166', 'HITCOUNT': '0.230', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'weapon3': '1.042', 'DAMAGECOUNT': '1.206', 'weapon2': '1.592', 'FRAGCOUNT': '2.000'} [2023-02-24 17:40:50,614][177172] DAMAGECOUNT value on done: 10970.0 [2023-02-24 17:40:50,614][177172] Sum rewards: -3.277, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.146', 'AMMO2': '0.016', 'AMMO5': '0.022', 'ARMOR': '0.044', 'AMMO4': '0.079', 'WEAPON1': '0.120', 'AMMO3': '0.162', 'weapon5': '0.166', 'WEAPON4': '0.200', 'HITCOUNT': '0.290', 'weapon4': '0.446', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'DAMAGECOUNT': '0.993', 'weapon3': '1.392', 'weapon2': '1.488', 'FRAGCOUNT': '3.000'} [2023-02-24 17:40:50,637][177171] DAMAGECOUNT value on done: 11858.0 [2023-02-24 17:40:50,638][177171] Sum rewards: 2.291, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.386', 'weapon4': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.031', 'ARMOR': '0.068', 'WEAPON1': '0.070', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'AMMO4': '0.155', 'HITCOUNT': '0.270', 'weapon5': '0.298', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon3': '1.466', 'weapon2': '1.870', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '4.000'} [2023-02-24 17:40:50,907][177172] DAMAGECOUNT value on done: 10460.0 [2023-02-24 17:40:50,907][177172] Sum rewards: 0.696, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.012', 'AMMO2': '0.021', 'WEAPON1': '0.050', 'ARMOR': '0.052', 'AMMO3': '0.079', 'weapon5': '0.096', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'HEALTH': '0.262', 'WEAPON5': '0.300', 'weapon4': '0.334', 'HITCOUNT': '0.390', 'WEAPON3': '0.450', 'weapon3': '0.870', 'DAMAGECOUNT': '1.473', 'weapon2': '2.050', 'FRAGCOUNT': '3.000'} [2023-02-24 17:40:50,941][177171] DAMAGECOUNT value on done: 11062.0 [2023-02-24 17:40:50,942][177171] Sum rewards: -0.231, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.464', 'AMMO5': '0.012', 'AMMO2': '0.013', 'ARMOR': '0.028', 'WEAPON1': '0.050', 'AMMO4': '0.065', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.114', 'weapon5': '0.198', 'WEAPON5': '0.300', 'HITCOUNT': '0.390', 'WEAPON3': '0.650', 'weapon3': '1.458', 'DAMAGECOUNT': '1.650', 'weapon2': '1.930', 'FRAGCOUNT': '2.000'} [2023-02-24 17:40:50,965][177157] DAMAGECOUNT value on done: 12271.0 [2023-02-24 17:40:50,966][177157] Sum rewards: 3.052, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.642', 'AMMO2': '0.012', 'AMMO5': '0.019', 'AMMO4': '0.062', 'WEAPON1': '0.070', 'AMMO3': '0.092', 'weapon5': '0.282', 'WEAPON5': '0.400', 'HITCOUNT': '0.450', 'WEAPON3': '0.600', 'weapon3': '1.372', 'weapon2': '1.686', 'DAMAGECOUNT': '2.148', 'FRAGCOUNT': '4.000'} [2023-02-24 17:40:51,069][177155] DAMAGECOUNT value on done: 10949.0 [2023-02-24 17:40:51,070][177155] Sum rewards: -5.080, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.297', 'AMMO5': '0.010', 'AMMO2': '0.028', 'WEAPON1': '0.050', 'ARMOR': '0.076', 'weapon5': '0.116', 'HITCOUNT': '0.120', 'weapon4': '0.138', 'AMMO4': '0.138', 'AMMO3': '0.167', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon3': '1.546', 'weapon2': '1.568'} [2023-02-24 17:40:51,246][177171] DAMAGECOUNT value on done: 11903.0 [2023-02-24 17:40:51,247][177171] Sum rewards: -1.033, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.100', 'AMMO5': '0.013', 'AMMO2': '0.015', 'ARMOR': '0.040', 'weapon4': '0.052', 'WEAPON1': '0.070', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'HITCOUNT': '0.190', 'weapon5': '0.206', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.624', 'WEAPON3': '0.700', 'weapon3': '1.470', 'weapon2': '1.796', 'FRAGCOUNT': '2.000'} [2023-02-24 17:40:51,264][177157] DAMAGECOUNT value on done: 13252.0 [2023-02-24 17:40:51,273][177157] DAMAGECOUNT value on done: 13046.0 [2023-02-24 17:40:51,274][177157] Sum rewards: -0.421, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.742', 'weapon4': '0.006', 'AMMO2': '0.028', 'AMMO5': '0.042', 'WEAPON4': '0.100', 'AMMO3': '0.125', 'AMMO4': '0.137', 'WEAPON1': '0.140', 'HITCOUNT': '0.270', 'weapon5': '0.276', 'WEAPON3': '0.850', 'WEAPON5': '0.900', 'DAMAGECOUNT': '1.200', 'weapon2': '1.354', 'weapon3': '1.892', 'FRAGCOUNT': '5.000'} [2023-02-24 17:40:51,366][177155] DAMAGECOUNT value on done: 12347.0 [2023-02-24 17:40:51,367][177155] Sum rewards: 2.179, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.101', 'AMMO5': '0.010', 'AMMO2': '0.033', 'WEAPON1': '0.050', 'AMMO3': '0.080', 'ARMOR': '0.120', 'weapon5': '0.128', 'WEAPON4': '0.150', 'AMMO4': '0.165', 'weapon4': '0.184', 'WEAPON5': '0.250', 'HITCOUNT': '0.310', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.065', 'weapon3': '1.490', 'weapon2': '1.744', 'FRAGCOUNT': '2.000'} [2023-02-24 17:40:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14063.0, 300 sec: 14051.4). Total num frames: 15048704. Throughput: 0: 3514.9. Samples: 3756756. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:40:51,376][177119] Avg episode reward: [(0, '-0.394')] [2023-02-24 17:40:51,547][177171] DAMAGECOUNT value on done: 11064.0 [2023-02-24 17:40:51,548][177171] Sum rewards: 3.730, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.242', 'AMMO2': '0.004', 'AMMO5': '0.012', 'AMMO4': '0.019', 'WEAPON1': '0.060', 'ARMOR': '0.060', 'AMMO3': '0.065', 'HITCOUNT': '0.170', 'weapon5': '0.216', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.050', 'weapon3': '1.294', 'FRAGCOUNT': '2.000', 'weapon2': '2.022'} [2023-02-24 17:40:51,565][177157] DAMAGECOUNT value on done: 11309.0 [2023-02-24 17:40:51,565][177157] Sum rewards: 0.551, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.138', 'AMMO5': '0.012', 'AMMO2': '0.025', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.098', 'AMMO4': '0.126', 'AMMO3': '0.131', 'weapon4': '0.174', 'WEAPON5': '0.250', 'HITCOUNT': '0.370', 'WEAPON3': '0.750', 'weapon2': '1.440', 'DAMAGECOUNT': '1.521', 'weapon3': '1.692', 'FRAGCOUNT': '4.000'} [2023-02-24 17:40:51,576][177155] DAMAGECOUNT value on done: 13944.0 [2023-02-24 17:40:51,576][177155] Sum rewards: 5.458, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.966', 'AMMO2': '0.010', 'AMMO5': '0.014', 'AMMO4': '0.048', 'WEAPON1': '0.070', 'ARMOR': '0.080', 'AMMO3': '0.082', 'weapon4': '0.116', 'WEAPON4': '0.150', 'weapon5': '0.192', 'HITCOUNT': '0.270', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon3': '1.320', 'weapon2': '1.662', 'DAMAGECOUNT': '1.710', 'FRAGCOUNT': '5.000'} [2023-02-24 17:40:51,868][177155] DAMAGECOUNT value on done: 11747.0 [2023-02-24 17:40:51,868][177155] Sum rewards: 0.192, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.990', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.010', 'ARMOR': '0.054', 'WEAPON1': '0.060', 'AMMO3': '0.097', 'weapon5': '0.130', 'HITCOUNT': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.260', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.311', 'weapon2': '1.550', 'weapon3': '1.678', 'FRAGCOUNT': '3.000'} [2023-02-24 17:40:52,889][177153] Updated weights for policy 0, policy_version 3680 (0.0009) [2023-02-24 17:40:53,428][177156] DAMAGECOUNT value on done: 11975.0 [2023-02-24 17:40:53,429][177156] Sum rewards: -1.092, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.710', 'AMMO5': '0.027', 'AMMO2': '0.033', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'AMMO3': '0.098', 'AMMO4': '0.165', 'weapon4': '0.178', 'weapon5': '0.226', 'WEAPON4': '0.250', 'HITCOUNT': '0.260', 'WEAPON3': '0.500', 'WEAPON5': '0.550', 'weapon3': '1.036', 'DAMAGECOUNT': '1.137', 'FRAGCOUNT': '2.000', 'weapon2': '2.068'} [2023-02-24 17:40:53,731][177156] DAMAGECOUNT value on done: 12353.0 [2023-02-24 17:40:53,732][177156] Sum rewards: -0.914, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.730', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'AMMO4': '0.065', 'ARMOR': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'HITCOUNT': '0.140', 'WEAPON5': '0.150', 'weapon5': '0.208', 'weapon4': '0.224', 'WEAPON3': '0.500', 'weapon3': '0.980', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.044', 'weapon2': '1.896'} [2023-02-24 17:40:53,890][177156] DAMAGECOUNT value on done: 11252.0 [2023-02-24 17:40:53,891][177156] Sum rewards: -1.137, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.662', 'weapon5': '0.002', 'AMMO5': '0.017', 'AMMO2': '0.030', 'WEAPON1': '0.040', 'AMMO3': '0.125', 'AMMO4': '0.150', 'WEAPON4': '0.150', 'ARMOR': '0.156', 'HITCOUNT': '0.210', 'weapon4': '0.298', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.732', 'WEAPON3': '0.800', 'weapon3': '1.508', 'weapon2': '1.756', 'FRAGCOUNT': '3.000'} [2023-02-24 17:40:54,180][177156] DAMAGECOUNT value on done: 13429.0 [2023-02-24 17:40:54,181][177156] Sum rewards: 0.812, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.334', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'HITCOUNT': '0.110', 'AMMO3': '0.153', 'weapon5': '0.176', 'weapon4': '0.178', 'WEAPON5': '0.300', 'ARMOR': '0.528', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.167', 'weapon3': '1.370', 'weapon2': '1.672', 'FRAGCOUNT': '3.000'} [2023-02-24 17:40:55,792][177153] Updated weights for policy 0, policy_version 3690 (0.0008) [2023-02-24 17:40:56,376][177119] Fps is (10 sec: 14336.1, 60 sec: 14062.9, 300 sec: 14065.2). Total num frames: 15122432. Throughput: 0: 3513.8. Samples: 3777824. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:40:56,376][177119] Avg episode reward: [(0, '-0.269')] [2023-02-24 17:40:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000003692_15122432.pth... [2023-02-24 17:40:56,438][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000002868_11747328.pth [2023-02-24 17:40:56,444][177140] Saving new best policy, reward=-0.269! [2023-02-24 17:40:58,738][177153] Updated weights for policy 0, policy_version 3700 (0.0008) [2023-02-24 17:41:01,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14062.9, 300 sec: 14065.2). Total num frames: 15192064. Throughput: 0: 3511.8. Samples: 3798846. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:41:01,377][177119] Avg episode reward: [(0, '-0.269')] [2023-02-24 17:41:01,635][177153] Updated weights for policy 0, policy_version 3710 (0.0008) [2023-02-24 17:41:04,529][177153] Updated weights for policy 0, policy_version 3720 (0.0009) [2023-02-24 17:41:06,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 15261696. Throughput: 0: 3512.3. Samples: 3809450. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:41:06,376][177119] Avg episode reward: [(0, '-0.269')] [2023-02-24 17:41:07,448][177153] Updated weights for policy 0, policy_version 3730 (0.0008) [2023-02-24 17:41:07,632][177170] DAMAGECOUNT value on done: 11339.0 [2023-02-24 17:41:07,632][177170] Sum rewards: -3.573, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.100', 'AMMO5': '0.017', 'AMMO2': '0.023', 'WEAPON1': '0.060', 'weapon5': '0.062', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.207', 'HITCOUNT': '0.310', 'weapon4': '0.318', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.855', 'WEAPON3': '1.050', 'weapon2': '1.354', 'weapon3': '1.654', 'FRAGCOUNT': '3.000'} [2023-02-24 17:41:07,929][177170] DAMAGECOUNT value on done: 13839.0 [2023-02-24 17:41:07,929][177170] Sum rewards: -3.451, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.964', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.025', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'weapon5': '0.102', 'AMMO3': '0.128', 'weapon4': '0.222', 'HITCOUNT': '0.310', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.236', 'weapon3': '1.514', 'weapon2': '1.718', 'FRAGCOUNT': '3.000'} [2023-02-24 17:41:07,953][177170] DAMAGECOUNT value on done: 11178.0 [2023-02-24 17:41:08,205][177158] DAMAGECOUNT value on done: 12950.0 [2023-02-24 17:41:08,247][177170] DAMAGECOUNT value on done: 13433.0 [2023-02-24 17:41:08,248][177170] Sum rewards: -1.466, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.592', 'AMMO5': '0.010', 'AMMO2': '0.024', 'WEAPON1': '0.060', 'weapon5': '0.070', 'ARMOR': '0.096', 'WEAPON4': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.172', 'weapon4': '0.180', 'WEAPON5': '0.200', 'HITCOUNT': '0.390', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.545', 'weapon3': '1.604', 'weapon2': '1.804', 'FRAGCOUNT': '4.000'} [2023-02-24 17:41:08,505][177158] DAMAGECOUNT value on done: 11155.0 [2023-02-24 17:41:08,506][177158] Sum rewards: 1.211, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.011', 'AMMO5': '0.017', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'WEAPON1': '0.070', 'weapon5': '0.082', 'AMMO3': '0.107', 'weapon4': '0.108', 'HEALTH': '0.150', 'HITCOUNT': '0.220', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.747', 'weapon2': '1.226', 'FRAGCOUNT': '2.000', 'weapon3': '2.078'} [2023-02-24 17:41:08,564][177172] DAMAGECOUNT value on done: 9951.0 [2023-02-24 17:41:08,565][177172] Sum rewards: 0.240, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.532', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.014', 'WEAPON1': '0.040', 'AMMO4': '0.068', 'weapon5': '0.072', 'AMMO3': '0.085', 'HITCOUNT': '0.110', 'weapon4': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.807', 'FRAGCOUNT': '1.000', 'weapon3': '1.192', 'weapon2': '1.548'} [2023-02-24 17:41:08,788][177154] DAMAGECOUNT value on done: 13040.0 [2023-02-24 17:41:08,818][177158] DAMAGECOUNT value on done: 11309.0 [2023-02-24 17:41:08,818][177158] Sum rewards: -1.473, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.544', 'AMMO2': '0.020', 'AMMO5': '0.021', 'WEAPON1': '0.070', 'AMMO4': '0.097', 'AMMO3': '0.115', 'weapon5': '0.154', 'HITCOUNT': '0.290', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.996', 'FRAGCOUNT': '1.000', 'weapon2': '1.648', 'weapon3': '1.810'} [2023-02-24 17:41:08,869][177172] DAMAGECOUNT value on done: 10194.0 [2023-02-24 17:41:08,870][177172] Sum rewards: 1.642, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.740', 'AMMO2': '0.014', 'AMMO5': '0.015', 'AMMO4': '0.068', 'WEAPON1': '0.070', 'AMMO3': '0.083', 'weapon4': '0.086', 'WEAPON4': '0.100', 'weapon5': '0.160', 'HITCOUNT': '0.170', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.612', 'weapon3': '1.314', 'FRAGCOUNT': '2.000', 'weapon2': '2.040'} [2023-02-24 17:41:09,090][177154] DAMAGECOUNT value on done: 11016.0 [2023-02-24 17:41:09,091][177154] Sum rewards: -2.964, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.230', 'AMMO5': '0.019', 'AMMO2': '0.028', 'WEAPON1': '0.060', 'ARMOR': '0.068', 'AMMO3': '0.101', 'weapon5': '0.126', 'AMMO4': '0.138', 'HITCOUNT': '0.240', 'weapon4': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'weapon3': '0.824', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.032', 'weapon2': '2.042'} [2023-02-24 17:41:09,118][177158] DAMAGECOUNT value on done: 11570.0 [2023-02-24 17:41:09,119][177158] Sum rewards: 0.108, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.402', 'AMMO5': '0.020', 'AMMO2': '0.043', 'WEAPON1': '0.070', 'AMMO3': '0.137', 'weapon5': '0.144', 'AMMO4': '0.217', 'HITCOUNT': '0.230', 'weapon4': '0.278', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'weapon2': '1.330', 'weapon3': '1.526', 'DAMAGECOUNT': '1.665', 'FRAGCOUNT': '4.000'} [2023-02-24 17:41:09,340][177154] DAMAGECOUNT value on done: 13190.0 [2023-02-24 17:41:09,340][177154] Sum rewards: 2.414, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.512', 'AMMO2': '0.004', 'AMMO4': '0.019', 'AMMO5': '0.021', 'WEAPON1': '0.060', 'AMMO3': '0.123', 'weapon5': '0.244', 'HITCOUNT': '0.420', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'weapon2': '1.504', 'weapon3': '1.732', 'DAMAGECOUNT': '2.199', 'FRAGCOUNT': '3.000'} [2023-02-24 17:41:09,635][177154] DAMAGECOUNT value on done: 12436.0 [2023-02-24 17:41:09,635][177154] Sum rewards: -1.301, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.744', 'AMMO2': '0.007', 'AMMO5': '0.007', 'weapon4': '0.018', 'ARMOR': '0.032', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'WEAPON1': '0.080', 'AMMO3': '0.146', 'weapon5': '0.176', 'WEAPON5': '0.300', 'HITCOUNT': '0.320', 'WEAPON3': '0.900', 'weapon3': '1.618', 'weapon2': '1.812', 'DAMAGECOUNT': '1.941', 'FRAGCOUNT': '3.000'} [2023-02-24 17:41:09,678][177171] DAMAGECOUNT value on done: 12241.0 [2023-02-24 17:41:09,678][177171] Sum rewards: -2.854, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-0.500', 'ARMOR': '0.024', 'AMMO2': '0.026', 'AMMO5': '0.027', 'AMMO3': '0.072', 'WEAPON1': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.132', 'weapon4': '0.150', 'HEALTH': '0.180', 'HITCOUNT': '0.220', 'weapon5': '0.240', 'WEAPON3': '0.450', 'WEAPON5': '0.600', 'weapon3': '1.026', 'DAMAGECOUNT': '1.149', 'weapon2': '2.160'} [2023-02-24 17:41:09,755][177172] DAMAGECOUNT value on done: 11580.0 [2023-02-24 17:41:09,756][177172] Sum rewards: 1.041, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.050', 'AMMO5': '0.020', 'AMMO2': '0.028', 'ARMOR': '0.052', 'WEAPON1': '0.060', 'weapon4': '0.094', 'AMMO3': '0.130', 'AMMO4': '0.141', 'weapon5': '0.184', 'WEAPON4': '0.200', 'HITCOUNT': '0.300', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon3': '1.430', 'DAMAGECOUNT': '1.830', 'weapon2': '1.872', 'FRAGCOUNT': '5.000'} [2023-02-24 17:41:09,979][177171] DAMAGECOUNT value on done: 11211.0 [2023-02-24 17:41:09,979][177171] Sum rewards: 1.310, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'AMMO3': '0.075', 'HITCOUNT': '0.090', 'WEAPON3': '0.300', 'ARMOR': '0.432', 'DAMAGECOUNT': '0.447', 'HEALTH': '0.539', 'weapon2': '0.930', 'FRAGCOUNT': '1.000', 'weapon3': '1.126'} [2023-02-24 17:41:10,058][177172] DAMAGECOUNT value on done: 10709.0 [2023-02-24 17:41:10,144][177157] DAMAGECOUNT value on done: 13036.0 [2023-02-24 17:41:10,144][177157] Sum rewards: 3.012, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.461', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.022', 'WEAPON1': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'weapon5': '0.218', 'weapon4': '0.280', 'HITCOUNT': '0.350', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'weapon2': '1.032', 'weapon3': '1.632', 'DAMAGECOUNT': '2.295', 'FRAGCOUNT': '3.000'} [2023-02-24 17:41:10,242][177155] DAMAGECOUNT value on done: 11174.0 [2023-02-24 17:41:10,242][177155] Sum rewards: 0.457, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.870', 'AMMO2': '0.013', 'AMMO5': '0.015', 'ARMOR': '0.032', 'WEAPON1': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'weapon4': '0.138', 'HITCOUNT': '0.140', 'weapon5': '0.176', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.675', 'FRAGCOUNT': '1.000', 'weapon2': '1.232', 'weapon3': '1.322'} [2023-02-24 17:41:10,292][177171] DAMAGECOUNT value on done: 12236.0 [2023-02-24 17:41:10,293][177171] Sum rewards: 1.886, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.170', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'AMMO3': '0.060', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'HITCOUNT': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.176', 'weapon4': '0.182', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.969', 'FRAGCOUNT': '1.000', 'weapon3': '1.456', 'weapon2': '1.826'} [2023-02-24 17:41:10,404][177153] Updated weights for policy 0, policy_version 3740 (0.0008) [2023-02-24 17:41:10,442][177157] DAMAGECOUNT value on done: 13841.0 [2023-02-24 17:41:10,442][177157] Sum rewards: -0.284, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.396', 'AMMO2': '0.015', 'AMMO5': '0.025', 'ARMOR': '0.056', 'AMMO4': '0.074', 'WEAPON1': '0.080', 'AMMO3': '0.105', 'weapon4': '0.134', 'WEAPON4': '0.150', 'weapon5': '0.214', 'HITCOUNT': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon2': '1.436', 'weapon3': '1.606', 'DAMAGECOUNT': '1.767', 'FRAGCOUNT': '2.000'} [2023-02-24 17:41:10,452][177157] DAMAGECOUNT value on done: 13276.0 [2023-02-24 17:41:10,452][177157] Sum rewards: -0.303, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.375', 'AMMO2': '0.016', 'AMMO5': '0.024', 'ARMOR': '0.072', 'AMMO4': '0.077', 'WEAPON1': '0.100', 'AMMO3': '0.105', 'weapon5': '0.200', 'HITCOUNT': '0.210', 'WEAPON5': '0.600', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.690', 'weapon3': '1.202', 'weapon2': '1.876', 'FRAGCOUNT': '2.000'} [2023-02-24 17:41:10,537][177155] DAMAGECOUNT value on done: 12500.0 [2023-02-24 17:41:10,592][177171] DAMAGECOUNT value on done: 11094.0 [2023-02-24 17:41:10,726][177155] DAMAGECOUNT value on done: 14278.0 [2023-02-24 17:41:10,726][177155] Sum rewards: 0.161, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.624', 'AMMO2': '0.015', 'AMMO5': '0.015', 'WEAPON1': '0.070', 'AMMO4': '0.076', 'AMMO3': '0.108', 'HITCOUNT': '0.120', 'WEAPON4': '0.200', 'weapon5': '0.218', 'weapon4': '0.354', 'WEAPON5': '0.400', 'ARMOR': '0.454', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.002', 'weapon2': '1.170', 'weapon3': '1.382', 'FRAGCOUNT': '3.000'} [2023-02-24 17:41:10,748][177157] DAMAGECOUNT value on done: 12342.0 [2023-02-24 17:41:10,748][177157] Sum rewards: 5.747, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.735', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.040', 'AMMO4': '0.050', 'AMMO3': '0.120', 'weapon5': '0.160', 'WEAPON5': '0.200', 'HITCOUNT': '0.420', 'WEAPON3': '0.750', 'weapon2': '1.476', 'weapon3': '1.900', 'DAMAGECOUNT': '3.099', 'FRAGCOUNT': '6.000'} [2023-02-24 17:41:11,017][177155] DAMAGECOUNT value on done: 11897.0 [2023-02-24 17:41:11,017][177155] Sum rewards: 0.127, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.432', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON1': '0.060', 'ARMOR': '0.072', 'HITCOUNT': '0.090', 'AMMO4': '0.091', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'weapon4': '0.140', 'weapon5': '0.194', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.302', 'weapon2': '1.442'} [2023-02-24 17:41:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 15331328. Throughput: 0: 3504.7. Samples: 3830384. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 17:41:11,376][177119] Avg episode reward: [(0, '-0.162')] [2023-02-24 17:41:11,377][177140] Saving new best policy, reward=-0.162! [2023-02-24 17:41:12,657][177156] DAMAGECOUNT value on done: 12130.0 [2023-02-24 17:41:12,657][177156] Sum rewards: -0.344, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.894', 'AMMO5': '0.019', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'AMMO3': '0.067', 'ARMOR': '0.072', 'HITCOUNT': '0.120', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'weapon5': '0.150', 'weapon4': '0.344', 'WEAPON3': '0.350', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.465', 'weapon3': '0.922', 'FRAGCOUNT': '1.000', 'weapon2': '2.284'} [2023-02-24 17:41:12,960][177156] DAMAGECOUNT value on done: 12700.0 [2023-02-24 17:41:12,960][177156] Sum rewards: 3.456, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.221', 'AMMO5': '0.014', 'AMMO2': '0.026', 'ARMOR': '0.042', 'WEAPON1': '0.070', 'AMMO3': '0.089', 'weapon4': '0.128', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'weapon5': '0.154', 'HITCOUNT': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'weapon3': '0.822', 'DAMAGECOUNT': '1.041', 'weapon2': '2.312', 'FRAGCOUNT': '3.000'} [2023-02-24 17:41:13,127][177156] DAMAGECOUNT value on done: 11826.0 [2023-02-24 17:41:13,128][177156] Sum rewards: -0.089, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.764', 'AMMO5': '0.022', 'ARMOR': '0.032', 'AMMO2': '0.036', 'weapon4': '0.048', 'WEAPON1': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.110', 'AMMO3': '0.151', 'AMMO4': '0.178', 'HITCOUNT': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'weapon2': '1.212', 'DAMAGECOUNT': '1.722', 'weapon3': '2.074', 'FRAGCOUNT': '3.000'} [2023-02-24 17:41:13,315][177153] Updated weights for policy 0, policy_version 3750 (0.0009) [2023-02-24 17:41:13,429][177156] DAMAGECOUNT value on done: 13866.0 [2023-02-24 17:41:13,429][177156] Sum rewards: -0.373, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.432', 'AMMO2': '0.004', 'AMMO4': '0.019', 'AMMO5': '0.025', 'ARMOR': '0.036', 'WEAPON1': '0.110', 'AMMO3': '0.172', 'weapon5': '0.218', 'HITCOUNT': '0.300', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.311', 'weapon3': '1.526', 'weapon2': '1.788', 'FRAGCOUNT': '4.000'} [2023-02-24 17:41:16,197][177153] Updated weights for policy 0, policy_version 3760 (0.0008) [2023-02-24 17:41:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 15400960. Throughput: 0: 3509.2. Samples: 3851592. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:41:16,376][177119] Avg episode reward: [(0, '-0.082')] [2023-02-24 17:41:16,380][177140] Saving new best policy, reward=-0.082! [2023-02-24 17:41:19,115][177153] Updated weights for policy 0, policy_version 3770 (0.0008) [2023-02-24 17:41:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14051.4). Total num frames: 15470592. Throughput: 0: 3510.9. Samples: 3862122. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:41:21,376][177119] Avg episode reward: [(0, '-0.082')] [2023-02-24 17:41:22,026][177153] Updated weights for policy 0, policy_version 3780 (0.0008) [2023-02-24 17:41:24,913][177153] Updated weights for policy 0, policy_version 3790 (0.0008) [2023-02-24 17:41:26,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13994.7, 300 sec: 14051.4). Total num frames: 15540224. Throughput: 0: 3512.6. Samples: 3883222. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 17:41:26,376][177119] Avg episode reward: [(0, '-0.082')] [2023-02-24 17:41:26,750][177170] DAMAGECOUNT value on done: 11982.0 [2023-02-24 17:41:26,750][177170] Sum rewards: 2.183, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.702', 'AMMO2': '0.009', 'AMMO5': '0.021', 'AMMO4': '0.046', 'WEAPON1': '0.090', 'AMMO3': '0.123', 'HITCOUNT': '0.290', 'weapon5': '0.322', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'weapon2': '1.508', 'weapon3': '1.696', 'DAMAGECOUNT': '1.929', 'FRAGCOUNT': '7.000'} [2023-02-24 17:41:27,047][177170] DAMAGECOUNT value on done: 14214.0 [2023-02-24 17:41:27,048][177170] Sum rewards: -5.885, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.398', 'AMMO2': '0.015', 'AMMO5': '0.027', 'AMMO4': '0.076', 'WEAPON1': '0.110', 'weapon5': '0.190', 'AMMO3': '0.191', 'HITCOUNT': '0.310', 'WEAPON5': '0.550', 'weapon2': '1.098', 'WEAPON3': '1.100', 'DAMAGECOUNT': '1.125', 'FRAGCOUNT': '2.000', 'weapon3': '2.220'} [2023-02-24 17:41:27,067][177170] DAMAGECOUNT value on done: 11656.0 [2023-02-24 17:41:27,068][177170] Sum rewards: 2.009, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.756', 'AMMO5': '0.013', 'AMMO2': '0.014', 'weapon4': '0.042', 'WEAPON1': '0.050', 'AMMO3': '0.066', 'AMMO4': '0.071', 'weapon5': '0.076', 'WEAPON4': '0.100', 'HITCOUNT': '0.260', 'WEAPON5': '0.300', 'ARMOR': '0.455', 'WEAPON3': '0.500', 'weapon2': '1.166', 'DAMAGECOUNT': '1.434', 'weapon3': '1.468', 'FRAGCOUNT': '2.000'} [2023-02-24 17:41:27,343][177158] DAMAGECOUNT value on done: 13274.0 [2023-02-24 17:41:27,343][177158] Sum rewards: 5.849, reward structure: {'DEATHCOUNT': '-5.250', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO3': '0.060', 'WEAPON1': '0.060', 'weapon7': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'weapon5': '0.194', 'WEAPON7': '0.200', 'weapon4': '0.296', 'WEAPON5': '0.300', 'HITCOUNT': '0.320', 'WEAPON3': '0.350', 'HEALTH': '0.817', 'DAMAGECOUNT': '0.972', 'weapon3': '0.972', 'weapon2': '1.914', 'FRAGCOUNT': '4.000'} [2023-02-24 17:41:27,368][177170] DAMAGECOUNT value on done: 14431.0 [2023-02-24 17:41:27,369][177170] Sum rewards: 9.505, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.678', 'AMMO5': '0.017', 'AMMO2': '0.025', 'AMMO3': '0.088', 'WEAPON1': '0.120', 'AMMO4': '0.122', 'weapon5': '0.314', 'WEAPON3': '0.500', 'HITCOUNT': '0.530', 'WEAPON5': '0.600', 'weapon3': '1.400', 'weapon2': '1.972', 'DAMAGECOUNT': '2.994', 'FRAGCOUNT': '6.000'} [2023-02-24 17:41:27,632][177172] DAMAGECOUNT value on done: 10811.0 [2023-02-24 17:41:27,632][177172] Sum rewards: 2.911, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.602', 'AMMO5': '0.020', 'AMMO2': '0.028', 'WEAPON1': '0.080', 'AMMO3': '0.087', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'weapon5': '0.228', 'weapon4': '0.274', 'HITCOUNT': '0.430', 'ARMOR': '0.461', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'weapon2': '1.080', 'weapon3': '1.806', 'FRAGCOUNT': '2.500', 'DAMAGECOUNT': '2.580'} [2023-02-24 17:41:27,641][177158] DAMAGECOUNT value on done: 11563.0 [2023-02-24 17:41:27,642][177158] Sum rewards: 0.497, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.590', 'weapon7': '0.002', 'AMMO2': '0.007', 'AMMO5': '0.017', 'AMMO4': '0.035', 'ARMOR': '0.060', 'WEAPON1': '0.080', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.131', 'weapon5': '0.202', 'HITCOUNT': '0.230', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'weapon3': '0.872', 'DAMAGECOUNT': '1.224', 'weapon2': '2.026', 'FRAGCOUNT': '4.000'} [2023-02-24 17:41:27,848][177153] Updated weights for policy 0, policy_version 3800 (0.0008) [2023-02-24 17:41:27,919][177154] DAMAGECOUNT value on done: 13274.0 [2023-02-24 17:41:27,936][177158] DAMAGECOUNT value on done: 12047.0 [2023-02-24 17:41:27,937][177158] Sum rewards: 5.906, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.996', 'AMMO2': '0.015', 'AMMO5': '0.019', 'ARMOR': '0.032', 'AMMO4': '0.075', 'AMMO3': '0.104', 'WEAPON1': '0.120', 'weapon5': '0.260', 'HITCOUNT': '0.410', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'weapon3': '1.326', 'weapon2': '1.426', 'DAMAGECOUNT': '2.214', 'FRAGCOUNT': '5.000'} [2023-02-24 17:41:27,938][177172] DAMAGECOUNT value on done: 10405.0 [2023-02-24 17:41:27,939][177172] Sum rewards: 0.510, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.004', 'AMMO5': '0.012', 'HEALTH': '0.016', 'AMMO4': '0.022', 'WEAPON1': '0.070', 'HITCOUNT': '0.070', 'AMMO3': '0.079', 'WEAPON3': '0.300', 'weapon5': '0.308', 'WEAPON5': '0.350', 'ARMOR': '0.436', 'DAMAGECOUNT': '0.633', 'weapon3': '0.692', 'weapon2': '1.516', 'FRAGCOUNT': '2.000'} [2023-02-24 17:41:28,216][177154] DAMAGECOUNT value on done: 11130.0 [2023-02-24 17:41:28,234][177158] DAMAGECOUNT value on done: 12199.0 [2023-02-24 17:41:28,235][177158] Sum rewards: 1.856, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.877', 'AMMO2': '0.011', 'AMMO5': '0.023', 'ARMOR': '0.040', 'AMMO4': '0.053', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO3': '0.119', 'weapon5': '0.188', 'HITCOUNT': '0.230', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'weapon3': '1.556', 'weapon2': '1.662', 'DAMAGECOUNT': '1.887', 'FRAGCOUNT': '3.000'} [2023-02-24 17:41:28,450][177154] DAMAGECOUNT value on done: 13534.0 [2023-02-24 17:41:28,747][177154] DAMAGECOUNT value on done: 13210.0 [2023-02-24 17:41:28,747][177154] Sum rewards: -0.264, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.115', 'AMMO2': '0.015', 'AMMO5': '0.027', 'AMMO4': '0.073', 'WEAPON1': '0.080', 'AMMO3': '0.086', 'weapon5': '0.294', 'HITCOUNT': '0.430', 'WEAPON3': '0.550', 'WEAPON5': '0.650', 'weapon3': '1.362', 'weapon2': '1.962', 'DAMAGECOUNT': '2.322', 'FRAGCOUNT': '2.500'} [2023-02-24 17:41:28,795][177172] DAMAGECOUNT value on done: 12347.0 [2023-02-24 17:41:28,795][177172] Sum rewards: -2.320, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.456', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'ARMOR': '0.008', 'AMMO5': '0.022', 'WEAPON1': '0.050', 'AMMO3': '0.192', 'weapon5': '0.198', 'HITCOUNT': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'weapon3': '1.340', 'weapon2': '2.132', 'DAMAGECOUNT': '2.301', 'FRAGCOUNT': '2.500'} [2023-02-24 17:41:28,815][177171] DAMAGECOUNT value on done: 12703.0 [2023-02-24 17:41:28,816][177171] Sum rewards: 0.231, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.812', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.019', 'WEAPON1': '0.070', 'AMMO3': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'weapon5': '0.112', 'WEAPON4': '0.200', 'WEAPON6': '0.200', 'weapon6': '0.270', 'HITCOUNT': '0.330', 'WEAPON5': '0.350', 'weapon4': '0.428', 'WEAPON3': '0.600', 'weapon2': '1.056', 'DAMAGECOUNT': '1.386', 'weapon3': '1.506', 'FRAGCOUNT': '2.000'} [2023-02-24 17:41:29,094][177172] DAMAGECOUNT value on done: 11191.0 [2023-02-24 17:41:29,094][177172] Sum rewards: 3.081, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.328', 'ARMOR': '0.020', 'AMMO5': '0.027', 'AMMO2': '0.027', 'WEAPON1': '0.060', 'weapon4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'AMMO4': '0.136', 'HITCOUNT': '0.190', 'weapon5': '0.228', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'weapon3': '1.426', 'DAMAGECOUNT': '1.446', 'weapon2': '1.920', 'FRAGCOUNT': '5.000'} [2023-02-24 17:41:29,112][177171] DAMAGECOUNT value on done: 11586.0 [2023-02-24 17:41:29,112][177171] Sum rewards: -0.021, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.021', 'AMMO2': '0.030', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.064', 'AMMO3': '0.086', 'HITCOUNT': '0.140', 'AMMO4': '0.148', 'weapon5': '0.326', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'FRAGCOUNT': '0.500', 'HEALTH': '1.000', 'DAMAGECOUNT': '1.125', 'weapon3': '1.266', 'weapon2': '1.832'} [2023-02-24 17:41:29,222][177157] DAMAGECOUNT value on done: 13345.0 [2023-02-24 17:41:29,222][177157] Sum rewards: -1.266, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.870', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'ARMOR': '0.028', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon5': '0.060', 'weapon4': '0.120', 'AMMO3': '0.131', 'WEAPON5': '0.150', 'HITCOUNT': '0.230', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.927', 'weapon3': '1.534', 'weapon2': '1.770', 'FRAGCOUNT': '3.000'} [2023-02-24 17:41:29,295][177155] DAMAGECOUNT value on done: 11682.0 [2023-02-24 17:41:29,296][177155] Sum rewards: -1.462, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.256', 'AMMO2': '0.025', 'AMMO5': '0.029', 'WEAPON1': '0.100', 'ARMOR': '0.120', 'AMMO4': '0.124', 'weapon4': '0.150', 'AMMO3': '0.162', 'weapon5': '0.248', 'WEAPON4': '0.250', 'HITCOUNT': '0.370', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'weapon2': '1.382', 'DAMAGECOUNT': '1.524', 'weapon3': '1.610', 'FRAGCOUNT': '3.500'} [2023-02-24 17:41:29,417][177171] DAMAGECOUNT value on done: 12449.0 [2023-02-24 17:41:29,418][177171] Sum rewards: 0.365, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.629', 'AMMO2': '0.024', 'AMMO5': '0.024', 'weapon4': '0.038', 'WEAPON4': '0.050', 'AMMO3': '0.068', 'HITCOUNT': '0.070', 'WEAPON1': '0.090', 'AMMO4': '0.120', 'weapon5': '0.354', 'WEAPON3': '0.450', 'WEAPON5': '0.600', 'DAMAGECOUNT': '0.639', 'weapon3': '1.206', 'FRAGCOUNT': '2.000', 'weapon2': '2.010'} [2023-02-24 17:41:29,516][177157] DAMAGECOUNT value on done: 14216.0 [2023-02-24 17:41:29,516][177157] Sum rewards: 1.098, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.066', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'AMMO4': '0.095', 'weapon4': '0.108', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'weapon5': '0.184', 'WEAPON5': '0.250', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.125', 'weapon3': '1.312', 'weapon2': '2.056', 'FRAGCOUNT': '4.000'} [2023-02-24 17:41:29,525][177157] DAMAGECOUNT value on done: 13894.0 [2023-02-24 17:41:29,526][177157] Sum rewards: 3.758, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.162', 'AMMO5': '0.012', 'AMMO2': '0.017', 'weapon4': '0.032', 'WEAPON4': '0.050', 'ARMOR': '0.057', 'WEAPON1': '0.070', 'AMMO4': '0.083', 'AMMO3': '0.105', 'weapon5': '0.276', 'HITCOUNT': '0.280', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'weapon2': '1.500', 'weapon3': '1.834', 'DAMAGECOUNT': '1.854', 'FRAGCOUNT': '5.000'} [2023-02-24 17:41:29,591][177155] DAMAGECOUNT value on done: 12969.0 [2023-02-24 17:41:29,592][177155] Sum rewards: 4.254, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.014', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'weapon4': '0.040', 'AMMO3': '0.077', 'ARMOR': '0.096', 'HEALTH': '0.113', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'weapon5': '0.200', 'HITCOUNT': '0.230', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'weapon3': '0.874', 'DAMAGECOUNT': '1.407', 'weapon2': '2.114', 'FRAGCOUNT': '4.000'} [2023-02-24 17:41:29,709][177171] DAMAGECOUNT value on done: 11812.0 [2023-02-24 17:41:29,710][177171] Sum rewards: 1.635, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.986', 'AMMO2': '0.012', 'AMMO5': '0.018', 'weapon4': '0.038', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'WEAPON1': '0.090', 'ARMOR': '0.096', 'AMMO3': '0.099', 'weapon5': '0.252', 'HITCOUNT': '0.370', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'weapon3': '1.468', 'weapon2': '1.766', 'DAMAGECOUNT': '2.154', 'FRAGCOUNT': '4.000'} [2023-02-24 17:41:29,747][177155] DAMAGECOUNT value on done: 14685.0 [2023-02-24 17:41:29,748][177155] Sum rewards: 1.430, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.534', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO3': '0.090', 'weapon5': '0.198', 'WEAPON5': '0.250', 'HITCOUNT': '0.320', 'WEAPON3': '0.500', 'weapon2': '1.216', 'DAMAGECOUNT': '1.221', 'FRAGCOUNT': '1.500', 'weapon3': '1.876'} [2023-02-24 17:41:29,819][177157] DAMAGECOUNT value on done: 12775.0 [2023-02-24 17:41:29,819][177157] Sum rewards: 3.338, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.015', 'WEAPON1': '0.040', 'HEALTH': '0.050', 'weapon4': '0.054', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'HITCOUNT': '0.230', 'weapon5': '0.238', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.299', 'weapon2': '1.300', 'weapon3': '1.370', 'FRAGCOUNT': '3.000'} [2023-02-24 17:41:30,049][177155] DAMAGECOUNT value on done: 12052.0 [2023-02-24 17:41:30,784][177153] Updated weights for policy 0, policy_version 3810 (0.0008) [2023-02-24 17:41:31,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14062.9, 300 sec: 14065.3). Total num frames: 15613952. Throughput: 0: 3511.4. Samples: 3904280. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:41:31,376][177119] Avg episode reward: [(0, '0.179')] [2023-02-24 17:41:31,377][177140] Saving new best policy, reward=0.179! [2023-02-24 17:41:31,854][177156] DAMAGECOUNT value on done: 12352.0 [2023-02-24 17:41:31,855][177156] Sum rewards: -2.772, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.644', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.035', 'WEAPON1': '0.050', 'AMMO3': '0.101', 'weapon5': '0.176', 'AMMO4': '0.177', 'HITCOUNT': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.392', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.666', 'FRAGCOUNT': '1.000', 'weapon3': '1.348', 'weapon2': '1.616'} [2023-02-24 17:41:32,150][177156] DAMAGECOUNT value on done: 13111.0 [2023-02-24 17:41:32,151][177156] Sum rewards: 1.872, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.426', 'ARMOR': '0.008', 'AMMO2': '0.011', 'AMMO5': '0.012', 'AMMO4': '0.053', 'WEAPON1': '0.070', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'weapon5': '0.204', 'HITCOUNT': '0.280', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'weapon3': '1.182', 'DAMAGECOUNT': '1.233', 'weapon2': '1.956', 'FRAGCOUNT': '4.000'} [2023-02-24 17:41:32,328][177156] DAMAGECOUNT value on done: 12188.0 [2023-02-24 17:41:32,328][177156] Sum rewards: -1.006, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.622', 'AMMO2': '0.013', 'AMMO5': '0.014', 'AMMO4': '0.065', 'WEAPON1': '0.070', 'ARMOR': '0.080', 'weapon5': '0.082', 'weapon4': '0.112', 'AMMO3': '0.121', 'WEAPON4': '0.200', 'HITCOUNT': '0.220', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.086', 'FRAGCOUNT': '1.500', 'weapon3': '1.586', 'weapon2': '1.666'} [2023-02-24 17:41:32,618][177156] DAMAGECOUNT value on done: 14585.0 [2023-02-24 17:41:32,619][177156] Sum rewards: 4.004, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.268', 'AMMO2': '0.016', 'AMMO5': '0.017', 'ARMOR': '0.044', 'WEAPON1': '0.070', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.161', 'weapon5': '0.176', 'weapon4': '0.236', 'HITCOUNT': '0.390', 'WEAPON5': '0.400', 'WEAPON3': '0.950', 'weapon2': '1.402', 'weapon3': '1.822', 'DAMAGECOUNT': '2.157', 'FRAGCOUNT': '7.000'} [2023-02-24 17:41:33,689][177153] Updated weights for policy 0, policy_version 3820 (0.0008) [2023-02-24 17:41:35,867][177171] Large shaping reward 2.564 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.543, 181.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 17:41:36,376][177119] Fps is (10 sec: 14335.9, 60 sec: 14062.9, 300 sec: 14065.2). Total num frames: 15683584. Throughput: 0: 3512.9. Samples: 3914836. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:41:36,376][177119] Avg episode reward: [(0, '0.148')] [2023-02-24 17:41:36,584][177153] Updated weights for policy 0, policy_version 3830 (0.0008) [2023-02-24 17:41:39,508][177153] Updated weights for policy 0, policy_version 3840 (0.0009) [2023-02-24 17:41:41,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 15753216. Throughput: 0: 3513.1. Samples: 3935914. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:41:41,376][177119] Avg episode reward: [(0, '0.148')] [2023-02-24 17:41:42,392][177153] Updated weights for policy 0, policy_version 3850 (0.0008) [2023-02-24 17:41:45,310][177153] Updated weights for policy 0, policy_version 3860 (0.0008) [2023-02-24 17:41:45,912][177170] DAMAGECOUNT value on done: 12601.0 [2023-02-24 17:41:45,912][177170] Sum rewards: 0.720, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.246', 'AMMO5': '0.012', 'AMMO2': '0.020', 'WEAPON1': '0.070', 'ARMOR': '0.076', 'AMMO4': '0.098', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'HITCOUNT': '0.240', 'weapon5': '0.272', 'WEAPON5': '0.300', 'weapon4': '0.308', 'WEAPON3': '0.550', 'weapon3': '1.012', 'DAMAGECOUNT': '1.857', 'weapon2': '1.882', 'FRAGCOUNT': '3.000'} [2023-02-24 17:41:46,208][177170] DAMAGECOUNT value on done: 14419.0 [2023-02-24 17:41:46,208][177170] Sum rewards: -0.694, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.420', 'AMMO5': '0.011', 'AMMO2': '0.022', 'ARMOR': '0.072', 'weapon4': '0.084', 'WEAPON1': '0.090', 'AMMO3': '0.095', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'weapon5': '0.210', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.615', 'weapon3': '0.964', 'FRAGCOUNT': '1.000', 'weapon2': '2.092'} [2023-02-24 17:41:46,230][177170] DAMAGECOUNT value on done: 11866.0 [2023-02-24 17:41:46,230][177170] Sum rewards: 1.369, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.920', 'AMMO2': '0.005', 'AMMO5': '0.015', 'AMMO4': '0.025', 'AMMO3': '0.065', 'WEAPON1': '0.090', 'WEAPON4': '0.100', 'HITCOUNT': '0.200', 'weapon4': '0.236', 'weapon5': '0.240', 'WEAPON3': '0.400', 'WEAPON5': '0.450', 'DAMAGECOUNT': '0.630', 'weapon3': '1.294', 'weapon2': '1.788', 'FRAGCOUNT': '2.000'} [2023-02-24 17:41:46,376][177119] Fps is (10 sec: 13926.5, 60 sec: 14063.0, 300 sec: 14051.4). Total num frames: 15822848. Throughput: 0: 3513.1. Samples: 3956936. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:41:46,376][177119] Avg episode reward: [(0, '0.167')] [2023-02-24 17:41:46,407][177158] DAMAGECOUNT value on done: 13606.0 [2023-02-24 17:41:46,525][177170] DAMAGECOUNT value on done: 15015.0 [2023-02-24 17:41:46,526][177170] Sum rewards: -3.843, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.588', 'AMMO2': '0.016', 'AMMO5': '0.025', 'WEAPON1': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.096', 'weapon5': '0.228', 'WEAPON4': '0.300', 'HITCOUNT': '0.370', 'weapon4': '0.402', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.082', 'weapon3': '1.446', 'DAMAGECOUNT': '1.752'} [2023-02-24 17:41:46,708][177158] DAMAGECOUNT value on done: 11838.0 [2023-02-24 17:41:46,708][177158] Sum rewards: 1.714, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.501', 'AMMO2': '0.014', 'AMMO5': '0.015', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'AMMO3': '0.055', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'weapon4': '0.254', 'HITCOUNT': '0.270', 'weapon5': '0.292', 'WEAPON5': '0.350', 'WEAPON3': '0.350', 'weapon3': '0.824', 'DAMAGECOUNT': '0.825', 'weapon2': '1.954', 'FRAGCOUNT': '2.000'} [2023-02-24 17:41:46,763][177172] DAMAGECOUNT value on done: 11068.0 [2023-02-24 17:41:46,763][177172] Sum rewards: -3.382, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.418', 'AMMO2': '0.016', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.081', 'WEAPON1': '0.110', 'AMMO3': '0.144', 'weapon5': '0.196', 'weapon4': '0.268', 'HITCOUNT': '0.270', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.771', 'weapon3': '1.200', 'weapon2': '1.462', 'FRAGCOUNT': '2.000'} [2023-02-24 17:41:46,988][177154] DAMAGECOUNT value on done: 13844.0 [2023-02-24 17:41:46,988][177154] Sum rewards: -3.413, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.082', 'AMMO5': '0.024', 'AMMO2': '0.026', 'WEAPON1': '0.090', 'weapon4': '0.090', 'ARMOR': '0.112', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'weapon5': '0.168', 'AMMO3': '0.212', 'HITCOUNT': '0.270', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'weapon3': '1.306', 'weapon2': '1.630', 'DAMAGECOUNT': '1.710', 'FRAGCOUNT': '3.000'} [2023-02-24 17:41:46,994][177158] DAMAGECOUNT value on done: 12561.0 [2023-02-24 17:41:46,994][177158] Sum rewards: -1.864, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.870', 'AMMO5': '0.017', 'AMMO2': '0.020', 'ARMOR': '0.049', 'WEAPON1': '0.080', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO4': '0.100', 'AMMO3': '0.105', 'weapon5': '0.186', 'HITCOUNT': '0.290', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon3': '0.992', 'DAMAGECOUNT': '1.542', 'weapon2': '1.980', 'FRAGCOUNT': '3.000'} [2023-02-24 17:41:47,070][177172] DAMAGECOUNT value on done: 10946.0 [2023-02-24 17:41:47,070][177172] Sum rewards: -2.510, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.072', 'AMMO5': '0.019', 'AMMO2': '0.030', 'ARMOR': '0.044', 'WEAPON4': '0.050', 'WEAPON1': '0.080', 'weapon4': '0.140', 'AMMO3': '0.144', 'AMMO4': '0.148', 'weapon5': '0.290', 'HITCOUNT': '0.380', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'weapon2': '1.276', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.623', 'weapon3': '1.788'} [2023-02-24 17:41:47,281][177158] DAMAGECOUNT value on done: 12691.0 [2023-02-24 17:41:47,281][177158] Sum rewards: 4.961, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.561', 'AMMO5': '0.020', 'AMMO2': '0.021', 'WEAPON1': '0.060', 'AMMO3': '0.082', 'HITCOUNT': '0.100', 'AMMO4': '0.103', 'weapon7': '0.150', 'WEAPON4': '0.200', 'weapon5': '0.210', 'weapon4': '0.244', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'ARMOR': '0.460', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon2': '1.092', 'weapon3': '1.414', 'DAMAGECOUNT': '1.476', 'FRAGCOUNT': '4.000'} [2023-02-24 17:41:47,286][177154] DAMAGECOUNT value on done: 11798.0 [2023-02-24 17:41:47,287][177154] Sum rewards: 3.328, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.984', 'AMMO5': '0.018', 'weapon4': '0.026', 'AMMO2': '0.030', 'ARMOR': '0.044', 'WEAPON4': '0.050', 'AMMO3': '0.089', 'WEAPON1': '0.120', 'AMMO4': '0.150', 'HITCOUNT': '0.190', 'weapon5': '0.282', 'WEAPON3': '0.450', 'WEAPON5': '0.500', 'weapon3': '0.936', 'DAMAGECOUNT': '2.004', 'weapon2': '2.172', 'FRAGCOUNT': '4.000'} [2023-02-24 17:41:47,501][177154] DAMAGECOUNT value on done: 13853.0 [2023-02-24 17:41:47,502][177154] Sum rewards: 0.862, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.367', 'AMMO2': '0.016', 'AMMO5': '0.022', 'ARMOR': '0.048', 'weapon7': '0.072', 'AMMO3': '0.074', 'AMMO4': '0.079', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON1': '0.100', 'HITCOUNT': '0.190', 'weapon5': '0.204', 'WEAPON3': '0.500', 'WEAPON5': '0.650', 'DAMAGECOUNT': '0.957', 'weapon3': '1.228', 'weapon2': '1.788', 'FRAGCOUNT': '2.000'} [2023-02-24 17:41:47,801][177154] DAMAGECOUNT value on done: 13647.0 [2023-02-24 17:41:47,801][177154] Sum rewards: 3.493, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.768', 'AMMO2': '0.008', 'AMMO5': '0.010', 'ARMOR': '0.036', 'AMMO4': '0.041', 'WEAPON1': '0.070', 'AMMO3': '0.074', 'WEAPON4': '0.100', 'weapon4': '0.204', 'weapon5': '0.252', 'HITCOUNT': '0.330', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'weapon3': '1.228', 'DAMAGECOUNT': '1.311', 'weapon2': '1.746', 'FRAGCOUNT': '4.000'} [2023-02-24 17:41:47,926][177172] DAMAGECOUNT value on done: 12826.0 [2023-02-24 17:41:47,927][177172] Sum rewards: 3.684, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.648', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.014', 'AMMO3': '0.072', 'WEAPON1': '0.080', 'ARMOR': '0.080', 'weapon5': '0.198', 'HITCOUNT': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.437', 'weapon2': '1.450', 'weapon3': '1.586', 'FRAGCOUNT': '5.000'} [2023-02-24 17:41:47,989][177171] DAMAGECOUNT value on done: 12933.0 [2023-02-24 17:41:47,989][177171] Sum rewards: -1.110, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.002', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.014', 'ARMOR': '0.020', 'WEAPON1': '0.070', 'AMMO3': '0.077', 'weapon5': '0.108', 'HITCOUNT': '0.170', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.690', 'weapon3': '1.232', 'FRAGCOUNT': '2.000', 'weapon2': '2.076'} [2023-02-24 17:41:48,213][177172] DAMAGECOUNT value on done: 11569.0 [2023-02-24 17:41:48,214][177172] Sum rewards: 0.170, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.774', 'AMMO5': '0.015', 'AMMO2': '0.016', 'ARMOR': '0.064', 'WEAPON1': '0.070', 'AMMO4': '0.079', 'weapon5': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'weapon4': '0.170', 'HITCOUNT': '0.280', 'WEAPON5': '0.300', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.134', 'weapon3': '1.590', 'weapon2': '1.722', 'FRAGCOUNT': '4.000'} [2023-02-24 17:41:48,281][177153] Updated weights for policy 0, policy_version 3870 (0.0008) [2023-02-24 17:41:48,290][177171] DAMAGECOUNT value on done: 12068.0 [2023-02-24 17:41:48,290][177171] Sum rewards: 2.841, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.196', 'AMMO4': '-0.054', 'AMMO2': '-0.011', 'AMMO5': '0.017', 'ARMOR': '0.040', 'WEAPON1': '0.080', 'HITCOUNT': '0.080', 'AMMO3': '0.098', 'weapon5': '0.268', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'weapon2': '1.430', 'DAMAGECOUNT': '1.446', 'weapon3': '1.492', 'FRAGCOUNT': '4.000'} [2023-02-24 17:41:48,391][177157] DAMAGECOUNT value on done: 13881.0 [2023-02-24 17:41:48,391][177157] Sum rewards: 0.485, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.836', 'AMMO2': '0.007', 'AMMO5': '0.019', 'AMMO4': '0.037', 'ARMOR': '0.068', 'WEAPON1': '0.070', 'weapon4': '0.116', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.260', 'HITCOUNT': '0.410', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'weapon2': '1.146', 'DAMAGECOUNT': '1.608', 'weapon3': '1.830', 'FRAGCOUNT': '4.000'} [2023-02-24 17:41:48,510][177155] DAMAGECOUNT value on done: 12122.0 [2023-02-24 17:41:48,510][177155] Sum rewards: -0.136, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.243', 'AMMO2': '0.011', 'AMMO5': '0.022', 'ARMOR': '0.040', 'AMMO4': '0.052', 'AMMO3': '0.055', 'WEAPON1': '0.080', 'WEAPON4': '0.150', 'weapon5': '0.174', 'weapon4': '0.254', 'HITCOUNT': '0.330', 'WEAPON3': '0.400', 'WEAPON5': '0.450', 'weapon3': '1.132', 'DAMAGECOUNT': '1.320', 'weapon2': '1.886', 'FRAGCOUNT': '3.000'} [2023-02-24 17:41:48,600][177171] DAMAGECOUNT value on done: 12528.0 [2023-02-24 17:41:48,687][177157] DAMAGECOUNT value on done: 14643.0 [2023-02-24 17:41:48,688][177157] Sum rewards: 0.862, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.856', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.017', 'weapon4': '0.024', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'WEAPON1': '0.080', 'AMMO3': '0.108', 'weapon5': '0.196', 'HITCOUNT': '0.220', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.281', 'weapon3': '1.400', 'weapon2': '2.006', 'FRAGCOUNT': '5.000'} [2023-02-24 17:41:48,696][177157] DAMAGECOUNT value on done: 14125.0 [2023-02-24 17:41:48,697][177157] Sum rewards: 2.234, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.014', 'AMMO2': '0.015', 'ARMOR': '0.040', 'HITCOUNT': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.073', 'AMMO3': '0.083', 'weapon5': '0.274', 'WEAPON5': '0.350', 'HEALTH': '0.352', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.693', 'weapon3': '0.964', 'weapon2': '1.816', 'FRAGCOUNT': '3.000'} [2023-02-24 17:41:48,814][177155] DAMAGECOUNT value on done: 13382.0 [2023-02-24 17:41:48,814][177155] Sum rewards: 1.133, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.818', 'AMMO5': '0.012', 'AMMO2': '0.021', 'ARMOR': '0.068', 'WEAPON1': '0.080', 'AMMO3': '0.095', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'weapon5': '0.222', 'weapon4': '0.232', 'HITCOUNT': '0.290', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'weapon3': '1.164', 'DAMAGECOUNT': '1.239', 'weapon2': '1.872', 'FRAGCOUNT': '3.000'} [2023-02-24 17:41:48,892][177171] DAMAGECOUNT value on done: 12308.0 [2023-02-24 17:41:48,893][177171] Sum rewards: -2.839, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.750', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.028', 'ARMOR': '0.036', 'WEAPON1': '0.050', 'weapon4': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'weapon5': '0.186', 'HITCOUNT': '0.190', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'weapon3': '1.440', 'DAMAGECOUNT': '1.488', 'weapon2': '1.784', 'FRAGCOUNT': '2.000'} [2023-02-24 17:41:48,966][177155] DAMAGECOUNT value on done: 15133.0 [2023-02-24 17:41:48,967][177155] Sum rewards: -5.976, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.014', 'AMMO5': '0.024', 'AMMO2': '0.038', 'ARMOR': '0.056', 'WEAPON1': '0.090', 'weapon4': '0.114', 'AMMO3': '0.163', 'HITCOUNT': '0.170', 'AMMO4': '0.187', 'WEAPON4': '0.200', 'weapon5': '0.240', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.344', 'weapon3': '1.386', 'FRAGCOUNT': '1.500', 'weapon2': '1.726'} [2023-02-24 17:41:48,985][177157] DAMAGECOUNT value on done: 13127.0 [2023-02-24 17:41:48,986][177157] Sum rewards: 0.423, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.484', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.020', 'ARMOR': '0.044', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.142', 'AMMO3': '0.144', 'HITCOUNT': '0.190', 'weapon5': '0.198', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.056', 'weapon2': '1.472', 'weapon3': '1.500', 'FRAGCOUNT': '4.000'} [2023-02-24 17:41:49,262][177155] DAMAGECOUNT value on done: 12483.0 [2023-02-24 17:41:49,262][177155] Sum rewards: -2.000, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.522', 'AMMO5': '0.015', 'AMMO2': '0.018', 'WEAPON1': '0.060', 'ARMOR': '0.061', 'AMMO4': '0.090', 'weapon5': '0.130', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'HITCOUNT': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.448', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.850', 'weapon2': '0.942', 'DAMAGECOUNT': '1.293', 'weapon3': '2.106'} [2023-02-24 17:41:51,156][177156] DAMAGECOUNT value on done: 12621.0 [2023-02-24 17:41:51,156][177156] Sum rewards: -5.247, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.870', 'AMMO5': '0.010', 'AMMO2': '0.021', 'ARMOR': '0.040', 'weapon5': '0.078', 'WEAPON1': '0.090', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'WEAPON5': '0.250', 'HITCOUNT': '0.260', 'weapon4': '0.320', 'DAMAGECOUNT': '0.807', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.444', 'weapon3': '1.526'} [2023-02-24 17:41:51,170][177153] Updated weights for policy 0, policy_version 3880 (0.0008) [2023-02-24 17:41:51,376][177119] Fps is (10 sec: 13926.5, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 15892480. Throughput: 0: 3509.6. Samples: 3967380. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:41:51,376][177119] Avg episode reward: [(0, '0.114')] [2023-02-24 17:41:51,453][177156] DAMAGECOUNT value on done: 13685.0 [2023-02-24 17:41:51,454][177156] Sum rewards: 2.951, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.311', 'weapon7': '0.002', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO5': '0.019', 'ARMOR': '0.024', 'WEAPON1': '0.080', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'weapon5': '0.160', 'weapon4': '0.186', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.310', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'weapon2': '1.380', 'weapon3': '1.600', 'DAMAGECOUNT': '1.692', 'FRAGCOUNT': '5.000'} [2023-02-24 17:41:51,598][177156] DAMAGECOUNT value on done: 12720.0 [2023-02-24 17:41:51,598][177156] Sum rewards: 1.700, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.942', 'AMMO2': '0.027', 'AMMO5': '0.031', 'ARMOR': '0.040', 'weapon4': '0.090', 'WEAPON1': '0.100', 'AMMO4': '0.134', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'weapon5': '0.244', 'HITCOUNT': '0.380', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'weapon2': '1.120', 'DAMAGECOUNT': '1.596', 'weapon3': '1.990', 'FRAGCOUNT': '5.000'} [2023-02-24 17:41:51,890][177156] DAMAGECOUNT value on done: 14826.0 [2023-02-24 17:41:54,123][177153] Updated weights for policy 0, policy_version 3890 (0.0008) [2023-02-24 17:41:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 14051.4). Total num frames: 15962112. Throughput: 0: 3512.8. Samples: 3988462. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:41:56,376][177119] Avg episode reward: [(0, '0.067')] [2023-02-24 17:41:57,038][177153] Updated weights for policy 0, policy_version 3900 (0.0008) [2023-02-24 17:41:59,966][177153] Updated weights for policy 0, policy_version 3910 (0.0009) [2023-02-24 17:42:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14051.4). Total num frames: 16031744. Throughput: 0: 3510.3. Samples: 4009556. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:42:01,376][177119] Avg episode reward: [(0, '0.067')] [2023-02-24 17:42:02,886][177153] Updated weights for policy 0, policy_version 3920 (0.0008) [2023-02-24 17:42:05,064][177170] DAMAGECOUNT value on done: 13146.0 [2023-02-24 17:42:05,064][177170] Sum rewards: 5.014, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.017', 'AMMO2': '0.019', 'WEAPON1': '0.050', 'ARMOR': '0.084', 'AMMO4': '0.093', 'AMMO3': '0.097', 'HITCOUNT': '0.250', 'weapon5': '0.282', 'HEALTH': '0.366', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon3': '1.372', 'DAMAGECOUNT': '1.635', 'weapon2': '2.048', 'FRAGCOUNT': '6.000'} [2023-02-24 17:42:05,357][177170] DAMAGECOUNT value on done: 12087.0 [2023-02-24 17:42:05,358][177170] Sum rewards: 3.435, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'weapon5': '0.068', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.166', 'weapon4': '0.176', 'HITCOUNT': '0.210', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.663', 'HEALTH': '0.724', 'weapon3': '1.406', 'weapon2': '1.844', 'FRAGCOUNT': '2.000'} [2023-02-24 17:42:05,367][177170] DAMAGECOUNT value on done: 15095.0 [2023-02-24 17:42:05,367][177170] Sum rewards: 3.154, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.541', 'AMMO2': '0.014', 'AMMO5': '0.019', 'AMMO4': '0.069', 'WEAPON1': '0.070', 'weapon7': '0.070', 'AMMO3': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.250', 'weapon5': '0.298', 'HITCOUNT': '0.350', 'weapon4': '0.392', 'WEAPON5': '0.500', 'WEAPON3': '0.500', 'ARMOR': '0.529', 'weapon3': '1.144', 'weapon2': '1.316', 'DAMAGECOUNT': '2.028', 'FRAGCOUNT': '4.000'} [2023-02-24 17:42:05,632][177158] DAMAGECOUNT value on done: 14075.0 [2023-02-24 17:42:05,632][177158] Sum rewards: -2.107, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.123', 'AMMO2': '0.012', 'ARMOR': '0.016', 'AMMO5': '0.027', 'AMMO4': '0.059', 'WEAPON1': '0.080', 'weapon4': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.158', 'AMMO3': '0.179', 'HITCOUNT': '0.350', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'weapon2': '1.150', 'DAMAGECOUNT': '1.407', 'weapon3': '2.238', 'FRAGCOUNT': '3.000'} [2023-02-24 17:42:05,666][177170] DAMAGECOUNT value on done: 15230.0 [2023-02-24 17:42:05,667][177170] Sum rewards: -3.823, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.070', 'AMMO5': '0.027', 'AMMO2': '0.039', 'ARMOR': '0.040', 'WEAPON1': '0.040', 'weapon4': '0.056', 'weapon7': '0.078', 'AMMO3': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.116', 'HITCOUNT': '0.140', 'AMMO4': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.645', 'FRAGCOUNT': '1.000', 'weapon3': '1.220', 'weapon2': '2.058'} [2023-02-24 17:42:05,789][177153] Updated weights for policy 0, policy_version 3930 (0.0009) [2023-02-24 17:42:05,897][177172] DAMAGECOUNT value on done: 11724.0 [2023-02-24 17:42:05,897][177172] Sum rewards: 1.059, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.738', 'AMMO2': '0.026', 'AMMO5': '0.026', 'weapon4': '0.040', 'ARMOR': '0.050', 'WEAPON1': '0.080', 'AMMO3': '0.108', 'AMMO4': '0.128', 'WEAPON4': '0.200', 'weapon5': '0.258', 'HITCOUNT': '0.360', 'WEAPON3': '0.500', 'WEAPON5': '0.700', 'weapon3': '1.276', 'weapon2': '1.826', 'DAMAGECOUNT': '1.968', 'FRAGCOUNT': '5.000'} [2023-02-24 17:42:05,929][177158] DAMAGECOUNT value on done: 12193.0 [2023-02-24 17:42:05,929][177158] Sum rewards: -2.514, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.000', 'HEALTH': '-0.115', 'AMMO5': '0.012', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'weapon5': '0.038', 'ARMOR': '0.040', 'AMMO3': '0.108', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.330', 'weapon4': '0.406', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.065', 'weapon2': '1.338', 'weapon3': '1.500'} [2023-02-24 17:42:06,208][177172] DAMAGECOUNT value on done: 11686.0 [2023-02-24 17:42:06,209][177172] Sum rewards: 0.492, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.292', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon7': '0.056', 'AMMO3': '0.077', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'weapon5': '0.128', 'ARMOR': '0.129', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.248', 'WEAPON3': '0.400', 'DAMAGECOUNT': '1.020', 'weapon3': '1.298', 'weapon2': '1.316', 'FRAGCOUNT': '2.000'} [2023-02-24 17:42:06,214][177158] DAMAGECOUNT value on done: 13003.0 [2023-02-24 17:42:06,215][177158] Sum rewards: -3.762, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON1': '0.070', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.164', 'weapon5': '0.196', 'weapon4': '0.266', 'WEAPON5': '0.300', 'HEALTH': '0.314', 'HITCOUNT': '0.330', 'WEAPON3': '0.850', 'weapon2': '0.930', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.326', 'weapon3': '2.264'} [2023-02-24 17:42:06,218][177154] DAMAGECOUNT value on done: 14108.0 [2023-02-24 17:42:06,218][177154] Sum rewards: -3.161, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.310', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.017', 'AMMO2': '0.029', 'ARMOR': '0.032', 'WEAPON1': '0.070', 'AMMO3': '0.078', 'AMMO4': '0.145', 'HITCOUNT': '0.150', 'weapon5': '0.230', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.468', 'weapon3': '0.728', 'DAMAGECOUNT': '0.792', 'weapon2': '1.610'} [2023-02-24 17:42:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14037.5). Total num frames: 16101376. Throughput: 0: 3509.6. Samples: 4020054. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:42:06,376][177119] Avg episode reward: [(0, '0.217')] [2023-02-24 17:42:06,402][177140] Saving new best policy, reward=0.217! [2023-02-24 17:42:06,535][177158] DAMAGECOUNT value on done: 12988.0 [2023-02-24 17:42:06,536][177158] Sum rewards: 0.373, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.960', 'AMMO2': '0.013', 'AMMO5': '0.019', 'ARMOR': '0.040', 'AMMO4': '0.064', 'WEAPON1': '0.070', 'AMMO3': '0.084', 'weapon5': '0.176', 'HITCOUNT': '0.200', 'weapon4': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.891', 'weapon3': '1.464', 'weapon2': '1.584', 'FRAGCOUNT': '2.000'} [2023-02-24 17:42:06,538][177154] DAMAGECOUNT value on done: 12223.0 [2023-02-24 17:42:06,539][177154] Sum rewards: -0.387, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.828', 'AMMO2': '0.017', 'AMMO5': '0.027', 'ARMOR': '0.076', 'AMMO4': '0.083', 'WEAPON1': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.151', 'weapon4': '0.166', 'HITCOUNT': '0.180', 'weapon5': '0.254', 'WEAPON5': '0.650', 'WEAPON3': '0.700', 'weapon3': '1.120', 'DAMAGECOUNT': '1.275', 'weapon2': '2.042', 'FRAGCOUNT': '5.000'} [2023-02-24 17:42:06,737][177154] DAMAGECOUNT value on done: 14107.0 [2023-02-24 17:42:06,737][177154] Sum rewards: 0.244, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.696', 'AMMO2': '0.004', 'AMMO5': '0.014', 'AMMO4': '0.018', 'WEAPON1': '0.050', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'weapon5': '0.176', 'HITCOUNT': '0.220', 'WEAPON5': '0.350', 'weapon4': '0.354', 'ARMOR': '0.461', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.762', 'weapon3': '1.394', 'weapon2': '1.578', 'FRAGCOUNT': '3.000'} [2023-02-24 17:42:07,034][177154] DAMAGECOUNT value on done: 14014.0 [2023-02-24 17:42:07,035][177154] Sum rewards: 0.584, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.638', 'AMMO2': '0.012', 'AMMO5': '0.017', 'ARMOR': '0.040', 'AMMO4': '0.059', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon4': '0.210', 'HITCOUNT': '0.230', 'weapon5': '0.248', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.101', 'weapon2': '1.562', 'weapon3': '1.572', 'FRAGCOUNT': '3.000'} [2023-02-24 17:42:07,090][177172] DAMAGECOUNT value on done: 13102.0 [2023-02-24 17:42:07,091][177172] Sum rewards: 1.203, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.983', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.018', 'WEAPON1': '0.030', 'weapon5': '0.082', 'AMMO3': '0.083', 'HITCOUNT': '0.110', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.328', 'WEAPON3': '0.350', 'ARMOR': '0.488', 'DAMAGECOUNT': '0.828', 'weapon2': '0.906', 'FRAGCOUNT': '1.000', 'weapon3': '1.354'} [2023-02-24 17:42:07,152][177171] DAMAGECOUNT value on done: 13445.0 [2023-02-24 17:42:07,152][177171] Sum rewards: -1.107, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.602', 'AMMO5': '0.023', 'AMMO2': '0.030', 'ARMOR': '0.072', 'WEAPON1': '0.100', 'AMMO3': '0.102', 'WEAPON4': '0.150', 'AMMO4': '0.152', 'HITCOUNT': '0.200', 'weapon5': '0.340', 'weapon4': '0.406', 'WEAPON5': '0.600', 'WEAPON3': '0.650', 'weapon3': '1.378', 'weapon2': '1.506', 'DAMAGECOUNT': '1.536', 'FRAGCOUNT': '3.000'} [2023-02-24 17:42:07,388][177172] DAMAGECOUNT value on done: 12199.0 [2023-02-24 17:42:07,388][177172] Sum rewards: 2.469, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.406', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.017', 'weapon4': '0.018', 'ARMOR': '0.028', 'WEAPON1': '0.050', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'weapon5': '0.136', 'WEAPON5': '0.250', 'HITCOUNT': '0.340', 'WEAPON3': '0.550', 'weapon3': '1.282', 'DAMAGECOUNT': '1.890', 'weapon2': '2.128', 'FRAGCOUNT': '3.000'} [2023-02-24 17:42:07,446][177171] DAMAGECOUNT value on done: 12828.0 [2023-02-24 17:42:07,446][177171] Sum rewards: 4.783, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.561', 'AMMO2': '0.008', 'AMMO5': '0.020', 'AMMO4': '0.042', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.052', 'AMMO3': '0.094', 'HITCOUNT': '0.280', 'weapon5': '0.338', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon3': '1.138', 'weapon2': '1.692', 'DAMAGECOUNT': '2.280', 'FRAGCOUNT': '5.000'} [2023-02-24 17:42:07,490][177157] DAMAGECOUNT value on done: 14451.0 [2023-02-24 17:42:07,490][177157] Sum rewards: 3.237, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.184', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.027', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'AMMO3': '0.078', 'weapon4': '0.176', 'weapon5': '0.186', 'WEAPON4': '0.200', 'HITCOUNT': '0.290', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'weapon3': '0.988', 'DAMAGECOUNT': '1.710', 'weapon2': '1.910', 'FRAGCOUNT': '4.000'} [2023-02-24 17:42:07,646][177155] DAMAGECOUNT value on done: 12996.0 [2023-02-24 17:42:07,646][177155] Sum rewards: -0.230, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.358', 'weapon4': '0.008', 'AMMO2': '0.023', 'AMMO5': '0.027', 'WEAPON4': '0.050', 'AMMO4': '0.116', 'AMMO3': '0.135', 'WEAPON1': '0.150', 'weapon5': '0.224', 'HITCOUNT': '0.430', 'WEAPON5': '0.600', 'WEAPON3': '0.850', 'weapon2': '1.266', 'weapon3': '1.876', 'DAMAGECOUNT': '2.622', 'FRAGCOUNT': '4.000'} [2023-02-24 17:42:07,754][177171] DAMAGECOUNT value on done: 12572.0 [2023-02-24 17:42:07,786][177157] DAMAGECOUNT value on done: 15176.0 [2023-02-24 17:42:07,787][177157] Sum rewards: -1.689, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.700', 'AMMO2': '0.024', 'AMMO5': '0.026', 'ARMOR': '0.068', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.112', 'AMMO4': '0.118', 'AMMO3': '0.147', 'weapon5': '0.224', 'HITCOUNT': '0.300', 'WEAPON5': '0.700', 'WEAPON3': '0.900', 'weapon2': '0.986', 'DAMAGECOUNT': '1.599', 'FRAGCOUNT': '2.000', 'weapon3': '2.126'} [2023-02-24 17:42:07,797][177157] DAMAGECOUNT value on done: 14300.0 [2023-02-24 17:42:07,798][177157] Sum rewards: -1.668, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.014', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.055', 'HITCOUNT': '0.060', 'WEAPON1': '0.080', 'ARMOR': '0.088', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'weapon4': '0.140', 'weapon5': '0.196', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.525', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.140', 'weapon2': '1.748'} [2023-02-24 17:42:07,945][177155] DAMAGECOUNT value on done: 13675.0 [2023-02-24 17:42:07,946][177155] Sum rewards: -0.881, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.610', 'AMMO2': '0.017', 'AMMO5': '0.023', 'ARMOR': '0.040', 'weapon4': '0.044', 'AMMO4': '0.083', 'WEAPON1': '0.100', 'weapon5': '0.102', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'WEAPON5': '0.500', 'weapon2': '0.864', 'DAMAGECOUNT': '0.879', 'WEAPON3': '0.900', 'FRAGCOUNT': '2.000', 'weapon3': '2.208'} [2023-02-24 17:42:08,048][177171] DAMAGECOUNT value on done: 12982.0 [2023-02-24 17:42:08,048][177171] Sum rewards: -2.969, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.570', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.021', 'weapon4': '0.054', 'AMMO3': '0.073', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.354', 'HITCOUNT': '0.360', 'WEAPON3': '0.450', 'WEAPON5': '0.550', 'weapon3': '0.920', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '2.022', 'weapon2': '2.146'} [2023-02-24 17:42:08,085][177155] DAMAGECOUNT value on done: 15212.0 [2023-02-24 17:42:08,086][177155] Sum rewards: -2.947, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.080', 'AMMO2': '0.018', 'AMMO5': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.070', 'AMMO4': '0.088', 'HITCOUNT': '0.090', 'WEAPON1': '0.110', 'AMMO3': '0.122', 'weapon5': '0.192', 'DAMAGECOUNT': '0.237', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.120', 'weapon2': '2.166'} [2023-02-24 17:42:08,087][177157] DAMAGECOUNT value on done: 13350.0 [2023-02-24 17:42:08,087][177157] Sum rewards: -2.307, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.967', 'AMMO5': '0.015', 'AMMO2': '0.020', 'ARMOR': '0.036', 'WEAPON1': '0.080', 'AMMO4': '0.101', 'AMMO3': '0.105', 'weapon5': '0.148', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'weapon4': '0.276', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.669', 'weapon3': '0.936', 'FRAGCOUNT': '2.000', 'weapon2': '2.114'} [2023-02-24 17:42:08,378][177155] DAMAGECOUNT value on done: 12671.0 [2023-02-24 17:42:08,379][177155] Sum rewards: 3.432, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.356', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.028', 'AMMO3': '0.037', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'HITCOUNT': '0.180', 'weapon5': '0.238', 'WEAPON3': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.326', 'ARMOR': '0.547', 'DAMAGECOUNT': '0.564', 'weapon3': '0.590', 'weapon2': '2.052', 'FRAGCOUNT': '3.000'} [2023-02-24 17:42:08,746][177153] Updated weights for policy 0, policy_version 3940 (0.0008) [2023-02-24 17:42:10,268][177156] DAMAGECOUNT value on done: 12896.0 [2023-02-24 17:42:10,269][177156] Sum rewards: 0.766, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.406', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'weapon7': '0.056', 'AMMO3': '0.062', 'ARMOR': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.162', 'HITCOUNT': '0.190', 'weapon5': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.288', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.825', 'weapon3': '1.038', 'weapon2': '1.802', 'FRAGCOUNT': '2.000'} [2023-02-24 17:42:10,576][177156] DAMAGECOUNT value on done: 14117.0 [2023-02-24 17:42:10,577][177156] Sum rewards: -1.421, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.352', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.017', 'WEAPON1': '0.060', 'AMMO3': '0.155', 'weapon5': '0.210', 'WEAPON5': '0.350', 'HITCOUNT': '0.370', 'WEAPON3': '0.850', 'weapon2': '1.254', 'DAMAGECOUNT': '1.296', 'FRAGCOUNT': '2.000', 'weapon3': '2.138'} [2023-02-24 17:42:10,715][177156] DAMAGECOUNT value on done: 13194.0 [2023-02-24 17:42:10,716][177156] Sum rewards: 5.174, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.009', 'AMMO5': '0.010', 'HEALTH': '0.016', 'AMMO4': '0.043', 'AMMO3': '0.060', 'WEAPON1': '0.060', 'ARMOR': '0.076', 'weapon5': '0.208', 'HITCOUNT': '0.220', 'WEAPON3': '0.300', 'WEAPON5': '0.300', 'weapon3': '1.042', 'DAMAGECOUNT': '1.422', 'weapon2': '2.158', 'FRAGCOUNT': '3.000'} [2023-02-24 17:42:11,002][177156] DAMAGECOUNT value on done: 15202.0 [2023-02-24 17:42:11,002][177156] Sum rewards: 3.181, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.048', 'AMMO2': '0.004', 'AMMO5': '0.012', 'AMMO4': '0.020', 'ARMOR': '0.040', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO3': '0.089', 'weapon5': '0.096', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.140', 'weapon4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'weapon2': '1.096', 'DAMAGECOUNT': '1.128', 'weapon3': '1.626', 'FRAGCOUNT': '2.000'} [2023-02-24 17:42:11,376][177119] Fps is (10 sec: 14336.1, 60 sec: 14063.0, 300 sec: 14051.4). Total num frames: 16175104. Throughput: 0: 3508.1. Samples: 4041086. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:42:11,376][177119] Avg episode reward: [(0, '0.256')] [2023-02-24 17:42:11,377][177140] Saving new best policy, reward=0.256! [2023-02-24 17:42:11,657][177153] Updated weights for policy 0, policy_version 3950 (0.0008) [2023-02-24 17:42:14,553][177153] Updated weights for policy 0, policy_version 3960 (0.0008) [2023-02-24 17:42:15,450][177154] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 17:42:16,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14063.0, 300 sec: 14051.4). Total num frames: 16244736. Throughput: 0: 3508.0. Samples: 4062138. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:42:16,376][177119] Avg episode reward: [(0, '0.256')] [2023-02-24 17:42:17,470][177153] Updated weights for policy 0, policy_version 3970 (0.0008) [2023-02-24 17:42:20,397][177153] Updated weights for policy 0, policy_version 3980 (0.0009) [2023-02-24 17:42:21,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 16314368. Throughput: 0: 3507.3. Samples: 4072666. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:42:21,376][177119] Avg episode reward: [(0, '0.256')] [2023-02-24 17:42:23,329][177153] Updated weights for policy 0, policy_version 3990 (0.0008) [2023-02-24 17:42:24,214][177170] DAMAGECOUNT value on done: 13176.0 [2023-02-24 17:42:24,257][177171] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 17:42:24,505][177170] DAMAGECOUNT value on done: 12460.0 [2023-02-24 17:42:24,506][177170] Sum rewards: 2.186, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.015', 'AMMO2': '0.045', 'HEALTH': '0.060', 'ARMOR': '0.064', 'WEAPON1': '0.070', 'AMMO3': '0.099', 'weapon5': '0.132', 'AMMO4': '0.225', 'WEAPON4': '0.250', 'HITCOUNT': '0.310', 'WEAPON5': '0.350', 'weapon4': '0.574', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.119', 'weapon3': '1.302', 'weapon2': '1.470', 'FRAGCOUNT': '3.000'} [2023-02-24 17:42:24,515][177170] DAMAGECOUNT value on done: 15667.0 [2023-02-24 17:42:24,516][177170] Sum rewards: -0.378, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.721', 'AMMO2': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.051', 'WEAPON1': '0.060', 'weapon4': '0.060', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'HITCOUNT': '0.300', 'weapon5': '0.314', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'weapon3': '1.226', 'weapon2': '1.542', 'DAMAGECOUNT': '1.716', 'FRAGCOUNT': '3.000'} [2023-02-24 17:42:24,772][177158] DAMAGECOUNT value on done: 14288.0 [2023-02-24 17:42:24,772][177158] Sum rewards: 2.676, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.338', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon4': '0.014', 'WEAPON1': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'HITCOUNT': '0.150', 'weapon5': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.639', 'weapon3': '1.518', 'weapon2': '1.820', 'FRAGCOUNT': '3.000'} [2023-02-24 17:42:24,806][177170] DAMAGECOUNT value on done: 15681.0 [2023-02-24 17:42:24,807][177170] Sum rewards: -2.703, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.792', 'AMMO5': '0.011', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.088', 'AMMO4': '0.091', 'AMMO3': '0.127', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.264', 'HITCOUNT': '0.340', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.353', 'weapon2': '1.514', 'weapon3': '1.762', 'FRAGCOUNT': '2.500'} [2023-02-24 17:42:25,055][177158] DAMAGECOUNT value on done: 12971.0 [2023-02-24 17:42:25,055][177158] Sum rewards: 5.666, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.324', 'AMMO2': '0.022', 'AMMO5': '0.024', 'ARMOR': '0.079', 'WEAPON1': '0.090', 'AMMO3': '0.095', 'AMMO4': '0.111', 'weapon4': '0.166', 'WEAPON4': '0.200', 'weapon5': '0.250', 'HITCOUNT': '0.300', 'WEAPON3': '0.600', 'WEAPON5': '0.600', 'weapon3': '1.424', 'weapon2': '1.694', 'DAMAGECOUNT': '2.334', 'FRAGCOUNT': '5.000'} [2023-02-24 17:42:25,092][177172] DAMAGECOUNT value on done: 12133.0 [2023-02-24 17:42:25,093][177172] Sum rewards: -1.394, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.214', 'AMMO2': '0.011', 'weapon4': '0.018', 'AMMO5': '0.028', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'WEAPON1': '0.100', 'AMMO3': '0.127', 'HITCOUNT': '0.160', 'weapon5': '0.240', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'weapon3': '1.122', 'DAMAGECOUNT': '1.227', 'weapon2': '1.834', 'FRAGCOUNT': '2.000'} [2023-02-24 17:42:25,388][177172] DAMAGECOUNT value on done: 12238.0 [2023-02-24 17:42:25,389][177172] Sum rewards: 1.008, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.449', 'AMMO2': '0.013', 'AMMO5': '0.020', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.064', 'weapon4': '0.080', 'AMMO3': '0.112', 'weapon5': '0.116', 'HITCOUNT': '0.210', 'ARMOR': '0.416', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon3': '1.236', 'weapon2': '1.424', 'DAMAGECOUNT': '1.656', 'FRAGCOUNT': '4.000'} [2023-02-24 17:42:25,394][177158] DAMAGECOUNT value on done: 13262.0 [2023-02-24 17:42:25,395][177158] Sum rewards: -2.488, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.374', 'AMMO2': '0.012', 'weapon7': '0.012', 'AMMO5': '0.025', 'ARMOR': '0.040', 'AMMO4': '0.058', 'WEAPON1': '0.070', 'AMMO3': '0.100', 'weapon5': '0.162', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'weapon4': '0.268', 'WEAPON5': '0.500', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.777', 'weapon2': '1.304', 'weapon3': '1.648'} [2023-02-24 17:42:25,410][177154] DAMAGECOUNT value on done: 14556.0 [2023-02-24 17:42:25,411][177154] Sum rewards: 1.991, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.525', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'weapon4': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.079', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.120', 'weapon5': '0.164', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'weapon3': '1.058', 'DAMAGECOUNT': '1.344', 'weapon2': '1.640', 'FRAGCOUNT': '3.000'} [2023-02-24 17:42:25,689][177158] DAMAGECOUNT value on done: 13507.0 [2023-02-24 17:42:25,689][177158] Sum rewards: 3.801, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.282', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON1': '0.050', 'AMMO3': '0.062', 'AMMO4': '0.086', 'weapon4': '0.196', 'WEAPON4': '0.200', 'weapon5': '0.254', 'HITCOUNT': '0.290', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'weapon3': '1.174', 'DAMAGECOUNT': '1.557', 'weapon2': '1.670', 'FRAGCOUNT': '3.000'} [2023-02-24 17:42:25,708][177154] DAMAGECOUNT value on done: 12756.0 [2023-02-24 17:42:25,708][177154] Sum rewards: 1.065, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.380', 'weapon4': '0.010', 'AMMO2': '0.013', 'AMMO5': '0.022', 'ARMOR': '0.032', 'AMMO4': '0.066', 'weapon7': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON1': '0.120', 'weapon5': '0.146', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.320', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon3': '1.208', 'DAMAGECOUNT': '1.599', 'weapon2': '1.724', 'FRAGCOUNT': '4.000'} [2023-02-24 17:42:25,899][177154] DAMAGECOUNT value on done: 14628.0 [2023-02-24 17:42:25,900][177154] Sum rewards: 4.623, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.302', 'AMMO2': '0.007', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.037', 'ARMOR': '0.040', 'AMMO3': '0.074', 'weapon7': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.144', 'weapon4': '0.240', 'WEAPON5': '0.300', 'HITCOUNT': '0.330', 'WEAPON3': '0.450', 'weapon3': '1.256', 'weapon2': '1.454', 'DAMAGECOUNT': '1.563', 'FRAGCOUNT': '4.500'} [2023-02-24 17:42:26,190][177154] DAMAGECOUNT value on done: 14385.0 [2023-02-24 17:42:26,190][177154] Sum rewards: -1.858, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.851', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.062', 'AMMO3': '0.105', 'ARMOR': '0.112', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.340', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.113', 'weapon3': '1.604', 'weapon2': '1.638', 'FRAGCOUNT': '2.000'} [2023-02-24 17:42:26,216][177172] DAMAGECOUNT value on done: 13378.0 [2023-02-24 17:42:26,217][177172] Sum rewards: -1.315, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.389', 'AMMO2': '0.019', 'ARMOR': '0.024', 'AMMO5': '0.025', 'WEAPON1': '0.050', 'AMMO4': '0.093', 'weapon4': '0.102', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'weapon5': '0.186', 'HITCOUNT': '0.260', 'WEAPON5': '0.500', 'DAMAGECOUNT': '0.828', 'WEAPON3': '0.850', 'weapon2': '1.576', 'weapon3': '1.764', 'FRAGCOUNT': '4.000'} [2023-02-24 17:42:26,229][177153] Updated weights for policy 0, policy_version 4000 (0.0008) [2023-02-24 17:42:26,288][177171] DAMAGECOUNT value on done: 13775.0 [2023-02-24 17:42:26,288][177171] Sum rewards: -0.520, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.503', 'AMMO2': '0.009', 'AMMO5': '0.012', 'ARMOR': '0.028', 'WEAPON1': '0.030', 'weapon4': '0.030', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'AMMO3': '0.088', 'weapon5': '0.130', 'HITCOUNT': '0.210', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.990', 'weapon3': '1.168', 'weapon2': '1.992', 'FRAGCOUNT': '2.000'} [2023-02-24 17:42:26,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 16384000. Throughput: 0: 3506.2. Samples: 4093692. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:42:26,376][177119] Avg episode reward: [(0, '0.208')] [2023-02-24 17:42:26,505][177172] DAMAGECOUNT value on done: 12729.0 [2023-02-24 17:42:26,506][177172] Sum rewards: -0.138, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.875', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.027', 'ARMOR': '0.080', 'AMMO3': '0.088', 'WEAPON1': '0.090', 'WEAPON4': '0.150', 'HITCOUNT': '0.240', 'weapon5': '0.260', 'weapon4': '0.310', 'WEAPON3': '0.450', 'WEAPON5': '0.650', 'weapon3': '0.716', 'DAMAGECOUNT': '1.590', 'weapon2': '2.326', 'FRAGCOUNT': '3.000'} [2023-02-24 17:42:26,580][177157] DAMAGECOUNT value on done: 14914.0 [2023-02-24 17:42:26,581][177157] Sum rewards: -4.475, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.941', 'FRAGCOUNT': '-0.500', 'ARMOR': '0.013', 'AMMO2': '0.018', 'AMMO5': '0.032', 'weapon4': '0.060', 'AMMO4': '0.088', 'WEAPON1': '0.100', 'AMMO3': '0.110', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.236', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'weapon2': '1.248', 'DAMAGECOUNT': '1.389', 'weapon3': '1.772'} [2023-02-24 17:42:26,591][177171] DAMAGECOUNT value on done: 13207.0 [2023-02-24 17:42:26,591][177171] Sum rewards: 0.924, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.119', 'AMMO5': '0.017', 'AMMO2': '0.038', 'WEAPON1': '0.070', 'AMMO3': '0.089', 'weapon5': '0.148', 'AMMO4': '0.191', 'weapon4': '0.250', 'HITCOUNT': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.137', 'weapon2': '1.524', 'weapon3': '1.538', 'FRAGCOUNT': '3.000'} [2023-02-24 17:42:26,773][177155] DAMAGECOUNT value on done: 13376.0 [2023-02-24 17:42:26,773][177155] Sum rewards: -2.932, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.458', 'AMMO2': '0.005', 'AMMO5': '0.018', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'weapon5': '0.164', 'weapon4': '0.170', 'AMMO3': '0.191', 'HITCOUNT': '0.220', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.140', 'weapon2': '1.404', 'weapon3': '1.920', 'FRAGCOUNT': '2.000'} [2023-02-24 17:42:26,887][177157] DAMAGECOUNT value on done: 15321.0 [2023-02-24 17:42:26,887][177157] Sum rewards: -2.692, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.480', 'AMMO5': '0.012', 'AMMO2': '0.028', 'WEAPON1': '0.080', 'AMMO3': '0.083', 'AMMO4': '0.137', 'HITCOUNT': '0.140', 'weapon5': '0.216', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.332', 'weapon2': '1.824'} [2023-02-24 17:42:26,896][177157] DAMAGECOUNT value on done: 14789.0 [2023-02-24 17:42:26,896][177157] Sum rewards: 2.167, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.580', 'AMMO2': '0.007', 'ARMOR': '0.016', 'AMMO5': '0.021', 'AMMO4': '0.033', 'WEAPON1': '0.110', 'AMMO3': '0.114', 'HITCOUNT': '0.280', 'weapon5': '0.344', 'WEAPON5': '0.550', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.467', 'weapon3': '1.602', 'weapon2': '1.652', 'FRAGCOUNT': '5.000'} [2023-02-24 17:42:26,909][177171] DAMAGECOUNT value on done: 12728.0 [2023-02-24 17:42:26,910][177171] Sum rewards: -9.780, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.860', 'FRAGCOUNT': '-1.500', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO5': '0.023', 'weapon4': '0.026', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'weapon5': '0.188', 'HITCOUNT': '0.200', 'AMMO3': '0.204', 'DAMAGECOUNT': '0.468', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon2': '1.362', 'weapon3': '1.944'} [2023-02-24 17:42:27,080][177155] DAMAGECOUNT value on done: 14069.0 [2023-02-24 17:42:27,081][177155] Sum rewards: -1.144, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.500', 'AMMO5': '0.016', 'AMMO2': '0.024', 'WEAPON1': '0.060', 'AMMO3': '0.109', 'AMMO4': '0.121', 'weapon5': '0.190', 'WEAPON4': '0.200', 'HITCOUNT': '0.240', 'weapon4': '0.248', 'WEAPON5': '0.450', 'ARMOR': '0.491', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.182', 'weapon3': '1.462', 'weapon2': '1.662', 'FRAGCOUNT': '2.000'} [2023-02-24 17:42:27,188][177157] DAMAGECOUNT value on done: 14198.0 [2023-02-24 17:42:27,189][177157] Sum rewards: 0.544, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.716', 'AMMO2': '0.028', 'AMMO5': '0.029', 'WEAPON1': '0.080', 'weapon4': '0.126', 'AMMO4': '0.142', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'weapon5': '0.290', 'HITCOUNT': '0.470', 'WEAPON5': '0.700', 'WEAPON3': '0.900', 'weapon2': '1.038', 'weapon3': '2.054', 'FRAGCOUNT': '2.500', 'DAMAGECOUNT': '2.544'} [2023-02-24 17:42:27,208][177171] DAMAGECOUNT value on done: 13162.0 [2023-02-24 17:42:27,209][177171] Sum rewards: -2.612, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.994', 'weapon4': '0.012', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.016', 'WEAPON1': '0.070', 'weapon5': '0.076', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'HITCOUNT': '0.140', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.540', 'FRAGCOUNT': '1.000', 'weapon3': '1.356', 'weapon2': '1.654'} [2023-02-24 17:42:27,230][177155] DAMAGECOUNT value on done: 15540.0 [2023-02-24 17:42:27,231][177155] Sum rewards: -0.071, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.070', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'AMMO4': '0.081', 'AMMO3': '0.096', 'weapon5': '0.120', 'weapon4': '0.182', 'WEAPON4': '0.200', 'HITCOUNT': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.505', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.984', 'weapon2': '1.288', 'weapon3': '1.836', 'FRAGCOUNT': '2.000'} [2023-02-24 17:42:27,524][177155] DAMAGECOUNT value on done: 13186.0 [2023-02-24 17:42:27,524][177155] Sum rewards: 0.910, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.949', 'AMMO2': '0.006', 'AMMO5': '0.015', 'ARMOR': '0.024', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.088', 'weapon4': '0.114', 'weapon5': '0.220', 'HITCOUNT': '0.250', 'WEAPON5': '0.450', 'WEAPON3': '0.450', 'weapon3': '0.986', 'DAMAGECOUNT': '1.545', 'FRAGCOUNT': '2.000', 'weapon2': '2.322'} [2023-02-24 17:42:29,151][177153] Updated weights for policy 0, policy_version 4010 (0.0008) [2023-02-24 17:42:29,537][177156] DAMAGECOUNT value on done: 13592.0 [2023-02-24 17:42:29,537][177156] Sum rewards: -0.254, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.650', 'weapon4': '0.002', 'AMMO2': '0.008', 'AMMO5': '0.021', 'AMMO4': '0.042', 'ARMOR': '0.048', 'WEAPON1': '0.080', 'weapon5': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.135', 'WEAPON5': '0.400', 'HITCOUNT': '0.420', 'WEAPON3': '0.950', 'weapon2': '1.406', 'weapon3': '1.640', 'DAMAGECOUNT': '1.800', 'FRAGCOUNT': '5.000'} [2023-02-24 17:42:29,830][177156] DAMAGECOUNT value on done: 14527.0 [2023-02-24 17:42:29,831][177156] Sum rewards: 4.833, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.194', 'AMMO5': '0.010', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'ARMOR': '0.040', 'AMMO3': '0.059', 'AMMO4': '0.108', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'weapon5': '0.256', 'WEAPON5': '0.300', 'weapon4': '0.330', 'WEAPON3': '0.350', 'weapon3': '0.930', 'DAMAGECOUNT': '1.230', 'weapon2': '1.732', 'FRAGCOUNT': '3.000'} [2023-02-24 17:42:29,941][177156] DAMAGECOUNT value on done: 13849.0 [2023-02-24 17:42:29,942][177156] Sum rewards: 1.913, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.996', 'AMMO5': '0.015', 'AMMO2': '0.027', 'WEAPON1': '0.090', 'AMMO3': '0.127', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'weapon4': '0.192', 'weapon5': '0.238', 'WEAPON5': '0.400', 'HITCOUNT': '0.450', 'weapon2': '0.844', 'WEAPON3': '0.850', 'ARMOR': '0.861', 'DAMAGECOUNT': '1.965', 'weapon3': '2.064', 'FRAGCOUNT': '3.500'} [2023-02-24 17:42:30,234][177156] DAMAGECOUNT value on done: 15982.0 [2023-02-24 17:42:30,235][177156] Sum rewards: 3.865, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.148', 'AMMO2': '0.018', 'AMMO5': '0.022', 'ARMOR': '0.040', 'WEAPON1': '0.070', 'AMMO4': '0.089', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'weapon4': '0.180', 'weapon5': '0.222', 'HITCOUNT': '0.360', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon3': '1.282', 'weapon2': '1.816', 'DAMAGECOUNT': '2.340', 'FRAGCOUNT': '5.000'} [2023-02-24 17:42:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14051.4). Total num frames: 16453632. Throughput: 0: 3508.6. Samples: 4114822. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:42:31,376][177119] Avg episode reward: [(0, '0.059')] [2023-02-24 17:42:32,039][177153] Updated weights for policy 0, policy_version 4020 (0.0008) [2023-02-24 17:42:34,936][177153] Updated weights for policy 0, policy_version 4030 (0.0008) [2023-02-24 17:42:36,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 14051.4). Total num frames: 16523264. Throughput: 0: 3511.3. Samples: 4125390. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:42:36,376][177119] Avg episode reward: [(0, '0.059')] [2023-02-24 17:42:37,842][177153] Updated weights for policy 0, policy_version 4040 (0.0008) [2023-02-24 17:42:40,768][177153] Updated weights for policy 0, policy_version 4050 (0.0008) [2023-02-24 17:42:41,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14062.9, 300 sec: 14065.2). Total num frames: 16596992. Throughput: 0: 3512.7. Samples: 4146532. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:42:41,376][177119] Avg episode reward: [(0, '0.059')] [2023-02-24 17:42:43,298][177170] DAMAGECOUNT value on done: 13615.0 [2023-02-24 17:42:43,298][177170] Sum rewards: -4.647, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.390', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.074', 'ARMOR': '0.096', 'AMMO3': '0.105', 'weapon5': '0.122', 'WEAPON4': '0.250', 'weapon4': '0.280', 'WEAPON5': '0.300', 'HITCOUNT': '0.300', 'WEAPON3': '0.700', 'weapon3': '1.104', 'DAMAGECOUNT': '1.317', 'weapon2': '2.030', 'FRAGCOUNT': '3.000'} [2023-02-24 17:42:43,597][177170] DAMAGECOUNT value on done: 13186.0 [2023-02-24 17:42:43,598][177170] Sum rewards: 6.879, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.228', 'AMMO2': '0.001', 'AMMO4': '0.006', 'ARMOR': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.070', 'AMMO3': '0.082', 'WEAPON4': '0.150', 'weapon5': '0.184', 'weapon4': '0.222', 'WEAPON5': '0.350', 'HITCOUNT': '0.360', 'WEAPON3': '0.650', 'weapon3': '1.458', 'weapon2': '1.628', 'DAMAGECOUNT': '2.178', 'FRAGCOUNT': '6.000'} [2023-02-24 17:42:43,607][177170] DAMAGECOUNT value on done: 16012.0 [2023-02-24 17:42:43,607][177170] Sum rewards: -5.524, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.680', 'ARMOR': '0.008', 'AMMO2': '0.019', 'AMMO5': '0.026', 'WEAPON1': '0.050', 'weapon4': '0.088', 'AMMO4': '0.092', 'AMMO3': '0.132', 'HITCOUNT': '0.140', 'WEAPON4': '0.200', 'weapon5': '0.226', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.035', 'weapon3': '1.182', 'weapon2': '1.958'} [2023-02-24 17:42:43,700][177153] Updated weights for policy 0, policy_version 4060 (0.0008) [2023-02-24 17:42:43,874][177158] DAMAGECOUNT value on done: 14702.0 [2023-02-24 17:42:43,875][177158] Sum rewards: 2.828, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.123', 'AMMO5': '0.020', 'AMMO2': '0.022', 'WEAPON1': '0.060', 'AMMO3': '0.079', 'AMMO4': '0.108', 'weapon5': '0.138', 'HITCOUNT': '0.190', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.242', 'weapon3': '1.568', 'weapon2': '1.624', 'FRAGCOUNT': '3.000'} [2023-02-24 17:42:43,905][177170] DAMAGECOUNT value on done: 16148.0 [2023-02-24 17:42:43,906][177170] Sum rewards: -0.336, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.515', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.019', 'ARMOR': '0.020', 'WEAPON1': '0.070', 'AMMO3': '0.118', 'weapon5': '0.176', 'HITCOUNT': '0.350', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.401', 'weapon3': '1.524', 'weapon2': '1.538', 'FRAGCOUNT': '4.000'} [2023-02-24 17:42:44,164][177158] DAMAGECOUNT value on done: 13321.0 [2023-02-24 17:42:44,164][177158] Sum rewards: 0.750, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.004', 'AMMO5': '0.017', 'AMMO2': '0.023', 'ARMOR': '0.028', 'WEAPON1': '0.050', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'AMMO4': '0.112', 'weapon4': '0.160', 'HITCOUNT': '0.230', 'weapon5': '0.290', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.050', 'weapon3': '1.252', 'FRAGCOUNT': '1.500', 'weapon2': '1.762'} [2023-02-24 17:42:44,212][177172] DAMAGECOUNT value on done: 12691.0 [2023-02-24 17:42:44,212][177172] Sum rewards: 0.471, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.519', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.067', 'ARMOR': '0.072', 'AMMO3': '0.115', 'WEAPON4': '0.150', 'weapon5': '0.202', 'weapon4': '0.228', 'WEAPON5': '0.250', 'HITCOUNT': '0.310', 'WEAPON3': '0.650', 'weapon2': '1.426', 'DAMAGECOUNT': '1.674', 'weapon3': '1.810', 'FRAGCOUNT': '3.000'} [2023-02-24 17:42:44,491][177158] DAMAGECOUNT value on done: 13656.0 [2023-02-24 17:42:44,491][177158] Sum rewards: 0.380, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.850', 'AMMO5': '0.019', 'AMMO2': '0.022', 'WEAPON1': '0.070', 'AMMO3': '0.102', 'AMMO4': '0.112', 'HITCOUNT': '0.310', 'weapon5': '0.334', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.182', 'weapon3': '1.344', 'weapon2': '1.834', 'FRAGCOUNT': '3.000'} [2023-02-24 17:42:44,512][177154] DAMAGECOUNT value on done: 15042.0 [2023-02-24 17:42:44,512][177154] Sum rewards: 0.326, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.823', 'AMMO5': '0.022', 'AMMO2': '0.031', 'WEAPON1': '0.060', 'ARMOR': '0.076', 'weapon5': '0.136', 'AMMO4': '0.154', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'weapon4': '0.336', 'HITCOUNT': '0.390', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'weapon2': '1.012', 'DAMAGECOUNT': '1.458', 'weapon3': '1.770', 'FRAGCOUNT': '4.000'} [2023-02-24 17:42:44,513][177172] DAMAGECOUNT value on done: 12481.0 [2023-02-24 17:42:44,514][177172] Sum rewards: -5.128, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.164', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.015', 'AMMO2': '0.031', 'ARMOR': '0.052', 'WEAPON1': '0.060', 'AMMO3': '0.093', 'weapon5': '0.130', 'AMMO4': '0.154', 'HITCOUNT': '0.230', 'weapon4': '0.236', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.729', 'weapon3': '1.526', 'weapon2': '1.730'} [2023-02-24 17:42:44,783][177158] DAMAGECOUNT value on done: 13855.0 [2023-02-24 17:42:44,783][177158] Sum rewards: 2.915, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.555', 'AMMO2': '0.009', 'AMMO5': '0.015', 'ARMOR': '0.028', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'WEAPON1': '0.050', 'AMMO3': '0.071', 'weapon4': '0.142', 'HITCOUNT': '0.190', 'weapon5': '0.222', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.044', 'weapon3': '1.068', 'weapon2': '1.686', 'FRAGCOUNT': '2.500'} [2023-02-24 17:42:44,813][177154] DAMAGECOUNT value on done: 13286.0 [2023-02-24 17:42:44,813][177154] Sum rewards: -0.731, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.232', 'AMMO2': '0.012', 'AMMO5': '0.019', 'WEAPON1': '0.030', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'weapon4': '0.110', 'AMMO3': '0.116', 'weapon5': '0.184', 'HITCOUNT': '0.220', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'ARMOR': '0.964', 'weapon2': '1.448', 'DAMAGECOUNT': '1.590', 'weapon3': '1.846', 'FRAGCOUNT': '4.000'} [2023-02-24 17:42:45,019][177154] DAMAGECOUNT value on done: 14961.0 [2023-02-24 17:42:45,019][177154] Sum rewards: -0.086, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.976', 'AMMO5': '0.012', 'AMMO2': '0.013', 'ARMOR': '0.040', 'AMMO4': '0.063', 'AMMO3': '0.072', 'WEAPON1': '0.080', 'HITCOUNT': '0.110', 'WEAPON4': '0.200', 'weapon5': '0.256', 'weapon4': '0.260', 'WEAPON3': '0.400', 'WEAPON5': '0.450', 'weapon3': '0.650', 'DAMAGECOUNT': '0.999', 'FRAGCOUNT': '2.000', 'weapon2': '2.034'} [2023-02-24 17:42:45,289][177172] DAMAGECOUNT value on done: 14030.0 [2023-02-24 17:42:45,289][177172] Sum rewards: 2.178, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.423', 'AMMO2': '0.005', 'AMMO5': '0.020', 'AMMO4': '0.023', 'weapon7': '0.048', 'WEAPON1': '0.050', 'ARMOR': '0.084', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.146', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.240', 'weapon4': '0.308', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'weapon2': '0.960', 'weapon3': '1.558', 'DAMAGECOUNT': '1.956', 'FRAGCOUNT': '3.000'} [2023-02-24 17:42:45,325][177154] DAMAGECOUNT value on done: 14887.0 [2023-02-24 17:42:45,325][177154] Sum rewards: -0.052, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.712', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.020', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon5': '0.236', 'HITCOUNT': '0.240', 'weapon4': '0.242', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon2': '1.162', 'weapon3': '1.468', 'DAMAGECOUNT': '1.506', 'FRAGCOUNT': '5.000'} [2023-02-24 17:42:45,376][177171] DAMAGECOUNT value on done: 13958.0 [2023-02-24 17:42:45,377][177171] Sum rewards: -0.804, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.718', 'AMMO5': '0.007', 'AMMO2': '0.039', 'WEAPON1': '0.040', 'ARMOR': '0.072', 'AMMO3': '0.127', 'HITCOUNT': '0.140', 'weapon5': '0.144', 'WEAPON4': '0.150', 'weapon4': '0.182', 'AMMO4': '0.197', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.549', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.502', 'weapon3': '1.564'} [2023-02-24 17:42:45,586][177172] DAMAGECOUNT value on done: 12929.0 [2023-02-24 17:42:45,586][177172] Sum rewards: -1.964, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO2': '0.036', 'HITCOUNT': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'weapon5': '0.162', 'HEALTH': '0.166', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'weapon4': '0.300', 'ARMOR': '0.412', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.488', 'weapon2': '1.572'} [2023-02-24 17:42:45,669][177171] DAMAGECOUNT value on done: 13874.0 [2023-02-24 17:42:45,669][177171] Sum rewards: 3.848, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.310', 'ARMOR': '0.008', 'AMMO2': '0.013', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.077', 'HITCOUNT': '0.200', 'weapon5': '0.248', 'WEAPON3': '0.300', 'weapon4': '0.338', 'WEAPON5': '0.400', 'weapon3': '0.730', 'weapon2': '1.670', 'DAMAGECOUNT': '2.001', 'FRAGCOUNT': '4.000'} [2023-02-24 17:42:45,681][177157] DAMAGECOUNT value on done: 15401.0 [2023-02-24 17:42:45,681][177157] Sum rewards: 0.582, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.991', 'AMMO2': '0.009', 'AMMO5': '0.012', 'weapon4': '0.014', 'AMMO4': '0.044', 'WEAPON1': '0.060', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'weapon5': '0.192', 'HITCOUNT': '0.260', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'weapon3': '1.190', 'DAMAGECOUNT': '1.461', 'weapon2': '1.736', 'FRAGCOUNT': '3.000'} [2023-02-24 17:42:45,904][177155] DAMAGECOUNT value on done: 13695.0 [2023-02-24 17:42:45,905][177155] Sum rewards: 2.356, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.505', 'AMMO4': '-0.069', 'AMMO2': '-0.014', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'weapon5': '0.074', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'HITCOUNT': '0.230', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.957', 'ARMOR': '1.022', 'weapon2': '1.814', 'weapon3': '1.860', 'FRAGCOUNT': '3.000'} [2023-02-24 17:42:45,967][177157] DAMAGECOUNT value on done: 15571.0 [2023-02-24 17:42:45,967][177171] DAMAGECOUNT value on done: 13073.0 [2023-02-24 17:42:45,968][177171] Sum rewards: 0.447, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.091', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.023', 'AMMO5': '0.027', 'WEAPON4': '0.050', 'weapon5': '0.078', 'AMMO3': '0.124', 'HITCOUNT': '0.180', 'weapon4': '0.242', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.724', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.035', 'weapon3': '1.880', 'FRAGCOUNT': '3.000'} [2023-02-24 17:42:45,968][177157] Sum rewards: -2.644, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.120', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'weapon7': '0.082', 'weapon5': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.290', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.750', 'weapon3': '1.230', 'weapon2': '1.570', 'FRAGCOUNT': '2.000'} [2023-02-24 17:42:45,979][177157] DAMAGECOUNT value on done: 15194.0 [2023-02-24 17:42:45,979][177157] Sum rewards: 4.451, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'weapon5': '0.052', 'AMMO4': '0.085', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'HITCOUNT': '0.260', 'ARMOR': '0.420', 'WEAPON3': '0.450', 'HEALTH': '0.805', 'weapon2': '1.210', 'DAMAGECOUNT': '1.215', 'weapon3': '1.932', 'FRAGCOUNT': '3.000'} [2023-02-24 17:42:46,197][177155] DAMAGECOUNT value on done: 14234.0 [2023-02-24 17:42:46,197][177155] Sum rewards: -0.324, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.748', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.030', 'AMMO3': '0.038', 'WEAPON1': '0.040', 'ARMOR': '0.040', 'weapon5': '0.138', 'HITCOUNT': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.200', 'WEAPON4': '0.250', 'weapon3': '0.308', 'DAMAGECOUNT': '0.495', 'weapon4': '0.524', 'FRAGCOUNT': '1.000', 'weapon2': '2.248'} [2023-02-24 17:42:46,269][177157] DAMAGECOUNT value on done: 14483.0 [2023-02-24 17:42:46,269][177157] Sum rewards: 2.372, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.600', 'AMMO5': '0.005', 'AMMO2': '0.032', 'ARMOR': '0.040', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO3': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.112', 'AMMO4': '0.158', 'HITCOUNT': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.276', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.855', 'weapon3': '1.122', 'weapon2': '1.734', 'FRAGCOUNT': '3.000'} [2023-02-24 17:42:46,269][177171] DAMAGECOUNT value on done: 13617.0 [2023-02-24 17:42:46,270][177171] Sum rewards: -0.913, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.170', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.012', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.127', 'HITCOUNT': '0.210', 'weapon5': '0.262', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.365', 'weapon3': '1.410', 'FRAGCOUNT': '1.500', 'weapon2': '1.684'} [2023-02-24 17:42:46,358][177155] DAMAGECOUNT value on done: 16267.0 [2023-02-24 17:42:46,359][177155] Sum rewards: 0.990, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.562', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.025', 'WEAPON1': '0.110', 'AMMO3': '0.132', 'HITCOUNT': '0.290', 'weapon5': '0.316', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'weapon2': '1.150', 'weapon3': '1.752', 'DAMAGECOUNT': '2.181', 'FRAGCOUNT': '4.000'} [2023-02-24 17:42:46,376][177119] Fps is (10 sec: 14336.1, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 16666624. Throughput: 0: 3508.9. Samples: 4167454. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:42:46,376][177119] Avg episode reward: [(0, '0.046')] [2023-02-24 17:42:46,630][177153] Updated weights for policy 0, policy_version 4070 (0.0008) [2023-02-24 17:42:46,656][177155] DAMAGECOUNT value on done: 13286.0 [2023-02-24 17:42:46,656][177155] Sum rewards: -2.226, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.522', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.060', 'AMMO3': '0.123', 'HITCOUNT': '0.130', 'weapon5': '0.138', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.604', 'weapon3': '1.788'} [2023-02-24 17:42:48,680][177156] DAMAGECOUNT value on done: 13877.0 [2023-02-24 17:42:48,680][177156] Sum rewards: -2.545, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.358', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.030', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'weapon5': '0.148', 'WEAPON5': '0.200', 'weapon4': '0.232', 'HITCOUNT': '0.300', 'ARMOR': '0.541', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.855', 'weapon2': '1.350', 'weapon3': '1.806', 'FRAGCOUNT': '2.000'} [2023-02-24 17:42:48,976][177156] DAMAGECOUNT value on done: 14895.0 [2023-02-24 17:42:48,976][177156] Sum rewards: 1.180, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.057', 'weapon5': '0.086', 'WEAPON4': '0.100', 'ARMOR': '0.137', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'weapon4': '0.246', 'HITCOUNT': '0.260', 'HEALTH': '0.536', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.104', 'weapon2': '1.124', 'weapon3': '2.074', 'FRAGCOUNT': '4.000'} [2023-02-24 17:42:49,082][177156] DAMAGECOUNT value on done: 14264.0 [2023-02-24 17:42:49,082][177156] Sum rewards: 2.528, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.684', 'AMMO2': '0.007', 'weapon4': '0.014', 'AMMO5': '0.017', 'AMMO4': '0.034', 'WEAPON1': '0.040', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'weapon5': '0.210', 'HITCOUNT': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.520', 'WEAPON3': '0.600', 'weapon2': '0.900', 'DAMAGECOUNT': '1.245', 'weapon3': '1.884', 'FRAGCOUNT': '3.000'} [2023-02-24 17:42:49,381][177156] DAMAGECOUNT value on done: 16583.0 [2023-02-24 17:42:49,382][177156] Sum rewards: 3.316, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'AMMO2': '0.030', 'WEAPON1': '0.030', 'AMMO3': '0.051', 'ARMOR': '0.064', 'HEALTH': '0.078', 'weapon5': '0.084', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.154', 'HITCOUNT': '0.250', 'WEAPON3': '0.300', 'weapon3': '0.950', 'DAMAGECOUNT': '1.650', 'weapon2': '1.970', 'FRAGCOUNT': '4.000'} [2023-02-24 17:42:49,542][177153] Updated weights for policy 0, policy_version 4080 (0.0008) [2023-02-24 17:42:51,376][177119] Fps is (10 sec: 13926.5, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 16736256. Throughput: 0: 3512.4. Samples: 4178114. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:42:51,376][177119] Avg episode reward: [(0, '0.161')] [2023-02-24 17:42:52,434][177153] Updated weights for policy 0, policy_version 4090 (0.0008) [2023-02-24 17:42:55,326][177153] Updated weights for policy 0, policy_version 4100 (0.0009) [2023-02-24 17:42:56,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 16805888. Throughput: 0: 3514.7. Samples: 4199248. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:42:56,376][177119] Avg episode reward: [(0, '0.161')] [2023-02-24 17:42:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000004103_16805888.pth... [2023-02-24 17:42:56,437][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000003280_13434880.pth [2023-02-24 17:42:58,262][177153] Updated weights for policy 0, policy_version 4110 (0.0008) [2023-02-24 17:43:01,184][177153] Updated weights for policy 0, policy_version 4120 (0.0008) [2023-02-24 17:43:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14063.0, 300 sec: 14051.4). Total num frames: 16875520. Throughput: 0: 3514.3. Samples: 4220280. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:43:01,376][177119] Avg episode reward: [(0, '0.161')] [2023-02-24 17:43:02,478][177170] DAMAGECOUNT value on done: 13895.0 [2023-02-24 17:43:02,479][177170] Sum rewards: -2.832, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.642', 'AMMO5': '0.015', 'AMMO2': '0.026', 'WEAPON1': '0.050', 'ARMOR': '0.088', 'AMMO4': '0.127', 'AMMO3': '0.137', 'weapon5': '0.140', 'WEAPON4': '0.200', 'HITCOUNT': '0.230', 'weapon4': '0.288', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.840', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.378', 'weapon3': '1.840'} [2023-02-24 17:43:02,772][177170] DAMAGECOUNT value on done: 16140.0 [2023-02-24 17:43:02,785][177170] DAMAGECOUNT value on done: 13585.0 [2023-02-24 17:43:02,786][177170] Sum rewards: -0.330, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.074', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO5': '0.024', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'ARMOR': '0.072', 'AMMO3': '0.128', 'weapon5': '0.192', 'weapon4': '0.226', 'HITCOUNT': '0.270', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.197', 'weapon2': '1.302', 'weapon3': '2.014', 'FRAGCOUNT': '3.000'} [2023-02-24 17:43:02,915][177158] DAMAGECOUNT value on done: 14812.0 [2023-02-24 17:43:03,089][177170] DAMAGECOUNT value on done: 16533.0 [2023-02-24 17:43:03,089][177170] Sum rewards: -0.537, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.545', 'AMMO5': '0.019', 'AMMO2': '0.033', 'ARMOR': '0.044', 'WEAPON4': '0.050', 'WEAPON1': '0.080', 'AMMO3': '0.105', 'HITCOUNT': '0.120', 'AMMO4': '0.164', 'weapon5': '0.208', 'weapon4': '0.272', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.124', 'DAMAGECOUNT': '1.155', 'weapon3': '1.834', 'FRAGCOUNT': '2.000'} [2023-02-24 17:43:03,213][177158] DAMAGECOUNT value on done: 13886.0 [2023-02-24 17:43:03,214][177158] Sum rewards: -2.529, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.562', 'AMMO2': '0.009', 'AMMO5': '0.024', 'AMMO4': '0.042', 'weapon4': '0.054', 'ARMOR': '0.064', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.200', 'AMMO3': '0.232', 'HITCOUNT': '0.410', 'WEAPON5': '0.500', 'weapon2': '0.912', 'WEAPON3': '1.400', 'DAMAGECOUNT': '1.695', 'weapon3': '2.312', 'FRAGCOUNT': '4.000'} [2023-02-24 17:43:03,363][177172] DAMAGECOUNT value on done: 13083.0 [2023-02-24 17:43:03,363][177172] Sum rewards: -1.154, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.314', 'AMMO5': '0.013', 'AMMO2': '0.013', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.066', 'weapon5': '0.086', 'AMMO3': '0.138', 'HITCOUNT': '0.220', 'weapon4': '0.228', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'weapon2': '0.848', 'DAMAGECOUNT': '1.176', 'weapon3': '2.172', 'FRAGCOUNT': '3.000'} [2023-02-24 17:43:03,605][177158] DAMAGECOUNT value on done: 14019.0 [2023-02-24 17:43:03,606][177158] Sum rewards: 1.375, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.545', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.056', 'AMMO3': '0.106', 'WEAPON5': '0.200', 'weapon5': '0.210', 'HITCOUNT': '0.320', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.089', 'weapon2': '1.456', 'weapon3': '1.722', 'FRAGCOUNT': '3.000'} [2023-02-24 17:43:03,618][177154] DAMAGECOUNT value on done: 15170.0 [2023-02-24 17:43:03,618][177154] Sum rewards: -1.501, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.061', 'AMMO4': '-0.062', 'AMMO2': '-0.012', 'AMMO5': '0.030', 'WEAPON1': '0.050', 'ARMOR': '0.064', 'weapon5': '0.108', 'AMMO3': '0.130', 'HITCOUNT': '0.140', 'DAMAGECOUNT': '0.384', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'weapon2': '1.396', 'FRAGCOUNT': '2.000', 'weapon3': '2.282'} [2023-02-24 17:43:03,665][177172] DAMAGECOUNT value on done: 13112.0 [2023-02-24 17:43:03,665][177172] Sum rewards: -4.020, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.618', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.023', 'WEAPON1': '0.030', 'ARMOR': '0.072', 'AMMO3': '0.105', 'weapon5': '0.220', 'HITCOUNT': '0.360', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.500', 'weapon2': '1.524', 'DAMAGECOUNT': '1.893', 'weapon3': '1.928'} [2023-02-24 17:43:03,915][177158] DAMAGECOUNT value on done: 14303.0 [2023-02-24 17:43:03,916][177158] Sum rewards: 3.115, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.324', 'AMMO2': '0.010', 'AMMO5': '0.020', 'AMMO4': '0.051', 'WEAPON1': '0.060', 'AMMO3': '0.124', 'HITCOUNT': '0.150', 'weapon5': '0.394', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'weapon2': '0.780', 'DAMAGECOUNT': '1.344', 'weapon3': '2.056', 'FRAGCOUNT': '4.000'} [2023-02-24 17:43:03,918][177154] DAMAGECOUNT value on done: 13466.0 [2023-02-24 17:43:03,919][177154] Sum rewards: -1.358, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.400', 'AMMO5': '0.007', 'weapon5': '0.016', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'ARMOR': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.114', 'AMMO3': '0.129', 'WEAPON5': '0.150', 'HITCOUNT': '0.190', 'weapon4': '0.232', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.540', 'weapon2': '0.942', 'weapon3': '1.620', 'FRAGCOUNT': '2.000'} [2023-02-24 17:43:04,070][177154] DAMAGECOUNT value on done: 15232.0 [2023-02-24 17:43:04,070][177154] Sum rewards: -1.323, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.686', 'AMMO2': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.042', 'ARMOR': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon5': '0.142', 'HITCOUNT': '0.210', 'WEAPON5': '0.300', 'weapon4': '0.404', 'WEAPON3': '0.600', 'weapon2': '0.652', 'DAMAGECOUNT': '0.813', 'FRAGCOUNT': '1.000', 'weapon3': '1.626'} [2023-02-24 17:43:04,149][177153] Updated weights for policy 0, policy_version 4130 (0.0009) [2023-02-24 17:43:04,370][177154] DAMAGECOUNT value on done: 15030.0 [2023-02-24 17:43:04,370][177154] Sum rewards: -1.033, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.250', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon4': '0.036', 'AMMO3': '0.080', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'ARMOR': '0.122', 'HITCOUNT': '0.160', 'weapon5': '0.178', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.429', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.244', 'weapon2': '1.934'} [2023-02-24 17:43:04,453][177172] DAMAGECOUNT value on done: 14654.0 [2023-02-24 17:43:04,453][177172] Sum rewards: 1.441, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.220', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'AMMO5': '0.007', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO3': '0.073', 'ARMOR': '0.100', 'weapon4': '0.114', 'weapon5': '0.126', 'HITCOUNT': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'weapon3': '1.364', 'weapon2': '1.548', 'DAMAGECOUNT': '1.860', 'FRAGCOUNT': '4.000'} [2023-02-24 17:43:04,534][177171] DAMAGECOUNT value on done: 14258.0 [2023-02-24 17:43:04,534][177171] Sum rewards: -0.524, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.917', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'ARMOR': '0.040', 'WEAPON4': '0.100', 'weapon4': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.113', 'HITCOUNT': '0.130', 'weapon5': '0.180', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.900', 'weapon2': '1.514', 'weapon3': '1.608', 'FRAGCOUNT': '3.000'} [2023-02-24 17:43:04,754][177172] DAMAGECOUNT value on done: 13064.0 [2023-02-24 17:43:04,754][177172] Sum rewards: -1.721, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO4': '0.036', 'AMMO3': '0.104', 'weapon5': '0.140', 'HITCOUNT': '0.150', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.405', 'HEALTH': '0.421', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.648', 'weapon2': '1.880'} [2023-02-24 17:43:04,831][177171] DAMAGECOUNT value on done: 14099.0 [2023-02-24 17:43:04,832][177171] Sum rewards: 1.330, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.503', 'AMMO2': '0.010', 'AMMO5': '0.018', 'AMMO4': '0.047', 'ARMOR': '0.052', 'WEAPON1': '0.060', 'AMMO3': '0.091', 'weapon5': '0.130', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'weapon4': '0.236', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.675', 'weapon3': '1.560', 'weapon2': '1.644', 'FRAGCOUNT': '2.000'} [2023-02-24 17:43:04,832][177157] DAMAGECOUNT value on done: 15666.0 [2023-02-24 17:43:04,833][177157] Sum rewards: 0.309, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.010', 'AMMO2': '0.017', 'AMMO5': '0.017', 'weapon4': '0.028', 'ARMOR': '0.068', 'WEAPON1': '0.070', 'AMMO3': '0.077', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'weapon5': '0.178', 'HITCOUNT': '0.220', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.795', 'weapon3': '1.434', 'weapon2': '1.978', 'FRAGCOUNT': '2.000'} [2023-02-24 17:43:05,095][177155] DAMAGECOUNT value on done: 13890.0 [2023-02-24 17:43:05,095][177155] Sum rewards: -0.851, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.260', 'AMMO2': '0.007', 'AMMO5': '0.014', 'AMMO4': '0.035', 'WEAPON1': '0.050', 'ARMOR': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'weapon5': '0.138', 'HITCOUNT': '0.180', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.585', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.264', 'weapon2': '1.746'} [2023-02-24 17:43:05,125][177157] DAMAGECOUNT value on done: 15799.0 [2023-02-24 17:43:05,134][177171] DAMAGECOUNT value on done: 13378.0 [2023-02-24 17:43:05,134][177157] DAMAGECOUNT value on done: 15546.0 [2023-02-24 17:43:05,135][177157] Sum rewards: 5.566, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.346', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'AMMO3': '0.090', 'AMMO4': '0.102', 'weapon5': '0.118', 'WEAPON5': '0.250', 'HITCOUNT': '0.320', 'ARMOR': '0.408', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.056', 'weapon2': '1.588', 'weapon3': '1.962', 'FRAGCOUNT': '4.000'} [2023-02-24 17:43:05,135][177171] Sum rewards: 0.163, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.306', 'AMMO2': '0.008', 'AMMO5': '0.012', 'ARMOR': '0.040', 'WEAPON1': '0.040', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'AMMO3': '0.137', 'HITCOUNT': '0.170', 'weapon4': '0.196', 'weapon5': '0.208', 'WEAPON5': '0.250', 'WEAPON3': '0.700', 'weapon2': '0.832', 'DAMAGECOUNT': '0.915', 'FRAGCOUNT': '1.000', 'weapon3': '2.120'} [2023-02-24 17:43:05,395][177155] DAMAGECOUNT value on done: 14790.0 [2023-02-24 17:43:05,395][177155] Sum rewards: 4.878, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.555', 'AMMO5': '0.005', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'weapon7': '0.058', 'AMMO3': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.220', 'weapon4': '0.234', 'WEAPON3': '0.450', 'weapon3': '1.204', 'weapon2': '1.270', 'DAMAGECOUNT': '1.668', 'FRAGCOUNT': '4.000'} [2023-02-24 17:43:05,428][177171] DAMAGECOUNT value on done: 13981.0 [2023-02-24 17:43:05,429][177171] Sum rewards: -1.705, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.849', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.010', 'WEAPON1': '0.050', 'ARMOR': '0.072', 'AMMO3': '0.099', 'HITCOUNT': '0.150', 'weapon5': '0.194', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.092', 'weapon3': '1.380', 'weapon2': '2.028', 'FRAGCOUNT': '3.000'} [2023-02-24 17:43:05,431][177157] DAMAGECOUNT value on done: 14743.0 [2023-02-24 17:43:05,431][177157] Sum rewards: -1.801, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.330', 'weapon5': '0.002', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.031', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'weapon4': '0.144', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'DAMAGECOUNT': '0.780', 'WEAPON3': '0.950', 'ARMOR': '1.077', 'weapon2': '1.420', 'weapon3': '1.594', 'FRAGCOUNT': '2.000'} [2023-02-24 17:43:05,511][177155] DAMAGECOUNT value on done: 16636.0 [2023-02-24 17:43:05,511][177155] Sum rewards: 0.710, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.801', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.032', 'WEAPON1': '0.040', 'ARMOR': '0.072', 'AMMO3': '0.074', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'HITCOUNT': '0.200', 'weapon5': '0.244', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.107', 'weapon3': '1.204', 'weapon2': '1.580', 'FRAGCOUNT': '2.000'} [2023-02-24 17:43:05,811][177155] DAMAGECOUNT value on done: 13625.0 [2023-02-24 17:43:05,812][177155] Sum rewards: 0.970, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.890', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'weapon4': '0.002', 'AMMO5': '0.012', 'ARMOR': '0.020', 'WEAPON1': '0.060', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.150', 'weapon5': '0.192', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.017', 'weapon3': '1.258', 'weapon2': '1.854', 'FRAGCOUNT': '4.000'} [2023-02-24 17:43:06,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 16945152. Throughput: 0: 3512.2. Samples: 4230714. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:43:06,376][177119] Avg episode reward: [(0, '0.096')] [2023-02-24 17:43:07,055][177153] Updated weights for policy 0, policy_version 4140 (0.0008) [2023-02-24 17:43:07,822][177156] DAMAGECOUNT value on done: 14258.0 [2023-02-24 17:43:07,822][177156] Sum rewards: -4.136, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.222', 'FRAGCOUNT': '-1.000', 'AMMO5': '0.012', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'ARMOR': '0.084', 'weapon5': '0.088', 'AMMO4': '0.097', 'AMMO3': '0.146', 'HITCOUNT': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.286', 'WEAPON5': '0.300', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.143', 'weapon2': '1.162', 'weapon3': '1.828'} [2023-02-24 17:43:08,132][177156] DAMAGECOUNT value on done: 15120.0 [2023-02-24 17:43:08,133][177156] Sum rewards: -4.981, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.080', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO5': '0.025', 'WEAPON1': '0.040', 'AMMO3': '0.158', 'weapon5': '0.192', 'HITCOUNT': '0.210', 'WEAPON5': '0.450', 'DAMAGECOUNT': '0.675', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '1.302', 'weapon3': '1.824'} [2023-02-24 17:43:08,258][177156] DAMAGECOUNT value on done: 14710.0 [2023-02-24 17:43:08,258][177156] Sum rewards: -1.346, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.233', 'AMMO2': '0.006', 'AMMO5': '0.025', 'ARMOR': '0.028', 'AMMO4': '0.031', 'WEAPON1': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.108', 'AMMO3': '0.116', 'HITCOUNT': '0.200', 'weapon5': '0.260', 'WEAPON5': '0.650', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.338', 'weapon3': '1.398', 'weapon2': '1.526', 'FRAGCOUNT': '3.000'} [2023-02-24 17:43:08,554][177156] DAMAGECOUNT value on done: 16777.0 [2023-02-24 17:43:08,554][177156] Sum rewards: 3.905, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.070', 'AMMO4': '0.119', 'HITCOUNT': '0.170', 'WEAPON5': '0.200', 'HEALTH': '0.218', 'weapon5': '0.240', 'WEAPON3': '0.350', 'ARMOR': '0.500', 'DAMAGECOUNT': '0.582', 'FRAGCOUNT': '1.000', 'weapon2': '1.596', 'weapon3': '1.806'} [2023-02-24 17:43:09,942][177153] Updated weights for policy 0, policy_version 4150 (0.0008) [2023-02-24 17:43:11,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 14051.4). Total num frames: 17014784. Throughput: 0: 3513.7. Samples: 4251810. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:43:11,376][177119] Avg episode reward: [(0, '0.078')] [2023-02-24 17:43:12,845][177153] Updated weights for policy 0, policy_version 4160 (0.0008) [2023-02-24 17:43:15,730][177153] Updated weights for policy 0, policy_version 4170 (0.0008) [2023-02-24 17:43:16,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 17088512. Throughput: 0: 3514.2. Samples: 4272960. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:43:16,376][177119] Avg episode reward: [(0, '0.078')] [2023-02-24 17:43:18,641][177153] Updated weights for policy 0, policy_version 4180 (0.0008) [2023-02-24 17:43:21,376][177119] Fps is (10 sec: 14335.9, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 17158144. Throughput: 0: 3513.3. Samples: 4283490. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:43:21,376][177119] Avg episode reward: [(0, '0.078')] [2023-02-24 17:43:21,504][177170] DAMAGECOUNT value on done: 14314.0 [2023-02-24 17:43:21,505][177170] Sum rewards: 0.275, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.574', 'AMMO5': '0.010', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'AMMO4': '0.114', 'AMMO3': '0.121', 'weapon5': '0.126', 'WEAPON4': '0.200', 'HITCOUNT': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.336', 'ARMOR': '0.436', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.257', 'weapon3': '1.416', 'weapon2': '1.620', 'FRAGCOUNT': '3.000'} [2023-02-24 17:43:21,567][177153] Updated weights for policy 0, policy_version 4190 (0.0008) [2023-02-24 17:43:21,772][177170] DAMAGECOUNT value on done: 13989.0 [2023-02-24 17:43:21,773][177170] Sum rewards: 2.215, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.735', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON1': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.090', 'weapon5': '0.112', 'HITCOUNT': '0.160', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'ARMOR': '0.424', 'weapon3': '1.152', 'DAMAGECOUNT': '1.212', 'weapon2': '1.614', 'FRAGCOUNT': '2.000'} [2023-02-24 17:43:21,819][177170] DAMAGECOUNT value on done: 16330.0 [2023-02-24 17:43:21,820][177170] Sum rewards: -0.875, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.896', 'AMMO2': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.019', 'weapon5': '0.066', 'ARMOR': '0.092', 'WEAPON5': '0.100', 'HITCOUNT': '0.130', 'AMMO3': '0.131', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.750', 'weapon2': '1.582', 'FRAGCOUNT': '2.000', 'weapon3': '2.062'} [2023-02-24 17:43:22,030][177158] DAMAGECOUNT value on done: 15233.0 [2023-02-24 17:43:22,031][177158] Sum rewards: 3.585, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.826', 'AMMO2': '0.004', 'AMMO5': '0.011', 'AMMO4': '0.018', 'WEAPON1': '0.050', 'AMMO3': '0.110', 'weapon5': '0.180', 'WEAPON5': '0.300', 'HITCOUNT': '0.340', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.263', 'weapon2': '1.422', 'weapon3': '2.062', 'FRAGCOUNT': '4.000'} [2023-02-24 17:43:22,077][177170] DAMAGECOUNT value on done: 16928.0 [2023-02-24 17:43:22,078][177170] Sum rewards: 6.352, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.010', 'AMMO2': '0.036', 'WEAPON1': '0.050', 'weapon7': '0.078', 'AMMO3': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.178', 'weapon5': '0.206', 'HITCOUNT': '0.240', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HEALTH': '0.585', 'DAMAGECOUNT': '1.185', 'weapon3': '1.506', 'weapon2': '1.898', 'FRAGCOUNT': '6.000'} [2023-02-24 17:43:22,331][177158] DAMAGECOUNT value on done: 14526.0 [2023-02-24 17:43:22,332][177158] Sum rewards: 4.332, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.770', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.015', 'WEAPON1': '0.050', 'AMMO3': '0.092', 'weapon5': '0.272', 'HITCOUNT': '0.320', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'weapon3': '1.350', 'DAMAGECOUNT': '1.920', 'weapon2': '1.982', 'FRAGCOUNT': '6.000'} [2023-02-24 17:43:22,524][177172] DAMAGECOUNT value on done: 13817.0 [2023-02-24 17:43:22,525][177172] Sum rewards: 2.528, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.247', 'ARMOR': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.024', 'WEAPON4': '0.050', 'AMMO3': '0.095', 'WEAPON1': '0.100', 'AMMO4': '0.117', 'HITCOUNT': '0.180', 'weapon5': '0.284', 'WEAPON5': '0.600', 'WEAPON3': '0.650', 'weapon2': '1.306', 'weapon3': '1.624', 'DAMAGECOUNT': '2.202', 'FRAGCOUNT': '4.000'} [2023-02-24 17:43:22,762][177158] DAMAGECOUNT value on done: 14334.0 [2023-02-24 17:43:22,762][177158] Sum rewards: -4.226, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.430', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.015', 'WEAPON1': '0.050', 'AMMO3': '0.124', 'weapon5': '0.214', 'HITCOUNT': '0.220', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.945', 'weapon2': '1.566', 'weapon3': '1.694'} [2023-02-24 17:43:22,806][177154] DAMAGECOUNT value on done: 15847.0 [2023-02-24 17:43:22,807][177154] Sum rewards: 1.547, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.482', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'ARMOR': '0.012', 'AMMO5': '0.024', 'WEAPON1': '0.060', 'AMMO3': '0.116', 'HITCOUNT': '0.150', 'weapon5': '0.266', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'weapon3': '1.364', 'weapon2': '1.900', 'DAMAGECOUNT': '1.986', 'FRAGCOUNT': '4.000'} [2023-02-24 17:43:22,828][177172] DAMAGECOUNT value on done: 13342.0 [2023-02-24 17:43:22,829][177172] Sum rewards: -2.515, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.918', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.030', 'ARMOR': '0.068', 'WEAPON1': '0.070', 'HITCOUNT': '0.140', 'AMMO3': '0.151', 'weapon5': '0.194', 'WEAPON5': '0.650', 'DAMAGECOUNT': '0.690', 'WEAPON3': '0.800', 'weapon3': '1.592', 'weapon2': '1.778', 'FRAGCOUNT': '2.000'} [2023-02-24 17:43:23,054][177158] DAMAGECOUNT value on done: 14642.0 [2023-02-24 17:43:23,054][177158] Sum rewards: -1.464, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.520', 'AMMO5': '0.011', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'weapon7': '0.042', 'ARMOR': '0.048', 'AMMO4': '0.074', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.160', 'weapon5': '0.198', 'WEAPON4': '0.200', 'HITCOUNT': '0.240', 'weapon4': '0.248', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.017', 'weapon2': '1.352', 'weapon3': '1.820', 'FRAGCOUNT': '3.000'} [2023-02-24 17:43:23,105][177154] DAMAGECOUNT value on done: 13977.0 [2023-02-24 17:43:23,105][177154] Sum rewards: 1.820, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.465', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO5': '0.015', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.120', 'weapon5': '0.122', 'weapon4': '0.214', 'WEAPON5': '0.300', 'HITCOUNT': '0.390', 'WEAPON3': '0.600', 'weapon3': '1.292', 'DAMAGECOUNT': '1.533', 'weapon2': '1.766', 'FRAGCOUNT': '4.000'} [2023-02-24 17:43:23,254][177154] DAMAGECOUNT value on done: 15785.0 [2023-02-24 17:43:23,254][177154] Sum rewards: -1.555, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.904', 'AMMO5': '0.017', 'ARMOR': '0.036', 'AMMO2': '0.045', 'WEAPON1': '0.070', 'weapon4': '0.070', 'AMMO3': '0.092', 'WEAPON4': '0.200', 'AMMO4': '0.228', 'weapon5': '0.228', 'HITCOUNT': '0.270', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon2': '1.366', 'DAMAGECOUNT': '1.659', 'weapon3': '1.868', 'FRAGCOUNT': '3.500'} [2023-02-24 17:43:23,555][177154] DAMAGECOUNT value on done: 15544.0 [2023-02-24 17:43:23,556][177154] Sum rewards: 0.117, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.530', 'AMMO2': '0.007', 'AMMO5': '0.009', 'ARMOR': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.034', 'AMMO3': '0.161', 'weapon5': '0.180', 'WEAPON5': '0.250', 'HITCOUNT': '0.340', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.542', 'weapon2': '1.742', 'weapon3': '1.782', 'FRAGCOUNT': '2.000'} [2023-02-24 17:43:23,566][177172] DAMAGECOUNT value on done: 14838.0 [2023-02-24 17:43:23,567][177172] Sum rewards: 0.982, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.532', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.054', 'AMMO3': '0.061', 'weapon5': '0.104', 'HITCOUNT': '0.110', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.278', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.552', 'ARMOR': '0.813', 'weapon3': '0.990', 'FRAGCOUNT': '1.000', 'weapon2': '1.316'} [2023-02-24 17:43:23,690][177171] DAMAGECOUNT value on done: 14673.0 [2023-02-24 17:43:23,690][177171] Sum rewards: -2.297, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.260', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO5': '0.017', 'ARMOR': '0.076', 'WEAPON1': '0.090', 'AMMO3': '0.103', 'HITCOUNT': '0.150', 'weapon5': '0.252', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.245', 'weapon2': '1.384', 'weapon3': '1.444', 'FRAGCOUNT': '3.000'} [2023-02-24 17:43:23,857][177172] DAMAGECOUNT value on done: 13254.0 [2023-02-24 17:43:23,947][177157] DAMAGECOUNT value on done: 15889.0 [2023-02-24 17:43:23,947][177157] Sum rewards: -3.915, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.710', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'weapon7': '0.012', 'weapon4': '0.014', 'AMMO5': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.052', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.200', 'AMMO3': '0.260', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.669', 'weapon2': '1.092', 'WEAPON3': '1.200', 'weapon3': '2.546', 'FRAGCOUNT': '3.000'} [2023-02-24 17:43:23,992][177171] DAMAGECOUNT value on done: 14418.0 [2023-02-24 17:43:23,993][177171] Sum rewards: 2.935, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.910', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.030', 'AMMO4': '0.039', 'AMMO3': '0.062', 'WEAPON4': '0.100', 'weapon5': '0.176', 'HITCOUNT': '0.200', 'weapon4': '0.224', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.957', 'weapon3': '1.012', 'FRAGCOUNT': '2.000', 'weapon2': '2.180'} [2023-02-24 17:43:24,222][177155] DAMAGECOUNT value on done: 14341.0 [2023-02-24 17:43:24,222][177155] Sum rewards: 1.078, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.821', 'AMMO5': '0.013', 'AMMO2': '0.015', 'WEAPON1': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.114', 'HITCOUNT': '0.250', 'weapon5': '0.276', 'WEAPON5': '0.300', 'ARMOR': '0.416', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.353', 'weapon3': '1.446', 'weapon2': '1.940', 'FRAGCOUNT': '4.000'} [2023-02-24 17:43:24,249][177157] DAMAGECOUNT value on done: 15998.0 [2023-02-24 17:43:24,249][177157] Sum rewards: 0.603, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.250', 'AMMO2': '0.003', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.016', 'WEAPON1': '0.060', 'AMMO3': '0.089', 'HITCOUNT': '0.160', 'weapon5': '0.232', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.597', 'FRAGCOUNT': '1.000', 'weapon2': '1.342', 'weapon3': '1.930'} [2023-02-24 17:43:24,259][177157] DAMAGECOUNT value on done: 16039.0 [2023-02-24 17:43:24,259][177157] Sum rewards: -2.081, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.658', 'AMMO5': '0.018', 'ARMOR': '0.028', 'AMMO2': '0.030', 'WEAPON1': '0.070', 'AMMO3': '0.146', 'AMMO4': '0.150', 'weapon5': '0.186', 'HITCOUNT': '0.280', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'weapon2': '1.456', 'DAMAGECOUNT': '1.479', 'weapon3': '1.734', 'FRAGCOUNT': '2.500'} [2023-02-24 17:43:24,303][177171] DAMAGECOUNT value on done: 13680.0 [2023-02-24 17:43:24,304][177171] Sum rewards: -0.318, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.826', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.145', 'WEAPON5': '0.150', 'weapon5': '0.208', 'weapon4': '0.254', 'HITCOUNT': '0.290', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.906', 'weapon3': '1.536', 'weapon2': '1.540', 'FRAGCOUNT': '3.000'} [2023-02-24 17:43:24,528][177153] Updated weights for policy 0, policy_version 4200 (0.0009) [2023-02-24 17:43:24,532][177155] DAMAGECOUNT value on done: 15634.0 [2023-02-24 17:43:24,532][177155] Sum rewards: 2.729, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.580', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.014', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.118', 'AMMO3': '0.184', 'weapon5': '0.206', 'WEAPON5': '0.300', 'HITCOUNT': '0.360', 'WEAPON3': '0.900', 'weapon2': '1.358', 'weapon3': '1.884', 'DAMAGECOUNT': '2.532', 'FRAGCOUNT': '6.000'} [2023-02-24 17:43:24,563][177157] DAMAGECOUNT value on done: 15135.0 [2023-02-24 17:43:24,604][177171] DAMAGECOUNT value on done: 14483.0 [2023-02-24 17:43:24,605][177171] Sum rewards: 0.166, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.080', 'AMMO5': '0.021', 'AMMO2': '0.022', 'WEAPON1': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.138', 'HITCOUNT': '0.360', 'weapon5': '0.382', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'weapon3': '1.472', 'DAMAGECOUNT': '1.506', 'weapon2': '1.696', 'FRAGCOUNT': '3.000'} [2023-02-24 17:43:24,650][177155] DAMAGECOUNT value on done: 17169.0 [2023-02-24 17:43:24,650][177155] Sum rewards: 2.183, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.005', 'AMMO5': '0.015', 'AMMO2': '0.015', 'WEAPON1': '0.060', 'AMMO4': '0.077', 'AMMO3': '0.124', 'weapon5': '0.228', 'HITCOUNT': '0.290', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'weapon2': '1.492', 'weapon3': '1.588', 'DAMAGECOUNT': '1.599', 'FRAGCOUNT': '5.000'} [2023-02-24 17:43:24,938][177155] DAMAGECOUNT value on done: 14125.0 [2023-02-24 17:43:24,939][177155] Sum rewards: 0.561, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.015', 'AMMO2': '0.033', 'ARMOR': '0.044', 'weapon4': '0.062', 'WEAPON1': '0.070', 'AMMO3': '0.126', 'weapon5': '0.132', 'AMMO4': '0.163', 'HEALTH': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'HITCOUNT': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.500', 'weapon2': '1.550', 'weapon3': '1.868', 'FRAGCOUNT': '3.000'} [2023-02-24 17:43:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 17227776. Throughput: 0: 3508.6. Samples: 4304418. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 17:43:26,376][177119] Avg episode reward: [(0, '0.139')] [2023-02-24 17:43:27,067][177156] DAMAGECOUNT value on done: 14588.0 [2023-02-24 17:43:27,067][177156] Sum rewards: -5.259, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.834', 'AMMO2': '0.011', 'AMMO5': '0.027', 'AMMO4': '0.053', 'WEAPON1': '0.110', 'AMMO3': '0.176', 'weapon5': '0.206', 'HITCOUNT': '0.280', 'WEAPON5': '0.650', 'DAMAGECOUNT': '0.990', 'WEAPON3': '1.050', 'weapon2': '1.314', 'weapon3': '1.958', 'FRAGCOUNT': '2.000'} [2023-02-24 17:43:27,355][177156] DAMAGECOUNT value on done: 15607.0 [2023-02-24 17:43:27,355][177156] Sum rewards: 1.707, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.810', 'AMMO2': '0.016', 'AMMO5': '0.017', 'ARMOR': '0.048', 'WEAPON1': '0.050', 'AMMO4': '0.081', 'AMMO3': '0.111', 'weapon5': '0.152', 'HITCOUNT': '0.380', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.461', 'weapon2': '1.650', 'weapon3': '1.850', 'FRAGCOUNT': '3.000'} [2023-02-24 17:43:27,420][177153] Updated weights for policy 0, policy_version 4210 (0.0008) [2023-02-24 17:43:27,505][177156] DAMAGECOUNT value on done: 15207.0 [2023-02-24 17:43:27,505][177156] Sum rewards: -1.220, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.488', 'AMMO2': '0.016', 'AMMO5': '0.017', 'weapon4': '0.040', 'WEAPON1': '0.050', 'ARMOR': '0.064', 'AMMO4': '0.081', 'weapon5': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.125', 'HITCOUNT': '0.320', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'weapon2': '1.248', 'DAMAGECOUNT': '1.491', 'FRAGCOUNT': '2.000', 'weapon3': '2.220'} [2023-02-24 17:43:27,803][177156] DAMAGECOUNT value on done: 16978.0 [2023-02-24 17:43:27,803][177156] Sum rewards: -1.201, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.620', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'ARMOR': '0.064', 'weapon7': '0.064', 'weapon5': '0.086', 'AMMO4': '0.086', 'HITCOUNT': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.376', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.603', 'FRAGCOUNT': '1.000', 'weapon3': '1.294', 'weapon2': '1.854'} [2023-02-24 17:43:30,340][177153] Updated weights for policy 0, policy_version 4220 (0.0008) [2023-02-24 17:43:31,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 17297408. Throughput: 0: 3515.1. Samples: 4325632. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:43:31,376][177119] Avg episode reward: [(0, '0.091')] [2023-02-24 17:43:33,236][177153] Updated weights for policy 0, policy_version 4230 (0.0008) [2023-02-24 17:43:36,168][177153] Updated weights for policy 0, policy_version 4240 (0.0008) [2023-02-24 17:43:36,376][177119] Fps is (10 sec: 13926.5, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 17367040. Throughput: 0: 3513.0. Samples: 4336198. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:43:36,376][177119] Avg episode reward: [(0, '0.091')] [2023-02-24 17:43:39,087][177153] Updated weights for policy 0, policy_version 4250 (0.0009) [2023-02-24 17:43:40,583][177170] DAMAGECOUNT value on done: 14810.0 [2023-02-24 17:43:40,583][177170] Sum rewards: -0.895, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.561', 'AMMO5': '0.012', 'AMMO2': '0.031', 'ARMOR': '0.034', 'WEAPON1': '0.060', 'AMMO3': '0.136', 'weapon5': '0.136', 'AMMO4': '0.154', 'WEAPON4': '0.250', 'HITCOUNT': '0.290', 'WEAPON5': '0.300', 'weapon4': '0.440', 'WEAPON3': '0.750', 'weapon2': '0.784', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.488', 'weapon3': '2.050'} [2023-02-24 17:43:40,842][177170] DAMAGECOUNT value on done: 14246.0 [2023-02-24 17:43:40,842][177170] Sum rewards: 4.094, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.026', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'weapon5': '0.056', 'WEAPON1': '0.060', 'AMMO3': '0.123', 'WEAPON5': '0.200', 'HITCOUNT': '0.270', 'ARMOR': '0.509', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.771', 'weapon2': '1.274', 'weapon3': '2.354', 'FRAGCOUNT': '4.000'} [2023-02-24 17:43:40,862][177157] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 17:43:40,893][177170] DAMAGECOUNT value on done: 16983.0 [2023-02-24 17:43:40,894][177170] Sum rewards: 2.442, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.804', 'AMMO5': '0.014', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'weapon7': '0.048', 'AMMO3': '0.095', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.204', 'weapon5': '0.228', 'HITCOUNT': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'weapon3': '1.206', 'weapon2': '1.368', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.959'} [2023-02-24 17:43:41,046][177158] DAMAGECOUNT value on done: 15548.0 [2023-02-24 17:43:41,046][177158] Sum rewards: 2.294, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.060', 'AMMO2': '0.007', 'AMMO5': '0.012', 'AMMO4': '0.034', 'WEAPON1': '0.050', 'ARMOR': '0.050', 'weapon4': '0.084', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.226', 'HITCOUNT': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.945', 'weapon2': '1.288', 'weapon3': '1.918', 'FRAGCOUNT': '2.000'} [2023-02-24 17:43:41,073][177172] Large shaping reward -2.534 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 17:43:41,155][177170] DAMAGECOUNT value on done: 17733.0 [2023-02-24 17:43:41,155][177170] Sum rewards: -0.416, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.276', 'AMMO2': '0.004', 'AMMO4': '0.021', 'AMMO5': '0.025', 'ARMOR': '0.028', 'WEAPON1': '0.050', 'weapon5': '0.116', 'AMMO3': '0.179', 'HITCOUNT': '0.420', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon2': '1.602', 'weapon3': '2.000', 'DAMAGECOUNT': '2.415', 'FRAGCOUNT': '4.000'} [2023-02-24 17:43:41,352][177158] DAMAGECOUNT value on done: 14671.0 [2023-02-24 17:43:41,352][177158] Sum rewards: -0.916, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.215', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.008', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'ARMOR': '0.112', 'AMMO3': '0.136', 'HITCOUNT': '0.140', 'weapon4': '0.148', 'weapon5': '0.172', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.700', 'weapon3': '1.500', 'weapon2': '1.736', 'FRAGCOUNT': '3.000'} [2023-02-24 17:43:41,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13994.7, 300 sec: 14051.4). Total num frames: 17436672. Throughput: 0: 3512.2. Samples: 4357296. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:43:41,376][177119] Avg episode reward: [(0, '0.031')] [2023-02-24 17:43:41,664][177172] DAMAGECOUNT value on done: 14150.0 [2023-02-24 17:43:41,666][177172] Sum rewards: 0.036, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.017', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon7': '0.048', 'WEAPON1': '0.050', 'ARMOR': '0.052', 'AMMO3': '0.076', 'AMMO4': '0.095', 'HITCOUNT': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.216', 'weapon5': '0.280', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.999', 'FRAGCOUNT': '1.000', 'weapon2': '1.138', 'weapon3': '1.420'} [2023-02-24 17:43:41,867][177158] DAMAGECOUNT value on done: 14374.0 [2023-02-24 17:43:41,923][177154] DAMAGECOUNT value on done: 16461.0 [2023-02-24 17:43:41,923][177154] Sum rewards: -1.557, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.344', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'ARMOR': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.154', 'weapon4': '0.162', 'weapon5': '0.176', 'HITCOUNT': '0.330', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'weapon3': '1.488', 'weapon2': '1.590', 'DAMAGECOUNT': '1.842', 'FRAGCOUNT': '4.000'} [2023-02-24 17:43:41,959][177172] DAMAGECOUNT value on done: 13787.0 [2023-02-24 17:43:41,959][177172] Sum rewards: 1.746, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.752', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.032', 'WEAPON4': '0.050', 'weapon7': '0.054', 'ARMOR': '0.060', 'weapon4': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.114', 'AMMO3': '0.117', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'HITCOUNT': '0.240', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.335', 'weapon2': '1.658', 'weapon3': '1.670', 'FRAGCOUNT': '4.000'} [2023-02-24 17:43:42,006][177153] Updated weights for policy 0, policy_version 4260 (0.0008) [2023-02-24 17:43:42,160][177158] DAMAGECOUNT value on done: 14700.0 [2023-02-24 17:43:42,161][177158] Sum rewards: -0.328, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.626', 'AMMO5': '0.008', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'HITCOUNT': '0.060', 'AMMO4': '0.064', 'AMMO3': '0.095', 'weapon4': '0.120', 'weapon5': '0.144', 'DAMAGECOUNT': '0.174', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'ARMOR': '0.888', 'FRAGCOUNT': '1.000', 'weapon2': '1.286', 'weapon3': '1.486'} [2023-02-24 17:43:42,227][177154] DAMAGECOUNT value on done: 14335.0 [2023-02-24 17:43:42,384][177154] DAMAGECOUNT value on done: 16255.0 [2023-02-24 17:43:42,385][177154] Sum rewards: 2.060, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.343', 'AMMO2': '0.006', 'AMMO5': '0.025', 'AMMO4': '0.029', 'AMMO3': '0.098', 'WEAPON1': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.226', 'HITCOUNT': '0.280', 'weapon5': '0.410', 'WEAPON5': '0.600', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.410', 'weapon2': '1.446', 'weapon3': '1.522', 'FRAGCOUNT': '4.000'} [2023-02-24 17:43:42,684][177154] DAMAGECOUNT value on done: 15859.0 [2023-02-24 17:43:42,684][177154] Sum rewards: -1.744, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.489', 'AMMO5': '0.010', 'AMMO2': '0.014', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.068', 'weapon5': '0.112', 'AMMO3': '0.166', 'HITCOUNT': '0.170', 'weapon4': '0.240', 'WEAPON5': '0.300', 'weapon2': '0.940', 'DAMAGECOUNT': '0.945', 'WEAPON3': '0.950', 'weapon3': '1.940', 'FRAGCOUNT': '2.000'} [2023-02-24 17:43:42,733][177172] DAMAGECOUNT value on done: 15218.0 [2023-02-24 17:43:42,733][177172] Sum rewards: 0.368, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.017', 'AMMO5': '0.018', 'WEAPON1': '0.050', 'AMMO4': '0.084', 'AMMO3': '0.090', 'HITCOUNT': '0.160', 'weapon5': '0.222', 'HEALTH': '0.308', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.140', 'weapon3': '1.368', 'weapon2': '1.610', 'FRAGCOUNT': '2.000'} [2023-02-24 17:43:42,798][177171] DAMAGECOUNT value on done: 14918.0 [2023-02-24 17:43:42,798][177171] Sum rewards: -0.173, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.150', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.014', 'AMMO2': '0.026', 'ARMOR': '0.048', 'AMMO3': '0.049', 'WEAPON5': '0.050', 'HITCOUNT': '0.080', 'AMMO4': '0.132', 'weapon4': '0.192', 'WEAPON4': '0.200', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.735', 'weapon3': '0.794', 'FRAGCOUNT': '1.000', 'weapon2': '1.544'} [2023-02-24 17:43:43,045][177172] DAMAGECOUNT value on done: 13653.0 [2023-02-24 17:43:43,045][177172] Sum rewards: -5.409, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.556', 'AMMO2': '0.015', 'AMMO5': '0.021', 'WEAPON1': '0.060', 'AMMO4': '0.074', 'weapon4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.164', 'weapon5': '0.260', 'HITCOUNT': '0.330', 'WEAPON5': '0.450', 'FRAGCOUNT': '0.500', 'WEAPON3': '1.000', 'weapon2': '1.056', 'DAMAGECOUNT': '1.197', 'weapon3': '2.078'} [2023-02-24 17:43:43,075][177157] DAMAGECOUNT value on done: 16048.0 [2023-02-24 17:43:43,076][177157] Sum rewards: -1.249, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.323', 'AMMO2': '0.012', 'AMMO5': '0.030', 'AMMO4': '0.058', 'WEAPON1': '0.090', 'AMMO3': '0.098', 'HITCOUNT': '0.120', 'weapon5': '0.306', 'DAMAGECOUNT': '0.477', 'WEAPON3': '0.550', 'WEAPON5': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.358', 'weapon2': '2.024'} [2023-02-24 17:43:43,108][177171] DAMAGECOUNT value on done: 14821.0 [2023-02-24 17:43:43,109][177171] Sum rewards: 1.682, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.621', 'AMMO2': '0.015', 'AMMO5': '0.017', 'AMMO4': '0.076', 'WEAPON1': '0.090', 'AMMO3': '0.099', 'weapon5': '0.264', 'HITCOUNT': '0.270', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.209', 'weapon2': '1.514', 'weapon3': '1.798', 'FRAGCOUNT': '3.000'} [2023-02-24 17:43:43,354][177155] DAMAGECOUNT value on done: 14630.0 [2023-02-24 17:43:43,355][177155] Sum rewards: -3.709, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.525', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'weapon5': '0.002', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.149', 'WEAPON5': '0.200', 'HITCOUNT': '0.270', 'ARMOR': '0.495', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.867', 'weapon2': '1.082', 'weapon3': '1.976', 'FRAGCOUNT': '2.000'} [2023-02-24 17:43:43,364][177157] DAMAGECOUNT value on done: 16493.0 [2023-02-24 17:43:43,364][177157] Sum rewards: 5.602, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.346', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO5': '0.015', 'ARMOR': '0.032', 'AMMO3': '0.063', 'AMMO4': '0.067', 'weapon5': '0.116', 'HITCOUNT': '0.240', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'weapon3': '0.810', 'DAMAGECOUNT': '1.377', 'weapon2': '2.304', 'FRAGCOUNT': '4.000'} [2023-02-24 17:43:43,374][177157] DAMAGECOUNT value on done: 16381.0 [2023-02-24 17:43:43,375][177157] Sum rewards: -4.932, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.608', 'AMMO5': '0.020', 'AMMO2': '0.032', 'ARMOR': '0.073', 'WEAPON1': '0.080', 'AMMO3': '0.124', 'AMMO4': '0.159', 'HITCOUNT': '0.250', 'WEAPON4': '0.250', 'weapon5': '0.384', 'weapon4': '0.392', 'WEAPON5': '0.450', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.026', 'weapon3': '1.246', 'weapon2': '1.540'} [2023-02-24 17:43:43,412][177171] DAMAGECOUNT value on done: 14287.0 [2023-02-24 17:43:43,413][177171] Sum rewards: 3.064, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.296', 'AMMO2': '0.006', 'AMMO5': '0.017', 'ARMOR': '0.024', 'AMMO4': '0.028', 'WEAPON1': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON6': '0.100', 'AMMO3': '0.116', 'weapon5': '0.330', 'HITCOUNT': '0.350', 'WEAPON5': '0.400', 'weapon6': '0.528', 'WEAPON3': '0.600', 'weapon2': '0.900', 'weapon3': '1.610', 'DAMAGECOUNT': '1.821', 'FRAGCOUNT': '3.000'} [2023-02-24 17:43:43,653][177155] DAMAGECOUNT value on done: 15744.0 [2023-02-24 17:43:43,664][177157] DAMAGECOUNT value on done: 15375.0 [2023-02-24 17:43:43,665][177157] Sum rewards: 2.253, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.174', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'AMMO3': '0.051', 'AMMO4': '0.096', 'HITCOUNT': '0.140', 'weapon5': '0.218', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.720', 'weapon3': '0.818', 'FRAGCOUNT': '1.000', 'weapon2': '2.524'} [2023-02-24 17:43:43,724][177171] DAMAGECOUNT value on done: 14792.0 [2023-02-24 17:43:43,725][177171] Sum rewards: -1.778, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.302', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.012', 'AMMO2': '0.016', 'ARMOR': '0.050', 'WEAPON1': '0.070', 'AMMO4': '0.080', 'AMMO3': '0.082', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'weapon5': '0.252', 'weapon4': '0.280', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'weapon3': '0.912', 'DAMAGECOUNT': '0.927', 'weapon2': '2.202'} [2023-02-24 17:43:43,751][177155] DAMAGECOUNT value on done: 17863.0 [2023-02-24 17:43:43,752][177155] Sum rewards: -1.687, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.129', 'AMMO2': '0.005', 'AMMO5': '0.019', 'AMMO4': '0.023', 'ARMOR': '0.040', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'weapon5': '0.122', 'weapon4': '0.134', 'AMMO3': '0.165', 'WEAPON5': '0.400', 'HITCOUNT': '0.470', 'WEAPON3': '0.900', 'weapon3': '1.562', 'weapon2': '1.880', 'DAMAGECOUNT': '2.082', 'FRAGCOUNT': '3.000'} [2023-02-24 17:43:44,046][177155] DAMAGECOUNT value on done: 14367.0 [2023-02-24 17:43:44,047][177155] Sum rewards: -1.396, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.880', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon4': '0.028', 'weapon5': '0.068', 'AMMO4': '0.077', 'ARMOR': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.121', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.726', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.644', 'weapon2': '2.072'} [2023-02-24 17:43:44,941][177153] Updated weights for policy 0, policy_version 4270 (0.0008) [2023-02-24 17:43:46,215][177156] DAMAGECOUNT value on done: 15059.0 [2023-02-24 17:43:46,216][177156] Sum rewards: -1.301, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.415', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.033', 'ARMOR': '0.040', 'AMMO3': '0.052', 'WEAPON5': '0.100', 'weapon5': '0.114', 'HITCOUNT': '0.120', 'AMMO4': '0.163', 'WEAPON4': '0.300', 'WEAPON3': '0.300', 'weapon3': '1.078', 'DAMAGECOUNT': '1.413', 'weapon2': '1.886', 'FRAGCOUNT': '2.000'} [2023-02-24 17:43:46,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 14051.4). Total num frames: 17506304. Throughput: 0: 3511.2. Samples: 4378284. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:43:46,376][177119] Avg episode reward: [(0, '-0.110')] [2023-02-24 17:43:46,515][177156] DAMAGECOUNT value on done: 16269.0 [2023-02-24 17:43:46,515][177156] Sum rewards: 2.072, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.454', 'AMMO2': '0.015', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'ARMOR': '0.044', 'AMMO3': '0.072', 'AMMO4': '0.074', 'weapon5': '0.146', 'WEAPON4': '0.150', 'HITCOUNT': '0.260', 'weapon4': '0.274', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'weapon3': '1.262', 'weapon2': '1.688', 'DAMAGECOUNT': '1.986', 'FRAGCOUNT': '4.000'} [2023-02-24 17:43:46,643][177156] DAMAGECOUNT value on done: 15723.0 [2023-02-24 17:43:46,644][177156] Sum rewards: -0.350, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.260', 'AMMO2': '0.003', 'AMMO4': '0.012', 'AMMO5': '0.021', 'WEAPON1': '0.060', 'ARMOR': '0.086', 'AMMO3': '0.134', 'weapon5': '0.238', 'HITCOUNT': '0.250', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'weapon2': '1.514', 'DAMAGECOUNT': '1.548', 'weapon3': '1.844', 'FRAGCOUNT': '3.000'} [2023-02-24 17:43:46,932][177156] DAMAGECOUNT value on done: 17598.0 [2023-02-24 17:43:46,933][177156] Sum rewards: 3.760, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.754', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.019', 'WEAPON1': '0.040', 'AMMO3': '0.105', 'weapon5': '0.182', 'HITCOUNT': '0.310', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon3': '1.362', 'weapon2': '1.558', 'DAMAGECOUNT': '1.860', 'FRAGCOUNT': '4.000'} [2023-02-24 17:43:47,858][177153] Updated weights for policy 0, policy_version 4280 (0.0009) [2023-02-24 17:43:50,724][177153] Updated weights for policy 0, policy_version 4290 (0.0009) [2023-02-24 17:43:51,376][177119] Fps is (10 sec: 14335.9, 60 sec: 14062.9, 300 sec: 14065.3). Total num frames: 17580032. Throughput: 0: 3513.4. Samples: 4388816. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:43:51,376][177119] Avg episode reward: [(0, '-0.033')] [2023-02-24 17:43:53,634][177153] Updated weights for policy 0, policy_version 4300 (0.0008) [2023-02-24 17:43:56,376][177119] Fps is (10 sec: 14335.9, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 17649664. Throughput: 0: 3514.7. Samples: 4409970. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:43:56,376][177119] Avg episode reward: [(0, '-0.033')] [2023-02-24 17:43:56,545][177153] Updated weights for policy 0, policy_version 4310 (0.0008) [2023-02-24 17:43:56,927][177155] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 17:43:59,515][177153] Updated weights for policy 0, policy_version 4320 (0.0008) [2023-02-24 17:43:59,679][177170] DAMAGECOUNT value on done: 15305.0 [2023-02-24 17:43:59,680][177170] Sum rewards: 2.183, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.074', 'AMMO2': '0.006', 'AMMO5': '0.022', 'AMMO4': '0.031', 'weapon4': '0.036', 'AMMO3': '0.070', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'HITCOUNT': '0.270', 'weapon5': '0.312', 'WEAPON3': '0.400', 'WEAPON5': '0.600', 'weapon3': '1.082', 'DAMAGECOUNT': '1.485', 'weapon2': '1.772', 'FRAGCOUNT': '3.000'} [2023-02-24 17:43:59,946][177170] DAMAGECOUNT value on done: 14606.0 [2023-02-24 17:43:59,947][177170] Sum rewards: 3.443, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.150', 'AMMO2': '0.009', 'AMMO5': '0.010', 'ARMOR': '0.036', 'AMMO4': '0.046', 'AMMO3': '0.061', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.200', 'HITCOUNT': '0.220', 'weapon5': '0.258', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'DAMAGECOUNT': '1.080', 'weapon3': '1.120', 'weapon2': '1.622', 'FRAGCOUNT': '5.000'} [2023-02-24 17:43:59,992][177170] DAMAGECOUNT value on done: 17413.0 [2023-02-24 17:43:59,993][177170] Sum rewards: -1.336, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.324', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'weapon5': '0.124', 'weapon4': '0.176', 'HITCOUNT': '0.210', 'WEAPON3': '0.650', 'weapon3': '1.198', 'DAMAGECOUNT': '1.290', 'weapon2': '1.870', 'FRAGCOUNT': '3.000'} [2023-02-24 17:44:00,215][177158] DAMAGECOUNT value on done: 15732.0 [2023-02-24 17:44:00,216][177158] Sum rewards: -3.893, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.890', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'HITCOUNT': '0.050', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.182', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.552', 'weapon3': '0.932', 'FRAGCOUNT': '1.000', 'weapon2': '2.564'} [2023-02-24 17:44:00,257][177170] DAMAGECOUNT value on done: 18245.0 [2023-02-24 17:44:00,258][177170] Sum rewards: 3.645, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.966', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO3': '0.056', 'WEAPON1': '0.060', 'ARMOR': '0.072', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'weapon4': '0.144', 'WEAPON5': '0.200', 'weapon5': '0.234', 'HITCOUNT': '0.240', 'WEAPON3': '0.400', 'weapon3': '1.248', 'weapon2': '1.462', 'DAMAGECOUNT': '1.536', 'FRAGCOUNT': '4.000'} [2023-02-24 17:44:00,515][177158] DAMAGECOUNT value on done: 15434.0 [2023-02-24 17:44:00,516][177158] Sum rewards: -0.346, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.650', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'weapon4': '0.134', 'HITCOUNT': '0.170', 'weapon5': '0.196', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'weapon2': '1.478', 'weapon3': '1.792', 'DAMAGECOUNT': '2.265', 'FRAGCOUNT': '3.000'} [2023-02-24 17:44:00,777][177172] DAMAGECOUNT value on done: 14499.0 [2023-02-24 17:44:00,777][177172] Sum rewards: -1.476, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon7': '0.054', 'WEAPON1': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'ARMOR': '0.102', 'AMMO3': '0.110', 'weapon5': '0.136', 'WEAPON4': '0.200', 'AMMO4': '0.205', 'HITCOUNT': '0.240', 'HEALTH': '0.270', 'WEAPON5': '0.300', 'weapon4': '0.418', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.047', 'weapon2': '1.308', 'weapon3': '1.570', 'FRAGCOUNT': '2.000'} [2023-02-24 17:44:01,065][177158] DAMAGECOUNT value on done: 14483.0 [2023-02-24 17:44:01,073][177172] DAMAGECOUNT value on done: 14017.0 [2023-02-24 17:44:01,073][177172] Sum rewards: 0.713, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.835', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'weapon5': '0.132', 'ARMOR': '0.140', 'HITCOUNT': '0.180', 'weapon4': '0.226', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.690', 'weapon3': '1.196', 'FRAGCOUNT': '2.000', 'weapon2': '2.004'} [2023-02-24 17:44:01,153][177154] DAMAGECOUNT value on done: 16891.0 [2023-02-24 17:44:01,154][177154] Sum rewards: -2.908, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.383', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.068', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'weapon4': '0.218', 'HITCOUNT': '0.320', 'WEAPON3': '0.800', 'weapon3': '1.256', 'DAMAGECOUNT': '1.290', 'FRAGCOUNT': '2.000', 'weapon2': '2.138'} [2023-02-24 17:44:01,367][177158] DAMAGECOUNT value on done: 15260.0 [2023-02-24 17:44:01,368][177158] Sum rewards: -1.161, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.230', 'AMMO5': '0.014', 'AMMO2': '0.028', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'AMMO3': '0.083', 'AMMO4': '0.138', 'weapon5': '0.218', 'WEAPON4': '0.250', 'HITCOUNT': '0.260', 'weapon4': '0.356', 'WEAPON5': '0.450', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.600', 'weapon2': '1.430', 'weapon3': '1.490', 'DAMAGECOUNT': '1.680'} [2023-02-24 17:44:01,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 17719296. Throughput: 0: 3509.8. Samples: 4430902. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 17:44:01,376][177119] Avg episode reward: [(0, '-0.018')] [2023-02-24 17:44:01,455][177154] DAMAGECOUNT value on done: 14682.0 [2023-02-24 17:44:01,455][177154] Sum rewards: 0.809, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.786', 'AMMO5': '0.017', 'AMMO2': '0.019', 'WEAPON1': '0.060', 'AMMO4': '0.095', 'AMMO3': '0.108', 'weapon5': '0.230', 'HITCOUNT': '0.300', 'WEAPON5': '0.450', 'ARMOR': '0.480', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.041', 'weapon2': '1.644', 'weapon3': '1.750', 'FRAGCOUNT': '3.000'} [2023-02-24 17:44:01,628][177154] DAMAGECOUNT value on done: 16674.0 [2023-02-24 17:44:01,628][177154] Sum rewards: -6.410, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.420', 'AMMO4': '-0.060', 'AMMO2': '-0.012', 'AMMO5': '0.037', 'weapon4': '0.046', 'WEAPON4': '0.050', 'ARMOR': '0.056', 'weapon5': '0.100', 'AMMO3': '0.179', 'HITCOUNT': '0.330', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.257', 'weapon3': '1.732', 'weapon2': '1.844', 'FRAGCOUNT': '2.000'} [2023-02-24 17:44:01,854][177172] DAMAGECOUNT value on done: 15486.0 [2023-02-24 17:44:01,854][177172] Sum rewards: -2.999, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.794', 'AMMO5': '0.012', 'AMMO2': '0.017', 'ARMOR': '0.044', 'weapon7': '0.048', 'WEAPON1': '0.070', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.172', 'HITCOUNT': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.222', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.804', 'weapon3': '1.142', 'FRAGCOUNT': '2.000', 'weapon2': '2.034'} [2023-02-24 17:44:01,930][177154] DAMAGECOUNT value on done: 16230.0 [2023-02-24 17:44:01,930][177154] Sum rewards: -0.717, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.098', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.025', 'AMMO4': '0.035', 'AMMO3': '0.121', 'weapon5': '0.204', 'HITCOUNT': '0.270', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.113', 'weapon3': '1.604', 'weapon2': '1.892', 'FRAGCOUNT': '3.000'} [2023-02-24 17:44:02,000][177171] DAMAGECOUNT value on done: 15426.0 [2023-02-24 17:44:02,001][177171] Sum rewards: 0.250, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.892', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'weapon5': '0.102', 'ARMOR': '0.104', 'WEAPON5': '0.150', 'weapon4': '0.244', 'HITCOUNT': '0.360', 'WEAPON3': '0.600', 'weapon2': '1.004', 'DAMAGECOUNT': '1.524', 'weapon3': '1.616', 'FRAGCOUNT': '3.000'} [2023-02-24 17:44:02,155][177172] DAMAGECOUNT value on done: 13849.0 [2023-02-24 17:44:02,156][177172] Sum rewards: 0.490, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.293', 'AMMO5': '0.020', 'AMMO2': '0.020', 'AMMO3': '0.079', 'WEAPON1': '0.080', 'AMMO4': '0.102', 'HITCOUNT': '0.190', 'weapon5': '0.220', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.588', 'FRAGCOUNT': '1.000', 'weapon3': '1.464', 'weapon2': '1.970'} [2023-02-24 17:44:02,218][177157] DAMAGECOUNT value on done: 16237.0 [2023-02-24 17:44:02,218][177157] Sum rewards: -3.137, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.677', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.012', 'ARMOR': '0.012', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.121', 'weapon5': '0.148', 'HITCOUNT': '0.180', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.567', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.240', 'weapon2': '2.230'} [2023-02-24 17:44:02,296][177171] DAMAGECOUNT value on done: 15080.0 [2023-02-24 17:44:02,297][177171] Sum rewards: -3.413, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.246', 'FRAGCOUNT': '0.000', 'AMMO2': '0.011', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'weapon4': '0.024', 'AMMO4': '0.054', 'ARMOR': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'HITCOUNT': '0.110', 'weapon5': '0.226', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.777', 'weapon3': '1.646', 'weapon2': '1.860'} [2023-02-24 17:44:02,439][177153] Updated weights for policy 0, policy_version 4330 (0.0009) [2023-02-24 17:44:02,477][177155] DAMAGECOUNT value on done: 15097.0 [2023-02-24 17:44:02,478][177155] Sum rewards: -0.689, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.728', 'AMMO5': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'AMMO4': '0.085', 'weapon5': '0.116', 'AMMO3': '0.130', 'WEAPON4': '0.150', 'HITCOUNT': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.262', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.228', 'DAMAGECOUNT': '1.401', 'weapon3': '1.818'} [2023-02-24 17:44:02,514][177157] DAMAGECOUNT value on done: 17005.0 [2023-02-24 17:44:02,515][177157] Sum rewards: -1.435, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.730', 'AMMO5': '0.005', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'weapon4': '0.028', 'AMMO4': '0.035', 'ARMOR': '0.072', 'WEAPON4': '0.100', 'weapon5': '0.104', 'AMMO3': '0.131', 'WEAPON5': '0.150', 'HITCOUNT': '0.370', 'WEAPON3': '0.950', 'weapon2': '1.270', 'DAMAGECOUNT': '1.536', 'weapon3': '2.276', 'FRAGCOUNT': '3.000'} [2023-02-24 17:44:02,524][177157] DAMAGECOUNT value on done: 16605.0 [2023-02-24 17:44:02,524][177157] Sum rewards: 3.919, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.010', 'AMMO2': '0.031', 'WEAPON1': '0.040', 'HITCOUNT': '0.060', 'AMMO3': '0.063', 'AMMO4': '0.153', 'weapon5': '0.162', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'HEALTH': '0.450', 'DAMAGECOUNT': '0.672', 'weapon3': '0.922', 'FRAGCOUNT': '2.000', 'weapon2': '2.556'} [2023-02-24 17:44:02,604][177171] DAMAGECOUNT value on done: 14608.0 [2023-02-24 17:44:02,605][177171] Sum rewards: -1.382, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.049', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.015', 'ARMOR': '0.048', 'WEAPON4': '0.050', 'weapon7': '0.050', 'WEAPON1': '0.060', 'weapon5': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.109', 'weapon4': '0.238', 'WEAPON5': '0.300', 'HITCOUNT': '0.330', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.963', 'weapon3': '1.218', 'weapon2': '1.380', 'FRAGCOUNT': '3.000'} [2023-02-24 17:44:02,771][177155] DAMAGECOUNT value on done: 16390.0 [2023-02-24 17:44:02,772][177155] Sum rewards: 5.123, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.754', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.011', 'WEAPON1': '0.060', 'AMMO3': '0.065', 'weapon7': '0.066', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.216', 'HITCOUNT': '0.220', 'weapon4': '0.220', 'WEAPON3': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.938', 'weapon3': '0.940', 'DAMAGECOUNT': '1.761', 'FRAGCOUNT': '4.000'} [2023-02-24 17:44:02,810][177155] DAMAGECOUNT value on done: 18017.0 [2023-02-24 17:44:02,810][177155] Sum rewards: -0.992, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.524', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'HITCOUNT': '0.070', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'ARMOR': '0.112', 'weapon5': '0.138', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.462', 'weapon3': '0.892', 'FRAGCOUNT': '1.000', 'weapon2': '2.888'} [2023-02-24 17:44:02,817][177157] DAMAGECOUNT value on done: 15665.0 [2023-02-24 17:44:02,817][177157] Sum rewards: 2.542, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.334', 'AMMO2': '0.003', 'AMMO5': '0.009', 'AMMO4': '0.016', 'WEAPON1': '0.040', 'AMMO3': '0.058', 'weapon7': '0.062', 'weapon5': '0.144', 'HITCOUNT': '0.180', 'WEAPON5': '0.200', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON3': '0.350', 'WEAPON7': '0.400', 'DAMAGECOUNT': '0.870', 'weapon3': '0.976', 'FRAGCOUNT': '1.000', 'weapon2': '1.678'} [2023-02-24 17:44:02,903][177171] DAMAGECOUNT value on done: 14947.0 [2023-02-24 17:44:03,102][177155] DAMAGECOUNT value on done: 14609.0 [2023-02-24 17:44:03,102][177155] Sum rewards: -1.251, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.515', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon5': '0.050', 'ARMOR': '0.072', 'AMMO3': '0.154', 'WEAPON5': '0.200', 'HITCOUNT': '0.200', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.726', 'weapon3': '1.668', 'weapon2': '1.718', 'FRAGCOUNT': '2.000'} [2023-02-24 17:44:05,328][177153] Updated weights for policy 0, policy_version 4340 (0.0008) [2023-02-24 17:44:05,334][177156] DAMAGECOUNT value on done: 15624.0 [2023-02-24 17:44:05,334][177156] Sum rewards: 3.105, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.634', 'ARMOR': '0.012', 'AMMO2': '0.016', 'AMMO5': '0.022', 'WEAPON1': '0.050', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'weapon4': '0.168', 'weapon5': '0.214', 'HITCOUNT': '0.330', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'weapon3': '1.564', 'DAMAGECOUNT': '1.695', 'weapon2': '1.732', 'FRAGCOUNT': '4.000'} [2023-02-24 17:44:05,631][177156] DAMAGECOUNT value on done: 16415.0 [2023-02-24 17:44:05,758][177156] DAMAGECOUNT value on done: 16134.0 [2023-02-24 17:44:05,759][177156] Sum rewards: 2.980, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.620', 'AMMO5': '0.010', 'AMMO2': '0.023', 'WEAPON1': '0.050', 'AMMO3': '0.109', 'AMMO4': '0.113', 'weapon5': '0.224', 'WEAPON5': '0.250', 'HITCOUNT': '0.280', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.233', 'weapon2': '1.404', 'weapon3': '2.004', 'FRAGCOUNT': '4.000'} [2023-02-24 17:44:06,051][177156] DAMAGECOUNT value on done: 18330.0 [2023-02-24 17:44:06,051][177156] Sum rewards: 9.570, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.142', 'AMMO2': '0.004', 'AMMO5': '0.012', 'AMMO4': '0.018', 'WEAPON1': '0.050', 'AMMO3': '0.066', 'weapon5': '0.160', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'HITCOUNT': '0.530', 'weapon3': '1.438', 'weapon2': '2.188', 'DAMAGECOUNT': '2.196', 'FRAGCOUNT': '6.000'} [2023-02-24 17:44:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 17788928. Throughput: 0: 3510.1. Samples: 4441444. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:44:06,376][177119] Avg episode reward: [(0, '0.001')] [2023-02-24 17:44:08,230][177153] Updated weights for policy 0, policy_version 4350 (0.0008) [2023-02-24 17:44:11,144][177153] Updated weights for policy 0, policy_version 4360 (0.0008) [2023-02-24 17:44:11,376][177119] Fps is (10 sec: 13926.6, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 17858560. Throughput: 0: 3516.9. Samples: 4462680. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:44:11,376][177119] Avg episode reward: [(0, '0.001')] [2023-02-24 17:44:14,046][177153] Updated weights for policy 0, policy_version 4370 (0.0008) [2023-02-24 17:44:16,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14063.0, 300 sec: 14065.2). Total num frames: 17932288. Throughput: 0: 3515.2. Samples: 4483814. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:44:16,376][177119] Avg episode reward: [(0, '0.001')] [2023-02-24 17:44:16,963][177153] Updated weights for policy 0, policy_version 4380 (0.0008) [2023-02-24 17:44:18,795][177170] DAMAGECOUNT value on done: 15597.0 [2023-02-24 17:44:18,795][177170] Sum rewards: -2.115, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.704', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.013', 'AMMO5': '0.025', 'AMMO4': '0.064', 'WEAPON1': '0.070', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'HITCOUNT': '0.130', 'weapon4': '0.176', 'weapon5': '0.240', 'WEAPON3': '0.500', 'WEAPON5': '0.550', 'DAMAGECOUNT': '0.876', 'weapon3': '1.374', 'weapon2': '1.638'} [2023-02-24 17:44:19,058][177170] DAMAGECOUNT value on done: 15254.0 [2023-02-24 17:44:19,059][177170] Sum rewards: 2.798, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.038', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO5': '0.021', 'ARMOR': '0.032', 'AMMO4': '0.104', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'weapon4': '0.162', 'HITCOUNT': '0.280', 'weapon5': '0.290', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'weapon2': '1.608', 'weapon3': '1.624', 'DAMAGECOUNT': '1.944', 'FRAGCOUNT': '6.000'} [2023-02-24 17:44:19,103][177170] DAMAGECOUNT value on done: 17850.0 [2023-02-24 17:44:19,104][177170] Sum rewards: 3.218, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.284', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'ARMOR': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO3': '0.091', 'AMMO4': '0.123', 'WEAPON4': '0.250', 'HITCOUNT': '0.340', 'weapon4': '0.416', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.311', 'weapon3': '1.526', 'weapon2': '1.658', 'FRAGCOUNT': '3.000'} [2023-02-24 17:44:19,222][177158] DAMAGECOUNT value on done: 16533.0 [2023-02-24 17:44:19,222][177158] Sum rewards: 1.786, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.990', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO5': '0.010', 'WEAPON1': '0.050', 'AMMO3': '0.094', 'weapon5': '0.210', 'HITCOUNT': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'weapon3': '1.070', 'weapon2': '2.100', 'DAMAGECOUNT': '2.403', 'FRAGCOUNT': '4.000'} [2023-02-24 17:44:19,362][177170] DAMAGECOUNT value on done: 18760.0 [2023-02-24 17:44:19,362][177170] Sum rewards: 0.610, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.400', 'AMMO2': '0.019', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'AMMO4': '0.096', 'AMMO3': '0.103', 'weapon5': '0.232', 'HITCOUNT': '0.280', 'WEAPON5': '0.350', 'ARMOR': '0.454', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.545', 'weapon2': '1.670', 'weapon3': '1.800', 'FRAGCOUNT': '2.000'} [2023-02-24 17:44:19,514][177158] DAMAGECOUNT value on done: 16035.0 [2023-02-24 17:44:19,515][177158] Sum rewards: 3.054, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.014', 'AMMO2': '0.028', 'HEALTH': '0.031', 'ARMOR': '0.040', 'WEAPON1': '0.070', 'AMMO3': '0.105', 'weapon5': '0.138', 'AMMO4': '0.141', 'HITCOUNT': '0.280', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'weapon2': '1.332', 'DAMAGECOUNT': '1.803', 'weapon3': '1.822', 'FRAGCOUNT': '3.000'} [2023-02-24 17:44:19,854][177172] DAMAGECOUNT value on done: 14896.0 [2023-02-24 17:44:19,854][177172] Sum rewards: -3.005, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.390', 'AMMO5': '0.010', 'weapon4': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'ARMOR': '0.045', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'weapon5': '0.106', 'AMMO3': '0.181', 'HITCOUNT': '0.290', 'WEAPON5': '0.300', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.191', 'weapon2': '1.718', 'weapon3': '1.848', 'FRAGCOUNT': '2.000'} [2023-02-24 17:44:19,891][177153] Updated weights for policy 0, policy_version 4390 (0.0008) [2023-02-24 17:44:20,107][177158] DAMAGECOUNT value on done: 14548.0 [2023-02-24 17:44:20,155][177172] DAMAGECOUNT value on done: 14534.0 [2023-02-24 17:44:20,156][177172] Sum rewards: -2.354, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.026', 'AMMO5': '0.008', 'AMMO2': '0.014', 'ARMOR': '0.032', 'WEAPON1': '0.060', 'AMMO4': '0.068', 'AMMO3': '0.145', 'weapon5': '0.148', 'WEAPON5': '0.200', 'HITCOUNT': '0.390', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.551', 'weapon3': '1.554', 'FRAGCOUNT': '2.000', 'weapon2': '2.152'} [2023-02-24 17:44:20,236][177154] DAMAGECOUNT value on done: 16980.0 [2023-02-24 17:44:20,400][177158] DAMAGECOUNT value on done: 15530.0 [2023-02-24 17:44:20,401][177158] Sum rewards: 3.162, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO3': '0.030', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'weapon5': '0.110', 'WEAPON3': '0.150', 'HITCOUNT': '0.160', 'HEALTH': '0.348', 'ARMOR': '0.504', 'weapon3': '0.806', 'DAMAGECOUNT': '0.810', 'FRAGCOUNT': '1.000', 'weapon2': '2.790'} [2023-02-24 17:44:20,541][177154] DAMAGECOUNT value on done: 14965.0 [2023-02-24 17:44:20,542][177154] Sum rewards: 0.022, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.766', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'AMMO3': '0.091', 'weapon5': '0.126', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'HITCOUNT': '0.180', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.849', 'weapon2': '1.672', 'weapon3': '1.682', 'FRAGCOUNT': '2.000'} [2023-02-24 17:44:20,699][177154] DAMAGECOUNT value on done: 16856.0 [2023-02-24 17:44:20,699][177154] Sum rewards: -0.517, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.670', 'AMMO5': '0.007', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'weapon7': '0.056', 'AMMO3': '0.082', 'ARMOR': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.107', 'weapon5': '0.118', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'weapon4': '0.198', 'WEAPON5': '0.200', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.546', 'FRAGCOUNT': '1.000', 'weapon3': '1.220', 'weapon2': '1.340'} [2023-02-24 17:44:20,928][177172] DAMAGECOUNT value on done: 15969.0 [2023-02-24 17:44:20,928][177172] Sum rewards: 1.707, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.634', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.026', 'ARMOR': '0.032', 'WEAPON1': '0.060', 'AMMO3': '0.137', 'HITCOUNT': '0.170', 'weapon5': '0.182', 'WEAPON5': '0.250', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.449', 'weapon2': '1.560', 'weapon3': '1.910', 'FRAGCOUNT': '4.000'} [2023-02-24 17:44:21,012][177154] DAMAGECOUNT value on done: 16856.0 [2023-02-24 17:44:21,013][177154] Sum rewards: 1.159, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.933', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.015', 'weapon7': '0.048', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.126', 'weapon5': '0.134', 'AMMO3': '0.137', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'HITCOUNT': '0.460', 'WEAPON3': '0.800', 'weapon2': '1.670', 'weapon3': '1.804', 'DAMAGECOUNT': '1.878', 'FRAGCOUNT': '4.000'} [2023-02-24 17:44:21,016][177171] DAMAGECOUNT value on done: 15744.0 [2023-02-24 17:44:21,017][177171] Sum rewards: -3.661, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.084', 'AMMO5': '0.012', 'weapon5': '0.026', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'ARMOR': '0.060', 'AMMO4': '0.139', 'AMMO3': '0.150', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.270', 'HITCOUNT': '0.340', 'WEAPON3': '0.950', 'DAMAGECOUNT': '0.954', 'weapon2': '1.492', 'weapon3': '1.762', 'FRAGCOUNT': '2.000'} [2023-02-24 17:44:21,218][177172] DAMAGECOUNT value on done: 14094.0 [2023-02-24 17:44:21,218][177172] Sum rewards: -1.034, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.133', 'AMMO2': '0.002', 'AMMO5': '0.008', 'AMMO4': '0.011', 'ARMOR': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.076', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.120', 'weapon5': '0.148', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'weapon3': '0.698', 'DAMAGECOUNT': '0.735', 'FRAGCOUNT': '1.000', 'weapon2': '2.356'} [2023-02-24 17:44:21,307][177157] DAMAGECOUNT value on done: 16587.0 [2023-02-24 17:44:21,308][177157] Sum rewards: -2.048, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.930', 'AMMO5': '0.010', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'weapon4': '0.034', 'AMMO4': '0.051', 'weapon5': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'HITCOUNT': '0.370', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.050', 'weapon2': '1.676', 'weapon3': '1.886'} [2023-02-24 17:44:21,314][177171] DAMAGECOUNT value on done: 15165.0 [2023-02-24 17:44:21,376][177119] Fps is (10 sec: 14336.1, 60 sec: 14063.0, 300 sec: 14065.3). Total num frames: 18001920. Throughput: 0: 3513.9. Samples: 4494322. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:44:21,376][177119] Avg episode reward: [(0, '-0.081')] [2023-02-24 17:44:21,536][177155] DAMAGECOUNT value on done: 15505.0 [2023-02-24 17:44:21,536][177155] Sum rewards: 4.444, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.016', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.031', 'WEAPON1': '0.040', 'AMMO3': '0.111', 'AMMO4': '0.155', 'weapon5': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.240', 'weapon4': '0.294', 'WEAPON3': '0.500', 'weapon3': '1.026', 'DAMAGECOUNT': '1.224', 'weapon2': '1.988', 'FRAGCOUNT': '5.000'} [2023-02-24 17:44:21,609][177157] DAMAGECOUNT value on done: 16911.0 [2023-02-24 17:44:21,610][177157] Sum rewards: 0.860, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.010', 'AMMO2': '0.018', 'ARMOR': '0.036', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.092', 'AMMO3': '0.110', 'weapon5': '0.132', 'weapon4': '0.164', 'WEAPON5': '0.200', 'HITCOUNT': '0.250', 'WEAPON3': '0.400', 'HEALTH': '0.666', 'DAMAGECOUNT': '0.918', 'weapon2': '1.352', 'weapon3': '1.922', 'FRAGCOUNT': '2.000'} [2023-02-24 17:44:21,624][177171] DAMAGECOUNT value on done: 15325.0 [2023-02-24 17:44:21,624][177157] DAMAGECOUNT value on done: 17306.0 [2023-02-24 17:44:21,625][177171] Sum rewards: -1.216, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.161', 'AMMO5': '0.008', 'AMMO2': '0.022', 'WEAPON1': '0.050', 'ARMOR': '0.064', 'AMMO4': '0.112', 'AMMO3': '0.112', 'weapon5': '0.160', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.300', 'HITCOUNT': '0.370', 'WEAPON3': '0.750', 'weapon3': '1.148', 'weapon2': '1.898', 'DAMAGECOUNT': '2.151', 'FRAGCOUNT': '3.000'} [2023-02-24 17:44:21,625][177157] Sum rewards: -2.519, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.220', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.002', 'WEAPON1': '0.010', 'AMMO4': '0.011', 'AMMO5': '0.018', 'weapon7': '0.052', 'ARMOR': '0.085', 'AMMO3': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.200', 'weapon4': '0.206', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.903', 'weapon2': '1.270', 'weapon3': '1.916'} [2023-02-24 17:44:21,831][177155] DAMAGECOUNT value on done: 16907.0 [2023-02-24 17:44:21,832][177155] Sum rewards: 0.357, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.876', 'AMMO5': '0.008', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'weapon5': '0.170', 'weapon4': '0.188', 'WEAPON5': '0.300', 'HITCOUNT': '0.450', 'WEAPON3': '0.850', 'weapon3': '1.526', 'DAMAGECOUNT': '1.551', 'weapon2': '1.804', 'FRAGCOUNT': '4.000'} [2023-02-24 17:44:21,909][177155] DAMAGECOUNT value on done: 18541.0 [2023-02-24 17:44:21,919][177157] DAMAGECOUNT value on done: 15930.0 [2023-02-24 17:44:21,919][177171] DAMAGECOUNT value on done: 15503.0 [2023-02-24 17:44:21,920][177171] Sum rewards: 4.039, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.354', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.007', 'WEAPON1': '0.040', 'AMMO3': '0.095', 'WEAPON5': '0.200', 'weapon5': '0.214', 'HITCOUNT': '0.370', 'WEAPON3': '0.600', 'weapon3': '1.488', 'DAMAGECOUNT': '1.668', 'weapon2': '1.710', 'FRAGCOUNT': '4.000'} [2023-02-24 17:44:22,210][177155] DAMAGECOUNT value on done: 14994.0 [2023-02-24 17:44:22,210][177155] Sum rewards: -4.278, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.556', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.020', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'ARMOR': '0.108', 'AMMO3': '0.117', 'AMMO4': '0.123', 'weapon4': '0.220', 'HITCOUNT': '0.260', 'weapon5': '0.266', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'weapon2': '0.970', 'DAMAGECOUNT': '1.155', 'weapon3': '2.024'} [2023-02-24 17:44:22,826][177153] Updated weights for policy 0, policy_version 4400 (0.0008) [2023-02-24 17:44:24,543][177156] DAMAGECOUNT value on done: 15986.0 [2023-02-24 17:44:24,543][177156] Sum rewards: -1.440, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.302', 'AMMO5': '0.012', 'AMMO2': '0.019', 'ARMOR': '0.045', 'WEAPON1': '0.060', 'AMMO3': '0.091', 'AMMO4': '0.096', 'weapon5': '0.112', 'HITCOUNT': '0.180', 'weapon4': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.086', 'weapon2': '1.424', 'weapon3': '1.722'} [2023-02-24 17:44:24,841][177156] DAMAGECOUNT value on done: 16643.0 [2023-02-24 17:44:24,841][177156] Sum rewards: -2.147, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.698', 'AMMO2': '0.012', 'AMMO5': '0.012', 'ARMOR': '0.036', 'AMMO4': '0.062', 'WEAPON1': '0.070', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'HITCOUNT': '0.120', 'weapon5': '0.268', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.684', 'FRAGCOUNT': '1.000', 'weapon3': '1.108', 'weapon2': '2.188'} [2023-02-24 17:44:24,928][177156] DAMAGECOUNT value on done: 16951.0 [2023-02-24 17:44:24,929][177156] Sum rewards: 3.508, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.060', 'AMMO2': '0.005', 'AMMO5': '0.013', 'AMMO4': '0.026', 'WEAPON1': '0.090', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'weapon4': '0.192', 'weapon5': '0.208', 'HITCOUNT': '0.340', 'WEAPON5': '0.350', 'ARMOR': '0.456', 'WEAPON3': '0.550', 'weapon3': '1.528', 'weapon2': '1.666', 'DAMAGECOUNT': '2.451', 'FRAGCOUNT': '4.000'} [2023-02-24 17:44:25,220][177156] DAMAGECOUNT value on done: 18709.0 [2023-02-24 17:44:25,221][177156] Sum rewards: -1.488, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.580', 'AMMO2': '0.025', 'AMMO5': '0.029', 'WEAPON1': '0.070', 'AMMO3': '0.093', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'weapon5': '0.166', 'HITCOUNT': '0.230', 'weapon4': '0.438', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon3': '1.128', 'DAMAGECOUNT': '1.137', 'weapon2': '1.652', 'FRAGCOUNT': '2.000'} [2023-02-24 17:44:25,713][177153] Updated weights for policy 0, policy_version 4410 (0.0008) [2023-02-24 17:44:26,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 18071552. Throughput: 0: 3513.9. Samples: 4515424. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:44:26,376][177119] Avg episode reward: [(0, '-0.085')] [2023-02-24 17:44:28,641][177153] Updated weights for policy 0, policy_version 4420 (0.0008) [2023-02-24 17:44:31,376][177119] Fps is (10 sec: 13925.9, 60 sec: 14062.9, 300 sec: 14051.3). Total num frames: 18141184. Throughput: 0: 3515.9. Samples: 4536500. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:44:31,376][177119] Avg episode reward: [(0, '-0.085')] [2023-02-24 17:44:31,561][177153] Updated weights for policy 0, policy_version 4430 (0.0008) [2023-02-24 17:44:34,477][177153] Updated weights for policy 0, policy_version 4440 (0.0009) [2023-02-24 17:44:36,376][177119] Fps is (10 sec: 13926.5, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 18210816. Throughput: 0: 3516.5. Samples: 4547060. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:44:36,376][177119] Avg episode reward: [(0, '-0.085')] [2023-02-24 17:44:37,396][177153] Updated weights for policy 0, policy_version 4450 (0.0008) [2023-02-24 17:44:37,864][177170] DAMAGECOUNT value on done: 16150.0 [2023-02-24 17:44:37,864][177170] Sum rewards: 1.190, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.019', 'AMMO2': '0.022', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'weapon4': '0.060', 'WEAPON1': '0.070', 'AMMO3': '0.084', 'AMMO4': '0.109', 'HEALTH': '0.198', 'HITCOUNT': '0.210', 'weapon5': '0.330', 'WEAPON3': '0.500', 'WEAPON5': '0.500', 'weapon3': '1.230', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.659', 'weapon2': '2.116'} [2023-02-24 17:44:38,125][177170] DAMAGECOUNT value on done: 15744.0 [2023-02-24 17:44:38,125][177170] Sum rewards: 3.792, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.180', 'AMMO5': '0.010', 'AMMO2': '0.011', 'ARMOR': '0.046', 'AMMO4': '0.056', 'WEAPON1': '0.070', 'AMMO3': '0.082', 'HITCOUNT': '0.220', 'weapon5': '0.270', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'weapon3': '1.050', 'DAMAGECOUNT': '1.467', 'weapon2': '2.290', 'FRAGCOUNT': '3.000'} [2023-02-24 17:44:38,170][177170] DAMAGECOUNT value on done: 18426.0 [2023-02-24 17:44:38,171][177170] Sum rewards: 2.394, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.299', 'AMMO2': '0.010', 'ARMOR': '0.016', 'AMMO5': '0.022', 'weapon7': '0.050', 'AMMO4': '0.051', 'WEAPON1': '0.060', 'AMMO3': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.198', 'weapon4': '0.282', 'HITCOUNT': '0.310', 'WEAPON3': '0.500', 'WEAPON5': '0.550', 'weapon2': '0.682', 'weapon3': '1.500', 'DAMAGECOUNT': '1.728', 'FRAGCOUNT': '4.000'} [2023-02-24 17:44:38,419][177158] DAMAGECOUNT value on done: 17069.0 [2023-02-24 17:44:38,420][177158] Sum rewards: 3.790, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.017', 'ARMOR': '0.024', 'AMMO2': '0.032', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.064', 'HEALTH': '0.074', 'weapon4': '0.076', 'AMMO4': '0.157', 'HITCOUNT': '0.230', 'weapon5': '0.258', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'weapon3': '1.354', 'DAMAGECOUNT': '1.608', 'weapon2': '2.046', 'FRAGCOUNT': '3.000'} [2023-02-24 17:44:38,436][177170] DAMAGECOUNT value on done: 19339.0 [2023-02-24 17:44:38,436][177170] Sum rewards: 0.777, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.594', 'AMMO2': '0.013', 'AMMO5': '0.019', 'WEAPON1': '0.040', 'ARMOR': '0.048', 'AMMO4': '0.062', 'AMMO3': '0.107', 'WEAPON4': '0.200', 'weapon5': '0.244', 'weapon4': '0.276', 'HITCOUNT': '0.350', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'weapon3': '1.262', 'DAMAGECOUNT': '1.737', 'weapon2': '1.962', 'FRAGCOUNT': '3.000'} [2023-02-24 17:44:38,727][177158] DAMAGECOUNT value on done: 16140.0 [2023-02-24 17:44:38,964][177172] DAMAGECOUNT value on done: 15265.0 [2023-02-24 17:44:38,965][177172] Sum rewards: 4.777, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.556', 'AMMO5': '0.022', 'AMMO2': '0.026', 'AMMO3': '0.033', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'AMMO4': '0.129', 'HITCOUNT': '0.160', 'weapon5': '0.196', 'weapon4': '0.240', 'WEAPON3': '0.300', 'WEAPON5': '0.450', 'weapon3': '0.726', 'DAMAGECOUNT': '1.107', 'weapon2': '2.524', 'FRAGCOUNT': '3.000'} [2023-02-24 17:44:39,254][177172] DAMAGECOUNT value on done: 15151.0 [2023-02-24 17:44:39,255][177172] Sum rewards: 0.735, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.168', 'AMMO5': '0.009', 'AMMO2': '0.030', 'WEAPON1': '0.040', 'ARMOR': '0.064', 'AMMO3': '0.116', 'AMMO4': '0.148', 'weapon5': '0.166', 'weapon4': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'HITCOUNT': '0.360', 'WEAPON3': '0.800', 'weapon2': '1.594', 'weapon3': '1.636', 'DAMAGECOUNT': '1.851', 'FRAGCOUNT': '2.500'} [2023-02-24 17:44:39,259][177154] DAMAGECOUNT value on done: 17377.0 [2023-02-24 17:44:39,259][177154] Sum rewards: 1.983, reward structure: {'DEATHCOUNT': '-4.500', 'FRAGCOUNT': '0.000', 'AMMO5': '0.017', 'AMMO2': '0.025', 'AMMO3': '0.030', 'WEAPON1': '0.040', 'WEAPON3': '0.100', 'AMMO4': '0.127', 'HITCOUNT': '0.170', 'WEAPON5': '0.350', 'weapon5': '0.372', 'HEALTH': '0.480', 'weapon3': '0.488', 'DAMAGECOUNT': '1.191', 'weapon2': '3.092'} [2023-02-24 17:44:39,317][177158] DAMAGECOUNT value on done: 15158.0 [2023-02-24 17:44:39,318][177158] Sum rewards: 3.413, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.482', 'AMMO5': '0.017', 'AMMO2': '0.022', 'ARMOR': '0.032', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'AMMO4': '0.111', 'weapon4': '0.254', 'HITCOUNT': '0.310', 'weapon5': '0.322', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'weapon2': '0.866', 'weapon3': '1.706', 'DAMAGECOUNT': '1.830', 'FRAGCOUNT': '3.000'} [2023-02-24 17:44:39,548][177154] DAMAGECOUNT value on done: 14975.0 [2023-02-24 17:44:39,621][177158] DAMAGECOUNT value on done: 15985.0 [2023-02-24 17:44:39,621][177158] Sum rewards: -2.127, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.090', 'AMMO5': '0.013', 'AMMO2': '0.022', 'ARMOR': '0.036', 'WEAPON1': '0.060', 'AMMO4': '0.108', 'AMMO3': '0.157', 'weapon5': '0.174', 'weapon4': '0.276', 'HITCOUNT': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.880', 'WEAPON3': '1.050', 'DAMAGECOUNT': '1.365', 'weapon3': '2.342', 'FRAGCOUNT': '3.000'} [2023-02-24 17:44:39,814][177154] DAMAGECOUNT value on done: 17594.0 [2023-02-24 17:44:39,815][177154] Sum rewards: 0.968, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.062', 'AMMO2': '0.021', 'AMMO5': '0.025', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'WEAPON1': '0.110', 'AMMO3': '0.130', 'weapon4': '0.266', 'HITCOUNT': '0.270', 'weapon5': '0.358', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon2': '0.976', 'weapon3': '1.904', 'DAMAGECOUNT': '2.214', 'FRAGCOUNT': '3.000'} [2023-02-24 17:44:39,951][177172] DAMAGECOUNT value on done: 16229.0 [2023-02-24 17:44:39,952][177172] Sum rewards: 0.256, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.037', 'AMMO5': '0.012', 'AMMO2': '0.024', 'WEAPON1': '0.060', 'ARMOR': '0.060', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'AMMO4': '0.121', 'HITCOUNT': '0.190', 'weapon5': '0.280', 'WEAPON5': '0.350', 'weapon4': '0.352', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.780', 'weapon2': '0.980', 'weapon3': '1.852', 'FRAGCOUNT': '2.000'} [2023-02-24 17:44:40,111][177154] DAMAGECOUNT value on done: 17021.0 [2023-02-24 17:44:40,112][177154] Sum rewards: 3.806, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.209', 'AMMO5': '0.005', 'AMMO2': '0.026', 'AMMO3': '0.040', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'ARMOR': '0.068', 'HITCOUNT': '0.080', 'AMMO4': '0.127', 'weapon5': '0.142', 'WEAPON5': '0.200', 'weapon4': '0.204', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.495', 'weapon3': '1.092', 'FRAGCOUNT': '2.000', 'weapon2': '2.146'} [2023-02-24 17:44:40,135][177171] DAMAGECOUNT value on done: 15961.0 [2023-02-24 17:44:40,135][177171] Sum rewards: -0.494, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.509', 'AMMO5': '0.008', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO3': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.110', 'AMMO4': '0.119', 'weapon5': '0.182', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'WEAPON4': '0.350', 'ARMOR': '0.491', 'DAMAGECOUNT': '0.651', 'weapon3': '0.758', 'weapon4': '0.790', 'FRAGCOUNT': '1.000', 'weapon2': '1.434'} [2023-02-24 17:44:40,248][177172] DAMAGECOUNT value on done: 14245.0 [2023-02-24 17:44:40,248][177172] Sum rewards: -2.741, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.184', 'AMMO2': '0.009', 'AMMO5': '0.020', 'ARMOR': '0.028', 'AMMO4': '0.046', 'WEAPON1': '0.050', 'weapon5': '0.086', 'HITCOUNT': '0.130', 'AMMO3': '0.139', 'WEAPON5': '0.450', 'DAMAGECOUNT': '0.453', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.738', 'weapon3': '1.744'} [2023-02-24 17:44:40,314][177153] Updated weights for policy 0, policy_version 4460 (0.0009) [2023-02-24 17:44:40,435][177171] DAMAGECOUNT value on done: 15527.0 [2023-02-24 17:44:40,436][177171] Sum rewards: -0.926, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.572', 'AMMO2': '0.013', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'WEAPON1': '0.100', 'AMMO3': '0.110', 'HITCOUNT': '0.190', 'weapon5': '0.304', 'WEAPON5': '0.500', 'weapon4': '0.522', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.086', 'weapon3': '1.132', 'weapon2': '1.154', 'FRAGCOUNT': '2.000'} [2023-02-24 17:44:40,457][177157] DAMAGECOUNT value on done: 16990.0 [2023-02-24 17:44:40,458][177157] Sum rewards: -2.254, reward structure: {'DEATHCOUNT': '-5.250', 'FRAGCOUNT': '-2.000', 'HEALTH': '-0.945', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon4': '0.232', 'HITCOUNT': '0.290', 'weapon5': '0.290', 'WEAPON3': '0.300', 'WEAPON5': '0.450', 'weapon3': '0.984', 'DAMAGECOUNT': '1.209', 'weapon2': '1.980'} [2023-02-24 17:44:40,658][177155] DAMAGECOUNT value on done: 15867.0 [2023-02-24 17:44:40,659][177155] Sum rewards: -1.110, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.384', 'AMMO5': '0.018', 'AMMO2': '0.050', 'ARMOR': '0.068', 'WEAPON1': '0.100', 'weapon4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'weapon5': '0.182', 'AMMO4': '0.248', 'HITCOUNT': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.086', 'weapon2': '1.188', 'FRAGCOUNT': '2.000', 'weapon3': '2.160'} [2023-02-24 17:44:40,740][177171] DAMAGECOUNT value on done: 15347.0 [2023-02-24 17:44:40,756][177157] DAMAGECOUNT value on done: 17622.0 [2023-02-24 17:44:40,757][177157] Sum rewards: 0.352, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.110', 'AMMO5': '0.018', 'AMMO2': '0.027', 'ARMOR': '0.032', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.143', 'HITCOUNT': '0.180', 'weapon4': '0.226', 'weapon5': '0.280', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.948', 'weapon2': '1.350', 'weapon3': '1.714', 'FRAGCOUNT': '3.000'} [2023-02-24 17:44:40,765][177157] DAMAGECOUNT value on done: 17391.0 [2023-02-24 17:44:40,766][177157] Sum rewards: -0.843, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.912', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.008', 'ARMOR': '0.061', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon4': '0.268', 'HITCOUNT': '0.430', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.440', 'weapon3': '1.552', 'weapon2': '1.670', 'FRAGCOUNT': '4.000'} [2023-02-24 17:44:40,954][177155] DAMAGECOUNT value on done: 17585.0 [2023-02-24 17:44:40,955][177155] Sum rewards: 2.130, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.348', 'AMMO2': '0.004', 'weapon4': '0.006', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'AMMO3': '0.077', 'weapon5': '0.176', 'HITCOUNT': '0.200', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'ARMOR': '0.474', 'weapon3': '0.812', 'weapon2': '1.540', 'DAMAGECOUNT': '2.034', 'FRAGCOUNT': '5.000'} [2023-02-24 17:44:41,031][177155] DAMAGECOUNT value on done: 19073.0 [2023-02-24 17:44:41,031][177155] Sum rewards: 2.833, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.626', 'AMMO2': '0.018', 'AMMO5': '0.026', 'WEAPON1': '0.070', 'AMMO3': '0.084', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'weapon4': '0.252', 'HITCOUNT': '0.360', 'WEAPON3': '0.450', 'weapon5': '0.490', 'WEAPON5': '0.700', 'weapon3': '1.426', 'weapon2': '1.498', 'DAMAGECOUNT': '1.596', 'FRAGCOUNT': '4.000'} [2023-02-24 17:44:41,039][177171] DAMAGECOUNT value on done: 15991.0 [2023-02-24 17:44:41,039][177171] Sum rewards: -2.946, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.990', 'AMMO2': '0.014', 'AMMO5': '0.017', 'ARMOR': '0.040', 'AMMO4': '0.068', 'WEAPON1': '0.090', 'weapon5': '0.136', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'weapon4': '0.278', 'HITCOUNT': '0.300', 'WEAPON5': '0.450', 'weapon2': '1.190', 'WEAPON3': '1.300', 'DAMAGECOUNT': '1.464', 'weapon3': '2.022', 'FRAGCOUNT': '5.000'} [2023-02-24 17:44:41,054][177157] DAMAGECOUNT value on done: 16258.0 [2023-02-24 17:44:41,055][177157] Sum rewards: 1.016, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.962', 'AMMO5': '0.022', 'AMMO2': '0.023', 'WEAPON4': '0.050', 'AMMO3': '0.067', 'WEAPON1': '0.100', 'weapon4': '0.102', 'AMMO4': '0.115', 'HITCOUNT': '0.170', 'weapon5': '0.374', 'WEAPON3': '0.500', 'WEAPON5': '0.550', 'DAMAGECOUNT': '0.984', 'FRAGCOUNT': '1.000', 'weapon3': '1.500', 'weapon2': '1.670'} [2023-02-24 17:44:41,324][177155] DAMAGECOUNT value on done: 15760.0 [2023-02-24 17:44:41,324][177155] Sum rewards: 2.544, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.040', 'AMMO5': '0.023', 'AMMO2': '0.040', 'WEAPON1': '0.060', 'ARMOR': '0.064', 'AMMO3': '0.111', 'weapon4': '0.188', 'weapon5': '0.188', 'AMMO4': '0.198', 'WEAPON4': '0.200', 'HITCOUNT': '0.430', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon2': '1.608', 'weapon3': '1.626', 'DAMAGECOUNT': '2.298', 'FRAGCOUNT': '5.000'} [2023-02-24 17:44:41,376][177119] Fps is (10 sec: 13926.7, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 18280448. Throughput: 0: 3512.4. Samples: 4568028. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:44:41,376][177119] Avg episode reward: [(0, '0.185')] [2023-02-24 17:44:43,198][177153] Updated weights for policy 0, policy_version 4470 (0.0008) [2023-02-24 17:44:43,793][177156] DAMAGECOUNT value on done: 16251.0 [2023-02-24 17:44:43,794][177156] Sum rewards: -3.932, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.090', 'AMMO2': '0.018', 'AMMO5': '0.028', 'weapon4': '0.050', 'AMMO4': '0.089', 'WEAPON1': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'HITCOUNT': '0.210', 'weapon5': '0.214', 'WEAPON5': '0.650', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.795', 'weapon3': '1.514', 'weapon2': '1.536'} [2023-02-24 17:44:44,088][177156] DAMAGECOUNT value on done: 17037.0 [2023-02-24 17:44:44,088][177156] Sum rewards: 0.552, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.570', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO5': '0.013', 'weapon7': '0.022', 'ARMOR': '0.056', 'WEAPON1': '0.070', 'AMMO3': '0.076', 'HITCOUNT': '0.170', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.286', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.182', 'weapon2': '1.398', 'weapon3': '1.848', 'FRAGCOUNT': '3.000'} [2023-02-24 17:44:44,177][177156] DAMAGECOUNT value on done: 17063.0 [2023-02-24 17:44:44,473][177156] DAMAGECOUNT value on done: 19186.0 [2023-02-24 17:44:44,473][177156] Sum rewards: 3.265, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.190', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON1': '0.060', 'ARMOR': '0.072', 'AMMO4': '0.083', 'AMMO3': '0.087', 'weapon4': '0.094', 'WEAPON4': '0.100', 'HITCOUNT': '0.230', 'weapon5': '0.302', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'weapon3': '0.884', 'DAMAGECOUNT': '1.431', 'weapon2': '2.030', 'FRAGCOUNT': '4.000'} [2023-02-24 17:44:46,099][177153] Updated weights for policy 0, policy_version 4480 (0.0009) [2023-02-24 17:44:46,376][177119] Fps is (10 sec: 13926.2, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 18350080. Throughput: 0: 3517.5. Samples: 4589188. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:44:46,376][177119] Avg episode reward: [(0, '0.165')] [2023-02-24 17:44:49,028][177153] Updated weights for policy 0, policy_version 4490 (0.0009) [2023-02-24 17:44:51,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 18423808. Throughput: 0: 3516.8. Samples: 4599698. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:44:51,376][177119] Avg episode reward: [(0, '0.165')] [2023-02-24 17:44:51,947][177153] Updated weights for policy 0, policy_version 4500 (0.0008) [2023-02-24 17:44:54,873][177153] Updated weights for policy 0, policy_version 4510 (0.0008) [2023-02-24 17:44:56,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 18493440. Throughput: 0: 3511.7. Samples: 4620706. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 17:44:56,376][177119] Avg episode reward: [(0, '0.165')] [2023-02-24 17:44:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000004515_18493440.pth... [2023-02-24 17:44:56,441][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000003692_15122432.pth [2023-02-24 17:44:57,025][177170] DAMAGECOUNT value on done: 16422.0 [2023-02-24 17:44:57,026][177170] Sum rewards: -0.562, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.156', 'AMMO5': '0.011', 'AMMO2': '0.032', 'ARMOR': '0.056', 'WEAPON1': '0.060', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'weapon5': '0.100', 'AMMO4': '0.159', 'HITCOUNT': '0.220', 'weapon4': '0.222', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.816', 'FRAGCOUNT': '1.000', 'weapon3': '1.226', 'weapon2': '2.146'} [2023-02-24 17:44:57,295][177170] DAMAGECOUNT value on done: 16209.0 [2023-02-24 17:44:57,295][177170] Sum rewards: 1.073, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.496', 'AMMO5': '0.012', 'AMMO2': '0.019', 'WEAPON1': '0.060', 'AMMO4': '0.092', 'AMMO3': '0.106', 'weapon5': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.270', 'HITCOUNT': '0.340', 'ARMOR': '0.533', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.395', 'weapon3': '1.540', 'weapon2': '1.730', 'FRAGCOUNT': '4.000'} [2023-02-24 17:44:57,340][177170] DAMAGECOUNT value on done: 18673.0 [2023-02-24 17:44:57,604][177170] DAMAGECOUNT value on done: 19922.0 [2023-02-24 17:44:57,604][177170] Sum rewards: 4.537, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.810', 'AMMO5': '0.010', 'AMMO2': '0.010', 'WEAPON1': '0.040', 'AMMO4': '0.052', 'AMMO3': '0.080', 'WEAPON4': '0.150', 'weapon5': '0.238', 'weapon4': '0.242', 'WEAPON5': '0.300', 'HITCOUNT': '0.310', 'WEAPON3': '0.400', 'weapon2': '1.360', 'weapon3': '1.406', 'DAMAGECOUNT': '1.749', 'FRAGCOUNT': '3.500'} [2023-02-24 17:44:57,640][177158] DAMAGECOUNT value on done: 17514.0 [2023-02-24 17:44:57,641][177158] Sum rewards: 5.024, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.238', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.072', 'weapon7': '0.080', 'AMMO4': '0.082', 'AMMO3': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.188', 'HITCOUNT': '0.210', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'weapon3': '0.964', 'DAMAGECOUNT': '1.335', 'weapon2': '2.306', 'FRAGCOUNT': '4.000'} [2023-02-24 17:44:57,805][177153] Updated weights for policy 0, policy_version 4520 (0.0008) [2023-02-24 17:44:57,941][177158] DAMAGECOUNT value on done: 16293.0 [2023-02-24 17:44:57,942][177158] Sum rewards: -1.386, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.272', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'weapon5': '0.052', 'AMMO3': '0.064', 'ARMOR': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'HITCOUNT': '0.140', 'weapon4': '0.144', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.459', 'FRAGCOUNT': '1.000', 'weapon3': '1.358', 'weapon2': '1.628'} [2023-02-24 17:44:58,147][177172] DAMAGECOUNT value on done: 15792.0 [2023-02-24 17:44:58,147][177172] Sum rewards: -0.475, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.171', 'AMMO2': '0.014', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'ARMOR': '0.044', 'weapon7': '0.050', 'AMMO4': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'weapon5': '0.246', 'HITCOUNT': '0.330', 'WEAPON5': '0.400', 'weapon4': '0.554', 'WEAPON3': '0.800', 'weapon3': '1.310', 'DAMAGECOUNT': '1.581', 'weapon2': '1.598', 'FRAGCOUNT': '3.000'} [2023-02-24 17:44:58,389][177154] DAMAGECOUNT value on done: 17857.0 [2023-02-24 17:44:58,390][177154] Sum rewards: -1.488, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.664', 'AMMO5': '0.020', 'AMMO2': '0.029', 'weapon4': '0.056', 'WEAPON1': '0.080', 'AMMO3': '0.119', 'AMMO4': '0.142', 'weapon5': '0.196', 'WEAPON4': '0.200', 'HITCOUNT': '0.280', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.440', 'weapon3': '1.466', 'weapon2': '1.998', 'FRAGCOUNT': '6.000'} [2023-02-24 17:44:58,438][177172] DAMAGECOUNT value on done: 15619.0 [2023-02-24 17:44:58,439][177172] Sum rewards: -2.084, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.188', 'AMMO2': '0.019', 'AMMO5': '0.025', 'WEAPON1': '0.050', 'ARMOR': '0.052', 'AMMO4': '0.095', 'weapon5': '0.134', 'AMMO3': '0.164', 'HITCOUNT': '0.230', 'weapon4': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.550', 'weapon2': '1.004', 'WEAPON3': '1.100', 'DAMAGECOUNT': '1.404', 'FRAGCOUNT': '1.500', 'weapon3': '2.282'} [2023-02-24 17:44:58,525][177158] DAMAGECOUNT value on done: 15419.0 [2023-02-24 17:44:58,526][177158] Sum rewards: 0.756, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.490', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.011', 'WEAPON1': '0.060', 'ARMOR': '0.068', 'AMMO3': '0.082', 'HITCOUNT': '0.200', 'weapon5': '0.228', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.783', 'FRAGCOUNT': '1.000', 'weapon3': '1.328', 'weapon2': '1.926'} [2023-02-24 17:44:58,693][177154] DAMAGECOUNT value on done: 15743.0 [2023-02-24 17:44:58,694][177154] Sum rewards: 5.262, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.298', 'AMMO5': '0.018', 'AMMO2': '0.023', 'WEAPON1': '0.090', 'AMMO4': '0.116', 'AMMO3': '0.132', 'weapon5': '0.184', 'HITCOUNT': '0.310', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'weapon2': '1.450', 'weapon3': '2.032', 'DAMAGECOUNT': '2.304', 'FRAGCOUNT': '6.000'} [2023-02-24 17:44:58,823][177158] DAMAGECOUNT value on done: 16366.0 [2023-02-24 17:44:58,823][177158] Sum rewards: -1.269, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.876', 'AMMO2': '0.014', 'AMMO5': '0.017', 'AMMO4': '0.068', 'WEAPON1': '0.080', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'weapon4': '0.262', 'weapon5': '0.342', 'ARMOR': '0.408', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon3': '1.062', 'DAMAGECOUNT': '1.143', 'FRAGCOUNT': '2.000', 'weapon2': '2.032'} [2023-02-24 17:44:58,940][177154] DAMAGECOUNT value on done: 18095.0 [2023-02-24 17:44:58,941][177154] Sum rewards: 1.449, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon7': '0.056', 'ARMOR': '0.060', 'WEAPON1': '0.070', 'AMMO4': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.106', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'weapon5': '0.246', 'weapon4': '0.292', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'weapon3': '1.048', 'DAMAGECOUNT': '1.503', 'weapon2': '1.724', 'FRAGCOUNT': '3.000'} [2023-02-24 17:44:59,122][177172] DAMAGECOUNT value on done: 16726.0 [2023-02-24 17:44:59,122][177172] Sum rewards: 5.150, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.909', 'AMMO5': '0.012', 'AMMO2': '0.016', 'ARMOR': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.067', 'AMMO4': '0.079', 'weapon5': '0.160', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'WEAPON5': '0.250', 'weapon4': '0.328', 'WEAPON3': '0.450', 'weapon3': '1.034', 'DAMAGECOUNT': '1.491', 'weapon2': '2.204', 'FRAGCOUNT': '4.000'} [2023-02-24 17:44:59,249][177154] DAMAGECOUNT value on done: 17309.0 [2023-02-24 17:44:59,250][177154] Sum rewards: -0.330, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.510', 'AMMO5': '0.010', 'AMMO2': '0.026', 'WEAPON1': '0.050', 'ARMOR': '0.056', 'AMMO3': '0.089', 'weapon4': '0.100', 'AMMO4': '0.129', 'HITCOUNT': '0.130', 'weapon5': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.864', 'weapon3': '0.916', 'FRAGCOUNT': '1.000', 'weapon2': '2.200'} [2023-02-24 17:44:59,371][177171] DAMAGECOUNT value on done: 16436.0 [2023-02-24 17:44:59,371][177171] Sum rewards: 2.094, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.259', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'AMMO4': '0.109', 'weapon5': '0.114', 'AMMO3': '0.135', 'WEAPON5': '0.200', 'HITCOUNT': '0.360', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.425', 'weapon3': '1.568', 'weapon2': '1.858', 'FRAGCOUNT': '4.000'} [2023-02-24 17:44:59,424][177172] DAMAGECOUNT value on done: 15318.0 [2023-02-24 17:44:59,425][177172] Sum rewards: 6.298, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.880', 'AMMO2': '0.009', 'AMMO5': '0.019', 'ARMOR': '0.040', 'AMMO4': '0.047', 'WEAPON1': '0.090', 'AMMO3': '0.130', 'weapon5': '0.308', 'HITCOUNT': '0.340', 'WEAPON5': '0.600', 'WEAPON3': '0.900', 'weapon2': '1.368', 'weapon3': '1.858', 'DAMAGECOUNT': '3.219', 'FRAGCOUNT': '6.000'} [2023-02-24 17:44:59,620][177157] DAMAGECOUNT value on done: 18087.0 [2023-02-24 17:44:59,620][177157] Sum rewards: 6.007, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.722', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.014', 'WEAPON1': '0.050', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'weapon4': '0.168', 'weapon5': '0.192', 'WEAPON5': '0.350', 'HITCOUNT': '0.460', 'ARMOR': '0.546', 'WEAPON3': '0.800', 'weapon3': '1.524', 'weapon2': '1.828', 'DAMAGECOUNT': '3.291', 'FRAGCOUNT': '6.500'} [2023-02-24 17:44:59,675][177171] DAMAGECOUNT value on done: 16134.0 [2023-02-24 17:44:59,675][177171] Sum rewards: -1.069, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.010', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.024', 'ARMOR': '0.072', 'WEAPON1': '0.100', 'AMMO3': '0.150', 'weapon5': '0.282', 'HITCOUNT': '0.340', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'weapon2': '1.382', 'DAMAGECOUNT': '1.821', 'weapon3': '1.968', 'FRAGCOUNT': '3.000'} [2023-02-24 17:44:59,917][177157] DAMAGECOUNT value on done: 17877.0 [2023-02-24 17:44:59,918][177157] Sum rewards: 4.345, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'HEALTH': '0.035', 'ARMOR': '0.040', 'AMMO3': '0.047', 'AMMO4': '0.085', 'weapon5': '0.102', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.260', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.765', 'weapon3': '0.840', 'weapon2': '2.128', 'FRAGCOUNT': '3.000'} [2023-02-24 17:44:59,927][177155] DAMAGECOUNT value on done: 16473.0 [2023-02-24 17:44:59,927][177155] Sum rewards: 5.026, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.516', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.070', 'AMMO3': '0.076', 'weapon5': '0.134', 'WEAPON5': '0.200', 'WEAPON3': '0.400', 'HITCOUNT': '0.480', 'weapon3': '1.132', 'DAMAGECOUNT': '1.818', 'weapon2': '2.152', 'FRAGCOUNT': '5.000'} [2023-02-24 17:44:59,928][177157] DAMAGECOUNT value on done: 17741.0 [2023-02-24 17:44:59,928][177157] Sum rewards: 2.032, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.189', 'AMMO2': '0.004', 'AMMO5': '0.015', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO3': '0.099', 'weapon4': '0.210', 'weapon5': '0.228', 'HITCOUNT': '0.280', 'WEAPON5': '0.450', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.050', 'weapon3': '1.572', 'weapon2': '1.722', 'FRAGCOUNT': '3.000'} [2023-02-24 17:44:59,969][177171] DAMAGECOUNT value on done: 15618.0 [2023-02-24 17:44:59,970][177171] Sum rewards: -1.420, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.871', 'AMMO2': '0.006', 'AMMO5': '0.014', 'AMMO4': '0.031', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'ARMOR': '0.104', 'HITCOUNT': '0.130', 'AMMO3': '0.154', 'weapon4': '0.180', 'weapon5': '0.214', 'WEAPON5': '0.350', 'weapon2': '0.800', 'DAMAGECOUNT': '0.813', 'WEAPON3': '0.850', 'weapon3': '1.894', 'FRAGCOUNT': '2.000'} [2023-02-24 17:45:00,223][177155] DAMAGECOUNT value on done: 18255.0 [2023-02-24 17:45:00,223][177155] Sum rewards: -2.889, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.490', 'AMMO2': '0.007', 'AMMO5': '0.020', 'AMMO4': '0.033', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.116', 'weapon5': '0.182', 'AMMO3': '0.189', 'WEAPON5': '0.500', 'HITCOUNT': '0.510', 'WEAPON3': '0.950', 'weapon3': '1.464', 'FRAGCOUNT': '1.500', 'weapon2': '1.530', 'DAMAGECOUNT': '2.010'} [2023-02-24 17:45:00,231][177157] DAMAGECOUNT value on done: 16727.0 [2023-02-24 17:45:00,231][177157] Sum rewards: 0.122, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.014', 'AMMO5': '0.017', 'AMMO2': '0.018', 'ARMOR': '0.020', 'weapon4': '0.060', 'WEAPON1': '0.070', 'AMMO4': '0.089', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'weapon5': '0.184', 'HITCOUNT': '0.280', 'WEAPON5': '0.400', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.407', 'weapon2': '1.494', 'weapon3': '1.698'} [2023-02-24 17:45:00,264][177171] DAMAGECOUNT value on done: 16699.0 [2023-02-24 17:45:00,265][177171] Sum rewards: 3.339, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.604', 'AMMO2': '0.007', 'AMMO5': '0.017', 'ARMOR': '0.020', 'AMMO4': '0.033', 'AMMO3': '0.066', 'WEAPON1': '0.080', 'WEAPON4': '0.200', 'weapon5': '0.258', 'weapon4': '0.260', 'HITCOUNT': '0.320', 'WEAPON3': '0.400', 'WEAPON5': '0.500', 'weapon3': '1.290', 'weapon2': '1.868', 'DAMAGECOUNT': '2.124', 'FRAGCOUNT': '2.500'} [2023-02-24 17:45:00,291][177155] DAMAGECOUNT value on done: 19213.0 [2023-02-24 17:45:00,292][177155] Sum rewards: -5.960, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.979', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.010', 'AMMO2': '0.023', 'WEAPON1': '0.060', 'AMMO3': '0.106', 'AMMO4': '0.115', 'ARMOR': '0.116', 'HITCOUNT': '0.130', 'weapon4': '0.144', 'weapon5': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.550', 'weapon3': '1.492', 'weapon2': '1.820'} [2023-02-24 17:45:00,592][177155] DAMAGECOUNT value on done: 15920.0 [2023-02-24 17:45:00,592][177155] Sum rewards: -0.832, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.900', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.040', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'AMMO3': '0.112', 'weapon5': '0.126', 'HITCOUNT': '0.140', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.700', 'weapon3': '1.544', 'FRAGCOUNT': '2.000', 'weapon2': '2.168'} [2023-02-24 17:45:00,759][177153] Updated weights for policy 0, policy_version 4530 (0.0009) [2023-02-24 17:45:01,376][177119] Fps is (10 sec: 13926.5, 60 sec: 14063.0, 300 sec: 14051.4). Total num frames: 18563072. Throughput: 0: 3505.8. Samples: 4641576. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:45:01,376][177119] Avg episode reward: [(0, '0.531')] [2023-02-24 17:45:01,377][177140] Saving new best policy, reward=0.531! [2023-02-24 17:45:02,917][177156] DAMAGECOUNT value on done: 16636.0 [2023-02-24 17:45:02,917][177156] Sum rewards: 1.786, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.182', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.032', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.097', 'AMMO4': '0.110', 'weapon5': '0.172', 'WEAPON5': '0.200', 'HITCOUNT': '0.330', 'ARMOR': '0.432', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.155', 'weapon2': '1.518', 'weapon3': '1.902', 'FRAGCOUNT': '2.000'} [2023-02-24 17:45:03,221][177156] DAMAGECOUNT value on done: 17407.0 [2023-02-24 17:45:03,222][177156] Sum rewards: 4.120, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.498', 'AMMO2': '0.000', 'AMMO4': '0.001', 'ARMOR': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.070', 'AMMO3': '0.072', 'weapon7': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.242', 'HITCOUNT': '0.260', 'WEAPON3': '0.300', 'WEAPON5': '0.400', 'weapon3': '0.734', 'DAMAGECOUNT': '1.110', 'weapon2': '2.376', 'FRAGCOUNT': '3.000'} [2023-02-24 17:45:03,319][177156] DAMAGECOUNT value on done: 18353.0 [2023-02-24 17:45:03,320][177156] Sum rewards: 2.209, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.706', 'AMMO5': '0.012', 'AMMO2': '0.020', 'WEAPON1': '0.050', 'weapon7': '0.074', 'ARMOR': '0.088', 'AMMO4': '0.101', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'HITCOUNT': '0.170', 'WEAPON7': '0.200', 'weapon4': '0.218', 'weapon5': '0.242', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'weapon3': '1.020', 'DAMAGECOUNT': '2.070', 'weapon2': '2.086', 'FRAGCOUNT': '4.000'} [2023-02-24 17:45:03,620][177156] DAMAGECOUNT value on done: 20019.0 [2023-02-24 17:45:03,620][177156] Sum rewards: 0.890, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.381', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.019', 'WEAPON1': '0.050', 'ARMOR': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'weapon4': '0.188', 'weapon5': '0.200', 'HITCOUNT': '0.390', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'weapon2': '1.276', 'weapon3': '1.450', 'DAMAGECOUNT': '2.499', 'FRAGCOUNT': '4.500'} [2023-02-24 17:45:03,659][177153] Updated weights for policy 0, policy_version 4540 (0.0008) [2023-02-24 17:45:06,376][177119] Fps is (10 sec: 13926.5, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 18632704. Throughput: 0: 3506.7. Samples: 4652124. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:45:06,376][177119] Avg episode reward: [(0, '0.662')] [2023-02-24 17:45:06,379][177140] Saving new best policy, reward=0.662! [2023-02-24 17:45:06,579][177153] Updated weights for policy 0, policy_version 4550 (0.0008) [2023-02-24 17:45:09,536][177153] Updated weights for policy 0, policy_version 4560 (0.0008) [2023-02-24 17:45:11,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 18702336. Throughput: 0: 3503.7. Samples: 4673092. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:45:11,376][177119] Avg episode reward: [(0, '0.662')] [2023-02-24 17:45:12,464][177153] Updated weights for policy 0, policy_version 4570 (0.0008) [2023-02-24 17:45:15,394][177153] Updated weights for policy 0, policy_version 4580 (0.0008) [2023-02-24 17:45:16,282][177170] DAMAGECOUNT value on done: 16582.0 [2023-02-24 17:45:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14037.5). Total num frames: 18771968. Throughput: 0: 3501.5. Samples: 4694066. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:45:16,376][177119] Avg episode reward: [(0, '0.645')] [2023-02-24 17:45:16,543][177170] DAMAGECOUNT value on done: 16899.0 [2023-02-24 17:45:16,544][177170] Sum rewards: -1.627, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.704', 'AMMO5': '0.010', 'AMMO2': '0.021', 'ARMOR': '0.028', 'weapon4': '0.054', 'WEAPON1': '0.060', 'AMMO3': '0.101', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'weapon5': '0.168', 'WEAPON5': '0.250', 'HITCOUNT': '0.300', 'WEAPON3': '0.750', 'weapon3': '1.734', 'weapon2': '1.774', 'DAMAGECOUNT': '2.070', 'FRAGCOUNT': '3.000'} [2023-02-24 17:45:16,595][177170] DAMAGECOUNT value on done: 19206.0 [2023-02-24 17:45:16,595][177170] Sum rewards: -1.321, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.210', 'AMMO2': '0.006', 'AMMO5': '0.022', 'AMMO4': '0.030', 'ARMOR': '0.048', 'WEAPON1': '0.070', 'weapon4': '0.098', 'WEAPON4': '0.100', 'weapon5': '0.148', 'AMMO3': '0.168', 'HITCOUNT': '0.440', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'weapon2': '1.546', 'DAMAGECOUNT': '1.599', 'weapon3': '1.764', 'FRAGCOUNT': '3.000'} [2023-02-24 17:45:16,819][177158] DAMAGECOUNT value on done: 17963.0 [2023-02-24 17:45:16,819][177158] Sum rewards: 1.281, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.014', 'AMMO5': '0.015', 'weapon4': '0.040', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'HEALTH': '0.068', 'AMMO4': '0.072', 'AMMO3': '0.102', 'weapon5': '0.194', 'HITCOUNT': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.347', 'weapon2': '1.630', 'weapon3': '1.748', 'FRAGCOUNT': '3.000'} [2023-02-24 17:45:16,852][177170] DAMAGECOUNT value on done: 20355.0 [2023-02-24 17:45:16,852][177170] Sum rewards: 0.807, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.559', 'AMMO5': '0.010', 'AMMO2': '0.022', 'ARMOR': '0.044', 'WEAPON1': '0.050', 'AMMO3': '0.068', 'weapon7': '0.084', 'AMMO4': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.168', 'HITCOUNT': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.336', 'WEAPON3': '0.450', 'weapon3': '0.954', 'DAMAGECOUNT': '1.299', 'FRAGCOUNT': '2.000', 'weapon2': '2.180'} [2023-02-24 17:45:17,119][177158] DAMAGECOUNT value on done: 16556.0 [2023-02-24 17:45:17,120][177158] Sum rewards: -0.374, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.160', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.015', 'ARMOR': '0.044', 'AMMO3': '0.070', 'WEAPON1': '0.070', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.176', 'weapon5': '0.188', 'WEAPON3': '0.300', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.789', 'weapon3': '1.068', 'weapon2': '1.754', 'FRAGCOUNT': '3.000'} [2023-02-24 17:45:17,334][177172] DAMAGECOUNT value on done: 16027.0 [2023-02-24 17:45:17,334][177172] Sum rewards: 2.760, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.088', 'AMMO5': '0.003', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.023', 'AMMO3': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.082', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'WEAPON3': '0.150', 'weapon4': '0.196', 'ARMOR': '0.501', 'weapon2': '0.616', 'DAMAGECOUNT': '0.705', 'weapon3': '0.758', 'FRAGCOUNT': '1.000'} [2023-02-24 17:45:17,602][177154] DAMAGECOUNT value on done: 18723.0 [2023-02-24 17:45:17,602][177154] Sum rewards: 2.598, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.496', 'AMMO2': '0.013', 'AMMO5': '0.017', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.112', 'WEAPON4': '0.150', 'weapon4': '0.208', 'weapon5': '0.248', 'WEAPON5': '0.450', 'HITCOUNT': '0.530', 'WEAPON3': '0.800', 'weapon2': '1.478', 'weapon3': '1.584', 'DAMAGECOUNT': '2.598', 'FRAGCOUNT': '4.000'} [2023-02-24 17:45:17,634][177172] DAMAGECOUNT value on done: 15977.0 [2023-02-24 17:45:17,634][177172] Sum rewards: -1.185, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.167', 'AMMO2': '0.009', 'AMMO5': '0.021', 'AMMO4': '0.043', 'AMMO3': '0.069', 'weapon4': '0.076', 'WEAPON4': '0.100', 'WEAPON1': '0.120', 'HITCOUNT': '0.250', 'weapon5': '0.348', 'WEAPON3': '0.400', 'ARMOR': '0.448', 'WEAPON5': '0.550', 'weapon3': '1.054', 'DAMAGECOUNT': '1.074', 'weapon2': '2.170', 'FRAGCOUNT': '3.000'} [2023-02-24 17:45:17,701][177158] DAMAGECOUNT value on done: 15967.0 [2023-02-24 17:45:17,702][177158] Sum rewards: 0.846, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.682', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.020', 'WEAPON1': '0.080', 'AMMO3': '0.142', 'weapon5': '0.282', 'HITCOUNT': '0.390', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'weapon2': '1.040', 'DAMAGECOUNT': '1.644', 'weapon3': '2.228', 'FRAGCOUNT': '5.000'} [2023-02-24 17:45:17,911][177154] DAMAGECOUNT value on done: 16316.0 [2023-02-24 17:45:17,911][177154] Sum rewards: 2.784, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.282', 'AMMO2': '0.011', 'AMMO5': '0.015', 'WEAPON1': '0.050', 'AMMO4': '0.052', 'ARMOR': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.157', 'weapon4': '0.176', 'weapon5': '0.266', 'HITCOUNT': '0.330', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'weapon2': '1.460', 'DAMAGECOUNT': '1.719', 'weapon3': '1.724', 'FRAGCOUNT': '4.000'} [2023-02-24 17:45:17,998][177158] DAMAGECOUNT value on done: 17108.0 [2023-02-24 17:45:17,998][177158] Sum rewards: 3.526, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.241', 'AMMO5': '0.016', 'AMMO2': '0.023', 'WEAPON4': '0.050', 'AMMO4': '0.112', 'AMMO3': '0.113', 'WEAPON1': '0.120', 'weapon4': '0.198', 'weapon5': '0.332', 'HITCOUNT': '0.430', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'weapon2': '1.364', 'weapon3': '1.682', 'DAMAGECOUNT': '2.226', 'FRAGCOUNT': '5.000'} [2023-02-24 17:45:18,151][177154] DAMAGECOUNT value on done: 18664.0 [2023-02-24 17:45:18,151][177154] Sum rewards: -0.420, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.997', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.072', 'ARMOR': '0.108', 'weapon5': '0.130', 'AMMO3': '0.133', 'weapon4': '0.198', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.480', 'WEAPON3': '0.750', 'weapon3': '1.572', 'DAMAGECOUNT': '1.707', 'weapon2': '1.822', 'FRAGCOUNT': '3.000'} [2023-02-24 17:45:18,249][177172] DAMAGECOUNT value on done: 16949.0 [2023-02-24 17:45:18,249][177172] Sum rewards: -1.624, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.010', 'AMMO2': '0.019', 'ARMOR': '0.044', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.052', 'AMMO3': '0.090', 'AMMO4': '0.095', 'weapon5': '0.120', 'HEALTH': '0.152', 'HITCOUNT': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.669', 'FRAGCOUNT': '1.000', 'weapon3': '1.258', 'weapon2': '2.116'} [2023-02-24 17:45:18,329][177153] Updated weights for policy 0, policy_version 4590 (0.0008) [2023-02-24 17:45:18,454][177154] DAMAGECOUNT value on done: 17644.0 [2023-02-24 17:45:18,454][177154] Sum rewards: -0.306, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.988', 'AMMO5': '0.012', 'ARMOR': '0.024', 'AMMO2': '0.027', 'WEAPON1': '0.080', 'AMMO3': '0.086', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'weapon5': '0.180', 'weapon4': '0.214', 'HITCOUNT': '0.280', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.005', 'weapon3': '1.430', 'weapon2': '1.756', 'FRAGCOUNT': '2.000'} [2023-02-24 17:45:18,552][177172] DAMAGECOUNT value on done: 15714.0 [2023-02-24 17:45:18,553][177172] Sum rewards: -3.213, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.650', 'AMMO2': '0.010', 'AMMO5': '0.022', 'AMMO4': '0.049', 'WEAPON1': '0.050', 'AMMO3': '0.087', 'ARMOR': '0.100', 'weapon4': '0.150', 'weapon5': '0.172', 'WEAPON4': '0.200', 'HITCOUNT': '0.320', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.188', 'weapon2': '1.522', 'weapon3': '1.616'} [2023-02-24 17:45:18,637][177171] DAMAGECOUNT value on done: 16621.0 [2023-02-24 17:45:18,637][177171] Sum rewards: -0.604, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.665', 'AMMO2': '0.011', 'AMMO5': '0.017', 'AMMO4': '0.054', 'WEAPON1': '0.070', 'AMMO3': '0.076', 'HITCOUNT': '0.130', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.206', 'WEAPON5': '0.350', 'weapon4': '0.396', 'DAMAGECOUNT': '0.555', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.234', 'weapon3': '1.562'} [2023-02-24 17:45:18,804][177157] DAMAGECOUNT value on done: 18643.0 [2023-02-24 17:45:18,805][177157] Sum rewards: -2.975, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.192', 'AMMO2': '0.019', 'AMMO5': '0.021', 'WEAPON4': '0.050', 'WEAPON1': '0.090', 'AMMO4': '0.092', 'AMMO3': '0.145', 'weapon4': '0.214', 'weapon5': '0.220', 'HITCOUNT': '0.250', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.188', 'weapon2': '1.358', 'weapon3': '1.570', 'FRAGCOUNT': '3.000'} [2023-02-24 17:45:18,933][177171] DAMAGECOUNT value on done: 16466.0 [2023-02-24 17:45:18,933][177171] Sum rewards: 0.200, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.862', 'AMMO2': '0.013', 'AMMO5': '0.023', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'AMMO4': '0.062', 'WEAPON1': '0.080', 'AMMO3': '0.115', 'weapon4': '0.150', 'HITCOUNT': '0.210', 'weapon5': '0.272', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.996', 'weapon2': '1.302', 'weapon3': '1.802', 'FRAGCOUNT': '3.000'} [2023-02-24 17:45:19,100][177157] DAMAGECOUNT value on done: 17806.0 [2023-02-24 17:45:19,116][177155] DAMAGECOUNT value on done: 16833.0 [2023-02-24 17:45:19,117][177155] Sum rewards: -1.060, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.208', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'AMMO5': '0.017', 'WEAPON1': '0.060', 'AMMO3': '0.085', 'HITCOUNT': '0.120', 'weapon5': '0.170', 'WEAPON5': '0.400', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.080', 'weapon2': '1.530', 'weapon3': '1.642'} [2023-02-24 17:45:19,122][177157] DAMAGECOUNT value on done: 18117.0 [2023-02-24 17:45:19,122][177157] Sum rewards: 2.242, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.017', 'AMMO2': '0.024', 'HEALTH': '0.040', 'AMMO3': '0.052', 'WEAPON1': '0.070', 'AMMO4': '0.122', 'HITCOUNT': '0.170', 'weapon5': '0.264', 'WEAPON3': '0.300', 'WEAPON5': '0.400', 'weapon3': '0.714', 'DAMAGECOUNT': '0.720', 'FRAGCOUNT': '2.000', 'weapon2': '2.598'} [2023-02-24 17:45:19,229][177171] DAMAGECOUNT value on done: 15926.0 [2023-02-24 17:45:19,230][177171] Sum rewards: -3.519, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.750', 'AMMO2': '0.016', 'ARMOR': '0.024', 'AMMO5': '0.029', 'AMMO4': '0.080', 'WEAPON1': '0.090', 'AMMO3': '0.109', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'weapon4': '0.240', 'weapon5': '0.316', 'WEAPON5': '0.700', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.924', 'weapon3': '1.368', 'weapon2': '1.674', 'FRAGCOUNT': '3.000'} [2023-02-24 17:45:19,421][177155] DAMAGECOUNT value on done: 19164.0 [2023-02-24 17:45:19,421][177155] Sum rewards: 4.713, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.012', 'AMMO5': '0.017', 'HEALTH': '0.045', 'WEAPON1': '0.050', 'AMMO4': '0.059', 'ARMOR': '0.060', 'AMMO3': '0.108', 'weapon5': '0.330', 'WEAPON5': '0.350', 'HITCOUNT': '0.490', 'WEAPON3': '0.650', 'weapon3': '1.536', 'weapon2': '1.778', 'DAMAGECOUNT': '2.727', 'FRAGCOUNT': '5.500'} [2023-02-24 17:45:19,422][177157] DAMAGECOUNT value on done: 16936.0 [2023-02-24 17:45:19,422][177157] Sum rewards: -3.185, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.319', 'AMMO2': '0.019', 'ARMOR': '0.020', 'AMMO5': '0.023', 'WEAPON1': '0.050', 'AMMO4': '0.094', 'AMMO3': '0.095', 'weapon4': '0.132', 'weapon5': '0.132', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'WEAPON5': '0.450', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.627', 'WEAPON3': '0.650', 'weapon3': '1.498', 'weapon2': '1.764'} [2023-02-24 17:45:19,500][177155] DAMAGECOUNT value on done: 19701.0 [2023-02-24 17:45:19,500][177155] Sum rewards: -1.094, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.592', 'AMMO5': '0.015', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'ARMOR': '0.060', 'AMMO3': '0.094', 'AMMO4': '0.119', 'weapon4': '0.124', 'WEAPON4': '0.150', 'weapon5': '0.150', 'WEAPON5': '0.300', 'HITCOUNT': '0.390', 'WEAPON3': '0.600', 'weapon3': '1.050', 'DAMAGECOUNT': '1.464', 'weapon2': '1.918', 'FRAGCOUNT': '3.000'} [2023-02-24 17:45:19,522][177171] DAMAGECOUNT value on done: 17223.0 [2023-02-24 17:45:19,523][177171] Sum rewards: -4.093, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.230', 'AMMO5': '0.015', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'ARMOR': '0.056', 'AMMO3': '0.085', 'AMMO4': '0.101', 'weapon5': '0.164', 'WEAPON4': '0.200', 'weapon4': '0.268', 'HITCOUNT': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'weapon3': '0.832', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.572', 'weapon2': '2.594'} [2023-02-24 17:45:19,813][177155] DAMAGECOUNT value on done: 16570.0 [2023-02-24 17:45:19,814][177155] Sum rewards: 2.198, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.270', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO5': '0.022', 'ARMOR': '0.040', 'AMMO3': '0.057', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'HITCOUNT': '0.300', 'weapon5': '0.316', 'WEAPON3': '0.400', 'WEAPON5': '0.500', 'weapon3': '0.836', 'DAMAGECOUNT': '1.950', 'weapon2': '2.350', 'FRAGCOUNT': '4.000'} [2023-02-24 17:45:21,251][177153] Updated weights for policy 0, policy_version 4600 (0.0008) [2023-02-24 17:45:21,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.6, 300 sec: 14037.5). Total num frames: 18841600. Throughput: 0: 3499.2. Samples: 4704524. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:45:21,376][177119] Avg episode reward: [(0, '0.478')] [2023-02-24 17:45:22,158][177156] DAMAGECOUNT value on done: 16899.0 [2023-02-24 17:45:22,158][177156] Sum rewards: -1.849, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.954', 'AMMO5': '0.022', 'AMMO2': '0.032', 'ARMOR': '0.066', 'WEAPON1': '0.070', 'AMMO3': '0.132', 'AMMO4': '0.158', 'weapon4': '0.174', 'WEAPON4': '0.200', 'weapon5': '0.248', 'HITCOUNT': '0.270', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.789', 'weapon3': '0.798', 'FRAGCOUNT': '2.000', 'weapon2': '2.196'} [2023-02-24 17:45:22,452][177156] DAMAGECOUNT value on done: 17658.0 [2023-02-24 17:45:22,452][177156] Sum rewards: 1.244, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.074', 'AMMO2': '0.005', 'AMMO5': '0.015', 'AMMO4': '0.023', 'AMMO3': '0.050', 'weapon7': '0.056', 'HITCOUNT': '0.060', 'WEAPON1': '0.060', 'ARMOR': '0.072', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.210', 'weapon5': '0.228', 'WEAPON3': '0.300', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.753', 'weapon3': '1.032', 'weapon2': '1.514', 'FRAGCOUNT': '2.000'} [2023-02-24 17:45:22,539][177156] DAMAGECOUNT value on done: 18944.0 [2023-02-24 17:45:22,539][177156] Sum rewards: 4.021, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.578', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.012', 'weapon4': '0.026', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.123', 'HITCOUNT': '0.300', 'WEAPON5': '0.300', 'weapon5': '0.300', 'WEAPON3': '0.600', 'weapon3': '1.278', 'weapon2': '1.756', 'DAMAGECOUNT': '1.773', 'FRAGCOUNT': '4.000'} [2023-02-24 17:45:22,838][177156] DAMAGECOUNT value on done: 20482.0 [2023-02-24 17:45:22,839][177156] Sum rewards: 3.004, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.379', 'AMMO4': '-0.080', 'AMMO2': '-0.016', 'AMMO5': '0.018', 'AMMO3': '0.055', 'WEAPON1': '0.080', 'HITCOUNT': '0.240', 'weapon5': '0.364', 'WEAPON3': '0.450', 'WEAPON5': '0.500', 'weapon3': '1.080', 'DAMAGECOUNT': '1.389', 'weapon2': '1.802', 'FRAGCOUNT': '3.000'} [2023-02-24 17:45:24,140][177153] Updated weights for policy 0, policy_version 4610 (0.0008) [2023-02-24 17:45:26,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 14037.5). Total num frames: 18911232. Throughput: 0: 3504.0. Samples: 4725706. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:45:26,376][177119] Avg episode reward: [(0, '0.609')] [2023-02-24 17:45:27,029][177153] Updated weights for policy 0, policy_version 4620 (0.0008) [2023-02-24 17:45:28,702][177171] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 17:45:29,946][177153] Updated weights for policy 0, policy_version 4630 (0.0008) [2023-02-24 17:45:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14037.5). Total num frames: 18980864. Throughput: 0: 3503.5. Samples: 4746846. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:45:31,376][177119] Avg episode reward: [(0, '0.609')] [2023-02-24 17:45:32,868][177153] Updated weights for policy 0, policy_version 4640 (0.0008) [2023-02-24 17:45:33,328][177155] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 17:45:35,390][177170] DAMAGECOUNT value on done: 16881.0 [2023-02-24 17:45:35,391][177170] Sum rewards: 1.190, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.531', 'AMMO5': '0.010', 'ARMOR': '0.017', 'AMMO2': '0.018', 'WEAPON1': '0.050', 'AMMO3': '0.061', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'weapon4': '0.158', 'HITCOUNT': '0.180', 'weapon5': '0.220', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'weapon3': '0.732', 'DAMAGECOUNT': '0.897', 'FRAGCOUNT': '2.000', 'weapon2': '2.590'} [2023-02-24 17:45:35,655][177170] DAMAGECOUNT value on done: 17258.0 [2023-02-24 17:45:35,655][177170] Sum rewards: -0.845, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.480', 'AMMO2': '0.013', 'AMMO5': '0.019', 'AMMO4': '0.063', 'AMMO3': '0.073', 'WEAPON1': '0.080', 'WEAPON4': '0.150', 'weapon5': '0.194', 'HITCOUNT': '0.250', 'weapon4': '0.256', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.077', 'weapon3': '1.082', 'weapon2': '2.178'} [2023-02-24 17:45:35,700][177170] DAMAGECOUNT value on done: 19751.0 [2023-02-24 17:45:35,700][177170] Sum rewards: 0.353, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.620', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO5': '0.017', 'ARMOR': '0.024', 'WEAPON1': '0.090', 'AMMO3': '0.124', 'weapon5': '0.270', 'HITCOUNT': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'weapon2': '1.018', 'DAMAGECOUNT': '1.635', 'weapon3': '2.178', 'FRAGCOUNT': '3.000'} [2023-02-24 17:45:35,781][177153] Updated weights for policy 0, policy_version 4650 (0.0009) [2023-02-24 17:45:35,901][177158] DAMAGECOUNT value on done: 18197.0 [2023-02-24 17:45:35,901][177158] Sum rewards: 0.262, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.618', 'AMMO5': '0.010', 'AMMO2': '0.026', 'ARMOR': '0.032', 'WEAPON1': '0.060', 'AMMO3': '0.087', 'AMMO4': '0.131', 'HITCOUNT': '0.140', 'weapon5': '0.196', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'weapon3': '0.628', 'DAMAGECOUNT': '0.702', 'FRAGCOUNT': '1.000', 'weapon2': '2.468'} [2023-02-24 17:45:35,964][177170] DAMAGECOUNT value on done: 20878.0 [2023-02-24 17:45:35,964][177170] Sum rewards: 0.052, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.778', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON1': '0.070', 'AMMO4': '0.090', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon7': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.140', 'WEAPON7': '0.200', 'weapon4': '0.204', 'weapon5': '0.252', 'WEAPON5': '0.400', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.650', 'weapon2': '1.314', 'DAMAGECOUNT': '1.569', 'weapon3': '1.614'} [2023-02-24 17:45:36,204][177158] DAMAGECOUNT value on done: 17378.0 [2023-02-24 17:45:36,205][177158] Sum rewards: -0.793, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.479', 'AMMO2': '0.021', 'AMMO5': '0.022', 'AMMO4': '0.103', 'WEAPON1': '0.120', 'AMMO3': '0.140', 'HITCOUNT': '0.310', 'weapon5': '0.354', 'WEAPON5': '0.650', 'WEAPON3': '0.850', 'weapon2': '1.534', 'weapon3': '1.616', 'DAMAGECOUNT': '2.466', 'FRAGCOUNT': '4.000'} [2023-02-24 17:45:36,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 14037.5). Total num frames: 19050496. Throughput: 0: 3503.3. Samples: 4757346. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:45:36,376][177119] Avg episode reward: [(0, '0.577')] [2023-02-24 17:45:36,449][177172] DAMAGECOUNT value on done: 16379.0 [2023-02-24 17:45:36,450][177172] Sum rewards: -3.700, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.892', 'AMMO5': '0.023', 'AMMO2': '0.029', 'ARMOR': '0.040', 'WEAPON1': '0.070', 'AMMO3': '0.075', 'AMMO4': '0.147', 'HITCOUNT': '0.230', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'weapon4': '0.412', 'weapon5': '0.440', 'WEAPON5': '0.550', 'weapon3': '0.650', 'DAMAGECOUNT': '1.056', 'weapon2': '1.570', 'FRAGCOUNT': '2.000'} [2023-02-24 17:45:36,737][177154] DAMAGECOUNT value on done: 19093.0 [2023-02-24 17:45:36,737][177154] Sum rewards: 0.029, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.318', 'AMMO5': '0.017', 'AMMO2': '0.046', 'WEAPON1': '0.080', 'weapon5': '0.108', 'AMMO3': '0.117', 'AMMO4': '0.232', 'HITCOUNT': '0.240', 'WEAPON4': '0.250', 'weapon4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.471', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.110', 'weapon2': '1.144', 'weapon3': '1.980', 'FRAGCOUNT': '3.000'} [2023-02-24 17:45:36,744][177172] DAMAGECOUNT value on done: 16429.0 [2023-02-24 17:45:36,745][177172] Sum rewards: -0.322, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.330', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.024', 'WEAPON1': '0.110', 'AMMO3': '0.160', 'weapon5': '0.172', 'HITCOUNT': '0.280', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.356', 'weapon2': '1.424', 'weapon3': '1.936', 'FRAGCOUNT': '4.000'} [2023-02-24 17:45:36,799][177158] DAMAGECOUNT value on done: 16216.0 [2023-02-24 17:45:36,800][177158] Sum rewards: -7.408, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-3.000', 'HEALTH': '-1.129', 'AMMO2': '0.006', 'AMMO5': '0.027', 'AMMO4': '0.029', 'WEAPON1': '0.060', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'weapon5': '0.208', 'HITCOUNT': '0.210', 'weapon4': '0.212', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.747', 'weapon3': '0.820', 'weapon2': '2.160'} [2023-02-24 17:45:37,037][177154] DAMAGECOUNT value on done: 16779.0 [2023-02-24 17:45:37,038][177154] Sum rewards: -0.985, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.453', 'AMMO2': '0.009', 'AMMO5': '0.014', 'AMMO4': '0.045', 'WEAPON1': '0.060', 'AMMO3': '0.124', 'HITCOUNT': '0.240', 'weapon5': '0.298', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'weapon2': '1.192', 'DAMAGECOUNT': '1.389', 'weapon3': '1.996', 'FRAGCOUNT': '3.000'} [2023-02-24 17:45:37,098][177158] DAMAGECOUNT value on done: 17354.0 [2023-02-24 17:45:37,241][177154] DAMAGECOUNT value on done: 19141.0 [2023-02-24 17:45:37,242][177154] Sum rewards: 0.692, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.988', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.021', 'ARMOR': '0.028', 'WEAPON4': '0.050', 'WEAPON1': '0.090', 'AMMO3': '0.092', 'HITCOUNT': '0.160', 'weapon5': '0.428', 'WEAPON3': '0.600', 'WEAPON5': '0.650', 'weapon3': '1.306', 'DAMAGECOUNT': '1.431', 'weapon2': '1.596', 'FRAGCOUNT': '3.000'} [2023-02-24 17:45:37,359][177172] DAMAGECOUNT value on done: 17309.0 [2023-02-24 17:45:37,360][177172] Sum rewards: 1.135, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.648', 'AMMO5': '0.010', 'AMMO2': '0.012', 'ARMOR': '0.028', 'WEAPON1': '0.050', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'weapon4': '0.112', 'AMMO3': '0.120', 'weapon5': '0.140', 'HITCOUNT': '0.260', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'DAMAGECOUNT': '1.080', 'weapon3': '1.336', 'weapon2': '2.278', 'FRAGCOUNT': '3.000'} [2023-02-24 17:45:37,536][177154] DAMAGECOUNT value on done: 17744.0 [2023-02-24 17:45:37,537][177154] Sum rewards: -1.741, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.204', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'ARMOR': '0.052', 'weapon5': '0.056', 'HITCOUNT': '0.070', 'weapon4': '0.070', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.123', 'weapon7': '0.134', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.222', 'weapon2': '1.672'} [2023-02-24 17:45:37,652][177172] DAMAGECOUNT value on done: 16170.0 [2023-02-24 17:45:37,653][177172] Sum rewards: 1.086, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.820', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO5': '0.017', 'ARMOR': '0.040', 'weapon7': '0.056', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.160', 'weapon4': '0.172', 'WEAPON7': '0.200', 'weapon5': '0.262', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'weapon3': '1.260', 'DAMAGECOUNT': '1.368', 'weapon2': '1.392', 'FRAGCOUNT': '3.000'} [2023-02-24 17:45:37,757][177171] DAMAGECOUNT value on done: 17041.0 [2023-02-24 17:45:37,757][177171] Sum rewards: 1.060, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.124', 'AMMO5': '0.012', 'AMMO2': '0.024', 'WEAPON1': '0.050', 'ARMOR': '0.080', 'AMMO3': '0.112', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'weapon4': '0.210', 'weapon5': '0.210', 'WEAPON5': '0.250', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.260', 'weapon3': '1.374', 'weapon2': '1.430', 'FRAGCOUNT': '5.000'} [2023-02-24 17:45:37,947][177157] DAMAGECOUNT value on done: 19398.0 [2023-02-24 17:45:37,947][177157] Sum rewards: 2.491, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.726', 'AMMO2': '0.006', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.030', 'AMMO3': '0.087', 'HITCOUNT': '0.230', 'WEAPON5': '0.300', 'weapon5': '0.352', 'WEAPON3': '0.600', 'weapon3': '1.264', 'weapon2': '2.040', 'DAMAGECOUNT': '2.265', 'FRAGCOUNT': '5.000'} [2023-02-24 17:45:38,056][177171] DAMAGECOUNT value on done: 16750.0 [2023-02-24 17:45:38,056][177171] Sum rewards: 1.663, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.586', 'AMMO5': '0.005', 'AMMO2': '0.032', 'ARMOR': '0.040', 'WEAPON1': '0.040', 'AMMO3': '0.069', 'weapon5': '0.102', 'WEAPON4': '0.150', 'AMMO4': '0.157', 'WEAPON5': '0.200', 'HITCOUNT': '0.210', 'weapon4': '0.302', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.852', 'weapon3': '1.326', 'weapon2': '1.614', 'FRAGCOUNT': '2.000'} [2023-02-24 17:45:38,248][177157] DAMAGECOUNT value on done: 18465.0 [2023-02-24 17:45:38,248][177157] Sum rewards: -1.319, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.606', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.026', 'WEAPON1': '0.030', 'AMMO3': '0.079', 'ARMOR': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.110', 'weapon4': '0.132', 'HITCOUNT': '0.280', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.044', 'weapon3': '1.340', 'weapon2': '2.248', 'FRAGCOUNT': '3.000'} [2023-02-24 17:45:38,256][177157] DAMAGECOUNT value on done: 18583.0 [2023-02-24 17:45:38,257][177157] Sum rewards: 7.942, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.560', 'AMMO5': '0.007', 'AMMO2': '0.013', 'ARMOR': '0.032', 'WEAPON1': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.067', 'weapon5': '0.190', 'WEAPON5': '0.250', 'HITCOUNT': '0.250', 'WEAPON3': '0.450', 'weapon3': '0.856', 'DAMAGECOUNT': '2.331', 'weapon2': '2.690', 'FRAGCOUNT': '5.000'} [2023-02-24 17:45:38,292][177155] DAMAGECOUNT value on done: 17099.0 [2023-02-24 17:45:38,354][177171] DAMAGECOUNT value on done: 16145.0 [2023-02-24 17:45:38,354][177171] Sum rewards: -0.532, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.248', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.022', 'AMMO2': '0.030', 'WEAPON1': '0.050', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'AMMO4': '0.150', 'WEAPON3': '0.350', 'weapon5': '0.358', 'WEAPON5': '0.450', 'DAMAGECOUNT': '0.657', 'weapon3': '0.720', 'weapon2': '2.640'} [2023-02-24 17:45:38,560][177157] DAMAGECOUNT value on done: 17495.0 [2023-02-24 17:45:38,561][177157] Sum rewards: -0.370, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.161', 'AMMO5': '0.010', 'AMMO2': '0.012', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'AMMO4': '0.060', 'AMMO3': '0.070', 'weapon5': '0.144', 'WEAPON4': '0.150', 'weapon4': '0.186', 'WEAPON5': '0.200', 'HITCOUNT': '0.340', 'WEAPON3': '0.500', 'weapon3': '0.942', 'DAMAGECOUNT': '1.665', 'weapon2': '2.190', 'FRAGCOUNT': '4.000'} [2023-02-24 17:45:38,593][177155] DAMAGECOUNT value on done: 19529.0 [2023-02-24 17:45:38,594][177155] Sum rewards: -2.590, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.486', 'AMMO5': '0.015', 'AMMO2': '0.026', 'WEAPON1': '0.050', 'ARMOR': '0.068', 'AMMO3': '0.070', 'AMMO4': '0.128', 'weapon5': '0.180', 'HITCOUNT': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.276', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'weapon3': '1.090', 'DAMAGECOUNT': '1.095', 'FRAGCOUNT': '2.000', 'weapon2': '2.168'} [2023-02-24 17:45:38,655][177171] DAMAGECOUNT value on done: 17559.0 [2023-02-24 17:45:38,655][177171] Sum rewards: 1.130, reward structure: {'DEATHCOUNT': '-6.750', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'AMMO3': '0.070', 'AMMO4': '0.098', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'weapon5': '0.280', 'WEAPON5': '0.300', 'WEAPON3': '0.300', 'weapon4': '0.300', 'HEALTH': '0.675', 'DAMAGECOUNT': '1.008', 'weapon2': '1.152', 'weapon3': '1.326', 'FRAGCOUNT': '2.000'} [2023-02-24 17:45:38,657][177155] DAMAGECOUNT value on done: 19933.0 [2023-02-24 17:45:38,657][177155] Sum rewards: 2.111, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.828', 'AMMO5': '0.010', 'weapon4': '0.030', 'AMMO2': '0.042', 'ARMOR': '0.064', 'AMMO3': '0.068', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'weapon5': '0.200', 'AMMO4': '0.209', 'HITCOUNT': '0.210', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.696', 'weapon3': '1.250', 'weapon2': '2.140', 'FRAGCOUNT': '3.000'} [2023-02-24 17:45:38,741][177153] Updated weights for policy 0, policy_version 4660 (0.0008) [2023-02-24 17:45:38,954][177155] DAMAGECOUNT value on done: 17174.0 [2023-02-24 17:45:38,954][177155] Sum rewards: 0.688, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.488', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.031', 'ARMOR': '0.048', 'WEAPON1': '0.080', 'AMMO3': '0.092', 'weapon5': '0.268', 'HITCOUNT': '0.290', 'WEAPON3': '0.650', 'WEAPON5': '0.700', 'weapon2': '1.264', 'weapon3': '1.688', 'DAMAGECOUNT': '1.812', 'FRAGCOUNT': '3.500'} [2023-02-24 17:45:41,301][177156] DAMAGECOUNT value on done: 17225.0 [2023-02-24 17:45:41,302][177156] Sum rewards: -2.958, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.108', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO5': '0.022', 'AMMO3': '0.100', 'WEAPON1': '0.110', 'HITCOUNT': '0.220', 'weapon5': '0.324', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.978', 'FRAGCOUNT': '1.000', 'weapon2': '1.460', 'weapon3': '1.512'} [2023-02-24 17:45:41,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 19124224. Throughput: 0: 3502.2. Samples: 4778304. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:45:41,376][177119] Avg episode reward: [(0, '0.322')] [2023-02-24 17:45:41,600][177156] DAMAGECOUNT value on done: 18310.0 [2023-02-24 17:45:41,600][177156] Sum rewards: 2.223, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.707', 'AMMO5': '0.016', 'AMMO2': '0.034', 'AMMO3': '0.058', 'WEAPON1': '0.060', 'WEAPON4': '0.150', 'AMMO4': '0.170', 'weapon4': '0.230', 'HITCOUNT': '0.240', 'weapon5': '0.294', 'WEAPON5': '0.400', 'WEAPON3': '0.400', 'weapon3': '0.972', 'DAMAGECOUNT': '1.956', 'weapon2': '2.200', 'FRAGCOUNT': '2.500'} [2023-02-24 17:45:41,639][177153] Updated weights for policy 0, policy_version 4670 (0.0008) [2023-02-24 17:45:41,711][177156] DAMAGECOUNT value on done: 19385.0 [2023-02-24 17:45:41,711][177156] Sum rewards: 2.611, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.592', 'AMMO2': '0.009', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'AMMO4': '0.045', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'weapon4': '0.170', 'HITCOUNT': '0.290', 'weapon5': '0.336', 'WEAPON5': '0.400', 'ARMOR': '0.404', 'WEAPON3': '0.550', 'weapon2': '1.236', 'DAMAGECOUNT': '1.323', 'weapon3': '1.700', 'FRAGCOUNT': '4.000'} [2023-02-24 17:45:42,015][177156] DAMAGECOUNT value on done: 21031.0 [2023-02-24 17:45:42,016][177156] Sum rewards: 0.465, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.815', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.084', 'AMMO3': '0.101', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.360', 'HITCOUNT': '0.480', 'WEAPON3': '0.700', 'weapon2': '1.124', 'DAMAGECOUNT': '1.647', 'weapon3': '1.776', 'FRAGCOUNT': '3.000'} [2023-02-24 17:45:44,559][177153] Updated weights for policy 0, policy_version 4680 (0.0008) [2023-02-24 17:45:46,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14063.0, 300 sec: 14051.4). Total num frames: 19193856. Throughput: 0: 3508.0. Samples: 4799436. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:45:46,376][177119] Avg episode reward: [(0, '0.369')] [2023-02-24 17:45:47,487][177153] Updated weights for policy 0, policy_version 4690 (0.0008) [2023-02-24 17:45:50,368][177153] Updated weights for policy 0, policy_version 4700 (0.0008) [2023-02-24 17:45:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14037.5). Total num frames: 19263488. Throughput: 0: 3507.0. Samples: 4809940. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:45:51,376][177119] Avg episode reward: [(0, '0.369')] [2023-02-24 17:45:53,310][177153] Updated weights for policy 0, policy_version 4710 (0.0008) [2023-02-24 17:45:54,562][177170] DAMAGECOUNT value on done: 17192.0 [2023-02-24 17:45:54,562][177170] Sum rewards: -2.262, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.596', 'AMMO5': '0.011', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'ARMOR': '0.068', 'AMMO3': '0.078', 'weapon7': '0.086', 'weapon5': '0.088', 'AMMO4': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'HITCOUNT': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.288', 'WEAPON3': '0.300', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.933', 'weapon3': '0.978', 'FRAGCOUNT': '1.000', 'weapon2': '1.748'} [2023-02-24 17:45:54,825][177170] DAMAGECOUNT value on done: 17754.0 [2023-02-24 17:45:54,825][177170] Sum rewards: -1.304, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.878', 'AMMO2': '0.011', 'ARMOR': '0.012', 'AMMO5': '0.023', 'WEAPON4': '0.050', 'AMMO4': '0.055', 'WEAPON1': '0.060', 'AMMO3': '0.078', 'weapon5': '0.104', 'weapon4': '0.108', 'HITCOUNT': '0.380', 'WEAPON5': '0.550', 'WEAPON3': '0.550', 'weapon3': '1.314', 'DAMAGECOUNT': '1.488', 'weapon2': '2.290', 'FRAGCOUNT': '2.500'} [2023-02-24 17:45:54,871][177170] DAMAGECOUNT value on done: 19872.0 [2023-02-24 17:45:54,872][177170] Sum rewards: -0.737, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.806', 'AMMO2': '0.008', 'AMMO5': '0.013', 'AMMO4': '0.040', 'ARMOR': '0.040', 'WEAPON1': '0.060', 'HITCOUNT': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'weapon5': '0.118', 'weapon4': '0.120', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.363', 'WEAPON3': '0.750', 'weapon2': '0.904', 'weapon3': '1.816', 'FRAGCOUNT': '2.000'} [2023-02-24 17:45:55,083][177158] DAMAGECOUNT value on done: 18591.0 [2023-02-24 17:45:55,083][177158] Sum rewards: 2.313, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.413', 'weapon7': '0.014', 'AMMO5': '0.017', 'AMMO2': '0.028', 'ARMOR': '0.041', 'WEAPON1': '0.070', 'AMMO3': '0.087', 'AMMO4': '0.140', 'weapon4': '0.176', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.290', 'weapon5': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.182', 'weapon3': '1.468', 'weapon2': '1.612', 'FRAGCOUNT': '4.000'} [2023-02-24 17:45:55,131][177170] DAMAGECOUNT value on done: 21185.0 [2023-02-24 17:45:55,131][177170] Sum rewards: 2.937, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.920', 'AMMO5': '0.003', 'weapon7': '0.012', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO2': '0.024', 'weapon5': '0.052', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.120', 'weapon4': '0.152', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.280', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.921', 'weapon2': '1.628', 'weapon3': '1.732', 'FRAGCOUNT': '2.000'} [2023-02-24 17:45:55,379][177158] DAMAGECOUNT value on done: 17748.0 [2023-02-24 17:45:55,379][177158] Sum rewards: 0.836, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.527', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.016', 'ARMOR': '0.028', 'AMMO3': '0.076', 'WEAPON1': '0.090', 'HITCOUNT': '0.220', 'WEAPON3': '0.300', 'weapon5': '0.346', 'WEAPON5': '0.450', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.110', 'weapon3': '1.174', 'weapon2': '1.802'} [2023-02-24 17:45:55,556][177172] DAMAGECOUNT value on done: 16604.0 [2023-02-24 17:45:55,556][177172] Sum rewards: -0.777, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.862', 'AMMO2': '0.024', 'AMMO5': '0.027', 'ARMOR': '0.072', 'WEAPON1': '0.080', 'AMMO4': '0.119', 'AMMO3': '0.120', 'weapon5': '0.150', 'HITCOUNT': '0.160', 'WEAPON3': '0.600', 'WEAPON5': '0.600', 'DAMAGECOUNT': '0.675', 'FRAGCOUNT': '1.000', 'weapon2': '1.554', 'weapon3': '1.654'} [2023-02-24 17:45:55,857][177172] DAMAGECOUNT value on done: 16646.0 [2023-02-24 17:45:55,857][177172] Sum rewards: -1.928, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.028', 'AMMO5': '0.019', 'AMMO2': '0.027', 'WEAPON1': '0.060', 'AMMO3': '0.094', 'AMMO4': '0.136', 'HITCOUNT': '0.210', 'weapon5': '0.214', 'weapon4': '0.240', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.651', 'weapon3': '1.190', 'weapon2': '1.908', 'FRAGCOUNT': '4.000'} [2023-02-24 17:45:55,893][177154] DAMAGECOUNT value on done: 19641.0 [2023-02-24 17:45:55,893][177154] Sum rewards: 3.046, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.000', 'AMMO2': '0.005', 'AMMO5': '0.014', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO3': '0.110', 'weapon4': '0.116', 'weapon5': '0.262', 'HITCOUNT': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon3': '1.470', 'DAMAGECOUNT': '1.644', 'weapon2': '1.778', 'FRAGCOUNT': '4.000'} [2023-02-24 17:45:55,965][177158] DAMAGECOUNT value on done: 16460.0 [2023-02-24 17:45:55,966][177158] Sum rewards: -1.910, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.266', 'ARMOR': '0.012', 'AMMO2': '0.019', 'AMMO5': '0.019', 'AMMO3': '0.068', 'WEAPON1': '0.090', 'AMMO4': '0.095', 'WEAPON4': '0.200', 'weapon4': '0.212', 'HITCOUNT': '0.220', 'weapon5': '0.256', 'WEAPON3': '0.450', 'WEAPON5': '0.550', 'DAMAGECOUNT': '0.732', 'FRAGCOUNT': '1.000', 'weapon3': '1.156', 'weapon2': '1.776'} [2023-02-24 17:45:56,193][177154] DAMAGECOUNT value on done: 17308.0 [2023-02-24 17:45:56,193][177154] Sum rewards: 3.627, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.775', 'AMMO2': '0.015', 'AMMO5': '0.016', 'WEAPON4': '0.050', 'AMMO3': '0.066', 'AMMO4': '0.075', 'WEAPON1': '0.080', 'weapon4': '0.184', 'HITCOUNT': '0.320', 'weapon5': '0.368', 'WEAPON3': '0.450', 'WEAPON5': '0.500', 'weapon3': '1.322', 'weapon2': '1.368', 'DAMAGECOUNT': '1.587', 'FRAGCOUNT': '4.000'} [2023-02-24 17:45:56,253][177153] Updated weights for policy 0, policy_version 4720 (0.0008) [2023-02-24 17:45:56,265][177158] DAMAGECOUNT value on done: 17888.0 [2023-02-24 17:45:56,265][177158] Sum rewards: 0.739, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.192', 'AMMO5': '0.007', 'AMMO2': '0.014', 'ARMOR': '0.024', 'WEAPON1': '0.040', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'weapon4': '0.190', 'WEAPON5': '0.200', 'weapon5': '0.204', 'HITCOUNT': '0.300', 'WEAPON3': '0.550', 'weapon3': '1.086', 'DAMAGECOUNT': '1.602', 'weapon2': '1.920', 'FRAGCOUNT': '3.000'} [2023-02-24 17:45:56,351][177154] DAMAGECOUNT value on done: 19384.0 [2023-02-24 17:45:56,352][177154] Sum rewards: 2.156, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.454', 'AMMO5': '0.015', 'AMMO2': '0.024', 'WEAPON1': '0.060', 'HITCOUNT': '0.070', 'AMMO3': '0.084', 'AMMO4': '0.121', 'weapon5': '0.334', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'weapon2': '0.504', 'DAMAGECOUNT': '0.729', 'weapon3': '1.518', 'FRAGCOUNT': '2.000'} [2023-02-24 17:45:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 14037.5). Total num frames: 19333120. Throughput: 0: 3508.6. Samples: 4830980. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:45:56,376][177119] Avg episode reward: [(0, '0.468')] [2023-02-24 17:45:56,541][177172] DAMAGECOUNT value on done: 17844.0 [2023-02-24 17:45:56,542][177172] Sum rewards: -4.564, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.170', 'AMMO5': '0.026', 'AMMO2': '0.040', 'WEAPON1': '0.090', 'AMMO4': '0.198', 'AMMO3': '0.204', 'weapon4': '0.220', 'weapon5': '0.236', 'HITCOUNT': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'weapon2': '1.206', 'weapon3': '1.600', 'DAMAGECOUNT': '1.605', 'FRAGCOUNT': '2.000'} [2023-02-24 17:45:56,653][177154] DAMAGECOUNT value on done: 18351.0 [2023-02-24 17:45:56,653][177154] Sum rewards: 1.944, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.110', 'weapon4': '0.002', 'AMMO2': '0.003', 'AMMO5': '0.008', 'AMMO4': '0.017', 'ARMOR': '0.020', 'AMMO3': '0.047', 'weapon7': '0.068', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.148', 'WEAPON7': '0.200', 'HITCOUNT': '0.270', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'weapon3': '0.800', 'FRAGCOUNT': '1.500', 'weapon2': '1.660', 'DAMAGECOUNT': '1.821'} [2023-02-24 17:45:56,851][177172] DAMAGECOUNT value on done: 16550.0 [2023-02-24 17:45:56,852][177172] Sum rewards: -1.488, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.000', 'AMMO5': '0.014', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon7': '0.054', 'AMMO3': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.104', 'AMMO4': '0.111', 'HEALTH': '0.115', 'HITCOUNT': '0.170', 'weapon5': '0.234', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'ARMOR': '0.500', 'DAMAGECOUNT': '1.140', 'weapon3': '1.214', 'weapon2': '1.468'} [2023-02-24 17:45:56,933][177171] DAMAGECOUNT value on done: 17396.0 [2023-02-24 17:45:56,934][177171] Sum rewards: 0.299, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.694', 'AMMO5': '0.014', 'AMMO2': '0.016', 'ARMOR': '0.024', 'weapon4': '0.040', 'WEAPON1': '0.060', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'HITCOUNT': '0.270', 'weapon5': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.020', 'DAMAGECOUNT': '1.065', 'weapon2': '2.088'} [2023-02-24 17:45:57,134][177157] DAMAGECOUNT value on done: 19662.0 [2023-02-24 17:45:57,134][177157] Sum rewards: 0.740, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.382', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.030', 'AMMO4': '0.031', 'ARMOR': '0.039', 'weapon7': '0.064', 'AMMO3': '0.093', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.124', 'HITCOUNT': '0.140', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.762', 'weapon3': '1.112', 'FRAGCOUNT': '2.000', 'weapon2': '2.376'} [2023-02-24 17:45:57,232][177171] DAMAGECOUNT value on done: 17013.0 [2023-02-24 17:45:57,233][177171] Sum rewards: -0.164, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.015', 'weapon4': '0.016', 'AMMO5': '0.021', 'ARMOR': '0.044', 'WEAPON1': '0.060', 'AMMO4': '0.075', 'AMMO3': '0.090', 'HEALTH': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.150', 'weapon5': '0.186', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.789', 'weapon3': '1.386', 'weapon2': '2.104'} [2023-02-24 17:45:57,426][177157] DAMAGECOUNT value on done: 18857.0 [2023-02-24 17:45:57,427][177157] Sum rewards: -0.968, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-1.000', 'HEALTH': '-0.708', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.024', 'weapon7': '0.048', 'AMMO3': '0.079', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.120', 'weapon5': '0.170', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.280', 'WEAPON5': '0.300', 'HITCOUNT': '0.340', 'WEAPON3': '0.350', 'weapon3': '0.826', 'DAMAGECOUNT': '1.176', 'weapon2': '2.358'} [2023-02-24 17:45:57,435][177157] DAMAGECOUNT value on done: 19166.0 [2023-02-24 17:45:57,436][177157] Sum rewards: 4.477, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.168', 'AMMO2': '0.013', 'AMMO5': '0.026', 'AMMO4': '0.064', 'AMMO3': '0.105', 'WEAPON1': '0.120', 'HITCOUNT': '0.260', 'weapon5': '0.308', 'WEAPON3': '0.550', 'WEAPON5': '0.650', 'weapon3': '1.276', 'DAMAGECOUNT': '1.749', 'weapon2': '2.024', 'FRAGCOUNT': '6.000'} [2023-02-24 17:45:57,453][177155] DAMAGECOUNT value on done: 17471.0 [2023-02-24 17:45:57,454][177155] Sum rewards: 2.319, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.117', 'AMMO2': '0.016', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.079', 'AMMO3': '0.095', 'weapon5': '0.214', 'HITCOUNT': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.116', 'weapon3': '1.462', 'weapon2': '2.116', 'FRAGCOUNT': '3.000'} [2023-02-24 17:45:57,529][177171] DAMAGECOUNT value on done: 16418.0 [2023-02-24 17:45:57,529][177171] Sum rewards: 1.006, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.734', 'AMMO5': '0.014', 'AMMO2': '0.033', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'HITCOUNT': '0.080', 'weapon4': '0.094', 'AMMO4': '0.162', 'weapon5': '0.200', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.813', 'FRAGCOUNT': '1.000', 'weapon3': '1.180', 'weapon2': '2.294'} [2023-02-24 17:45:57,732][177157] DAMAGECOUNT value on done: 17717.0 [2023-02-24 17:45:57,733][177157] Sum rewards: -1.136, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.236', 'AMMO2': '0.006', 'AMMO5': '0.017', 'AMMO4': '0.028', 'WEAPON1': '0.040', 'ARMOR': '0.040', 'HITCOUNT': '0.120', 'AMMO3': '0.125', 'weapon5': '0.260', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.666', 'weapon3': '1.434', 'weapon2': '1.864', 'FRAGCOUNT': '2.000'} [2023-02-24 17:45:57,751][177155] DAMAGECOUNT value on done: 19992.0 [2023-02-24 17:45:57,751][177155] Sum rewards: 0.444, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.216', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO3': '0.121', 'weapon5': '0.180', 'HITCOUNT': '0.190', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'weapon3': '1.366', 'DAMAGECOUNT': '1.389', 'FRAGCOUNT': '2.000', 'weapon2': '2.264'} [2023-02-24 17:45:57,816][177155] DAMAGECOUNT value on done: 20408.0 [2023-02-24 17:45:57,817][177155] Sum rewards: 0.174, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.024', 'AMMO2': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.059', 'weapon5': '0.062', 'AMMO3': '0.121', 'HITCOUNT': '0.270', 'WEAPON5': '0.300', 'ARMOR': '0.472', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.425', 'weapon3': '1.540', 'FRAGCOUNT': '2.000', 'weapon2': '2.182'} [2023-02-24 17:45:57,820][177171] DAMAGECOUNT value on done: 18196.0 [2023-02-24 17:45:57,821][177171] Sum rewards: 2.207, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.866', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.020', 'WEAPON1': '0.090', 'AMMO3': '0.126', 'HITCOUNT': '0.190', 'weapon5': '0.352', 'WEAPON5': '0.550', 'WEAPON3': '0.550', 'weapon3': '1.228', 'DAMAGECOUNT': '1.911', 'weapon2': '2.078', 'FRAGCOUNT': '6.000'} [2023-02-24 17:45:58,114][177155] DAMAGECOUNT value on done: 17409.0 [2023-02-24 17:45:58,115][177155] Sum rewards: -0.358, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.034', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'ARMOR': '0.024', 'AMMO3': '0.040', 'weapon7': '0.080', 'AMMO4': '0.100', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.120', 'WEAPON3': '0.150', 'weapon4': '0.174', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon3': '0.344', 'DAMAGECOUNT': '0.705', 'FRAGCOUNT': '2.000', 'weapon2': '2.752'} [2023-02-24 17:45:59,176][177153] Updated weights for policy 0, policy_version 4730 (0.0009) [2023-02-24 17:46:00,420][177156] DAMAGECOUNT value on done: 17480.0 [2023-02-24 17:46:00,420][177156] Sum rewards: 3.805, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.016', 'AMMO5': '0.017', 'ARMOR': '0.048', 'WEAPON1': '0.050', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'HITCOUNT': '0.160', 'weapon4': '0.196', 'weapon5': '0.216', 'WEAPON5': '0.250', 'HEALTH': '0.308', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.765', 'weapon3': '1.550', 'weapon2': '1.746', 'FRAGCOUNT': '3.000'} [2023-02-24 17:46:00,723][177156] DAMAGECOUNT value on done: 18624.0 [2023-02-24 17:46:00,723][177156] Sum rewards: 0.679, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.210', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO3': '0.054', 'weapon7': '0.070', 'WEAPON1': '0.080', 'AMMO4': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'HITCOUNT': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.214', 'weapon5': '0.284', 'WEAPON3': '0.350', 'WEAPON5': '0.500', 'weapon3': '0.804', 'DAMAGECOUNT': '0.942', 'FRAGCOUNT': '2.000', 'weapon2': '2.022'} [2023-02-24 17:46:00,931][177156] DAMAGECOUNT value on done: 19520.0 [2023-02-24 17:46:00,932][177156] Sum rewards: 0.972, reward structure: {'DEATHCOUNT': '-3.000', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.009', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'HEALTH': '0.080', 'AMMO3': '0.094', 'AMMO4': '0.101', 'HITCOUNT': '0.130', 'weapon5': '0.148', 'WEAPON5': '0.200', 'weapon4': '0.242', 'WEAPON3': '0.250', 'DAMAGECOUNT': '0.405', 'weapon2': '1.264', 'weapon3': '1.448'} [2023-02-24 17:46:01,242][177156] DAMAGECOUNT value on done: 21259.0 [2023-02-24 17:46:01,242][177156] Sum rewards: 1.550, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.780', 'ARMOR': '0.004', 'AMMO2': '0.016', 'AMMO5': '0.021', 'weapon4': '0.042', 'WEAPON4': '0.050', 'AMMO4': '0.079', 'WEAPON1': '0.080', 'HITCOUNT': '0.100', 'AMMO3': '0.110', 'weapon5': '0.268', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.684', 'weapon3': '1.394', 'weapon2': '1.682', 'FRAGCOUNT': '2.000'} [2023-02-24 17:46:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14037.5). Total num frames: 19402752. Throughput: 0: 3509.8. Samples: 4852006. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:46:01,376][177119] Avg episode reward: [(0, '0.307')] [2023-02-24 17:46:02,084][177153] Updated weights for policy 0, policy_version 4740 (0.0009) [2023-02-24 17:46:04,986][177153] Updated weights for policy 0, policy_version 4750 (0.0008) [2023-02-24 17:46:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14037.5). Total num frames: 19472384. Throughput: 0: 3512.3. Samples: 4862576. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:46:06,376][177119] Avg episode reward: [(0, '0.307')] [2023-02-24 17:46:07,920][177153] Updated weights for policy 0, policy_version 4760 (0.0008) [2023-02-24 17:46:10,831][177153] Updated weights for policy 0, policy_version 4770 (0.0008) [2023-02-24 17:46:11,376][177119] Fps is (10 sec: 13926.1, 60 sec: 13994.6, 300 sec: 14037.5). Total num frames: 19542016. Throughput: 0: 3508.0. Samples: 4883568. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:46:11,377][177119] Avg episode reward: [(0, '0.307')] [2023-02-24 17:46:13,761][177170] DAMAGECOUNT value on done: 17447.0 [2023-02-24 17:46:13,761][177170] Sum rewards: -1.373, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.386', 'AMMO5': '0.010', 'AMMO2': '0.013', 'ARMOR': '0.036', 'WEAPON1': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.119', 'weapon5': '0.122', 'WEAPON5': '0.200', 'HITCOUNT': '0.220', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.765', 'weapon3': '1.056', 'FRAGCOUNT': '2.000', 'weapon2': '2.008'} [2023-02-24 17:46:13,763][177153] Updated weights for policy 0, policy_version 4780 (0.0009) [2023-02-24 17:46:14,004][177170] DAMAGECOUNT value on done: 18386.0 [2023-02-24 17:46:14,005][177170] Sum rewards: -2.402, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.452', 'AMMO2': '0.010', 'AMMO5': '0.019', 'ARMOR': '0.024', 'AMMO4': '0.048', 'weapon7': '0.048', 'WEAPON1': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.157', 'WEAPON7': '0.200', 'weapon4': '0.286', 'weapon5': '0.308', 'HITCOUNT': '0.390', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'weapon3': '1.370', 'weapon2': '1.504', 'DAMAGECOUNT': '1.896', 'FRAGCOUNT': '3.000'} [2023-02-24 17:46:14,068][177170] DAMAGECOUNT value on done: 20469.0 [2023-02-24 17:46:14,069][177170] Sum rewards: 0.960, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.860', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.026', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO3': '0.133', 'weapon4': '0.194', 'weapon5': '0.288', 'HITCOUNT': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon2': '1.500', 'weapon3': '1.590', 'DAMAGECOUNT': '1.791', 'FRAGCOUNT': '3.000'} [2023-02-24 17:46:14,205][177158] DAMAGECOUNT value on done: 18863.0 [2023-02-24 17:46:14,205][177158] Sum rewards: 0.572, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.218', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'ARMOR': '0.004', 'AMMO5': '0.020', 'WEAPON1': '0.050', 'weapon7': '0.072', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.130', 'weapon5': '0.150', 'HITCOUNT': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.226', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.816', 'weapon2': '1.474', 'weapon3': '1.618', 'FRAGCOUNT': '3.000'} [2023-02-24 17:46:14,323][177170] DAMAGECOUNT value on done: 21535.0 [2023-02-24 17:46:14,324][177170] Sum rewards: 0.671, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.791', 'AMMO5': '0.017', 'AMMO2': '0.028', 'ARMOR': '0.040', 'WEAPON1': '0.080', 'HITCOUNT': '0.090', 'AMMO3': '0.099', 'AMMO4': '0.139', 'weapon5': '0.206', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.050', 'weapon2': '1.652', 'weapon3': '1.710', 'FRAGCOUNT': '2.000'} [2023-02-24 17:46:14,503][177158] DAMAGECOUNT value on done: 18118.0 [2023-02-24 17:46:14,503][177158] Sum rewards: -0.369, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.492', 'AMMO2': '0.013', 'AMMO5': '0.025', 'weapon4': '0.026', 'weapon5': '0.034', 'WEAPON4': '0.050', 'ARMOR': '0.060', 'AMMO4': '0.067', 'WEAPON1': '0.080', 'AMMO3': '0.142', 'HITCOUNT': '0.320', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.110', 'weapon2': '1.328', 'weapon3': '1.818', 'FRAGCOUNT': '2.000'} [2023-02-24 17:46:14,684][177172] DAMAGECOUNT value on done: 16984.0 [2023-02-24 17:46:14,685][177172] Sum rewards: -0.380, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.110', 'AMMO2': '0.013', 'ARMOR': '0.016', 'AMMO5': '0.022', 'WEAPON1': '0.050', 'AMMO4': '0.062', 'weapon4': '0.118', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'weapon5': '0.238', 'HITCOUNT': '0.300', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.140', 'weapon3': '1.530', 'weapon2': '1.768', 'FRAGCOUNT': '3.000'} [2023-02-24 17:46:14,984][177172] DAMAGECOUNT value on done: 17190.0 [2023-02-24 17:46:14,984][177172] Sum rewards: 0.457, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.680', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.024', 'WEAPON1': '0.040', 'weapon7': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'weapon5': '0.140', 'weapon4': '0.204', 'WEAPON5': '0.250', 'HITCOUNT': '0.340', 'ARMOR': '0.436', 'WEAPON3': '0.500', 'weapon3': '1.190', 'DAMAGECOUNT': '1.632', 'weapon2': '1.800', 'FRAGCOUNT': '4.000'} [2023-02-24 17:46:15,099][177158] DAMAGECOUNT value on done: 16582.0 [2023-02-24 17:46:15,164][177154] DAMAGECOUNT value on done: 19796.0 [2023-02-24 17:46:15,397][177158] DAMAGECOUNT value on done: 18354.0 [2023-02-24 17:46:15,398][177158] Sum rewards: 2.760, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.692', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.008', 'WEAPON1': '0.040', 'weapon7': '0.062', 'AMMO3': '0.067', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.178', 'WEAPON5': '0.200', 'HITCOUNT': '0.290', 'weapon4': '0.398', 'ARMOR': '0.464', 'WEAPON3': '0.550', 'weapon2': '1.094', 'DAMAGECOUNT': '1.398', 'weapon3': '1.494', 'FRAGCOUNT': '3.000'} [2023-02-24 17:46:15,471][177154] DAMAGECOUNT value on done: 17801.0 [2023-02-24 17:46:15,472][177154] Sum rewards: 3.748, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.366', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO3': '0.100', 'weapon5': '0.112', 'WEAPON5': '0.200', 'HITCOUNT': '0.430', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.479', 'weapon2': '1.700', 'weapon3': '1.914', 'FRAGCOUNT': '5.000'} [2023-02-24 17:46:15,621][177154] DAMAGECOUNT value on done: 19634.0 [2023-02-24 17:46:15,622][177154] Sum rewards: -2.886, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.006', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON1': '0.070', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'HITCOUNT': '0.200', 'weapon5': '0.212', 'weapon4': '0.220', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.248', 'weapon2': '2.022'} [2023-02-24 17:46:15,694][177172] DAMAGECOUNT value on done: 18627.0 [2023-02-24 17:46:15,694][177172] Sum rewards: 6.839, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.795', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.019', 'AMMO3': '0.069', 'WEAPON1': '0.080', 'HITCOUNT': '0.280', 'weapon5': '0.300', 'WEAPON3': '0.500', 'WEAPON5': '0.500', 'weapon3': '1.364', 'weapon2': '1.692', 'DAMAGECOUNT': '2.349', 'FRAGCOUNT': '5.000'} [2023-02-24 17:46:15,908][177154] DAMAGECOUNT value on done: 18664.0 [2023-02-24 17:46:15,909][177154] Sum rewards: -0.460, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.869', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'ARMOR': '0.088', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO3': '0.146', 'HITCOUNT': '0.170', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.939', 'weapon2': '1.466', 'FRAGCOUNT': '2.000', 'weapon3': '2.172'} [2023-02-24 17:46:15,997][177172] DAMAGECOUNT value on done: 16585.0 [2023-02-24 17:46:16,085][177171] DAMAGECOUNT value on done: 17725.0 [2023-02-24 17:46:16,085][177171] Sum rewards: -0.943, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.874', 'AMMO5': '0.018', 'AMMO2': '0.030', 'ARMOR': '0.052', 'WEAPON1': '0.090', 'AMMO3': '0.140', 'AMMO4': '0.148', 'HITCOUNT': '0.270', 'weapon5': '0.274', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.987', 'weapon3': '1.588', 'weapon2': '1.734', 'FRAGCOUNT': '3.000'} [2023-02-24 17:46:16,273][177157] DAMAGECOUNT value on done: 20291.0 [2023-02-24 17:46:16,273][177157] Sum rewards: 0.976, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.364', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.012', 'AMMO3': '0.073', 'WEAPON1': '0.080', 'HITCOUNT': '0.250', 'weapon5': '0.318', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.306', 'weapon3': '1.670', 'DAMAGECOUNT': '1.887'} [2023-02-24 17:46:16,376][177119] Fps is (10 sec: 13926.1, 60 sec: 13994.6, 300 sec: 14037.5). Total num frames: 19611648. Throughput: 0: 3503.5. Samples: 4904506. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:46:16,377][177119] Avg episode reward: [(0, '0.173')] [2023-02-24 17:46:16,379][177171] DAMAGECOUNT value on done: 17400.0 [2023-02-24 17:46:16,380][177171] Sum rewards: 0.941, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.762', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'AMMO5': '0.015', 'AMMO3': '0.067', 'WEAPON1': '0.090', 'HITCOUNT': '0.120', 'weapon5': '0.218', 'WEAPON3': '0.350', 'WEAPON5': '0.400', 'ARMOR': '0.454', 'weapon3': '0.812', 'DAMAGECOUNT': '1.161', 'weapon2': '1.766', 'FRAGCOUNT': '3.000'} [2023-02-24 17:46:16,561][177157] DAMAGECOUNT value on done: 19252.0 [2023-02-24 17:46:16,561][177157] Sum rewards: -2.351, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.440', 'AMMO2': '0.010', 'AMMO5': '0.020', 'AMMO4': '0.048', 'WEAPON1': '0.060', 'weapon4': '0.110', 'AMMO3': '0.118', 'WEAPON4': '0.150', 'weapon5': '0.292', 'HITCOUNT': '0.320', 'ARMOR': '0.462', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.185', 'weapon3': '1.414', 'weapon2': '1.600'} [2023-02-24 17:46:16,579][177157] DAMAGECOUNT value on done: 19363.0 [2023-02-24 17:46:16,580][177157] Sum rewards: 0.341, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.015', 'AMMO2': '0.026', 'WEAPON1': '0.060', 'HEALTH': '0.078', 'AMMO3': '0.116', 'AMMO4': '0.129', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'weapon5': '0.214', 'WEAPON5': '0.350', 'weapon4': '0.378', 'DAMAGECOUNT': '0.591', 'WEAPON3': '0.600', 'ARMOR': '0.928', 'FRAGCOUNT': '1.000', 'weapon2': '1.210', 'weapon3': '1.776'} [2023-02-24 17:46:16,675][177155] DAMAGECOUNT value on done: 17835.0 [2023-02-24 17:46:16,676][177155] Sum rewards: 1.179, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.391', 'AMMO5': '0.017', 'AMMO2': '0.018', 'weapon4': '0.036', 'WEAPON1': '0.040', 'AMMO3': '0.070', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'HITCOUNT': '0.160', 'weapon5': '0.236', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'ARMOR': '0.400', 'weapon3': '1.078', 'DAMAGECOUNT': '1.092', 'FRAGCOUNT': '1.500', 'weapon2': '2.084'} [2023-02-24 17:46:16,678][177171] DAMAGECOUNT value on done: 16758.0 [2023-02-24 17:46:16,679][177171] Sum rewards: -0.709, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.606', 'weapon4': '0.006', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.050', 'ARMOR': '0.056', 'AMMO4': '0.087', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon5': '0.158', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.020', 'weapon3': '1.482', 'weapon2': '1.958', 'FRAGCOUNT': '3.000'} [2023-02-24 17:46:16,732][177153] Updated weights for policy 0, policy_version 4790 (0.0008) [2023-02-24 17:46:16,868][177157] DAMAGECOUNT value on done: 17820.0 [2023-02-24 17:46:16,868][177157] Sum rewards: -0.389, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.114', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.012', 'WEAPON1': '0.070', 'HITCOUNT': '0.090', 'AMMO3': '0.092', 'weapon5': '0.168', 'DAMAGECOUNT': '0.309', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'ARMOR': '0.448', 'FRAGCOUNT': '1.000', 'weapon3': '1.458', 'weapon2': '1.610'} [2023-02-24 17:46:16,967][177155] DAMAGECOUNT value on done: 20529.0 [2023-02-24 17:46:16,967][177155] Sum rewards: 2.490, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.290', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.008', 'WEAPON1': '0.050', 'AMMO3': '0.071', 'weapon5': '0.170', 'WEAPON5': '0.250', 'HITCOUNT': '0.290', 'WEAPON3': '0.450', 'weapon3': '1.028', 'DAMAGECOUNT': '1.611', 'weapon2': '1.626', 'FRAGCOUNT': '3.500'} [2023-02-24 17:46:16,989][177171] DAMAGECOUNT value on done: 18640.0 [2023-02-24 17:46:16,990][177171] Sum rewards: -1.419, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.932', 'AMMO5': '0.018', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'ARMOR': '0.056', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'weapon5': '0.118', 'weapon4': '0.118', 'AMMO3': '0.126', 'HITCOUNT': '0.330', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.332', 'weapon3': '1.584', 'weapon2': '1.832'} [2023-02-24 17:46:17,045][177155] DAMAGECOUNT value on done: 20573.0 [2023-02-24 17:46:17,045][177155] Sum rewards: -1.712, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.410', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON1': '0.070', 'AMMO3': '0.071', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'weapon5': '0.202', 'WEAPON5': '0.250', 'weapon4': '0.294', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.495', 'ARMOR': '0.511', 'weapon2': '0.844', 'FRAGCOUNT': '1.000', 'weapon3': '1.094'} [2023-02-24 17:46:17,354][177155] DAMAGECOUNT value on done: 17518.0 [2023-02-24 17:46:19,649][177153] Updated weights for policy 0, policy_version 4800 (0.0008) [2023-02-24 17:46:19,699][177156] DAMAGECOUNT value on done: 18153.0 [2023-02-24 17:46:19,700][177156] Sum rewards: 1.813, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.354', 'AMMO5': '0.007', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'ARMOR': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'AMMO4': '0.142', 'weapon4': '0.146', 'weapon5': '0.148', 'WEAPON5': '0.200', 'HITCOUNT': '0.360', 'WEAPON3': '0.600', 'weapon3': '1.404', 'DAMAGECOUNT': '2.019', 'weapon2': '2.020', 'FRAGCOUNT': '3.000'} [2023-02-24 17:46:19,992][177156] DAMAGECOUNT value on done: 18829.0 [2023-02-24 17:46:19,993][177156] Sum rewards: -3.497, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.256', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO3': '0.143', 'HITCOUNT': '0.190', 'DAMAGECOUNT': '0.615', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.736', 'weapon3': '2.000'} [2023-02-24 17:46:20,184][177156] DAMAGECOUNT value on done: 20119.0 [2023-02-24 17:46:20,185][177156] Sum rewards: -0.971, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.349', 'AMMO2': '0.023', 'AMMO5': '0.026', 'WEAPON1': '0.070', 'AMMO4': '0.115', 'AMMO3': '0.135', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.248', 'weapon5': '0.442', 'WEAPON3': '0.500', 'WEAPON5': '0.550', 'weapon2': '1.152', 'FRAGCOUNT': '1.500', 'weapon3': '1.580', 'DAMAGECOUNT': '1.797'} [2023-02-24 17:46:20,485][177156] DAMAGECOUNT value on done: 21458.0 [2023-02-24 17:46:20,486][177156] Sum rewards: -0.848, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.480', 'ARMOR': '0.012', 'AMMO2': '0.016', 'AMMO5': '0.022', 'WEAPON1': '0.050', 'AMMO3': '0.076', 'AMMO4': '0.081', 'HITCOUNT': '0.140', 'weapon5': '0.358', 'WEAPON3': '0.450', 'WEAPON5': '0.450', 'DAMAGECOUNT': '0.597', 'FRAGCOUNT': '1.000', 'weapon3': '1.244', 'weapon2': '1.886'} [2023-02-24 17:46:21,376][177119] Fps is (10 sec: 14336.3, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 19685376. Throughput: 0: 3502.4. Samples: 4914956. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:46:21,376][177119] Avg episode reward: [(0, '0.235')] [2023-02-24 17:46:21,447][177157] Large shaping reward 2.628 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.003, -1.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 17:46:22,540][177153] Updated weights for policy 0, policy_version 4810 (0.0008) [2023-02-24 17:46:25,471][177153] Updated weights for policy 0, policy_version 4820 (0.0009) [2023-02-24 17:46:26,376][177119] Fps is (10 sec: 14336.3, 60 sec: 14062.9, 300 sec: 14037.5). Total num frames: 19755008. Throughput: 0: 3505.0. Samples: 4936030. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:46:26,376][177119] Avg episode reward: [(0, '0.235')] [2023-02-24 17:46:28,390][177153] Updated weights for policy 0, policy_version 4830 (0.0008) [2023-02-24 17:46:31,319][177153] Updated weights for policy 0, policy_version 4840 (0.0008) [2023-02-24 17:46:31,376][177119] Fps is (10 sec: 13926.5, 60 sec: 14062.9, 300 sec: 14037.5). Total num frames: 19824640. Throughput: 0: 3501.2. Samples: 4956988. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:46:31,376][177119] Avg episode reward: [(0, '0.235')] [2023-02-24 17:46:32,926][177170] DAMAGECOUNT value on done: 18258.0 [2023-02-24 17:46:32,926][177170] Sum rewards: 0.144, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.512', 'AMMO2': '0.007', 'AMMO5': '0.016', 'weapon4': '0.018', 'ARMOR': '0.032', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.073', 'weapon5': '0.266', 'WEAPON5': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.410', 'weapon3': '1.300', 'FRAGCOUNT': '1.500', 'weapon2': '1.954', 'DAMAGECOUNT': '2.382'} [2023-02-24 17:46:33,189][177170] DAMAGECOUNT value on done: 18851.0 [2023-02-24 17:46:33,189][177170] Sum rewards: 2.544, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.970', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO3': '0.061', 'WEAPON1': '0.080', 'AMMO4': '0.123', 'weapon5': '0.216', 'HITCOUNT': '0.270', 'WEAPON4': '0.300', 'weapon4': '0.346', 'WEAPON5': '0.400', 'ARMOR': '0.466', 'WEAPON3': '0.500', 'weapon3': '1.170', 'DAMAGECOUNT': '1.395', 'weapon2': '1.402', 'FRAGCOUNT': '3.000'} [2023-02-24 17:46:33,233][177170] DAMAGECOUNT value on done: 20849.0 [2023-02-24 17:46:33,234][177170] Sum rewards: 1.815, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.461', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon4': '0.020', 'AMMO4': '0.090', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'HITCOUNT': '0.340', 'ARMOR': '0.456', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.140', 'weapon2': '1.452', 'weapon3': '1.976'} [2023-02-24 17:46:33,375][177158] DAMAGECOUNT value on done: 19551.0 [2023-02-24 17:46:33,376][177158] Sum rewards: 0.026, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.177', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO5': '0.024', 'WEAPON1': '0.090', 'AMMO3': '0.132', 'weapon5': '0.264', 'HITCOUNT': '0.470', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'weapon3': '1.374', 'DAMAGECOUNT': '2.064', 'weapon2': '2.118', 'FRAGCOUNT': '4.000'} [2023-02-24 17:46:33,494][177170] DAMAGECOUNT value on done: 21964.0 [2023-02-24 17:46:33,495][177170] Sum rewards: 0.582, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.925', 'AMMO5': '0.011', 'ARMOR': '0.032', 'AMMO2': '0.041', 'WEAPON1': '0.070', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'weapon5': '0.200', 'AMMO4': '0.204', 'HITCOUNT': '0.280', 'weapon4': '0.342', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'weapon2': '1.172', 'DAMAGECOUNT': '1.287', 'weapon3': '1.552', 'FRAGCOUNT': '5.000'} [2023-02-24 17:46:33,669][177158] DAMAGECOUNT value on done: 18540.0 [2023-02-24 17:46:33,670][177158] Sum rewards: 4.231, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.604', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.011', 'WEAPON1': '0.060', 'AMMO3': '0.074', 'HITCOUNT': '0.150', 'weapon5': '0.252', 'WEAPON5': '0.300', 'ARMOR': '0.440', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.266', 'weapon2': '1.336', 'weapon3': '1.516', 'FRAGCOUNT': '2.000'} [2023-02-24 17:46:33,839][177172] DAMAGECOUNT value on done: 17570.0 [2023-02-24 17:46:33,839][177172] Sum rewards: 5.370, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.016', 'AMMO2': '0.020', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.054', 'AMMO3': '0.077', 'AMMO4': '0.099', 'HEALTH': '0.136', 'weapon5': '0.180', 'HITCOUNT': '0.270', 'WEAPON5': '0.350', 'WEAPON3': '0.350', 'weapon2': '1.306', 'weapon3': '1.654', 'DAMAGECOUNT': '1.758', 'FRAGCOUNT': '3.500'} [2023-02-24 17:46:34,138][177172] DAMAGECOUNT value on done: 17280.0 [2023-02-24 17:46:34,138][177172] Sum rewards: 2.037, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.360', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'weapon5': '0.070', 'AMMO3': '0.086', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.204', 'DAMAGECOUNT': '0.270', 'WEAPON3': '0.350', 'ARMOR': '0.413', 'weapon2': '0.426', 'weapon3': '1.268', 'FRAGCOUNT': '2.000'} [2023-02-24 17:46:34,243][177153] Updated weights for policy 0, policy_version 4850 (0.0008) [2023-02-24 17:46:34,308][177158] DAMAGECOUNT value on done: 16747.0 [2023-02-24 17:46:34,309][177158] Sum rewards: 2.168, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.016', 'AMMO2': '0.005', 'AMMO5': '0.015', 'AMMO4': '0.026', 'WEAPON1': '0.050', 'AMMO3': '0.087', 'HITCOUNT': '0.150', 'weapon5': '0.246', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.495', 'FRAGCOUNT': '1.000', 'weapon3': '1.252', 'weapon2': '1.858'} [2023-02-24 17:46:34,414][177154] DAMAGECOUNT value on done: 20578.0 [2023-02-24 17:46:34,415][177154] Sum rewards: 3.806, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.046', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.015', 'ARMOR': '0.032', 'WEAPON1': '0.070', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'weapon4': '0.216', 'HITCOUNT': '0.390', 'weapon5': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon3': '1.118', 'weapon2': '1.152', 'DAMAGECOUNT': '2.346', 'FRAGCOUNT': '4.000'} [2023-02-24 17:46:34,603][177158] DAMAGECOUNT value on done: 18734.0 [2023-02-24 17:46:34,603][177158] Sum rewards: -2.287, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.920', 'AMMO5': '0.020', 'AMMO2': '0.025', 'WEAPON1': '0.050', 'AMMO4': '0.125', 'AMMO3': '0.141', 'weapon5': '0.160', 'WEAPON4': '0.300', 'HITCOUNT': '0.310', 'WEAPON5': '0.450', 'ARMOR': '0.477', 'weapon4': '0.686', 'weapon2': '0.888', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.140', 'weapon3': '1.710', 'FRAGCOUNT': '2.000'} [2023-02-24 17:46:34,716][177154] DAMAGECOUNT value on done: 18013.0 [2023-02-24 17:46:34,716][177154] Sum rewards: -1.298, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.480', 'AMMO2': '0.006', 'AMMO5': '0.022', 'AMMO4': '0.030', 'ARMOR': '0.040', 'WEAPON1': '0.080', 'AMMO3': '0.087', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'weapon5': '0.174', 'weapon4': '0.390', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.636', 'weapon3': '0.758', 'weapon2': '1.368', 'FRAGCOUNT': '2.000'} [2023-02-24 17:46:34,858][177154] DAMAGECOUNT value on done: 20135.0 [2023-02-24 17:46:34,858][177154] Sum rewards: 2.627, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.350', 'weapon4': '0.004', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'WEAPON1': '0.060', 'AMMO3': '0.083', 'weapon5': '0.134', 'WEAPON5': '0.300', 'HITCOUNT': '0.330', 'WEAPON3': '0.550', 'weapon3': '1.354', 'DAMAGECOUNT': '1.503', 'weapon2': '2.282', 'FRAGCOUNT': '3.000'} [2023-02-24 17:46:34,922][177172] DAMAGECOUNT value on done: 19272.0 [2023-02-24 17:46:34,923][177172] Sum rewards: 1.743, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.796', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO2': '0.033', 'WEAPON4': '0.100', 'AMMO3': '0.129', 'AMMO4': '0.164', 'weapon4': '0.186', 'HITCOUNT': '0.250', 'weapon5': '0.258', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'weapon2': '1.270', 'weapon3': '1.774', 'DAMAGECOUNT': '1.935', 'FRAGCOUNT': '3.500'} [2023-02-24 17:46:35,148][177154] DAMAGECOUNT value on done: 19591.0 [2023-02-24 17:46:35,149][177154] Sum rewards: 4.224, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.476', 'AMMO2': '0.011', 'AMMO5': '0.017', 'AMMO4': '0.056', 'WEAPON1': '0.080', 'AMMO3': '0.112', 'WEAPON4': '0.200', 'weapon5': '0.324', 'weapon4': '0.420', 'WEAPON5': '0.500', 'HITCOUNT': '0.570', 'WEAPON3': '0.600', 'weapon2': '1.312', 'weapon3': '1.466', 'DAMAGECOUNT': '2.781', 'FRAGCOUNT': '7.000'} [2023-02-24 17:46:35,216][177172] DAMAGECOUNT value on done: 17455.0 [2023-02-24 17:46:35,216][177172] Sum rewards: 10.881, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.680', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.037', 'WEAPON1': '0.040', 'AMMO3': '0.057', 'weapon5': '0.138', 'WEAPON5': '0.200', 'WEAPON3': '0.400', 'HITCOUNT': '0.550', 'weapon3': '1.096', 'weapon2': '2.186', 'DAMAGECOUNT': '2.595', 'FRAGCOUNT': '8.000'} [2023-02-24 17:46:35,298][177171] DAMAGECOUNT value on done: 18313.0 [2023-02-24 17:46:35,298][177171] Sum rewards: 2.402, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.762', 'weapon4': '0.014', 'AMMO2': '0.017', 'AMMO5': '0.021', 'ARMOR': '0.024', 'WEAPON4': '0.050', 'AMMO4': '0.083', 'WEAPON1': '0.090', 'AMMO3': '0.121', 'weapon5': '0.272', 'HITCOUNT': '0.300', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'weapon3': '1.508', 'weapon2': '1.750', 'DAMAGECOUNT': '1.764', 'FRAGCOUNT': '5.000'} [2023-02-24 17:46:35,479][177157] DAMAGECOUNT value on done: 20759.0 [2023-02-24 17:46:35,480][177157] Sum rewards: 1.125, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.210', 'AMMO2': '0.009', 'AMMO5': '0.013', 'weapon7': '0.014', 'ARMOR': '0.016', 'AMMO4': '0.045', 'AMMO3': '0.075', 'WEAPON1': '0.090', 'HITCOUNT': '0.180', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.326', 'WEAPON5': '0.450', 'weapon4': '0.482', 'WEAPON3': '0.550', 'weapon2': '1.130', 'DAMAGECOUNT': '1.404', 'weapon3': '1.450', 'FRAGCOUNT': '2.000'} [2023-02-24 17:46:35,595][177171] DAMAGECOUNT value on done: 18209.0 [2023-02-24 17:46:35,596][177171] Sum rewards: 6.626, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.856', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO3': '0.060', 'weapon5': '0.246', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.500', 'weapon3': '1.018', 'weapon2': '1.760', 'DAMAGECOUNT': '2.427', 'FRAGCOUNT': '6.000'} [2023-02-24 17:46:35,775][177157] DAMAGECOUNT value on done: 20028.0 [2023-02-24 17:46:35,775][177157] Sum rewards: 4.933, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.093', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO5': '0.017', 'WEAPON1': '0.050', 'AMMO3': '0.077', 'weapon5': '0.278', 'HITCOUNT': '0.330', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'weapon3': '1.478', 'weapon2': '1.932', 'DAMAGECOUNT': '1.995', 'FRAGCOUNT': '4.000'} [2023-02-24 17:46:35,787][177157] DAMAGECOUNT value on done: 19654.0 [2023-02-24 17:46:35,899][177171] DAMAGECOUNT value on done: 17178.0 [2023-02-24 17:46:35,900][177171] Sum rewards: 1.243, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.329', 'AMMO2': '0.009', 'AMMO5': '0.014', 'AMMO4': '0.045', 'WEAPON1': '0.050', 'AMMO3': '0.064', 'weapon4': '0.090', 'weapon5': '0.134', 'WEAPON4': '0.200', 'HITCOUNT': '0.240', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'weapon3': '0.960', 'DAMAGECOUNT': '1.260', 'weapon2': '2.506', 'FRAGCOUNT': '3.000'} [2023-02-24 17:46:35,920][177155] DAMAGECOUNT value on done: 17988.0 [2023-02-24 17:46:36,101][177157] DAMAGECOUNT value on done: 18581.0 [2023-02-24 17:46:36,102][177157] Sum rewards: 6.567, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.124', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.036', 'weapon7': '0.064', 'AMMO3': '0.067', 'WEAPON1': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.222', 'HITCOUNT': '0.330', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'weapon3': '1.388', 'weapon2': '1.934', 'DAMAGECOUNT': '2.163', 'FRAGCOUNT': '5.500'} [2023-02-24 17:46:36,212][177171] DAMAGECOUNT value on done: 19060.0 [2023-02-24 17:46:36,213][177171] Sum rewards: 0.178, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.500', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.070', 'AMMO4': '0.087', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'weapon4': '0.134', 'HITCOUNT': '0.220', 'weapon5': '0.268', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'weapon3': '0.992', 'DAMAGECOUNT': '1.260', 'FRAGCOUNT': '2.000', 'weapon2': '2.328'} [2023-02-24 17:46:36,230][177155] DAMAGECOUNT value on done: 21153.0 [2023-02-24 17:46:36,231][177155] Sum rewards: -1.031, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.279', 'AMMO5': '0.017', 'AMMO2': '0.038', 'WEAPON1': '0.050', 'AMMO3': '0.113', 'weapon4': '0.156', 'weapon5': '0.190', 'AMMO4': '0.192', 'WEAPON4': '0.300', 'HITCOUNT': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.500', 'weapon2': '1.580', 'weapon3': '1.690', 'DAMAGECOUNT': '1.872'} [2023-02-24 17:46:36,303][177155] DAMAGECOUNT value on done: 20874.0 [2023-02-24 17:46:36,303][177155] Sum rewards: -1.325, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.857', 'AMMO2': '0.007', 'AMMO5': '0.017', 'AMMO4': '0.033', 'WEAPON1': '0.070', 'AMMO3': '0.118', 'HITCOUNT': '0.160', 'weapon5': '0.366', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.903', 'FRAGCOUNT': '1.000', 'weapon2': '1.308', 'weapon3': '1.950'} [2023-02-24 17:46:36,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14062.9, 300 sec: 14037.5). Total num frames: 19894272. Throughput: 0: 3499.6. Samples: 4967424. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:46:36,376][177119] Avg episode reward: [(0, '0.803')] [2023-02-24 17:46:36,380][177140] Saving new best policy, reward=0.803! [2023-02-24 17:46:36,620][177155] DAMAGECOUNT value on done: 17809.0 [2023-02-24 17:46:36,620][177155] Sum rewards: 0.971, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.346', 'AMMO2': '0.004', 'AMMO5': '0.011', 'AMMO4': '0.018', 'WEAPON4': '0.050', 'weapon7': '0.054', 'WEAPON1': '0.060', 'AMMO3': '0.073', 'ARMOR': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.160', 'WEAPON7': '0.200', 'weapon5': '0.284', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.873', 'weapon3': '1.384', 'weapon2': '1.822', 'FRAGCOUNT': '2.000'} [2023-02-24 17:46:37,184][177153] Updated weights for policy 0, policy_version 4860 (0.0008) [2023-02-24 17:46:39,010][177156] DAMAGECOUNT value on done: 18388.0 [2023-02-24 17:46:39,010][177156] Sum rewards: 0.656, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.336', 'AMMO2': '0.003', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon4': '0.014', 'AMMO4': '0.016', 'AMMO3': '0.089', 'ARMOR': '0.092', 'WEAPON4': '0.100', 'weapon5': '0.126', 'WEAPON5': '0.150', 'HITCOUNT': '0.190', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.705', 'weapon2': '1.460', 'weapon3': '1.482', 'FRAGCOUNT': '3.000'} [2023-02-24 17:46:39,312][177156] DAMAGECOUNT value on done: 19537.0 [2023-02-24 17:46:39,313][177156] Sum rewards: -2.779, reward structure: {'DEATHCOUNT': '-10.500', 'FRAGCOUNT': '0.000', 'AMMO5': '0.018', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'AMMO4': '0.110', 'AMMO3': '0.125', 'WEAPON4': '0.200', 'HEALTH': '0.240', 'weapon5': '0.352', 'WEAPON5': '0.400', 'HITCOUNT': '0.450', 'weapon4': '0.462', 'WEAPON3': '0.600', 'weapon2': '0.932', 'weapon3': '1.656', 'DAMAGECOUNT': '2.124'} [2023-02-24 17:46:39,479][177156] DAMAGECOUNT value on done: 20736.0 [2023-02-24 17:46:39,479][177156] Sum rewards: 2.518, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.304', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.027', 'WEAPON1': '0.100', 'AMMO3': '0.107', 'HITCOUNT': '0.390', 'weapon5': '0.418', 'WEAPON3': '0.650', 'WEAPON5': '0.700', 'weapon3': '1.440', 'weapon2': '1.648', 'DAMAGECOUNT': '1.851', 'FRAGCOUNT': '4.000'} [2023-02-24 17:46:39,773][177156] DAMAGECOUNT value on done: 21721.0 [2023-02-24 17:46:39,774][177156] Sum rewards: 1.175, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.200', 'AMMO5': '0.012', 'AMMO2': '0.022', 'ARMOR': '0.044', 'WEAPON4': '0.050', 'WEAPON1': '0.050', 'AMMO3': '0.069', 'HITCOUNT': '0.090', 'AMMO4': '0.110', 'weapon5': '0.156', 'WEAPON5': '0.300', 'WEAPON3': '0.300', 'weapon4': '0.368', 'DAMAGECOUNT': '0.789', 'FRAGCOUNT': '1.000', 'weapon3': '1.180', 'weapon2': '1.334'} [2023-02-24 17:46:40,095][177153] Updated weights for policy 0, policy_version 4870 (0.0008) [2023-02-24 17:46:41,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 14037.5). Total num frames: 19963904. Throughput: 0: 3499.4. Samples: 4988452. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:46:41,376][177119] Avg episode reward: [(0, '0.819')] [2023-02-24 17:46:41,377][177140] Saving new best policy, reward=0.819! [2023-02-24 17:46:43,001][177153] Updated weights for policy 0, policy_version 4880 (0.0008) [2023-02-24 17:46:45,897][177153] Updated weights for policy 0, policy_version 4890 (0.0009) [2023-02-24 17:46:46,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 14037.5). Total num frames: 20033536. Throughput: 0: 3502.5. Samples: 5009618. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:46:46,376][177119] Avg episode reward: [(0, '0.819')] [2023-02-24 17:46:48,826][177153] Updated weights for policy 0, policy_version 4900 (0.0008) [2023-02-24 17:46:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14037.5). Total num frames: 20103168. Throughput: 0: 3502.2. Samples: 5020176. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:46:51,376][177119] Avg episode reward: [(0, '0.819')] [2023-02-24 17:46:51,732][177153] Updated weights for policy 0, policy_version 4910 (0.0008) [2023-02-24 17:46:52,092][177170] DAMAGECOUNT value on done: 18420.0 [2023-02-24 17:46:52,092][177170] Sum rewards: 0.442, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.012', 'weapon4': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'ARMOR': '0.052', 'WEAPON1': '0.060', 'AMMO3': '0.082', 'AMMO4': '0.124', 'HITCOUNT': '0.150', 'weapon5': '0.198', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.486', 'FRAGCOUNT': '1.000', 'weapon3': '1.568', 'weapon2': '1.930'} [2023-02-24 17:46:52,358][177170] DAMAGECOUNT value on done: 19116.0 [2023-02-24 17:46:52,359][177170] Sum rewards: -1.296, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.906', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO2': '0.030', 'ARMOR': '0.033', 'AMMO3': '0.102', 'AMMO4': '0.150', 'HITCOUNT': '0.180', 'weapon4': '0.290', 'weapon5': '0.342', 'WEAPON4': '0.350', 'WEAPON3': '0.350', 'WEAPON5': '0.400', 'weapon3': '0.774', 'DAMAGECOUNT': '0.795', 'FRAGCOUNT': '1.000', 'weapon2': '2.266'} [2023-02-24 17:46:52,400][177170] DAMAGECOUNT value on done: 21129.0 [2023-02-24 17:46:52,506][177158] DAMAGECOUNT value on done: 20155.0 [2023-02-24 17:46:52,507][177158] Sum rewards: -0.232, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.410', 'AMMO5': '0.028', 'AMMO2': '0.037', 'weapon4': '0.096', 'WEAPON1': '0.100', 'AMMO3': '0.111', 'AMMO4': '0.186', 'WEAPON4': '0.200', 'weapon5': '0.204', 'HITCOUNT': '0.320', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'weapon2': '1.054', 'DAMAGECOUNT': '1.812', 'weapon3': '2.180', 'FRAGCOUNT': '5.000'} [2023-02-24 17:46:52,658][177170] DAMAGECOUNT value on done: 22254.0 [2023-02-24 17:46:52,659][177170] Sum rewards: 3.248, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.014', 'AMMO5': '0.022', 'ARMOR': '0.032', 'AMMO4': '0.067', 'AMMO3': '0.081', 'weapon5': '0.164', 'WEAPON5': '0.250', 'HITCOUNT': '0.270', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.870', 'HEALTH': '0.989', 'weapon2': '1.444', 'weapon3': '1.844', 'FRAGCOUNT': '2.000'} [2023-02-24 17:46:52,814][177158] DAMAGECOUNT value on done: 18923.0 [2023-02-24 17:46:52,814][177158] Sum rewards: 1.989, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.780', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'AMMO4': '0.062', 'ARMOR': '0.063', 'weapon5': '0.156', 'weapon4': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.340', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.149', 'weapon3': '1.270', 'weapon2': '2.242', 'FRAGCOUNT': '3.000'} [2023-02-24 17:46:52,886][177172] DAMAGECOUNT value on done: 17968.0 [2023-02-24 17:46:52,887][177172] Sum rewards: 2.660, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.532', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.027', 'ARMOR': '0.032', 'WEAPON1': '0.070', 'AMMO3': '0.117', 'HITCOUNT': '0.190', 'weapon5': '0.258', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'weapon3': '1.040', 'DAMAGECOUNT': '1.194', 'weapon2': '2.046', 'FRAGCOUNT': '5.000'} [2023-02-24 17:46:53,179][177172] DAMAGECOUNT value on done: 17655.0 [2023-02-24 17:46:53,179][177172] Sum rewards: -1.393, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '0.008', 'ARMOR': '0.012', 'AMMO5': '0.024', 'WEAPON1': '0.040', 'AMMO2': '0.054', 'AMMO3': '0.077', 'HITCOUNT': '0.220', 'AMMO4': '0.271', 'WEAPON4': '0.300', 'weapon5': '0.370', 'WEAPON5': '0.450', 'WEAPON3': '0.450', 'weapon4': '0.516', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.125', 'weapon2': '1.250', 'weapon3': '1.440'} [2023-02-24 17:46:53,441][177158] DAMAGECOUNT value on done: 17310.0 [2023-02-24 17:46:53,442][177158] Sum rewards: 4.681, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.240', 'AMMO2': '0.007', 'AMMO5': '0.027', 'AMMO4': '0.034', 'ARMOR': '0.045', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.087', 'weapon4': '0.096', 'HITCOUNT': '0.180', 'WEAPON5': '0.450', 'weapon5': '0.548', 'WEAPON3': '0.550', 'weapon2': '1.032', 'DAMAGECOUNT': '1.689', 'weapon3': '1.826', 'FRAGCOUNT': '5.000'} [2023-02-24 17:46:53,528][177154] DAMAGECOUNT value on done: 20870.0 [2023-02-24 17:46:53,528][177154] Sum rewards: -3.928, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.176', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.050', 'ARMOR': '0.052', 'AMMO4': '0.060', 'weapon5': '0.072', 'AMMO3': '0.089', 'HITCOUNT': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'weapon4': '0.624', 'DAMAGECOUNT': '0.876', 'FRAGCOUNT': '1.000', 'weapon3': '1.226', 'weapon2': '1.574'} [2023-02-24 17:46:53,739][177158] DAMAGECOUNT value on done: 19123.0 [2023-02-24 17:46:53,740][177158] Sum rewards: -0.383, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.176', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.019', 'WEAPON1': '0.080', 'AMMO3': '0.085', 'HITCOUNT': '0.280', 'weapon5': '0.342', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.167', 'weapon3': '1.320', 'FRAGCOUNT': '2.000', 'weapon2': '2.044'} [2023-02-24 17:46:53,823][177154] DAMAGECOUNT value on done: 18178.0 [2023-02-24 17:46:53,824][177154] Sum rewards: -4.674, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.476', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'ARMOR': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.116', 'AMMO4': '0.126', 'HITCOUNT': '0.160', 'weapon5': '0.236', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'DAMAGECOUNT': '0.495', 'weapon4': '0.560', 'WEAPON3': '0.700', 'weapon2': '1.110', 'weapon3': '1.776', 'FRAGCOUNT': '2.000'} [2023-02-24 17:46:53,959][177154] DAMAGECOUNT value on done: 20470.0 [2023-02-24 17:46:53,960][177154] Sum rewards: 2.176, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.007', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'ARMOR': '0.048', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'weapon5': '0.138', 'HITCOUNT': '0.290', 'weapon4': '0.290', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.005', 'weapon2': '1.146', 'weapon3': '1.550', 'FRAGCOUNT': '3.000'} [2023-02-24 17:46:54,049][177172] DAMAGECOUNT value on done: 20008.0 [2023-02-24 17:46:54,050][177172] Sum rewards: 3.393, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.378', 'AMMO2': '0.023', 'AMMO5': '0.028', 'WEAPON1': '0.070', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.121', 'WEAPON4': '0.150', 'weapon4': '0.280', 'HITCOUNT': '0.300', 'ARMOR': '0.464', 'weapon5': '0.474', 'WEAPON3': '0.600', 'WEAPON5': '0.700', 'weapon2': '1.252', 'weapon3': '1.434', 'DAMAGECOUNT': '2.208', 'FRAGCOUNT': '4.500'} [2023-02-24 17:46:54,250][177154] DAMAGECOUNT value on done: 19676.0 [2023-02-24 17:46:54,346][177172] DAMAGECOUNT value on done: 17580.0 [2023-02-24 17:46:54,347][177172] Sum rewards: -2.573, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.784', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.048', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.375', 'ARMOR': '0.424', 'WEAPON3': '0.450', 'weapon4': '0.476', 'FRAGCOUNT': '1.000', 'weapon2': '1.128', 'weapon3': '1.180'} [2023-02-24 17:46:54,471][177171] DAMAGECOUNT value on done: 18358.0 [2023-02-24 17:46:54,471][177171] Sum rewards: 2.909, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.030', 'AMMO3': '0.041', 'WEAPON5': '0.050', 'HITCOUNT': '0.060', 'weapon5': '0.086', 'HEALTH': '0.120', 'DAMAGECOUNT': '0.135', 'WEAPON4': '0.200', 'WEAPON3': '0.250', 'weapon4': '0.394', 'weapon2': '0.784', 'ARMOR': '0.986', 'FRAGCOUNT': '1.000', 'weapon3': '1.014'} [2023-02-24 17:46:54,655][177157] DAMAGECOUNT value on done: 21181.0 [2023-02-24 17:46:54,655][177157] Sum rewards: 0.160, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.866', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.018', 'ARMOR': '0.076', 'AMMO3': '0.080', 'WEAPON1': '0.080', 'weapon5': '0.198', 'HITCOUNT': '0.230', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'WEAPON5': '0.500', 'weapon4': '0.594', 'weapon3': '1.098', 'DAMAGECOUNT': '1.266', 'weapon2': '1.676', 'FRAGCOUNT': '3.000'} [2023-02-24 17:46:54,722][177153] Updated weights for policy 0, policy_version 4920 (0.0009) [2023-02-24 17:46:54,779][177171] DAMAGECOUNT value on done: 18928.0 [2023-02-24 17:46:54,780][177171] Sum rewards: 0.273, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.496', 'AMMO5': '0.019', 'AMMO2': '0.023', 'WEAPON1': '0.050', 'AMMO3': '0.106', 'AMMO4': '0.113', 'weapon4': '0.170', 'WEAPON4': '0.300', 'weapon5': '0.304', 'HITCOUNT': '0.330', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'weapon3': '1.586', 'weapon2': '1.660', 'DAMAGECOUNT': '2.157', 'FRAGCOUNT': '3.500'} [2023-02-24 17:46:54,954][177157] DAMAGECOUNT value on done: 20595.0 [2023-02-24 17:46:54,954][177157] Sum rewards: 1.957, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.766', 'AMMO5': '0.023', 'ARMOR': '0.028', 'AMMO2': '0.036', 'WEAPON1': '0.080', 'AMMO3': '0.082', 'weapon7': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'AMMO4': '0.178', 'WEAPON7': '0.200', 'weapon4': '0.210', 'weapon5': '0.260', 'HITCOUNT': '0.370', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'weapon2': '1.232', 'weapon3': '1.696', 'DAMAGECOUNT': '1.701', 'FRAGCOUNT': '5.000'} [2023-02-24 17:46:54,970][177157] DAMAGECOUNT value on done: 20194.0 [2023-02-24 17:46:54,970][177157] Sum rewards: 0.460, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.493', 'ARMOR': '0.016', 'AMMO5': '0.020', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'AMMO3': '0.086', 'AMMO4': '0.109', 'weapon5': '0.206', 'WEAPON4': '0.350', 'HITCOUNT': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.534', 'WEAPON3': '0.550', 'weapon3': '1.314', 'weapon2': '1.346', 'DAMAGECOUNT': '1.620', 'FRAGCOUNT': '4.000'} [2023-02-24 17:46:55,071][177171] DAMAGECOUNT value on done: 17727.0 [2023-02-24 17:46:55,072][177171] Sum rewards: -1.455, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.774', 'AMMO5': '0.022', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'ARMOR': '0.064', 'AMMO3': '0.121', 'AMMO4': '0.142', 'weapon5': '0.232', 'weapon4': '0.246', 'HITCOUNT': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'weapon3': '1.406', 'weapon2': '1.410', 'DAMAGECOUNT': '1.647', 'FRAGCOUNT': '3.000'} [2023-02-24 17:46:55,121][177155] DAMAGECOUNT value on done: 18440.0 [2023-02-24 17:46:55,121][177155] Sum rewards: 3.826, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.106', 'ARMOR': '0.016', 'AMMO2': '0.022', 'AMMO5': '0.029', 'WEAPON1': '0.050', 'AMMO3': '0.099', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'weapon4': '0.208', 'HITCOUNT': '0.250', 'weapon5': '0.430', 'WEAPON5': '0.550', 'WEAPON3': '0.550', 'weapon2': '1.142', 'DAMAGECOUNT': '1.356', 'weapon3': '1.722', 'FRAGCOUNT': '4.000'} [2023-02-24 17:46:55,275][177157] DAMAGECOUNT value on done: 19269.0 [2023-02-24 17:46:55,275][177157] Sum rewards: 1.811, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.788', 'AMMO5': '0.017', 'AMMO2': '0.023', 'WEAPON1': '0.050', 'AMMO4': '0.117', 'AMMO3': '0.145', 'HITCOUNT': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.270', 'weapon5': '0.320', 'ARMOR': '0.408', 'WEAPON5': '0.450', 'weapon2': '0.772', 'WEAPON3': '0.850', 'DAMAGECOUNT': '2.064', 'weapon3': '2.132', 'FRAGCOUNT': '5.000'} [2023-02-24 17:46:55,375][177171] DAMAGECOUNT value on done: 19471.0 [2023-02-24 17:46:55,376][177171] Sum rewards: -1.563, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.038', 'AMMO2': '0.027', 'AMMO5': '0.029', 'WEAPON1': '0.030', 'ARMOR': '0.096', 'AMMO3': '0.105', 'AMMO4': '0.135', 'HITCOUNT': '0.190', 'weapon5': '0.234', 'weapon4': '0.378', 'WEAPON4': '0.400', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.233', 'weapon2': '1.502', 'weapon3': '1.516', 'FRAGCOUNT': '3.000'} [2023-02-24 17:46:55,412][177155] DAMAGECOUNT value on done: 21694.0 [2023-02-24 17:46:55,412][177155] Sum rewards: 2.345, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.489', 'AMMO2': '0.004', 'ARMOR': '0.012', 'AMMO5': '0.014', 'AMMO4': '0.021', 'AMMO3': '0.051', 'WEAPON1': '0.060', 'WEAPON4': '0.200', 'HITCOUNT': '0.280', 'WEAPON3': '0.400', 'weapon5': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.520', 'weapon2': '1.176', 'weapon3': '1.372', 'DAMAGECOUNT': '1.623', 'FRAGCOUNT': '4.000'} [2023-02-24 17:46:55,479][177155] DAMAGECOUNT value on done: 21073.0 [2023-02-24 17:46:55,479][177155] Sum rewards: 1.537, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.932', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'ARMOR': '0.040', 'AMMO3': '0.062', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'weapon5': '0.236', 'WEAPON5': '0.250', 'weapon4': '0.274', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.597', 'weapon2': '1.602', 'weapon3': '1.608', 'FRAGCOUNT': '2.000'} [2023-02-24 17:46:55,772][177155] DAMAGECOUNT value on done: 18225.0 [2023-02-24 17:46:55,772][177155] Sum rewards: 1.545, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.247', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO3': '0.073', 'HITCOUNT': '0.130', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'weapon5': '0.294', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.604', 'weapon2': '0.820', 'ARMOR': '0.836', 'DAMAGECOUNT': '1.248', 'weapon3': '1.428', 'FRAGCOUNT': '2.000'} [2023-02-24 17:46:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 14037.5). Total num frames: 20172800. Throughput: 0: 3498.8. Samples: 5041012. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:46:56,376][177119] Avg episode reward: [(0, '0.849')] [2023-02-24 17:46:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000004925_20172800.pth... [2023-02-24 17:46:56,439][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000004103_16805888.pth [2023-02-24 17:46:56,449][177140] Saving new best policy, reward=0.849! [2023-02-24 17:46:57,634][177153] Updated weights for policy 0, policy_version 4930 (0.0008) [2023-02-24 17:46:58,230][177156] DAMAGECOUNT value on done: 18690.0 [2023-02-24 17:46:58,231][177156] Sum rewards: 2.194, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.014', 'AMMO5': '0.015', 'WEAPON1': '0.060', 'AMMO4': '0.071', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'HITCOUNT': '0.170', 'weapon4': '0.200', 'WEAPON5': '0.300', 'weapon5': '0.366', 'WEAPON3': '0.400', 'HEALTH': '0.454', 'DAMAGECOUNT': '0.906', 'weapon3': '1.310', 'weapon2': '1.748', 'FRAGCOUNT': '2.000'} [2023-02-24 17:46:58,538][177156] DAMAGECOUNT value on done: 19757.0 [2023-02-24 17:46:58,670][177156] DAMAGECOUNT value on done: 20899.0 [2023-02-24 17:46:58,670][177156] Sum rewards: -2.537, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.848', 'AMMO2': '0.011', 'AMMO5': '0.025', 'WEAPON1': '0.040', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'HITCOUNT': '0.150', 'weapon4': '0.242', 'weapon5': '0.272', 'WEAPON5': '0.450', 'DAMAGECOUNT': '0.489', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.600', 'weapon3': '1.120', 'weapon2': '1.646'} [2023-02-24 17:46:58,972][177156] DAMAGECOUNT value on done: 22123.0 [2023-02-24 17:46:58,973][177156] Sum rewards: -1.146, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.198', 'ARMOR': '0.008', 'AMMO2': '0.020', 'AMMO5': '0.026', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.076', 'AMMO4': '0.098', 'weapon4': '0.136', 'HITCOUNT': '0.240', 'weapon5': '0.348', 'WEAPON3': '0.450', 'WEAPON5': '0.600', 'DAMAGECOUNT': '1.206', 'FRAGCOUNT': '1.500', 'weapon2': '1.578', 'weapon3': '1.656'} [2023-02-24 17:47:00,536][177153] Updated weights for policy 0, policy_version 4940 (0.0009) [2023-02-24 17:47:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14037.5). Total num frames: 20242432. Throughput: 0: 3502.0. Samples: 5062094. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 17:47:01,376][177119] Avg episode reward: [(0, '0.782')] [2023-02-24 17:47:03,468][177153] Updated weights for policy 0, policy_version 4950 (0.0008) [2023-02-24 17:47:06,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13994.7, 300 sec: 14023.6). Total num frames: 20312064. Throughput: 0: 3502.6. Samples: 5072574. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:47:06,376][177119] Avg episode reward: [(0, '0.782')] [2023-02-24 17:47:06,380][177153] Updated weights for policy 0, policy_version 4960 (0.0008) [2023-02-24 17:47:06,764][177156] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 17:47:09,311][177153] Updated weights for policy 0, policy_version 4970 (0.0008) [2023-02-24 17:47:11,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14063.0, 300 sec: 14037.5). Total num frames: 20385792. Throughput: 0: 3502.5. Samples: 5093642. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:47:11,376][177119] Avg episode reward: [(0, '0.782')] [2023-02-24 17:47:11,384][177170] DAMAGECOUNT value on done: 18933.0 [2023-02-24 17:47:11,384][177170] Sum rewards: -4.567, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.664', 'AMMO2': '0.015', 'ARMOR': '0.016', 'AMMO5': '0.019', 'WEAPON1': '0.060', 'AMMO4': '0.074', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.138', 'HITCOUNT': '0.250', 'weapon5': '0.298', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.310', 'DAMAGECOUNT': '1.539', 'weapon2': '1.984'} [2023-02-24 17:47:11,621][177170] DAMAGECOUNT value on done: 19707.0 [2023-02-24 17:47:11,622][177170] Sum rewards: 4.394, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.776', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'AMMO5': '0.015', 'WEAPON1': '0.060', 'AMMO3': '0.074', 'weapon5': '0.234', 'WEAPON5': '0.300', 'HITCOUNT': '0.430', 'WEAPON3': '0.550', 'weapon3': '1.696', 'DAMAGECOUNT': '1.773', 'weapon2': '1.844', 'FRAGCOUNT': '5.000'} [2023-02-24 17:47:11,678][177170] DAMAGECOUNT value on done: 21750.0 [2023-02-24 17:47:11,678][177170] Sum rewards: 3.898, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.702', 'AMMO2': '0.003', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.013', 'WEAPON1': '0.030', 'weapon7': '0.052', 'AMMO3': '0.063', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.172', 'WEAPON7': '0.200', 'weapon4': '0.204', 'WEAPON5': '0.250', 'HITCOUNT': '0.340', 'WEAPON3': '0.450', 'weapon2': '1.344', 'weapon3': '1.512', 'DAMAGECOUNT': '1.863', 'FRAGCOUNT': '3.000'} [2023-02-24 17:47:11,728][177158] DAMAGECOUNT value on done: 20190.0 [2023-02-24 17:47:11,729][177158] Sum rewards: -0.469, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.536', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.038', 'HITCOUNT': '0.040', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.105', 'weapon5': '0.146', 'AMMO4': '0.148', 'weapon4': '0.168', 'WEAPON3': '0.200', 'WEAPON4': '0.250', 'weapon3': '0.342', 'ARMOR': '0.525', 'FRAGCOUNT': '1.000', 'weapon2': '1.450'} [2023-02-24 17:47:11,924][177170] DAMAGECOUNT value on done: 22894.0 [2023-02-24 17:47:11,925][177170] Sum rewards: 2.885, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.300', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.018', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'weapon5': '0.290', 'HITCOUNT': '0.380', 'weapon4': '0.428', 'WEAPON5': '0.500', 'weapon2': '0.702', 'WEAPON3': '0.750', 'weapon3': '1.906', 'DAMAGECOUNT': '1.920', 'FRAGCOUNT': '3.000'} [2023-02-24 17:47:12,030][177158] DAMAGECOUNT value on done: 19553.0 [2023-02-24 17:47:12,031][177158] Sum rewards: 6.151, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.260', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON1': '0.030', 'AMMO4': '0.056', 'AMMO3': '0.068', 'weapon5': '0.212', 'WEAPON5': '0.250', 'HITCOUNT': '0.280', 'ARMOR': '0.404', 'WEAPON3': '0.450', 'weapon3': '1.390', 'weapon2': '1.862', 'DAMAGECOUNT': '1.890', 'FRAGCOUNT': '4.000'} [2023-02-24 17:47:12,137][177172] DAMAGECOUNT value on done: 18247.0 [2023-02-24 17:47:12,137][177172] Sum rewards: -5.577, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.130', 'AMMO2': '0.010', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'ARMOR': '0.038', 'AMMO4': '0.049', 'weapon5': '0.118', 'AMMO3': '0.197', 'WEAPON5': '0.250', 'HITCOUNT': '0.270', 'DAMAGECOUNT': '0.837', 'WEAPON3': '1.100', 'weapon3': '1.820', 'weapon2': '1.824', 'FRAGCOUNT': '2.000'} [2023-02-24 17:47:12,264][177153] Updated weights for policy 0, policy_version 4980 (0.0008) [2023-02-24 17:47:12,437][177172] DAMAGECOUNT value on done: 18514.0 [2023-02-24 17:47:12,437][177172] Sum rewards: 3.318, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.925', 'AMMO5': '0.025', 'AMMO2': '0.030', 'ARMOR': '0.064', 'WEAPON1': '0.080', 'weapon4': '0.098', 'WEAPON4': '0.100', 'AMMO4': '0.148', 'AMMO3': '0.149', 'weapon5': '0.402', 'HITCOUNT': '0.420', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'weapon2': '1.432', 'weapon3': '1.586', 'DAMAGECOUNT': '2.559', 'FRAGCOUNT': '7.000'} [2023-02-24 17:47:12,653][177158] DAMAGECOUNT value on done: 17914.0 [2023-02-24 17:47:12,654][177158] Sum rewards: -2.155, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.060', 'AMMO2': '0.007', 'AMMO5': '0.020', 'AMMO4': '0.035', 'WEAPON1': '0.090', 'weapon5': '0.156', 'AMMO3': '0.170', 'WEAPON5': '0.450', 'HITCOUNT': '0.520', 'WEAPON3': '1.000', 'weapon2': '1.106', 'DAMAGECOUNT': '1.812', 'FRAGCOUNT': '2.000', 'weapon3': '2.288'} [2023-02-24 17:47:12,758][177154] DAMAGECOUNT value on done: 21429.0 [2023-02-24 17:47:12,759][177154] Sum rewards: 4.260, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.986', 'AMMO5': '0.021', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'AMMO3': '0.086', 'AMMO4': '0.137', 'WEAPON4': '0.250', 'weapon5': '0.290', 'HITCOUNT': '0.330', 'WEAPON5': '0.350', 'weapon4': '0.382', 'WEAPON3': '0.550', 'weapon2': '1.184', 'DAMAGECOUNT': '1.677', 'weapon3': '1.682', 'FRAGCOUNT': '5.000'} [2023-02-24 17:47:12,952][177158] DAMAGECOUNT value on done: 19433.0 [2023-02-24 17:47:12,952][177158] Sum rewards: 4.788, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.056', 'AMMO5': '0.010', 'AMMO2': '0.010', 'WEAPON1': '0.030', 'weapon5': '0.042', 'AMMO4': '0.050', 'weapon7': '0.060', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.178', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.270', 'WEAPON3': '0.300', 'ARMOR': '0.508', 'DAMAGECOUNT': '0.930', 'weapon3': '1.352', 'weapon2': '1.546', 'FRAGCOUNT': '4.000'} [2023-02-24 17:47:13,067][177154] DAMAGECOUNT value on done: 18797.0 [2023-02-24 17:47:13,067][177154] Sum rewards: 4.932, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.187', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'AMMO5': '0.007', 'ARMOR': '0.020', 'WEAPON1': '0.040', 'AMMO3': '0.138', 'WEAPON5': '0.200', 'weapon5': '0.252', 'HITCOUNT': '0.260', 'WEAPON3': '0.700', 'weapon3': '1.366', 'DAMAGECOUNT': '1.857', 'weapon2': '2.080', 'FRAGCOUNT': '6.000'} [2023-02-24 17:47:13,221][177154] DAMAGECOUNT value on done: 20645.0 [2023-02-24 17:47:13,221][177154] Sum rewards: -3.307, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO2': '0.011', 'AMMO5': '0.015', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'ARMOR': '0.061', 'AMMO3': '0.107', 'HITCOUNT': '0.190', 'weapon5': '0.260', 'weapon4': '0.328', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.525', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.086', 'HEALTH': '1.152', 'weapon2': '1.404'} [2023-02-24 17:47:13,321][177172] DAMAGECOUNT value on done: 20450.0 [2023-02-24 17:47:13,321][177172] Sum rewards: 0.963, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.890', 'AMMO5': '0.014', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'AMMO3': '0.102', 'AMMO4': '0.133', 'weapon5': '0.178', 'WEAPON4': '0.200', 'weapon4': '0.228', 'WEAPON5': '0.300', 'HITCOUNT': '0.320', 'ARMOR': '0.404', 'WEAPON3': '0.550', 'weapon3': '1.120', 'DAMAGECOUNT': '1.326', 'weapon2': '1.420', 'FRAGCOUNT': '3.000'} [2023-02-24 17:47:13,516][177154] DAMAGECOUNT value on done: 19977.0 [2023-02-24 17:47:13,516][177154] Sum rewards: 1.536, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.618', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.139', 'WEAPON4': '0.150', 'HITCOUNT': '0.250', 'weapon4': '0.310', 'ARMOR': '0.480', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.903', 'weapon2': '1.534', 'weapon3': '1.708', 'FRAGCOUNT': '4.000'} [2023-02-24 17:47:13,623][177172] DAMAGECOUNT value on done: 17838.0 [2023-02-24 17:47:13,623][177172] Sum rewards: -0.978, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.478', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO2': '0.024', 'AMMO4': '0.118', 'HITCOUNT': '0.140', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'weapon5': '0.278', 'WEAPON5': '0.350', 'weapon4': '0.350', 'ARMOR': '0.408', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.774', 'weapon3': '1.294', 'weapon2': '1.720', 'FRAGCOUNT': '2.000'} [2023-02-24 17:47:13,625][177171] DAMAGECOUNT value on done: 18677.0 [2023-02-24 17:47:13,625][177171] Sum rewards: 0.298, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.922', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.042', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO3': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.170', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'weapon5': '0.410', 'weapon3': '0.780', 'DAMAGECOUNT': '0.957', 'FRAGCOUNT': '2.000', 'weapon2': '2.334'} [2023-02-24 17:47:13,860][177157] DAMAGECOUNT value on done: 21488.0 [2023-02-24 17:47:13,861][177157] Sum rewards: 0.879, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.384', 'AMMO5': '0.011', 'ARMOR': '0.020', 'AMMO2': '0.025', 'WEAPON1': '0.050', 'AMMO3': '0.104', 'AMMO4': '0.126', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'weapon5': '0.266', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.488', 'DAMAGECOUNT': '0.921', 'weapon3': '1.406', 'weapon2': '1.526', 'FRAGCOUNT': '2.000'} [2023-02-24 17:47:13,930][177171] DAMAGECOUNT value on done: 19244.0 [2023-02-24 17:47:13,931][177171] Sum rewards: -3.401, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.230', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.015', 'weapon4': '0.016', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.056', 'ARMOR': '0.076', 'AMMO3': '0.148', 'HITCOUNT': '0.300', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.948', 'WEAPON3': '0.950', 'weapon2': '1.684', 'weapon3': '1.966', 'FRAGCOUNT': '2.000'} [2023-02-24 17:47:14,134][177157] DAMAGECOUNT value on done: 20548.0 [2023-02-24 17:47:14,135][177157] Sum rewards: -1.911, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.707', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'weapon5': '0.062', 'weapon4': '0.088', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'HITCOUNT': '0.310', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.062', 'weapon2': '1.618', 'weapon3': '2.016'} [2023-02-24 17:47:14,153][177157] DAMAGECOUNT value on done: 21077.0 [2023-02-24 17:47:14,154][177157] Sum rewards: 2.589, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.650', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.007', 'WEAPON1': '0.060', 'AMMO3': '0.092', 'WEAPON5': '0.200', 'weapon5': '0.218', 'HITCOUNT': '0.240', 'ARMOR': '0.416', 'WEAPON3': '0.550', 'weapon3': '0.950', 'weapon2': '1.344', 'DAMAGECOUNT': '1.446', 'FRAGCOUNT': '3.000'} [2023-02-24 17:47:14,226][177171] DAMAGECOUNT value on done: 18422.0 [2023-02-24 17:47:14,227][177171] Sum rewards: 5.061, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.277', 'ARMOR': '0.012', 'AMMO2': '0.015', 'AMMO5': '0.016', 'weapon4': '0.040', 'WEAPON1': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'HITCOUNT': '0.400', 'WEAPON5': '0.400', 'weapon5': '0.400', 'WEAPON3': '0.500', 'weapon2': '1.336', 'weapon3': '1.572', 'DAMAGECOUNT': '2.085', 'FRAGCOUNT': '5.000'} [2023-02-24 17:47:14,392][177155] DAMAGECOUNT value on done: 18781.0 [2023-02-24 17:47:14,392][177155] Sum rewards: 1.575, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.829', 'AMMO2': '0.014', 'AMMO5': '0.017', 'ARMOR': '0.036', 'WEAPON1': '0.060', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'weapon4': '0.158', 'HITCOUNT': '0.300', 'weapon5': '0.330', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.023', 'weapon2': '1.298', 'weapon3': '1.696', 'FRAGCOUNT': '3.000'} [2023-02-24 17:47:14,444][177157] DAMAGECOUNT value on done: 19401.0 [2023-02-24 17:47:14,445][177157] Sum rewards: 2.467, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.505', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO3': '0.040', 'AMMO4': '0.040', 'WEAPON1': '0.050', 'HITCOUNT': '0.060', 'weapon5': '0.184', 'WEAPON3': '0.250', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.396', 'ARMOR': '0.500', 'weapon3': '0.904', 'FRAGCOUNT': '1.000', 'weapon2': '1.532'} [2023-02-24 17:47:14,514][177171] DAMAGECOUNT value on done: 19816.0 [2023-02-24 17:47:14,514][177171] Sum rewards: -0.086, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.315', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO5': '0.023', 'ARMOR': '0.048', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.058', 'AMMO3': '0.125', 'HITCOUNT': '0.240', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.035', 'weapon2': '1.280', 'FRAGCOUNT': '1.500', 'weapon3': '1.654'} [2023-02-24 17:47:14,690][177155] DAMAGECOUNT value on done: 21904.0 [2023-02-24 17:47:14,691][177155] Sum rewards: -0.101, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.310', 'AMMO2': '0.005', 'AMMO5': '0.015', 'AMMO4': '0.022', 'ARMOR': '0.048', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'HITCOUNT': '0.140', 'weapon5': '0.154', 'WEAPON5': '0.400', 'weapon4': '0.402', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.630', 'FRAGCOUNT': '1.000', 'weapon2': '1.396', 'weapon3': '1.536'} [2023-02-24 17:47:14,768][177155] DAMAGECOUNT value on done: 21363.0 [2023-02-24 17:47:14,769][177155] Sum rewards: -2.034, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.494', 'AMMO5': '0.025', 'AMMO2': '0.031', 'WEAPON1': '0.040', 'ARMOR': '0.068', 'AMMO3': '0.119', 'AMMO4': '0.153', 'weapon5': '0.170', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'weapon4': '0.342', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.870', 'FRAGCOUNT': '1.000', 'weapon2': '1.384', 'weapon3': '1.538'} [2023-02-24 17:47:15,070][177155] DAMAGECOUNT value on done: 19438.0 [2023-02-24 17:47:15,071][177155] Sum rewards: 8.225, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.410', 'AMMO2': '0.012', 'AMMO5': '0.018', 'AMMO3': '0.060', 'WEAPON1': '0.060', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'weapon4': '0.360', 'WEAPON3': '0.400', 'weapon5': '0.456', 'HITCOUNT': '0.530', 'WEAPON5': '0.550', 'weapon3': '0.958', 'weapon2': '1.980', 'DAMAGECOUNT': '3.588', 'FRAGCOUNT': '8.000'} [2023-02-24 17:47:15,240][177153] Updated weights for policy 0, policy_version 4990 (0.0008) [2023-02-24 17:47:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14023.6). Total num frames: 20451328. Throughput: 0: 3500.0. Samples: 5114488. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:47:16,376][177119] Avg episode reward: [(0, '1.008')] [2023-02-24 17:47:16,398][177140] Saving new best policy, reward=1.008! [2023-02-24 17:47:17,446][177156] DAMAGECOUNT value on done: 19019.0 [2023-02-24 17:47:17,446][177156] Sum rewards: 1.149, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.380', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.060', 'AMMO4': '0.061', 'AMMO3': '0.096', 'HITCOUNT': '0.260', 'WEAPON5': '0.300', 'weapon5': '0.312', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.987', 'weapon3': '1.476', 'weapon2': '1.504', 'FRAGCOUNT': '2.000'} [2023-02-24 17:47:17,752][177156] DAMAGECOUNT value on done: 19857.0 [2023-02-24 17:47:17,752][177156] Sum rewards: -5.455, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.794', 'AMMO5': '0.015', 'AMMO2': '0.023', 'WEAPON4': '0.050', 'AMMO3': '0.061', 'WEAPON1': '0.070', 'HITCOUNT': '0.070', 'AMMO4': '0.114', 'weapon3': '0.262', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'weapon5': '0.436', 'weapon4': '0.624', 'weapon2': '2.364'} [2023-02-24 17:47:17,894][177156] DAMAGECOUNT value on done: 21299.0 [2023-02-24 17:47:17,894][177156] Sum rewards: 2.686, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.340', 'AMMO2': '0.007', 'AMMO5': '0.012', 'AMMO4': '0.034', 'weapon4': '0.046', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.097', 'weapon5': '0.166', 'WEAPON5': '0.300', 'HITCOUNT': '0.300', 'ARMOR': '0.568', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.200', 'weapon3': '1.540', 'weapon2': '1.756', 'FRAGCOUNT': '4.000'} [2023-02-24 17:47:18,177][177153] Updated weights for policy 0, policy_version 5000 (0.0008) [2023-02-24 17:47:18,192][177156] DAMAGECOUNT value on done: 22828.0 [2023-02-24 17:47:18,192][177156] Sum rewards: 3.749, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.110', 'AMMO5': '0.005', 'AMMO2': '0.012', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'AMMO4': '0.060', 'weapon7': '0.062', 'AMMO3': '0.079', 'weapon4': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.230', 'weapon5': '0.318', 'WEAPON3': '0.400', 'weapon3': '0.874', 'DAMAGECOUNT': '1.920', 'weapon2': '2.080', 'FRAGCOUNT': '4.000'} [2023-02-24 17:47:21,093][177153] Updated weights for policy 0, policy_version 5010 (0.0008) [2023-02-24 17:47:21,376][177119] Fps is (10 sec: 13516.9, 60 sec: 13926.4, 300 sec: 14023.6). Total num frames: 20520960. Throughput: 0: 3499.9. Samples: 5124920. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:47:21,376][177119] Avg episode reward: [(0, '1.033')] [2023-02-24 17:47:21,383][177140] Saving new best policy, reward=1.033! [2023-02-24 17:47:24,025][177153] Updated weights for policy 0, policy_version 5020 (0.0009) [2023-02-24 17:47:26,376][177119] Fps is (10 sec: 14335.8, 60 sec: 13994.7, 300 sec: 14037.5). Total num frames: 20594688. Throughput: 0: 3500.4. Samples: 5145972. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:47:26,376][177119] Avg episode reward: [(0, '1.033')] [2023-02-24 17:47:26,947][177153] Updated weights for policy 0, policy_version 5030 (0.0009) [2023-02-24 17:47:29,901][177153] Updated weights for policy 0, policy_version 5040 (0.0009) [2023-02-24 17:47:30,573][177170] DAMAGECOUNT value on done: 19129.0 [2023-02-24 17:47:30,825][177170] DAMAGECOUNT value on done: 20277.0 [2023-02-24 17:47:30,826][177170] Sum rewards: -0.545, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.049', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'ARMOR': '0.052', 'AMMO4': '0.081', 'weapon5': '0.084', 'weapon4': '0.104', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'HITCOUNT': '0.440', 'WEAPON3': '0.800', 'weapon2': '1.470', 'DAMAGECOUNT': '1.710', 'FRAGCOUNT': '2.000', 'weapon3': '2.176'} [2023-02-24 17:47:30,870][177170] DAMAGECOUNT value on done: 21925.0 [2023-02-24 17:47:30,918][177158] DAMAGECOUNT value on done: 20560.0 [2023-02-24 17:47:30,918][177158] Sum rewards: -0.591, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.010', 'AMMO2': '0.003', 'AMMO4': '0.013', 'weapon4': '0.016', 'AMMO5': '0.022', 'WEAPON1': '0.070', 'ARMOR': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.139', 'weapon5': '0.198', 'HITCOUNT': '0.210', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon3': '1.022', 'DAMAGECOUNT': '1.110', 'FRAGCOUNT': '2.000', 'weapon2': '2.440'} [2023-02-24 17:47:31,125][177170] DAMAGECOUNT value on done: 23273.0 [2023-02-24 17:47:31,214][177158] DAMAGECOUNT value on done: 20095.0 [2023-02-24 17:47:31,214][177158] Sum rewards: 2.020, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.990', 'AMMO2': '0.011', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'weapon4': '0.120', 'AMMO3': '0.133', 'weapon5': '0.236', 'HITCOUNT': '0.300', 'WEAPON5': '0.400', 'ARMOR': '0.512', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.626', 'weapon3': '1.704', 'weapon2': '1.730', 'FRAGCOUNT': '3.000'} [2023-02-24 17:47:31,376][177119] Fps is (10 sec: 14335.8, 60 sec: 13994.6, 300 sec: 14037.5). Total num frames: 20664320. Throughput: 0: 3495.2. Samples: 5166904. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:47:31,376][177119] Avg episode reward: [(0, '0.997')] [2023-02-24 17:47:31,391][177172] DAMAGECOUNT value on done: 18576.0 [2023-02-24 17:47:31,391][177172] Sum rewards: 0.942, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.130', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'AMMO3': '0.057', 'ARMOR': '0.080', 'weapon5': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.160', 'HITCOUNT': '0.240', 'WEAPON3': '0.350', 'weapon4': '0.380', 'weapon3': '0.852', 'DAMAGECOUNT': '0.987', 'FRAGCOUNT': '1.000', 'weapon2': '1.860'} [2023-02-24 17:47:31,688][177172] DAMAGECOUNT value on done: 18904.0 [2023-02-24 17:47:31,689][177172] Sum rewards: 2.426, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.706', 'AMMO5': '0.019', 'AMMO2': '0.031', 'WEAPON1': '0.060', 'AMMO3': '0.099', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.140', 'weapon7': '0.142', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.234', 'weapon4': '0.344', 'WEAPON5': '0.450', 'ARMOR': '0.519', 'WEAPON3': '0.650', 'weapon2': '0.806', 'DAMAGECOUNT': '1.170', 'weapon3': '1.674', 'FRAGCOUNT': '2.000'} [2023-02-24 17:47:31,833][177158] DAMAGECOUNT value on done: 18161.0 [2023-02-24 17:47:31,833][177158] Sum rewards: 0.459, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.080', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'weapon5': '0.062', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'ARMOR': '0.105', 'weapon4': '0.164', 'HITCOUNT': '0.230', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.741', 'FRAGCOUNT': '1.000', 'weapon2': '1.376', 'weapon3': '1.708'} [2023-02-24 17:47:32,018][177154] DAMAGECOUNT value on done: 21965.0 [2023-02-24 17:47:32,018][177154] Sum rewards: 4.390, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.370', 'AMMO2': '0.011', 'AMMO5': '0.012', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'weapon5': '0.196', 'weapon4': '0.204', 'HITCOUNT': '0.260', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'weapon3': '1.040', 'weapon2': '1.536', 'DAMAGECOUNT': '1.608', 'FRAGCOUNT': '5.000'} [2023-02-24 17:47:32,129][177158] DAMAGECOUNT value on done: 19593.0 [2023-02-24 17:47:32,130][177158] Sum rewards: -0.339, reward structure: {'DEATHCOUNT': '-7.500', 'weapon5': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'ARMOR': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'AMMO4': '0.124', 'HEALTH': '0.129', 'WEAPON5': '0.150', 'HITCOUNT': '0.180', 'weapon4': '0.300', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.550', 'weapon3': '1.320', 'weapon2': '1.586', 'FRAGCOUNT': '2.000'} [2023-02-24 17:47:32,315][177154] DAMAGECOUNT value on done: 19221.0 [2023-02-24 17:47:32,316][177154] Sum rewards: -2.721, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.342', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.017', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'ARMOR': '0.074', 'AMMO3': '0.106', 'weapon5': '0.172', 'HITCOUNT': '0.180', 'weapon4': '0.186', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.272', 'weapon3': '1.438', 'weapon2': '1.982', 'FRAGCOUNT': '2.000'} [2023-02-24 17:47:32,450][177154] DAMAGECOUNT value on done: 20868.0 [2023-02-24 17:47:32,451][177154] Sum rewards: -1.186, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.007', 'AMMO2': '0.010', 'ARMOR': '0.036', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'weapon5': '0.120', 'AMMO3': '0.130', 'HEALTH': '0.174', 'weapon4': '0.188', 'HITCOUNT': '0.210', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.669', 'weapon3': '1.250', 'FRAGCOUNT': '2.000', 'weapon2': '2.002'} [2023-02-24 17:47:32,568][177172] DAMAGECOUNT value on done: 20774.0 [2023-02-24 17:47:32,568][177172] Sum rewards: -3.000, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.023', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'ARMOR': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'AMMO4': '0.145', 'HITCOUNT': '0.170', 'weapon5': '0.206', 'weapon4': '0.322', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'HEALTH': '0.890', 'DAMAGECOUNT': '0.972', 'FRAGCOUNT': '1.000', 'weapon2': '1.348', 'weapon3': '1.784'} [2023-02-24 17:47:32,748][177154] DAMAGECOUNT value on done: 20641.0 [2023-02-24 17:47:32,748][177154] Sum rewards: 4.443, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.567', 'AMMO5': '0.015', 'AMMO2': '0.021', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.083', 'AMMO4': '0.105', 'weapon5': '0.218', 'weapon4': '0.256', 'WEAPON5': '0.350', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'weapon2': '1.156', 'weapon3': '1.642', 'DAMAGECOUNT': '1.992', 'FRAGCOUNT': '4.000'} [2023-02-24 17:47:32,819][177153] Updated weights for policy 0, policy_version 5050 (0.0008) [2023-02-24 17:47:32,833][177171] DAMAGECOUNT value on done: 18822.0 [2023-02-24 17:47:32,873][177172] DAMAGECOUNT value on done: 18143.0 [2023-02-24 17:47:32,874][177172] Sum rewards: 1.343, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.536', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'weapon4': '0.074', 'AMMO4': '0.079', 'AMMO3': '0.113', 'HITCOUNT': '0.240', 'weapon5': '0.296', 'WEAPON5': '0.350', 'ARMOR': '0.485', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.915', 'weapon2': '1.386', 'weapon3': '1.892', 'FRAGCOUNT': '2.000'} [2023-02-24 17:47:33,126][177157] DAMAGECOUNT value on done: 22260.0 [2023-02-24 17:47:33,126][177157] Sum rewards: 8.819, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.731', 'AMMO5': '0.010', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'weapon5': '0.202', 'weapon4': '0.240', 'HITCOUNT': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'weapon3': '1.272', 'weapon2': '1.832', 'DAMAGECOUNT': '2.316', 'FRAGCOUNT': '7.000'} [2023-02-24 17:47:33,127][177171] DAMAGECOUNT value on done: 19433.0 [2023-02-24 17:47:33,128][177171] Sum rewards: 0.677, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.030', 'WEAPON1': '0.030', 'HEALTH': '0.090', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'ARMOR': '0.104', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'HITCOUNT': '0.190', 'weapon5': '0.192', 'weapon4': '0.230', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.567', 'weapon3': '0.938', 'FRAGCOUNT': '1.000', 'weapon2': '1.654'} [2023-02-24 17:47:33,413][177157] DAMAGECOUNT value on done: 20788.0 [2023-02-24 17:47:33,433][177157] DAMAGECOUNT value on done: 21734.0 [2023-02-24 17:47:33,434][177157] Sum rewards: 3.785, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.244', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.030', 'AMMO4': '0.039', 'weapon7': '0.050', 'AMMO3': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.164', 'WEAPON5': '0.250', 'HITCOUNT': '0.280', 'weapon4': '0.284', 'WEAPON3': '0.550', 'weapon3': '1.190', 'weapon2': '1.686', 'DAMAGECOUNT': '1.971', 'FRAGCOUNT': '4.000'} [2023-02-24 17:47:33,436][177171] DAMAGECOUNT value on done: 18866.0 [2023-02-24 17:47:33,436][177171] Sum rewards: 1.945, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.849', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON3': '0.300', 'HITCOUNT': '0.320', 'weapon4': '0.394', 'ARMOR': '0.400', 'weapon2': '0.774', 'weapon3': '1.246', 'DAMAGECOUNT': '1.332', 'FRAGCOUNT': '2.000'} [2023-02-24 17:47:33,572][177155] DAMAGECOUNT value on done: 19557.0 [2023-02-24 17:47:33,573][177155] Sum rewards: 4.895, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.067', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.016', 'AMMO3': '0.047', 'WEAPON1': '0.050', 'weapon4': '0.070', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'weapon5': '0.220', 'WEAPON5': '0.250', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'weapon3': '0.848', 'DAMAGECOUNT': '2.328', 'weapon2': '2.662', 'FRAGCOUNT': '7.000'} [2023-02-24 17:47:33,729][177157] DAMAGECOUNT value on done: 19871.0 [2023-02-24 17:47:33,730][177157] Sum rewards: -2.164, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.858', 'AMMO2': '0.010', 'weapon4': '0.016', 'AMMO5': '0.022', 'AMMO4': '0.048', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.138', 'weapon5': '0.300', 'HITCOUNT': '0.440', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.410', 'weapon3': '1.492', 'weapon2': '1.648'} [2023-02-24 17:47:33,733][177171] DAMAGECOUNT value on done: 20269.0 [2023-02-24 17:47:33,733][177171] Sum rewards: -1.852, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.960', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.030', 'ARMOR': '0.036', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'HITCOUNT': '0.440', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.359', 'weapon3': '1.566', 'weapon2': '1.898'} [2023-02-24 17:47:33,877][177155] DAMAGECOUNT value on done: 22041.0 [2023-02-24 17:47:33,877][177155] Sum rewards: -1.252, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.282', 'AMMO2': '0.002', 'AMMO5': '0.006', 'AMMO4': '0.007', 'WEAPON1': '0.030', 'weapon5': '0.040', 'AMMO3': '0.113', 'HITCOUNT': '0.130', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.411', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon2': '1.100', 'weapon3': '1.540'} [2023-02-24 17:47:34,043][177155] DAMAGECOUNT value on done: 21513.0 [2023-02-24 17:47:34,043][177155] Sum rewards: 1.128, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.767', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.018', 'WEAPON1': '0.020', 'AMMO3': '0.058', 'ARMOR': '0.060', 'weapon7': '0.070', 'weapon5': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.140', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.002', 'weapon2': '1.948'} [2023-02-24 17:47:34,335][177155] DAMAGECOUNT value on done: 20174.0 [2023-02-24 17:47:34,335][177155] Sum rewards: 1.461, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.095', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON1': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.122', 'weapon5': '0.144', 'HITCOUNT': '0.220', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'weapon2': '1.644', 'weapon3': '1.784', 'DAMAGECOUNT': '2.013', 'FRAGCOUNT': '3.500'} [2023-02-24 17:47:35,756][177153] Updated weights for policy 0, policy_version 5060 (0.0008) [2023-02-24 17:47:36,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 14023.6). Total num frames: 20733952. Throughput: 0: 3492.0. Samples: 5177314. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:47:36,376][177119] Avg episode reward: [(0, '0.628')] [2023-02-24 17:47:36,656][177156] DAMAGECOUNT value on done: 19585.0 [2023-02-24 17:47:36,657][177156] Sum rewards: 1.752, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.383', 'AMMO5': '0.013', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'AMMO3': '0.086', 'AMMO4': '0.091', 'weapon5': '0.216', 'WEAPON5': '0.300', 'HITCOUNT': '0.410', 'WEAPON3': '0.500', 'weapon3': '1.420', 'DAMAGECOUNT': '1.698', 'weapon2': '1.842', 'FRAGCOUNT': '3.000'} [2023-02-24 17:47:36,836][177172] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 17:47:36,948][177156] DAMAGECOUNT value on done: 20140.0 [2023-02-24 17:47:36,948][177156] Sum rewards: -5.299, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.406', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'ARMOR': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.079', 'AMMO3': '0.169', 'weapon5': '0.186', 'WEAPON5': '0.250', 'HITCOUNT': '0.290', 'weapon4': '0.410', 'DAMAGECOUNT': '0.849', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.290', 'weapon3': '1.718'} [2023-02-24 17:47:37,054][177156] DAMAGECOUNT value on done: 21679.0 [2023-02-24 17:47:37,054][177156] Sum rewards: 2.874, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.431', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'WEAPON5': '0.150', 'weapon5': '0.168', 'WEAPON3': '0.200', 'HITCOUNT': '0.230', 'ARMOR': '0.500', 'weapon3': '0.620', 'DAMAGECOUNT': '1.140', 'FRAGCOUNT': '2.000', 'weapon2': '2.754'} [2023-02-24 17:47:37,355][177156] DAMAGECOUNT value on done: 23359.0 [2023-02-24 17:47:37,355][177156] Sum rewards: 0.912, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO2': '0.017', 'AMMO5': '0.017', 'ARMOR': '0.024', 'WEAPON1': '0.030', 'weapon7': '0.058', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.121', 'HEALTH': '0.165', 'weapon4': '0.172', 'WEAPON7': '0.200', 'weapon5': '0.224', 'WEAPON5': '0.350', 'HITCOUNT': '0.360', 'WEAPON3': '0.550', 'weapon3': '1.184', 'DAMAGECOUNT': '1.593', 'weapon2': '1.922', 'FRAGCOUNT': '4.000'} [2023-02-24 17:47:38,671][177153] Updated weights for policy 0, policy_version 5070 (0.0008) [2023-02-24 17:47:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14023.6). Total num frames: 20803584. Throughput: 0: 3500.0. Samples: 5198512. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:47:41,376][177119] Avg episode reward: [(0, '0.643')] [2023-02-24 17:47:41,576][177153] Updated weights for policy 0, policy_version 5080 (0.0008) [2023-02-24 17:47:44,517][177153] Updated weights for policy 0, policy_version 5090 (0.0008) [2023-02-24 17:47:46,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14023.6). Total num frames: 20873216. Throughput: 0: 3497.4. Samples: 5219476. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 17:47:46,376][177119] Avg episode reward: [(0, '0.643')] [2023-02-24 17:47:47,428][177153] Updated weights for policy 0, policy_version 5100 (0.0009) [2023-02-24 17:47:49,724][177170] DAMAGECOUNT value on done: 19396.0 [2023-02-24 17:47:49,967][177158] DAMAGECOUNT value on done: 21145.0 [2023-02-24 17:47:49,967][177158] Sum rewards: -2.178, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.864', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.012', 'weapon4': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon5': '0.160', 'WEAPON5': '0.250', 'HITCOUNT': '0.360', 'WEAPON3': '0.600', 'weapon3': '1.164', 'DAMAGECOUNT': '1.755', 'weapon2': '1.930', 'FRAGCOUNT': '2.500'} [2023-02-24 17:47:49,987][177170] DAMAGECOUNT value on done: 20845.0 [2023-02-24 17:47:49,987][177170] Sum rewards: 4.551, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.720', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'AMMO5': '0.010', 'ARMOR': '0.040', 'weapon4': '0.054', 'WEAPON1': '0.060', 'AMMO3': '0.074', 'WEAPON4': '0.100', 'weapon5': '0.108', 'HITCOUNT': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'weapon3': '1.504', 'DAMAGECOUNT': '1.704', 'weapon2': '1.720', 'FRAGCOUNT': '5.000'} [2023-02-24 17:47:50,044][177170] DAMAGECOUNT value on done: 22432.0 [2023-02-24 17:47:50,045][177170] Sum rewards: -3.093, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.486', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon4': '0.012', 'AMMO4': '0.029', 'WEAPON1': '0.030', 'ARMOR': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'weapon5': '0.148', 'WEAPON5': '0.150', 'HITCOUNT': '0.460', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.521', 'weapon2': '1.762', 'weapon3': '1.866', 'FRAGCOUNT': '2.000'} [2023-02-24 17:47:50,273][177158] DAMAGECOUNT value on done: 20315.0 [2023-02-24 17:47:50,273][177158] Sum rewards: 2.388, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.215', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO3': '0.037', 'WEAPON5': '0.050', 'weapon5': '0.056', 'weapon7': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'ARMOR': '0.433', 'weapon2': '0.456', 'weapon3': '0.508', 'DAMAGECOUNT': '0.660', 'FRAGCOUNT': '1.000'} [2023-02-24 17:47:50,295][177170] DAMAGECOUNT value on done: 23908.0 [2023-02-24 17:47:50,296][177170] Sum rewards: 0.330, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.680', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'weapon5': '0.112', 'AMMO3': '0.129', 'WEAPON5': '0.150', 'HITCOUNT': '0.400', 'WEAPON3': '0.850', 'weapon3': '1.540', 'weapon2': '1.618', 'DAMAGECOUNT': '1.905', 'FRAGCOUNT': '5.000'} [2023-02-24 17:47:50,353][177153] Updated weights for policy 0, policy_version 5110 (0.0009) [2023-02-24 17:47:50,533][177172] DAMAGECOUNT value on done: 18813.0 [2023-02-24 17:47:50,534][177172] Sum rewards: 2.492, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.120', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon4': '0.030', 'weapon7': '0.046', 'AMMO4': '0.059', 'WEAPON1': '0.060', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.240', 'weapon5': '0.240', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.711', 'weapon3': '1.374', 'weapon2': '2.032', 'FRAGCOUNT': '4.000'} [2023-02-24 17:47:50,832][177172] DAMAGECOUNT value on done: 19582.0 [2023-02-24 17:47:50,833][177172] Sum rewards: 3.424, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.318', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.028', 'ARMOR': '0.028', 'weapon4': '0.048', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.124', 'weapon5': '0.156', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'HITCOUNT': '0.360', 'WEAPON3': '0.700', 'weapon3': '1.514', 'weapon2': '1.752', 'DAMAGECOUNT': '1.776', 'FRAGCOUNT': '4.000'} [2023-02-24 17:47:50,886][177158] DAMAGECOUNT value on done: 18523.0 [2023-02-24 17:47:50,886][177158] Sum rewards: -0.562, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.350', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'weapon4': '0.032', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'ARMOR': '0.096', 'AMMO3': '0.148', 'weapon5': '0.170', 'HITCOUNT': '0.240', 'WEAPON5': '0.250', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.086', 'weapon3': '1.552', 'weapon2': '2.050', 'FRAGCOUNT': '4.000'} [2023-02-24 17:47:51,180][177158] DAMAGECOUNT value on done: 20082.0 [2023-02-24 17:47:51,180][177158] Sum rewards: -1.818, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.402', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO5': '0.015', 'ARMOR': '0.036', 'WEAPON1': '0.070', 'AMMO3': '0.128', 'HITCOUNT': '0.190', 'weapon5': '0.208', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'weapon3': '1.448', 'DAMAGECOUNT': '1.467', 'FRAGCOUNT': '1.500', 'weapon2': '1.660'} [2023-02-24 17:47:51,245][177154] DAMAGECOUNT value on done: 22515.0 [2023-02-24 17:47:51,246][177154] Sum rewards: 2.793, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.600', 'AMMO2': '0.009', 'AMMO5': '0.014', 'AMMO4': '0.045', 'WEAPON1': '0.070', 'AMMO3': '0.080', 'weapon5': '0.222', 'WEAPON5': '0.350', 'HITCOUNT': '0.360', 'WEAPON3': '0.550', 'weapon3': '1.338', 'DAMAGECOUNT': '1.650', 'weapon2': '2.204', 'FRAGCOUNT': '4.000'} [2023-02-24 17:47:51,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 14023.6). Total num frames: 20942848. Throughput: 0: 3498.7. Samples: 5230016. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:47:51,376][177119] Avg episode reward: [(0, '0.631')] [2023-02-24 17:47:51,552][177154] DAMAGECOUNT value on done: 19664.0 [2023-02-24 17:47:51,552][177154] Sum rewards: 3.232, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.373', 'AMMO2': '0.011', 'AMMO5': '0.017', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'WEAPON1': '0.080', 'AMMO3': '0.081', 'weapon4': '0.196', 'HITCOUNT': '0.270', 'weapon5': '0.310', 'WEAPON3': '0.450', 'WEAPON5': '0.500', 'DAMAGECOUNT': '1.329', 'weapon2': '1.406', 'weapon3': '1.558', 'FRAGCOUNT': '4.000'} [2023-02-24 17:47:51,690][177154] DAMAGECOUNT value on done: 21125.0 [2023-02-24 17:47:51,690][177154] Sum rewards: -0.768, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.070', 'ARMOR': '0.076', 'weapon5': '0.144', 'WEAPON5': '0.150', 'HITCOUNT': '0.160', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.771', 'HEALTH': '0.842', 'FRAGCOUNT': '1.000', 'weapon3': '1.160', 'weapon2': '2.538'} [2023-02-24 17:47:51,693][177172] DAMAGECOUNT value on done: 21023.0 [2023-02-24 17:47:51,694][177172] Sum rewards: 0.913, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.545', 'AMMO5': '0.013', 'AMMO2': '0.017', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.084', 'AMMO4': '0.085', 'ARMOR': '0.088', 'weapon5': '0.098', 'weapon4': '0.194', 'HITCOUNT': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.747', 'FRAGCOUNT': '1.000', 'weapon2': '1.234', 'weapon3': '1.398'} [2023-02-24 17:47:51,982][177154] DAMAGECOUNT value on done: 21157.0 [2023-02-24 17:47:51,982][177154] Sum rewards: -5.277, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.840', 'AMMO5': '0.016', 'AMMO2': '0.018', 'WEAPON1': '0.070', 'AMMO4': '0.090', 'ARMOR': '0.096', 'AMMO3': '0.148', 'weapon5': '0.160', 'HITCOUNT': '0.320', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.482', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon3': '1.176', 'DAMAGECOUNT': '1.548', 'weapon2': '1.938'} [2023-02-24 17:47:51,994][177172] DAMAGECOUNT value on done: 18664.0 [2023-02-24 17:47:51,994][177172] Sum rewards: -1.079, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.326', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'ARMOR': '0.050', 'weapon4': '0.058', 'AMMO4': '0.060', 'AMMO3': '0.128', 'weapon5': '0.158', 'WEAPON5': '0.250', 'HITCOUNT': '0.320', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.563', 'weapon2': '1.632', 'weapon3': '1.906'} [2023-02-24 17:47:52,036][177171] DAMAGECOUNT value on done: 18957.0 [2023-02-24 17:47:52,036][177171] Sum rewards: -2.479, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.888', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'ARMOR': '0.048', 'AMMO3': '0.088', 'weapon4': '0.124', 'weapon5': '0.130', 'AMMO4': '0.140', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.184', 'weapon2': '2.382'} [2023-02-24 17:47:52,340][177171] DAMAGECOUNT value on done: 19827.0 [2023-02-24 17:47:52,341][177171] Sum rewards: -4.832, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.700', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.011', 'weapon4': '0.016', 'AMMO2': '0.021', 'WEAPON1': '0.050', 'ARMOR': '0.056', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'weapon5': '0.146', 'AMMO3': '0.166', 'HITCOUNT': '0.190', 'WEAPON5': '0.250', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.182', 'weapon3': '1.206', 'weapon2': '1.818'} [2023-02-24 17:47:52,355][177157] DAMAGECOUNT value on done: 22456.0 [2023-02-24 17:47:52,356][177157] Sum rewards: -1.318, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.572', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'HITCOUNT': '0.190', 'DAMAGECOUNT': '0.588', 'WEAPON3': '0.600', 'weapon2': '1.042', 'weapon3': '1.644', 'FRAGCOUNT': '2.000'} [2023-02-24 17:47:52,642][177171] DAMAGECOUNT value on done: 19276.0 [2023-02-24 17:47:52,642][177171] Sum rewards: 0.146, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.936', 'AMMO2': '0.015', 'AMMO5': '0.015', 'WEAPON1': '0.070', 'AMMO4': '0.073', 'AMMO3': '0.135', 'weapon5': '0.184', 'HITCOUNT': '0.340', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'weapon2': '1.176', 'DAMAGECOUNT': '1.230', 'FRAGCOUNT': '1.500', 'weapon3': '2.044'} [2023-02-24 17:47:52,656][177157] DAMAGECOUNT value on done: 21221.0 [2023-02-24 17:47:52,657][177157] Sum rewards: 3.176, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.438', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.013', 'ARMOR': '0.036', 'AMMO3': '0.043', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.106', 'HITCOUNT': '0.180', 'weapon5': '0.260', 'WEAPON3': '0.350', 'WEAPON5': '0.500', 'weapon3': '0.728', 'DAMAGECOUNT': '1.299', 'weapon2': '2.478', 'FRAGCOUNT': '3.000'} [2023-02-24 17:47:52,667][177157] DAMAGECOUNT value on done: 22044.0 [2023-02-24 17:47:52,667][177157] Sum rewards: 1.637, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.461', 'AMMO2': '0.011', 'AMMO5': '0.015', 'AMMO3': '0.040', 'ARMOR': '0.040', 'WEAPON1': '0.040', 'AMMO4': '0.055', 'weapon4': '0.066', 'WEAPON4': '0.100', 'weapon5': '0.120', 'HITCOUNT': '0.180', 'WEAPON3': '0.300', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.930', 'weapon3': '0.932', 'FRAGCOUNT': '1.000', 'weapon2': '2.468'} [2023-02-24 17:47:52,758][177155] DAMAGECOUNT value on done: 19918.0 [2023-02-24 17:47:52,759][177155] Sum rewards: 1.827, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.067', 'weapon5': '0.068', 'WEAPON5': '0.100', 'HEALTH': '0.123', 'HITCOUNT': '0.320', 'WEAPON3': '0.400', 'weapon3': '0.986', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.083', 'weapon2': '2.842'} [2023-02-24 17:47:52,938][177171] DAMAGECOUNT value on done: 20943.0 [2023-02-24 17:47:52,939][177171] Sum rewards: 6.959, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.003', 'AMMO5': '0.013', 'AMMO4': '0.014', 'ARMOR': '0.041', 'WEAPON1': '0.050', 'AMMO3': '0.080', 'HEALTH': '0.235', 'weapon5': '0.252', 'WEAPON5': '0.350', 'HITCOUNT': '0.440', 'WEAPON3': '0.500', 'weapon2': '1.442', 'weapon3': '2.016', 'DAMAGECOUNT': '2.022', 'FRAGCOUNT': '5.500'} [2023-02-24 17:47:52,966][177157] DAMAGECOUNT value on done: 20336.0 [2023-02-24 17:47:52,967][177157] Sum rewards: -2.539, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.730', 'weapon5': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'ARMOR': '0.048', 'AMMO4': '0.066', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'WEAPON5': '0.250', 'weapon4': '0.270', 'HITCOUNT': '0.350', 'WEAPON3': '0.950', 'weapon2': '1.060', 'DAMAGECOUNT': '1.395', 'FRAGCOUNT': '2.000', 'weapon3': '2.172'} [2023-02-24 17:47:53,054][177155] DAMAGECOUNT value on done: 22790.0 [2023-02-24 17:47:53,055][177155] Sum rewards: 4.998, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.799', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.031', 'ARMOR': '0.076', 'AMMO3': '0.087', 'weapon5': '0.148', 'WEAPON5': '0.200', 'HITCOUNT': '0.420', 'WEAPON3': '0.600', 'weapon2': '1.600', 'weapon3': '1.624', 'DAMAGECOUNT': '2.247', 'FRAGCOUNT': '4.000'} [2023-02-24 17:47:53,207][177155] DAMAGECOUNT value on done: 21911.0 [2023-02-24 17:47:53,208][177155] Sum rewards: 1.958, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.243', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'ARMOR': '0.035', 'AMMO3': '0.053', 'AMMO4': '0.092', 'weapon5': '0.116', 'WEAPON5': '0.150', 'HITCOUNT': '0.260', 'WEAPON3': '0.400', 'weapon3': '0.938', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.194', 'weapon2': '2.410'} [2023-02-24 17:47:53,299][177153] Updated weights for policy 0, policy_version 5120 (0.0008) [2023-02-24 17:47:53,502][177155] DAMAGECOUNT value on done: 20466.0 [2023-02-24 17:47:53,502][177155] Sum rewards: 1.972, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.546', 'AMMO5': '0.017', 'AMMO2': '0.033', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'weapon7': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.105', 'AMMO4': '0.164', 'HITCOUNT': '0.180', 'weapon4': '0.188', 'weapon5': '0.208', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.876', 'weapon2': '1.476', 'weapon3': '1.500', 'FRAGCOUNT': '3.000'} [2023-02-24 17:47:55,830][177156] DAMAGECOUNT value on done: 19658.0 [2023-02-24 17:47:56,122][177156] DAMAGECOUNT value on done: 20769.0 [2023-02-24 17:47:56,122][177156] Sum rewards: 1.199, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.495', 'AMMO5': '0.012', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.092', 'weapon5': '0.122', 'AMMO3': '0.123', 'weapon4': '0.170', 'WEAPON5': '0.300', 'HITCOUNT': '0.410', 'WEAPON3': '0.750', 'weapon3': '1.674', 'weapon2': '1.794', 'DAMAGECOUNT': '1.887', 'FRAGCOUNT': '4.000'} [2023-02-24 17:47:56,174][177153] Updated weights for policy 0, policy_version 5130 (0.0009) [2023-02-24 17:47:56,219][177156] DAMAGECOUNT value on done: 22097.0 [2023-02-24 17:47:56,219][177156] Sum rewards: 0.629, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.241', 'AMMO5': '0.011', 'AMMO2': '0.014', 'WEAPON1': '0.050', 'AMMO4': '0.070', 'ARMOR': '0.083', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'weapon7': '0.160', 'weapon5': '0.174', 'HITCOUNT': '0.230', 'WEAPON5': '0.250', 'weapon4': '0.380', 'WEAPON3': '0.750', 'weapon2': '0.796', 'DAMAGECOUNT': '1.254', 'weapon3': '1.892', 'FRAGCOUNT': '2.000'} [2023-02-24 17:47:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 14023.6). Total num frames: 21012480. Throughput: 0: 3497.4. Samples: 5251024. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:47:56,376][177119] Avg episode reward: [(0, '0.628')] [2023-02-24 17:47:56,525][177156] DAMAGECOUNT value on done: 23763.0 [2023-02-24 17:47:56,525][177156] Sum rewards: 2.479, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.986', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.007', 'ARMOR': '0.020', 'WEAPON1': '0.030', 'weapon5': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon4': '0.136', 'WEAPON5': '0.150', 'HITCOUNT': '0.310', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.212', 'weapon3': '1.672', 'weapon2': '1.790', 'FRAGCOUNT': '4.000'} [2023-02-24 17:47:59,098][177153] Updated weights for policy 0, policy_version 5140 (0.0008) [2023-02-24 17:48:01,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 14023.6). Total num frames: 21082112. Throughput: 0: 3505.3. Samples: 5272228. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:48:01,376][177119] Avg episode reward: [(0, '0.637')] [2023-02-24 17:48:01,980][177153] Updated weights for policy 0, policy_version 5150 (0.0008) [2023-02-24 17:48:04,909][177153] Updated weights for policy 0, policy_version 5160 (0.0009) [2023-02-24 17:48:06,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14062.9, 300 sec: 14037.5). Total num frames: 21155840. Throughput: 0: 3507.6. Samples: 5282762. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:48:06,376][177119] Avg episode reward: [(0, '0.637')] [2023-02-24 17:48:07,794][177153] Updated weights for policy 0, policy_version 5170 (0.0008) [2023-02-24 17:48:08,770][177170] DAMAGECOUNT value on done: 19515.0 [2023-02-24 17:48:08,771][177170] Sum rewards: -1.102, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.288', 'weapon4': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.031', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'ARMOR': '0.068', 'weapon5': '0.084', 'AMMO3': '0.119', 'HITCOUNT': '0.140', 'AMMO4': '0.155', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.357', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.452', 'weapon2': '2.210'} [2023-02-24 17:48:09,057][177170] DAMAGECOUNT value on done: 21276.0 [2023-02-24 17:48:09,057][177170] Sum rewards: 1.097, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.354', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'ARMOR': '0.068', 'AMMO4': '0.095', 'weapon5': '0.108', 'AMMO3': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'HITCOUNT': '0.330', 'weapon4': '0.476', 'WEAPON3': '0.750', 'weapon2': '0.962', 'DAMAGECOUNT': '1.293', 'weapon3': '1.544', 'FRAGCOUNT': '3.000'} [2023-02-24 17:48:09,077][177170] DAMAGECOUNT value on done: 23016.0 [2023-02-24 17:48:09,077][177170] Sum rewards: 0.038, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.328', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'HITCOUNT': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'weapon3': '1.500', 'weapon2': '1.748', 'DAMAGECOUNT': '1.752', 'FRAGCOUNT': '3.500'} [2023-02-24 17:48:09,138][177158] DAMAGECOUNT value on done: 21355.0 [2023-02-24 17:48:09,139][177158] Sum rewards: -2.983, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.590', 'AMMO5': '0.009', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.076', 'weapon5': '0.082', 'AMMO3': '0.100', 'weapon4': '0.132', 'HITCOUNT': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.630', 'FRAGCOUNT': '1.000', 'weapon3': '1.332', 'weapon2': '1.390'} [2023-02-24 17:48:09,366][177170] DAMAGECOUNT value on done: 23982.0 [2023-02-24 17:48:09,437][177158] DAMAGECOUNT value on done: 20922.0 [2023-02-24 17:48:09,438][177158] Sum rewards: 1.208, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.090', 'AMMO5': '0.010', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'AMMO3': '0.107', 'AMMO4': '0.111', 'weapon5': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.322', 'HITCOUNT': '0.410', 'WEAPON3': '0.550', 'weapon2': '1.286', 'DAMAGECOUNT': '1.431', 'weapon3': '1.568', 'FRAGCOUNT': '4.000'} [2023-02-24 17:48:09,649][177172] DAMAGECOUNT value on done: 19098.0 [2023-02-24 17:48:09,650][177172] Sum rewards: -3.644, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.236', 'AMMO5': '0.010', 'AMMO2': '0.015', 'ARMOR': '0.035', 'WEAPON1': '0.040', 'AMMO4': '0.074', 'AMMO3': '0.121', 'weapon5': '0.150', 'WEAPON5': '0.250', 'HITCOUNT': '0.290', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.855', 'weapon3': '1.658', 'weapon2': '1.944'} [2023-02-24 17:48:09,946][177172] DAMAGECOUNT value on done: 20122.0 [2023-02-24 17:48:09,947][177172] Sum rewards: 3.781, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.520', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'AMMO3': '0.042', 'weapon5': '0.128', 'WEAPON5': '0.150', 'HITCOUNT': '0.240', 'WEAPON3': '0.300', 'ARMOR': '0.516', 'weapon3': '0.724', 'weapon2': '1.550', 'DAMAGECOUNT': '1.620', 'FRAGCOUNT': '2.000'} [2023-02-24 17:48:10,058][177158] DAMAGECOUNT value on done: 19165.0 [2023-02-24 17:48:10,059][177158] Sum rewards: 5.924, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.012', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'AMMO4': '0.138', 'WEAPON3': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.330', 'weapon5': '0.338', 'HEALTH': '0.758', 'weapon3': '0.958', 'DAMAGECOUNT': '1.926', 'weapon2': '2.146', 'FRAGCOUNT': '4.000'} [2023-02-24 17:48:10,351][177158] DAMAGECOUNT value on done: 20239.0 [2023-02-24 17:48:10,424][177154] DAMAGECOUNT value on done: 22720.0 [2023-02-24 17:48:10,424][177154] Sum rewards: -0.204, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.425', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'AMMO3': '0.060', 'ARMOR': '0.076', 'AMMO4': '0.078', 'HITCOUNT': '0.140', 'weapon5': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.250', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.615', 'FRAGCOUNT': '1.000', 'weapon3': '1.448', 'weapon2': '1.606'} [2023-02-24 17:48:10,724][177153] Updated weights for policy 0, policy_version 5180 (0.0008) [2023-02-24 17:48:10,724][177154] DAMAGECOUNT value on done: 20180.0 [2023-02-24 17:48:10,724][177154] Sum rewards: -2.470, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.256', 'AMMO5': '0.017', 'AMMO2': '0.029', 'ARMOR': '0.040', 'WEAPON1': '0.070', 'AMMO4': '0.143', 'AMMO3': '0.155', 'HITCOUNT': '0.290', 'weapon5': '0.310', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'weapon2': '1.506', 'DAMAGECOUNT': '1.548', 'weapon3': '1.728', 'FRAGCOUNT': '2.000'} [2023-02-24 17:48:10,784][177172] DAMAGECOUNT value on done: 21207.0 [2023-02-24 17:48:10,784][177172] Sum rewards: -0.752, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.825', 'AMMO2': '0.012', 'AMMO5': '0.014', 'AMMO4': '0.060', 'WEAPON1': '0.080', 'AMMO3': '0.093', 'weapon7': '0.094', 'HITCOUNT': '0.100', 'ARMOR': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.144', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.552', 'WEAPON3': '0.600', 'weapon3': '1.030', 'FRAGCOUNT': '2.000', 'weapon2': '2.102'} [2023-02-24 17:48:10,871][177154] DAMAGECOUNT value on done: 21378.0 [2023-02-24 17:48:10,872][177154] Sum rewards: -2.592, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.998', 'AMMO2': '0.016', 'AMMO5': '0.019', 'ARMOR': '0.024', 'WEAPON1': '0.070', 'AMMO4': '0.077', 'AMMO3': '0.121', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'weapon5': '0.200', 'weapon4': '0.360', 'WEAPON5': '0.450', 'DAMAGECOUNT': '0.759', 'weapon2': '0.848', 'WEAPON3': '0.950', 'weapon3': '2.152', 'FRAGCOUNT': '3.000'} [2023-02-24 17:48:11,081][177172] DAMAGECOUNT value on done: 18909.0 [2023-02-24 17:48:11,102][177171] DAMAGECOUNT value on done: 19617.0 [2023-02-24 17:48:11,102][177171] Sum rewards: 2.888, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.540', 'weapon7': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'ARMOR': '0.056', 'AMMO4': '0.111', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.168', 'weapon5': '0.188', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.270', 'WEAPON3': '0.750', 'weapon2': '1.414', 'weapon3': '1.544', 'DAMAGECOUNT': '1.980', 'FRAGCOUNT': '4.000'} [2023-02-24 17:48:11,164][177154] DAMAGECOUNT value on done: 21437.0 [2023-02-24 17:48:11,165][177154] Sum rewards: -1.468, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.132', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.082', 'ARMOR': '0.096', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.170', 'weapon4': '0.254', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.840', 'weapon2': '1.562', 'weapon3': '1.664', 'FRAGCOUNT': '2.000'} [2023-02-24 17:48:11,376][177119] Fps is (10 sec: 14336.0, 60 sec: 13994.7, 300 sec: 14023.6). Total num frames: 21225472. Throughput: 0: 3507.5. Samples: 5303810. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:48:11,376][177119] Avg episode reward: [(0, '0.420')] [2023-02-24 17:48:11,401][177171] DAMAGECOUNT value on done: 20098.0 [2023-02-24 17:48:11,401][177171] Sum rewards: -6.755, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.940', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.015', 'AMMO5': '0.016', 'WEAPON1': '0.050', 'weapon7': '0.052', 'AMMO4': '0.076', 'ARMOR': '0.100', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'WEAPON7': '0.200', 'HITCOUNT': '0.210', 'weapon4': '0.244', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.813', 'WEAPON3': '1.000', 'weapon3': '1.290', 'weapon2': '1.846'} [2023-02-24 17:48:11,467][177157] DAMAGECOUNT value on done: 23163.0 [2023-02-24 17:48:11,468][177157] Sum rewards: 1.549, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.354', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'ARMOR': '0.068', 'AMMO4': '0.077', 'AMMO3': '0.097', 'weapon4': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.206', 'WEAPON3': '0.500', 'HITCOUNT': '0.520', 'weapon3': '1.378', 'weapon2': '1.886', 'DAMAGECOUNT': '2.121', 'FRAGCOUNT': '3.000'} [2023-02-24 17:48:11,672][177171] DAMAGECOUNT value on done: 19316.0 [2023-02-24 17:48:11,760][177157] DAMAGECOUNT value on done: 21844.0 [2023-02-24 17:48:11,761][177157] Sum rewards: 2.985, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.062', 'AMMO2': '0.009', 'AMMO5': '0.017', 'ARMOR': '0.040', 'AMMO4': '0.045', 'WEAPON1': '0.070', 'AMMO3': '0.118', 'weapon5': '0.120', 'WEAPON5': '0.350', 'HITCOUNT': '0.400', 'WEAPON3': '0.700', 'weapon2': '1.168', 'DAMAGECOUNT': '1.869', 'weapon3': '2.390', 'FRAGCOUNT': '4.000'} [2023-02-24 17:48:11,770][177157] DAMAGECOUNT value on done: 22526.0 [2023-02-24 17:48:11,770][177157] Sum rewards: 2.582, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.058', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'AMMO4': '0.059', 'weapon5': '0.074', 'AMMO3': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.250', 'weapon4': '0.280', 'WEAPON3': '0.500', 'weapon3': '1.192', 'DAMAGECOUNT': '1.446', 'weapon2': '1.730', 'FRAGCOUNT': '3.000'} [2023-02-24 17:48:11,835][177155] DAMAGECOUNT value on done: 20313.0 [2023-02-24 17:48:11,835][177155] Sum rewards: 3.639, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.003', 'HEALTH': '0.012', 'AMMO5': '0.012', 'AMMO4': '0.013', 'WEAPON1': '0.030', 'weapon5': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'weapon4': '0.182', 'WEAPON5': '0.250', 'HITCOUNT': '0.370', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.185', 'weapon2': '1.474', 'weapon3': '1.986', 'FRAGCOUNT': '4.000'} [2023-02-24 17:48:11,954][177171] DAMAGECOUNT value on done: 21196.0 [2023-02-24 17:48:11,954][177171] Sum rewards: 2.079, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.010', 'AMMO2': '0.038', 'WEAPON1': '0.050', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'HITCOUNT': '0.140', 'ARMOR': '0.152', 'AMMO4': '0.192', 'weapon5': '0.194', 'WEAPON5': '0.250', 'weapon4': '0.334', 'WEAPON3': '0.350', 'HEALTH': '0.550', 'DAMAGECOUNT': '0.759', 'weapon2': '0.902', 'FRAGCOUNT': '1.000', 'weapon3': '1.498'} [2023-02-24 17:48:12,066][177157] DAMAGECOUNT value on done: 20486.0 [2023-02-24 17:48:12,067][177157] Sum rewards: 0.905, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.772', 'AMMO2': '0.004', 'AMMO5': '0.009', 'AMMO4': '0.021', 'WEAPON1': '0.030', 'AMMO3': '0.065', 'HITCOUNT': '0.100', 'ARMOR': '0.100', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.256', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.450', 'FRAGCOUNT': '1.000', 'weapon2': '1.196', 'weapon3': '1.206'} [2023-02-24 17:48:12,130][177155] DAMAGECOUNT value on done: 22985.0 [2023-02-24 17:48:12,131][177155] Sum rewards: 1.858, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.762', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.085', 'ARMOR': '0.088', 'weapon4': '0.098', 'WEAPON4': '0.100', 'HITCOUNT': '0.200', 'DAMAGECOUNT': '0.585', 'WEAPON3': '0.600', 'weapon3': '1.364', 'weapon2': '1.642', 'FRAGCOUNT': '3.000'} [2023-02-24 17:48:12,297][177155] DAMAGECOUNT value on done: 22635.0 [2023-02-24 17:48:12,297][177155] Sum rewards: 8.246, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.873', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.022', 'ARMOR': '0.036', 'WEAPON1': '0.080', 'AMMO3': '0.113', 'weapon5': '0.224', 'HITCOUNT': '0.340', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon2': '1.378', 'weapon3': '1.964', 'DAMAGECOUNT': '2.172', 'FRAGCOUNT': '9.000'} [2023-02-24 17:48:12,591][177155] DAMAGECOUNT value on done: 20762.0 [2023-02-24 17:48:12,591][177155] Sum rewards: -1.553, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.915', 'AMMO5': '0.007', 'AMMO2': '0.015', 'ARMOR': '0.028', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.100', 'weapon4': '0.162', 'weapon5': '0.164', 'WEAPON5': '0.200', 'HITCOUNT': '0.300', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.888', 'FRAGCOUNT': '1.000', 'weapon3': '1.078', 'weapon2': '2.258'} [2023-02-24 17:48:13,645][177153] Updated weights for policy 0, policy_version 5190 (0.0008) [2023-02-24 17:48:15,022][177156] DAMAGECOUNT value on done: 19968.0 [2023-02-24 17:48:15,319][177156] DAMAGECOUNT value on done: 21192.0 [2023-02-24 17:48:15,319][177156] Sum rewards: 5.444, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'AMMO2': '0.033', 'ARMOR': '0.040', 'HEALTH': '0.046', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.079', 'AMMO4': '0.167', 'HITCOUNT': '0.170', 'weapon5': '0.170', 'weapon4': '0.208', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.269', 'weapon3': '1.296', 'weapon2': '2.006', 'FRAGCOUNT': '5.000'} [2023-02-24 17:48:15,406][177156] DAMAGECOUNT value on done: 22356.0 [2023-02-24 17:48:15,407][177156] Sum rewards: 3.143, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.177', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.030', 'AMMO4': '0.042', 'ARMOR': '0.052', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon5': '0.122', 'WEAPON5': '0.150', 'weapon4': '0.196', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon7': '0.208', 'HITCOUNT': '0.270', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.777', 'FRAGCOUNT': '1.000', 'weapon2': '1.448', 'weapon3': '1.542'} [2023-02-24 17:48:15,709][177156] DAMAGECOUNT value on done: 24099.0 [2023-02-24 17:48:15,710][177156] Sum rewards: 2.874, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.350', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'ARMOR': '0.068', 'AMMO4': '0.074', 'AMMO3': '0.089', 'WEAPON4': '0.150', 'HITCOUNT': '0.320', 'weapon4': '0.326', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.008', 'weapon2': '1.312', 'weapon3': '1.546', 'FRAGCOUNT': '3.000'} [2023-02-24 17:48:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 14023.6). Total num frames: 21295104. Throughput: 0: 3510.0. Samples: 5324854. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:48:16,376][177119] Avg episode reward: [(0, '0.527')] [2023-02-24 17:48:16,568][177153] Updated weights for policy 0, policy_version 5200 (0.0008) [2023-02-24 17:48:19,486][177153] Updated weights for policy 0, policy_version 5210 (0.0009) [2023-02-24 17:48:21,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14062.9, 300 sec: 14023.6). Total num frames: 21364736. Throughput: 0: 3512.2. Samples: 5335364. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:48:21,376][177119] Avg episode reward: [(0, '0.527')] [2023-02-24 17:48:22,424][177153] Updated weights for policy 0, policy_version 5220 (0.0008) [2023-02-24 17:48:25,360][177153] Updated weights for policy 0, policy_version 5230 (0.0008) [2023-02-24 17:48:26,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 14023.6). Total num frames: 21434368. Throughput: 0: 3506.8. Samples: 5356316. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:48:26,376][177119] Avg episode reward: [(0, '0.527')] [2023-02-24 17:48:27,944][177170] DAMAGECOUNT value on done: 19828.0 [2023-02-24 17:48:27,945][177170] Sum rewards: 2.292, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.280', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.010', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO3': '0.058', 'ARMOR': '0.060', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.270', 'weapon4': '0.342', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.939', 'weapon3': '1.100', 'weapon2': '1.616', 'FRAGCOUNT': '3.000'} [2023-02-24 17:48:28,243][177170] DAMAGECOUNT value on done: 23487.0 [2023-02-24 17:48:28,243][177170] Sum rewards: 1.937, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.530', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.040', 'WEAPON1': '0.040', 'weapon5': '0.068', 'AMMO3': '0.076', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.256', 'HITCOUNT': '0.260', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.084', 'DAMAGECOUNT': '1.413', 'weapon2': '1.812'} [2023-02-24 17:48:28,253][177170] DAMAGECOUNT value on done: 21660.0 [2023-02-24 17:48:28,254][177170] Sum rewards: -3.753, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.777', 'AMMO2': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.050', 'WEAPON1': '0.050', 'ARMOR': '0.068', 'AMMO3': '0.134', 'weapon5': '0.176', 'WEAPON4': '0.200', 'weapon4': '0.216', 'HITCOUNT': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.152', 'weapon2': '1.504', 'weapon3': '1.746'} [2023-02-24 17:48:28,273][177158] DAMAGECOUNT value on done: 21535.0 [2023-02-24 17:48:28,273][177158] Sum rewards: -4.620, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.170', 'AMMO5': '0.008', 'AMMO2': '0.027', 'ARMOR': '0.042', 'WEAPON1': '0.050', 'AMMO3': '0.095', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'WEAPON5': '0.250', 'weapon4': '0.268', 'weapon5': '0.434', 'DAMAGECOUNT': '0.540', 'WEAPON3': '0.650', 'weapon2': '1.230', 'weapon3': '1.504'} [2023-02-24 17:48:28,285][177153] Updated weights for policy 0, policy_version 5240 (0.0008) [2023-02-24 17:48:28,549][177170] DAMAGECOUNT value on done: 24607.0 [2023-02-24 17:48:28,549][177170] Sum rewards: 4.848, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.732', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'weapon5': '0.074', 'AMMO4': '0.079', 'AMMO3': '0.103', 'weapon4': '0.136', 'WEAPON5': '0.150', 'HITCOUNT': '0.520', 'WEAPON3': '0.650', 'weapon3': '1.564', 'weapon2': '1.788', 'DAMAGECOUNT': '1.875', 'FRAGCOUNT': '6.000'} [2023-02-24 17:48:28,577][177158] DAMAGECOUNT value on done: 21047.0 [2023-02-24 17:48:28,578][177158] Sum rewards: 3.428, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.040', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO3': '0.030', 'weapon5': '0.048', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'HITCOUNT': '0.140', 'WEAPON3': '0.150', 'weapon3': '0.248', 'DAMAGECOUNT': '0.375', 'weapon2': '1.770', 'FRAGCOUNT': '2.000'} [2023-02-24 17:48:28,883][177172] DAMAGECOUNT value on done: 19871.0 [2023-02-24 17:48:28,883][177172] Sum rewards: 6.211, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.258', 'AMMO2': '0.006', 'AMMO5': '0.017', 'weapon5': '0.026', 'AMMO4': '0.029', 'WEAPON1': '0.040', 'AMMO3': '0.136', 'WEAPON5': '0.350', 'HITCOUNT': '0.670', 'WEAPON3': '0.700', 'weapon3': '1.644', 'weapon2': '1.782', 'DAMAGECOUNT': '2.319', 'FRAGCOUNT': '8.000'} [2023-02-24 17:48:29,189][177158] DAMAGECOUNT value on done: 19419.0 [2023-02-24 17:48:29,190][177158] Sum rewards: 1.893, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.660', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'weapon7': '0.066', 'AMMO3': '0.072', 'AMMO4': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.144', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.396', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.762', 'weapon2': '1.238', 'weapon3': '1.594', 'FRAGCOUNT': '2.000'} [2023-02-24 17:48:29,191][177172] DAMAGECOUNT value on done: 20666.0 [2023-02-24 17:48:29,191][177172] Sum rewards: 1.180, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.765', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'weapon5': '0.050', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.120', 'HITCOUNT': '0.350', 'WEAPON3': '0.600', 'weapon3': '1.234', 'DAMAGECOUNT': '1.632', 'weapon2': '1.904', 'FRAGCOUNT': '2.000'} [2023-02-24 17:48:29,486][177158] DAMAGECOUNT value on done: 20534.0 [2023-02-24 17:48:29,487][177158] Sum rewards: -4.062, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.398', 'AMMO2': '0.004', 'AMMO5': '0.012', 'AMMO4': '0.020', 'WEAPON1': '0.060', 'AMMO3': '0.118', 'weapon5': '0.184', 'HITCOUNT': '0.210', 'WEAPON5': '0.350', 'ARMOR': '0.500', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.885', 'weapon3': '1.350', 'FRAGCOUNT': '2.000', 'weapon2': '2.192'} [2023-02-24 17:48:29,629][177154] DAMAGECOUNT value on done: 23206.0 [2023-02-24 17:48:29,629][177154] Sum rewards: 1.423, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.265', 'AMMO2': '0.011', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.056', 'weapon5': '0.088', 'AMMO3': '0.093', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.290', 'weapon7': '0.296', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'weapon3': '1.054', 'DAMAGECOUNT': '1.458', 'weapon2': '1.668', 'FRAGCOUNT': '3.000'} [2023-02-24 17:48:29,923][177154] DAMAGECOUNT value on done: 20510.0 [2023-02-24 17:48:29,923][177154] Sum rewards: -3.665, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.486', 'AMMO2': '0.015', 'AMMO5': '0.018', 'WEAPON1': '0.060', 'weapon5': '0.062', 'AMMO4': '0.072', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'weapon4': '0.286', 'WEAPON5': '0.400', 'ARMOR': '0.565', 'DAMAGECOUNT': '0.990', 'WEAPON3': '1.150', 'weapon2': '1.182', 'weapon3': '2.056', 'FRAGCOUNT': '3.000'} [2023-02-24 17:48:30,001][177172] DAMAGECOUNT value on done: 21636.0 [2023-02-24 17:48:30,001][177172] Sum rewards: 4.048, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.777', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.038', 'AMMO3': '0.040', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.128', 'weapon5': '0.166', 'HITCOUNT': '0.250', 'WEAPON3': '0.300', 'WEAPON5': '0.300', 'weapon3': '0.898', 'DAMAGECOUNT': '1.287', 'weapon2': '1.992', 'FRAGCOUNT': '3.000'} [2023-02-24 17:48:30,086][177154] DAMAGECOUNT value on done: 21393.0 [2023-02-24 17:48:30,295][177172] DAMAGECOUNT value on done: 19347.0 [2023-02-24 17:48:30,295][177172] Sum rewards: 0.447, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.480', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'AMMO4': '0.047', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'weapon4': '0.120', 'weapon5': '0.196', 'HITCOUNT': '0.210', 'WEAPON5': '0.250', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.266', 'DAMAGECOUNT': '1.314', 'weapon3': '1.792'} [2023-02-24 17:48:30,323][177171] DAMAGECOUNT value on done: 19783.0 [2023-02-24 17:48:30,380][177154] DAMAGECOUNT value on done: 22151.0 [2023-02-24 17:48:30,381][177154] Sum rewards: 3.178, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.552', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.018', 'ARMOR': '0.068', 'weapon5': '0.080', 'AMMO3': '0.136', 'WEAPON5': '0.250', 'HITCOUNT': '0.460', 'weapon2': '0.916', 'WEAPON3': '1.000', 'DAMAGECOUNT': '2.142', 'weapon3': '2.634', 'FRAGCOUNT': '6.000'} [2023-02-24 17:48:30,620][177171] DAMAGECOUNT value on done: 20379.0 [2023-02-24 17:48:30,621][177171] Sum rewards: -0.926, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.910', 'AMMO5': '0.004', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'weapon5': '0.050', 'AMMO4': '0.065', 'WEAPON5': '0.100', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'ARMOR': '0.160', 'HITCOUNT': '0.230', 'weapon4': '0.332', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.843', 'weapon2': '1.098', 'weapon3': '1.492', 'FRAGCOUNT': '2.000'} [2023-02-24 17:48:30,676][177157] DAMAGECOUNT value on done: 23593.0 [2023-02-24 17:48:30,676][177157] Sum rewards: 1.668, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.702', 'AMMO5': '0.013', 'ARMOR': '0.024', 'AMMO2': '0.028', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.106', 'weapon5': '0.106', 'weapon4': '0.136', 'AMMO4': '0.139', 'WEAPON5': '0.250', 'HITCOUNT': '0.350', 'WEAPON3': '0.650', 'weapon2': '1.196', 'DAMAGECOUNT': '1.290', 'weapon3': '2.232', 'FRAGCOUNT': '4.000'} [2023-02-24 17:48:30,821][177171] DAMAGECOUNT value on done: 19880.0 [2023-02-24 17:48:30,821][177171] Sum rewards: 1.853, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.314', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.017', 'WEAPON1': '0.030', 'ARMOR': '0.084', 'AMMO3': '0.119', 'weapon5': '0.132', 'WEAPON5': '0.150', 'HITCOUNT': '0.510', 'WEAPON3': '0.750', 'weapon2': '1.148', 'DAMAGECOUNT': '1.692', 'weapon3': '2.024', 'FRAGCOUNT': '3.000'} [2023-02-24 17:48:30,980][177157] DAMAGECOUNT value on done: 22232.0 [2023-02-24 17:48:30,981][177157] Sum rewards: 0.499, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.816', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.043', 'weapon5': '0.072', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.290', 'weapon4': '0.310', 'ARMOR': '0.466', 'WEAPON3': '0.900', 'weapon3': '1.072', 'DAMAGECOUNT': '1.164', 'weapon2': '1.266', 'FRAGCOUNT': '6.000'} [2023-02-24 17:48:30,990][177157] DAMAGECOUNT value on done: 22995.0 [2023-02-24 17:48:30,990][177157] Sum rewards: 3.111, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.713', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'weapon5': '0.048', 'ARMOR': '0.076', 'AMMO3': '0.126', 'WEAPON5': '0.150', 'HITCOUNT': '0.410', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.407', 'weapon2': '1.746', 'weapon3': '1.894', 'FRAGCOUNT': '4.000'} [2023-02-24 17:48:31,033][177155] DAMAGECOUNT value on done: 20754.0 [2023-02-24 17:48:31,125][177171] DAMAGECOUNT value on done: 21684.0 [2023-02-24 17:48:31,125][177171] Sum rewards: 0.190, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.592', 'AMMO2': '0.001', 'AMMO4': '0.003', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'ARMOR': '0.068', 'AMMO3': '0.122', 'weapon5': '0.160', 'HITCOUNT': '0.340', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.464', 'weapon2': '1.656', 'weapon3': '1.926', 'FRAGCOUNT': '6.000'} [2023-02-24 17:48:31,238][177153] Updated weights for policy 0, policy_version 5250 (0.0008) [2023-02-24 17:48:31,295][177157] DAMAGECOUNT value on done: 20828.0 [2023-02-24 17:48:31,296][177157] Sum rewards: 3.784, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.011', 'AMMO2': '0.012', 'ARMOR': '0.012', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.074', 'weapon4': '0.146', 'weapon5': '0.194', 'WEAPON5': '0.250', 'HITCOUNT': '0.300', 'HEALTH': '0.390', 'WEAPON3': '0.400', 'DAMAGECOUNT': '1.026', 'weapon2': '1.572', 'weapon3': '1.748', 'FRAGCOUNT': '2.000'} [2023-02-24 17:48:31,337][177155] DAMAGECOUNT value on done: 23355.0 [2023-02-24 17:48:31,337][177155] Sum rewards: -1.585, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.670', 'AMMO2': '0.005', 'AMMO5': '0.012', 'ARMOR': '0.024', 'AMMO4': '0.024', 'WEAPON1': '0.040', 'weapon5': '0.100', 'AMMO3': '0.106', 'WEAPON5': '0.300', 'HITCOUNT': '0.360', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.110', 'weapon2': '1.580', 'weapon3': '1.924', 'FRAGCOUNT': '2.000'} [2023-02-24 17:48:31,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 14023.6). Total num frames: 21504000. Throughput: 0: 3505.2. Samples: 5377208. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:48:31,376][177119] Avg episode reward: [(0, '0.509')] [2023-02-24 17:48:31,528][177155] DAMAGECOUNT value on done: 22740.0 [2023-02-24 17:48:31,528][177155] Sum rewards: -0.355, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.675', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.109', 'HITCOUNT': '0.110', 'weapon5': '0.116', 'ARMOR': '0.136', 'WEAPON4': '0.150', 'weapon4': '0.258', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.315', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.514', 'weapon2': '1.574'} [2023-02-24 17:48:31,818][177155] DAMAGECOUNT value on done: 21307.0 [2023-02-24 17:48:31,818][177155] Sum rewards: -0.432, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.470', 'AMMO5': '0.009', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.049', 'ARMOR': '0.050', 'weapon4': '0.120', 'weapon5': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'WEAPON5': '0.200', 'HITCOUNT': '0.440', 'WEAPON3': '0.950', 'weapon2': '1.500', 'DAMAGECOUNT': '1.635', 'weapon3': '1.878', 'FRAGCOUNT': '3.500'} [2023-02-24 17:48:34,126][177153] Updated weights for policy 0, policy_version 5260 (0.0008) [2023-02-24 17:48:34,270][177156] DAMAGECOUNT value on done: 20441.0 [2023-02-24 17:48:34,271][177156] Sum rewards: 0.013, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.569', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.014', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'weapon4': '0.202', 'weapon5': '0.252', 'HITCOUNT': '0.290', 'WEAPON5': '0.300', 'WEAPON3': '0.800', 'weapon2': '1.204', 'DAMAGECOUNT': '1.419', 'weapon3': '1.858', 'FRAGCOUNT': '3.000'} [2023-02-24 17:48:34,571][177156] DAMAGECOUNT value on done: 21638.0 [2023-02-24 17:48:34,571][177156] Sum rewards: 0.532, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.982', 'ARMOR': '0.014', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON1': '0.070', 'AMMO4': '0.087', 'AMMO3': '0.093', 'weapon4': '0.190', 'weapon5': '0.192', 'WEAPON4': '0.200', 'HITCOUNT': '0.270', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'weapon3': '1.210', 'DAMAGECOUNT': '1.338', 'weapon2': '2.118', 'FRAGCOUNT': '3.000'} [2023-02-24 17:48:34,646][177156] DAMAGECOUNT value on done: 22758.0 [2023-02-24 17:48:34,646][177156] Sum rewards: 2.466, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.403', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.066', 'weapon5': '0.072', 'ARMOR': '0.086', 'WEAPON4': '0.100', 'HITCOUNT': '0.170', 'weapon4': '0.180', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.200', 'weapon3': '1.364', 'weapon2': '1.634', 'FRAGCOUNT': '2.000'} [2023-02-24 17:48:34,945][177156] DAMAGECOUNT value on done: 24403.0 [2023-02-24 17:48:34,945][177156] Sum rewards: 4.444, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.012', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'weapon5': '0.072', 'AMMO3': '0.079', 'weapon4': '0.110', 'HEALTH': '0.127', 'AMMO4': '0.146', 'WEAPON5': '0.250', 'HITCOUNT': '0.290', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.912', 'weapon3': '1.574', 'weapon2': '1.730', 'FRAGCOUNT': '3.000'} [2023-02-24 17:48:36,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 14023.6). Total num frames: 21573632. Throughput: 0: 3507.0. Samples: 5387832. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:48:36,376][177119] Avg episode reward: [(0, '0.554')] [2023-02-24 17:48:37,051][177153] Updated weights for policy 0, policy_version 5270 (0.0009) [2023-02-24 17:48:39,983][177153] Updated weights for policy 0, policy_version 5280 (0.0008) [2023-02-24 17:48:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14023.6). Total num frames: 21643264. Throughput: 0: 3506.8. Samples: 5408830. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:48:41,376][177119] Avg episode reward: [(0, '0.554')] [2023-02-24 17:48:42,912][177153] Updated weights for policy 0, policy_version 5290 (0.0008) [2023-02-24 17:48:45,878][177153] Updated weights for policy 0, policy_version 5300 (0.0008) [2023-02-24 17:48:46,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.6, 300 sec: 14009.7). Total num frames: 21712896. Throughput: 0: 3502.3. Samples: 5429830. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:48:46,376][177119] Avg episode reward: [(0, '0.554')] [2023-02-24 17:48:47,197][177170] DAMAGECOUNT value on done: 20275.0 [2023-02-24 17:48:47,198][177170] Sum rewards: 1.292, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.715', 'AMMO2': '0.003', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.013', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'weapon5': '0.078', 'AMMO3': '0.103', 'WEAPON5': '0.150', 'weapon4': '0.190', 'HITCOUNT': '0.350', 'WEAPON3': '0.700', 'weapon2': '1.298', 'DAMAGECOUNT': '1.341', 'weapon3': '1.424', 'FRAGCOUNT': '4.000'} [2023-02-24 17:48:47,473][177158] DAMAGECOUNT value on done: 21915.0 [2023-02-24 17:48:47,474][177158] Sum rewards: 4.534, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.027', 'AMMO5': '0.007', 'AMMO2': '0.021', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'AMMO3': '0.081', 'weapon5': '0.082', 'AMMO4': '0.107', 'WEAPON5': '0.200', 'HITCOUNT': '0.290', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.140', 'weapon3': '1.648', 'weapon2': '1.912', 'FRAGCOUNT': '3.000'} [2023-02-24 17:48:47,500][177170] DAMAGECOUNT value on done: 22342.0 [2023-02-24 17:48:47,501][177170] Sum rewards: 4.194, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.090', 'AMMO4': '0.098', 'weapon4': '0.134', 'weapon5': '0.148', 'WEAPON5': '0.150', 'HITCOUNT': '0.420', 'WEAPON3': '0.500', 'HEALTH': '1.097', 'weapon2': '1.424', 'weapon3': '1.752', 'DAMAGECOUNT': '2.046', 'FRAGCOUNT': '3.000'} [2023-02-24 17:48:47,510][177170] DAMAGECOUNT value on done: 23748.0 [2023-02-24 17:48:47,511][177170] Sum rewards: 0.692, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.914', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.007', 'WEAPON1': '0.060', 'AMMO3': '0.080', 'HITCOUNT': '0.160', 'weapon5': '0.280', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.783', 'weapon3': '1.076', 'weapon2': '1.694', 'FRAGCOUNT': '2.000'} [2023-02-24 17:48:47,780][177158] DAMAGECOUNT value on done: 21473.0 [2023-02-24 17:48:47,780][177158] Sum rewards: 1.031, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.830', 'AMMO5': '0.006', 'AMMO2': '0.011', 'WEAPON1': '0.030', 'AMMO4': '0.054', 'weapon5': '0.084', 'AMMO3': '0.130', 'WEAPON5': '0.150', 'HITCOUNT': '0.280', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.278', 'weapon2': '1.390', 'weapon3': '1.898', 'FRAGCOUNT': '4.000'} [2023-02-24 17:48:47,814][177170] DAMAGECOUNT value on done: 25059.0 [2023-02-24 17:48:47,814][177170] Sum rewards: -0.083, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.005', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'ARMOR': '0.044', 'AMMO3': '0.127', 'weapon5': '0.208', 'HITCOUNT': '0.310', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'weapon3': '1.286', 'DAMAGECOUNT': '1.356', 'FRAGCOUNT': '2.000', 'weapon2': '2.130'} [2023-02-24 17:48:48,104][177172] DAMAGECOUNT value on done: 20186.0 [2023-02-24 17:48:48,386][177158] DAMAGECOUNT value on done: 19619.0 [2023-02-24 17:48:48,386][177158] Sum rewards: -3.634, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.570', 'AMMO4': '-0.066', 'AMMO2': '-0.013', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'weapon5': '0.088', 'ARMOR': '0.108', 'AMMO3': '0.168', 'HITCOUNT': '0.200', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.950', 'weapon2': '1.410', 'weapon3': '1.946', 'FRAGCOUNT': '3.000'} [2023-02-24 17:48:48,403][177172] DAMAGECOUNT value on done: 21100.0 [2023-02-24 17:48:48,404][177172] Sum rewards: 1.326, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.328', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'weapon5': '0.006', 'WEAPON1': '0.010', 'ARMOR': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'HITCOUNT': '0.410', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.302', 'weapon2': '1.552', 'weapon3': '1.992', 'FRAGCOUNT': '3.000'} [2023-02-24 17:48:48,681][177158] DAMAGECOUNT value on done: 21133.0 [2023-02-24 17:48:48,681][177158] Sum rewards: -1.046, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.496', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'AMMO3': '0.098', 'ARMOR': '0.104', 'weapon5': '0.122', 'WEAPON5': '0.150', 'HITCOUNT': '0.390', 'WEAPON3': '0.550', 'weapon3': '1.272', 'DAMAGECOUNT': '1.797', 'weapon2': '1.966', 'FRAGCOUNT': '2.000'} [2023-02-24 17:48:48,751][177154] DAMAGECOUNT value on done: 23335.0 [2023-02-24 17:48:48,832][177153] Updated weights for policy 0, policy_version 5310 (0.0009) [2023-02-24 17:48:49,052][177154] DAMAGECOUNT value on done: 20979.0 [2023-02-24 17:48:49,052][177154] Sum rewards: -0.249, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.826', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.050', 'ARMOR': '0.076', 'AMMO4': '0.087', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.164', 'weapon4': '0.180', 'WEAPON5': '0.250', 'HITCOUNT': '0.270', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.068', 'DAMAGECOUNT': '1.407', 'weapon3': '1.848'} [2023-02-24 17:48:49,189][177172] DAMAGECOUNT value on done: 22039.0 [2023-02-24 17:48:49,190][177172] Sum rewards: 0.211, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.882', 'AMMO2': '0.011', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'weapon5': '0.046', 'AMMO4': '0.053', 'ARMOR': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'weapon4': '0.190', 'HITCOUNT': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'weapon2': '1.132', 'DAMAGECOUNT': '1.209', 'FRAGCOUNT': '2.000', 'weapon3': '2.174'} [2023-02-24 17:48:49,289][177154] DAMAGECOUNT value on done: 21799.0 [2023-02-24 17:48:49,289][177154] Sum rewards: -0.715, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.170', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO5': '0.020', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'weapon5': '0.124', 'weapon4': '0.198', 'HITCOUNT': '0.260', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.218', 'weapon2': '1.394', 'weapon3': '1.578', 'FRAGCOUNT': '2.000'} [2023-02-24 17:48:49,492][177172] DAMAGECOUNT value on done: 19637.0 [2023-02-24 17:48:49,492][177172] Sum rewards: -2.158, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.185', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'weapon5': '0.034', 'ARMOR': '0.040', 'AMMO4': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.129', 'HITCOUNT': '0.290', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.870', 'FRAGCOUNT': '1.000', 'weapon3': '1.532', 'weapon2': '1.592'} [2023-02-24 17:48:49,570][177171] DAMAGECOUNT value on done: 19968.0 [2023-02-24 17:48:49,571][177171] Sum rewards: -0.980, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-2.056', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.010', 'ARMOR': '0.040', 'WEAPON1': '0.060', 'AMMO3': '0.106', 'weapon5': '0.172', 'HITCOUNT': '0.200', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.555', 'WEAPON3': '0.600', 'weapon3': '0.980', 'FRAGCOUNT': '1.000', 'weapon2': '2.296'} [2023-02-24 17:48:49,597][177154] DAMAGECOUNT value on done: 22590.0 [2023-02-24 17:48:49,597][177154] Sum rewards: 2.929, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.120', 'ARMOR': '0.004', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.026', 'WEAPON1': '0.030', 'AMMO3': '0.123', 'WEAPON5': '0.150', 'weapon5': '0.198', 'HITCOUNT': '0.280', 'WEAPON3': '0.650', 'weapon2': '1.302', 'DAMAGECOUNT': '1.317', 'weapon3': '1.956', 'FRAGCOUNT': '3.000'} [2023-02-24 17:48:49,860][177157] DAMAGECOUNT value on done: 23933.0 [2023-02-24 17:48:49,861][177157] Sum rewards: -2.847, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.309', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.012', 'WEAPON1': '0.050', 'weapon5': '0.064', 'WEAPON4': '0.100', 'ARMOR': '0.118', 'weapon4': '0.138', 'AMMO3': '0.146', 'WEAPON5': '0.250', 'HITCOUNT': '0.350', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.020', 'weapon2': '1.406', 'weapon3': '1.890', 'FRAGCOUNT': '2.000'} [2023-02-24 17:48:49,880][177171] DAMAGECOUNT value on done: 21204.0 [2023-02-24 17:48:49,880][177171] Sum rewards: 5.071, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.052', 'AMMO3': '0.132', 'WEAPON5': '0.150', 'weapon5': '0.168', 'HEALTH': '0.172', 'WEAPON3': '0.550', 'HITCOUNT': '0.610', 'weapon2': '1.626', 'weapon3': '1.850', 'DAMAGECOUNT': '2.475', 'FRAGCOUNT': '4.000'} [2023-02-24 17:48:49,988][177171] DAMAGECOUNT value on done: 20225.0 [2023-02-24 17:48:49,989][177171] Sum rewards: 1.399, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.273', 'AMMO5': '0.014', 'AMMO2': '0.019', 'ARMOR': '0.044', 'WEAPON1': '0.050', 'AMMO4': '0.094', 'AMMO3': '0.144', 'weapon5': '0.160', 'HITCOUNT': '0.290', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.035', 'weapon2': '1.042', 'weapon3': '2.230', 'FRAGCOUNT': '3.000'} [2023-02-24 17:48:50,002][177157] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 17:48:50,157][177157] DAMAGECOUNT value on done: 22721.0 [2023-02-24 17:48:50,157][177157] Sum rewards: 5.554, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.415', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO3': '0.040', 'WEAPON1': '0.050', 'AMMO4': '0.078', 'weapon5': '0.252', 'HITCOUNT': '0.260', 'WEAPON3': '0.300', 'WEAPON5': '0.350', 'weapon3': '1.186', 'DAMAGECOUNT': '1.245', 'weapon2': '1.930', 'FRAGCOUNT': '4.000'} [2023-02-24 17:48:50,167][177157] DAMAGECOUNT value on done: 23385.0 [2023-02-24 17:48:50,167][177157] Sum rewards: 0.558, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.216', 'AMMO5': '0.012', 'AMMO2': '0.015', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.137', 'weapon4': '0.190', 'WEAPON5': '0.200', 'HITCOUNT': '0.280', 'weapon5': '0.302', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.170', 'weapon3': '1.282', 'weapon2': '1.526', 'FRAGCOUNT': '3.000'} [2023-02-24 17:48:50,178][177155] DAMAGECOUNT value on done: 21203.0 [2023-02-24 17:48:50,178][177155] Sum rewards: 0.801, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.386', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'weapon4': '0.052', 'weapon5': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'WEAPON5': '0.150', 'HITCOUNT': '0.450', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.347', 'weapon2': '1.352', 'weapon3': '1.700', 'FRAGCOUNT': '3.000'} [2023-02-24 17:48:50,289][177171] DAMAGECOUNT value on done: 22280.0 [2023-02-24 17:48:50,289][177171] Sum rewards: 4.145, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.226', 'AMMO5': '0.009', 'AMMO2': '0.009', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'AMMO4': '0.047', 'AMMO3': '0.108', 'weapon5': '0.174', 'WEAPON5': '0.200', 'HITCOUNT': '0.340', 'WEAPON3': '0.750', 'weapon2': '0.800', 'DAMAGECOUNT': '1.788', 'weapon3': '2.574', 'FRAGCOUNT': '5.000'} [2023-02-24 17:48:50,469][177157] DAMAGECOUNT value on done: 21108.0 [2023-02-24 17:48:50,470][177157] Sum rewards: 1.989, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.860', 'AMMO2': '0.007', 'AMMO5': '0.007', 'ARMOR': '0.024', 'WEAPON1': '0.030', 'AMMO4': '0.033', 'AMMO3': '0.085', 'weapon5': '0.120', 'WEAPON5': '0.200', 'HITCOUNT': '0.250', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.810', 'weapon3': '1.162', 'weapon2': '1.670', 'FRAGCOUNT': '4.000'} [2023-02-24 17:48:50,479][177155] DAMAGECOUNT value on done: 23535.0 [2023-02-24 17:48:50,762][177155] DAMAGECOUNT value on done: 22894.0 [2023-02-24 17:48:51,059][177155] DAMAGECOUNT value on done: 21910.0 [2023-02-24 17:48:51,060][177155] Sum rewards: 4.537, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.916', 'AMMO5': '0.012', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'weapon4': '0.072', 'AMMO3': '0.111', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'weapon5': '0.188', 'WEAPON5': '0.300', 'HITCOUNT': '0.310', 'WEAPON3': '0.650', 'weapon2': '1.552', 'DAMAGECOUNT': '1.809', 'weapon3': '1.852', 'FRAGCOUNT': '5.000'} [2023-02-24 17:48:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 21782528. Throughput: 0: 3499.6. Samples: 5440246. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 17:48:51,376][177119] Avg episode reward: [(0, '0.642')] [2023-02-24 17:48:51,716][177153] Updated weights for policy 0, policy_version 5320 (0.0008) [2023-02-24 17:48:53,565][177156] DAMAGECOUNT value on done: 20986.0 [2023-02-24 17:48:53,565][177156] Sum rewards: -0.033, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.316', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.031', 'ARMOR': '0.040', 'WEAPON1': '0.060', 'AMMO3': '0.090', 'weapon5': '0.118', 'WEAPON5': '0.300', 'HITCOUNT': '0.330', 'WEAPON3': '0.550', 'weapon3': '1.594', 'DAMAGECOUNT': '1.635', 'weapon2': '1.766', 'FRAGCOUNT': '2.000'} [2023-02-24 17:48:53,879][177156] DAMAGECOUNT value on done: 21836.0 [2023-02-24 17:48:53,880][177156] Sum rewards: 0.714, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.660', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.009', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'AMMO3': '0.080', 'weapon5': '0.088', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.180', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.594', 'weapon3': '1.190', 'weapon2': '1.562', 'FRAGCOUNT': '2.000'} [2023-02-24 17:48:53,987][177156] DAMAGECOUNT value on done: 23319.0 [2023-02-24 17:48:53,987][177156] Sum rewards: 4.307, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.010', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'AMMO4': '0.098', 'weapon5': '0.242', 'WEAPON5': '0.250', 'HEALTH': '0.288', 'HITCOUNT': '0.330', 'WEAPON3': '0.350', 'weapon3': '1.276', 'DAMAGECOUNT': '1.683', 'weapon2': '1.930', 'FRAGCOUNT': '3.000'} [2023-02-24 17:48:54,284][177156] DAMAGECOUNT value on done: 24693.0 [2023-02-24 17:48:54,284][177156] Sum rewards: 1.109, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.297', 'AMMO5': '0.007', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'ARMOR': '0.052', 'AMMO3': '0.066', 'weapon5': '0.114', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.184', 'WEAPON5': '0.200', 'HITCOUNT': '0.260', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.870', 'weapon3': '1.410', 'weapon2': '1.508', 'FRAGCOUNT': '2.000'} [2023-02-24 17:48:54,643][177153] Updated weights for policy 0, policy_version 5330 (0.0008) [2023-02-24 17:48:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.6, 300 sec: 14009.7). Total num frames: 21852160. Throughput: 0: 3498.9. Samples: 5461262. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:48:56,376][177119] Avg episode reward: [(0, '0.640')] [2023-02-24 17:48:56,393][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000005336_21856256.pth... [2023-02-24 17:48:56,450][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000004515_18493440.pth [2023-02-24 17:48:57,564][177153] Updated weights for policy 0, policy_version 5340 (0.0008) [2023-02-24 17:49:00,490][177153] Updated weights for policy 0, policy_version 5350 (0.0008) [2023-02-24 17:49:01,376][177119] Fps is (10 sec: 14336.1, 60 sec: 14062.9, 300 sec: 14023.6). Total num frames: 21925888. Throughput: 0: 3495.7. Samples: 5482162. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:49:01,376][177119] Avg episode reward: [(0, '0.640')] [2023-02-24 17:49:03,405][177153] Updated weights for policy 0, policy_version 5360 (0.0008) [2023-02-24 17:49:06,331][177153] Updated weights for policy 0, policy_version 5370 (0.0008) [2023-02-24 17:49:06,376][177119] Fps is (10 sec: 14336.2, 60 sec: 13994.7, 300 sec: 14023.6). Total num frames: 21995520. Throughput: 0: 3496.1. Samples: 5492688. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:49:06,376][177119] Avg episode reward: [(0, '0.640')] [2023-02-24 17:49:06,412][177170] DAMAGECOUNT value on done: 20792.0 [2023-02-24 17:49:06,413][177170] Sum rewards: 1.874, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.328', 'AMMO2': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'ARMOR': '0.057', 'AMMO3': '0.085', 'weapon4': '0.194', 'WEAPON5': '0.250', 'weapon5': '0.254', 'HITCOUNT': '0.370', 'WEAPON3': '0.550', 'weapon3': '1.544', 'DAMAGECOUNT': '1.551', 'weapon2': '1.698', 'FRAGCOUNT': '3.000'} [2023-02-24 17:49:06,655][177158] DAMAGECOUNT value on done: 22399.0 [2023-02-24 17:49:06,656][177158] Sum rewards: 0.678, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.794', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.026', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.093', 'AMMO4': '0.128', 'weapon4': '0.174', 'weapon5': '0.190', 'HITCOUNT': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.214', 'DAMAGECOUNT': '1.452', 'weapon3': '1.862'} [2023-02-24 17:49:06,709][177170] DAMAGECOUNT value on done: 24104.0 [2023-02-24 17:49:06,710][177170] Sum rewards: 1.649, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.538', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.016', 'ARMOR': '0.036', 'WEAPON1': '0.040', 'AMMO3': '0.081', 'weapon5': '0.162', 'WEAPON5': '0.250', 'HITCOUNT': '0.260', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.068', 'weapon2': '1.278', 'weapon3': '1.730', 'FRAGCOUNT': '2.000'} [2023-02-24 17:49:06,721][177170] DAMAGECOUNT value on done: 22901.0 [2023-02-24 17:49:06,722][177170] Sum rewards: -0.574, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.482', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.016', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'AMMO3': '0.100', 'HITCOUNT': '0.260', 'weapon5': '0.266', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.500', 'weapon3': '1.646', 'DAMAGECOUNT': '1.677', 'weapon2': '1.878'} [2023-02-24 17:49:06,964][177158] DAMAGECOUNT value on done: 21700.0 [2023-02-24 17:49:06,964][177158] Sum rewards: 0.792, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.507', 'AMMO4': '-0.056', 'AMMO2': '-0.011', 'WEAPON4': '0.050', 'AMMO3': '0.090', 'weapon4': '0.120', 'HITCOUNT': '0.170', 'ARMOR': '0.545', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.681', 'weapon3': '1.204', 'FRAGCOUNT': '2.000', 'weapon2': '2.106'} [2023-02-24 17:49:07,019][177170] DAMAGECOUNT value on done: 25425.0 [2023-02-24 17:49:07,019][177170] Sum rewards: 4.358, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.370', 'AMMO5': '0.010', 'AMMO2': '0.017', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.064', 'AMMO4': '0.083', 'weapon5': '0.130', 'weapon4': '0.178', 'HITCOUNT': '0.270', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.098', 'weapon3': '1.502', 'weapon2': '1.884', 'FRAGCOUNT': '4.000'} [2023-02-24 17:49:07,373][177172] DAMAGECOUNT value on done: 20446.0 [2023-02-24 17:49:07,374][177172] Sum rewards: 2.174, reward structure: {'DEATHCOUNT': '-6.000', 'weapon5': '0.006', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'AMMO3': '0.093', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'HITCOUNT': '0.220', 'WEAPON3': '0.500', 'HEALTH': '0.731', 'DAMAGECOUNT': '0.780', 'weapon3': '1.584', 'weapon2': '1.906', 'FRAGCOUNT': '2.000'} [2023-02-24 17:49:07,586][177158] DAMAGECOUNT value on done: 19965.0 [2023-02-24 17:49:07,586][177158] Sum rewards: 2.889, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.660', 'AMMO2': '0.004', 'AMMO5': '0.015', 'AMMO4': '0.020', 'AMMO3': '0.035', 'WEAPON4': '0.050', 'weapon4': '0.052', 'WEAPON1': '0.080', 'HITCOUNT': '0.140', 'WEAPON3': '0.250', 'weapon5': '0.442', 'WEAPON5': '0.500', 'weapon3': '0.742', 'DAMAGECOUNT': '1.017', 'weapon2': '2.452', 'FRAGCOUNT': '3.000'} [2023-02-24 17:49:07,670][177172] DAMAGECOUNT value on done: 21683.0 [2023-02-24 17:49:07,671][177172] Sum rewards: 2.706, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '0.002', 'AMMO5': '0.015', 'AMMO2': '0.024', 'WEAPON1': '0.050', 'AMMO3': '0.110', 'AMMO4': '0.119', 'weapon5': '0.226', 'HITCOUNT': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.480', 'DAMAGECOUNT': '1.749', 'weapon3': '2.030', 'FRAGCOUNT': '3.000'} [2023-02-24 17:49:07,857][177154] DAMAGECOUNT value on done: 24114.0 [2023-02-24 17:49:07,857][177154] Sum rewards: 3.019, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.820', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.037', 'WEAPON1': '0.050', 'weapon4': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'weapon5': '0.226', 'WEAPON5': '0.250', 'HITCOUNT': '0.450', 'WEAPON3': '0.750', 'weapon2': '1.694', 'weapon3': '1.772', 'DAMAGECOUNT': '2.337', 'FRAGCOUNT': '6.000'} [2023-02-24 17:49:07,879][177158] DAMAGECOUNT value on done: 21628.0 [2023-02-24 17:49:07,879][177158] Sum rewards: 4.916, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.340', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon7': '0.038', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.079', 'weapon5': '0.082', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon4': '0.118', 'AMMO4': '0.121', 'WEAPON5': '0.250', 'HITCOUNT': '0.260', 'WEAPON3': '0.500', 'weapon2': '1.342', 'DAMAGECOUNT': '1.485', 'weapon3': '1.546', 'FRAGCOUNT': '5.000'} [2023-02-24 17:49:08,159][177154] DAMAGECOUNT value on done: 21341.0 [2023-02-24 17:49:08,159][177154] Sum rewards: 1.515, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.170', 'AMMO2': '0.005', 'AMMO5': '0.013', 'ARMOR': '0.020', 'AMMO4': '0.023', 'WEAPON1': '0.040', 'weapon5': '0.068', 'AMMO3': '0.125', 'HITCOUNT': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.086', 'weapon2': '1.758', 'weapon3': '1.948', 'FRAGCOUNT': '3.000'} [2023-02-24 17:49:08,380][177154] DAMAGECOUNT value on done: 22164.0 [2023-02-24 17:49:08,381][177154] Sum rewards: 2.796, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.344', 'AMMO2': '0.010', 'AMMO5': '0.014', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.108', 'AMMO3': '0.124', 'HITCOUNT': '0.180', 'weapon5': '0.188', 'weapon4': '0.220', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.095', 'weapon2': '1.216', 'weapon3': '1.564', 'FRAGCOUNT': '3.000'} [2023-02-24 17:49:08,464][177172] DAMAGECOUNT value on done: 22578.0 [2023-02-24 17:49:08,465][177172] Sum rewards: 2.017, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.950', 'AMMO2': '0.004', 'AMMO5': '0.014', 'AMMO4': '0.017', 'ARMOR': '0.060', 'WEAPON1': '0.060', 'weapon5': '0.074', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'weapon4': '0.226', 'WEAPON5': '0.300', 'HITCOUNT': '0.430', 'WEAPON3': '0.850', 'weapon2': '0.930', 'DAMAGECOUNT': '1.617', 'weapon3': '2.362', 'FRAGCOUNT': '4.000'} [2023-02-24 17:49:08,673][177154] DAMAGECOUNT value on done: 23011.0 [2023-02-24 17:49:08,674][177154] Sum rewards: 3.797, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.724', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO3': '0.060', 'WEAPON1': '0.060', 'ARMOR': '0.112', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'weapon5': '0.222', 'weapon4': '0.258', 'WEAPON5': '0.300', 'HITCOUNT': '0.340', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.263', 'weapon3': '1.440', 'weapon2': '1.688', 'FRAGCOUNT': '4.000'} [2023-02-24 17:49:08,759][177172] DAMAGECOUNT value on done: 20405.0 [2023-02-24 17:49:08,759][177172] Sum rewards: 4.119, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.102', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'ARMOR': '0.030', 'AMMO3': '0.082', 'AMMO4': '0.083', 'WEAPON5': '0.150', 'weapon5': '0.178', 'HITCOUNT': '0.220', 'WEAPON3': '0.500', 'weapon3': '1.602', 'weapon2': '2.020', 'DAMAGECOUNT': '2.304', 'FRAGCOUNT': '3.000'} [2023-02-24 17:49:08,839][177171] DAMAGECOUNT value on done: 20384.0 [2023-02-24 17:49:08,840][177171] Sum rewards: 1.514, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.710', 'AMMO2': '0.012', 'AMMO5': '0.012', 'ARMOR': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'weapon7': '0.064', 'WEAPON1': '0.070', 'AMMO3': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.118', 'weapon5': '0.180', 'HITCOUNT': '0.230', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.248', 'weapon3': '1.436', 'weapon2': '1.980', 'FRAGCOUNT': '3.000'} [2023-02-24 17:49:09,126][177157] DAMAGECOUNT value on done: 24302.0 [2023-02-24 17:49:09,126][177157] Sum rewards: 0.573, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.358', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.007', 'ARMOR': '0.029', 'WEAPON1': '0.050', 'AMMO3': '0.100', 'HITCOUNT': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.164', 'weapon4': '0.184', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.107', 'weapon3': '1.536', 'weapon2': '1.674', 'FRAGCOUNT': '2.000'} [2023-02-24 17:49:09,136][177171] DAMAGECOUNT value on done: 21426.0 [2023-02-24 17:49:09,136][177171] Sum rewards: -3.260, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.046', 'AMMO5': '0.007', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'AMMO3': '0.080', 'weapon5': '0.114', 'AMMO4': '0.132', 'HITCOUNT': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.420', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.666', 'FRAGCOUNT': '1.000', 'weapon3': '1.426', 'weapon2': '1.714'} [2023-02-24 17:49:09,247][177171] DAMAGECOUNT value on done: 20726.0 [2023-02-24 17:49:09,247][177171] Sum rewards: 4.588, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.933', 'AMMO5': '0.014', 'ARMOR': '0.016', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.085', 'AMMO3': '0.097', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon4': '0.150', 'weapon5': '0.178', 'WEAPON5': '0.400', 'HITCOUNT': '0.490', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.503', 'weapon3': '1.586', 'weapon2': '1.774', 'FRAGCOUNT': '5.000'} [2023-02-24 17:49:09,270][177153] Updated weights for policy 0, policy_version 5380 (0.0008) [2023-02-24 17:49:09,422][177157] DAMAGECOUNT value on done: 23101.0 [2023-02-24 17:49:09,423][177157] Sum rewards: -2.410, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.174', 'AMMO5': '0.014', 'AMMO2': '0.024', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'weapon5': '0.062', 'AMMO3': '0.111', 'AMMO4': '0.119', 'HITCOUNT': '0.240', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '0.650', 'weapon4': '0.826', 'weapon3': '1.138', 'DAMAGECOUNT': '1.140', 'weapon2': '1.368', 'FRAGCOUNT': '2.000'} [2023-02-24 17:49:09,432][177157] DAMAGECOUNT value on done: 23754.0 [2023-02-24 17:49:09,432][177157] Sum rewards: 1.375, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.212', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'weapon4': '0.040', 'WEAPON4': '0.050', 'ARMOR': '0.056', 'weapon5': '0.070', 'AMMO3': '0.108', 'WEAPON5': '0.250', 'HITCOUNT': '0.330', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.107', 'weapon3': '1.372', 'weapon2': '2.354', 'FRAGCOUNT': '3.000'} [2023-02-24 17:49:09,437][177155] DAMAGECOUNT value on done: 21501.0 [2023-02-24 17:49:09,437][177155] Sum rewards: -0.413, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.290', 'AMMO2': '0.005', 'AMMO5': '0.009', 'AMMO4': '0.023', 'ARMOR': '0.040', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.086', 'weapon5': '0.158', 'weapon4': '0.188', 'HITCOUNT': '0.240', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.894', 'weapon3': '1.232', 'weapon2': '1.862', 'FRAGCOUNT': '2.000'} [2023-02-24 17:49:09,556][177171] DAMAGECOUNT value on done: 22980.0 [2023-02-24 17:49:09,557][177171] Sum rewards: -1.867, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.924', 'AMMO2': '0.004', 'AMMO5': '0.012', 'AMMO4': '0.022', 'ARMOR': '0.024', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.102', 'AMMO3': '0.144', 'weapon5': '0.148', 'WEAPON5': '0.350', 'HITCOUNT': '0.590', 'WEAPON3': '0.950', 'weapon2': '1.302', 'DAMAGECOUNT': '2.100', 'weapon3': '2.218', 'FRAGCOUNT': '4.000'} [2023-02-24 17:49:09,719][177157] DAMAGECOUNT value on done: 21449.0 [2023-02-24 17:49:09,720][177157] Sum rewards: -0.175, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.362', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.021', 'WEAPON1': '0.050', 'weapon4': '0.084', 'WEAPON4': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.108', 'weapon5': '0.250', 'HITCOUNT': '0.280', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.023', 'weapon2': '1.394', 'weapon3': '1.740', 'FRAGCOUNT': '2.500'} [2023-02-24 17:49:09,731][177155] DAMAGECOUNT value on done: 24119.0 [2023-02-24 17:49:09,731][177155] Sum rewards: -2.314, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.058', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'AMMO4': '0.064', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.210', 'weapon5': '0.254', 'weapon4': '0.332', 'WEAPON3': '0.500', 'weapon3': '0.962', 'DAMAGECOUNT': '1.743', 'weapon2': '1.888', 'FRAGCOUNT': '3.000'} [2023-02-24 17:49:10,003][177155] DAMAGECOUNT value on done: 23486.0 [2023-02-24 17:49:10,003][177155] Sum rewards: 4.359, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.515', 'AMMO5': '0.010', 'AMMO2': '0.014', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'AMMO3': '0.062', 'AMMO4': '0.068', 'weapon5': '0.212', 'WEAPON5': '0.250', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'weapon3': '1.632', 'weapon2': '1.740', 'DAMAGECOUNT': '1.776', 'FRAGCOUNT': '2.000'} [2023-02-24 17:49:10,319][177155] DAMAGECOUNT value on done: 22433.0 [2023-02-24 17:49:10,319][177155] Sum rewards: 2.878, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.926', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.003', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO3': '0.076', 'HITCOUNT': '0.330', 'WEAPON3': '0.450', 'weapon3': '1.058', 'DAMAGECOUNT': '1.569', 'weapon2': '2.210', 'FRAGCOUNT': '4.000'} [2023-02-24 17:49:11,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 22065152. Throughput: 0: 3495.9. Samples: 5513632. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:49:11,376][177119] Avg episode reward: [(0, '1.100')] [2023-02-24 17:49:11,377][177140] Saving new best policy, reward=1.100! [2023-02-24 17:49:12,196][177153] Updated weights for policy 0, policy_version 5390 (0.0008) [2023-02-24 17:49:12,783][177156] DAMAGECOUNT value on done: 21402.0 [2023-02-24 17:49:12,784][177156] Sum rewards: -2.211, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.610', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.012', 'WEAPON1': '0.030', 'AMMO3': '0.070', 'weapon5': '0.080', 'ARMOR': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.192', 'HITCOUNT': '0.240', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.248', 'weapon3': '1.368', 'weapon2': '1.552'} [2023-02-24 17:49:13,083][177156] DAMAGECOUNT value on done: 22195.0 [2023-02-24 17:49:13,083][177156] Sum rewards: 0.209, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.066', 'AMMO2': '0.013', 'AMMO5': '0.017', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.107', 'HITCOUNT': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.232', 'weapon4': '0.278', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.077', 'weapon3': '1.356', 'weapon2': '1.888', 'FRAGCOUNT': '3.000'} [2023-02-24 17:49:13,207][177156] DAMAGECOUNT value on done: 23618.0 [2023-02-24 17:49:13,208][177156] Sum rewards: -1.299, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.994', 'AMMO2': '0.008', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.041', 'weapon5': '0.062', 'AMMO3': '0.101', 'ARMOR': '0.140', 'HITCOUNT': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.510', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.897', 'weapon2': '1.204', 'weapon3': '1.406', 'FRAGCOUNT': '3.000'} [2023-02-24 17:49:13,503][177156] DAMAGECOUNT value on done: 24896.0 [2023-02-24 17:49:15,123][177153] Updated weights for policy 0, policy_version 5400 (0.0008) [2023-02-24 17:49:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 22134784. Throughput: 0: 3498.5. Samples: 5534640. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:49:16,376][177119] Avg episode reward: [(0, '0.937')] [2023-02-24 17:49:18,039][177153] Updated weights for policy 0, policy_version 5410 (0.0009) [2023-02-24 17:49:20,962][177153] Updated weights for policy 0, policy_version 5420 (0.0008) [2023-02-24 17:49:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 22204416. Throughput: 0: 3496.4. Samples: 5545172. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:49:21,376][177119] Avg episode reward: [(0, '0.937')] [2023-02-24 17:49:23,893][177153] Updated weights for policy 0, policy_version 5430 (0.0009) [2023-02-24 17:49:25,578][177170] DAMAGECOUNT value on done: 21167.0 [2023-02-24 17:49:25,579][177170] Sum rewards: -0.458, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.542', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.015', 'WEAPON1': '0.030', 'ARMOR': '0.044', 'WEAPON4': '0.050', 'weapon5': '0.074', 'weapon4': '0.114', 'AMMO3': '0.121', 'WEAPON5': '0.150', 'HITCOUNT': '0.330', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.125', 'weapon2': '1.490', 'FRAGCOUNT': '2.000', 'weapon3': '2.032'} [2023-02-24 17:49:25,864][177158] DAMAGECOUNT value on done: 22823.0 [2023-02-24 17:49:25,865][177158] Sum rewards: 3.553, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'ARMOR': '0.040', 'AMMO4': '0.073', 'AMMO3': '0.077', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'HEALTH': '0.267', 'HITCOUNT': '0.330', 'weapon4': '0.358', 'WEAPON3': '0.450', 'weapon3': '1.248', 'DAMAGECOUNT': '1.272', 'weapon2': '1.318', 'FRAGCOUNT': '3.000'} [2023-02-24 17:49:25,876][177170] DAMAGECOUNT value on done: 24527.0 [2023-02-24 17:49:25,876][177170] Sum rewards: 0.569, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.876', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO5': '0.016', 'WEAPON1': '0.050', 'AMMO3': '0.086', 'weapon5': '0.196', 'HITCOUNT': '0.330', 'ARMOR': '0.445', 'WEAPON5': '0.450', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.269', 'weapon2': '1.660', 'weapon3': '1.904'} [2023-02-24 17:49:25,888][177170] DAMAGECOUNT value on done: 23276.0 [2023-02-24 17:49:25,889][177170] Sum rewards: -1.311, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.004', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO2': '0.047', 'ARMOR': '0.068', 'AMMO3': '0.136', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'AMMO4': '0.233', 'weapon5': '0.258', 'WEAPON5': '0.300', 'weapon4': '0.506', 'WEAPON3': '0.700', 'weapon2': '1.022', 'DAMAGECOUNT': '1.125', 'weapon3': '1.698', 'FRAGCOUNT': '2.000'} [2023-02-24 17:49:26,162][177158] DAMAGECOUNT value on done: 22045.0 [2023-02-24 17:49:26,162][177158] Sum rewards: 0.845, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.740', 'AMMO2': '0.001', 'weapon7': '0.002', 'AMMO4': '0.007', 'ARMOR': '0.076', 'AMMO3': '0.132', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.230', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.035', 'weapon2': '1.104', 'weapon3': '2.248', 'FRAGCOUNT': '3.000'} [2023-02-24 17:49:26,180][177170] DAMAGECOUNT value on done: 25696.0 [2023-02-24 17:49:26,180][177170] Sum rewards: 4.773, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.990', 'AMMO5': '0.009', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'AMMO4': '0.081', 'AMMO3': '0.082', 'weapon5': '0.092', 'WEAPON5': '0.200', 'HITCOUNT': '0.320', 'ARMOR': '0.499', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.813', 'weapon3': '1.290', 'weapon2': '2.220', 'FRAGCOUNT': '4.000'} [2023-02-24 17:49:26,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 22274048. Throughput: 0: 3497.0. Samples: 5566194. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:49:26,376][177119] Avg episode reward: [(0, '0.854')] [2023-02-24 17:49:26,563][177172] DAMAGECOUNT value on done: 20866.0 [2023-02-24 17:49:26,563][177172] Sum rewards: 2.340, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.728', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.007', 'ARMOR': '0.012', 'WEAPON1': '0.040', 'AMMO3': '0.126', 'weapon5': '0.164', 'WEAPON5': '0.250', 'HITCOUNT': '0.340', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.260', 'weapon3': '1.438', 'FRAGCOUNT': '2.000', 'weapon2': '2.080'} [2023-02-24 17:49:26,804][177158] DAMAGECOUNT value on done: 20219.0 [2023-02-24 17:49:26,805][177158] Sum rewards: -4.018, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.818', 'FRAGCOUNT': '-1.500', 'AMMO2': '0.003', 'AMMO5': '0.013', 'AMMO4': '0.014', 'ARMOR': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.112', 'weapon5': '0.178', 'HITCOUNT': '0.200', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.762', 'WEAPON3': '0.800', 'weapon2': '1.778', 'weapon3': '1.786'} [2023-02-24 17:49:26,851][177153] Updated weights for policy 0, policy_version 5440 (0.0008) [2023-02-24 17:49:26,875][177172] DAMAGECOUNT value on done: 21979.0 [2023-02-24 17:49:26,875][177172] Sum rewards: -3.617, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.539', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.048', 'AMMO2': '-0.009', 'AMMO5': '0.018', 'WEAPON1': '0.050', 'ARMOR': '0.072', 'AMMO3': '0.125', 'HITCOUNT': '0.210', 'weapon5': '0.210', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.888', 'weapon2': '1.504', 'weapon3': '1.702'} [2023-02-24 17:49:27,078][177154] DAMAGECOUNT value on done: 24214.0 [2023-02-24 17:49:27,102][177158] DAMAGECOUNT value on done: 21759.0 [2023-02-24 17:49:27,374][177154] DAMAGECOUNT value on done: 21640.0 [2023-02-24 17:49:27,374][177154] Sum rewards: -0.986, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.749', 'AMMO5': '0.012', 'AMMO2': '0.023', 'WEAPON1': '0.060', 'AMMO3': '0.085', 'AMMO4': '0.117', 'weapon5': '0.236', 'HITCOUNT': '0.290', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.897', 'weapon3': '1.228', 'FRAGCOUNT': '2.000', 'weapon2': '2.214'} [2023-02-24 17:49:27,585][177154] DAMAGECOUNT value on done: 22356.0 [2023-02-24 17:49:27,674][177172] DAMAGECOUNT value on done: 22892.0 [2023-02-24 17:49:27,675][177172] Sum rewards: -0.722, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.370', 'AMMO4': '-0.066', 'AMMO2': '-0.013', 'AMMO5': '0.007', 'WEAPON1': '0.040', 'ARMOR': '0.052', 'weapon5': '0.076', 'AMMO3': '0.098', 'WEAPON5': '0.200', 'HITCOUNT': '0.210', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.942', 'FRAGCOUNT': '1.000', 'weapon3': '1.378', 'weapon2': '1.474'} [2023-02-24 17:49:27,881][177154] DAMAGECOUNT value on done: 23356.0 [2023-02-24 17:49:27,882][177154] Sum rewards: 0.943, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.364', 'AMMO2': '0.007', 'AMMO5': '0.022', 'AMMO4': '0.032', 'WEAPON1': '0.080', 'AMMO3': '0.127', 'weapon5': '0.204', 'HITCOUNT': '0.210', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.035', 'weapon2': '1.162', 'weapon3': '2.228', 'FRAGCOUNT': '2.500'} [2023-02-24 17:49:27,960][177171] DAMAGECOUNT value on done: 20918.0 [2023-02-24 17:49:27,960][177171] Sum rewards: 6.182, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.612', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.011', 'WEAPON1': '0.050', 'weapon7': '0.058', 'AMMO3': '0.081', 'weapon5': '0.098', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.190', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.340', 'WEAPON3': '0.550', 'weapon2': '1.008', 'weapon3': '1.264', 'DAMAGECOUNT': '1.602', 'FRAGCOUNT': '6.000'} [2023-02-24 17:49:27,970][177172] DAMAGECOUNT value on done: 20456.0 [2023-02-24 17:49:27,971][177172] Sum rewards: -4.276, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'AMMO2': '0.013', 'AMMO5': '0.015', 'WEAPON1': '0.060', 'HITCOUNT': '0.060', 'HEALTH': '0.063', 'AMMO4': '0.065', 'AMMO3': '0.073', 'weapon5': '0.124', 'DAMAGECOUNT': '0.153', 'WEAPON3': '0.250', 'WEAPON5': '0.300', 'weapon3': '0.784', 'weapon2': '2.014'} [2023-02-24 17:49:28,256][177171] DAMAGECOUNT value on done: 21766.0 [2023-02-24 17:49:28,257][177171] Sum rewards: 0.667, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.012', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.104', 'AMMO3': '0.153', 'weapon5': '0.154', 'weapon4': '0.190', 'HEALTH': '0.228', 'WEAPON5': '0.250', 'HITCOUNT': '0.270', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.020', 'weapon2': '1.398', 'weapon3': '1.556', 'FRAGCOUNT': '2.000'} [2023-02-24 17:49:28,323][177157] DAMAGECOUNT value on done: 24766.0 [2023-02-24 17:49:28,324][177157] Sum rewards: 2.686, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.770', 'AMMO4': '-0.066', 'AMMO2': '-0.013', 'AMMO5': '0.003', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'ARMOR': '0.104', 'HITCOUNT': '0.330', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.392', 'weapon3': '1.654', 'weapon2': '1.840', 'FRAGCOUNT': '2.000'} [2023-02-24 17:49:28,368][177171] DAMAGECOUNT value on done: 21124.0 [2023-02-24 17:49:28,368][177171] Sum rewards: 3.023, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.354', 'AMMO2': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.048', 'WEAPON1': '0.070', 'AMMO3': '0.080', 'weapon7': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.190', 'WEAPON7': '0.200', 'weapon5': '0.270', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.194', 'weapon3': '1.386', 'weapon2': '1.794', 'FRAGCOUNT': '3.000'} [2023-02-24 17:49:28,612][177157] DAMAGECOUNT value on done: 23507.0 [2023-02-24 17:49:28,612][177157] Sum rewards: -3.707, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.538', 'AMMO5': '0.015', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'AMMO4': '0.104', 'AMMO3': '0.109', 'weapon5': '0.234', 'WEAPON4': '0.250', 'HITCOUNT': '0.280', 'WEAPON5': '0.350', 'weapon4': '0.474', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.218', 'weapon2': '1.260', 'weapon3': '1.696', 'FRAGCOUNT': '3.000'} [2023-02-24 17:49:28,621][177157] DAMAGECOUNT value on done: 24193.0 [2023-02-24 17:49:28,621][177157] Sum rewards: 3.452, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.110', 'AMMO4': '-0.059', 'AMMO2': '-0.012', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO3': '0.094', 'weapon5': '0.104', 'WEAPON5': '0.250', 'HITCOUNT': '0.340', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.317', 'weapon3': '1.688', 'weapon2': '1.820', 'FRAGCOUNT': '3.000'} [2023-02-24 17:49:28,669][177171] DAMAGECOUNT value on done: 23306.0 [2023-02-24 17:49:28,669][177171] Sum rewards: -3.042, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.936', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.100', 'weapon5': '0.196', 'HITCOUNT': '0.270', 'WEAPON5': '0.450', 'ARMOR': '0.467', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.978', 'FRAGCOUNT': '1.000', 'weapon2': '1.420', 'weapon3': '1.536'} [2023-02-24 17:49:28,691][177155] DAMAGECOUNT value on done: 21720.0 [2023-02-24 17:49:28,692][177155] Sum rewards: -3.482, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.140', 'AMMO2': '0.009', 'AMMO5': '0.015', 'ARMOR': '0.024', 'AMMO4': '0.045', 'WEAPON1': '0.070', 'AMMO3': '0.117', 'HITCOUNT': '0.140', 'weapon5': '0.144', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.657', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.500', 'weapon2': '1.526', 'weapon3': '2.060'} [2023-02-24 17:49:28,939][177157] DAMAGECOUNT value on done: 21619.0 [2023-02-24 17:49:28,940][177157] Sum rewards: -0.071, reward structure: {'DEATHCOUNT': '-4.500', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.003', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.014', 'ARMOR': '0.032', 'HITCOUNT': '0.080', 'AMMO3': '0.088', 'WEAPON5': '0.150', 'HEALTH': '0.159', 'weapon5': '0.198', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.510', 'weapon3': '1.540', 'weapon2': '1.688'} [2023-02-24 17:49:29,000][177155] DAMAGECOUNT value on done: 24495.0 [2023-02-24 17:49:29,001][177155] Sum rewards: -1.867, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.657', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.076', 'WEAPON1': '0.080', 'AMMO3': '0.114', 'weapon5': '0.220', 'HITCOUNT': '0.340', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.128', 'weapon3': '1.704', 'weapon2': '1.800', 'FRAGCOUNT': '2.000'} [2023-02-24 17:49:29,273][177155] DAMAGECOUNT value on done: 23725.0 [2023-02-24 17:49:29,273][177155] Sum rewards: -2.403, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.258', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon5': '0.082', 'ARMOR': '0.088', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'HITCOUNT': '0.200', 'weapon4': '0.234', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.717', 'WEAPON3': '0.900', 'weapon2': '1.140', 'weapon3': '1.980', 'FRAGCOUNT': '4.000'} [2023-02-24 17:49:29,572][177155] DAMAGECOUNT value on done: 22874.0 [2023-02-24 17:49:29,572][177155] Sum rewards: 4.153, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.528', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.074', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.128', 'weapon7': '0.142', 'weapon4': '0.220', 'HITCOUNT': '0.280', 'WEAPON3': '0.500', 'weapon2': '1.020', 'DAMAGECOUNT': '1.323', 'weapon3': '1.700', 'FRAGCOUNT': '4.000'} [2023-02-24 17:49:29,771][177153] Updated weights for policy 0, policy_version 5450 (0.0008) [2023-02-24 17:49:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 22343680. Throughput: 0: 3494.4. Samples: 5587080. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:49:31,376][177119] Avg episode reward: [(0, '0.631')] [2023-02-24 17:49:32,028][177156] DAMAGECOUNT value on done: 21722.0 [2023-02-24 17:49:32,028][177156] Sum rewards: 0.459, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.219', 'AMMO2': '0.018', 'AMMO5': '0.019', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO3': '0.077', 'AMMO4': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.156', 'HITCOUNT': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.264', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon2': '0.800', 'DAMAGECOUNT': '0.960', 'weapon3': '1.202', 'FRAGCOUNT': '2.000'} [2023-02-24 17:49:32,326][177156] DAMAGECOUNT value on done: 22470.0 [2023-02-24 17:49:32,326][177156] Sum rewards: 0.288, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.208', 'AMMO5': '0.012', 'AMMO2': '0.022', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'AMMO4': '0.107', 'AMMO3': '0.115', 'WEAPON4': '0.200', 'weapon5': '0.218', 'HITCOUNT': '0.230', 'WEAPON5': '0.250', 'weapon4': '0.390', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.825', 'weapon2': '1.420', 'weapon3': '1.584', 'FRAGCOUNT': '2.000'} [2023-02-24 17:49:32,469][177156] DAMAGECOUNT value on done: 24023.0 [2023-02-24 17:49:32,470][177156] Sum rewards: -0.963, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.250', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'ARMOR': '0.008', 'AMMO5': '0.013', 'WEAPON1': '0.050', 'weapon4': '0.058', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'weapon5': '0.136', 'WEAPON5': '0.300', 'HITCOUNT': '0.390', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.215', 'weapon2': '1.440', 'FRAGCOUNT': '2.000', 'weapon3': '2.046'} [2023-02-24 17:49:32,726][177153] Updated weights for policy 0, policy_version 5460 (0.0008) [2023-02-24 17:49:32,775][177156] DAMAGECOUNT value on done: 25431.0 [2023-02-24 17:49:32,775][177156] Sum rewards: 4.474, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'ARMOR': '0.060', 'weapon5': '0.064', 'AMMO4': '0.077', 'AMMO3': '0.088', 'weapon4': '0.170', 'HITCOUNT': '0.340', 'WEAPON3': '0.500', 'HEALTH': '0.613', 'weapon2': '1.352', 'DAMAGECOUNT': '1.605', 'weapon3': '1.726', 'FRAGCOUNT': '3.000'} [2023-02-24 17:49:35,650][177153] Updated weights for policy 0, policy_version 5470 (0.0008) [2023-02-24 17:49:36,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 22413312. Throughput: 0: 3495.8. Samples: 5597556. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:49:36,376][177119] Avg episode reward: [(0, '0.660')] [2023-02-24 17:49:38,601][177153] Updated weights for policy 0, policy_version 5480 (0.0008) [2023-02-24 17:49:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 22482944. Throughput: 0: 3492.9. Samples: 5618440. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:49:41,376][177119] Avg episode reward: [(0, '0.660')] [2023-02-24 17:49:41,553][177153] Updated weights for policy 0, policy_version 5490 (0.0008) [2023-02-24 17:49:44,492][177153] Updated weights for policy 0, policy_version 5500 (0.0008) [2023-02-24 17:49:44,895][177170] DAMAGECOUNT value on done: 21447.0 [2023-02-24 17:49:44,896][177170] Sum rewards: -1.404, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.255', 'AMMO2': '0.014', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.048', 'AMMO4': '0.071', 'AMMO3': '0.077', 'weapon7': '0.176', 'HITCOUNT': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'FRAGCOUNT': '0.500', 'weapon4': '0.506', 'DAMAGECOUNT': '0.840', 'weapon2': '1.090', 'weapon3': '1.190'} [2023-02-24 17:49:45,046][177158] DAMAGECOUNT value on done: 23353.0 [2023-02-24 17:49:45,046][177158] Sum rewards: 3.005, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.186', 'AMMO5': '0.020', 'AMMO2': '0.024', 'ARMOR': '0.027', 'weapon4': '0.070', 'WEAPON1': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'AMMO4': '0.119', 'weapon5': '0.138', 'HITCOUNT': '0.480', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'weapon2': '1.118', 'DAMAGECOUNT': '1.590', 'weapon3': '2.264', 'FRAGCOUNT': '3.500'} [2023-02-24 17:49:45,156][177170] DAMAGECOUNT value on done: 23552.0 [2023-02-24 17:49:45,157][177170] Sum rewards: 3.286, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.167', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.030', 'weapon4': '0.030', 'AMMO4': '0.037', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'weapon5': '0.182', 'WEAPON5': '0.200', 'HITCOUNT': '0.200', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.828', 'weapon3': '1.418', 'weapon2': '2.090', 'FRAGCOUNT': '3.000'} [2023-02-24 17:49:45,206][177170] DAMAGECOUNT value on done: 24808.0 [2023-02-24 17:49:45,206][177170] Sum rewards: 1.127, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.171', 'AMMO5': '0.010', 'AMMO2': '0.011', 'weapon5': '0.018', 'weapon7': '0.036', 'WEAPON1': '0.040', 'AMMO4': '0.056', 'AMMO3': '0.076', 'AMMO6': '0.160', 'AMMO7': '0.160', 'HITCOUNT': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.436', 'WEAPON3': '0.500', 'weapon2': '0.644', 'DAMAGECOUNT': '0.843', 'weapon3': '1.028', 'FRAGCOUNT': '2.000'} [2023-02-24 17:49:45,359][177158] DAMAGECOUNT value on done: 22554.0 [2023-02-24 17:49:45,359][177158] Sum rewards: -3.922, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.096', 'AMMO2': '0.015', 'AMMO5': '0.026', 'ARMOR': '0.032', 'AMMO4': '0.076', 'WEAPON1': '0.100', 'AMMO3': '0.105', 'weapon5': '0.128', 'WEAPON4': '0.250', 'weapon4': '0.316', 'HITCOUNT': '0.320', 'FRAGCOUNT': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'weapon2': '1.438', 'DAMAGECOUNT': '1.527', 'weapon3': '1.790'} [2023-02-24 17:49:45,458][177170] DAMAGECOUNT value on done: 26441.0 [2023-02-24 17:49:45,458][177170] Sum rewards: 3.229, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.378', 'AMMO2': '0.024', 'AMMO5': '0.025', 'ARMOR': '0.028', 'WEAPON1': '0.110', 'AMMO4': '0.121', 'AMMO3': '0.127', 'weapon5': '0.344', 'HITCOUNT': '0.420', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon2': '0.966', 'weapon3': '2.156', 'DAMAGECOUNT': '2.235', 'FRAGCOUNT': '4.000'} [2023-02-24 17:49:45,822][177172] DAMAGECOUNT value on done: 21551.0 [2023-02-24 17:49:45,822][177172] Sum rewards: 3.827, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.565', 'ARMOR': '0.012', 'AMMO2': '0.012', 'AMMO5': '0.020', 'weapon4': '0.024', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.099', 'weapon5': '0.142', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'weapon2': '1.608', 'weapon3': '1.908', 'DAMAGECOUNT': '2.055', 'FRAGCOUNT': '5.000'} [2023-02-24 17:49:46,100][177158] DAMAGECOUNT value on done: 20619.0 [2023-02-24 17:49:46,100][177158] Sum rewards: 0.053, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.103', 'AMMO5': '0.015', 'AMMO2': '0.022', 'ARMOR': '0.032', 'AMMO3': '0.065', 'WEAPON1': '0.070', 'AMMO4': '0.111', 'HITCOUNT': '0.190', 'WEAPON4': '0.250', 'weapon5': '0.264', 'WEAPON3': '0.350', 'weapon4': '0.360', 'WEAPON5': '0.450', 'weapon3': '0.618', 'DAMAGECOUNT': '1.200', 'weapon2': '2.408', 'FRAGCOUNT': '3.000'} [2023-02-24 17:49:46,120][177172] DAMAGECOUNT value on done: 22235.0 [2023-02-24 17:49:46,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 22552576. Throughput: 0: 3492.5. Samples: 5639326. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:49:46,376][177119] Avg episode reward: [(0, '0.540')] [2023-02-24 17:49:46,393][177158] DAMAGECOUNT value on done: 22280.0 [2023-02-24 17:49:46,393][177158] Sum rewards: 5.335, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.715', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.060', 'AMMO4': '0.061', 'AMMO3': '0.101', 'weapon4': '0.130', 'WEAPON5': '0.300', 'HITCOUNT': '0.360', 'WEAPON3': '0.750', 'weapon2': '1.316', 'DAMAGECOUNT': '1.563', 'weapon3': '2.034', 'FRAGCOUNT': '6.000'} [2023-02-24 17:49:46,456][177154] DAMAGECOUNT value on done: 24751.0 [2023-02-24 17:49:46,457][177154] Sum rewards: -0.943, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.715', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.016', 'ARMOR': '0.040', 'WEAPON1': '0.070', 'AMMO3': '0.120', 'weapon5': '0.152', 'WEAPON4': '0.200', 'weapon4': '0.272', 'WEAPON5': '0.350', 'HITCOUNT': '0.430', 'WEAPON3': '0.900', 'weapon2': '0.986', 'DAMAGECOUNT': '1.506', 'weapon3': '1.984', 'FRAGCOUNT': '3.000'} [2023-02-24 17:49:46,731][177158] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 17:49:46,751][177154] DAMAGECOUNT value on done: 22078.0 [2023-02-24 17:49:46,752][177154] Sum rewards: 2.558, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.750', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'weapon4': '0.044', 'AMMO4': '0.065', 'AMMO3': '0.080', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.310', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.314', 'weapon2': '1.744', 'weapon3': '1.904', 'FRAGCOUNT': '3.000'} [2023-02-24 17:49:46,977][177154] DAMAGECOUNT value on done: 23197.0 [2023-02-24 17:49:46,977][177154] Sum rewards: 6.050, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.974', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.017', 'WEAPON1': '0.050', 'weapon5': '0.080', 'AMMO3': '0.133', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon7': '0.198', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'HITCOUNT': '0.520', 'WEAPON3': '0.700', 'weapon2': '1.062', 'weapon3': '2.362', 'DAMAGECOUNT': '2.523', 'FRAGCOUNT': '6.000'} [2023-02-24 17:49:46,985][177172] DAMAGECOUNT value on done: 23345.0 [2023-02-24 17:49:46,986][177172] Sum rewards: 3.209, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.034', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO3': '0.079', 'weapon7': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.150', 'weapon4': '0.196', 'WEAPON5': '0.250', 'HITCOUNT': '0.310', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.359', 'weapon2': '1.490', 'weapon3': '1.594', 'FRAGCOUNT': '3.000'} [2023-02-24 17:49:47,222][177171] DAMAGECOUNT value on done: 21275.0 [2023-02-24 17:49:47,223][177171] Sum rewards: -2.604, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.000', 'HEALTH': '-0.330', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.027', 'WEAPON4': '0.050', 'weapon7': '0.056', 'WEAPON1': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.117', 'AMMO4': '0.135', 'weapon5': '0.252', 'HITCOUNT': '0.280', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.071', 'weapon2': '1.286', 'weapon3': '1.654'} [2023-02-24 17:49:47,281][177172] DAMAGECOUNT value on done: 20936.0 [2023-02-24 17:49:47,281][177172] Sum rewards: 1.791, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.523', 'AMMO2': '0.010', 'AMMO5': '0.027', 'AMMO4': '0.048', 'ARMOR': '0.064', 'WEAPON1': '0.090', 'AMMO3': '0.091', 'WEAPON4': '0.150', 'weapon5': '0.212', 'weapon4': '0.294', 'HITCOUNT': '0.380', 'WEAPON5': '0.650', 'WEAPON3': '0.750', 'weapon2': '1.040', 'DAMAGECOUNT': '1.440', 'weapon3': '1.818', 'FRAGCOUNT': '3.000'} [2023-02-24 17:49:47,288][177154] DAMAGECOUNT value on done: 23787.0 [2023-02-24 17:49:47,289][177154] Sum rewards: 3.108, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.012', 'AMMO2': '0.024', 'HEALTH': '0.033', 'WEAPON1': '0.050', 'AMMO3': '0.080', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'weapon5': '0.254', 'WEAPON5': '0.300', 'HITCOUNT': '0.380', 'ARMOR': '0.400', 'weapon4': '0.406', 'WEAPON3': '0.500', 'weapon2': '0.950', 'DAMAGECOUNT': '1.293', 'weapon3': '1.904', 'FRAGCOUNT': '3.000'} [2023-02-24 17:49:47,432][177153] Updated weights for policy 0, policy_version 5510 (0.0008) [2023-02-24 17:49:47,526][177171] DAMAGECOUNT value on done: 22323.0 [2023-02-24 17:49:47,526][177171] Sum rewards: -2.240, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.660', 'AMMO2': '0.011', 'AMMO5': '0.013', 'weapon7': '0.038', 'WEAPON1': '0.050', 'ARMOR': '0.052', 'AMMO4': '0.056', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon5': '0.178', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.280', 'weapon4': '0.306', 'WEAPON3': '0.900', 'weapon2': '1.066', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.671', 'weapon3': '2.002'} [2023-02-24 17:49:47,576][177157] DAMAGECOUNT value on done: 25454.0 [2023-02-24 17:49:47,577][177157] Sum rewards: 5.117, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.750', 'AMMO2': '0.011', 'AMMO5': '0.022', 'AMMO4': '0.053', 'WEAPON1': '0.060', 'weapon5': '0.088', 'AMMO3': '0.107', 'WEAPON5': '0.450', 'HITCOUNT': '0.630', 'WEAPON3': '0.750', 'weapon3': '1.534', 'weapon2': '1.848', 'DAMAGECOUNT': '2.064', 'FRAGCOUNT': '6.000'} [2023-02-24 17:49:47,607][177171] DAMAGECOUNT value on done: 21551.0 [2023-02-24 17:49:47,608][177171] Sum rewards: 2.247, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.659', 'AMMO5': '0.020', 'AMMO2': '0.023', 'ARMOR': '0.032', 'WEAPON1': '0.060', 'AMMO3': '0.111', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'weapon5': '0.286', 'HITCOUNT': '0.310', 'weapon4': '0.352', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon2': '1.210', 'DAMAGECOUNT': '1.281', 'weapon3': '1.606', 'FRAGCOUNT': '3.000'} [2023-02-24 17:49:47,852][177157] DAMAGECOUNT value on done: 24533.0 [2023-02-24 17:49:47,852][177157] Sum rewards: -2.485, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.496', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'weapon5': '0.114', 'WEAPON5': '0.250', 'weapon4': '0.276', 'HITCOUNT': '0.290', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.020', 'weapon2': '1.248', 'weapon3': '1.354'} [2023-02-24 17:49:47,866][177157] DAMAGECOUNT value on done: 23904.0 [2023-02-24 17:49:47,866][177157] Sum rewards: 2.251, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.244', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.040', 'AMMO4': '0.054', 'ARMOR': '0.056', 'weapon7': '0.074', 'AMMO3': '0.083', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.210', 'WEAPON5': '0.250', 'weapon4': '0.414', 'WEAPON3': '0.500', 'weapon3': '0.902', 'weapon2': '0.960', 'DAMAGECOUNT': '1.191', 'FRAGCOUNT': '3.000'} [2023-02-24 17:49:47,904][177171] DAMAGECOUNT value on done: 23576.0 [2023-02-24 17:49:47,905][177171] Sum rewards: -1.368, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.244', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.015', 'WEAPON1': '0.050', 'ARMOR': '0.056', 'AMMO3': '0.070', 'weapon5': '0.106', 'HITCOUNT': '0.180', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.810', 'weapon3': '1.316', 'weapon2': '1.974', 'FRAGCOUNT': '2.000'} [2023-02-24 17:49:47,945][177155] DAMAGECOUNT value on done: 21867.0 [2023-02-24 17:49:48,170][177157] DAMAGECOUNT value on done: 21972.0 [2023-02-24 17:49:48,171][177157] Sum rewards: 5.173, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.676', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.040', 'AMMO3': '0.040', 'WEAPON1': '0.070', 'weapon5': '0.246', 'HITCOUNT': '0.300', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'weapon3': '1.038', 'DAMAGECOUNT': '1.059', 'weapon2': '2.338', 'FRAGCOUNT': '3.000'} [2023-02-24 17:49:48,240][177155] DAMAGECOUNT value on done: 25033.0 [2023-02-24 17:49:48,240][177155] Sum rewards: 6.252, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.028', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.053', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'weapon5': '0.158', 'WEAPON4': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.400', 'weapon4': '0.508', 'weapon3': '1.100', 'DAMAGECOUNT': '1.614', 'weapon2': '1.746', 'FRAGCOUNT': '4.000'} [2023-02-24 17:49:48,512][177155] DAMAGECOUNT value on done: 24324.0 [2023-02-24 17:49:48,513][177155] Sum rewards: 3.099, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.768', 'AMMO2': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO4': '0.040', 'AMMO3': '0.067', 'weapon5': '0.132', 'HITCOUNT': '0.190', 'weapon4': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.478', 'WEAPON3': '0.600', 'weapon2': '1.424', 'weapon3': '1.446', 'DAMAGECOUNT': '1.797', 'FRAGCOUNT': '3.000'} [2023-02-24 17:49:48,812][177155] DAMAGECOUNT value on done: 23229.0 [2023-02-24 17:49:48,813][177155] Sum rewards: -0.025, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.490', 'AMMO5': '0.007', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'ARMOR': '0.064', 'AMMO3': '0.105', 'weapon5': '0.120', 'AMMO4': '0.123', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.224', 'HITCOUNT': '0.390', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.065', 'weapon3': '1.582', 'weapon2': '1.870', 'FRAGCOUNT': '3.000'} [2023-02-24 17:49:50,329][177153] Updated weights for policy 0, policy_version 5520 (0.0008) [2023-02-24 17:49:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 22622208. Throughput: 0: 3492.1. Samples: 5649834. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:49:51,376][177119] Avg episode reward: [(0, '0.847')] [2023-02-24 17:49:51,405][177156] DAMAGECOUNT value on done: 22345.0 [2023-02-24 17:49:51,405][177156] Sum rewards: 2.806, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.382', 'AMMO5': '0.017', 'AMMO2': '0.029', 'ARMOR': '0.044', 'WEAPON1': '0.060', 'AMMO3': '0.076', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'weapon5': '0.224', 'weapon4': '0.236', 'WEAPON3': '0.400', 'WEAPON5': '0.450', 'weapon3': '1.146', 'weapon2': '1.630', 'DAMAGECOUNT': '1.869', 'FRAGCOUNT': '2.500'} [2023-02-24 17:49:51,704][177156] DAMAGECOUNT value on done: 23095.0 [2023-02-24 17:49:51,704][177156] Sum rewards: 2.452, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.012', 'AMMO2': '0.020', 'HEALTH': '0.028', 'WEAPON1': '0.040', 'AMMO3': '0.088', 'AMMO4': '0.100', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'weapon4': '0.336', 'HITCOUNT': '0.460', 'WEAPON3': '0.500', 'weapon2': '1.508', 'weapon3': '1.644', 'DAMAGECOUNT': '1.875', 'FRAGCOUNT': '2.000'} [2023-02-24 17:49:51,834][177156] DAMAGECOUNT value on done: 24303.0 [2023-02-24 17:49:51,834][177156] Sum rewards: 1.463, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.563', 'AMMO5': '0.004', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'ARMOR': '0.040', 'weapon5': '0.040', 'AMMO3': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'HITCOUNT': '0.290', 'WEAPON4': '0.350', 'weapon4': '0.466', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.840', 'weapon2': '1.202', 'weapon3': '1.438', 'FRAGCOUNT': '5.000'} [2023-02-24 17:49:52,134][177156] DAMAGECOUNT value on done: 25786.0 [2023-02-24 17:49:52,134][177156] Sum rewards: -1.009, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.414', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.066', 'AMMO3': '0.123', 'WEAPON5': '0.300', 'HITCOUNT': '0.310', 'ARMOR': '0.404', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.065', 'weapon3': '1.690', 'FRAGCOUNT': '2.000', 'weapon2': '2.026'} [2023-02-24 17:49:53,250][177153] Updated weights for policy 0, policy_version 5530 (0.0008) [2023-02-24 17:49:56,175][177153] Updated weights for policy 0, policy_version 5540 (0.0009) [2023-02-24 17:49:56,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 22691840. Throughput: 0: 3495.2. Samples: 5670918. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:49:56,376][177119] Avg episode reward: [(0, '0.899')] [2023-02-24 17:49:59,091][177153] Updated weights for policy 0, policy_version 5550 (0.0008) [2023-02-24 17:50:01,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13995.8). Total num frames: 22761472. Throughput: 0: 3495.1. Samples: 5691918. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 17:50:01,376][177119] Avg episode reward: [(0, '0.899')] [2023-02-24 17:50:01,998][177153] Updated weights for policy 0, policy_version 5560 (0.0008) [2023-02-24 17:50:04,044][177170] DAMAGECOUNT value on done: 21743.0 [2023-02-24 17:50:04,045][177170] Sum rewards: 0.086, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.799', 'AMMO2': '0.008', 'AMMO5': '0.021', 'ARMOR': '0.032', 'AMMO4': '0.040', 'AMMO3': '0.052', 'weapon7': '0.062', 'WEAPON1': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'weapon4': '0.194', 'WEAPON7': '0.200', 'weapon5': '0.258', 'WEAPON3': '0.300', 'WEAPON5': '0.550', 'weapon3': '0.734', 'DAMAGECOUNT': '0.888', 'FRAGCOUNT': '1.500', 'weapon2': '2.406'} [2023-02-24 17:50:04,193][177170] DAMAGECOUNT value on done: 24068.0 [2023-02-24 17:50:04,194][177170] Sum rewards: 4.466, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.056', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon4': '0.022', 'ARMOR': '0.024', 'AMMO2': '0.029', 'WEAPON4': '0.050', 'AMMO3': '0.082', 'HITCOUNT': '0.140', 'AMMO4': '0.146', 'weapon5': '0.170', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'weapon3': '0.700', 'DAMAGECOUNT': '1.548', 'weapon2': '3.028', 'FRAGCOUNT': '4.000'} [2023-02-24 17:50:04,256][177158] DAMAGECOUNT value on done: 23849.0 [2023-02-24 17:50:04,256][177158] Sum rewards: 3.581, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.910', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO3': '0.057', 'WEAPON1': '0.060', 'ARMOR': '0.072', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'weapon5': '0.102', 'weapon4': '0.210', 'HITCOUNT': '0.220', 'WEAPON5': '0.300', 'WEAPON3': '0.300', 'weapon3': '1.098', 'DAMAGECOUNT': '1.488', 'weapon2': '1.626', 'FRAGCOUNT': '4.000'} [2023-02-24 17:50:04,357][177170] DAMAGECOUNT value on done: 25183.0 [2023-02-24 17:50:04,357][177170] Sum rewards: -4.189, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.903', 'AMMO2': '0.005', 'AMMO5': '0.016', 'AMMO4': '0.023', 'ARMOR': '0.036', 'WEAPON1': '0.060', 'weapon5': '0.104', 'AMMO3': '0.127', 'WEAPON4': '0.200', 'weapon4': '0.222', 'HITCOUNT': '0.250', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.125', 'weapon3': '1.308', 'weapon2': '1.938', 'FRAGCOUNT': '2.000'} [2023-02-24 17:50:04,500][177170] DAMAGECOUNT value on done: 27116.0 [2023-02-24 17:50:04,500][177170] Sum rewards: 3.978, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.739', 'AMMO2': '0.006', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO4': '0.027', 'WEAPON1': '0.040', 'AMMO3': '0.118', 'weapon5': '0.236', 'WEAPON5': '0.300', 'HITCOUNT': '0.340', 'WEAPON3': '0.450', 'weapon3': '1.024', 'DAMAGECOUNT': '2.025', 'weapon2': '2.622', 'FRAGCOUNT': '5.000'} [2023-02-24 17:50:04,559][177158] DAMAGECOUNT value on done: 23115.0 [2023-02-24 17:50:04,559][177158] Sum rewards: -4.122, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.325', 'weapon7': '0.002', 'AMMO5': '0.017', 'AMMO2': '0.025', 'WEAPON1': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.125', 'weapon5': '0.146', 'AMMO3': '0.154', 'weapon4': '0.282', 'WEAPON5': '0.350', 'HITCOUNT': '0.390', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.500', 'weapon3': '1.606', 'weapon2': '1.672', 'DAMAGECOUNT': '1.683'} [2023-02-24 17:50:04,959][177153] Updated weights for policy 0, policy_version 5570 (0.0008) [2023-02-24 17:50:05,070][177172] DAMAGECOUNT value on done: 22071.0 [2023-02-24 17:50:05,070][177172] Sum rewards: 3.805, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.519', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO5': '0.020', 'AMMO3': '0.062', 'AMMO4': '0.078', 'weapon5': '0.102', 'WEAPON4': '0.200', 'weapon4': '0.246', 'WEAPON5': '0.400', 'HITCOUNT': '0.420', 'WEAPON3': '0.450', 'weapon2': '1.036', 'weapon3': '1.224', 'DAMAGECOUNT': '1.560', 'FRAGCOUNT': '3.000'} [2023-02-24 17:50:05,330][177158] DAMAGECOUNT value on done: 21278.0 [2023-02-24 17:50:05,331][177158] Sum rewards: 4.611, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.110', 'AMMO5': '0.008', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'ARMOR': '0.052', 'weapon5': '0.072', 'AMMO3': '0.085', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'weapon4': '0.164', 'WEAPON5': '0.200', 'WEAPON3': '0.500', 'HITCOUNT': '0.530', 'weapon3': '1.760', 'weapon2': '1.814', 'DAMAGECOUNT': '1.977', 'FRAGCOUNT': '4.000'} [2023-02-24 17:50:05,371][177172] DAMAGECOUNT value on done: 23150.0 [2023-02-24 17:50:05,372][177172] Sum rewards: -0.374, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.493', 'AMMO2': '0.006', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO4': '0.031', 'WEAPON1': '0.050', 'AMMO3': '0.139', 'weapon5': '0.148', 'WEAPON4': '0.150', 'weapon4': '0.210', 'WEAPON5': '0.350', 'HITCOUNT': '0.580', 'WEAPON3': '0.850', 'weapon2': '1.088', 'weapon3': '1.996', 'FRAGCOUNT': '2.500', 'DAMAGECOUNT': '2.745'} [2023-02-24 17:50:05,636][177158] DAMAGECOUNT value on done: 22653.0 [2023-02-24 17:50:05,636][177158] Sum rewards: 2.801, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.757', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'AMMO3': '0.083', 'AMMO4': '0.084', 'WEAPON4': '0.200', 'weapon4': '0.218', 'weapon5': '0.222', 'HITCOUNT': '0.280', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.119', 'weapon2': '1.196', 'weapon3': '1.422', 'FRAGCOUNT': '3.000'} [2023-02-24 17:50:05,718][177154] DAMAGECOUNT value on done: 25471.0 [2023-02-24 17:50:05,718][177154] Sum rewards: 4.210, reward structure: {'DEATHCOUNT': '-6.750', 'ARMOR': '0.008', 'AMMO2': '0.015', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'HEALTH': '0.048', 'AMMO3': '0.068', 'weapon7': '0.072', 'AMMO4': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.166', 'weapon5': '0.284', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'HITCOUNT': '0.510', 'weapon3': '1.242', 'weapon2': '1.526', 'DAMAGECOUNT': '2.160', 'FRAGCOUNT': '3.500'} [2023-02-24 17:50:06,018][177154] DAMAGECOUNT value on done: 22786.0 [2023-02-24 17:50:06,019][177154] Sum rewards: -3.509, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.164', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.033', 'WEAPON1': '0.050', 'AMMO3': '0.151', 'weapon5': '0.180', 'HITCOUNT': '0.510', 'WEAPON5': '0.650', 'WEAPON3': '0.750', 'weapon3': '1.262', 'DAMAGECOUNT': '2.124', 'weapon2': '2.220', 'FRAGCOUNT': '3.000'} [2023-02-24 17:50:06,243][177154] DAMAGECOUNT value on done: 23934.0 [2023-02-24 17:50:06,243][177154] Sum rewards: 2.935, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.358', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.030', 'ARMOR': '0.036', 'AMMO4': '0.058', 'AMMO3': '0.094', 'WEAPON4': '0.150', 'weapon5': '0.216', 'weapon4': '0.218', 'WEAPON5': '0.350', 'HITCOUNT': '0.390', 'WEAPON3': '0.600', 'weapon2': '1.406', 'weapon3': '1.762', 'DAMAGECOUNT': '2.211', 'FRAGCOUNT': '4.000'} [2023-02-24 17:50:06,252][177172] DAMAGECOUNT value on done: 23687.0 [2023-02-24 17:50:06,253][177172] Sum rewards: 0.966, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.110', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.013', 'WEAPON1': '0.040', 'AMMO3': '0.106', 'weapon5': '0.196', 'WEAPON5': '0.250', 'HITCOUNT': '0.300', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.026', 'weapon2': '1.700', 'weapon3': '1.782', 'FRAGCOUNT': '4.000'} [2023-02-24 17:50:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13995.8). Total num frames: 22831104. Throughput: 0: 3491.6. Samples: 5702294. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:50:06,376][177119] Avg episode reward: [(0, '0.835')] [2023-02-24 17:50:06,486][177171] DAMAGECOUNT value on done: 21832.0 [2023-02-24 17:50:06,486][177171] Sum rewards: 1.938, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.254', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.020', 'WEAPON1': '0.050', 'weapon7': '0.060', 'AMMO3': '0.071', 'weapon5': '0.092', 'AMMO4': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.274', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'HITCOUNT': '0.520', 'weapon3': '1.128', 'weapon2': '1.334', 'DAMAGECOUNT': '1.671', 'FRAGCOUNT': '4.000'} [2023-02-24 17:50:06,540][177154] DAMAGECOUNT value on done: 23912.0 [2023-02-24 17:50:06,541][177154] Sum rewards: -4.257, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.206', 'AMMO5': '0.007', 'weapon5': '0.020', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'AMMO3': '0.073', 'HITCOUNT': '0.100', 'AMMO4': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon7': '0.196', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.375', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.468', 'weapon3': '1.144', 'weapon2': '1.178'} [2023-02-24 17:50:06,556][177172] DAMAGECOUNT value on done: 21247.0 [2023-02-24 17:50:06,557][177172] Sum rewards: -4.588, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.686', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.015', 'AMMO2': '0.019', 'WEAPON1': '0.060', 'AMMO4': '0.093', 'AMMO3': '0.116', 'weapon5': '0.204', 'WEAPON4': '0.250', 'HITCOUNT': '0.250', 'weapon4': '0.266', 'WEAPON5': '0.400', 'ARMOR': '0.408', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.933', 'weapon3': '1.316', 'weapon2': '1.668'} [2023-02-24 17:50:06,784][177157] DAMAGECOUNT value on done: 25837.0 [2023-02-24 17:50:06,784][177157] Sum rewards: 0.490, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.164', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.015', 'ARMOR': '0.060', 'WEAPON1': '0.080', 'AMMO3': '0.118', 'weapon5': '0.196', 'HITCOUNT': '0.360', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.149', 'weapon2': '1.530', 'weapon3': '1.638', 'FRAGCOUNT': '3.000'} [2023-02-24 17:50:06,785][177171] DAMAGECOUNT value on done: 22932.0 [2023-02-24 17:50:06,785][177171] Sum rewards: 2.726, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.153', 'AMMO5': '0.012', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'AMMO3': '0.085', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'weapon5': '0.184', 'WEAPON5': '0.250', 'weapon4': '0.280', 'HITCOUNT': '0.290', 'ARMOR': '0.432', 'WEAPON3': '0.500', 'weapon3': '1.516', 'weapon2': '1.690', 'DAMAGECOUNT': '1.827', 'FRAGCOUNT': '3.000'} [2023-02-24 17:50:06,850][177171] DAMAGECOUNT value on done: 22116.0 [2023-02-24 17:50:06,851][177171] Sum rewards: 5.909, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.784', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.007', 'AMMO3': '0.020', 'WEAPON1': '0.050', 'weapon5': '0.168', 'WEAPON3': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.320', 'weapon3': '0.472', 'DAMAGECOUNT': '1.677', 'weapon2': '2.560', 'FRAGCOUNT': '4.000'} [2023-02-24 17:50:07,087][177157] DAMAGECOUNT value on done: 24986.0 [2023-02-24 17:50:07,087][177157] Sum rewards: -1.968, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.128', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.015', 'weapon4': '0.050', 'WEAPON1': '0.070', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'weapon5': '0.116', 'WEAPON5': '0.350', 'HITCOUNT': '0.410', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.359', 'weapon3': '1.802', 'weapon2': '1.826', 'FRAGCOUNT': '3.000'} [2023-02-24 17:50:07,100][177157] DAMAGECOUNT value on done: 24172.0 [2023-02-24 17:50:07,101][177157] Sum rewards: 1.297, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.294', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'weapon7': '0.046', 'ARMOR': '0.073', 'AMMO3': '0.089', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'HITCOUNT': '0.260', 'weapon5': '0.262', 'AMMO6': '0.400', 'WEAPON7': '0.400', 'AMMO7': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.600', 'weapon4': '0.644', 'DAMAGECOUNT': '0.804', 'weapon2': '0.824', 'weapon3': '1.520', 'FRAGCOUNT': '3.000'} [2023-02-24 17:50:07,158][177171] DAMAGECOUNT value on done: 23964.0 [2023-02-24 17:50:07,158][177171] Sum rewards: 1.051, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.565', 'AMMO2': '0.009', 'AMMO5': '0.015', 'weapon4': '0.040', 'AMMO4': '0.043', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'HITCOUNT': '0.190', 'weapon5': '0.194', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.164', 'weapon3': '1.668', 'weapon2': '1.730', 'FRAGCOUNT': '4.000'} [2023-02-24 17:50:07,202][177155] DAMAGECOUNT value on done: 22152.0 [2023-02-24 17:50:07,202][177155] Sum rewards: -1.606, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.650', 'AMMO5': '0.027', 'AMMO2': '0.034', 'WEAPON1': '0.080', 'AMMO3': '0.085', 'AMMO4': '0.169', 'weapon5': '0.192', 'WEAPON4': '0.200', 'HITCOUNT': '0.270', 'weapon4': '0.300', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.855', 'weapon2': '1.318', 'FRAGCOUNT': '1.500', 'weapon3': '1.864'} [2023-02-24 17:50:07,397][177157] DAMAGECOUNT value on done: 22197.0 [2023-02-24 17:50:07,397][177157] Sum rewards: 0.027, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.625', 'AMMO2': '0.007', 'AMMO5': '0.019', 'AMMO4': '0.035', 'WEAPON1': '0.060', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'weapon5': '0.136', 'HITCOUNT': '0.220', 'WEAPON5': '0.450', 'DAMAGECOUNT': '0.675', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.500', 'weapon2': '1.680', 'weapon3': '1.870'} [2023-02-24 17:50:07,499][177155] DAMAGECOUNT value on done: 25819.0 [2023-02-24 17:50:07,500][177155] Sum rewards: -0.444, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.160', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.012', 'AMMO5': '0.013', 'AMMO4': '0.016', 'ARMOR': '0.060', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'weapon4': '0.216', 'WEAPON5': '0.250', 'HITCOUNT': '0.670', 'WEAPON3': '0.900', 'weapon2': '1.684', 'weapon3': '1.920', 'DAMAGECOUNT': '2.358', 'FRAGCOUNT': '3.000'} [2023-02-24 17:50:07,777][177155] DAMAGECOUNT value on done: 24760.0 [2023-02-24 17:50:07,778][177155] Sum rewards: -0.821, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.658', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'ARMOR': '0.028', 'AMMO4': '0.035', 'AMMO3': '0.085', 'WEAPON4': '0.150', 'weapon4': '0.204', 'weapon5': '0.214', 'WEAPON5': '0.300', 'HITCOUNT': '0.400', 'WEAPON3': '0.600', 'weapon2': '1.168', 'DAMAGECOUNT': '1.308', 'weapon3': '1.798'} [2023-02-24 17:50:07,895][177153] Updated weights for policy 0, policy_version 5580 (0.0008) [2023-02-24 17:50:08,078][177155] DAMAGECOUNT value on done: 23634.0 [2023-02-24 17:50:08,079][177155] Sum rewards: 0.610, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.264', 'AMMO2': '0.006', 'AMMO5': '0.017', 'ARMOR': '0.024', 'AMMO4': '0.030', 'WEAPON1': '0.060', 'weapon4': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'weapon5': '0.146', 'WEAPON5': '0.350', 'HITCOUNT': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.215', 'weapon3': '1.472', 'weapon2': '1.788', 'FRAGCOUNT': '6.000'} [2023-02-24 17:50:10,695][177156] DAMAGECOUNT value on done: 22875.0 [2023-02-24 17:50:10,696][177156] Sum rewards: 3.589, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.242', 'AMMO2': '0.011', 'AMMO5': '0.014', 'WEAPON1': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'weapon4': '0.160', 'weapon5': '0.180', 'WEAPON5': '0.350', 'HITCOUNT': '0.360', 'WEAPON3': '0.450', 'weapon2': '1.456', 'DAMAGECOUNT': '1.590', 'weapon3': '1.712', 'FRAGCOUNT': '4.000'} [2023-02-24 17:50:10,832][177153] Updated weights for policy 0, policy_version 5590 (0.0008) [2023-02-24 17:50:10,999][177156] DAMAGECOUNT value on done: 23559.0 [2023-02-24 17:50:10,999][177156] Sum rewards: 2.469, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.850', 'AMMO2': '0.014', 'AMMO5': '0.022', 'ARMOR': '0.052', 'WEAPON1': '0.060', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'AMMO3': '0.154', 'weapon5': '0.166', 'weapon4': '0.272', 'HITCOUNT': '0.340', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.392', 'weapon2': '1.458', 'weapon3': '1.768', 'FRAGCOUNT': '5.000'} [2023-02-24 17:50:11,128][177156] DAMAGECOUNT value on done: 24770.0 [2023-02-24 17:50:11,128][177156] Sum rewards: -1.473, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.197', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'AMMO3': '0.079', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.280', 'weapon5': '0.296', 'weapon4': '0.440', 'WEAPON3': '0.500', 'weapon2': '1.350', 'DAMAGECOUNT': '1.401', 'weapon3': '1.436', 'FRAGCOUNT': '2.000'} [2023-02-24 17:50:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13995.8). Total num frames: 22900736. Throughput: 0: 3488.6. Samples: 5723182. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:50:11,376][177119] Avg episode reward: [(0, '0.673')] [2023-02-24 17:50:11,422][177156] DAMAGECOUNT value on done: 26204.0 [2023-02-24 17:50:11,422][177156] Sum rewards: 0.186, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.057', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.032', 'WEAPON1': '0.040', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'weapon5': '0.136', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'weapon4': '0.196', 'HITCOUNT': '0.290', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.254', 'weapon3': '1.578', 'weapon2': '1.798', 'FRAGCOUNT': '2.000'} [2023-02-24 17:50:13,782][177153] Updated weights for policy 0, policy_version 5600 (0.0008) [2023-02-24 17:50:16,376][177119] Fps is (10 sec: 13926.2, 60 sec: 13926.4, 300 sec: 13995.8). Total num frames: 22970368. Throughput: 0: 3492.8. Samples: 5744256. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 17:50:16,376][177119] Avg episode reward: [(0, '0.646')] [2023-02-24 17:50:16,703][177153] Updated weights for policy 0, policy_version 5610 (0.0008) [2023-02-24 17:50:19,616][177153] Updated weights for policy 0, policy_version 5620 (0.0008) [2023-02-24 17:50:21,376][177119] Fps is (10 sec: 14336.0, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 23044096. Throughput: 0: 3493.3. Samples: 5754754. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:50:21,376][177119] Avg episode reward: [(0, '0.646')] [2023-02-24 17:50:22,543][177153] Updated weights for policy 0, policy_version 5630 (0.0008) [2023-02-24 17:50:23,201][177170] DAMAGECOUNT value on done: 22650.0 [2023-02-24 17:50:23,201][177170] Sum rewards: 1.346, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.065', 'ARMOR': '0.008', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon7': '0.052', 'AMMO3': '0.097', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.127', 'weapon4': '0.158', 'weapon5': '0.184', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.440', 'WEAPON3': '0.600', 'weapon3': '1.560', 'weapon2': '1.816', 'DAMAGECOUNT': '2.718', 'FRAGCOUNT': '5.000'} [2023-02-24 17:50:23,343][177170] DAMAGECOUNT value on done: 24577.0 [2023-02-24 17:50:23,344][177170] Sum rewards: 2.573, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.500', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.029', 'WEAPON1': '0.050', 'weapon7': '0.062', 'ARMOR': '0.076', 'AMMO3': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.184', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.388', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon2': '0.602', 'weapon3': '1.168', 'DAMAGECOUNT': '1.527', 'FRAGCOUNT': '4.000'} [2023-02-24 17:50:23,466][177158] DAMAGECOUNT value on done: 23955.0 [2023-02-24 17:50:23,513][177170] DAMAGECOUNT value on done: 25862.0 [2023-02-24 17:50:23,514][177170] Sum rewards: 4.120, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.876', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon7': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.092', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'ARMOR': '0.113', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'weapon5': '0.174', 'WEAPON4': '0.400', 'HITCOUNT': '0.540', 'WEAPON3': '0.550', 'weapon4': '0.600', 'weapon3': '1.310', 'weapon2': '1.504', 'DAMAGECOUNT': '2.037', 'FRAGCOUNT': '6.000'} [2023-02-24 17:50:23,652][177170] DAMAGECOUNT value on done: 27601.0 [2023-02-24 17:50:23,652][177170] Sum rewards: -0.267, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.511', 'AMMO2': '0.019', 'AMMO5': '0.027', 'weapon5': '0.076', 'WEAPON1': '0.080', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'weapon4': '0.144', 'AMMO3': '0.192', 'HITCOUNT': '0.420', 'WEAPON5': '0.550', 'ARMOR': '0.963', 'WEAPON3': '1.100', 'weapon2': '1.268', 'DAMAGECOUNT': '1.455', 'weapon3': '2.256', 'FRAGCOUNT': '4.000'} [2023-02-24 17:50:23,774][177158] DAMAGECOUNT value on done: 23936.0 [2023-02-24 17:50:23,774][177158] Sum rewards: 3.322, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.718', 'AMMO5': '0.025', 'AMMO2': '0.038', 'WEAPON1': '0.080', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'AMMO4': '0.190', 'weapon4': '0.196', 'weapon5': '0.276', 'ARMOR': '0.440', 'HITCOUNT': '0.440', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'weapon2': '1.012', 'weapon3': '1.840', 'DAMAGECOUNT': '2.445', 'FRAGCOUNT': '3.000'} [2023-02-24 17:50:24,180][177172] DAMAGECOUNT value on done: 22386.0 [2023-02-24 17:50:24,181][177172] Sum rewards: 1.064, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.410', 'AMMO5': '0.014', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'weapon7': '0.064', 'weapon5': '0.066', 'AMMO4': '0.087', 'AMMO3': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.290', 'WEAPON5': '0.300', 'weapon4': '0.356', 'ARMOR': '0.432', 'WEAPON3': '0.450', 'weapon3': '0.914', 'DAMAGECOUNT': '0.945', 'weapon2': '1.450', 'FRAGCOUNT': '3.000'} [2023-02-24 17:50:24,483][177172] DAMAGECOUNT value on done: 23580.0 [2023-02-24 17:50:24,484][177172] Sum rewards: 0.234, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.243', 'AMMO2': '0.010', 'AMMO5': '0.012', 'ARMOR': '0.024', 'WEAPON1': '0.040', 'AMMO4': '0.050', 'weapon7': '0.078', 'weapon5': '0.088', 'AMMO3': '0.175', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.220', 'WEAPON5': '0.250', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.290', 'weapon3': '1.530', 'weapon2': '1.910', 'FRAGCOUNT': '4.000'} [2023-02-24 17:50:24,550][177158] DAMAGECOUNT value on done: 21798.0 [2023-02-24 17:50:24,550][177158] Sum rewards: 6.488, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.675', 'AMMO5': '0.005', 'AMMO2': '0.005', 'ARMOR': '0.020', 'AMMO4': '0.025', 'AMMO3': '0.040', 'WEAPON1': '0.040', 'weapon7': '0.100', 'weapon5': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.230', 'weapon4': '0.304', 'WEAPON3': '0.350', 'weapon3': '1.012', 'weapon2': '1.522', 'DAMAGECOUNT': '1.560', 'FRAGCOUNT': '4.000'} [2023-02-24 17:50:24,848][177158] DAMAGECOUNT value on done: 23178.0 [2023-02-24 17:50:24,849][177158] Sum rewards: 4.541, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.863', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO5': '0.020', 'WEAPON1': '0.080', 'AMMO3': '0.084', 'weapon5': '0.198', 'HITCOUNT': '0.360', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'weapon3': '1.420', 'DAMAGECOUNT': '1.575', 'weapon2': '2.048', 'FRAGCOUNT': '4.000'} [2023-02-24 17:50:25,003][177154] DAMAGECOUNT value on done: 26006.0 [2023-02-24 17:50:25,004][177154] Sum rewards: -2.239, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.184', 'AMMO5': '0.011', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'AMMO4': '0.072', 'weapon5': '0.144', 'AMMO3': '0.149', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.250', 'HITCOUNT': '0.380', 'WEAPON3': '0.800', 'weapon3': '1.084', 'DAMAGECOUNT': '1.605', 'weapon2': '2.184', 'FRAGCOUNT': '3.000'} [2023-02-24 17:50:25,298][177154] DAMAGECOUNT value on done: 23139.0 [2023-02-24 17:50:25,298][177154] Sum rewards: 1.867, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.328', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.050', 'AMMO4': '0.050', 'AMMO3': '0.058', 'weapon5': '0.112', 'WEAPON5': '0.150', 'HITCOUNT': '0.380', 'WEAPON3': '0.400', 'weapon3': '1.052', 'DAMAGECOUNT': '1.059', 'FRAGCOUNT': '2.000', 'weapon2': '2.118'} [2023-02-24 17:50:25,375][177172] DAMAGECOUNT value on done: 23937.0 [2023-02-24 17:50:25,375][177172] Sum rewards: -0.438, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.786', 'AMMO5': '0.012', 'AMMO2': '0.026', 'WEAPON1': '0.040', 'weapon7': '0.074', 'AMMO3': '0.075', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.130', 'weapon5': '0.134', 'weapon4': '0.138', 'HITCOUNT': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.750', 'weapon3': '1.436', 'weapon2': '1.932', 'FRAGCOUNT': '2.000'} [2023-02-24 17:50:25,449][177153] Updated weights for policy 0, policy_version 5640 (0.0008) [2023-02-24 17:50:25,535][177154] DAMAGECOUNT value on done: 24484.0 [2023-02-24 17:50:25,536][177154] Sum rewards: 2.313, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO5': '0.019', 'WEAPON1': '0.030', 'AMMO3': '0.108', 'weapon5': '0.212', 'HITCOUNT': '0.290', 'HEALTH': '0.328', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'weapon2': '1.358', 'DAMAGECOUNT': '1.650', 'weapon3': '1.804', 'FRAGCOUNT': '3.000'} [2023-02-24 17:50:25,680][177172] DAMAGECOUNT value on done: 21642.0 [2023-02-24 17:50:25,681][177172] Sum rewards: -0.325, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.125', 'AMMO5': '0.017', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'AMMO3': '0.103', 'AMMO4': '0.106', 'weapon5': '0.182', 'weapon4': '0.198', 'WEAPON4': '0.200', 'HITCOUNT': '0.230', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'weapon3': '1.092', 'DAMAGECOUNT': '1.185', 'weapon2': '1.726', 'FRAGCOUNT': '3.000'} [2023-02-24 17:50:25,753][177171] DAMAGECOUNT value on done: 22069.0 [2023-02-24 17:50:25,753][177171] Sum rewards: 3.160, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon4': '0.010', 'AMMO2': '0.023', 'AMMO3': '0.050', 'ARMOR': '0.064', 'WEAPON4': '0.100', 'AMMO4': '0.114', 'weapon5': '0.140', 'WEAPON5': '0.150', 'WEAPON3': '0.200', 'HITCOUNT': '0.220', 'HEALTH': '0.394', 'DAMAGECOUNT': '0.711', 'weapon3': '0.854', 'weapon2': '1.612', 'FRAGCOUNT': '3.000'} [2023-02-24 17:50:25,838][177154] DAMAGECOUNT value on done: 24169.0 [2023-02-24 17:50:25,838][177154] Sum rewards: 0.595, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.374', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'ARMOR': '0.064', 'AMMO3': '0.127', 'weapon4': '0.128', 'weapon5': '0.182', 'HITCOUNT': '0.230', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.771', 'weapon2': '1.416', 'weapon3': '1.642', 'FRAGCOUNT': '2.000'} [2023-02-24 17:50:26,002][177157] DAMAGECOUNT value on done: 26569.0 [2023-02-24 17:50:26,003][177157] Sum rewards: 4.738, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.007', 'ARMOR': '0.024', 'WEAPON1': '0.030', 'AMMO2': '0.038', 'AMMO3': '0.075', 'HEALTH': '0.111', 'WEAPON5': '0.150', 'AMMO4': '0.190', 'weapon5': '0.206', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'weapon4': '0.422', 'HITCOUNT': '0.530', 'weapon3': '1.046', 'weapon2': '1.562', 'DAMAGECOUNT': '2.196', 'FRAGCOUNT': '5.000'} [2023-02-24 17:50:26,054][177171] DAMAGECOUNT value on done: 23182.0 [2023-02-24 17:50:26,116][177171] DAMAGECOUNT value on done: 22400.0 [2023-02-24 17:50:26,116][177171] Sum rewards: 3.478, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.447', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'AMMO3': '0.050', 'WEAPON1': '0.050', 'weapon5': '0.124', 'WEAPON5': '0.250', 'HITCOUNT': '0.290', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.852', 'weapon3': '1.244', 'FRAGCOUNT': '2.000', 'weapon2': '2.368'} [2023-02-24 17:50:26,288][177157] DAMAGECOUNT value on done: 24522.0 [2023-02-24 17:50:26,289][177157] Sum rewards: 2.841, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.974', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'weapon4': '0.044', 'ARMOR': '0.052', 'weapon5': '0.052', 'AMMO3': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'HITCOUNT': '0.200', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.050', 'weapon3': '1.240', 'weapon2': '1.844', 'FRAGCOUNT': '3.000'} [2023-02-24 17:50:26,300][177157] DAMAGECOUNT value on done: 25265.0 [2023-02-24 17:50:26,300][177157] Sum rewards: -1.148, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.514', 'AMMO2': '0.006', 'AMMO4': '0.029', 'ARMOR': '0.099', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'HITCOUNT': '0.280', 'weapon4': '0.288', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.837', 'weapon3': '1.294', 'FRAGCOUNT': '2.000', 'weapon2': '2.074'} [2023-02-24 17:50:26,376][177119] Fps is (10 sec: 14336.2, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 23113728. Throughput: 0: 3494.2. Samples: 5775678. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:50:26,376][177119] Avg episode reward: [(0, '1.064')] [2023-02-24 17:50:26,404][177171] DAMAGECOUNT value on done: 24419.0 [2023-02-24 17:50:26,405][177171] Sum rewards: 1.690, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.828', 'AMMO2': '0.015', 'AMMO5': '0.020', 'WEAPON1': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'weapon5': '0.166', 'weapon4': '0.304', 'HITCOUNT': '0.340', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.365', 'weapon3': '1.462', 'weapon2': '1.604', 'FRAGCOUNT': '4.000'} [2023-02-24 17:50:26,499][177155] DAMAGECOUNT value on done: 22952.0 [2023-02-24 17:50:26,499][177155] Sum rewards: 4.766, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.390', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.056', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'weapon5': '0.208', 'HITCOUNT': '0.340', 'WEAPON5': '0.350', 'WEAPON3': '0.350', 'weapon4': '0.440', 'weapon3': '0.836', 'weapon2': '2.044', 'DAMAGECOUNT': '2.400', 'FRAGCOUNT': '6.000'} [2023-02-24 17:50:26,594][177157] DAMAGECOUNT value on done: 22447.0 [2023-02-24 17:50:26,594][177157] Sum rewards: 1.360, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.845', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO3': '0.045', 'weapon5': '0.060', 'WEAPON4': '0.150', 'HITCOUNT': '0.230', 'WEAPON5': '0.250', 'weapon4': '0.338', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.750', 'weapon3': '0.802', 'weapon2': '0.956', 'FRAGCOUNT': '2.000'} [2023-02-24 17:50:26,793][177155] DAMAGECOUNT value on done: 26189.0 [2023-02-24 17:50:26,794][177155] Sum rewards: 5.163, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.095', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO3': '0.030', 'weapon5': '0.060', 'WEAPON5': '0.100', 'WEAPON3': '0.250', 'HITCOUNT': '0.330', 'weapon3': '0.762', 'DAMAGECOUNT': '1.110', 'weapon2': '1.868', 'FRAGCOUNT': '3.000'} [2023-02-24 17:50:27,068][177155] DAMAGECOUNT value on done: 25010.0 [2023-02-24 17:50:27,370][177155] DAMAGECOUNT value on done: 24309.0 [2023-02-24 17:50:27,370][177155] Sum rewards: 0.877, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.832', 'AMMO2': '0.011', 'AMMO5': '0.026', 'ARMOR': '0.036', 'AMMO4': '0.052', 'WEAPON1': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.145', 'weapon4': '0.202', 'HITCOUNT': '0.330', 'weapon5': '0.360', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'weapon2': '1.218', 'weapon3': '1.714', 'DAMAGECOUNT': '2.025', 'FRAGCOUNT': '4.500'} [2023-02-24 17:50:28,393][177153] Updated weights for policy 0, policy_version 5650 (0.0008) [2023-02-24 17:50:29,867][177156] DAMAGECOUNT value on done: 23223.0 [2023-02-24 17:50:29,868][177156] Sum rewards: 3.445, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'weapon5': '0.020', 'AMMO4': '0.064', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.190', 'HEALTH': '0.194', 'HITCOUNT': '0.370', 'WEAPON3': '0.500', 'ARMOR': '0.525', 'DAMAGECOUNT': '1.044', 'weapon2': '1.380', 'weapon3': '1.832', 'FRAGCOUNT': '3.000'} [2023-02-24 17:50:30,160][177156] DAMAGECOUNT value on done: 24552.0 [2023-02-24 17:50:30,160][177156] Sum rewards: 3.054, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.610', 'AMMO5': '0.010', 'AMMO2': '0.025', 'ARMOR': '0.048', 'WEAPON1': '0.050', 'weapon4': '0.058', 'AMMO4': '0.124', 'AMMO3': '0.134', 'WEAPON4': '0.200', 'weapon5': '0.330', 'WEAPON5': '0.350', 'HITCOUNT': '0.520', 'WEAPON3': '0.850', 'weapon2': '1.568', 'weapon3': '1.668', 'DAMAGECOUNT': '2.979', 'FRAGCOUNT': '5.500'} [2023-02-24 17:50:30,279][177156] DAMAGECOUNT value on done: 24910.0 [2023-02-24 17:50:30,279][177156] Sum rewards: -0.571, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.350', 'AMMO5': '0.003', 'AMMO2': '0.033', 'AMMO3': '0.038', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.140', 'weapon7': '0.162', 'AMMO4': '0.163', 'WEAPON3': '0.250', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.420', 'weapon3': '0.468', 'weapon4': '0.652', 'FRAGCOUNT': '1.000', 'weapon2': '1.058'} [2023-02-24 17:50:30,581][177156] DAMAGECOUNT value on done: 26624.0 [2023-02-24 17:50:30,582][177156] Sum rewards: -0.508, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.700', 'AMMO2': '0.014', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.071', 'AMMO3': '0.110', 'weapon5': '0.180', 'WEAPON5': '0.300', 'HITCOUNT': '0.320', 'WEAPON4': '0.350', 'weapon4': '0.484', 'ARMOR': '0.487', 'WEAPON3': '0.750', 'weapon2': '0.750', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.260', 'weapon3': '1.580'} [2023-02-24 17:50:31,295][177153] Updated weights for policy 0, policy_version 5660 (0.0008) [2023-02-24 17:50:31,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 23183360. Throughput: 0: 3497.7. Samples: 5796722. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:50:31,376][177119] Avg episode reward: [(0, '1.263')] [2023-02-24 17:50:31,377][177140] Saving new best policy, reward=1.263! [2023-02-24 17:50:34,218][177153] Updated weights for policy 0, policy_version 5670 (0.0008) [2023-02-24 17:50:36,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 23252992. Throughput: 0: 3497.4. Samples: 5807218. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:50:36,376][177119] Avg episode reward: [(0, '1.263')] [2023-02-24 17:50:37,153][177153] Updated weights for policy 0, policy_version 5680 (0.0008) [2023-02-24 17:50:38,801][177170] Large shaping reward 2.553 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.531, 177.0), ('weapon5', 0.002)] [2023-02-24 17:50:40,082][177153] Updated weights for policy 0, policy_version 5690 (0.0008) [2023-02-24 17:50:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 23322624. Throughput: 0: 3494.2. Samples: 5828156. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:50:41,376][177119] Avg episode reward: [(0, '1.263')] [2023-02-24 17:50:42,278][177170] DAMAGECOUNT value on done: 22954.0 [2023-02-24 17:50:42,278][177170] Sum rewards: -0.942, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.976', 'AMMO5': '0.012', 'AMMO2': '0.029', 'ARMOR': '0.036', 'WEAPON1': '0.050', 'weapon5': '0.086', 'AMMO3': '0.110', 'weapon4': '0.124', 'AMMO4': '0.142', 'WEAPON5': '0.250', 'HITCOUNT': '0.260', 'WEAPON4': '0.350', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.912', 'weapon3': '1.504', 'weapon2': '1.768', 'FRAGCOUNT': '2.000'} [2023-02-24 17:50:42,505][177170] DAMAGECOUNT value on done: 24832.0 [2023-02-24 17:50:42,584][177170] DAMAGECOUNT value on done: 26177.0 [2023-02-24 17:50:42,585][177170] Sum rewards: 0.456, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.516', 'AMMO5': '0.014', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.072', 'AMMO3': '0.083', 'weapon5': '0.192', 'HITCOUNT': '0.310', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.945', 'weapon2': '1.208', 'weapon3': '1.902', 'FRAGCOUNT': '2.000'} [2023-02-24 17:50:42,645][177158] DAMAGECOUNT value on done: 24234.0 [2023-02-24 17:50:42,646][177158] Sum rewards: -0.496, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.037', 'AMMO3': '0.053', 'weapon5': '0.142', 'HITCOUNT': '0.150', 'HEALTH': '0.171', 'AMMO4': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.300', 'FRAGCOUNT': '0.500', 'weapon4': '0.682', 'DAMAGECOUNT': '0.837', 'weapon3': '0.940', 'weapon2': '1.018'} [2023-02-24 17:50:42,814][177170] DAMAGECOUNT value on done: 28008.0 [2023-02-24 17:50:42,815][177170] Sum rewards: 0.032, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.050', 'AMMO5': '0.024', 'AMMO2': '0.029', 'ARMOR': '0.040', 'WEAPON1': '0.090', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.107', 'AMMO4': '0.146', 'weapon5': '0.158', 'HITCOUNT': '0.240', 'WEAPON4': '0.250', 'weapon4': '0.458', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'weapon2': '1.184', 'DAMAGECOUNT': '1.221', 'weapon3': '1.684', 'FRAGCOUNT': '3.000'} [2023-02-24 17:50:42,953][177158] DAMAGECOUNT value on done: 23966.0 [2023-02-24 17:50:43,023][177153] Updated weights for policy 0, policy_version 5700 (0.0008) [2023-02-24 17:50:43,430][177172] DAMAGECOUNT value on done: 22752.0 [2023-02-24 17:50:43,430][177172] Sum rewards: 2.733, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.512', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.027', 'ARMOR': '0.030', 'WEAPON1': '0.050', 'AMMO3': '0.060', 'WEAPON4': '0.150', 'HITCOUNT': '0.220', 'WEAPON5': '0.250', 'weapon5': '0.350', 'weapon4': '0.368', 'WEAPON3': '0.400', 'DAMAGECOUNT': '1.098', 'weapon2': '1.156', 'weapon3': '1.572', 'FRAGCOUNT': '2.000'} [2023-02-24 17:50:43,717][177158] DAMAGECOUNT value on done: 22520.0 [2023-02-24 17:50:43,718][177158] Sum rewards: -0.167, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.318', 'AMMO2': '0.019', 'ARMOR': '0.020', 'AMMO5': '0.020', 'WEAPON1': '0.050', 'AMMO4': '0.096', 'weapon4': '0.106', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'weapon5': '0.202', 'HITCOUNT': '0.420', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'weapon3': '1.518', 'weapon2': '1.700', 'DAMAGECOUNT': '2.166', 'FRAGCOUNT': '4.500'} [2023-02-24 17:50:43,733][177172] DAMAGECOUNT value on done: 23846.0 [2023-02-24 17:50:43,733][177172] Sum rewards: -11.023, reward structure: {'DEATHCOUNT': '-14.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.340', 'AMMO5': '0.016', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'ARMOR': '0.048', 'AMMO3': '0.098', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'weapon5': '0.218', 'WEAPON5': '0.400', 'weapon4': '0.420', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.798', 'weapon3': '0.946', 'weapon2': '2.030'} [2023-02-24 17:50:44,010][177158] DAMAGECOUNT value on done: 23631.0 [2023-02-24 17:50:44,011][177158] Sum rewards: 2.816, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.410', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.030', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.079', 'weapon5': '0.096', 'weapon4': '0.188', 'HITCOUNT': '0.270', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.359', 'weapon2': '1.488', 'weapon3': '1.500', 'FRAGCOUNT': '5.000'} [2023-02-24 17:50:44,229][177154] DAMAGECOUNT value on done: 26491.0 [2023-02-24 17:50:44,229][177154] Sum rewards: -4.818, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.269', 'AMMO5': '0.020', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'weapon5': '0.098', 'AMMO4': '0.124', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'HITCOUNT': '0.370', 'WEAPON5': '0.400', 'weapon4': '0.404', 'WEAPON3': '1.050', 'weapon2': '1.162', 'DAMAGECOUNT': '1.455', 'weapon3': '1.892', 'FRAGCOUNT': '2.000'} [2023-02-24 17:50:44,522][177154] DAMAGECOUNT value on done: 23554.0 [2023-02-24 17:50:44,523][177154] Sum rewards: 1.680, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.416', 'AMMO5': '0.005', 'AMMO2': '0.040', 'ARMOR': '0.052', 'weapon5': '0.070', 'AMMO3': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.202', 'HITCOUNT': '0.390', 'WEAPON4': '0.500', 'WEAPON3': '0.500', 'weapon4': '0.562', 'DAMAGECOUNT': '1.245', 'weapon2': '1.388', 'weapon3': '1.460', 'FRAGCOUNT': '4.000'} [2023-02-24 17:50:44,626][177172] DAMAGECOUNT value on done: 24263.0 [2023-02-24 17:50:44,627][177172] Sum rewards: -3.330, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.982', 'AMMO2': '0.009', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.044', 'ARMOR': '0.088', 'AMMO3': '0.120', 'weapon5': '0.122', 'WEAPON4': '0.200', 'HITCOUNT': '0.320', 'WEAPON5': '0.350', 'weapon4': '0.414', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.978', 'FRAGCOUNT': '1.000', 'weapon3': '1.208', 'weapon2': '1.744'} [2023-02-24 17:50:44,746][177154] DAMAGECOUNT value on done: 24732.0 [2023-02-24 17:50:44,747][177154] Sum rewards: -0.744, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.192', 'ARMOR': '0.016', 'AMMO5': '0.016', 'AMMO2': '0.028', 'WEAPON1': '0.060', 'AMMO3': '0.078', 'AMMO4': '0.138', 'weapon5': '0.170', 'HITCOUNT': '0.230', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.744', 'weapon3': '1.566', 'weapon2': '1.902', 'FRAGCOUNT': '2.000'} [2023-02-24 17:50:44,878][177155] Large shaping reward -2.665 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('ARMOR', -0.01, -10.0), ('WEAPON3', -0.05, -1.0), ('WEAPON5', -0.05, -1.0), ('AMMO5', -0.005, -10.0), ('AMMO6', -0.1, -100.0), ('WEAPON7', -0.1, -1.0), ('AMMO7', -0.1, -100.0)] [2023-02-24 17:50:44,929][177172] DAMAGECOUNT value on done: 22091.0 [2023-02-24 17:50:44,930][177172] Sum rewards: 0.780, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.385', 'AMMO2': '0.008', 'AMMO5': '0.017', 'AMMO4': '0.037', 'WEAPON1': '0.040', 'weapon4': '0.056', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'weapon5': '0.198', 'HITCOUNT': '0.260', 'WEAPON3': '0.400', 'WEAPON5': '0.450', 'weapon3': '1.116', 'DAMAGECOUNT': '1.347', 'weapon2': '2.300', 'FRAGCOUNT': '3.000'} [2023-02-24 17:50:45,037][177154] DAMAGECOUNT value on done: 24758.0 [2023-02-24 17:50:45,038][177154] Sum rewards: 5.499, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.017', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'weapon5': '0.080', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'HITCOUNT': '0.350', 'HEALTH': '0.503', 'WEAPON3': '0.550', 'weapon3': '1.504', 'DAMAGECOUNT': '1.767', 'weapon2': '1.986', 'FRAGCOUNT': '6.000'} [2023-02-24 17:50:45,039][177171] DAMAGECOUNT value on done: 22654.0 [2023-02-24 17:50:45,040][177171] Sum rewards: 1.725, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.061', 'AMMO2': '0.020', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'ARMOR': '0.044', 'AMMO4': '0.097', 'AMMO3': '0.116', 'weapon5': '0.156', 'WEAPON4': '0.250', 'HITCOUNT': '0.320', 'weapon4': '0.332', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'weapon2': '1.440', 'weapon3': '1.456', 'DAMAGECOUNT': '1.755', 'FRAGCOUNT': '3.000'} [2023-02-24 17:50:45,255][177157] DAMAGECOUNT value on done: 26754.0 [2023-02-24 17:50:45,256][177157] Sum rewards: 1.648, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'ARMOR': '0.048', 'AMMO3': '0.050', 'weapon5': '0.084', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'WEAPON3': '0.300', 'HEALTH': '0.394', 'weapon4': '0.396', 'DAMAGECOUNT': '0.555', 'FRAGCOUNT': '1.000', 'weapon3': '1.114', 'weapon2': '1.914'} [2023-02-24 17:50:45,329][177171] DAMAGECOUNT value on done: 23487.0 [2023-02-24 17:50:45,330][177171] Sum rewards: -1.543, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.112', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.007', 'weapon5': '0.068', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.186', 'HITCOUNT': '0.320', 'ARMOR': '0.487', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.915', 'FRAGCOUNT': '1.000', 'weapon2': '1.168', 'weapon3': '1.214'} [2023-02-24 17:50:45,394][177171] DAMAGECOUNT value on done: 22988.0 [2023-02-24 17:50:45,395][177171] Sum rewards: -0.221, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.098', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.054', 'ARMOR': '0.064', 'AMMO3': '0.098', 'WEAPON5': '0.250', 'weapon5': '0.258', 'AMMO4': '0.270', 'weapon4': '0.294', 'HITCOUNT': '0.310', 'WEAPON4': '0.400', 'WEAPON3': '0.550', 'weapon3': '1.214', 'DAMAGECOUNT': '1.764', 'weapon2': '1.818', 'FRAGCOUNT': '4.000'} [2023-02-24 17:50:45,551][177157] DAMAGECOUNT value on done: 24867.0 [2023-02-24 17:50:45,551][177157] Sum rewards: -2.038, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.045', 'AMMO2': '0.010', 'AMMO5': '0.015', 'ARMOR': '0.028', 'weapon4': '0.038', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.131', 'weapon5': '0.140', 'WEAPON5': '0.300', 'HITCOUNT': '0.300', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.035', 'weapon2': '1.704', 'weapon3': '1.704', 'FRAGCOUNT': '4.000'} [2023-02-24 17:50:45,560][177157] DAMAGECOUNT value on done: 25466.0 [2023-02-24 17:50:45,561][177157] Sum rewards: -0.520, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.150', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'ARMOR': '0.044', 'AMMO3': '0.063', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.140', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon7': '0.352', 'WEAPON3': '0.400', 'weapon4': '0.402', 'DAMAGECOUNT': '0.603', 'weapon2': '0.890', 'weapon3': '1.398', 'FRAGCOUNT': '2.000'} [2023-02-24 17:50:45,694][177171] DAMAGECOUNT value on done: 24864.0 [2023-02-24 17:50:45,695][177171] Sum rewards: 3.009, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.164', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.006', 'WEAPON1': '0.040', 'ARMOR': '0.060', 'AMMO3': '0.072', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.334', 'HITCOUNT': '0.340', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.335', 'weapon3': '1.372', 'weapon2': '1.540', 'FRAGCOUNT': '4.000'} [2023-02-24 17:50:45,697][177155] DAMAGECOUNT value on done: 23675.0 [2023-02-24 17:50:45,698][177155] Sum rewards: -0.535, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.816', 'AMMO5': '0.018', 'AMMO2': '0.029', 'ARMOR': '0.032', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'AMMO4': '0.144', 'weapon5': '0.334', 'weapon4': '0.358', 'HITCOUNT': '0.370', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'weapon3': '1.114', 'weapon2': '1.832', 'DAMAGECOUNT': '2.169', 'FRAGCOUNT': '3.000'} [2023-02-24 17:50:45,858][177157] DAMAGECOUNT value on done: 23152.0 [2023-02-24 17:50:45,858][177157] Sum rewards: 2.930, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.406', 'AMMO5': '0.014', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'AMMO2': '0.033', 'AMMO3': '0.107', 'weapon5': '0.146', 'AMMO4': '0.166', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.460', 'WEAPON3': '0.600', 'weapon4': '0.614', 'weapon2': '0.924', 'weapon3': '1.194', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '3.000'} [2023-02-24 17:50:45,932][177153] Updated weights for policy 0, policy_version 5710 (0.0008) [2023-02-24 17:50:45,993][177155] DAMAGECOUNT value on done: 26435.0 [2023-02-24 17:50:45,994][177155] Sum rewards: -7.493, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.508', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.012', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'ARMOR': '0.090', 'AMMO3': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.124', 'weapon5': '0.148', 'weapon7': '0.186', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.300', 'weapon4': '0.424', 'WEAPON4': '0.500', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.738', 'weapon2': '1.302', 'weapon3': '1.434'} [2023-02-24 17:50:46,271][177155] DAMAGECOUNT value on done: 25054.0 [2023-02-24 17:50:46,272][177155] Sum rewards: -1.301, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.709', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.008', 'AMMO5': '0.022', 'AMMO4': '0.040', 'WEAPON1': '0.040', 'HITCOUNT': '0.040', 'ARMOR': '0.040', 'AMMO3': '0.044', 'weapon4': '0.086', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.132', 'weapon5': '0.148', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.300', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'weapon7': '0.484', 'weapon3': '1.020', 'weapon2': '1.514'} [2023-02-24 17:50:46,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 23392256. Throughput: 0: 3493.2. Samples: 5849110. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:50:46,376][177119] Avg episode reward: [(0, '0.791')] [2023-02-24 17:50:46,575][177155] DAMAGECOUNT value on done: 24773.0 [2023-02-24 17:50:46,575][177155] Sum rewards: 0.805, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.878', 'weapon5': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.044', 'WEAPON1': '0.050', 'ARMOR': '0.085', 'AMMO3': '0.141', 'AMMO4': '0.222', 'weapon4': '0.272', 'WEAPON4': '0.350', 'HITCOUNT': '0.380', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'weapon2': '0.930', 'DAMAGECOUNT': '1.392', 'weapon3': '2.240', 'FRAGCOUNT': '4.000'} [2023-02-24 17:50:46,916][177158] Large shaping reward 2.605 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5730000000000001, 191.0), ('weapon7', 0.002)] [2023-02-24 17:50:48,848][177153] Updated weights for policy 0, policy_version 5720 (0.0008) [2023-02-24 17:50:49,079][177156] DAMAGECOUNT value on done: 23700.0 [2023-02-24 17:50:49,079][177156] Sum rewards: -0.147, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.256', 'AMMO5': '0.019', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.090', 'AMMO4': '0.105', 'HITCOUNT': '0.280', 'weapon5': '0.318', 'WEAPON5': '0.400', 'WEAPON3': '0.400', 'weapon3': '1.114', 'DAMAGECOUNT': '1.431', 'FRAGCOUNT': '2.000', 'weapon2': '2.070'} [2023-02-24 17:50:49,369][177156] DAMAGECOUNT value on done: 24867.0 [2023-02-24 17:50:49,370][177156] Sum rewards: 2.314, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'AMMO3': '0.080', 'ARMOR': '0.084', 'weapon5': '0.102', 'AMMO4': '0.115', 'HITCOUNT': '0.140', 'HEALTH': '0.173', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON3': '0.450', 'weapon4': '0.462', 'DAMAGECOUNT': '0.945', 'weapon3': '1.216', 'weapon2': '1.336', 'FRAGCOUNT': '2.000'} [2023-02-24 17:50:49,505][177156] DAMAGECOUNT value on done: 25509.0 [2023-02-24 17:50:49,505][177156] Sum rewards: 2.794, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.600', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO5': '0.015', 'ARMOR': '0.020', 'WEAPON1': '0.030', 'AMMO3': '0.098', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'weapon4': '0.312', 'HITCOUNT': '0.430', 'WEAPON3': '0.650', 'weapon3': '1.344', 'DAMAGECOUNT': '1.797', 'weapon2': '1.890', 'FRAGCOUNT': '4.000'} [2023-02-24 17:50:49,807][177156] DAMAGECOUNT value on done: 27007.0 [2023-02-24 17:50:49,808][177156] Sum rewards: 0.866, reward structure: {'DEATHCOUNT': '-4.500', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.317', 'ARMOR': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO3': '0.050', 'AMMO4': '0.058', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.104', 'weapon7': '0.184', 'WEAPON5': '0.200', 'HITCOUNT': '0.210', 'WEAPON4': '0.250', 'WEAPON3': '0.300', 'weapon4': '0.446', 'DAMAGECOUNT': '1.149', 'weapon3': '1.270', 'weapon2': '1.622'} [2023-02-24 17:50:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 23461888. Throughput: 0: 3498.4. Samples: 5859720. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:50:51,376][177119] Avg episode reward: [(0, '0.716')] [2023-02-24 17:50:51,786][177153] Updated weights for policy 0, policy_version 5730 (0.0008) [2023-02-24 17:50:54,704][177153] Updated weights for policy 0, policy_version 5740 (0.0008) [2023-02-24 17:50:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.6, 300 sec: 13995.8). Total num frames: 23531520. Throughput: 0: 3500.4. Samples: 5880700. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:50:56,376][177119] Avg episode reward: [(0, '0.716')] [2023-02-24 17:50:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000005745_23531520.pth... [2023-02-24 17:50:56,438][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000004925_20172800.pth [2023-02-24 17:50:57,680][177153] Updated weights for policy 0, policy_version 5750 (0.0008) [2023-02-24 17:51:00,620][177153] Updated weights for policy 0, policy_version 5760 (0.0008) [2023-02-24 17:51:01,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 23601152. Throughput: 0: 3496.5. Samples: 5901598. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:51:01,376][177119] Avg episode reward: [(0, '0.716')] [2023-02-24 17:51:01,485][177170] DAMAGECOUNT value on done: 23367.0 [2023-02-24 17:51:01,485][177170] Sum rewards: 4.278, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.894', 'AMMO5': '0.007', 'AMMO2': '0.015', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'AMMO4': '0.073', 'AMMO3': '0.082', 'weapon5': '0.172', 'WEAPON5': '0.200', 'weapon4': '0.210', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.239', 'weapon3': '1.494', 'weapon2': '1.820', 'FRAGCOUNT': '4.000'} [2023-02-24 17:51:01,715][177170] DAMAGECOUNT value on done: 25185.0 [2023-02-24 17:51:01,716][177170] Sum rewards: 2.432, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.420', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'ARMOR': '0.036', 'weapon5': '0.068', 'AMMO4': '0.080', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.172', 'HITCOUNT': '0.310', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.059', 'weapon2': '1.444', 'weapon3': '1.736', 'FRAGCOUNT': '3.000'} [2023-02-24 17:51:01,790][177170] DAMAGECOUNT value on done: 26973.0 [2023-02-24 17:51:01,791][177170] Sum rewards: 4.519, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.899', 'AMMO5': '0.017', 'AMMO2': '0.023', 'AMMO3': '0.063', 'WEAPON1': '0.070', 'AMMO4': '0.112', 'weapon5': '0.314', 'HITCOUNT': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'weapon3': '1.352', 'weapon2': '1.828', 'DAMAGECOUNT': '2.388', 'FRAGCOUNT': '4.000'} [2023-02-24 17:51:01,851][177158] DAMAGECOUNT value on done: 24462.0 [2023-02-24 17:51:01,851][177158] Sum rewards: -2.555, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.545', 'ARMOR': '0.012', 'AMMO5': '0.024', 'AMMO2': '0.027', 'WEAPON4': '0.050', 'WEAPON1': '0.090', 'AMMO3': '0.102', 'AMMO4': '0.133', 'weapon4': '0.182', 'HITCOUNT': '0.190', 'weapon5': '0.270', 'WEAPON5': '0.600', 'DAMAGECOUNT': '0.684', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.120', 'weapon3': '2.006'} [2023-02-24 17:51:02,020][177170] DAMAGECOUNT value on done: 28396.0 [2023-02-24 17:51:02,021][177170] Sum rewards: 4.280, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.396', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'ARMOR': '0.104', 'AMMO4': '0.119', 'AMMO3': '0.126', 'weapon5': '0.160', 'HITCOUNT': '0.260', 'WEAPON5': '0.400', 'weapon4': '0.414', 'WEAPON4': '0.450', 'WEAPON3': '0.750', 'weapon2': '0.842', 'DAMAGECOUNT': '1.164', 'weapon3': '1.826', 'FRAGCOUNT': '5.000'} [2023-02-24 17:51:02,146][177158] DAMAGECOUNT value on done: 24369.0 [2023-02-24 17:51:02,146][177158] Sum rewards: -2.885, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.038', 'AMMO5': '0.014', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'ARMOR': '0.036', 'AMMO3': '0.077', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'weapon4': '0.178', 'weapon5': '0.206', 'HITCOUNT': '0.260', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.209', 'weapon3': '1.298', 'FRAGCOUNT': '2.000', 'weapon2': '2.044'} [2023-02-24 17:51:02,629][177172] DAMAGECOUNT value on done: 23377.0 [2023-02-24 17:51:02,630][177172] Sum rewards: 2.324, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.770', 'AMMO2': '0.008', 'ARMOR': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.040', 'weapon5': '0.062', 'AMMO3': '0.094', 'weapon4': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'HITCOUNT': '0.510', 'WEAPON3': '0.700', 'weapon3': '1.522', 'DAMAGECOUNT': '1.875', 'weapon2': '2.048', 'FRAGCOUNT': '4.000'} [2023-02-24 17:51:02,929][177172] DAMAGECOUNT value on done: 24097.0 [2023-02-24 17:51:02,929][177172] Sum rewards: -0.272, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.301', 'AMMO5': '0.012', 'AMMO2': '0.026', 'WEAPON1': '0.050', 'ARMOR': '0.056', 'AMMO3': '0.098', 'weapon5': '0.102', 'HITCOUNT': '0.120', 'AMMO4': '0.130', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.258', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.753', 'FRAGCOUNT': '1.000', 'weapon3': '1.066', 'weapon2': '2.308'} [2023-02-24 17:51:02,930][177158] DAMAGECOUNT value on done: 22868.0 [2023-02-24 17:51:02,930][177158] Sum rewards: -3.113, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.780', 'AMMO2': '0.024', 'AMMO5': '0.026', 'WEAPON1': '0.070', 'ARMOR': '0.090', 'AMMO4': '0.120', 'AMMO3': '0.139', 'weapon5': '0.142', 'HITCOUNT': '0.310', 'WEAPON4': '0.400', 'weapon4': '0.444', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon2': '1.006', 'DAMAGECOUNT': '1.044', 'FRAGCOUNT': '2.000', 'weapon3': '2.052'} [2023-02-24 17:51:03,239][177158] DAMAGECOUNT value on done: 24369.0 [2023-02-24 17:51:03,240][177158] Sum rewards: -0.162, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.868', 'ARMOR': '0.020', 'AMMO2': '0.021', 'AMMO5': '0.026', 'weapon7': '0.076', 'WEAPON1': '0.080', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'weapon5': '0.160', 'AMMO3': '0.164', 'weapon4': '0.200', 'HITCOUNT': '0.370', 'WEAPON5': '0.600', 'WEAPON3': '1.000', 'weapon2': '1.134', 'weapon3': '2.086', 'DAMAGECOUNT': '2.214', 'FRAGCOUNT': '5.000'} [2023-02-24 17:51:03,391][177154] DAMAGECOUNT value on done: 27029.0 [2023-02-24 17:51:03,391][177154] Sum rewards: 0.267, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.961', 'AMMO2': '0.004', 'AMMO5': '0.013', 'AMMO4': '0.020', 'ARMOR': '0.032', 'weapon4': '0.044', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.098', 'weapon5': '0.150', 'WEAPON5': '0.300', 'HITCOUNT': '0.380', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.614', 'weapon2': '1.734', 'weapon3': '1.778', 'FRAGCOUNT': '4.000'} [2023-02-24 17:51:03,579][177153] Updated weights for policy 0, policy_version 5770 (0.0009) [2023-02-24 17:51:03,694][177154] DAMAGECOUNT value on done: 23812.0 [2023-02-24 17:51:03,694][177154] Sum rewards: -0.625, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.120', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.030', 'WEAPON1': '0.040', 'weapon5': '0.054', 'AMMO3': '0.098', 'WEAPON5': '0.150', 'HITCOUNT': '0.240', 'ARMOR': '0.470', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.774', 'FRAGCOUNT': '1.000', 'weapon3': '1.710', 'weapon2': '2.066'} [2023-02-24 17:51:03,844][177172] DAMAGECOUNT value on done: 24453.0 [2023-02-24 17:51:03,845][177172] Sum rewards: 1.300, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.434', 'AMMO2': '0.011', 'AMMO5': '0.017', 'ARMOR': '0.040', 'AMMO4': '0.055', 'WEAPON1': '0.060', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'HITCOUNT': '0.140', 'weapon4': '0.194', 'weapon5': '0.272', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.600', 'weapon2': '1.558', 'weapon3': '1.670', 'FRAGCOUNT': '2.000'} [2023-02-24 17:51:03,929][177154] DAMAGECOUNT value on done: 25768.0 [2023-02-24 17:51:03,930][177154] Sum rewards: 4.945, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.566', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.032', 'WEAPON1': '0.040', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.134', 'AMMO4': '0.158', 'weapon7': '0.190', 'WEAPON7': '0.200', 'HITCOUNT': '0.260', 'WEAPON5': '0.300', 'weapon4': '0.320', 'WEAPON3': '0.400', 'weapon3': '1.044', 'weapon2': '1.838', 'DAMAGECOUNT': '1.908', 'FRAGCOUNT': '5.000'} [2023-02-24 17:51:04,148][177172] DAMAGECOUNT value on done: 22566.0 [2023-02-24 17:51:04,148][177172] Sum rewards: 2.850, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.888', 'AMMO5': '0.015', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.099', 'WEAPON1': '0.100', 'HITCOUNT': '0.250', 'weapon5': '0.256', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'weapon2': '1.368', 'DAMAGECOUNT': '1.425', 'weapon3': '1.924', 'FRAGCOUNT': '3.000'} [2023-02-24 17:51:04,221][177154] DAMAGECOUNT value on done: 25108.0 [2023-02-24 17:51:04,221][177154] Sum rewards: 0.686, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.869', 'AMMO2': '0.017', 'AMMO5': '0.017', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.077', 'WEAPON1': '0.080', 'AMMO4': '0.085', 'weapon5': '0.118', 'HITCOUNT': '0.230', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.050', 'weapon3': '1.556', 'weapon2': '1.942', 'FRAGCOUNT': '2.000'} [2023-02-24 17:51:04,273][177171] DAMAGECOUNT value on done: 23178.0 [2023-02-24 17:51:04,274][177171] Sum rewards: -1.600, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.888', 'AMMO2': '0.015', 'AMMO5': '0.021', 'WEAPON1': '0.030', 'AMMO4': '0.076', 'AMMO3': '0.108', 'weapon4': '0.198', 'WEAPON4': '0.200', 'weapon5': '0.262', 'HITCOUNT': '0.330', 'FRAGCOUNT': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'weapon2': '1.318', 'DAMAGECOUNT': '1.572', 'weapon3': '1.758'} [2023-02-24 17:51:04,433][177157] DAMAGECOUNT value on done: 26980.0 [2023-02-24 17:51:04,433][177157] Sum rewards: -3.098, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.872', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'HITCOUNT': '0.050', 'ARMOR': '0.060', 'WEAPON1': '0.060', 'AMMO3': '0.083', 'weapon5': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.274', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.678', 'weapon3': '0.966', 'FRAGCOUNT': '1.000', 'weapon2': '1.224'} [2023-02-24 17:51:04,564][177171] DAMAGECOUNT value on done: 23822.0 [2023-02-24 17:51:04,564][177171] Sum rewards: 1.292, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.111', 'AMMO5': '0.013', 'AMMO2': '0.019', 'WEAPON1': '0.070', 'AMMO4': '0.095', 'AMMO3': '0.104', 'weapon5': '0.158', 'HITCOUNT': '0.280', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.005', 'weapon2': '1.716', 'weapon3': '1.842', 'FRAGCOUNT': '2.000'} [2023-02-24 17:51:04,628][177171] DAMAGECOUNT value on done: 23599.0 [2023-02-24 17:51:04,629][177171] Sum rewards: 4.444, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.370', 'AMMO2': '0.015', 'AMMO5': '0.022', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.073', 'weapon4': '0.092', 'AMMO3': '0.103', 'weapon5': '0.150', 'WEAPON5': '0.400', 'HITCOUNT': '0.400', 'WEAPON3': '0.650', 'weapon3': '1.610', 'DAMAGECOUNT': '1.833', 'weapon2': '1.856', 'FRAGCOUNT': '5.000'} [2023-02-24 17:51:04,727][177157] DAMAGECOUNT value on done: 25338.0 [2023-02-24 17:51:04,727][177157] Sum rewards: 0.404, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.057', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.090', 'AMMO3': '0.104', 'weapon4': '0.152', 'weapon5': '0.162', 'WEAPON5': '0.250', 'HITCOUNT': '0.340', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.413', 'weapon3': '1.508', 'weapon2': '1.866', 'FRAGCOUNT': '3.000'} [2023-02-24 17:51:04,735][177157] DAMAGECOUNT value on done: 26388.0 [2023-02-24 17:51:04,736][177157] Sum rewards: 6.275, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.390', 'AMMO5': '0.012', 'AMMO2': '0.030', 'ARMOR': '0.044', 'WEAPON1': '0.060', 'AMMO3': '0.076', 'weapon4': '0.120', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'weapon5': '0.186', 'WEAPON5': '0.300', 'HITCOUNT': '0.390', 'WEAPON3': '0.550', 'weapon3': '1.564', 'weapon2': '1.768', 'DAMAGECOUNT': '2.766', 'FRAGCOUNT': '7.000'} [2023-02-24 17:51:04,922][177171] DAMAGECOUNT value on done: 25705.0 [2023-02-24 17:51:04,923][177171] Sum rewards: 2.093, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.280', 'AMMO2': '0.020', 'AMMO5': '0.022', 'WEAPON1': '0.040', 'ARMOR': '0.078', 'AMMO4': '0.098', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'weapon5': '0.266', 'weapon4': '0.296', 'HITCOUNT': '0.380', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon3': '1.298', 'weapon2': '1.828', 'DAMAGECOUNT': '2.523', 'FRAGCOUNT': '3.000'} [2023-02-24 17:51:05,007][177155] DAMAGECOUNT value on done: 24084.0 [2023-02-24 17:51:05,008][177155] Sum rewards: -0.455, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.622', 'AMMO5': '0.016', 'WEAPON1': '0.030', 'weapon7': '0.034', 'AMMO2': '0.046', 'ARMOR': '0.068', 'AMMO3': '0.086', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.228', 'weapon5': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.278', 'WEAPON5': '0.300', 'HITCOUNT': '0.310', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.227', 'weapon2': '1.234', 'weapon3': '1.480', 'FRAGCOUNT': '1.500'} [2023-02-24 17:51:05,030][177157] DAMAGECOUNT value on done: 23398.0 [2023-02-24 17:51:05,310][177155] DAMAGECOUNT value on done: 26818.0 [2023-02-24 17:51:05,311][177155] Sum rewards: -3.548, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.748', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.011', 'AMMO5': '0.021', 'AMMO4': '0.052', 'WEAPON1': '0.060', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'weapon5': '0.116', 'weapon4': '0.198', 'HITCOUNT': '0.320', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.149', 'weapon3': '1.172', 'weapon2': '1.766'} [2023-02-24 17:51:05,507][177155] DAMAGECOUNT value on done: 25634.0 [2023-02-24 17:51:05,507][177155] Sum rewards: 1.564, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.212', 'AMMO5': '0.010', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'ARMOR': '0.051', 'AMMO3': '0.097', 'weapon5': '0.104', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.322', 'HITCOUNT': '0.540', 'WEAPON3': '0.650', 'weapon2': '1.664', 'weapon3': '1.666', 'DAMAGECOUNT': '1.740', 'FRAGCOUNT': '3.000'} [2023-02-24 17:51:05,802][177155] DAMAGECOUNT value on done: 25352.0 [2023-02-24 17:51:05,803][177155] Sum rewards: 2.501, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.756', 'AMMO5': '0.008', 'AMMO2': '0.020', 'WEAPON1': '0.050', 'ARMOR': '0.082', 'AMMO4': '0.099', 'AMMO3': '0.118', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.352', 'HITCOUNT': '0.450', 'WEAPON3': '0.750', 'weapon2': '1.438', 'DAMAGECOUNT': '1.737', 'weapon3': '1.820', 'FRAGCOUNT': '4.000'} [2023-02-24 17:51:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.6, 300 sec: 13995.8). Total num frames: 23670784. Throughput: 0: 3495.0. Samples: 5912028. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:51:06,376][177119] Avg episode reward: [(0, '0.709')] [2023-02-24 17:51:06,507][177153] Updated weights for policy 0, policy_version 5780 (0.0008) [2023-02-24 17:51:08,390][177156] DAMAGECOUNT value on done: 24251.0 [2023-02-24 17:51:08,391][177156] Sum rewards: 0.297, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.316', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON1': '0.070', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'weapon4': '0.116', 'weapon5': '0.220', 'HITCOUNT': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'weapon2': '1.582', 'DAMAGECOUNT': '1.653', 'weapon3': '1.738', 'FRAGCOUNT': '2.000'} [2023-02-24 17:51:08,688][177156] DAMAGECOUNT value on done: 25268.0 [2023-02-24 17:51:08,688][177156] Sum rewards: 2.032, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.324', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'ARMOR': '0.052', 'weapon5': '0.074', 'AMMO3': '0.089', 'weapon4': '0.092', 'WEAPON5': '0.100', 'HITCOUNT': '0.340', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.203', 'weapon3': '1.274', 'weapon2': '2.274', 'FRAGCOUNT': '3.000'} [2023-02-24 17:51:08,856][177156] DAMAGECOUNT value on done: 25833.0 [2023-02-24 17:51:08,856][177156] Sum rewards: 3.878, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.392', 'AMMO2': '0.009', 'AMMO5': '0.012', 'ARMOR': '0.040', 'AMMO4': '0.045', 'WEAPON1': '0.050', 'AMMO3': '0.072', 'weapon5': '0.110', 'WEAPON5': '0.250', 'HITCOUNT': '0.250', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.972', 'weapon3': '1.244', 'weapon2': '2.266', 'FRAGCOUNT': '3.000'} [2023-02-24 17:51:09,150][177156] DAMAGECOUNT value on done: 27320.0 [2023-02-24 17:51:09,151][177156] Sum rewards: -1.281, reward structure: {'DEATHCOUNT': '-5.250', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.074', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO3': '0.040', 'WEAPON1': '0.040', 'AMMO4': '0.101', 'HITCOUNT': '0.120', 'weapon5': '0.168', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '0.250', 'weapon4': '0.372', 'DAMAGECOUNT': '0.939', 'weapon2': '0.946', 'weapon3': '1.038'} [2023-02-24 17:51:09,437][177153] Updated weights for policy 0, policy_version 5790 (0.0008) [2023-02-24 17:51:11,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 23740416. Throughput: 0: 3497.8. Samples: 5933078. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:51:11,376][177119] Avg episode reward: [(0, '0.765')] [2023-02-24 17:51:12,369][177153] Updated weights for policy 0, policy_version 5800 (0.0009) [2023-02-24 17:51:15,294][177153] Updated weights for policy 0, policy_version 5810 (0.0009) [2023-02-24 17:51:16,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 13981.9). Total num frames: 23810048. Throughput: 0: 3497.0. Samples: 5954086. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:51:16,376][177119] Avg episode reward: [(0, '0.765')] [2023-02-24 17:51:18,210][177153] Updated weights for policy 0, policy_version 5820 (0.0008) [2023-02-24 17:51:20,699][177170] DAMAGECOUNT value on done: 23557.0 [2023-02-24 17:51:20,699][177170] Sum rewards: 0.718, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.188', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'weapon5': '0.082', 'AMMO4': '0.088', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'HITCOUNT': '0.160', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.570', 'weapon3': '1.358', 'weapon2': '1.888', 'FRAGCOUNT': '2.000'} [2023-02-24 17:51:20,777][177170] DAMAGECOUNT value on done: 25449.0 [2023-02-24 17:51:20,778][177170] Sum rewards: 0.478, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.102', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO3': '0.061', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'ARMOR': '0.116', 'weapon4': '0.178', 'HITCOUNT': '0.240', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.792', 'weapon7': '0.846', 'FRAGCOUNT': '1.000', 'weapon3': '1.284', 'weapon2': '1.482'} [2023-02-24 17:51:20,947][177158] DAMAGECOUNT value on done: 24660.0 [2023-02-24 17:51:20,997][177170] DAMAGECOUNT value on done: 27364.0 [2023-02-24 17:51:20,997][177170] Sum rewards: 1.960, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.216', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.062', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.139', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.250', 'weapon7': '0.318', 'weapon4': '0.394', 'WEAPON3': '0.400', 'weapon3': '0.994', 'DAMAGECOUNT': '1.173', 'weapon2': '1.592', 'FRAGCOUNT': '2.000'} [2023-02-24 17:51:21,069][177170] DAMAGECOUNT value on done: 28611.0 [2023-02-24 17:51:21,070][177170] Sum rewards: 0.330, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.438', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO4': '0.017', 'ARMOR': '0.050', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.112', 'HITCOUNT': '0.190', 'weapon5': '0.210', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.645', 'FRAGCOUNT': '1.000', 'weapon2': '1.392', 'weapon3': '1.430'} [2023-02-24 17:51:21,116][177153] Updated weights for policy 0, policy_version 5830 (0.0008) [2023-02-24 17:51:21,246][177158] DAMAGECOUNT value on done: 24526.0 [2023-02-24 17:51:21,247][177158] Sum rewards: -1.474, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.396', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.016', 'WEAPON1': '0.020', 'weapon5': '0.046', 'WEAPON4': '0.050', 'weapon4': '0.070', 'AMMO3': '0.092', 'ARMOR': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.200', 'DAMAGECOUNT': '0.471', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.392', 'weapon2': '2.256'} [2023-02-24 17:51:21,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13926.4, 300 sec: 13981.9). Total num frames: 23879680. Throughput: 0: 3498.1. Samples: 5964632. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:51:21,376][177119] Avg episode reward: [(0, '0.682')] [2023-02-24 17:51:21,871][177172] DAMAGECOUNT value on done: 23412.0 [2023-02-24 17:51:22,140][177158] DAMAGECOUNT value on done: 23198.0 [2023-02-24 17:51:22,141][177158] Sum rewards: -3.169, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.326', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.048', 'weapon5': '0.064', 'AMMO3': '0.117', 'WEAPON5': '0.150', 'HITCOUNT': '0.250', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.990', 'FRAGCOUNT': '1.000', 'weapon3': '1.784', 'weapon2': '1.816'} [2023-02-24 17:51:22,173][177172] DAMAGECOUNT value on done: 24509.0 [2023-02-24 17:51:22,447][177158] DAMAGECOUNT value on done: 24772.0 [2023-02-24 17:51:22,448][177158] Sum rewards: 4.054, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.520', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.030', 'AMMO4': '0.046', 'AMMO3': '0.058', 'weapon5': '0.066', 'ARMOR': '0.068', 'WEAPON5': '0.150', 'HITCOUNT': '0.250', 'WEAPON3': '0.350', 'weapon3': '1.130', 'DAMAGECOUNT': '1.209', 'weapon2': '2.702', 'FRAGCOUNT': '3.000'} [2023-02-24 17:51:22,516][177154] DAMAGECOUNT value on done: 27511.0 [2023-02-24 17:51:22,516][177154] Sum rewards: -0.082, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.238', 'AMMO5': '0.030', 'AMMO2': '0.049', 'AMMO3': '0.084', 'WEAPON1': '0.090', 'AMMO4': '0.243', 'weapon5': '0.300', 'WEAPON4': '0.350', 'HITCOUNT': '0.400', 'weapon4': '0.420', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'weapon2': '1.368', 'DAMAGECOUNT': '1.446', 'weapon3': '1.476', 'FRAGCOUNT': '3.500'} [2023-02-24 17:51:22,812][177154] DAMAGECOUNT value on done: 24034.0 [2023-02-24 17:51:22,812][177154] Sum rewards: 1.262, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.010', 'AMMO5': '0.010', 'AMMO2': '0.016', 'ARMOR': '0.032', 'AMMO3': '0.049', 'WEAPON1': '0.060', 'AMMO4': '0.077', 'HITCOUNT': '0.140', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.300', 'weapon5': '0.322', 'weapon4': '0.560', 'DAMAGECOUNT': '0.666', 'weapon3': '0.786', 'weapon2': '1.454', 'FRAGCOUNT': '3.000'} [2023-02-24 17:51:23,057][177172] DAMAGECOUNT value on done: 24831.0 [2023-02-24 17:51:23,057][177172] Sum rewards: -5.018, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.354', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.030', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'weapon5': '0.080', 'weapon7': '0.080', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.134', 'WEAPON5': '0.150', 'weapon4': '0.188', 'HITCOUNT': '0.300', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.059', 'weapon2': '1.534', 'weapon3': '1.872'} [2023-02-24 17:51:23,068][177154] DAMAGECOUNT value on done: 26093.0 [2023-02-24 17:51:23,069][177154] Sum rewards: -0.427, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.611', 'AMMO5': '0.007', 'AMMO2': '0.010', 'ARMOR': '0.032', 'WEAPON1': '0.050', 'AMMO4': '0.052', 'weapon4': '0.060', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'HITCOUNT': '0.160', 'weapon5': '0.170', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.975', 'FRAGCOUNT': '1.000', 'weapon3': '1.376', 'weapon2': '2.164'} [2023-02-24 17:51:23,320][177171] DAMAGECOUNT value on done: 24248.0 [2023-02-24 17:51:23,321][177171] Sum rewards: 3.966, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.649', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'weapon5': '0.038', 'AMMO4': '0.044', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.129', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.330', 'weapon7': '0.694', 'WEAPON3': '0.700', 'weapon2': '1.278', 'weapon3': '1.524', 'DAMAGECOUNT': '1.710', 'FRAGCOUNT': '6.000'} [2023-02-24 17:51:23,357][177172] DAMAGECOUNT value on done: 23419.0 [2023-02-24 17:51:23,358][177172] Sum rewards: 7.113, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.764', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON1': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.135', 'weapon5': '0.192', 'WEAPON5': '0.250', 'HITCOUNT': '0.540', 'WEAPON3': '0.800', 'weapon3': '1.694', 'weapon2': '1.832', 'DAMAGECOUNT': '2.559', 'FRAGCOUNT': '8.000'} [2023-02-24 17:51:23,368][177154] DAMAGECOUNT value on done: 25215.0 [2023-02-24 17:51:23,621][177171] DAMAGECOUNT value on done: 24108.0 [2023-02-24 17:51:23,622][177171] Sum rewards: -0.777, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.837', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.050', 'AMMO3': '0.086', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'ARMOR': '0.108', 'WEAPON4': '0.150', 'HITCOUNT': '0.220', 'weapon4': '0.344', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.858', 'weapon3': '1.118', 'weapon2': '1.608', 'FRAGCOUNT': '3.000'} [2023-02-24 17:51:23,669][177157] DAMAGECOUNT value on done: 27530.0 [2023-02-24 17:51:23,669][177157] Sum rewards: 4.176, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.711', 'AMMO2': '0.020', 'AMMO5': '0.022', 'WEAPON1': '0.060', 'AMMO3': '0.080', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'weapon4': '0.154', 'weapon5': '0.178', 'HITCOUNT': '0.380', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'weapon3': '1.526', 'weapon2': '1.568', 'DAMAGECOUNT': '1.650', 'FRAGCOUNT': '4.000'} [2023-02-24 17:51:23,685][177171] DAMAGECOUNT value on done: 24312.0 [2023-02-24 17:51:23,685][177171] Sum rewards: 4.738, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.426', 'AMMO2': '0.011', 'AMMO5': '0.015', 'AMMO4': '0.054', 'weapon4': '0.058', 'WEAPON1': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon5': '0.212', 'HITCOUNT': '0.280', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'weapon3': '1.346', 'weapon2': '1.656', 'DAMAGECOUNT': '2.139', 'FRAGCOUNT': '5.000'} [2023-02-24 17:51:23,975][177157] DAMAGECOUNT value on done: 25561.0 [2023-02-24 17:51:23,976][177157] Sum rewards: 1.425, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.282', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'ARMOR': '0.064', 'weapon5': '0.070', 'AMMO4': '0.081', 'AMMO3': '0.099', 'WEAPON5': '0.150', 'HITCOUNT': '0.220', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.669', 'weapon3': '1.300', 'FRAGCOUNT': '2.000', 'weapon2': '2.400'} [2023-02-24 17:51:23,985][177157] DAMAGECOUNT value on done: 26686.0 [2023-02-24 17:51:23,985][177157] Sum rewards: -4.950, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.466', 'AMMO5': '0.012', 'AMMO2': '0.024', 'ARMOR': '0.024', 'WEAPON1': '0.040', 'AMMO3': '0.117', 'weapon5': '0.118', 'AMMO4': '0.119', 'HITCOUNT': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.526', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.894', 'weapon3': '1.014', 'weapon2': '1.928', 'FRAGCOUNT': '3.000'} [2023-02-24 17:51:23,992][177171] DAMAGECOUNT value on done: 25865.0 [2023-02-24 17:51:23,993][177171] Sum rewards: -1.384, reward structure: {'DEATHCOUNT': '-4.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.150', 'AMMO5': '0.009', 'AMMO2': '0.013', 'AMMO3': '0.040', 'WEAPON1': '0.050', 'AMMO4': '0.064', 'weapon5': '0.144', 'HITCOUNT': '0.160', 'WEAPON5': '0.250', 'WEAPON3': '0.250', 'DAMAGECOUNT': '0.480', 'weapon3': '0.968', 'weapon2': '2.338'} [2023-02-24 17:51:24,067][177153] Updated weights for policy 0, policy_version 5840 (0.0008) [2023-02-24 17:51:24,227][177155] DAMAGECOUNT value on done: 24472.0 [2023-02-24 17:51:24,228][177155] Sum rewards: 0.603, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.326', 'AMMO2': '0.012', 'AMMO5': '0.014', 'WEAPON1': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.081', 'weapon5': '0.124', 'ARMOR': '0.136', 'WEAPON4': '0.200', 'HITCOUNT': '0.200', 'weapon4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.164', 'weapon2': '1.172', 'weapon3': '1.518', 'FRAGCOUNT': '2.000'} [2023-02-24 17:51:24,276][177157] DAMAGECOUNT value on done: 24175.0 [2023-02-24 17:51:24,277][177157] Sum rewards: 6.790, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.100', 'AMMO5': '0.015', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'ARMOR': '0.044', 'AMMO3': '0.099', 'AMMO4': '0.120', 'weapon5': '0.124', 'WEAPON4': '0.150', 'weapon4': '0.276', 'WEAPON5': '0.350', 'HITCOUNT': '0.450', 'WEAPON3': '0.700', 'weapon3': '1.506', 'weapon2': '1.660', 'DAMAGECOUNT': '2.331', 'FRAGCOUNT': '6.000'} [2023-02-24 17:51:24,514][177155] DAMAGECOUNT value on done: 27094.0 [2023-02-24 17:51:24,514][177155] Sum rewards: 0.399, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.580', 'AMMO2': '0.011', 'AMMO4': '0.056', 'AMMO3': '0.089', 'ARMOR': '0.118', 'HITCOUNT': '0.310', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.828', 'FRAGCOUNT': '1.000', 'weapon3': '1.226', 'weapon2': '2.040'} [2023-02-24 17:51:24,657][177155] DAMAGECOUNT value on done: 25734.0 [2023-02-24 17:51:24,658][177155] Sum rewards: -3.135, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.234', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.076', 'AMMO3': '0.110', 'HITCOUNT': '0.120', 'weapon5': '0.190', 'DAMAGECOUNT': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.170', 'weapon2': '2.230'} [2023-02-24 17:51:24,949][177155] DAMAGECOUNT value on done: 25467.0 [2023-02-24 17:51:26,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13981.9). Total num frames: 23949312. Throughput: 0: 3499.5. Samples: 5985634. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:51:26,376][177119] Avg episode reward: [(0, '0.522')] [2023-02-24 17:51:26,977][177153] Updated weights for policy 0, policy_version 5850 (0.0008) [2023-02-24 17:51:27,614][177156] DAMAGECOUNT value on done: 24781.0 [2023-02-24 17:51:27,615][177156] Sum rewards: 1.453, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.809', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO3': '0.126', 'weapon5': '0.202', 'WEAPON5': '0.300', 'HITCOUNT': '0.310', 'WEAPON3': '0.750', 'weapon2': '1.510', 'DAMAGECOUNT': '1.590', 'weapon3': '1.936', 'FRAGCOUNT': '3.000'} [2023-02-24 17:51:27,909][177156] DAMAGECOUNT value on done: 25603.0 [2023-02-24 17:51:27,910][177156] Sum rewards: -0.068, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.513', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.006', 'WEAPON1': '0.030', 'ARMOR': '0.048', 'AMMO3': '0.095', 'weapon5': '0.114', 'WEAPON5': '0.150', 'HITCOUNT': '0.250', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.005', 'weapon2': '1.180', 'weapon3': '1.942', 'FRAGCOUNT': '2.500'} [2023-02-24 17:51:28,074][177156] DAMAGECOUNT value on done: 26293.0 [2023-02-24 17:51:28,075][177156] Sum rewards: -1.971, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.030', 'AMMO3': '0.136', 'AMMO4': '0.150', 'weapon5': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.338', 'HITCOUNT': '0.390', 'ARMOR': '0.500', 'FRAGCOUNT': '0.500', 'HEALTH': '0.536', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.380', 'weapon2': '1.540', 'weapon3': '1.620'} [2023-02-24 17:51:28,376][177156] DAMAGECOUNT value on done: 27374.0 [2023-02-24 17:51:28,376][177156] Sum rewards: 0.424, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.695', 'AMMO2': '0.004', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO4': '0.022', 'ARMOR': '0.028', 'WEAPON1': '0.040', 'HITCOUNT': '0.060', 'AMMO3': '0.067', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'DAMAGECOUNT': '0.162', 'WEAPON5': '0.200', 'WEAPON3': '0.450', 'weapon7': '0.614', 'FRAGCOUNT': '1.000', 'weapon3': '1.226', 'weapon2': '1.426'} [2023-02-24 17:51:29,879][177153] Updated weights for policy 0, policy_version 5860 (0.0008) [2023-02-24 17:51:31,376][177119] Fps is (10 sec: 14335.8, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 24023040. Throughput: 0: 3500.3. Samples: 6006622. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:51:31,376][177119] Avg episode reward: [(0, '0.454')] [2023-02-24 17:51:32,821][177153] Updated weights for policy 0, policy_version 5870 (0.0008) [2023-02-24 17:51:35,726][177153] Updated weights for policy 0, policy_version 5880 (0.0009) [2023-02-24 17:51:36,376][177119] Fps is (10 sec: 14336.1, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 24092672. Throughput: 0: 3498.0. Samples: 6017132. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:51:36,376][177119] Avg episode reward: [(0, '0.454')] [2023-02-24 17:51:38,647][177153] Updated weights for policy 0, policy_version 5890 (0.0008) [2023-02-24 17:51:39,880][177170] DAMAGECOUNT value on done: 25915.0 [2023-02-24 17:51:39,880][177170] Sum rewards: 0.796, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.002', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon7': '0.018', 'WEAPON1': '0.030', 'ARMOR': '0.044', 'WEAPON4': '0.050', 'weapon5': '0.050', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.123', 'weapon4': '0.180', 'HITCOUNT': '0.340', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.398', 'weapon2': '1.538', 'weapon3': '1.840', 'FRAGCOUNT': '3.000'} [2023-02-24 17:51:39,892][177170] DAMAGECOUNT value on done: 23827.0 [2023-02-24 17:51:39,893][177170] Sum rewards: -4.259, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.540', 'AMMO2': '0.002', 'AMMO4': '0.012', 'AMMO5': '0.012', 'weapon4': '0.018', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon5': '0.078', 'AMMO3': '0.130', 'HITCOUNT': '0.240', 'WEAPON5': '0.300', 'ARMOR': '0.499', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.810', 'weapon3': '1.692', 'weapon2': '1.856'} [2023-02-24 17:51:40,080][177158] DAMAGECOUNT value on done: 24946.0 [2023-02-24 17:51:40,080][177158] Sum rewards: 2.123, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.820', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'ARMOR': '0.035', 'AMMO3': '0.095', 'HITCOUNT': '0.290', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.858', 'weapon3': '1.302', 'weapon2': '2.048', 'FRAGCOUNT': '3.000'} [2023-02-24 17:51:40,189][177170] DAMAGECOUNT value on done: 28866.0 [2023-02-24 17:51:40,200][177170] DAMAGECOUNT value on done: 27818.0 [2023-02-24 17:51:40,200][177170] Sum rewards: 2.691, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.526', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'AMMO3': '0.104', 'weapon5': '0.138', 'WEAPON5': '0.150', 'HITCOUNT': '0.390', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.362', 'weapon2': '1.606', 'weapon3': '1.716', 'FRAGCOUNT': '3.000'} [2023-02-24 17:51:40,378][177158] DAMAGECOUNT value on done: 25011.0 [2023-02-24 17:51:40,378][177158] Sum rewards: -1.266, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.184', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.021', 'WEAPON1': '0.040', 'ARMOR': '0.064', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'weapon5': '0.176', 'HITCOUNT': '0.260', 'WEAPON3': '0.900', 'weapon2': '1.436', 'DAMAGECOUNT': '1.455', 'weapon3': '1.996', 'FRAGCOUNT': '2.000'} [2023-02-24 17:51:41,119][177172] DAMAGECOUNT value on done: 23914.0 [2023-02-24 17:51:41,120][177172] Sum rewards: 2.168, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.510', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'ARMOR': '0.060', 'AMMO4': '0.065', 'weapon5': '0.070', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.330', 'HITCOUNT': '0.420', 'WEAPON3': '0.700', 'weapon3': '1.336', 'DAMAGECOUNT': '1.506', 'weapon2': '1.692', 'FRAGCOUNT': '2.000'} [2023-02-24 17:51:41,339][177158] DAMAGECOUNT value on done: 23541.0 [2023-02-24 17:51:41,340][177158] Sum rewards: -0.801, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.490', 'AMMO5': '0.010', 'AMMO2': '0.013', 'ARMOR': '0.036', 'WEAPON1': '0.040', 'AMMO4': '0.064', 'AMMO3': '0.135', 'weapon5': '0.154', 'HITCOUNT': '0.180', 'WEAPON5': '0.250', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.029', 'weapon2': '1.550', 'weapon3': '1.978'} [2023-02-24 17:51:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 24162304. Throughput: 0: 3499.1. Samples: 6038160. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:51:41,376][177119] Avg episode reward: [(0, '0.425')] [2023-02-24 17:51:41,423][177172] DAMAGECOUNT value on done: 25009.0 [2023-02-24 17:51:41,423][177172] Sum rewards: 2.859, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.684', 'AMMO5': '0.017', 'AMMO2': '0.021', 'ARMOR': '0.028', 'WEAPON1': '0.090', 'AMMO4': '0.104', 'AMMO3': '0.121', 'weapon5': '0.162', 'WEAPON5': '0.400', 'HITCOUNT': '0.410', 'WEAPON3': '0.750', 'weapon2': '1.238', 'DAMAGECOUNT': '1.500', 'weapon3': '2.202', 'FRAGCOUNT': '4.000'} [2023-02-24 17:51:41,577][177153] Updated weights for policy 0, policy_version 5900 (0.0008) [2023-02-24 17:51:41,642][177158] DAMAGECOUNT value on done: 25072.0 [2023-02-24 17:51:41,642][177158] Sum rewards: 1.728, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.064', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.040', 'AMMO4': '0.064', 'AMMO3': '0.070', 'weapon5': '0.120', 'WEAPON5': '0.200', 'HITCOUNT': '0.220', 'WEAPON3': '0.500', 'weapon2': '0.756', 'DAMAGECOUNT': '0.900', 'weapon3': '1.402', 'FRAGCOUNT': '3.000'} [2023-02-24 17:51:41,775][177154] DAMAGECOUNT value on done: 28054.0 [2023-02-24 17:51:41,775][177154] Sum rewards: 2.380, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.696', 'AMMO2': '0.006', 'AMMO4': '0.031', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'weapon4': '0.056', 'AMMO3': '0.131', 'HITCOUNT': '0.440', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.629', 'weapon3': '1.780', 'weapon2': '1.920', 'FRAGCOUNT': '3.000'} [2023-02-24 17:51:42,077][177154] DAMAGECOUNT value on done: 24273.0 [2023-02-24 17:51:42,077][177154] Sum rewards: 2.312, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'ARMOR': '0.035', 'AMMO3': '0.041', 'WEAPON5': '0.050', 'weapon4': '0.072', 'HEALTH': '0.080', 'weapon5': '0.084', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'HITCOUNT': '0.200', 'WEAPON3': '0.250', 'DAMAGECOUNT': '0.717', 'FRAGCOUNT': '1.000', 'weapon3': '1.050', 'weapon2': '2.248'} [2023-02-24 17:51:42,300][177172] DAMAGECOUNT value on done: 25324.0 [2023-02-24 17:51:42,300][177172] Sum rewards: 0.334, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.302', 'weapon4': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.013', 'ARMOR': '0.036', 'WEAPON1': '0.050', 'weapon5': '0.058', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'WEAPON5': '0.200', 'HITCOUNT': '0.420', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.479', 'weapon2': '1.738', 'weapon3': '1.846', 'FRAGCOUNT': '3.000'} [2023-02-24 17:51:42,327][177154] DAMAGECOUNT value on done: 26486.0 [2023-02-24 17:51:42,328][177154] Sum rewards: -1.141, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.192', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON1': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.106', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'weapon5': '0.164', 'weapon4': '0.230', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.150', 'DAMAGECOUNT': '1.179', 'weapon3': '1.502'} [2023-02-24 17:51:42,560][177171] DAMAGECOUNT value on done: 24728.0 [2023-02-24 17:51:42,560][177171] Sum rewards: 2.511, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.034', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.020', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.386', 'HITCOUNT': '0.400', 'WEAPON3': '0.500', 'ARMOR': '0.567', 'weapon2': '0.720', 'weapon3': '1.302', 'DAMAGECOUNT': '1.440', 'FRAGCOUNT': '3.000'} [2023-02-24 17:51:42,604][177172] DAMAGECOUNT value on done: 23814.0 [2023-02-24 17:51:42,604][177172] Sum rewards: -2.898, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.935', 'AMMO5': '0.015', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'AMMO4': '0.093', 'AMMO3': '0.129', 'weapon5': '0.170', 'HITCOUNT': '0.330', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.185', 'weapon3': '1.656', 'weapon2': '2.010'} [2023-02-24 17:51:42,642][177154] DAMAGECOUNT value on done: 25541.0 [2023-02-24 17:51:42,642][177154] Sum rewards: 1.342, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.030', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'weapon7': '0.054', 'weapon5': '0.062', 'AMMO4': '0.066', 'AMMO3': '0.077', 'ARMOR': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.210', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.978', 'weapon3': '1.122', 'weapon2': '1.722', 'FRAGCOUNT': '4.000'} [2023-02-24 17:51:42,844][177157] DAMAGECOUNT value on done: 28275.0 [2023-02-24 17:51:42,844][177157] Sum rewards: 4.416, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.348', 'AMMO2': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'AMMO4': '0.025', 'AMMO3': '0.104', 'weapon5': '0.118', 'WEAPON5': '0.150', 'HITCOUNT': '0.430', 'WEAPON3': '0.550', 'weapon3': '1.824', 'weapon2': '1.838', 'DAMAGECOUNT': '2.172', 'FRAGCOUNT': '5.000'} [2023-02-24 17:51:42,865][177171] DAMAGECOUNT value on done: 24513.0 [2023-02-24 17:51:42,866][177171] Sum rewards: -2.542, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.116', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.016', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'AMMO4': '0.035', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.100', 'AMMO3': '0.140', 'HITCOUNT': '0.340', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.215', 'weapon2': '1.750', 'weapon3': '1.866'} [2023-02-24 17:51:42,930][177171] DAMAGECOUNT value on done: 24560.0 [2023-02-24 17:51:42,931][177171] Sum rewards: -0.154, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.374', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.034', 'weapon7': '0.066', 'AMMO3': '0.089', 'weapon5': '0.098', 'HITCOUNT': '0.160', 'AMMO4': '0.170', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'weapon4': '0.488', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.744', 'weapon2': '1.260', 'weapon3': '1.628', 'FRAGCOUNT': '3.000'} [2023-02-24 17:51:43,127][177157] DAMAGECOUNT value on done: 25903.0 [2023-02-24 17:51:43,127][177157] Sum rewards: 2.307, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.010', 'weapon4': '0.012', 'AMMO2': '0.016', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.069', 'AMMO4': '0.082', 'HITCOUNT': '0.180', 'weapon5': '0.194', 'WEAPON5': '0.200', 'WEAPON3': '0.350', 'HEALTH': '0.408', 'DAMAGECOUNT': '1.026', 'weapon3': '1.202', 'weapon2': '1.686', 'FRAGCOUNT': '2.000'} [2023-02-24 17:51:43,136][177157] DAMAGECOUNT value on done: 27032.0 [2023-02-24 17:51:43,137][177157] Sum rewards: -0.811, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.239', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'AMMO4': '0.047', 'AMMO3': '0.094', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.230', 'weapon4': '0.282', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.038', 'weapon3': '1.510', 'weapon2': '1.704', 'FRAGCOUNT': '2.000'} [2023-02-24 17:51:43,223][177171] DAMAGECOUNT value on done: 26150.0 [2023-02-24 17:51:43,223][177171] Sum rewards: -1.825, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.676', 'AMMO5': '0.005', 'ARMOR': '0.028', 'AMMO2': '0.029', 'WEAPON1': '0.040', 'AMMO3': '0.111', 'weapon5': '0.116', 'AMMO4': '0.143', 'WEAPON5': '0.200', 'HITCOUNT': '0.270', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.855', 'FRAGCOUNT': '1.000', 'weapon3': '1.444', 'weapon2': '2.210'} [2023-02-24 17:51:43,397][177155] DAMAGECOUNT value on done: 24852.0 [2023-02-24 17:51:43,397][177155] Sum rewards: -1.198, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.882', 'weapon5': '0.012', 'AMMO2': '0.013', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'weapon4': '0.044', 'ARMOR': '0.060', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'WEAPON5': '0.300', 'HITCOUNT': '0.320', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.140', 'weapon3': '1.674', 'weapon2': '1.752', 'FRAGCOUNT': '4.000'} [2023-02-24 17:51:43,434][177157] DAMAGECOUNT value on done: 24575.0 [2023-02-24 17:51:43,434][177157] Sum rewards: 2.492, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.084', 'AMMO5': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'weapon4': '0.048', 'ARMOR': '0.072', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'weapon5': '0.172', 'HITCOUNT': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.200', 'weapon2': '1.470', 'weapon3': '1.954', 'FRAGCOUNT': '3.000'} [2023-02-24 17:51:43,688][177155] DAMAGECOUNT value on done: 27507.0 [2023-02-24 17:51:43,688][177155] Sum rewards: 1.265, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.242', 'AMMO5': '0.010', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'AMMO3': '0.078', 'weapon5': '0.096', 'WEAPON4': '0.100', 'AMMO4': '0.132', 'WEAPON5': '0.250', 'HITCOUNT': '0.250', 'WEAPON3': '0.400', 'DAMAGECOUNT': '1.239', 'weapon2': '1.422', 'weapon3': '1.474', 'FRAGCOUNT': '2.000'} [2023-02-24 17:51:43,826][177155] DAMAGECOUNT value on done: 26200.0 [2023-02-24 17:51:43,827][177155] Sum rewards: -0.470, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.392', 'AMMO2': '0.007', 'AMMO5': '0.010', 'ARMOR': '0.028', 'AMMO4': '0.033', 'WEAPON1': '0.040', 'weapon5': '0.072', 'AMMO3': '0.122', 'WEAPON5': '0.250', 'HITCOUNT': '0.390', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.398', 'weapon3': '1.776', 'weapon2': '1.796', 'FRAGCOUNT': '3.000'} [2023-02-24 17:51:44,125][177155] DAMAGECOUNT value on done: 26005.0 [2023-02-24 17:51:44,125][177155] Sum rewards: 3.186, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.082', 'AMMO2': '0.015', 'AMMO5': '0.020', 'WEAPON1': '0.060', 'AMMO4': '0.076', 'AMMO3': '0.113', 'weapon5': '0.152', 'WEAPON5': '0.400', 'HITCOUNT': '0.420', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.614', 'weapon2': '1.676', 'weapon3': '1.922', 'FRAGCOUNT': '3.000'} [2023-02-24 17:51:44,502][177153] Updated weights for policy 0, policy_version 5910 (0.0008) [2023-02-24 17:51:46,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 24231936. Throughput: 0: 3501.5. Samples: 6059164. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:51:46,376][177119] Avg episode reward: [(0, '0.653')] [2023-02-24 17:51:46,864][177156] DAMAGECOUNT value on done: 25663.0 [2023-02-24 17:51:46,865][177156] Sum rewards: 5.311, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.841', 'AMMO5': '0.010', 'AMMO2': '0.010', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'weapon5': '0.182', 'weapon4': '0.186', 'WEAPON5': '0.300', 'HITCOUNT': '0.570', 'WEAPON3': '0.750', 'weapon2': '0.968', 'weapon3': '1.954', 'DAMAGECOUNT': '2.646', 'FRAGCOUNT': '5.000'} [2023-02-24 17:51:47,155][177156] DAMAGECOUNT value on done: 25978.0 [2023-02-24 17:51:47,155][177156] Sum rewards: 0.295, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.354', 'weapon5': '0.002', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO3': '0.090', 'AMMO4': '0.090', 'ARMOR': '0.091', 'WEAPON4': '0.150', 'weapon4': '0.162', 'HITCOUNT': '0.350', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.034', 'DAMAGECOUNT': '1.125', 'weapon3': '1.924'} [2023-02-24 17:51:47,309][177156] DAMAGECOUNT value on done: 26501.0 [2023-02-24 17:51:47,310][177156] Sum rewards: -2.114, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.438', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon5': '0.066', 'ARMOR': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'weapon7': '0.108', 'AMMO3': '0.145', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'HITCOUNT': '0.210', 'WEAPON4': '0.350', 'weapon4': '0.370', 'DAMAGECOUNT': '0.624', 'WEAPON3': '0.900', 'weapon2': '1.204', 'weapon3': '1.746', 'FRAGCOUNT': '2.000'} [2023-02-24 17:51:47,439][177153] Updated weights for policy 0, policy_version 5920 (0.0008) [2023-02-24 17:51:47,603][177156] DAMAGECOUNT value on done: 27539.0 [2023-02-24 17:51:50,343][177153] Updated weights for policy 0, policy_version 5930 (0.0008) [2023-02-24 17:51:51,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 24301568. Throughput: 0: 3502.9. Samples: 6069660. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:51:51,376][177119] Avg episode reward: [(0, '0.727')] [2023-02-24 17:51:53,255][177153] Updated weights for policy 0, policy_version 5940 (0.0008) [2023-02-24 17:51:56,159][177153] Updated weights for policy 0, policy_version 5950 (0.0008) [2023-02-24 17:51:56,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 24371200. Throughput: 0: 3501.6. Samples: 6090652. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:51:56,376][177119] Avg episode reward: [(0, '0.727')] [2023-02-24 17:51:58,966][177170] DAMAGECOUNT value on done: 26010.0 [2023-02-24 17:51:59,025][177170] DAMAGECOUNT value on done: 24002.0 [2023-02-24 17:51:59,026][177170] Sum rewards: 1.803, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.400', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.057', 'AMMO3': '0.069', 'HITCOUNT': '0.100', 'weapon5': '0.152', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.525', 'FRAGCOUNT': '1.000', 'weapon3': '1.186', 'weapon2': '2.060'} [2023-02-24 17:51:59,089][177153] Updated weights for policy 0, policy_version 5960 (0.0008) [2023-02-24 17:51:59,275][177170] DAMAGECOUNT value on done: 29578.0 [2023-02-24 17:51:59,276][177170] Sum rewards: 0.425, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.566', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'AMMO2': '0.034', 'ARMOR': '0.056', 'AMMO3': '0.103', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'WEAPON4': '0.250', 'HITCOUNT': '0.410', 'weapon4': '0.430', 'WEAPON3': '0.750', 'weapon2': '1.098', 'weapon3': '1.760', 'DAMAGECOUNT': '2.136', 'FRAGCOUNT': '5.000'} [2023-02-24 17:51:59,293][177158] DAMAGECOUNT value on done: 25331.0 [2023-02-24 17:51:59,293][177158] Sum rewards: 1.897, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.552', 'AMMO2': '0.004', 'AMMO5': '0.017', 'AMMO4': '0.022', 'WEAPON1': '0.070', 'AMMO3': '0.095', 'weapon5': '0.114', 'HITCOUNT': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'weapon2': '1.006', 'DAMAGECOUNT': '1.155', 'weapon3': '2.116', 'FRAGCOUNT': '5.000'} [2023-02-24 17:51:59,330][177170] DAMAGECOUNT value on done: 28231.0 [2023-02-24 17:51:59,331][177170] Sum rewards: 3.776, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.282', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'ARMOR': '0.040', 'AMMO3': '0.095', 'weapon5': '0.102', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.310', 'WEAPON3': '0.500', 'weapon4': '0.516', 'weapon2': '1.178', 'DAMAGECOUNT': '1.239', 'weapon3': '1.532', 'FRAGCOUNT': '4.000'} [2023-02-24 17:51:59,603][177158] DAMAGECOUNT value on done: 25494.0 [2023-02-24 17:51:59,603][177158] Sum rewards: 1.596, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.921', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.028', 'ARMOR': '0.036', 'WEAPON1': '0.040', 'weapon5': '0.056', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'weapon4': '0.180', 'WEAPON5': '0.200', 'HITCOUNT': '0.380', 'WEAPON3': '0.800', 'weapon2': '0.912', 'DAMAGECOUNT': '1.449', 'weapon3': '1.974', 'FRAGCOUNT': '4.000'} [2023-02-24 17:52:00,333][177172] DAMAGECOUNT value on done: 24319.0 [2023-02-24 17:52:00,333][177172] Sum rewards: -2.494, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.132', 'AMMO5': '0.006', 'ARMOR': '0.016', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'weapon5': '0.080', 'AMMO4': '0.085', 'AMMO3': '0.085', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.250', 'weapon4': '0.360', 'WEAPON3': '0.400', 'FRAGCOUNT': '1.000', 'weapon3': '1.076', 'DAMAGECOUNT': '1.215', 'weapon2': '1.968'} [2023-02-24 17:52:00,559][177158] DAMAGECOUNT value on done: 24253.0 [2023-02-24 17:52:00,559][177158] Sum rewards: 2.553, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.162', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'AMMO4': '0.054', 'weapon5': '0.092', 'AMMO3': '0.117', 'weapon4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.360', 'WEAPON3': '0.700', 'weapon2': '1.574', 'weapon3': '1.626', 'DAMAGECOUNT': '2.136', 'FRAGCOUNT': '7.000'} [2023-02-24 17:52:00,637][177172] DAMAGECOUNT value on done: 25089.0 [2023-02-24 17:52:00,638][177172] Sum rewards: -0.207, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.600', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.062', 'HITCOUNT': '0.090', 'AMMO3': '0.096', 'WEAPON5': '0.150', 'weapon4': '0.182', 'DAMAGECOUNT': '0.240', 'WEAPON3': '0.600', 'weapon3': '1.326', 'weapon2': '1.496', 'FRAGCOUNT': '2.000'} [2023-02-24 17:52:00,859][177158] DAMAGECOUNT value on done: 25518.0 [2023-02-24 17:52:00,859][177158] Sum rewards: 1.619, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.606', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'ARMOR': '0.040', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'weapon5': '0.104', 'AMMO4': '0.109', 'weapon4': '0.192', 'WEAPON5': '0.200', 'HITCOUNT': '0.440', 'WEAPON3': '0.500', 'weapon2': '1.300', 'DAMAGECOUNT': '1.338', 'weapon3': '1.532', 'FRAGCOUNT': '3.000'} [2023-02-24 17:52:00,998][177154] DAMAGECOUNT value on done: 28342.0 [2023-02-24 17:52:00,998][177154] Sum rewards: -3.226, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.440', 'AMMO5': '0.016', 'AMMO2': '0.027', 'WEAPON1': '0.060', 'AMMO3': '0.115', 'AMMO4': '0.136', 'weapon5': '0.152', 'WEAPON4': '0.250', 'HITCOUNT': '0.290', 'WEAPON5': '0.350', 'weapon4': '0.396', 'ARMOR': '0.501', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.864', 'FRAGCOUNT': '1.000', 'weapon2': '1.064', 'weapon3': '1.292'} [2023-02-24 17:52:01,297][177154] DAMAGECOUNT value on done: 25145.0 [2023-02-24 17:52:01,297][177154] Sum rewards: 5.471, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.010', 'AMMO5': '0.014', 'AMMO2': '0.015', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'AMMO4': '0.075', 'AMMO3': '0.112', 'weapon5': '0.222', 'WEAPON5': '0.300', 'HITCOUNT': '0.420', 'WEAPON3': '0.650', 'weapon2': '1.564', 'weapon3': '1.920', 'DAMAGECOUNT': '2.616', 'FRAGCOUNT': '5.000'} [2023-02-24 17:52:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 24440832. Throughput: 0: 3501.5. Samples: 6111652. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:52:01,376][177119] Avg episode reward: [(0, '0.665')] [2023-02-24 17:52:01,533][177172] DAMAGECOUNT value on done: 25848.0 [2023-02-24 17:52:01,533][177172] Sum rewards: -2.563, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.510', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'WEAPON4': '0.100', 'weapon5': '0.144', 'AMMO3': '0.152', 'weapon4': '0.178', 'WEAPON5': '0.300', 'HITCOUNT': '0.470', 'weapon2': '0.902', 'WEAPON3': '1.100', 'DAMAGECOUNT': '1.572', 'weapon3': '1.996', 'FRAGCOUNT': '2.000'} [2023-02-24 17:52:01,542][177154] DAMAGECOUNT value on done: 26773.0 [2023-02-24 17:52:01,542][177154] Sum rewards: 0.838, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.136', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.020', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'ARMOR': '0.082', 'AMMO3': '0.098', 'weapon4': '0.170', 'HITCOUNT': '0.230', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.861', 'FRAGCOUNT': '1.000', 'weapon2': '1.124', 'weapon3': '1.912'} [2023-02-24 17:52:01,760][177171] DAMAGECOUNT value on done: 25448.0 [2023-02-24 17:52:01,760][177171] Sum rewards: 2.825, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.918', 'AMMO2': '0.012', 'AMMO5': '0.015', 'weapon4': '0.040', 'ARMOR': '0.048', 'WEAPON1': '0.050', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'weapon5': '0.120', 'AMMO3': '0.138', 'WEAPON5': '0.250', 'HITCOUNT': '0.540', 'WEAPON3': '0.950', 'weapon2': '1.556', 'weapon3': '1.956', 'DAMAGECOUNT': '2.160', 'FRAGCOUNT': '5.000'} [2023-02-24 17:52:01,833][177172] DAMAGECOUNT value on done: 24497.0 [2023-02-24 17:52:01,833][177172] Sum rewards: -0.422, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.791', 'AMMO5': '0.013', 'AMMO2': '0.018', 'weapon4': '0.028', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'ARMOR': '0.080', 'AMMO4': '0.090', 'AMMO3': '0.111', 'weapon5': '0.234', 'WEAPON5': '0.300', 'HITCOUNT': '0.310', 'WEAPON3': '0.750', 'weapon2': '1.430', 'DAMAGECOUNT': '1.728', 'weapon3': '1.946', 'FRAGCOUNT': '3.000'} [2023-02-24 17:52:01,837][177154] DAMAGECOUNT value on done: 25946.0 [2023-02-24 17:52:01,838][177154] Sum rewards: 0.280, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.083', 'AMMO2': '0.004', 'AMMO5': '0.005', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.020', 'AMMO3': '0.070', 'weapon5': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.270', 'weapon4': '0.316', 'WEAPON3': '0.500', 'weapon7': '0.706', 'weapon3': '1.020', 'DAMAGECOUNT': '1.215', 'weapon2': '1.472', 'FRAGCOUNT': '3.000'} [2023-02-24 17:52:02,031][177153] Updated weights for policy 0, policy_version 5970 (0.0008) [2023-02-24 17:52:02,041][177157] DAMAGECOUNT value on done: 28834.0 [2023-02-24 17:52:02,041][177157] Sum rewards: 5.211, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.348', 'AMMO5': '0.013', 'AMMO2': '0.015', 'AMMO3': '0.070', 'WEAPON1': '0.070', 'AMMO4': '0.076', 'HITCOUNT': '0.350', 'weapon5': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon3': '1.582', 'weapon2': '1.656', 'DAMAGECOUNT': '1.677', 'FRAGCOUNT': '4.000'} [2023-02-24 17:52:02,055][177171] DAMAGECOUNT value on done: 24985.0 [2023-02-24 17:52:02,056][177171] Sum rewards: 6.448, reward structure: {'DEATHCOUNT': '-4.500', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.024', 'WEAPON1': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.120', 'weapon5': '0.126', 'WEAPON5': '0.250', 'HITCOUNT': '0.280', 'WEAPON3': '0.400', 'HEALTH': '0.628', 'weapon3': '1.362', 'DAMAGECOUNT': '1.416', 'weapon2': '2.202', 'FRAGCOUNT': '4.000'} [2023-02-24 17:52:02,120][177171] DAMAGECOUNT value on done: 24969.0 [2023-02-24 17:52:02,121][177171] Sum rewards: -3.115, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.100', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon4': '0.130', 'AMMO3': '0.133', 'HITCOUNT': '0.280', 'ARMOR': '0.453', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.227', 'weapon3': '1.546', 'weapon2': '1.914'} [2023-02-24 17:52:02,335][177157] DAMAGECOUNT value on done: 26097.0 [2023-02-24 17:52:02,335][177157] Sum rewards: -5.596, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.388', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'ARMOR': '0.060', 'weapon5': '0.072', 'AMMO4': '0.091', 'AMMO3': '0.116', 'WEAPON5': '0.150', 'HITCOUNT': '0.190', 'weapon4': '0.192', 'DAMAGECOUNT': '0.582', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.152', 'weapon3': '1.774'} [2023-02-24 17:52:02,344][177157] DAMAGECOUNT value on done: 27311.0 [2023-02-24 17:52:02,345][177157] Sum rewards: -1.059, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.714', 'AMMO2': '0.015', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.073', 'AMMO3': '0.077', 'ARMOR': '0.088', 'weapon5': '0.108', 'weapon4': '0.128', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.837', 'FRAGCOUNT': '1.000', 'weapon3': '1.446', 'weapon2': '2.118'} [2023-02-24 17:52:02,420][177171] DAMAGECOUNT value on done: 26522.0 [2023-02-24 17:52:02,421][177171] Sum rewards: 0.767, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.079', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.012', 'WEAPON1': '0.040', 'weapon5': '0.056', 'AMMO4': '0.058', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'weapon4': '0.142', 'WEAPON5': '0.200', 'HITCOUNT': '0.390', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.116', 'weapon3': '1.600', 'weapon2': '1.978', 'FRAGCOUNT': '2.000'} [2023-02-24 17:52:02,621][177155] DAMAGECOUNT value on done: 25214.0 [2023-02-24 17:52:02,622][177155] Sum rewards: 1.252, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.398', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'AMMO4': '0.076', 'AMMO3': '0.080', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.192', 'WEAPON3': '0.400', 'HITCOUNT': '0.410', 'DAMAGECOUNT': '1.086', 'weapon2': '1.178', 'weapon3': '1.566', 'FRAGCOUNT': '3.000'} [2023-02-24 17:52:02,651][177157] DAMAGECOUNT value on done: 25005.0 [2023-02-24 17:52:02,652][177157] Sum rewards: 0.200, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.410', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.075', 'ARMOR': '0.080', 'AMMO3': '0.102', 'weapon4': '0.108', 'HITCOUNT': '0.120', 'weapon5': '0.124', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.550', 'weapon3': '1.234', 'weapon2': '1.266', 'DAMAGECOUNT': '1.290', 'FRAGCOUNT': '3.000'} [2023-02-24 17:52:02,919][177155] DAMAGECOUNT value on done: 28040.0 [2023-02-24 17:52:02,919][177155] Sum rewards: 0.851, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.488', 'AMMO5': '0.015', 'AMMO2': '0.020', 'weapon4': '0.020', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.099', 'AMMO3': '0.108', 'weapon5': '0.232', 'HITCOUNT': '0.290', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'weapon3': '1.172', 'DAMAGECOUNT': '1.599', 'weapon2': '2.294', 'FRAGCOUNT': '5.000'} [2023-02-24 17:52:03,052][177155] DAMAGECOUNT value on done: 26824.0 [2023-02-24 17:52:03,053][177155] Sum rewards: 0.153, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.048', 'AMMO5': '0.010', 'AMMO2': '0.026', 'ARMOR': '0.048', 'WEAPON1': '0.050', 'AMMO3': '0.089', 'AMMO4': '0.128', 'weapon5': '0.184', 'WEAPON4': '0.250', 'HITCOUNT': '0.310', 'weapon4': '0.322', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'weapon2': '1.538', 'weapon3': '1.574', 'DAMAGECOUNT': '1.872', 'FRAGCOUNT': '3.000'} [2023-02-24 17:52:03,362][177155] DAMAGECOUNT value on done: 26495.0 [2023-02-24 17:52:03,362][177155] Sum rewards: 1.774, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.146', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.014', 'ARMOR': '0.024', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'weapon4': '0.070', 'weapon5': '0.092', 'AMMO3': '0.133', 'HITCOUNT': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.900', 'weapon3': '1.462', 'DAMAGECOUNT': '1.470', 'weapon2': '1.974', 'FRAGCOUNT': '5.000'} [2023-02-24 17:52:04,961][177153] Updated weights for policy 0, policy_version 5980 (0.0009) [2023-02-24 17:52:06,024][177156] DAMAGECOUNT value on done: 25801.0 [2023-02-24 17:52:06,321][177156] DAMAGECOUNT value on done: 26169.0 [2023-02-24 17:52:06,322][177156] Sum rewards: 2.419, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.051', 'AMMO4': '0.077', 'HEALTH': '0.103', 'WEAPON5': '0.150', 'weapon5': '0.170', 'HITCOUNT': '0.180', 'weapon4': '0.334', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.573', 'FRAGCOUNT': '1.000', 'weapon3': '1.266', 'weapon2': '1.722'} [2023-02-24 17:52:06,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 13981.9). Total num frames: 24510464. Throughput: 0: 3499.4. Samples: 6122106. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:52:06,376][177119] Avg episode reward: [(0, '0.669')] [2023-02-24 17:52:06,439][177156] DAMAGECOUNT value on done: 26675.0 [2023-02-24 17:52:06,440][177156] Sum rewards: -1.353, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.406', 'AMMO5': '0.014', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'ARMOR': '0.060', 'weapon5': '0.086', 'AMMO3': '0.114', 'AMMO4': '0.128', 'HITCOUNT': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.522', 'weapon4': '0.604', 'WEAPON3': '0.650', 'weapon2': '0.882', 'weapon3': '1.476', 'FRAGCOUNT': '2.000'} [2023-02-24 17:52:06,739][177156] DAMAGECOUNT value on done: 27892.0 [2023-02-24 17:52:06,739][177156] Sum rewards: -3.900, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.250', 'AMMO5': '0.015', 'AMMO2': '0.022', 'WEAPON1': '0.060', 'ARMOR': '0.089', 'AMMO4': '0.112', 'AMMO3': '0.147', 'weapon5': '0.178', 'HITCOUNT': '0.190', 'weapon4': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.059', 'weapon2': '1.488', 'weapon3': '1.628'} [2023-02-24 17:52:06,847][177172] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 17:52:07,906][177153] Updated weights for policy 0, policy_version 5990 (0.0008) [2023-02-24 17:52:10,830][177153] Updated weights for policy 0, policy_version 6000 (0.0009) [2023-02-24 17:52:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 24580096. Throughput: 0: 3499.7. Samples: 6143118. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:52:11,376][177119] Avg episode reward: [(0, '0.576')] [2023-02-24 17:52:13,754][177153] Updated weights for policy 0, policy_version 6010 (0.0008) [2023-02-24 17:52:16,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 24649728. Throughput: 0: 3499.5. Samples: 6164098. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 17:52:16,376][177119] Avg episode reward: [(0, '0.576')] [2023-02-24 17:52:16,702][177153] Updated weights for policy 0, policy_version 6020 (0.0008) [2023-02-24 17:52:18,244][177170] DAMAGECOUNT value on done: 26623.0 [2023-02-24 17:52:18,244][177170] Sum rewards: 0.513, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.744', 'ARMOR': '0.016', 'AMMO5': '0.017', 'AMMO2': '0.027', 'WEAPON1': '0.040', 'AMMO3': '0.102', 'AMMO4': '0.137', 'weapon5': '0.226', 'WEAPON4': '0.300', 'HITCOUNT': '0.450', 'weapon4': '0.474', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'weapon2': '1.314', 'weapon3': '1.364', 'DAMAGECOUNT': '1.839', 'FRAGCOUNT': '3.000'} [2023-02-24 17:52:18,315][177170] DAMAGECOUNT value on done: 24596.0 [2023-02-24 17:52:18,316][177170] Sum rewards: 1.270, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'ARMOR': '0.052', 'AMMO3': '0.089', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'weapon4': '0.216', 'HITCOUNT': '0.220', 'WEAPON5': '0.300', 'weapon5': '0.358', 'WEAPON3': '0.450', 'HEALTH': '0.624', 'weapon3': '1.274', 'weapon2': '1.490', 'DAMAGECOUNT': '1.782', 'FRAGCOUNT': '3.000'} [2023-02-24 17:52:18,545][177170] DAMAGECOUNT value on done: 30141.0 [2023-02-24 17:52:18,545][177170] Sum rewards: -0.743, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.933', 'AMMO5': '0.007', 'AMMO2': '0.017', 'ARMOR': '0.020', 'WEAPON1': '0.040', 'AMMO4': '0.086', 'AMMO3': '0.146', 'weapon5': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.256', 'HITCOUNT': '0.360', 'weapon2': '0.890', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.689', 'weapon3': '1.908', 'FRAGCOUNT': '4.000'} [2023-02-24 17:52:18,594][177158] DAMAGECOUNT value on done: 25764.0 [2023-02-24 17:52:18,594][177158] Sum rewards: 4.183, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.389', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO3': '0.071', 'AMMO4': '0.091', 'weapon5': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'HITCOUNT': '0.320', 'WEAPON3': '0.350', 'weapon4': '0.474', 'ARMOR': '0.514', 'weapon3': '0.940', 'DAMAGECOUNT': '1.299', 'weapon2': '1.470', 'FRAGCOUNT': '2.000'} [2023-02-24 17:52:18,619][177170] DAMAGECOUNT value on done: 28773.0 [2023-02-24 17:52:18,619][177170] Sum rewards: -0.536, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.698', 'AMMO5': '0.007', 'AMMO2': '0.014', 'ARMOR': '0.024', 'WEAPON1': '0.030', 'weapon7': '0.052', 'AMMO4': '0.068', 'weapon5': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.134', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.382', 'HITCOUNT': '0.510', 'WEAPON3': '0.800', 'weapon2': '1.166', 'DAMAGECOUNT': '1.626', 'weapon3': '1.652', 'FRAGCOUNT': '5.000'} [2023-02-24 17:52:18,899][177158] DAMAGECOUNT value on done: 26183.0 [2023-02-24 17:52:18,899][177158] Sum rewards: 7.232, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.322', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.074', 'AMMO3': '0.112', 'weapon5': '0.178', 'WEAPON5': '0.200', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'weapon2': '1.730', 'weapon3': '1.738', 'DAMAGECOUNT': '2.067', 'FRAGCOUNT': '7.000'} [2023-02-24 17:52:19,543][177172] DAMAGECOUNT value on done: 25228.0 [2023-02-24 17:52:19,544][177172] Sum rewards: 5.688, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.500', 'AMMO2': '0.014', 'AMMO5': '0.014', 'WEAPON1': '0.050', 'AMMO3': '0.067', 'AMMO4': '0.067', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon7': '0.238', 'HITCOUNT': '0.320', 'WEAPON5': '0.350', 'weapon4': '0.400', 'WEAPON3': '0.450', 'weapon2': '0.670', 'weapon3': '1.204', 'DAMAGECOUNT': '2.127', 'FRAGCOUNT': '4.000'} [2023-02-24 17:52:19,658][177153] Updated weights for policy 0, policy_version 6030 (0.0008) [2023-02-24 17:52:19,804][177158] DAMAGECOUNT value on done: 24820.0 [2023-02-24 17:52:19,805][177158] Sum rewards: 5.953, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.446', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.022', 'weapon7': '0.058', 'AMMO3': '0.059', 'AMMO4': '0.088', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'WEAPON3': '0.450', 'HITCOUNT': '0.460', 'weapon4': '0.486', 'weapon3': '1.094', 'weapon2': '1.584', 'DAMAGECOUNT': '1.701', 'FRAGCOUNT': '5.000'} [2023-02-24 17:52:19,845][177172] DAMAGECOUNT value on done: 25410.0 [2023-02-24 17:52:19,846][177172] Sum rewards: 0.490, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.626', 'AMMO2': '0.027', 'weapon7': '0.032', 'AMMO5': '0.035', 'ARMOR': '0.056', 'WEAPON1': '0.080', 'AMMO4': '0.133', 'AMMO3': '0.144', 'weapon5': '0.156', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.280', 'weapon4': '0.360', 'WEAPON5': '0.650', 'WEAPON3': '0.850', 'weapon2': '0.898', 'DAMAGECOUNT': '0.963', 'weapon3': '1.932', 'FRAGCOUNT': '3.000'} [2023-02-24 17:52:20,100][177158] DAMAGECOUNT value on done: 26040.0 [2023-02-24 17:52:20,101][177158] Sum rewards: 2.826, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.724', 'AMMO5': '0.010', 'AMMO2': '0.021', 'ARMOR': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.099', 'AMMO4': '0.105', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.460', 'weapon4': '0.478', 'WEAPON3': '0.650', 'weapon3': '1.374', 'DAMAGECOUNT': '1.566', 'weapon2': '1.616', 'FRAGCOUNT': '4.000'} [2023-02-24 17:52:20,179][177154] DAMAGECOUNT value on done: 28537.0 [2023-02-24 17:52:20,179][177154] Sum rewards: -0.556, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.038', 'AMMO2': '0.011', 'AMMO5': '0.015', 'ARMOR': '0.024', 'WEAPON1': '0.030', 'AMMO4': '0.054', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'HITCOUNT': '0.180', 'weapon4': '0.184', 'WEAPON5': '0.250', 'weapon5': '0.258', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.585', 'weapon2': '1.428', 'weapon3': '1.530', 'FRAGCOUNT': '2.000'} [2023-02-24 17:52:20,478][177154] DAMAGECOUNT value on done: 25915.0 [2023-02-24 17:52:20,479][177154] Sum rewards: -3.784, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.654', 'AMMO2': '0.011', 'AMMO5': '0.018', 'AMMO4': '0.056', 'WEAPON1': '0.060', 'AMMO3': '0.186', 'weapon5': '0.206', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.456', 'HITCOUNT': '0.490', 'weapon2': '0.926', 'WEAPON3': '1.100', 'weapon3': '2.050', 'DAMAGECOUNT': '2.310', 'FRAGCOUNT': '3.000'} [2023-02-24 17:52:20,730][177172] DAMAGECOUNT value on done: 26531.0 [2023-02-24 17:52:20,730][177172] Sum rewards: 2.648, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.850', 'AMMO5': '0.017', 'AMMO2': '0.026', 'AMMO3': '0.077', 'weapon4': '0.088', 'WEAPON1': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.127', 'weapon5': '0.280', 'HITCOUNT': '0.450', 'WEAPON3': '0.500', 'WEAPON5': '0.500', 'weapon3': '1.528', 'weapon2': '1.656', 'DAMAGECOUNT': '2.049', 'FRAGCOUNT': '3.500'} [2023-02-24 17:52:20,733][177154] DAMAGECOUNT value on done: 27042.0 [2023-02-24 17:52:20,733][177154] Sum rewards: 3.538, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.017', 'AMMO2': '0.019', 'AMMO3': '0.054', 'WEAPON1': '0.070', 'weapon7': '0.094', 'AMMO4': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.146', 'HITCOUNT': '0.210', 'HEALTH': '0.296', 'WEAPON5': '0.350', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.807', 'weapon3': '1.354', 'weapon2': '1.874', 'FRAGCOUNT': '2.000'} [2023-02-24 17:52:20,985][177171] DAMAGECOUNT value on done: 25792.0 [2023-02-24 17:52:20,985][177171] Sum rewards: -4.276, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.428', 'AMMO5': '0.017', 'AMMO2': '0.020', 'ARMOR': '0.024', 'WEAPON1': '0.060', 'AMMO4': '0.101', 'AMMO3': '0.142', 'weapon5': '0.146', 'HITCOUNT': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.554', 'weapon2': '0.910', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.032', 'weapon3': '1.836', 'FRAGCOUNT': '2.000'} [2023-02-24 17:52:21,033][177172] DAMAGECOUNT value on done: 24885.0 [2023-02-24 17:52:21,033][177154] DAMAGECOUNT value on done: 26205.0 [2023-02-24 17:52:21,033][177172] Sum rewards: 0.980, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.966', 'AMMO5': '0.009', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'AMMO4': '0.081', 'AMMO3': '0.113', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'weapon4': '0.316', 'HITCOUNT': '0.330', 'WEAPON3': '0.650', 'weapon2': '0.992', 'DAMAGECOUNT': '1.164', 'FRAGCOUNT': '1.500', 'weapon3': '2.154'} [2023-02-24 17:52:21,033][177154] Sum rewards: 1.706, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.106', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'AMMO3': '0.040', 'AMMO4': '0.081', 'HITCOUNT': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.208', 'WEAPON4': '0.250', 'WEAPON3': '0.250', 'weapon4': '0.280', 'DAMAGECOUNT': '0.777', 'weapon3': '0.888', 'FRAGCOUNT': '1.000', 'weapon2': '2.056'} [2023-02-24 17:52:21,282][177171] DAMAGECOUNT value on done: 25015.0 [2023-02-24 17:52:21,307][177157] DAMAGECOUNT value on done: 29346.0 [2023-02-24 17:52:21,307][177157] Sum rewards: 1.566, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.154', 'AMMO5': '0.012', 'weapon4': '0.020', 'AMMO2': '0.024', 'WEAPON1': '0.050', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'AMMO4': '0.119', 'weapon5': '0.216', 'WEAPON5': '0.300', 'HITCOUNT': '0.410', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.536', 'weapon3': '1.684', 'weapon2': '1.738'} [2023-02-24 17:52:21,346][177171] DAMAGECOUNT value on done: 25620.0 [2023-02-24 17:52:21,346][177171] Sum rewards: -3.343, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.196', 'AMMO2': '0.008', 'ARMOR': '0.020', 'AMMO5': '0.032', 'AMMO4': '0.037', 'WEAPON1': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.145', 'HITCOUNT': '0.180', 'weapon5': '0.194', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon7': '0.224', 'weapon4': '0.286', 'WEAPON5': '0.650', 'WEAPON3': '0.900', 'weapon2': '0.932', 'weapon3': '1.602', 'DAMAGECOUNT': '1.953', 'FRAGCOUNT': '3.000'} [2023-02-24 17:52:21,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.6, 300 sec: 13981.9). Total num frames: 24719360. Throughput: 0: 3497.5. Samples: 6174520. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 17:52:21,376][177119] Avg episode reward: [(0, '0.663')] [2023-02-24 17:52:21,614][177157] DAMAGECOUNT value on done: 26821.0 [2023-02-24 17:52:21,615][177157] Sum rewards: 4.534, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.814', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.011', 'WEAPON1': '0.020', 'ARMOR': '0.025', 'AMMO3': '0.089', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'HITCOUNT': '0.440', 'WEAPON3': '0.550', 'weapon3': '1.334', 'DAMAGECOUNT': '2.172', 'weapon2': '2.302', 'FRAGCOUNT': '5.000'} [2023-02-24 17:52:21,624][177157] DAMAGECOUNT value on done: 27927.0 [2023-02-24 17:52:21,624][177157] Sum rewards: -1.743, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.675', 'AMMO5': '0.017', 'AMMO2': '0.021', 'ARMOR': '0.036', 'WEAPON1': '0.090', 'AMMO4': '0.103', 'AMMO3': '0.135', 'weapon5': '0.178', 'weapon4': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.500', 'HITCOUNT': '0.540', 'weapon2': '0.838', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.848', 'weapon3': '2.290'} [2023-02-24 17:52:21,649][177171] DAMAGECOUNT value on done: 26856.0 [2023-02-24 17:52:21,649][177171] Sum rewards: -0.673, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.626', 'ARMOR': '0.005', 'AMMO2': '0.016', 'AMMO5': '0.019', 'WEAPON1': '0.070', 'AMMO3': '0.078', 'AMMO4': '0.080', 'HITCOUNT': '0.190', 'weapon5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.002', 'weapon2': '1.270', 'weapon3': '1.522', 'FRAGCOUNT': '2.000'} [2023-02-24 17:52:21,902][177155] DAMAGECOUNT value on done: 25995.0 [2023-02-24 17:52:21,902][177155] Sum rewards: 5.258, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.000', 'AMMO2': '0.015', 'AMMO5': '0.024', 'AMMO3': '0.060', 'WEAPON1': '0.070', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'HITCOUNT': '0.290', 'weapon5': '0.304', 'weapon4': '0.398', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'ARMOR': '0.812', 'weapon3': '1.130', 'weapon2': '1.188', 'DAMAGECOUNT': '2.343', 'FRAGCOUNT': '7.000'} [2023-02-24 17:52:21,925][177157] DAMAGECOUNT value on done: 25437.0 [2023-02-24 17:52:21,926][177157] Sum rewards: -0.163, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.602', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon4': '0.032', 'WEAPON1': '0.070', 'AMMO4': '0.074', 'ARMOR': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'weapon5': '0.238', 'HITCOUNT': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'weapon2': '1.072', 'DAMAGECOUNT': '1.296', 'weapon3': '2.086', 'FRAGCOUNT': '3.000'} [2023-02-24 17:52:22,195][177155] DAMAGECOUNT value on done: 28650.0 [2023-02-24 17:52:22,196][177155] Sum rewards: 2.744, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.012', 'AMMO2': '0.030', 'WEAPON1': '0.060', 'AMMO3': '0.112', 'WEAPON4': '0.150', 'AMMO4': '0.151', 'weapon4': '0.232', 'HITCOUNT': '0.260', 'weapon5': '0.292', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HEALTH': '0.628', 'weapon2': '1.024', 'weapon3': '1.812', 'DAMAGECOUNT': '1.830', 'FRAGCOUNT': '3.500'} [2023-02-24 17:52:22,340][177155] DAMAGECOUNT value on done: 27328.0 [2023-02-24 17:52:22,340][177155] Sum rewards: -0.944, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.778', 'AMMO2': '0.004', 'weapon4': '0.012', 'AMMO5': '0.012', 'AMMO4': '0.017', 'ARMOR': '0.033', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.087', 'HITCOUNT': '0.190', 'weapon5': '0.278', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.512', 'weapon2': '1.616', 'weapon3': '1.622'} [2023-02-24 17:52:22,580][177153] Updated weights for policy 0, policy_version 6040 (0.0008) [2023-02-24 17:52:22,634][177155] DAMAGECOUNT value on done: 27009.0 [2023-02-24 17:52:22,634][177155] Sum rewards: -2.741, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.688', 'AMMO5': '0.011', 'ARMOR': '0.024', 'AMMO2': '0.036', 'weapon5': '0.090', 'AMMO3': '0.133', 'AMMO4': '0.179', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'HITCOUNT': '0.390', 'weapon4': '0.394', 'WEAPON3': '0.750', 'weapon2': '1.264', 'FRAGCOUNT': '1.500', 'weapon3': '1.534', 'DAMAGECOUNT': '1.542'} [2023-02-24 17:52:24,657][177157] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 17:52:25,328][177156] DAMAGECOUNT value on done: 26574.0 [2023-02-24 17:52:25,328][177156] Sum rewards: 7.026, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.942', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'weapon4': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.062', 'weapon5': '0.160', 'WEAPON5': '0.350', 'HITCOUNT': '0.360', 'WEAPON3': '0.450', 'weapon3': '1.332', 'weapon2': '1.792', 'DAMAGECOUNT': '2.319', 'FRAGCOUNT': '7.000'} [2023-02-24 17:52:25,507][177153] Updated weights for policy 0, policy_version 6050 (0.0008) [2023-02-24 17:52:25,623][177156] DAMAGECOUNT value on done: 26715.0 [2023-02-24 17:52:25,624][177156] Sum rewards: 1.995, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.664', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.036', 'WEAPON1': '0.040', 'ARMOR': '0.052', 'AMMO3': '0.124', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.322', 'HITCOUNT': '0.350', 'WEAPON3': '0.800', 'weapon2': '0.950', 'DAMAGECOUNT': '1.638', 'weapon3': '2.104', 'FRAGCOUNT': '4.000'} [2023-02-24 17:52:25,716][177156] DAMAGECOUNT value on done: 27217.0 [2023-02-24 17:52:25,716][177156] Sum rewards: -1.457, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.530', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.020', 'WEAPON1': '0.090', 'AMMO4': '0.099', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.156', 'HITCOUNT': '0.260', 'weapon5': '0.380', 'FRAGCOUNT': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'weapon2': '1.348', 'weapon3': '1.564', 'DAMAGECOUNT': '1.626'} [2023-02-24 17:52:26,015][177156] DAMAGECOUNT value on done: 28579.0 [2023-02-24 17:52:26,015][177156] Sum rewards: -0.159, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.736', 'AMMO2': '0.003', 'AMMO4': '0.017', 'AMMO5': '0.028', 'ARMOR': '0.028', 'WEAPON1': '0.060', 'AMMO3': '0.122', 'weapon5': '0.300', 'HITCOUNT': '0.310', 'WEAPON4': '0.400', 'weapon4': '0.628', 'WEAPON5': '0.650', 'weapon2': '0.792', 'WEAPON3': '0.850', 'weapon3': '1.578', 'DAMAGECOUNT': '2.061', 'FRAGCOUNT': '3.000'} [2023-02-24 17:52:26,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 13981.9). Total num frames: 24788992. Throughput: 0: 3496.3. Samples: 6195494. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:52:26,376][177119] Avg episode reward: [(0, '0.721')] [2023-02-24 17:52:28,429][177153] Updated weights for policy 0, policy_version 6060 (0.0008) [2023-02-24 17:52:28,673][177157] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 17:52:31,348][177153] Updated weights for policy 0, policy_version 6070 (0.0008) [2023-02-24 17:52:31,376][177119] Fps is (10 sec: 14336.1, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 24862720. Throughput: 0: 3494.9. Samples: 6216436. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:52:31,376][177119] Avg episode reward: [(0, '0.721')] [2023-02-24 17:52:34,283][177153] Updated weights for policy 0, policy_version 6080 (0.0008) [2023-02-24 17:52:36,376][177119] Fps is (10 sec: 14335.8, 60 sec: 13994.6, 300 sec: 13995.8). Total num frames: 24932352. Throughput: 0: 3495.3. Samples: 6226948. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 17:52:36,376][177119] Avg episode reward: [(0, '0.721')] [2023-02-24 17:52:37,202][177153] Updated weights for policy 0, policy_version 6090 (0.0008) [2023-02-24 17:52:37,496][177170] DAMAGECOUNT value on done: 27259.0 [2023-02-24 17:52:37,497][177170] Sum rewards: -0.257, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.480', 'AMMO5': '0.014', 'AMMO2': '0.023', 'ARMOR': '0.024', 'WEAPON1': '0.050', 'weapon5': '0.102', 'AMMO4': '0.116', 'AMMO3': '0.129', 'WEAPON4': '0.250', 'weapon4': '0.270', 'WEAPON5': '0.350', 'HITCOUNT': '0.470', 'weapon2': '0.940', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.908', 'weapon3': '2.126', 'FRAGCOUNT': '5.000'} [2023-02-24 17:52:37,569][177170] DAMAGECOUNT value on done: 24869.0 [2023-02-24 17:52:37,569][177170] Sum rewards: -4.529, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.132', 'AMMO2': '0.015', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'ARMOR': '0.052', 'AMMO3': '0.064', 'AMMO4': '0.075', 'weapon5': '0.148', 'HITCOUNT': '0.260', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'WEAPON4': '0.450', 'FRAGCOUNT': '0.500', 'weapon4': '0.674', 'DAMAGECOUNT': '0.819', 'weapon3': '0.904', 'weapon2': '0.934'} [2023-02-24 17:52:37,794][177170] DAMAGECOUNT value on done: 30562.0 [2023-02-24 17:52:37,795][177170] Sum rewards: -1.987, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.749', 'AMMO5': '0.010', 'AMMO2': '0.023', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.122', 'HITCOUNT': '0.210', 'weapon5': '0.224', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.263', 'weapon2': '1.514', 'weapon3': '1.872', 'FRAGCOUNT': '2.000'} [2023-02-24 17:52:37,829][177158] DAMAGECOUNT value on done: 26341.0 [2023-02-24 17:52:37,829][177158] Sum rewards: 0.533, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.054', 'ARMOR': '0.008', 'AMMO2': '0.018', 'AMMO5': '0.026', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO4': '0.090', 'AMMO3': '0.123', 'weapon4': '0.178', 'weapon5': '0.236', 'HITCOUNT': '0.340', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'weapon2': '1.324', 'DAMAGECOUNT': '1.731', 'weapon3': '1.842', 'FRAGCOUNT': '4.000'} [2023-02-24 17:52:37,865][177170] DAMAGECOUNT value on done: 29620.0 [2023-02-24 17:52:37,866][177170] Sum rewards: 1.869, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.625', 'AMMO2': '0.009', 'AMMO5': '0.023', 'ARMOR': '0.036', 'WEAPON1': '0.040', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'weapon4': '0.098', 'AMMO3': '0.112', 'weapon5': '0.264', 'WEAPON5': '0.450', 'HITCOUNT': '0.510', 'WEAPON3': '0.800', 'weapon2': '1.380', 'weapon3': '1.888', 'DAMAGECOUNT': '2.541', 'FRAGCOUNT': '3.500'} [2023-02-24 17:52:38,141][177158] DAMAGECOUNT value on done: 26378.0 [2023-02-24 17:52:38,141][177158] Sum rewards: 0.072, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.292', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO3': '0.081', 'AMMO4': '0.083', 'HITCOUNT': '0.180', 'WEAPON5': '0.200', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.585', 'FRAGCOUNT': '1.000', 'weapon2': '1.384', 'weapon3': '1.566'} [2023-02-24 17:52:38,752][177172] DAMAGECOUNT value on done: 25639.0 [2023-02-24 17:52:38,753][177172] Sum rewards: -2.609, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.290', 'AMMO5': '0.012', 'AMMO2': '0.022', 'WEAPON1': '0.060', 'AMMO4': '0.111', 'AMMO3': '0.114', 'WEAPON4': '0.150', 'weapon4': '0.154', 'weapon5': '0.250', 'WEAPON5': '0.350', 'HITCOUNT': '0.370', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.233', 'weapon2': '1.402', 'weapon3': '1.752'} [2023-02-24 17:52:38,953][177158] DAMAGECOUNT value on done: 25281.0 [2023-02-24 17:52:38,954][177158] Sum rewards: 2.318, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.159', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO2': '0.021', 'ARMOR': '0.024', 'WEAPON1': '0.040', 'weapon5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.120', 'WEAPON5': '0.200', 'HITCOUNT': '0.380', 'WEAPON3': '0.800', 'weapon2': '1.244', 'DAMAGECOUNT': '1.371', 'weapon3': '2.504', 'FRAGCOUNT': '4.000'} [2023-02-24 17:52:39,047][177172] DAMAGECOUNT value on done: 25556.0 [2023-02-24 17:52:39,048][177172] Sum rewards: 0.616, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.238', 'AMMO5': '0.003', 'AMMO2': '0.007', 'ARMOR': '0.008', 'AMMO4': '0.035', 'WEAPON1': '0.040', 'weapon7': '0.046', 'AMMO3': '0.055', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.160', 'weapon4': '0.190', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'DAMAGECOUNT': '0.438', 'WEAPON3': '0.450', 'weapon3': '1.166', 'weapon2': '1.636', 'FRAGCOUNT': '2.000'} [2023-02-24 17:52:39,248][177158] DAMAGECOUNT value on done: 26647.0 [2023-02-24 17:52:39,249][177158] Sum rewards: 4.008, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.296', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.094', 'AMMO4': '0.135', 'weapon4': '0.190', 'WEAPON5': '0.200', 'weapon5': '0.210', 'HITCOUNT': '0.300', 'WEAPON3': '0.650', 'weapon3': '1.216', 'weapon2': '1.602', 'DAMAGECOUNT': '1.821', 'FRAGCOUNT': '4.000'} [2023-02-24 17:52:39,338][177154] DAMAGECOUNT value on done: 29286.0 [2023-02-24 17:52:39,338][177154] Sum rewards: 3.925, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.495', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.036', 'WEAPON1': '0.050', 'AMMO3': '0.104', 'WEAPON5': '0.250', 'weapon5': '0.266', 'HITCOUNT': '0.440', 'WEAPON3': '0.700', 'weapon2': '1.372', 'weapon3': '1.938', 'DAMAGECOUNT': '2.247', 'FRAGCOUNT': '3.000'} [2023-02-24 17:52:39,630][177154] DAMAGECOUNT value on done: 26697.0 [2023-02-24 17:52:39,630][177154] Sum rewards: 9.814, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.808', 'AMMO5': '0.007', 'ARMOR': '0.026', 'AMMO2': '0.033', 'WEAPON1': '0.040', 'AMMO3': '0.057', 'AMMO4': '0.164', 'WEAPON4': '0.200', 'weapon5': '0.228', 'WEAPON5': '0.250', 'HITCOUNT': '0.390', 'WEAPON3': '0.450', 'weapon4': '0.554', 'weapon3': '1.064', 'weapon2': '1.312', 'DAMAGECOUNT': '2.346', 'FRAGCOUNT': '8.000'} [2023-02-24 17:52:39,887][177154] DAMAGECOUNT value on done: 27271.0 [2023-02-24 17:52:39,887][177154] Sum rewards: -0.635, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.141', 'AMMO5': '0.017', 'AMMO2': '0.030', 'AMMO3': '0.065', 'WEAPON1': '0.080', 'AMMO4': '0.148', 'HITCOUNT': '0.220', 'weapon5': '0.298', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.687', 'weapon3': '1.472', 'weapon2': '1.888'} [2023-02-24 17:52:39,931][177172] DAMAGECOUNT value on done: 26866.0 [2023-02-24 17:52:39,931][177172] Sum rewards: 1.061, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.846', 'AMMO5': '0.020', 'AMMO2': '0.021', 'ARMOR': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.090', 'AMMO4': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.170', 'HITCOUNT': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.350', 'WEAPON5': '0.500', 'weapon4': '0.530', 'WEAPON3': '0.550', 'weapon2': '0.756', 'DAMAGECOUNT': '1.005', 'weapon3': '1.558', 'FRAGCOUNT': '2.000'} [2023-02-24 17:52:40,122][177170] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 17:52:40,147][177153] Updated weights for policy 0, policy_version 6100 (0.0008) [2023-02-24 17:52:40,187][177171] DAMAGECOUNT value on done: 26812.0 [2023-02-24 17:52:40,188][177171] Sum rewards: 0.411, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.992', 'ARMOR': '0.008', 'AMMO2': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.050', 'WEAPON1': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.154', 'weapon5': '0.258', 'weapon4': '0.346', 'WEAPON5': '0.400', 'HITCOUNT': '0.620', 'weapon2': '0.904', 'WEAPON3': '1.000', 'weapon3': '2.126', 'FRAGCOUNT': '3.000', 'DAMAGECOUNT': '3.060'} [2023-02-24 17:52:40,189][177154] DAMAGECOUNT value on done: 26995.0 [2023-02-24 17:52:40,189][177154] Sum rewards: 4.313, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.970', 'AMMO2': '0.005', 'AMMO5': '0.012', 'ARMOR': '0.025', 'AMMO4': '0.027', 'WEAPON1': '0.070', 'AMMO3': '0.113', 'weapon5': '0.226', 'WEAPON5': '0.350', 'HITCOUNT': '0.560', 'WEAPON3': '0.750', 'weapon2': '1.184', 'weapon3': '2.090', 'DAMAGECOUNT': '2.370', 'FRAGCOUNT': '5.000'} [2023-02-24 17:52:40,232][177172] DAMAGECOUNT value on done: 25195.0 [2023-02-24 17:52:40,232][177172] Sum rewards: -2.037, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.485', 'AMMO5': '0.010', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'AMMO3': '0.118', 'AMMO4': '0.122', 'HITCOUNT': '0.190', 'weapon5': '0.198', 'WEAPON4': '0.200', 'weapon4': '0.220', 'WEAPON5': '0.250', 'ARMOR': '0.463', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.930', 'FRAGCOUNT': '1.000', 'weapon2': '1.550', 'weapon3': '1.632'} [2023-02-24 17:52:40,489][177171] DAMAGECOUNT value on done: 25636.0 [2023-02-24 17:52:40,545][177171] DAMAGECOUNT value on done: 26010.0 [2023-02-24 17:52:40,545][177171] Sum rewards: 1.713, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.658', 'AMMO5': '0.015', 'AMMO2': '0.024', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO4': '0.118', 'AMMO3': '0.124', 'weapon4': '0.192', 'weapon5': '0.202', 'HITCOUNT': '0.260', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.170', 'weapon3': '1.520', 'weapon2': '1.576', 'FRAGCOUNT': '5.000'} [2023-02-24 17:52:40,575][177157] DAMAGECOUNT value on done: 29814.0 [2023-02-24 17:52:40,575][177157] Sum rewards: -0.199, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.534', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO2': '0.026', 'WEAPON1': '0.040', 'AMMO3': '0.077', 'weapon5': '0.106', 'AMMO4': '0.129', 'weapon4': '0.148', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.270', 'WEAPON3': '0.600', 'weapon2': '0.900', 'DAMAGECOUNT': '1.404', 'FRAGCOUNT': '1.500', 'weapon3': '1.704'} [2023-02-24 17:52:40,843][177171] DAMAGECOUNT value on done: 27046.0 [2023-02-24 17:52:40,880][177157] DAMAGECOUNT value on done: 27748.0 [2023-02-24 17:52:40,880][177157] Sum rewards: 5.476, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.324', 'AMMO5': '0.009', 'AMMO2': '0.014', 'WEAPON1': '0.040', 'AMMO4': '0.070', 'AMMO3': '0.083', 'weapon5': '0.104', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.422', 'ARMOR': '0.461', 'WEAPON3': '0.500', 'HITCOUNT': '0.620', 'weapon3': '1.418', 'weapon2': '1.586', 'DAMAGECOUNT': '2.772', 'FRAGCOUNT': '4.000'} [2023-02-24 17:52:40,890][177157] DAMAGECOUNT value on done: 28560.0 [2023-02-24 17:52:40,890][177157] Sum rewards: -0.406, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.015', 'AMMO2': '0.010', 'AMMO5': '0.021', 'WEAPON1': '0.030', 'AMMO4': '0.050', 'AMMO3': '0.120', 'weapon5': '0.318', 'HITCOUNT': '0.420', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'weapon3': '1.514', 'weapon2': '1.776', 'DAMAGECOUNT': '1.899', 'FRAGCOUNT': '2.500'} [2023-02-24 17:52:41,100][177155] DAMAGECOUNT value on done: 26489.0 [2023-02-24 17:52:41,100][177155] Sum rewards: 0.996, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.015', 'ARMOR': '0.020', 'AMMO2': '0.030', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'AMMO4': '0.149', 'weapon5': '0.174', 'weapon4': '0.248', 'HEALTH': '0.282', 'WEAPON5': '0.300', 'HITCOUNT': '0.420', 'WEAPON3': '0.700', 'weapon2': '1.140', 'DAMAGECOUNT': '1.482', 'weapon3': '1.782', 'FRAGCOUNT': '3.000'} [2023-02-24 17:52:41,187][177157] DAMAGECOUNT value on done: 26014.0 [2023-02-24 17:52:41,187][177157] Sum rewards: 1.534, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.296', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO3': '0.080', 'WEAPON1': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.138', 'weapon4': '0.202', 'weapon5': '0.294', 'ARMOR': '0.400', 'HITCOUNT': '0.410', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon2': '0.750', 'DAMAGECOUNT': '1.731', 'FRAGCOUNT': '2.000', 'weapon3': '2.042'} [2023-02-24 17:52:41,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 25001984. Throughput: 0: 3494.6. Samples: 6247908. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 17:52:41,376][177119] Avg episode reward: [(0, '0.800')] [2023-02-24 17:52:41,380][177155] DAMAGECOUNT value on done: 29080.0 [2023-02-24 17:52:41,380][177155] Sum rewards: 3.879, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.025', 'AMMO5': '0.005', 'ARMOR': '0.030', 'WEAPON1': '0.040', 'AMMO2': '0.040', 'weapon5': '0.058', 'AMMO3': '0.064', 'weapon7': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.201', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'WEAPON3': '0.400', 'weapon4': '0.622', 'weapon2': '1.128', 'weapon3': '1.280', 'DAMAGECOUNT': '1.290', 'FRAGCOUNT': '3.000'} [2023-02-24 17:52:41,509][177155] DAMAGECOUNT value on done: 27886.0 [2023-02-24 17:52:41,509][177155] Sum rewards: 4.939, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.290', 'AMMO2': '0.009', 'AMMO5': '0.022', 'AMMO4': '0.044', 'WEAPON1': '0.070', 'AMMO3': '0.097', 'WEAPON4': '0.250', 'weapon5': '0.272', 'HITCOUNT': '0.370', 'ARMOR': '0.494', 'WEAPON5': '0.550', 'weapon4': '0.648', 'WEAPON3': '0.700', 'weapon3': '1.372', 'weapon2': '1.406', 'DAMAGECOUNT': '1.674', 'FRAGCOUNT': '5.000'} [2023-02-24 17:52:41,812][177155] DAMAGECOUNT value on done: 27600.0 [2023-02-24 17:52:41,813][177155] Sum rewards: 1.814, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.316', 'AMMO2': '0.008', 'AMMO5': '0.012', 'weapon4': '0.028', 'WEAPON1': '0.030', 'AMMO4': '0.040', 'ARMOR': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.145', 'weapon5': '0.298', 'WEAPON5': '0.350', 'HITCOUNT': '0.390', 'WEAPON3': '0.950', 'weapon2': '1.308', 'DAMAGECOUNT': '1.773', 'weapon3': '1.900', 'FRAGCOUNT': '5.000'} [2023-02-24 17:52:43,042][177153] Updated weights for policy 0, policy_version 6110 (0.0008) [2023-02-24 17:52:44,612][177156] DAMAGECOUNT value on done: 27067.0 [2023-02-24 17:52:44,612][177156] Sum rewards: -0.226, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.880', 'AMMO2': '0.015', 'AMMO5': '0.024', 'WEAPON1': '0.040', 'AMMO4': '0.073', 'AMMO3': '0.135', 'WEAPON4': '0.300', 'weapon4': '0.402', 'HITCOUNT': '0.410', 'weapon5': '0.462', 'WEAPON5': '0.500', 'ARMOR': '0.504', 'weapon2': '0.672', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.479', 'weapon3': '1.838', 'FRAGCOUNT': '3.000'} [2023-02-24 17:52:44,915][177156] DAMAGECOUNT value on done: 27156.0 [2023-02-24 17:52:44,916][177156] Sum rewards: 1.931, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.726', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon7': '0.070', 'ARMOR': '0.076', 'WEAPON1': '0.080', 'AMMO4': '0.084', 'AMMO3': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.204', 'HITCOUNT': '0.210', 'WEAPON5': '0.300', 'weapon4': '0.376', 'WEAPON3': '0.750', 'weapon2': '1.292', 'DAMAGECOUNT': '1.323', 'weapon3': '1.670', 'FRAGCOUNT': '4.000'} [2023-02-24 17:52:45,007][177156] DAMAGECOUNT value on done: 27642.0 [2023-02-24 17:52:45,007][177156] Sum rewards: 3.616, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.390', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.009', 'WEAPON1': '0.030', 'AMMO3': '0.095', 'weapon7': '0.096', 'weapon5': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.386', 'HITCOUNT': '0.430', 'WEAPON3': '0.600', 'weapon3': '1.058', 'DAMAGECOUNT': '1.275', 'weapon2': '1.582', 'FRAGCOUNT': '6.000'} [2023-02-24 17:52:45,311][177156] DAMAGECOUNT value on done: 29179.0 [2023-02-24 17:52:45,311][177156] Sum rewards: 4.548, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.183', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'weapon5': '0.048', 'AMMO4': '0.066', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.284', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'weapon3': '1.484', 'weapon2': '1.538', 'DAMAGECOUNT': '1.800', 'FRAGCOUNT': '4.000'} [2023-02-24 17:52:45,951][177153] Updated weights for policy 0, policy_version 6120 (0.0009) [2023-02-24 17:52:46,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 25071616. Throughput: 0: 3495.2. Samples: 6268938. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:52:46,376][177119] Avg episode reward: [(0, '0.979')] [2023-02-24 17:52:48,888][177153] Updated weights for policy 0, policy_version 6130 (0.0008) [2023-02-24 17:52:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.6, 300 sec: 13995.8). Total num frames: 25141248. Throughput: 0: 3496.7. Samples: 6279458. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:52:51,376][177119] Avg episode reward: [(0, '0.979')] [2023-02-24 17:52:51,751][177153] Updated weights for policy 0, policy_version 6140 (0.0008) [2023-02-24 17:52:54,703][177153] Updated weights for policy 0, policy_version 6150 (0.0008) [2023-02-24 17:52:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 25210880. Throughput: 0: 3495.6. Samples: 6300422. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 17:52:56,376][177119] Avg episode reward: [(0, '0.979')] [2023-02-24 17:52:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000006155_25210880.pth... [2023-02-24 17:52:56,439][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000005336_21856256.pth [2023-02-24 17:52:56,514][177170] DAMAGECOUNT value on done: 27758.0 [2023-02-24 17:52:56,515][177170] Sum rewards: -4.077, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.942', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.019', 'AMMO5': '0.024', 'AMMO3': '0.060', 'WEAPON1': '0.060', 'AMMO4': '0.095', 'HITCOUNT': '0.230', 'weapon5': '0.270', 'WEAPON4': '0.450', 'weapon4': '0.480', 'ARMOR': '0.485', 'WEAPON5': '0.500', 'WEAPON3': '0.500', 'weapon3': '1.318', 'weapon2': '1.376', 'DAMAGECOUNT': '1.497'} [2023-02-24 17:52:56,601][177170] DAMAGECOUNT value on done: 24995.0 [2023-02-24 17:52:56,602][177170] Sum rewards: 2.294, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.007', 'AMMO3': '0.020', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'weapon7': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON3': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'weapon5': '0.180', 'DAMAGECOUNT': '0.378', 'weapon3': '0.486', 'weapon4': '0.498', 'HEALTH': '0.500', 'FRAGCOUNT': '1.000', 'weapon2': '1.164'} [2023-02-24 17:52:56,818][177170] DAMAGECOUNT value on done: 30809.0 [2023-02-24 17:52:56,818][177170] Sum rewards: 0.510, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.200', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON1': '0.020', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'HITCOUNT': '0.190', 'WEAPON4': '0.300', 'weapon2': '0.308', 'WEAPON3': '0.500', 'weapon4': '0.612', 'DAMAGECOUNT': '0.741', 'weapon3': '1.340', 'FRAGCOUNT': '2.000'} [2023-02-24 17:52:56,909][177170] DAMAGECOUNT value on done: 29855.0 [2023-02-24 17:52:56,909][177170] Sum rewards: 2.196, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.362', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO3': '0.030', 'WEAPON1': '0.030', 'weapon5': '0.108', 'WEAPON5': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.250', 'DAMAGECOUNT': '0.705', 'weapon3': '0.762', 'FRAGCOUNT': '1.000', 'weapon2': '2.220'} [2023-02-24 17:52:57,059][177158] DAMAGECOUNT value on done: 26871.0 [2023-02-24 17:52:57,059][177158] Sum rewards: -1.967, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.275', 'AMMO5': '0.015', 'AMMO2': '0.021', 'ARMOR': '0.024', 'WEAPON1': '0.070', 'AMMO4': '0.107', 'AMMO3': '0.107', 'weapon5': '0.218', 'WEAPON4': '0.300', 'weapon4': '0.382', 'WEAPON5': '0.400', 'HITCOUNT': '0.430', 'WEAPON3': '0.750', 'weapon2': '1.128', 'DAMAGECOUNT': '1.590', 'weapon3': '1.766', 'FRAGCOUNT': '2.000'} [2023-02-24 17:52:57,350][177158] DAMAGECOUNT value on done: 26610.0 [2023-02-24 17:52:57,350][177158] Sum rewards: 0.747, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.028', 'AMMO2': '0.009', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.089', 'weapon5': '0.146', 'WEAPON5': '0.200', 'HITCOUNT': '0.230', 'weapon4': '0.296', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.696', 'weapon2': '0.714', 'weapon3': '1.056', 'FRAGCOUNT': '2.000'} [2023-02-24 17:52:57,640][177153] Updated weights for policy 0, policy_version 6160 (0.0008) [2023-02-24 17:52:57,976][177172] DAMAGECOUNT value on done: 25848.0 [2023-02-24 17:52:57,976][177172] Sum rewards: 0.542, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.170', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'AMMO3': '0.079', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'weapon5': '0.232', 'WEAPON5': '0.300', 'weapon4': '0.348', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.627', 'FRAGCOUNT': '1.000', 'weapon2': '1.042', 'weapon3': '1.348'} [2023-02-24 17:52:58,190][177158] DAMAGECOUNT value on done: 25764.0 [2023-02-24 17:52:58,191][177158] Sum rewards: 2.186, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.875', 'AMMO2': '0.011', 'AMMO5': '0.012', 'ARMOR': '0.022', 'WEAPON1': '0.050', 'AMMO4': '0.056', 'weapon5': '0.096', 'AMMO3': '0.106', 'weapon4': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.310', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.449', 'weapon2': '1.458', 'weapon3': '1.598', 'FRAGCOUNT': '5.000'} [2023-02-24 17:52:58,268][177172] DAMAGECOUNT value on done: 26196.0 [2023-02-24 17:52:58,268][177172] Sum rewards: 6.195, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.664', 'AMMO5': '0.010', 'AMMO2': '0.019', 'ARMOR': '0.024', 'WEAPON1': '0.040', 'AMMO3': '0.076', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.242', 'weapon4': '0.282', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'weapon3': '1.092', 'weapon2': '1.232', 'DAMAGECOUNT': '1.920', 'FRAGCOUNT': '5.000'} [2023-02-24 17:52:58,484][177158] DAMAGECOUNT value on done: 27205.0 [2023-02-24 17:52:58,484][177158] Sum rewards: 1.071, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.712', 'weapon7': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.026', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON1': '0.110', 'AMMO3': '0.122', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'weapon5': '0.172', 'HITCOUNT': '0.350', 'ARMOR': '0.400', 'weapon4': '0.490', 'WEAPON5': '0.600', 'weapon2': '0.652', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.674', 'FRAGCOUNT': '2.000', 'weapon3': '2.026'} [2023-02-24 17:52:58,642][177154] DAMAGECOUNT value on done: 29528.0 [2023-02-24 17:52:58,642][177154] Sum rewards: -0.683, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.260', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.086', 'HITCOUNT': '0.100', 'AMMO3': '0.108', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.406', 'weapon2': '0.488', 'ARMOR': '0.500', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.726', 'FRAGCOUNT': '1.000', 'weapon3': '1.268'} [2023-02-24 17:52:58,941][177154] DAMAGECOUNT value on done: 27240.0 [2023-02-24 17:52:58,941][177154] Sum rewards: -0.730, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.620', 'AMMO2': '0.008', 'AMMO5': '0.022', 'AMMO4': '0.037', 'WEAPON1': '0.040', 'AMMO3': '0.091', 'weapon4': '0.132', 'WEAPON4': '0.150', 'weapon5': '0.294', 'WEAPON5': '0.450', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'weapon3': '1.424', 'weapon2': '1.472', 'DAMAGECOUNT': '1.629', 'FRAGCOUNT': '2.000'} [2023-02-24 17:52:59,137][177172] DAMAGECOUNT value on done: 27345.0 [2023-02-24 17:52:59,137][177172] Sum rewards: -2.549, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.946', 'AMMO2': '0.010', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'weapon4': '0.036', 'AMMO4': '0.048', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'HITCOUNT': '0.440', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.437', 'weapon3': '1.488', 'weapon2': '1.840'} [2023-02-24 17:52:59,193][177154] DAMAGECOUNT value on done: 27973.0 [2023-02-24 17:52:59,194][177154] Sum rewards: 2.203, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.962', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.073', 'weapon5': '0.134', 'AMMO3': '0.138', 'weapon7': '0.158', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.400', 'weapon4': '0.560', 'WEAPON3': '0.800', 'weapon2': '0.966', 'weapon3': '1.260', 'DAMAGECOUNT': '2.106', 'FRAGCOUNT': '5.000'} [2023-02-24 17:52:59,431][177172] DAMAGECOUNT value on done: 25469.0 [2023-02-24 17:52:59,431][177172] Sum rewards: -0.041, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.443', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'ARMOR': '0.040', 'AMMO3': '0.050', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'HITCOUNT': '0.190', 'WEAPON3': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.466', 'DAMAGECOUNT': '0.822', 'weapon2': '0.826', 'FRAGCOUNT': '1.000', 'weapon3': '1.182'} [2023-02-24 17:52:59,477][177171] DAMAGECOUNT value on done: 27108.0 [2023-02-24 17:52:59,477][177171] Sum rewards: -0.121, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.012', 'AMMO2': '0.014', 'WEAPON1': '0.040', 'AMMO3': '0.070', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'weapon5': '0.184', 'HITCOUNT': '0.240', 'WEAPON5': '0.300', 'weapon4': '0.314', 'ARMOR': '0.404', 'WEAPON3': '0.450', 'HEALTH': '0.575', 'DAMAGECOUNT': '0.888', 'FRAGCOUNT': '1.000', 'weapon2': '1.342', 'weapon3': '1.374'} [2023-02-24 17:52:59,492][177154] DAMAGECOUNT value on done: 27558.0 [2023-02-24 17:52:59,493][177154] Sum rewards: 2.055, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.716', 'AMMO2': '0.016', 'AMMO5': '0.020', 'AMMO3': '0.070', 'WEAPON1': '0.070', 'AMMO4': '0.078', 'WEAPON4': '0.200', 'weapon5': '0.214', 'weapon4': '0.446', 'HITCOUNT': '0.460', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.316', 'weapon2': '1.392', 'DAMAGECOUNT': '1.689'} [2023-02-24 17:52:59,781][177171] DAMAGECOUNT value on done: 25921.0 [2023-02-24 17:52:59,782][177171] Sum rewards: -1.870, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.041', 'AMMO2': '0.008', 'AMMO5': '0.022', 'AMMO4': '0.041', 'AMMO3': '0.108', 'WEAPON1': '0.110', 'weapon5': '0.178', 'HITCOUNT': '0.300', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.855', 'weapon2': '1.688', 'weapon3': '1.760', 'FRAGCOUNT': '2.000'} [2023-02-24 17:52:59,786][177157] DAMAGECOUNT value on done: 30109.0 [2023-02-24 17:52:59,786][177157] Sum rewards: 1.543, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.975', 'AMMO2': '0.012', 'AMMO5': '0.022', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.111', 'weapon4': '0.200', 'HITCOUNT': '0.210', 'weapon5': '0.310', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.885', 'weapon3': '1.530', 'weapon2': '1.586', 'FRAGCOUNT': '3.000'} [2023-02-24 17:52:59,841][177171] DAMAGECOUNT value on done: 26420.0 [2023-02-24 17:52:59,842][177171] Sum rewards: -0.527, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.200', 'AMMO5': '0.017', 'AMMO2': '0.032', 'WEAPON1': '0.070', 'AMMO3': '0.129', 'weapon5': '0.160', 'AMMO4': '0.162', 'WEAPON4': '0.250', 'HITCOUNT': '0.350', 'ARMOR': '0.424', 'WEAPON5': '0.450', 'weapon4': '0.462', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.230', 'weapon3': '1.416', 'weapon2': '1.420', 'FRAGCOUNT': '4.000'} [2023-02-24 17:53:00,086][177157] DAMAGECOUNT value on done: 28063.0 [2023-02-24 17:53:00,087][177157] Sum rewards: -0.277, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.095', 'AMMO2': '0.014', 'AMMO5': '0.015', 'WEAPON1': '0.060', 'AMMO4': '0.067', 'AMMO3': '0.102', 'weapon5': '0.278', 'WEAPON4': '0.300', 'HITCOUNT': '0.310', 'weapon4': '0.312', 'WEAPON5': '0.350', 'ARMOR': '0.511', 'WEAPON3': '0.700', 'weapon2': '0.770', 'DAMAGECOUNT': '0.945', 'weapon3': '1.584', 'FRAGCOUNT': '2.000'} [2023-02-24 17:53:00,096][177157] DAMAGECOUNT value on done: 28914.0 [2023-02-24 17:53:00,096][177157] Sum rewards: 3.735, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.750', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON1': '0.040', 'AMMO3': '0.060', 'AMMO4': '0.071', 'weapon4': '0.092', 'WEAPON4': '0.100', 'weapon5': '0.140', 'WEAPON5': '0.250', 'HITCOUNT': '0.360', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.062', 'weapon3': '1.150', 'weapon2': '1.888', 'FRAGCOUNT': '4.000'} [2023-02-24 17:53:00,128][177171] DAMAGECOUNT value on done: 27693.0 [2023-02-24 17:53:00,128][177171] Sum rewards: 2.176, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.076', 'AMMO5': '0.025', 'AMMO2': '0.029', 'weapon4': '0.034', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO3': '0.128', 'weapon5': '0.136', 'AMMO4': '0.146', 'HITCOUNT': '0.310', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon2': '1.562', 'weapon3': '1.770', 'DAMAGECOUNT': '1.941', 'FRAGCOUNT': '4.000'} [2023-02-24 17:53:00,328][177155] DAMAGECOUNT value on done: 26884.0 [2023-02-24 17:53:00,328][177155] Sum rewards: 2.131, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.016', 'AMMO5': '0.012', 'AMMO2': '0.016', 'ARMOR': '0.048', 'WEAPON1': '0.060', 'AMMO4': '0.079', 'AMMO3': '0.088', 'WEAPON4': '0.200', 'weapon4': '0.202', 'weapon5': '0.220', 'HITCOUNT': '0.290', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.185', 'weapon3': '1.268', 'weapon2': '1.828', 'FRAGCOUNT': '2.000'} [2023-02-24 17:53:00,398][177157] DAMAGECOUNT value on done: 26704.0 [2023-02-24 17:53:00,398][177157] Sum rewards: -0.048, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.694', 'ARMOR': '0.016', 'AMMO2': '0.021', 'AMMO5': '0.033', 'WEAPON1': '0.060', 'AMMO3': '0.079', 'AMMO4': '0.106', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.350', 'HITCOUNT': '0.350', 'weapon4': '0.356', 'weapon5': '0.398', 'WEAPON3': '0.550', 'WEAPON5': '0.650', 'weapon3': '1.364', 'weapon2': '1.392', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '2.070'} [2023-02-24 17:53:00,616][177153] Updated weights for policy 0, policy_version 6170 (0.0008) [2023-02-24 17:53:00,624][177155] DAMAGECOUNT value on done: 29560.0 [2023-02-24 17:53:00,625][177155] Sum rewards: 3.215, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.590', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO3': '0.036', 'AMMO4': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.126', 'WEAPON5': '0.150', 'weapon5': '0.164', 'WEAPON7': '0.200', 'HITCOUNT': '0.230', 'WEAPON4': '0.250', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'weapon4': '0.478', 'weapon3': '0.612', 'weapon2': '1.044', 'DAMAGECOUNT': '1.440', 'FRAGCOUNT': '2.500'} [2023-02-24 17:53:00,764][177155] DAMAGECOUNT value on done: 28552.0 [2023-02-24 17:53:00,765][177155] Sum rewards: -1.985, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.450', 'ARMOR': '0.024', 'AMMO5': '0.025', 'WEAPON1': '0.050', 'AMMO2': '0.051', 'weapon7': '0.058', 'AMMO3': '0.089', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.184', 'WEAPON7': '0.200', 'AMMO4': '0.257', 'HITCOUNT': '0.350', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon2': '0.594', 'WEAPON3': '0.600', 'weapon4': '0.884', 'weapon3': '1.310', 'DAMAGECOUNT': '1.998', 'FRAGCOUNT': '2.000'} [2023-02-24 17:53:01,060][177155] DAMAGECOUNT value on done: 27754.0 [2023-02-24 17:53:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13981.9). Total num frames: 25280512. Throughput: 0: 3492.7. Samples: 6321270. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 17:53:01,376][177119] Avg episode reward: [(0, '0.971')] [2023-02-24 17:53:03,547][177153] Updated weights for policy 0, policy_version 6180 (0.0008) [2023-02-24 17:53:03,917][177156] DAMAGECOUNT value on done: 27277.0 [2023-02-24 17:53:03,917][177156] Sum rewards: 5.765, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.014', 'AMMO3': '0.050', 'WEAPON1': '0.050', 'weapon5': '0.164', 'HITCOUNT': '0.200', 'WEAPON5': '0.250', 'HEALTH': '0.312', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.630', 'weapon3': '1.208', 'weapon2': '2.274', 'FRAGCOUNT': '4.000'} [2023-02-24 17:53:04,217][177156] DAMAGECOUNT value on done: 27765.0 [2023-02-24 17:53:04,217][177156] Sum rewards: 2.693, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.180', 'AMMO2': '0.007', 'AMMO5': '0.015', 'AMMO4': '0.036', 'WEAPON1': '0.070', 'AMMO3': '0.087', 'weapon5': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.450', 'HITCOUNT': '0.460', 'weapon4': '0.492', 'WEAPON3': '0.650', 'weapon2': '0.834', 'weapon3': '1.572', 'DAMAGECOUNT': '1.827', 'FRAGCOUNT': '3.000'} [2023-02-24 17:53:04,308][177156] DAMAGECOUNT value on done: 27973.0 [2023-02-24 17:53:04,602][177156] DAMAGECOUNT value on done: 29911.0 [2023-02-24 17:53:04,603][177156] Sum rewards: 2.178, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.786', 'AMMO5': '0.013', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'AMMO4': '0.116', 'weapon5': '0.130', 'AMMO3': '0.133', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.390', 'HITCOUNT': '0.460', 'WEAPON3': '0.750', 'ARMOR': '0.972', 'weapon2': '1.234', 'weapon3': '1.656', 'DAMAGECOUNT': '2.196', 'FRAGCOUNT': '4.000'} [2023-02-24 17:53:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.6, 300 sec: 13981.9). Total num frames: 25350144. Throughput: 0: 3496.4. Samples: 6331856. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:53:06,376][177119] Avg episode reward: [(0, '1.058')] [2023-02-24 17:53:06,471][177153] Updated weights for policy 0, policy_version 6190 (0.0009) [2023-02-24 17:53:09,388][177153] Updated weights for policy 0, policy_version 6200 (0.0008) [2023-02-24 17:53:11,376][177119] Fps is (10 sec: 13926.1, 60 sec: 13994.6, 300 sec: 13981.9). Total num frames: 25419776. Throughput: 0: 3496.7. Samples: 6352848. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:53:11,377][177119] Avg episode reward: [(0, '1.058')] [2023-02-24 17:53:12,302][177153] Updated weights for policy 0, policy_version 6210 (0.0008) [2023-02-24 17:53:15,258][177153] Updated weights for policy 0, policy_version 6220 (0.0008) [2023-02-24 17:53:15,713][177170] DAMAGECOUNT value on done: 28376.0 [2023-02-24 17:53:15,713][177170] Sum rewards: 1.468, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.188', 'AMMO5': '0.013', 'AMMO2': '0.027', 'ARMOR': '0.040', 'WEAPON1': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.134', 'weapon4': '0.182', 'weapon5': '0.202', 'WEAPON5': '0.400', 'HITCOUNT': '0.440', 'WEAPON3': '0.750', 'weapon2': '1.028', 'DAMAGECOUNT': '1.854', 'weapon3': '2.262', 'FRAGCOUNT': '3.000'} [2023-02-24 17:53:15,806][177170] DAMAGECOUNT value on done: 25557.0 [2023-02-24 17:53:15,806][177170] Sum rewards: 5.072, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.900', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.029', 'WEAPON1': '0.050', 'AMMO3': '0.105', 'weapon4': '0.142', 'WEAPON4': '0.150', 'HITCOUNT': '0.230', 'weapon5': '0.264', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'weapon3': '1.546', 'DAMAGECOUNT': '1.686', 'weapon2': '1.704', 'FRAGCOUNT': '5.000'} [2023-02-24 17:53:16,026][177170] DAMAGECOUNT value on done: 31551.0 [2023-02-24 17:53:16,026][177170] Sum rewards: -0.725, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.826', 'AMMO5': '0.012', 'AMMO2': '0.018', 'ARMOR': '0.024', 'WEAPON1': '0.070', 'AMMO3': '0.072', 'AMMO4': '0.090', 'weapon5': '0.148', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.448', 'WEAPON3': '0.500', 'HITCOUNT': '0.560', 'weapon3': '1.464', 'FRAGCOUNT': '1.500', 'weapon2': '1.568', 'DAMAGECOUNT': '2.226'} [2023-02-24 17:53:16,125][177170] DAMAGECOUNT value on done: 30356.0 [2023-02-24 17:53:16,126][177170] Sum rewards: 2.755, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.130', 'AMMO2': '0.010', 'AMMO5': '0.017', 'ARMOR': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.051', 'AMMO3': '0.079', 'weapon5': '0.108', 'weapon7': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.230', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'weapon3': '1.456', 'DAMAGECOUNT': '1.503', 'weapon2': '1.776', 'FRAGCOUNT': '2.000'} [2023-02-24 17:53:16,262][177158] DAMAGECOUNT value on done: 27232.0 [2023-02-24 17:53:16,262][177158] Sum rewards: -1.201, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.960', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.033', 'WEAPON1': '0.060', 'AMMO3': '0.103', 'weapon5': '0.126', 'AMMO4': '0.163', 'WEAPON5': '0.200', 'HITCOUNT': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.330', 'WEAPON3': '0.400', 'DAMAGECOUNT': '1.083', 'weapon3': '1.204', 'weapon2': '1.228', 'FRAGCOUNT': '2.000'} [2023-02-24 17:53:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13981.9). Total num frames: 25489408. Throughput: 0: 3496.6. Samples: 6373782. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:53:16,376][177119] Avg episode reward: [(0, '1.162')] [2023-02-24 17:53:16,568][177158] DAMAGECOUNT value on done: 27150.0 [2023-02-24 17:53:16,568][177158] Sum rewards: -0.201, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.259', 'AMMO2': '0.008', 'AMMO5': '0.020', 'ARMOR': '0.036', 'AMMO4': '0.039', 'WEAPON1': '0.070', 'weapon5': '0.096', 'AMMO3': '0.183', 'HITCOUNT': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.406', 'WEAPON5': '0.450', 'weapon2': '0.612', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.620', 'weapon3': '2.068', 'FRAGCOUNT': '4.000'} [2023-02-24 17:53:17,129][177172] DAMAGECOUNT value on done: 26550.0 [2023-02-24 17:53:17,130][177172] Sum rewards: 0.983, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.892', 'ARMOR': '0.016', 'AMMO2': '0.016', 'AMMO5': '0.025', 'AMMO4': '0.080', 'WEAPON1': '0.080', 'AMMO3': '0.160', 'weapon5': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.252', 'HITCOUNT': '0.290', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'weapon3': '1.422', 'weapon2': '1.558', 'DAMAGECOUNT': '2.106', 'FRAGCOUNT': '4.000'} [2023-02-24 17:53:17,427][177172] DAMAGECOUNT value on done: 26714.0 [2023-02-24 17:53:17,427][177172] Sum rewards: 7.369, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.015', 'AMMO2': '0.020', 'WEAPON1': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.098', 'HEALTH': '0.198', 'WEAPON5': '0.250', 'weapon5': '0.258', 'HITCOUNT': '0.320', 'WEAPON3': '0.350', 'weapon3': '1.128', 'DAMAGECOUNT': '1.554', 'weapon2': '2.318', 'FRAGCOUNT': '6.000'} [2023-02-24 17:53:17,459][177158] DAMAGECOUNT value on done: 26094.0 [2023-02-24 17:53:17,459][177158] Sum rewards: 3.873, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.040', 'WEAPON1': '0.050', 'HEALTH': '0.088', 'AMMO3': '0.094', 'WEAPON4': '0.150', 'weapon5': '0.178', 'HITCOUNT': '0.260', 'WEAPON5': '0.300', 'weapon4': '0.304', 'ARMOR': '0.500', 'weapon2': '0.522', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.990', 'weapon3': '1.774', 'FRAGCOUNT': '4.000'} [2023-02-24 17:53:17,759][177158] DAMAGECOUNT value on done: 27751.0 [2023-02-24 17:53:17,760][177158] Sum rewards: 7.759, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'HEALTH': '0.045', 'AMMO4': '0.046', 'AMMO3': '0.052', 'weapon5': '0.052', 'WEAPON5': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.420', 'weapon3': '1.060', 'DAMAGECOUNT': '1.638', 'weapon2': '1.846', 'FRAGCOUNT': '5.000'} [2023-02-24 17:53:17,911][177154] DAMAGECOUNT value on done: 29982.0 [2023-02-24 17:53:17,912][177154] Sum rewards: -0.573, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.746', 'AMMO2': '0.023', 'AMMO5': '0.025', 'ARMOR': '0.036', 'WEAPON1': '0.070', 'AMMO4': '0.114', 'AMMO3': '0.119', 'weapon5': '0.122', 'HITCOUNT': '0.260', 'WEAPON4': '0.300', 'weapon4': '0.434', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'weapon2': '1.238', 'DAMAGECOUNT': '1.362', 'weapon3': '1.820', 'FRAGCOUNT': '3.000'} [2023-02-24 17:53:18,203][177153] Updated weights for policy 0, policy_version 6230 (0.0008) [2023-02-24 17:53:18,211][177154] DAMAGECOUNT value on done: 27807.0 [2023-02-24 17:53:18,211][177154] Sum rewards: 2.289, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.434', 'AMMO2': '0.015', 'AMMO5': '0.017', 'ARMOR': '0.020', 'AMMO4': '0.072', 'WEAPON1': '0.090', 'weapon4': '0.112', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'weapon5': '0.318', 'HITCOUNT': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'weapon3': '1.478', 'weapon2': '1.584', 'DAMAGECOUNT': '1.701', 'FRAGCOUNT': '4.000'} [2023-02-24 17:53:18,299][177172] DAMAGECOUNT value on done: 27739.0 [2023-02-24 17:53:18,300][177172] Sum rewards: -1.490, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.419', 'AMMO2': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.022', 'ARMOR': '0.036', 'weapon5': '0.098', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.350', 'weapon4': '0.396', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.182', 'weapon2': '1.376', 'weapon3': '1.914', 'FRAGCOUNT': '3.000'} [2023-02-24 17:53:18,453][177154] DAMAGECOUNT value on done: 28467.0 [2023-02-24 17:53:18,454][177154] Sum rewards: 5.234, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.520', 'AMMO5': '0.003', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'weapon7': '0.048', 'weapon5': '0.068', 'AMMO3': '0.078', 'WEAPON5': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.270', 'WEAPON3': '0.400', 'weapon4': '0.406', 'ARMOR': '0.500', 'weapon3': '1.018', 'weapon2': '1.376', 'DAMAGECOUNT': '1.482', 'FRAGCOUNT': '4.000'} [2023-02-24 17:53:18,598][177172] DAMAGECOUNT value on done: 26424.0 [2023-02-24 17:53:18,598][177172] Sum rewards: 5.022, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.861', 'AMMO5': '0.010', 'AMMO2': '0.017', 'ARMOR': '0.036', 'WEAPON1': '0.040', 'AMMO4': '0.086', 'AMMO3': '0.090', 'weapon5': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.456', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'weapon3': '1.144', 'weapon2': '1.668', 'DAMAGECOUNT': '2.865', 'FRAGCOUNT': '6.000'} [2023-02-24 17:53:18,661][177171] DAMAGECOUNT value on done: 27278.0 [2023-02-24 17:53:18,662][177171] Sum rewards: 0.079, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.088', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.031', 'WEAPON1': '0.060', 'AMMO3': '0.068', 'weapon5': '0.080', 'HITCOUNT': '0.150', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.510', 'weapon2': '0.612', 'FRAGCOUNT': '1.000', 'weapon3': '1.140'} [2023-02-24 17:53:18,753][177154] DAMAGECOUNT value on done: 27638.0 [2023-02-24 17:53:18,962][177171] DAMAGECOUNT value on done: 26291.0 [2023-02-24 17:53:18,962][177171] Sum rewards: 1.459, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.045', 'AMMO5': '0.010', 'AMMO2': '0.024', 'ARMOR': '0.028', 'WEAPON1': '0.050', 'weapon7': '0.076', 'AMMO3': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.121', 'WEAPON4': '0.200', 'weapon5': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.346', 'HITCOUNT': '0.350', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.110', 'weapon2': '1.244', 'FRAGCOUNT': '1.500', 'weapon3': '1.806'} [2023-02-24 17:53:19,017][177171] DAMAGECOUNT value on done: 27000.0 [2023-02-24 17:53:19,018][177171] Sum rewards: -0.884, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.224', 'ARMOR': '0.012', 'AMMO2': '0.013', 'AMMO5': '0.029', 'AMMO4': '0.062', 'WEAPON1': '0.090', 'AMMO3': '0.118', 'WEAPON4': '0.150', 'weapon5': '0.262', 'weapon4': '0.264', 'HITCOUNT': '0.390', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.600', 'WEAPON5': '0.700', 'weapon3': '0.824', 'DAMAGECOUNT': '1.740', 'weapon2': '2.086'} [2023-02-24 17:53:19,033][177157] DAMAGECOUNT value on done: 30579.0 [2023-02-24 17:53:19,033][177157] Sum rewards: -0.155, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.007', 'ARMOR': '0.032', 'WEAPON1': '0.050', 'AMMO2': '0.053', 'weapon5': '0.100', 'AMMO3': '0.126', 'WEAPON5': '0.200', 'weapon4': '0.248', 'AMMO4': '0.266', 'HITCOUNT': '0.310', 'HEALTH': '0.322', 'WEAPON4': '0.400', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.410', 'weapon3': '1.602', 'weapon2': '1.818', 'FRAGCOUNT': '2.000'} [2023-02-24 17:53:19,319][177171] DAMAGECOUNT value on done: 28194.0 [2023-02-24 17:53:19,320][177171] Sum rewards: -0.499, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.260', 'AMMO5': '0.010', 'AMMO2': '0.019', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'AMMO4': '0.094', 'AMMO3': '0.121', 'weapon5': '0.154', 'weapon4': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'HITCOUNT': '0.320', 'weapon2': '0.668', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.503', 'weapon3': '1.968', 'FRAGCOUNT': '4.000'} [2023-02-24 17:53:19,331][177157] DAMAGECOUNT value on done: 28488.0 [2023-02-24 17:53:19,332][177157] Sum rewards: -2.568, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.726', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.018', 'WEAPON1': '0.060', 'AMMO4': '0.088', 'AMMO3': '0.122', 'weapon4': '0.142', 'weapon5': '0.188', 'WEAPON4': '0.250', 'HITCOUNT': '0.280', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.275', 'weapon3': '1.488', 'weapon2': '1.922', 'FRAGCOUNT': '2.000'} [2023-02-24 17:53:19,344][177157] DAMAGECOUNT value on done: 29349.0 [2023-02-24 17:53:19,344][177157] Sum rewards: 0.667, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.421', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.041', 'ARMOR': '0.044', 'WEAPON1': '0.060', 'AMMO3': '0.085', 'WEAPON4': '0.150', 'weapon5': '0.224', 'WEAPON5': '0.300', 'weapon4': '0.328', 'HITCOUNT': '0.370', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.305', 'weapon2': '1.334', 'weapon3': '1.628', 'FRAGCOUNT': '3.000'} [2023-02-24 17:53:19,557][177155] DAMAGECOUNT value on done: 27474.0 [2023-02-24 17:53:19,558][177155] Sum rewards: 2.703, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.600', 'AMMO2': '0.008', 'AMMO5': '0.015', 'ARMOR': '0.040', 'AMMO4': '0.042', 'weapon4': '0.066', 'WEAPON1': '0.080', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'HITCOUNT': '0.340', 'weapon5': '0.378', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'weapon3': '1.264', 'DAMAGECOUNT': '1.770', 'weapon2': '2.004', 'FRAGCOUNT': '3.000'} [2023-02-24 17:53:19,640][177157] DAMAGECOUNT value on done: 27572.0 [2023-02-24 17:53:19,641][177157] Sum rewards: 1.809, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO2': '0.007', 'AMMO5': '0.025', 'AMMO4': '0.034', 'WEAPON1': '0.090', 'AMMO3': '0.164', 'weapon5': '0.244', 'HEALTH': '0.457', 'HITCOUNT': '0.480', 'WEAPON5': '0.550', 'weapon2': '0.816', 'WEAPON3': '0.900', 'weapon3': '2.438', 'DAMAGECOUNT': '2.604', 'FRAGCOUNT': '5.000'} [2023-02-24 17:53:19,851][177155] DAMAGECOUNT value on done: 30179.0 [2023-02-24 17:53:19,852][177155] Sum rewards: 4.094, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.441', 'AMMO5': '0.017', 'AMMO2': '0.025', 'ARMOR': '0.040', 'WEAPON1': '0.080', 'AMMO3': '0.097', 'AMMO4': '0.124', 'weapon5': '0.256', 'weapon4': '0.360', 'HITCOUNT': '0.370', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'weapon2': '1.150', 'weapon3': '1.658', 'DAMAGECOUNT': '1.857', 'FRAGCOUNT': '7.000'} [2023-02-24 17:53:20,002][177155] DAMAGECOUNT value on done: 28901.0 [2023-02-24 17:53:20,003][177155] Sum rewards: 1.193, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.754', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'ARMOR': '0.052', 'weapon5': '0.062', 'AMMO4': '0.096', 'AMMO3': '0.113', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.312', 'HITCOUNT': '0.340', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.047', 'weapon3': '1.204', 'weapon2': '1.914', 'FRAGCOUNT': '4.000'} [2023-02-24 17:53:20,294][177155] DAMAGECOUNT value on done: 28341.0 [2023-02-24 17:53:20,294][177155] Sum rewards: 4.838, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.303', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.024', 'WEAPON1': '0.070', 'AMMO3': '0.086', 'AMMO4': '0.119', 'weapon5': '0.186', 'WEAPON4': '0.200', 'weapon4': '0.320', 'HITCOUNT': '0.420', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon2': '0.990', 'weapon3': '1.636', 'DAMAGECOUNT': '1.761', 'FRAGCOUNT': '5.000'} [2023-02-24 17:53:21,128][177153] Updated weights for policy 0, policy_version 6240 (0.0009) [2023-02-24 17:53:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.6, 300 sec: 13981.9). Total num frames: 25559040. Throughput: 0: 3493.5. Samples: 6384156. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:53:21,377][177119] Avg episode reward: [(0, '1.291')] [2023-02-24 17:53:21,377][177140] Saving new best policy, reward=1.291! [2023-02-24 17:53:23,175][177156] DAMAGECOUNT value on done: 27447.0 [2023-02-24 17:53:23,176][177156] Sum rewards: 1.825, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.554', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'HITCOUNT': '0.030', 'AMMO3': '0.058', 'weapon5': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.234', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.510', 'weapon2': '0.590', 'ARMOR': '0.603', 'weapon3': '0.986', 'FRAGCOUNT': '1.000'} [2023-02-24 17:53:23,473][177156] DAMAGECOUNT value on done: 28445.0 [2023-02-24 17:53:23,473][177156] Sum rewards: 3.262, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.890', 'AMMO5': '0.012', 'AMMO2': '0.017', 'ARMOR': '0.028', 'WEAPON1': '0.050', 'weapon7': '0.078', 'AMMO4': '0.085', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.108', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'weapon4': '0.358', 'HITCOUNT': '0.480', 'weapon2': '0.778', 'WEAPON3': '0.800', 'weapon3': '1.932', 'DAMAGECOUNT': '2.040', 'FRAGCOUNT': '4.000'} [2023-02-24 17:53:23,574][177156] DAMAGECOUNT value on done: 28629.0 [2023-02-24 17:53:23,575][177156] Sum rewards: 4.898, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.271', 'ARMOR': '0.012', 'AMMO5': '0.016', 'AMMO2': '0.026', 'AMMO3': '0.071', 'WEAPON1': '0.080', 'AMMO4': '0.127', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'weapon5': '0.278', 'weapon4': '0.498', 'WEAPON3': '0.500', 'WEAPON5': '0.600', 'weapon2': '1.300', 'weapon3': '1.572', 'DAMAGECOUNT': '1.968', 'FRAGCOUNT': '4.000'} [2023-02-24 17:53:23,892][177156] DAMAGECOUNT value on done: 30301.0 [2023-02-24 17:53:23,892][177156] Sum rewards: 1.127, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.022', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.079', 'HEALTH': '0.088', 'weapon5': '0.120', 'WEAPON5': '0.150', 'HITCOUNT': '0.300', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.170', 'weapon3': '1.308', 'FRAGCOUNT': '1.500', 'weapon2': '1.788'} [2023-02-24 17:53:24,103][177153] Updated weights for policy 0, policy_version 6250 (0.0008) [2023-02-24 17:53:26,376][177119] Fps is (10 sec: 13926.2, 60 sec: 13994.6, 300 sec: 13981.9). Total num frames: 25628672. Throughput: 0: 3494.7. Samples: 6405170. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:53:26,377][177119] Avg episode reward: [(0, '1.413')] [2023-02-24 17:53:26,380][177140] Saving new best policy, reward=1.413! [2023-02-24 17:53:27,017][177153] Updated weights for policy 0, policy_version 6260 (0.0008) [2023-02-24 17:53:29,949][177153] Updated weights for policy 0, policy_version 6270 (0.0009) [2023-02-24 17:53:31,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.3, 300 sec: 13981.9). Total num frames: 25698304. Throughput: 0: 3493.1. Samples: 6426130. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:53:31,377][177119] Avg episode reward: [(0, '1.413')] [2023-02-24 17:53:32,885][177153] Updated weights for policy 0, policy_version 6280 (0.0008) [2023-02-24 17:53:35,002][177170] DAMAGECOUNT value on done: 28568.0 [2023-02-24 17:53:35,003][177170] Sum rewards: -0.430, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.937', 'AMMO2': '0.005', 'AMMO5': '0.015', 'AMMO4': '0.025', 'weapon5': '0.030', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon4': '0.202', 'HITCOUNT': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.504', 'weapon2': '0.566', 'DAMAGECOUNT': '0.576', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.366'} [2023-02-24 17:53:35,093][177170] DAMAGECOUNT value on done: 26103.0 [2023-02-24 17:53:35,093][177170] Sum rewards: -0.672, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.234', 'AMMO2': '0.010', 'AMMO5': '0.018', 'weapon4': '0.040', 'AMMO4': '0.051', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.150', 'weapon5': '0.258', 'WEAPON5': '0.400', 'HITCOUNT': '0.510', 'WEAPON3': '1.050', 'weapon2': '1.202', 'DAMAGECOUNT': '1.638', 'weapon3': '2.074', 'FRAGCOUNT': '4.500'} [2023-02-24 17:53:35,313][177170] DAMAGECOUNT value on done: 32261.0 [2023-02-24 17:53:35,314][177170] Sum rewards: -0.744, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.738', 'AMMO5': '0.024', 'ARMOR': '0.028', 'AMMO2': '0.036', 'WEAPON1': '0.050', 'AMMO3': '0.130', 'AMMO4': '0.181', 'WEAPON4': '0.200', 'weapon5': '0.238', 'weapon4': '0.272', 'HITCOUNT': '0.420', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'weapon2': '1.220', 'weapon3': '1.714', 'DAMAGECOUNT': '2.130', 'FRAGCOUNT': '2.500'} [2023-02-24 17:53:35,406][177170] DAMAGECOUNT value on done: 30680.0 [2023-02-24 17:53:35,406][177170] Sum rewards: -1.013, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.720', 'AMMO5': '0.020', 'AMMO2': '0.024', 'ARMOR': '0.037', 'WEAPON1': '0.040', 'AMMO3': '0.101', 'AMMO4': '0.119', 'weapon5': '0.140', 'weapon4': '0.216', 'HITCOUNT': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.972', 'FRAGCOUNT': '1.000', 'weapon2': '1.362', 'weapon3': '1.586'} [2023-02-24 17:53:35,568][177158] DAMAGECOUNT value on done: 28027.0 [2023-02-24 17:53:35,569][177158] Sum rewards: 5.060, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.942', 'ARMOR': '0.016', 'AMMO2': '0.016', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.081', 'AMMO3': '0.148', 'weapon5': '0.202', 'weapon4': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'HITCOUNT': '0.480', 'WEAPON3': '0.850', 'weapon2': '1.418', 'weapon3': '1.732', 'DAMAGECOUNT': '2.385', 'FRAGCOUNT': '6.000'} [2023-02-24 17:53:35,828][177153] Updated weights for policy 0, policy_version 6290 (0.0008) [2023-02-24 17:53:35,884][177158] DAMAGECOUNT value on done: 27777.0 [2023-02-24 17:53:35,884][177158] Sum rewards: 3.134, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.431', 'AMMO5': '0.010', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'weapon5': '0.048', 'ARMOR': '0.064', 'AMMO3': '0.070', 'AMMO4': '0.098', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'HITCOUNT': '0.450', 'WEAPON3': '0.600', 'weapon4': '0.666', 'weapon2': '1.108', 'weapon3': '1.520', 'DAMAGECOUNT': '1.881', 'FRAGCOUNT': '5.000'} [2023-02-24 17:53:36,358][177172] DAMAGECOUNT value on done: 27572.0 [2023-02-24 17:53:36,359][177172] Sum rewards: 4.738, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.677', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.074', 'weapon4': '0.098', 'WEAPON4': '0.100', 'weapon5': '0.196', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'weapon2': '1.366', 'weapon3': '1.656', 'DAMAGECOUNT': '3.066', 'FRAGCOUNT': '5.000'} [2023-02-24 17:53:36,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13981.9). Total num frames: 25767936. Throughput: 0: 3490.7. Samples: 6436538. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:53:36,377][177119] Avg episode reward: [(0, '1.508')] [2023-02-24 17:53:36,420][177140] Saving new best policy, reward=1.508! [2023-02-24 17:53:36,675][177172] DAMAGECOUNT value on done: 27169.0 [2023-02-24 17:53:36,676][177172] Sum rewards: -0.303, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.228', 'AMMO2': '0.008', 'AMMO5': '0.019', 'AMMO4': '0.038', 'WEAPON1': '0.080', 'AMMO3': '0.088', 'weapon7': '0.126', 'weapon5': '0.154', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HITCOUNT': '0.250', 'WEAPON7': '0.300', 'weapon4': '0.404', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon2': '1.206', 'DAMAGECOUNT': '1.365', 'weapon3': '1.496', 'FRAGCOUNT': '2.000'} [2023-02-24 17:53:36,791][177158] DAMAGECOUNT value on done: 27085.0 [2023-02-24 17:53:36,791][177158] Sum rewards: 6.137, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.427', 'AMMO2': '0.016', 'AMMO5': '0.017', 'WEAPON1': '0.070', 'AMMO4': '0.079', 'AMMO3': '0.104', 'WEAPON4': '0.250', 'weapon5': '0.250', 'HITCOUNT': '0.410', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'weapon4': '0.672', 'weapon2': '0.896', 'weapon3': '1.310', 'DAMAGECOUNT': '2.889', 'FRAGCOUNT': '6.000'} [2023-02-24 17:53:37,096][177158] DAMAGECOUNT value on done: 28337.0 [2023-02-24 17:53:37,097][177158] Sum rewards: 2.318, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.126', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO3': '0.086', 'WEAPON5': '0.200', 'weapon5': '0.236', 'HITCOUNT': '0.330', 'WEAPON3': '0.550', 'weapon3': '1.468', 'DAMAGECOUNT': '1.758', 'weapon2': '1.772', 'FRAGCOUNT': '3.000'} [2023-02-24 17:53:37,186][177154] DAMAGECOUNT value on done: 30153.0 [2023-02-24 17:53:37,186][177154] Sum rewards: -4.248, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.634', 'weapon5': '0.012', 'AMMO5': '0.022', 'AMMO2': '0.025', 'WEAPON1': '0.050', 'ARMOR': '0.057', 'AMMO4': '0.126', 'AMMO3': '0.132', 'HITCOUNT': '0.180', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'DAMAGECOUNT': '0.513', 'weapon4': '0.528', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.204', 'weapon3': '1.686'} [2023-02-24 17:53:37,482][177154] DAMAGECOUNT value on done: 28492.0 [2023-02-24 17:53:37,483][177154] Sum rewards: 4.528, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.212', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.052', 'WEAPON1': '0.060', 'ARMOR': '0.068', 'AMMO3': '0.128', 'AMMO4': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.304', 'HITCOUNT': '0.590', 'WEAPON3': '0.650', 'weapon2': '1.220', 'DAMAGECOUNT': '2.055', 'weapon3': '2.156', 'FRAGCOUNT': '5.000'} [2023-02-24 17:53:37,629][177172] DAMAGECOUNT value on done: 27992.0 [2023-02-24 17:53:37,630][177172] Sum rewards: 0.121, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.972', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'ARMOR': '0.016', 'AMMO5': '0.017', 'WEAPON1': '0.050', 'weapon5': '0.092', 'weapon7': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.230', 'weapon4': '0.242', 'WEAPON5': '0.400', 'DAMAGECOUNT': '0.759', 'WEAPON3': '0.900', 'weapon2': '1.204', 'weapon3': '1.562', 'FRAGCOUNT': '4.000'} [2023-02-24 17:53:37,742][177154] DAMAGECOUNT value on done: 29006.0 [2023-02-24 17:53:37,743][177154] Sum rewards: -2.637, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.000', 'HEALTH': '-0.902', 'ARMOR': '0.008', 'weapon4': '0.022', 'AMMO2': '0.023', 'AMMO5': '0.024', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.082', 'AMMO4': '0.116', 'HITCOUNT': '0.240', 'weapon5': '0.270', 'WEAPON3': '0.500', 'WEAPON5': '0.550', 'weapon3': '1.422', 'DAMAGECOUNT': '1.617', 'weapon2': '1.780'} [2023-02-24 17:53:37,934][177172] DAMAGECOUNT value on done: 26879.0 [2023-02-24 17:53:37,935][177172] Sum rewards: 1.212, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.790', 'AMMO5': '0.003', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO4': '0.017', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'weapon4': '0.220', 'HITCOUNT': '0.400', 'WEAPON3': '0.550', 'weapon2': '1.180', 'weapon3': '1.244', 'DAMAGECOUNT': '1.365', 'FRAGCOUNT': '2.000'} [2023-02-24 17:53:38,021][177171] DAMAGECOUNT value on done: 27630.0 [2023-02-24 17:53:38,022][177171] Sum rewards: 4.668, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.885', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO3': '0.040', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO4': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.234', 'HITCOUNT': '0.280', 'WEAPON3': '0.350', 'weapon3': '0.814', 'DAMAGECOUNT': '1.056', 'weapon2': '1.546', 'FRAGCOUNT': '4.000'} [2023-02-24 17:53:38,055][177154] DAMAGECOUNT value on done: 28190.0 [2023-02-24 17:53:38,056][177154] Sum rewards: -2.491, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.966', 'AMMO5': '0.006', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'weapon5': '0.046', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon4': '0.348', 'HITCOUNT': '0.470', 'WEAPON3': '1.050', 'weapon2': '1.178', 'DAMAGECOUNT': '1.656', 'weapon3': '2.222', 'FRAGCOUNT': '3.000'} [2023-02-24 17:53:38,235][177157] DAMAGECOUNT value on done: 30999.0 [2023-02-24 17:53:38,235][177157] Sum rewards: -2.955, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.864', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'ARMOR': '0.056', 'weapon7': '0.094', 'AMMO3': '0.130', 'weapon5': '0.136', 'AMMO4': '0.169', 'HITCOUNT': '0.300', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon4': '0.626', 'weapon2': '0.732', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.260', 'weapon3': '1.382'} [2023-02-24 17:53:38,326][177171] DAMAGECOUNT value on done: 26716.0 [2023-02-24 17:53:38,327][177171] Sum rewards: 0.674, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.296', 'AMMO5': '0.008', 'ARMOR': '0.032', 'AMMO2': '0.032', 'WEAPON1': '0.040', 'AMMO3': '0.094', 'weapon5': '0.116', 'AMMO4': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.320', 'weapon4': '0.372', 'WEAPON3': '0.550', 'weapon3': '1.256', 'DAMAGECOUNT': '1.275', 'weapon2': '1.564', 'FRAGCOUNT': '3.000'} [2023-02-24 17:53:38,382][177171] DAMAGECOUNT value on done: 27428.0 [2023-02-24 17:53:38,382][177171] Sum rewards: -2.432, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.550', 'AMMO5': '0.007', 'weapon5': '0.018', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.110', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'HITCOUNT': '0.370', 'weapon4': '0.376', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'weapon2': '1.274', 'DAMAGECOUNT': '1.284', 'weapon3': '1.850', 'FRAGCOUNT': '2.000'} [2023-02-24 17:53:38,537][177157] DAMAGECOUNT value on done: 29021.0 [2023-02-24 17:53:38,538][177157] Sum rewards: 2.627, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.941', 'AMMO5': '0.010', 'AMMO2': '0.011', 'ARMOR': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.055', 'AMMO3': '0.094', 'weapon5': '0.122', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'HITCOUNT': '0.450', 'weapon4': '0.512', 'WEAPON3': '0.650', 'weapon3': '1.140', 'weapon2': '1.534', 'DAMAGECOUNT': '1.599', 'FRAGCOUNT': '3.000'} [2023-02-24 17:53:38,547][177157] DAMAGECOUNT value on done: 29631.0 [2023-02-24 17:53:38,548][177157] Sum rewards: 3.186, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.082', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'ARMOR': '0.032', 'AMMO3': '0.040', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.114', 'WEAPON4': '0.150', 'HITCOUNT': '0.220', 'WEAPON3': '0.250', 'weapon4': '0.404', 'weapon3': '0.620', 'DAMAGECOUNT': '0.846', 'weapon2': '1.352', 'FRAGCOUNT': '2.000'} [2023-02-24 17:53:38,682][177171] DAMAGECOUNT value on done: 28713.0 [2023-02-24 17:53:38,682][177171] Sum rewards: 1.210, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.015', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.075', 'AMMO4': '0.079', 'HEALTH': '0.140', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon5': '0.306', 'HITCOUNT': '0.360', 'weapon4': '0.468', 'WEAPON3': '0.500', 'ARMOR': '0.500', 'weapon3': '1.150', 'weapon2': '1.474', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.557'} [2023-02-24 17:53:38,791][177153] Updated weights for policy 0, policy_version 6300 (0.0008) [2023-02-24 17:53:38,827][177155] DAMAGECOUNT value on done: 28054.0 [2023-02-24 17:53:38,828][177155] Sum rewards: 7.262, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.505', 'AMMO2': '0.007', 'weapon7': '0.008', 'AMMO5': '0.017', 'AMMO4': '0.034', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.062', 'weapon4': '0.100', 'weapon5': '0.168', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.390', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'weapon3': '1.512', 'weapon2': '1.628', 'DAMAGECOUNT': '1.740', 'FRAGCOUNT': '5.000'} [2023-02-24 17:53:38,845][177157] DAMAGECOUNT value on done: 27996.0 [2023-02-24 17:53:38,846][177157] Sum rewards: -1.722, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.150', 'AMMO5': '0.022', 'AMMO2': '0.024', 'WEAPON1': '0.090', 'AMMO4': '0.118', 'AMMO3': '0.170', 'weapon4': '0.176', 'weapon5': '0.190', 'WEAPON4': '0.200', 'HITCOUNT': '0.330', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.272', 'weapon2': '1.416', 'weapon3': '1.720', 'FRAGCOUNT': '3.000'} [2023-02-24 17:53:39,125][177155] DAMAGECOUNT value on done: 30980.0 [2023-02-24 17:53:39,126][177155] Sum rewards: 4.710, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.130', 'AMMO2': '0.010', 'AMMO5': '0.010', 'AMMO4': '0.047', 'WEAPON1': '0.060', 'AMMO3': '0.062', 'weapon5': '0.128', 'WEAPON4': '0.200', 'weapon4': '0.232', 'WEAPON5': '0.300', 'HITCOUNT': '0.460', 'WEAPON3': '0.500', 'weapon3': '1.162', 'weapon2': '1.776', 'DAMAGECOUNT': '2.142', 'FRAGCOUNT': '4.000'} [2023-02-24 17:53:39,254][177155] DAMAGECOUNT value on done: 29323.0 [2023-02-24 17:53:39,255][177155] Sum rewards: -3.924, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.670', 'AMMO5': '0.017', 'ARMOR': '0.033', 'AMMO2': '0.033', 'WEAPON1': '0.080', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.152', 'AMMO4': '0.166', 'weapon5': '0.186', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.340', 'HITCOUNT': '0.350', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'weapon2': '0.884', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.266', 'weapon3': '1.788'} [2023-02-24 17:53:39,555][177155] DAMAGECOUNT value on done: 28839.0 [2023-02-24 17:53:39,555][177155] Sum rewards: 3.164, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.995', 'AMMO5': '0.017', 'AMMO2': '0.028', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'weapon4': '0.080', 'AMMO3': '0.090', 'AMMO4': '0.137', 'HITCOUNT': '0.250', 'weapon5': '0.294', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.494', 'weapon3': '1.540', 'weapon2': '1.626', 'FRAGCOUNT': '5.000'} [2023-02-24 17:53:41,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13981.9). Total num frames: 25837568. Throughput: 0: 3485.5. Samples: 6457272. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:53:41,377][177119] Avg episode reward: [(0, '1.440')] [2023-02-24 17:53:41,721][177153] Updated weights for policy 0, policy_version 6310 (0.0008) [2023-02-24 17:53:42,546][177156] DAMAGECOUNT value on done: 28092.0 [2023-02-24 17:53:42,546][177156] Sum rewards: 6.072, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.360', 'AMMO2': '0.009', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.045', 'AMMO3': '0.082', 'weapon5': '0.156', 'WEAPON5': '0.300', 'HITCOUNT': '0.410', 'WEAPON3': '0.600', 'weapon2': '1.446', 'weapon3': '1.656', 'DAMAGECOUNT': '1.935', 'FRAGCOUNT': '5.000'} [2023-02-24 17:53:42,845][177156] DAMAGECOUNT value on done: 28854.0 [2023-02-24 17:53:42,845][177156] Sum rewards: -3.534, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.972', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.052', 'AMMO3': '0.109', 'WEAPON4': '0.200', 'HITCOUNT': '0.260', 'WEAPON5': '0.350', 'weapon4': '0.410', 'WEAPON3': '0.700', 'weapon3': '1.176', 'DAMAGECOUNT': '1.227', 'weapon2': '1.420', 'FRAGCOUNT': '3.000'} [2023-02-24 17:53:42,975][177156] DAMAGECOUNT value on done: 29049.0 [2023-02-24 17:53:42,976][177156] Sum rewards: -1.730, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.482', 'AMMO2': '0.014', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'weapon5': '0.058', 'AMMO4': '0.069', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'weapon4': '0.264', 'HITCOUNT': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.424', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.260', 'weapon2': '1.312', 'weapon3': '1.560', 'FRAGCOUNT': '2.000'} [2023-02-24 17:53:43,275][177156] DAMAGECOUNT value on done: 30931.0 [2023-02-24 17:53:43,276][177156] Sum rewards: -2.451, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.510', 'AMMO2': '0.004', 'AMMO5': '0.013', 'AMMO4': '0.018', 'WEAPON1': '0.070', 'WEAPON4': '0.150', 'AMMO3': '0.156', 'weapon5': '0.216', 'weapon4': '0.250', 'WEAPON5': '0.350', 'HITCOUNT': '0.400', 'WEAPON3': '1.000', 'weapon2': '1.254', 'weapon3': '1.788', 'DAMAGECOUNT': '1.890', 'FRAGCOUNT': '3.000'} [2023-02-24 17:53:44,690][177153] Updated weights for policy 0, policy_version 6320 (0.0008) [2023-02-24 17:53:46,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13926.4, 300 sec: 13981.9). Total num frames: 25907200. Throughput: 0: 3485.2. Samples: 6478102. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:53:46,376][177119] Avg episode reward: [(0, '1.302')] [2023-02-24 17:53:47,638][177153] Updated weights for policy 0, policy_version 6330 (0.0008) [2023-02-24 17:53:50,581][177153] Updated weights for policy 0, policy_version 6340 (0.0008) [2023-02-24 17:53:51,376][177119] Fps is (10 sec: 13926.7, 60 sec: 13926.4, 300 sec: 13981.9). Total num frames: 25976832. Throughput: 0: 3482.4. Samples: 6488562. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:53:51,376][177119] Avg episode reward: [(0, '1.302')] [2023-02-24 17:53:53,536][177153] Updated weights for policy 0, policy_version 6350 (0.0008) [2023-02-24 17:53:54,396][177170] DAMAGECOUNT value on done: 29025.0 [2023-02-24 17:53:54,397][177170] Sum rewards: 4.510, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.056', 'AMMO2': '0.007', 'AMMO5': '0.008', 'WEAPON1': '0.030', 'AMMO4': '0.035', 'ARMOR': '0.036', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.136', 'weapon4': '0.168', 'WEAPON5': '0.250', 'HITCOUNT': '0.350', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.371', 'weapon2': '1.474', 'weapon3': '1.540', 'FRAGCOUNT': '4.000'} [2023-02-24 17:53:54,489][177170] DAMAGECOUNT value on done: 26511.0 [2023-02-24 17:53:54,490][177170] Sum rewards: 3.741, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.592', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON1': '0.050', 'AMMO4': '0.091', 'AMMO3': '0.108', 'weapon4': '0.180', 'WEAPON4': '0.200', 'weapon5': '0.226', 'HITCOUNT': '0.320', 'WEAPON5': '0.350', 'ARMOR': '0.472', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.224', 'weapon3': '1.330', 'weapon2': '1.746', 'FRAGCOUNT': '5.000'} [2023-02-24 17:53:54,710][177170] DAMAGECOUNT value on done: 32484.0 [2023-02-24 17:53:54,710][177170] Sum rewards: 0.693, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.261', 'AMMO5': '0.009', 'AMMO2': '0.014', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.090', 'weapon5': '0.144', 'HITCOUNT': '0.180', 'weapon4': '0.206', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.669', 'weapon3': '1.260', 'weapon2': '1.514', 'FRAGCOUNT': '2.000'} [2023-02-24 17:53:54,796][177170] DAMAGECOUNT value on done: 30899.0 [2023-02-24 17:53:54,796][177170] Sum rewards: -0.436, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.897', 'AMMO5': '0.007', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'AMMO3': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.145', 'weapon7': '0.168', 'HITCOUNT': '0.200', 'weapon5': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.470', 'DAMAGECOUNT': '0.657', 'weapon3': '0.808', 'FRAGCOUNT': '1.000', 'weapon2': '1.438'} [2023-02-24 17:53:54,961][177158] DAMAGECOUNT value on done: 28660.0 [2023-02-24 17:53:54,962][177158] Sum rewards: 2.659, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.534', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'AMMO3': '0.073', 'AMMO4': '0.129', 'weapon4': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.292', 'WEAPON3': '0.500', 'HITCOUNT': '0.570', 'weapon3': '1.340', 'weapon2': '1.374', 'DAMAGECOUNT': '1.899', 'FRAGCOUNT': '3.000'} [2023-02-24 17:53:55,258][177158] DAMAGECOUNT value on done: 28397.0 [2023-02-24 17:53:55,259][177158] Sum rewards: 2.891, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.032', 'AMMO5': '0.008', 'AMMO2': '0.015', 'ARMOR': '0.036', 'WEAPON1': '0.040', 'weapon7': '0.056', 'AMMO4': '0.073', 'AMMO3': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.420', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'weapon3': '1.326', 'weapon2': '1.402', 'DAMAGECOUNT': '1.860', 'FRAGCOUNT': '5.000'} [2023-02-24 17:53:55,672][177172] DAMAGECOUNT value on done: 27925.0 [2023-02-24 17:53:55,672][177172] Sum rewards: -1.467, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.202', 'AMMO5': '0.010', 'weapon4': '0.026', 'AMMO2': '0.027', 'ARMOR': '0.028', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'AMMO4': '0.132', 'weapon5': '0.168', 'WEAPON5': '0.200', 'HITCOUNT': '0.310', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.059', 'weapon2': '1.456', 'weapon3': '1.602'} [2023-02-24 17:53:55,964][177172] DAMAGECOUNT value on done: 27392.0 [2023-02-24 17:53:55,964][177172] Sum rewards: -3.777, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.536', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.030', 'ARMOR': '0.030', 'AMMO4': '0.047', 'weapon5': '0.094', 'AMMO3': '0.123', 'WEAPON5': '0.150', 'HITCOUNT': '0.160', 'weapon4': '0.206', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.669', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.266', 'weapon3': '2.020'} [2023-02-24 17:53:56,144][177158] DAMAGECOUNT value on done: 27652.0 [2023-02-24 17:53:56,144][177158] Sum rewards: 3.373, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.798', 'AMMO5': '0.017', 'ARMOR': '0.028', 'AMMO2': '0.045', 'AMMO3': '0.072', 'WEAPON1': '0.090', 'WEAPON4': '0.200', 'AMMO4': '0.223', 'HITCOUNT': '0.290', 'weapon4': '0.312', 'weapon5': '0.322', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon2': '1.132', 'weapon3': '1.638', 'DAMAGECOUNT': '1.701', 'FRAGCOUNT': '3.000'} [2023-02-24 17:53:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13968.0). Total num frames: 26046464. Throughput: 0: 3477.9. Samples: 6509354. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:53:56,376][177119] Avg episode reward: [(0, '1.335')] [2023-02-24 17:53:56,466][177158] DAMAGECOUNT value on done: 28815.0 [2023-02-24 17:53:56,466][177158] Sum rewards: 2.547, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.998', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.020', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'WEAPON4': '0.150', 'weapon5': '0.158', 'weapon4': '0.196', 'WEAPON5': '0.200', 'HITCOUNT': '0.220', 'WEAPON3': '0.350', 'ARMOR': '0.525', 'weapon3': '0.922', 'weapon2': '1.270', 'DAMAGECOUNT': '1.434', 'FRAGCOUNT': '4.000'} [2023-02-24 17:53:56,505][177153] Updated weights for policy 0, policy_version 6360 (0.0008) [2023-02-24 17:53:56,546][177154] DAMAGECOUNT value on done: 30651.0 [2023-02-24 17:53:56,547][177154] Sum rewards: 4.463, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.017', 'AMMO2': '0.025', 'AMMO3': '0.050', 'WEAPON1': '0.050', 'weapon5': '0.120', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'weapon4': '0.200', 'WEAPON3': '0.300', 'HEALTH': '0.311', 'WEAPON5': '0.350', 'weapon2': '1.208', 'weapon3': '1.378', 'DAMAGECOUNT': '1.488', 'FRAGCOUNT': '3.000'} [2023-02-24 17:53:56,843][177154] DAMAGECOUNT value on done: 29169.0 [2023-02-24 17:53:56,843][177154] Sum rewards: 1.104, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.812', 'AMMO2': '0.004', 'AMMO5': '0.018', 'AMMO4': '0.020', 'WEAPON1': '0.050', 'AMMO3': '0.139', 'weapon5': '0.184', 'WEAPON5': '0.450', 'HITCOUNT': '0.450', 'WEAPON3': '0.900', 'weapon2': '1.116', 'DAMAGECOUNT': '2.031', 'weapon3': '2.304', 'FRAGCOUNT': '4.000'} [2023-02-24 17:53:56,938][177172] DAMAGECOUNT value on done: 28608.0 [2023-02-24 17:53:56,939][177172] Sum rewards: 4.485, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.073', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.026', 'WEAPON1': '0.070', 'weapon4': '0.086', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'AMMO4': '0.131', 'weapon5': '0.292', 'HITCOUNT': '0.440', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon2': '1.516', 'weapon3': '1.684', 'DAMAGECOUNT': '1.848', 'FRAGCOUNT': '4.000'} [2023-02-24 17:53:57,102][177154] DAMAGECOUNT value on done: 29791.0 [2023-02-24 17:53:57,102][177154] Sum rewards: 5.070, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.154', 'AMMO2': '0.013', 'AMMO5': '0.015', 'ARMOR': '0.020', 'weapon4': '0.024', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.077', 'weapon5': '0.198', 'WEAPON5': '0.350', 'HITCOUNT': '0.430', 'WEAPON3': '0.500', 'weapon2': '1.352', 'weapon3': '1.476', 'DAMAGECOUNT': '2.355', 'FRAGCOUNT': '3.500'} [2023-02-24 17:53:57,238][177172] DAMAGECOUNT value on done: 27494.0 [2023-02-24 17:53:57,239][177172] Sum rewards: -0.889, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.830', 'ARMOR': '0.008', 'AMMO2': '0.012', 'AMMO5': '0.020', 'WEAPON1': '0.050', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'AMMO3': '0.138', 'weapon5': '0.176', 'weapon4': '0.228', 'WEAPON5': '0.350', 'HITCOUNT': '0.510', 'WEAPON3': '1.000', 'weapon2': '1.068', 'DAMAGECOUNT': '1.845', 'weapon3': '2.124', 'FRAGCOUNT': '4.000'} [2023-02-24 17:53:57,393][177154] DAMAGECOUNT value on done: 28612.0 [2023-02-24 17:53:57,394][177154] Sum rewards: 1.849, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.164', 'AMMO5': '0.008', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'AMMO3': '0.104', 'AMMO4': '0.140', 'weapon4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.200', 'HITCOUNT': '0.260', 'ARMOR': '0.500', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.266', 'weapon2': '1.568', 'weapon3': '1.750'} [2023-02-24 17:53:57,410][177171] DAMAGECOUNT value on done: 28063.0 [2023-02-24 17:53:57,410][177171] Sum rewards: 1.587, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.120', 'AMMO5': '0.010', 'AMMO2': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.051', 'AMMO3': '0.109', 'weapon5': '0.152', 'WEAPON5': '0.250', 'HITCOUNT': '0.320', 'WEAPON3': '0.650', 'weapon2': '0.990', 'DAMAGECOUNT': '1.299', 'weapon3': '1.586', 'FRAGCOUNT': '3.000'} [2023-02-24 17:53:57,619][177157] DAMAGECOUNT value on done: 31199.0 [2023-02-24 17:53:57,620][177157] Sum rewards: -2.796, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.080', 'AMMO2': '0.008', 'ARMOR': '0.008', 'AMMO5': '0.009', 'WEAPON1': '0.030', 'AMMO4': '0.039', 'AMMO3': '0.059', 'weapon5': '0.132', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'WEAPON5': '0.250', 'weapon4': '0.366', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.600', 'weapon3': '0.722', 'FRAGCOUNT': '1.000', 'weapon2': '1.800'} [2023-02-24 17:53:57,705][177171] DAMAGECOUNT value on done: 27176.0 [2023-02-24 17:53:57,705][177171] Sum rewards: 1.779, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.656', 'AMMO2': '0.006', 'AMMO5': '0.017', 'AMMO4': '0.031', 'WEAPON1': '0.060', 'AMMO3': '0.123', 'weapon5': '0.178', 'WEAPON4': '0.350', 'HITCOUNT': '0.380', 'weapon4': '0.446', 'WEAPON5': '0.450', 'ARMOR': '0.465', 'WEAPON3': '0.850', 'weapon2': '0.966', 'DAMAGECOUNT': '1.380', 'weapon3': '1.732', 'FRAGCOUNT': '5.000'} [2023-02-24 17:53:57,760][177171] DAMAGECOUNT value on done: 27789.0 [2023-02-24 17:53:57,761][177171] Sum rewards: 3.845, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.728', 'AMMO5': '0.016', 'ARMOR': '0.024', 'AMMO2': '0.025', 'AMMO3': '0.058', 'WEAPON1': '0.070', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'weapon4': '0.242', 'weapon5': '0.260', 'WEAPON3': '0.400', 'WEAPON5': '0.500', 'weapon3': '0.834', 'DAMAGECOUNT': '1.083', 'weapon2': '1.874', 'FRAGCOUNT': '4.000'} [2023-02-24 17:53:57,931][177157] DAMAGECOUNT value on done: 29286.0 [2023-02-24 17:53:57,931][177157] Sum rewards: -0.106, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.006', 'AMMO5': '0.012', 'ARMOR': '0.024', 'AMMO4': '0.028', 'WEAPON1': '0.050', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'weapon5': '0.180', 'HITCOUNT': '0.280', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'HEALTH': '0.606', 'DAMAGECOUNT': '0.795', 'FRAGCOUNT': '1.000', 'weapon2': '1.558', 'weapon3': '1.708'} [2023-02-24 17:53:57,941][177157] DAMAGECOUNT value on done: 30051.0 [2023-02-24 17:53:57,942][177157] Sum rewards: 0.725, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.925', 'ARMOR': '0.008', 'AMMO2': '0.022', 'AMMO5': '0.024', 'WEAPON1': '0.040', 'AMMO3': '0.104', 'AMMO4': '0.111', 'weapon7': '0.146', 'weapon5': '0.204', 'WEAPON4': '0.250', 'weapon4': '0.332', 'HITCOUNT': '0.390', 'WEAPON5': '0.450', 'AMMO6': '0.600', 'WEAPON7': '0.600', 'AMMO7': '0.600', 'WEAPON3': '0.650', 'weapon2': '1.138', 'DAMAGECOUNT': '1.260', 'weapon3': '1.720', 'FRAGCOUNT': '2.000'} [2023-02-24 17:53:58,062][177171] DAMAGECOUNT value on done: 28805.0 [2023-02-24 17:53:58,062][177171] Sum rewards: -1.160, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.995', 'AMMO5': '0.003', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.025', 'AMMO3': '0.030', 'weapon5': '0.068', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'WEAPON3': '0.250', 'DAMAGECOUNT': '0.276', 'WEAPON4': '0.300', 'ARMOR': '0.453', 'weapon3': '0.530', 'weapon4': '0.538', 'weapon2': '0.648', 'FRAGCOUNT': '1.000'} [2023-02-24 17:53:58,164][177155] DAMAGECOUNT value on done: 28737.0 [2023-02-24 17:53:58,164][177155] Sum rewards: 1.762, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.960', 'AMMO5': '0.014', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.100', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'weapon7': '0.178', 'weapon5': '0.310', 'weapon4': '0.370', 'HITCOUNT': '0.390', 'WEAPON5': '0.400', 'ARMOR': '0.446', 'WEAPON3': '0.800', 'weapon2': '0.800', 'weapon3': '1.738', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.049'} [2023-02-24 17:53:58,237][177157] DAMAGECOUNT value on done: 28308.0 [2023-02-24 17:53:58,238][177157] Sum rewards: 2.492, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.394', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.036', 'AMMO3': '0.099', 'weapon5': '0.146', 'WEAPON4': '0.200', 'HITCOUNT': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.392', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.936', 'weapon2': '1.038', 'weapon3': '1.598', 'FRAGCOUNT': '4.000'} [2023-02-24 17:53:58,460][177155] DAMAGECOUNT value on done: 31353.0 [2023-02-24 17:53:58,461][177155] Sum rewards: 0.037, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.918', 'AMMO2': '0.011', 'AMMO5': '0.017', 'WEAPON1': '0.050', 'AMMO4': '0.056', 'weapon4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon5': '0.200', 'HITCOUNT': '0.340', 'WEAPON5': '0.350', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.119', 'weapon3': '1.454', 'weapon2': '1.888'} [2023-02-24 17:53:58,614][177155] DAMAGECOUNT value on done: 30160.0 [2023-02-24 17:53:58,614][177155] Sum rewards: 5.083, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.465', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.014', 'WEAPON1': '0.050', 'AMMO3': '0.109', 'weapon5': '0.130', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'HITCOUNT': '0.470', 'weapon4': '0.494', 'WEAPON3': '0.800', 'weapon2': '0.980', 'weapon3': '1.480', 'DAMAGECOUNT': '2.511', 'FRAGCOUNT': '5.000'} [2023-02-24 17:53:58,907][177155] DAMAGECOUNT value on done: 29430.0 [2023-02-24 17:53:58,907][177155] Sum rewards: 1.677, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.185', 'weapon7': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.014', 'AMMO5': '0.017', 'weapon4': '0.034', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.086', 'weapon5': '0.112', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.230', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'weapon2': '1.278', 'weapon3': '1.376', 'DAMAGECOUNT': '1.773', 'FRAGCOUNT': '2.000'} [2023-02-24 17:53:59,443][177153] Updated weights for policy 0, policy_version 6370 (0.0008) [2023-02-24 17:54:01,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 26116096. Throughput: 0: 3475.9. Samples: 6530198. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:54:01,376][177119] Avg episode reward: [(0, '1.493')] [2023-02-24 17:54:02,016][177156] DAMAGECOUNT value on done: 28796.0 [2023-02-24 17:54:02,016][177156] Sum rewards: 0.859, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.878', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.104', 'AMMO3': '0.110', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.224', 'weapon4': '0.268', 'weapon7': '0.332', 'HITCOUNT': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '0.650', 'weapon2': '0.916', 'weapon3': '1.996', 'DAMAGECOUNT': '2.112', 'FRAGCOUNT': '3.000'} [2023-02-24 17:54:02,308][177156] DAMAGECOUNT value on done: 29493.0 [2023-02-24 17:54:02,308][177156] Sum rewards: 0.877, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.196', 'AMMO2': '0.007', 'AMMO5': '0.022', 'AMMO4': '0.032', 'WEAPON1': '0.040', 'AMMO3': '0.060', 'WEAPON4': '0.250', 'weapon5': '0.328', 'HITCOUNT': '0.390', 'weapon4': '0.392', 'WEAPON3': '0.400', 'WEAPON5': '0.550', 'ARMOR': '0.916', 'weapon3': '1.080', 'weapon2': '1.188', 'DAMAGECOUNT': '1.917', 'FRAGCOUNT': '2.000'} [2023-02-24 17:54:02,359][177153] Updated weights for policy 0, policy_version 6380 (0.0008) [2023-02-24 17:54:02,418][177156] DAMAGECOUNT value on done: 29394.0 [2023-02-24 17:54:02,419][177156] Sum rewards: 0.610, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.276', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.052', 'ARMOR': '0.056', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'weapon5': '0.150', 'HITCOUNT': '0.170', 'WEAPON5': '0.250', 'weapon4': '0.348', 'WEAPON3': '0.500', 'weapon2': '0.954', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.035', 'weapon3': '1.408'} [2023-02-24 17:54:02,723][177156] DAMAGECOUNT value on done: 31620.0 [2023-02-24 17:54:02,723][177156] Sum rewards: 4.220, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.844', 'AMMO2': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.040', 'weapon4': '0.044', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'weapon5': '0.182', 'WEAPON5': '0.300', 'HITCOUNT': '0.390', 'ARMOR': '0.456', 'WEAPON3': '0.650', 'weapon2': '1.086', 'weapon3': '1.356', 'DAMAGECOUNT': '2.067', 'FRAGCOUNT': '5.000'} [2023-02-24 17:54:05,296][177153] Updated weights for policy 0, policy_version 6390 (0.0009) [2023-02-24 17:54:06,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 26185728. Throughput: 0: 3478.0. Samples: 6540666. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 17:54:06,376][177119] Avg episode reward: [(0, '1.544')] [2023-02-24 17:54:06,379][177140] Saving new best policy, reward=1.544! [2023-02-24 17:54:08,244][177153] Updated weights for policy 0, policy_version 6400 (0.0008) [2023-02-24 17:54:09,470][177171] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 17:54:11,187][177153] Updated weights for policy 0, policy_version 6410 (0.0008) [2023-02-24 17:54:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 26255360. Throughput: 0: 3473.5. Samples: 6561478. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 17:54:11,376][177119] Avg episode reward: [(0, '1.544')] [2023-02-24 17:54:13,719][177170] DAMAGECOUNT value on done: 29992.0 [2023-02-24 17:54:13,719][177170] Sum rewards: 0.037, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.745', 'AMMO2': '0.015', 'AMMO5': '0.022', 'AMMO4': '0.074', 'AMMO3': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON1': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon7': '0.220', 'weapon4': '0.254', 'weapon5': '0.370', 'HITCOUNT': '0.400', 'WEAPON5': '0.600', 'WEAPON3': '0.650', 'weapon3': '1.226', 'weapon2': '1.492', 'DAMAGECOUNT': '2.601', 'FRAGCOUNT': '6.000'} [2023-02-24 17:54:13,831][177170] DAMAGECOUNT value on done: 26919.0 [2023-02-24 17:54:13,832][177170] Sum rewards: 5.339, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.626', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.026', 'WEAPON1': '0.040', 'AMMO3': '0.088', 'weapon4': '0.098', 'WEAPON4': '0.100', 'AMMO4': '0.130', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.240', 'weapon5': '0.246', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.224', 'weapon2': '1.632', 'weapon3': '1.664', 'FRAGCOUNT': '5.000'} [2023-02-24 17:54:14,028][177170] DAMAGECOUNT value on done: 32919.0 [2023-02-24 17:54:14,029][177170] Sum rewards: 0.411, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.591', 'AMMO5': '0.005', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'AMMO3': '0.066', 'weapon5': '0.128', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'HITCOUNT': '0.410', 'ARMOR': '0.432', 'weapon4': '0.432', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.305', 'weapon3': '1.308', 'weapon2': '1.462', 'FRAGCOUNT': '2.000'} [2023-02-24 17:54:14,109][177153] Updated weights for policy 0, policy_version 6420 (0.0008) [2023-02-24 17:54:14,135][177170] DAMAGECOUNT value on done: 31832.0 [2023-02-24 17:54:14,136][177170] Sum rewards: 3.812, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.598', 'AMMO2': '0.011', 'AMMO5': '0.019', 'AMMO4': '0.052', 'WEAPON1': '0.090', 'AMMO3': '0.117', 'weapon7': '0.134', 'weapon5': '0.162', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.500', 'HITCOUNT': '0.590', 'WEAPON3': '0.850', 'weapon2': '1.110', 'weapon3': '1.930', 'DAMAGECOUNT': '2.244', 'FRAGCOUNT': '6.000'} [2023-02-24 17:54:14,284][177158] DAMAGECOUNT value on done: 29340.0 [2023-02-24 17:54:14,285][177158] Sum rewards: 1.574, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.580', 'AMMO5': '0.005', 'AMMO2': '0.028', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'AMMO3': '0.111', 'weapon5': '0.134', 'AMMO4': '0.138', 'WEAPON5': '0.200', 'HITCOUNT': '0.390', 'WEAPON4': '0.400', 'weapon4': '0.634', 'WEAPON3': '0.750', 'weapon2': '0.976', 'weapon3': '1.526', 'DAMAGECOUNT': '2.040', 'FRAGCOUNT': '4.000'} [2023-02-24 17:54:14,573][177158] DAMAGECOUNT value on done: 28652.0 [2023-02-24 17:54:14,573][177158] Sum rewards: -2.477, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.845', 'AMMO2': '0.005', 'AMMO5': '0.013', 'AMMO4': '0.025', 'WEAPON1': '0.040', 'weapon5': '0.096', 'AMMO3': '0.122', 'WEAPON5': '0.300', 'HITCOUNT': '0.310', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.765', 'FRAGCOUNT': '1.000', 'weapon3': '1.462', 'weapon2': '1.730'} [2023-02-24 17:54:14,949][177172] DAMAGECOUNT value on done: 28175.0 [2023-02-24 17:54:14,950][177172] Sum rewards: 3.235, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.340', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.104', 'weapon5': '0.110', 'WEAPON4': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.350', 'ARMOR': '0.440', 'weapon4': '0.680', 'DAMAGECOUNT': '0.750', 'weapon3': '0.886', 'weapon2': '1.432', 'FRAGCOUNT': '2.000'} [2023-02-24 17:54:15,242][177172] DAMAGECOUNT value on done: 27993.0 [2023-02-24 17:54:15,243][177172] Sum rewards: 4.448, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.704', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'weapon5': '0.048', 'AMMO4': '0.109', 'AMMO3': '0.110', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.450', 'weapon4': '0.606', 'WEAPON3': '0.700', 'weapon2': '0.902', 'weapon3': '1.642', 'DAMAGECOUNT': '1.803', 'FRAGCOUNT': '5.000'} [2023-02-24 17:54:15,461][177158] DAMAGECOUNT value on done: 28054.0 [2023-02-24 17:54:15,461][177158] Sum rewards: 3.361, reward structure: {'DEATHCOUNT': '-6.750', 'weapon4': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'weapon5': '0.068', 'AMMO3': '0.070', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'HEALTH': '0.111', 'WEAPON5': '0.250', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'DAMAGECOUNT': '1.206', 'weapon3': '1.374', 'weapon2': '2.024', 'FRAGCOUNT': '4.000'} [2023-02-24 17:54:15,752][177158] DAMAGECOUNT value on done: 29799.0 [2023-02-24 17:54:15,752][177158] Sum rewards: 7.026, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.995', 'ARMOR': '0.004', 'AMMO2': '0.005', 'AMMO4': '0.026', 'AMMO5': '0.028', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon5': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.108', 'AMMO3': '0.138', 'weapon4': '0.182', 'WEAPON5': '0.400', 'HITCOUNT': '0.720', 'weapon2': '0.832', 'WEAPON3': '0.900', 'weapon3': '2.246', 'DAMAGECOUNT': '2.952', 'FRAGCOUNT': '8.000'} [2023-02-24 17:54:15,885][177154] DAMAGECOUNT value on done: 31361.0 [2023-02-24 17:54:15,885][177154] Sum rewards: 5.735, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.035', 'WEAPON1': '0.040', 'AMMO3': '0.099', 'weapon5': '0.176', 'WEAPON5': '0.250', 'HEALTH': '0.280', 'HITCOUNT': '0.400', 'WEAPON3': '0.550', 'weapon2': '1.238', 'weapon3': '1.770', 'DAMAGECOUNT': '2.130', 'FRAGCOUNT': '4.000'} [2023-02-24 17:54:16,180][177154] DAMAGECOUNT value on done: 29814.0 [2023-02-24 17:54:16,181][177154] Sum rewards: 6.024, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.692', 'ARMOR': '0.016', 'AMMO5': '0.020', 'AMMO2': '0.024', 'WEAPON1': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.121', 'weapon7': '0.130', 'AMMO3': '0.144', 'weapon5': '0.144', 'weapon4': '0.390', 'WEAPON5': '0.400', 'HITCOUNT': '0.550', 'WEAPON3': '0.850', 'weapon2': '1.018', 'weapon3': '1.774', 'DAMAGECOUNT': '1.935', 'FRAGCOUNT': '7.000'} [2023-02-24 17:54:16,213][177172] DAMAGECOUNT value on done: 29289.0 [2023-02-24 17:54:16,213][177172] Sum rewards: 3.467, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.990', 'AMMO5': '0.022', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'AMMO3': '0.064', 'AMMO4': '0.124', 'weapon5': '0.310', 'WEAPON3': '0.350', 'WEAPON4': '0.350', 'HITCOUNT': '0.380', 'ARMOR': '0.455', 'weapon4': '0.542', 'WEAPON5': '0.550', 'weapon3': '0.726', 'weapon2': '1.736', 'DAMAGECOUNT': '2.043', 'FRAGCOUNT': '5.000'} [2023-02-24 17:54:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 26324992. Throughput: 0: 3472.7. Samples: 6582402. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 17:54:16,376][177119] Avg episode reward: [(0, '1.654')] [2023-02-24 17:54:16,379][177140] Saving new best policy, reward=1.654! [2023-02-24 17:54:16,433][177154] DAMAGECOUNT value on done: 30194.0 [2023-02-24 17:54:16,433][177154] Sum rewards: -1.702, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.652', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'ARMOR': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO3': '0.077', 'weapon5': '0.162', 'WEAPON5': '0.250', 'HITCOUNT': '0.320', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.209', 'weapon3': '1.408', 'weapon2': '1.938'} [2023-02-24 17:54:16,523][177172] DAMAGECOUNT value on done: 27875.0 [2023-02-24 17:54:16,524][177172] Sum rewards: 1.462, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.012', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'HEALTH': '0.081', 'AMMO3': '0.099', 'AMMO4': '0.133', 'weapon5': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.350', 'weapon4': '0.484', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.143', 'weapon2': '1.408', 'weapon3': '1.578', 'FRAGCOUNT': '3.000'} [2023-02-24 17:54:16,660][177171] DAMAGECOUNT value on done: 28531.0 [2023-02-24 17:54:16,660][177171] Sum rewards: 3.483, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.450', 'AMMO5': '0.010', 'AMMO2': '0.017', 'ARMOR': '0.048', 'WEAPON1': '0.060', 'AMMO4': '0.084', 'AMMO3': '0.090', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.320', 'weapon5': '0.466', 'weapon4': '0.518', 'WEAPON3': '0.600', 'weapon2': '0.912', 'weapon3': '1.154', 'DAMAGECOUNT': '1.404', 'FRAGCOUNT': '3.000'} [2023-02-24 17:54:16,743][177154] DAMAGECOUNT value on done: 29125.0 [2023-02-24 17:54:16,743][177154] Sum rewards: 1.101, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.441', 'AMMO5': '0.016', 'AMMO2': '0.026', 'WEAPON1': '0.040', 'weapon7': '0.098', 'AMMO3': '0.101', 'weapon5': '0.120', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'HITCOUNT': '0.340', 'WEAPON5': '0.350', 'ARMOR': '0.451', 'weapon4': '0.626', 'WEAPON3': '0.650', 'weapon2': '0.814', 'weapon3': '1.392', 'DAMAGECOUNT': '1.539', 'FRAGCOUNT': '2.000'} [2023-02-24 17:54:16,948][177157] DAMAGECOUNT value on done: 31616.0 [2023-02-24 17:54:16,949][177157] Sum rewards: 2.470, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.486', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.071', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.152', 'HITCOUNT': '0.280', 'weapon4': '0.428', 'ARMOR': '0.464', 'WEAPON3': '0.500', 'weapon3': '1.076', 'DAMAGECOUNT': '1.251', 'weapon2': '1.354', 'FRAGCOUNT': '3.000'} [2023-02-24 17:54:16,959][177171] DAMAGECOUNT value on done: 27967.0 [2023-02-24 17:54:16,959][177171] Sum rewards: 4.234, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.113', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.014', 'WEAPON1': '0.030', 'AMMO3': '0.065', 'WEAPON4': '0.100', 'weapon5': '0.180', 'weapon4': '0.202', 'WEAPON5': '0.300', 'HITCOUNT': '0.450', 'WEAPON3': '0.500', 'weapon3': '1.326', 'weapon2': '1.542', 'DAMAGECOUNT': '2.373', 'FRAGCOUNT': '5.000'} [2023-02-24 17:54:17,013][177171] DAMAGECOUNT value on done: 28245.0 [2023-02-24 17:54:17,014][177171] Sum rewards: -2.057, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.472', 'weapon7': '0.002', 'AMMO5': '0.016', 'ARMOR': '0.032', 'AMMO2': '0.050', 'WEAPON1': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.106', 'weapon5': '0.122', 'AMMO4': '0.250', 'weapon4': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'HITCOUNT': '0.420', 'WEAPON3': '0.600', 'weapon3': '1.366', 'DAMAGECOUNT': '1.368', 'weapon2': '1.488'} [2023-02-24 17:54:17,084][177153] Updated weights for policy 0, policy_version 6430 (0.0008) [2023-02-24 17:54:17,248][177157] DAMAGECOUNT value on done: 30291.0 [2023-02-24 17:54:17,249][177157] Sum rewards: 8.826, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.920', 'AMMO2': '0.013', 'AMMO5': '0.019', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'WEAPON1': '0.080', 'AMMO3': '0.130', 'weapon4': '0.146', 'weapon5': '0.212', 'WEAPON5': '0.450', 'HITCOUNT': '0.680', 'WEAPON3': '0.850', 'weapon2': '0.920', 'weapon3': '2.114', 'DAMAGECOUNT': '3.015', 'FRAGCOUNT': '8.500'} [2023-02-24 17:54:17,259][177157] DAMAGECOUNT value on done: 30610.0 [2023-02-24 17:54:17,259][177157] Sum rewards: -1.434, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.944', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.012', 'ARMOR': '0.028', 'WEAPON1': '0.030', 'WEAPON4': '0.100', 'weapon7': '0.102', 'weapon5': '0.120', 'AMMO3': '0.145', 'weapon4': '0.146', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.360', 'WEAPON3': '0.950', 'weapon2': '1.148', 'DAMAGECOUNT': '1.677', 'weapon3': '2.032', 'FRAGCOUNT': '4.000'} [2023-02-24 17:54:17,317][177171] DAMAGECOUNT value on done: 28945.0 [2023-02-24 17:54:17,491][177155] DAMAGECOUNT value on done: 29242.0 [2023-02-24 17:54:17,492][177155] Sum rewards: 3.311, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.140', 'AMMO5': '0.015', 'AMMO2': '0.030', 'WEAPON1': '0.050', 'AMMO3': '0.065', 'AMMO4': '0.148', 'WEAPON4': '0.200', 'weapon5': '0.318', 'weapon4': '0.350', 'WEAPON5': '0.400', 'HITCOUNT': '0.460', 'WEAPON3': '0.550', 'weapon2': '1.022', 'weapon3': '1.328', 'DAMAGECOUNT': '1.515', 'FRAGCOUNT': '4.000'} [2023-02-24 17:54:17,552][177157] DAMAGECOUNT value on done: 28613.0 [2023-02-24 17:54:17,552][177157] Sum rewards: -1.220, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.976', 'ARMOR': '0.012', 'AMMO2': '0.021', 'AMMO5': '0.022', 'weapon5': '0.052', 'WEAPON1': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.134', 'weapon7': '0.146', 'WEAPON4': '0.150', 'HITCOUNT': '0.250', 'weapon4': '0.328', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'weapon2': '0.874', 'DAMAGECOUNT': '0.915', 'weapon3': '1.816', 'FRAGCOUNT': '3.000'} [2023-02-24 17:54:17,791][177155] DAMAGECOUNT value on done: 31712.0 [2023-02-24 17:54:17,791][177155] Sum rewards: -1.161, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.823', 'AMMO5': '0.024', 'AMMO2': '0.031', 'ARMOR': '0.036', 'weapon4': '0.040', 'WEAPON4': '0.050', 'WEAPON1': '0.110', 'AMMO3': '0.120', 'AMMO4': '0.156', 'HITCOUNT': '0.180', 'weapon5': '0.462', 'WEAPON5': '0.600', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.072', 'DAMAGECOUNT': '1.077', 'weapon3': '1.604'} [2023-02-24 17:54:17,932][177155] DAMAGECOUNT value on done: 30404.0 [2023-02-24 17:54:17,933][177155] Sum rewards: 0.552, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.002', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.034', 'AMMO3': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.100', 'WEAPON4': '0.150', 'weapon7': '0.158', 'AMMO4': '0.170', 'WEAPON5': '0.200', 'HITCOUNT': '0.210', 'weapon4': '0.236', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'weapon2': '0.662', 'DAMAGECOUNT': '0.732', 'FRAGCOUNT': '1.000', 'weapon3': '1.054'} [2023-02-24 17:54:18,230][177155] DAMAGECOUNT value on done: 29975.0 [2023-02-24 17:54:18,231][177155] Sum rewards: 4.985, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.346', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.052', 'AMMO4': '0.056', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.204', 'WEAPON3': '0.300', 'HITCOUNT': '0.460', 'ARMOR': '0.472', 'weapon3': '1.122', 'weapon2': '1.528', 'DAMAGECOUNT': '1.635', 'FRAGCOUNT': '4.000'} [2023-02-24 17:54:19,994][177153] Updated weights for policy 0, policy_version 6440 (0.0008) [2023-02-24 17:54:21,368][177156] DAMAGECOUNT value on done: 29333.0 [2023-02-24 17:54:21,368][177156] Sum rewards: 1.122, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.910', 'AMMO2': '0.006', 'AMMO5': '0.011', 'AMMO4': '0.032', 'WEAPON1': '0.040', 'AMMO3': '0.119', 'weapon5': '0.222', 'WEAPON5': '0.300', 'HITCOUNT': '0.430', 'WEAPON3': '0.650', 'weapon2': '1.228', 'DAMAGECOUNT': '1.611', 'FRAGCOUNT': '2.000', 'weapon3': '2.132'} [2023-02-24 17:54:21,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.5, 300 sec: 13968.1). Total num frames: 26394624. Throughput: 0: 3473.6. Samples: 6592850. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 17:54:21,376][177119] Avg episode reward: [(0, '1.696')] [2023-02-24 17:54:21,377][177140] Saving new best policy, reward=1.696! [2023-02-24 17:54:21,677][177156] DAMAGECOUNT value on done: 30187.0 [2023-02-24 17:54:21,678][177156] Sum rewards: 2.078, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.680', 'AMMO5': '0.018', 'AMMO2': '0.036', 'weapon7': '0.052', 'WEAPON1': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'AMMO4': '0.182', 'weapon5': '0.202', 'weapon4': '0.244', 'WEAPON5': '0.400', 'HITCOUNT': '0.620', 'WEAPON3': '0.900', 'weapon2': '1.052', 'weapon3': '1.802', 'DAMAGECOUNT': '2.082', 'FRAGCOUNT': '3.000'} [2023-02-24 17:54:21,781][177156] DAMAGECOUNT value on done: 30151.0 [2023-02-24 17:54:21,782][177156] Sum rewards: 4.912, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.532', 'AMMO5': '0.014', 'AMMO2': '0.035', 'WEAPON1': '0.040', 'AMMO3': '0.131', 'AMMO4': '0.174', 'weapon5': '0.258', 'WEAPON4': '0.400', 'weapon4': '0.440', 'WEAPON5': '0.450', 'HITCOUNT': '0.470', 'ARMOR': '0.471', 'WEAPON3': '0.850', 'weapon2': '1.270', 'weapon3': '1.420', 'DAMAGECOUNT': '2.271', 'FRAGCOUNT': '6.000'} [2023-02-24 17:54:22,077][177156] DAMAGECOUNT value on done: 31988.0 [2023-02-24 17:54:22,078][177156] Sum rewards: -0.106, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.794', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.028', 'WEAPON1': '0.080', 'weapon7': '0.086', 'AMMO3': '0.106', 'AMMO4': '0.142', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon5': '0.168', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.254', 'HITCOUNT': '0.310', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.104', 'weapon2': '1.110', 'weapon3': '1.656', 'FRAGCOUNT': '3.000'} [2023-02-24 17:54:22,929][177153] Updated weights for policy 0, policy_version 6450 (0.0008) [2023-02-24 17:54:25,833][177153] Updated weights for policy 0, policy_version 6460 (0.0008) [2023-02-24 17:54:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 26464256. Throughput: 0: 3479.9. Samples: 6613866. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 17:54:26,377][177119] Avg episode reward: [(0, '1.656')] [2023-02-24 17:54:28,781][177153] Updated weights for policy 0, policy_version 6470 (0.0008) [2023-02-24 17:54:31,376][177119] Fps is (10 sec: 13926.0, 60 sec: 13926.4, 300 sec: 13968.0). Total num frames: 26533888. Throughput: 0: 3483.8. Samples: 6634876. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 17:54:31,377][177119] Avg episode reward: [(0, '1.656')] [2023-02-24 17:54:31,720][177153] Updated weights for policy 0, policy_version 6480 (0.0007) [2023-02-24 17:54:32,919][177170] DAMAGECOUNT value on done: 30290.0 [2023-02-24 17:54:32,920][177170] Sum rewards: 1.385, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.292', 'AMMO2': '0.010', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.049', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'weapon5': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.186', 'HITCOUNT': '0.190', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.208', 'WEAPON3': '0.500', 'weapon2': '0.804', 'DAMAGECOUNT': '0.894', 'weapon3': '1.124', 'FRAGCOUNT': '2.000'} [2023-02-24 17:54:33,014][177170] DAMAGECOUNT value on done: 27689.0 [2023-02-24 17:54:33,015][177170] Sum rewards: -0.604, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.296', 'AMMO5': '0.013', 'AMMO2': '0.038', 'WEAPON1': '0.050', 'AMMO3': '0.117', 'AMMO4': '0.188', 'weapon5': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.394', 'HITCOUNT': '0.450', 'weapon2': '0.836', 'WEAPON3': '0.850', 'weapon3': '1.772', 'DAMAGECOUNT': '2.310', 'FRAGCOUNT': '4.000'} [2023-02-24 17:54:33,238][177170] DAMAGECOUNT value on done: 33736.0 [2023-02-24 17:54:33,239][177170] Sum rewards: 2.899, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.002', 'AMMO5': '0.020', 'AMMO2': '0.021', 'ARMOR': '0.028', 'WEAPON1': '0.060', 'AMMO4': '0.104', 'AMMO3': '0.119', 'weapon5': '0.260', 'WEAPON4': '0.300', 'HITCOUNT': '0.420', 'WEAPON5': '0.550', 'weapon4': '0.674', 'WEAPON3': '0.850', 'weapon2': '0.904', 'weapon3': '1.640', 'DAMAGECOUNT': '2.451', 'FRAGCOUNT': '4.000'} [2023-02-24 17:54:33,332][177170] DAMAGECOUNT value on done: 32342.0 [2023-02-24 17:54:33,333][177170] Sum rewards: -1.754, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.310', 'AMMO2': '0.026', 'AMMO5': '0.026', 'WEAPON1': '0.050', 'AMMO3': '0.084', 'AMMO4': '0.128', 'weapon5': '0.142', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon4': '0.410', 'HITCOUNT': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.076', 'DAMAGECOUNT': '1.530', 'weapon3': '1.784'} [2023-02-24 17:54:33,506][177158] DAMAGECOUNT value on done: 29918.0 [2023-02-24 17:54:33,506][177158] Sum rewards: 4.359, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.565', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.034', 'WEAPON1': '0.050', 'AMMO3': '0.083', 'weapon4': '0.158', 'weapon5': '0.168', 'AMMO4': '0.170', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.440', 'WEAPON3': '0.600', 'weapon2': '1.288', 'weapon3': '1.530', 'DAMAGECOUNT': '1.734', 'FRAGCOUNT': '5.000'} [2023-02-24 17:54:33,806][177158] DAMAGECOUNT value on done: 28989.0 [2023-02-24 17:54:33,806][177158] Sum rewards: -2.093, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.534', 'AMMO2': '0.021', 'AMMO5': '0.028', 'weapon7': '0.048', 'WEAPON1': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.130', 'weapon5': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.176', 'HITCOUNT': '0.330', 'ARMOR': '0.454', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.011', 'weapon2': '1.272', 'FRAGCOUNT': '1.500', 'weapon3': '2.028'} [2023-02-24 17:54:34,204][177172] DAMAGECOUNT value on done: 28607.0 [2023-02-24 17:54:34,204][177172] Sum rewards: 2.481, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.222', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'AMMO3': '0.084', 'weapon5': '0.090', 'weapon7': '0.104', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.290', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'weapon4': '0.550', 'weapon2': '0.778', 'weapon3': '0.964', 'DAMAGECOUNT': '1.296', 'FRAGCOUNT': '2.000'} [2023-02-24 17:54:34,508][177172] DAMAGECOUNT value on done: 28750.0 [2023-02-24 17:54:34,508][177172] Sum rewards: 2.068, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.440', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'AMMO3': '0.070', 'AMMO4': '0.108', 'weapon5': '0.220', 'WEAPON4': '0.300', 'HITCOUNT': '0.320', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.450', 'weapon2': '1.218', 'weapon3': '1.412', 'DAMAGECOUNT': '2.271', 'FRAGCOUNT': '6.000'} [2023-02-24 17:54:34,675][177153] Updated weights for policy 0, policy_version 6490 (0.0009) [2023-02-24 17:54:34,703][177158] DAMAGECOUNT value on done: 28409.0 [2023-02-24 17:54:34,704][177158] Sum rewards: 2.167, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.371', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO3': '0.020', 'AMMO4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.062', 'weapon7': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.260', 'WEAPON4': '0.350', 'weapon2': '0.372', 'weapon3': '0.466', 'ARMOR': '0.474', 'weapon4': '0.608', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.065'} [2023-02-24 17:54:35,005][177158] DAMAGECOUNT value on done: 30616.0 [2023-02-24 17:54:35,006][177158] Sum rewards: 7.290, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.012', 'HEALTH': '0.024', 'WEAPON1': '0.030', 'AMMO2': '0.049', 'AMMO3': '0.074', 'weapon5': '0.108', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.247', 'WEAPON4': '0.300', 'weapon7': '0.334', 'weapon2': '0.384', 'HITCOUNT': '0.400', 'WEAPON3': '0.400', 'ARMOR': '0.456', 'weapon4': '0.934', 'weapon3': '1.036', 'DAMAGECOUNT': '2.451', 'FRAGCOUNT': '6.000'} [2023-02-24 17:54:35,052][177154] DAMAGECOUNT value on done: 31791.0 [2023-02-24 17:54:35,053][177154] Sum rewards: -0.327, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.908', 'AMMO2': '0.004', 'AMMO5': '0.012', 'AMMO4': '0.018', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.097', 'weapon4': '0.122', 'weapon5': '0.188', 'WEAPON5': '0.200', 'HITCOUNT': '0.380', 'WEAPON3': '0.600', 'weapon3': '1.224', 'DAMAGECOUNT': '1.290', 'weapon2': '1.606', 'FRAGCOUNT': '3.000'} [2023-02-24 17:54:35,352][177154] DAMAGECOUNT value on done: 30253.0 [2023-02-24 17:54:35,352][177154] Sum rewards: 3.465, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.963', 'AMMO5': '0.007', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'ARMOR': '0.036', 'AMMO3': '0.041', 'weapon5': '0.080', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'weapon7': '0.164', 'HITCOUNT': '0.210', 'WEAPON3': '0.300', 'WEAPON4': '0.400', 'AMMO6': '0.420', 'AMMO7': '0.420', 'WEAPON7': '0.500', 'weapon4': '0.594', 'weapon3': '1.046', 'weapon2': '1.082', 'DAMAGECOUNT': '1.317', 'FRAGCOUNT': '5.000'} [2023-02-24 17:54:35,467][177172] DAMAGECOUNT value on done: 29505.0 [2023-02-24 17:54:35,468][177172] Sum rewards: -4.970, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.068', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.013', 'AMMO2': '0.033', 'WEAPON1': '0.050', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'AMMO4': '0.162', 'weapon4': '0.196', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.220', 'weapon5': '0.220', 'WEAPON5': '0.350', 'ARMOR': '0.424', 'DAMAGECOUNT': '0.648', 'WEAPON3': '0.700', 'weapon2': '1.290', 'weapon3': '1.416'} [2023-02-24 17:54:35,600][177154] DAMAGECOUNT value on done: 30521.0 [2023-02-24 17:54:35,600][177154] Sum rewards: 2.790, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.850', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.008', 'WEAPON1': '0.040', 'AMMO4': '0.042', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon7': '0.222', 'weapon4': '0.224', 'weapon5': '0.226', 'HITCOUNT': '0.270', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.936', 'weapon2': '1.248', 'weapon3': '1.350', 'FRAGCOUNT': '3.000'} [2023-02-24 17:54:35,777][177172] DAMAGECOUNT value on done: 28267.0 [2023-02-24 17:54:35,778][177172] Sum rewards: -4.998, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.150', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.006', 'AMMO5': '0.019', 'AMMO4': '0.030', 'WEAPON1': '0.080', 'weapon4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.152', 'weapon5': '0.160', 'HITCOUNT': '0.330', 'WEAPON5': '0.450', 'ARMOR': '0.458', 'WEAPON3': '0.900', 'weapon2': '0.974', 'DAMAGECOUNT': '1.176', 'weapon3': '2.230'} [2023-02-24 17:54:35,885][177154] DAMAGECOUNT value on done: 29929.0 [2023-02-24 17:54:35,885][177154] Sum rewards: 9.615, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.154', 'HEALTH': '0.266', 'weapon4': '0.278', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.500', 'weapon2': '0.550', 'weapon3': '1.302', 'DAMAGECOUNT': '2.412', 'FRAGCOUNT': '6.000'} [2023-02-24 17:54:35,942][177171] DAMAGECOUNT value on done: 28880.0 [2023-02-24 17:54:35,942][177171] Sum rewards: 3.061, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.918', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.011', 'WEAPON1': '0.030', 'AMMO3': '0.069', 'weapon5': '0.096', 'WEAPON5': '0.150', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.298', 'weapon2': '0.368', 'WEAPON3': '0.450', 'ARMOR': '0.460', 'DAMAGECOUNT': '1.047', 'weapon3': '1.350', 'FRAGCOUNT': '3.000'} [2023-02-24 17:54:36,189][177157] DAMAGECOUNT value on done: 32096.0 [2023-02-24 17:54:36,189][177157] Sum rewards: 5.558, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.470', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO3': '0.060', 'WEAPON1': '0.060', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'weapon5': '0.198', 'weapon4': '0.226', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.460', 'ARMOR': '0.470', 'DAMAGECOUNT': '1.440', 'weapon3': '1.470', 'weapon2': '1.680', 'FRAGCOUNT': '5.000'} [2023-02-24 17:54:36,239][177171] DAMAGECOUNT value on done: 28622.0 [2023-02-24 17:54:36,239][177171] Sum rewards: 6.718, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.540', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.034', 'WEAPON1': '0.040', 'AMMO3': '0.105', 'AMMO4': '0.171', 'weapon5': '0.176', 'WEAPON5': '0.200', 'weapon7': '0.270', 'WEAPON4': '0.300', 'AMMO6': '0.380', 'AMMO7': '0.380', 'WEAPON7': '0.500', 'HITCOUNT': '0.520', 'weapon4': '0.540', 'WEAPON3': '0.650', 'weapon2': '0.812', 'weapon3': '1.680', 'DAMAGECOUNT': '1.965', 'FRAGCOUNT': '6.000'} [2023-02-24 17:54:36,294][177171] DAMAGECOUNT value on done: 28668.0 [2023-02-24 17:54:36,294][177171] Sum rewards: 2.058, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.366', 'AMMO2': '0.013', 'AMMO5': '0.020', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.116', 'weapon5': '0.150', 'weapon4': '0.198', 'HITCOUNT': '0.360', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.269', 'weapon2': '1.506', 'weapon3': '1.730', 'FRAGCOUNT': '3.000'} [2023-02-24 17:54:36,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 26603520. Throughput: 0: 3482.4. Samples: 6645272. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 17:54:36,376][177119] Avg episode reward: [(0, '1.738')] [2023-02-24 17:54:36,380][177140] Saving new best policy, reward=1.738! [2023-02-24 17:54:36,500][177157] DAMAGECOUNT value on done: 30826.0 [2023-02-24 17:54:36,501][177157] Sum rewards: 0.890, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.384', 'AMMO5': '0.021', 'AMMO2': '0.028', 'WEAPON1': '0.060', 'AMMO3': '0.083', 'AMMO4': '0.140', 'WEAPON4': '0.250', 'weapon5': '0.258', 'HITCOUNT': '0.320', 'weapon4': '0.362', 'WEAPON3': '0.450', 'WEAPON5': '0.450', 'weapon3': '1.286', 'DAMAGECOUNT': '1.605', 'weapon2': '1.710', 'FRAGCOUNT': '2.500'} [2023-02-24 17:54:36,510][177157] DAMAGECOUNT value on done: 31226.0 [2023-02-24 17:54:36,511][177157] Sum rewards: 0.542, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.070', 'ARMOR': '0.016', 'AMMO2': '0.019', 'AMMO5': '0.022', 'WEAPON1': '0.090', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'weapon5': '0.192', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.430', 'WEAPON5': '0.450', 'HITCOUNT': '0.500', 'weapon2': '0.688', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.848', 'weapon3': '1.946', 'FRAGCOUNT': '2.000'} [2023-02-24 17:54:36,614][177171] DAMAGECOUNT value on done: 29437.0 [2023-02-24 17:54:36,615][177171] Sum rewards: 0.265, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.406', 'AMMO2': '0.015', 'AMMO5': '0.028', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'WEAPON1': '0.120', 'weapon4': '0.182', 'weapon5': '0.238', 'HITCOUNT': '0.380', 'WEAPON5': '0.700', 'WEAPON3': '0.850', 'weapon2': '0.916', 'DAMAGECOUNT': '1.476', 'weapon3': '2.222', 'FRAGCOUNT': '4.000'} [2023-02-24 17:54:36,810][177157] DAMAGECOUNT value on done: 28838.0 [2023-02-24 17:54:36,811][177157] Sum rewards: 0.038, reward structure: {'DEATHCOUNT': '-4.500', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.240', 'AMMO5': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon4': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.074', 'AMMO4': '0.083', 'HITCOUNT': '0.160', 'weapon5': '0.212', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'ARMOR': '0.451', 'weapon3': '0.644', 'DAMAGECOUNT': '0.675', 'weapon2': '2.260'} [2023-02-24 17:54:36,815][177155] DAMAGECOUNT value on done: 29651.0 [2023-02-24 17:54:36,815][177155] Sum rewards: 0.236, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.017', 'ARMOR': '0.020', 'AMMO2': '0.025', 'WEAPON1': '0.050', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'AMMO4': '0.126', 'HEALTH': '0.132', 'weapon5': '0.182', 'HITCOUNT': '0.220', 'weapon4': '0.232', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.227', 'weapon3': '1.508', 'weapon2': '1.652', 'FRAGCOUNT': '2.000'} [2023-02-24 17:54:37,105][177155] DAMAGECOUNT value on done: 32233.0 [2023-02-24 17:54:37,105][177155] Sum rewards: -0.907, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.540', 'AMMO5': '0.020', 'AMMO2': '0.024', 'WEAPON1': '0.070', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'weapon5': '0.228', 'HITCOUNT': '0.350', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'weapon4': '0.506', 'WEAPON3': '0.750', 'weapon2': '1.106', 'DAMAGECOUNT': '1.563', 'weapon3': '1.638', 'FRAGCOUNT': '2.500'} [2023-02-24 17:54:37,237][177155] DAMAGECOUNT value on done: 31029.0 [2023-02-24 17:54:37,237][177155] Sum rewards: -0.785, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.238', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.022', 'weapon7': '0.038', 'weapon5': '0.064', 'WEAPON1': '0.070', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.123', 'WEAPON5': '0.400', 'HITCOUNT': '0.540', 'WEAPON3': '0.900', 'weapon2': '1.710', 'DAMAGECOUNT': '1.875', 'weapon3': '1.918', 'FRAGCOUNT': '4.000'} [2023-02-24 17:54:37,541][177155] DAMAGECOUNT value on done: 30316.0 [2023-02-24 17:54:37,541][177155] Sum rewards: 4.046, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.820', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.032', 'WEAPON1': '0.060', 'AMMO3': '0.076', 'WEAPON4': '0.150', 'AMMO4': '0.160', 'weapon5': '0.236', 'HITCOUNT': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.422', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.023', 'weapon2': '1.058', 'weapon3': '1.676', 'FRAGCOUNT': '4.000'} [2023-02-24 17:54:37,657][177153] Updated weights for policy 0, policy_version 6500 (0.0009) [2023-02-24 17:54:40,589][177153] Updated weights for policy 0, policy_version 6510 (0.0009) [2023-02-24 17:54:40,707][177156] DAMAGECOUNT value on done: 29667.0 [2023-02-24 17:54:40,708][177156] Sum rewards: -0.837, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.191', 'AMMO5': '0.012', 'AMMO2': '0.027', 'ARMOR': '0.028', 'WEAPON1': '0.050', 'AMMO3': '0.067', 'AMMO4': '0.134', 'weapon5': '0.176', 'HITCOUNT': '0.180', 'WEAPON4': '0.250', 'weapon4': '0.288', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.000', 'DAMAGECOUNT': '1.002', 'weapon2': '1.890'} [2023-02-24 17:54:40,996][177156] DAMAGECOUNT value on done: 30843.0 [2023-02-24 17:54:40,997][177156] Sum rewards: 2.729, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.116', 'AMMO5': '0.017', 'AMMO2': '0.031', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.109', 'AMMO4': '0.154', 'weapon4': '0.200', 'weapon5': '0.254', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.510', 'WEAPON3': '0.700', 'weapon2': '1.226', 'weapon3': '1.826', 'DAMAGECOUNT': '1.968', 'FRAGCOUNT': '2.500'} [2023-02-24 17:54:41,092][177156] DAMAGECOUNT value on done: 31033.0 [2023-02-24 17:54:41,093][177156] Sum rewards: 2.482, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.660', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.033', 'WEAPON1': '0.050', 'weapon7': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.124', 'AMMO4': '0.164', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon5': '0.328', 'weapon4': '0.344', 'WEAPON4': '0.350', 'HITCOUNT': '0.520', 'WEAPON3': '0.700', 'weapon2': '1.258', 'weapon3': '1.552', 'FRAGCOUNT': '2.500', 'DAMAGECOUNT': '2.646'} [2023-02-24 17:54:41,376][177119] Fps is (10 sec: 13926.8, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 26673152. Throughput: 0: 3482.1. Samples: 6666046. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 17:54:41,376][177119] Avg episode reward: [(0, '1.764')] [2023-02-24 17:54:41,377][177140] Saving new best policy, reward=1.764! [2023-02-24 17:54:41,400][177156] DAMAGECOUNT value on done: 32614.0 [2023-02-24 17:54:41,401][177156] Sum rewards: 3.983, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.948', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.020', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO3': '0.100', 'weapon7': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.162', 'WEAPON7': '0.200', 'weapon4': '0.200', 'HITCOUNT': '0.410', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'weapon2': '1.436', 'weapon3': '1.666', 'DAMAGECOUNT': '1.878', 'FRAGCOUNT': '4.000'} [2023-02-24 17:54:43,537][177153] Updated weights for policy 0, policy_version 6520 (0.0008) [2023-02-24 17:54:46,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 26742784. Throughput: 0: 3484.0. Samples: 6686980. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:54:46,376][177119] Avg episode reward: [(0, '1.772')] [2023-02-24 17:54:46,380][177140] Saving new best policy, reward=1.772! [2023-02-24 17:54:46,494][177153] Updated weights for policy 0, policy_version 6530 (0.0009) [2023-02-24 17:54:46,816][177171] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 17:54:46,950][177154] Large shaping reward 2.526 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.504, 168.0), ('weapon5', 0.002)] [2023-02-24 17:54:49,414][177153] Updated weights for policy 0, policy_version 6540 (0.0008) [2023-02-24 17:54:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 26812416. Throughput: 0: 3483.0. Samples: 6697402. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:54:51,376][177119] Avg episode reward: [(0, '1.772')] [2023-02-24 17:54:52,251][177170] DAMAGECOUNT value on done: 31040.0 [2023-02-24 17:54:52,251][177170] Sum rewards: 5.727, reward structure: {'DEATHCOUNT': '-6.750', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'AMMO3': '0.066', 'weapon7': '0.068', 'HEALTH': '0.076', 'AMMO4': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.254', 'weapon4': '0.318', 'HITCOUNT': '0.330', 'WEAPON5': '0.400', 'WEAPON3': '0.400', 'weapon2': '0.800', 'weapon3': '1.158', 'DAMAGECOUNT': '2.250', 'FRAGCOUNT': '5.500'} [2023-02-24 17:54:52,353][177170] DAMAGECOUNT value on done: 28255.0 [2023-02-24 17:54:52,353][177170] Sum rewards: 3.782, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.742', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.136', 'WEAPON4': '0.250', 'ARMOR': '0.444', 'HITCOUNT': '0.460', 'weapon4': '0.552', 'WEAPON3': '0.700', 'weapon2': '1.178', 'DAMAGECOUNT': '1.698', 'weapon3': '1.748', 'FRAGCOUNT': '4.000'} [2023-02-24 17:54:52,377][177153] Updated weights for policy 0, policy_version 6550 (0.0008) [2023-02-24 17:54:52,557][177170] DAMAGECOUNT value on done: 34194.0 [2023-02-24 17:54:52,557][177170] Sum rewards: 0.228, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.445', 'AMMO5': '0.005', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.034', 'ARMOR': '0.052', 'weapon7': '0.072', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.370', 'WEAPON4': '0.400', 'weapon4': '0.536', 'WEAPON3': '0.650', 'weapon3': '1.058', 'weapon2': '1.206', 'DAMAGECOUNT': '1.374', 'FRAGCOUNT': '3.000'} [2023-02-24 17:54:52,663][177170] DAMAGECOUNT value on done: 32867.0 [2023-02-24 17:54:52,664][177170] Sum rewards: 4.028, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.021', 'ARMOR': '0.024', 'HEALTH': '0.025', 'AMMO2': '0.035', 'AMMO3': '0.050', 'WEAPON1': '0.050', 'WEAPON4': '0.150', 'AMMO4': '0.175', 'weapon4': '0.218', 'HITCOUNT': '0.350', 'WEAPON3': '0.350', 'weapon5': '0.364', 'WEAPON5': '0.400', 'weapon3': '1.136', 'DAMAGECOUNT': '1.575', 'weapon2': '1.854', 'FRAGCOUNT': '2.500'} [2023-02-24 17:54:52,818][177158] DAMAGECOUNT value on done: 30050.0 [2023-02-24 17:54:52,818][177158] Sum rewards: 2.842, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.737', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'WEAPON1': '0.040', 'AMMO3': '0.057', 'WEAPON4': '0.100', 'weapon5': '0.114', 'HITCOUNT': '0.150', 'weapon4': '0.194', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.396', 'WEAPON3': '0.450', 'ARMOR': '0.463', 'weapon3': '1.098', 'weapon2': '1.350', 'FRAGCOUNT': '2.000'} [2023-02-24 17:54:53,115][177158] DAMAGECOUNT value on done: 29635.0 [2023-02-24 17:54:53,115][177158] Sum rewards: 1.698, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.674', 'AMMO5': '0.024', 'AMMO2': '0.034', 'ARMOR': '0.036', 'weapon7': '0.048', 'WEAPON1': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.151', 'AMMO4': '0.169', 'weapon4': '0.250', 'weapon5': '0.262', 'WEAPON4': '0.400', 'HITCOUNT': '0.470', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'weapon2': '1.246', 'weapon3': '1.664', 'DAMAGECOUNT': '1.938', 'FRAGCOUNT': '7.000'} [2023-02-24 17:54:53,548][177172] DAMAGECOUNT value on done: 29250.0 [2023-02-24 17:54:53,549][177172] Sum rewards: 3.673, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.472', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon7': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.370', 'ARMOR': '0.400', 'weapon4': '0.404', 'WEAPON3': '0.600', 'weapon2': '1.046', 'weapon3': '1.602', 'DAMAGECOUNT': '1.929', 'FRAGCOUNT': '5.000'} [2023-02-24 17:54:53,852][177172] DAMAGECOUNT value on done: 29095.0 [2023-02-24 17:54:53,998][177158] DAMAGECOUNT value on done: 28759.0 [2023-02-24 17:54:53,998][177158] Sum rewards: -1.307, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.260', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'weapon5': '0.054', 'weapon7': '0.056', 'AMMO3': '0.145', 'WEAPON5': '0.150', 'AMMO6': '0.260', 'AMMO7': '0.260', 'HITCOUNT': '0.280', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.408', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.050', 'weapon2': '1.314', 'weapon3': '1.696', 'FRAGCOUNT': '5.000'} [2023-02-24 17:54:54,284][177158] DAMAGECOUNT value on done: 31557.0 [2023-02-24 17:54:54,285][177158] Sum rewards: 9.278, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.317', 'AMMO5': '0.007', 'AMMO2': '0.015', 'ARMOR': '0.016', 'WEAPON1': '0.040', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'AMMO3': '0.134', 'weapon4': '0.170', 'weapon5': '0.182', 'WEAPON5': '0.200', 'HITCOUNT': '0.710', 'WEAPON3': '0.850', 'weapon2': '1.206', 'weapon3': '2.068', 'DAMAGECOUNT': '2.823', 'FRAGCOUNT': '10.000'} [2023-02-24 17:54:54,405][177154] DAMAGECOUNT value on done: 32404.0 [2023-02-24 17:54:54,406][177154] Sum rewards: -0.558, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.430', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon7': '0.030', 'WEAPON1': '0.040', 'AMMO4': '0.044', 'weapon5': '0.054', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.140', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'HITCOUNT': '0.450', 'ARMOR': '0.460', 'weapon4': '0.506', 'WEAPON3': '0.900', 'weapon2': '0.986', 'weapon3': '1.806', 'DAMAGECOUNT': '1.839', 'FRAGCOUNT': '5.000'} [2023-02-24 17:54:54,702][177154] DAMAGECOUNT value on done: 30777.0 [2023-02-24 17:54:54,702][177154] Sum rewards: -3.002, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.096', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'ARMOR': '0.012', 'AMMO5': '0.016', 'weapon7': '0.076', 'WEAPON1': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.161', 'WEAPON7': '0.200', 'weapon5': '0.246', 'WEAPON5': '0.400', 'HITCOUNT': '0.450', 'WEAPON3': '0.950', 'weapon2': '1.176', 'DAMAGECOUNT': '1.572', 'FRAGCOUNT': '2.000', 'weapon3': '2.028'} [2023-02-24 17:54:54,816][177172] DAMAGECOUNT value on done: 29982.0 [2023-02-24 17:54:54,817][177172] Sum rewards: -1.983, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.308', 'AMMO5': '0.007', 'AMMO2': '0.021', 'ARMOR': '0.028', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.106', 'weapon4': '0.114', 'AMMO3': '0.137', 'weapon5': '0.174', 'WEAPON5': '0.250', 'HITCOUNT': '0.360', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.850', 'weapon2': '1.294', 'DAMAGECOUNT': '1.431', 'weapon3': '1.962'} [2023-02-24 17:54:54,954][177154] DAMAGECOUNT value on done: 31410.0 [2023-02-24 17:54:54,954][177154] Sum rewards: 4.830, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.420', 'AMMO5': '0.027', 'AMMO2': '0.038', 'WEAPON1': '0.050', 'AMMO3': '0.124', 'weapon5': '0.186', 'AMMO4': '0.188', 'WEAPON4': '0.350', 'weapon4': '0.588', 'WEAPON5': '0.600', 'HITCOUNT': '0.710', 'weapon2': '0.850', 'WEAPON3': '0.900', 'weapon3': '1.972', 'DAMAGECOUNT': '2.667', 'FRAGCOUNT': '6.000'} [2023-02-24 17:54:55,102][177172] DAMAGECOUNT value on done: 28676.0 [2023-02-24 17:54:55,103][177172] Sum rewards: 2.886, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.662', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.016', 'WEAPON1': '0.060', 'AMMO3': '0.101', 'HITCOUNT': '0.300', 'weapon5': '0.306', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.227', 'weapon2': '1.348', 'weapon3': '1.886', 'FRAGCOUNT': '4.000'} [2023-02-24 17:54:55,226][177171] DAMAGECOUNT value on done: 29267.0 [2023-02-24 17:54:55,226][177171] Sum rewards: -2.131, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.946', 'ARMOR': '0.012', 'AMMO2': '0.014', 'AMMO5': '0.025', 'weapon4': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'WEAPON1': '0.080', 'weapon5': '0.106', 'AMMO3': '0.108', 'HITCOUNT': '0.290', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.161', 'weapon2': '1.206', 'weapon3': '1.616'} [2023-02-24 17:54:55,256][177154] DAMAGECOUNT value on done: 30558.0 [2023-02-24 17:54:55,257][177154] Sum rewards: 9.037, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.012', 'AMMO2': '0.027', 'WEAPON1': '0.060', 'AMMO3': '0.069', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'weapon5': '0.204', 'WEAPON5': '0.300', 'weapon4': '0.366', 'HEALTH': '0.379', 'WEAPON3': '0.400', 'HITCOUNT': '0.520', 'weapon2': '0.828', 'ARMOR': '0.892', 'weapon3': '1.306', 'DAMAGECOUNT': '1.887', 'FRAGCOUNT': '6.000'} [2023-02-24 17:54:55,320][177153] Updated weights for policy 0, policy_version 6560 (0.0008) [2023-02-24 17:54:55,523][177157] DAMAGECOUNT value on done: 32332.0 [2023-02-24 17:54:55,524][177157] Sum rewards: 2.160, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.285', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO3': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'weapon7': '0.214', 'weapon4': '0.240', 'HITCOUNT': '0.250', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.708', 'weapon3': '1.354', 'weapon2': '1.390', 'FRAGCOUNT': '3.000'} [2023-02-24 17:54:55,525][177171] DAMAGECOUNT value on done: 28852.0 [2023-02-24 17:54:55,526][177171] Sum rewards: -3.691, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.276', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.022', 'ARMOR': '0.028', 'AMMO2': '0.061', 'weapon4': '0.078', 'AMMO3': '0.087', 'HITCOUNT': '0.090', 'WEAPON1': '0.110', 'weapon5': '0.182', 'WEAPON4': '0.300', 'AMMO4': '0.303', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.690', 'weapon3': '1.422', 'weapon2': '1.762'} [2023-02-24 17:54:55,594][177171] DAMAGECOUNT value on done: 29572.0 [2023-02-24 17:54:55,595][177171] Sum rewards: 6.735, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.460', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.015', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'AMMO3': '0.070', 'weapon5': '0.088', 'weapon4': '0.088', 'weapon7': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.230', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON3': '0.500', 'weapon3': '1.280', 'weapon2': '1.780', 'DAMAGECOUNT': '2.112', 'FRAGCOUNT': '5.000'} [2023-02-24 17:54:55,820][177157] DAMAGECOUNT value on done: 31703.0 [2023-02-24 17:54:55,820][177157] Sum rewards: -0.320, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.120', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.009', 'AMMO5': '0.013', 'WEAPON1': '0.030', 'AMMO4': '0.047', 'AMMO3': '0.112', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.426', 'HITCOUNT': '0.550', 'WEAPON3': '0.650', 'weapon2': '0.928', 'weapon3': '1.920', 'DAMAGECOUNT': '2.631'} [2023-02-24 17:54:55,828][177157] DAMAGECOUNT value on done: 31550.0 [2023-02-24 17:54:55,829][177157] Sum rewards: 0.203, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.064', 'weapon5': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'ARMOR': '0.052', 'AMMO3': '0.094', 'AMMO4': '0.148', 'WEAPON5': '0.200', 'weapon7': '0.280', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.600', 'weapon4': '0.696', 'weapon2': '0.804', 'DAMAGECOUNT': '0.972', 'weapon3': '1.550', 'FRAGCOUNT': '2.500'} [2023-02-24 17:54:55,895][177171] DAMAGECOUNT value on done: 29666.0 [2023-02-24 17:54:55,896][177171] Sum rewards: 0.982, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.194', 'AMMO2': '0.005', 'AMMO5': '0.006', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.023', 'AMMO3': '0.075', 'weapon5': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.210', 'weapon4': '0.252', 'weapon7': '0.430', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.687', 'weapon3': '0.890', 'FRAGCOUNT': '1.000', 'weapon2': '1.620'} [2023-02-24 17:54:56,140][177157] DAMAGECOUNT value on done: 29276.0 [2023-02-24 17:54:56,140][177157] Sum rewards: 2.107, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.658', 'AMMO5': '0.007', 'AMMO2': '0.011', 'ARMOR': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.054', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.124', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.260', 'weapon4': '0.262', 'weapon7': '0.386', 'weapon2': '0.700', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.314', 'weapon3': '2.156', 'FRAGCOUNT': '4.000'} [2023-02-24 17:54:56,144][177155] DAMAGECOUNT value on done: 30141.0 [2023-02-24 17:54:56,145][177155] Sum rewards: 0.704, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.514', 'AMMO5': '0.010', 'AMMO2': '0.031', 'ARMOR': '0.036', 'WEAPON1': '0.060', 'weapon5': '0.102', 'AMMO3': '0.108', 'AMMO4': '0.157', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.350', 'weapon4': '0.460', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.412', 'DAMAGECOUNT': '1.470', 'weapon3': '1.672'} [2023-02-24 17:54:56,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 26882048. Throughput: 0: 3482.9. Samples: 6718208. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:54:56,376][177119] Avg episode reward: [(0, '1.907')] [2023-02-24 17:54:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000006563_26882048.pth... [2023-02-24 17:54:56,438][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000005745_23531520.pth [2023-02-24 17:54:56,445][177140] Saving new best policy, reward=1.907! [2023-02-24 17:54:56,448][177155] DAMAGECOUNT value on done: 33033.0 [2023-02-24 17:54:56,448][177155] Sum rewards: 4.086, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.230', 'AMMO5': '0.012', 'AMMO2': '0.028', 'ARMOR': '0.036', 'weapon7': '0.056', 'WEAPON1': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'weapon4': '0.240', 'weapon5': '0.254', 'WEAPON5': '0.350', 'HITCOUNT': '0.560', 'WEAPON3': '0.950', 'weapon2': '1.192', 'weapon3': '1.690', 'DAMAGECOUNT': '2.400', 'FRAGCOUNT': '8.000'} [2023-02-24 17:54:56,609][177155] DAMAGECOUNT value on done: 31929.0 [2023-02-24 17:54:56,610][177155] Sum rewards: 5.288, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.016', 'AMMO5': '0.015', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'weapon5': '0.092', 'AMMO4': '0.092', 'AMMO3': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.184', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'HITCOUNT': '0.580', 'weapon4': '0.638', 'WEAPON3': '0.650', 'weapon2': '0.754', 'weapon3': '1.510', 'DAMAGECOUNT': '2.700', 'FRAGCOUNT': '6.000'} [2023-02-24 17:54:56,900][177155] DAMAGECOUNT value on done: 30486.0 [2023-02-24 17:54:58,293][177153] Updated weights for policy 0, policy_version 6570 (0.0008) [2023-02-24 17:55:00,080][177156] DAMAGECOUNT value on done: 30261.0 [2023-02-24 17:55:00,080][177156] Sum rewards: 5.468, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.146', 'AMMO5': '0.012', 'AMMO2': '0.016', 'ARMOR': '0.024', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.091', 'weapon4': '0.096', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.200', 'weapon5': '0.254', 'HITCOUNT': '0.360', 'weapon7': '0.362', 'WEAPON3': '0.550', 'weapon2': '1.210', 'weapon3': '1.698', 'DAMAGECOUNT': '1.782', 'FRAGCOUNT': '6.000'} [2023-02-24 17:55:00,386][177156] DAMAGECOUNT value on done: 31250.0 [2023-02-24 17:55:00,386][177156] Sum rewards: 1.718, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.004', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon5': '0.028', 'WEAPON1': '0.040', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.102', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.200', 'weapon2': '0.296', 'weapon4': '0.510', 'WEAPON3': '0.600', 'weapon7': '0.814', 'weapon3': '0.900', 'DAMAGECOUNT': '1.221', 'FRAGCOUNT': '3.000'} [2023-02-24 17:55:00,485][177156] DAMAGECOUNT value on done: 31869.0 [2023-02-24 17:55:00,486][177156] Sum rewards: 6.575, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.134', 'AMMO2': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.020', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'weapon5': '0.180', 'WEAPON5': '0.200', 'weapon4': '0.226', 'WEAPON3': '0.500', 'HITCOUNT': '0.630', 'weapon2': '1.262', 'weapon3': '1.474', 'DAMAGECOUNT': '2.508', 'FRAGCOUNT': '4.000'} [2023-02-24 17:55:00,784][177156] DAMAGECOUNT value on done: 32962.0 [2023-02-24 17:55:00,785][177156] Sum rewards: -4.251, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.321', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON1': '0.040', 'weapon4': '0.062', 'AMMO3': '0.120', 'WEAPON4': '0.200', 'weapon5': '0.280', 'HITCOUNT': '0.290', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.044', 'weapon2': '1.316', 'weapon3': '1.764', 'FRAGCOUNT': '3.000'} [2023-02-24 17:55:01,237][177153] Updated weights for policy 0, policy_version 6580 (0.0008) [2023-02-24 17:55:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 26951680. Throughput: 0: 3482.4. Samples: 6739112. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:55:01,376][177119] Avg episode reward: [(0, '1.989')] [2023-02-24 17:55:01,377][177140] Saving new best policy, reward=1.989! [2023-02-24 17:55:04,164][177153] Updated weights for policy 0, policy_version 6590 (0.0008) [2023-02-24 17:55:06,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 27021312. Throughput: 0: 3482.2. Samples: 6749550. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:55:06,376][177119] Avg episode reward: [(0, '1.989')] [2023-02-24 17:55:07,095][177153] Updated weights for policy 0, policy_version 6600 (0.0008) [2023-02-24 17:55:10,032][177153] Updated weights for policy 0, policy_version 6610 (0.0008) [2023-02-24 17:55:11,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 27090944. Throughput: 0: 3479.2. Samples: 6770428. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:55:11,376][177119] Avg episode reward: [(0, '1.989')] [2023-02-24 17:55:11,488][177170] DAMAGECOUNT value on done: 31359.0 [2023-02-24 17:55:11,489][177170] Sum rewards: 1.425, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.550', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.037', 'AMMO3': '0.114', 'weapon5': '0.134', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.240', 'weapon4': '0.318', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.957', 'weapon3': '1.330', 'weapon2': '1.722', 'FRAGCOUNT': '3.000'} [2023-02-24 17:55:11,562][177170] DAMAGECOUNT value on done: 28445.0 [2023-02-24 17:55:11,562][177170] Sum rewards: -1.487, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.460', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.048', 'AMMO3': '0.097', 'WEAPON5': '0.150', 'weapon7': '0.160', 'HITCOUNT': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'DAMAGECOUNT': '0.570', 'weapon4': '0.616', 'WEAPON3': '0.650', 'weapon2': '0.834', 'weapon3': '1.120', 'FRAGCOUNT': '2.000'} [2023-02-24 17:55:11,789][177170] DAMAGECOUNT value on done: 34935.0 [2023-02-24 17:55:11,790][177170] Sum rewards: 5.211, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.384', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'weapon5': '0.070', 'AMMO3': '0.107', 'WEAPON5': '0.150', 'weapon4': '0.180', 'weapon7': '0.190', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'HITCOUNT': '0.480', 'WEAPON3': '0.600', 'weapon2': '0.998', 'weapon3': '1.542', 'DAMAGECOUNT': '2.223', 'FRAGCOUNT': '5.500'} [2023-02-24 17:55:11,867][177170] DAMAGECOUNT value on done: 33340.0 [2023-02-24 17:55:11,867][177170] Sum rewards: 3.414, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.424', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.015', 'weapon5': '0.048', 'AMMO4': '0.075', 'AMMO3': '0.093', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.470', 'weapon4': '0.484', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.419', 'weapon3': '1.486', 'weapon2': '1.682', 'FRAGCOUNT': '3.000'} [2023-02-24 17:55:12,144][177158] DAMAGECOUNT value on done: 30795.0 [2023-02-24 17:55:12,144][177158] Sum rewards: 0.899, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.860', 'AMMO2': '0.008', 'AMMO5': '0.012', 'AMMO4': '0.040', 'weapon7': '0.052', 'weapon5': '0.058', 'WEAPON1': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.150', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.590', 'WEAPON3': '0.950', 'weapon2': '1.538', 'weapon3': '1.824', 'DAMAGECOUNT': '2.235', 'FRAGCOUNT': '6.000'} [2023-02-24 17:55:12,453][177158] DAMAGECOUNT value on done: 29920.0 [2023-02-24 17:55:12,454][177158] Sum rewards: -1.359, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.180', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'weapon4': '0.032', 'weapon5': '0.070', 'AMMO4': '0.097', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'HITCOUNT': '0.270', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.855', 'FRAGCOUNT': '1.000', 'weapon2': '1.640', 'weapon3': '1.962'} [2023-02-24 17:55:12,877][177172] DAMAGECOUNT value on done: 29755.0 [2023-02-24 17:55:12,877][177172] Sum rewards: 0.633, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.464', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO3': '0.086', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'HITCOUNT': '0.370', 'weapon4': '0.494', 'WEAPON3': '0.650', 'weapon2': '1.218', 'weapon3': '1.500', 'DAMAGECOUNT': '1.503', 'FRAGCOUNT': '2.000'} [2023-02-24 17:55:13,007][177153] Updated weights for policy 0, policy_version 6620 (0.0009) [2023-02-24 17:55:13,167][177172] DAMAGECOUNT value on done: 29512.0 [2023-02-24 17:55:13,167][177172] Sum rewards: 0.647, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.280', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.037', 'AMMO3': '0.101', 'weapon5': '0.106', 'AMMO4': '0.187', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'HITCOUNT': '0.440', 'weapon4': '0.534', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.251', 'weapon2': '1.368', 'weapon3': '1.570', 'FRAGCOUNT': '4.000'} [2023-02-24 17:55:13,349][177158] DAMAGECOUNT value on done: 29372.0 [2023-02-24 17:55:13,350][177158] Sum rewards: 2.270, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.700', 'ARMOR': '0.012', 'AMMO2': '0.017', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'weapon7': '0.086', 'AMMO4': '0.086', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.115', 'weapon4': '0.144', 'WEAPON4': '0.150', 'weapon5': '0.208', 'WEAPON5': '0.350', 'HITCOUNT': '0.530', 'WEAPON3': '0.750', 'weapon2': '0.942', 'DAMAGECOUNT': '1.839', 'FRAGCOUNT': '2.000', 'weapon3': '2.138'} [2023-02-24 17:55:13,655][177158] DAMAGECOUNT value on done: 32412.0 [2023-02-24 17:55:13,655][177158] Sum rewards: 4.137, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.455', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.016', 'WEAPON1': '0.050', 'weapon7': '0.100', 'AMMO3': '0.102', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon5': '0.200', 'WEAPON5': '0.400', 'HITCOUNT': '0.710', 'WEAPON3': '0.800', 'weapon2': '1.028', 'weapon3': '2.348', 'DAMAGECOUNT': '2.565', 'FRAGCOUNT': '5.000'} [2023-02-24 17:55:13,689][177154] DAMAGECOUNT value on done: 32804.0 [2023-02-24 17:55:13,689][177154] Sum rewards: -3.021, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.000', 'HEALTH': '-0.550', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'ARMOR': '0.027', 'weapon7': '0.076', 'AMMO3': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.142', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.340', 'WEAPON3': '0.650', 'weapon4': '0.716', 'weapon2': '0.912', 'DAMAGECOUNT': '1.200', 'weapon3': '1.622'} [2023-02-24 17:55:13,986][177154] DAMAGECOUNT value on done: 31327.0 [2023-02-24 17:55:13,987][177154] Sum rewards: 4.163, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.097', 'AMMO2': '0.010', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.049', 'ARMOR': '0.064', 'AMMO3': '0.081', 'weapon7': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.232', 'HITCOUNT': '0.290', 'WEAPON5': '0.400', 'weapon4': '0.406', 'WEAPON3': '0.450', 'weapon3': '1.022', 'DAMAGECOUNT': '1.650', 'weapon2': '1.826', 'FRAGCOUNT': '4.000'} [2023-02-24 17:55:14,105][177172] DAMAGECOUNT value on done: 30660.0 [2023-02-24 17:55:14,106][177172] Sum rewards: 5.940, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.160', 'AMMO5': '0.025', 'AMMO2': '0.026', 'ARMOR': '0.040', 'WEAPON1': '0.070', 'AMMO3': '0.074', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'weapon4': '0.210', 'HITCOUNT': '0.260', 'weapon5': '0.282', 'WEAPON3': '0.500', 'WEAPON5': '0.550', 'weapon2': '1.214', 'weapon3': '1.560', 'DAMAGECOUNT': '2.010', 'FRAGCOUNT': '5.000'} [2023-02-24 17:55:14,238][177154] DAMAGECOUNT value on done: 32062.0 [2023-02-24 17:55:14,239][177154] Sum rewards: 9.570, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.985', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.184', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.350', 'WEAPON3': '0.400', 'weapon3': '1.086', 'weapon2': '1.772', 'DAMAGECOUNT': '1.956', 'FRAGCOUNT': '7.000'} [2023-02-24 17:55:14,418][177172] DAMAGECOUNT value on done: 29430.0 [2023-02-24 17:55:14,419][177172] Sum rewards: 5.921, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.013', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'HEALTH': '0.033', 'WEAPON4': '0.050', 'AMMO4': '0.115', 'AMMO3': '0.120', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.216', 'weapon5': '0.244', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.400', 'WEAPON3': '0.700', 'weapon2': '1.252', 'weapon3': '1.662', 'DAMAGECOUNT': '2.262', 'FRAGCOUNT': '5.000'} [2023-02-24 17:55:14,550][177154] DAMAGECOUNT value on done: 30915.0 [2023-02-24 17:55:14,551][177154] Sum rewards: 3.762, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.252', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'AMMO3': '0.097', 'AMMO4': '0.133', 'weapon5': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.350', 'weapon4': '0.578', 'WEAPON3': '0.600', 'weapon2': '0.894', 'DAMAGECOUNT': '1.071', 'weapon3': '1.332', 'FRAGCOUNT': '5.000'} [2023-02-24 17:55:14,625][177171] DAMAGECOUNT value on done: 29558.0 [2023-02-24 17:55:14,625][177171] Sum rewards: -0.057, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-2.020', 'AMMO5': '0.005', 'AMMO2': '0.009', 'ARMOR': '0.020', 'WEAPON1': '0.020', 'weapon5': '0.036', 'AMMO4': '0.045', 'AMMO3': '0.047', 'WEAPON5': '0.100', 'weapon7': '0.130', 'HITCOUNT': '0.280', 'WEAPON4': '0.400', 'WEAPON3': '0.400', 'AMMO6': '0.520', 'AMMO7': '0.520', 'weapon4': '0.584', 'WEAPON7': '0.600', 'weapon3': '0.778', 'weapon2': '0.846', 'DAMAGECOUNT': '0.873', 'FRAGCOUNT': '1.000'} [2023-02-24 17:55:14,862][177157] DAMAGECOUNT value on done: 32799.0 [2023-02-24 17:55:14,862][177157] Sum rewards: 2.127, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.456', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.025', 'WEAPON1': '0.030', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.102', 'AMMO3': '0.114', 'WEAPON5': '0.200', 'weapon5': '0.220', 'HITCOUNT': '0.420', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.216', 'DAMAGECOUNT': '1.401', 'weapon2': '1.492'} [2023-02-24 17:55:14,927][177171] DAMAGECOUNT value on done: 29601.0 [2023-02-24 17:55:14,927][177171] Sum rewards: 1.595, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.430', 'AMMO5': '0.010', 'AMMO2': '0.014', 'ARMOR': '0.028', 'WEAPON1': '0.050', 'AMMO4': '0.070', 'AMMO3': '0.112', 'weapon5': '0.112', 'weapon4': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.570', 'WEAPON3': '0.700', 'weapon3': '1.514', 'weapon2': '1.740', 'DAMAGECOUNT': '2.247', 'FRAGCOUNT': '5.000'} [2023-02-24 17:55:14,986][177171] DAMAGECOUNT value on done: 30208.0 [2023-02-24 17:55:14,986][177171] Sum rewards: 4.654, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.119', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.010', 'WEAPON1': '0.040', 'AMMO4': '0.048', 'AMMO3': '0.075', 'WEAPON4': '0.150', 'weapon5': '0.184', 'weapon4': '0.270', 'WEAPON5': '0.300', 'HITCOUNT': '0.500', 'WEAPON3': '0.550', 'weapon2': '1.570', 'weapon3': '1.652', 'DAMAGECOUNT': '1.908', 'FRAGCOUNT': '3.000'} [2023-02-24 17:55:15,153][177157] DAMAGECOUNT value on done: 32091.0 [2023-02-24 17:55:15,154][177157] Sum rewards: 3.763, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.005', 'AMMO5': '0.009', 'AMMO4': '0.026', 'WEAPON1': '0.050', 'AMMO3': '0.056', 'weapon5': '0.194', 'WEAPON5': '0.250', 'HEALTH': '0.326', 'HITCOUNT': '0.340', 'WEAPON3': '0.350', 'weapon2': '0.844', 'weapon3': '1.148', 'DAMAGECOUNT': '1.164', 'FRAGCOUNT': '2.000'} [2023-02-24 17:55:15,164][177157] DAMAGECOUNT value on done: 31696.0 [2023-02-24 17:55:15,164][177157] Sum rewards: 4.943, reward structure: {'DEATHCOUNT': '-1.500', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.059', 'weapon4': '0.092', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'HITCOUNT': '0.170', 'WEAPON3': '0.200', 'DAMAGECOUNT': '0.438', 'HEALTH': '0.445', 'ARMOR': '0.492', 'weapon3': '1.000', 'weapon2': '1.224', 'FRAGCOUNT': '2.000'} [2023-02-24 17:55:15,285][177171] DAMAGECOUNT value on done: 30382.0 [2023-02-24 17:55:15,286][177171] Sum rewards: 9.301, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.699', 'AMMO2': '0.016', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'weapon4': '0.046', 'AMMO3': '0.068', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.198', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.520', 'weapon3': '1.364', 'weapon2': '1.370', 'DAMAGECOUNT': '2.148', 'FRAGCOUNT': '7.000'} [2023-02-24 17:55:15,460][177157] DAMAGECOUNT value on done: 29797.0 [2023-02-24 17:55:15,460][177157] Sum rewards: 3.334, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.390', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.007', 'AMMO3': '0.048', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'weapon5': '0.210', 'HITCOUNT': '0.270', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'weapon3': '0.792', 'DAMAGECOUNT': '1.563', 'weapon2': '2.558', 'FRAGCOUNT': '3.000'} [2023-02-24 17:55:15,516][177155] DAMAGECOUNT value on done: 30819.0 [2023-02-24 17:55:15,516][177155] Sum rewards: 6.671, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.520', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'ARMOR': '0.068', 'weapon5': '0.084', 'AMMO4': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon7': '0.100', 'AMMO3': '0.121', 'WEAPON4': '0.150', 'weapon4': '0.408', 'HITCOUNT': '0.440', 'WEAPON3': '0.600', 'weapon2': '0.952', 'weapon3': '1.954', 'DAMAGECOUNT': '2.034', 'FRAGCOUNT': '5.000'} [2023-02-24 17:55:15,812][177155] DAMAGECOUNT value on done: 33685.0 [2023-02-24 17:55:15,813][177155] Sum rewards: 4.458, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.346', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.040', 'ARMOR': '0.052', 'AMMO4': '0.054', 'weapon5': '0.088', 'AMMO3': '0.107', 'weapon4': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.440', 'WEAPON3': '0.650', 'weapon3': '1.494', 'weapon2': '1.932', 'DAMAGECOUNT': '1.956', 'FRAGCOUNT': '5.000'} [2023-02-24 17:55:15,956][177155] DAMAGECOUNT value on done: 32383.0 [2023-02-24 17:55:15,956][177155] Sum rewards: -0.230, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.018', 'AMMO2': '0.002', 'AMMO4': '0.008', 'ARMOR': '0.012', 'AMMO5': '0.016', 'WEAPON1': '0.030', 'weapon4': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.118', 'weapon5': '0.146', 'HITCOUNT': '0.320', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.362', 'weapon2': '1.576', 'weapon3': '1.718', 'FRAGCOUNT': '4.000'} [2023-02-24 17:55:15,967][177153] Updated weights for policy 0, policy_version 6630 (0.0008) [2023-02-24 17:55:16,246][177155] DAMAGECOUNT value on done: 31026.0 [2023-02-24 17:55:16,247][177155] Sum rewards: 2.907, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.805', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.018', 'weapon4': '0.036', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon7': '0.052', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.114', 'AMMO3': '0.131', 'WEAPON5': '0.450', 'HITCOUNT': '0.520', 'WEAPON3': '0.950', 'weapon2': '1.072', 'DAMAGECOUNT': '1.620', 'weapon3': '1.888', 'FRAGCOUNT': '5.000'} [2023-02-24 17:55:16,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 27160576. Throughput: 0: 3474.5. Samples: 6791226. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 17:55:16,376][177119] Avg episode reward: [(0, '2.164')] [2023-02-24 17:55:16,379][177140] Saving new best policy, reward=2.164! [2023-02-24 17:55:18,918][177153] Updated weights for policy 0, policy_version 6640 (0.0008) [2023-02-24 17:55:19,412][177156] DAMAGECOUNT value on done: 31006.0 [2023-02-24 17:55:19,413][177156] Sum rewards: 0.408, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.732', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'weapon5': '0.034', 'ARMOR': '0.044', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.282', 'HITCOUNT': '0.600', 'WEAPON3': '0.900', 'weapon2': '1.226', 'weapon3': '2.080', 'DAMAGECOUNT': '2.235', 'FRAGCOUNT': '4.000'} [2023-02-24 17:55:19,714][177156] DAMAGECOUNT value on done: 31971.0 [2023-02-24 17:55:19,715][177156] Sum rewards: 6.017, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.159', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO3': '0.062', 'ARMOR': '0.064', 'AMMO4': '0.088', 'weapon5': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.384', 'WEAPON3': '0.450', 'HITCOUNT': '0.630', 'weapon3': '1.346', 'weapon2': '1.760', 'DAMAGECOUNT': '2.163', 'FRAGCOUNT': '4.000'} [2023-02-24 17:55:19,840][177156] DAMAGECOUNT value on done: 32253.0 [2023-02-24 17:55:19,841][177156] Sum rewards: 0.205, reward structure: {'DEATHCOUNT': '-8.250', 'ARMOR': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon4': '0.026', 'AMMO2': '0.026', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'AMMO4': '0.130', 'WEAPON5': '0.200', 'weapon5': '0.224', 'HITCOUNT': '0.350', 'WEAPON3': '0.350', 'HEALTH': '0.444', 'DAMAGECOUNT': '1.152', 'weapon3': '1.292', 'FRAGCOUNT': '2.000', 'weapon2': '2.056'} [2023-02-24 17:55:20,144][177156] DAMAGECOUNT value on done: 33284.0 [2023-02-24 17:55:20,144][177156] Sum rewards: -3.912, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.392', 'ARMOR': '0.004', 'AMMO2': '0.006', 'weapon7': '0.010', 'AMMO5': '0.016', 'AMMO4': '0.030', 'WEAPON1': '0.070', 'AMMO3': '0.135', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.212', 'weapon5': '0.244', 'HITCOUNT': '0.280', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.966', 'FRAGCOUNT': '1.000', 'weapon2': '1.084', 'weapon3': '2.072'} [2023-02-24 17:55:21,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 27230208. Throughput: 0: 3476.3. Samples: 6801704. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:55:21,376][177119] Avg episode reward: [(0, '2.159')] [2023-02-24 17:55:21,866][177153] Updated weights for policy 0, policy_version 6650 (0.0008) [2023-02-24 17:55:24,822][177153] Updated weights for policy 0, policy_version 6660 (0.0008) [2023-02-24 17:55:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 27299840. Throughput: 0: 3477.6. Samples: 6822536. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:55:26,376][177119] Avg episode reward: [(0, '2.159')] [2023-02-24 17:55:27,740][177153] Updated weights for policy 0, policy_version 6670 (0.0008) [2023-02-24 17:55:30,664][177153] Updated weights for policy 0, policy_version 6680 (0.0008) [2023-02-24 17:55:30,822][177170] DAMAGECOUNT value on done: 32147.0 [2023-02-24 17:55:30,822][177170] Sum rewards: 6.396, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.730', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.009', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'weapon4': '0.362', 'WEAPON7': '0.400', 'weapon7': '0.468', 'HITCOUNT': '0.580', 'weapon3': '0.888', 'weapon2': '1.298', 'DAMAGECOUNT': '2.364', 'FRAGCOUNT': '4.000'} [2023-02-24 17:55:30,910][177170] DAMAGECOUNT value on done: 28886.0 [2023-02-24 17:55:30,910][177170] Sum rewards: -7.247, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.340', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'weapon7': '0.052', 'weapon4': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.156', 'AMMO4': '0.158', 'AMMO3': '0.198', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.310', 'WEAPON5': '0.400', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.150', 'DAMAGECOUNT': '1.323', 'weapon3': '1.418', 'weapon2': '1.498'} [2023-02-24 17:55:31,135][177170] DAMAGECOUNT value on done: 35294.0 [2023-02-24 17:55:31,135][177170] Sum rewards: -0.413, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.285', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO2': '0.041', 'weapon5': '0.080', 'weapon7': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.111', 'WEAPON5': '0.150', 'AMMO4': '0.207', 'HITCOUNT': '0.310', 'WEAPON4': '0.400', 'WEAPON3': '0.650', 'weapon4': '0.716', 'DAMAGECOUNT': '1.077', 'weapon2': '1.126', 'weapon3': '1.578', 'FRAGCOUNT': '4.500'} [2023-02-24 17:55:31,216][177170] DAMAGECOUNT value on done: 33737.0 [2023-02-24 17:55:31,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.5, 300 sec: 13954.2). Total num frames: 27369472. Throughput: 0: 3475.7. Samples: 6843384. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:55:31,376][177119] Avg episode reward: [(0, '2.054')] [2023-02-24 17:55:31,500][177158] DAMAGECOUNT value on done: 31465.0 [2023-02-24 17:55:31,501][177158] Sum rewards: 3.667, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.702', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO3': '0.085', 'AMMO4': '0.148', 'WEAPON5': '0.200', 'weapon5': '0.260', 'WEAPON4': '0.350', 'ARMOR': '0.416', 'weapon4': '0.474', 'HITCOUNT': '0.620', 'WEAPON3': '0.650', 'weapon2': '1.044', 'weapon3': '1.822', 'DAMAGECOUNT': '2.010', 'FRAGCOUNT': '4.000'} [2023-02-24 17:55:31,802][177158] DAMAGECOUNT value on done: 30312.0 [2023-02-24 17:55:31,802][177158] Sum rewards: -0.854, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.452', 'FRAGCOUNT': '0.000', 'AMMO5': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.050', 'AMMO3': '0.056', 'AMMO4': '0.086', 'HITCOUNT': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.266', 'weapon7': '0.286', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'weapon3': '1.156', 'DAMAGECOUNT': '1.176', 'weapon2': '1.720'} [2023-02-24 17:55:32,200][177172] DAMAGECOUNT value on done: 29970.0 [2023-02-24 17:55:32,200][177172] Sum rewards: -0.389, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.054', 'AMMO5': '0.007', 'AMMO2': '0.026', 'ARMOR': '0.036', 'WEAPON1': '0.070', 'AMMO3': '0.099', 'AMMO4': '0.131', 'HITCOUNT': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon5': '0.432', 'weapon4': '0.436', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.650', 'weapon3': '1.424', 'weapon2': '1.458', 'FRAGCOUNT': '2.000'} [2023-02-24 17:55:32,508][177172] DAMAGECOUNT value on done: 29990.0 [2023-02-24 17:55:32,508][177172] Sum rewards: -0.373, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.846', 'AMMO2': '0.006', 'weapon4': '0.006', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO4': '0.028', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.122', 'weapon5': '0.126', 'WEAPON5': '0.150', 'HITCOUNT': '0.520', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.434', 'weapon3': '1.694', 'weapon2': '1.714', 'FRAGCOUNT': '2.000'} [2023-02-24 17:55:32,699][177158] DAMAGECOUNT value on done: 29779.0 [2023-02-24 17:55:32,700][177158] Sum rewards: 1.307, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.731', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO4': '0.030', 'AMMO3': '0.090', 'weapon5': '0.096', 'WEAPON5': '0.300', 'HITCOUNT': '0.370', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.221', 'weapon3': '1.290', 'FRAGCOUNT': '2.000', 'weapon2': '2.044'} [2023-02-24 17:55:32,972][177154] DAMAGECOUNT value on done: 32939.0 [2023-02-24 17:55:32,972][177154] Sum rewards: 2.665, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.444', 'AMMO5': '0.007', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO3': '0.032', 'WEAPON4': '0.050', 'AMMO4': '0.055', 'HITCOUNT': '0.060', 'weapon5': '0.076', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon7': '0.206', 'weapon4': '0.244', 'WEAPON3': '0.250', 'DAMAGECOUNT': '0.405', 'weapon3': '0.742', 'weapon2': '1.202', 'FRAGCOUNT': '2.000'} [2023-02-24 17:55:33,017][177158] DAMAGECOUNT value on done: 33047.0 [2023-02-24 17:55:33,017][177158] Sum rewards: 2.443, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.636', 'AMMO2': '0.014', 'AMMO5': '0.015', 'WEAPON1': '0.060', 'AMMO4': '0.068', 'weapon7': '0.072', 'AMMO3': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.226', 'WEAPON4': '0.300', 'HITCOUNT': '0.330', 'weapon4': '0.366', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.154', 'weapon3': '1.226', 'DAMAGECOUNT': '1.905', 'FRAGCOUNT': '5.000'} [2023-02-24 17:55:33,274][177154] DAMAGECOUNT value on done: 31772.0 [2023-02-24 17:55:33,275][177154] Sum rewards: 2.145, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.245', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO3': '0.081', 'WEAPON5': '0.150', 'weapon5': '0.248', 'HITCOUNT': '0.300', 'ARMOR': '0.509', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.268', 'DAMAGECOUNT': '1.335', 'weapon2': '2.172'} [2023-02-24 17:55:33,481][177172] DAMAGECOUNT value on done: 31682.0 [2023-02-24 17:55:33,482][177172] Sum rewards: 9.663, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.046', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.102', 'AMMO4': '0.229', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'weapon4': '0.582', 'HITCOUNT': '0.750', 'HEALTH': '1.017', 'weapon3': '1.498', 'weapon2': '1.642', 'DAMAGECOUNT': '3.066', 'FRAGCOUNT': '8.000'} [2023-02-24 17:55:33,557][177154] DAMAGECOUNT value on done: 32576.0 [2023-02-24 17:55:33,557][177154] Sum rewards: -1.782, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.898', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'weapon5': '0.046', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.270', 'HITCOUNT': '0.420', 'ARMOR': '0.476', 'WEAPON3': '0.900', 'weapon3': '1.492', 'DAMAGECOUNT': '1.542', 'weapon2': '1.644', 'FRAGCOUNT': '4.000'} [2023-02-24 17:55:33,637][177153] Updated weights for policy 0, policy_version 6690 (0.0008) [2023-02-24 17:55:33,786][177172] DAMAGECOUNT value on done: 29684.0 [2023-02-24 17:55:33,787][177172] Sum rewards: -0.092, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.570', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.017', 'weapon5': '0.046', 'AMMO3': '0.076', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.198', 'WEAPON7': '0.200', 'weapon7': '0.230', 'HITCOUNT': '0.240', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.762', 'weapon3': '1.076', 'weapon2': '1.586', 'FRAGCOUNT': '2.000'} [2023-02-24 17:55:33,857][177154] DAMAGECOUNT value on done: 31284.0 [2023-02-24 17:55:33,857][177154] Sum rewards: 4.347, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'HEALTH': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'AMMO3': '0.063', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.128', 'weapon5': '0.148', 'WEAPON5': '0.150', 'weapon7': '0.166', 'HITCOUNT': '0.190', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.364', 'WEAPON3': '0.400', 'ARMOR': '0.496', 'weapon2': '1.106', 'DAMAGECOUNT': '1.107', 'weapon3': '1.288', 'FRAGCOUNT': '4.000'} [2023-02-24 17:55:33,953][177171] DAMAGECOUNT value on done: 29888.0 [2023-02-24 17:55:33,954][177171] Sum rewards: 2.563, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.830', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.056', 'weapon7': '0.066', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.108', 'weapon5': '0.234', 'WEAPON5': '0.250', 'HITCOUNT': '0.280', 'ARMOR': '0.475', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.990', 'weapon2': '1.512', 'weapon3': '1.776', 'FRAGCOUNT': '4.000'} [2023-02-24 17:55:34,131][177157] DAMAGECOUNT value on done: 32935.0 [2023-02-24 17:55:34,131][177157] Sum rewards: 5.705, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.195', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO3': '0.010', 'AMMO4': '0.031', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON3': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.110', 'weapon5': '0.126', 'WEAPON5': '0.200', 'weapon4': '0.222', 'weapon3': '0.290', 'DAMAGECOUNT': '0.408', 'weapon2': '2.446', 'FRAGCOUNT': '3.000'} [2023-02-24 17:55:34,247][177171] DAMAGECOUNT value on done: 30093.0 [2023-02-24 17:55:34,247][177171] Sum rewards: 2.231, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.660', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.086', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.128', 'weapon5': '0.168', 'HITCOUNT': '0.190', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'weapon3': '1.468', 'DAMAGECOUNT': '1.476', 'weapon2': '2.012', 'FRAGCOUNT': '3.000'} [2023-02-24 17:55:34,304][177171] DAMAGECOUNT value on done: 30701.0 [2023-02-24 17:55:34,305][177171] Sum rewards: 3.444, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.194', 'AMMO5': '0.008', 'AMMO2': '0.011', 'WEAPON1': '0.040', 'AMMO4': '0.053', 'AMMO3': '0.059', 'WEAPON5': '0.200', 'HITCOUNT': '0.300', 'WEAPON3': '0.350', 'weapon5': '0.350', 'weapon3': '0.860', 'weapon2': '1.428', 'DAMAGECOUNT': '1.479', 'FRAGCOUNT': '3.000'} [2023-02-24 17:55:34,402][177157] DAMAGECOUNT value on done: 32356.0 [2023-02-24 17:55:34,403][177157] Sum rewards: 6.480, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.785', 'AMMO4': '-0.033', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'WEAPON5': '0.200', 'weapon5': '0.226', 'HITCOUNT': '0.230', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.795', 'weapon3': '1.250', 'weapon2': '2.058', 'FRAGCOUNT': '5.000'} [2023-02-24 17:55:34,438][177157] DAMAGECOUNT value on done: 32232.0 [2023-02-24 17:55:34,439][177157] Sum rewards: 6.485, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.130', 'AMMO2': '0.003', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO4': '0.015', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'AMMO3': '0.065', 'WEAPON5': '0.100', 'weapon2': '0.184', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'HITCOUNT': '0.350', 'weapon4': '0.376', 'WEAPON7': '0.400', 'weapon7': '0.424', 'WEAPON3': '0.500', 'weapon3': '1.334', 'DAMAGECOUNT': '1.608', 'FRAGCOUNT': '6.000'} [2023-02-24 17:55:34,603][177171] DAMAGECOUNT value on done: 31249.0 [2023-02-24 17:55:34,604][177171] Sum rewards: 4.510, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.302', 'AMMO2': '0.008', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'AMMO4': '0.041', 'AMMO3': '0.078', 'WEAPON4': '0.150', 'weapon4': '0.270', 'weapon5': '0.318', 'WEAPON5': '0.450', 'HITCOUNT': '0.460', 'WEAPON3': '0.600', 'weapon2': '1.404', 'weapon3': '1.624', 'DAMAGECOUNT': '2.601', 'FRAGCOUNT': '4.500'} [2023-02-24 17:55:34,705][177157] DAMAGECOUNT value on done: 30294.0 [2023-02-24 17:55:34,706][177157] Sum rewards: 1.145, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.363', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO3': '0.083', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.266', 'HITCOUNT': '0.420', 'WEAPON3': '0.600', 'weapon2': '1.380', 'DAMAGECOUNT': '1.491', 'weapon3': '1.844', 'FRAGCOUNT': '2.000'} [2023-02-24 17:55:34,905][177155] DAMAGECOUNT value on done: 31909.0 [2023-02-24 17:55:34,905][177155] Sum rewards: 6.632, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.844', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'AMMO2': '0.035', 'AMMO3': '0.134', 'weapon7': '0.134', 'AMMO4': '0.173', 'weapon5': '0.188', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.700', 'HITCOUNT': '0.820', 'weapon2': '1.278', 'weapon3': '1.780', 'DAMAGECOUNT': '3.270', 'FRAGCOUNT': '8.000'} [2023-02-24 17:55:35,207][177155] DAMAGECOUNT value on done: 33970.0 [2023-02-24 17:55:35,207][177155] Sum rewards: -0.374, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.380', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'weapon5': '0.072', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'HITCOUNT': '0.290', 'weapon4': '0.308', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.855', 'FRAGCOUNT': '1.000', 'weapon3': '1.198', 'weapon2': '1.974'} [2023-02-24 17:55:35,346][177155] DAMAGECOUNT value on done: 33209.0 [2023-02-24 17:55:35,347][177155] Sum rewards: 5.023, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.645', 'AMMO2': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.037', 'WEAPON4': '0.100', 'weapon4': '0.126', 'AMMO3': '0.144', 'weapon5': '0.160', 'WEAPON5': '0.250', 'HITCOUNT': '0.570', 'WEAPON3': '0.900', 'weapon2': '1.334', 'weapon3': '1.772', 'DAMAGECOUNT': '2.478', 'FRAGCOUNT': '7.000'} [2023-02-24 17:55:35,639][177155] DAMAGECOUNT value on done: 32095.0 [2023-02-24 17:55:35,639][177155] Sum rewards: 4.981, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.650', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.024', 'ARMOR': '0.032', 'AMMO3': '0.121', 'weapon5': '0.146', 'WEAPON5': '0.250', 'HITCOUNT': '0.390', 'WEAPON3': '0.750', 'weapon2': '1.846', 'weapon3': '1.848', 'DAMAGECOUNT': '3.207', 'FRAGCOUNT': '6.000'} [2023-02-24 17:55:36,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 27439104. Throughput: 0: 3473.7. Samples: 6853718. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:55:36,376][177119] Avg episode reward: [(0, '2.340')] [2023-02-24 17:55:36,379][177140] Saving new best policy, reward=2.340! [2023-02-24 17:55:36,609][177153] Updated weights for policy 0, policy_version 6700 (0.0008) [2023-02-24 17:55:38,793][177156] DAMAGECOUNT value on done: 31546.0 [2023-02-24 17:55:38,793][177156] Sum rewards: 3.102, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.808', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.015', 'ARMOR': '0.032', 'WEAPON1': '0.050', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.116', 'weapon4': '0.174', 'WEAPON5': '0.350', 'HITCOUNT': '0.370', 'WEAPON3': '0.550', 'weapon2': '1.594', 'DAMAGECOUNT': '1.620', 'weapon3': '1.888', 'FRAGCOUNT': '3.000'} [2023-02-24 17:55:39,095][177156] DAMAGECOUNT value on done: 32405.0 [2023-02-24 17:55:39,095][177156] Sum rewards: 0.065, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.070', 'weapon5': '0.074', 'WEAPON5': '0.100', 'HEALTH': '0.127', 'HITCOUNT': '0.380', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'FRAGCOUNT': '0.500', 'weapon3': '1.258', 'DAMAGECOUNT': '1.302', 'weapon2': '2.128'} [2023-02-24 17:55:39,214][177156] DAMAGECOUNT value on done: 32948.0 [2023-02-24 17:55:39,214][177156] Sum rewards: 5.648, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.858', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.060', 'weapon5': '0.078', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.376', 'ARMOR': '0.512', 'HITCOUNT': '0.570', 'WEAPON3': '0.600', 'weapon3': '1.510', 'weapon2': '1.588', 'DAMAGECOUNT': '2.085', 'FRAGCOUNT': '4.000'} [2023-02-24 17:55:39,513][177156] DAMAGECOUNT value on done: 34094.0 [2023-02-24 17:55:39,514][177156] Sum rewards: 5.044, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.006', 'AMMO2': '0.012', 'AMMO5': '0.014', 'ARMOR': '0.040', 'weapon7': '0.052', 'WEAPON1': '0.060', 'AMMO4': '0.062', 'AMMO3': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.218', 'weapon4': '0.278', 'WEAPON5': '0.350', 'HITCOUNT': '0.480', 'WEAPON3': '0.750', 'weapon2': '1.434', 'weapon3': '1.660', 'DAMAGECOUNT': '2.430', 'FRAGCOUNT': '6.500'} [2023-02-24 17:55:39,529][177153] Updated weights for policy 0, policy_version 6710 (0.0008) [2023-02-24 17:55:41,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 27508736. Throughput: 0: 3478.0. Samples: 6874716. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:55:41,376][177119] Avg episode reward: [(0, '2.453')] [2023-02-24 17:55:41,377][177140] Saving new best policy, reward=2.453! [2023-02-24 17:55:42,461][177153] Updated weights for policy 0, policy_version 6720 (0.0009) [2023-02-24 17:55:45,387][177153] Updated weights for policy 0, policy_version 6730 (0.0008) [2023-02-24 17:55:46,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 27578368. Throughput: 0: 3478.0. Samples: 6895624. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:55:46,376][177119] Avg episode reward: [(0, '2.453')] [2023-02-24 17:55:48,336][177153] Updated weights for policy 0, policy_version 6740 (0.0008) [2023-02-24 17:55:50,097][177170] DAMAGECOUNT value on done: 32960.0 [2023-02-24 17:55:50,098][177170] Sum rewards: 5.870, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.062', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO5': '0.015', 'weapon4': '0.028', 'AMMO3': '0.078', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.360', 'WEAPON5': '0.550', 'WEAPON3': '0.550', 'HITCOUNT': '0.550', 'weapon3': '1.222', 'weapon2': '1.948', 'DAMAGECOUNT': '2.439', 'FRAGCOUNT': '5.000'} [2023-02-24 17:55:50,206][177170] DAMAGECOUNT value on done: 29286.0 [2023-02-24 17:55:50,206][177170] Sum rewards: -0.876, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.204', 'AMMO5': '0.010', 'ARMOR': '0.028', 'WEAPON1': '0.030', 'AMMO2': '0.037', 'AMMO3': '0.110', 'WEAPON5': '0.150', 'AMMO4': '0.185', 'weapon5': '0.190', 'WEAPON4': '0.300', 'HITCOUNT': '0.300', 'weapon4': '0.390', 'WEAPON3': '0.500', 'weapon3': '1.104', 'DAMAGECOUNT': '1.200', 'FRAGCOUNT': '2.000', 'weapon2': '2.044'} [2023-02-24 17:55:50,408][177170] DAMAGECOUNT value on done: 35684.0 [2023-02-24 17:55:50,409][177170] Sum rewards: 3.571, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.443', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO3': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.094', 'weapon7': '0.098', 'WEAPON4': '0.100', 'HITCOUNT': '0.180', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.250', 'weapon4': '0.252', 'WEAPON7': '0.400', 'weapon3': '0.606', 'DAMAGECOUNT': '1.170', 'weapon2': '1.294', 'FRAGCOUNT': '2.000'} [2023-02-24 17:55:50,513][177170] DAMAGECOUNT value on done: 34092.0 [2023-02-24 17:55:50,514][177170] Sum rewards: -0.096, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.786', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'AMMO4': '0.079', 'weapon5': '0.108', 'WEAPON5': '0.200', 'weapon4': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.300', 'HITCOUNT': '0.310', 'weapon3': '0.938', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.065', 'weapon2': '2.146'} [2023-02-24 17:55:50,816][177158] DAMAGECOUNT value on done: 32228.0 [2023-02-24 17:55:50,817][177158] Sum rewards: 5.635, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.098', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.075', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'weapon5': '0.162', 'WEAPON5': '0.200', 'weapon4': '0.308', 'ARMOR': '0.428', 'WEAPON3': '0.550', 'HITCOUNT': '0.640', 'weapon2': '1.008', 'weapon3': '1.576', 'DAMAGECOUNT': '2.289', 'FRAGCOUNT': '5.000'} [2023-02-24 17:55:51,104][177158] DAMAGECOUNT value on done: 31039.0 [2023-02-24 17:55:51,105][177158] Sum rewards: 3.455, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.385', 'AMMO5': '0.017', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'weapon4': '0.054', 'AMMO3': '0.079', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'weapon5': '0.292', 'WEAPON5': '0.400', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.540', 'weapon3': '1.470', 'weapon2': '1.668', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.106'} [2023-02-24 17:55:51,291][177153] Updated weights for policy 0, policy_version 6750 (0.0009) [2023-02-24 17:55:51,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 27648000. Throughput: 0: 3476.9. Samples: 6906008. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:55:51,376][177119] Avg episode reward: [(0, '2.450')] [2023-02-24 17:55:51,548][177172] DAMAGECOUNT value on done: 30605.0 [2023-02-24 17:55:51,548][177172] Sum rewards: 0.824, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.432', 'AMMO2': '0.008', 'AMMO5': '0.012', 'ARMOR': '0.012', 'AMMO4': '0.039', 'WEAPON1': '0.040', 'AMMO3': '0.072', 'weapon5': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.320', 'weapon4': '0.436', 'WEAPON3': '0.550', 'weapon3': '1.274', 'weapon2': '1.742', 'DAMAGECOUNT': '1.905', 'FRAGCOUNT': '2.000'} [2023-02-24 17:55:51,843][177172] DAMAGECOUNT value on done: 30402.0 [2023-02-24 17:55:51,844][177172] Sum rewards: 0.901, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.840', 'AMMO4': '-0.077', 'AMMO2': '-0.015', 'AMMO5': '0.009', 'WEAPON1': '0.050', 'AMMO3': '0.075', 'weapon5': '0.106', 'WEAPON5': '0.250', 'HITCOUNT': '0.370', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.236', 'weapon3': '1.448', 'weapon2': '1.738', 'FRAGCOUNT': '2.000'} [2023-02-24 17:55:52,006][177158] DAMAGECOUNT value on done: 30376.0 [2023-02-24 17:55:52,007][177158] Sum rewards: 7.968, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.623', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'WEAPON1': '0.050', 'AMMO3': '0.080', 'weapon5': '0.204', 'WEAPON5': '0.250', 'HITCOUNT': '0.380', 'WEAPON3': '0.550', 'weapon3': '1.612', 'DAMAGECOUNT': '1.791', 'weapon2': '1.926', 'FRAGCOUNT': '7.000'} [2023-02-24 17:55:52,299][177154] DAMAGECOUNT value on done: 33340.0 [2023-02-24 17:55:52,300][177154] Sum rewards: -0.982, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.444', 'AMMO5': '0.017', 'AMMO2': '0.020', 'ARMOR': '0.052', 'WEAPON1': '0.070', 'AMMO3': '0.089', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'weapon4': '0.146', 'weapon5': '0.228', 'HITCOUNT': '0.250', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.203', 'weapon3': '1.426', 'weapon2': '1.962', 'FRAGCOUNT': '3.000'} [2023-02-24 17:55:52,307][177158] DAMAGECOUNT value on done: 33926.0 [2023-02-24 17:55:52,308][177158] Sum rewards: 8.593, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'HEALTH': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.077', 'WEAPON5': '0.150', 'weapon5': '0.182', 'weapon4': '0.240', 'WEAPON3': '0.450', 'HITCOUNT': '0.570', 'weapon3': '1.320', 'weapon2': '1.752', 'DAMAGECOUNT': '2.637', 'FRAGCOUNT': '7.000'} [2023-02-24 17:55:52,588][177154] DAMAGECOUNT value on done: 32052.0 [2023-02-24 17:55:52,588][177154] Sum rewards: -0.563, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.115', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.050', 'weapon5': '0.082', 'AMMO3': '0.091', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.282', 'HITCOUNT': '0.300', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.840', 'weapon2': '1.280', 'weapon3': '1.544', 'FRAGCOUNT': '2.000'} [2023-02-24 17:55:52,811][177172] DAMAGECOUNT value on done: 32066.0 [2023-02-24 17:55:52,812][177172] Sum rewards: -0.872, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'weapon5': '0.060', 'AMMO4': '0.061', 'AMMO3': '0.085', 'WEAPON5': '0.250', 'HITCOUNT': '0.350', 'WEAPON3': '0.450', 'FRAGCOUNT': '0.500', 'HEALTH': '0.717', 'DAMAGECOUNT': '1.152', 'weapon2': '1.828', 'weapon3': '1.856'} [2023-02-24 17:55:52,865][177154] DAMAGECOUNT value on done: 32936.0 [2023-02-24 17:55:52,866][177154] Sum rewards: -3.440, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.481', 'AMMO5': '0.006', 'ARMOR': '0.016', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.108', 'weapon5': '0.116', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.280', 'weapon4': '0.300', 'WEAPON3': '0.650', 'weapon3': '0.916', 'DAMAGECOUNT': '1.080', 'weapon2': '1.496', 'FRAGCOUNT': '3.000'} [2023-02-24 17:55:53,112][177172] DAMAGECOUNT value on done: 30152.0 [2023-02-24 17:55:53,112][177172] Sum rewards: -1.792, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.040', 'AMMO3': '0.095', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'HEALTH': '0.113', 'WEAPON4': '0.150', 'weapon5': '0.156', 'AMMO4': '0.201', 'weapon4': '0.214', 'HITCOUNT': '0.340', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.404', 'weapon3': '1.518', 'weapon2': '1.762'} [2023-02-24 17:55:53,156][177154] DAMAGECOUNT value on done: 31449.0 [2023-02-24 17:55:53,157][177154] Sum rewards: 2.094, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.409', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'AMMO3': '0.040', 'WEAPON1': '0.040', 'HITCOUNT': '0.160', 'weapon5': '0.170', 'WEAPON5': '0.200', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.495', 'weapon3': '0.852', 'FRAGCOUNT': '1.000', 'weapon2': '2.270'} [2023-02-24 17:55:53,332][177171] DAMAGECOUNT value on done: 30603.0 [2023-02-24 17:55:53,333][177171] Sum rewards: 1.462, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.475', 'AMMO2': '0.007', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'weapon4': '0.100', 'AMMO3': '0.126', 'weapon5': '0.192', 'WEAPON5': '0.250', 'HITCOUNT': '0.550', 'WEAPON3': '0.850', 'weapon2': '1.660', 'weapon3': '1.936', 'DAMAGECOUNT': '2.145', 'FRAGCOUNT': '4.000'} [2023-02-24 17:55:53,438][177157] DAMAGECOUNT value on done: 33297.0 [2023-02-24 17:55:53,438][177157] Sum rewards: 0.732, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.538', 'AMMO5': '0.004', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO3': '0.032', 'ARMOR': '0.032', 'weapon5': '0.052', 'AMMO4': '0.065', 'weapon7': '0.094', 'WEAPON5': '0.100', 'WEAPON3': '0.200', 'HITCOUNT': '0.220', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'WEAPON7': '0.400', 'weapon4': '0.688', 'weapon3': '0.822', 'DAMAGECOUNT': '0.954', 'FRAGCOUNT': '1.000', 'weapon2': '1.044'} [2023-02-24 17:55:53,639][177171] DAMAGECOUNT value on done: 30692.0 [2023-02-24 17:55:53,640][177171] Sum rewards: 2.969, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.545', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO2': '0.044', 'weapon7': '0.052', 'AMMO3': '0.056', 'weapon5': '0.202', 'AMMO4': '0.218', 'WEAPON5': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON3': '0.350', 'WEAPON7': '0.400', 'HITCOUNT': '0.400', 'WEAPON4': '0.450', 'weapon3': '0.716', 'ARMOR': '0.812', 'weapon4': '1.010', 'weapon2': '1.514', 'DAMAGECOUNT': '1.797', 'FRAGCOUNT': '2.000'} [2023-02-24 17:55:53,696][177157] DAMAGECOUNT value on done: 33173.0 [2023-02-24 17:55:53,696][177157] Sum rewards: 1.040, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.489', 'AMMO5': '0.015', 'AMMO2': '0.029', 'ARMOR': '0.036', 'WEAPON1': '0.080', 'AMMO3': '0.102', 'AMMO4': '0.144', 'WEAPON4': '0.150', 'weapon5': '0.236', 'WEAPON5': '0.300', 'weapon4': '0.350', 'HITCOUNT': '0.570', 'WEAPON3': '0.650', 'weapon2': '0.974', 'weapon3': '1.704', 'DAMAGECOUNT': '2.439', 'FRAGCOUNT': '3.000'} [2023-02-24 17:55:53,705][177171] DAMAGECOUNT value on done: 31001.0 [2023-02-24 17:55:53,706][177171] Sum rewards: 1.868, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.580', 'AMMO4': '-0.061', 'AMMO2': '-0.012', 'AMMO5': '0.010', 'WEAPON1': '0.060', 'AMMO3': '0.063', 'weapon5': '0.262', 'WEAPON5': '0.300', 'HITCOUNT': '0.310', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.900', 'weapon3': '1.058', 'weapon2': '2.308', 'FRAGCOUNT': '3.000'} [2023-02-24 17:55:53,751][177157] DAMAGECOUNT value on done: 32527.0 [2023-02-24 17:55:53,752][177157] Sum rewards: -2.914, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.692', 'AMMO2': '0.003', 'AMMO4': '0.017', 'AMMO5': '0.022', 'WEAPON4': '0.050', 'WEAPON1': '0.080', 'AMMO3': '0.169', 'weapon4': '0.202', 'weapon5': '0.244', 'HITCOUNT': '0.310', 'ARMOR': '0.420', 'WEAPON5': '0.550', 'DAMAGECOUNT': '0.885', 'weapon2': '0.992', 'WEAPON3': '1.150', 'FRAGCOUNT': '2.000', 'weapon3': '2.184'} [2023-02-24 17:55:54,007][177157] DAMAGECOUNT value on done: 30644.0 [2023-02-24 17:55:54,010][177171] DAMAGECOUNT value on done: 31977.0 [2023-02-24 17:55:54,010][177171] Sum rewards: 5.402, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.020', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'AMMO3': '0.060', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'weapon5': '0.254', 'WEAPON5': '0.300', 'HEALTH': '0.302', 'weapon4': '0.324', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'weapon3': '1.398', 'weapon2': '1.438', 'DAMAGECOUNT': '2.184', 'FRAGCOUNT': '4.000'} [2023-02-24 17:55:54,216][177155] DAMAGECOUNT value on done: 32384.0 [2023-02-24 17:55:54,216][177155] Sum rewards: 3.705, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.259', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.030', 'AMMO4': '0.056', 'AMMO3': '0.083', 'weapon5': '0.170', 'WEAPON5': '0.200', 'HITCOUNT': '0.220', 'WEAPON3': '0.500', 'weapon3': '1.326', 'DAMAGECOUNT': '1.425', 'weapon2': '2.182', 'FRAGCOUNT': '3.000'} [2023-02-24 17:55:54,251][177153] Updated weights for policy 0, policy_version 6760 (0.0008) [2023-02-24 17:55:54,521][177155] DAMAGECOUNT value on done: 34797.0 [2023-02-24 17:55:54,521][177155] Sum rewards: 5.152, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.547', 'AMMO2': '0.008', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO4': '0.038', 'WEAPON1': '0.040', 'AMMO3': '0.103', 'weapon5': '0.132', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.618', 'HITCOUNT': '0.730', 'WEAPON3': '0.750', 'weapon2': '0.758', 'weapon3': '1.866', 'DAMAGECOUNT': '2.481', 'FRAGCOUNT': '6.000'} [2023-02-24 17:55:54,670][177155] DAMAGECOUNT value on done: 33629.0 [2023-02-24 17:55:54,671][177155] Sum rewards: -0.320, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.144', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.079', 'AMMO4': '0.140', 'weapon5': '0.156', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.324', 'HITCOUNT': '0.400', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.260', 'weapon2': '1.486', 'weapon3': '1.536'} [2023-02-24 17:55:54,963][177155] DAMAGECOUNT value on done: 32636.0 [2023-02-24 17:55:54,964][177155] Sum rewards: 3.057, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.329', 'ARMOR': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.032', 'weapon7': '0.048', 'WEAPON1': '0.090', 'AMMO3': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.142', 'AMMO4': '0.160', 'HITCOUNT': '0.260', 'weapon4': '0.304', 'weapon2': '0.454', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'weapon3': '1.280', 'DAMAGECOUNT': '1.623', 'FRAGCOUNT': '5.000'} [2023-02-24 17:55:56,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 27717632. Throughput: 0: 3475.5. Samples: 6926826. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:55:56,376][177119] Avg episode reward: [(0, '2.387')] [2023-02-24 17:55:57,163][177153] Updated weights for policy 0, policy_version 6770 (0.0008) [2023-02-24 17:55:58,112][177156] DAMAGECOUNT value on done: 32081.0 [2023-02-24 17:55:58,112][177156] Sum rewards: -0.514, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.074', 'AMMO5': '0.012', 'AMMO2': '0.026', 'WEAPON1': '0.060', 'AMMO4': '0.129', 'AMMO3': '0.140', 'weapon5': '0.158', 'HITCOUNT': '0.180', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.564', 'WEAPON3': '0.800', 'weapon3': '1.448', 'weapon2': '1.488', 'DAMAGECOUNT': '1.605', 'FRAGCOUNT': '4.000'} [2023-02-24 17:55:58,417][177156] DAMAGECOUNT value on done: 32754.0 [2023-02-24 17:55:58,418][177156] Sum rewards: -0.585, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.759', 'AMMO5': '0.009', 'AMMO2': '0.014', 'WEAPON1': '0.040', 'weapon4': '0.054', 'AMMO4': '0.069', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'weapon5': '0.140', 'WEAPON5': '0.200', 'HITCOUNT': '0.290', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.047', 'weapon3': '1.294', 'weapon2': '2.080'} [2023-02-24 17:55:58,521][177156] DAMAGECOUNT value on done: 33398.0 [2023-02-24 17:55:58,522][177156] Sum rewards: -1.162, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.538', 'AMMO5': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'weapon4': '0.044', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'weapon5': '0.308', 'HITCOUNT': '0.320', 'WEAPON3': '1.100', 'DAMAGECOUNT': '1.350', 'weapon2': '1.370', 'weapon3': '1.718', 'FRAGCOUNT': '4.000'} [2023-02-24 17:55:58,826][177156] DAMAGECOUNT value on done: 34545.0 [2023-02-24 17:55:58,826][177156] Sum rewards: -0.422, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.318', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'weapon4': '0.002', 'AMMO5': '0.011', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.091', 'weapon5': '0.206', 'WEAPON5': '0.300', 'HITCOUNT': '0.350', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.353', 'weapon2': '1.448', 'weapon3': '1.848', 'FRAGCOUNT': '2.000'} [2023-02-24 17:56:00,139][177153] Updated weights for policy 0, policy_version 6780 (0.0008) [2023-02-24 17:56:01,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 27787264. Throughput: 0: 3477.6. Samples: 6947716. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:56:01,376][177119] Avg episode reward: [(0, '2.260')] [2023-02-24 17:56:03,100][177153] Updated weights for policy 0, policy_version 6790 (0.0008) [2023-02-24 17:56:06,053][177153] Updated weights for policy 0, policy_version 6800 (0.0008) [2023-02-24 17:56:06,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 27856896. Throughput: 0: 3476.1. Samples: 6958128. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:56:06,376][177119] Avg episode reward: [(0, '2.260')] [2023-02-24 17:56:08,972][177153] Updated weights for policy 0, policy_version 6810 (0.0008) [2023-02-24 17:56:09,235][177171] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 17:56:09,434][177170] DAMAGECOUNT value on done: 33100.0 [2023-02-24 17:56:09,435][177170] Sum rewards: 5.090, reward structure: {'DEATHCOUNT': '-0.750', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO3': '0.030', 'WEAPON5': '0.050', 'WEAPON3': '0.150', 'HITCOUNT': '0.160', 'HEALTH': '0.168', 'DAMAGECOUNT': '0.420', 'weapon3': '0.684', 'weapon2': '1.176', 'FRAGCOUNT': '3.000'} [2023-02-24 17:56:09,595][177170] DAMAGECOUNT value on done: 29899.0 [2023-02-24 17:56:09,596][177170] Sum rewards: 6.203, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.012', 'ARMOR': '0.016', 'WEAPON1': '0.040', 'AMMO2': '0.047', 'AMMO3': '0.096', 'weapon5': '0.216', 'AMMO4': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.370', 'WEAPON3': '0.450', 'HEALTH': '0.552', 'weapon4': '0.734', 'weapon3': '1.190', 'weapon2': '1.408', 'DAMAGECOUNT': '1.839', 'FRAGCOUNT': '6.000'} [2023-02-24 17:56:09,743][177170] DAMAGECOUNT value on done: 36129.0 [2023-02-24 17:56:09,743][177170] Sum rewards: 0.316, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.940', 'AMMO5': '0.015', 'weapon4': '0.018', 'AMMO2': '0.031', 'WEAPON1': '0.060', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'AMMO4': '0.156', 'HITCOUNT': '0.240', 'weapon5': '0.274', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.335', 'weapon3': '1.524', 'weapon2': '1.922', 'FRAGCOUNT': '3.000'} [2023-02-24 17:56:09,903][177170] DAMAGECOUNT value on done: 34602.0 [2023-02-24 17:56:09,904][177170] Sum rewards: 3.861, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.832', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.068', 'AMMO3': '0.109', 'WEAPON5': '0.200', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'weapon3': '1.474', 'DAMAGECOUNT': '1.530', 'weapon2': '2.230', 'FRAGCOUNT': '4.000'} [2023-02-24 17:56:10,178][177158] DAMAGECOUNT value on done: 32593.0 [2023-02-24 17:56:10,179][177158] Sum rewards: 6.119, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.158', 'AMMO2': '0.005', 'AMMO4': '0.027', 'AMMO3': '0.040', 'ARMOR': '0.046', 'weapon4': '0.046', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.270', 'WEAPON3': '0.300', 'weapon3': '1.006', 'DAMAGECOUNT': '1.095', 'weapon2': '1.238', 'FRAGCOUNT': '4.000'} [2023-02-24 17:56:10,475][177158] DAMAGECOUNT value on done: 31385.0 [2023-02-24 17:56:10,476][177158] Sum rewards: 4.223, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.044', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon7': '0.114', 'weapon5': '0.194', 'HITCOUNT': '0.330', 'weapon4': '0.448', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.038', 'weapon2': '1.196', 'weapon3': '1.418', 'FRAGCOUNT': '5.000'} [2023-02-24 17:56:10,820][177172] DAMAGECOUNT value on done: 31402.0 [2023-02-24 17:56:10,821][177172] Sum rewards: 2.770, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.735', 'AMMO5': '0.007', 'ARMOR': '0.040', 'WEAPON1': '0.040', 'AMMO2': '0.043', 'weapon7': '0.074', 'AMMO3': '0.103', 'weapon5': '0.132', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'AMMO4': '0.216', 'weapon4': '0.370', 'HITCOUNT': '0.440', 'WEAPON4': '0.450', 'WEAPON3': '0.600', 'weapon3': '1.470', 'weapon2': '1.658', 'DAMAGECOUNT': '2.391', 'FRAGCOUNT': '6.000'} [2023-02-24 17:56:11,115][177172] DAMAGECOUNT value on done: 30919.0 [2023-02-24 17:56:11,115][177172] Sum rewards: 1.048, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.047', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.025', 'AMMO4': '0.035', 'weapon7': '0.052', 'WEAPON4': '0.100', 'weapon5': '0.108', 'AMMO3': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.190', 'WEAPON7': '0.200', 'HITCOUNT': '0.380', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'weapon3': '1.498', 'DAMAGECOUNT': '1.551', 'weapon2': '1.980', 'FRAGCOUNT': '3.000'} [2023-02-24 17:56:11,351][177158] DAMAGECOUNT value on done: 31194.0 [2023-02-24 17:56:11,351][177158] Sum rewards: 3.263, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.848', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.030', 'AMMO4': '0.040', 'weapon4': '0.060', 'weapon5': '0.096', 'AMMO3': '0.111', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.540', 'WEAPON3': '0.700', 'weapon3': '1.720', 'weapon2': '1.792', 'DAMAGECOUNT': '2.454', 'FRAGCOUNT': '6.000'} [2023-02-24 17:56:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 27926528. Throughput: 0: 3476.4. Samples: 6978974. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:56:11,376][177119] Avg episode reward: [(0, '2.399')] [2023-02-24 17:56:11,563][177154] DAMAGECOUNT value on done: 33624.0 [2023-02-24 17:56:11,563][177154] Sum rewards: 3.044, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.760', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.063', 'AMMO3': '0.069', 'weapon5': '0.178', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.260', 'weapon7': '0.260', 'WEAPON3': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.444', 'ARMOR': '0.500', 'weapon3': '0.636', 'DAMAGECOUNT': '0.852', 'FRAGCOUNT': '2.000', 'weapon2': '2.296'} [2023-02-24 17:56:11,647][177158] DAMAGECOUNT value on done: 34374.0 [2023-02-24 17:56:11,648][177158] Sum rewards: 0.017, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.335', 'AMMO5': '0.010', 'weapon7': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.064', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon5': '0.260', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'HITCOUNT': '0.410', 'ARMOR': '0.517', 'weapon4': '0.536', 'WEAPON3': '0.650', 'weapon3': '0.828', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.344', 'weapon2': '1.840'} [2023-02-24 17:56:11,862][177154] DAMAGECOUNT value on done: 32494.0 [2023-02-24 17:56:11,862][177154] Sum rewards: 1.484, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.252', 'AMMO5': '0.005', 'ARMOR': '0.016', 'WEAPON1': '0.040', 'AMMO2': '0.052', 'AMMO3': '0.091', 'weapon5': '0.134', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO4': '0.258', 'HITCOUNT': '0.460', 'weapon4': '0.482', 'WEAPON3': '0.550', 'weapon3': '1.228', 'DAMAGECOUNT': '1.326', 'weapon2': '1.444', 'FRAGCOUNT': '2.000'} [2023-02-24 17:56:11,896][177153] Updated weights for policy 0, policy_version 6820 (0.0008) [2023-02-24 17:56:12,076][177172] DAMAGECOUNT value on done: 32357.0 [2023-02-24 17:56:12,077][177172] Sum rewards: -2.393, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.255', 'AMMO2': '0.010', 'AMMO5': '0.017', 'ARMOR': '0.020', 'weapon4': '0.044', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO3': '0.086', 'HITCOUNT': '0.150', 'weapon5': '0.290', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.873', 'FRAGCOUNT': '1.000', 'weapon3': '1.544', 'weapon2': '1.860'} [2023-02-24 17:56:12,140][177154] DAMAGECOUNT value on done: 33760.0 [2023-02-24 17:56:12,141][177154] Sum rewards: 3.256, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.916', 'AMMO5': '0.018', 'AMMO2': '0.025', 'WEAPON1': '0.070', 'AMMO4': '0.122', 'weapon4': '0.136', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'weapon5': '0.308', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.450', 'WEAPON3': '0.950', 'weapon2': '1.388', 'weapon3': '1.894', 'DAMAGECOUNT': '2.472', 'FRAGCOUNT': '4.500'} [2023-02-24 17:56:12,380][177172] DAMAGECOUNT value on done: 30723.0 [2023-02-24 17:56:12,380][177172] Sum rewards: 4.629, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'weapon4': '0.016', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO4': '0.133', 'WEAPON3': '0.300', 'HEALTH': '0.388', 'HITCOUNT': '0.430', 'weapon3': '1.158', 'DAMAGECOUNT': '1.713', 'weapon2': '2.368', 'FRAGCOUNT': '3.000'} [2023-02-24 17:56:12,430][177154] DAMAGECOUNT value on done: 32048.0 [2023-02-24 17:56:12,431][177154] Sum rewards: -1.014, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.442', 'AMMO5': '0.014', 'AMMO2': '0.027', 'ARMOR': '0.036', 'WEAPON1': '0.040', 'AMMO3': '0.088', 'weapon5': '0.110', 'AMMO4': '0.134', 'WEAPON4': '0.200', 'weapon4': '0.276', 'WEAPON5': '0.300', 'HITCOUNT': '0.510', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.600', 'weapon3': '1.746', 'DAMAGECOUNT': '1.797'} [2023-02-24 17:56:12,689][177171] DAMAGECOUNT value on done: 31298.0 [2023-02-24 17:56:12,690][177171] Sum rewards: 8.067, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.845', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO3': '0.040', 'weapon5': '0.048', 'AMMO4': '0.081', 'weapon7': '0.086', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'WEAPON4': '0.300', 'ARMOR': '0.428', 'HITCOUNT': '0.430', 'weapon4': '0.528', 'weapon3': '0.748', 'DAMAGECOUNT': '2.085', 'weapon2': '2.266', 'FRAGCOUNT': '7.000'} [2023-02-24 17:56:12,803][177157] DAMAGECOUNT value on done: 34125.0 [2023-02-24 17:56:12,803][177157] Sum rewards: 5.651, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.008', 'AMMO5': '0.014', 'WEAPON1': '0.030', 'AMMO4': '0.039', 'AMMO3': '0.040', 'HEALTH': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'weapon5': '0.328', 'weapon4': '0.570', 'HITCOUNT': '0.600', 'weapon3': '1.092', 'weapon2': '1.496', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.484'} [2023-02-24 17:56:12,988][177171] DAMAGECOUNT value on done: 31088.0 [2023-02-24 17:56:12,988][177171] Sum rewards: 4.653, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.607', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'AMMO4': '0.051', 'weapon5': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.200', 'WEAPON3': '0.350', 'ARMOR': '0.432', 'weapon4': '0.492', 'weapon3': '1.094', 'DAMAGECOUNT': '1.188', 'weapon2': '1.456', 'FRAGCOUNT': '4.000'} [2023-02-24 17:56:12,995][177157] DAMAGECOUNT value on done: 33835.0 [2023-02-24 17:56:12,996][177157] Sum rewards: 3.387, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.328', 'AMMO5': '0.017', 'AMMO2': '0.026', 'WEAPON1': '0.040', 'weapon7': '0.066', 'ARMOR': '0.067', 'AMMO3': '0.098', 'weapon5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.131', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'HITCOUNT': '0.430', 'WEAPON4': '0.450', 'weapon4': '0.666', 'WEAPON3': '0.700', 'weapon2': '1.130', 'weapon3': '1.768', 'DAMAGECOUNT': '1.986', 'FRAGCOUNT': '6.000'} [2023-02-24 17:56:13,046][177171] DAMAGECOUNT value on done: 31939.0 [2023-02-24 17:56:13,046][177171] Sum rewards: 11.112, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'AMMO3': '0.030', 'ARMOR': '0.048', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'weapon5': '0.176', 'WEAPON5': '0.200', 'WEAPON3': '0.200', 'weapon7': '0.202', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.400', 'HEALTH': '0.591', 'weapon4': '0.688', 'weapon3': '0.820', 'weapon2': '1.638', 'DAMAGECOUNT': '2.559', 'FRAGCOUNT': '5.500'} [2023-02-24 17:56:13,111][177157] DAMAGECOUNT value on done: 33104.0 [2023-02-24 17:56:13,112][177157] Sum rewards: -0.166, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.768', 'AMMO5': '0.022', 'weapon4': '0.026', 'AMMO2': '0.032', 'WEAPON4': '0.050', 'WEAPON1': '0.090', 'AMMO3': '0.107', 'AMMO4': '0.161', 'weapon5': '0.266', 'HITCOUNT': '0.270', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.500', 'weapon3': '1.586', 'DAMAGECOUNT': '1.731', 'weapon2': '1.810'} [2023-02-24 17:56:13,305][177157] DAMAGECOUNT value on done: 31348.0 [2023-02-24 17:56:13,306][177157] Sum rewards: 2.149, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.362', 'AMMO2': '0.014', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO4': '0.069', 'AMMO3': '0.086', 'WEAPON4': '0.150', 'weapon5': '0.224', 'weapon4': '0.362', 'HITCOUNT': '0.430', 'WEAPON5': '0.450', 'WEAPON3': '0.450', 'weapon3': '0.996', 'weapon2': '2.106', 'DAMAGECOUNT': '2.112', 'FRAGCOUNT': '4.000'} [2023-02-24 17:56:13,360][177171] DAMAGECOUNT value on done: 32528.0 [2023-02-24 17:56:13,360][177171] Sum rewards: 8.378, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO3': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'weapon5': '0.092', 'WEAPON3': '0.250', 'HITCOUNT': '0.410', 'HEALTH': '0.580', 'weapon3': '1.088', 'DAMAGECOUNT': '1.653', 'weapon2': '2.366', 'FRAGCOUNT': '4.000'} [2023-02-24 17:56:13,503][177155] DAMAGECOUNT value on done: 32715.0 [2023-02-24 17:56:13,503][177155] Sum rewards: -0.120, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.067', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'weapon5': '0.056', 'AMMO3': '0.098', 'AMMO4': '0.103', 'WEAPON5': '0.250', 'weapon4': '0.258', 'HITCOUNT': '0.300', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.993', 'FRAGCOUNT': '1.000', 'weapon2': '1.002', 'weapon3': '1.996'} [2023-02-24 17:56:13,805][177155] DAMAGECOUNT value on done: 35312.0 [2023-02-24 17:56:13,806][177155] Sum rewards: -1.174, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.264', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO5': '0.019', 'WEAPON1': '0.050', 'weapon5': '0.072', 'weapon4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.138', 'WEAPON5': '0.400', 'HITCOUNT': '0.430', 'WEAPON3': '0.850', 'weapon2': '1.532', 'DAMAGECOUNT': '1.545', 'weapon3': '1.856', 'FRAGCOUNT': '2.000'} [2023-02-24 17:56:13,998][177155] DAMAGECOUNT value on done: 34645.0 [2023-02-24 17:56:13,998][177155] Sum rewards: 7.159, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.095', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'ARMOR': '0.036', 'AMMO3': '0.054', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.150', 'WEAPON3': '0.350', 'HITCOUNT': '0.620', 'weapon4': '0.652', 'weapon3': '1.014', 'weapon2': '1.372', 'DAMAGECOUNT': '3.048', 'FRAGCOUNT': '4.000'} [2023-02-24 17:56:14,303][177155] DAMAGECOUNT value on done: 33071.0 [2023-02-24 17:56:14,304][177155] Sum rewards: 1.436, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.706', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON1': '0.050', 'ARMOR': '0.060', 'weapon7': '0.068', 'AMMO4': '0.072', 'AMMO3': '0.089', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.258', 'HITCOUNT': '0.400', 'weapon4': '0.472', 'WEAPON3': '0.650', 'weapon2': '1.288', 'DAMAGECOUNT': '1.305', 'weapon3': '1.358', 'FRAGCOUNT': '3.000'} [2023-02-24 17:56:14,699][177171] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 17:56:14,848][177153] Updated weights for policy 0, policy_version 6830 (0.0008) [2023-02-24 17:56:16,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 27996160. Throughput: 0: 3476.4. Samples: 6999822. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:56:16,376][177119] Avg episode reward: [(0, '2.371')] [2023-02-24 17:56:17,575][177156] DAMAGECOUNT value on done: 32418.0 [2023-02-24 17:56:17,576][177156] Sum rewards: -0.187, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.390', 'AMMO5': '0.009', 'AMMO2': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.061', 'weapon5': '0.100', 'AMMO3': '0.107', 'weapon4': '0.140', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.220', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.011', 'weapon2': '1.502', 'weapon3': '1.900', 'FRAGCOUNT': '4.000'} [2023-02-24 17:56:17,767][177153] Updated weights for policy 0, policy_version 6840 (0.0008) [2023-02-24 17:56:17,872][177156] DAMAGECOUNT value on done: 33218.0 [2023-02-24 17:56:17,872][177156] Sum rewards: 1.105, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.428', 'AMMO5': '0.009', 'AMMO2': '0.016', 'ARMOR': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'weapon5': '0.120', 'AMMO3': '0.122', 'weapon4': '0.186', 'WEAPON5': '0.200', 'HITCOUNT': '0.310', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.392', 'weapon3': '1.700', 'weapon2': '1.796', 'FRAGCOUNT': '3.000'} [2023-02-24 17:56:17,932][177156] DAMAGECOUNT value on done: 34254.0 [2023-02-24 17:56:17,932][177156] Sum rewards: 5.433, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.760', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon7': '0.046', 'WEAPON1': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.123', 'AMMO4': '0.167', 'WEAPON7': '0.200', 'weapon5': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.538', 'HITCOUNT': '0.540', 'WEAPON3': '0.850', 'weapon2': '1.040', 'weapon3': '1.872', 'DAMAGECOUNT': '2.568', 'FRAGCOUNT': '7.000'} [2023-02-24 17:56:18,238][177156] DAMAGECOUNT value on done: 35068.0 [2023-02-24 17:56:18,239][177156] Sum rewards: 5.130, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.755', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO3': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.077', 'weapon5': '0.212', 'WEAPON5': '0.300', 'HITCOUNT': '0.340', 'WEAPON3': '0.350', 'weapon3': '1.050', 'DAMAGECOUNT': '1.569', 'weapon2': '2.354', 'FRAGCOUNT': '4.000'} [2023-02-24 17:56:20,692][177153] Updated weights for policy 0, policy_version 6850 (0.0008) [2023-02-24 17:56:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 28065792. Throughput: 0: 3480.2. Samples: 7010328. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:56:21,376][177119] Avg episode reward: [(0, '2.348')] [2023-02-24 17:56:23,639][177153] Updated weights for policy 0, policy_version 6860 (0.0009) [2023-02-24 17:56:26,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 28135424. Throughput: 0: 3478.2. Samples: 7031236. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 17:56:26,376][177119] Avg episode reward: [(0, '2.348')] [2023-02-24 17:56:26,584][177153] Updated weights for policy 0, policy_version 6870 (0.0008) [2023-02-24 17:56:28,729][177170] DAMAGECOUNT value on done: 34168.0 [2023-02-24 17:56:28,729][177170] Sum rewards: 7.863, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.440', 'ARMOR': '0.012', 'AMMO2': '0.012', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'AMMO4': '0.060', 'AMMO3': '0.131', 'weapon5': '0.208', 'WEAPON4': '0.250', 'weapon4': '0.424', 'WEAPON5': '0.450', 'HITCOUNT': '0.660', 'WEAPON3': '0.850', 'weapon2': '1.114', 'weapon3': '1.876', 'DAMAGECOUNT': '3.204', 'FRAGCOUNT': '9.000'} [2023-02-24 17:56:28,870][177170] DAMAGECOUNT value on done: 30451.0 [2023-02-24 17:56:28,870][177170] Sum rewards: -0.833, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.212', 'ARMOR': '0.005', 'AMMO5': '0.010', 'AMMO2': '0.033', 'WEAPON1': '0.060', 'AMMO3': '0.086', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon4': '0.128', 'weapon5': '0.146', 'AMMO4': '0.162', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'HITCOUNT': '0.390', 'WEAPON3': '0.550', 'weapon3': '1.442', 'DAMAGECOUNT': '1.656', 'weapon2': '2.010', 'FRAGCOUNT': '4.000'} [2023-02-24 17:56:29,036][177170] DAMAGECOUNT value on done: 36497.0 [2023-02-24 17:56:29,037][177170] Sum rewards: 3.934, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.260', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon5': '0.086', 'AMMO3': '0.103', 'AMMO4': '0.137', 'WEAPON5': '0.200', 'HITCOUNT': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.518', 'WEAPON3': '0.650', 'ARMOR': '0.840', 'DAMAGECOUNT': '1.104', 'weapon3': '1.460', 'weapon2': '1.490', 'FRAGCOUNT': '4.000'} [2023-02-24 17:56:29,178][177170] DAMAGECOUNT value on done: 35631.0 [2023-02-24 17:56:29,179][177170] Sum rewards: 5.825, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.332', 'AMMO5': '0.022', 'ARMOR': '0.024', 'AMMO2': '0.042', 'WEAPON1': '0.080', 'AMMO3': '0.138', 'AMMO4': '0.209', 'weapon5': '0.302', 'WEAPON4': '0.450', 'weapon4': '0.522', 'WEAPON5': '0.550', 'HITCOUNT': '0.610', 'WEAPON3': '0.800', 'weapon2': '1.312', 'weapon3': '1.508', 'DAMAGECOUNT': '3.087', 'FRAGCOUNT': '8.000'} [2023-02-24 17:56:29,462][177158] DAMAGECOUNT value on done: 32958.0 [2023-02-24 17:56:29,463][177158] Sum rewards: 0.860, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.345', 'AMMO2': '0.008', 'AMMO5': '0.013', 'weapon5': '0.018', 'ARMOR': '0.028', 'AMMO4': '0.041', 'AMMO3': '0.058', 'weapon7': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'HITCOUNT': '0.310', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON3': '0.400', 'WEAPON7': '0.500', 'FRAGCOUNT': '0.500', 'weapon4': '0.876', 'weapon2': '0.994', 'DAMAGECOUNT': '1.095', 'weapon3': '1.200'} [2023-02-24 17:56:29,551][177153] Updated weights for policy 0, policy_version 6880 (0.0008) [2023-02-24 17:56:29,755][177158] DAMAGECOUNT value on done: 31894.0 [2023-02-24 17:56:29,756][177158] Sum rewards: 0.291, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.418', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON1': '0.040', 'weapon4': '0.042', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.104', 'WEAPON5': '0.200', 'weapon5': '0.240', 'HITCOUNT': '0.350', 'WEAPON3': '0.550', 'weapon3': '1.072', 'DAMAGECOUNT': '1.527', 'weapon2': '2.464', 'FRAGCOUNT': '4.000'} [2023-02-24 17:56:30,166][177172] DAMAGECOUNT value on done: 32698.0 [2023-02-24 17:56:30,166][177172] Sum rewards: 10.076, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.425', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.076', 'weapon4': '0.096', 'WEAPON4': '0.100', 'weapon5': '0.272', 'WEAPON5': '0.350', 'ARMOR': '0.466', 'HITCOUNT': '0.520', 'WEAPON3': '0.650', 'weapon2': '1.576', 'weapon3': '1.738', 'DAMAGECOUNT': '3.876', 'FRAGCOUNT': '7.000'} [2023-02-24 17:56:30,464][177172] DAMAGECOUNT value on done: 31840.0 [2023-02-24 17:56:30,464][177172] Sum rewards: 6.995, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.545', 'AMMO5': '0.012', 'AMMO2': '0.027', 'ARMOR': '0.028', 'WEAPON1': '0.030', 'weapon7': '0.082', 'AMMO3': '0.085', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.136', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon5': '0.376', 'WEAPON3': '0.500', 'weapon2': '0.524', 'HITCOUNT': '0.580', 'weapon3': '1.070', 'weapon4': '1.076', 'DAMAGECOUNT': '2.763', 'FRAGCOUNT': '6.000'} [2023-02-24 17:56:30,638][177158] DAMAGECOUNT value on done: 31612.0 [2023-02-24 17:56:30,638][177158] Sum rewards: 2.270, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.746', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO3': '0.044', 'AMMO4': '0.047', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.148', 'weapon5': '0.240', 'HITCOUNT': '0.270', 'WEAPON3': '0.300', 'WEAPON5': '0.300', 'weapon3': '0.992', 'DAMAGECOUNT': '1.254', 'weapon2': '2.002', 'FRAGCOUNT': '2.500'} [2023-02-24 17:56:30,877][177154] DAMAGECOUNT value on done: 34434.0 [2023-02-24 17:56:30,878][177154] Sum rewards: 0.535, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.013', 'AMMO5': '0.017', 'AMMO2': '0.023', 'weapon7': '0.038', 'WEAPON1': '0.050', 'AMMO4': '0.115', 'weapon5': '0.118', 'AMMO3': '0.140', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.276', 'WEAPON5': '0.400', 'HITCOUNT': '0.600', 'WEAPON3': '0.850', 'weapon2': '1.244', 'weapon3': '1.476', 'DAMAGECOUNT': '2.430', 'FRAGCOUNT': '3.000'} [2023-02-24 17:56:30,931][177158] DAMAGECOUNT value on done: 34719.0 [2023-02-24 17:56:30,931][177158] Sum rewards: 3.665, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.029', 'ARMOR': '0.004', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'weapon5': '0.042', 'AMMO3': '0.057', 'AMMO4': '0.065', 'weapon7': '0.094', 'WEAPON5': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'HITCOUNT': '0.310', 'WEAPON3': '0.350', 'WEAPON7': '0.400', 'weapon4': '0.892', 'weapon2': '0.962', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.035', 'weapon3': '1.322'} [2023-02-24 17:56:31,178][177154] DAMAGECOUNT value on done: 33396.0 [2023-02-24 17:56:31,179][177154] Sum rewards: 1.400, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.257', 'AMMO5': '0.022', 'AMMO2': '0.029', 'ARMOR': '0.040', 'WEAPON1': '0.060', 'weapon5': '0.136', 'AMMO4': '0.145', 'weapon4': '0.156', 'AMMO3': '0.166', 'WEAPON4': '0.300', 'HITCOUNT': '0.540', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon2': '1.214', 'weapon3': '2.142', 'DAMAGECOUNT': '2.706', 'FRAGCOUNT': '8.000'} [2023-02-24 17:56:31,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 28205056. Throughput: 0: 3474.8. Samples: 7051990. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:56:31,376][177119] Avg episode reward: [(0, '2.755')] [2023-02-24 17:56:31,377][177140] Saving new best policy, reward=2.755! [2023-02-24 17:56:31,433][177172] DAMAGECOUNT value on done: 33113.0 [2023-02-24 17:56:31,434][177172] Sum rewards: 3.863, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.488', 'AMMO2': '0.013', 'AMMO5': '0.013', 'WEAPON1': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.080', 'WEAPON4': '0.150', 'weapon5': '0.286', 'HITCOUNT': '0.350', 'WEAPON5': '0.350', 'ARMOR': '0.488', 'WEAPON3': '0.550', 'weapon4': '0.560', 'weapon3': '1.070', 'weapon2': '1.808', 'DAMAGECOUNT': '2.268', 'FRAGCOUNT': '4.000'} [2023-02-24 17:56:31,457][177154] DAMAGECOUNT value on done: 34318.0 [2023-02-24 17:56:31,457][177154] Sum rewards: 1.473, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.640', 'AMMO5': '0.012', 'ARMOR': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'weapon7': '0.058', 'AMMO3': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.142', 'AMMO4': '0.144', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'HITCOUNT': '0.410', 'WEAPON3': '0.450', 'weapon4': '0.584', 'weapon3': '0.900', 'weapon2': '1.130', 'DAMAGECOUNT': '1.674', 'FRAGCOUNT': '3.000'} [2023-02-24 17:56:31,742][177172] DAMAGECOUNT value on done: 31265.0 [2023-02-24 17:56:31,742][177172] Sum rewards: 4.259, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.726', 'AMMO2': '0.021', 'AMMO5': '0.021', 'AMMO3': '0.060', 'WEAPON1': '0.070', 'AMMO4': '0.102', 'weapon7': '0.120', 'weapon5': '0.184', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'HITCOUNT': '0.510', 'weapon4': '0.732', 'weapon2': '1.034', 'weapon3': '1.514', 'DAMAGECOUNT': '1.626', 'FRAGCOUNT': '7.000'} [2023-02-24 17:56:31,751][177154] DAMAGECOUNT value on done: 32754.0 [2023-02-24 17:56:31,752][177154] Sum rewards: 5.058, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.454', 'AMMO5': '0.015', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'ARMOR': '0.040', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'weapon5': '0.210', 'weapon4': '0.302', 'WEAPON5': '0.350', 'HITCOUNT': '0.400', 'WEAPON3': '0.500', 'weapon3': '1.074', 'weapon2': '1.900', 'DAMAGECOUNT': '2.118', 'FRAGCOUNT': '6.500'} [2023-02-24 17:56:31,900][177171] DAMAGECOUNT value on done: 31950.0 [2023-02-24 17:56:31,901][177171] Sum rewards: 2.901, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.032', 'AMMO5': '0.016', 'AMMO2': '0.018', 'ARMOR': '0.024', 'WEAPON1': '0.070', 'weapon5': '0.084', 'AMMO4': '0.089', 'AMMO3': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon7': '0.108', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'weapon4': '0.520', 'HITCOUNT': '0.560', 'weapon2': '1.356', 'weapon3': '1.386', 'DAMAGECOUNT': '1.956', 'FRAGCOUNT': '4.000'} [2023-02-24 17:56:32,102][177157] DAMAGECOUNT value on done: 34622.0 [2023-02-24 17:56:32,102][177157] Sum rewards: -0.138, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.038', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'weapon5': '0.106', 'AMMO3': '0.129', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'HITCOUNT': '0.480', 'weapon4': '0.780', 'ARMOR': '0.854', 'WEAPON3': '0.900', 'weapon2': '1.120', 'DAMAGECOUNT': '1.491', 'weapon3': '1.580', 'FRAGCOUNT': '2.000'} [2023-02-24 17:56:32,205][177171] DAMAGECOUNT value on done: 31789.0 [2023-02-24 17:56:32,206][177171] Sum rewards: 3.639, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.210', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.055', 'weapon5': '0.066', 'AMMO4': '0.118', 'weapon7': '0.148', 'HITCOUNT': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.350', 'WEAPON7': '0.400', 'weapon4': '0.726', 'weapon3': '0.750', 'weapon2': '0.832', 'DAMAGECOUNT': '1.803', 'FRAGCOUNT': '3.000'} [2023-02-24 17:56:32,316][177157] DAMAGECOUNT value on done: 34372.0 [2023-02-24 17:56:32,316][177157] Sum rewards: 4.155, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO3': '0.058', 'AMMO4': '0.062', 'weapon4': '0.102', 'weapon5': '0.120', 'WEAPON5': '0.150', 'HITCOUNT': '0.270', 'WEAPON3': '0.350', 'HEALTH': '0.486', 'weapon3': '0.992', 'DAMAGECOUNT': '1.611', 'weapon2': '2.124', 'FRAGCOUNT': '3.000'} [2023-02-24 17:56:32,410][177171] DAMAGECOUNT value on done: 32427.0 [2023-02-24 17:56:32,410][177171] Sum rewards: -0.264, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.108', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.015', 'WEAPON1': '0.040', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.240', 'weapon5': '0.250', 'HITCOUNT': '0.310', 'ARMOR': '0.451', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.464', 'weapon2': '1.490', 'weapon3': '1.644', 'FRAGCOUNT': '2.000'} [2023-02-24 17:56:32,415][177157] DAMAGECOUNT value on done: 33779.0 [2023-02-24 17:56:32,415][177157] Sum rewards: -0.629, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.965', 'AMMO2': '0.008', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO4': '0.038', 'WEAPON1': '0.040', 'AMMO3': '0.136', 'WEAPON4': '0.200', 'weapon5': '0.218', 'WEAPON5': '0.300', 'weapon4': '0.300', 'HITCOUNT': '0.530', 'WEAPON3': '0.900', 'weapon2': '1.092', 'weapon3': '2.022', 'DAMAGECOUNT': '2.025', 'FRAGCOUNT': '2.500'} [2023-02-24 17:56:32,523][177153] Updated weights for policy 0, policy_version 6890 (0.0008) [2023-02-24 17:56:32,627][177157] DAMAGECOUNT value on done: 32052.0 [2023-02-24 17:56:32,627][177157] Sum rewards: 3.818, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.470', 'AMMO5': '0.022', 'AMMO2': '0.033', 'WEAPON1': '0.040', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'AMMO4': '0.166', 'weapon5': '0.266', 'WEAPON5': '0.400', 'weapon4': '0.460', 'HITCOUNT': '0.520', 'WEAPON3': '0.650', 'weapon2': '1.168', 'weapon3': '1.684', 'DAMAGECOUNT': '2.112', 'FRAGCOUNT': '4.000'} [2023-02-24 17:56:32,706][177171] DAMAGECOUNT value on done: 32969.0 [2023-02-24 17:56:32,707][177171] Sum rewards: 3.741, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.965', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO3': '0.022', 'WEAPON1': '0.040', 'AMMO4': '0.088', 'weapon7': '0.106', 'weapon5': '0.134', 'HITCOUNT': '0.150', 'WEAPON3': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon3': '0.480', 'weapon2': '0.704', 'ARMOR': '0.942', 'weapon4': '1.010', 'DAMAGECOUNT': '1.152', 'FRAGCOUNT': '3.000'} [2023-02-24 17:56:32,908][177155] DAMAGECOUNT value on done: 33364.0 [2023-02-24 17:56:32,909][177155] Sum rewards: 0.139, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.629', 'AMMO2': '0.007', 'AMMO5': '0.022', 'weapon4': '0.032', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'WEAPON1': '0.080', 'AMMO3': '0.131', 'weapon5': '0.148', 'HITCOUNT': '0.390', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'weapon2': '1.708', 'weapon3': '1.770', 'DAMAGECOUNT': '1.947', 'FRAGCOUNT': '3.000'} [2023-02-24 17:56:33,213][177155] DAMAGECOUNT value on done: 35915.0 [2023-02-24 17:56:33,213][177155] Sum rewards: 3.065, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.446', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.027', 'WEAPON1': '0.030', 'weapon7': '0.058', 'AMMO3': '0.089', 'weapon5': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.360', 'WEAPON3': '0.450', 'ARMOR': '0.453', 'weapon4': '0.620', 'weapon3': '0.966', 'weapon2': '1.344', 'DAMAGECOUNT': '1.809', 'FRAGCOUNT': '3.000'} [2023-02-24 17:56:33,411][177155] DAMAGECOUNT value on done: 35439.0 [2023-02-24 17:56:33,412][177155] Sum rewards: 3.229, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.482', 'AMMO2': '0.007', 'AMMO5': '0.017', 'AMMO4': '0.035', 'WEAPON1': '0.060', 'AMMO3': '0.077', 'weapon5': '0.238', 'WEAPON5': '0.400', 'HITCOUNT': '0.440', 'WEAPON3': '0.500', 'weapon3': '1.260', 'weapon2': '2.044', 'DAMAGECOUNT': '2.382', 'FRAGCOUNT': '3.000'} [2023-02-24 17:56:33,715][177155] DAMAGECOUNT value on done: 34100.0 [2023-02-24 17:56:33,716][177155] Sum rewards: 7.419, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.281', 'AMMO2': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.037', 'AMMO3': '0.057', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.112', 'weapon7': '0.112', 'WEAPON5': '0.350', 'weapon5': '0.366', 'WEAPON3': '0.400', 'HITCOUNT': '0.550', 'weapon3': '1.170', 'weapon2': '2.008', 'DAMAGECOUNT': '3.087', 'FRAGCOUNT': '6.500'} [2023-02-24 17:56:35,438][177153] Updated weights for policy 0, policy_version 6900 (0.0009) [2023-02-24 17:56:36,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 28274688. Throughput: 0: 3475.1. Samples: 7062390. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 17:56:36,376][177119] Avg episode reward: [(0, '2.680')] [2023-02-24 17:56:36,942][177156] DAMAGECOUNT value on done: 33018.0 [2023-02-24 17:56:36,942][177156] Sum rewards: 3.958, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.558', 'AMMO5': '0.010', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.098', 'AMMO4': '0.118', 'weapon5': '0.126', 'WEAPON5': '0.250', 'HITCOUNT': '0.380', 'WEAPON4': '0.400', 'ARMOR': '0.482', 'weapon4': '0.642', 'WEAPON3': '0.650', 'weapon2': '1.468', 'weapon3': '1.538', 'DAMAGECOUNT': '1.800', 'FRAGCOUNT': '5.000'} [2023-02-24 17:56:37,241][177156] DAMAGECOUNT value on done: 34057.0 [2023-02-24 17:56:37,241][177156] Sum rewards: 5.386, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.416', 'AMMO2': '0.011', 'AMMO5': '0.012', 'ARMOR': '0.020', 'AMMO4': '0.055', 'WEAPON1': '0.060', 'AMMO3': '0.115', 'weapon5': '0.198', 'WEAPON5': '0.400', 'HITCOUNT': '0.550', 'WEAPON3': '0.850', 'weapon2': '1.244', 'weapon3': '2.270', 'DAMAGECOUNT': '2.517', 'FRAGCOUNT': '6.000'} [2023-02-24 17:56:37,298][177156] DAMAGECOUNT value on done: 34769.0 [2023-02-24 17:56:37,299][177156] Sum rewards: -0.066, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.269', 'AMMO5': '0.017', 'AMMO2': '0.028', 'ARMOR': '0.036', 'WEAPON1': '0.060', 'AMMO3': '0.090', 'AMMO4': '0.141', 'weapon5': '0.254', 'HITCOUNT': '0.340', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.566', 'WEAPON3': '0.600', 'weapon2': '1.136', 'DAMAGECOUNT': '1.545', 'weapon3': '1.640', 'FRAGCOUNT': '3.000'} [2023-02-24 17:56:37,601][177156] DAMAGECOUNT value on done: 35638.0 [2023-02-24 17:56:37,601][177156] Sum rewards: 7.501, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'AMMO3': '0.085', 'AMMO4': '0.111', 'weapon5': '0.146', 'WEAPON5': '0.200', 'HITCOUNT': '0.420', 'WEAPON3': '0.500', 'HEALTH': '0.714', 'weapon2': '1.654', 'DAMAGECOUNT': '1.710', 'weapon3': '1.888', 'FRAGCOUNT': '6.000'} [2023-02-24 17:56:38,366][177153] Updated weights for policy 0, policy_version 6910 (0.0008) [2023-02-24 17:56:41,334][177153] Updated weights for policy 0, policy_version 6920 (0.0008) [2023-02-24 17:56:41,376][177119] Fps is (10 sec: 13926.2, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 28344320. Throughput: 0: 3479.4. Samples: 7083398. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:56:41,376][177119] Avg episode reward: [(0, '2.685')] [2023-02-24 17:56:44,288][177153] Updated weights for policy 0, policy_version 6930 (0.0008) [2023-02-24 17:56:46,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 28413952. Throughput: 0: 3478.6. Samples: 7104252. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:56:46,376][177119] Avg episode reward: [(0, '2.685')] [2023-02-24 17:56:47,212][177153] Updated weights for policy 0, policy_version 6940 (0.0008) [2023-02-24 17:56:47,908][177170] DAMAGECOUNT value on done: 34709.0 [2023-02-24 17:56:47,909][177170] Sum rewards: -0.263, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.963', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO3': '0.047', 'AMMO4': '0.058', 'WEAPON1': '0.060', 'HITCOUNT': '0.250', 'weapon5': '0.338', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.366', 'WEAPON3': '0.400', 'weapon3': '1.002', 'weapon2': '1.576', 'DAMAGECOUNT': '1.623', 'FRAGCOUNT': '2.000'} [2023-02-24 17:56:48,157][177170] DAMAGECOUNT value on done: 30626.0 [2023-02-24 17:56:48,157][177170] Sum rewards: -0.872, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.370', 'AMMO2': '0.015', 'AMMO5': '0.015', 'ARMOR': '0.036', 'WEAPON1': '0.040', 'weapon5': '0.042', 'AMMO4': '0.073', 'HITCOUNT': '0.130', 'AMMO3': '0.134', 'weapon4': '0.142', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.525', 'WEAPON3': '0.850', 'weapon2': '1.324', 'weapon3': '1.872', 'FRAGCOUNT': '3.000'} [2023-02-24 17:56:48,211][177170] DAMAGECOUNT value on done: 36858.0 [2023-02-24 17:56:48,212][177170] Sum rewards: 1.407, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.558', 'AMMO2': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.050', 'AMMO3': '0.052', 'WEAPON1': '0.120', 'HITCOUNT': '0.260', 'weapon5': '0.396', 'WEAPON3': '0.450', 'WEAPON5': '0.600', 'DAMAGECOUNT': '1.083', 'weapon3': '1.344', 'weapon2': '1.832', 'FRAGCOUNT': '2.000'} [2023-02-24 17:56:48,461][177170] DAMAGECOUNT value on done: 35896.0 [2023-02-24 17:56:48,461][177170] Sum rewards: 1.439, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.620', 'AMMO2': '0.004', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.020', 'ARMOR': '0.032', 'weapon5': '0.090', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'HITCOUNT': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.242', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.795', 'weapon2': '1.054', 'FRAGCOUNT': '1.500', 'weapon3': '1.838'} [2023-02-24 17:56:48,721][177158] DAMAGECOUNT value on done: 33365.0 [2023-02-24 17:56:48,721][177158] Sum rewards: 1.592, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.623', 'AMMO2': '0.003', 'AMMO5': '0.011', 'AMMO4': '0.015', 'WEAPON1': '0.040', 'weapon7': '0.072', 'AMMO3': '0.086', 'ARMOR': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.228', 'HITCOUNT': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '0.650', 'weapon4': '0.654', 'weapon3': '1.182', 'DAMAGECOUNT': '1.221', 'weapon2': '1.384', 'FRAGCOUNT': '4.000'} [2023-02-24 17:56:49,023][177158] DAMAGECOUNT value on done: 32194.0 [2023-02-24 17:56:49,480][177172] DAMAGECOUNT value on done: 33214.0 [2023-02-24 17:56:49,481][177172] Sum rewards: 3.196, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.038', 'ARMOR': '0.005', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.044', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'weapon5': '0.104', 'WEAPON5': '0.200', 'HITCOUNT': '0.330', 'WEAPON3': '0.550', 'weapon3': '1.546', 'DAMAGECOUNT': '1.548', 'weapon2': '1.690', 'FRAGCOUNT': '4.000'} [2023-02-24 17:56:49,783][177172] DAMAGECOUNT value on done: 32336.0 [2023-02-24 17:56:49,783][177172] Sum rewards: 2.930, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.158', 'AMMO5': '0.007', 'AMMO2': '0.008', 'ARMOR': '0.036', 'AMMO4': '0.040', 'WEAPON1': '0.040', 'weapon7': '0.056', 'weapon5': '0.082', 'AMMO3': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.480', 'weapon4': '0.608', 'WEAPON3': '0.650', 'weapon2': '0.748', 'DAMAGECOUNT': '1.488', 'weapon3': '1.904', 'FRAGCOUNT': '3.000'} [2023-02-24 17:56:49,879][177158] DAMAGECOUNT value on done: 32297.0 [2023-02-24 17:56:49,880][177158] Sum rewards: 2.918, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.440', 'ARMOR': '0.004', 'AMMO2': '0.014', 'AMMO5': '0.019', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.064', 'AMMO4': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.130', 'weapon4': '0.180', 'weapon5': '0.260', 'WEAPON5': '0.350', 'HITCOUNT': '0.580', 'WEAPON3': '0.850', 'weapon2': '1.184', 'weapon3': '1.950', 'DAMAGECOUNT': '2.055', 'FRAGCOUNT': '6.000'} [2023-02-24 17:56:50,144][177153] Updated weights for policy 0, policy_version 6950 (0.0008) [2023-02-24 17:56:50,177][177158] DAMAGECOUNT value on done: 35317.0 [2023-02-24 17:56:50,178][177158] Sum rewards: 3.269, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.804', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO5': '0.025', 'WEAPON1': '0.110', 'AMMO3': '0.124', 'weapon5': '0.244', 'HITCOUNT': '0.390', 'WEAPON5': '0.600', 'WEAPON3': '0.850', 'weapon2': '1.582', 'DAMAGECOUNT': '1.794', 'weapon3': '1.836', 'FRAGCOUNT': '5.000'} [2023-02-24 17:56:50,234][177154] DAMAGECOUNT value on done: 34994.0 [2023-02-24 17:56:50,234][177154] Sum rewards: 0.687, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.690', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'ARMOR': '0.040', 'AMMO4': '0.067', 'weapon5': '0.070', 'weapon4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'WEAPON5': '0.150', 'HITCOUNT': '0.480', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.680', 'weapon2': '1.806', 'weapon3': '1.870', 'FRAGCOUNT': '4.000'} [2023-02-24 17:56:50,532][177154] DAMAGECOUNT value on done: 33893.0 [2023-02-24 17:56:50,533][177154] Sum rewards: 1.248, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.992', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'weapon5': '0.058', 'AMMO3': '0.112', 'AMMO4': '0.130', 'WEAPON4': '0.350', 'HITCOUNT': '0.450', 'weapon4': '0.500', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.491', 'weapon3': '1.564', 'weapon2': '1.740', 'FRAGCOUNT': '4.000'} [2023-02-24 17:56:50,764][177172] DAMAGECOUNT value on done: 33785.0 [2023-02-24 17:56:50,764][177172] Sum rewards: 4.212, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.305', 'AMMO5': '0.007', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'weapon5': '0.058', 'weapon7': '0.086', 'AMMO4': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.184', 'WEAPON7': '0.200', 'HITCOUNT': '0.450', 'WEAPON3': '0.900', 'weapon2': '1.540', 'weapon3': '1.738', 'DAMAGECOUNT': '2.016', 'FRAGCOUNT': '5.000'} [2023-02-24 17:56:50,787][177154] DAMAGECOUNT value on done: 34936.0 [2023-02-24 17:56:50,787][177154] Sum rewards: 5.244, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.604', 'AMMO2': '0.014', 'AMMO5': '0.014', 'WEAPON1': '0.060', 'AMMO4': '0.067', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'HITCOUNT': '0.190', 'weapon5': '0.330', 'weapon4': '0.334', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon2': '1.480', 'weapon3': '1.626', 'DAMAGECOUNT': '1.854', 'FRAGCOUNT': '4.000'} [2023-02-24 17:56:51,061][177172] DAMAGECOUNT value on done: 31887.0 [2023-02-24 17:56:51,062][177172] Sum rewards: 3.462, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.060', 'AMMO5': '0.011', 'AMMO2': '0.020', 'weapon4': '0.038', 'WEAPON1': '0.060', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon5': '0.102', 'WEAPON5': '0.300', 'HITCOUNT': '0.510', 'WEAPON3': '0.650', 'weapon3': '1.632', 'weapon2': '1.784', 'DAMAGECOUNT': '1.866', 'FRAGCOUNT': '4.000'} [2023-02-24 17:56:51,083][177154] DAMAGECOUNT value on done: 33015.0 [2023-02-24 17:56:51,084][177154] Sum rewards: 1.921, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.292', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'weapon7': '0.068', 'AMMO4': '0.083', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.250', 'weapon5': '0.252', 'WEAPON5': '0.300', 'weapon4': '0.326', 'WEAPON3': '0.500', 'weapon2': '0.716', 'DAMAGECOUNT': '0.783', 'weapon3': '1.484', 'FRAGCOUNT': '2.000'} [2023-02-24 17:56:51,211][177171] DAMAGECOUNT value on done: 32687.0 [2023-02-24 17:56:51,211][177171] Sum rewards: 4.934, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.552', 'ARMOR': '0.004', 'AMMO5': '0.027', 'AMMO2': '0.028', 'weapon7': '0.060', 'WEAPON1': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'AMMO4': '0.137', 'weapon5': '0.258', 'HITCOUNT': '0.370', 'weapon4': '0.530', 'weapon2': '0.542', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'weapon3': '1.970', 'DAMAGECOUNT': '2.211', 'FRAGCOUNT': '5.000'} [2023-02-24 17:56:51,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 28483584. Throughput: 0: 3479.0. Samples: 7114682. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:56:51,376][177119] Avg episode reward: [(0, '2.597')] [2023-02-24 17:56:51,410][177157] DAMAGECOUNT value on done: 35036.0 [2023-02-24 17:56:51,411][177157] Sum rewards: -0.749, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.932', 'AMMO2': '0.002', 'ARMOR': '0.004', 'AMMO4': '0.009', 'AMMO5': '0.012', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO3': '0.083', 'weapon4': '0.110', 'weapon5': '0.310', 'HITCOUNT': '0.330', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.242', 'weapon3': '1.596', 'weapon2': '1.664', 'FRAGCOUNT': '2.000'} [2023-02-24 17:56:51,508][177171] DAMAGECOUNT value on done: 32429.0 [2023-02-24 17:56:51,508][177171] Sum rewards: 3.564, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.522', 'AMMO5': '0.007', 'AMMO2': '0.038', 'WEAPON1': '0.040', 'ARMOR': '0.056', 'AMMO3': '0.071', 'AMMO4': '0.191', 'weapon5': '0.224', 'WEAPON5': '0.300', 'HITCOUNT': '0.340', 'WEAPON4': '0.500', 'WEAPON3': '0.550', 'weapon4': '0.604', 'weapon3': '1.192', 'weapon2': '1.802', 'DAMAGECOUNT': '1.920', 'FRAGCOUNT': '4.000'} [2023-02-24 17:56:51,586][177157] DAMAGECOUNT value on done: 35217.0 [2023-02-24 17:56:51,587][177157] Sum rewards: 5.828, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.290', 'AMMO5': '0.009', 'WEAPON1': '0.030', 'AMMO2': '0.033', 'ARMOR': '0.036', 'AMMO3': '0.101', 'weapon5': '0.118', 'weapon7': '0.118', 'AMMO4': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon2': '0.534', 'HITCOUNT': '0.620', 'WEAPON3': '0.700', 'weapon4': '0.838', 'weapon3': '1.644', 'DAMAGECOUNT': '2.535', 'FRAGCOUNT': '6.000'} [2023-02-24 17:56:51,713][177157] DAMAGECOUNT value on done: 34142.0 [2023-02-24 17:56:51,713][177157] Sum rewards: 2.416, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'AMMO4': '0.054', 'WEAPON5': '0.200', 'weapon5': '0.214', 'HITCOUNT': '0.250', 'WEAPON3': '0.300', 'HEALTH': '0.358', 'DAMAGECOUNT': '1.089', 'weapon3': '1.106', 'weapon2': '1.984', 'FRAGCOUNT': '2.000'} [2023-02-24 17:56:51,732][177171] DAMAGECOUNT value on done: 32925.0 [2023-02-24 17:56:51,732][177171] Sum rewards: 0.645, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.854', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.007', 'ARMOR': '0.032', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'weapon4': '0.192', 'weapon5': '0.246', 'WEAPON5': '0.250', 'HITCOUNT': '0.520', 'WEAPON3': '0.750', 'weapon2': '1.424', 'DAMAGECOUNT': '1.494', 'weapon3': '1.860', 'FRAGCOUNT': '3.000'} [2023-02-24 17:56:51,889][177157] DAMAGECOUNT value on done: 33273.0 [2023-02-24 17:56:51,889][177157] Sum rewards: 7.246, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.858', 'AMMO5': '0.019', 'AMMO2': '0.025', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'AMMO4': '0.123', 'AMMO3': '0.138', 'weapon5': '0.158', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'weapon4': '0.474', 'HITCOUNT': '0.710', 'WEAPON3': '0.750', 'weapon2': '1.178', 'weapon3': '1.844', 'DAMAGECOUNT': '3.663', 'FRAGCOUNT': '6.500'} [2023-02-24 17:56:52,033][177171] DAMAGECOUNT value on done: 33530.0 [2023-02-24 17:56:52,033][177171] Sum rewards: 3.688, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.012', 'AMMO2': '0.035', 'WEAPON1': '0.050', 'AMMO3': '0.060', 'weapon7': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.176', 'weapon5': '0.310', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'HITCOUNT': '0.420', 'HEALTH': '0.479', 'weapon4': '0.558', 'weapon3': '1.216', 'weapon2': '1.478', 'DAMAGECOUNT': '1.683', 'FRAGCOUNT': '2.000'} [2023-02-24 17:56:52,185][177155] DAMAGECOUNT value on done: 33762.0 [2023-02-24 17:56:52,186][177155] Sum rewards: 1.051, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.312', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'weapon5': '0.080', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'weapon4': '0.106', 'AMMO3': '0.136', 'WEAPON5': '0.200', 'HITCOUNT': '0.300', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.194', 'weapon2': '1.654', 'weapon3': '1.918', 'FRAGCOUNT': '3.000'} [2023-02-24 17:56:52,487][177155] DAMAGECOUNT value on done: 36605.0 [2023-02-24 17:56:52,487][177155] Sum rewards: 2.779, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.110', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'weapon5': '0.122', 'AMMO3': '0.132', 'AMMO4': '0.155', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.358', 'ARMOR': '0.436', 'HITCOUNT': '0.450', 'WEAPON3': '0.700', 'weapon3': '1.324', 'weapon2': '1.974', 'DAMAGECOUNT': '2.070', 'FRAGCOUNT': '6.000'} [2023-02-24 17:56:52,682][177155] DAMAGECOUNT value on done: 35985.0 [2023-02-24 17:56:52,683][177155] Sum rewards: 4.762, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.400', 'AMMO2': '0.003', 'AMMO4': '0.015', 'ARMOR': '0.020', 'AMMO3': '0.040', 'WEAPON4': '0.150', 'weapon4': '0.236', 'WEAPON3': '0.300', 'HITCOUNT': '0.430', 'weapon3': '0.988', 'weapon2': '1.342', 'DAMAGECOUNT': '1.638', 'FRAGCOUNT': '3.000'} [2023-02-24 17:56:52,979][177155] DAMAGECOUNT value on done: 34331.0 [2023-02-24 17:56:52,980][177155] Sum rewards: -1.656, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.812', 'AMMO5': '0.017', 'AMMO2': '0.026', 'WEAPON1': '0.070', 'AMMO4': '0.130', 'AMMO3': '0.133', 'weapon5': '0.164', 'HITCOUNT': '0.200', 'weapon4': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.432', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.693', 'FRAGCOUNT': '1.000', 'weapon2': '1.144', 'weapon3': '1.838'} [2023-02-24 17:56:53,099][177153] Updated weights for policy 0, policy_version 6960 (0.0008) [2023-02-24 17:56:56,016][177153] Updated weights for policy 0, policy_version 6970 (0.0009) [2023-02-24 17:56:56,283][177156] DAMAGECOUNT value on done: 33500.0 [2023-02-24 17:56:56,283][177156] Sum rewards: 3.901, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.432', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.046', 'AMMO3': '0.071', 'weapon7': '0.086', 'AMMO4': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.260', 'WEAPON3': '0.350', 'weapon4': '0.382', 'ARMOR': '0.459', 'weapon3': '1.204', 'DAMAGECOUNT': '1.446', 'weapon2': '1.488', 'FRAGCOUNT': '3.000'} [2023-02-24 17:56:56,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 28553216. Throughput: 0: 3479.8. Samples: 7135564. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:56:56,376][177119] Avg episode reward: [(0, '2.865')] [2023-02-24 17:56:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000006971_28553216.pth... [2023-02-24 17:56:56,436][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000006155_25210880.pth [2023-02-24 17:56:56,443][177140] Saving new best policy, reward=2.865! [2023-02-24 17:56:56,610][177156] DAMAGECOUNT value on done: 34708.0 [2023-02-24 17:56:56,610][177156] Sum rewards: 1.748, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.516', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'weapon5': '0.144', 'weapon4': '0.240', 'ARMOR': '0.408', 'HITCOUNT': '0.450', 'WEAPON3': '0.800', 'weapon3': '1.438', 'weapon2': '1.696', 'DAMAGECOUNT': '1.953', 'FRAGCOUNT': '4.000'} [2023-02-24 17:56:56,676][177156] DAMAGECOUNT value on done: 35155.0 [2023-02-24 17:56:56,676][177156] Sum rewards: 1.153, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.014', 'AMMO2': '0.019', 'WEAPON1': '0.050', 'AMMO3': '0.084', 'AMMO4': '0.096', 'HITCOUNT': '0.200', 'weapon5': '0.274', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HEALTH': '0.505', 'DAMAGECOUNT': '1.158', 'weapon3': '1.686', 'weapon2': '1.766', 'FRAGCOUNT': '2.000'} [2023-02-24 17:56:56,979][177156] DAMAGECOUNT value on done: 36124.0 [2023-02-24 17:56:56,979][177156] Sum rewards: 1.382, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.710', 'AMMO5': '0.014', 'AMMO2': '0.024', 'WEAPON1': '0.050', 'AMMO3': '0.104', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'weapon4': '0.214', 'weapon5': '0.226', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.400', 'WEAPON3': '0.700', 'weapon3': '0.920', 'DAMAGECOUNT': '1.458', 'weapon2': '2.460', 'FRAGCOUNT': '3.000'} [2023-02-24 17:56:58,986][177153] Updated weights for policy 0, policy_version 6980 (0.0008) [2023-02-24 17:57:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 28622848. Throughput: 0: 3478.2. Samples: 7156340. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:57:01,376][177119] Avg episode reward: [(0, '2.829')] [2023-02-24 17:57:01,920][177153] Updated weights for policy 0, policy_version 6990 (0.0008) [2023-02-24 17:57:04,887][177153] Updated weights for policy 0, policy_version 7000 (0.0009) [2023-02-24 17:57:05,661][177171] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 17:57:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 28692480. Throughput: 0: 3476.8. Samples: 7166784. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:57:06,376][177119] Avg episode reward: [(0, '2.829')] [2023-02-24 17:57:07,208][177170] DAMAGECOUNT value on done: 35453.0 [2023-02-24 17:57:07,208][177170] Sum rewards: 5.665, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.602', 'AMMO2': '0.005', 'AMMO5': '0.017', 'AMMO4': '0.025', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.056', 'WEAPON1': '0.090', 'AMMO3': '0.111', 'weapon5': '0.326', 'HITCOUNT': '0.410', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon2': '1.280', 'weapon3': '2.024', 'DAMAGECOUNT': '2.232', 'FRAGCOUNT': '6.000'} [2023-02-24 17:57:07,482][177170] DAMAGECOUNT value on done: 30884.0 [2023-02-24 17:57:07,483][177170] Sum rewards: 1.629, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.684', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO3': '0.020', 'WEAPON1': '0.040', 'weapon7': '0.048', 'HITCOUNT': '0.080', 'ARMOR': '0.083', 'AMMO4': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.200', 'weapon5': '0.266', 'weapon4': '0.338', 'WEAPON5': '0.400', 'weapon3': '0.504', 'DAMAGECOUNT': '0.774', 'weapon2': '1.488', 'FRAGCOUNT': '2.000'} [2023-02-24 17:57:07,531][177170] DAMAGECOUNT value on done: 37622.0 [2023-02-24 17:57:07,532][177170] Sum rewards: 0.611, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.344', 'AMMO2': '0.015', 'AMMO5': '0.017', 'WEAPON1': '0.050', 'AMMO4': '0.075', 'weapon5': '0.090', 'AMMO3': '0.105', 'weapon4': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'HITCOUNT': '0.630', 'WEAPON3': '0.750', 'weapon2': '1.386', 'weapon3': '2.020', 'DAMAGECOUNT': '2.292', 'FRAGCOUNT': '5.000'} [2023-02-24 17:57:07,818][177170] DAMAGECOUNT value on done: 36283.0 [2023-02-24 17:57:07,819][177170] Sum rewards: 4.152, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.654', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'ARMOR': '0.008', 'WEAPON1': '0.040', 'AMMO3': '0.052', 'weapon7': '0.056', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.130', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.250', 'WEAPON3': '0.300', 'weapon4': '0.666', 'weapon3': '0.766', 'DAMAGECOUNT': '1.161', 'weapon2': '1.566', 'FRAGCOUNT': '2.000'} [2023-02-24 17:57:07,834][177153] Updated weights for policy 0, policy_version 7010 (0.0008) [2023-02-24 17:57:07,961][177158] DAMAGECOUNT value on done: 33603.0 [2023-02-24 17:57:07,962][177158] Sum rewards: -3.580, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.553', 'ARMOR': '0.024', 'AMMO2': '0.025', 'AMMO5': '0.026', 'weapon7': '0.050', 'AMMO3': '0.070', 'WEAPON1': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.104', 'AMMO4': '0.124', 'HITCOUNT': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.714', 'weapon4': '0.878', 'weapon2': '0.992', 'FRAGCOUNT': '1.000', 'weapon3': '1.096'} [2023-02-24 17:57:08,260][177158] DAMAGECOUNT value on done: 32958.0 [2023-02-24 17:57:08,261][177158] Sum rewards: 6.630, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.012', 'AMMO2': '0.026', 'WEAPON1': '0.050', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'AMMO4': '0.130', 'weapon5': '0.194', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'HITCOUNT': '0.500', 'weapon4': '0.586', 'HEALTH': '0.624', 'weapon2': '1.048', 'weapon3': '1.538', 'DAMAGECOUNT': '2.292', 'FRAGCOUNT': '4.000'} [2023-02-24 17:57:08,791][177172] DAMAGECOUNT value on done: 33518.0 [2023-02-24 17:57:08,792][177172] Sum rewards: 0.770, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.007', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'HEALTH': '0.046', 'weapon7': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'AMMO4': '0.109', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.138', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.270', 'weapon4': '0.272', 'ARMOR': '0.464', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.912', 'weapon2': '1.542', 'weapon3': '1.756', 'FRAGCOUNT': '2.000'} [2023-02-24 17:57:09,095][177172] DAMAGECOUNT value on done: 32657.0 [2023-02-24 17:57:09,095][177172] Sum rewards: -0.664, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.175', 'AMMO5': '0.012', 'AMMO2': '0.040', 'WEAPON1': '0.070', 'AMMO3': '0.087', 'weapon4': '0.180', 'AMMO4': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.300', 'weapon5': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.499', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.963', 'FRAGCOUNT': '1.000', 'weapon2': '1.512', 'weapon3': '1.648'} [2023-02-24 17:57:09,114][177158] DAMAGECOUNT value on done: 32851.0 [2023-02-24 17:57:09,115][177158] Sum rewards: -2.233, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.718', 'AMMO2': '0.005', 'AMMO5': '0.020', 'ARMOR': '0.020', 'AMMO4': '0.024', 'weapon7': '0.078', 'WEAPON1': '0.090', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.125', 'weapon5': '0.134', 'weapon4': '0.154', 'WEAPON7': '0.200', 'HITCOUNT': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'weapon2': '1.094', 'DAMAGECOUNT': '1.653', 'weapon3': '2.198', 'FRAGCOUNT': '3.000'} [2023-02-24 17:57:09,411][177158] DAMAGECOUNT value on done: 36133.0 [2023-02-24 17:57:09,412][177158] Sum rewards: 4.977, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.298', 'AMMO2': '0.006', 'AMMO5': '0.017', 'AMMO4': '0.028', 'WEAPON1': '0.080', 'AMMO3': '0.100', 'weapon5': '0.254', 'WEAPON5': '0.400', 'HITCOUNT': '0.520', 'WEAPON3': '0.700', 'weapon2': '1.714', 'weapon3': '1.758', 'DAMAGECOUNT': '2.448', 'FRAGCOUNT': '4.000'} [2023-02-24 17:57:09,598][177154] DAMAGECOUNT value on done: 35414.0 [2023-02-24 17:57:09,599][177154] Sum rewards: 3.432, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.204', 'AMMO2': '0.011', 'AMMO5': '0.012', 'ARMOR': '0.032', 'AMMO4': '0.052', 'WEAPON1': '0.070', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'weapon4': '0.166', 'weapon5': '0.318', 'WEAPON5': '0.350', 'HITCOUNT': '0.360', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.260', 'weapon2': '1.514', 'weapon3': '1.754', 'FRAGCOUNT': '3.000'} [2023-02-24 17:57:09,896][177154] DAMAGECOUNT value on done: 34053.0 [2023-02-24 17:57:09,896][177154] Sum rewards: 0.897, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.990', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.028', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'weapon7': '0.046', 'AMMO3': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon5': '0.306', 'weapon4': '0.410', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.302', 'weapon2': '1.658'} [2023-02-24 17:57:10,046][177172] DAMAGECOUNT value on done: 34356.0 [2023-02-24 17:57:10,046][177172] Sum rewards: 1.735, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.398', 'AMMO2': '0.017', 'AMMO5': '0.017', 'WEAPON1': '0.050', 'AMMO4': '0.084', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'weapon5': '0.240', 'WEAPON5': '0.300', 'weapon4': '0.306', 'HITCOUNT': '0.420', 'WEAPON3': '0.600', 'weapon2': '1.264', 'DAMAGECOUNT': '1.713', 'weapon3': '1.836', 'FRAGCOUNT': '4.000'} [2023-02-24 17:57:10,131][177154] DAMAGECOUNT value on done: 35721.0 [2023-02-24 17:57:10,132][177154] Sum rewards: -1.502, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.510', 'AMMO5': '0.017', 'AMMO2': '0.022', 'ARMOR': '0.040', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.138', 'weapon4': '0.246', 'weapon5': '0.372', 'HITCOUNT': '0.480', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'weapon2': '1.112', 'weapon3': '2.044', 'DAMAGECOUNT': '2.355', 'FRAGCOUNT': '3.000'} [2023-02-24 17:57:10,346][177172] DAMAGECOUNT value on done: 32985.0 [2023-02-24 17:57:10,347][177172] Sum rewards: 7.437, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.242', 'AMMO2': '0.017', 'AMMO5': '0.020', 'ARMOR': '0.024', 'AMMO4': '0.085', 'AMMO3': '0.088', 'WEAPON1': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.252', 'weapon5': '0.360', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'weapon3': '1.438', 'weapon2': '1.680', 'DAMAGECOUNT': '3.294', 'FRAGCOUNT': '10.000'} [2023-02-24 17:57:10,431][177154] DAMAGECOUNT value on done: 33780.0 [2023-02-24 17:57:10,431][177154] Sum rewards: 3.636, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.432', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO2': '0.043', 'AMMO3': '0.068', 'weapon5': '0.134', 'AMMO4': '0.214', 'weapon4': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.490', 'weapon3': '0.954', 'weapon2': '1.992', 'DAMAGECOUNT': '2.295', 'FRAGCOUNT': '5.000'} [2023-02-24 17:57:10,457][177171] DAMAGECOUNT value on done: 32904.0 [2023-02-24 17:57:10,752][177157] DAMAGECOUNT value on done: 35346.0 [2023-02-24 17:57:10,752][177157] Sum rewards: 2.855, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.586', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'weapon7': '0.058', 'AMMO4': '0.062', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.208', 'HITCOUNT': '0.260', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.930', 'weapon3': '1.464', 'weapon2': '2.034', 'FRAGCOUNT': '3.000'} [2023-02-24 17:57:10,754][177171] DAMAGECOUNT value on done: 33372.0 [2023-02-24 17:57:10,754][177171] Sum rewards: 6.589, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.690', 'AMMO5': '0.017', 'ARMOR': '0.020', 'AMMO2': '0.023', 'WEAPON1': '0.070', 'AMMO3': '0.080', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO4': '0.117', 'HITCOUNT': '0.340', 'weapon5': '0.354', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'weapon3': '1.444', 'weapon2': '1.896', 'DAMAGECOUNT': '2.829', 'FRAGCOUNT': '5.000'} [2023-02-24 17:57:10,775][177153] Updated weights for policy 0, policy_version 7020 (0.0008) [2023-02-24 17:57:10,936][177157] DAMAGECOUNT value on done: 35936.0 [2023-02-24 17:57:10,937][177157] Sum rewards: 3.575, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.480', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'ARMOR': '0.032', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'weapon5': '0.270', 'weapon4': '0.376', 'HITCOUNT': '0.470', 'WEAPON3': '0.550', 'weapon2': '1.416', 'weapon3': '1.518', 'DAMAGECOUNT': '2.157', 'FRAGCOUNT': '5.000'} [2023-02-24 17:57:11,008][177171] DAMAGECOUNT value on done: 33789.0 [2023-02-24 17:57:11,009][177171] Sum rewards: 5.679, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.228', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.081', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO3': '0.120', 'WEAPON4': '0.300', 'ARMOR': '0.456', 'HITCOUNT': '0.510', 'WEAPON3': '0.600', 'weapon4': '0.754', 'weapon2': '0.898', 'weapon3': '1.660', 'DAMAGECOUNT': '2.532', 'FRAGCOUNT': '6.000'} [2023-02-24 17:57:11,068][177157] DAMAGECOUNT value on done: 34638.0 [2023-02-24 17:57:11,068][177157] Sum rewards: 0.387, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.676', 'AMMO2': '0.004', 'AMMO5': '0.009', 'ARMOR': '0.020', 'AMMO4': '0.020', 'WEAPON1': '0.050', 'AMMO3': '0.069', 'WEAPON4': '0.150', 'weapon5': '0.194', 'weapon4': '0.196', 'WEAPON5': '0.250', 'HITCOUNT': '0.470', 'WEAPON3': '0.550', 'weapon3': '1.346', 'DAMAGECOUNT': '1.488', 'weapon2': '1.996', 'FRAGCOUNT': '2.000'} [2023-02-24 17:57:11,248][177157] DAMAGECOUNT value on done: 33953.0 [2023-02-24 17:57:11,249][177157] Sum rewards: 6.024, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.851', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.076', 'weapon4': '0.084', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'weapon5': '0.150', 'WEAPON4': '0.250', 'ARMOR': '0.470', 'HITCOUNT': '0.510', 'WEAPON3': '0.900', 'weapon2': '1.640', 'weapon3': '1.906', 'DAMAGECOUNT': '2.040', 'FRAGCOUNT': '7.000'} [2023-02-24 17:57:11,303][177171] DAMAGECOUNT value on done: 33700.0 [2023-02-24 17:57:11,304][177171] Sum rewards: 3.070, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.340', 'AMMO5': '0.007', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'AMMO3': '0.031', 'weapon7': '0.050', 'weapon5': '0.054', 'AMMO4': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'ARMOR': '0.400', 'weapon4': '0.498', 'DAMAGECOUNT': '0.510', 'weapon3': '0.660', 'weapon2': '0.872', 'FRAGCOUNT': '2.000'} [2023-02-24 17:57:11,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 28762112. Throughput: 0: 3478.0. Samples: 7187744. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:57:11,376][177119] Avg episode reward: [(0, '2.800')] [2023-02-24 17:57:11,507][177155] DAMAGECOUNT value on done: 34601.0 [2023-02-24 17:57:11,508][177155] Sum rewards: 8.848, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.508', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon5': '0.096', 'weapon4': '0.220', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.520', 'weapon3': '1.406', 'weapon2': '1.724', 'DAMAGECOUNT': '2.517', 'FRAGCOUNT': '5.000'} [2023-02-24 17:57:11,813][177155] DAMAGECOUNT value on done: 37421.0 [2023-02-24 17:57:11,813][177155] Sum rewards: 6.318, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.776', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.070', 'AMMO3': '0.080', 'WEAPON4': '0.150', 'weapon4': '0.290', 'weapon5': '0.324', 'WEAPON5': '0.350', 'HITCOUNT': '0.510', 'WEAPON3': '0.550', 'weapon3': '1.226', 'weapon2': '1.824', 'DAMAGECOUNT': '2.448', 'FRAGCOUNT': '6.000'} [2023-02-24 17:57:12,009][177155] DAMAGECOUNT value on done: 36315.0 [2023-02-24 17:57:12,010][177155] Sum rewards: 1.916, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.128', 'AMMO2': '0.005', 'AMMO5': '0.015', 'AMMO4': '0.023', 'WEAPON1': '0.050', 'weapon7': '0.052', 'ARMOR': '0.072', 'AMMO3': '0.097', 'weapon5': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.280', 'WEAPON5': '0.350', 'weapon4': '0.396', 'WEAPON3': '0.450', 'weapon2': '0.968', 'DAMAGECOUNT': '0.990', 'weapon3': '1.750', 'FRAGCOUNT': '2.500'} [2023-02-24 17:57:12,307][177155] DAMAGECOUNT value on done: 35323.0 [2023-02-24 17:57:12,307][177155] Sum rewards: 4.464, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.571', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.021', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO4': '0.102', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.134', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.330', 'WEAPON5': '0.350', 'weapon4': '0.554', 'WEAPON3': '0.650', 'weapon3': '1.046', 'weapon2': '1.472', 'DAMAGECOUNT': '2.745', 'FRAGCOUNT': '6.000'} [2023-02-24 17:57:13,687][177153] Updated weights for policy 0, policy_version 7030 (0.0009) [2023-02-24 17:57:15,624][177156] DAMAGECOUNT value on done: 34357.0 [2023-02-24 17:57:15,625][177156] Sum rewards: 3.596, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.310', 'AMMO2': '0.011', 'AMMO5': '0.015', 'weapon4': '0.046', 'AMMO4': '0.054', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.129', 'WEAPON5': '0.250', 'weapon5': '0.362', 'ARMOR': '0.514', 'HITCOUNT': '0.610', 'WEAPON3': '0.700', 'weapon2': '1.210', 'FRAGCOUNT': '2.000', 'weapon3': '2.024', 'DAMAGECOUNT': '2.571'} [2023-02-24 17:57:15,933][177156] DAMAGECOUNT value on done: 35499.0 [2023-02-24 17:57:15,934][177156] Sum rewards: 8.257, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.426', 'AMMO2': '0.008', 'AMMO5': '0.012', 'weapon7': '0.018', 'AMMO4': '0.040', 'WEAPON1': '0.060', 'AMMO3': '0.097', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.306', 'ARMOR': '0.380', 'weapon4': '0.438', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'weapon2': '1.152', 'weapon3': '1.768', 'DAMAGECOUNT': '2.373', 'FRAGCOUNT': '6.000'} [2023-02-24 17:57:16,018][177156] DAMAGECOUNT value on done: 35798.0 [2023-02-24 17:57:16,019][177156] Sum rewards: 0.372, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.140', 'AMMO2': '0.018', 'AMMO5': '0.031', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'weapon7': '0.078', 'AMMO4': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON1': '0.140', 'AMMO3': '0.148', 'weapon5': '0.224', 'weapon4': '0.326', 'HITCOUNT': '0.580', 'WEAPON5': '0.700', 'weapon2': '0.778', 'WEAPON3': '1.000', 'weapon3': '1.832', 'DAMAGECOUNT': '1.929', 'FRAGCOUNT': '4.000'} [2023-02-24 17:57:16,323][177156] DAMAGECOUNT value on done: 36772.0 [2023-02-24 17:57:16,323][177156] Sum rewards: 4.908, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.486', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.008', 'AMMO3': '0.043', 'WEAPON1': '0.050', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.220', 'HITCOUNT': '0.280', 'WEAPON3': '0.350', 'weapon4': '0.400', 'weapon3': '0.888', 'weapon2': '1.746', 'DAMAGECOUNT': '1.944', 'FRAGCOUNT': '4.000'} [2023-02-24 17:57:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 28831744. Throughput: 0: 3482.0. Samples: 7208680. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:57:16,376][177119] Avg episode reward: [(0, '2.899')] [2023-02-24 17:57:16,380][177140] Saving new best policy, reward=2.899! [2023-02-24 17:57:16,636][177153] Updated weights for policy 0, policy_version 7040 (0.0008) [2023-02-24 17:57:19,556][177153] Updated weights for policy 0, policy_version 7050 (0.0008) [2023-02-24 17:57:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 28901376. Throughput: 0: 3484.4. Samples: 7219190. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:57:21,376][177119] Avg episode reward: [(0, '2.899')] [2023-02-24 17:57:22,505][177153] Updated weights for policy 0, policy_version 7060 (0.0009) [2023-02-24 17:57:25,434][177153] Updated weights for policy 0, policy_version 7070 (0.0009) [2023-02-24 17:57:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 28971008. Throughput: 0: 3482.2. Samples: 7240096. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:57:26,376][177119] Avg episode reward: [(0, '2.899')] [2023-02-24 17:57:26,453][177170] DAMAGECOUNT value on done: 35822.0 [2023-02-24 17:57:26,453][177170] Sum rewards: -0.134, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.716', 'AMMO2': '0.015', 'AMMO5': '0.022', 'AMMO4': '0.074', 'AMMO3': '0.099', 'WEAPON1': '0.100', 'HITCOUNT': '0.250', 'ARMOR': '0.451', 'WEAPON5': '0.600', 'weapon5': '0.636', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.107', 'weapon3': '1.288', 'weapon2': '1.790', 'FRAGCOUNT': '2.000'} [2023-02-24 17:57:26,752][177170] DAMAGECOUNT value on done: 38411.0 [2023-02-24 17:57:26,752][177170] Sum rewards: 3.484, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.855', 'AMMO5': '0.020', 'AMMO2': '0.023', 'weapon4': '0.066', 'WEAPON4': '0.100', 'AMMO4': '0.116', 'WEAPON1': '0.120', 'AMMO3': '0.136', 'HITCOUNT': '0.460', 'WEAPON5': '0.650', 'weapon5': '0.726', 'WEAPON3': '0.800', 'weapon2': '0.962', 'weapon3': '1.792', 'DAMAGECOUNT': '2.367', 'FRAGCOUNT': '6.000'} [2023-02-24 17:57:26,764][177170] DAMAGECOUNT value on done: 31674.0 [2023-02-24 17:57:26,765][177170] Sum rewards: 4.911, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.320', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO3': '0.107', 'WEAPON5': '0.200', 'weapon5': '0.212', 'WEAPON4': '0.300', 'weapon4': '0.542', 'HITCOUNT': '0.640', 'WEAPON3': '0.750', 'ARMOR': '0.941', 'weapon3': '1.230', 'weapon2': '1.660', 'DAMAGECOUNT': '2.370', 'FRAGCOUNT': '5.000'} [2023-02-24 17:57:27,062][177170] DAMAGECOUNT value on done: 37039.0 [2023-02-24 17:57:27,063][177170] Sum rewards: 5.561, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.012', 'AMMO5': '0.015', 'AMMO4': '0.061', 'WEAPON1': '0.070', 'weapon7': '0.092', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.306', 'WEAPON5': '0.350', 'weapon5': '0.350', 'HITCOUNT': '0.360', 'WEAPON3': '0.450', 'HEALTH': '0.644', 'weapon2': '0.986', 'weapon3': '1.404', 'DAMAGECOUNT': '2.268', 'FRAGCOUNT': '5.000'} [2023-02-24 17:57:27,260][177158] DAMAGECOUNT value on done: 34107.0 [2023-02-24 17:57:27,260][177158] Sum rewards: 0.824, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.106', 'AMMO2': '0.012', 'AMMO5': '0.015', 'ARMOR': '0.028', 'WEAPON1': '0.050', 'AMMO4': '0.060', 'weapon5': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'HITCOUNT': '0.310', 'WEAPON5': '0.350', 'weapon4': '0.460', 'WEAPON3': '0.600', 'weapon2': '1.372', 'DAMAGECOUNT': '1.512', 'weapon3': '1.632', 'FRAGCOUNT': '5.000'} [2023-02-24 17:57:27,563][177158] DAMAGECOUNT value on done: 33854.0 [2023-02-24 17:57:27,564][177158] Sum rewards: 2.949, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.412', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'ARMOR': '0.028', 'weapon5': '0.034', 'WEAPON1': '0.050', 'weapon7': '0.064', 'AMMO3': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.640', 'WEAPON3': '0.700', 'weapon3': '1.322', 'weapon2': '2.412', 'DAMAGECOUNT': '2.688', 'FRAGCOUNT': '4.000'} [2023-02-24 17:57:28,128][177172] DAMAGECOUNT value on done: 34268.0 [2023-02-24 17:57:28,129][177172] Sum rewards: 1.691, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.474', 'AMMO2': '0.004', 'AMMO5': '0.012', 'AMMO4': '0.019', 'WEAPON1': '0.060', 'AMMO3': '0.078', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.480', 'weapon5': '0.566', 'weapon3': '1.098', 'weapon2': '2.098', 'DAMAGECOUNT': '2.250', 'FRAGCOUNT': '3.000'} [2023-02-24 17:57:28,398][177153] Updated weights for policy 0, policy_version 7080 (0.0008) [2023-02-24 17:57:28,416][177158] DAMAGECOUNT value on done: 33425.0 [2023-02-24 17:57:28,417][177158] Sum rewards: 5.931, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO3': '0.040', 'weapon7': '0.058', 'WEAPON1': '0.060', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.230', 'HITCOUNT': '0.260', 'HEALTH': '0.268', 'WEAPON3': '0.300', 'WEAPON5': '0.300', 'weapon5': '0.334', 'ARMOR': '0.482', 'weapon2': '0.774', 'weapon3': '0.938', 'DAMAGECOUNT': '1.722', 'FRAGCOUNT': '4.000'} [2023-02-24 17:57:28,435][177172] DAMAGECOUNT value on done: 32932.0 [2023-02-24 17:57:28,435][177172] Sum rewards: -0.823, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.774', 'AMMO2': '0.012', 'AMMO5': '0.013', 'WEAPON1': '0.030', 'ARMOR': '0.056', 'AMMO4': '0.059', 'AMMO3': '0.096', 'weapon5': '0.114', 'WEAPON5': '0.150', 'weapon7': '0.192', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'HITCOUNT': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.550', 'weapon4': '0.774', 'DAMAGECOUNT': '0.825', 'weapon2': '0.902', 'FRAGCOUNT': '1.000', 'weapon3': '1.438'} [2023-02-24 17:57:28,709][177158] DAMAGECOUNT value on done: 36658.0 [2023-02-24 17:57:28,710][177158] Sum rewards: 0.936, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.492', 'AMMO5': '0.015', 'AMMO2': '0.032', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.105', 'AMMO4': '0.159', 'WEAPON4': '0.200', 'HITCOUNT': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon5': '0.412', 'WEAPON3': '0.500', 'weapon4': '0.730', 'weapon3': '0.790', 'weapon2': '1.522', 'DAMAGECOUNT': '1.575', 'FRAGCOUNT': '3.000'} [2023-02-24 17:57:28,831][177154] DAMAGECOUNT value on done: 36114.0 [2023-02-24 17:57:28,832][177154] Sum rewards: 5.161, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.908', 'AMMO2': '0.011', 'AMMO5': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'ARMOR': '0.060', 'WEAPON1': '0.060', 'AMMO3': '0.101', 'weapon5': '0.222', 'WEAPON5': '0.300', 'weapon4': '0.358', 'HITCOUNT': '0.680', 'WEAPON3': '0.700', 'weapon2': '1.088', 'weapon3': '1.768', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '6.000'} [2023-02-24 17:57:29,133][177154] DAMAGECOUNT value on done: 34314.0 [2023-02-24 17:57:29,134][177154] Sum rewards: -0.898, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.682', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.044', 'AMMO3': '0.093', 'weapon5': '0.134', 'HITCOUNT': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.308', 'ARMOR': '0.513', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.783', 'FRAGCOUNT': '1.000', 'weapon3': '1.052', 'weapon2': '1.378'} [2023-02-24 17:57:29,377][177172] DAMAGECOUNT value on done: 34926.0 [2023-02-24 17:57:29,377][177172] Sum rewards: 2.958, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.460', 'AMMO2': '0.009', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.044', 'weapon5': '0.072', 'AMMO3': '0.090', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.424', 'HITCOUNT': '0.530', 'WEAPON3': '0.600', 'weapon4': '0.868', 'weapon3': '0.908', 'DAMAGECOUNT': '1.710', 'weapon2': '1.880', 'FRAGCOUNT': '5.000'} [2023-02-24 17:57:29,432][177154] DAMAGECOUNT value on done: 36091.0 [2023-02-24 17:57:29,432][177154] Sum rewards: 3.917, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.427', 'AMMO2': '0.005', 'AMMO5': '0.014', 'AMMO4': '0.022', 'weapon4': '0.040', 'WEAPON1': '0.050', 'AMMO3': '0.051', 'WEAPON4': '0.100', 'HITCOUNT': '0.270', 'weapon5': '0.296', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'weapon3': '0.788', 'DAMAGECOUNT': '1.110', 'weapon2': '2.398', 'FRAGCOUNT': '4.000'} [2023-02-24 17:57:29,665][177171] DAMAGECOUNT value on done: 33393.0 [2023-02-24 17:57:29,665][177171] Sum rewards: 2.402, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.062', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.028', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon7': '0.056', 'AMMO3': '0.062', 'weapon5': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.218', 'WEAPON3': '0.450', 'HITCOUNT': '0.470', 'weapon3': '0.954', 'weapon2': '1.260', 'DAMAGECOUNT': '1.467', 'FRAGCOUNT': '3.000'} [2023-02-24 17:57:29,672][177172] DAMAGECOUNT value on done: 33592.0 [2023-02-24 17:57:29,673][177172] Sum rewards: -0.206, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.262', 'AMMO2': '0.002', 'AMMO4': '0.012', 'AMMO5': '0.028', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'WEAPON1': '0.110', 'weapon5': '0.236', 'HITCOUNT': '0.450', 'WEAPON3': '0.500', 'WEAPON5': '0.600', 'weapon3': '1.246', 'weapon2': '1.760', 'DAMAGECOUNT': '1.821', 'FRAGCOUNT': '3.000'} [2023-02-24 17:57:29,730][177154] DAMAGECOUNT value on done: 34197.0 [2023-02-24 17:57:29,731][177154] Sum rewards: 2.453, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.332', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'ARMOR': '0.061', 'AMMO3': '0.079', 'weapon5': '0.128', 'weapon7': '0.134', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.350', 'WEAPON3': '0.450', 'weapon4': '0.874', 'weapon2': '0.992', 'DAMAGECOUNT': '1.251', 'weapon3': '1.268', 'FRAGCOUNT': '4.000'} [2023-02-24 17:57:29,968][177171] DAMAGECOUNT value on done: 34355.0 [2023-02-24 17:57:29,969][177171] Sum rewards: 8.036, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'ARMOR': '0.060', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'weapon5': '0.158', 'weapon4': '0.220', 'HEALTH': '0.256', 'WEAPON3': '0.450', 'HITCOUNT': '0.770', 'weapon2': '1.184', 'weapon3': '1.760', 'DAMAGECOUNT': '2.949', 'FRAGCOUNT': '5.000'} [2023-02-24 17:57:29,996][177157] DAMAGECOUNT value on done: 35779.0 [2023-02-24 17:57:29,997][177157] Sum rewards: 1.517, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.316', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.053', 'ARMOR': '0.065', 'AMMO3': '0.088', 'weapon5': '0.192', 'WEAPON5': '0.300', 'HITCOUNT': '0.370', 'WEAPON3': '0.450', 'weapon3': '1.140', 'DAMAGECOUNT': '1.299', 'weapon2': '2.312', 'FRAGCOUNT': '3.000'} [2023-02-24 17:57:30,186][177157] DAMAGECOUNT value on done: 36980.0 [2023-02-24 17:57:30,187][177157] Sum rewards: 4.620, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.467', 'AMMO2': '0.006', 'AMMO5': '0.023', 'AMMO4': '0.029', 'WEAPON1': '0.030', 'AMMO3': '0.116', 'weapon5': '0.380', 'WEAPON5': '0.550', 'HITCOUNT': '0.660', 'WEAPON3': '0.850', 'weapon2': '1.488', 'weapon3': '1.824', 'DAMAGECOUNT': '3.132', 'FRAGCOUNT': '6.000'} [2023-02-24 17:57:30,237][177171] DAMAGECOUNT value on done: 34284.0 [2023-02-24 17:57:30,237][177171] Sum rewards: 2.471, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.405', 'AMMO2': '0.009', 'AMMO5': '0.022', 'ARMOR': '0.028', 'WEAPON1': '0.040', 'AMMO4': '0.047', 'AMMO3': '0.077', 'HITCOUNT': '0.250', 'weapon5': '0.396', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon2': '1.420', 'DAMAGECOUNT': '1.485', 'weapon3': '1.852', 'FRAGCOUNT': '3.000'} [2023-02-24 17:57:30,301][177157] DAMAGECOUNT value on done: 35250.0 [2023-02-24 17:57:30,301][177157] Sum rewards: -2.743, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.706', 'AMMO5': '0.022', 'AMMO2': '0.026', 'ARMOR': '0.029', 'weapon7': '0.050', 'WEAPON1': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.132', 'AMMO3': '0.136', 'WEAPON7': '0.200', 'HITCOUNT': '0.300', 'WEAPON4': '0.350', 'weapon5': '0.434', 'WEAPON5': '0.450', 'weapon4': '0.566', 'WEAPON3': '0.800', 'weapon2': '0.890', 'weapon3': '1.402', 'DAMAGECOUNT': '1.836', 'FRAGCOUNT': '2.000'} [2023-02-24 17:57:30,490][177157] DAMAGECOUNT value on done: 34573.0 [2023-02-24 17:57:30,491][177157] Sum rewards: 2.144, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.367', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon7': '0.072', 'AMMO4': '0.076', 'WEAPON1': '0.080', 'AMMO3': '0.081', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.330', 'weapon5': '0.344', 'WEAPON3': '0.450', 'ARMOR': '0.458', 'weapon4': '0.662', 'weapon2': '0.846', 'weapon3': '1.174', 'DAMAGECOUNT': '1.860', 'FRAGCOUNT': '2.000'} [2023-02-24 17:57:30,529][177171] DAMAGECOUNT value on done: 34350.0 [2023-02-24 17:57:30,529][177171] Sum rewards: 7.259, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.728', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO3': '0.061', 'WEAPON4': '0.100', 'weapon7': '0.104', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.318', 'weapon5': '0.344', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'weapon3': '0.954', 'weapon2': '1.796', 'DAMAGECOUNT': '1.950', 'FRAGCOUNT': '5.000'} [2023-02-24 17:57:30,699][177155] DAMAGECOUNT value on done: 35317.0 [2023-02-24 17:57:30,699][177155] Sum rewards: -2.109, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.348', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.021', 'ARMOR': '0.028', 'AMMO3': '0.090', 'WEAPON1': '0.090', 'weapon5': '0.170', 'HITCOUNT': '0.440', 'FRAGCOUNT': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon3': '1.334', 'weapon2': '1.608', 'DAMAGECOUNT': '2.148'} [2023-02-24 17:57:30,989][177155] DAMAGECOUNT value on done: 37826.0 [2023-02-24 17:57:30,989][177155] Sum rewards: 4.493, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.476', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.005', 'weapon4': '0.026', 'ARMOR': '0.028', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.055', 'weapon5': '0.144', 'WEAPON5': '0.200', 'HITCOUNT': '0.280', 'WEAPON3': '0.400', 'weapon3': '1.174', 'DAMAGECOUNT': '1.215', 'weapon2': '2.098', 'FRAGCOUNT': '3.000'} [2023-02-24 17:57:31,190][177155] DAMAGECOUNT value on done: 36922.0 [2023-02-24 17:57:31,190][177155] Sum rewards: 2.775, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.509', 'AMMO5': '0.007', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.055', 'weapon7': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.139', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.340', 'WEAPON3': '0.350', 'weapon5': '0.540', 'weapon4': '0.700', 'weapon3': '0.846', 'ARMOR': '0.885', 'weapon2': '1.510', 'DAMAGECOUNT': '1.821', 'FRAGCOUNT': '2.000'} [2023-02-24 17:57:31,347][177153] Updated weights for policy 0, policy_version 7090 (0.0008) [2023-02-24 17:57:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 29040640. Throughput: 0: 3482.3. Samples: 7260954. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:57:31,376][177119] Avg episode reward: [(0, '2.770')] [2023-02-24 17:57:31,485][177155] DAMAGECOUNT value on done: 35794.0 [2023-02-24 17:57:31,485][177155] Sum rewards: 2.722, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.787', 'AMMO5': '0.012', 'AMMO2': '0.019', 'ARMOR': '0.036', 'WEAPON1': '0.060', 'AMMO3': '0.068', 'AMMO4': '0.094', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.300', 'weapon4': '0.306', 'weapon5': '0.322', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'weapon3': '1.254', 'DAMAGECOUNT': '1.413', 'weapon2': '1.774', 'FRAGCOUNT': '3.000'} [2023-02-24 17:57:34,272][177153] Updated weights for policy 0, policy_version 7100 (0.0008) [2023-02-24 17:57:34,987][177156] DAMAGECOUNT value on done: 35403.0 [2023-02-24 17:57:34,988][177156] Sum rewards: 9.199, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.574', 'AMMO5': '0.014', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO3': '0.093', 'AMMO4': '0.104', 'weapon4': '0.276', 'weapon5': '0.378', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.630', 'weapon3': '1.316', 'weapon2': '1.832', 'DAMAGECOUNT': '3.138', 'FRAGCOUNT': '7.000'} [2023-02-24 17:57:35,284][177156] DAMAGECOUNT value on done: 36548.0 [2023-02-24 17:57:35,284][177156] Sum rewards: 6.268, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.886', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'WEAPON5': '0.200', 'weapon5': '0.246', 'weapon4': '0.356', 'HITCOUNT': '0.560', 'WEAPON3': '0.700', 'weapon2': '0.982', 'weapon3': '1.560', 'DAMAGECOUNT': '2.250', 'FRAGCOUNT': '6.000'} [2023-02-24 17:57:35,293][177156] DAMAGECOUNT value on done: 36036.0 [2023-02-24 17:57:35,293][177156] Sum rewards: 6.372, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.161', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'AMMO3': '0.036', 'ARMOR': '0.036', 'AMMO4': '0.077', 'weapon7': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.196', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.250', 'WEAPON7': '0.300', 'HITCOUNT': '0.400', 'weapon4': '0.560', 'weapon3': '0.610', 'DAMAGECOUNT': '1.611', 'weapon2': '1.780', 'FRAGCOUNT': '5.000'} [2023-02-24 17:57:35,590][177156] DAMAGECOUNT value on done: 37156.0 [2023-02-24 17:57:35,591][177156] Sum rewards: -1.390, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.388', 'AMMO5': '0.013', 'ARMOR': '0.016', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'WEAPON1': '0.080', 'AMMO3': '0.103', 'AMMO4': '0.122', 'HITCOUNT': '0.200', 'weapon4': '0.246', 'WEAPON5': '0.400', 'weapon5': '0.416', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.152', 'weapon2': '1.224', 'weapon3': '1.700'} [2023-02-24 17:57:36,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 29110272. Throughput: 0: 3484.0. Samples: 7271460. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:57:36,376][177119] Avg episode reward: [(0, '2.826')] [2023-02-24 17:57:37,222][177153] Updated weights for policy 0, policy_version 7110 (0.0008) [2023-02-24 17:57:40,155][177153] Updated weights for policy 0, policy_version 7120 (0.0008) [2023-02-24 17:57:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 29179904. Throughput: 0: 3485.6. Samples: 7292418. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:57:41,376][177119] Avg episode reward: [(0, '2.826')] [2023-02-24 17:57:43,107][177153] Updated weights for policy 0, policy_version 7130 (0.0008) [2023-02-24 17:57:45,749][177170] DAMAGECOUNT value on done: 36341.0 [2023-02-24 17:57:45,749][177170] Sum rewards: 3.670, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.965', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'WEAPON1': '0.050', 'weapon4': '0.062', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'weapon5': '0.138', 'WEAPON5': '0.300', 'HITCOUNT': '0.350', 'WEAPON3': '0.550', 'weapon3': '1.412', 'DAMAGECOUNT': '1.557', 'weapon2': '2.038', 'FRAGCOUNT': '4.000'} [2023-02-24 17:57:46,026][177153] Updated weights for policy 0, policy_version 7140 (0.0008) [2023-02-24 17:57:46,049][177170] DAMAGECOUNT value on done: 38838.0 [2023-02-24 17:57:46,049][177170] Sum rewards: -0.660, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.006', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'weapon7': '0.052', 'ARMOR': '0.067', 'AMMO3': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO4': '0.191', 'WEAPON4': '0.250', 'HITCOUNT': '0.410', 'WEAPON3': '0.500', 'weapon4': '0.686', 'weapon3': '1.084', 'DAMAGECOUNT': '1.281', 'weapon2': '1.434', 'FRAGCOUNT': '2.000'} [2023-02-24 17:57:46,060][177170] DAMAGECOUNT value on done: 32313.0 [2023-02-24 17:57:46,061][177170] Sum rewards: 6.433, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.021', 'AMMO5': '0.015', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'AMMO3': '0.101', 'AMMO4': '0.115', 'weapon7': '0.174', 'WEAPON4': '0.200', 'weapon4': '0.252', 'weapon5': '0.268', 'WEAPON5': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.560', 'weapon2': '1.382', 'weapon3': '1.516', 'DAMAGECOUNT': '1.917', 'FRAGCOUNT': '5.000'} [2023-02-24 17:57:46,362][177170] DAMAGECOUNT value on done: 37607.0 [2023-02-24 17:57:46,362][177170] Sum rewards: 3.204, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.207', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.042', 'weapon7': '0.046', 'AMMO3': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.164', 'AMMO4': '0.212', 'WEAPON3': '0.300', 'HITCOUNT': '0.310', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.886', 'weapon2': '0.990', 'weapon3': '1.060', 'DAMAGECOUNT': '1.704', 'FRAGCOUNT': '4.000'} [2023-02-24 17:57:46,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 29249536. Throughput: 0: 3487.6. Samples: 7313280. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:57:46,376][177119] Avg episode reward: [(0, '2.785')] [2023-02-24 17:57:46,440][177158] DAMAGECOUNT value on done: 34826.0 [2023-02-24 17:57:46,440][177158] Sum rewards: 5.120, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.974', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.024', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.121', 'AMMO4': '0.122', 'weapon5': '0.204', 'weapon4': '0.230', 'WEAPON5': '0.250', 'HITCOUNT': '0.450', 'WEAPON3': '0.800', 'weapon3': '1.604', 'weapon2': '1.766', 'DAMAGECOUNT': '2.157', 'FRAGCOUNT': '8.000'} [2023-02-24 17:57:46,742][177158] DAMAGECOUNT value on done: 34480.0 [2023-02-24 17:57:46,743][177158] Sum rewards: 3.411, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.234', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'ARMOR': '0.032', 'weapon7': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'weapon5': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.410', 'WEAPON3': '0.650', 'weapon3': '1.082', 'DAMAGECOUNT': '1.878', 'weapon2': '2.342', 'FRAGCOUNT': '5.000'} [2023-02-24 17:57:47,366][177172] DAMAGECOUNT value on done: 34872.0 [2023-02-24 17:57:47,367][177172] Sum rewards: 0.539, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.260', 'AMMO2': '0.015', 'AMMO5': '0.022', 'WEAPON1': '0.070', 'AMMO4': '0.075', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'HITCOUNT': '0.290', 'weapon5': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon2': '1.062', 'weapon3': '1.686', 'DAMAGECOUNT': '1.812', 'FRAGCOUNT': '3.000'} [2023-02-24 17:57:47,590][177158] DAMAGECOUNT value on done: 34211.0 [2023-02-24 17:57:47,590][177158] Sum rewards: 8.373, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.654', 'AMMO5': '0.012', 'AMMO2': '0.033', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.096', 'AMMO4': '0.165', 'weapon5': '0.256', 'weapon4': '0.256', 'WEAPON5': '0.300', 'HITCOUNT': '0.530', 'WEAPON3': '0.600', 'weapon3': '1.468', 'weapon2': '1.852', 'DAMAGECOUNT': '2.358', 'FRAGCOUNT': '7.000'} [2023-02-24 17:57:47,669][177172] DAMAGECOUNT value on done: 33464.0 [2023-02-24 17:57:47,670][177172] Sum rewards: -0.735, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.650', 'AMMO5': '0.015', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'ARMOR': '0.072', 'AMMO3': '0.091', 'AMMO4': '0.117', 'WEAPON4': '0.200', 'weapon5': '0.202', 'HITCOUNT': '0.270', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'weapon4': '0.796', 'weapon3': '0.960', 'DAMAGECOUNT': '1.596', 'weapon2': '1.642', 'FRAGCOUNT': '2.000'} [2023-02-24 17:57:47,889][177158] DAMAGECOUNT value on done: 36895.0 [2023-02-24 17:57:47,889][177158] Sum rewards: 3.585, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.258', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO3': '0.030', 'WEAPON1': '0.030', 'weapon7': '0.078', 'AMMO4': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.162', 'WEAPON7': '0.200', 'WEAPON3': '0.200', 'HITCOUNT': '0.220', 'DAMAGECOUNT': '0.711', 'weapon4': '0.766', 'weapon3': '0.778', 'weapon2': '1.766', 'FRAGCOUNT': '2.000'} [2023-02-24 17:57:48,181][177154] DAMAGECOUNT value on done: 36669.0 [2023-02-24 17:57:48,181][177154] Sum rewards: 4.561, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.571', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon7': '0.052', 'WEAPON1': '0.070', 'AMMO3': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.134', 'WEAPON4': '0.150', 'AMMO4': '0.184', 'HITCOUNT': '0.270', 'weapon4': '0.324', 'WEAPON5': '0.350', 'ARMOR': '0.519', 'WEAPON3': '0.550', 'weapon2': '0.854', 'DAMAGECOUNT': '1.665', 'weapon3': '1.836', 'FRAGCOUNT': '3.000'} [2023-02-24 17:57:48,487][177154] DAMAGECOUNT value on done: 35122.0 [2023-02-24 17:57:48,487][177154] Sum rewards: 8.532, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.558', 'weapon4': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.028', 'WEAPON1': '0.080', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'AMMO4': '0.139', 'weapon5': '0.298', 'WEAPON5': '0.400', 'HITCOUNT': '0.500', 'WEAPON3': '0.600', 'weapon2': '1.566', 'weapon3': '1.856', 'DAMAGECOUNT': '2.424', 'FRAGCOUNT': '7.000'} [2023-02-24 17:57:48,622][177172] DAMAGECOUNT value on done: 35261.0 [2023-02-24 17:57:48,623][177172] Sum rewards: 3.702, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'HEALTH': '0.061', 'AMMO3': '0.085', 'weapon4': '0.102', 'AMMO4': '0.119', 'WEAPON5': '0.200', 'weapon5': '0.216', 'HITCOUNT': '0.350', 'WEAPON3': '0.450', 'weapon3': '0.902', 'DAMAGECOUNT': '1.005', 'FRAGCOUNT': '2.000', 'weapon2': '2.550'} [2023-02-24 17:57:48,783][177154] DAMAGECOUNT value on done: 36434.0 [2023-02-24 17:57:48,784][177154] Sum rewards: 1.735, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.456', 'AMMO5': '0.006', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'AMMO3': '0.055', 'AMMO4': '0.081', 'weapon5': '0.094', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.260', 'WEAPON3': '0.350', 'weapon4': '0.484', 'weapon3': '0.648', 'DAMAGECOUNT': '1.029', 'weapon2': '1.248', 'FRAGCOUNT': '2.000'} [2023-02-24 17:57:48,938][177172] DAMAGECOUNT value on done: 34246.0 [2023-02-24 17:57:48,938][177172] Sum rewards: 5.264, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.624', 'ARMOR': '0.005', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.028', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.067', 'weapon4': '0.260', 'WEAPON5': '0.300', 'weapon5': '0.302', 'HITCOUNT': '0.320', 'WEAPON3': '0.500', 'weapon3': '1.054', 'DAMAGECOUNT': '1.962', 'weapon2': '1.984', 'FRAGCOUNT': '5.000'} [2023-02-24 17:57:48,988][177171] DAMAGECOUNT value on done: 33826.0 [2023-02-24 17:57:48,988][177171] Sum rewards: -0.847, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.246', 'AMMO5': '0.013', 'AMMO2': '0.033', 'WEAPON1': '0.060', 'weapon5': '0.082', 'AMMO3': '0.140', 'AMMO4': '0.166', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'HITCOUNT': '0.310', 'weapon4': '0.366', 'ARMOR': '0.400', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.299', 'weapon2': '1.472', 'weapon3': '1.608', 'FRAGCOUNT': '2.000'} [2023-02-24 17:57:48,995][177153] Updated weights for policy 0, policy_version 7150 (0.0009) [2023-02-24 17:57:49,084][177154] DAMAGECOUNT value on done: 35063.0 [2023-02-24 17:57:49,085][177154] Sum rewards: 6.061, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.015', 'AMMO2': '0.005', 'AMMO5': '0.013', 'AMMO4': '0.024', 'WEAPON1': '0.050', 'weapon7': '0.062', 'AMMO3': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.216', 'WEAPON5': '0.350', 'HITCOUNT': '0.520', 'WEAPON3': '0.600', 'weapon3': '1.418', 'weapon2': '1.582', 'DAMAGECOUNT': '2.598', 'FRAGCOUNT': '6.000'} [2023-02-24 17:57:49,286][177171] DAMAGECOUNT value on done: 34590.0 [2023-02-24 17:57:49,359][177157] DAMAGECOUNT value on done: 36573.0 [2023-02-24 17:57:49,359][177157] Sum rewards: 8.403, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.834', 'AMMO2': '0.009', 'AMMO5': '0.014', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO3': '0.071', 'weapon5': '0.144', 'weapon4': '0.258', 'HITCOUNT': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'ARMOR': '0.510', 'weapon3': '1.136', 'weapon2': '1.846', 'DAMAGECOUNT': '2.382', 'FRAGCOUNT': '6.000'} [2023-02-24 17:57:49,486][177157] DAMAGECOUNT value on done: 37831.0 [2023-02-24 17:57:49,487][177157] Sum rewards: 8.920, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.160', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.091', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'weapon5': '0.100', 'weapon4': '0.262', 'WEAPON3': '0.650', 'HITCOUNT': '0.660', 'weapon2': '1.638', 'weapon3': '1.794', 'DAMAGECOUNT': '2.553', 'FRAGCOUNT': '7.000'} [2023-02-24 17:57:49,540][177171] DAMAGECOUNT value on done: 34922.0 [2023-02-24 17:57:49,541][177171] Sum rewards: 2.646, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.000', 'AMMO2': '0.003', 'AMMO5': '0.015', 'AMMO4': '0.017', 'WEAPON1': '0.030', 'weapon5': '0.092', 'AMMO3': '0.118', 'WEAPON5': '0.300', 'HITCOUNT': '0.610', 'WEAPON3': '0.750', 'weapon3': '1.564', 'DAMAGECOUNT': '1.914', 'weapon2': '1.982', 'FRAGCOUNT': '3.000'} [2023-02-24 17:57:49,672][177157] DAMAGECOUNT value on done: 35750.0 [2023-02-24 17:57:49,673][177157] Sum rewards: -0.421, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.982', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.031', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.128', 'weapon5': '0.164', 'weapon4': '0.174', 'WEAPON5': '0.200', 'HITCOUNT': '0.290', 'WEAPON3': '0.700', 'weapon3': '1.280', 'DAMAGECOUNT': '1.500', 'weapon2': '1.940', 'FRAGCOUNT': '3.000'} [2023-02-24 17:57:49,794][177157] DAMAGECOUNT value on done: 35364.0 [2023-02-24 17:57:49,795][177157] Sum rewards: 3.260, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.422', 'AMMO2': '0.010', 'AMMO5': '0.020', 'weapon7': '0.036', 'WEAPON4': '0.050', 'AMMO4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.114', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.200', 'weapon5': '0.282', 'HITCOUNT': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon3': '1.002', 'weapon2': '2.014', 'DAMAGECOUNT': '2.373', 'FRAGCOUNT': '7.000'} [2023-02-24 17:57:49,839][177171] DAMAGECOUNT value on done: 35096.0 [2023-02-24 17:57:49,839][177171] Sum rewards: 8.409, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.928', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon5': '0.028', 'AMMO3': '0.078', 'weapon7': '0.082', 'ARMOR': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'WEAPON4': '0.400', 'HITCOUNT': '0.530', 'WEAPON3': '0.550', 'weapon4': '0.768', 'weapon3': '1.324', 'weapon2': '1.436', 'DAMAGECOUNT': '2.238', 'FRAGCOUNT': '8.000'} [2023-02-24 17:57:49,975][177155] DAMAGECOUNT value on done: 36021.0 [2023-02-24 17:57:49,976][177155] Sum rewards: 1.196, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.976', 'AMMO5': '0.020', 'AMMO2': '0.048', 'WEAPON1': '0.060', 'ARMOR': '0.076', 'weapon5': '0.080', 'AMMO3': '0.163', 'AMMO4': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'HITCOUNT': '0.570', 'weapon2': '0.656', 'weapon4': '0.690', 'WEAPON3': '1.100', 'weapon3': '2.106', 'DAMAGECOUNT': '2.112', 'FRAGCOUNT': '5.000'} [2023-02-24 17:57:50,272][177155] DAMAGECOUNT value on done: 38453.0 [2023-02-24 17:57:50,273][177155] Sum rewards: 5.835, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.587', 'AMMO2': '0.009', 'AMMO5': '0.011', 'AMMO4': '0.043', 'ARMOR': '0.050', 'AMMO3': '0.060', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'weapon5': '0.220', 'weapon4': '0.238', 'WEAPON5': '0.350', 'HITCOUNT': '0.370', 'WEAPON3': '0.500', 'weapon3': '1.166', 'weapon2': '1.854', 'DAMAGECOUNT': '1.881', 'FRAGCOUNT': '4.000'} [2023-02-24 17:57:50,525][177155] DAMAGECOUNT value on done: 37430.0 [2023-02-24 17:57:50,525][177155] Sum rewards: 1.382, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.826', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'ARMOR': '0.036', 'AMMO4': '0.103', 'weapon5': '0.104', 'AMMO3': '0.127', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.480', 'weapon4': '0.528', 'WEAPON3': '0.700', 'weapon2': '1.058', 'DAMAGECOUNT': '1.524', 'weapon3': '2.040', 'FRAGCOUNT': '4.000'} [2023-02-24 17:57:50,821][177155] DAMAGECOUNT value on done: 35994.0 [2023-02-24 17:57:50,821][177155] Sum rewards: 0.902, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.260', 'AMMO2': '0.013', 'ARMOR': '0.016', 'AMMO5': '0.022', 'AMMO4': '0.064', 'AMMO3': '0.075', 'WEAPON1': '0.080', 'HITCOUNT': '0.180', 'weapon5': '0.246', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.600', 'weapon3': '1.382', 'weapon2': '1.934', 'FRAGCOUNT': '4.000'} [2023-02-24 17:57:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 29319168. Throughput: 0: 3483.9. Samples: 7323558. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:57:51,376][177119] Avg episode reward: [(0, '3.065')] [2023-02-24 17:57:51,377][177140] Saving new best policy, reward=3.065! [2023-02-24 17:57:51,951][177153] Updated weights for policy 0, policy_version 7160 (0.0008) [2023-02-24 17:57:54,365][177156] DAMAGECOUNT value on done: 36688.0 [2023-02-24 17:57:54,366][177156] Sum rewards: 9.278, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'ARMOR': '0.072', 'AMMO4': '0.086', 'weapon5': '0.088', 'WEAPON5': '0.100', 'weapon7': '0.110', 'WEAPON4': '0.150', 'HEALTH': '0.218', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.460', 'weapon4': '0.488', 'weapon3': '1.010', 'weapon2': '1.208', 'DAMAGECOUNT': '2.655', 'FRAGCOUNT': '6.000'} [2023-02-24 17:57:54,654][177156] DAMAGECOUNT value on done: 37425.0 [2023-02-24 17:57:54,654][177156] Sum rewards: 9.850, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.346', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.080', 'weapon4': '0.104', 'WEAPON5': '0.200', 'weapon5': '0.212', 'WEAPON3': '0.600', 'HITCOUNT': '0.730', 'weapon2': '1.508', 'weapon3': '1.964', 'DAMAGECOUNT': '2.631', 'FRAGCOUNT': '8.000'} [2023-02-24 17:57:54,664][177156] DAMAGECOUNT value on done: 36693.0 [2023-02-24 17:57:54,665][177156] Sum rewards: 4.112, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'AMMO2': '0.035', 'AMMO3': '0.060', 'weapon4': '0.072', 'WEAPON4': '0.150', 'AMMO4': '0.175', 'weapon5': '0.184', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'HITCOUNT': '0.550', 'HEALTH': '0.726', 'weapon3': '0.994', 'DAMAGECOUNT': '1.971', 'weapon2': '2.320', 'FRAGCOUNT': '3.000'} [2023-02-24 17:57:54,894][177153] Updated weights for policy 0, policy_version 7170 (0.0008) [2023-02-24 17:57:54,972][177156] DAMAGECOUNT value on done: 37871.0 [2023-02-24 17:57:54,973][177156] Sum rewards: 11.022, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.150', 'weapon4': '0.242', 'HEALTH': '0.258', 'WEAPON3': '0.350', 'HITCOUNT': '0.420', 'ARMOR': '0.466', 'weapon3': '1.028', 'weapon2': '1.550', 'DAMAGECOUNT': '2.145', 'FRAGCOUNT': '7.000'} [2023-02-24 17:57:56,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 29388800. Throughput: 0: 3482.3. Samples: 7344446. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 17:57:56,376][177119] Avg episode reward: [(0, '3.338')] [2023-02-24 17:57:56,380][177140] Saving new best policy, reward=3.338! [2023-02-24 17:57:57,864][177153] Updated weights for policy 0, policy_version 7180 (0.0008) [2023-02-24 17:58:00,771][177153] Updated weights for policy 0, policy_version 7190 (0.0008) [2023-02-24 17:58:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 29458432. Throughput: 0: 3480.1. Samples: 7365284. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:58:01,376][177119] Avg episode reward: [(0, '3.338')] [2023-02-24 17:58:03,688][177153] Updated weights for policy 0, policy_version 7200 (0.0009) [2023-02-24 17:58:05,128][177170] DAMAGECOUNT value on done: 36891.0 [2023-02-24 17:58:05,129][177170] Sum rewards: 1.585, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.834', 'AMMO2': '0.012', 'AMMO5': '0.017', 'ARMOR': '0.036', 'AMMO4': '0.061', 'WEAPON1': '0.080', 'AMMO3': '0.105', 'weapon5': '0.212', 'WEAPON5': '0.400', 'HITCOUNT': '0.470', 'WEAPON3': '0.850', 'weapon2': '1.468', 'DAMAGECOUNT': '1.650', 'FRAGCOUNT': '2.000', 'weapon3': '2.058'} [2023-02-24 17:58:05,442][177170] DAMAGECOUNT value on done: 39422.0 [2023-02-24 17:58:05,443][177170] Sum rewards: 5.673, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.078', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'weapon5': '0.186', 'weapon4': '0.192', 'HEALTH': '0.260', 'HITCOUNT': '0.360', 'WEAPON3': '0.450', 'weapon3': '1.218', 'DAMAGECOUNT': '1.752', 'weapon2': '2.020', 'FRAGCOUNT': '4.000'} [2023-02-24 17:58:05,454][177170] DAMAGECOUNT value on done: 32678.0 [2023-02-24 17:58:05,455][177170] Sum rewards: 1.918, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.504', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.040', 'AMMO3': '0.041', 'AMMO4': '0.051', 'weapon5': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.330', 'WEAPON3': '0.350', 'weapon4': '0.442', 'ARMOR': '0.489', 'FRAGCOUNT': '1.000', 'weapon3': '1.068', 'DAMAGECOUNT': '1.095', 'weapon2': '1.528'} [2023-02-24 17:58:05,763][177170] DAMAGECOUNT value on done: 38512.0 [2023-02-24 17:58:05,764][177170] Sum rewards: 8.604, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.114', 'AMMO5': '0.010', 'ARMOR': '0.013', 'AMMO2': '0.021', 'WEAPON1': '0.070', 'AMMO3': '0.080', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'weapon5': '0.222', 'WEAPON5': '0.250', 'weapon4': '0.328', 'WEAPON3': '0.500', 'HITCOUNT': '0.590', 'weapon2': '1.350', 'weapon3': '1.814', 'DAMAGECOUNT': '2.715', 'FRAGCOUNT': '8.000'} [2023-02-24 17:58:05,818][177158] DAMAGECOUNT value on done: 35553.0 [2023-02-24 17:58:05,819][177158] Sum rewards: 6.290, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.918', 'AMMO2': '0.012', 'ARMOR': '0.016', 'AMMO5': '0.017', 'AMMO4': '0.062', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon5': '0.182', 'weapon4': '0.196', 'WEAPON5': '0.400', 'HITCOUNT': '0.400', 'WEAPON3': '0.700', 'weapon2': '1.414', 'weapon3': '1.844', 'DAMAGECOUNT': '2.181', 'FRAGCOUNT': '7.000'} [2023-02-24 17:58:06,121][177158] DAMAGECOUNT value on done: 35457.0 [2023-02-24 17:58:06,121][177158] Sum rewards: 3.387, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'AMMO2': '0.015', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'weapon7': '0.074', 'AMMO4': '0.074', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.152', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.280', 'HEALTH': '0.312', 'WEAPON3': '0.400', 'weapon4': '0.490', 'weapon3': '1.028', 'weapon2': '1.670', 'DAMAGECOUNT': '1.731', 'FRAGCOUNT': '3.000'} [2023-02-24 17:58:06,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 29528064. Throughput: 0: 3479.8. Samples: 7375782. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:58:06,376][177119] Avg episode reward: [(0, '3.458')] [2023-02-24 17:58:06,380][177140] Saving new best policy, reward=3.458! [2023-02-24 17:58:06,665][177153] Updated weights for policy 0, policy_version 7210 (0.0008) [2023-02-24 17:58:06,708][177172] DAMAGECOUNT value on done: 35563.0 [2023-02-24 17:58:06,709][177172] Sum rewards: 3.395, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.568', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'ARMOR': '0.080', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'weapon4': '0.112', 'AMMO3': '0.141', 'WEAPON5': '0.200', 'weapon5': '0.204', 'HITCOUNT': '0.620', 'WEAPON3': '0.850', 'weapon2': '1.270', 'DAMAGECOUNT': '2.073', 'weapon3': '2.160', 'FRAGCOUNT': '5.000'} [2023-02-24 17:58:06,969][177158] DAMAGECOUNT value on done: 34887.0 [2023-02-24 17:58:06,969][177158] Sum rewards: 2.610, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.598', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.015', 'WEAPON1': '0.070', 'AMMO3': '0.092', 'weapon5': '0.092', 'WEAPON5': '0.350', 'HITCOUNT': '0.530', 'WEAPON3': '0.750', 'weapon3': '1.712', 'weapon2': '1.844', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.028'} [2023-02-24 17:58:07,008][177172] DAMAGECOUNT value on done: 33827.0 [2023-02-24 17:58:07,008][177172] Sum rewards: 3.470, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.148', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.037', 'WEAPON1': '0.050', 'AMMO3': '0.080', 'AMMO4': '0.183', 'WEAPON4': '0.200', 'HITCOUNT': '0.290', 'weapon5': '0.336', 'WEAPON5': '0.350', 'weapon4': '0.450', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.089', 'weapon3': '1.210', 'weapon2': '1.576', 'FRAGCOUNT': '4.000'} [2023-02-24 17:58:07,261][177158] DAMAGECOUNT value on done: 37498.0 [2023-02-24 17:58:07,262][177158] Sum rewards: 3.880, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.901', 'AMMO5': '0.011', 'AMMO2': '0.014', 'weapon7': '0.056', 'AMMO4': '0.067', 'WEAPON1': '0.070', 'AMMO3': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.146', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'HITCOUNT': '0.350', 'weapon4': '0.572', 'WEAPON3': '0.600', 'weapon3': '1.290', 'weapon2': '1.512', 'DAMAGECOUNT': '1.809', 'FRAGCOUNT': '4.000'} [2023-02-24 17:58:07,562][177154] DAMAGECOUNT value on done: 37219.0 [2023-02-24 17:58:07,563][177154] Sum rewards: 3.482, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.510', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'weapon5': '0.068', 'AMMO3': '0.088', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.338', 'HITCOUNT': '0.390', 'ARMOR': '0.493', 'WEAPON3': '0.550', 'weapon2': '1.064', 'weapon3': '1.620', 'DAMAGECOUNT': '1.650', 'FRAGCOUNT': '4.000'} [2023-02-24 17:58:07,863][177154] DAMAGECOUNT value on done: 35532.0 [2023-02-24 17:58:07,959][177172] DAMAGECOUNT value on done: 35916.0 [2023-02-24 17:58:07,959][177172] Sum rewards: 4.424, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.435', 'AMMO5': '0.012', 'AMMO2': '0.029', 'ARMOR': '0.048', 'WEAPON1': '0.050', 'AMMO3': '0.116', 'AMMO4': '0.143', 'weapon5': '0.178', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.408', 'HITCOUNT': '0.430', 'WEAPON3': '0.700', 'weapon2': '1.292', 'weapon3': '1.638', 'DAMAGECOUNT': '1.965', 'FRAGCOUNT': '5.000'} [2023-02-24 17:58:08,166][177154] DAMAGECOUNT value on done: 37199.0 [2023-02-24 17:58:08,167][177154] Sum rewards: 5.635, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.314', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'ARMOR': '0.044', 'weapon5': '0.054', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.136', 'weapon4': '0.192', 'WEAPON5': '0.200', 'HITCOUNT': '0.590', 'WEAPON3': '0.700', 'weapon2': '1.316', 'weapon3': '1.706', 'DAMAGECOUNT': '2.295', 'FRAGCOUNT': '6.000'} [2023-02-24 17:58:08,258][177172] DAMAGECOUNT value on done: 34411.0 [2023-02-24 17:58:08,259][177172] Sum rewards: 1.120, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.244', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.021', 'WEAPON1': '0.050', 'ARMOR': '0.052', 'AMMO3': '0.054', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'weapon5': '0.286', 'WEAPON5': '0.300', 'weapon4': '0.300', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.495', 'FRAGCOUNT': '1.000', 'weapon2': '1.288', 'weapon3': '1.294'} [2023-02-24 17:58:08,324][177171] DAMAGECOUNT value on done: 35337.0 [2023-02-24 17:58:08,325][177171] Sum rewards: 7.009, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.614', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.040', 'AMMO4': '0.050', 'AMMO3': '0.063', 'weapon7': '0.064', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.134', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.220', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'weapon4': '0.416', 'weapon3': '0.870', 'ARMOR': '0.943', 'weapon2': '1.982', 'DAMAGECOUNT': '3.033', 'FRAGCOUNT': '7.000'} [2023-02-24 17:58:08,467][177154] DAMAGECOUNT value on done: 35607.0 [2023-02-24 17:58:08,467][177154] Sum rewards: -0.710, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.780', 'AMMO5': '0.017', 'ARMOR': '0.040', 'weapon7': '0.046', 'AMMO2': '0.050', 'WEAPON1': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.108', 'AMMO3': '0.128', 'AMMO4': '0.251', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.450', 'WEAPON3': '0.800', 'weapon2': '0.818', 'weapon4': '0.848', 'weapon3': '1.472', 'DAMAGECOUNT': '1.632', 'FRAGCOUNT': '3.000'} [2023-02-24 17:58:08,631][177171] DAMAGECOUNT value on done: 35121.0 [2023-02-24 17:58:08,631][177171] Sum rewards: 4.231, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'weapon5': '0.064', 'HEALTH': '0.086', 'AMMO3': '0.096', 'WEAPON5': '0.200', 'weapon4': '0.284', 'HITCOUNT': '0.420', 'WEAPON3': '0.650', 'weapon2': '1.188', 'DAMAGECOUNT': '1.593', 'weapon3': '2.004', 'FRAGCOUNT': '5.000'} [2023-02-24 17:58:08,670][177157] DAMAGECOUNT value on done: 37357.0 [2023-02-24 17:58:08,671][177157] Sum rewards: 7.762, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.544', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.037', 'ARMOR': '0.044', 'AMMO3': '0.069', 'AMMO4': '0.186', 'weapon5': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'HITCOUNT': '0.450', 'WEAPON3': '0.450', 'weapon4': '0.502', 'weapon3': '1.300', 'weapon2': '1.540', 'DAMAGECOUNT': '2.352', 'FRAGCOUNT': '5.000'} [2023-02-24 17:58:08,814][177157] DAMAGECOUNT value on done: 38551.0 [2023-02-24 17:58:08,814][177157] Sum rewards: 0.735, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.747', 'AMMO5': '0.017', 'AMMO2': '0.025', 'WEAPON1': '0.080', 'AMMO3': '0.098', 'AMMO4': '0.123', 'weapon5': '0.246', 'WEAPON4': '0.300', 'weapon4': '0.312', 'HITCOUNT': '0.430', 'WEAPON5': '0.500', 'WEAPON3': '0.500', 'ARMOR': '0.500', 'weapon3': '0.984', 'DAMAGECOUNT': '2.160', 'weapon2': '2.206', 'FRAGCOUNT': '3.000'} [2023-02-24 17:58:08,896][177171] DAMAGECOUNT value on done: 35517.0 [2023-02-24 17:58:08,896][177171] Sum rewards: 4.214, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.754', 'AMMO2': '0.004', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO4': '0.020', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.076', 'AMMO3': '0.087', 'weapon5': '0.142', 'WEAPON5': '0.150', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'weapon3': '1.502', 'DAMAGECOUNT': '1.785', 'weapon2': '2.010', 'FRAGCOUNT': '4.000'} [2023-02-24 17:58:08,988][177157] DAMAGECOUNT value on done: 36308.0 [2023-02-24 17:58:08,989][177157] Sum rewards: 0.616, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.870', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.050', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.120', 'AMMO3': '0.144', 'weapon4': '0.178', 'WEAPON5': '0.250', 'HITCOUNT': '0.450', 'WEAPON3': '0.900', 'weapon2': '1.524', 'DAMAGECOUNT': '1.674', 'weapon3': '1.756', 'FRAGCOUNT': '2.000'} [2023-02-24 17:58:09,135][177157] DAMAGECOUNT value on done: 35870.0 [2023-02-24 17:58:09,135][177157] Sum rewards: 4.579, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.754', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.028', 'AMMO3': '0.050', 'ARMOR': '0.060', 'weapon7': '0.062', 'weapon5': '0.078', 'WEAPON5': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.350', 'WEAPON3': '0.400', 'weapon4': '0.612', 'weapon3': '1.086', 'DAMAGECOUNT': '1.518', 'weapon2': '1.596', 'FRAGCOUNT': '3.000'} [2023-02-24 17:58:09,201][177171] DAMAGECOUNT value on done: 35790.0 [2023-02-24 17:58:09,201][177171] Sum rewards: 8.477, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.715', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON1': '0.040', 'AMMO3': '0.054', 'weapon5': '0.120', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.412', 'WEAPON3': '0.450', 'ARMOR': '0.506', 'HITCOUNT': '0.540', 'weapon3': '1.182', 'weapon2': '2.038', 'DAMAGECOUNT': '2.082', 'FRAGCOUNT': '5.000'} [2023-02-24 17:58:09,353][177155] DAMAGECOUNT value on done: 36928.0 [2023-02-24 17:58:09,353][177155] Sum rewards: 8.315, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.387', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.007', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'weapon5': '0.198', 'weapon4': '0.212', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'HITCOUNT': '0.550', 'weapon3': '1.398', 'weapon2': '2.048', 'DAMAGECOUNT': '2.721', 'FRAGCOUNT': '6.000'} [2023-02-24 17:58:09,659][177155] DAMAGECOUNT value on done: 39018.0 [2023-02-24 17:58:09,659][177155] Sum rewards: 1.950, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.142', 'AMMO5': '0.017', 'AMMO2': '0.020', 'WEAPON1': '0.060', 'weapon5': '0.060', 'AMMO3': '0.081', 'weapon7': '0.098', 'AMMO4': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.330', 'WEAPON4': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.618', 'weapon2': '0.800', 'weapon3': '1.274', 'DAMAGECOUNT': '1.695', 'FRAGCOUNT': '3.000'} [2023-02-24 17:58:09,671][177153] Updated weights for policy 0, policy_version 7220 (0.0009) [2023-02-24 17:58:09,889][177155] DAMAGECOUNT value on done: 37867.0 [2023-02-24 17:58:09,890][177155] Sum rewards: 0.698, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.738', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.017', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'weapon5': '0.040', 'weapon7': '0.050', 'AMMO3': '0.061', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.224', 'WEAPON3': '0.450', 'HITCOUNT': '0.450', 'weapon2': '0.598', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.311', 'weapon3': '1.714'} [2023-02-24 17:58:10,189][177155] DAMAGECOUNT value on done: 36631.0 [2023-02-24 17:58:10,190][177155] Sum rewards: 8.054, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.011', 'AMMO5': '0.015', 'HEALTH': '0.024', 'AMMO4': '0.055', 'AMMO3': '0.060', 'weapon7': '0.062', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.198', 'WEAPON7': '0.200', 'weapon4': '0.218', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.480', 'weapon3': '1.390', 'weapon2': '1.770', 'DAMAGECOUNT': '1.911', 'FRAGCOUNT': '5.000'} [2023-02-24 17:58:11,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13858.1, 300 sec: 13912.5). Total num frames: 29593600. Throughput: 0: 3474.7. Samples: 7396458. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:58:11,376][177119] Avg episode reward: [(0, '3.803')] [2023-02-24 17:58:11,415][177140] Saving new best policy, reward=3.803! [2023-02-24 17:58:12,592][177153] Updated weights for policy 0, policy_version 7230 (0.0008) [2023-02-24 17:58:13,813][177156] DAMAGECOUNT value on done: 37198.0 [2023-02-24 17:58:13,813][177156] Sum rewards: 3.619, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.208', 'AMMO2': '0.007', 'ARMOR': '0.012', 'AMMO5': '0.019', 'AMMO4': '0.035', 'WEAPON1': '0.040', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'weapon5': '0.156', 'weapon4': '0.350', 'WEAPON5': '0.400', 'HITCOUNT': '0.490', 'WEAPON3': '0.750', 'weapon2': '1.248', 'DAMAGECOUNT': '1.530', 'weapon3': '2.016', 'FRAGCOUNT': '5.000'} [2023-02-24 17:58:14,106][177156] DAMAGECOUNT value on done: 38008.0 [2023-02-24 17:58:14,107][177156] Sum rewards: 2.275, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.700', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'AMMO3': '0.067', 'AMMO4': '0.097', 'WEAPON5': '0.200', 'weapon5': '0.210', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'ARMOR': '0.420', 'HITCOUNT': '0.440', 'weapon4': '0.594', 'FRAGCOUNT': '1.000', 'weapon3': '1.212', 'weapon2': '1.528', 'DAMAGECOUNT': '1.749'} [2023-02-24 17:58:14,116][177156] DAMAGECOUNT value on done: 37604.0 [2023-02-24 17:58:14,117][177156] Sum rewards: 7.736, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.447', 'AMMO5': '0.010', 'AMMO2': '0.020', 'WEAPON1': '0.060', 'AMMO3': '0.065', 'AMMO4': '0.097', 'weapon7': '0.116', 'weapon5': '0.156', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.300', 'WEAPON7': '0.400', 'HITCOUNT': '0.420', 'WEAPON3': '0.500', 'weapon4': '0.628', 'weapon2': '0.782', 'weapon3': '1.466', 'DAMAGECOUNT': '2.733', 'FRAGCOUNT': '6.000'} [2023-02-24 17:58:14,416][177156] DAMAGECOUNT value on done: 38532.0 [2023-02-24 17:58:14,417][177156] Sum rewards: 0.781, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.795', 'AMMO5': '0.011', 'ARMOR': '0.020', 'AMMO2': '0.021', 'WEAPON1': '0.060', 'AMMO4': '0.107', 'AMMO3': '0.120', 'weapon4': '0.180', 'WEAPON4': '0.200', 'weapon5': '0.218', 'WEAPON5': '0.300', 'HITCOUNT': '0.440', 'WEAPON3': '0.800', 'weapon2': '1.312', 'DAMAGECOUNT': '1.983', 'weapon3': '2.054', 'FRAGCOUNT': '3.000'} [2023-02-24 17:58:15,524][177153] Updated weights for policy 0, policy_version 7240 (0.0008) [2023-02-24 17:58:16,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13858.1, 300 sec: 13912.5). Total num frames: 29663232. Throughput: 0: 3476.0. Samples: 7417376. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:58:16,376][177119] Avg episode reward: [(0, '3.732')] [2023-02-24 17:58:18,466][177153] Updated weights for policy 0, policy_version 7250 (0.0008) [2023-02-24 17:58:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13912.5). Total num frames: 29732864. Throughput: 0: 3473.7. Samples: 7427778. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:58:21,376][177119] Avg episode reward: [(0, '3.732')] [2023-02-24 17:58:21,391][177153] Updated weights for policy 0, policy_version 7260 (0.0008) [2023-02-24 17:58:24,343][177153] Updated weights for policy 0, policy_version 7270 (0.0008) [2023-02-24 17:58:24,442][177170] DAMAGECOUNT value on done: 37271.0 [2023-02-24 17:58:24,442][177170] Sum rewards: 4.469, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.078', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.036', 'WEAPON1': '0.070', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'AMMO4': '0.180', 'weapon5': '0.212', 'HITCOUNT': '0.340', 'WEAPON5': '0.350', 'weapon4': '0.360', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.140', 'weapon2': '1.242', 'weapon3': '1.868', 'FRAGCOUNT': '4.000'} [2023-02-24 17:58:24,740][177170] DAMAGECOUNT value on done: 39766.0 [2023-02-24 17:58:24,741][177170] Sum rewards: 2.857, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'HEALTH': '0.054', 'AMMO3': '0.059', 'weapon5': '0.132', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.220', 'WEAPON3': '0.350', 'weapon4': '0.430', 'ARMOR': '0.457', 'weapon3': '0.804', 'DAMAGECOUNT': '1.032', 'weapon2': '2.308', 'FRAGCOUNT': '4.000'} [2023-02-24 17:58:24,752][177170] DAMAGECOUNT value on done: 33210.0 [2023-02-24 17:58:24,753][177170] Sum rewards: 7.404, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.028', 'AMMO5': '0.015', 'AMMO2': '0.026', 'WEAPON1': '0.060', 'AMMO3': '0.062', 'WEAPON4': '0.100', 'AMMO4': '0.131', 'weapon5': '0.224', 'WEAPON5': '0.350', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'weapon4': '0.442', 'weapon3': '1.318', 'DAMAGECOUNT': '1.596', 'weapon2': '1.838', 'FRAGCOUNT': '5.000'} [2023-02-24 17:58:25,049][177170] DAMAGECOUNT value on done: 39353.0 [2023-02-24 17:58:25,049][177170] Sum rewards: 8.289, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.216', 'AMMO2': '0.003', 'AMMO5': '0.014', 'AMMO4': '0.015', 'WEAPON1': '0.050', 'AMMO3': '0.087', 'weapon5': '0.196', 'WEAPON5': '0.350', 'HITCOUNT': '0.550', 'WEAPON3': '0.700', 'weapon2': '1.330', 'weapon3': '1.936', 'DAMAGECOUNT': '2.523', 'FRAGCOUNT': '7.000'} [2023-02-24 17:58:25,121][177158] DAMAGECOUNT value on done: 36103.0 [2023-02-24 17:58:25,121][177158] Sum rewards: 6.027, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.035', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon5': '0.062', 'AMMO3': '0.075', 'ARMOR': '0.080', 'HEALTH': '0.130', 'WEAPON5': '0.200', 'weapon4': '0.220', 'WEAPON3': '0.300', 'HITCOUNT': '0.450', 'weapon3': '1.016', 'weapon2': '1.454', 'DAMAGECOUNT': '1.650', 'FRAGCOUNT': '4.000'} [2023-02-24 17:58:25,419][177158] DAMAGECOUNT value on done: 36216.0 [2023-02-24 17:58:25,419][177158] Sum rewards: -1.364, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.980', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.085', 'AMMO4': '0.105', 'weapon5': '0.172', 'weapon4': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON3': '0.450', 'HITCOUNT': '0.660', 'FRAGCOUNT': '1.500', 'weapon2': '1.636', 'weapon3': '1.844', 'DAMAGECOUNT': '2.277'} [2023-02-24 17:58:25,991][177172] DAMAGECOUNT value on done: 36332.0 [2023-02-24 17:58:25,991][177172] Sum rewards: 6.722, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.316', 'AMMO2': '0.012', 'weapon7': '0.020', 'AMMO5': '0.022', 'ARMOR': '0.056', 'AMMO4': '0.060', 'WEAPON1': '0.090', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.100', 'AMMO3': '0.144', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'HITCOUNT': '0.470', 'weapon2': '0.554', 'weapon4': '0.626', 'WEAPON3': '0.850', 'weapon3': '1.726', 'DAMAGECOUNT': '2.307', 'FRAGCOUNT': '9.000'} [2023-02-24 17:58:26,288][177158] DAMAGECOUNT value on done: 35807.0 [2023-02-24 17:58:26,288][177158] Sum rewards: 7.726, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.470', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.010', 'WEAPON1': '0.060', 'AMMO3': '0.095', 'weapon5': '0.256', 'WEAPON5': '0.300', 'HITCOUNT': '0.580', 'WEAPON3': '0.800', 'weapon2': '1.200', 'weapon3': '2.158', 'DAMAGECOUNT': '2.760', 'FRAGCOUNT': '7.000'} [2023-02-24 17:58:26,291][177172] DAMAGECOUNT value on done: 34251.0 [2023-02-24 17:58:26,291][177172] Sum rewards: 3.826, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.363', 'weapon5': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.015', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'ARMOR': '0.064', 'AMMO4': '0.077', 'weapon4': '0.090', 'AMMO3': '0.106', 'WEAPON5': '0.250', 'HITCOUNT': '0.350', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.272', 'weapon3': '1.718', 'weapon2': '1.780', 'FRAGCOUNT': '3.000'} [2023-02-24 17:58:26,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13912.5). Total num frames: 29802496. Throughput: 0: 3473.3. Samples: 7448718. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:58:26,376][177119] Avg episode reward: [(0, '3.873')] [2023-02-24 17:58:26,406][177140] Saving new best policy, reward=3.873! [2023-02-24 17:58:26,597][177158] DAMAGECOUNT value on done: 38148.0 [2023-02-24 17:58:26,598][177158] Sum rewards: 0.935, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.566', 'AMMO5': '0.015', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'ARMOR': '0.044', 'weapon7': '0.048', 'weapon5': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.112', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'HITCOUNT': '0.290', 'WEAPON5': '0.300', 'weapon4': '0.496', 'WEAPON3': '0.700', 'weapon2': '1.384', 'DAMAGECOUNT': '1.650', 'weapon3': '1.764', 'FRAGCOUNT': '3.000'} [2023-02-24 17:58:26,904][177154] DAMAGECOUNT value on done: 37843.0 [2023-02-24 17:58:26,904][177154] Sum rewards: 2.416, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.648', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.040', 'WEAPON1': '0.040', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'weapon5': '0.134', 'WEAPON5': '0.350', 'HITCOUNT': '0.460', 'WEAPON3': '0.800', 'weapon2': '1.576', 'DAMAGECOUNT': '1.872', 'weapon3': '1.960', 'FRAGCOUNT': '4.000'} [2023-02-24 17:58:27,203][177154] DAMAGECOUNT value on done: 36135.0 [2023-02-24 17:58:27,203][177154] Sum rewards: 2.833, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.638', 'AMMO2': '0.003', 'AMMO5': '0.011', 'AMMO4': '0.013', 'WEAPON1': '0.040', 'AMMO3': '0.089', 'weapon5': '0.170', 'WEAPON5': '0.200', 'WEAPON3': '0.550', 'HITCOUNT': '0.630', 'weapon3': '1.792', 'DAMAGECOUNT': '1.809', 'weapon2': '1.914', 'FRAGCOUNT': '3.000'} [2023-02-24 17:58:27,240][177172] DAMAGECOUNT value on done: 36293.0 [2023-02-24 17:58:27,241][177172] Sum rewards: -0.389, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.933', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'weapon5': '0.096', 'AMMO3': '0.127', 'WEAPON5': '0.350', 'HITCOUNT': '0.440', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.131', 'weapon2': '1.266', 'weapon3': '2.428', 'FRAGCOUNT': '3.000'} [2023-02-24 17:58:27,305][177153] Updated weights for policy 0, policy_version 7280 (0.0009) [2023-02-24 17:58:27,502][177154] DAMAGECOUNT value on done: 37941.0 [2023-02-24 17:58:27,503][177154] Sum rewards: 3.002, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.036', 'AMMO5': '0.013', 'AMMO2': '0.017', 'WEAPON1': '0.070', 'AMMO4': '0.085', 'AMMO3': '0.088', 'weapon5': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'HITCOUNT': '0.470', 'weapon4': '0.528', 'WEAPON3': '0.600', 'weapon2': '1.140', 'weapon3': '1.472', 'DAMAGECOUNT': '2.226', 'FRAGCOUNT': '4.000'} [2023-02-24 17:58:27,543][177172] DAMAGECOUNT value on done: 35023.0 [2023-02-24 17:58:27,544][177172] Sum rewards: 9.687, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.010', 'AMMO2': '0.011', 'ARMOR': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.040', 'AMMO4': '0.053', 'WEAPON5': '0.150', 'weapon7': '0.204', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.250', 'WEAPON4': '0.250', 'HITCOUNT': '0.300', 'WEAPON7': '0.300', 'weapon5': '0.310', 'HEALTH': '0.407', 'weapon2': '0.830', 'weapon4': '0.878', 'weapon3': '1.110', 'DAMAGECOUNT': '1.836', 'FRAGCOUNT': '6.000'} [2023-02-24 17:58:27,663][177171] DAMAGECOUNT value on done: 36130.0 [2023-02-24 17:58:27,664][177171] Sum rewards: 6.095, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.837', 'AMMO5': '0.012', 'AMMO2': '0.019', 'ARMOR': '0.036', 'weapon4': '0.036', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO3': '0.090', 'AMMO4': '0.095', 'weapon5': '0.224', 'WEAPON5': '0.350', 'HITCOUNT': '0.480', 'WEAPON3': '0.650', 'weapon3': '1.504', 'weapon2': '1.936', 'DAMAGECOUNT': '2.379', 'FRAGCOUNT': '5.000'} [2023-02-24 17:58:27,797][177154] DAMAGECOUNT value on done: 35976.0 [2023-02-24 17:58:27,797][177154] Sum rewards: 1.018, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.320', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'weapon5': '0.056', 'AMMO4': '0.099', 'AMMO3': '0.123', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'HITCOUNT': '0.300', 'ARMOR': '0.484', 'WEAPON3': '0.600', 'weapon4': '0.662', 'DAMAGECOUNT': '1.107', 'weapon2': '1.260', 'weapon3': '1.700', 'FRAGCOUNT': '2.000'} [2023-02-24 17:58:27,975][177171] DAMAGECOUNT value on done: 35804.0 [2023-02-24 17:58:27,975][177171] Sum rewards: 5.353, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.634', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.086', 'weapon5': '0.118', 'weapon4': '0.252', 'HITCOUNT': '0.440', 'WEAPON3': '0.650', 'weapon2': '1.642', 'weapon3': '1.834', 'DAMAGECOUNT': '2.049', 'FRAGCOUNT': '4.000'} [2023-02-24 17:58:28,023][177157] DAMAGECOUNT value on done: 37527.0 [2023-02-24 17:58:28,024][177157] Sum rewards: -3.651, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.316', 'AMMO5': '0.019', 'AMMO2': '0.029', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'AMMO3': '0.140', 'AMMO4': '0.146', 'HITCOUNT': '0.160', 'weapon7': '0.174', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'weapon5': '0.344', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.510', 'weapon4': '0.592', 'WEAPON3': '0.800', 'weapon2': '1.108', 'weapon3': '1.462', 'FRAGCOUNT': '2.000'} [2023-02-24 17:58:28,146][177157] DAMAGECOUNT value on done: 38921.0 [2023-02-24 17:58:28,237][177171] DAMAGECOUNT value on done: 35930.0 [2023-02-24 17:58:28,237][177171] Sum rewards: -0.286, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.790', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'weapon7': '0.052', 'weapon5': '0.078', 'AMMO4': '0.084', 'AMMO3': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'HITCOUNT': '0.430', 'weapon4': '0.608', 'WEAPON3': '0.650', 'weapon2': '0.950', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.239', 'weapon3': '1.406'} [2023-02-24 17:58:28,329][177157] DAMAGECOUNT value on done: 37028.0 [2023-02-24 17:58:28,330][177157] Sum rewards: 4.933, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.030', 'AMMO4': '0.039', 'AMMO3': '0.057', 'weapon5': '0.108', 'WEAPON5': '0.150', 'WEAPON3': '0.350', 'HEALTH': '0.460', 'HITCOUNT': '0.470', 'weapon3': '1.028', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.160', 'weapon2': '2.566'} [2023-02-24 17:58:28,448][177157] DAMAGECOUNT value on done: 36430.0 [2023-02-24 17:58:28,449][177157] Sum rewards: 4.834, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.774', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.012', 'weapon4': '0.040', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO3': '0.086', 'weapon5': '0.190', 'HITCOUNT': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'weapon2': '1.636', 'DAMAGECOUNT': '1.680', 'weapon3': '1.808', 'FRAGCOUNT': '4.000'} [2023-02-24 17:58:28,537][177171] DAMAGECOUNT value on done: 36365.0 [2023-02-24 17:58:28,538][177171] Sum rewards: 4.367, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.730', 'AMMO2': '0.014', 'AMMO5': '0.015', 'ARMOR': '0.028', 'WEAPON1': '0.050', 'AMMO4': '0.070', 'AMMO3': '0.089', 'WEAPON4': '0.150', 'weapon5': '0.238', 'weapon4': '0.262', 'HITCOUNT': '0.370', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon3': '1.374', 'DAMAGECOUNT': '1.725', 'weapon2': '1.762', 'FRAGCOUNT': '4.000'} [2023-02-24 17:58:28,697][177155] DAMAGECOUNT value on done: 37844.0 [2023-02-24 17:58:28,697][177155] Sum rewards: 9.970, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.085', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.025', 'WEAPON1': '0.050', 'AMMO3': '0.076', 'weapon5': '0.154', 'WEAPON5': '0.350', 'HITCOUNT': '0.640', 'WEAPON3': '0.650', 'weapon2': '1.716', 'weapon3': '1.900', 'DAMAGECOUNT': '2.748', 'FRAGCOUNT': '8.000'} [2023-02-24 17:58:28,993][177155] DAMAGECOUNT value on done: 39546.0 [2023-02-24 17:58:28,993][177155] Sum rewards: 2.254, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.537', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'ARMOR': '0.052', 'AMMO3': '0.079', 'weapon5': '0.080', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.280', 'HITCOUNT': '0.400', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.584', 'weapon3': '1.668', 'weapon2': '1.740'} [2023-02-24 17:58:29,244][177155] DAMAGECOUNT value on done: 38433.0 [2023-02-24 17:58:29,245][177155] Sum rewards: 6.627, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.650', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO3': '0.050', 'WEAPON1': '0.070', 'AMMO4': '0.094', 'weapon5': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'HITCOUNT': '0.510', 'weapon3': '1.302', 'DAMAGECOUNT': '1.698', 'weapon2': '2.174', 'FRAGCOUNT': '4.000'} [2023-02-24 17:58:29,530][177155] DAMAGECOUNT value on done: 37374.0 [2023-02-24 17:58:29,531][177155] Sum rewards: 6.224, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.664', 'ARMOR': '0.012', 'AMMO5': '0.014', 'AMMO2': '0.022', 'WEAPON1': '0.050', 'AMMO3': '0.087', 'AMMO4': '0.109', 'weapon5': '0.120', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'weapon4': '0.938', 'weapon2': '1.130', 'weapon3': '1.486', 'DAMAGECOUNT': '2.229', 'FRAGCOUNT': '5.000'} [2023-02-24 17:58:30,228][177153] Updated weights for policy 0, policy_version 7290 (0.0008) [2023-02-24 17:58:31,376][177119] Fps is (10 sec: 14336.1, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 29876224. Throughput: 0: 3474.2. Samples: 7469620. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:58:31,376][177119] Avg episode reward: [(0, '4.006')] [2023-02-24 17:58:31,377][177140] Saving new best policy, reward=4.006! [2023-02-24 17:58:33,097][177156] DAMAGECOUNT value on done: 37798.0 [2023-02-24 17:58:33,097][177156] Sum rewards: 6.674, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.452', 'AMMO2': '0.020', 'AMMO5': '0.022', 'AMMO3': '0.092', 'WEAPON1': '0.100', 'AMMO4': '0.101', 'weapon5': '0.310', 'HITCOUNT': '0.370', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'weapon2': '1.540', 'DAMAGECOUNT': '1.800', 'weapon3': '1.870', 'FRAGCOUNT': '5.000'} [2023-02-24 17:58:33,134][177153] Updated weights for policy 0, policy_version 7300 (0.0008) [2023-02-24 17:58:33,382][177156] DAMAGECOUNT value on done: 38405.0 [2023-02-24 17:58:33,383][177156] Sum rewards: -0.050, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.693', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.017', 'WEAPON1': '0.050', 'weapon7': '0.064', 'AMMO4': '0.083', 'AMMO3': '0.091', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.174', 'WEAPON7': '0.200', 'HITCOUNT': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'weapon4': '0.510', 'weapon3': '0.804', 'DAMAGECOUNT': '1.191', 'weapon2': '1.622', 'FRAGCOUNT': '2.000'} [2023-02-24 17:58:33,393][177156] DAMAGECOUNT value on done: 38631.0 [2023-02-24 17:58:33,394][177156] Sum rewards: 6.847, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.012', 'AMMO2': '0.023', 'WEAPON1': '0.050', 'AMMO3': '0.090', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'weapon5': '0.256', 'weapon4': '0.296', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.550', 'HEALTH': '0.587', 'weapon3': '1.398', 'weapon2': '1.738', 'DAMAGECOUNT': '3.081', 'FRAGCOUNT': '6.000'} [2023-02-24 17:58:33,693][177156] DAMAGECOUNT value on done: 39023.0 [2023-02-24 17:58:33,694][177156] Sum rewards: 5.974, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'AMMO3': '0.047', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.157', 'WEAPON4': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.340', 'HEALTH': '0.551', 'weapon4': '0.592', 'weapon3': '0.852', 'DAMAGECOUNT': '1.473', 'FRAGCOUNT': '2.000', 'weapon2': '2.356'} [2023-02-24 17:58:36,075][177153] Updated weights for policy 0, policy_version 7310 (0.0008) [2023-02-24 17:58:36,376][177119] Fps is (10 sec: 14336.0, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 29945856. Throughput: 0: 3476.4. Samples: 7479994. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 17:58:36,376][177119] Avg episode reward: [(0, '4.122')] [2023-02-24 17:58:36,379][177140] Saving new best policy, reward=4.122! [2023-02-24 17:58:39,029][177153] Updated weights for policy 0, policy_version 7320 (0.0009) [2023-02-24 17:58:41,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 30015488. Throughput: 0: 3478.6. Samples: 7500982. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:58:41,376][177119] Avg episode reward: [(0, '4.122')] [2023-02-24 17:58:41,965][177153] Updated weights for policy 0, policy_version 7330 (0.0008) [2023-02-24 17:58:43,743][177170] DAMAGECOUNT value on done: 37857.0 [2023-02-24 17:58:43,743][177170] Sum rewards: 6.267, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.015', 'AMMO2': '0.010', 'ARMOR': '0.040', 'AMMO4': '0.047', 'AMMO3': '0.097', 'WEAPON4': '0.250', 'HITCOUNT': '0.550', 'weapon4': '0.554', 'WEAPON3': '0.600', 'weapon3': '1.348', 'DAMAGECOUNT': '1.758', 'weapon2': '2.028', 'FRAGCOUNT': '6.000'} [2023-02-24 17:58:44,028][177170] DAMAGECOUNT value on done: 33870.0 [2023-02-24 17:58:44,029][177170] Sum rewards: 6.671, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.006', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.030', 'WEAPON1': '0.050', 'weapon7': '0.052', 'weapon5': '0.076', 'AMMO3': '0.089', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.388', 'ARMOR': '0.400', 'HITCOUNT': '0.520', 'WEAPON3': '0.650', 'weapon3': '1.520', 'weapon2': '1.710', 'DAMAGECOUNT': '1.980', 'FRAGCOUNT': '6.000'} [2023-02-24 17:58:44,050][177170] DAMAGECOUNT value on done: 40412.0 [2023-02-24 17:58:44,051][177170] Sum rewards: 4.471, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'HEALTH': '0.051', 'AMMO3': '0.060', 'AMMO4': '0.075', 'weapon5': '0.112', 'WEAPON5': '0.150', 'weapon4': '0.262', 'HITCOUNT': '0.340', 'WEAPON3': '0.400', 'weapon3': '1.376', 'DAMAGECOUNT': '1.938', 'FRAGCOUNT': '2.000', 'weapon2': '2.114'} [2023-02-24 17:58:44,334][177170] DAMAGECOUNT value on done: 39540.0 [2023-02-24 17:58:44,335][177170] Sum rewards: -0.422, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.638', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO3': '0.028', 'WEAPON1': '0.030', 'HITCOUNT': '0.050', 'weapon7': '0.070', 'AMMO4': '0.073', 'weapon3': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.122', 'WEAPON3': '0.150', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.561', 'weapon4': '0.754', 'weapon2': '0.866', 'FRAGCOUNT': '1.000'} [2023-02-24 17:58:44,436][177158] DAMAGECOUNT value on done: 36485.0 [2023-02-24 17:58:44,436][177158] Sum rewards: -1.165, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.540', 'AMMO2': '0.009', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO3': '0.040', 'AMMO4': '0.045', 'WEAPON1': '0.060', 'weapon7': '0.098', 'weapon5': '0.166', 'WEAPON3': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.270', 'WEAPON5': '0.300', 'weapon4': '0.352', 'AMMO6': '0.440', 'AMMO7': '0.440', 'WEAPON7': '0.600', 'weapon3': '0.626', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.146', 'weapon2': '1.608'} [2023-02-24 17:58:44,733][177158] DAMAGECOUNT value on done: 36855.0 [2023-02-24 17:58:44,733][177158] Sum rewards: 5.495, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.954', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO5': '0.015', 'WEAPON4': '0.050', 'weapon5': '0.056', 'WEAPON1': '0.060', 'AMMO3': '0.086', 'weapon4': '0.144', 'WEAPON5': '0.350', 'HITCOUNT': '0.540', 'WEAPON3': '0.700', 'weapon3': '1.742', 'weapon2': '1.816', 'DAMAGECOUNT': '1.917', 'FRAGCOUNT': '5.000'} [2023-02-24 17:58:44,891][177153] Updated weights for policy 0, policy_version 7340 (0.0008) [2023-02-24 17:58:45,281][177172] DAMAGECOUNT value on done: 37149.0 [2023-02-24 17:58:45,282][177172] Sum rewards: 2.811, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.140', 'AMMO2': '0.022', 'AMMO5': '0.027', 'AMMO3': '0.097', 'WEAPON1': '0.100', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'weapon4': '0.348', 'weapon5': '0.478', 'HITCOUNT': '0.490', 'WEAPON3': '0.650', 'WEAPON5': '0.650', 'weapon2': '1.088', 'weapon3': '1.492', 'DAMAGECOUNT': '2.451', 'FRAGCOUNT': '4.000'} [2023-02-24 17:58:45,567][177158] DAMAGECOUNT value on done: 36458.0 [2023-02-24 17:58:45,568][177158] Sum rewards: 6.958, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'ARMOR': '0.060', 'AMMO4': '0.066', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'HEALTH': '0.110', 'weapon5': '0.132', 'WEAPON5': '0.200', 'weapon4': '0.432', 'WEAPON3': '0.450', 'HITCOUNT': '0.570', 'weapon3': '1.272', 'weapon2': '1.504', 'DAMAGECOUNT': '1.953', 'FRAGCOUNT': '6.000'} [2023-02-24 17:58:45,574][177172] DAMAGECOUNT value on done: 35151.0 [2023-02-24 17:58:45,575][177172] Sum rewards: 3.355, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.630', 'AMMO5': '0.016', 'AMMO2': '0.019', 'ARMOR': '0.024', 'WEAPON1': '0.040', 'AMMO4': '0.096', 'AMMO3': '0.097', 'weapon5': '0.132', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'HITCOUNT': '0.490', 'WEAPON3': '0.650', 'weapon4': '0.652', 'weapon2': '1.416', 'weapon3': '1.552', 'DAMAGECOUNT': '2.700', 'FRAGCOUNT': '4.500'} [2023-02-24 17:58:45,869][177158] DAMAGECOUNT value on done: 38508.0 [2023-02-24 17:58:45,869][177158] Sum rewards: 2.057, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.740', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO3': '0.051', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon7': '0.152', 'WEAPON7': '0.200', 'weapon4': '0.266', 'HITCOUNT': '0.310', 'WEAPON3': '0.400', 'DAMAGECOUNT': '1.080', 'weapon3': '1.232', 'weapon2': '1.816', 'FRAGCOUNT': '2.000'} [2023-02-24 17:58:46,125][177154] DAMAGECOUNT value on done: 38634.0 [2023-02-24 17:58:46,125][177154] Sum rewards: 6.725, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.480', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.073', 'AMMO4': '0.154', 'WEAPON4': '0.250', 'ARMOR': '0.416', 'WEAPON3': '0.450', 'weapon4': '0.542', 'HITCOUNT': '0.570', 'weapon3': '0.956', 'weapon2': '2.274', 'DAMAGECOUNT': '2.373', 'FRAGCOUNT': '5.000'} [2023-02-24 17:58:46,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 30085120. Throughput: 0: 3481.1. Samples: 7521932. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:58:46,376][177119] Avg episode reward: [(0, '4.133')] [2023-02-24 17:58:46,380][177140] Saving new best policy, reward=4.133! [2023-02-24 17:58:46,449][177154] DAMAGECOUNT value on done: 36687.0 [2023-02-24 17:58:46,450][177154] Sum rewards: 5.455, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.135', 'AMMO5': '0.015', 'AMMO2': '0.022', 'weapon7': '0.056', 'WEAPON1': '0.060', 'AMMO3': '0.065', 'WEAPON4': '0.100', 'AMMO4': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.250', 'weapon5': '0.268', 'WEAPON5': '0.350', 'HITCOUNT': '0.400', 'WEAPON3': '0.400', 'weapon3': '1.426', 'weapon2': '1.474', 'DAMAGECOUNT': '1.656', 'FRAGCOUNT': '3.000'} [2023-02-24 17:58:46,533][177172] DAMAGECOUNT value on done: 37068.0 [2023-02-24 17:58:46,534][177172] Sum rewards: 5.705, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.016', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.078', 'AMMO3': '0.079', 'weapon4': '0.086', 'weapon5': '0.246', 'HITCOUNT': '0.320', 'HEALTH': '0.320', 'WEAPON3': '0.350', 'WEAPON5': '0.400', 'weapon3': '1.388', 'weapon2': '1.970', 'DAMAGECOUNT': '2.325', 'FRAGCOUNT': '4.000'} [2023-02-24 17:58:46,751][177154] DAMAGECOUNT value on done: 38081.0 [2023-02-24 17:58:46,837][177172] DAMAGECOUNT value on done: 35985.0 [2023-02-24 17:58:46,838][177172] Sum rewards: 8.723, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.610', 'AMMO5': '0.012', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'AMMO3': '0.084', 'AMMO4': '0.118', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon5': '0.366', 'weapon4': '0.464', 'WEAPON3': '0.550', 'HITCOUNT': '0.590', 'weapon3': '1.192', 'weapon2': '1.456', 'DAMAGECOUNT': '2.886', 'FRAGCOUNT': '7.000'} [2023-02-24 17:58:46,923][177171] DAMAGECOUNT value on done: 37039.0 [2023-02-24 17:58:46,923][177171] Sum rewards: 5.307, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.271', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO5': '0.028', 'ARMOR': '0.040', 'WEAPON1': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'weapon4': '0.236', 'weapon5': '0.238', 'WEAPON5': '0.600', 'weapon2': '0.630', 'HITCOUNT': '0.680', 'WEAPON3': '0.850', 'weapon3': '2.218', 'DAMAGECOUNT': '2.727', 'FRAGCOUNT': '5.500'} [2023-02-24 17:58:47,055][177154] DAMAGECOUNT value on done: 36642.0 [2023-02-24 17:58:47,055][177154] Sum rewards: 7.047, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.880', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'ARMOR': '0.004', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.172', 'weapon4': '0.182', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'HITCOUNT': '0.420', 'WEAPON3': '0.500', 'weapon3': '0.930', 'DAMAGECOUNT': '1.998', 'weapon2': '2.160', 'FRAGCOUNT': '5.000'} [2023-02-24 17:58:47,231][177171] DAMAGECOUNT value on done: 36238.0 [2023-02-24 17:58:47,231][177171] Sum rewards: -0.055, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.140', 'AMMO5': '0.005', 'AMMO2': '0.007', 'WEAPON1': '0.030', 'AMMO4': '0.036', 'AMMO3': '0.065', 'weapon5': '0.102', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.334', 'HITCOUNT': '0.450', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.302', 'weapon3': '1.398', 'weapon2': '1.906', 'FRAGCOUNT': '3.000'} [2023-02-24 17:58:47,269][177157] DAMAGECOUNT value on done: 37997.0 [2023-02-24 17:58:47,269][177157] Sum rewards: 4.433, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.098', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.031', 'AMMO3': '0.040', 'weapon7': '0.062', 'WEAPON4': '0.100', 'weapon5': '0.128', 'HITCOUNT': '0.190', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.250', 'weapon4': '0.252', 'WEAPON7': '0.300', 'weapon3': '0.904', 'weapon2': '1.190', 'DAMAGECOUNT': '1.410', 'FRAGCOUNT': '2.000'} [2023-02-24 17:58:47,392][177157] DAMAGECOUNT value on done: 39341.0 [2023-02-24 17:58:47,469][177171] DAMAGECOUNT value on done: 36538.0 [2023-02-24 17:58:47,470][177171] Sum rewards: 7.519, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.536', 'AMMO5': '0.009', 'ARMOR': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'AMMO3': '0.067', 'AMMO4': '0.081', 'weapon5': '0.106', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.400', 'weapon4': '0.420', 'WEAPON3': '0.500', 'weapon3': '1.164', 'DAMAGECOUNT': '1.824', 'weapon2': '2.018', 'FRAGCOUNT': '7.000'} [2023-02-24 17:58:47,565][177157] DAMAGECOUNT value on done: 37419.0 [2023-02-24 17:58:47,565][177157] Sum rewards: 1.834, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.012', 'AMMO2': '0.007', 'AMMO4': '0.037', 'weapon7': '0.050', 'ARMOR': '0.056', 'AMMO3': '0.065', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.310', 'WEAPON4': '0.450', 'WEAPON3': '0.550', 'weapon4': '0.762', 'weapon3': '1.104', 'DAMAGECOUNT': '1.173', 'weapon2': '1.592', 'FRAGCOUNT': '4.000'} [2023-02-24 17:58:47,702][177157] DAMAGECOUNT value on done: 36766.0 [2023-02-24 17:58:47,703][177157] Sum rewards: 5.115, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.286', 'AMMO5': '0.010', 'weapon4': '0.024', 'AMMO2': '0.024', 'AMMO3': '0.040', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.120', 'weapon5': '0.200', 'HITCOUNT': '0.230', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'DAMAGECOUNT': '1.008', 'weapon3': '1.012', 'weapon2': '1.842', 'FRAGCOUNT': '4.000'} [2023-02-24 17:58:47,771][177171] DAMAGECOUNT value on done: 37105.0 [2023-02-24 17:58:47,771][177171] Sum rewards: 3.346, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.276', 'AMMO2': '0.015', 'AMMO5': '0.017', 'ARMOR': '0.024', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.075', 'weapon5': '0.082', 'AMMO3': '0.126', 'weapon4': '0.194', 'WEAPON5': '0.350', 'HITCOUNT': '0.520', 'WEAPON3': '0.750', 'weapon3': '1.482', 'weapon2': '1.666', 'DAMAGECOUNT': '2.220', 'FRAGCOUNT': '5.000'} [2023-02-24 17:58:47,903][177153] Updated weights for policy 0, policy_version 7350 (0.0008) [2023-02-24 17:58:47,987][177155] DAMAGECOUNT value on done: 38118.0 [2023-02-24 17:58:47,987][177155] Sum rewards: -1.029, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.982', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'AMMO3': '0.091', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'weapon5': '0.156', 'WEAPON5': '0.200', 'HITCOUNT': '0.270', 'weapon4': '0.336', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.500', 'ARMOR': '0.619', 'weapon2': '0.816', 'DAMAGECOUNT': '0.822', 'weapon3': '1.346'} [2023-02-24 17:58:48,284][177155] DAMAGECOUNT value on done: 40315.0 [2023-02-24 17:58:48,284][177155] Sum rewards: 1.145, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.012', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.030', 'WEAPON1': '0.050', 'AMMO3': '0.090', 'AMMO4': '0.150', 'weapon5': '0.284', 'WEAPON4': '0.300', 'weapon4': '0.394', 'WEAPON5': '0.500', 'HITCOUNT': '0.500', 'WEAPON3': '0.550', 'weapon3': '1.186', 'weapon2': '1.790', 'DAMAGECOUNT': '2.307', 'FRAGCOUNT': '3.000'} [2023-02-24 17:58:48,535][177155] DAMAGECOUNT value on done: 39240.0 [2023-02-24 17:58:48,535][177155] Sum rewards: 5.071, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.410', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.040', 'ARMOR': '0.040', 'AMMO4': '0.061', 'AMMO3': '0.090', 'weapon5': '0.174', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.400', 'weapon4': '0.508', 'WEAPON3': '0.550', 'weapon2': '1.204', 'weapon3': '1.520', 'DAMAGECOUNT': '2.421', 'FRAGCOUNT': '4.000'} [2023-02-24 17:58:48,824][177155] DAMAGECOUNT value on done: 38026.0 [2023-02-24 17:58:48,824][177155] Sum rewards: 6.650, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.147', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'weapon5': '0.128', 'weapon4': '0.144', 'WEAPON5': '0.150', 'HITCOUNT': '0.340', 'WEAPON3': '0.400', 'weapon3': '1.078', 'DAMAGECOUNT': '1.956', 'weapon2': '2.080', 'FRAGCOUNT': '4.000'} [2023-02-24 17:58:50,841][177153] Updated weights for policy 0, policy_version 7360 (0.0008) [2023-02-24 17:58:51,376][177119] Fps is (10 sec: 13516.6, 60 sec: 13858.1, 300 sec: 13912.5). Total num frames: 30150656. Throughput: 0: 3478.3. Samples: 7532304. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 17:58:51,377][177119] Avg episode reward: [(0, '4.051')] [2023-02-24 17:58:52,378][177156] DAMAGECOUNT value on done: 38303.0 [2023-02-24 17:58:52,379][177156] Sum rewards: 2.635, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.380', 'AMMO2': '0.009', 'ARMOR': '0.015', 'AMMO4': '0.044', 'AMMO3': '0.086', 'weapon4': '0.140', 'WEAPON4': '0.200', 'HITCOUNT': '0.430', 'WEAPON3': '0.550', 'weapon3': '1.302', 'DAMAGECOUNT': '1.515', 'FRAGCOUNT': '2.000', 'weapon2': '2.224'} [2023-02-24 17:58:52,673][177156] DAMAGECOUNT value on done: 38957.0 [2023-02-24 17:58:52,673][177156] Sum rewards: 3.344, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.640', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'AMMO4': '0.057', 'weapon5': '0.084', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'HITCOUNT': '0.470', 'weapon4': '0.612', 'WEAPON3': '0.700', 'weapon3': '1.364', 'weapon2': '1.520', 'DAMAGECOUNT': '1.656', 'FRAGCOUNT': '4.000'} [2023-02-24 17:58:52,683][177156] DAMAGECOUNT value on done: 38834.0 [2023-02-24 17:58:52,988][177156] DAMAGECOUNT value on done: 39353.0 [2023-02-24 17:58:52,988][177156] Sum rewards: 2.251, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'ARMOR': '0.028', 'AMMO3': '0.050', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.110', 'AMMO4': '0.136', 'HITCOUNT': '0.270', 'weapon4': '0.282', 'WEAPON3': '0.300', 'HEALTH': '0.397', 'weapon3': '0.898', 'DAMAGECOUNT': '0.960', 'weapon2': '2.318', 'FRAGCOUNT': '3.000'} [2023-02-24 17:58:53,780][177153] Updated weights for policy 0, policy_version 7370 (0.0008) [2023-02-24 17:58:56,376][177119] Fps is (10 sec: 13517.0, 60 sec: 13858.1, 300 sec: 13912.5). Total num frames: 30220288. Throughput: 0: 3483.7. Samples: 7553222. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:58:56,376][177119] Avg episode reward: [(0, '4.049')] [2023-02-24 17:58:56,403][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000007379_30224384.pth... [2023-02-24 17:58:56,460][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000006563_26882048.pth [2023-02-24 17:58:56,702][177153] Updated weights for policy 0, policy_version 7380 (0.0008) [2023-02-24 17:58:59,653][177153] Updated weights for policy 0, policy_version 7390 (0.0009) [2023-02-24 17:59:01,376][177119] Fps is (10 sec: 13926.2, 60 sec: 13858.1, 300 sec: 13912.5). Total num frames: 30289920. Throughput: 0: 3482.8. Samples: 7574102. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 17:59:01,377][177119] Avg episode reward: [(0, '4.049')] [2023-02-24 17:59:02,592][177153] Updated weights for policy 0, policy_version 7400 (0.0008) [2023-02-24 17:59:03,058][177170] DAMAGECOUNT value on done: 38336.0 [2023-02-24 17:59:03,058][177170] Sum rewards: 6.342, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.220', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.050', 'WEAPON1': '0.060', 'weapon5': '0.196', 'WEAPON5': '0.300', 'HITCOUNT': '0.340', 'WEAPON3': '0.500', 'weapon3': '1.268', 'DAMAGECOUNT': '1.437', 'weapon2': '2.344', 'FRAGCOUNT': '4.000'} [2023-02-24 17:59:03,360][177170] DAMAGECOUNT value on done: 41199.0 [2023-02-24 17:59:03,361][177170] Sum rewards: 2.381, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.460', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon4': '0.026', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.098', 'AMMO3': '0.099', 'weapon5': '0.144', 'WEAPON5': '0.300', 'HITCOUNT': '0.500', 'WEAPON3': '0.700', 'weapon2': '1.594', 'weapon3': '1.876', 'DAMAGECOUNT': '2.361', 'FRAGCOUNT': '2.500'} [2023-02-24 17:59:03,374][177170] DAMAGECOUNT value on done: 34402.0 [2023-02-24 17:59:03,375][177170] Sum rewards: -0.039, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.776', 'ARMOR': '0.012', 'AMMO5': '0.019', 'AMMO2': '0.022', 'WEAPON1': '0.070', 'AMMO4': '0.108', 'AMMO3': '0.130', 'weapon5': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.166', 'WEAPON5': '0.350', 'HITCOUNT': '0.440', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.596', 'weapon2': '1.652', 'weapon3': '1.792', 'FRAGCOUNT': '4.000'} [2023-02-24 17:59:03,681][177170] DAMAGECOUNT value on done: 40210.0 [2023-02-24 17:59:03,682][177170] Sum rewards: 0.784, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.160', 'ARMOR': '0.004', 'AMMO2': '0.017', 'AMMO5': '0.023', 'AMMO4': '0.086', 'WEAPON1': '0.090', 'weapon5': '0.096', 'WEAPON4': '0.100', 'weapon7': '0.112', 'AMMO3': '0.152', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.426', 'WEAPON5': '0.450', 'HITCOUNT': '0.540', 'WEAPON3': '0.950', 'weapon2': '1.102', 'weapon3': '1.686', 'DAMAGECOUNT': '2.010', 'FRAGCOUNT': '4.000'} [2023-02-24 17:59:03,742][177158] DAMAGECOUNT value on done: 37197.0 [2023-02-24 17:59:03,742][177158] Sum rewards: 2.825, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.670', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.031', 'weapon7': '0.056', 'AMMO3': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.134', 'AMMO4': '0.154', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.450', 'WEAPON4': '0.450', 'WEAPON3': '0.500', 'weapon2': '0.698', 'weapon4': '0.918', 'weapon3': '1.148', 'DAMAGECOUNT': '2.136', 'FRAGCOUNT': '5.000'} [2023-02-24 17:59:04,034][177158] DAMAGECOUNT value on done: 37078.0 [2023-02-24 17:59:04,035][177158] Sum rewards: 3.203, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.140', 'AMMO4': '-0.043', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.020', 'AMMO3': '0.065', 'ARMOR': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.180', 'weapon4': '0.202', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.669', 'weapon3': '0.854', 'weapon2': '2.340', 'FRAGCOUNT': '3.000'} [2023-02-24 17:59:04,539][177154] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 17:59:04,578][177172] DAMAGECOUNT value on done: 37373.0 [2023-02-24 17:59:04,578][177172] Sum rewards: -1.437, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.170', 'AMMO5': '0.020', 'AMMO2': '0.024', 'WEAPON1': '0.060', 'AMMO3': '0.103', 'weapon5': '0.110', 'AMMO4': '0.122', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.210', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'ARMOR': '0.424', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.672', 'weapon4': '0.864', 'weapon2': '1.100', 'weapon3': '1.374', 'FRAGCOUNT': '2.000'} [2023-02-24 17:59:04,872][177158] DAMAGECOUNT value on done: 36703.0 [2023-02-24 17:59:04,873][177158] Sum rewards: 1.644, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.840', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'AMMO4': '0.071', 'AMMO3': '0.080', 'HITCOUNT': '0.150', 'weapon4': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.282', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.735', 'weapon2': '1.200', 'weapon3': '1.406', 'FRAGCOUNT': '2.500'} [2023-02-24 17:59:04,875][177172] DAMAGECOUNT value on done: 35834.0 [2023-02-24 17:59:04,875][177172] Sum rewards: 2.011, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.750', 'AMMO5': '0.018', 'AMMO2': '0.019', 'weapon4': '0.068', 'WEAPON1': '0.090', 'AMMO4': '0.096', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.222', 'HITCOUNT': '0.440', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon2': '1.600', 'weapon3': '1.708', 'DAMAGECOUNT': '2.049', 'FRAGCOUNT': '5.000'} [2023-02-24 17:59:05,174][177158] DAMAGECOUNT value on done: 39002.0 [2023-02-24 17:59:05,175][177158] Sum rewards: 7.047, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'ARMOR': '0.076', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO4': '0.176', 'WEAPON4': '0.200', 'weapon4': '0.326', 'HITCOUNT': '0.420', 'WEAPON3': '0.450', 'HEALTH': '0.753', 'DAMAGECOUNT': '1.482', 'weapon3': '1.530', 'weapon2': '1.532', 'FRAGCOUNT': '5.000'} [2023-02-24 17:59:05,466][177154] DAMAGECOUNT value on done: 38949.0 [2023-02-24 17:59:05,467][177154] Sum rewards: 2.087, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.251', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'ARMOR': '0.032', 'AMMO3': '0.065', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'HITCOUNT': '0.220', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'weapon4': '0.616', 'DAMAGECOUNT': '0.945', 'weapon3': '1.068', 'weapon2': '1.600', 'FRAGCOUNT': '2.000'} [2023-02-24 17:59:05,560][177153] Updated weights for policy 0, policy_version 7410 (0.0008) [2023-02-24 17:59:05,758][177154] DAMAGECOUNT value on done: 37507.0 [2023-02-24 17:59:05,758][177154] Sum rewards: 4.953, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.120', 'AMMO5': '0.019', 'AMMO2': '0.036', 'WEAPON1': '0.080', 'AMMO3': '0.098', 'AMMO4': '0.180', 'WEAPON4': '0.250', 'weapon5': '0.268', 'weapon4': '0.318', 'ARMOR': '0.436', 'HITCOUNT': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'weapon2': '1.392', 'weapon3': '1.586', 'DAMAGECOUNT': '2.460', 'FRAGCOUNT': '7.000'} [2023-02-24 17:59:05,837][177172] DAMAGECOUNT value on done: 37343.0 [2023-02-24 17:59:05,837][177172] Sum rewards: -0.982, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.678', 'AMMO5': '0.009', 'weapon5': '0.022', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO3': '0.081', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.250', 'weapon4': '0.320', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.825', 'weapon3': '1.012', 'weapon2': '1.506', 'FRAGCOUNT': '2.000'} [2023-02-24 17:59:06,052][177154] DAMAGECOUNT value on done: 38546.0 [2023-02-24 17:59:06,053][177154] Sum rewards: 4.458, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.850', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon7': '0.016', 'WEAPON1': '0.040', 'weapon5': '0.074', 'AMMO4': '0.075', 'AMMO3': '0.078', 'weapon4': '0.198', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.440', 'WEAPON3': '0.550', 'weapon3': '1.046', 'DAMAGECOUNT': '1.395', 'weapon2': '2.374', 'FRAGCOUNT': '5.000'} [2023-02-24 17:59:06,137][177172] DAMAGECOUNT value on done: 36324.0 [2023-02-24 17:59:06,137][177172] Sum rewards: 0.651, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.110', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.018', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.089', 'weapon5': '0.090', 'WEAPON5': '0.150', 'weapon4': '0.212', 'HITCOUNT': '0.310', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.017', 'weapon2': '1.354', 'weapon3': '1.512', 'FRAGCOUNT': '3.000'} [2023-02-24 17:59:06,353][177154] DAMAGECOUNT value on done: 37742.0 [2023-02-24 17:59:06,353][177171] DAMAGECOUNT value on done: 37452.0 [2023-02-24 17:59:06,354][177154] Sum rewards: 5.456, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.195', 'AMMO2': '0.003', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.016', 'weapon4': '0.038', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon7': '0.052', 'AMMO3': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.166', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.540', 'WEAPON3': '0.750', 'weapon3': '1.470', 'weapon2': '1.824', 'DAMAGECOUNT': '3.180', 'FRAGCOUNT': '6.000'} [2023-02-24 17:59:06,354][177171] Sum rewards: -2.224, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.618', 'ARMOR': '0.016', 'AMMO2': '0.017', 'AMMO5': '0.018', 'WEAPON1': '0.050', 'AMMO4': '0.083', 'weapon5': '0.108', 'AMMO3': '0.117', 'WEAPON4': '0.200', 'weapon4': '0.294', 'HITCOUNT': '0.310', 'WEAPON5': '0.350', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.239', 'weapon2': '1.500', 'weapon3': '1.892'} [2023-02-24 17:59:06,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13912.5). Total num frames: 30359552. Throughput: 0: 3482.3. Samples: 7584480. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 17:59:06,376][177119] Avg episode reward: [(0, '3.597')] [2023-02-24 17:59:06,583][177157] DAMAGECOUNT value on done: 38917.0 [2023-02-24 17:59:06,583][177157] Sum rewards: 6.889, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.180', 'AMMO5': '0.012', 'AMMO2': '0.034', 'ARMOR': '0.036', 'WEAPON1': '0.050', 'weapon7': '0.052', 'weapon5': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.105', 'AMMO4': '0.171', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.502', 'HITCOUNT': '0.610', 'WEAPON3': '0.700', 'weapon3': '1.378', 'weapon2': '1.488', 'DAMAGECOUNT': '2.760', 'FRAGCOUNT': '9.000'} [2023-02-24 17:59:06,660][177171] DAMAGECOUNT value on done: 37332.0 [2023-02-24 17:59:06,660][177171] Sum rewards: 7.098, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.972', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO2': '0.033', 'weapon5': '0.046', 'AMMO3': '0.136', 'AMMO4': '0.167', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.456', 'WEAPON3': '0.850', 'HITCOUNT': '0.900', 'weapon2': '1.214', 'weapon3': '1.984', 'DAMAGECOUNT': '3.282', 'FRAGCOUNT': '7.000'} [2023-02-24 17:59:06,695][177157] DAMAGECOUNT value on done: 39730.0 [2023-02-24 17:59:06,696][177157] Sum rewards: 1.679, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.579', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.027', 'WEAPON1': '0.050', 'AMMO3': '0.052', 'weapon5': '0.132', 'HITCOUNT': '0.230', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'FRAGCOUNT': '1.000', 'weapon3': '1.034', 'DAMAGECOUNT': '1.167', 'weapon2': '2.348'} [2023-02-24 17:59:06,881][177171] DAMAGECOUNT value on done: 37528.0 [2023-02-24 17:59:06,882][177171] Sum rewards: 10.787, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.088', 'AMMO5': '0.012', 'AMMO2': '0.014', 'WEAPON1': '0.040', 'ARMOR': '0.044', 'AMMO4': '0.067', 'AMMO3': '0.097', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.264', 'HITCOUNT': '0.580', 'WEAPON3': '0.600', 'weapon2': '1.306', 'weapon3': '1.792', 'DAMAGECOUNT': '2.970', 'FRAGCOUNT': '10.000'} [2023-02-24 17:59:06,889][177157] DAMAGECOUNT value on done: 38155.0 [2023-02-24 17:59:06,889][177157] Sum rewards: 0.831, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.479', 'AMMO5': '0.015', 'AMMO2': '0.022', 'weapon5': '0.026', 'WEAPON1': '0.060', 'weapon4': '0.096', 'AMMO4': '0.108', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'HITCOUNT': '0.670', 'WEAPON3': '0.950', 'weapon2': '1.708', 'weapon3': '1.874', 'DAMAGECOUNT': '2.208', 'FRAGCOUNT': '4.000'} [2023-02-24 17:59:07,006][177157] DAMAGECOUNT value on done: 36914.0 [2023-02-24 17:59:07,007][177157] Sum rewards: -0.439, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.406', 'AMMO2': '0.006', 'AMMO5': '0.022', 'AMMO4': '0.028', 'weapon7': '0.056', 'weapon5': '0.072', 'WEAPON1': '0.080', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.130', 'WEAPON7': '0.200', 'weapon4': '0.302', 'DAMAGECOUNT': '0.444', 'weapon2': '0.488', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon3': '0.850', 'FRAGCOUNT': '2.000'} [2023-02-24 17:59:07,188][177171] DAMAGECOUNT value on done: 37870.0 [2023-02-24 17:59:07,188][177171] Sum rewards: 3.538, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.709', 'AMMO2': '0.005', 'AMMO5': '0.017', 'AMMO4': '0.023', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.092', 'weapon5': '0.104', 'weapon4': '0.288', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.700', 'weapon2': '1.262', 'weapon3': '1.762', 'DAMAGECOUNT': '2.295', 'FRAGCOUNT': '3.000'} [2023-02-24 17:59:07,267][177155] DAMAGECOUNT value on done: 38838.0 [2023-02-24 17:59:07,267][177155] Sum rewards: 4.587, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.301', 'ARMOR': '0.008', 'AMMO5': '0.025', 'AMMO2': '0.029', 'AMMO3': '0.091', 'WEAPON1': '0.120', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'weapon5': '0.234', 'HITCOUNT': '0.400', 'weapon4': '0.404', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'weapon2': '0.738', 'weapon3': '1.782', 'DAMAGECOUNT': '2.160', 'FRAGCOUNT': '5.000'} [2023-02-24 17:59:07,550][177155] DAMAGECOUNT value on done: 40883.0 [2023-02-24 17:59:07,550][177155] Sum rewards: 3.907, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.055', 'AMMO2': '0.016', 'AMMO5': '0.021', 'ARMOR': '0.036', 'weapon7': '0.052', 'AMMO4': '0.078', 'WEAPON1': '0.090', 'AMMO3': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.246', 'WEAPON4': '0.250', 'HITCOUNT': '0.430', 'WEAPON5': '0.450', 'weapon4': '0.618', 'weapon2': '0.678', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.704', 'weapon3': '1.934', 'FRAGCOUNT': '6.000'} [2023-02-24 17:59:07,792][177155] DAMAGECOUNT value on done: 39984.0 [2023-02-24 17:59:07,793][177155] Sum rewards: 7.826, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.876', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'ARMOR': '0.040', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.078', 'weapon7': '0.094', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'WEAPON7': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.540', 'weapon4': '0.578', 'weapon2': '1.210', 'weapon3': '1.322', 'DAMAGECOUNT': '2.232', 'FRAGCOUNT': '6.000'} [2023-02-24 17:59:08,092][177155] DAMAGECOUNT value on done: 38916.0 [2023-02-24 17:59:08,093][177155] Sum rewards: 3.492, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.717', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.056', 'AMMO4': '0.058', 'AMMO3': '0.075', 'weapon7': '0.088', 'WEAPON5': '0.100', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'HITCOUNT': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.396', 'WEAPON3': '0.450', 'weapon3': '1.278', 'DAMAGECOUNT': '1.485', 'weapon2': '1.638', 'FRAGCOUNT': '4.000'} [2023-02-24 17:59:08,514][177153] Updated weights for policy 0, policy_version 7420 (0.0008) [2023-02-24 17:59:08,530][177157] Large shaping reward 2.538 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.582, 194.0), ('HEALTH', -0.066, -22.0), ('weapon5', 0.002)] [2023-02-24 17:59:11,376][177119] Fps is (10 sec: 13926.8, 60 sec: 13926.4, 300 sec: 13912.5). Total num frames: 30429184. Throughput: 0: 3482.1. Samples: 7605410. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 17:59:11,376][177119] Avg episode reward: [(0, '3.663')] [2023-02-24 17:59:11,431][177153] Updated weights for policy 0, policy_version 7430 (0.0008) [2023-02-24 17:59:11,734][177156] DAMAGECOUNT value on done: 38975.0 [2023-02-24 17:59:11,734][177156] Sum rewards: 2.555, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.393', 'AMMO5': '0.012', 'AMMO2': '0.033', 'WEAPON1': '0.050', 'weapon5': '0.086', 'AMMO3': '0.120', 'AMMO4': '0.164', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'HITCOUNT': '0.450', 'ARMOR': '0.475', 'weapon4': '0.560', 'WEAPON3': '0.700', 'weapon2': '1.062', 'weapon3': '1.320', 'DAMAGECOUNT': '2.016', 'FRAGCOUNT': '5.000'} [2023-02-24 17:59:12,039][177156] DAMAGECOUNT value on done: 39497.0 [2023-02-24 17:59:12,039][177156] Sum rewards: 0.949, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.243', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'ARMOR': '0.004', 'AMMO5': '0.012', 'WEAPON1': '0.050', 'weapon7': '0.088', 'WEAPON4': '0.100', 'weapon5': '0.108', 'AMMO3': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.260', 'WEAPON5': '0.300', 'HITCOUNT': '0.470', 'WEAPON3': '0.800', 'weapon2': '1.184', 'weapon3': '1.402', 'DAMAGECOUNT': '1.620', 'FRAGCOUNT': '2.000'} [2023-02-24 17:59:12,049][177156] DAMAGECOUNT value on done: 39757.0 [2023-02-24 17:59:12,049][177156] Sum rewards: 10.576, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.060', 'AMMO3': '0.070', 'HEALTH': '0.080', 'WEAPON5': '0.200', 'weapon5': '0.294', 'WEAPON3': '0.450', 'HITCOUNT': '0.590', 'weapon2': '1.720', 'weapon3': '1.790', 'DAMAGECOUNT': '2.769', 'FRAGCOUNT': '7.000'} [2023-02-24 17:59:12,344][177156] DAMAGECOUNT value on done: 39989.0 [2023-02-24 17:59:12,345][177156] Sum rewards: 8.434, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.761', 'AMMO2': '0.005', 'AMMO5': '0.006', 'AMMO4': '0.024', 'WEAPON1': '0.040', 'weapon5': '0.064', 'AMMO3': '0.084', 'WEAPON5': '0.150', 'HITCOUNT': '0.590', 'WEAPON3': '0.650', 'weapon3': '1.672', 'DAMAGECOUNT': '1.908', 'weapon2': '2.002', 'FRAGCOUNT': '8.000'} [2023-02-24 17:59:14,367][177153] Updated weights for policy 0, policy_version 7440 (0.0008) [2023-02-24 17:59:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13912.5). Total num frames: 30498816. Throughput: 0: 3483.0. Samples: 7626354. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:59:16,376][177119] Avg episode reward: [(0, '3.697')] [2023-02-24 17:59:17,299][177153] Updated weights for policy 0, policy_version 7450 (0.0009) [2023-02-24 17:59:20,202][177153] Updated weights for policy 0, policy_version 7460 (0.0008) [2023-02-24 17:59:21,376][177119] Fps is (10 sec: 14336.0, 60 sec: 13994.7, 300 sec: 13926.4). Total num frames: 30572544. Throughput: 0: 3485.4. Samples: 7636836. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:59:21,376][177119] Avg episode reward: [(0, '3.697')] [2023-02-24 17:59:22,360][177170] DAMAGECOUNT value on done: 39101.0 [2023-02-24 17:59:22,361][177170] Sum rewards: 9.401, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.295', 'AMMO5': '0.010', 'weapon4': '0.022', 'AMMO2': '0.025', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.052', 'AMMO3': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.126', 'weapon5': '0.154', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'HITCOUNT': '0.520', 'weapon3': '1.518', 'weapon2': '1.974', 'DAMAGECOUNT': '2.295', 'FRAGCOUNT': '7.000'} [2023-02-24 17:59:22,590][177170] DAMAGECOUNT value on done: 34884.0 [2023-02-24 17:59:22,590][177170] Sum rewards: 0.994, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.318', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'weapon5': '0.074', 'AMMO3': '0.077', 'WEAPON4': '0.150', 'ARMOR': '0.412', 'HITCOUNT': '0.420', 'WEAPON3': '0.500', 'weapon4': '0.556', 'weapon3': '1.156', 'DAMAGECOUNT': '1.446', 'weapon2': '1.876', 'FRAGCOUNT': '2.000'} [2023-02-24 17:59:22,666][177170] DAMAGECOUNT value on done: 41734.0 [2023-02-24 17:59:22,666][177170] Sum rewards: 3.532, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.544', 'AMMO5': '0.021', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'weapon4': '0.072', 'WEAPON1': '0.080', 'AMMO3': '0.103', 'AMMO4': '0.110', 'weapon5': '0.202', 'WEAPON5': '0.450', 'HITCOUNT': '0.500', 'WEAPON3': '0.700', 'weapon2': '1.450', 'DAMAGECOUNT': '1.605', 'weapon3': '1.960', 'FRAGCOUNT': '3.500'} [2023-02-24 17:59:22,888][177170] DAMAGECOUNT value on done: 41015.0 [2023-02-24 17:59:22,889][177170] Sum rewards: 3.631, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.421', 'AMMO2': '0.014', 'weapon5': '0.014', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.068', 'AMMO3': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.510', 'HITCOUNT': '0.760', 'WEAPON3': '1.100', 'weapon2': '1.244', 'weapon3': '1.904', 'DAMAGECOUNT': '2.415', 'FRAGCOUNT': '7.000'} [2023-02-24 17:59:22,903][177158] DAMAGECOUNT value on done: 37381.0 [2023-02-24 17:59:23,152][177153] Updated weights for policy 0, policy_version 7470 (0.0008) [2023-02-24 17:59:23,196][177158] DAMAGECOUNT value on done: 37510.0 [2023-02-24 17:59:23,197][177158] Sum rewards: 4.081, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.845', 'AMMO5': '0.003', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.040', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'weapon7': '0.160', 'HITCOUNT': '0.200', 'WEAPON3': '0.300', 'WEAPON4': '0.450', 'AMMO6': '0.500', 'AMMO7': '0.500', 'weapon2': '0.540', 'WEAPON7': '0.700', 'weapon3': '0.720', 'DAMAGECOUNT': '1.296', 'weapon4': '1.428', 'FRAGCOUNT': '3.000'} [2023-02-24 17:59:23,795][177172] DAMAGECOUNT value on done: 38136.0 [2023-02-24 17:59:23,796][177172] Sum rewards: 5.257, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.850', 'AMMO5': '0.017', 'AMMO2': '0.027', 'WEAPON1': '0.050', 'AMMO3': '0.102', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'weapon5': '0.170', 'weapon4': '0.396', 'WEAPON5': '0.400', 'HITCOUNT': '0.450', 'WEAPON3': '0.700', 'ARMOR': '0.855', 'weapon2': '1.458', 'weapon3': '1.656', 'DAMAGECOUNT': '2.289', 'FRAGCOUNT': '7.000'} [2023-02-24 17:59:24,054][177158] DAMAGECOUNT value on done: 36858.0 [2023-02-24 17:59:24,054][177158] Sum rewards: -0.466, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.536', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO3': '0.034', 'AMMO4': '0.035', 'WEAPON5': '0.050', 'weapon7': '0.054', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.130', 'weapon2': '0.142', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.465', 'weapon3': '0.470', 'weapon4': '0.530', 'FRAGCOUNT': '1.000'} [2023-02-24 17:59:24,089][177172] DAMAGECOUNT value on done: 36934.0 [2023-02-24 17:59:24,089][177172] Sum rewards: 4.827, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.846', 'AMMO5': '0.017', 'AMMO2': '0.028', 'WEAPON1': '0.070', 'AMMO3': '0.096', 'AMMO4': '0.139', 'WEAPON4': '0.200', 'weapon5': '0.370', 'weapon4': '0.376', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '0.630', 'weapon2': '1.378', 'weapon3': '1.522', 'DAMAGECOUNT': '3.297', 'FRAGCOUNT': '7.000'} [2023-02-24 17:59:24,344][177158] DAMAGECOUNT value on done: 40012.0 [2023-02-24 17:59:24,345][177158] Sum rewards: 5.657, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.596', 'AMMO5': '0.023', 'AMMO2': '0.031', 'ARMOR': '0.036', 'AMMO3': '0.089', 'WEAPON1': '0.090', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'weapon5': '0.412', 'WEAPON3': '0.500', 'HITCOUNT': '0.570', 'weapon4': '0.638', 'WEAPON5': '0.650', 'weapon2': '1.170', 'weapon3': '1.410', 'DAMAGECOUNT': '3.030', 'FRAGCOUNT': '7.000'} [2023-02-24 17:59:24,696][177154] DAMAGECOUNT value on done: 39380.0 [2023-02-24 17:59:24,696][177154] Sum rewards: 0.172, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.432', 'AMMO5': '0.010', 'ARMOR': '0.010', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.055', 'WEAPON1': '0.060', 'AMMO3': '0.071', 'weapon5': '0.118', 'weapon4': '0.150', 'WEAPON5': '0.300', 'HITCOUNT': '0.320', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.053', 'weapon3': '1.208', 'FRAGCOUNT': '2.000', 'weapon2': '2.388'} [2023-02-24 17:59:24,990][177154] DAMAGECOUNT value on done: 37855.0 [2023-02-24 17:59:24,990][177154] Sum rewards: 1.587, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.518', 'weapon4': '0.012', 'AMMO5': '0.018', 'AMMO2': '0.034', 'WEAPON1': '0.080', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'weapon5': '0.164', 'AMMO4': '0.169', 'HITCOUNT': '0.180', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.044', 'weapon3': '1.250', 'FRAGCOUNT': '2.000', 'weapon2': '2.012'} [2023-02-24 17:59:25,021][177172] DAMAGECOUNT value on done: 37766.0 [2023-02-24 17:59:25,022][177172] Sum rewards: 2.102, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.758', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON1': '0.030', 'weapon7': '0.042', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.082', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.124', 'WEAPON5': '0.250', 'HITCOUNT': '0.310', 'weapon4': '0.388', 'WEAPON3': '0.550', 'weapon3': '1.134', 'weapon2': '1.258', 'DAMAGECOUNT': '1.269', 'FRAGCOUNT': '3.000'} [2023-02-24 17:59:25,288][177154] DAMAGECOUNT value on done: 39477.0 [2023-02-24 17:59:25,288][177154] Sum rewards: 10.598, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.395', 'AMMO5': '0.007', 'ARMOR': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'weapon5': '0.160', 'weapon7': '0.190', 'WEAPON4': '0.200', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'HITCOUNT': '0.470', 'WEAPON3': '0.600', 'weapon4': '0.694', 'weapon2': '1.162', 'weapon3': '1.348', 'DAMAGECOUNT': '2.793', 'FRAGCOUNT': '8.000'} [2023-02-24 17:59:25,315][177172] DAMAGECOUNT value on done: 36915.0 [2023-02-24 17:59:25,315][177172] Sum rewards: 2.751, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.015', 'AMMO5': '0.017', 'WEAPON1': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.089', 'WEAPON4': '0.150', 'HEALTH': '0.158', 'weapon5': '0.216', 'WEAPON5': '0.250', 'weapon4': '0.288', 'WEAPON3': '0.500', 'HITCOUNT': '0.560', 'weapon3': '1.550', 'weapon2': '1.560', 'DAMAGECOUNT': '1.773', 'FRAGCOUNT': '3.000'} [2023-02-24 17:59:25,586][177154] DAMAGECOUNT value on done: 38209.0 [2023-02-24 17:59:25,586][177154] Sum rewards: 1.471, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.896', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'AMMO4': '0.052', 'AMMO3': '0.055', 'WEAPON4': '0.150', 'weapon5': '0.186', 'WEAPON5': '0.250', 'HITCOUNT': '0.320', 'WEAPON3': '0.400', 'weapon4': '0.412', 'weapon3': '0.918', 'DAMAGECOUNT': '1.401', 'weapon2': '2.380', 'FRAGCOUNT': '4.000'} [2023-02-24 17:59:25,651][177171] DAMAGECOUNT value on done: 37921.0 [2023-02-24 17:59:25,652][177171] Sum rewards: 5.553, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.417', 'AMMO2': '0.007', 'AMMO5': '0.022', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'weapon5': '0.068', 'WEAPON1': '0.070', 'AMMO3': '0.107', 'weapon4': '0.206', 'WEAPON5': '0.350', 'HITCOUNT': '0.380', 'ARMOR': '0.544', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.407', 'weapon2': '1.480', 'weapon3': '1.792', 'FRAGCOUNT': '5.000'} [2023-02-24 17:59:25,889][177157] DAMAGECOUNT value on done: 40329.0 [2023-02-24 17:59:25,890][177157] Sum rewards: 10.734, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'weapon7': '0.060', 'AMMO3': '0.088', 'AMMO4': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'HEALTH': '0.288', 'weapon5': '0.346', 'weapon4': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.950', 'weapon2': '0.972', 'weapon3': '1.700', 'DAMAGECOUNT': '4.236', 'FRAGCOUNT': '11.000'} [2023-02-24 17:59:25,925][177157] DAMAGECOUNT value on done: 40245.0 [2023-02-24 17:59:25,926][177157] Sum rewards: 4.483, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.810', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.080', 'AMMO3': '0.088', 'AMMO4': '0.091', 'weapon5': '0.278', 'HITCOUNT': '0.340', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.545', 'weapon2': '1.688', 'weapon3': '1.802', 'FRAGCOUNT': '6.000'} [2023-02-24 17:59:25,958][177171] DAMAGECOUNT value on done: 37713.0 [2023-02-24 17:59:25,958][177171] Sum rewards: -0.167, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.360', 'AMMO2': '0.018', 'AMMO5': '0.020', 'ARMOR': '0.036', 'weapon4': '0.046', 'AMMO3': '0.089', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'WEAPON1': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.242', 'HITCOUNT': '0.300', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.143', 'weapon2': '1.298', 'weapon3': '1.750'} [2023-02-24 17:59:26,112][177153] Updated weights for policy 0, policy_version 7480 (0.0008) [2023-02-24 17:59:26,193][177157] DAMAGECOUNT value on done: 38711.0 [2023-02-24 17:59:26,194][177157] Sum rewards: 1.264, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.590', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'WEAPON1': '0.040', 'weapon5': '0.094', 'AMMO3': '0.096', 'WEAPON5': '0.150', 'HITCOUNT': '0.320', 'WEAPON3': '0.650', 'weapon3': '1.314', 'DAMAGECOUNT': '1.668', 'weapon2': '2.058', 'FRAGCOUNT': '3.000'} [2023-02-24 17:59:26,196][177171] DAMAGECOUNT value on done: 38358.0 [2023-02-24 17:59:26,196][177171] Sum rewards: 6.971, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.236', 'AMMO2': '0.010', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO4': '0.048', 'WEAPON1': '0.050', 'AMMO3': '0.071', 'WEAPON5': '0.250', 'weapon5': '0.252', 'WEAPON3': '0.500', 'HITCOUNT': '0.710', 'weapon3': '1.662', 'weapon2': '1.888', 'DAMAGECOUNT': '2.490', 'FRAGCOUNT': '6.000'} [2023-02-24 17:59:26,231][177157] DAMAGECOUNT value on done: 37475.0 [2023-02-24 17:59:26,232][177157] Sum rewards: 6.200, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.015', 'AMMO2': '0.025', 'WEAPON1': '0.060', 'ARMOR': '0.064', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'weapon7': '0.102', 'weapon5': '0.124', 'AMMO4': '0.125', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.340', 'weapon4': '0.340', 'weapon2': '0.486', 'WEAPON3': '0.500', 'HEALTH': '0.597', 'weapon3': '1.656', 'DAMAGECOUNT': '1.683', 'FRAGCOUNT': '5.000'} [2023-02-24 17:59:26,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13912.5). Total num frames: 30638080. Throughput: 0: 3483.9. Samples: 7657756. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:59:26,376][177119] Avg episode reward: [(0, '3.706')] [2023-02-24 17:59:26,500][177171] DAMAGECOUNT value on done: 38452.0 [2023-02-24 17:59:26,500][177171] Sum rewards: 4.495, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.522', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'AMMO3': '0.056', 'weapon7': '0.076', 'weapon5': '0.080', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.290', 'weapon4': '0.292', 'WEAPON3': '0.500', 'weapon3': '1.156', 'weapon2': '1.688', 'DAMAGECOUNT': '1.746', 'FRAGCOUNT': '6.000'} [2023-02-24 17:59:26,554][177155] DAMAGECOUNT value on done: 39563.0 [2023-02-24 17:59:26,554][177155] Sum rewards: 5.882, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.440', 'AMMO5': '0.012', 'AMMO2': '0.035', 'ARMOR': '0.036', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO3': '0.078', 'weapon4': '0.090', 'weapon5': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.176', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.570', 'WEAPON3': '0.600', 'weapon3': '1.584', 'weapon2': '1.782', 'DAMAGECOUNT': '2.175', 'FRAGCOUNT': '5.000'} [2023-02-24 17:59:26,852][177155] DAMAGECOUNT value on done: 41333.0 [2023-02-24 17:59:26,853][177155] Sum rewards: 1.141, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.452', 'AMMO5': '0.005', 'AMMO2': '0.007', 'WEAPON1': '0.030', 'AMMO4': '0.036', 'AMMO3': '0.100', 'HITCOUNT': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.204', 'WEAPON4': '0.250', 'weapon4': '0.638', 'WEAPON3': '0.700', 'weapon2': '1.154', 'DAMAGECOUNT': '1.350', 'weapon3': '1.568', 'FRAGCOUNT': '3.000'} [2023-02-24 17:59:27,098][177155] DAMAGECOUNT value on done: 40596.0 [2023-02-24 17:59:27,098][177155] Sum rewards: 8.746, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.925', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'WEAPON4': '0.100', 'weapon4': '0.104', 'weapon5': '0.108', 'weapon7': '0.110', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.400', 'HITCOUNT': '0.400', 'WEAPON7': '0.400', 'weapon3': '1.026', 'weapon2': '1.726', 'DAMAGECOUNT': '1.836', 'FRAGCOUNT': '5.000'} [2023-02-24 17:59:27,395][177155] DAMAGECOUNT value on done: 39803.0 [2023-02-24 17:59:27,396][177155] Sum rewards: 2.824, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.532', 'AMMO5': '0.015', 'AMMO2': '0.047', 'WEAPON1': '0.070', 'weapon7': '0.072', 'AMMO3': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.142', 'AMMO4': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.636', 'WEAPON3': '0.650', 'HITCOUNT': '0.680', 'weapon4': '0.822', 'weapon3': '1.694', 'DAMAGECOUNT': '2.661', 'FRAGCOUNT': '5.000'} [2023-02-24 17:59:28,144][177170] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 17:59:29,003][177153] Updated weights for policy 0, policy_version 7490 (0.0009) [2023-02-24 17:59:30,991][177156] DAMAGECOUNT value on done: 39462.0 [2023-02-24 17:59:30,991][177156] Sum rewards: 1.246, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.640', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon7': '0.050', 'ARMOR': '0.064', 'AMMO4': '0.082', 'weapon5': '0.116', 'AMMO3': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.364', 'HITCOUNT': '0.450', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.461', 'weapon2': '1.474', 'weapon3': '1.818', 'FRAGCOUNT': '4.000'} [2023-02-24 17:59:31,283][177156] DAMAGECOUNT value on done: 39959.0 [2023-02-24 17:59:31,284][177156] Sum rewards: 5.213, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.197', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.010', 'WEAPON1': '0.050', 'AMMO3': '0.057', 'WEAPON4': '0.100', 'WEAPON5': '0.250', 'HITCOUNT': '0.270', 'weapon4': '0.410', 'WEAPON3': '0.450', 'weapon5': '0.556', 'ARMOR': '0.912', 'weapon3': '0.928', 'DAMAGECOUNT': '1.386', 'weapon2': '1.810', 'FRAGCOUNT': '3.000'} [2023-02-24 17:59:31,295][177156] DAMAGECOUNT value on done: 40101.0 [2023-02-24 17:59:31,296][177156] Sum rewards: 3.937, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.300', 'AMMO5': '0.007', 'AMMO2': '0.008', 'ARMOR': '0.016', 'WEAPON1': '0.030', 'AMMO4': '0.039', 'AMMO3': '0.041', 'weapon4': '0.088', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'WEAPON5': '0.200', 'weapon5': '0.214', 'WEAPON3': '0.250', 'weapon3': '0.468', 'DAMAGECOUNT': '1.032', 'FRAGCOUNT': '2.000', 'weapon2': '2.624'} [2023-02-24 17:59:31,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 30711808. Throughput: 0: 3484.6. Samples: 7678740. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:59:31,376][177119] Avg episode reward: [(0, '3.746')] [2023-02-24 17:59:31,592][177156] DAMAGECOUNT value on done: 40409.0 [2023-02-24 17:59:31,593][177156] Sum rewards: 3.649, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.304', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.014', 'WEAPON1': '0.020', 'ARMOR': '0.021', 'AMMO3': '0.050', 'weapon7': '0.052', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'HITCOUNT': '0.370', 'weapon2': '0.554', 'weapon4': '0.678', 'weapon3': '1.190', 'DAMAGECOUNT': '1.260', 'FRAGCOUNT': '3.000'} [2023-02-24 17:59:31,915][177153] Updated weights for policy 0, policy_version 7500 (0.0009) [2023-02-24 17:59:34,849][177153] Updated weights for policy 0, policy_version 7510 (0.0008) [2023-02-24 17:59:36,376][177119] Fps is (10 sec: 14336.1, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 30781440. Throughput: 0: 3486.3. Samples: 7689186. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 17:59:36,376][177119] Avg episode reward: [(0, '3.720')] [2023-02-24 17:59:37,755][177153] Updated weights for policy 0, policy_version 7520 (0.0009) [2023-02-24 17:59:40,673][177153] Updated weights for policy 0, policy_version 7530 (0.0008) [2023-02-24 17:59:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 30851072. Throughput: 0: 3489.3. Samples: 7710242. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:59:41,376][177119] Avg episode reward: [(0, '3.720')] [2023-02-24 17:59:41,644][177170] DAMAGECOUNT value on done: 39521.0 [2023-02-24 17:59:41,645][177170] Sum rewards: 2.928, reward structure: {'DEATHCOUNT': '-4.500', 'ARMOR': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'AMMO3': '0.061', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'weapon7': '0.122', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'HEALTH': '0.213', 'weapon5': '0.214', 'HITCOUNT': '0.320', 'WEAPON3': '0.400', 'weapon2': '0.688', 'weapon4': '0.822', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.260', 'weapon3': '1.366'} [2023-02-24 17:59:41,865][177170] DAMAGECOUNT value on done: 35373.0 [2023-02-24 17:59:41,866][177170] Sum rewards: -0.647, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.654', 'AMMO5': '0.016', 'ARMOR': '0.020', 'AMMO2': '0.027', 'WEAPON4': '0.050', 'WEAPON1': '0.080', 'weapon7': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.111', 'AMMO4': '0.136', 'HITCOUNT': '0.350', 'weapon4': '0.362', 'WEAPON5': '0.400', 'weapon5': '0.462', 'weapon2': '0.684', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.467', 'weapon3': '1.994'} [2023-02-24 17:59:41,947][177170] DAMAGECOUNT value on done: 42804.0 [2023-02-24 17:59:41,948][177170] Sum rewards: 6.744, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.434', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.022', 'WEAPON1': '0.050', 'AMMO3': '0.076', 'weapon7': '0.100', 'AMMO4': '0.109', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.142', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.388', 'WEAPON3': '0.550', 'HITCOUNT': '0.640', 'weapon3': '1.270', 'weapon2': '1.916', 'DAMAGECOUNT': '3.195', 'FRAGCOUNT': '7.000'} [2023-02-24 17:59:42,048][177158] DAMAGECOUNT value on done: 37996.0 [2023-02-24 17:59:42,048][177158] Sum rewards: 3.953, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.213', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.008', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'WEAPON5': '0.200', 'weapon4': '0.288', 'weapon5': '0.292', 'HITCOUNT': '0.350', 'ARMOR': '0.553', 'WEAPON3': '0.750', 'weapon2': '1.316', 'weapon3': '1.810', 'DAMAGECOUNT': '1.845', 'FRAGCOUNT': '5.000'} [2023-02-24 17:59:42,166][177170] DAMAGECOUNT value on done: 41736.0 [2023-02-24 17:59:42,166][177170] Sum rewards: 8.524, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.820', 'AMMO2': '0.007', 'ARMOR': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.033', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.077', 'weapon4': '0.162', 'weapon5': '0.202', 'WEAPON5': '0.350', 'HITCOUNT': '0.430', 'WEAPON3': '0.550', 'weapon3': '1.694', 'weapon2': '1.810', 'DAMAGECOUNT': '2.163', 'FRAGCOUNT': '7.000'} [2023-02-24 17:59:42,351][177158] DAMAGECOUNT value on done: 38480.0 [2023-02-24 17:59:42,351][177158] Sum rewards: -0.333, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.814', 'AMMO2': '0.020', 'AMMO5': '0.021', 'WEAPON1': '0.070', 'weapon7': '0.072', 'AMMO3': '0.099', 'AMMO4': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'HITCOUNT': '0.640', 'WEAPON3': '0.750', 'weapon2': '0.762', 'weapon4': '0.822', 'weapon3': '1.764', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.910'} [2023-02-24 17:59:43,014][177172] DAMAGECOUNT value on done: 38755.0 [2023-02-24 17:59:43,014][177172] Sum rewards: 1.873, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.178', 'AMMO5': '0.008', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'ARMOR': '0.088', 'AMMO3': '0.094', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'weapon5': '0.180', 'WEAPON5': '0.300', 'weapon4': '0.302', 'HITCOUNT': '0.390', 'WEAPON3': '0.750', 'weapon2': '0.884', 'DAMAGECOUNT': '1.764', 'weapon3': '1.950', 'FRAGCOUNT': '2.000'} [2023-02-24 17:59:43,178][177158] DAMAGECOUNT value on done: 36985.0 [2023-02-24 17:59:43,178][177158] Sum rewards: -2.031, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.878', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'ARMOR': '0.082', 'AMMO4': '0.097', 'AMMO3': '0.099', 'HITCOUNT': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.160', 'DAMAGECOUNT': '0.381', 'WEAPON4': '0.400', 'weapon4': '0.510', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.304', 'weapon3': '1.480'} [2023-02-24 17:59:43,309][177172] DAMAGECOUNT value on done: 37346.0 [2023-02-24 17:59:43,309][177172] Sum rewards: 3.885, reward structure: {'DEATHCOUNT': '-6.750', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.040', 'WEAPON1': '0.060', 'AMMO3': '0.071', 'WEAPON4': '0.100', 'HEALTH': '0.136', 'AMMO4': '0.200', 'HITCOUNT': '0.280', 'weapon4': '0.342', 'WEAPON5': '0.350', 'weapon5': '0.354', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.236', 'weapon2': '1.424', 'weapon3': '1.518', 'FRAGCOUNT': '4.000'} [2023-02-24 17:59:43,474][177158] DAMAGECOUNT value on done: 41050.0 [2023-02-24 17:59:43,475][177158] Sum rewards: 9.244, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.658', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.091', 'AMMO3': '0.096', 'weapon5': '0.166', 'weapon4': '0.184', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.670', 'weapon3': '1.592', 'weapon2': '1.938', 'DAMAGECOUNT': '3.114', 'FRAGCOUNT': '7.000'} [2023-02-24 17:59:43,610][177153] Updated weights for policy 0, policy_version 7540 (0.0009) [2023-02-24 17:59:43,988][177154] DAMAGECOUNT value on done: 39884.0 [2023-02-24 17:59:43,989][177154] Sum rewards: 3.195, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.112', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'weapon7': '0.048', 'AMMO3': '0.081', 'weapon5': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.390', 'weapon4': '0.482', 'WEAPON3': '0.550', 'weapon3': '1.342', 'DAMAGECOUNT': '1.512', 'weapon2': '1.586', 'FRAGCOUNT': '3.000'} [2023-02-24 17:59:44,260][177172] DAMAGECOUNT value on done: 38317.0 [2023-02-24 17:59:44,260][177172] Sum rewards: 2.463, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.211', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.030', 'WEAPON1': '0.070', 'AMMO3': '0.100', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'weapon4': '0.290', 'weapon5': '0.362', 'HITCOUNT': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'weapon2': '0.938', 'DAMAGECOUNT': '1.653', 'weapon3': '2.016', 'FRAGCOUNT': '3.000'} [2023-02-24 17:59:44,288][177154] DAMAGECOUNT value on done: 38655.0 [2023-02-24 17:59:44,289][177154] Sum rewards: 6.140, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.812', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'ARMOR': '0.032', 'AMMO3': '0.095', 'AMMO4': '0.153', 'weapon5': '0.186', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'HITCOUNT': '0.520', 'WEAPON3': '0.550', 'weapon2': '0.904', 'weapon4': '0.988', 'weapon3': '1.358', 'DAMAGECOUNT': '2.400', 'FRAGCOUNT': '8.000'} [2023-02-24 17:59:44,565][177172] DAMAGECOUNT value on done: 37728.0 [2023-02-24 17:59:44,566][177172] Sum rewards: 6.747, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.180', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'ARMOR': '0.052', 'AMMO3': '0.080', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'weapon5': '0.200', 'weapon4': '0.282', 'WEAPON3': '0.500', 'HITCOUNT': '0.650', 'weapon2': '1.154', 'weapon3': '1.444', 'DAMAGECOUNT': '2.439', 'FRAGCOUNT': '5.000'} [2023-02-24 17:59:44,582][177154] DAMAGECOUNT value on done: 39832.0 [2023-02-24 17:59:44,583][177154] Sum rewards: -1.450, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.285', 'AMMO5': '0.018', 'ARMOR': '0.024', 'AMMO2': '0.029', 'WEAPON1': '0.100', 'AMMO3': '0.140', 'HITCOUNT': '0.140', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'weapon5': '0.346', 'weapon4': '0.366', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'weapon2': '0.868', 'DAMAGECOUNT': '1.065', 'weapon3': '1.842', 'FRAGCOUNT': '3.000'} [2023-02-24 17:59:44,817][177171] DAMAGECOUNT value on done: 38679.0 [2023-02-24 17:59:44,818][177171] Sum rewards: 4.417, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.437', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO2': '0.036', 'ARMOR': '0.076', 'AMMO3': '0.113', 'AMMO4': '0.181', 'weapon5': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'HITCOUNT': '0.420', 'WEAPON3': '0.650', 'weapon4': '0.722', 'weapon2': '1.110', 'weapon3': '1.688', 'DAMAGECOUNT': '2.274', 'FRAGCOUNT': '5.000'} [2023-02-24 17:59:44,875][177154] DAMAGECOUNT value on done: 39114.0 [2023-02-24 17:59:44,876][177154] Sum rewards: 5.723, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.540', 'AMMO5': '0.007', 'AMMO2': '0.024', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'weapon5': '0.222', 'HITCOUNT': '0.350', 'weapon4': '0.414', 'WEAPON3': '0.550', 'weapon3': '1.224', 'weapon2': '1.980', 'DAMAGECOUNT': '2.715', 'FRAGCOUNT': '5.000'} [2023-02-24 17:59:45,117][177171] DAMAGECOUNT value on done: 38293.0 [2023-02-24 17:59:45,117][177171] Sum rewards: 3.657, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.295', 'AMMO5': '0.015', 'AMMO2': '0.034', 'ARMOR': '0.064', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'weapon4': '0.152', 'AMMO4': '0.171', 'weapon5': '0.312', 'WEAPON5': '0.400', 'HITCOUNT': '0.430', 'WEAPON3': '0.650', 'weapon2': '0.954', 'DAMAGECOUNT': '1.740', 'weapon3': '2.254', 'FRAGCOUNT': '4.000'} [2023-02-24 17:59:45,122][177157] DAMAGECOUNT value on done: 40644.0 [2023-02-24 17:59:45,122][177157] Sum rewards: 0.605, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.563', 'AMMO2': '0.010', 'AMMO4': '0.049', 'ARMOR': '0.052', 'weapon7': '0.058', 'AMMO3': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.250', 'HITCOUNT': '0.280', 'weapon4': '0.422', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.945', 'weapon3': '1.140', 'weapon2': '1.844', 'FRAGCOUNT': '3.000'} [2023-02-24 17:59:45,155][177157] DAMAGECOUNT value on done: 41236.0 [2023-02-24 17:59:45,156][177157] Sum rewards: 8.976, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'AMMO4': '0.063', 'AMMO3': '0.070', 'weapon5': '0.198', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'HEALTH': '0.617', 'HITCOUNT': '0.730', 'weapon3': '1.606', 'weapon2': '1.966', 'DAMAGECOUNT': '2.973', 'FRAGCOUNT': '6.000'} [2023-02-24 17:59:45,338][177171] DAMAGECOUNT value on done: 38614.0 [2023-02-24 17:59:45,338][177171] Sum rewards: 3.318, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.010', 'AMMO2': '0.023', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'WEAPON1': '0.060', 'ARMOR': '0.088', 'AMMO4': '0.113', 'HEALTH': '0.114', 'HITCOUNT': '0.150', 'weapon4': '0.254', 'weapon5': '0.294', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.768', 'weapon2': '0.884', 'weapon3': '1.300', 'FRAGCOUNT': '3.000'} [2023-02-24 17:59:45,430][177157] DAMAGECOUNT value on done: 39606.0 [2023-02-24 17:59:45,430][177157] Sum rewards: 6.141, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.880', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'AMMO4': '0.083', 'AMMO3': '0.087', 'weapon5': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.370', 'weapon4': '0.536', 'WEAPON3': '0.600', 'weapon2': '1.312', 'weapon3': '1.636', 'DAMAGECOUNT': '2.502', 'FRAGCOUNT': '6.000'} [2023-02-24 17:59:45,469][177157] DAMAGECOUNT value on done: 37952.0 [2023-02-24 17:59:45,470][177157] Sum rewards: 3.037, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.130', 'AMMO5': '0.011', 'AMMO2': '0.022', 'ARMOR': '0.024', 'WEAPON1': '0.040', 'AMMO3': '0.077', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon7': '0.106', 'AMMO4': '0.108', 'HITCOUNT': '0.220', 'weapon5': '0.294', 'WEAPON5': '0.350', 'weapon4': '0.474', 'WEAPON3': '0.500', 'weapon3': '1.078', 'DAMAGECOUNT': '1.431', 'weapon2': '1.782', 'FRAGCOUNT': '4.000'} [2023-02-24 17:59:45,643][177171] DAMAGECOUNT value on done: 38684.0 [2023-02-24 17:59:45,643][177171] Sum rewards: 2.925, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.735', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.047', 'WEAPON5': '0.050', 'weapon7': '0.054', 'HITCOUNT': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.130', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'weapon2': '0.576', 'weapon3': '0.666', 'DAMAGECOUNT': '0.696', 'weapon4': '0.962', 'FRAGCOUNT': '3.000'} [2023-02-24 17:59:45,736][177155] DAMAGECOUNT value on done: 39853.0 [2023-02-24 17:59:45,736][177155] Sum rewards: 1.413, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.846', 'AMMO2': '0.008', 'AMMO5': '0.016', 'AMMO4': '0.038', 'AMMO3': '0.050', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'HITCOUNT': '0.200', 'weapon5': '0.332', 'WEAPON3': '0.400', 'weapon4': '0.436', 'WEAPON5': '0.450', 'DAMAGECOUNT': '0.870', 'weapon3': '1.222', 'weapon2': '1.306', 'FRAGCOUNT': '2.000'} [2023-02-24 17:59:46,036][177155] DAMAGECOUNT value on done: 42101.0 [2023-02-24 17:59:46,037][177155] Sum rewards: 6.404, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.403', 'AMMO2': '0.030', 'AMMO3': '0.104', 'ARMOR': '0.124', 'AMMO4': '0.151', 'WEAPON4': '0.350', 'HITCOUNT': '0.590', 'WEAPON3': '0.650', 'weapon2': '0.916', 'weapon4': '0.920', 'weapon3': '1.918', 'DAMAGECOUNT': '2.304', 'FRAGCOUNT': '7.000'} [2023-02-24 17:59:46,291][177155] DAMAGECOUNT value on done: 41158.0 [2023-02-24 17:59:46,292][177155] Sum rewards: 4.110, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.482', 'AMMO5': '0.010', 'AMMO2': '0.022', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'AMMO3': '0.110', 'AMMO4': '0.112', 'weapon4': '0.132', 'WEAPON4': '0.150', 'weapon5': '0.226', 'WEAPON5': '0.250', 'HITCOUNT': '0.320', 'WEAPON3': '0.700', 'weapon2': '1.384', 'DAMAGECOUNT': '1.686', 'weapon3': '1.900', 'FRAGCOUNT': '5.000'} [2023-02-24 17:59:46,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 30920704. Throughput: 0: 3490.0. Samples: 7731150. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 17:59:46,376][177119] Avg episode reward: [(0, '3.638')] [2023-02-24 17:59:46,558][177153] Updated weights for policy 0, policy_version 7550 (0.0008) [2023-02-24 17:59:46,588][177155] DAMAGECOUNT value on done: 39918.0 [2023-02-24 17:59:46,588][177155] Sum rewards: -3.037, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.022', 'ARMOR': '0.004', 'weapon5': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.108', 'HITCOUNT': '0.120', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.345', 'weapon4': '0.512', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.184', 'weapon3': '1.784'} [2023-02-24 17:59:49,495][177153] Updated weights for policy 0, policy_version 7560 (0.0008) [2023-02-24 17:59:50,297][177156] DAMAGECOUNT value on done: 39964.0 [2023-02-24 17:59:50,298][177156] Sum rewards: 3.222, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.432', 'weapon4': '0.006', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.070', 'HITCOUNT': '0.250', 'WEAPON5': '0.300', 'weapon5': '0.300', 'ARMOR': '0.481', 'WEAPON3': '0.500', 'weapon3': '1.142', 'DAMAGECOUNT': '1.506', 'FRAGCOUNT': '2.000', 'weapon2': '2.180'} [2023-02-24 17:59:50,601][177156] DAMAGECOUNT value on done: 40395.0 [2023-02-24 17:59:50,601][177156] Sum rewards: 2.208, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.012', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.084', 'AMMO4': '0.108', 'AMMO3': '0.134', 'weapon5': '0.204', 'WEAPON5': '0.250', 'HITCOUNT': '0.450', 'WEAPON3': '0.750', 'HEALTH': '0.758', 'DAMAGECOUNT': '1.308', 'weapon2': '1.472', 'weapon3': '2.036', 'FRAGCOUNT': '3.500'} [2023-02-24 17:59:50,610][177156] DAMAGECOUNT value on done: 40634.0 [2023-02-24 17:59:50,611][177156] Sum rewards: 4.105, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.540', 'AMMO5': '0.010', 'AMMO2': '0.012', 'ARMOR': '0.032', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.092', 'weapon5': '0.138', 'weapon4': '0.246', 'WEAPON5': '0.250', 'HITCOUNT': '0.520', 'WEAPON3': '0.550', 'weapon2': '1.512', 'DAMAGECOUNT': '1.599', 'weapon3': '1.772', 'FRAGCOUNT': '3.000'} [2023-02-24 17:59:50,909][177156] DAMAGECOUNT value on done: 40690.0 [2023-02-24 17:59:50,910][177156] Sum rewards: 1.791, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.261', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.048', 'ARMOR': '0.052', 'AMMO3': '0.077', 'WEAPON5': '0.100', 'HITCOUNT': '0.240', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.843', 'weapon3': '1.338', 'weapon2': '1.840', 'FRAGCOUNT': '3.000'} [2023-02-24 17:59:51,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 13926.4). Total num frames: 30990336. Throughput: 0: 3495.2. Samples: 7741764. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:59:51,376][177119] Avg episode reward: [(0, '3.569')] [2023-02-24 17:59:52,474][177153] Updated weights for policy 0, policy_version 7570 (0.0008) [2023-02-24 17:59:55,372][177153] Updated weights for policy 0, policy_version 7580 (0.0008) [2023-02-24 17:59:56,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13926.4). Total num frames: 31059968. Throughput: 0: 3496.9. Samples: 7762770. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 17:59:56,376][177119] Avg episode reward: [(0, '3.569')] [2023-02-24 17:59:58,290][177153] Updated weights for policy 0, policy_version 7590 (0.0008) [2023-02-24 18:00:00,752][177170] DAMAGECOUNT value on done: 40223.0 [2023-02-24 18:00:00,753][177170] Sum rewards: 4.323, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.592', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon7': '0.056', 'WEAPON1': '0.060', 'AMMO4': '0.066', 'ARMOR': '0.080', 'weapon5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.135', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'HITCOUNT': '0.440', 'weapon4': '0.506', 'WEAPON3': '0.950', 'weapon2': '1.246', 'weapon3': '1.706', 'DAMAGECOUNT': '2.106', 'FRAGCOUNT': '5.000'} [2023-02-24 18:00:01,048][177170] DAMAGECOUNT value on done: 35938.0 [2023-02-24 18:00:01,049][177170] Sum rewards: 0.653, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.196', 'AMMO5': '0.015', 'AMMO2': '0.023', 'ARMOR': '0.048', 'WEAPON1': '0.070', 'weapon5': '0.074', 'AMMO3': '0.108', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'weapon4': '0.168', 'WEAPON5': '0.350', 'HITCOUNT': '0.440', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.652', 'DAMAGECOUNT': '1.695', 'weapon2': '1.892'} [2023-02-24 18:00:01,058][177170] DAMAGECOUNT value on done: 43424.0 [2023-02-24 18:00:01,059][177170] Sum rewards: 8.045, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.336', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO3': '0.040', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.178', 'weapon4': '0.204', 'HITCOUNT': '0.330', 'WEAPON3': '0.350', 'weapon3': '0.982', 'DAMAGECOUNT': '1.860', 'weapon2': '2.056', 'FRAGCOUNT': '5.000'} [2023-02-24 18:00:01,123][177158] DAMAGECOUNT value on done: 38281.0 [2023-02-24 18:00:01,124][177158] Sum rewards: 2.236, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.058', 'AMMO4': '0.097', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'ARMOR': '0.124', 'HITCOUNT': '0.250', 'weapon4': '0.252', 'HEALTH': '0.417', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.855', 'weapon2': '1.464', 'weapon3': '1.876', 'FRAGCOUNT': '2.000'} [2023-02-24 18:00:01,224][177153] Updated weights for policy 0, policy_version 7600 (0.0008) [2023-02-24 18:00:01,347][177170] DAMAGECOUNT value on done: 42326.0 [2023-02-24 18:00:01,347][177170] Sum rewards: 5.259, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.186', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.113', 'weapon5': '0.178', 'WEAPON5': '0.200', 'weapon4': '0.216', 'HITCOUNT': '0.340', 'WEAPON3': '0.650', 'weapon2': '1.566', 'weapon3': '1.568', 'DAMAGECOUNT': '1.770', 'FRAGCOUNT': '5.000'} [2023-02-24 18:00:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13926.4). Total num frames: 31129600. Throughput: 0: 3497.5. Samples: 7783740. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:00:01,376][177119] Avg episode reward: [(0, '3.620')] [2023-02-24 18:00:01,423][177158] DAMAGECOUNT value on done: 39135.0 [2023-02-24 18:00:01,423][177158] Sum rewards: -1.374, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.291', 'AMMO5': '0.010', 'AMMO2': '0.029', 'ARMOR': '0.044', 'WEAPON1': '0.070', 'AMMO4': '0.143', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'weapon5': '0.270', 'WEAPON5': '0.350', 'weapon4': '0.400', 'HITCOUNT': '0.520', 'weapon2': '0.838', 'WEAPON3': '1.200', 'DAMAGECOUNT': '1.965', 'weapon3': '2.152', 'FRAGCOUNT': '3.000'} [2023-02-24 18:00:02,226][177172] DAMAGECOUNT value on done: 39153.0 [2023-02-24 18:00:02,226][177172] Sum rewards: -0.090, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.618', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.114', 'weapon5': '0.122', 'WEAPON5': '0.200', 'weapon4': '0.204', 'HITCOUNT': '0.300', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.194', 'weapon3': '1.412', 'weapon2': '2.048', 'FRAGCOUNT': '3.000'} [2023-02-24 18:00:02,267][177158] DAMAGECOUNT value on done: 37200.0 [2023-02-24 18:00:02,267][177158] Sum rewards: -2.675, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.630', 'AMMO5': '0.013', 'AMMO2': '0.015', 'ARMOR': '0.025', 'WEAPON1': '0.050', 'weapon5': '0.050', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon4': '0.198', 'HITCOUNT': '0.220', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.436', 'weapon3': '1.522'} [2023-02-24 18:00:02,526][177172] DAMAGECOUNT value on done: 38152.0 [2023-02-24 18:00:02,527][177172] Sum rewards: 10.073, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.432', 'AMMO5': '0.014', 'AMMO2': '0.023', 'AMMO3': '0.080', 'WEAPON1': '0.080', 'ARMOR': '0.089', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'weapon5': '0.220', 'weapon4': '0.356', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'weapon2': '1.296', 'weapon3': '1.806', 'DAMAGECOUNT': '2.418', 'FRAGCOUNT': '9.000'} [2023-02-24 18:00:02,569][177158] DAMAGECOUNT value on done: 41546.0 [2023-02-24 18:00:02,570][177158] Sum rewards: 3.143, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.479', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'ARMOR': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.081', 'AMMO4': '0.088', 'weapon4': '0.094', 'weapon5': '0.118', 'WEAPON5': '0.150', 'HITCOUNT': '0.360', 'WEAPON3': '0.550', 'weapon3': '1.356', 'DAMAGECOUNT': '1.488', 'weapon2': '2.186', 'FRAGCOUNT': '3.000'} [2023-02-24 18:00:03,163][177154] DAMAGECOUNT value on done: 40629.0 [2023-02-24 18:00:03,163][177154] Sum rewards: 3.489, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.870', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'weapon5': '0.080', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO3': '0.115', 'HITCOUNT': '0.440', 'WEAPON3': '0.750', 'weapon3': '1.790', 'weapon2': '1.812', 'DAMAGECOUNT': '2.235', 'FRAGCOUNT': '5.000'} [2023-02-24 18:00:03,439][177172] DAMAGECOUNT value on done: 39002.0 [2023-02-24 18:00:03,440][177172] Sum rewards: 5.257, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.298', 'AMMO5': '0.010', 'AMMO2': '0.015', 'ARMOR': '0.040', 'WEAPON1': '0.060', 'AMMO4': '0.075', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.182', 'weapon4': '0.228', 'WEAPON5': '0.350', 'HITCOUNT': '0.430', 'WEAPON3': '0.650', 'weapon2': '1.302', 'weapon3': '1.968', 'DAMAGECOUNT': '2.055', 'FRAGCOUNT': '4.000'} [2023-02-24 18:00:03,462][177154] DAMAGECOUNT value on done: 38988.0 [2023-02-24 18:00:03,462][177154] Sum rewards: 1.422, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.640', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.020', 'WEAPON1': '0.030', 'weapon7': '0.052', 'AMMO3': '0.065', 'WEAPON4': '0.100', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.240', 'weapon4': '0.364', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.999', 'weapon2': '1.080', 'weapon3': '1.196', 'FRAGCOUNT': '2.000'} [2023-02-24 18:00:03,742][177172] DAMAGECOUNT value on done: 38460.0 [2023-02-24 18:00:03,743][177172] Sum rewards: 6.986, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.468', 'AMMO5': '0.005', 'WEAPON1': '0.040', 'AMMO2': '0.054', 'AMMO3': '0.069', 'weapon7': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.128', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO4': '0.271', 'HITCOUNT': '0.330', 'WEAPON3': '0.450', 'weapon4': '0.756', 'weapon3': '1.242', 'weapon2': '1.392', 'DAMAGECOUNT': '2.196', 'FRAGCOUNT': '5.000'} [2023-02-24 18:00:03,758][177154] DAMAGECOUNT value on done: 40102.0 [2023-02-24 18:00:03,759][177154] Sum rewards: -0.214, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.832', 'AMMO5': '0.005', 'AMMO2': '0.018', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.087', 'weapon5': '0.116', 'AMMO3': '0.124', 'weapon4': '0.146', 'WEAPON5': '0.200', 'HITCOUNT': '0.230', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.810', 'weapon3': '1.700', 'weapon2': '1.760', 'FRAGCOUNT': '2.000'} [2023-02-24 18:00:04,051][177154] DAMAGECOUNT value on done: 39634.0 [2023-02-24 18:00:04,052][177154] Sum rewards: 3.835, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.086', 'AMMO2': '0.009', 'AMMO5': '0.017', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.101', 'WEAPON1': '0.110', 'weapon5': '0.200', 'weapon4': '0.204', 'HITCOUNT': '0.410', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.560', 'weapon3': '1.594', 'weapon2': '1.620', 'FRAGCOUNT': '6.000'} [2023-02-24 18:00:04,074][177171] DAMAGECOUNT value on done: 39272.0 [2023-02-24 18:00:04,075][177171] Sum rewards: 1.937, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.715', 'AMMO2': '0.022', 'AMMO5': '0.022', 'ARMOR': '0.024', 'WEAPON1': '0.030', 'weapon4': '0.034', 'AMMO4': '0.111', 'weapon5': '0.130', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'HITCOUNT': '0.360', 'WEAPON3': '0.800', 'weapon3': '1.652', 'DAMAGECOUNT': '1.779', 'weapon2': '1.894', 'FRAGCOUNT': '5.000'} [2023-02-24 18:00:04,145][177153] Updated weights for policy 0, policy_version 7610 (0.0008) [2023-02-24 18:00:04,295][177157] DAMAGECOUNT value on done: 40779.0 [2023-02-24 18:00:04,295][177157] Sum rewards: -0.355, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.264', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.050', 'weapon5': '0.052', 'ARMOR': '0.056', 'weapon4': '0.104', 'AMMO3': '0.110', 'HITCOUNT': '0.130', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.500', 'weapon2': '0.956', 'FRAGCOUNT': '1.000', 'weapon3': '1.548'} [2023-02-24 18:00:04,336][177157] DAMAGECOUNT value on done: 41363.0 [2023-02-24 18:00:04,384][177171] DAMAGECOUNT value on done: 38803.0 [2023-02-24 18:00:04,385][177171] Sum rewards: 2.126, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.082', 'AMMO3': '0.099', 'AMMO4': '0.125', 'weapon5': '0.146', 'WEAPON5': '0.200', 'HITCOUNT': '0.350', 'WEAPON3': '0.550', 'HEALTH': '0.598', 'weapon3': '1.398', 'DAMAGECOUNT': '1.530', 'weapon2': '1.658', 'FRAGCOUNT': '2.000'} [2023-02-24 18:00:04,610][177157] DAMAGECOUNT value on done: 40277.0 [2023-02-24 18:00:04,610][177157] Sum rewards: 2.302, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.626', 'AMMO2': '0.015', 'AMMO5': '0.020', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'weapon4': '0.072', 'AMMO4': '0.076', 'AMMO3': '0.095', 'weapon5': '0.228', 'HITCOUNT': '0.290', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'weapon2': '1.314', 'DAMAGECOUNT': '2.013', 'weapon3': '2.034', 'FRAGCOUNT': '3.000'} [2023-02-24 18:00:04,651][177171] DAMAGECOUNT value on done: 38994.0 [2023-02-24 18:00:04,652][177171] Sum rewards: 1.412, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.076', 'AMMO2': '0.008', 'AMMO5': '0.019', 'AMMO4': '0.042', 'ARMOR': '0.048', 'WEAPON1': '0.050', 'AMMO3': '0.099', 'weapon5': '0.142', 'HITCOUNT': '0.230', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.140', 'weapon2': '1.548', 'weapon3': '1.762', 'FRAGCOUNT': '3.000'} [2023-02-24 18:00:04,653][177157] DAMAGECOUNT value on done: 38424.0 [2023-02-24 18:00:04,653][177157] Sum rewards: 7.040, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.690', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'ARMOR': '0.032', 'AMMO3': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.194', 'WEAPON3': '0.450', 'HITCOUNT': '0.470', 'weapon3': '1.180', 'DAMAGECOUNT': '1.416', 'weapon2': '1.872', 'FRAGCOUNT': '5.000'} [2023-02-24 18:00:04,955][177171] DAMAGECOUNT value on done: 39149.0 [2023-02-24 18:00:04,955][177171] Sum rewards: 3.415, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.288', 'AMMO5': '0.010', 'AMMO2': '0.035', 'ARMOR': '0.040', 'WEAPON1': '0.070', 'AMMO3': '0.088', 'weapon4': '0.098', 'WEAPON4': '0.150', 'weapon5': '0.154', 'AMMO4': '0.176', 'WEAPON5': '0.350', 'HITCOUNT': '0.370', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.395', 'weapon3': '1.610', 'weapon2': '1.806', 'FRAGCOUNT': '2.000'} [2023-02-24 18:00:04,965][177155] DAMAGECOUNT value on done: 40450.0 [2023-02-24 18:00:04,966][177155] Sum rewards: 2.517, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.560', 'AMMO2': '0.005', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO4': '0.026', 'WEAPON1': '0.040', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'weapon5': '0.100', 'weapon4': '0.180', 'WEAPON5': '0.250', 'HITCOUNT': '0.520', 'WEAPON3': '0.650', 'weapon3': '1.690', 'DAMAGECOUNT': '1.791', 'weapon2': '1.844', 'FRAGCOUNT': '5.000'} [2023-02-24 18:00:05,268][177155] DAMAGECOUNT value on done: 42622.0 [2023-02-24 18:00:05,269][177155] Sum rewards: 0.124, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.660', 'AMMO5': '0.013', 'AMMO2': '0.032', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO3': '0.103', 'AMMO4': '0.159', 'weapon4': '0.204', 'weapon5': '0.220', 'WEAPON5': '0.350', 'HITCOUNT': '0.380', 'WEAPON3': '0.700', 'weapon2': '1.260', 'DAMAGECOUNT': '1.563', 'weapon3': '1.930', 'FRAGCOUNT': '2.000'} [2023-02-24 18:00:05,512][177155] DAMAGECOUNT value on done: 42065.0 [2023-02-24 18:00:05,512][177155] Sum rewards: 5.235, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.054', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.040', 'ARMOR': '0.084', 'AMMO3': '0.101', 'WEAPON5': '0.150', 'weapon5': '0.180', 'AMMO4': '0.198', 'WEAPON4': '0.250', 'HITCOUNT': '0.460', 'WEAPON3': '0.550', 'weapon4': '0.692', 'weapon3': '1.068', 'weapon2': '1.768', 'DAMAGECOUNT': '2.721', 'FRAGCOUNT': '6.000'} [2023-02-24 18:00:05,803][177155] DAMAGECOUNT value on done: 40471.0 [2023-02-24 18:00:05,803][177155] Sum rewards: 3.154, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.412', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.043', 'WEAPON1': '0.050', 'AMMO3': '0.057', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.302', 'WEAPON3': '0.350', 'HITCOUNT': '0.390', 'weapon4': '0.520', 'weapon3': '0.536', 'DAMAGECOUNT': '1.659', 'weapon2': '2.186', 'FRAGCOUNT': '3.000'} [2023-02-24 18:00:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13926.4). Total num frames: 31199232. Throughput: 0: 3497.2. Samples: 7794210. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:00:06,376][177119] Avg episode reward: [(0, '3.556')] [2023-02-24 18:00:07,092][177153] Updated weights for policy 0, policy_version 7620 (0.0009) [2023-02-24 18:00:09,543][177156] DAMAGECOUNT value on done: 40344.0 [2023-02-24 18:00:09,543][177156] Sum rewards: 4.901, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.304', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO3': '0.020', 'AMMO2': '0.032', 'WEAPON1': '0.040', 'weapon7': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.130', 'AMMO4': '0.158', 'WEAPON3': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.240', 'weapon4': '0.496', 'weapon3': '0.520', 'DAMAGECOUNT': '1.140', 'weapon2': '1.548', 'FRAGCOUNT': '3.000'} [2023-02-24 18:00:09,791][177156] DAMAGECOUNT value on done: 40917.0 [2023-02-24 18:00:09,791][177156] Sum rewards: -1.674, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.817', 'AMMO5': '0.010', 'AMMO2': '0.032', 'WEAPON1': '0.090', 'AMMO4': '0.161', 'AMMO3': '0.185', 'HITCOUNT': '0.230', 'weapon5': '0.234', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon2': '1.540', 'DAMAGECOUNT': '1.566', 'weapon3': '1.844', 'FRAGCOUNT': '4.000'} [2023-02-24 18:00:09,856][177156] DAMAGECOUNT value on done: 40929.0 [2023-02-24 18:00:09,856][177156] Sum rewards: 1.533, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.388', 'AMMO5': '0.012', 'AMMO2': '0.031', 'WEAPON4': '0.050', 'ARMOR': '0.052', 'WEAPON1': '0.060', 'weapon5': '0.064', 'AMMO3': '0.082', 'AMMO4': '0.156', 'weapon4': '0.234', 'HITCOUNT': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.885', 'weapon3': '1.406', 'weapon2': '1.788', 'FRAGCOUNT': '2.000'} [2023-02-24 18:00:10,004][177153] Updated weights for policy 0, policy_version 7630 (0.0008) [2023-02-24 18:00:10,099][177156] DAMAGECOUNT value on done: 41407.0 [2023-02-24 18:00:10,100][177156] Sum rewards: 4.333, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.941', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.031', 'WEAPON1': '0.050', 'AMMO3': '0.076', 'AMMO4': '0.155', 'weapon5': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.324', 'WEAPON3': '0.550', 'HITCOUNT': '0.580', 'weapon3': '1.280', 'weapon2': '1.954', 'DAMAGECOUNT': '2.151', 'FRAGCOUNT': '5.000'} [2023-02-24 18:00:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13926.4). Total num frames: 31268864. Throughput: 0: 3498.8. Samples: 7815204. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:00:11,376][177119] Avg episode reward: [(0, '3.449')] [2023-02-24 18:00:12,901][177153] Updated weights for policy 0, policy_version 7640 (0.0008) [2023-02-24 18:00:15,808][177153] Updated weights for policy 0, policy_version 7650 (0.0008) [2023-02-24 18:00:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13926.4). Total num frames: 31338496. Throughput: 0: 3502.4. Samples: 7836348. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:00:16,376][177119] Avg episode reward: [(0, '3.449')] [2023-02-24 18:00:18,738][177153] Updated weights for policy 0, policy_version 7660 (0.0008) [2023-02-24 18:00:19,841][177170] DAMAGECOUNT value on done: 41374.0 [2023-02-24 18:00:19,842][177170] Sum rewards: 7.557, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.690', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.022', 'WEAPON1': '0.070', 'AMMO3': '0.101', 'weapon5': '0.234', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.560', 'weapon3': '1.556', 'weapon2': '1.836', 'DAMAGECOUNT': '3.453', 'FRAGCOUNT': '7.000'} [2023-02-24 18:00:20,139][177170] DAMAGECOUNT value on done: 43709.0 [2023-02-24 18:00:20,139][177170] Sum rewards: 0.730, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.568', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.050', 'AMMO4': '0.093', 'AMMO3': '0.105', 'weapon5': '0.190', 'HITCOUNT': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.258', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.855', 'weapon3': '1.500', 'weapon2': '1.718', 'FRAGCOUNT': '2.000'} [2023-02-24 18:00:20,237][177170] DAMAGECOUNT value on done: 36253.0 [2023-02-24 18:00:20,238][177170] Sum rewards: 4.620, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.029', 'AMMO3': '0.030', 'ARMOR': '0.040', 'weapon5': '0.072', 'WEAPON4': '0.100', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'WEAPON3': '0.200', 'HITCOUNT': '0.290', 'weapon4': '0.378', 'HEALTH': '0.477', 'weapon3': '0.722', 'DAMAGECOUNT': '0.945', 'FRAGCOUNT': '1.500', 'weapon2': '2.526'} [2023-02-24 18:00:20,307][177158] DAMAGECOUNT value on done: 38741.0 [2023-02-24 18:00:20,308][177158] Sum rewards: 3.752, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.516', 'AMMO5': '0.007', 'AMMO2': '0.019', 'ARMOR': '0.040', 'WEAPON1': '0.040', 'AMMO3': '0.069', 'AMMO4': '0.095', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.304', 'HITCOUNT': '0.420', 'WEAPON3': '0.450', 'weapon3': '1.072', 'DAMAGECOUNT': '1.380', 'weapon2': '2.130', 'FRAGCOUNT': '3.000'} [2023-02-24 18:00:20,540][177170] DAMAGECOUNT value on done: 42730.0 [2023-02-24 18:00:20,541][177170] Sum rewards: 2.713, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.662', 'AMMO5': '0.008', 'AMMO2': '0.009', 'ARMOR': '0.040', 'WEAPON1': '0.040', 'AMMO4': '0.042', 'AMMO3': '0.072', 'weapon5': '0.152', 'WEAPON5': '0.200', 'HITCOUNT': '0.210', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.212', 'weapon3': '1.556', 'weapon2': '2.034', 'FRAGCOUNT': '4.000'} [2023-02-24 18:00:20,614][177158] DAMAGECOUNT value on done: 39592.0 [2023-02-24 18:00:20,614][177158] Sum rewards: 4.177, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.166', 'AMMO5': '0.005', 'AMMO2': '0.021', 'ARMOR': '0.028', 'WEAPON1': '0.040', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'weapon5': '0.110', 'WEAPON5': '0.150', 'weapon4': '0.152', 'HITCOUNT': '0.400', 'WEAPON3': '0.550', 'weapon3': '1.116', 'DAMAGECOUNT': '1.371', 'weapon2': '2.354', 'FRAGCOUNT': '3.000'} [2023-02-24 18:00:21,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 31408128. Throughput: 0: 3501.8. Samples: 7846768. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:00:21,376][177119] Avg episode reward: [(0, '3.355')] [2023-02-24 18:00:21,410][177172] DAMAGECOUNT value on done: 39452.0 [2023-02-24 18:00:21,410][177172] Sum rewards: -5.582, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.008', 'AMMO5': '0.015', 'AMMO2': '0.019', 'ARMOR': '0.020', 'WEAPON4': '0.050', 'WEAPON1': '0.090', 'AMMO4': '0.096', 'weapon5': '0.170', 'AMMO3': '0.173', 'weapon4': '0.226', 'HITCOUNT': '0.310', 'WEAPON5': '0.350', 'weapon2': '0.790', 'DAMAGECOUNT': '0.897', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.150', 'weapon3': '2.320'} [2023-02-24 18:00:21,455][177158] DAMAGECOUNT value on done: 37637.0 [2023-02-24 18:00:21,455][177158] Sum rewards: 2.103, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.318', 'AMMO5': '0.012', 'AMMO2': '0.033', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'ARMOR': '0.116', 'AMMO4': '0.166', 'weapon5': '0.194', 'HITCOUNT': '0.270', 'WEAPON5': '0.350', 'weapon4': '0.448', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.311', 'weapon2': '1.472', 'weapon3': '1.512', 'FRAGCOUNT': '4.000'} [2023-02-24 18:00:21,692][177153] Updated weights for policy 0, policy_version 7670 (0.0008) [2023-02-24 18:00:21,709][177172] DAMAGECOUNT value on done: 38572.0 [2023-02-24 18:00:21,710][177172] Sum rewards: 0.296, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.690', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'WEAPON1': '0.050', 'AMMO3': '0.093', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'weapon5': '0.114', 'weapon4': '0.122', 'WEAPON5': '0.200', 'HITCOUNT': '0.430', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.260', 'weapon3': '1.508', 'weapon2': '1.884', 'FRAGCOUNT': '2.000'} [2023-02-24 18:00:21,761][177158] DAMAGECOUNT value on done: 42379.0 [2023-02-24 18:00:21,761][177158] Sum rewards: 2.131, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.394', 'AMMO5': '0.014', 'AMMO2': '0.021', 'ARMOR': '0.040', 'WEAPON1': '0.070', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.158', 'weapon5': '0.160', 'WEAPON5': '0.350', 'HITCOUNT': '0.440', 'weapon4': '0.468', 'WEAPON3': '1.000', 'weapon2': '1.066', 'weapon3': '1.732', 'DAMAGECOUNT': '2.499', 'FRAGCOUNT': '5.000'} [2023-02-24 18:00:22,366][177154] DAMAGECOUNT value on done: 41118.0 [2023-02-24 18:00:22,366][177154] Sum rewards: 4.113, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.006', 'AMMO5': '0.007', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'AMMO3': '0.076', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.150', 'HITCOUNT': '0.240', 'weapon4': '0.246', 'WEAPON3': '0.400', 'weapon3': '0.968', 'DAMAGECOUNT': '1.467', 'weapon2': '2.280', 'FRAGCOUNT': '3.000'} [2023-02-24 18:00:22,604][177172] DAMAGECOUNT value on done: 39418.0 [2023-02-24 18:00:22,605][177172] Sum rewards: 2.503, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.641', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.070', 'AMMO4': '0.087', 'AMMO3': '0.100', 'weapon5': '0.190', 'WEAPON5': '0.300', 'HITCOUNT': '0.410', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.248', 'weapon2': '1.276', 'weapon3': '2.228', 'FRAGCOUNT': '4.000'} [2023-02-24 18:00:22,671][177154] DAMAGECOUNT value on done: 39426.0 [2023-02-24 18:00:22,671][177154] Sum rewards: -0.737, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.469', 'AMMO5': '0.012', 'AMMO2': '0.033', 'WEAPON1': '0.050', 'weapon5': '0.064', 'AMMO3': '0.087', 'ARMOR': '0.088', 'AMMO4': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.340', 'weapon4': '0.374', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.314', 'weapon3': '1.606', 'weapon2': '1.650', 'FRAGCOUNT': '2.000'} [2023-02-24 18:00:22,901][177172] DAMAGECOUNT value on done: 38499.0 [2023-02-24 18:00:22,969][177154] DAMAGECOUNT value on done: 40540.0 [2023-02-24 18:00:22,969][177154] Sum rewards: 2.097, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.858', 'AMMO5': '0.010', 'AMMO2': '0.022', 'ARMOR': '0.040', 'WEAPON1': '0.040', 'weapon4': '0.072', 'weapon5': '0.094', 'WEAPON4': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.120', 'WEAPON5': '0.250', 'HITCOUNT': '0.330', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.314', 'weapon2': '1.436', 'weapon3': '1.668', 'FRAGCOUNT': '5.000'} [2023-02-24 18:00:23,274][177154] DAMAGECOUNT value on done: 40260.0 [2023-02-24 18:00:23,274][177154] Sum rewards: 9.731, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.007', 'AMMO2': '0.008', 'HEALTH': '0.018', 'WEAPON1': '0.030', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'weapon5': '0.052', 'AMMO3': '0.073', 'WEAPON5': '0.150', 'weapon4': '0.198', 'WEAPON3': '0.450', 'HITCOUNT': '0.480', 'weapon3': '1.020', 'DAMAGECOUNT': '1.878', 'weapon2': '2.028', 'FRAGCOUNT': '7.000'} [2023-02-24 18:00:23,281][177171] DAMAGECOUNT value on done: 39377.0 [2023-02-24 18:00:23,282][177171] Sum rewards: -1.406, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.703', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.039', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'ARMOR': '0.080', 'AMMO3': '0.100', 'HITCOUNT': '0.120', 'weapon5': '0.138', 'weapon4': '0.200', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.315', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.154', 'weapon2': '1.938'} [2023-02-24 18:00:23,557][177157] DAMAGECOUNT value on done: 40954.0 [2023-02-24 18:00:23,558][177157] Sum rewards: 1.985, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.012', 'ARMOR': '0.020', 'AMMO2': '0.022', 'HEALTH': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.078', 'AMMO4': '0.109', 'HITCOUNT': '0.150', 'weapon5': '0.164', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.525', 'FRAGCOUNT': '1.000', 'weapon3': '1.188', 'weapon2': '2.406'} [2023-02-24 18:00:23,575][177171] DAMAGECOUNT value on done: 38978.0 [2023-02-24 18:00:23,576][177171] Sum rewards: -0.623, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.196', 'AMMO5': '0.012', 'AMMO2': '0.033', 'WEAPON1': '0.060', 'ARMOR': '0.080', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'weapon5': '0.152', 'AMMO4': '0.163', 'HITCOUNT': '0.180', 'WEAPON5': '0.300', 'weapon4': '0.432', 'DAMAGECOUNT': '0.525', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.090', 'weapon3': '1.512'} [2023-02-24 18:00:23,594][177157] DAMAGECOUNT value on done: 42090.0 [2023-02-24 18:00:23,595][177157] Sum rewards: 4.035, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.472', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'ARMOR': '0.071', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'weapon5': '0.158', 'weapon4': '0.160', 'WEAPON5': '0.300', 'HITCOUNT': '0.600', 'WEAPON3': '0.700', 'weapon3': '1.412', 'weapon2': '2.060', 'DAMAGECOUNT': '2.181', 'FRAGCOUNT': '5.000'} [2023-02-24 18:00:23,836][177171] DAMAGECOUNT value on done: 39595.0 [2023-02-24 18:00:23,837][177171] Sum rewards: 5.933, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.960', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'AMMO5': '0.013', 'ARMOR': '0.040', 'WEAPON1': '0.070', 'AMMO3': '0.073', 'weapon5': '0.094', 'WEAPON5': '0.350', 'HITCOUNT': '0.470', 'WEAPON3': '0.500', 'weapon3': '1.080', 'DAMAGECOUNT': '1.803', 'weapon2': '1.962', 'FRAGCOUNT': '5.000'} [2023-02-24 18:00:23,869][177157] DAMAGECOUNT value on done: 40538.0 [2023-02-24 18:00:23,870][177157] Sum rewards: 1.571, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.320', 'AMMO5': '0.007', 'AMMO2': '0.009', 'ARMOR': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'weapon5': '0.058', 'AMMO3': '0.063', 'WEAPON5': '0.200', 'weapon4': '0.210', 'HITCOUNT': '0.250', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.783', 'FRAGCOUNT': '1.000', 'weapon3': '1.360', 'weapon2': '1.852'} [2023-02-24 18:00:23,909][177157] DAMAGECOUNT value on done: 39042.0 [2023-02-24 18:00:23,910][177157] Sum rewards: 3.333, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.850', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.010', 'ARMOR': '0.035', 'WEAPON1': '0.040', 'weapon5': '0.048', 'AMMO3': '0.099', 'WEAPON5': '0.200', 'HITCOUNT': '0.560', 'WEAPON3': '0.750', 'weapon3': '1.450', 'DAMAGECOUNT': '1.854', 'weapon2': '1.886', 'FRAGCOUNT': '5.000'} [2023-02-24 18:00:24,129][177171] DAMAGECOUNT value on done: 39451.0 [2023-02-24 18:00:24,130][177171] Sum rewards: 2.075, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.090', 'AMMO5': '0.005', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.078', 'AMMO4': '0.093', 'weapon5': '0.094', 'WEAPON5': '0.150', 'weapon4': '0.230', 'HITCOUNT': '0.290', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.906', 'FRAGCOUNT': '1.000', 'weapon3': '1.148', 'weapon2': '2.122'} [2023-02-24 18:00:24,215][177155] DAMAGECOUNT value on done: 41181.0 [2023-02-24 18:00:24,216][177155] Sum rewards: 4.309, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.408', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.083', 'WEAPON1': '0.090', 'AMMO3': '0.111', 'weapon5': '0.162', 'WEAPON5': '0.250', 'HITCOUNT': '0.510', 'WEAPON3': '0.650', 'weapon3': '1.608', 'weapon2': '1.780', 'DAMAGECOUNT': '2.193', 'FRAGCOUNT': '4.000'} [2023-02-24 18:00:24,518][177155] DAMAGECOUNT value on done: 42737.0 [2023-02-24 18:00:24,634][177153] Updated weights for policy 0, policy_version 7680 (0.0008) [2023-02-24 18:00:24,766][177155] DAMAGECOUNT value on done: 42631.0 [2023-02-24 18:00:24,766][177155] Sum rewards: 3.865, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.120', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'AMMO3': '0.080', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'weapon5': '0.124', 'WEAPON5': '0.200', 'weapon4': '0.216', 'HITCOUNT': '0.500', 'WEAPON3': '0.550', 'weapon3': '1.526', 'DAMAGECOUNT': '1.698', 'weapon2': '1.832', 'FRAGCOUNT': '3.000'} [2023-02-24 18:00:25,050][177155] DAMAGECOUNT value on done: 41106.0 [2023-02-24 18:00:25,050][177155] Sum rewards: 1.329, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.763', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.019', 'ARMOR': '0.068', 'WEAPON1': '0.090', 'AMMO3': '0.152', 'weapon5': '0.186', 'HITCOUNT': '0.430', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'weapon2': '1.212', 'DAMAGECOUNT': '1.905', 'weapon3': '2.122', 'FRAGCOUNT': '5.000'} [2023-02-24 18:00:26,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 13926.4). Total num frames: 31477760. Throughput: 0: 3496.4. Samples: 7867578. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:00:26,376][177119] Avg episode reward: [(0, '2.946')] [2023-02-24 18:00:27,566][177153] Updated weights for policy 0, policy_version 7690 (0.0008) [2023-02-24 18:00:28,824][177156] DAMAGECOUNT value on done: 40863.0 [2023-02-24 18:00:28,824][177156] Sum rewards: 3.547, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.566', 'AMMO5': '0.010', 'AMMO2': '0.022', 'ARMOR': '0.052', 'WEAPON1': '0.060', 'AMMO3': '0.085', 'AMMO4': '0.109', 'weapon5': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.332', 'HITCOUNT': '0.390', 'WEAPON3': '0.550', 'weapon3': '1.322', 'DAMAGECOUNT': '1.557', 'weapon2': '1.896', 'FRAGCOUNT': '3.000'} [2023-02-24 18:00:29,089][177156] DAMAGECOUNT value on done: 41047.0 [2023-02-24 18:00:29,134][177156] DAMAGECOUNT value on done: 41395.0 [2023-02-24 18:00:29,135][177156] Sum rewards: 1.170, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.014', 'AMMO2': '0.022', 'WEAPON1': '0.050', 'ARMOR': '0.076', 'AMMO3': '0.090', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'weapon5': '0.210', 'WEAPON5': '0.300', 'weapon4': '0.304', 'HITCOUNT': '0.330', 'WEAPON3': '0.500', 'HEALTH': '0.574', 'DAMAGECOUNT': '1.398', 'weapon3': '1.424', 'FRAGCOUNT': '1.500', 'weapon2': '1.616'} [2023-02-24 18:00:29,405][177156] DAMAGECOUNT value on done: 41799.0 [2023-02-24 18:00:29,406][177156] Sum rewards: 1.572, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.973', 'AMMO5': '0.011', 'AMMO2': '0.020', 'ARMOR': '0.036', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.090', 'AMMO3': '0.092', 'AMMO4': '0.101', 'weapon4': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.380', 'WEAPON3': '0.650', 'weapon2': '1.104', 'DAMAGECOUNT': '1.176', 'weapon3': '1.534', 'FRAGCOUNT': '2.000'} [2023-02-24 18:00:30,500][177153] Updated weights for policy 0, policy_version 7700 (0.0008) [2023-02-24 18:00:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 31547392. Throughput: 0: 3498.3. Samples: 7888574. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:00:31,376][177119] Avg episode reward: [(0, '2.832')] [2023-02-24 18:00:33,419][177153] Updated weights for policy 0, policy_version 7710 (0.0009) [2023-02-24 18:00:36,345][177153] Updated weights for policy 0, policy_version 7720 (0.0009) [2023-02-24 18:00:36,376][177119] Fps is (10 sec: 14336.0, 60 sec: 13994.7, 300 sec: 13940.3). Total num frames: 31621120. Throughput: 0: 3494.4. Samples: 7899014. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:00:36,376][177119] Avg episode reward: [(0, '2.832')] [2023-02-24 18:00:39,078][177170] DAMAGECOUNT value on done: 41785.0 [2023-02-24 18:00:39,079][177170] Sum rewards: 0.520, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.890', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.062', 'AMMO4': '0.083', 'AMMO3': '0.092', 'ARMOR': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.316', 'HITCOUNT': '0.330', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.233', 'weapon3': '1.384', 'weapon2': '2.072', 'FRAGCOUNT': '3.000'} [2023-02-24 18:00:39,314][177153] Updated weights for policy 0, policy_version 7730 (0.0008) [2023-02-24 18:00:39,375][177170] DAMAGECOUNT value on done: 43896.0 [2023-02-24 18:00:39,375][177170] Sum rewards: -3.933, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.310', 'weapon5': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.053', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon4': '0.170', 'HITCOUNT': '0.220', 'WEAPON5': '0.300', 'ARMOR': '0.508', 'DAMAGECOUNT': '0.561', 'WEAPON3': '0.700', 'weapon3': '1.284', 'weapon2': '2.320'} [2023-02-24 18:00:39,487][177170] DAMAGECOUNT value on done: 36621.0 [2023-02-24 18:00:39,487][177170] Sum rewards: 0.868, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.276', 'AMMO5': '0.008', 'AMMO2': '0.019', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'AMMO4': '0.096', 'AMMO3': '0.112', 'weapon5': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.300', 'HITCOUNT': '0.380', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.104', 'weapon2': '1.202', 'weapon3': '1.858', 'FRAGCOUNT': '3.000'} [2023-02-24 18:00:39,653][177158] DAMAGECOUNT value on done: 39481.0 [2023-02-24 18:00:39,654][177158] Sum rewards: 6.726, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.630', 'AMMO2': '0.009', 'AMMO5': '0.017', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'weapon4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.081', 'weapon5': '0.160', 'WEAPON5': '0.400', 'HITCOUNT': '0.590', 'WEAPON3': '0.600', 'weapon2': '1.784', 'weapon3': '1.788', 'DAMAGECOUNT': '2.220', 'FRAGCOUNT': '7.000'} [2023-02-24 18:00:39,797][177170] DAMAGECOUNT value on done: 43136.0 [2023-02-24 18:00:39,797][177170] Sum rewards: 3.093, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.625', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'weapon4': '0.032', 'WEAPON4': '0.050', 'ARMOR': '0.076', 'AMMO3': '0.080', 'HITCOUNT': '0.420', 'WEAPON3': '0.450', 'weapon3': '1.056', 'DAMAGECOUNT': '1.218', 'weapon2': '2.602', 'FRAGCOUNT': '3.000'} [2023-02-24 18:00:39,955][177158] DAMAGECOUNT value on done: 40193.0 [2023-02-24 18:00:39,956][177158] Sum rewards: 4.950, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.214', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'AMMO3': '0.083', 'WEAPON5': '0.150', 'weapon5': '0.230', 'HITCOUNT': '0.510', 'WEAPON3': '0.650', 'weapon3': '1.356', 'DAMAGECOUNT': '1.803', 'weapon2': '1.820', 'FRAGCOUNT': '4.000'} [2023-02-24 18:00:40,702][177172] DAMAGECOUNT value on done: 40067.0 [2023-02-24 18:00:40,702][177172] Sum rewards: 2.989, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.012', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.050', 'AMMO3': '0.100', 'weapon5': '0.132', 'WEAPON5': '0.200', 'HEALTH': '0.356', 'HITCOUNT': '0.540', 'WEAPON3': '0.550', 'weapon2': '1.564', 'DAMAGECOUNT': '1.845', 'weapon3': '2.032', 'FRAGCOUNT': '3.000'} [2023-02-24 18:00:40,802][177158] DAMAGECOUNT value on done: 37907.0 [2023-02-24 18:00:40,802][177158] Sum rewards: -0.018, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.405', 'AMMO2': '0.003', 'AMMO5': '0.003', 'AMMO4': '0.013', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'weapon5': '0.056', 'AMMO3': '0.078', 'WEAPON5': '0.100', 'HITCOUNT': '0.300', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.810', 'FRAGCOUNT': '1.000', 'weapon3': '1.346', 'weapon2': '2.318'} [2023-02-24 18:00:41,001][177172] DAMAGECOUNT value on done: 38927.0 [2023-02-24 18:00:41,001][177172] Sum rewards: 3.835, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'AMMO3': '0.065', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'WEAPON3': '0.350', 'HITCOUNT': '0.360', 'HEALTH': '0.365', 'weapon4': '0.372', 'DAMAGECOUNT': '1.065', 'weapon3': '1.106', 'weapon2': '1.864', 'FRAGCOUNT': '3.000'} [2023-02-24 18:00:41,107][177158] DAMAGECOUNT value on done: 42864.0 [2023-02-24 18:00:41,108][177158] Sum rewards: 6.903, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.385', 'AMMO5': '0.005', 'AMMO2': '0.013', 'ARMOR': '0.032', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.065', 'AMMO4': '0.066', 'weapon4': '0.066', 'weapon5': '0.112', 'WEAPON5': '0.150', 'HITCOUNT': '0.350', 'WEAPON3': '0.500', 'weapon3': '1.324', 'DAMAGECOUNT': '1.455', 'weapon2': '1.800', 'FRAGCOUNT': '5.000'} [2023-02-24 18:00:41,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 31686656. Throughput: 0: 3492.1. Samples: 7919916. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 18:00:41,376][177119] Avg episode reward: [(0, '2.739')] [2023-02-24 18:00:41,678][177154] DAMAGECOUNT value on done: 42069.0 [2023-02-24 18:00:41,679][177154] Sum rewards: 7.215, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.639', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.112', 'weapon4': '0.156', 'weapon5': '0.186', 'WEAPON5': '0.350', 'HITCOUNT': '0.650', 'WEAPON3': '0.700', 'weapon3': '1.680', 'weapon2': '1.698', 'DAMAGECOUNT': '2.853', 'FRAGCOUNT': '6.000'} [2023-02-24 18:00:41,927][177172] DAMAGECOUNT value on done: 39888.0 [2023-02-24 18:00:41,927][177172] Sum rewards: -1.630, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.006', 'AMMO2': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.034', 'ARMOR': '0.044', 'WEAPON4': '0.050', 'weapon4': '0.056', 'AMMO3': '0.151', 'weapon5': '0.198', 'WEAPON5': '0.200', 'HITCOUNT': '0.390', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.410', 'FRAGCOUNT': '1.500', 'weapon2': '1.594', 'weapon3': '1.902'} [2023-02-24 18:00:41,982][177154] DAMAGECOUNT value on done: 40187.0 [2023-02-24 18:00:41,983][177154] Sum rewards: 3.198, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.138', 'AMMO5': '0.020', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'AMMO3': '0.071', 'WEAPON1': '0.090', 'AMMO4': '0.123', 'weapon5': '0.174', 'weapon4': '0.208', 'HITCOUNT': '0.490', 'WEAPON3': '0.500', 'WEAPON5': '0.550', 'weapon3': '1.308', 'weapon2': '1.944', 'DAMAGECOUNT': '2.283', 'FRAGCOUNT': '4.000'} [2023-02-24 18:00:42,225][177172] DAMAGECOUNT value on done: 39197.0 [2023-02-24 18:00:42,225][177172] Sum rewards: 1.767, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.608', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.011', 'ARMOR': '0.036', 'WEAPON1': '0.050', 'AMMO3': '0.092', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.348', 'HITCOUNT': '0.460', 'WEAPON3': '0.650', 'weapon3': '1.244', 'weapon2': '2.026', 'DAMAGECOUNT': '2.094', 'FRAGCOUNT': '4.000'} [2023-02-24 18:00:42,259][177153] Updated weights for policy 0, policy_version 7740 (0.0008) [2023-02-24 18:00:42,278][177154] DAMAGECOUNT value on done: 40975.0 [2023-02-24 18:00:42,278][177154] Sum rewards: 2.339, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.250', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON1': '0.050', 'AMMO4': '0.056', 'weapon7': '0.064', 'AMMO3': '0.081', 'weapon5': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.264', 'HITCOUNT': '0.360', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.305', 'weapon3': '1.594', 'weapon2': '1.802', 'FRAGCOUNT': '4.000'} [2023-02-24 18:00:42,572][177154] DAMAGECOUNT value on done: 41110.0 [2023-02-24 18:00:42,573][177154] Sum rewards: 7.045, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'weapon5': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'HEALTH': '0.080', 'AMMO3': '0.093', 'WEAPON3': '0.450', 'HITCOUNT': '0.680', 'weapon3': '1.294', 'weapon2': '2.006', 'DAMAGECOUNT': '2.550', 'FRAGCOUNT': '5.000'} [2023-02-24 18:00:42,574][177171] DAMAGECOUNT value on done: 39839.0 [2023-02-24 18:00:42,574][177171] Sum rewards: 1.338, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.244', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.052', 'WEAPON1': '0.060', 'AMMO3': '0.084', 'AMMO4': '0.099', 'weapon5': '0.118', 'WEAPON5': '0.150', 'HITCOUNT': '0.340', 'WEAPON3': '0.500', 'weapon3': '1.282', 'DAMAGECOUNT': '1.386', 'weapon2': '1.936', 'FRAGCOUNT': '3.000'} [2023-02-24 18:00:42,870][177171] DAMAGECOUNT value on done: 39019.0 [2023-02-24 18:00:42,905][177157] DAMAGECOUNT value on done: 41491.0 [2023-02-24 18:00:42,905][177157] Sum rewards: 4.089, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.362', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.049', 'weapon7': '0.050', 'ARMOR': '0.056', 'AMMO3': '0.085', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.286', 'HITCOUNT': '0.490', 'WEAPON3': '0.500', 'weapon3': '1.220', 'DAMAGECOUNT': '1.611', 'weapon2': '1.994', 'FRAGCOUNT': '5.000'} [2023-02-24 18:00:42,942][177157] DAMAGECOUNT value on done: 42574.0 [2023-02-24 18:00:42,943][177157] Sum rewards: 3.821, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.874', 'AMMO2': '0.004', 'AMMO4': '0.019', 'AMMO3': '0.067', 'ARMOR': '0.085', 'WEAPON4': '0.300', 'weapon4': '0.322', 'HITCOUNT': '0.420', 'WEAPON3': '0.600', 'weapon3': '1.236', 'DAMAGECOUNT': '1.452', 'weapon2': '1.690', 'FRAGCOUNT': '4.000'} [2023-02-24 18:00:43,135][177171] DAMAGECOUNT value on done: 40240.0 [2023-02-24 18:00:43,135][177171] Sum rewards: 6.453, reward structure: {'DEATHCOUNT': '-3.000', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.020', 'AMMO3': '0.030', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.099', 'WEAPON3': '0.150', 'weapon5': '0.200', 'HITCOUNT': '0.240', 'weapon4': '0.278', 'WEAPON5': '0.300', 'HEALTH': '0.334', 'weapon3': '0.614', 'DAMAGECOUNT': '1.935', 'weapon2': '2.134', 'FRAGCOUNT': '3.000'} [2023-02-24 18:00:43,216][177157] DAMAGECOUNT value on done: 41068.0 [2023-02-24 18:00:43,217][177157] Sum rewards: 0.007, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.164', 'AMMO5': '0.010', 'AMMO2': '0.028', 'WEAPON1': '0.070', 'AMMO3': '0.101', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'weapon4': '0.194', 'WEAPON5': '0.250', 'weapon5': '0.282', 'HITCOUNT': '0.310', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.338', 'DAMAGECOUNT': '1.590', 'weapon2': '1.658'} [2023-02-24 18:00:43,252][177157] DAMAGECOUNT value on done: 39827.0 [2023-02-24 18:00:43,252][177157] Sum rewards: 6.695, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.400', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'ARMOR': '0.052', 'AMMO3': '0.105', 'AMMO4': '0.139', 'WEAPON5': '0.250', 'weapon5': '0.288', 'WEAPON4': '0.350', 'HITCOUNT': '0.400', 'WEAPON3': '0.650', 'weapon4': '0.724', 'weapon2': '0.844', 'weapon3': '1.628', 'DAMAGECOUNT': '2.355', 'FRAGCOUNT': '6.000'} [2023-02-24 18:00:43,406][177155] DAMAGECOUNT value on done: 41223.0 [2023-02-24 18:00:43,447][177171] DAMAGECOUNT value on done: 40158.0 [2023-02-24 18:00:43,448][177171] Sum rewards: 2.448, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.506', 'AMMO2': '0.016', 'AMMO5': '0.016', 'ARMOR': '0.044', 'WEAPON1': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.095', 'WEAPON4': '0.200', 'weapon5': '0.214', 'weapon4': '0.260', 'WEAPON5': '0.400', 'HITCOUNT': '0.500', 'WEAPON3': '0.700', 'weapon2': '1.562', 'weapon3': '1.698', 'DAMAGECOUNT': '2.121', 'FRAGCOUNT': '3.500'} [2023-02-24 18:00:43,704][177155] DAMAGECOUNT value on done: 43202.0 [2023-02-24 18:00:43,705][177155] Sum rewards: 4.061, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.830', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.022', 'WEAPON1': '0.040', 'weapon5': '0.084', 'ARMOR': '0.088', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.260', 'HITCOUNT': '0.400', 'WEAPON3': '0.600', 'weapon3': '1.364', 'DAMAGECOUNT': '1.395', 'weapon2': '1.984', 'FRAGCOUNT': '5.000'} [2023-02-24 18:00:43,940][177155] DAMAGECOUNT value on done: 43211.0 [2023-02-24 18:00:43,940][177155] Sum rewards: 4.447, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.098', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.040', 'AMMO4': '0.053', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'weapon4': '0.110', 'weapon5': '0.248', 'WEAPON5': '0.300', 'HITCOUNT': '0.350', 'WEAPON3': '0.500', 'weapon3': '1.584', 'DAMAGECOUNT': '1.740', 'weapon2': '1.912', 'FRAGCOUNT': '6.000'} [2023-02-24 18:00:44,241][177155] DAMAGECOUNT value on done: 41214.0 [2023-02-24 18:00:45,173][177153] Updated weights for policy 0, policy_version 7750 (0.0009) [2023-02-24 18:00:46,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13940.3). Total num frames: 31760384. Throughput: 0: 3491.4. Samples: 7940854. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 18:00:46,376][177119] Avg episode reward: [(0, '2.525')] [2023-02-24 18:00:48,052][177156] DAMAGECOUNT value on done: 41579.0 [2023-02-24 18:00:48,053][177156] Sum rewards: 8.163, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'AMMO4': '0.200', 'weapon4': '0.258', 'HEALTH': '0.268', 'WEAPON3': '0.350', 'HITCOUNT': '0.540', 'weapon3': '1.488', 'weapon2': '1.558', 'DAMAGECOUNT': '2.148', 'FRAGCOUNT': '7.000'} [2023-02-24 18:00:48,071][177153] Updated weights for policy 0, policy_version 7760 (0.0008) [2023-02-24 18:00:48,300][177156] DAMAGECOUNT value on done: 41473.0 [2023-02-24 18:00:48,301][177156] Sum rewards: 4.277, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.340', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.042', 'weapon5': '0.044', 'ARMOR': '0.056', 'AMMO3': '0.081', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'HITCOUNT': '0.390', 'weapon4': '0.524', 'WEAPON3': '0.550', 'weapon3': '1.172', 'DAMAGECOUNT': '1.278', 'weapon2': '1.596', 'FRAGCOUNT': '3.000'} [2023-02-24 18:00:48,367][177156] DAMAGECOUNT value on done: 41659.0 [2023-02-24 18:00:48,368][177156] Sum rewards: 0.365, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.725', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'weapon5': '0.066', 'ARMOR': '0.080', 'AMMO4': '0.081', 'AMMO3': '0.093', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'weapon4': '0.250', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.792', 'FRAGCOUNT': '1.000', 'weapon3': '1.184', 'weapon2': '1.630'} [2023-02-24 18:00:48,618][177156] DAMAGECOUNT value on done: 42458.0 [2023-02-24 18:00:48,618][177156] Sum rewards: 8.157, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.645', 'AMMO2': '0.015', 'AMMO5': '0.017', 'AMMO3': '0.060', 'WEAPON1': '0.060', 'AMMO4': '0.076', 'weapon5': '0.344', 'HITCOUNT': '0.350', 'WEAPON3': '0.400', 'WEAPON5': '0.450', 'weapon3': '1.424', 'weapon2': '1.878', 'DAMAGECOUNT': '1.977', 'FRAGCOUNT': '7.000'} [2023-02-24 18:00:50,984][177153] Updated weights for policy 0, policy_version 7770 (0.0008) [2023-02-24 18:00:51,376][177119] Fps is (10 sec: 14336.1, 60 sec: 13994.7, 300 sec: 13940.3). Total num frames: 31830016. Throughput: 0: 3495.5. Samples: 7951508. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 18:00:51,376][177119] Avg episode reward: [(0, '2.646')] [2023-02-24 18:00:53,931][177153] Updated weights for policy 0, policy_version 7780 (0.0008) [2023-02-24 18:00:56,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13940.3). Total num frames: 31899648. Throughput: 0: 3494.7. Samples: 7972466. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 18:00:56,376][177119] Avg episode reward: [(0, '2.646')] [2023-02-24 18:00:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000007788_31899648.pth... [2023-02-24 18:00:56,442][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000006971_28553216.pth [2023-02-24 18:00:56,875][177153] Updated weights for policy 0, policy_version 7790 (0.0009) [2023-02-24 18:00:57,273][177170] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 18:00:58,305][177170] DAMAGECOUNT value on done: 42174.0 [2023-02-24 18:00:58,305][177170] Sum rewards: -1.899, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.290', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'WEAPON1': '0.040', 'AMMO3': '0.129', 'weapon5': '0.178', 'HITCOUNT': '0.180', 'WEAPON5': '0.200', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.167', 'weapon3': '1.602', 'weapon2': '1.630', 'FRAGCOUNT': '2.000'} [2023-02-24 18:00:58,604][177170] DAMAGECOUNT value on done: 44694.0 [2023-02-24 18:00:58,605][177170] Sum rewards: 7.160, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.042', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.010', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.076', 'WEAPON3': '0.450', 'HITCOUNT': '0.610', 'weapon3': '1.380', 'DAMAGECOUNT': '2.394', 'weapon2': '2.404', 'FRAGCOUNT': '5.000'} [2023-02-24 18:00:58,732][177170] DAMAGECOUNT value on done: 36956.0 [2023-02-24 18:00:58,733][177170] Sum rewards: -1.617, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.410', 'AMMO5': '0.018', 'ARMOR': '0.036', 'AMMO2': '0.046', 'WEAPON1': '0.080', 'AMMO3': '0.129', 'weapon5': '0.132', 'AMMO4': '0.229', 'WEAPON4': '0.250', 'HITCOUNT': '0.280', 'weapon4': '0.372', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'weapon2': '0.972', 'DAMAGECOUNT': '1.005', 'FRAGCOUNT': '2.000', 'weapon3': '2.044'} [2023-02-24 18:00:58,927][177158] DAMAGECOUNT value on done: 40422.0 [2023-02-24 18:00:58,927][177158] Sum rewards: 8.145, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.015', 'AMMO5': '0.009', 'AMMO2': '0.036', 'WEAPON1': '0.060', 'AMMO3': '0.125', 'AMMO4': '0.181', 'WEAPON5': '0.300', 'weapon5': '0.314', 'HITCOUNT': '0.790', 'WEAPON3': '0.900', 'weapon2': '1.532', 'weapon3': '1.840', 'DAMAGECOUNT': '2.823', 'FRAGCOUNT': '8.000'} [2023-02-24 18:00:59,034][177170] DAMAGECOUNT value on done: 44297.0 [2023-02-24 18:00:59,035][177170] Sum rewards: 8.256, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.062', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.029', 'WEAPON1': '0.090', 'AMMO3': '0.101', 'WEAPON5': '0.250', 'weapon5': '0.288', 'HITCOUNT': '0.450', 'WEAPON3': '0.600', 'weapon3': '1.364', 'weapon2': '1.878', 'DAMAGECOUNT': '3.255', 'FRAGCOUNT': '10.000'} [2023-02-24 18:00:59,230][177158] DAMAGECOUNT value on done: 41090.0 [2023-02-24 18:00:59,231][177158] Sum rewards: 4.709, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.410', 'AMMO2': '0.003', 'weapon4': '0.004', 'AMMO4': '0.013', 'AMMO5': '0.014', 'AMMO3': '0.069', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'weapon5': '0.114', 'WEAPON5': '0.350', 'HITCOUNT': '0.460', 'WEAPON3': '0.550', 'weapon3': '1.350', 'weapon2': '1.830', 'DAMAGECOUNT': '2.691', 'FRAGCOUNT': '3.000'} [2023-02-24 18:00:59,837][177153] Updated weights for policy 0, policy_version 7800 (0.0008) [2023-02-24 18:00:59,944][177172] DAMAGECOUNT value on done: 40840.0 [2023-02-24 18:00:59,944][177172] Sum rewards: 2.417, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.314', 'AMMO5': '0.007', 'AMMO2': '0.014', 'ARMOR': '0.044', 'WEAPON1': '0.060', 'AMMO4': '0.069', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.280', 'weapon5': '0.286', 'HITCOUNT': '0.450', 'WEAPON3': '0.750', 'weapon2': '1.272', 'weapon3': '1.708', 'DAMAGECOUNT': '2.319', 'FRAGCOUNT': '5.000'} [2023-02-24 18:01:00,077][177158] DAMAGECOUNT value on done: 38152.0 [2023-02-24 18:01:00,078][177158] Sum rewards: -2.168, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.635', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'weapon5': '0.206', 'HITCOUNT': '0.230', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.735', 'FRAGCOUNT': '1.000', 'weapon2': '1.804', 'weapon3': '1.842'} [2023-02-24 18:01:00,256][177172] DAMAGECOUNT value on done: 39653.0 [2023-02-24 18:01:00,256][177172] Sum rewards: 5.445, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.615', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.014', 'WEAPON1': '0.030', 'AMMO3': '0.066', 'WEAPON5': '0.100', 'weapon5': '0.162', 'HITCOUNT': '0.410', 'WEAPON3': '0.500', 'weapon3': '1.376', 'DAMAGECOUNT': '2.178', 'weapon2': '2.216', 'FRAGCOUNT': '5.000'} [2023-02-24 18:01:00,387][177158] DAMAGECOUNT value on done: 43462.0 [2023-02-24 18:01:00,388][177158] Sum rewards: 1.959, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.626', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'weapon7': '0.060', 'AMMO3': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon5': '0.152', 'WEAPON7': '0.200', 'weapon4': '0.214', 'HITCOUNT': '0.450', 'WEAPON3': '0.500', 'weapon3': '1.240', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.794', 'weapon2': '1.882'} [2023-02-24 18:01:00,845][177154] DAMAGECOUNT value on done: 42502.0 [2023-02-24 18:01:01,143][177154] DAMAGECOUNT value on done: 40836.0 [2023-02-24 18:01:01,144][177154] Sum rewards: 0.262, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.494', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON1': '0.040', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.126', 'weapon5': '0.182', 'weapon4': '0.192', 'HITCOUNT': '0.610', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.344', 'weapon3': '1.790', 'DAMAGECOUNT': '1.947'} [2023-02-24 18:01:01,168][177172] DAMAGECOUNT value on done: 40453.0 [2023-02-24 18:01:01,168][177172] Sum rewards: -1.660, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.428', 'FRAGCOUNT': '0.000', 'AMMO5': '0.016', 'AMMO2': '0.019', 'WEAPON1': '0.050', 'AMMO3': '0.073', 'ARMOR': '0.084', 'AMMO4': '0.096', 'HITCOUNT': '0.280', 'WEAPON4': '0.350', 'weapon5': '0.398', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon4': '0.654', 'weapon2': '1.094', 'weapon3': '1.458', 'DAMAGECOUNT': '1.695'} [2023-02-24 18:01:01,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.6, 300 sec: 13940.3). Total num frames: 31969280. Throughput: 0: 3485.2. Samples: 7993182. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:01:01,376][177119] Avg episode reward: [(0, '2.533')] [2023-02-24 18:01:01,434][177154] DAMAGECOUNT value on done: 41195.0 [2023-02-24 18:01:01,434][177154] Sum rewards: 2.339, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.365', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO3': '0.040', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.130', 'WEAPON7': '0.200', 'weapon5': '0.242', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.660', 'weapon3': '1.056', 'weapon2': '1.228', 'FRAGCOUNT': '2.000'} [2023-02-24 18:01:01,465][177172] DAMAGECOUNT value on done: 40034.0 [2023-02-24 18:01:01,466][177172] Sum rewards: 5.244, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.226', 'AMMO5': '0.015', 'AMMO2': '0.016', 'ARMOR': '0.056', 'AMMO4': '0.079', 'WEAPON1': '0.080', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon4': '0.218', 'HITCOUNT': '0.310', 'WEAPON5': '0.450', 'weapon5': '0.628', 'WEAPON3': '0.650', 'weapon3': '1.268', 'weapon2': '1.494', 'DAMAGECOUNT': '2.511', 'FRAGCOUNT': '6.000'} [2023-02-24 18:01:01,728][177154] DAMAGECOUNT value on done: 41542.0 [2023-02-24 18:01:01,728][177154] Sum rewards: 3.055, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.748', 'ARMOR': '0.005', 'AMMO2': '0.007', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.036', 'weapon5': '0.082', 'AMMO3': '0.117', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.260', 'weapon4': '0.302', 'WEAPON3': '0.600', 'weapon2': '0.856', 'DAMAGECOUNT': '1.296', 'weapon3': '1.796', 'FRAGCOUNT': '4.000'} [2023-02-24 18:01:01,770][177171] DAMAGECOUNT value on done: 40654.0 [2023-02-24 18:01:01,770][177171] Sum rewards: 3.317, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.573', 'AMMO2': '0.020', 'AMMO5': '0.020', 'ARMOR': '0.028', 'WEAPON1': '0.070', 'AMMO4': '0.098', 'AMMO3': '0.140', 'weapon5': '0.248', 'WEAPON5': '0.450', 'HITCOUNT': '0.480', 'WEAPON3': '0.800', 'weapon2': '0.884', 'weapon3': '2.208', 'DAMAGECOUNT': '2.445', 'FRAGCOUNT': '5.000'} [2023-02-24 18:01:02,070][177171] DAMAGECOUNT value on done: 39443.0 [2023-02-24 18:01:02,070][177171] Sum rewards: -0.609, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.490', 'AMMO2': '0.015', 'AMMO5': '0.020', 'ARMOR': '0.020', 'WEAPON1': '0.060', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'weapon4': '0.136', 'AMMO3': '0.140', 'HITCOUNT': '0.260', 'weapon5': '0.290', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'weapon2': '1.144', 'DAMAGECOUNT': '1.272', 'weapon3': '1.950', 'FRAGCOUNT': '3.000'} [2023-02-24 18:01:02,224][177157] DAMAGECOUNT value on done: 41961.0 [2023-02-24 18:01:02,224][177157] Sum rewards: 1.680, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.144', 'AMMO5': '0.007', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'AMMO3': '0.102', 'AMMO4': '0.115', 'weapon5': '0.120', 'WEAPON5': '0.150', 'HITCOUNT': '0.380', 'WEAPON3': '0.600', 'weapon3': '1.048', 'DAMAGECOUNT': '1.410', 'FRAGCOUNT': '2.000', 'weapon2': '2.588'} [2023-02-24 18:01:02,262][177157] DAMAGECOUNT value on done: 43465.0 [2023-02-24 18:01:02,262][177157] Sum rewards: 8.825, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.490', 'AMMO4': '-0.023', 'AMMO2': '-0.004', 'AMMO5': '0.018', 'ARMOR': '0.032', 'WEAPON1': '0.060', 'AMMO3': '0.120', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.216', 'WEAPON5': '0.400', 'HITCOUNT': '0.600', 'WEAPON3': '0.850', 'weapon2': '1.580', 'weapon3': '1.942', 'DAMAGECOUNT': '2.673', 'FRAGCOUNT': '8.000'} [2023-02-24 18:01:02,335][177171] DAMAGECOUNT value on done: 40880.0 [2023-02-24 18:01:02,335][177171] Sum rewards: 1.091, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.911', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.040', 'WEAPON1': '0.070', 'AMMO3': '0.104', 'AMMO4': '0.198', 'WEAPON4': '0.200', 'weapon4': '0.278', 'WEAPON5': '0.300', 'weapon5': '0.322', 'HITCOUNT': '0.530', 'WEAPON3': '0.700', 'weapon2': '1.252', 'weapon3': '1.816', 'DAMAGECOUNT': '1.920', 'FRAGCOUNT': '2.500'} [2023-02-24 18:01:02,536][177157] DAMAGECOUNT value on done: 41303.0 [2023-02-24 18:01:02,537][177157] Sum rewards: -1.443, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.395', 'AMMO5': '0.012', 'AMMO2': '0.028', 'ARMOR': '0.044', 'WEAPON1': '0.060', 'AMMO3': '0.090', 'AMMO4': '0.139', 'WEAPON4': '0.200', 'weapon5': '0.210', 'HITCOUNT': '0.220', 'WEAPON5': '0.300', 'weapon4': '0.414', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.705', 'FRAGCOUNT': '1.000', 'weapon2': '1.380', 'weapon3': '1.750'} [2023-02-24 18:01:02,575][177157] DAMAGECOUNT value on done: 39917.0 [2023-02-24 18:01:02,637][177171] DAMAGECOUNT value on done: 40613.0 [2023-02-24 18:01:02,637][177171] Sum rewards: 1.437, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.868', 'AMMO5': '0.007', 'AMMO2': '0.011', 'ARMOR': '0.012', 'WEAPON1': '0.030', 'weapon4': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.079', 'WEAPON5': '0.150', 'weapon5': '0.222', 'HITCOUNT': '0.230', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.365', 'weapon3': '1.574', 'weapon2': '1.932', 'FRAGCOUNT': '2.000'} [2023-02-24 18:01:02,654][177155] DAMAGECOUNT value on done: 41683.0 [2023-02-24 18:01:02,655][177155] Sum rewards: 1.538, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.162', 'AMMO5': '0.021', 'AMMO2': '0.027', 'ARMOR': '0.040', 'WEAPON1': '0.090', 'AMMO4': '0.132', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'HITCOUNT': '0.250', 'weapon4': '0.312', 'weapon5': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.732', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.380', 'weapon3': '2.074', 'FRAGCOUNT': '3.000'} [2023-02-24 18:01:02,813][177153] Updated weights for policy 0, policy_version 7810 (0.0008) [2023-02-24 18:01:02,949][177155] DAMAGECOUNT value on done: 43932.0 [2023-02-24 18:01:02,949][177155] Sum rewards: 4.335, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.280', 'AMMO5': '0.010', 'AMMO2': '0.024', 'ARMOR': '0.040', 'WEAPON1': '0.040', 'weapon5': '0.110', 'AMMO4': '0.119', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.424', 'HITCOUNT': '0.590', 'WEAPON3': '0.800', 'weapon2': '1.194', 'weapon3': '1.842', 'DAMAGECOUNT': '2.190', 'FRAGCOUNT': '5.000'} [2023-02-24 18:01:03,186][177155] DAMAGECOUNT value on done: 43961.0 [2023-02-24 18:01:03,187][177155] Sum rewards: 2.786, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.990', 'AMMO5': '0.003', 'weapon7': '0.008', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.052', 'weapon5': '0.076', 'ARMOR': '0.080', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.264', 'HITCOUNT': '0.620', 'WEAPON3': '0.700', 'weapon3': '1.546', 'weapon2': '1.906', 'DAMAGECOUNT': '2.250', 'FRAGCOUNT': '3.000'} [2023-02-24 18:01:03,485][177155] DAMAGECOUNT value on done: 41943.0 [2023-02-24 18:01:03,486][177155] Sum rewards: 7.932, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.054', 'AMMO2': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO4': '0.040', 'weapon7': '0.048', 'AMMO3': '0.062', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.320', 'WEAPON3': '0.400', 'weapon5': '0.444', 'weapon3': '1.450', 'weapon2': '1.736', 'DAMAGECOUNT': '2.187', 'FRAGCOUNT': '5.000'} [2023-02-24 18:01:03,566][177158] Large shaping reward 2.602 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('weapon7', 0.002)] [2023-02-24 18:01:05,714][177153] Updated weights for policy 0, policy_version 7820 (0.0008) [2023-02-24 18:01:06,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.6, 300 sec: 13940.3). Total num frames: 32038912. Throughput: 0: 3485.8. Samples: 8003630. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:01:06,376][177119] Avg episode reward: [(0, '2.543')] [2023-02-24 18:01:07,373][177156] DAMAGECOUNT value on done: 42415.0 [2023-02-24 18:01:07,373][177156] Sum rewards: 8.810, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.547', 'AMMO5': '0.014', 'AMMO2': '0.018', 'WEAPON1': '0.070', 'AMMO3': '0.075', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'weapon4': '0.178', 'weapon5': '0.320', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.650', 'weapon2': '1.532', 'weapon3': '1.552', 'DAMAGECOUNT': '2.508', 'FRAGCOUNT': '8.000'} [2023-02-24 18:01:07,641][177156] DAMAGECOUNT value on done: 41836.0 [2023-02-24 18:01:07,642][177156] Sum rewards: 1.434, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.107', 'AMMO2': '0.010', 'AMMO5': '0.010', 'ARMOR': '0.028', 'WEAPON1': '0.040', 'AMMO4': '0.048', 'AMMO3': '0.074', 'weapon7': '0.084', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.184', 'WEAPON7': '0.200', 'HITCOUNT': '0.220', 'WEAPON5': '0.250', 'weapon4': '0.282', 'WEAPON3': '0.600', 'weapon2': '0.872', 'DAMAGECOUNT': '1.089', 'weapon3': '1.460', 'FRAGCOUNT': '2.000'} [2023-02-24 18:01:07,690][177156] DAMAGECOUNT value on done: 42738.0 [2023-02-24 18:01:07,690][177156] Sum rewards: 13.275, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.226', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.070', 'AMMO4': '0.088', 'AMMO3': '0.106', 'weapon5': '0.252', 'WEAPON5': '0.300', 'HITCOUNT': '0.610', 'WEAPON3': '0.650', 'weapon2': '1.434', 'weapon3': '1.726', 'DAMAGECOUNT': '3.237', 'FRAGCOUNT': '11.000'} [2023-02-24 18:01:07,958][177156] DAMAGECOUNT value on done: 42763.0 [2023-02-24 18:01:07,958][177156] Sum rewards: -0.735, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.660', 'AMMO5': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.050', 'weapon4': '0.074', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'WEAPON5': '0.250', 'HITCOUNT': '0.260', 'weapon5': '0.374', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.915', 'weapon3': '0.990', 'weapon2': '1.590', 'FRAGCOUNT': '2.000'} [2023-02-24 18:01:08,666][177153] Updated weights for policy 0, policy_version 7830 (0.0008) [2023-02-24 18:01:11,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 13940.3). Total num frames: 32108544. Throughput: 0: 3490.9. Samples: 8024668. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:01:11,376][177119] Avg episode reward: [(0, '2.661')] [2023-02-24 18:01:11,598][177153] Updated weights for policy 0, policy_version 7840 (0.0009) [2023-02-24 18:01:14,514][177153] Updated weights for policy 0, policy_version 7850 (0.0008) [2023-02-24 18:01:16,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.6, 300 sec: 13940.3). Total num frames: 32178176. Throughput: 0: 3488.5. Samples: 8045558. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:01:16,376][177119] Avg episode reward: [(0, '2.661')] [2023-02-24 18:01:17,482][177153] Updated weights for policy 0, policy_version 7860 (0.0008) [2023-02-24 18:01:17,631][177170] DAMAGECOUNT value on done: 42791.0 [2023-02-24 18:01:17,632][177170] Sum rewards: 5.442, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.013', 'AMMO2': '0.015', 'WEAPON1': '0.060', 'AMMO4': '0.075', 'HEALTH': '0.078', 'AMMO3': '0.105', 'weapon5': '0.128', 'WEAPON5': '0.300', 'HITCOUNT': '0.510', 'WEAPON3': '0.650', 'weapon3': '1.764', 'DAMAGECOUNT': '1.851', 'weapon2': '1.892', 'FRAGCOUNT': '4.000'} [2023-02-24 18:01:17,937][177170] DAMAGECOUNT value on done: 45293.0 [2023-02-24 18:01:17,937][177170] Sum rewards: 4.910, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO2': '0.055', 'AMMO3': '0.066', 'weapon5': '0.070', 'HEALTH': '0.171', 'AMMO4': '0.274', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.520', 'weapon4': '1.028', 'weapon3': '1.236', 'weapon2': '1.340', 'DAMAGECOUNT': '1.797', 'FRAGCOUNT': '5.000'} [2023-02-24 18:01:18,063][177170] DAMAGECOUNT value on done: 37304.0 [2023-02-24 18:01:18,064][177170] Sum rewards: 0.272, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.530', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON1': '0.060', 'weapon5': '0.086', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon4': '0.144', 'WEAPON5': '0.200', 'HITCOUNT': '0.330', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.044', 'weapon3': '1.636', 'weapon2': '1.852', 'FRAGCOUNT': '3.000'} [2023-02-24 18:01:18,183][177158] DAMAGECOUNT value on done: 40830.0 [2023-02-24 18:01:18,183][177158] Sum rewards: 5.076, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.423', 'AMMO2': '0.016', 'AMMO3': '0.040', 'ARMOR': '0.040', 'weapon7': '0.056', 'AMMO4': '0.081', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'WEAPON3': '0.300', 'weapon4': '0.388', 'weapon3': '0.938', 'DAMAGECOUNT': '1.224', 'weapon2': '1.956', 'FRAGCOUNT': '4.000'} [2023-02-24 18:01:18,365][177170] DAMAGECOUNT value on done: 45002.0 [2023-02-24 18:01:18,366][177170] Sum rewards: 6.322, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.970', 'AMMO5': '0.010', 'AMMO2': '0.014', 'WEAPON1': '0.050', 'AMMO4': '0.070', 'AMMO3': '0.087', 'weapon5': '0.202', 'WEAPON5': '0.300', 'HITCOUNT': '0.490', 'WEAPON3': '0.650', 'weapon3': '1.400', 'DAMAGECOUNT': '2.115', 'weapon2': '2.154', 'FRAGCOUNT': '5.000'} [2023-02-24 18:01:18,482][177158] DAMAGECOUNT value on done: 41529.0 [2023-02-24 18:01:18,482][177158] Sum rewards: 3.375, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.050', 'WEAPON1': '0.060', 'ARMOR': '0.080', 'AMMO3': '0.093', 'WEAPON4': '0.150', 'weapon5': '0.152', 'HEALTH': '0.176', 'HITCOUNT': '0.310', 'WEAPON5': '0.350', 'weapon4': '0.382', 'WEAPON3': '0.550', 'weapon2': '0.946', 'DAMAGECOUNT': '1.317', 'weapon3': '1.484', 'FRAGCOUNT': '4.000'} [2023-02-24 18:01:19,203][177172] DAMAGECOUNT value on done: 41346.0 [2023-02-24 18:01:19,203][177172] Sum rewards: -4.113, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.592', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon7': '0.068', 'WEAPON1': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.152', 'weapon5': '0.228', 'AMMO4': '0.270', 'WEAPON4': '0.350', 'HITCOUNT': '0.360', 'ARMOR': '0.467', 'WEAPON5': '0.500', 'weapon4': '0.502', 'WEAPON3': '0.950', 'weapon2': '1.062', 'DAMAGECOUNT': '1.518', 'weapon3': '1.600', 'FRAGCOUNT': '2.000'} [2023-02-24 18:01:19,352][177158] DAMAGECOUNT value on done: 38877.0 [2023-02-24 18:01:19,353][177158] Sum rewards: 3.923, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.558', 'AMMO5': '0.016', 'ARMOR': '0.040', 'AMMO2': '0.041', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.138', 'weapon5': '0.160', 'AMMO4': '0.206', 'weapon4': '0.364', 'WEAPON5': '0.400', 'HITCOUNT': '0.500', 'WEAPON3': '0.850', 'weapon2': '1.036', 'weapon3': '2.144', 'DAMAGECOUNT': '2.175', 'FRAGCOUNT': '6.000'} [2023-02-24 18:01:19,509][177172] DAMAGECOUNT value on done: 40249.0 [2023-02-24 18:01:19,509][177172] Sum rewards: 2.406, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.396', 'AMMO2': '0.008', 'AMMO5': '0.012', 'ARMOR': '0.040', 'AMMO4': '0.042', 'WEAPON1': '0.070', 'AMMO3': '0.093', 'weapon5': '0.228', 'WEAPON5': '0.350', 'HITCOUNT': '0.430', 'WEAPON3': '0.650', 'weapon3': '1.422', 'DAMAGECOUNT': '1.788', 'weapon2': '1.918', 'FRAGCOUNT': '5.000'} [2023-02-24 18:01:19,656][177158] DAMAGECOUNT value on done: 43827.0 [2023-02-24 18:01:19,656][177158] Sum rewards: 1.694, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.142', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.035', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.082', 'AMMO4': '0.177', 'HITCOUNT': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.266', 'WEAPON3': '0.400', 'DAMAGECOUNT': '1.095', 'weapon3': '1.266', 'weapon2': '1.912', 'FRAGCOUNT': '2.000'} [2023-02-24 18:01:20,118][177158] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:01:20,163][177154] DAMAGECOUNT value on done: 42947.0 [2023-02-24 18:01:20,163][177154] Sum rewards: 4.390, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.733', 'AMMO5': '0.010', 'AMMO2': '0.015', 'ARMOR': '0.016', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.079', 'weapon4': '0.138', 'weapon5': '0.202', 'HITCOUNT': '0.220', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'weapon3': '1.070', 'DAMAGECOUNT': '1.335', 'weapon2': '2.324', 'FRAGCOUNT': '4.000'} [2023-02-24 18:01:20,414][177172] DAMAGECOUNT value on done: 40700.0 [2023-02-24 18:01:20,452][177153] Updated weights for policy 0, policy_version 7870 (0.0008) [2023-02-24 18:01:20,461][177154] DAMAGECOUNT value on done: 41568.0 [2023-02-24 18:01:20,461][177154] Sum rewards: 2.296, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.278', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO5': '0.013', 'ARMOR': '0.028', 'WEAPON1': '0.070', 'AMMO3': '0.126', 'weapon5': '0.142', 'WEAPON5': '0.350', 'HITCOUNT': '0.560', 'WEAPON3': '0.850', 'weapon2': '1.470', 'weapon3': '1.756', 'DAMAGECOUNT': '2.196', 'FRAGCOUNT': '5.000'} [2023-02-24 18:01:20,710][177172] DAMAGECOUNT value on done: 40414.0 [2023-02-24 18:01:20,711][177172] Sum rewards: 3.942, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.077', 'AMMO5': '0.007', 'AMMO2': '0.019', 'ARMOR': '0.020', 'WEAPON1': '0.020', 'weapon5': '0.046', 'AMMO4': '0.093', 'AMMO3': '0.095', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.290', 'weapon4': '0.346', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.140', 'weapon2': '1.140', 'weapon3': '1.602', 'FRAGCOUNT': '3.000'} [2023-02-24 18:01:20,766][177154] DAMAGECOUNT value on done: 41948.0 [2023-02-24 18:01:20,767][177154] Sum rewards: 0.380, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.370', 'AMMO2': '0.004', 'AMMO5': '0.012', 'AMMO4': '0.021', 'WEAPON1': '0.060', 'weapon5': '0.078', 'AMMO3': '0.113', 'WEAPON5': '0.300', 'HITCOUNT': '0.650', 'WEAPON3': '0.800', 'weapon2': '1.448', 'weapon3': '1.804', 'DAMAGECOUNT': '1.959', 'FRAGCOUNT': '2.000'} [2023-02-24 18:01:21,061][177154] DAMAGECOUNT value on done: 42155.0 [2023-02-24 18:01:21,061][177154] Sum rewards: 5.287, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.254', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'ARMOR': '0.040', 'weapon7': '0.046', 'AMMO3': '0.085', 'weapon5': '0.100', 'AMMO4': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.390', 'WEAPON3': '0.500', 'weapon4': '0.884', 'weapon3': '1.182', 'weapon2': '1.422', 'DAMAGECOUNT': '1.839', 'FRAGCOUNT': '4.000'} [2023-02-24 18:01:21,111][177171] DAMAGECOUNT value on done: 41004.0 [2023-02-24 18:01:21,111][177171] Sum rewards: -0.654, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.100', 'AMMO2': '0.004', 'AMMO5': '0.011', 'AMMO4': '0.018', 'weapon7': '0.028', 'WEAPON1': '0.060', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.124', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'HITCOUNT': '0.300', 'weapon4': '0.410', 'ARMOR': '0.500', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.005', 'weapon3': '1.400', 'weapon2': '1.660', 'FRAGCOUNT': '3.000'} [2023-02-24 18:01:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13940.3). Total num frames: 32247808. Throughput: 0: 3486.0. Samples: 8055882. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:01:21,376][177119] Avg episode reward: [(0, '2.734')] [2023-02-24 18:01:21,407][177171] DAMAGECOUNT value on done: 39880.0 [2023-02-24 18:01:21,408][177171] Sum rewards: 4.062, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.608', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.016', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.176', 'WEAPON3': '0.350', 'HITCOUNT': '0.390', 'weapon3': '1.010', 'DAMAGECOUNT': '1.311', 'weapon2': '2.018', 'FRAGCOUNT': '5.000'} [2023-02-24 18:01:21,474][177157] DAMAGECOUNT value on done: 42423.0 [2023-02-24 18:01:21,475][177157] Sum rewards: 1.639, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.352', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'weapon5': '0.054', 'AMMO3': '0.075', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'weapon4': '0.426', 'WEAPON3': '0.550', 'weapon3': '1.224', 'DAMAGECOUNT': '1.386', 'weapon2': '1.494', 'FRAGCOUNT': '3.500'} [2023-02-24 18:01:21,511][177157] DAMAGECOUNT value on done: 44321.0 [2023-02-24 18:01:21,511][177157] Sum rewards: 9.592, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.568', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.019', 'WEAPON4': '0.050', 'AMMO3': '0.087', 'WEAPON1': '0.090', 'weapon4': '0.122', 'weapon5': '0.202', 'WEAPON5': '0.450', 'HITCOUNT': '0.540', 'WEAPON3': '0.550', 'weapon3': '1.040', 'weapon2': '2.214', 'DAMAGECOUNT': '2.568', 'FRAGCOUNT': '9.000'} [2023-02-24 18:01:21,668][177171] DAMAGECOUNT value on done: 41234.0 [2023-02-24 18:01:21,668][177171] Sum rewards: -0.137, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.382', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO2': '0.042', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'AMMO4': '0.210', 'HITCOUNT': '0.310', 'WEAPON4': '0.350', 'weapon4': '0.540', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.062', 'weapon3': '1.390', 'weapon2': '1.814'} [2023-02-24 18:01:21,779][177157] DAMAGECOUNT value on done: 42316.0 [2023-02-24 18:01:21,780][177157] Sum rewards: 8.501, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.550', 'AMMO5': '0.015', 'AMMO2': '0.016', 'ARMOR': '0.016', 'WEAPON1': '0.040', 'AMMO4': '0.077', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'weapon4': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.346', 'HITCOUNT': '0.490', 'WEAPON3': '0.700', 'weapon2': '1.362', 'weapon3': '1.742', 'DAMAGECOUNT': '3.039', 'FRAGCOUNT': '8.000'} [2023-02-24 18:01:21,818][177157] DAMAGECOUNT value on done: 40006.0 [2023-02-24 18:01:21,964][177155] DAMAGECOUNT value on done: 42105.0 [2023-02-24 18:01:21,965][177155] Sum rewards: 0.566, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.770', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'ARMOR': '0.056', 'AMMO3': '0.068', 'AMMO4': '0.090', 'weapon4': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.202', 'HITCOUNT': '0.240', 'WEAPON3': '0.400', 'weapon3': '0.878', 'DAMAGECOUNT': '1.266', 'FRAGCOUNT': '2.000', 'weapon2': '2.362'} [2023-02-24 18:01:21,972][177171] DAMAGECOUNT value on done: 40923.0 [2023-02-24 18:01:21,972][177171] Sum rewards: 0.608, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.489', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'AMMO3': '0.060', 'weapon5': '0.100', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.200', 'weapon4': '0.232', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.930', 'FRAGCOUNT': '1.000', 'weapon3': '1.334', 'weapon2': '2.232'} [2023-02-24 18:01:22,259][177155] DAMAGECOUNT value on done: 44431.0 [2023-02-24 18:01:22,259][177155] Sum rewards: 4.181, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.227', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.026', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'WEAPON4': '0.200', 'HITCOUNT': '0.320', 'WEAPON3': '0.350', 'weapon4': '0.550', 'weapon3': '1.066', 'DAMAGECOUNT': '1.497', 'weapon2': '2.210', 'FRAGCOUNT': '4.000'} [2023-02-24 18:01:22,502][177155] DAMAGECOUNT value on done: 44616.0 [2023-02-24 18:01:22,503][177155] Sum rewards: 4.518, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.730', 'AMMO5': '0.015', 'AMMO2': '0.029', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'AMMO4': '0.145', 'weapon5': '0.222', 'HITCOUNT': '0.340', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'weapon4': '0.496', 'weapon3': '1.054', 'weapon2': '1.162', 'DAMAGECOUNT': '1.965', 'FRAGCOUNT': '4.000'} [2023-02-24 18:01:22,803][177155] DAMAGECOUNT value on done: 42357.0 [2023-02-24 18:01:22,803][177155] Sum rewards: 3.681, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.580', 'ARMOR': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO3': '0.054', 'WEAPON1': '0.080', 'AMMO4': '0.128', 'weapon4': '0.198', 'HITCOUNT': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.268', 'WEAPON5': '0.400', 'WEAPON3': '0.400', 'weapon3': '1.188', 'DAMAGECOUNT': '1.242', 'weapon2': '2.102', 'FRAGCOUNT': '3.000'} [2023-02-24 18:01:23,379][177153] Updated weights for policy 0, policy_version 7880 (0.0008) [2023-02-24 18:01:26,293][177153] Updated weights for policy 0, policy_version 7890 (0.0008) [2023-02-24 18:01:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13940.3). Total num frames: 32317440. Throughput: 0: 3487.6. Samples: 8076858. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:01:26,376][177119] Avg episode reward: [(0, '2.833')] [2023-02-24 18:01:26,709][177156] DAMAGECOUNT value on done: 42907.0 [2023-02-24 18:01:26,709][177156] Sum rewards: 3.819, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.468', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.021', 'WEAPON1': '0.060', 'AMMO4': '0.106', 'AMMO3': '0.116', 'weapon5': '0.190', 'WEAPON5': '0.300', 'HITCOUNT': '0.400', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.476', 'weapon2': '1.532', 'weapon3': '1.816', 'FRAGCOUNT': '5.000'} [2023-02-24 18:01:26,973][177156] DAMAGECOUNT value on done: 42466.0 [2023-02-24 18:01:26,973][177156] Sum rewards: 5.658, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.460', 'AMMO5': '0.015', 'AMMO2': '0.024', 'WEAPON1': '0.060', 'weapon7': '0.074', 'AMMO3': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'weapon5': '0.150', 'WEAPON5': '0.350', 'HITCOUNT': '0.380', 'weapon4': '0.462', 'WEAPON3': '0.550', 'weapon3': '1.148', 'weapon2': '1.854', 'DAMAGECOUNT': '1.890', 'FRAGCOUNT': '6.000'} [2023-02-24 18:01:27,018][177156] DAMAGECOUNT value on done: 43455.0 [2023-02-24 18:01:27,019][177156] Sum rewards: 8.111, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.264', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'weapon7': '0.056', 'AMMO3': '0.084', 'AMMO4': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.420', 'weapon2': '0.424', 'WEAPON3': '0.500', 'weapon4': '0.646', 'weapon3': '1.034', 'DAMAGECOUNT': '2.151', 'FRAGCOUNT': '7.000'} [2023-02-24 18:01:27,286][177156] DAMAGECOUNT value on done: 43508.0 [2023-02-24 18:01:27,286][177156] Sum rewards: 3.121, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.254', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'AMMO2': '0.033', 'weapon7': '0.056', 'AMMO3': '0.109', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'weapon5': '0.168', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.416', 'HITCOUNT': '0.420', 'WEAPON3': '0.650', 'weapon3': '1.434', 'weapon2': '1.540', 'DAMAGECOUNT': '2.235', 'FRAGCOUNT': '5.000'} [2023-02-24 18:01:29,232][177153] Updated weights for policy 0, policy_version 7900 (0.0008) [2023-02-24 18:01:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13940.3). Total num frames: 32387072. Throughput: 0: 3486.5. Samples: 8097746. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:01:31,376][177119] Avg episode reward: [(0, '2.951')] [2023-02-24 18:01:32,160][177153] Updated weights for policy 0, policy_version 7910 (0.0009) [2023-02-24 18:01:35,093][177153] Updated weights for policy 0, policy_version 7920 (0.0008) [2023-02-24 18:01:36,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 32456704. Throughput: 0: 3483.2. Samples: 8108250. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:01:36,376][177119] Avg episode reward: [(0, '2.951')] [2023-02-24 18:01:36,931][177170] DAMAGECOUNT value on done: 43361.0 [2023-02-24 18:01:36,931][177170] Sum rewards: 6.070, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.333', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'AMMO4': '0.045', 'AMMO3': '0.062', 'WEAPON4': '0.100', 'weapon4': '0.142', 'WEAPON5': '0.200', 'weapon5': '0.256', 'WEAPON3': '0.400', 'HITCOUNT': '0.420', 'weapon3': '1.334', 'DAMAGECOUNT': '1.710', 'weapon2': '2.158', 'FRAGCOUNT': '4.000'} [2023-02-24 18:01:37,229][177170] DAMAGECOUNT value on done: 45853.0 [2023-02-24 18:01:37,229][177170] Sum rewards: 2.711, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.102', 'AMMO2': '0.015', 'AMMO5': '0.016', 'WEAPON1': '0.030', 'AMMO4': '0.074', 'AMMO3': '0.086', 'weapon5': '0.102', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.304', 'HITCOUNT': '0.510', 'WEAPON3': '0.550', 'weapon3': '1.378', 'weapon2': '1.518', 'DAMAGECOUNT': '1.680', 'FRAGCOUNT': '2.500'} [2023-02-24 18:01:37,348][177170] DAMAGECOUNT value on done: 37722.0 [2023-02-24 18:01:37,349][177170] Sum rewards: -0.707, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.624', 'AMMO2': '0.006', 'AMMO5': '0.017', 'AMMO4': '0.032', 'WEAPON1': '0.060', 'AMMO3': '0.096', 'WEAPON4': '0.200', 'weapon5': '0.200', 'WEAPON5': '0.350', 'HITCOUNT': '0.380', 'weapon4': '0.516', 'WEAPON3': '0.600', 'weapon2': '0.972', 'DAMAGECOUNT': '1.254', 'weapon3': '1.734', 'FRAGCOUNT': '2.000'} [2023-02-24 18:01:37,365][177158] DAMAGECOUNT value on done: 41175.0 [2023-02-24 18:01:37,366][177158] Sum rewards: -0.164, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.770', 'AMMO5': '0.019', 'AMMO2': '0.023', 'weapon7': '0.036', 'ARMOR': '0.048', 'WEAPON1': '0.060', 'AMMO3': '0.103', 'AMMO4': '0.115', 'weapon5': '0.142', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'HITCOUNT': '0.260', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '0.650', 'weapon4': '0.820', 'weapon2': '0.854', 'DAMAGECOUNT': '1.035', 'weapon3': '1.870', 'FRAGCOUNT': '3.000'} [2023-02-24 18:01:37,655][177170] DAMAGECOUNT value on done: 45216.0 [2023-02-24 18:01:37,656][177170] Sum rewards: 0.801, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.440', 'AMMO5': '0.005', 'AMMO2': '0.016', 'ARMOR': '0.020', 'WEAPON1': '0.020', 'AMMO3': '0.054', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'weapon4': '0.136', 'weapon5': '0.170', 'WEAPON5': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.642', 'weapon3': '0.978', 'FRAGCOUNT': '1.000', 'weapon2': '2.382'} [2023-02-24 18:01:37,665][177158] DAMAGECOUNT value on done: 42151.0 [2023-02-24 18:01:37,665][177158] Sum rewards: 6.701, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.420', 'AMMO5': '0.003', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.037', 'AMMO3': '0.040', 'weapon7': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.185', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.330', 'weapon4': '0.444', 'WEAPON4': '0.450', 'weapon3': '0.546', 'DAMAGECOUNT': '1.776', 'weapon2': '2.326', 'FRAGCOUNT': '7.000'} [2023-02-24 18:01:38,044][177153] Updated weights for policy 0, policy_version 7930 (0.0008) [2023-02-24 18:01:38,478][177172] DAMAGECOUNT value on done: 42449.0 [2023-02-24 18:01:38,479][177172] Sum rewards: 10.576, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.945', 'AMMO5': '0.015', 'AMMO2': '0.019', 'ARMOR': '0.020', 'WEAPON1': '0.050', 'AMMO4': '0.095', 'AMMO3': '0.101', 'WEAPON4': '0.200', 'weapon5': '0.242', 'WEAPON5': '0.300', 'weapon4': '0.312', 'WEAPON3': '0.600', 'HITCOUNT': '0.720', 'weapon3': '1.590', 'weapon2': '1.698', 'DAMAGECOUNT': '3.309', 'FRAGCOUNT': '9.000'} [2023-02-24 18:01:38,527][177158] DAMAGECOUNT value on done: 39826.0 [2023-02-24 18:01:38,527][177158] Sum rewards: 9.697, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.696', 'ARMOR': '0.004', 'AMMO5': '0.010', 'weapon4': '0.016', 'AMMO2': '0.022', 'WEAPON1': '0.050', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'AMMO4': '0.110', 'weapon5': '0.228', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'HITCOUNT': '0.690', 'weapon3': '1.600', 'weapon2': '1.844', 'DAMAGECOUNT': '2.847', 'FRAGCOUNT': '8.000'} [2023-02-24 18:01:38,785][177172] DAMAGECOUNT value on done: 40683.0 [2023-02-24 18:01:38,785][177172] Sum rewards: 5.159, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.038', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'weapon7': '0.074', 'AMMO3': '0.082', 'weapon5': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.188', 'HITCOUNT': '0.280', 'WEAPON3': '0.500', 'weapon3': '1.260', 'DAMAGECOUNT': '1.302', 'weapon2': '1.882', 'FRAGCOUNT': '4.000'} [2023-02-24 18:01:38,833][177158] DAMAGECOUNT value on done: 44404.0 [2023-02-24 18:01:38,833][177158] Sum rewards: 4.963, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.575', 'AMMO5': '0.015', 'AMMO2': '0.027', 'ARMOR': '0.032', 'AMMO3': '0.056', 'WEAPON1': '0.060', 'weapon7': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.133', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.304', 'HITCOUNT': '0.330', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'weapon5': '0.460', 'weapon3': '1.240', 'weapon2': '1.534', 'DAMAGECOUNT': '1.731', 'FRAGCOUNT': '5.000'} [2023-02-24 18:01:39,392][177154] DAMAGECOUNT value on done: 43412.0 [2023-02-24 18:01:39,392][177154] Sum rewards: 1.211, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.510', 'AMMO5': '0.024', 'AMMO2': '0.027', 'AMMO3': '0.077', 'HITCOUNT': '0.120', 'AMMO4': '0.134', 'WEAPON1': '0.140', 'weapon5': '0.400', 'WEAPON3': '0.550', 'WEAPON5': '0.700', 'weapon3': '0.978', 'DAMAGECOUNT': '1.395', 'FRAGCOUNT': '2.000', 'weapon2': '2.176'} [2023-02-24 18:01:39,681][177172] DAMAGECOUNT value on done: 41295.0 [2023-02-24 18:01:39,682][177172] Sum rewards: -1.589, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.130', 'AMMO4': '-0.018', 'AMMO2': '-0.003', 'ARMOR': '0.008', 'AMMO5': '0.022', 'WEAPON4': '0.050', 'WEAPON1': '0.100', 'AMMO3': '0.119', 'weapon4': '0.188', 'weapon5': '0.218', 'HITCOUNT': '0.390', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon3': '1.264', 'DAMAGECOUNT': '1.785', 'FRAGCOUNT': '2.000', 'weapon2': '2.118'} [2023-02-24 18:01:39,686][177154] DAMAGECOUNT value on done: 42315.0 [2023-02-24 18:01:39,686][177154] Sum rewards: 5.718, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.828', 'AMMO5': '0.010', 'AMMO2': '0.024', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'AMMO4': '0.120', 'WEAPON5': '0.250', 'weapon5': '0.402', 'HITCOUNT': '0.620', 'WEAPON3': '0.700', 'weapon2': '1.288', 'weapon3': '1.864', 'DAMAGECOUNT': '2.241', 'FRAGCOUNT': '7.000'} [2023-02-24 18:01:39,981][177172] DAMAGECOUNT value on done: 41003.0 [2023-02-24 18:01:39,981][177172] Sum rewards: 1.898, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.660', 'AMMO5': '0.005', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'AMMO3': '0.113', 'AMMO4': '0.162', 'weapon5': '0.196', 'WEAPON4': '0.350', 'HITCOUNT': '0.460', 'weapon4': '0.504', 'WEAPON3': '0.800', 'weapon3': '1.434', 'weapon2': '1.602', 'DAMAGECOUNT': '1.767', 'FRAGCOUNT': '5.000'} [2023-02-24 18:01:39,984][177154] DAMAGECOUNT value on done: 43045.0 [2023-02-24 18:01:39,984][177154] Sum rewards: 2.351, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.440', 'AMMO5': '0.029', 'AMMO2': '0.032', 'ARMOR': '0.040', 'WEAPON1': '0.090', 'AMMO3': '0.126', 'AMMO4': '0.162', 'weapon4': '0.174', 'WEAPON4': '0.200', 'HITCOUNT': '0.360', 'weapon5': '0.430', 'WEAPON5': '0.650', 'WEAPON3': '0.900', 'weapon2': '1.172', 'weapon3': '1.884', 'DAMAGECOUNT': '3.291', 'FRAGCOUNT': '5.500'} [2023-02-24 18:01:40,286][177154] DAMAGECOUNT value on done: 42591.0 [2023-02-24 18:01:40,286][177154] Sum rewards: 3.651, reward structure: {'DEATHCOUNT': '-6.750', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.085', 'weapon5': '0.128', 'AMMO4': '0.131', 'weapon7': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HITCOUNT': '0.270', 'WEAPON7': '0.300', 'HEALTH': '0.319', 'WEAPON3': '0.400', 'weapon4': '0.434', 'DAMAGECOUNT': '1.308', 'weapon3': '1.326', 'weapon2': '1.720', 'FRAGCOUNT': '3.000'} [2023-02-24 18:01:40,434][177171] DAMAGECOUNT value on done: 41470.0 [2023-02-24 18:01:40,434][177171] Sum rewards: -0.515, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.710', 'AMMO5': '0.014', 'AMMO2': '0.024', 'ARMOR': '0.048', 'WEAPON1': '0.060', 'AMMO3': '0.108', 'AMMO4': '0.120', 'weapon5': '0.196', 'WEAPON4': '0.200', 'weapon4': '0.296', 'HITCOUNT': '0.390', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.398', 'weapon3': '1.504', 'weapon2': '1.786', 'FRAGCOUNT': '2.000'} [2023-02-24 18:01:40,732][177171] DAMAGECOUNT value on done: 40372.0 [2023-02-24 18:01:40,733][177171] Sum rewards: 6.014, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.649', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.059', 'AMMO3': '0.075', 'weapon5': '0.084', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.322', 'HITCOUNT': '0.350', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.476', 'weapon3': '1.486', 'weapon2': '1.966', 'FRAGCOUNT': '6.000'} [2023-02-24 18:01:40,739][177157] DAMAGECOUNT value on done: 43501.0 [2023-02-24 18:01:40,739][177157] Sum rewards: 14.005, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.081', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.060', 'AMMO3': '0.074', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.238', 'WEAPON5': '0.400', 'weapon5': '0.456', 'WEAPON3': '0.650', 'HITCOUNT': '0.930', 'weapon2': '1.090', 'weapon3': '1.728', 'DAMAGECOUNT': '3.234', 'FRAGCOUNT': '13.000'} [2023-02-24 18:01:40,778][177157] DAMAGECOUNT value on done: 45204.0 [2023-02-24 18:01:40,779][177157] Sum rewards: 4.407, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.415', 'AMMO5': '0.015', 'AMMO2': '0.019', 'WEAPON1': '0.060', 'AMMO4': '0.093', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.350', 'weapon5': '0.354', 'weapon4': '0.402', 'weapon2': '0.436', 'HITCOUNT': '0.530', 'WEAPON3': '1.000', 'weapon3': '2.376', 'DAMAGECOUNT': '2.649', 'FRAGCOUNT': '7.000'} [2023-02-24 18:01:40,999][177153] Updated weights for policy 0, policy_version 7940 (0.0009) [2023-02-24 18:01:41,001][177171] DAMAGECOUNT value on done: 41774.0 [2023-02-24 18:01:41,001][177171] Sum rewards: 3.331, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.526', 'AMMO2': '0.019', 'AMMO5': '0.019', 'AMMO3': '0.067', 'WEAPON1': '0.080', 'weapon7': '0.082', 'AMMO4': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.240', 'HITCOUNT': '0.340', 'WEAPON5': '0.450', 'WEAPON3': '0.450', 'weapon4': '0.706', 'weapon2': '0.936', 'weapon3': '1.104', 'DAMAGECOUNT': '1.620', 'FRAGCOUNT': '4.000'} [2023-02-24 18:01:41,050][177157] DAMAGECOUNT value on done: 42725.0 [2023-02-24 18:01:41,050][177157] Sum rewards: 2.819, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.318', 'AMMO5': '0.011', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'weapon7': '0.064', 'AMMO3': '0.078', 'AMMO4': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.192', 'WEAPON7': '0.200', 'HITCOUNT': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'weapon4': '0.758', 'weapon3': '0.860', 'DAMAGECOUNT': '1.227', 'weapon2': '1.242', 'FRAGCOUNT': '3.000'} [2023-02-24 18:01:41,087][177157] DAMAGECOUNT value on done: 40412.0 [2023-02-24 18:01:41,088][177157] Sum rewards: 0.925, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.782', 'AMMO5': '0.014', 'AMMO2': '0.017', 'ARMOR': '0.044', 'WEAPON1': '0.080', 'AMMO4': '0.083', 'AMMO3': '0.106', 'weapon5': '0.180', 'WEAPON4': '0.200', 'HITCOUNT': '0.260', 'weapon4': '0.278', 'WEAPON5': '0.400', 'weapon2': '0.666', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.218', 'weapon3': '2.010', 'FRAGCOUNT': '4.000'} [2023-02-24 18:01:41,190][177155] DAMAGECOUNT value on done: 42694.0 [2023-02-24 18:01:41,190][177155] Sum rewards: 2.339, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.910', 'AMMO5': '0.014', 'AMMO2': '0.024', 'WEAPON1': '0.070', 'AMMO3': '0.098', 'AMMO4': '0.118', 'weapon5': '0.196', 'HITCOUNT': '0.260', 'WEAPON4': '0.300', 'weapon4': '0.322', 'WEAPON5': '0.350', 'ARMOR': '0.454', 'WEAPON3': '0.700', 'weapon2': '1.482', 'weapon3': '1.594', 'DAMAGECOUNT': '1.767', 'FRAGCOUNT': '4.000'} [2023-02-24 18:01:41,300][177171] DAMAGECOUNT value on done: 41498.0 [2023-02-24 18:01:41,301][177171] Sum rewards: 3.682, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.900', 'AMMO5': '0.011', 'AMMO2': '0.016', 'ARMOR': '0.044', 'WEAPON1': '0.050', 'weapon5': '0.072', 'AMMO4': '0.078', 'AMMO3': '0.088', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.340', 'HITCOUNT': '0.510', 'WEAPON3': '0.550', 'weapon3': '1.318', 'DAMAGECOUNT': '1.725', 'weapon2': '2.080', 'FRAGCOUNT': '4.000'} [2023-02-24 18:01:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13940.3). Total num frames: 32526336. Throughput: 0: 3481.1. Samples: 8129116. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:01:41,376][177119] Avg episode reward: [(0, '3.251')] [2023-02-24 18:01:41,499][177155] DAMAGECOUNT value on done: 45160.0 [2023-02-24 18:01:41,500][177155] Sum rewards: 7.699, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.054', 'AMMO5': '0.010', 'AMMO2': '0.022', 'ARMOR': '0.036', 'WEAPON1': '0.070', 'AMMO3': '0.077', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.109', 'weapon7': '0.126', 'weapon5': '0.272', 'WEAPON5': '0.350', 'HITCOUNT': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.736', 'weapon3': '1.120', 'weapon2': '1.338', 'DAMAGECOUNT': '2.187', 'FRAGCOUNT': '6.000'} [2023-02-24 18:01:41,757][177155] DAMAGECOUNT value on done: 45061.0 [2023-02-24 18:01:41,758][177155] Sum rewards: 0.819, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.016', 'AMMO2': '0.020', 'WEAPON1': '0.050', 'AMMO3': '0.086', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'weapon7': '0.112', 'HEALTH': '0.126', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.266', 'HITCOUNT': '0.280', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'weapon2': '0.552', 'weapon4': '0.864', 'weapon3': '0.912', 'DAMAGECOUNT': '1.335', 'FRAGCOUNT': '2.000'} [2023-02-24 18:01:42,056][177155] DAMAGECOUNT value on done: 43155.0 [2023-02-24 18:01:42,056][177155] Sum rewards: 4.768, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.882', 'AMMO5': '0.012', 'AMMO2': '0.030', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'AMMO3': '0.116', 'weapon7': '0.140', 'weapon5': '0.150', 'AMMO4': '0.151', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO6': '0.440', 'AMMO7': '0.440', 'HITCOUNT': '0.520', 'WEAPON7': '0.600', 'weapon4': '0.622', 'weapon2': '0.662', 'WEAPON3': '0.750', 'weapon3': '1.700', 'DAMAGECOUNT': '2.394', 'FRAGCOUNT': '7.000'} [2023-02-24 18:01:42,345][177157] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:01:43,946][177153] Updated weights for policy 0, policy_version 7950 (0.0008) [2023-02-24 18:01:46,062][177156] DAMAGECOUNT value on done: 43418.0 [2023-02-24 18:01:46,062][177156] Sum rewards: 3.853, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.955', 'AMMO5': '0.013', 'AMMO2': '0.017', 'WEAPON1': '0.060', 'AMMO3': '0.069', 'AMMO4': '0.085', 'weapon7': '0.118', 'weapon4': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.278', 'WEAPON5': '0.400', 'HITCOUNT': '0.440', 'WEAPON3': '0.550', 'weapon3': '1.350', 'DAMAGECOUNT': '1.533', 'weapon2': '1.774', 'FRAGCOUNT': '5.000'} [2023-02-24 18:01:46,325][177156] DAMAGECOUNT value on done: 42771.0 [2023-02-24 18:01:46,325][177156] Sum rewards: -0.187, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.374', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.060', 'AMMO4': '0.063', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'HITCOUNT': '0.200', 'weapon5': '0.252', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.915', 'FRAGCOUNT': '1.000', 'weapon3': '1.210', 'weapon2': '2.230'} [2023-02-24 18:01:46,370][177156] DAMAGECOUNT value on done: 44565.0 [2023-02-24 18:01:46,371][177156] Sum rewards: 13.421, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.657', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.098', 'weapon7': '0.098', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.462', 'WEAPON3': '0.550', 'HITCOUNT': '0.890', 'weapon3': '1.566', 'weapon2': '1.720', 'DAMAGECOUNT': '3.330', 'FRAGCOUNT': '10.000'} [2023-02-24 18:01:46,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 32595968. Throughput: 0: 3484.8. Samples: 8149998. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:01:46,376][177119] Avg episode reward: [(0, '3.304')] [2023-02-24 18:01:46,636][177156] DAMAGECOUNT value on done: 43848.0 [2023-02-24 18:01:46,637][177156] Sum rewards: -0.028, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.384', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'weapon7': '0.054', 'AMMO3': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.141', 'WEAPON4': '0.200', 'weapon5': '0.266', 'HITCOUNT': '0.290', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'weapon4': '0.520', 'weapon3': '0.936', 'DAMAGECOUNT': '1.020', 'weapon2': '1.986', 'FRAGCOUNT': '2.000'} [2023-02-24 18:01:46,848][177153] Updated weights for policy 0, policy_version 7960 (0.0008) [2023-02-24 18:01:49,793][177153] Updated weights for policy 0, policy_version 7970 (0.0008) [2023-02-24 18:01:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 32665600. Throughput: 0: 3485.7. Samples: 8160488. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:01:51,376][177119] Avg episode reward: [(0, '3.409')] [2023-02-24 18:01:51,441][177158] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:01:52,709][177153] Updated weights for policy 0, policy_version 7980 (0.0009) [2023-02-24 18:01:55,638][177153] Updated weights for policy 0, policy_version 7990 (0.0008) [2023-02-24 18:01:56,147][177170] DAMAGECOUNT value on done: 44256.0 [2023-02-24 18:01:56,147][177170] Sum rewards: 3.095, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.866', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.035', 'WEAPON1': '0.050', 'ARMOR': '0.072', 'weapon7': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.300', 'HITCOUNT': '0.410', 'weapon4': '0.490', 'WEAPON3': '0.850', 'weapon2': '1.064', 'weapon3': '1.678', 'DAMAGECOUNT': '2.685', 'FRAGCOUNT': '5.000'} [2023-02-24 18:01:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 32735232. Throughput: 0: 3482.7. Samples: 8181390. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:01:56,376][177119] Avg episode reward: [(0, '3.359')] [2023-02-24 18:01:56,453][177170] DAMAGECOUNT value on done: 46360.0 [2023-02-24 18:01:56,453][177170] Sum rewards: 6.407, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.192', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'ARMOR': '0.024', 'AMMO4': '0.037', 'AMMO3': '0.102', 'weapon5': '0.106', 'WEAPON4': '0.150', 'weapon7': '0.156', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'HITCOUNT': '0.390', 'WEAPON3': '0.600', 'weapon4': '0.684', 'weapon2': '1.130', 'weapon3': '1.428', 'DAMAGECOUNT': '1.521', 'FRAGCOUNT': '6.000'} [2023-02-24 18:01:56,593][177170] DAMAGECOUNT value on done: 38150.0 [2023-02-24 18:01:56,594][177170] Sum rewards: 2.454, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.147', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.077', 'AMMO4': '0.080', 'WEAPON5': '0.150', 'weapon5': '0.196', 'WEAPON4': '0.250', 'HITCOUNT': '0.280', 'WEAPON3': '0.450', 'ARMOR': '0.496', 'weapon4': '0.498', 'DAMAGECOUNT': '1.284', 'weapon3': '1.364', 'weapon2': '1.432', 'FRAGCOUNT': '2.000'} [2023-02-24 18:01:56,684][177158] DAMAGECOUNT value on done: 42320.0 [2023-02-24 18:01:56,684][177158] Sum rewards: 6.515, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.396', 'AMMO5': '0.005', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'weapon4': '0.296', 'WEAPON3': '0.850', 'HITCOUNT': '0.920', 'weapon3': '1.756', 'weapon2': '1.766', 'DAMAGECOUNT': '3.435', 'FRAGCOUNT': '7.000'} [2023-02-24 18:01:56,898][177170] DAMAGECOUNT value on done: 46166.0 [2023-02-24 18:01:56,898][177170] Sum rewards: 6.680, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.824', 'AMMO5': '0.012', 'AMMO2': '0.022', 'ARMOR': '0.032', 'WEAPON1': '0.060', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.110', 'AMMO4': '0.112', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'weapon4': '0.668', 'WEAPON3': '0.800', 'HITCOUNT': '0.800', 'weapon2': '1.022', 'weapon3': '1.898', 'DAMAGECOUNT': '2.850', 'FRAGCOUNT': '8.000'} [2023-02-24 18:01:56,992][177158] DAMAGECOUNT value on done: 42825.0 [2023-02-24 18:01:56,993][177158] Sum rewards: 4.855, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.543', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.031', 'WEAPON1': '0.090', 'AMMO3': '0.095', 'weapon7': '0.120', 'WEAPON4': '0.150', 'AMMO4': '0.157', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.280', 'WEAPON7': '0.300', 'HITCOUNT': '0.320', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'weapon4': '0.678', 'weapon2': '0.890', 'weapon3': '1.648', 'DAMAGECOUNT': '2.022', 'FRAGCOUNT': '6.000'} [2023-02-24 18:01:57,794][177172] DAMAGECOUNT value on done: 43661.0 [2023-02-24 18:01:57,794][177172] Sum rewards: 3.596, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.105', 'AMMO5': '0.013', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.085', 'AMMO3': '0.108', 'weapon4': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon5': '0.366', 'HITCOUNT': '0.580', 'WEAPON3': '0.750', 'weapon2': '1.572', 'weapon3': '1.602', 'DAMAGECOUNT': '3.636', 'FRAGCOUNT': '5.000'} [2023-02-24 18:01:57,849][177158] DAMAGECOUNT value on done: 40536.0 [2023-02-24 18:01:57,849][177158] Sum rewards: 2.876, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.960', 'AMMO2': '0.012', 'AMMO5': '0.018', 'WEAPON1': '0.060', 'AMMO4': '0.062', 'AMMO3': '0.073', 'weapon5': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.130', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.350', 'weapon4': '0.392', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon3': '1.348', 'weapon2': '1.794', 'DAMAGECOUNT': '1.899', 'FRAGCOUNT': '3.000'} [2023-02-24 18:01:57,946][177158] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 18:01:58,098][177172] DAMAGECOUNT value on done: 41148.0 [2023-02-24 18:01:58,099][177172] Sum rewards: -0.046, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.775', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon7': '0.048', 'AMMO3': '0.082', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.340', 'WEAPON3': '0.600', 'weapon4': '0.602', 'weapon3': '1.144', 'DAMAGECOUNT': '1.395', 'weapon2': '1.934', 'FRAGCOUNT': '2.000'} [2023-02-24 18:01:58,146][177158] DAMAGECOUNT value on done: 45079.0 [2023-02-24 18:01:58,146][177158] Sum rewards: 8.363, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.855', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.055', 'AMMO3': '0.067', 'weapon5': '0.070', 'WEAPON5': '0.150', 'weapon7': '0.202', 'HITCOUNT': '0.270', 'WEAPON4': '0.300', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON3': '0.350', 'WEAPON7': '0.500', 'weapon4': '0.740', 'weapon2': '0.900', 'weapon3': '1.130', 'DAMAGECOUNT': '2.025', 'FRAGCOUNT': '7.000'} [2023-02-24 18:01:58,626][177153] Updated weights for policy 0, policy_version 8000 (0.0008) [2023-02-24 18:01:58,710][177154] DAMAGECOUNT value on done: 44231.0 [2023-02-24 18:01:58,710][177154] Sum rewards: 8.822, reward structure: {'DEATHCOUNT': '-6.000', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'weapon7': '0.054', 'AMMO3': '0.069', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.126', 'HEALTH': '0.158', 'WEAPON5': '0.200', 'weapon4': '0.340', 'WEAPON3': '0.400', 'HITCOUNT': '0.500', 'weapon3': '1.124', 'weapon2': '1.974', 'DAMAGECOUNT': '2.457', 'FRAGCOUNT': '7.000'} [2023-02-24 18:01:58,985][177172] DAMAGECOUNT value on done: 42245.0 [2023-02-24 18:01:58,986][177172] Sum rewards: 6.049, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.858', 'AMMO5': '0.017', 'AMMO2': '0.030', 'ARMOR': '0.036', 'WEAPON1': '0.040', 'weapon7': '0.068', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.110', 'AMMO4': '0.148', 'weapon4': '0.192', 'weapon5': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.680', 'WEAPON3': '0.750', 'weapon2': '1.038', 'weapon3': '2.202', 'DAMAGECOUNT': '2.850', 'FRAGCOUNT': '6.000'} [2023-02-24 18:01:59,012][177154] DAMAGECOUNT value on done: 42982.0 [2023-02-24 18:01:59,012][177154] Sum rewards: 3.678, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.740', 'AMMO5': '0.021', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'AMMO3': '0.119', 'AMMO4': '0.124', 'weapon4': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'HITCOUNT': '0.400', 'weapon5': '0.408', 'WEAPON3': '0.850', 'weapon2': '1.524', 'weapon3': '1.574', 'DAMAGECOUNT': '2.001', 'FRAGCOUNT': '5.000'} [2023-02-24 18:01:59,285][177172] DAMAGECOUNT value on done: 41634.0 [2023-02-24 18:01:59,286][177172] Sum rewards: 1.506, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'HEALTH': '0.044', 'weapon7': '0.052', 'AMMO3': '0.069', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'weapon5': '0.160', 'HITCOUNT': '0.230', 'WEAPON3': '0.450', 'weapon4': '0.572', 'weapon2': '1.026', 'weapon3': '1.048', 'DAMAGECOUNT': '1.893', 'FRAGCOUNT': '2.000'} [2023-02-24 18:01:59,311][177154] DAMAGECOUNT value on done: 43951.0 [2023-02-24 18:01:59,312][177154] Sum rewards: 7.401, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.031', 'AMMO2': '0.004', 'AMMO5': '0.016', 'AMMO4': '0.022', 'WEAPON1': '0.040', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'weapon4': '0.102', 'weapon5': '0.214', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.690', 'weapon2': '1.752', 'weapon3': '1.792', 'DAMAGECOUNT': '2.718', 'FRAGCOUNT': '6.000'} [2023-02-24 18:01:59,613][177154] DAMAGECOUNT value on done: 43982.0 [2023-02-24 18:01:59,613][177154] Sum rewards: 8.121, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.396', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'weapon4': '0.022', 'AMMO2': '0.026', 'AMMO3': '0.115', 'AMMO4': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.292', 'WEAPON3': '0.750', 'HITCOUNT': '0.920', 'weapon2': '1.420', 'weapon3': '1.936', 'DAMAGECOUNT': '4.173', 'FRAGCOUNT': '8.000'} [2023-02-24 18:01:59,813][177171] DAMAGECOUNT value on done: 42150.0 [2023-02-24 18:01:59,814][177171] Sum rewards: 3.478, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.537', 'AMMO5': '0.010', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'weapon7': '0.086', 'AMMO4': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.202', 'WEAPON5': '0.250', 'WEAPON3': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.470', 'weapon4': '0.536', 'weapon3': '0.774', 'DAMAGECOUNT': '2.040', 'weapon2': '2.174', 'FRAGCOUNT': '3.000'} [2023-02-24 18:01:59,961][177157] DAMAGECOUNT value on done: 44455.0 [2023-02-24 18:01:59,962][177157] Sum rewards: 7.915, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.522', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO3': '0.060', 'AMMO4': '0.063', 'WEAPON5': '0.100', 'weapon5': '0.136', 'WEAPON4': '0.150', 'weapon4': '0.384', 'WEAPON3': '0.400', 'HITCOUNT': '0.630', 'weapon3': '1.362', 'weapon2': '1.502', 'DAMAGECOUNT': '2.862', 'FRAGCOUNT': '6.000'} [2023-02-24 18:01:59,999][177157] DAMAGECOUNT value on done: 45597.0 [2023-02-24 18:01:59,999][177157] Sum rewards: 2.746, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.080', 'AMMO2': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.020', 'weapon5': '0.094', 'AMMO3': '0.111', 'WEAPON5': '0.200', 'HITCOUNT': '0.340', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.179', 'weapon3': '1.480', 'weapon2': '2.370', 'FRAGCOUNT': '4.000'} [2023-02-24 18:02:00,125][177171] DAMAGECOUNT value on done: 41188.0 [2023-02-24 18:02:00,126][177171] Sum rewards: 2.987, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.930', 'ARMOR': '0.004', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.102', 'AMMO3': '0.109', 'weapon5': '0.150', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.554', 'HITCOUNT': '0.620', 'WEAPON3': '0.700', 'weapon2': '1.262', 'weapon3': '1.562', 'DAMAGECOUNT': '2.448', 'FRAGCOUNT': '4.000'} [2023-02-24 18:02:00,269][177157] DAMAGECOUNT value on done: 43280.0 [2023-02-24 18:02:00,269][177157] Sum rewards: 3.735, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.890', 'AMMO5': '0.010', 'AMMO2': '0.038', 'WEAPON1': '0.040', 'weapon5': '0.070', 'weapon7': '0.074', 'AMMO3': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.192', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'ARMOR': '0.412', 'HITCOUNT': '0.510', 'WEAPON3': '0.700', 'weapon4': '0.788', 'weapon2': '0.894', 'weapon3': '1.586', 'DAMAGECOUNT': '1.665', 'FRAGCOUNT': '5.000'} [2023-02-24 18:02:00,302][177157] DAMAGECOUNT value on done: 40745.0 [2023-02-24 18:02:00,303][177157] Sum rewards: 2.809, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.854', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'ARMOR': '0.036', 'AMMO2': '0.038', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'HITCOUNT': '0.140', 'AMMO4': '0.192', 'weapon7': '0.228', 'WEAPON3': '0.350', 'AMMO6': '0.420', 'AMMO7': '0.420', 'WEAPON4': '0.450', 'WEAPON7': '0.500', 'weapon3': '0.774', 'weapon2': '0.800', 'DAMAGECOUNT': '0.951', 'weapon4': '1.200', 'FRAGCOUNT': '3.000'} [2023-02-24 18:02:00,379][177171] DAMAGECOUNT value on done: 42450.0 [2023-02-24 18:02:00,379][177171] Sum rewards: 2.340, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.446', 'AMMO2': '0.006', 'AMMO5': '0.017', 'ARMOR': '0.028', 'AMMO4': '0.029', 'weapon7': '0.048', 'WEAPON1': '0.070', 'weapon5': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.134', 'AMMO3': '0.144', 'WEAPON5': '0.400', 'HITCOUNT': '0.520', 'WEAPON3': '1.000', 'weapon2': '1.310', 'DAMAGECOUNT': '2.028', 'weapon3': '2.058', 'FRAGCOUNT': '6.000'} [2023-02-24 18:02:00,577][177155] DAMAGECOUNT value on done: 43398.0 [2023-02-24 18:02:00,578][177155] Sum rewards: 7.130, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.348', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'ARMOR': '0.048', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.198', 'weapon4': '0.220', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'HITCOUNT': '0.540', 'weapon3': '0.974', 'weapon2': '1.986', 'DAMAGECOUNT': '2.112', 'FRAGCOUNT': '6.000'} [2023-02-24 18:02:00,670][177171] DAMAGECOUNT value on done: 42324.0 [2023-02-24 18:02:00,671][177171] Sum rewards: 4.451, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.290', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'weapon5': '0.060', 'AMMO3': '0.074', 'WEAPON5': '0.100', 'HITCOUNT': '0.590', 'WEAPON3': '0.700', 'weapon3': '1.586', 'weapon2': '2.180', 'DAMAGECOUNT': '2.478', 'FRAGCOUNT': '5.000'} [2023-02-24 18:02:00,877][177155] DAMAGECOUNT value on done: 45721.0 [2023-02-24 18:02:00,877][177155] Sum rewards: 0.203, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.070', 'AMMO5': '0.012', 'AMMO2': '0.018', 'weapon7': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.113', 'weapon5': '0.202', 'WEAPON5': '0.300', 'HITCOUNT': '0.500', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.683', 'weapon2': '1.728', 'weapon3': '1.766'} [2023-02-24 18:02:01,128][177155] DAMAGECOUNT value on done: 45773.0 [2023-02-24 18:02:01,129][177155] Sum rewards: 5.622, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.200', 'AMMO2': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.024', 'AMMO3': '0.030', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON3': '0.250', 'weapon5': '0.276', 'weapon4': '0.342', 'HITCOUNT': '0.480', 'weapon3': '0.764', 'DAMAGECOUNT': '2.136', 'weapon2': '2.438', 'FRAGCOUNT': '2.500'} [2023-02-24 18:02:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 32804864. Throughput: 0: 3479.2. Samples: 8202124. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:02:01,376][177119] Avg episode reward: [(0, '3.944')] [2023-02-24 18:02:01,430][177155] DAMAGECOUNT value on done: 43731.0 [2023-02-24 18:02:01,430][177155] Sum rewards: 1.856, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.126', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon7': '0.054', 'weapon4': '0.074', 'AMMO3': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.264', 'WEAPON5': '0.300', 'HITCOUNT': '0.360', 'WEAPON3': '0.700', 'weapon3': '1.438', 'DAMAGECOUNT': '1.728', 'weapon2': '1.924', 'FRAGCOUNT': '3.000'} [2023-02-24 18:02:01,567][177153] Updated weights for policy 0, policy_version 8010 (0.0008) [2023-02-24 18:02:04,490][177153] Updated weights for policy 0, policy_version 8020 (0.0008) [2023-02-24 18:02:05,398][177156] DAMAGECOUNT value on done: 44510.0 [2023-02-24 18:02:05,399][177156] Sum rewards: 3.974, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.435', 'AMMO2': '0.009', 'AMMO5': '0.014', 'weapon4': '0.034', 'AMMO4': '0.044', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.168', 'weapon5': '0.248', 'WEAPON5': '0.400', 'HITCOUNT': '0.610', 'weapon2': '0.838', 'WEAPON3': '1.100', 'weapon3': '2.488', 'DAMAGECOUNT': '3.276', 'FRAGCOUNT': '8.000'} [2023-02-24 18:02:05,661][177156] DAMAGECOUNT value on done: 43500.0 [2023-02-24 18:02:05,661][177156] Sum rewards: 5.619, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.306', 'AMMO5': '0.007', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'weapon5': '0.072', 'AMMO3': '0.098', 'weapon7': '0.120', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.470', 'WEAPON3': '0.550', 'weapon4': '0.630', 'weapon2': '1.056', 'weapon3': '1.342', 'DAMAGECOUNT': '2.187', 'FRAGCOUNT': '5.000'} [2023-02-24 18:02:05,716][177156] DAMAGECOUNT value on done: 45177.0 [2023-02-24 18:02:05,717][177156] Sum rewards: 4.002, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.058', 'AMMO5': '0.013', 'AMMO2': '0.025', 'ARMOR': '0.028', 'WEAPON1': '0.040', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'AMMO4': '0.123', 'weapon5': '0.298', 'weapon4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'HITCOUNT': '0.540', 'weapon3': '1.158', 'DAMAGECOUNT': '1.836', 'weapon2': '1.974', 'FRAGCOUNT': '5.000'} [2023-02-24 18:02:05,973][177156] DAMAGECOUNT value on done: 44484.0 [2023-02-24 18:02:05,973][177156] Sum rewards: 1.030, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.744', 'AMMO2': '0.012', 'AMMO5': '0.012', 'weapon7': '0.048', 'AMMO4': '0.059', 'WEAPON1': '0.060', 'AMMO3': '0.089', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.276', 'weapon4': '0.344', 'WEAPON5': '0.350', 'HITCOUNT': '0.460', 'WEAPON3': '0.550', 'weapon3': '1.394', 'weapon2': '1.572', 'DAMAGECOUNT': '1.908', 'FRAGCOUNT': '3.000'} [2023-02-24 18:02:06,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 32874496. Throughput: 0: 3484.0. Samples: 8212662. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:02:06,376][177119] Avg episode reward: [(0, '3.928')] [2023-02-24 18:02:07,426][177153] Updated weights for policy 0, policy_version 8030 (0.0008) [2023-02-24 18:02:10,385][177153] Updated weights for policy 0, policy_version 8040 (0.0008) [2023-02-24 18:02:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 32944128. Throughput: 0: 3482.5. Samples: 8233570. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:02:11,376][177119] Avg episode reward: [(0, '3.928')] [2023-02-24 18:02:13,320][177153] Updated weights for policy 0, policy_version 8050 (0.0008) [2023-02-24 18:02:15,432][177170] DAMAGECOUNT value on done: 44651.0 [2023-02-24 18:02:15,432][177170] Sum rewards: 1.590, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.500', 'AMMO5': '0.012', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'weapon7': '0.048', 'weapon5': '0.062', 'AMMO4': '0.069', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.124', 'WEAPON7': '0.200', 'weapon4': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.350', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.185', 'weapon2': '1.532', 'weapon3': '1.900', 'FRAGCOUNT': '4.000'} [2023-02-24 18:02:15,727][177170] DAMAGECOUNT value on done: 46934.0 [2023-02-24 18:02:15,728][177170] Sum rewards: -1.776, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.058', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO2': '0.031', 'AMMO3': '0.099', 'weapon5': '0.112', 'weapon7': '0.136', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.370', 'weapon2': '0.488', 'WEAPON3': '0.700', 'weapon4': '0.762', 'weapon3': '1.410', 'DAMAGECOUNT': '1.722', 'FRAGCOUNT': '2.000'} [2023-02-24 18:02:15,846][177170] DAMAGECOUNT value on done: 38875.0 [2023-02-24 18:02:15,846][177170] Sum rewards: 5.635, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.247', 'AMMO5': '0.003', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.086', 'AMMO3': '0.112', 'HITCOUNT': '0.650', 'WEAPON3': '0.750', 'weapon3': '1.464', 'DAMAGECOUNT': '2.175', 'weapon2': '2.298', 'FRAGCOUNT': '6.000'} [2023-02-24 18:02:15,937][177158] DAMAGECOUNT value on done: 42500.0 [2023-02-24 18:02:15,937][177158] Sum rewards: 1.908, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.340', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO3': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon7': '0.056', 'AMMO4': '0.089', 'WEAPON3': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon3': '0.240', 'DAMAGECOUNT': '0.540', 'weapon4': '0.724', 'FRAGCOUNT': '1.000', 'weapon2': '2.316'} [2023-02-24 18:02:16,133][177170] DAMAGECOUNT value on done: 47073.0 [2023-02-24 18:02:16,133][177170] Sum rewards: 4.286, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.550', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'weapon5': '0.064', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.276', 'HITCOUNT': '0.570', 'WEAPON3': '0.650', 'weapon2': '1.182', 'weapon3': '1.490', 'DAMAGECOUNT': '2.721', 'FRAGCOUNT': '3.500'} [2023-02-24 18:02:16,237][177158] DAMAGECOUNT value on done: 43595.0 [2023-02-24 18:02:16,237][177158] Sum rewards: 8.257, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.796', 'AMMO2': '0.002', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO4': '0.009', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO3': '0.057', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.124', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.270', 'WEAPON3': '0.400', 'weapon4': '0.482', 'weapon3': '0.982', 'weapon2': '2.158', 'DAMAGECOUNT': '2.166', 'FRAGCOUNT': '6.000'} [2023-02-24 18:02:16,272][177153] Updated weights for policy 0, policy_version 8060 (0.0008) [2023-02-24 18:02:16,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 33013760. Throughput: 0: 3483.9. Samples: 8254522. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:02:16,376][177119] Avg episode reward: [(0, '3.796')] [2023-02-24 18:02:17,076][177172] DAMAGECOUNT value on done: 44565.0 [2023-02-24 18:02:17,077][177172] Sum rewards: 3.086, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.232', 'AMMO5': '0.017', 'AMMO2': '0.030', 'ARMOR': '0.040', 'WEAPON1': '0.060', 'AMMO3': '0.115', 'AMMO4': '0.150', 'weapon5': '0.210', 'weapon4': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'HITCOUNT': '0.480', 'WEAPON3': '0.850', 'weapon2': '1.460', 'weapon3': '1.764', 'DAMAGECOUNT': '2.712', 'FRAGCOUNT': '6.000'} [2023-02-24 18:02:17,097][177158] DAMAGECOUNT value on done: 41071.0 [2023-02-24 18:02:17,098][177158] Sum rewards: 2.584, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.474', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'AMMO3': '0.086', 'weapon5': '0.126', 'AMMO4': '0.158', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'HITCOUNT': '0.360', 'ARMOR': '0.476', 'WEAPON3': '0.600', 'weapon4': '0.788', 'weapon2': '1.110', 'weapon3': '1.324', 'DAMAGECOUNT': '1.605', 'FRAGCOUNT': '4.000'} [2023-02-24 18:02:17,371][177172] DAMAGECOUNT value on done: 41335.0 [2023-02-24 18:02:17,371][177172] Sum rewards: 1.120, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.120', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'weapon7': '0.058', 'AMMO4': '0.063', 'weapon5': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.200', 'HITCOUNT': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.561', 'weapon4': '0.564', 'weapon3': '0.756', 'FRAGCOUNT': '1.000', 'weapon2': '1.464'} [2023-02-24 18:02:17,402][177158] DAMAGECOUNT value on done: 45590.0 [2023-02-24 18:02:17,403][177158] Sum rewards: 2.622, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.976', 'AMMO2': '0.010', 'AMMO5': '0.012', 'ARMOR': '0.016', 'WEAPON1': '0.040', 'AMMO4': '0.050', 'weapon7': '0.058', 'AMMO3': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.198', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.420', 'WEAPON3': '0.500', 'weapon4': '0.510', 'weapon3': '1.382', 'DAMAGECOUNT': '1.533', 'weapon2': '1.562', 'FRAGCOUNT': '3.000'} [2023-02-24 18:02:17,975][177154] DAMAGECOUNT value on done: 45214.0 [2023-02-24 18:02:17,975][177154] Sum rewards: 9.179, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.048', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.029', 'WEAPON1': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.140', 'weapon5': '0.150', 'WEAPON5': '0.350', 'HITCOUNT': '0.540', 'WEAPON3': '0.850', 'weapon3': '1.764', 'weapon2': '1.804', 'DAMAGECOUNT': '2.949', 'FRAGCOUNT': '9.000'} [2023-02-24 18:02:18,194][177172] DAMAGECOUNT value on done: 42342.0 [2023-02-24 18:02:18,275][177154] DAMAGECOUNT value on done: 43555.0 [2023-02-24 18:02:18,275][177154] Sum rewards: 6.110, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.158', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.017', 'AMMO3': '0.060', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'weapon7': '0.148', 'AMMO6': '0.320', 'AMMO7': '0.320', 'HITCOUNT': '0.370', 'WEAPON7': '0.400', 'WEAPON3': '0.400', 'weapon4': '0.468', 'weapon3': '0.790', 'weapon2': '0.802', 'DAMAGECOUNT': '1.719', 'FRAGCOUNT': '4.000'} [2023-02-24 18:02:18,489][177172] DAMAGECOUNT value on done: 42512.0 [2023-02-24 18:02:18,490][177172] Sum rewards: 5.100, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.160', 'AMMO2': '0.009', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'AMMO4': '0.044', 'AMMO3': '0.081', 'weapon5': '0.136', 'WEAPON4': '0.150', 'weapon4': '0.214', 'WEAPON5': '0.350', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'weapon3': '1.288', 'weapon2': '2.190', 'DAMAGECOUNT': '2.634', 'FRAGCOUNT': '4.000'} [2023-02-24 18:02:18,576][177154] DAMAGECOUNT value on done: 44571.0 [2023-02-24 18:02:18,577][177154] Sum rewards: -2.104, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.066', 'AMMO5': '0.008', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'AMMO4': '0.095', 'AMMO3': '0.120', 'weapon5': '0.126', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.477', 'HITCOUNT': '0.510', 'weapon4': '0.538', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.500', 'weapon2': '1.520', 'weapon3': '1.598', 'DAMAGECOUNT': '1.860'} [2023-02-24 18:02:18,880][177154] DAMAGECOUNT value on done: 44468.0 [2023-02-24 18:02:18,880][177154] Sum rewards: 3.731, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.881', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.010', 'weapon5': '0.048', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'AMMO3': '0.059', 'weapon7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.290', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON3': '0.400', 'WEAPON7': '0.500', 'weapon4': '0.758', 'weapon2': '0.872', 'weapon3': '0.978', 'DAMAGECOUNT': '1.458', 'FRAGCOUNT': '4.000'} [2023-02-24 18:02:19,122][177171] DAMAGECOUNT value on done: 42624.0 [2023-02-24 18:02:19,122][177171] Sum rewards: 4.132, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.158', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO3': '0.060', 'weapon5': '0.126', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.450', 'weapon4': '0.466', 'WEAPON3': '0.500', 'weapon2': '0.986', 'weapon3': '1.362', 'DAMAGECOUNT': '1.422', 'FRAGCOUNT': '4.000'} [2023-02-24 18:02:19,181][177157] DAMAGECOUNT value on done: 45320.0 [2023-02-24 18:02:19,181][177157] Sum rewards: 6.564, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.630', 'AMMO5': '0.006', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO3': '0.079', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.106', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.374', 'WEAPON3': '0.550', 'HITCOUNT': '0.600', 'weapon3': '1.504', 'weapon2': '1.570', 'DAMAGECOUNT': '2.595', 'FRAGCOUNT': '5.000'} [2023-02-24 18:02:19,217][177153] Updated weights for policy 0, policy_version 8070 (0.0009) [2023-02-24 18:02:19,229][177157] DAMAGECOUNT value on done: 46058.0 [2023-02-24 18:02:19,229][177157] Sum rewards: 1.854, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.113', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.034', 'WEAPON1': '0.040', 'weapon6': '0.064', 'AMMO3': '0.070', 'weapon5': '0.078', 'WEAPON6': '0.100', 'weapon7': '0.148', 'AMMO4': '0.170', 'WEAPON5': '0.250', 'HITCOUNT': '0.310', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON7': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.450', 'weapon3': '0.802', 'weapon4': '1.090', 'DAMAGECOUNT': '1.383', 'weapon2': '1.418', 'FRAGCOUNT': '4.000'} [2023-02-24 18:02:19,425][177171] DAMAGECOUNT value on done: 41598.0 [2023-02-24 18:02:19,426][177171] Sum rewards: 4.782, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.386', 'AMMO5': '0.008', 'ARMOR': '0.020', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'AMMO4': '0.125', 'weapon5': '0.172', 'WEAPON5': '0.200', 'weapon4': '0.224', 'HITCOUNT': '0.420', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.230', 'weapon2': '1.660', 'weapon3': '1.680', 'FRAGCOUNT': '6.000'} [2023-02-24 18:02:19,481][177157] DAMAGECOUNT value on done: 43918.0 [2023-02-24 18:02:19,482][177157] Sum rewards: 3.301, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.620', 'AMMO2': '0.010', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'AMMO3': '0.074', 'weapon5': '0.120', 'WEAPON5': '0.150', 'weapon4': '0.198', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'weapon3': '0.994', 'weapon2': '1.842', 'DAMAGECOUNT': '1.914', 'FRAGCOUNT': '2.000'} [2023-02-24 18:02:19,530][177157] DAMAGECOUNT value on done: 41625.0 [2023-02-24 18:02:19,531][177157] Sum rewards: 7.487, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.309', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO3': '0.030', 'WEAPON1': '0.040', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'weapon5': '0.184', 'WEAPON3': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.426', 'HITCOUNT': '0.510', 'weapon3': '0.618', 'weapon2': '2.604', 'DAMAGECOUNT': '2.640', 'FRAGCOUNT': '6.000'} [2023-02-24 18:02:19,685][177171] DAMAGECOUNT value on done: 42965.0 [2023-02-24 18:02:19,685][177171] Sum rewards: 5.960, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.042', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO3': '0.056', 'AMMO4': '0.092', 'weapon5': '0.106', 'weapon4': '0.146', 'WEAPON4': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.430', 'weapon3': '1.078', 'DAMAGECOUNT': '1.545', 'weapon2': '2.660', 'FRAGCOUNT': '3.000'} [2023-02-24 18:02:19,857][177155] DAMAGECOUNT value on done: 44045.0 [2023-02-24 18:02:19,858][177155] Sum rewards: 7.816, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.431', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'AMMO3': '0.060', 'weapon5': '0.078', 'WEAPON5': '0.150', 'WEAPON3': '0.450', 'HITCOUNT': '0.480', 'weapon3': '1.366', 'DAMAGECOUNT': '1.941', 'weapon2': '2.434', 'FRAGCOUNT': '5.000'} [2023-02-24 18:02:19,991][177171] DAMAGECOUNT value on done: 43139.0 [2023-02-24 18:02:19,991][177171] Sum rewards: 7.291, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.154', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.041', 'weapon5': '0.100', 'AMMO3': '0.101', 'WEAPON5': '0.150', 'WEAPON3': '0.650', 'HITCOUNT': '0.680', 'weapon3': '1.822', 'weapon2': '1.920', 'DAMAGECOUNT': '2.445', 'FRAGCOUNT': '7.000'} [2023-02-24 18:02:20,158][177155] DAMAGECOUNT value on done: 45951.0 [2023-02-24 18:02:20,413][177155] DAMAGECOUNT value on done: 46507.0 [2023-02-24 18:02:20,414][177155] Sum rewards: 8.820, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.648', 'AMMO2': '0.001', 'AMMO4': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'ARMOR': '0.012', 'AMMO3': '0.051', 'weapon7': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.114', 'weapon5': '0.122', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.650', 'weapon3': '1.220', 'DAMAGECOUNT': '2.202', 'weapon2': '2.410', 'FRAGCOUNT': '6.000'} [2023-02-24 18:02:20,717][177155] DAMAGECOUNT value on done: 43756.0 [2023-02-24 18:02:21,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 33083392. Throughput: 0: 3482.3. Samples: 8264952. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:02:21,376][177119] Avg episode reward: [(0, '4.083')] [2023-02-24 18:02:22,143][177153] Updated weights for policy 0, policy_version 8080 (0.0008) [2023-02-24 18:02:24,755][177156] DAMAGECOUNT value on done: 45723.0 [2023-02-24 18:02:24,756][177156] Sum rewards: 10.195, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.580', 'AMMO5': '0.014', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.073', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon5': '0.186', 'WEAPON5': '0.300', 'weapon4': '0.372', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.840', 'weapon2': '1.068', 'weapon3': '1.994', 'DAMAGECOUNT': '3.639', 'FRAGCOUNT': '10.000'} [2023-02-24 18:02:24,933][177156] DAMAGECOUNT value on done: 44248.0 [2023-02-24 18:02:24,933][177156] Sum rewards: 2.335, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.438', 'AMMO2': '0.007', 'AMMO5': '0.013', 'WEAPON1': '0.030', 'AMMO4': '0.036', 'weapon7': '0.048', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.154', 'WEAPON7': '0.200', 'weapon4': '0.212', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.480', 'weapon3': '1.230', 'FRAGCOUNT': '1.500', 'weapon2': '2.200', 'DAMAGECOUNT': '2.244'} [2023-02-24 18:02:25,063][177153] Updated weights for policy 0, policy_version 8090 (0.0008) [2023-02-24 18:02:25,064][177156] DAMAGECOUNT value on done: 45542.0 [2023-02-24 18:02:25,064][177156] Sum rewards: 2.450, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.649', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.040', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'HITCOUNT': '0.210', 'weapon5': '0.224', 'weapon4': '0.236', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.095', 'weapon3': '1.218', 'FRAGCOUNT': '2.000', 'weapon2': '2.080'} [2023-02-24 18:02:25,239][177156] DAMAGECOUNT value on done: 45124.0 [2023-02-24 18:02:25,240][177156] Sum rewards: 3.334, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.961', 'AMMO5': '0.019', 'AMMO2': '0.026', 'ARMOR': '0.032', 'AMMO3': '0.092', 'WEAPON1': '0.100', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'weapon4': '0.184', 'weapon5': '0.312', 'HITCOUNT': '0.420', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon3': '1.186', 'weapon2': '1.872', 'DAMAGECOUNT': '1.920', 'FRAGCOUNT': '5.000'} [2023-02-24 18:02:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 33153024. Throughput: 0: 3483.8. Samples: 8285888. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:02:26,376][177119] Avg episode reward: [(0, '4.136')] [2023-02-24 18:02:26,379][177140] Saving new best policy, reward=4.136! [2023-02-24 18:02:27,983][177153] Updated weights for policy 0, policy_version 8100 (0.0008) [2023-02-24 18:02:30,916][177153] Updated weights for policy 0, policy_version 8110 (0.0008) [2023-02-24 18:02:31,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 33222656. Throughput: 0: 3486.3. Samples: 8306880. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:02:31,376][177119] Avg episode reward: [(0, '4.136')] [2023-02-24 18:02:33,870][177153] Updated weights for policy 0, policy_version 8120 (0.0009) [2023-02-24 18:02:34,702][177170] DAMAGECOUNT value on done: 45578.0 [2023-02-24 18:02:34,702][177170] Sum rewards: 8.231, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.299', 'AMMO2': '0.003', 'AMMO4': '0.017', 'AMMO5': '0.020', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'weapon5': '0.112', 'weapon4': '0.252', 'WEAPON5': '0.400', 'HITCOUNT': '0.480', 'WEAPON3': '0.650', 'weapon2': '1.028', 'weapon3': '1.516', 'DAMAGECOUNT': '2.781', 'FRAGCOUNT': '8.000'} [2023-02-24 18:02:34,997][177170] DAMAGECOUNT value on done: 47735.0 [2023-02-24 18:02:34,997][177170] Sum rewards: 4.905, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.292', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON1': '0.050', 'AMMO4': '0.086', 'weapon4': '0.096', 'AMMO3': '0.102', 'WEAPON4': '0.150', 'weapon5': '0.184', 'WEAPON5': '0.250', 'HITCOUNT': '0.490', 'ARMOR': '0.515', 'WEAPON3': '0.650', 'weapon3': '1.302', 'weapon2': '2.144', 'DAMAGECOUNT': '2.403', 'FRAGCOUNT': '6.000'} [2023-02-24 18:02:35,133][177170] DAMAGECOUNT value on done: 39525.0 [2023-02-24 18:02:35,133][177170] Sum rewards: 4.691, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.015', 'AMMO5': '0.017', 'WEAPON1': '0.060', 'HEALTH': '0.066', 'AMMO4': '0.076', 'ARMOR': '0.078', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'weapon4': '0.276', 'weapon5': '0.296', 'WEAPON5': '0.350', 'HITCOUNT': '0.500', 'WEAPON3': '0.600', 'weapon2': '1.358', 'weapon3': '1.604', 'DAMAGECOUNT': '1.950', 'FRAGCOUNT': '4.000'} [2023-02-24 18:02:35,144][177158] DAMAGECOUNT value on done: 42891.0 [2023-02-24 18:02:35,144][177158] Sum rewards: 3.045, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.984', 'ARMOR': '0.008', 'AMMO2': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.049', 'WEAPON1': '0.060', 'AMMO3': '0.088', 'WEAPON4': '0.150', 'weapon5': '0.258', 'WEAPON5': '0.350', 'HITCOUNT': '0.360', 'weapon4': '0.366', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.173', 'weapon2': '1.384', 'weapon3': '1.608', 'FRAGCOUNT': '5.000'} [2023-02-24 18:02:35,430][177170] DAMAGECOUNT value on done: 47304.0 [2023-02-24 18:02:35,431][177170] Sum rewards: 0.748, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.670', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.018', 'WEAPON1': '0.020', 'AMMO3': '0.065', 'weapon5': '0.088', 'WEAPON5': '0.150', 'HITCOUNT': '0.250', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.693', 'weapon3': '0.850', 'weapon2': '2.772', 'FRAGCOUNT': '3.000'} [2023-02-24 18:02:35,448][177158] DAMAGECOUNT value on done: 44165.0 [2023-02-24 18:02:35,448][177158] Sum rewards: 3.686, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.906', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.030', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.086', 'AMMO4': '0.151', 'weapon5': '0.214', 'weapon4': '0.232', 'WEAPON5': '0.300', 'HITCOUNT': '0.340', 'WEAPON3': '0.600', 'weapon2': '1.154', 'weapon3': '1.638', 'DAMAGECOUNT': '1.710', 'FRAGCOUNT': '4.000'} [2023-02-24 18:02:36,357][177172] DAMAGECOUNT value on done: 44770.0 [2023-02-24 18:02:36,357][177172] Sum rewards: -0.384, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.677', 'AMMO5': '0.013', 'AMMO2': '0.029', 'ARMOR': '0.044', 'AMMO3': '0.050', 'WEAPON1': '0.050', 'AMMO4': '0.147', 'HITCOUNT': '0.160', 'weapon4': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon5': '0.372', 'WEAPON3': '0.400', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.615', 'weapon3': '1.042', 'weapon2': '2.178'} [2023-02-24 18:02:36,366][177158] DAMAGECOUNT value on done: 41339.0 [2023-02-24 18:02:36,366][177158] Sum rewards: 0.996, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.520', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.013', 'WEAPON1': '0.020', 'AMMO3': '0.103', 'WEAPON5': '0.200', 'weapon5': '0.202', 'HITCOUNT': '0.210', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.804', 'FRAGCOUNT': '1.000', 'weapon3': '1.134', 'weapon2': '2.470'} [2023-02-24 18:02:36,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 33292288. Throughput: 0: 3485.1. Samples: 8317316. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:02:36,376][177119] Avg episode reward: [(0, '4.109')] [2023-02-24 18:02:36,656][177172] DAMAGECOUNT value on done: 41765.0 [2023-02-24 18:02:36,657][177172] Sum rewards: 1.753, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.288', 'AMMO5': '0.012', 'AMMO2': '0.024', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'AMMO3': '0.107', 'AMMO4': '0.121', 'weapon5': '0.162', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'HITCOUNT': '0.330', 'weapon4': '0.550', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.290', 'weapon2': '1.352', 'weapon3': '1.352', 'FRAGCOUNT': '3.000'} [2023-02-24 18:02:36,663][177158] DAMAGECOUNT value on done: 45727.0 [2023-02-24 18:02:36,664][177158] Sum rewards: 2.538, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.840', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO5': '0.006', 'AMMO3': '0.026', 'AMMO4': '0.028', 'WEAPON1': '0.040', 'weapon7': '0.050', 'weapon5': '0.092', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.200', 'weapon4': '0.266', 'weapon3': '0.380', 'DAMAGECOUNT': '0.411', 'weapon2': '1.268', 'FRAGCOUNT': '2.000'} [2023-02-24 18:02:36,834][177153] Updated weights for policy 0, policy_version 8130 (0.0008) [2023-02-24 18:02:37,175][177154] DAMAGECOUNT value on done: 45574.0 [2023-02-24 18:02:37,176][177154] Sum rewards: 0.011, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.208', 'AMMO5': '0.017', 'AMMO2': '0.026', 'ARMOR': '0.040', 'weapon4': '0.040', 'WEAPON1': '0.050', 'AMMO3': '0.067', 'weapon5': '0.122', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'HITCOUNT': '0.280', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.080', 'weapon3': '1.350', 'weapon2': '1.918'} [2023-02-24 18:02:37,477][177154] DAMAGECOUNT value on done: 43669.0 [2023-02-24 18:02:37,540][177172] DAMAGECOUNT value on done: 42647.0 [2023-02-24 18:02:37,541][177172] Sum rewards: 1.090, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.122', 'AMMO5': '0.014', 'AMMO2': '0.022', 'WEAPON1': '0.070', 'AMMO3': '0.091', 'AMMO4': '0.111', 'weapon5': '0.116', 'HITCOUNT': '0.270', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.915', 'FRAGCOUNT': '1.000', 'weapon3': '1.622', 'weapon2': '2.080'} [2023-02-24 18:02:37,744][177154] DAMAGECOUNT value on done: 45758.0 [2023-02-24 18:02:37,744][177154] Sum rewards: 4.232, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.160', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'weapon7': '0.078', 'weapon5': '0.098', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'HITCOUNT': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.260', 'WEAPON3': '0.350', 'weapon3': '0.666', 'weapon2': '1.406', 'DAMAGECOUNT': '2.061', 'FRAGCOUNT': '4.000'} [2023-02-24 18:02:37,835][177172] DAMAGECOUNT value on done: 42783.0 [2023-02-24 18:02:37,835][177172] Sum rewards: 1.005, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.142', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'ARMOR': '0.056', 'weapon5': '0.056', 'AMMO4': '0.080', 'AMMO3': '0.086', 'WEAPON5': '0.200', 'HITCOUNT': '0.270', 'WEAPON4': '0.350', 'WEAPON3': '0.600', 'weapon4': '0.708', 'DAMAGECOUNT': '0.813', 'weapon3': '1.216', 'weapon2': '1.646', 'FRAGCOUNT': '2.000'} [2023-02-24 18:02:38,050][177154] DAMAGECOUNT value on done: 45038.0 [2023-02-24 18:02:38,050][177154] Sum rewards: 0.918, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.166', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'AMMO4': '0.059', 'AMMO3': '0.068', 'weapon5': '0.096', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.380', 'WEAPON3': '0.450', 'weapon4': '0.558', 'FRAGCOUNT': '1.000', 'weapon3': '1.104', 'DAMAGECOUNT': '1.710', 'weapon2': '1.880'} [2023-02-24 18:02:38,437][177171] DAMAGECOUNT value on done: 43690.0 [2023-02-24 18:02:38,437][177171] Sum rewards: 7.405, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.700', 'AMMO2': '0.005', 'AMMO5': '0.019', 'AMMO4': '0.025', 'WEAPON1': '0.080', 'AMMO3': '0.132', 'weapon5': '0.256', 'WEAPON5': '0.500', 'HITCOUNT': '0.710', 'WEAPON3': '0.750', 'weapon2': '1.638', 'weapon3': '1.792', 'DAMAGECOUNT': '3.198', 'FRAGCOUNT': '8.000'} [2023-02-24 18:02:38,482][177157] DAMAGECOUNT value on done: 45824.0 [2023-02-24 18:02:38,483][177157] Sum rewards: 1.239, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.025', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.060', 'AMMO3': '0.086', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'weapon4': '0.182', 'weapon5': '0.236', 'HITCOUNT': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'weapon3': '1.172', 'DAMAGECOUNT': '1.512', 'weapon2': '2.248', 'FRAGCOUNT': '3.000'} [2023-02-24 18:02:38,521][177157] DAMAGECOUNT value on done: 46938.0 [2023-02-24 18:02:38,522][177157] Sum rewards: 9.814, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.012', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'WEAPON1': '0.040', 'AMMO3': '0.058', 'weapon5': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.450', 'ARMOR': '0.463', 'HITCOUNT': '0.480', 'weapon4': '0.484', 'weapon3': '0.994', 'weapon2': '1.438', 'DAMAGECOUNT': '2.640', 'FRAGCOUNT': '7.000'} [2023-02-24 18:02:38,735][177171] DAMAGECOUNT value on done: 41888.0 [2023-02-24 18:02:38,736][177171] Sum rewards: 3.222, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'AMMO2': '0.041', 'weapon7': '0.046', 'AMMO3': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.128', 'WEAPON5': '0.150', 'weapon4': '0.184', 'AMMO4': '0.203', 'HITCOUNT': '0.220', 'HEALTH': '0.368', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.870', 'FRAGCOUNT': '1.000', 'weapon3': '1.254', 'weapon2': '2.250'} [2023-02-24 18:02:38,791][177157] DAMAGECOUNT value on done: 44264.0 [2023-02-24 18:02:38,792][177157] Sum rewards: 2.409, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.190', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.031', 'AMMO3': '0.088', 'weapon5': '0.116', 'AMMO4': '0.155', 'weapon4': '0.182', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.330', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.038', 'weapon3': '1.156', 'weapon2': '2.362', 'FRAGCOUNT': '3.000'} [2023-02-24 18:02:38,830][177157] DAMAGECOUNT value on done: 41725.0 [2023-02-24 18:02:39,030][177171] DAMAGECOUNT value on done: 43275.0 [2023-02-24 18:02:39,031][177171] Sum rewards: 4.872, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.450', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.037', 'AMMO3': '0.040', 'WEAPON1': '0.040', 'weapon5': '0.124', 'WEAPON5': '0.200', 'HITCOUNT': '0.290', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.930', 'weapon3': '0.984', 'FRAGCOUNT': '2.000', 'weapon2': '2.564'} [2023-02-24 18:02:39,147][177155] DAMAGECOUNT value on done: 44774.0 [2023-02-24 18:02:39,148][177155] Sum rewards: 6.109, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.622', 'AMMO5': '0.010', 'AMMO2': '0.020', 'ARMOR': '0.028', 'WEAPON1': '0.040', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'weapon4': '0.126', 'weapon5': '0.188', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'HITCOUNT': '0.550', 'weapon3': '1.498', 'weapon2': '2.004', 'DAMAGECOUNT': '2.187', 'FRAGCOUNT': '5.000'} [2023-02-24 18:02:39,333][177171] DAMAGECOUNT value on done: 43609.0 [2023-02-24 18:02:39,334][177171] Sum rewards: 0.854, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.990', 'AMMO5': '0.015', 'AMMO2': '0.018', 'ARMOR': '0.056', 'WEAPON1': '0.060', 'AMMO3': '0.090', 'AMMO4': '0.090', 'weapon4': '0.206', 'WEAPON4': '0.250', 'weapon5': '0.260', 'HITCOUNT': '0.430', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.410', 'weapon2': '1.624', 'weapon3': '1.634', 'FRAGCOUNT': '3.000'} [2023-02-24 18:02:39,448][177155] DAMAGECOUNT value on done: 46436.0 [2023-02-24 18:02:39,448][177155] Sum rewards: -4.494, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.280', 'FRAGCOUNT': '0.000', 'AMMO5': '0.020', 'AMMO2': '0.036', 'WEAPON1': '0.070', 'AMMO3': '0.136', 'AMMO4': '0.179', 'weapon5': '0.192', 'WEAPON4': '0.200', 'HITCOUNT': '0.390', 'WEAPON5': '0.450', 'weapon4': '0.488', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.455', 'weapon3': '1.458', 'weapon2': '1.512'} [2023-02-24 18:02:39,696][177155] DAMAGECOUNT value on done: 46966.0 [2023-02-24 18:02:39,697][177155] Sum rewards: -1.613, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.028', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'ARMOR': '0.032', 'AMMO3': '0.105', 'weapon5': '0.112', 'AMMO4': '0.117', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'HITCOUNT': '0.320', 'FRAGCOUNT': '0.500', 'weapon4': '0.562', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.377', 'weapon2': '1.534', 'weapon3': '1.648'} [2023-02-24 18:02:39,777][177153] Updated weights for policy 0, policy_version 8140 (0.0008) [2023-02-24 18:02:39,996][177155] DAMAGECOUNT value on done: 44005.0 [2023-02-24 18:02:39,997][177155] Sum rewards: 0.508, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.564', 'AMMO5': '0.017', 'AMMO2': '0.027', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'weapon4': '0.060', 'AMMO3': '0.078', 'WEAPON1': '0.090', 'AMMO4': '0.133', 'HITCOUNT': '0.190', 'weapon5': '0.274', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.747', 'FRAGCOUNT': '1.000', 'weapon3': '1.414', 'weapon2': '1.956'} [2023-02-24 18:02:41,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 33361920. Throughput: 0: 3482.6. Samples: 8338108. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:02:41,376][177119] Avg episode reward: [(0, '3.682')] [2023-02-24 18:02:42,700][177153] Updated weights for policy 0, policy_version 8150 (0.0008) [2023-02-24 18:02:44,074][177156] DAMAGECOUNT value on done: 45979.0 [2023-02-24 18:02:44,075][177156] Sum rewards: 2.673, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.173', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.094', 'HITCOUNT': '0.200', 'weapon5': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.532', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.768', 'weapon2': '1.106', 'weapon3': '1.678', 'FRAGCOUNT': '4.000'} [2023-02-24 18:02:44,286][177156] DAMAGECOUNT value on done: 44565.0 [2023-02-24 18:02:44,287][177156] Sum rewards: -2.688, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.052', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.037', 'ARMOR': '0.040', 'weapon7': '0.050', 'AMMO3': '0.082', 'weapon5': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.340', 'weapon4': '0.600', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.951', 'FRAGCOUNT': '1.000', 'weapon2': '1.200', 'weapon3': '1.550'} [2023-02-24 18:02:44,384][177156] DAMAGECOUNT value on done: 46267.0 [2023-02-24 18:02:44,385][177156] Sum rewards: 4.113, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.000', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO5': '0.009', 'WEAPON1': '0.030', 'AMMO4': '0.031', 'AMMO3': '0.068', 'WEAPON4': '0.200', 'weapon5': '0.206', 'WEAPON5': '0.250', 'weapon4': '0.414', 'WEAPON3': '0.500', 'HITCOUNT': '0.500', 'weapon3': '1.096', 'weapon2': '1.874', 'DAMAGECOUNT': '2.175', 'FRAGCOUNT': '3.000'} [2023-02-24 18:02:44,607][177156] DAMAGECOUNT value on done: 45700.0 [2023-02-24 18:02:44,608][177156] Sum rewards: 4.919, reward structure: {'DEATHCOUNT': '-7.500', 'ARMOR': '0.020', 'AMMO2': '0.022', 'AMMO5': '0.022', 'WEAPON4': '0.050', 'WEAPON1': '0.080', 'AMMO3': '0.097', 'AMMO4': '0.112', 'HEALTH': '0.243', 'weapon5': '0.264', 'weapon4': '0.264', 'HITCOUNT': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon2': '1.418', 'weapon3': '1.698', 'DAMAGECOUNT': '1.728', 'FRAGCOUNT': '5.000'} [2023-02-24 18:02:45,660][177153] Updated weights for policy 0, policy_version 8160 (0.0008) [2023-02-24 18:02:46,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 33431552. Throughput: 0: 3485.6. Samples: 8358974. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:02:46,376][177119] Avg episode reward: [(0, '3.602')] [2023-02-24 18:02:48,609][177153] Updated weights for policy 0, policy_version 8170 (0.0008) [2023-02-24 18:02:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 33501184. Throughput: 0: 3484.3. Samples: 8369456. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:02:51,376][177119] Avg episode reward: [(0, '3.602')] [2023-02-24 18:02:51,534][177153] Updated weights for policy 0, policy_version 8180 (0.0008) [2023-02-24 18:02:53,910][177170] DAMAGECOUNT value on done: 46328.0 [2023-02-24 18:02:53,910][177170] Sum rewards: 1.690, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.782', 'AMMO2': '0.011', 'AMMO5': '0.021', 'ARMOR': '0.040', 'AMMO4': '0.055', 'WEAPON1': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'weapon4': '0.252', 'weapon5': '0.272', 'WEAPON5': '0.500', 'HITCOUNT': '0.630', 'WEAPON3': '0.750', 'weapon2': '1.416', 'weapon3': '1.720', 'DAMAGECOUNT': '2.250', 'FRAGCOUNT': '3.500'} [2023-02-24 18:02:54,208][177170] DAMAGECOUNT value on done: 48268.0 [2023-02-24 18:02:54,209][177170] Sum rewards: 5.976, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.375', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'AMMO3': '0.055', 'weapon7': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.111', 'weapon5': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.310', 'WEAPON3': '0.350', 'weapon3': '0.668', 'weapon4': '1.002', 'weapon2': '1.394', 'DAMAGECOUNT': '1.599', 'FRAGCOUNT': '5.000'} [2023-02-24 18:02:54,327][177170] DAMAGECOUNT value on done: 39730.0 [2023-02-24 18:02:54,448][177158] DAMAGECOUNT value on done: 43578.0 [2023-02-24 18:02:54,449][177158] Sum rewards: 5.461, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.360', 'AMMO5': '0.010', 'weapon5': '0.026', 'AMMO2': '0.028', 'AMMO3': '0.056', 'WEAPON5': '0.100', 'weapon7': '0.118', 'AMMO4': '0.140', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.470', 'weapon4': '0.754', 'weapon3': '1.064', 'weapon2': '1.254', 'DAMAGECOUNT': '2.061', 'FRAGCOUNT': '6.000'} [2023-02-24 18:02:54,453][177153] Updated weights for policy 0, policy_version 8190 (0.0008) [2023-02-24 18:02:54,628][177170] DAMAGECOUNT value on done: 48139.0 [2023-02-24 18:02:54,629][177170] Sum rewards: 7.712, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.005', 'AMMO4': '0.022', 'AMMO5': '0.025', 'weapon7': '0.048', 'HEALTH': '0.061', 'WEAPON1': '0.090', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.130', 'WEAPON7': '0.200', 'weapon5': '0.308', 'HITCOUNT': '0.390', 'weapon4': '0.398', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon2': '0.902', 'weapon3': '1.988', 'DAMAGECOUNT': '2.505', 'FRAGCOUNT': '8.000'} [2023-02-24 18:02:54,745][177158] DAMAGECOUNT value on done: 44987.0 [2023-02-24 18:02:54,745][177158] Sum rewards: 9.299, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.295', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.024', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon5': '0.078', 'AMMO3': '0.086', 'weapon7': '0.160', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.442', 'WEAPON3': '0.600', 'HITCOUNT': '0.660', 'weapon2': '1.436', 'weapon3': '1.634', 'DAMAGECOUNT': '2.466', 'FRAGCOUNT': '7.000'} [2023-02-24 18:02:55,580][177158] DAMAGECOUNT value on done: 41822.0 [2023-02-24 18:02:55,580][177158] Sum rewards: 5.529, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.296', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.040', 'AMMO4': '0.050', 'AMMO3': '0.071', 'WEAPON4': '0.100', 'weapon5': '0.196', 'WEAPON5': '0.200', 'HITCOUNT': '0.310', 'weapon4': '0.330', 'WEAPON3': '0.450', 'ARMOR': '0.497', 'weapon3': '1.244', 'DAMAGECOUNT': '1.449', 'weapon2': '1.870', 'FRAGCOUNT': '5.000'} [2023-02-24 18:02:55,642][177172] DAMAGECOUNT value on done: 45194.0 [2023-02-24 18:02:55,643][177172] Sum rewards: 0.500, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.158', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.019', 'WEAPON1': '0.060', 'weapon5': '0.082', 'AMMO3': '0.088', 'AMMO4': '0.097', 'weapon7': '0.156', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'HITCOUNT': '0.310', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'weapon4': '0.730', 'weapon3': '1.062', 'DAMAGECOUNT': '1.272', 'weapon2': '1.370', 'FRAGCOUNT': '2.000'} [2023-02-24 18:02:55,892][177158] DAMAGECOUNT value on done: 46182.0 [2023-02-24 18:02:55,893][177158] Sum rewards: 0.939, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.712', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.147', 'weapon4': '0.148', 'WEAPON4': '0.150', 'weapon5': '0.164', 'WEAPON5': '0.300', 'HITCOUNT': '0.400', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.365', 'weapon3': '1.394', 'weapon2': '1.998', 'FRAGCOUNT': '3.000'} [2023-02-24 18:02:55,946][177172] DAMAGECOUNT value on done: 42519.0 [2023-02-24 18:02:55,946][177172] Sum rewards: 6.103, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.928', 'ARMOR': '0.005', 'AMMO5': '0.010', 'AMMO2': '0.039', 'WEAPON1': '0.060', 'weapon7': '0.064', 'AMMO3': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.197', 'WEAPON7': '0.200', 'weapon5': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'HITCOUNT': '0.380', 'WEAPON3': '0.500', 'weapon4': '0.514', 'weapon3': '1.396', 'weapon2': '1.486', 'DAMAGECOUNT': '2.262', 'FRAGCOUNT': '7.000'} [2023-02-24 18:02:56,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 33570816. Throughput: 0: 3485.8. Samples: 8390432. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:02:56,376][177119] Avg episode reward: [(0, '3.573')] [2023-02-24 18:02:56,379][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000008196_33570816.pth... [2023-02-24 18:02:56,438][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000007379_30224384.pth [2023-02-24 18:02:56,454][177154] DAMAGECOUNT value on done: 46281.0 [2023-02-24 18:02:56,455][177154] Sum rewards: 2.668, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.486', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'AMMO2': '0.033', 'weapon7': '0.056', 'AMMO3': '0.085', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.164', 'weapon5': '0.188', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.330', 'WEAPON4': '0.550', 'WEAPON3': '0.600', 'weapon4': '0.814', 'weapon3': '1.094', 'weapon2': '1.624', 'DAMAGECOUNT': '2.121', 'FRAGCOUNT': '4.000'} [2023-02-24 18:02:56,750][177154] DAMAGECOUNT value on done: 44463.0 [2023-02-24 18:02:56,751][177154] Sum rewards: 5.872, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.278', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.030', 'WEAPON1': '0.040', 'AMMO3': '0.074', 'weapon5': '0.136', 'AMMO4': '0.151', 'weapon7': '0.178', 'WEAPON5': '0.250', 'HITCOUNT': '0.330', 'WEAPON4': '0.350', 'AMMO6': '0.420', 'AMMO7': '0.420', 'WEAPON3': '0.500', 'WEAPON7': '0.500', 'weapon2': '0.872', 'weapon4': '0.978', 'weapon3': '1.064', 'DAMAGECOUNT': '2.340', 'FRAGCOUNT': '6.000'} [2023-02-24 18:02:56,837][177172] DAMAGECOUNT value on done: 43337.0 [2023-02-24 18:02:56,838][177172] Sum rewards: 6.346, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.840', 'AMMO5': '0.012', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'weapon5': '0.090', 'AMMO3': '0.112', 'AMMO4': '0.129', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.380', 'HITCOUNT': '0.520', 'WEAPON3': '0.700', 'weapon2': '1.492', 'weapon3': '1.584', 'DAMAGECOUNT': '2.070', 'FRAGCOUNT': '5.500'} [2023-02-24 18:02:57,017][177154] DAMAGECOUNT value on done: 46253.0 [2023-02-24 18:02:57,017][177154] Sum rewards: 6.716, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'HEALTH': '0.153', 'weapon4': '0.202', 'weapon5': '0.238', 'HITCOUNT': '0.350', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.485', 'weapon3': '1.558', 'weapon2': '1.770', 'FRAGCOUNT': '6.000'} [2023-02-24 18:02:57,143][177172] DAMAGECOUNT value on done: 43318.0 [2023-02-24 18:02:57,143][177172] Sum rewards: 5.379, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.782', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'weapon7': '0.052', 'weapon5': '0.056', 'AMMO3': '0.058', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.300', 'weapon4': '0.372', 'WEAPON3': '0.400', 'weapon3': '1.000', 'weapon2': '1.460', 'DAMAGECOUNT': '1.605', 'FRAGCOUNT': '4.000'} [2023-02-24 18:02:57,324][177154] DAMAGECOUNT value on done: 45223.0 [2023-02-24 18:02:57,325][177154] Sum rewards: 3.578, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.390', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.040', 'AMMO3': '0.046', 'AMMO4': '0.046', 'HITCOUNT': '0.160', 'weapon5': '0.178', 'WEAPON5': '0.200', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.555', 'weapon3': '0.930', 'FRAGCOUNT': '1.000', 'weapon2': '2.698'} [2023-02-24 18:02:57,414][177153] Updated weights for policy 0, policy_version 8200 (0.0008) [2023-02-24 18:02:57,773][177157] DAMAGECOUNT value on done: 46546.0 [2023-02-24 18:02:57,773][177157] Sum rewards: 6.074, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.099', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.013', 'AMMO3': '0.030', 'WEAPON1': '0.030', 'AMMO4': '0.065', 'weapon7': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.360', 'weapon3': '0.736', 'weapon2': '0.914', 'weapon4': '1.250', 'DAMAGECOUNT': '2.166', 'FRAGCOUNT': '4.000'} [2023-02-24 18:02:57,799][177171] DAMAGECOUNT value on done: 44422.0 [2023-02-24 18:02:57,800][177171] Sum rewards: 5.493, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.000', 'AMMO5': '0.019', 'AMMO2': '0.025', 'WEAPON1': '0.090', 'AMMO3': '0.112', 'AMMO4': '0.124', 'weapon5': '0.282', 'HITCOUNT': '0.430', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon2': '1.362', 'weapon3': '2.102', 'DAMAGECOUNT': '2.196', 'FRAGCOUNT': '6.000'} [2023-02-24 18:02:57,811][177157] DAMAGECOUNT value on done: 47653.0 [2023-02-24 18:02:57,812][177157] Sum rewards: 7.119, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.289', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'weapon7': '0.050', 'ARMOR': '0.052', 'AMMO3': '0.094', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'weapon5': '0.212', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'HITCOUNT': '0.480', 'WEAPON3': '0.650', 'weapon4': '0.796', 'weapon2': '1.300', 'weapon3': '1.410', 'DAMAGECOUNT': '2.145', 'FRAGCOUNT': '7.000'} [2023-02-24 18:02:58,077][177157] DAMAGECOUNT value on done: 44649.0 [2023-02-24 18:02:58,077][177157] Sum rewards: 1.882, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.136', 'AMMO2': '0.010', 'AMMO5': '0.020', 'AMMO4': '0.052', 'WEAPON1': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon4': '0.228', 'HITCOUNT': '0.310', 'weapon5': '0.350', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.155', 'weapon3': '1.358', 'weapon2': '1.786', 'FRAGCOUNT': '3.000'} [2023-02-24 18:02:58,101][177171] DAMAGECOUNT value on done: 42845.0 [2023-02-24 18:02:58,101][177171] Sum rewards: 6.746, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.456', 'AMMO5': '0.007', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'weapon7': '0.060', 'weapon5': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.700', 'HITCOUNT': '0.810', 'weapon2': '0.924', 'weapon4': '0.986', 'weapon3': '1.328', 'DAMAGECOUNT': '2.871', 'FRAGCOUNT': '6.000'} [2023-02-24 18:02:58,118][177157] DAMAGECOUNT value on done: 41865.0 [2023-02-24 18:02:58,118][177157] Sum rewards: 2.304, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.145', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'weapon5': '0.010', 'WEAPON1': '0.010', 'AMMO3': '0.020', 'WEAPON5': '0.050', 'weapon7': '0.118', 'HITCOUNT': '0.140', 'WEAPON3': '0.150', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon3': '0.390', 'WEAPON7': '0.400', 'DAMAGECOUNT': '0.420', 'weapon4': '0.942', 'weapon2': '1.154', 'FRAGCOUNT': '2.000'} [2023-02-24 18:02:58,384][177171] DAMAGECOUNT value on done: 44135.0 [2023-02-24 18:02:58,385][177171] Sum rewards: 5.546, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.072', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'AMMO3': '0.081', 'weapon7': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.520', 'WEAPON3': '0.600', 'weapon4': '0.666', 'weapon2': '1.354', 'weapon3': '1.514', 'DAMAGECOUNT': '2.580', 'FRAGCOUNT': '6.000'} [2023-02-24 18:02:58,451][177155] DAMAGECOUNT value on done: 45633.0 [2023-02-24 18:02:58,452][177155] Sum rewards: 6.044, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.198', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.029', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO3': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.480', 'HITCOUNT': '0.530', 'weapon4': '0.706', 'WEAPON3': '0.750', 'weapon3': '1.610', 'DAMAGECOUNT': '2.577', 'FRAGCOUNT': '6.000'} [2023-02-24 18:02:58,689][177171] DAMAGECOUNT value on done: 44111.0 [2023-02-24 18:02:58,689][177171] Sum rewards: 4.176, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.035', 'AMMO5': '0.010', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'AMMO3': '0.046', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.113', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'weapon4': '0.350', 'HITCOUNT': '0.360', 'weapon3': '0.888', 'DAMAGECOUNT': '1.506', 'weapon2': '2.098', 'FRAGCOUNT': '3.000'} [2023-02-24 18:02:58,755][177155] DAMAGECOUNT value on done: 46750.0 [2023-02-24 18:02:58,756][177155] Sum rewards: 2.906, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO3': '0.030', 'WEAPON1': '0.040', 'weapon7': '0.074', 'HEALTH': '0.091', 'weapon4': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.112', 'HITCOUNT': '0.160', 'WEAPON3': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.262', 'FRAGCOUNT': '0.500', 'weapon3': '0.772', 'DAMAGECOUNT': '0.942', 'weapon2': '2.644'} [2023-02-24 18:02:59,009][177155] DAMAGECOUNT value on done: 47643.0 [2023-02-24 18:02:59,010][177155] Sum rewards: 2.376, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.981', 'AMMO5': '0.013', 'ARMOR': '0.020', 'AMMO2': '0.032', 'WEAPON1': '0.060', 'weapon7': '0.062', 'weapon5': '0.076', 'AMMO3': '0.102', 'AMMO4': '0.161', 'WEAPON5': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.456', 'HITCOUNT': '0.520', 'WEAPON3': '0.750', 'weapon4': '1.032', 'weapon3': '1.552', 'DAMAGECOUNT': '2.031', 'FRAGCOUNT': '4.000'} [2023-02-24 18:02:59,302][177155] DAMAGECOUNT value on done: 44569.0 [2023-02-24 18:02:59,302][177155] Sum rewards: 4.128, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'HEALTH': '0.025', 'AMMO2': '0.031', 'weapon5': '0.072', 'AMMO3': '0.097', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'weapon4': '0.220', 'WEAPON4': '0.250', 'HITCOUNT': '0.550', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.692', 'weapon2': '1.740', 'weapon3': '1.816', 'FRAGCOUNT': '5.000'} [2023-02-24 18:03:00,330][177153] Updated weights for policy 0, policy_version 8210 (0.0008) [2023-02-24 18:03:01,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 33640448. Throughput: 0: 3484.0. Samples: 8411302. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:03:01,376][177119] Avg episode reward: [(0, '3.591')] [2023-02-24 18:03:03,245][177153] Updated weights for policy 0, policy_version 8220 (0.0009) [2023-02-24 18:03:03,479][177156] DAMAGECOUNT value on done: 46554.0 [2023-02-24 18:03:03,480][177156] Sum rewards: 7.050, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.003', 'weapon7': '0.004', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.043', 'WEAPON4': '0.050', 'weapon5': '0.050', 'weapon4': '0.076', 'AMMO4': '0.080', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'HEALTH': '0.245', 'WEAPON3': '0.250', 'HITCOUNT': '0.480', 'weapon3': '0.914', 'DAMAGECOUNT': '1.725', 'weapon2': '2.694', 'FRAGCOUNT': '3.000'} [2023-02-24 18:03:03,702][177156] DAMAGECOUNT value on done: 45365.0 [2023-02-24 18:03:03,703][177156] Sum rewards: 8.978, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.691', 'ARMOR': '0.004', 'AMMO2': '0.012', 'AMMO5': '0.016', 'WEAPON1': '0.040', 'AMMO4': '0.062', 'weapon4': '0.082', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'weapon5': '0.202', 'WEAPON5': '0.400', 'HITCOUNT': '0.580', 'WEAPON3': '0.700', 'weapon2': '1.636', 'weapon3': '1.774', 'DAMAGECOUNT': '2.400', 'FRAGCOUNT': '9.000'} [2023-02-24 18:03:03,801][177156] DAMAGECOUNT value on done: 47740.0 [2023-02-24 18:03:03,801][177156] Sum rewards: 8.948, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.190', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO3': '0.101', 'AMMO4': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.292', 'weapon4': '0.302', 'HITCOUNT': '0.610', 'WEAPON3': '0.650', 'weapon2': '1.198', 'weapon3': '1.888', 'DAMAGECOUNT': '3.519', 'FRAGCOUNT': '8.500'} [2023-02-24 18:03:04,017][177156] DAMAGECOUNT value on done: 46300.0 [2023-02-24 18:03:04,017][177156] Sum rewards: 0.511, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.134', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.050', 'weapon7': '0.084', 'AMMO4': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.149', 'WEAPON4': '0.200', 'weapon5': '0.232', 'weapon4': '0.322', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.420', 'WEAPON3': '0.850', 'weapon2': '1.444', 'weapon3': '1.672', 'DAMAGECOUNT': '1.800', 'FRAGCOUNT': '3.000'} [2023-02-24 18:03:06,173][177153] Updated weights for policy 0, policy_version 8230 (0.0008) [2023-02-24 18:03:06,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 33710080. Throughput: 0: 3485.6. Samples: 8421806. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:03:06,376][177119] Avg episode reward: [(0, '3.725')] [2023-02-24 18:03:09,222][177153] Updated weights for policy 0, policy_version 8240 (0.0009) [2023-02-24 18:03:11,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 33779712. Throughput: 0: 3473.7. Samples: 8442206. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:03:11,376][177119] Avg episode reward: [(0, '3.725')] [2023-02-24 18:03:12,195][177153] Updated weights for policy 0, policy_version 8250 (0.0008) [2023-02-24 18:03:13,226][177170] DAMAGECOUNT value on done: 47169.0 [2023-02-24 18:03:13,227][177170] Sum rewards: 5.901, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.852', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO3': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'weapon5': '0.074', 'weapon7': '0.168', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.360', 'WEAPON7': '0.400', 'weapon2': '0.730', 'weapon4': '0.746', 'weapon3': '0.802', 'DAMAGECOUNT': '2.523', 'FRAGCOUNT': '5.000'} [2023-02-24 18:03:13,534][177170] DAMAGECOUNT value on done: 49823.0 [2023-02-24 18:03:13,534][177170] Sum rewards: 10.131, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.335', 'AMMO5': '0.024', 'AMMO2': '0.029', 'weapon7': '0.070', 'WEAPON1': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.122', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'weapon5': '0.152', 'WEAPON7': '0.200', 'WEAPON5': '0.500', 'weapon4': '0.536', 'HITCOUNT': '0.710', 'WEAPON3': '0.800', 'weapon2': '1.276', 'weapon3': '1.604', 'DAMAGECOUNT': '4.065', 'FRAGCOUNT': '9.000'} [2023-02-24 18:03:13,646][177170] DAMAGECOUNT value on done: 40597.0 [2023-02-24 18:03:13,646][177170] Sum rewards: 5.817, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.752', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.026', 'WEAPON1': '0.080', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'AMMO4': '0.128', 'weapon4': '0.234', 'weapon5': '0.292', 'WEAPON5': '0.400', 'HITCOUNT': '0.500', 'WEAPON3': '0.550', 'weapon3': '1.434', 'weapon2': '1.614', 'DAMAGECOUNT': '2.601', 'FRAGCOUNT': '6.000'} [2023-02-24 18:03:13,830][177158] DAMAGECOUNT value on done: 43883.0 [2023-02-24 18:03:13,831][177158] Sum rewards: 0.837, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.586', 'AMMO5': '0.011', 'AMMO2': '0.027', 'WEAPON1': '0.060', 'AMMO3': '0.079', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'weapon5': '0.288', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'weapon4': '0.594', 'DAMAGECOUNT': '0.915', 'weapon3': '1.238', 'weapon2': '1.614', 'FRAGCOUNT': '2.000'} [2023-02-24 18:03:13,950][177170] DAMAGECOUNT value on done: 49117.0 [2023-02-24 18:03:13,951][177170] Sum rewards: 7.417, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.594', 'AMMO2': '0.008', 'AMMO5': '0.017', 'AMMO4': '0.038', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.128', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'weapon4': '0.418', 'HITCOUNT': '0.780', 'WEAPON3': '1.000', 'weapon2': '1.076', 'weapon3': '1.876', 'DAMAGECOUNT': '2.934', 'FRAGCOUNT': '10.000'} [2023-02-24 18:03:14,138][177158] DAMAGECOUNT value on done: 45362.0 [2023-02-24 18:03:14,138][177158] Sum rewards: 2.490, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.268', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.054', 'AMMO4': '0.082', 'weapon5': '0.086', 'WEAPON5': '0.100', 'weapon7': '0.162', 'HITCOUNT': '0.220', 'WEAPON4': '0.250', 'AMMO6': '0.340', 'AMMO7': '0.340', 'weapon2': '0.446', 'WEAPON3': '0.450', 'WEAPON7': '0.500', 'weapon3': '0.898', 'weapon4': '0.904', 'DAMAGECOUNT': '1.125', 'FRAGCOUNT': '3.000'} [2023-02-24 18:03:14,965][177158] DAMAGECOUNT value on done: 42377.0 [2023-02-24 18:03:14,965][177158] Sum rewards: 0.886, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.068', 'AMMO5': '0.023', 'AMMO2': '0.027', 'WEAPON1': '0.080', 'AMMO3': '0.097', 'AMMO4': '0.133', 'WEAPON4': '0.150', 'HITCOUNT': '0.270', 'weapon5': '0.324', 'weapon4': '0.448', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'weapon3': '1.292', 'weapon2': '1.494', 'DAMAGECOUNT': '1.665', 'FRAGCOUNT': '3.000'} [2023-02-24 18:03:15,080][177172] DAMAGECOUNT value on done: 46022.0 [2023-02-24 18:03:15,080][177172] Sum rewards: 3.428, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.409', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'weapon5': '0.250', 'weapon4': '0.332', 'WEAPON5': '0.350', 'HITCOUNT': '0.610', 'WEAPON3': '0.800', 'weapon2': '1.044', 'weapon3': '2.066', 'DAMAGECOUNT': '2.484', 'FRAGCOUNT': '4.000'} [2023-02-24 18:03:15,150][177153] Updated weights for policy 0, policy_version 8260 (0.0008) [2023-02-24 18:03:15,265][177158] DAMAGECOUNT value on done: 47299.0 [2023-02-24 18:03:15,266][177158] Sum rewards: 12.210, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.198', 'AMMO5': '0.010', 'AMMO2': '0.025', 'ARMOR': '0.040', 'weapon7': '0.046', 'WEAPON1': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.117', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'weapon5': '0.154', 'weapon4': '0.198', 'WEAPON5': '0.250', 'WEAPON3': '0.750', 'HITCOUNT': '0.820', 'weapon2': '1.016', 'weapon3': '2.256', 'DAMAGECOUNT': '3.351', 'FRAGCOUNT': '11.000'} [2023-02-24 18:03:15,372][177172] DAMAGECOUNT value on done: 43109.0 [2023-02-24 18:03:15,372][177172] Sum rewards: 8.012, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.477', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO3': '0.040', 'WEAPON1': '0.040', 'AMMO4': '0.096', 'weapon5': '0.146', 'WEAPON5': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.300', 'weapon3': '0.870', 'DAMAGECOUNT': '1.770', 'weapon2': '2.762', 'FRAGCOUNT': '5.000'} [2023-02-24 18:03:15,938][177154] DAMAGECOUNT value on done: 47225.0 [2023-02-24 18:03:15,938][177154] Sum rewards: 11.101, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.884', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'AMMO3': '0.060', 'weapon7': '0.076', 'AMMO4': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.154', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.720', 'weapon4': '0.946', 'weapon2': '1.014', 'weapon3': '1.330', 'DAMAGECOUNT': '2.832', 'FRAGCOUNT': '10.000'} [2023-02-24 18:03:16,247][177154] DAMAGECOUNT value on done: 45127.0 [2023-02-24 18:03:16,248][177154] Sum rewards: 4.862, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.383', 'AMMO5': '0.018', 'AMMO2': '0.046', 'AMMO3': '0.050', 'weapon7': '0.052', 'WEAPON1': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.229', 'weapon5': '0.282', 'HITCOUNT': '0.290', 'WEAPON3': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.676', 'weapon2': '1.096', 'weapon3': '1.184', 'DAMAGECOUNT': '1.992', 'FRAGCOUNT': '4.000'} [2023-02-24 18:03:16,266][177172] DAMAGECOUNT value on done: 43815.0 [2023-02-24 18:03:16,267][177172] Sum rewards: 6.172, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.060', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO3': '0.030', 'AMMO2': '0.037', 'weapon7': '0.074', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.186', 'WEAPON3': '0.200', 'WEAPON4': '0.250', 'AMMO6': '0.260', 'AMMO7': '0.260', 'HITCOUNT': '0.290', 'WEAPON7': '0.300', 'weapon4': '0.588', 'weapon3': '0.756', 'weapon2': '1.114', 'DAMAGECOUNT': '1.434', 'FRAGCOUNT': '4.000'} [2023-02-24 18:03:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 33849344. Throughput: 0: 3469.5. Samples: 8463008. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 18:03:16,376][177119] Avg episode reward: [(0, '4.104')] [2023-02-24 18:03:16,503][177154] DAMAGECOUNT value on done: 46850.0 [2023-02-24 18:03:16,503][177154] Sum rewards: -0.006, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.512', 'AMMO5': '0.024', 'AMMO2': '0.027', 'WEAPON1': '0.120', 'AMMO4': '0.135', 'AMMO3': '0.140', 'weapon5': '0.266', 'HITCOUNT': '0.370', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'weapon2': '1.216', 'DAMAGECOUNT': '1.791', 'FRAGCOUNT': '2.000', 'weapon3': '2.118'} [2023-02-24 18:03:16,565][177172] DAMAGECOUNT value on done: 43649.0 [2023-02-24 18:03:16,565][177172] Sum rewards: 6.305, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.200', 'AMMO2': '0.008', 'AMMO3': '0.030', 'AMMO4': '0.041', 'weapon4': '0.064', 'weapon7': '0.066', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.250', 'weapon3': '0.520', 'DAMAGECOUNT': '0.993', 'FRAGCOUNT': '3.000', 'weapon2': '3.042'} [2023-02-24 18:03:16,802][177154] DAMAGECOUNT value on done: 45814.0 [2023-02-24 18:03:16,803][177154] Sum rewards: 4.963, reward structure: {'DEATHCOUNT': '-7.500', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'HEALTH': '0.076', 'AMMO4': '0.079', 'weapon5': '0.108', 'AMMO3': '0.119', 'weapon7': '0.120', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.370', 'weapon4': '0.382', 'WEAPON3': '0.650', 'weapon2': '1.280', 'weapon3': '1.484', 'DAMAGECOUNT': '1.773', 'FRAGCOUNT': '5.000'} [2023-02-24 18:03:17,220][177157] DAMAGECOUNT value on done: 47249.0 [2023-02-24 18:03:17,220][177157] Sum rewards: 2.264, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.700', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.019', 'WEAPON1': '0.080', 'AMMO3': '0.134', 'WEAPON4': '0.150', 'weapon5': '0.178', 'HITCOUNT': '0.400', 'weapon4': '0.488', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'weapon2': '1.244', 'weapon3': '1.762', 'DAMAGECOUNT': '2.109', 'FRAGCOUNT': '5.000'} [2023-02-24 18:03:17,257][177157] DAMAGECOUNT value on done: 48485.0 [2023-02-24 18:03:17,258][177157] Sum rewards: 12.583, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.948', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.018', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'weapon7': '0.050', 'AMMO3': '0.073', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.418', 'WEAPON3': '0.550', 'HITCOUNT': '0.840', 'weapon3': '1.648', 'weapon2': '1.714', 'DAMAGECOUNT': '2.496', 'FRAGCOUNT': '11.000'} [2023-02-24 18:03:17,271][177171] DAMAGECOUNT value on done: 45017.0 [2023-02-24 18:03:17,271][177171] Sum rewards: 7.197, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.764', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO3': '0.057', 'AMMO4': '0.064', 'weapon5': '0.072', 'weapon7': '0.128', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.450', 'HITCOUNT': '0.500', 'weapon4': '0.804', 'weapon2': '0.890', 'weapon3': '1.136', 'DAMAGECOUNT': '1.785', 'FRAGCOUNT': '5.000'} [2023-02-24 18:03:17,499][177157] Large shaping reward 2.539 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.093, -31.0), ('weapon5', 0.002)] [2023-02-24 18:03:17,524][177157] DAMAGECOUNT value on done: 45141.0 [2023-02-24 18:03:17,525][177157] Sum rewards: 4.585, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.335', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon7': '0.048', 'WEAPON1': '0.060', 'AMMO3': '0.085', 'AMMO4': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon5': '0.304', 'HITCOUNT': '0.310', 'WEAPON3': '0.500', 'weapon4': '0.578', 'weapon3': '1.260', 'weapon2': '1.470', 'DAMAGECOUNT': '1.476', 'FRAGCOUNT': '3.000'} [2023-02-24 18:03:17,565][177171] DAMAGECOUNT value on done: 43498.0 [2023-02-24 18:03:17,566][177171] Sum rewards: 0.952, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.849', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.023', 'WEAPON1': '0.060', 'weapon5': '0.094', 'AMMO4': '0.116', 'AMMO3': '0.137', 'WEAPON4': '0.200', 'weapon4': '0.214', 'WEAPON5': '0.400', 'HITCOUNT': '0.460', 'WEAPON3': '0.900', 'weapon2': '1.498', 'DAMAGECOUNT': '1.959', 'weapon3': '1.968', 'FRAGCOUNT': '3.000'} [2023-02-24 18:03:17,566][177157] DAMAGECOUNT value on done: 42459.0 [2023-02-24 18:03:17,566][177157] Sum rewards: 2.269, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.838', 'AMMO5': '0.006', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'AMMO4': '0.070', 'weapon5': '0.116', 'weapon7': '0.132', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'HITCOUNT': '0.330', 'WEAPON4': '0.350', 'WEAPON3': '0.350', 'WEAPON7': '0.400', 'weapon4': '0.666', 'weapon3': '0.966', 'weapon2': '1.422', 'DAMAGECOUNT': '1.545', 'FRAGCOUNT': '3.000'} [2023-02-24 18:03:17,833][177155] DAMAGECOUNT value on done: 46665.0 [2023-02-24 18:03:17,834][177155] Sum rewards: 14.488, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.323', 'AMMO5': '0.007', 'AMMO2': '0.028', 'WEAPON1': '0.050', 'AMMO3': '0.078', 'AMMO4': '0.139', 'WEAPON5': '0.250', 'weapon5': '0.260', 'HITCOUNT': '0.540', 'WEAPON3': '0.550', 'weapon3': '1.624', 'weapon2': '1.688', 'DAMAGECOUNT': '3.096', 'FRAGCOUNT': '11.000'} [2023-02-24 18:03:17,855][177171] DAMAGECOUNT value on done: 44325.0 [2023-02-24 18:03:17,855][177171] Sum rewards: 0.496, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.872', 'AMMO2': '0.017', 'AMMO5': '0.017', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'WEAPON1': '0.080', 'AMMO4': '0.084', 'AMMO3': '0.115', 'HITCOUNT': '0.170', 'weapon5': '0.254', 'weapon4': '0.328', 'WEAPON5': '0.450', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.750', 'weapon2': '0.982', 'weapon3': '1.960', 'FRAGCOUNT': '3.000'} [2023-02-24 18:03:18,096][177153] Updated weights for policy 0, policy_version 8270 (0.0008) [2023-02-24 18:03:18,136][177155] DAMAGECOUNT value on done: 47165.0 [2023-02-24 18:03:18,137][177155] Sum rewards: 1.629, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.678', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'weapon7': '0.052', 'AMMO4': '0.054', 'AMMO3': '0.055', 'weapon5': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.320', 'WEAPON3': '0.350', 'weapon4': '0.566', 'weapon3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.032', 'DAMAGECOUNT': '1.245'} [2023-02-24 18:03:18,150][177171] DAMAGECOUNT value on done: 44942.0 [2023-02-24 18:03:18,150][177171] Sum rewards: 3.791, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.898', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon5': '0.044', 'WEAPON1': '0.050', 'weapon7': '0.108', 'AMMO3': '0.170', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'AMMO4': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.398', 'HITCOUNT': '0.670', 'WEAPON3': '0.950', 'weapon2': '1.092', 'weapon3': '2.050', 'DAMAGECOUNT': '2.493', 'FRAGCOUNT': '5.000'} [2023-02-24 18:03:18,408][177155] DAMAGECOUNT value on done: 48727.0 [2023-02-24 18:03:18,409][177155] Sum rewards: 8.659, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.810', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO3': '0.050', 'WEAPON1': '0.070', 'weapon7': '0.114', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.286', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.580', 'weapon4': '0.620', 'weapon2': '1.304', 'weapon3': '1.342', 'DAMAGECOUNT': '3.252', 'FRAGCOUNT': '6.000'} [2023-02-24 18:03:18,708][177155] DAMAGECOUNT value on done: 44919.0 [2023-02-24 18:03:18,708][177155] Sum rewards: 4.738, reward structure: {'DEATHCOUNT': '-3.750', 'ARMOR': '0.004', 'AMMO2': '0.010', 'AMMO4': '0.048', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON3': '0.300', 'weapon4': '0.364', 'HITCOUNT': '0.370', 'HEALTH': '0.406', 'weapon3': '0.892', 'DAMAGECOUNT': '1.050', 'weapon2': '1.572', 'FRAGCOUNT': '3.000'} [2023-02-24 18:03:21,033][177153] Updated weights for policy 0, policy_version 8280 (0.0008) [2023-02-24 18:03:21,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 33918976. Throughput: 0: 3469.7. Samples: 8473452. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:03:21,376][177119] Avg episode reward: [(0, '4.192')] [2023-02-24 18:03:21,377][177140] Saving new best policy, reward=4.192! [2023-02-24 18:03:22,962][177156] DAMAGECOUNT value on done: 47848.0 [2023-02-24 18:03:22,963][177156] Sum rewards: 9.149, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.929', 'ARMOR': '0.012', 'AMMO5': '0.019', 'AMMO2': '0.037', 'weapon7': '0.052', 'WEAPON1': '0.070', 'AMMO3': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.187', 'weapon5': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'weapon4': '0.638', 'WEAPON3': '0.650', 'weapon2': '0.698', 'HITCOUNT': '0.770', 'weapon3': '1.992', 'DAMAGECOUNT': '3.882', 'FRAGCOUNT': '8.000'} [2023-02-24 18:03:23,178][177156] DAMAGECOUNT value on done: 45725.0 [2023-02-24 18:03:23,179][177156] Sum rewards: 4.852, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.180', 'AMMO2': '0.014', 'AMMO5': '0.017', 'AMMO4': '0.070', 'WEAPON1': '0.070', 'AMMO3': '0.077', 'weapon5': '0.216', 'HITCOUNT': '0.310', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.080', 'weapon3': '1.642', 'weapon2': '1.936', 'FRAGCOUNT': '4.000'} [2023-02-24 18:03:23,268][177156] DAMAGECOUNT value on done: 48539.0 [2023-02-24 18:03:23,269][177156] Sum rewards: 7.733, reward structure: {'DEATHCOUNT': '-6.750', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.031', 'WEAPON1': '0.050', 'weapon7': '0.086', 'AMMO3': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.118', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.390', 'HEALTH': '0.476', 'WEAPON3': '0.500', 'weapon4': '0.932', 'weapon2': '0.996', 'weapon3': '1.486', 'DAMAGECOUNT': '2.397', 'FRAGCOUNT': '6.000'} [2023-02-24 18:03:23,487][177156] DAMAGECOUNT value on done: 46922.0 [2023-02-24 18:03:23,488][177156] Sum rewards: 8.011, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'ARMOR': '0.039', 'AMMO3': '0.050', 'weapon5': '0.066', 'weapon7': '0.068', 'HEALTH': '0.083', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.520', 'weapon2': '1.140', 'weapon3': '1.182', 'weapon4': '1.198', 'DAMAGECOUNT': '1.866', 'FRAGCOUNT': '5.000'} [2023-02-24 18:03:23,982][177153] Updated weights for policy 0, policy_version 8290 (0.0008) [2023-02-24 18:03:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 33988608. Throughput: 0: 3473.9. Samples: 8494432. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:03:26,376][177119] Avg episode reward: [(0, '4.339')] [2023-02-24 18:03:26,380][177140] Saving new best policy, reward=4.339! [2023-02-24 18:03:26,923][177153] Updated weights for policy 0, policy_version 8300 (0.0008) [2023-02-24 18:03:29,846][177153] Updated weights for policy 0, policy_version 8310 (0.0008) [2023-02-24 18:03:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 34058240. Throughput: 0: 3475.6. Samples: 8515376. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:03:31,376][177119] Avg episode reward: [(0, '4.339')] [2023-02-24 18:03:32,390][177170] DAMAGECOUNT value on done: 47665.0 [2023-02-24 18:03:32,390][177170] Sum rewards: 3.139, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.328', 'AMMO2': '0.004', 'AMMO5': '0.009', 'AMMO4': '0.019', 'WEAPON1': '0.050', 'AMMO3': '0.127', 'weapon5': '0.188', 'WEAPON5': '0.250', 'HITCOUNT': '0.440', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.488', 'weapon3': '1.776', 'weapon2': '1.816', 'FRAGCOUNT': '5.000'} [2023-02-24 18:03:32,701][177170] DAMAGECOUNT value on done: 50597.0 [2023-02-24 18:03:32,701][177170] Sum rewards: 5.623, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.620', 'ARMOR': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'weapon7': '0.056', 'AMMO4': '0.070', 'weapon5': '0.078', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.350', 'WEAPON3': '0.600', 'weapon4': '0.658', 'weapon2': '1.096', 'weapon3': '1.404', 'DAMAGECOUNT': '2.322', 'FRAGCOUNT': '5.000'} [2023-02-24 18:03:32,793][177153] Updated weights for policy 0, policy_version 8320 (0.0008) [2023-02-24 18:03:32,832][177170] DAMAGECOUNT value on done: 41342.0 [2023-02-24 18:03:32,833][177170] Sum rewards: 6.812, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.490', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.030', 'AMMO4': '0.044', 'weapon5': '0.082', 'weapon7': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.558', 'HITCOUNT': '0.600', 'WEAPON3': '0.700', 'weapon2': '0.792', 'weapon3': '1.354', 'DAMAGECOUNT': '2.235', 'FRAGCOUNT': '7.000'} [2023-02-24 18:03:33,101][177158] DAMAGECOUNT value on done: 44320.0 [2023-02-24 18:03:33,102][177158] Sum rewards: 4.674, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.860', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON1': '0.040', 'AMMO4': '0.054', 'AMMO3': '0.065', 'weapon7': '0.118', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon2': '0.282', 'WEAPON7': '0.300', 'WEAPON3': '0.450', 'weapon4': '0.882', 'DAMAGECOUNT': '1.311', 'weapon3': '1.400', 'FRAGCOUNT': '4.000'} [2023-02-24 18:03:33,131][177170] DAMAGECOUNT value on done: 49419.0 [2023-02-24 18:03:33,132][177170] Sum rewards: 0.629, reward structure: {'DEATHCOUNT': '-9.000', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.040', 'WEAPON1': '0.070', 'AMMO3': '0.081', 'weapon5': '0.166', 'HITCOUNT': '0.180', 'AMMO4': '0.197', 'HEALTH': '0.224', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.550', 'DAMAGECOUNT': '0.906', 'weapon2': '1.306', 'weapon3': '1.630', 'FRAGCOUNT': '3.000'} [2023-02-24 18:03:33,404][177158] DAMAGECOUNT value on done: 46187.0 [2023-02-24 18:03:33,404][177158] Sum rewards: 9.012, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO3': '0.102', 'HEALTH': '0.106', 'weapon5': '0.134', 'WEAPON5': '0.200', 'WEAPON3': '0.600', 'HITCOUNT': '0.700', 'weapon3': '1.718', 'weapon2': '1.948', 'DAMAGECOUNT': '2.475', 'FRAGCOUNT': '7.000'} [2023-02-24 18:03:34,221][177158] DAMAGECOUNT value on done: 42657.0 [2023-02-24 18:03:34,222][177158] Sum rewards: -1.442, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.622', 'AMMO2': '0.022', 'AMMO5': '0.024', 'ARMOR': '0.036', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.109', 'WEAPON1': '0.110', 'AMMO3': '0.133', 'weapon5': '0.208', 'WEAPON4': '0.250', 'HITCOUNT': '0.300', 'weapon4': '0.496', 'WEAPON5': '0.550', 'DAMAGECOUNT': '0.840', 'WEAPON3': '0.900', 'weapon2': '0.994', 'weapon3': '1.844', 'FRAGCOUNT': '2.000'} [2023-02-24 18:03:34,365][177172] DAMAGECOUNT value on done: 46611.0 [2023-02-24 18:03:34,365][177172] Sum rewards: 9.200, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.338', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'ARMOR': '0.040', 'AMMO4': '0.055', 'weapon5': '0.082', 'weapon7': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.310', 'weapon4': '0.756', 'weapon3': '0.948', 'weapon2': '1.130', 'DAMAGECOUNT': '1.767', 'FRAGCOUNT': '6.000'} [2023-02-24 18:03:34,530][177158] DAMAGECOUNT value on done: 48099.0 [2023-02-24 18:03:34,530][177158] Sum rewards: 5.278, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.744', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'weapon7': '0.054', 'AMMO4': '0.065', 'weapon5': '0.098', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.490', 'weapon4': '0.586', 'WEAPON3': '0.800', 'weapon2': '1.114', 'weapon3': '1.648', 'DAMAGECOUNT': '2.400', 'FRAGCOUNT': '5.000'} [2023-02-24 18:03:34,660][177172] DAMAGECOUNT value on done: 43906.0 [2023-02-24 18:03:34,660][177172] Sum rewards: 5.373, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.378', 'AMMO5': '0.010', 'AMMO2': '0.026', 'WEAPON1': '0.050', 'AMMO3': '0.125', 'AMMO4': '0.127', 'weapon5': '0.172', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.510', 'weapon4': '0.552', 'WEAPON3': '0.800', 'weapon2': '1.010', 'weapon3': '1.828', 'DAMAGECOUNT': '2.391', 'FRAGCOUNT': '7.000'} [2023-02-24 18:03:35,266][177154] DAMAGECOUNT value on done: 47714.0 [2023-02-24 18:03:35,266][177154] Sum rewards: 2.192, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.410', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.014', 'AMMO3': '0.066', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.224', 'HITCOUNT': '0.390', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'weapon3': '1.374', 'DAMAGECOUNT': '1.467', 'FRAGCOUNT': '2.000', 'weapon2': '2.222'} [2023-02-24 18:03:35,540][177172] DAMAGECOUNT value on done: 44409.0 [2023-02-24 18:03:35,540][177172] Sum rewards: -1.227, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.722', 'AMMO5': '0.012', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'weapon5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.146', 'WEAPON5': '0.250', 'HITCOUNT': '0.280', 'WEAPON4': '0.350', 'weapon2': '0.630', 'weapon4': '0.804', 'WEAPON3': '0.850', 'weapon3': '1.618', 'DAMAGECOUNT': '1.782', 'FRAGCOUNT': '3.000'} [2023-02-24 18:03:35,557][177154] DAMAGECOUNT value on done: 45792.0 [2023-02-24 18:03:35,557][177154] Sum rewards: 5.982, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.797', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'weapon7': '0.050', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.500', 'WEAPON3': '0.650', 'weapon4': '0.710', 'weapon2': '1.190', 'weapon3': '1.352', 'DAMAGECOUNT': '1.995', 'FRAGCOUNT': '6.000'} [2023-02-24 18:03:35,740][177153] Updated weights for policy 0, policy_version 8330 (0.0008) [2023-02-24 18:03:35,806][177154] DAMAGECOUNT value on done: 47220.0 [2023-02-24 18:03:35,806][177154] Sum rewards: 4.375, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.135', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO3': '0.052', 'HITCOUNT': '0.300', 'WEAPON3': '0.350', 'DAMAGECOUNT': '1.110', 'weapon3': '1.166', 'FRAGCOUNT': '2.000', 'weapon2': '2.530'} [2023-02-24 18:03:35,839][177172] DAMAGECOUNT value on done: 44478.0 [2023-02-24 18:03:35,839][177172] Sum rewards: 4.901, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.722', 'AMMO5': '0.018', 'AMMO2': '0.022', 'WEAPON1': '0.090', 'AMMO4': '0.112', 'AMMO3': '0.127', 'weapon5': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.450', 'HITCOUNT': '0.630', 'weapon4': '0.636', 'weapon2': '0.834', 'WEAPON3': '0.850', 'weapon3': '1.992', 'DAMAGECOUNT': '2.487', 'FRAGCOUNT': '7.000'} [2023-02-24 18:03:36,102][177154] DAMAGECOUNT value on done: 46018.0 [2023-02-24 18:03:36,376][177119] Fps is (10 sec: 13926.2, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 34127872. Throughput: 0: 3474.7. Samples: 8525816. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:03:36,376][177119] Avg episode reward: [(0, '4.477')] [2023-02-24 18:03:36,380][177140] Saving new best policy, reward=4.477! [2023-02-24 18:03:36,484][177157] DAMAGECOUNT value on done: 47651.0 [2023-02-24 18:03:36,485][177157] Sum rewards: 5.270, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.850', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'weapon7': '0.054', 'AMMO3': '0.057', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.320', 'WEAPON3': '0.350', 'weapon4': '0.754', 'weapon3': '1.066', 'DAMAGECOUNT': '1.206', 'weapon2': '1.606', 'FRAGCOUNT': '5.000'} [2023-02-24 18:03:36,522][177157] DAMAGECOUNT value on done: 48937.0 [2023-02-24 18:03:36,523][177157] Sum rewards: 2.748, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.706', 'AMMO5': '0.016', 'AMMO2': '0.031', 'WEAPON1': '0.070', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'AMMO4': '0.152', 'HITCOUNT': '0.210', 'weapon5': '0.240', 'weapon4': '0.336', 'WEAPON5': '0.450', 'ARMOR': '0.466', 'WEAPON3': '0.550', 'weapon3': '1.058', 'DAMAGECOUNT': '1.356', 'weapon2': '2.092', 'FRAGCOUNT': '4.000'} [2023-02-24 18:03:36,526][177171] DAMAGECOUNT value on done: 45216.0 [2023-02-24 18:03:36,527][177171] Sum rewards: -1.055, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.560', 'AMMO5': '0.012', 'weapon5': '0.020', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'AMMO3': '0.086', 'weapon7': '0.096', 'HITCOUNT': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON4': '0.500', 'DAMAGECOUNT': '0.597', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon4': '1.126', 'weapon3': '1.190', 'weapon2': '1.218'} [2023-02-24 18:03:36,789][177157] DAMAGECOUNT value on done: 46015.0 [2023-02-24 18:03:36,789][177157] Sum rewards: 5.841, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.582', 'AMMO5': '0.017', 'AMMO2': '0.023', 'WEAPON1': '0.050', 'weapon7': '0.074', 'AMMO3': '0.085', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'weapon4': '0.182', 'weapon5': '0.228', 'WEAPON5': '0.400', 'HITCOUNT': '0.460', 'WEAPON3': '0.600', 'weapon2': '1.244', 'weapon3': '1.872', 'DAMAGECOUNT': '2.622', 'FRAGCOUNT': '5.500'} [2023-02-24 18:03:36,824][177157] DAMAGECOUNT value on done: 43371.0 [2023-02-24 18:03:36,824][177157] Sum rewards: 5.262, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.456', 'AMMO2': '0.010', 'AMMO5': '0.020', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'WEAPON1': '0.100', 'AMMO3': '0.145', 'weapon4': '0.198', 'HITCOUNT': '0.380', 'ARMOR': '0.400', 'weapon5': '0.410', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'weapon2': '0.992', 'weapon3': '1.828', 'DAMAGECOUNT': '2.736', 'FRAGCOUNT': '7.000'} [2023-02-24 18:03:36,826][177171] DAMAGECOUNT value on done: 43711.0 [2023-02-24 18:03:36,827][177171] Sum rewards: -1.621, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.120', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon4': '0.028', 'WEAPON1': '0.060', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'weapon5': '0.110', 'AMMO3': '0.115', 'HITCOUNT': '0.220', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.639', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.446', 'weapon3': '2.078'} [2023-02-24 18:03:37,114][177171] DAMAGECOUNT value on done: 44945.0 [2023-02-24 18:03:37,114][177171] Sum rewards: 3.392, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.356', 'ARMOR': '0.004', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'weapon5': '0.040', 'weapon7': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.132', 'weapon4': '0.218', 'WEAPON5': '0.250', 'HITCOUNT': '0.450', 'WEAPON3': '0.750', 'weapon3': '1.716', 'weapon2': '1.824', 'DAMAGECOUNT': '1.860', 'FRAGCOUNT': '5.000'} [2023-02-24 18:03:37,119][177155] DAMAGECOUNT value on done: 46920.0 [2023-02-24 18:03:37,409][177171] DAMAGECOUNT value on done: 45892.0 [2023-02-24 18:03:37,409][177171] Sum rewards: 11.523, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.131', 'AMMO5': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.076', 'AMMO4': '0.108', 'WEAPON1': '0.130', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.268', 'weapon5': '0.316', 'WEAPON3': '0.500', 'WEAPON5': '0.550', 'HITCOUNT': '0.580', 'weapon2': '1.178', 'weapon3': '1.756', 'DAMAGECOUNT': '2.850', 'FRAGCOUNT': '11.000'} [2023-02-24 18:03:37,414][177155] DAMAGECOUNT value on done: 47304.0 [2023-02-24 18:03:37,414][177155] Sum rewards: 1.034, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.595', 'AMMO5': '0.013', 'AMMO2': '0.029', 'WEAPON1': '0.060', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.109', 'HITCOUNT': '0.120', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'weapon5': '0.234', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.417', 'ARMOR': '0.504', 'WEAPON3': '0.650', 'weapon2': '0.728', 'weapon4': '0.806', 'weapon3': '1.762', 'FRAGCOUNT': '2.000'} [2023-02-24 18:03:37,667][177155] DAMAGECOUNT value on done: 49327.0 [2023-02-24 18:03:37,668][177155] Sum rewards: 4.676, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'AMMO3': '0.063', 'AMMO4': '0.079', 'WEAPON5': '0.150', 'weapon5': '0.160', 'WEAPON3': '0.350', 'HITCOUNT': '0.380', 'HEALTH': '0.838', 'FRAGCOUNT': '1.000', 'weapon3': '1.556', 'DAMAGECOUNT': '1.800', 'weapon2': '1.996'} [2023-02-24 18:03:37,966][177155] DAMAGECOUNT value on done: 45394.0 [2023-02-24 18:03:37,966][177155] Sum rewards: 2.272, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.816', 'AMMO2': '0.002', 'AMMO4': '0.011', 'ARMOR': '0.012', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon5': '0.084', 'AMMO3': '0.114', 'weapon4': '0.262', 'HITCOUNT': '0.270', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'weapon3': '1.188', 'DAMAGECOUNT': '1.425', 'weapon2': '2.312', 'FRAGCOUNT': '3.000'} [2023-02-24 18:03:38,655][177153] Updated weights for policy 0, policy_version 8340 (0.0008) [2023-02-24 18:03:41,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 34197504. Throughput: 0: 3477.4. Samples: 8546914. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:03:41,376][177119] Avg episode reward: [(0, '4.451')] [2023-02-24 18:03:41,569][177153] Updated weights for policy 0, policy_version 8350 (0.0008) [2023-02-24 18:03:42,243][177156] DAMAGECOUNT value on done: 48062.0 [2023-02-24 18:03:42,244][177156] Sum rewards: 4.362, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.048', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO3': '0.030', 'WEAPON1': '0.040', 'AMMO2': '0.048', 'weapon5': '0.144', 'weapon7': '0.144', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'AMMO4': '0.239', 'WEAPON3': '0.250', 'DAMAGECOUNT': '0.642', 'weapon4': '0.794', 'weapon3': '0.832', 'weapon2': '1.846', 'FRAGCOUNT': '2.000'} [2023-02-24 18:03:42,405][177156] DAMAGECOUNT value on done: 46087.0 [2023-02-24 18:03:42,406][177156] Sum rewards: 2.566, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.760', 'AMMO5': '0.005', 'AMMO2': '0.029', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.065', 'weapon7': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.128', 'AMMO4': '0.143', 'HITCOUNT': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.450', 'weapon4': '0.452', 'weapon3': '0.914', 'weapon2': '0.968', 'DAMAGECOUNT': '1.086', 'FRAGCOUNT': '2.000'} [2023-02-24 18:03:42,544][177156] DAMAGECOUNT value on done: 48966.0 [2023-02-24 18:03:42,545][177156] Sum rewards: -0.349, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.088', 'AMMO2': '0.015', 'AMMO5': '0.021', 'WEAPON1': '0.070', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'weapon5': '0.144', 'weapon4': '0.204', 'HITCOUNT': '0.380', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'weapon2': '1.170', 'DAMAGECOUNT': '1.281', 'FRAGCOUNT': '2.000', 'weapon3': '2.090'} [2023-02-24 18:03:42,710][177156] DAMAGECOUNT value on done: 47451.0 [2023-02-24 18:03:42,711][177156] Sum rewards: 7.484, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.161', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'weapon5': '0.070', 'AMMO3': '0.071', 'weapon7': '0.192', 'AMMO6': '0.360', 'AMMO7': '0.360', 'WEAPON4': '0.400', 'HITCOUNT': '0.450', 'WEAPON3': '0.500', 'WEAPON7': '0.600', 'weapon2': '1.050', 'weapon4': '1.106', 'weapon3': '1.238', 'DAMAGECOUNT': '1.587', 'FRAGCOUNT': '5.000'} [2023-02-24 18:03:44,490][177153] Updated weights for policy 0, policy_version 8360 (0.0008) [2023-02-24 18:03:46,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 34267136. Throughput: 0: 3481.6. Samples: 8567972. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:03:46,376][177119] Avg episode reward: [(0, '4.639')] [2023-02-24 18:03:46,379][177140] Saving new best policy, reward=4.639! [2023-02-24 18:03:47,422][177153] Updated weights for policy 0, policy_version 8370 (0.0008) [2023-02-24 18:03:50,335][177153] Updated weights for policy 0, policy_version 8380 (0.0008) [2023-02-24 18:03:51,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 34336768. Throughput: 0: 3481.4. Samples: 8578468. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 18:03:51,376][177119] Avg episode reward: [(0, '4.639')] [2023-02-24 18:03:51,483][177170] DAMAGECOUNT value on done: 47931.0 [2023-02-24 18:03:51,784][177170] DAMAGECOUNT value on done: 51097.0 [2023-02-24 18:03:51,785][177170] Sum rewards: 1.343, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.839', 'AMMO5': '0.016', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.101', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'weapon5': '0.218', 'weapon4': '0.390', 'WEAPON5': '0.400', 'HITCOUNT': '0.450', 'WEAPON3': '0.600', 'weapon2': '1.162', 'DAMAGECOUNT': '1.500', 'weapon3': '1.624', 'FRAGCOUNT': '4.000'} [2023-02-24 18:03:51,896][177170] DAMAGECOUNT value on done: 42004.0 [2023-02-24 18:03:51,896][177170] Sum rewards: 3.763, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.048', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.030', 'weapon7': '0.060', 'AMMO3': '0.096', 'WEAPON1': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.151', 'weapon4': '0.164', 'weapon5': '0.198', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.340', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'weapon3': '1.406', 'weapon2': '1.716', 'DAMAGECOUNT': '1.986', 'FRAGCOUNT': '5.000'} [2023-02-24 18:03:52,191][177170] DAMAGECOUNT value on done: 49991.0 [2023-02-24 18:03:52,191][177170] Sum rewards: 2.207, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.717', 'AMMO5': '0.024', 'AMMO2': '0.049', 'WEAPON1': '0.090', 'AMMO3': '0.093', 'AMMO4': '0.245', 'WEAPON4': '0.250', 'HITCOUNT': '0.250', 'weapon5': '0.330', 'weapon4': '0.634', 'WEAPON5': '0.650', 'WEAPON3': '0.650', 'weapon2': '1.168', 'weapon3': '1.274', 'DAMAGECOUNT': '1.716', 'FRAGCOUNT': '4.000'} [2023-02-24 18:03:52,216][177158] DAMAGECOUNT value on done: 44535.0 [2023-02-24 18:03:52,216][177158] Sum rewards: -1.709, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.100', 'AMMO5': '0.022', 'ARMOR': '0.032', 'AMMO2': '0.038', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.136', 'AMMO3': '0.147', 'HITCOUNT': '0.160', 'AMMO4': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.500', 'weapon2': '0.620', 'weapon4': '0.642', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.810'} [2023-02-24 18:03:52,512][177158] DAMAGECOUNT value on done: 46612.0 [2023-02-24 18:03:52,513][177158] Sum rewards: 1.522, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.694', 'AMMO5': '0.011', 'AMMO2': '0.016', 'weapon5': '0.040', 'weapon7': '0.046', 'WEAPON1': '0.050', 'AMMO4': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.382', 'HITCOUNT': '0.390', 'ARMOR': '0.508', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.275', 'weapon2': '1.438', 'weapon3': '1.748', 'FRAGCOUNT': '3.000'} [2023-02-24 18:03:53,251][177153] Updated weights for policy 0, policy_version 8390 (0.0008) [2023-02-24 18:03:53,344][177158] DAMAGECOUNT value on done: 43784.0 [2023-02-24 18:03:53,345][177158] Sum rewards: 4.545, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.871', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.027', 'WEAPON1': '0.040', 'AMMO3': '0.093', 'weapon7': '0.096', 'weapon5': '0.100', 'AMMO4': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO6': '0.420', 'AMMO7': '0.420', 'HITCOUNT': '0.420', 'WEAPON7': '0.500', 'weapon4': '0.554', 'WEAPON3': '0.650', 'weapon2': '1.156', 'weapon3': '1.710', 'DAMAGECOUNT': '2.181', 'FRAGCOUNT': '4.000'} [2023-02-24 18:03:53,599][177172] DAMAGECOUNT value on done: 47056.0 [2023-02-24 18:03:53,599][177172] Sum rewards: 0.414, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.939', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon7': '0.068', 'WEAPON1': '0.100', 'AMMO3': '0.105', 'WEAPON4': '0.150', 'weapon4': '0.170', 'AMMO6': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.264', 'HITCOUNT': '0.330', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'weapon2': '1.268', 'DAMAGECOUNT': '1.335', 'weapon3': '1.756', 'FRAGCOUNT': '2.000'} [2023-02-24 18:03:53,644][177158] DAMAGECOUNT value on done: 48417.0 [2023-02-24 18:03:53,644][177158] Sum rewards: 2.049, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.850', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon7': '0.052', 'WEAPON1': '0.060', 'AMMO3': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.130', 'AMMO4': '0.147', 'weapon5': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'weapon4': '0.688', 'DAMAGECOUNT': '0.954', 'weapon2': '0.960', 'weapon3': '1.458', 'FRAGCOUNT': '2.000'} [2023-02-24 18:03:53,898][177172] DAMAGECOUNT value on done: 44581.0 [2023-02-24 18:03:53,899][177172] Sum rewards: 0.087, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.486', 'ARMOR': '0.004', 'AMMO5': '0.022', 'weapon7': '0.064', 'AMMO2': '0.065', 'WEAPON1': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.151', 'weapon5': '0.218', 'AMMO4': '0.327', 'WEAPON4': '0.400', 'HITCOUNT': '0.460', 'WEAPON5': '0.550', 'weapon4': '0.752', 'WEAPON3': '0.900', 'weapon2': '0.904', 'weapon3': '1.590', 'DAMAGECOUNT': '2.025', 'FRAGCOUNT': '4.000'} [2023-02-24 18:03:54,435][177154] DAMAGECOUNT value on done: 48392.0 [2023-02-24 18:03:54,435][177154] Sum rewards: 3.015, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.475', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'AMMO3': '0.102', 'AMMO4': '0.113', 'weapon5': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'HITCOUNT': '0.510', 'weapon2': '0.532', 'WEAPON3': '0.650', 'weapon4': '1.034', 'weapon3': '1.830', 'DAMAGECOUNT': '2.034', 'FRAGCOUNT': '5.000'} [2023-02-24 18:03:54,729][177154] DAMAGECOUNT value on done: 46869.0 [2023-02-24 18:03:54,729][177154] Sum rewards: 5.607, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.107', 'AMMO5': '0.015', 'ARMOR': '0.020', 'AMMO2': '0.044', 'WEAPON1': '0.070', 'weapon7': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.129', 'WEAPON7': '0.200', 'AMMO4': '0.222', 'weapon5': '0.268', 'weapon4': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'HITCOUNT': '0.670', 'WEAPON3': '0.950', 'weapon2': '1.042', 'weapon3': '1.800', 'DAMAGECOUNT': '3.231', 'FRAGCOUNT': '6.000'} [2023-02-24 18:03:54,765][177172] DAMAGECOUNT value on done: 45372.0 [2023-02-24 18:03:54,765][177172] Sum rewards: 5.228, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.472', 'AMMO5': '0.017', 'AMMO2': '0.030', 'WEAPON1': '0.060', 'AMMO3': '0.100', 'AMMO4': '0.147', 'weapon5': '0.168', 'WEAPON4': '0.200', 'weapon4': '0.314', 'WEAPON5': '0.400', 'HITCOUNT': '0.640', 'WEAPON3': '0.700', 'weapon2': '1.216', 'weapon3': '1.818', 'DAMAGECOUNT': '2.889', 'FRAGCOUNT': '7.000'} [2023-02-24 18:03:54,964][177154] DAMAGECOUNT value on done: 47864.0 [2023-02-24 18:03:54,964][177154] Sum rewards: 3.922, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.227', 'ARMOR': '0.016', 'AMMO5': '0.019', 'weapon7': '0.030', 'AMMO2': '0.043', 'WEAPON1': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.214', 'weapon5': '0.246', 'WEAPON4': '0.300', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'HITCOUNT': '0.370', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.560', 'weapon2': '1.360', 'weapon3': '1.388', 'DAMAGECOUNT': '1.932', 'FRAGCOUNT': '5.000'} [2023-02-24 18:03:55,061][177172] DAMAGECOUNT value on done: 45635.0 [2023-02-24 18:03:55,062][177172] Sum rewards: 9.469, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.196', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.073', 'AMMO3': '0.080', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.284', 'weapon5': '0.352', 'WEAPON5': '0.400', 'HITCOUNT': '0.430', 'WEAPON3': '0.700', 'weapon2': '1.344', 'weapon3': '1.608', 'DAMAGECOUNT': '3.186', 'FRAGCOUNT': '8.000'} [2023-02-24 18:03:55,262][177154] DAMAGECOUNT value on done: 46735.0 [2023-02-24 18:03:55,263][177154] Sum rewards: 6.908, reward structure: {'DEATHCOUNT': '-6.750', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.031', 'WEAPON1': '0.070', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon4': '0.128', 'AMMO4': '0.154', 'HEALTH': '0.156', 'weapon5': '0.198', 'WEAPON5': '0.300', 'HITCOUNT': '0.330', 'WEAPON3': '0.550', 'weapon3': '1.520', 'weapon2': '1.848', 'DAMAGECOUNT': '2.151', 'FRAGCOUNT': '6.000'} [2023-02-24 18:03:55,608][177157] DAMAGECOUNT value on done: 47988.0 [2023-02-24 18:03:55,608][177157] Sum rewards: 5.281, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.325', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'weapon5': '0.056', 'weapon7': '0.074', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'HITCOUNT': '0.190', 'WEAPON3': '0.250', 'WEAPON4': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'weapon4': '0.666', 'weapon2': '0.678', 'weapon3': '0.766', 'DAMAGECOUNT': '1.011', 'FRAGCOUNT': '4.000'} [2023-02-24 18:03:55,648][177157] DAMAGECOUNT value on done: 49436.0 [2023-02-24 18:03:55,648][177157] Sum rewards: 3.855, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'AMMO2': '0.026', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'AMMO4': '0.132', 'weapon4': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.208', 'WEAPON3': '0.250', 'HITCOUNT': '0.280', 'HEALTH': '0.488', 'weapon3': '1.042', 'DAMAGECOUNT': '1.497', 'weapon2': '2.276', 'FRAGCOUNT': '3.000'} [2023-02-24 18:03:55,692][177171] DAMAGECOUNT value on done: 45791.0 [2023-02-24 18:03:55,692][177171] Sum rewards: 7.710, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.050', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.093', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'HEALTH': '0.105', 'weapon5': '0.140', 'weapon4': '0.178', 'WEAPON5': '0.250', 'HITCOUNT': '0.440', 'WEAPON3': '0.600', 'weapon2': '1.706', 'DAMAGECOUNT': '1.725', 'weapon3': '1.750', 'FRAGCOUNT': '7.000'} [2023-02-24 18:03:55,919][177157] DAMAGECOUNT value on done: 46135.0 [2023-02-24 18:03:55,920][177157] Sum rewards: -0.217, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.012', 'AMMO2': '0.022', 'ARMOR': '0.024', 'weapon7': '0.048', 'WEAPON1': '0.060', 'AMMO3': '0.076', 'AMMO4': '0.109', 'HITCOUNT': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'HEALTH': '0.176', 'WEAPON7': '0.200', 'weapon5': '0.246', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.450', 'weapon4': '0.666', 'weapon2': '0.918', 'FRAGCOUNT': '1.000', 'weapon3': '1.366'} [2023-02-24 18:03:55,958][177157] DAMAGECOUNT value on done: 43851.0 [2023-02-24 18:03:55,959][177157] Sum rewards: 4.936, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.479', 'AMMO5': '0.012', 'AMMO2': '0.016', 'ARMOR': '0.028', 'WEAPON1': '0.030', 'AMMO4': '0.078', 'weapon7': '0.088', 'AMMO3': '0.102', 'weapon5': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.360', 'weapon4': '0.436', 'WEAPON3': '0.700', 'weapon2': '0.992', 'DAMAGECOUNT': '1.440', 'weapon3': '1.886', 'FRAGCOUNT': '5.000'} [2023-02-24 18:03:55,991][177171] DAMAGECOUNT value on done: 44163.0 [2023-02-24 18:03:55,991][177171] Sum rewards: 1.466, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.650', 'AMMO5': '0.012', 'AMMO2': '0.055', 'weapon7': '0.058', 'WEAPON1': '0.080', 'AMMO3': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.180', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'AMMO4': '0.273', 'WEAPON5': '0.400', 'weapon4': '0.482', 'WEAPON3': '0.600', 'weapon3': '1.296', 'DAMAGECOUNT': '1.356', 'weapon2': '1.530', 'FRAGCOUNT': '4.000'} [2023-02-24 18:03:56,168][177153] Updated weights for policy 0, policy_version 8400 (0.0009) [2023-02-24 18:03:56,245][177155] DAMAGECOUNT value on done: 47562.0 [2023-02-24 18:03:56,246][177155] Sum rewards: 6.122, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.240', 'AMMO5': '0.016', 'AMMO2': '0.036', 'AMMO3': '0.050', 'WEAPON1': '0.080', 'AMMO4': '0.182', 'WEAPON4': '0.200', 'HITCOUNT': '0.260', 'weapon5': '0.338', 'WEAPON3': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.844', 'ARMOR': '0.847', 'weapon2': '0.910', 'weapon3': '1.072', 'DAMAGECOUNT': '1.926', 'FRAGCOUNT': '4.000'} [2023-02-24 18:03:56,266][177171] DAMAGECOUNT value on done: 45473.0 [2023-02-24 18:03:56,266][177171] Sum rewards: 5.573, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.010', 'HEALTH': '0.020', 'WEAPON1': '0.020', 'AMMO3': '0.079', 'weapon7': '0.084', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.162', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.300', 'weapon4': '0.424', 'WEAPON3': '0.450', 'weapon3': '1.418', 'weapon2': '1.482', 'DAMAGECOUNT': '1.584', 'FRAGCOUNT': '4.000'} [2023-02-24 18:03:56,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 34406400. Throughput: 0: 3495.5. Samples: 8599502. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:03:56,376][177119] Avg episode reward: [(0, '4.441')] [2023-02-24 18:03:56,548][177155] DAMAGECOUNT value on done: 48106.0 [2023-02-24 18:03:56,549][177155] Sum rewards: 6.026, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.079', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'weapon5': '0.052', 'AMMO3': '0.076', 'AMMO4': '0.158', 'weapon7': '0.164', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'HITCOUNT': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.412', 'WEAPON3': '0.450', 'weapon2': '1.080', 'weapon3': '1.174', 'weapon4': '1.230', 'DAMAGECOUNT': '2.106', 'FRAGCOUNT': '6.000'} [2023-02-24 18:03:56,565][177171] DAMAGECOUNT value on done: 46261.0 [2023-02-24 18:03:56,566][177171] Sum rewards: 2.769, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.370', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'weapon5': '0.048', 'AMMO3': '0.077', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'weapon7': '0.146', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon2': '0.260', 'WEAPON7': '0.300', 'WEAPON3': '0.500', 'weapon4': '0.912', 'weapon3': '0.950', 'DAMAGECOUNT': '1.107', 'FRAGCOUNT': '3.000'} [2023-02-24 18:03:56,803][177155] DAMAGECOUNT value on done: 49838.0 [2023-02-24 18:03:56,803][177155] Sum rewards: 3.287, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.491', 'AMMO5': '0.015', 'AMMO2': '0.025', 'ARMOR': '0.032', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO3': '0.081', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'weapon5': '0.208', 'HITCOUNT': '0.330', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'weapon4': '0.678', 'weapon3': '1.322', 'weapon2': '1.330', 'DAMAGECOUNT': '1.533', 'FRAGCOUNT': '2.000'} [2023-02-24 18:03:57,095][177155] DAMAGECOUNT value on done: 45721.0 [2023-02-24 18:03:57,096][177155] Sum rewards: 3.066, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.295', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'AMMO3': '0.036', 'weapon7': '0.050', 'AMMO4': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.596', 'weapon3': '0.650', 'weapon4': '0.678', 'DAMAGECOUNT': '0.981', 'FRAGCOUNT': '2.000'} [2023-02-24 18:03:59,025][177153] Updated weights for policy 0, policy_version 8410 (0.0008) [2023-02-24 18:03:59,098][177155] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:04:01,376][177119] Fps is (10 sec: 14336.0, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 34480128. Throughput: 0: 3502.8. Samples: 8620634. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:04:01,376][177119] Avg episode reward: [(0, '4.386')] [2023-02-24 18:04:01,445][177156] DAMAGECOUNT value on done: 49291.0 [2023-02-24 18:04:01,446][177156] Sum rewards: 10.974, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.484', 'ARMOR': '0.016', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.089', 'WEAPON1': '0.090', 'AMMO3': '0.106', 'weapon4': '0.142', 'weapon5': '0.228', 'WEAPON5': '0.450', 'HITCOUNT': '0.650', 'WEAPON3': '0.700', 'weapon2': '0.972', 'weapon3': '2.242', 'DAMAGECOUNT': '3.687', 'FRAGCOUNT': '8.000'} [2023-02-24 18:04:01,609][177156] DAMAGECOUNT value on done: 46816.0 [2023-02-24 18:04:01,609][177156] Sum rewards: 8.280, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.075', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.049', 'weapon7': '0.054', 'AMMO3': '0.078', 'weapon5': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.360', 'WEAPON3': '0.550', 'weapon4': '0.874', 'weapon2': '1.172', 'weapon3': '1.222', 'DAMAGECOUNT': '2.187', 'FRAGCOUNT': '7.000'} [2023-02-24 18:04:01,759][177156] DAMAGECOUNT value on done: 49536.0 [2023-02-24 18:04:01,760][177156] Sum rewards: 0.871, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.002', 'AMMO2': '0.012', 'AMMO5': '0.021', 'AMMO4': '0.059', 'weapon7': '0.074', 'WEAPON1': '0.080', 'AMMO3': '0.152', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon5': '0.196', 'WEAPON7': '0.200', 'HITCOUNT': '0.430', 'WEAPON5': '0.550', 'WEAPON3': '0.950', 'weapon2': '1.516', 'DAMAGECOUNT': '1.710', 'weapon3': '1.852', 'FRAGCOUNT': '6.000'} [2023-02-24 18:04:01,929][177156] DAMAGECOUNT value on done: 48112.0 [2023-02-24 18:04:01,930][177156] Sum rewards: 3.985, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.292', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon7': '0.050', 'AMMO3': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.131', 'weapon5': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.316', 'HITCOUNT': '0.460', 'WEAPON3': '0.500', 'weapon2': '1.492', 'weapon3': '1.770', 'DAMAGECOUNT': '1.983', 'FRAGCOUNT': '4.000'} [2023-02-24 18:04:01,966][177153] Updated weights for policy 0, policy_version 8420 (0.0008) [2023-02-24 18:04:04,884][177153] Updated weights for policy 0, policy_version 8430 (0.0008) [2023-02-24 18:04:06,376][177119] Fps is (10 sec: 14336.0, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 34549760. Throughput: 0: 3503.6. Samples: 8631114. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:04:06,376][177119] Avg episode reward: [(0, '4.492')] [2023-02-24 18:04:07,784][177153] Updated weights for policy 0, policy_version 8440 (0.0008) [2023-02-24 18:04:10,570][177170] DAMAGECOUNT value on done: 48203.0 [2023-02-24 18:04:10,571][177170] Sum rewards: -1.722, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.222', 'AMMO5': '0.012', 'ARMOR': '0.020', 'WEAPON1': '0.030', 'AMMO2': '0.034', 'weapon7': '0.054', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.169', 'HITCOUNT': '0.190', 'WEAPON7': '0.200', 'weapon5': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.480', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.816', 'weapon4': '0.818', 'FRAGCOUNT': '1.000', 'weapon3': '1.222'} [2023-02-24 18:04:10,708][177153] Updated weights for policy 0, policy_version 8450 (0.0008) [2023-02-24 18:04:10,868][177170] DAMAGECOUNT value on done: 51538.0 [2023-02-24 18:04:10,868][177170] Sum rewards: 3.859, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.460', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.039', 'AMMO3': '0.050', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.136', 'WEAPON7': '0.200', 'weapon5': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.360', 'weapon4': '0.408', 'WEAPON3': '0.500', 'weapon2': '0.662', 'DAMAGECOUNT': '1.323', 'weapon3': '1.476', 'FRAGCOUNT': '3.000'} [2023-02-24 18:04:10,961][177170] DAMAGECOUNT value on done: 42492.0 [2023-02-24 18:04:10,961][177170] Sum rewards: 1.234, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.500', 'AMMO5': '0.018', 'AMMO2': '0.036', 'WEAPON1': '0.050', 'weapon7': '0.066', 'AMMO3': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.180', 'weapon5': '0.210', 'HITCOUNT': '0.310', 'weapon4': '0.418', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon3': '1.328', 'DAMAGECOUNT': '1.464', 'weapon2': '1.670', 'FRAGCOUNT': '2.000'} [2023-02-24 18:04:11,260][177170] DAMAGECOUNT value on done: 50643.0 [2023-02-24 18:04:11,260][177170] Sum rewards: 6.242, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.015', 'ARMOR': '0.028', 'AMMO2': '0.029', 'weapon7': '0.046', 'WEAPON1': '0.060', 'AMMO3': '0.061', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.145', 'WEAPON4': '0.250', 'weapon5': '0.260', 'WEAPON5': '0.300', 'HITCOUNT': '0.320', 'WEAPON3': '0.350', 'HEALTH': '0.474', 'weapon4': '0.824', 'weapon2': '0.980', 'weapon3': '1.344', 'DAMAGECOUNT': '1.956', 'FRAGCOUNT': '6.000'} [2023-02-24 18:04:11,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.6, 300 sec: 13968.1). Total num frames: 34619392. Throughput: 0: 3506.3. Samples: 8652216. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:04:11,376][177119] Avg episode reward: [(0, '4.333')] [2023-02-24 18:04:11,400][177158] DAMAGECOUNT value on done: 45319.0 [2023-02-24 18:04:11,400][177158] Sum rewards: 2.062, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.860', 'AMMO5': '0.012', 'AMMO2': '0.023', 'WEAPON1': '0.070', 'AMMO4': '0.115', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'weapon5': '0.236', 'WEAPON5': '0.350', 'HITCOUNT': '0.570', 'weapon2': '0.848', 'WEAPON3': '0.850', 'weapon4': '0.886', 'weapon3': '1.584', 'DAMAGECOUNT': '2.352', 'FRAGCOUNT': '4.000'} [2023-02-24 18:04:11,695][177158] DAMAGECOUNT value on done: 46975.0 [2023-02-24 18:04:11,695][177158] Sum rewards: 0.057, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.910', 'weapon7': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.032', 'WEAPON1': '0.040', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'AMMO4': '0.158', 'HITCOUNT': '0.160', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.256', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon4': '0.792', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.089', 'weapon2': '1.256', 'weapon3': '1.350'} [2023-02-24 18:04:12,524][177158] DAMAGECOUNT value on done: 44153.0 [2023-02-24 18:04:12,524][177158] Sum rewards: 3.502, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.095', 'AMMO2': '0.007', 'AMMO5': '0.009', 'AMMO4': '0.036', 'AMMO3': '0.050', 'WEAPON1': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.120', 'weapon5': '0.142', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.390', 'WEAPON3': '0.400', 'DAMAGECOUNT': '1.107', 'weapon3': '1.214', 'weapon2': '1.432', 'FRAGCOUNT': '3.000'} [2023-02-24 18:04:12,717][177172] DAMAGECOUNT value on done: 47606.0 [2023-02-24 18:04:12,718][177172] Sum rewards: 6.914, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.550', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.014', 'WEAPON1': '0.050', 'AMMO3': '0.066', 'weapon7': '0.080', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.136', 'WEAPON7': '0.200', 'HITCOUNT': '0.340', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'weapon4': '0.476', 'weapon3': '1.388', 'weapon2': '1.412', 'DAMAGECOUNT': '1.650', 'FRAGCOUNT': '5.000'} [2023-02-24 18:04:12,817][177158] DAMAGECOUNT value on done: 48960.0 [2023-02-24 18:04:12,818][177158] Sum rewards: 4.798, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'AMMO3': '0.088', 'AMMO4': '0.104', 'weapon5': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.350', 'WEAPON3': '0.500', 'weapon4': '0.538', 'HEALTH': '0.744', 'weapon3': '1.458', 'weapon2': '1.566', 'DAMAGECOUNT': '1.629', 'FRAGCOUNT': '4.000'} [2023-02-24 18:04:13,011][177172] DAMAGECOUNT value on done: 45152.0 [2023-02-24 18:04:13,012][177172] Sum rewards: 0.621, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.220', 'AMMO5': '0.022', 'AMMO2': '0.032', 'WEAPON1': '0.060', 'weapon5': '0.070', 'weapon7': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'AMMO4': '0.158', 'WEAPON5': '0.400', 'HITCOUNT': '0.540', 'weapon4': '0.608', 'weapon2': '0.704', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.713', 'weapon3': '1.752', 'FRAGCOUNT': '3.000'} [2023-02-24 18:04:13,435][177154] DAMAGECOUNT value on done: 48581.0 [2023-02-24 18:04:13,435][177154] Sum rewards: 1.637, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.781', 'AMMO5': '0.011', 'AMMO2': '0.021', 'ARMOR': '0.024', 'weapon7': '0.056', 'AMMO3': '0.059', 'WEAPON1': '0.060', 'AMMO4': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.140', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.262', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.567', 'weapon2': '0.712', 'weapon4': '0.722', 'FRAGCOUNT': '1.000', 'weapon3': '1.090'} [2023-02-24 18:04:13,604][177153] Updated weights for policy 0, policy_version 8460 (0.0008) [2023-02-24 18:04:13,736][177154] DAMAGECOUNT value on done: 47337.0 [2023-02-24 18:04:13,736][177154] Sum rewards: 7.780, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.823', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.010', 'WEAPON1': '0.010', 'ARMOR': '0.032', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'weapon7': '0.060', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.300', 'weapon4': '0.344', 'WEAPON3': '0.450', 'weapon3': '1.278', 'DAMAGECOUNT': '1.404', 'weapon2': '2.018', 'FRAGCOUNT': '5.000'} [2023-02-24 18:04:13,885][177172] DAMAGECOUNT value on done: 45802.0 [2023-02-24 18:04:13,885][177172] Sum rewards: 2.747, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.229', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO3': '0.097', 'AMMO4': '0.111', 'HITCOUNT': '0.140', 'weapon5': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.376', 'weapon2': '0.582', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.290', 'weapon3': '2.018', 'FRAGCOUNT': '3.000'} [2023-02-24 18:04:14,008][177154] DAMAGECOUNT value on done: 48286.0 [2023-02-24 18:04:14,009][177154] Sum rewards: 0.153, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.860', 'ARMOR': '0.008', 'AMMO2': '0.015', 'AMMO5': '0.017', 'WEAPON1': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.094', 'WEAPON4': '0.150', 'weapon5': '0.168', 'weapon7': '0.216', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HITCOUNT': '0.250', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'weapon2': '0.714', 'weapon4': '0.972', 'FRAGCOUNT': '1.000', 'weapon3': '1.076', 'DAMAGECOUNT': '1.266'} [2023-02-24 18:04:14,177][177172] DAMAGECOUNT value on done: 45923.0 [2023-02-24 18:04:14,177][177172] Sum rewards: 1.434, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.267', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.027', 'AMMO3': '0.040', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.126', 'AMMO4': '0.133', 'HITCOUNT': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '0.300', 'weapon3': '0.706', 'DAMAGECOUNT': '0.864', 'FRAGCOUNT': '1.000', 'weapon4': '1.152', 'weapon2': '1.488'} [2023-02-24 18:04:14,305][177154] DAMAGECOUNT value on done: 46925.0 [2023-02-24 18:04:14,715][177157] DAMAGECOUNT value on done: 48601.0 [2023-02-24 18:04:14,715][177157] Sum rewards: 2.847, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.204', 'ARMOR': '0.005', 'AMMO5': '0.017', 'AMMO2': '0.021', 'weapon4': '0.084', 'AMMO3': '0.097', 'WEAPON1': '0.100', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'weapon5': '0.244', 'HITCOUNT': '0.470', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'weapon2': '1.430', 'weapon3': '1.738', 'DAMAGECOUNT': '1.839', 'FRAGCOUNT': '4.000'} [2023-02-24 18:04:14,760][177157] DAMAGECOUNT value on done: 49897.0 [2023-02-24 18:04:14,760][177157] Sum rewards: 1.628, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.762', 'AMMO2': '0.011', 'AMMO5': '0.019', 'AMMO4': '0.056', 'WEAPON1': '0.070', 'weapon7': '0.082', 'AMMO3': '0.097', 'weapon5': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.290', 'ARMOR': '0.449', 'WEAPON5': '0.450', 'weapon2': '0.576', 'WEAPON3': '0.650', 'weapon4': '0.838', 'weapon3': '1.370', 'DAMAGECOUNT': '1.383', 'FRAGCOUNT': '3.000'} [2023-02-24 18:04:14,832][177171] DAMAGECOUNT value on done: 46521.0 [2023-02-24 18:04:14,833][177171] Sum rewards: 0.355, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.040', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.049', 'WEAPON1': '0.080', 'weapon5': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.138', 'AMMO3': '0.183', 'WEAPON7': '0.200', 'AMMO4': '0.243', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'HITCOUNT': '0.540', 'weapon2': '0.554', 'weapon4': '0.928', 'WEAPON3': '1.100', 'weapon3': '1.822', 'DAMAGECOUNT': '2.190', 'FRAGCOUNT': '6.000'} [2023-02-24 18:04:15,018][177157] DAMAGECOUNT value on done: 46524.0 [2023-02-24 18:04:15,018][177157] Sum rewards: 3.238, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.343', 'AMMO5': '0.010', 'AMMO2': '0.027', 'WEAPON1': '0.040', 'ARMOR': '0.048', 'AMMO3': '0.070', 'weapon7': '0.090', 'AMMO4': '0.136', 'weapon5': '0.154', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.350', 'WEAPON3': '0.450', 'weapon4': '0.706', 'weapon2': '1.024', 'DAMAGECOUNT': '1.167', 'weapon3': '1.568', 'FRAGCOUNT': '4.000'} [2023-02-24 18:04:15,075][177157] DAMAGECOUNT value on done: 44154.0 [2023-02-24 18:04:15,075][177157] Sum rewards: 1.554, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.015', 'AMMO5': '0.012', 'AMMO2': '0.032', 'WEAPON1': '0.060', 'AMMO3': '0.073', 'weapon7': '0.100', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'AMMO4': '0.158', 'weapon5': '0.178', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'weapon2': '0.676', 'weapon4': '0.718', 'DAMAGECOUNT': '0.909', 'weapon3': '1.702', 'FRAGCOUNT': '2.000'} [2023-02-24 18:04:15,127][177171] DAMAGECOUNT value on done: 45011.0 [2023-02-24 18:04:15,128][177171] Sum rewards: 5.357, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.643', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.038', 'WEAPON1': '0.090', 'AMMO3': '0.138', 'AMMO4': '0.190', 'WEAPON4': '0.200', 'weapon5': '0.290', 'weapon4': '0.350', 'WEAPON5': '0.450', 'HITCOUNT': '0.640', 'weapon2': '0.672', 'WEAPON3': '0.850', 'weapon3': '2.270', 'DAMAGECOUNT': '2.544', 'FRAGCOUNT': '7.000'} [2023-02-24 18:04:15,402][177155] DAMAGECOUNT value on done: 48076.0 [2023-02-24 18:04:15,403][177155] Sum rewards: 1.444, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.542', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.024', 'WEAPON1': '0.060', 'weapon5': '0.080', 'AMMO3': '0.108', 'AMMO4': '0.120', 'weapon7': '0.214', 'HITCOUNT': '0.240', 'WEAPON5': '0.300', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON4': '0.350', 'weapon2': '0.488', 'WEAPON7': '0.500', 'WEAPON3': '0.700', 'weapon3': '1.082', 'DAMAGECOUNT': '1.263', 'weapon4': '1.758', 'FRAGCOUNT': '4.000'} [2023-02-24 18:04:15,403][177171] DAMAGECOUNT value on done: 46075.0 [2023-02-24 18:04:15,403][177171] Sum rewards: 8.143, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.775', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.061', 'weapon7': '0.114', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.382', 'HITCOUNT': '0.440', 'WEAPON3': '0.500', 'weapon2': '1.462', 'weapon3': '1.504', 'DAMAGECOUNT': '1.806', 'FRAGCOUNT': '6.000'} [2023-02-24 18:04:15,696][177155] DAMAGECOUNT value on done: 48689.0 [2023-02-24 18:04:15,696][177155] Sum rewards: 4.949, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.755', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.030', 'AMMO2': '0.052', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.150', 'WEAPON3': '0.250', 'AMMO4': '0.261', 'WEAPON5': '0.300', 'ARMOR': '0.412', 'HITCOUNT': '0.420', 'WEAPON4': '0.450', 'weapon3': '0.752', 'weapon4': '1.318', 'weapon2': '1.480', 'DAMAGECOUNT': '1.749', 'FRAGCOUNT': '3.000'} [2023-02-24 18:04:15,702][177171] DAMAGECOUNT value on done: 46693.0 [2023-02-24 18:04:15,702][177171] Sum rewards: 5.371, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.428', 'AMMO2': '0.005', 'AMMO5': '0.017', 'AMMO4': '0.023', 'WEAPON1': '0.090', 'AMMO3': '0.115', 'weapon5': '0.284', 'HITCOUNT': '0.310', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.296', 'weapon3': '1.482', 'weapon2': '1.826', 'FRAGCOUNT': '6.000'} [2023-02-24 18:04:15,931][177155] DAMAGECOUNT value on done: 50314.0 [2023-02-24 18:04:15,932][177155] Sum rewards: 2.537, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.391', 'AMMO5': '0.012', 'AMMO2': '0.023', 'WEAPON1': '0.050', 'AMMO3': '0.112', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'weapon5': '0.210', 'weapon4': '0.220', 'WEAPON5': '0.250', 'HITCOUNT': '0.260', 'WEAPON3': '0.750', 'weapon2': '1.426', 'DAMAGECOUNT': '1.428', 'weapon3': '1.622', 'FRAGCOUNT': '4.000'} [2023-02-24 18:04:16,239][177155] DAMAGECOUNT value on done: 46275.0 [2023-02-24 18:04:16,239][177155] Sum rewards: 3.288, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.200', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'weapon5': '0.058', 'AMMO3': '0.113', 'WEAPON5': '0.200', 'weapon4': '0.244', 'HITCOUNT': '0.460', 'WEAPON3': '0.800', 'weapon2': '1.380', 'DAMAGECOUNT': '1.662', 'weapon3': '1.926', 'FRAGCOUNT': '5.000'} [2023-02-24 18:04:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13954.2). Total num frames: 34689024. Throughput: 0: 3508.2. Samples: 8673244. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:04:16,376][177119] Avg episode reward: [(0, '3.704')] [2023-02-24 18:04:16,535][177153] Updated weights for policy 0, policy_version 8470 (0.0009) [2023-02-24 18:04:19,426][177153] Updated weights for policy 0, policy_version 8480 (0.0009) [2023-02-24 18:04:20,081][177157] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200.0)] [2023-02-24 18:04:20,689][177156] DAMAGECOUNT value on done: 49743.0 [2023-02-24 18:04:20,690][177156] Sum rewards: 1.577, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.612', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.018', 'weapon7': '0.054', 'AMMO4': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.147', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.372', 'HITCOUNT': '0.420', 'WEAPON3': '0.950', 'weapon4': '1.320', 'DAMAGECOUNT': '1.356', 'weapon3': '2.036', 'FRAGCOUNT': '5.000'} [2023-02-24 18:04:20,860][177156] DAMAGECOUNT value on done: 46920.0 [2023-02-24 18:04:20,861][177156] Sum rewards: -1.138, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.010', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'weapon5': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'weapon7': '0.086', 'AMMO3': '0.094', 'HITCOUNT': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.312', 'weapon4': '0.528', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.180', 'weapon2': '2.126'} [2023-02-24 18:04:20,996][177156] DAMAGECOUNT value on done: 50658.0 [2023-02-24 18:04:20,997][177156] Sum rewards: 3.393, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.238', 'AMMO2': '0.014', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.138', 'weapon5': '0.138', 'WEAPON5': '0.400', 'weapon4': '0.468', 'HITCOUNT': '0.590', 'WEAPON3': '0.900', 'weapon2': '0.992', 'weapon3': '1.952', 'DAMAGECOUNT': '3.366', 'FRAGCOUNT': '6.000'} [2023-02-24 18:04:21,163][177156] DAMAGECOUNT value on done: 49244.0 [2023-02-24 18:04:21,164][177156] Sum rewards: 8.196, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.074', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'AMMO4': '0.081', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.146', 'weapon4': '0.202', 'WEAPON5': '0.250', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'weapon3': '1.626', 'weapon2': '1.820', 'DAMAGECOUNT': '3.396', 'FRAGCOUNT': '7.000'} [2023-02-24 18:04:21,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 34758656. Throughput: 0: 3512.6. Samples: 8683882. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 18:04:21,376][177119] Avg episode reward: [(0, '3.637')] [2023-02-24 18:04:22,373][177153] Updated weights for policy 0, policy_version 8490 (0.0008) [2023-02-24 18:04:25,312][177153] Updated weights for policy 0, policy_version 8500 (0.0009) [2023-02-24 18:04:25,955][177155] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:04:26,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.6, 300 sec: 13954.2). Total num frames: 34828288. Throughput: 0: 3508.7. Samples: 8704806. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:04:26,376][177119] Avg episode reward: [(0, '3.637')] [2023-02-24 18:04:28,226][177153] Updated weights for policy 0, policy_version 8510 (0.0008) [2023-02-24 18:04:29,765][177170] DAMAGECOUNT value on done: 48730.0 [2023-02-24 18:04:29,766][177170] Sum rewards: 3.207, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.326', 'AMMO5': '0.020', 'AMMO2': '0.037', 'AMMO3': '0.099', 'WEAPON1': '0.110', 'AMMO4': '0.184', 'weapon5': '0.248', 'HITCOUNT': '0.370', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon2': '1.132', 'DAMAGECOUNT': '1.581', 'weapon3': '2.202', 'FRAGCOUNT': '4.000'} [2023-02-24 18:04:30,073][177170] DAMAGECOUNT value on done: 52363.0 [2023-02-24 18:04:30,073][177170] Sum rewards: 4.107, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.076', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'weapon5': '0.110', 'AMMO4': '0.123', 'WEAPON5': '0.200', 'weapon4': '0.332', 'HITCOUNT': '0.400', 'WEAPON3': '0.600', 'weapon3': '1.548', 'weapon2': '1.628', 'DAMAGECOUNT': '2.475', 'FRAGCOUNT': '4.000'} [2023-02-24 18:04:30,145][177170] DAMAGECOUNT value on done: 42948.0 [2023-02-24 18:04:30,145][177170] Sum rewards: 6.678, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.150', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'AMMO4': '0.066', 'AMMO3': '0.108', 'weapon5': '0.138', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.400', 'ARMOR': '0.521', 'WEAPON3': '0.700', 'weapon2': '0.812', 'weapon4': '0.866', 'DAMAGECOUNT': '1.368', 'weapon3': '1.798', 'FRAGCOUNT': '8.000'} [2023-02-24 18:04:30,442][177170] DAMAGECOUNT value on done: 51298.0 [2023-02-24 18:04:30,442][177170] Sum rewards: 4.700, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.183', 'AMMO2': '0.002', 'AMMO5': '0.010', 'AMMO4': '0.011', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.074', 'AMMO3': '0.080', 'weapon5': '0.124', 'WEAPON5': '0.250', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'weapon2': '1.470', 'DAMAGECOUNT': '1.965', 'weapon3': '2.016', 'FRAGCOUNT': '3.000'} [2023-02-24 18:04:30,546][177158] DAMAGECOUNT value on done: 46127.0 [2023-02-24 18:04:30,547][177158] Sum rewards: 6.691, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.560', 'AMMO5': '0.013', 'AMMO2': '0.013', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'weapon4': '0.200', 'weapon5': '0.302', 'WEAPON5': '0.350', 'HITCOUNT': '0.510', 'WEAPON3': '0.700', 'weapon2': '1.308', 'weapon3': '1.806', 'DAMAGECOUNT': '2.424', 'FRAGCOUNT': '6.000'} [2023-02-24 18:04:30,843][177158] DAMAGECOUNT value on done: 47915.0 [2023-02-24 18:04:30,844][177158] Sum rewards: 3.182, reward structure: {'DEATHCOUNT': '-9.750', 'weapon7': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.031', 'WEAPON1': '0.070', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.134', 'weapon4': '0.134', 'HEALTH': '0.146', 'AMMO4': '0.153', 'weapon5': '0.272', 'WEAPON5': '0.350', 'HITCOUNT': '0.570', 'weapon2': '0.612', 'WEAPON3': '0.750', 'weapon3': '2.464', 'DAMAGECOUNT': '2.820', 'FRAGCOUNT': '4.000'} [2023-02-24 18:04:31,190][177153] Updated weights for policy 0, policy_version 8520 (0.0008) [2023-02-24 18:04:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13954.2). Total num frames: 34897920. Throughput: 0: 3507.0. Samples: 8725786. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:04:31,376][177119] Avg episode reward: [(0, '3.537')] [2023-02-24 18:04:31,648][177158] DAMAGECOUNT value on done: 44600.0 [2023-02-24 18:04:31,649][177158] Sum rewards: 1.523, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.198', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'ARMOR': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.076', 'weapon7': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.131', 'weapon2': '0.164', 'HITCOUNT': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'weapon3': '0.830', 'DAMAGECOUNT': '1.341', 'weapon4': '1.658', 'FRAGCOUNT': '2.000'} [2023-02-24 18:04:31,894][177172] DAMAGECOUNT value on done: 48226.0 [2023-02-24 18:04:31,894][177172] Sum rewards: 6.405, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.486', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO5': '0.015', 'AMMO3': '0.076', 'WEAPON1': '0.080', 'weapon5': '0.294', 'HITCOUNT': '0.330', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'weapon2': '1.474', 'weapon3': '1.744', 'DAMAGECOUNT': '1.860', 'FRAGCOUNT': '7.000'} [2023-02-24 18:04:31,944][177158] DAMAGECOUNT value on done: 49277.0 [2023-02-24 18:04:31,945][177158] Sum rewards: 4.077, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.750', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.037', 'AMMO3': '0.040', 'weapon5': '0.052', 'WEAPON4': '0.100', 'weapon7': '0.140', 'HITCOUNT': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.306', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON3': '0.350', 'WEAPON7': '0.400', 'weapon3': '0.824', 'DAMAGECOUNT': '0.951', 'FRAGCOUNT': '1.000', 'weapon2': '2.654'} [2023-02-24 18:04:32,187][177172] DAMAGECOUNT value on done: 45497.0 [2023-02-24 18:04:32,187][177172] Sum rewards: -0.883, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.160', 'AMMO2': '0.004', 'AMMO5': '0.017', 'AMMO4': '0.022', 'WEAPON1': '0.080', 'AMMO3': '0.128', 'weapon5': '0.188', 'HITCOUNT': '0.230', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.035', 'weapon3': '1.706', 'weapon2': '1.866', 'FRAGCOUNT': '3.000'} [2023-02-24 18:04:32,683][177154] DAMAGECOUNT value on done: 49880.0 [2023-02-24 18:04:32,684][177154] Sum rewards: 10.790, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.550', 'weapon7': '0.006', 'AMMO5': '0.017', 'AMMO2': '0.040', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.200', 'weapon4': '0.248', 'weapon5': '0.262', 'WEAPON5': '0.450', 'HITCOUNT': '0.670', 'WEAPON3': '0.900', 'weapon2': '1.006', 'weapon3': '2.004', 'DAMAGECOUNT': '3.876', 'FRAGCOUNT': '10.000'} [2023-02-24 18:04:32,986][177154] DAMAGECOUNT value on done: 47980.0 [2023-02-24 18:04:32,986][177154] Sum rewards: 5.590, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.158', 'AMMO2': '0.007', 'AMMO5': '0.013', 'ARMOR': '0.028', 'AMMO4': '0.034', 'WEAPON1': '0.070', 'AMMO3': '0.075', 'weapon5': '0.252', 'WEAPON5': '0.350', 'HITCOUNT': '0.360', 'WEAPON3': '0.550', 'weapon3': '1.386', 'DAMAGECOUNT': '1.929', 'weapon2': '1.944', 'FRAGCOUNT': '4.000'} [2023-02-24 18:04:33,090][177172] DAMAGECOUNT value on done: 46424.0 [2023-02-24 18:04:33,091][177172] Sum rewards: 0.468, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.136', 'ARMOR': '0.012', 'AMMO5': '0.026', 'AMMO2': '0.058', 'WEAPON1': '0.130', 'AMMO3': '0.159', 'weapon5': '0.272', 'AMMO4': '0.290', 'HITCOUNT': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.406', 'WEAPON5': '0.650', 'weapon2': '0.946', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.866', 'weapon3': '1.938', 'FRAGCOUNT': '4.000'} [2023-02-24 18:04:33,254][177154] DAMAGECOUNT value on done: 49126.0 [2023-02-24 18:04:33,255][177154] Sum rewards: 7.827, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.325', 'AMMO2': '0.006', 'AMMO5': '0.022', 'AMMO4': '0.030', 'weapon4': '0.072', 'AMMO3': '0.093', 'WEAPON1': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.188', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.590', 'weapon2': '1.584', 'weapon3': '1.796', 'DAMAGECOUNT': '2.520', 'FRAGCOUNT': '9.000'} [2023-02-24 18:04:33,385][177172] DAMAGECOUNT value on done: 46802.0 [2023-02-24 18:04:33,385][177172] Sum rewards: 4.662, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.450', 'AMMO2': '0.017', 'AMMO5': '0.025', 'WEAPON1': '0.060', 'AMMO4': '0.085', 'AMMO3': '0.126', 'weapon5': '0.282', 'HITCOUNT': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon2': '1.618', 'weapon3': '1.712', 'DAMAGECOUNT': '2.637', 'FRAGCOUNT': '5.000'} [2023-02-24 18:04:33,558][177154] DAMAGECOUNT value on done: 47341.0 [2023-02-24 18:04:33,559][177154] Sum rewards: 3.174, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.086', 'weapon4': '0.156', 'weapon5': '0.170', 'WEAPON5': '0.200', 'HITCOUNT': '0.350', 'WEAPON3': '0.500', 'HEALTH': '0.854', 'DAMAGECOUNT': '1.248', 'weapon3': '1.634', 'weapon2': '1.806', 'FRAGCOUNT': '2.000'} [2023-02-24 18:04:33,913][177157] DAMAGECOUNT value on done: 49723.0 [2023-02-24 18:04:33,914][177157] Sum rewards: 8.089, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.790', 'AMMO5': '0.017', 'AMMO2': '0.019', 'WEAPON1': '0.090', 'AMMO4': '0.093', 'AMMO3': '0.097', 'weapon7': '0.114', 'WEAPON4': '0.200', 'weapon5': '0.220', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON5': '0.500', 'weapon2': '0.572', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'weapon4': '0.916', 'weapon3': '1.684', 'DAMAGECOUNT': '3.366', 'FRAGCOUNT': '7.000'} [2023-02-24 18:04:33,945][177157] DAMAGECOUNT value on done: 50442.0 [2023-02-24 18:04:33,945][177157] Sum rewards: 4.941, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.540', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'WEAPON4': '0.050', 'weapon7': '0.064', 'AMMO4': '0.070', 'AMMO3': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.110', 'weapon4': '0.304', 'HITCOUNT': '0.310', 'WEAPON3': '0.600', 'weapon2': '1.624', 'DAMAGECOUNT': '1.635', 'weapon3': '1.656', 'FRAGCOUNT': '6.000'} [2023-02-24 18:04:34,030][177171] DAMAGECOUNT value on done: 47031.0 [2023-02-24 18:04:34,031][177171] Sum rewards: 1.697, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.892', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon7': '0.054', 'WEAPON1': '0.060', 'AMMO3': '0.084', 'AMMO4': '0.093', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.174', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'HITCOUNT': '0.410', 'WEAPON3': '0.650', 'weapon2': '0.766', 'weapon4': '0.846', 'DAMAGECOUNT': '1.530', 'weapon3': '1.702', 'FRAGCOUNT': '2.000'} [2023-02-24 18:04:34,158][177153] Updated weights for policy 0, policy_version 8530 (0.0008) [2023-02-24 18:04:34,224][177157] DAMAGECOUNT value on done: 47360.0 [2023-02-24 18:04:34,225][177157] Sum rewards: 4.892, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.376', 'AMMO5': '0.017', 'AMMO2': '0.026', 'ARMOR': '0.028', 'weapon4': '0.068', 'WEAPON1': '0.080', 'weapon7': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.128', 'AMMO4': '0.131', 'weapon5': '0.172', 'HITCOUNT': '0.380', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'weapon2': '1.576', 'weapon3': '1.760', 'DAMAGECOUNT': '2.508', 'FRAGCOUNT': '6.000'} [2023-02-24 18:04:34,256][177157] DAMAGECOUNT value on done: 44723.0 [2023-02-24 18:04:34,257][177157] Sum rewards: 5.486, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'AMMO3': '0.059', 'weapon7': '0.090', 'AMMO4': '0.093', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon5': '0.160', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'HITCOUNT': '0.320', 'HEALTH': '0.348', 'weapon2': '0.744', 'weapon3': '0.886', 'weapon4': '1.172', 'DAMAGECOUNT': '1.707', 'FRAGCOUNT': '4.000'} [2023-02-24 18:04:34,324][177171] DAMAGECOUNT value on done: 45896.0 [2023-02-24 18:04:34,325][177171] Sum rewards: -1.084, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.770', 'AMMO2': '0.006', 'AMMO5': '0.020', 'AMMO4': '0.031', 'WEAPON1': '0.070', 'weapon5': '0.076', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'weapon4': '0.456', 'HITCOUNT': '0.610', 'WEAPON3': '1.100', 'weapon2': '1.254', 'weapon3': '1.634', 'DAMAGECOUNT': '2.655', 'FRAGCOUNT': '5.000'} [2023-02-24 18:04:34,585][177155] DAMAGECOUNT value on done: 48579.0 [2023-02-24 18:04:34,586][177155] Sum rewards: 6.741, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.579', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.120', 'WEAPON5': '0.200', 'WEAPON3': '0.400', 'HITCOUNT': '0.430', 'weapon4': '0.646', 'weapon2': '1.162', 'weapon3': '1.274', 'DAMAGECOUNT': '1.509', 'FRAGCOUNT': '4.000'} [2023-02-24 18:04:34,619][177171] DAMAGECOUNT value on done: 46903.0 [2023-02-24 18:04:34,620][177171] Sum rewards: 5.714, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.870', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO3': '0.051', 'WEAPON1': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.102', 'AMMO4': '0.196', 'WEAPON4': '0.250', 'weapon5': '0.264', 'WEAPON3': '0.400', 'HITCOUNT': '0.410', 'WEAPON5': '0.450', 'weapon4': '0.866', 'weapon2': '1.170', 'weapon3': '1.246', 'DAMAGECOUNT': '2.484', 'FRAGCOUNT': '5.000'} [2023-02-24 18:04:34,886][177155] DAMAGECOUNT value on done: 49522.0 [2023-02-24 18:04:34,887][177155] Sum rewards: 8.247, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.472', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.030', 'AMMO4': '0.049', 'weapon7': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon5': '0.164', 'WEAPON4': '0.200', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.408', 'HITCOUNT': '0.480', 'weapon3': '0.810', 'weapon2': '0.970', 'weapon4': '1.226', 'DAMAGECOUNT': '2.217', 'FRAGCOUNT': '5.000'} [2023-02-24 18:04:34,918][177171] DAMAGECOUNT value on done: 47402.0 [2023-02-24 18:04:34,919][177171] Sum rewards: 3.904, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.848', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.030', 'WEAPON4': '0.050', 'WEAPON1': '0.090', 'AMMO3': '0.096', 'AMMO4': '0.140', 'weapon5': '0.248', 'WEAPON5': '0.400', 'HITCOUNT': '0.520', 'WEAPON3': '0.650', 'weapon3': '1.374', 'weapon2': '1.982', 'DAMAGECOUNT': '2.127', 'FRAGCOUNT': '3.000'} [2023-02-24 18:04:35,139][177155] DAMAGECOUNT value on done: 50981.0 [2023-02-24 18:04:35,139][177155] Sum rewards: 5.766, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.650', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.056', 'weapon5': '0.068', 'AMMO4': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.450', 'weapon4': '0.460', 'HITCOUNT': '0.610', 'weapon2': '0.788', 'weapon3': '1.108', 'DAMAGECOUNT': '2.001', 'FRAGCOUNT': '4.000'} [2023-02-24 18:04:35,439][177155] DAMAGECOUNT value on done: 46800.0 [2023-02-24 18:04:35,439][177155] Sum rewards: 5.285, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.794', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon7': '0.058', 'WEAPON1': '0.060', 'ARMOR': '0.068', 'AMMO3': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'weapon5': '0.192', 'HITCOUNT': '0.370', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'weapon4': '0.848', 'weapon2': '1.000', 'weapon3': '1.454', 'DAMAGECOUNT': '1.575', 'FRAGCOUNT': '4.000'} [2023-02-24 18:04:36,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 13954.2). Total num frames: 34967552. Throughput: 0: 3505.7. Samples: 8736224. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:04:36,376][177119] Avg episode reward: [(0, '3.833')] [2023-02-24 18:04:37,080][177153] Updated weights for policy 0, policy_version 8540 (0.0008) [2023-02-24 18:04:39,937][177156] DAMAGECOUNT value on done: 50527.0 [2023-02-24 18:04:39,938][177156] Sum rewards: 6.584, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'AMMO3': '0.059', 'HEALTH': '0.062', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.158', 'weapon4': '0.246', 'WEAPON3': '0.350', 'HITCOUNT': '0.370', 'weapon3': '0.816', 'DAMAGECOUNT': '2.352', 'weapon2': '2.546', 'FRAGCOUNT': '3.000'} [2023-02-24 18:04:40,016][177153] Updated weights for policy 0, policy_version 8550 (0.0009) [2023-02-24 18:04:40,107][177156] DAMAGECOUNT value on done: 47585.0 [2023-02-24 18:04:40,107][177156] Sum rewards: 6.188, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.656', 'AMMO5': '0.020', 'AMMO2': '0.046', 'ARMOR': '0.046', 'weapon7': '0.046', 'WEAPON1': '0.050', 'AMMO3': '0.063', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO4': '0.230', 'weapon5': '0.270', 'WEAPON3': '0.400', 'HITCOUNT': '0.410', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.652', 'weapon3': '1.192', 'weapon2': '1.534', 'DAMAGECOUNT': '1.995', 'FRAGCOUNT': '6.000'} [2023-02-24 18:04:40,239][177156] DAMAGECOUNT value on done: 51543.0 [2023-02-24 18:04:40,240][177156] Sum rewards: 7.977, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.100', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'weapon5': '0.064', 'AMMO4': '0.124', 'weapon7': '0.178', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.470', 'weapon3': '0.804', 'weapon2': '0.876', 'weapon4': '1.422', 'DAMAGECOUNT': '2.655', 'FRAGCOUNT': '6.000'} [2023-02-24 18:04:40,418][177156] DAMAGECOUNT value on done: 49947.0 [2023-02-24 18:04:40,418][177156] Sum rewards: 3.382, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.162', 'AMMO2': '0.019', 'AMMO5': '0.020', 'WEAPON1': '0.090', 'AMMO4': '0.095', 'AMMO3': '0.115', 'weapon5': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'HITCOUNT': '0.550', 'weapon2': '0.674', 'weapon4': '0.700', 'WEAPON3': '0.750', 'weapon3': '2.016', 'DAMAGECOUNT': '2.109', 'FRAGCOUNT': '4.000'} [2023-02-24 18:04:41,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.6, 300 sec: 13954.2). Total num frames: 35037184. Throughput: 0: 3505.1. Samples: 8757230. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:04:41,376][177119] Avg episode reward: [(0, '3.879')] [2023-02-24 18:04:42,922][177153] Updated weights for policy 0, policy_version 8560 (0.0008) [2023-02-24 18:04:45,849][177153] Updated weights for policy 0, policy_version 8570 (0.0008) [2023-02-24 18:04:46,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 13954.2). Total num frames: 35106816. Throughput: 0: 3502.4. Samples: 8778242. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:04:46,376][177119] Avg episode reward: [(0, '3.879')] [2023-02-24 18:04:48,792][177153] Updated weights for policy 0, policy_version 8580 (0.0008) [2023-02-24 18:04:49,085][177170] DAMAGECOUNT value on done: 49731.0 [2023-02-24 18:04:49,086][177170] Sum rewards: 2.326, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.718', 'AMMO5': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.075', 'weapon5': '0.136', 'AMMO3': '0.140', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.500', 'weapon4': '0.700', 'HITCOUNT': '0.710', 'WEAPON3': '0.900', 'weapon2': '1.128', 'weapon3': '1.534', 'DAMAGECOUNT': '3.003', 'FRAGCOUNT': '5.000'} [2023-02-24 18:04:49,376][177170] DAMAGECOUNT value on done: 52955.0 [2023-02-24 18:04:49,376][177170] Sum rewards: 4.935, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.523', 'AMMO5': '0.011', 'AMMO2': '0.017', 'AMMO3': '0.069', 'WEAPON1': '0.070', 'AMMO4': '0.083', 'weapon5': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.450', 'WEAPON3': '0.550', 'weapon4': '0.754', 'weapon3': '1.042', 'DAMAGECOUNT': '1.776', 'weapon2': '1.794', 'FRAGCOUNT': '5.000'} [2023-02-24 18:04:49,421][177170] DAMAGECOUNT value on done: 43906.0 [2023-02-24 18:04:49,421][177170] Sum rewards: 7.043, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.730', 'AMMO5': '0.015', 'AMMO2': '0.025', 'WEAPON1': '0.060', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.157', 'weapon5': '0.166', 'weapon4': '0.284', 'WEAPON5': '0.400', 'HITCOUNT': '0.740', 'WEAPON3': '1.000', 'weapon2': '1.218', 'weapon3': '2.060', 'DAMAGECOUNT': '2.874', 'FRAGCOUNT': '9.000'} [2023-02-24 18:04:49,669][177158] DAMAGECOUNT value on done: 46726.0 [2023-02-24 18:04:49,669][177158] Sum rewards: 3.607, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.880', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.028', 'WEAPON1': '0.060', 'AMMO3': '0.063', 'AMMO4': '0.138', 'weapon4': '0.170', 'weapon5': '0.182', 'WEAPON4': '0.250', 'HITCOUNT': '0.260', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'weapon3': '1.196', 'DAMAGECOUNT': '1.797', 'weapon2': '1.926', 'FRAGCOUNT': '6.000'} [2023-02-24 18:04:49,724][177170] DAMAGECOUNT value on done: 52135.0 [2023-02-24 18:04:49,725][177170] Sum rewards: 5.562, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.787', 'AMMO5': '0.022', 'AMMO2': '0.035', 'WEAPON1': '0.080', 'AMMO3': '0.095', 'weapon7': '0.114', 'AMMO4': '0.173', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon5': '0.340', 'WEAPON4': '0.400', 'WEAPON7': '0.400', 'weapon2': '0.458', 'WEAPON5': '0.550', 'HITCOUNT': '0.560', 'WEAPON3': '0.600', 'weapon4': '1.072', 'weapon3': '1.458', 'DAMAGECOUNT': '2.511', 'FRAGCOUNT': '6.000'} [2023-02-24 18:04:49,974][177158] DAMAGECOUNT value on done: 48168.0 [2023-02-24 18:04:49,975][177158] Sum rewards: 1.904, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.780', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.013', 'weapon5': '0.024', 'AMMO3': '0.039', 'AMMO4': '0.064', 'weapon7': '0.074', 'WEAPON5': '0.150', 'HITCOUNT': '0.190', 'WEAPON4': '0.250', 'WEAPON3': '0.250', 'weapon2': '0.310', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'weapon3': '0.434', 'DAMAGECOUNT': '0.759', 'weapon4': '0.822', 'FRAGCOUNT': '2.000'} [2023-02-24 18:04:50,842][177158] DAMAGECOUNT value on done: 45373.0 [2023-02-24 18:04:50,842][177158] Sum rewards: 8.094, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.250', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO3': '0.051', 'WEAPON1': '0.060', 'weapon7': '0.066', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.168', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.430', 'WEAPON3': '0.450', 'weapon4': '0.492', 'weapon2': '0.914', 'weapon3': '1.196', 'DAMAGECOUNT': '2.319', 'FRAGCOUNT': '6.000'} [2023-02-24 18:04:51,118][177172] DAMAGECOUNT value on done: 48736.0 [2023-02-24 18:04:51,118][177172] Sum rewards: 0.448, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.852', 'AMMO5': '0.012', 'AMMO2': '0.025', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'AMMO4': '0.127', 'weapon5': '0.134', 'weapon4': '0.186', 'WEAPON5': '0.300', 'HITCOUNT': '0.390', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.530', 'weapon3': '1.626', 'weapon2': '1.786', 'FRAGCOUNT': '2.000'} [2023-02-24 18:04:51,133][177158] DAMAGECOUNT value on done: 49577.0 [2023-02-24 18:04:51,134][177158] Sum rewards: 1.094, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.156', 'weapon7': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.026', 'WEAPON1': '0.040', 'AMMO3': '0.074', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.114', 'AMMO4': '0.131', 'WEAPON4': '0.200', 'weapon4': '0.242', 'HITCOUNT': '0.260', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'weapon3': '0.830', 'DAMAGECOUNT': '0.900', 'FRAGCOUNT': '2.000', 'weapon2': '2.164'} [2023-02-24 18:04:51,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 13954.2). Total num frames: 35176448. Throughput: 0: 3500.7. Samples: 8788644. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:04:51,376][177119] Avg episode reward: [(0, '4.019')] [2023-02-24 18:04:51,421][177172] DAMAGECOUNT value on done: 46211.0 [2023-02-24 18:04:51,421][177172] Sum rewards: 3.831, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.774', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO3': '0.050', 'WEAPON1': '0.050', 'weapon5': '0.054', 'AMMO4': '0.082', 'weapon7': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.412', 'HITCOUNT': '0.500', 'weapon3': '0.608', 'weapon2': '0.684', 'weapon4': '1.566', 'DAMAGECOUNT': '2.142', 'FRAGCOUNT': '3.000'} [2023-02-24 18:04:51,729][177153] Updated weights for policy 0, policy_version 8590 (0.0008) [2023-02-24 18:04:51,938][177154] DAMAGECOUNT value on done: 50540.0 [2023-02-24 18:04:51,938][177154] Sum rewards: 8.094, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.015', 'WEAPON1': '0.030', 'AMMO3': '0.087', 'weapon5': '0.120', 'WEAPON5': '0.150', 'HEALTH': '0.274', 'HITCOUNT': '0.430', 'WEAPON3': '0.550', 'weapon3': '1.676', 'DAMAGECOUNT': '1.980', 'weapon2': '2.024', 'FRAGCOUNT': '6.000'} [2023-02-24 18:04:52,229][177154] DAMAGECOUNT value on done: 48549.0 [2023-02-24 18:04:52,229][177154] Sum rewards: 5.976, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.031', 'AMMO3': '0.050', 'WEAPON1': '0.050', 'weapon7': '0.108', 'AMMO4': '0.152', 'weapon5': '0.184', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'weapon2': '0.380', 'HEALTH': '0.411', 'HITCOUNT': '0.450', 'weapon4': '1.030', 'weapon3': '1.300', 'DAMAGECOUNT': '1.707', 'FRAGCOUNT': '4.000'} [2023-02-24 18:04:52,308][177172] DAMAGECOUNT value on done: 47079.0 [2023-02-24 18:04:52,309][177172] Sum rewards: 5.407, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.310', 'AMMO5': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.060', 'AMMO3': '0.083', 'AMMO4': '0.083', 'weapon4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.250', 'HITCOUNT': '0.260', 'weapon5': '0.330', 'WEAPON3': '0.500', 'weapon3': '1.410', 'weapon2': '1.810', 'DAMAGECOUNT': '1.965', 'FRAGCOUNT': '4.000'} [2023-02-24 18:04:52,453][177154] DAMAGECOUNT value on done: 49421.0 [2023-02-24 18:04:52,453][177154] Sum rewards: -1.712, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.432', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon7': '0.060', 'WEAPON1': '0.080', 'AMMO3': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.235', 'weapon5': '0.238', 'HITCOUNT': '0.240', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.885', 'weapon2': '0.962', 'weapon4': '0.970', 'FRAGCOUNT': '1.000', 'weapon3': '1.336'} [2023-02-24 18:04:52,599][177172] DAMAGECOUNT value on done: 47258.0 [2023-02-24 18:04:52,600][177172] Sum rewards: 3.507, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.493', 'AMMO5': '0.016', 'ARMOR': '0.028', 'AMMO2': '0.034', 'weapon4': '0.040', 'WEAPON1': '0.090', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'AMMO4': '0.170', 'weapon5': '0.206', 'HITCOUNT': '0.380', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.368', 'weapon2': '1.670', 'weapon3': '1.756', 'FRAGCOUNT': '3.000'} [2023-02-24 18:04:52,743][177154] DAMAGECOUNT value on done: 48049.0 [2023-02-24 18:04:52,743][177154] Sum rewards: 5.217, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.813', 'AMMO5': '0.013', 'WEAPON1': '0.030', 'AMMO2': '0.033', 'weapon7': '0.052', 'weapon5': '0.058', 'AMMO3': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.166', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'HITCOUNT': '0.530', 'WEAPON3': '0.600', 'weapon2': '0.844', 'weapon4': '0.876', 'weapon3': '0.968', 'DAMAGECOUNT': '2.124', 'FRAGCOUNT': '6.000'} [2023-02-24 18:04:53,182][177157] DAMAGECOUNT value on done: 50752.0 [2023-02-24 18:04:53,183][177157] Sum rewards: 8.874, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.958', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.025', 'WEAPON1': '0.080', 'AMMO3': '0.131', 'weapon5': '0.244', 'HITCOUNT': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '0.850', 'weapon3': '1.610', 'weapon2': '1.856', 'DAMAGECOUNT': '3.087', 'FRAGCOUNT': '9.000'} [2023-02-24 18:04:53,212][177157] DAMAGECOUNT value on done: 50971.0 [2023-02-24 18:04:53,212][177157] Sum rewards: 5.542, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.956', 'ARMOR': '0.005', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO3': '0.060', 'WEAPON1': '0.090', 'AMMO4': '0.158', 'weapon5': '0.282', 'HITCOUNT': '0.380', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon3': '1.570', 'DAMAGECOUNT': '1.587', 'weapon2': '1.872', 'FRAGCOUNT': '4.000'} [2023-02-24 18:04:53,243][177171] DAMAGECOUNT value on done: 47499.0 [2023-02-24 18:04:53,243][177171] Sum rewards: 3.823, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO2': '0.049', 'weapon7': '0.058', 'AMMO3': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.110', 'WEAPON5': '0.150', 'HEALTH': '0.232', 'AMMO4': '0.246', 'HITCOUNT': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '0.350', 'weapon2': '0.682', 'weapon4': '1.012', 'DAMAGECOUNT': '1.404', 'weapon3': '1.460', 'FRAGCOUNT': '3.000'} [2023-02-24 18:04:53,483][177157] DAMAGECOUNT value on done: 48100.0 [2023-02-24 18:04:53,484][177157] Sum rewards: 3.957, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.998', 'AMMO2': '0.019', 'AMMO5': '0.022', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON1': '0.110', 'AMMO3': '0.117', 'weapon5': '0.292', 'weapon4': '0.392', 'HITCOUNT': '0.540', 'WEAPON5': '0.600', 'WEAPON3': '0.850', 'weapon2': '1.116', 'weapon3': '1.730', 'DAMAGECOUNT': '2.220', 'FRAGCOUNT': '6.000'} [2023-02-24 18:04:53,513][177157] DAMAGECOUNT value on done: 45403.0 [2023-02-24 18:04:53,513][177157] Sum rewards: 0.185, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.979', 'AMMO5': '0.014', 'AMMO2': '0.020', 'WEAPON1': '0.070', 'AMMO4': '0.100', 'AMMO3': '0.113', 'WEAPON4': '0.200', 'weapon5': '0.208', 'weapon4': '0.218', 'WEAPON5': '0.350', 'HITCOUNT': '0.520', 'WEAPON3': '0.700', 'weapon3': '1.340', 'weapon2': '1.770', 'DAMAGECOUNT': '2.040', 'FRAGCOUNT': '2.500'} [2023-02-24 18:04:53,541][177171] DAMAGECOUNT value on done: 46351.0 [2023-02-24 18:04:53,541][177171] Sum rewards: 1.258, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.210', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.032', 'WEAPON1': '0.040', 'AMMO3': '0.099', 'weapon5': '0.136', 'weapon7': '0.154', 'AMMO4': '0.162', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'HITCOUNT': '0.370', 'weapon2': '0.394', 'WEAPON3': '0.600', 'weapon4': '1.068', 'weapon3': '1.228', 'DAMAGECOUNT': '1.365', 'FRAGCOUNT': '3.000'} [2023-02-24 18:04:53,820][177171] DAMAGECOUNT value on done: 47391.0 [2023-02-24 18:04:53,820][177171] Sum rewards: 5.871, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.319', 'AMMO2': '0.007', 'AMMO5': '0.017', 'AMMO4': '0.032', 'AMMO3': '0.057', 'WEAPON1': '0.070', 'weapon7': '0.102', 'WEAPON4': '0.150', 'weapon5': '0.270', 'AMMO6': '0.320', 'AMMO7': '0.320', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.502', 'weapon3': '1.110', 'DAMAGECOUNT': '1.464', 'weapon2': '1.648', 'FRAGCOUNT': '3.000'} [2023-02-24 18:04:53,830][177155] DAMAGECOUNT value on done: 49316.0 [2023-02-24 18:04:53,830][177155] Sum rewards: 8.316, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.074', 'AMMO5': '0.010', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'AMMO3': '0.064', 'weapon7': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.100', 'AMMO4': '0.146', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'weapon4': '0.442', 'HITCOUNT': '0.450', 'weapon3': '0.778', 'DAMAGECOUNT': '2.211', 'weapon2': '2.348', 'FRAGCOUNT': '5.000'} [2023-02-24 18:04:54,109][177171] DAMAGECOUNT value on done: 47847.0 [2023-02-24 18:04:54,110][177171] Sum rewards: 5.799, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.250', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.059', 'AMMO3': '0.064', 'weapon5': '0.110', 'WEAPON5': '0.200', 'HITCOUNT': '0.380', 'WEAPON3': '0.500', 'weapon3': '0.846', 'DAMAGECOUNT': '1.335', 'weapon2': '2.998', 'FRAGCOUNT': '5.000'} [2023-02-24 18:04:54,115][177155] DAMAGECOUNT value on done: 50328.0 [2023-02-24 18:04:54,115][177155] Sum rewards: 7.341, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.010', 'AMMO2': '0.024', 'WEAPON1': '0.050', 'AMMO3': '0.066', 'weapon7': '0.110', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'weapon5': '0.218', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'HEALTH': '0.258', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.420', 'weapon4': '0.698', 'weapon3': '1.192', 'weapon2': '1.470', 'DAMAGECOUNT': '2.418', 'FRAGCOUNT': '4.000'} [2023-02-24 18:04:54,364][177155] DAMAGECOUNT value on done: 51943.0 [2023-02-24 18:04:54,364][177155] Sum rewards: 7.322, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.505', 'ARMOR': '0.012', 'AMMO5': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.087', 'WEAPON1': '0.110', 'AMMO4': '0.132', 'WEAPON4': '0.200', 'weapon5': '0.306', 'weapon4': '0.312', 'HITCOUNT': '0.530', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'weapon2': '1.134', 'weapon3': '1.672', 'DAMAGECOUNT': '2.886', 'FRAGCOUNT': '6.000'} [2023-02-24 18:04:54,604][177153] Updated weights for policy 0, policy_version 8600 (0.0008) [2023-02-24 18:04:54,649][177155] DAMAGECOUNT value on done: 47221.0 [2023-02-24 18:04:54,649][177155] Sum rewards: 2.374, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.749', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO3': '0.024', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'weapon5': '0.064', 'WEAPON3': '0.150', 'weapon7': '0.150', 'HITCOUNT': '0.190', 'weapon3': '0.192', 'weapon2': '0.222', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'WEAPON7': '0.400', 'DAMAGECOUNT': '1.263', 'weapon4': '1.360', 'FRAGCOUNT': '2.000'} [2023-02-24 18:04:56,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14062.9, 300 sec: 13968.1). Total num frames: 35250176. Throughput: 0: 3502.1. Samples: 8809812. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:04:56,376][177119] Avg episode reward: [(0, '4.154')] [2023-02-24 18:04:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000008606_35250176.pth... [2023-02-24 18:04:56,436][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000007788_31899648.pth [2023-02-24 18:04:57,500][177153] Updated weights for policy 0, policy_version 8610 (0.0009) [2023-02-24 18:04:59,076][177156] DAMAGECOUNT value on done: 50979.0 [2023-02-24 18:04:59,076][177156] Sum rewards: -1.229, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.841', 'AMMO2': '0.017', 'AMMO5': '0.024', 'WEAPON1': '0.040', 'AMMO4': '0.084', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'weapon5': '0.212', 'weapon4': '0.304', 'HITCOUNT': '0.350', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.168', 'DAMAGECOUNT': '1.356', 'weapon3': '1.974'} [2023-02-24 18:04:59,254][177156] DAMAGECOUNT value on done: 48418.0 [2023-02-24 18:04:59,254][177156] Sum rewards: 5.792, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.442', 'AMMO5': '0.012', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.101', 'weapon7': '0.120', 'weapon5': '0.236', 'weapon2': '0.256', 'HITCOUNT': '0.330', 'WEAPON5': '0.400', 'weapon4': '0.632', 'WEAPON3': '0.650', 'weapon3': '1.476', 'DAMAGECOUNT': '2.499', 'FRAGCOUNT': '5.000'} [2023-02-24 18:04:59,387][177156] DAMAGECOUNT value on done: 52096.0 [2023-02-24 18:04:59,388][177156] Sum rewards: 6.492, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.465', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.016', 'WEAPON1': '0.060', 'weapon7': '0.062', 'AMMO3': '0.069', 'AMMO4': '0.082', 'weapon5': '0.180', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.340', 'WEAPON3': '0.400', 'weapon4': '0.870', 'weapon3': '1.114', 'weapon2': '1.486', 'DAMAGECOUNT': '1.659', 'FRAGCOUNT': '6.000'} [2023-02-24 18:04:59,559][177156] DAMAGECOUNT value on done: 50631.0 [2023-02-24 18:04:59,560][177156] Sum rewards: 4.200, reward structure: {'DEATHCOUNT': '-6.000', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.016', 'weapon7': '0.048', 'WEAPON1': '0.060', 'AMMO3': '0.071', 'AMMO4': '0.079', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.140', 'WEAPON5': '0.300', 'HITCOUNT': '0.410', 'WEAPON3': '0.450', 'weapon4': '0.562', 'weapon2': '0.598', 'HEALTH': '0.743', 'weapon3': '1.252', 'DAMAGECOUNT': '2.052', 'FRAGCOUNT': '3.000'} [2023-02-24 18:05:00,396][177153] Updated weights for policy 0, policy_version 8620 (0.0009) [2023-02-24 18:05:01,376][177119] Fps is (10 sec: 14336.0, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 35319808. Throughput: 0: 3503.7. Samples: 8830910. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:05:01,376][177119] Avg episode reward: [(0, '4.155')] [2023-02-24 18:05:03,311][177153] Updated weights for policy 0, policy_version 8630 (0.0008) [2023-02-24 18:05:06,208][177153] Updated weights for policy 0, policy_version 8640 (0.0008) [2023-02-24 18:05:06,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 35389440. Throughput: 0: 3502.0. Samples: 8841470. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:05:06,376][177119] Avg episode reward: [(0, '4.155')] [2023-02-24 18:05:08,035][177170] DAMAGECOUNT value on done: 50122.0 [2023-02-24 18:05:08,036][177170] Sum rewards: 3.968, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.204', 'AMMO5': '0.010', 'AMMO2': '0.029', 'WEAPON4': '0.050', 'AMMO3': '0.051', 'WEAPON1': '0.060', 'weapon7': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.132', 'AMMO4': '0.143', 'HITCOUNT': '0.260', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.462', 'weapon4': '0.702', 'weapon2': '0.948', 'DAMAGECOUNT': '1.173', 'weapon3': '1.282', 'FRAGCOUNT': '4.000'} [2023-02-24 18:05:08,334][177170] DAMAGECOUNT value on done: 53244.0 [2023-02-24 18:05:08,335][177170] Sum rewards: 3.173, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-1.060', 'AMMO2': '0.007', 'ARMOR': '0.008', 'AMMO3': '0.020', 'AMMO4': '0.033', 'weapon7': '0.142', 'WEAPON3': '0.200', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'HITCOUNT': '0.270', 'WEAPON7': '0.400', 'weapon3': '0.490', 'weapon4': '0.718', 'DAMAGECOUNT': '0.867', 'FRAGCOUNT': '1.000', 'weapon2': '1.648'} [2023-02-24 18:05:08,355][177170] DAMAGECOUNT value on done: 44758.0 [2023-02-24 18:05:08,355][177170] Sum rewards: 9.466, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.410', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'AMMO3': '0.078', 'WEAPON1': '0.080', 'weapon4': '0.108', 'weapon5': '0.180', 'WEAPON5': '0.400', 'HITCOUNT': '0.420', 'WEAPON3': '0.550', 'weapon3': '1.662', 'weapon2': '1.742', 'DAMAGECOUNT': '2.556', 'FRAGCOUNT': '8.000'} [2023-02-24 18:05:08,654][177170] DAMAGECOUNT value on done: 52955.0 [2023-02-24 18:05:08,655][177170] Sum rewards: 1.502, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.550', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.054', 'HITCOUNT': '0.100', 'weapon5': '0.128', 'weapon7': '0.134', 'AMMO4': '0.145', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'ARMOR': '0.481', 'weapon2': '0.720', 'DAMAGECOUNT': '0.960', 'weapon3': '1.034', 'weapon4': '1.546', 'FRAGCOUNT': '2.000'} [2023-02-24 18:05:08,783][177158] DAMAGECOUNT value on done: 47203.0 [2023-02-24 18:05:08,783][177158] Sum rewards: 2.008, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.484', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon5': '0.070', 'AMMO4': '0.072', 'AMMO3': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.102', 'WEAPON5': '0.150', 'HITCOUNT': '0.440', 'weapon2': '0.488', 'WEAPON3': '0.550', 'weapon4': '0.804', 'DAMAGECOUNT': '1.431', 'weapon3': '1.900', 'FRAGCOUNT': '2.000'} [2023-02-24 18:05:09,086][177158] DAMAGECOUNT value on done: 48732.0 [2023-02-24 18:05:09,087][177158] Sum rewards: 3.427, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.176', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'weapon7': '0.116', 'weapon4': '0.192', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon5': '0.264', 'HITCOUNT': '0.310', 'WEAPON7': '0.400', 'WEAPON3': '0.550', 'weapon3': '1.398', 'weapon2': '1.652', 'DAMAGECOUNT': '1.692', 'FRAGCOUNT': '3.000'} [2023-02-24 18:05:09,143][177153] Updated weights for policy 0, policy_version 8650 (0.0009) [2023-02-24 18:05:09,963][177158] DAMAGECOUNT value on done: 46030.0 [2023-02-24 18:05:09,963][177158] Sum rewards: 6.660, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.132', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'ARMOR': '0.033', 'AMMO2': '0.046', 'weapon5': '0.104', 'AMMO3': '0.128', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.229', 'WEAPON4': '0.450', 'weapon4': '0.462', 'HITCOUNT': '0.630', 'WEAPON3': '0.850', 'weapon2': '1.064', 'DAMAGECOUNT': '1.971', 'weapon3': '2.048', 'FRAGCOUNT': '8.000'} [2023-02-24 18:05:10,206][177172] DAMAGECOUNT value on done: 49328.0 [2023-02-24 18:05:10,207][177172] Sum rewards: 2.309, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.456', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'AMMO4': '0.091', 'AMMO3': '0.106', 'weapon5': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.156', 'HITCOUNT': '0.360', 'WEAPON3': '0.700', 'weapon2': '1.426', 'DAMAGECOUNT': '1.776', 'weapon3': '1.926', 'FRAGCOUNT': '4.000'} [2023-02-24 18:05:10,255][177158] DAMAGECOUNT value on done: 50309.0 [2023-02-24 18:05:10,255][177158] Sum rewards: 5.557, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.382', 'AMMO5': '0.019', 'AMMO2': '0.025', 'ARMOR': '0.044', 'WEAPON1': '0.100', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'weapon5': '0.258', 'weapon4': '0.426', 'HITCOUNT': '0.480', 'WEAPON5': '0.500', 'weapon2': '0.840', 'WEAPON3': '0.950', 'weapon3': '1.924', 'DAMAGECOUNT': '2.196', 'FRAGCOUNT': '7.000'} [2023-02-24 18:05:10,509][177172] DAMAGECOUNT value on done: 46546.0 [2023-02-24 18:05:10,510][177172] Sum rewards: 3.733, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.480', 'AMMO5': '0.013', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'weapon7': '0.058', 'WEAPON1': '0.060', 'AMMO3': '0.063', 'weapon5': '0.088', 'AMMO4': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.240', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'weapon2': '0.620', 'weapon4': '0.798', 'weapon3': '0.804', 'DAMAGECOUNT': '1.005', 'FRAGCOUNT': '3.000'} [2023-02-24 18:05:11,033][177154] DAMAGECOUNT value on done: 51215.0 [2023-02-24 18:05:11,033][177154] Sum rewards: 2.021, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.002', 'AMMO5': '0.013', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'AMMO4': '0.109', 'weapon5': '0.128', 'AMMO3': '0.131', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.382', 'HITCOUNT': '0.540', 'WEAPON3': '0.850', 'weapon2': '1.008', 'weapon3': '2.024', 'DAMAGECOUNT': '2.025', 'FRAGCOUNT': '6.000'} [2023-02-24 18:05:11,325][177154] DAMAGECOUNT value on done: 49216.0 [2023-02-24 18:05:11,326][177154] Sum rewards: 4.232, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.140', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.042', 'weapon5': '0.048', 'weapon7': '0.058', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.338', 'HITCOUNT': '0.390', 'ARMOR': '0.400', 'WEAPON3': '1.000', 'weapon3': '1.568', 'weapon2': '1.656', 'DAMAGECOUNT': '2.001', 'FRAGCOUNT': '7.000'} [2023-02-24 18:05:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13968.0). Total num frames: 35459072. Throughput: 0: 3504.1. Samples: 8862490. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 18:05:11,376][177119] Avg episode reward: [(0, '4.173')] [2023-02-24 18:05:11,392][177172] DAMAGECOUNT value on done: 47749.0 [2023-02-24 18:05:11,393][177172] Sum rewards: 6.186, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.625', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.060', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon5': '0.116', 'weapon4': '0.148', 'WEAPON5': '0.300', 'HITCOUNT': '0.480', 'WEAPON3': '0.650', 'weapon2': '1.600', 'weapon3': '1.880', 'DAMAGECOUNT': '2.010', 'FRAGCOUNT': '7.000'} [2023-02-24 18:05:11,536][177154] DAMAGECOUNT value on done: 50107.0 [2023-02-24 18:05:11,536][177154] Sum rewards: 4.120, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.531', 'AMMO2': '0.014', 'AMMO5': '0.019', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.146', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'HITCOUNT': '0.580', 'WEAPON3': '0.750', 'weapon4': '0.840', 'weapon2': '1.092', 'weapon3': '1.478', 'DAMAGECOUNT': '2.058', 'FRAGCOUNT': '5.500'} [2023-02-24 18:05:11,693][177172] DAMAGECOUNT value on done: 47639.0 [2023-02-24 18:05:11,694][177172] Sum rewards: -2.990, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.442', 'AMMO5': '0.013', 'AMMO2': '0.029', 'WEAPON1': '0.050', 'weapon5': '0.130', 'AMMO4': '0.143', 'AMMO3': '0.151', 'HITCOUNT': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.634', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.143', 'weapon2': '1.272', 'weapon3': '1.496', 'FRAGCOUNT': '2.000'} [2023-02-24 18:05:11,844][177154] DAMAGECOUNT value on done: 48619.0 [2023-02-24 18:05:11,844][177154] Sum rewards: 4.033, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.790', 'AMMO2': '0.012', 'AMMO5': '0.017', 'AMMO4': '0.059', 'WEAPON1': '0.060', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'weapon5': '0.224', 'WEAPON5': '0.350', 'HITCOUNT': '0.500', 'WEAPON3': '0.650', 'weapon3': '1.594', 'weapon2': '1.608', 'DAMAGECOUNT': '1.710', 'FRAGCOUNT': '6.000'} [2023-02-24 18:05:12,074][177153] Updated weights for policy 0, policy_version 8660 (0.0009) [2023-02-24 18:05:12,260][177157] DAMAGECOUNT value on done: 51627.0 [2023-02-24 18:05:12,261][177157] Sum rewards: 8.625, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.932', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon7': '0.052', 'WEAPON1': '0.070', 'AMMO3': '0.083', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.228', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.560', 'weapon4': '0.694', 'weapon2': '0.894', 'weapon3': '1.606', 'DAMAGECOUNT': '2.625', 'FRAGCOUNT': '7.000'} [2023-02-24 18:05:12,287][177157] DAMAGECOUNT value on done: 51321.0 [2023-02-24 18:05:12,287][177157] Sum rewards: 1.289, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.010', 'AMMO2': '0.037', 'WEAPON1': '0.040', 'weapon7': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.122', 'AMMO4': '0.182', 'weapon5': '0.184', 'HEALTH': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.320', 'WEAPON3': '0.500', 'weapon4': '0.634', 'weapon2': '0.972', 'DAMAGECOUNT': '1.050', 'weapon3': '1.690', 'FRAGCOUNT': '2.000'} [2023-02-24 18:05:12,398][177171] DAMAGECOUNT value on done: 48598.0 [2023-02-24 18:05:12,399][177171] Sum rewards: 12.687, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.036', 'AMMO2': '0.012', 'AMMO5': '0.014', 'ARMOR': '0.020', 'WEAPON1': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'weapon4': '0.192', 'weapon5': '0.202', 'WEAPON5': '0.300', 'HITCOUNT': '0.530', 'WEAPON3': '0.600', 'weapon2': '1.282', 'weapon3': '1.970', 'DAMAGECOUNT': '3.297', 'FRAGCOUNT': '10.000'} [2023-02-24 18:05:12,560][177157] DAMAGECOUNT value on done: 48664.0 [2023-02-24 18:05:12,560][177157] Sum rewards: 3.936, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.245', 'AMMO2': '0.009', 'AMMO5': '0.015', 'AMMO4': '0.045', 'WEAPON1': '0.050', 'weapon7': '0.074', 'ARMOR': '0.080', 'weapon5': '0.084', 'AMMO3': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'HITCOUNT': '0.470', 'WEAPON3': '0.700', 'weapon4': '1.002', 'weapon2': '1.018', 'weapon3': '1.500', 'DAMAGECOUNT': '1.692', 'FRAGCOUNT': '5.000'} [2023-02-24 18:05:12,585][177157] DAMAGECOUNT value on done: 45772.0 [2023-02-24 18:05:12,586][177157] Sum rewards: 4.518, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.616', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'AMMO3': '0.047', 'WEAPON4': '0.100', 'AMMO4': '0.132', 'weapon5': '0.140', 'HITCOUNT': '0.150', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'weapon3': '0.618', 'weapon4': '0.680', 'DAMAGECOUNT': '1.107', 'weapon2': '2.236', 'FRAGCOUNT': '3.000'} [2023-02-24 18:05:12,698][177171] DAMAGECOUNT value on done: 46832.0 [2023-02-24 18:05:12,698][177171] Sum rewards: 7.157, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.745', 'AMMO5': '0.007', 'AMMO2': '0.012', 'ARMOR': '0.016', 'WEAPON1': '0.040', 'weapon7': '0.054', 'AMMO3': '0.060', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'weapon5': '0.150', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.360', 'WEAPON3': '0.450', 'weapon4': '0.718', 'weapon2': '1.292', 'DAMAGECOUNT': '1.443', 'weapon3': '1.448', 'FRAGCOUNT': '6.000'} [2023-02-24 18:05:12,982][177171] DAMAGECOUNT value on done: 47934.0 [2023-02-24 18:05:12,982][177171] Sum rewards: 5.255, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.689', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO3': '0.060', 'WEAPON1': '0.060', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.141', 'weapon5': '0.150', 'HITCOUNT': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'weapon4': '0.672', 'weapon3': '1.346', 'weapon2': '1.440', 'DAMAGECOUNT': '1.629', 'FRAGCOUNT': '4.000'} [2023-02-24 18:05:12,995][177155] DAMAGECOUNT value on done: 50394.0 [2023-02-24 18:05:12,996][177155] Sum rewards: 7.382, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.014', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'AMMO4': '0.067', 'AMMO3': '0.145', 'weapon5': '0.180', 'WEAPON5': '0.250', 'WEAPON3': '0.650', 'HITCOUNT': '0.720', 'weapon2': '1.642', 'weapon3': '1.912', 'DAMAGECOUNT': '3.234', 'FRAGCOUNT': '6.000'} [2023-02-24 18:05:13,279][177171] DAMAGECOUNT value on done: 48407.0 [2023-02-24 18:05:13,279][177171] Sum rewards: 5.891, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.246', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon7': '0.046', 'AMMO3': '0.081', 'WEAPON1': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.186', 'WEAPON7': '0.200', 'AMMO4': '0.207', 'HITCOUNT': '0.210', 'WEAPON4': '0.300', 'ARMOR': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon4': '0.750', 'weapon3': '1.256', 'weapon2': '1.334', 'DAMAGECOUNT': '1.680', 'FRAGCOUNT': '5.000'} [2023-02-24 18:05:13,293][177155] DAMAGECOUNT value on done: 51550.0 [2023-02-24 18:05:13,294][177155] Sum rewards: 7.870, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.021', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.015', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'AMMO3': '0.123', 'weapon5': '0.208', 'WEAPON5': '0.300', 'HITCOUNT': '0.610', 'WEAPON3': '0.800', 'weapon2': '1.350', 'weapon3': '1.998', 'DAMAGECOUNT': '3.666', 'FRAGCOUNT': '8.000'} [2023-02-24 18:05:13,539][177155] DAMAGECOUNT value on done: 53145.0 [2023-02-24 18:05:13,539][177155] Sum rewards: 8.727, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.510', 'AMMO5': '0.025', 'AMMO2': '0.031', 'WEAPON4': '0.050', 'AMMO3': '0.108', 'WEAPON1': '0.110', 'AMMO4': '0.153', 'weapon5': '0.266', 'weapon4': '0.344', 'HITCOUNT': '0.580', 'WEAPON5': '0.650', 'WEAPON3': '0.800', 'weapon2': '1.264', 'weapon3': '1.750', 'DAMAGECOUNT': '3.606', 'FRAGCOUNT': '8.000'} [2023-02-24 18:05:13,835][177155] DAMAGECOUNT value on done: 47878.0 [2023-02-24 18:05:13,835][177155] Sum rewards: 5.467, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.312', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.060', 'AMMO4': '0.090', 'AMMO3': '0.101', 'weapon7': '0.122', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.226', 'WEAPON5': '0.350', 'HITCOUNT': '0.390', 'weapon4': '0.414', 'WEAPON3': '0.600', 'weapon2': '1.326', 'weapon3': '1.544', 'DAMAGECOUNT': '1.971', 'FRAGCOUNT': '6.000'} [2023-02-24 18:05:14,948][177153] Updated weights for policy 0, policy_version 8670 (0.0008) [2023-02-24 18:05:16,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.6, 300 sec: 13968.1). Total num frames: 35528704. Throughput: 0: 3508.7. Samples: 8883676. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 18:05:16,376][177119] Avg episode reward: [(0, '4.636')] [2023-02-24 18:05:17,865][177153] Updated weights for policy 0, policy_version 8680 (0.0008) [2023-02-24 18:05:18,194][177156] DAMAGECOUNT value on done: 51469.0 [2023-02-24 18:05:18,195][177156] Sum rewards: 3.290, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.104', 'AMMO5': '0.007', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'AMMO3': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.158', 'weapon5': '0.222', 'WEAPON5': '0.250', 'HITCOUNT': '0.270', 'WEAPON3': '0.400', 'weapon4': '0.450', 'weapon3': '1.138', 'weapon2': '1.318', 'DAMAGECOUNT': '1.470', 'FRAGCOUNT': '3.000'} [2023-02-24 18:05:18,345][177156] DAMAGECOUNT value on done: 49003.0 [2023-02-24 18:05:18,346][177156] Sum rewards: 5.312, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.942', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.122', 'AMMO3': '0.146', 'AMMO4': '0.180', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.348', 'HITCOUNT': '0.400', 'ARMOR': '0.473', 'WEAPON4': '0.500', 'WEAPON3': '0.900', 'weapon4': '1.140', 'weapon3': '1.708', 'DAMAGECOUNT': '1.755', 'FRAGCOUNT': '7.500'} [2023-02-24 18:05:18,485][177156] DAMAGECOUNT value on done: 52594.0 [2023-02-24 18:05:18,486][177156] Sum rewards: 3.563, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.457', 'AMMO5': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.050', 'AMMO4': '0.084', 'AMMO3': '0.099', 'weapon7': '0.104', 'weapon5': '0.140', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.340', 'AMMO6': '0.440', 'AMMO7': '0.440', 'WEAPON3': '0.550', 'WEAPON7': '0.600', 'weapon2': '0.758', 'weapon4': '1.030', 'DAMAGECOUNT': '1.494', 'weapon3': '1.562', 'FRAGCOUNT': '4.000'} [2023-02-24 18:05:18,644][177156] DAMAGECOUNT value on done: 51396.0 [2023-02-24 18:05:18,645][177156] Sum rewards: 6.993, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.255', 'AMMO5': '0.015', 'AMMO2': '0.026', 'WEAPON1': '0.070', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'AMMO4': '0.129', 'weapon5': '0.182', 'weapon7': '0.210', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.410', 'weapon4': '0.554', 'WEAPON3': '0.600', 'weapon2': '0.688', 'weapon3': '1.796', 'DAMAGECOUNT': '2.295', 'FRAGCOUNT': '5.000'} [2023-02-24 18:05:20,813][177153] Updated weights for policy 0, policy_version 8690 (0.0008) [2023-02-24 18:05:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 35598336. Throughput: 0: 3510.4. Samples: 8894192. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 18:05:21,376][177119] Avg episode reward: [(0, '4.666')] [2023-02-24 18:05:21,399][177140] Saving new best policy, reward=4.666! [2023-02-24 18:05:23,705][177153] Updated weights for policy 0, policy_version 8700 (0.0008) [2023-02-24 18:05:26,376][177119] Fps is (10 sec: 14336.1, 60 sec: 14062.9, 300 sec: 13981.9). Total num frames: 35672064. Throughput: 0: 3512.1. Samples: 8915274. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:05:26,376][177119] Avg episode reward: [(0, '4.666')] [2023-02-24 18:05:26,622][177153] Updated weights for policy 0, policy_version 8710 (0.0008) [2023-02-24 18:05:27,110][177170] DAMAGECOUNT value on done: 50752.0 [2023-02-24 18:05:27,111][177170] Sum rewards: 8.038, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.672', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.040', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.176', 'AMMO4': '0.201', 'WEAPON5': '0.300', 'weapon4': '0.372', 'HITCOUNT': '0.460', 'WEAPON3': '0.650', 'weapon2': '1.358', 'weapon3': '1.520', 'DAMAGECOUNT': '1.890', 'FRAGCOUNT': '7.500'} [2023-02-24 18:05:27,408][177170] DAMAGECOUNT value on done: 53704.0 [2023-02-24 18:05:27,409][177170] Sum rewards: -0.107, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.208', 'AMMO5': '0.009', 'AMMO2': '0.027', 'WEAPON1': '0.040', 'weapon5': '0.082', 'AMMO3': '0.109', 'AMMO4': '0.137', 'weapon7': '0.140', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.340', 'WEAPON4': '0.350', 'ARMOR': '0.440', 'weapon4': '0.618', 'WEAPON3': '0.650', 'weapon2': '1.048', 'DAMAGECOUNT': '1.380', 'weapon3': '1.540', 'FRAGCOUNT': '3.000'} [2023-02-24 18:05:27,446][177170] DAMAGECOUNT value on done: 45282.0 [2023-02-24 18:05:27,447][177170] Sum rewards: -2.112, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.930', 'AMMO5': '0.012', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'AMMO4': '0.119', 'AMMO3': '0.127', 'weapon5': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.416', 'HITCOUNT': '0.490', 'WEAPON3': '0.750', 'weapon2': '1.026', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.572', 'weapon3': '1.860'} [2023-02-24 18:05:27,738][177170] DAMAGECOUNT value on done: 53335.0 [2023-02-24 18:05:27,739][177170] Sum rewards: 2.721, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.764', 'AMMO5': '0.013', 'ARMOR': '0.016', 'AMMO2': '0.026', 'WEAPON1': '0.060', 'weapon7': '0.098', 'AMMO3': '0.102', 'weapon5': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.370', 'HITCOUNT': '0.410', 'WEAPON3': '0.700', 'weapon2': '1.108', 'DAMAGECOUNT': '1.140', 'weapon3': '1.814', 'FRAGCOUNT': '4.000'} [2023-02-24 18:05:27,915][177158] DAMAGECOUNT value on done: 47788.0 [2023-02-24 18:05:27,915][177158] Sum rewards: 1.549, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.598', 'AMMO5': '0.014', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'weapon4': '0.090', 'AMMO3': '0.121', 'AMMO4': '0.124', 'weapon5': '0.190', 'WEAPON5': '0.350', 'HITCOUNT': '0.550', 'WEAPON3': '0.800', 'weapon2': '1.066', 'DAMAGECOUNT': '1.755', 'weapon3': '2.192', 'FRAGCOUNT': '3.000'} [2023-02-24 18:05:28,219][177158] DAMAGECOUNT value on done: 49332.0 [2023-02-24 18:05:28,220][177158] Sum rewards: 4.205, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.898', 'AMMO2': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.020', 'weapon7': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.164', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'weapon4': '0.416', 'HITCOUNT': '0.510', 'WEAPON3': '0.700', 'weapon2': '1.076', 'weapon3': '1.564', 'DAMAGECOUNT': '1.800', 'FRAGCOUNT': '5.000'} [2023-02-24 18:05:29,077][177158] DAMAGECOUNT value on done: 46906.0 [2023-02-24 18:05:29,077][177158] Sum rewards: 4.544, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.012', 'ARMOR': '0.024', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'weapon7': '0.052', 'HEALTH': '0.078', 'AMMO3': '0.078', 'AMMO4': '0.147', 'weapon5': '0.152', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.270', 'WEAPON3': '0.450', 'AMMO6': '0.500', 'WEAPON7': '0.500', 'AMMO7': '0.500', 'weapon2': '0.702', 'weapon4': '0.800', 'weapon3': '1.504', 'DAMAGECOUNT': '1.965', 'FRAGCOUNT': '3.000'} [2023-02-24 18:05:29,329][177172] DAMAGECOUNT value on done: 49656.0 [2023-02-24 18:05:29,329][177172] Sum rewards: 4.979, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.056', 'AMMO4': '0.073', 'weapon7': '0.120', 'weapon5': '0.130', 'HITCOUNT': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HEALTH': '0.256', 'WEAPON3': '0.300', 'weapon4': '0.440', 'DAMAGECOUNT': '0.984', 'weapon3': '1.106', 'weapon2': '1.916', 'FRAGCOUNT': '3.000'} [2023-02-24 18:05:29,374][177158] DAMAGECOUNT value on done: 50805.0 [2023-02-24 18:05:29,375][177158] Sum rewards: 5.024, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.772', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO3': '0.053', 'WEAPON1': '0.060', 'AMMO4': '0.139', 'weapon7': '0.152', 'weapon5': '0.210', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'HITCOUNT': '0.290', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.548', 'weapon2': '1.084', 'weapon3': '1.292', 'DAMAGECOUNT': '1.488', 'FRAGCOUNT': '4.000'} [2023-02-24 18:05:29,553][177153] Updated weights for policy 0, policy_version 8720 (0.0009) [2023-02-24 18:05:29,622][177172] DAMAGECOUNT value on done: 47252.0 [2023-02-24 18:05:29,623][177172] Sum rewards: 3.671, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.828', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon7': '0.046', 'ARMOR': '0.056', 'WEAPON1': '0.060', 'AMMO3': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.166', 'AMMO4': '0.195', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'HITCOUNT': '0.550', 'WEAPON3': '0.650', 'weapon2': '0.662', 'weapon4': '0.914', 'weapon3': '1.734', 'DAMAGECOUNT': '2.118', 'FRAGCOUNT': '5.000'} [2023-02-24 18:05:30,169][177154] DAMAGECOUNT value on done: 51686.0 [2023-02-24 18:05:30,169][177154] Sum rewards: 1.139, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.318', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.015', 'weapon5': '0.076', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.138', 'weapon4': '0.340', 'WEAPON5': '0.350', 'HITCOUNT': '0.490', 'WEAPON3': '0.900', 'weapon2': '1.184', 'DAMAGECOUNT': '1.413', 'weapon3': '1.878', 'FRAGCOUNT': '3.000'} [2023-02-24 18:05:30,465][177154] DAMAGECOUNT value on done: 49541.0 [2023-02-24 18:05:30,465][177154] Sum rewards: 1.024, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.606', 'ARMOR': '0.012', 'AMMO2': '0.015', 'AMMO5': '0.025', 'WEAPON1': '0.070', 'AMMO4': '0.076', 'weapon7': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.105', 'weapon5': '0.142', 'WEAPON4': '0.150', 'HITCOUNT': '0.340', 'WEAPON5': '0.550', 'weapon4': '0.686', 'WEAPON3': '0.750', 'weapon2': '0.800', 'DAMAGECOUNT': '0.975', 'weapon3': '1.558', 'FRAGCOUNT': '2.000'} [2023-02-24 18:05:30,507][177172] DAMAGECOUNT value on done: 48640.0 [2023-02-24 18:05:30,507][177172] Sum rewards: 5.800, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.420', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'weapon7': '0.048', 'weapon5': '0.060', 'AMMO4': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.105', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.338', 'WEAPON3': '0.650', 'HITCOUNT': '0.660', 'weapon4': '0.942', 'weapon3': '1.704', 'DAMAGECOUNT': '2.673', 'FRAGCOUNT': '6.500'} [2023-02-24 18:05:30,637][177154] DAMAGECOUNT value on done: 50357.0 [2023-02-24 18:05:30,638][177154] Sum rewards: -0.556, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.206', 'AMMO5': '0.017', 'AMMO2': '0.032', 'WEAPON1': '0.050', 'AMMO3': '0.082', 'WEAPON4': '0.150', 'AMMO4': '0.160', 'HITCOUNT': '0.230', 'weapon5': '0.236', 'weapon4': '0.346', 'WEAPON5': '0.350', 'ARMOR': '0.468', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.750', 'weapon2': '1.070', 'weapon3': '1.708'} [2023-02-24 18:05:30,799][177172] DAMAGECOUNT value on done: 48012.0 [2023-02-24 18:05:30,800][177172] Sum rewards: 0.772, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.908', 'AMMO2': '0.007', 'AMMO5': '0.019', 'AMMO4': '0.034', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'weapon7': '0.106', 'weapon5': '0.124', 'AMMO3': '0.132', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.300', 'HITCOUNT': '0.310', 'weapon4': '0.374', 'WEAPON7': '0.400', 'weapon2': '0.670', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.119', 'weapon3': '2.164', 'FRAGCOUNT': '3.500'} [2023-02-24 18:05:30,928][177154] DAMAGECOUNT value on done: 49202.0 [2023-02-24 18:05:30,929][177154] Sum rewards: 0.912, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.900', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon7': '0.054', 'WEAPON1': '0.060', 'AMMO3': '0.106', 'weapon5': '0.168', 'AMMO4': '0.238', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON5': '0.350', 'HITCOUNT': '0.360', 'weapon2': '0.380', 'WEAPON7': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '0.650', 'weapon4': '1.192', 'weapon3': '1.400', 'DAMAGECOUNT': '1.749', 'FRAGCOUNT': '4.000'} [2023-02-24 18:05:31,329][177157] DAMAGECOUNT value on done: 52802.0 [2023-02-24 18:05:31,330][177157] Sum rewards: 10.637, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.401', 'weapon7': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.030', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.106', 'AMMO4': '0.147', 'weapon5': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.440', 'WEAPON3': '0.600', 'weapon2': '0.858', 'weapon4': '0.902', 'weapon3': '1.654', 'DAMAGECOUNT': '3.525', 'FRAGCOUNT': '10.000'} [2023-02-24 18:05:31,352][177157] DAMAGECOUNT value on done: 51838.0 [2023-02-24 18:05:31,352][177157] Sum rewards: -1.901, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.966', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon7': '0.054', 'WEAPON1': '0.060', 'AMMO3': '0.118', 'weapon5': '0.136', 'AMMO4': '0.240', 'WEAPON5': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'HITCOUNT': '0.380', 'WEAPON7': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.796', 'WEAPON3': '0.800', 'weapon2': '0.858', 'DAMAGECOUNT': '1.551', 'weapon3': '1.724', 'FRAGCOUNT': '2.000'} [2023-02-24 18:05:31,376][177119] Fps is (10 sec: 14335.9, 60 sec: 14062.9, 300 sec: 13968.1). Total num frames: 35741696. Throughput: 0: 3511.7. Samples: 8936268. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:05:31,376][177119] Avg episode reward: [(0, '4.406')] [2023-02-24 18:05:31,491][177171] DAMAGECOUNT value on done: 49127.0 [2023-02-24 18:05:31,492][177171] Sum rewards: 2.315, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.385', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'AMMO3': '0.055', 'AMMO4': '0.097', 'weapon5': '0.108', 'weapon7': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.320', 'WEAPON3': '0.350', 'weapon2': '0.396', 'weapon4': '0.714', 'weapon3': '0.982', 'DAMAGECOUNT': '1.587', 'FRAGCOUNT': '2.000'} [2023-02-24 18:05:31,634][177157] DAMAGECOUNT value on done: 49408.0 [2023-02-24 18:05:31,634][177157] Sum rewards: 5.415, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.392', 'AMMO5': '0.005', 'AMMO2': '0.019', 'ARMOR': '0.020', 'weapon7': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.052', 'AMMO4': '0.097', 'WEAPON5': '0.150', 'weapon5': '0.184', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'HITCOUNT': '0.540', 'weapon4': '0.736', 'weapon3': '1.240', 'weapon2': '1.278', 'DAMAGECOUNT': '2.232', 'FRAGCOUNT': '4.000'} [2023-02-24 18:05:31,653][177157] DAMAGECOUNT value on done: 46328.0 [2023-02-24 18:05:31,654][177157] Sum rewards: 2.139, reward structure: {'DEATHCOUNT': '-9.000', 'weapon4': '0.004', 'AMMO2': '0.011', 'AMMO5': '0.017', 'ARMOR': '0.020', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.150', 'HEALTH': '0.216', 'weapon5': '0.258', 'HITCOUNT': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.794', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.668', 'weapon3': '2.248', 'FRAGCOUNT': '4.000'} [2023-02-24 18:05:31,788][177171] DAMAGECOUNT value on done: 47328.0 [2023-02-24 18:05:31,788][177171] Sum rewards: 3.858, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.791', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'ARMOR': '0.040', 'AMMO4': '0.091', 'AMMO3': '0.104', 'weapon7': '0.106', 'weapon5': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HITCOUNT': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.600', 'weapon2': '0.866', 'weapon4': '0.950', 'weapon3': '1.318', 'DAMAGECOUNT': '1.488', 'FRAGCOUNT': '5.000'} [2023-02-24 18:05:32,074][177171] DAMAGECOUNT value on done: 48432.0 [2023-02-24 18:05:32,074][177171] Sum rewards: -0.483, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.171', 'AMMO5': '0.015', 'AMMO2': '0.028', 'ARMOR': '0.032', 'WEAPON1': '0.060', 'AMMO3': '0.090', 'AMMO4': '0.139', 'WEAPON4': '0.200', 'weapon5': '0.254', 'WEAPON5': '0.350', 'weapon4': '0.390', 'HITCOUNT': '0.400', 'WEAPON3': '0.600', 'weapon2': '1.136', 'DAMAGECOUNT': '1.494', 'weapon3': '1.750', 'FRAGCOUNT': '2.000'} [2023-02-24 18:05:32,259][177155] DAMAGECOUNT value on done: 50700.0 [2023-02-24 18:05:32,259][177155] Sum rewards: 2.252, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.194', 'AMMO5': '0.021', 'AMMO2': '0.033', 'weapon7': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.130', 'AMMO4': '0.163', 'weapon5': '0.226', 'WEAPON4': '0.300', 'ARMOR': '0.447', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon2': '0.758', 'DAMAGECOUNT': '0.918', 'weapon4': '0.932', 'weapon3': '1.180', 'FRAGCOUNT': '2.000'} [2023-02-24 18:05:32,367][177171] DAMAGECOUNT value on done: 48946.0 [2023-02-24 18:05:32,367][177171] Sum rewards: 2.625, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.508', 'ARMOR': '0.004', 'AMMO5': '0.007', 'weapon5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon7': '0.048', 'AMMO3': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.350', 'weapon3': '1.014', 'weapon4': '1.126', 'weapon2': '1.144', 'DAMAGECOUNT': '1.617', 'FRAGCOUNT': '4.000'} [2023-02-24 18:05:32,479][177153] Updated weights for policy 0, policy_version 8730 (0.0008) [2023-02-24 18:05:32,559][177155] DAMAGECOUNT value on done: 52464.0 [2023-02-24 18:05:32,559][177155] Sum rewards: 9.147, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.773', 'AMMO2': '0.010', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'weapon4': '0.068', 'AMMO3': '0.117', 'weapon5': '0.230', 'WEAPON5': '0.400', 'HITCOUNT': '0.700', 'WEAPON3': '0.800', 'weapon2': '0.984', 'weapon3': '2.210', 'DAMAGECOUNT': '2.742', 'FRAGCOUNT': '9.000'} [2023-02-24 18:05:32,780][177155] DAMAGECOUNT value on done: 53794.0 [2023-02-24 18:05:32,780][177155] Sum rewards: -0.378, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.910', 'ARMOR': '0.008', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.050', 'AMMO4': '0.059', 'weapon4': '0.094', 'AMMO3': '0.141', 'weapon5': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'HITCOUNT': '0.420', 'WEAPON3': '0.850', 'weapon2': '1.156', 'DAMAGECOUNT': '1.947', 'weapon3': '1.986', 'FRAGCOUNT': '4.500'} [2023-02-24 18:05:33,073][177155] DAMAGECOUNT value on done: 48940.0 [2023-02-24 18:05:33,074][177155] Sum rewards: 7.488, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.287', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'ARMOR': '0.049', 'weapon7': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.116', 'AMMO3': '0.137', 'AMMO4': '0.161', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.490', 'HITCOUNT': '0.500', 'weapon4': '0.790', 'WEAPON3': '0.850', 'weapon3': '1.976', 'DAMAGECOUNT': '3.186', 'FRAGCOUNT': '9.000'} [2023-02-24 18:05:35,399][177153] Updated weights for policy 0, policy_version 8740 (0.0009) [2023-02-24 18:05:36,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14062.9, 300 sec: 13981.9). Total num frames: 35811328. Throughput: 0: 3516.1. Samples: 8946870. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:05:36,376][177119] Avg episode reward: [(0, '4.307')] [2023-02-24 18:05:37,337][177156] DAMAGECOUNT value on done: 52529.0 [2023-02-24 18:05:37,337][177156] Sum rewards: 9.168, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.447', 'AMMO2': '0.012', 'AMMO5': '0.014', 'weapon7': '0.046', 'WEAPON1': '0.060', 'AMMO4': '0.062', 'AMMO3': '0.128', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.226', 'WEAPON5': '0.350', 'weapon4': '0.406', 'ARMOR': '0.468', 'weapon2': '0.646', 'HITCOUNT': '0.650', 'WEAPON3': '0.900', 'weapon3': '2.246', 'DAMAGECOUNT': '3.180', 'FRAGCOUNT': '8.000'} [2023-02-24 18:05:37,506][177156] DAMAGECOUNT value on done: 49593.0 [2023-02-24 18:05:37,506][177156] Sum rewards: -0.787, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.908', 'AMMO5': '0.015', 'AMMO2': '0.024', 'WEAPON1': '0.050', 'AMMO4': '0.120', 'AMMO3': '0.123', 'weapon5': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.300', 'HITCOUNT': '0.460', 'ARMOR': '0.518', 'WEAPON3': '0.750', 'weapon2': '0.992', 'DAMAGECOUNT': '1.770', 'weapon3': '1.918', 'FRAGCOUNT': '2.000'} [2023-02-24 18:05:37,635][177156] DAMAGECOUNT value on done: 53432.0 [2023-02-24 18:05:37,636][177156] Sum rewards: 5.134, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.825', 'AMMO5': '0.014', 'AMMO2': '0.015', 'ARMOR': '0.016', 'WEAPON1': '0.060', 'AMMO4': '0.075', 'AMMO3': '0.106', 'WEAPON4': '0.150', 'weapon5': '0.216', 'WEAPON5': '0.400', 'weapon4': '0.400', 'HITCOUNT': '0.690', 'WEAPON3': '0.700', 'weapon2': '0.852', 'weapon3': '2.000', 'DAMAGECOUNT': '2.514', 'FRAGCOUNT': '6.000'} [2023-02-24 18:05:37,814][177156] DAMAGECOUNT value on done: 51951.0 [2023-02-24 18:05:37,815][177156] Sum rewards: 6.477, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.274', 'AMMO5': '0.007', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'AMMO3': '0.062', 'AMMO4': '0.107', 'weapon5': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.420', 'WEAPON3': '0.550', 'weapon4': '0.590', 'weapon2': '1.214', 'weapon3': '1.350', 'ARMOR': '1.353', 'DAMAGECOUNT': '1.665', 'FRAGCOUNT': '5.000'} [2023-02-24 18:05:38,303][177153] Updated weights for policy 0, policy_version 8750 (0.0008) [2023-02-24 18:05:41,227][177153] Updated weights for policy 0, policy_version 8760 (0.0008) [2023-02-24 18:05:41,376][177119] Fps is (10 sec: 13926.5, 60 sec: 14062.9, 300 sec: 13968.1). Total num frames: 35880960. Throughput: 0: 3513.5. Samples: 8967920. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:05:41,376][177119] Avg episode reward: [(0, '4.275')] [2023-02-24 18:05:44,121][177153] Updated weights for policy 0, policy_version 8770 (0.0008) [2023-02-24 18:05:46,215][177170] DAMAGECOUNT value on done: 51382.0 [2023-02-24 18:05:46,215][177170] Sum rewards: 3.212, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.580', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.027', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'weapon4': '0.120', 'AMMO4': '0.137', 'weapon5': '0.156', 'HITCOUNT': '0.270', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'weapon2': '1.676', 'weapon3': '1.696', 'DAMAGECOUNT': '1.890', 'FRAGCOUNT': '5.000'} [2023-02-24 18:05:46,376][177119] Fps is (10 sec: 13926.6, 60 sec: 14063.0, 300 sec: 13968.1). Total num frames: 35950592. Throughput: 0: 3514.6. Samples: 8989068. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:05:46,376][177119] Avg episode reward: [(0, '4.241')] [2023-02-24 18:05:46,515][177170] DAMAGECOUNT value on done: 54801.0 [2023-02-24 18:05:46,516][177170] Sum rewards: 5.243, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.060', 'AMMO5': '0.016', 'AMMO2': '0.027', 'ARMOR': '0.047', 'WEAPON1': '0.050', 'AMMO4': '0.133', 'weapon5': '0.162', 'AMMO3': '0.179', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.408', 'weapon2': '0.420', 'HITCOUNT': '0.710', 'WEAPON3': '1.200', 'weapon3': '2.260', 'DAMAGECOUNT': '3.291', 'FRAGCOUNT': '10.000'} [2023-02-24 18:05:46,552][177170] DAMAGECOUNT value on done: 46016.0 [2023-02-24 18:05:46,553][177170] Sum rewards: 5.251, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.938', 'AMMO5': '0.020', 'AMMO2': '0.028', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.112', 'weapon5': '0.130', 'AMMO4': '0.140', 'WEAPON4': '0.250', 'weapon4': '0.294', 'HITCOUNT': '0.400', 'WEAPON5': '0.450', 'ARMOR': '0.504', 'WEAPON3': '0.700', 'weapon3': '1.410', 'weapon2': '1.648', 'DAMAGECOUNT': '2.202', 'FRAGCOUNT': '5.000'} [2023-02-24 18:05:46,862][177170] DAMAGECOUNT value on done: 53765.0 [2023-02-24 18:05:46,862][177170] Sum rewards: 0.873, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.300', 'AMMO5': '0.014', 'AMMO2': '0.020', 'weapon4': '0.034', 'WEAPON1': '0.060', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'weapon5': '0.264', 'HITCOUNT': '0.330', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.290', 'weapon2': '1.484', 'weapon3': '1.828', 'FRAGCOUNT': '3.000'} [2023-02-24 18:05:47,008][177158] DAMAGECOUNT value on done: 47953.0 [2023-02-24 18:05:47,009][177158] Sum rewards: 1.464, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.322', 'AMMO5': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON1': '0.050', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'weapon5': '0.182', 'HITCOUNT': '0.190', 'WEAPON5': '0.250', 'weapon4': '0.328', 'ARMOR': '0.461', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.700', 'weapon2': '1.058', 'weapon3': '1.814', 'FRAGCOUNT': '3.000'} [2023-02-24 18:05:47,041][177153] Updated weights for policy 0, policy_version 8780 (0.0008) [2023-02-24 18:05:47,304][177158] DAMAGECOUNT value on done: 49829.0 [2023-02-24 18:05:47,305][177158] Sum rewards: 3.571, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.434', 'AMMO5': '0.007', 'ARMOR': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.035', 'weapon7': '0.052', 'AMMO3': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.148', 'WEAPON5': '0.150', 'AMMO4': '0.173', 'WEAPON4': '0.200', 'HITCOUNT': '0.260', 'WEAPON3': '0.600', 'weapon4': '0.622', 'weapon2': '1.272', 'weapon3': '1.310', 'DAMAGECOUNT': '1.491', 'FRAGCOUNT': '4.000'} [2023-02-24 18:05:48,158][177158] DAMAGECOUNT value on done: 47187.0 [2023-02-24 18:05:48,158][177158] Sum rewards: -5.114, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.990', 'AMMO5': '0.010', 'ARMOR': '0.013', 'AMMO2': '0.022', 'WEAPON1': '0.050', 'AMMO3': '0.078', 'AMMO4': '0.108', 'HITCOUNT': '0.180', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon5': '0.266', 'weapon4': '0.444', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.843', 'FRAGCOUNT': '1.000', 'weapon2': '1.096', 'weapon3': '1.466'} [2023-02-24 18:05:48,411][177172] DAMAGECOUNT value on done: 49996.0 [2023-02-24 18:05:48,412][177172] Sum rewards: -2.913, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.252', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'weapon5': '0.068', 'AMMO3': '0.128', 'AMMO4': '0.158', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'HITCOUNT': '0.350', 'ARMOR': '0.440', 'weapon4': '0.562', 'WEAPON3': '0.750', 'weapon2': '0.938', 'DAMAGECOUNT': '1.020', 'weapon3': '1.750', 'FRAGCOUNT': '2.000'} [2023-02-24 18:05:48,456][177158] DAMAGECOUNT value on done: 51191.0 [2023-02-24 18:05:48,457][177158] Sum rewards: 1.857, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.472', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'AMMO3': '0.074', 'weapon5': '0.074', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.280', 'weapon4': '0.296', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.158', 'weapon3': '1.346', 'FRAGCOUNT': '2.000', 'weapon2': '2.046'} [2023-02-24 18:05:48,709][177172] DAMAGECOUNT value on done: 47993.0 [2023-02-24 18:05:48,710][177172] Sum rewards: 1.404, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.346', 'AMMO5': '0.012', 'AMMO2': '0.035', 'WEAPON1': '0.040', 'weapon7': '0.060', 'weapon5': '0.066', 'AMMO3': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.173', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'HITCOUNT': '0.520', 'weapon2': '0.616', 'WEAPON3': '0.700', 'weapon4': '1.054', 'weapon3': '1.752', 'DAMAGECOUNT': '2.223', 'FRAGCOUNT': '3.000'} [2023-02-24 18:05:49,291][177154] DAMAGECOUNT value on done: 52591.0 [2023-02-24 18:05:49,291][177154] Sum rewards: 5.762, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.508', 'weapon4': '0.018', 'AMMO5': '0.020', 'AMMO2': '0.035', 'WEAPON4': '0.050', 'WEAPON1': '0.100', 'AMMO3': '0.134', 'AMMO4': '0.176', 'weapon5': '0.184', 'WEAPON5': '0.500', 'HITCOUNT': '0.680', 'weapon2': '0.814', 'WEAPON3': '0.950', 'weapon3': '2.394', 'DAMAGECOUNT': '2.715', 'FRAGCOUNT': '9.000'} [2023-02-24 18:05:49,571][177172] DAMAGECOUNT value on done: 48655.0 [2023-02-24 18:05:49,580][177154] DAMAGECOUNT value on done: 49790.0 [2023-02-24 18:05:49,581][177154] Sum rewards: 0.237, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.682', 'weapon5': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.029', 'WEAPON1': '0.040', 'weapon7': '0.070', 'AMMO3': '0.079', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.140', 'AMMO4': '0.142', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.520', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.747', 'weapon4': '0.866', 'weapon2': '0.948', 'weapon3': '1.434', 'FRAGCOUNT': '2.000'} [2023-02-24 18:05:49,772][177154] DAMAGECOUNT value on done: 51158.0 [2023-02-24 18:05:49,772][177154] Sum rewards: 5.229, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.870', 'AMMO2': '0.011', 'AMMO5': '0.017', 'ARMOR': '0.024', 'WEAPON1': '0.040', 'AMMO4': '0.056', 'AMMO3': '0.111', 'weapon5': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.392', 'HITCOUNT': '0.480', 'WEAPON3': '0.700', 'weapon2': '1.460', 'weapon3': '1.674', 'DAMAGECOUNT': '2.403', 'FRAGCOUNT': '7.000'} [2023-02-24 18:05:49,875][177172] DAMAGECOUNT value on done: 48763.0 [2023-02-24 18:05:49,876][177172] Sum rewards: 1.764, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.980', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.033', 'WEAPON1': '0.070', 'AMMO3': '0.096', 'AMMO4': '0.162', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon5': '0.356', 'HITCOUNT': '0.450', 'WEAPON3': '0.700', 'weapon4': '0.764', 'weapon2': '0.770', 'weapon3': '1.626', 'DAMAGECOUNT': '2.253', 'FRAGCOUNT': '4.000'} [2023-02-24 18:05:49,966][177153] Updated weights for policy 0, policy_version 8790 (0.0008) [2023-02-24 18:05:50,068][177154] DAMAGECOUNT value on done: 49732.0 [2023-02-24 18:05:50,069][177154] Sum rewards: 2.569, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.456', 'AMMO5': '0.010', 'AMMO2': '0.036', 'WEAPON1': '0.040', 'AMMO3': '0.101', 'weapon5': '0.118', 'AMMO4': '0.178', 'weapon4': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'HITCOUNT': '0.450', 'WEAPON3': '0.700', 'weapon2': '1.522', 'DAMAGECOUNT': '1.590', 'weapon3': '1.804', 'FRAGCOUNT': '4.000'} [2023-02-24 18:05:50,471][177157] DAMAGECOUNT value on done: 53455.0 [2023-02-24 18:05:50,472][177157] Sum rewards: 2.634, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.576', 'AMMO2': '0.019', 'AMMO5': '0.020', 'ARMOR': '0.024', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO4': '0.093', 'AMMO3': '0.096', 'weapon5': '0.296', 'weapon4': '0.308', 'HITCOUNT': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'weapon2': '0.874', 'weapon3': '1.854', 'DAMAGECOUNT': '1.956', 'FRAGCOUNT': '3.500'} [2023-02-24 18:05:50,483][177157] DAMAGECOUNT value on done: 52780.0 [2023-02-24 18:05:50,483][177157] Sum rewards: 4.663, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.750', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO2': '0.031', 'AMMO3': '0.145', 'AMMO4': '0.156', 'weapon5': '0.212', 'WEAPON4': '0.250', 'HITCOUNT': '0.390', 'WEAPON5': '0.400', 'weapon4': '0.432', 'weapon2': '0.792', 'WEAPON3': '0.850', 'weapon3': '2.134', 'DAMAGECOUNT': '2.826', 'FRAGCOUNT': '5.000'} [2023-02-24 18:05:50,655][177171] DAMAGECOUNT value on done: 50020.0 [2023-02-24 18:05:50,655][177171] Sum rewards: 7.650, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.660', 'AMMO5': '0.019', 'AMMO2': '0.025', 'ARMOR': '0.038', 'weapon7': '0.042', 'WEAPON1': '0.080', 'AMMO3': '0.087', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'weapon4': '0.256', 'weapon5': '0.268', 'HITCOUNT': '0.460', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'weapon2': '1.294', 'weapon3': '1.684', 'DAMAGECOUNT': '2.679', 'FRAGCOUNT': '8.000'} [2023-02-24 18:05:50,782][177157] DAMAGECOUNT value on done: 50244.0 [2023-02-24 18:05:50,782][177157] Sum rewards: 0.392, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.449', 'AMMO5': '0.007', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.142', 'WEAPON5': '0.150', 'weapon4': '0.186', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'HITCOUNT': '0.610', 'WEAPON3': '1.050', 'weapon2': '1.472', 'weapon3': '1.920', 'DAMAGECOUNT': '2.508', 'FRAGCOUNT': '3.500'} [2023-02-24 18:05:50,795][177157] DAMAGECOUNT value on done: 47111.0 [2023-02-24 18:05:50,796][177157] Sum rewards: 5.839, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.752', 'ARMOR': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'weapon7': '0.064', 'AMMO3': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.160', 'weapon5': '0.232', 'WEAPON5': '0.350', 'HITCOUNT': '0.390', 'weapon4': '0.500', 'WEAPON3': '0.550', 'weapon2': '0.796', 'weapon3': '1.344', 'DAMAGECOUNT': '2.349', 'FRAGCOUNT': '4.500'} [2023-02-24 18:05:50,967][177171] DAMAGECOUNT value on done: 47628.0 [2023-02-24 18:05:50,967][177171] Sum rewards: -3.508, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.544', 'AMMO5': '0.010', 'AMMO2': '0.026', 'ARMOR': '0.036', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'weapon5': '0.100', 'AMMO4': '0.128', 'AMMO3': '0.146', 'weapon4': '0.228', 'HITCOUNT': '0.230', 'WEAPON5': '0.250', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.900', 'weapon2': '1.244', 'weapon3': '1.998', 'FRAGCOUNT': '2.000'} [2023-02-24 18:05:51,256][177171] DAMAGECOUNT value on done: 49563.0 [2023-02-24 18:05:51,257][177171] Sum rewards: 4.205, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.022', 'ARMOR': '0.004', 'AMMO5': '0.027', 'AMMO2': '0.044', 'WEAPON1': '0.080', 'weapon5': '0.138', 'AMMO3': '0.173', 'AMMO4': '0.218', 'WEAPON4': '0.250', 'weapon4': '0.360', 'WEAPON5': '0.550', 'weapon2': '0.676', 'HITCOUNT': '0.750', 'WEAPON3': '1.150', 'weapon3': '2.414', 'DAMAGECOUNT': '3.393', 'FRAGCOUNT': '8.000'} [2023-02-24 18:05:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 13968.1). Total num frames: 36020224. Throughput: 0: 3513.4. Samples: 8999572. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:05:51,376][177119] Avg episode reward: [(0, '3.730')] [2023-02-24 18:05:51,403][177155] DAMAGECOUNT value on done: 51849.0 [2023-02-24 18:05:51,404][177155] Sum rewards: 3.714, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.212', 'AMMO5': '0.009', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'AMMO4': '0.093', 'weapon5': '0.126', 'AMMO3': '0.132', 'WEAPON5': '0.300', 'HITCOUNT': '0.890', 'WEAPON3': '1.050', 'weapon2': '1.438', 'weapon3': '2.132', 'DAMAGECOUNT': '3.447', 'FRAGCOUNT': '7.000'} [2023-02-24 18:05:51,551][177171] DAMAGECOUNT value on done: 49153.0 [2023-02-24 18:05:51,551][177171] Sum rewards: 1.619, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.801', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'ARMOR': '0.004', 'AMMO5': '0.008', 'WEAPON1': '0.030', 'weapon7': '0.060', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.130', 'weapon5': '0.142', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.438', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.621', 'weapon3': '1.224', 'weapon2': '1.392', 'FRAGCOUNT': '3.000'} [2023-02-24 18:05:51,699][177155] DAMAGECOUNT value on done: 53212.0 [2023-02-24 18:05:51,699][177155] Sum rewards: 3.299, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.961', 'AMMO2': '0.010', 'AMMO5': '0.011', 'AMMO4': '0.051', 'WEAPON1': '0.070', 'AMMO3': '0.113', 'weapon5': '0.218', 'WEAPON5': '0.250', 'HITCOUNT': '0.520', 'WEAPON3': '0.750', 'weapon2': '1.186', 'weapon3': '2.086', 'DAMAGECOUNT': '2.244', 'FRAGCOUNT': '5.000'} [2023-02-24 18:05:51,912][177155] DAMAGECOUNT value on done: 54552.0 [2023-02-24 18:05:51,912][177155] Sum rewards: 5.857, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.603', 'AMMO5': '0.007', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon5': '0.128', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'weapon4': '0.432', 'HITCOUNT': '0.470', 'WEAPON3': '0.600', 'weapon2': '1.282', 'weapon3': '1.466', 'DAMAGECOUNT': '2.274', 'FRAGCOUNT': '6.000'} [2023-02-24 18:05:52,207][177155] DAMAGECOUNT value on done: 49200.0 [2023-02-24 18:05:52,902][177153] Updated weights for policy 0, policy_version 8800 (0.0009) [2023-02-24 18:05:55,828][177153] Updated weights for policy 0, policy_version 8810 (0.0008) [2023-02-24 18:05:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 36089856. Throughput: 0: 3512.7. Samples: 9020562. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:05:56,376][177119] Avg episode reward: [(0, '3.635')] [2023-02-24 18:05:56,514][177156] DAMAGECOUNT value on done: 53023.0 [2023-02-24 18:05:56,514][177156] Sum rewards: 5.425, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.015', 'AMMO2': '0.030', 'ARMOR': '0.036', 'weapon7': '0.048', 'WEAPON1': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.106', 'weapon5': '0.128', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'HEALTH': '0.274', 'WEAPON5': '0.350', 'HITCOUNT': '0.460', 'WEAPON3': '0.550', 'weapon2': '0.804', 'weapon4': '0.932', 'DAMAGECOUNT': '1.482', 'weapon3': '1.552', 'FRAGCOUNT': '4.000'} [2023-02-24 18:05:56,680][177156] DAMAGECOUNT value on done: 49833.0 [2023-02-24 18:05:56,680][177156] Sum rewards: 2.160, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.692', 'AMMO5': '0.012', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'weapon7': '0.066', 'AMMO3': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.104', 'AMMO4': '0.112', 'HITCOUNT': '0.230', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.720', 'weapon3': '1.482', 'weapon2': '1.974', 'FRAGCOUNT': '2.000'} [2023-02-24 18:05:56,812][177156] DAMAGECOUNT value on done: 54194.0 [2023-02-24 18:05:56,812][177156] Sum rewards: 4.520, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.811', 'weapon7': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.030', 'WEAPON1': '0.040', 'ARMOR': '0.052', 'AMMO3': '0.102', 'AMMO4': '0.148', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.232', 'HITCOUNT': '0.350', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.558', 'WEAPON3': '0.700', 'weapon2': '1.126', 'weapon3': '1.534', 'DAMAGECOUNT': '2.286', 'FRAGCOUNT': '6.000'} [2023-02-24 18:05:56,990][177156] DAMAGECOUNT value on done: 52576.0 [2023-02-24 18:05:56,991][177156] Sum rewards: 7.690, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.590', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.070', 'WEAPON1': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.102', 'weapon5': '0.192', 'WEAPON5': '0.350', 'HITCOUNT': '0.460', 'WEAPON3': '0.550', 'weapon2': '1.536', 'weapon3': '1.694', 'DAMAGECOUNT': '1.875', 'FRAGCOUNT': '7.000'} [2023-02-24 18:05:58,738][177153] Updated weights for policy 0, policy_version 8820 (0.0008) [2023-02-24 18:06:01,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14062.9, 300 sec: 13981.9). Total num frames: 36163584. Throughput: 0: 3507.8. Samples: 9041528. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:06:01,376][177119] Avg episode reward: [(0, '3.604')] [2023-02-24 18:06:01,654][177153] Updated weights for policy 0, policy_version 8830 (0.0009) [2023-02-24 18:06:04,612][177153] Updated weights for policy 0, policy_version 8840 (0.0008) [2023-02-24 18:06:05,386][177170] DAMAGECOUNT value on done: 52254.0 [2023-02-24 18:06:05,386][177170] Sum rewards: 8.805, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.789', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.028', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.069', 'weapon5': '0.084', 'AMMO3': '0.091', 'WEAPON5': '0.250', 'HITCOUNT': '0.630', 'WEAPON3': '0.650', 'weapon2': '1.562', 'weapon3': '1.990', 'DAMAGECOUNT': '2.616', 'FRAGCOUNT': '9.000'} [2023-02-24 18:06:05,684][177170] DAMAGECOUNT value on done: 55637.0 [2023-02-24 18:06:05,685][177170] Sum rewards: 6.621, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.114', 'AMMO5': '0.007', 'AMMO2': '0.037', 'WEAPON1': '0.050', 'weapon4': '0.062', 'AMMO3': '0.112', 'AMMO4': '0.184', 'WEAPON4': '0.200', 'weapon5': '0.218', 'WEAPON5': '0.250', 'HITCOUNT': '0.450', 'WEAPON3': '0.800', 'weapon2': '1.346', 'weapon3': '2.010', 'DAMAGECOUNT': '2.508', 'FRAGCOUNT': '7.000'} [2023-02-24 18:06:05,721][177170] DAMAGECOUNT value on done: 46654.0 [2023-02-24 18:06:05,722][177170] Sum rewards: 3.216, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.116', 'AMMO5': '0.010', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'AMMO4': '0.070', 'AMMO3': '0.095', 'weapon7': '0.160', 'weapon5': '0.188', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'HITCOUNT': '0.420', 'WEAPON3': '0.700', 'weapon2': '0.748', 'weapon4': '0.922', 'weapon3': '1.620', 'DAMAGECOUNT': '1.914', 'FRAGCOUNT': '4.500'} [2023-02-24 18:06:06,017][177170] DAMAGECOUNT value on done: 54232.0 [2023-02-24 18:06:06,018][177170] Sum rewards: 5.348, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.009', 'AMMO2': '0.031', 'WEAPON1': '0.040', 'AMMO3': '0.061', 'ARMOR': '0.068', 'weapon5': '0.082', 'WEAPON4': '0.100', 'AMMO4': '0.152', 'HEALTH': '0.186', 'WEAPON5': '0.200', 'HITCOUNT': '0.290', 'WEAPON3': '0.350', 'weapon2': '0.494', 'weapon4': '0.878', 'weapon3': '1.006', 'DAMAGECOUNT': '1.401', 'FRAGCOUNT': '3.000'} [2023-02-24 18:06:06,195][177158] DAMAGECOUNT value on done: 48936.0 [2023-02-24 18:06:06,196][177158] Sum rewards: 5.939, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.181', 'AMMO5': '0.015', 'AMMO2': '0.027', 'ARMOR': '0.028', 'WEAPON1': '0.070', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'AMMO4': '0.136', 'weapon5': '0.160', 'WEAPON5': '0.350', 'HITCOUNT': '0.580', 'WEAPON3': '0.750', 'weapon2': '1.036', 'weapon3': '2.242', 'DAMAGECOUNT': '2.949', 'FRAGCOUNT': '6.000'} [2023-02-24 18:06:06,376][177119] Fps is (10 sec: 14336.1, 60 sec: 14062.9, 300 sec: 13981.9). Total num frames: 36233216. Throughput: 0: 3506.4. Samples: 9051980. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:06:06,376][177119] Avg episode reward: [(0, '3.711')] [2023-02-24 18:06:06,493][177158] DAMAGECOUNT value on done: 50148.0 [2023-02-24 18:06:06,493][177158] Sum rewards: -2.983, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.364', 'AMMO5': '0.006', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'weapon7': '0.050', 'ARMOR': '0.076', 'AMMO3': '0.090', 'weapon5': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.133', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.230', 'WEAPON3': '0.500', 'weapon4': '0.742', 'DAMAGECOUNT': '0.957', 'weapon3': '1.050', 'weapon2': '1.550'} [2023-02-24 18:06:07,365][177158] DAMAGECOUNT value on done: 47767.0 [2023-02-24 18:06:07,366][177158] Sum rewards: 1.914, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.712', 'AMMO2': '0.017', 'AMMO5': '0.025', 'weapon7': '0.048', 'WEAPON1': '0.080', 'AMMO4': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.106', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'weapon4': '0.196', 'HITCOUNT': '0.440', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon2': '1.250', 'DAMAGECOUNT': '1.740', 'weapon3': '2.076', 'FRAGCOUNT': '3.000'} [2023-02-24 18:06:07,543][177153] Updated weights for policy 0, policy_version 8850 (0.0008) [2023-02-24 18:06:07,624][177172] DAMAGECOUNT value on done: 50858.0 [2023-02-24 18:06:07,625][177172] Sum rewards: 5.270, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.590', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon7': '0.028', 'WEAPON1': '0.040', 'AMMO3': '0.097', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.115', 'weapon5': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.424', 'WEAPON3': '0.650', 'weapon4': '0.714', 'HITCOUNT': '0.750', 'weapon2': '0.818', 'weapon3': '1.656', 'DAMAGECOUNT': '2.586', 'FRAGCOUNT': '4.500'} [2023-02-24 18:06:07,661][177158] DAMAGECOUNT value on done: 52215.0 [2023-02-24 18:06:07,661][177158] Sum rewards: 2.605, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.952', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.031', 'weapon5': '0.060', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'WEAPON4': '0.400', 'weapon4': '0.636', 'WEAPON3': '0.750', 'HITCOUNT': '0.770', 'weapon2': '1.204', 'weapon3': '1.908', 'DAMAGECOUNT': '3.072', 'FRAGCOUNT': '6.000'} [2023-02-24 18:06:07,923][177172] DAMAGECOUNT value on done: 48895.0 [2023-02-24 18:06:07,924][177172] Sum rewards: 6.457, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.217', 'AMMO2': '0.009', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.046', 'weapon7': '0.046', 'AMMO3': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.144', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.590', 'WEAPON3': '0.800', 'weapon2': '1.412', 'weapon3': '1.814', 'DAMAGECOUNT': '2.706', 'FRAGCOUNT': '6.000'} [2023-02-24 18:06:08,501][177154] DAMAGECOUNT value on done: 52886.0 [2023-02-24 18:06:08,501][177154] Sum rewards: 1.194, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.388', 'AMMO5': '0.007', 'AMMO2': '0.029', 'WEAPON1': '0.040', 'AMMO3': '0.058', 'weapon7': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.112', 'AMMO4': '0.144', 'HITCOUNT': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.885', 'weapon4': '0.990', 'weapon3': '1.022', 'weapon2': '1.606', 'FRAGCOUNT': '2.000'} [2023-02-24 18:06:08,791][177154] DAMAGECOUNT value on done: 50200.0 [2023-02-24 18:06:08,792][177154] Sum rewards: 1.330, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.028', 'AMMO2': '0.011', 'AMMO5': '0.012', 'ARMOR': '0.024', 'weapon4': '0.052', 'AMMO4': '0.053', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'weapon5': '0.168', 'HITCOUNT': '0.230', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.230', 'weapon2': '1.630', 'weapon3': '1.772', 'FRAGCOUNT': '5.000'} [2023-02-24 18:06:08,813][177172] DAMAGECOUNT value on done: 49480.0 [2023-02-24 18:06:08,814][177172] Sum rewards: 4.374, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.230', 'AMMO5': '0.010', 'AMMO2': '0.014', 'WEAPON1': '0.070', 'AMMO4': '0.071', 'weapon7': '0.078', 'AMMO3': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.280', 'weapon4': '0.318', 'WEAPON5': '0.350', 'HITCOUNT': '0.640', 'weapon2': '0.764', 'WEAPON3': '0.900', 'weapon3': '2.178', 'DAMAGECOUNT': '2.475', 'FRAGCOUNT': '6.000'} [2023-02-24 18:06:08,899][177154] DAMAGECOUNT value on done: 51932.0 [2023-02-24 18:06:08,900][177154] Sum rewards: 3.914, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.962', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'weapon5': '0.108', 'AMMO3': '0.132', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'HITCOUNT': '0.520', 'weapon4': '0.548', 'WEAPON3': '0.900', 'weapon2': '0.908', 'weapon3': '2.002', 'DAMAGECOUNT': '2.322', 'FRAGCOUNT': '6.000'} [2023-02-24 18:06:09,109][177172] DAMAGECOUNT value on done: 49932.0 [2023-02-24 18:06:09,109][177172] Sum rewards: 6.673, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.990', 'AMMO2': '0.006', 'AMMO5': '0.023', 'AMMO4': '0.030', 'weapon5': '0.032', 'WEAPON4': '0.050', 'WEAPON1': '0.080', 'weapon4': '0.122', 'AMMO3': '0.169', 'WEAPON5': '0.450', 'HITCOUNT': '0.830', 'weapon2': '0.970', 'WEAPON3': '1.100', 'weapon3': '2.544', 'DAMAGECOUNT': '3.507', 'FRAGCOUNT': '9.000'} [2023-02-24 18:06:09,197][177154] DAMAGECOUNT value on done: 50572.0 [2023-02-24 18:06:09,197][177154] Sum rewards: 9.190, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.977', 'AMMO5': '0.010', 'ARMOR': '0.024', 'WEAPON1': '0.030', 'AMMO2': '0.030', 'AMMO3': '0.073', 'weapon5': '0.108', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.524', 'WEAPON3': '0.550', 'HITCOUNT': '0.610', 'weapon2': '1.438', 'weapon3': '1.708', 'DAMAGECOUNT': '2.460', 'FRAGCOUNT': '8.000'} [2023-02-24 18:06:09,702][177157] DAMAGECOUNT value on done: 55151.0 [2023-02-24 18:06:09,702][177157] Sum rewards: 6.744, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.235', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'ARMOR': '0.044', 'WEAPON5': '0.100', 'weapon7': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.145', 'AMMO4': '0.149', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.740', 'HITCOUNT': '0.780', 'weapon4': '0.878', 'WEAPON3': '1.000', 'weapon3': '2.042', 'DAMAGECOUNT': '3.588', 'FRAGCOUNT': '8.000'} [2023-02-24 18:06:09,713][177157] DAMAGECOUNT value on done: 53399.0 [2023-02-24 18:06:09,714][177157] Sum rewards: 6.036, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.006', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'ARMOR': '0.065', 'AMMO3': '0.076', 'WEAPON5': '0.100', 'weapon5': '0.132', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'HITCOUNT': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.886', 'weapon2': '1.102', 'weapon3': '1.540', 'DAMAGECOUNT': '1.857', 'FRAGCOUNT': '5.000'} [2023-02-24 18:06:09,906][177171] DAMAGECOUNT value on done: 50957.0 [2023-02-24 18:06:09,907][177171] Sum rewards: 6.589, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.092', 'AMMO5': '0.012', 'AMMO2': '0.024', 'ARMOR': '0.032', 'WEAPON1': '0.060', 'AMMO4': '0.117', 'AMMO3': '0.134', 'WEAPON4': '0.200', 'weapon5': '0.236', 'WEAPON5': '0.300', 'weapon4': '0.324', 'HITCOUNT': '0.700', 'WEAPON3': '0.850', 'weapon2': '1.220', 'weapon3': '1.910', 'DAMAGECOUNT': '2.811', 'FRAGCOUNT': '7.000'} [2023-02-24 18:06:10,010][177157] DAMAGECOUNT value on done: 51050.0 [2023-02-24 18:06:10,011][177157] Sum rewards: 4.365, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.394', 'weapon7': '0.002', 'AMMO5': '0.012', 'AMMO2': '0.034', 'WEAPON1': '0.040', 'ARMOR': '0.096', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.121', 'AMMO4': '0.171', 'weapon5': '0.172', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'HITCOUNT': '0.530', 'weapon4': '0.608', 'WEAPON3': '0.850', 'weapon2': '1.242', 'weapon3': '1.712', 'DAMAGECOUNT': '2.418', 'FRAGCOUNT': '8.000'} [2023-02-24 18:06:10,022][177157] DAMAGECOUNT value on done: 47609.0 [2023-02-24 18:06:10,023][177157] Sum rewards: 1.735, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.724', 'AMMO2': '0.004', 'AMMO5': '0.017', 'AMMO4': '0.019', 'WEAPON1': '0.060', 'AMMO3': '0.081', 'weapon5': '0.150', 'HITCOUNT': '0.350', 'WEAPON5': '0.400', 'ARMOR': '0.492', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.494', 'weapon3': '1.548', 'weapon2': '1.994'} [2023-02-24 18:06:10,205][177171] DAMAGECOUNT value on done: 48602.0 [2023-02-24 18:06:10,206][177171] Sum rewards: 8.542, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'AMMO2': '0.033', 'ARMOR': '0.036', 'AMMO3': '0.060', 'weapon5': '0.062', 'WEAPON5': '0.150', 'weapon7': '0.150', 'AMMO4': '0.167', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HEALTH': '0.331', 'WEAPON3': '0.400', 'HITCOUNT': '0.540', 'weapon2': '0.968', 'weapon4': '1.236', 'weapon3': '1.302', 'DAMAGECOUNT': '2.922', 'FRAGCOUNT': '6.000'} [2023-02-24 18:06:10,431][177154] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:06:10,484][177153] Updated weights for policy 0, policy_version 8860 (0.0008) [2023-02-24 18:06:10,494][177171] DAMAGECOUNT value on done: 50626.0 [2023-02-24 18:06:10,494][177171] Sum rewards: 9.574, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.101', 'AMMO5': '0.007', 'AMMO2': '0.027', 'WEAPON1': '0.040', 'weapon5': '0.052', 'AMMO4': '0.134', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.382', 'ARMOR': '0.400', 'weapon2': '0.784', 'HITCOUNT': '0.850', 'WEAPON3': '1.050', 'weapon3': '2.510', 'DAMAGECOUNT': '3.189', 'FRAGCOUNT': '10.000'} [2023-02-24 18:06:10,643][177155] DAMAGECOUNT value on done: 52809.0 [2023-02-24 18:06:10,643][177155] Sum rewards: 8.403, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.322', 'weapon5': '0.006', 'AMMO5': '0.010', 'ARMOR': '0.013', 'AMMO2': '0.033', 'WEAPON1': '0.040', 'weapon7': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.115', 'AMMO4': '0.167', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.770', 'weapon4': '0.836', 'weapon2': '1.034', 'weapon3': '1.782', 'DAMAGECOUNT': '2.880', 'FRAGCOUNT': '11.000'} [2023-02-24 18:06:10,791][177171] DAMAGECOUNT value on done: 49870.0 [2023-02-24 18:06:10,792][177171] Sum rewards: 2.863, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.262', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'weapon5': '0.108', 'AMMO3': '0.123', 'WEAPON5': '0.150', 'weapon4': '0.208', 'HITCOUNT': '0.560', 'WEAPON3': '0.650', 'weapon2': '1.604', 'weapon3': '1.844', 'DAMAGECOUNT': '2.151', 'FRAGCOUNT': '6.000'} [2023-02-24 18:06:10,951][177155] DAMAGECOUNT value on done: 54135.0 [2023-02-24 18:06:10,952][177155] Sum rewards: 0.990, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.499', 'ARMOR': '0.012', 'AMMO2': '0.015', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.062', 'weapon5': '0.066', 'AMMO4': '0.074', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'weapon7': '0.132', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.398', 'WEAPON3': '0.400', 'weapon3': '0.542', 'DAMAGECOUNT': '0.969', 'FRAGCOUNT': '1.000', 'weapon2': '2.802'} [2023-02-24 18:06:11,184][177155] DAMAGECOUNT value on done: 55384.0 [2023-02-24 18:06:11,184][177155] Sum rewards: 9.834, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.284', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.040', 'weapon7': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.102', 'weapon5': '0.154', 'WEAPON5': '0.200', 'weapon4': '0.242', 'WEAPON3': '0.650', 'HITCOUNT': '0.750', 'weapon2': '1.486', 'weapon3': '1.766', 'DAMAGECOUNT': '2.496', 'FRAGCOUNT': '10.000'} [2023-02-24 18:06:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 13981.9). Total num frames: 36302848. Throughput: 0: 3505.4. Samples: 9073018. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:06:11,376][177119] Avg episode reward: [(0, '3.779')] [2023-02-24 18:06:11,486][177155] DAMAGECOUNT value on done: 49829.0 [2023-02-24 18:06:11,487][177155] Sum rewards: 3.225, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.212', 'AMMO2': '0.007', 'weapon7': '0.008', 'AMMO5': '0.011', 'AMMO4': '0.034', 'WEAPON1': '0.050', 'AMMO3': '0.090', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.144', 'weapon4': '0.272', 'WEAPON5': '0.350', 'HITCOUNT': '0.430', 'ARMOR': '0.488', 'WEAPON3': '0.600', 'weapon2': '1.010', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.887', 'weapon3': '2.156'} [2023-02-24 18:06:13,406][177153] Updated weights for policy 0, policy_version 8870 (0.0008) [2023-02-24 18:06:15,782][177156] DAMAGECOUNT value on done: 53680.0 [2023-02-24 18:06:15,782][177156] Sum rewards: 5.428, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.557', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.110', 'weapon5': '0.266', 'WEAPON5': '0.300', 'HITCOUNT': '0.370', 'weapon4': '0.426', 'WEAPON3': '0.750', 'weapon2': '1.466', 'weapon3': '1.626', 'DAMAGECOUNT': '1.971', 'FRAGCOUNT': '6.000'} [2023-02-24 18:06:15,938][177156] DAMAGECOUNT value on done: 50557.0 [2023-02-24 18:06:15,938][177156] Sum rewards: 2.300, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.806', 'AMMO2': '0.011', 'AMMO5': '0.017', 'AMMO4': '0.056', 'WEAPON1': '0.060', 'AMMO3': '0.095', 'weapon5': '0.114', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.454', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'weapon4': '0.884', 'weapon2': '0.898', 'weapon3': '1.554', 'DAMAGECOUNT': '2.172', 'FRAGCOUNT': '4.000'} [2023-02-24 18:06:16,092][177156] DAMAGECOUNT value on done: 54684.0 [2023-02-24 18:06:16,092][177156] Sum rewards: 2.719, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.570', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.025', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'AMMO4': '0.123', 'weapon5': '0.202', 'HITCOUNT': '0.240', 'WEAPON5': '0.350', 'weapon4': '0.436', 'WEAPON3': '0.800', 'weapon2': '1.456', 'DAMAGECOUNT': '1.470', 'weapon3': '1.628', 'FRAGCOUNT': '4.000'} [2023-02-24 18:06:16,234][177156] DAMAGECOUNT value on done: 53135.0 [2023-02-24 18:06:16,234][177156] Sum rewards: 2.305, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.250', 'AMMO5': '0.010', 'AMMO2': '0.035', 'WEAPON1': '0.040', 'AMMO3': '0.079', 'AMMO4': '0.175', 'weapon5': '0.198', 'HITCOUNT': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.648', 'weapon3': '1.210', 'weapon2': '1.542', 'DAMAGECOUNT': '1.677', 'FRAGCOUNT': '4.000'} [2023-02-24 18:06:16,311][177153] Updated weights for policy 0, policy_version 8880 (0.0008) [2023-02-24 18:06:16,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14062.9, 300 sec: 13981.9). Total num frames: 36372480. Throughput: 0: 3505.6. Samples: 9094020. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:06:16,376][177119] Avg episode reward: [(0, '3.585')] [2023-02-24 18:06:19,236][177153] Updated weights for policy 0, policy_version 8890 (0.0008) [2023-02-24 18:06:21,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14062.9, 300 sec: 13981.9). Total num frames: 36442112. Throughput: 0: 3504.5. Samples: 9104574. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:06:21,376][177119] Avg episode reward: [(0, '3.585')] [2023-02-24 18:06:22,173][177153] Updated weights for policy 0, policy_version 8900 (0.0008) [2023-02-24 18:06:24,586][177170] DAMAGECOUNT value on done: 53064.0 [2023-02-24 18:06:24,587][177170] Sum rewards: 1.846, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.320', 'ARMOR': '0.004', 'AMMO2': '0.015', 'AMMO5': '0.017', 'WEAPON1': '0.060', 'AMMO4': '0.075', 'weapon5': '0.124', 'AMMO3': '0.152', 'WEAPON5': '0.400', 'HITCOUNT': '0.760', 'weapon2': '0.940', 'WEAPON3': '1.050', 'DAMAGECOUNT': '2.430', 'weapon3': '2.638', 'FRAGCOUNT': '5.000'} [2023-02-24 18:06:24,883][177170] DAMAGECOUNT value on done: 56267.0 [2023-02-24 18:06:24,884][177170] Sum rewards: 5.346, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.316', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.070', 'AMMO3': '0.077', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'weapon5': '0.208', 'WEAPON5': '0.350', 'ARMOR': '0.408', 'WEAPON3': '0.500', 'HITCOUNT': '0.510', 'weapon4': '0.816', 'weapon2': '1.252', 'weapon3': '1.374', 'DAMAGECOUNT': '1.890', 'FRAGCOUNT': '4.000'} [2023-02-24 18:06:24,922][177170] DAMAGECOUNT value on done: 47115.0 [2023-02-24 18:06:24,923][177170] Sum rewards: 0.204, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.480', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'AMMO4': '0.090', 'weapon5': '0.108', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.310', 'weapon4': '0.548', 'WEAPON3': '0.750', 'weapon3': '1.176', 'DAMAGECOUNT': '1.383', 'weapon2': '1.594', 'FRAGCOUNT': '2.000'} [2023-02-24 18:06:25,112][177153] Updated weights for policy 0, policy_version 8910 (0.0008) [2023-02-24 18:06:25,221][177170] DAMAGECOUNT value on done: 55220.0 [2023-02-24 18:06:25,222][177170] Sum rewards: 11.969, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.686', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'WEAPON1': '0.050', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'weapon7': '0.110', 'weapon5': '0.114', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'weapon4': '0.380', 'WEAPON7': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.700', 'weapon2': '1.340', 'weapon3': '1.738', 'DAMAGECOUNT': '2.964', 'FRAGCOUNT': '11.000'} [2023-02-24 18:06:25,336][177158] DAMAGECOUNT value on done: 49521.0 [2023-02-24 18:06:25,337][177158] Sum rewards: 0.226, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.448', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'weapon7': '0.048', 'ARMOR': '0.052', 'weapon5': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'AMMO3': '0.151', 'WEAPON4': '0.250', 'HITCOUNT': '0.460', 'weapon4': '0.512', 'WEAPON3': '0.950', 'weapon2': '1.154', 'DAMAGECOUNT': '1.755', 'weapon3': '1.918', 'FRAGCOUNT': '5.000'} [2023-02-24 18:06:25,636][177158] DAMAGECOUNT value on done: 50918.0 [2023-02-24 18:06:25,637][177158] Sum rewards: 6.764, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.213', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.029', 'WEAPON1': '0.050', 'AMMO3': '0.100', 'weapon5': '0.108', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.334', 'HITCOUNT': '0.470', 'WEAPON3': '0.600', 'weapon3': '1.516', 'weapon2': '1.792', 'DAMAGECOUNT': '2.310', 'FRAGCOUNT': '6.000'} [2023-02-24 18:06:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13981.9). Total num frames: 36511744. Throughput: 0: 3502.3. Samples: 9125522. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:06:26,376][177119] Avg episode reward: [(0, '3.578')] [2023-02-24 18:06:26,540][177158] DAMAGECOUNT value on done: 48762.0 [2023-02-24 18:06:26,541][177158] Sum rewards: 13.587, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.920', 'AMMO5': '0.010', 'AMMO2': '0.010', 'WEAPON1': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.104', 'weapon5': '0.164', 'WEAPON5': '0.250', 'HITCOUNT': '0.640', 'WEAPON3': '0.650', 'weapon3': '1.454', 'weapon2': '2.138', 'DAMAGECOUNT': '2.985', 'FRAGCOUNT': '12.000'} [2023-02-24 18:06:26,838][177158] DAMAGECOUNT value on done: 53174.0 [2023-02-24 18:06:26,838][177158] Sum rewards: 2.231, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.890', 'AMMO5': '0.017', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'WEAPON1': '0.080', 'AMMO4': '0.098', 'weapon4': '0.130', 'AMMO3': '0.134', 'weapon5': '0.212', 'WEAPON5': '0.450', 'HITCOUNT': '0.700', 'weapon2': '0.802', 'WEAPON3': '0.900', 'weapon3': '2.402', 'DAMAGECOUNT': '2.877', 'FRAGCOUNT': '4.000'} [2023-02-24 18:06:26,876][177172] DAMAGECOUNT value on done: 51820.0 [2023-02-24 18:06:26,876][177172] Sum rewards: 7.836, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.852', 'AMMO5': '0.005', 'AMMO2': '0.014', 'ARMOR': '0.028', 'WEAPON1': '0.030', 'weapon7': '0.052', 'AMMO4': '0.069', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.128', 'weapon5': '0.148', 'WEAPON5': '0.150', 'weapon4': '0.344', 'HITCOUNT': '0.740', 'WEAPON3': '0.800', 'weapon2': '1.278', 'weapon3': '1.866', 'DAMAGECOUNT': '2.886', 'FRAGCOUNT': '8.000'} [2023-02-24 18:06:27,176][177172] DAMAGECOUNT value on done: 49634.0 [2023-02-24 18:06:27,177][177172] Sum rewards: 4.672, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.982', 'AMMO5': '0.025', 'AMMO2': '0.038', 'WEAPON1': '0.040', 'weapon5': '0.114', 'AMMO3': '0.186', 'AMMO4': '0.190', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.446', 'HITCOUNT': '0.510', 'ARMOR': '0.521', 'weapon2': '1.032', 'WEAPON3': '1.150', 'weapon3': '2.184', 'DAMAGECOUNT': '2.217', 'FRAGCOUNT': '7.000'} [2023-02-24 18:06:27,743][177154] DAMAGECOUNT value on done: 53442.0 [2023-02-24 18:06:27,743][177154] Sum rewards: 2.382, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.351', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.021', 'WEAPON1': '0.060', 'AMMO4': '0.105', 'weapon5': '0.126', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'weapon4': '0.246', 'WEAPON5': '0.400', 'HITCOUNT': '0.420', 'WEAPON3': '0.850', 'weapon2': '1.616', 'weapon3': '1.662', 'DAMAGECOUNT': '1.668', 'FRAGCOUNT': '6.000'} [2023-02-24 18:06:28,036][177153] Updated weights for policy 0, policy_version 8920 (0.0008) [2023-02-24 18:06:28,054][177154] DAMAGECOUNT value on done: 52207.0 [2023-02-24 18:06:28,054][177154] Sum rewards: 8.923, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.620', 'ARMOR': '0.008', 'AMMO5': '0.028', 'AMMO2': '0.031', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON1': '0.120', 'AMMO3': '0.150', 'AMMO4': '0.154', 'weapon5': '0.232', 'WEAPON4': '0.300', 'weapon4': '0.584', 'WEAPON5': '0.600', 'HITCOUNT': '0.770', 'weapon2': '0.842', 'WEAPON3': '0.950', 'weapon3': '1.814', 'DAMAGECOUNT': '4.611', 'FRAGCOUNT': '11.000'} [2023-02-24 18:06:28,073][177172] DAMAGECOUNT value on done: 50150.0 [2023-02-24 18:06:28,073][177172] Sum rewards: 4.785, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.693', 'AMMO2': '0.014', 'AMMO5': '0.015', 'ARMOR': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'AMMO3': '0.154', 'weapon5': '0.158', 'WEAPON5': '0.350', 'weapon4': '0.380', 'HITCOUNT': '0.470', 'WEAPON3': '0.750', 'weapon2': '1.570', 'weapon3': '1.636', 'DAMAGECOUNT': '2.010', 'FRAGCOUNT': '6.000'} [2023-02-24 18:06:28,138][177154] DAMAGECOUNT value on done: 52275.0 [2023-02-24 18:06:28,139][177154] Sum rewards: 4.077, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.330', 'AMMO5': '0.012', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'AMMO3': '0.050', 'AMMO4': '0.094', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.300', 'WEAPON3': '0.350', 'weapon4': '0.416', 'DAMAGECOUNT': '1.029', 'weapon3': '1.256', 'weapon2': '1.732', 'FRAGCOUNT': '3.000'} [2023-02-24 18:06:28,371][177172] DAMAGECOUNT value on done: 51009.0 [2023-02-24 18:06:28,372][177172] Sum rewards: 6.594, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.806', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'ARMOR': '0.032', 'weapon7': '0.054', 'AMMO3': '0.101', 'AMMO4': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.184', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.374', 'WEAPON3': '0.700', 'HITCOUNT': '0.730', 'weapon2': '1.454', 'weapon3': '1.748', 'DAMAGECOUNT': '3.231', 'FRAGCOUNT': '7.000'} [2023-02-24 18:06:28,439][177154] DAMAGECOUNT value on done: 51845.0 [2023-02-24 18:06:28,440][177154] Sum rewards: 13.790, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.134', 'AMMO5': '0.012', 'ARMOR': '0.024', 'AMMO2': '0.031', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'weapon5': '0.142', 'weapon4': '0.150', 'AMMO4': '0.155', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'HITCOUNT': '0.900', 'weapon2': '1.684', 'weapon3': '1.754', 'DAMAGECOUNT': '3.819', 'FRAGCOUNT': '11.500'} [2023-02-24 18:06:28,881][177157] DAMAGECOUNT value on done: 53935.0 [2023-02-24 18:06:28,881][177157] Sum rewards: 0.621, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.179', 'AMMO5': '0.013', 'AMMO2': '0.033', 'WEAPON1': '0.040', 'ARMOR': '0.072', 'AMMO3': '0.090', 'weapon5': '0.106', 'AMMO4': '0.163', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'HITCOUNT': '0.480', 'WEAPON3': '0.600', 'weapon4': '0.626', 'weapon2': '1.332', 'DAMAGECOUNT': '1.608', 'weapon3': '1.636', 'FRAGCOUNT': '5.000'} [2023-02-24 18:06:28,892][177157] DAMAGECOUNT value on done: 56540.0 [2023-02-24 18:06:28,893][177157] Sum rewards: 9.621, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.148', 'AMMO2': '0.009', 'AMMO5': '0.017', 'ARMOR': '0.036', 'AMMO4': '0.046', 'weapon7': '0.046', 'weapon5': '0.056', 'WEAPON1': '0.060', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'weapon4': '0.588', 'WEAPON3': '0.700', 'HITCOUNT': '0.770', 'weapon2': '1.438', 'weapon3': '1.592', 'DAMAGECOUNT': '3.567', 'FRAGCOUNT': '9.000'} [2023-02-24 18:06:29,084][177171] DAMAGECOUNT value on done: 51636.0 [2023-02-24 18:06:29,084][177171] Sum rewards: 8.300, reward structure: {'DEATHCOUNT': '-6.000', 'ARMOR': '0.004', 'HEALTH': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'AMMO3': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.156', 'AMMO4': '0.176', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.460', 'weapon4': '0.522', 'weapon3': '1.242', 'weapon2': '1.838', 'DAMAGECOUNT': '2.037', 'FRAGCOUNT': '7.000'} [2023-02-24 18:06:29,187][177157] DAMAGECOUNT value on done: 48440.0 [2023-02-24 18:06:29,187][177157] Sum rewards: 3.512, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.680', 'AMMO5': '0.014', 'AMMO2': '0.018', 'ARMOR': '0.020', 'WEAPON1': '0.050', 'weapon7': '0.056', 'AMMO4': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.230', 'WEAPON5': '0.300', 'weapon4': '0.366', 'HITCOUNT': '0.680', 'WEAPON3': '1.000', 'weapon2': '1.126', 'weapon3': '1.928', 'DAMAGECOUNT': '2.493', 'FRAGCOUNT': '8.000'} [2023-02-24 18:06:29,196][177157] DAMAGECOUNT value on done: 51650.0 [2023-02-24 18:06:29,196][177157] Sum rewards: 3.158, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.533', 'AMMO2': '0.024', 'ARMOR': '0.059', 'AMMO3': '0.080', 'AMMO4': '0.122', 'WEAPON4': '0.250', 'HITCOUNT': '0.510', 'WEAPON3': '0.550', 'weapon4': '0.684', 'weapon2': '1.400', 'weapon3': '1.712', 'DAMAGECOUNT': '1.800', 'FRAGCOUNT': '4.000'} [2023-02-24 18:06:29,376][177171] DAMAGECOUNT value on done: 49705.0 [2023-02-24 18:06:29,377][177171] Sum rewards: 0.162, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.812', 'AMMO5': '0.025', 'AMMO2': '0.034', 'WEAPON1': '0.050', 'AMMO3': '0.127', 'weapon7': '0.156', 'weapon5': '0.166', 'AMMO4': '0.172', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HITCOUNT': '0.230', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'ARMOR': '0.495', 'WEAPON3': '0.650', 'weapon4': '0.916', 'weapon3': '1.008', 'weapon2': '1.496', 'DAMAGECOUNT': '1.509', 'FRAGCOUNT': '4.000'} [2023-02-24 18:06:29,664][177171] DAMAGECOUNT value on done: 51702.0 [2023-02-24 18:06:29,665][177171] Sum rewards: 13.670, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.570', 'AMMO5': '0.005', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.041', 'AMMO3': '0.064', 'weapon7': '0.064', 'WEAPON5': '0.100', 'weapon5': '0.124', 'AMMO4': '0.206', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.410', 'WEAPON3': '0.450', 'HITCOUNT': '0.870', 'weapon3': '1.384', 'weapon2': '1.758', 'DAMAGECOUNT': '3.228', 'FRAGCOUNT': '11.000'} [2023-02-24 18:06:29,864][177155] DAMAGECOUNT value on done: 53546.0 [2023-02-24 18:06:29,864][177155] Sum rewards: 6.977, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.027', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO3': '0.050', 'WEAPON1': '0.070', 'AMMO4': '0.148', 'WEAPON4': '0.250', 'weapon5': '0.308', 'WEAPON3': '0.400', 'WEAPON5': '0.450', 'HITCOUNT': '0.520', 'weapon4': '0.632', 'weapon2': '0.764', 'weapon3': '1.156', 'DAMAGECOUNT': '2.211', 'FRAGCOUNT': '7.000'} [2023-02-24 18:06:29,961][177171] DAMAGECOUNT value on done: 50713.0 [2023-02-24 18:06:29,962][177171] Sum rewards: 4.958, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.007', 'AMMO5': '0.017', 'AMMO4': '0.036', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.068', 'weapon7': '0.106', 'AMMO3': '0.119', 'weapon5': '0.124', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.540', 'HEALTH': '0.557', 'WEAPON3': '0.650', 'weapon2': '1.614', 'weapon3': '1.850', 'DAMAGECOUNT': '2.529', 'FRAGCOUNT': '4.000'} [2023-02-24 18:06:30,159][177155] DAMAGECOUNT value on done: 55060.0 [2023-02-24 18:06:30,160][177155] Sum rewards: 4.387, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.238', 'AMMO2': '0.013', 'AMMO5': '0.023', 'weapon7': '0.052', 'AMMO4': '0.063', 'WEAPON1': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.134', 'WEAPON4': '0.150', 'weapon4': '0.186', 'weapon5': '0.188', 'WEAPON7': '0.200', 'WEAPON5': '0.600', 'HITCOUNT': '0.670', 'WEAPON3': '0.950', 'weapon2': '1.406', 'weapon3': '1.874', 'DAMAGECOUNT': '2.775', 'FRAGCOUNT': '6.000'} [2023-02-24 18:06:30,163][177172] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:06:30,392][177155] DAMAGECOUNT value on done: 56374.0 [2023-02-24 18:06:30,392][177155] Sum rewards: 8.407, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.234', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.026', 'WEAPON1': '0.070', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'AMMO4': '0.130', 'weapon4': '0.212', 'weapon5': '0.338', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '0.660', 'weapon2': '1.084', 'weapon3': '1.846', 'DAMAGECOUNT': '2.970', 'FRAGCOUNT': '7.000'} [2023-02-24 18:06:30,677][177155] DAMAGECOUNT value on done: 50328.0 [2023-02-24 18:06:30,678][177155] Sum rewards: 5.589, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.772', 'AMMO5': '0.017', 'AMMO2': '0.033', 'ARMOR': '0.036', 'AMMO3': '0.067', 'WEAPON1': '0.070', 'weapon7': '0.102', 'WEAPON4': '0.150', 'AMMO4': '0.162', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.242', 'HITCOUNT': '0.260', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.732', 'weapon2': '1.186', 'weapon3': '1.366', 'DAMAGECOUNT': '1.497', 'FRAGCOUNT': '4.000'} [2023-02-24 18:06:30,946][177153] Updated weights for policy 0, policy_version 8930 (0.0008) [2023-02-24 18:06:31,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 13981.9). Total num frames: 36581376. Throughput: 0: 3499.5. Samples: 9146546. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:06:31,376][177119] Avg episode reward: [(0, '4.381')] [2023-02-24 18:06:33,854][177153] Updated weights for policy 0, policy_version 8940 (0.0008) [2023-02-24 18:06:34,970][177156] DAMAGECOUNT value on done: 54256.0 [2023-02-24 18:06:34,971][177156] Sum rewards: 5.964, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.640', 'AMMO5': '0.007', 'AMMO2': '0.009', 'ARMOR': '0.013', 'AMMO3': '0.040', 'AMMO4': '0.046', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'weapon5': '0.160', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'weapon4': '0.350', 'HITCOUNT': '0.450', 'weapon3': '0.982', 'DAMAGECOUNT': '1.728', 'weapon2': '2.318', 'FRAGCOUNT': '6.000'} [2023-02-24 18:06:35,048][177156] DAMAGECOUNT value on done: 50791.0 [2023-02-24 18:06:35,048][177156] Sum rewards: -0.648, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.195', 'AMMO5': '0.012', 'AMMO2': '0.036', 'WEAPON1': '0.040', 'weapon7': '0.056', 'AMMO3': '0.062', 'AMMO4': '0.182', 'weapon5': '0.188', 'HITCOUNT': '0.190', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.702', 'weapon3': '1.072', 'weapon2': '1.128', 'weapon4': '1.138', 'FRAGCOUNT': '2.000'} [2023-02-24 18:06:35,290][177156] DAMAGECOUNT value on done: 55184.0 [2023-02-24 18:06:35,291][177156] Sum rewards: 2.143, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.104', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.025', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.151', 'weapon5': '0.174', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.440', 'WEAPON3': '0.900', 'weapon2': '1.428', 'DAMAGECOUNT': '1.500', 'weapon3': '2.076', 'FRAGCOUNT': '4.000'} [2023-02-24 18:06:35,349][177156] DAMAGECOUNT value on done: 53973.0 [2023-02-24 18:06:35,349][177156] Sum rewards: 6.445, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.708', 'AMMO2': '0.018', 'AMMO5': '0.018', 'WEAPON1': '0.060', 'AMMO3': '0.080', 'AMMO4': '0.088', 'WEAPON4': '0.200', 'weapon5': '0.300', 'weapon4': '0.434', 'HITCOUNT': '0.470', 'ARMOR': '0.483', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon2': '1.382', 'weapon3': '1.506', 'DAMAGECOUNT': '2.514', 'FRAGCOUNT': '7.000'} [2023-02-24 18:06:36,002][177158] Large shaping reward 2.594 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5640000000000001, 188.0)] [2023-02-24 18:06:36,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 13981.9). Total num frames: 36651008. Throughput: 0: 3502.1. Samples: 9157166. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:06:36,376][177119] Avg episode reward: [(0, '4.331')] [2023-02-24 18:06:36,787][177153] Updated weights for policy 0, policy_version 8950 (0.0008) [2023-02-24 18:06:39,708][177153] Updated weights for policy 0, policy_version 8960 (0.0009) [2023-02-24 18:06:40,242][177158] Large shaping reward 3.642 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:06:41,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 13981.9). Total num frames: 36720640. Throughput: 0: 3501.6. Samples: 9178134. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:06:41,376][177119] Avg episode reward: [(0, '4.331')] [2023-02-24 18:06:42,640][177153] Updated weights for policy 0, policy_version 8970 (0.0008) [2023-02-24 18:06:43,670][177170] DAMAGECOUNT value on done: 53901.0 [2023-02-24 18:06:43,671][177170] Sum rewards: 6.454, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.649', 'AMMO2': '0.009', 'AMMO5': '0.015', 'ARMOR': '0.040', 'AMMO4': '0.043', 'WEAPON1': '0.070', 'AMMO3': '0.101', 'WEAPON4': '0.200', 'weapon5': '0.202', 'WEAPON5': '0.350', 'HITCOUNT': '0.400', 'weapon4': '0.464', 'WEAPON3': '0.600', 'weapon3': '1.140', 'weapon2': '1.458', 'DAMAGECOUNT': '2.511', 'FRAGCOUNT': '7.000'} [2023-02-24 18:06:43,967][177170] DAMAGECOUNT value on done: 57092.0 [2023-02-24 18:06:43,968][177170] Sum rewards: 8.729, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.526', 'AMMO5': '0.005', 'AMMO2': '0.008', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.039', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'weapon4': '0.244', 'HITCOUNT': '0.680', 'WEAPON3': '0.700', 'weapon2': '1.394', 'weapon3': '2.054', 'DAMAGECOUNT': '2.475', 'FRAGCOUNT': '8.000'} [2023-02-24 18:06:44,007][177170] DAMAGECOUNT value on done: 47744.0 [2023-02-24 18:06:44,007][177170] Sum rewards: 2.222, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.014', 'ARMOR': '0.008', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO2': '0.041', 'AMMO3': '0.112', 'AMMO4': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon5': '0.354', 'HITCOUNT': '0.460', 'WEAPON3': '0.700', 'weapon4': '0.942', 'weapon2': '1.094', 'weapon3': '1.326', 'DAMAGECOUNT': '1.887', 'FRAGCOUNT': '6.000'} [2023-02-24 18:06:44,305][177170] DAMAGECOUNT value on done: 55715.0 [2023-02-24 18:06:44,306][177170] Sum rewards: -3.169, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.916', 'ARMOR': '0.016', 'AMMO5': '0.023', 'AMMO2': '0.027', 'weapon4': '0.112', 'WEAPON1': '0.130', 'AMMO4': '0.137', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'HITCOUNT': '0.280', 'weapon5': '0.342', 'WEAPON5': '0.550', 'weapon2': '0.866', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.485', 'weapon3': '2.170', 'FRAGCOUNT': '4.000'} [2023-02-24 18:06:44,477][177158] DAMAGECOUNT value on done: 50379.0 [2023-02-24 18:06:44,478][177158] Sum rewards: 6.446, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.686', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.031', 'WEAPON1': '0.060', 'weapon7': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.129', 'AMMO4': '0.154', 'weapon5': '0.170', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.512', 'HITCOUNT': '0.540', 'WEAPON3': '0.900', 'weapon2': '1.224', 'weapon3': '1.610', 'DAMAGECOUNT': '2.574', 'FRAGCOUNT': '8.000'} [2023-02-24 18:06:44,769][177158] DAMAGECOUNT value on done: 51273.0 [2023-02-24 18:06:44,770][177158] Sum rewards: -1.887, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.818', 'ARMOR': '0.012', 'AMMO5': '0.022', 'AMMO2': '0.052', 'WEAPON1': '0.080', 'weapon4': '0.140', 'AMMO3': '0.162', 'HITCOUNT': '0.220', 'WEAPON4': '0.250', 'AMMO4': '0.261', 'weapon5': '0.356', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.065', 'weapon2': '1.110', 'weapon3': '1.950', 'FRAGCOUNT': '4.000'} [2023-02-24 18:06:45,578][177153] Updated weights for policy 0, policy_version 8980 (0.0008) [2023-02-24 18:06:45,712][177158] DAMAGECOUNT value on done: 50208.0 [2023-02-24 18:06:45,712][177158] Sum rewards: 9.635, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.529', 'weapon5': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon7': '0.050', 'AMMO4': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.142', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.440', 'weapon4': '0.504', 'WEAPON3': '1.000', 'HITCOUNT': '1.020', 'weapon2': '1.216', 'weapon3': '2.010', 'DAMAGECOUNT': '4.137', 'FRAGCOUNT': '11.000'} [2023-02-24 18:06:46,005][177158] DAMAGECOUNT value on done: 53996.0 [2023-02-24 18:06:46,006][177158] Sum rewards: 6.171, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.660', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.076', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'weapon5': '0.120', 'WEAPON4': '0.150', 'HITCOUNT': '0.540', 'WEAPON3': '0.550', 'weapon4': '0.670', 'weapon3': '1.038', 'weapon2': '1.744', 'DAMAGECOUNT': '2.466', 'FRAGCOUNT': '6.000'} [2023-02-24 18:06:46,062][177172] DAMAGECOUNT value on done: 52095.0 [2023-02-24 18:06:46,062][177172] Sum rewards: 1.944, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.287', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.030', 'AMMO3': '0.045', 'WEAPON1': '0.060', 'weapon4': '0.098', 'WEAPON4': '0.150', 'AMMO4': '0.151', 'HITCOUNT': '0.220', 'WEAPON5': '0.300', 'weapon5': '0.342', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.825', 'weapon3': '0.866', 'FRAGCOUNT': '1.000', 'weapon2': '2.482'} [2023-02-24 18:06:46,359][177172] DAMAGECOUNT value on done: 50819.0 [2023-02-24 18:06:46,359][177172] Sum rewards: 12.674, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.296', 'AMMO5': '0.012', 'AMMO2': '0.029', 'ARMOR': '0.032', 'WEAPON1': '0.050', 'weapon7': '0.070', 'AMMO3': '0.122', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'weapon5': '0.200', 'AMMO6': '0.260', 'AMMO7': '0.260', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.610', 'weapon2': '0.620', 'weapon4': '0.680', 'WEAPON3': '0.700', 'weapon3': '1.860', 'DAMAGECOUNT': '3.468', 'FRAGCOUNT': '13.000'} [2023-02-24 18:06:46,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.6, 300 sec: 13981.9). Total num frames: 36790272. Throughput: 0: 3503.3. Samples: 9199178. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:06:46,376][177119] Avg episode reward: [(0, '4.427')] [2023-02-24 18:06:46,902][177154] DAMAGECOUNT value on done: 54499.0 [2023-02-24 18:06:46,902][177154] Sum rewards: 9.000, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.856', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.013', 'WEAPON1': '0.050', 'AMMO3': '0.120', 'weapon5': '0.342', 'WEAPON5': '0.350', 'HITCOUNT': '0.750', 'WEAPON3': '0.900', 'weapon2': '1.260', 'weapon3': '2.134', 'DAMAGECOUNT': '3.171', 'FRAGCOUNT': '10.000'} [2023-02-24 18:06:47,202][177154] DAMAGECOUNT value on done: 53021.0 [2023-02-24 18:06:47,203][177154] Sum rewards: 4.284, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.222', 'AMMO5': '0.020', 'AMMO2': '0.024', 'WEAPON4': '0.050', 'WEAPON1': '0.110', 'AMMO4': '0.117', 'weapon4': '0.134', 'AMMO3': '0.141', 'weapon5': '0.158', 'WEAPON5': '0.450', 'HITCOUNT': '0.690', 'WEAPON3': '0.900', 'weapon2': '1.466', 'weapon3': '1.804', 'DAMAGECOUNT': '2.442', 'FRAGCOUNT': '6.000'} [2023-02-24 18:06:47,241][177154] DAMAGECOUNT value on done: 52924.0 [2023-02-24 18:06:47,241][177172] DAMAGECOUNT value on done: 50801.0 [2023-02-24 18:06:47,242][177154] Sum rewards: 2.908, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.166', 'AMMO5': '0.010', 'AMMO2': '0.033', 'WEAPON1': '0.070', 'AMMO3': '0.104', 'AMMO4': '0.167', 'WEAPON4': '0.200', 'weapon5': '0.234', 'HITCOUNT': '0.240', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon4': '0.618', 'WEAPON3': '0.700', 'weapon2': '1.246', 'weapon3': '1.504', 'DAMAGECOUNT': '1.947', 'FRAGCOUNT': '6.000'} [2023-02-24 18:06:47,242][177172] Sum rewards: 0.873, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.981', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.040', 'weapon7': '0.058', 'AMMO4': '0.066', 'AMMO3': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.134', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.364', 'HITCOUNT': '0.410', 'WEAPON3': '0.750', 'weapon2': '1.606', 'weapon3': '1.642', 'DAMAGECOUNT': '1.953', 'FRAGCOUNT': '3.000'} [2023-02-24 18:06:47,537][177172] DAMAGECOUNT value on done: 51414.0 [2023-02-24 18:06:47,537][177172] Sum rewards: 0.097, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.698', 'AMMO5': '0.010', 'AMMO2': '0.022', 'WEAPON1': '0.050', 'AMMO4': '0.109', 'AMMO3': '0.124', 'WEAPON5': '0.250', 'HITCOUNT': '0.270', 'weapon5': '0.296', 'WEAPON4': '0.300', 'ARMOR': '0.459', 'weapon4': '0.554', 'WEAPON3': '0.850', 'weapon2': '1.174', 'DAMAGECOUNT': '1.215', 'weapon3': '1.612', 'FRAGCOUNT': '2.000'} [2023-02-24 18:06:47,545][177154] DAMAGECOUNT value on done: 52605.0 [2023-02-24 18:06:47,546][177154] Sum rewards: 6.772, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.464', 'AMMO5': '0.010', 'AMMO2': '0.033', 'ARMOR': '0.036', 'WEAPON1': '0.040', 'AMMO3': '0.069', 'AMMO4': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.268', 'HITCOUNT': '0.410', 'WEAPON3': '0.450', 'weapon4': '0.718', 'weapon3': '1.084', 'weapon2': '1.472', 'DAMAGECOUNT': '2.280', 'FRAGCOUNT': '5.000'} [2023-02-24 18:06:48,058][177157] DAMAGECOUNT value on done: 56940.0 [2023-02-24 18:06:48,058][177157] Sum rewards: 2.086, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.950', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO3': '0.098', 'AMMO4': '0.154', 'HITCOUNT': '0.280', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'weapon3': '0.834', 'weapon4': '0.916', 'DAMAGECOUNT': '1.200', 'weapon2': '1.624', 'FRAGCOUNT': '3.000'} [2023-02-24 18:06:48,078][177157] DAMAGECOUNT value on done: 54372.0 [2023-02-24 18:06:48,079][177157] Sum rewards: 5.662, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.421', 'AMMO2': '0.002', 'AMMO5': '0.010', 'AMMO4': '0.012', 'weapon4': '0.022', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'weapon7': '0.060', 'AMMO3': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.208', 'HITCOUNT': '0.290', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.311', 'weapon3': '1.362', 'weapon2': '1.890', 'FRAGCOUNT': '4.000'} [2023-02-24 18:06:48,224][177171] DAMAGECOUNT value on done: 52436.0 [2023-02-24 18:06:48,224][177171] Sum rewards: 8.690, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.952', 'AMMO5': '0.012', 'ARMOR': '0.028', 'AMMO2': '0.028', 'WEAPON1': '0.050', 'AMMO3': '0.088', 'AMMO4': '0.141', 'weapon5': '0.216', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.620', 'HITCOUNT': '0.640', 'WEAPON3': '0.650', 'weapon2': '1.008', 'weapon3': '1.660', 'DAMAGECOUNT': '2.400', 'FRAGCOUNT': '9.000'} [2023-02-24 18:06:48,369][177157] DAMAGECOUNT value on done: 52844.0 [2023-02-24 18:06:48,370][177157] Sum rewards: 7.129, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.870', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.046', 'WEAPON1': '0.050', 'weapon5': '0.054', 'AMMO3': '0.174', 'weapon4': '0.188', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.930', 'weapon2': '1.032', 'WEAPON3': '1.200', 'weapon3': '2.346', 'DAMAGECOUNT': '3.582', 'FRAGCOUNT': '11.000'} [2023-02-24 18:06:48,392][177157] DAMAGECOUNT value on done: 49107.0 [2023-02-24 18:06:48,392][177157] Sum rewards: 3.330, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.014', 'AMMO5': '0.015', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.072', 'AMMO3': '0.100', 'weapon4': '0.100', 'weapon5': '0.250', 'WEAPON5': '0.350', 'HEALTH': '0.370', 'WEAPON3': '0.500', 'HITCOUNT': '0.550', 'weapon2': '0.852', 'DAMAGECOUNT': '2.001', 'weapon3': '2.296', 'FRAGCOUNT': '4.000'} [2023-02-24 18:06:48,517][177153] Updated weights for policy 0, policy_version 8990 (0.0009) [2023-02-24 18:06:48,522][177171] DAMAGECOUNT value on done: 50517.0 [2023-02-24 18:06:48,522][177171] Sum rewards: 5.818, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.030', 'AMMO5': '0.015', 'AMMO2': '0.027', 'WEAPON1': '0.070', 'AMMO3': '0.106', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'weapon5': '0.204', 'weapon4': '0.374', 'WEAPON5': '0.400', 'ARMOR': '0.408', 'HITCOUNT': '0.480', 'WEAPON3': '0.700', 'weapon3': '1.322', 'weapon2': '1.770', 'DAMAGECOUNT': '2.436', 'FRAGCOUNT': '5.000'} [2023-02-24 18:06:48,811][177171] DAMAGECOUNT value on done: 52859.0 [2023-02-24 18:06:48,811][177171] Sum rewards: 10.279, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.200', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.121', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.493', 'weapon4': '0.566', 'WEAPON3': '0.750', 'HITCOUNT': '0.770', 'weapon2': '0.900', 'weapon3': '2.120', 'DAMAGECOUNT': '3.471', 'FRAGCOUNT': '10.000'} [2023-02-24 18:06:48,970][177155] DAMAGECOUNT value on done: 54351.0 [2023-02-24 18:06:48,970][177155] Sum rewards: 7.956, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.714', 'AMMO5': '0.003', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'AMMO3': '0.163', 'weapon4': '0.302', 'HITCOUNT': '0.740', 'WEAPON3': '1.000', 'weapon2': '1.380', 'weapon3': '2.072', 'DAMAGECOUNT': '2.415', 'FRAGCOUNT': '11.000'} [2023-02-24 18:06:49,109][177171] DAMAGECOUNT value on done: 51049.0 [2023-02-24 18:06:49,109][177171] Sum rewards: 1.658, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.788', 'AMMO5': '0.017', 'AMMO2': '0.023', 'WEAPON1': '0.070', 'AMMO3': '0.104', 'AMMO4': '0.116', 'weapon4': '0.124', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'weapon5': '0.180', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.008', 'weapon2': '1.368', 'weapon3': '1.926', 'FRAGCOUNT': '3.000'} [2023-02-24 18:06:49,267][177155] DAMAGECOUNT value on done: 55703.0 [2023-02-24 18:06:49,267][177155] Sum rewards: 2.058, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.020', 'AMMO2': '0.022', 'HEALTH': '0.032', 'WEAPON4': '0.050', 'WEAPON1': '0.090', 'AMMO4': '0.108', 'AMMO3': '0.145', 'weapon4': '0.230', 'weapon5': '0.380', 'WEAPON5': '0.500', 'HITCOUNT': '0.550', 'weapon2': '0.748', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.929', 'weapon3': '2.104', 'FRAGCOUNT': '4.000'} [2023-02-24 18:06:49,557][177155] DAMAGECOUNT value on done: 56883.0 [2023-02-24 18:06:49,558][177155] Sum rewards: 0.214, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.676', 'AMMO5': '0.007', 'AMMO2': '0.055', 'WEAPON1': '0.060', 'weapon5': '0.072', 'AMMO3': '0.123', 'WEAPON5': '0.200', 'AMMO4': '0.275', 'WEAPON4': '0.300', 'HITCOUNT': '0.340', 'ARMOR': '0.400', 'weapon4': '0.550', 'WEAPON3': '0.850', 'weapon3': '1.336', 'DAMAGECOUNT': '1.527', 'weapon2': '1.794', 'FRAGCOUNT': '3.000'} [2023-02-24 18:06:49,850][177155] DAMAGECOUNT value on done: 50889.0 [2023-02-24 18:06:49,851][177155] Sum rewards: -1.450, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.232', 'AMMO5': '0.020', 'ARMOR': '0.048', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO2': '0.064', 'weapon5': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.147', 'AMMO4': '0.322', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'HITCOUNT': '0.470', 'weapon2': '0.818', 'weapon4': '0.898', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.683', 'weapon3': '1.838', 'FRAGCOUNT': '4.000'} [2023-02-24 18:06:51,376][177119] Fps is (10 sec: 13926.2, 60 sec: 13994.6, 300 sec: 13981.9). Total num frames: 36859904. Throughput: 0: 3503.6. Samples: 9209644. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:06:51,377][177119] Avg episode reward: [(0, '4.828')] [2023-02-24 18:06:51,378][177140] Saving new best policy, reward=4.828! [2023-02-24 18:06:51,472][177153] Updated weights for policy 0, policy_version 9000 (0.0008) [2023-02-24 18:06:54,239][177156] DAMAGECOUNT value on done: 51526.0 [2023-02-24 18:06:54,239][177156] Sum rewards: 6.061, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.323', 'AMMO5': '0.022', 'AMMO2': '0.034', 'WEAPON1': '0.060', 'AMMO3': '0.138', 'AMMO4': '0.172', 'WEAPON4': '0.200', 'weapon5': '0.218', 'weapon4': '0.300', 'WEAPON5': '0.500', 'HITCOUNT': '0.570', 'WEAPON3': '0.900', 'weapon2': '0.978', 'weapon3': '2.086', 'DAMAGECOUNT': '2.205', 'FRAGCOUNT': '8.000'} [2023-02-24 18:06:54,250][177156] DAMAGECOUNT value on done: 54486.0 [2023-02-24 18:06:54,250][177156] Sum rewards: -2.956, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.470', 'ARMOR': '0.012', 'AMMO5': '0.014', 'AMMO2': '0.030', 'WEAPON1': '0.050', 'weapon7': '0.052', 'weapon5': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.129', 'AMMO4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.230', 'WEAPON5': '0.300', 'weapon2': '0.434', 'WEAPON4': '0.450', 'DAMAGECOUNT': '0.690', 'weapon4': '0.746', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.844'} [2023-02-24 18:06:54,351][177153] Updated weights for policy 0, policy_version 9010 (0.0008) [2023-02-24 18:06:54,541][177156] DAMAGECOUNT value on done: 54339.0 [2023-02-24 18:06:54,542][177156] Sum rewards: 2.295, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.741', 'AMMO5': '0.010', 'AMMO2': '0.029', 'WEAPON1': '0.050', 'weapon7': '0.052', 'AMMO3': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.326', 'weapon5': '0.392', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.098', 'weapon2': '1.370', 'weapon3': '1.536', 'FRAGCOUNT': '3.000'} [2023-02-24 18:06:54,552][177156] DAMAGECOUNT value on done: 55527.0 [2023-02-24 18:06:54,553][177156] Sum rewards: 1.200, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.340', 'AMMO5': '0.012', 'AMMO2': '0.028', 'ARMOR': '0.040', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.137', 'weapon5': '0.172', 'HITCOUNT': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.318', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.029', 'weapon3': '1.552', 'weapon2': '1.682', 'FRAGCOUNT': '2.000'} [2023-02-24 18:06:56,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13981.9). Total num frames: 36929536. Throughput: 0: 3501.9. Samples: 9230602. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:06:56,376][177119] Avg episode reward: [(0, '4.830')] [2023-02-24 18:06:56,404][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000009017_36933632.pth... [2023-02-24 18:06:56,466][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000008196_33570816.pth [2023-02-24 18:06:56,473][177140] Saving new best policy, reward=4.830! [2023-02-24 18:06:57,296][177153] Updated weights for policy 0, policy_version 9020 (0.0009) [2023-02-24 18:07:00,212][177153] Updated weights for policy 0, policy_version 9030 (0.0008) [2023-02-24 18:07:01,376][177119] Fps is (10 sec: 14336.2, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 37003264. Throughput: 0: 3502.8. Samples: 9251644. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:07:01,376][177119] Avg episode reward: [(0, '4.830')] [2023-02-24 18:07:02,862][177170] DAMAGECOUNT value on done: 54455.0 [2023-02-24 18:07:02,863][177170] Sum rewards: 4.868, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.778', 'ARMOR': '0.008', 'AMMO2': '0.010', 'AMMO5': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'WEAPON1': '0.080', 'AMMO3': '0.089', 'HITCOUNT': '0.240', 'weapon5': '0.254', 'weapon4': '0.266', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.482', 'weapon3': '1.638', 'DAMAGECOUNT': '1.662', 'FRAGCOUNT': '4.000'} [2023-02-24 18:07:03,127][177153] Updated weights for policy 0, policy_version 9040 (0.0007) [2023-02-24 18:07:03,158][177170] DAMAGECOUNT value on done: 57543.0 [2023-02-24 18:07:03,159][177170] Sum rewards: 1.886, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.116', 'AMMO5': '0.014', 'ARMOR': '0.020', 'AMMO2': '0.026', 'WEAPON1': '0.070', 'AMMO3': '0.091', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'weapon4': '0.270', 'weapon5': '0.312', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'weapon2': '0.962', 'DAMAGECOUNT': '1.353', 'weapon3': '1.956', 'FRAGCOUNT': '3.000'} [2023-02-24 18:07:03,231][177170] DAMAGECOUNT value on done: 48767.0 [2023-02-24 18:07:03,231][177170] Sum rewards: 11.109, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.212', 'AMMO2': '0.015', 'AMMO5': '0.022', 'AMMO4': '0.076', 'WEAPON1': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.132', 'weapon4': '0.342', 'weapon5': '0.378', 'weapon2': '0.382', 'WEAPON5': '0.500', 'HITCOUNT': '0.540', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'weapon3': '1.924', 'DAMAGECOUNT': '3.069', 'FRAGCOUNT': '9.000'} [2023-02-24 18:07:03,521][177170] DAMAGECOUNT value on done: 56655.0 [2023-02-24 18:07:03,521][177170] Sum rewards: 6.717, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.618', 'ARMOR': '0.008', 'AMMO2': '0.020', 'AMMO5': '0.025', 'WEAPON4': '0.050', 'WEAPON1': '0.080', 'AMMO4': '0.101', 'AMMO3': '0.137', 'weapon4': '0.162', 'weapon5': '0.204', 'WEAPON5': '0.550', 'HITCOUNT': '0.760', 'WEAPON3': '0.850', 'weapon2': '1.600', 'weapon3': '1.718', 'DAMAGECOUNT': '2.820', 'FRAGCOUNT': '8.000'} [2023-02-24 18:07:03,610][177158] DAMAGECOUNT value on done: 51243.0 [2023-02-24 18:07:03,611][177158] Sum rewards: 3.858, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.161', 'AMMO5': '0.017', 'AMMO2': '0.036', 'WEAPON1': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.136', 'weapon7': '0.154', 'AMMO4': '0.178', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.424', 'ARMOR': '0.460', 'weapon5': '0.476', 'HITCOUNT': '0.500', 'weapon2': '0.690', 'WEAPON3': '1.000', 'weapon3': '1.946', 'DAMAGECOUNT': '2.592', 'FRAGCOUNT': '4.500'} [2023-02-24 18:07:03,907][177158] DAMAGECOUNT value on done: 51908.0 [2023-02-24 18:07:03,907][177158] Sum rewards: 5.245, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.760', 'AMMO2': '0.004', 'AMMO5': '0.010', 'ARMOR': '0.017', 'AMMO4': '0.021', 'WEAPON1': '0.030', 'AMMO3': '0.052', 'weapon7': '0.056', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.272', 'HITCOUNT': '0.330', 'WEAPON3': '0.400', 'weapon4': '0.700', 'weapon2': '0.784', 'weapon3': '0.984', 'DAMAGECOUNT': '1.905', 'FRAGCOUNT': '4.000'} [2023-02-24 18:07:04,969][177158] DAMAGECOUNT value on done: 50927.0 [2023-02-24 18:07:04,969][177158] Sum rewards: 4.926, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.496', 'AMMO5': '0.015', 'AMMO2': '0.046', 'WEAPON1': '0.050', 'ARMOR': '0.064', 'AMMO3': '0.144', 'weapon5': '0.170', 'AMMO4': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.550', 'weapon4': '0.588', 'WEAPON3': '0.950', 'weapon2': '1.148', 'weapon3': '1.662', 'DAMAGECOUNT': '2.157', 'FRAGCOUNT': '7.000'} [2023-02-24 18:07:05,274][177172] DAMAGECOUNT value on done: 52404.0 [2023-02-24 18:07:05,275][177172] Sum rewards: 0.676, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.826', 'AMMO5': '0.016', 'ARMOR': '0.032', 'AMMO2': '0.036', 'weapon7': '0.056', 'WEAPON1': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.137', 'AMMO4': '0.182', 'weapon5': '0.186', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'weapon4': '0.408', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.927', 'weapon2': '1.326', 'weapon3': '1.464', 'FRAGCOUNT': '3.000'} [2023-02-24 18:07:05,276][177158] DAMAGECOUNT value on done: 54818.0 [2023-02-24 18:07:05,277][177158] Sum rewards: 7.200, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.618', 'ARMOR': '0.012', 'AMMO2': '0.014', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.068', 'AMMO3': '0.121', 'WEAPON5': '0.250', 'weapon5': '0.264', 'HITCOUNT': '0.400', 'WEAPON3': '0.700', 'weapon2': '1.616', 'weapon3': '1.860', 'DAMAGECOUNT': '2.466', 'FRAGCOUNT': '6.000'} [2023-02-24 18:07:05,567][177172] DAMAGECOUNT value on done: 51672.0 [2023-02-24 18:07:05,567][177172] Sum rewards: 8.832, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.680', 'AMMO5': '0.015', 'AMMO2': '0.018', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.060', 'AMMO4': '0.092', 'weapon5': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.160', 'WEAPON5': '0.350', 'weapon4': '0.374', 'HITCOUNT': '0.640', 'WEAPON3': '0.950', 'weapon2': '1.190', 'weapon3': '1.856', 'DAMAGECOUNT': '2.559', 'FRAGCOUNT': '10.000'} [2023-02-24 18:07:06,051][177153] Updated weights for policy 0, policy_version 9050 (0.0008) [2023-02-24 18:07:06,101][177154] DAMAGECOUNT value on done: 55522.0 [2023-02-24 18:07:06,102][177154] Sum rewards: 16.115, reward structure: {'DEATHCOUNT': '-5.250', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.035', 'WEAPON1': '0.040', 'AMMO3': '0.078', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.173', 'WEAPON5': '0.300', 'weapon5': '0.326', 'weapon4': '0.440', 'WEAPON3': '0.450', 'HITCOUNT': '0.530', 'HEALTH': '0.710', 'weapon2': '1.162', 'weapon3': '1.582', 'DAMAGECOUNT': '3.069', 'FRAGCOUNT': '12.000'} [2023-02-24 18:07:06,376][177119] Fps is (10 sec: 14335.9, 60 sec: 13994.6, 300 sec: 13995.8). Total num frames: 37072896. Throughput: 0: 3501.8. Samples: 9262154. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:07:06,376][177119] Avg episode reward: [(0, '5.058')] [2023-02-24 18:07:06,381][177140] Saving new best policy, reward=5.058! [2023-02-24 18:07:06,381][177154] DAMAGECOUNT value on done: 53881.0 [2023-02-24 18:07:06,381][177154] Sum rewards: 11.401, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.522', 'AMMO5': '0.007', 'AMMO2': '0.027', 'WEAPON1': '0.040', 'weapon7': '0.052', 'AMMO3': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.135', 'weapon5': '0.166', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'weapon2': '0.604', 'weapon4': '0.620', 'HITCOUNT': '0.650', 'weapon3': '1.590', 'DAMAGECOUNT': '2.871', 'FRAGCOUNT': '9.000'} [2023-02-24 18:07:06,406][177154] DAMAGECOUNT value on done: 53364.0 [2023-02-24 18:07:06,407][177154] Sum rewards: 2.235, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.589', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'weapon5': '0.044', 'AMMO3': '0.055', 'AMMO4': '0.072', 'weapon7': '0.094', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.450', 'weapon2': '0.482', 'weapon4': '0.834', 'weapon3': '1.002', 'DAMAGECOUNT': '1.029', 'FRAGCOUNT': '2.000'} [2023-02-24 18:07:06,451][177172] DAMAGECOUNT value on done: 51828.0 [2023-02-24 18:07:06,452][177172] Sum rewards: 8.125, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.402', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.022', 'weapon7': '0.054', 'AMMO3': '0.104', 'WEAPON1': '0.110', 'AMMO4': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.156', 'weapon5': '0.196', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'HITCOUNT': '0.660', 'WEAPON3': '0.750', 'weapon2': '1.314', 'weapon3': '1.806', 'DAMAGECOUNT': '3.081', 'FRAGCOUNT': '9.000'} [2023-02-24 18:07:06,700][177154] DAMAGECOUNT value on done: 53111.0 [2023-02-24 18:07:06,700][177154] Sum rewards: 4.425, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.015', 'AMMO2': '0.017', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO4': '0.083', 'AMMO3': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.180', 'HITCOUNT': '0.220', 'HEALTH': '0.252', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'weapon2': '1.364', 'DAMAGECOUNT': '1.518', 'weapon3': '1.988', 'FRAGCOUNT': '3.500'} [2023-02-24 18:07:06,748][177172] DAMAGECOUNT value on done: 52210.0 [2023-02-24 18:07:06,748][177172] Sum rewards: 7.471, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.256', 'AMMO2': '0.005', 'AMMO5': '0.017', 'AMMO4': '0.027', 'WEAPON1': '0.080', 'AMMO3': '0.119', 'weapon5': '0.174', 'WEAPON5': '0.450', 'HITCOUNT': '0.560', 'WEAPON3': '0.900', 'weapon2': '1.318', 'weapon3': '2.188', 'DAMAGECOUNT': '2.388', 'FRAGCOUNT': '8.000'} [2023-02-24 18:07:07,307][177157] DAMAGECOUNT value on done: 55126.0 [2023-02-24 18:07:07,308][177157] Sum rewards: 5.027, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.262', 'AMMO2': '0.025', 'AMMO5': '0.037', 'weapon4': '0.056', 'WEAPON1': '0.110', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'weapon5': '0.200', 'HITCOUNT': '0.600', 'WEAPON5': '0.750', 'weapon2': '0.876', 'WEAPON3': '1.050', 'DAMAGECOUNT': '2.262', 'weapon3': '2.392', 'FRAGCOUNT': '8.000'} [2023-02-24 18:07:07,317][177157] DAMAGECOUNT value on done: 57422.0 [2023-02-24 18:07:07,317][177157] Sum rewards: 3.951, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.585', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.121', 'WEAPON5': '0.150', 'weapon5': '0.160', 'weapon4': '0.184', 'WEAPON4': '0.200', 'HITCOUNT': '0.390', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.446', 'weapon2': '1.512', 'weapon3': '1.822', 'FRAGCOUNT': '4.000'} [2023-02-24 18:07:07,452][177171] DAMAGECOUNT value on done: 53428.0 [2023-02-24 18:07:07,452][177171] Sum rewards: 9.947, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.013', 'ARMOR': '0.016', 'AMMO2': '0.030', 'HEALTH': '0.042', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.116', 'AMMO4': '0.151', 'WEAPON5': '0.250', 'weapon5': '0.280', 'weapon4': '0.410', 'HITCOUNT': '0.640', 'WEAPON3': '0.700', 'weapon2': '1.244', 'weapon3': '1.728', 'DAMAGECOUNT': '2.976', 'FRAGCOUNT': '8.000'} [2023-02-24 18:07:07,607][177157] DAMAGECOUNT value on done: 49684.0 [2023-02-24 18:07:07,607][177157] Sum rewards: 3.899, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.004', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon7': '0.046', 'WEAPON1': '0.050', 'AMMO4': '0.094', 'weapon5': '0.104', 'AMMO3': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'ARMOR': '0.459', 'weapon4': '0.492', 'HITCOUNT': '0.550', 'WEAPON3': '0.800', 'weapon2': '1.080', 'weapon3': '1.676', 'DAMAGECOUNT': '1.731', 'FRAGCOUNT': '6.000'} [2023-02-24 18:07:07,619][177157] DAMAGECOUNT value on done: 53485.0 [2023-02-24 18:07:07,620][177157] Sum rewards: 7.172, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.908', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.070', 'WEAPON1': '0.070', 'AMMO3': '0.074', 'weapon7': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.298', 'HITCOUNT': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'weapon3': '1.662', 'weapon2': '1.692', 'DAMAGECOUNT': '1.923', 'FRAGCOUNT': '5.000'} [2023-02-24 18:07:07,743][177171] DAMAGECOUNT value on done: 51165.0 [2023-02-24 18:07:07,743][177171] Sum rewards: 6.481, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.728', 'AMMO2': '0.022', 'AMMO5': '0.025', 'WEAPON1': '0.060', 'AMMO4': '0.112', 'weapon4': '0.114', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.176', 'HITCOUNT': '0.320', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'weapon2': '1.552', 'weapon3': '1.914', 'DAMAGECOUNT': '1.944', 'FRAGCOUNT': '7.000'} [2023-02-24 18:07:08,024][177171] DAMAGECOUNT value on done: 53316.0 [2023-02-24 18:07:08,024][177171] Sum rewards: 2.980, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.558', 'AMMO5': '0.008', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'AMMO3': '0.087', 'AMMO4': '0.097', 'weapon4': '0.102', 'WEAPON4': '0.150', 'weapon5': '0.164', 'WEAPON5': '0.200', 'HITCOUNT': '0.280', 'ARMOR': '0.478', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.371', 'weapon2': '1.704', 'weapon3': '1.738', 'FRAGCOUNT': '4.000'} [2023-02-24 18:07:08,156][177155] DAMAGECOUNT value on done: 55304.0 [2023-02-24 18:07:08,157][177155] Sum rewards: 9.953, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.070', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'weapon7': '0.070', 'AMMO4': '0.073', 'AMMO3': '0.085', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.218', 'WEAPON3': '0.550', 'HITCOUNT': '0.610', 'weapon3': '1.418', 'weapon2': '1.908', 'DAMAGECOUNT': '2.859', 'FRAGCOUNT': '9.000'} [2023-02-24 18:07:08,319][177171] DAMAGECOUNT value on done: 51437.0 [2023-02-24 18:07:08,319][177171] Sum rewards: 6.958, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.013', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'HEALTH': '0.080', 'weapon7': '0.110', 'AMMO4': '0.146', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.242', 'WEAPON4': '0.250', 'HITCOUNT': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'weapon4': '0.616', 'weapon3': '0.962', 'DAMAGECOUNT': '1.164', 'weapon2': '1.476', 'FRAGCOUNT': '5.000'} [2023-02-24 18:07:08,454][177155] DAMAGECOUNT value on done: 56173.0 [2023-02-24 18:07:08,455][177155] Sum rewards: 0.852, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.960', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'ARMOR': '0.040', 'AMMO3': '0.095', 'weapon7': '0.140', 'AMMO4': '0.145', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon5': '0.324', 'HITCOUNT': '0.350', 'WEAPON4': '0.400', 'WEAPON7': '0.400', 'weapon2': '0.512', 'WEAPON3': '0.600', 'weapon4': '1.154', 'weapon3': '1.254', 'DAMAGECOUNT': '1.410', 'FRAGCOUNT': '2.500'} [2023-02-24 18:07:08,752][177155] DAMAGECOUNT value on done: 57268.0 [2023-02-24 18:07:08,753][177155] Sum rewards: 3.801, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.542', 'ARMOR': '0.008', 'AMMO2': '0.009', 'AMMO5': '0.012', 'AMMO4': '0.044', 'WEAPON1': '0.050', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.220', 'HITCOUNT': '0.290', 'weapon4': '0.290', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.155', 'weapon2': '1.160', 'weapon3': '1.914', 'FRAGCOUNT': '4.000'} [2023-02-24 18:07:08,978][177153] Updated weights for policy 0, policy_version 9060 (0.0009) [2023-02-24 18:07:09,052][177155] DAMAGECOUNT value on done: 51388.0 [2023-02-24 18:07:09,052][177155] Sum rewards: 5.132, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.722', 'AMMO5': '0.010', 'AMMO2': '0.026', 'ARMOR': '0.036', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO3': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.130', 'weapon4': '0.158', 'weapon5': '0.164', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.230', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'weapon3': '1.474', 'DAMAGECOUNT': '1.497', 'weapon2': '1.772', 'FRAGCOUNT': '4.000'} [2023-02-24 18:07:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 37142528. Throughput: 0: 3503.8. Samples: 9283192. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:07:11,376][177119] Avg episode reward: [(0, '5.126')] [2023-02-24 18:07:11,377][177140] Saving new best policy, reward=5.126! [2023-02-24 18:07:11,927][177153] Updated weights for policy 0, policy_version 9070 (0.0009) [2023-02-24 18:07:13,435][177156] DAMAGECOUNT value on done: 52098.0 [2023-02-24 18:07:13,435][177156] Sum rewards: 1.290, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.428', 'AMMO5': '0.015', 'AMMO2': '0.020', 'WEAPON1': '0.070', 'AMMO4': '0.100', 'AMMO3': '0.112', 'weapon5': '0.218', 'weapon4': '0.224', 'WEAPON4': '0.300', 'HITCOUNT': '0.380', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'ARMOR': '0.917', 'weapon2': '1.518', 'DAMAGECOUNT': '1.716', 'weapon3': '1.728', 'FRAGCOUNT': '4.000'} [2023-02-24 18:07:13,446][177156] DAMAGECOUNT value on done: 55179.0 [2023-02-24 18:07:13,446][177156] Sum rewards: 7.224, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.896', 'AMMO5': '0.010', 'AMMO2': '0.023', 'WEAPON1': '0.050', 'AMMO4': '0.116', 'weapon5': '0.130', 'AMMO3': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.326', 'HITCOUNT': '0.480', 'WEAPON3': '0.800', 'weapon2': '1.622', 'weapon3': '1.652', 'DAMAGECOUNT': '2.079', 'FRAGCOUNT': '7.000'} [2023-02-24 18:07:13,741][177156] DAMAGECOUNT value on done: 54674.0 [2023-02-24 18:07:13,742][177156] Sum rewards: 4.022, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.590', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.048', 'weapon7': '0.050', 'AMMO3': '0.062', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.220', 'WEAPON3': '0.450', 'weapon4': '0.532', 'weapon3': '0.740', 'DAMAGECOUNT': '1.005', 'weapon2': '1.502', 'FRAGCOUNT': '3.000'} [2023-02-24 18:07:13,753][177156] DAMAGECOUNT value on done: 56512.0 [2023-02-24 18:07:13,754][177156] Sum rewards: 5.643, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.045', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO2': '0.030', 'weapon7': '0.050', 'AMMO3': '0.085', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.149', 'weapon5': '0.226', 'HITCOUNT': '0.440', 'WEAPON4': '0.450', 'WEAPON3': '0.500', 'WEAPON5': '0.550', 'weapon3': '0.876', 'weapon2': '0.924', 'weapon4': '0.938', 'DAMAGECOUNT': '2.367', 'FRAGCOUNT': '8.000'} [2023-02-24 18:07:14,839][177153] Updated weights for policy 0, policy_version 9080 (0.0008) [2023-02-24 18:07:16,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 37212160. Throughput: 0: 3503.6. Samples: 9304210. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:07:16,376][177119] Avg episode reward: [(0, '5.139')] [2023-02-24 18:07:16,379][177140] Saving new best policy, reward=5.139! [2023-02-24 18:07:17,770][177153] Updated weights for policy 0, policy_version 9090 (0.0008) [2023-02-24 18:07:20,672][177153] Updated weights for policy 0, policy_version 9100 (0.0008) [2023-02-24 18:07:20,933][177170] Large shaping reward 2.587 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.045, -15.0), ('weapon7', 0.002)] [2023-02-24 18:07:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 37281792. Throughput: 0: 3500.8. Samples: 9314702. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:07:21,376][177119] Avg episode reward: [(0, '5.139')] [2023-02-24 18:07:22,045][177170] DAMAGECOUNT value on done: 55026.0 [2023-02-24 18:07:22,046][177170] Sum rewards: 6.689, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.428', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon7': '0.032', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon4': '0.170', 'WEAPON7': '0.200', 'weapon5': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.340', 'WEAPON3': '0.450', 'weapon3': '1.202', 'DAMAGECOUNT': '1.713', 'weapon2': '2.202', 'FRAGCOUNT': '5.000'} [2023-02-24 18:07:22,332][177170] DAMAGECOUNT value on done: 58449.0 [2023-02-24 18:07:22,333][177170] Sum rewards: 3.215, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.580', 'AMMO5': '0.017', 'AMMO2': '0.023', 'ARMOR': '0.028', 'WEAPON1': '0.040', 'weapon7': '0.066', 'AMMO4': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.144', 'WEAPON7': '0.200', 'weapon5': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.504', 'weapon4': '0.618', 'HITCOUNT': '0.620', 'WEAPON3': '0.850', 'weapon3': '1.808', 'DAMAGECOUNT': '2.718', 'FRAGCOUNT': '5.500'} [2023-02-24 18:07:22,353][177170] DAMAGECOUNT value on done: 49148.0 [2023-02-24 18:07:22,354][177170] Sum rewards: 3.975, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.573', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'weapon5': '0.032', 'AMMO4': '0.037', 'AMMO3': '0.066', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon7': '0.272', 'HITCOUNT': '0.310', 'ARMOR': '0.400', 'AMMO6': '0.460', 'AMMO7': '0.460', 'WEAPON3': '0.500', 'weapon4': '0.594', 'WEAPON7': '0.700', 'weapon3': '1.140', 'DAMAGECOUNT': '1.143', 'weapon2': '1.348', 'FRAGCOUNT': '2.000'} [2023-02-24 18:07:22,648][177170] DAMAGECOUNT value on done: 57669.0 [2023-02-24 18:07:22,649][177170] Sum rewards: 9.500, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.149', 'AMMO5': '0.010', 'AMMO2': '0.040', 'WEAPON1': '0.050', 'AMMO3': '0.087', 'weapon7': '0.098', 'AMMO4': '0.198', 'weapon5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.330', 'weapon2': '0.392', 'WEAPON3': '0.550', 'weapon4': '0.940', 'weapon3': '1.346', 'DAMAGECOUNT': '2.868', 'FRAGCOUNT': '8.000'} [2023-02-24 18:07:22,830][177158] DAMAGECOUNT value on done: 52297.0 [2023-02-24 18:07:22,831][177158] Sum rewards: 6.155, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.059', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'ARMOR': '0.040', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'weapon7': '0.102', 'weapon5': '0.106', 'AMMO4': '0.116', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.350', 'weapon4': '0.476', 'WEAPON3': '0.600', 'weapon2': '0.992', 'weapon3': '1.694', 'DAMAGECOUNT': '2.562', 'FRAGCOUNT': '4.000'} [2023-02-24 18:07:23,127][177158] DAMAGECOUNT value on done: 52589.0 [2023-02-24 18:07:23,128][177158] Sum rewards: -0.886, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.368', 'AMMO5': '0.017', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'weapon7': '0.092', 'AMMO4': '0.097', 'AMMO3': '0.110', 'weapon5': '0.192', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.300', 'WEAPON7': '0.400', 'HITCOUNT': '0.440', 'WEAPON4': '0.550', 'WEAPON3': '0.650', 'weapon2': '0.854', 'weapon4': '1.088', 'weapon3': '1.118', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.043'} [2023-02-24 18:07:23,586][177153] Updated weights for policy 0, policy_version 9110 (0.0008) [2023-02-24 18:07:24,177][177158] DAMAGECOUNT value on done: 52457.0 [2023-02-24 18:07:24,177][177158] Sum rewards: 9.297, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.160', 'AMMO5': '0.027', 'AMMO2': '0.047', 'WEAPON1': '0.090', 'AMMO3': '0.111', 'weapon7': '0.132', 'AMMO6': '0.220', 'AMMO7': '0.220', 'AMMO4': '0.235', 'weapon5': '0.242', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'weapon4': '0.320', 'HITCOUNT': '0.520', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon2': '1.034', 'weapon3': '1.818', 'DAMAGECOUNT': '3.090', 'FRAGCOUNT': '9.000'} [2023-02-24 18:07:24,384][177172] DAMAGECOUNT value on done: 53035.0 [2023-02-24 18:07:24,385][177172] Sum rewards: 6.070, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.711', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.012', 'WEAPON1': '0.050', 'AMMO3': '0.086', 'weapon7': '0.098', 'WEAPON4': '0.100', 'weapon5': '0.162', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.328', 'WEAPON5': '0.350', 'HITCOUNT': '0.450', 'WEAPON3': '0.600', 'weapon2': '1.286', 'weapon3': '1.626', 'DAMAGECOUNT': '1.893', 'FRAGCOUNT': '5.000'} [2023-02-24 18:07:24,476][177158] DAMAGECOUNT value on done: 55912.0 [2023-02-24 18:07:24,476][177158] Sum rewards: 8.931, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.560', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.025', 'WEAPON1': '0.030', 'AMMO3': '0.061', 'weapon7': '0.118', 'weapon5': '0.160', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'WEAPON7': '0.400', 'WEAPON5': '0.450', 'HITCOUNT': '0.470', 'WEAPON3': '0.500', 'weapon2': '0.788', 'weapon4': '0.956', 'weapon3': '1.476', 'DAMAGECOUNT': '3.282', 'FRAGCOUNT': '7.000'} [2023-02-24 18:07:24,683][177172] DAMAGECOUNT value on done: 52097.0 [2023-02-24 18:07:24,684][177172] Sum rewards: -2.008, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.942', 'ARMOR': '0.004', 'weapon5': '0.006', 'AMMO5': '0.012', 'AMMO2': '0.026', 'WEAPON1': '0.050', 'weapon7': '0.094', 'AMMO3': '0.110', 'AMMO4': '0.132', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.340', 'weapon2': '0.466', 'weapon4': '0.692', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.275', 'weapon3': '1.686', 'FRAGCOUNT': '2.000'} [2023-02-24 18:07:25,289][177154] DAMAGECOUNT value on done: 56142.0 [2023-02-24 18:07:25,289][177154] Sum rewards: 3.664, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.005', 'AMMO5': '0.007', 'AMMO2': '0.029', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO3': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.142', 'weapon5': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.310', 'ARMOR': '0.400', 'weapon4': '0.460', 'WEAPON3': '0.500', 'weapon2': '1.004', 'weapon3': '1.752', 'DAMAGECOUNT': '1.860', 'FRAGCOUNT': '3.000'} [2023-02-24 18:07:25,585][177154] DAMAGECOUNT value on done: 54737.0 [2023-02-24 18:07:25,586][177154] Sum rewards: 7.522, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.080', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'AMMO3': '0.087', 'weapon5': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.460', 'ARMOR': '0.474', 'WEAPON3': '0.500', 'weapon2': '1.212', 'weapon3': '1.540', 'DAMAGECOUNT': '2.568', 'FRAGCOUNT': '5.000'} [2023-02-24 18:07:25,596][177154] DAMAGECOUNT value on done: 53621.0 [2023-02-24 18:07:25,597][177154] Sum rewards: -0.218, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.490', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'AMMO3': '0.082', 'weapon5': '0.112', 'weapon7': '0.126', 'AMMO4': '0.168', 'HITCOUNT': '0.200', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'ARMOR': '0.408', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.771', 'weapon2': '0.804', 'weapon4': '0.902', 'FRAGCOUNT': '1.000', 'weapon3': '1.404'} [2023-02-24 18:07:25,599][177172] DAMAGECOUNT value on done: 52753.0 [2023-02-24 18:07:25,599][177172] Sum rewards: 9.639, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.510', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.056', 'AMMO3': '0.092', 'AMMO4': '0.096', 'weapon5': '0.116', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.326', 'HITCOUNT': '0.640', 'WEAPON3': '0.700', 'weapon2': '1.258', 'weapon3': '1.860', 'DAMAGECOUNT': '2.775', 'FRAGCOUNT': '8.000'} [2023-02-24 18:07:25,910][177172] DAMAGECOUNT value on done: 52755.0 [2023-02-24 18:07:25,910][177154] DAMAGECOUNT value on done: 53997.0 [2023-02-24 18:07:25,910][177172] Sum rewards: 3.714, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.057', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'AMMO3': '0.094', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'weapon5': '0.206', 'weapon4': '0.230', 'WEAPON5': '0.250', 'HITCOUNT': '0.300', 'WEAPON3': '0.650', 'weapon2': '1.578', 'DAMAGECOUNT': '1.635', 'weapon3': '1.744', 'FRAGCOUNT': '6.000'} [2023-02-24 18:07:25,910][177154] Sum rewards: 4.961, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.511', 'AMMO2': '0.016', 'AMMO5': '0.038', 'WEAPON1': '0.060', 'weapon7': '0.076', 'AMMO4': '0.078', 'AMMO3': '0.114', 'weapon5': '0.128', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'HITCOUNT': '0.460', 'ARMOR': '0.468', 'weapon4': '0.582', 'weapon2': '0.628', 'WEAPON5': '0.700', 'WEAPON3': '0.800', 'weapon3': '1.926', 'DAMAGECOUNT': '2.658', 'FRAGCOUNT': '6.500'} [2023-02-24 18:07:26,376][177119] Fps is (10 sec: 13926.2, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 37351424. Throughput: 0: 3503.6. Samples: 9335798. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:07:26,376][177119] Avg episode reward: [(0, '5.153')] [2023-02-24 18:07:26,380][177140] Saving new best policy, reward=5.153! [2023-02-24 18:07:26,452][177157] DAMAGECOUNT value on done: 58272.0 [2023-02-24 18:07:26,452][177157] Sum rewards: 1.357, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.196', 'AMMO5': '0.012', 'AMMO2': '0.040', 'WEAPON1': '0.090', 'AMMO3': '0.175', 'AMMO4': '0.201', 'weapon5': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'HITCOUNT': '0.570', 'weapon4': '0.618', 'weapon2': '0.724', 'WEAPON3': '1.050', 'weapon3': '1.938', 'DAMAGECOUNT': '2.550', 'FRAGCOUNT': '5.000'} [2023-02-24 18:07:26,466][177157] DAMAGECOUNT value on done: 55401.0 [2023-02-24 18:07:26,466][177157] Sum rewards: -1.555, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.734', 'ARMOR': '0.016', 'AMMO5': '0.024', 'AMMO2': '0.036', 'weapon7': '0.054', 'WEAPON1': '0.060', 'AMMO3': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.170', 'AMMO4': '0.180', 'WEAPON4': '0.250', 'weapon4': '0.406', 'WEAPON5': '0.500', 'weapon5': '0.514', 'weapon2': '0.604', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.825', 'FRAGCOUNT': '1.000', 'weapon3': '1.740'} [2023-02-24 18:07:26,486][177153] Updated weights for policy 0, policy_version 9120 (0.0008) [2023-02-24 18:07:26,609][177171] DAMAGECOUNT value on done: 54468.0 [2023-02-24 18:07:26,609][177171] Sum rewards: 2.528, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.980', 'AMMO5': '0.016', 'weapon7': '0.046', 'AMMO2': '0.048', 'WEAPON1': '0.060', 'AMMO3': '0.102', 'weapon5': '0.206', 'weapon4': '0.226', 'AMMO4': '0.241', 'WEAPON5': '0.300', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.350', 'ARMOR': '0.501', 'WEAPON3': '0.650', 'weapon2': '1.498', 'weapon3': '1.584', 'DAMAGECOUNT': '2.229', 'FRAGCOUNT': '2.500'} [2023-02-24 18:07:26,759][177157] DAMAGECOUNT value on done: 54437.0 [2023-02-24 18:07:26,759][177157] Sum rewards: 7.759, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.510', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon7': '0.048', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'AMMO4': '0.121', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'weapon5': '0.268', 'WEAPON5': '0.400', 'weapon4': '0.474', 'HITCOUNT': '0.620', 'WEAPON3': '0.850', 'weapon2': '0.872', 'weapon3': '1.842', 'DAMAGECOUNT': '2.856', 'FRAGCOUNT': '9.000'} [2023-02-24 18:07:26,769][177157] DAMAGECOUNT value on done: 50312.0 [2023-02-24 18:07:26,769][177157] Sum rewards: -2.891, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.290', 'AMMO5': '0.024', 'AMMO2': '0.040', 'weapon7': '0.046', 'WEAPON1': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.104', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'AMMO4': '0.201', 'weapon2': '0.250', 'HITCOUNT': '0.400', 'WEAPON5': '0.500', 'weapon4': '0.808', 'WEAPON3': '1.100', 'DAMAGECOUNT': '1.884', 'weapon3': '2.034', 'FRAGCOUNT': '3.000'} [2023-02-24 18:07:26,909][177171] DAMAGECOUNT value on done: 51545.0 [2023-02-24 18:07:26,909][177171] Sum rewards: 0.556, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.776', 'ARMOR': '0.004', 'AMMO2': '0.010', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'WEAPON1': '0.060', 'weapon7': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.120', 'weapon5': '0.152', 'HITCOUNT': '0.170', 'weapon4': '0.262', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.140', 'weapon2': '1.186', 'weapon3': '1.838', 'FRAGCOUNT': '3.000'} [2023-02-24 18:07:27,187][177171] DAMAGECOUNT value on done: 54104.0 [2023-02-24 18:07:27,188][177171] Sum rewards: 9.185, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.827', 'AMMO2': '0.019', 'AMMO5': '0.022', 'weapon4': '0.042', 'AMMO3': '0.071', 'WEAPON1': '0.090', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'weapon5': '0.286', 'HITCOUNT': '0.460', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon2': '1.616', 'weapon3': '1.748', 'DAMAGECOUNT': '2.364', 'FRAGCOUNT': '8.000'} [2023-02-24 18:07:27,388][177155] DAMAGECOUNT value on done: 56210.0 [2023-02-24 18:07:27,389][177155] Sum rewards: 8.866, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.666', 'AMMO2': '0.009', 'AMMO5': '0.015', 'ARMOR': '0.020', 'WEAPON1': '0.040', 'AMMO4': '0.043', 'weapon7': '0.104', 'AMMO3': '0.113', 'weapon5': '0.184', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.540', 'WEAPON3': '0.800', 'weapon2': '1.516', 'weapon3': '1.890', 'DAMAGECOUNT': '2.718', 'FRAGCOUNT': '8.000'} [2023-02-24 18:07:27,482][177171] DAMAGECOUNT value on done: 52027.0 [2023-02-24 18:07:27,482][177171] Sum rewards: -0.062, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.076', 'AMMO5': '0.017', 'AMMO2': '0.028', 'ARMOR': '0.053', 'WEAPON1': '0.070', 'weapon5': '0.082', 'AMMO3': '0.116', 'AMMO4': '0.141', 'weapon7': '0.154', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.470', 'weapon2': '0.648', 'WEAPON3': '0.750', 'weapon4': '0.752', 'DAMAGECOUNT': '1.770', 'weapon3': '1.872', 'FRAGCOUNT': '2.500'} [2023-02-24 18:07:27,682][177155] DAMAGECOUNT value on done: 56877.0 [2023-02-24 18:07:27,682][177155] Sum rewards: 3.524, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.280', 'AMMO2': '0.015', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'AMMO3': '0.076', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'weapon5': '0.236', 'weapon4': '0.268', 'WEAPON5': '0.350', 'HITCOUNT': '0.380', 'ARMOR': '0.449', 'WEAPON3': '0.500', 'weapon2': '1.558', 'weapon3': '1.576', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.112'} [2023-02-24 18:07:27,972][177155] DAMAGECOUNT value on done: 58144.0 [2023-02-24 18:07:27,972][177155] Sum rewards: 5.504, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.883', 'AMMO5': '0.019', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'weapon7': '0.068', 'AMMO3': '0.097', 'AMMO4': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.298', 'weapon4': '0.304', 'ARMOR': '0.478', 'HITCOUNT': '0.510', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon2': '0.982', 'weapon3': '1.942', 'DAMAGECOUNT': '2.628', 'FRAGCOUNT': '4.500'} [2023-02-24 18:07:28,265][177155] DAMAGECOUNT value on done: 51822.0 [2023-02-24 18:07:28,265][177155] Sum rewards: 3.005, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.745', 'AMMO2': '0.010', 'AMMO5': '0.015', 'ARMOR': '0.024', 'AMMO4': '0.050', 'WEAPON1': '0.070', 'AMMO3': '0.112', 'WEAPON4': '0.200', 'weapon5': '0.208', 'HITCOUNT': '0.310', 'WEAPON5': '0.350', 'weapon2': '0.570', 'weapon4': '0.706', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.302', 'weapon3': '1.822', 'FRAGCOUNT': '4.000'} [2023-02-24 18:07:29,371][177153] Updated weights for policy 0, policy_version 9130 (0.0008) [2023-02-24 18:07:31,376][177119] Fps is (10 sec: 13926.1, 60 sec: 13994.6, 300 sec: 13995.8). Total num frames: 37421056. Throughput: 0: 3505.7. Samples: 9356934. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:07:31,377][177119] Avg episode reward: [(0, '4.778')] [2023-02-24 18:07:32,289][177153] Updated weights for policy 0, policy_version 9140 (0.0008) [2023-02-24 18:07:32,569][177156] DAMAGECOUNT value on done: 55870.0 [2023-02-24 18:07:32,570][177156] Sum rewards: 5.941, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.012', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'weapon7': '0.046', 'AMMO3': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.139', 'weapon5': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'HEALTH': '0.364', 'HITCOUNT': '0.380', 'weapon4': '0.384', 'WEAPON3': '0.400', 'weapon3': '1.256', 'weapon2': '1.546', 'DAMAGECOUNT': '2.073', 'FRAGCOUNT': '5.000'} [2023-02-24 18:07:32,582][177156] DAMAGECOUNT value on done: 52979.0 [2023-02-24 18:07:32,583][177156] Sum rewards: 6.461, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.010', 'AMMO2': '0.010', 'WEAPON1': '0.050', 'AMMO4': '0.052', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.136', 'weapon5': '0.180', 'HEALTH': '0.194', 'WEAPON5': '0.250', 'HITCOUNT': '0.450', 'WEAPON3': '0.800', 'weapon2': '1.118', 'weapon3': '2.204', 'DAMAGECOUNT': '2.643', 'FRAGCOUNT': '7.000'} [2023-02-24 18:07:32,876][177156] DAMAGECOUNT value on done: 57369.0 [2023-02-24 18:07:32,876][177156] Sum rewards: 5.876, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.320', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.044', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'weapon7': '0.156', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.268', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.480', 'WEAPON3': '0.750', 'weapon2': '1.568', 'weapon3': '1.644', 'DAMAGECOUNT': '2.571', 'FRAGCOUNT': '5.000'} [2023-02-24 18:07:32,888][177156] DAMAGECOUNT value on done: 55290.0 [2023-02-24 18:07:32,888][177156] Sum rewards: 2.365, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.100', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.088', 'weapon5': '0.106', 'AMMO4': '0.128', 'weapon7': '0.164', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'ARMOR': '0.446', 'AMMO6': '0.460', 'AMMO7': '0.460', 'HITCOUNT': '0.490', 'WEAPON3': '0.650', 'WEAPON7': '0.700', 'weapon4': '0.822', 'weapon2': '1.034', 'weapon3': '1.258', 'DAMAGECOUNT': '1.848', 'FRAGCOUNT': '2.500'} [2023-02-24 18:07:35,203][177153] Updated weights for policy 0, policy_version 9150 (0.0009) [2023-02-24 18:07:36,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 37490688. Throughput: 0: 3505.6. Samples: 9367394. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:07:36,376][177119] Avg episode reward: [(0, '4.751')] [2023-02-24 18:07:38,107][177153] Updated weights for policy 0, policy_version 9160 (0.0009) [2023-02-24 18:07:41,009][177153] Updated weights for policy 0, policy_version 9170 (0.0008) [2023-02-24 18:07:41,104][177170] DAMAGECOUNT value on done: 55551.0 [2023-02-24 18:07:41,104][177170] Sum rewards: 3.321, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.806', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon5': '0.060', 'WEAPON5': '0.100', 'weapon7': '0.104', 'AMMO3': '0.108', 'AMMO4': '0.113', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'HITCOUNT': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.440', 'WEAPON3': '0.650', 'weapon3': '1.372', 'DAMAGECOUNT': '1.575', 'weapon2': '1.770', 'FRAGCOUNT': '4.000'} [2023-02-24 18:07:41,376][177119] Fps is (10 sec: 14336.3, 60 sec: 14062.9, 300 sec: 14009.7). Total num frames: 37564416. Throughput: 0: 3509.9. Samples: 9388546. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:07:41,376][177119] Avg episode reward: [(0, '4.725')] [2023-02-24 18:07:41,404][177170] DAMAGECOUNT value on done: 59091.0 [2023-02-24 18:07:41,404][177170] Sum rewards: -0.546, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.461', 'ARMOR': '0.016', 'AMMO5': '0.023', 'AMMO2': '0.035', 'WEAPON1': '0.050', 'weapon7': '0.104', 'AMMO3': '0.136', 'AMMO4': '0.173', 'weapon5': '0.186', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.604', 'weapon4': '0.762', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.926', 'weapon3': '1.950', 'FRAGCOUNT': '3.500'} [2023-02-24 18:07:41,426][177170] DAMAGECOUNT value on done: 49960.0 [2023-02-24 18:07:41,427][177170] Sum rewards: 5.250, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.460', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'AMMO3': '0.040', 'AMMO4': '0.105', 'weapon5': '0.116', 'weapon7': '0.128', 'WEAPON5': '0.150', 'HITCOUNT': '0.190', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.272', 'WEAPON7': '0.300', 'weapon3': '0.472', 'weapon4': '0.852', 'DAMAGECOUNT': '1.836', 'FRAGCOUNT': '4.000'} [2023-02-24 18:07:41,726][177170] DAMAGECOUNT value on done: 58449.0 [2023-02-24 18:07:41,727][177170] Sum rewards: 4.152, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.976', 'AMMO5': '0.013', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'AMMO4': '0.134', 'AMMO3': '0.146', 'weapon5': '0.154', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.374', 'HITCOUNT': '0.430', 'weapon2': '0.686', 'WEAPON3': '1.000', 'weapon3': '2.062', 'DAMAGECOUNT': '2.340', 'FRAGCOUNT': '7.000'} [2023-02-24 18:07:41,831][177158] DAMAGECOUNT value on done: 52921.0 [2023-02-24 18:07:41,832][177158] Sum rewards: 3.027, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.976', 'AMMO2': '0.004', 'AMMO5': '0.016', 'AMMO4': '0.022', 'WEAPON1': '0.040', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.121', 'weapon5': '0.150', 'HITCOUNT': '0.390', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'weapon2': '1.748', 'weapon3': '1.838', 'DAMAGECOUNT': '1.872', 'FRAGCOUNT': '3.000'} [2023-02-24 18:07:42,142][177158] DAMAGECOUNT value on done: 53209.0 [2023-02-24 18:07:42,142][177158] Sum rewards: 6.862, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.031', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon7': '0.140', 'AMMO4': '0.156', 'HEALTH': '0.187', 'weapon5': '0.194', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.340', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.528', 'weapon2': '0.968', 'weapon3': '1.788', 'DAMAGECOUNT': '1.860', 'FRAGCOUNT': '5.500'} [2023-02-24 18:07:43,208][177158] DAMAGECOUNT value on done: 52882.0 [2023-02-24 18:07:43,208][177158] Sum rewards: 0.233, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.017', 'AMMO2': '0.008', 'ARMOR': '0.040', 'AMMO4': '0.042', 'AMMO3': '0.087', 'weapon7': '0.118', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.238', 'HITCOUNT': '0.360', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.275', 'weapon3': '1.388', 'weapon2': '1.844', 'FRAGCOUNT': '2.000'} [2023-02-24 18:07:43,507][177158] DAMAGECOUNT value on done: 56278.0 [2023-02-24 18:07:43,507][177158] Sum rewards: -0.782, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.686', 'AMMO5': '0.012', 'AMMO2': '0.021', 'WEAPON1': '0.050', 'weapon5': '0.086', 'AMMO3': '0.088', 'weapon7': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'weapon4': '0.236', 'HITCOUNT': '0.270', 'WEAPON5': '0.300', 'ARMOR': '0.435', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.098', 'weapon3': '1.404', 'weapon2': '1.854'} [2023-02-24 18:07:43,567][177172] DAMAGECOUNT value on done: 53554.0 [2023-02-24 18:07:43,567][177172] Sum rewards: 1.127, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.456', 'ARMOR': '0.008', 'AMMO2': '0.014', 'AMMO5': '0.021', 'AMMO4': '0.072', 'WEAPON1': '0.080', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'weapon5': '0.230', 'HITCOUNT': '0.280', 'WEAPON5': '0.450', 'weapon4': '0.536', 'WEAPON3': '0.600', 'weapon2': '1.126', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.557', 'weapon3': '1.670'} [2023-02-24 18:07:43,867][177172] DAMAGECOUNT value on done: 52532.0 [2023-02-24 18:07:43,867][177172] Sum rewards: 3.407, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'AMMO3': '0.040', 'AMMO2': '0.041', 'weapon5': '0.060', 'WEAPON5': '0.100', 'WEAPON3': '0.200', 'AMMO4': '0.205', 'weapon7': '0.232', 'HITCOUNT': '0.260', 'AMMO6': '0.420', 'AMMO7': '0.420', 'ARMOR': '0.424', 'WEAPON4': '0.450', 'WEAPON7': '0.500', 'HEALTH': '0.543', 'weapon2': '0.566', 'weapon3': '0.582', 'DAMAGECOUNT': '1.305', 'weapon4': '1.554', 'FRAGCOUNT': '3.000'} [2023-02-24 18:07:43,955][177153] Updated weights for policy 0, policy_version 9180 (0.0008) [2023-02-24 18:07:44,499][177154] DAMAGECOUNT value on done: 57356.0 [2023-02-24 18:07:44,500][177154] Sum rewards: 12.669, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.429', 'ARMOR': '0.008', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.073', 'weapon5': '0.222', 'weapon4': '0.280', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.900', 'weapon2': '1.334', 'weapon3': '1.718', 'DAMAGECOUNT': '3.642', 'FRAGCOUNT': '10.000'} [2023-02-24 18:07:44,757][177172] DAMAGECOUNT value on done: 53218.0 [2023-02-24 18:07:44,758][177172] Sum rewards: 3.288, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.120', 'AMMO5': '0.022', 'AMMO2': '0.027', 'ARMOR': '0.040', 'weapon7': '0.050', 'WEAPON1': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.110', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'weapon5': '0.172', 'HITCOUNT': '0.350', 'WEAPON5': '0.500', 'weapon4': '0.570', 'WEAPON3': '0.750', 'weapon2': '0.906', 'DAMAGECOUNT': '1.395', 'weapon3': '1.612', 'FRAGCOUNT': '4.000'} [2023-02-24 18:07:44,787][177154] DAMAGECOUNT value on done: 55171.0 [2023-02-24 18:07:44,788][177154] Sum rewards: -0.459, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.790', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.020', 'WEAPON1': '0.050', 'AMMO3': '0.099', 'WEAPON4': '0.200', 'weapon5': '0.202', 'HITCOUNT': '0.230', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'weapon4': '0.674', 'ARMOR': '0.926', 'weapon3': '1.196', 'DAMAGECOUNT': '1.302', 'weapon2': '1.570', 'FRAGCOUNT': '2.000'} [2023-02-24 18:07:44,797][177154] DAMAGECOUNT value on done: 54371.0 [2023-02-24 18:07:44,798][177154] Sum rewards: 1.826, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.260', 'AMMO2': '0.004', 'AMMO4': '0.022', 'AMMO5': '0.022', 'weapon7': '0.068', 'WEAPON1': '0.080', 'AMMO3': '0.137', 'weapon5': '0.162', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'HITCOUNT': '0.500', 'WEAPON5': '0.600', 'weapon4': '0.710', 'WEAPON3': '0.900', 'weapon2': '1.074', 'weapon3': '1.566', 'DAMAGECOUNT': '2.250', 'FRAGCOUNT': '4.000'} [2023-02-24 18:07:45,054][177172] DAMAGECOUNT value on done: 53196.0 [2023-02-24 18:07:45,054][177172] Sum rewards: 1.228, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.660', 'AMMO5': '0.018', 'AMMO2': '0.041', 'weapon7': '0.046', 'WEAPON1': '0.080', 'AMMO3': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'AMMO4': '0.206', 'weapon5': '0.336', 'HITCOUNT': '0.340', 'weapon4': '0.398', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon2': '0.830', 'DAMAGECOUNT': '1.323', 'weapon3': '1.580', 'FRAGCOUNT': '4.000'} [2023-02-24 18:07:45,088][177154] DAMAGECOUNT value on done: 54559.0 [2023-02-24 18:07:45,088][177154] Sum rewards: 2.474, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.941', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.031', 'weapon7': '0.046', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.127', 'weapon5': '0.168', 'WEAPON7': '0.200', 'weapon4': '0.228', 'WEAPON5': '0.350', 'HITCOUNT': '0.420', 'WEAPON3': '0.750', 'weapon3': '1.392', 'DAMAGECOUNT': '1.686', 'weapon2': '1.858', 'FRAGCOUNT': '4.000'} [2023-02-24 18:07:45,526][177157] DAMAGECOUNT value on done: 56431.0 [2023-02-24 18:07:45,527][177157] Sum rewards: 3.875, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.445', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon7': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.132', 'weapon5': '0.152', 'AMMO4': '0.195', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.404', 'WEAPON4': '0.500', 'weapon4': '0.572', 'HITCOUNT': '0.690', 'WEAPON3': '0.850', 'weapon2': '1.030', 'weapon3': '1.890', 'DAMAGECOUNT': '3.090', 'FRAGCOUNT': '7.000'} [2023-02-24 18:07:45,537][177157] DAMAGECOUNT value on done: 58822.0 [2023-02-24 18:07:45,538][177157] Sum rewards: 4.743, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.028', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.106', 'AMMO3': '0.115', 'weapon5': '0.130', 'weapon7': '0.152', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HEALTH': '0.343', 'HITCOUNT': '0.450', 'WEAPON3': '0.650', 'weapon2': '1.354', 'DAMAGECOUNT': '1.650', 'weapon3': '2.034', 'FRAGCOUNT': '5.000'} [2023-02-24 18:07:45,693][177171] DAMAGECOUNT value on done: 55133.0 [2023-02-24 18:07:45,693][177171] Sum rewards: 7.179, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.022', 'AMMO2': '0.024', 'WEAPON1': '0.050', 'HEALTH': '0.092', 'weapon4': '0.096', 'AMMO4': '0.121', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'weapon5': '0.174', 'WEAPON5': '0.400', 'HITCOUNT': '0.440', 'WEAPON3': '0.750', 'ARMOR': '0.849', 'weapon2': '0.992', 'DAMAGECOUNT': '1.995', 'weapon3': '2.148', 'FRAGCOUNT': '7.000'} [2023-02-24 18:07:45,834][177157] DAMAGECOUNT value on done: 50867.0 [2023-02-24 18:07:45,835][177157] Sum rewards: 7.717, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.232', 'AMMO5': '0.015', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'AMMO3': '0.070', 'AMMO4': '0.104', 'weapon5': '0.130', 'weapon7': '0.172', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'HITCOUNT': '0.330', 'WEAPON7': '0.400', 'weapon4': '0.432', 'WEAPON3': '0.550', 'weapon2': '1.174', 'DAMAGECOUNT': '1.665', 'weapon3': '1.766', 'FRAGCOUNT': '7.000'} [2023-02-24 18:07:45,846][177157] DAMAGECOUNT value on done: 55233.0 [2023-02-24 18:07:45,846][177157] Sum rewards: 3.441, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.150', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'AMMO2': '0.036', 'weapon5': '0.106', 'AMMO3': '0.109', 'weapon7': '0.122', 'WEAPON5': '0.150', 'AMMO4': '0.178', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON4': '0.450', 'HITCOUNT': '0.510', 'WEAPON3': '0.650', 'weapon4': '0.776', 'weapon2': '0.880', 'weapon3': '1.772', 'DAMAGECOUNT': '2.160', 'FRAGCOUNT': '4.500'} [2023-02-24 18:07:45,990][177171] DAMAGECOUNT value on done: 52620.0 [2023-02-24 18:07:45,991][177171] Sum rewards: 11.071, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.320', 'AMMO5': '0.017', 'AMMO2': '0.037', 'WEAPON1': '0.050', 'AMMO3': '0.061', 'AMMO4': '0.186', 'weapon5': '0.214', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '0.500', 'weapon2': '0.662', 'HITCOUNT': '0.700', 'weapon4': '1.112', 'weapon3': '1.576', 'DAMAGECOUNT': '3.225', 'FRAGCOUNT': '10.000'} [2023-02-24 18:07:46,282][177171] DAMAGECOUNT value on done: 55098.0 [2023-02-24 18:07:46,283][177171] Sum rewards: 1.851, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.386', 'AMMO2': '0.019', 'AMMO5': '0.021', 'WEAPON1': '0.040', 'weapon7': '0.060', 'AMMO4': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'weapon5': '0.264', 'weapon4': '0.366', 'WEAPON5': '0.500', 'weapon2': '0.584', 'HITCOUNT': '0.710', 'WEAPON3': '1.150', 'weapon3': '2.316', 'DAMAGECOUNT': '2.982', 'FRAGCOUNT': '5.500'} [2023-02-24 18:07:46,376][177119] Fps is (10 sec: 14335.9, 60 sec: 14062.9, 300 sec: 14009.7). Total num frames: 37634048. Throughput: 0: 3507.1. Samples: 9409464. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:07:46,376][177119] Avg episode reward: [(0, '4.586')] [2023-02-24 18:07:46,510][177155] DAMAGECOUNT value on done: 56865.0 [2023-02-24 18:07:46,510][177155] Sum rewards: 6.425, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.676', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.026', 'ARMOR': '0.032', 'WEAPON1': '0.060', 'AMMO3': '0.061', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'weapon4': '0.334', 'WEAPON3': '0.550', 'HITCOUNT': '0.560', 'weapon2': '1.206', 'weapon3': '1.460', 'DAMAGECOUNT': '1.965', 'FRAGCOUNT': '7.000'} [2023-02-24 18:07:46,570][177171] DAMAGECOUNT value on done: 52872.0 [2023-02-24 18:07:46,570][177171] Sum rewards: 3.039, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.565', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.035', 'WEAPON1': '0.050', 'weapon5': '0.058', 'AMMO3': '0.084', 'WEAPON4': '0.150', 'weapon7': '0.166', 'AMMO4': '0.173', 'WEAPON5': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'HITCOUNT': '0.330', 'WEAPON7': '0.400', 'weapon2': '0.442', 'WEAPON3': '0.600', 'weapon4': '0.910', 'weapon3': '1.164', 'DAMAGECOUNT': '1.635', 'FRAGCOUNT': '4.000'} [2023-02-24 18:07:46,803][177155] DAMAGECOUNT value on done: 57562.0 [2023-02-24 18:07:46,804][177155] Sum rewards: 7.650, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.240', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO3': '0.030', 'AMMO2': '0.036', 'weapon5': '0.040', 'WEAPON5': '0.150', 'weapon7': '0.170', 'AMMO4': '0.178', 'WEAPON3': '0.200', 'WEAPON4': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'HITCOUNT': '0.480', 'weapon2': '0.596', 'weapon3': '0.628', 'weapon4': '1.268', 'DAMAGECOUNT': '2.055', 'FRAGCOUNT': '6.000'} [2023-02-24 18:07:46,866][177153] Updated weights for policy 0, policy_version 9190 (0.0009) [2023-02-24 18:07:47,103][177155] DAMAGECOUNT value on done: 59184.0 [2023-02-24 18:07:47,103][177155] Sum rewards: 3.847, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.282', 'weapon7': '0.002', 'ARMOR': '0.004', 'weapon5': '0.014', 'AMMO5': '0.015', 'AMMO2': '0.025', 'WEAPON1': '0.060', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.125', 'AMMO3': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.348', 'weapon2': '0.852', 'HITCOUNT': '0.870', 'WEAPON3': '1.000', 'weapon3': '2.250', 'DAMAGECOUNT': '3.120', 'FRAGCOUNT': '6.000'} [2023-02-24 18:07:47,400][177155] DAMAGECOUNT value on done: 52514.0 [2023-02-24 18:07:47,401][177155] Sum rewards: 4.758, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.058', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'AMMO3': '0.041', 'AMMO4': '0.085', 'weapon7': '0.108', 'WEAPON4': '0.150', 'weapon5': '0.152', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.350', 'weapon4': '0.768', 'weapon2': '0.874', 'weapon3': '1.002', 'DAMAGECOUNT': '2.076', 'FRAGCOUNT': '4.000'} [2023-02-24 18:07:49,735][177153] Updated weights for policy 0, policy_version 9200 (0.0008) [2023-02-24 18:07:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14063.0, 300 sec: 14009.7). Total num frames: 37703680. Throughput: 0: 3509.1. Samples: 9420062. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:07:51,376][177119] Avg episode reward: [(0, '4.498')] [2023-02-24 18:07:51,827][177156] DAMAGECOUNT value on done: 56558.0 [2023-02-24 18:07:51,827][177156] Sum rewards: 3.565, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.870', 'weapon7': '0.006', 'AMMO5': '0.017', 'AMMO2': '0.028', 'WEAPON1': '0.070', 'AMMO3': '0.101', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.316', 'weapon4': '0.328', 'WEAPON5': '0.400', 'HITCOUNT': '0.430', 'ARMOR': '0.432', 'WEAPON3': '0.650', 'weapon2': '1.056', 'weapon3': '1.898', 'DAMAGECOUNT': '2.064', 'FRAGCOUNT': '4.000'} [2023-02-24 18:07:51,838][177156] DAMAGECOUNT value on done: 53660.0 [2023-02-24 18:07:51,839][177156] Sum rewards: 5.022, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.710', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.026', 'weapon7': '0.050', 'WEAPON1': '0.070', 'AMMO3': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.128', 'weapon5': '0.264', 'WEAPON4': '0.350', 'HITCOUNT': '0.410', 'weapon4': '0.542', 'WEAPON3': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.958', 'weapon3': '1.626', 'DAMAGECOUNT': '2.043', 'FRAGCOUNT': '4.500'} [2023-02-24 18:07:52,131][177156] DAMAGECOUNT value on done: 58246.0 [2023-02-24 18:07:52,132][177156] Sum rewards: 2.864, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.272', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.029', 'WEAPON1': '0.030', 'weapon7': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.154', 'WEAPON5': '0.200', 'weapon5': '0.204', 'weapon2': '0.540', 'HITCOUNT': '0.610', 'WEAPON3': '0.850', 'DAMAGECOUNT': '2.631', 'weapon3': '2.754', 'FRAGCOUNT': '3.000'} [2023-02-24 18:07:52,142][177156] DAMAGECOUNT value on done: 55681.0 [2023-02-24 18:07:52,143][177156] Sum rewards: 0.922, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.564', 'AMMO2': '0.006', 'AMMO5': '0.014', 'AMMO4': '0.031', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.062', 'weapon5': '0.118', 'AMMO3': '0.125', 'HITCOUNT': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.173', 'weapon2': '1.700', 'weapon3': '1.766', 'FRAGCOUNT': '2.500'} [2023-02-24 18:07:52,640][177153] Updated weights for policy 0, policy_version 9210 (0.0009) [2023-02-24 18:07:55,524][177153] Updated weights for policy 0, policy_version 9220 (0.0009) [2023-02-24 18:07:56,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 14009.7). Total num frames: 37773312. Throughput: 0: 3511.8. Samples: 9441224. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 18:07:56,376][177119] Avg episode reward: [(0, '4.597')] [2023-02-24 18:07:58,447][177153] Updated weights for policy 0, policy_version 9230 (0.0008) [2023-02-24 18:08:00,218][177170] DAMAGECOUNT value on done: 56305.0 [2023-02-24 18:08:00,219][177170] Sum rewards: 0.970, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.460', 'AMMO2': '0.017', 'AMMO5': '0.030', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'WEAPON1': '0.110', 'AMMO3': '0.164', 'weapon4': '0.346', 'weapon5': '0.348', 'ARMOR': '0.408', 'weapon2': '0.496', 'HITCOUNT': '0.580', 'WEAPON5': '0.700', 'WEAPON3': '1.050', 'weapon3': '2.236', 'DAMAGECOUNT': '2.262', 'FRAGCOUNT': '4.000'} [2023-02-24 18:08:00,518][177170] DAMAGECOUNT value on done: 59542.0 [2023-02-24 18:08:00,519][177170] Sum rewards: 1.081, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.266', 'AMMO2': '0.005', 'weapon4': '0.018', 'AMMO5': '0.020', 'AMMO4': '0.023', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.052', 'AMMO3': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.256', 'HITCOUNT': '0.270', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.353', 'weapon2': '1.522', 'weapon3': '1.536', 'FRAGCOUNT': '2.000'} [2023-02-24 18:08:00,556][177170] DAMAGECOUNT value on done: 50486.0 [2023-02-24 18:08:00,557][177170] Sum rewards: 2.015, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.078', 'AMMO2': '0.013', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.063', 'weapon5': '0.090', 'AMMO3': '0.150', 'WEAPON5': '0.350', 'HITCOUNT': '0.410', 'WEAPON3': '0.900', 'weapon2': '1.490', 'DAMAGECOUNT': '1.578', 'weapon3': '2.004', 'FRAGCOUNT': '6.000'} [2023-02-24 18:08:00,860][177170] DAMAGECOUNT value on done: 59035.0 [2023-02-24 18:08:00,860][177170] Sum rewards: -0.705, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.336', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'weapon7': '0.046', 'weapon5': '0.052', 'AMMO4': '0.081', 'AMMO3': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.370', 'weapon4': '0.512', 'weapon2': '0.628', 'WEAPON3': '0.750', 'weapon3': '1.454', 'DAMAGECOUNT': '1.758', 'FRAGCOUNT': '4.000'} [2023-02-24 18:08:00,955][177158] DAMAGECOUNT value on done: 54026.0 [2023-02-24 18:08:00,955][177158] Sum rewards: 3.735, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.220', 'AMMO5': '0.017', 'AMMO2': '0.021', 'WEAPON1': '0.080', 'AMMO4': '0.104', 'AMMO3': '0.171', 'weapon5': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.402', 'HITCOUNT': '0.600', 'weapon2': '0.748', 'WEAPON3': '1.100', 'weapon3': '2.254', 'DAMAGECOUNT': '3.315', 'FRAGCOUNT': '6.000'} [2023-02-24 18:08:01,251][177158] DAMAGECOUNT value on done: 53826.0 [2023-02-24 18:08:01,252][177158] Sum rewards: 2.503, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.034', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon5': '0.046', 'weapon7': '0.070', 'AMMO4': '0.078', 'weapon4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.410', 'WEAPON3': '0.700', 'weapon2': '1.590', 'DAMAGECOUNT': '1.851', 'weapon3': '1.902', 'FRAGCOUNT': '5.000'} [2023-02-24 18:08:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 37842944. Throughput: 0: 3510.9. Samples: 9462202. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 18:08:01,376][177119] Avg episode reward: [(0, '4.559')] [2023-02-24 18:08:01,399][177153] Updated weights for policy 0, policy_version 9240 (0.0008) [2023-02-24 18:08:02,299][177158] DAMAGECOUNT value on done: 53132.0 [2023-02-24 18:08:02,299][177158] Sum rewards: 3.949, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.660', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO3': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO4': '0.079', 'weapon7': '0.112', 'HITCOUNT': '0.140', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.250', 'WEAPON7': '0.300', 'weapon4': '0.482', 'DAMAGECOUNT': '0.750', 'weapon3': '0.830', 'weapon2': '2.336', 'FRAGCOUNT': '3.000'} [2023-02-24 18:08:02,604][177158] DAMAGECOUNT value on done: 57116.0 [2023-02-24 18:08:02,604][177158] Sum rewards: 7.617, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.836', 'AMMO5': '0.009', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'AMMO3': '0.078', 'AMMO4': '0.081', 'weapon5': '0.110', 'weapon7': '0.146', 'WEAPON4': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'WEAPON7': '0.400', 'HITCOUNT': '0.440', 'weapon4': '0.474', 'WEAPON3': '0.600', 'weapon2': '1.138', 'weapon3': '1.536', 'DAMAGECOUNT': '2.514', 'FRAGCOUNT': '6.000'} [2023-02-24 18:08:02,821][177172] DAMAGECOUNT value on done: 54450.0 [2023-02-24 18:08:02,821][177172] Sum rewards: 7.624, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.535', 'weapon7': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.018', 'ARMOR': '0.040', 'WEAPON1': '0.070', 'AMMO4': '0.089', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.104', 'weapon5': '0.104', 'WEAPON4': '0.150', 'weapon4': '0.282', 'WEAPON5': '0.350', 'weapon2': '0.638', 'HITCOUNT': '0.660', 'WEAPON3': '0.700', 'weapon3': '2.444', 'DAMAGECOUNT': '2.688', 'FRAGCOUNT': '7.000'} [2023-02-24 18:08:03,120][177172] DAMAGECOUNT value on done: 53387.0 [2023-02-24 18:08:03,121][177172] Sum rewards: 2.109, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.921', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon7': '0.048', 'WEAPON1': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.105', 'weapon5': '0.118', 'AMMO4': '0.225', 'WEAPON5': '0.400', 'HITCOUNT': '0.430', 'WEAPON4': '0.500', 'weapon2': '0.542', 'WEAPON3': '0.700', 'weapon4': '0.882', 'weapon3': '1.834', 'DAMAGECOUNT': '2.565', 'FRAGCOUNT': '4.000'} [2023-02-24 18:08:03,614][177154] DAMAGECOUNT value on done: 58466.0 [2023-02-24 18:08:03,615][177154] Sum rewards: 7.766, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.412', 'weapon4': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'weapon5': '0.058', 'weapon7': '0.066', 'AMMO4': '0.083', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.130', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.660', 'WEAPON3': '0.800', 'weapon3': '1.820', 'weapon2': '1.832', 'DAMAGECOUNT': '3.330', 'FRAGCOUNT': '10.000'} [2023-02-24 18:08:03,913][177154] DAMAGECOUNT value on done: 56136.0 [2023-02-24 18:08:03,914][177154] Sum rewards: 6.369, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.428', 'AMMO5': '0.018', 'AMMO2': '0.035', 'WEAPON1': '0.050', 'AMMO3': '0.130', 'WEAPON4': '0.150', 'AMMO4': '0.176', 'weapon5': '0.238', 'weapon4': '0.262', 'WEAPON5': '0.450', 'HITCOUNT': '0.690', 'WEAPON3': '0.850', 'weapon2': '1.446', 'weapon3': '1.656', 'DAMAGECOUNT': '2.895', 'FRAGCOUNT': '7.000'} [2023-02-24 18:08:03,924][177154] DAMAGECOUNT value on done: 55363.0 [2023-02-24 18:08:03,924][177154] Sum rewards: 2.576, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.518', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon7': '0.048', 'WEAPON1': '0.060', 'AMMO3': '0.099', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.122', 'AMMO4': '0.130', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.320', 'HITCOUNT': '0.430', 'WEAPON3': '0.700', 'weapon3': '1.456', 'weapon2': '1.724', 'DAMAGECOUNT': '2.976', 'FRAGCOUNT': '4.000'} [2023-02-24 18:08:04,009][177172] DAMAGECOUNT value on done: 53547.0 [2023-02-24 18:08:04,010][177172] Sum rewards: 1.351, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.988', 'AMMO5': '0.019', 'WEAPON1': '0.040', 'AMMO2': '0.057', 'AMMO3': '0.126', 'HITCOUNT': '0.270', 'AMMO4': '0.284', 'weapon5': '0.300', 'weapon2': '0.404', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.987', 'weapon4': '1.082', 'weapon3': '1.248', 'ARMOR': '1.721', 'FRAGCOUNT': '3.000'} [2023-02-24 18:08:04,219][177154] DAMAGECOUNT value on done: 55159.0 [2023-02-24 18:08:04,220][177154] Sum rewards: -0.303, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.496', 'AMMO2': '0.019', 'AMMO5': '0.028', 'ARMOR': '0.044', 'WEAPON4': '0.050', 'WEAPON1': '0.080', 'AMMO4': '0.096', 'weapon5': '0.138', 'AMMO3': '0.206', 'weapon4': '0.226', 'HITCOUNT': '0.590', 'WEAPON5': '0.650', 'weapon2': '0.692', 'WEAPON3': '1.250', 'DAMAGECOUNT': '1.800', 'weapon3': '2.324', 'FRAGCOUNT': '5.000'} [2023-02-24 18:08:04,312][177172] DAMAGECOUNT value on done: 54187.0 [2023-02-24 18:08:04,312][177172] Sum rewards: 10.169, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.946', 'AMMO5': '0.010', 'ARMOR': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'weapon7': '0.062', 'weapon5': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.149', 'AMMO4': '0.159', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.350', 'weapon2': '0.522', 'HITCOUNT': '0.680', 'WEAPON3': '0.950', 'weapon3': '2.360', 'DAMAGECOUNT': '2.973', 'FRAGCOUNT': '10.000'} [2023-02-24 18:08:04,317][177153] Updated weights for policy 0, policy_version 9250 (0.0008) [2023-02-24 18:08:04,668][177157] DAMAGECOUNT value on done: 56846.0 [2023-02-24 18:08:04,668][177157] Sum rewards: -0.126, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.210', 'AMMO5': '0.030', 'AMMO2': '0.032', 'WEAPON1': '0.050', 'weapon5': '0.128', 'AMMO3': '0.154', 'AMMO4': '0.160', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.242', 'WEAPON4': '0.250', 'HITCOUNT': '0.320', 'WEAPON5': '0.600', 'weapon2': '0.746', 'WEAPON3': '1.050', 'DAMAGECOUNT': '1.245', 'weapon3': '2.226', 'FRAGCOUNT': '4.000'} [2023-02-24 18:08:04,679][177157] DAMAGECOUNT value on done: 59621.0 [2023-02-24 18:08:04,679][177157] Sum rewards: 8.367, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.032', 'WEAPON1': '0.040', 'weapon7': '0.042', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.127', 'weapon5': '0.210', 'WEAPON5': '0.300', 'HEALTH': '0.352', 'HITCOUNT': '0.380', 'WEAPON3': '0.500', 'weapon2': '1.498', 'weapon3': '1.714', 'DAMAGECOUNT': '2.397', 'FRAGCOUNT': '7.000'} [2023-02-24 18:08:04,786][177171] DAMAGECOUNT value on done: 55969.0 [2023-02-24 18:08:04,787][177171] Sum rewards: 4.903, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.165', 'AMMO2': '0.014', 'AMMO5': '0.015', 'ARMOR': '0.020', 'WEAPON1': '0.040', 'weapon7': '0.046', 'AMMO4': '0.070', 'AMMO3': '0.137', 'weapon5': '0.146', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.496', 'HITCOUNT': '0.590', 'WEAPON3': '0.750', 'weapon2': '1.072', 'weapon3': '1.674', 'DAMAGECOUNT': '2.508', 'FRAGCOUNT': '6.000'} [2023-02-24 18:08:04,975][177157] DAMAGECOUNT value on done: 51160.0 [2023-02-24 18:08:04,975][177157] Sum rewards: -1.586, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.642', 'ARMOR': '0.008', 'AMMO5': '0.021', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.125', 'AMMO3': '0.197', 'HITCOUNT': '0.200', 'weapon5': '0.270', 'WEAPON4': '0.350', 'weapon4': '0.504', 'WEAPON5': '0.550', 'weapon2': '0.812', 'DAMAGECOUNT': '0.879', 'WEAPON3': '1.050', 'weapon3': '1.974', 'FRAGCOUNT': '4.000'} [2023-02-24 18:08:04,986][177157] DAMAGECOUNT value on done: 55598.0 [2023-02-24 18:08:04,987][177157] Sum rewards: 1.198, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.781', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO2': '0.038', 'weapon7': '0.050', 'weapon5': '0.094', 'AMMO3': '0.095', 'AMMO4': '0.191', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'HITCOUNT': '0.310', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'weapon4': '0.788', 'DAMAGECOUNT': '1.095', 'weapon2': '1.206', 'weapon3': '1.322', 'FRAGCOUNT': '3.000'} [2023-02-24 18:08:05,076][177171] DAMAGECOUNT value on done: 53187.0 [2023-02-24 18:08:05,077][177171] Sum rewards: 3.965, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.820', 'AMMO5': '0.007', 'AMMO2': '0.028', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'AMMO3': '0.081', 'weapon7': '0.126', 'AMMO4': '0.137', 'weapon5': '0.148', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'weapon4': '0.516', 'WEAPON3': '0.550', 'weapon2': '1.036', 'weapon3': '1.554', 'DAMAGECOUNT': '1.701', 'FRAGCOUNT': '2.000'} [2023-02-24 18:08:05,364][177171] DAMAGECOUNT value on done: 55860.0 [2023-02-24 18:08:05,365][177171] Sum rewards: 6.235, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.960', 'AMMO2': '0.009', 'AMMO5': '0.035', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'weapon7': '0.054', 'weapon4': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON1': '0.100', 'AMMO3': '0.112', 'HITCOUNT': '0.210', 'weapon5': '0.444', 'WEAPON3': '0.750', 'WEAPON5': '0.750', 'weapon2': '1.036', 'weapon3': '1.682', 'DAMAGECOUNT': '2.286', 'FRAGCOUNT': '6.000'} [2023-02-24 18:08:05,637][177155] DAMAGECOUNT value on done: 57165.0 [2023-02-24 18:08:05,637][177155] Sum rewards: 2.689, reward structure: {'DEATHCOUNT': '-8.250', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.036', 'weapon7': '0.048', 'WEAPON1': '0.090', 'AMMO3': '0.105', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'AMMO4': '0.178', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'weapon2': '0.210', 'weapon5': '0.298', 'HEALTH': '0.406', 'weapon4': '0.484', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.900', 'weapon3': '2.096', 'FRAGCOUNT': '4.000'} [2023-02-24 18:08:05,665][177171] DAMAGECOUNT value on done: 53260.0 [2023-02-24 18:08:05,665][177171] Sum rewards: -0.036, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.212', 'AMMO5': '0.010', 'weapon4': '0.016', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon7': '0.062', 'AMMO3': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.115', 'weapon5': '0.152', 'WEAPON5': '0.250', 'HITCOUNT': '0.310', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.164', 'weapon3': '1.338', 'weapon2': '2.264'} [2023-02-24 18:08:05,932][177155] DAMAGECOUNT value on done: 58321.0 [2023-02-24 18:08:05,932][177155] Sum rewards: 5.529, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.098', 'AMMO2': '0.004', 'AMMO4': '0.019', 'AMMO5': '0.024', 'WEAPON1': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.161', 'weapon4': '0.172', 'weapon5': '0.224', 'WEAPON5': '0.550', 'HITCOUNT': '0.580', 'weapon2': '0.884', 'WEAPON3': '0.950', 'DAMAGECOUNT': '2.277', 'weapon3': '2.342', 'FRAGCOUNT': '8.000'} [2023-02-24 18:08:06,220][177155] DAMAGECOUNT value on done: 59589.0 [2023-02-24 18:08:06,221][177155] Sum rewards: 0.649, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.114', 'AMMO2': '0.004', 'AMMO5': '0.017', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'weapon7': '0.058', 'WEAPON1': '0.080', 'weapon5': '0.094', 'weapon4': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.131', 'WEAPON7': '0.200', 'HITCOUNT': '0.300', 'WEAPON5': '0.400', 'ARMOR': '0.865', 'WEAPON3': '0.950', 'weapon2': '0.998', 'DAMAGECOUNT': '1.215', 'FRAGCOUNT': '2.000', 'weapon3': '2.294'} [2023-02-24 18:08:06,376][177119] Fps is (10 sec: 14335.9, 60 sec: 14062.9, 300 sec: 14023.6). Total num frames: 37916672. Throughput: 0: 3510.6. Samples: 9472680. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 18:08:06,376][177119] Avg episode reward: [(0, '3.992')] [2023-02-24 18:08:06,515][177155] DAMAGECOUNT value on done: 53337.0 [2023-02-24 18:08:06,515][177155] Sum rewards: 6.161, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.058', 'AMMO2': '0.014', 'AMMO5': '0.020', 'weapon7': '0.054', 'AMMO4': '0.070', 'WEAPON1': '0.080', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.306', 'HITCOUNT': '0.440', 'WEAPON5': '0.500', 'weapon4': '0.502', 'WEAPON3': '0.600', 'weapon3': '1.308', 'weapon2': '1.484', 'DAMAGECOUNT': '2.469', 'FRAGCOUNT': '4.000'} [2023-02-24 18:08:07,245][177153] Updated weights for policy 0, policy_version 9260 (0.0008) [2023-02-24 18:08:08,881][177155] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-24 18:08:10,081][177171] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:08:10,171][177153] Updated weights for policy 0, policy_version 9270 (0.0008) [2023-02-24 18:08:11,061][177156] DAMAGECOUNT value on done: 57063.0 [2023-02-24 18:08:11,061][177156] Sum rewards: 1.531, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.732', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'weapon7': '0.062', 'weapon5': '0.088', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.121', 'WEAPON5': '0.150', 'weapon4': '0.158', 'WEAPON7': '0.200', 'HITCOUNT': '0.470', 'WEAPON3': '0.800', 'weapon2': '1.066', 'DAMAGECOUNT': '1.515', 'weapon3': '2.232', 'FRAGCOUNT': '2.500'} [2023-02-24 18:08:11,081][177156] DAMAGECOUNT value on done: 54237.0 [2023-02-24 18:08:11,081][177156] Sum rewards: 5.507, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.423', 'ARMOR': '0.008', 'AMMO5': '0.011', 'weapon7': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.063', 'weapon4': '0.070', 'AMMO3': '0.094', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.204', 'WEAPON5': '0.350', 'HITCOUNT': '0.410', 'WEAPON3': '0.750', 'weapon2': '1.288', 'DAMAGECOUNT': '1.731', 'weapon3': '1.976', 'FRAGCOUNT': '6.000'} [2023-02-24 18:08:11,366][177156] DAMAGECOUNT value on done: 59331.0 [2023-02-24 18:08:11,367][177156] Sum rewards: 5.511, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.238', 'AMMO2': '0.007', 'AMMO5': '0.013', 'weapon7': '0.026', 'AMMO4': '0.033', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.111', 'WEAPON4': '0.150', 'weapon4': '0.242', 'WEAPON5': '0.300', 'weapon5': '0.320', 'HITCOUNT': '0.630', 'WEAPON3': '0.700', 'weapon2': '0.746', 'weapon3': '2.238', 'DAMAGECOUNT': '3.093', 'FRAGCOUNT': '5.000'} [2023-02-24 18:08:11,376][177119] Fps is (10 sec: 14336.2, 60 sec: 14063.0, 300 sec: 14023.6). Total num frames: 37986304. Throughput: 0: 3512.5. Samples: 9493858. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:08:11,376][177119] Avg episode reward: [(0, '3.963')] [2023-02-24 18:08:11,387][177156] DAMAGECOUNT value on done: 56334.0 [2023-02-24 18:08:11,388][177156] Sum rewards: 6.564, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.017', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'ARMOR': '0.044', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.107', 'AMMO4': '0.112', 'weapon5': '0.170', 'HEALTH': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.492', 'HITCOUNT': '0.570', 'WEAPON3': '0.600', 'weapon2': '1.272', 'weapon3': '1.574', 'DAMAGECOUNT': '1.959', 'FRAGCOUNT': '6.000'} [2023-02-24 18:08:13,108][177153] Updated weights for policy 0, policy_version 9280 (0.0008) [2023-02-24 18:08:16,043][177153] Updated weights for policy 0, policy_version 9290 (0.0008) [2023-02-24 18:08:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 14023.6). Total num frames: 38055936. Throughput: 0: 3508.5. Samples: 9514816. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:08:16,376][177119] Avg episode reward: [(0, '3.977')] [2023-02-24 18:08:18,956][177153] Updated weights for policy 0, policy_version 9300 (0.0009) [2023-02-24 18:08:19,271][177170] DAMAGECOUNT value on done: 56889.0 [2023-02-24 18:08:19,271][177170] Sum rewards: 4.987, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.876', 'AMMO2': '0.008', 'AMMO5': '0.017', 'AMMO4': '0.041', 'weapon5': '0.046', 'WEAPON1': '0.060', 'weapon7': '0.082', 'AMMO3': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.350', 'ARMOR': '0.404', 'HITCOUNT': '0.480', 'weapon4': '0.512', 'WEAPON3': '0.700', 'weapon2': '0.936', 'DAMAGECOUNT': '1.752', 'weapon3': '1.926', 'FRAGCOUNT': '4.000'} [2023-02-24 18:08:19,568][177170] DAMAGECOUNT value on done: 60340.0 [2023-02-24 18:08:19,568][177170] Sum rewards: 7.558, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.580', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO3': '0.065', 'AMMO4': '0.079', 'weapon5': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'ARMOR': '0.436', 'weapon4': '0.446', 'WEAPON3': '0.450', 'HITCOUNT': '0.620', 'weapon2': '0.916', 'weapon3': '1.056', 'DAMAGECOUNT': '2.394', 'FRAGCOUNT': '6.000'} [2023-02-24 18:08:19,607][177170] DAMAGECOUNT value on done: 51292.0 [2023-02-24 18:08:19,608][177170] Sum rewards: 7.561, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.308', 'AMMO5': '0.017', 'AMMO2': '0.036', 'ARMOR': '0.036', 'WEAPON1': '0.060', 'AMMO3': '0.115', 'weapon4': '0.136', 'AMMO4': '0.179', 'weapon5': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.500', 'HITCOUNT': '0.510', 'WEAPON3': '0.800', 'weapon2': '1.046', 'weapon3': '1.994', 'DAMAGECOUNT': '2.418', 'FRAGCOUNT': '8.000'} [2023-02-24 18:08:19,904][177170] DAMAGECOUNT value on done: 60440.0 [2023-02-24 18:08:19,904][177170] Sum rewards: 12.044, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.966', 'ARMOR': '0.004', 'AMMO2': '0.021', 'AMMO5': '0.028', 'WEAPON1': '0.080', 'AMMO3': '0.081', 'AMMO4': '0.107', 'weapon4': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.346', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'weapon2': '1.342', 'weapon3': '1.876', 'DAMAGECOUNT': '4.215', 'FRAGCOUNT': '9.500'} [2023-02-24 18:08:20,055][177158] DAMAGECOUNT value on done: 55244.0 [2023-02-24 18:08:20,056][177158] Sum rewards: 10.895, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.168', 'weapon7': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.030', 'WEAPON1': '0.060', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.149', 'AMMO3': '0.152', 'weapon4': '0.208', 'weapon5': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'ARMOR': '0.404', 'weapon2': '0.520', 'HITCOUNT': '0.780', 'WEAPON3': '1.000', 'weapon3': '2.550', 'DAMAGECOUNT': '3.654', 'FRAGCOUNT': '11.000'} [2023-02-24 18:08:20,359][177158] DAMAGECOUNT value on done: 54354.0 [2023-02-24 18:08:20,359][177158] Sum rewards: 0.658, reward structure: {'DEATHCOUNT': '-9.750', 'ARMOR': '0.008', 'AMMO5': '0.010', 'HEALTH': '0.026', 'AMMO2': '0.041', 'WEAPON1': '0.060', 'weapon7': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.103', 'WEAPON5': '0.200', 'AMMO4': '0.206', 'weapon5': '0.228', 'HITCOUNT': '0.280', 'WEAPON4': '0.300', 'weapon4': '0.380', 'WEAPON3': '0.600', 'weapon3': '1.046', 'DAMAGECOUNT': '1.584', 'weapon2': '1.954', 'FRAGCOUNT': '3.000'} [2023-02-24 18:08:21,376][177119] Fps is (10 sec: 13926.2, 60 sec: 14062.9, 300 sec: 14023.6). Total num frames: 38125568. Throughput: 0: 3510.7. Samples: 9525376. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:08:21,376][177119] Avg episode reward: [(0, '4.134')] [2023-02-24 18:08:21,492][177158] DAMAGECOUNT value on done: 53718.0 [2023-02-24 18:08:21,492][177158] Sum rewards: 4.371, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.573', 'AMMO2': '0.016', 'weapon4': '0.030', 'AMMO5': '0.035', 'WEAPON4': '0.050', 'AMMO4': '0.080', 'AMMO3': '0.094', 'WEAPON1': '0.110', 'HITCOUNT': '0.280', 'weapon5': '0.412', 'WEAPON3': '0.700', 'WEAPON5': '0.750', 'weapon2': '1.358', 'DAMAGECOUNT': '1.758', 'weapon3': '1.770', 'FRAGCOUNT': '5.000'} [2023-02-24 18:08:21,784][177158] DAMAGECOUNT value on done: 57545.0 [2023-02-24 18:08:21,785][177158] Sum rewards: 3.956, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.127', 'AMMO2': '0.001', 'AMMO4': '0.002', 'ARMOR': '0.008', 'AMMO5': '0.015', 'WEAPON1': '0.060', 'weapon7': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.288', 'WEAPON5': '0.300', 'HITCOUNT': '0.330', 'weapon2': '0.470', 'weapon4': '0.486', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.287', 'weapon3': '1.648', 'FRAGCOUNT': '4.000'} [2023-02-24 18:08:21,911][177153] Updated weights for policy 0, policy_version 9310 (0.0008) [2023-02-24 18:08:21,960][177172] DAMAGECOUNT value on done: 54863.0 [2023-02-24 18:08:21,961][177172] Sum rewards: 2.335, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.266', 'ARMOR': '0.004', 'AMMO2': '0.015', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.077', 'weapon4': '0.118', 'AMMO3': '0.134', 'WEAPON4': '0.150', 'weapon5': '0.204', 'HITCOUNT': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'weapon2': '1.078', 'DAMAGECOUNT': '1.239', 'weapon3': '2.276', 'FRAGCOUNT': '5.000'} [2023-02-24 18:08:22,256][177172] DAMAGECOUNT value on done: 54103.0 [2023-02-24 18:08:22,256][177172] Sum rewards: 0.107, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.944', 'AMMO2': '0.017', 'AMMO5': '0.021', 'WEAPON1': '0.040', 'AMMO4': '0.087', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'weapon5': '0.398', 'weapon4': '0.516', 'WEAPON5': '0.550', 'HITCOUNT': '0.610', 'weapon2': '0.956', 'WEAPON3': '1.050', 'weapon3': '1.740', 'DAMAGECOUNT': '2.148', 'FRAGCOUNT': '4.000'} [2023-02-24 18:08:22,733][177154] DAMAGECOUNT value on done: 59400.0 [2023-02-24 18:08:22,734][177154] Sum rewards: 6.292, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.538', 'ARMOR': '0.008', 'AMMO5': '0.017', 'weapon7': '0.018', 'AMMO2': '0.029', 'WEAPON1': '0.070', 'AMMO3': '0.127', 'AMMO4': '0.142', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon5': '0.192', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'HITCOUNT': '0.520', 'weapon4': '0.534', 'weapon2': '0.828', 'WEAPON3': '0.900', 'weapon3': '1.872', 'DAMAGECOUNT': '2.802', 'FRAGCOUNT': '9.000'} [2023-02-24 18:08:23,027][177154] DAMAGECOUNT value on done: 56920.0 [2023-02-24 18:08:23,028][177154] Sum rewards: 6.992, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.608', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'weapon5': '0.090', 'AMMO4': '0.091', 'AMMO3': '0.095', 'weapon7': '0.146', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.458', 'HITCOUNT': '0.570', 'WEAPON3': '0.600', 'weapon2': '1.074', 'weapon3': '1.648', 'DAMAGECOUNT': '2.352', 'FRAGCOUNT': '6.000'} [2023-02-24 18:08:23,035][177154] DAMAGECOUNT value on done: 56232.0 [2023-02-24 18:08:23,035][177154] Sum rewards: 8.023, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.651', 'AMMO5': '0.012', 'AMMO2': '0.021', 'ARMOR': '0.036', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO3': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'weapon5': '0.222', 'WEAPON5': '0.350', 'weapon4': '0.358', 'HITCOUNT': '0.470', 'WEAPON3': '0.600', 'weapon2': '1.322', 'weapon3': '1.426', 'DAMAGECOUNT': '2.607', 'FRAGCOUNT': '8.000'} [2023-02-24 18:08:23,135][177172] DAMAGECOUNT value on done: 54458.0 [2023-02-24 18:08:23,135][177172] Sum rewards: 3.395, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.305', 'AMMO2': '0.019', 'AMMO5': '0.021', 'ARMOR': '0.024', 'weapon7': '0.048', 'AMMO4': '0.094', 'WEAPON1': '0.100', 'AMMO3': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.196', 'WEAPON7': '0.200', 'weapon5': '0.270', 'HITCOUNT': '0.430', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'weapon2': '0.864', 'weapon3': '2.154', 'DAMAGECOUNT': '2.733', 'FRAGCOUNT': '4.000'} [2023-02-24 18:08:23,332][177154] DAMAGECOUNT value on done: 55877.0 [2023-02-24 18:08:23,332][177154] Sum rewards: -1.206, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.398', 'ARMOR': '0.008', 'AMMO5': '0.026', 'AMMO2': '0.047', 'WEAPON1': '0.060', 'AMMO3': '0.063', 'AMMO4': '0.236', 'HITCOUNT': '0.260', 'weapon5': '0.308', 'WEAPON3': '0.450', 'WEAPON4': '0.450', 'weapon4': '0.530', 'WEAPON5': '0.600', 'weapon3': '1.366', 'weapon2': '1.398', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.139'} [2023-02-24 18:08:23,431][177172] DAMAGECOUNT value on done: 54503.0 [2023-02-24 18:08:23,432][177172] Sum rewards: -1.113, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.748', 'AMMO5': '0.028', 'AMMO2': '0.031', 'weapon7': '0.070', 'WEAPON1': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.139', 'AMMO4': '0.157', 'weapon5': '0.206', 'weapon4': '0.262', 'HITCOUNT': '0.270', 'WEAPON4': '0.300', 'ARMOR': '0.484', 'WEAPON5': '0.650', 'weapon2': '0.794', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.948', 'weapon3': '2.316', 'FRAGCOUNT': '2.500'} [2023-02-24 18:08:23,828][177157] DAMAGECOUNT value on done: 60302.0 [2023-02-24 18:08:23,829][177157] Sum rewards: 1.539, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.482', 'AMMO5': '0.017', 'AMMO2': '0.032', 'WEAPON1': '0.070', 'AMMO3': '0.134', 'AMMO4': '0.157', 'WEAPON4': '0.200', 'weapon4': '0.254', 'WEAPON5': '0.400', 'ARMOR': '0.443', 'weapon5': '0.480', 'HITCOUNT': '0.510', 'WEAPON3': '0.750', 'weapon2': '0.816', 'weapon3': '1.964', 'DAMAGECOUNT': '2.043', 'FRAGCOUNT': '5.000'} [2023-02-24 18:08:23,838][177157] DAMAGECOUNT value on done: 57543.0 [2023-02-24 18:08:23,839][177157] Sum rewards: 7.213, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.032', 'AMMO5': '0.010', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'AMMO3': '0.040', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.250', 'weapon5': '0.258', 'HITCOUNT': '0.290', 'ARMOR': '0.408', 'weapon4': '0.646', 'weapon3': '0.836', 'weapon2': '1.408', 'DAMAGECOUNT': '2.091', 'FRAGCOUNT': '5.000'} [2023-02-24 18:08:23,959][177171] DAMAGECOUNT value on done: 56932.0 [2023-02-24 18:08:23,960][177171] Sum rewards: 11.885, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.752', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO3': '0.071', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.182', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'HITCOUNT': '0.560', 'weapon3': '1.684', 'weapon2': '1.854', 'DAMAGECOUNT': '2.889', 'FRAGCOUNT': '10.000'} [2023-02-24 18:08:24,135][177157] DAMAGECOUNT value on done: 56413.0 [2023-02-24 18:08:24,136][177157] Sum rewards: 10.389, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.216', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'AMMO3': '0.061', 'AMMO4': '0.092', 'weapon7': '0.094', 'weapon5': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO6': '0.400', 'WEAPON7': '0.400', 'AMMO7': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.630', 'weapon4': '0.632', 'weapon2': '0.882', 'weapon3': '1.454', 'DAMAGECOUNT': '2.445', 'FRAGCOUNT': '8.000'} [2023-02-24 18:08:24,147][177157] DAMAGECOUNT value on done: 52141.0 [2023-02-24 18:08:24,147][177157] Sum rewards: 13.279, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO3': '0.040', 'AMMO4': '0.085', 'weapon7': '0.124', 'weapon5': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.256', 'HEALTH': '0.257', 'WEAPON7': '0.300', 'WEAPON3': '0.300', 'HITCOUNT': '0.530', 'weapon3': '0.970', 'weapon2': '2.266', 'DAMAGECOUNT': '2.943', 'FRAGCOUNT': '8.000'} [2023-02-24 18:08:24,256][177171] DAMAGECOUNT value on done: 54590.0 [2023-02-24 18:08:24,256][177171] Sum rewards: 9.485, reward structure: {'DEATHCOUNT': '-8.250', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO5': '0.017', 'weapon7': '0.060', 'AMMO4': '0.078', 'AMMO3': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HEALTH': '0.136', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.232', 'weapon5': '0.268', 'WEAPON5': '0.300', 'HITCOUNT': '0.510', 'WEAPON3': '0.650', 'weapon2': '1.150', 'weapon3': '1.918', 'DAMAGECOUNT': '4.209', 'FRAGCOUNT': '7.500'} [2023-02-24 18:08:24,538][177171] DAMAGECOUNT value on done: 56289.0 [2023-02-24 18:08:24,539][177171] Sum rewards: 0.992, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.440', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon5': '0.232', 'HITCOUNT': '0.290', 'WEAPON5': '0.300', 'weapon4': '0.384', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.287', 'weapon2': '1.382', 'weapon3': '1.684', 'FRAGCOUNT': '3.000'} [2023-02-24 18:08:24,758][177155] DAMAGECOUNT value on done: 57708.0 [2023-02-24 18:08:24,759][177155] Sum rewards: 6.448, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.454', 'AMMO5': '0.015', 'AMMO2': '0.024', 'WEAPON4': '0.050', 'WEAPON1': '0.050', 'weapon7': '0.064', 'AMMO3': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.118', 'weapon5': '0.216', 'weapon4': '0.342', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.440', 'weapon2': '0.560', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.629', 'weapon3': '1.860', 'FRAGCOUNT': '5.000'} [2023-02-24 18:08:24,813][177153] Updated weights for policy 0, policy_version 9320 (0.0008) [2023-02-24 18:08:24,833][177171] DAMAGECOUNT value on done: 54428.0 [2023-02-24 18:08:24,833][177171] Sum rewards: 11.526, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.520', 'AMMO5': '0.015', 'AMMO2': '0.015', 'ARMOR': '0.020', 'WEAPON1': '0.040', 'weapon7': '0.072', 'AMMO4': '0.075', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'weapon5': '0.254', 'WEAPON5': '0.300', 'weapon4': '0.332', 'HITCOUNT': '0.680', 'WEAPON3': '0.800', 'weapon3': '1.522', 'weapon2': '1.556', 'DAMAGECOUNT': '3.279', 'FRAGCOUNT': '10.000'} [2023-02-24 18:08:25,053][177155] DAMAGECOUNT value on done: 59517.0 [2023-02-24 18:08:25,053][177155] Sum rewards: 10.586, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.064', 'weapon7': '0.006', 'AMMO5': '0.015', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.089', 'AMMO4': '0.120', 'weapon4': '0.160', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.700', 'weapon3': '1.644', 'weapon2': '1.726', 'DAMAGECOUNT': '3.345', 'FRAGCOUNT': '11.000'} [2023-02-24 18:08:25,348][177155] DAMAGECOUNT value on done: 60547.0 [2023-02-24 18:08:25,348][177155] Sum rewards: 11.204, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.888', 'AMMO2': '0.014', 'AMMO5': '0.015', 'AMMO3': '0.050', 'AMMO4': '0.069', 'WEAPON1': '0.080', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.440', 'WEAPON3': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.520', 'HITCOUNT': '0.590', 'weapon2': '1.000', 'weapon3': '1.240', 'DAMAGECOUNT': '2.874', 'FRAGCOUNT': '8.000'} [2023-02-24 18:08:25,640][177155] DAMAGECOUNT value on done: 53907.0 [2023-02-24 18:08:25,640][177155] Sum rewards: 1.795, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.508', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.022', 'WEAPON1': '0.070', 'AMMO3': '0.145', 'weapon5': '0.294', 'HITCOUNT': '0.320', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'weapon2': '1.388', 'DAMAGECOUNT': '1.710', 'weapon3': '1.948', 'FRAGCOUNT': '4.000'} [2023-02-24 18:08:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 14023.6). Total num frames: 38195200. Throughput: 0: 3508.8. Samples: 9546442. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:08:26,376][177119] Avg episode reward: [(0, '4.467')] [2023-02-24 18:08:27,713][177153] Updated weights for policy 0, policy_version 9330 (0.0008) [2023-02-24 18:08:30,248][177156] DAMAGECOUNT value on done: 55009.0 [2023-02-24 18:08:30,248][177156] Sum rewards: 4.544, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.775', 'AMMO5': '0.012', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'weapon7': '0.040', 'weapon5': '0.094', 'AMMO4': '0.097', 'AMMO3': '0.123', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.480', 'HITCOUNT': '0.530', 'WEAPON3': '0.950', 'weapon2': '0.984', 'weapon3': '1.862', 'DAMAGECOUNT': '2.316', 'FRAGCOUNT': '7.000'} [2023-02-24 18:08:30,260][177156] DAMAGECOUNT value on done: 57626.0 [2023-02-24 18:08:30,260][177156] Sum rewards: 4.635, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.426', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.026', 'WEAPON1': '0.050', 'weapon7': '0.052', 'AMMO3': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.250', 'weapon5': '0.296', 'HITCOUNT': '0.420', 'WEAPON3': '0.650', 'weapon2': '1.414', 'DAMAGECOUNT': '1.689', 'weapon3': '1.798', 'FRAGCOUNT': '4.000'} [2023-02-24 18:08:30,549][177156] DAMAGECOUNT value on done: 57221.0 [2023-02-24 18:08:30,549][177156] Sum rewards: 10.194, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.165', 'AMMO2': '0.012', 'AMMO5': '0.019', 'weapon7': '0.048', 'AMMO4': '0.058', 'weapon4': '0.066', 'WEAPON1': '0.070', 'AMMO3': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.312', 'WEAPON5': '0.400', 'HITCOUNT': '0.570', 'WEAPON3': '0.700', 'weapon2': '1.274', 'weapon3': '1.966', 'DAMAGECOUNT': '2.661', 'FRAGCOUNT': '9.000'} [2023-02-24 18:08:30,560][177156] DAMAGECOUNT value on done: 60138.0 [2023-02-24 18:08:30,560][177156] Sum rewards: -0.984, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.180', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.041', 'WEAPON1': '0.070', 'weapon7': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.139', 'AMMO4': '0.206', 'weapon4': '0.294', 'WEAPON4': '0.300', 'weapon5': '0.322', 'HITCOUNT': '0.350', 'WEAPON5': '0.550', 'WEAPON3': '0.950', 'weapon2': '1.054', 'weapon3': '1.602', 'DAMAGECOUNT': '2.421', 'FRAGCOUNT': '3.000'} [2023-02-24 18:08:30,612][177153] Updated weights for policy 0, policy_version 9340 (0.0008) [2023-02-24 18:08:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14063.0, 300 sec: 14023.6). Total num frames: 38264832. Throughput: 0: 3514.1. Samples: 9567600. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:08:31,376][177119] Avg episode reward: [(0, '4.532')] [2023-02-24 18:08:32,699][177170] Large shaping reward 2.608 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5760000000000001, 192.0), ('weapon7', 0.002)] [2023-02-24 18:08:33,508][177153] Updated weights for policy 0, policy_version 9350 (0.0008) [2023-02-24 18:08:36,376][177119] Fps is (10 sec: 13926.6, 60 sec: 14062.9, 300 sec: 14023.6). Total num frames: 38334464. Throughput: 0: 3513.1. Samples: 9578150. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 18:08:36,376][177119] Avg episode reward: [(0, '4.532')] [2023-02-24 18:08:36,404][177153] Updated weights for policy 0, policy_version 9360 (0.0009) [2023-02-24 18:08:38,343][177170] DAMAGECOUNT value on done: 57664.0 [2023-02-24 18:08:38,343][177170] Sum rewards: 2.379, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.179', 'AMMO2': '0.016', 'AMMO5': '0.035', 'WEAPON1': '0.050', 'AMMO4': '0.082', 'AMMO3': '0.116', 'WEAPON4': '0.250', 'weapon5': '0.286', 'weapon4': '0.480', 'HITCOUNT': '0.620', 'WEAPON5': '0.750', 'weapon2': '0.814', 'WEAPON3': '0.850', 'weapon3': '1.884', 'DAMAGECOUNT': '2.325', 'FRAGCOUNT': '5.000'} [2023-02-24 18:08:38,638][177170] DAMAGECOUNT value on done: 61317.0 [2023-02-24 18:08:38,638][177170] Sum rewards: 8.564, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.860', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon7': '0.052', 'weapon4': '0.060', 'WEAPON1': '0.070', 'AMMO3': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.190', 'WEAPON4': '0.200', 'weapon5': '0.266', 'WEAPON5': '0.450', 'HITCOUNT': '0.500', 'WEAPON3': '0.600', 'weapon2': '1.260', 'weapon3': '1.894', 'DAMAGECOUNT': '2.931', 'FRAGCOUNT': '8.000'} [2023-02-24 18:08:38,688][177170] DAMAGECOUNT value on done: 51960.0 [2023-02-24 18:08:38,688][177170] Sum rewards: 7.341, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.921', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.057', 'AMMO3': '0.086', 'weapon7': '0.104', 'weapon5': '0.140', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON7': '0.400', 'HITCOUNT': '0.420', 'WEAPON3': '0.500', 'weapon4': '0.542', 'weapon3': '1.150', 'weapon2': '1.510', 'DAMAGECOUNT': '2.004', 'FRAGCOUNT': '7.000'} [2023-02-24 18:08:38,989][177170] DAMAGECOUNT value on done: 60859.0 [2023-02-24 18:08:38,989][177170] Sum rewards: 2.076, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.475', 'AMMO5': '0.011', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO3': '0.061', 'AMMO4': '0.091', 'weapon7': '0.100', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'weapon5': '0.254', 'HITCOUNT': '0.280', 'weapon4': '0.312', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'weapon3': '0.932', 'DAMAGECOUNT': '1.257', 'weapon2': '1.684', 'FRAGCOUNT': '2.000'} [2023-02-24 18:08:39,097][177158] DAMAGECOUNT value on done: 56143.0 [2023-02-24 18:08:39,098][177158] Sum rewards: 7.608, reward structure: {'DEATHCOUNT': '-9.750', 'ARMOR': '0.004', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO2': '0.030', 'weapon7': '0.048', 'AMMO3': '0.110', 'AMMO4': '0.150', 'WEAPON4': '0.250', 'weapon5': '0.256', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.420', 'WEAPON3': '0.600', 'HITCOUNT': '0.670', 'HEALTH': '0.924', 'weapon2': '1.082', 'weapon3': '1.820', 'DAMAGECOUNT': '2.697', 'FRAGCOUNT': '7.000'} [2023-02-24 18:08:39,262][177153] Updated weights for policy 0, policy_version 9370 (0.0008) [2023-02-24 18:08:39,379][177158] DAMAGECOUNT value on done: 54820.0 [2023-02-24 18:08:39,379][177158] Sum rewards: 5.099, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'weapon7': '0.046', 'weapon5': '0.050', 'AMMO3': '0.068', 'AMMO4': '0.078', 'HEALTH': '0.096', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'HITCOUNT': '0.420', 'ARMOR': '0.432', 'weapon4': '0.576', 'weapon3': '1.056', 'DAMAGECOUNT': '1.398', 'weapon2': '1.906', 'FRAGCOUNT': '3.000'} [2023-02-24 18:08:40,489][177158] DAMAGECOUNT value on done: 54867.0 [2023-02-24 18:08:40,490][177158] Sum rewards: 3.235, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.203', 'ARMOR': '0.004', 'AMMO2': '0.014', 'AMMO5': '0.020', 'WEAPON1': '0.060', 'AMMO4': '0.072', 'AMMO3': '0.073', 'weapon7': '0.110', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.270', 'weapon2': '0.274', 'HITCOUNT': '0.280', 'WEAPON7': '0.300', 'WEAPON3': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.682', 'weapon3': '1.042', 'DAMAGECOUNT': '1.947', 'FRAGCOUNT': '2.000'} [2023-02-24 18:08:40,783][177158] DAMAGECOUNT value on done: 58169.0 [2023-02-24 18:08:40,783][177158] Sum rewards: 2.548, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.860', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO5': '0.026', 'AMMO4': '0.032', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.124', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.304', 'HITCOUNT': '0.330', 'weapon5': '0.334', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'weapon2': '1.080', 'weapon3': '1.356', 'DAMAGECOUNT': '1.872', 'FRAGCOUNT': '6.000'} [2023-02-24 18:08:41,069][177172] DAMAGECOUNT value on done: 55500.0 [2023-02-24 18:08:41,069][177172] Sum rewards: 3.631, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'weapon4': '0.040', 'AMMO4': '0.057', 'HEALTH': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.129', 'weapon5': '0.200', 'WEAPON5': '0.350', 'HITCOUNT': '0.460', 'WEAPON3': '0.750', 'weapon2': '1.460', 'DAMAGECOUNT': '1.911', 'weapon3': '2.022', 'FRAGCOUNT': '5.000'} [2023-02-24 18:08:41,368][177172] DAMAGECOUNT value on done: 55325.0 [2023-02-24 18:08:41,369][177172] Sum rewards: 9.644, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.984', 'AMMO5': '0.017', 'AMMO2': '0.021', 'ARMOR': '0.024', 'WEAPON1': '0.060', 'AMMO4': '0.105', 'AMMO3': '0.141', 'WEAPON4': '0.300', 'weapon5': '0.316', 'weapon4': '0.422', 'WEAPON5': '0.550', 'HITCOUNT': '0.800', 'weapon2': '1.022', 'WEAPON3': '1.050', 'weapon3': '1.884', 'DAMAGECOUNT': '3.666', 'FRAGCOUNT': '12.000'} [2023-02-24 18:08:41,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14062.9, 300 sec: 14037.5). Total num frames: 38408192. Throughput: 0: 3513.0. Samples: 9599310. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 18:08:41,377][177119] Avg episode reward: [(0, '4.598')] [2023-02-24 18:08:41,828][177154] DAMAGECOUNT value on done: 60232.0 [2023-02-24 18:08:41,829][177154] Sum rewards: 6.937, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.640', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.044', 'AMMO3': '0.050', 'WEAPON5': '0.100', 'weapon7': '0.106', 'WEAPON4': '0.150', 'weapon4': '0.188', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.294', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.380', 'weapon3': '1.074', 'DAMAGECOUNT': '1.905', 'weapon2': '2.172', 'FRAGCOUNT': '6.000'} [2023-02-24 18:08:42,123][177154] DAMAGECOUNT value on done: 57703.0 [2023-02-24 18:08:42,124][177154] Sum rewards: 5.079, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.414', 'ARMOR': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'weapon7': '0.050', 'weapon5': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.124', 'AMMO4': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.378', 'HITCOUNT': '0.420', 'WEAPON3': '0.650', 'weapon2': '0.844', 'weapon3': '1.780', 'DAMAGECOUNT': '2.349', 'FRAGCOUNT': '6.000'} [2023-02-24 18:08:42,135][177154] DAMAGECOUNT value on done: 56940.0 [2023-02-24 18:08:42,136][177154] Sum rewards: 9.370, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.012', 'AMMO2': '0.013', 'ARMOR': '0.024', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.073', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HEALTH': '0.110', 'weapon5': '0.188', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.640', 'weapon3': '1.618', 'weapon2': '1.804', 'DAMAGECOUNT': '2.124', 'FRAGCOUNT': '6.000'} [2023-02-24 18:08:42,177][177153] Updated weights for policy 0, policy_version 9380 (0.0008) [2023-02-24 18:08:42,246][177172] DAMAGECOUNT value on done: 55034.0 [2023-02-24 18:08:42,247][177172] Sum rewards: 2.162, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.027', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.024', 'WEAPON1': '0.060', 'AMMO3': '0.101', 'AMMO4': '0.119', 'weapon5': '0.124', 'weapon7': '0.156', 'WEAPON4': '0.300', 'AMMO6': '0.360', 'AMMO7': '0.360', 'WEAPON5': '0.400', 'HITCOUNT': '0.430', 'WEAPON3': '0.600', 'WEAPON7': '0.600', 'weapon4': '0.670', 'weapon2': '0.792', 'weapon3': '1.594', 'DAMAGECOUNT': '1.728', 'FRAGCOUNT': '3.000'} [2023-02-24 18:08:42,422][177154] DAMAGECOUNT value on done: 56429.0 [2023-02-24 18:08:42,422][177154] Sum rewards: 2.126, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.039', 'AMMO2': '0.013', 'AMMO5': '0.017', 'weapon7': '0.054', 'WEAPON1': '0.060', 'AMMO4': '0.063', 'AMMO3': '0.105', 'WEAPON4': '0.200', 'weapon5': '0.292', 'AMMO6': '0.320', 'AMMO7': '0.320', 'weapon4': '0.374', 'WEAPON7': '0.400', 'HITCOUNT': '0.460', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'weapon2': '1.108', 'DAMAGECOUNT': '1.656', 'weapon3': '1.672', 'FRAGCOUNT': '4.000'} [2023-02-24 18:08:42,530][177172] DAMAGECOUNT value on done: 55130.0 [2023-02-24 18:08:42,531][177172] Sum rewards: 2.453, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.100', 'weapon7': '0.002', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.036', 'WEAPON1': '0.060', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.121', 'AMMO4': '0.181', 'weapon5': '0.310', 'weapon2': '0.362', 'WEAPON4': '0.500', 'HITCOUNT': '0.560', 'WEAPON5': '0.600', 'weapon4': '0.842', 'WEAPON3': '0.900', 'weapon3': '1.872', 'DAMAGECOUNT': '1.881', 'FRAGCOUNT': '5.000'} [2023-02-24 18:08:42,905][177157] DAMAGECOUNT value on done: 58098.0 [2023-02-24 18:08:42,905][177157] Sum rewards: 4.791, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.068', 'AMMO5': '0.020', 'AMMO2': '0.022', 'weapon7': '0.052', 'WEAPON1': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.108', 'weapon5': '0.124', 'HITCOUNT': '0.380', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.665', 'weapon3': '1.742', 'weapon2': '1.860', 'FRAGCOUNT': '5.000'} [2023-02-24 18:08:42,915][177157] DAMAGECOUNT value on done: 60871.0 [2023-02-24 18:08:42,915][177157] Sum rewards: 6.736, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.534', 'AMMO5': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.060', 'weapon7': '0.066', 'AMMO4': '0.073', 'AMMO3': '0.089', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.222', 'weapon5': '0.272', 'WEAPON5': '0.300', 'HITCOUNT': '0.380', 'WEAPON3': '0.550', 'weapon3': '1.326', 'DAMAGECOUNT': '1.707', 'weapon2': '1.748', 'FRAGCOUNT': '6.000'} [2023-02-24 18:08:43,063][177171] DAMAGECOUNT value on done: 57632.0 [2023-02-24 18:08:43,063][177171] Sum rewards: 2.794, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.642', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'weapon5': '0.092', 'AMMO3': '0.138', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.408', 'weapon4': '0.554', 'HITCOUNT': '0.580', 'WEAPON3': '0.900', 'weapon2': '1.132', 'weapon3': '1.846', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '7.000'} [2023-02-24 18:08:43,211][177157] DAMAGECOUNT value on done: 53455.0 [2023-02-24 18:08:43,211][177157] Sum rewards: 9.990, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.515', 'AMMO2': '0.016', 'AMMO5': '0.019', 'ARMOR': '0.028', 'WEAPON1': '0.030', 'weapon7': '0.052', 'AMMO4': '0.081', 'weapon5': '0.116', 'weapon4': '0.126', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON5': '0.450', 'HITCOUNT': '0.960', 'weapon2': '1.074', 'WEAPON3': '1.250', 'weapon3': '2.308', 'DAMAGECOUNT': '3.942', 'FRAGCOUNT': '12.000'} [2023-02-24 18:08:43,222][177157] DAMAGECOUNT value on done: 57391.0 [2023-02-24 18:08:43,222][177157] Sum rewards: 7.390, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.412', 'AMMO5': '0.020', 'AMMO2': '0.026', 'ARMOR': '0.040', 'WEAPON1': '0.070', 'weapon7': '0.096', 'AMMO4': '0.130', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.222', 'WEAPON5': '0.350', 'weapon4': '0.504', 'weapon2': '0.516', 'HITCOUNT': '0.700', 'WEAPON3': '0.850', 'weapon3': '1.958', 'DAMAGECOUNT': '2.934', 'FRAGCOUNT': '7.000'} [2023-02-24 18:08:43,364][177171] DAMAGECOUNT value on done: 55603.0 [2023-02-24 18:08:43,364][177171] Sum rewards: 6.236, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.239', 'AMMO2': '0.015', 'AMMO5': '0.015', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'weapon7': '0.054', 'AMMO4': '0.073', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'weapon4': '0.184', 'weapon5': '0.250', 'WEAPON5': '0.350', 'HITCOUNT': '0.700', 'WEAPON3': '0.800', 'weapon2': '1.156', 'weapon3': '2.026', 'DAMAGECOUNT': '3.039', 'FRAGCOUNT': '7.000'} [2023-02-24 18:08:43,652][177171] DAMAGECOUNT value on done: 56726.0 [2023-02-24 18:08:43,653][177171] Sum rewards: 5.122, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.968', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO3': '0.057', 'WEAPON1': '0.060', 'AMMO4': '0.071', 'weapon5': '0.092', 'weapon7': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.128', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HITCOUNT': '0.280', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'ARMOR': '0.400', 'weapon3': '0.900', 'DAMAGECOUNT': '1.311', 'weapon2': '2.628', 'FRAGCOUNT': '3.000'} [2023-02-24 18:08:43,825][177155] DAMAGECOUNT value on done: 58763.0 [2023-02-24 18:08:43,825][177155] Sum rewards: 12.163, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.016', 'HEALTH': '0.028', 'WEAPON1': '0.050', 'AMMO3': '0.112', 'WEAPON5': '0.250', 'weapon5': '0.340', 'HITCOUNT': '0.570', 'WEAPON3': '0.650', 'weapon2': '1.028', 'weapon3': '2.188', 'DAMAGECOUNT': '3.165', 'FRAGCOUNT': '10.500'} [2023-02-24 18:08:43,964][177171] DAMAGECOUNT value on done: 55360.0 [2023-02-24 18:08:43,964][177171] Sum rewards: 7.804, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.800', 'AMMO5': '0.008', 'ARMOR': '0.010', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'AMMO4': '0.103', 'AMMO3': '0.110', 'weapon5': '0.114', 'weapon7': '0.158', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO6': '0.320', 'AMMO7': '0.320', 'weapon4': '0.384', 'WEAPON7': '0.400', 'HITCOUNT': '0.580', 'WEAPON3': '0.650', 'weapon2': '1.390', 'weapon3': '1.550', 'DAMAGECOUNT': '2.796', 'FRAGCOUNT': '6.000'} [2023-02-24 18:08:44,130][177155] DAMAGECOUNT value on done: 60432.0 [2023-02-24 18:08:44,130][177155] Sum rewards: 4.026, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.070', 'AMMO2': '0.004', 'AMMO5': '0.009', 'AMMO4': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.040', 'weapon4': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.124', 'WEAPON5': '0.200', 'weapon7': '0.216', 'AMMO6': '0.340', 'AMMO7': '0.340', 'ARMOR': '0.462', 'WEAPON7': '0.500', 'HITCOUNT': '0.640', 'WEAPON3': '0.900', 'weapon2': '1.614', 'weapon3': '1.826', 'DAMAGECOUNT': '2.745', 'FRAGCOUNT': '5.000'} [2023-02-24 18:08:44,425][177155] DAMAGECOUNT value on done: 61046.0 [2023-02-24 18:08:44,425][177155] Sum rewards: 3.429, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.810', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'weapon7': '0.052', 'AMMO3': '0.079', 'AMMO4': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.122', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.224', 'WEAPON4': '0.250', 'HITCOUNT': '0.330', 'WEAPON3': '0.550', 'weapon3': '1.330', 'DAMAGECOUNT': '1.497', 'weapon2': '2.056', 'FRAGCOUNT': '3.000'} [2023-02-24 18:08:44,725][177155] DAMAGECOUNT value on done: 54361.0 [2023-02-24 18:08:44,725][177155] Sum rewards: 6.424, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.004', 'AMMO5': '0.009', 'AMMO2': '0.030', 'WEAPON1': '0.040', 'weapon7': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.081', 'weapon5': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'HITCOUNT': '0.290', 'weapon4': '0.352', 'WEAPON3': '0.450', 'weapon3': '1.042', 'DAMAGECOUNT': '1.362', 'weapon2': '1.678', 'FRAGCOUNT': '4.000'} [2023-02-24 18:08:45,083][177153] Updated weights for policy 0, policy_version 9390 (0.0008) [2023-02-24 18:08:46,376][177119] Fps is (10 sec: 14335.8, 60 sec: 14062.9, 300 sec: 14037.5). Total num frames: 38477824. Throughput: 0: 3515.9. Samples: 9620416. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 18:08:46,376][177119] Avg episode reward: [(0, '4.963')] [2023-02-24 18:08:47,982][177153] Updated weights for policy 0, policy_version 9400 (0.0008) [2023-02-24 18:08:49,356][177156] DAMAGECOUNT value on done: 55464.0 [2023-02-24 18:08:49,357][177156] Sum rewards: -1.375, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.865', 'AMMO5': '0.017', 'AMMO2': '0.043', 'WEAPON1': '0.050', 'weapon5': '0.120', 'weapon7': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'AMMO4': '0.216', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HITCOUNT': '0.280', 'weapon4': '0.298', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.652', 'WEAPON3': '1.050', 'DAMAGECOUNT': '1.365', 'weapon3': '2.354', 'FRAGCOUNT': '3.000'} [2023-02-24 18:08:49,367][177156] DAMAGECOUNT value on done: 58250.0 [2023-02-24 18:08:49,368][177156] Sum rewards: 2.103, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.258', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.029', 'WEAPON1': '0.050', 'weapon7': '0.102', 'AMMO3': '0.104', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'weapon5': '0.196', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon2': '0.268', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.440', 'weapon4': '0.554', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.872', 'weapon3': '2.030', 'FRAGCOUNT': '3.000'} [2023-02-24 18:08:49,662][177156] DAMAGECOUNT value on done: 58194.0 [2023-02-24 18:08:49,663][177156] Sum rewards: 9.533, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.764', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'AMMO2': '0.022', 'weapon7': '0.052', 'weapon5': '0.078', 'AMMO4': '0.111', 'AMMO3': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon2': '0.250', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'HITCOUNT': '0.640', 'weapon4': '0.698', 'WEAPON3': '0.750', 'weapon3': '2.014', 'DAMAGECOUNT': '2.919', 'FRAGCOUNT': '9.000'} [2023-02-24 18:08:49,673][177156] DAMAGECOUNT value on done: 60487.0 [2023-02-24 18:08:49,674][177156] Sum rewards: -0.171, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.571', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon7': '0.048', 'AMMO4': '0.094', 'AMMO3': '0.094', 'weapon5': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'WEAPON3': '0.600', 'weapon4': '0.632', 'DAMAGECOUNT': '1.047', 'weapon2': '1.386', 'weapon3': '1.404', 'FRAGCOUNT': '2.000'} [2023-02-24 18:08:50,757][177157] Large shaping reward 2.593 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.561, 187.0), ('weapon7', 0.002)] [2023-02-24 18:08:50,901][177153] Updated weights for policy 0, policy_version 9410 (0.0008) [2023-02-24 18:08:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 14037.5). Total num frames: 38547456. Throughput: 0: 3518.3. Samples: 9631002. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 18:08:51,376][177119] Avg episode reward: [(0, '4.871')] [2023-02-24 18:08:53,816][177153] Updated weights for policy 0, policy_version 9420 (0.0008) [2023-02-24 18:08:56,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 14023.6). Total num frames: 38617088. Throughput: 0: 3515.9. Samples: 9652072. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 18:08:56,376][177119] Avg episode reward: [(0, '4.871')] [2023-02-24 18:08:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000009428_38617088.pth... [2023-02-24 18:08:56,443][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000008606_35250176.pth [2023-02-24 18:08:56,735][177153] Updated weights for policy 0, policy_version 9430 (0.0008) [2023-02-24 18:08:57,300][177170] DAMAGECOUNT value on done: 58125.0 [2023-02-24 18:08:57,301][177170] Sum rewards: 0.819, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.159', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'weapon7': '0.064', 'AMMO3': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.310', 'weapon2': '0.368', 'weapon4': '0.734', 'WEAPON3': '0.750', 'ARMOR': '0.865', 'DAMAGECOUNT': '1.383', 'weapon3': '1.746', 'FRAGCOUNT': '3.000'} [2023-02-24 18:08:57,586][177170] DAMAGECOUNT value on done: 62736.0 [2023-02-24 18:08:57,587][177170] Sum rewards: 15.884, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.434', 'AMMO5': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.095', 'WEAPON4': '0.150', 'weapon4': '0.262', 'weapon5': '0.328', 'WEAPON5': '0.350', 'ARMOR': '0.453', 'WEAPON3': '0.650', 'HITCOUNT': '0.910', 'weapon2': '1.054', 'weapon3': '1.906', 'DAMAGECOUNT': '4.257', 'FRAGCOUNT': '12.500'} [2023-02-24 18:08:57,619][177170] DAMAGECOUNT value on done: 52410.0 [2023-02-24 18:08:57,619][177170] Sum rewards: 5.433, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.410', 'AMMO5': '0.003', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.023', 'AMMO3': '0.046', 'WEAPON5': '0.050', 'weapon7': '0.052', 'WEAPON4': '0.100', 'weapon5': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.300', 'WEAPON3': '0.300', 'weapon3': '0.884', 'DAMAGECOUNT': '1.350', 'weapon2': '1.928', 'FRAGCOUNT': '4.000'} [2023-02-24 18:08:57,914][177170] DAMAGECOUNT value on done: 61972.0 [2023-02-24 18:08:57,915][177170] Sum rewards: 6.080, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.625', 'AMMO2': '0.016', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'weapon5': '0.066', 'AMMO4': '0.079', 'AMMO3': '0.125', 'WEAPON4': '0.200', 'weapon4': '0.346', 'WEAPON5': '0.350', 'AMMO6': '0.400', 'WEAPON7': '0.400', 'AMMO7': '0.400', 'ARMOR': '0.456', 'HITCOUNT': '0.660', 'WEAPON3': '0.850', 'weapon2': '1.042', 'weapon3': '2.166', 'DAMAGECOUNT': '3.339', 'FRAGCOUNT': '6.500'} [2023-02-24 18:08:58,205][177158] DAMAGECOUNT value on done: 56660.0 [2023-02-24 18:08:58,205][177158] Sum rewards: 1.988, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.450', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.020', 'weapon5': '0.034', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'weapon7': '0.152', 'WEAPON5': '0.200', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'HITCOUNT': '0.460', 'WEAPON3': '0.550', 'weapon4': '0.610', 'weapon2': '1.070', 'weapon3': '1.332', 'DAMAGECOUNT': '1.551', 'FRAGCOUNT': '2.000'} [2023-02-24 18:08:58,517][177158] DAMAGECOUNT value on done: 55387.0 [2023-02-24 18:08:58,518][177158] Sum rewards: 6.170, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.439', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'WEAPON4': '0.200', 'WEAPON3': '0.500', 'HITCOUNT': '0.600', 'weapon4': '0.638', 'ARMOR': '0.899', 'weapon2': '1.236', 'DAMAGECOUNT': '1.701', 'weapon3': '1.748', 'FRAGCOUNT': '4.000'} [2023-02-24 18:08:59,562][177158] DAMAGECOUNT value on done: 55560.0 [2023-02-24 18:08:59,563][177158] Sum rewards: 4.010, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.784', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO2': '0.034', 'weapon7': '0.078', 'AMMO3': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.172', 'weapon5': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'HITCOUNT': '0.510', 'WEAPON3': '0.550', 'weapon4': '0.638', 'weapon2': '0.852', 'weapon3': '0.994', 'DAMAGECOUNT': '2.079', 'FRAGCOUNT': '6.000'} [2023-02-24 18:08:59,639][177153] Updated weights for policy 0, policy_version 9440 (0.0008) [2023-02-24 18:08:59,868][177158] DAMAGECOUNT value on done: 59015.0 [2023-02-24 18:08:59,869][177158] Sum rewards: 5.541, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.225', 'ARMOR': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon5': '0.066', 'AMMO3': '0.100', 'AMMO4': '0.115', 'WEAPON4': '0.200', 'weapon7': '0.200', 'WEAPON5': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'HITCOUNT': '0.500', 'WEAPON3': '0.700', 'weapon4': '0.720', 'weapon2': '1.128', 'weapon3': '1.396', 'DAMAGECOUNT': '2.538', 'FRAGCOUNT': '4.500'} [2023-02-24 18:09:00,175][177172] DAMAGECOUNT value on done: 56727.0 [2023-02-24 18:09:00,176][177172] Sum rewards: 9.486, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.294', 'AMMO5': '0.011', 'ARMOR': '0.020', 'WEAPON1': '0.030', 'AMMO2': '0.034', 'AMMO3': '0.053', 'weapon7': '0.068', 'AMMO4': '0.169', 'weapon5': '0.196', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON3': '0.350', 'WEAPON4': '0.400', 'HITCOUNT': '0.590', 'weapon3': '0.946', 'weapon4': '1.270', 'DAMAGECOUNT': '3.174', 'FRAGCOUNT': '8.000'} [2023-02-24 18:09:00,483][177172] DAMAGECOUNT value on done: 55865.0 [2023-02-24 18:09:00,484][177172] Sum rewards: 1.934, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.552', 'AMMO2': '0.026', 'AMMO3': '0.076', 'weapon7': '0.102', 'AMMO4': '0.131', 'HITCOUNT': '0.270', 'AMMO6': '0.340', 'AMMO7': '0.340', 'ARMOR': '0.484', 'WEAPON7': '0.500', 'WEAPON4': '0.500', 'WEAPON3': '0.550', 'weapon2': '0.924', 'weapon3': '0.946', 'weapon4': '1.176', 'DAMAGECOUNT': '1.620', 'FRAGCOUNT': '3.000'} [2023-02-24 18:09:01,003][177154] DAMAGECOUNT value on done: 61126.0 [2023-02-24 18:09:01,004][177154] Sum rewards: 9.659, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.460', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.016', 'WEAPON1': '0.080', 'AMMO3': '0.116', 'weapon5': '0.208', 'WEAPON5': '0.450', 'HITCOUNT': '0.680', 'WEAPON3': '1.000', 'weapon2': '1.008', 'weapon3': '2.394', 'DAMAGECOUNT': '2.682', 'FRAGCOUNT': '11.000'} [2023-02-24 18:09:01,297][177154] DAMAGECOUNT value on done: 58502.0 [2023-02-24 18:09:01,297][177154] Sum rewards: 7.072, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.615', 'AMMO2': '0.019', 'AMMO5': '0.020', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.084', 'AMMO4': '0.095', 'weapon4': '0.096', 'HITCOUNT': '0.400', 'weapon5': '0.438', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon2': '1.164', 'weapon3': '1.764', 'DAMAGECOUNT': '2.397', 'FRAGCOUNT': '6.000'} [2023-02-24 18:09:01,307][177154] DAMAGECOUNT value on done: 57875.0 [2023-02-24 18:09:01,307][177154] Sum rewards: 10.380, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.822', 'AMMO2': '0.002', 'AMMO4': '0.012', 'AMMO5': '0.012', 'ARMOR': '0.020', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.085', 'weapon4': '0.086', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.236', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.670', 'weapon3': '1.528', 'weapon2': '1.914', 'DAMAGECOUNT': '2.805', 'FRAGCOUNT': '9.000'} [2023-02-24 18:09:01,364][177172] DAMAGECOUNT value on done: 55416.0 [2023-02-24 18:09:01,364][177172] Sum rewards: 5.406, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.005', 'HEALTH': '0.020', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.040', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'weapon5': '0.168', 'HITCOUNT': '0.210', 'WEAPON3': '0.300', 'weapon4': '0.322', 'ARMOR': '0.400', 'weapon3': '1.010', 'weapon2': '1.062', 'DAMAGECOUNT': '1.146', 'FRAGCOUNT': '3.000'} [2023-02-24 18:09:01,376][177119] Fps is (10 sec: 13926.1, 60 sec: 14062.9, 300 sec: 14023.6). Total num frames: 38686720. Throughput: 0: 3517.9. Samples: 9673120. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:09:01,377][177119] Avg episode reward: [(0, '5.337')] [2023-02-24 18:09:01,378][177140] Saving new best policy, reward=5.337! [2023-02-24 18:09:01,606][177154] DAMAGECOUNT value on done: 57446.0 [2023-02-24 18:09:01,606][177154] Sum rewards: 10.750, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.532', 'AMMO5': '0.014', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'weapon7': '0.054', 'AMMO3': '0.088', 'AMMO4': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.212', 'WEAPON5': '0.350', 'HITCOUNT': '0.480', 'weapon4': '0.586', 'WEAPON3': '0.650', 'weapon2': '0.656', 'ARMOR': '1.316', 'weapon3': '1.336', 'DAMAGECOUNT': '3.051', 'FRAGCOUNT': '8.000'} [2023-02-24 18:09:01,674][177172] DAMAGECOUNT value on done: 56099.0 [2023-02-24 18:09:01,674][177172] Sum rewards: 5.256, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.473', 'AMMO2': '0.005', 'AMMO5': '0.012', 'ARMOR': '0.020', 'AMMO4': '0.026', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'weapon4': '0.130', 'weapon5': '0.150', 'WEAPON5': '0.350', 'HITCOUNT': '0.510', 'WEAPON3': '0.900', 'weapon2': '1.494', 'weapon3': '1.944', 'DAMAGECOUNT': '2.907', 'FRAGCOUNT': '7.000'} [2023-02-24 18:09:02,033][177157] DAMAGECOUNT value on done: 58203.0 [2023-02-24 18:09:02,034][177157] Sum rewards: 0.553, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.490', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'weapon7': '0.046', 'AMMO4': '0.049', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.315', 'weapon2': '0.394', 'weapon4': '0.422', 'WEAPON3': '0.500', 'ARMOR': '0.500', 'weapon3': '1.296', 'FRAGCOUNT': '2.000'} [2023-02-24 18:09:02,044][177157] DAMAGECOUNT value on done: 61576.0 [2023-02-24 18:09:02,044][177157] Sum rewards: 8.990, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.182', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'AMMO3': '0.077', 'AMMO4': '0.093', 'weapon5': '0.106', 'WEAPON4': '0.150', 'weapon7': '0.166', 'WEAPON5': '0.250', 'HITCOUNT': '0.340', 'AMMO6': '0.340', 'AMMO7': '0.340', 'weapon4': '0.394', 'WEAPON7': '0.500', 'WEAPON3': '0.550', 'weapon3': '1.148', 'weapon2': '1.784', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '7.000'} [2023-02-24 18:09:02,212][177171] DAMAGECOUNT value on done: 58130.0 [2023-02-24 18:09:02,212][177171] Sum rewards: 5.942, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.235', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon7': '0.050', 'AMMO3': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.110', 'weapon5': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.420', 'ARMOR': '0.439', 'weapon4': '0.692', 'weapon2': '0.848', 'weapon3': '1.478', 'DAMAGECOUNT': '1.494', 'FRAGCOUNT': '4.500'} [2023-02-24 18:09:02,335][177157] DAMAGECOUNT value on done: 54840.0 [2023-02-24 18:09:02,335][177157] Sum rewards: 13.578, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.366', 'AMMO5': '0.016', 'AMMO2': '0.019', 'ARMOR': '0.020', 'WEAPON1': '0.040', 'AMMO4': '0.092', 'AMMO3': '0.095', 'weapon7': '0.098', 'weapon5': '0.122', 'WEAPON4': '0.150', 'weapon4': '0.374', 'WEAPON5': '0.400', 'AMMO6': '0.400', 'WEAPON7': '0.400', 'AMMO7': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.730', 'weapon2': '1.052', 'weapon3': '2.030', 'DAMAGECOUNT': '4.155', 'FRAGCOUNT': '11.000'} [2023-02-24 18:09:02,347][177157] DAMAGECOUNT value on done: 57658.0 [2023-02-24 18:09:02,348][177157] Sum rewards: 1.806, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.769', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.038', 'AMMO3': '0.046', 'weapon7': '0.046', 'WEAPON4': '0.050', 'weapon5': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.170', 'WEAPON5': '0.200', 'weapon4': '0.316', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.801', 'weapon3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.272'} [2023-02-24 18:09:02,510][177171] DAMAGECOUNT value on done: 56292.0 [2023-02-24 18:09:02,511][177171] Sum rewards: 6.420, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.040', 'AMMO4': '0.041', 'weapon7': '0.046', 'AMMO3': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.218', 'HEALTH': '0.392', 'HITCOUNT': '0.400', 'WEAPON3': '0.550', 'weapon3': '1.650', 'weapon2': '1.712', 'DAMAGECOUNT': '2.067', 'FRAGCOUNT': '4.000'} [2023-02-24 18:09:02,605][177153] Updated weights for policy 0, policy_version 9450 (0.0008) [2023-02-24 18:09:02,775][177171] DAMAGECOUNT value on done: 56982.0 [2023-02-24 18:09:02,776][177171] Sum rewards: 3.845, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.000', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.047', 'AMMO3': '0.064', 'WEAPON5': '0.100', 'weapon7': '0.148', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.316', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON3': '0.450', 'WEAPON7': '0.500', 'DAMAGECOUNT': '0.768', 'weapon3': '0.942', 'FRAGCOUNT': '2.000', 'weapon2': '2.196'} [2023-02-24 18:09:02,990][177155] DAMAGECOUNT value on done: 59479.0 [2023-02-24 18:09:02,991][177155] Sum rewards: 2.933, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.474', 'AMMO2': '0.002', 'AMMO4': '0.012', 'AMMO5': '0.014', 'weapon5': '0.036', 'WEAPON1': '0.060', 'AMMO3': '0.094', 'weapon7': '0.162', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'AMMO6': '0.340', 'AMMO7': '0.340', 'HITCOUNT': '0.410', 'WEAPON7': '0.500', 'WEAPON3': '0.600', 'weapon4': '0.646', 'weapon3': '1.092', 'weapon2': '1.150', 'DAMAGECOUNT': '2.148', 'FRAGCOUNT': '3.000'} [2023-02-24 18:09:03,073][177171] DAMAGECOUNT value on done: 56282.0 [2023-02-24 18:09:03,073][177171] Sum rewards: 8.970, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.102', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'ARMOR': '0.010', 'AMMO5': '0.017', 'weapon7': '0.070', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.262', 'weapon4': '0.326', 'WEAPON5': '0.450', 'HITCOUNT': '0.560', 'WEAPON3': '0.800', 'weapon2': '1.062', 'weapon3': '1.778', 'DAMAGECOUNT': '2.766', 'FRAGCOUNT': '8.000'} [2023-02-24 18:09:03,292][177155] DAMAGECOUNT value on done: 60896.0 [2023-02-24 18:09:03,292][177155] Sum rewards: 4.119, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.680', 'AMMO5': '0.013', 'AMMO2': '0.017', 'weapon7': '0.036', 'WEAPON1': '0.050', 'AMMO3': '0.079', 'AMMO4': '0.085', 'weapon4': '0.086', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'weapon5': '0.240', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon3': '1.380', 'DAMAGECOUNT': '1.392', 'weapon2': '1.980', 'FRAGCOUNT': '4.000'} [2023-02-24 18:09:03,588][177155] DAMAGECOUNT value on done: 61667.0 [2023-02-24 18:09:03,588][177155] Sum rewards: 5.810, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.660', 'AMMO2': '0.011', 'AMMO5': '0.014', 'AMMO4': '0.056', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon5': '0.254', 'ARMOR': '0.478', 'WEAPON5': '0.500', 'HITCOUNT': '0.530', 'WEAPON3': '0.900', 'weapon2': '1.556', 'weapon3': '1.790', 'DAMAGECOUNT': '1.863', 'FRAGCOUNT': '7.000'} [2023-02-24 18:09:03,885][177155] DAMAGECOUNT value on done: 55139.0 [2023-02-24 18:09:03,886][177155] Sum rewards: 4.635, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.720', 'ARMOR': '0.008', 'AMMO5': '0.016', 'WEAPON1': '0.030', 'AMMO2': '0.038', 'weapon7': '0.102', 'weapon5': '0.112', 'AMMO3': '0.130', 'AMMO4': '0.191', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'AMMO6': '0.540', 'AMMO7': '0.540', 'HITCOUNT': '0.610', 'WEAPON3': '0.700', 'WEAPON7': '0.700', 'weapon2': '0.774', 'weapon4': '1.038', 'weapon3': '1.492', 'DAMAGECOUNT': '2.334', 'FRAGCOUNT': '6.000'} [2023-02-24 18:09:05,529][177153] Updated weights for policy 0, policy_version 9460 (0.0009) [2023-02-24 18:09:05,916][177157] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:09:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14023.6). Total num frames: 38756352. Throughput: 0: 3515.8. Samples: 9683588. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:09:06,376][177119] Avg episode reward: [(0, '5.637')] [2023-02-24 18:09:06,390][177140] Saving new best policy, reward=5.637! [2023-02-24 18:09:08,453][177153] Updated weights for policy 0, policy_version 9470 (0.0009) [2023-02-24 18:09:08,506][177156] DAMAGECOUNT value on done: 56008.0 [2023-02-24 18:09:08,507][177156] Sum rewards: 7.440, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.090', 'AMMO2': '0.002', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO4': '0.011', 'AMMO3': '0.030', 'weapon5': '0.046', 'weapon7': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.320', 'weapon3': '0.694', 'DAMAGECOUNT': '1.632', 'weapon2': '1.790', 'FRAGCOUNT': '5.000'} [2023-02-24 18:09:08,518][177156] DAMAGECOUNT value on done: 58920.0 [2023-02-24 18:09:08,518][177156] Sum rewards: 6.230, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.454', 'AMMO5': '0.003', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.026', 'weapon5': '0.046', 'weapon7': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.068', 'weapon4': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.390', 'WEAPON3': '0.500', 'weapon3': '1.312', 'weapon2': '1.640', 'DAMAGECOUNT': '2.010', 'FRAGCOUNT': '4.500'} [2023-02-24 18:09:08,817][177156] DAMAGECOUNT value on done: 59122.0 [2023-02-24 18:09:08,817][177156] Sum rewards: 6.498, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.404', 'weapon7': '0.004', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.019', 'WEAPON1': '0.070', 'AMMO4': '0.093', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.238', 'weapon4': '0.314', 'WEAPON5': '0.350', 'HITCOUNT': '0.620', 'WEAPON3': '0.850', 'weapon2': '1.124', 'weapon3': '1.800', 'DAMAGECOUNT': '2.784', 'FRAGCOUNT': '8.000'} [2023-02-24 18:09:08,828][177156] DAMAGECOUNT value on done: 60801.0 [2023-02-24 18:09:08,829][177156] Sum rewards: 1.634, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.847', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.044', 'weapon5': '0.104', 'AMMO4': '0.104', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON3': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.290', 'HITCOUNT': '0.340', 'weapon3': '0.922', 'DAMAGECOUNT': '0.942', 'FRAGCOUNT': '2.000', 'weapon2': '2.382'} [2023-02-24 18:09:11,349][177153] Updated weights for policy 0, policy_version 9480 (0.0008) [2023-02-24 18:09:11,376][177119] Fps is (10 sec: 14336.3, 60 sec: 14062.9, 300 sec: 14037.5). Total num frames: 38830080. Throughput: 0: 3516.8. Samples: 9704698. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:09:11,376][177119] Avg episode reward: [(0, '5.732')] [2023-02-24 18:09:11,377][177140] Saving new best policy, reward=5.732! [2023-02-24 18:09:14,283][177153] Updated weights for policy 0, policy_version 9490 (0.0008) [2023-02-24 18:09:15,480][177157] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.561, 187.0)] [2023-02-24 18:09:16,376][177119] Fps is (10 sec: 14336.1, 60 sec: 14062.9, 300 sec: 14037.5). Total num frames: 38899712. Throughput: 0: 3513.1. Samples: 9725690. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:09:16,376][177119] Avg episode reward: [(0, '5.732')] [2023-02-24 18:09:16,519][177170] DAMAGECOUNT value on done: 59064.0 [2023-02-24 18:09:16,520][177170] Sum rewards: 6.939, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.456', 'AMMO5': '0.009', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'weapon7': '0.038', 'AMMO3': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.105', 'weapon5': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.434', 'ARMOR': '0.464', 'HITCOUNT': '0.660', 'WEAPON3': '0.750', 'weapon2': '0.998', 'weapon3': '1.814', 'DAMAGECOUNT': '2.817', 'FRAGCOUNT': '7.500'} [2023-02-24 18:09:16,816][177170] DAMAGECOUNT value on done: 63273.0 [2023-02-24 18:09:16,816][177170] Sum rewards: 1.857, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.432', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'weapon7': '0.070', 'AMMO4': '0.089', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'weapon5': '0.208', 'WEAPON5': '0.250', 'weapon4': '0.272', 'HITCOUNT': '0.330', 'WEAPON3': '0.600', 'weapon2': '1.254', 'weapon3': '1.476', 'DAMAGECOUNT': '1.611', 'FRAGCOUNT': '4.000'} [2023-02-24 18:09:16,828][177170] DAMAGECOUNT value on done: 52828.0 [2023-02-24 18:09:16,829][177170] Sum rewards: 2.039, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.531', 'AMMO2': '0.007', 'AMMO5': '0.017', 'ARMOR': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.034', 'weapon5': '0.048', 'AMMO3': '0.080', 'weapon7': '0.118', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.266', 'WEAPON5': '0.350', 'HITCOUNT': '0.360', 'WEAPON7': '0.400', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.254', 'weapon3': '1.518', 'weapon2': '1.738', 'FRAGCOUNT': '2.000'} [2023-02-24 18:09:17,121][177170] DAMAGECOUNT value on done: 62610.0 [2023-02-24 18:09:17,122][177170] Sum rewards: 3.419, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.468', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON1': '0.070', 'weapon5': '0.074', 'AMMO4': '0.092', 'weapon7': '0.096', 'AMMO3': '0.111', 'WEAPON4': '0.150', 'weapon4': '0.198', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.490', 'WEAPON3': '0.850', 'weapon2': '1.474', 'weapon3': '1.902', 'DAMAGECOUNT': '1.914', 'FRAGCOUNT': '4.000'} [2023-02-24 18:09:17,211][177153] Updated weights for policy 0, policy_version 9500 (0.0008) [2023-02-24 18:09:17,363][177158] DAMAGECOUNT value on done: 57174.0 [2023-02-24 18:09:17,364][177158] Sum rewards: -0.980, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.844', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'weapon5': '0.026', 'AMMO2': '0.028', 'weapon7': '0.052', 'AMMO3': '0.062', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.141', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.340', 'ARMOR': '0.404', 'WEAPON3': '0.450', 'WEAPON4': '0.550', 'weapon3': '0.936', 'weapon4': '1.094', 'DAMAGECOUNT': '1.542', 'weapon2': '1.570', 'FRAGCOUNT': '2.000'} [2023-02-24 18:09:17,655][177158] DAMAGECOUNT value on done: 56250.0 [2023-02-24 18:09:17,655][177158] Sum rewards: 6.348, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.656', 'AMMO5': '0.012', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon7': '0.064', 'AMMO4': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.122', 'weapon5': '0.192', 'weapon4': '0.226', 'WEAPON5': '0.350', 'HITCOUNT': '0.580', 'WEAPON3': '0.850', 'weapon2': '1.362', 'weapon3': '1.652', 'DAMAGECOUNT': '2.589', 'FRAGCOUNT': '7.000'} [2023-02-24 18:09:18,722][177158] DAMAGECOUNT value on done: 55995.0 [2023-02-24 18:09:18,723][177158] Sum rewards: 6.336, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.320', 'AMMO2': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.018', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'weapon7': '0.104', 'AMMO6': '0.240', 'AMMO7': '0.240', 'HITCOUNT': '0.250', 'weapon4': '0.280', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'weapon3': '1.268', 'DAMAGECOUNT': '1.305', 'weapon2': '1.318', 'FRAGCOUNT': '5.000'} [2023-02-24 18:09:19,017][177158] DAMAGECOUNT value on done: 59419.0 [2023-02-24 18:09:19,017][177158] Sum rewards: 4.825, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.106', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO3': '0.055', 'weapon5': '0.108', 'AMMO4': '0.166', 'HITCOUNT': '0.170', 'weapon7': '0.170', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'AMMO6': '0.380', 'AMMO7': '0.380', 'WEAPON3': '0.450', 'WEAPON7': '0.500', 'weapon4': '0.500', 'weapon3': '0.932', 'DAMAGECOUNT': '1.212', 'weapon2': '1.508', 'FRAGCOUNT': '3.000'} [2023-02-24 18:09:19,381][177172] DAMAGECOUNT value on done: 57526.0 [2023-02-24 18:09:19,382][177172] Sum rewards: 6.854, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.563', 'AMMO5': '0.020', 'AMMO2': '0.036', 'WEAPON1': '0.050', 'weapon7': '0.056', 'AMMO3': '0.073', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.181', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.348', 'HITCOUNT': '0.360', 'ARMOR': '0.416', 'weapon5': '0.426', 'WEAPON3': '0.500', 'WEAPON5': '0.550', 'weapon2': '1.172', 'weapon3': '1.642', 'DAMAGECOUNT': '2.397', 'FRAGCOUNT': '6.000'} [2023-02-24 18:09:19,680][177172] DAMAGECOUNT value on done: 56489.0 [2023-02-24 18:09:19,681][177172] Sum rewards: 4.781, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.680', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.036', 'AMMO3': '0.124', 'weapon5': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.320', 'ARMOR': '0.467', 'HITCOUNT': '0.500', 'WEAPON3': '0.800', 'weapon2': '1.434', 'weapon3': '1.806', 'DAMAGECOUNT': '1.872', 'FRAGCOUNT': '6.000'} [2023-02-24 18:09:20,131][177153] Updated weights for policy 0, policy_version 9510 (0.0008) [2023-02-24 18:09:20,133][177154] DAMAGECOUNT value on done: 62098.0 [2023-02-24 18:09:20,134][177154] Sum rewards: 10.716, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.610', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'weapon7': '0.074', 'AMMO3': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.316', 'WEAPON3': '0.550', 'HITCOUNT': '0.640', 'weapon2': '1.144', 'weapon3': '1.372', 'DAMAGECOUNT': '2.916', 'FRAGCOUNT': '9.000'} [2023-02-24 18:09:20,426][177154] DAMAGECOUNT value on done: 59111.0 [2023-02-24 18:09:20,426][177154] Sum rewards: 7.934, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.205', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.026', 'AMMO3': '0.030', 'weapon7': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.166', 'WEAPON3': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.278', 'WEAPON7': '0.300', 'HITCOUNT': '0.360', 'weapon3': '0.722', 'weapon2': '1.684', 'DAMAGECOUNT': '1.827', 'FRAGCOUNT': '4.000'} [2023-02-24 18:09:20,434][177154] DAMAGECOUNT value on done: 59119.0 [2023-02-24 18:09:20,434][177154] Sum rewards: 6.650, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.350', 'AMMO5': '0.020', 'ARMOR': '0.022', 'WEAPON1': '0.030', 'AMMO2': '0.037', 'AMMO3': '0.147', 'AMMO4': '0.186', 'weapon5': '0.208', 'WEAPON4': '0.250', 'weapon4': '0.280', 'WEAPON5': '0.400', 'weapon2': '0.792', 'HITCOUNT': '0.840', 'WEAPON3': '0.900', 'weapon3': '1.906', 'DAMAGECOUNT': '3.732', 'FRAGCOUNT': '9.500'} [2023-02-24 18:09:20,565][177172] DAMAGECOUNT value on done: 56364.0 [2023-02-24 18:09:20,566][177172] Sum rewards: 2.927, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.902', 'AMMO2': '0.005', 'AMMO5': '0.016', 'AMMO4': '0.024', 'WEAPON1': '0.050', 'weapon7': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.121', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.208', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'HITCOUNT': '0.470', 'weapon4': '0.518', 'WEAPON3': '0.800', 'weapon2': '0.952', 'weapon3': '1.760', 'DAMAGECOUNT': '2.844', 'FRAGCOUNT': '4.500'} [2023-02-24 18:09:20,647][177155] Large shaping reward -2.534 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 18:09:20,723][177154] DAMAGECOUNT value on done: 58236.0 [2023-02-24 18:09:20,723][177154] Sum rewards: 3.295, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.465', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.043', 'AMMO3': '0.088', 'AMMO4': '0.214', 'weapon5': '0.222', 'WEAPON5': '0.300', 'weapon4': '0.390', 'WEAPON4': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.640', 'weapon2': '1.552', 'weapon3': '1.564', 'DAMAGECOUNT': '2.370', 'FRAGCOUNT': '6.000'} [2023-02-24 18:09:20,857][177172] DAMAGECOUNT value on done: 56845.0 [2023-02-24 18:09:20,857][177172] Sum rewards: 6.674, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.302', 'AMMO5': '0.010', 'AMMO2': '0.027', 'ARMOR': '0.036', 'WEAPON1': '0.040', 'weapon7': '0.096', 'AMMO3': '0.103', 'AMMO4': '0.134', 'weapon5': '0.136', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.370', 'weapon4': '0.512', 'WEAPON3': '0.700', 'weapon2': '0.902', 'weapon3': '1.272', 'DAMAGECOUNT': '2.238', 'FRAGCOUNT': '7.000'} [2023-02-24 18:09:21,182][177157] DAMAGECOUNT value on done: 59103.0 [2023-02-24 18:09:21,182][177157] Sum rewards: 9.184, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.011', 'AMMO5': '0.007', 'weapon5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.082', 'AMMO4': '0.104', 'weapon7': '0.128', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.254', 'AMMO6': '0.400', 'WEAPON7': '0.400', 'AMMO7': '0.400', 'HITCOUNT': '0.410', 'WEAPON3': '0.550', 'weapon3': '1.430', 'weapon2': '1.976', 'DAMAGECOUNT': '2.697', 'FRAGCOUNT': '7.000'} [2023-02-24 18:09:21,193][177157] DAMAGECOUNT value on done: 63050.0 [2023-02-24 18:09:21,193][177157] Sum rewards: 10.509, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.480', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon7': '0.080', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'weapon5': '0.120', 'AMMO3': '0.143', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'weapon4': '0.436', 'HITCOUNT': '0.910', 'WEAPON3': '0.950', 'weapon2': '1.124', 'weapon3': '1.936', 'DAMAGECOUNT': '4.335', 'FRAGCOUNT': '12.000'} [2023-02-24 18:09:21,376][177119] Fps is (10 sec: 13926.5, 60 sec: 14062.9, 300 sec: 14037.5). Total num frames: 38969344. Throughput: 0: 3513.1. Samples: 9736240. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:09:21,376][177119] Avg episode reward: [(0, '5.752')] [2023-02-24 18:09:21,377][177140] Saving new best policy, reward=5.752! [2023-02-24 18:09:21,384][177171] DAMAGECOUNT value on done: 60025.0 [2023-02-24 18:09:21,385][177171] Sum rewards: 11.951, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.985', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'AMMO5': '0.027', 'AMMO3': '0.082', 'AMMO4': '0.121', 'weapon5': '0.122', 'weapon7': '0.154', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.630', 'weapon2': '0.744', 'weapon4': '0.866', 'weapon3': '1.380', 'DAMAGECOUNT': '4.485', 'FRAGCOUNT': '9.000'} [2023-02-24 18:09:21,502][177157] DAMAGECOUNT value on done: 55780.0 [2023-02-24 18:09:21,503][177157] Sum rewards: 8.005, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.170', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon7': '0.062', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.102', 'WEAPON5': '0.200', 'weapon4': '0.268', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.390', 'WEAPON3': '0.500', 'weapon3': '1.274', 'weapon2': '1.508', 'DAMAGECOUNT': '2.520', 'FRAGCOUNT': '7.000'} [2023-02-24 18:09:21,514][177157] DAMAGECOUNT value on done: 58542.0 [2023-02-24 18:09:21,514][177157] Sum rewards: 10.418, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.950', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'weapon5': '0.028', 'AMMO4': '0.043', 'weapon7': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.406', 'ARMOR': '0.420', 'WEAPON3': '0.650', 'HITCOUNT': '0.770', 'weapon2': '1.404', 'weapon3': '1.622', 'DAMAGECOUNT': '2.652', 'FRAGCOUNT': '10.000'} [2023-02-24 18:09:21,692][177171] DAMAGECOUNT value on done: 57483.0 [2023-02-24 18:09:21,693][177171] Sum rewards: 2.185, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.027', 'AMMO2': '0.004', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO4': '0.018', 'WEAPON1': '0.040', 'weapon7': '0.050', 'weapon5': '0.098', 'AMMO3': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.298', 'HITCOUNT': '0.330', 'WEAPON3': '0.700', 'weapon2': '1.400', 'weapon3': '1.700', 'DAMAGECOUNT': '2.394', 'FRAGCOUNT': '5.000'} [2023-02-24 18:09:21,968][177171] DAMAGECOUNT value on done: 57580.0 [2023-02-24 18:09:21,968][177171] Sum rewards: 6.936, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.014', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.057', 'AMMO3': '0.073', 'weapon5': '0.084', 'WEAPON5': '0.100', 'weapon7': '0.102', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.310', 'weapon4': '0.364', 'ARMOR': '0.412', 'WEAPON3': '0.500', 'weapon3': '0.958', 'weapon2': '1.536', 'DAMAGECOUNT': '1.794', 'FRAGCOUNT': '6.000'} [2023-02-24 18:09:22,160][177155] DAMAGECOUNT value on done: 60337.0 [2023-02-24 18:09:22,161][177155] Sum rewards: 6.286, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.895', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO3': '0.069', 'AMMO4': '0.125', 'weapon7': '0.182', 'weapon5': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.500', 'weapon2': '0.654', 'HITCOUNT': '0.680', 'weapon4': '0.808', 'weapon3': '1.072', 'DAMAGECOUNT': '2.574', 'FRAGCOUNT': '5.500'} [2023-02-24 18:09:22,255][177171] DAMAGECOUNT value on done: 57158.0 [2023-02-24 18:09:22,255][177171] Sum rewards: -1.516, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.361', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'weapon7': '0.054', 'AMMO4': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.138', 'AMMO3': '0.152', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.408', 'HITCOUNT': '0.690', 'weapon4': '0.724', 'WEAPON3': '0.950', 'weapon3': '1.924', 'DAMAGECOUNT': '2.628', 'FRAGCOUNT': '4.000'} [2023-02-24 18:09:22,458][177155] DAMAGECOUNT value on done: 61623.0 [2023-02-24 18:09:22,459][177155] Sum rewards: 7.217, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.930', 'AMMO5': '0.012', 'AMMO2': '0.035', 'WEAPON1': '0.040', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.119', 'weapon5': '0.154', 'AMMO4': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'HITCOUNT': '0.420', 'weapon2': '0.686', 'WEAPON3': '0.700', 'weapon4': '0.822', 'weapon3': '1.400', 'DAMAGECOUNT': '2.181', 'FRAGCOUNT': '8.000'} [2023-02-24 18:09:22,752][177155] DAMAGECOUNT value on done: 62165.0 [2023-02-24 18:09:22,752][177155] Sum rewards: 3.332, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.718', 'AMMO5': '0.010', 'AMMO2': '0.024', 'WEAPON1': '0.050', 'weapon7': '0.074', 'AMMO3': '0.078', 'AMMO4': '0.120', 'WEAPON5': '0.250', 'weapon5': '0.276', 'WEAPON4': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'HITCOUNT': '0.320', 'weapon4': '0.346', 'WEAPON7': '0.400', 'WEAPON3': '0.600', 'weapon2': '1.226', 'weapon3': '1.342', 'DAMAGECOUNT': '1.494', 'FRAGCOUNT': '5.000'} [2023-02-24 18:09:23,041][177153] Updated weights for policy 0, policy_version 9520 (0.0008) [2023-02-24 18:09:23,059][177155] DAMAGECOUNT value on done: 55644.0 [2023-02-24 18:09:23,059][177155] Sum rewards: 8.403, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO3': '0.030', 'AMMO4': '0.054', 'weapon7': '0.070', 'HEALTH': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.312', 'HITCOUNT': '0.370', 'weapon2': '0.476', 'weapon3': '0.750', 'DAMAGECOUNT': '1.515', 'FRAGCOUNT': '6.000'} [2023-02-24 18:09:23,271][177157] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0)] [2023-02-24 18:09:25,949][177153] Updated weights for policy 0, policy_version 9530 (0.0008) [2023-02-24 18:09:26,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14062.9, 300 sec: 14037.5). Total num frames: 39038976. Throughput: 0: 3511.5. Samples: 9757328. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:09:26,376][177119] Avg episode reward: [(0, '5.795')] [2023-02-24 18:09:26,380][177140] Saving new best policy, reward=5.795! [2023-02-24 18:09:27,563][177156] DAMAGECOUNT value on done: 56419.0 [2023-02-24 18:09:27,564][177156] Sum rewards: 2.187, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.244', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.034', 'AMMO3': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon7': '0.106', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.256', 'HITCOUNT': '0.280', 'WEAPON3': '0.300', 'WEAPON7': '0.300', 'weapon3': '0.618', 'weapon2': '1.066', 'DAMAGECOUNT': '1.233', 'FRAGCOUNT': '2.000'} [2023-02-24 18:09:27,573][177156] DAMAGECOUNT value on done: 59306.0 [2023-02-24 18:09:27,574][177156] Sum rewards: -0.039, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.151', 'AMMO5': '0.012', 'weapon7': '0.016', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'weapon5': '0.066', 'AMMO4': '0.104', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'weapon4': '0.266', 'WEAPON5': '0.300', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'HITCOUNT': '0.320', 'ARMOR': '0.404', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.158', 'weapon2': '1.656', 'weapon3': '1.722', 'FRAGCOUNT': '3.000'} [2023-02-24 18:09:27,871][177156] DAMAGECOUNT value on done: 59582.0 [2023-02-24 18:09:27,882][177156] DAMAGECOUNT value on done: 61311.0 [2023-02-24 18:09:27,883][177156] Sum rewards: 1.025, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.140', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.040', 'AMMO2': '0.042', 'AMMO3': '0.109', 'weapon5': '0.200', 'AMMO4': '0.208', 'WEAPON5': '0.250', 'HITCOUNT': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.514', 'WEAPON3': '0.750', 'weapon2': '0.988', 'DAMAGECOUNT': '1.530', 'weapon3': '1.822', 'FRAGCOUNT': '4.000'} [2023-02-24 18:09:28,860][177153] Updated weights for policy 0, policy_version 9540 (0.0008) [2023-02-24 18:09:31,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14062.9, 300 sec: 14037.5). Total num frames: 39108608. Throughput: 0: 3513.2. Samples: 9778512. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:09:31,377][177119] Avg episode reward: [(0, '5.476')] [2023-02-24 18:09:31,762][177153] Updated weights for policy 0, policy_version 9550 (0.0008) [2023-02-24 18:09:32,060][177171] Large shaping reward 3.632 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:09:32,153][177156] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:09:34,674][177153] Updated weights for policy 0, policy_version 9560 (0.0008) [2023-02-24 18:09:35,555][177170] DAMAGECOUNT value on done: 59730.0 [2023-02-24 18:09:35,555][177170] Sum rewards: 0.229, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.050', 'AMMO5': '0.017', 'AMMO2': '0.026', 'ARMOR': '0.035', 'WEAPON1': '0.050', 'weapon5': '0.086', 'weapon7': '0.126', 'AMMO4': '0.127', 'AMMO3': '0.128', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'HITCOUNT': '0.480', 'weapon2': '0.536', 'weapon4': '0.792', 'WEAPON3': '0.850', 'weapon3': '1.788', 'DAMAGECOUNT': '1.998', 'FRAGCOUNT': '3.500'} [2023-02-24 18:09:35,850][177170] DAMAGECOUNT value on done: 63825.0 [2023-02-24 18:09:35,851][177170] Sum rewards: 3.695, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.638', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.025', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon7': '0.120', 'AMMO4': '0.125', 'weapon5': '0.194', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.270', 'WEAPON5': '0.350', 'weapon2': '0.392', 'weapon4': '0.602', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.656', 'weapon3': '1.808', 'FRAGCOUNT': '4.000'} [2023-02-24 18:09:35,907][177170] DAMAGECOUNT value on done: 54155.0 [2023-02-24 18:09:35,908][177170] Sum rewards: 11.159, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.321', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO4': '0.053', 'AMMO3': '0.093', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.372', 'WEAPON3': '0.650', 'HITCOUNT': '0.710', 'weapon2': '1.012', 'weapon3': '1.826', 'DAMAGECOUNT': '3.681', 'FRAGCOUNT': '8.000'} [2023-02-24 18:09:36,212][177170] DAMAGECOUNT value on done: 63140.0 [2023-02-24 18:09:36,212][177170] Sum rewards: 6.770, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'ARMOR': '0.028', 'AMMO2': '0.035', 'weapon5': '0.058', 'AMMO3': '0.077', 'weapon7': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.173', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.340', 'WEAPON3': '0.450', 'HEALTH': '0.462', 'weapon4': '0.602', 'weapon3': '1.040', 'weapon2': '1.162', 'DAMAGECOUNT': '1.590', 'FRAGCOUNT': '5.000'} [2023-02-24 18:09:36,376][177119] Fps is (10 sec: 13926.6, 60 sec: 14062.9, 300 sec: 14037.5). Total num frames: 39178240. Throughput: 0: 3512.4. Samples: 9789060. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:09:36,376][177119] Avg episode reward: [(0, '5.511')] [2023-02-24 18:09:36,479][177158] DAMAGECOUNT value on done: 57578.0 [2023-02-24 18:09:36,480][177158] Sum rewards: 4.300, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.510', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO4': '0.029', 'AMMO3': '0.057', 'weapon7': '0.126', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HITCOUNT': '0.260', 'WEAPON7': '0.300', 'weapon4': '0.350', 'WEAPON3': '0.400', 'weapon3': '0.886', 'DAMAGECOUNT': '1.212', 'weapon2': '2.090', 'FRAGCOUNT': '3.000'} [2023-02-24 18:09:36,773][177158] DAMAGECOUNT value on done: 56984.0 [2023-02-24 18:09:36,774][177158] Sum rewards: 4.998, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.269', 'weapon5': '0.002', 'AMMO2': '0.009', 'AMMO5': '0.013', 'ARMOR': '0.032', 'AMMO4': '0.043', 'AMMO3': '0.115', 'weapon7': '0.136', 'WEAPON5': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'WEAPON7': '0.400', 'HITCOUNT': '0.510', 'weapon4': '0.654', 'WEAPON3': '0.750', 'weapon2': '1.004', 'weapon3': '1.468', 'DAMAGECOUNT': '2.202', 'FRAGCOUNT': '8.000'} [2023-02-24 18:09:37,608][177153] Updated weights for policy 0, policy_version 9570 (0.0008) [2023-02-24 18:09:37,800][177158] DAMAGECOUNT value on done: 56476.0 [2023-02-24 18:09:37,800][177158] Sum rewards: 7.738, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon4': '0.036', 'weapon7': '0.046', 'AMMO3': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'weapon5': '0.128', 'HITCOUNT': '0.210', 'HEALTH': '0.340', 'WEAPON3': '0.350', 'weapon3': '0.990', 'DAMAGECOUNT': '1.443', 'weapon2': '2.482', 'FRAGCOUNT': '4.000'} [2023-02-24 18:09:38,099][177158] DAMAGECOUNT value on done: 60321.0 [2023-02-24 18:09:38,100][177158] Sum rewards: 8.275, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.212', 'AMMO5': '0.021', 'AMMO2': '0.031', 'WEAPON1': '0.040', 'weapon7': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.122', 'AMMO3': '0.141', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'weapon4': '0.318', 'WEAPON5': '0.500', 'HITCOUNT': '0.760', 'WEAPON3': '1.000', 'weapon2': '1.168', 'weapon3': '1.942', 'DAMAGECOUNT': '2.706', 'FRAGCOUNT': '10.000'} [2023-02-24 18:09:38,488][177172] DAMAGECOUNT value on done: 57761.0 [2023-02-24 18:09:38,488][177172] Sum rewards: 1.954, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.810', 'AMMO5': '0.003', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'weapon5': '0.010', 'AMMO4': '0.029', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'weapon7': '0.196', 'WEAPON4': '0.200', 'HITCOUNT': '0.230', 'WEAPON3': '0.450', 'AMMO6': '0.540', 'AMMO7': '0.540', 'weapon4': '0.626', 'WEAPON7': '0.700', 'DAMAGECOUNT': '0.705', 'FRAGCOUNT': '1.000', 'weapon3': '1.122', 'weapon2': '1.528'} [2023-02-24 18:09:38,783][177172] DAMAGECOUNT value on done: 57187.0 [2023-02-24 18:09:38,783][177172] Sum rewards: 0.883, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.606', 'AMMO2': '0.010', 'AMMO5': '0.022', 'WEAPON4': '0.050', 'AMMO4': '0.050', 'WEAPON1': '0.070', 'AMMO3': '0.118', 'weapon4': '0.140', 'weapon5': '0.212', 'WEAPON5': '0.500', 'HITCOUNT': '0.520', 'WEAPON3': '0.700', 'weapon2': '0.890', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.094', 'weapon3': '2.362'} [2023-02-24 18:09:39,140][177154] DAMAGECOUNT value on done: 62374.0 [2023-02-24 18:09:39,141][177154] Sum rewards: 2.515, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.178', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.038', 'ARMOR': '0.040', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'weapon7': '0.190', 'WEAPON4': '0.200', 'HITCOUNT': '0.200', 'weapon2': '0.228', 'WEAPON3': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'weapon3': '0.548', 'weapon4': '0.804', 'DAMAGECOUNT': '0.828', 'FRAGCOUNT': '1.000'} [2023-02-24 18:09:39,438][177154] DAMAGECOUNT value on done: 59891.0 [2023-02-24 18:09:39,438][177154] Sum rewards: 7.714, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.264', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON1': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'weapon7': '0.102', 'weapon5': '0.166', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'weapon4': '0.280', 'WEAPON7': '0.300', 'HITCOUNT': '0.430', 'WEAPON3': '0.450', 'weapon3': '1.382', 'weapon2': '1.748', 'DAMAGECOUNT': '2.340', 'FRAGCOUNT': '5.000'} [2023-02-24 18:09:39,447][177154] DAMAGECOUNT value on done: 59908.0 [2023-02-24 18:09:39,448][177154] Sum rewards: 4.716, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.330', 'AMMO5': '0.007', 'AMMO2': '0.010', 'ARMOR': '0.040', 'AMMO4': '0.048', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO3': '0.095', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.154', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.530', 'weapon4': '0.578', 'WEAPON3': '0.700', 'weapon2': '0.830', 'weapon3': '1.646', 'DAMAGECOUNT': '2.367', 'FRAGCOUNT': '4.000'} [2023-02-24 18:09:39,731][177172] DAMAGECOUNT value on done: 57229.0 [2023-02-24 18:09:39,731][177172] Sum rewards: 4.040, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.112', 'AMMO2': '0.011', 'AMMO5': '0.022', 'ARMOR': '0.024', 'weapon7': '0.048', 'AMMO4': '0.055', 'weapon5': '0.066', 'WEAPON1': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.171', 'WEAPON7': '0.200', 'WEAPON5': '0.450', 'weapon4': '0.464', 'HITCOUNT': '0.570', 'weapon2': '0.632', 'WEAPON3': '0.950', 'weapon3': '2.184', 'DAMAGECOUNT': '2.595', 'FRAGCOUNT': '6.000'} [2023-02-24 18:09:39,756][177154] DAMAGECOUNT value on done: 59103.0 [2023-02-24 18:09:39,756][177154] Sum rewards: 6.457, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.860', 'AMMO2': '0.009', 'AMMO5': '0.015', 'AMMO4': '0.044', 'weapon7': '0.048', 'WEAPON1': '0.050', 'weapon5': '0.062', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.130', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.640', 'WEAPON3': '0.850', 'weapon2': '1.660', 'weapon3': '2.018', 'DAMAGECOUNT': '2.601', 'FRAGCOUNT': '7.000'} [2023-02-24 18:09:40,026][177172] DAMAGECOUNT value on done: 57572.0 [2023-02-24 18:09:40,027][177172] Sum rewards: 7.015, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.400', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.017', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.220', 'weapon5': '0.252', 'HITCOUNT': '0.440', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'weapon3': '1.388', 'weapon2': '1.592', 'DAMAGECOUNT': '2.181', 'FRAGCOUNT': '5.000'} [2023-02-24 18:09:40,362][177157] DAMAGECOUNT value on done: 59634.0 [2023-02-24 18:09:40,363][177157] Sum rewards: 1.007, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.330', 'AMMO5': '0.020', 'AMMO2': '0.036', 'weapon7': '0.070', 'WEAPON1': '0.080', 'AMMO3': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.146', 'WEAPON4': '0.150', 'AMMO4': '0.178', 'HITCOUNT': '0.290', 'weapon2': '0.336', 'WEAPON5': '0.500', 'WEAPON3': '0.500', 'weapon4': '0.544', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.593', 'weapon3': '1.762'} [2023-02-24 18:09:40,373][177157] DAMAGECOUNT value on done: 63935.0 [2023-02-24 18:09:40,373][177157] Sum rewards: 7.064, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.696', 'AMMO5': '0.015', 'AMMO2': '0.020', 'weapon5': '0.020', 'WEAPON1': '0.030', 'weapon7': '0.046', 'AMMO3': '0.075', 'AMMO4': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.250', 'weapon4': '0.448', 'WEAPON3': '0.500', 'HITCOUNT': '0.710', 'ARMOR': '0.904', 'weapon2': '1.506', 'weapon3': '1.582', 'DAMAGECOUNT': '2.655', 'FRAGCOUNT': '6.000'} [2023-02-24 18:09:40,543][177153] Updated weights for policy 0, policy_version 9580 (0.0009) [2023-02-24 18:09:40,549][177171] DAMAGECOUNT value on done: 60991.0 [2023-02-24 18:09:40,549][177171] Sum rewards: 6.461, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.296', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO2': '0.033', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'AMMO4': '0.162', 'weapon5': '0.210', 'WEAPON5': '0.250', 'weapon4': '0.454', 'HITCOUNT': '0.630', 'WEAPON3': '0.650', 'weapon2': '1.170', 'weapon3': '1.792', 'DAMAGECOUNT': '2.898', 'FRAGCOUNT': '6.500'} [2023-02-24 18:09:40,667][177157] DAMAGECOUNT value on done: 56785.0 [2023-02-24 18:09:40,668][177157] Sum rewards: 4.169, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.208', 'AMMO5': '0.024', 'AMMO2': '0.026', 'WEAPON1': '0.040', 'weapon5': '0.082', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'weapon4': '0.296', 'WEAPON5': '0.500', 'ARMOR': '0.517', 'HITCOUNT': '0.740', 'weapon2': '1.006', 'WEAPON3': '1.050', 'weapon3': '2.138', 'DAMAGECOUNT': '3.015', 'FRAGCOUNT': '7.000'} [2023-02-24 18:09:40,680][177157] DAMAGECOUNT value on done: 59582.0 [2023-02-24 18:09:40,680][177157] Sum rewards: 2.900, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.492', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.047', 'AMMO3': '0.134', 'WEAPON4': '0.150', 'weapon5': '0.206', 'weapon4': '0.346', 'WEAPON5': '0.400', 'HITCOUNT': '0.730', 'WEAPON3': '0.850', 'weapon2': '1.292', 'weapon3': '1.814', 'DAMAGECOUNT': '3.120', 'FRAGCOUNT': '5.000'} [2023-02-24 18:09:40,843][177171] DAMAGECOUNT value on done: 58494.0 [2023-02-24 18:09:40,843][177171] Sum rewards: 10.521, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.678', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO3': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.140', 'WEAPON4': '0.200', 'AMMO4': '0.235', 'WEAPON5': '0.450', 'WEAPON3': '0.450', 'ARMOR': '0.500', 'HITCOUNT': '0.620', 'weapon4': '0.622', 'weapon2': '1.206', 'weapon3': '1.218', 'DAMAGECOUNT': '3.033', 'FRAGCOUNT': '8.000'} [2023-02-24 18:09:41,106][177171] DAMAGECOUNT value on done: 58357.0 [2023-02-24 18:09:41,106][177171] Sum rewards: 10.265, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.390', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.065', 'weapon7': '0.102', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON3': '0.450', 'WEAPON7': '0.500', 'HITCOUNT': '0.530', 'weapon3': '1.208', 'DAMAGECOUNT': '2.331', 'weapon2': '2.512', 'FRAGCOUNT': '6.000'} [2023-02-24 18:09:41,181][177155] DAMAGECOUNT value on done: 60801.0 [2023-02-24 18:09:41,182][177155] Sum rewards: 4.412, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.410', 'AMMO2': '0.005', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.026', 'weapon5': '0.062', 'weapon7': '0.066', 'AMMO3': '0.069', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.360', 'weapon4': '0.366', 'WEAPON3': '0.400', 'weapon2': '0.668', 'weapon3': '1.088', 'DAMAGECOUNT': '1.392', 'FRAGCOUNT': '4.000'} [2023-02-24 18:09:41,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 14037.5). Total num frames: 39247872. Throughput: 0: 3511.3. Samples: 9810080. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:09:41,376][177119] Avg episode reward: [(0, '5.540')] [2023-02-24 18:09:41,412][177171] DAMAGECOUNT value on done: 58258.0 [2023-02-24 18:09:41,412][177171] Sum rewards: 8.075, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.382', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'weapon7': '0.068', 'AMMO4': '0.105', 'AMMO3': '0.109', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.184', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.488', 'WEAPON3': '0.650', 'HITCOUNT': '0.700', 'weapon2': '0.946', 'weapon3': '1.932', 'DAMAGECOUNT': '3.267', 'FRAGCOUNT': '8.000'} [2023-02-24 18:09:41,477][177155] DAMAGECOUNT value on done: 62648.0 [2023-02-24 18:09:41,478][177155] Sum rewards: 13.549, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.510', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.066', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'weapon7': '0.124', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.316', 'WEAPON7': '0.400', 'HITCOUNT': '0.600', 'WEAPON3': '0.650', 'weapon2': '1.182', 'weapon3': '1.762', 'DAMAGECOUNT': '3.075', 'FRAGCOUNT': '11.000'} [2023-02-24 18:09:41,773][177155] DAMAGECOUNT value on done: 62716.0 [2023-02-24 18:09:41,774][177155] Sum rewards: 5.049, reward structure: {'DEATHCOUNT': '-4.500', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.008', 'ARMOR': '0.008', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'weapon7': '0.064', 'HEALTH': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON3': '0.200', 'weapon4': '0.276', 'HITCOUNT': '0.330', 'weapon3': '0.876', 'weapon2': '1.532', 'DAMAGECOUNT': '1.653', 'FRAGCOUNT': '4.000'} [2023-02-24 18:09:42,066][177155] DAMAGECOUNT value on done: 55756.0 [2023-02-24 18:09:43,444][177153] Updated weights for policy 0, policy_version 9590 (0.0008) [2023-02-24 18:09:46,372][177153] Updated weights for policy 0, policy_version 9600 (0.0008) [2023-02-24 18:09:46,376][177119] Fps is (10 sec: 14335.9, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 39321600. Throughput: 0: 3510.6. Samples: 9831098. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:09:46,376][177119] Avg episode reward: [(0, '5.491')] [2023-02-24 18:09:46,826][177156] DAMAGECOUNT value on done: 57930.0 [2023-02-24 18:09:46,827][177156] Sum rewards: 12.210, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.470', 'AMMO2': '0.008', 'ARMOR': '0.008', 'AMMO5': '0.024', 'WEAPON1': '0.030', 'AMMO4': '0.039', 'weapon4': '0.096', 'weapon7': '0.096', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'weapon5': '0.164', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '0.910', 'weapon2': '1.416', 'weapon3': '1.890', 'DAMAGECOUNT': '4.458', 'FRAGCOUNT': '12.000'} [2023-02-24 18:09:46,838][177156] DAMAGECOUNT value on done: 59521.0 [2023-02-24 18:09:46,838][177156] Sum rewards: 1.325, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.348', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.026', 'AMMO3': '0.064', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO4': '0.131', 'HITCOUNT': '0.150', 'weapon7': '0.172', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.645', 'weapon4': '0.688', 'weapon2': '0.908', 'weapon3': '1.034', 'FRAGCOUNT': '3.000'} [2023-02-24 18:09:47,135][177156] DAMAGECOUNT value on done: 60540.0 [2023-02-24 18:09:47,136][177156] Sum rewards: 4.065, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.130', 'AMMO5': '0.019', 'AMMO2': '0.023', 'ARMOR': '0.040', 'WEAPON1': '0.070', 'AMMO4': '0.116', 'weapon5': '0.196', 'AMMO3': '0.198', 'WEAPON4': '0.300', 'weapon4': '0.356', 'WEAPON5': '0.400', 'HITCOUNT': '0.690', 'weapon2': '1.096', 'WEAPON3': '1.250', 'weapon3': '2.072', 'DAMAGECOUNT': '2.868', 'FRAGCOUNT': '7.000'} [2023-02-24 18:09:47,147][177156] DAMAGECOUNT value on done: 62315.0 [2023-02-24 18:09:47,147][177156] Sum rewards: 7.445, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.484', 'AMMO2': '0.004', 'AMMO4': '0.018', 'AMMO5': '0.020', 'WEAPON4': '0.050', 'WEAPON1': '0.050', 'AMMO3': '0.121', 'weapon4': '0.146', 'weapon5': '0.222', 'WEAPON5': '0.450', 'ARMOR': '0.456', 'HITCOUNT': '0.670', 'WEAPON3': '0.900', 'weapon2': '1.218', 'weapon3': '2.092', 'DAMAGECOUNT': '3.012', 'FRAGCOUNT': '7.000'} [2023-02-24 18:09:49,282][177153] Updated weights for policy 0, policy_version 9610 (0.0008) [2023-02-24 18:09:51,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14062.9, 300 sec: 14037.5). Total num frames: 39391232. Throughput: 0: 3512.2. Samples: 9841636. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:09:51,376][177119] Avg episode reward: [(0, '5.525')] [2023-02-24 18:09:52,217][177153] Updated weights for policy 0, policy_version 9620 (0.0008) [2023-02-24 18:09:54,619][177170] DAMAGECOUNT value on done: 60361.0 [2023-02-24 18:09:54,620][177170] Sum rewards: 4.675, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.012', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO3': '0.080', 'AMMO4': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.250', 'weapon5': '0.320', 'weapon4': '0.346', 'HITCOUNT': '0.390', 'WEAPON3': '0.450', 'ARMOR': '0.483', 'HEALTH': '0.827', 'weapon2': '1.292', 'weapon3': '1.750', 'DAMAGECOUNT': '1.893', 'FRAGCOUNT': '2.000'} [2023-02-24 18:09:54,917][177170] DAMAGECOUNT value on done: 64255.0 [2023-02-24 18:09:54,918][177170] Sum rewards: 0.847, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.346', 'weapon5': '0.006', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO4': '0.044', 'weapon7': '0.096', 'AMMO3': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.146', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.350', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.290', 'weapon3': '1.446', 'weapon2': '1.788', 'FRAGCOUNT': '2.000'} [2023-02-24 18:09:54,979][177170] DAMAGECOUNT value on done: 55307.0 [2023-02-24 18:09:54,980][177170] Sum rewards: 12.030, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.440', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.028', 'WEAPON1': '0.040', 'weapon7': '0.072', 'AMMO3': '0.087', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.336', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'weapon3': '1.424', 'weapon2': '1.644', 'DAMAGECOUNT': '3.456', 'FRAGCOUNT': '10.000'} [2023-02-24 18:09:55,115][177153] Updated weights for policy 0, policy_version 9630 (0.0008) [2023-02-24 18:09:55,273][177170] DAMAGECOUNT value on done: 63706.0 [2023-02-24 18:09:55,273][177170] Sum rewards: 5.597, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.445', 'AMMO5': '0.017', 'AMMO2': '0.023', 'weapon7': '0.052', 'WEAPON1': '0.070', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'AMMO4': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.214', 'weapon4': '0.222', 'WEAPON5': '0.450', 'HITCOUNT': '0.450', 'WEAPON3': '0.550', 'weapon2': '0.934', 'weapon3': '1.136', 'DAMAGECOUNT': '1.698', 'FRAGCOUNT': '5.000'} [2023-02-24 18:09:55,657][177158] DAMAGECOUNT value on done: 58373.0 [2023-02-24 18:09:55,658][177158] Sum rewards: 9.663, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.174', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.077', 'AMMO4': '0.085', 'weapon7': '0.090', 'weapon5': '0.114', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.292', 'WEAPON3': '0.600', 'HITCOUNT': '0.630', 'weapon2': '1.096', 'weapon3': '1.526', 'DAMAGECOUNT': '2.385', 'FRAGCOUNT': '9.000'} [2023-02-24 18:09:55,953][177158] DAMAGECOUNT value on done: 58281.0 [2023-02-24 18:09:55,954][177158] Sum rewards: 10.499, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.140', 'AMMO5': '0.017', 'AMMO2': '0.018', 'weapon7': '0.048', 'WEAPON1': '0.070', 'AMMO4': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.127', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.216', 'weapon4': '0.236', 'WEAPON5': '0.450', 'HITCOUNT': '0.880', 'WEAPON3': '0.900', 'weapon2': '0.964', 'weapon3': '2.094', 'DAMAGECOUNT': '3.891', 'FRAGCOUNT': '11.000'} [2023-02-24 18:09:56,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 14037.5). Total num frames: 39460864. Throughput: 0: 3512.7. Samples: 9862768. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:09:56,376][177119] Avg episode reward: [(0, '5.690')] [2023-02-24 18:09:56,967][177158] DAMAGECOUNT value on done: 57051.0 [2023-02-24 18:09:56,968][177158] Sum rewards: 1.130, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.395', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'AMMO3': '0.091', 'AMMO4': '0.096', 'weapon5': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'HITCOUNT': '0.370', 'weapon4': '0.430', 'WEAPON3': '0.600', 'weapon2': '1.184', 'weapon3': '1.584', 'DAMAGECOUNT': '1.725', 'FRAGCOUNT': '3.000'} [2023-02-24 18:09:57,263][177158] DAMAGECOUNT value on done: 61219.0 [2023-02-24 18:09:57,264][177158] Sum rewards: 12.161, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.042', 'AMMO2': '0.017', 'AMMO5': '0.017', 'ARMOR': '0.024', 'WEAPON1': '0.070', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon4': '0.252', 'weapon5': '0.274', 'WEAPON5': '0.400', 'HITCOUNT': '0.710', 'WEAPON3': '0.800', 'weapon2': '1.110', 'weapon3': '2.038', 'DAMAGECOUNT': '2.694', 'FRAGCOUNT': '12.000'} [2023-02-24 18:09:57,699][177172] DAMAGECOUNT value on done: 58553.0 [2023-02-24 18:09:57,700][177172] Sum rewards: 4.024, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.343', 'ARMOR': '0.004', 'AMMO2': '0.017', 'AMMO5': '0.019', 'WEAPON1': '0.050', 'weapon7': '0.078', 'AMMO4': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.131', 'weapon5': '0.136', 'WEAPON7': '0.200', 'weapon4': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'HITCOUNT': '0.640', 'WEAPON3': '0.950', 'weapon2': '1.260', 'weapon3': '1.940', 'DAMAGECOUNT': '2.376', 'FRAGCOUNT': '7.000'} [2023-02-24 18:09:57,980][177172] DAMAGECOUNT value on done: 58023.0 [2023-02-24 18:09:57,980][177172] Sum rewards: 5.641, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.292', 'AMMO5': '0.017', 'AMMO2': '0.017', 'weapon4': '0.034', 'WEAPON1': '0.060', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'weapon5': '0.158', 'WEAPON5': '0.350', 'ARMOR': '0.420', 'HITCOUNT': '0.680', 'WEAPON3': '0.700', 'weapon2': '1.512', 'weapon3': '1.936', 'DAMAGECOUNT': '2.508', 'FRAGCOUNT': '5.500'} [2023-02-24 18:09:58,033][177153] Updated weights for policy 0, policy_version 9640 (0.0008) [2023-02-24 18:09:58,315][177154] DAMAGECOUNT value on done: 62985.0 [2023-02-24 18:09:58,316][177154] Sum rewards: 7.047, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'weapon5': '0.056', 'AMMO3': '0.076', 'weapon4': '0.082', 'WEAPON5': '0.150', 'HEALTH': '0.396', 'WEAPON3': '0.450', 'HITCOUNT': '0.530', 'ARMOR': '0.852', 'weapon3': '1.488', 'DAMAGECOUNT': '1.833', 'weapon2': '2.278', 'FRAGCOUNT': '4.000'} [2023-02-24 18:09:58,612][177154] DAMAGECOUNT value on done: 60522.0 [2023-02-24 18:09:58,612][177154] Sum rewards: 4.288, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.747', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon7': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.126', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.467', 'HITCOUNT': '0.510', 'weapon2': '0.622', 'WEAPON3': '0.850', 'weapon4': '0.970', 'weapon3': '1.804', 'DAMAGECOUNT': '1.893', 'FRAGCOUNT': '6.000'} [2023-02-24 18:09:58,620][177154] DAMAGECOUNT value on done: 60106.0 [2023-02-24 18:09:58,620][177154] Sum rewards: 3.285, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'AMMO3': '0.031', 'weapon5': '0.058', 'weapon7': '0.066', 'AMMO4': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.200', 'weapon4': '0.354', 'HEALTH': '0.410', 'DAMAGECOUNT': '0.594', 'weapon3': '0.738', 'FRAGCOUNT': '1.000', 'weapon2': '1.244'} [2023-02-24 18:09:58,879][177172] DAMAGECOUNT value on done: 57919.0 [2023-02-24 18:09:58,879][177172] Sum rewards: 4.493, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.734', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon7': '0.054', 'WEAPON1': '0.080', 'AMMO3': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.178', 'WEAPON7': '0.200', 'weapon5': '0.268', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'HITCOUNT': '0.460', 'ARMOR': '0.466', 'weapon4': '0.656', 'WEAPON3': '0.750', 'weapon2': '0.788', 'weapon3': '1.820', 'DAMAGECOUNT': '2.070', 'FRAGCOUNT': '4.000'} [2023-02-24 18:09:58,920][177154] DAMAGECOUNT value on done: 59659.0 [2023-02-24 18:09:58,920][177154] Sum rewards: 2.166, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.504', 'ARMOR': '0.008', 'weapon7': '0.018', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.109', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.206', 'WEAPON5': '0.300', 'weapon4': '0.418', 'HITCOUNT': '0.420', 'weapon2': '0.614', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.668', 'weapon3': '1.720', 'FRAGCOUNT': '3.000'} [2023-02-24 18:09:59,181][177172] DAMAGECOUNT value on done: 58422.0 [2023-02-24 18:09:59,181][177172] Sum rewards: 8.673, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.047', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'AMMO4': '0.078', 'WEAPON5': '0.200', 'weapon5': '0.246', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'weapon4': '0.432', 'ARMOR': '0.516', 'HITCOUNT': '0.530', 'weapon3': '1.204', 'weapon2': '1.508', 'DAMAGECOUNT': '2.550', 'FRAGCOUNT': '6.000'} [2023-02-24 18:09:59,529][177157] DAMAGECOUNT value on done: 60115.0 [2023-02-24 18:09:59,529][177157] Sum rewards: 7.241, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.512', 'AMMO2': '0.010', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.050', 'weapon5': '0.060', 'AMMO3': '0.079', 'weapon7': '0.138', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.272', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.330', 'WEAPON3': '0.550', 'weapon2': '1.002', 'weapon3': '1.176', 'DAMAGECOUNT': '1.443', 'FRAGCOUNT': '6.000'} [2023-02-24 18:09:59,540][177157] DAMAGECOUNT value on done: 64879.0 [2023-02-24 18:09:59,540][177157] Sum rewards: 8.302, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.544', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.081', 'weapon7': '0.082', 'AMMO3': '0.083', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.262', 'weapon4': '0.356', 'ARMOR': '0.400', 'HITCOUNT': '0.470', 'WEAPON3': '0.550', 'weapon3': '1.320', 'weapon2': '1.526', 'DAMAGECOUNT': '2.232', 'FRAGCOUNT': '6.000'} [2023-02-24 18:09:59,737][177171] DAMAGECOUNT value on done: 61849.0 [2023-02-24 18:09:59,737][177171] Sum rewards: 3.596, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.226', 'ARMOR': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.035', 'WEAPON1': '0.050', 'AMMO3': '0.136', 'weapon5': '0.170', 'AMMO4': '0.173', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'HITCOUNT': '0.720', 'weapon2': '0.764', 'WEAPON3': '0.800', 'weapon4': '0.966', 'weapon3': '1.692', 'DAMAGECOUNT': '2.574', 'FRAGCOUNT': '7.000'} [2023-02-24 18:09:59,833][177157] DAMAGECOUNT value on done: 57234.0 [2023-02-24 18:09:59,833][177157] Sum rewards: 3.220, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.145', 'AMMO2': '0.022', 'AMMO5': '0.030', 'WEAPON1': '0.060', 'AMMO3': '0.103', 'weapon7': '0.110', 'AMMO4': '0.111', 'weapon5': '0.228', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.350', 'HITCOUNT': '0.370', 'WEAPON7': '0.400', 'weapon4': '0.594', 'WEAPON5': '0.600', 'WEAPON3': '0.650', 'weapon2': '0.888', 'weapon3': '1.272', 'DAMAGECOUNT': '1.347', 'FRAGCOUNT': '6.000'} [2023-02-24 18:09:59,844][177157] DAMAGECOUNT value on done: 60768.0 [2023-02-24 18:09:59,844][177157] Sum rewards: 10.145, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.072', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'AMMO4': '0.086', 'AMMO3': '0.096', 'WEAPON5': '0.300', 'weapon5': '0.384', 'WEAPON3': '0.650', 'HITCOUNT': '0.710', 'weapon2': '1.418', 'weapon3': '1.942', 'DAMAGECOUNT': '3.558', 'FRAGCOUNT': '7.000'} [2023-02-24 18:10:00,041][177171] DAMAGECOUNT value on done: 59283.0 [2023-02-24 18:10:00,041][177171] Sum rewards: 3.628, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.580', 'ARMOR': '0.004', 'AMMO2': '0.012', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'weapon7': '0.058', 'AMMO4': '0.062', 'AMMO3': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.224', 'weapon4': '0.326', 'WEAPON5': '0.350', 'HITCOUNT': '0.370', 'WEAPON3': '0.650', 'weapon2': '0.760', 'weapon3': '1.312', 'DAMAGECOUNT': '2.367', 'FRAGCOUNT': '4.000'} [2023-02-24 18:10:00,276][177171] DAMAGECOUNT value on done: 59102.0 [2023-02-24 18:10:00,276][177171] Sum rewards: 10.479, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.273', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.042', 'weapon7': '0.046', 'AMMO3': '0.079', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.208', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon5': '0.408', 'ARMOR': '0.560', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'weapon4': '0.610', 'weapon2': '0.886', 'weapon3': '1.438', 'DAMAGECOUNT': '2.235', 'FRAGCOUNT': '9.000'} [2023-02-24 18:10:00,304][177155] DAMAGECOUNT value on done: 61565.0 [2023-02-24 18:10:00,305][177155] Sum rewards: 6.239, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.710', 'AMMO5': '0.017', 'AMMO2': '0.028', 'WEAPON4': '0.050', 'WEAPON1': '0.100', 'AMMO3': '0.107', 'AMMO4': '0.138', 'weapon4': '0.216', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'weapon5': '0.500', 'HITCOUNT': '0.510', 'WEAPON3': '0.800', 'weapon2': '0.898', 'weapon3': '1.892', 'DAMAGECOUNT': '2.292', 'FRAGCOUNT': '6.000'} [2023-02-24 18:10:00,574][177171] DAMAGECOUNT value on done: 59136.0 [2023-02-24 18:10:00,574][177171] Sum rewards: 9.393, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.836', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'AMMO3': '0.040', 'weapon7': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.214', 'weapon4': '0.226', 'WEAPON3': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'ARMOR': '0.481', 'HITCOUNT': '0.590', 'weapon3': '0.966', 'weapon2': '1.910', 'DAMAGECOUNT': '2.634', 'FRAGCOUNT': '6.000'} [2023-02-24 18:10:00,600][177155] DAMAGECOUNT value on done: 63487.0 [2023-02-24 18:10:00,600][177155] Sum rewards: 11.847, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.220', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO3': '0.040', 'AMMO4': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.104', 'WEAPON4': '0.150', 'WEAPON3': '0.350', 'weapon4': '0.354', 'weapon2': '0.616', 'HITCOUNT': '0.720', 'weapon3': '0.822', 'DAMAGECOUNT': '2.517', 'FRAGCOUNT': '9.000'} [2023-02-24 18:10:00,890][177155] DAMAGECOUNT value on done: 63451.0 [2023-02-24 18:10:00,891][177155] Sum rewards: 11.999, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.519', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon7': '0.050', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.420', 'weapon3': '1.200', 'weapon2': '1.888', 'DAMAGECOUNT': '2.205', 'FRAGCOUNT': '8.000'} [2023-02-24 18:10:00,977][177153] Updated weights for policy 0, policy_version 9650 (0.0009) [2023-02-24 18:10:01,185][177155] DAMAGECOUNT value on done: 56579.0 [2023-02-24 18:10:01,186][177155] Sum rewards: 4.144, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.096', 'AMMO5': '0.012', 'AMMO2': '0.027', 'WEAPON1': '0.040', 'AMMO3': '0.106', 'AMMO4': '0.133', 'weapon5': '0.154', 'weapon7': '0.164', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.463', 'HITCOUNT': '0.560', 'weapon4': '0.652', 'WEAPON3': '0.700', 'weapon2': '0.958', 'weapon3': '1.512', 'DAMAGECOUNT': '2.469', 'FRAGCOUNT': '5.000'} [2023-02-24 18:10:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14063.0, 300 sec: 14037.5). Total num frames: 39530496. Throughput: 0: 3512.0. Samples: 9883730. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:10:01,376][177119] Avg episode reward: [(0, '5.789')] [2023-02-24 18:10:03,839][177153] Updated weights for policy 0, policy_version 9660 (0.0009) [2023-02-24 18:10:05,996][177156] DAMAGECOUNT value on done: 59020.0 [2023-02-24 18:10:05,996][177156] Sum rewards: 8.783, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.614', 'AMMO5': '0.010', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'weapon7': '0.054', 'AMMO4': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.106', 'weapon5': '0.156', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.312', 'WEAPON3': '0.700', 'HITCOUNT': '0.800', 'weapon2': '1.492', 'weapon3': '1.800', 'DAMAGECOUNT': '3.270', 'FRAGCOUNT': '8.000'} [2023-02-24 18:10:06,007][177156] DAMAGECOUNT value on done: 60365.0 [2023-02-24 18:10:06,007][177156] Sum rewards: 7.478, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.280', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.016', 'WEAPON1': '0.030', 'AMMO3': '0.099', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.416', 'WEAPON3': '0.650', 'HITCOUNT': '0.860', 'weapon2': '1.378', 'weapon3': '1.596', 'DAMAGECOUNT': '2.532', 'FRAGCOUNT': '8.000'} [2023-02-24 18:10:06,302][177156] DAMAGECOUNT value on done: 61170.0 [2023-02-24 18:10:06,302][177156] Sum rewards: 3.881, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.943', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'weapon7': '0.050', 'weapon5': '0.052', 'AMMO4': '0.090', 'AMMO3': '0.125', 'WEAPON4': '0.200', 'weapon4': '0.318', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.430', 'WEAPON3': '0.700', 'weapon2': '1.484', 'weapon3': '1.484', 'DAMAGECOUNT': '1.890', 'FRAGCOUNT': '5.000'} [2023-02-24 18:10:06,314][177156] DAMAGECOUNT value on done: 63275.0 [2023-02-24 18:10:06,314][177156] Sum rewards: 5.581, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.019', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'AMMO4': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'WEAPON4': '0.150', 'weapon4': '0.346', 'WEAPON3': '0.750', 'HITCOUNT': '0.820', 'weapon2': '1.776', 'weapon3': '1.788', 'DAMAGECOUNT': '2.880', 'FRAGCOUNT': '6.000'} [2023-02-24 18:10:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 14037.5). Total num frames: 39600128. Throughput: 0: 3514.3. Samples: 9894382. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:10:06,376][177119] Avg episode reward: [(0, '5.811')] [2023-02-24 18:10:06,379][177140] Saving new best policy, reward=5.811! [2023-02-24 18:10:06,745][177153] Updated weights for policy 0, policy_version 9670 (0.0009) [2023-02-24 18:10:09,649][177153] Updated weights for policy 0, policy_version 9680 (0.0008) [2023-02-24 18:10:11,376][177119] Fps is (10 sec: 14336.2, 60 sec: 14063.0, 300 sec: 14051.4). Total num frames: 39673856. Throughput: 0: 3513.3. Samples: 9915426. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:10:11,376][177119] Avg episode reward: [(0, '5.811')] [2023-02-24 18:10:12,544][177153] Updated weights for policy 0, policy_version 9690 (0.0008) [2023-02-24 18:10:13,723][177170] DAMAGECOUNT value on done: 61234.0 [2023-02-24 18:10:13,723][177170] Sum rewards: 5.515, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.276', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.037', 'AMMO3': '0.097', 'AMMO4': '0.183', 'weapon5': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.600', 'WEAPON3': '0.650', 'weapon2': '0.716', 'weapon4': '0.848', 'weapon3': '1.502', 'DAMAGECOUNT': '2.619', 'FRAGCOUNT': '7.000'} [2023-02-24 18:10:14,015][177170] DAMAGECOUNT value on done: 65130.0 [2023-02-24 18:10:14,015][177170] Sum rewards: 10.797, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.506', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.078', 'AMMO3': '0.080', 'AMMO4': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.196', 'weapon5': '0.236', 'WEAPON5': '0.250', 'HITCOUNT': '0.520', 'WEAPON3': '0.650', 'weapon3': '1.460', 'weapon2': '1.684', 'DAMAGECOUNT': '2.625', 'FRAGCOUNT': '10.000'} [2023-02-24 18:10:14,083][177170] DAMAGECOUNT value on done: 55624.0 [2023-02-24 18:10:14,084][177170] Sum rewards: 1.680, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.700', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.037', 'AMMO3': '0.048', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'weapon7': '0.276', 'WEAPON3': '0.400', 'AMMO6': '0.460', 'AMMO7': '0.460', 'WEAPON7': '0.700', 'weapon4': '0.744', 'weapon3': '0.824', 'DAMAGECOUNT': '0.951', 'weapon2': '1.060', 'FRAGCOUNT': '2.000'} [2023-02-24 18:10:14,381][177170] DAMAGECOUNT value on done: 64909.0 [2023-02-24 18:10:14,382][177170] Sum rewards: 13.330, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.100', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.017', 'WEAPON1': '0.070', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.180', 'weapon4': '0.274', 'WEAPON5': '0.450', 'ARMOR': '0.478', 'WEAPON3': '0.700', 'HITCOUNT': '0.830', 'weapon2': '1.120', 'weapon3': '1.766', 'DAMAGECOUNT': '3.609', 'FRAGCOUNT': '10.000'} [2023-02-24 18:10:14,750][177158] DAMAGECOUNT value on done: 58928.0 [2023-02-24 18:10:14,750][177158] Sum rewards: 5.331, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.698', 'AMMO5': '0.015', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'weapon7': '0.046', 'AMMO3': '0.067', 'AMMO4': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.132', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'HITCOUNT': '0.470', 'weapon4': '0.580', 'weapon3': '1.098', 'weapon2': '1.270', 'DAMAGECOUNT': '1.665', 'FRAGCOUNT': '5.000'} [2023-02-24 18:10:15,045][177158] DAMAGECOUNT value on done: 58818.0 [2023-02-24 18:10:15,045][177158] Sum rewards: 2.746, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.160', 'AMMO5': '0.006', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.040', 'AMMO3': '0.048', 'weapon7': '0.048', 'weapon5': '0.104', 'HITCOUNT': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.430', 'weapon2': '0.492', 'weapon3': '0.498', 'DAMAGECOUNT': '1.611', 'FRAGCOUNT': '3.000'} [2023-02-24 18:10:15,481][177153] Updated weights for policy 0, policy_version 9700 (0.0008) [2023-02-24 18:10:16,039][177158] DAMAGECOUNT value on done: 57916.0 [2023-02-24 18:10:16,039][177158] Sum rewards: 6.717, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.137', 'AMMO5': '0.025', 'AMMO2': '0.039', 'WEAPON4': '0.050', 'WEAPON1': '0.090', 'weapon4': '0.104', 'AMMO3': '0.133', 'AMMO4': '0.196', 'weapon5': '0.222', 'WEAPON5': '0.550', 'HITCOUNT': '0.560', 'weapon2': '0.798', 'WEAPON3': '0.950', 'weapon3': '2.292', 'DAMAGECOUNT': '2.595', 'FRAGCOUNT': '9.000'} [2023-02-24 18:10:16,332][177158] DAMAGECOUNT value on done: 62648.0 [2023-02-24 18:10:16,333][177158] Sum rewards: 13.282, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.795', 'AMMO2': '0.022', 'AMMO5': '0.023', 'ARMOR': '0.024', 'WEAPON1': '0.050', 'AMMO3': '0.108', 'AMMO4': '0.109', 'weapon4': '0.136', 'WEAPON4': '0.200', 'weapon5': '0.390', 'WEAPON5': '0.500', 'weapon2': '0.792', 'WEAPON3': '0.800', 'HITCOUNT': '0.940', 'weapon3': '2.306', 'DAMAGECOUNT': '3.927', 'FRAGCOUNT': '13.000'} [2023-02-24 18:10:16,376][177119] Fps is (10 sec: 14335.9, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 39743488. Throughput: 0: 3508.8. Samples: 9936406. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 18:10:16,376][177119] Avg episode reward: [(0, '6.045')] [2023-02-24 18:10:16,380][177140] Saving new best policy, reward=6.045! [2023-02-24 18:10:16,731][177172] DAMAGECOUNT value on done: 58950.0 [2023-02-24 18:10:16,732][177172] Sum rewards: 5.157, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'AMMO2': '0.007', 'HEALTH': '0.020', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'weapon5': '0.056', 'AMMO3': '0.068', 'WEAPON5': '0.100', 'HITCOUNT': '0.210', 'weapon7': '0.216', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.232', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'DAMAGECOUNT': '1.191', 'weapon3': '1.220', 'weapon2': '1.360', 'FRAGCOUNT': '3.000'} [2023-02-24 18:10:17,031][177172] DAMAGECOUNT value on done: 58751.0 [2023-02-24 18:10:17,032][177172] Sum rewards: 3.964, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.066', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON1': '0.040', 'AMMO3': '0.045', 'AMMO4': '0.067', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.116', 'weapon5': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'HITCOUNT': '0.410', 'weapon4': '0.504', 'weapon3': '0.784', 'weapon2': '0.846', 'DAMAGECOUNT': '2.184', 'FRAGCOUNT': '4.000'} [2023-02-24 18:10:17,561][177154] DAMAGECOUNT value on done: 64095.0 [2023-02-24 18:10:17,561][177154] Sum rewards: 10.854, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.113', 'AMMO5': '0.012', 'AMMO2': '0.018', 'ARMOR': '0.020', 'weapon7': '0.048', 'WEAPON4': '0.050', 'WEAPON1': '0.050', 'weapon4': '0.074', 'AMMO3': '0.085', 'AMMO4': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.300', 'weapon5': '0.300', 'WEAPON3': '0.700', 'HITCOUNT': '0.770', 'weapon2': '1.538', 'weapon3': '1.780', 'DAMAGECOUNT': '3.330', 'FRAGCOUNT': '8.500'} [2023-02-24 18:10:17,854][177154] DAMAGECOUNT value on done: 61812.0 [2023-02-24 18:10:17,854][177154] Sum rewards: 11.118, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.154', 'AMMO5': '0.020', 'ARMOR': '0.040', 'AMMO2': '0.044', 'WEAPON1': '0.080', 'AMMO3': '0.130', 'AMMO4': '0.220', 'weapon4': '0.280', 'weapon5': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.500', 'weapon2': '0.714', 'HITCOUNT': '0.870', 'WEAPON3': '0.950', 'weapon3': '2.220', 'DAMAGECOUNT': '3.870', 'FRAGCOUNT': '11.000'} [2023-02-24 18:10:17,863][177154] DAMAGECOUNT value on done: 60867.0 [2023-02-24 18:10:17,864][177154] Sum rewards: 5.294, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.695', 'AMMO5': '0.007', 'ARMOR': '0.028', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.071', 'weapon7': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.141', 'WEAPON4': '0.150', 'weapon5': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.256', 'WEAPON3': '0.500', 'HITCOUNT': '0.680', 'weapon2': '1.290', 'weapon3': '1.552', 'DAMAGECOUNT': '2.283', 'FRAGCOUNT': '5.000'} [2023-02-24 18:10:17,935][177172] DAMAGECOUNT value on done: 58333.0 [2023-02-24 18:10:17,936][177172] Sum rewards: 0.921, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.805', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'AMMO3': '0.049', 'weapon7': '0.056', 'AMMO4': '0.108', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'HITCOUNT': '0.190', 'weapon2': '0.198', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'WEAPON4': '0.350', 'weapon3': '0.436', 'weapon4': '0.536', 'DAMAGECOUNT': '1.242', 'FRAGCOUNT': '2.000'} [2023-02-24 18:10:18,156][177154] DAMAGECOUNT value on done: 60611.0 [2023-02-24 18:10:18,156][177154] Sum rewards: 8.358, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.705', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO5': '0.019', 'weapon7': '0.050', 'WEAPON1': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.129', 'WEAPON7': '0.200', 'weapon5': '0.268', 'WEAPON5': '0.450', 'HITCOUNT': '0.730', 'WEAPON3': '1.000', 'weapon2': '1.158', 'weapon3': '2.202', 'DAMAGECOUNT': '2.856', 'FRAGCOUNT': '9.000'} [2023-02-24 18:10:18,235][177172] DAMAGECOUNT value on done: 59146.0 [2023-02-24 18:10:18,236][177172] Sum rewards: 4.745, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.122', 'ARMOR': '0.004', 'AMMO2': '0.010', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.050', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'weapon5': '0.226', 'WEAPON5': '0.250', 'HITCOUNT': '0.550', 'WEAPON3': '0.600', 'weapon3': '1.582', 'weapon2': '1.948', 'DAMAGECOUNT': '2.172', 'FRAGCOUNT': '5.000'} [2023-02-24 18:10:18,434][177153] Updated weights for policy 0, policy_version 9710 (0.0008) [2023-02-24 18:10:18,623][177157] DAMAGECOUNT value on done: 61260.0 [2023-02-24 18:10:18,624][177157] Sum rewards: 9.718, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.736', 'AMMO5': '0.007', 'AMMO2': '0.034', 'WEAPON1': '0.040', 'weapon7': '0.068', 'AMMO3': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.240', 'weapon4': '0.286', 'WEAPON4': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.840', 'weapon2': '1.074', 'weapon3': '1.732', 'DAMAGECOUNT': '3.435', 'FRAGCOUNT': '6.000'} [2023-02-24 18:10:18,634][177157] DAMAGECOUNT value on done: 65579.0 [2023-02-24 18:10:18,634][177157] Sum rewards: 0.446, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.100', 'AMMO5': '0.013', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon7': '0.078', 'AMMO4': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.160', 'weapon5': '0.222', 'WEAPON5': '0.300', 'HITCOUNT': '0.430', 'WEAPON3': '0.750', 'weapon2': '1.526', 'weapon3': '1.780', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '4.000'} [2023-02-24 18:10:18,918][177171] DAMAGECOUNT value on done: 62593.0 [2023-02-24 18:10:18,918][177171] Sum rewards: 6.596, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.496', 'AMMO5': '0.010', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'AMMO3': '0.110', 'AMMO4': '0.123', 'weapon4': '0.136', 'WEAPON4': '0.150', 'weapon5': '0.168', 'WEAPON5': '0.300', 'ARMOR': '0.408', 'HITCOUNT': '0.540', 'WEAPON3': '0.750', 'weapon2': '1.406', 'weapon3': '1.944', 'DAMAGECOUNT': '2.232', 'FRAGCOUNT': '7.000'} [2023-02-24 18:10:18,928][177157] DAMAGECOUNT value on done: 57793.0 [2023-02-24 18:10:18,929][177157] Sum rewards: 3.230, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.172', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.044', 'WEAPON1': '0.060', 'weapon5': '0.118', 'AMMO3': '0.121', 'AMMO4': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.352', 'HITCOUNT': '0.490', 'WEAPON3': '0.800', 'weapon2': '1.218', 'DAMAGECOUNT': '1.677', 'weapon3': '1.930', 'FRAGCOUNT': '5.000'} [2023-02-24 18:10:18,940][177157] DAMAGECOUNT value on done: 60963.0 [2023-02-24 18:10:18,940][177157] Sum rewards: -0.434, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.868', 'AMMO2': '0.010', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'AMMO4': '0.048', 'weapon7': '0.052', 'AMMO3': '0.063', 'HITCOUNT': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.160', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.238', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'WEAPON5': '0.450', 'DAMAGECOUNT': '0.585', 'weapon3': '0.770', 'weapon2': '0.858', 'FRAGCOUNT': '1.000'} [2023-02-24 18:10:19,209][177171] DAMAGECOUNT value on done: 60246.0 [2023-02-24 18:10:19,210][177171] Sum rewards: 10.271, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.501', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon7': '0.066', 'AMMO3': '0.070', 'weapon5': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.412', 'ARMOR': '0.489', 'HITCOUNT': '0.490', 'WEAPON3': '0.500', 'weapon2': '0.664', 'weapon3': '1.422', 'DAMAGECOUNT': '2.889', 'FRAGCOUNT': '8.000'} [2023-02-24 18:10:19,477][177171] DAMAGECOUNT value on done: 60166.0 [2023-02-24 18:10:19,478][177171] Sum rewards: 9.267, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.975', 'weapon7': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'AMMO3': '0.091', 'AMMO4': '0.097', 'weapon5': '0.180', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.334', 'WEAPON5': '0.400', 'ARMOR': '0.496', 'WEAPON3': '0.650', 'HITCOUNT': '0.700', 'weapon2': '1.330', 'weapon3': '1.586', 'DAMAGECOUNT': '3.192', 'FRAGCOUNT': '7.000'} [2023-02-24 18:10:19,526][177155] DAMAGECOUNT value on done: 62071.0 [2023-02-24 18:10:19,526][177155] Sum rewards: 2.551, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.920', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'weapon7': '0.046', 'AMMO4': '0.073', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.111', 'weapon5': '0.202', 'weapon4': '0.232', 'WEAPON5': '0.300', 'HITCOUNT': '0.310', 'WEAPON3': '0.700', 'weapon3': '1.474', 'DAMAGECOUNT': '1.518', 'weapon2': '1.530', 'FRAGCOUNT': '4.000'} [2023-02-24 18:10:19,772][177171] DAMAGECOUNT value on done: 59755.0 [2023-02-24 18:10:19,773][177171] Sum rewards: 1.971, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.664', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'weapon5': '0.038', 'ARMOR': '0.040', 'weapon7': '0.052', 'AMMO3': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.398', 'WEAPON5': '0.400', 'HITCOUNT': '0.430', 'weapon2': '0.530', 'WEAPON3': '0.650', 'weapon3': '1.210', 'DAMAGECOUNT': '1.857', 'FRAGCOUNT': '4.000'} [2023-02-24 18:10:19,824][177155] DAMAGECOUNT value on done: 64626.0 [2023-02-24 18:10:19,825][177155] Sum rewards: 8.364, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.342', 'AMMO5': '0.021', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'AMMO4': '0.141', 'AMMO3': '0.155', 'weapon5': '0.192', 'weapon4': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'ARMOR': '0.502', 'HITCOUNT': '0.780', 'WEAPON3': '0.900', 'weapon2': '1.058', 'weapon3': '2.084', 'DAMAGECOUNT': '3.417', 'FRAGCOUNT': '9.000'} [2023-02-24 18:10:20,117][177155] DAMAGECOUNT value on done: 64597.0 [2023-02-24 18:10:20,118][177155] Sum rewards: 8.416, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.103', 'AMMO5': '0.012', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'AMMO4': '0.124', 'AMMO3': '0.134', 'weapon5': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon4': '0.406', 'WEAPON3': '0.850', 'HITCOUNT': '0.970', 'weapon2': '1.134', 'weapon3': '1.878', 'DAMAGECOUNT': '3.438', 'FRAGCOUNT': '7.500'} [2023-02-24 18:10:20,416][177155] DAMAGECOUNT value on done: 57651.0 [2023-02-24 18:10:20,417][177155] Sum rewards: 7.131, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.018', 'AMMO2': '0.002', 'AMMO4': '0.010', 'ARMOR': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'weapon4': '0.036', 'WEAPON4': '0.050', 'weapon5': '0.068', 'AMMO3': '0.120', 'WEAPON5': '0.350', 'HITCOUNT': '0.760', 'WEAPON3': '0.950', 'weapon2': '1.122', 'weapon3': '2.408', 'DAMAGECOUNT': '3.216', 'FRAGCOUNT': '9.000'} [2023-02-24 18:10:21,358][177153] Updated weights for policy 0, policy_version 9720 (0.0009) [2023-02-24 18:10:21,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14062.9, 300 sec: 14037.5). Total num frames: 39813120. Throughput: 0: 3506.1. Samples: 9946836. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 18:10:21,376][177119] Avg episode reward: [(0, '5.906')] [2023-02-24 18:10:24,278][177153] Updated weights for policy 0, policy_version 9730 (0.0009) [2023-02-24 18:10:25,271][177156] DAMAGECOUNT value on done: 59572.0 [2023-02-24 18:10:25,271][177156] Sum rewards: 3.966, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.316', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'weapon7': '0.100', 'AMMO3': '0.113', 'weapon5': '0.114', 'AMMO4': '0.118', 'weapon4': '0.128', 'WEAPON4': '0.250', 'AMMO6': '0.260', 'AMMO7': '0.260', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'HITCOUNT': '0.440', 'WEAPON3': '0.700', 'weapon2': '1.522', 'weapon3': '1.594', 'DAMAGECOUNT': '1.656', 'FRAGCOUNT': '7.000'} [2023-02-24 18:10:25,297][177156] DAMAGECOUNT value on done: 61300.0 [2023-02-24 18:10:25,297][177156] Sum rewards: 4.701, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.125', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.110', 'weapon5': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.512', 'HITCOUNT': '0.590', 'WEAPON3': '0.700', 'weapon2': '1.312', 'weapon3': '1.430', 'DAMAGECOUNT': '2.805', 'FRAGCOUNT': '8.000'} [2023-02-24 18:10:25,571][177156] DAMAGECOUNT value on done: 61950.0 [2023-02-24 18:10:25,572][177156] Sum rewards: 2.981, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.028', 'AMMO2': '0.012', 'ARMOR': '0.032', 'AMMO5': '0.035', 'WEAPON4': '0.050', 'AMMO4': '0.060', 'WEAPON1': '0.090', 'AMMO3': '0.152', 'weapon5': '0.178', 'weapon4': '0.186', 'WEAPON5': '0.550', 'HITCOUNT': '0.630', 'weapon2': '0.830', 'WEAPON3': '0.950', 'weapon3': '2.164', 'DAMAGECOUNT': '2.340', 'FRAGCOUNT': '7.000'} [2023-02-24 18:10:25,598][177156] DAMAGECOUNT value on done: 64542.0 [2023-02-24 18:10:25,598][177156] Sum rewards: 9.392, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.512', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon7': '0.038', 'AMMO3': '0.098', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.103', 'weapon5': '0.162', 'weapon4': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.527', 'WEAPON3': '0.650', 'HITCOUNT': '0.860', 'weapon2': '1.574', 'weapon3': '1.794', 'DAMAGECOUNT': '3.801', 'FRAGCOUNT': '7.500'} [2023-02-24 18:10:26,376][177119] Fps is (10 sec: 13926.5, 60 sec: 14063.0, 300 sec: 14037.5). Total num frames: 39882752. Throughput: 0: 3508.0. Samples: 9967940. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:10:26,376][177119] Avg episode reward: [(0, '5.942')] [2023-02-24 18:10:27,233][177153] Updated weights for policy 0, policy_version 9740 (0.0008) [2023-02-24 18:10:30,161][177153] Updated weights for policy 0, policy_version 9750 (0.0008) [2023-02-24 18:10:30,264][177171] Large shaping reward 2.553 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.069, -23.0), ('weapon5', 0.002)] [2023-02-24 18:10:31,376][177119] Fps is (10 sec: 13926.5, 60 sec: 14063.0, 300 sec: 14037.5). Total num frames: 39952384. Throughput: 0: 3507.6. Samples: 9988942. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:10:31,376][177119] Avg episode reward: [(0, '5.942')] [2023-02-24 18:10:32,857][177170] DAMAGECOUNT value on done: 61892.0 [2023-02-24 18:10:32,857][177170] Sum rewards: 5.429, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.057', 'weapon7': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.018', 'ARMOR': '0.024', 'WEAPON1': '0.030', 'AMMO4': '0.088', 'AMMO3': '0.106', 'WEAPON4': '0.150', 'weapon5': '0.180', 'weapon4': '0.224', 'HITCOUNT': '0.260', 'WEAPON5': '0.350', 'AMMO6': '0.500', 'WEAPON7': '0.500', 'AMMO7': '0.500', 'WEAPON3': '0.750', 'weapon3': '1.632', 'weapon2': '1.674', 'DAMAGECOUNT': '1.974', 'FRAGCOUNT': '5.000'} [2023-02-24 18:10:33,091][177153] Updated weights for policy 0, policy_version 9760 (0.0008) [2023-02-24 18:10:33,150][177170] DAMAGECOUNT value on done: 65757.0 [2023-02-24 18:10:33,150][177170] Sum rewards: 5.406, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.780', 'AMMO5': '0.011', 'AMMO2': '0.028', 'WEAPON1': '0.080', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'AMMO4': '0.140', 'weapon4': '0.156', 'weapon5': '0.262', 'WEAPON5': '0.400', 'HITCOUNT': '0.410', 'WEAPON3': '0.700', 'weapon2': '1.322', 'weapon3': '1.860', 'DAMAGECOUNT': '1.881', 'FRAGCOUNT': '5.000'} [2023-02-24 18:10:33,220][177170] DAMAGECOUNT value on done: 55906.0 [2023-02-24 18:10:33,221][177170] Sum rewards: -2.541, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.013', 'AMMO5': '0.023', 'AMMO2': '0.031', 'weapon7': '0.056', 'WEAPON1': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.139', 'weapon5': '0.140', 'AMMO4': '0.155', 'HITCOUNT': '0.190', 'weapon4': '0.316', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'DAMAGECOUNT': '0.846', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.012', 'weapon3': '1.374'} [2023-02-24 18:10:33,520][177170] DAMAGECOUNT value on done: 65830.0 [2023-02-24 18:10:33,521][177170] Sum rewards: 6.071, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.709', 'AMMO2': '0.018', 'AMMO5': '0.021', 'WEAPON1': '0.060', 'AMMO4': '0.092', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'weapon5': '0.164', 'weapon4': '0.258', 'WEAPON5': '0.400', 'ARMOR': '0.519', 'HITCOUNT': '0.790', 'WEAPON3': '0.950', 'weapon2': '1.092', 'weapon3': '2.128', 'DAMAGECOUNT': '2.763', 'FRAGCOUNT': '6.500'} [2023-02-24 18:10:33,933][177158] DAMAGECOUNT value on done: 59279.0 [2023-02-24 18:10:33,934][177158] Sum rewards: 0.890, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.614', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'ARMOR': '0.032', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'AMMO3': '0.058', 'AMMO4': '0.185', 'weapon7': '0.206', 'HITCOUNT': '0.330', 'WEAPON3': '0.400', 'WEAPON4': '0.550', 'AMMO6': '0.620', 'AMMO7': '0.620', 'WEAPON7': '0.700', 'weapon4': '0.722', 'weapon3': '0.894', 'DAMAGECOUNT': '1.053', 'weapon2': '1.534', 'FRAGCOUNT': '2.000'} [2023-02-24 18:10:34,220][177158] DAMAGECOUNT value on done: 59888.0 [2023-02-24 18:10:34,221][177158] Sum rewards: 10.904, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.803', 'AMMO2': '0.013', 'AMMO5': '0.020', 'WEAPON1': '0.060', 'AMMO4': '0.066', 'AMMO3': '0.068', 'weapon7': '0.164', 'weapon5': '0.194', 'WEAPON4': '0.300', 'AMMO6': '0.360', 'AMMO7': '0.360', 'WEAPON3': '0.450', 'HITCOUNT': '0.450', 'WEAPON5': '0.500', 'WEAPON7': '0.600', 'weapon4': '0.832', 'weapon2': '1.024', 'weapon3': '1.036', 'DAMAGECOUNT': '3.210', 'FRAGCOUNT': '8.000'} [2023-02-24 18:10:35,215][177158] DAMAGECOUNT value on done: 59259.0 [2023-02-24 18:10:35,216][177158] Sum rewards: 11.608, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.560', 'AMMO5': '0.020', 'AMMO2': '0.035', 'weapon7': '0.042', 'WEAPON1': '0.070', 'AMMO3': '0.090', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.175', 'WEAPON4': '0.200', 'weapon4': '0.246', 'weapon5': '0.326', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'weapon2': '0.886', 'HITCOUNT': '0.950', 'weapon3': '1.908', 'DAMAGECOUNT': '4.020', 'FRAGCOUNT': '10.000'} [2023-02-24 18:10:35,513][177158] DAMAGECOUNT value on done: 64105.0 [2023-02-24 18:10:35,513][177158] Sum rewards: 13.072, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.144', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.030', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.137', 'AMMO4': '0.151', 'weapon4': '0.204', 'weapon5': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.780', 'ARMOR': '0.800', 'WEAPON3': '0.850', 'weapon2': '1.378', 'weapon3': '1.862', 'DAMAGECOUNT': '4.371', 'FRAGCOUNT': '11.500'} [2023-02-24 18:10:35,946][177172] DAMAGECOUNT value on done: 60088.0 [2023-02-24 18:10:35,946][177172] Sum rewards: 9.812, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.478', 'AMMO5': '0.009', 'AMMO2': '0.020', 'ARMOR': '0.024', 'WEAPON1': '0.060', 'AMMO3': '0.090', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'weapon7': '0.118', 'weapon5': '0.144', 'weapon4': '0.208', 'WEAPON5': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.670', 'weapon2': '1.346', 'weapon3': '1.798', 'DAMAGECOUNT': '3.414', 'FRAGCOUNT': '7.000'} [2023-02-24 18:10:36,001][177153] Updated weights for policy 0, policy_version 9770 (0.0008) [2023-02-24 18:10:36,243][177172] DAMAGECOUNT value on done: 59421.0 [2023-02-24 18:10:36,243][177172] Sum rewards: 2.545, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.614', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO5': '0.017', 'ARMOR': '0.028', 'weapon5': '0.068', 'AMMO4': '0.084', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.350', 'weapon4': '0.352', 'HITCOUNT': '0.510', 'WEAPON3': '0.650', 'weapon2': '1.336', 'weapon3': '1.672', 'DAMAGECOUNT': '2.010', 'FRAGCOUNT': '3.000'} [2023-02-24 18:10:36,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 14037.5). Total num frames: 40022016. Throughput: 0: 3507.2. Samples: 9999460. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:10:36,376][177119] Avg episode reward: [(0, '6.230')] [2023-02-24 18:10:36,379][177140] Saving new best policy, reward=6.230! [2023-02-24 18:10:36,693][177154] DAMAGECOUNT value on done: 64818.0 [2023-02-24 18:10:36,694][177154] Sum rewards: 5.454, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.020', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'AMMO3': '0.084', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.350', 'weapon5': '0.442', 'WEAPON3': '0.450', 'weapon4': '0.462', 'HEALTH': '0.492', 'HITCOUNT': '0.580', 'weapon3': '1.008', 'weapon2': '1.308', 'DAMAGECOUNT': '2.169', 'FRAGCOUNT': '6.000'} [2023-02-24 18:10:36,985][177154] DAMAGECOUNT value on done: 62150.0 [2023-02-24 18:10:36,985][177154] Sum rewards: 0.963, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.654', 'AMMO5': '0.004', 'ARMOR': '0.024', 'AMMO2': '0.029', 'weapon5': '0.052', 'AMMO3': '0.065', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'weapon7': '0.154', 'HITCOUNT': '0.210', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'weapon3': '0.438', 'WEAPON7': '0.500', 'weapon4': '0.650', 'DAMAGECOUNT': '1.014', 'weapon2': '1.554', 'FRAGCOUNT': '2.000'} [2023-02-24 18:10:36,994][177154] DAMAGECOUNT value on done: 61996.0 [2023-02-24 18:10:36,994][177154] Sum rewards: 10.225, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.090', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'weapon7': '0.058', 'weapon4': '0.080', 'AMMO4': '0.083', 'AMMO3': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.256', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '0.730', 'weapon3': '1.524', 'weapon2': '1.770', 'DAMAGECOUNT': '3.387', 'FRAGCOUNT': '10.000'} [2023-02-24 18:10:37,159][177172] DAMAGECOUNT value on done: 59134.0 [2023-02-24 18:10:37,159][177172] Sum rewards: 6.720, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.073', 'HEALTH': '0.077', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.126', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.298', 'WEAPON3': '0.500', 'HITCOUNT': '0.650', 'weapon2': '1.490', 'weapon3': '1.550', 'DAMAGECOUNT': '2.403', 'FRAGCOUNT': '4.000'} [2023-02-24 18:10:37,296][177154] DAMAGECOUNT value on done: 61175.0 [2023-02-24 18:10:37,296][177154] Sum rewards: 6.336, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.025', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO3': '0.040', 'WEAPON4': '0.100', 'weapon4': '0.202', 'weapon7': '0.250', 'WEAPON3': '0.350', 'AMMO6': '0.440', 'AMMO7': '0.440', 'HITCOUNT': '0.480', 'WEAPON7': '0.600', 'weapon3': '0.966', 'weapon2': '1.594', 'DAMAGECOUNT': '1.692', 'FRAGCOUNT': '4.000'} [2023-02-24 18:10:37,453][177172] DAMAGECOUNT value on done: 60556.0 [2023-02-24 18:10:37,454][177172] Sum rewards: 9.416, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.576', 'ARMOR': '0.004', 'AMMO2': '0.029', 'AMMO5': '0.030', 'WEAPON1': '0.050', 'weapon7': '0.060', 'AMMO4': '0.146', 'AMMO3': '0.149', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'weapon4': '0.286', 'weapon5': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.600', 'HITCOUNT': '0.850', 'weapon2': '0.882', 'WEAPON3': '0.900', 'weapon3': '2.024', 'DAMAGECOUNT': '4.230', 'FRAGCOUNT': '10.500'} [2023-02-24 18:10:37,786][177157] DAMAGECOUNT value on done: 66365.0 [2023-02-24 18:10:37,787][177157] Sum rewards: 9.344, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.635', 'AMMO2': '0.003', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.015', 'weapon7': '0.048', 'AMMO3': '0.065', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.234', 'weapon5': '0.314', 'WEAPON3': '0.500', 'HITCOUNT': '0.590', 'weapon3': '1.352', 'weapon2': '1.492', 'DAMAGECOUNT': '2.358', 'FRAGCOUNT': '6.000'} [2023-02-24 18:10:37,797][177157] DAMAGECOUNT value on done: 61963.0 [2023-02-24 18:10:37,797][177157] Sum rewards: 7.835, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.030', 'WEAPON1': '0.040', 'weapon7': '0.054', 'AMMO3': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'weapon5': '0.150', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'HITCOUNT': '0.410', 'HEALTH': '0.532', 'weapon4': '0.554', 'weapon2': '0.568', 'weapon3': '1.308', 'DAMAGECOUNT': '2.109', 'FRAGCOUNT': '6.000'} [2023-02-24 18:10:38,086][177171] DAMAGECOUNT value on done: 63543.0 [2023-02-24 18:10:38,086][177171] Sum rewards: 8.720, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.330', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.044', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'weapon7': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.218', 'WEAPON3': '0.450', 'WEAPON4': '0.450', 'HITCOUNT': '0.750', 'weapon4': '0.766', 'weapon2': '0.956', 'weapon3': '1.488', 'DAMAGECOUNT': '2.850', 'FRAGCOUNT': '8.000'} [2023-02-24 18:10:38,091][177157] DAMAGECOUNT value on done: 61473.0 [2023-02-24 18:10:38,092][177157] Sum rewards: 6.077, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.027', 'AMMO2': '0.008', 'AMMO5': '0.013', 'AMMO4': '0.040', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO3': '0.063', 'weapon5': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.460', 'WEAPON3': '0.500', 'weapon4': '0.530', 'weapon3': '0.902', 'DAMAGECOUNT': '1.530', 'weapon2': '1.542', 'FRAGCOUNT': '5.000'} [2023-02-24 18:10:38,102][177157] DAMAGECOUNT value on done: 58598.0 [2023-02-24 18:10:38,103][177157] Sum rewards: 8.766, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.874', 'AMMO5': '0.015', 'AMMO2': '0.020', 'weapon7': '0.054', 'WEAPON1': '0.060', 'AMMO3': '0.082', 'AMMO4': '0.099', 'weapon5': '0.148', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.426', 'ARMOR': '0.467', 'WEAPON3': '0.600', 'HITCOUNT': '0.750', 'weapon2': '1.068', 'weapon3': '1.786', 'DAMAGECOUNT': '2.415', 'FRAGCOUNT': '8.000'} [2023-02-24 18:10:38,379][177171] DAMAGECOUNT value on done: 60831.0 [2023-02-24 18:10:38,380][177171] Sum rewards: 5.761, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.089', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.038', 'weapon7': '0.052', 'AMMO3': '0.057', 'WEAPON4': '0.150', 'weapon4': '0.178', 'HITCOUNT': '0.190', 'WEAPON5': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON3': '0.350', 'WEAPON7': '0.400', 'ARMOR': '0.456', 'weapon5': '0.496', 'weapon3': '0.928', 'DAMAGECOUNT': '1.746', 'weapon2': '1.886', 'FRAGCOUNT': '5.000'} [2023-02-24 18:10:38,666][177171] DAMAGECOUNT value on done: 61166.0 [2023-02-24 18:10:38,667][177171] Sum rewards: 9.120, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.516', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.072', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.106', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.424', 'weapon4': '0.426', 'HITCOUNT': '0.700', 'WEAPON3': '0.750', 'weapon3': '1.422', 'weapon2': '1.584', 'DAMAGECOUNT': '3.000', 'FRAGCOUNT': '8.000'} [2023-02-24 18:10:38,683][177155] DAMAGECOUNT value on done: 62581.0 [2023-02-24 18:10:38,684][177155] Sum rewards: 4.770, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.045', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.016', 'ARMOR': '0.028', 'WEAPON1': '0.040', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon7': '0.128', 'weapon5': '0.130', 'WEAPON5': '0.200', 'weapon4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'HITCOUNT': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'weapon3': '1.088', 'DAMAGECOUNT': '1.530', 'weapon2': '1.886', 'FRAGCOUNT': '4.000'} [2023-02-24 18:10:38,961][177171] DAMAGECOUNT value on done: 60592.0 [2023-02-24 18:10:38,961][177171] Sum rewards: 9.971, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.360', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.103', 'weapon5': '0.184', 'weapon4': '0.212', 'WEAPON5': '0.350', 'ARMOR': '0.491', 'HITCOUNT': '0.630', 'WEAPON3': '0.750', 'weapon2': '1.218', 'weapon3': '1.408', 'DAMAGECOUNT': '2.511', 'FRAGCOUNT': '9.000'} [2023-02-24 18:10:38,965][177153] Updated weights for policy 0, policy_version 9780 (0.0008) [2023-02-24 18:10:38,979][177155] DAMAGECOUNT value on done: 64989.0 [2023-02-24 18:10:38,979][177155] Sum rewards: 3.815, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO2': '0.005', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'ARMOR': '0.016', 'HEALTH': '0.018', 'weapon4': '0.024', 'AMMO4': '0.024', 'AMMO3': '0.040', 'WEAPON4': '0.050', 'weapon7': '0.056', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.130', 'weapon5': '0.146', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'weapon3': '0.488', 'DAMAGECOUNT': '1.089', 'FRAGCOUNT': '1.500', 'weapon2': '1.570'} [2023-02-24 18:10:39,279][177155] DAMAGECOUNT value on done: 66168.0 [2023-02-24 18:10:39,280][177155] Sum rewards: 15.265, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.510', 'AMMO2': '0.014', 'AMMO5': '0.018', 'WEAPON1': '0.040', 'AMMO4': '0.067', 'AMMO3': '0.131', 'weapon5': '0.138', 'weapon4': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.970', 'WEAPON3': '1.000', 'weapon2': '1.306', 'weapon3': '2.112', 'DAMAGECOUNT': '4.353', 'FRAGCOUNT': '15.000'} [2023-02-24 18:10:39,574][177155] DAMAGECOUNT value on done: 58516.0 [2023-02-24 18:10:39,575][177155] Sum rewards: 6.930, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.596', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon7': '0.020', 'ARMOR': '0.032', 'WEAPON1': '0.050', 'AMMO4': '0.098', 'weapon5': '0.114', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.364', 'HITCOUNT': '0.710', 'WEAPON3': '0.800', 'weapon2': '0.990', 'weapon3': '2.100', 'DAMAGECOUNT': '2.595', 'FRAGCOUNT': '6.000'} [2023-02-24 18:10:41,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14062.9, 300 sec: 14037.5). Total num frames: 40091648. Throughput: 0: 3504.8. Samples: 10020482. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:10:41,376][177119] Avg episode reward: [(0, '6.604')] [2023-02-24 18:10:41,377][177140] Saving new best policy, reward=6.604! [2023-02-24 18:10:41,893][177153] Updated weights for policy 0, policy_version 9790 (0.0008) [2023-02-24 18:10:44,542][177156] DAMAGECOUNT value on done: 60192.0 [2023-02-24 18:10:44,543][177156] Sum rewards: 6.174, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.520', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon7': '0.064', 'weapon5': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon4': '0.196', 'WEAPON5': '0.250', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'ARMOR': '0.462', 'HITCOUNT': '0.500', 'WEAPON3': '0.700', 'weapon2': '1.298', 'weapon3': '1.654', 'DAMAGECOUNT': '1.860', 'FRAGCOUNT': '7.000'} [2023-02-24 18:10:44,553][177156] DAMAGECOUNT value on done: 62687.0 [2023-02-24 18:10:44,553][177156] Sum rewards: 9.660, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.214', 'AMMO5': '0.023', 'AMMO2': '0.027', 'WEAPON1': '0.090', 'AMMO3': '0.097', 'AMMO4': '0.134', 'weapon5': '0.248', 'WEAPON4': '0.250', 'weapon4': '0.546', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'HITCOUNT': '0.920', 'weapon2': '1.052', 'weapon3': '1.526', 'DAMAGECOUNT': '4.161', 'FRAGCOUNT': '8.000'} [2023-02-24 18:10:44,818][177153] Updated weights for policy 0, policy_version 9800 (0.0008) [2023-02-24 18:10:44,852][177156] DAMAGECOUNT value on done: 63129.0 [2023-02-24 18:10:44,852][177156] Sum rewards: 14.269, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'AMMO3': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.127', 'weapon5': '0.172', 'WEAPON5': '0.200', 'weapon7': '0.202', 'WEAPON3': '0.350', 'weapon4': '0.418', 'HITCOUNT': '0.580', 'HEALTH': '0.598', 'weapon3': '0.888', 'weapon2': '1.486', 'DAMAGECOUNT': '3.537', 'FRAGCOUNT': '9.000'} [2023-02-24 18:10:44,863][177156] DAMAGECOUNT value on done: 65207.0 [2023-02-24 18:10:44,864][177156] Sum rewards: 3.621, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.800', 'AMMO5': '0.015', 'ARMOR': '0.020', 'AMMO2': '0.030', 'weapon7': '0.050', 'WEAPON1': '0.070', 'AMMO3': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.142', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.246', 'WEAPON5': '0.350', 'HITCOUNT': '0.580', 'WEAPON3': '0.700', 'weapon3': '1.534', 'weapon2': '1.798', 'DAMAGECOUNT': '1.995', 'FRAGCOUNT': '6.000'} [2023-02-24 18:10:46,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.6, 300 sec: 14037.5). Total num frames: 40161280. Throughput: 0: 3502.7. Samples: 10041350. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:10:46,376][177119] Avg episode reward: [(0, '6.680')] [2023-02-24 18:10:46,379][177140] Saving new best policy, reward=6.680! [2023-02-24 18:10:47,766][177153] Updated weights for policy 0, policy_version 9810 (0.0009) [2023-02-24 18:10:50,674][177153] Updated weights for policy 0, policy_version 9820 (0.0008) [2023-02-24 18:10:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14037.5). Total num frames: 40230912. Throughput: 0: 3499.4. Samples: 10051856. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:10:51,376][177119] Avg episode reward: [(0, '6.680')] [2023-02-24 18:10:52,044][177170] DAMAGECOUNT value on done: 62953.0 [2023-02-24 18:10:52,045][177170] Sum rewards: 11.865, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'AMMO3': '0.070', 'AMMO4': '0.106', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.310', 'weapon5': '0.384', 'WEAPON3': '0.400', 'ARMOR': '0.440', 'HITCOUNT': '0.670', 'HEALTH': '0.733', 'weapon2': '1.440', 'weapon3': '1.558', 'DAMAGECOUNT': '3.183', 'FRAGCOUNT': '8.000'} [2023-02-24 18:10:52,342][177170] DAMAGECOUNT value on done: 66533.0 [2023-02-24 18:10:52,342][177170] Sum rewards: 7.760, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.157', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'AMMO2': '0.033', 'AMMO3': '0.090', 'weapon7': '0.126', 'weapon5': '0.128', 'AMMO4': '0.164', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'HITCOUNT': '0.630', 'WEAPON3': '0.700', 'weapon2': '0.782', 'weapon4': '0.882', 'weapon3': '1.436', 'DAMAGECOUNT': '2.328', 'FRAGCOUNT': '9.000'} [2023-02-24 18:10:52,422][177170] DAMAGECOUNT value on done: 56266.0 [2023-02-24 18:10:52,422][177170] Sum rewards: 1.460, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.780', 'AMMO2': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.021', 'weapon5': '0.066', 'AMMO3': '0.074', 'WEAPON5': '0.100', 'weapon7': '0.112', 'WEAPON4': '0.200', 'weapon4': '0.206', 'AMMO6': '0.240', 'AMMO7': '0.240', 'HITCOUNT': '0.300', 'WEAPON7': '0.400', 'WEAPON3': '0.600', 'weapon2': '0.942', 'DAMAGECOUNT': '1.080', 'weapon3': '1.130', 'FRAGCOUNT': '2.000'} [2023-02-24 18:10:52,721][177170] DAMAGECOUNT value on done: 66586.0 [2023-02-24 18:10:52,722][177170] Sum rewards: 3.094, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.880', 'AMMO5': '0.008', 'ARMOR': '0.020', 'AMMO2': '0.022', 'WEAPON1': '0.050', 'AMMO3': '0.107', 'AMMO4': '0.109', 'weapon7': '0.122', 'weapon5': '0.132', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON7': '0.400', 'weapon4': '0.414', 'HITCOUNT': '0.630', 'WEAPON3': '0.650', 'weapon2': '0.936', 'weapon3': '1.796', 'DAMAGECOUNT': '2.268', 'FRAGCOUNT': '5.000'} [2023-02-24 18:10:53,185][177158] DAMAGECOUNT value on done: 60346.0 [2023-02-24 18:10:53,185][177158] Sum rewards: 9.767, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.968', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.083', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.116', 'AMMO3': '0.134', 'WEAPON5': '0.200', 'weapon4': '0.324', 'ARMOR': '0.460', 'HITCOUNT': '0.800', 'WEAPON3': '0.850', 'weapon2': '1.178', 'weapon3': '1.934', 'DAMAGECOUNT': '3.201', 'FRAGCOUNT': '10.000'} [2023-02-24 18:10:53,478][177158] DAMAGECOUNT value on done: 60572.0 [2023-02-24 18:10:53,479][177158] Sum rewards: 5.773, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.400', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'weapon7': '0.076', 'AMMO3': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.127', 'weapon5': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.468', 'WEAPON3': '0.550', 'HITCOUNT': '0.650', 'weapon2': '1.138', 'weapon3': '1.646', 'DAMAGECOUNT': '2.052', 'FRAGCOUNT': '5.500'} [2023-02-24 18:10:53,612][177153] Updated weights for policy 0, policy_version 9830 (0.0008) [2023-02-24 18:10:54,481][177158] DAMAGECOUNT value on done: 60085.0 [2023-02-24 18:10:54,481][177158] Sum rewards: 8.385, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.318', 'AMMO5': '0.022', 'AMMO2': '0.028', 'WEAPON1': '0.060', 'AMMO3': '0.098', 'AMMO4': '0.137', 'WEAPON4': '0.200', 'weapon5': '0.284', 'weapon4': '0.294', 'HITCOUNT': '0.450', 'ARMOR': '0.469', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'weapon2': '1.380', 'weapon3': '1.652', 'DAMAGECOUNT': '2.478', 'FRAGCOUNT': '6.000'} [2023-02-24 18:10:54,773][177158] DAMAGECOUNT value on done: 65022.0 [2023-02-24 18:10:54,773][177158] Sum rewards: 7.536, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.011', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'weapon5': '0.052', 'AMMO4': '0.056', 'WEAPON1': '0.060', 'weapon7': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.152', 'weapon4': '0.224', 'HEALTH': '0.274', 'WEAPON5': '0.400', 'weapon2': '0.490', 'HITCOUNT': '0.680', 'WEAPON3': '0.850', 'weapon3': '2.084', 'DAMAGECOUNT': '2.751', 'FRAGCOUNT': '8.000'} [2023-02-24 18:10:55,177][177172] DAMAGECOUNT value on done: 61243.0 [2023-02-24 18:10:55,178][177172] Sum rewards: 11.553, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.130', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.030', 'weapon7': '0.066', 'AMMO3': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.152', 'WEAPON7': '0.200', 'weapon5': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.512', 'HITCOUNT': '0.900', 'weapon2': '1.342', 'weapon3': '1.578', 'DAMAGECOUNT': '3.465', 'FRAGCOUNT': '11.000'} [2023-02-24 18:10:55,477][177172] DAMAGECOUNT value on done: 60756.0 [2023-02-24 18:10:55,478][177172] Sum rewards: 8.813, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.727', 'AMMO2': '0.009', 'weapon4': '0.020', 'AMMO5': '0.023', 'WEAPON1': '0.040', 'AMMO4': '0.043', 'weapon5': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.178', 'WEAPON5': '0.450', 'HITCOUNT': '1.060', 'WEAPON3': '1.150', 'weapon2': '1.308', 'weapon3': '2.340', 'DAMAGECOUNT': '4.005', 'FRAGCOUNT': '11.000'} [2023-02-24 18:10:55,903][177154] DAMAGECOUNT value on done: 65688.0 [2023-02-24 18:10:55,903][177154] Sum rewards: 5.873, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.460', 'AMMO2': '0.025', 'AMMO5': '0.026', 'weapon7': '0.052', 'WEAPON1': '0.080', 'AMMO3': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.125', 'WEAPON7': '0.200', 'weapon5': '0.278', 'WEAPON4': '0.300', 'ARMOR': '0.462', 'weapon4': '0.482', 'WEAPON3': '0.550', 'WEAPON5': '0.550', 'HITCOUNT': '0.660', 'weapon2': '1.412', 'weapon3': '1.448', 'DAMAGECOUNT': '2.610', 'FRAGCOUNT': '5.000'} [2023-02-24 18:10:56,203][177154] DAMAGECOUNT value on done: 62962.0 [2023-02-24 18:10:56,204][177154] Sum rewards: 8.949, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.081', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.037', 'AMMO3': '0.075', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.183', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'weapon7': '0.400', 'ARMOR': '0.420', 'WEAPON3': '0.450', 'HITCOUNT': '0.570', 'weapon4': '0.614', 'weapon3': '0.990', 'weapon2': '1.262', 'DAMAGECOUNT': '2.436', 'FRAGCOUNT': '6.000'} [2023-02-24 18:10:56,213][177154] DAMAGECOUNT value on done: 62801.0 [2023-02-24 18:10:56,213][177154] Sum rewards: 10.879, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.455', 'AMMO5': '0.027', 'AMMO2': '0.039', 'AMMO3': '0.078', 'WEAPON1': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.110', 'AMMO4': '0.196', 'WEAPON4': '0.200', 'weapon4': '0.222', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'WEAPON5': '0.550', 'weapon5': '0.554', 'HITCOUNT': '0.580', 'weapon2': '1.010', 'weapon3': '1.522', 'DAMAGECOUNT': '2.415', 'FRAGCOUNT': '7.000'} [2023-02-24 18:10:56,367][177172] DAMAGECOUNT value on done: 59776.0 [2023-02-24 18:10:56,368][177172] Sum rewards: 1.887, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.268', 'ARMOR': '0.012', 'AMMO5': '0.034', 'AMMO2': '0.041', 'WEAPON1': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.203', 'weapon5': '0.278', 'weapon4': '0.356', 'WEAPON4': '0.450', 'HITCOUNT': '0.530', 'WEAPON3': '0.700', 'WEAPON5': '0.700', 'weapon3': '1.438', 'weapon2': '1.528', 'DAMAGECOUNT': '1.926', 'FRAGCOUNT': '6.000'} [2023-02-24 18:10:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.6, 300 sec: 14023.6). Total num frames: 40300544. Throughput: 0: 3499.5. Samples: 10072904. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:10:56,376][177119] Avg episode reward: [(0, '6.803')] [2023-02-24 18:10:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000009839_40300544.pth... [2023-02-24 18:10:56,436][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000009017_36933632.pth [2023-02-24 18:10:56,443][177140] Saving new best policy, reward=6.803! [2023-02-24 18:10:56,530][177154] DAMAGECOUNT value on done: 62576.0 [2023-02-24 18:10:56,531][177154] Sum rewards: 10.738, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.000', 'AMMO5': '0.015', 'ARMOR': '0.040', 'AMMO2': '0.049', 'WEAPON1': '0.070', 'weapon7': '0.070', 'AMMO3': '0.077', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'weapon5': '0.660', 'weapon4': '0.674', 'weapon2': '0.748', 'HITCOUNT': '0.980', 'weapon3': '1.358', 'DAMAGECOUNT': '4.203', 'FRAGCOUNT': '9.000'} [2023-02-24 18:10:56,553][177153] Updated weights for policy 0, policy_version 9840 (0.0008) [2023-02-24 18:10:56,690][177172] DAMAGECOUNT value on done: 61197.0 [2023-02-24 18:10:56,690][177172] Sum rewards: 2.357, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.664', 'AMMO5': '0.021', 'AMMO2': '0.032', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO3': '0.091', 'AMMO4': '0.161', 'weapon4': '0.196', 'weapon5': '0.204', 'ARMOR': '0.400', 'HITCOUNT': '0.520', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'weapon3': '1.660', 'weapon2': '1.692', 'DAMAGECOUNT': '1.923', 'FRAGCOUNT': '4.000'} [2023-02-24 18:10:57,032][177157] DAMAGECOUNT value on done: 67250.0 [2023-02-24 18:10:57,033][177157] Sum rewards: 9.020, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.275', 'AMMO5': '0.004', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'AMMO4': '0.029', 'weapon5': '0.034', 'AMMO3': '0.065', 'weapon7': '0.094', 'WEAPON5': '0.100', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.690', 'weapon3': '1.316', 'weapon2': '1.572', 'DAMAGECOUNT': '2.655', 'FRAGCOUNT': '6.000'} [2023-02-24 18:10:57,044][177157] DAMAGECOUNT value on done: 62812.0 [2023-02-24 18:10:57,045][177157] Sum rewards: 9.409, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.101', 'weapon7': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.020', 'WEAPON1': '0.090', 'AMMO4': '0.098', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.102', 'AMMO3': '0.121', 'WEAPON5': '0.450', 'HITCOUNT': '0.730', 'WEAPON3': '0.900', 'weapon2': '1.216', 'weapon3': '2.408', 'DAMAGECOUNT': '2.547', 'FRAGCOUNT': '9.000'} [2023-02-24 18:10:57,306][177171] DAMAGECOUNT value on done: 64068.0 [2023-02-24 18:10:57,306][177171] Sum rewards: 4.536, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.040', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.098', 'AMMO3': '0.103', 'weapon7': '0.148', 'WEAPON5': '0.150', 'AMMO6': '0.260', 'AMMO7': '0.260', 'WEAPON7': '0.300', 'HITCOUNT': '0.440', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.575', 'weapon3': '1.688', 'weapon2': '1.798', 'FRAGCOUNT': '4.000'} [2023-02-24 18:10:57,338][177157] DAMAGECOUNT value on done: 62740.0 [2023-02-24 18:10:57,339][177157] Sum rewards: 12.866, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.942', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon7': '0.052', 'WEAPON1': '0.060', 'AMMO4': '0.071', 'AMMO3': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon5': '0.376', 'weapon4': '0.416', 'WEAPON3': '0.700', 'HITCOUNT': '0.920', 'weapon2': '0.972', 'weapon3': '1.810', 'DAMAGECOUNT': '3.801', 'FRAGCOUNT': '11.000'} [2023-02-24 18:10:57,353][177157] DAMAGECOUNT value on done: 60158.0 [2023-02-24 18:10:57,353][177157] Sum rewards: 15.339, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.841', 'AMMO5': '0.014', 'AMMO2': '0.033', 'WEAPON1': '0.050', 'AMMO3': '0.106', 'AMMO4': '0.164', 'weapon5': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.453', 'weapon4': '0.458', 'weapon2': '0.506', 'WEAPON3': '0.750', 'HITCOUNT': '1.090', 'weapon3': '2.150', 'DAMAGECOUNT': '4.680', 'FRAGCOUNT': '14.000'} [2023-02-24 18:10:57,602][177171] DAMAGECOUNT value on done: 62221.0 [2023-02-24 18:10:57,603][177171] Sum rewards: 4.015, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.203', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'WEAPON1': '0.050', 'AMMO3': '0.096', 'weapon7': '0.156', 'weapon5': '0.178', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'weapon4': '0.396', 'WEAPON7': '0.400', 'ARMOR': '0.455', 'HITCOUNT': '0.490', 'WEAPON3': '0.700', 'weapon2': '0.730', 'weapon3': '1.766', 'DAMAGECOUNT': '2.370', 'FRAGCOUNT': '4.000'} [2023-02-24 18:10:57,848][177155] DAMAGECOUNT value on done: 64028.0 [2023-02-24 18:10:57,849][177155] Sum rewards: 13.799, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.530', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon7': '0.046', 'WEAPON1': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.106', 'AMMO3': '0.130', 'AMMO4': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'ARMOR': '0.468', 'weapon4': '0.504', 'weapon2': '0.748', 'WEAPON3': '0.850', 'HITCOUNT': '0.920', 'weapon3': '1.732', 'DAMAGECOUNT': '4.341', 'FRAGCOUNT': '11.000'} [2023-02-24 18:10:57,902][177171] DAMAGECOUNT value on done: 62016.0 [2023-02-24 18:10:57,903][177171] Sum rewards: 11.290, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.425', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.013', 'WEAPON1': '0.050', 'AMMO3': '0.086', 'weapon5': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'weapon3': '1.594', 'weapon2': '1.936', 'DAMAGECOUNT': '2.550', 'FRAGCOUNT': '9.000'} [2023-02-24 18:10:58,151][177155] DAMAGECOUNT value on done: 65196.0 [2023-02-24 18:10:58,152][177155] Sum rewards: 1.863, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.910', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO3': '0.030', 'WEAPON1': '0.040', 'weapon7': '0.074', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.150', 'HITCOUNT': '0.170', 'weapon5': '0.192', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.621', 'weapon3': '0.756', 'FRAGCOUNT': '1.000', 'weapon2': '1.604'} [2023-02-24 18:10:58,190][177171] DAMAGECOUNT value on done: 61582.0 [2023-02-24 18:10:58,190][177171] Sum rewards: 8.360, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.880', 'AMMO5': '0.014', 'AMMO2': '0.042', 'WEAPON1': '0.070', 'AMMO3': '0.106', 'WEAPON4': '0.200', 'AMMO4': '0.211', 'WEAPON5': '0.400', 'weapon5': '0.400', 'weapon4': '0.588', 'weapon2': '0.616', 'WEAPON3': '0.650', 'HITCOUNT': '0.790', 'weapon3': '1.682', 'DAMAGECOUNT': '2.970', 'FRAGCOUNT': '8.000'} [2023-02-24 18:10:58,516][177155] DAMAGECOUNT value on done: 66638.0 [2023-02-24 18:10:58,516][177155] Sum rewards: 2.702, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.515', 'AMMO2': '0.011', 'AMMO5': '0.015', 'AMMO4': '0.053', 'WEAPON1': '0.060', 'AMMO3': '0.116', 'weapon5': '0.236', 'WEAPON5': '0.300', 'HITCOUNT': '0.380', 'WEAPON3': '0.750', 'weapon2': '1.392', 'DAMAGECOUNT': '1.410', 'weapon3': '1.994', 'FRAGCOUNT': '5.000'} [2023-02-24 18:10:58,814][177155] DAMAGECOUNT value on done: 59451.0 [2023-02-24 18:10:58,814][177155] Sum rewards: 3.898, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.724', 'AMMO2': '0.014', 'AMMO5': '0.015', 'ARMOR': '0.032', 'weapon7': '0.036', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.070', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.147', 'weapon5': '0.166', 'weapon4': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.510', 'weapon2': '0.532', 'WEAPON3': '0.900', 'weapon3': '2.244', 'DAMAGECOUNT': '2.805', 'FRAGCOUNT': '6.000'} [2023-02-24 18:10:59,449][177153] Updated weights for policy 0, policy_version 9850 (0.0008) [2023-02-24 18:11:01,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 14023.6). Total num frames: 40370176. Throughput: 0: 3500.9. Samples: 10093946. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:11:01,376][177119] Avg episode reward: [(0, '7.077')] [2023-02-24 18:11:01,376][177140] Saving new best policy, reward=7.077! [2023-02-24 18:11:02,364][177153] Updated weights for policy 0, policy_version 9860 (0.0009) [2023-02-24 18:11:03,828][177156] DAMAGECOUNT value on done: 63731.0 [2023-02-24 18:11:03,829][177156] Sum rewards: 6.916, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.255', 'ARMOR': '0.008', 'AMMO5': '0.018', 'weapon7': '0.034', 'AMMO2': '0.042', 'WEAPON1': '0.080', 'AMMO3': '0.095', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.208', 'WEAPON4': '0.300', 'weapon5': '0.318', 'weapon4': '0.394', 'WEAPON5': '0.500', 'HITCOUNT': '0.710', 'weapon2': '0.788', 'WEAPON3': '0.800', 'weapon3': '1.894', 'DAMAGECOUNT': '3.132', 'FRAGCOUNT': '6.500'} [2023-02-24 18:11:03,840][177156] DAMAGECOUNT value on done: 61306.0 [2023-02-24 18:11:03,841][177156] Sum rewards: 1.814, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.030', 'AMMO5': '0.018', 'ARMOR': '0.020', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'weapon7': '0.090', 'weapon5': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.128', 'AMMO3': '0.141', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'HITCOUNT': '0.570', 'weapon2': '0.712', 'WEAPON3': '0.800', 'weapon4': '0.800', 'weapon3': '1.574', 'DAMAGECOUNT': '3.042', 'FRAGCOUNT': '8.000'} [2023-02-24 18:11:04,142][177156] DAMAGECOUNT value on done: 66039.0 [2023-02-24 18:11:04,143][177156] Sum rewards: 4.053, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.832', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.047', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO3': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.237', 'weapon5': '0.270', 'weapon4': '0.372', 'WEAPON4': '0.400', 'WEAPON3': '0.550', 'WEAPON5': '0.600', 'HITCOUNT': '0.680', 'weapon3': '1.380', 'weapon2': '1.592', 'DAMAGECOUNT': '2.496', 'FRAGCOUNT': '7.000'} [2023-02-24 18:11:04,154][177156] DAMAGECOUNT value on done: 64137.0 [2023-02-24 18:11:04,155][177156] Sum rewards: 10.347, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.074', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.023', 'WEAPON1': '0.050', 'weapon4': '0.082', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'AMMO4': '0.117', 'weapon5': '0.218', 'WEAPON5': '0.250', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.620', 'weapon7': '0.802', 'weapon2': '1.136', 'weapon3': '1.494', 'DAMAGECOUNT': '3.024', 'FRAGCOUNT': '7.000'} [2023-02-24 18:11:04,333][177170] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-24 18:11:05,298][177153] Updated weights for policy 0, policy_version 9870 (0.0008) [2023-02-24 18:11:06,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 14023.6). Total num frames: 40439808. Throughput: 0: 3501.3. Samples: 10104396. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:11:06,376][177119] Avg episode reward: [(0, '6.934')] [2023-02-24 18:11:08,237][177153] Updated weights for policy 0, policy_version 9880 (0.0008) [2023-02-24 18:11:11,147][177153] Updated weights for policy 0, policy_version 9890 (0.0008) [2023-02-24 18:11:11,237][177170] DAMAGECOUNT value on done: 63551.0 [2023-02-24 18:11:11,238][177170] Sum rewards: 6.784, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.272', 'AMMO5': '0.015', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'weapon7': '0.074', 'AMMO3': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.102', 'weapon4': '0.212', 'HITCOUNT': '0.290', 'WEAPON5': '0.350', 'weapon5': '0.396', 'WEAPON3': '0.500', 'weapon2': '1.144', 'weapon3': '1.660', 'DAMAGECOUNT': '1.794', 'FRAGCOUNT': '6.000'} [2023-02-24 18:11:11,376][177119] Fps is (10 sec: 13926.2, 60 sec: 13926.4, 300 sec: 14023.6). Total num frames: 40509440. Throughput: 0: 3500.4. Samples: 10125456. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:11:11,376][177119] Avg episode reward: [(0, '6.914')] [2023-02-24 18:11:11,538][177170] DAMAGECOUNT value on done: 67938.0 [2023-02-24 18:11:11,539][177170] Sum rewards: 7.920, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.618', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'ARMOR': '0.012', 'AMMO5': '0.017', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'weapon7': '0.102', 'AMMO3': '0.127', 'weapon5': '0.172', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.230', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'HITCOUNT': '0.830', 'WEAPON3': '0.850', 'weapon2': '1.064', 'weapon3': '1.806', 'DAMAGECOUNT': '4.209', 'FRAGCOUNT': '8.000'} [2023-02-24 18:11:11,553][177170] DAMAGECOUNT value on done: 56395.0 [2023-02-24 18:11:11,553][177170] Sum rewards: 1.476, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.187', 'AMMO2': '0.007', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.035', 'AMMO3': '0.054', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'weapon5': '0.132', 'weapon7': '0.174', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.214', 'WEAPON3': '0.300', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.387', 'FRAGCOUNT': '1.000', 'weapon3': '1.104', 'weapon2': '1.540'} [2023-02-24 18:11:11,851][177170] DAMAGECOUNT value on done: 67334.0 [2023-02-24 18:11:11,852][177170] Sum rewards: 8.510, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.436', 'ARMOR': '0.009', 'AMMO5': '0.013', 'AMMO2': '0.021', 'WEAPON1': '0.050', 'weapon7': '0.062', 'AMMO3': '0.090', 'AMMO4': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.294', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.680', 'weapon2': '1.202', 'weapon3': '1.884', 'DAMAGECOUNT': '2.244', 'FRAGCOUNT': '8.000'} [2023-02-24 18:11:12,368][177158] DAMAGECOUNT value on done: 60709.0 [2023-02-24 18:11:12,368][177158] Sum rewards: 1.048, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.550', 'AMMO5': '0.012', 'AMMO2': '0.027', 'WEAPON1': '0.040', 'weapon5': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'weapon7': '0.134', 'AMMO4': '0.135', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.340', 'HITCOUNT': '0.390', 'ARMOR': '0.507', 'weapon2': '0.558', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.089', 'weapon3': '1.904', 'FRAGCOUNT': '2.000'} [2023-02-24 18:11:12,670][177158] DAMAGECOUNT value on done: 61221.0 [2023-02-24 18:11:12,671][177158] Sum rewards: 7.082, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.332', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.075', 'weapon7': '0.102', 'weapon5': '0.114', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'weapon4': '0.324', 'HITCOUNT': '0.350', 'WEAPON3': '0.550', 'weapon3': '1.466', 'weapon2': '1.564', 'DAMAGECOUNT': '1.947', 'FRAGCOUNT': '5.000'} [2023-02-24 18:11:13,646][177158] DAMAGECOUNT value on done: 61345.0 [2023-02-24 18:11:13,646][177158] Sum rewards: 5.390, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.172', 'AMMO5': '0.025', 'AMMO2': '0.025', 'WEAPON1': '0.070', 'AMMO4': '0.125', 'AMMO3': '0.128', 'weapon5': '0.366', 'WEAPON4': '0.400', 'ARMOR': '0.412', 'WEAPON5': '0.600', 'weapon4': '0.648', 'weapon2': '0.720', 'WEAPON3': '0.800', 'HITCOUNT': '0.830', 'weapon3': '1.632', 'DAMAGECOUNT': '3.780', 'FRAGCOUNT': '8.000'} [2023-02-24 18:11:13,940][177158] DAMAGECOUNT value on done: 65548.0 [2023-02-24 18:11:13,940][177158] Sum rewards: 7.381, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.553', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO3': '0.040', 'WEAPON1': '0.040', 'AMMO4': '0.055', 'weapon7': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.168', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'HITCOUNT': '0.380', 'ARMOR': '0.408', 'weapon4': '0.422', 'weapon3': '1.024', 'weapon2': '1.272', 'DAMAGECOUNT': '1.578', 'FRAGCOUNT': '5.000'} [2023-02-24 18:11:14,078][177153] Updated weights for policy 0, policy_version 9900 (0.0008) [2023-02-24 18:11:14,265][177172] DAMAGECOUNT value on done: 62154.0 [2023-02-24 18:11:14,265][177172] Sum rewards: 4.257, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.075', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon7': '0.048', 'WEAPON1': '0.060', 'weapon5': '0.088', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.114', 'AMMO4': '0.120', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.734', 'WEAPON3': '0.750', 'weapon2': '0.750', 'HITCOUNT': '0.800', 'weapon3': '1.898', 'DAMAGECOUNT': '2.733', 'FRAGCOUNT': '6.000'} [2023-02-24 18:11:14,564][177172] DAMAGECOUNT value on done: 61490.0 [2023-02-24 18:11:14,565][177172] Sum rewards: 7.117, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.937', 'AMMO2': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.041', 'AMMO3': '0.069', 'WEAPON5': '0.100', 'weapon5': '0.142', 'WEAPON4': '0.150', 'weapon7': '0.156', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.384', 'HITCOUNT': '0.430', 'WEAPON3': '0.500', 'weapon3': '1.176', 'weapon2': '1.186', 'DAMAGECOUNT': '2.202', 'FRAGCOUNT': '6.000'} [2023-02-24 18:11:15,043][177154] DAMAGECOUNT value on done: 66458.0 [2023-02-24 18:11:15,044][177154] Sum rewards: 3.884, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.002', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO2': '0.043', 'weapon5': '0.094', 'AMMO3': '0.097', 'weapon7': '0.110', 'AMMO4': '0.215', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.440', 'weapon4': '0.450', 'HITCOUNT': '0.560', 'WEAPON3': '0.600', 'weapon3': '1.472', 'DAMAGECOUNT': '2.310', 'FRAGCOUNT': '6.000'} [2023-02-24 18:11:15,336][177154] DAMAGECOUNT value on done: 64302.0 [2023-02-24 18:11:15,337][177154] Sum rewards: 9.636, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.982', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.024', 'weapon7': '0.072', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon5': '0.280', 'weapon4': '0.428', 'ARMOR': '0.458', 'HITCOUNT': '0.650', 'weapon2': '0.682', 'WEAPON3': '0.700', 'weapon3': '1.494', 'DAMAGECOUNT': '4.020', 'FRAGCOUNT': '9.000'} [2023-02-24 18:11:15,346][177154] DAMAGECOUNT value on done: 63589.0 [2023-02-24 18:11:15,346][177154] Sum rewards: 7.353, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.017', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'ARMOR': '0.052', 'AMMO3': '0.075', 'weapon5': '0.116', 'AMMO4': '0.136', 'WEAPON5': '0.200', 'weapon7': '0.316', 'HITCOUNT': '0.340', 'WEAPON4': '0.400', 'WEAPON3': '0.400', 'AMMO6': '0.460', 'AMMO7': '0.460', 'weapon3': '0.530', 'WEAPON7': '0.700', 'weapon4': '0.752', 'weapon2': '1.012', 'DAMAGECOUNT': '2.364', 'FRAGCOUNT': '6.000'} [2023-02-24 18:11:15,470][177172] DAMAGECOUNT value on done: 60227.0 [2023-02-24 18:11:15,470][177172] Sum rewards: 0.918, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.784', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.094', 'AMMO3': '0.109', 'weapon7': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.334', 'HITCOUNT': '0.340', 'WEAPON3': '0.650', 'weapon2': '0.696', 'ARMOR': '0.800', 'DAMAGECOUNT': '1.353', 'weapon3': '1.408', 'FRAGCOUNT': '4.000'} [2023-02-24 18:11:15,644][177154] DAMAGECOUNT value on done: 63445.0 [2023-02-24 18:11:15,645][177154] Sum rewards: 5.693, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.398', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'weapon7': '0.048', 'AMMO3': '0.065', 'AMMO4': '0.081', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon5': '0.218', 'weapon4': '0.308', 'WEAPON3': '0.400', 'HITCOUNT': '0.540', 'weapon3': '1.348', 'weapon2': '1.536', 'DAMAGECOUNT': '2.607', 'FRAGCOUNT': '5.000'} [2023-02-24 18:11:15,771][177172] DAMAGECOUNT value on done: 61736.0 [2023-02-24 18:11:15,771][177172] Sum rewards: 3.550, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.470', 'AMMO5': '0.012', 'AMMO2': '0.032', 'WEAPON1': '0.070', 'weapon7': '0.084', 'AMMO3': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.128', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'weapon4': '0.342', 'WEAPON5': '0.350', 'HITCOUNT': '0.400', 'WEAPON3': '0.550', 'weapon2': '0.622', 'weapon3': '1.068', 'DAMAGECOUNT': '1.617', 'FRAGCOUNT': '4.000'} [2023-02-24 18:11:16,226][177157] DAMAGECOUNT value on done: 67656.0 [2023-02-24 18:11:16,226][177157] Sum rewards: 3.482, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.580', 'AMMO2': '0.002', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.012', 'WEAPON5': '0.050', 'weapon7': '0.076', 'AMMO3': '0.083', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.262', 'HITCOUNT': '0.290', 'WEAPON3': '0.550', 'weapon3': '1.060', 'weapon2': '1.106', 'DAMAGECOUNT': '1.218', 'FRAGCOUNT': '4.000'} [2023-02-24 18:11:16,237][177157] DAMAGECOUNT value on done: 63273.0 [2023-02-24 18:11:16,237][177157] Sum rewards: 2.077, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.068', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.050', 'AMMO3': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.132', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.390', 'WEAPON3': '0.700', 'weapon2': '1.068', 'DAMAGECOUNT': '1.383', 'weapon3': '1.440', 'FRAGCOUNT': '4.000'} [2023-02-24 18:11:16,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 14023.6). Total num frames: 40579072. Throughput: 0: 3501.3. Samples: 10146502. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:11:16,376][177119] Avg episode reward: [(0, '6.646')] [2023-02-24 18:11:16,441][177171] DAMAGECOUNT value on done: 64626.0 [2023-02-24 18:11:16,442][177171] Sum rewards: 4.149, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.210', 'AMMO2': '0.002', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO4': '0.011', 'WEAPON1': '0.020', 'AMMO3': '0.063', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon7': '0.116', 'weapon4': '0.210', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'HITCOUNT': '0.470', 'WEAPON3': '0.500', 'weapon2': '1.146', 'weapon3': '1.228', 'DAMAGECOUNT': '1.674', 'FRAGCOUNT': '4.000'} [2023-02-24 18:11:16,536][177157] DAMAGECOUNT value on done: 63200.0 [2023-02-24 18:11:16,536][177157] Sum rewards: 0.498, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.530', 'AMMO2': '0.018', 'AMMO5': '0.018', 'WEAPON1': '0.070', 'AMMO4': '0.090', 'AMMO3': '0.105', 'WEAPON4': '0.150', 'weapon4': '0.212', 'weapon5': '0.216', 'HITCOUNT': '0.300', 'WEAPON5': '0.400', 'ARMOR': '0.462', 'WEAPON3': '0.750', 'weapon2': '0.940', 'DAMAGECOUNT': '1.380', 'weapon3': '1.916', 'FRAGCOUNT': '2.500'} [2023-02-24 18:11:16,546][177157] DAMAGECOUNT value on done: 61136.0 [2023-02-24 18:11:16,547][177157] Sum rewards: 4.947, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.842', 'AMMO2': '0.015', 'ARMOR': '0.017', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'AMMO4': '0.076', 'weapon5': '0.076', 'AMMO3': '0.139', 'WEAPON4': '0.150', 'weapon4': '0.220', 'WEAPON5': '0.400', 'HITCOUNT': '0.630', 'WEAPON3': '0.950', 'weapon2': '1.674', 'weapon3': '1.700', 'DAMAGECOUNT': '2.934', 'FRAGCOUNT': '9.000'} [2023-02-24 18:11:16,735][177171] DAMAGECOUNT value on done: 62805.0 [2023-02-24 18:11:16,735][177171] Sum rewards: 0.629, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.805', 'AMMO5': '0.013', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'weapon7': '0.054', 'AMMO4': '0.078', 'AMMO3': '0.090', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.394', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'weapon2': '0.824', 'DAMAGECOUNT': '1.752', 'weapon3': '1.908', 'FRAGCOUNT': '3.000'} [2023-02-24 18:11:16,985][177153] Updated weights for policy 0, policy_version 9910 (0.0009) [2023-02-24 18:11:17,072][177171] DAMAGECOUNT value on done: 62968.0 [2023-02-24 18:11:17,073][177171] Sum rewards: 9.342, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.434', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.028', 'WEAPON1': '0.060', 'AMMO3': '0.070', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'weapon7': '0.118', 'weapon5': '0.172', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.488', 'WEAPON3': '0.550', 'HITCOUNT': '0.640', 'weapon2': '1.498', 'weapon3': '1.730', 'DAMAGECOUNT': '2.856', 'FRAGCOUNT': '7.500'} [2023-02-24 18:11:17,105][177155] DAMAGECOUNT value on done: 64787.0 [2023-02-24 18:11:17,106][177155] Sum rewards: 6.852, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.894', 'AMMO5': '0.010', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'AMMO3': '0.078', 'AMMO4': '0.131', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.440', 'WEAPON3': '0.600', 'HITCOUNT': '0.680', 'weapon2': '1.326', 'weapon3': '1.562', 'DAMAGECOUNT': '2.277', 'FRAGCOUNT': '6.000'} [2023-02-24 18:11:17,367][177171] DAMAGECOUNT value on done: 62363.0 [2023-02-24 18:11:17,367][177171] Sum rewards: 8.836, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.852', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO3': '0.077', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'AMMO4': '0.118', 'weapon4': '0.204', 'weapon5': '0.232', 'WEAPON5': '0.400', 'ARMOR': '0.455', 'WEAPON3': '0.550', 'HITCOUNT': '0.630', 'weapon3': '1.492', 'weapon2': '1.718', 'DAMAGECOUNT': '2.343', 'FRAGCOUNT': '8.000'} [2023-02-24 18:11:17,408][177155] DAMAGECOUNT value on done: 66181.0 [2023-02-24 18:11:17,409][177155] Sum rewards: 5.760, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.805', 'AMMO5': '0.014', 'AMMO2': '0.032', 'WEAPON1': '0.040', 'weapon5': '0.102', 'AMMO3': '0.146', 'AMMO4': '0.161', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.516', 'HITCOUNT': '0.670', 'WEAPON3': '0.950', 'weapon2': '1.232', 'weapon3': '1.846', 'DAMAGECOUNT': '2.955', 'FRAGCOUNT': '7.500'} [2023-02-24 18:11:17,740][177155] DAMAGECOUNT value on done: 67205.0 [2023-02-24 18:11:17,741][177155] Sum rewards: 7.750, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.424', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.018', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'weapon5': '0.092', 'WEAPON5': '0.100', 'weapon7': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.370', 'weapon4': '0.392', 'ARMOR': '0.424', 'weapon3': '1.028', 'weapon2': '1.366', 'DAMAGECOUNT': '1.701', 'FRAGCOUNT': '6.000'} [2023-02-24 18:11:18,035][177155] DAMAGECOUNT value on done: 60487.0 [2023-02-24 18:11:18,036][177155] Sum rewards: 3.987, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-3.195', 'AMMO2': '0.014', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.067', 'AMMO3': '0.118', 'WEAPON4': '0.250', 'weapon5': '0.282', 'weapon4': '0.408', 'WEAPON5': '0.450', 'HITCOUNT': '0.590', 'weapon2': '0.886', 'WEAPON3': '1.000', 'weapon3': '1.974', 'DAMAGECOUNT': '3.108', 'FRAGCOUNT': '7.000'} [2023-02-24 18:11:19,914][177153] Updated weights for policy 0, policy_version 9920 (0.0008) [2023-02-24 18:11:21,376][177119] Fps is (10 sec: 14336.1, 60 sec: 13994.7, 300 sec: 14037.5). Total num frames: 40652800. Throughput: 0: 3500.4. Samples: 10156980. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:11:21,376][177119] Avg episode reward: [(0, '6.626')] [2023-02-24 18:11:22,839][177153] Updated weights for policy 0, policy_version 9930 (0.0008) [2023-02-24 18:11:22,923][177156] DAMAGECOUNT value on done: 64576.0 [2023-02-24 18:11:22,923][177156] Sum rewards: 7.634, reward structure: {'DEATHCOUNT': '-6.000', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.046', 'AMMO3': '0.070', 'WEAPON1': '0.080', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon7': '0.134', 'WEAPON4': '0.150', 'AMMO4': '0.230', 'HEALTH': '0.378', 'WEAPON5': '0.400', 'weapon4': '0.440', 'WEAPON3': '0.450', 'weapon5': '0.460', 'HITCOUNT': '0.510', 'weapon2': '0.754', 'weapon3': '1.672', 'DAMAGECOUNT': '2.535', 'FRAGCOUNT': '5.000'} [2023-02-24 18:11:22,934][177156] DAMAGECOUNT value on done: 61860.0 [2023-02-24 18:11:22,934][177156] Sum rewards: 3.054, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.874', 'ARMOR': '0.008', 'AMMO2': '0.027', 'AMMO5': '0.027', 'WEAPON1': '0.060', 'AMMO3': '0.132', 'AMMO4': '0.134', 'WEAPON4': '0.200', 'weapon5': '0.226', 'weapon4': '0.326', 'HITCOUNT': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'weapon2': '1.028', 'DAMAGECOUNT': '1.662', 'weapon3': '1.798', 'FRAGCOUNT': '4.000'} [2023-02-24 18:11:23,228][177156] DAMAGECOUNT value on done: 67108.0 [2023-02-24 18:11:23,228][177156] Sum rewards: 9.096, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.304', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'AMMO4': '0.067', 'weapon5': '0.170', 'weapon7': '0.210', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.256', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.650', 'weapon3': '0.756', 'weapon2': '1.636', 'DAMAGECOUNT': '3.207', 'FRAGCOUNT': '7.000'} [2023-02-24 18:11:23,239][177156] DAMAGECOUNT value on done: 64858.0 [2023-02-24 18:11:23,239][177156] Sum rewards: 4.264, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.855', 'AMMO2': '0.005', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO4': '0.026', 'WEAPON1': '0.060', 'weapon7': '0.062', 'weapon5': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.176', 'AMMO6': '0.260', 'AMMO7': '0.260', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'HITCOUNT': '0.560', 'WEAPON3': '0.800', 'weapon2': '1.458', 'weapon3': '1.864', 'DAMAGECOUNT': '2.163', 'FRAGCOUNT': '5.000'} [2023-02-24 18:11:23,702][177171] Large shaping reward 2.575 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.543, 181.0), ('weapon7', 0.002)] [2023-02-24 18:11:25,736][177153] Updated weights for policy 0, policy_version 9940 (0.0008) [2023-02-24 18:11:26,376][177119] Fps is (10 sec: 14336.1, 60 sec: 13994.7, 300 sec: 14037.5). Total num frames: 40722432. Throughput: 0: 3503.3. Samples: 10178130. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:11:26,376][177119] Avg episode reward: [(0, '6.607')] [2023-02-24 18:11:28,642][177153] Updated weights for policy 0, policy_version 9950 (0.0008) [2023-02-24 18:11:30,368][177170] DAMAGECOUNT value on done: 64095.0 [2023-02-24 18:11:30,369][177170] Sum rewards: 2.083, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.479', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.020', 'weapon7': '0.060', 'AMMO3': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.222', 'HITCOUNT': '0.250', 'weapon4': '0.304', 'WEAPON3': '0.450', 'weapon2': '0.706', 'weapon3': '1.372', 'DAMAGECOUNT': '1.632', 'FRAGCOUNT': '2.000'} [2023-02-24 18:11:30,660][177170] DAMAGECOUNT value on done: 69234.0 [2023-02-24 18:11:30,661][177170] Sum rewards: 11.488, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.369', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.030', 'WEAPON1': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.119', 'AMMO4': '0.149', 'weapon5': '0.196', 'WEAPON4': '0.250', 'weapon4': '0.332', 'WEAPON5': '0.350', 'HITCOUNT': '0.770', 'WEAPON3': '0.850', 'weapon2': '0.934', 'weapon3': '2.122', 'DAMAGECOUNT': '3.888', 'FRAGCOUNT': '10.000'} [2023-02-24 18:11:30,675][177170] DAMAGECOUNT value on done: 57174.0 [2023-02-24 18:11:30,675][177170] Sum rewards: 7.120, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.845', 'AMMO5': '0.015', 'AMMO2': '0.028', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.095', 'AMMO4': '0.141', 'weapon4': '0.236', 'weapon5': '0.276', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.650', 'weapon2': '0.936', 'weapon3': '2.040', 'DAMAGECOUNT': '2.337', 'FRAGCOUNT': '6.000'} [2023-02-24 18:11:30,986][177170] DAMAGECOUNT value on done: 68140.0 [2023-02-24 18:11:30,986][177170] Sum rewards: 5.027, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.515', 'AMMO2': '0.005', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.026', 'weapon5': '0.062', 'AMMO3': '0.078', 'weapon4': '0.090', 'WEAPON4': '0.100', 'weapon7': '0.172', 'WEAPON5': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'HITCOUNT': '0.390', 'WEAPON7': '0.400', 'WEAPON3': '0.600', 'weapon2': '1.234', 'weapon3': '1.544', 'DAMAGECOUNT': '2.118', 'FRAGCOUNT': '4.000'} [2023-02-24 18:11:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14037.5). Total num frames: 40792064. Throughput: 0: 3507.1. Samples: 10199168. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:11:31,376][177119] Avg episode reward: [(0, '6.654')] [2023-02-24 18:11:31,492][177158] DAMAGECOUNT value on done: 61769.0 [2023-02-24 18:11:31,493][177158] Sum rewards: 5.059, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.073', 'AMMO5': '0.010', 'AMMO2': '0.010', 'weapon4': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.121', 'weapon7': '0.128', 'weapon5': '0.192', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.750', 'HITCOUNT': '0.760', 'weapon2': '0.846', 'weapon3': '1.994', 'DAMAGECOUNT': '3.180', 'FRAGCOUNT': '5.500'} [2023-02-24 18:11:31,554][177153] Updated weights for policy 0, policy_version 9960 (0.0008) [2023-02-24 18:11:31,785][177158] DAMAGECOUNT value on done: 62776.0 [2023-02-24 18:11:31,786][177158] Sum rewards: 12.617, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.465', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon7': '0.064', 'AMMO4': '0.078', 'AMMO3': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.416', 'WEAPON3': '0.600', 'HITCOUNT': '0.650', 'weapon2': '0.962', 'weapon3': '1.554', 'DAMAGECOUNT': '3.465', 'FRAGCOUNT': '11.000'} [2023-02-24 18:11:32,733][177158] DAMAGECOUNT value on done: 62160.0 [2023-02-24 18:11:32,733][177158] Sum rewards: 5.876, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.976', 'AMMO2': '0.013', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.065', 'AMMO3': '0.070', 'weapon7': '0.094', 'WEAPON4': '0.150', 'weapon5': '0.184', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'weapon4': '0.424', 'HITCOUNT': '0.490', 'WEAPON3': '0.500', 'weapon2': '1.370', 'weapon3': '1.432', 'DAMAGECOUNT': '2.445', 'FRAGCOUNT': '6.000'} [2023-02-24 18:11:33,030][177158] DAMAGECOUNT value on done: 65994.0 [2023-02-24 18:11:33,031][177158] Sum rewards: -1.732, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.200', 'weapon7': '0.010', 'AMMO5': '0.022', 'WEAPON1': '0.040', 'AMMO2': '0.044', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.110', 'AMMO4': '0.221', 'weapon4': '0.258', 'weapon5': '0.348', 'HITCOUNT': '0.390', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'WEAPON3': '0.750', 'weapon2': '1.216', 'DAMAGECOUNT': '1.338', 'weapon3': '1.770', 'FRAGCOUNT': '2.500'} [2023-02-24 18:11:33,431][177172] DAMAGECOUNT value on done: 62768.0 [2023-02-24 18:11:33,432][177172] Sum rewards: 1.937, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.670', 'AMMO5': '0.010', 'AMMO2': '0.029', 'WEAPON1': '0.050', 'AMMO3': '0.091', 'AMMO4': '0.147', 'WEAPON4': '0.250', 'weapon5': '0.260', 'weapon4': '0.296', 'WEAPON5': '0.300', 'HITCOUNT': '0.500', 'WEAPON3': '0.650', 'weapon2': '1.016', 'DAMAGECOUNT': '1.842', 'weapon3': '1.916', 'FRAGCOUNT': '6.000'} [2023-02-24 18:11:33,723][177172] DAMAGECOUNT value on done: 62343.0 [2023-02-24 18:11:33,724][177172] Sum rewards: 3.855, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.390', 'AMMO2': '0.006', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'weapon7': '0.048', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.152', 'AMMO3': '0.153', 'weapon4': '0.160', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'HITCOUNT': '0.530', 'WEAPON3': '0.700', 'weapon3': '0.972', 'weapon2': '1.414', 'DAMAGECOUNT': '2.559', 'FRAGCOUNT': '6.000'} [2023-02-24 18:11:34,186][177154] DAMAGECOUNT value on done: 67154.0 [2023-02-24 18:11:34,186][177154] Sum rewards: 2.930, reward structure: {'DEATHCOUNT': '-9.000', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'AMMO3': '0.097', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'HEALTH': '0.204', 'weapon5': '0.342', 'WEAPON5': '0.350', 'weapon4': '0.386', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'weapon3': '1.414', 'weapon2': '1.440', 'DAMAGECOUNT': '2.088', 'FRAGCOUNT': '4.000'} [2023-02-24 18:11:34,478][177153] Updated weights for policy 0, policy_version 9970 (0.0008) [2023-02-24 18:11:34,479][177154] DAMAGECOUNT value on done: 64812.0 [2023-02-24 18:11:34,480][177154] Sum rewards: -3.350, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.900', 'AMMO2': '0.010', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.050', 'weapon4': '0.064', 'WEAPON4': '0.100', 'weapon7': '0.134', 'weapon5': '0.152', 'AMMO3': '0.155', 'WEAPON5': '0.350', 'HITCOUNT': '0.400', 'AMMO6': '0.480', 'AMMO7': '0.480', 'WEAPON7': '0.600', 'weapon2': '0.718', 'WEAPON3': '1.100', 'DAMAGECOUNT': '1.530', 'FRAGCOUNT': '2.000', 'weapon3': '2.430'} [2023-02-24 18:11:34,488][177154] DAMAGECOUNT value on done: 64274.0 [2023-02-24 18:11:34,489][177154] Sum rewards: 4.906, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.708', 'AMMO2': '0.020', 'AMMO5': '0.020', 'ARMOR': '0.020', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon7': '0.078', 'AMMO4': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.120', 'weapon4': '0.162', 'weapon5': '0.176', 'WEAPON5': '0.400', 'HITCOUNT': '0.490', 'WEAPON3': '0.800', 'weapon2': '1.274', 'weapon3': '2.020', 'DAMAGECOUNT': '2.055', 'FRAGCOUNT': '5.000'} [2023-02-24 18:11:34,570][177172] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:11:34,612][177172] DAMAGECOUNT value on done: 61518.0 [2023-02-24 18:11:34,612][177172] Sum rewards: 7.402, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.816', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.030', 'AMMO3': '0.109', 'weapon7': '0.120', 'weapon5': '0.136', 'WEAPON5': '0.150', 'AMMO4': '0.150', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'ARMOR': '0.408', 'WEAPON3': '0.650', 'weapon4': '0.658', 'HITCOUNT': '0.720', 'weapon2': '1.048', 'weapon3': '1.470', 'DAMAGECOUNT': '3.741', 'FRAGCOUNT': '8.000'} [2023-02-24 18:11:34,780][177154] DAMAGECOUNT value on done: 63785.0 [2023-02-24 18:11:34,781][177154] Sum rewards: -1.851, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.560', 'ARMOR': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.040', 'AMMO3': '0.074', 'weapon5': '0.136', 'HITCOUNT': '0.150', 'weapon7': '0.168', 'AMMO4': '0.202', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'WEAPON7': '0.500', 'WEAPON4': '0.500', 'weapon3': '0.694', 'weapon4': '0.772', 'weapon2': '0.926', 'DAMAGECOUNT': '1.020', 'FRAGCOUNT': '2.000'} [2023-02-24 18:11:34,915][177172] DAMAGECOUNT value on done: 62411.0 [2023-02-24 18:11:34,916][177172] Sum rewards: 3.813, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.210', 'AMMO2': '0.000', 'AMMO4': '0.002', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon7': '0.020', 'AMMO3': '0.098', 'weapon5': '0.100', 'WEAPON4': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.248', 'WEAPON5': '0.250', 'HITCOUNT': '0.520', 'WEAPON3': '0.700', 'weapon2': '1.052', 'weapon3': '1.804', 'DAMAGECOUNT': '2.025', 'FRAGCOUNT': '5.000'} [2023-02-24 18:11:35,353][177157] DAMAGECOUNT value on done: 68290.0 [2023-02-24 18:11:35,353][177157] Sum rewards: 4.123, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.978', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'weapon7': '0.048', 'AMMO3': '0.089', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.158', 'AMMO4': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'HITCOUNT': '0.510', 'weapon2': '0.576', 'WEAPON3': '0.600', 'weapon4': '0.678', 'ARMOR': '0.800', 'weapon3': '1.150', 'DAMAGECOUNT': '1.902', 'FRAGCOUNT': '5.000'} [2023-02-24 18:11:35,362][177157] DAMAGECOUNT value on done: 63788.0 [2023-02-24 18:11:35,363][177157] Sum rewards: 3.290, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.248', 'AMMO5': '0.012', 'ARMOR': '0.028', 'AMMO2': '0.033', 'WEAPON1': '0.040', 'AMMO3': '0.074', 'weapon7': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.108', 'AMMO4': '0.162', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'HITCOUNT': '0.340', 'WEAPON3': '0.550', 'weapon4': '0.562', 'weapon2': '1.050', 'weapon3': '1.296', 'DAMAGECOUNT': '1.545', 'FRAGCOUNT': '3.000'} [2023-02-24 18:11:35,560][177171] DAMAGECOUNT value on done: 65066.0 [2023-02-24 18:11:35,561][177171] Sum rewards: 2.974, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.754', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'AMMO2': '0.036', 'weapon7': '0.098', 'AMMO3': '0.110', 'weapon5': '0.152', 'AMMO4': '0.181', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.390', 'WEAPON5': '0.400', 'weapon4': '0.476', 'weapon2': '0.678', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.320', 'weapon3': '1.630', 'FRAGCOUNT': '4.000'} [2023-02-24 18:11:35,660][177157] DAMAGECOUNT value on done: 63735.0 [2023-02-24 18:11:35,661][177157] Sum rewards: 6.126, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.340', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.040', 'AMMO3': '0.082', 'weapon7': '0.132', 'weapon5': '0.148', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.201', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.460', 'WEAPON3': '0.500', 'weapon4': '0.540', 'weapon2': '1.072', 'weapon3': '1.502', 'DAMAGECOUNT': '1.605', 'FRAGCOUNT': '5.000'} [2023-02-24 18:11:35,672][177157] DAMAGECOUNT value on done: 62451.0 [2023-02-24 18:11:35,672][177157] Sum rewards: 17.476, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.138', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon7': '0.018', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.087', 'AMMO3': '0.115', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.216', 'weapon2': '0.472', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'HITCOUNT': '0.960', 'weapon3': '2.090', 'DAMAGECOUNT': '3.945', 'FRAGCOUNT': '14.000'} [2023-02-24 18:11:35,860][177171] DAMAGECOUNT value on done: 63765.0 [2023-02-24 18:11:35,860][177171] Sum rewards: 6.028, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.123', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'weapon5': '0.054', 'AMMO4': '0.089', 'AMMO3': '0.095', 'weapon7': '0.120', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.440', 'weapon2': '0.552', 'weapon4': '0.622', 'WEAPON3': '0.650', 'weapon3': '1.340', 'DAMAGECOUNT': '2.880', 'FRAGCOUNT': '8.000'} [2023-02-24 18:11:36,260][177171] DAMAGECOUNT value on done: 63736.0 [2023-02-24 18:11:36,261][177171] Sum rewards: 6.459, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.804', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.018', 'weapon4': '0.040', 'weapon5': '0.050', 'AMMO4': '0.092', 'weapon7': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.108', 'WEAPON5': '0.250', 'HITCOUNT': '0.490', 'WEAPON3': '0.700', 'weapon2': '1.642', 'weapon3': '1.800', 'DAMAGECOUNT': '2.304', 'FRAGCOUNT': '6.000'} [2023-02-24 18:11:36,317][177155] DAMAGECOUNT value on done: 65555.0 [2023-02-24 18:11:36,317][177155] Sum rewards: 6.287, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.934', 'AMMO2': '0.029', 'AMMO5': '0.031', 'WEAPON4': '0.050', 'weapon4': '0.088', 'WEAPON1': '0.090', 'AMMO3': '0.103', 'AMMO4': '0.147', 'weapon5': '0.428', 'HITCOUNT': '0.450', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'weapon2': '0.918', 'weapon3': '2.032', 'DAMAGECOUNT': '2.304', 'FRAGCOUNT': '6.000'} [2023-02-24 18:11:36,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 14037.5). Total num frames: 40861696. Throughput: 0: 3508.6. Samples: 10209744. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:11:36,376][177119] Avg episode reward: [(0, '6.253')] [2023-02-24 18:11:36,556][177171] DAMAGECOUNT value on done: 63367.0 [2023-02-24 18:11:36,557][177171] Sum rewards: 10.756, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.748', 'AMMO5': '0.017', 'AMMO2': '0.034', 'WEAPON1': '0.040', 'weapon7': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.114', 'AMMO4': '0.172', 'weapon5': '0.222', 'WEAPON5': '0.400', 'HITCOUNT': '0.520', 'WEAPON3': '0.750', 'weapon2': '1.292', 'weapon3': '2.072', 'DAMAGECOUNT': '3.012', 'FRAGCOUNT': '10.000'} [2023-02-24 18:11:36,614][177155] DAMAGECOUNT value on done: 67057.0 [2023-02-24 18:11:36,614][177155] Sum rewards: 8.816, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.291', 'ARMOR': '0.020', 'AMMO2': '0.026', 'AMMO5': '0.028', 'weapon7': '0.056', 'WEAPON1': '0.060', 'AMMO3': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.226', 'weapon4': '0.322', 'WEAPON5': '0.550', 'HITCOUNT': '0.620', 'WEAPON3': '0.750', 'weapon2': '0.782', 'weapon3': '2.156', 'DAMAGECOUNT': '2.628', 'FRAGCOUNT': '10.000'} [2023-02-24 18:11:36,944][177155] DAMAGECOUNT value on done: 67775.0 [2023-02-24 18:11:36,945][177155] Sum rewards: 5.884, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.012', 'ARMOR': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.050', 'AMMO4': '0.059', 'weapon7': '0.092', 'AMMO3': '0.114', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.470', 'weapon5': '0.524', 'WEAPON3': '0.600', 'HEALTH': '0.762', 'weapon2': '1.182', 'DAMAGECOUNT': '1.710', 'weapon3': '1.882', 'FRAGCOUNT': '5.000'} [2023-02-24 18:11:37,246][177155] DAMAGECOUNT value on done: 61296.0 [2023-02-24 18:11:37,246][177155] Sum rewards: 0.434, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.476', 'AMMO5': '0.015', 'ARMOR': '0.020', 'AMMO2': '0.043', 'WEAPON1': '0.050', 'weapon7': '0.064', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.141', 'WEAPON7': '0.200', 'weapon5': '0.214', 'AMMO4': '0.216', 'WEAPON5': '0.300', 'weapon4': '0.332', 'WEAPON4': '0.400', 'HITCOUNT': '0.600', 'weapon2': '0.712', 'WEAPON3': '0.950', 'weapon3': '2.236', 'DAMAGECOUNT': '2.427', 'FRAGCOUNT': '4.000'} [2023-02-24 18:11:37,416][177153] Updated weights for policy 0, policy_version 9980 (0.0008) [2023-02-24 18:11:40,322][177153] Updated weights for policy 0, policy_version 9990 (0.0008) [2023-02-24 18:11:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14037.5). Total num frames: 40931328. Throughput: 0: 3506.8. Samples: 10230710. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:11:41,376][177119] Avg episode reward: [(0, '6.228')] [2023-02-24 18:11:41,393][177154] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:11:42,070][177156] DAMAGECOUNT value on done: 65159.0 [2023-02-24 18:11:42,070][177156] Sum rewards: 3.587, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.290', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO3': '0.072', 'weapon7': '0.112', 'AMMO4': '0.114', 'weapon5': '0.166', 'HITCOUNT': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'AMMO6': '0.400', 'WEAPON7': '0.400', 'AMMO7': '0.400', 'weapon4': '0.438', 'WEAPON3': '0.450', 'ARMOR': '0.465', 'weapon2': '0.650', 'weapon3': '1.196', 'DAMAGECOUNT': '1.749', 'FRAGCOUNT': '2.500'} [2023-02-24 18:11:42,082][177156] DAMAGECOUNT value on done: 62172.0 [2023-02-24 18:11:42,082][177156] Sum rewards: 3.205, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.375', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.031', 'WEAPON1': '0.040', 'weapon5': '0.046', 'AMMO3': '0.053', 'weapon7': '0.104', 'WEAPON5': '0.150', 'HITCOUNT': '0.190', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'weapon2': '0.306', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.564', 'DAMAGECOUNT': '0.936', 'weapon3': '1.016', 'FRAGCOUNT': '4.000'} [2023-02-24 18:11:42,374][177156] DAMAGECOUNT value on done: 67453.0 [2023-02-24 18:11:42,374][177156] Sum rewards: 1.845, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.560', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'weapon4': '0.054', 'weapon5': '0.058', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'weapon7': '0.146', 'HITCOUNT': '0.220', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.035', 'weapon2': '1.338', 'weapon3': '1.364', 'FRAGCOUNT': '2.000'} [2023-02-24 18:11:42,385][177156] DAMAGECOUNT value on done: 65293.0 [2023-02-24 18:11:42,385][177156] Sum rewards: 1.356, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.137', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.018', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.089', 'AMMO3': '0.104', 'WEAPON4': '0.250', 'weapon4': '0.332', 'HITCOUNT': '0.380', 'WEAPON3': '0.700', 'weapon2': '1.026', 'DAMAGECOUNT': '1.305', 'weapon3': '1.696', 'FRAGCOUNT': '4.000'} [2023-02-24 18:11:43,227][177153] Updated weights for policy 0, policy_version 10000 (0.0008) [2023-02-24 18:11:46,099][177153] Updated weights for policy 0, policy_version 10010 (0.0008) [2023-02-24 18:11:46,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14037.5). Total num frames: 41000960. Throughput: 0: 3511.8. Samples: 10251976. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:11:46,376][177119] Avg episode reward: [(0, '5.968')] [2023-02-24 18:11:49,028][177153] Updated weights for policy 0, policy_version 10020 (0.0008) [2023-02-24 18:11:49,471][177170] DAMAGECOUNT value on done: 64694.0 [2023-02-24 18:11:49,472][177170] Sum rewards: 4.954, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.060', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.050', 'AMMO4': '0.053', 'weapon7': '0.054', 'weapon5': '0.076', 'AMMO3': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.106', 'WEAPON5': '0.250', 'HITCOUNT': '0.420', 'WEAPON3': '0.600', 'weapon2': '0.832', 'weapon3': '1.498', 'DAMAGECOUNT': '1.797', 'FRAGCOUNT': '5.000'} [2023-02-24 18:11:49,768][177170] DAMAGECOUNT value on done: 69510.0 [2023-02-24 18:11:49,769][177170] Sum rewards: 3.208, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.000', 'AMMO5': '0.014', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'weapon7': '0.052', 'AMMO3': '0.063', 'AMMO4': '0.091', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.200', 'weapon4': '0.260', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.828', 'weapon2': '0.988', 'weapon3': '1.484', 'FRAGCOUNT': '3.000'} [2023-02-24 18:11:49,781][177170] DAMAGECOUNT value on done: 57776.0 [2023-02-24 18:11:49,781][177170] Sum rewards: 3.912, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.219', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'weapon5': '0.052', 'weapon7': '0.056', 'AMMO3': '0.080', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'weapon4': '0.682', 'weapon2': '0.756', 'ARMOR': '0.892', 'weapon3': '1.618', 'DAMAGECOUNT': '1.806', 'FRAGCOUNT': '3.000'} [2023-02-24 18:11:50,079][177170] DAMAGECOUNT value on done: 68779.0 [2023-02-24 18:11:50,079][177170] Sum rewards: 5.668, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.990', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.050', 'AMMO4': '0.057', 'weapon5': '0.100', 'AMMO3': '0.105', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'HITCOUNT': '0.500', 'weapon4': '0.514', 'WEAPON3': '0.800', 'weapon2': '0.944', 'weapon3': '1.846', 'DAMAGECOUNT': '1.917', 'FRAGCOUNT': '7.000'} [2023-02-24 18:11:50,608][177158] DAMAGECOUNT value on done: 62232.0 [2023-02-24 18:11:50,609][177158] Sum rewards: -0.191, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.100', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon7': '0.048', 'AMMO3': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'weapon5': '0.218', 'HITCOUNT': '0.280', 'weapon4': '0.338', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'weapon2': '0.648', 'FRAGCOUNT': '1.000', 'weapon3': '1.312', 'DAMAGECOUNT': '1.389'} [2023-02-24 18:11:50,909][177158] DAMAGECOUNT value on done: 63504.0 [2023-02-24 18:11:50,909][177158] Sum rewards: 3.072, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.732', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.036', 'WEAPON1': '0.060', 'weapon7': '0.070', 'weapon5': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.101', 'AMMO4': '0.178', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon4': '0.498', 'HITCOUNT': '0.620', 'WEAPON3': '0.700', 'weapon2': '1.082', 'weapon3': '1.610', 'DAMAGECOUNT': '2.184', 'FRAGCOUNT': '4.500'} [2023-02-24 18:11:51,376][177119] Fps is (10 sec: 14335.9, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 41074688. Throughput: 0: 3512.7. Samples: 10262468. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:11:51,376][177119] Avg episode reward: [(0, '5.641')] [2023-02-24 18:11:51,813][177158] DAMAGECOUNT value on done: 62950.0 [2023-02-24 18:11:51,813][177158] Sum rewards: 6.627, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.004', 'AMMO2': '0.021', 'AMMO5': '0.025', 'weapon4': '0.078', 'WEAPON1': '0.080', 'AMMO3': '0.096', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'weapon5': '0.244', 'HITCOUNT': '0.480', 'WEAPON5': '0.600', 'WEAPON3': '0.650', 'weapon2': '1.160', 'weapon3': '2.020', 'DAMAGECOUNT': '2.370', 'FRAGCOUNT': '7.000'} [2023-02-24 18:11:51,951][177153] Updated weights for policy 0, policy_version 10030 (0.0008) [2023-02-24 18:11:52,113][177158] DAMAGECOUNT value on done: 66925.0 [2023-02-24 18:11:52,114][177158] Sum rewards: 8.175, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.762', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.060', 'AMMO4': '0.061', 'weapon7': '0.110', 'weapon5': '0.144', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.450', 'weapon4': '0.518', 'HITCOUNT': '0.550', 'weapon2': '0.586', 'weapon3': '0.980', 'DAMAGECOUNT': '2.793', 'FRAGCOUNT': '6.000'} [2023-02-24 18:11:52,510][177172] DAMAGECOUNT value on done: 63996.0 [2023-02-24 18:11:52,511][177172] Sum rewards: 10.740, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.100', 'AMMO2': '0.010', 'AMMO5': '0.015', 'weapon7': '0.050', 'AMMO4': '0.051', 'WEAPON1': '0.060', 'AMMO3': '0.096', 'weapon5': '0.110', 'WEAPON4': '0.300', 'weapon4': '0.312', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON5': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.760', 'weapon2': '1.216', 'weapon3': '1.536', 'DAMAGECOUNT': '3.684', 'FRAGCOUNT': '10.000'} [2023-02-24 18:11:52,802][177172] DAMAGECOUNT value on done: 62603.0 [2023-02-24 18:11:52,803][177172] Sum rewards: 3.022, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.259', 'AMMO5': '0.005', 'AMMO2': '0.006', 'ARMOR': '0.016', 'AMMO3': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'weapon7': '0.102', 'HITCOUNT': '0.160', 'weapon5': '0.194', 'WEAPON5': '0.200', 'WEAPON3': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'WEAPON7': '0.400', 'weapon3': '0.526', 'weapon4': '0.764', 'DAMAGECOUNT': '0.780', 'weapon2': '1.080', 'FRAGCOUNT': '2.000'} [2023-02-24 18:11:53,235][177154] DAMAGECOUNT value on done: 67990.0 [2023-02-24 18:11:53,235][177154] Sum rewards: 7.726, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.599', 'AMMO2': '0.006', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.032', 'ARMOR': '0.032', 'weapon4': '0.072', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'weapon7': '0.110', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.260', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.380', 'WEAPON3': '0.550', 'weapon3': '1.436', 'weapon2': '1.670', 'DAMAGECOUNT': '2.508', 'FRAGCOUNT': '6.000'} [2023-02-24 18:11:53,546][177154] DAMAGECOUNT value on done: 64797.0 [2023-02-24 18:11:53,547][177154] Sum rewards: 3.597, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.529', 'AMMO5': '0.007', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'weapon5': '0.054', 'AMMO3': '0.072', 'AMMO4': '0.123', 'weapon7': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HITCOUNT': '0.290', 'WEAPON7': '0.300', 'WEAPON3': '0.500', 'weapon4': '0.626', 'weapon3': '1.134', 'weapon2': '1.272', 'DAMAGECOUNT': '1.569', 'FRAGCOUNT': '5.000'} [2023-02-24 18:11:53,558][177154] DAMAGECOUNT value on done: 65244.0 [2023-02-24 18:11:53,558][177154] Sum rewards: 0.318, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.514', 'AMMO2': '0.009', 'AMMO5': '0.015', 'ARMOR': '0.024', 'AMMO4': '0.044', 'weapon5': '0.072', 'WEAPON1': '0.090', 'weapon4': '0.100', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'weapon7': '0.152', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON5': '0.350', 'HITCOUNT': '0.380', 'WEAPON7': '0.500', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.296', 'weapon2': '1.526', 'weapon3': '1.786', 'FRAGCOUNT': '2.000'} [2023-02-24 18:11:53,719][177172] DAMAGECOUNT value on done: 62467.0 [2023-02-24 18:11:53,719][177172] Sum rewards: 4.344, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.128', 'AMMO5': '0.025', 'AMMO2': '0.036', 'WEAPON4': '0.100', 'WEAPON1': '0.110', 'AMMO4': '0.179', 'AMMO3': '0.181', 'weapon4': '0.276', 'weapon5': '0.278', 'ARMOR': '0.400', 'WEAPON5': '0.600', 'weapon2': '0.650', 'HITCOUNT': '0.710', 'WEAPON3': '1.150', 'weapon3': '2.180', 'DAMAGECOUNT': '2.847', 'FRAGCOUNT': '8.000'} [2023-02-24 18:11:53,858][177154] DAMAGECOUNT value on done: 64563.0 [2023-02-24 18:11:53,859][177154] Sum rewards: 6.726, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.556', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'weapon5': '0.064', 'AMMO4': '0.065', 'AMMO3': '0.089', 'weapon7': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.410', 'AMMO6': '0.420', 'AMMO7': '0.420', 'WEAPON7': '0.500', 'weapon2': '0.552', 'weapon4': '0.556', 'WEAPON3': '0.600', 'weapon3': '1.668', 'DAMAGECOUNT': '2.304', 'FRAGCOUNT': '6.000'} [2023-02-24 18:11:54,021][177172] DAMAGECOUNT value on done: 63121.0 [2023-02-24 18:11:54,022][177172] Sum rewards: 0.806, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.468', 'AMMO5': '0.015', 'weapon7': '0.032', 'AMMO2': '0.039', 'WEAPON1': '0.070', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.134', 'AMMO3': '0.180', 'AMMO4': '0.196', 'WEAPON4': '0.300', 'weapon2': '0.320', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.660', 'weapon4': '0.726', 'WEAPON3': '1.100', 'DAMAGECOUNT': '2.130', 'weapon3': '2.272', 'FRAGCOUNT': '4.000'} [2023-02-24 18:11:54,435][177157] DAMAGECOUNT value on done: 63965.0 [2023-02-24 18:11:54,447][177157] DAMAGECOUNT value on done: 68795.0 [2023-02-24 18:11:54,447][177157] Sum rewards: 2.692, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.094', 'AMMO2': '0.004', 'AMMO5': '0.005', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.022', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'weapon7': '0.136', 'weapon4': '0.154', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HITCOUNT': '0.260', 'WEAPON7': '0.300', 'WEAPON3': '0.600', 'weapon2': '1.268', 'weapon3': '1.510', 'DAMAGECOUNT': '1.515', 'FRAGCOUNT': '3.000'} [2023-02-24 18:11:54,626][177171] DAMAGECOUNT value on done: 65809.0 [2023-02-24 18:11:54,626][177171] Sum rewards: 7.535, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.069', 'AMMO5': '0.015', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'weapon5': '0.074', 'AMMO3': '0.081', 'AMMO4': '0.109', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.544', 'HITCOUNT': '0.600', 'WEAPON3': '0.650', 'weapon4': '0.952', 'ARMOR': '0.954', 'weapon3': '1.494', 'DAMAGECOUNT': '2.229', 'FRAGCOUNT': '8.000'} [2023-02-24 18:11:54,735][177157] DAMAGECOUNT value on done: 63138.0 [2023-02-24 18:11:54,735][177157] Sum rewards: 4.303, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.863', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon7': '0.068', 'AMMO4': '0.069', 'AMMO3': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.108', 'weapon5': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.540', 'WEAPON3': '0.650', 'weapon3': '1.632', 'weapon2': '1.656', 'DAMAGECOUNT': '2.061', 'FRAGCOUNT': '5.000'} [2023-02-24 18:11:54,746][177157] DAMAGECOUNT value on done: 64274.0 [2023-02-24 18:11:54,747][177157] Sum rewards: 4.630, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.242', 'AMMO5': '0.005', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'weapon5': '0.050', 'weapon7': '0.076', 'AMMO4': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.260', 'HITCOUNT': '0.450', 'WEAPON3': '0.650', 'weapon2': '1.202', 'DAMAGECOUNT': '1.617', 'weapon3': '1.718', 'FRAGCOUNT': '4.000'} [2023-02-24 18:11:54,834][177153] Updated weights for policy 0, policy_version 10040 (0.0008) [2023-02-24 18:11:54,924][177171] DAMAGECOUNT value on done: 64891.0 [2023-02-24 18:11:54,925][177171] Sum rewards: 1.194, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.665', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'AMMO3': '0.090', 'weapon7': '0.098', 'AMMO4': '0.103', 'weapon4': '0.152', 'weapon5': '0.176', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'HITCOUNT': '0.320', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.412', 'weapon3': '1.720', 'DAMAGECOUNT': '1.878', 'FRAGCOUNT': '2.000'} [2023-02-24 18:11:55,322][177171] DAMAGECOUNT value on done: 64001.0 [2023-02-24 18:11:55,323][177171] Sum rewards: -1.895, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.450', 'AMMO2': '0.019', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'AMMO4': '0.095', 'AMMO3': '0.133', 'HITCOUNT': '0.160', 'weapon5': '0.270', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'weapon4': '0.594', 'DAMAGECOUNT': '0.795', 'WEAPON3': '0.850', 'weapon2': '0.920', 'weapon3': '1.716', 'FRAGCOUNT': '2.000'} [2023-02-24 18:11:55,430][177155] DAMAGECOUNT value on done: 66483.0 [2023-02-24 18:11:55,430][177155] Sum rewards: 16.350, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.038', 'HEALTH': '0.039', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO3': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.280', 'WEAPON3': '0.400', 'weapon4': '0.518', 'HITCOUNT': '0.540', 'weapon2': '1.302', 'weapon3': '1.320', 'DAMAGECOUNT': '2.784', 'FRAGCOUNT': '14.000'} [2023-02-24 18:11:55,624][177171] DAMAGECOUNT value on done: 63966.0 [2023-02-24 18:11:55,624][177171] Sum rewards: 6.329, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.654', 'AMMO5': '0.010', 'AMMO2': '0.027', 'WEAPON1': '0.050', 'weapon7': '0.054', 'AMMO3': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.134', 'weapon5': '0.220', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'WEAPON5': '0.300', 'weapon4': '0.352', 'ARMOR': '0.483', 'WEAPON3': '0.650', 'weapon2': '1.032', 'weapon3': '1.710', 'DAMAGECOUNT': '1.797', 'FRAGCOUNT': '6.000'} [2023-02-24 18:11:55,723][177155] DAMAGECOUNT value on done: 67627.0 [2023-02-24 18:11:55,723][177155] Sum rewards: 5.644, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.140', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO3': '0.068', 'AMMO4': '0.073', 'weapon7': '0.104', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.288', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.450', 'weapon2': '0.966', 'weapon3': '1.110', 'DAMAGECOUNT': '1.710', 'FRAGCOUNT': '4.000'} [2023-02-24 18:11:56,057][177155] DAMAGECOUNT value on done: 68449.0 [2023-02-24 18:11:56,057][177155] Sum rewards: 6.818, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.065', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'weapon7': '0.050', 'AMMO3': '0.058', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.154', 'WEAPON7': '0.200', 'weapon5': '0.236', 'WEAPON5': '0.250', 'HITCOUNT': '0.280', 'WEAPON3': '0.450', 'weapon3': '1.092', 'weapon2': '1.372', 'DAMAGECOUNT': '2.022', 'FRAGCOUNT': '5.000'} [2023-02-24 18:11:56,354][177155] DAMAGECOUNT value on done: 62352.0 [2023-02-24 18:11:56,354][177155] Sum rewards: 8.311, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.554', 'AMMO5': '0.016', 'AMMO2': '0.036', 'WEAPON1': '0.070', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.181', 'WEAPON4': '0.250', 'weapon4': '0.306', 'weapon5': '0.324', 'WEAPON5': '0.450', 'ARMOR': '0.472', 'HITCOUNT': '0.560', 'WEAPON3': '0.650', 'weapon2': '1.012', 'weapon3': '1.960', 'DAMAGECOUNT': '3.168', 'FRAGCOUNT': '8.000'} [2023-02-24 18:11:56,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14063.0, 300 sec: 14037.5). Total num frames: 41144320. Throughput: 0: 3514.4. Samples: 10283602. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:11:56,376][177119] Avg episode reward: [(0, '4.987')] [2023-02-24 18:11:57,315][177170] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 18:11:57,748][177153] Updated weights for policy 0, policy_version 10050 (0.0009) [2023-02-24 18:12:00,648][177153] Updated weights for policy 0, policy_version 10060 (0.0008) [2023-02-24 18:12:01,145][177156] DAMAGECOUNT value on done: 65814.0 [2023-02-24 18:12:01,146][177156] Sum rewards: 6.925, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.248', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.057', 'AMMO3': '0.066', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon5': '0.262', 'WEAPON3': '0.350', 'ARMOR': '0.458', 'HITCOUNT': '0.500', 'weapon4': '0.592', 'weapon3': '1.340', 'weapon2': '1.378', 'DAMAGECOUNT': '1.965', 'FRAGCOUNT': '5.000'} [2023-02-24 18:12:01,156][177156] DAMAGECOUNT value on done: 62477.0 [2023-02-24 18:12:01,157][177156] Sum rewards: 3.173, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.003', 'AMMO2': '0.015', 'AMMO3': '0.021', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'weapon7': '0.114', 'WEAPON3': '0.150', 'weapon2': '0.156', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'HEALTH': '0.295', 'AMMO6': '0.420', 'AMMO7': '0.420', 'weapon3': '0.492', 'WEAPON7': '0.500', 'weapon4': '0.624', 'DAMAGECOUNT': '0.915', 'FRAGCOUNT': '1.500'} [2023-02-24 18:12:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 14037.5). Total num frames: 41213952. Throughput: 0: 3515.5. Samples: 10304698. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:12:01,376][177119] Avg episode reward: [(0, '4.986')] [2023-02-24 18:12:01,450][177156] DAMAGECOUNT value on done: 68367.0 [2023-02-24 18:12:01,451][177156] Sum rewards: 5.988, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.088', 'ARMOR': '0.014', 'AMMO5': '0.020', 'AMMO2': '0.025', 'WEAPON1': '0.070', 'weapon5': '0.078', 'weapon7': '0.106', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'weapon4': '0.154', 'AMMO3': '0.161', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'HITCOUNT': '0.580', 'weapon2': '0.834', 'WEAPON3': '1.000', 'weapon3': '2.378', 'DAMAGECOUNT': '2.742', 'FRAGCOUNT': '8.000'} [2023-02-24 18:12:01,463][177156] DAMAGECOUNT value on done: 65874.0 [2023-02-24 18:12:01,463][177156] Sum rewards: 1.241, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.356', 'AMMO5': '0.015', 'AMMO2': '0.022', 'WEAPON1': '0.050', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'AMMO4': '0.108', 'weapon5': '0.132', 'WEAPON5': '0.300', 'weapon4': '0.498', 'WEAPON3': '0.500', 'HITCOUNT': '0.530', 'weapon2': '1.306', 'weapon3': '1.466', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.743'} [2023-02-24 18:12:03,571][177153] Updated weights for policy 0, policy_version 10070 (0.0008) [2023-02-24 18:12:06,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14062.9, 300 sec: 14037.5). Total num frames: 41283584. Throughput: 0: 3516.9. Samples: 10315242. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:12:06,376][177119] Avg episode reward: [(0, '4.993')] [2023-02-24 18:12:06,481][177153] Updated weights for policy 0, policy_version 10080 (0.0009) [2023-02-24 18:12:08,581][177170] DAMAGECOUNT value on done: 65343.0 [2023-02-24 18:12:08,582][177170] Sum rewards: 3.377, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.097', 'weapon5': '0.002', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.081', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'weapon7': '0.122', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.366', 'HITCOUNT': '0.520', 'WEAPON3': '0.650', 'weapon4': '0.744', 'DAMAGECOUNT': '1.947', 'weapon3': '1.980', 'FRAGCOUNT': '4.000'} [2023-02-24 18:12:08,867][177170] DAMAGECOUNT value on done: 58599.0 [2023-02-24 18:12:08,867][177170] Sum rewards: 4.824, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.332', 'AMMO5': '0.012', 'AMMO2': '0.032', 'WEAPON1': '0.040', 'AMMO3': '0.100', 'AMMO4': '0.160', 'weapon5': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'ARMOR': '0.404', 'weapon4': '0.562', 'HITCOUNT': '0.610', 'WEAPON3': '0.750', 'weapon2': '1.248', 'weapon3': '1.592', 'DAMAGECOUNT': '2.469', 'FRAGCOUNT': '7.000'} [2023-02-24 18:12:08,886][177170] DAMAGECOUNT value on done: 70514.0 [2023-02-24 18:12:08,887][177170] Sum rewards: 2.815, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.330', 'weapon5': '0.016', 'AMMO5': '0.018', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'AMMO4': '0.090', 'weapon4': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'WEAPON5': '0.350', 'ARMOR': '0.460', 'weapon2': '0.656', 'HITCOUNT': '0.730', 'WEAPON3': '1.350', 'weapon3': '2.802', 'DAMAGECOUNT': '3.012', 'FRAGCOUNT': '10.000'} [2023-02-24 18:12:09,177][177170] DAMAGECOUNT value on done: 69618.0 [2023-02-24 18:12:09,177][177170] Sum rewards: 6.073, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.918', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'weapon7': '0.058', 'AMMO4': '0.069', 'AMMO3': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.280', 'HITCOUNT': '0.350', 'WEAPON3': '0.650', 'weapon2': '1.386', 'weapon3': '1.394', 'DAMAGECOUNT': '2.517', 'FRAGCOUNT': '6.000'} [2023-02-24 18:12:09,419][177153] Updated weights for policy 0, policy_version 10090 (0.0008) [2023-02-24 18:12:09,755][177158] DAMAGECOUNT value on done: 62999.0 [2023-02-24 18:12:09,755][177158] Sum rewards: 5.579, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.600', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.015', 'WEAPON1': '0.060', 'AMMO3': '0.122', 'weapon5': '0.164', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.400', 'HITCOUNT': '0.600', 'WEAPON3': '0.900', 'weapon2': '1.538', 'weapon3': '1.968', 'DAMAGECOUNT': '2.301', 'FRAGCOUNT': '6.000'} [2023-02-24 18:12:10,053][177158] DAMAGECOUNT value on done: 63922.0 [2023-02-24 18:12:10,054][177158] Sum rewards: 3.534, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.836', 'AMMO2': '0.009', 'AMMO5': '0.012', 'weapon4': '0.020', 'AMMO4': '0.046', 'WEAPON1': '0.050', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'weapon5': '0.208', 'HITCOUNT': '0.340', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.254', 'weapon3': '1.376', 'weapon2': '2.228', 'FRAGCOUNT': '3.000'} [2023-02-24 18:12:10,929][177158] DAMAGECOUNT value on done: 63876.0 [2023-02-24 18:12:10,930][177158] Sum rewards: 5.896, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.504', 'AMMO2': '0.015', 'AMMO5': '0.026', 'AMMO4': '0.076', 'WEAPON1': '0.100', 'AMMO3': '0.114', 'WEAPON4': '0.200', 'weapon5': '0.256', 'weapon4': '0.292', 'ARMOR': '0.458', 'WEAPON5': '0.650', 'HITCOUNT': '0.650', 'WEAPON3': '0.900', 'weapon2': '0.940', 'weapon3': '1.944', 'DAMAGECOUNT': '2.778', 'FRAGCOUNT': '8.000'} [2023-02-24 18:12:11,226][177158] DAMAGECOUNT value on done: 67833.0 [2023-02-24 18:12:11,226][177158] Sum rewards: 9.168, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.155', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.021', 'AMMO3': '0.040', 'WEAPON1': '0.050', 'weapon7': '0.094', 'AMMO4': '0.103', 'weapon5': '0.164', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.300', 'WEAPON7': '0.400', 'HITCOUNT': '0.400', 'weapon4': '0.748', 'weapon2': '0.840', 'weapon3': '0.890', 'DAMAGECOUNT': '2.724', 'FRAGCOUNT': '7.000'} [2023-02-24 18:12:11,376][177119] Fps is (10 sec: 13926.5, 60 sec: 14063.0, 300 sec: 14037.5). Total num frames: 41353216. Throughput: 0: 3512.9. Samples: 10336212. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:12:11,376][177119] Avg episode reward: [(0, '4.927')] [2023-02-24 18:12:11,715][177172] DAMAGECOUNT value on done: 64829.0 [2023-02-24 18:12:11,716][177172] Sum rewards: 4.151, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.362', 'ARMOR': '0.016', 'AMMO5': '0.022', 'AMMO2': '0.040', 'weapon7': '0.046', 'WEAPON1': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.129', 'weapon5': '0.184', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'AMMO4': '0.200', 'weapon4': '0.334', 'WEAPON5': '0.450', 'HITCOUNT': '0.670', 'WEAPON3': '0.900', 'weapon2': '1.234', 'weapon3': '1.808', 'DAMAGECOUNT': '2.499', 'FRAGCOUNT': '7.000'} [2023-02-24 18:12:12,021][177172] DAMAGECOUNT value on done: 63514.0 [2023-02-24 18:12:12,022][177172] Sum rewards: 8.593, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.023', 'WEAPON1': '0.030', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon7': '0.110', 'HEALTH': '0.115', 'WEAPON5': '0.150', 'weapon5': '0.162', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.322', 'HITCOUNT': '0.370', 'WEAPON7': '0.400', 'WEAPON3': '0.400', 'weapon3': '1.382', 'weapon2': '1.728', 'DAMAGECOUNT': '2.733', 'FRAGCOUNT': '6.000'} [2023-02-24 18:12:12,358][177153] Updated weights for policy 0, policy_version 10100 (0.0008) [2023-02-24 18:12:12,449][177154] DAMAGECOUNT value on done: 68813.0 [2023-02-24 18:12:12,450][177154] Sum rewards: 5.651, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.910', 'AMMO2': '0.020', 'AMMO5': '0.022', 'AMMO4': '0.100', 'WEAPON1': '0.100', 'weapon5': '0.118', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'weapon2': '0.490', 'WEAPON5': '0.550', 'weapon4': '0.624', 'HITCOUNT': '0.710', 'WEAPON3': '0.950', 'ARMOR': '0.954', 'weapon3': '2.128', 'DAMAGECOUNT': '2.469', 'FRAGCOUNT': '5.500'} [2023-02-24 18:12:12,747][177154] DAMAGECOUNT value on done: 65711.0 [2023-02-24 18:12:12,748][177154] Sum rewards: 6.187, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.429', 'AMMO2': '0.001', 'AMMO4': '0.003', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO3': '0.103', 'weapon5': '0.166', 'WEAPON5': '0.300', 'HITCOUNT': '0.560', 'WEAPON3': '0.700', 'weapon3': '1.756', 'weapon2': '1.762', 'DAMAGECOUNT': '2.742', 'FRAGCOUNT': '7.000'} [2023-02-24 18:12:12,760][177154] DAMAGECOUNT value on done: 65942.0 [2023-02-24 18:12:12,760][177154] Sum rewards: 5.859, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.017', 'AMMO2': '0.022', 'weapon7': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.075', 'AMMO4': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.220', 'HITCOUNT': '0.320', 'HEALTH': '0.330', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'ARMOR': '0.408', 'weapon4': '0.604', 'weapon2': '0.916', 'weapon3': '1.042', 'DAMAGECOUNT': '2.094', 'FRAGCOUNT': '3.500'} [2023-02-24 18:12:12,921][177172] DAMAGECOUNT value on done: 63421.0 [2023-02-24 18:12:12,922][177172] Sum rewards: 9.386, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.151', 'ARMOR': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.040', 'AMMO3': '0.065', 'weapon5': '0.126', 'AMMO4': '0.198', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.700', 'weapon4': '0.742', 'weapon3': '1.192', 'weapon2': '1.662', 'DAMAGECOUNT': '2.862', 'FRAGCOUNT': '10.000'} [2023-02-24 18:12:13,059][177154] DAMAGECOUNT value on done: 65716.0 [2023-02-24 18:12:13,060][177154] Sum rewards: 10.709, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon7': '0.050', 'AMMO3': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.133', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.218', 'weapon4': '0.320', 'WEAPON3': '0.500', 'HEALTH': '0.534', 'HITCOUNT': '0.590', 'weapon2': '1.412', 'weapon3': '1.698', 'DAMAGECOUNT': '3.459', 'FRAGCOUNT': '7.000'} [2023-02-24 18:12:13,210][177172] DAMAGECOUNT value on done: 64105.0 [2023-02-24 18:12:13,210][177172] Sum rewards: 4.009, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.362', 'AMMO5': '0.017', 'AMMO2': '0.035', 'WEAPON1': '0.040', 'AMMO4': '0.176', 'AMMO3': '0.183', 'weapon5': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'weapon4': '0.550', 'weapon2': '0.680', 'HITCOUNT': '0.760', 'WEAPON3': '1.150', 'weapon3': '2.032', 'DAMAGECOUNT': '2.952', 'FRAGCOUNT': '8.000'} [2023-02-24 18:12:13,608][177157] DAMAGECOUNT value on done: 64916.0 [2023-02-24 18:12:13,608][177157] Sum rewards: 4.595, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.430', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.037', 'weapon7': '0.050', 'AMMO3': '0.093', 'weapon5': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.185', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.506', 'WEAPON3': '0.700', 'HITCOUNT': '0.840', 'weapon2': '1.550', 'weapon3': '1.594', 'DAMAGECOUNT': '2.853', 'FRAGCOUNT': '5.500'} [2023-02-24 18:12:13,618][177157] DAMAGECOUNT value on done: 69135.0 [2023-02-24 18:12:13,618][177157] Sum rewards: 0.124, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.800', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.034', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'weapon4': '0.146', 'AMMO4': '0.172', 'weapon5': '0.184', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.270', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.020', 'weapon2': '1.110', 'FRAGCOUNT': '2.000', 'weapon3': '2.184'} [2023-02-24 18:12:13,799][177171] DAMAGECOUNT value on done: 66963.0 [2023-02-24 18:12:13,799][177171] Sum rewards: 6.283, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.106', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon7': '0.058', 'WEAPON1': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'AMMO4': '0.216', 'weapon5': '0.258', 'ARMOR': '0.408', 'weapon4': '0.472', 'WEAPON5': '0.550', 'HITCOUNT': '0.750', 'weapon2': '0.780', 'WEAPON3': '0.900', 'weapon3': '2.008', 'DAMAGECOUNT': '3.462', 'FRAGCOUNT': '6.500'} [2023-02-24 18:12:13,916][177157] DAMAGECOUNT value on done: 63518.0 [2023-02-24 18:12:13,917][177157] Sum rewards: -2.378, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.560', 'ARMOR': '0.004', 'AMMO5': '0.016', 'WEAPON1': '0.040', 'AMMO2': '0.044', 'AMMO3': '0.164', 'weapon5': '0.174', 'AMMO4': '0.221', 'HITCOUNT': '0.290', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.752', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.140', 'weapon2': '1.190', 'weapon3': '1.346', 'FRAGCOUNT': '4.000'} [2023-02-24 18:12:13,927][177157] DAMAGECOUNT value on done: 64940.0 [2023-02-24 18:12:13,928][177157] Sum rewards: 4.255, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.264', 'AMMO5': '0.008', 'ARMOR': '0.020', 'AMMO2': '0.045', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO3': '0.123', 'weapon5': '0.188', 'AMMO4': '0.223', 'WEAPON5': '0.250', 'weapon4': '0.280', 'WEAPON4': '0.300', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'HITCOUNT': '0.480', 'WEAPON3': '0.750', 'weapon2': '1.370', 'weapon3': '1.736', 'DAMAGECOUNT': '1.998', 'FRAGCOUNT': '5.000'} [2023-02-24 18:12:14,092][177171] DAMAGECOUNT value on done: 65690.0 [2023-02-24 18:12:14,093][177171] Sum rewards: 7.986, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.262', 'AMMO5': '0.013', 'AMMO2': '0.018', 'weapon7': '0.052', 'WEAPON1': '0.070', 'AMMO4': '0.089', 'weapon4': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.129', 'weapon5': '0.288', 'WEAPON5': '0.400', 'HITCOUNT': '0.470', 'WEAPON3': '0.600', 'weapon2': '1.540', 'weapon3': '1.688', 'DAMAGECOUNT': '2.397', 'FRAGCOUNT': '6.000'} [2023-02-24 18:12:14,481][177155] DAMAGECOUNT value on done: 67483.0 [2023-02-24 18:12:14,481][177155] Sum rewards: 7.466, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.108', 'AMMO5': '0.005', 'AMMO2': '0.005', 'ARMOR': '0.010', 'AMMO4': '0.025', 'WEAPON1': '0.040', 'weapon7': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO3': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.190', 'WEAPON7': '0.200', 'HITCOUNT': '0.590', 'WEAPON3': '0.750', 'weapon3': '1.588', 'weapon2': '1.722', 'DAMAGECOUNT': '3.000', 'FRAGCOUNT': '8.000'} [2023-02-24 18:12:14,490][177171] DAMAGECOUNT value on done: 64841.0 [2023-02-24 18:12:14,490][177171] Sum rewards: 3.398, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.090', 'weapon7': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO5': '0.019', 'AMMO4': '0.076', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.147', 'weapon5': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'ARMOR': '0.460', 'weapon4': '0.466', 'weapon2': '0.504', 'HITCOUNT': '0.600', 'WEAPON3': '0.950', 'weapon3': '2.072', 'DAMAGECOUNT': '2.520', 'FRAGCOUNT': '4.500'} [2023-02-24 18:12:14,777][177155] DAMAGECOUNT value on done: 69317.0 [2023-02-24 18:12:14,778][177155] Sum rewards: 12.649, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.118', 'AMMO2': '0.010', 'AMMO5': '0.020', 'ARMOR': '0.036', 'AMMO4': '0.050', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.142', 'AMMO3': '0.150', 'weapon5': '0.214', 'WEAPON5': '0.550', 'weapon2': '0.764', 'HITCOUNT': '0.860', 'WEAPON3': '1.100', 'weapon3': '2.380', 'DAMAGECOUNT': '5.070', 'FRAGCOUNT': '13.000'} [2023-02-24 18:12:14,785][177171] DAMAGECOUNT value on done: 65050.0 [2023-02-24 18:12:14,786][177171] Sum rewards: 8.171, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.880', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'weapon7': '0.050', 'AMMO3': '0.091', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.155', 'weapon4': '0.162', 'WEAPON7': '0.200', 'weapon5': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.680', 'weapon3': '1.512', 'weapon2': '1.756', 'DAMAGECOUNT': '3.252', 'FRAGCOUNT': '7.000'} [2023-02-24 18:12:14,950][177155] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200.0), ('weapon7', 0.002)] [2023-02-24 18:12:15,101][177155] DAMAGECOUNT value on done: 69614.0 [2023-02-24 18:12:15,102][177155] Sum rewards: 12.869, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.298', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.058', 'weapon7': '0.080', 'AMMO3': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.128', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'weapon4': '0.606', 'HITCOUNT': '0.650', 'weapon2': '0.910', 'weapon3': '1.922', 'DAMAGECOUNT': '3.495', 'FRAGCOUNT': '11.000'} [2023-02-24 18:12:15,254][177153] Updated weights for policy 0, policy_version 10110 (0.0008) [2023-02-24 18:12:15,393][177155] DAMAGECOUNT value on done: 62693.0 [2023-02-24 18:12:15,394][177155] Sum rewards: 6.212, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.577', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.006', 'WEAPON1': '0.010', 'ARMOR': '0.016', 'AMMO3': '0.030', 'weapon5': '0.060', 'weapon7': '0.068', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.220', 'WEAPON3': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'weapon4': '0.348', 'WEAPON7': '0.400', 'weapon3': '0.554', 'DAMAGECOUNT': '1.023', 'weapon2': '1.558', 'FRAGCOUNT': '5.000'} [2023-02-24 18:12:16,376][177119] Fps is (10 sec: 13926.5, 60 sec: 14062.9, 300 sec: 14037.5). Total num frames: 41422848. Throughput: 0: 3514.1. Samples: 10357302. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:12:16,376][177119] Avg episode reward: [(0, '5.236')] [2023-02-24 18:12:18,163][177153] Updated weights for policy 0, policy_version 10120 (0.0008) [2023-02-24 18:12:20,258][177156] DAMAGECOUNT value on done: 66395.0 [2023-02-24 18:12:20,258][177156] Sum rewards: 6.846, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.224', 'AMMO5': '0.010', 'AMMO2': '0.020', 'ARMOR': '0.020', 'AMMO3': '0.050', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO4': '0.099', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.214', 'WEAPON5': '0.300', 'HITCOUNT': '0.330', 'WEAPON3': '0.350', 'weapon4': '0.420', 'weapon3': '1.130', 'DAMAGECOUNT': '1.743', 'weapon2': '1.894', 'FRAGCOUNT': '5.000'} [2023-02-24 18:12:20,271][177156] DAMAGECOUNT value on done: 63243.0 [2023-02-24 18:12:20,271][177156] Sum rewards: 9.863, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.756', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.019', 'WEAPON1': '0.060', 'weapon7': '0.116', 'AMMO3': '0.138', 'weapon5': '0.152', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'ARMOR': '0.475', 'HITCOUNT': '0.500', 'WEAPON3': '0.850', 'weapon2': '1.216', 'weapon3': '2.144', 'DAMAGECOUNT': '2.298', 'FRAGCOUNT': '9.000'} [2023-02-24 18:12:20,568][177156] DAMAGECOUNT value on done: 69347.0 [2023-02-24 18:12:20,568][177156] Sum rewards: 3.553, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.761', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'weapon5': '0.052', 'AMMO3': '0.083', 'AMMO4': '0.098', 'weapon7': '0.110', 'WEAPON5': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'weapon4': '0.274', 'WEAPON7': '0.400', 'HITCOUNT': '0.410', 'WEAPON3': '0.550', 'weapon3': '1.428', 'weapon2': '1.734', 'DAMAGECOUNT': '1.740', 'FRAGCOUNT': '4.000'} [2023-02-24 18:12:20,578][177156] DAMAGECOUNT value on done: 66516.0 [2023-02-24 18:12:20,579][177156] Sum rewards: 4.611, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.612', 'AMMO5': '0.010', 'AMMO2': '0.012', 'ARMOR': '0.028', 'AMMO4': '0.059', 'WEAPON1': '0.060', 'weapon7': '0.082', 'AMMO3': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon5': '0.354', 'HITCOUNT': '0.380', 'weapon4': '0.386', 'weapon2': '0.508', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.926', 'weapon3': '2.110', 'FRAGCOUNT': '5.000'} [2023-02-24 18:12:21,066][177153] Updated weights for policy 0, policy_version 10130 (0.0008) [2023-02-24 18:12:21,376][177119] Fps is (10 sec: 14335.8, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 41496576. Throughput: 0: 3513.9. Samples: 10367870. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:12:21,376][177119] Avg episode reward: [(0, '5.221')] [2023-02-24 18:12:23,975][177153] Updated weights for policy 0, policy_version 10140 (0.0008) [2023-02-24 18:12:26,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 41566208. Throughput: 0: 3516.1. Samples: 10388934. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:12:26,376][177119] Avg episode reward: [(0, '5.221')] [2023-02-24 18:12:26,910][177153] Updated weights for policy 0, policy_version 10150 (0.0008) [2023-02-24 18:12:27,699][177170] DAMAGECOUNT value on done: 66449.0 [2023-02-24 18:12:27,699][177170] Sum rewards: 7.324, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.566', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.021', 'weapon7': '0.048', 'WEAPON1': '0.050', 'weapon5': '0.066', 'AMMO4': '0.106', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.246', 'AMMO6': '0.420', 'AMMO7': '0.420', 'WEAPON7': '0.500', 'HITCOUNT': '0.690', 'WEAPON3': '0.900', 'weapon2': '0.926', 'weapon3': '2.418', 'DAMAGECOUNT': '3.318', 'FRAGCOUNT': '8.500'} [2023-02-24 18:12:27,997][177170] DAMAGECOUNT value on done: 71091.0 [2023-02-24 18:12:27,997][177170] Sum rewards: 4.794, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.583', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon7': '0.048', 'AMMO3': '0.056', 'WEAPON1': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.214', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.450', 'weapon4': '0.472', 'weapon3': '0.858', 'weapon2': '1.514', 'DAMAGECOUNT': '1.731', 'FRAGCOUNT': '4.500'} [2023-02-24 18:12:28,018][177170] DAMAGECOUNT value on done: 59467.0 [2023-02-24 18:12:28,018][177170] Sum rewards: 4.662, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.111', 'AMMO5': '0.017', 'ARMOR': '0.028', 'AMMO2': '0.037', 'WEAPON1': '0.060', 'AMMO3': '0.109', 'weapon5': '0.140', 'AMMO4': '0.184', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.626', 'HITCOUNT': '0.650', 'WEAPON3': '0.800', 'weapon2': '1.090', 'weapon3': '1.778', 'DAMAGECOUNT': '2.604', 'FRAGCOUNT': '10.000'} [2023-02-24 18:12:28,202][177170] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 18:12:28,318][177170] DAMAGECOUNT value on done: 70592.0 [2023-02-24 18:12:28,318][177170] Sum rewards: 11.618, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.451', 'AMMO2': '0.008', 'AMMO5': '0.010', 'ARMOR': '0.024', 'WEAPON1': '0.030', 'AMMO4': '0.038', 'weapon7': '0.048', 'AMMO3': '0.057', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.220', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'HITCOUNT': '0.670', 'weapon4': '0.732', 'weapon3': '1.012', 'weapon2': '1.698', 'DAMAGECOUNT': '2.922', 'FRAGCOUNT': '8.000'} [2023-02-24 18:12:28,908][177158] DAMAGECOUNT value on done: 64096.0 [2023-02-24 18:12:28,909][177158] Sum rewards: 9.582, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.020', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'weapon7': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.121', 'AMMO3': '0.149', 'weapon5': '0.150', 'WEAPON7': '0.200', 'HEALTH': '0.238', 'WEAPON4': '0.250', 'ARMOR': '0.408', 'WEAPON5': '0.450', 'weapon4': '0.530', 'HITCOUNT': '0.810', 'WEAPON3': '0.850', 'weapon2': '1.182', 'weapon3': '1.820', 'DAMAGECOUNT': '3.291', 'FRAGCOUNT': '8.500'} [2023-02-24 18:12:29,208][177158] DAMAGECOUNT value on done: 64591.0 [2023-02-24 18:12:29,208][177158] Sum rewards: 2.620, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.894', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO2': '0.025', 'weapon7': '0.066', 'weapon5': '0.070', 'AMMO3': '0.099', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.123', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.470', 'weapon4': '0.640', 'WEAPON3': '0.700', 'weapon2': '0.814', 'weapon3': '1.856', 'DAMAGECOUNT': '2.007', 'FRAGCOUNT': '5.000'} [2023-02-24 18:12:29,844][177153] Updated weights for policy 0, policy_version 10160 (0.0009) [2023-02-24 18:12:30,078][177158] DAMAGECOUNT value on done: 65098.0 [2023-02-24 18:12:30,079][177158] Sum rewards: 6.424, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.293', 'AMMO5': '0.023', 'AMMO2': '0.038', 'ARMOR': '0.048', 'WEAPON1': '0.080', 'AMMO3': '0.138', 'weapon5': '0.172', 'AMMO4': '0.188', 'weapon4': '0.320', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'HITCOUNT': '0.750', 'WEAPON3': '0.950', 'weapon2': '0.992', 'weapon3': '2.102', 'DAMAGECOUNT': '3.666', 'FRAGCOUNT': '8.000'} [2023-02-24 18:12:30,387][177158] DAMAGECOUNT value on done: 68615.0 [2023-02-24 18:12:30,387][177158] Sum rewards: 1.282, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.790', 'AMMO2': '0.010', 'AMMO5': '0.023', 'AMMO4': '0.050', 'WEAPON1': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon4': '0.136', 'weapon5': '0.258', 'HITCOUNT': '0.490', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'weapon2': '1.422', 'weapon3': '1.682', 'DAMAGECOUNT': '2.346', 'FRAGCOUNT': '4.500'} [2023-02-24 18:12:30,857][177172] DAMAGECOUNT value on done: 65748.0 [2023-02-24 18:12:30,857][177172] Sum rewards: 4.646, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.800', 'AMMO5': '0.025', 'AMMO2': '0.031', 'WEAPON1': '0.060', 'weapon7': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.146', 'AMMO4': '0.157', 'AMMO3': '0.167', 'WEAPON4': '0.350', 'weapon4': '0.456', 'HITCOUNT': '0.470', 'ARMOR': '0.538', 'WEAPON5': '0.550', 'weapon2': '0.722', 'WEAPON3': '1.050', 'weapon3': '2.104', 'DAMAGECOUNT': '2.757', 'FRAGCOUNT': '7.000'} [2023-02-24 18:12:31,156][177172] DAMAGECOUNT value on done: 64410.0 [2023-02-24 18:12:31,156][177172] Sum rewards: 4.456, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '0.002', 'AMMO5': '0.017', 'ARMOR': '0.025', 'AMMO2': '0.032', 'WEAPON1': '0.060', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO4': '0.159', 'weapon5': '0.160', 'AMMO3': '0.163', 'WEAPON5': '0.300', 'HITCOUNT': '0.670', 'WEAPON3': '0.900', 'weapon2': '1.076', 'weapon3': '2.284', 'DAMAGECOUNT': '2.688', 'FRAGCOUNT': '5.500'} [2023-02-24 18:12:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 14051.4). Total num frames: 41635840. Throughput: 0: 3509.8. Samples: 10409918. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:12:31,376][177119] Avg episode reward: [(0, '5.121')] [2023-02-24 18:12:31,623][177154] DAMAGECOUNT value on done: 69641.0 [2023-02-24 18:12:31,623][177154] Sum rewards: 6.356, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.490', 'AMMO5': '0.010', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'AMMO3': '0.100', 'weapon5': '0.100', 'AMMO4': '0.110', 'weapon4': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.620', 'WEAPON3': '0.650', 'weapon2': '1.512', 'weapon3': '1.830', 'DAMAGECOUNT': '2.484', 'FRAGCOUNT': '7.000'} [2023-02-24 18:12:31,918][177154] DAMAGECOUNT value on done: 66301.0 [2023-02-24 18:12:31,918][177154] Sum rewards: 1.429, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.336', 'ARMOR': '0.004', 'AMMO2': '0.013', 'AMMO5': '0.020', 'weapon7': '0.046', 'AMMO4': '0.063', 'WEAPON1': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.208', 'WEAPON5': '0.450', 'HITCOUNT': '0.490', 'weapon4': '0.718', 'WEAPON3': '0.800', 'weapon2': '0.986', 'weapon3': '1.650', 'DAMAGECOUNT': '1.770', 'FRAGCOUNT': '3.000'} [2023-02-24 18:12:31,931][177154] DAMAGECOUNT value on done: 67020.0 [2023-02-24 18:12:31,931][177154] Sum rewards: 3.946, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.366', 'ARMOR': '0.008', 'AMMO5': '0.026', 'AMMO2': '0.046', 'WEAPON1': '0.070', 'AMMO3': '0.115', 'weapon5': '0.164', 'AMMO4': '0.230', 'WEAPON4': '0.450', 'WEAPON5': '0.600', 'HITCOUNT': '0.690', 'WEAPON3': '0.700', 'weapon4': '0.754', 'weapon2': '0.974', 'weapon3': '1.750', 'DAMAGECOUNT': '3.234', 'FRAGCOUNT': '7.500'} [2023-02-24 18:12:32,047][177172] DAMAGECOUNT value on done: 65239.0 [2023-02-24 18:12:32,048][177172] Sum rewards: 17.471, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.935', 'AMMO5': '0.012', 'AMMO2': '0.028', 'WEAPON1': '0.050', 'weapon4': '0.050', 'WEAPON4': '0.100', 'weapon5': '0.128', 'AMMO4': '0.141', 'AMMO3': '0.154', 'WEAPON5': '0.300', 'weapon2': '0.968', 'WEAPON3': '1.000', 'HITCOUNT': '1.360', 'weapon3': '2.410', 'DAMAGECOUNT': '5.454', 'FRAGCOUNT': '16.000'} [2023-02-24 18:12:32,231][177154] DAMAGECOUNT value on done: 66506.0 [2023-02-24 18:12:32,231][177154] Sum rewards: 3.318, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.112', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'weapon5': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.108', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'HITCOUNT': '0.580', 'weapon2': '0.622', 'weapon4': '0.790', 'WEAPON3': '0.850', 'ARMOR': '0.875', 'weapon3': '1.488', 'DAMAGECOUNT': '2.370', 'FRAGCOUNT': '5.000'} [2023-02-24 18:12:32,354][177172] DAMAGECOUNT value on done: 64725.0 [2023-02-24 18:12:32,354][177172] Sum rewards: 0.798, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.286', 'ARMOR': '0.008', 'AMMO2': '0.014', 'AMMO5': '0.017', 'weapon7': '0.056', 'WEAPON1': '0.070', 'AMMO4': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.144', 'weapon5': '0.162', 'weapon2': '0.370', 'WEAPON5': '0.400', 'HITCOUNT': '0.500', 'weapon4': '0.542', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.860', 'weapon3': '2.070', 'FRAGCOUNT': '5.000'} [2023-02-24 18:12:32,775][177153] Updated weights for policy 0, policy_version 10170 (0.0008) [2023-02-24 18:12:32,833][177157] DAMAGECOUNT value on done: 66413.0 [2023-02-24 18:12:32,834][177157] Sum rewards: 11.735, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.865', 'AMMO5': '0.019', 'AMMO2': '0.041', 'WEAPON1': '0.060', 'weapon5': '0.128', 'AMMO3': '0.136', 'AMMO4': '0.205', 'WEAPON4': '0.250', 'ARMOR': '0.416', 'weapon2': '0.436', 'weapon4': '0.494', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'HITCOUNT': '1.110', 'weapon3': '2.564', 'DAMAGECOUNT': '4.491', 'FRAGCOUNT': '12.000'} [2023-02-24 18:12:32,845][177157] DAMAGECOUNT value on done: 69878.0 [2023-02-24 18:12:32,845][177157] Sum rewards: 8.045, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.500', 'AMMO5': '0.021', 'AMMO2': '0.033', 'WEAPON4': '0.050', 'weapon4': '0.068', 'WEAPON1': '0.080', 'AMMO3': '0.107', 'AMMO4': '0.166', 'weapon5': '0.316', 'WEAPON5': '0.500', 'HITCOUNT': '0.560', 'WEAPON3': '0.750', 'weapon2': '1.276', 'weapon3': '1.888', 'DAMAGECOUNT': '2.229', 'FRAGCOUNT': '8.000'} [2023-02-24 18:12:32,980][177171] DAMAGECOUNT value on done: 67565.0 [2023-02-24 18:12:32,980][177171] Sum rewards: 3.918, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.446', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.062', 'WEAPON1': '0.070', 'weapon7': '0.080', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.140', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.328', 'HITCOUNT': '0.470', 'WEAPON3': '0.600', 'weapon2': '1.052', 'weapon3': '1.286', 'DAMAGECOUNT': '1.806', 'FRAGCOUNT': '6.000'} [2023-02-24 18:12:33,145][177157] DAMAGECOUNT value on done: 64248.0 [2023-02-24 18:12:33,146][177157] Sum rewards: 3.796, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.287', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'AMMO4': '0.077', 'AMMO3': '0.114', 'weapon5': '0.140', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'HITCOUNT': '0.580', 'WEAPON3': '0.750', 'weapon2': '0.812', 'weapon4': '0.868', 'ARMOR': '0.936', 'weapon3': '1.760', 'DAMAGECOUNT': '2.190', 'FRAGCOUNT': '6.000'} [2023-02-24 18:12:33,157][177157] DAMAGECOUNT value on done: 65652.0 [2023-02-24 18:12:33,157][177157] Sum rewards: -2.488, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.083', 'AMMO5': '0.020', 'ARMOR': '0.020', 'WEAPON1': '0.040', 'AMMO2': '0.061', 'weapon7': '0.062', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.134', 'AMMO3': '0.154', 'WEAPON7': '0.200', 'AMMO4': '0.304', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'HITCOUNT': '0.620', 'weapon2': '0.636', 'WEAPON3': '0.900', 'weapon4': '0.998', 'weapon3': '1.720', 'DAMAGECOUNT': '2.136', 'FRAGCOUNT': '3.000'} [2023-02-24 18:12:33,280][177171] DAMAGECOUNT value on done: 66889.0 [2023-02-24 18:12:33,281][177171] Sum rewards: 9.651, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.800', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.099', 'AMMO4': '0.142', 'weapon5': '0.204', 'WEAPON5': '0.300', 'ARMOR': '0.436', 'WEAPON4': '0.450', 'WEAPON3': '0.600', 'weapon4': '0.860', 'HITCOUNT': '0.880', 'weapon2': '0.952', 'weapon3': '1.620', 'DAMAGECOUNT': '3.597', 'FRAGCOUNT': '8.500'} [2023-02-24 18:12:33,597][177155] DAMAGECOUNT value on done: 68214.0 [2023-02-24 18:12:33,598][177155] Sum rewards: 1.914, reward structure: {'DEATHCOUNT': '-8.250', 'ARMOR': '0.008', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'AMMO2': '0.048', 'HEALTH': '0.066', 'weapon7': '0.072', 'weapon5': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.108', 'weapon2': '0.180', 'AMMO4': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'HITCOUNT': '0.520', 'WEAPON3': '0.650', 'weapon3': '1.196', 'weapon4': '1.282', 'DAMAGECOUNT': '2.193', 'FRAGCOUNT': '2.500'} [2023-02-24 18:12:33,696][177171] DAMAGECOUNT value on done: 65821.0 [2023-02-24 18:12:33,697][177171] Sum rewards: 2.478, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.473', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'AMMO2': '0.035', 'weapon5': '0.070', 'weapon7': '0.088', 'AMMO3': '0.136', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'ARMOR': '0.440', 'WEAPON4': '0.550', 'weapon2': '0.632', 'WEAPON3': '0.900', 'HITCOUNT': '0.910', 'weapon4': '1.414', 'weapon3': '1.576', 'DAMAGECOUNT': '2.940', 'FRAGCOUNT': '5.000'} [2023-02-24 18:12:33,884][177155] DAMAGECOUNT value on done: 69759.0 [2023-02-24 18:12:33,885][177155] Sum rewards: -0.880, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.780', 'AMMO5': '0.012', 'AMMO2': '0.034', 'WEAPON1': '0.070', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'AMMO4': '0.169', 'weapon5': '0.188', 'HITCOUNT': '0.220', 'weapon4': '0.310', 'weapon2': '0.334', 'WEAPON5': '0.350', 'ARMOR': '0.500', 'WEAPON3': '0.650', 'weapon3': '1.288', 'DAMAGECOUNT': '1.326', 'FRAGCOUNT': '2.000'} [2023-02-24 18:12:33,987][177171] DAMAGECOUNT value on done: 65946.0 [2023-02-24 18:12:33,988][177171] Sum rewards: 2.269, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.560', 'AMMO5': '0.010', 'weapon7': '0.016', 'AMMO2': '0.019', 'ARMOR': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.093', 'weapon5': '0.100', 'AMMO3': '0.169', 'weapon4': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon2': '0.602', 'HITCOUNT': '0.740', 'WEAPON3': '1.050', 'weapon3': '2.612', 'DAMAGECOUNT': '2.688', 'FRAGCOUNT': '7.000'} [2023-02-24 18:12:34,206][177155] DAMAGECOUNT value on done: 70059.0 [2023-02-24 18:12:34,207][177155] Sum rewards: 5.102, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.340', 'AMMO5': '0.011', 'AMMO2': '0.012', 'WEAPON1': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.089', 'WEAPON5': '0.250', 'weapon5': '0.254', 'HITCOUNT': '0.340', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.335', 'weapon3': '1.704', 'weapon2': '1.786', 'FRAGCOUNT': '5.000'} [2023-02-24 18:12:34,507][177155] DAMAGECOUNT value on done: 63615.0 [2023-02-24 18:12:34,508][177155] Sum rewards: 3.992, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.722', 'AMMO5': '0.005', 'AMMO2': '0.024', 'ARMOR': '0.028', 'WEAPON1': '0.030', 'weapon5': '0.064', 'weapon4': '0.106', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'HITCOUNT': '0.770', 'WEAPON3': '0.950', 'weapon2': '1.188', 'weapon3': '2.406', 'DAMAGECOUNT': '2.766', 'FRAGCOUNT': '7.000'} [2023-02-24 18:12:35,675][177153] Updated weights for policy 0, policy_version 10180 (0.0008) [2023-02-24 18:12:36,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 14037.5). Total num frames: 41705472. Throughput: 0: 3509.3. Samples: 10420388. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:12:36,376][177119] Avg episode reward: [(0, '5.184')] [2023-02-24 18:12:38,585][177153] Updated weights for policy 0, policy_version 10190 (0.0008) [2023-02-24 18:12:39,498][177156] DAMAGECOUNT value on done: 67531.0 [2023-02-24 18:12:39,498][177156] Sum rewards: 12.457, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.184', 'AMMO2': '0.011', 'ARMOR': '0.012', 'AMMO5': '0.012', 'weapon7': '0.044', 'AMMO4': '0.056', 'WEAPON1': '0.060', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.132', 'AMMO3': '0.137', 'weapon5': '0.222', 'WEAPON5': '0.400', 'HITCOUNT': '0.730', 'WEAPON3': '0.900', 'weapon2': '0.948', 'weapon3': '2.168', 'DAMAGECOUNT': '3.408', 'FRAGCOUNT': '13.000'} [2023-02-24 18:12:39,509][177156] DAMAGECOUNT value on done: 64375.0 [2023-02-24 18:12:39,510][177156] Sum rewards: 8.302, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.404', 'AMMO2': '0.024', 'AMMO5': '0.027', 'AMMO4': '0.119', 'WEAPON1': '0.120', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'weapon4': '0.216', 'weapon5': '0.312', 'ARMOR': '0.472', 'HITCOUNT': '0.650', 'WEAPON5': '0.700', 'weapon2': '0.840', 'WEAPON3': '1.100', 'weapon3': '2.186', 'DAMAGECOUNT': '3.396', 'FRAGCOUNT': '10.000'} [2023-02-24 18:12:39,802][177156] DAMAGECOUNT value on done: 69542.0 [2023-02-24 18:12:39,802][177156] Sum rewards: 2.163, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.268', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'AMMO2': '0.031', 'AMMO3': '0.050', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'HITCOUNT': '0.170', 'WEAPON4': '0.250', 'weapon4': '0.290', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.585', 'weapon2': '0.726', 'ARMOR': '0.824', 'weapon3': '1.248', 'FRAGCOUNT': '2.000'} [2023-02-24 18:12:39,813][177156] DAMAGECOUNT value on done: 67296.0 [2023-02-24 18:12:39,813][177156] Sum rewards: 0.332, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.902', 'AMMO2': '0.024', 'AMMO5': '0.027', 'ARMOR': '0.032', 'WEAPON4': '0.100', 'AMMO4': '0.119', 'WEAPON1': '0.130', 'weapon5': '0.174', 'weapon4': '0.190', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.230', 'HITCOUNT': '0.510', 'weapon2': '0.566', 'WEAPON5': '0.650', 'WEAPON3': '1.500', 'DAMAGECOUNT': '2.340', 'weapon3': '2.542', 'FRAGCOUNT': '7.000'} [2023-02-24 18:12:41,376][177119] Fps is (10 sec: 13926.5, 60 sec: 14062.9, 300 sec: 14037.5). Total num frames: 41775104. Throughput: 0: 3507.7. Samples: 10441450. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:12:41,376][177119] Avg episode reward: [(0, '5.158')] [2023-02-24 18:12:41,504][177153] Updated weights for policy 0, policy_version 10200 (0.0008) [2023-02-24 18:12:44,419][177153] Updated weights for policy 0, policy_version 10210 (0.0008) [2023-02-24 18:12:46,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 14037.5). Total num frames: 41844736. Throughput: 0: 3507.0. Samples: 10462514. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:12:46,376][177119] Avg episode reward: [(0, '5.158')] [2023-02-24 18:12:46,868][177170] DAMAGECOUNT value on done: 68099.0 [2023-02-24 18:12:46,868][177170] Sum rewards: 13.924, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.930', 'AMMO2': '0.010', 'weapon5': '0.014', 'AMMO5': '0.015', 'AMMO4': '0.048', 'WEAPON1': '0.060', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.342', 'ARMOR': '0.467', 'weapon2': '0.784', 'WEAPON3': '1.300', 'HITCOUNT': '1.360', 'weapon3': '2.604', 'DAMAGECOUNT': '4.950', 'FRAGCOUNT': '16.000'} [2023-02-24 18:12:47,173][177170] DAMAGECOUNT value on done: 72182.0 [2023-02-24 18:12:47,173][177170] Sum rewards: 5.899, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.320', 'AMMO5': '0.010', 'weapon5': '0.012', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'ARMOR': '0.052', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'weapon4': '0.178', 'WEAPON5': '0.200', 'HITCOUNT': '0.880', 'weapon2': '1.010', 'WEAPON3': '1.050', 'weapon3': '2.572', 'DAMAGECOUNT': '3.273', 'FRAGCOUNT': '8.000'} [2023-02-24 18:12:47,251][177170] DAMAGECOUNT value on done: 60568.0 [2023-02-24 18:12:47,252][177170] Sum rewards: 6.995, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.252', 'AMMO2': '0.003', 'AMMO4': '0.012', 'AMMO5': '0.017', 'ARMOR': '0.032', 'weapon7': '0.054', 'WEAPON1': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.122', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'weapon4': '0.402', 'HITCOUNT': '0.620', 'weapon2': '0.640', 'WEAPON3': '0.750', 'weapon3': '1.376', 'DAMAGECOUNT': '3.273', 'FRAGCOUNT': '8.000'} [2023-02-24 18:12:47,367][177153] Updated weights for policy 0, policy_version 10220 (0.0008) [2023-02-24 18:12:47,551][177170] DAMAGECOUNT value on done: 70967.0 [2023-02-24 18:12:48,076][177158] DAMAGECOUNT value on done: 64596.0 [2023-02-24 18:12:48,076][177158] Sum rewards: 0.713, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.836', 'AMMO5': '0.015', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'weapon5': '0.094', 'weapon4': '0.114', 'AMMO4': '0.123', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.404', 'HITCOUNT': '0.460', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.500', 'weapon2': '1.620', 'weapon3': '1.912', 'FRAGCOUNT': '3.000'} [2023-02-24 18:12:48,375][177158] DAMAGECOUNT value on done: 65134.0 [2023-02-24 18:12:48,375][177158] Sum rewards: 4.741, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.963', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.034', 'WEAPON1': '0.050', 'AMMO3': '0.055', 'weapon5': '0.114', 'AMMO4': '0.171', 'weapon7': '0.216', 'HITCOUNT': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'AMMO6': '0.480', 'AMMO7': '0.480', 'WEAPON7': '0.600', 'weapon3': '1.142', 'weapon4': '1.460', 'DAMAGECOUNT': '1.629', 'FRAGCOUNT': '5.000'} [2023-02-24 18:12:49,269][177158] DAMAGECOUNT value on done: 66061.0 [2023-02-24 18:12:49,269][177158] Sum rewards: 4.870, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.356', 'AMMO5': '0.015', 'AMMO2': '0.036', 'WEAPON1': '0.060', 'weapon7': '0.072', 'weapon5': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.106', 'AMMO4': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.476', 'weapon4': '0.492', 'ARMOR': '0.504', 'HITCOUNT': '0.620', 'WEAPON3': '0.700', 'weapon3': '1.668', 'DAMAGECOUNT': '2.859', 'FRAGCOUNT': '5.500'} [2023-02-24 18:12:49,571][177158] DAMAGECOUNT value on done: 69709.0 [2023-02-24 18:12:49,571][177158] Sum rewards: 3.977, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.232', 'ARMOR': '0.016', 'AMMO5': '0.016', 'WEAPON1': '0.030', 'AMMO2': '0.037', 'AMMO3': '0.148', 'AMMO4': '0.183', 'weapon5': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.614', 'HITCOUNT': '0.650', 'weapon2': '0.704', 'WEAPON3': '0.850', 'weapon3': '1.846', 'DAMAGECOUNT': '3.282', 'FRAGCOUNT': '5.500'} [2023-02-24 18:12:50,075][177172] DAMAGECOUNT value on done: 66410.0 [2023-02-24 18:12:50,076][177172] Sum rewards: 3.576, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.430', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'AMMO2': '0.035', 'AMMO3': '0.103', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'HITCOUNT': '0.600', 'weapon4': '0.670', 'WEAPON3': '0.700', 'weapon2': '1.120', 'weapon3': '1.416', 'DAMAGECOUNT': '1.986', 'FRAGCOUNT': '4.000'} [2023-02-24 18:12:50,291][177153] Updated weights for policy 0, policy_version 10230 (0.0008) [2023-02-24 18:12:50,370][177172] DAMAGECOUNT value on done: 65504.0 [2023-02-24 18:12:50,371][177172] Sum rewards: 6.113, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.510', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.033', 'WEAPON1': '0.090', 'weapon5': '0.118', 'AMMO3': '0.146', 'AMMO4': '0.167', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.718', 'HITCOUNT': '0.800', 'WEAPON3': '0.850', 'weapon2': '1.042', 'weapon3': '1.660', 'DAMAGECOUNT': '3.282', 'FRAGCOUNT': '7.000'} [2023-02-24 18:12:50,792][177154] DAMAGECOUNT value on done: 70841.0 [2023-02-24 18:12:50,792][177154] Sum rewards: 8.085, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.690', 'AMMO5': '0.023', 'AMMO2': '0.032', 'weapon7': '0.052', 'WEAPON1': '0.080', 'AMMO3': '0.149', 'AMMO4': '0.159', 'weapon5': '0.176', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON5': '0.600', 'WEAPON4': '0.600', 'weapon4': '0.724', 'HITCOUNT': '0.770', 'WEAPON3': '0.900', 'weapon2': '0.990', 'weapon3': '1.380', 'DAMAGECOUNT': '3.600', 'FRAGCOUNT': '11.000'} [2023-02-24 18:12:51,090][177154] DAMAGECOUNT value on done: 66756.0 [2023-02-24 18:12:51,091][177154] Sum rewards: 3.988, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.102', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON1': '0.050', 'AMMO4': '0.103', 'AMMO3': '0.114', 'WEAPON5': '0.150', 'weapon5': '0.150', 'WEAPON4': '0.250', 'HITCOUNT': '0.350', 'weapon4': '0.466', 'ARMOR': '0.474', 'WEAPON3': '0.700', 'weapon2': '0.790', 'DAMAGECOUNT': '1.365', 'weapon3': '2.102', 'FRAGCOUNT': '4.000'} [2023-02-24 18:12:51,105][177154] DAMAGECOUNT value on done: 68709.0 [2023-02-24 18:12:51,105][177154] Sum rewards: 12.550, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.560', 'AMMO5': '0.019', 'AMMO2': '0.032', 'weapon7': '0.046', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON1': '0.100', 'AMMO4': '0.160', 'weapon5': '0.168', 'AMMO3': '0.186', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon4': '0.618', 'weapon2': '0.662', 'HITCOUNT': '1.130', 'WEAPON3': '1.150', 'weapon3': '2.122', 'DAMAGECOUNT': '5.067', 'FRAGCOUNT': '15.000'} [2023-02-24 18:12:51,268][177172] DAMAGECOUNT value on done: 65994.0 [2023-02-24 18:12:51,268][177172] Sum rewards: 0.100, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.734', 'weapon4': '0.012', 'AMMO2': '0.022', 'AMMO5': '0.025', 'WEAPON4': '0.050', 'AMMO4': '0.108', 'WEAPON1': '0.110', 'AMMO3': '0.178', 'weapon5': '0.240', 'HITCOUNT': '0.490', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'weapon2': '1.274', 'weapon3': '2.060', 'DAMAGECOUNT': '2.265', 'FRAGCOUNT': '4.500'} [2023-02-24 18:12:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14037.5). Total num frames: 41914368. Throughput: 0: 3504.1. Samples: 10472928. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:12:51,376][177119] Avg episode reward: [(0, '5.345')] [2023-02-24 18:12:51,401][177154] DAMAGECOUNT value on done: 67925.0 [2023-02-24 18:12:51,402][177154] Sum rewards: 8.867, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.802', 'AMMO5': '0.012', 'AMMO2': '0.024', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO4': '0.120', 'weapon5': '0.120', 'AMMO3': '0.194', 'weapon4': '0.240', 'WEAPON5': '0.300', 'HITCOUNT': '0.820', 'weapon2': '0.966', 'WEAPON3': '1.200', 'weapon3': '2.296', 'DAMAGECOUNT': '4.257', 'FRAGCOUNT': '12.000'} [2023-02-24 18:12:51,570][177172] DAMAGECOUNT value on done: 66017.0 [2023-02-24 18:12:51,571][177172] Sum rewards: 4.335, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.570', 'AMMO5': '0.007', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'AMMO3': '0.054', 'weapon7': '0.122', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.300', 'WEAPON7': '0.300', 'WEAPON4': '0.450', 'HITCOUNT': '0.450', 'weapon3': '0.700', 'weapon2': '0.738', 'weapon4': '1.280', 'DAMAGECOUNT': '2.076', 'FRAGCOUNT': '5.000'} [2023-02-24 18:12:52,073][177157] DAMAGECOUNT value on done: 67334.0 [2023-02-24 18:12:52,073][177157] Sum rewards: 7.175, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.935', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.060', 'AMMO4': '0.064', 'AMMO3': '0.116', 'weapon5': '0.138', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.510', 'weapon4': '0.540', 'WEAPON3': '0.650', 'weapon2': '1.306', 'weapon3': '1.388', 'DAMAGECOUNT': '2.763', 'FRAGCOUNT': '6.000'} [2023-02-24 18:12:52,084][177157] DAMAGECOUNT value on done: 71014.0 [2023-02-24 18:12:52,084][177157] Sum rewards: 8.999, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.127', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon7': '0.048', 'WEAPON1': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.118', 'AMMO4': '0.152', 'weapon5': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.434', 'HITCOUNT': '0.450', 'WEAPON3': '0.800', 'weapon2': '0.886', 'weapon3': '1.810', 'DAMAGECOUNT': '3.408', 'FRAGCOUNT': '9.000'} [2023-02-24 18:12:52,139][177171] DAMAGECOUNT value on done: 68318.0 [2023-02-24 18:12:52,140][177171] Sum rewards: 5.438, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.514', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'AMMO2': '0.043', 'AMMO3': '0.099', 'WEAPON5': '0.150', 'weapon5': '0.154', 'AMMO4': '0.216', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.550', 'WEAPON3': '0.600', 'weapon4': '0.910', 'weapon2': '1.012', 'weapon3': '1.424', 'DAMAGECOUNT': '2.259', 'FRAGCOUNT': '6.000'} [2023-02-24 18:12:52,380][177157] DAMAGECOUNT value on done: 65536.0 [2023-02-24 18:12:52,380][177157] Sum rewards: 14.170, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.845', 'AMMO2': '0.024', 'AMMO5': '0.024', 'WEAPON1': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.148', 'weapon5': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.398', 'weapon4': '0.586', 'WEAPON5': '0.600', 'HITCOUNT': '0.630', 'WEAPON3': '0.850', 'weapon3': '2.274', 'DAMAGECOUNT': '3.864', 'FRAGCOUNT': '14.000'} [2023-02-24 18:12:52,391][177157] DAMAGECOUNT value on done: 67147.0 [2023-02-24 18:12:52,391][177157] Sum rewards: 9.062, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.811', 'ARMOR': '0.004', 'AMMO2': '0.010', 'AMMO5': '0.010', 'weapon4': '0.034', 'AMMO4': '0.047', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.165', 'weapon5': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.810', 'HITCOUNT': '0.920', 'WEAPON3': '1.050', 'weapon3': '2.536', 'DAMAGECOUNT': '4.485', 'FRAGCOUNT': '10.500'} [2023-02-24 18:12:52,438][177171] DAMAGECOUNT value on done: 67745.0 [2023-02-24 18:12:52,439][177171] Sum rewards: 2.836, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.344', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO2': '0.039', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'AMMO4': '0.196', 'WEAPON4': '0.350', 'weapon4': '0.574', 'weapon2': '0.620', 'HITCOUNT': '0.720', 'WEAPON3': '1.000', 'weapon3': '2.046', 'DAMAGECOUNT': '2.568', 'FRAGCOUNT': '8.000'} [2023-02-24 18:12:52,718][177155] DAMAGECOUNT value on done: 68709.0 [2023-02-24 18:12:52,719][177155] Sum rewards: 3.892, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.140', 'AMMO2': '0.010', 'AMMO4': '0.052', 'AMMO3': '0.059', 'weapon7': '0.126', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon2': '0.248', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'weapon4': '0.764', 'weapon3': '0.838', 'DAMAGECOUNT': '1.485', 'FRAGCOUNT': '2.000'} [2023-02-24 18:12:52,826][177171] DAMAGECOUNT value on done: 66431.0 [2023-02-24 18:12:52,827][177171] Sum rewards: 4.144, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.015', 'AMMO2': '0.032', 'WEAPON4': '0.050', 'weapon7': '0.052', 'WEAPON1': '0.070', 'AMMO3': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.161', 'weapon5': '0.246', 'HEALTH': '0.294', 'WEAPON5': '0.350', 'weapon4': '0.384', 'HITCOUNT': '0.400', 'WEAPON3': '0.500', 'weapon2': '1.358', 'weapon3': '1.514', 'DAMAGECOUNT': '1.830', 'FRAGCOUNT': '2.500'} [2023-02-24 18:12:53,024][177155] DAMAGECOUNT value on done: 70869.0 [2023-02-24 18:12:53,025][177155] Sum rewards: 10.954, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.642', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'weapon7': '0.052', 'WEAPON1': '0.080', 'AMMO3': '0.084', 'AMMO4': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.202', 'WEAPON5': '0.300', 'weapon4': '0.372', 'HITCOUNT': '0.730', 'WEAPON3': '0.750', 'weapon2': '0.860', 'weapon3': '1.870', 'DAMAGECOUNT': '3.330', 'FRAGCOUNT': '9.500'} [2023-02-24 18:12:53,126][177171] DAMAGECOUNT value on done: 66682.0 [2023-02-24 18:12:53,127][177171] Sum rewards: 2.558, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.696', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.022', 'WEAPON1': '0.090', 'AMMO4': '0.112', 'AMMO3': '0.147', 'weapon5': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.446', 'HITCOUNT': '0.630', 'WEAPON3': '0.850', 'weapon2': '1.250', 'weapon3': '1.746', 'DAMAGECOUNT': '2.208', 'FRAGCOUNT': '4.000'} [2023-02-24 18:12:53,237][177153] Updated weights for policy 0, policy_version 10240 (0.0007) [2023-02-24 18:12:53,358][177155] DAMAGECOUNT value on done: 71073.0 [2023-02-24 18:12:53,359][177155] Sum rewards: 1.122, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.198', 'AMMO5': '0.007', 'AMMO2': '0.029', 'WEAPON1': '0.050', 'AMMO4': '0.144', 'weapon5': '0.176', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'ARMOR': '0.428', 'weapon4': '0.522', 'HITCOUNT': '0.740', 'weapon2': '0.810', 'WEAPON3': '1.000', 'weapon3': '2.078', 'DAMAGECOUNT': '3.042', 'FRAGCOUNT': '6.000'} [2023-02-24 18:12:53,654][177155] DAMAGECOUNT value on done: 64471.0 [2023-02-24 18:12:53,654][177155] Sum rewards: 4.946, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.625', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.031', 'WEAPON1': '0.060', 'weapon5': '0.068', 'AMMO3': '0.121', 'AMMO4': '0.157', 'weapon7': '0.164', 'WEAPON4': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON5': '0.400', 'WEAPON7': '0.400', 'HITCOUNT': '0.470', 'weapon2': '0.760', 'WEAPON3': '0.800', 'weapon4': '1.144', 'weapon3': '1.466', 'DAMAGECOUNT': '2.568', 'FRAGCOUNT': '6.000'} [2023-02-24 18:12:56,145][177153] Updated weights for policy 0, policy_version 10250 (0.0009) [2023-02-24 18:12:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.6, 300 sec: 14037.5). Total num frames: 41984000. Throughput: 0: 3504.6. Samples: 10493920. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:12:56,376][177119] Avg episode reward: [(0, '5.666')] [2023-02-24 18:12:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000010250_41984000.pth... [2023-02-24 18:12:56,436][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000009428_38617088.pth [2023-02-24 18:12:58,755][177156] DAMAGECOUNT value on done: 68728.0 [2023-02-24 18:12:58,755][177156] Sum rewards: 10.260, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.250', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.012', 'WEAPON1': '0.050', 'weapon7': '0.056', 'AMMO3': '0.071', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.278', 'weapon5': '0.280', 'WEAPON5': '0.350', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'weapon2': '0.528', 'weapon3': '1.044', 'DAMAGECOUNT': '3.573', 'FRAGCOUNT': '9.000'} [2023-02-24 18:12:58,765][177156] DAMAGECOUNT value on done: 65601.0 [2023-02-24 18:12:58,766][177156] Sum rewards: 10.772, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.009', 'AMMO5': '0.012', 'AMMO2': '0.030', 'WEAPON1': '0.080', 'AMMO3': '0.113', 'AMMO4': '0.150', 'weapon5': '0.240', 'WEAPON4': '0.350', 'weapon4': '0.356', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'HITCOUNT': '0.860', 'weapon2': '1.470', 'weapon3': '1.546', 'DAMAGECOUNT': '3.573', 'FRAGCOUNT': '11.000'} [2023-02-24 18:12:59,055][177153] Updated weights for policy 0, policy_version 10260 (0.0009) [2023-02-24 18:12:59,075][177156] DAMAGECOUNT value on done: 70130.0 [2023-02-24 18:12:59,075][177156] Sum rewards: 2.670, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.647', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.030', 'WEAPON1': '0.040', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.136', 'WEAPON4': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.155', 'WEAPON5': '0.200', 'HITCOUNT': '0.510', 'weapon4': '0.594', 'weapon2': '0.854', 'WEAPON3': '0.900', 'weapon3': '1.702', 'DAMAGECOUNT': '1.764', 'FRAGCOUNT': '5.500'} [2023-02-24 18:12:59,087][177156] DAMAGECOUNT value on done: 68221.0 [2023-02-24 18:12:59,087][177156] Sum rewards: 4.489, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.310', 'AMMO5': '0.013', 'AMMO2': '0.023', 'WEAPON1': '0.090', 'AMMO4': '0.115', 'AMMO3': '0.160', 'weapon5': '0.178', 'WEAPON4': '0.200', 'weapon4': '0.318', 'WEAPON5': '0.400', 'HITCOUNT': '0.740', 'weapon2': '0.856', 'WEAPON3': '1.100', 'weapon3': '2.080', 'DAMAGECOUNT': '2.775', 'FRAGCOUNT': '9.000'} [2023-02-24 18:13:01,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 14023.6). Total num frames: 42053632. Throughput: 0: 3502.5. Samples: 10514916. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:13:01,376][177119] Avg episode reward: [(0, '5.677')] [2023-02-24 18:13:01,993][177153] Updated weights for policy 0, policy_version 10270 (0.0008) [2023-02-24 18:13:04,957][177153] Updated weights for policy 0, policy_version 10280 (0.0009) [2023-02-24 18:13:06,156][177170] DAMAGECOUNT value on done: 69228.0 [2023-02-24 18:13:06,157][177170] Sum rewards: 3.965, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.754', 'AMMO5': '0.015', 'ARMOR': '0.016', 'WEAPON1': '0.050', 'AMMO2': '0.056', 'weapon5': '0.074', 'AMMO3': '0.167', 'weapon4': '0.196', 'AMMO4': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'HITCOUNT': '0.860', 'weapon2': '0.926', 'WEAPON3': '1.050', 'weapon3': '2.444', 'DAMAGECOUNT': '3.387', 'FRAGCOUNT': '7.500'} [2023-02-24 18:13:06,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 14023.6). Total num frames: 42123264. Throughput: 0: 3498.8. Samples: 10525314. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:13:06,376][177119] Avg episode reward: [(0, '5.648')] [2023-02-24 18:13:06,459][177170] DAMAGECOUNT value on done: 72863.0 [2023-02-24 18:13:06,460][177170] Sum rewards: 4.486, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.719', 'AMMO5': '0.020', 'AMMO2': '0.020', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO4': '0.100', 'WEAPON1': '0.110', 'AMMO3': '0.117', 'weapon5': '0.162', 'WEAPON5': '0.550', 'HITCOUNT': '0.590', 'WEAPON3': '0.750', 'weapon3': '1.500', 'weapon2': '1.822', 'DAMAGECOUNT': '2.043', 'FRAGCOUNT': '5.000'} [2023-02-24 18:13:06,473][177170] DAMAGECOUNT value on done: 61608.0 [2023-02-24 18:13:06,473][177170] Sum rewards: 8.409, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.952', 'AMMO5': '0.015', 'AMMO2': '0.026', 'WEAPON1': '0.040', 'weapon5': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'AMMO4': '0.130', 'WEAPON5': '0.300', 'weapon4': '0.346', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '0.870', 'weapon2': '1.034', 'weapon3': '2.308', 'DAMAGECOUNT': '3.120', 'FRAGCOUNT': '8.000'} [2023-02-24 18:13:06,769][177170] DAMAGECOUNT value on done: 71618.0 [2023-02-24 18:13:06,770][177170] Sum rewards: 0.256, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.428', 'AMMO5': '0.010', 'AMMO2': '0.040', 'WEAPON1': '0.050', 'weapon7': '0.050', 'weapon5': '0.072', 'AMMO3': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO4': '0.201', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.370', 'HITCOUNT': '0.490', 'WEAPON3': '0.750', 'weapon2': '1.224', 'weapon3': '1.642', 'DAMAGECOUNT': '1.953', 'FRAGCOUNT': '3.000'} [2023-02-24 18:13:07,310][177158] DAMAGECOUNT value on done: 65001.0 [2023-02-24 18:13:07,311][177158] Sum rewards: 6.358, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.076', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'AMMO4': '0.062', 'WEAPON5': '0.150', 'weapon5': '0.172', 'WEAPON3': '0.200', 'HITCOUNT': '0.260', 'ARMOR': '0.450', 'weapon2': '0.880', 'weapon3': '1.198', 'DAMAGECOUNT': '1.215', 'FRAGCOUNT': '4.000'} [2023-02-24 18:13:07,603][177158] DAMAGECOUNT value on done: 66209.0 [2023-02-24 18:13:07,603][177158] Sum rewards: 9.814, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.200', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.019', 'WEAPON1': '0.070', 'AMMO4': '0.096', 'AMMO3': '0.128', 'weapon5': '0.202', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.662', 'HITCOUNT': '0.720', 'WEAPON3': '0.750', 'weapon2': '0.760', 'weapon3': '1.966', 'DAMAGECOUNT': '3.225', 'FRAGCOUNT': '10.000'} [2023-02-24 18:13:07,898][177153] Updated weights for policy 0, policy_version 10290 (0.0008) [2023-02-24 18:13:08,491][177158] DAMAGECOUNT value on done: 66741.0 [2023-02-24 18:13:08,491][177158] Sum rewards: 7.415, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.950', 'AMMO2': '0.005', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO4': '0.024', 'AMMO3': '0.040', 'weapon7': '0.054', 'WEAPON1': '0.070', 'weapon5': '0.140', 'WEAPON3': '0.300', 'WEAPON4': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON7': '0.400', 'HITCOUNT': '0.400', 'weapon4': '0.788', 'weapon3': '0.942', 'DAMAGECOUNT': '2.040', 'FRAGCOUNT': '6.000'} [2023-02-24 18:13:08,781][177158] DAMAGECOUNT value on done: 70834.0 [2023-02-24 18:13:08,782][177158] Sum rewards: -0.682, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.056', 'ARMOR': '0.012', 'AMMO2': '0.015', 'AMMO5': '0.017', 'WEAPON1': '0.070', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'weapon5': '0.210', 'weapon4': '0.234', 'WEAPON5': '0.400', 'weapon2': '0.602', 'HITCOUNT': '0.800', 'WEAPON3': '1.150', 'FRAGCOUNT': '2.500', 'weapon3': '2.568', 'DAMAGECOUNT': '3.375'} [2023-02-24 18:13:09,279][177172] DAMAGECOUNT value on done: 67639.0 [2023-02-24 18:13:09,279][177172] Sum rewards: 9.376, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.400', 'AMMO5': '0.010', 'AMMO2': '0.039', 'WEAPON1': '0.070', 'AMMO3': '0.100', 'weapon5': '0.182', 'AMMO4': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.294', 'WEAPON3': '0.650', 'HITCOUNT': '0.900', 'weapon2': '1.270', 'weapon3': '1.930', 'DAMAGECOUNT': '3.687', 'FRAGCOUNT': '9.000'} [2023-02-24 18:13:09,587][177172] DAMAGECOUNT value on done: 66590.0 [2023-02-24 18:13:09,588][177172] Sum rewards: 9.338, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.015', 'AMMO2': '0.017', 'HEALTH': '0.019', 'WEAPON1': '0.040', 'weapon4': '0.042', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.134', 'weapon5': '0.234', 'WEAPON5': '0.300', 'HITCOUNT': '0.730', 'WEAPON3': '0.750', 'weapon2': '1.574', 'weapon3': '1.788', 'DAMAGECOUNT': '3.258', 'FRAGCOUNT': '10.000'} [2023-02-24 18:13:10,003][177154] DAMAGECOUNT value on done: 71965.0 [2023-02-24 18:13:10,004][177154] Sum rewards: 6.440, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.804', 'AMMO5': '0.010', 'AMMO2': '0.029', 'WEAPON1': '0.040', 'weapon5': '0.094', 'AMMO3': '0.134', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'weapon4': '0.448', 'HITCOUNT': '0.820', 'WEAPON3': '0.950', 'weapon2': '1.516', 'weapon3': '1.634', 'DAMAGECOUNT': '3.372', 'FRAGCOUNT': '8.000'} [2023-02-24 18:13:10,300][177154] DAMAGECOUNT value on done: 67715.0 [2023-02-24 18:13:10,301][177154] Sum rewards: 9.836, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.626', 'AMMO5': '0.012', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.092', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'weapon5': '0.178', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.550', 'weapon4': '0.714', 'weapon2': '0.922', 'weapon3': '1.216', 'DAMAGECOUNT': '2.877', 'FRAGCOUNT': '7.000'} [2023-02-24 18:13:10,313][177154] DAMAGECOUNT value on done: 69463.0 [2023-02-24 18:13:10,314][177154] Sum rewards: 2.073, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.648', 'AMMO5': '0.012', 'AMMO2': '0.023', 'WEAPON1': '0.050', 'weapon5': '0.062', 'AMMO4': '0.115', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.366', 'HITCOUNT': '0.620', 'weapon2': '0.790', 'WEAPON3': '1.000', 'DAMAGECOUNT': '2.262', 'weapon3': '2.550', 'FRAGCOUNT': '4.000'} [2023-02-24 18:13:10,508][177172] DAMAGECOUNT value on done: 67097.0 [2023-02-24 18:13:10,508][177172] Sum rewards: 0.619, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.954', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO2': '0.035', 'ARMOR': '0.040', 'weapon7': '0.070', 'AMMO3': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.173', 'WEAPON4': '0.200', 'weapon5': '0.210', 'weapon4': '0.332', 'HITCOUNT': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.238', 'weapon3': '1.330', 'DAMAGECOUNT': '1.809', 'FRAGCOUNT': '2.000'} [2023-02-24 18:13:10,606][177154] DAMAGECOUNT value on done: 68228.0 [2023-02-24 18:13:10,606][177154] Sum rewards: 2.524, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.324', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon7': '0.046', 'WEAPON1': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.214', 'HITCOUNT': '0.260', 'weapon4': '0.356', 'WEAPON3': '0.400', 'weapon2': '0.870', 'DAMAGECOUNT': '0.879', 'weapon3': '0.976', 'FRAGCOUNT': '3.000'} [2023-02-24 18:13:10,811][177172] DAMAGECOUNT value on done: 66556.0 [2023-02-24 18:13:10,812][177172] Sum rewards: 1.054, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.192', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.022', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO3': '0.089', 'AMMO4': '0.109', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.330', 'WEAPON4': '0.400', 'WEAPON3': '0.600', 'weapon4': '0.666', 'weapon2': '0.928', 'weapon3': '1.032', 'DAMAGECOUNT': '1.617', 'FRAGCOUNT': '4.000'} [2023-02-24 18:13:10,835][177153] Updated weights for policy 0, policy_version 10300 (0.0009) [2023-02-24 18:13:11,371][177157] DAMAGECOUNT value on done: 68545.0 [2023-02-24 18:13:11,372][177157] Sum rewards: 4.007, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.545', 'AMMO5': '0.015', 'AMMO2': '0.049', 'WEAPON1': '0.070', 'AMMO3': '0.172', 'AMMO4': '0.247', 'weapon5': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.480', 'weapon4': '0.520', 'HITCOUNT': '0.810', 'WEAPON3': '1.050', 'weapon3': '2.258', 'DAMAGECOUNT': '3.633', 'FRAGCOUNT': '6.500'} [2023-02-24 18:13:11,376][177119] Fps is (10 sec: 13926.0, 60 sec: 13994.6, 300 sec: 14023.6). Total num frames: 42192896. Throughput: 0: 3495.2. Samples: 10546220. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:13:11,377][177119] Avg episode reward: [(0, '5.658')] [2023-02-24 18:13:11,386][177157] DAMAGECOUNT value on done: 72336.0 [2023-02-24 18:13:11,387][177157] Sum rewards: 8.444, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.098', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon7': '0.068', 'WEAPON1': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.130', 'AMMO4': '0.156', 'AMMO3': '0.161', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.460', 'weapon4': '0.540', 'WEAPON3': '1.000', 'HITCOUNT': '1.010', 'weapon3': '2.034', 'DAMAGECOUNT': '3.966', 'FRAGCOUNT': '11.000'} [2023-02-24 18:13:11,427][177171] DAMAGECOUNT value on done: 69306.0 [2023-02-24 18:13:11,427][177171] Sum rewards: 7.319, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.017', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.085', 'AMMO4': '0.126', 'HEALTH': '0.251', 'weapon5': '0.310', 'weapon4': '0.348', 'WEAPON5': '0.350', 'HITCOUNT': '0.460', 'WEAPON3': '0.550', 'weapon2': '1.188', 'weapon3': '1.284', 'DAMAGECOUNT': '2.964', 'FRAGCOUNT': '6.000'} [2023-02-24 18:13:11,685][177157] DAMAGECOUNT value on done: 66959.0 [2023-02-24 18:13:11,685][177157] Sum rewards: 9.102, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.062', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.029', 'WEAPON1': '0.090', 'AMMO3': '0.122', 'AMMO4': '0.145', 'weapon5': '0.236', 'WEAPON4': '0.250', 'weapon4': '0.536', 'WEAPON5': '0.600', 'weapon2': '0.756', 'WEAPON3': '0.800', 'HITCOUNT': '0.800', 'weapon3': '1.934', 'DAMAGECOUNT': '4.089', 'FRAGCOUNT': '9.500'} [2023-02-24 18:13:11,694][177157] DAMAGECOUNT value on done: 67979.0 [2023-02-24 18:13:11,694][177157] Sum rewards: 3.680, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.220', 'AMMO5': '0.015', 'AMMO2': '0.045', 'WEAPON1': '0.060', 'AMMO3': '0.145', 'weapon5': '0.208', 'AMMO4': '0.227', 'weapon4': '0.384', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'HITCOUNT': '0.630', 'WEAPON3': '0.950', 'weapon2': '1.362', 'weapon3': '1.778', 'DAMAGECOUNT': '2.496', 'FRAGCOUNT': '8.000'} [2023-02-24 18:13:11,724][177171] DAMAGECOUNT value on done: 68839.0 [2023-02-24 18:13:11,725][177171] Sum rewards: 5.048, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.846', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.059', 'WEAPON1': '0.060', 'AMMO3': '0.108', 'weapon4': '0.162', 'weapon5': '0.252', 'AMMO4': '0.297', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'HITCOUNT': '0.570', 'WEAPON3': '0.800', 'weapon2': '1.150', 'weapon3': '2.024', 'DAMAGECOUNT': '3.282', 'FRAGCOUNT': '7.000'} [2023-02-24 18:13:12,037][177155] DAMAGECOUNT value on done: 69799.0 [2023-02-24 18:13:12,038][177155] Sum rewards: 10.189, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.177', 'AMMO5': '0.005', 'AMMO2': '0.007', 'WEAPON1': '0.030', 'AMMO4': '0.033', 'weapon7': '0.048', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.304', 'WEAPON3': '0.650', 'HITCOUNT': '0.680', 'weapon2': '0.902', 'weapon3': '1.540', 'DAMAGECOUNT': '3.270', 'FRAGCOUNT': '9.000'} [2023-02-24 18:13:12,114][177171] DAMAGECOUNT value on done: 67626.0 [2023-02-24 18:13:12,115][177171] Sum rewards: 5.940, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.144', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.050', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'weapon4': '0.120', 'AMMO3': '0.152', 'weapon5': '0.202', 'WEAPON5': '0.250', 'HITCOUNT': '0.930', 'WEAPON3': '0.950', 'weapon2': '1.208', 'weapon3': '2.178', 'DAMAGECOUNT': '3.585', 'FRAGCOUNT': '7.000'} [2023-02-24 18:13:12,339][177155] DAMAGECOUNT value on done: 71979.0 [2023-02-24 18:13:12,339][177155] Sum rewards: 5.953, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.026', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'weapon5': '0.046', 'weapon7': '0.064', 'AMMO4': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.278', 'weapon4': '0.394', 'HITCOUNT': '0.880', 'WEAPON3': '0.900', 'weapon3': '1.892', 'DAMAGECOUNT': '3.330', 'FRAGCOUNT': '8.500'} [2023-02-24 18:13:12,409][177171] DAMAGECOUNT value on done: 67630.0 [2023-02-24 18:13:12,410][177171] Sum rewards: 3.775, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.076', 'ARMOR': '0.012', 'AMMO5': '0.016', 'WEAPON1': '0.030', 'AMMO2': '0.037', 'AMMO3': '0.104', 'weapon5': '0.134', 'AMMO4': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.670', 'weapon4': '0.684', 'WEAPON3': '0.700', 'weapon2': '1.214', 'weapon3': '1.574', 'DAMAGECOUNT': '2.844', 'FRAGCOUNT': '5.000'} [2023-02-24 18:13:12,651][177155] DAMAGECOUNT value on done: 71726.0 [2023-02-24 18:13:12,652][177155] Sum rewards: 3.855, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.552', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.031', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'AMMO4': '0.154', 'weapon5': '0.174', 'WEAPON5': '0.250', 'weapon4': '0.278', 'HITCOUNT': '0.610', 'WEAPON3': '0.850', 'weapon2': '1.406', 'weapon3': '1.898', 'DAMAGECOUNT': '1.959', 'FRAGCOUNT': '4.000'} [2023-02-24 18:13:12,951][177155] DAMAGECOUNT value on done: 65639.0 [2023-02-24 18:13:12,951][177155] Sum rewards: 14.366, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.426', 'AMMO5': '0.007', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'AMMO3': '0.101', 'weapon7': '0.114', 'AMMO4': '0.122', 'weapon5': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.420', 'weapon2': '0.452', 'WEAPON3': '0.600', 'HITCOUNT': '0.840', 'weapon3': '1.400', 'DAMAGECOUNT': '3.504', 'FRAGCOUNT': '12.000'} [2023-02-24 18:13:13,297][177155] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200.0), ('weapon7', 0.002)] [2023-02-24 18:13:13,766][177153] Updated weights for policy 0, policy_version 10310 (0.0009) [2023-02-24 18:13:14,208][177155] Large shaping reward 2.641 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO2', -0.0001, -1.0), ('AMMO4', -0.0005, -1.0), ('weapon4', 0.002)] [2023-02-24 18:13:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14023.6). Total num frames: 42262528. Throughput: 0: 3495.6. Samples: 10567218. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:13:16,376][177119] Avg episode reward: [(0, '5.858')] [2023-02-24 18:13:16,710][177153] Updated weights for policy 0, policy_version 10320 (0.0008) [2023-02-24 18:13:18,040][177156] DAMAGECOUNT value on done: 69163.0 [2023-02-24 18:13:18,040][177156] Sum rewards: 0.962, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'ARMOR': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'HEALTH': '0.112', 'weapon5': '0.118', 'AMMO3': '0.134', 'WEAPON4': '0.300', 'HITCOUNT': '0.430', 'weapon4': '0.532', 'WEAPON3': '0.650', 'weapon2': '1.012', 'DAMAGECOUNT': '1.305', 'weapon3': '2.042', 'FRAGCOUNT': '3.000'} [2023-02-24 18:13:18,051][177156] DAMAGECOUNT value on done: 66759.0 [2023-02-24 18:13:18,052][177156] Sum rewards: 5.088, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.940', 'ARMOR': '0.016', 'AMMO5': '0.017', 'AMMO2': '0.025', 'WEAPON1': '0.050', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.154', 'weapon4': '0.178', 'weapon5': '0.196', 'WEAPON5': '0.400', 'HITCOUNT': '0.840', 'weapon2': '0.914', 'WEAPON3': '0.950', 'weapon3': '2.292', 'DAMAGECOUNT': '3.474', 'FRAGCOUNT': '6.000'} [2023-02-24 18:13:18,348][177156] DAMAGECOUNT value on done: 71117.0 [2023-02-24 18:13:18,349][177156] Sum rewards: 3.571, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.079', 'AMMO5': '0.015', 'AMMO2': '0.026', 'WEAPON1': '0.090', 'AMMO4': '0.131', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'weapon5': '0.170', 'weapon4': '0.344', 'WEAPON5': '0.400', 'HITCOUNT': '0.810', 'WEAPON3': '0.850', 'weapon2': '1.162', 'weapon3': '1.908', 'DAMAGECOUNT': '2.961', 'FRAGCOUNT': '6.000'} [2023-02-24 18:13:18,360][177156] DAMAGECOUNT value on done: 69376.0 [2023-02-24 18:13:18,360][177156] Sum rewards: 8.106, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.360', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.027', 'weapon7': '0.048', 'WEAPON1': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.125', 'AMMO4': '0.135', 'weapon5': '0.164', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.376', 'WEAPON5': '0.400', 'weapon2': '0.768', 'WEAPON3': '0.950', 'HITCOUNT': '1.010', 'weapon3': '2.244', 'DAMAGECOUNT': '3.465', 'FRAGCOUNT': '9.000'} [2023-02-24 18:13:19,641][177153] Updated weights for policy 0, policy_version 10330 (0.0008) [2023-02-24 18:13:21,376][177119] Fps is (10 sec: 13926.8, 60 sec: 13926.4, 300 sec: 14023.6). Total num frames: 42332160. Throughput: 0: 3494.7. Samples: 10577650. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:13:21,376][177119] Avg episode reward: [(0, '5.636')] [2023-02-24 18:13:22,564][177153] Updated weights for policy 0, policy_version 10340 (0.0008) [2023-02-24 18:13:25,316][177170] DAMAGECOUNT value on done: 69838.0 [2023-02-24 18:13:25,317][177170] Sum rewards: 3.726, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.558', 'AMMO5': '0.005', 'AMMO2': '0.007', 'WEAPON1': '0.030', 'AMMO4': '0.034', 'weapon7': '0.090', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'weapon4': '0.612', 'weapon2': '0.878', 'weapon3': '1.562', 'DAMAGECOUNT': '1.830', 'FRAGCOUNT': '4.000'} [2023-02-24 18:13:25,484][177153] Updated weights for policy 0, policy_version 10350 (0.0009) [2023-02-24 18:13:25,620][177170] DAMAGECOUNT value on done: 73812.0 [2023-02-24 18:13:25,620][177170] Sum rewards: 8.635, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.119', 'weapon5': '0.132', 'WEAPON5': '0.150', 'HEALTH': '0.227', 'AMMO4': '0.249', 'WEAPON4': '0.350', 'ARMOR': '0.416', 'weapon4': '0.602', 'WEAPON3': '0.650', 'HITCOUNT': '0.680', 'weapon2': '1.002', 'weapon3': '1.834', 'DAMAGECOUNT': '2.847', 'FRAGCOUNT': '8.000'} [2023-02-24 18:13:25,692][177170] DAMAGECOUNT value on done: 62298.0 [2023-02-24 18:13:25,692][177170] Sum rewards: 5.802, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.412', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.086', 'WEAPON4': '0.350', 'HITCOUNT': '0.390', 'WEAPON3': '0.650', 'weapon2': '0.870', 'weapon4': '0.938', 'ARMOR': '1.027', 'weapon3': '1.478', 'DAMAGECOUNT': '2.070', 'FRAGCOUNT': '6.000'} [2023-02-24 18:13:26,002][177170] DAMAGECOUNT value on done: 72843.0 [2023-02-24 18:13:26,002][177170] Sum rewards: 7.724, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.150', 'AMMO5': '0.005', 'AMMO2': '0.009', 'ARMOR': '0.036', 'AMMO4': '0.046', 'WEAPON1': '0.060', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.121', 'weapon7': '0.146', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'WEAPON7': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '0.750', 'weapon4': '0.878', 'weapon2': '0.890', 'weapon3': '1.632', 'DAMAGECOUNT': '3.675', 'FRAGCOUNT': '9.000'} [2023-02-24 18:13:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 14023.6). Total num frames: 42401792. Throughput: 0: 3495.6. Samples: 10598750. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:13:26,376][177119] Avg episode reward: [(0, '5.646')] [2023-02-24 18:13:26,431][177158] DAMAGECOUNT value on done: 65885.0 [2023-02-24 18:13:26,432][177158] Sum rewards: 7.941, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.644', 'AMMO2': '0.001', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.005', 'WEAPON1': '0.050', 'weapon5': '0.096', 'AMMO3': '0.097', 'WEAPON5': '0.150', 'HITCOUNT': '0.570', 'WEAPON3': '0.700', 'weapon3': '1.736', 'weapon2': '1.768', 'DAMAGECOUNT': '2.652', 'FRAGCOUNT': '9.000'} [2023-02-24 18:13:26,732][177158] DAMAGECOUNT value on done: 67315.0 [2023-02-24 18:13:26,733][177158] Sum rewards: 9.577, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.144', 'AMMO5': '0.015', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'weapon7': '0.064', 'AMMO4': '0.099', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.123', 'weapon5': '0.132', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.334', 'WEAPON5': '0.350', 'HITCOUNT': '0.630', 'WEAPON3': '0.750', 'weapon2': '1.364', 'weapon3': '1.792', 'DAMAGECOUNT': '3.318', 'FRAGCOUNT': '10.000'} [2023-02-24 18:13:27,729][177158] DAMAGECOUNT value on done: 67276.0 [2023-02-24 18:13:27,729][177158] Sum rewards: 6.260, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.976', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'weapon7': '0.048', 'weapon5': '0.052', 'AMMO3': '0.066', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'weapon4': '0.414', 'weapon3': '1.142', 'weapon2': '1.150', 'DAMAGECOUNT': '1.605', 'FRAGCOUNT': '5.000'} [2023-02-24 18:13:28,028][177158] DAMAGECOUNT value on done: 71575.0 [2023-02-24 18:13:28,028][177158] Sum rewards: 3.937, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.128', 'AMMO5': '0.025', 'weapon7': '0.048', 'AMMO2': '0.048', 'WEAPON1': '0.070', 'AMMO3': '0.104', 'AMMO4': '0.241', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'weapon5': '0.312', 'HITCOUNT': '0.400', 'ARMOR': '0.416', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon4': '0.706', 'weapon2': '0.856', 'weapon3': '1.566', 'DAMAGECOUNT': '2.223', 'FRAGCOUNT': '3.000'} [2023-02-24 18:13:28,418][177153] Updated weights for policy 0, policy_version 10360 (0.0008) [2023-02-24 18:13:28,551][177172] DAMAGECOUNT value on done: 68481.0 [2023-02-24 18:13:28,551][177172] Sum rewards: 2.880, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.190', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.040', 'AMMO4': '0.054', 'weapon5': '0.074', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'HITCOUNT': '0.670', 'WEAPON3': '0.950', 'weapon2': '1.336', 'weapon3': '2.286', 'DAMAGECOUNT': '2.526', 'FRAGCOUNT': '4.000'} [2023-02-24 18:13:28,856][177172] DAMAGECOUNT value on done: 67355.0 [2023-02-24 18:13:28,856][177172] Sum rewards: 5.833, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.464', 'AMMO5': '0.005', 'weapon5': '0.006', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'weapon7': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'AMMO4': '0.165', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.540', 'WEAPON3': '0.750', 'weapon2': '0.774', 'ARMOR': '0.897', 'weapon4': '0.968', 'weapon3': '1.196', 'DAMAGECOUNT': '2.295', 'FRAGCOUNT': '6.000'} [2023-02-24 18:13:29,206][177154] DAMAGECOUNT value on done: 73190.0 [2023-02-24 18:13:29,207][177154] Sum rewards: 4.349, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.078', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'WEAPON1': '0.050', 'weapon7': '0.058', 'AMMO3': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'HITCOUNT': '0.430', 'weapon4': '0.506', 'weapon3': '0.802', 'weapon2': '1.142', 'DAMAGECOUNT': '2.175', 'FRAGCOUNT': '4.000'} [2023-02-24 18:13:29,508][177154] DAMAGECOUNT value on done: 70916.0 [2023-02-24 18:13:29,508][177154] Sum rewards: 12.628, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.372', 'AMMO5': '0.015', 'AMMO2': '0.025', 'weapon7': '0.052', 'WEAPON1': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.123', 'AMMO4': '0.124', 'weapon5': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.498', 'weapon4': '0.598', 'weapon2': '0.778', 'WEAPON3': '0.850', 'HITCOUNT': '0.970', 'weapon3': '1.684', 'DAMAGECOUNT': '4.359', 'FRAGCOUNT': '11.000'} [2023-02-24 18:13:29,517][177154] DAMAGECOUNT value on done: 68455.0 [2023-02-24 18:13:29,517][177154] Sum rewards: 4.429, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.220', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.034', 'WEAPON1': '0.040', 'weapon7': '0.064', 'weapon5': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'AMMO4': '0.168', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.510', 'weapon2': '0.534', 'weapon4': '0.556', 'WEAPON3': '0.650', 'weapon3': '1.998', 'DAMAGECOUNT': '2.220', 'FRAGCOUNT': '5.000'} [2023-02-24 18:13:29,810][177172] DAMAGECOUNT value on done: 68778.0 [2023-02-24 18:13:29,810][177172] Sum rewards: 13.238, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.006', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'AMMO4': '0.070', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'weapon5': '0.224', 'WEAPON5': '0.250', 'weapon2': '0.480', 'weapon4': '0.574', 'WEAPON3': '0.850', 'HITCOUNT': '1.230', 'weapon3': '2.186', 'DAMAGECOUNT': '5.043', 'FRAGCOUNT': '12.000'} [2023-02-24 18:13:29,816][177154] DAMAGECOUNT value on done: 69381.0 [2023-02-24 18:13:29,817][177154] Sum rewards: 9.347, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.244', 'AMMO5': '0.016', 'AMMO2': '0.030', 'ARMOR': '0.048', 'WEAPON1': '0.080', 'weapon7': '0.092', 'AMMO3': '0.108', 'AMMO4': '0.148', 'weapon5': '0.162', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '0.850', 'HITCOUNT': '0.910', 'weapon4': '1.304', 'weapon3': '1.594', 'DAMAGECOUNT': '3.459', 'FRAGCOUNT': '9.000'} [2023-02-24 18:13:30,116][177172] DAMAGECOUNT value on done: 68188.0 [2023-02-24 18:13:30,116][177172] Sum rewards: 16.997, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.204', 'AMMO5': '0.005', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'weapon7': '0.046', 'AMMO4': '0.068', 'weapon5': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'weapon4': '0.626', 'weapon2': '0.640', 'WEAPON3': '0.800', 'HITCOUNT': '1.180', 'weapon3': '1.890', 'DAMAGECOUNT': '4.896', 'FRAGCOUNT': '16.000'} [2023-02-24 18:13:30,587][177157] DAMAGECOUNT value on done: 69245.0 [2023-02-24 18:13:30,588][177157] Sum rewards: 6.709, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.139', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'AMMO5': '0.012', 'weapon5': '0.050', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'weapon7': '0.106', 'AMMO3': '0.127', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.300', 'weapon4': '0.368', 'WEAPON7': '0.400', 'HITCOUNT': '0.500', 'WEAPON3': '0.750', 'weapon2': '0.830', 'DAMAGECOUNT': '2.100', 'weapon3': '2.154', 'FRAGCOUNT': '7.000'} [2023-02-24 18:13:30,599][177157] DAMAGECOUNT value on done: 73381.0 [2023-02-24 18:13:30,600][177157] Sum rewards: 1.074, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.272', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon7': '0.096', 'AMMO4': '0.119', 'AMMO3': '0.163', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'weapon4': '0.340', 'HITCOUNT': '0.860', 'WEAPON3': '0.950', 'weapon2': '1.510', 'weapon3': '1.832', 'DAMAGECOUNT': '3.135', 'FRAGCOUNT': '5.000'} [2023-02-24 18:13:30,663][177171] DAMAGECOUNT value on done: 69531.0 [2023-02-24 18:13:30,663][177171] Sum rewards: 1.523, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.486', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'weapon5': '0.044', 'AMMO4': '0.073', 'weapon7': '0.074', 'AMMO3': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'WEAPON5': '0.250', 'ARMOR': '0.454', 'WEAPON3': '0.600', 'weapon4': '0.614', 'DAMAGECOUNT': '0.675', 'weapon2': '1.196', 'weapon3': '1.278', 'FRAGCOUNT': '2.000'} [2023-02-24 18:13:30,891][177157] DAMAGECOUNT value on done: 67609.0 [2023-02-24 18:13:30,891][177157] Sum rewards: 5.576, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.475', 'AMMO5': '0.022', 'AMMO2': '0.030', 'weapon7': '0.046', 'weapon4': '0.070', 'WEAPON1': '0.090', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.149', 'weapon5': '0.194', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'HITCOUNT': '0.480', 'WEAPON3': '0.750', 'weapon2': '1.294', 'weapon3': '1.938', 'DAMAGECOUNT': '1.950', 'FRAGCOUNT': '5.000'} [2023-02-24 18:13:30,902][177157] DAMAGECOUNT value on done: 68924.0 [2023-02-24 18:13:30,902][177157] Sum rewards: 4.653, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.380', 'ARMOR': '0.016', 'AMMO2': '0.017', 'AMMO5': '0.020', 'WEAPON1': '0.050', 'weapon5': '0.056', 'weapon7': '0.056', 'AMMO4': '0.083', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.144', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.728', 'HITCOUNT': '0.790', 'WEAPON3': '0.900', 'weapon2': '1.034', 'weapon3': '1.764', 'DAMAGECOUNT': '2.835', 'FRAGCOUNT': '7.000'} [2023-02-24 18:13:30,956][177171] DAMAGECOUNT value on done: 69876.0 [2023-02-24 18:13:30,957][177171] Sum rewards: 3.581, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.109', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.038', 'WEAPON1': '0.070', 'weapon5': '0.164', 'AMMO4': '0.188', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.400', 'HITCOUNT': '0.700', 'weapon2': '0.712', 'WEAPON3': '1.150', 'weapon3': '2.286', 'DAMAGECOUNT': '3.102', 'FRAGCOUNT': '8.000'} [2023-02-24 18:13:31,250][177171] DAMAGECOUNT value on done: 68486.0 [2023-02-24 18:13:31,250][177171] Sum rewards: 11.038, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.010', 'ARMOR': '0.015', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'weapon5': '0.074', 'AMMO4': '0.106', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.230', 'HITCOUNT': '0.690', 'WEAPON3': '0.700', 'HEALTH': '0.946', 'weapon2': '1.654', 'weapon3': '1.754', 'DAMAGECOUNT': '2.580', 'FRAGCOUNT': '10.000'} [2023-02-24 18:13:31,259][177155] DAMAGECOUNT value on done: 71324.0 [2023-02-24 18:13:31,260][177155] Sum rewards: 12.640, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.392', 'AMMO5': '0.010', 'AMMO2': '0.026', 'WEAPON1': '0.050', 'weapon5': '0.066', 'weapon7': '0.094', 'AMMO3': '0.120', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.470', 'weapon2': '0.726', 'WEAPON3': '0.800', 'weapon4': '0.896', 'HITCOUNT': '1.020', 'weapon3': '1.500', 'DAMAGECOUNT': '4.575', 'FRAGCOUNT': '10.000'} [2023-02-24 18:13:31,350][177153] Updated weights for policy 0, policy_version 10370 (0.0008) [2023-02-24 18:13:31,376][177119] Fps is (10 sec: 14335.8, 60 sec: 13994.7, 300 sec: 14037.5). Total num frames: 42475520. Throughput: 0: 3490.9. Samples: 10619604. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:13:31,376][177119] Avg episode reward: [(0, '5.906')] [2023-02-24 18:13:31,542][177171] DAMAGECOUNT value on done: 68432.0 [2023-02-24 18:13:31,542][177171] Sum rewards: 5.616, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.810', 'AMMO2': '0.005', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO4': '0.024', 'WEAPON1': '0.060', 'weapon7': '0.074', 'AMMO3': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.188', 'WEAPON7': '0.200', 'weapon4': '0.370', 'WEAPON5': '0.450', 'HITCOUNT': '0.490', 'WEAPON3': '0.650', 'weapon2': '0.970', 'weapon3': '2.014', 'DAMAGECOUNT': '2.406', 'FRAGCOUNT': '5.500'} [2023-02-24 18:13:31,555][177155] DAMAGECOUNT value on done: 72833.0 [2023-02-24 18:13:31,556][177155] Sum rewards: 5.186, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.300', 'AMMO5': '0.007', 'AMMO2': '0.015', 'ARMOR': '0.016', 'WEAPON1': '0.040', 'AMMO4': '0.075', 'AMMO3': '0.077', 'weapon7': '0.118', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'HITCOUNT': '0.380', 'WEAPON3': '0.450', 'weapon5': '0.602', 'weapon4': '0.682', 'weapon2': '0.918', 'weapon3': '1.328', 'DAMAGECOUNT': '2.337', 'FRAGCOUNT': '5.000'} [2023-02-24 18:13:31,842][177155] DAMAGECOUNT value on done: 72644.0 [2023-02-24 18:13:31,843][177155] Sum rewards: 9.771, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.065', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'ARMOR': '0.024', 'WEAPON1': '0.030', 'weapon7': '0.046', 'AMMO3': '0.070', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'weapon2': '0.602', 'HITCOUNT': '0.700', 'weapon4': '0.790', 'weapon3': '1.664', 'DAMAGECOUNT': '2.754', 'FRAGCOUNT': '8.000'} [2023-02-24 18:13:32,143][177155] DAMAGECOUNT value on done: 66529.0 [2023-02-24 18:13:32,143][177155] Sum rewards: 3.880, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.330', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.006', 'WEAPON1': '0.030', 'AMMO3': '0.081', 'weapon5': '0.096', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.498', 'ARMOR': '0.520', 'HITCOUNT': '0.620', 'WEAPON3': '0.650', 'weapon2': '1.016', 'weapon3': '1.666', 'DAMAGECOUNT': '2.670', 'FRAGCOUNT': '3.000'} [2023-02-24 18:13:33,587][177155] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:13:34,232][177153] Updated weights for policy 0, policy_version 10380 (0.0009) [2023-02-24 18:13:36,376][177119] Fps is (10 sec: 14336.0, 60 sec: 13994.7, 300 sec: 14023.6). Total num frames: 42545152. Throughput: 0: 3495.2. Samples: 10630212. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:13:36,376][177119] Avg episode reward: [(0, '6.035')] [2023-02-24 18:13:37,165][177153] Updated weights for policy 0, policy_version 10390 (0.0008) [2023-02-24 18:13:37,237][177156] DAMAGECOUNT value on done: 70210.0 [2023-02-24 18:13:37,237][177156] Sum rewards: 4.963, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.801', 'AMMO5': '0.023', 'AMMO2': '0.047', 'WEAPON1': '0.100', 'AMMO3': '0.119', 'weapon4': '0.170', 'AMMO4': '0.237', 'WEAPON4': '0.250', 'weapon5': '0.264', 'HITCOUNT': '0.540', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'weapon2': '1.260', 'weapon3': '1.912', 'DAMAGECOUNT': '3.141', 'FRAGCOUNT': '7.000'} [2023-02-24 18:13:37,248][177156] DAMAGECOUNT value on done: 67212.0 [2023-02-24 18:13:37,249][177156] Sum rewards: 3.694, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO3': '0.060', 'AMMO4': '0.090', 'weapon7': '0.096', 'WEAPON4': '0.150', 'weapon5': '0.198', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.300', 'ARMOR': '0.409', 'HITCOUNT': '0.430', 'weapon4': '0.572', 'weapon2': '0.666', 'HEALTH': '0.848', 'weapon3': '1.288', 'DAMAGECOUNT': '1.359', 'FRAGCOUNT': '1.500'} [2023-02-24 18:13:37,546][177156] DAMAGECOUNT value on done: 72130.0 [2023-02-24 18:13:37,546][177156] Sum rewards: 6.680, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.211', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.085', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.135', 'weapon5': '0.158', 'WEAPON5': '0.200', 'weapon4': '0.260', 'ARMOR': '0.464', 'weapon2': '0.712', 'HITCOUNT': '0.730', 'WEAPON3': '0.900', 'weapon3': '1.754', 'DAMAGECOUNT': '3.039', 'FRAGCOUNT': '8.000'} [2023-02-24 18:13:37,557][177156] DAMAGECOUNT value on done: 70251.0 [2023-02-24 18:13:37,557][177156] Sum rewards: -0.467, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.869', 'AMMO5': '0.014', 'weapon7': '0.046', 'AMMO2': '0.051', 'WEAPON1': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.128', 'AMMO3': '0.157', 'AMMO4': '0.256', 'WEAPON5': '0.300', 'ARMOR': '0.458', 'WEAPON4': '0.500', 'weapon2': '0.560', 'HITCOUNT': '0.730', 'weapon4': '0.842', 'WEAPON3': '0.900', 'weapon3': '1.974', 'DAMAGECOUNT': '2.625', 'FRAGCOUNT': '3.500'} [2023-02-24 18:13:40,074][177153] Updated weights for policy 0, policy_version 10400 (0.0008) [2023-02-24 18:13:40,690][177155] Large shaping reward 2.529 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.507, 169.0), ('weapon7', 0.002)] [2023-02-24 18:13:41,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13994.7, 300 sec: 14023.6). Total num frames: 42614784. Throughput: 0: 3494.6. Samples: 10651176. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:13:41,376][177119] Avg episode reward: [(0, '6.079')] [2023-02-24 18:13:43,012][177153] Updated weights for policy 0, policy_version 10410 (0.0008) [2023-02-24 18:13:44,464][177170] DAMAGECOUNT value on done: 70586.0 [2023-02-24 18:13:44,465][177170] Sum rewards: 3.512, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.850', 'AMMO5': '0.004', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon5': '0.052', 'weapon7': '0.064', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.124', 'AMMO3': '0.125', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'ARMOR': '0.452', 'HITCOUNT': '0.590', 'weapon4': '0.628', 'WEAPON3': '0.750', 'weapon2': '0.968', 'weapon3': '1.626', 'DAMAGECOUNT': '2.244', 'FRAGCOUNT': '5.000'} [2023-02-24 18:13:44,761][177170] DAMAGECOUNT value on done: 74928.0 [2023-02-24 18:13:44,762][177170] Sum rewards: 9.161, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.650', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON1': '0.050', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon5': '0.166', 'weapon4': '0.182', 'WEAPON5': '0.250', 'HITCOUNT': '0.760', 'WEAPON3': '0.900', 'weapon2': '1.228', 'weapon3': '2.106', 'DAMAGECOUNT': '3.348', 'FRAGCOUNT': '9.000'} [2023-02-24 18:13:44,882][177170] DAMAGECOUNT value on done: 63823.0 [2023-02-24 18:13:44,882][177170] Sum rewards: 11.625, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.866', 'AMMO2': '0.010', 'AMMO5': '0.011', 'WEAPON1': '0.040', 'AMMO4': '0.051', 'AMMO3': '0.145', 'WEAPON4': '0.250', 'weapon5': '0.286', 'WEAPON5': '0.300', 'ARMOR': '0.477', 'weapon4': '0.516', 'weapon2': '0.838', 'WEAPON3': '0.950', 'HITCOUNT': '0.980', 'weapon3': '2.062', 'DAMAGECOUNT': '4.575', 'FRAGCOUNT': '11.000'} [2023-02-24 18:13:45,186][177170] DAMAGECOUNT value on done: 73273.0 [2023-02-24 18:13:45,187][177170] Sum rewards: 2.636, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.566', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO2': '0.041', 'ARMOR': '0.048', 'weapon5': '0.072', 'weapon7': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.138', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'AMMO4': '0.205', 'weapon2': '0.322', 'HITCOUNT': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '0.800', 'weapon4': '0.878', 'DAMAGECOUNT': '1.290', 'weapon3': '2.018', 'FRAGCOUNT': '3.000'} [2023-02-24 18:13:45,703][177158] DAMAGECOUNT value on done: 66875.0 [2023-02-24 18:13:45,704][177158] Sum rewards: 2.946, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.466', 'AMMO5': '0.013', 'AMMO2': '0.015', 'ARMOR': '0.028', 'WEAPON1': '0.030', 'AMMO4': '0.075', 'weapon7': '0.078', 'weapon5': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.142', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.318', 'HITCOUNT': '0.650', 'weapon4': '0.686', 'WEAPON3': '0.950', 'weapon3': '2.114', 'DAMAGECOUNT': '2.970', 'FRAGCOUNT': '5.000'} [2023-02-24 18:13:45,942][177153] Updated weights for policy 0, policy_version 10420 (0.0008) [2023-02-24 18:13:46,000][177158] DAMAGECOUNT value on done: 67395.0 [2023-02-24 18:13:46,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 14023.6). Total num frames: 42684416. Throughput: 0: 3495.9. Samples: 10672230. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:13:46,376][177119] Avg episode reward: [(0, '5.958')] [2023-02-24 18:13:47,016][177158] DAMAGECOUNT value on done: 69140.0 [2023-02-24 18:13:47,017][177158] Sum rewards: 13.296, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.180', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.069', 'WEAPON1': '0.080', 'WEAPON4': '0.150', 'weapon5': '0.150', 'AMMO3': '0.166', 'WEAPON5': '0.300', 'ARMOR': '0.408', 'weapon4': '0.482', 'weapon2': '0.878', 'WEAPON3': '1.050', 'HITCOUNT': '1.260', 'weapon3': '2.114', 'DAMAGECOUNT': '5.592', 'FRAGCOUNT': '13.000'} [2023-02-24 18:13:47,320][177158] DAMAGECOUNT value on done: 72436.0 [2023-02-24 18:13:47,320][177158] Sum rewards: 10.111, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.820', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'weapon7': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.106', 'weapon5': '0.178', 'WEAPON5': '0.200', 'weapon4': '0.248', 'HITCOUNT': '0.530', 'WEAPON3': '0.800', 'weapon2': '1.180', 'weapon3': '2.046', 'DAMAGECOUNT': '2.583', 'FRAGCOUNT': '10.000'} [2023-02-24 18:13:47,700][177172] DAMAGECOUNT value on done: 68821.0 [2023-02-24 18:13:47,700][177172] Sum rewards: 1.076, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.635', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon7': '0.112', 'AMMO4': '0.123', 'weapon5': '0.152', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.270', 'WEAPON3': '0.350', 'weapon4': '0.518', 'weapon3': '0.568', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.020', 'weapon2': '1.180'} [2023-02-24 18:13:47,988][177172] DAMAGECOUNT value on done: 67849.0 [2023-02-24 18:13:47,989][177172] Sum rewards: 4.112, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'ARMOR': '0.008', 'WEAPON1': '0.030', 'AMMO2': '0.030', 'weapon7': '0.058', 'AMMO3': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.320', 'WEAPON3': '0.400', 'weapon5': '0.422', 'weapon2': '0.430', 'weapon4': '0.472', 'HEALTH': '0.740', 'weapon3': '0.844', 'DAMAGECOUNT': '1.482', 'FRAGCOUNT': '4.000'} [2023-02-24 18:13:48,385][177154] DAMAGECOUNT value on done: 74527.0 [2023-02-24 18:13:48,386][177154] Sum rewards: 16.881, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO3': '0.100', 'weapon5': '0.160', 'WEAPON5': '0.200', 'HEALTH': '0.282', 'ARMOR': '0.500', 'WEAPON3': '0.500', 'HITCOUNT': '0.940', 'weapon2': '1.370', 'weapon3': '2.052', 'DAMAGECOUNT': '4.011', 'FRAGCOUNT': '12.000'} [2023-02-24 18:13:48,681][177154] DAMAGECOUNT value on done: 71526.0 [2023-02-24 18:13:48,681][177154] Sum rewards: 2.900, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.368', 'ARMOR': '0.016', 'AMMO5': '0.023', 'AMMO2': '0.053', 'WEAPON1': '0.070', 'AMMO3': '0.088', 'AMMO4': '0.264', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.448', 'WEAPON3': '0.550', 'HITCOUNT': '0.620', 'weapon4': '0.664', 'weapon5': '0.704', 'weapon3': '1.638', 'DAMAGECOUNT': '1.830', 'FRAGCOUNT': '4.000'} [2023-02-24 18:13:48,691][177154] DAMAGECOUNT value on done: 69700.0 [2023-02-24 18:13:48,691][177154] Sum rewards: 9.968, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.140', 'AMMO5': '0.008', 'WEAPON1': '0.040', 'AMMO2': '0.048', 'weapon5': '0.096', 'AMMO3': '0.121', 'WEAPON5': '0.200', 'AMMO4': '0.240', 'WEAPON4': '0.300', 'ARMOR': '0.415', 'WEAPON3': '0.500', 'weapon4': '0.536', 'HITCOUNT': '0.940', 'weapon2': '1.024', 'weapon3': '1.904', 'DAMAGECOUNT': '3.735', 'FRAGCOUNT': '7.500'} [2023-02-24 18:13:48,880][177153] Updated weights for policy 0, policy_version 10430 (0.0009) [2023-02-24 18:13:48,960][177172] DAMAGECOUNT value on done: 69108.0 [2023-02-24 18:13:48,960][177172] Sum rewards: 1.036, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.330', 'AMMO5': '0.017', 'AMMO2': '0.028', 'weapon7': '0.056', 'WEAPON1': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.118', 'AMMO4': '0.141', 'weapon5': '0.176', 'WEAPON4': '0.200', 'HITCOUNT': '0.220', 'WEAPON5': '0.450', 'ARMOR': '0.475', 'weapon4': '0.646', 'WEAPON3': '0.800', 'weapon2': '0.982', 'DAMAGECOUNT': '0.990', 'weapon3': '1.426', 'FRAGCOUNT': '2.000'} [2023-02-24 18:13:48,993][177154] DAMAGECOUNT value on done: 70316.0 [2023-02-24 18:13:48,993][177154] Sum rewards: 13.032, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.501', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'weapon7': '0.062', 'weapon5': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'weapon2': '0.362', 'ARMOR': '0.492', 'WEAPON3': '0.750', 'HITCOUNT': '0.840', 'weapon4': '0.874', 'weapon3': '1.858', 'DAMAGECOUNT': '2.805', 'FRAGCOUNT': '12.000'} [2023-02-24 18:13:49,254][177172] DAMAGECOUNT value on done: 68792.0 [2023-02-24 18:13:49,255][177172] Sum rewards: 1.908, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.944', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.058', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'weapon4': '0.168', 'ARMOR': '0.428', 'HITCOUNT': '0.520', 'WEAPON3': '0.900', 'weapon2': '1.620', 'DAMAGECOUNT': '1.812', 'weapon3': '1.958', 'FRAGCOUNT': '4.000'} [2023-02-24 18:13:49,647][177157] DAMAGECOUNT value on done: 69959.0 [2023-02-24 18:13:49,648][177157] Sum rewards: 5.853, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.510', 'AMMO5': '0.012', 'AMMO2': '0.026', 'WEAPON1': '0.060', 'weapon4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'AMMO4': '0.128', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.300', 'weapon5': '0.380', 'HITCOUNT': '0.570', 'WEAPON3': '0.900', 'weapon2': '1.074', 'weapon3': '2.120', 'DAMAGECOUNT': '2.142', 'FRAGCOUNT': '7.000'} [2023-02-24 18:13:49,658][177157] DAMAGECOUNT value on done: 74254.0 [2023-02-24 18:13:49,658][177157] Sum rewards: 5.936, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.235', 'AMMO5': '0.007', 'AMMO2': '0.024', 'ARMOR': '0.024', 'WEAPON1': '0.050', 'AMMO4': '0.119', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.260', 'weapon4': '0.308', 'weapon2': '0.682', 'HITCOUNT': '0.690', 'WEAPON3': '0.950', 'weapon3': '2.198', 'DAMAGECOUNT': '2.619', 'FRAGCOUNT': '7.000'} [2023-02-24 18:13:49,835][177171] DAMAGECOUNT value on done: 70431.0 [2023-02-24 18:13:49,835][177171] Sum rewards: 6.716, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.227', 'AMMO5': '0.010', 'AMMO2': '0.033', 'ARMOR': '0.044', 'WEAPON1': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.118', 'AMMO4': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.426', 'weapon4': '0.520', 'HITCOUNT': '0.670', 'WEAPON3': '0.800', 'weapon2': '0.868', 'weapon3': '1.788', 'DAMAGECOUNT': '2.700', 'FRAGCOUNT': '6.500'} [2023-02-24 18:13:49,953][177157] DAMAGECOUNT value on done: 67644.0 [2023-02-24 18:13:49,964][177157] DAMAGECOUNT value on done: 69484.0 [2023-02-24 18:13:49,964][177157] Sum rewards: 4.191, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.710', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.033', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'weapon5': '0.134', 'AMMO4': '0.165', 'WEAPON5': '0.200', 'weapon2': '0.396', 'HITCOUNT': '0.430', 'weapon4': '0.530', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.680', 'weapon3': '1.730', 'FRAGCOUNT': '4.000'} [2023-02-24 18:13:50,004][177171] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 18:13:50,140][177171] DAMAGECOUNT value on done: 70643.0 [2023-02-24 18:13:50,140][177171] Sum rewards: 6.972, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.516', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.030', 'AMMO3': '0.087', 'weapon5': '0.146', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.590', 'weapon4': '0.630', 'WEAPON3': '0.650', 'weapon2': '0.762', 'ARMOR': '0.855', 'weapon3': '1.792', 'DAMAGECOUNT': '2.301', 'FRAGCOUNT': '5.000'} [2023-02-24 18:13:50,407][177171] DAMAGECOUNT value on done: 69866.0 [2023-02-24 18:13:50,407][177171] Sum rewards: 11.988, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.930', 'AMMO5': '0.015', 'AMMO2': '0.026', 'WEAPON1': '0.060', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.135', 'weapon5': '0.350', 'weapon4': '0.364', 'WEAPON5': '0.400', 'HITCOUNT': '0.700', 'WEAPON3': '0.800', 'weapon2': '1.088', 'weapon3': '1.744', 'DAMAGECOUNT': '4.140', 'FRAGCOUNT': '10.000'} [2023-02-24 18:13:50,419][177155] DAMAGECOUNT value on done: 71992.0 [2023-02-24 18:13:50,420][177155] Sum rewards: 9.943, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.027', 'WEAPON1': '0.040', 'weapon7': '0.046', 'AMMO3': '0.050', 'HEALTH': '0.051', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.136', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.300', 'HITCOUNT': '0.310', 'weapon5': '0.484', 'weapon4': '0.682', 'weapon3': '1.216', 'weapon2': '1.244', 'DAMAGECOUNT': '2.001', 'FRAGCOUNT': '7.000'} [2023-02-24 18:13:50,716][177171] DAMAGECOUNT value on done: 69173.0 [2023-02-24 18:13:50,716][177171] Sum rewards: 6.234, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.886', 'AMMO5': '0.015', 'AMMO2': '0.026', 'WEAPON1': '0.060', 'weapon7': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.130', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.212', 'WEAPON5': '0.300', 'weapon4': '0.358', 'ARMOR': '0.483', 'HITCOUNT': '0.510', 'WEAPON3': '0.850', 'weapon2': '0.970', 'weapon3': '1.660', 'DAMAGECOUNT': '2.223', 'FRAGCOUNT': '6.000'} [2023-02-24 18:13:50,734][177155] DAMAGECOUNT value on done: 73980.0 [2023-02-24 18:13:50,735][177155] Sum rewards: 12.795, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.130', 'AMMO5': '0.007', 'AMMO2': '0.035', 'WEAPON1': '0.040', 'AMMO3': '0.070', 'weapon7': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.177', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.416', 'WEAPON3': '0.500', 'weapon5': '0.502', 'HITCOUNT': '0.580', 'weapon2': '1.172', 'weapon3': '1.224', 'DAMAGECOUNT': '3.441', 'FRAGCOUNT': '10.000'} [2023-02-24 18:13:51,024][177155] DAMAGECOUNT value on done: 74103.0 [2023-02-24 18:13:51,024][177155] Sum rewards: 14.481, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.470', 'AMMO5': '0.012', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'weapon5': '0.088', 'AMMO3': '0.102', 'AMMO4': '0.127', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.544', 'WEAPON3': '0.750', 'weapon2': '0.896', 'HITCOUNT': '0.910', 'ARMOR': '1.019', 'weapon3': '1.810', 'DAMAGECOUNT': '4.377', 'FRAGCOUNT': '12.000'} [2023-02-24 18:13:51,323][177155] DAMAGECOUNT value on done: 67702.0 [2023-02-24 18:13:51,323][177155] Sum rewards: 8.730, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.486', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.028', 'weapon7': '0.054', 'WEAPON1': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.101', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'weapon5': '0.198', 'weapon4': '0.234', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'HITCOUNT': '0.920', 'weapon2': '1.208', 'weapon3': '1.950', 'DAMAGECOUNT': '3.519', 'FRAGCOUNT': '10.000'} [2023-02-24 18:13:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14023.6). Total num frames: 42754048. Throughput: 0: 3498.6. Samples: 10682752. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:13:51,376][177119] Avg episode reward: [(0, '6.363')] [2023-02-24 18:13:51,837][177153] Updated weights for policy 0, policy_version 10440 (0.0008) [2023-02-24 18:13:54,748][177153] Updated weights for policy 0, policy_version 10450 (0.0008) [2023-02-24 18:13:56,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14023.6). Total num frames: 42823680. Throughput: 0: 3500.3. Samples: 10703734. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:13:56,376][177119] Avg episode reward: [(0, '6.363')] [2023-02-24 18:13:56,481][177156] DAMAGECOUNT value on done: 70964.0 [2023-02-24 18:13:56,481][177156] Sum rewards: 5.639, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.333', 'AMMO5': '0.012', 'AMMO2': '0.029', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'AMMO3': '0.080', 'AMMO4': '0.146', 'weapon5': '0.220', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.578', 'HITCOUNT': '0.680', 'weapon2': '1.188', 'weapon3': '1.686', 'DAMAGECOUNT': '2.262', 'FRAGCOUNT': '7.000'} [2023-02-24 18:13:56,492][177156] DAMAGECOUNT value on done: 68237.0 [2023-02-24 18:13:56,493][177156] Sum rewards: 7.557, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.214', 'AMMO5': '0.020', 'AMMO2': '0.033', 'WEAPON1': '0.090', 'weapon5': '0.138', 'AMMO3': '0.144', 'weapon4': '0.164', 'AMMO4': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.450', 'HITCOUNT': '0.690', 'WEAPON3': '0.900', 'weapon2': '0.974', 'weapon3': '2.476', 'DAMAGECOUNT': '3.075', 'FRAGCOUNT': '9.000'} [2023-02-24 18:13:56,792][177156] DAMAGECOUNT value on done: 73014.0 [2023-02-24 18:13:56,793][177156] Sum rewards: 5.954, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.750', 'AMMO5': '0.005', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.084', 'AMMO4': '0.096', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.358', 'HITCOUNT': '0.810', 'WEAPON3': '0.900', 'weapon2': '1.372', 'weapon3': '1.962', 'DAMAGECOUNT': '2.652', 'FRAGCOUNT': '8.000'} [2023-02-24 18:13:56,802][177156] DAMAGECOUNT value on done: 71219.0 [2023-02-24 18:13:56,803][177156] Sum rewards: 3.564, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.164', 'AMMO5': '0.020', 'AMMO2': '0.040', 'WEAPON1': '0.090', 'AMMO3': '0.148', 'WEAPON4': '0.200', 'AMMO4': '0.200', 'weapon4': '0.220', 'weapon5': '0.430', 'WEAPON5': '0.550', 'HITCOUNT': '0.740', 'weapon2': '0.918', 'WEAPON3': '1.000', 'weapon3': '2.018', 'DAMAGECOUNT': '2.904', 'FRAGCOUNT': '6.000'} [2023-02-24 18:13:57,672][177153] Updated weights for policy 0, policy_version 10460 (0.0008) [2023-02-24 18:14:00,617][177153] Updated weights for policy 0, policy_version 10470 (0.0008) [2023-02-24 18:14:01,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 14023.6). Total num frames: 42893312. Throughput: 0: 3500.8. Samples: 10724756. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:14:01,376][177119] Avg episode reward: [(0, '6.395')] [2023-02-24 18:14:02,813][177154] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:14:03,542][177153] Updated weights for policy 0, policy_version 10480 (0.0009) [2023-02-24 18:14:03,707][177170] DAMAGECOUNT value on done: 71481.0 [2023-02-24 18:14:03,707][177170] Sum rewards: 3.237, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.908', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon7': '0.046', 'WEAPON1': '0.060', 'ARMOR': '0.064', 'AMMO3': '0.104', 'AMMO4': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.190', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.458', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'weapon2': '1.228', 'weapon3': '1.636', 'DAMAGECOUNT': '2.685', 'FRAGCOUNT': '3.500'} [2023-02-24 18:14:04,005][177170] DAMAGECOUNT value on done: 75822.0 [2023-02-24 18:14:04,005][177170] Sum rewards: 7.700, reward structure: {'DEATHCOUNT': '-6.750', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'weapon7': '0.054', 'WEAPON1': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.125', 'AMMO4': '0.126', 'weapon5': '0.236', 'HEALTH': '0.278', 'weapon2': '0.302', 'WEAPON5': '0.350', 'weapon4': '0.428', 'WEAPON3': '0.650', 'HITCOUNT': '0.700', 'weapon3': '1.548', 'DAMAGECOUNT': '2.682', 'FRAGCOUNT': '6.500'} [2023-02-24 18:14:04,160][177170] DAMAGECOUNT value on done: 64784.0 [2023-02-24 18:14:04,160][177170] Sum rewards: 3.702, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.570', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON1': '0.060', 'AMMO3': '0.124', 'AMMO4': '0.142', 'weapon5': '0.164', 'WEAPON5': '0.200', 'WEAPON4': '0.450', 'HITCOUNT': '0.640', 'weapon2': '0.806', 'weapon4': '0.880', 'ARMOR': '0.923', 'WEAPON3': '0.950', 'weapon3': '1.766', 'DAMAGECOUNT': '2.883', 'FRAGCOUNT': '6.000'} [2023-02-24 18:14:04,456][177170] DAMAGECOUNT value on done: 73935.0 [2023-02-24 18:14:04,457][177170] Sum rewards: 3.231, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.586', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.037', 'WEAPON1': '0.080', 'AMMO3': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.164', 'AMMO4': '0.186', 'WEAPON5': '0.350', 'weapon4': '0.408', 'HITCOUNT': '0.430', 'WEAPON3': '0.800', 'weapon2': '1.380', 'weapon3': '1.726', 'DAMAGECOUNT': '1.986', 'FRAGCOUNT': '6.000'} [2023-02-24 18:14:04,487][177170] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 18:14:05,023][177158] DAMAGECOUNT value on done: 67775.0 [2023-02-24 18:14:05,024][177158] Sum rewards: 6.637, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.494', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'AMMO3': '0.098', 'AMMO4': '0.171', 'weapon5': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'ARMOR': '0.440', 'WEAPON3': '0.650', 'HITCOUNT': '0.670', 'weapon2': '0.876', 'weapon4': '1.140', 'weapon3': '1.540', 'DAMAGECOUNT': '2.700', 'FRAGCOUNT': '7.000'} [2023-02-24 18:14:05,322][177158] DAMAGECOUNT value on done: 68507.0 [2023-02-24 18:14:05,323][177158] Sum rewards: 5.205, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.616', 'AMMO5': '0.015', 'ARMOR': '0.020', 'AMMO2': '0.043', 'WEAPON1': '0.050', 'weapon7': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.101', 'weapon5': '0.158', 'AMMO4': '0.214', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.488', 'WEAPON3': '0.650', 'HITCOUNT': '0.790', 'weapon4': '0.960', 'weapon3': '1.684', 'DAMAGECOUNT': '3.336', 'FRAGCOUNT': '6.000'} [2023-02-24 18:14:06,219][177158] DAMAGECOUNT value on done: 70019.0 [2023-02-24 18:14:06,220][177158] Sum rewards: 7.293, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.908', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'weapon5': '0.054', 'AMMO4': '0.079', 'AMMO3': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.384', 'HITCOUNT': '0.600', 'WEAPON3': '0.650', 'weapon3': '1.406', 'weapon2': '1.528', 'DAMAGECOUNT': '2.637', 'FRAGCOUNT': '7.000'} [2023-02-24 18:14:06,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 42962944. Throughput: 0: 3501.3. Samples: 10735208. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:14:06,376][177119] Avg episode reward: [(0, '6.314')] [2023-02-24 18:14:06,485][177153] Updated weights for policy 0, policy_version 10490 (0.0008) [2023-02-24 18:14:06,521][177158] DAMAGECOUNT value on done: 73446.0 [2023-02-24 18:14:06,521][177158] Sum rewards: 7.726, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.152', 'AMMO5': '0.017', 'AMMO2': '0.027', 'WEAPON1': '0.080', 'AMMO3': '0.120', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'weapon5': '0.160', 'weapon4': '0.348', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '0.720', 'weapon2': '0.918', 'weapon3': '1.724', 'DAMAGECOUNT': '3.030', 'FRAGCOUNT': '7.000'} [2023-02-24 18:14:06,859][177172] DAMAGECOUNT value on done: 70056.0 [2023-02-24 18:14:06,859][177172] Sum rewards: 5.619, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.846', 'AMMO5': '0.013', 'AMMO2': '0.040', 'WEAPON1': '0.070', 'AMMO3': '0.128', 'weapon7': '0.132', 'weapon5': '0.142', 'AMMO4': '0.201', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'WEAPON4': '0.400', 'HITCOUNT': '0.580', 'weapon2': '0.628', 'WEAPON3': '0.800', 'weapon4': '0.928', 'weapon3': '1.758', 'DAMAGECOUNT': '3.405', 'FRAGCOUNT': '7.000'} [2023-02-24 18:14:07,161][177172] DAMAGECOUNT value on done: 68557.0 [2023-02-24 18:14:07,162][177172] Sum rewards: 3.673, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.869', 'weapon7': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.043', 'WEAPON1': '0.060', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.109', 'weapon5': '0.154', 'AMMO4': '0.217', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.418', 'ARMOR': '0.465', 'HITCOUNT': '0.550', 'WEAPON3': '0.700', 'weapon3': '1.340', 'weapon2': '1.700', 'DAMAGECOUNT': '2.124', 'FRAGCOUNT': '4.000'} [2023-02-24 18:14:07,638][177154] DAMAGECOUNT value on done: 75832.0 [2023-02-24 18:14:07,638][177154] Sum rewards: 8.279, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.210', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.045', 'AMMO3': '0.057', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.164', 'AMMO4': '0.226', 'WEAPON3': '0.450', 'weapon2': '0.486', 'WEAPON4': '0.650', 'HITCOUNT': '0.780', 'ARMOR': '0.931', 'weapon3': '1.074', 'weapon4': '1.466', 'DAMAGECOUNT': '3.864', 'FRAGCOUNT': '7.000'} [2023-02-24 18:14:07,931][177154] DAMAGECOUNT value on done: 73011.0 [2023-02-24 18:14:07,931][177154] Sum rewards: 4.922, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.246', 'AMMO2': '0.014', 'AMMO5': '0.022', 'WEAPON1': '0.050', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.106', 'weapon5': '0.138', 'AMMO3': '0.229', 'WEAPON5': '0.450', 'weapon2': '0.676', 'HITCOUNT': '1.210', 'WEAPON3': '1.450', 'weapon3': '2.698', 'DAMAGECOUNT': '4.455', 'FRAGCOUNT': '9.000'} [2023-02-24 18:14:07,940][177154] DAMAGECOUNT value on done: 70621.0 [2023-02-24 18:14:07,940][177154] Sum rewards: 5.006, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.514', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO2': '0.054', 'weapon5': '0.072', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'AMMO4': '0.271', 'WEAPON5': '0.350', 'ARMOR': '0.408', 'weapon4': '0.494', 'weapon2': '0.718', 'HITCOUNT': '0.860', 'WEAPON3': '1.100', 'weapon3': '2.450', 'DAMAGECOUNT': '2.763', 'FRAGCOUNT': '7.000'} [2023-02-24 18:14:08,228][177172] DAMAGECOUNT value on done: 70431.0 [2023-02-24 18:14:08,229][177172] Sum rewards: 10.850, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.806', 'AMMO5': '0.003', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'weapon4': '0.526', 'weapon2': '0.622', 'WEAPON3': '0.950', 'HITCOUNT': '1.030', 'weapon3': '2.454', 'DAMAGECOUNT': '3.969', 'FRAGCOUNT': '11.000'} [2023-02-24 18:14:08,235][177154] DAMAGECOUNT value on done: 70882.0 [2023-02-24 18:14:08,236][177154] Sum rewards: 4.280, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.982', 'AMMO5': '0.007', 'ARMOR': '0.013', 'AMMO2': '0.032', 'WEAPON1': '0.040', 'weapon7': '0.052', 'AMMO3': '0.073', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.160', 'weapon5': '0.168', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.416', 'HITCOUNT': '0.420', 'WEAPON3': '0.600', 'weapon3': '1.556', 'weapon2': '1.586', 'DAMAGECOUNT': '1.698', 'FRAGCOUNT': '5.000'} [2023-02-24 18:14:08,521][177172] DAMAGECOUNT value on done: 69956.0 [2023-02-24 18:14:08,521][177172] Sum rewards: 13.010, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.649', 'AMMO5': '0.012', 'AMMO2': '0.014', 'WEAPON1': '0.070', 'AMMO4': '0.072', 'AMMO3': '0.109', 'weapon5': '0.232', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'HITCOUNT': '0.960', 'weapon2': '1.280', 'weapon3': '2.118', 'DAMAGECOUNT': '3.492', 'FRAGCOUNT': '11.000'} [2023-02-24 18:14:08,840][177157] DAMAGECOUNT value on done: 70464.0 [2023-02-24 18:14:08,841][177157] Sum rewards: 4.462, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.656', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON1': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.119', 'weapon5': '0.124', 'WEAPON5': '0.200', 'HITCOUNT': '0.420', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.515', 'weapon3': '1.734', 'weapon2': '1.932', 'FRAGCOUNT': '5.000'} [2023-02-24 18:14:08,851][177157] DAMAGECOUNT value on done: 75523.0 [2023-02-24 18:14:08,852][177157] Sum rewards: 11.884, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.088', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.043', 'AMMO3': '0.102', 'weapon7': '0.104', 'WEAPON5': '0.150', 'weapon5': '0.190', 'AMMO4': '0.216', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.650', 'weapon2': '0.684', 'HITCOUNT': '0.870', 'weapon4': '0.876', 'weapon3': '1.688', 'DAMAGECOUNT': '3.807', 'FRAGCOUNT': '12.000'} [2023-02-24 18:14:09,124][177171] DAMAGECOUNT value on done: 70970.0 [2023-02-24 18:14:09,125][177171] Sum rewards: 3.130, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.270', 'AMMO2': '0.005', 'AMMO5': '0.020', 'AMMO4': '0.024', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'weapon4': '0.134', 'weapon5': '0.236', 'WEAPON5': '0.400', 'ARMOR': '0.441', 'HITCOUNT': '0.510', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.617', 'weapon2': '1.662', 'weapon3': '1.748', 'FRAGCOUNT': '4.000'} [2023-02-24 18:14:09,143][177157] DAMAGECOUNT value on done: 68603.0 [2023-02-24 18:14:09,143][177157] Sum rewards: 5.567, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.120', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'weapon7': '0.054', 'weapon5': '0.088', 'AMMO3': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.450', 'WEAPON3': '0.700', 'weapon4': '0.772', 'HITCOUNT': '0.850', 'weapon2': '0.950', 'weapon3': '1.560', 'DAMAGECOUNT': '2.877', 'FRAGCOUNT': '8.000'} [2023-02-24 18:14:09,155][177157] DAMAGECOUNT value on done: 70300.0 [2023-02-24 18:14:09,156][177157] Sum rewards: 6.082, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.369', 'AMMO5': '0.007', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'weapon7': '0.052', 'weapon5': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.117', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.368', 'HITCOUNT': '0.480', 'weapon2': '0.486', 'WEAPON3': '0.650', 'weapon3': '1.420', 'DAMAGECOUNT': '2.448', 'FRAGCOUNT': '7.000'} [2023-02-24 18:14:09,425][177153] Updated weights for policy 0, policy_version 10500 (0.0008) [2023-02-24 18:14:09,438][177171] DAMAGECOUNT value on done: 71820.0 [2023-02-24 18:14:09,439][177171] Sum rewards: 5.307, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.815', 'AMMO5': '0.012', 'AMMO2': '0.013', 'ARMOR': '0.044', 'AMMO4': '0.065', 'WEAPON1': '0.070', 'weapon5': '0.084', 'AMMO3': '0.114', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.534', 'WEAPON3': '0.750', 'HITCOUNT': '0.960', 'weapon2': '1.176', 'weapon3': '1.968', 'DAMAGECOUNT': '3.531', 'FRAGCOUNT': '7.000'} [2023-02-24 18:14:09,652][177171] DAMAGECOUNT value on done: 71025.0 [2023-02-24 18:14:09,653][177171] Sum rewards: 5.241, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.395', 'AMMO2': '0.009', 'AMMO5': '0.016', 'WEAPON1': '0.030', 'weapon5': '0.042', 'AMMO4': '0.044', 'AMMO3': '0.134', 'weapon2': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.538', 'WEAPON3': '0.900', 'ARMOR': '0.930', 'HITCOUNT': '0.990', 'weapon3': '2.288', 'DAMAGECOUNT': '3.477', 'FRAGCOUNT': '5.500'} [2023-02-24 18:14:09,663][177155] DAMAGECOUNT value on done: 72747.0 [2023-02-24 18:14:09,664][177155] Sum rewards: 4.164, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.294', 'ARMOR': '0.016', 'AMMO5': '0.022', 'AMMO2': '0.025', 'WEAPON1': '0.060', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'AMMO3': '0.169', 'weapon5': '0.192', 'WEAPON5': '0.400', 'weapon4': '0.412', 'HITCOUNT': '0.610', 'WEAPON3': '0.950', 'weapon2': '1.154', 'weapon3': '1.906', 'DAMAGECOUNT': '2.265', 'FRAGCOUNT': '6.000'} [2023-02-24 18:14:09,956][177171] DAMAGECOUNT value on done: 70880.0 [2023-02-24 18:14:09,956][177171] Sum rewards: 13.404, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.015', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.098', 'AMMO3': '0.152', 'weapon5': '0.152', 'weapon4': '0.274', 'WEAPON5': '0.300', 'HEALTH': '0.308', 'weapon2': '0.802', 'WEAPON3': '0.900', 'HITCOUNT': '1.060', 'weapon3': '2.342', 'DAMAGECOUNT': '5.121', 'FRAGCOUNT': '13.000'} [2023-02-24 18:14:09,959][177155] DAMAGECOUNT value on done: 75044.0 [2023-02-24 18:14:09,960][177155] Sum rewards: 11.640, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.180', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.037', 'WEAPON1': '0.080', 'AMMO3': '0.134', 'weapon5': '0.224', 'WEAPON5': '0.350', 'HITCOUNT': '0.810', 'WEAPON3': '0.850', 'weapon2': '1.164', 'weapon3': '2.212', 'DAMAGECOUNT': '3.192', 'FRAGCOUNT': '11.000'} [2023-02-24 18:14:10,282][177155] DAMAGECOUNT value on done: 75099.0 [2023-02-24 18:14:10,282][177155] Sum rewards: 7.003, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.500', 'AMMO5': '0.012', 'AMMO2': '0.023', 'WEAPON1': '0.050', 'AMMO3': '0.099', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'weapon4': '0.228', 'WEAPON5': '0.300', 'ARMOR': '0.404', 'weapon5': '0.408', 'HITCOUNT': '0.530', 'WEAPON3': '0.650', 'weapon3': '1.336', 'weapon2': '1.660', 'DAMAGECOUNT': '2.988', 'FRAGCOUNT': '6.000'} [2023-02-24 18:14:10,574][177155] DAMAGECOUNT value on done: 68102.0 [2023-02-24 18:14:10,574][177155] Sum rewards: 1.289, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.580', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon4': '0.078', 'WEAPON1': '0.080', 'AMMO3': '0.125', 'weapon5': '0.208', 'AMMO4': '0.229', 'WEAPON4': '0.250', 'HITCOUNT': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.200', 'weapon3': '1.352', 'weapon2': '2.088', 'FRAGCOUNT': '4.000'} [2023-02-24 18:14:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 43032576. Throughput: 0: 3496.1. Samples: 10756074. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:14:11,376][177119] Avg episode reward: [(0, '6.558')] [2023-02-24 18:14:12,373][177153] Updated weights for policy 0, policy_version 10510 (0.0009) [2023-02-24 18:14:15,288][177153] Updated weights for policy 0, policy_version 10520 (0.0009) [2023-02-24 18:14:15,712][177156] DAMAGECOUNT value on done: 71533.0 [2023-02-24 18:14:15,713][177156] Sum rewards: 0.605, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.366', 'ARMOR': '0.016', 'AMMO5': '0.022', 'AMMO2': '0.039', 'WEAPON1': '0.060', 'weapon7': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.138', 'AMMO4': '0.194', 'WEAPON7': '0.200', 'HITCOUNT': '0.350', 'weapon5': '0.356', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.518', 'weapon4': '0.798', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.707', 'weapon3': '1.764', 'FRAGCOUNT': '6.000'} [2023-02-24 18:14:15,723][177156] DAMAGECOUNT value on done: 69461.0 [2023-02-24 18:14:15,724][177156] Sum rewards: 9.933, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.610', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon7': '0.048', 'WEAPON1': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.101', 'weapon5': '0.130', 'AMMO4': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.590', 'WEAPON3': '0.750', 'HITCOUNT': '0.790', 'weapon2': '0.970', 'weapon3': '1.794', 'DAMAGECOUNT': '3.672', 'FRAGCOUNT': '9.000'} [2023-02-24 18:14:16,023][177156] DAMAGECOUNT value on done: 73625.0 [2023-02-24 18:14:16,024][177156] Sum rewards: 6.077, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.575', 'AMMO5': '0.009', 'AMMO2': '0.028', 'ARMOR': '0.036', 'WEAPON1': '0.050', 'AMMO3': '0.072', 'AMMO4': '0.138', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.252', 'HITCOUNT': '0.360', 'WEAPON4': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.874', 'weapon3': '1.158', 'weapon2': '1.292', 'DAMAGECOUNT': '1.833', 'FRAGCOUNT': '5.000'} [2023-02-24 18:14:16,035][177156] DAMAGECOUNT value on done: 72245.0 [2023-02-24 18:14:16,035][177156] Sum rewards: 10.917, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.500', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.054', 'WEAPON1': '0.070', 'AMMO3': '0.106', 'WEAPON5': '0.350', 'weapon5': '0.364', 'ARMOR': '0.400', 'HITCOUNT': '0.600', 'WEAPON3': '0.750', 'weapon2': '1.488', 'weapon3': '1.886', 'DAMAGECOUNT': '3.078', 'FRAGCOUNT': '9.000'} [2023-02-24 18:14:16,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 43102208. Throughput: 0: 3499.3. Samples: 10777072. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:14:16,376][177119] Avg episode reward: [(0, '6.554')] [2023-02-24 18:14:18,204][177153] Updated weights for policy 0, policy_version 10530 (0.0008) [2023-02-24 18:14:21,145][177153] Updated weights for policy 0, policy_version 10540 (0.0008) [2023-02-24 18:14:21,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 43171840. Throughput: 0: 3497.2. Samples: 10787584. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:14:21,376][177119] Avg episode reward: [(0, '6.554')] [2023-02-24 18:14:22,835][177170] DAMAGECOUNT value on done: 72666.0 [2023-02-24 18:14:22,836][177170] Sum rewards: 11.696, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.047', 'AMMO5': '0.015', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'AMMO4': '0.082', 'AMMO3': '0.099', 'weapon5': '0.104', 'WEAPON4': '0.150', 'weapon4': '0.208', 'WEAPON5': '0.350', 'HITCOUNT': '0.640', 'WEAPON3': '0.700', 'weapon3': '1.742', 'weapon2': '1.802', 'DAMAGECOUNT': '3.555', 'FRAGCOUNT': '10.000'} [2023-02-24 18:14:23,137][177170] DAMAGECOUNT value on done: 77109.0 [2023-02-24 18:14:23,137][177170] Sum rewards: 12.328, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.316', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.117', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.306', 'ARMOR': '0.412', 'WEAPON3': '0.700', 'weapon4': '0.732', 'HITCOUNT': '0.740', 'weapon2': '0.806', 'weapon3': '1.714', 'DAMAGECOUNT': '3.861', 'FRAGCOUNT': '11.000'} [2023-02-24 18:14:23,371][177170] DAMAGECOUNT value on done: 65442.0 [2023-02-24 18:14:23,372][177170] Sum rewards: 2.985, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.478', 'AMMO5': '0.005', 'ARMOR': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'AMMO4': '0.091', 'weapon7': '0.094', 'AMMO3': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon5': '0.166', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.346', 'HITCOUNT': '0.350', 'weapon2': '0.354', 'WEAPON3': '0.650', 'weapon3': '1.236', 'DAMAGECOUNT': '1.974', 'FRAGCOUNT': '5.000'} [2023-02-24 18:14:23,678][177170] DAMAGECOUNT value on done: 75358.0 [2023-02-24 18:14:23,679][177170] Sum rewards: 8.750, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.298', 'AMMO5': '0.025', 'AMMO2': '0.040', 'WEAPON1': '0.050', 'weapon4': '0.064', 'AMMO3': '0.198', 'AMMO4': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.296', 'WEAPON5': '0.550', 'weapon2': '0.826', 'HITCOUNT': '1.060', 'WEAPON3': '1.100', 'weapon3': '2.420', 'DAMAGECOUNT': '4.269', 'FRAGCOUNT': '10.500'} [2023-02-24 18:14:24,081][177153] Updated weights for policy 0, policy_version 10550 (0.0008) [2023-02-24 18:14:24,274][177158] DAMAGECOUNT value on done: 69246.0 [2023-02-24 18:14:24,275][177158] Sum rewards: 7.697, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.374', 'AMMO5': '0.016', 'AMMO2': '0.029', 'ARMOR': '0.036', 'WEAPON1': '0.090', 'AMMO3': '0.095', 'weapon7': '0.106', 'AMMO4': '0.145', 'weapon5': '0.246', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON4': '0.300', 'WEAPON7': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.456', 'WEAPON3': '0.650', 'HITCOUNT': '0.870', 'weapon2': '1.028', 'weapon3': '1.430', 'DAMAGECOUNT': '4.413', 'FRAGCOUNT': '6.000'} [2023-02-24 18:14:24,575][177158] DAMAGECOUNT value on done: 69719.0 [2023-02-24 18:14:24,575][177158] Sum rewards: 9.880, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.241', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.154', 'weapon4': '0.344', 'WEAPON3': '0.950', 'HITCOUNT': '0.970', 'weapon2': '1.036', 'weapon3': '2.296', 'DAMAGECOUNT': '3.633', 'FRAGCOUNT': '10.000'} [2023-02-24 18:14:25,463][177158] DAMAGECOUNT value on done: 71039.0 [2023-02-24 18:14:25,463][177158] Sum rewards: 7.097, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.036', 'AMMO5': '0.012', 'ARMOR': '0.024', 'AMMO2': '0.029', 'WEAPON1': '0.060', 'AMMO4': '0.142', 'AMMO3': '0.148', 'WEAPON4': '0.200', 'weapon5': '0.220', 'WEAPON5': '0.300', 'weapon4': '0.364', 'WEAPON3': '0.850', 'HITCOUNT': '0.860', 'weapon2': '1.080', 'weapon3': '2.034', 'DAMAGECOUNT': '3.060', 'FRAGCOUNT': '7.000'} [2023-02-24 18:14:25,762][177158] DAMAGECOUNT value on done: 74411.0 [2023-02-24 18:14:25,762][177158] Sum rewards: 8.659, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON1': '0.040', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'weapon5': '0.112', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'HEALTH': '0.274', 'weapon4': '0.314', 'HITCOUNT': '0.700', 'WEAPON3': '0.750', 'weapon2': '0.980', 'weapon3': '2.204', 'DAMAGECOUNT': '2.895', 'FRAGCOUNT': '9.000'} [2023-02-24 18:14:26,095][177172] DAMAGECOUNT value on done: 70775.0 [2023-02-24 18:14:26,096][177172] Sum rewards: 6.652, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.015', 'AMMO2': '0.031', 'WEAPON1': '0.060', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'HEALTH': '0.139', 'AMMO4': '0.153', 'weapon5': '0.302', 'WEAPON5': '0.350', 'weapon4': '0.488', 'WEAPON3': '0.500', 'HITCOUNT': '0.610', 'weapon3': '1.270', 'weapon2': '1.642', 'DAMAGECOUNT': '2.157', 'FRAGCOUNT': '4.000'} [2023-02-24 18:14:26,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 43241472. Throughput: 0: 3496.4. Samples: 10808516. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:14:26,376][177119] Avg episode reward: [(0, '6.796')] [2023-02-24 18:14:26,396][177172] DAMAGECOUNT value on done: 69633.0 [2023-02-24 18:14:26,396][177172] Sum rewards: 11.232, reward structure: {'DEATHCOUNT': '-9.000', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.031', 'WEAPON1': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'AMMO4': '0.154', 'HEALTH': '0.209', 'weapon5': '0.230', 'WEAPON5': '0.300', 'weapon4': '0.318', 'HITCOUNT': '0.680', 'weapon2': '0.710', 'WEAPON3': '0.750', 'weapon3': '2.282', 'DAMAGECOUNT': '3.228', 'FRAGCOUNT': '11.000'} [2023-02-24 18:14:26,868][177154] DAMAGECOUNT value on done: 76564.0 [2023-02-24 18:14:26,869][177154] Sum rewards: 5.296, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.534', 'AMMO5': '0.005', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'AMMO3': '0.064', 'weapon7': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.128', 'AMMO4': '0.171', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.390', 'weapon4': '0.804', 'weapon3': '0.810', 'weapon2': '1.124', 'DAMAGECOUNT': '2.151', 'FRAGCOUNT': '5.000'} [2023-02-24 18:14:27,019][177153] Updated weights for policy 0, policy_version 10560 (0.0008) [2023-02-24 18:14:27,152][177154] DAMAGECOUNT value on done: 74215.0 [2023-02-24 18:14:27,152][177154] Sum rewards: 8.288, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.174', 'AMMO5': '0.012', 'AMMO2': '0.020', 'WEAPON1': '0.080', 'AMMO3': '0.099', 'AMMO4': '0.100', 'weapon5': '0.166', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.880', 'weapon2': '1.596', 'weapon3': '1.946', 'DAMAGECOUNT': '3.612', 'FRAGCOUNT': '5.000'} [2023-02-24 18:14:27,170][177154] DAMAGECOUNT value on done: 71907.0 [2023-02-24 18:14:27,171][177154] Sum rewards: 12.384, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.412', 'AMMO5': '0.010', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'AMMO4': '0.109', 'AMMO3': '0.133', 'weapon5': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.246', 'WEAPON5': '0.250', 'ARMOR': '0.524', 'HITCOUNT': '0.770', 'WEAPON3': '0.900', 'weapon2': '1.486', 'weapon3': '1.818', 'DAMAGECOUNT': '3.858', 'FRAGCOUNT': '13.000'} [2023-02-24 18:14:27,462][177154] DAMAGECOUNT value on done: 71637.0 [2023-02-24 18:14:27,463][177154] Sum rewards: 7.931, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.756', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.036', 'weapon7': '0.058', 'AMMO3': '0.060', 'WEAPON1': '0.060', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.570', 'weapon4': '0.614', 'weapon2': '1.342', 'weapon3': '1.412', 'DAMAGECOUNT': '2.265', 'FRAGCOUNT': '6.000'} [2023-02-24 18:14:27,468][177172] DAMAGECOUNT value on done: 71720.0 [2023-02-24 18:14:27,469][177172] Sum rewards: 7.438, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.706', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.072', 'weapon5': '0.080', 'AMMO3': '0.154', 'WEAPON5': '0.200', 'weapon4': '0.286', 'HITCOUNT': '0.950', 'WEAPON3': '1.050', 'weapon2': '1.092', 'weapon3': '2.028', 'DAMAGECOUNT': '3.867', 'FRAGCOUNT': '9.000'} [2023-02-24 18:14:27,767][177172] DAMAGECOUNT value on done: 70937.0 [2023-02-24 18:14:27,768][177172] Sum rewards: 2.915, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.460', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'AMMO4': '0.090', 'AMMO3': '0.207', 'weapon5': '0.268', 'WEAPON5': '0.550', 'HITCOUNT': '0.820', 'weapon2': '1.074', 'WEAPON3': '1.300', 'weapon3': '2.298', 'DAMAGECOUNT': '2.943', 'FRAGCOUNT': '7.000'} [2023-02-24 18:14:28,073][177157] DAMAGECOUNT value on done: 70744.0 [2023-02-24 18:14:28,074][177157] Sum rewards: 3.960, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.050', 'AMMO3': '0.051', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'HITCOUNT': '0.210', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'weapon5': '0.548', 'DAMAGECOUNT': '0.840', 'weapon3': '1.218', 'FRAGCOUNT': '2.000', 'weapon2': '2.046'} [2023-02-24 18:14:28,084][177157] DAMAGECOUNT value on done: 76623.0 [2023-02-24 18:14:28,084][177157] Sum rewards: 9.768, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.458', 'AMMO5': '0.009', 'ARMOR': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.033', 'weapon7': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.102', 'AMMO3': '0.118', 'AMMO4': '0.167', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.620', 'WEAPON3': '0.750', 'weapon4': '0.758', 'weapon2': '0.932', 'weapon3': '1.582', 'DAMAGECOUNT': '3.225', 'FRAGCOUNT': '10.000'} [2023-02-24 18:14:28,355][177171] DAMAGECOUNT value on done: 71656.0 [2023-02-24 18:14:28,355][177171] Sum rewards: 6.294, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.046', 'AMMO5': '0.021', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'WEAPON1': '0.090', 'AMMO4': '0.125', 'AMMO3': '0.136', 'weapon4': '0.232', 'weapon5': '0.264', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'HITCOUNT': '0.590', 'weapon2': '0.812', 'WEAPON3': '0.850', 'DAMAGECOUNT': '2.058', 'weapon3': '2.238', 'FRAGCOUNT': '6.500'} [2023-02-24 18:14:28,378][177157] DAMAGECOUNT value on done: 69692.0 [2023-02-24 18:14:28,378][177157] Sum rewards: 5.406, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.583', 'ARMOR': '0.008', 'AMMO2': '0.014', 'AMMO5': '0.014', 'WEAPON1': '0.050', 'AMMO4': '0.070', 'AMMO3': '0.116', 'weapon5': '0.196', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.546', 'WEAPON3': '0.700', 'HITCOUNT': '0.700', 'weapon4': '1.030', 'weapon3': '1.628', 'DAMAGECOUNT': '3.267', 'FRAGCOUNT': '6.000'} [2023-02-24 18:14:28,389][177157] DAMAGECOUNT value on done: 71150.0 [2023-02-24 18:14:28,390][177157] Sum rewards: 1.900, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.609', 'AMMO5': '0.020', 'AMMO2': '0.034', 'ARMOR': '0.036', 'WEAPON1': '0.090', 'weapon5': '0.116', 'AMMO3': '0.168', 'AMMO4': '0.171', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.538', 'weapon4': '0.596', 'HITCOUNT': '0.680', 'WEAPON3': '1.050', 'weapon3': '2.360', 'DAMAGECOUNT': '2.550', 'FRAGCOUNT': '7.000'} [2023-02-24 18:14:28,644][177171] DAMAGECOUNT value on done: 72968.0 [2023-02-24 18:14:28,645][177171] Sum rewards: 4.748, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.121', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.050', 'AMMO4': '0.086', 'weapon5': '0.100', 'AMMO3': '0.162', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.392', 'weapon2': '0.876', 'HITCOUNT': '0.900', 'WEAPON3': '1.150', 'weapon3': '2.286', 'DAMAGECOUNT': '3.444', 'FRAGCOUNT': '9.000'} [2023-02-24 18:14:28,806][177171] DAMAGECOUNT value on done: 71707.0 [2023-02-24 18:14:28,807][177171] Sum rewards: 5.317, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.008', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon7': '0.056', 'WEAPON1': '0.060', 'AMMO3': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.132', 'AMMO4': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.408', 'weapon2': '0.536', 'WEAPON3': '0.550', 'HITCOUNT': '0.580', 'weapon4': '0.878', 'weapon3': '1.392', 'DAMAGECOUNT': '2.046', 'FRAGCOUNT': '5.000'} [2023-02-24 18:14:28,980][177155] DAMAGECOUNT value on done: 73334.0 [2023-02-24 18:14:28,980][177155] Sum rewards: 3.966, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.703', 'AMMO5': '0.003', 'ARMOR': '0.024', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon7': '0.064', 'AMMO3': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon2': '0.140', 'AMMO4': '0.161', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.470', 'WEAPON3': '0.600', 'weapon4': '0.778', 'weapon3': '1.530', 'DAMAGECOUNT': '1.761', 'FRAGCOUNT': '5.000'} [2023-02-24 18:14:29,093][177171] DAMAGECOUNT value on done: 71432.0 [2023-02-24 18:14:29,094][177171] Sum rewards: 1.830, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.360', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.088', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.230', 'HITCOUNT': '0.430', 'ARMOR': '0.538', 'WEAPON3': '0.650', 'weapon2': '1.236', 'weapon3': '1.474', 'DAMAGECOUNT': '1.656', 'FRAGCOUNT': '4.000'} [2023-02-24 18:14:29,275][177155] DAMAGECOUNT value on done: 75966.0 [2023-02-24 18:14:29,276][177155] Sum rewards: 5.428, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.798', 'AMMO5': '0.007', 'AMMO2': '0.014', 'ARMOR': '0.024', 'WEAPON1': '0.040', 'AMMO4': '0.071', 'weapon5': '0.072', 'AMMO3': '0.143', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon2': '0.374', 'weapon4': '0.498', 'HITCOUNT': '0.710', 'WEAPON3': '0.850', 'weapon3': '1.856', 'DAMAGECOUNT': '2.766', 'FRAGCOUNT': '7.500'} [2023-02-24 18:14:29,559][177155] DAMAGECOUNT value on done: 76241.0 [2023-02-24 18:14:29,560][177155] Sum rewards: 10.658, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.862', 'AMMO5': '0.014', 'AMMO2': '0.025', 'weapon4': '0.046', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.129', 'weapon5': '0.264', 'WEAPON5': '0.350', 'WEAPON3': '0.900', 'HITCOUNT': '0.940', 'weapon2': '1.388', 'weapon3': '2.004', 'DAMAGECOUNT': '3.426', 'FRAGCOUNT': '11.000'} [2023-02-24 18:14:29,858][177155] DAMAGECOUNT value on done: 69386.0 [2023-02-24 18:14:29,859][177155] Sum rewards: 14.415, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.317', 'AMMO5': '0.017', 'AMMO2': '0.046', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'weapon5': '0.134', 'weapon4': '0.192', 'AMMO4': '0.228', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.770', 'WEAPON3': '0.800', 'weapon2': '1.220', 'weapon3': '2.202', 'DAMAGECOUNT': '3.852', 'FRAGCOUNT': '14.000'} [2023-02-24 18:14:29,931][177153] Updated weights for policy 0, policy_version 10570 (0.0008) [2023-02-24 18:14:31,376][177119] Fps is (10 sec: 14336.0, 60 sec: 13994.7, 300 sec: 14023.6). Total num frames: 43315200. Throughput: 0: 3496.3. Samples: 10829564. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:14:31,376][177119] Avg episode reward: [(0, '6.725')] [2023-02-24 18:14:32,824][177153] Updated weights for policy 0, policy_version 10580 (0.0009) [2023-02-24 18:14:34,952][177156] DAMAGECOUNT value on done: 72922.0 [2023-02-24 18:14:34,952][177156] Sum rewards: 0.826, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.158', 'AMMO2': '0.012', 'ARMOR': '0.012', 'AMMO5': '0.016', 'WEAPON1': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.168', 'weapon5': '0.240', 'weapon2': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.714', 'HITCOUNT': '1.040', 'WEAPON3': '1.150', 'weapon3': '2.332', 'FRAGCOUNT': '4.000', 'DAMAGECOUNT': '4.167'} [2023-02-24 18:14:34,963][177156] DAMAGECOUNT value on done: 70437.0 [2023-02-24 18:14:34,963][177156] Sum rewards: 6.233, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.844', 'ARMOR': '0.008', 'AMMO5': '0.020', 'weapon7': '0.044', 'AMMO2': '0.052', 'WEAPON1': '0.070', 'AMMO3': '0.097', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'AMMO4': '0.261', 'weapon5': '0.314', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.740', 'weapon4': '0.770', 'weapon2': '1.044', 'weapon3': '1.508', 'DAMAGECOUNT': '2.928', 'FRAGCOUNT': '6.500'} [2023-02-24 18:14:35,266][177156] DAMAGECOUNT value on done: 74464.0 [2023-02-24 18:14:35,266][177156] Sum rewards: 6.801, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.871', 'AMMO5': '0.007', 'AMMO2': '0.026', 'WEAPON1': '0.050', 'AMMO3': '0.110', 'AMMO4': '0.128', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon5': '0.322', 'weapon4': '0.602', 'HITCOUNT': '0.680', 'WEAPON3': '0.700', 'weapon2': '1.210', 'weapon3': '1.570', 'DAMAGECOUNT': '2.517', 'FRAGCOUNT': '6.000'} [2023-02-24 18:14:35,277][177156] DAMAGECOUNT value on done: 72994.0 [2023-02-24 18:14:35,277][177156] Sum rewards: 5.800, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.265', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.022', 'WEAPON1': '0.050', 'AMMO3': '0.068', 'weapon5': '0.170', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.390', 'ARMOR': '0.500', 'WEAPON3': '0.550', 'weapon4': '0.780', 'weapon2': '0.960', 'weapon3': '1.266', 'DAMAGECOUNT': '2.247', 'FRAGCOUNT': '4.000'} [2023-02-24 18:14:35,732][177153] Updated weights for policy 0, policy_version 10590 (0.0008) [2023-02-24 18:14:36,376][177119] Fps is (10 sec: 14335.9, 60 sec: 13994.7, 300 sec: 14023.6). Total num frames: 43384832. Throughput: 0: 3496.8. Samples: 10840110. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:14:36,376][177119] Avg episode reward: [(0, '6.677')] [2023-02-24 18:14:38,653][177153] Updated weights for policy 0, policy_version 10600 (0.0009) [2023-02-24 18:14:41,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 43454464. Throughput: 0: 3498.8. Samples: 10861180. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:14:41,376][177119] Avg episode reward: [(0, '6.677')] [2023-02-24 18:14:41,570][177153] Updated weights for policy 0, policy_version 10610 (0.0008) [2023-02-24 18:14:41,947][177170] DAMAGECOUNT value on done: 73490.0 [2023-02-24 18:14:41,947][177170] Sum rewards: 10.479, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.298', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.033', 'WEAPON1': '0.060', 'AMMO3': '0.066', 'AMMO4': '0.165', 'WEAPON4': '0.250', 'weapon5': '0.374', 'WEAPON5': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.420', 'weapon4': '0.632', 'weapon3': '1.106', 'weapon2': '1.378', 'DAMAGECOUNT': '2.472', 'FRAGCOUNT': '9.000'} [2023-02-24 18:14:42,245][177170] DAMAGECOUNT value on done: 77623.0 [2023-02-24 18:14:42,245][177170] Sum rewards: 4.074, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.663', 'AMMO5': '0.017', 'ARMOR': '0.024', 'AMMO2': '0.030', 'WEAPON1': '0.080', 'AMMO3': '0.091', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'weapon5': '0.178', 'WEAPON5': '0.350', 'HITCOUNT': '0.530', 'WEAPON3': '0.700', 'weapon4': '0.752', 'weapon2': '0.952', 'DAMAGECOUNT': '1.542', 'weapon3': '1.692', 'FRAGCOUNT': '5.000'} [2023-02-24 18:14:42,484][177170] DAMAGECOUNT value on done: 66234.0 [2023-02-24 18:14:42,484][177170] Sum rewards: 7.819, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.848', 'weapon4': '0.008', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'WEAPON1': '0.070', 'AMMO3': '0.123', 'weapon5': '0.240', 'WEAPON5': '0.300', 'HITCOUNT': '0.650', 'WEAPON3': '0.800', 'weapon2': '1.262', 'weapon3': '2.194', 'DAMAGECOUNT': '2.376', 'FRAGCOUNT': '8.000'} [2023-02-24 18:14:42,779][177170] DAMAGECOUNT value on done: 76100.0 [2023-02-24 18:14:42,780][177170] Sum rewards: 5.171, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.126', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon7': '0.046', 'WEAPON1': '0.060', 'AMMO4': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.138', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.264', 'WEAPON5': '0.300', 'HITCOUNT': '0.470', 'weapon4': '0.750', 'weapon2': '0.838', 'WEAPON3': '0.850', 'weapon3': '1.564', 'DAMAGECOUNT': '2.226', 'FRAGCOUNT': '7.000'} [2023-02-24 18:14:43,430][177158] DAMAGECOUNT value on done: 70556.0 [2023-02-24 18:14:43,430][177158] Sum rewards: 12.177, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.245', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.018', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.176', 'weapon5': '0.186', 'WEAPON5': '0.200', 'weapon4': '0.270', 'ARMOR': '0.500', 'HITCOUNT': '0.830', 'WEAPON3': '0.900', 'weapon2': '1.208', 'weapon3': '2.040', 'DAMAGECOUNT': '3.930', 'FRAGCOUNT': '12.000'} [2023-02-24 18:14:43,734][177158] DAMAGECOUNT value on done: 70643.0 [2023-02-24 18:14:43,735][177158] Sum rewards: 7.923, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.508', 'AMMO5': '0.012', 'AMMO2': '0.038', 'WEAPON1': '0.060', 'AMMO3': '0.119', 'AMMO4': '0.187', 'weapon5': '0.188', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.454', 'weapon4': '0.586', 'HITCOUNT': '0.690', 'WEAPON3': '0.750', 'weapon2': '1.174', 'weapon3': '1.700', 'DAMAGECOUNT': '2.772', 'FRAGCOUNT': '9.000'} [2023-02-24 18:14:44,516][177153] Updated weights for policy 0, policy_version 10620 (0.0008) [2023-02-24 18:14:44,625][177158] DAMAGECOUNT value on done: 71501.0 [2023-02-24 18:14:44,626][177158] Sum rewards: 0.133, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.938', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.036', 'WEAPON1': '0.070', 'AMMO3': '0.094', 'weapon5': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.420', 'weapon4': '0.560', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.386', 'weapon2': '1.426', 'weapon3': '1.466'} [2023-02-24 18:14:44,925][177158] DAMAGECOUNT value on done: 74654.0 [2023-02-24 18:14:44,925][177158] Sum rewards: 3.844, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.010', 'AMMO2': '0.031', 'WEAPON1': '0.050', 'AMMO3': '0.067', 'WEAPON4': '0.150', 'AMMO4': '0.155', 'weapon5': '0.204', 'HEALTH': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.260', 'WEAPON3': '0.350', 'weapon4': '0.564', 'DAMAGECOUNT': '0.729', 'weapon3': '0.858', 'weapon2': '1.416', 'FRAGCOUNT': '3.000'} [2023-02-24 18:14:45,269][177172] DAMAGECOUNT value on done: 71916.0 [2023-02-24 18:14:45,269][177172] Sum rewards: 10.550, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.212', 'AMMO5': '0.012', 'AMMO2': '0.017', 'ARMOR': '0.028', 'WEAPON1': '0.060', 'AMMO4': '0.087', 'AMMO3': '0.102', 'weapon4': '0.128', 'WEAPON4': '0.150', 'weapon5': '0.168', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'HITCOUNT': '0.830', 'weapon2': '1.420', 'weapon3': '2.036', 'DAMAGECOUNT': '3.423', 'FRAGCOUNT': '8.000'} [2023-02-24 18:14:45,561][177172] DAMAGECOUNT value on done: 70868.0 [2023-02-24 18:14:45,562][177172] Sum rewards: 14.733, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.445', 'AMMO2': '0.009', 'ARMOR': '0.016', 'AMMO5': '0.017', 'AMMO4': '0.045', 'weapon7': '0.048', 'AMMO3': '0.081', 'WEAPON1': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.340', 'WEAPON5': '0.550', 'weapon2': '0.588', 'weapon4': '0.688', 'WEAPON3': '0.700', 'HITCOUNT': '0.800', 'weapon3': '1.840', 'DAMAGECOUNT': '3.705', 'FRAGCOUNT': '12.000'} [2023-02-24 18:14:46,048][177154] DAMAGECOUNT value on done: 77645.0 [2023-02-24 18:14:46,048][177154] Sum rewards: 9.060, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.003', 'AMMO4': '0.012', 'AMMO5': '0.022', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO3': '0.091', 'weapon4': '0.116', 'HEALTH': '0.124', 'weapon5': '0.330', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '0.780', 'weapon2': '1.304', 'weapon3': '1.914', 'DAMAGECOUNT': '3.243', 'FRAGCOUNT': '7.500'} [2023-02-24 18:14:46,350][177154] DAMAGECOUNT value on done: 75298.0 [2023-02-24 18:14:46,351][177154] Sum rewards: 8.533, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.339', 'AMMO5': '0.012', 'AMMO2': '0.018', 'weapon7': '0.046', 'WEAPON1': '0.070', 'AMMO4': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.134', 'WEAPON4': '0.150', 'weapon5': '0.194', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.550', 'weapon4': '0.676', 'WEAPON3': '0.900', 'weapon2': '0.932', 'weapon3': '1.798', 'DAMAGECOUNT': '3.249', 'FRAGCOUNT': '9.000'} [2023-02-24 18:14:46,359][177154] DAMAGECOUNT value on done: 72664.0 [2023-02-24 18:14:46,360][177154] Sum rewards: 5.890, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.280', 'AMMO5': '0.008', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'weapon7': '0.052', 'AMMO3': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.110', 'weapon5': '0.202', 'WEAPON5': '0.300', 'HITCOUNT': '0.460', 'WEAPON3': '0.700', 'weapon3': '1.472', 'weapon2': '1.888', 'DAMAGECOUNT': '2.271', 'FRAGCOUNT': '6.000'} [2023-02-24 18:14:46,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 43524096. Throughput: 0: 3495.5. Samples: 10882054. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:14:46,376][177119] Avg episode reward: [(0, '6.978')] [2023-02-24 18:14:46,660][177154] DAMAGECOUNT value on done: 73319.0 [2023-02-24 18:14:46,661][177154] Sum rewards: 10.056, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.161', 'AMMO5': '0.011', 'AMMO2': '0.038', 'WEAPON1': '0.060', 'weapon5': '0.144', 'AMMO3': '0.166', 'AMMO4': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.508', 'weapon4': '0.586', 'HITCOUNT': '0.910', 'WEAPON3': '1.100', 'weapon3': '2.456', 'DAMAGECOUNT': '5.046', 'FRAGCOUNT': '10.000'} [2023-02-24 18:14:46,667][177172] DAMAGECOUNT value on done: 73156.0 [2023-02-24 18:14:46,668][177172] Sum rewards: 13.515, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.902', 'AMMO2': '0.013', 'AMMO5': '0.015', 'WEAPON1': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'weapon5': '0.156', 'WEAPON5': '0.350', 'weapon4': '0.412', 'ARMOR': '0.470', 'HITCOUNT': '0.790', 'WEAPON3': '0.850', 'weapon2': '0.942', 'weapon3': '1.982', 'DAMAGECOUNT': '4.308', 'FRAGCOUNT': '12.000'} [2023-02-24 18:14:46,960][177172] DAMAGECOUNT value on done: 71637.0 [2023-02-24 18:14:46,960][177172] Sum rewards: 3.241, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.612', 'ARMOR': '0.004', 'AMMO2': '0.015', 'AMMO5': '0.022', 'weapon4': '0.052', 'WEAPON1': '0.070', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'weapon5': '0.180', 'WEAPON5': '0.450', 'HITCOUNT': '0.530', 'WEAPON3': '0.750', 'weapon2': '1.608', 'weapon3': '1.766', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '5.000'} [2023-02-24 18:14:47,215][177157] DAMAGECOUNT value on done: 77831.0 [2023-02-24 18:14:47,215][177157] Sum rewards: 7.699, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.372', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.025', 'WEAPON1': '0.080', 'AMMO4': '0.126', 'AMMO3': '0.141', 'WEAPON4': '0.200', 'weapon5': '0.324', 'weapon4': '0.440', 'WEAPON5': '0.550', 'HITCOUNT': '0.750', 'WEAPON3': '0.900', 'weapon2': '0.944', 'weapon3': '1.942', 'DAMAGECOUNT': '3.624', 'FRAGCOUNT': '8.000'} [2023-02-24 18:14:47,226][177157] DAMAGECOUNT value on done: 71664.0 [2023-02-24 18:14:47,227][177157] Sum rewards: 7.587, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.639', 'AMMO5': '0.017', 'ARMOR': '0.044', 'AMMO2': '0.049', 'WEAPON1': '0.080', 'AMMO3': '0.147', 'weapon4': '0.206', 'AMMO4': '0.246', 'weapon5': '0.342', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'HITCOUNT': '0.590', 'weapon2': '0.682', 'WEAPON3': '0.900', 'weapon3': '2.312', 'DAMAGECOUNT': '2.760', 'FRAGCOUNT': '9.000'} [2023-02-24 18:14:47,445][177153] Updated weights for policy 0, policy_version 10630 (0.0009) [2023-02-24 18:14:47,526][177157] DAMAGECOUNT value on done: 71679.0 [2023-02-24 18:14:47,527][177157] Sum rewards: 2.944, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.644', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon7': '0.048', 'WEAPON1': '0.060', 'weapon5': '0.068', 'AMMO3': '0.081', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.175', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.320', 'WEAPON4': '0.350', 'ARMOR': '0.408', 'WEAPON3': '0.550', 'weapon2': '0.656', 'weapon4': '0.774', 'weapon3': '1.576', 'DAMAGECOUNT': '1.587', 'FRAGCOUNT': '3.000'} [2023-02-24 18:14:47,538][177157] DAMAGECOUNT value on done: 70228.0 [2023-02-24 18:14:47,538][177157] Sum rewards: 5.295, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.535', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.090', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'weapon5': '0.216', 'WEAPON4': '0.250', 'HITCOUNT': '0.370', 'weapon2': '0.572', 'weapon4': '0.590', 'WEAPON3': '0.600', 'ARMOR': '0.943', 'weapon3': '1.462', 'DAMAGECOUNT': '1.608', 'FRAGCOUNT': '4.000'} [2023-02-24 18:14:47,554][177171] DAMAGECOUNT value on done: 72867.0 [2023-02-24 18:14:47,555][177171] Sum rewards: 11.148, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.598', 'ARMOR': '0.010', 'AMMO5': '0.025', 'AMMO2': '0.026', 'WEAPON1': '0.060', 'weapon4': '0.086', 'WEAPON4': '0.100', 'AMMO4': '0.128', 'AMMO3': '0.137', 'weapon5': '0.232', 'WEAPON5': '0.500', 'HITCOUNT': '0.660', 'WEAPON3': '0.850', 'weapon2': '1.024', 'weapon3': '2.276', 'DAMAGECOUNT': '3.633', 'FRAGCOUNT': '11.000'} [2023-02-24 18:14:47,849][177171] DAMAGECOUNT value on done: 73732.0 [2023-02-24 18:14:47,849][177171] Sum rewards: 4.227, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.058', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon7': '0.048', 'AMMO4': '0.093', 'weapon5': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON1': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.105', 'WEAPON5': '0.250', 'HITCOUNT': '0.440', 'WEAPON3': '0.700', 'weapon3': '1.360', 'weapon2': '2.222', 'DAMAGECOUNT': '2.292', 'FRAGCOUNT': '4.000'} [2023-02-24 18:14:48,007][177171] DAMAGECOUNT value on done: 72247.0 [2023-02-24 18:14:48,007][177171] Sum rewards: 2.999, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.242', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon7': '0.048', 'WEAPON1': '0.070', 'AMMO3': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.165', 'WEAPON4': '0.200', 'weapon5': '0.216', 'WEAPON5': '0.250', 'HITCOUNT': '0.380', 'WEAPON3': '0.600', 'weapon4': '0.606', 'weapon2': '0.802', 'weapon3': '1.604', 'DAMAGECOUNT': '1.620', 'FRAGCOUNT': '3.000'} [2023-02-24 18:14:48,171][177155] DAMAGECOUNT value on done: 73855.0 [2023-02-24 18:14:48,172][177155] Sum rewards: 1.833, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.438', 'AMMO5': '0.009', 'AMMO2': '0.034', 'WEAPON1': '0.040', 'AMMO3': '0.071', 'weapon7': '0.114', 'weapon5': '0.150', 'AMMO4': '0.171', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'HITCOUNT': '0.410', 'WEAPON4': '0.450', 'weapon2': '0.710', 'weapon3': '1.022', 'weapon4': '1.146', 'DAMAGECOUNT': '1.563', 'FRAGCOUNT': '3.000'} [2023-02-24 18:14:48,301][177171] DAMAGECOUNT value on done: 72422.0 [2023-02-24 18:14:48,302][177171] Sum rewards: 5.157, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.710', 'AMMO5': '0.017', 'AMMO2': '0.036', 'WEAPON1': '0.100', 'weapon5': '0.114', 'AMMO3': '0.173', 'AMMO4': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.280', 'WEAPON5': '0.450', 'HITCOUNT': '0.730', 'weapon2': '0.914', 'WEAPON3': '1.150', 'weapon3': '2.302', 'DAMAGECOUNT': '2.970', 'FRAGCOUNT': '7.000'} [2023-02-24 18:14:48,471][177155] DAMAGECOUNT value on done: 76776.0 [2023-02-24 18:14:48,471][177155] Sum rewards: 1.356, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.742', 'AMMO5': '0.012', 'AMMO2': '0.023', 'ARMOR': '0.032', 'weapon5': '0.046', 'WEAPON1': '0.070', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon7': '0.102', 'AMMO4': '0.114', 'AMMO3': '0.217', 'WEAPON5': '0.300', 'weapon2': '0.422', 'WEAPON4': '0.450', 'HITCOUNT': '0.710', 'weapon4': '0.734', 'WEAPON3': '1.300', 'weapon3': '2.086', 'DAMAGECOUNT': '2.430', 'FRAGCOUNT': '6.000'} [2023-02-24 18:14:48,752][177155] DAMAGECOUNT value on done: 77428.0 [2023-02-24 18:14:48,752][177155] Sum rewards: 9.799, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.494', 'AMMO2': '0.014', 'AMMO5': '0.015', 'AMMO4': '0.069', 'WEAPON1': '0.090', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'weapon5': '0.368', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.644', 'HITCOUNT': '0.670', 'WEAPON3': '0.700', 'weapon2': '0.780', 'weapon3': '1.544', 'DAMAGECOUNT': '3.540', 'FRAGCOUNT': '9.000'} [2023-02-24 18:14:49,050][177155] DAMAGECOUNT value on done: 70180.0 [2023-02-24 18:14:49,050][177155] Sum rewards: 8.931, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'AMMO3': '0.080', 'AMMO4': '0.081', 'WEAPON5': '0.200', 'weapon5': '0.250', 'WEAPON3': '0.400', 'HITCOUNT': '0.530', 'HEALTH': '1.188', 'weapon3': '1.494', 'weapon2': '1.760', 'DAMAGECOUNT': '2.382', 'FRAGCOUNT': '5.000'} [2023-02-24 18:14:50,357][177153] Updated weights for policy 0, policy_version 10640 (0.0008) [2023-02-24 18:14:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 43593728. Throughput: 0: 3497.1. Samples: 10892576. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 18:14:51,376][177119] Avg episode reward: [(0, '6.928')] [2023-02-24 18:14:53,299][177153] Updated weights for policy 0, policy_version 10650 (0.0008) [2023-02-24 18:14:54,207][177156] DAMAGECOUNT value on done: 73709.0 [2023-02-24 18:14:54,208][177156] Sum rewards: 8.108, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.942', 'AMMO2': '0.007', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.034', 'AMMO3': '0.093', 'weapon5': '0.144', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.500', 'weapon4': '0.604', 'HITCOUNT': '0.650', 'WEAPON3': '0.700', 'weapon2': '0.850', 'weapon3': '1.512', 'DAMAGECOUNT': '2.361', 'FRAGCOUNT': '7.000'} [2023-02-24 18:14:54,219][177156] DAMAGECOUNT value on done: 71542.0 [2023-02-24 18:14:54,219][177156] Sum rewards: 6.649, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.814', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.022', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'weapon4': '0.130', 'AMMO3': '0.171', 'weapon5': '0.198', 'WEAPON5': '0.450', 'HITCOUNT': '0.930', 'WEAPON3': '1.000', 'weapon2': '1.366', 'weapon3': '1.760', 'DAMAGECOUNT': '3.315', 'FRAGCOUNT': '8.000'} [2023-02-24 18:14:54,519][177156] DAMAGECOUNT value on done: 73750.0 [2023-02-24 18:14:54,519][177156] Sum rewards: 5.977, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.364', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.025', 'WEAPON1': '0.050', 'AMMO3': '0.083', 'weapon7': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'weapon5': '0.272', 'weapon4': '0.360', 'HITCOUNT': '0.390', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon3': '1.208', 'weapon2': '1.746', 'DAMAGECOUNT': '2.268', 'FRAGCOUNT': '5.000'} [2023-02-24 18:14:54,529][177156] DAMAGECOUNT value on done: 75131.0 [2023-02-24 18:14:54,529][177156] Sum rewards: 2.958, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.118', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.021', 'WEAPON1': '0.060', 'AMMO4': '0.107', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'weapon5': '0.172', 'WEAPON5': '0.300', 'weapon4': '0.392', 'HITCOUNT': '0.570', 'WEAPON3': '0.900', 'weapon2': '1.016', 'weapon3': '1.970', 'DAMAGECOUNT': '2.001', 'FRAGCOUNT': '6.000'} [2023-02-24 18:14:56,214][177153] Updated weights for policy 0, policy_version 10660 (0.0008) [2023-02-24 18:14:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 43663360. Throughput: 0: 3501.7. Samples: 10913652. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 18:14:56,376][177119] Avg episode reward: [(0, '6.742')] [2023-02-24 18:14:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000010660_43663360.pth... [2023-02-24 18:14:56,446][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000009839_40300544.pth [2023-02-24 18:14:59,139][177153] Updated weights for policy 0, policy_version 10670 (0.0008) [2023-02-24 18:15:01,131][177170] DAMAGECOUNT value on done: 74075.0 [2023-02-24 18:15:01,131][177170] Sum rewards: 5.419, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.016', 'AMMO2': '0.018', 'ARMOR': '0.036', 'WEAPON1': '0.050', 'AMMO3': '0.085', 'AMMO4': '0.092', 'HEALTH': '0.196', 'weapon5': '0.240', 'HITCOUNT': '0.340', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'weapon3': '1.506', 'DAMAGECOUNT': '1.755', 'weapon2': '2.034', 'FRAGCOUNT': '3.500'} [2023-02-24 18:15:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 43732992. Throughput: 0: 3502.4. Samples: 10934678. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:15:01,376][177119] Avg episode reward: [(0, '6.740')] [2023-02-24 18:15:01,428][177170] DAMAGECOUNT value on done: 78243.0 [2023-02-24 18:15:01,428][177170] Sum rewards: 7.633, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.104', 'AMMO2': '0.019', 'weapon7': '0.050', 'AMMO3': '0.087', 'AMMO4': '0.093', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.338', 'WEAPON3': '0.350', 'HITCOUNT': '0.410', 'ARMOR': '0.452', 'weapon2': '0.652', 'weapon3': '1.586', 'DAMAGECOUNT': '1.860', 'FRAGCOUNT': '5.000'} [2023-02-24 18:15:01,614][177170] DAMAGECOUNT value on done: 66997.0 [2023-02-24 18:15:01,614][177170] Sum rewards: 9.301, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.444', 'AMMO5': '0.013', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'weapon7': '0.056', 'AMMO4': '0.080', 'AMMO3': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'HITCOUNT': '0.400', 'WEAPON3': '0.550', 'weapon2': '0.652', 'weapon4': '0.846', 'weapon3': '1.232', 'DAMAGECOUNT': '2.289', 'FRAGCOUNT': '10.000'} [2023-02-24 18:15:01,907][177170] DAMAGECOUNT value on done: 77230.0 [2023-02-24 18:15:01,908][177170] Sum rewards: 9.439, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.303', 'AMMO2': '0.016', 'AMMO5': '0.017', 'AMMO4': '0.078', 'WEAPON1': '0.100', 'AMMO3': '0.122', 'WEAPON4': '0.250', 'weapon5': '0.318', 'weapon4': '0.430', 'WEAPON5': '0.500', 'weapon2': '0.718', 'HITCOUNT': '0.720', 'WEAPON3': '0.800', 'weapon3': '2.032', 'DAMAGECOUNT': '3.390', 'FRAGCOUNT': '11.000'} [2023-02-24 18:15:02,067][177153] Updated weights for policy 0, policy_version 10680 (0.0009) [2023-02-24 18:15:02,570][177158] DAMAGECOUNT value on done: 71273.0 [2023-02-24 18:15:02,570][177158] Sum rewards: 4.305, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.862', 'ARMOR': '0.016', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'AMMO2': '0.045', 'AMMO3': '0.087', 'weapon7': '0.138', 'AMMO4': '0.223', 'weapon5': '0.278', 'AMMO6': '0.380', 'AMMO7': '0.380', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON7': '0.500', 'HITCOUNT': '0.540', 'WEAPON3': '0.550', 'weapon2': '0.878', 'weapon4': '1.060', 'weapon3': '1.284', 'DAMAGECOUNT': '2.151', 'FRAGCOUNT': '4.000'} [2023-02-24 18:15:02,875][177158] DAMAGECOUNT value on done: 71110.0 [2023-02-24 18:15:02,876][177158] Sum rewards: 4.269, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.434', 'AMMO5': '0.015', 'AMMO2': '0.016', 'weapon7': '0.048', 'AMMO4': '0.079', 'WEAPON1': '0.080', 'AMMO3': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon2': '0.184', 'WEAPON7': '0.200', 'weapon5': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'HITCOUNT': '0.330', 'ARMOR': '0.484', 'WEAPON3': '0.600', 'weapon3': '0.918', 'weapon4': '1.206', 'DAMAGECOUNT': '1.401', 'FRAGCOUNT': '5.000'} [2023-02-24 18:15:03,733][177158] DAMAGECOUNT value on done: 71905.0 [2023-02-24 18:15:03,733][177158] Sum rewards: 2.976, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.526', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'weapon4': '0.058', 'AMMO3': '0.060', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'weapon5': '0.226', 'WEAPON5': '0.300', 'HITCOUNT': '0.340', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'DAMAGECOUNT': '1.212', 'weapon3': '1.426', 'FRAGCOUNT': '2.000', 'weapon2': '2.078'} [2023-02-24 18:15:04,042][177158] DAMAGECOUNT value on done: 75800.0 [2023-02-24 18:15:04,043][177158] Sum rewards: 5.097, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.141', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.046', 'WEAPON1': '0.060', 'AMMO3': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.120', 'weapon5': '0.168', 'AMMO4': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.676', 'WEAPON3': '0.700', 'HITCOUNT': '0.700', 'weapon2': '0.766', 'weapon3': '1.416', 'DAMAGECOUNT': '3.438', 'FRAGCOUNT': '6.000'} [2023-02-24 18:15:04,233][177155] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 18:15:04,434][177172] DAMAGECOUNT value on done: 73073.0 [2023-02-24 18:15:04,434][177172] Sum rewards: 10.733, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.527', 'AMMO2': '0.009', 'AMMO5': '0.015', 'AMMO4': '0.044', 'WEAPON1': '0.060', 'AMMO3': '0.144', 'weapon5': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.476', 'ARMOR': '0.477', 'weapon2': '0.702', 'HITCOUNT': '0.810', 'WEAPON3': '0.900', 'weapon3': '2.226', 'DAMAGECOUNT': '3.471', 'FRAGCOUNT': '11.000'} [2023-02-24 18:15:04,726][177172] DAMAGECOUNT value on done: 72097.0 [2023-02-24 18:15:04,726][177172] Sum rewards: 12.081, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.157', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon7': '0.082', 'AMMO4': '0.116', 'AMMO3': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.638', 'WEAPON3': '0.700', 'HITCOUNT': '0.850', 'weapon2': '1.314', 'weapon3': '1.454', 'DAMAGECOUNT': '3.687', 'FRAGCOUNT': '12.000'} [2023-02-24 18:15:04,985][177153] Updated weights for policy 0, policy_version 10690 (0.0008) [2023-02-24 18:15:05,202][177154] DAMAGECOUNT value on done: 78450.0 [2023-02-24 18:15:05,203][177154] Sum rewards: 7.746, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.492', 'AMMO5': '0.015', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.130', 'WEAPON4': '0.200', 'weapon5': '0.218', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon4': '0.452', 'HITCOUNT': '0.580', 'WEAPON3': '0.800', 'weapon2': '0.998', 'weapon3': '1.950', 'DAMAGECOUNT': '2.415', 'FRAGCOUNT': '9.000'} [2023-02-24 18:15:05,502][177154] DAMAGECOUNT value on done: 73677.0 [2023-02-24 18:15:05,502][177154] Sum rewards: 7.687, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.679', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.031', 'WEAPON1': '0.060', 'AMMO3': '0.064', 'AMMO4': '0.156', 'weapon5': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.386', 'WEAPON3': '0.450', 'HITCOUNT': '0.810', 'weapon4': '1.260', 'weapon3': '1.418', 'DAMAGECOUNT': '3.039', 'FRAGCOUNT': '6.000'} [2023-02-24 18:15:05,514][177154] DAMAGECOUNT value on done: 75754.0 [2023-02-24 18:15:05,515][177154] Sum rewards: 5.942, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.190', 'AMMO2': '0.000', 'AMMO4': '0.000', 'WEAPON1': '0.010', 'AMMO3': '0.037', 'weapon7': '0.078', 'WEAPON4': '0.100', 'weapon2': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.290', 'weapon4': '0.348', 'weapon3': '0.394', 'DAMAGECOUNT': '1.368', 'FRAGCOUNT': '5.000'} [2023-02-24 18:15:05,791][177172] DAMAGECOUNT value on done: 73405.0 [2023-02-24 18:15:05,792][177172] Sum rewards: 2.449, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.990', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO3': '0.049', 'weapon7': '0.050', 'AMMO4': '0.066', 'weapon5': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.190', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'weapon2': '0.462', 'ARMOR': '0.475', 'DAMAGECOUNT': '0.747', 'weapon4': '0.752', 'weapon3': '0.770', 'FRAGCOUNT': '2.000'} [2023-02-24 18:15:05,813][177154] DAMAGECOUNT value on done: 74049.0 [2023-02-24 18:15:05,814][177154] Sum rewards: 1.259, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.435', 'AMMO5': '0.017', 'AMMO2': '0.042', 'WEAPON1': '0.070', 'weapon5': '0.114', 'AMMO3': '0.158', 'AMMO4': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.488', 'HITCOUNT': '0.570', 'weapon2': '0.636', 'WEAPON3': '1.050', 'weapon3': '2.050', 'DAMAGECOUNT': '2.190', 'FRAGCOUNT': '5.000'} [2023-02-24 18:15:06,088][177172] DAMAGECOUNT value on done: 72698.0 [2023-02-24 18:15:06,088][177172] Sum rewards: 10.940, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.755', 'AMMO5': '0.022', 'AMMO2': '0.038', 'WEAPON1': '0.090', 'AMMO3': '0.105', 'AMMO4': '0.189', 'weapon5': '0.354', 'WEAPON5': '0.600', 'HITCOUNT': '0.730', 'WEAPON3': '0.800', 'weapon2': '1.486', 'weapon3': '1.848', 'DAMAGECOUNT': '3.183', 'FRAGCOUNT': '10.000'} [2023-02-24 18:15:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 43802624. Throughput: 0: 3503.4. Samples: 10945238. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:15:06,376][177119] Avg episode reward: [(0, '6.916')] [2023-02-24 18:15:06,419][177157] DAMAGECOUNT value on done: 78631.0 [2023-02-24 18:15:06,419][177157] Sum rewards: 7.333, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.140', 'AMMO2': '0.014', 'AMMO5': '0.017', 'ARMOR': '0.024', 'weapon7': '0.034', 'WEAPON1': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.119', 'weapon4': '0.134', 'WEAPON4': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon5': '0.216', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'HITCOUNT': '0.740', 'weapon2': '1.416', 'weapon3': '1.766', 'DAMAGECOUNT': '2.400', 'FRAGCOUNT': '7.000'} [2023-02-24 18:15:06,434][177157] DAMAGECOUNT value on done: 72292.0 [2023-02-24 18:15:06,434][177157] Sum rewards: 6.194, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.022', 'WEAPON1': '0.050', 'HEALTH': '0.054', 'AMMO3': '0.080', 'AMMO4': '0.111', 'weapon5': '0.200', 'weapon4': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '0.550', 'HITCOUNT': '0.640', 'weapon2': '1.288', 'weapon3': '1.828', 'DAMAGECOUNT': '1.884', 'FRAGCOUNT': '7.000'} [2023-02-24 18:15:06,592][177171] DAMAGECOUNT value on done: 73510.0 [2023-02-24 18:15:06,593][177171] Sum rewards: 2.238, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.675', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.048', 'AMMO3': '0.090', 'weapon7': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.500', 'HITCOUNT': '0.510', 'WEAPON3': '0.600', 'weapon4': '0.632', 'weapon3': '1.228', 'DAMAGECOUNT': '1.929', 'FRAGCOUNT': '5.000'} [2023-02-24 18:15:06,729][177157] DAMAGECOUNT value on done: 72735.0 [2023-02-24 18:15:06,729][177157] Sum rewards: 6.667, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'HEALTH': '0.046', 'weapon5': '0.056', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'WEAPON5': '0.150', 'ARMOR': '0.428', 'weapon4': '0.490', 'WEAPON3': '0.700', 'HITCOUNT': '0.760', 'weapon2': '0.808', 'weapon3': '2.366', 'DAMAGECOUNT': '2.760', 'FRAGCOUNT': '6.000'} [2023-02-24 18:15:06,740][177157] DAMAGECOUNT value on done: 71038.0 [2023-02-24 18:15:06,740][177157] Sum rewards: 6.686, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.286', 'AMMO2': '0.012', 'AMMO5': '0.025', 'weapon7': '0.056', 'AMMO4': '0.059', 'AMMO3': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON1': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.162', 'weapon5': '0.418', 'HITCOUNT': '0.470', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon2': '1.198', 'weapon3': '1.792', 'DAMAGECOUNT': '2.430', 'FRAGCOUNT': '7.000'} [2023-02-24 18:15:06,890][177171] DAMAGECOUNT value on done: 74132.0 [2023-02-24 18:15:06,890][177171] Sum rewards: 3.822, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.530', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.010', 'AMMO3': '0.037', 'weapon7': '0.050', 'AMMO4': '0.051', 'weapon2': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.300', 'weapon4': '0.414', 'weapon3': '0.554', 'DAMAGECOUNT': '1.200', 'FRAGCOUNT': '3.000'} [2023-02-24 18:15:07,020][177171] DAMAGECOUNT value on done: 73570.0 [2023-02-24 18:15:07,021][177171] Sum rewards: 13.685, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.821', 'AMMO5': '0.011', 'AMMO2': '0.021', 'WEAPON1': '0.050', 'AMMO4': '0.103', 'AMMO3': '0.115', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'ARMOR': '0.408', 'weapon4': '0.604', 'WEAPON3': '0.700', 'HITCOUNT': '0.750', 'weapon2': '1.042', 'weapon3': '1.650', 'DAMAGECOUNT': '3.969', 'FRAGCOUNT': '12.000'} [2023-02-24 18:15:07,307][177171] DAMAGECOUNT value on done: 72849.0 [2023-02-24 18:15:07,308][177171] Sum rewards: 5.404, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.087', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.063', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.108', 'WEAPON5': '0.150', 'weapon7': '0.174', 'HITCOUNT': '0.350', 'weapon4': '0.378', 'WEAPON3': '0.450', 'weapon2': '1.250', 'DAMAGECOUNT': '1.281', 'weapon3': '1.356', 'FRAGCOUNT': '4.000'} [2023-02-24 18:15:07,354][177155] DAMAGECOUNT value on done: 75141.0 [2023-02-24 18:15:07,355][177155] Sum rewards: 16.408, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO2': '0.033', 'AMMO3': '0.080', 'weapon5': '0.110', 'weapon7': '0.116', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'WEAPON4': '0.200', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.586', 'weapon2': '0.806', 'HITCOUNT': '0.870', 'HEALTH': '1.540', 'weapon3': '1.806', 'DAMAGECOUNT': '3.858', 'FRAGCOUNT': '13.000'} [2023-02-24 18:15:07,647][177155] DAMAGECOUNT value on done: 77890.0 [2023-02-24 18:15:07,648][177155] Sum rewards: 7.915, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.472', 'AMMO5': '0.005', 'weapon5': '0.024', 'ARMOR': '0.032', 'AMMO2': '0.033', 'WEAPON1': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'AMMO4': '0.164', 'WEAPON4': '0.400', 'weapon4': '0.454', 'weapon2': '0.794', 'HITCOUNT': '0.920', 'WEAPON3': '1.000', 'weapon3': '2.448', 'DAMAGECOUNT': '3.342', 'FRAGCOUNT': '10.000'} [2023-02-24 18:15:07,921][177153] Updated weights for policy 0, policy_version 10700 (0.0008) [2023-02-24 18:15:07,931][177155] DAMAGECOUNT value on done: 77726.0 [2023-02-24 18:15:07,932][177155] Sum rewards: 2.070, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.704', 'AMMO5': '0.010', 'AMMO2': '0.016', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'weapon7': '0.064', 'AMMO4': '0.080', 'AMMO3': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'HITCOUNT': '0.290', 'weapon5': '0.304', 'weapon4': '0.414', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.894', 'weapon2': '0.898', 'weapon3': '1.422', 'FRAGCOUNT': '3.000'} [2023-02-24 18:15:08,227][177155] DAMAGECOUNT value on done: 71345.0 [2023-02-24 18:15:08,228][177155] Sum rewards: 9.680, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.385', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO3': '0.050', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.280', 'WEAPON3': '0.350', 'ARMOR': '0.465', 'HITCOUNT': '0.610', 'weapon3': '1.184', 'weapon2': '1.516', 'DAMAGECOUNT': '2.595', 'FRAGCOUNT': '6.000'} [2023-02-24 18:15:10,831][177153] Updated weights for policy 0, policy_version 10710 (0.0008) [2023-02-24 18:15:11,376][177119] Fps is (10 sec: 13926.1, 60 sec: 13994.6, 300 sec: 13995.8). Total num frames: 43872256. Throughput: 0: 3505.5. Samples: 10966262. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:15:11,377][177119] Avg episode reward: [(0, '7.007')] [2023-02-24 18:15:13,407][177156] DAMAGECOUNT value on done: 72419.0 [2023-02-24 18:15:13,408][177156] Sum rewards: 4.660, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.572', 'AMMO5': '0.022', 'AMMO2': '0.031', 'weapon7': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'AMMO4': '0.152', 'WEAPON7': '0.200', 'weapon4': '0.422', 'WEAPON5': '0.450', 'weapon5': '0.492', 'HITCOUNT': '0.710', 'WEAPON3': '0.750', 'weapon2': '1.176', 'weapon3': '1.576', 'DAMAGECOUNT': '2.631', 'FRAGCOUNT': '5.000'} [2023-02-24 18:15:13,429][177156] DAMAGECOUNT value on done: 74088.0 [2023-02-24 18:15:13,430][177156] Sum rewards: 5.815, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.349', 'AMMO5': '0.009', 'AMMO2': '0.024', 'WEAPON1': '0.050', 'AMMO3': '0.052', 'weapon7': '0.118', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'weapon5': '0.216', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'HITCOUNT': '0.280', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'weapon2': '0.480', 'weapon4': '0.824', 'weapon3': '1.062', 'DAMAGECOUNT': '1.137', 'FRAGCOUNT': '4.000'} [2023-02-24 18:15:13,714][177156] DAMAGECOUNT value on done: 74975.0 [2023-02-24 18:15:13,714][177156] Sum rewards: 9.718, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.620', 'AMMO5': '0.005', 'AMMO2': '0.030', 'WEAPON1': '0.060', 'AMMO3': '0.095', 'weapon5': '0.096', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.580', 'WEAPON3': '0.700', 'HITCOUNT': '0.930', 'weapon2': '1.520', 'weapon3': '1.548', 'DAMAGECOUNT': '3.675', 'FRAGCOUNT': '9.000'} [2023-02-24 18:15:13,745][177156] DAMAGECOUNT value on done: 75891.0 [2023-02-24 18:15:13,745][177156] Sum rewards: 6.328, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.210', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.018', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.064', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'weapon5': '0.260', 'HITCOUNT': '0.510', 'weapon2': '0.856', 'WEAPON3': '0.950', 'DAMAGECOUNT': '2.280', 'weapon3': '2.620', 'FRAGCOUNT': '8.000'} [2023-02-24 18:15:13,765][177153] Updated weights for policy 0, policy_version 10720 (0.0008) [2023-02-24 18:15:16,376][177119] Fps is (10 sec: 13926.1, 60 sec: 13994.6, 300 sec: 13995.8). Total num frames: 43941888. Throughput: 0: 3503.4. Samples: 10987216. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:15:16,377][177119] Avg episode reward: [(0, '6.939')] [2023-02-24 18:15:16,717][177153] Updated weights for policy 0, policy_version 10730 (0.0008) [2023-02-24 18:15:19,661][177153] Updated weights for policy 0, policy_version 10740 (0.0009) [2023-02-24 18:15:20,366][177170] DAMAGECOUNT value on done: 75135.0 [2023-02-24 18:15:20,367][177170] Sum rewards: 9.644, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.894', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.012', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.157', 'weapon4': '0.288', 'WEAPON5': '0.350', 'weapon5': '0.372', 'ARMOR': '0.449', 'HITCOUNT': '0.850', 'weapon2': '0.858', 'WEAPON3': '1.050', 'weapon3': '2.064', 'DAMAGECOUNT': '3.180', 'FRAGCOUNT': '11.500'} [2023-02-24 18:15:20,668][177170] DAMAGECOUNT value on done: 79101.0 [2023-02-24 18:15:20,668][177170] Sum rewards: 8.537, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.774', 'ARMOR': '0.004', 'AMMO2': '0.025', 'AMMO5': '0.027', 'WEAPON1': '0.080', 'AMMO3': '0.113', 'AMMO4': '0.125', 'weapon5': '0.190', 'weapon4': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.600', 'HITCOUNT': '0.720', 'WEAPON3': '0.850', 'weapon2': '1.044', 'weapon3': '2.066', 'DAMAGECOUNT': '2.574', 'FRAGCOUNT': '9.000'} [2023-02-24 18:15:20,732][177170] DAMAGECOUNT value on done: 67833.0 [2023-02-24 18:15:20,733][177170] Sum rewards: 5.854, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.720', 'AMMO5': '0.012', 'AMMO2': '0.024', 'WEAPON1': '0.050', 'AMMO3': '0.104', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'weapon5': '0.190', 'WEAPON4': '0.250', 'weapon4': '0.388', 'ARMOR': '0.484', 'HITCOUNT': '0.620', 'WEAPON3': '0.650', 'weapon2': '0.858', 'weapon3': '1.666', 'DAMAGECOUNT': '2.508', 'FRAGCOUNT': '6.000'} [2023-02-24 18:15:21,035][177170] DAMAGECOUNT value on done: 79047.0 [2023-02-24 18:15:21,036][177170] Sum rewards: 18.752, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.470', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'weapon4': '0.030', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'weapon5': '0.204', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.920', 'weapon3': '1.466', 'weapon2': '2.036', 'DAMAGECOUNT': '5.451', 'FRAGCOUNT': '13.000'} [2023-02-24 18:15:21,376][177119] Fps is (10 sec: 13926.7, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 44011520. Throughput: 0: 3499.5. Samples: 10997586. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:15:21,376][177119] Avg episode reward: [(0, '7.091')] [2023-02-24 18:15:21,410][177140] Saving new best policy, reward=7.091! [2023-02-24 18:15:21,848][177158] DAMAGECOUNT value on done: 72595.0 [2023-02-24 18:15:21,849][177158] Sum rewards: 10.945, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.280', 'AMMO5': '0.015', 'AMMO2': '0.022', 'WEAPON1': '0.050', 'AMMO4': '0.109', 'AMMO3': '0.121', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.366', 'weapon5': '0.474', 'WEAPON3': '0.800', 'weapon2': '0.996', 'HITCOUNT': '1.060', 'weapon3': '1.746', 'DAMAGECOUNT': '3.966', 'FRAGCOUNT': '11.000'} [2023-02-24 18:15:22,151][177158] DAMAGECOUNT value on done: 72232.0 [2023-02-24 18:15:22,152][177158] Sum rewards: 9.194, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.678', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.035', 'WEAPON1': '0.060', 'weapon4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'WEAPON5': '0.350', 'weapon5': '0.528', 'WEAPON3': '0.700', 'HITCOUNT': '0.710', 'weapon2': '1.438', 'weapon3': '1.626', 'DAMAGECOUNT': '3.366', 'FRAGCOUNT': '9.000'} [2023-02-24 18:15:22,602][177153] Updated weights for policy 0, policy_version 10750 (0.0008) [2023-02-24 18:15:23,032][177158] DAMAGECOUNT value on done: 72670.0 [2023-02-24 18:15:23,033][177158] Sum rewards: 10.169, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.008', 'ARMOR': '0.008', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.070', 'HEALTH': '0.118', 'weapon5': '0.176', 'WEAPON5': '0.200', 'weapon4': '0.270', 'WEAPON3': '0.400', 'HITCOUNT': '0.580', 'weapon2': '1.544', 'weapon3': '1.594', 'DAMAGECOUNT': '2.295', 'FRAGCOUNT': '8.000'} [2023-02-24 18:15:23,332][177158] DAMAGECOUNT value on done: 77212.0 [2023-02-24 18:15:23,332][177158] Sum rewards: 13.875, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.622', 'AMMO5': '0.012', 'AMMO2': '0.018', 'ARMOR': '0.024', 'WEAPON1': '0.050', 'AMMO4': '0.090', 'AMMO3': '0.110', 'weapon5': '0.122', 'WEAPON4': '0.150', 'weapon4': '0.172', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'weapon2': '0.842', 'HITCOUNT': '0.920', 'weapon3': '2.484', 'DAMAGECOUNT': '4.203', 'FRAGCOUNT': '11.000'} [2023-02-24 18:15:23,664][177172] DAMAGECOUNT value on done: 74180.0 [2023-02-24 18:15:23,664][177172] Sum rewards: 9.732, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.644', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'weapon5': '0.146', 'WEAPON5': '0.250', 'weapon4': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.790', 'WEAPON3': '0.850', 'weapon2': '0.934', 'weapon3': '2.216', 'DAMAGECOUNT': '3.321', 'FRAGCOUNT': '9.000'} [2023-02-24 18:15:23,963][177172] DAMAGECOUNT value on done: 73292.0 [2023-02-24 18:15:23,963][177172] Sum rewards: 10.911, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.021', 'AMMO5': '0.007', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'AMMO3': '0.116', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'weapon5': '0.194', 'WEAPON5': '0.200', 'weapon4': '0.510', 'WEAPON3': '0.700', 'weapon2': '0.748', 'HITCOUNT': '0.890', 'weapon3': '2.152', 'DAMAGECOUNT': '3.585', 'FRAGCOUNT': '9.000'} [2023-02-24 18:15:24,454][177154] DAMAGECOUNT value on done: 79479.0 [2023-02-24 18:15:24,454][177154] Sum rewards: 6.872, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.654', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON1': '0.050', 'AMMO4': '0.103', 'AMMO3': '0.146', 'weapon5': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.430', 'weapon2': '0.582', 'HITCOUNT': '0.750', 'WEAPON3': '1.000', 'weapon3': '2.388', 'DAMAGECOUNT': '3.087', 'FRAGCOUNT': '9.000'} [2023-02-24 18:15:24,746][177154] DAMAGECOUNT value on done: 76459.0 [2023-02-24 18:15:24,747][177154] Sum rewards: 9.730, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.497', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.033', 'WEAPON1': '0.050', 'AMMO3': '0.059', 'WEAPON4': '0.150', 'AMMO4': '0.163', 'weapon5': '0.216', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'HITCOUNT': '0.460', 'weapon4': '0.566', 'weapon3': '1.070', 'weapon2': '1.380', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '7.000'} [2023-02-24 18:15:24,766][177154] DAMAGECOUNT value on done: 75103.0 [2023-02-24 18:15:24,767][177154] Sum rewards: 11.089, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.112', 'AMMO5': '0.010', 'AMMO2': '0.023', 'WEAPON1': '0.050', 'AMMO3': '0.110', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'weapon5': '0.204', 'WEAPON5': '0.300', 'weapon4': '0.448', 'WEAPON3': '0.750', 'weapon2': '0.938', 'HITCOUNT': '0.980', 'weapon3': '2.046', 'DAMAGECOUNT': '4.278', 'FRAGCOUNT': '10.000'} [2023-02-24 18:15:25,057][177154] DAMAGECOUNT value on done: 74940.0 [2023-02-24 18:15:25,057][177154] Sum rewards: 10.259, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.830', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.028', 'weapon7': '0.048', 'weapon5': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.122', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.450', 'weapon4': '0.668', 'WEAPON3': '0.750', 'HITCOUNT': '0.750', 'weapon2': '1.056', 'weapon3': '1.694', 'DAMAGECOUNT': '2.673', 'FRAGCOUNT': '11.000'} [2023-02-24 18:15:25,119][177172] DAMAGECOUNT value on done: 74574.0 [2023-02-24 18:15:25,119][177172] Sum rewards: 11.420, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.459', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.015', 'WEAPON1': '0.080', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.284', 'weapon5': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.748', 'WEAPON3': '0.750', 'HITCOUNT': '0.920', 'weapon3': '2.126', 'DAMAGECOUNT': '3.507', 'FRAGCOUNT': '10.000'} [2023-02-24 18:15:25,424][177172] DAMAGECOUNT value on done: 74356.0 [2023-02-24 18:15:25,425][177172] Sum rewards: 14.661, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.378', 'AMMO2': '0.002', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.012', 'WEAPON4': '0.100', 'weapon4': '0.110', 'AMMO3': '0.114', 'weapon5': '0.182', 'WEAPON5': '0.250', 'WEAPON3': '0.800', 'HITCOUNT': '0.980', 'weapon3': '1.512', 'weapon2': '1.920', 'DAMAGECOUNT': '4.788', 'FRAGCOUNT': '14.500'} [2023-02-24 18:15:25,554][177153] Updated weights for policy 0, policy_version 10760 (0.0009) [2023-02-24 18:15:25,731][177157] DAMAGECOUNT value on done: 79022.0 [2023-02-24 18:15:25,732][177157] Sum rewards: 2.579, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.868', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON1': '0.030', 'weapon5': '0.048', 'AMMO4': '0.060', 'AMMO3': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.280', 'HITCOUNT': '0.390', 'ARMOR': '0.465', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.173', 'weapon2': '1.264', 'weapon3': '1.390', 'FRAGCOUNT': '2.000'} [2023-02-24 18:15:25,742][177157] DAMAGECOUNT value on done: 73419.0 [2023-02-24 18:15:25,743][177157] Sum rewards: 4.608, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.978', 'ARMOR': '0.008', 'AMMO5': '0.010', 'weapon7': '0.016', 'weapon5': '0.026', 'AMMO2': '0.047', 'WEAPON1': '0.070', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'AMMO4': '0.236', 'WEAPON4': '0.350', 'weapon4': '0.780', 'HITCOUNT': '0.910', 'weapon2': '1.098', 'WEAPON3': '1.100', 'weapon3': '1.640', 'DAMAGECOUNT': '3.381', 'FRAGCOUNT': '10.000'} [2023-02-24 18:15:25,863][177171] DAMAGECOUNT value on done: 75018.0 [2023-02-24 18:15:25,863][177171] Sum rewards: 15.566, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'weapon4': '0.082', 'AMMO4': '0.091', 'HEALTH': '0.131', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'weapon5': '0.188', 'WEAPON5': '0.200', 'WEAPON3': '0.800', 'weapon2': '0.926', 'HITCOUNT': '0.960', 'weapon3': '2.312', 'DAMAGECOUNT': '4.524', 'FRAGCOUNT': '14.000'} [2023-02-24 18:15:26,041][177157] DAMAGECOUNT value on done: 73440.0 [2023-02-24 18:15:26,042][177157] Sum rewards: 10.768, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.082', 'weapon5': '0.142', 'WEAPON5': '0.200', 'weapon4': '0.294', 'WEAPON3': '0.400', 'HITCOUNT': '0.470', 'HEALTH': '0.489', 'ARMOR': '0.500', 'weapon3': '1.552', 'weapon2': '1.624', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '8.000'} [2023-02-24 18:15:26,053][177157] DAMAGECOUNT value on done: 72022.0 [2023-02-24 18:15:26,053][177157] Sum rewards: 6.563, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.064', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'weapon4': '0.044', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'weapon5': '0.134', 'HITCOUNT': '0.730', 'WEAPON3': '0.900', 'weapon2': '1.032', 'weapon3': '2.464', 'DAMAGECOUNT': '2.952', 'FRAGCOUNT': '8.000'} [2023-02-24 18:15:26,153][177171] DAMAGECOUNT value on done: 75262.0 [2023-02-24 18:15:26,154][177171] Sum rewards: 5.575, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.185', 'ARMOR': '0.016', 'AMMO5': '0.018', 'AMMO2': '0.045', 'WEAPON1': '0.110', 'weapon5': '0.178', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'AMMO4': '0.225', 'WEAPON5': '0.400', 'weapon4': '0.476', 'weapon2': '0.594', 'HITCOUNT': '0.940', 'WEAPON3': '1.200', 'weapon3': '2.266', 'DAMAGECOUNT': '3.390', 'FRAGCOUNT': '10.000'} [2023-02-24 18:15:26,278][177171] DAMAGECOUNT value on done: 74299.0 [2023-02-24 18:15:26,279][177171] Sum rewards: 8.092, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.187', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.054', 'AMMO4': '0.074', 'AMMO3': '0.079', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.170', 'WEAPON5': '0.250', 'weapon4': '0.280', 'WEAPON3': '0.500', 'HITCOUNT': '0.550', 'weapon3': '1.262', 'weapon2': '1.948', 'DAMAGECOUNT': '2.187', 'FRAGCOUNT': '5.000'} [2023-02-24 18:15:26,376][177119] Fps is (10 sec: 13926.8, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 44081152. Throughput: 0: 3495.1. Samples: 11018460. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:15:26,376][177119] Avg episode reward: [(0, '7.405')] [2023-02-24 18:15:26,407][177140] Saving new best policy, reward=7.405! [2023-02-24 18:15:26,590][177171] DAMAGECOUNT value on done: 74174.0 [2023-02-24 18:15:26,590][177171] Sum rewards: 9.209, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.949', 'AMMO5': '0.015', 'AMMO2': '0.023', 'ARMOR': '0.036', 'WEAPON1': '0.050', 'weapon5': '0.084', 'AMMO4': '0.113', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.504', 'weapon2': '0.516', 'WEAPON3': '1.000', 'HITCOUNT': '1.040', 'weapon3': '2.400', 'DAMAGECOUNT': '3.975', 'FRAGCOUNT': '11.000'} [2023-02-24 18:15:26,608][177155] DAMAGECOUNT value on done: 76310.0 [2023-02-24 18:15:26,608][177155] Sum rewards: 9.829, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.051', 'weapon7': '0.062', 'AMMO4': '0.083', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HEALTH': '0.190', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'weapon4': '0.448', 'HITCOUNT': '0.500', 'weapon3': '1.056', 'weapon2': '1.312', 'DAMAGECOUNT': '2.607', 'FRAGCOUNT': '6.000'} [2023-02-24 18:15:26,902][177155] DAMAGECOUNT value on done: 79038.0 [2023-02-24 18:15:26,902][177155] Sum rewards: 6.845, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.446', 'AMMO5': '0.007', 'weapon5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.136', 'AMMO4': '0.169', 'weapon4': '0.326', 'HITCOUNT': '0.820', 'WEAPON3': '0.900', 'weapon2': '1.386', 'weapon3': '1.882', 'DAMAGECOUNT': '3.444', 'FRAGCOUNT': '8.000'} [2023-02-24 18:15:27,188][177155] DAMAGECOUNT value on done: 78736.0 [2023-02-24 18:15:27,189][177155] Sum rewards: 5.660, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.738', 'AMMO5': '0.010', 'AMMO2': '0.021', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.120', 'weapon5': '0.198', 'weapon4': '0.210', 'WEAPON5': '0.250', 'HITCOUNT': '0.730', 'WEAPON3': '0.850', 'weapon2': '1.218', 'weapon3': '2.004', 'DAMAGECOUNT': '3.030', 'FRAGCOUNT': '6.000'} [2023-02-24 18:15:27,485][177155] DAMAGECOUNT value on done: 72496.0 [2023-02-24 18:15:27,486][177155] Sum rewards: 3.172, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.620', 'AMMO5': '0.015', 'AMMO2': '0.031', 'WEAPON1': '0.060', 'weapon7': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.129', 'AMMO4': '0.157', 'weapon5': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.492', 'weapon2': '0.932', 'WEAPON3': '0.950', 'HITCOUNT': '0.980', 'weapon3': '1.880', 'DAMAGECOUNT': '3.453', 'FRAGCOUNT': '5.000'} [2023-02-24 18:15:28,409][177153] Updated weights for policy 0, policy_version 10770 (0.0008) [2023-02-24 18:15:31,315][177153] Updated weights for policy 0, policy_version 10780 (0.0009) [2023-02-24 18:15:31,376][177119] Fps is (10 sec: 14335.9, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 44154880. Throughput: 0: 3500.2. Samples: 11039564. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:15:31,376][177119] Avg episode reward: [(0, '7.539')] [2023-02-24 18:15:31,377][177140] Saving new best policy, reward=7.539! [2023-02-24 18:15:32,721][177156] DAMAGECOUNT value on done: 73715.0 [2023-02-24 18:15:32,722][177156] Sum rewards: 5.815, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.174', 'AMMO5': '0.010', 'AMMO2': '0.019', 'ARMOR': '0.036', 'WEAPON1': '0.050', 'weapon5': '0.074', 'AMMO4': '0.096', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.486', 'HITCOUNT': '0.850', 'weapon2': '0.928', 'WEAPON3': '1.150', 'weapon3': '2.170', 'DAMAGECOUNT': '3.888', 'FRAGCOUNT': '11.000'} [2023-02-24 18:15:32,741][177156] DAMAGECOUNT value on done: 75007.0 [2023-02-24 18:15:32,742][177156] Sum rewards: 2.403, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.210', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.022', 'WEAPON1': '0.060', 'weapon4': '0.066', 'AMMO4': '0.112', 'weapon5': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'WEAPON5': '0.400', 'HITCOUNT': '0.720', 'WEAPON3': '1.000', 'weapon2': '1.364', 'weapon3': '2.146', 'DAMAGECOUNT': '2.757', 'FRAGCOUNT': '6.000'} [2023-02-24 18:15:33,023][177156] DAMAGECOUNT value on done: 75977.0 [2023-02-24 18:15:33,023][177156] Sum rewards: 8.519, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.040', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.004', 'WEAPON1': '0.020', 'AMMO4': '0.021', 'weapon7': '0.046', 'weapon5': '0.050', 'AMMO3': '0.059', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.352', 'WEAPON3': '0.450', 'HITCOUNT': '0.720', 'weapon4': '0.824', 'weapon3': '1.010', 'DAMAGECOUNT': '3.006', 'FRAGCOUNT': '6.000'} [2023-02-24 18:15:33,047][177156] DAMAGECOUNT value on done: 76353.0 [2023-02-24 18:15:33,048][177156] Sum rewards: 0.585, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.512', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon7': '0.078', 'AMMO3': '0.087', 'AMMO4': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.380', 'weapon2': '0.502', 'WEAPON3': '0.550', 'weapon4': '0.792', 'weapon3': '1.152', 'DAMAGECOUNT': '1.386', 'FRAGCOUNT': '3.000'} [2023-02-24 18:15:34,271][177153] Updated weights for policy 0, policy_version 10790 (0.0008) [2023-02-24 18:15:36,376][177119] Fps is (10 sec: 14335.9, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 44224512. Throughput: 0: 3497.9. Samples: 11049980. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:15:36,376][177119] Avg episode reward: [(0, '7.389')] [2023-02-24 18:15:37,187][177153] Updated weights for policy 0, policy_version 10800 (0.0009) [2023-02-24 18:15:39,601][177170] DAMAGECOUNT value on done: 75810.0 [2023-02-24 18:15:39,602][177170] Sum rewards: 4.403, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.558', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.031', 'WEAPON1': '0.040', 'AMMO3': '0.112', 'weapon5': '0.138', 'AMMO4': '0.156', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.630', 'WEAPON3': '0.700', 'weapon2': '0.712', 'weapon4': '0.740', 'weapon3': '1.348', 'DAMAGECOUNT': '2.025', 'FRAGCOUNT': '6.000'} [2023-02-24 18:15:39,904][177170] DAMAGECOUNT value on done: 79756.0 [2023-02-24 18:15:39,904][177170] Sum rewards: 4.982, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.398', 'AMMO2': '0.011', 'weapon4': '0.012', 'AMMO5': '0.017', 'AMMO4': '0.054', 'WEAPON1': '0.070', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'weapon5': '0.214', 'WEAPON5': '0.400', 'HITCOUNT': '0.460', 'WEAPON3': '0.650', 'weapon2': '1.210', 'DAMAGECOUNT': '1.965', 'weapon3': '2.124', 'FRAGCOUNT': '5.500'} [2023-02-24 18:15:39,969][177170] DAMAGECOUNT value on done: 68678.0 [2023-02-24 18:15:39,969][177170] Sum rewards: 6.260, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.099', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon4': '0.044', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO3': '0.106', 'HITCOUNT': '0.450', 'WEAPON3': '0.700', 'weapon3': '1.596', 'weapon2': '1.994', 'DAMAGECOUNT': '2.535', 'FRAGCOUNT': '6.000'} [2023-02-24 18:15:40,136][177153] Updated weights for policy 0, policy_version 10810 (0.0008) [2023-02-24 18:15:40,262][177170] DAMAGECOUNT value on done: 80494.0 [2023-02-24 18:15:40,263][177170] Sum rewards: 14.269, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.185', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'AMMO3': '0.083', 'weapon7': '0.084', 'AMMO4': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.520', 'WEAPON3': '0.650', 'weapon2': '0.746', 'HITCOUNT': '0.910', 'weapon3': '1.686', 'DAMAGECOUNT': '4.341', 'FRAGCOUNT': '11.000'} [2023-02-24 18:15:41,039][177158] DAMAGECOUNT value on done: 73267.0 [2023-02-24 18:15:41,040][177158] Sum rewards: 3.913, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.428', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'weapon5': '0.140', 'AMMO3': '0.147', 'AMMO4': '0.154', 'WEAPON4': '0.250', 'weapon4': '0.346', 'HITCOUNT': '0.460', 'WEAPON3': '0.800', 'weapon2': '0.962', 'DAMAGECOUNT': '2.016', 'weapon3': '2.136', 'FRAGCOUNT': '6.000'} [2023-02-24 18:15:41,342][177158] DAMAGECOUNT value on done: 73529.0 [2023-02-24 18:15:41,343][177158] Sum rewards: 14.290, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.370', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.066', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.136', 'weapon4': '0.442', 'WEAPON3': '0.850', 'HITCOUNT': '0.890', 'weapon2': '0.918', 'weapon3': '1.756', 'DAMAGECOUNT': '3.891', 'FRAGCOUNT': '15.000'} [2023-02-24 18:15:41,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 44294144. Throughput: 0: 3495.9. Samples: 11070968. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:15:41,376][177119] Avg episode reward: [(0, '7.528')] [2023-02-24 18:15:42,192][177158] DAMAGECOUNT value on done: 73427.0 [2023-02-24 18:15:42,192][177158] Sum rewards: 5.961, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.744', 'AMMO5': '0.009', 'AMMO2': '0.016', 'ARMOR': '0.028', 'WEAPON1': '0.030', 'AMMO4': '0.078', 'AMMO3': '0.087', 'weapon5': '0.186', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.298', 'WEAPON3': '0.500', 'HITCOUNT': '0.600', 'weapon2': '1.386', 'weapon3': '1.716', 'DAMAGECOUNT': '2.271', 'FRAGCOUNT': '5.000'} [2023-02-24 18:15:42,475][177158] DAMAGECOUNT value on done: 77902.0 [2023-02-24 18:15:42,476][177158] Sum rewards: 7.721, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.274', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'ARMOR': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'weapon5': '0.094', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'weapon4': '0.198', 'WEAPON3': '0.550', 'HITCOUNT': '0.550', 'weapon2': '1.648', 'weapon3': '1.648', 'DAMAGECOUNT': '2.070', 'FRAGCOUNT': '6.000'} [2023-02-24 18:15:42,871][177172] DAMAGECOUNT value on done: 74774.0 [2023-02-24 18:15:42,872][177172] Sum rewards: 8.276, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.585', 'AMMO5': '0.012', 'AMMO2': '0.022', 'WEAPON1': '0.060', 'AMMO3': '0.094', 'AMMO4': '0.108', 'weapon5': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.420', 'ARMOR': '0.506', 'weapon4': '0.538', 'WEAPON3': '0.600', 'weapon2': '1.186', 'weapon3': '1.562', 'DAMAGECOUNT': '1.782', 'FRAGCOUNT': '8.000'} [2023-02-24 18:15:43,083][177153] Updated weights for policy 0, policy_version 10820 (0.0008) [2023-02-24 18:15:43,169][177172] DAMAGECOUNT value on done: 74369.0 [2023-02-24 18:15:43,170][177172] Sum rewards: 9.348, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.961', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon7': '0.052', 'AMMO3': '0.097', 'AMMO4': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.174', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.468', 'WEAPON3': '0.700', 'HITCOUNT': '0.810', 'weapon2': '1.232', 'weapon3': '1.696', 'DAMAGECOUNT': '3.231', 'FRAGCOUNT': '9.000'} [2023-02-24 18:15:43,715][177154] DAMAGECOUNT value on done: 80204.0 [2023-02-24 18:15:43,715][177154] Sum rewards: 10.508, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.650', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON1': '0.050', 'AMMO4': '0.056', 'weapon7': '0.066', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.298', 'HITCOUNT': '0.500', 'WEAPON3': '0.550', 'weapon3': '1.418', 'weapon2': '1.446', 'DAMAGECOUNT': '2.175', 'FRAGCOUNT': '9.000'} [2023-02-24 18:15:44,008][177154] DAMAGECOUNT value on done: 77189.0 [2023-02-24 18:15:44,009][177154] Sum rewards: 6.788, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.197', 'AMMO5': '0.025', 'AMMO2': '0.027', 'WEAPON1': '0.060', 'AMMO3': '0.134', 'AMMO4': '0.136', 'WEAPON4': '0.200', 'weapon4': '0.204', 'weapon5': '0.286', 'ARMOR': '0.439', 'WEAPON5': '0.500', 'HITCOUNT': '0.630', 'weapon2': '0.700', 'WEAPON3': '0.850', 'DAMAGECOUNT': '2.190', 'weapon3': '2.354', 'FRAGCOUNT': '9.000'} [2023-02-24 18:15:44,018][177154] DAMAGECOUNT value on done: 75688.0 [2023-02-24 18:15:44,018][177154] Sum rewards: 2.019, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.342', 'AMMO2': '0.011', 'AMMO5': '0.015', 'ARMOR': '0.029', 'AMMO4': '0.053', 'WEAPON1': '0.070', 'AMMO3': '0.094', 'weapon4': '0.138', 'WEAPON4': '0.200', 'weapon5': '0.322', 'WEAPON5': '0.350', 'HITCOUNT': '0.390', 'WEAPON3': '0.650', 'weapon2': '1.360', 'weapon3': '1.674', 'DAMAGECOUNT': '1.755', 'FRAGCOUNT': '3.000'} [2023-02-24 18:15:44,310][177172] DAMAGECOUNT value on done: 75165.0 [2023-02-24 18:15:44,310][177172] Sum rewards: 2.402, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.170', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.012', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'weapon5': '0.140', 'weapon7': '0.200', 'WEAPON4': '0.300', 'AMMO6': '0.400', 'AMMO7': '0.400', 'HITCOUNT': '0.410', 'ARMOR': '0.461', 'WEAPON3': '0.600', 'WEAPON7': '0.600', 'weapon2': '0.730', 'weapon4': '0.734', 'weapon3': '1.114', 'DAMAGECOUNT': '1.773', 'FRAGCOUNT': '4.000'} [2023-02-24 18:15:44,315][177154] DAMAGECOUNT value on done: 76715.0 [2023-02-24 18:15:44,315][177154] Sum rewards: 5.476, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.460', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon7': '0.048', 'AMMO4': '0.104', 'AMMO3': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.566', 'WEAPON3': '0.700', 'HITCOUNT': '0.820', 'weapon2': '0.980', 'weapon3': '1.748', 'DAMAGECOUNT': '3.525', 'FRAGCOUNT': '7.000'} [2023-02-24 18:15:44,603][177172] DAMAGECOUNT value on done: 75610.0 [2023-02-24 18:15:44,603][177172] Sum rewards: 12.247, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.298', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.019', 'WEAPON1': '0.050', 'AMMO3': '0.080', 'AMMO4': '0.096', 'weapon4': '0.106', 'WEAPON4': '0.150', 'weapon5': '0.158', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.940', 'weapon3': '1.726', 'weapon2': '1.734', 'DAMAGECOUNT': '3.762', 'FRAGCOUNT': '9.500'} [2023-02-24 18:15:44,940][177157] DAMAGECOUNT value on done: 80030.0 [2023-02-24 18:15:44,940][177157] Sum rewards: 5.766, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.768', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO2': '0.049', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'AMMO4': '0.246', 'weapon5': '0.254', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon2': '0.442', 'weapon4': '0.606', 'HITCOUNT': '0.710', 'WEAPON3': '1.050', 'weapon3': '1.774', 'DAMAGECOUNT': '3.024', 'FRAGCOUNT': '8.000'} [2023-02-24 18:15:44,951][177157] DAMAGECOUNT value on done: 74346.0 [2023-02-24 18:15:44,951][177157] Sum rewards: 5.476, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.126', 'AMMO5': '0.010', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon5': '0.090', 'AMMO3': '0.115', 'AMMO4': '0.123', 'WEAPON5': '0.200', 'weapon4': '0.422', 'weapon2': '0.712', 'HITCOUNT': '0.730', 'WEAPON3': '0.800', 'weapon3': '2.004', 'DAMAGECOUNT': '2.781', 'FRAGCOUNT': '6.000'} [2023-02-24 18:15:45,112][177171] DAMAGECOUNT value on done: 75859.0 [2023-02-24 18:15:45,113][177171] Sum rewards: 6.704, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.492', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon7': '0.052', 'AMMO3': '0.078', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.127', 'weapon5': '0.154', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.680', 'weapon4': '0.824', 'weapon2': '1.096', 'weapon3': '1.284', 'DAMAGECOUNT': '2.523', 'FRAGCOUNT': '7.000'} [2023-02-24 18:15:45,246][177157] DAMAGECOUNT value on done: 74285.0 [2023-02-24 18:15:45,247][177157] Sum rewards: 3.281, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.526', 'AMMO5': '0.018', 'AMMO2': '0.020', 'ARMOR': '0.022', 'WEAPON1': '0.040', 'weapon7': '0.048', 'weapon5': '0.094', 'AMMO4': '0.100', 'AMMO3': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '0.650', 'weapon4': '0.668', 'HITCOUNT': '0.690', 'weapon2': '0.940', 'weapon3': '1.478', 'DAMAGECOUNT': '2.535', 'FRAGCOUNT': '5.000'} [2023-02-24 18:15:45,258][177157] DAMAGECOUNT value on done: 72928.0 [2023-02-24 18:15:45,258][177157] Sum rewards: 6.652, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.935', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.087', 'weapon4': '0.096', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.236', 'WEAPON5': '0.250', 'HITCOUNT': '0.430', 'WEAPON3': '0.600', 'weapon2': '1.368', 'weapon3': '1.818', 'DAMAGECOUNT': '2.718', 'FRAGCOUNT': '6.000'} [2023-02-24 18:15:45,408][177171] DAMAGECOUNT value on done: 76487.0 [2023-02-24 18:15:45,408][177171] Sum rewards: 11.147, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.060', 'AMMO5': '0.014', 'AMMO2': '0.027', 'WEAPON1': '0.070', 'AMMO3': '0.100', 'AMMO4': '0.133', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon5': '0.430', 'weapon4': '0.536', 'weapon2': '0.626', 'HITCOUNT': '0.790', 'WEAPON3': '0.800', 'weapon3': '1.856', 'DAMAGECOUNT': '3.675', 'FRAGCOUNT': '11.000'} [2023-02-24 18:15:45,535][177171] DAMAGECOUNT value on done: 74737.0 [2023-02-24 18:15:45,535][177171] Sum rewards: 1.377, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.554', 'AMMO5': '0.009', 'AMMO2': '0.013', 'WEAPON1': '0.040', 'weapon7': '0.062', 'AMMO4': '0.065', 'AMMO3': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.138', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.282', 'HITCOUNT': '0.360', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.314', 'weapon3': '1.414', 'weapon2': '1.836', 'FRAGCOUNT': '5.000'} [2023-02-24 18:15:45,795][177155] DAMAGECOUNT value on done: 77259.0 [2023-02-24 18:15:45,795][177155] Sum rewards: 8.306, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.508', 'AMMO2': '0.014', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.070', 'weapon5': '0.170', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.206', 'ARMOR': '0.400', 'HITCOUNT': '0.880', 'weapon2': '1.040', 'WEAPON3': '1.100', 'weapon3': '2.198', 'DAMAGECOUNT': '2.847', 'FRAGCOUNT': '10.000'} [2023-02-24 18:15:45,835][177171] DAMAGECOUNT value on done: 74579.0 [2023-02-24 18:15:45,836][177171] Sum rewards: 3.475, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.588', 'AMMO5': '0.007', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.122', 'AMMO4': '0.134', 'weapon5': '0.198', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.340', 'weapon4': '0.432', 'WEAPON3': '0.650', 'weapon2': '0.944', 'DAMAGECOUNT': '1.215', 'weapon3': '1.526', 'FRAGCOUNT': '5.000'} [2023-02-24 18:15:46,006][177153] Updated weights for policy 0, policy_version 10830 (0.0008) [2023-02-24 18:15:46,102][177155] DAMAGECOUNT value on done: 80235.0 [2023-02-24 18:15:46,102][177155] Sum rewards: 11.014, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.374', 'AMMO2': '0.004', 'AMMO5': '0.017', 'AMMO4': '0.020', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.080', 'AMMO3': '0.113', 'weapon5': '0.156', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'HITCOUNT': '0.940', 'weapon2': '1.406', 'weapon3': '2.010', 'DAMAGECOUNT': '3.591', 'FRAGCOUNT': '11.000'} [2023-02-24 18:15:46,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.6, 300 sec: 14009.7). Total num frames: 44363776. Throughput: 0: 3494.6. Samples: 11091936. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:15:46,376][177119] Avg episode reward: [(0, '7.352')] [2023-02-24 18:15:46,388][177155] DAMAGECOUNT value on done: 79696.0 [2023-02-24 18:15:46,388][177155] Sum rewards: 8.443, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.833', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.020', 'AMMO3': '0.073', 'weapon5': '0.092', 'AMMO4': '0.099', 'WEAPON4': '0.200', 'weapon4': '0.232', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'HITCOUNT': '0.660', 'weapon3': '1.440', 'weapon2': '2.044', 'DAMAGECOUNT': '2.880', 'FRAGCOUNT': '9.000'} [2023-02-24 18:15:46,690][177155] DAMAGECOUNT value on done: 73379.0 [2023-02-24 18:15:46,690][177155] Sum rewards: 5.889, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.522', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.030', 'AMMO4': '0.041', 'weapon4': '0.072', 'weapon5': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.610', 'WEAPON3': '0.950', 'weapon2': '1.622', 'weapon3': '1.950', 'DAMAGECOUNT': '2.649', 'FRAGCOUNT': '8.000'} [2023-02-24 18:15:48,926][177153] Updated weights for policy 0, policy_version 10840 (0.0008) [2023-02-24 18:15:51,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 44433408. Throughput: 0: 3494.5. Samples: 11102492. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:15:51,376][177119] Avg episode reward: [(0, '7.447')] [2023-02-24 18:15:51,850][177153] Updated weights for policy 0, policy_version 10850 (0.0008) [2023-02-24 18:15:51,976][177156] DAMAGECOUNT value on done: 74546.0 [2023-02-24 18:15:51,977][177156] Sum rewards: 4.569, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.029', 'HEALTH': '0.031', 'AMMO3': '0.081', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.138', 'AMMO4': '0.145', 'WEAPON5': '0.200', 'weapon5': '0.204', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'weapon4': '0.490', 'HITCOUNT': '0.690', 'weapon3': '1.464', 'weapon2': '1.468', 'DAMAGECOUNT': '2.358', 'FRAGCOUNT': '3.000'} [2023-02-24 18:15:51,999][177156] DAMAGECOUNT value on done: 76438.0 [2023-02-24 18:15:52,000][177156] Sum rewards: 12.103, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.712', 'AMMO5': '0.012', 'ARMOR': '0.012', 'AMMO2': '0.026', 'WEAPON1': '0.040', 'weapon7': '0.052', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.130', 'AMMO3': '0.133', 'weapon5': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.634', 'weapon4': '0.680', 'WEAPON3': '0.950', 'HITCOUNT': '0.960', 'weapon3': '2.052', 'DAMAGECOUNT': '4.293', 'FRAGCOUNT': '13.000'} [2023-02-24 18:15:52,288][177156] DAMAGECOUNT value on done: 77068.0 [2023-02-24 18:15:52,289][177156] Sum rewards: 11.576, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.714', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.050', 'AMMO3': '0.063', 'AMMO4': '0.087', 'weapon5': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'weapon4': '0.522', 'HITCOUNT': '0.740', 'weapon3': '1.224', 'weapon2': '1.370', 'DAMAGECOUNT': '3.273', 'FRAGCOUNT': '9.000'} [2023-02-24 18:15:52,309][177156] DAMAGECOUNT value on done: 77317.0 [2023-02-24 18:15:52,310][177156] Sum rewards: 11.331, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.185', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.264', 'WEAPON3': '0.800', 'HITCOUNT': '0.840', 'weapon2': '1.448', 'weapon3': '1.898', 'DAMAGECOUNT': '2.892', 'FRAGCOUNT': '13.000'} [2023-02-24 18:15:54,318][177156] Large shaping reward 2.574 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.552, 184.0), ('weapon5', 0.002)] [2023-02-24 18:15:54,772][177153] Updated weights for policy 0, policy_version 10860 (0.0008) [2023-02-24 18:15:56,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 44503040. Throughput: 0: 3494.4. Samples: 11123508. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:15:56,376][177119] Avg episode reward: [(0, '7.590')] [2023-02-24 18:15:56,379][177140] Saving new best policy, reward=7.590! [2023-02-24 18:15:57,675][177153] Updated weights for policy 0, policy_version 10870 (0.0008) [2023-02-24 18:15:58,771][177170] DAMAGECOUNT value on done: 76724.0 [2023-02-24 18:15:58,772][177170] Sum rewards: 3.995, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.373', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.043', 'weapon7': '0.068', 'weapon5': '0.122', 'AMMO3': '0.126', 'WEAPON5': '0.200', 'AMMO4': '0.217', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON4': '0.400', 'WEAPON7': '0.400', 'HITCOUNT': '0.610', 'weapon4': '0.724', 'WEAPON3': '0.800', 'weapon2': '0.878', 'weapon3': '1.854', 'DAMAGECOUNT': '2.742', 'FRAGCOUNT': '6.000'} [2023-02-24 18:15:59,068][177170] DAMAGECOUNT value on done: 81105.0 [2023-02-24 18:15:59,068][177170] Sum rewards: 10.751, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.730', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'weapon7': '0.052', 'weapon5': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'weapon4': '0.466', 'weapon2': '0.778', 'HITCOUNT': '0.860', 'WEAPON3': '0.950', 'weapon3': '2.236', 'DAMAGECOUNT': '4.047', 'FRAGCOUNT': '12.000'} [2023-02-24 18:15:59,113][177170] DAMAGECOUNT value on done: 69791.0 [2023-02-24 18:15:59,114][177170] Sum rewards: 4.308, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.602', 'ARMOR': '0.008', 'AMMO2': '0.009', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.044', 'AMMO3': '0.088', 'weapon5': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.470', 'weapon2': '0.692', 'WEAPON3': '0.700', 'HITCOUNT': '0.960', 'weapon3': '1.624', 'DAMAGECOUNT': '3.339', 'FRAGCOUNT': '5.000'} [2023-02-24 18:15:59,411][177170] DAMAGECOUNT value on done: 81214.0 [2023-02-24 18:15:59,412][177170] Sum rewards: 10.136, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'AMMO4': '0.061', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'weapon5': '0.104', 'weapon4': '0.108', 'WEAPON5': '0.150', 'HEALTH': '0.441', 'WEAPON3': '0.450', 'HITCOUNT': '0.580', 'weapon3': '1.202', 'DAMAGECOUNT': '2.160', 'weapon2': '2.374', 'FRAGCOUNT': '9.000'} [2023-02-24 18:16:00,187][177158] DAMAGECOUNT value on done: 74490.0 [2023-02-24 18:16:00,187][177158] Sum rewards: 8.941, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.436', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon7': '0.046', 'WEAPON1': '0.050', 'AMMO3': '0.075', 'AMMO4': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon5': '0.364', 'WEAPON3': '0.450', 'weapon4': '0.670', 'HITCOUNT': '0.760', 'weapon2': '0.776', 'weapon3': '1.632', 'DAMAGECOUNT': '3.669', 'FRAGCOUNT': '8.000'} [2023-02-24 18:16:00,496][177158] DAMAGECOUNT value on done: 74091.0 [2023-02-24 18:16:00,496][177158] Sum rewards: 4.352, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.922', 'AMMO2': '0.009', 'AMMO5': '0.011', 'ARMOR': '0.024', 'WEAPON1': '0.040', 'AMMO4': '0.043', 'AMMO3': '0.096', 'weapon5': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.440', 'weapon4': '0.550', 'WEAPON3': '0.650', 'weapon2': '1.338', 'weapon3': '1.480', 'DAMAGECOUNT': '1.686', 'FRAGCOUNT': '5.000'} [2023-02-24 18:16:00,625][177153] Updated weights for policy 0, policy_version 10880 (0.0008) [2023-02-24 18:16:01,342][177158] DAMAGECOUNT value on done: 74510.0 [2023-02-24 18:16:01,343][177158] Sum rewards: 5.376, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.838', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'AMMO4': '0.065', 'weapon5': '0.088', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'HITCOUNT': '0.850', 'weapon2': '0.902', 'WEAPON3': '1.200', 'weapon3': '2.680', 'DAMAGECOUNT': '3.249', 'FRAGCOUNT': '9.000'} [2023-02-24 18:16:01,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 44572672. Throughput: 0: 3495.8. Samples: 11144526. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:16:01,376][177119] Avg episode reward: [(0, '7.608')] [2023-02-24 18:16:01,377][177140] Saving new best policy, reward=7.608! [2023-02-24 18:16:01,647][177158] DAMAGECOUNT value on done: 78542.0 [2023-02-24 18:16:01,648][177158] Sum rewards: 1.436, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.874', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'AMMO4': '0.095', 'AMMO3': '0.101', 'weapon5': '0.140', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'HITCOUNT': '0.450', 'weapon2': '0.698', 'WEAPON3': '0.750', 'weapon4': '0.912', 'weapon3': '1.754', 'DAMAGECOUNT': '1.920', 'FRAGCOUNT': '5.000'} [2023-02-24 18:16:02,054][177172] DAMAGECOUNT value on done: 75519.0 [2023-02-24 18:16:02,055][177172] Sum rewards: 0.772, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.290', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.024', 'WEAPON1': '0.070', 'AMMO4': '0.120', 'weapon4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.178', 'weapon5': '0.210', 'WEAPON5': '0.350', 'HITCOUNT': '0.530', 'weapon2': '1.000', 'WEAPON3': '1.200', 'DAMAGECOUNT': '2.235', 'weapon3': '2.342', 'FRAGCOUNT': '5.000'} [2023-02-24 18:16:02,351][177172] DAMAGECOUNT value on done: 75277.0 [2023-02-24 18:16:02,351][177172] Sum rewards: 7.819, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.316', 'AMMO5': '0.007', 'weapon5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'AMMO3': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'WEAPON4': '0.250', 'weapon4': '0.308', 'WEAPON3': '0.750', 'HITCOUNT': '0.830', 'weapon2': '1.078', 'weapon3': '1.954', 'DAMAGECOUNT': '2.724', 'FRAGCOUNT': '9.000'} [2023-02-24 18:16:02,880][177154] DAMAGECOUNT value on done: 81572.0 [2023-02-24 18:16:02,880][177154] Sum rewards: 14.007, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.425', 'AMMO5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.035', 'weapon7': '0.048', 'WEAPON1': '0.060', 'AMMO3': '0.075', 'weapon5': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.174', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'WEAPON3': '0.550', 'weapon4': '0.680', 'HITCOUNT': '0.860', 'weapon2': '1.064', 'weapon3': '1.738', 'DAMAGECOUNT': '3.936', 'FRAGCOUNT': '12.000'} [2023-02-24 18:16:03,175][177154] DAMAGECOUNT value on done: 77889.0 [2023-02-24 18:16:03,175][177154] Sum rewards: 3.803, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.180', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon7': '0.050', 'AMMO3': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.130', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'HITCOUNT': '0.650', 'weapon4': '0.650', 'WEAPON3': '0.800', 'weapon2': '1.072', 'weapon3': '1.588', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '7.000'} [2023-02-24 18:16:03,185][177154] DAMAGECOUNT value on done: 76767.0 [2023-02-24 18:16:03,185][177154] Sum rewards: 5.869, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.112', 'AMMO2': '0.011', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'AMMO4': '0.057', 'weapon4': '0.140', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.198', 'WEAPON5': '0.400', 'HITCOUNT': '0.830', 'WEAPON3': '1.000', 'weapon2': '1.152', 'weapon3': '2.098', 'DAMAGECOUNT': '3.237', 'FRAGCOUNT': '9.000'} [2023-02-24 18:16:03,477][177154] DAMAGECOUNT value on done: 78057.0 [2023-02-24 18:16:03,477][177154] Sum rewards: 12.560, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.139', 'AMMO5': '0.017', 'AMMO2': '0.023', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'AMMO4': '0.113', 'weapon5': '0.272', 'weapon4': '0.274', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'HITCOUNT': '0.890', 'weapon2': '0.900', 'weapon3': '2.062', 'DAMAGECOUNT': '4.026', 'FRAGCOUNT': '11.000'} [2023-02-24 18:16:03,504][177172] DAMAGECOUNT value on done: 76310.0 [2023-02-24 18:16:03,505][177172] Sum rewards: 11.687, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.565', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.017', 'weapon7': '0.032', 'WEAPON1': '0.050', 'weapon5': '0.078', 'AMMO4': '0.085', 'weapon4': '0.110', 'AMMO3': '0.135', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.760', 'WEAPON3': '0.900', 'weapon2': '1.326', 'weapon3': '2.250', 'DAMAGECOUNT': '3.435', 'FRAGCOUNT': '12.000'} [2023-02-24 18:16:03,563][177153] Updated weights for policy 0, policy_version 10890 (0.0008) [2023-02-24 18:16:03,800][177172] DAMAGECOUNT value on done: 76443.0 [2023-02-24 18:16:03,800][177172] Sum rewards: 5.637, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.494', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'AMMO4': '0.188', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'weapon4': '0.688', 'HITCOUNT': '0.810', 'weapon3': '1.232', 'weapon2': '1.340', 'DAMAGECOUNT': '2.499', 'FRAGCOUNT': '7.000'} [2023-02-24 18:16:04,210][177157] DAMAGECOUNT value on done: 80965.0 [2023-02-24 18:16:04,211][177157] Sum rewards: 3.926, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.094', 'AMMO5': '0.004', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.040', 'weapon7': '0.050', 'AMMO4': '0.057', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.442', 'weapon4': '0.636', 'WEAPON3': '0.650', 'HITCOUNT': '0.780', 'weapon3': '1.682', 'DAMAGECOUNT': '2.805', 'FRAGCOUNT': '6.000'} [2023-02-24 18:16:04,221][177157] DAMAGECOUNT value on done: 75487.0 [2023-02-24 18:16:04,221][177157] Sum rewards: 4.313, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.445', 'AMMO2': '0.003', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO4': '0.013', 'WEAPON1': '0.030', 'weapon5': '0.064', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.310', 'weapon4': '0.476', 'HITCOUNT': '0.930', 'WEAPON3': '1.250', 'weapon3': '2.606', 'DAMAGECOUNT': '3.423', 'FRAGCOUNT': '9.000'} [2023-02-24 18:16:04,332][177171] DAMAGECOUNT value on done: 76213.0 [2023-02-24 18:16:04,332][177171] Sum rewards: 2.044, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.634', 'AMMO5': '0.015', 'AMMO2': '0.039', 'WEAPON1': '0.050', 'weapon4': '0.066', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'AMMO4': '0.196', 'HITCOUNT': '0.250', 'weapon5': '0.286', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.062', 'weapon3': '1.070', 'weapon2': '2.310', 'FRAGCOUNT': '4.000'} [2023-02-24 18:16:04,520][177157] DAMAGECOUNT value on done: 75139.0 [2023-02-24 18:16:04,520][177157] Sum rewards: 3.666, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.876', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.029', 'weapon5': '0.060', 'weapon7': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.122', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.560', 'weapon4': '0.658', 'WEAPON3': '0.750', 'weapon2': '0.780', 'weapon3': '1.640', 'DAMAGECOUNT': '2.562', 'FRAGCOUNT': '6.000'} [2023-02-24 18:16:04,532][177157] DAMAGECOUNT value on done: 74358.0 [2023-02-24 18:16:04,532][177157] Sum rewards: 12.038, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.268', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.118', 'WEAPON4': '0.400', 'weapon4': '0.440', 'WEAPON3': '0.850', 'weapon2': '1.112', 'HITCOUNT': '1.120', 'weapon3': '2.158', 'DAMAGECOUNT': '4.290', 'FRAGCOUNT': '14.000'} [2023-02-24 18:16:04,637][177171] DAMAGECOUNT value on done: 77554.0 [2023-02-24 18:16:04,638][177171] Sum rewards: 4.369, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.390', 'ARMOR': '0.004', 'AMMO2': '0.014', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.071', 'AMMO3': '0.122', 'WEAPON5': '0.150', 'weapon5': '0.168', 'WEAPON4': '0.250', 'weapon4': '0.534', 'WEAPON3': '0.800', 'HITCOUNT': '0.810', 'weapon2': '1.022', 'weapon3': '1.558', 'DAMAGECOUNT': '3.201', 'FRAGCOUNT': '6.000'} [2023-02-24 18:16:04,737][177171] DAMAGECOUNT value on done: 75453.0 [2023-02-24 18:16:04,737][177171] Sum rewards: 3.510, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.020', 'AMMO5': '0.015', 'AMMO2': '0.037', 'WEAPON1': '0.080', 'AMMO3': '0.091', 'weapon5': '0.124', 'AMMO4': '0.187', 'WEAPON4': '0.300', 'weapon4': '0.368', 'WEAPON5': '0.400', 'HITCOUNT': '0.540', 'WEAPON3': '0.650', 'weapon2': '1.384', 'weapon3': '1.706', 'DAMAGECOUNT': '2.148', 'FRAGCOUNT': '4.000'} [2023-02-24 18:16:04,964][177155] DAMAGECOUNT value on done: 77867.0 [2023-02-24 18:16:04,964][177155] Sum rewards: 5.066, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.510', 'AMMO5': '0.017', 'AMMO2': '0.037', 'WEAPON1': '0.040', 'weapon7': '0.086', 'AMMO3': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.185', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon5': '0.302', 'weapon4': '0.320', 'HITCOUNT': '0.440', 'WEAPON3': '0.600', 'weapon3': '1.440', 'weapon2': '1.446', 'DAMAGECOUNT': '1.824', 'FRAGCOUNT': '6.000'} [2023-02-24 18:16:05,030][177171] DAMAGECOUNT value on done: 75141.0 [2023-02-24 18:16:05,031][177171] Sum rewards: 3.350, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.090', 'AMMO5': '0.003', 'ARMOR': '0.024', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.056', 'weapon7': '0.072', 'AMMO3': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.123', 'WEAPON4': '0.350', 'HITCOUNT': '0.450', 'WEAPON3': '0.500', 'weapon4': '0.832', 'weapon2': '0.994', 'weapon3': '1.112', 'DAMAGECOUNT': '1.686', 'FRAGCOUNT': '6.000'} [2023-02-24 18:16:05,260][177155] DAMAGECOUNT value on done: 81639.0 [2023-02-24 18:16:05,261][177155] Sum rewards: 17.292, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.940', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'weapon5': '0.054', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'weapon4': '0.294', 'ARMOR': '0.480', 'WEAPON3': '0.850', 'HITCOUNT': '1.010', 'weapon2': '1.128', 'weapon3': '2.282', 'DAMAGECOUNT': '4.212', 'FRAGCOUNT': '15.000'} [2023-02-24 18:16:05,553][177155] DAMAGECOUNT value on done: 80264.0 [2023-02-24 18:16:05,554][177155] Sum rewards: 6.437, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.478', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'AMMO3': '0.064', 'AMMO4': '0.086', 'weapon7': '0.096', 'weapon5': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.480', 'ARMOR': '0.487', 'weapon4': '0.708', 'weapon3': '1.114', 'weapon2': '1.326', 'DAMAGECOUNT': '1.674', 'FRAGCOUNT': '5.000'} [2023-02-24 18:16:05,853][177155] DAMAGECOUNT value on done: 73554.0 [2023-02-24 18:16:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 44642304. Throughput: 0: 3498.1. Samples: 11155002. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:16:06,376][177119] Avg episode reward: [(0, '7.501')] [2023-02-24 18:16:06,488][177153] Updated weights for policy 0, policy_version 10900 (0.0008) [2023-02-24 18:16:09,395][177153] Updated weights for policy 0, policy_version 10910 (0.0008) [2023-02-24 18:16:11,132][177156] DAMAGECOUNT value on done: 75596.0 [2023-02-24 18:16:11,132][177156] Sum rewards: 8.034, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.086', 'weapon5': '0.010', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.039', 'ARMOR': '0.072', 'AMMO3': '0.129', 'AMMO4': '0.196', 'WEAPON5': '0.300', 'WEAPON4': '0.550', 'weapon4': '0.670', 'HITCOUNT': '0.720', 'WEAPON3': '0.800', 'weapon2': '1.160', 'weapon3': '1.788', 'DAMAGECOUNT': '3.150', 'FRAGCOUNT': '11.000'} [2023-02-24 18:16:11,152][177156] DAMAGECOUNT value on done: 77349.0 [2023-02-24 18:16:11,152][177156] Sum rewards: 8.609, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.909', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.041', 'WEAPON1': '0.060', 'AMMO3': '0.061', 'WEAPON4': '0.200', 'weapon5': '0.314', 'weapon4': '0.320', 'WEAPON5': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.560', 'weapon2': '1.176', 'weapon3': '1.230', 'DAMAGECOUNT': '2.733', 'FRAGCOUNT': '8.000'} [2023-02-24 18:16:11,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 44711936. Throughput: 0: 3503.6. Samples: 11176122. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:16:11,376][177119] Avg episode reward: [(0, '7.424')] [2023-02-24 18:16:11,443][177156] DAMAGECOUNT value on done: 78076.0 [2023-02-24 18:16:11,444][177156] Sum rewards: 12.159, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.138', 'AMMO2': '0.003', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.014', 'WEAPON1': '0.020', 'weapon5': '0.050', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'weapon7': '0.112', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'weapon4': '0.368', 'WEAPON7': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.550', 'weapon3': '1.142', 'weapon2': '1.438', 'DAMAGECOUNT': '3.024', 'FRAGCOUNT': '9.000'} [2023-02-24 18:16:11,463][177156] DAMAGECOUNT value on done: 77821.0 [2023-02-24 18:16:11,464][177156] Sum rewards: 4.699, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.050', 'ARMOR': '0.008', 'AMMO2': '0.011', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'weapon4': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.100', 'AMMO3': '0.101', 'weapon5': '0.158', 'HITCOUNT': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.512', 'weapon2': '1.640', 'weapon3': '1.736', 'FRAGCOUNT': '4.500'} [2023-02-24 18:16:12,239][177153] Updated weights for policy 0, policy_version 10920 (0.0008) [2023-02-24 18:16:15,156][177153] Updated weights for policy 0, policy_version 10930 (0.0008) [2023-02-24 18:16:16,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14063.0, 300 sec: 14009.7). Total num frames: 44785664. Throughput: 0: 3501.6. Samples: 11197134. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:16:16,376][177119] Avg episode reward: [(0, '7.475')] [2023-02-24 18:16:17,935][177170] DAMAGECOUNT value on done: 78041.0 [2023-02-24 18:16:17,935][177170] Sum rewards: 12.005, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.670', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.020', 'WEAPON1': '0.040', 'weapon5': '0.128', 'AMMO3': '0.135', 'WEAPON5': '0.200', 'HITCOUNT': '0.830', 'WEAPON3': '1.000', 'weapon2': '1.348', 'weapon3': '2.264', 'DAMAGECOUNT': '3.951', 'FRAGCOUNT': '12.000'} [2023-02-24 18:16:18,062][177153] Updated weights for policy 0, policy_version 10940 (0.0008) [2023-02-24 18:16:18,231][177170] DAMAGECOUNT value on done: 70273.0 [2023-02-24 18:16:18,232][177170] Sum rewards: 7.268, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.142', 'AMMO5': '0.005', 'AMMO2': '0.013', 'ARMOR': '0.028', 'AMMO3': '0.040', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'weapon5': '0.100', 'weapon7': '0.140', 'WEAPON4': '0.150', 'HITCOUNT': '0.260', 'WEAPON3': '0.300', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON7': '0.500', 'weapon4': '0.552', 'weapon3': '0.908', 'weapon2': '1.124', 'DAMAGECOUNT': '1.446', 'FRAGCOUNT': '4.000'} [2023-02-24 18:16:18,240][177170] DAMAGECOUNT value on done: 81760.0 [2023-02-24 18:16:18,241][177170] Sum rewards: 3.989, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.761', 'AMMO5': '0.005', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon5': '0.072', 'weapon7': '0.080', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.332', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'weapon2': '1.150', 'DAMAGECOUNT': '1.965', 'weapon3': '1.994', 'FRAGCOUNT': '4.000'} [2023-02-24 18:16:18,536][177170] DAMAGECOUNT value on done: 81557.0 [2023-02-24 18:16:18,537][177170] Sum rewards: -0.262, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.710', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.072', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.266', 'HITCOUNT': '0.300', 'weapon4': '0.350', 'ARMOR': '0.428', 'WEAPON3': '0.450', 'weapon3': '0.984', 'DAMAGECOUNT': '1.029', 'FRAGCOUNT': '2.000'} [2023-02-24 18:16:19,319][177158] DAMAGECOUNT value on done: 75478.0 [2023-02-24 18:16:19,320][177158] Sum rewards: 10.142, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.017', 'AMMO5': '0.015', 'AMMO2': '0.045', 'WEAPON1': '0.050', 'AMMO3': '0.072', 'weapon7': '0.142', 'weapon5': '0.182', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'AMMO4': '0.226', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'ARMOR': '0.476', 'HITCOUNT': '0.680', 'weapon4': '0.856', 'weapon2': '1.020', 'weapon3': '1.330', 'DAMAGECOUNT': '2.964', 'FRAGCOUNT': '8.000'} [2023-02-24 18:16:19,618][177158] DAMAGECOUNT value on done: 74456.0 [2023-02-24 18:16:19,618][177158] Sum rewards: 1.378, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.212', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.045', 'weapon7': '0.056', 'AMMO3': '0.064', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.250', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'weapon4': '0.564', 'weapon2': '0.710', 'weapon3': '0.816', 'DAMAGECOUNT': '1.095', 'FRAGCOUNT': '2.000'} [2023-02-24 18:16:20,429][177158] DAMAGECOUNT value on done: 76019.0 [2023-02-24 18:16:20,430][177158] Sum rewards: 13.317, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.352', 'AMMO5': '0.011', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'AMMO2': '0.049', 'AMMO3': '0.097', 'weapon5': '0.218', 'AMMO4': '0.243', 'WEAPON5': '0.300', 'WEAPON4': '0.550', 'weapon4': '0.742', 'WEAPON3': '0.750', 'HITCOUNT': '0.990', 'weapon2': '1.112', 'weapon3': '1.518', 'DAMAGECOUNT': '4.527', 'FRAGCOUNT': '13.500'} [2023-02-24 18:16:20,725][177158] DAMAGECOUNT value on done: 79374.0 [2023-02-24 18:16:20,725][177158] Sum rewards: 7.082, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.324', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'weapon7': '0.066', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.208', 'WEAPON5': '0.250', 'HITCOUNT': '0.470', 'WEAPON3': '0.700', 'weapon3': '1.554', 'weapon2': '1.854', 'DAMAGECOUNT': '2.496', 'FRAGCOUNT': '6.000'} [2023-02-24 18:16:21,026][177153] Updated weights for policy 0, policy_version 10950 (0.0008) [2023-02-24 18:16:21,180][177172] DAMAGECOUNT value on done: 76279.0 [2023-02-24 18:16:21,180][177172] Sum rewards: 4.448, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.510', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'AMMO4': '0.104', 'weapon5': '0.148', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.282', 'ARMOR': '0.500', 'HITCOUNT': '0.540', 'weapon2': '0.778', 'WEAPON3': '0.950', 'DAMAGECOUNT': '2.280', 'weapon3': '2.308', 'FRAGCOUNT': '7.000'} [2023-02-24 18:16:21,376][177119] Fps is (10 sec: 14335.9, 60 sec: 14062.9, 300 sec: 14009.7). Total num frames: 44855296. Throughput: 0: 3503.3. Samples: 11207630. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:16:21,376][177119] Avg episode reward: [(0, '7.266')] [2023-02-24 18:16:21,472][177172] DAMAGECOUNT value on done: 76174.0 [2023-02-24 18:16:21,473][177172] Sum rewards: 9.394, reward structure: {'DEATHCOUNT': '-6.000', 'ARMOR': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon7': '0.050', 'AMMO3': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.122', 'weapon5': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HEALTH': '0.358', 'WEAPON3': '0.400', 'weapon4': '0.540', 'weapon2': '0.602', 'HITCOUNT': '0.610', 'weapon3': '1.118', 'DAMAGECOUNT': '2.691', 'FRAGCOUNT': '8.000'} [2023-02-24 18:16:22,010][177154] DAMAGECOUNT value on done: 81990.0 [2023-02-24 18:16:22,010][177154] Sum rewards: -1.163, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.888', 'weapon7': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.031', 'WEAPON1': '0.040', 'AMMO3': '0.090', 'AMMO4': '0.156', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.234', 'HITCOUNT': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.408', 'WEAPON3': '0.600', 'weapon4': '0.804', 'DAMAGECOUNT': '0.894', 'weapon2': '1.056', 'weapon3': '1.580', 'FRAGCOUNT': '2.000'} [2023-02-24 18:16:22,300][177154] DAMAGECOUNT value on done: 78727.0 [2023-02-24 18:16:22,301][177154] Sum rewards: 11.174, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.770', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.030', 'AMMO3': '0.098', 'weapon5': '0.106', 'AMMO4': '0.148', 'WEAPON4': '0.200', 'weapon7': '0.214', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON5': '0.500', 'HITCOUNT': '0.560', 'WEAPON3': '0.600', 'weapon2': '0.620', 'weapon4': '0.792', 'weapon3': '1.370', 'DAMAGECOUNT': '2.514', 'FRAGCOUNT': '10.000'} [2023-02-24 18:16:22,310][177154] DAMAGECOUNT value on done: 77437.0 [2023-02-24 18:16:22,311][177154] Sum rewards: 4.704, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.296', 'AMMO5': '0.017', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'weapon5': '0.102', 'AMMO3': '0.133', 'AMMO4': '0.144', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.580', 'weapon4': '0.676', 'WEAPON3': '0.800', 'ARMOR': '0.808', 'weapon2': '1.042', 'weapon3': '1.828', 'DAMAGECOUNT': '2.010', 'FRAGCOUNT': '6.000'} [2023-02-24 18:16:22,607][177154] DAMAGECOUNT value on done: 78914.0 [2023-02-24 18:16:22,607][177154] Sum rewards: 6.529, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.800', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'weapon7': '0.138', 'WEAPON4': '0.200', 'weapon4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.640', 'WEAPON3': '0.750', 'weapon2': '1.432', 'weapon3': '2.018', 'DAMAGECOUNT': '2.571', 'FRAGCOUNT': '6.000'} [2023-02-24 18:16:22,650][177172] DAMAGECOUNT value on done: 77095.0 [2023-02-24 18:16:22,650][177172] Sum rewards: 5.320, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.770', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'AMMO2': '0.045', 'AMMO3': '0.138', 'weapon4': '0.164', 'AMMO4': '0.224', 'weapon5': '0.288', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.510', 'WEAPON3': '0.850', 'weapon2': '1.482', 'weapon3': '1.676', 'DAMAGECOUNT': '2.355', 'FRAGCOUNT': '6.000'} [2023-02-24 18:16:22,962][177172] DAMAGECOUNT value on done: 77340.0 [2023-02-24 18:16:22,962][177172] Sum rewards: 6.698, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.077', 'AMMO5': '0.007', 'AMMO2': '0.035', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.106', 'AMMO4': '0.173', 'weapon5': '0.210', 'WEAPON5': '0.250', 'HITCOUNT': '0.490', 'weapon4': '0.508', 'WEAPON3': '0.750', 'weapon2': '1.078', 'weapon3': '1.732', 'DAMAGECOUNT': '2.691', 'FRAGCOUNT': '6.000'} [2023-02-24 18:16:23,368][177157] DAMAGECOUNT value on done: 81876.0 [2023-02-24 18:16:23,368][177157] Sum rewards: 8.681, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.515', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.040', 'AMMO4': '0.040', 'weapon5': '0.060', 'AMMO3': '0.103', 'WEAPON5': '0.200', 'weapon7': '0.214', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'HITCOUNT': '0.560', 'WEAPON3': '0.800', 'weapon2': '1.678', 'weapon3': '1.872', 'DAMAGECOUNT': '2.733', 'FRAGCOUNT': '7.000'} [2023-02-24 18:16:23,379][177157] DAMAGECOUNT value on done: 76107.0 [2023-02-24 18:16:23,379][177157] Sum rewards: 4.539, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.945', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.046', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.054', 'weapon7': '0.146', 'AMMO6': '0.220', 'AMMO7': '0.220', 'AMMO4': '0.231', 'WEAPON7': '0.300', 'HITCOUNT': '0.380', 'WEAPON3': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.888', 'weapon4': '0.920', 'weapon3': '1.010', 'DAMAGECOUNT': '1.860', 'FRAGCOUNT': '5.000'} [2023-02-24 18:16:23,569][177171] DAMAGECOUNT value on done: 77668.0 [2023-02-24 18:16:23,570][177171] Sum rewards: 12.147, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.892', 'AMMO2': '0.017', 'AMMO5': '0.017', 'WEAPON1': '0.070', 'weapon7': '0.074', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.129', 'weapon5': '0.178', 'WEAPON7': '0.200', 'weapon4': '0.336', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'HITCOUNT': '0.990', 'weapon2': '1.084', 'weapon3': '2.006', 'DAMAGECOUNT': '4.365', 'FRAGCOUNT': '11.000'} [2023-02-24 18:16:23,675][177157] DAMAGECOUNT value on done: 75459.0 [2023-02-24 18:16:23,675][177157] Sum rewards: 2.541, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.414', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.040', 'AMMO3': '0.041', 'weapon7': '0.060', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.124', 'WEAPON3': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.230', 'weapon4': '0.624', 'weapon3': '0.778', 'weapon2': '0.874', 'DAMAGECOUNT': '0.960', 'FRAGCOUNT': '2.000'} [2023-02-24 18:16:23,685][177157] DAMAGECOUNT value on done: 75581.0 [2023-02-24 18:16:23,685][177157] Sum rewards: 14.425, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.972', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon7': '0.078', 'weapon5': '0.084', 'AMMO3': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.121', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.514', 'HITCOUNT': '0.700', 'WEAPON3': '0.700', 'weapon2': '0.812', 'weapon3': '1.894', 'DAMAGECOUNT': '3.669', 'FRAGCOUNT': '12.000'} [2023-02-24 18:16:23,866][177171] DAMAGECOUNT value on done: 77874.0 [2023-02-24 18:16:23,867][177171] Sum rewards: 2.735, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.415', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon7': '0.060', 'AMMO3': '0.072', 'AMMO4': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.138', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.310', 'weapon4': '0.470', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.960', 'weapon3': '1.266', 'weapon2': '1.516', 'FRAGCOUNT': '2.000'} [2023-02-24 18:16:23,951][177171] DAMAGECOUNT value on done: 76304.0 [2023-02-24 18:16:23,952][177171] Sum rewards: 5.611, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.717', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.018', 'WEAPON1': '0.050', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO3': '0.161', 'weapon7': '0.166', 'WEAPON7': '0.200', 'weapon4': '0.240', 'weapon5': '0.254', 'WEAPON5': '0.350', 'weapon2': '0.566', 'HITCOUNT': '0.700', 'WEAPON3': '1.000', 'weapon3': '2.288', 'DAMAGECOUNT': '2.553', 'FRAGCOUNT': '8.000'} [2023-02-24 18:16:23,986][177153] Updated weights for policy 0, policy_version 10960 (0.0008) [2023-02-24 18:16:24,212][177155] DAMAGECOUNT value on done: 79303.0 [2023-02-24 18:16:24,213][177155] Sum rewards: 12.594, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'ARMOR': '0.032', 'AMMO3': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.112', 'weapon5': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HEALTH': '0.179', 'weapon7': '0.282', 'WEAPON3': '0.550', 'weapon4': '0.676', 'weapon2': '0.858', 'HITCOUNT': '0.960', 'weapon3': '1.538', 'DAMAGECOUNT': '4.308', 'FRAGCOUNT': '9.000'} [2023-02-24 18:16:24,247][177171] DAMAGECOUNT value on done: 75915.0 [2023-02-24 18:16:24,247][177171] Sum rewards: 7.051, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.500', 'AMMO5': '0.015', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'weapon4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'AMMO4': '0.125', 'weapon5': '0.294', 'WEAPON5': '0.400', 'HITCOUNT': '0.430', 'ARMOR': '0.492', 'WEAPON3': '0.750', 'weapon2': '1.318', 'weapon3': '1.804', 'DAMAGECOUNT': '2.322', 'FRAGCOUNT': '7.000'} [2023-02-24 18:16:24,517][177155] DAMAGECOUNT value on done: 83512.0 [2023-02-24 18:16:24,518][177155] Sum rewards: 12.221, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.914', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'weapon7': '0.066', 'AMMO4': '0.105', 'AMMO3': '0.125', 'weapon4': '0.142', 'WEAPON4': '0.150', 'weapon5': '0.198', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.850', 'HITCOUNT': '0.850', 'weapon2': '1.082', 'weapon3': '2.136', 'DAMAGECOUNT': '4.419', 'FRAGCOUNT': '11.000'} [2023-02-24 18:16:24,798][177155] DAMAGECOUNT value on done: 80599.0 [2023-02-24 18:16:24,798][177155] Sum rewards: 2.945, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.270', 'WEAPON3': '0.300', 'weapon4': '0.336', 'HEALTH': '0.380', 'ARMOR': '0.488', 'weapon2': '0.498', 'weapon3': '0.830', 'DAMAGECOUNT': '1.005', 'FRAGCOUNT': '2.000'} [2023-02-24 18:16:25,099][177155] DAMAGECOUNT value on done: 74213.0 [2023-02-24 18:16:25,100][177155] Sum rewards: 6.953, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.116', 'weapon4': '0.144', 'weapon5': '0.148', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'HITCOUNT': '0.500', 'HEALTH': '0.514', 'WEAPON3': '0.600', 'weapon3': '1.630', 'weapon2': '1.818', 'DAMAGECOUNT': '1.977', 'FRAGCOUNT': '7.000'} [2023-02-24 18:16:26,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14062.9, 300 sec: 14009.7). Total num frames: 44924928. Throughput: 0: 3500.7. Samples: 11228500. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:16:26,376][177119] Avg episode reward: [(0, '6.809')] [2023-02-24 18:16:26,897][177153] Updated weights for policy 0, policy_version 10970 (0.0008) [2023-02-24 18:16:29,834][177153] Updated weights for policy 0, policy_version 10980 (0.0008) [2023-02-24 18:16:30,381][177156] DAMAGECOUNT value on done: 76769.0 [2023-02-24 18:16:30,382][177156] Sum rewards: 7.597, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.106', 'AMMO5': '0.027', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO4': '0.138', 'AMMO3': '0.139', 'weapon5': '0.140', 'WEAPON5': '0.500', 'weapon4': '0.550', 'ARMOR': '0.800', 'weapon2': '0.826', 'WEAPON3': '0.850', 'HITCOUNT': '0.890', 'weapon3': '2.156', 'DAMAGECOUNT': '3.519', 'FRAGCOUNT': '6.000'} [2023-02-24 18:16:30,405][177156] DAMAGECOUNT value on done: 78309.0 [2023-02-24 18:16:30,405][177156] Sum rewards: 8.511, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.860', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'weapon5': '0.060', 'AMMO4': '0.072', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'weapon7': '0.250', 'WEAPON7': '0.300', 'weapon2': '0.410', 'WEAPON3': '0.700', 'HITCOUNT': '0.730', 'weapon4': '1.040', 'weapon3': '1.502', 'DAMAGECOUNT': '2.880', 'FRAGCOUNT': '9.000'} [2023-02-24 18:16:30,679][177156] DAMAGECOUNT value on done: 78521.0 [2023-02-24 18:16:30,680][177156] Sum rewards: 7.119, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.152', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'weapon7': '0.056', 'AMMO3': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.202', 'HITCOUNT': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.483', 'DAMAGECOUNT': '1.335', 'weapon3': '1.478', 'weapon2': '1.998', 'FRAGCOUNT': '4.000'} [2023-02-24 18:16:30,699][177156] DAMAGECOUNT value on done: 79460.0 [2023-02-24 18:16:30,700][177156] Sum rewards: 12.222, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.380', 'AMMO5': '0.008', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'weapon7': '0.114', 'AMMO4': '0.145', 'weapon5': '0.154', 'AMMO3': '0.172', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.514', 'weapon2': '0.630', 'WEAPON3': '1.150', 'HITCOUNT': '1.240', 'weapon3': '2.298', 'DAMAGECOUNT': '4.917', 'FRAGCOUNT': '14.000'} [2023-02-24 18:16:31,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 44994560. Throughput: 0: 3501.6. Samples: 11249508. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:16:31,376][177119] Avg episode reward: [(0, '6.908')] [2023-02-24 18:16:32,779][177153] Updated weights for policy 0, policy_version 10990 (0.0008) [2023-02-24 18:16:35,700][177153] Updated weights for policy 0, policy_version 11000 (0.0008) [2023-02-24 18:16:36,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 45064192. Throughput: 0: 3499.8. Samples: 11259982. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:16:36,376][177119] Avg episode reward: [(0, '6.908')] [2023-02-24 18:16:37,141][177170] DAMAGECOUNT value on done: 79925.0 [2023-02-24 18:16:37,142][177170] Sum rewards: 18.092, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.511', 'AMMO5': '0.015', 'AMMO2': '0.034', 'WEAPON1': '0.040', 'weapon7': '0.074', 'AMMO3': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.171', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.204', 'WEAPON5': '0.300', 'weapon4': '0.318', 'ARMOR': '0.436', 'WEAPON3': '0.700', 'HITCOUNT': '1.050', 'weapon2': '1.050', 'weapon3': '1.996', 'DAMAGECOUNT': '5.457', 'FRAGCOUNT': '15.000'} [2023-02-24 18:16:37,439][177170] DAMAGECOUNT value on done: 71144.0 [2023-02-24 18:16:37,440][177170] Sum rewards: 6.978, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.802', 'AMMO2': '0.014', 'AMMO5': '0.014', 'ARMOR': '0.020', 'AMMO4': '0.067', 'WEAPON1': '0.070', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'weapon4': '0.240', 'weapon5': '0.248', 'WEAPON5': '0.400', 'HITCOUNT': '0.580', 'WEAPON3': '0.650', 'weapon2': '1.494', 'weapon3': '1.684', 'DAMAGECOUNT': '2.613', 'FRAGCOUNT': '7.000'} [2023-02-24 18:16:37,448][177170] DAMAGECOUNT value on done: 82338.0 [2023-02-24 18:16:37,449][177170] Sum rewards: 9.511, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.569', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO3': '0.040', 'WEAPON1': '0.060', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.106', 'HITCOUNT': '0.190', 'weapon5': '0.246', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'weapon3': '1.022', 'DAMAGECOUNT': '1.734', 'weapon2': '2.524', 'FRAGCOUNT': '5.000'} [2023-02-24 18:16:37,745][177170] DAMAGECOUNT value on done: 83004.0 [2023-02-24 18:16:37,745][177170] Sum rewards: 8.611, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.904', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.083', 'weapon5': '0.098', 'AMMO3': '0.129', 'weapon7': '0.144', 'WEAPON4': '0.200', 'weapon4': '0.314', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON5': '0.350', 'WEAPON7': '0.500', 'HITCOUNT': '0.640', 'WEAPON3': '0.800', 'weapon3': '1.340', 'weapon2': '1.844', 'DAMAGECOUNT': '4.341', 'FRAGCOUNT': '8.000'} [2023-02-24 18:16:38,581][177158] DAMAGECOUNT value on done: 76449.0 [2023-02-24 18:16:38,582][177158] Sum rewards: 6.002, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.211', 'ARMOR': '0.008', 'AMMO5': '0.016', 'WEAPON1': '0.040', 'AMMO2': '0.057', 'AMMO3': '0.111', 'weapon7': '0.146', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.226', 'AMMO4': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'HITCOUNT': '0.520', 'WEAPON3': '0.750', 'weapon2': '0.896', 'weapon4': '1.048', 'weapon3': '1.248', 'DAMAGECOUNT': '2.913', 'FRAGCOUNT': '6.500'} [2023-02-24 18:16:38,646][177153] Updated weights for policy 0, policy_version 11010 (0.0008) [2023-02-24 18:16:38,878][177158] DAMAGECOUNT value on done: 75304.0 [2023-02-24 18:16:38,879][177158] Sum rewards: 6.659, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.940', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.017', 'WEAPON1': '0.070', 'AMMO3': '0.161', 'weapon5': '0.294', 'WEAPON5': '0.500', 'HITCOUNT': '0.560', 'weapon2': '1.088', 'WEAPON3': '1.100', 'weapon3': '2.282', 'DAMAGECOUNT': '2.544', 'FRAGCOUNT': '9.000'} [2023-02-24 18:16:39,686][177158] DAMAGECOUNT value on done: 76910.0 [2023-02-24 18:16:39,687][177158] Sum rewards: 7.938, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.210', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.026', 'WEAPON1': '0.040', 'weapon5': '0.070', 'AMMO3': '0.098', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'weapon7': '0.326', 'WEAPON4': '0.400', 'weapon4': '0.428', 'AMMO6': '0.460', 'AMMO7': '0.460', 'HITCOUNT': '0.590', 'WEAPON3': '0.600', 'WEAPON7': '0.700', 'weapon2': '1.188', 'weapon3': '1.292', 'DAMAGECOUNT': '2.673', 'FRAGCOUNT': '7.000'} [2023-02-24 18:16:39,982][177158] DAMAGECOUNT value on done: 80291.0 [2023-02-24 18:16:39,983][177158] Sum rewards: 5.915, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.250', 'AMMO2': '0.008', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.039', 'AMMO3': '0.088', 'WEAPON4': '0.150', 'weapon5': '0.196', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'weapon4': '0.560', 'HITCOUNT': '0.630', 'weapon2': '1.004', 'weapon3': '1.670', 'DAMAGECOUNT': '2.751', 'FRAGCOUNT': '5.000'} [2023-02-24 18:16:40,417][177172] DAMAGECOUNT value on done: 77621.0 [2023-02-24 18:16:40,418][177172] Sum rewards: 17.147, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.776', 'AMMO2': '0.005', 'AMMO5': '0.015', 'AMMO4': '0.024', 'WEAPON1': '0.090', 'AMMO3': '0.129', 'weapon5': '0.228', 'WEAPON5': '0.450', 'WEAPON3': '0.900', 'weapon2': '0.902', 'HITCOUNT': '0.950', 'weapon3': '2.454', 'DAMAGECOUNT': '4.026', 'FRAGCOUNT': '17.000'} [2023-02-24 18:16:40,708][177172] DAMAGECOUNT value on done: 77280.0 [2023-02-24 18:16:40,709][177172] Sum rewards: 12.369, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.672', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'WEAPON1': '0.040', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.154', 'weapon4': '0.162', 'WEAPON5': '0.200', 'WEAPON3': '0.600', 'HITCOUNT': '0.800', 'weapon3': '1.438', 'weapon2': '1.914', 'DAMAGECOUNT': '3.318', 'FRAGCOUNT': '9.000'} [2023-02-24 18:16:41,243][177154] DAMAGECOUNT value on done: 83340.0 [2023-02-24 18:16:41,243][177154] Sum rewards: 13.409, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.446', 'AMMO5': '0.006', 'AMMO2': '0.035', 'WEAPON1': '0.050', 'weapon7': '0.084', 'weapon5': '0.090', 'AMMO3': '0.111', 'AMMO4': '0.176', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'weapon4': '0.522', 'WEAPON3': '0.850', 'weapon2': '0.852', 'HITCOUNT': '1.040', 'weapon3': '2.048', 'DAMAGECOUNT': '4.050', 'FRAGCOUNT': '12.000'} [2023-02-24 18:16:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 45133824. Throughput: 0: 3499.3. Samples: 11280978. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:16:41,376][177119] Avg episode reward: [(0, '7.320')] [2023-02-24 18:16:41,536][177154] DAMAGECOUNT value on done: 78262.0 [2023-02-24 18:16:41,537][177154] Sum rewards: 0.074, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.134', 'AMMO5': '0.026', 'AMMO2': '0.048', 'WEAPON1': '0.110', 'AMMO3': '0.124', 'AMMO4': '0.239', 'weapon4': '0.276', 'weapon5': '0.320', 'WEAPON4': '0.350', 'HITCOUNT': '0.480', 'WEAPON5': '0.550', 'weapon2': '0.778', 'WEAPON3': '0.800', 'weapon3': '2.132', 'DAMAGECOUNT': '2.475', 'FRAGCOUNT': '3.000'} [2023-02-24 18:16:41,551][177154] DAMAGECOUNT value on done: 79713.0 [2023-02-24 18:16:41,551][177154] Sum rewards: 8.635, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.870', 'AMMO5': '0.009', 'AMMO2': '0.025', 'WEAPON1': '0.060', 'weapon7': '0.074', 'AMMO3': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'weapon5': '0.190', 'WEAPON5': '0.300', 'weapon4': '0.354', 'HITCOUNT': '0.580', 'WEAPON3': '0.600', 'weapon2': '0.962', 'weapon3': '1.730', 'DAMAGECOUNT': '2.958', 'FRAGCOUNT': '7.000'} [2023-02-24 18:16:41,577][177153] Updated weights for policy 0, policy_version 11020 (0.0008) [2023-02-24 18:16:41,856][177154] DAMAGECOUNT value on done: 80156.0 [2023-02-24 18:16:41,856][177154] Sum rewards: 13.133, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.560', 'AMMO2': '0.008', 'AMMO5': '0.008', 'WEAPON1': '0.030', 'AMMO4': '0.040', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon7': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.234', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.252', 'WEAPON7': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.640', 'weapon3': '1.414', 'weapon2': '1.680', 'DAMAGECOUNT': '3.726', 'FRAGCOUNT': '10.000'} [2023-02-24 18:16:41,878][177172] DAMAGECOUNT value on done: 78355.0 [2023-02-24 18:16:41,879][177172] Sum rewards: 10.356, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.505', 'AMMO5': '0.015', 'AMMO2': '0.045', 'WEAPON1': '0.070', 'AMMO3': '0.103', 'weapon5': '0.226', 'AMMO4': '0.227', 'weapon4': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.459', 'HITCOUNT': '0.590', 'WEAPON3': '0.650', 'weapon2': '1.088', 'weapon3': '2.040', 'DAMAGECOUNT': '3.735', 'FRAGCOUNT': '9.000'} [2023-02-24 18:16:42,168][177172] DAMAGECOUNT value on done: 78105.0 [2023-02-24 18:16:42,169][177172] Sum rewards: 9.280, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.259', 'AMMO2': '0.009', 'AMMO5': '0.025', 'WEAPON1': '0.030', 'AMMO4': '0.045', 'weapon7': '0.046', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.188', 'WEAPON7': '0.200', 'weapon4': '0.308', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.580', 'weapon3': '1.238', 'weapon2': '1.810', 'DAMAGECOUNT': '2.295', 'FRAGCOUNT': '7.000'} [2023-02-24 18:16:42,579][177157] DAMAGECOUNT value on done: 83030.0 [2023-02-24 18:16:42,579][177157] Sum rewards: 12.220, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.663', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'weapon5': '0.104', 'weapon7': '0.118', 'AMMO3': '0.138', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.300', 'WEAPON7': '0.400', 'HITCOUNT': '0.770', 'WEAPON3': '0.850', 'weapon2': '1.136', 'weapon3': '2.336', 'DAMAGECOUNT': '3.462', 'FRAGCOUNT': '11.000'} [2023-02-24 18:16:42,589][177157] DAMAGECOUNT value on done: 76589.0 [2023-02-24 18:16:42,590][177157] Sum rewards: 3.545, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.370', 'AMMO5': '0.003', 'AMMO2': '0.004', 'ARMOR': '0.004', 'AMMO4': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'weapon7': '0.100', 'weapon5': '0.194', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'HITCOUNT': '0.330', 'WEAPON7': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.592', 'weapon2': '0.838', 'weapon3': '0.856', 'DAMAGECOUNT': '1.446', 'FRAGCOUNT': '3.000'} [2023-02-24 18:16:42,803][177171] DAMAGECOUNT value on done: 79383.0 [2023-02-24 18:16:42,804][177171] Sum rewards: 13.503, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.555', 'AMMO2': '0.005', 'weapon7': '0.016', 'AMMO5': '0.018', 'AMMO4': '0.025', 'WEAPON1': '0.050', 'weapon4': '0.096', 'WEAPON4': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.147', 'weapon5': '0.376', 'WEAPON5': '0.400', 'weapon2': '0.820', 'HITCOUNT': '0.890', 'WEAPON3': '1.050', 'weapon3': '2.370', 'DAMAGECOUNT': '5.145', 'FRAGCOUNT': '14.000'} [2023-02-24 18:16:42,888][177157] DAMAGECOUNT value on done: 76365.0 [2023-02-24 18:16:42,889][177157] Sum rewards: 7.566, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.430', 'AMMO5': '0.015', 'AMMO2': '0.061', 'WEAPON1': '0.070', 'AMMO3': '0.098', 'WEAPON4': '0.250', 'AMMO4': '0.307', 'weapon5': '0.326', 'weapon4': '0.334', 'WEAPON5': '0.450', 'HITCOUNT': '0.450', 'WEAPON3': '0.700', 'weapon2': '1.452', 'weapon3': '1.514', 'DAMAGECOUNT': '2.718', 'FRAGCOUNT': '7.000'} [2023-02-24 18:16:42,899][177157] DAMAGECOUNT value on done: 76684.0 [2023-02-24 18:16:42,899][177157] Sum rewards: 8.541, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.543', 'AMMO2': '0.016', 'AMMO5': '0.020', 'AMMO4': '0.081', 'WEAPON1': '0.090', 'AMMO3': '0.097', 'weapon5': '0.368', 'HITCOUNT': '0.530', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'weapon2': '1.182', 'weapon3': '1.990', 'DAMAGECOUNT': '3.309', 'FRAGCOUNT': '7.000'} [2023-02-24 18:16:43,093][177171] DAMAGECOUNT value on done: 78678.0 [2023-02-24 18:16:43,094][177171] Sum rewards: 9.190, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.484', 'AMMO5': '0.007', 'AMMO2': '0.021', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'weapon7': '0.060', 'AMMO4': '0.105', 'AMMO3': '0.121', 'WEAPON4': '0.150', 'weapon5': '0.162', 'WEAPON5': '0.200', 'weapon4': '0.260', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'HITCOUNT': '0.550', 'WEAPON3': '0.800', 'weapon2': '1.040', 'weapon3': '2.174', 'DAMAGECOUNT': '2.412', 'FRAGCOUNT': '8.000'} [2023-02-24 18:16:43,178][177171] DAMAGECOUNT value on done: 76952.0 [2023-02-24 18:16:43,178][177171] Sum rewards: 5.700, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.565', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.060', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.440', 'HITCOUNT': '0.620', 'WEAPON3': '0.700', 'weapon2': '1.516', 'weapon3': '1.524', 'DAMAGECOUNT': '1.944', 'FRAGCOUNT': '6.000'} [2023-02-24 18:16:43,466][177171] DAMAGECOUNT value on done: 77061.0 [2023-02-24 18:16:43,467][177171] Sum rewards: 9.339, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.540', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'weapon7': '0.060', 'AMMO3': '0.071', 'AMMO4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.162', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.394', 'WEAPON3': '0.600', 'HITCOUNT': '0.800', 'weapon2': '1.474', 'weapon3': '1.582', 'DAMAGECOUNT': '3.438', 'FRAGCOUNT': '8.000'} [2023-02-24 18:16:43,483][177155] DAMAGECOUNT value on done: 80393.0 [2023-02-24 18:16:43,484][177155] Sum rewards: 12.287, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.360', 'AMMO2': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.021', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'weapon4': '0.132', 'weapon5': '0.148', 'WEAPON5': '0.150', 'WEAPON3': '0.700', 'HITCOUNT': '0.800', 'weapon2': '1.154', 'weapon3': '2.260', 'DAMAGECOUNT': '3.270', 'FRAGCOUNT': '10.500'} [2023-02-24 18:16:43,786][177155] DAMAGECOUNT value on done: 84612.0 [2023-02-24 18:16:43,786][177155] Sum rewards: 4.311, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.848', 'ARMOR': '0.005', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'weapon7': '0.048', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.157', 'AMMO3': '0.172', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.560', 'HITCOUNT': '0.700', 'WEAPON3': '1.050', 'weapon2': '1.128', 'weapon3': '1.854', 'DAMAGECOUNT': '3.300', 'FRAGCOUNT': '7.000'} [2023-02-24 18:16:44,073][177155] DAMAGECOUNT value on done: 81765.0 [2023-02-24 18:16:44,073][177155] Sum rewards: 9.933, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.360', 'AMMO2': '0.015', 'AMMO5': '0.022', 'WEAPON4': '0.050', 'AMMO4': '0.074', 'WEAPON1': '0.080', 'weapon4': '0.134', 'AMMO3': '0.145', 'weapon5': '0.274', 'WEAPON5': '0.550', 'HITCOUNT': '0.580', 'ARMOR': '0.800', 'WEAPON3': '0.900', 'weapon2': '0.972', 'weapon3': '2.198', 'DAMAGECOUNT': '3.498', 'FRAGCOUNT': '10.000'} [2023-02-24 18:16:44,367][177155] DAMAGECOUNT value on done: 74787.0 [2023-02-24 18:16:44,368][177155] Sum rewards: -2.496, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.990', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'weapon7': '0.056', 'weapon5': '0.080', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.470', 'weapon4': '0.590', 'weapon2': '0.654', 'WEAPON3': '1.000', 'weapon3': '1.520', 'DAMAGECOUNT': '1.722', 'FRAGCOUNT': '3.000'} [2023-02-24 18:16:44,483][177153] Updated weights for policy 0, policy_version 11030 (0.0008) [2023-02-24 18:16:46,280][177172] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 18:16:46,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 45203456. Throughput: 0: 3500.0. Samples: 11302028. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:16:46,376][177119] Avg episode reward: [(0, '7.537')] [2023-02-24 18:16:47,384][177153] Updated weights for policy 0, policy_version 11040 (0.0008) [2023-02-24 18:16:49,591][177156] DAMAGECOUNT value on done: 77908.0 [2023-02-24 18:16:49,591][177156] Sum rewards: 10.739, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.150', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO5': '0.018', 'WEAPON1': '0.080', 'AMMO3': '0.104', 'weapon5': '0.318', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'HITCOUNT': '0.890', 'weapon2': '1.460', 'weapon3': '1.932', 'DAMAGECOUNT': '3.417', 'FRAGCOUNT': '10.000'} [2023-02-24 18:16:49,612][177156] DAMAGECOUNT value on done: 79348.0 [2023-02-24 18:16:49,612][177156] Sum rewards: 10.211, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.085', 'AMMO5': '0.017', 'AMMO2': '0.021', 'WEAPON1': '0.060', 'AMMO3': '0.086', 'AMMO4': '0.103', 'weapon5': '0.178', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.466', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'weapon2': '0.876', 'weapon4': '0.966', 'weapon3': '1.406', 'DAMAGECOUNT': '3.117', 'FRAGCOUNT': '9.000'} [2023-02-24 18:16:49,912][177156] DAMAGECOUNT value on done: 79371.0 [2023-02-24 18:16:49,912][177156] Sum rewards: 8.081, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.212', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon7': '0.052', 'WEAPON1': '0.060', 'AMMO3': '0.071', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.278', 'weapon4': '0.306', 'HITCOUNT': '0.440', 'WEAPON3': '0.450', 'weapon3': '1.208', 'weapon2': '1.902', 'DAMAGECOUNT': '2.550', 'FRAGCOUNT': '6.000'} [2023-02-24 18:16:49,934][177156] DAMAGECOUNT value on done: 79662.0 [2023-02-24 18:16:50,343][177153] Updated weights for policy 0, policy_version 11050 (0.0008) [2023-02-24 18:16:51,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 45273088. Throughput: 0: 3500.6. Samples: 11312530. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:16:51,376][177119] Avg episode reward: [(0, '7.548')] [2023-02-24 18:16:53,247][177153] Updated weights for policy 0, policy_version 11060 (0.0008) [2023-02-24 18:16:56,200][177153] Updated weights for policy 0, policy_version 11070 (0.0009) [2023-02-24 18:16:56,349][177170] DAMAGECOUNT value on done: 80690.0 [2023-02-24 18:16:56,350][177170] Sum rewards: -0.632, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.244', 'AMMO5': '0.027', 'AMMO2': '0.048', 'WEAPON1': '0.080', 'AMMO3': '0.170', 'weapon5': '0.218', 'AMMO4': '0.242', 'WEAPON4': '0.350', 'weapon2': '0.458', 'weapon4': '0.560', 'WEAPON5': '0.600', 'HITCOUNT': '0.630', 'WEAPON3': '1.050', 'weapon3': '1.882', 'DAMAGECOUNT': '2.295', 'FRAGCOUNT': '5.000'} [2023-02-24 18:16:56,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 45342720. Throughput: 0: 3496.8. Samples: 11333480. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:16:56,376][177119] Avg episode reward: [(0, '7.496')] [2023-02-24 18:16:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000011070_45342720.pth... [2023-02-24 18:16:56,438][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000010250_41984000.pth [2023-02-24 18:16:56,646][177170] DAMAGECOUNT value on done: 83346.0 [2023-02-24 18:16:56,647][177170] Sum rewards: 6.643, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.128', 'AMMO5': '0.007', 'AMMO2': '0.013', 'ARMOR': '0.028', 'WEAPON1': '0.030', 'weapon7': '0.048', 'weapon5': '0.062', 'AMMO4': '0.063', 'AMMO3': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.780', 'weapon2': '1.412', 'weapon3': '1.662', 'DAMAGECOUNT': '3.024', 'FRAGCOUNT': '9.000'} [2023-02-24 18:16:56,659][177170] DAMAGECOUNT value on done: 72655.0 [2023-02-24 18:16:56,660][177170] Sum rewards: 15.282, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.090', 'AMMO5': '0.017', 'AMMO2': '0.018', 'AMMO3': '0.062', 'WEAPON1': '0.080', 'AMMO4': '0.091', 'WEAPON4': '0.250', 'weapon5': '0.322', 'ARMOR': '0.485', 'WEAPON3': '0.500', 'WEAPON5': '0.550', 'weapon4': '0.626', 'HITCOUNT': '0.650', 'weapon3': '1.054', 'weapon2': '1.634', 'DAMAGECOUNT': '4.533', 'FRAGCOUNT': '11.500'} [2023-02-24 18:16:56,963][177170] DAMAGECOUNT value on done: 83820.0 [2023-02-24 18:16:56,963][177170] Sum rewards: 5.777, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.079', 'AMMO2': '0.011', 'AMMO5': '0.013', 'WEAPON1': '0.040', 'AMMO4': '0.057', 'AMMO3': '0.104', 'weapon5': '0.114', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.632', 'HITCOUNT': '0.700', 'WEAPON3': '0.750', 'weapon2': '0.840', 'weapon3': '1.996', 'DAMAGECOUNT': '2.448', 'FRAGCOUNT': '6.000'} [2023-02-24 18:16:57,811][177158] DAMAGECOUNT value on done: 77760.0 [2023-02-24 18:16:57,812][177158] Sum rewards: 11.358, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.820', 'AMMO2': '0.016', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'AMMO4': '0.081', 'AMMO3': '0.097', 'WEAPON4': '0.250', 'weapon5': '0.320', 'WEAPON5': '0.600', 'weapon4': '0.644', 'WEAPON3': '0.700', 'HITCOUNT': '1.010', 'weapon2': '1.188', 'weapon3': '1.536', 'DAMAGECOUNT': '3.933', 'FRAGCOUNT': '11.000'} [2023-02-24 18:16:58,122][177158] DAMAGECOUNT value on done: 76066.0 [2023-02-24 18:16:58,122][177158] Sum rewards: 5.331, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.500', 'AMMO2': '0.009', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.044', 'AMMO3': '0.050', 'weapon7': '0.126', 'WEAPON4': '0.150', 'weapon5': '0.196', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.416', 'ARMOR': '0.469', 'WEAPON3': '0.500', 'HITCOUNT': '0.530', 'weapon2': '0.998', 'weapon3': '1.234', 'DAMAGECOUNT': '2.286', 'FRAGCOUNT': '4.000'} [2023-02-24 18:16:58,873][177158] DAMAGECOUNT value on done: 77484.0 [2023-02-24 18:16:58,873][177158] Sum rewards: 2.732, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.350', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO2': '0.048', 'weapon7': '0.056', 'AMMO3': '0.093', 'weapon5': '0.236', 'AMMO4': '0.238', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'HITCOUNT': '0.460', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '0.600', 'weapon2': '0.734', 'weapon4': '0.788', 'weapon3': '1.222', 'DAMAGECOUNT': '1.722', 'FRAGCOUNT': '4.000'} [2023-02-24 18:16:59,132][177153] Updated weights for policy 0, policy_version 11080 (0.0008) [2023-02-24 18:16:59,172][177158] DAMAGECOUNT value on done: 81418.0 [2023-02-24 18:16:59,173][177158] Sum rewards: 10.679, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.616', 'AMMO5': '0.013', 'AMMO2': '0.014', 'ARMOR': '0.020', 'AMMO4': '0.071', 'WEAPON1': '0.080', 'AMMO3': '0.121', 'weapon7': '0.162', 'weapon5': '0.182', 'WEAPON4': '0.250', 'AMMO6': '0.380', 'AMMO7': '0.380', 'WEAPON5': '0.400', 'weapon4': '0.438', 'WEAPON7': '0.500', 'WEAPON3': '0.700', 'HITCOUNT': '0.740', 'weapon2': '1.016', 'weapon3': '1.446', 'DAMAGECOUNT': '3.381', 'FRAGCOUNT': '11.000'} [2023-02-24 18:16:59,622][177172] DAMAGECOUNT value on done: 78602.0 [2023-02-24 18:16:59,623][177172] Sum rewards: 9.283, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.040', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.109', 'weapon5': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.580', 'WEAPON3': '0.700', 'HITCOUNT': '0.700', 'weapon3': '1.442', 'weapon2': '1.596', 'DAMAGECOUNT': '2.943', 'FRAGCOUNT': '7.000'} [2023-02-24 18:16:59,922][177172] DAMAGECOUNT value on done: 78200.0 [2023-02-24 18:16:59,922][177172] Sum rewards: 5.914, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.430', 'AMMO5': '0.015', 'AMMO2': '0.030', 'WEAPON1': '0.030', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.138', 'weapon5': '0.148', 'AMMO4': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.396', 'weapon4': '0.674', 'HITCOUNT': '0.760', 'WEAPON3': '0.850', 'weapon3': '1.994', 'DAMAGECOUNT': '2.760', 'FRAGCOUNT': '8.000'} [2023-02-24 18:17:00,436][177154] DAMAGECOUNT value on done: 84514.0 [2023-02-24 18:17:00,436][177154] Sum rewards: 12.230, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.818', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.011', 'WEAPON1': '0.050', 'AMMO3': '0.061', 'WEAPON4': '0.100', 'weapon5': '0.150', 'weapon7': '0.206', 'weapon4': '0.212', 'WEAPON5': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'ARMOR': '0.416', 'WEAPON3': '0.450', 'HITCOUNT': '0.720', 'weapon3': '1.472', 'weapon2': '1.628', 'DAMAGECOUNT': '3.522', 'FRAGCOUNT': '8.000'} [2023-02-24 18:17:00,732][177154] DAMAGECOUNT value on done: 79207.0 [2023-02-24 18:17:00,732][177154] Sum rewards: 10.627, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-2.000', 'AMMO4': '-0.060', 'AMMO2': '-0.012', 'ARMOR': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.085', 'weapon7': '0.094', 'WEAPON4': '0.100', 'weapon5': '0.114', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.326', 'WEAPON7': '0.400', 'HITCOUNT': '0.660', 'WEAPON3': '0.700', 'weapon3': '1.360', 'weapon2': '1.566', 'DAMAGECOUNT': '2.835', 'FRAGCOUNT': '9.000'} [2023-02-24 18:17:00,754][177154] DAMAGECOUNT value on done: 80978.0 [2023-02-24 18:17:00,754][177154] Sum rewards: 12.030, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.544', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'weapon5': '0.064', 'AMMO4': '0.088', 'AMMO3': '0.092', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.266', 'WEAPON3': '0.550', 'HITCOUNT': '0.740', 'weapon2': '1.398', 'weapon3': '2.060', 'DAMAGECOUNT': '3.795', 'FRAGCOUNT': '12.000'} [2023-02-24 18:17:01,054][177154] DAMAGECOUNT value on done: 80622.0 [2023-02-24 18:17:01,055][177154] Sum rewards: 9.206, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.133', 'AMMO5': '0.007', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'AMMO3': '0.040', 'weapon7': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'weapon5': '0.246', 'WEAPON4': '0.250', 'WEAPON3': '0.250', 'HITCOUNT': '0.370', 'weapon4': '0.404', 'weapon3': '1.038', 'DAMAGECOUNT': '1.398', 'weapon2': '1.660', 'FRAGCOUNT': '6.000'} [2023-02-24 18:17:01,064][177172] DAMAGECOUNT value on done: 79629.0 [2023-02-24 18:17:01,065][177172] Sum rewards: 12.540, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.056', 'ARMOR': '0.012', 'AMMO2': '0.013', 'AMMO5': '0.015', 'WEAPON1': '0.050', 'weapon7': '0.060', 'AMMO4': '0.065', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'weapon5': '0.142', 'weapon4': '0.212', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'HITCOUNT': '0.790', 'weapon2': '1.300', 'weapon3': '1.856', 'DAMAGECOUNT': '3.822', 'FRAGCOUNT': '11.000'} [2023-02-24 18:17:01,361][177172] DAMAGECOUNT value on done: 78832.0 [2023-02-24 18:17:01,361][177172] Sum rewards: 9.278, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.340', 'AMMO5': '0.015', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.044', 'weapon7': '0.050', 'AMMO4': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.224', 'WEAPON3': '0.300', 'HITCOUNT': '0.370', 'weapon4': '0.392', 'WEAPON5': '0.400', 'weapon2': '0.630', 'weapon3': '0.930', 'DAMAGECOUNT': '2.181', 'FRAGCOUNT': '6.500'} [2023-02-24 18:17:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 45412352. Throughput: 0: 3495.8. Samples: 11354444. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:17:01,376][177119] Avg episode reward: [(0, '7.778')] [2023-02-24 18:17:01,377][177140] Saving new best policy, reward=7.778! [2023-02-24 18:17:01,851][177157] DAMAGECOUNT value on done: 83794.0 [2023-02-24 18:17:01,851][177157] Sum rewards: 7.970, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.116', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'WEAPON1': '0.040', 'ARMOR': '0.044', 'AMMO3': '0.073', 'weapon7': '0.098', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon5': '0.292', 'WEAPON4': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.680', 'weapon2': '0.688', 'weapon3': '1.110', 'weapon4': '1.290', 'DAMAGECOUNT': '2.292', 'FRAGCOUNT': '5.000'} [2023-02-24 18:17:01,862][177157] DAMAGECOUNT value on done: 77623.0 [2023-02-24 18:17:01,862][177157] Sum rewards: 5.829, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.393', 'AMMO2': '0.006', 'ARMOR': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.030', 'weapon5': '0.064', 'weapon7': '0.112', 'AMMO3': '0.131', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON7': '0.400', 'weapon4': '0.662', 'HITCOUNT': '0.680', 'WEAPON3': '0.850', 'weapon2': '0.874', 'weapon3': '1.930', 'DAMAGECOUNT': '3.102', 'FRAGCOUNT': '5.500'} [2023-02-24 18:17:01,968][177171] DAMAGECOUNT value on done: 80195.0 [2023-02-24 18:17:01,969][177171] Sum rewards: 8.410, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.028', 'AMMO3': '0.050', 'HEALTH': '0.056', 'weapon5': '0.060', 'weapon7': '0.122', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.300', 'HITCOUNT': '0.310', 'weapon2': '0.474', 'weapon3': '0.740', 'weapon4': '0.978', 'DAMAGECOUNT': '2.436', 'FRAGCOUNT': '6.000'} [2023-02-24 18:17:02,076][177153] Updated weights for policy 0, policy_version 11090 (0.0008) [2023-02-24 18:17:02,161][177157] DAMAGECOUNT value on done: 77859.0 [2023-02-24 18:17:02,162][177157] Sum rewards: 12.108, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.126', 'AMMO2': '0.013', 'AMMO5': '0.022', 'weapon4': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.063', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'weapon5': '0.230', 'WEAPON5': '0.650', 'HITCOUNT': '0.800', 'WEAPON3': '0.850', 'weapon2': '1.168', 'weapon3': '2.068', 'DAMAGECOUNT': '4.482', 'FRAGCOUNT': '10.000'} [2023-02-24 18:17:02,173][177157] DAMAGECOUNT value on done: 77419.0 [2023-02-24 18:17:02,174][177157] Sum rewards: 1.576, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.322', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'AMMO2': '0.049', 'AMMO3': '0.108', 'weapon7': '0.156', 'weapon5': '0.178', 'AMMO4': '0.243', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'HITCOUNT': '0.460', 'WEAPON4': '0.600', 'WEAPON3': '0.700', 'weapon2': '0.798', 'weapon4': '1.028', 'weapon3': '1.496', 'DAMAGECOUNT': '1.635', 'FRAGCOUNT': '6.000'} [2023-02-24 18:17:02,277][177171] DAMAGECOUNT value on done: 79392.0 [2023-02-24 18:17:02,277][177171] Sum rewards: 3.914, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.594', 'AMMO5': '0.022', 'AMMO2': '0.026', 'WEAPON1': '0.080', 'AMMO3': '0.106', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'weapon5': '0.214', 'HITCOUNT': '0.550', 'weapon4': '0.572', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'weapon2': '0.978', 'weapon3': '1.638', 'DAMAGECOUNT': '2.142', 'FRAGCOUNT': '5.000'} [2023-02-24 18:17:02,378][177171] DAMAGECOUNT value on done: 78677.0 [2023-02-24 18:17:02,379][177171] Sum rewards: 17.652, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.456', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'weapon7': '0.102', 'weapon5': '0.118', 'WEAPON4': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'ARMOR': '0.489', 'weapon4': '0.566', 'WEAPON3': '0.600', 'weapon2': '0.864', 'HITCOUNT': '1.040', 'weapon3': '1.714', 'DAMAGECOUNT': '4.575', 'FRAGCOUNT': '12.000'} [2023-02-24 18:17:02,671][177171] DAMAGECOUNT value on done: 77964.0 [2023-02-24 18:17:02,671][177171] Sum rewards: 8.672, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.154', 'AMMO5': '0.015', 'AMMO2': '0.019', 'WEAPON1': '0.070', 'AMMO3': '0.087', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'weapon5': '0.312', 'WEAPON5': '0.450', 'HITCOUNT': '0.480', 'weapon4': '0.588', 'WEAPON3': '0.650', 'weapon2': '1.022', 'weapon3': '1.430', 'DAMAGECOUNT': '2.709', 'FRAGCOUNT': '7.000'} [2023-02-24 18:17:02,705][177155] DAMAGECOUNT value on done: 81173.0 [2023-02-24 18:17:02,706][177155] Sum rewards: 7.336, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.324', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.015', 'WEAPON1': '0.070', 'AMMO3': '0.100', 'WEAPON5': '0.350', 'weapon5': '0.376', 'HITCOUNT': '0.520', 'WEAPON3': '0.650', 'weapon2': '0.844', 'DAMAGECOUNT': '2.340', 'weapon3': '2.380', 'FRAGCOUNT': '6.000'} [2023-02-24 18:17:03,003][177155] DAMAGECOUNT value on done: 85788.0 [2023-02-24 18:17:03,003][177155] Sum rewards: 8.736, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.670', 'AMMO5': '0.015', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'AMMO4': '0.089', 'weapon5': '0.104', 'AMMO3': '0.127', 'WEAPON5': '0.150', 'WEAPON4': '0.400', 'weapon2': '0.430', 'ARMOR': '0.467', 'weapon4': '0.628', 'HITCOUNT': '0.770', 'WEAPON3': '0.900', 'weapon3': '1.990', 'DAMAGECOUNT': '3.528', 'FRAGCOUNT': '9.000'} [2023-02-24 18:17:03,286][177155] DAMAGECOUNT value on done: 82436.0 [2023-02-24 18:17:03,286][177155] Sum rewards: 8.719, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.820', 'AMMO2': '0.008', 'AMMO5': '0.009', 'weapon5': '0.018', 'AMMO4': '0.040', 'AMMO3': '0.066', 'weapon7': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.530', 'weapon4': '0.544', 'weapon2': '1.226', 'weapon3': '1.258', 'DAMAGECOUNT': '2.013', 'FRAGCOUNT': '7.000'} [2023-02-24 18:17:03,585][177155] DAMAGECOUNT value on done: 76082.0 [2023-02-24 18:17:03,586][177155] Sum rewards: 12.301, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.890', 'AMMO5': '0.020', 'AMMO2': '0.032', 'WEAPON1': '0.040', 'AMMO3': '0.106', 'AMMO4': '0.161', 'WEAPON4': '0.250', 'weapon5': '0.276', 'ARMOR': '0.400', 'weapon4': '0.424', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.800', 'weapon2': '1.398', 'weapon3': '1.548', 'DAMAGECOUNT': '3.885', 'FRAGCOUNT': '11.000'} [2023-02-24 18:17:04,536][177155] Large shaping reward 2.652 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:17:05,014][177153] Updated weights for policy 0, policy_version 11100 (0.0008) [2023-02-24 18:17:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 45481984. Throughput: 0: 3494.8. Samples: 11364896. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:17:06,376][177119] Avg episode reward: [(0, '8.063')] [2023-02-24 18:17:06,380][177140] Saving new best policy, reward=8.063! [2023-02-24 18:17:07,948][177153] Updated weights for policy 0, policy_version 11110 (0.0009) [2023-02-24 18:17:08,854][177156] DAMAGECOUNT value on done: 78551.0 [2023-02-24 18:17:08,855][177156] Sum rewards: 4.713, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.714', 'AMMO2': '0.010', 'ARMOR': '0.012', 'AMMO5': '0.020', 'WEAPON1': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.072', 'WEAPON4': '0.250', 'weapon5': '0.372', 'WEAPON3': '0.450', 'WEAPON5': '0.500', 'HITCOUNT': '0.550', 'weapon2': '0.622', 'weapon4': '0.940', 'weapon3': '1.348', 'DAMAGECOUNT': '1.929', 'FRAGCOUNT': '5.000'} [2023-02-24 18:17:08,874][177156] DAMAGECOUNT value on done: 80281.0 [2023-02-24 18:17:08,874][177156] Sum rewards: 11.073, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.175', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.064', 'WEAPON5': '0.100', 'weapon5': '0.116', 'weapon7': '0.118', 'WEAPON4': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.334', 'WEAPON7': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.540', 'weapon2': '1.434', 'weapon3': '1.446', 'DAMAGECOUNT': '2.799', 'FRAGCOUNT': '9.000'} [2023-02-24 18:17:09,161][177156] DAMAGECOUNT value on done: 80432.0 [2023-02-24 18:17:09,162][177156] Sum rewards: 6.593, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-3.030', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.060', 'AMMO4': '0.091', 'AMMO3': '0.140', 'weapon5': '0.242', 'weapon4': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.800', 'WEAPON3': '1.050', 'weapon2': '1.146', 'weapon3': '1.952', 'DAMAGECOUNT': '3.183', 'FRAGCOUNT': '9.000'} [2023-02-24 18:17:09,182][177156] DAMAGECOUNT value on done: 80401.0 [2023-02-24 18:17:09,183][177156] Sum rewards: 6.780, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.912', 'AMMO2': '0.007', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO4': '0.033', 'WEAPON1': '0.040', 'AMMO3': '0.048', 'weapon7': '0.052', 'weapon5': '0.196', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.540', 'weapon3': '0.808', 'weapon2': '0.938', 'weapon4': '0.958', 'DAMAGECOUNT': '2.217', 'FRAGCOUNT': '4.000'} [2023-02-24 18:17:10,851][177153] Updated weights for policy 0, policy_version 11120 (0.0009) [2023-02-24 18:17:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 45551616. Throughput: 0: 3498.5. Samples: 11385932. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:17:11,376][177119] Avg episode reward: [(0, '8.118')] [2023-02-24 18:17:11,377][177140] Saving new best policy, reward=8.118! [2023-02-24 18:17:13,798][177153] Updated weights for policy 0, policy_version 11130 (0.0009) [2023-02-24 18:17:15,601][177170] DAMAGECOUNT value on done: 81131.0 [2023-02-24 18:17:15,601][177170] Sum rewards: 3.097, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.024', 'AMMO2': '0.013', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'weapon5': '0.054', 'AMMO4': '0.064', 'AMMO3': '0.087', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.332', 'HITCOUNT': '0.470', 'ARMOR': '0.507', 'WEAPON3': '0.650', 'weapon2': '1.142', 'DAMAGECOUNT': '1.323', 'weapon3': '1.632', 'FRAGCOUNT': '4.000'} [2023-02-24 18:17:15,897][177170] DAMAGECOUNT value on done: 84341.0 [2023-02-24 18:17:15,898][177170] Sum rewards: 7.228, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.400', 'AMMO2': '0.004', 'AMMO5': '0.017', 'AMMO4': '0.021', 'weapon7': '0.054', 'WEAPON4': '0.100', 'weapon5': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.122', 'WEAPON7': '0.200', 'weapon4': '0.378', 'WEAPON5': '0.400', 'HITCOUNT': '0.770', 'weapon2': '0.798', 'WEAPON3': '0.850', 'weapon3': '1.832', 'DAMAGECOUNT': '2.985', 'FRAGCOUNT': '6.500'} [2023-02-24 18:17:15,949][177170] DAMAGECOUNT value on done: 73644.0 [2023-02-24 18:17:15,949][177170] Sum rewards: 15.496, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.967', 'AMMO2': '0.009', 'AMMO5': '0.012', 'AMMO4': '0.043', 'WEAPON1': '0.050', 'AMMO3': '0.075', 'WEAPON4': '0.200', 'weapon4': '0.218', 'weapon5': '0.294', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.660', 'weapon3': '1.478', 'weapon2': '1.756', 'DAMAGECOUNT': '2.967', 'FRAGCOUNT': '13.000'} [2023-02-24 18:17:16,247][177170] DAMAGECOUNT value on done: 84355.0 [2023-02-24 18:17:16,248][177170] Sum rewards: 7.735, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.563', 'ARMOR': '0.004', 'AMMO5': '0.004', 'AMMO2': '0.014', 'AMMO3': '0.030', 'weapon5': '0.064', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon7': '0.118', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.250', 'WEAPON7': '0.300', 'weapon4': '0.338', 'HITCOUNT': '0.400', 'weapon3': '0.722', 'weapon2': '0.988', 'DAMAGECOUNT': '1.605', 'FRAGCOUNT': '5.000'} [2023-02-24 18:17:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13981.9). Total num frames: 45621248. Throughput: 0: 3498.9. Samples: 11406960. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 18:17:16,376][177119] Avg episode reward: [(0, '8.118')] [2023-02-24 18:17:16,721][177153] Updated weights for policy 0, policy_version 11140 (0.0008) [2023-02-24 18:17:17,061][177158] DAMAGECOUNT value on done: 78657.0 [2023-02-24 18:17:17,062][177158] Sum rewards: 9.608, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.032', 'AMMO2': '0.014', 'AMMO5': '0.014', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.069', 'weapon7': '0.096', 'AMMO3': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.218', 'WEAPON5': '0.300', 'weapon4': '0.378', 'HITCOUNT': '0.510', 'WEAPON3': '0.600', 'weapon2': '0.972', 'weapon3': '1.306', 'DAMAGECOUNT': '2.676', 'FRAGCOUNT': '8.000'} [2023-02-24 18:17:17,360][177158] DAMAGECOUNT value on done: 76728.0 [2023-02-24 18:17:17,361][177158] Sum rewards: 8.970, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.728', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'weapon4': '0.110', 'weapon5': '0.194', 'WEAPON5': '0.250', 'HITCOUNT': '0.470', 'WEAPON3': '0.750', 'weapon2': '1.506', 'weapon3': '1.934', 'DAMAGECOUNT': '1.986', 'FRAGCOUNT': '10.000'} [2023-02-24 18:17:18,042][177158] DAMAGECOUNT value on done: 78163.0 [2023-02-24 18:17:18,042][177158] Sum rewards: 2.730, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.754', 'ARMOR': '0.008', 'AMMO2': '0.018', 'AMMO5': '0.024', 'WEAPON1': '0.070', 'weapon4': '0.088', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'weapon5': '0.264', 'HITCOUNT': '0.490', 'WEAPON5': '0.600', 'WEAPON3': '0.850', 'weapon2': '1.084', 'DAMAGECOUNT': '2.037', 'weapon3': '2.142', 'FRAGCOUNT': '4.000'} [2023-02-24 18:17:18,339][177158] DAMAGECOUNT value on done: 82365.0 [2023-02-24 18:17:18,340][177158] Sum rewards: 9.167, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.402', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.026', 'WEAPON1': '0.080', 'AMMO3': '0.113', 'AMMO4': '0.127', 'WEAPON4': '0.250', 'weapon4': '0.272', 'weapon5': '0.288', 'WEAPON5': '0.400', 'HITCOUNT': '0.520', 'WEAPON3': '0.650', 'weapon2': '1.116', 'weapon3': '1.864', 'DAMAGECOUNT': '2.841', 'FRAGCOUNT': '10.000'} [2023-02-24 18:17:18,830][177172] DAMAGECOUNT value on done: 79480.0 [2023-02-24 18:17:18,831][177172] Sum rewards: 3.882, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.454', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.020', 'WEAPON1': '0.030', 'weapon7': '0.050', 'AMMO3': '0.056', 'HITCOUNT': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.172', 'WEAPON5': '0.200', 'weapon4': '0.256', 'WEAPON3': '0.400', 'weapon3': '1.108', 'DAMAGECOUNT': '1.134', 'FRAGCOUNT': '2.000', 'weapon2': '2.168'} [2023-02-24 18:17:19,118][177172] DAMAGECOUNT value on done: 78675.0 [2023-02-24 18:17:19,118][177172] Sum rewards: -0.690, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.269', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO5': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.135', 'weapon5': '0.202', 'weapon4': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'HITCOUNT': '0.450', 'WEAPON3': '0.900', 'weapon2': '0.922', 'DAMAGECOUNT': '1.425', 'weapon3': '2.336', 'FRAGCOUNT': '3.000'} [2023-02-24 18:17:19,660][177153] Updated weights for policy 0, policy_version 11150 (0.0008) [2023-02-24 18:17:19,704][177154] DAMAGECOUNT value on done: 85240.0 [2023-02-24 18:17:19,705][177154] Sum rewards: 3.510, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.270', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'weapon7': '0.080', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'weapon5': '0.138', 'weapon4': '0.262', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'ARMOR': '0.478', 'HITCOUNT': '0.570', 'WEAPON3': '0.700', 'weapon3': '1.416', 'weapon2': '1.912', 'DAMAGECOUNT': '2.178', 'FRAGCOUNT': '4.000'} [2023-02-24 18:17:20,004][177154] DAMAGECOUNT value on done: 80570.0 [2023-02-24 18:17:20,005][177154] Sum rewards: 15.264, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.796', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.040', 'AMMO4': '0.044', 'weapon5': '0.098', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.284', 'WEAPON3': '0.600', 'HITCOUNT': '1.170', 'weapon2': '1.568', 'weapon3': '1.804', 'DAMAGECOUNT': '4.089', 'FRAGCOUNT': '12.000'} [2023-02-24 18:17:20,016][177154] DAMAGECOUNT value on done: 81182.0 [2023-02-24 18:17:20,017][177154] Sum rewards: -1.333, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.556', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'AMMO3': '0.092', 'weapon7': '0.098', 'AMMO4': '0.120', 'HITCOUNT': '0.140', 'weapon5': '0.158', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'weapon2': '0.496', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.612', 'weapon4': '0.824', 'FRAGCOUNT': '1.000', 'weapon3': '1.348'} [2023-02-24 18:17:20,279][177172] DAMAGECOUNT value on done: 80632.0 [2023-02-24 18:17:20,279][177172] Sum rewards: 7.730, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.838', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'weapon7': '0.066', 'AMMO4': '0.119', 'AMMO3': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.144', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.208', 'WEAPON5': '0.450', 'HITCOUNT': '0.600', 'WEAPON3': '0.850', 'weapon3': '1.660', 'weapon2': '1.670', 'DAMAGECOUNT': '3.009', 'FRAGCOUNT': '9.000'} [2023-02-24 18:17:20,317][177154] DAMAGECOUNT value on done: 81698.0 [2023-02-24 18:17:20,317][177154] Sum rewards: 8.392, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.514', 'AMMO2': '0.004', 'ARMOR': '0.016', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.021', 'weapon7': '0.052', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'weapon4': '0.154', 'WEAPON7': '0.200', 'weapon5': '0.222', 'WEAPON5': '0.450', 'HITCOUNT': '0.590', 'WEAPON3': '0.850', 'weapon2': '1.256', 'weapon3': '1.812', 'DAMAGECOUNT': '3.228', 'FRAGCOUNT': '8.000'} [2023-02-24 18:17:20,584][177172] DAMAGECOUNT value on done: 80175.0 [2023-02-24 18:17:20,585][177172] Sum rewards: 14.944, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.004', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'weapon5': '0.028', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'weapon4': '0.066', 'AMMO3': '0.084', 'WEAPON5': '0.100', 'weapon7': '0.104', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'HEALTH': '0.262', 'WEAPON3': '0.550', 'HITCOUNT': '0.850', 'weapon3': '1.764', 'weapon2': '1.878', 'DAMAGECOUNT': '4.029', 'FRAGCOUNT': '10.500'} [2023-02-24 18:17:20,895][177157] DAMAGECOUNT value on done: 84328.0 [2023-02-24 18:17:20,895][177157] Sum rewards: 8.509, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.670', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.032', 'AMMO3': '0.077', 'weapon7': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.108', 'WEAPON4': '0.300', 'HITCOUNT': '0.420', 'weapon2': '0.466', 'ARMOR': '0.478', 'WEAPON3': '0.550', 'weapon4': '0.734', 'weapon3': '1.420', 'DAMAGECOUNT': '1.602', 'FRAGCOUNT': '7.000'} [2023-02-24 18:17:20,907][177157] DAMAGECOUNT value on done: 78434.0 [2023-02-24 18:17:20,908][177157] Sum rewards: 5.135, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.441', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'weapon7': '0.054', 'AMMO4': '0.064', 'AMMO3': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.460', 'weapon4': '0.474', 'WEAPON3': '0.650', 'weapon3': '1.466', 'weapon2': '1.572', 'DAMAGECOUNT': '2.250', 'FRAGCOUNT': '6.000'} [2023-02-24 18:17:21,161][177171] DAMAGECOUNT value on done: 80789.0 [2023-02-24 18:17:21,161][177171] Sum rewards: 5.356, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.452', 'AMMO5': '0.012', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'AMMO3': '0.054', 'WEAPON4': '0.100', 'AMMO4': '0.112', 'weapon5': '0.184', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'ARMOR': '0.441', 'HITCOUNT': '0.450', 'weapon4': '0.458', 'weapon2': '0.846', 'weapon3': '1.166', 'DAMAGECOUNT': '1.782', 'FRAGCOUNT': '4.000'} [2023-02-24 18:17:21,199][177157] DAMAGECOUNT value on done: 78903.0 [2023-02-24 18:17:21,200][177157] Sum rewards: 6.050, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.718', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon7': '0.066', 'AMMO3': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.132', 'weapon5': '0.180', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.455', 'HITCOUNT': '0.520', 'WEAPON3': '0.550', 'weapon2': '0.592', 'weapon4': '0.988', 'weapon3': '1.408', 'DAMAGECOUNT': '3.132', 'FRAGCOUNT': '6.000'} [2023-02-24 18:17:21,210][177157] DAMAGECOUNT value on done: 78260.0 [2023-02-24 18:17:21,211][177157] Sum rewards: 12.428, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.860', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.012', 'weapon5': '0.018', 'AMMO3': '0.034', 'WEAPON5': '0.050', 'weapon7': '0.098', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.300', 'WEAPON7': '0.400', 'weapon4': '0.484', 'HITCOUNT': '0.560', 'weapon3': '0.620', 'weapon2': '1.502', 'DAMAGECOUNT': '2.520', 'FRAGCOUNT': '9.000'} [2023-02-24 18:17:21,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13981.9). Total num frames: 45690880. Throughput: 0: 3500.2. Samples: 11417490. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 18:17:21,376][177119] Avg episode reward: [(0, '8.208')] [2023-02-24 18:17:21,401][177140] Saving new best policy, reward=8.208! [2023-02-24 18:17:21,475][177171] DAMAGECOUNT value on done: 80030.0 [2023-02-24 18:17:21,476][177171] Sum rewards: 3.557, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.454', 'AMMO5': '0.011', 'AMMO2': '0.024', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.106', 'AMMO3': '0.113', 'AMMO4': '0.117', 'weapon5': '0.268', 'WEAPON5': '0.300', 'HITCOUNT': '0.660', 'WEAPON3': '0.700', 'weapon3': '1.590', 'weapon2': '1.608', 'DAMAGECOUNT': '1.914', 'FRAGCOUNT': '4.000'} [2023-02-24 18:17:21,559][177171] DAMAGECOUNT value on done: 79535.0 [2023-02-24 18:17:21,560][177171] Sum rewards: 8.468, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.731', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.030', 'AMMO4': '0.041', 'weapon5': '0.054', 'weapon7': '0.090', 'AMMO3': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'ARMOR': '0.492', 'HITCOUNT': '0.550', 'weapon4': '0.598', 'WEAPON3': '0.700', 'weapon2': '1.066', 'weapon3': '1.596', 'DAMAGECOUNT': '2.574', 'FRAGCOUNT': '10.000'} [2023-02-24 18:17:21,764][177155] DAMAGECOUNT value on done: 81747.0 [2023-02-24 18:17:21,764][177155] Sum rewards: 5.574, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.389', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.012', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'weapon5': '0.316', 'weapon4': '0.336', 'WEAPON5': '0.350', 'HITCOUNT': '0.410', 'WEAPON3': '0.450', 'ARMOR': '0.935', 'weapon3': '1.380', 'weapon2': '1.546', 'DAMAGECOUNT': '1.722', 'FRAGCOUNT': '5.000'} [2023-02-24 18:17:21,855][177171] DAMAGECOUNT value on done: 78490.0 [2023-02-24 18:17:21,856][177171] Sum rewards: 7.697, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.505', 'AMMO2': '0.001', 'AMMO4': '0.004', 'ARMOR': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO3': '0.057', 'weapon7': '0.098', 'WEAPON4': '0.100', 'weapon5': '0.176', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'HITCOUNT': '0.330', 'WEAPON3': '0.350', 'weapon4': '0.376', 'WEAPON7': '0.400', 'weapon3': '0.662', 'DAMAGECOUNT': '1.578', 'weapon2': '2.042', 'FRAGCOUNT': '5.000'} [2023-02-24 18:17:22,057][177155] DAMAGECOUNT value on done: 86447.0 [2023-02-24 18:17:22,057][177155] Sum rewards: 4.829, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.446', 'AMMO2': '0.013', 'AMMO5': '0.017', 'AMMO4': '0.064', 'weapon7': '0.070', 'WEAPON1': '0.080', 'AMMO3': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.270', 'weapon4': '0.358', 'HITCOUNT': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'weapon2': '1.000', 'weapon3': '1.596', 'DAMAGECOUNT': '1.977', 'FRAGCOUNT': '6.000'} [2023-02-24 18:17:22,354][177155] DAMAGECOUNT value on done: 83420.0 [2023-02-24 18:17:22,354][177155] Sum rewards: 8.799, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.614', 'AMMO2': '0.004', 'AMMO5': '0.017', 'AMMO4': '0.022', 'WEAPON1': '0.040', 'weapon7': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.294', 'WEAPON5': '0.350', 'ARMOR': '0.450', 'HITCOUNT': '0.640', 'weapon2': '0.684', 'WEAPON3': '0.700', 'weapon5': '0.792', 'weapon3': '1.764', 'DAMAGECOUNT': '2.952', 'FRAGCOUNT': '6.000'} [2023-02-24 18:17:22,567][177153] Updated weights for policy 0, policy_version 11160 (0.0008) [2023-02-24 18:17:22,658][177155] DAMAGECOUNT value on done: 76593.0 [2023-02-24 18:17:22,658][177155] Sum rewards: 5.810, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.846', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'weapon5': '0.016', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO3': '0.032', 'weapon7': '0.052', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.180', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'weapon3': '0.910', 'DAMAGECOUNT': '1.119', 'weapon2': '1.752', 'FRAGCOUNT': '4.000'} [2023-02-24 18:17:25,455][177153] Updated weights for policy 0, policy_version 11170 (0.0008) [2023-02-24 18:17:26,376][177119] Fps is (10 sec: 14336.1, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 45764608. Throughput: 0: 3503.5. Samples: 11438636. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:17:26,376][177119] Avg episode reward: [(0, '8.109')] [2023-02-24 18:17:27,936][177156] DAMAGECOUNT value on done: 79289.0 [2023-02-24 18:17:27,936][177156] Sum rewards: 8.690, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.124', 'AMMO5': '0.014', 'AMMO2': '0.030', 'WEAPON1': '0.060', 'AMMO3': '0.115', 'AMMO4': '0.147', 'WEAPON4': '0.250', 'weapon5': '0.294', 'weapon4': '0.382', 'WEAPON5': '0.400', 'ARMOR': '0.465', 'HITCOUNT': '0.530', 'WEAPON3': '0.750', 'weapon2': '1.136', 'weapon3': '1.776', 'DAMAGECOUNT': '2.214', 'FRAGCOUNT': '8.000'} [2023-02-24 18:17:27,955][177156] DAMAGECOUNT value on done: 81270.0 [2023-02-24 18:17:27,956][177156] Sum rewards: 8.818, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.570', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.040', 'weapon4': '0.062', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'weapon7': '0.118', 'weapon5': '0.178', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.710', 'weapon2': '1.594', 'weapon3': '1.834', 'DAMAGECOUNT': '2.967', 'FRAGCOUNT': '8.000'} [2023-02-24 18:17:28,239][177156] DAMAGECOUNT value on done: 81152.0 [2023-02-24 18:17:28,240][177156] Sum rewards: 0.812, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.112', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'ARMOR': '0.028', 'weapon7': '0.046', 'AMMO3': '0.065', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.127', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'WEAPON4': '0.500', 'HITCOUNT': '0.600', 'weapon2': '0.646', 'weapon4': '0.906', 'weapon3': '1.216', 'DAMAGECOUNT': '2.160', 'FRAGCOUNT': '3.000'} [2023-02-24 18:17:28,260][177156] DAMAGECOUNT value on done: 80753.0 [2023-02-24 18:17:28,261][177156] Sum rewards: 4.963, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.325', 'AMMO5': '0.004', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'AMMO3': '0.030', 'weapon7': '0.052', 'weapon5': '0.066', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.260', 'weapon4': '0.396', 'weapon3': '0.736', 'DAMAGECOUNT': '1.056', 'FRAGCOUNT': '2.000', 'weapon2': '2.402'} [2023-02-24 18:17:28,355][177153] Updated weights for policy 0, policy_version 11180 (0.0009) [2023-02-24 18:17:31,279][177153] Updated weights for policy 0, policy_version 11190 (0.0008) [2023-02-24 18:17:31,376][177119] Fps is (10 sec: 14336.1, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 45834240. Throughput: 0: 3502.9. Samples: 11459660. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:17:31,376][177119] Avg episode reward: [(0, '8.050')] [2023-02-24 18:17:34,174][177153] Updated weights for policy 0, policy_version 11200 (0.0008) [2023-02-24 18:17:34,753][177170] DAMAGECOUNT value on done: 81917.0 [2023-02-24 18:17:34,754][177170] Sum rewards: 4.834, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.190', 'AMMO2': '0.004', 'weapon7': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.021', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'weapon5': '0.182', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.240', 'WEAPON5': '0.250', 'HITCOUNT': '0.410', 'WEAPON3': '0.550', 'weapon3': '1.026', 'weapon2': '1.676', 'DAMAGECOUNT': '2.358', 'FRAGCOUNT': '3.000'} [2023-02-24 18:17:35,053][177170] DAMAGECOUNT value on done: 74029.0 [2023-02-24 18:17:35,053][177170] Sum rewards: 3.401, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.640', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.009', 'WEAPON1': '0.020', 'AMMO3': '0.030', 'weapon7': '0.052', 'weapon5': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.190', 'WEAPON5': '0.200', 'WEAPON3': '0.200', 'weapon3': '0.776', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.155', 'weapon2': '3.010'} [2023-02-24 18:17:35,063][177170] DAMAGECOUNT value on done: 85376.0 [2023-02-24 18:17:35,063][177170] Sum rewards: 13.277, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.560', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.038', 'AMMO3': '0.077', 'weapon7': '0.084', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO6': '0.260', 'AMMO7': '0.260', 'WEAPON7': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.770', 'weapon3': '1.430', 'weapon2': '2.220', 'DAMAGECOUNT': '3.105', 'FRAGCOUNT': '9.000'} [2023-02-24 18:17:35,092][177155] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 18:17:35,357][177170] DAMAGECOUNT value on done: 85270.0 [2023-02-24 18:17:35,357][177170] Sum rewards: 8.306, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.314', 'AMMO2': '0.004', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.020', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.156', 'weapon5': '0.216', 'WEAPON5': '0.350', 'HITCOUNT': '0.600', 'WEAPON3': '0.700', 'weapon2': '1.280', 'weapon3': '2.064', 'DAMAGECOUNT': '2.745', 'FRAGCOUNT': '7.000'} [2023-02-24 18:17:36,138][177158] DAMAGECOUNT value on done: 79315.0 [2023-02-24 18:17:36,138][177158] Sum rewards: 5.407, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.013', 'AMMO4': '0.052', 'WEAPON1': '0.060', 'AMMO3': '0.101', 'weapon5': '0.208', 'WEAPON5': '0.300', 'HITCOUNT': '0.450', 'WEAPON3': '0.650', 'weapon2': '1.104', 'DAMAGECOUNT': '1.974', 'weapon3': '2.224', 'FRAGCOUNT': '5.000'} [2023-02-24 18:17:36,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 45903872. Throughput: 0: 3503.3. Samples: 11470180. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:17:36,376][177119] Avg episode reward: [(0, '7.867')] [2023-02-24 18:17:36,439][177158] DAMAGECOUNT value on done: 77596.0 [2023-02-24 18:17:36,440][177158] Sum rewards: 10.090, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.650', 'AMMO2': '0.018', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.092', 'AMMO3': '0.099', 'WEAPON4': '0.150', 'weapon5': '0.308', 'weapon4': '0.328', 'WEAPON5': '0.450', 'ARMOR': '0.465', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'weapon2': '1.208', 'weapon3': '1.638', 'DAMAGECOUNT': '2.604', 'FRAGCOUNT': '9.000'} [2023-02-24 18:17:36,712][177171] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:17:37,115][177158] DAMAGECOUNT value on done: 79258.0 [2023-02-24 18:17:37,115][177158] Sum rewards: 7.908, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.532', 'AMMO2': '0.018', 'AMMO3': '0.036', 'AMMO4': '0.091', 'weapon2': '0.114', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.300', 'HITCOUNT': '0.310', 'weapon7': '0.402', 'ARMOR': '0.457', 'weapon3': '0.572', 'weapon4': '1.014', 'DAMAGECOUNT': '2.085', 'FRAGCOUNT': '5.000'} [2023-02-24 18:17:37,125][177153] Updated weights for policy 0, policy_version 11210 (0.0008) [2023-02-24 18:17:37,409][177158] DAMAGECOUNT value on done: 83004.0 [2023-02-24 18:17:37,409][177158] Sum rewards: 5.075, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.010', 'AMMO5': '0.005', 'AMMO2': '0.034', 'WEAPON1': '0.040', 'weapon7': '0.046', 'AMMO3': '0.069', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.168', 'weapon5': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.380', 'WEAPON3': '0.450', 'weapon4': '0.758', 'weapon2': '0.812', 'weapon3': '1.028', 'DAMAGECOUNT': '1.917', 'FRAGCOUNT': '3.000'} [2023-02-24 18:17:37,989][177172] DAMAGECOUNT value on done: 80031.0 [2023-02-24 18:17:37,989][177172] Sum rewards: -0.636, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.370', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.015', 'weapon7': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.076', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.120', 'weapon5': '0.124', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.440', 'weapon4': '0.706', 'WEAPON3': '0.750', 'weapon2': '1.028', 'DAMAGECOUNT': '1.653', 'weapon3': '1.866', 'FRAGCOUNT': '3.000'} [2023-02-24 18:17:38,295][177172] DAMAGECOUNT value on done: 79663.0 [2023-02-24 18:17:38,296][177172] Sum rewards: 7.000, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.566', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.009', 'ARMOR': '0.012', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'weapon5': '0.154', 'weapon4': '0.230', 'WEAPON5': '0.250', 'WEAPON3': '0.750', 'HITCOUNT': '0.830', 'weapon2': '1.362', 'weapon3': '1.994', 'DAMAGECOUNT': '2.964', 'FRAGCOUNT': '7.000'} [2023-02-24 18:17:38,891][177154] DAMAGECOUNT value on done: 85923.0 [2023-02-24 18:17:38,892][177154] Sum rewards: 8.246, reward structure: {'DEATHCOUNT': '-4.500', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon7': '0.056', 'AMMO3': '0.069', 'AMMO4': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HEALTH': '0.118', 'WEAPON4': '0.150', 'weapon5': '0.184', 'WEAPON5': '0.250', 'weapon4': '0.256', 'WEAPON3': '0.400', 'HITCOUNT': '0.470', 'weapon3': '1.254', 'weapon2': '2.046', 'DAMAGECOUNT': '2.049', 'FRAGCOUNT': '5.000'} [2023-02-24 18:17:39,191][177154] DAMAGECOUNT value on done: 82371.0 [2023-02-24 18:17:39,191][177154] Sum rewards: 17.298, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.960', 'AMMO5': '0.010', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'AMMO3': '0.089', 'weapon7': '0.100', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.214', 'WEAPON5': '0.300', 'weapon4': '0.522', 'WEAPON3': '0.700', 'HITCOUNT': '0.870', 'weapon2': '1.278', 'weapon3': '1.596', 'DAMAGECOUNT': '5.403', 'FRAGCOUNT': '13.000'} [2023-02-24 18:17:39,202][177154] DAMAGECOUNT value on done: 81838.0 [2023-02-24 18:17:39,203][177154] Sum rewards: 1.944, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.420', 'AMMO5': '0.012', 'ARMOR': '0.013', 'AMMO2': '0.027', 'WEAPON1': '0.040', 'weapon7': '0.052', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.122', 'AMMO4': '0.137', 'WEAPON7': '0.200', 'weapon5': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'HITCOUNT': '0.600', 'weapon4': '0.638', 'WEAPON3': '0.800', 'weapon2': '0.840', 'weapon3': '1.790', 'DAMAGECOUNT': '1.968', 'FRAGCOUNT': '4.000'} [2023-02-24 18:17:39,484][177172] DAMAGECOUNT value on done: 81482.0 [2023-02-24 18:17:39,485][177172] Sum rewards: 8.777, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.694', 'AMMO2': '0.013', 'AMMO5': '0.022', 'ARMOR': '0.036', 'WEAPON1': '0.050', 'weapon7': '0.050', 'weapon5': '0.060', 'AMMO4': '0.067', 'AMMO3': '0.097', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.638', 'HITCOUNT': '0.640', 'WEAPON3': '0.800', 'weapon4': '0.814', 'weapon3': '2.044', 'DAMAGECOUNT': '2.550', 'FRAGCOUNT': '9.000'} [2023-02-24 18:17:39,502][177154] DAMAGECOUNT value on done: 83449.0 [2023-02-24 18:17:39,503][177154] Sum rewards: 10.901, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.778', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.010', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO4': '0.052', 'weapon4': '0.088', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.206', 'WEAPON5': '0.250', 'HITCOUNT': '0.620', 'WEAPON3': '0.700', 'weapon2': '1.366', 'weapon3': '1.930', 'DAMAGECOUNT': '3.711', 'FRAGCOUNT': '8.000'} [2023-02-24 18:17:39,781][177172] DAMAGECOUNT value on done: 80483.0 [2023-02-24 18:17:39,782][177172] Sum rewards: 2.577, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.325', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'weapon5': '0.052', 'AMMO3': '0.062', 'weapon7': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.108', 'HITCOUNT': '0.290', 'weapon4': '0.292', 'WEAPON3': '0.400', 'weapon2': '0.898', 'DAMAGECOUNT': '0.924', 'weapon3': '1.066', 'FRAGCOUNT': '2.000'} [2023-02-24 18:17:40,034][177153] Updated weights for policy 0, policy_version 11220 (0.0008) [2023-02-24 18:17:40,070][177157] DAMAGECOUNT value on done: 85178.0 [2023-02-24 18:17:40,071][177157] Sum rewards: 5.497, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.324', 'AMMO2': '0.021', 'AMMO5': '0.024', 'WEAPON1': '0.050', 'AMMO3': '0.082', 'AMMO4': '0.104', 'weapon5': '0.306', 'WEAPON4': '0.350', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'WEAPON5': '0.700', 'weapon4': '0.732', 'weapon2': '1.048', 'weapon3': '1.514', 'DAMAGECOUNT': '2.550', 'FRAGCOUNT': '6.500'} [2023-02-24 18:17:40,081][177157] DAMAGECOUNT value on done: 79847.0 [2023-02-24 18:17:40,082][177157] Sum rewards: 13.478, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.592', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.060', 'AMMO4': '0.060', 'AMMO3': '0.100', 'WEAPON4': '0.300', 'weapon5': '0.300', 'WEAPON5': '0.400', 'ARMOR': '0.420', 'weapon4': '0.528', 'WEAPON3': '0.650', 'HITCOUNT': '0.840', 'weapon2': '1.090', 'weapon3': '1.808', 'DAMAGECOUNT': '4.239', 'FRAGCOUNT': '10.000'} [2023-02-24 18:17:40,366][177171] DAMAGECOUNT value on done: 81656.0 [2023-02-24 18:17:40,367][177171] Sum rewards: 12.385, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.172', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.040', 'AMMO4': '0.054', 'AMMO3': '0.058', 'weapon7': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.292', 'WEAPON3': '0.400', 'HITCOUNT': '0.440', 'weapon3': '1.112', 'weapon2': '1.706', 'DAMAGECOUNT': '2.532', 'FRAGCOUNT': '8.000'} [2023-02-24 18:17:40,379][177157] DAMAGECOUNT value on done: 79463.0 [2023-02-24 18:17:40,379][177157] Sum rewards: 7.143, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.039', 'AMMO3': '0.049', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.194', 'HEALTH': '0.244', 'WEAPON3': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.380', 'weapon2': '0.624', 'weapon3': '0.736', 'weapon4': '0.754', 'DAMAGECOUNT': '1.680', 'FRAGCOUNT': '5.000'} [2023-02-24 18:17:40,391][177157] DAMAGECOUNT value on done: 78853.0 [2023-02-24 18:17:40,391][177157] Sum rewards: 5.723, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.311', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon7': '0.048', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'weapon5': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.113', 'weapon4': '0.132', 'AMMO4': '0.133', 'WEAPON5': '0.300', 'HITCOUNT': '0.420', 'WEAPON3': '0.650', 'weapon2': '1.678', 'weapon3': '1.738', 'DAMAGECOUNT': '1.779', 'FRAGCOUNT': '6.000'} [2023-02-24 18:17:40,668][177171] DAMAGECOUNT value on done: 80626.0 [2023-02-24 18:17:40,668][177171] Sum rewards: 7.384, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.293', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.054', 'weapon5': '0.148', 'WEAPON5': '0.150', 'weapon4': '0.216', 'HITCOUNT': '0.310', 'WEAPON3': '0.400', 'ARMOR': '0.400', 'weapon3': '1.138', 'weapon2': '1.682', 'DAMAGECOUNT': '1.788', 'FRAGCOUNT': '5.000'} [2023-02-24 18:17:40,752][177171] DAMAGECOUNT value on done: 80135.0 [2023-02-24 18:17:40,752][177171] Sum rewards: 9.838, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.025', 'AMMO3': '0.070', 'WEAPON5': '0.200', 'weapon5': '0.254', 'HEALTH': '0.418', 'WEAPON3': '0.450', 'HITCOUNT': '0.580', 'weapon3': '1.678', 'DAMAGECOUNT': '1.800', 'weapon2': '1.840', 'FRAGCOUNT': '7.000'} [2023-02-24 18:17:40,997][177155] DAMAGECOUNT value on done: 83171.0 [2023-02-24 18:17:40,997][177155] Sum rewards: 10.222, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.605', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'weapon7': '0.038', 'weapon5': '0.094', 'AMMO3': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.169', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.408', 'ARMOR': '0.555', 'WEAPON3': '0.750', 'HITCOUNT': '0.960', 'weapon2': '1.102', 'weapon3': '2.024', 'DAMAGECOUNT': '4.272', 'FRAGCOUNT': '7.000'} [2023-02-24 18:17:41,059][177171] DAMAGECOUNT value on done: 79794.0 [2023-02-24 18:17:41,060][177171] Sum rewards: 12.745, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.218', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.029', 'weapon7': '0.032', 'AMMO3': '0.100', 'AMMO4': '0.147', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.336', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'ARMOR': '0.454', 'weapon4': '0.484', 'WEAPON3': '0.650', 'HITCOUNT': '0.670', 'weapon2': '0.838', 'weapon3': '1.878', 'DAMAGECOUNT': '3.912', 'FRAGCOUNT': '11.000'} [2023-02-24 18:17:41,301][177155] DAMAGECOUNT value on done: 86532.0 [2023-02-24 18:17:41,301][177155] Sum rewards: 1.980, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.660', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'weapon7': '0.048', 'WEAPON4': '0.050', 'weapon5': '0.052', 'AMMO3': '0.053', 'HITCOUNT': '0.070', 'WEAPON5': '0.100', 'weapon4': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.255', 'WEAPON3': '0.400', 'weapon3': '0.866', 'FRAGCOUNT': '1.000', 'weapon2': '2.936'} [2023-02-24 18:17:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 45973504. Throughput: 0: 3502.5. Samples: 11491094. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 18:17:41,376][177119] Avg episode reward: [(0, '7.617')] [2023-02-24 18:17:41,599][177155] DAMAGECOUNT value on done: 84615.0 [2023-02-24 18:17:41,599][177155] Sum rewards: 10.787, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.319', 'AMMO2': '0.015', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'weapon7': '0.060', 'AMMO4': '0.074', 'AMMO3': '0.074', 'weapon5': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'weapon4': '0.784', 'HITCOUNT': '0.860', 'weapon2': '1.038', 'weapon3': '1.500', 'DAMAGECOUNT': '3.585', 'FRAGCOUNT': '9.000'} [2023-02-24 18:17:41,898][177155] DAMAGECOUNT value on done: 78024.0 [2023-02-24 18:17:41,899][177155] Sum rewards: 6.724, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.529', 'ARMOR': '0.008', 'AMMO2': '0.010', 'AMMO5': '0.025', 'AMMO4': '0.049', 'WEAPON1': '0.080', 'weapon7': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.206', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.310', 'weapon5': '0.328', 'weapon2': '0.386', 'WEAPON5': '0.600', 'HITCOUNT': '0.710', 'WEAPON3': '1.400', 'weapon3': '2.326', 'DAMAGECOUNT': '4.293', 'FRAGCOUNT': '10.500'} [2023-02-24 18:17:42,897][177153] Updated weights for policy 0, policy_version 11230 (0.0008) [2023-02-24 18:17:45,811][177153] Updated weights for policy 0, policy_version 11240 (0.0008) [2023-02-24 18:17:46,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 46043136. Throughput: 0: 3505.8. Samples: 11512204. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 18:17:46,376][177119] Avg episode reward: [(0, '7.642')] [2023-02-24 18:17:47,117][177156] DAMAGECOUNT value on done: 80634.0 [2023-02-24 18:17:47,118][177156] Sum rewards: 12.922, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.924', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'AMMO3': '0.103', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'weapon5': '0.160', 'weapon4': '0.234', 'WEAPON4': '0.300', 'WEAPON3': '0.700', 'HITCOUNT': '0.940', 'weapon3': '1.510', 'weapon2': '1.766', 'DAMAGECOUNT': '4.035', 'FRAGCOUNT': '12.000'} [2023-02-24 18:17:47,138][177156] DAMAGECOUNT value on done: 81835.0 [2023-02-24 18:17:47,139][177156] Sum rewards: 6.055, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.370', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'ARMOR': '0.032', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.065', 'AMMO4': '0.067', 'weapon7': '0.072', 'AMMO6': '0.320', 'AMMO7': '0.320', 'HITCOUNT': '0.370', 'WEAPON4': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.780', 'weapon3': '1.004', 'weapon2': '1.326', 'DAMAGECOUNT': '1.695', 'FRAGCOUNT': '6.000'} [2023-02-24 18:17:47,437][177156] DAMAGECOUNT value on done: 81895.0 [2023-02-24 18:17:47,438][177156] Sum rewards: 6.354, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.312', 'AMMO5': '0.007', 'AMMO2': '0.042', 'WEAPON1': '0.050', 'AMMO3': '0.076', 'weapon7': '0.106', 'weapon5': '0.150', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'AMMO4': '0.211', 'WEAPON5': '0.250', 'HITCOUNT': '0.300', 'WEAPON3': '0.450', 'weapon2': '0.622', 'weapon3': '0.738', 'weapon4': '0.884', 'DAMAGECOUNT': '2.229', 'FRAGCOUNT': '5.000'} [2023-02-24 18:17:47,459][177156] DAMAGECOUNT value on done: 81648.0 [2023-02-24 18:17:47,459][177156] Sum rewards: 8.898, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.070', 'weapon7': '0.004', 'AMMO2': '0.011', 'AMMO5': '0.015', 'weapon4': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'WEAPON1': '0.060', 'AMMO3': '0.087', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.348', 'WEAPON5': '0.450', 'HITCOUNT': '0.470', 'WEAPON3': '0.600', 'weapon3': '1.638', 'weapon2': '1.658', 'DAMAGECOUNT': '2.685', 'FRAGCOUNT': '8.000'} [2023-02-24 18:17:48,732][177153] Updated weights for policy 0, policy_version 11250 (0.0009) [2023-02-24 18:17:51,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14062.9, 300 sec: 14009.7). Total num frames: 46116864. Throughput: 0: 3506.0. Samples: 11522666. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 18:17:51,376][177119] Avg episode reward: [(0, '7.744')] [2023-02-24 18:17:51,666][177153] Updated weights for policy 0, policy_version 11260 (0.0008) [2023-02-24 18:17:53,971][177170] DAMAGECOUNT value on done: 82504.0 [2023-02-24 18:17:53,971][177170] Sum rewards: 0.772, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.316', 'AMMO5': '0.020', 'AMMO2': '0.032', 'WEAPON1': '0.050', 'weapon7': '0.052', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.162', 'weapon5': '0.194', 'WEAPON7': '0.200', 'HITCOUNT': '0.390', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.608', 'WEAPON3': '0.650', 'weapon2': '0.788', 'DAMAGECOUNT': '1.761', 'weapon3': '1.978', 'FRAGCOUNT': '5.000'} [2023-02-24 18:17:54,169][177156] Large shaping reward 2.623 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.591, 197.0), ('weapon7', 0.002)] [2023-02-24 18:17:54,257][177170] DAMAGECOUNT value on done: 75126.0 [2023-02-24 18:17:54,258][177170] Sum rewards: 8.019, reward structure: {'DEATHCOUNT': '-9.750', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'weapon7': '0.052', 'AMMO4': '0.107', 'AMMO3': '0.117', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'weapon5': '0.252', 'WEAPON7': '0.300', 'HEALTH': '0.507', 'HITCOUNT': '0.530', 'weapon4': '0.590', 'WEAPON3': '0.650', 'weapon2': '0.702', 'weapon3': '1.706', 'DAMAGECOUNT': '3.291', 'FRAGCOUNT': '8.000'} [2023-02-24 18:17:54,265][177170] DAMAGECOUNT value on done: 86525.0 [2023-02-24 18:17:54,265][177170] Sum rewards: 8.474, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.473', 'AMMO2': '0.014', 'AMMO5': '0.030', 'WEAPON1': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.137', 'weapon4': '0.142', 'WEAPON4': '0.150', 'weapon5': '0.292', 'WEAPON5': '0.500', 'HITCOUNT': '0.550', 'WEAPON3': '0.850', 'weapon2': '1.080', 'weapon3': '2.134', 'DAMAGECOUNT': '3.447', 'FRAGCOUNT': '10.000'} [2023-02-24 18:17:54,557][177170] DAMAGECOUNT value on done: 86355.0 [2023-02-24 18:17:54,558][177170] Sum rewards: 9.537, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.671', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'AMMO3': '0.068', 'weapon7': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.153', 'weapon5': '0.176', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'ARMOR': '0.416', 'weapon4': '0.460', 'HITCOUNT': '0.780', 'weapon3': '1.156', 'weapon2': '1.730', 'DAMAGECOUNT': '3.255', 'FRAGCOUNT': '8.000'} [2023-02-24 18:17:54,581][177153] Updated weights for policy 0, policy_version 11270 (0.0008) [2023-02-24 18:17:55,181][177158] DAMAGECOUNT value on done: 79674.0 [2023-02-24 18:17:55,182][177158] Sum rewards: 3.389, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.800', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'weapon7': '0.102', 'AMMO3': '0.107', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'HITCOUNT': '0.380', 'WEAPON7': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.554', 'weapon3': '0.984', 'DAMAGECOUNT': '1.077', 'weapon2': '1.182', 'FRAGCOUNT': '4.000'} [2023-02-24 18:17:55,481][177158] DAMAGECOUNT value on done: 78111.0 [2023-02-24 18:17:55,481][177158] Sum rewards: 2.015, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.730', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'ARMOR': '0.028', 'AMMO4': '0.050', 'AMMO3': '0.091', 'weapon7': '0.094', 'weapon5': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.350', 'weapon4': '0.540', 'WEAPON3': '0.600', 'weapon2': '0.958', 'weapon3': '1.074', 'DAMAGECOUNT': '1.545', 'FRAGCOUNT': '4.000'} [2023-02-24 18:17:56,155][177158] DAMAGECOUNT value on done: 80098.0 [2023-02-24 18:17:56,156][177158] Sum rewards: 11.969, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.053', 'AMMO4': '0.075', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.128', 'WEAPON5': '0.200', 'HEALTH': '0.230', 'weapon4': '0.292', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.710', 'weapon3': '1.200', 'weapon2': '1.860', 'DAMAGECOUNT': '2.520', 'FRAGCOUNT': '8.000'} [2023-02-24 18:17:56,376][177119] Fps is (10 sec: 14335.9, 60 sec: 14062.9, 300 sec: 14009.7). Total num frames: 46186496. Throughput: 0: 3508.1. Samples: 11543798. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 18:17:56,376][177119] Avg episode reward: [(0, '7.673')] [2023-02-24 18:17:56,461][177158] DAMAGECOUNT value on done: 83984.0 [2023-02-24 18:17:56,461][177158] Sum rewards: 7.017, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.535', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.040', 'weapon7': '0.052', 'AMMO4': '0.061', 'weapon5': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.124', 'WEAPON5': '0.300', 'HITCOUNT': '0.640', 'WEAPON3': '0.800', 'weapon3': '1.812', 'weapon2': '1.866', 'DAMAGECOUNT': '2.940', 'FRAGCOUNT': '7.000'} [2023-02-24 18:17:57,148][177172] DAMAGECOUNT value on done: 81330.0 [2023-02-24 18:17:57,149][177172] Sum rewards: 14.799, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.393', 'ARMOR': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.111', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.264', 'weapon4': '0.360', 'WEAPON3': '0.700', 'HITCOUNT': '0.940', 'weapon2': '0.966', 'weapon3': '2.014', 'DAMAGECOUNT': '3.897', 'FRAGCOUNT': '13.000'} [2023-02-24 18:17:57,445][177172] DAMAGECOUNT value on done: 81078.0 [2023-02-24 18:17:57,445][177172] Sum rewards: 13.210, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.736', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'AMMO4': '0.144', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.168', 'weapon4': '0.218', 'WEAPON5': '0.350', 'HITCOUNT': '0.910', 'WEAPON3': '0.950', 'weapon2': '1.370', 'weapon3': '1.958', 'DAMAGECOUNT': '4.245', 'FRAGCOUNT': '14.000'} [2023-02-24 18:17:57,520][177153] Updated weights for policy 0, policy_version 11280 (0.0008) [2023-02-24 18:17:57,925][177154] DAMAGECOUNT value on done: 86483.0 [2023-02-24 18:17:57,925][177154] Sum rewards: 4.578, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.793', 'AMMO2': '0.005', 'AMMO5': '0.007', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.022', 'weapon7': '0.052', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.182', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.324', 'WEAPON3': '0.450', 'HITCOUNT': '0.460', 'weapon2': '0.688', 'weapon3': '1.118', 'DAMAGECOUNT': '1.680', 'FRAGCOUNT': '4.000'} [2023-02-24 18:17:58,211][177154] DAMAGECOUNT value on done: 82941.0 [2023-02-24 18:17:58,211][177154] Sum rewards: 6.054, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.373', 'AMMO5': '0.005', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO3': '0.057', 'AMMO4': '0.094', 'weapon5': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'WEAPON3': '0.400', 'HITCOUNT': '0.510', 'weapon2': '0.554', 'weapon4': '0.684', 'weapon3': '1.130', 'DAMAGECOUNT': '1.710', 'FRAGCOUNT': '5.000'} [2023-02-24 18:17:58,224][177154] DAMAGECOUNT value on done: 83468.0 [2023-02-24 18:17:58,224][177154] Sum rewards: 14.370, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.843', 'AMMO5': '0.005', 'AMMO2': '0.013', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO4': '0.064', 'weapon5': '0.108', 'AMMO3': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.402', 'WEAPON3': '0.850', 'weapon2': '0.968', 'HITCOUNT': '1.100', 'weapon3': '1.924', 'DAMAGECOUNT': '4.890', 'FRAGCOUNT': '13.000'} [2023-02-24 18:17:58,522][177154] DAMAGECOUNT value on done: 83997.0 [2023-02-24 18:17:58,522][177154] Sum rewards: 4.298, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.013', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.015', 'WEAPON1': '0.060', 'AMMO3': '0.085', 'weapon5': '0.278', 'WEAPON5': '0.350', 'HITCOUNT': '0.440', 'WEAPON3': '0.550', 'weapon2': '1.032', 'DAMAGECOUNT': '1.644', 'weapon3': '2.100', 'FRAGCOUNT': '3.000'} [2023-02-24 18:17:58,625][177172] DAMAGECOUNT value on done: 82181.0 [2023-02-24 18:17:58,625][177172] Sum rewards: 5.491, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.010', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO3': '0.103', 'weapon5': '0.254', 'WEAPON5': '0.400', 'HITCOUNT': '0.510', 'WEAPON3': '0.700', 'weapon2': '1.616', 'weapon3': '1.776', 'DAMAGECOUNT': '2.097', 'FRAGCOUNT': '5.000'} [2023-02-24 18:17:58,919][177172] DAMAGECOUNT value on done: 81196.0 [2023-02-24 18:17:58,920][177172] Sum rewards: 1.737, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.026', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.033', 'weapon7': '0.114', 'AMMO3': '0.125', 'weapon5': '0.128', 'AMMO4': '0.166', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'HITCOUNT': '0.330', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.604', 'WEAPON3': '0.800', 'weapon4': '0.950', 'weapon3': '1.374', 'DAMAGECOUNT': '2.139', 'FRAGCOUNT': '4.000'} [2023-02-24 18:17:59,192][177157] DAMAGECOUNT value on done: 86017.0 [2023-02-24 18:17:59,193][177157] Sum rewards: 4.341, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.266', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'AMMO2': '0.047', 'weapon5': '0.098', 'AMMO3': '0.137', 'weapon7': '0.174', 'AMMO4': '0.235', 'WEAPON5': '0.350', 'AMMO6': '0.400', 'AMMO7': '0.400', 'WEAPON4': '0.450', 'HITCOUNT': '0.570', 'WEAPON7': '0.600', 'weapon4': '0.666', 'WEAPON3': '0.950', 'weapon2': '0.968', 'weapon3': '1.732', 'DAMAGECOUNT': '2.517', 'FRAGCOUNT': '6.000'} [2023-02-24 18:17:59,203][177157] DAMAGECOUNT value on done: 80507.0 [2023-02-24 18:17:59,204][177157] Sum rewards: 3.912, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.300', 'AMMO2': '0.019', 'AMMO5': '0.022', 'WEAPON1': '0.090', 'AMMO4': '0.097', 'AMMO3': '0.130', 'weapon5': '0.222', 'HITCOUNT': '0.480', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'weapon2': '1.026', 'DAMAGECOUNT': '1.980', 'weapon3': '2.246', 'FRAGCOUNT': '5.000'} [2023-02-24 18:17:59,496][177157] DAMAGECOUNT value on done: 80162.0 [2023-02-24 18:17:59,496][177157] Sum rewards: 0.493, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.668', 'AMMO5': '0.010', 'ARMOR': '0.028', 'AMMO2': '0.039', 'weapon5': '0.060', 'weapon7': '0.098', 'AMMO3': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.193', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.600', 'HITCOUNT': '0.710', 'weapon2': '0.710', 'WEAPON3': '0.750', 'weapon3': '1.164', 'weapon4': '1.192', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.097'} [2023-02-24 18:17:59,510][177157] DAMAGECOUNT value on done: 79754.0 [2023-02-24 18:17:59,511][177157] Sum rewards: 7.161, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.102', 'AMMO5': '0.018', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.108', 'AMMO3': '0.109', 'weapon5': '0.172', 'weapon4': '0.212', 'WEAPON5': '0.450', 'HITCOUNT': '0.580', 'WEAPON3': '0.800', 'ARMOR': '0.891', 'weapon3': '1.534', 'weapon2': '1.804', 'DAMAGECOUNT': '2.703', 'FRAGCOUNT': '8.000'} [2023-02-24 18:17:59,533][177171] DAMAGECOUNT value on done: 83185.0 [2023-02-24 18:17:59,534][177171] Sum rewards: 15.287, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.094', 'AMMO5': '0.017', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'AMMO4': '0.108', 'weapon5': '0.116', 'AMMO3': '0.122', 'WEAPON4': '0.200', 'weapon4': '0.238', 'WEAPON5': '0.400', 'ARMOR': '0.481', 'HITCOUNT': '0.820', 'WEAPON3': '0.850', 'weapon2': '0.946', 'weapon3': '2.452', 'DAMAGECOUNT': '4.578', 'FRAGCOUNT': '14.000'} [2023-02-24 18:17:59,826][177171] DAMAGECOUNT value on done: 82084.0 [2023-02-24 18:17:59,827][177171] Sum rewards: 16.280, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.004', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.022', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'HEALTH': '0.122', 'weapon4': '0.236', 'weapon5': '0.302', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon2': '0.782', 'HITCOUNT': '0.990', 'weapon3': '2.168', 'DAMAGECOUNT': '4.374', 'FRAGCOUNT': '12.000'} [2023-02-24 18:17:59,911][177171] DAMAGECOUNT value on done: 80547.0 [2023-02-24 18:17:59,911][177171] Sum rewards: 3.972, reward structure: {'DEATHCOUNT': '-4.500', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO3': '0.040', 'weapon7': '0.048', 'weapon5': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.133', 'WEAPON3': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.250', 'weapon4': '0.318', 'HEALTH': '0.348', 'weapon3': '0.892', 'DAMAGECOUNT': '1.236', 'FRAGCOUNT': '2.000', 'weapon2': '2.126'} [2023-02-24 18:18:00,207][177171] DAMAGECOUNT value on done: 80608.0 [2023-02-24 18:18:00,207][177171] Sum rewards: 6.531, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.592', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'weapon5': '0.126', 'AMMO4': '0.166', 'WEAPON4': '0.250', 'HITCOUNT': '0.430', 'weapon4': '0.468', 'WEAPON3': '0.600', 'weapon3': '1.396', 'weapon2': '1.484', 'DAMAGECOUNT': '2.442', 'FRAGCOUNT': '7.000'} [2023-02-24 18:18:00,237][177155] DAMAGECOUNT value on done: 83778.0 [2023-02-24 18:18:00,238][177155] Sum rewards: 5.822, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.458', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.012', 'WEAPON1': '0.060', 'AMMO3': '0.114', 'weapon5': '0.258', 'WEAPON5': '0.350', 'HITCOUNT': '0.380', 'WEAPON3': '0.700', 'weapon2': '1.316', 'DAMAGECOUNT': '1.821', 'weapon3': '2.024', 'FRAGCOUNT': '6.000'} [2023-02-24 18:18:00,434][177153] Updated weights for policy 0, policy_version 11290 (0.0008) [2023-02-24 18:18:00,544][177155] DAMAGECOUNT value on done: 87727.0 [2023-02-24 18:18:00,545][177155] Sum rewards: 7.698, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.340', 'AMMO2': '0.004', 'ARMOR': '0.008', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO4': '0.022', 'WEAPON1': '0.060', 'weapon4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.154', 'WEAPON5': '0.200', 'HITCOUNT': '1.020', 'WEAPON3': '1.100', 'weapon2': '1.326', 'weapon3': '2.346', 'DAMAGECOUNT': '3.585', 'FRAGCOUNT': '9.000'} [2023-02-24 18:18:00,824][177155] DAMAGECOUNT value on done: 85454.0 [2023-02-24 18:18:00,825][177155] Sum rewards: 8.653, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.039', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'ARMOR': '0.028', 'AMMO3': '0.062', 'AMMO4': '0.074', 'weapon5': '0.126', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.310', 'WEAPON3': '0.500', 'HITCOUNT': '0.580', 'weapon3': '1.318', 'weapon2': '1.694', 'DAMAGECOUNT': '2.517', 'FRAGCOUNT': '8.000'} [2023-02-24 18:18:01,135][177155] DAMAGECOUNT value on done: 79131.0 [2023-02-24 18:18:01,136][177155] Sum rewards: 8.278, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.012', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.039', 'weapon7': '0.078', 'WEAPON1': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.123', 'AMMO4': '0.193', 'WEAPON7': '0.200', 'weapon5': '0.222', 'WEAPON4': '0.250', 'weapon4': '0.356', 'WEAPON5': '0.650', 'HITCOUNT': '0.690', 'weapon2': '0.818', 'WEAPON3': '0.950', 'weapon3': '2.050', 'DAMAGECOUNT': '3.321', 'FRAGCOUNT': '9.000'} [2023-02-24 18:18:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 14009.7). Total num frames: 46256128. Throughput: 0: 3509.5. Samples: 11564888. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 18:18:01,376][177119] Avg episode reward: [(0, '7.442')] [2023-02-24 18:18:03,331][177153] Updated weights for policy 0, policy_version 11300 (0.0009) [2023-02-24 18:18:06,257][177153] Updated weights for policy 0, policy_version 11310 (0.0008) [2023-02-24 18:18:06,321][177156] DAMAGECOUNT value on done: 82015.0 [2023-02-24 18:18:06,322][177156] Sum rewards: 10.126, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.874', 'ARMOR': '0.008', 'AMMO2': '0.020', 'AMMO5': '0.024', 'WEAPON1': '0.030', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.100', 'AMMO3': '0.132', 'weapon5': '0.172', 'WEAPON4': '0.200', 'weapon4': '0.218', 'WEAPON5': '0.500', 'HITCOUNT': '0.750', 'WEAPON3': '0.850', 'weapon2': '1.162', 'weapon3': '2.090', 'DAMAGECOUNT': '4.143', 'FRAGCOUNT': '10.000'} [2023-02-24 18:18:06,367][177156] DAMAGECOUNT value on done: 83379.0 [2023-02-24 18:18:06,367][177156] Sum rewards: 12.289, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.748', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO5': '0.022', 'weapon7': '0.052', 'AMMO4': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.128', 'WEAPON4': '0.200', 'weapon5': '0.260', 'weapon4': '0.264', 'WEAPON5': '0.500', 'HITCOUNT': '0.790', 'WEAPON3': '0.800', 'weapon2': '1.054', 'weapon3': '1.948', 'DAMAGECOUNT': '4.632', 'FRAGCOUNT': '9.500'} [2023-02-24 18:18:06,376][177119] Fps is (10 sec: 13926.5, 60 sec: 14062.9, 300 sec: 14009.7). Total num frames: 46325760. Throughput: 0: 3510.1. Samples: 11575446. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:18:06,376][177119] Avg episode reward: [(0, '7.505')] [2023-02-24 18:18:06,629][177156] DAMAGECOUNT value on done: 83204.0 [2023-02-24 18:18:06,630][177156] Sum rewards: 14.158, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.663', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'ARMOR': '0.012', 'AMMO5': '0.019', 'WEAPON1': '0.030', 'AMMO3': '0.117', 'WEAPON4': '0.200', 'weapon5': '0.240', 'weapon2': '0.374', 'WEAPON5': '0.450', 'weapon4': '0.554', 'HITCOUNT': '0.820', 'WEAPON3': '0.850', 'weapon3': '1.982', 'DAMAGECOUNT': '3.927', 'FRAGCOUNT': '13.000'} [2023-02-24 18:18:06,683][177156] DAMAGECOUNT value on done: 82524.0 [2023-02-24 18:18:06,683][177156] Sum rewards: 10.803, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.738', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO4': '0.082', 'AMMO3': '0.097', 'WEAPON4': '0.150', 'weapon5': '0.184', 'weapon7': '0.204', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.268', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.360', 'WEAPON3': '0.600', 'weapon3': '1.134', 'weapon2': '1.238', 'DAMAGECOUNT': '2.628', 'FRAGCOUNT': '8.000'} [2023-02-24 18:18:09,185][177153] Updated weights for policy 0, policy_version 11320 (0.0008) [2023-02-24 18:18:11,376][177119] Fps is (10 sec: 13926.5, 60 sec: 14062.9, 300 sec: 14009.7). Total num frames: 46395392. Throughput: 0: 3507.0. Samples: 11596452. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:18:11,376][177119] Avg episode reward: [(0, '7.545')] [2023-02-24 18:18:12,104][177153] Updated weights for policy 0, policy_version 11330 (0.0008) [2023-02-24 18:18:13,119][177170] DAMAGECOUNT value on done: 83834.0 [2023-02-24 18:18:13,120][177170] Sum rewards: 9.257, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.895', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.014', 'weapon7': '0.046', 'WEAPON1': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.112', 'AMMO3': '0.131', 'weapon4': '0.326', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'HITCOUNT': '0.790', 'weapon3': '1.596', 'weapon2': '1.694', 'DAMAGECOUNT': '3.390', 'FRAGCOUNT': '9.000'} [2023-02-24 18:18:13,411][177170] DAMAGECOUNT value on done: 75642.0 [2023-02-24 18:18:13,412][177170] Sum rewards: 4.913, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.340', 'AMMO5': '0.015', 'ARMOR': '0.020', 'AMMO2': '0.037', 'WEAPON1': '0.060', 'weapon4': '0.074', 'AMMO3': '0.091', 'WEAPON4': '0.150', 'AMMO4': '0.186', 'weapon5': '0.252', 'HITCOUNT': '0.360', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon2': '1.382', 'DAMAGECOUNT': '1.548', 'weapon3': '1.878', 'FRAGCOUNT': '5.000'} [2023-02-24 18:18:13,421][177170] DAMAGECOUNT value on done: 87453.0 [2023-02-24 18:18:13,422][177170] Sum rewards: 10.642, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.628', 'AMMO5': '0.007', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'weapon7': '0.052', 'AMMO3': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.136', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.164', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.550', 'weapon3': '1.138', 'weapon2': '2.336', 'DAMAGECOUNT': '2.784', 'FRAGCOUNT': '9.000'} [2023-02-24 18:18:13,721][177170] DAMAGECOUNT value on done: 87243.0 [2023-02-24 18:18:13,721][177170] Sum rewards: 4.630, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.230', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.138', 'AMMO3': '0.144', 'WEAPON5': '0.200', 'weapon5': '0.204', 'WEAPON4': '0.350', 'weapon4': '0.384', 'HITCOUNT': '0.650', 'WEAPON3': '0.900', 'weapon2': '0.984', 'weapon3': '2.098', 'DAMAGECOUNT': '2.664', 'FRAGCOUNT': '8.000'} [2023-02-24 18:18:14,337][177158] DAMAGECOUNT value on done: 81189.0 [2023-02-24 18:18:14,338][177158] Sum rewards: 9.995, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.530', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'weapon4': '0.106', 'weapon5': '0.172', 'AMMO3': '0.179', 'WEAPON5': '0.250', 'weapon2': '0.534', 'WEAPON3': '1.100', 'HITCOUNT': '1.190', 'weapon3': '2.600', 'DAMAGECOUNT': '4.545', 'FRAGCOUNT': '12.000'} [2023-02-24 18:18:14,639][177158] DAMAGECOUNT value on done: 79232.0 [2023-02-24 18:18:14,640][177158] Sum rewards: 10.586, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.540', 'AMMO5': '0.013', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'weapon7': '0.070', 'AMMO4': '0.106', 'AMMO3': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.224', 'WEAPON4': '0.250', 'weapon5': '0.282', 'WEAPON5': '0.300', 'HITCOUNT': '0.600', 'WEAPON3': '0.750', 'weapon2': '1.362', 'weapon3': '1.690', 'DAMAGECOUNT': '3.363', 'FRAGCOUNT': '8.500'} [2023-02-24 18:18:15,053][177153] Updated weights for policy 0, policy_version 11340 (0.0008) [2023-02-24 18:18:15,347][177158] DAMAGECOUNT value on done: 81202.0 [2023-02-24 18:18:15,347][177158] Sum rewards: 4.259, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.500', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'weapon7': '0.056', 'weapon5': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.160', 'AMMO3': '0.163', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.532', 'HITCOUNT': '0.700', 'WEAPON3': '0.850', 'weapon2': '0.912', 'weapon3': '1.926', 'DAMAGECOUNT': '3.312', 'FRAGCOUNT': '7.000'} [2023-02-24 18:18:15,657][177158] DAMAGECOUNT value on done: 85063.0 [2023-02-24 18:18:15,658][177158] Sum rewards: 10.418, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.364', 'weapon4': '0.002', 'AMMO2': '0.017', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'weapon5': '0.184', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'HITCOUNT': '0.860', 'weapon2': '1.182', 'weapon3': '2.284', 'DAMAGECOUNT': '3.237', 'FRAGCOUNT': '9.000'} [2023-02-24 18:18:16,284][177172] DAMAGECOUNT value on done: 82001.0 [2023-02-24 18:18:16,284][177172] Sum rewards: 5.727, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.388', 'AMMO5': '0.010', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'AMMO3': '0.082', 'weapon7': '0.128', 'weapon5': '0.136', 'AMMO4': '0.137', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.386', 'WEAPON3': '0.500', 'HITCOUNT': '0.530', 'weapon4': '0.722', 'ARMOR': '0.804', 'weapon3': '1.360', 'DAMAGECOUNT': '2.013', 'FRAGCOUNT': '3.500'} [2023-02-24 18:18:16,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14062.9, 300 sec: 14009.7). Total num frames: 46465024. Throughput: 0: 3504.7. Samples: 11617370. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:18:16,376][177119] Avg episode reward: [(0, '7.526')] [2023-02-24 18:18:16,583][177172] DAMAGECOUNT value on done: 81536.0 [2023-02-24 18:18:16,584][177172] Sum rewards: 4.388, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.424', 'ARMOR': '0.008', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.041', 'AMMO3': '0.074', 'weapon7': '0.116', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.522', 'weapon2': '0.536', 'weapon3': '1.132', 'DAMAGECOUNT': '1.374', 'FRAGCOUNT': '3.000'} [2023-02-24 18:18:17,151][177154] DAMAGECOUNT value on done: 87496.0 [2023-02-24 18:18:17,151][177154] Sum rewards: 10.799, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.017', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO3': '0.078', 'AMMO4': '0.084', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.250', 'weapon5': '0.276', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'weapon4': '0.454', 'ARMOR': '0.504', 'HEALTH': '0.538', 'HITCOUNT': '0.660', 'weapon2': '1.112', 'weapon3': '1.640', 'DAMAGECOUNT': '3.039', 'FRAGCOUNT': '7.000'} [2023-02-24 18:18:17,447][177154] DAMAGECOUNT value on done: 84436.0 [2023-02-24 18:18:17,447][177154] Sum rewards: 9.989, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.345', 'AMMO2': '0.009', 'AMMO5': '0.015', 'AMMO4': '0.044', 'WEAPON1': '0.070', 'AMMO3': '0.134', 'weapon5': '0.308', 'WEAPON5': '0.450', 'HITCOUNT': '0.760', 'WEAPON3': '0.900', 'weapon2': '1.340', 'weapon3': '1.900', 'DAMAGECOUNT': '2.904', 'FRAGCOUNT': '10.000'} [2023-02-24 18:18:17,457][177154] DAMAGECOUNT value on done: 83753.0 [2023-02-24 18:18:17,457][177154] Sum rewards: 7.689, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.052', 'AMMO5': '0.008', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.085', 'weapon4': '0.088', 'weapon5': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'weapon7': '0.106', 'WEAPON5': '0.150', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'weapon2': '1.588', 'weapon3': '1.826', 'DAMAGECOUNT': '2.436', 'FRAGCOUNT': '6.500'} [2023-02-24 18:18:17,749][177172] DAMAGECOUNT value on done: 83006.0 [2023-02-24 18:18:17,750][177172] Sum rewards: 5.439, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.766', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'AMMO2': '0.030', 'weapon5': '0.104', 'AMMO3': '0.105', 'weapon7': '0.134', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'weapon4': '0.476', 'HITCOUNT': '0.650', 'WEAPON3': '0.750', 'weapon2': '1.394', 'weapon3': '1.670', 'DAMAGECOUNT': '2.475', 'FRAGCOUNT': '7.000'} [2023-02-24 18:18:17,754][177154] DAMAGECOUNT value on done: 85391.0 [2023-02-24 18:18:17,754][177154] Sum rewards: 13.985, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.256', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'ARMOR': '0.044', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.123', 'WEAPON4': '0.200', 'weapon5': '0.222', 'WEAPON5': '0.250', 'weapon4': '0.296', 'WEAPON3': '0.750', 'HITCOUNT': '0.850', 'weapon2': '0.902', 'weapon3': '1.954', 'DAMAGECOUNT': '4.182', 'FRAGCOUNT': '13.000'} [2023-02-24 18:18:18,001][177153] Updated weights for policy 0, policy_version 11350 (0.0008) [2023-02-24 18:18:18,052][177172] DAMAGECOUNT value on done: 81771.0 [2023-02-24 18:18:18,053][177172] Sum rewards: 5.758, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.961', 'AMMO2': '0.009', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.047', 'weapon5': '0.072', 'AMMO3': '0.087', 'weapon7': '0.102', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'ARMOR': '0.400', 'HITCOUNT': '0.440', 'weapon4': '0.450', 'WEAPON3': '0.650', 'weapon3': '1.370', 'weapon2': '1.532', 'DAMAGECOUNT': '1.725', 'FRAGCOUNT': '6.000'} [2023-02-24 18:18:18,356][177157] DAMAGECOUNT value on done: 87188.0 [2023-02-24 18:18:18,357][177157] Sum rewards: 5.209, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.248', 'ARMOR': '0.008', 'AMMO2': '0.021', 'AMMO5': '0.033', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'weapon5': '0.180', 'AMMO3': '0.187', 'weapon4': '0.282', 'weapon2': '0.590', 'WEAPON5': '0.650', 'HITCOUNT': '0.890', 'WEAPON3': '1.050', 'weapon3': '2.298', 'DAMAGECOUNT': '3.513', 'FRAGCOUNT': '7.500'} [2023-02-24 18:18:18,368][177157] DAMAGECOUNT value on done: 81344.0 [2023-02-24 18:18:18,368][177157] Sum rewards: 9.445, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.336', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon7': '0.058', 'AMMO3': '0.072', 'AMMO4': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.144', 'WEAPON5': '0.300', 'weapon4': '0.308', 'HITCOUNT': '0.500', 'WEAPON3': '0.550', 'weapon2': '1.296', 'weapon3': '1.782', 'DAMAGECOUNT': '2.511', 'FRAGCOUNT': '7.000'} [2023-02-24 18:18:18,540][177154] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:18:18,659][177157] DAMAGECOUNT value on done: 81112.0 [2023-02-24 18:18:18,660][177157] Sum rewards: 7.686, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.921', 'AMMO2': '0.006', 'AMMO5': '0.012', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'weapon7': '0.046', 'AMMO3': '0.064', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.338', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.720', 'weapon2': '1.028', 'weapon3': '1.476', 'DAMAGECOUNT': '2.850', 'FRAGCOUNT': '8.000'} [2023-02-24 18:18:18,671][177157] DAMAGECOUNT value on done: 80601.0 [2023-02-24 18:18:18,671][177157] Sum rewards: 8.781, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.401', 'AMMO5': '0.017', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.077', 'weapon4': '0.088', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'weapon5': '0.330', 'WEAPON5': '0.400', 'HITCOUNT': '0.410', 'WEAPON3': '0.550', 'weapon2': '1.542', 'weapon3': '1.692', 'DAMAGECOUNT': '2.541', 'FRAGCOUNT': '8.000'} [2023-02-24 18:18:18,682][177171] DAMAGECOUNT value on done: 83946.0 [2023-02-24 18:18:18,682][177171] Sum rewards: 4.401, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.720', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.018', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon7': '0.178', 'AMMO6': '0.360', 'AMMO7': '0.360', 'weapon4': '0.378', 'HITCOUNT': '0.500', 'WEAPON7': '0.600', 'WEAPON3': '0.700', 'weapon2': '1.542', 'weapon3': '1.600', 'DAMAGECOUNT': '2.283', 'FRAGCOUNT': '4.000'} [2023-02-24 18:18:18,976][177171] DAMAGECOUNT value on done: 83497.0 [2023-02-24 18:18:18,976][177171] Sum rewards: 11.625, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.920', 'AMMO5': '0.012', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'weapon7': '0.058', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.127', 'AMMO4': '0.130', 'WEAPON7': '0.200', 'weapon5': '0.214', 'weapon4': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'HITCOUNT': '1.010', 'weapon2': '1.196', 'weapon3': '1.846', 'DAMAGECOUNT': '4.239', 'FRAGCOUNT': '13.000'} [2023-02-24 18:18:19,057][177171] DAMAGECOUNT value on done: 81895.0 [2023-02-24 18:18:19,057][177171] Sum rewards: 13.911, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.197', 'AMMO5': '0.017', 'ARMOR': '0.020', 'weapon7': '0.056', 'AMMO2': '0.062', 'WEAPON1': '0.070', 'AMMO3': '0.122', 'weapon5': '0.170', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'AMMO4': '0.309', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '0.700', 'weapon4': '0.708', 'weapon2': '1.082', 'HITCOUNT': '1.100', 'weapon3': '1.598', 'DAMAGECOUNT': '4.044', 'FRAGCOUNT': '13.000'} [2023-02-24 18:18:19,354][177171] DAMAGECOUNT value on done: 80811.0 [2023-02-24 18:18:19,355][177171] Sum rewards: -0.080, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.110', 'AMMO2': '0.010', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon7': '0.046', 'AMMO4': '0.052', 'weapon5': '0.054', 'AMMO3': '0.061', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.150', 'WEAPON7': '0.200', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'weapon4': '0.506', 'DAMAGECOUNT': '0.609', 'FRAGCOUNT': '1.000', 'weapon3': '1.234'} [2023-02-24 18:18:19,436][177155] DAMAGECOUNT value on done: 84541.0 [2023-02-24 18:18:19,437][177155] Sum rewards: 7.856, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.454', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.024', 'AMMO3': '0.094', 'weapon5': '0.118', 'AMMO4': '0.119', 'weapon7': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'weapon4': '0.458', 'WEAPON3': '0.550', 'HITCOUNT': '0.610', 'weapon3': '1.068', 'weapon2': '1.968', 'DAMAGECOUNT': '2.289', 'FRAGCOUNT': '7.000'} [2023-02-24 18:18:19,731][177155] DAMAGECOUNT value on done: 88589.0 [2023-02-24 18:18:19,731][177155] Sum rewards: 9.605, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.764', 'AMMO2': '0.001', 'ARMOR': '0.004', 'AMMO4': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'weapon7': '0.110', 'weapon5': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'weapon4': '0.544', 'HITCOUNT': '0.650', 'weapon2': '0.686', 'weapon3': '1.330', 'DAMAGECOUNT': '2.586', 'FRAGCOUNT': '7.000'} [2023-02-24 18:18:20,000][177155] DAMAGECOUNT value on done: 85995.0 [2023-02-24 18:18:20,000][177155] Sum rewards: 0.951, reward structure: {'DEATHCOUNT': '-9.000', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'weapon7': '0.056', 'weapon5': '0.070', 'AMMO3': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'HEALTH': '0.304', 'HITCOUNT': '0.460', 'weapon4': '0.538', 'WEAPON3': '0.550', 'weapon2': '0.718', 'weapon3': '1.526', 'DAMAGECOUNT': '1.623', 'FRAGCOUNT': '3.000'} [2023-02-24 18:18:20,296][177155] DAMAGECOUNT value on done: 80146.0 [2023-02-24 18:18:20,296][177155] Sum rewards: 6.188, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.420', 'AMMO2': '0.005', 'AMMO5': '0.016', 'AMMO4': '0.025', 'WEAPON1': '0.040', 'weapon7': '0.062', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.124', 'weapon5': '0.180', 'WEAPON7': '0.200', 'weapon4': '0.226', 'WEAPON5': '0.400', 'weapon2': '0.408', 'HITCOUNT': '0.530', 'WEAPON3': '0.850', 'weapon3': '1.906', 'DAMAGECOUNT': '3.045', 'FRAGCOUNT': '6.000'} [2023-02-24 18:18:20,917][177153] Updated weights for policy 0, policy_version 11360 (0.0009) [2023-02-24 18:18:21,376][177119] Fps is (10 sec: 13926.3, 60 sec: 14062.9, 300 sec: 14009.7). Total num frames: 46534656. Throughput: 0: 3505.8. Samples: 11627942. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:18:21,376][177119] Avg episode reward: [(0, '7.685')] [2023-02-24 18:18:23,827][177153] Updated weights for policy 0, policy_version 11370 (0.0008) [2023-02-24 18:18:25,400][177156] DAMAGECOUNT value on done: 82240.0 [2023-02-24 18:18:25,401][177156] Sum rewards: 1.073, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.604', 'AMMO2': '0.013', 'AMMO5': '0.014', 'weapon4': '0.022', 'WEAPON1': '0.050', 'weapon7': '0.056', 'AMMO4': '0.066', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.162', 'HITCOUNT': '0.170', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.675', 'weapon3': '1.374', 'FRAGCOUNT': '2.000', 'weapon2': '2.196'} [2023-02-24 18:18:25,515][177156] DAMAGECOUNT value on done: 84034.0 [2023-02-24 18:18:25,516][177156] Sum rewards: 5.376, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.355', 'AMMO2': '0.009', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.044', 'weapon7': '0.048', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon5': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.246', 'WEAPON5': '0.350', 'HITCOUNT': '0.490', 'weapon2': '0.620', 'WEAPON3': '0.650', 'weapon3': '1.518', 'DAMAGECOUNT': '1.965', 'FRAGCOUNT': '6.000'} [2023-02-24 18:18:25,697][177156] DAMAGECOUNT value on done: 83650.0 [2023-02-24 18:18:25,698][177156] Sum rewards: 1.788, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.660', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'weapon7': '0.056', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon2': '0.140', 'AMMO3': '0.161', 'weapon5': '0.186', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.320', 'WEAPON5': '0.400', 'ARMOR': '0.475', 'weapon4': '0.560', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.338', 'weapon3': '1.668', 'FRAGCOUNT': '5.000'} [2023-02-24 18:18:25,811][177156] DAMAGECOUNT value on done: 82810.0 [2023-02-24 18:18:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.6, 300 sec: 13995.8). Total num frames: 46604288. Throughput: 0: 3507.5. Samples: 11648930. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:18:26,376][177119] Avg episode reward: [(0, '7.503')] [2023-02-24 18:18:26,716][177153] Updated weights for policy 0, policy_version 11380 (0.0008) [2023-02-24 18:18:29,628][177153] Updated weights for policy 0, policy_version 11390 (0.0008) [2023-02-24 18:18:30,515][177155] Large shaping reward 2.590 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.558, 186.0), ('weapon7', 0.002)] [2023-02-24 18:18:31,376][177119] Fps is (10 sec: 14335.1, 60 sec: 14062.8, 300 sec: 14009.7). Total num frames: 46678016. Throughput: 0: 3508.5. Samples: 11670090. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:18:31,377][177119] Avg episode reward: [(0, '7.503')] [2023-02-24 18:18:32,305][177170] DAMAGECOUNT value on done: 84295.0 [2023-02-24 18:18:32,306][177170] Sum rewards: 7.494, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.052', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO3': '0.030', 'ARMOR': '0.032', 'AMMO4': '0.045', 'weapon5': '0.082', 'WEAPON5': '0.100', 'weapon7': '0.106', 'WEAPON3': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.360', 'AMMO6': '0.440', 'AMMO7': '0.440', 'WEAPON7': '0.600', 'weapon3': '0.808', 'weapon4': '0.810', 'DAMAGECOUNT': '1.383', 'weapon2': '1.728', 'FRAGCOUNT': '4.000'} [2023-02-24 18:18:32,528][177153] Updated weights for policy 0, policy_version 11400 (0.0008) [2023-02-24 18:18:32,604][177170] DAMAGECOUNT value on done: 77232.0 [2023-02-24 18:18:32,605][177170] Sum rewards: 15.525, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.010', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'weapon4': '0.078', 'AMMO3': '0.079', 'HEALTH': '0.115', 'WEAPON5': '0.200', 'weapon5': '0.228', 'WEAPON3': '0.500', 'HITCOUNT': '0.690', 'weapon3': '1.514', 'weapon2': '1.940', 'DAMAGECOUNT': '4.770', 'FRAGCOUNT': '12.000'} [2023-02-24 18:18:32,613][177170] DAMAGECOUNT value on done: 88368.0 [2023-02-24 18:18:32,614][177170] Sum rewards: 7.396, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.849', 'AMMO2': '0.015', 'AMMO5': '0.020', 'ARMOR': '0.028', 'WEAPON1': '0.070', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.129', 'weapon5': '0.178', 'weapon4': '0.228', 'WEAPON5': '0.450', 'HITCOUNT': '0.600', 'WEAPON3': '0.800', 'weapon2': '1.412', 'weapon3': '1.898', 'DAMAGECOUNT': '2.745', 'FRAGCOUNT': '7.000'} [2023-02-24 18:18:32,916][177170] DAMAGECOUNT value on done: 87538.0 [2023-02-24 18:18:32,916][177170] Sum rewards: 3.352, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.481', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.050', 'weapon7': '0.058', 'AMMO4': '0.084', 'AMMO3': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.114', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'weapon4': '0.574', 'DAMAGECOUNT': '0.885', 'weapon2': '0.908', 'weapon3': '0.986', 'FRAGCOUNT': '3.000'} [2023-02-24 18:18:33,551][177158] DAMAGECOUNT value on done: 81732.0 [2023-02-24 18:18:33,551][177158] Sum rewards: 10.884, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.400', 'AMMO2': '0.004', 'AMMO4': '0.021', 'AMMO3': '0.043', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.270', 'WEAPON3': '0.350', 'ARMOR': '0.500', 'HITCOUNT': '0.510', 'weapon3': '1.080', 'DAMAGECOUNT': '1.629', 'weapon2': '1.678', 'FRAGCOUNT': '7.000'} [2023-02-24 18:18:33,847][177158] DAMAGECOUNT value on done: 80236.0 [2023-02-24 18:18:33,847][177158] Sum rewards: 10.475, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.575', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'ARMOR': '0.004', 'AMMO3': '0.050', 'weapon7': '0.194', 'WEAPON4': '0.200', 'WEAPON3': '0.450', 'AMMO6': '0.480', 'AMMO7': '0.480', 'weapon4': '0.502', 'HITCOUNT': '0.590', 'WEAPON7': '0.800', 'weapon3': '1.158', 'weapon2': '1.636', 'DAMAGECOUNT': '3.012', 'FRAGCOUNT': '7.000'} [2023-02-24 18:18:34,566][177158] DAMAGECOUNT value on done: 82181.0 [2023-02-24 18:18:34,566][177158] Sum rewards: 8.309, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.498', 'weapon5': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'weapon7': '0.048', 'AMMO4': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.232', 'WEAPON3': '0.700', 'HITCOUNT': '0.780', 'weapon2': '1.650', 'weapon3': '1.848', 'DAMAGECOUNT': '2.937', 'FRAGCOUNT': '8.000'} [2023-02-24 18:18:34,854][177158] DAMAGECOUNT value on done: 86104.0 [2023-02-24 18:18:34,855][177158] Sum rewards: 8.773, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.754', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.025', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.128', 'weapon5': '0.300', 'weapon4': '0.340', 'WEAPON5': '0.400', 'weapon2': '0.526', 'WEAPON3': '0.800', 'HITCOUNT': '0.920', 'weapon3': '1.908', 'DAMAGECOUNT': '3.123', 'FRAGCOUNT': '9.000'} [2023-02-24 18:18:35,441][177172] DAMAGECOUNT value on done: 82973.0 [2023-02-24 18:18:35,442][177172] Sum rewards: 10.763, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.630', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.037', 'weapon7': '0.048', 'WEAPON1': '0.060', 'AMMO3': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.256', 'weapon4': '0.360', 'WEAPON5': '0.400', 'HITCOUNT': '0.580', 'WEAPON3': '0.750', 'weapon2': '1.304', 'weapon3': '1.674', 'DAMAGECOUNT': '2.916', 'FRAGCOUNT': '10.000'} [2023-02-24 18:18:35,460][177153] Updated weights for policy 0, policy_version 11410 (0.0009) [2023-02-24 18:18:35,731][177172] DAMAGECOUNT value on done: 82923.0 [2023-02-24 18:18:35,731][177172] Sum rewards: 11.853, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.460', 'AMMO5': '0.012', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'weapon7': '0.046', 'AMMO3': '0.081', 'AMMO4': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.192', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'weapon2': '0.576', 'weapon4': '0.684', 'HITCOUNT': '0.790', 'weapon3': '1.482', 'DAMAGECOUNT': '3.261', 'FRAGCOUNT': '8.000'} [2023-02-24 18:18:36,249][177154] DAMAGECOUNT value on done: 89198.0 [2023-02-24 18:18:36,250][177154] Sum rewards: 19.221, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.108', 'AMMO5': '0.010', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'weapon7': '0.102', 'AMMO4': '0.146', 'weapon5': '0.196', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.519', 'HITCOUNT': '0.700', 'weapon4': '0.770', 'weapon2': '1.196', 'weapon3': '1.274', 'DAMAGECOUNT': '5.106', 'FRAGCOUNT': '13.000'} [2023-02-24 18:18:36,376][177119] Fps is (10 sec: 14336.1, 60 sec: 14062.9, 300 sec: 14009.7). Total num frames: 46747648. Throughput: 0: 3508.3. Samples: 11680538. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:18:36,376][177119] Avg episode reward: [(0, '7.878')] [2023-02-24 18:18:36,544][177154] DAMAGECOUNT value on done: 85506.0 [2023-02-24 18:18:36,545][177154] Sum rewards: 9.273, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.102', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.010', 'weapon7': '0.048', 'WEAPON1': '0.060', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.132', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.368', 'WEAPON3': '0.550', 'HITCOUNT': '0.620', 'weapon2': '1.450', 'weapon3': '1.502', 'DAMAGECOUNT': '3.210', 'FRAGCOUNT': '6.000'} [2023-02-24 18:18:36,554][177154] DAMAGECOUNT value on done: 85006.0 [2023-02-24 18:18:36,554][177154] Sum rewards: 12.497, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.759', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'AMMO4': '0.059', 'weapon5': '0.086', 'WEAPON5': '0.100', 'weapon7': '0.108', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.300', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'weapon4': '0.658', 'weapon2': '0.716', 'HITCOUNT': '0.780', 'weapon3': '0.890', 'DAMAGECOUNT': '3.744', 'FRAGCOUNT': '9.000'} [2023-02-24 18:18:36,868][177154] DAMAGECOUNT value on done: 86548.0 [2023-02-24 18:18:36,869][177154] Sum rewards: 7.321, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.598', 'AMMO5': '0.012', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.141', 'weapon5': '0.218', 'weapon4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '0.900', 'HITCOUNT': '0.920', 'weapon2': '1.062', 'weapon3': '2.092', 'DAMAGECOUNT': '3.471', 'FRAGCOUNT': '8.000'} [2023-02-24 18:18:36,943][177172] DAMAGECOUNT value on done: 83891.0 [2023-02-24 18:18:36,943][177172] Sum rewards: 3.798, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.080', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO5': '0.030', 'AMMO4': '0.039', 'WEAPON1': '0.060', 'weapon7': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.136', 'weapon5': '0.154', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'HITCOUNT': '0.730', 'weapon4': '0.766', 'WEAPON3': '0.850', 'weapon2': '0.972', 'weapon3': '1.624', 'DAMAGECOUNT': '2.655', 'FRAGCOUNT': '7.000'} [2023-02-24 18:18:37,244][177172] DAMAGECOUNT value on done: 82974.0 [2023-02-24 18:18:37,244][177172] Sum rewards: 13.785, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.208', 'AMMO2': '0.013', 'AMMO5': '0.014', 'WEAPON1': '0.050', 'AMMO4': '0.063', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.318', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '0.790', 'weapon2': '1.490', 'weapon3': '1.788', 'DAMAGECOUNT': '3.609', 'FRAGCOUNT': '11.500'} [2023-02-24 18:18:37,490][177157] DAMAGECOUNT value on done: 87700.0 [2023-02-24 18:18:37,490][177157] Sum rewards: 5.183, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.047', 'AMMO2': '0.006', 'AMMO5': '0.013', 'AMMO4': '0.031', 'WEAPON1': '0.040', 'weapon7': '0.054', 'AMMO3': '0.073', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.218', 'WEAPON5': '0.250', 'HITCOUNT': '0.290', 'weapon4': '0.484', 'ARMOR': '0.527', 'WEAPON3': '0.550', 'weapon2': '1.134', 'weapon3': '1.384', 'DAMAGECOUNT': '1.536', 'FRAGCOUNT': '5.000'} [2023-02-24 18:18:37,500][177157] DAMAGECOUNT value on done: 81769.0 [2023-02-24 18:18:37,501][177157] Sum rewards: 5.706, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.861', 'AMMO2': '0.005', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO3': '0.023', 'AMMO4': '0.025', 'WEAPON1': '0.030', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon7': '0.152', 'HITCOUNT': '0.170', 'WEAPON3': '0.200', 'AMMO6': '0.360', 'AMMO7': '0.360', 'weapon4': '0.392', 'weapon3': '0.436', 'WEAPON7': '0.600', 'DAMAGECOUNT': '1.275', 'weapon2': '2.170', 'FRAGCOUNT': '3.000'} [2023-02-24 18:18:37,786][177157] DAMAGECOUNT value on done: 81662.0 [2023-02-24 18:18:37,787][177157] Sum rewards: 5.698, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.442', 'AMMO5': '0.007', 'AMMO2': '0.009', 'ARMOR': '0.040', 'WEAPON1': '0.040', 'AMMO4': '0.043', 'AMMO3': '0.050', 'WEAPON4': '0.150', 'weapon5': '0.162', 'WEAPON5': '0.200', 'weapon4': '0.358', 'WEAPON3': '0.400', 'HITCOUNT': '0.420', 'weapon3': '1.314', 'DAMAGECOUNT': '1.650', 'weapon2': '1.796', 'FRAGCOUNT': '4.000'} [2023-02-24 18:18:37,796][177157] DAMAGECOUNT value on done: 81662.0 [2023-02-24 18:18:37,797][177157] Sum rewards: 12.373, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.057', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.026', 'WEAPON1': '0.050', 'AMMO3': '0.085', 'AMMO4': '0.130', 'WEAPON4': '0.350', 'weapon5': '0.362', 'WEAPON3': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.660', 'HITCOUNT': '0.740', 'weapon2': '1.278', 'weapon3': '1.294', 'DAMAGECOUNT': '3.183', 'FRAGCOUNT': '11.000'} [2023-02-24 18:18:37,878][177171] DAMAGECOUNT value on done: 84960.0 [2023-02-24 18:18:37,878][177171] Sum rewards: 6.571, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.958', 'AMMO5': '0.015', 'AMMO2': '0.038', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'AMMO3': '0.080', 'AMMO4': '0.192', 'weapon5': '0.206', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '0.500', 'weapon2': '0.584', 'HITCOUNT': '0.720', 'weapon4': '0.862', 'weapon3': '1.550', 'DAMAGECOUNT': '3.042', 'FRAGCOUNT': '7.000'} [2023-02-24 18:18:38,173][177171] DAMAGECOUNT value on done: 84538.0 [2023-02-24 18:18:38,173][177171] Sum rewards: 13.486, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.990', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.013', 'AMMO3': '0.046', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.224', 'weapon5': '0.290', 'WEAPON3': '0.350', 'WEAPON5': '0.450', 'HITCOUNT': '0.570', 'weapon3': '0.872', 'weapon2': '2.156', 'DAMAGECOUNT': '3.123', 'FRAGCOUNT': '10.000'} [2023-02-24 18:18:38,253][177171] DAMAGECOUNT value on done: 82335.0 [2023-02-24 18:18:38,253][177171] Sum rewards: 4.180, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.377', 'AMMO2': '0.004', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.019', 'WEAPON1': '0.050', 'AMMO3': '0.060', 'weapon5': '0.156', 'WEAPON5': '0.250', 'HITCOUNT': '0.250', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.320', 'weapon3': '1.366', 'FRAGCOUNT': '2.000', 'weapon2': '2.370'} [2023-02-24 18:18:38,395][177153] Updated weights for policy 0, policy_version 11420 (0.0008) [2023-02-24 18:18:38,546][177171] DAMAGECOUNT value on done: 82205.0 [2023-02-24 18:18:38,547][177171] Sum rewards: 16.545, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.059', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.015', 'WEAPON1': '0.050', 'weapon7': '0.052', 'AMMO3': '0.055', 'AMMO4': '0.073', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.156', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'weapon4': '0.602', 'weapon2': '0.842', 'HITCOUNT': '0.890', 'weapon3': '1.034', 'DAMAGECOUNT': '4.182', 'FRAGCOUNT': '15.000'} [2023-02-24 18:18:38,569][177155] DAMAGECOUNT value on done: 84931.0 [2023-02-24 18:18:38,569][177155] Sum rewards: 1.805, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.008', 'AMMO5': '0.015', 'AMMO2': '0.026', 'weapon4': '0.058', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'AMMO4': '0.130', 'weapon5': '0.202', 'HITCOUNT': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.170', 'weapon2': '1.694', 'weapon3': '1.742', 'FRAGCOUNT': '2.000'} [2023-02-24 18:18:38,867][177155] DAMAGECOUNT value on done: 89374.0 [2023-02-24 18:18:38,868][177155] Sum rewards: 8.936, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.544', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'AMMO3': '0.067', 'weapon7': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.112', 'WEAPON5': '0.200', 'weapon4': '0.242', 'WEAPON3': '0.500', 'HITCOUNT': '0.580', 'weapon2': '1.316', 'weapon3': '1.342', 'DAMAGECOUNT': '2.355', 'FRAGCOUNT': '6.000'} [2023-02-24 18:18:39,140][177155] DAMAGECOUNT value on done: 86722.0 [2023-02-24 18:18:39,141][177155] Sum rewards: 6.286, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.510', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.071', 'weapon7': '0.100', 'AMMO4': '0.126', 'weapon5': '0.202', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'HITCOUNT': '0.490', 'WEAPON3': '0.550', 'weapon4': '0.668', 'weapon2': '0.994', 'weapon3': '1.068', 'DAMAGECOUNT': '2.181', 'FRAGCOUNT': '6.000'} [2023-02-24 18:18:39,431][177155] DAMAGECOUNT value on done: 81330.0 [2023-02-24 18:18:39,431][177155] Sum rewards: 11.986, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.560', 'AMMO5': '0.011', 'AMMO2': '0.013', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.061', 'AMMO4': '0.065', 'weapon7': '0.174', 'weapon5': '0.212', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.474', 'WEAPON3': '0.500', 'HITCOUNT': '0.690', 'weapon3': '1.394', 'weapon2': '1.520', 'DAMAGECOUNT': '3.552', 'FRAGCOUNT': '8.000'} [2023-02-24 18:18:41,332][177153] Updated weights for policy 0, policy_version 11430 (0.0009) [2023-02-24 18:18:41,376][177119] Fps is (10 sec: 13927.2, 60 sec: 14062.9, 300 sec: 14009.7). Total num frames: 46817280. Throughput: 0: 3507.2. Samples: 11701624. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:18:41,376][177119] Avg episode reward: [(0, '8.004')] [2023-02-24 18:18:44,251][177153] Updated weights for policy 0, policy_version 11440 (0.0008) [2023-02-24 18:18:44,566][177156] DAMAGECOUNT value on done: 82910.0 [2023-02-24 18:18:44,566][177156] Sum rewards: 3.739, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.964', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.026', 'WEAPON1': '0.030', 'weapon7': '0.046', 'weapon5': '0.098', 'AMMO3': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.440', 'weapon2': '0.466', 'WEAPON3': '0.750', 'weapon4': '0.784', 'ARMOR': '0.953', 'weapon3': '1.488', 'DAMAGECOUNT': '2.010', 'FRAGCOUNT': '5.000'} [2023-02-24 18:18:44,684][177156] DAMAGECOUNT value on done: 85001.0 [2023-02-24 18:18:44,684][177156] Sum rewards: 8.954, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.312', 'AMMO5': '0.012', 'AMMO2': '0.018', 'ARMOR': '0.019', 'WEAPON1': '0.030', 'AMMO3': '0.082', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.220', 'weapon4': '0.266', 'WEAPON3': '0.650', 'HITCOUNT': '0.700', 'weapon2': '0.848', 'weapon3': '1.830', 'DAMAGECOUNT': '2.901', 'FRAGCOUNT': '9.000'} [2023-02-24 18:18:44,870][177156] DAMAGECOUNT value on done: 84445.0 [2023-02-24 18:18:44,870][177156] Sum rewards: 4.615, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.276', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.038', 'weapon7': '0.052', 'WEAPON1': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.135', 'weapon5': '0.142', 'AMMO4': '0.191', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'HITCOUNT': '0.560', 'weapon2': '0.652', 'WEAPON3': '0.750', 'weapon4': '0.894', 'weapon3': '1.456', 'DAMAGECOUNT': '2.385', 'FRAGCOUNT': '7.000'} [2023-02-24 18:18:44,989][177156] DAMAGECOUNT value on done: 83445.0 [2023-02-24 18:18:44,990][177156] Sum rewards: 4.355, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.255', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.036', 'weapon7': '0.048', 'weapon5': '0.054', 'AMMO3': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.526', 'HITCOUNT': '0.530', 'WEAPON3': '0.600', 'weapon3': '1.450', 'weapon2': '1.454', 'DAMAGECOUNT': '1.905', 'FRAGCOUNT': '4.000'} [2023-02-24 18:18:45,622][177155] Large shaping reward 3.652 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:18:46,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 14009.7). Total num frames: 46886912. Throughput: 0: 3506.5. Samples: 11722682. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:18:46,376][177119] Avg episode reward: [(0, '7.898')] [2023-02-24 18:18:47,163][177153] Updated weights for policy 0, policy_version 11450 (0.0009) [2023-02-24 18:18:50,057][177153] Updated weights for policy 0, policy_version 11460 (0.0008) [2023-02-24 18:18:51,371][177170] DAMAGECOUNT value on done: 85410.0 [2023-02-24 18:18:51,372][177170] Sum rewards: 11.855, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.458', 'AMMO2': '0.012', 'AMMO5': '0.012', 'weapon4': '0.020', 'WEAPON1': '0.060', 'AMMO4': '0.062', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'weapon5': '0.248', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.700', 'weapon3': '1.504', 'weapon2': '1.976', 'DAMAGECOUNT': '3.345', 'FRAGCOUNT': '9.000'} [2023-02-24 18:18:51,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 46956544. Throughput: 0: 3508.0. Samples: 11733308. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:18:51,376][177119] Avg episode reward: [(0, '7.898')] [2023-02-24 18:18:51,671][177170] DAMAGECOUNT value on done: 78399.0 [2023-02-24 18:18:51,671][177170] Sum rewards: 11.660, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.305', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'weapon7': '0.048', 'AMMO3': '0.072', 'AMMO4': '0.075', 'weapon5': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.318', 'WEAPON3': '0.600', 'HITCOUNT': '0.840', 'weapon3': '1.178', 'weapon2': '1.802', 'DAMAGECOUNT': '3.501', 'FRAGCOUNT': '12.000'} [2023-02-24 18:18:51,680][177170] DAMAGECOUNT value on done: 89217.0 [2023-02-24 18:18:51,681][177170] Sum rewards: 7.359, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.180', 'AMMO5': '0.016', 'ARMOR': '0.024', 'AMMO2': '0.032', 'WEAPON4': '0.050', 'weapon4': '0.056', 'AMMO3': '0.080', 'WEAPON1': '0.090', 'AMMO4': '0.158', 'weapon5': '0.296', 'HITCOUNT': '0.460', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon3': '1.414', 'weapon2': '1.966', 'DAMAGECOUNT': '2.547', 'FRAGCOUNT': '7.000'} [2023-02-24 18:18:51,977][177170] DAMAGECOUNT value on done: 88406.0 [2023-02-24 18:18:51,977][177170] Sum rewards: 10.728, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.035', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.077', 'HEALTH': '0.117', 'weapon5': '0.188', 'WEAPON5': '0.200', 'weapon4': '0.248', 'WEAPON3': '0.500', 'HITCOUNT': '0.660', 'weapon3': '1.324', 'weapon2': '1.920', 'DAMAGECOUNT': '2.604', 'FRAGCOUNT': '8.000'} [2023-02-24 18:18:52,611][177158] DAMAGECOUNT value on done: 82997.0 [2023-02-24 18:18:52,611][177158] Sum rewards: 10.292, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.824', 'AMMO5': '0.015', 'ARMOR': '0.032', 'AMMO2': '0.038', 'WEAPON1': '0.060', 'AMMO3': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.168', 'AMMO4': '0.188', 'weapon5': '0.272', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'weapon2': '0.928', 'HITCOUNT': '0.960', 'weapon3': '2.180', 'DAMAGECOUNT': '3.795', 'FRAGCOUNT': '8.500'} [2023-02-24 18:18:52,905][177158] DAMAGECOUNT value on done: 80411.0 [2023-02-24 18:18:52,906][177158] Sum rewards: 1.214, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.186', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.020', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO3': '0.055', 'AMMO4': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.130', 'HITCOUNT': '0.170', 'WEAPON5': '0.250', 'weapon4': '0.310', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.525', 'weapon3': '0.690', 'FRAGCOUNT': '1.000', 'weapon2': '1.026'} [2023-02-24 18:18:52,994][177153] Updated weights for policy 0, policy_version 11470 (0.0008) [2023-02-24 18:18:53,693][177158] DAMAGECOUNT value on done: 83111.0 [2023-02-24 18:18:53,694][177158] Sum rewards: 7.920, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.291', 'AMMO5': '0.017', 'AMMO2': '0.031', 'WEAPON1': '0.060', 'AMMO3': '0.125', 'AMMO4': '0.152', 'weapon5': '0.182', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.418', 'HITCOUNT': '0.660', 'WEAPON3': '0.750', 'weapon4': '0.820', 'ARMOR': '0.871', 'weapon3': '1.584', 'DAMAGECOUNT': '2.790', 'FRAGCOUNT': '9.000'} [2023-02-24 18:18:53,993][177158] DAMAGECOUNT value on done: 87092.0 [2023-02-24 18:18:53,994][177158] Sum rewards: 6.583, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.618', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.030', 'WEAPON1': '0.070', 'weapon5': '0.138', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'HITCOUNT': '0.690', 'WEAPON3': '0.850', 'weapon2': '1.074', 'weapon3': '2.510', 'DAMAGECOUNT': '2.964', 'FRAGCOUNT': '7.500'} [2023-02-24 18:18:54,628][177172] DAMAGECOUNT value on done: 83918.0 [2023-02-24 18:18:54,628][177172] Sum rewards: 8.606, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.330', 'AMMO5': '0.017', 'AMMO2': '0.031', 'WEAPON1': '0.050', 'AMMO3': '0.063', 'AMMO4': '0.152', 'weapon4': '0.216', 'weapon5': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.465', 'HITCOUNT': '0.570', 'weapon3': '1.490', 'weapon2': '1.656', 'DAMAGECOUNT': '2.835', 'FRAGCOUNT': '7.000'} [2023-02-24 18:18:54,928][177172] DAMAGECOUNT value on done: 83826.0 [2023-02-24 18:18:54,928][177172] Sum rewards: 11.105, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.003', 'AMMO5': '0.009', 'AMMO2': '0.019', 'ARMOR': '0.024', 'WEAPON1': '0.050', 'AMMO3': '0.061', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'weapon5': '0.142', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'weapon4': '0.472', 'HITCOUNT': '0.870', 'weapon2': '1.548', 'weapon3': '1.558', 'DAMAGECOUNT': '2.709', 'FRAGCOUNT': '8.000'} [2023-02-24 18:18:55,344][177154] DAMAGECOUNT value on done: 89615.0 [2023-02-24 18:18:55,345][177154] Sum rewards: 3.307, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.192', 'AMMO5': '0.003', 'ARMOR': '0.024', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'weapon7': '0.054', 'AMMO3': '0.057', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.112', 'AMMO4': '0.120', 'weapon4': '0.336', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'weapon2': '0.752', 'weapon3': '0.956', 'DAMAGECOUNT': '1.251', 'FRAGCOUNT': '3.000'} [2023-02-24 18:18:55,650][177154] DAMAGECOUNT value on done: 85680.0 [2023-02-24 18:18:55,651][177154] Sum rewards: 3.435, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.610', 'ARMOR': '0.008', 'AMMO2': '0.012', 'AMMO5': '0.025', 'weapon4': '0.056', 'WEAPON1': '0.060', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'weapon7': '0.106', 'AMMO3': '0.113', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.252', 'WEAPON7': '0.300', 'HITCOUNT': '0.320', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'weapon3': '1.116', 'DAMAGECOUNT': '2.022', 'weapon2': '2.204', 'FRAGCOUNT': '5.000'} [2023-02-24 18:18:55,672][177154] DAMAGECOUNT value on done: 87091.0 [2023-02-24 18:18:55,673][177154] Sum rewards: 16.880, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.012', 'HEALTH': '0.016', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'weapon4': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'AMMO4': '0.124', 'weapon5': '0.204', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.770', 'weapon3': '1.734', 'weapon2': '1.798', 'DAMAGECOUNT': '4.755', 'FRAGCOUNT': '13.000'} [2023-02-24 18:18:55,919][177153] Updated weights for policy 0, policy_version 11480 (0.0009) [2023-02-24 18:18:55,971][177154] DAMAGECOUNT value on done: 87953.0 [2023-02-24 18:18:55,971][177154] Sum rewards: 13.481, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.485', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'weapon7': '0.050', 'AMMO4': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'weapon5': '0.172', 'WEAPON5': '0.250', 'weapon4': '0.330', 'ARMOR': '0.451', 'WEAPON3': '0.750', 'HITCOUNT': '0.940', 'weapon2': '0.996', 'weapon3': '1.832', 'DAMAGECOUNT': '4.215', 'FRAGCOUNT': '10.000'} [2023-02-24 18:18:56,106][177172] DAMAGECOUNT value on done: 84973.0 [2023-02-24 18:18:56,106][177172] Sum rewards: 14.124, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.236', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'weapon7': '0.050', 'AMMO3': '0.074', 'AMMO4': '0.091', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.138', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.400', 'ARMOR': '0.449', 'WEAPON3': '0.550', 'HITCOUNT': '0.730', 'weapon3': '1.242', 'weapon2': '1.842', 'DAMAGECOUNT': '3.246', 'FRAGCOUNT': '10.000'} [2023-02-24 18:18:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 47026176. Throughput: 0: 3506.2. Samples: 11754230. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:18:56,377][177119] Avg episode reward: [(0, '8.104')] [2023-02-24 18:18:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000011481_47026176.pth... [2023-02-24 18:18:56,405][177172] DAMAGECOUNT value on done: 83611.0 [2023-02-24 18:18:56,406][177172] Sum rewards: 5.005, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.964', 'AMMO5': '0.020', 'AMMO2': '0.034', 'weapon7': '0.052', 'WEAPON1': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.111', 'AMMO4': '0.169', 'WEAPON4': '0.350', 'weapon5': '0.364', 'HITCOUNT': '0.420', 'weapon4': '0.488', 'weapon2': '0.498', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'weapon3': '1.432', 'DAMAGECOUNT': '1.911', 'FRAGCOUNT': '6.000'} [2023-02-24 18:18:56,437][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000010660_43663360.pth [2023-02-24 18:18:56,662][177157] DAMAGECOUNT value on done: 88537.0 [2023-02-24 18:18:56,662][177157] Sum rewards: 8.107, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.650', 'weapon7': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.040', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.115', 'AMMO4': '0.115', 'weapon5': '0.240', 'WEAPON5': '0.300', 'HITCOUNT': '0.590', 'WEAPON3': '0.750', 'weapon2': '1.538', 'weapon3': '1.846', 'DAMAGECOUNT': '2.511', 'FRAGCOUNT': '7.000'} [2023-02-24 18:18:56,673][177157] DAMAGECOUNT value on done: 82940.0 [2023-02-24 18:18:56,673][177157] Sum rewards: 11.008, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.449', 'AMMO5': '0.009', 'AMMO2': '0.040', 'WEAPON1': '0.050', 'ARMOR': '0.052', 'weapon7': '0.052', 'AMMO3': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.104', 'AMMO4': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.600', 'weapon4': '0.744', 'HITCOUNT': '0.820', 'weapon2': '1.102', 'weapon3': '1.476', 'DAMAGECOUNT': '3.513', 'FRAGCOUNT': '10.000'} [2023-02-24 18:18:56,964][177157] DAMAGECOUNT value on done: 83319.0 [2023-02-24 18:18:56,964][177157] Sum rewards: 18.916, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'weapon7': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.105', 'AMMO4': '0.130', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HEALTH': '0.210', 'weapon4': '0.580', 'WEAPON3': '0.600', 'weapon2': '1.086', 'HITCOUNT': '1.090', 'weapon3': '1.766', 'DAMAGECOUNT': '4.971', 'FRAGCOUNT': '15.000'} [2023-02-24 18:18:56,975][177157] DAMAGECOUNT value on done: 82215.0 [2023-02-24 18:18:56,975][177157] Sum rewards: 3.409, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.272', 'AMMO5': '0.007', 'AMMO2': '0.015', 'ARMOR': '0.044', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO3': '0.065', 'AMMO4': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.166', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.288', 'WEAPON3': '0.500', 'HITCOUNT': '0.530', 'weapon2': '1.196', 'weapon3': '1.398', 'DAMAGECOUNT': '1.659', 'FRAGCOUNT': '3.000'} [2023-02-24 18:18:57,053][177171] DAMAGECOUNT value on done: 85685.0 [2023-02-24 18:18:57,053][177171] Sum rewards: 6.907, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.630', 'AMMO2': '0.006', 'AMMO5': '0.013', 'AMMO4': '0.028', 'WEAPON1': '0.050', 'AMMO3': '0.073', 'weapon5': '0.162', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '0.570', 'weapon3': '1.638', 'weapon2': '1.972', 'DAMAGECOUNT': '2.175', 'FRAGCOUNT': '6.000'} [2023-02-24 18:18:57,348][177171] DAMAGECOUNT value on done: 85766.0 [2023-02-24 18:18:57,348][177171] Sum rewards: 7.944, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.376', 'AMMO5': '0.017', 'ARMOR': '0.020', 'AMMO2': '0.049', 'WEAPON1': '0.050', 'AMMO3': '0.120', 'weapon5': '0.138', 'WEAPON5': '0.200', 'AMMO4': '0.245', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'weapon4': '0.860', 'weapon2': '0.950', 'HITCOUNT': '1.220', 'weapon3': '1.766', 'DAMAGECOUNT': '3.684', 'FRAGCOUNT': '10.000'} [2023-02-24 18:18:57,438][177171] DAMAGECOUNT value on done: 83477.0 [2023-02-24 18:18:57,438][177171] Sum rewards: 12.013, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.256', 'AMMO2': '0.013', 'AMMO5': '0.015', 'WEAPON1': '0.060', 'AMMO4': '0.062', 'AMMO3': '0.070', 'WEAPON5': '0.400', 'weapon5': '0.402', 'HITCOUNT': '0.520', 'WEAPON3': '0.550', 'weapon2': '1.468', 'weapon3': '1.798', 'DAMAGECOUNT': '3.411', 'FRAGCOUNT': '8.000'} [2023-02-24 18:18:57,739][177171] DAMAGECOUNT value on done: 83209.0 [2023-02-24 18:18:57,739][177171] Sum rewards: 8.880, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.555', 'AMMO2': '0.011', 'AMMO5': '0.017', 'weapon7': '0.048', 'AMMO4': '0.055', 'WEAPON1': '0.070', 'AMMO3': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.282', 'WEAPON5': '0.450', 'HITCOUNT': '0.500', 'WEAPON3': '0.650', 'weapon3': '1.330', 'weapon2': '1.978', 'DAMAGECOUNT': '3.012', 'FRAGCOUNT': '6.000'} [2023-02-24 18:18:57,755][177155] DAMAGECOUNT value on done: 85778.0 [2023-02-24 18:18:57,755][177155] Sum rewards: 8.863, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.428', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO4': '0.030', 'AMMO3': '0.050', 'weapon7': '0.098', 'WEAPON5': '0.150', 'weapon5': '0.162', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.300', 'WEAPON7': '0.400', 'HITCOUNT': '0.460', 'weapon2': '0.526', 'weapon4': '0.544', 'weapon3': '1.286', 'DAMAGECOUNT': '2.061', 'FRAGCOUNT': '7.000'} [2023-02-24 18:18:58,046][177155] DAMAGECOUNT value on done: 90384.0 [2023-02-24 18:18:58,046][177155] Sum rewards: 14.566, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.384', 'weapon7': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.114', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.206', 'WEAPON3': '0.750', 'HITCOUNT': '0.780', 'weapon2': '0.936', 'weapon3': '2.352', 'DAMAGECOUNT': '3.030', 'FRAGCOUNT': '14.000'} [2023-02-24 18:18:58,318][177155] DAMAGECOUNT value on done: 87378.0 [2023-02-24 18:18:58,318][177155] Sum rewards: 3.931, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.491', 'AMMO2': '0.007', 'AMMO5': '0.011', 'AMMO4': '0.033', 'WEAPON1': '0.060', 'AMMO3': '0.086', 'weapon5': '0.224', 'WEAPON5': '0.300', 'HITCOUNT': '0.550', 'WEAPON3': '0.600', 'weapon3': '1.742', 'weapon2': '1.840', 'DAMAGECOUNT': '1.968', 'FRAGCOUNT': '3.000'} [2023-02-24 18:18:58,616][177155] DAMAGECOUNT value on done: 82248.0 [2023-02-24 18:18:58,616][177155] Sum rewards: 11.313, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.309', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON1': '0.050', 'AMMO3': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.126', 'WEAPON5': '0.250', 'weapon5': '0.356', 'WEAPON3': '0.450', 'HITCOUNT': '0.750', 'weapon3': '1.464', 'weapon2': '1.750', 'DAMAGECOUNT': '2.754', 'FRAGCOUNT': '7.000'} [2023-02-24 18:18:58,852][177153] Updated weights for policy 0, policy_version 11490 (0.0008) [2023-02-24 18:19:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 47095808. Throughput: 0: 3510.8. Samples: 11775358. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:19:01,376][177119] Avg episode reward: [(0, '8.413')] [2023-02-24 18:19:01,377][177140] Saving new best policy, reward=8.413! [2023-02-24 18:19:01,751][177153] Updated weights for policy 0, policy_version 11500 (0.0008) [2023-02-24 18:19:03,770][177156] DAMAGECOUNT value on done: 83755.0 [2023-02-24 18:19:03,770][177156] Sum rewards: 9.627, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.022', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.052', 'AMMO3': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.108', 'weapon4': '0.144', 'weapon5': '0.224', 'WEAPON5': '0.250', 'HEALTH': '0.342', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.550', 'weapon3': '1.528', 'weapon2': '1.740', 'DAMAGECOUNT': '2.535', 'FRAGCOUNT': '6.000'} [2023-02-24 18:19:03,919][177156] DAMAGECOUNT value on done: 85592.0 [2023-02-24 18:19:03,920][177156] Sum rewards: 7.704, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.960', 'AMMO2': '0.012', 'AMMO5': '0.013', 'AMMO3': '0.048', 'WEAPON1': '0.060', 'AMMO4': '0.062', 'weapon7': '0.098', 'weapon5': '0.206', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'WEAPON5': '0.400', 'HITCOUNT': '0.500', 'weapon4': '0.728', 'weapon3': '0.840', 'weapon2': '1.284', 'DAMAGECOUNT': '1.773', 'FRAGCOUNT': '5.000'} [2023-02-24 18:19:04,072][177156] DAMAGECOUNT value on done: 85148.0 [2023-02-24 18:19:04,073][177156] Sum rewards: 8.441, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.355', 'AMMO2': '0.004', 'AMMO5': '0.017', 'AMMO4': '0.022', 'WEAPON1': '0.040', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.100', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.234', 'weapon4': '0.250', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.471', 'HITCOUNT': '0.490', 'WEAPON3': '0.550', 'weapon2': '1.394', 'weapon3': '1.726', 'DAMAGECOUNT': '2.109', 'FRAGCOUNT': '7.000'} [2023-02-24 18:19:04,217][177156] DAMAGECOUNT value on done: 84583.0 [2023-02-24 18:19:04,217][177156] Sum rewards: 11.780, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.830', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO3': '0.092', 'weapon5': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.232', 'WEAPON3': '0.650', 'HITCOUNT': '0.730', 'weapon2': '1.552', 'weapon3': '1.706', 'DAMAGECOUNT': '3.414', 'FRAGCOUNT': '10.000'} [2023-02-24 18:19:04,688][177153] Updated weights for policy 0, policy_version 11510 (0.0008) [2023-02-24 18:19:05,520][177158] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:19:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 47165440. Throughput: 0: 3507.2. Samples: 11785764. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:19:06,376][177119] Avg episode reward: [(0, '8.484')] [2023-02-24 18:19:06,414][177140] Saving new best policy, reward=8.484! [2023-02-24 18:19:07,589][177153] Updated weights for policy 0, policy_version 11520 (0.0008) [2023-02-24 18:19:10,526][177153] Updated weights for policy 0, policy_version 11530 (0.0008) [2023-02-24 18:19:10,601][177170] DAMAGECOUNT value on done: 86207.0 [2023-02-24 18:19:10,601][177170] Sum rewards: 7.785, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.133', 'AMMO5': '0.010', 'ARMOR': '0.028', 'AMMO2': '0.034', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO3': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.169', 'weapon5': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.360', 'WEAPON3': '0.500', 'weapon4': '0.660', 'weapon3': '0.898', 'weapon2': '1.186', 'DAMAGECOUNT': '2.391', 'FRAGCOUNT': '6.000'} [2023-02-24 18:19:10,897][177170] DAMAGECOUNT value on done: 79560.0 [2023-02-24 18:19:10,897][177170] Sum rewards: 9.148, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.060', 'AMMO5': '0.017', 'ARMOR': '0.036', 'AMMO2': '0.037', 'WEAPON1': '0.070', 'AMMO3': '0.127', 'weapon5': '0.168', 'AMMO4': '0.187', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.404', 'weapon2': '0.656', 'WEAPON3': '0.850', 'HITCOUNT': '0.890', 'weapon3': '2.282', 'DAMAGECOUNT': '3.483', 'FRAGCOUNT': '10.000'} [2023-02-24 18:19:10,905][177170] DAMAGECOUNT value on done: 89932.0 [2023-02-24 18:19:10,906][177170] Sum rewards: 4.577, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.106', 'AMMO2': '0.014', 'AMMO5': '0.023', 'WEAPON1': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'weapon4': '0.310', 'weapon5': '0.312', 'ARMOR': '0.458', 'HITCOUNT': '0.460', 'WEAPON5': '0.650', 'WEAPON3': '0.750', 'weapon3': '1.278', 'weapon2': '1.838', 'DAMAGECOUNT': '2.145', 'FRAGCOUNT': '6.000'} [2023-02-24 18:19:11,198][177170] DAMAGECOUNT value on done: 89554.0 [2023-02-24 18:19:11,199][177170] Sum rewards: 11.130, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.074', 'AMMO3': '0.075', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'weapon7': '0.116', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HEALTH': '0.270', 'WEAPON7': '0.300', 'weapon4': '0.344', 'WEAPON3': '0.500', 'HITCOUNT': '0.850', 'weapon3': '1.398', 'weapon2': '1.678', 'DAMAGECOUNT': '3.444', 'FRAGCOUNT': '8.000'} [2023-02-24 18:19:11,376][177119] Fps is (10 sec: 13926.2, 60 sec: 13994.6, 300 sec: 14009.7). Total num frames: 47235072. Throughput: 0: 3508.0. Samples: 11806790. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:19:11,377][177119] Avg episode reward: [(0, '8.337')] [2023-02-24 18:19:11,752][177158] DAMAGECOUNT value on done: 84067.0 [2023-02-24 18:19:11,752][177158] Sum rewards: 10.678, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.780', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.032', 'weapon7': '0.046', 'weapon5': '0.054', 'AMMO3': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.467', 'weapon4': '0.626', 'HITCOUNT': '0.910', 'weapon3': '1.246', 'weapon2': '1.318', 'DAMAGECOUNT': '3.210', 'FRAGCOUNT': '8.000'} [2023-02-24 18:19:12,052][177158] DAMAGECOUNT value on done: 81197.0 [2023-02-24 18:19:12,052][177158] Sum rewards: 7.707, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.660', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.097', 'AMMO4': '0.098', 'weapon5': '0.102', 'weapon7': '0.112', 'WEAPON5': '0.250', 'weapon4': '0.338', 'AMMO6': '0.400', 'WEAPON7': '0.400', 'AMMO7': '0.400', 'HITCOUNT': '0.480', 'WEAPON3': '0.600', 'weapon3': '1.310', 'weapon2': '1.794', 'DAMAGECOUNT': '2.358', 'FRAGCOUNT': '7.000'} [2023-02-24 18:19:12,804][177158] DAMAGECOUNT value on done: 83717.0 [2023-02-24 18:19:12,804][177158] Sum rewards: 7.328, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.550', 'ARMOR': '0.005', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.066', 'AMMO4': '0.116', 'weapon7': '0.118', 'weapon5': '0.120', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.334', 'HITCOUNT': '0.380', 'WEAPON3': '0.400', 'weapon3': '0.730', 'DAMAGECOUNT': '1.779', 'weapon2': '2.434', 'FRAGCOUNT': '7.000'} [2023-02-24 18:19:13,100][177158] DAMAGECOUNT value on done: 87507.0 [2023-02-24 18:19:13,100][177158] Sum rewards: 6.066, reward structure: {'DEATHCOUNT': '-2.250', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'HEALTH': '0.208', 'WEAPON3': '0.300', 'HITCOUNT': '0.300', 'weapon3': '0.682', 'DAMAGECOUNT': '1.245', 'weapon2': '2.014', 'FRAGCOUNT': '3.000'} [2023-02-24 18:19:13,442][177153] Updated weights for policy 0, policy_version 11540 (0.0008) [2023-02-24 18:19:13,800][177172] DAMAGECOUNT value on done: 84856.0 [2023-02-24 18:19:13,800][177172] Sum rewards: 12.083, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.720', 'AMMO5': '0.010', 'AMMO2': '0.027', 'WEAPON1': '0.070', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'AMMO4': '0.137', 'weapon4': '0.160', 'weapon5': '0.268', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.620', 'weapon2': '1.268', 'weapon3': '1.840', 'DAMAGECOUNT': '2.814', 'FRAGCOUNT': '9.000'} [2023-02-24 18:19:14,090][177172] DAMAGECOUNT value on done: 84830.0 [2023-02-24 18:19:14,091][177172] Sum rewards: 9.049, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.225', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'weapon5': '0.090', 'weapon7': '0.098', 'AMMO3': '0.101', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'weapon4': '0.516', 'WEAPON3': '0.700', 'HITCOUNT': '0.700', 'weapon2': '0.928', 'weapon3': '1.512', 'DAMAGECOUNT': '3.012', 'FRAGCOUNT': '8.000'} [2023-02-24 18:19:14,526][177154] DAMAGECOUNT value on done: 90592.0 [2023-02-24 18:19:14,526][177154] Sum rewards: 8.547, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.736', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.038', 'WEAPON1': '0.040', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.120', 'AMMO3': '0.132', 'AMMO4': '0.188', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.382', 'HITCOUNT': '0.730', 'weapon2': '0.796', 'WEAPON3': '0.950', 'weapon3': '2.052', 'DAMAGECOUNT': '2.931', 'FRAGCOUNT': '10.000'} [2023-02-24 18:19:14,823][177154] DAMAGECOUNT value on done: 86120.0 [2023-02-24 18:19:14,824][177154] Sum rewards: 6.185, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.653', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO3': '0.051', 'WEAPON1': '0.070', 'weapon7': '0.082', 'WEAPON4': '0.100', 'AMMO4': '0.115', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'weapon5': '0.322', 'HITCOUNT': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.444', 'WEAPON3': '0.450', 'weapon2': '1.234', 'DAMAGECOUNT': '1.320', 'weapon3': '1.452', 'FRAGCOUNT': '4.000'} [2023-02-24 18:19:14,845][177154] DAMAGECOUNT value on done: 88259.0 [2023-02-24 18:19:14,845][177154] Sum rewards: 11.284, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.012', 'AMMO5': '0.012', 'AMMO3': '0.040', 'WEAPON1': '0.050', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'weapon7': '0.102', 'weapon4': '0.198', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'weapon5': '0.262', 'HEALTH': '0.337', 'WEAPON5': '0.350', 'HITCOUNT': '0.590', 'weapon3': '1.136', 'weapon2': '1.928', 'DAMAGECOUNT': '3.504', 'FRAGCOUNT': '7.000'} [2023-02-24 18:19:15,139][177154] DAMAGECOUNT value on done: 89199.0 [2023-02-24 18:19:15,140][177154] Sum rewards: 12.177, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.874', 'AMMO5': '0.003', 'AMMO2': '0.006', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'weapon7': '0.054', 'weapon5': '0.060', 'AMMO3': '0.089', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.222', 'WEAPON3': '0.750', 'HITCOUNT': '0.910', 'weapon2': '1.670', 'weapon3': '1.810', 'DAMAGECOUNT': '3.717', 'FRAGCOUNT': '11.000'} [2023-02-24 18:19:15,246][177172] DAMAGECOUNT value on done: 85241.0 [2023-02-24 18:19:15,247][177172] Sum rewards: 5.069, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.235', 'AMMO5': '0.008', 'AMMO2': '0.011', 'AMMO3': '0.020', 'WEAPON1': '0.050', 'AMMO4': '0.056', 'weapon7': '0.058', 'HITCOUNT': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON3': '0.150', 'weapon5': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon3': '0.498', 'DAMAGECOUNT': '0.804', 'FRAGCOUNT': '1.000', 'weapon2': '3.228'} [2023-02-24 18:19:15,543][177172] DAMAGECOUNT value on done: 84966.0 [2023-02-24 18:19:15,543][177172] Sum rewards: 14.504, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.682', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.027', 'AMMO3': '0.077', 'WEAPON1': '0.080', 'AMMO4': '0.137', 'weapon5': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.756', 'HITCOUNT': '0.810', 'weapon2': '0.934', 'weapon3': '1.492', 'DAMAGECOUNT': '4.065', 'FRAGCOUNT': '12.000'} [2023-02-24 18:19:15,960][177157] DAMAGECOUNT value on done: 89443.0 [2023-02-24 18:19:15,961][177157] Sum rewards: 11.612, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.055', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'weapon5': '0.170', 'WEAPON5': '0.200', 'weapon4': '0.240', 'WEAPON3': '0.350', 'HEALTH': '0.386', 'HITCOUNT': '0.680', 'weapon3': '1.216', 'weapon2': '2.032', 'DAMAGECOUNT': '2.718', 'FRAGCOUNT': '7.000'} [2023-02-24 18:19:15,973][177157] DAMAGECOUNT value on done: 83759.0 [2023-02-24 18:19:15,974][177157] Sum rewards: 8.099, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.242', 'AMMO5': '0.010', 'AMMO2': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.051', 'AMMO3': '0.105', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.394', 'weapon4': '0.582', 'WEAPON3': '0.600', 'weapon2': '0.696', 'HITCOUNT': '0.720', 'weapon3': '1.486', 'DAMAGECOUNT': '2.457', 'FRAGCOUNT': '6.000'} [2023-02-24 18:19:16,213][177171] DAMAGECOUNT value on done: 87359.0 [2023-02-24 18:19:16,213][177171] Sum rewards: 18.020, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.019', 'AMMO2': '0.022', 'AMMO3': '0.076', 'WEAPON1': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.110', 'weapon4': '0.152', 'HEALTH': '0.190', 'weapon5': '0.294', 'WEAPON5': '0.450', 'WEAPON3': '0.450', 'HITCOUNT': '0.720', 'weapon2': '1.354', 'weapon3': '1.720', 'DAMAGECOUNT': '5.022', 'FRAGCOUNT': '14.000'} [2023-02-24 18:19:16,278][177157] DAMAGECOUNT value on done: 84617.0 [2023-02-24 18:19:16,278][177157] Sum rewards: 13.567, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.207', 'AMMO2': '0.002', 'AMMO4': '0.007', 'AMMO5': '0.011', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO3': '0.099', 'weapon5': '0.114', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '1.060', 'weapon3': '1.802', 'weapon2': '1.844', 'DAMAGECOUNT': '3.894', 'FRAGCOUNT': '9.000'} [2023-02-24 18:19:16,288][177157] DAMAGECOUNT value on done: 83163.0 [2023-02-24 18:19:16,289][177157] Sum rewards: 7.174, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.286', 'AMMO5': '0.005', 'AMMO2': '0.038', 'WEAPON1': '0.050', 'AMMO3': '0.063', 'weapon5': '0.108', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'weapon7': '0.206', 'WEAPON3': '0.450', 'WEAPON4': '0.450', 'ARMOR': '0.451', 'HITCOUNT': '0.480', 'AMMO6': '0.520', 'AMMO7': '0.520', 'weapon2': '0.528', 'WEAPON7': '0.600', 'weapon3': '0.992', 'weapon4': '1.264', 'DAMAGECOUNT': '2.844', 'FRAGCOUNT': '6.000'} [2023-02-24 18:19:16,339][177156] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200.0)] [2023-02-24 18:19:16,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 47304704. Throughput: 0: 3501.9. Samples: 11827672. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 18:19:16,376][177119] Avg episode reward: [(0, '8.691')] [2023-02-24 18:19:16,389][177140] Saving new best policy, reward=8.691! [2023-02-24 18:19:16,392][177153] Updated weights for policy 0, policy_version 11550 (0.0008) [2023-02-24 18:19:16,521][177171] DAMAGECOUNT value on done: 87043.0 [2023-02-24 18:19:16,521][177171] Sum rewards: 17.366, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.990', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.020', 'WEAPON1': '0.030', 'AMMO3': '0.096', 'weapon5': '0.116', 'WEAPON5': '0.150', 'WEAPON3': '0.700', 'HITCOUNT': '0.960', 'weapon3': '1.808', 'weapon2': '1.886', 'DAMAGECOUNT': '3.831', 'FRAGCOUNT': '14.000'} [2023-02-24 18:19:16,601][177171] DAMAGECOUNT value on done: 84407.0 [2023-02-24 18:19:16,602][177171] Sum rewards: 6.413, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.293', 'AMMO2': '0.018', 'AMMO5': '0.024', 'AMMO4': '0.089', 'WEAPON1': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.238', 'weapon4': '0.260', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'HITCOUNT': '0.810', 'weapon2': '1.048', 'weapon3': '2.102', 'DAMAGECOUNT': '2.790', 'FRAGCOUNT': '5.500'} [2023-02-24 18:19:16,904][177171] DAMAGECOUNT value on done: 84776.0 [2023-02-24 18:19:16,905][177171] Sum rewards: 12.580, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.860', 'AMMO2': '0.009', 'AMMO5': '0.022', 'AMMO4': '0.045', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON1': '0.110', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'weapon4': '0.356', 'WEAPON5': '0.500', 'weapon2': '0.514', 'weapon5': '0.516', 'HITCOUNT': '0.770', 'WEAPON3': '0.900', 'weapon3': '2.098', 'DAMAGECOUNT': '4.701', 'FRAGCOUNT': '12.000'} [2023-02-24 18:19:17,031][177155] DAMAGECOUNT value on done: 87432.0 [2023-02-24 18:19:17,031][177155] Sum rewards: 16.463, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.187', 'AMMO2': '0.018', 'AMMO5': '0.022', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.092', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.121', 'weapon4': '0.228', 'weapon5': '0.234', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon2': '0.850', 'HITCOUNT': '1.220', 'weapon3': '2.202', 'DAMAGECOUNT': '4.962', 'FRAGCOUNT': '13.500'} [2023-02-24 18:19:17,332][177155] DAMAGECOUNT value on done: 91128.0 [2023-02-24 18:19:17,332][177155] Sum rewards: 4.869, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.038', 'AMMO5': '0.014', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.078', 'WEAPON1': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.126', 'weapon5': '0.190', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.260', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.550', 'weapon2': '1.232', 'weapon3': '1.520', 'DAMAGECOUNT': '2.232', 'FRAGCOUNT': '4.000'} [2023-02-24 18:19:17,622][177155] DAMAGECOUNT value on done: 88816.0 [2023-02-24 18:19:17,623][177155] Sum rewards: 15.492, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.576', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'AMMO3': '0.095', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'weapon5': '0.248', 'WEAPON5': '0.300', 'weapon4': '0.398', 'WEAPON3': '0.600', 'HITCOUNT': '0.880', 'weapon3': '1.478', 'weapon2': '1.634', 'DAMAGECOUNT': '4.314', 'FRAGCOUNT': '14.000'} [2023-02-24 18:19:17,915][177155] DAMAGECOUNT value on done: 83247.0 [2023-02-24 18:19:17,915][177155] Sum rewards: 6.398, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.712', 'ARMOR': '0.008', 'WEAPON1': '0.030', 'AMMO5': '0.032', 'AMMO2': '0.038', 'weapon7': '0.046', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.128', 'AMMO4': '0.189', 'weapon5': '0.220', 'WEAPON4': '0.300', 'weapon4': '0.334', 'WEAPON5': '0.400', 'weapon2': '0.656', 'HITCOUNT': '0.780', 'WEAPON3': '0.900', 'weapon3': '2.252', 'DAMAGECOUNT': '2.997', 'FRAGCOUNT': '9.000'} [2023-02-24 18:19:19,315][177153] Updated weights for policy 0, policy_version 11560 (0.0008) [2023-02-24 18:19:21,376][177119] Fps is (10 sec: 14336.3, 60 sec: 14062.9, 300 sec: 14023.6). Total num frames: 47378432. Throughput: 0: 3502.4. Samples: 11838146. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 18:19:21,376][177119] Avg episode reward: [(0, '8.930')] [2023-02-24 18:19:21,377][177140] Saving new best policy, reward=8.930! [2023-02-24 18:19:21,419][177157] Large shaping reward 3.642 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:19:21,926][177154] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:19:22,241][177153] Updated weights for policy 0, policy_version 11570 (0.0008) [2023-02-24 18:19:23,003][177156] DAMAGECOUNT value on done: 84670.0 [2023-02-24 18:19:23,004][177156] Sum rewards: 7.716, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.144', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.070', 'AMMO3': '0.077', 'AMMO4': '0.088', 'weapon4': '0.098', 'WEAPON4': '0.100', 'weapon5': '0.254', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.660', 'weapon2': '1.624', 'weapon3': '1.716', 'DAMAGECOUNT': '2.745', 'FRAGCOUNT': '5.000'} [2023-02-24 18:19:23,159][177156] DAMAGECOUNT value on done: 86322.0 [2023-02-24 18:19:23,159][177156] Sum rewards: 5.499, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.374', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO3': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.122', 'weapon5': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.278', 'WEAPON3': '0.350', 'HITCOUNT': '0.580', 'weapon3': '1.328', 'weapon2': '1.922', 'DAMAGECOUNT': '2.190', 'FRAGCOUNT': '5.000'} [2023-02-24 18:19:23,312][177156] DAMAGECOUNT value on done: 86517.0 [2023-02-24 18:19:23,312][177156] Sum rewards: 9.579, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.452', 'AMMO5': '0.018', 'AMMO2': '0.026', 'weapon7': '0.048', 'WEAPON1': '0.060', 'AMMO3': '0.073', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.132', 'weapon5': '0.174', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'HITCOUNT': '0.420', 'WEAPON3': '0.450', 'weapon2': '0.630', 'weapon4': '0.658', 'weapon3': '1.344', 'DAMAGECOUNT': '2.907', 'FRAGCOUNT': '8.000'} [2023-02-24 18:19:23,469][177156] DAMAGECOUNT value on done: 85934.0 [2023-02-24 18:19:23,470][177156] Sum rewards: 11.272, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.186', 'AMMO2': '0.019', 'AMMO5': '0.020', 'ARMOR': '0.024', 'WEAPON1': '0.040', 'AMMO4': '0.096', 'AMMO3': '0.116', 'weapon5': '0.154', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'HITCOUNT': '0.750', 'WEAPON3': '0.800', 'weapon4': '0.858', 'weapon2': '0.860', 'weapon3': '1.368', 'DAMAGECOUNT': '4.053', 'FRAGCOUNT': '11.000'} [2023-02-24 18:19:25,130][177153] Updated weights for policy 0, policy_version 11580 (0.0008) [2023-02-24 18:19:26,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14062.9, 300 sec: 14009.7). Total num frames: 47448064. Throughput: 0: 3502.1. Samples: 11859220. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 18:19:26,376][177119] Avg episode reward: [(0, '9.024')] [2023-02-24 18:19:26,380][177140] Saving new best policy, reward=9.024! [2023-02-24 18:19:28,074][177153] Updated weights for policy 0, policy_version 11590 (0.0008) [2023-02-24 18:19:29,832][177170] DAMAGECOUNT value on done: 87532.0 [2023-02-24 18:19:29,833][177170] Sum rewards: 8.129, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.297', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.060', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.143', 'weapon5': '0.174', 'weapon4': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.770', 'WEAPON3': '0.900', 'weapon2': '1.000', 'weapon3': '2.098', 'DAMAGECOUNT': '3.975', 'FRAGCOUNT': '9.000'} [2023-02-24 18:19:30,127][177170] DAMAGECOUNT value on done: 80520.0 [2023-02-24 18:19:30,127][177170] Sum rewards: 12.040, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.304', 'AMMO2': '0.004', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO4': '0.022', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.072', 'AMMO3': '0.089', 'weapon5': '0.094', 'weapon4': '0.102', 'WEAPON5': '0.300', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.820', 'weapon3': '1.542', 'weapon2': '1.848', 'DAMAGECOUNT': '2.880', 'FRAGCOUNT': '9.000'} [2023-02-24 18:19:30,136][177170] DAMAGECOUNT value on done: 90502.0 [2023-02-24 18:19:30,136][177170] Sum rewards: 2.619, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.626', 'AMMO2': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.049', 'WEAPON1': '0.060', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'weapon5': '0.210', 'weapon4': '0.252', 'WEAPON5': '0.300', 'HITCOUNT': '0.420', 'WEAPON3': '0.600', 'weapon2': '1.044', 'DAMAGECOUNT': '1.710', 'weapon3': '1.880', 'FRAGCOUNT': '4.000'} [2023-02-24 18:19:30,441][177170] DAMAGECOUNT value on done: 90598.0 [2023-02-24 18:19:30,442][177170] Sum rewards: 8.044, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.274', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO4': '0.044', 'AMMO3': '0.091', 'weapon7': '0.164', 'weapon5': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'AMMO6': '0.340', 'AMMO7': '0.340', 'weapon4': '0.358', 'WEAPON7': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.590', 'weapon2': '1.272', 'weapon3': '1.456', 'DAMAGECOUNT': '3.132', 'FRAGCOUNT': '5.500'} [2023-02-24 18:19:30,876][177158] DAMAGECOUNT value on done: 85142.0 [2023-02-24 18:19:30,876][177158] Sum rewards: 8.288, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.963', 'AMMO2': '0.020', 'AMMO5': '0.022', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.099', 'weapon4': '0.130', 'AMMO3': '0.137', 'weapon5': '0.238', 'WEAPON5': '0.500', 'HITCOUNT': '0.550', 'WEAPON3': '0.900', 'weapon2': '1.644', 'weapon3': '1.696', 'DAMAGECOUNT': '3.225', 'FRAGCOUNT': '9.000'} [2023-02-24 18:19:31,015][177153] Updated weights for policy 0, policy_version 11600 (0.0008) [2023-02-24 18:19:31,175][177158] DAMAGECOUNT value on done: 82045.0 [2023-02-24 18:19:31,175][177158] Sum rewards: 4.809, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.680', 'weapon4': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.060', 'AMMO3': '0.075', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'weapon7': '0.132', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.660', 'weapon3': '1.604', 'weapon2': '1.846', 'DAMAGECOUNT': '2.544', 'FRAGCOUNT': '3.000'} [2023-02-24 18:19:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.8, 300 sec: 14009.7). Total num frames: 47517696. Throughput: 0: 3499.7. Samples: 11880168. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 18:19:31,376][177119] Avg episode reward: [(0, '9.144')] [2023-02-24 18:19:31,377][177140] Saving new best policy, reward=9.144! [2023-02-24 18:19:31,947][177158] DAMAGECOUNT value on done: 84658.0 [2023-02-24 18:19:31,947][177158] Sum rewards: 4.455, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.866', 'AMMO5': '0.017', 'AMMO2': '0.024', 'WEAPON1': '0.070', 'AMMO3': '0.085', 'weapon7': '0.096', 'AMMO4': '0.121', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.260', 'WEAPON7': '0.300', 'weapon2': '0.352', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.590', 'weapon4': '0.816', 'weapon3': '1.326', 'DAMAGECOUNT': '2.823', 'FRAGCOUNT': '5.000'} [2023-02-24 18:19:32,247][177158] DAMAGECOUNT value on done: 88790.0 [2023-02-24 18:19:32,248][177158] Sum rewards: 14.916, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.817', 'AMMO5': '0.017', 'AMMO2': '0.025', 'AMMO3': '0.067', 'WEAPON1': '0.070', 'AMMO4': '0.126', 'weapon5': '0.148', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.494', 'WEAPON3': '0.550', 'weapon4': '0.660', 'HITCOUNT': '0.890', 'weapon2': '1.168', 'weapon3': '1.568', 'DAMAGECOUNT': '3.849', 'FRAGCOUNT': '10.000'} [2023-02-24 18:19:33,016][177172] DAMAGECOUNT value on done: 86031.0 [2023-02-24 18:19:33,017][177172] Sum rewards: 9.121, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.764', 'AMMO2': '0.005', 'AMMO5': '0.020', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'WEAPON1': '0.080', 'AMMO3': '0.113', 'weapon4': '0.124', 'weapon5': '0.244', 'WEAPON5': '0.400', 'HITCOUNT': '0.700', 'WEAPON3': '0.750', 'weapon2': '0.890', 'weapon3': '2.210', 'DAMAGECOUNT': '3.525', 'FRAGCOUNT': '7.500'} [2023-02-24 18:19:33,317][177172] DAMAGECOUNT value on done: 85834.0 [2023-02-24 18:19:33,317][177172] Sum rewards: 12.050, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.510', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'AMMO3': '0.043', 'AMMO4': '0.095', 'weapon7': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.186', 'WEAPON7': '0.200', 'HITCOUNT': '0.240', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'weapon3': '1.024', 'weapon2': '2.364', 'DAMAGECOUNT': '2.412', 'FRAGCOUNT': '8.000'} [2023-02-24 18:19:33,786][177154] DAMAGECOUNT value on done: 91590.0 [2023-02-24 18:19:33,786][177154] Sum rewards: 7.287, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.586', 'AMMO2': '0.014', 'AMMO5': '0.016', 'WEAPON1': '0.070', 'AMMO4': '0.070', 'AMMO3': '0.084', 'WEAPON4': '0.200', 'weapon4': '0.262', 'weapon5': '0.276', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'ARMOR': '0.502', 'HITCOUNT': '0.610', 'weapon3': '1.440', 'weapon2': '1.684', 'DAMAGECOUNT': '2.994', 'FRAGCOUNT': '5.500'} [2023-02-24 18:19:33,960][177153] Updated weights for policy 0, policy_version 11610 (0.0009) [2023-02-24 18:19:34,084][177154] DAMAGECOUNT value on done: 87520.0 [2023-02-24 18:19:34,084][177154] Sum rewards: 12.579, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.870', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'weapon7': '0.106', 'AMMO3': '0.118', 'weapon4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '0.920', 'weapon3': '1.532', 'weapon2': '1.908', 'DAMAGECOUNT': '3.930', 'FRAGCOUNT': '12.000'} [2023-02-24 18:19:34,106][177154] DAMAGECOUNT value on done: 88664.0 [2023-02-24 18:19:34,107][177154] Sum rewards: 5.676, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.110', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.017', 'weapon7': '0.048', 'WEAPON4': '0.050', 'WEAPON1': '0.050', 'AMMO3': '0.063', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.128', 'WEAPON7': '0.200', 'weapon5': '0.216', 'HITCOUNT': '0.240', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.215', 'weapon3': '1.436', 'weapon2': '1.772', 'FRAGCOUNT': '3.000'} [2023-02-24 18:19:34,400][177154] DAMAGECOUNT value on done: 90267.0 [2023-02-24 18:19:34,400][177154] Sum rewards: 4.543, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.496', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.013', 'WEAPON1': '0.050', 'AMMO3': '0.142', 'weapon5': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.499', 'HITCOUNT': '0.770', 'WEAPON3': '1.000', 'weapon2': '1.372', 'weapon3': '2.046', 'DAMAGECOUNT': '3.204', 'FRAGCOUNT': '6.500'} [2023-02-24 18:19:34,492][177172] DAMAGECOUNT value on done: 86985.0 [2023-02-24 18:19:34,493][177172] Sum rewards: 12.949, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.426', 'AMMO5': '0.007', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.038', 'weapon5': '0.082', 'AMMO3': '0.100', 'weapon7': '0.126', 'WEAPON5': '0.150', 'AMMO4': '0.191', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.600', 'weapon4': '0.734', 'weapon2': '0.966', 'HITCOUNT': '1.050', 'weapon3': '1.498', 'DAMAGECOUNT': '5.214', 'FRAGCOUNT': '10.000'} [2023-02-24 18:19:34,787][177172] DAMAGECOUNT value on done: 85517.0 [2023-02-24 18:19:34,787][177172] Sum rewards: 5.878, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.696', 'ARMOR': '0.008', 'AMMO2': '0.008', 'AMMO4': '0.041', 'AMMO3': '0.089', 'weapon7': '0.164', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'WEAPON7': '0.400', 'HITCOUNT': '0.410', 'weapon2': '0.442', 'WEAPON3': '0.650', 'weapon4': '0.952', 'weapon3': '1.226', 'DAMAGECOUNT': '1.653', 'FRAGCOUNT': '6.000'} [2023-02-24 18:19:35,211][177157] DAMAGECOUNT value on done: 90442.0 [2023-02-24 18:19:35,212][177157] Sum rewards: 9.724, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.483', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.027', 'WEAPON1': '0.030', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'weapon5': '0.112', 'weapon4': '0.134', 'WEAPON5': '0.200', 'WEAPON3': '0.600', 'HITCOUNT': '0.710', 'weapon2': '1.464', 'weapon3': '1.980', 'DAMAGECOUNT': '2.997', 'FRAGCOUNT': '7.000'} [2023-02-24 18:19:35,223][177157] DAMAGECOUNT value on done: 85258.0 [2023-02-24 18:19:35,224][177157] Sum rewards: 14.009, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.345', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO5': '0.022', 'WEAPON1': '0.060', 'AMMO3': '0.116', 'weapon5': '0.124', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'HITCOUNT': '1.110', 'weapon2': '1.312', 'weapon3': '2.300', 'DAMAGECOUNT': '4.497', 'FRAGCOUNT': '12.000'} [2023-02-24 18:19:35,381][177171] DAMAGECOUNT value on done: 89023.0 [2023-02-24 18:19:35,381][177171] Sum rewards: 12.514, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.040', 'ARMOR': '0.009', 'AMMO2': '0.017', 'AMMO5': '0.017', 'weapon7': '0.044', 'WEAPON1': '0.060', 'AMMO4': '0.083', 'AMMO3': '0.135', 'weapon5': '0.162', 'WEAPON4': '0.200', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON5': '0.450', 'weapon4': '0.674', 'HITCOUNT': '0.820', 'WEAPON3': '0.850', 'weapon2': '1.218', 'weapon3': '1.536', 'DAMAGECOUNT': '4.878', 'FRAGCOUNT': '10.500'} [2023-02-24 18:19:35,518][177157] DAMAGECOUNT value on done: 85747.0 [2023-02-24 18:19:35,519][177157] Sum rewards: 9.846, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.202', 'ARMOR': '0.005', 'AMMO5': '0.014', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'AMMO3': '0.112', 'weapon7': '0.116', 'AMMO4': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.190', 'WEAPON7': '0.200', 'weapon5': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.510', 'WEAPON3': '0.750', 'weapon3': '1.422', 'weapon2': '1.474', 'DAMAGECOUNT': '3.219', 'FRAGCOUNT': '10.000'} [2023-02-24 18:19:35,529][177157] DAMAGECOUNT value on done: 84279.0 [2023-02-24 18:19:35,530][177157] Sum rewards: 9.897, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.590', 'AMMO2': '0.016', 'AMMO5': '0.017', 'WEAPON1': '0.050', 'AMMO3': '0.071', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'weapon4': '0.240', 'weapon5': '0.338', 'WEAPON5': '0.400', 'ARMOR': '0.457', 'WEAPON3': '0.550', 'HITCOUNT': '0.750', 'weapon2': '1.138', 'weapon3': '1.882', 'DAMAGECOUNT': '3.348', 'FRAGCOUNT': '9.500'} [2023-02-24 18:19:35,672][177171] DAMAGECOUNT value on done: 88001.0 [2023-02-24 18:19:35,673][177171] Sum rewards: 4.237, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.680', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.035', 'WEAPON1': '0.060', 'weapon4': '0.104', 'AMMO3': '0.131', 'AMMO4': '0.176', 'weapon5': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'HITCOUNT': '0.690', 'WEAPON3': '0.800', 'weapon2': '1.264', 'weapon3': '1.924', 'DAMAGECOUNT': '2.874', 'FRAGCOUNT': '8.000'} [2023-02-24 18:19:35,766][177171] DAMAGECOUNT value on done: 85435.0 [2023-02-24 18:19:35,767][177171] Sum rewards: 8.581, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.400', 'AMMO5': '0.015', 'AMMO2': '0.016', 'WEAPON1': '0.050', 'AMMO3': '0.064', 'AMMO4': '0.080', 'weapon7': '0.092', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.290', 'WEAPON5': '0.300', 'weapon4': '0.330', 'WEAPON3': '0.450', 'HITCOUNT': '0.630', 'weapon2': '0.668', 'weapon3': '1.712', 'DAMAGECOUNT': '3.084', 'FRAGCOUNT': '6.000'} [2023-02-24 18:19:36,061][177171] DAMAGECOUNT value on done: 85428.0 [2023-02-24 18:19:36,062][177171] Sum rewards: 5.421, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.109', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO3': '0.047', 'AMMO4': '0.111', 'weapon5': '0.164', 'weapon7': '0.220', 'HITCOUNT': '0.330', 'WEAPON5': '0.350', 'WEAPON3': '0.350', 'AMMO6': '0.360', 'AMMO7': '0.360', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'WEAPON7': '0.600', 'weapon2': '0.654', 'weapon3': '0.718', 'weapon4': '0.728', 'DAMAGECOUNT': '1.956', 'FRAGCOUNT': '4.000'} [2023-02-24 18:19:36,244][177155] DAMAGECOUNT value on done: 88684.0 [2023-02-24 18:19:36,245][177155] Sum rewards: 13.077, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.665', 'AMMO5': '0.020', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'AMMO4': '0.106', 'weapon5': '0.114', 'AMMO3': '0.131', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'ARMOR': '0.404', 'weapon4': '0.426', 'weapon2': '0.886', 'WEAPON3': '0.900', 'HITCOUNT': '1.000', 'weapon3': '2.298', 'DAMAGECOUNT': '3.756', 'FRAGCOUNT': '13.000'} [2023-02-24 18:19:36,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 47587328. Throughput: 0: 3496.4. Samples: 11890646. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:19:36,376][177119] Avg episode reward: [(0, '9.180')] [2023-02-24 18:19:36,379][177140] Saving new best policy, reward=9.180! [2023-02-24 18:19:36,564][177155] DAMAGECOUNT value on done: 92358.0 [2023-02-24 18:19:36,564][177155] Sum rewards: 7.905, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.820', 'AMMO2': '0.009', 'AMMO5': '0.029', 'WEAPON1': '0.040', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'weapon7': '0.084', 'weapon4': '0.108', 'AMMO3': '0.110', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon5': '0.504', 'WEAPON5': '0.650', 'WEAPON3': '0.750', 'HITCOUNT': '0.800', 'weapon2': '1.238', 'weapon3': '1.630', 'DAMAGECOUNT': '3.690', 'FRAGCOUNT': '9.000'} [2023-02-24 18:19:36,848][177155] DAMAGECOUNT value on done: 89594.0 [2023-02-24 18:19:36,849][177155] Sum rewards: 7.369, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.920', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon5': '0.068', 'AMMO3': '0.095', 'weapon7': '0.098', 'AMMO4': '0.114', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.420', 'HITCOUNT': '0.530', 'weapon2': '0.590', 'WEAPON3': '0.700', 'weapon4': '0.792', 'weapon3': '1.598', 'DAMAGECOUNT': '2.334', 'FRAGCOUNT': '8.000'} [2023-02-24 18:19:36,892][177153] Updated weights for policy 0, policy_version 11620 (0.0008) [2023-02-24 18:19:36,961][177157] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 18:19:37,150][177155] DAMAGECOUNT value on done: 83982.0 [2023-02-24 18:19:37,151][177155] Sum rewards: 9.672, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.014', 'AMMO2': '0.014', 'ARMOR': '0.028', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO3': '0.061', 'AMMO4': '0.072', 'HEALTH': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.250', 'weapon5': '0.252', 'WEAPON5': '0.300', 'weapon4': '0.396', 'WEAPON3': '0.400', 'HITCOUNT': '0.500', 'weapon2': '1.218', 'weapon3': '1.506', 'DAMAGECOUNT': '2.205', 'FRAGCOUNT': '8.000'} [2023-02-24 18:19:39,787][177153] Updated weights for policy 0, policy_version 11630 (0.0008) [2023-02-24 18:19:41,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 47656960. Throughput: 0: 3502.2. Samples: 11911828. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:19:41,376][177119] Avg episode reward: [(0, '9.087')] [2023-02-24 18:19:42,205][177156] DAMAGECOUNT value on done: 85882.0 [2023-02-24 18:19:42,206][177156] Sum rewards: 9.005, reward structure: {'DEATHCOUNT': '-9.000', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'HEALTH': '0.024', 'AMMO2': '0.029', 'weapon7': '0.052', 'AMMO3': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.145', 'weapon5': '0.156', 'WEAPON4': '0.200', 'weapon4': '0.288', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '0.840', 'weapon3': '1.486', 'weapon2': '1.776', 'DAMAGECOUNT': '3.636', 'FRAGCOUNT': '8.000'} [2023-02-24 18:19:42,343][177156] DAMAGECOUNT value on done: 86922.0 [2023-02-24 18:19:42,344][177156] Sum rewards: 5.593, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.030', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.019', 'weapon7': '0.056', 'AMMO3': '0.069', 'WEAPON1': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.212', 'WEAPON5': '0.250', 'weapon4': '0.352', 'HITCOUNT': '0.370', 'WEAPON3': '0.450', 'weapon3': '1.072', 'weapon2': '1.552', 'DAMAGECOUNT': '1.800', 'FRAGCOUNT': '5.000'} [2023-02-24 18:19:42,509][177156] DAMAGECOUNT value on done: 87624.0 [2023-02-24 18:19:42,510][177156] Sum rewards: 9.827, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.912', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.040', 'WEAPON1': '0.050', 'weapon5': '0.062', 'AMMO3': '0.112', 'AMMO4': '0.200', 'weapon7': '0.202', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON5': '0.300', 'WEAPON7': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.650', 'WEAPON3': '0.700', 'HITCOUNT': '0.740', 'weapon4': '0.764', 'weapon3': '1.616', 'DAMAGECOUNT': '3.321', 'FRAGCOUNT': '12.000'} [2023-02-24 18:19:42,652][177156] DAMAGECOUNT value on done: 87099.0 [2023-02-24 18:19:42,652][177156] Sum rewards: 13.049, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.776', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.014', 'WEAPON1': '0.080', 'AMMO3': '0.092', 'weapon5': '0.306', 'WEAPON5': '0.400', 'weapon2': '0.498', 'WEAPON3': '0.650', 'HITCOUNT': '0.760', 'weapon3': '2.284', 'DAMAGECOUNT': '3.495', 'FRAGCOUNT': '12.000'} [2023-02-24 18:19:42,706][177153] Updated weights for policy 0, policy_version 11640 (0.0008) [2023-02-24 18:19:45,635][177153] Updated weights for policy 0, policy_version 11650 (0.0008) [2023-02-24 18:19:46,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 47726592. Throughput: 0: 3501.5. Samples: 11932926. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:19:46,376][177119] Avg episode reward: [(0, '9.172')] [2023-02-24 18:19:48,536][177153] Updated weights for policy 0, policy_version 11660 (0.0009) [2023-02-24 18:19:48,882][177170] DAMAGECOUNT value on done: 88757.0 [2023-02-24 18:19:48,882][177170] Sum rewards: 12.786, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.400', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon7': '0.054', 'AMMO4': '0.094', 'AMMO3': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.118', 'weapon5': '0.160', 'WEAPON5': '0.200', 'WEAPON3': '0.600', 'HITCOUNT': '0.650', 'weapon3': '1.484', 'weapon2': '1.906', 'DAMAGECOUNT': '3.405', 'FRAGCOUNT': '10.000'} [2023-02-24 18:19:49,186][177170] DAMAGECOUNT value on done: 90877.0 [2023-02-24 18:19:49,187][177170] Sum rewards: 1.378, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'HEALTH': '0.051', 'AMMO3': '0.092', 'weapon5': '0.104', 'AMMO4': '0.167', 'WEAPON4': '0.200', 'weapon2': '0.314', 'HITCOUNT': '0.340', 'WEAPON5': '0.350', 'ARMOR': '0.412', 'WEAPON3': '0.550', 'weapon4': '0.752', 'DAMAGECOUNT': '1.125', 'weapon3': '1.350', 'FRAGCOUNT': '1.500'} [2023-02-24 18:19:49,200][177170] DAMAGECOUNT value on done: 81414.0 [2023-02-24 18:19:49,200][177170] Sum rewards: 7.144, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.761', 'weapon7': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.028', 'WEAPON1': '0.060', 'AMMO4': '0.141', 'AMMO3': '0.148', 'weapon5': '0.190', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon4': '0.474', 'HITCOUNT': '0.630', 'weapon2': '0.726', 'WEAPON3': '0.950', 'weapon3': '1.904', 'DAMAGECOUNT': '2.682', 'FRAGCOUNT': '9.000'} [2023-02-24 18:19:49,503][177170] DAMAGECOUNT value on done: 91258.0 [2023-02-24 18:19:49,503][177170] Sum rewards: 3.908, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.851', 'AMMO2': '0.019', 'AMMO5': '0.020', 'weapon7': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.124', 'weapon4': '0.164', 'WEAPON7': '0.200', 'HITCOUNT': '0.430', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'weapon2': '1.540', 'weapon3': '1.772', 'DAMAGECOUNT': '1.980', 'FRAGCOUNT': '5.000'} [2023-02-24 18:19:50,026][177158] DAMAGECOUNT value on done: 86097.0 [2023-02-24 18:19:50,026][177158] Sum rewards: 6.462, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.432', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'WEAPON4': '0.050', 'AMMO4': '0.070', 'weapon5': '0.126', 'AMMO3': '0.152', 'weapon4': '0.260', 'WEAPON5': '0.450', 'HITCOUNT': '0.640', 'WEAPON3': '0.850', 'weapon3': '1.452', 'weapon2': '1.672', 'DAMAGECOUNT': '2.865', 'FRAGCOUNT': '9.000'} [2023-02-24 18:19:50,321][177158] DAMAGECOUNT value on done: 82637.0 [2023-02-24 18:19:50,321][177158] Sum rewards: 4.073, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.609', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.014', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.089', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.126', 'weapon7': '0.150', 'weapon5': '0.156', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.440', 'WEAPON3': '0.650', 'weapon2': '1.316', 'weapon3': '1.712', 'DAMAGECOUNT': '1.776', 'FRAGCOUNT': '3.000'} [2023-02-24 18:19:50,541][177172] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:19:51,080][177158] DAMAGECOUNT value on done: 85834.0 [2023-02-24 18:19:51,081][177158] Sum rewards: 5.948, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.774', 'AMMO5': '0.013', 'AMMO2': '0.038', 'WEAPON1': '0.060', 'weapon5': '0.116', 'AMMO3': '0.123', 'AMMO4': '0.191', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'ARMOR': '0.404', 'weapon4': '0.498', 'HITCOUNT': '0.880', 'WEAPON3': '0.950', 'weapon2': '1.080', 'weapon3': '1.840', 'DAMAGECOUNT': '3.528', 'FRAGCOUNT': '8.000'} [2023-02-24 18:19:51,376][177158] DAMAGECOUNT value on done: 89758.0 [2023-02-24 18:19:51,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 47796224. Throughput: 0: 3505.0. Samples: 11943488. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:19:51,376][177119] Avg episode reward: [(0, '9.063')] [2023-02-24 18:19:51,376][177158] Sum rewards: 5.261, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.835', 'AMMO5': '0.012', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.097', 'weapon5': '0.098', 'AMMO3': '0.099', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.452', 'ARMOR': '0.465', 'WEAPON3': '0.700', 'weapon4': '0.830', 'HITCOUNT': '0.910', 'weapon3': '1.728', 'DAMAGECOUNT': '2.904', 'FRAGCOUNT': '7.000'} [2023-02-24 18:19:51,466][177153] Updated weights for policy 0, policy_version 11670 (0.0008) [2023-02-24 18:19:52,208][177172] DAMAGECOUNT value on done: 87203.0 [2023-02-24 18:19:52,209][177172] Sum rewards: 5.439, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.297', 'ARMOR': '0.004', 'AMMO5': '0.025', 'WEAPON1': '0.030', 'AMMO2': '0.034', 'weapon5': '0.070', 'AMMO3': '0.125', 'weapon7': '0.134', 'AMMO4': '0.172', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.380', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.750', 'weapon2': '0.868', 'weapon3': '2.098', 'DAMAGECOUNT': '3.306', 'FRAGCOUNT': '7.000'} [2023-02-24 18:19:52,502][177172] DAMAGECOUNT value on done: 86339.0 [2023-02-24 18:19:52,502][177172] Sum rewards: 3.140, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.468', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'weapon4': '0.062', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'AMMO4': '0.118', 'weapon5': '0.120', 'HITCOUNT': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.515', 'weapon3': '1.706', 'weapon2': '1.868', 'FRAGCOUNT': '2.000'} [2023-02-24 18:19:52,956][177154] DAMAGECOUNT value on done: 92595.0 [2023-02-24 18:19:52,956][177154] Sum rewards: 10.993, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.732', 'AMMO5': '0.010', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'AMMO3': '0.082', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.105', 'weapon5': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.640', 'weapon4': '0.694', 'weapon2': '1.286', 'weapon3': '1.366', 'DAMAGECOUNT': '3.015', 'FRAGCOUNT': '9.000'} [2023-02-24 18:19:53,254][177154] DAMAGECOUNT value on done: 89320.0 [2023-02-24 18:19:53,255][177154] Sum rewards: 17.346, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.431', 'AMMO2': '0.004', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.019', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'weapon4': '0.144', 'weapon5': '0.150', 'WEAPON5': '0.350', 'WEAPON3': '0.900', 'weapon2': '0.994', 'HITCOUNT': '1.170', 'weapon3': '2.312', 'DAMAGECOUNT': '5.400', 'FRAGCOUNT': '16.000'} [2023-02-24 18:19:53,283][177154] DAMAGECOUNT value on done: 90043.0 [2023-02-24 18:19:53,283][177154] Sum rewards: 15.194, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.964', 'AMMO5': '0.012', 'AMMO2': '0.033', 'WEAPON1': '0.040', 'AMMO3': '0.117', 'weapon5': '0.162', 'AMMO4': '0.163', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon4': '0.642', 'WEAPON3': '0.750', 'HITCOUNT': '0.920', 'weapon2': '1.194', 'weapon3': '1.496', 'DAMAGECOUNT': '4.128', 'FRAGCOUNT': '13.000'} [2023-02-24 18:19:53,577][177154] DAMAGECOUNT value on done: 91147.0 [2023-02-24 18:19:53,577][177154] Sum rewards: 11.165, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.417', 'AMMO5': '0.019', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'weapon7': '0.064', 'AMMO3': '0.115', 'AMMO4': '0.123', 'weapon5': '0.192', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.500', 'weapon4': '0.512', 'HITCOUNT': '0.560', 'WEAPON3': '0.600', 'weapon3': '1.930', 'DAMAGECOUNT': '2.640', 'FRAGCOUNT': '11.000'} [2023-02-24 18:19:53,672][177172] DAMAGECOUNT value on done: 88231.0 [2023-02-24 18:19:53,673][177172] Sum rewards: 13.870, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.900', 'AMMO5': '0.020', 'AMMO2': '0.028', 'WEAPON1': '0.080', 'AMMO3': '0.081', 'AMMO4': '0.139', 'WEAPON4': '0.250', 'weapon5': '0.300', 'weapon2': '0.434', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.670', 'weapon4': '0.700', 'weapon3': '1.980', 'DAMAGECOUNT': '3.738', 'FRAGCOUNT': '12.000'} [2023-02-24 18:19:53,979][177172] DAMAGECOUNT value on done: 86449.0 [2023-02-24 18:19:53,979][177172] Sum rewards: 6.410, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.794', 'AMMO2': '0.007', 'AMMO5': '0.022', 'AMMO4': '0.032', 'weapon4': '0.042', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon5': '0.222', 'ARMOR': '0.400', 'HITCOUNT': '0.470', 'WEAPON5': '0.600', 'WEAPON3': '0.850', 'weapon2': '1.102', 'weapon3': '2.150', 'DAMAGECOUNT': '2.796', 'FRAGCOUNT': '6.000'} [2023-02-24 18:19:54,245][177157] DAMAGECOUNT value on done: 91467.0 [2023-02-24 18:19:54,246][177157] Sum rewards: 6.993, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.310', 'AMMO5': '0.026', 'AMMO2': '0.042', 'weapon7': '0.068', 'WEAPON1': '0.070', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.146', 'AMMO4': '0.209', 'weapon5': '0.234', 'ARMOR': '0.449', 'WEAPON4': '0.500', 'weapon4': '0.564', 'WEAPON5': '0.650', 'HITCOUNT': '0.840', 'WEAPON3': '0.900', 'weapon2': '1.220', 'weapon3': '1.510', 'DAMAGECOUNT': '3.075', 'FRAGCOUNT': '9.000'} [2023-02-24 18:19:54,257][177157] DAMAGECOUNT value on done: 86181.0 [2023-02-24 18:19:54,258][177157] Sum rewards: 8.751, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.921', 'AMMO5': '0.021', 'AMMO2': '0.022', 'WEAPON1': '0.080', 'weapon7': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.116', 'weapon5': '0.192', 'weapon4': '0.224', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'HITCOUNT': '0.660', 'WEAPON3': '0.750', 'weapon2': '0.824', 'weapon3': '2.124', 'DAMAGECOUNT': '2.769', 'FRAGCOUNT': '8.500'} [2023-02-24 18:19:54,338][177171] DAMAGECOUNT value on done: 89342.0 [2023-02-24 18:19:54,339][177171] Sum rewards: 0.506, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.328', 'AMMO5': '0.010', 'AMMO2': '0.023', 'WEAPON1': '0.050', 'weapon7': '0.052', 'AMMO3': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'weapon5': '0.174', 'HITCOUNT': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.344', 'weapon2': '0.504', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.957', 'weapon3': '1.608', 'FRAGCOUNT': '3.000'} [2023-02-24 18:19:54,385][177153] Updated weights for policy 0, policy_version 11680 (0.0009) [2023-02-24 18:19:54,550][177157] DAMAGECOUNT value on done: 86473.0 [2023-02-24 18:19:54,551][177157] Sum rewards: 5.739, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.071', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon7': '0.056', 'AMMO3': '0.092', 'AMMO4': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.184', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'HITCOUNT': '0.440', 'ARMOR': '0.455', 'weapon4': '0.544', 'WEAPON3': '0.550', 'weapon2': '0.708', 'weapon3': '1.544', 'DAMAGECOUNT': '2.178', 'FRAGCOUNT': '7.000'} [2023-02-24 18:19:54,561][177157] DAMAGECOUNT value on done: 85194.0 [2023-02-24 18:19:54,562][177157] Sum rewards: 6.412, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.250', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon5': '0.078', 'AMMO4': '0.080', 'AMMO3': '0.093', 'weapon7': '0.136', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.340', 'HITCOUNT': '0.560', 'WEAPON3': '0.650', 'weapon2': '1.120', 'weapon3': '1.604', 'DAMAGECOUNT': '2.745', 'FRAGCOUNT': '6.000'} [2023-02-24 18:19:54,634][177171] DAMAGECOUNT value on done: 89048.0 [2023-02-24 18:19:54,635][177171] Sum rewards: 8.618, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.976', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'ARMOR': '0.004', 'AMMO5': '0.027', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'WEAPON1': '0.110', 'weapon7': '0.188', 'weapon5': '0.220', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.288', 'WEAPON7': '0.400', 'weapon2': '0.434', 'WEAPON5': '0.600', 'HITCOUNT': '0.650', 'WEAPON3': '0.750', 'weapon3': '2.108', 'DAMAGECOUNT': '3.141', 'FRAGCOUNT': '8.500'} [2023-02-24 18:19:54,743][177171] DAMAGECOUNT value on done: 85670.0 [2023-02-24 18:19:54,744][177171] Sum rewards: 2.707, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.565', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.020', 'AMMO3': '0.059', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'weapon7': '0.172', 'weapon4': '0.360', 'WEAPON3': '0.400', 'AMMO6': '0.400', 'WEAPON7': '0.400', 'AMMO7': '0.400', 'DAMAGECOUNT': '0.705', 'weapon3': '0.978', 'weapon2': '1.356', 'FRAGCOUNT': '2.000'} [2023-02-24 18:19:55,031][177171] DAMAGECOUNT value on done: 85751.0 [2023-02-24 18:19:55,032][177171] Sum rewards: 4.554, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.564', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO3': '0.020', 'AMMO4': '0.021', 'WEAPON1': '0.030', 'weapon7': '0.052', 'weapon5': '0.056', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON3': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.340', 'weapon3': '0.568', 'DAMAGECOUNT': '0.969', 'weapon2': '1.300', 'FRAGCOUNT': '3.000'} [2023-02-24 18:19:55,328][177155] DAMAGECOUNT value on done: 89448.0 [2023-02-24 18:19:55,328][177155] Sum rewards: 8.017, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.012', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'AMMO3': '0.050', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.212', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'HITCOUNT': '0.340', 'HEALTH': '0.370', 'weapon5': '0.386', 'weapon3': '1.098', 'weapon2': '1.940', 'DAMAGECOUNT': '2.292', 'FRAGCOUNT': '5.000'} [2023-02-24 18:19:55,620][177155] DAMAGECOUNT value on done: 93358.0 [2023-02-24 18:19:55,621][177155] Sum rewards: 8.022, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.479', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'AMMO3': '0.145', 'WEAPON5': '0.150', 'weapon5': '0.414', 'HITCOUNT': '0.760', 'WEAPON3': '0.850', 'weapon2': '1.250', 'weapon3': '2.120', 'DAMAGECOUNT': '3.000', 'FRAGCOUNT': '8.000'} [2023-02-24 18:19:55,907][177155] DAMAGECOUNT value on done: 91341.0 [2023-02-24 18:19:55,907][177155] Sum rewards: 14.486, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.350', 'AMMO5': '0.014', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.070', 'AMMO3': '0.091', 'AMMO4': '0.091', 'weapon7': '0.098', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.532', 'WEAPON3': '0.700', 'HITCOUNT': '0.700', 'weapon4': '0.908', 'weapon3': '1.712', 'DAMAGECOUNT': '4.341', 'FRAGCOUNT': '12.000'} [2023-02-24 18:19:56,199][177155] DAMAGECOUNT value on done: 84915.0 [2023-02-24 18:19:56,199][177155] Sum rewards: 7.296, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.116', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO5': '0.028', 'AMMO4': '0.032', 'AMMO3': '0.098', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.264', 'weapon4': '0.394', 'ARMOR': '0.526', 'WEAPON5': '0.550', 'HITCOUNT': '0.570', 'WEAPON3': '0.600', 'weapon2': '1.420', 'weapon3': '1.564', 'DAMAGECOUNT': '2.799', 'FRAGCOUNT': '7.000'} [2023-02-24 18:19:56,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 47865856. Throughput: 0: 3505.6. Samples: 11964540. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:19:56,376][177119] Avg episode reward: [(0, '8.874')] [2023-02-24 18:19:57,266][177153] Updated weights for policy 0, policy_version 11690 (0.0008) [2023-02-24 18:20:00,171][177153] Updated weights for policy 0, policy_version 11700 (0.0008) [2023-02-24 18:20:01,287][177156] DAMAGECOUNT value on done: 86887.0 [2023-02-24 18:20:01,287][177156] Sum rewards: 6.490, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.996', 'AMMO2': '0.013', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'weapon4': '0.044', 'AMMO4': '0.066', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'weapon5': '0.170', 'WEAPON5': '0.400', 'HITCOUNT': '0.760', 'WEAPON3': '0.850', 'weapon2': '0.990', 'weapon3': '2.352', 'DAMAGECOUNT': '3.015', 'FRAGCOUNT': '6.000'} [2023-02-24 18:20:01,376][177119] Fps is (10 sec: 14335.9, 60 sec: 14062.9, 300 sec: 14023.6). Total num frames: 47939584. Throughput: 0: 3512.1. Samples: 11985718. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:20:01,376][177119] Avg episode reward: [(0, '8.850')] [2023-02-24 18:20:01,453][177156] DAMAGECOUNT value on done: 87932.0 [2023-02-24 18:20:01,453][177156] Sum rewards: 7.479, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.354', 'AMMO2': '0.017', 'AMMO5': '0.027', 'WEAPON1': '0.050', 'AMMO4': '0.083', 'weapon4': '0.104', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon5': '0.228', 'WEAPON5': '0.500', 'HITCOUNT': '0.750', 'weapon2': '0.788', 'WEAPON3': '1.050', 'weapon3': '2.338', 'DAMAGECOUNT': '3.030', 'FRAGCOUNT': '10.000'} [2023-02-24 18:20:01,610][177156] DAMAGECOUNT value on done: 88945.0 [2023-02-24 18:20:01,610][177156] Sum rewards: 13.065, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.532', 'AMMO5': '0.010', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'weapon5': '0.106', 'AMMO4': '0.114', 'AMMO3': '0.141', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.692', 'WEAPON3': '0.850', 'HITCOUNT': '0.890', 'weapon2': '1.126', 'weapon3': '1.802', 'DAMAGECOUNT': '3.963', 'FRAGCOUNT': '14.000'} [2023-02-24 18:20:01,757][177156] DAMAGECOUNT value on done: 88469.0 [2023-02-24 18:20:01,757][177156] Sum rewards: 18.013, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.492', 'AMMO2': '0.008', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.042', 'weapon7': '0.058', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.166', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.348', 'WEAPON5': '0.400', 'ARMOR': '0.404', 'HITCOUNT': '0.680', 'WEAPON3': '0.700', 'weapon2': '1.184', 'weapon3': '1.632', 'DAMAGECOUNT': '4.095', 'FRAGCOUNT': '14.000'} [2023-02-24 18:20:03,107][177153] Updated weights for policy 0, policy_version 11710 (0.0008) [2023-02-24 18:20:06,021][177153] Updated weights for policy 0, policy_version 11720 (0.0008) [2023-02-24 18:20:06,376][177119] Fps is (10 sec: 14335.9, 60 sec: 14062.9, 300 sec: 14023.6). Total num frames: 48009216. Throughput: 0: 3512.3. Samples: 11996202. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:20:06,376][177119] Avg episode reward: [(0, '8.938')] [2023-02-24 18:20:07,978][177170] DAMAGECOUNT value on done: 89449.0 [2023-02-24 18:20:07,979][177170] Sum rewards: 3.679, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.708', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.037', 'WEAPON1': '0.040', 'AMMO3': '0.055', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.102', 'AMMO4': '0.184', 'WEAPON4': '0.250', 'HITCOUNT': '0.340', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.880', 'weapon2': '0.992', 'weapon3': '1.196', 'DAMAGECOUNT': '2.076', 'FRAGCOUNT': '3.000'} [2023-02-24 18:20:08,292][177170] DAMAGECOUNT value on done: 81677.0 [2023-02-24 18:20:08,292][177170] Sum rewards: 0.709, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.280', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'ARMOR': '0.020', 'AMMO3': '0.061', 'AMMO4': '0.068', 'weapon5': '0.092', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon7': '0.228', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.370', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'weapon2': '0.754', 'DAMAGECOUNT': '0.789', 'weapon3': '1.058', 'FRAGCOUNT': '2.000'} [2023-02-24 18:20:08,302][177170] DAMAGECOUNT value on done: 92073.0 [2023-02-24 18:20:08,302][177170] Sum rewards: 14.583, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.512', 'AMMO2': '0.011', 'AMMO5': '0.016', 'WEAPON1': '0.050', 'AMMO4': '0.052', 'weapon7': '0.058', 'AMMO3': '0.093', 'weapon5': '0.276', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'WEAPON5': '0.450', 'ARMOR': '0.481', 'WEAPON3': '0.600', 'HITCOUNT': '0.800', 'weapon4': '0.892', 'weapon2': '0.906', 'weapon3': '1.432', 'DAMAGECOUNT': '3.588', 'FRAGCOUNT': '11.000'} [2023-02-24 18:20:08,598][177170] DAMAGECOUNT value on done: 91689.0 [2023-02-24 18:20:08,598][177170] Sum rewards: 7.344, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'AMMO4': '0.071', 'weapon7': '0.106', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.166', 'HEALTH': '0.188', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.250', 'HITCOUNT': '0.380', 'WEAPON7': '0.400', 'weapon4': '0.536', 'weapon3': '1.000', 'DAMAGECOUNT': '1.293', 'weapon2': '1.842', 'FRAGCOUNT': '4.000'} [2023-02-24 18:20:08,942][177153] Updated weights for policy 0, policy_version 11730 (0.0008) [2023-02-24 18:20:09,169][177158] DAMAGECOUNT value on done: 87270.0 [2023-02-24 18:20:09,170][177158] Sum rewards: 9.820, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.011', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon7': '0.026', 'WEAPON1': '0.040', 'weapon5': '0.062', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.155', 'WEAPON5': '0.250', 'weapon4': '0.340', 'WEAPON4': '0.350', 'weapon2': '0.662', 'HITCOUNT': '0.940', 'WEAPON3': '1.000', 'weapon3': '2.276', 'DAMAGECOUNT': '3.519', 'FRAGCOUNT': '13.000'} [2023-02-24 18:20:09,461][177158] DAMAGECOUNT value on done: 84042.0 [2023-02-24 18:20:09,462][177158] Sum rewards: 7.968, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.448', 'AMMO2': '0.029', 'AMMO5': '0.033', 'WEAPON1': '0.050', 'weapon5': '0.124', 'AMMO4': '0.147', 'AMMO3': '0.148', 'WEAPON4': '0.500', 'weapon2': '0.514', 'WEAPON5': '0.600', 'weapon4': '0.732', 'WEAPON3': '1.000', 'HITCOUNT': '1.180', 'weapon3': '2.144', 'DAMAGECOUNT': '4.215', 'FRAGCOUNT': '10.000'} [2023-02-24 18:20:10,190][177158] DAMAGECOUNT value on done: 86480.0 [2023-02-24 18:20:10,191][177158] Sum rewards: -0.877, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.198', 'ARMOR': '0.012', 'AMMO5': '0.025', 'AMMO2': '0.036', 'WEAPON1': '0.050', 'weapon7': '0.100', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.172', 'AMMO4': '0.182', 'WEAPON7': '0.200', 'weapon4': '0.280', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'HITCOUNT': '0.570', 'weapon2': '0.710', 'WEAPON3': '1.100', 'DAMAGECOUNT': '1.938', 'weapon3': '2.138', 'FRAGCOUNT': '6.000'} [2023-02-24 18:20:10,486][177158] DAMAGECOUNT value on done: 91579.0 [2023-02-24 18:20:10,486][177158] Sum rewards: 19.600, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.447', 'AMMO5': '0.015', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO4': '0.089', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.176', 'WEAPON7': '0.200', 'weapon4': '0.310', 'WEAPON5': '0.400', 'ARMOR': '0.474', 'WEAPON3': '0.750', 'weapon2': '1.050', 'HITCOUNT': '1.190', 'weapon3': '2.080', 'DAMAGECOUNT': '5.463', 'FRAGCOUNT': '17.000'} [2023-02-24 18:20:11,343][177172] DAMAGECOUNT value on done: 88212.0 [2023-02-24 18:20:11,343][177172] Sum rewards: 6.760, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.378', 'AMMO2': '0.006', 'AMMO5': '0.026', 'AMMO4': '0.027', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'weapon5': '0.114', 'weapon4': '0.126', 'AMMO3': '0.144', 'WEAPON5': '0.450', 'weapon2': '0.588', 'HITCOUNT': '0.710', 'WEAPON3': '1.050', 'weapon3': '2.730', 'DAMAGECOUNT': '3.027', 'FRAGCOUNT': '9.000'} [2023-02-24 18:20:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14063.0, 300 sec: 14023.6). Total num frames: 48078848. Throughput: 0: 3512.9. Samples: 12017302. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:20:11,376][177119] Avg episode reward: [(0, '8.825')] [2023-02-24 18:20:11,642][177172] DAMAGECOUNT value on done: 87443.0 [2023-02-24 18:20:11,643][177172] Sum rewards: 7.112, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.500', 'AMMO5': '0.014', 'AMMO2': '0.035', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.108', 'AMMO3': '0.114', 'WEAPON4': '0.150', 'AMMO4': '0.177', 'weapon5': '0.190', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.740', 'WEAPON3': '0.750', 'weapon3': '1.368', 'weapon2': '2.064', 'DAMAGECOUNT': '3.312', 'FRAGCOUNT': '6.000'} [2023-02-24 18:20:11,867][177153] Updated weights for policy 0, policy_version 11740 (0.0008) [2023-02-24 18:20:12,101][177154] DAMAGECOUNT value on done: 93479.0 [2023-02-24 18:20:12,102][177154] Sum rewards: 8.108, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.968', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'AMMO4': '0.063', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.100', 'AMMO3': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.284', 'HITCOUNT': '0.600', 'WEAPON3': '0.750', 'weapon2': '1.378', 'weapon3': '1.734', 'DAMAGECOUNT': '2.652', 'FRAGCOUNT': '8.000'} [2023-02-24 18:20:12,397][177154] DAMAGECOUNT value on done: 90523.0 [2023-02-24 18:20:12,397][177154] Sum rewards: 3.757, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.386', 'AMMO5': '0.015', 'AMMO2': '0.023', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO3': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.106', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'WEAPON5': '0.350', 'HITCOUNT': '0.380', 'weapon2': '0.490', 'WEAPON3': '0.500', 'weapon4': '0.886', 'weapon3': '0.972', 'DAMAGECOUNT': '1.440', 'FRAGCOUNT': '5.000'} [2023-02-24 18:20:12,405][177154] DAMAGECOUNT value on done: 90614.0 [2023-02-24 18:20:12,406][177154] Sum rewards: 6.516, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.090', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon7': '0.058', 'WEAPON1': '0.070', 'AMMO3': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.140', 'weapon5': '0.194', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.410', 'weapon4': '0.626', 'WEAPON3': '0.750', 'weapon2': '1.350', 'weapon3': '1.436', 'DAMAGECOUNT': '2.682', 'FRAGCOUNT': '7.000'} [2023-02-24 18:20:12,696][177154] DAMAGECOUNT value on done: 92278.0 [2023-02-24 18:20:12,696][177154] Sum rewards: 9.931, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.872', 'AMMO5': '0.018', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.132', 'weapon5': '0.202', 'weapon4': '0.312', 'weapon2': '0.322', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.840', 'WEAPON3': '0.850', 'weapon3': '2.398', 'DAMAGECOUNT': '3.393', 'FRAGCOUNT': '10.000'} [2023-02-24 18:20:12,797][177172] DAMAGECOUNT value on done: 89066.0 [2023-02-24 18:20:12,798][177172] Sum rewards: 6.828, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.266', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'weapon7': '0.062', 'AMMO3': '0.086', 'AMMO4': '0.099', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.360', 'WEAPON3': '0.500', 'weapon4': '0.786', 'weapon2': '1.274', 'weapon3': '1.274', 'DAMAGECOUNT': '2.505', 'FRAGCOUNT': '7.000'} [2023-02-24 18:20:13,096][177172] DAMAGECOUNT value on done: 87253.0 [2023-02-24 18:20:13,097][177172] Sum rewards: 10.148, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO3': '0.045', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'weapon7': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HEALTH': '0.133', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'weapon5': '0.328', 'HITCOUNT': '0.460', 'weapon4': '0.470', 'weapon3': '0.810', 'weapon2': '0.902', 'DAMAGECOUNT': '2.412', 'FRAGCOUNT': '8.000'} [2023-02-24 18:20:13,355][177157] DAMAGECOUNT value on done: 92166.0 [2023-02-24 18:20:13,356][177157] Sum rewards: 4.081, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.466', 'ARMOR': '0.029', 'WEAPON1': '0.030', 'AMMO5': '0.032', 'AMMO2': '0.048', 'AMMO3': '0.103', 'weapon5': '0.136', 'AMMO4': '0.242', 'weapon4': '0.292', 'HITCOUNT': '0.470', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'weapon2': '1.476', 'weapon3': '1.692', 'DAMAGECOUNT': '2.097', 'FRAGCOUNT': '6.000'} [2023-02-24 18:20:13,367][177157] DAMAGECOUNT value on done: 86970.0 [2023-02-24 18:20:13,368][177157] Sum rewards: 9.032, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.198', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'weapon5': '0.024', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'AMMO3': '0.087', 'weapon4': '0.212', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'weapon7': '0.284', 'WEAPON7': '0.300', 'HITCOUNT': '0.590', 'WEAPON3': '0.600', 'weapon2': '1.250', 'weapon3': '1.708', 'DAMAGECOUNT': '2.367', 'FRAGCOUNT': '7.000'} [2023-02-24 18:20:13,472][177171] DAMAGECOUNT value on done: 90576.0 [2023-02-24 18:20:13,472][177171] Sum rewards: 10.253, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.920', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO5': '0.020', 'AMMO4': '0.071', 'weapon7': '0.076', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.432', 'WEAPON3': '0.750', 'HITCOUNT': '0.890', 'weapon2': '1.292', 'weapon3': '1.754', 'DAMAGECOUNT': '3.702', 'FRAGCOUNT': '10.000'} [2023-02-24 18:20:13,660][177157] DAMAGECOUNT value on done: 87564.0 [2023-02-24 18:20:13,661][177157] Sum rewards: 11.924, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.217', 'AMMO5': '0.019', 'AMMO2': '0.020', 'ARMOR': '0.024', 'WEAPON1': '0.060', 'weapon7': '0.086', 'AMMO3': '0.097', 'AMMO4': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.280', 'weapon4': '0.328', 'WEAPON5': '0.450', 'HITCOUNT': '0.600', 'WEAPON3': '0.650', 'weapon2': '1.010', 'weapon3': '1.706', 'DAMAGECOUNT': '3.273', 'FRAGCOUNT': '12.000'} [2023-02-24 18:20:13,671][177157] DAMAGECOUNT value on done: 85739.0 [2023-02-24 18:20:13,671][177157] Sum rewards: -1.055, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.042', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'weapon7': '0.028', 'AMMO4': '0.096', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'weapon5': '0.236', 'weapon4': '0.392', 'HITCOUNT': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'weapon2': '0.804', 'DAMAGECOUNT': '1.635', 'weapon3': '1.948', 'FRAGCOUNT': '3.000'} [2023-02-24 18:20:13,777][177171] DAMAGECOUNT value on done: 89952.0 [2023-02-24 18:20:13,777][177171] Sum rewards: 7.742, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.337', 'AMMO5': '0.017', 'AMMO2': '0.038', 'WEAPON1': '0.050', 'ARMOR': '0.060', 'AMMO3': '0.083', 'weapon5': '0.146', 'AMMO4': '0.189', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.580', 'HITCOUNT': '0.630', 'WEAPON3': '0.650', 'weapon3': '1.388', 'weapon2': '1.436', 'DAMAGECOUNT': '2.712', 'FRAGCOUNT': '8.000'} [2023-02-24 18:20:13,882][177171] DAMAGECOUNT value on done: 86939.0 [2023-02-24 18:20:13,882][177171] Sum rewards: 13.070, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.337', 'AMMO2': '0.009', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'weapon5': '0.074', 'weapon7': '0.082', 'AMMO3': '0.093', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon4': '0.308', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.930', 'weapon2': '1.216', 'weapon3': '1.858', 'DAMAGECOUNT': '3.807', 'FRAGCOUNT': '10.000'} [2023-02-24 18:20:14,180][177171] DAMAGECOUNT value on done: 86046.0 [2023-02-24 18:20:14,180][177171] Sum rewards: 4.568, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.160', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.016', 'WEAPON1': '0.020', 'weapon7': '0.054', 'AMMO3': '0.063', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.220', 'weapon5': '0.250', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.885', 'weapon3': '1.244', 'FRAGCOUNT': '2.000', 'weapon2': '2.028'} [2023-02-24 18:20:14,519][177155] DAMAGECOUNT value on done: 89821.0 [2023-02-24 18:20:14,519][177155] Sum rewards: 5.481, reward structure: {'DEATHCOUNT': '-1.500', 'AMMO2': '0.005', 'AMMO3': '0.020', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'weapon7': '0.102', 'WEAPON3': '0.150', 'HEALTH': '0.160', 'HITCOUNT': '0.180', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.382', 'weapon3': '0.432', 'DAMAGECOUNT': '1.119', 'weapon2': '1.616', 'FRAGCOUNT': '2.000'} [2023-02-24 18:20:14,806][177153] Updated weights for policy 0, policy_version 11750 (0.0008) [2023-02-24 18:20:14,815][177155] DAMAGECOUNT value on done: 94580.0 [2023-02-24 18:20:14,815][177155] Sum rewards: 10.094, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.530', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'AMMO3': '0.092', 'weapon7': '0.098', 'AMMO4': '0.134', 'weapon5': '0.152', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.584', 'WEAPON3': '0.600', 'HITCOUNT': '0.880', 'weapon2': '0.978', 'weapon3': '1.572', 'DAMAGECOUNT': '3.666', 'FRAGCOUNT': '9.000'} [2023-02-24 18:20:15,107][177155] DAMAGECOUNT value on done: 92505.0 [2023-02-24 18:20:15,108][177155] Sum rewards: 12.510, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.639', 'AMMO2': '0.009', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.045', 'weapon7': '0.092', 'weapon5': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.158', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.360', 'ARMOR': '0.492', 'HITCOUNT': '0.880', 'WEAPON3': '0.900', 'weapon2': '0.922', 'weapon3': '2.152', 'DAMAGECOUNT': '3.492', 'FRAGCOUNT': '13.000'} [2023-02-24 18:20:15,408][177155] DAMAGECOUNT value on done: 86068.0 [2023-02-24 18:20:15,408][177155] Sum rewards: 10.029, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.838', 'AMMO5': '0.019', 'WEAPON1': '0.040', 'AMMO2': '0.043', 'AMMO3': '0.086', 'AMMO4': '0.217', 'weapon5': '0.236', 'ARMOR': '0.408', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'HITCOUNT': '0.550', 'WEAPON3': '0.600', 'weapon4': '0.936', 'weapon2': '0.986', 'weapon3': '1.336', 'DAMAGECOUNT': '3.459', 'FRAGCOUNT': '10.000'} [2023-02-24 18:20:16,376][177119] Fps is (10 sec: 13926.6, 60 sec: 14063.0, 300 sec: 14023.6). Total num frames: 48148480. Throughput: 0: 3515.0. Samples: 12038342. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:20:16,376][177119] Avg episode reward: [(0, '8.378')] [2023-02-24 18:20:17,702][177153] Updated weights for policy 0, policy_version 11760 (0.0008) [2023-02-24 18:20:20,392][177156] DAMAGECOUNT value on done: 87495.0 [2023-02-24 18:20:20,393][177156] Sum rewards: 0.667, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.015', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.025', 'WEAPON1': '0.040', 'AMMO3': '0.118', 'weapon5': '0.234', 'WEAPON5': '0.300', 'HITCOUNT': '0.370', 'WEAPON3': '0.700', 'weapon2': '0.864', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.824', 'weapon3': '2.206'} [2023-02-24 18:20:20,589][177156] DAMAGECOUNT value on done: 88767.0 [2023-02-24 18:20:20,589][177156] Sum rewards: 1.322, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.930', 'AMMO2': '0.013', 'ARMOR': '0.028', 'AMMO5': '0.030', 'WEAPON1': '0.050', 'AMMO4': '0.063', 'weapon5': '0.072', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.272', 'weapon4': '0.350', 'WEAPON5': '0.550', 'HITCOUNT': '0.710', 'WEAPON3': '1.150', 'DAMAGECOUNT': '2.505', 'weapon3': '2.808', 'FRAGCOUNT': '4.500'} [2023-02-24 18:20:20,641][177153] Updated weights for policy 0, policy_version 11770 (0.0009) [2023-02-24 18:20:20,695][177156] DAMAGECOUNT value on done: 89317.0 [2023-02-24 18:20:20,695][177156] Sum rewards: 3.524, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.225', 'ARMOR': '0.004', 'weapon5': '0.008', 'AMMO2': '0.008', 'AMMO5': '0.013', 'AMMO4': '0.040', 'AMMO3': '0.048', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon7': '0.210', 'HITCOUNT': '0.230', 'WEAPON3': '0.350', 'AMMO6': '0.360', 'AMMO7': '0.360', 'WEAPON7': '0.600', 'weapon4': '0.724', 'weapon3': '0.800', 'DAMAGECOUNT': '1.116', 'weapon2': '1.728', 'FRAGCOUNT': '3.000'} [2023-02-24 18:20:20,909][177156] DAMAGECOUNT value on done: 89166.0 [2023-02-24 18:20:20,909][177156] Sum rewards: 11.445, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.363', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'WEAPON5': '0.050', 'AMMO3': '0.055', 'weapon5': '0.102', 'WEAPON4': '0.200', 'weapon7': '0.308', 'AMMO6': '0.360', 'AMMO7': '0.360', 'WEAPON3': '0.400', 'WEAPON7': '0.600', 'HITCOUNT': '0.600', 'weapon2': '0.624', 'weapon4': '0.662', 'weapon3': '1.364', 'DAMAGECOUNT': '2.091', 'FRAGCOUNT': '7.000'} [2023-02-24 18:20:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.6, 300 sec: 14023.6). Total num frames: 48218112. Throughput: 0: 3516.7. Samples: 12048898. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:20:21,376][177119] Avg episode reward: [(0, '8.115')] [2023-02-24 18:20:23,573][177153] Updated weights for policy 0, policy_version 11780 (0.0008) [2023-02-24 18:20:26,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 48287744. Throughput: 0: 3513.2. Samples: 12069920. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:20:26,376][177119] Avg episode reward: [(0, '8.115')] [2023-02-24 18:20:26,475][177153] Updated weights for policy 0, policy_version 11790 (0.0008) [2023-02-24 18:20:27,102][177156] Large shaping reward 2.577 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.045, -15.0), ('weapon5', 0.002)] [2023-02-24 18:20:27,192][177170] DAMAGECOUNT value on done: 90878.0 [2023-02-24 18:20:27,192][177170] Sum rewards: 15.245, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.812', 'AMMO5': '0.017', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'weapon7': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.131', 'weapon4': '0.220', 'weapon5': '0.380', 'WEAPON5': '0.450', 'HITCOUNT': '0.770', 'WEAPON3': '0.800', 'weapon2': '0.912', 'weapon3': '1.716', 'DAMAGECOUNT': '4.287', 'FRAGCOUNT': '14.000'} [2023-02-24 18:20:27,480][177170] DAMAGECOUNT value on done: 82986.0 [2023-02-24 18:20:27,480][177170] Sum rewards: 13.281, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.564', 'AMMO5': '0.012', 'AMMO2': '0.031', 'WEAPON1': '0.040', 'AMMO3': '0.048', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.156', 'WEAPON4': '0.200', 'WEAPON3': '0.300', 'WEAPON5': '0.350', 'weapon5': '0.352', 'ARMOR': '0.453', 'HITCOUNT': '0.530', 'weapon4': '0.596', 'weapon3': '0.910', 'weapon2': '1.338', 'DAMAGECOUNT': '3.927', 'FRAGCOUNT': '11.000'} [2023-02-24 18:20:27,489][177170] DAMAGECOUNT value on done: 92746.0 [2023-02-24 18:20:27,489][177170] Sum rewards: 2.845, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.866', 'AMMO5': '0.020', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.115', 'WEAPON4': '0.250', 'weapon5': '0.268', 'weapon4': '0.404', 'HITCOUNT': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'weapon2': '1.108', 'weapon3': '1.588', 'DAMAGECOUNT': '2.019', 'FRAGCOUNT': '5.000'} [2023-02-24 18:20:27,780][177170] DAMAGECOUNT value on done: 92466.0 [2023-02-24 18:20:27,780][177170] Sum rewards: 5.882, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.741', 'AMMO2': '0.015', 'AMMO5': '0.026', 'WEAPON1': '0.070', 'AMMO4': '0.075', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'weapon4': '0.198', 'weapon5': '0.332', 'WEAPON5': '0.500', 'HITCOUNT': '0.520', 'WEAPON3': '0.750', 'weapon2': '0.884', 'weapon3': '1.896', 'DAMAGECOUNT': '2.331', 'FRAGCOUNT': '7.000'} [2023-02-24 18:20:28,225][177172] Large shaping reward 2.529 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.507, 169.0), ('weapon7', 0.002)] [2023-02-24 18:20:28,316][177158] DAMAGECOUNT value on done: 88512.0 [2023-02-24 18:20:28,317][177158] Sum rewards: 10.504, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.112', 'AMMO2': '0.009', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.043', 'AMMO3': '0.133', 'weapon5': '0.298', 'WEAPON5': '0.400', 'weapon2': '0.608', 'HITCOUNT': '0.870', 'WEAPON3': '1.000', 'weapon3': '2.474', 'DAMAGECOUNT': '3.726', 'FRAGCOUNT': '12.000'} [2023-02-24 18:20:28,617][177158] DAMAGECOUNT value on done: 85017.0 [2023-02-24 18:20:28,618][177158] Sum rewards: 6.178, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-3.037', 'AMMO5': '0.017', 'ARMOR': '0.024', 'WEAPON1': '0.040', 'AMMO2': '0.060', 'AMMO3': '0.112', 'weapon5': '0.296', 'AMMO4': '0.299', 'WEAPON5': '0.550', 'HITCOUNT': '0.590', 'WEAPON4': '0.650', 'weapon2': '0.654', 'weapon4': '0.704', 'WEAPON3': '0.850', 'weapon3': '1.694', 'DAMAGECOUNT': '2.925', 'FRAGCOUNT': '8.000'} [2023-02-24 18:20:29,274][177158] DAMAGECOUNT value on done: 87129.0 [2023-02-24 18:20:29,274][177158] Sum rewards: 7.605, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.615', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.018', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'weapon7': '0.052', 'WEAPON4': '0.100', 'weapon5': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.396', 'HITCOUNT': '0.400', 'WEAPON3': '0.400', 'weapon2': '0.676', 'weapon3': '1.148', 'DAMAGECOUNT': '1.947', 'FRAGCOUNT': '6.000'} [2023-02-24 18:20:29,406][177153] Updated weights for policy 0, policy_version 11800 (0.0008) [2023-02-24 18:20:29,573][177158] DAMAGECOUNT value on done: 92596.0 [2023-02-24 18:20:29,573][177158] Sum rewards: 10.353, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.691', 'AMMO2': '0.017', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'weapon5': '0.160', 'weapon7': '0.192', 'AMMO6': '0.320', 'AMMO7': '0.320', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'weapon4': '0.408', 'WEAPON5': '0.450', 'HITCOUNT': '0.530', 'WEAPON3': '0.700', 'weapon3': '1.158', 'weapon2': '1.848', 'DAMAGECOUNT': '3.051', 'FRAGCOUNT': '10.000'} [2023-02-24 18:20:30,426][177172] DAMAGECOUNT value on done: 90159.0 [2023-02-24 18:20:30,426][177172] Sum rewards: 8.113, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.121', 'AMMO5': '0.014', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'weapon7': '0.118', 'AMMO3': '0.121', 'AMMO4': '0.135', 'weapon4': '0.196', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'weapon5': '0.262', 'WEAPON5': '0.300', 'WEAPON7': '0.400', 'ARMOR': '0.465', 'weapon2': '0.766', 'HITCOUNT': '0.780', 'WEAPON3': '0.850', 'weapon3': '1.998', 'DAMAGECOUNT': '4.041', 'FRAGCOUNT': '9.500'} [2023-02-24 18:20:30,721][177172] DAMAGECOUNT value on done: 88966.0 [2023-02-24 18:20:30,722][177172] Sum rewards: 14.151, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.830', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'AMMO4': '0.124', 'weapon5': '0.128', 'weapon7': '0.128', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.438', 'weapon2': '0.834', 'WEAPON3': '0.950', 'HITCOUNT': '0.950', 'weapon3': '2.076', 'DAMAGECOUNT': '4.569', 'FRAGCOUNT': '14.000'} [2023-02-24 18:20:30,938][177155] Large shaping reward 2.578 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.546, 182.0), ('weapon7', 0.002)] [2023-02-24 18:20:31,338][177154] DAMAGECOUNT value on done: 94219.0 [2023-02-24 18:20:31,338][177154] Sum rewards: 1.922, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.468', 'AMMO5': '0.017', 'AMMO2': '0.028', 'WEAPON1': '0.050', 'weapon7': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.122', 'AMMO4': '0.140', 'weapon5': '0.190', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'HITCOUNT': '0.480', 'weapon4': '0.730', 'WEAPON3': '0.750', 'ARMOR': '0.808', 'weapon2': '1.164', 'weapon3': '1.380', 'DAMAGECOUNT': '2.220', 'FRAGCOUNT': '6.000'} [2023-02-24 18:20:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 48357376. Throughput: 0: 3513.2. Samples: 12091020. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:20:31,376][177119] Avg episode reward: [(0, '8.251')] [2023-02-24 18:20:31,629][177154] DAMAGECOUNT value on done: 91218.0 [2023-02-24 18:20:31,629][177154] Sum rewards: 7.234, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.078', 'ARMOR': '0.004', 'AMMO2': '0.016', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'AMMO3': '0.066', 'AMMO4': '0.081', 'weapon7': '0.138', 'weapon4': '0.144', 'WEAPON4': '0.200', 'weapon5': '0.218', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON5': '0.350', 'HITCOUNT': '0.410', 'WEAPON3': '0.500', 'WEAPON7': '0.500', 'weapon2': '1.246', 'weapon3': '1.616', 'DAMAGECOUNT': '2.085', 'FRAGCOUNT': '6.000'} [2023-02-24 18:20:31,638][177154] DAMAGECOUNT value on done: 91703.0 [2023-02-24 18:20:31,639][177154] Sum rewards: 9.498, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.566', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'AMMO3': '0.127', 'AMMO4': '0.141', 'weapon7': '0.142', 'weapon5': '0.164', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'weapon4': '0.368', 'WEAPON5': '0.450', 'HITCOUNT': '0.580', 'WEAPON3': '0.750', 'weapon2': '1.294', 'weapon3': '1.696', 'DAMAGECOUNT': '3.267', 'FRAGCOUNT': '9.000'} [2023-02-24 18:20:31,887][177172] DAMAGECOUNT value on done: 89531.0 [2023-02-24 18:20:31,887][177172] Sum rewards: 6.294, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'HEALTH': '0.033', 'AMMO3': '0.050', 'weapon7': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.254', 'HITCOUNT': '0.310', 'WEAPON3': '0.350', 'weapon3': '1.094', 'DAMAGECOUNT': '1.395', 'weapon2': '2.080', 'FRAGCOUNT': '3.000'} [2023-02-24 18:20:31,936][177154] DAMAGECOUNT value on done: 94131.0 [2023-02-24 18:20:31,937][177154] Sum rewards: 19.029, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.785', 'weapon7': '0.014', 'AMMO5': '0.021', 'AMMO2': '0.025', 'WEAPON1': '0.050', 'AMMO3': '0.124', 'AMMO4': '0.127', 'weapon4': '0.144', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.286', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon2': '0.990', 'HITCOUNT': '1.140', 'weapon3': '2.056', 'DAMAGECOUNT': '5.037', 'FRAGCOUNT': '16.000'} [2023-02-24 18:20:32,184][177172] DAMAGECOUNT value on done: 88349.0 [2023-02-24 18:20:32,184][177172] Sum rewards: 5.504, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.174', 'ARMOR': '0.012', 'weapon7': '0.016', 'AMMO2': '0.016', 'AMMO5': '0.018', 'weapon5': '0.058', 'WEAPON1': '0.070', 'AMMO4': '0.081', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.480', 'HITCOUNT': '0.950', 'WEAPON3': '1.000', 'weapon2': '1.010', 'weapon3': '1.930', 'DAMAGECOUNT': '3.288', 'FRAGCOUNT': '6.500'} [2023-02-24 18:20:32,302][177153] Updated weights for policy 0, policy_version 11810 (0.0008) [2023-02-24 18:20:32,466][177157] DAMAGECOUNT value on done: 92813.0 [2023-02-24 18:20:32,467][177157] Sum rewards: 2.451, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.315', 'AMMO2': '0.013', 'AMMO5': '0.019', 'weapon4': '0.032', 'WEAPON1': '0.040', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'AMMO3': '0.146', 'weapon5': '0.212', 'WEAPON5': '0.450', 'HITCOUNT': '0.490', 'weapon2': '0.796', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.941', 'weapon3': '2.210', 'FRAGCOUNT': '6.000'} [2023-02-24 18:20:32,477][177157] DAMAGECOUNT value on done: 88388.0 [2023-02-24 18:20:32,477][177157] Sum rewards: 9.300, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.225', 'ARMOR': '0.004', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.056', 'weapon7': '0.070', 'AMMO3': '0.093', 'weapon5': '0.146', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'AMMO6': '0.520', 'AMMO7': '0.520', 'WEAPON3': '0.550', 'weapon4': '0.576', 'WEAPON7': '0.600', 'HITCOUNT': '0.780', 'weapon2': '1.202', 'weapon3': '1.360', 'DAMAGECOUNT': '4.254', 'FRAGCOUNT': '9.000'} [2023-02-24 18:20:32,505][177171] DAMAGECOUNT value on done: 91626.0 [2023-02-24 18:20:32,505][177171] Sum rewards: 6.296, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.650', 'ARMOR': '0.008', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'AMMO5': '0.032', 'weapon5': '0.104', 'AMMO3': '0.111', 'AMMO4': '0.135', 'WEAPON4': '0.450', 'weapon2': '0.470', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'HITCOUNT': '0.650', 'weapon4': '0.948', 'weapon3': '1.932', 'DAMAGECOUNT': '3.150', 'FRAGCOUNT': '7.500'} [2023-02-24 18:20:32,772][177157] DAMAGECOUNT value on done: 88049.0 [2023-02-24 18:20:32,773][177157] Sum rewards: 1.556, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.132', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'ARMOR': '0.026', 'AMMO2': '0.038', 'weapon5': '0.082', 'AMMO3': '0.089', 'weapon7': '0.118', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.310', 'WEAPON4': '0.350', 'WEAPON3': '0.600', 'weapon4': '0.696', 'weapon2': '0.992', 'weapon3': '1.164', 'DAMAGECOUNT': '1.320', 'FRAGCOUNT': '4.000'} [2023-02-24 18:20:32,783][177157] DAMAGECOUNT value on done: 87049.0 [2023-02-24 18:20:32,784][177157] Sum rewards: 14.849, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.104', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.021', 'WEAPON1': '0.050', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'weapon5': '0.146', 'WEAPON5': '0.350', 'weapon4': '0.544', 'WEAPON3': '0.600', 'HITCOUNT': '1.000', 'weapon2': '1.254', 'weapon3': '1.738', 'DAMAGECOUNT': '3.930', 'FRAGCOUNT': '11.000'} [2023-02-24 18:20:32,799][177171] DAMAGECOUNT value on done: 90521.0 [2023-02-24 18:20:32,799][177171] Sum rewards: 1.417, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.400', 'AMMO5': '0.021', 'ARMOR': '0.028', 'AMMO2': '0.034', 'WEAPON1': '0.060', 'weapon7': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.122', 'AMMO4': '0.170', 'WEAPON4': '0.200', 'weapon5': '0.252', 'HITCOUNT': '0.410', 'weapon4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'weapon2': '0.828', 'weapon3': '1.622', 'DAMAGECOUNT': '1.707', 'FRAGCOUNT': '5.000'} [2023-02-24 18:20:33,026][177171] DAMAGECOUNT value on done: 87703.0 [2023-02-24 18:20:33,027][177171] Sum rewards: 8.034, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.312', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.021', 'weapon7': '0.052', 'AMMO3': '0.061', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.252', 'weapon4': '0.278', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '0.600', 'weapon2': '0.918', 'weapon3': '1.762', 'DAMAGECOUNT': '2.292', 'FRAGCOUNT': '6.000'} [2023-02-24 18:20:33,314][177171] DAMAGECOUNT value on done: 86685.0 [2023-02-24 18:20:33,315][177171] Sum rewards: 8.578, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.840', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.007', 'WEAPON1': '0.050', 'AMMO3': '0.055', 'WEAPON4': '0.100', 'weapon5': '0.102', 'weapon7': '0.102', 'WEAPON5': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.292', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'weapon3': '1.188', 'weapon2': '1.546', 'DAMAGECOUNT': '1.917', 'FRAGCOUNT': '6.000'} [2023-02-24 18:20:33,614][177155] DAMAGECOUNT value on done: 91070.0 [2023-02-24 18:20:33,614][177155] Sum rewards: 9.825, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.145', 'AMMO2': '0.012', 'AMMO5': '0.029', 'AMMO4': '0.058', 'WEAPON1': '0.060', 'weapon7': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.152', 'weapon4': '0.188', 'WEAPON7': '0.200', 'WEAPON5': '0.550', 'HITCOUNT': '0.840', 'weapon2': '0.892', 'WEAPON3': '1.050', 'weapon3': '2.434', 'DAMAGECOUNT': '3.747', 'FRAGCOUNT': '11.000'} [2023-02-24 18:20:33,913][177155] DAMAGECOUNT value on done: 95617.0 [2023-02-24 18:20:33,914][177155] Sum rewards: 14.646, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.034', 'weapon7': '0.052', 'AMMO3': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.128', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'weapon4': '0.530', 'weapon2': '0.594', 'HEALTH': '0.669', 'HITCOUNT': '0.700', 'weapon3': '1.884', 'DAMAGECOUNT': '3.111', 'FRAGCOUNT': '11.000'} [2023-02-24 18:20:34,199][177155] DAMAGECOUNT value on done: 93234.0 [2023-02-24 18:20:34,200][177155] Sum rewards: 5.821, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.460', 'AMMO2': '0.014', 'AMMO5': '0.017', 'WEAPON1': '0.060', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'weapon7': '0.100', 'AMMO3': '0.137', 'weapon5': '0.158', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.386', 'HITCOUNT': '0.640', 'WEAPON3': '0.800', 'weapon2': '0.860', 'weapon3': '2.050', 'DAMAGECOUNT': '2.187', 'FRAGCOUNT': '6.000'} [2023-02-24 18:20:34,511][177155] DAMAGECOUNT value on done: 86750.0 [2023-02-24 18:20:34,511][177155] Sum rewards: 6.947, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.442', 'AMMO5': '0.010', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'AMMO3': '0.080', 'AMMO4': '0.102', 'weapon5': '0.134', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon7': '0.234', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'ARMOR': '0.404', 'WEAPON3': '0.450', 'weapon2': '0.564', 'HITCOUNT': '0.590', 'weapon4': '0.734', 'weapon3': '1.550', 'DAMAGECOUNT': '2.046', 'FRAGCOUNT': '4.500'} [2023-02-24 18:20:35,219][177153] Updated weights for policy 0, policy_version 11820 (0.0008) [2023-02-24 18:20:36,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 48427008. Throughput: 0: 3511.5. Samples: 12101508. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:20:36,376][177119] Avg episode reward: [(0, '8.032')] [2023-02-24 18:20:38,148][177153] Updated weights for policy 0, policy_version 11830 (0.0008) [2023-02-24 18:20:39,600][177156] DAMAGECOUNT value on done: 88866.0 [2023-02-24 18:20:39,600][177156] Sum rewards: 8.284, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.879', 'AMMO5': '0.010', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'AMMO4': '0.103', 'AMMO3': '0.107', 'weapon5': '0.118', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '0.750', 'weapon4': '0.790', 'HITCOUNT': '0.900', 'weapon2': '1.198', 'weapon3': '1.568', 'DAMAGECOUNT': '4.008', 'FRAGCOUNT': '9.000'} [2023-02-24 18:20:39,805][177156] DAMAGECOUNT value on done: 89875.0 [2023-02-24 18:20:39,805][177156] Sum rewards: 11.549, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.950', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.030', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'weapon7': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.128', 'weapon5': '0.144', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.600', 'HITCOUNT': '0.650', 'weapon3': '1.620', 'weapon2': '1.790', 'DAMAGECOUNT': '3.324', 'FRAGCOUNT': '10.000'} [2023-02-24 18:20:39,903][177156] DAMAGECOUNT value on done: 90643.0 [2023-02-24 18:20:39,904][177156] Sum rewards: 8.724, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.162', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO5': '0.029', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'weapon4': '0.052', 'AMMO3': '0.132', 'weapon5': '0.192', 'WEAPON5': '0.550', 'HITCOUNT': '0.810', 'WEAPON3': '0.900', 'weapon2': '1.350', 'weapon3': '2.000', 'DAMAGECOUNT': '3.978', 'FRAGCOUNT': '9.500'} [2023-02-24 18:20:40,112][177156] DAMAGECOUNT value on done: 89567.0 [2023-02-24 18:20:40,112][177156] Sum rewards: 3.961, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.122', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO3': '0.080', 'weapon5': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.220', 'WEAPON3': '0.500', 'weapon2': '0.558', 'weapon4': '0.634', 'weapon3': '1.124', 'DAMAGECOUNT': '1.203', 'FRAGCOUNT': '4.000'} [2023-02-24 18:20:41,071][177153] Updated weights for policy 0, policy_version 11840 (0.0008) [2023-02-24 18:20:41,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14062.9, 300 sec: 14023.6). Total num frames: 48500736. Throughput: 0: 3510.0. Samples: 12122492. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:20:41,376][177119] Avg episode reward: [(0, '7.977')] [2023-02-24 18:20:43,988][177153] Updated weights for policy 0, policy_version 11850 (0.0008) [2023-02-24 18:20:46,323][177170] DAMAGECOUNT value on done: 92198.0 [2023-02-24 18:20:46,324][177170] Sum rewards: 4.037, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.943', 'weapon7': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'AMMO4': '0.090', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.142', 'WEAPON4': '0.150', 'weapon4': '0.168', 'AMMO3': '0.180', 'WEAPON5': '0.250', 'HITCOUNT': '0.930', 'WEAPON3': '1.050', 'weapon2': '1.350', 'weapon3': '2.102', 'DAMAGECOUNT': '3.960', 'FRAGCOUNT': '9.000'} [2023-02-24 18:20:46,376][177119] Fps is (10 sec: 14336.0, 60 sec: 14062.9, 300 sec: 14023.6). Total num frames: 48570368. Throughput: 0: 3505.5. Samples: 12143464. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:20:46,376][177119] Avg episode reward: [(0, '7.927')] [2023-02-24 18:20:46,611][177170] DAMAGECOUNT value on done: 84043.0 [2023-02-24 18:20:46,612][177170] Sum rewards: 6.607, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.452', 'AMMO5': '0.012', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'weapon7': '0.050', 'weapon5': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'AMMO4': '0.103', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.398', 'WEAPON3': '0.600', 'HITCOUNT': '0.630', 'weapon2': '1.040', 'weapon3': '1.544', 'DAMAGECOUNT': '3.171', 'FRAGCOUNT': '7.000'} [2023-02-24 18:20:46,632][177170] DAMAGECOUNT value on done: 93753.0 [2023-02-24 18:20:46,632][177170] Sum rewards: 4.376, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.994', 'AMMO5': '0.018', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'weapon5': '0.060', 'AMMO4': '0.104', 'AMMO3': '0.142', 'weapon7': '0.194', 'weapon4': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'AMMO6': '0.480', 'AMMO7': '0.480', 'WEAPON7': '0.600', 'HITCOUNT': '0.840', 'WEAPON3': '1.000', 'weapon2': '1.516', 'weapon3': '1.686', 'DAMAGECOUNT': '3.021', 'FRAGCOUNT': '9.000'} [2023-02-24 18:20:46,934][177153] Updated weights for policy 0, policy_version 11860 (0.0009) [2023-02-24 18:20:46,934][177170] DAMAGECOUNT value on done: 93239.0 [2023-02-24 18:20:46,934][177170] Sum rewards: 5.340, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.940', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.050', 'WEAPON1': '0.060', 'weapon7': '0.090', 'AMMO3': '0.094', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'AMMO4': '0.250', 'weapon5': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'HITCOUNT': '0.440', 'weapon4': '0.552', 'WEAPON3': '0.600', 'weapon2': '0.740', 'weapon3': '1.734', 'DAMAGECOUNT': '2.319', 'FRAGCOUNT': '4.500'} [2023-02-24 18:20:47,578][177158] DAMAGECOUNT value on done: 89767.0 [2023-02-24 18:20:47,579][177158] Sum rewards: 11.926, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.562', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.007', 'ARMOR': '0.029', 'WEAPON1': '0.040', 'weapon5': '0.092', 'AMMO3': '0.135', 'WEAPON5': '0.200', 'WEAPON3': '0.850', 'HITCOUNT': '0.920', 'weapon2': '1.534', 'weapon3': '2.164', 'DAMAGECOUNT': '3.765', 'FRAGCOUNT': '11.000'} [2023-02-24 18:20:47,875][177158] DAMAGECOUNT value on done: 86754.0 [2023-02-24 18:20:47,875][177158] Sum rewards: 14.649, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.101', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.014', 'WEAPON1': '0.050', 'AMMO3': '0.120', 'weapon5': '0.184', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '0.960', 'weapon2': '1.170', 'weapon3': '2.198', 'DAMAGECOUNT': '5.211', 'FRAGCOUNT': '12.500'} [2023-02-24 18:20:48,517][177158] DAMAGECOUNT value on done: 88435.0 [2023-02-24 18:20:48,518][177158] Sum rewards: 10.923, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.458', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO3': '0.143', 'weapon5': '0.206', 'WEAPON5': '0.450', 'HITCOUNT': '0.820', 'WEAPON3': '0.900', 'weapon2': '1.228', 'weapon3': '2.182', 'DAMAGECOUNT': '3.918', 'FRAGCOUNT': '10.000'} [2023-02-24 18:20:48,819][177158] DAMAGECOUNT value on done: 93497.0 [2023-02-24 18:20:48,819][177158] Sum rewards: 7.239, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.008', 'AMMO5': '0.005', 'ARMOR': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.037', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.108', 'WEAPON5': '0.150', 'weapon5': '0.172', 'AMMO4': '0.187', 'WEAPON4': '0.200', 'weapon2': '0.660', 'WEAPON3': '0.700', 'HITCOUNT': '0.730', 'weapon4': '0.992', 'weapon3': '1.682', 'DAMAGECOUNT': '2.703', 'FRAGCOUNT': '7.000'} [2023-02-24 18:20:49,636][177172] DAMAGECOUNT value on done: 91124.0 [2023-02-24 18:20:49,636][177172] Sum rewards: 8.296, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.599', 'AMMO2': '0.010', 'AMMO5': '0.025', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'weapon4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.118', 'weapon5': '0.316', 'WEAPON5': '0.550', 'HITCOUNT': '0.750', 'WEAPON3': '0.850', 'weapon2': '1.114', 'weapon3': '2.058', 'DAMAGECOUNT': '2.895', 'FRAGCOUNT': '10.000'} [2023-02-24 18:20:49,823][177153] Updated weights for policy 0, policy_version 11870 (0.0008) [2023-02-24 18:20:49,931][177172] DAMAGECOUNT value on done: 89595.0 [2023-02-24 18:20:49,932][177172] Sum rewards: 5.784, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON1': '0.010', 'HEALTH': '0.012', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon7': '0.128', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.250', 'weapon4': '0.368', 'HITCOUNT': '0.390', 'WEAPON7': '0.400', 'weapon3': '0.872', 'weapon2': '1.276', 'DAMAGECOUNT': '1.887', 'FRAGCOUNT': '4.000'} [2023-02-24 18:20:50,475][177154] DAMAGECOUNT value on done: 94947.0 [2023-02-24 18:20:50,476][177154] Sum rewards: 3.835, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.096', 'ARMOR': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.038', 'AMMO3': '0.059', 'weapon7': '0.060', 'weapon5': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'WEAPON3': '0.350', 'HITCOUNT': '0.440', 'weapon4': '0.692', 'weapon3': '1.118', 'weapon2': '1.322', 'DAMAGECOUNT': '2.184', 'FRAGCOUNT': '4.000'} [2023-02-24 18:20:50,772][177154] DAMAGECOUNT value on done: 92093.0 [2023-02-24 18:20:50,772][177154] Sum rewards: 11.275, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.874', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'weapon7': '0.052', 'AMMO3': '0.058', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.204', 'WEAPON5': '0.300', 'HITCOUNT': '0.430', 'WEAPON3': '0.450', 'weapon4': '0.464', 'weapon2': '0.720', 'weapon3': '1.164', 'DAMAGECOUNT': '2.625', 'FRAGCOUNT': '8.000'} [2023-02-24 18:20:50,781][177154] DAMAGECOUNT value on done: 92647.0 [2023-02-24 18:20:50,782][177154] Sum rewards: 8.208, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO2': '0.010', 'ARMOR': '0.024', 'AMMO5': '0.025', 'WEAPON1': '0.040', 'AMMO4': '0.051', 'weapon4': '0.074', 'weapon5': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon7': '0.120', 'HEALTH': '0.170', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'HITCOUNT': '0.710', 'weapon2': '1.372', 'weapon3': '2.046', 'DAMAGECOUNT': '2.832', 'FRAGCOUNT': '9.000'} [2023-02-24 18:20:51,087][177154] DAMAGECOUNT value on done: 95315.0 [2023-02-24 18:20:51,087][177154] Sum rewards: 8.577, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.046', 'AMMO5': '0.017', 'AMMO2': '0.019', 'weapon4': '0.064', 'WEAPON1': '0.070', 'AMMO4': '0.093', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'weapon5': '0.222', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'HITCOUNT': '0.950', 'weapon2': '1.420', 'weapon3': '1.976', 'DAMAGECOUNT': '3.552', 'FRAGCOUNT': '11.000'} [2023-02-24 18:20:51,123][177172] DAMAGECOUNT value on done: 91189.0 [2023-02-24 18:20:51,124][177172] Sum rewards: 16.870, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.039', 'AMMO2': '0.005', 'AMMO5': '0.015', 'AMMO4': '0.024', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon4': '0.134', 'weapon5': '0.244', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.940', 'weapon2': '1.184', 'weapon3': '2.042', 'DAMAGECOUNT': '4.974', 'FRAGCOUNT': '12.500'} [2023-02-24 18:20:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 14023.6). Total num frames: 48640000. Throughput: 0: 3507.1. Samples: 12154020. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:20:51,376][177119] Avg episode reward: [(0, '8.216')] [2023-02-24 18:20:51,418][177172] DAMAGECOUNT value on done: 89621.0 [2023-02-24 18:20:51,418][177172] Sum rewards: 8.773, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.730', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.080', 'AMMO3': '0.129', 'weapon5': '0.226', 'WEAPON5': '0.300', 'WEAPON3': '0.950', 'HITCOUNT': '1.060', 'weapon2': '1.240', 'weapon3': '2.184', 'DAMAGECOUNT': '3.816', 'FRAGCOUNT': '8.000'} [2023-02-24 18:20:51,664][177171] DAMAGECOUNT value on done: 92585.0 [2023-02-24 18:20:51,665][177171] Sum rewards: 7.293, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.305', 'AMMO2': '0.012', 'AMMO5': '0.014', 'AMMO3': '0.051', 'AMMO4': '0.061', 'weapon5': '0.152', 'weapon7': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON3': '0.400', 'HITCOUNT': '0.430', 'WEAPON7': '0.500', 'weapon4': '0.832', 'weapon3': '0.908', 'weapon2': '1.390', 'DAMAGECOUNT': '2.877', 'FRAGCOUNT': '5.500'} [2023-02-24 18:20:51,667][177157] DAMAGECOUNT value on done: 93714.0 [2023-02-24 18:20:51,667][177157] Sum rewards: 6.642, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.345', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO5': '0.017', 'AMMO3': '0.065', 'weapon7': '0.066', 'AMMO4': '0.083', 'weapon5': '0.180', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.400', 'weapon4': '0.504', 'HITCOUNT': '0.510', 'weapon2': '1.056', 'weapon3': '1.132', 'DAMAGECOUNT': '2.703', 'FRAGCOUNT': '8.000'} [2023-02-24 18:20:51,678][177157] DAMAGECOUNT value on done: 89383.0 [2023-02-24 18:20:51,678][177157] Sum rewards: 8.841, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.258', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.005', 'weapon7': '0.064', 'WEAPON1': '0.070', 'AMMO3': '0.099', 'weapon5': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.570', 'weapon4': '0.614', 'WEAPON3': '0.650', 'weapon2': '1.358', 'weapon3': '1.536', 'DAMAGECOUNT': '2.985', 'FRAGCOUNT': '9.000'} [2023-02-24 18:20:51,964][177171] DAMAGECOUNT value on done: 92076.0 [2023-02-24 18:20:51,965][177171] Sum rewards: 11.280, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.852', 'ARMOR': '0.004', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.041', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.142', 'weapon5': '0.146', 'AMMO4': '0.203', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.586', 'WEAPON3': '0.900', 'weapon2': '1.026', 'HITCOUNT': '1.140', 'weapon3': '1.842', 'DAMAGECOUNT': '4.665', 'FRAGCOUNT': '15.000'} [2023-02-24 18:20:51,973][177157] DAMAGECOUNT value on done: 88863.0 [2023-02-24 18:20:51,973][177157] Sum rewards: 8.175, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.048', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'weapon7': '0.056', 'AMMO3': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.346', 'WEAPON5': '0.400', 'HITCOUNT': '0.510', 'weapon5': '0.534', 'WEAPON3': '0.600', 'weapon2': '0.974', 'weapon3': '1.306', 'DAMAGECOUNT': '2.442', 'FRAGCOUNT': '7.500'} [2023-02-24 18:20:51,984][177157] DAMAGECOUNT value on done: 88160.0 [2023-02-24 18:20:51,985][177157] Sum rewards: 9.578, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.337', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.008', 'WEAPON1': '0.020', 'weapon5': '0.046', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'weapon7': '0.122', 'WEAPON4': '0.350', 'ARMOR': '0.515', 'WEAPON3': '0.700', 'HITCOUNT': '0.820', 'weapon4': '0.822', 'weapon2': '1.010', 'weapon3': '1.650', 'DAMAGECOUNT': '3.333', 'FRAGCOUNT': '7.000'} [2023-02-24 18:20:52,210][177171] DAMAGECOUNT value on done: 88488.0 [2023-02-24 18:20:52,211][177171] Sum rewards: 4.877, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.711', 'AMMO5': '0.019', 'ARMOR': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.054', 'AMMO3': '0.077', 'weapon5': '0.114', 'weapon7': '0.158', 'AMMO6': '0.220', 'AMMO7': '0.220', 'AMMO4': '0.268', 'weapon2': '0.280', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '0.550', 'HITCOUNT': '0.630', 'weapon3': '1.038', 'weapon4': '1.314', 'DAMAGECOUNT': '2.355', 'FRAGCOUNT': '7.000'} [2023-02-24 18:20:52,510][177171] DAMAGECOUNT value on done: 87193.0 [2023-02-24 18:20:52,510][177171] Sum rewards: -0.366, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.665', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'ARMOR': '0.064', 'AMMO3': '0.067', 'AMMO4': '0.102', 'weapon5': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.366', 'HITCOUNT': '0.380', 'WEAPON3': '0.500', 'weapon2': '0.874', 'weapon3': '1.394', 'DAMAGECOUNT': '1.524', 'FRAGCOUNT': '2.000'} [2023-02-24 18:20:52,768][177153] Updated weights for policy 0, policy_version 11880 (0.0009) [2023-02-24 18:20:52,876][177155] DAMAGECOUNT value on done: 92099.0 [2023-02-24 18:20:52,877][177155] Sum rewards: 3.955, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.035', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'weapon7': '0.054', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.142', 'AMMO3': '0.155', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.350', 'HITCOUNT': '0.720', 'weapon2': '0.848', 'WEAPON3': '0.850', 'weapon3': '2.234', 'DAMAGECOUNT': '3.087', 'FRAGCOUNT': '7.000'} [2023-02-24 18:20:53,176][177155] DAMAGECOUNT value on done: 96467.0 [2023-02-24 18:20:53,176][177155] Sum rewards: 6.596, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.778', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'AMMO3': '0.082', 'weapon7': '0.118', 'weapon5': '0.142', 'AMMO4': '0.161', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.412', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.580', 'weapon3': '1.500', 'weapon2': '1.504', 'DAMAGECOUNT': '2.550', 'FRAGCOUNT': '5.000'} [2023-02-24 18:20:53,466][177155] DAMAGECOUNT value on done: 94160.0 [2023-02-24 18:20:53,467][177155] Sum rewards: 10.379, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.527', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.037', 'weapon5': '0.060', 'weapon7': '0.064', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'weapon3': '1.230', 'weapon2': '1.380', 'DAMAGECOUNT': '2.778', 'FRAGCOUNT': '10.000'} [2023-02-24 18:20:53,761][177155] DAMAGECOUNT value on done: 87624.0 [2023-02-24 18:20:53,762][177155] Sum rewards: 5.642, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.764', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'weapon7': '0.126', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.366', 'weapon5': '0.370', 'WEAPON7': '0.400', 'HITCOUNT': '0.580', 'WEAPON3': '0.600', 'weapon3': '1.078', 'weapon2': '1.382', 'DAMAGECOUNT': '2.622', 'FRAGCOUNT': '5.000'} [2023-02-24 18:20:55,675][177153] Updated weights for policy 0, policy_version 11890 (0.0008) [2023-02-24 18:20:56,376][177119] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 14023.6). Total num frames: 48709632. Throughput: 0: 3506.0. Samples: 12175072. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:20:56,376][177119] Avg episode reward: [(0, '8.050')] [2023-02-24 18:20:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000011892_48709632.pth... [2023-02-24 18:20:56,437][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000011070_45342720.pth [2023-02-24 18:20:58,617][177153] Updated weights for policy 0, policy_version 11900 (0.0008) [2023-02-24 18:20:58,753][177156] DAMAGECOUNT value on done: 89651.0 [2023-02-24 18:20:58,753][177156] Sum rewards: 5.679, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.584', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'AMMO3': '0.032', 'weapon5': '0.086', 'AMMO4': '0.092', 'weapon7': '0.098', 'WEAPON5': '0.200', 'WEAPON3': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'WEAPON7': '0.400', 'weapon3': '0.546', 'weapon4': '0.724', 'weapon2': '0.832', 'DAMAGECOUNT': '1.485', 'FRAGCOUNT': '5.000'} [2023-02-24 18:20:58,979][177156] DAMAGECOUNT value on done: 90619.0 [2023-02-24 18:20:58,979][177156] Sum rewards: 8.553, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.360', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'AMMO4': '0.111', 'AMMO3': '0.118', 'WEAPON4': '0.150', 'weapon5': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.486', 'HITCOUNT': '0.580', 'WEAPON3': '0.700', 'weapon2': '1.342', 'weapon3': '1.568', 'DAMAGECOUNT': '2.232', 'FRAGCOUNT': '8.500'} [2023-02-24 18:20:59,056][177156] DAMAGECOUNT value on done: 91713.0 [2023-02-24 18:20:59,056][177156] Sum rewards: 2.006, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.190', 'ARMOR': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'AMMO4': '0.091', 'AMMO3': '0.094', 'weapon5': '0.094', 'weapon7': '0.100', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'HITCOUNT': '0.430', 'WEAPON3': '0.550', 'weapon4': '0.826', 'weapon3': '0.930', 'weapon2': '1.000', 'DAMAGECOUNT': '2.010', 'FRAGCOUNT': '4.000'} [2023-02-24 18:20:59,287][177156] DAMAGECOUNT value on done: 90978.0 [2023-02-24 18:20:59,288][177156] Sum rewards: 10.182, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.865', 'AMMO5': '0.010', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.068', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.106', 'WEAPON5': '0.200', 'weapon4': '0.410', 'WEAPON3': '0.500', 'HITCOUNT': '0.570', 'weapon2': '0.926', 'weapon3': '1.338', 'DAMAGECOUNT': '3.633', 'FRAGCOUNT': '8.000'} [2023-02-24 18:21:01,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 14023.6). Total num frames: 48779264. Throughput: 0: 3503.5. Samples: 12195998. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:21:01,376][177119] Avg episode reward: [(0, '7.936')] [2023-02-24 18:21:01,565][177153] Updated weights for policy 0, policy_version 11910 (0.0008) [2023-02-24 18:21:04,491][177153] Updated weights for policy 0, policy_version 11920 (0.0008) [2023-02-24 18:21:05,566][177170] DAMAGECOUNT value on done: 93261.0 [2023-02-24 18:21:05,566][177170] Sum rewards: 8.820, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.234', 'AMMO2': '0.014', 'AMMO5': '0.019', 'WEAPON1': '0.030', 'AMMO4': '0.070', 'weapon7': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.142', 'weapon5': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.360', 'ARMOR': '0.404', 'HITCOUNT': '0.760', 'weapon2': '0.786', 'WEAPON3': '0.950', 'weapon3': '2.190', 'DAMAGECOUNT': '3.189', 'FRAGCOUNT': '9.000'} [2023-02-24 18:21:05,855][177170] DAMAGECOUNT value on done: 85251.0 [2023-02-24 18:21:05,855][177170] Sum rewards: 11.510, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.834', 'weapon7': '0.004', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'weapon4': '0.108', 'AMMO3': '0.109', 'AMMO4': '0.126', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'HITCOUNT': '0.800', 'weapon2': '0.964', 'weapon3': '2.270', 'DAMAGECOUNT': '3.624', 'FRAGCOUNT': '12.000'} [2023-02-24 18:21:05,873][177170] DAMAGECOUNT value on done: 94556.0 [2023-02-24 18:21:05,874][177170] Sum rewards: 5.170, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.025', 'weapon7': '0.054', 'AMMO3': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.126', 'weapon5': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.430', 'WEAPON3': '0.500', 'weapon4': '0.624', 'weapon2': '0.646', 'weapon3': '1.196', 'DAMAGECOUNT': '2.409', 'FRAGCOUNT': '5.000'} [2023-02-24 18:21:06,156][177170] DAMAGECOUNT value on done: 93904.0 [2023-02-24 18:21:06,157][177170] Sum rewards: 6.775, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.096', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.009', 'weapon7': '0.046', 'WEAPON1': '0.060', 'AMMO3': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.162', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'weapon2': '1.662', 'weapon3': '1.796', 'DAMAGECOUNT': '1.995', 'FRAGCOUNT': '7.000'} [2023-02-24 18:21:06,233][177171] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:21:06,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 14023.6). Total num frames: 48848896. Throughput: 0: 3502.6. Samples: 12206514. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:21:06,376][177119] Avg episode reward: [(0, '7.809')] [2023-02-24 18:21:06,775][177158] DAMAGECOUNT value on done: 90743.0 [2023-02-24 18:21:06,775][177158] Sum rewards: 6.524, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.970', 'AMMO2': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'weapon7': '0.060', 'weapon4': '0.066', 'AMMO3': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.260', 'WEAPON5': '0.300', 'HITCOUNT': '0.680', 'WEAPON3': '0.750', 'weapon2': '1.540', 'weapon3': '1.698', 'DAMAGECOUNT': '2.928', 'FRAGCOUNT': '6.000'} [2023-02-24 18:21:07,069][177158] DAMAGECOUNT value on done: 87441.0 [2023-02-24 18:21:07,069][177158] Sum rewards: 5.509, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.836', 'AMMO5': '0.024', 'AMMO2': '0.028', 'WEAPON1': '0.070', 'AMMO3': '0.120', 'AMMO4': '0.141', 'WEAPON4': '0.200', 'weapon5': '0.296', 'weapon4': '0.388', 'ARMOR': '0.464', 'WEAPON5': '0.550', 'HITCOUNT': '0.580', 'WEAPON3': '0.800', 'weapon2': '1.280', 'weapon3': '1.592', 'DAMAGECOUNT': '2.061', 'FRAGCOUNT': '6.000'} [2023-02-24 18:21:07,461][177153] Updated weights for policy 0, policy_version 11930 (0.0008) [2023-02-24 18:21:07,717][177158] DAMAGECOUNT value on done: 89740.0 [2023-02-24 18:21:07,718][177158] Sum rewards: 13.881, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.078', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON1': '0.030', 'ARMOR': '0.036', 'weapon7': '0.048', 'AMMO4': '0.057', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'weapon4': '0.170', 'weapon5': '0.182', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.800', 'WEAPON3': '0.850', 'weapon3': '1.574', 'weapon2': '1.600', 'DAMAGECOUNT': '3.915', 'FRAGCOUNT': '14.000'} [2023-02-24 18:21:08,009][177158] DAMAGECOUNT value on done: 94792.0 [2023-02-24 18:21:08,009][177158] Sum rewards: 10.145, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.234', 'AMMO2': '0.011', 'AMMO5': '0.014', 'weapon7': '0.054', 'AMMO4': '0.055', 'WEAPON1': '0.060', 'AMMO3': '0.108', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.258', 'WEAPON5': '0.400', 'weapon4': '0.406', 'weapon2': '0.602', 'WEAPON3': '0.800', 'HITCOUNT': '0.970', 'weapon3': '2.096', 'DAMAGECOUNT': '3.525', 'FRAGCOUNT': '9.500'} [2023-02-24 18:21:08,909][177172] DAMAGECOUNT value on done: 92129.0 [2023-02-24 18:21:08,909][177172] Sum rewards: 7.557, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.652', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.020', 'AMMO2': '0.029', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.106', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.238', 'WEAPON3': '0.650', 'HITCOUNT': '0.740', 'weapon4': '0.854', 'weapon3': '0.978', 'DAMAGECOUNT': '3.015', 'FRAGCOUNT': '9.000'} [2023-02-24 18:21:09,203][177172] DAMAGECOUNT value on done: 90666.0 [2023-02-24 18:21:09,203][177172] Sum rewards: 12.654, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.455', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon7': '0.052', 'AMMO3': '0.060', 'WEAPON1': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon5': '0.346', 'WEAPON3': '0.450', 'weapon4': '0.576', 'HITCOUNT': '0.700', 'weapon3': '1.286', 'weapon2': '1.384', 'DAMAGECOUNT': '3.213', 'FRAGCOUNT': '10.000'} [2023-02-24 18:21:09,705][177154] DAMAGECOUNT value on done: 95794.0 [2023-02-24 18:21:09,706][177154] Sum rewards: 4.648, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.336', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.083', 'AMMO4': '0.106', 'weapon5': '0.338', 'WEAPON4': '0.400', 'ARMOR': '0.461', 'WEAPON5': '0.500', 'weapon4': '0.592', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'weapon2': '1.176', 'weapon3': '1.508', 'DAMAGECOUNT': '2.541', 'FRAGCOUNT': '6.000'} [2023-02-24 18:21:09,997][177154] DAMAGECOUNT value on done: 93014.0 [2023-02-24 18:21:09,997][177154] Sum rewards: 6.715, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'AMMO3': '0.060', 'AMMO4': '0.072', 'weapon5': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'weapon4': '0.504', 'HEALTH': '0.612', 'HITCOUNT': '0.700', 'weapon3': '1.174', 'weapon2': '1.858', 'DAMAGECOUNT': '2.763', 'FRAGCOUNT': '4.000'} [2023-02-24 18:21:10,006][177154] DAMAGECOUNT value on done: 94242.0 [2023-02-24 18:21:10,007][177154] Sum rewards: 11.739, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.194', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO5': '0.012', 'weapon4': '0.036', 'AMMO4': '0.045', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'weapon5': '0.160', 'AMMO3': '0.169', 'WEAPON5': '0.300', 'weapon2': '1.034', 'WEAPON3': '1.050', 'HITCOUNT': '1.110', 'weapon3': '2.318', 'DAMAGECOUNT': '4.785', 'FRAGCOUNT': '13.000'} [2023-02-24 18:21:10,302][177154] DAMAGECOUNT value on done: 95939.0 [2023-02-24 18:21:10,302][177154] Sum rewards: 2.912, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.038', 'AMMO5': '0.019', 'AMMO2': '0.023', 'ARMOR': '0.032', 'WEAPON1': '0.050', 'weapon4': '0.078', 'AMMO4': '0.114', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'weapon5': '0.328', 'WEAPON5': '0.400', 'HITCOUNT': '0.480', 'WEAPON3': '0.700', 'weapon2': '1.120', 'DAMAGECOUNT': '1.872', 'weapon3': '2.202', 'FRAGCOUNT': '4.500'} [2023-02-24 18:21:10,359][177153] Updated weights for policy 0, policy_version 11940 (0.0008) [2023-02-24 18:21:10,374][177172] DAMAGECOUNT value on done: 92578.0 [2023-02-24 18:21:10,374][177172] Sum rewards: 5.973, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.382', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon5': '0.032', 'AMMO4': '0.074', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'WEAPON5': '0.250', 'weapon4': '0.290', 'weapon2': '0.948', 'WEAPON3': '1.000', 'HITCOUNT': '1.060', 'weapon3': '2.424', 'DAMAGECOUNT': '4.167', 'FRAGCOUNT': '7.000'} [2023-02-24 18:21:10,667][177172] DAMAGECOUNT value on done: 90941.0 [2023-02-24 18:21:10,667][177172] Sum rewards: 9.171, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.481', 'AMMO2': '0.004', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO4': '0.019', 'WEAPON1': '0.050', 'AMMO3': '0.070', 'weapon7': '0.086', 'WEAPON4': '0.200', 'AMMO6': '0.280', 'AMMO7': '0.280', 'weapon4': '0.344', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.650', 'weapon5': '0.756', 'weapon2': '1.160', 'weapon3': '1.424', 'DAMAGECOUNT': '2.760', 'FRAGCOUNT': '8.000'} [2023-02-24 18:21:10,862][177157] DAMAGECOUNT value on done: 94258.0 [2023-02-24 18:21:10,863][177157] Sum rewards: 7.283, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.007', 'HEALTH': '0.015', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'weapon7': '0.058', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.232', 'WEAPON3': '0.300', 'weapon4': '0.310', 'HITCOUNT': '0.330', 'weapon2': '1.110', 'weapon3': '1.242', 'DAMAGECOUNT': '1.632', 'FRAGCOUNT': '5.000'} [2023-02-24 18:21:10,875][177157] DAMAGECOUNT value on done: 90598.0 [2023-02-24 18:21:10,875][177157] Sum rewards: 13.377, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.215', 'AMMO5': '0.010', 'AMMO2': '0.032', 'WEAPON1': '0.040', 'weapon7': '0.066', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'weapon5': '0.128', 'AMMO4': '0.158', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.406', 'WEAPON3': '0.550', 'HITCOUNT': '0.860', 'weapon2': '1.012', 'weapon3': '1.854', 'DAMAGECOUNT': '3.645', 'FRAGCOUNT': '9.000'} [2023-02-24 18:21:10,877][177171] DAMAGECOUNT value on done: 94128.0 [2023-02-24 18:21:10,878][177171] Sum rewards: 12.644, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.354', 'AMMO2': '0.020', 'AMMO5': '0.022', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.100', 'weapon7': '0.116', 'AMMO3': '0.120', 'weapon4': '0.182', 'weapon5': '0.262', 'WEAPON5': '0.400', 'ARMOR': '0.420', 'WEAPON3': '0.700', 'HITCOUNT': '0.750', 'weapon2': '1.336', 'weapon3': '1.800', 'DAMAGECOUNT': '4.629', 'FRAGCOUNT': '10.000'} [2023-02-24 18:21:11,176][177157] DAMAGECOUNT value on done: 89951.0 [2023-02-24 18:21:11,176][177157] Sum rewards: 8.281, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.780', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO5': '0.016', 'WEAPON1': '0.030', 'weapon7': '0.050', 'AMMO3': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.176', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.470', 'weapon4': '0.492', 'WEAPON3': '0.650', 'weapon2': '0.672', 'HITCOUNT': '0.890', 'weapon3': '2.052', 'DAMAGECOUNT': '3.264', 'FRAGCOUNT': '6.000'} [2023-02-24 18:21:11,179][177171] DAMAGECOUNT value on done: 92833.0 [2023-02-24 18:21:11,179][177171] Sum rewards: 8.626, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.320', 'AMMO5': '0.015', 'AMMO2': '0.018', 'WEAPON1': '0.050', 'weapon7': '0.052', 'AMMO4': '0.088', 'AMMO3': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.262', 'WEAPON5': '0.350', 'weapon4': '0.398', 'HITCOUNT': '0.470', 'WEAPON3': '0.650', 'weapon2': '0.936', 'weapon3': '1.416', 'DAMAGECOUNT': '2.250', 'FRAGCOUNT': '9.000'} [2023-02-24 18:21:11,187][177157] DAMAGECOUNT value on done: 89222.0 [2023-02-24 18:21:11,188][177157] Sum rewards: 5.604, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.626', 'AMMO2': '0.009', 'AMMO5': '0.020', 'AMMO4': '0.046', 'WEAPON1': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'weapon4': '0.256', 'weapon5': '0.312', 'WEAPON5': '0.450', 'HITCOUNT': '0.760', 'WEAPON3': '0.900', 'weapon2': '1.216', 'weapon3': '1.938', 'DAMAGECOUNT': '3.186', 'FRAGCOUNT': '8.000'} [2023-02-24 18:21:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 48918528. Throughput: 0: 3500.1. Samples: 12227424. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:21:11,376][177119] Avg episode reward: [(0, '7.990')] [2023-02-24 18:21:11,441][177171] DAMAGECOUNT value on done: 89874.0 [2023-02-24 18:21:11,441][177171] Sum rewards: 10.723, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.760', 'AMMO5': '0.016', 'AMMO2': '0.022', 'WEAPON1': '0.050', 'AMMO4': '0.110', 'AMMO3': '0.114', 'weapon4': '0.138', 'WEAPON4': '0.150', 'weapon5': '0.336', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '0.880', 'weapon2': '1.030', 'weapon3': '2.078', 'DAMAGECOUNT': '4.158', 'FRAGCOUNT': '11.000'} [2023-02-24 18:21:11,751][177171] DAMAGECOUNT value on done: 88587.0 [2023-02-24 18:21:11,752][177171] Sum rewards: 10.807, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.199', 'AMMO2': '0.015', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'AMMO4': '0.077', 'AMMO3': '0.097', 'weapon7': '0.120', 'weapon5': '0.178', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'weapon2': '0.376', 'WEAPON7': '0.400', 'WEAPON5': '0.450', 'ARMOR': '0.463', 'weapon4': '0.596', 'WEAPON3': '0.750', 'HITCOUNT': '0.790', 'weapon3': '1.422', 'DAMAGECOUNT': '4.182', 'FRAGCOUNT': '9.000'} [2023-02-24 18:21:12,132][177155] DAMAGECOUNT value on done: 93332.0 [2023-02-24 18:21:12,132][177155] Sum rewards: 13.113, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.624', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO5': '0.015', 'weapon7': '0.052', 'AMMO4': '0.066', 'AMMO3': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon5': '0.196', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'ARMOR': '0.455', 'weapon2': '0.634', 'HITCOUNT': '0.830', 'weapon4': '0.854', 'weapon3': '1.194', 'DAMAGECOUNT': '3.699', 'FRAGCOUNT': '11.000'} [2023-02-24 18:21:12,435][177155] DAMAGECOUNT value on done: 97712.0 [2023-02-24 18:21:12,436][177155] Sum rewards: 14.721, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.666', 'AMMO5': '0.011', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO4': '0.082', 'AMMO3': '0.111', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.276', 'WEAPON5': '0.300', 'ARMOR': '0.517', 'WEAPON3': '0.750', 'HITCOUNT': '0.900', 'weapon3': '1.628', 'weapon2': '1.720', 'DAMAGECOUNT': '3.735', 'FRAGCOUNT': '13.000'} [2023-02-24 18:21:12,727][177155] DAMAGECOUNT value on done: 95323.0 [2023-02-24 18:21:12,728][177155] Sum rewards: 6.217, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.170', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON1': '0.040', 'AMMO4': '0.053', 'AMMO3': '0.127', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.152', 'weapon4': '0.178', 'ARMOR': '0.438', 'WEAPON3': '0.850', 'HITCOUNT': '0.910', 'weapon2': '1.400', 'weapon3': '1.934', 'DAMAGECOUNT': '3.489', 'FRAGCOUNT': '6.500'} [2023-02-24 18:21:13,023][177155] DAMAGECOUNT value on done: 88946.0 [2023-02-24 18:21:13,024][177155] Sum rewards: 15.139, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.835', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'ARMOR': '0.004', 'AMMO5': '0.020', 'WEAPON1': '0.060', 'AMMO3': '0.085', 'weapon5': '0.162', 'weapon7': '0.168', 'WEAPON5': '0.350', 'AMMO6': '0.360', 'AMMO7': '0.360', 'WEAPON7': '0.600', 'WEAPON3': '0.700', 'HITCOUNT': '0.800', 'weapon2': '1.600', 'weapon3': '1.774', 'DAMAGECOUNT': '3.966', 'FRAGCOUNT': '12.000'} [2023-02-24 18:21:13,312][177153] Updated weights for policy 0, policy_version 11950 (0.0009) [2023-02-24 18:21:16,252][177153] Updated weights for policy 0, policy_version 11960 (0.0008) [2023-02-24 18:21:16,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.6, 300 sec: 14009.7). Total num frames: 48988160. Throughput: 0: 3495.2. Samples: 12248302. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:21:16,376][177119] Avg episode reward: [(0, '8.232')] [2023-02-24 18:21:17,662][177171] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 18:21:18,066][177156] DAMAGECOUNT value on done: 90806.0 [2023-02-24 18:21:18,066][177156] Sum rewards: 9.650, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.327', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.032', 'WEAPON1': '0.050', 'AMMO3': '0.100', 'weapon5': '0.164', 'WEAPON4': '0.200', 'weapon4': '0.332', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'weapon2': '0.808', 'ARMOR': '0.911', 'HITCOUNT': '0.970', 'weapon3': '2.024', 'DAMAGECOUNT': '3.465', 'FRAGCOUNT': '9.000'} [2023-02-24 18:21:18,302][177156] DAMAGECOUNT value on done: 91346.0 [2023-02-24 18:21:18,302][177156] Sum rewards: 9.467, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.975', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'weapon5': '0.058', 'AMMO3': '0.089', 'weapon7': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.540', 'WEAPON3': '0.550', 'weapon3': '1.614', 'weapon2': '1.994', 'DAMAGECOUNT': '2.181', 'FRAGCOUNT': '8.000'} [2023-02-24 18:21:18,374][177156] DAMAGECOUNT value on done: 92787.0 [2023-02-24 18:21:18,374][177156] Sum rewards: 9.749, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.344', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO3': '0.076', 'AMMO4': '0.100', 'weapon5': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'weapon4': '0.508', 'HITCOUNT': '0.620', 'weapon3': '1.198', 'weapon2': '1.692', 'DAMAGECOUNT': '3.222', 'FRAGCOUNT': '9.000'} [2023-02-24 18:21:18,608][177156] DAMAGECOUNT value on done: 91928.0 [2023-02-24 18:21:18,608][177156] Sum rewards: 6.595, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.698', 'AMMO2': '0.018', 'AMMO5': '0.025', 'ARMOR': '0.048', 'WEAPON1': '0.060', 'AMMO4': '0.089', 'AMMO3': '0.150', 'WEAPON4': '0.250', 'weapon5': '0.332', 'weapon2': '0.400', 'weapon4': '0.504', 'WEAPON5': '0.600', 'HITCOUNT': '0.730', 'WEAPON3': '0.950', 'weapon3': '2.286', 'DAMAGECOUNT': '2.850', 'FRAGCOUNT': '6.500'} [2023-02-24 18:21:19,148][177153] Updated weights for policy 0, policy_version 11970 (0.0008) [2023-02-24 18:21:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 49057792. Throughput: 0: 3495.9. Samples: 12258822. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:21:21,376][177119] Avg episode reward: [(0, '8.206')] [2023-02-24 18:21:22,077][177153] Updated weights for policy 0, policy_version 11980 (0.0009) [2023-02-24 18:21:24,855][177170] DAMAGECOUNT value on done: 93978.0 [2023-02-24 18:21:24,855][177170] Sum rewards: 2.852, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.194', 'AMMO2': '0.011', 'AMMO5': '0.020', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.188', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.290', 'WEAPON5': '0.450', 'HITCOUNT': '0.540', 'WEAPON3': '0.800', 'weapon3': '1.280', 'weapon2': '1.902', 'DAMAGECOUNT': '2.151', 'FRAGCOUNT': '4.000'} [2023-02-24 18:21:25,040][177153] Updated weights for policy 0, policy_version 11990 (0.0008) [2023-02-24 18:21:25,153][177170] DAMAGECOUNT value on done: 95373.0 [2023-02-24 18:21:25,154][177170] Sum rewards: 6.304, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.866', 'AMMO5': '0.010', 'weapon5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.039', 'weapon7': '0.080', 'AMMO3': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.195', 'WEAPON5': '0.200', 'weapon2': '0.282', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.650', 'weapon4': '0.752', 'weapon3': '0.946', 'DAMAGECOUNT': '2.451', 'FRAGCOUNT': '6.000'} [2023-02-24 18:21:25,165][177170] DAMAGECOUNT value on done: 86305.0 [2023-02-24 18:21:25,165][177170] Sum rewards: 10.944, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.036', 'AMMO5': '0.011', 'AMMO2': '0.031', 'WEAPON1': '0.040', 'ARMOR': '0.044', 'weapon7': '0.048', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.156', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon5': '0.288', 'WEAPON3': '0.550', 'weapon4': '0.560', 'HITCOUNT': '0.810', 'weapon2': '1.224', 'weapon3': '1.512', 'DAMAGECOUNT': '3.162', 'FRAGCOUNT': '9.000'} [2023-02-24 18:21:25,461][177170] DAMAGECOUNT value on done: 95562.0 [2023-02-24 18:21:25,462][177170] Sum rewards: 7.437, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.659', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'weapon7': '0.046', 'AMMO4': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.104', 'weapon5': '0.184', 'AMMO3': '0.199', 'WEAPON5': '0.350', 'HITCOUNT': '0.670', 'weapon2': '1.008', 'WEAPON3': '1.150', 'weapon3': '2.326', 'DAMAGECOUNT': '4.074', 'FRAGCOUNT': '9.000'} [2023-02-24 18:21:25,980][177158] DAMAGECOUNT value on done: 91093.0 [2023-02-24 18:21:25,980][177158] Sum rewards: 2.612, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.760', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'weapon5': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'weapon7': '0.126', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.212', 'HITCOUNT': '0.310', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.050', 'weapon3': '1.216', 'FRAGCOUNT': '2.000', 'weapon2': '2.222'} [2023-02-24 18:21:26,288][177158] DAMAGECOUNT value on done: 88864.0 [2023-02-24 18:21:26,288][177158] Sum rewards: 12.847, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.315', 'AMMO2': '0.022', 'AMMO5': '0.024', 'ARMOR': '0.024', 'WEAPON1': '0.070', 'AMMO4': '0.112', 'AMMO3': '0.149', 'weapon5': '0.196', 'WEAPON4': '0.450', 'weapon2': '0.504', 'WEAPON5': '0.550', 'weapon4': '0.576', 'HITCOUNT': '0.880', 'WEAPON3': '1.000', 'weapon3': '2.086', 'DAMAGECOUNT': '4.269', 'FRAGCOUNT': '14.000'} [2023-02-24 18:21:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 49127424. Throughput: 0: 3492.1. Samples: 12279636. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:21:26,376][177119] Avg episode reward: [(0, '8.181')] [2023-02-24 18:21:26,910][177158] DAMAGECOUNT value on done: 91058.0 [2023-02-24 18:21:26,910][177158] Sum rewards: 6.839, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon7': '0.064', 'AMMO3': '0.090', 'AMMO4': '0.095', 'weapon5': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HEALTH': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'weapon4': '0.498', 'HITCOUNT': '0.680', 'weapon2': '0.806', 'weapon3': '1.646', 'DAMAGECOUNT': '3.054', 'FRAGCOUNT': '7.000'} [2023-02-24 18:21:27,213][177158] DAMAGECOUNT value on done: 94956.0 [2023-02-24 18:21:27,213][177158] Sum rewards: 3.518, reward structure: {'DEATHCOUNT': '-0.750', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO3': '0.020', 'HEALTH': '0.030', 'weapon7': '0.050', 'HITCOUNT': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON3': '0.150', 'WEAPON7': '0.200', 'weapon3': '0.422', 'DAMAGECOUNT': '0.492', 'FRAGCOUNT': '1.000', 'weapon2': '1.584'} [2023-02-24 18:21:28,000][177153] Updated weights for policy 0, policy_version 12000 (0.0009) [2023-02-24 18:21:28,160][177172] DAMAGECOUNT value on done: 92605.0 [2023-02-24 18:21:28,160][177172] Sum rewards: 2.753, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.768', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.050', 'AMMO3': '0.059', 'AMMO4': '0.067', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.154', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.202', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'weapon4': '0.458', 'weapon2': '0.524', 'weapon3': '0.732', 'DAMAGECOUNT': '1.428', 'FRAGCOUNT': '2.000'} [2023-02-24 18:21:28,466][177172] DAMAGECOUNT value on done: 91826.0 [2023-02-24 18:21:28,467][177172] Sum rewards: 10.232, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.550', 'AMMO5': '0.017', 'AMMO2': '0.017', 'WEAPON1': '0.050', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'AMMO3': '0.126', 'weapon5': '0.138', 'WEAPON5': '0.350', 'weapon4': '0.374', 'WEAPON3': '0.900', 'HITCOUNT': '1.000', 'weapon2': '1.084', 'weapon3': '2.060', 'DAMAGECOUNT': '3.480', 'FRAGCOUNT': '11.000'} [2023-02-24 18:21:28,978][177154] DAMAGECOUNT value on done: 96786.0 [2023-02-24 18:21:28,979][177154] Sum rewards: 10.390, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.810', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.019', 'WEAPON1': '0.030', 'weapon7': '0.050', 'weapon5': '0.056', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.144', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.600', 'HITCOUNT': '0.720', 'weapon3': '1.484', 'weapon2': '2.032', 'DAMAGECOUNT': '2.976', 'FRAGCOUNT': '9.000'} [2023-02-24 18:21:29,273][177154] DAMAGECOUNT value on done: 95564.0 [2023-02-24 18:21:29,274][177154] Sum rewards: 12.236, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.421', 'AMMO5': '0.014', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'weapon7': '0.052', 'AMMO3': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.133', 'WEAPON7': '0.200', 'weapon5': '0.252', 'WEAPON4': '0.300', 'weapon4': '0.402', 'WEAPON5': '0.450', 'weapon2': '0.462', 'WEAPON3': '0.600', 'HITCOUNT': '0.710', 'weapon3': '1.486', 'DAMAGECOUNT': '3.966', 'FRAGCOUNT': '11.000'} [2023-02-24 18:21:29,286][177154] DAMAGECOUNT value on done: 93593.0 [2023-02-24 18:21:29,287][177154] Sum rewards: 3.279, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.895', 'ARMOR': '0.012', 'AMMO5': '0.022', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'AMMO3': '0.084', 'weapon4': '0.088', 'AMMO4': '0.120', 'weapon5': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'HITCOUNT': '0.450', 'WEAPON3': '0.600', 'weapon3': '1.630', 'weapon2': '1.676', 'DAMAGECOUNT': '1.737', 'FRAGCOUNT': '6.000'} [2023-02-24 18:21:29,584][177154] DAMAGECOUNT value on done: 97314.0 [2023-02-24 18:21:29,585][177154] Sum rewards: 10.961, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.030', 'weapon7': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.130', 'WEAPON7': '0.200', 'HEALTH': '0.363', 'WEAPON3': '0.650', 'HITCOUNT': '0.840', 'weapon3': '1.780', 'weapon2': '1.802', 'DAMAGECOUNT': '4.125', 'FRAGCOUNT': '8.000'} [2023-02-24 18:21:29,635][177172] DAMAGECOUNT value on done: 93760.0 [2023-02-24 18:21:29,635][177172] Sum rewards: 8.809, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.633', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.014', 'weapon5': '0.038', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'weapon7': '0.100', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'weapon4': '0.152', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'HITCOUNT': '0.770', 'WEAPON3': '0.900', 'weapon2': '1.066', 'weapon3': '2.240', 'DAMAGECOUNT': '3.438', 'FRAGCOUNT': '9.000'} [2023-02-24 18:21:29,928][177172] DAMAGECOUNT value on done: 91480.0 [2023-02-24 18:21:29,928][177172] Sum rewards: 2.148, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.259', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.084', 'AMMO3': '0.116', 'AMMO4': '0.120', 'weapon7': '0.140', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.340', 'ARMOR': '0.473', 'weapon2': '0.508', 'weapon4': '0.698', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.617', 'weapon3': '1.676', 'FRAGCOUNT': '2.500'} [2023-02-24 18:21:30,209][177157] DAMAGECOUNT value on done: 95583.0 [2023-02-24 18:21:30,209][177157] Sum rewards: 5.687, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.272', 'AMMO2': '0.011', 'AMMO5': '0.016', 'ARMOR': '0.024', 'AMMO4': '0.055', 'weapon7': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.159', 'weapon5': '0.174', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.398', 'WEAPON5': '0.400', 'HITCOUNT': '0.770', 'WEAPON3': '0.950', 'weapon2': '1.284', 'weapon3': '1.388', 'DAMAGECOUNT': '3.975', 'FRAGCOUNT': '9.000'} [2023-02-24 18:21:30,220][177157] DAMAGECOUNT value on done: 91336.0 [2023-02-24 18:21:30,221][177157] Sum rewards: 3.694, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.734', 'AMMO5': '0.007', 'ARMOR': '0.008', 'weapon7': '0.008', 'AMMO2': '0.011', 'WEAPON1': '0.030', 'AMMO4': '0.055', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'weapon5': '0.152', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.204', 'HITCOUNT': '0.540', 'WEAPON3': '0.750', 'weapon3': '1.666', 'weapon2': '1.732', 'DAMAGECOUNT': '2.214', 'FRAGCOUNT': '6.000'} [2023-02-24 18:21:30,221][177171] DAMAGECOUNT value on done: 95357.0 [2023-02-24 18:21:30,221][177171] Sum rewards: 9.619, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.282', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon7': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.124', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.455', 'weapon2': '0.676', 'WEAPON3': '0.700', 'weapon4': '0.724', 'HITCOUNT': '0.900', 'weapon3': '1.952', 'DAMAGECOUNT': '3.675', 'FRAGCOUNT': '10.000'} [2023-02-24 18:21:30,511][177157] DAMAGECOUNT value on done: 90870.0 [2023-02-24 18:21:30,512][177157] Sum rewards: 7.674, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.730', 'ARMOR': '0.004', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon7': '0.052', 'AMMO3': '0.083', 'AMMO4': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon5': '0.352', 'weapon4': '0.362', 'WEAPON3': '0.500', 'HITCOUNT': '0.680', 'weapon2': '1.162', 'weapon3': '1.744', 'DAMAGECOUNT': '2.757', 'FRAGCOUNT': '7.000'} [2023-02-24 18:21:30,521][177171] DAMAGECOUNT value on done: 94029.0 [2023-02-24 18:21:30,521][177171] Sum rewards: 6.569, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.826', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.090', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.320', 'WEAPON3': '0.900', 'weapon2': '0.938', 'HITCOUNT': '0.990', 'weapon3': '2.396', 'DAMAGECOUNT': '3.588', 'FRAGCOUNT': '6.500'} [2023-02-24 18:21:30,523][177157] DAMAGECOUNT value on done: 90412.0 [2023-02-24 18:21:30,523][177157] Sum rewards: 11.438, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.088', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO5': '0.022', 'weapon4': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'WEAPON1': '0.070', 'weapon5': '0.408', 'WEAPON3': '0.450', 'HITCOUNT': '0.500', 'WEAPON5': '0.500', 'weapon3': '1.468', 'weapon2': '1.628', 'DAMAGECOUNT': '3.570', 'FRAGCOUNT': '8.000'} [2023-02-24 18:21:30,787][177171] DAMAGECOUNT value on done: 91075.0 [2023-02-24 18:21:30,787][177171] Sum rewards: 12.051, reward structure: {'DEATHCOUNT': '-7.500', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'HEALTH': '0.084', 'AMMO4': '0.090', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon5': '0.138', 'WEAPON5': '0.200', 'weapon4': '0.222', 'WEAPON3': '0.600', 'HITCOUNT': '0.800', 'weapon2': '1.298', 'weapon3': '1.942', 'DAMAGECOUNT': '3.603', 'FRAGCOUNT': '10.000'} [2023-02-24 18:21:30,929][177153] Updated weights for policy 0, policy_version 12010 (0.0008) [2023-02-24 18:21:31,082][177171] DAMAGECOUNT value on done: 89631.0 [2023-02-24 18:21:31,083][177171] Sum rewards: 3.504, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.352', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.026', 'WEAPON1': '0.040', 'AMMO3': '0.108', 'AMMO4': '0.129', 'weapon5': '0.196', 'weapon4': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'HITCOUNT': '0.620', 'WEAPON3': '0.650', 'weapon3': '1.604', 'weapon2': '1.640', 'DAMAGECOUNT': '3.132', 'FRAGCOUNT': '6.000'} [2023-02-24 18:21:31,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 49197056. Throughput: 0: 3491.6. Samples: 12300584. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:21:31,376][177119] Avg episode reward: [(0, '8.148')] [2023-02-24 18:21:31,405][177155] DAMAGECOUNT value on done: 94186.0 [2023-02-24 18:21:31,406][177155] Sum rewards: 9.010, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO5': '0.015', 'WEAPON1': '0.050', 'HEALTH': '0.060', 'AMMO3': '0.095', 'weapon5': '0.170', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.670', 'weapon2': '1.486', 'weapon3': '1.986', 'DAMAGECOUNT': '2.562', 'FRAGCOUNT': '7.000'} [2023-02-24 18:21:31,703][177155] DAMAGECOUNT value on done: 98421.0 [2023-02-24 18:21:31,704][177155] Sum rewards: 5.154, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.859', 'weapon4': '0.018', 'AMMO2': '0.023', 'AMMO5': '0.025', 'WEAPON4': '0.050', 'WEAPON1': '0.080', 'AMMO4': '0.117', 'AMMO3': '0.124', 'weapon5': '0.294', 'HITCOUNT': '0.540', 'WEAPON5': '0.600', 'weapon2': '0.810', 'WEAPON3': '0.850', 'DAMAGECOUNT': '2.127', 'weapon3': '2.354', 'FRAGCOUNT': '5.500'} [2023-02-24 18:21:31,997][177155] DAMAGECOUNT value on done: 95825.0 [2023-02-24 18:21:31,997][177155] Sum rewards: 3.682, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'ARMOR': '0.040', 'HEALTH': '0.046', 'AMMO4': '0.054', 'weapon5': '0.056', 'AMMO3': '0.074', 'WEAPON5': '0.100', 'weapon7': '0.110', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.380', 'WEAPON3': '0.450', 'weapon4': '0.494', 'weapon2': '1.132', 'weapon3': '1.324', 'DAMAGECOUNT': '1.506', 'FRAGCOUNT': '3.000'} [2023-02-24 18:21:32,311][177155] DAMAGECOUNT value on done: 90289.0 [2023-02-24 18:21:32,312][177155] Sum rewards: 14.316, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.674', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'ARMOR': '0.036', 'weapon7': '0.082', 'AMMO3': '0.086', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.152', 'weapon5': '0.170', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '0.650', 'weapon2': '0.736', 'HITCOUNT': '1.080', 'weapon4': '1.120', 'weapon3': '1.388', 'DAMAGECOUNT': '4.029', 'FRAGCOUNT': '13.000'} [2023-02-24 18:21:33,861][177153] Updated weights for policy 0, policy_version 12020 (0.0008) [2023-02-24 18:21:36,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 49266688. Throughput: 0: 3490.4. Samples: 12311090. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:21:36,376][177119] Avg episode reward: [(0, '8.140')] [2023-02-24 18:21:36,801][177153] Updated weights for policy 0, policy_version 12030 (0.0008) [2023-02-24 18:21:37,326][177156] DAMAGECOUNT value on done: 91952.0 [2023-02-24 18:21:37,326][177156] Sum rewards: 9.056, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.526', 'AMMO2': '0.002', 'AMMO5': '0.010', 'AMMO4': '0.012', 'ARMOR': '0.028', 'weapon5': '0.072', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'weapon7': '0.100', 'AMMO3': '0.117', 'weapon4': '0.214', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'WEAPON7': '0.400', 'HITCOUNT': '0.620', 'WEAPON3': '0.800', 'weapon2': '1.210', 'weapon3': '1.908', 'DAMAGECOUNT': '3.429', 'FRAGCOUNT': '9.000'} [2023-02-24 18:21:37,565][177156] DAMAGECOUNT value on done: 92953.0 [2023-02-24 18:21:37,565][177156] Sum rewards: 11.050, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.209', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon7': '0.046', 'WEAPON1': '0.070', 'AMMO3': '0.081', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.121', 'WEAPON7': '0.200', 'weapon5': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.398', 'WEAPON3': '0.700', 'HITCOUNT': '0.890', 'weapon2': '0.946', 'weapon3': '1.764', 'DAMAGECOUNT': '4.212', 'FRAGCOUNT': '11.000'} [2023-02-24 18:21:37,637][177156] DAMAGECOUNT value on done: 93903.0 [2023-02-24 18:21:37,637][177156] Sum rewards: 4.501, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.778', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.101', 'AMMO4': '0.124', 'weapon5': '0.248', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.660', 'weapon4': '0.686', 'weapon2': '0.928', 'weapon3': '1.556', 'DAMAGECOUNT': '3.342', 'FRAGCOUNT': '5.000'} [2023-02-24 18:21:37,869][177156] DAMAGECOUNT value on done: 92780.0 [2023-02-24 18:21:37,869][177156] Sum rewards: 6.362, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO2': '0.036', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.127', 'AMMO4': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.274', 'ARMOR': '0.404', 'weapon4': '0.452', 'WEAPON3': '0.650', 'HITCOUNT': '0.680', 'weapon2': '0.750', 'HEALTH': '1.078', 'weapon3': '1.578', 'DAMAGECOUNT': '2.556', 'FRAGCOUNT': '6.500'} [2023-02-24 18:21:39,741][177153] Updated weights for policy 0, policy_version 12040 (0.0008) [2023-02-24 18:21:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 14009.7). Total num frames: 49336320. Throughput: 0: 3486.6. Samples: 12331968. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:21:41,376][177119] Avg episode reward: [(0, '8.078')] [2023-02-24 18:21:42,680][177153] Updated weights for policy 0, policy_version 12050 (0.0009) [2023-02-24 18:21:44,114][177170] DAMAGECOUNT value on done: 94370.0 [2023-02-24 18:21:44,114][177170] Sum rewards: 3.020, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.034', 'AMMO2': '0.044', 'AMMO3': '0.054', 'weapon7': '0.056', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'AMMO4': '0.218', 'WEAPON3': '0.300', 'HITCOUNT': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.386', 'ARMOR': '0.400', 'weapon2': '0.556', 'weapon3': '0.894', 'DAMAGECOUNT': '1.176', 'FRAGCOUNT': '3.000'} [2023-02-24 18:21:44,396][177170] DAMAGECOUNT value on done: 86449.0 [2023-02-24 18:21:44,397][177170] Sum rewards: 2.339, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.514', 'AMMO5': '0.005', 'weapon5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.021', 'HITCOUNT': '0.070', 'AMMO4': '0.074', 'weapon2': '0.084', 'WEAPON5': '0.100', 'WEAPON3': '0.150', 'weapon7': '0.164', 'WEAPON4': '0.300', 'AMMO6': '0.340', 'AMMO7': '0.340', 'weapon3': '0.408', 'DAMAGECOUNT': '0.432', 'WEAPON7': '0.500', 'weapon4': '0.816', 'FRAGCOUNT': '2.000'} [2023-02-24 18:21:44,419][177170] DAMAGECOUNT value on done: 96530.0 [2023-02-24 18:21:44,419][177170] Sum rewards: 10.505, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.284', 'AMMO2': '0.010', 'ARMOR': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.047', 'AMMO3': '0.066', 'weapon5': '0.212', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.532', 'HITCOUNT': '0.800', 'weapon3': '1.104', 'weapon2': '1.480', 'DAMAGECOUNT': '3.471', 'FRAGCOUNT': '8.000'} [2023-02-24 18:21:44,724][177170] DAMAGECOUNT value on done: 96947.0 [2023-02-24 18:21:44,725][177170] Sum rewards: 11.812, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.846', 'AMMO2': '0.010', 'AMMO5': '0.018', 'weapon4': '0.018', 'AMMO4': '0.049', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'WEAPON5': '0.400', 'weapon5': '0.448', 'WEAPON3': '0.800', 'weapon2': '0.932', 'HITCOUNT': '1.080', 'weapon3': '2.206', 'DAMAGECOUNT': '4.155', 'FRAGCOUNT': '10.500'} [2023-02-24 18:21:44,976][177172] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:21:45,305][177158] DAMAGECOUNT value on done: 92335.0 [2023-02-24 18:21:45,305][177158] Sum rewards: 12.301, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.201', 'AMMO5': '0.010', 'AMMO2': '0.013', 'ARMOR': '0.024', 'WEAPON1': '0.040', 'AMMO4': '0.064', 'AMMO3': '0.097', 'WEAPON4': '0.250', 'weapon5': '0.252', 'WEAPON5': '0.350', 'weapon4': '0.548', 'WEAPON3': '0.700', 'HITCOUNT': '0.830', 'weapon2': '0.830', 'weapon3': '1.768', 'DAMAGECOUNT': '3.726', 'FRAGCOUNT': '10.000'} [2023-02-24 18:21:45,602][177153] Updated weights for policy 0, policy_version 12060 (0.0008) [2023-02-24 18:21:45,602][177158] DAMAGECOUNT value on done: 89246.0 [2023-02-24 18:21:45,602][177158] Sum rewards: -0.172, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.046', 'AMMO2': '0.015', 'AMMO5': '0.025', 'ARMOR': '0.044', 'weapon7': '0.056', 'WEAPON1': '0.070', 'AMMO4': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'weapon4': '0.232', 'HITCOUNT': '0.270', 'weapon5': '0.360', 'WEAPON5': '0.550', 'weapon2': '0.786', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.146', 'weapon3': '2.116', 'FRAGCOUNT': '4.000'} [2023-02-24 18:21:46,212][177158] DAMAGECOUNT value on done: 92210.0 [2023-02-24 18:21:46,213][177158] Sum rewards: 5.925, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.815', 'AMMO2': '0.011', 'AMMO5': '0.022', 'WEAPON1': '0.040', 'AMMO4': '0.057', 'AMMO3': '0.159', 'weapon5': '0.206', 'WEAPON5': '0.500', 'HITCOUNT': '0.790', 'WEAPON3': '1.050', 'weapon2': '1.198', 'weapon3': '2.250', 'DAMAGECOUNT': '3.456', 'FRAGCOUNT': '7.000'} [2023-02-24 18:21:46,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 14009.7). Total num frames: 49405952. Throughput: 0: 3487.7. Samples: 12352944. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:21:46,376][177119] Avg episode reward: [(0, '8.060')] [2023-02-24 18:21:46,510][177158] DAMAGECOUNT value on done: 95768.0 [2023-02-24 18:21:46,510][177158] Sum rewards: 5.670, reward structure: {'DEATHCOUNT': '-6.750', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.030', 'AMMO3': '0.056', 'weapon5': '0.142', 'AMMO4': '0.152', 'weapon7': '0.168', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'HEALTH': '0.318', 'WEAPON3': '0.350', 'HITCOUNT': '0.650', 'weapon4': '0.702', 'weapon3': '0.764', 'weapon2': '1.228', 'DAMAGECOUNT': '2.436', 'FRAGCOUNT': '4.000'} [2023-02-24 18:21:47,388][177172] DAMAGECOUNT value on done: 94241.0 [2023-02-24 18:21:47,389][177172] Sum rewards: 21.619, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.000', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.024', 'ARMOR': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.096', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.260', 'weapon4': '0.490', 'WEAPON3': '0.700', 'HITCOUNT': '1.140', 'weapon2': '1.352', 'weapon3': '1.578', 'DAMAGECOUNT': '4.908', 'FRAGCOUNT': '19.000'} [2023-02-24 18:21:47,686][177172] DAMAGECOUNT value on done: 92992.0 [2023-02-24 18:21:47,686][177172] Sum rewards: 10.827, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.463', 'AMMO2': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.039', 'ARMOR': '0.040', 'AMMO3': '0.081', 'weapon5': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.632', 'WEAPON3': '0.650', 'weapon4': '0.692', 'HITCOUNT': '0.840', 'weapon3': '1.736', 'DAMAGECOUNT': '3.498', 'FRAGCOUNT': '10.000'} [2023-02-24 18:21:48,255][177154] DAMAGECOUNT value on done: 97725.0 [2023-02-24 18:21:48,255][177154] Sum rewards: 6.484, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.255', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.118', 'weapon5': '0.194', 'WEAPON5': '0.300', 'HITCOUNT': '0.730', 'WEAPON3': '0.800', 'weapon2': '1.494', 'weapon3': '1.994', 'DAMAGECOUNT': '2.817', 'FRAGCOUNT': '6.000'} [2023-02-24 18:21:48,505][177153] Updated weights for policy 0, policy_version 12070 (0.0008) [2023-02-24 18:21:48,557][177154] DAMAGECOUNT value on done: 96301.0 [2023-02-24 18:21:48,557][177154] Sum rewards: 2.471, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.385', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'ARMOR': '0.028', 'AMMO2': '0.029', 'weapon5': '0.054', 'AMMO3': '0.088', 'weapon7': '0.122', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'weapon4': '0.534', 'WEAPON4': '0.550', 'WEAPON3': '0.700', 'HITCOUNT': '0.780', 'weapon2': '0.884', 'weapon3': '1.778', 'DAMAGECOUNT': '2.211', 'FRAGCOUNT': '4.000'} [2023-02-24 18:21:48,571][177154] DAMAGECOUNT value on done: 94401.0 [2023-02-24 18:21:48,572][177154] Sum rewards: 6.430, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.571', 'AMMO2': '0.014', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'weapon7': '0.052', 'AMMO4': '0.069', 'weapon5': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.145', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.544', 'HITCOUNT': '0.570', 'weapon2': '0.624', 'WEAPON3': '0.800', 'weapon3': '1.806', 'DAMAGECOUNT': '2.424', 'FRAGCOUNT': '8.500'} [2023-02-24 18:21:48,853][177172] DAMAGECOUNT value on done: 94365.0 [2023-02-24 18:21:48,854][177172] Sum rewards: 4.775, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.515', 'AMMO2': '0.014', 'AMMO5': '0.015', 'AMMO4': '0.071', 'WEAPON1': '0.080', 'weapon4': '0.110', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'weapon5': '0.320', 'WEAPON5': '0.450', 'HITCOUNT': '0.510', 'WEAPON3': '0.850', 'weapon3': '1.600', 'weapon2': '1.622', 'DAMAGECOUNT': '1.815', 'FRAGCOUNT': '6.000'} [2023-02-24 18:21:48,878][177154] DAMAGECOUNT value on done: 98537.0 [2023-02-24 18:21:48,879][177154] Sum rewards: 12.112, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.828', 'AMMO2': '0.022', 'AMMO5': '0.024', 'ARMOR': '0.033', 'WEAPON1': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.109', 'weapon4': '0.270', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'weapon5': '0.462', 'WEAPON5': '0.600', 'HITCOUNT': '0.710', 'weapon2': '1.106', 'weapon3': '1.574', 'DAMAGECOUNT': '3.669', 'FRAGCOUNT': '11.000'} [2023-02-24 18:21:49,151][177172] DAMAGECOUNT value on done: 92351.0 [2023-02-24 18:21:49,151][177172] Sum rewards: 6.528, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.670', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.066', 'weapon7': '0.124', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.470', 'weapon4': '0.564', 'weapon2': '0.658', 'weapon3': '1.290', 'DAMAGECOUNT': '2.310', 'FRAGCOUNT': '5.500'} [2023-02-24 18:21:49,389][177171] DAMAGECOUNT value on done: 95402.0 [2023-02-24 18:21:49,465][177157] DAMAGECOUNT value on done: 96783.0 [2023-02-24 18:21:49,466][177157] Sum rewards: 11.213, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.970', 'AMMO5': '0.015', 'AMMO2': '0.037', 'WEAPON1': '0.060', 'AMMO3': '0.076', 'AMMO4': '0.186', 'WEAPON4': '0.200', 'weapon5': '0.236', 'WEAPON5': '0.400', 'weapon4': '0.462', 'WEAPON3': '0.550', 'HITCOUNT': '0.830', 'weapon3': '1.364', 'weapon2': '1.416', 'DAMAGECOUNT': '3.600', 'FRAGCOUNT': '11.000'} [2023-02-24 18:21:49,476][177157] DAMAGECOUNT value on done: 92235.0 [2023-02-24 18:21:49,477][177157] Sum rewards: 4.705, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.747', 'AMMO5': '0.019', 'ARMOR': '0.028', 'AMMO2': '0.029', 'WEAPON1': '0.080', 'AMMO3': '0.130', 'AMMO4': '0.146', 'weapon5': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'HITCOUNT': '0.700', 'weapon4': '0.712', 'WEAPON3': '0.850', 'weapon2': '0.862', 'weapon3': '1.754', 'DAMAGECOUNT': '2.697', 'FRAGCOUNT': '7.000'} [2023-02-24 18:21:49,692][177171] DAMAGECOUNT value on done: 95329.0 [2023-02-24 18:21:49,693][177171] Sum rewards: 12.552, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.019', 'AMMO5': '0.023', 'ARMOR': '0.028', 'WEAPON1': '0.050', 'AMMO4': '0.097', 'HEALTH': '0.106', 'AMMO3': '0.124', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.350', 'weapon5': '0.454', 'weapon2': '0.486', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'weapon4': '0.700', 'HITCOUNT': '0.740', 'weapon3': '1.674', 'DAMAGECOUNT': '3.900', 'FRAGCOUNT': '11.000'} [2023-02-24 18:21:49,771][177157] DAMAGECOUNT value on done: 92379.0 [2023-02-24 18:21:49,772][177157] Sum rewards: 10.293, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.071', 'AMMO2': '0.008', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.042', 'weapon5': '0.106', 'AMMO3': '0.129', 'WEAPON5': '0.300', 'WEAPON3': '0.950', 'weapon2': '1.166', 'HITCOUNT': '1.220', 'weapon3': '2.378', 'DAMAGECOUNT': '4.527', 'FRAGCOUNT': '9.500'} [2023-02-24 18:21:49,783][177157] DAMAGECOUNT value on done: 91316.0 [2023-02-24 18:21:49,783][177157] Sum rewards: 7.312, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.644', 'ARMOR': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon7': '0.062', 'AMMO3': '0.065', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.122', 'weapon5': '0.170', 'WEAPON4': '0.250', 'weapon2': '0.274', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'weapon4': '0.706', 'HITCOUNT': '0.710', 'weapon3': '1.370', 'DAMAGECOUNT': '2.712', 'FRAGCOUNT': '5.500'} [2023-02-24 18:21:49,935][177171] DAMAGECOUNT value on done: 91280.0 [2023-02-24 18:21:49,935][177171] Sum rewards: -2.564, reward structure: {'DEATHCOUNT': '-4.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.380', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO3': '0.047', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'weapon5': '0.100', 'weapon7': '0.118', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon2': '0.260', 'WEAPON3': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.496', 'DAMAGECOUNT': '0.615', 'weapon3': '0.632'} [2023-02-24 18:21:50,230][177171] DAMAGECOUNT value on done: 90606.0 [2023-02-24 18:21:50,230][177171] Sum rewards: 11.603, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.558', 'AMMO5': '0.017', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'AMMO3': '0.093', 'AMMO4': '0.112', 'weapon5': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.388', 'ARMOR': '0.483', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'weapon2': '0.944', 'weapon3': '1.692', 'DAMAGECOUNT': '2.925', 'FRAGCOUNT': '10.000'} [2023-02-24 18:21:50,745][177155] DAMAGECOUNT value on done: 95266.0 [2023-02-24 18:21:50,745][177155] Sum rewards: 11.972, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.850', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.016', 'weapon7': '0.046', 'weapon5': '0.046', 'AMMO4': '0.079', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'weapon4': '0.270', 'WEAPON5': '0.350', 'WEAPON3': '0.950', 'HITCOUNT': '0.970', 'weapon2': '1.226', 'weapon3': '2.016', 'DAMAGECOUNT': '3.240', 'FRAGCOUNT': '13.000'} [2023-02-24 18:21:51,037][177155] DAMAGECOUNT value on done: 98759.0 [2023-02-24 18:21:51,037][177155] Sum rewards: 4.441, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.230', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO3': '0.044', 'weapon7': '0.060', 'AMMO4': '0.071', 'weapon5': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'HITCOUNT': '0.250', 'WEAPON3': '0.300', 'weapon2': '0.558', 'weapon4': '0.618', 'weapon3': '0.684', 'DAMAGECOUNT': '1.014', 'FRAGCOUNT': '4.000'} [2023-02-24 18:21:51,327][177155] DAMAGECOUNT value on done: 96910.0 [2023-02-24 18:21:51,328][177155] Sum rewards: 8.905, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.374', 'AMMO2': '0.008', 'AMMO5': '0.022', 'weapon4': '0.028', 'AMMO4': '0.039', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon5': '0.258', 'ARMOR': '0.400', 'WEAPON5': '0.550', 'HITCOUNT': '0.680', 'WEAPON3': '0.850', 'weapon2': '1.568', 'weapon3': '1.854', 'DAMAGECOUNT': '3.255', 'FRAGCOUNT': '9.000'} [2023-02-24 18:21:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 14009.7). Total num frames: 49475584. Throughput: 0: 3486.3. Samples: 12363396. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:21:51,376][177119] Avg episode reward: [(0, '7.822')] [2023-02-24 18:21:51,459][177153] Updated weights for policy 0, policy_version 12080 (0.0008) [2023-02-24 18:21:51,628][177155] DAMAGECOUNT value on done: 91717.0 [2023-02-24 18:21:51,628][177155] Sum rewards: 13.993, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.990', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON1': '0.050', 'AMMO4': '0.090', 'AMMO3': '0.093', 'weapon7': '0.096', 'WEAPON4': '0.100', 'weapon5': '0.182', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.440', 'WEAPON3': '0.650', 'HITCOUNT': '1.060', 'weapon2': '1.208', 'weapon3': '1.414', 'DAMAGECOUNT': '4.284', 'FRAGCOUNT': '11.000'} [2023-02-24 18:21:54,393][177153] Updated weights for policy 0, policy_version 12090 (0.0008) [2023-02-24 18:21:56,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 14009.7). Total num frames: 49545216. Throughput: 0: 3486.7. Samples: 12384324. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:21:56,376][177119] Avg episode reward: [(0, '7.966')] [2023-02-24 18:21:56,616][177156] DAMAGECOUNT value on done: 93384.0 [2023-02-24 18:21:56,616][177156] Sum rewards: 11.070, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.560', 'AMMO2': '0.020', 'AMMO5': '0.020', 'WEAPON1': '0.070', 'AMMO4': '0.099', 'AMMO3': '0.101', 'weapon5': '0.244', 'WEAPON4': '0.300', 'weapon4': '0.410', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.930', 'weapon3': '1.488', 'weapon2': '1.552', 'DAMAGECOUNT': '4.296', 'FRAGCOUNT': '11.000'} [2023-02-24 18:21:56,859][177156] DAMAGECOUNT value on done: 93746.0 [2023-02-24 18:21:56,860][177156] Sum rewards: 11.594, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.006', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'HEALTH': '0.030', 'AMMO4': '0.031', 'weapon7': '0.048', 'AMMO3': '0.055', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.300', 'weapon5': '0.386', 'WEAPON3': '0.400', 'HITCOUNT': '0.500', 'weapon3': '1.084', 'weapon2': '1.788', 'DAMAGECOUNT': '2.379', 'FRAGCOUNT': '8.000'} [2023-02-24 18:21:56,940][177156] DAMAGECOUNT value on done: 95550.0 [2023-02-24 18:21:56,941][177156] Sum rewards: 12.876, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.960', 'AMMO2': '0.007', 'ARMOR': '0.020', 'AMMO5': '0.025', 'AMMO4': '0.032', 'weapon7': '0.048', 'WEAPON1': '0.060', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.156', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.210', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'HITCOUNT': '0.900', 'weapon2': '1.438', 'weapon3': '1.846', 'DAMAGECOUNT': '4.941', 'FRAGCOUNT': '12.000'} [2023-02-24 18:21:57,176][177156] DAMAGECOUNT value on done: 93498.0 [2023-02-24 18:21:57,176][177156] Sum rewards: 6.511, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.870', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.036', 'WEAPON5': '0.050', 'weapon7': '0.062', 'weapon5': '0.092', 'AMMO3': '0.104', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.240', 'ARMOR': '0.478', 'HITCOUNT': '0.720', 'WEAPON3': '0.750', 'weapon2': '1.486', 'weapon3': '1.714', 'DAMAGECOUNT': '2.154', 'FRAGCOUNT': '8.000'} [2023-02-24 18:21:57,342][177153] Updated weights for policy 0, policy_version 12100 (0.0008) [2023-02-24 18:21:58,756][177155] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 18:22:00,298][177153] Updated weights for policy 0, policy_version 12110 (0.0008) [2023-02-24 18:22:01,376][177119] Fps is (10 sec: 13926.2, 60 sec: 13926.4, 300 sec: 14009.7). Total num frames: 49614848. Throughput: 0: 3487.2. Samples: 12405228. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:22:01,376][177119] Avg episode reward: [(0, '8.121')] [2023-02-24 18:22:03,225][177153] Updated weights for policy 0, policy_version 12120 (0.0008) [2023-02-24 18:22:03,381][177170] DAMAGECOUNT value on done: 95385.0 [2023-02-24 18:22:03,382][177170] Sum rewards: 7.191, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.183', 'AMMO2': '0.020', 'AMMO5': '0.025', 'WEAPON1': '0.040', 'weapon7': '0.054', 'AMMO3': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.100', 'weapon5': '0.242', 'WEAPON5': '0.400', 'weapon4': '0.500', 'HITCOUNT': '0.690', 'WEAPON3': '0.700', 'weapon2': '1.176', 'weapon3': '1.382', 'DAMAGECOUNT': '3.045', 'FRAGCOUNT': '7.000'} [2023-02-24 18:22:03,673][177170] DAMAGECOUNT value on done: 87472.0 [2023-02-24 18:22:03,673][177170] Sum rewards: 8.151, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.028', 'AMMO2': '0.014', 'AMMO5': '0.017', 'weapon7': '0.030', 'WEAPON1': '0.060', 'AMMO4': '0.070', 'AMMO3': '0.144', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon5': '0.310', 'weapon4': '0.342', 'WEAPON5': '0.350', 'weapon2': '0.368', 'HITCOUNT': '0.740', 'WEAPON3': '0.900', 'weapon3': '2.444', 'DAMAGECOUNT': '3.069', 'FRAGCOUNT': '10.000'} [2023-02-24 18:22:03,682][177170] DAMAGECOUNT value on done: 97463.0 [2023-02-24 18:22:03,682][177170] Sum rewards: 6.397, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.471', 'ARMOR': '0.004', 'AMMO2': '0.020', 'AMMO5': '0.031', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.106', 'weapon4': '0.142', 'weapon5': '0.406', 'WEAPON5': '0.450', 'HITCOUNT': '0.470', 'WEAPON3': '0.700', 'weapon2': '0.876', 'weapon3': '2.122', 'DAMAGECOUNT': '2.799', 'FRAGCOUNT': '6.000'} [2023-02-24 18:22:03,977][177170] DAMAGECOUNT value on done: 97432.0 [2023-02-24 18:22:03,977][177170] Sum rewards: 6.717, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.630', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO3': '0.046', 'weapon7': '0.048', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.052', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.300', 'HITCOUNT': '0.370', 'weapon2': '0.456', 'weapon4': '0.704', 'weapon3': '0.848', 'DAMAGECOUNT': '1.455', 'FRAGCOUNT': '6.000'} [2023-02-24 18:22:04,596][177158] DAMAGECOUNT value on done: 93365.0 [2023-02-24 18:22:04,597][177158] Sum rewards: 11.626, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.292', 'AMMO5': '0.017', 'AMMO2': '0.021', 'WEAPON1': '0.050', 'weapon4': '0.078', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'AMMO4': '0.107', 'weapon5': '0.334', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.710', 'weapon2': '1.420', 'weapon3': '1.760', 'DAMAGECOUNT': '3.090', 'FRAGCOUNT': '10.000'} [2023-02-24 18:22:04,899][177158] DAMAGECOUNT value on done: 90745.0 [2023-02-24 18:22:04,899][177158] Sum rewards: 14.097, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.434', 'AMMO5': '0.013', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'AMMO3': '0.098', 'WEAPON4': '0.150', 'AMMO4': '0.160', 'weapon5': '0.256', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'weapon4': '0.470', 'WEAPON3': '0.700', 'weapon2': '0.956', 'HITCOUNT': '1.150', 'weapon3': '1.818', 'DAMAGECOUNT': '4.497', 'FRAGCOUNT': '11.000'} [2023-02-24 18:22:05,521][177158] DAMAGECOUNT value on done: 93292.0 [2023-02-24 18:22:05,522][177158] Sum rewards: 8.737, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.784', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'AMMO3': '0.084', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'weapon4': '0.100', 'WEAPON5': '0.300', 'weapon5': '0.350', 'WEAPON3': '0.650', 'HITCOUNT': '0.700', 'weapon2': '1.372', 'weapon3': '1.712', 'DAMAGECOUNT': '3.246', 'FRAGCOUNT': '7.500'} [2023-02-24 18:22:05,815][177158] DAMAGECOUNT value on done: 97330.0 [2023-02-24 18:22:05,815][177158] Sum rewards: 14.149, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.268', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.030', 'AMMO4': '0.047', 'weapon5': '0.078', 'AMMO3': '0.102', 'WEAPON5': '0.150', 'weapon7': '0.212', 'WEAPON4': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'weapon4': '0.494', 'WEAPON3': '0.650', 'HITCOUNT': '0.850', 'weapon2': '0.902', 'weapon3': '1.708', 'DAMAGECOUNT': '4.086', 'FRAGCOUNT': '13.000'} [2023-02-24 18:22:06,170][177153] Updated weights for policy 0, policy_version 12130 (0.0008) [2023-02-24 18:22:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 14009.7). Total num frames: 49684480. Throughput: 0: 3486.6. Samples: 12415720. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:22:06,376][177119] Avg episode reward: [(0, '8.305')] [2023-02-24 18:22:06,609][177172] DAMAGECOUNT value on done: 95756.0 [2023-02-24 18:22:06,609][177172] Sum rewards: 14.911, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.670', 'AMMO2': '0.017', 'AMMO5': '0.025', 'WEAPON1': '0.060', 'AMMO3': '0.072', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'weapon4': '0.200', 'weapon5': '0.422', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '1.030', 'weapon2': '1.396', 'weapon3': '1.676', 'DAMAGECOUNT': '4.545', 'FRAGCOUNT': '11.000'} [2023-02-24 18:22:06,903][177172] DAMAGECOUNT value on done: 93951.0 [2023-02-24 18:22:06,903][177172] Sum rewards: 12.447, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.624', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.030', 'WEAPON1': '0.040', 'AMMO3': '0.062', 'weapon7': '0.062', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.428', 'WEAPON3': '0.450', 'HITCOUNT': '0.760', 'weapon2': '1.346', 'weapon3': '1.440', 'DAMAGECOUNT': '2.877', 'FRAGCOUNT': '9.000'} [2023-02-24 18:22:07,500][177154] DAMAGECOUNT value on done: 98651.0 [2023-02-24 18:22:07,501][177154] Sum rewards: 7.338, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.626', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon7': '0.050', 'AMMO3': '0.094', 'AMMO4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.306', 'weapon5': '0.332', 'WEAPON5': '0.350', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'weapon2': '0.918', 'weapon3': '1.248', 'DAMAGECOUNT': '2.778', 'FRAGCOUNT': '6.000'} [2023-02-24 18:22:07,798][177154] DAMAGECOUNT value on done: 97186.0 [2023-02-24 18:22:07,798][177154] Sum rewards: 6.721, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.892', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO3': '0.076', 'weapon7': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.179', 'weapon5': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'weapon2': '0.622', 'weapon4': '0.706', 'HITCOUNT': '0.730', 'weapon3': '1.544', 'DAMAGECOUNT': '2.655', 'FRAGCOUNT': '6.000'} [2023-02-24 18:22:07,811][177154] DAMAGECOUNT value on done: 95510.0 [2023-02-24 18:22:07,811][177154] Sum rewards: 3.870, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.886', 'ARMOR': '0.008', 'AMMO2': '0.013', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.062', 'AMMO3': '0.160', 'weapon5': '0.264', 'WEAPON4': '0.350', 'weapon4': '0.452', 'WEAPON5': '0.500', 'weapon2': '0.536', 'HITCOUNT': '0.730', 'WEAPON3': '1.100', 'weapon3': '2.214', 'DAMAGECOUNT': '3.327', 'FRAGCOUNT': '9.000'} [2023-02-24 18:22:08,071][177172] DAMAGECOUNT value on done: 95631.0 [2023-02-24 18:22:08,072][177172] Sum rewards: 7.426, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.228', 'AMMO2': '0.016', 'AMMO5': '0.025', 'WEAPON1': '0.070', 'AMMO4': '0.079', 'AMMO3': '0.116', 'weapon5': '0.228', 'WEAPON4': '0.250', 'weapon4': '0.520', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'HITCOUNT': '0.860', 'weapon2': '0.886', 'weapon3': '1.656', 'DAMAGECOUNT': '3.798', 'FRAGCOUNT': '8.000'} [2023-02-24 18:22:08,112][177154] DAMAGECOUNT value on done: 100088.0 [2023-02-24 18:22:08,113][177154] Sum rewards: 13.695, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.500', 'AMMO2': '0.009', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'AMMO3': '0.087', 'weapon7': '0.100', 'weapon5': '0.186', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.284', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.640', 'weapon2': '1.058', 'weapon3': '1.600', 'DAMAGECOUNT': '3.753', 'FRAGCOUNT': '11.000'} [2023-02-24 18:22:08,368][177172] DAMAGECOUNT value on done: 92836.0 [2023-02-24 18:22:08,368][177172] Sum rewards: 0.565, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.970', 'AMMO2': '0.037', 'weapon7': '0.048', 'AMMO3': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.183', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'weapon4': '0.954', 'weapon2': '0.974', 'weapon3': '1.416', 'DAMAGECOUNT': '1.455', 'FRAGCOUNT': '2.000'} [2023-02-24 18:22:08,692][177171] DAMAGECOUNT value on done: 96577.0 [2023-02-24 18:22:08,692][177171] Sum rewards: 12.370, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.520', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.018', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'weapon4': '0.132', 'WEAPON5': '0.250', 'weapon5': '0.268', 'WEAPON3': '0.600', 'HITCOUNT': '0.880', 'weapon2': '1.308', 'weapon3': '1.924', 'DAMAGECOUNT': '3.525', 'FRAGCOUNT': '9.000'} [2023-02-24 18:22:08,788][177157] DAMAGECOUNT value on done: 97830.0 [2023-02-24 18:22:08,788][177157] Sum rewards: 8.993, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.376', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'AMMO4': '0.080', 'AMMO3': '0.134', 'weapon5': '0.156', 'WEAPON4': '0.200', 'weapon4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.710', 'WEAPON3': '0.900', 'weapon2': '1.024', 'weapon3': '2.148', 'DAMAGECOUNT': '3.141', 'FRAGCOUNT': '11.000'} [2023-02-24 18:22:08,799][177157] DAMAGECOUNT value on done: 93153.0 [2023-02-24 18:22:08,799][177157] Sum rewards: 9.816, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.352', 'AMMO2': '0.008', 'AMMO5': '0.017', 'AMMO4': '0.038', 'WEAPON1': '0.040', 'weapon7': '0.052', 'AMMO3': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'weapon5': '0.390', 'weapon4': '0.398', 'HITCOUNT': '0.450', 'ARMOR': '0.500', 'WEAPON3': '0.600', 'weapon2': '1.082', 'weapon3': '1.498', 'DAMAGECOUNT': '2.754', 'FRAGCOUNT': '8.000'} [2023-02-24 18:22:08,990][177171] DAMAGECOUNT value on done: 97134.0 [2023-02-24 18:22:08,990][177171] Sum rewards: 17.317, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.920', 'ARMOR': '0.004', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO5': '0.034', 'AMMO4': '0.062', 'AMMO3': '0.078', 'WEAPON4': '0.150', 'weapon4': '0.312', 'weapon5': '0.496', 'WEAPON3': '0.600', 'WEAPON5': '0.600', 'HITCOUNT': '0.820', 'weapon2': '1.134', 'weapon3': '1.500', 'DAMAGECOUNT': '5.415', 'FRAGCOUNT': '13.000'} [2023-02-24 18:22:09,087][177153] Updated weights for policy 0, policy_version 12140 (0.0009) [2023-02-24 18:22:09,092][177157] DAMAGECOUNT value on done: 93459.0 [2023-02-24 18:22:09,092][177157] Sum rewards: 13.995, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.090', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.040', 'AMMO3': '0.101', 'weapon5': '0.130', 'WEAPON5': '0.200', 'WEAPON3': '0.750', 'HITCOUNT': '0.770', 'weapon2': '1.772', 'weapon3': '1.834', 'DAMAGECOUNT': '3.240', 'FRAGCOUNT': '13.000'} [2023-02-24 18:22:09,103][177157] DAMAGECOUNT value on done: 92130.0 [2023-02-24 18:22:09,104][177157] Sum rewards: 1.846, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.308', 'AMMO2': '0.012', 'AMMO5': '0.022', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO4': '0.061', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.124', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.272', 'HITCOUNT': '0.510', 'weapon5': '0.540', 'WEAPON5': '0.650', 'WEAPON3': '0.850', 'weapon2': '0.944', 'weapon3': '1.686', 'DAMAGECOUNT': '2.442', 'FRAGCOUNT': '5.000'} [2023-02-24 18:22:09,272][177171] DAMAGECOUNT value on done: 92533.0 [2023-02-24 18:22:09,272][177171] Sum rewards: 9.497, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.762', 'AMMO2': '0.011', 'AMMO5': '0.019', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.128', 'weapon4': '0.156', 'weapon5': '0.234', 'WEAPON5': '0.400', 'HITCOUNT': '0.770', 'WEAPON3': '0.850', 'weapon2': '1.398', 'weapon3': '1.878', 'DAMAGECOUNT': '3.759', 'FRAGCOUNT': '8.000'} [2023-02-24 18:22:09,560][177171] DAMAGECOUNT value on done: 91677.0 [2023-02-24 18:22:09,560][177171] Sum rewards: 0.900, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.380', 'AMMO5': '0.029', 'AMMO2': '0.038', 'weapon7': '0.050', 'WEAPON1': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.148', 'weapon5': '0.176', 'AMMO4': '0.188', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'ARMOR': '0.404', 'WEAPON5': '0.650', 'weapon2': '0.698', 'HITCOUNT': '0.790', 'weapon4': '0.926', 'WEAPON3': '0.950', 'weapon3': '1.486', 'DAMAGECOUNT': '3.087', 'FRAGCOUNT': '6.500'} [2023-02-24 18:22:09,881][177155] DAMAGECOUNT value on done: 95753.0 [2023-02-24 18:22:09,881][177155] Sum rewards: 1.644, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.104', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon7': '0.052', 'AMMO3': '0.057', 'weapon5': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'WEAPON4': '0.250', 'HITCOUNT': '0.260', 'WEAPON3': '0.300', 'weapon4': '0.470', 'weapon3': '0.902', 'weapon2': '1.240', 'DAMAGECOUNT': '1.461', 'FRAGCOUNT': '2.000'} [2023-02-24 18:22:10,174][177155] DAMAGECOUNT value on done: 99561.0 [2023-02-24 18:22:10,174][177155] Sum rewards: 7.484, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.254', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.075', 'AMMO3': '0.080', 'weapon4': '0.144', 'WEAPON4': '0.200', 'weapon5': '0.264', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.630', 'weapon3': '1.522', 'weapon2': '1.702', 'DAMAGECOUNT': '2.406', 'FRAGCOUNT': '6.000'} [2023-02-24 18:22:10,461][177155] DAMAGECOUNT value on done: 97827.0 [2023-02-24 18:22:10,461][177155] Sum rewards: 9.623, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.701', 'AMMO2': '0.008', 'AMMO5': '0.020', 'AMMO4': '0.039', 'AMMO3': '0.092', 'WEAPON1': '0.100', 'weapon5': '0.338', 'HITCOUNT': '0.420', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'weapon2': '1.086', 'weapon3': '2.070', 'DAMAGECOUNT': '2.751', 'FRAGCOUNT': '9.000'} [2023-02-24 18:22:10,757][177155] DAMAGECOUNT value on done: 92544.0 [2023-02-24 18:22:10,757][177155] Sum rewards: 2.418, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.548', 'AMMO2': '0.006', 'AMMO5': '0.022', 'AMMO4': '0.031', 'weapon7': '0.054', 'WEAPON1': '0.070', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.194', 'WEAPON7': '0.200', 'weapon5': '0.244', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.570', 'weapon2': '0.828', 'weapon3': '1.550', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.481'} [2023-02-24 18:22:11,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13926.4, 300 sec: 14009.7). Total num frames: 49754112. Throughput: 0: 3488.4. Samples: 12436614. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:22:11,376][177119] Avg episode reward: [(0, '8.186')] [2023-02-24 18:22:12,032][177153] Updated weights for policy 0, policy_version 12150 (0.0009) [2023-02-24 18:22:14,977][177153] Updated weights for policy 0, policy_version 12160 (0.0008) [2023-02-24 18:22:15,872][177156] DAMAGECOUNT value on done: 94314.0 [2023-02-24 18:22:15,872][177156] Sum rewards: 8.944, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.060', 'AMMO4': '0.061', 'weapon7': '0.108', 'AMMO3': '0.131', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.224', 'HEALTH': '0.236', 'WEAPON5': '0.300', 'HITCOUNT': '0.730', 'WEAPON3': '0.750', 'weapon2': '0.848', 'weapon3': '2.258', 'DAMAGECOUNT': '2.790', 'FRAGCOUNT': '8.000'} [2023-02-24 18:22:16,093][177156] DAMAGECOUNT value on done: 94846.0 [2023-02-24 18:22:16,094][177156] Sum rewards: 5.659, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.968', 'AMMO5': '0.025', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'AMMO3': '0.103', 'AMMO4': '0.145', 'WEAPON4': '0.350', 'weapon4': '0.474', 'WEAPON5': '0.500', 'weapon5': '0.558', 'HITCOUNT': '0.600', 'WEAPON3': '0.700', 'weapon2': '0.808', 'weapon3': '1.754', 'DAMAGECOUNT': '3.300', 'FRAGCOUNT': '7.000'} [2023-02-24 18:22:16,180][177156] DAMAGECOUNT value on done: 96063.0 [2023-02-24 18:22:16,180][177156] Sum rewards: 6.894, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.655', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'AMMO3': '0.065', 'weapon7': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.286', 'HITCOUNT': '0.360', 'WEAPON3': '0.600', 'weapon3': '1.332', 'DAMAGECOUNT': '1.539', 'weapon2': '2.060', 'FRAGCOUNT': '6.000'} [2023-02-24 18:22:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 14009.7). Total num frames: 49823744. Throughput: 0: 3488.8. Samples: 12457578. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:22:16,376][177119] Avg episode reward: [(0, '8.060')] [2023-02-24 18:22:16,404][177156] DAMAGECOUNT value on done: 94296.0 [2023-02-24 18:22:16,405][177156] Sum rewards: 6.393, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.624', 'AMMO5': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.074', 'AMMO3': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.308', 'weapon4': '0.412', 'HITCOUNT': '0.510', 'WEAPON3': '0.550', 'weapon2': '0.564', 'ARMOR': '0.855', 'weapon3': '1.350', 'DAMAGECOUNT': '2.394', 'FRAGCOUNT': '7.000'} [2023-02-24 18:22:17,894][177153] Updated weights for policy 0, policy_version 12170 (0.0008) [2023-02-24 18:22:20,797][177153] Updated weights for policy 0, policy_version 12180 (0.0008) [2023-02-24 18:22:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13995.8). Total num frames: 49893376. Throughput: 0: 3488.8. Samples: 12468084. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:22:21,376][177119] Avg episode reward: [(0, '7.973')] [2023-02-24 18:22:22,652][177170] DAMAGECOUNT value on done: 96288.0 [2023-02-24 18:22:22,653][177170] Sum rewards: 8.747, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.010', 'weapon7': '0.006', 'AMMO5': '0.015', 'AMMO2': '0.020', 'WEAPON1': '0.070', 'weapon4': '0.084', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.278', 'WEAPON5': '0.350', 'HITCOUNT': '0.680', 'WEAPON3': '0.700', 'weapon2': '1.126', 'weapon3': '2.068', 'DAMAGECOUNT': '2.709', 'FRAGCOUNT': '7.500'} [2023-02-24 18:22:22,940][177170] DAMAGECOUNT value on done: 88774.0 [2023-02-24 18:22:22,940][177170] Sum rewards: 12.938, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.137', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.018', 'WEAPON1': '0.050', 'AMMO3': '0.070', 'weapon7': '0.076', 'AMMO4': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.154', 'weapon4': '0.376', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'HITCOUNT': '0.750', 'weapon2': '1.294', 'weapon3': '1.620', 'DAMAGECOUNT': '3.906', 'FRAGCOUNT': '9.500'} [2023-02-24 18:22:22,950][177170] DAMAGECOUNT value on done: 98582.0 [2023-02-24 18:22:22,950][177170] Sum rewards: 12.714, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.007', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.036', 'weapon7': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.226', 'WEAPON5': '0.350', 'weapon5': '0.432', 'WEAPON3': '0.550', 'HEALTH': '0.630', 'weapon2': '0.868', 'HITCOUNT': '0.970', 'weapon3': '2.040', 'DAMAGECOUNT': '3.357', 'FRAGCOUNT': '10.000'} [2023-02-24 18:22:23,255][177170] DAMAGECOUNT value on done: 98126.0 [2023-02-24 18:22:23,255][177170] Sum rewards: 0.393, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.544', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon5': '0.036', 'weapon7': '0.104', 'AMMO4': '0.131', 'AMMO3': '0.154', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'weapon4': '0.260', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.540', 'WEAPON3': '1.050', 'weapon2': '1.138', 'DAMAGECOUNT': '2.082', 'weapon3': '2.088', 'FRAGCOUNT': '6.000'} [2023-02-24 18:22:23,715][177153] Updated weights for policy 0, policy_version 12190 (0.0009) [2023-02-24 18:22:23,788][177158] DAMAGECOUNT value on done: 93986.0 [2023-02-24 18:22:23,788][177158] Sum rewards: 5.819, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.612', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.019', 'weapon7': '0.056', 'weapon5': '0.056', 'AMMO3': '0.057', 'AMMO4': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.390', 'WEAPON3': '0.400', 'weapon2': '0.634', 'weapon4': '0.650', 'weapon3': '1.104', 'DAMAGECOUNT': '1.863', 'FRAGCOUNT': '5.000'} [2023-02-24 18:22:24,089][177158] DAMAGECOUNT value on done: 91654.0 [2023-02-24 18:22:24,089][177158] Sum rewards: 9.655, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.632', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO3': '0.071', 'AMMO4': '0.102', 'weapon7': '0.134', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.696', 'HITCOUNT': '0.770', 'weapon2': '0.928', 'weapon3': '1.082', 'DAMAGECOUNT': '2.727', 'FRAGCOUNT': '8.000'} [2023-02-24 18:22:24,689][177158] DAMAGECOUNT value on done: 93880.0 [2023-02-24 18:22:24,689][177158] Sum rewards: 0.629, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.120', 'AMMO2': '0.022', 'AMMO5': '0.025', 'weapon5': '0.032', 'WEAPON1': '0.070', 'weapon7': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.107', 'AMMO4': '0.111', 'WEAPON4': '0.250', 'ARMOR': '0.462', 'weapon2': '0.478', 'HITCOUNT': '0.490', 'WEAPON5': '0.500', 'weapon4': '0.622', 'WEAPON3': '0.650', 'weapon3': '1.294', 'DAMAGECOUNT': '1.764', 'FRAGCOUNT': '2.000'} [2023-02-24 18:22:24,986][177158] DAMAGECOUNT value on done: 98671.0 [2023-02-24 18:22:24,986][177158] Sum rewards: 13.668, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.260', 'AMMO2': '0.008', 'weapon7': '0.008', 'weapon4': '0.014', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.039', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.450', 'weapon5': '0.516', 'HITCOUNT': '0.810', 'WEAPON3': '0.850', 'weapon2': '1.462', 'weapon3': '1.638', 'DAMAGECOUNT': '4.023', 'FRAGCOUNT': '12.000'} [2023-02-24 18:22:25,782][177172] DAMAGECOUNT value on done: 96512.0 [2023-02-24 18:22:25,783][177172] Sum rewards: 7.883, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.950', 'AMMO2': '0.018', 'AMMO5': '0.036', 'WEAPON1': '0.060', 'AMMO4': '0.089', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.216', 'ARMOR': '0.422', 'weapon5': '0.496', 'HITCOUNT': '0.600', 'WEAPON5': '0.700', 'WEAPON3': '0.750', 'weapon2': '1.330', 'weapon3': '1.550', 'DAMAGECOUNT': '2.268', 'FRAGCOUNT': '6.500'} [2023-02-24 18:22:26,080][177172] DAMAGECOUNT value on done: 94656.0 [2023-02-24 18:22:26,081][177172] Sum rewards: 6.352, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.015', 'AMMO2': '0.013', 'AMMO5': '0.025', 'WEAPON1': '0.030', 'AMMO4': '0.064', 'AMMO3': '0.073', 'weapon7': '0.098', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'weapon5': '0.254', 'WEAPON7': '0.300', 'WEAPON5': '0.450', 'ARMOR': '0.463', 'HITCOUNT': '0.490', 'WEAPON3': '0.550', 'weapon4': '0.650', 'weapon2': '0.660', 'weapon3': '1.442', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '5.000'} [2023-02-24 18:22:26,376][177119] Fps is (10 sec: 14335.9, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 49967104. Throughput: 0: 3491.2. Samples: 12489072. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:22:26,376][177119] Avg episode reward: [(0, '7.976')] [2023-02-24 18:22:26,639][177153] Updated weights for policy 0, policy_version 12200 (0.0008) [2023-02-24 18:22:26,743][177154] DAMAGECOUNT value on done: 99375.0 [2023-02-24 18:22:26,744][177154] Sum rewards: 7.131, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.240', 'AMMO2': '0.005', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.027', 'AMMO3': '0.049', 'WEAPON4': '0.100', 'weapon7': '0.128', 'weapon5': '0.186', 'weapon4': '0.230', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.300', 'HITCOUNT': '0.330', 'WEAPON3': '0.350', 'WEAPON7': '0.400', 'weapon3': '0.756', 'weapon2': '1.322', 'DAMAGECOUNT': '2.172', 'FRAGCOUNT': '6.000'} [2023-02-24 18:22:27,035][177154] DAMAGECOUNT value on done: 98021.0 [2023-02-24 18:22:27,035][177154] Sum rewards: 6.767, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.986', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.026', 'AMMO5': '0.030', 'weapon7': '0.048', 'WEAPON4': '0.050', 'weapon4': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.131', 'weapon5': '0.230', 'HITCOUNT': '0.530', 'WEAPON5': '0.700', 'weapon2': '0.834', 'WEAPON3': '0.900', 'weapon3': '2.366', 'DAMAGECOUNT': '2.505', 'FRAGCOUNT': '8.000'} [2023-02-24 18:22:27,049][177154] DAMAGECOUNT value on done: 96833.0 [2023-02-24 18:22:27,050][177154] Sum rewards: 12.840, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.046', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon7': '0.048', 'weapon5': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.108', 'AMMO4': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.646', 'WEAPON3': '0.750', 'weapon4': '0.818', 'HITCOUNT': '1.110', 'weapon3': '1.768', 'DAMAGECOUNT': '3.969', 'FRAGCOUNT': '11.000'} [2023-02-24 18:22:27,274][177172] DAMAGECOUNT value on done: 96549.0 [2023-02-24 18:22:27,275][177172] Sum rewards: 6.428, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.007', 'weapon5': '0.020', 'ARMOR': '0.028', 'AMMO2': '0.030', 'WEAPON1': '0.030', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.126', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'HEALTH': '0.408', 'weapon4': '0.612', 'HITCOUNT': '0.670', 'WEAPON3': '0.700', 'weapon2': '0.818', 'weapon3': '1.758', 'DAMAGECOUNT': '2.754', 'FRAGCOUNT': '8.000'} [2023-02-24 18:22:27,278][177158] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-24 18:22:27,352][177154] DAMAGECOUNT value on done: 101510.0 [2023-02-24 18:22:27,353][177154] Sum rewards: 13.969, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.150', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon7': '0.052', 'AMMO3': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.119', 'weapon5': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.404', 'weapon4': '0.582', 'WEAPON3': '0.600', 'weapon2': '0.860', 'HITCOUNT': '1.050', 'weapon3': '1.600', 'DAMAGECOUNT': '4.266', 'FRAGCOUNT': '11.000'} [2023-02-24 18:22:27,574][177172] DAMAGECOUNT value on done: 94966.0 [2023-02-24 18:22:27,575][177172] Sum rewards: 16.123, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.068', 'AMMO2': '0.013', 'AMMO5': '0.022', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO4': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.108', 'weapon5': '0.144', 'WEAPON4': '0.200', 'weapon4': '0.228', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'weapon2': '0.872', 'HITCOUNT': '1.100', 'weapon3': '2.352', 'DAMAGECOUNT': '4.590', 'FRAGCOUNT': '14.000'} [2023-02-24 18:22:27,949][177171] DAMAGECOUNT value on done: 97168.0 [2023-02-24 18:22:27,950][177171] Sum rewards: 4.627, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.866', 'AMMO5': '0.015', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'AMMO3': '0.075', 'AMMO4': '0.126', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon5': '0.400', 'ARMOR': '0.405', 'HITCOUNT': '0.460', 'WEAPON3': '0.550', 'weapon4': '0.640', 'weapon2': '0.976', 'weapon3': '1.568', 'DAMAGECOUNT': '1.773', 'FRAGCOUNT': '4.500'} [2023-02-24 18:22:28,130][177157] DAMAGECOUNT value on done: 98932.0 [2023-02-24 18:22:28,131][177157] Sum rewards: 12.930, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.189', 'ARMOR': '0.004', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon7': '0.054', 'AMMO3': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.108', 'AMMO4': '0.142', 'WEAPON4': '0.200', 'weapon4': '0.338', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.860', 'weapon2': '1.316', 'weapon3': '1.698', 'DAMAGECOUNT': '3.306', 'FRAGCOUNT': '12.000'} [2023-02-24 18:22:28,142][177157] DAMAGECOUNT value on done: 94643.0 [2023-02-24 18:22:28,143][177157] Sum rewards: 12.529, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.034', 'AMMO2': '0.009', 'AMMO5': '0.028', 'weapon4': '0.034', 'WEAPON1': '0.040', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon5': '0.274', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'weapon2': '0.972', 'HITCOUNT': '1.080', 'weapon3': '2.292', 'DAMAGECOUNT': '4.470', 'FRAGCOUNT': '11.000'} [2023-02-24 18:22:28,247][177171] DAMAGECOUNT value on done: 98037.0 [2023-02-24 18:22:28,248][177171] Sum rewards: 4.115, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.418', 'AMMO2': '0.010', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.052', 'AMMO3': '0.130', 'WEAPON4': '0.200', 'weapon5': '0.274', 'WEAPON5': '0.400', 'weapon4': '0.430', 'HITCOUNT': '0.640', 'weapon2': '0.804', 'WEAPON3': '0.850', 'weapon3': '1.744', 'DAMAGECOUNT': '2.709', 'FRAGCOUNT': '7.000'} [2023-02-24 18:22:28,435][177157] DAMAGECOUNT value on done: 94988.0 [2023-02-24 18:22:28,435][177157] Sum rewards: 15.579, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.630', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.045', 'weapon7': '0.058', 'AMMO3': '0.099', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.230', 'weapon4': '0.290', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'weapon2': '0.826', 'HITCOUNT': '1.280', 'weapon3': '1.836', 'DAMAGECOUNT': '4.587', 'FRAGCOUNT': '12.000'} [2023-02-24 18:22:28,445][177157] DAMAGECOUNT value on done: 93605.0 [2023-02-24 18:22:28,446][177157] Sum rewards: 12.834, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.650', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'AMMO2': '0.064', 'weapon7': '0.064', 'weapon5': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.135', 'AMMO4': '0.319', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.614', 'weapon4': '0.738', 'WEAPON3': '0.900', 'HITCOUNT': '1.110', 'weapon3': '2.012', 'DAMAGECOUNT': '4.425', 'FRAGCOUNT': '14.000'} [2023-02-24 18:22:28,529][177171] DAMAGECOUNT value on done: 93197.0 [2023-02-24 18:22:28,530][177171] Sum rewards: 3.739, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.265', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'AMMO3': '0.080', 'AMMO4': '0.105', 'weapon7': '0.108', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'HITCOUNT': '0.350', 'weapon4': '0.378', 'weapon5': '0.392', 'WEAPON7': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon2': '0.962', 'weapon3': '1.630', 'DAMAGECOUNT': '1.992', 'FRAGCOUNT': '5.000'} [2023-02-24 18:22:28,829][177171] DAMAGECOUNT value on done: 92024.0 [2023-02-24 18:22:28,830][177171] Sum rewards: -2.068, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.130', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO2': '0.033', 'weapon7': '0.046', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.112', 'AMMO4': '0.166', 'HITCOUNT': '0.170', 'weapon5': '0.224', 'WEAPON4': '0.250', 'weapon4': '0.272', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.750', 'weapon2': '1.394', 'FRAGCOUNT': '1.500', 'weapon3': '1.694'} [2023-02-24 18:22:29,149][177155] DAMAGECOUNT value on done: 96893.0 [2023-02-24 18:22:29,149][177155] Sum rewards: 8.274, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.796', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'weapon4': '0.074', 'weapon5': '0.108', 'AMMO4': '0.116', 'AMMO3': '0.139', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.850', 'HITCOUNT': '0.900', 'weapon2': '1.382', 'weapon3': '2.190', 'DAMAGECOUNT': '3.420', 'FRAGCOUNT': '10.000'} [2023-02-24 18:22:29,440][177155] DAMAGECOUNT value on done: 100687.0 [2023-02-24 18:22:29,440][177155] Sum rewards: 9.812, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.276', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.096', 'AMMO4': '0.122', 'weapon5': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'weapon4': '0.548', 'WEAPON3': '0.650', 'HITCOUNT': '0.820', 'weapon2': '0.964', 'weapon3': '1.692', 'DAMAGECOUNT': '3.378', 'FRAGCOUNT': '9.000'} [2023-02-24 18:22:29,577][177153] Updated weights for policy 0, policy_version 12210 (0.0009) [2023-02-24 18:22:29,728][177155] DAMAGECOUNT value on done: 98922.0 [2023-02-24 18:22:29,728][177155] Sum rewards: 7.795, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.226', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.032', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.116', 'AMMO3': '0.165', 'weapon5': '0.226', 'WEAPON5': '0.650', 'HITCOUNT': '0.870', 'WEAPON3': '1.000', 'weapon2': '1.534', 'weapon3': '1.736', 'DAMAGECOUNT': '3.285', 'FRAGCOUNT': '9.000'} [2023-02-24 18:22:30,033][177155] DAMAGECOUNT value on done: 93738.0 [2023-02-24 18:22:30,033][177155] Sum rewards: 9.474, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.100', 'AMMO2': '0.022', 'AMMO5': '0.027', 'weapon7': '0.058', 'WEAPON1': '0.060', 'weapon4': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.151', 'weapon5': '0.196', 'WEAPON5': '0.550', 'HITCOUNT': '0.920', 'WEAPON3': '1.050', 'weapon2': '1.478', 'weapon3': '1.904', 'DAMAGECOUNT': '3.582', 'FRAGCOUNT': '10.000'} [2023-02-24 18:22:31,376][177119] Fps is (10 sec: 14335.9, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 50036736. Throughput: 0: 3490.7. Samples: 12510026. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:22:31,376][177119] Avg episode reward: [(0, '8.291')] [2023-02-24 18:22:32,483][177153] Updated weights for policy 0, policy_version 12220 (0.0009) [2023-02-24 18:22:35,090][177156] DAMAGECOUNT value on done: 95663.0 [2023-02-24 18:22:35,091][177156] Sum rewards: 11.455, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.705', 'AMMO5': '0.025', 'AMMO2': '0.025', 'weapon7': '0.054', 'WEAPON1': '0.060', 'AMMO3': '0.089', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.126', 'weapon5': '0.142', 'weapon4': '0.296', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.780', 'weapon3': '1.546', 'weapon2': '1.650', 'DAMAGECOUNT': '3.867', 'FRAGCOUNT': '8.000'} [2023-02-24 18:22:35,315][177156] DAMAGECOUNT value on done: 96254.0 [2023-02-24 18:22:35,316][177156] Sum rewards: 10.259, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.693', 'ARMOR': '0.004', 'AMMO2': '0.012', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.057', 'weapon7': '0.064', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.135', 'weapon5': '0.158', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.606', 'weapon4': '0.666', 'HITCOUNT': '0.750', 'WEAPON3': '0.800', 'weapon3': '1.386', 'DAMAGECOUNT': '4.224', 'FRAGCOUNT': '10.000'} [2023-02-24 18:22:35,402][177153] Updated weights for policy 0, policy_version 12230 (0.0009) [2023-02-24 18:22:35,403][177156] DAMAGECOUNT value on done: 96703.0 [2023-02-24 18:22:35,403][177156] Sum rewards: 6.835, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.011', 'AMMO5': '0.017', 'HEALTH': '0.020', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'weapon4': '0.208', 'WEAPON5': '0.250', 'weapon5': '0.324', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.440', 'weapon2': '1.140', 'weapon3': '1.268', 'DAMAGECOUNT': '1.920', 'FRAGCOUNT': '4.000'} [2023-02-24 18:22:35,620][177156] DAMAGECOUNT value on done: 95533.0 [2023-02-24 18:22:35,621][177156] Sum rewards: 10.183, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.990', 'AMMO5': '0.022', 'AMMO2': '0.031', 'WEAPON1': '0.050', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'AMMO4': '0.155', 'weapon5': '0.224', 'weapon4': '0.404', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'HITCOUNT': '0.850', 'weapon2': '0.980', 'weapon3': '1.786', 'DAMAGECOUNT': '3.711', 'FRAGCOUNT': '9.000'} [2023-02-24 18:22:36,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 50106368. Throughput: 0: 3493.1. Samples: 12520584. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:22:36,376][177119] Avg episode reward: [(0, '8.357')] [2023-02-24 18:22:38,323][177153] Updated weights for policy 0, policy_version 12240 (0.0008) [2023-02-24 18:22:41,269][177153] Updated weights for policy 0, policy_version 12250 (0.0008) [2023-02-24 18:22:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 50176000. Throughput: 0: 3495.3. Samples: 12541612. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:22:41,376][177119] Avg episode reward: [(0, '8.357')] [2023-02-24 18:22:41,659][177170] DAMAGECOUNT value on done: 96794.0 [2023-02-24 18:22:41,659][177170] Sum rewards: 3.774, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.680', 'ARMOR': '0.008', 'AMMO2': '0.009', 'AMMO3': '0.020', 'AMMO4': '0.043', 'weapon7': '0.104', 'WEAPON3': '0.150', 'weapon2': '0.168', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'weapon3': '0.342', 'HITCOUNT': '0.370', 'WEAPON7': '0.400', 'weapon4': '0.542', 'DAMAGECOUNT': '1.518', 'FRAGCOUNT': '3.000'} [2023-02-24 18:22:41,958][177170] DAMAGECOUNT value on done: 99549.0 [2023-02-24 18:22:41,959][177170] Sum rewards: 11.623, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.620', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon7': '0.054', 'AMMO3': '0.072', 'AMMO4': '0.079', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.162', 'weapon2': '0.394', 'weapon4': '0.394', 'WEAPON3': '0.500', 'HITCOUNT': '0.530', 'weapon3': '1.128', 'DAMAGECOUNT': '2.901', 'FRAGCOUNT': '10.000'} [2023-02-24 18:22:42,025][177170] DAMAGECOUNT value on done: 89259.0 [2023-02-24 18:22:42,026][177170] Sum rewards: 3.380, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.005', 'ARMOR': '0.004', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.027', 'weapon5': '0.056', 'weapon7': '0.068', 'AMMO3': '0.081', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.450', 'weapon4': '0.506', 'WEAPON3': '0.550', 'weapon2': '1.086', 'weapon3': '1.178', 'DAMAGECOUNT': '1.455', 'FRAGCOUNT': '4.000'} [2023-02-24 18:22:42,315][177170] DAMAGECOUNT value on done: 98830.0 [2023-02-24 18:22:42,315][177170] Sum rewards: 1.462, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.748', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.015', 'WEAPON1': '0.030', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'weapon5': '0.110', 'weapon7': '0.118', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.234', 'WEAPON7': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.580', 'FRAGCOUNT': '1.000', 'weapon2': '1.094', 'weapon3': '1.282', 'DAMAGECOUNT': '2.112'} [2023-02-24 18:22:42,964][177158] DAMAGECOUNT value on done: 94221.0 [2023-02-24 18:22:42,965][177158] Sum rewards: 2.974, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.738', 'AMMO2': '0.010', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.054', 'weapon7': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.230', 'HITCOUNT': '0.250', 'weapon4': '0.254', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'weapon2': '0.496', 'DAMAGECOUNT': '0.705', 'weapon3': '1.202', 'FRAGCOUNT': '3.000'} [2023-02-24 18:22:43,265][177158] DAMAGECOUNT value on done: 93023.0 [2023-02-24 18:22:43,266][177158] Sum rewards: 12.206, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.809', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.068', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'weapon7': '0.116', 'WEAPON5': '0.200', 'weapon4': '0.234', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.850', 'weapon3': '1.604', 'weapon2': '1.618', 'DAMAGECOUNT': '4.071', 'FRAGCOUNT': '10.000'} [2023-02-24 18:22:43,871][177158] DAMAGECOUNT value on done: 95078.0 [2023-02-24 18:22:43,872][177158] Sum rewards: 14.518, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.474', 'AMMO2': '0.017', 'AMMO5': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.097', 'WEAPON1': '0.100', 'weapon4': '0.202', 'weapon5': '0.368', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'HITCOUNT': '0.830', 'weapon2': '0.980', 'weapon3': '1.798', 'DAMAGECOUNT': '3.594', 'FRAGCOUNT': '14.000'} [2023-02-24 18:22:44,172][177158] DAMAGECOUNT value on done: 99415.0 [2023-02-24 18:22:44,172][177158] Sum rewards: 6.784, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.119', 'AMMO2': '0.006', 'AMMO5': '0.007', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.051', 'weapon7': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.186', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.550', 'weapon2': '1.114', 'weapon3': '1.258', 'DAMAGECOUNT': '2.232', 'FRAGCOUNT': '3.500'} [2023-02-24 18:22:44,217][177153] Updated weights for policy 0, policy_version 12260 (0.0008) [2023-02-24 18:22:45,030][177172] DAMAGECOUNT value on done: 97759.0 [2023-02-24 18:22:45,030][177172] Sum rewards: 11.225, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.640', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.036', 'WEAPON1': '0.060', 'AMMO3': '0.094', 'weapon7': '0.116', 'AMMO4': '0.182', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.286', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.484', 'WEAPON3': '0.600', 'HITCOUNT': '0.720', 'weapon2': '1.218', 'weapon3': '1.570', 'DAMAGECOUNT': '3.741', 'FRAGCOUNT': '9.000'} [2023-02-24 18:22:45,320][177172] DAMAGECOUNT value on done: 95181.0 [2023-02-24 18:22:45,320][177172] Sum rewards: 4.295, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.550', 'AMMO2': '0.011', 'AMMO5': '0.015', 'ARMOR': '0.035', 'AMMO4': '0.057', 'AMMO3': '0.060', 'WEAPON1': '0.060', 'weapon4': '0.098', 'WEAPON4': '0.200', 'weapon5': '0.238', 'WEAPON5': '0.300', 'HITCOUNT': '0.440', 'WEAPON3': '0.500', 'weapon3': '1.556', 'DAMAGECOUNT': '1.575', 'weapon2': '1.700', 'FRAGCOUNT': '5.000'} [2023-02-24 18:22:46,025][177154] DAMAGECOUNT value on done: 99785.0 [2023-02-24 18:22:46,025][177154] Sum rewards: 1.250, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.180', 'AMMO2': '0.017', 'AMMO5': '0.017', 'WEAPON1': '0.050', 'AMMO3': '0.071', 'AMMO4': '0.084', 'weapon5': '0.096', 'WEAPON5': '0.250', 'HITCOUNT': '0.360', 'WEAPON4': '0.400', 'ARMOR': '0.465', 'WEAPON3': '0.550', 'weapon4': '0.566', 'DAMAGECOUNT': '1.230', 'weapon3': '1.268', 'weapon2': '1.756', 'FRAGCOUNT': '3.000'} [2023-02-24 18:22:46,327][177154] DAMAGECOUNT value on done: 99758.0 [2023-02-24 18:22:46,328][177154] Sum rewards: 16.091, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.182', 'AMMO5': '0.019', 'AMMO2': '0.020', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.101', 'AMMO3': '0.123', 'weapon4': '0.208', 'weapon5': '0.218', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'weapon2': '0.976', 'HITCOUNT': '1.160', 'weapon3': '2.286', 'DAMAGECOUNT': '5.211', 'FRAGCOUNT': '13.000'} [2023-02-24 18:22:46,341][177154] DAMAGECOUNT value on done: 97970.0 [2023-02-24 18:22:46,342][177154] Sum rewards: 10.350, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.260', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO3': '0.078', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'weapon7': '0.112', 'WEAPON5': '0.150', 'weapon5': '0.158', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.330', 'WEAPON3': '0.500', 'HITCOUNT': '0.730', 'weapon2': '0.794', 'weapon3': '1.284', 'DAMAGECOUNT': '3.411', 'FRAGCOUNT': '9.000'} [2023-02-24 18:22:46,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 50245632. Throughput: 0: 3493.8. Samples: 12562448. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:22:46,376][177119] Avg episode reward: [(0, '8.316')] [2023-02-24 18:22:46,480][177172] DAMAGECOUNT value on done: 97523.0 [2023-02-24 18:22:46,481][177172] Sum rewards: 5.522, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.466', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'weapon7': '0.066', 'AMMO4': '0.080', 'weapon4': '0.082', 'AMMO3': '0.111', 'WEAPON4': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon5': '0.234', 'WEAPON5': '0.250', 'HITCOUNT': '0.670', 'WEAPON3': '0.700', 'weapon2': '1.274', 'weapon3': '1.862', 'DAMAGECOUNT': '2.922', 'FRAGCOUNT': '6.000'} [2023-02-24 18:22:46,647][177154] DAMAGECOUNT value on done: 102899.0 [2023-02-24 18:22:46,648][177154] Sum rewards: 12.466, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.231', 'AMMO2': '0.015', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.114', 'weapon5': '0.180', 'weapon4': '0.202', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'HITCOUNT': '1.070', 'weapon2': '1.206', 'weapon3': '2.064', 'DAMAGECOUNT': '4.167', 'FRAGCOUNT': '10.000'} [2023-02-24 18:22:46,775][177172] DAMAGECOUNT value on done: 95906.0 [2023-02-24 18:22:46,775][177172] Sum rewards: 10.537, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.760', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO4': '0.035', 'weapon7': '0.048', 'weapon5': '0.068', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.466', 'WEAPON3': '0.650', 'HITCOUNT': '0.840', 'ARMOR': '0.965', 'weapon2': '1.174', 'weapon3': '1.736', 'DAMAGECOUNT': '2.820', 'FRAGCOUNT': '9.000'} [2023-02-24 18:22:47,138][177171] DAMAGECOUNT value on done: 98118.0 [2023-02-24 18:22:47,138][177171] Sum rewards: 9.715, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.150', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'weapon5': '0.058', 'weapon7': '0.062', 'weapon4': '0.092', 'AMMO3': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.300', 'HITCOUNT': '0.500', 'WEAPON3': '0.650', 'weapon3': '1.490', 'weapon2': '2.098', 'DAMAGECOUNT': '2.850', 'FRAGCOUNT': '9.000'} [2023-02-24 18:22:47,171][177153] Updated weights for policy 0, policy_version 12270 (0.0008) [2023-02-24 18:22:47,417][177157] DAMAGECOUNT value on done: 100367.0 [2023-02-24 18:22:47,418][177157] Sum rewards: 13.097, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.618', 'weapon7': '0.004', 'ARMOR': '0.012', 'AMMO2': '0.014', 'AMMO5': '0.022', 'WEAPON1': '0.050', 'AMMO4': '0.070', 'AMMO3': '0.103', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.286', 'WEAPON4': '0.300', 'weapon4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'weapon2': '1.094', 'HITCOUNT': '1.110', 'weapon3': '1.744', 'DAMAGECOUNT': '4.305', 'FRAGCOUNT': '13.000'} [2023-02-24 18:22:47,434][177171] DAMAGECOUNT value on done: 98890.0 [2023-02-24 18:22:47,434][177171] Sum rewards: 9.522, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'weapon7': '0.050', 'HEALTH': '0.051', 'AMMO4': '0.061', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.310', 'weapon4': '0.374', 'ARMOR': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.860', 'weapon2': '1.008', 'weapon3': '1.852', 'DAMAGECOUNT': '2.559', 'FRAGCOUNT': '8.000'} [2023-02-24 18:22:47,448][177157] DAMAGECOUNT value on done: 96053.0 [2023-02-24 18:22:47,448][177157] Sum rewards: 16.597, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.465', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.016', 'WEAPON1': '0.020', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'weapon4': '0.134', 'WEAPON5': '0.250', 'weapon5': '0.288', 'WEAPON3': '0.750', 'HITCOUNT': '0.920', 'weapon2': '1.440', 'weapon3': '1.796', 'DAMAGECOUNT': '4.230', 'FRAGCOUNT': '14.000'} [2023-02-24 18:22:47,709][177171] DAMAGECOUNT value on done: 94412.0 [2023-02-24 18:22:47,709][177171] Sum rewards: 9.965, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.110', 'AMMO2': '0.001', 'AMMO4': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO3': '0.126', 'weapon5': '0.194', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '0.850', 'weapon2': '1.296', 'weapon3': '2.176', 'DAMAGECOUNT': '3.645', 'FRAGCOUNT': '9.000'} [2023-02-24 18:22:47,734][177157] DAMAGECOUNT value on done: 95713.0 [2023-02-24 18:22:47,734][177157] Sum rewards: 6.692, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.430', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO3': '0.041', 'WEAPON1': '0.060', 'weapon7': '0.076', 'AMMO4': '0.077', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.300', 'WEAPON5': '0.300', 'weapon5': '0.312', 'HITCOUNT': '0.350', 'weapon4': '0.552', 'weapon2': '0.676', 'weapon3': '0.970', 'DAMAGECOUNT': '2.175', 'FRAGCOUNT': '6.000'} [2023-02-24 18:22:47,760][177157] DAMAGECOUNT value on done: 95033.0 [2023-02-24 18:22:47,760][177157] Sum rewards: 8.021, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.760', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.018', 'weapon7': '0.048', 'weapon5': '0.086', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'AMMO3': '0.201', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.354', 'weapon2': '0.634', 'WEAPON3': '1.150', 'HITCOUNT': '1.180', 'weapon3': '2.110', 'DAMAGECOUNT': '4.284', 'FRAGCOUNT': '10.000'} [2023-02-24 18:22:48,002][177171] DAMAGECOUNT value on done: 92512.0 [2023-02-24 18:22:48,003][177171] Sum rewards: 1.964, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.557', 'AMMO2': '0.001', 'AMMO4': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'weapon7': '0.072', 'AMMO3': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.260', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'weapon4': '0.472', 'weapon2': '0.660', 'weapon3': '0.970', 'DAMAGECOUNT': '1.464', 'FRAGCOUNT': '3.000'} [2023-02-24 18:22:48,410][177155] DAMAGECOUNT value on done: 97928.0 [2023-02-24 18:22:48,411][177155] Sum rewards: 10.070, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.112', 'AMMO5': '0.015', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO3': '0.072', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.312', 'WEAPON5': '0.350', 'weapon5': '0.418', 'ARMOR': '0.440', 'WEAPON3': '0.500', 'HITCOUNT': '0.670', 'weapon2': '1.096', 'weapon3': '1.704', 'DAMAGECOUNT': '3.105', 'FRAGCOUNT': '6.000'} [2023-02-24 18:22:48,715][177155] DAMAGECOUNT value on done: 101492.0 [2023-02-24 18:22:48,715][177155] Sum rewards: 3.890, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.700', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.045', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.168', 'AMMO4': '0.226', 'WEAPON4': '0.450', 'weapon4': '0.490', 'HITCOUNT': '0.650', 'WEAPON3': '0.900', 'weapon2': '1.028', 'weapon3': '1.900', 'DAMAGECOUNT': '2.415', 'FRAGCOUNT': '9.000'} [2023-02-24 18:22:49,000][177155] DAMAGECOUNT value on done: 100024.0 [2023-02-24 18:22:49,000][177155] Sum rewards: 11.219, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.972', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'weapon7': '0.048', 'AMMO3': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.121', 'weapon5': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon4': '0.582', 'WEAPON3': '0.650', 'HITCOUNT': '0.840', 'weapon2': '0.930', 'weapon3': '1.554', 'DAMAGECOUNT': '3.306', 'FRAGCOUNT': '12.000'} [2023-02-24 18:22:49,295][177155] DAMAGECOUNT value on done: 94233.0 [2023-02-24 18:22:49,296][177155] Sum rewards: 6.001, reward structure: {'DEATHCOUNT': '-6.000', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon7': '0.046', 'weapon5': '0.058', 'AMMO3': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.155', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HEALTH': '0.324', 'ARMOR': '0.400', 'HITCOUNT': '0.440', 'WEAPON3': '0.500', 'weapon4': '0.654', 'weapon3': '0.956', 'weapon2': '0.992', 'DAMAGECOUNT': '1.485', 'FRAGCOUNT': '5.000'} [2023-02-24 18:22:49,620][177157] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:22:50,098][177153] Updated weights for policy 0, policy_version 12280 (0.0008) [2023-02-24 18:22:50,536][177154] Large shaping reward 2.640 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-24 18:22:51,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.6, 300 sec: 13995.8). Total num frames: 50315264. Throughput: 0: 3492.5. Samples: 12572884. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:22:51,376][177119] Avg episode reward: [(0, '8.648')] [2023-02-24 18:22:53,013][177153] Updated weights for policy 0, policy_version 12290 (0.0008) [2023-02-24 18:22:54,362][177156] DAMAGECOUNT value on done: 96849.0 [2023-02-24 18:22:54,362][177156] Sum rewards: 9.296, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.412', 'AMMO5': '0.014', 'WEAPON1': '0.030', 'AMMO2': '0.038', 'AMMO3': '0.076', 'weapon5': '0.174', 'AMMO4': '0.188', 'WEAPON4': '0.250', 'weapon4': '0.282', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.810', 'weapon3': '1.532', 'weapon2': '1.706', 'DAMAGECOUNT': '3.558', 'FRAGCOUNT': '7.000'} [2023-02-24 18:22:54,598][177156] DAMAGECOUNT value on done: 96894.0 [2023-02-24 18:22:54,598][177156] Sum rewards: 8.124, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.047', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.043', 'AMMO3': '0.100', 'weapon5': '0.308', 'WEAPON5': '0.350', 'HITCOUNT': '0.370', 'WEAPON3': '0.650', 'weapon2': '1.574', 'weapon3': '1.810', 'DAMAGECOUNT': '1.920', 'FRAGCOUNT': '8.000'} [2023-02-24 18:22:54,667][177156] DAMAGECOUNT value on done: 97535.0 [2023-02-24 18:22:54,667][177156] Sum rewards: 6.672, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.838', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'ARMOR': '0.024', 'AMMO4': '0.039', 'weapon7': '0.070', 'AMMO3': '0.112', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.296', 'HITCOUNT': '0.420', 'WEAPON5': '0.550', 'weapon5': '0.570', 'weapon2': '0.652', 'WEAPON3': '0.850', 'weapon3': '1.910', 'DAMAGECOUNT': '2.496', 'FRAGCOUNT': '8.000'} [2023-02-24 18:22:54,907][177156] DAMAGECOUNT value on done: 96429.0 [2023-02-24 18:22:54,907][177156] Sum rewards: 8.017, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.586', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.032', 'AMMO3': '0.095', 'WEAPON4': '0.200', 'weapon4': '0.228', 'WEAPON5': '0.300', 'weapon5': '0.608', 'HITCOUNT': '0.640', 'WEAPON3': '0.650', 'weapon2': '1.192', 'weapon3': '1.704', 'DAMAGECOUNT': '2.688', 'FRAGCOUNT': '7.000'} [2023-02-24 18:22:55,939][177153] Updated weights for policy 0, policy_version 12300 (0.0008) [2023-02-24 18:22:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.6, 300 sec: 13995.8). Total num frames: 50384896. Throughput: 0: 3495.6. Samples: 12593916. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:22:56,376][177119] Avg episode reward: [(0, '8.576')] [2023-02-24 18:22:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000012301_50384896.pth... [2023-02-24 18:22:56,442][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000011481_47026176.pth [2023-02-24 18:22:58,899][177153] Updated weights for policy 0, policy_version 12310 (0.0008) [2023-02-24 18:23:00,762][177170] DAMAGECOUNT value on done: 97809.0 [2023-02-24 18:23:00,762][177170] Sum rewards: 9.205, reward structure: {'DEATHCOUNT': '-7.500', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'ARMOR': '0.028', 'AMMO2': '0.032', 'AMMO3': '0.083', 'AMMO4': '0.159', 'weapon5': '0.256', 'weapon2': '0.396', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'HEALTH': '0.471', 'HITCOUNT': '0.770', 'weapon4': '1.026', 'weapon3': '1.662', 'DAMAGECOUNT': '3.045', 'FRAGCOUNT': '7.500'} [2023-02-24 18:23:01,054][177170] DAMAGECOUNT value on done: 100310.0 [2023-02-24 18:23:01,054][177170] Sum rewards: 11.325, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.027', 'WEAPON1': '0.030', 'weapon7': '0.056', 'AMMO3': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon5': '0.152', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.420', 'HEALTH': '0.426', 'weapon3': '1.376', 'weapon2': '1.932', 'DAMAGECOUNT': '2.283', 'FRAGCOUNT': '7.000'} [2023-02-24 18:23:01,103][177170] DAMAGECOUNT value on done: 90359.0 [2023-02-24 18:23:01,103][177170] Sum rewards: 8.407, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.010', 'AMMO2': '0.049', 'WEAPON1': '0.050', 'weapon7': '0.056', 'AMMO3': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HEALTH': '0.136', 'weapon4': '0.178', 'AMMO4': '0.245', 'WEAPON4': '0.250', 'weapon5': '0.286', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.670', 'weapon2': '1.382', 'weapon3': '1.804', 'DAMAGECOUNT': '3.300', 'FRAGCOUNT': '7.000'} [2023-02-24 18:23:01,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 50454528. Throughput: 0: 3496.1. Samples: 12614902. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:23:01,376][177119] Avg episode reward: [(0, '8.510')] [2023-02-24 18:23:01,398][177170] DAMAGECOUNT value on done: 99854.0 [2023-02-24 18:23:01,399][177170] Sum rewards: 4.207, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.582', 'AMMO5': '0.007', 'AMMO2': '0.022', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'weapon5': '0.048', 'AMMO4': '0.110', 'AMMO3': '0.119', 'weapon7': '0.176', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'weapon4': '0.410', 'WEAPON4': '0.450', 'HITCOUNT': '0.640', 'WEAPON3': '0.850', 'weapon2': '1.386', 'weapon3': '1.596', 'DAMAGECOUNT': '3.072', 'FRAGCOUNT': '5.000'} [2023-02-24 18:23:01,822][177153] Updated weights for policy 0, policy_version 12320 (0.0008) [2023-02-24 18:23:02,232][177158] DAMAGECOUNT value on done: 95219.0 [2023-02-24 18:23:02,232][177158] Sum rewards: 6.681, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.234', 'AMMO2': '0.007', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO4': '0.034', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'weapon4': '0.304', 'weapon5': '0.384', 'WEAPON5': '0.400', 'HITCOUNT': '0.660', 'WEAPON3': '0.700', 'weapon2': '0.780', 'weapon3': '1.964', 'DAMAGECOUNT': '2.994', 'FRAGCOUNT': '7.000'} [2023-02-24 18:23:02,522][177158] DAMAGECOUNT value on done: 93536.0 [2023-02-24 18:23:02,523][177158] Sum rewards: 4.284, reward structure: {'DEATHCOUNT': '-1.500', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.006', 'HEALTH': '0.010', 'WEAPON1': '0.010', 'AMMO3': '0.020', 'weapon7': '0.050', 'weapon5': '0.068', 'WEAPON4': '0.100', 'WEAPON3': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.242', 'HITCOUNT': '0.260', 'weapon2': '0.312', 'weapon3': '0.520', 'DAMAGECOUNT': '1.539', 'FRAGCOUNT': '2.000'} [2023-02-24 18:23:03,107][177158] DAMAGECOUNT value on done: 96202.0 [2023-02-24 18:23:03,108][177158] Sum rewards: 7.986, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.080', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO3': '0.187', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.202', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.850', 'weapon2': '0.946', 'WEAPON3': '1.150', 'weapon3': '2.456', 'DAMAGECOUNT': '3.372', 'FRAGCOUNT': '9.000'} [2023-02-24 18:23:03,407][177158] DAMAGECOUNT value on done: 100150.0 [2023-02-24 18:23:03,408][177158] Sum rewards: 4.857, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.436', 'AMMO5': '0.003', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.014', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon7': '0.052', 'AMMO3': '0.079', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.332', 'WEAPON3': '0.500', 'HITCOUNT': '0.640', 'weapon3': '1.460', 'weapon2': '1.812', 'DAMAGECOUNT': '2.205', 'FRAGCOUNT': '3.500'} [2023-02-24 18:23:04,289][177172] DAMAGECOUNT value on done: 98590.0 [2023-02-24 18:23:04,289][177172] Sum rewards: 8.142, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.572', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'AMMO4': '0.093', 'weapon7': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.252', 'WEAPON3': '0.300', 'HITCOUNT': '0.460', 'weapon4': '0.694', 'weapon2': '0.912', 'weapon3': '0.926', 'DAMAGECOUNT': '2.493', 'FRAGCOUNT': '6.000'} [2023-02-24 18:23:04,582][177172] DAMAGECOUNT value on done: 96340.0 [2023-02-24 18:23:04,582][177172] Sum rewards: 7.127, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.435', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'ARMOR': '0.040', 'AMMO3': '0.105', 'weapon5': '0.162', 'AMMO4': '0.167', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon4': '0.584', 'WEAPON3': '0.750', 'weapon2': '0.864', 'HITCOUNT': '0.920', 'weapon3': '1.922', 'DAMAGECOUNT': '3.477', 'FRAGCOUNT': '7.000'} [2023-02-24 18:23:04,745][177153] Updated weights for policy 0, policy_version 12330 (0.0008) [2023-02-24 18:23:05,319][177154] DAMAGECOUNT value on done: 100248.0 [2023-02-24 18:23:05,319][177154] Sum rewards: 2.495, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.327', 'AMMO2': '0.019', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'AMMO3': '0.083', 'AMMO4': '0.096', 'weapon5': '0.192', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'HITCOUNT': '0.480', 'ARMOR': '0.490', 'WEAPON3': '0.550', 'weapon4': '0.584', 'weapon2': '0.770', 'weapon3': '1.308', 'DAMAGECOUNT': '1.389', 'FRAGCOUNT': '3.000'} [2023-02-24 18:23:05,615][177154] DAMAGECOUNT value on done: 100487.0 [2023-02-24 18:23:05,616][177154] Sum rewards: 7.020, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.010', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.052', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'weapon5': '0.166', 'weapon4': '0.226', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.620', 'HEALTH': '0.788', 'weapon2': '1.460', 'weapon3': '1.728', 'DAMAGECOUNT': '2.187', 'FRAGCOUNT': '4.000'} [2023-02-24 18:23:05,626][177154] DAMAGECOUNT value on done: 98822.0 [2023-02-24 18:23:05,626][177154] Sum rewards: 7.500, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.902', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.026', 'weapon7': '0.072', 'AMMO3': '0.077', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.129', 'WEAPON7': '0.200', 'weapon5': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'weapon4': '0.624', 'HITCOUNT': '0.700', 'weapon2': '1.148', 'weapon3': '1.298', 'DAMAGECOUNT': '2.556', 'FRAGCOUNT': '7.500'} [2023-02-24 18:23:05,766][177172] DAMAGECOUNT value on done: 98192.0 [2023-02-24 18:23:05,766][177172] Sum rewards: 3.070, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.430', 'AMMO5': '0.015', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'AMMO3': '0.055', 'AMMO4': '0.133', 'weapon7': '0.148', 'WEAPON4': '0.250', 'AMMO6': '0.280', 'AMMO7': '0.280', 'HITCOUNT': '0.320', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'weapon5': '0.456', 'weapon4': '0.480', 'WEAPON3': '0.500', 'weapon3': '1.112', 'weapon2': '1.156', 'DAMAGECOUNT': '2.007', 'FRAGCOUNT': '2.500'} [2023-02-24 18:23:05,924][177154] DAMAGECOUNT value on done: 103899.0 [2023-02-24 18:23:05,925][177154] Sum rewards: 8.959, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.706', 'AMMO2': '0.005', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.023', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'weapon5': '0.146', 'weapon4': '0.204', 'WEAPON5': '0.250', 'ARMOR': '0.500', 'HITCOUNT': '0.500', 'WEAPON3': '0.700', 'weapon2': '1.318', 'weapon3': '1.814', 'DAMAGECOUNT': '2.601', 'FRAGCOUNT': '7.000'} [2023-02-24 18:23:06,059][177172] DAMAGECOUNT value on done: 96673.0 [2023-02-24 18:23:06,059][177172] Sum rewards: 5.287, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.074', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO3': '0.060', 'weapon7': '0.100', 'weapon5': '0.120', 'AMMO4': '0.131', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.334', 'WEAPON3': '0.350', 'HITCOUNT': '0.410', 'weapon3': '0.886', 'weapon2': '1.312', 'DAMAGECOUNT': '2.301', 'FRAGCOUNT': '5.000'} [2023-02-24 18:23:06,332][177171] DAMAGECOUNT value on done: 99055.0 [2023-02-24 18:23:06,333][177171] Sum rewards: 6.419, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.564', 'AMMO2': '0.017', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'weapon7': '0.054', 'AMMO4': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.118', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon5': '0.378', 'weapon4': '0.414', 'HITCOUNT': '0.460', 'WEAPON3': '0.550', 'weapon2': '1.420', 'weapon3': '1.426', 'DAMAGECOUNT': '2.811', 'FRAGCOUNT': '6.000'} [2023-02-24 18:23:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.6, 300 sec: 13995.8). Total num frames: 50524160. Throughput: 0: 3496.5. Samples: 12625426. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:23:06,376][177119] Avg episode reward: [(0, '8.062')] [2023-02-24 18:23:06,636][177171] DAMAGECOUNT value on done: 99280.0 [2023-02-24 18:23:06,637][177171] Sum rewards: 2.313, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.032', 'AMMO5': '0.005', 'AMMO2': '0.005', 'ARMOR': '0.008', 'AMMO4': '0.027', 'weapon7': '0.048', 'weapon5': '0.074', 'AMMO3': '0.082', 'weapon4': '0.106', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.340', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.170', 'weapon3': '1.208', 'weapon2': '2.432', 'FRAGCOUNT': '3.000'} [2023-02-24 18:23:06,654][177157] DAMAGECOUNT value on done: 101383.0 [2023-02-24 18:23:06,655][177157] Sum rewards: 10.381, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.930', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.026', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO3': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.210', 'HITCOUNT': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'weapon3': '1.566', 'weapon2': '1.832', 'DAMAGECOUNT': '3.036', 'FRAGCOUNT': '9.000'} [2023-02-24 18:23:06,675][177157] DAMAGECOUNT value on done: 96843.0 [2023-02-24 18:23:06,675][177157] Sum rewards: 8.410, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.890', 'AMMO2': '0.005', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.026', 'AMMO3': '0.064', 'weapon5': '0.086', 'weapon4': '0.098', 'WEAPON4': '0.100', 'weapon7': '0.136', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.650', 'weapon3': '1.162', 'DAMAGECOUNT': '2.370', 'weapon2': '2.382', 'FRAGCOUNT': '6.000'} [2023-02-24 18:23:06,874][177171] DAMAGECOUNT value on done: 95387.0 [2023-02-24 18:23:06,875][177171] Sum rewards: 5.354, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.449', 'ARMOR': '0.012', 'AMMO5': '0.024', 'AMMO2': '0.033', 'WEAPON1': '0.040', 'weapon7': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.153', 'weapon4': '0.158', 'AMMO4': '0.167', 'weapon5': '0.192', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.450', 'HITCOUNT': '0.550', 'weapon2': '0.552', 'WEAPON3': '1.000', 'weapon3': '2.580', 'DAMAGECOUNT': '2.925', 'FRAGCOUNT': '8.000'} [2023-02-24 18:23:06,957][177157] DAMAGECOUNT value on done: 96517.0 [2023-02-24 18:23:06,958][177157] Sum rewards: 4.899, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.824', 'AMMO2': '0.014', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon5': '0.292', 'WEAPON5': '0.300', 'weapon4': '0.348', 'ARMOR': '0.516', 'HITCOUNT': '0.640', 'WEAPON3': '0.750', 'weapon2': '1.250', 'weapon3': '1.878', 'DAMAGECOUNT': '2.412', 'FRAGCOUNT': '6.000'} [2023-02-24 18:23:06,979][177157] DAMAGECOUNT value on done: 95877.0 [2023-02-24 18:23:06,979][177157] Sum rewards: 8.209, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'ARMOR': '0.060', 'AMMO3': '0.090', 'WEAPON4': '0.150', 'AMMO4': '0.154', 'weapon5': '0.158', 'WEAPON5': '0.200', 'HEALTH': '0.402', 'WEAPON3': '0.550', 'HITCOUNT': '0.580', 'weapon4': '0.584', 'weapon2': '1.088', 'weapon3': '1.600', 'DAMAGECOUNT': '2.532', 'FRAGCOUNT': '6.000'} [2023-02-24 18:23:07,162][177171] DAMAGECOUNT value on done: 93594.0 [2023-02-24 18:23:07,162][177171] Sum rewards: 9.013, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.085', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.047', 'weapon5': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'WEAPON5': '0.150', 'weapon4': '0.226', 'WEAPON3': '0.800', 'HITCOUNT': '0.800', 'weapon2': '1.366', 'weapon3': '1.870', 'DAMAGECOUNT': '3.246', 'FRAGCOUNT': '9.000'} [2023-02-24 18:23:07,548][177155] DAMAGECOUNT value on done: 99051.0 [2023-02-24 18:23:07,548][177155] Sum rewards: 2.773, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.240', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.016', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.064', 'AMMO3': '0.131', 'weapon5': '0.204', 'WEAPON5': '0.450', 'HITCOUNT': '0.740', 'WEAPON3': '1.000', 'weapon2': '1.488', 'weapon3': '1.962', 'DAMAGECOUNT': '3.369', 'FRAGCOUNT': '4.500'} [2023-02-24 18:23:07,684][177153] Updated weights for policy 0, policy_version 12340 (0.0009) [2023-02-24 18:23:07,845][177155] DAMAGECOUNT value on done: 102507.0 [2023-02-24 18:23:07,846][177155] Sum rewards: 9.243, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.056', 'AMMO2': '0.006', 'AMMO5': '0.017', 'AMMO4': '0.031', 'WEAPON1': '0.040', 'AMMO3': '0.099', 'WEAPON4': '0.150', 'weapon5': '0.224', 'weapon4': '0.290', 'WEAPON5': '0.400', 'HITCOUNT': '0.580', 'WEAPON3': '0.700', 'weapon2': '1.388', 'weapon3': '1.828', 'DAMAGECOUNT': '3.045', 'FRAGCOUNT': '9.000'} [2023-02-24 18:23:08,139][177155] DAMAGECOUNT value on done: 100895.0 [2023-02-24 18:23:08,140][177155] Sum rewards: 9.034, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.010', 'HEALTH': '0.014', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.088', 'AMMO4': '0.099', 'weapon5': '0.192', 'weapon4': '0.216', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.800', 'weapon2': '1.382', 'weapon3': '1.710', 'DAMAGECOUNT': '2.613', 'FRAGCOUNT': '5.500'} [2023-02-24 18:23:08,440][177155] DAMAGECOUNT value on done: 95118.0 [2023-02-24 18:23:08,440][177155] Sum rewards: 3.813, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.790', 'AMMO2': '0.015', 'AMMO5': '0.030', 'WEAPON1': '0.050', 'weapon7': '0.054', 'AMMO4': '0.073', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.272', 'weapon4': '0.290', 'HITCOUNT': '0.550', 'WEAPON5': '0.700', 'WEAPON3': '0.800', 'weapon2': '1.248', 'weapon3': '1.546', 'DAMAGECOUNT': '2.655', 'FRAGCOUNT': '5.000'} [2023-02-24 18:23:10,602][177153] Updated weights for policy 0, policy_version 12350 (0.0008) [2023-02-24 18:23:10,768][177154] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:23:11,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 50593792. Throughput: 0: 3495.9. Samples: 12646388. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:23:11,376][177119] Avg episode reward: [(0, '7.832')] [2023-02-24 18:23:13,530][177153] Updated weights for policy 0, policy_version 12360 (0.0008) [2023-02-24 18:23:13,674][177156] DAMAGECOUNT value on done: 97484.0 [2023-02-24 18:23:13,675][177156] Sum rewards: 7.227, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.559', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.031', 'weapon7': '0.048', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.166', 'WEAPON7': '0.200', 'weapon5': '0.238', 'WEAPON5': '0.250', 'HITCOUNT': '0.550', 'WEAPON3': '0.600', 'weapon3': '1.390', 'DAMAGECOUNT': '1.905', 'weapon2': '1.966', 'FRAGCOUNT': '6.000'} [2023-02-24 18:23:13,848][177156] DAMAGECOUNT value on done: 98011.0 [2023-02-24 18:23:13,849][177156] Sum rewards: 8.982, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.992', 'ARMOR': '0.024', 'AMMO5': '0.025', 'AMMO2': '0.041', 'WEAPON1': '0.060', 'AMMO3': '0.118', 'weapon5': '0.146', 'AMMO4': '0.205', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'HITCOUNT': '0.840', 'weapon4': '0.840', 'weapon2': '0.892', 'weapon3': '1.432', 'DAMAGECOUNT': '3.351', 'FRAGCOUNT': '11.000'} [2023-02-24 18:23:13,988][177156] DAMAGECOUNT value on done: 98510.0 [2023-02-24 18:23:13,989][177156] Sum rewards: 7.015, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.402', 'AMMO5': '0.017', 'AMMO2': '0.030', 'AMMO3': '0.093', 'AMMO4': '0.151', 'weapon5': '0.186', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'ARMOR': '0.470', 'weapon4': '0.490', 'HITCOUNT': '0.600', 'WEAPON3': '0.700', 'weapon2': '1.060', 'weapon3': '1.944', 'DAMAGECOUNT': '2.925', 'FRAGCOUNT': '8.000'} [2023-02-24 18:23:14,151][177156] DAMAGECOUNT value on done: 97458.0 [2023-02-24 18:23:14,151][177156] Sum rewards: 5.666, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.412', 'AMMO2': '0.009', 'AMMO5': '0.017', 'ARMOR': '0.028', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'weapon5': '0.090', 'weapon4': '0.090', 'AMMO3': '0.153', 'WEAPON5': '0.350', 'HITCOUNT': '0.680', 'weapon2': '0.734', 'WEAPON3': '1.000', 'weapon3': '2.684', 'DAMAGECOUNT': '3.087', 'FRAGCOUNT': '7.500'} [2023-02-24 18:23:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.6, 300 sec: 13995.8). Total num frames: 50663424. Throughput: 0: 3497.0. Samples: 12667390. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:23:16,376][177119] Avg episode reward: [(0, '7.909')] [2023-02-24 18:23:16,455][177153] Updated weights for policy 0, policy_version 12370 (0.0008) [2023-02-24 18:23:19,366][177153] Updated weights for policy 0, policy_version 12380 (0.0008) [2023-02-24 18:23:20,038][177170] DAMAGECOUNT value on done: 98804.0 [2023-02-24 18:23:20,039][177170] Sum rewards: 6.598, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.690', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon4': '0.020', 'AMMO2': '0.021', 'weapon7': '0.056', 'weapon5': '0.060', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.112', 'WEAPON5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.700', 'HITCOUNT': '0.780', 'weapon2': '1.832', 'weapon3': '1.854', 'DAMAGECOUNT': '2.985', 'FRAGCOUNT': '6.000'} [2023-02-24 18:23:20,325][177170] DAMAGECOUNT value on done: 91156.0 [2023-02-24 18:23:20,325][177170] Sum rewards: 6.509, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.220', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO3': '0.101', 'AMMO4': '0.109', 'weapon7': '0.134', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.428', 'HITCOUNT': '0.570', 'weapon4': '0.634', 'WEAPON3': '0.700', 'weapon2': '1.088', 'weapon3': '1.818', 'DAMAGECOUNT': '2.391', 'FRAGCOUNT': '6.000'} [2023-02-24 18:23:20,335][177170] DAMAGECOUNT value on done: 101553.0 [2023-02-24 18:23:20,336][177170] Sum rewards: 10.941, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.883', 'AMMO2': '0.008', 'AMMO5': '0.027', 'AMMO4': '0.037', 'weapon7': '0.050', 'WEAPON1': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.123', 'WEAPON7': '0.200', 'weapon5': '0.412', 'HITCOUNT': '0.570', 'WEAPON5': '0.650', 'WEAPON3': '0.800', 'weapon2': '1.286', 'weapon3': '1.862', 'DAMAGECOUNT': '3.729', 'FRAGCOUNT': '10.000'} [2023-02-24 18:23:20,628][177170] DAMAGECOUNT value on done: 101034.0 [2023-02-24 18:23:20,628][177170] Sum rewards: 11.391, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.620', 'AMMO2': '0.011', 'AMMO5': '0.014', 'WEAPON1': '0.030', 'AMMO3': '0.051', 'AMMO4': '0.056', 'weapon5': '0.132', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'ARMOR': '0.462', 'weapon4': '0.750', 'HITCOUNT': '0.830', 'weapon3': '1.252', 'weapon2': '1.282', 'DAMAGECOUNT': '3.540', 'FRAGCOUNT': '8.500'} [2023-02-24 18:23:21,376][177119] Fps is (10 sec: 13926.2, 60 sec: 13994.6, 300 sec: 13995.8). Total num frames: 50733056. Throughput: 0: 3494.0. Samples: 12677816. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:23:21,376][177119] Avg episode reward: [(0, '7.985')] [2023-02-24 18:23:21,456][177158] DAMAGECOUNT value on done: 95986.0 [2023-02-24 18:23:21,457][177158] Sum rewards: 2.091, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.684', 'AMMO2': '0.019', 'AMMO5': '0.032', 'WEAPON1': '0.050', 'weapon7': '0.056', 'AMMO4': '0.093', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.144', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.500', 'HITCOUNT': '0.510', 'weapon4': '0.530', 'WEAPON3': '0.750', 'weapon2': '0.808', 'ARMOR': '0.899', 'weapon3': '1.740', 'DAMAGECOUNT': '2.301', 'FRAGCOUNT': '3.500'} [2023-02-24 18:23:21,760][177158] DAMAGECOUNT value on done: 94831.0 [2023-02-24 18:23:21,761][177158] Sum rewards: 8.889, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.709', 'AMMO5': '0.019', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'AMMO4': '0.121', 'AMMO3': '0.130', 'weapon5': '0.130', 'weapon7': '0.132', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON4': '0.400', 'WEAPON7': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.668', 'WEAPON3': '0.750', 'HITCOUNT': '0.970', 'weapon2': '1.114', 'weapon3': '1.604', 'DAMAGECOUNT': '3.885', 'FRAGCOUNT': '9.000'} [2023-02-24 18:23:22,329][177158] DAMAGECOUNT value on done: 97472.0 [2023-02-24 18:23:22,330][177158] Sum rewards: 12.627, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.510', 'AMMO5': '0.011', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon4': '0.058', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon5': '0.134', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.820', 'WEAPON3': '0.850', 'weapon2': '1.278', 'weapon3': '2.242', 'DAMAGECOUNT': '3.810', 'FRAGCOUNT': '12.000'} [2023-02-24 18:23:22,340][177153] Updated weights for policy 0, policy_version 12390 (0.0008) [2023-02-24 18:23:22,633][177158] DAMAGECOUNT value on done: 100776.0 [2023-02-24 18:23:22,634][177158] Sum rewards: 1.089, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.539', 'AMMO5': '0.010', 'AMMO2': '0.012', 'ARMOR': '0.016', 'weapon7': '0.050', 'weapon5': '0.054', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.284', 'HITCOUNT': '0.510', 'WEAPON3': '0.800', 'weapon2': '1.422', 'DAMAGECOUNT': '1.878', 'weapon3': '1.924', 'FRAGCOUNT': '2.000'} [2023-02-24 18:23:23,567][177172] DAMAGECOUNT value on done: 99733.0 [2023-02-24 18:23:23,568][177172] Sum rewards: 11.472, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'weapon7': '0.056', 'AMMO3': '0.091', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HEALTH': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'weapon5': '0.162', 'WEAPON7': '0.200', 'weapon4': '0.302', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.680', 'weapon2': '1.184', 'weapon3': '1.954', 'DAMAGECOUNT': '3.429', 'FRAGCOUNT': '9.000'} [2023-02-24 18:23:23,868][177172] DAMAGECOUNT value on done: 97045.0 [2023-02-24 18:23:23,869][177172] Sum rewards: 5.602, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.750', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO3': '0.078', 'WEAPON4': '0.150', 'weapon5': '0.190', 'weapon4': '0.338', 'WEAPON5': '0.350', 'ARMOR': '0.490', 'HITCOUNT': '0.590', 'WEAPON3': '0.600', 'weapon2': '1.380', 'weapon3': '1.510', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '5.500'} [2023-02-24 18:23:24,608][177154] DAMAGECOUNT value on done: 101415.0 [2023-02-24 18:23:24,609][177154] Sum rewards: 9.159, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.928', 'AMMO5': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.072', 'AMMO3': '0.107', 'weapon5': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.510', 'HITCOUNT': '0.690', 'WEAPON3': '0.700', 'weapon2': '1.252', 'weapon3': '1.648', 'DAMAGECOUNT': '3.501', 'FRAGCOUNT': '9.000'} [2023-02-24 18:23:24,913][177154] DAMAGECOUNT value on done: 101392.0 [2023-02-24 18:23:24,913][177154] Sum rewards: 9.385, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.690', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.034', 'WEAPON4': '0.050', 'weapon5': '0.116', 'AMMO3': '0.122', 'AMMO4': '0.168', 'weapon4': '0.210', 'WEAPON5': '0.350', 'ARMOR': '0.475', 'HITCOUNT': '0.620', 'WEAPON3': '0.850', 'weapon2': '1.208', 'weapon3': '1.882', 'DAMAGECOUNT': '2.715', 'FRAGCOUNT': '9.000'} [2023-02-24 18:23:24,927][177154] DAMAGECOUNT value on done: 100114.0 [2023-02-24 18:23:24,928][177154] Sum rewards: 16.369, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.295', 'weapon5': '0.002', 'AMMO5': '0.013', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'weapon7': '0.052', 'AMMO3': '0.081', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.106', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.518', 'WEAPON3': '0.550', 'HITCOUNT': '0.950', 'weapon3': '1.454', 'weapon2': '1.572', 'DAMAGECOUNT': '3.855', 'FRAGCOUNT': '12.000'} [2023-02-24 18:23:25,034][177172] DAMAGECOUNT value on done: 99352.0 [2023-02-24 18:23:25,035][177172] Sum rewards: 4.157, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.218', 'AMMO5': '0.009', 'AMMO2': '0.039', 'ARMOR': '0.046', 'weapon5': '0.078', 'AMMO3': '0.141', 'AMMO4': '0.195', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.348', 'WEAPON3': '0.900', 'HITCOUNT': '1.020', 'weapon2': '1.670', 'weapon3': '1.698', 'DAMAGECOUNT': '3.480', 'FRAGCOUNT': '6.500'} [2023-02-24 18:23:25,226][177154] DAMAGECOUNT value on done: 104788.0 [2023-02-24 18:23:25,227][177154] Sum rewards: 9.653, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.030', 'AMMO5': '0.022', 'AMMO2': '0.023', 'WEAPON1': '0.050', 'AMMO3': '0.101', 'AMMO4': '0.113', 'WEAPON4': '0.300', 'weapon5': '0.300', 'WEAPON5': '0.450', 'ARMOR': '0.455', 'weapon4': '0.482', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'weapon2': '1.030', 'weapon3': '1.720', 'DAMAGECOUNT': '2.667', 'FRAGCOUNT': '10.000'} [2023-02-24 18:23:25,268][177153] Updated weights for policy 0, policy_version 12400 (0.0008) [2023-02-24 18:23:25,341][177172] DAMAGECOUNT value on done: 97656.0 [2023-02-24 18:23:25,342][177172] Sum rewards: 4.137, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.196', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.033', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO3': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.166', 'weapon5': '0.194', 'WEAPON7': '0.200', 'weapon4': '0.306', 'WEAPON4': '0.400', 'HITCOUNT': '0.520', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'weapon3': '1.556', 'weapon2': '1.560', 'DAMAGECOUNT': '2.949', 'FRAGCOUNT': '6.500'} [2023-02-24 18:23:25,586][177171] DAMAGECOUNT value on done: 99932.0 [2023-02-24 18:23:25,587][177171] Sum rewards: 9.254, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.952', 'ARMOR': '0.012', 'AMMO2': '0.017', 'AMMO5': '0.017', 'WEAPON1': '0.060', 'AMMO4': '0.087', 'weapon7': '0.094', 'AMMO3': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.338', 'HITCOUNT': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.422', 'WEAPON3': '0.700', 'weapon3': '1.300', 'weapon2': '1.422', 'DAMAGECOUNT': '2.631', 'FRAGCOUNT': '9.000'} [2023-02-24 18:23:25,885][177171] DAMAGECOUNT value on done: 99927.0 [2023-02-24 18:23:25,886][177171] Sum rewards: 6.318, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.440', 'AMMO5': '0.003', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'weapon7': '0.072', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.126', 'WEAPON7': '0.200', 'weapon4': '0.254', 'ARMOR': '0.400', 'HITCOUNT': '0.490', 'WEAPON3': '0.650', 'weapon3': '1.232', 'DAMAGECOUNT': '1.941', 'weapon2': '2.104', 'FRAGCOUNT': '5.000'} [2023-02-24 18:23:25,907][177157] DAMAGECOUNT value on done: 102334.0 [2023-02-24 18:23:25,907][177157] Sum rewards: 10.066, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.487', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon7': '0.050', 'AMMO3': '0.070', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.141', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.450', 'WEAPON3': '0.500', 'weapon4': '0.670', 'HITCOUNT': '0.810', 'weapon2': '1.208', 'weapon3': '1.528', 'DAMAGECOUNT': '2.853', 'FRAGCOUNT': '8.000'} [2023-02-24 18:23:25,918][177157] DAMAGECOUNT value on done: 97375.0 [2023-02-24 18:23:25,918][177157] Sum rewards: 2.850, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.455', 'weapon7': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'AMMO3': '0.098', 'AMMO4': '0.112', 'weapon5': '0.130', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.440', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.596', 'weapon2': '1.676', 'weapon3': '1.680', 'FRAGCOUNT': '4.000'} [2023-02-24 18:23:26,054][177171] DAMAGECOUNT value on done: 96367.0 [2023-02-24 18:23:26,054][177171] Sum rewards: 9.386, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.804', 'weapon7': '0.008', 'AMMO2': '0.009', 'AMMO5': '0.020', 'AMMO4': '0.047', 'WEAPON1': '0.060', 'AMMO3': '0.132', 'weapon5': '0.134', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.214', 'WEAPON5': '0.450', 'HITCOUNT': '0.630', 'WEAPON3': '0.800', 'weapon2': '0.964', 'weapon3': '2.282', 'DAMAGECOUNT': '2.940', 'FRAGCOUNT': '10.500'} [2023-02-24 18:23:26,204][177157] DAMAGECOUNT value on done: 97463.0 [2023-02-24 18:23:26,204][177157] Sum rewards: 5.069, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.398', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'weapon5': '0.078', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.121', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'weapon4': '0.268', 'WEAPON5': '0.300', 'HITCOUNT': '0.650', 'WEAPON3': '0.850', 'weapon2': '0.860', 'weapon3': '2.084', 'DAMAGECOUNT': '2.838', 'FRAGCOUNT': '6.000'} [2023-02-24 18:23:26,215][177157] DAMAGECOUNT value on done: 96353.0 [2023-02-24 18:23:26,215][177157] Sum rewards: 5.151, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.960', 'AMMO5': '0.003', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'AMMO3': '0.060', 'weapon5': '0.060', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon7': '0.184', 'AMMO6': '0.340', 'AMMO7': '0.340', 'HITCOUNT': '0.380', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.492', 'WEAPON7': '0.500', 'weapon3': '1.070', 'weapon2': '1.350', 'DAMAGECOUNT': '1.428', 'FRAGCOUNT': '4.000'} [2023-02-24 18:23:26,349][177171] DAMAGECOUNT value on done: 94410.0 [2023-02-24 18:23:26,350][177171] Sum rewards: 8.449, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.372', 'AMMO5': '0.015', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.124', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.264', 'ARMOR': '0.499', 'weapon4': '0.508', 'HITCOUNT': '0.530', 'WEAPON3': '0.800', 'weapon3': '1.288', 'DAMAGECOUNT': '2.448', 'FRAGCOUNT': '9.000'} [2023-02-24 18:23:26,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13926.4, 300 sec: 13982.0). Total num frames: 50802688. Throughput: 0: 3490.4. Samples: 12698678. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:23:26,376][177119] Avg episode reward: [(0, '7.734')] [2023-02-24 18:23:26,745][177155] DAMAGECOUNT value on done: 99796.0 [2023-02-24 18:23:26,745][177155] Sum rewards: 11.238, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.255', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON1': '0.040', 'weapon7': '0.096', 'weapon5': '0.106', 'AMMO3': '0.110', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.570', 'WEAPON3': '0.750', 'weapon2': '1.580', 'weapon3': '2.018', 'DAMAGECOUNT': '2.235', 'FRAGCOUNT': '10.000'} [2023-02-24 18:23:27,049][177155] DAMAGECOUNT value on done: 103707.0 [2023-02-24 18:23:27,050][177155] Sum rewards: 9.109, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.246', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO5': '0.014', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.050', 'weapon7': '0.062', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.188', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.610', 'WEAPON3': '0.700', 'weapon2': '1.648', 'weapon3': '1.796', 'DAMAGECOUNT': '3.600', 'FRAGCOUNT': '6.500'} [2023-02-24 18:23:27,356][177155] DAMAGECOUNT value on done: 101140.0 [2023-02-24 18:23:27,357][177155] Sum rewards: 2.787, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.200', 'AMMO2': '0.006', 'AMMO4': '0.028', 'AMMO3': '0.032', 'WEAPON4': '0.050', 'weapon7': '0.118', 'HITCOUNT': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.250', 'weapon4': '0.258', 'WEAPON7': '0.300', 'weapon3': '0.466', 'DAMAGECOUNT': '0.735', 'FRAGCOUNT': '1.000', 'weapon2': '1.404'} [2023-02-24 18:23:27,654][177155] DAMAGECOUNT value on done: 95983.0 [2023-02-24 18:23:27,654][177155] Sum rewards: 6.554, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.020', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon5': '0.128', 'AMMO3': '0.131', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.346', 'ARMOR': '0.453', 'HITCOUNT': '0.730', 'WEAPON3': '0.750', 'weapon2': '1.504', 'weapon3': '1.516', 'DAMAGECOUNT': '2.595', 'FRAGCOUNT': '7.000'} [2023-02-24 18:23:28,197][177153] Updated weights for policy 0, policy_version 12410 (0.0008) [2023-02-24 18:23:29,862][177171] Large shaping reward 2.614 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.582, 194.0), ('weapon7', 0.002)] [2023-02-24 18:23:31,115][177153] Updated weights for policy 0, policy_version 12420 (0.0009) [2023-02-24 18:23:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13981.9). Total num frames: 50872320. Throughput: 0: 3497.1. Samples: 12719816. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:23:31,376][177119] Avg episode reward: [(0, '7.730')] [2023-02-24 18:23:32,921][177156] DAMAGECOUNT value on done: 98694.0 [2023-02-24 18:23:32,922][177156] Sum rewards: 10.350, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.781', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.035', 'weapon5': '0.080', 'weapon7': '0.106', 'AMMO3': '0.107', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.336', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '0.960', 'weapon2': '1.420', 'weapon3': '1.742', 'DAMAGECOUNT': '3.630', 'FRAGCOUNT': '9.000'} [2023-02-24 18:23:33,069][177156] DAMAGECOUNT value on done: 98897.0 [2023-02-24 18:23:33,069][177156] Sum rewards: 3.664, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.880', 'AMMO2': '0.020', 'AMMO5': '0.020', 'ARMOR': '0.020', 'WEAPON1': '0.050', 'AMMO4': '0.099', 'AMMO3': '0.115', 'weapon5': '0.138', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.500', 'WEAPON3': '0.750', 'HITCOUNT': '0.810', 'weapon2': '1.254', 'weapon3': '1.810', 'DAMAGECOUNT': '2.658', 'FRAGCOUNT': '7.000'} [2023-02-24 18:23:33,227][177156] DAMAGECOUNT value on done: 99205.0 [2023-02-24 18:23:33,227][177156] Sum rewards: 0.951, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.890', 'AMMO2': '0.011', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'weapon4': '0.046', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.128', 'weapon5': '0.152', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.530', 'WEAPON3': '0.850', 'weapon2': '1.170', 'weapon3': '1.910', 'DAMAGECOUNT': '2.085', 'FRAGCOUNT': '4.000'} [2023-02-24 18:23:33,385][177156] DAMAGECOUNT value on done: 98109.0 [2023-02-24 18:23:33,386][177156] Sum rewards: 3.600, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.977', 'AMMO5': '0.003', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.090', 'weapon5': '0.094', 'WEAPON5': '0.100', 'weapon7': '0.120', 'AMMO4': '0.144', 'WEAPON4': '0.350', 'AMMO6': '0.400', 'WEAPON7': '0.400', 'AMMO7': '0.400', 'weapon2': '0.438', 'HITCOUNT': '0.590', 'WEAPON3': '0.650', 'weapon4': '0.922', 'weapon3': '1.366', 'DAMAGECOUNT': '1.953', 'FRAGCOUNT': '4.000'} [2023-02-24 18:23:33,988][177153] Updated weights for policy 0, policy_version 12430 (0.0008) [2023-02-24 18:23:34,297][177156] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:23:36,376][177119] Fps is (10 sec: 14335.9, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 50946048. Throughput: 0: 3497.2. Samples: 12730258. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:23:36,376][177119] Avg episode reward: [(0, '7.562')] [2023-02-24 18:23:36,930][177153] Updated weights for policy 0, policy_version 12440 (0.0008) [2023-02-24 18:23:39,260][177170] DAMAGECOUNT value on done: 100004.0 [2023-02-24 18:23:39,260][177170] Sum rewards: 14.049, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.010', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'ARMOR': '0.020', 'AMMO4': '0.022', 'weapon7': '0.052', 'AMMO3': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.274', 'weapon4': '0.274', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '1.010', 'weapon3': '1.516', 'weapon2': '1.602', 'DAMAGECOUNT': '3.600', 'FRAGCOUNT': '11.000'} [2023-02-24 18:23:39,562][177170] DAMAGECOUNT value on done: 92209.0 [2023-02-24 18:23:39,562][177170] Sum rewards: 9.367, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.249', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.027', 'WEAPON1': '0.050', 'AMMO3': '0.084', 'AMMO4': '0.135', 'weapon4': '0.266', 'WEAPON4': '0.300', 'weapon5': '0.322', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.700', 'weapon3': '1.416', 'weapon2': '1.586', 'DAMAGECOUNT': '3.159', 'FRAGCOUNT': '9.000'} [2023-02-24 18:23:39,572][177170] DAMAGECOUNT value on done: 102877.0 [2023-02-24 18:23:39,572][177170] Sum rewards: 15.500, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.012', 'ARMOR': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'AMMO3': '0.056', 'weapon7': '0.104', 'weapon5': '0.116', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.400', 'WEAPON4': '0.400', 'WEAPON7': '0.400', 'weapon4': '0.696', 'HITCOUNT': '0.720', 'weapon2': '0.822', 'weapon3': '1.034', 'DAMAGECOUNT': '3.972', 'FRAGCOUNT': '13.000'} [2023-02-24 18:23:39,870][177153] Updated weights for policy 0, policy_version 12450 (0.0008) [2023-02-24 18:23:39,874][177170] DAMAGECOUNT value on done: 102453.0 [2023-02-24 18:23:39,875][177170] Sum rewards: 11.297, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.190', 'AMMO5': '0.017', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'weapon7': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.131', 'weapon4': '0.194', 'weapon5': '0.230', 'WEAPON5': '0.350', 'HITCOUNT': '0.860', 'WEAPON3': '0.900', 'weapon2': '1.280', 'weapon3': '1.942', 'DAMAGECOUNT': '4.257', 'FRAGCOUNT': '10.000'} [2023-02-24 18:23:40,663][177158] DAMAGECOUNT value on done: 97533.0 [2023-02-24 18:23:40,663][177158] Sum rewards: 15.250, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.744', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO4': '0.083', 'AMMO3': '0.088', 'weapon5': '0.290', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'WEAPON3': '0.650', 'weapon4': '0.762', 'weapon2': '0.966', 'HITCOUNT': '0.980', 'weapon3': '1.474', 'DAMAGECOUNT': '4.587', 'FRAGCOUNT': '12.500'} [2023-02-24 18:23:40,964][177158] DAMAGECOUNT value on done: 95603.0 [2023-02-24 18:23:40,964][177158] Sum rewards: 8.132, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.480', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.039', 'AMMO3': '0.050', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.158', 'AMMO4': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'weapon4': '0.364', 'HITCOUNT': '0.710', 'weapon3': '1.204', 'weapon2': '1.882', 'DAMAGECOUNT': '2.316', 'FRAGCOUNT': '5.000'} [2023-02-24 18:23:41,376][177119] Fps is (10 sec: 14336.1, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 51015680. Throughput: 0: 3496.2. Samples: 12751246. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:23:41,376][177119] Avg episode reward: [(0, '7.757')] [2023-02-24 18:23:41,553][177158] DAMAGECOUNT value on done: 98203.0 [2023-02-24 18:23:41,554][177158] Sum rewards: 4.410, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.412', 'ARMOR': '0.004', 'AMMO5': '0.008', 'WEAPON1': '0.040', 'AMMO2': '0.046', 'weapon7': '0.050', 'AMMO3': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.144', 'WEAPON4': '0.200', 'AMMO4': '0.229', 'WEAPON5': '0.250', 'HITCOUNT': '0.480', 'weapon4': '0.512', 'WEAPON3': '0.600', 'weapon2': '0.724', 'weapon3': '1.454', 'DAMAGECOUNT': '2.193', 'FRAGCOUNT': '5.000'} [2023-02-24 18:23:41,869][177158] DAMAGECOUNT value on done: 101996.0 [2023-02-24 18:23:41,870][177158] Sum rewards: 12.518, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.438', 'AMMO2': '0.007', 'AMMO5': '0.025', 'AMMO4': '0.036', 'WEAPON1': '0.060', 'AMMO3': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.352', 'ARMOR': '0.420', 'weapon5': '0.478', 'WEAPON5': '0.550', 'weapon2': '0.770', 'HITCOUNT': '0.840', 'WEAPON3': '0.900', 'weapon3': '2.078', 'DAMAGECOUNT': '3.660', 'FRAGCOUNT': '11.000'} [2023-02-24 18:23:42,774][177172] DAMAGECOUNT value on done: 100170.0 [2023-02-24 18:23:42,774][177172] Sum rewards: 5.491, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.070', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.020', 'AMMO3': '0.050', 'WEAPON1': '0.070', 'WEAPON4': '0.200', 'HITCOUNT': '0.300', 'weapon4': '0.324', 'weapon5': '0.424', 'WEAPON3': '0.450', 'WEAPON5': '0.550', 'DAMAGECOUNT': '1.191', 'weapon3': '1.258', 'weapon2': '1.470', 'FRAGCOUNT': '4.000'} [2023-02-24 18:23:42,808][177153] Updated weights for policy 0, policy_version 12460 (0.0008) [2023-02-24 18:23:43,064][177172] DAMAGECOUNT value on done: 98104.0 [2023-02-24 18:23:43,065][177172] Sum rewards: 10.798, reward structure: {'DEATHCOUNT': '-6.750', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.038', 'WEAPON1': '0.060', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon7': '0.100', 'HEALTH': '0.164', 'weapon5': '0.178', 'AMMO4': '0.188', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.248', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.730', 'weapon2': '1.284', 'weapon3': '1.616', 'DAMAGECOUNT': '3.177', 'FRAGCOUNT': '8.000'} [2023-02-24 18:23:43,854][177154] DAMAGECOUNT value on done: 102852.0 [2023-02-24 18:23:43,855][177154] Sum rewards: 7.659, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.394', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'ARMOR': '0.044', 'weapon5': '0.068', 'AMMO3': '0.087', 'weapon7': '0.092', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'weapon2': '0.504', 'HITCOUNT': '0.550', 'weapon4': '0.574', 'WEAPON3': '0.600', 'weapon3': '1.574', 'DAMAGECOUNT': '3.411', 'FRAGCOUNT': '7.500'} [2023-02-24 18:23:44,157][177154] DAMAGECOUNT value on done: 102762.0 [2023-02-24 18:23:44,158][177154] Sum rewards: 9.494, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.892', 'ARMOR': '0.008', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'weapon7': '0.050', 'AMMO2': '0.050', 'AMMO3': '0.063', 'AMMO4': '0.252', 'weapon5': '0.258', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '0.500', 'weapon4': '0.770', 'HITCOUNT': '0.910', 'weapon2': '0.990', 'weapon3': '1.236', 'DAMAGECOUNT': '4.110', 'FRAGCOUNT': '10.000'} [2023-02-24 18:23:44,170][177154] DAMAGECOUNT value on done: 101579.0 [2023-02-24 18:23:44,170][177154] Sum rewards: 8.502, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.264', 'AMMO5': '0.015', 'AMMO2': '0.030', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'weapon7': '0.046', 'AMMO3': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.148', 'weapon5': '0.188', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.552', 'WEAPON3': '0.800', 'HITCOUNT': '0.960', 'weapon2': '1.020', 'weapon3': '1.486', 'DAMAGECOUNT': '4.395', 'FRAGCOUNT': '11.000'} [2023-02-24 18:23:44,249][177172] DAMAGECOUNT value on done: 100310.0 [2023-02-24 18:23:44,249][177172] Sum rewards: 5.532, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.358', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.017', 'AMMO4': '0.053', 'weapon7': '0.100', 'AMMO3': '0.121', 'weapon5': '0.190', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'weapon4': '0.340', 'WEAPON5': '0.450', 'HITCOUNT': '0.660', 'WEAPON3': '0.900', 'weapon2': '0.956', 'weapon3': '1.960', 'DAMAGECOUNT': '2.874', 'FRAGCOUNT': '7.000'} [2023-02-24 18:23:44,469][177154] DAMAGECOUNT value on done: 106248.0 [2023-02-24 18:23:44,469][177154] Sum rewards: 16.794, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.068', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'weapon7': '0.050', 'weapon5': '0.066', 'AMMO4': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.128', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.306', 'WEAPON3': '0.900', 'HITCOUNT': '1.030', 'weapon2': '1.224', 'weapon3': '1.902', 'DAMAGECOUNT': '4.380', 'FRAGCOUNT': '16.000'} [2023-02-24 18:23:44,542][177172] DAMAGECOUNT value on done: 98454.0 [2023-02-24 18:23:44,543][177172] Sum rewards: 7.192, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.012', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.037', 'weapon7': '0.048', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.168', 'weapon4': '0.240', 'WEAPON5': '0.350', 'weapon2': '0.446', 'HITCOUNT': '0.640', 'WEAPON3': '0.650', 'weapon3': '1.726', 'DAMAGECOUNT': '2.394', 'FRAGCOUNT': '7.000'} [2023-02-24 18:23:44,691][177171] DAMAGECOUNT value on done: 100929.0 [2023-02-24 18:23:44,691][177171] Sum rewards: 7.572, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.341', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO5': '0.012', 'weapon5': '0.014', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'AMMO3': '0.081', 'weapon7': '0.146', 'weapon4': '0.196', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.650', 'weapon2': '1.030', 'weapon3': '1.450', 'DAMAGECOUNT': '2.991', 'FRAGCOUNT': '6.000'} [2023-02-24 18:23:44,984][177171] DAMAGECOUNT value on done: 100817.0 [2023-02-24 18:23:44,984][177171] Sum rewards: 5.349, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.680', 'AMMO5': '0.010', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'AMMO3': '0.096', 'AMMO4': '0.145', 'weapon5': '0.210', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.554', 'HITCOUNT': '0.650', 'WEAPON3': '0.700', 'weapon2': '1.110', 'weapon3': '1.624', 'DAMAGECOUNT': '2.670', 'FRAGCOUNT': '4.500'} [2023-02-24 18:23:45,128][177157] DAMAGECOUNT value on done: 102876.0 [2023-02-24 18:23:45,129][177157] Sum rewards: 4.095, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.756', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.053', 'weapon7': '0.054', 'AMMO3': '0.098', 'weapon5': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.360', 'weapon4': '0.420', 'WEAPON3': '0.600', 'weapon2': '0.746', 'weapon3': '1.340', 'DAMAGECOUNT': '1.626', 'FRAGCOUNT': '6.000'} [2023-02-24 18:23:45,143][177157] DAMAGECOUNT value on done: 98140.0 [2023-02-24 18:23:45,143][177157] Sum rewards: 4.824, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.782', 'AMMO2': '0.008', 'AMMO5': '0.022', 'AMMO4': '0.038', 'weapon7': '0.048', 'WEAPON1': '0.090', 'AMMO3': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.274', 'HITCOUNT': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon2': '1.076', 'weapon3': '2.248', 'DAMAGECOUNT': '2.295', 'FRAGCOUNT': '4.000'} [2023-02-24 18:23:45,166][177171] DAMAGECOUNT value on done: 97608.0 [2023-02-24 18:23:45,166][177171] Sum rewards: 15.009, reward structure: {'DEATHCOUNT': '-4.500', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'ARMOR': '0.024', 'AMMO2': '0.029', 'weapon7': '0.048', 'AMMO3': '0.077', 'HEALTH': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.144', 'WEAPON5': '0.200', 'weapon5': '0.208', 'weapon4': '0.436', 'WEAPON3': '0.450', 'HITCOUNT': '0.710', 'weapon2': '0.888', 'weapon3': '1.064', 'DAMAGECOUNT': '3.723', 'FRAGCOUNT': '11.000'} [2023-02-24 18:23:45,431][177157] DAMAGECOUNT value on done: 99046.0 [2023-02-24 18:23:45,431][177157] Sum rewards: 16.403, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.019', 'weapon7': '0.048', 'HEALTH': '0.088', 'AMMO4': '0.095', 'AMMO3': '0.096', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'WEAPON3': '0.550', 'weapon4': '0.562', 'HITCOUNT': '1.230', 'weapon2': '1.236', 'weapon3': '1.628', 'DAMAGECOUNT': '4.749', 'FRAGCOUNT': '12.000'} [2023-02-24 18:23:45,442][177157] DAMAGECOUNT value on done: 97667.0 [2023-02-24 18:23:45,442][177157] Sum rewards: 8.873, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.964', 'AMMO2': '0.007', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO4': '0.036', 'weapon7': '0.048', 'AMMO3': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.144', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.354', 'HITCOUNT': '0.680', 'WEAPON3': '0.700', 'weapon2': '1.188', 'weapon3': '1.666', 'DAMAGECOUNT': '3.942', 'FRAGCOUNT': '9.000'} [2023-02-24 18:23:45,473][177171] DAMAGECOUNT value on done: 95170.0 [2023-02-24 18:23:45,473][177171] Sum rewards: 11.310, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon5': '0.050', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'weapon7': '0.114', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'HEALTH': '0.255', 'WEAPON3': '0.400', 'weapon4': '0.424', 'HITCOUNT': '0.560', 'weapon2': '0.570', 'weapon3': '1.086', 'DAMAGECOUNT': '2.280', 'FRAGCOUNT': '9.000'} [2023-02-24 18:23:45,769][177153] Updated weights for policy 0, policy_version 12470 (0.0008) [2023-02-24 18:23:46,032][177155] DAMAGECOUNT value on done: 100576.0 [2023-02-24 18:23:46,033][177155] Sum rewards: 3.410, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.246', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO2': '0.043', 'weapon5': '0.068', 'AMMO3': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.215', 'WEAPON4': '0.300', 'weapon4': '0.458', 'HITCOUNT': '0.600', 'WEAPON3': '0.650', 'weapon2': '1.526', 'weapon3': '1.654', 'DAMAGECOUNT': '2.340', 'FRAGCOUNT': '6.000'} [2023-02-24 18:23:46,330][177155] DAMAGECOUNT value on done: 104975.0 [2023-02-24 18:23:46,331][177155] Sum rewards: 9.928, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.590', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon7': '0.050', 'weapon5': '0.102', 'AMMO3': '0.119', 'weapon4': '0.136', 'AMMO4': '0.139', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'ARMOR': '0.436', 'HITCOUNT': '0.830', 'WEAPON3': '0.850', 'weapon3': '1.738', 'weapon2': '1.786', 'DAMAGECOUNT': '3.804', 'FRAGCOUNT': '9.000'} [2023-02-24 18:23:46,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 51085312. Throughput: 0: 3493.2. Samples: 12772094. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:23:46,376][177119] Avg episode reward: [(0, '7.722')] [2023-02-24 18:23:46,638][177155] DAMAGECOUNT value on done: 102159.0 [2023-02-24 18:23:46,639][177155] Sum rewards: 9.514, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.690', 'weapon7': '0.006', 'ARMOR': '0.024', 'AMMO2': '0.027', 'AMMO3': '0.078', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.135', 'WEAPON4': '0.350', 'weapon4': '0.516', 'WEAPON3': '0.550', 'HITCOUNT': '0.930', 'weapon3': '1.330', 'weapon2': '1.400', 'DAMAGECOUNT': '3.057', 'FRAGCOUNT': '9.000'} [2023-02-24 18:23:46,936][177155] DAMAGECOUNT value on done: 96767.0 [2023-02-24 18:23:46,936][177155] Sum rewards: 4.400, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.189', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.030', 'weapon7': '0.048', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.148', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.598', 'HITCOUNT': '0.710', 'WEAPON3': '0.750', 'weapon2': '1.112', 'weapon3': '1.844', 'DAMAGECOUNT': '2.352', 'FRAGCOUNT': '6.000'} [2023-02-24 18:23:48,685][177153] Updated weights for policy 0, policy_version 12480 (0.0008) [2023-02-24 18:23:51,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 51154944. Throughput: 0: 3494.2. Samples: 12782664. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 18:23:51,376][177119] Avg episode reward: [(0, '7.761')] [2023-02-24 18:23:51,612][177153] Updated weights for policy 0, policy_version 12490 (0.0008) [2023-02-24 18:23:52,134][177156] DAMAGECOUNT value on done: 99995.0 [2023-02-24 18:23:52,134][177156] Sum rewards: 11.745, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.138', 'ARMOR': '0.016', 'AMMO5': '0.022', 'AMMO2': '0.030', 'weapon7': '0.052', 'WEAPON1': '0.080', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'AMMO4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.236', 'weapon4': '0.248', 'WEAPON5': '0.600', 'WEAPON3': '0.850', 'HITCOUNT': '0.900', 'weapon2': '1.288', 'weapon3': '1.814', 'DAMAGECOUNT': '3.903', 'FRAGCOUNT': '9.000'} [2023-02-24 18:23:52,297][177156] DAMAGECOUNT value on done: 100181.0 [2023-02-24 18:23:52,297][177156] Sum rewards: 12.488, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.735', 'AMMO2': '0.006', 'ARMOR': '0.012', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.030', 'weapon7': '0.052', 'AMMO3': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.194', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon4': '0.506', 'weapon2': '0.722', 'WEAPON3': '0.750', 'HITCOUNT': '0.870', 'weapon3': '1.632', 'DAMAGECOUNT': '3.852', 'FRAGCOUNT': '11.000'} [2023-02-24 18:23:52,442][177156] DAMAGECOUNT value on done: 100537.0 [2023-02-24 18:23:52,442][177156] Sum rewards: 15.201, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.240', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.109', 'weapon5': '0.128', 'WEAPON5': '0.200', 'weapon4': '0.208', 'WEAPON3': '0.700', 'HITCOUNT': '1.050', 'weapon2': '1.350', 'weapon3': '2.020', 'DAMAGECOUNT': '3.996', 'FRAGCOUNT': '13.000'} [2023-02-24 18:23:52,615][177156] DAMAGECOUNT value on done: 98750.0 [2023-02-24 18:23:52,615][177156] Sum rewards: 4.796, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.273', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.042', 'weapon7': '0.060', 'WEAPON1': '0.070', 'AMMO3': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.211', 'weapon5': '0.216', 'HITCOUNT': '0.230', 'weapon4': '0.344', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon3': '1.068', 'weapon2': '1.636', 'DAMAGECOUNT': '1.689', 'FRAGCOUNT': '4.000'} [2023-02-24 18:23:54,573][177153] Updated weights for policy 0, policy_version 12500 (0.0008) [2023-02-24 18:23:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 51224576. Throughput: 0: 3492.7. Samples: 12803558. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 18:23:56,376][177119] Avg episode reward: [(0, '7.892')] [2023-02-24 18:23:57,497][177153] Updated weights for policy 0, policy_version 12510 (0.0008) [2023-02-24 18:23:58,526][177170] DAMAGECOUNT value on done: 101274.0 [2023-02-24 18:23:58,526][177170] Sum rewards: 6.733, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.117', 'AMMO5': '0.025', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO2': '0.054', 'weapon5': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.131', 'WEAPON7': '0.200', 'AMMO4': '0.272', 'ARMOR': '0.456', 'WEAPON5': '0.550', 'WEAPON4': '0.750', 'WEAPON3': '0.900', 'weapon4': '0.940', 'weapon2': '1.048', 'HITCOUNT': '1.060', 'weapon3': '1.512', 'DAMAGECOUNT': '3.795', 'FRAGCOUNT': '9.000'} [2023-02-24 18:23:58,822][177170] DAMAGECOUNT value on done: 92979.0 [2023-02-24 18:23:58,822][177170] Sum rewards: 9.251, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.054', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.091', 'AMMO3': '0.100', 'weapon7': '0.100', 'weapon5': '0.166', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.204', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.650', 'weapon3': '1.456', 'weapon2': '1.562', 'DAMAGECOUNT': '2.310', 'FRAGCOUNT': '6.000'} [2023-02-24 18:23:58,831][177170] DAMAGECOUNT value on done: 103780.0 [2023-02-24 18:23:58,831][177170] Sum rewards: 10.538, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.790', 'ARMOR': '0.008', 'AMMO2': '0.015', 'AMMO5': '0.017', 'AMMO4': '0.074', 'WEAPON1': '0.080', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'weapon7': '0.126', 'weapon5': '0.136', 'weapon4': '0.208', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'HITCOUNT': '0.640', 'WEAPON3': '0.650', 'weapon2': '0.836', 'weapon3': '1.750', 'DAMAGECOUNT': '2.709', 'FRAGCOUNT': '8.000'} [2023-02-24 18:23:59,130][177170] DAMAGECOUNT value on done: 103477.0 [2023-02-24 18:23:59,131][177170] Sum rewards: 15.646, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon5': '0.090', 'AMMO3': '0.094', 'AMMO4': '0.106', 'weapon7': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.306', 'HEALTH': '0.468', 'WEAPON3': '0.600', 'HITCOUNT': '0.800', 'weapon2': '1.132', 'weapon3': '1.894', 'DAMAGECOUNT': '3.072', 'FRAGCOUNT': '12.000'} [2023-02-24 18:23:59,973][177158] DAMAGECOUNT value on done: 98488.0 [2023-02-24 18:23:59,973][177158] Sum rewards: 9.157, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.370', 'AMMO2': '0.017', 'AMMO5': '0.028', 'ARMOR': '0.036', 'weapon7': '0.048', 'WEAPON1': '0.080', 'AMMO4': '0.085', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'weapon4': '0.182', 'weapon5': '0.192', 'WEAPON7': '0.200', 'WEAPON5': '0.650', 'HITCOUNT': '0.670', 'WEAPON3': '1.050', 'weapon2': '1.164', 'weapon3': '1.974', 'DAMAGECOUNT': '2.865', 'FRAGCOUNT': '10.000'} [2023-02-24 18:24:00,277][177158] DAMAGECOUNT value on done: 97139.0 [2023-02-24 18:24:00,277][177158] Sum rewards: 11.209, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.240', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.049', 'WEAPON1': '0.060', 'AMMO3': '0.105', 'AMMO4': '0.246', 'weapon4': '0.316', 'WEAPON4': '0.350', 'weapon5': '0.416', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'HITCOUNT': '0.910', 'weapon2': '1.046', 'weapon3': '1.816', 'DAMAGECOUNT': '4.608', 'FRAGCOUNT': '11.000'} [2023-02-24 18:24:00,429][177153] Updated weights for policy 0, policy_version 12520 (0.0008) [2023-02-24 18:24:00,858][177158] DAMAGECOUNT value on done: 98900.0 [2023-02-24 18:24:00,858][177158] Sum rewards: 3.446, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.143', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.085', 'weapon7': '0.108', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.406', 'HITCOUNT': '0.450', 'weapon2': '0.630', 'WEAPON3': '0.700', 'weapon3': '1.300', 'DAMAGECOUNT': '2.091', 'FRAGCOUNT': '5.000'} [2023-02-24 18:24:01,152][177158] DAMAGECOUNT value on done: 102857.0 [2023-02-24 18:24:01,152][177158] Sum rewards: 3.366, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.330', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'AMMO5': '0.020', 'WEAPON1': '0.060', 'AMMO3': '0.136', 'weapon5': '0.238', 'ARMOR': '0.477', 'WEAPON5': '0.500', 'HITCOUNT': '0.550', 'WEAPON3': '0.950', 'weapon3': '1.734', 'weapon2': '1.744', 'DAMAGECOUNT': '2.583', 'FRAGCOUNT': '5.000'} [2023-02-24 18:24:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 51294208. Throughput: 0: 3489.7. Samples: 12824428. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:24:01,376][177119] Avg episode reward: [(0, '7.933')] [2023-02-24 18:24:01,984][177172] DAMAGECOUNT value on done: 100913.0 [2023-02-24 18:24:01,985][177172] Sum rewards: 8.889, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.414', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.016', 'weapon5': '0.070', 'AMMO3': '0.095', 'weapon7': '0.118', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.300', 'WEAPON7': '0.400', 'weapon4': '0.472', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'weapon2': '1.208', 'weapon3': '1.346', 'DAMAGECOUNT': '2.229', 'FRAGCOUNT': '8.000'} [2023-02-24 18:24:02,290][177172] DAMAGECOUNT value on done: 99794.0 [2023-02-24 18:24:02,291][177172] Sum rewards: 16.559, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.770', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.025', 'WEAPON1': '0.050', 'weapon7': '0.074', 'AMMO4': '0.126', 'AMMO3': '0.133', 'weapon5': '0.162', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'weapon4': '0.412', 'WEAPON3': '0.800', 'HITCOUNT': '1.060', 'weapon2': '1.464', 'weapon3': '1.508', 'DAMAGECOUNT': '4.884', 'FRAGCOUNT': '15.000'} [2023-02-24 18:24:03,095][177154] DAMAGECOUNT value on done: 103549.0 [2023-02-24 18:24:03,096][177154] Sum rewards: 6.431, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.951', 'AMMO2': '0.013', 'AMMO5': '0.022', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.082', 'WEAPON1': '0.100', 'weapon4': '0.222', 'weapon5': '0.278', 'ARMOR': '0.457', 'WEAPON3': '0.550', 'WEAPON5': '0.550', 'HITCOUNT': '0.550', 'weapon2': '1.156', 'weapon3': '1.944', 'DAMAGECOUNT': '2.091', 'FRAGCOUNT': '4.500'} [2023-02-24 18:24:03,369][177153] Updated weights for policy 0, policy_version 12530 (0.0008) [2023-02-24 18:24:03,392][177154] DAMAGECOUNT value on done: 104541.0 [2023-02-24 18:24:03,392][177154] Sum rewards: 14.960, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.528', 'AMMO5': '0.012', 'AMMO2': '0.020', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'weapon4': '0.066', 'WEAPON1': '0.070', 'AMMO4': '0.100', 'AMMO3': '0.106', 'weapon7': '0.106', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.272', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'weapon2': '0.962', 'HITCOUNT': '0.980', 'weapon3': '2.174', 'DAMAGECOUNT': '5.337', 'FRAGCOUNT': '11.000'} [2023-02-24 18:24:03,404][177154] DAMAGECOUNT value on done: 102490.0 [2023-02-24 18:24:03,405][177154] Sum rewards: 9.745, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.305', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO3': '0.081', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.188', 'WEAPON7': '0.200', 'weapon5': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'ARMOR': '0.408', 'WEAPON3': '0.550', 'HITCOUNT': '0.590', 'weapon4': '0.784', 'weapon2': '0.910', 'weapon3': '1.496', 'DAMAGECOUNT': '2.733', 'FRAGCOUNT': '7.000'} [2023-02-24 18:24:03,481][177172] DAMAGECOUNT value on done: 101535.0 [2023-02-24 18:24:03,481][177172] Sum rewards: 14.504, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.098', 'weapon7': '0.104', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.228', 'WEAPON7': '0.300', 'HEALTH': '0.335', 'WEAPON3': '0.550', 'HITCOUNT': '0.780', 'weapon3': '1.428', 'weapon2': '1.976', 'DAMAGECOUNT': '3.675', 'FRAGCOUNT': '11.000'} [2023-02-24 18:24:03,708][177154] DAMAGECOUNT value on done: 107243.0 [2023-02-24 18:24:03,708][177154] Sum rewards: 7.792, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.300', 'AMMO5': '0.017', 'AMMO2': '0.019', 'WEAPON1': '0.060', 'AMMO4': '0.093', 'AMMO3': '0.111', 'weapon5': '0.132', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.436', 'ARMOR': '0.524', 'HITCOUNT': '0.690', 'WEAPON3': '0.700', 'weapon2': '1.464', 'weapon3': '1.710', 'DAMAGECOUNT': '2.985', 'FRAGCOUNT': '7.000'} [2023-02-24 18:24:03,780][177172] DAMAGECOUNT value on done: 99853.0 [2023-02-24 18:24:03,780][177172] Sum rewards: 10.755, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.070', 'AMMO2': '0.009', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.046', 'weapon5': '0.132', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'weapon4': '0.224', 'WEAPON5': '0.350', 'WEAPON3': '0.950', 'HITCOUNT': '1.030', 'weapon2': '1.456', 'weapon3': '1.850', 'DAMAGECOUNT': '4.197', 'FRAGCOUNT': '12.000'} [2023-02-24 18:24:04,002][177171] DAMAGECOUNT value on done: 102489.0 [2023-02-24 18:24:04,003][177171] Sum rewards: 10.315, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.406', 'weapon7': '0.008', 'AMMO2': '0.019', 'AMMO5': '0.032', 'WEAPON1': '0.040', 'AMMO4': '0.096', 'AMMO3': '0.117', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON5': '0.550', 'weapon4': '0.560', 'weapon2': '0.718', 'WEAPON3': '0.950', 'HITCOUNT': '0.950', 'weapon3': '2.092', 'DAMAGECOUNT': '3.639', 'FRAGCOUNT': '9.000'} [2023-02-24 18:24:04,302][177171] DAMAGECOUNT value on done: 101932.0 [2023-02-24 18:24:04,302][177171] Sum rewards: 10.153, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.604', 'AMMO5': '0.013', 'ARMOR': '0.016', 'AMMO2': '0.026', 'WEAPON1': '0.060', 'weapon4': '0.098', 'AMMO4': '0.131', 'AMMO3': '0.150', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.236', 'WEAPON5': '0.450', 'weapon2': '0.906', 'HITCOUNT': '0.910', 'WEAPON3': '1.050', 'weapon3': '2.316', 'DAMAGECOUNT': '3.345', 'FRAGCOUNT': '11.000'} [2023-02-24 18:24:04,406][177157] DAMAGECOUNT value on done: 103861.0 [2023-02-24 18:24:04,407][177157] Sum rewards: 9.897, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.886', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'ARMOR': '0.044', 'weapon5': '0.052', 'AMMO3': '0.104', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'WEAPON4': '0.400', 'WEAPON3': '0.600', 'weapon4': '0.624', 'HITCOUNT': '0.950', 'weapon2': '1.206', 'weapon3': '1.736', 'DAMAGECOUNT': '2.955', 'FRAGCOUNT': '10.000'} [2023-02-24 18:24:04,418][177157] DAMAGECOUNT value on done: 99116.0 [2023-02-24 18:24:04,419][177157] Sum rewards: 6.396, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.358', 'AMMO2': '0.010', 'AMMO5': '0.035', 'AMMO4': '0.048', 'WEAPON1': '0.070', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'weapon5': '0.162', 'weapon4': '0.212', 'WEAPON5': '0.700', 'HITCOUNT': '0.720', 'WEAPON3': '0.900', 'weapon2': '1.142', 'weapon3': '2.050', 'DAMAGECOUNT': '2.928', 'FRAGCOUNT': '8.000'} [2023-02-24 18:24:04,473][177171] DAMAGECOUNT value on done: 98030.0 [2023-02-24 18:24:04,473][177171] Sum rewards: 0.859, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.318', 'AMMO5': '0.022', 'AMMO2': '0.038', 'WEAPON1': '0.040', 'weapon7': '0.080', 'AMMO3': '0.120', 'AMMO4': '0.190', 'weapon5': '0.200', 'weapon2': '0.276', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'HITCOUNT': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'ARMOR': '0.808', 'weapon4': '0.942', 'weapon3': '1.194', 'DAMAGECOUNT': '1.266', 'FRAGCOUNT': '4.000'} [2023-02-24 18:24:04,719][177157] DAMAGECOUNT value on done: 100128.0 [2023-02-24 18:24:04,720][177157] Sum rewards: 9.161, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '0.010', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'ARMOR': '0.032', 'AMMO3': '0.091', 'AMMO4': '0.120', 'weapon5': '0.160', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.470', 'WEAPON3': '0.550', 'HITCOUNT': '0.690', 'weapon2': '1.334', 'weapon3': '1.554', 'DAMAGECOUNT': '3.246', 'FRAGCOUNT': '7.000'} [2023-02-24 18:24:04,729][177157] DAMAGECOUNT value on done: 98638.0 [2023-02-24 18:24:04,730][177157] Sum rewards: 10.682, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.220', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'WEAPON1': '0.060', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'weapon4': '0.226', 'WEAPON5': '0.250', 'weapon5': '0.284', 'HITCOUNT': '0.520', 'WEAPON3': '0.700', 'weapon2': '1.394', 'weapon3': '1.622', 'DAMAGECOUNT': '2.913', 'FRAGCOUNT': '9.000'} [2023-02-24 18:24:04,771][177171] DAMAGECOUNT value on done: 96395.0 [2023-02-24 18:24:04,772][177171] Sum rewards: 9.042, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.689', 'AMMO5': '0.020', 'AMMO2': '0.033', 'WEAPON1': '0.040', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'AMMO4': '0.165', 'weapon5': '0.300', 'ARMOR': '0.400', 'weapon4': '0.400', 'WEAPON5': '0.450', 'HITCOUNT': '0.820', 'weapon2': '0.856', 'WEAPON3': '0.900', 'weapon3': '2.140', 'DAMAGECOUNT': '3.675', 'FRAGCOUNT': '9.000'} [2023-02-24 18:24:05,282][177155] DAMAGECOUNT value on done: 101636.0 [2023-02-24 18:24:05,282][177155] Sum rewards: 8.247, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.990', 'AMMO2': '0.010', 'AMMO5': '0.015', 'ARMOR': '0.016', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO4': '0.048', 'AMMO3': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.178', 'weapon5': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'HITCOUNT': '0.780', 'weapon3': '1.626', 'weapon2': '1.684', 'DAMAGECOUNT': '3.180', 'FRAGCOUNT': '7.500'} [2023-02-24 18:24:05,579][177155] DAMAGECOUNT value on done: 106056.0 [2023-02-24 18:24:05,580][177155] Sum rewards: 8.284, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.738', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON1': '0.050', 'weapon7': '0.060', 'weapon5': '0.066', 'AMMO3': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.206', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.840', 'WEAPON3': '0.850', 'weapon2': '1.426', 'weapon3': '2.006', 'DAMAGECOUNT': '3.243', 'FRAGCOUNT': '9.000'} [2023-02-24 18:24:05,884][177155] DAMAGECOUNT value on done: 103510.0 [2023-02-24 18:24:05,885][177155] Sum rewards: 14.087, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.600', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.026', 'weapon4': '0.032', 'WEAPON4': '0.050', 'weapon5': '0.064', 'AMMO3': '0.084', 'weapon7': '0.144', 'WEAPON5': '0.150', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.860', 'weapon2': '1.724', 'weapon3': '1.842', 'DAMAGECOUNT': '4.053', 'FRAGCOUNT': '10.000'} [2023-02-24 18:24:06,172][177155] DAMAGECOUNT value on done: 97637.0 [2023-02-24 18:24:06,172][177155] Sum rewards: 7.957, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.112', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'ARMOR': '0.016', 'AMMO2': '0.031', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.152', 'weapon5': '0.174', 'WEAPON4': '0.250', 'weapon4': '0.290', 'WEAPON5': '0.300', 'HITCOUNT': '0.590', 'WEAPON3': '0.700', 'weapon3': '1.466', 'weapon2': '1.756', 'DAMAGECOUNT': '2.610', 'FRAGCOUNT': '7.000'} [2023-02-24 18:24:06,309][177153] Updated weights for policy 0, policy_version 12540 (0.0009) [2023-02-24 18:24:06,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 51363840. Throughput: 0: 3489.7. Samples: 12834852. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:24:06,376][177119] Avg episode reward: [(0, '8.596')] [2023-02-24 18:24:09,221][177153] Updated weights for policy 0, policy_version 12550 (0.0009) [2023-02-24 18:24:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13995.8). Total num frames: 51433472. Throughput: 0: 3494.1. Samples: 12855912. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 18:24:11,376][177119] Avg episode reward: [(0, '8.596')] [2023-02-24 18:24:11,471][177156] DAMAGECOUNT value on done: 101138.0 [2023-02-24 18:24:11,472][177156] Sum rewards: 12.289, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.898', 'AMMO5': '0.015', 'AMMO2': '0.027', 'WEAPON1': '0.050', 'weapon7': '0.052', 'AMMO3': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.134', 'weapon5': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon2': '0.422', 'WEAPON3': '0.500', 'weapon4': '0.604', 'HITCOUNT': '0.690', 'weapon3': '1.508', 'DAMAGECOUNT': '3.429', 'FRAGCOUNT': '11.000'} [2023-02-24 18:24:11,633][177156] DAMAGECOUNT value on done: 101342.0 [2023-02-24 18:24:11,634][177156] Sum rewards: 9.379, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.041', 'AMMO2': '0.009', 'AMMO5': '0.012', 'ARMOR': '0.020', 'AMMO4': '0.044', 'WEAPON1': '0.070', 'weapon4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon5': '0.164', 'WEAPON5': '0.350', 'HITCOUNT': '0.850', 'WEAPON3': '0.950', 'weapon2': '1.046', 'weapon3': '2.380', 'DAMAGECOUNT': '3.483', 'FRAGCOUNT': '10.000'} [2023-02-24 18:24:11,777][177156] DAMAGECOUNT value on done: 101443.0 [2023-02-24 18:24:11,778][177156] Sum rewards: 4.390, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.024', 'AMMO5': '0.020', 'ARMOR': '0.032', 'AMMO2': '0.042', 'WEAPON1': '0.060', 'weapon5': '0.074', 'AMMO3': '0.137', 'WEAPON4': '0.200', 'AMMO4': '0.210', 'weapon4': '0.362', 'WEAPON5': '0.400', 'HITCOUNT': '0.790', 'WEAPON3': '0.950', 'weapon2': '1.058', 'weapon3': '2.110', 'DAMAGECOUNT': '2.718', 'FRAGCOUNT': '6.000'} [2023-02-24 18:24:11,949][177156] DAMAGECOUNT value on done: 99979.0 [2023-02-24 18:24:11,949][177156] Sum rewards: 8.921, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.430', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'AMMO2': '0.048', 'weapon5': '0.060', 'AMMO3': '0.086', 'WEAPON5': '0.150', 'weapon7': '0.158', 'AMMO4': '0.239', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'WEAPON4': '0.550', 'weapon4': '0.964', 'HITCOUNT': '1.020', 'weapon2': '1.030', 'weapon3': '1.084', 'DAMAGECOUNT': '3.687', 'FRAGCOUNT': '9.000'} [2023-02-24 18:24:12,184][177153] Updated weights for policy 0, policy_version 12560 (0.0008) [2023-02-24 18:24:15,114][177153] Updated weights for policy 0, policy_version 12570 (0.0008) [2023-02-24 18:24:16,376][177119] Fps is (10 sec: 13925.7, 60 sec: 13994.6, 300 sec: 13981.9). Total num frames: 51503104. Throughput: 0: 3488.9. Samples: 12876816. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 18:24:16,377][177119] Avg episode reward: [(0, '8.697')] [2023-02-24 18:24:17,775][177170] DAMAGECOUNT value on done: 102070.0 [2023-02-24 18:24:17,776][177170] Sum rewards: 5.242, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.666', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'weapon4': '0.086', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'weapon5': '0.240', 'WEAPON5': '0.300', 'HITCOUNT': '0.560', 'WEAPON3': '0.600', 'weapon2': '1.440', 'weapon3': '1.530', 'DAMAGECOUNT': '2.388', 'FRAGCOUNT': '4.500'} [2023-02-24 18:24:18,050][177153] Updated weights for policy 0, policy_version 12580 (0.0008) [2023-02-24 18:24:18,077][177170] DAMAGECOUNT value on done: 94330.0 [2023-02-24 18:24:18,077][177170] Sum rewards: 10.368, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.296', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon7': '0.054', 'WEAPON1': '0.060', 'AMMO3': '0.088', 'AMMO4': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'weapon2': '0.826', 'HITCOUNT': '0.830', 'weapon4': '0.842', 'weapon3': '1.560', 'DAMAGECOUNT': '4.053', 'FRAGCOUNT': '8.000'} [2023-02-24 18:24:18,086][177170] DAMAGECOUNT value on done: 104576.0 [2023-02-24 18:24:18,087][177170] Sum rewards: 6.243, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.065', 'AMMO2': '0.011', 'AMMO5': '0.019', 'WEAPON1': '0.030', 'weapon7': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'weapon5': '0.158', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'weapon4': '0.418', 'WEAPON5': '0.450', 'HITCOUNT': '0.510', 'WEAPON3': '0.850', 'weapon2': '1.306', 'weapon3': '1.736', 'DAMAGECOUNT': '2.388', 'FRAGCOUNT': '7.000'} [2023-02-24 18:24:18,384][177170] DAMAGECOUNT value on done: 104114.0 [2023-02-24 18:24:18,384][177170] Sum rewards: 8.584, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.272', 'AMMO5': '0.012', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'AMMO3': '0.060', 'weapon5': '0.064', 'AMMO4': '0.095', 'weapon7': '0.184', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.420', 'weapon4': '0.444', 'weapon3': '1.260', 'weapon2': '1.344', 'DAMAGECOUNT': '1.911', 'FRAGCOUNT': '7.000'} [2023-02-24 18:24:19,177][177158] DAMAGECOUNT value on done: 99804.0 [2023-02-24 18:24:19,178][177158] Sum rewards: 8.947, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.790', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO2': '0.044', 'weapon7': '0.046', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.114', 'AMMO4': '0.222', 'weapon5': '0.282', 'weapon4': '0.378', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'HITCOUNT': '0.880', 'weapon2': '1.440', 'weapon3': '1.582', 'DAMAGECOUNT': '3.948', 'FRAGCOUNT': '9.500'} [2023-02-24 18:24:19,490][177158] DAMAGECOUNT value on done: 97928.0 [2023-02-24 18:24:19,491][177158] Sum rewards: 9.028, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.602', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO3': '0.050', 'AMMO4': '0.059', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.170', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'weapon4': '0.384', 'ARMOR': '0.432', 'HITCOUNT': '0.480', 'weapon2': '0.956', 'weapon3': '1.242', 'DAMAGECOUNT': '2.367', 'FRAGCOUNT': '6.000'} [2023-02-24 18:24:20,079][177158] DAMAGECOUNT value on done: 100020.0 [2023-02-24 18:24:20,079][177158] Sum rewards: 10.022, reward structure: {'DEATHCOUNT': '-4.500', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO3': '0.040', 'AMMO4': '0.089', 'weapon7': '0.158', 'HEALTH': '0.183', 'WEAPON5': '0.200', 'weapon5': '0.218', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.250', 'WEAPON4': '0.300', 'WEAPON7': '0.400', 'weapon2': '0.410', 'HITCOUNT': '0.730', 'weapon3': '0.744', 'weapon4': '0.926', 'DAMAGECOUNT': '3.360', 'FRAGCOUNT': '6.000'} [2023-02-24 18:24:20,368][177158] DAMAGECOUNT value on done: 103784.0 [2023-02-24 18:24:20,368][177158] Sum rewards: 8.670, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.870', 'AMMO2': '0.012', 'AMMO5': '0.022', 'AMMO4': '0.062', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon4': '0.192', 'weapon5': '0.218', 'WEAPON5': '0.500', 'HITCOUNT': '0.680', 'WEAPON3': '0.850', 'weapon2': '0.936', 'weapon3': '2.248', 'DAMAGECOUNT': '2.781', 'FRAGCOUNT': '9.000'} [2023-02-24 18:24:20,997][177153] Updated weights for policy 0, policy_version 12590 (0.0008) [2023-02-24 18:24:21,282][177172] DAMAGECOUNT value on done: 102278.0 [2023-02-24 18:24:21,283][177172] Sum rewards: 10.299, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.248', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.021', 'WEAPON1': '0.030', 'weapon5': '0.120', 'AMMO3': '0.141', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.468', 'ARMOR': '0.502', 'HITCOUNT': '0.860', 'WEAPON3': '0.900', 'weapon2': '1.262', 'weapon3': '1.906', 'DAMAGECOUNT': '3.927', 'FRAGCOUNT': '10.000'} [2023-02-24 18:24:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13981.9). Total num frames: 51572736. Throughput: 0: 3488.8. Samples: 12887254. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:24:21,376][177119] Avg episode reward: [(0, '8.807')] [2023-02-24 18:24:21,582][177172] DAMAGECOUNT value on done: 101447.0 [2023-02-24 18:24:21,582][177172] Sum rewards: 17.499, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.580', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.148', 'weapon4': '0.234', 'WEAPON5': '0.300', 'ARMOR': '0.463', 'WEAPON3': '0.650', 'HITCOUNT': '1.150', 'weapon2': '1.232', 'weapon3': '1.896', 'DAMAGECOUNT': '4.728', 'FRAGCOUNT': '12.000'} [2023-02-24 18:24:22,328][177154] DAMAGECOUNT value on done: 105057.0 [2023-02-24 18:24:22,329][177154] Sum rewards: 17.496, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.194', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'ARMOR': '0.004', 'weapon7': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.106', 'AMMO3': '0.109', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.244', 'WEAPON5': '0.250', 'WEAPON3': '0.850', 'weapon2': '1.154', 'HITCOUNT': '1.390', 'weapon3': '2.040', 'DAMAGECOUNT': '4.524', 'FRAGCOUNT': '14.000'} [2023-02-24 18:24:22,632][177154] DAMAGECOUNT value on done: 105116.0 [2023-02-24 18:24:22,632][177154] Sum rewards: 6.273, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.015', 'HEALTH': '0.023', 'AMMO2': '0.024', 'AMMO3': '0.060', 'WEAPON1': '0.100', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'weapon5': '0.232', 'HITCOUNT': '0.340', 'weapon4': '0.394', 'WEAPON5': '0.400', 'WEAPON3': '0.400', 'weapon2': '1.076', 'weapon3': '1.462', 'DAMAGECOUNT': '1.725', 'FRAGCOUNT': '5.000'} [2023-02-24 18:24:22,646][177154] DAMAGECOUNT value on done: 103282.0 [2023-02-24 18:24:22,646][177154] Sum rewards: 5.802, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.206', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon7': '0.024', 'weapon4': '0.052', 'WEAPON1': '0.060', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.110', 'weapon5': '0.126', 'AMMO3': '0.127', 'WEAPON5': '0.300', 'HITCOUNT': '0.690', 'WEAPON3': '0.850', 'weapon2': '1.382', 'weapon3': '1.978', 'DAMAGECOUNT': '2.376', 'FRAGCOUNT': '6.000'} [2023-02-24 18:24:22,777][177172] DAMAGECOUNT value on done: 103081.0 [2023-02-24 18:24:22,778][177172] Sum rewards: 5.732, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.625', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.036', 'AMMO3': '0.082', 'weapon7': '0.106', 'AMMO4': '0.180', 'weapon5': '0.182', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.380', 'WEAPON3': '0.500', 'HITCOUNT': '0.630', 'weapon4': '0.856', 'weapon3': '1.326', 'DAMAGECOUNT': '2.838', 'FRAGCOUNT': '4.000'} [2023-02-24 18:24:22,953][177154] DAMAGECOUNT value on done: 108621.0 [2023-02-24 18:24:22,954][177154] Sum rewards: 8.160, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.610', 'weapon7': '0.014', 'AMMO5': '0.026', 'AMMO2': '0.029', 'WEAPON1': '0.070', 'weapon4': '0.084', 'AMMO3': '0.134', 'AMMO4': '0.144', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.266', 'WEAPON5': '0.600', 'WEAPON3': '0.850', 'weapon2': '1.148', 'HITCOUNT': '1.190', 'weapon3': '2.080', 'DAMAGECOUNT': '4.134', 'FRAGCOUNT': '7.000'} [2023-02-24 18:24:23,083][177172] DAMAGECOUNT value on done: 101070.0 [2023-02-24 18:24:23,083][177172] Sum rewards: 10.074, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.193', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.041', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.103', 'weapon5': '0.178', 'AMMO4': '0.207', 'WEAPON5': '0.350', 'weapon2': '0.370', 'WEAPON4': '0.500', 'WEAPON3': '0.750', 'ARMOR': '0.901', 'weapon4': '0.980', 'HITCOUNT': '1.060', 'weapon3': '1.774', 'DAMAGECOUNT': '3.651', 'FRAGCOUNT': '9.000'} [2023-02-24 18:24:23,246][177171] DAMAGECOUNT value on done: 104406.0 [2023-02-24 18:24:23,247][177171] Sum rewards: 14.380, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.880', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'weapon7': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.127', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.234', 'WEAPON5': '0.300', 'weapon2': '0.518', 'weapon4': '0.530', 'WEAPON3': '0.750', 'HITCOUNT': '0.790', 'weapon3': '2.188', 'DAMAGECOUNT': '4.551', 'FRAGCOUNT': '12.000'} [2023-02-24 18:24:23,546][177171] DAMAGECOUNT value on done: 102970.0 [2023-02-24 18:24:23,547][177171] Sum rewards: 11.580, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.770', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'AMMO3': '0.054', 'weapon7': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'weapon4': '0.158', 'weapon5': '0.168', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.540', 'weapon3': '0.990', 'weapon2': '1.208', 'DAMAGECOUNT': '3.114', 'FRAGCOUNT': '9.000'} [2023-02-24 18:24:23,699][177157] DAMAGECOUNT value on done: 104943.0 [2023-02-24 18:24:23,700][177157] Sum rewards: 9.332, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.064', 'AMMO2': '0.006', 'AMMO5': '0.021', 'AMMO4': '0.030', 'WEAPON1': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.100', 'AMMO3': '0.115', 'weapon5': '0.258', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'HITCOUNT': '0.870', 'weapon2': '0.922', 'weapon3': '2.198', 'DAMAGECOUNT': '3.246', 'FRAGCOUNT': '7.500'} [2023-02-24 18:24:23,711][177157] DAMAGECOUNT value on done: 100384.0 [2023-02-24 18:24:23,711][177157] Sum rewards: 8.372, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.185', 'AMMO5': '0.017', 'AMMO2': '0.020', 'WEAPON1': '0.050', 'weapon7': '0.068', 'AMMO4': '0.099', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.143', 'weapon5': '0.190', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.714', 'weapon2': '0.750', 'HITCOUNT': '0.780', 'WEAPON3': '0.850', 'weapon3': '1.782', 'DAMAGECOUNT': '3.204', 'FRAGCOUNT': '9.000'} [2023-02-24 18:24:23,738][177171] DAMAGECOUNT value on done: 99669.0 [2023-02-24 18:24:23,738][177171] Sum rewards: 15.625, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.880', 'ARMOR': '0.008', 'AMMO5': '0.021', 'WEAPON1': '0.040', 'AMMO2': '0.052', 'AMMO3': '0.092', 'AMMO4': '0.262', 'weapon5': '0.326', 'weapon4': '0.442', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'weapon2': '0.850', 'HITCOUNT': '1.130', 'weapon3': '1.764', 'DAMAGECOUNT': '4.917', 'FRAGCOUNT': '14.000'} [2023-02-24 18:24:23,950][177153] Updated weights for policy 0, policy_version 12600 (0.0008) [2023-02-24 18:24:24,009][177157] DAMAGECOUNT value on done: 101861.0 [2023-02-24 18:24:24,009][177157] Sum rewards: 16.205, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.473', 'AMMO5': '0.008', 'ARMOR': '0.016', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'AMMO4': '0.090', 'AMMO3': '0.114', 'WEAPON4': '0.150', 'weapon5': '0.192', 'WEAPON5': '0.200', 'weapon4': '0.232', 'weapon2': '0.608', 'WEAPON3': '0.800', 'HITCOUNT': '1.390', 'weapon3': '2.620', 'DAMAGECOUNT': '5.199', 'FRAGCOUNT': '13.500'} [2023-02-24 18:24:24,019][177157] DAMAGECOUNT value on done: 99891.0 [2023-02-24 18:24:24,020][177157] Sum rewards: 16.341, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.012', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.067', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.162', 'WEAPON5': '0.200', 'weapon5': '0.270', 'WEAPON3': '0.400', 'HITCOUNT': '0.650', 'ARMOR': '0.800', 'weapon3': '1.272', 'weapon2': '2.016', 'DAMAGECOUNT': '3.759', 'FRAGCOUNT': '10.000'} [2023-02-24 18:24:24,036][177171] DAMAGECOUNT value on done: 97374.0 [2023-02-24 18:24:24,036][177171] Sum rewards: 9.276, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.894', 'AMMO5': '0.011', 'AMMO2': '0.016', 'ARMOR': '0.016', 'WEAPON1': '0.050', 'weapon7': '0.058', 'AMMO4': '0.079', 'AMMO3': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.216', 'weapon4': '0.330', 'WEAPON5': '0.350', 'HITCOUNT': '0.670', 'WEAPON3': '0.700', 'weapon2': '1.008', 'weapon3': '1.932', 'DAMAGECOUNT': '2.937', 'FRAGCOUNT': '8.000'} [2023-02-24 18:24:24,585][177155] DAMAGECOUNT value on done: 102807.0 [2023-02-24 18:24:24,586][177155] Sum rewards: 12.714, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.575', 'AMMO5': '0.009', 'AMMO2': '0.015', 'AMMO3': '0.030', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.076', 'weapon7': '0.102', 'weapon5': '0.158', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.410', 'weapon4': '0.444', 'weapon3': '0.746', 'weapon2': '1.206', 'DAMAGECOUNT': '3.513', 'FRAGCOUNT': '7.000'} [2023-02-24 18:24:24,883][177155] DAMAGECOUNT value on done: 107518.0 [2023-02-24 18:24:24,884][177155] Sum rewards: 9.915, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.252', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.040', 'WEAPON1': '0.050', 'AMMO3': '0.142', 'weapon5': '0.168', 'AMMO4': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.670', 'WEAPON3': '0.900', 'HITCOUNT': '0.900', 'weapon2': '1.100', 'weapon3': '1.686', 'DAMAGECOUNT': '4.386', 'FRAGCOUNT': '10.000'} [2023-02-24 18:24:25,185][177155] DAMAGECOUNT value on done: 104404.0 [2023-02-24 18:24:25,186][177155] Sum rewards: 9.631, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.100', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'weapon4': '0.054', 'weapon5': '0.064', 'AMMO3': '0.095', 'weapon7': '0.118', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.600', 'HITCOUNT': '0.710', 'weapon3': '1.476', 'weapon2': '2.158', 'DAMAGECOUNT': '2.682', 'FRAGCOUNT': '7.000'} [2023-02-24 18:24:25,480][177155] DAMAGECOUNT value on done: 98152.0 [2023-02-24 18:24:25,481][177155] Sum rewards: 2.424, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.645', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON1': '0.060', 'weapon7': '0.062', 'AMMO4': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'WEAPON5': '0.200', 'weapon5': '0.214', 'weapon4': '0.284', 'HITCOUNT': '0.360', 'WEAPON3': '0.700', 'weapon2': '0.956', 'DAMAGECOUNT': '1.545', 'weapon3': '1.830', 'FRAGCOUNT': '3.000'} [2023-02-24 18:24:26,376][177119] Fps is (10 sec: 13927.1, 60 sec: 13994.7, 300 sec: 13981.9). Total num frames: 51642368. Throughput: 0: 3486.8. Samples: 12908150. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:24:26,376][177119] Avg episode reward: [(0, '9.384')] [2023-02-24 18:24:26,379][177140] Saving new best policy, reward=9.384! [2023-02-24 18:24:26,906][177153] Updated weights for policy 0, policy_version 12610 (0.0008) [2023-02-24 18:24:29,837][177153] Updated weights for policy 0, policy_version 12620 (0.0008) [2023-02-24 18:24:30,847][177156] DAMAGECOUNT value on done: 102096.0 [2023-02-24 18:24:30,847][177156] Sum rewards: 9.675, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.670', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'AMMO4': '0.087', 'AMMO3': '0.088', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.454', 'WEAPON3': '0.650', 'HITCOUNT': '0.700', 'ARMOR': '0.920', 'weapon2': '1.332', 'weapon3': '1.664', 'DAMAGECOUNT': '2.874', 'FRAGCOUNT': '7.000'} [2023-02-24 18:24:31,023][177156] DAMAGECOUNT value on done: 101959.0 [2023-02-24 18:24:31,024][177156] Sum rewards: 5.561, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.365', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON1': '0.050', 'weapon5': '0.070', 'AMMO3': '0.073', 'weapon7': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'HITCOUNT': '0.310', 'WEAPON3': '0.450', 'AMMO6': '0.520', 'AMMO7': '0.520', 'weapon4': '0.584', 'WEAPON7': '0.600', 'weapon3': '1.122', 'weapon2': '1.162', 'DAMAGECOUNT': '1.851', 'FRAGCOUNT': '5.000'} [2023-02-24 18:24:31,163][177156] DAMAGECOUNT value on done: 102959.0 [2023-02-24 18:24:31,163][177156] Sum rewards: 14.818, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.368', 'AMMO2': '0.005', 'AMMO4': '0.024', 'AMMO5': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'weapon5': '0.350', 'weapon4': '0.386', 'WEAPON5': '0.450', 'ARMOR': '0.467', 'weapon2': '0.812', 'WEAPON3': '0.850', 'HITCOUNT': '1.060', 'weapon3': '2.152', 'DAMAGECOUNT': '4.548', 'FRAGCOUNT': '12.000'} [2023-02-24 18:24:31,339][177156] DAMAGECOUNT value on done: 101121.0 [2023-02-24 18:24:31,340][177156] Sum rewards: 8.868, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.304', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'weapon7': '0.050', 'AMMO4': '0.075', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.228', 'weapon4': '0.346', 'WEAPON3': '0.800', 'weapon2': '0.970', 'HITCOUNT': '0.980', 'weapon3': '2.026', 'DAMAGECOUNT': '3.426', 'FRAGCOUNT': '8.000'} [2023-02-24 18:24:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13981.9). Total num frames: 51712000. Throughput: 0: 3485.5. Samples: 12928942. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:24:31,376][177119] Avg episode reward: [(0, '9.477')] [2023-02-24 18:24:31,377][177140] Saving new best policy, reward=9.477! [2023-02-24 18:24:32,761][177153] Updated weights for policy 0, policy_version 12630 (0.0008) [2023-02-24 18:24:33,880][177172] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:24:35,693][177153] Updated weights for policy 0, policy_version 12640 (0.0008) [2023-02-24 18:24:36,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13981.9). Total num frames: 51781632. Throughput: 0: 3482.8. Samples: 12939392. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:24:36,376][177119] Avg episode reward: [(0, '9.477')] [2023-02-24 18:24:37,022][177170] DAMAGECOUNT value on done: 102749.0 [2023-02-24 18:24:37,023][177170] Sum rewards: 8.142, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.815', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.062', 'weapon5': '0.072', 'WEAPON5': '0.100', 'weapon7': '0.114', 'AMMO4': '0.114', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'HITCOUNT': '0.630', 'weapon4': '0.838', 'weapon2': '0.866', 'weapon3': '1.148', 'DAMAGECOUNT': '2.037', 'FRAGCOUNT': '7.000'} [2023-02-24 18:24:37,319][177170] DAMAGECOUNT value on done: 95994.0 [2023-02-24 18:24:37,320][177170] Sum rewards: 12.208, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.290', 'AMMO5': '0.015', 'AMMO2': '0.038', 'WEAPON1': '0.080', 'weapon7': '0.104', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'AMMO4': '0.188', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon5': '0.284', 'weapon4': '0.306', 'WEAPON5': '0.400', 'WEAPON7': '0.400', 'weapon2': '0.698', 'HITCOUNT': '0.920', 'WEAPON3': '0.950', 'weapon3': '2.100', 'DAMAGECOUNT': '4.992', 'FRAGCOUNT': '11.000'} [2023-02-24 18:24:37,338][177170] DAMAGECOUNT value on done: 106578.0 [2023-02-24 18:24:37,338][177170] Sum rewards: 20.275, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.495', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'weapon5': '0.048', 'AMMO4': '0.055', 'weapon4': '0.068', 'AMMO3': '0.084', 'weapon7': '0.094', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'ARMOR': '0.456', 'WEAPON3': '0.650', 'HITCOUNT': '1.010', 'weapon3': '1.530', 'weapon2': '2.050', 'DAMAGECOUNT': '5.406', 'FRAGCOUNT': '15.000'} [2023-02-24 18:24:37,635][177170] DAMAGECOUNT value on done: 104903.0 [2023-02-24 18:24:37,635][177170] Sum rewards: 3.054, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.995', 'AMMO5': '0.015', 'AMMO2': '0.022', 'WEAPON1': '0.060', 'weapon7': '0.096', 'AMMO4': '0.112', 'AMMO3': '0.129', 'WEAPON4': '0.200', 'weapon5': '0.244', 'AMMO6': '0.280', 'AMMO7': '0.280', 'weapon4': '0.336', 'WEAPON7': '0.400', 'WEAPON5': '0.500', 'HITCOUNT': '0.620', 'WEAPON3': '1.000', 'weapon2': '1.100', 'weapon3': '1.788', 'DAMAGECOUNT': '2.367', 'FRAGCOUNT': '4.000'} [2023-02-24 18:24:38,541][177158] DAMAGECOUNT value on done: 100795.0 [2023-02-24 18:24:38,541][177158] Sum rewards: 9.482, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.012', 'AMMO2': '0.029', 'WEAPON1': '0.050', 'AMMO3': '0.071', 'AMMO4': '0.144', 'WEAPON4': '0.150', 'HEALTH': '0.180', 'weapon5': '0.210', 'weapon4': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'weapon2': '1.508', 'weapon3': '1.624', 'DAMAGECOUNT': '2.973', 'FRAGCOUNT': '8.000'} [2023-02-24 18:24:38,674][177153] Updated weights for policy 0, policy_version 12650 (0.0009) [2023-02-24 18:24:38,839][177158] DAMAGECOUNT value on done: 98586.0 [2023-02-24 18:24:38,840][177158] Sum rewards: 3.292, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.929', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'ARMOR': '0.036', 'weapon5': '0.062', 'AMMO3': '0.085', 'AMMO4': '0.098', 'weapon7': '0.104', 'WEAPON5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.570', 'weapon4': '0.638', 'WEAPON3': '0.650', 'weapon2': '0.872', 'weapon3': '1.634', 'DAMAGECOUNT': '1.974', 'FRAGCOUNT': '3.000'} [2023-02-24 18:24:39,446][177158] DAMAGECOUNT value on done: 100712.0 [2023-02-24 18:24:39,446][177158] Sum rewards: 5.856, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.920', 'AMMO2': '0.006', 'AMMO5': '0.022', 'AMMO4': '0.031', 'weapon7': '0.062', 'WEAPON1': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'weapon5': '0.168', 'WEAPON7': '0.200', 'weapon4': '0.238', 'WEAPON5': '0.500', 'HITCOUNT': '0.610', 'WEAPON3': '0.950', 'weapon3': '1.490', 'weapon2': '1.800', 'DAMAGECOUNT': '2.076', 'FRAGCOUNT': '8.000'} [2023-02-24 18:24:39,741][177158] DAMAGECOUNT value on done: 104942.0 [2023-02-24 18:24:39,741][177158] Sum rewards: 12.026, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.114', 'AMMO2': '0.013', 'AMMO5': '0.015', 'WEAPON1': '0.050', 'weapon7': '0.060', 'AMMO4': '0.063', 'AMMO3': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.292', 'WEAPON5': '0.450', 'ARMOR': '0.453', 'WEAPON3': '0.550', 'weapon2': '0.606', 'weapon4': '0.606', 'HITCOUNT': '0.720', 'weapon3': '1.320', 'DAMAGECOUNT': '3.474', 'FRAGCOUNT': '9.000'} [2023-02-24 18:24:40,605][177172] DAMAGECOUNT value on done: 102991.0 [2023-02-24 18:24:40,606][177172] Sum rewards: 5.934, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.836', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.024', 'WEAPON1': '0.050', 'weapon5': '0.102', 'AMMO3': '0.115', 'weapon7': '0.116', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.470', 'HITCOUNT': '0.490', 'WEAPON3': '0.700', 'weapon2': '0.758', 'weapon3': '1.118', 'DAMAGECOUNT': '2.139', 'FRAGCOUNT': '7.000'} [2023-02-24 18:24:40,899][177172] DAMAGECOUNT value on done: 102478.0 [2023-02-24 18:24:40,900][177172] Sum rewards: 11.445, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.012', 'AMMO5': '0.016', 'weapon4': '0.032', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.061', 'WEAPON1': '0.070', 'HEALTH': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.104', 'weapon5': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.740', 'weapon2': '1.430', 'weapon3': '1.752', 'DAMAGECOUNT': '3.093', 'FRAGCOUNT': '9.000'} [2023-02-24 18:24:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13981.9). Total num frames: 51851264. Throughput: 0: 3484.2. Samples: 12960348. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:24:41,376][177119] Avg episode reward: [(0, '9.472')] [2023-02-24 18:24:41,595][177153] Updated weights for policy 0, policy_version 12660 (0.0008) [2023-02-24 18:24:41,602][177154] DAMAGECOUNT value on done: 106750.0 [2023-02-24 18:24:41,603][177154] Sum rewards: 14.156, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.362', 'AMMO5': '0.027', 'AMMO2': '0.033', 'WEAPON1': '0.060', 'AMMO3': '0.109', 'weapon4': '0.124', 'weapon5': '0.128', 'weapon7': '0.142', 'AMMO4': '0.163', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.300', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'HITCOUNT': '0.900', 'weapon2': '1.298', 'weapon3': '1.924', 'DAMAGECOUNT': '5.070', 'FRAGCOUNT': '13.000'} [2023-02-24 18:24:41,902][177154] DAMAGECOUNT value on done: 105809.0 [2023-02-24 18:24:41,903][177154] Sum rewards: 8.790, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.510', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'AMMO4': '0.053', 'weapon5': '0.098', 'weapon7': '0.102', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'HITCOUNT': '0.500', 'weapon4': '0.530', 'weapon3': '1.186', 'weapon2': '1.628', 'DAMAGECOUNT': '2.079', 'FRAGCOUNT': '5.000'} [2023-02-24 18:24:41,914][177154] DAMAGECOUNT value on done: 104706.0 [2023-02-24 18:24:41,915][177154] Sum rewards: 11.745, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.034', 'AMMO2': '0.016', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'AMMO4': '0.078', 'AMMO3': '0.094', 'weapon5': '0.282', 'WEAPON4': '0.300', 'weapon4': '0.440', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'HITCOUNT': '1.050', 'weapon2': '1.374', 'weapon3': '1.412', 'DAMAGECOUNT': '4.272', 'FRAGCOUNT': '10.500'} [2023-02-24 18:24:42,068][177172] DAMAGECOUNT value on done: 104256.0 [2023-02-24 18:24:42,069][177172] Sum rewards: 9.449, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.256', 'AMMO5': '0.011', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'weapon7': '0.050', 'AMMO3': '0.088', 'weapon5': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.133', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'weapon4': '0.504', 'WEAPON3': '0.600', 'HITCOUNT': '0.780', 'weapon3': '1.378', 'weapon2': '1.526', 'DAMAGECOUNT': '3.489', 'FRAGCOUNT': '8.000'} [2023-02-24 18:24:42,210][177154] DAMAGECOUNT value on done: 109051.0 [2023-02-24 18:24:42,211][177154] Sum rewards: 6.436, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'AMMO3': '0.040', 'AMMO4': '0.063', 'HEALTH': '0.099', 'weapon7': '0.104', 'WEAPON5': '0.150', 'weapon5': '0.158', 'WEAPON4': '0.200', 'WEAPON3': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.330', 'weapon2': '0.530', 'weapon4': '0.638', 'weapon3': '0.834', 'DAMAGECOUNT': '1.290', 'FRAGCOUNT': '4.000'} [2023-02-24 18:24:42,367][177172] DAMAGECOUNT value on done: 101764.0 [2023-02-24 18:24:42,367][177172] Sum rewards: 8.228, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.376', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'weapon5': '0.046', 'AMMO3': '0.077', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'weapon7': '0.110', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'WEAPON7': '0.400', 'HITCOUNT': '0.550', 'WEAPON3': '0.600', 'weapon2': '0.626', 'weapon4': '0.662', 'weapon3': '1.406', 'DAMAGECOUNT': '2.082', 'FRAGCOUNT': '8.000'} [2023-02-24 18:24:42,515][177171] DAMAGECOUNT value on done: 106283.0 [2023-02-24 18:24:42,516][177171] Sum rewards: 15.231, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.066', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.085', 'weapon5': '0.102', 'weapon7': '0.120', 'AMMO4': '0.150', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'AMMO6': '0.420', 'AMMO7': '0.420', 'weapon4': '0.496', 'WEAPON7': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '1.070', 'weapon2': '1.132', 'weapon3': '1.490', 'DAMAGECOUNT': '4.731', 'FRAGCOUNT': '11.000'} [2023-02-24 18:24:42,810][177171] DAMAGECOUNT value on done: 104225.0 [2023-02-24 18:24:42,811][177171] Sum rewards: 10.423, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.322', 'AMMO5': '0.023', 'AMMO2': '0.025', 'weapon7': '0.060', 'WEAPON1': '0.070', 'AMMO3': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.123', 'weapon5': '0.188', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.266', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon2': '0.828', 'HITCOUNT': '0.920', 'weapon3': '2.222', 'DAMAGECOUNT': '3.765', 'FRAGCOUNT': '8.500'} [2023-02-24 18:24:42,902][177157] DAMAGECOUNT value on done: 105804.0 [2023-02-24 18:24:42,903][177157] Sum rewards: 6.824, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.120', 'AMMO2': '0.009', 'AMMO5': '0.027', 'ARMOR': '0.032', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'weapon4': '0.088', 'WEAPON1': '0.090', 'AMMO3': '0.115', 'weapon5': '0.200', 'WEAPON5': '0.550', 'HITCOUNT': '0.690', 'WEAPON3': '0.900', 'weapon2': '1.294', 'weapon3': '2.022', 'DAMAGECOUNT': '2.583', 'FRAGCOUNT': '7.000'} [2023-02-24 18:24:42,913][177157] DAMAGECOUNT value on done: 101021.0 [2023-02-24 18:24:42,913][177157] Sum rewards: 6.152, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.040', 'ARMOR': '0.088', 'weapon7': '0.118', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'HEALTH': '0.171', 'weapon5': '0.180', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.250', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.330', 'weapon2': '0.540', 'weapon4': '0.936', 'weapon3': '0.964', 'DAMAGECOUNT': '1.911', 'FRAGCOUNT': '3.000'} [2023-02-24 18:24:42,977][177171] DAMAGECOUNT value on done: 100467.0 [2023-02-24 18:24:42,977][177171] Sum rewards: 7.922, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.809', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.030', 'WEAPON1': '0.050', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'weapon4': '0.200', 'weapon5': '0.216', 'WEAPON5': '0.250', 'ARMOR': '0.508', 'HITCOUNT': '0.620', 'WEAPON3': '0.650', 'weapon2': '1.266', 'weapon3': '1.596', 'DAMAGECOUNT': '2.394', 'FRAGCOUNT': '6.000'} [2023-02-24 18:24:43,201][177157] DAMAGECOUNT value on done: 102864.0 [2023-02-24 18:24:43,201][177157] Sum rewards: 8.799, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.712', 'AMMO5': '0.007', 'AMMO2': '0.033', 'WEAPON1': '0.040', 'weapon5': '0.084', 'AMMO3': '0.119', 'weapon7': '0.138', 'AMMO4': '0.167', 'WEAPON5': '0.200', 'WEAPON4': '0.450', 'AMMO6': '0.580', 'AMMO7': '0.580', 'HITCOUNT': '0.620', 'WEAPON3': '0.700', 'WEAPON7': '0.700', 'weapon2': '0.744', 'weapon4': '0.810', 'weapon3': '1.528', 'DAMAGECOUNT': '3.009', 'FRAGCOUNT': '10.500'} [2023-02-24 18:24:43,212][177157] DAMAGECOUNT value on done: 100137.0 [2023-02-24 18:24:43,212][177157] Sum rewards: 0.785, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.872', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO3': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.152', 'HITCOUNT': '0.180', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.304', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.738', 'weapon3': '0.886', 'weapon2': '1.082', 'FRAGCOUNT': '2.000'} [2023-02-24 18:24:43,273][177171] DAMAGECOUNT value on done: 97543.0 [2023-02-24 18:24:43,274][177171] Sum rewards: 4.993, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.065', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO3': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'weapon5': '0.060', 'HITCOUNT': '0.120', 'weapon7': '0.146', 'WEAPON3': '0.150', 'WEAPON4': '0.150', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON7': '0.500', 'weapon3': '0.500', 'DAMAGECOUNT': '0.507', 'weapon4': '0.608', 'weapon2': '0.734', 'FRAGCOUNT': '3.000'} [2023-02-24 18:24:43,850][177155] DAMAGECOUNT value on done: 103587.0 [2023-02-24 18:24:43,851][177155] Sum rewards: 12.790, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.766', 'AMMO2': '0.010', 'AMMO5': '0.012', 'weapon4': '0.030', 'WEAPON1': '0.040', 'AMMO4': '0.048', 'weapon7': '0.050', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon5': '0.174', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON5': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.640', 'ARMOR': '0.980', 'weapon3': '1.320', 'weapon2': '2.202', 'DAMAGECOUNT': '2.340', 'FRAGCOUNT': '9.000'} [2023-02-24 18:24:44,144][177155] DAMAGECOUNT value on done: 108788.0 [2023-02-24 18:24:44,144][177155] Sum rewards: 12.168, reward structure: {'DEATHCOUNT': '-6.750', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon7': '0.078', 'AMMO3': '0.081', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'weapon5': '0.230', 'HEALTH': '0.240', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'weapon4': '0.532', 'HITCOUNT': '0.740', 'weapon3': '1.086', 'weapon2': '1.656', 'DAMAGECOUNT': '3.810', 'FRAGCOUNT': '9.000'} [2023-02-24 18:24:44,450][177155] DAMAGECOUNT value on done: 105406.0 [2023-02-24 18:24:44,451][177155] Sum rewards: 8.615, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.752', 'ARMOR': '0.004', 'AMMO2': '0.004', 'AMMO5': '0.018', 'AMMO4': '0.021', 'WEAPON1': '0.030', 'AMMO3': '0.109', 'weapon5': '0.216', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'HITCOUNT': '0.740', 'WEAPON3': '0.750', 'weapon4': '0.766', 'weapon2': '0.894', 'weapon3': '1.508', 'DAMAGECOUNT': '3.006', 'FRAGCOUNT': '9.000'} [2023-02-24 18:24:44,509][177153] Updated weights for policy 0, policy_version 12670 (0.0008) [2023-02-24 18:24:44,746][177155] DAMAGECOUNT value on done: 99525.0 [2023-02-24 18:24:44,747][177155] Sum rewards: 12.953, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.843', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.036', 'WEAPON1': '0.060', 'AMMO3': '0.119', 'AMMO4': '0.178', 'weapon5': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.370', 'WEAPON3': '0.750', 'HITCOUNT': '0.820', 'weapon2': '1.016', 'weapon3': '1.774', 'DAMAGECOUNT': '4.119', 'FRAGCOUNT': '12.000'} [2023-02-24 18:24:45,330][177158] Large shaping reward 2.569 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.537, 179.0), ('weapon7', 0.002)] [2023-02-24 18:24:46,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13981.9). Total num frames: 51920896. Throughput: 0: 3487.2. Samples: 12981354. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:24:46,376][177119] Avg episode reward: [(0, '9.519')] [2023-02-24 18:24:46,380][177140] Saving new best policy, reward=9.519! [2023-02-24 18:24:47,429][177153] Updated weights for policy 0, policy_version 12680 (0.0008) [2023-02-24 18:24:50,173][177156] DAMAGECOUNT value on done: 102924.0 [2023-02-24 18:24:50,173][177156] Sum rewards: 10.381, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.420', 'AMMO5': '0.008', 'AMMO2': '0.010', 'WEAPON1': '0.040', 'AMMO4': '0.051', 'AMMO3': '0.065', 'weapon7': '0.106', 'weapon5': '0.114', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.500', 'weapon3': '1.398', 'weapon2': '2.134', 'DAMAGECOUNT': '2.484', 'FRAGCOUNT': '7.000'} [2023-02-24 18:24:50,343][177153] Updated weights for policy 0, policy_version 12690 (0.0009) [2023-02-24 18:24:50,349][177156] DAMAGECOUNT value on done: 102559.0 [2023-02-24 18:24:50,349][177156] Sum rewards: 9.131, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.770', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.019', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.114', 'weapon5': '0.136', 'WEAPON5': '0.200', 'ARMOR': '0.470', 'HITCOUNT': '0.480', 'WEAPON3': '0.700', 'weapon3': '1.506', 'DAMAGECOUNT': '1.800', 'weapon2': '2.074', 'FRAGCOUNT': '8.000'} [2023-02-24 18:24:50,481][177156] DAMAGECOUNT value on done: 104180.0 [2023-02-24 18:24:50,482][177156] Sum rewards: 15.562, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon7': '0.058', 'AMMO3': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'weapon5': '0.152', 'WEAPON4': '0.200', 'HEALTH': '0.244', 'WEAPON3': '0.550', 'weapon4': '0.644', 'HITCOUNT': '1.060', 'weapon2': '1.114', 'weapon3': '1.466', 'DAMAGECOUNT': '3.663', 'FRAGCOUNT': '11.000'} [2023-02-24 18:24:50,653][177156] DAMAGECOUNT value on done: 102595.0 [2023-02-24 18:24:50,654][177156] Sum rewards: 15.459, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.987', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.110', 'AMMO3': '0.129', 'AMMO4': '0.161', 'WEAPON4': '0.350', 'weapon4': '0.360', 'WEAPON5': '0.400', 'weapon2': '0.636', 'WEAPON3': '0.800', 'HITCOUNT': '0.960', 'weapon3': '2.454', 'DAMAGECOUNT': '4.422', 'FRAGCOUNT': '13.500'} [2023-02-24 18:24:51,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13981.9). Total num frames: 51990528. Throughput: 0: 3488.0. Samples: 12991810. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:24:51,376][177119] Avg episode reward: [(0, '9.751')] [2023-02-24 18:24:51,377][177140] Saving new best policy, reward=9.751! [2023-02-24 18:24:53,312][177153] Updated weights for policy 0, policy_version 12700 (0.0008) [2023-02-24 18:24:56,237][177153] Updated weights for policy 0, policy_version 12710 (0.0008) [2023-02-24 18:24:56,306][177170] DAMAGECOUNT value on done: 103370.0 [2023-02-24 18:24:56,306][177170] Sum rewards: 7.494, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.420', 'AMMO2': '0.010', 'AMMO5': '0.011', 'AMMO4': '0.048', 'WEAPON1': '0.050', 'AMMO3': '0.052', 'weapon7': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.224', 'WEAPON5': '0.300', 'weapon4': '0.378', 'WEAPON3': '0.400', 'HITCOUNT': '0.410', 'weapon2': '0.668', 'weapon3': '1.272', 'DAMAGECOUNT': '1.863', 'FRAGCOUNT': '6.000'} [2023-02-24 18:24:56,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 52060160. Throughput: 0: 3483.2. Samples: 13012656. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:24:56,376][177119] Avg episode reward: [(0, '9.709')] [2023-02-24 18:24:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000012710_52060160.pth... [2023-02-24 18:24:56,437][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000011892_48709632.pth [2023-02-24 18:24:56,624][177170] DAMAGECOUNT value on done: 108140.0 [2023-02-24 18:24:56,624][177170] Sum rewards: 13.371, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.610', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon7': '0.030', 'AMMO4': '0.089', 'AMMO3': '0.115', 'weapon5': '0.210', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'AMMO6': '0.360', 'AMMO7': '0.360', 'WEAPON7': '0.400', 'weapon4': '0.428', 'weapon2': '0.768', 'WEAPON3': '0.800', 'HITCOUNT': '0.980', 'weapon3': '2.000', 'DAMAGECOUNT': '4.686', 'FRAGCOUNT': '12.000'} [2023-02-24 18:24:56,637][177170] DAMAGECOUNT value on done: 96982.0 [2023-02-24 18:24:56,637][177170] Sum rewards: 6.173, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'HEALTH': '0.052', 'AMMO4': '0.090', 'weapon5': '0.092', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'weapon7': '0.100', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.552', 'WEAPON3': '0.600', 'HITCOUNT': '0.650', 'weapon2': '1.176', 'weapon3': '1.440', 'DAMAGECOUNT': '2.964', 'FRAGCOUNT': '4.000'} [2023-02-24 18:24:56,936][177170] DAMAGECOUNT value on done: 106453.0 [2023-02-24 18:24:56,936][177170] Sum rewards: 14.469, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.574', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon5': '0.040', 'AMMO4': '0.075', 'AMMO3': '0.127', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.496', 'weapon2': '0.692', 'WEAPON3': '0.900', 'ARMOR': '0.901', 'HITCOUNT': '1.310', 'weapon3': '2.020', 'DAMAGECOUNT': '4.650', 'FRAGCOUNT': '12.000'} [2023-02-24 18:24:57,822][177158] DAMAGECOUNT value on done: 102039.0 [2023-02-24 18:24:57,823][177158] Sum rewards: 17.697, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.145', 'ARMOR': '0.008', 'AMMO2': '0.011', 'AMMO5': '0.013', 'WEAPON1': '0.030', 'AMMO4': '0.053', 'weapon7': '0.108', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.246', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.388', 'WEAPON3': '0.650', 'HITCOUNT': '0.960', 'weapon2': '1.188', 'weapon3': '1.656', 'DAMAGECOUNT': '3.732', 'FRAGCOUNT': '15.000'} [2023-02-24 18:24:58,123][177158] DAMAGECOUNT value on done: 99708.0 [2023-02-24 18:24:58,124][177158] Sum rewards: 8.731, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.358', 'AMMO2': '0.008', 'AMMO5': '0.025', 'WEAPON1': '0.030', 'AMMO4': '0.041', 'AMMO3': '0.068', 'weapon7': '0.100', 'WEAPON4': '0.200', 'weapon5': '0.222', 'AMMO6': '0.240', 'AMMO7': '0.240', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.500', 'WEAPON5': '0.550', 'weapon4': '0.634', 'HITCOUNT': '0.660', 'weapon2': '1.094', 'weapon3': '1.310', 'DAMAGECOUNT': '3.366', 'FRAGCOUNT': '6.000'} [2023-02-24 18:24:58,719][177158] DAMAGECOUNT value on done: 102338.0 [2023-02-24 18:24:58,719][177158] Sum rewards: 17.264, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.055', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO3': '0.111', 'weapon7': '0.136', 'weapon5': '0.170', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'ARMOR': '0.487', 'WEAPON3': '0.800', 'HITCOUNT': '1.100', 'weapon2': '1.386', 'weapon3': '2.006', 'DAMAGECOUNT': '4.878', 'FRAGCOUNT': '13.000'} [2023-02-24 18:24:59,014][177158] DAMAGECOUNT value on done: 106221.0 [2023-02-24 18:24:59,014][177158] Sum rewards: 6.208, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.930', 'AMMO5': '0.004', 'WEAPON1': '0.020', 'weapon5': '0.028', 'AMMO2': '0.030', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'AMMO3': '0.156', 'WEAPON4': '0.250', 'ARMOR': '0.404', 'weapon4': '0.450', 'HITCOUNT': '0.900', 'weapon2': '0.974', 'WEAPON3': '1.000', 'weapon3': '1.984', 'DAMAGECOUNT': '3.837', 'FRAGCOUNT': '7.000'} [2023-02-24 18:24:59,189][177153] Updated weights for policy 0, policy_version 12720 (0.0008) [2023-02-24 18:24:59,813][177171] Large shaping reward -2.675 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', 0.05, 10.0), ('AMMO2', -0.0033, -33.0), ('WEAPON3', -0.05, -1.0), ('AMMO3', -0.003, -6.0), ('WEAPON4', -0.05, -1.0), ('AMMO4', -0.0165, -33.0), ('WEAPON5', -0.05, -1.0), ('AMMO5', -0.0025, -5.0), ('AMMO6', -0.1, -100.0), ('WEAPON7', -0.1, -1.0), ('AMMO7', -0.1, -100.0)] [2023-02-24 18:24:59,891][177172] DAMAGECOUNT value on done: 103675.0 [2023-02-24 18:24:59,892][177172] Sum rewards: 4.818, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.038', 'AMMO2': '0.013', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.064', 'AMMO3': '0.084', 'weapon7': '0.128', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'weapon5': '0.322', 'WEAPON5': '0.400', 'WEAPON7': '0.400', 'weapon4': '0.408', 'HITCOUNT': '0.430', 'ARMOR': '0.462', 'WEAPON3': '0.550', 'weapon2': '1.216', 'weapon3': '1.252', 'DAMAGECOUNT': '2.052', 'FRAGCOUNT': '4.000'} [2023-02-24 18:25:00,198][177172] DAMAGECOUNT value on done: 103007.0 [2023-02-24 18:25:00,198][177172] Sum rewards: 6.843, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.550', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO3': '0.047', 'weapon7': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.158', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'HITCOUNT': '0.400', 'weapon4': '0.494', 'weapon2': '0.732', 'weapon3': '0.884', 'DAMAGECOUNT': '1.587', 'FRAGCOUNT': '4.000'} [2023-02-24 18:25:00,947][177154] DAMAGECOUNT value on done: 108074.0 [2023-02-24 18:25:00,947][177154] Sum rewards: 13.921, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.038', 'AMMO2': '0.008', 'AMMO5': '0.021', 'AMMO4': '0.040', 'WEAPON1': '0.040', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'weapon4': '0.120', 'weapon5': '0.338', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.570', 'weapon2': '1.330', 'weapon3': '1.934', 'DAMAGECOUNT': '3.972', 'FRAGCOUNT': '12.000'} [2023-02-24 18:25:01,250][177154] DAMAGECOUNT value on done: 107132.0 [2023-02-24 18:25:01,251][177154] Sum rewards: 12.747, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.505', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'weapon5': '0.062', 'AMMO3': '0.095', 'weapon7': '0.116', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.528', 'WEAPON3': '0.550', 'HITCOUNT': '1.030', 'weapon2': '1.212', 'weapon3': '1.742', 'DAMAGECOUNT': '3.969', 'FRAGCOUNT': '11.000'} [2023-02-24 18:25:01,263][177154] DAMAGECOUNT value on done: 106466.0 [2023-02-24 18:25:01,263][177154] Sum rewards: 18.186, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.354', 'AMMO5': '0.012', 'AMMO2': '0.016', 'weapon7': '0.030', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.114', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'weapon4': '0.254', 'weapon5': '0.270', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '1.090', 'weapon2': '1.424', 'weapon3': '1.672', 'DAMAGECOUNT': '5.280', 'FRAGCOUNT': '14.000'} [2023-02-24 18:25:01,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 52129792. Throughput: 0: 3481.9. Samples: 13033500. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:25:01,376][177119] Avg episode reward: [(0, '10.006')] [2023-02-24 18:25:01,377][177140] Saving new best policy, reward=10.006! [2023-02-24 18:25:01,388][177172] DAMAGECOUNT value on done: 105959.0 [2023-02-24 18:25:01,389][177172] Sum rewards: 18.287, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.270', 'AMMO5': '0.012', 'AMMO2': '0.014', 'WEAPON1': '0.040', 'AMMO4': '0.072', 'AMMO3': '0.084', 'weapon7': '0.174', 'weapon5': '0.268', 'WEAPON4': '0.300', 'AMMO6': '0.340', 'AMMO7': '0.340', 'weapon4': '0.358', 'WEAPON5': '0.400', 'WEAPON7': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.900', 'weapon2': '0.986', 'weapon3': '1.310', 'DAMAGECOUNT': '5.109', 'FRAGCOUNT': '13.000'} [2023-02-24 18:25:01,574][177154] DAMAGECOUNT value on done: 110204.0 [2023-02-24 18:25:01,574][177154] Sum rewards: 9.326, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.666', 'AMMO5': '0.015', 'AMMO2': '0.027', 'WEAPON1': '0.050', 'weapon7': '0.070', 'AMMO3': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.134', 'weapon5': '0.178', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.550', 'WEAPON3': '0.650', 'weapon4': '0.652', 'weapon2': '0.688', 'weapon3': '1.474', 'DAMAGECOUNT': '3.459', 'FRAGCOUNT': '8.000'} [2023-02-24 18:25:01,695][177172] DAMAGECOUNT value on done: 103628.0 [2023-02-24 18:25:01,696][177172] Sum rewards: 17.620, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.076', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.033', 'weapon7': '0.050', 'AMMO3': '0.107', 'AMMO4': '0.163', 'weapon4': '0.174', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.266', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.860', 'weapon2': '1.548', 'weapon3': '1.638', 'DAMAGECOUNT': '5.424', 'FRAGCOUNT': '16.000'} [2023-02-24 18:25:01,850][177171] DAMAGECOUNT value on done: 107591.0 [2023-02-24 18:25:01,851][177171] Sum rewards: 10.723, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.012', 'WEAPON1': '0.060', 'weapon7': '0.062', 'AMMO3': '0.110', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HEALTH': '0.177', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.650', 'HITCOUNT': '0.780', 'weapon2': '1.426', 'weapon3': '1.966', 'DAMAGECOUNT': '3.924', 'FRAGCOUNT': '9.000'} [2023-02-24 18:25:02,146][177153] Updated weights for policy 0, policy_version 12730 (0.0009) [2023-02-24 18:25:02,154][177171] DAMAGECOUNT value on done: 105043.0 [2023-02-24 18:25:02,154][177171] Sum rewards: 5.137, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.020', 'AMMO2': '0.024', 'WEAPON1': '0.060', 'weapon7': '0.080', 'AMMO3': '0.085', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HEALTH': '0.253', 'weapon5': '0.294', 'WEAPON7': '0.300', 'weapon4': '0.360', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'HITCOUNT': '0.670', 'weapon2': '1.338', 'weapon3': '1.490', 'DAMAGECOUNT': '2.454', 'FRAGCOUNT': '3.500'} [2023-02-24 18:25:02,177][177157] DAMAGECOUNT value on done: 101983.0 [2023-02-24 18:25:02,177][177157] Sum rewards: 5.482, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.598', 'AMMO5': '0.019', 'AMMO2': '0.032', 'WEAPON1': '0.050', 'weapon7': '0.074', 'AMMO3': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.292', 'weapon5': '0.296', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'HITCOUNT': '0.490', 'WEAPON3': '0.550', 'weapon3': '1.304', 'weapon2': '1.656', 'DAMAGECOUNT': '2.886', 'FRAGCOUNT': '7.000'} [2023-02-24 18:25:02,240][177157] DAMAGECOUNT value on done: 106604.0 [2023-02-24 18:25:02,241][177157] Sum rewards: 5.220, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.065', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.005', 'AMMO4': '0.027', 'weapon5': '0.046', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'weapon7': '0.202', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'AMMO6': '0.560', 'AMMO7': '0.560', 'weapon4': '0.596', 'HITCOUNT': '0.660', 'WEAPON7': '0.800', 'weapon3': '1.184', 'weapon2': '1.778', 'DAMAGECOUNT': '2.400', 'FRAGCOUNT': '5.000'} [2023-02-24 18:25:02,319][177171] DAMAGECOUNT value on done: 101395.0 [2023-02-24 18:25:02,320][177171] Sum rewards: 5.384, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.962', 'AMMO5': '0.020', 'AMMO2': '0.024', 'WEAPON1': '0.070', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.119', 'weapon5': '0.284', 'weapon4': '0.350', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.680', 'WEAPON3': '0.700', 'weapon2': '1.084', 'weapon3': '1.772', 'DAMAGECOUNT': '2.784', 'FRAGCOUNT': '8.000'} [2023-02-24 18:25:02,487][177157] DAMAGECOUNT value on done: 101342.0 [2023-02-24 18:25:02,487][177157] Sum rewards: 14.647, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.804', 'AMMO2': '0.018', 'AMMO5': '0.032', 'WEAPON1': '0.040', 'weapon7': '0.066', 'AMMO4': '0.091', 'AMMO3': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.170', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.270', 'ARMOR': '0.400', 'HITCOUNT': '0.570', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'weapon2': '0.966', 'weapon3': '1.918', 'DAMAGECOUNT': '3.615', 'FRAGCOUNT': '12.000'} [2023-02-24 18:25:02,549][177157] DAMAGECOUNT value on done: 104139.0 [2023-02-24 18:25:02,550][177157] Sum rewards: 14.353, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.730', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.073', 'AMMO4': '0.082', 'weapon5': '0.100', 'weapon7': '0.128', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.244', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.690', 'weapon2': '1.614', 'weapon3': '1.680', 'DAMAGECOUNT': '3.825', 'FRAGCOUNT': '11.000'} [2023-02-24 18:25:02,620][177171] DAMAGECOUNT value on done: 98373.0 [2023-02-24 18:25:02,620][177171] Sum rewards: 3.051, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.587', 'AMMO2': '0.017', 'ARMOR': '0.020', 'AMMO5': '0.022', 'WEAPON1': '0.070', 'AMMO4': '0.083', 'AMMO3': '0.116', 'weapon7': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.194', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.260', 'WEAPON7': '0.300', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'HITCOUNT': '0.820', 'weapon2': '1.094', 'weapon3': '1.832', 'DAMAGECOUNT': '2.490', 'FRAGCOUNT': '3.500'} [2023-02-24 18:25:03,179][177155] DAMAGECOUNT value on done: 104444.0 [2023-02-24 18:25:03,180][177155] Sum rewards: 5.268, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.060', 'AMMO5': '0.012', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.103', 'weapon5': '0.146', 'weapon7': '0.210', 'WEAPON5': '0.300', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'weapon4': '0.378', 'HITCOUNT': '0.450', 'WEAPON3': '0.750', 'weapon2': '1.182', 'weapon3': '1.674', 'DAMAGECOUNT': '2.571', 'FRAGCOUNT': '3.500'} [2023-02-24 18:25:03,474][177155] DAMAGECOUNT value on done: 109560.0 [2023-02-24 18:25:03,474][177155] Sum rewards: 11.538, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.625', 'AMMO5': '0.010', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'AMMO3': '0.047', 'weapon5': '0.104', 'AMMO4': '0.136', 'weapon7': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'HITCOUNT': '0.340', 'WEAPON3': '0.350', 'WEAPON7': '0.400', 'ARMOR': '0.480', 'weapon4': '0.658', 'weapon3': '0.818', 'weapon2': '1.866', 'DAMAGECOUNT': '2.316', 'FRAGCOUNT': '7.000'} [2023-02-24 18:25:03,781][177155] DAMAGECOUNT value on done: 106698.0 [2023-02-24 18:25:03,781][177155] Sum rewards: 7.303, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.526', 'AMMO2': '0.013', 'AMMO5': '0.017', 'WEAPON1': '0.060', 'AMMO4': '0.062', 'AMMO3': '0.119', 'WEAPON4': '0.200', 'weapon5': '0.296', 'weapon4': '0.302', 'WEAPON5': '0.450', 'ARMOR': '0.456', 'WEAPON3': '0.700', 'HITCOUNT': '0.750', 'weapon2': '1.236', 'weapon3': '1.792', 'DAMAGECOUNT': '3.876', 'FRAGCOUNT': '8.000'} [2023-02-24 18:25:03,873][177170] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:25:04,075][177155] DAMAGECOUNT value on done: 100352.0 [2023-02-24 18:25:04,075][177155] Sum rewards: 7.738, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.356', 'AMMO5': '0.012', 'AMMO2': '0.039', 'WEAPON1': '0.060', 'AMMO3': '0.091', 'AMMO4': '0.194', 'weapon5': '0.198', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '0.500', 'ARMOR': '0.808', 'weapon4': '0.960', 'weapon3': '1.080', 'weapon2': '1.170', 'DAMAGECOUNT': '2.481', 'FRAGCOUNT': '7.000'} [2023-02-24 18:25:05,072][177153] Updated weights for policy 0, policy_version 12740 (0.0008) [2023-02-24 18:25:06,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 52199424. Throughput: 0: 3481.6. Samples: 13043926. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:25:06,376][177119] Avg episode reward: [(0, '9.944')] [2023-02-24 18:25:07,966][177153] Updated weights for policy 0, policy_version 12750 (0.0008) [2023-02-24 18:25:09,445][177156] DAMAGECOUNT value on done: 104424.0 [2023-02-24 18:25:09,445][177156] Sum rewards: 11.322, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.420', 'AMMO2': '0.014', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.071', 'AMMO3': '0.073', 'weapon7': '0.100', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'weapon5': '0.256', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.474', 'WEAPON3': '0.500', 'HITCOUNT': '0.690', 'weapon3': '1.090', 'weapon2': '1.798', 'DAMAGECOUNT': '4.500', 'FRAGCOUNT': '8.500'} [2023-02-24 18:25:09,604][177156] DAMAGECOUNT value on done: 103805.0 [2023-02-24 18:25:09,605][177156] Sum rewards: 13.172, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.248', 'AMMO5': '0.012', 'AMMO2': '0.023', 'WEAPON1': '0.050', 'AMMO3': '0.085', 'weapon7': '0.112', 'AMMO4': '0.116', 'weapon5': '0.116', 'WEAPON4': '0.150', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON5': '0.300', 'weapon4': '0.310', 'WEAPON7': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.770', 'weapon2': '1.222', 'weapon3': '1.730', 'DAMAGECOUNT': '3.663', 'FRAGCOUNT': '10.000'} [2023-02-24 18:25:09,750][177156] DAMAGECOUNT value on done: 105895.0 [2023-02-24 18:25:09,750][177156] Sum rewards: 6.390, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.858', 'AMMO2': '0.014', 'AMMO5': '0.019', 'weapon4': '0.020', 'weapon7': '0.060', 'AMMO4': '0.068', 'WEAPON1': '0.070', 'AMMO3': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.250', 'WEAPON5': '0.450', 'HITCOUNT': '0.560', 'WEAPON3': '0.700', 'weapon2': '1.302', 'weapon3': '1.920', 'DAMAGECOUNT': '3.375', 'FRAGCOUNT': '6.000'} [2023-02-24 18:25:09,910][177156] DAMAGECOUNT value on done: 103189.0 [2023-02-24 18:25:09,911][177156] Sum rewards: 4.278, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.232', 'AMMO2': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.032', 'AMMO3': '0.117', 'weapon5': '0.256', 'WEAPON5': '0.300', 'HITCOUNT': '0.570', 'WEAPON3': '0.700', 'weapon2': '1.654', 'DAMAGECOUNT': '1.782', 'weapon3': '1.802', 'FRAGCOUNT': '4.000'} [2023-02-24 18:25:10,878][177153] Updated weights for policy 0, policy_version 12760 (0.0008) [2023-02-24 18:25:11,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13968.0). Total num frames: 52269056. Throughput: 0: 3485.2. Samples: 13064984. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:25:11,376][177119] Avg episode reward: [(0, '9.910')] [2023-02-24 18:25:13,802][177153] Updated weights for policy 0, policy_version 12770 (0.0009) [2023-02-24 18:25:15,427][177170] DAMAGECOUNT value on done: 104125.0 [2023-02-24 18:25:15,427][177170] Sum rewards: 6.444, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.181', 'AMMO2': '0.013', 'AMMO5': '0.022', 'AMMO4': '0.066', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'weapon4': '0.136', 'weapon5': '0.140', 'WEAPON5': '0.450', 'HITCOUNT': '0.640', 'WEAPON3': '0.800', 'weapon2': '1.178', 'weapon3': '2.126', 'DAMAGECOUNT': '2.265', 'FRAGCOUNT': '7.000'} [2023-02-24 18:25:15,726][177170] DAMAGECOUNT value on done: 108345.0 [2023-02-24 18:25:15,727][177170] Sum rewards: 6.058, reward structure: {'DEATHCOUNT': '-0.750', 'HEALTH': '-0.470', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'AMMO3': '0.010', 'weapon5': '0.058', 'WEAPON3': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.160', 'weapon7': '0.172', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon3': '0.306', 'weapon4': '0.362', 'WEAPON7': '0.400', 'DAMAGECOUNT': '0.615', 'weapon2': '1.442', 'FRAGCOUNT': '3.000'} [2023-02-24 18:25:15,757][177170] DAMAGECOUNT value on done: 98028.0 [2023-02-24 18:25:15,758][177170] Sum rewards: 15.511, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.276', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.012', 'AMMO3': '0.092', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.600', 'HITCOUNT': '0.810', 'weapon3': '1.490', 'weapon2': '2.020', 'DAMAGECOUNT': '3.138', 'FRAGCOUNT': '12.000'} [2023-02-24 18:25:16,055][177170] DAMAGECOUNT value on done: 107757.0 [2023-02-24 18:25:16,056][177170] Sum rewards: 18.181, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.230', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO3': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.078', 'AMMO4': '0.080', 'weapon7': '0.148', 'weapon4': '0.168', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.250', 'WEAPON7': '0.300', 'ARMOR': '0.451', 'HITCOUNT': '0.770', 'weapon3': '0.912', 'weapon2': '2.564', 'DAMAGECOUNT': '3.681', 'FRAGCOUNT': '12.000'} [2023-02-24 18:25:16,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.5, 300 sec: 13968.1). Total num frames: 52338688. Throughput: 0: 3489.1. Samples: 13085950. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 18:25:16,376][177119] Avg episode reward: [(0, '10.022')] [2023-02-24 18:25:16,380][177140] Saving new best policy, reward=10.022! [2023-02-24 18:25:16,749][177153] Updated weights for policy 0, policy_version 12780 (0.0009) [2023-02-24 18:25:16,840][177156] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:25:17,005][177158] DAMAGECOUNT value on done: 102789.0 [2023-02-24 18:25:17,005][177158] Sum rewards: 4.994, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.660', 'AMMO2': '0.017', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'weapon7': '0.072', 'AMMO4': '0.085', 'AMMO3': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.164', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.394', 'ARMOR': '0.404', 'WEAPON3': '0.550', 'HITCOUNT': '0.630', 'weapon2': '1.400', 'weapon3': '1.512', 'DAMAGECOUNT': '2.250', 'FRAGCOUNT': '6.000'} [2023-02-24 18:25:17,302][177158] DAMAGECOUNT value on done: 101473.0 [2023-02-24 18:25:17,303][177158] Sum rewards: 19.186, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.017', 'AMMO2': '0.028', 'WEAPON1': '0.050', 'weapon7': '0.064', 'AMMO3': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.141', 'WEAPON4': '0.200', 'weapon5': '0.230', 'WEAPON5': '0.400', 'HEALTH': '0.481', 'WEAPON3': '0.500', 'weapon4': '0.618', 'weapon2': '0.832', 'HITCOUNT': '1.020', 'weapon3': '1.666', 'DAMAGECOUNT': '5.295', 'FRAGCOUNT': '14.000'} [2023-02-24 18:25:17,907][177158] DAMAGECOUNT value on done: 103941.0 [2023-02-24 18:25:17,908][177158] Sum rewards: 16.316, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.684', 'AMMO2': '0.012', 'AMMO5': '0.026', 'AMMO4': '0.057', 'WEAPON1': '0.070', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.104', 'weapon5': '0.178', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.148', 'HITCOUNT': '1.160', 'weapon3': '2.336', 'DAMAGECOUNT': '4.809', 'FRAGCOUNT': '14.000'} [2023-02-24 18:25:18,211][177158] DAMAGECOUNT value on done: 106840.0 [2023-02-24 18:25:18,212][177158] Sum rewards: 5.131, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.825', 'AMMO2': '0.009', 'AMMO5': '0.018', 'AMMO4': '0.045', 'WEAPON1': '0.060', 'weapon5': '0.076', 'AMMO3': '0.085', 'weapon7': '0.138', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.330', 'weapon4': '0.354', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon2': '0.848', 'weapon3': '1.396', 'DAMAGECOUNT': '1.857', 'FRAGCOUNT': '5.000'} [2023-02-24 18:25:19,162][177172] DAMAGECOUNT value on done: 104840.0 [2023-02-24 18:25:19,163][177172] Sum rewards: 12.214, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.820', 'AMMO2': '0.005', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO4': '0.022', 'WEAPON1': '0.040', 'weapon5': '0.076', 'AMMO3': '0.098', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.504', 'WEAPON3': '0.700', 'weapon2': '0.774', 'HITCOUNT': '0.810', 'weapon3': '1.786', 'DAMAGECOUNT': '3.495', 'FRAGCOUNT': '11.000'} [2023-02-24 18:25:19,460][177172] DAMAGECOUNT value on done: 104210.0 [2023-02-24 18:25:19,461][177172] Sum rewards: 11.103, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.189', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.079', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.212', 'weapon4': '0.290', 'ARMOR': '0.466', 'WEAPON3': '0.500', 'HITCOUNT': '0.880', 'weapon3': '1.266', 'weapon2': '1.798', 'DAMAGECOUNT': '3.609', 'FRAGCOUNT': '7.000'} [2023-02-24 18:25:19,687][177153] Updated weights for policy 0, policy_version 12790 (0.0008) [2023-02-24 18:25:20,166][177154] DAMAGECOUNT value on done: 108884.0 [2023-02-24 18:25:20,166][177154] Sum rewards: 7.714, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.468', 'AMMO2': '0.012', 'AMMO5': '0.022', 'WEAPON1': '0.050', 'AMMO4': '0.058', 'weapon7': '0.070', 'AMMO3': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.256', 'HITCOUNT': '0.370', 'WEAPON5': '0.450', 'weapon4': '0.478', 'WEAPON3': '0.700', 'weapon2': '1.104', 'weapon3': '1.644', 'DAMAGECOUNT': '2.430', 'FRAGCOUNT': '7.000'} [2023-02-24 18:25:20,468][177154] DAMAGECOUNT value on done: 108357.0 [2023-02-24 18:25:20,468][177154] Sum rewards: 6.026, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.594', 'AMMO2': '0.006', 'AMMO5': '0.017', 'AMMO4': '0.030', 'WEAPON1': '0.080', 'AMMO3': '0.119', 'weapon5': '0.262', 'WEAPON5': '0.550', 'HITCOUNT': '0.770', 'WEAPON3': '0.800', 'weapon2': '1.414', 'weapon3': '1.896', 'DAMAGECOUNT': '3.675', 'FRAGCOUNT': '5.500'} [2023-02-24 18:25:20,482][177154] DAMAGECOUNT value on done: 107825.0 [2023-02-24 18:25:20,483][177154] Sum rewards: 12.293, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.768', 'AMMO5': '0.012', 'AMMO2': '0.037', 'WEAPON1': '0.040', 'weapon7': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.105', 'AMMO4': '0.183', 'weapon5': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.574', 'weapon4': '0.638', 'WEAPON3': '0.650', 'HITCOUNT': '0.740', 'weapon3': '1.532', 'DAMAGECOUNT': '4.077', 'FRAGCOUNT': '10.000'} [2023-02-24 18:25:20,651][177172] DAMAGECOUNT value on done: 106618.0 [2023-02-24 18:25:20,651][177172] Sum rewards: 10.412, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.501', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon4': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.061', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'weapon5': '0.124', 'weapon7': '0.126', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'HITCOUNT': '0.610', 'weapon2': '1.430', 'weapon3': '1.524', 'DAMAGECOUNT': '1.977', 'FRAGCOUNT': '8.000'} [2023-02-24 18:25:20,792][177154] DAMAGECOUNT value on done: 111335.0 [2023-02-24 18:25:20,792][177154] Sum rewards: 5.226, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.410', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.020', 'WEAPON1': '0.050', 'weapon7': '0.056', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.150', 'AMMO3': '0.164', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.860', 'WEAPON3': '1.050', 'weapon2': '1.328', 'weapon3': '2.140', 'DAMAGECOUNT': '3.393', 'FRAGCOUNT': '6.500'} [2023-02-24 18:25:20,948][177172] DAMAGECOUNT value on done: 104183.0 [2023-02-24 18:25:20,949][177172] Sum rewards: 4.233, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.040', 'AMMO2': '0.009', 'weapon7': '0.012', 'AMMO5': '0.020', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'WEAPON1': '0.080', 'AMMO3': '0.096', 'weapon5': '0.158', 'weapon4': '0.170', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.410', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'weapon2': '1.624', 'DAMAGECOUNT': '1.665', 'weapon3': '1.684', 'FRAGCOUNT': '5.000'} [2023-02-24 18:25:21,186][177171] DAMAGECOUNT value on done: 108411.0 [2023-02-24 18:25:21,187][177171] Sum rewards: 11.016, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.444', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'AMMO3': '0.063', 'weapon5': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon7': '0.154', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'weapon4': '0.410', 'HITCOUNT': '0.690', 'weapon3': '1.458', 'weapon2': '1.548', 'DAMAGECOUNT': '2.460', 'FRAGCOUNT': '8.000'} [2023-02-24 18:25:21,342][177157] DAMAGECOUNT value on done: 103067.0 [2023-02-24 18:25:21,342][177157] Sum rewards: 10.080, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.042', 'weapon7': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO4': '0.092', 'AMMO3': '0.108', 'weapon5': '0.174', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.204', 'WEAPON5': '0.350', 'HITCOUNT': '0.580', 'WEAPON3': '0.650', 'weapon2': '0.782', 'weapon3': '2.166', 'DAMAGECOUNT': '3.252', 'FRAGCOUNT': '8.000'} [2023-02-24 18:25:21,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 52408320. Throughput: 0: 3488.9. Samples: 13096394. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 18:25:21,376][177119] Avg episode reward: [(0, '10.080')] [2023-02-24 18:25:21,376][177140] Saving new best policy, reward=10.080! [2023-02-24 18:25:21,424][177157] DAMAGECOUNT value on done: 107511.0 [2023-02-24 18:25:21,425][177157] Sum rewards: 6.368, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.772', 'AMMO5': '0.012', 'AMMO2': '0.026', 'WEAPON1': '0.080', 'weapon7': '0.096', 'AMMO3': '0.113', 'AMMO4': '0.128', 'weapon5': '0.146', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.434', 'HITCOUNT': '0.620', 'WEAPON3': '0.800', 'weapon2': '1.054', 'weapon3': '1.670', 'DAMAGECOUNT': '2.721', 'FRAGCOUNT': '8.000'} [2023-02-24 18:25:21,501][177171] DAMAGECOUNT value on done: 106063.0 [2023-02-24 18:25:21,501][177171] Sum rewards: 8.639, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.916', 'ARMOR': '0.009', 'AMMO5': '0.013', 'AMMO2': '0.018', 'weapon7': '0.048', 'WEAPON1': '0.050', 'weapon4': '0.052', 'AMMO4': '0.092', 'AMMO3': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.174', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'HITCOUNT': '0.610', 'WEAPON3': '0.800', 'weapon2': '1.278', 'weapon3': '2.004', 'DAMAGECOUNT': '3.060', 'FRAGCOUNT': '7.000'} [2023-02-24 18:25:21,646][177171] DAMAGECOUNT value on done: 102103.0 [2023-02-24 18:25:21,647][177171] Sum rewards: 4.083, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.456', 'AMMO5': '0.007', 'AMMO2': '0.025', 'WEAPON1': '0.050', 'weapon7': '0.064', 'AMMO3': '0.067', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.125', 'weapon5': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.450', 'weapon4': '0.450', 'WEAPON3': '0.500', 'weapon2': '0.930', 'weapon3': '1.338', 'DAMAGECOUNT': '2.124', 'FRAGCOUNT': '5.000'} [2023-02-24 18:25:21,657][177157] DAMAGECOUNT value on done: 102235.0 [2023-02-24 18:25:21,657][177157] Sum rewards: 12.097, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.140', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO3': '0.030', 'weapon5': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon7': '0.200', 'WEAPON3': '0.300', 'HITCOUNT': '0.310', 'AMMO6': '0.560', 'AMMO7': '0.560', 'weapon4': '0.586', 'weapon3': '0.720', 'WEAPON7': '0.800', 'weapon2': '0.976', 'DAMAGECOUNT': '2.679', 'FRAGCOUNT': '8.000'} [2023-02-24 18:25:21,732][177157] DAMAGECOUNT value on done: 104855.0 [2023-02-24 18:25:21,732][177157] Sum rewards: 4.148, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.965', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'weapon7': '0.048', 'AMMO3': '0.061', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.157', 'weapon5': '0.180', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.430', 'WEAPON4': '0.450', 'ARMOR': '0.511', 'weapon2': '0.728', 'weapon4': '0.926', 'weapon3': '1.020', 'DAMAGECOUNT': '2.148', 'FRAGCOUNT': '4.000'} [2023-02-24 18:25:21,941][177171] DAMAGECOUNT value on done: 99426.0 [2023-02-24 18:25:21,942][177171] Sum rewards: 12.140, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.015', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'weapon7': '0.058', 'AMMO4': '0.072', 'AMMO3': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HEALTH': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.260', 'weapon4': '0.366', 'WEAPON3': '0.400', 'HITCOUNT': '0.740', 'weapon2': '1.352', 'weapon3': '1.556', 'DAMAGECOUNT': '3.159', 'FRAGCOUNT': '9.000'} [2023-02-24 18:25:22,466][177155] DAMAGECOUNT value on done: 105102.0 [2023-02-24 18:25:22,466][177155] Sum rewards: 7.488, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.788', 'AMMO2': '0.005', 'AMMO5': '0.017', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO3': '0.060', 'WEAPON1': '0.060', 'weapon4': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.184', 'WEAPON5': '0.400', 'HITCOUNT': '0.400', 'WEAPON3': '0.500', 'weapon3': '1.510', 'weapon2': '1.926', 'DAMAGECOUNT': '1.974', 'FRAGCOUNT': '6.000'} [2023-02-24 18:25:22,638][177153] Updated weights for policy 0, policy_version 12800 (0.0008) [2023-02-24 18:25:22,769][177155] DAMAGECOUNT value on done: 110286.0 [2023-02-24 18:25:22,769][177155] Sum rewards: 2.705, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.505', 'AMMO2': '0.016', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'weapon7': '0.052', 'AMMO4': '0.081', 'AMMO3': '0.087', 'weapon5': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'weapon4': '0.384', 'WEAPON7': '0.400', 'HITCOUNT': '0.540', 'WEAPON3': '0.550', 'weapon2': '1.558', 'weapon3': '1.578', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.178'} [2023-02-24 18:25:23,072][177155] DAMAGECOUNT value on done: 107661.0 [2023-02-24 18:25:23,072][177155] Sum rewards: 8.532, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.365', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.020', 'weapon7': '0.048', 'WEAPON1': '0.050', 'weapon5': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.298', 'WEAPON5': '0.350', 'HITCOUNT': '0.760', 'WEAPON3': '0.800', 'weapon2': '1.224', 'weapon3': '2.008', 'DAMAGECOUNT': '2.889', 'FRAGCOUNT': '7.500'} [2023-02-24 18:25:23,373][177155] DAMAGECOUNT value on done: 101753.0 [2023-02-24 18:25:23,373][177155] Sum rewards: 13.323, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon7': '0.048', 'AMMO3': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.141', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.292', 'WEAPON3': '0.300', 'HEALTH': '0.418', 'weapon4': '0.628', 'HITCOUNT': '0.840', 'weapon2': '1.208', 'weapon3': '1.242', 'DAMAGECOUNT': '4.203', 'FRAGCOUNT': '7.500'} [2023-02-24 18:25:25,542][177153] Updated weights for policy 0, policy_version 12810 (0.0009) [2023-02-24 18:25:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 52477952. Throughput: 0: 3488.7. Samples: 13117340. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 18:25:26,376][177119] Avg episode reward: [(0, '9.681')] [2023-02-24 18:25:28,451][177153] Updated weights for policy 0, policy_version 12820 (0.0008) [2023-02-24 18:25:28,752][177156] DAMAGECOUNT value on done: 105117.0 [2023-02-24 18:25:28,752][177156] Sum rewards: 6.465, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.030', 'AMMO5': '0.015', 'AMMO2': '0.027', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO3': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.135', 'weapon5': '0.162', 'weapon4': '0.184', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.630', 'weapon3': '1.604', 'weapon2': '1.644', 'DAMAGECOUNT': '2.079', 'FRAGCOUNT': '6.000'} [2023-02-24 18:25:28,909][177156] DAMAGECOUNT value on done: 105146.0 [2023-02-24 18:25:28,909][177156] Sum rewards: 12.467, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.116', 'AMMO5': '0.022', 'AMMO2': '0.024', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.102', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'weapon5': '0.206', 'weapon4': '0.504', 'WEAPON5': '0.550', 'weapon2': '0.584', 'WEAPON3': '0.750', 'HITCOUNT': '0.810', 'weapon3': '1.840', 'DAMAGECOUNT': '4.023', 'FRAGCOUNT': '11.000'} [2023-02-24 18:25:29,068][177156] DAMAGECOUNT value on done: 106325.0 [2023-02-24 18:25:29,069][177156] Sum rewards: 4.133, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.907', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'ARMOR': '0.048', 'AMMO3': '0.063', 'AMMO4': '0.083', 'weapon5': '0.084', 'weapon7': '0.124', 'WEAPON5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'HITCOUNT': '0.410', 'WEAPON3': '0.450', 'weapon4': '0.718', 'weapon3': '0.906', 'weapon2': '1.072', 'DAMAGECOUNT': '1.290', 'FRAGCOUNT': '3.000'} [2023-02-24 18:25:29,219][177156] DAMAGECOUNT value on done: 103911.0 [2023-02-24 18:25:29,219][177156] Sum rewards: 7.630, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'weapon7': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.068', 'AMMO3': '0.068', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HEALTH': '0.232', 'weapon4': '0.308', 'WEAPON3': '0.350', 'HITCOUNT': '0.420', 'weapon3': '1.034', 'weapon2': '1.560', 'DAMAGECOUNT': '1.920', 'FRAGCOUNT': '6.000'} [2023-02-24 18:25:31,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 52547584. Throughput: 0: 3489.4. Samples: 13138378. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 18:25:31,376][177119] Avg episode reward: [(0, '9.641')] [2023-02-24 18:25:31,380][177153] Updated weights for policy 0, policy_version 12830 (0.0008) [2023-02-24 18:25:32,565][177155] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:25:33,838][177157] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:25:34,332][177153] Updated weights for policy 0, policy_version 12840 (0.0009) [2023-02-24 18:25:34,643][177170] DAMAGECOUNT value on done: 104703.0 [2023-02-24 18:25:34,643][177170] Sum rewards: 6.383, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.936', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO4': '0.035', 'AMMO3': '0.067', 'weapon7': '0.112', 'WEAPON4': '0.150', 'weapon5': '0.156', 'WEAPON5': '0.200', 'AMMO6': '0.340', 'AMMO7': '0.340', 'HITCOUNT': '0.380', 'ARMOR': '0.400', 'weapon4': '0.448', 'WEAPON3': '0.450', 'WEAPON7': '0.500', 'weapon3': '1.296', 'weapon2': '1.666', 'DAMAGECOUNT': '1.734', 'FRAGCOUNT': '5.000'} [2023-02-24 18:25:34,943][177170] DAMAGECOUNT value on done: 110097.0 [2023-02-24 18:25:34,944][177170] Sum rewards: 11.240, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.985', 'AMMO5': '0.019', 'AMMO2': '0.025', 'weapon7': '0.032', 'WEAPON1': '0.060', 'AMMO4': '0.123', 'AMMO3': '0.136', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.236', 'WEAPON4': '0.250', 'weapon5': '0.272', 'WEAPON5': '0.400', 'weapon2': '0.752', 'WEAPON3': '0.950', 'HITCOUNT': '0.960', 'weapon3': '2.234', 'DAMAGECOUNT': '5.256', 'FRAGCOUNT': '11.500'} [2023-02-24 18:25:34,972][177170] DAMAGECOUNT value on done: 99408.0 [2023-02-24 18:25:34,973][177170] Sum rewards: 13.094, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.008', 'AMMO2': '0.014', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.069', 'weapon7': '0.078', 'AMMO3': '0.116', 'weapon4': '0.134', 'weapon5': '0.182', 'WEAPON4': '0.200', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON5': '0.450', 'HITCOUNT': '0.700', 'WEAPON3': '0.850', 'weapon2': '0.958', 'weapon3': '2.274', 'DAMAGECOUNT': '4.140', 'FRAGCOUNT': '12.000'} [2023-02-24 18:25:35,270][177170] DAMAGECOUNT value on done: 109669.0 [2023-02-24 18:25:35,270][177170] Sum rewards: 18.244, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.022', 'AMMO2': '0.033', 'WEAPON1': '0.050', 'weapon7': '0.054', 'HEALTH': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'AMMO4': '0.165', 'weapon4': '0.250', 'weapon5': '0.256', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.720', 'weapon2': '1.348', 'weapon3': '1.692', 'DAMAGECOUNT': '4.836', 'FRAGCOUNT': '14.000'} [2023-02-24 18:25:36,205][177158] DAMAGECOUNT value on done: 103316.0 [2023-02-24 18:25:36,205][177158] Sum rewards: 5.391, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.060', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.032', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.062', 'weapon7': '0.142', 'weapon5': '0.180', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.332', 'HITCOUNT': '0.430', 'WEAPON3': '0.550', 'weapon2': '1.160', 'weapon3': '1.440', 'DAMAGECOUNT': '1.581', 'FRAGCOUNT': '4.000'} [2023-02-24 18:25:36,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 52617216. Throughput: 0: 3489.5. Samples: 13148838. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:25:36,376][177119] Avg episode reward: [(0, '9.714')] [2023-02-24 18:25:36,499][177158] DAMAGECOUNT value on done: 102518.0 [2023-02-24 18:25:36,500][177158] Sum rewards: 9.841, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.855', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'weapon7': '0.046', 'AMMO4': '0.059', 'weapon5': '0.060', 'AMMO3': '0.067', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.362', 'WEAPON3': '0.400', 'ARMOR': '0.428', 'HITCOUNT': '0.650', 'weapon2': '0.860', 'weapon3': '1.104', 'DAMAGECOUNT': '3.135', 'FRAGCOUNT': '8.000'} [2023-02-24 18:25:37,023][177158] DAMAGECOUNT value on done: 104751.0 [2023-02-24 18:25:37,023][177158] Sum rewards: 8.595, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.896', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.058', 'AMMO3': '0.060', 'weapon5': '0.090', 'WEAPON5': '0.150', 'weapon7': '0.150', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'weapon4': '0.454', 'WEAPON3': '0.500', 'HITCOUNT': '0.550', 'weapon2': '0.862', 'weapon3': '1.310', 'DAMAGECOUNT': '2.430', 'FRAGCOUNT': '7.000'} [2023-02-24 18:25:37,273][177153] Updated weights for policy 0, policy_version 12850 (0.0009) [2023-02-24 18:25:37,340][177158] DAMAGECOUNT value on done: 107524.0 [2023-02-24 18:25:37,340][177158] Sum rewards: 11.763, reward structure: {'DEATHCOUNT': '-2.250', 'ARMOR': '0.016', 'AMMO3': '0.020', 'AMMO2': '0.030', 'WEAPON3': '0.100', 'weapon2': '0.112', 'AMMO4': '0.149', 'WEAPON4': '0.250', 'weapon7': '0.282', 'HEALTH': '0.362', 'AMMO6': '0.420', 'AMMO7': '0.420', 'weapon3': '0.492', 'WEAPON7': '0.500', 'HITCOUNT': '0.500', 'weapon4': '1.308', 'DAMAGECOUNT': '2.052', 'FRAGCOUNT': '7.000'} [2023-02-24 18:25:38,353][177172] DAMAGECOUNT value on done: 105615.0 [2023-02-24 18:25:38,354][177172] Sum rewards: 4.991, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.705', 'AMMO5': '0.015', 'ARMOR': '0.024', 'AMMO2': '0.028', 'weapon5': '0.052', 'AMMO3': '0.074', 'weapon7': '0.128', 'AMMO4': '0.138', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.420', 'WEAPON3': '0.500', 'weapon2': '0.912', 'weapon3': '0.912', 'weapon4': '0.918', 'DAMAGECOUNT': '2.325', 'FRAGCOUNT': '4.000'} [2023-02-24 18:25:38,654][177172] DAMAGECOUNT value on done: 105154.0 [2023-02-24 18:25:38,654][177172] Sum rewards: 7.699, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.425', 'AMMO5': '0.015', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'weapon5': '0.050', 'AMMO4': '0.080', 'AMMO3': '0.099', 'weapon7': '0.130', 'WEAPON4': '0.150', 'AMMO6': '0.260', 'AMMO7': '0.260', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.450', 'ARMOR': '0.483', 'weapon2': '0.664', 'WEAPON3': '0.700', 'HITCOUNT': '0.760', 'weapon3': '1.872', 'DAMAGECOUNT': '2.454', 'FRAGCOUNT': '6.000'} [2023-02-24 18:25:39,418][177154] DAMAGECOUNT value on done: 110293.0 [2023-02-24 18:25:39,418][177154] Sum rewards: 16.007, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.708', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.007', 'WEAPON1': '0.040', 'weapon5': '0.082', 'weapon7': '0.082', 'AMMO3': '0.125', 'WEAPON5': '0.200', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.900', 'weapon3': '1.610', 'weapon2': '1.746', 'DAMAGECOUNT': '4.227', 'FRAGCOUNT': '12.000'} [2023-02-24 18:25:39,712][177154] DAMAGECOUNT value on done: 109457.0 [2023-02-24 18:25:39,713][177154] Sum rewards: 8.327, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.103', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'weapon7': '0.058', 'WEAPON1': '0.060', 'AMMO4': '0.077', 'AMMO3': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.146', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.700', 'HITCOUNT': '0.820', 'weapon2': '1.704', 'weapon3': '1.750', 'DAMAGECOUNT': '3.300', 'FRAGCOUNT': '6.000'} [2023-02-24 18:25:39,749][177154] DAMAGECOUNT value on done: 108870.0 [2023-02-24 18:25:39,750][177154] Sum rewards: 10.257, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.114', 'AMMO5': '0.010', 'AMMO2': '0.034', 'WEAPON1': '0.060', 'AMMO3': '0.072', 'weapon7': '0.108', 'AMMO4': '0.169', 'weapon5': '0.206', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon2': '0.558', 'WEAPON3': '0.600', 'weapon4': '0.648', 'HITCOUNT': '0.800', 'weapon3': '1.680', 'DAMAGECOUNT': '3.135', 'FRAGCOUNT': '9.000'} [2023-02-24 18:25:39,847][177172] DAMAGECOUNT value on done: 107908.0 [2023-02-24 18:25:39,848][177172] Sum rewards: 14.413, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.297', 'AMMO5': '0.017', 'AMMO2': '0.021', 'weapon4': '0.022', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.106', 'weapon7': '0.112', 'weapon5': '0.170', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.400', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.800', 'HITCOUNT': '0.810', 'weapon2': '1.298', 'weapon3': '2.052', 'DAMAGECOUNT': '3.870', 'FRAGCOUNT': '12.000'} [2023-02-24 18:25:40,049][177154] DAMAGECOUNT value on done: 112294.0 [2023-02-24 18:25:40,050][177154] Sum rewards: 7.321, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.815', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.032', 'WEAPON1': '0.060', 'AMMO3': '0.083', 'weapon7': '0.116', 'AMMO4': '0.158', 'weapon5': '0.160', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'AMMO6': '0.420', 'AMMO7': '0.420', 'HITCOUNT': '0.480', 'WEAPON7': '0.500', 'WEAPON3': '0.550', 'weapon2': '0.594', 'weapon4': '0.836', 'weapon3': '1.232', 'DAMAGECOUNT': '2.877', 'FRAGCOUNT': '6.500'} [2023-02-24 18:25:40,145][177172] DAMAGECOUNT value on done: 105624.0 [2023-02-24 18:25:40,145][177172] Sum rewards: 13.113, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.165', 'AMMO5': '0.028', 'AMMO2': '0.034', 'weapon7': '0.072', 'AMMO3': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.152', 'AMMO4': '0.172', 'WEAPON4': '0.300', 'weapon4': '0.390', 'WEAPON5': '0.450', 'WEAPON3': '0.450', 'HITCOUNT': '0.750', 'weapon3': '0.888', 'weapon2': '1.402', 'DAMAGECOUNT': '4.314', 'FRAGCOUNT': '12.000'} [2023-02-24 18:25:40,215][177153] Updated weights for policy 0, policy_version 12860 (0.0008) [2023-02-24 18:25:40,378][177171] DAMAGECOUNT value on done: 109423.0 [2023-02-24 18:25:40,378][177171] Sum rewards: 12.430, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.562', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'weapon4': '0.050', 'AMMO3': '0.057', 'weapon5': '0.102', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon7': '0.154', 'WEAPON3': '0.350', 'AMMO6': '0.520', 'AMMO7': '0.520', 'HITCOUNT': '0.560', 'WEAPON7': '0.600', 'weapon3': '1.036', 'weapon2': '2.512', 'DAMAGECOUNT': '3.036', 'FRAGCOUNT': '9.000'} [2023-02-24 18:25:40,602][177157] DAMAGECOUNT value on done: 103994.0 [2023-02-24 18:25:40,603][177157] Sum rewards: 10.805, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.150', 'AMMO2': '0.006', 'AMMO5': '0.014', 'AMMO4': '0.032', 'WEAPON1': '0.040', 'weapon7': '0.056', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.166', 'WEAPON7': '0.200', 'weapon4': '0.248', 'HITCOUNT': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'weapon3': '0.946', 'weapon2': '2.412', 'DAMAGECOUNT': '2.781', 'FRAGCOUNT': '10.000'} [2023-02-24 18:25:40,668][177171] DAMAGECOUNT value on done: 106244.0 [2023-02-24 18:25:40,670][177157] DAMAGECOUNT value on done: 108709.0 [2023-02-24 18:25:40,670][177157] Sum rewards: 12.802, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.466', 'AMMO2': '0.009', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'weapon5': '0.110', 'AMMO3': '0.115', 'weapon4': '0.236', 'WEAPON5': '0.250', 'WEAPON3': '0.800', 'HITCOUNT': '0.820', 'weapon2': '1.046', 'weapon3': '2.104', 'DAMAGECOUNT': '3.594', 'FRAGCOUNT': '13.000'} [2023-02-24 18:25:40,831][177171] DAMAGECOUNT value on done: 103246.0 [2023-02-24 18:25:40,831][177171] Sum rewards: 8.633, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.682', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.057', 'AMMO3': '0.063', 'weapon7': '0.100', 'weapon5': '0.114', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'AMMO6': '0.420', 'AMMO7': '0.420', 'WEAPON3': '0.450', 'WEAPON7': '0.500', 'weapon4': '0.596', 'HITCOUNT': '0.600', 'weapon3': '1.224', 'weapon2': '1.242', 'DAMAGECOUNT': '3.429', 'FRAGCOUNT': '8.000'} [2023-02-24 18:25:40,902][177157] DAMAGECOUNT value on done: 103495.0 [2023-02-24 18:25:40,903][177157] Sum rewards: 11.205, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.657', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'weapon7': '0.128', 'weapon5': '0.142', 'WEAPON5': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'weapon4': '0.326', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'weapon2': '0.430', 'HITCOUNT': '0.580', 'weapon3': '1.468', 'DAMAGECOUNT': '3.639', 'FRAGCOUNT': '8.500'} [2023-02-24 18:25:40,970][177157] DAMAGECOUNT value on done: 105645.0 [2023-02-24 18:25:40,971][177157] Sum rewards: 7.554, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.098', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.060', 'weapon7': '0.066', 'AMMO4': '0.084', 'AMMO3': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'HITCOUNT': '0.500', 'weapon4': '0.576', 'WEAPON3': '0.600', 'weapon2': '0.794', 'weapon3': '1.622', 'DAMAGECOUNT': '2.370', 'FRAGCOUNT': '7.000'} [2023-02-24 18:25:41,126][177171] DAMAGECOUNT value on done: 100135.0 [2023-02-24 18:25:41,127][177171] Sum rewards: 8.986, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.834', 'AMMO5': '0.015', 'AMMO2': '0.023', 'weapon7': '0.048', 'WEAPON1': '0.070', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'AMMO4': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.268', 'WEAPON5': '0.350', 'HITCOUNT': '0.450', 'WEAPON3': '0.650', 'weapon3': '1.642', 'weapon2': '1.674', 'DAMAGECOUNT': '2.127', 'FRAGCOUNT': '7.000'} [2023-02-24 18:25:41,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 52686848. Throughput: 0: 3491.4. Samples: 13169770. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:25:41,376][177119] Avg episode reward: [(0, '9.722')] [2023-02-24 18:25:41,706][177155] DAMAGECOUNT value on done: 106653.0 [2023-02-24 18:25:41,706][177155] Sum rewards: 15.151, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.338', 'AMMO2': '0.019', 'AMMO5': '0.032', 'weapon4': '0.034', 'AMMO4': '0.095', 'WEAPON1': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.136', 'weapon5': '0.306', 'WEAPON5': '0.650', 'weapon2': '0.658', 'HITCOUNT': '0.690', 'WEAPON3': '0.900', 'weapon3': '2.366', 'DAMAGECOUNT': '4.653', 'FRAGCOUNT': '14.000'} [2023-02-24 18:25:42,008][177155] DAMAGECOUNT value on done: 111458.0 [2023-02-24 18:25:42,008][177155] Sum rewards: 9.635, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.370', 'AMMO2': '0.014', 'AMMO5': '0.023', 'WEAPON1': '0.030', 'AMMO4': '0.071', 'AMMO3': '0.086', 'weapon4': '0.096', 'WEAPON4': '0.200', 'weapon7': '0.210', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon5': '0.314', 'ARMOR': '0.408', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.680', 'weapon2': '0.868', 'weapon3': '1.890', 'DAMAGECOUNT': '3.474', 'FRAGCOUNT': '7.500'} [2023-02-24 18:25:42,317][177155] DAMAGECOUNT value on done: 108831.0 [2023-02-24 18:25:42,318][177155] Sum rewards: 10.254, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.030', 'AMMO5': '0.019', 'AMMO2': '0.022', 'WEAPON1': '0.070', 'AMMO3': '0.087', 'weapon7': '0.102', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'weapon5': '0.206', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.308', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'weapon2': '1.060', 'weapon3': '1.858', 'DAMAGECOUNT': '3.510', 'FRAGCOUNT': '8.000'} [2023-02-24 18:25:42,611][177155] DAMAGECOUNT value on done: 103208.0 [2023-02-24 18:25:42,612][177155] Sum rewards: 15.806, reward structure: {'DEATHCOUNT': '-6.000', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.050', 'weapon5': '0.052', 'HEALTH': '0.065', 'AMMO3': '0.070', 'weapon7': '0.094', 'WEAPON5': '0.100', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.680', 'weapon4': '0.806', 'weapon2': '0.854', 'weapon3': '1.308', 'DAMAGECOUNT': '4.254', 'FRAGCOUNT': '12.000'} [2023-02-24 18:25:43,131][177153] Updated weights for policy 0, policy_version 12870 (0.0008) [2023-02-24 18:25:46,071][177153] Updated weights for policy 0, policy_version 12880 (0.0009) [2023-02-24 18:25:46,376][177119] Fps is (10 sec: 14336.0, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 52760576. Throughput: 0: 3495.1. Samples: 13190778. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:25:46,376][177119] Avg episode reward: [(0, '10.005')] [2023-02-24 18:25:47,938][177171] Large shaping reward 2.581 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.549, 183.0), ('weapon7', 0.002)] [2023-02-24 18:25:48,076][177156] DAMAGECOUNT value on done: 105859.0 [2023-02-24 18:25:48,076][177156] Sum rewards: 7.828, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.145', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO3': '0.062', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.434', 'ARMOR': '0.467', 'WEAPON3': '0.550', 'HITCOUNT': '0.620', 'weapon3': '1.464', 'weapon2': '1.490', 'DAMAGECOUNT': '2.226', 'FRAGCOUNT': '5.000'} [2023-02-24 18:25:48,268][177156] DAMAGECOUNT value on done: 106972.0 [2023-02-24 18:25:48,269][177156] Sum rewards: 17.252, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.323', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON1': '0.060', 'AMMO4': '0.090', 'AMMO3': '0.121', 'WEAPON4': '0.150', 'weapon5': '0.174', 'weapon4': '0.196', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'weapon2': '0.956', 'HITCOUNT': '1.170', 'weapon3': '2.336', 'DAMAGECOUNT': '5.478', 'FRAGCOUNT': '14.000'} [2023-02-24 18:25:48,399][177156] DAMAGECOUNT value on done: 107282.0 [2023-02-24 18:25:48,399][177156] Sum rewards: 7.493, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.920', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'weapon7': '0.070', 'AMMO4': '0.089', 'AMMO3': '0.112', 'weapon5': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.264', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.700', 'HITCOUNT': '0.740', 'weapon2': '1.270', 'weapon3': '1.672', 'DAMAGECOUNT': '2.871', 'FRAGCOUNT': '6.000'} [2023-02-24 18:25:48,574][177156] DAMAGECOUNT value on done: 104573.0 [2023-02-24 18:25:48,575][177156] Sum rewards: 6.773, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.013', 'AMMO5': '0.015', 'HEALTH': '0.027', 'WEAPON1': '0.060', 'weapon4': '0.062', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'weapon5': '0.332', 'HITCOUNT': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon3': '1.460', 'weapon2': '1.802', 'DAMAGECOUNT': '1.986', 'FRAGCOUNT': '6.000'} [2023-02-24 18:25:49,003][177153] Updated weights for policy 0, policy_version 12890 (0.0008) [2023-02-24 18:25:51,376][177119] Fps is (10 sec: 14336.0, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 52830208. Throughput: 0: 3496.5. Samples: 13201268. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:25:51,376][177119] Avg episode reward: [(0, '9.933')] [2023-02-24 18:25:51,479][177172] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 18:25:51,926][177153] Updated weights for policy 0, policy_version 12900 (0.0008) [2023-02-24 18:25:52,762][177157] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:25:53,821][177170] DAMAGECOUNT value on done: 106480.0 [2023-02-24 18:25:53,821][177170] Sum rewards: 16.512, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.859', 'AMMO5': '0.005', 'AMMO2': '0.018', 'ARMOR': '0.044', 'AMMO3': '0.067', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'weapon7': '0.176', 'WEAPON4': '0.200', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON3': '0.450', 'weapon4': '0.658', 'HITCOUNT': '0.710', 'weapon2': '1.148', 'weapon3': '1.426', 'DAMAGECOUNT': '4.131', 'FRAGCOUNT': '14.000'} [2023-02-24 18:25:54,081][177171] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:25:54,118][177170] DAMAGECOUNT value on done: 110821.0 [2023-02-24 18:25:54,118][177170] Sum rewards: 6.839, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.036', 'AMMO2': '0.008', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO4': '0.039', 'WEAPON1': '0.050', 'AMMO3': '0.089', 'WEAPON4': '0.150', 'weapon5': '0.158', 'weapon4': '0.304', 'WEAPON5': '0.350', 'HITCOUNT': '0.530', 'WEAPON3': '0.650', 'weapon2': '1.336', 'weapon3': '1.766', 'DAMAGECOUNT': '2.172', 'FRAGCOUNT': '7.000'} [2023-02-24 18:25:54,148][177170] DAMAGECOUNT value on done: 100364.0 [2023-02-24 18:25:54,149][177170] Sum rewards: 7.130, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.966', 'AMMO2': '0.006', 'AMMO5': '0.010', 'ARMOR': '0.016', 'WEAPON1': '0.030', 'AMMO4': '0.032', 'weapon7': '0.054', 'AMMO3': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.138', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.640', 'weapon4': '0.668', 'weapon2': '0.986', 'weapon3': '1.774', 'DAMAGECOUNT': '2.868', 'FRAGCOUNT': '6.000'} [2023-02-24 18:25:54,444][177170] DAMAGECOUNT value on done: 110474.0 [2023-02-24 18:25:54,444][177170] Sum rewards: 7.832, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.476', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.077', 'AMMO3': '0.079', 'weapon7': '0.086', 'WEAPON5': '0.100', 'weapon5': '0.108', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.602', 'weapon3': '1.346', 'weapon2': '1.564', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '6.000'} [2023-02-24 18:25:54,847][177153] Updated weights for policy 0, policy_version 12910 (0.0008) [2023-02-24 18:25:55,373][177158] DAMAGECOUNT value on done: 104201.0 [2023-02-24 18:25:55,373][177158] Sum rewards: 9.470, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.812', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.073', 'AMMO3': '0.098', 'weapon5': '0.118', 'WEAPON5': '0.150', 'weapon7': '0.156', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'WEAPON7': '0.400', 'weapon4': '0.448', 'HITCOUNT': '0.470', 'WEAPON3': '0.650', 'weapon2': '0.890', 'weapon3': '1.582', 'DAMAGECOUNT': '2.655', 'FRAGCOUNT': '7.000'} [2023-02-24 18:25:55,672][177158] DAMAGECOUNT value on done: 104033.0 [2023-02-24 18:25:55,673][177158] Sum rewards: 16.266, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.150', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.012', 'WEAPON1': '0.070', 'AMMO3': '0.115', 'weapon5': '0.258', 'WEAPON5': '0.350', 'HITCOUNT': '0.750', 'WEAPON3': '0.800', 'weapon2': '0.850', 'weapon3': '2.176', 'DAMAGECOUNT': '4.545', 'FRAGCOUNT': '15.000'} [2023-02-24 18:25:56,189][177158] DAMAGECOUNT value on done: 105965.0 [2023-02-24 18:25:56,189][177158] Sum rewards: 8.399, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.234', 'AMMO2': '0.013', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.067', 'AMMO3': '0.102', 'weapon7': '0.146', 'weapon5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'weapon4': '0.338', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.700', 'weapon3': '1.290', 'weapon2': '1.310', 'DAMAGECOUNT': '3.642', 'FRAGCOUNT': '8.000'} [2023-02-24 18:25:56,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13968.0). Total num frames: 52899840. Throughput: 0: 3495.3. Samples: 13222274. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:25:56,376][177119] Avg episode reward: [(0, '9.882')] [2023-02-24 18:25:56,494][177158] DAMAGECOUNT value on done: 108478.0 [2023-02-24 18:25:56,495][177158] Sum rewards: 12.298, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.625', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.016', 'AMMO4': '0.059', 'AMMO3': '0.072', 'WEAPON4': '0.150', 'weapon4': '0.198', 'weapon5': '0.276', 'ARMOR': '0.456', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.730', 'weapon3': '1.546', 'weapon2': '1.736', 'DAMAGECOUNT': '2.862', 'FRAGCOUNT': '9.000'} [2023-02-24 18:25:57,547][177172] DAMAGECOUNT value on done: 106750.0 [2023-02-24 18:25:57,548][177172] Sum rewards: 11.742, reward structure: {'DEATHCOUNT': '-6.000', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.178', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.314', 'WEAPON3': '0.550', 'HEALTH': '0.582', 'HITCOUNT': '0.700', 'weapon2': '1.378', 'weapon3': '1.660', 'DAMAGECOUNT': '3.405', 'FRAGCOUNT': '8.000'} [2023-02-24 18:25:57,777][177153] Updated weights for policy 0, policy_version 12920 (0.0008) [2023-02-24 18:25:57,858][177172] DAMAGECOUNT value on done: 106179.0 [2023-02-24 18:25:57,858][177172] Sum rewards: 9.427, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.665', 'ARMOR': '0.004', 'AMMO2': '0.013', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'AMMO4': '0.064', 'AMMO3': '0.078', 'weapon7': '0.112', 'WEAPON4': '0.150', 'weapon5': '0.176', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.324', 'WEAPON7': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.650', 'weapon2': '1.222', 'weapon3': '1.442', 'DAMAGECOUNT': '3.075', 'FRAGCOUNT': '7.000'} [2023-02-24 18:25:58,601][177154] DAMAGECOUNT value on done: 111111.0 [2023-02-24 18:25:58,602][177154] Sum rewards: 9.142, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.775', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.044', 'AMMO3': '0.070', 'WEAPON1': '0.070', 'weapon4': '0.124', 'WEAPON4': '0.150', 'weapon5': '0.204', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.610', 'weapon2': '1.526', 'weapon3': '1.796', 'DAMAGECOUNT': '2.454', 'FRAGCOUNT': '8.000'} [2023-02-24 18:25:58,910][177154] DAMAGECOUNT value on done: 110818.0 [2023-02-24 18:25:58,910][177154] Sum rewards: 11.206, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.117', 'AMMO5': '0.022', 'ARMOR': '0.024', 'AMMO2': '0.041', 'weapon7': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.132', 'WEAPON7': '0.200', 'AMMO4': '0.204', 'weapon4': '0.280', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'HITCOUNT': '0.810', 'weapon2': '1.366', 'weapon3': '1.788', 'DAMAGECOUNT': '4.050', 'FRAGCOUNT': '12.000'} [2023-02-24 18:25:59,018][177154] DAMAGECOUNT value on done: 109870.0 [2023-02-24 18:25:59,019][177154] Sum rewards: 10.969, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.015', 'AMMO2': '0.013', 'AMMO5': '0.016', 'AMMO4': '0.063', 'AMMO3': '0.070', 'WEAPON1': '0.070', 'weapon5': '0.248', 'WEAPON5': '0.450', 'HITCOUNT': '0.570', 'WEAPON3': '0.600', 'weapon3': '1.654', 'weapon2': '1.730', 'DAMAGECOUNT': '3.000', 'FRAGCOUNT': '8.000'} [2023-02-24 18:25:59,024][177172] DAMAGECOUNT value on done: 108916.0 [2023-02-24 18:25:59,025][177172] Sum rewards: 12.784, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.202', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'weapon7': '0.050', 'AMMO3': '0.086', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.284', 'WEAPON3': '0.550', 'HITCOUNT': '0.790', 'weapon2': '1.282', 'weapon3': '1.808', 'DAMAGECOUNT': '3.024', 'FRAGCOUNT': '10.000'} [2023-02-24 18:25:59,320][177154] DAMAGECOUNT value on done: 113217.0 [2023-02-24 18:25:59,320][177172] DAMAGECOUNT value on done: 106378.0 [2023-02-24 18:25:59,321][177154] Sum rewards: 8.660, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.155', 'AMMO2': '0.004', 'AMMO4': '0.017', 'AMMO5': '0.024', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'weapon7': '0.060', 'weapon4': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.132', 'AMMO3': '0.135', 'WEAPON7': '0.200', 'WEAPON5': '0.550', 'weapon2': '0.620', 'HITCOUNT': '0.720', 'WEAPON3': '0.900', 'weapon3': '2.732', 'DAMAGECOUNT': '2.769', 'FRAGCOUNT': '8.000'} [2023-02-24 18:25:59,321][177172] Sum rewards: 3.836, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.490', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.030', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO3': '0.110', 'AMMO4': '0.149', 'weapon5': '0.184', 'weapon4': '0.226', 'WEAPON5': '0.350', 'HITCOUNT': '0.460', 'WEAPON3': '0.750', 'weapon2': '1.504', 'weapon3': '1.652', 'DAMAGECOUNT': '2.262', 'FRAGCOUNT': '5.000'} [2023-02-24 18:25:59,566][177171] DAMAGECOUNT value on done: 109855.0 [2023-02-24 18:25:59,567][177171] Sum rewards: 0.851, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.856', 'AMMO2': '0.010', 'AMMO5': '0.021', 'weapon7': '0.026', 'WEAPON1': '0.030', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon4': '0.158', 'weapon5': '0.258', 'HITCOUNT': '0.370', 'ARMOR': '0.466', 'AMMO6': '0.500', 'WEAPON7': '0.500', 'AMMO7': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon2': '0.890', 'DAMAGECOUNT': '1.296', 'FRAGCOUNT': '2.000', 'weapon3': '2.170'} [2023-02-24 18:25:59,837][177157] DAMAGECOUNT value on done: 104850.0 [2023-02-24 18:25:59,838][177157] Sum rewards: 5.274, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.104', 'AMMO2': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'ARMOR': '0.038', 'AMMO3': '0.064', 'weapon5': '0.072', 'weapon7': '0.152', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.460', 'weapon4': '0.638', 'weapon2': '1.036', 'weapon3': '1.370', 'DAMAGECOUNT': '2.553', 'FRAGCOUNT': '4.000'} [2023-02-24 18:25:59,867][177171] DAMAGECOUNT value on done: 106925.0 [2023-02-24 18:25:59,867][177171] Sum rewards: 2.209, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.410', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'weapon5': '0.082', 'weapon7': '0.102', 'AMMO4': '0.107', 'AMMO3': '0.114', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.330', 'ARMOR': '0.412', 'weapon4': '0.480', 'WEAPON3': '0.750', 'weapon3': '1.112', 'weapon2': '1.218', 'DAMAGECOUNT': '2.043', 'FRAGCOUNT': '4.000'} [2023-02-24 18:25:59,883][177157] DAMAGECOUNT value on done: 110247.0 [2023-02-24 18:25:59,883][177157] Sum rewards: 13.864, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.933', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'weapon7': '0.070', 'AMMO4': '0.080', 'AMMO3': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.160', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.326', 'ARMOR': '0.467', 'weapon2': '0.594', 'WEAPON3': '0.750', 'HITCOUNT': '1.010', 'weapon3': '2.274', 'DAMAGECOUNT': '4.614', 'FRAGCOUNT': '11.000'} [2023-02-24 18:26:00,014][177171] DAMAGECOUNT value on done: 104764.0 [2023-02-24 18:26:00,014][177171] Sum rewards: 18.469, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.635', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO4': '0.067', 'AMMO3': '0.079', 'weapon7': '0.150', 'weapon5': '0.166', 'WEAPON4': '0.300', 'AMMO6': '0.340', 'AMMO7': '0.340', 'weapon4': '0.376', 'WEAPON5': '0.400', 'WEAPON7': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.830', 'weapon3': '1.006', 'weapon2': '1.810', 'DAMAGECOUNT': '4.320', 'FRAGCOUNT': '14.000'} [2023-02-24 18:26:00,146][177157] DAMAGECOUNT value on done: 104229.0 [2023-02-24 18:26:00,147][177157] Sum rewards: 8.214, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.271', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.015', 'ARMOR': '0.032', 'weapon7': '0.054', 'AMMO3': '0.065', 'WEAPON1': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.332', 'WEAPON5': '0.450', 'HITCOUNT': '0.470', 'WEAPON3': '0.550', 'weapon3': '1.568', 'weapon2': '1.616', 'DAMAGECOUNT': '2.202', 'FRAGCOUNT': '7.000'} [2023-02-24 18:26:00,195][177157] DAMAGECOUNT value on done: 106473.0 [2023-02-24 18:26:00,196][177157] Sum rewards: 10.336, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.494', 'AMMO2': '0.004', 'AMMO5': '0.017', 'AMMO4': '0.019', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'weapon7': '0.054', 'AMMO3': '0.077', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.276', 'WEAPON5': '0.300', 'weapon4': '0.336', 'WEAPON3': '0.450', 'HITCOUNT': '0.630', 'weapon2': '0.894', 'weapon3': '1.642', 'DAMAGECOUNT': '2.484', 'FRAGCOUNT': '9.000'} [2023-02-24 18:26:00,304][177171] DAMAGECOUNT value on done: 101442.0 [2023-02-24 18:26:00,305][177171] Sum rewards: 16.802, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.270', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'weapon5': '0.070', 'AMMO4': '0.079', 'AMMO3': '0.081', 'ARMOR': '0.088', 'weapon7': '0.096', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '0.660', 'weapon2': '0.662', 'weapon4': '0.958', 'weapon3': '1.576', 'DAMAGECOUNT': '3.921', 'FRAGCOUNT': '14.000'} [2023-02-24 18:26:00,753][177153] Updated weights for policy 0, policy_version 12930 (0.0008) [2023-02-24 18:26:00,926][177155] DAMAGECOUNT value on done: 107820.0 [2023-02-24 18:26:00,927][177155] Sum rewards: 11.957, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.400', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'AMMO3': '0.112', 'weapon5': '0.202', 'WEAPON5': '0.350', 'HITCOUNT': '0.650', 'WEAPON3': '0.700', 'weapon2': '1.476', 'weapon3': '2.066', 'DAMAGECOUNT': '3.501', 'FRAGCOUNT': '10.000'} [2023-02-24 18:26:01,228][177155] DAMAGECOUNT value on done: 112298.0 [2023-02-24 18:26:01,229][177155] Sum rewards: 7.722, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.772', 'AMMO2': '0.009', 'AMMO5': '0.017', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'weapon4': '0.070', 'AMMO3': '0.095', 'weapon5': '0.308', 'WEAPON5': '0.450', 'HITCOUNT': '0.480', 'WEAPON3': '0.700', 'weapon2': '1.178', 'weapon3': '2.000', 'DAMAGECOUNT': '2.520', 'FRAGCOUNT': '8.000'} [2023-02-24 18:26:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 52969472. Throughput: 0: 3494.6. Samples: 13243206. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:26:01,376][177119] Avg episode reward: [(0, '9.613')] [2023-02-24 18:26:01,524][177155] DAMAGECOUNT value on done: 110005.0 [2023-02-24 18:26:01,525][177155] Sum rewards: 11.918, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.598', 'AMMO5': '0.020', 'ARMOR': '0.025', 'AMMO2': '0.030', 'WEAPON1': '0.040', 'weapon5': '0.052', 'AMMO3': '0.122', 'AMMO4': '0.151', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.690', 'WEAPON3': '0.850', 'weapon4': '0.852', 'HITCOUNT': '0.960', 'weapon3': '1.652', 'DAMAGECOUNT': '3.522', 'FRAGCOUNT': '12.000'} [2023-02-24 18:26:01,826][177155] DAMAGECOUNT value on done: 104333.0 [2023-02-24 18:26:01,826][177155] Sum rewards: 14.078, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.110', 'AMMO2': '0.014', 'AMMO5': '0.027', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.069', 'AMMO3': '0.099', 'weapon4': '0.208', 'weapon5': '0.250', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'HITCOUNT': '0.750', 'weapon2': '1.028', 'weapon3': '2.008', 'DAMAGECOUNT': '3.375', 'FRAGCOUNT': '12.000'} [2023-02-24 18:26:03,681][177153] Updated weights for policy 0, policy_version 12940 (0.0008) [2023-02-24 18:26:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13968.0). Total num frames: 53039104. Throughput: 0: 3495.3. Samples: 13253682. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:26:06,376][177119] Avg episode reward: [(0, '9.699')] [2023-02-24 18:26:06,642][177153] Updated weights for policy 0, policy_version 12950 (0.0008) [2023-02-24 18:26:07,402][177156] DAMAGECOUNT value on done: 107050.0 [2023-02-24 18:26:07,402][177156] Sum rewards: 12.905, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.644', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.013', 'weapon7': '0.046', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.124', 'WEAPON7': '0.200', 'weapon4': '0.220', 'WEAPON5': '0.250', 'WEAPON3': '0.700', 'HITCOUNT': '0.700', 'ARMOR': '0.800', 'weapon3': '1.550', 'weapon2': '1.846', 'DAMAGECOUNT': '3.573', 'FRAGCOUNT': '10.500'} [2023-02-24 18:26:07,589][177156] DAMAGECOUNT value on done: 107635.0 [2023-02-24 18:26:07,589][177156] Sum rewards: 6.089, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.780', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO5': '0.027', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO3': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.222', 'weapon4': '0.414', 'weapon2': '0.442', 'WEAPON5': '0.500', 'HITCOUNT': '0.540', 'WEAPON3': '0.650', 'weapon3': '1.962', 'DAMAGECOUNT': '1.989', 'FRAGCOUNT': '6.000'} [2023-02-24 18:26:07,711][177156] DAMAGECOUNT value on done: 108913.0 [2023-02-24 18:26:07,711][177156] Sum rewards: 9.609, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.010', 'AMMO2': '0.009', 'AMMO5': '0.020', 'ARMOR': '0.020', 'AMMO4': '0.044', 'WEAPON1': '0.050', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'weapon5': '0.202', 'WEAPON5': '0.400', 'weapon4': '0.404', 'WEAPON3': '0.850', 'weapon2': '1.086', 'HITCOUNT': '1.150', 'weapon3': '1.716', 'DAMAGECOUNT': '4.893', 'FRAGCOUNT': '9.500'} [2023-02-24 18:26:07,890][177156] DAMAGECOUNT value on done: 105455.0 [2023-02-24 18:26:07,891][177156] Sum rewards: 7.787, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.080', 'AMMO5': '0.015', 'ARMOR': '0.020', 'AMMO2': '0.032', 'WEAPON1': '0.050', 'AMMO3': '0.076', 'weapon7': '0.102', 'AMMO4': '0.158', 'weapon5': '0.162', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.540', 'HITCOUNT': '0.610', 'weapon2': '1.046', 'weapon3': '1.120', 'DAMAGECOUNT': '2.646', 'FRAGCOUNT': '7.000'} [2023-02-24 18:26:09,572][177153] Updated weights for policy 0, policy_version 12960 (0.0008) [2023-02-24 18:26:11,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 53108736. Throughput: 0: 3495.0. Samples: 13274614. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:26:11,376][177119] Avg episode reward: [(0, '9.744')] [2023-02-24 18:26:12,525][177153] Updated weights for policy 0, policy_version 12970 (0.0008) [2023-02-24 18:26:13,005][177170] DAMAGECOUNT value on done: 107296.0 [2023-02-24 18:26:13,006][177170] Sum rewards: 6.933, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.333', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.012', 'ARMOR': '0.016', 'WEAPON1': '0.060', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'weapon5': '0.138', 'weapon4': '0.184', 'WEAPON5': '0.350', 'HITCOUNT': '0.640', 'WEAPON3': '0.650', 'weapon2': '1.208', 'weapon3': '2.106', 'DAMAGECOUNT': '2.448', 'FRAGCOUNT': '7.000'} [2023-02-24 18:26:13,311][177170] DAMAGECOUNT value on done: 111897.0 [2023-02-24 18:26:13,312][177170] Sum rewards: 9.681, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.436', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO5': '0.021', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon7': '0.078', 'AMMO3': '0.156', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon5': '0.168', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'ARMOR': '0.512', 'weapon2': '0.576', 'HITCOUNT': '0.750', 'WEAPON3': '0.950', 'weapon3': '2.694', 'DAMAGECOUNT': '3.228', 'FRAGCOUNT': '10.000'} [2023-02-24 18:26:13,332][177170] DAMAGECOUNT value on done: 101273.0 [2023-02-24 18:26:13,333][177170] Sum rewards: 7.586, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.900', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.017', 'weapon7': '0.052', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.186', 'WEAPON7': '0.200', 'weapon4': '0.302', 'WEAPON5': '0.450', 'HITCOUNT': '0.590', 'WEAPON3': '0.850', 'weapon2': '1.172', 'weapon3': '1.892', 'DAMAGECOUNT': '2.727', 'FRAGCOUNT': '8.000'} [2023-02-24 18:26:13,633][177170] DAMAGECOUNT value on done: 110783.0 [2023-02-24 18:26:13,633][177170] Sum rewards: 2.576, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.866', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.037', 'AMMO3': '0.049', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO4': '0.184', 'HITCOUNT': '0.230', 'WEAPON3': '0.350', 'WEAPON4': '0.350', 'weapon3': '0.602', 'weapon4': '0.768', 'ARMOR': '0.852', 'DAMAGECOUNT': '0.927', 'FRAGCOUNT': '2.000', 'weapon2': '2.106'} [2023-02-24 18:26:14,592][177158] DAMAGECOUNT value on done: 105238.0 [2023-02-24 18:26:14,593][177158] Sum rewards: 8.126, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.920', 'AMMO2': '0.017', 'AMMO5': '0.022', 'WEAPON1': '0.040', 'AMMO4': '0.084', 'weapon4': '0.106', 'AMMO3': '0.136', 'WEAPON4': '0.200', 'weapon5': '0.374', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'HITCOUNT': '0.810', 'weapon2': '0.952', 'weapon3': '2.144', 'DAMAGECOUNT': '3.111', 'FRAGCOUNT': '8.000'} [2023-02-24 18:26:14,881][177158] DAMAGECOUNT value on done: 104852.0 [2023-02-24 18:26:14,882][177158] Sum rewards: 5.707, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.544', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.044', 'ARMOR': '0.075', 'weapon7': '0.098', 'weapon5': '0.104', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON3': '0.350', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'HITCOUNT': '0.600', 'weapon3': '0.724', 'weapon4': '0.908', 'weapon2': '0.948', 'DAMAGECOUNT': '2.457', 'FRAGCOUNT': '6.000'} [2023-02-24 18:26:15,377][177158] DAMAGECOUNT value on done: 106586.0 [2023-02-24 18:26:15,377][177158] Sum rewards: 5.297, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.496', 'AMMO5': '0.013', 'AMMO2': '0.015', 'WEAPON1': '0.060', 'AMMO4': '0.077', 'AMMO3': '0.086', 'weapon5': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.240', 'WEAPON5': '0.250', 'HITCOUNT': '0.370', 'ARMOR': '0.501', 'WEAPON3': '0.600', 'weapon2': '0.856', 'DAMAGECOUNT': '1.863', 'weapon3': '1.914', 'FRAGCOUNT': '4.000'} [2023-02-24 18:26:15,458][177153] Updated weights for policy 0, policy_version 12980 (0.0009) [2023-02-24 18:26:15,674][177158] DAMAGECOUNT value on done: 109463.0 [2023-02-24 18:26:15,674][177158] Sum rewards: 9.605, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.805', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.034', 'WEAPON1': '0.050', 'weapon4': '0.056', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'weapon7': '0.114', 'weapon5': '0.148', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.430', 'ARMOR': '0.508', 'weapon3': '1.080', 'weapon2': '1.792', 'DAMAGECOUNT': '2.955', 'FRAGCOUNT': '7.000'} [2023-02-24 18:26:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13968.0). Total num frames: 53178368. Throughput: 0: 3491.2. Samples: 13295484. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:26:16,376][177119] Avg episode reward: [(0, '9.486')] [2023-02-24 18:26:16,834][177172] DAMAGECOUNT value on done: 107562.0 [2023-02-24 18:26:16,835][177172] Sum rewards: 9.862, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.196', 'AMMO2': '0.006', 'AMMO5': '0.011', 'AMMO4': '0.028', 'ARMOR': '0.036', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.085', 'weapon7': '0.096', 'weapon5': '0.098', 'weapon4': '0.194', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'HITCOUNT': '0.520', 'WEAPON3': '0.650', 'weapon2': '1.324', 'weapon3': '1.494', 'DAMAGECOUNT': '2.436', 'FRAGCOUNT': '9.000'} [2023-02-24 18:26:17,135][177172] DAMAGECOUNT value on done: 107123.0 [2023-02-24 18:26:17,135][177172] Sum rewards: 9.898, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.940', 'AMMO5': '0.012', 'AMMO2': '0.019', 'ARMOR': '0.024', 'WEAPON4': '0.050', 'WEAPON1': '0.090', 'AMMO4': '0.096', 'AMMO3': '0.108', 'weapon5': '0.254', 'weapon4': '0.284', 'WEAPON5': '0.400', 'HITCOUNT': '0.600', 'WEAPON3': '0.800', 'weapon2': '0.844', 'weapon3': '2.174', 'DAMAGECOUNT': '2.832', 'FRAGCOUNT': '9.000'} [2023-02-24 18:26:17,823][177154] DAMAGECOUNT value on done: 111949.0 [2023-02-24 18:26:17,824][177154] Sum rewards: 4.502, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.679', 'AMMO2': '0.011', 'AMMO5': '0.017', 'weapon4': '0.032', 'AMMO4': '0.057', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.135', 'weapon5': '0.182', 'WEAPON5': '0.350', 'HITCOUNT': '0.560', 'WEAPON3': '0.900', 'weapon2': '0.994', 'DAMAGECOUNT': '2.514', 'weapon3': '2.518', 'FRAGCOUNT': '6.000'} [2023-02-24 18:26:18,127][177154] DAMAGECOUNT value on done: 111842.0 [2023-02-24 18:26:18,127][177154] Sum rewards: 7.902, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.430', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.011', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.092', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.118', 'weapon4': '0.132', 'WEAPON5': '0.200', 'HITCOUNT': '0.710', 'WEAPON3': '0.750', 'weapon3': '1.698', 'weapon2': '1.902', 'DAMAGECOUNT': '3.072', 'FRAGCOUNT': '7.000'} [2023-02-24 18:26:18,298][177154] DAMAGECOUNT value on done: 110404.0 [2023-02-24 18:26:18,298][177154] Sum rewards: 3.287, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.489', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO2': '0.023', 'weapon5': '0.060', 'AMMO3': '0.100', 'AMMO4': '0.117', 'weapon7': '0.226', 'weapon4': '0.286', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'HITCOUNT': '0.310', 'AMMO6': '0.460', 'AMMO7': '0.460', 'ARMOR': '0.505', 'WEAPON3': '0.600', 'WEAPON7': '0.700', 'weapon2': '1.122', 'weapon3': '1.312', 'DAMAGECOUNT': '1.602', 'FRAGCOUNT': '2.000'} [2023-02-24 18:26:18,328][177172] DAMAGECOUNT value on done: 109692.0 [2023-02-24 18:26:18,329][177172] Sum rewards: 2.187, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.426', 'AMMO2': '0.005', 'AMMO5': '0.015', 'ARMOR': '0.024', 'AMMO4': '0.027', 'WEAPON1': '0.070', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.116', 'weapon5': '0.142', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.472', 'HITCOUNT': '0.620', 'WEAPON3': '0.750', 'weapon2': '1.252', 'weapon3': '1.642', 'DAMAGECOUNT': '2.328', 'FRAGCOUNT': '5.000'} [2023-02-24 18:26:18,395][177153] Updated weights for policy 0, policy_version 12990 (0.0009) [2023-02-24 18:26:18,595][177154] DAMAGECOUNT value on done: 113967.0 [2023-02-24 18:26:18,595][177154] Sum rewards: 10.860, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.740', 'AMMO2': '0.004', 'AMMO5': '0.011', 'AMMO4': '0.020', 'AMMO3': '0.040', 'weapon7': '0.052', 'weapon5': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.292', 'WEAPON3': '0.350', 'HITCOUNT': '0.410', 'ARMOR': '0.486', 'weapon3': '0.946', 'weapon2': '1.780', 'DAMAGECOUNT': '2.250', 'FRAGCOUNT': '7.000'} [2023-02-24 18:26:18,626][177172] DAMAGECOUNT value on done: 107218.0 [2023-02-24 18:26:18,627][177172] Sum rewards: 1.244, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.030', 'AMMO5': '0.017', 'ARMOR': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'weapon7': '0.096', 'weapon5': '0.126', 'AMMO3': '0.151', 'AMMO4': '0.165', 'WEAPON4': '0.200', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.472', 'weapon2': '0.578', 'HITCOUNT': '0.670', 'WEAPON3': '1.050', 'weapon3': '2.356', 'DAMAGECOUNT': '2.520', 'FRAGCOUNT': '5.500'} [2023-02-24 18:26:18,872][177171] DAMAGECOUNT value on done: 111039.0 [2023-02-24 18:26:18,872][177171] Sum rewards: 11.535, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.788', 'AMMO5': '0.012', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'weapon4': '0.052', 'WEAPON1': '0.090', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.113', 'weapon5': '0.244', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'HITCOUNT': '0.840', 'weapon2': '1.092', 'weapon3': '2.204', 'DAMAGECOUNT': '3.552', 'FRAGCOUNT': '10.000'} [2023-02-24 18:26:19,138][177157] DAMAGECOUNT value on done: 106007.0 [2023-02-24 18:26:19,139][177157] Sum rewards: 9.876, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.963', 'AMMO5': '0.020', 'AMMO2': '0.024', 'WEAPON1': '0.060', 'weapon7': '0.090', 'AMMO3': '0.100', 'AMMO4': '0.118', 'weapon5': '0.250', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'ARMOR': '0.432', 'WEAPON3': '0.650', 'weapon2': '0.748', 'weapon4': '0.770', 'HITCOUNT': '0.870', 'weapon3': '1.626', 'DAMAGECOUNT': '3.471', 'FRAGCOUNT': '7.500'} [2023-02-24 18:26:19,158][177157] DAMAGECOUNT value on done: 111257.0 [2023-02-24 18:26:19,159][177157] Sum rewards: 11.853, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.300', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.085', 'WEAPON4': '0.200', 'weapon5': '0.212', 'weapon4': '0.492', 'WEAPON5': '0.550', 'WEAPON3': '0.550', 'weapon2': '0.670', 'HITCOUNT': '0.820', 'weapon3': '1.480', 'DAMAGECOUNT': '3.030', 'FRAGCOUNT': '10.000'} [2023-02-24 18:26:19,169][177171] DAMAGECOUNT value on done: 107878.0 [2023-02-24 18:26:19,169][177171] Sum rewards: 7.836, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.728', 'AMMO5': '0.017', 'ARMOR': '0.028', 'AMMO2': '0.030', 'WEAPON1': '0.050', 'AMMO3': '0.094', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.151', 'weapon5': '0.166', 'WEAPON4': '0.350', 'weapon4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '0.800', 'weapon2': '1.032', 'weapon3': '1.986', 'DAMAGECOUNT': '2.859', 'FRAGCOUNT': '7.500'} [2023-02-24 18:26:19,278][177171] DAMAGECOUNT value on done: 105985.0 [2023-02-24 18:26:19,278][177171] Sum rewards: 7.727, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.130', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.029', 'weapon7': '0.050', 'AMMO3': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.143', 'WEAPON7': '0.200', 'weapon5': '0.206', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.492', 'WEAPON3': '0.750', 'HITCOUNT': '0.800', 'weapon2': '0.984', 'weapon3': '1.666', 'DAMAGECOUNT': '3.663', 'FRAGCOUNT': '7.000'} [2023-02-24 18:26:19,445][177157] DAMAGECOUNT value on done: 104404.0 [2023-02-24 18:26:19,446][177157] Sum rewards: 1.434, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.883', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'weapon5': '0.030', 'weapon7': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'weapon4': '0.518', 'DAMAGECOUNT': '0.525', 'FRAGCOUNT': '1.000', 'weapon2': '1.024', 'ARMOR': '1.355', 'weapon3': '1.510'} [2023-02-24 18:26:19,468][177157] DAMAGECOUNT value on done: 107050.0 [2023-02-24 18:26:19,469][177157] Sum rewards: 2.857, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.589', 'AMMO5': '0.015', 'AMMO2': '0.030', 'WEAPON1': '0.040', 'weapon7': '0.060', 'AMMO3': '0.107', 'weapon5': '0.114', 'AMMO4': '0.149', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon4': '0.190', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.420', 'WEAPON3': '0.700', 'weapon2': '1.208', 'DAMAGECOUNT': '1.731', 'weapon3': '1.862', 'FRAGCOUNT': '4.000'} [2023-02-24 18:26:19,562][177171] DAMAGECOUNT value on done: 102927.0 [2023-02-24 18:26:19,563][177171] Sum rewards: 14.831, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.106', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.013', 'weapon7': '0.064', 'AMMO4': '0.066', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.154', 'WEAPON5': '0.250', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.482', 'WEAPON3': '0.550', 'HITCOUNT': '0.840', 'weapon2': '0.894', 'weapon3': '1.562', 'DAMAGECOUNT': '4.455', 'FRAGCOUNT': '10.500'} [2023-02-24 18:26:20,188][177155] DAMAGECOUNT value on done: 108837.0 [2023-02-24 18:26:20,188][177155] Sum rewards: 8.964, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.472', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'weapon7': '0.020', 'AMMO2': '0.021', 'weapon5': '0.088', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.110', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.491', 'weapon4': '0.622', 'WEAPON3': '0.700', 'weapon2': '0.770', 'HITCOUNT': '0.840', 'weapon3': '1.734', 'DAMAGECOUNT': '3.051', 'FRAGCOUNT': '9.000'} [2023-02-24 18:26:20,484][177155] DAMAGECOUNT value on done: 113329.0 [2023-02-24 18:26:20,485][177155] Sum rewards: 7.216, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.878', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'weapon7': '0.056', 'AMMO4': '0.094', 'weapon5': '0.104', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'weapon4': '0.298', 'WEAPON5': '0.350', 'HITCOUNT': '0.730', 'WEAPON3': '0.850', 'weapon2': '1.558', 'weapon3': '1.750', 'DAMAGECOUNT': '3.093', 'FRAGCOUNT': '8.000'} [2023-02-24 18:26:20,791][177155] DAMAGECOUNT value on done: 111554.0 [2023-02-24 18:26:20,792][177155] Sum rewards: 14.517, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.698', 'AMMO2': '0.020', 'AMMO5': '0.021', 'AMMO3': '0.080', 'AMMO4': '0.098', 'weapon5': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon2': '0.676', 'weapon4': '0.704', 'ARMOR': '0.800', 'HITCOUNT': '0.900', 'weapon3': '1.870', 'DAMAGECOUNT': '4.647', 'FRAGCOUNT': '10.500'} [2023-02-24 18:26:21,075][177155] DAMAGECOUNT value on done: 105659.0 [2023-02-24 18:26:21,076][177155] Sum rewards: 14.013, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.080', 'ARMOR': '0.004', 'AMMO2': '0.015', 'AMMO5': '0.020', 'WEAPON1': '0.050', 'weapon7': '0.054', 'AMMO4': '0.073', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.130', 'AMMO3': '0.135', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.500', 'weapon2': '0.694', 'WEAPON3': '0.900', 'HITCOUNT': '0.990', 'weapon3': '2.210', 'DAMAGECOUNT': '3.978', 'FRAGCOUNT': '14.000'} [2023-02-24 18:26:21,323][177153] Updated weights for policy 0, policy_version 13000 (0.0008) [2023-02-24 18:26:21,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 53248000. Throughput: 0: 3492.1. Samples: 13305982. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:26:21,376][177119] Avg episode reward: [(0, '9.275')] [2023-02-24 18:26:24,251][177153] Updated weights for policy 0, policy_version 13010 (0.0009) [2023-02-24 18:26:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 53317632. Throughput: 0: 3494.5. Samples: 13327022. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:26:26,376][177119] Avg episode reward: [(0, '9.275')] [2023-02-24 18:26:26,636][177156] DAMAGECOUNT value on done: 107605.0 [2023-02-24 18:26:26,637][177156] Sum rewards: 5.581, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon7': '0.030', 'WEAPON1': '0.050', 'weapon5': '0.064', 'HEALTH': '0.074', 'AMMO3': '0.078', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.412', 'HITCOUNT': '0.490', 'WEAPON3': '0.500', 'ARMOR': '0.560', 'weapon2': '0.722', 'weapon3': '1.380', 'DAMAGECOUNT': '1.665', 'FRAGCOUNT': '3.000'} [2023-02-24 18:26:26,829][177156] DAMAGECOUNT value on done: 108162.0 [2023-02-24 18:26:26,830][177156] Sum rewards: 1.331, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.116', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'ARMOR': '0.024', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.100', 'weapon7': '0.102', 'AMMO3': '0.104', 'weapon5': '0.138', 'WEAPON5': '0.250', 'HITCOUNT': '0.360', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.550', 'weapon3': '1.444', 'DAMAGECOUNT': '1.581', 'weapon2': '1.866'} [2023-02-24 18:26:26,950][177156] DAMAGECOUNT value on done: 109691.0 [2023-02-24 18:26:26,950][177156] Sum rewards: 8.147, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.785', 'AMMO2': '0.006', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'weapon7': '0.054', 'AMMO3': '0.074', 'weapon5': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.432', 'WEAPON3': '0.450', 'ARMOR': '0.500', 'HITCOUNT': '0.550', 'weapon2': '0.806', 'weapon3': '1.178', 'DAMAGECOUNT': '2.334', 'FRAGCOUNT': '6.000'} [2023-02-24 18:26:27,147][177156] DAMAGECOUNT value on done: 106396.0 [2023-02-24 18:26:27,148][177156] Sum rewards: 7.285, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.988', 'AMMO2': '0.012', 'AMMO5': '0.022', 'AMMO4': '0.060', 'weapon7': '0.066', 'WEAPON1': '0.070', 'AMMO3': '0.123', 'weapon4': '0.180', 'weapon5': '0.198', 'WEAPON4': '0.200', 'AMMO6': '0.320', 'AMMO7': '0.320', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'WEAPON5': '0.450', 'HITCOUNT': '0.600', 'weapon2': '0.786', 'WEAPON3': '0.900', 'weapon3': '2.342', 'DAMAGECOUNT': '2.823', 'FRAGCOUNT': '8.000'} [2023-02-24 18:26:27,159][177153] Updated weights for policy 0, policy_version 13020 (0.0009) [2023-02-24 18:26:30,062][177153] Updated weights for policy 0, policy_version 13030 (0.0008) [2023-02-24 18:26:31,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 53387264. Throughput: 0: 3493.6. Samples: 13347988. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:26:31,376][177119] Avg episode reward: [(0, '9.178')] [2023-02-24 18:26:32,197][177170] DAMAGECOUNT value on done: 108469.0 [2023-02-24 18:26:32,197][177170] Sum rewards: 16.389, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.345', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO3': '0.085', 'AMMO4': '0.096', 'weapon7': '0.120', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.248', 'WEAPON7': '0.300', 'WEAPON3': '0.700', 'HITCOUNT': '0.800', 'weapon2': '1.542', 'weapon3': '1.784', 'DAMAGECOUNT': '3.519', 'FRAGCOUNT': '13.000'} [2023-02-24 18:26:32,492][177170] DAMAGECOUNT value on done: 112986.0 [2023-02-24 18:26:32,493][177170] Sum rewards: 15.348, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.410', 'AMMO5': '0.015', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO3': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.122', 'WEAPON7': '0.200', 'weapon5': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'WEAPON3': '0.400', 'weapon4': '0.552', 'HITCOUNT': '0.660', 'weapon2': '1.216', 'weapon3': '1.302', 'DAMAGECOUNT': '3.267', 'FRAGCOUNT': '12.000'} [2023-02-24 18:26:32,504][177170] DAMAGECOUNT value on done: 102263.0 [2023-02-24 18:26:32,505][177170] Sum rewards: 10.472, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.119', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.031', 'AMMO3': '0.040', 'weapon7': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.186', 'WEAPON7': '0.200', 'weapon4': '0.266', 'WEAPON5': '0.300', 'WEAPON3': '0.300', 'HITCOUNT': '0.420', 'ARMOR': '0.428', 'weapon3': '0.842', 'weapon2': '1.396', 'DAMAGECOUNT': '2.970', 'FRAGCOUNT': '6.500'} [2023-02-24 18:26:32,804][177170] DAMAGECOUNT value on done: 111414.0 [2023-02-24 18:26:32,805][177170] Sum rewards: 2.042, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.800', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.033', 'WEAPON1': '0.090', 'weapon7': '0.094', 'AMMO3': '0.132', 'AMMO4': '0.163', 'weapon5': '0.236', 'WEAPON4': '0.300', 'AMMO6': '0.360', 'AMMO7': '0.360', 'WEAPON7': '0.400', 'weapon4': '0.426', 'HITCOUNT': '0.490', 'WEAPON5': '0.650', 'weapon2': '0.778', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.893', 'weapon3': '2.008', 'FRAGCOUNT': '5.000'} [2023-02-24 18:26:32,970][177153] Updated weights for policy 0, policy_version 13040 (0.0008) [2023-02-24 18:26:33,835][177158] DAMAGECOUNT value on done: 106641.0 [2023-02-24 18:26:33,836][177158] Sum rewards: 12.237, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.915', 'AMMO2': '0.020', 'AMMO5': '0.024', 'WEAPON1': '0.050', 'weapon7': '0.052', 'weapon5': '0.076', 'AMMO4': '0.098', 'AMMO3': '0.133', 'WEAPON4': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'weapon4': '0.370', 'WEAPON5': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.950', 'weapon2': '0.998', 'HITCOUNT': '1.060', 'weapon3': '2.172', 'DAMAGECOUNT': '4.209', 'FRAGCOUNT': '12.000'} [2023-02-24 18:26:34,130][177158] DAMAGECOUNT value on done: 105671.0 [2023-02-24 18:26:34,131][177158] Sum rewards: 2.991, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.640', 'AMMO5': '0.017', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'AMMO4': '0.096', 'AMMO3': '0.127', 'weapon5': '0.210', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'HITCOUNT': '0.530', 'weapon2': '0.620', 'weapon4': '0.838', 'WEAPON3': '0.850', 'weapon3': '1.736', 'DAMAGECOUNT': '2.457', 'FRAGCOUNT': '6.000'} [2023-02-24 18:26:34,643][177158] DAMAGECOUNT value on done: 108413.0 [2023-02-24 18:26:34,644][177158] Sum rewards: 18.333, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.280', 'AMMO2': '0.009', 'AMMO5': '0.022', 'AMMO4': '0.047', 'WEAPON1': '0.050', 'AMMO3': '0.089', 'WEAPON4': '0.200', 'weapon5': '0.310', 'weapon4': '0.348', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.880', 'weapon2': '1.028', 'weapon3': '1.748', 'DAMAGECOUNT': '5.481', 'FRAGCOUNT': '15.000'} [2023-02-24 18:26:34,944][177158] DAMAGECOUNT value on done: 110394.0 [2023-02-24 18:26:34,945][177158] Sum rewards: 8.232, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.284', 'AMMO2': '0.016', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.081', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.100', 'AMMO3': '0.115', 'WEAPON4': '0.150', 'weapon5': '0.162', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'HITCOUNT': '0.790', 'weapon2': '1.408', 'weapon3': '2.004', 'DAMAGECOUNT': '2.793', 'FRAGCOUNT': '7.000'} [2023-02-24 18:26:35,892][177153] Updated weights for policy 0, policy_version 13050 (0.0008) [2023-02-24 18:26:36,113][177172] DAMAGECOUNT value on done: 108432.0 [2023-02-24 18:26:36,113][177172] Sum rewards: 8.847, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.310', 'weapon4': '0.002', 'AMMO2': '0.005', 'AMMO5': '0.017', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'WEAPON1': '0.080', 'AMMO3': '0.099', 'weapon5': '0.220', 'WEAPON5': '0.450', 'HITCOUNT': '0.500', 'WEAPON3': '0.650', 'weapon2': '1.560', 'weapon3': '1.888', 'DAMAGECOUNT': '2.610', 'FRAGCOUNT': '7.000'} [2023-02-24 18:26:36,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 53456896. Throughput: 0: 3494.2. Samples: 13358508. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:26:36,376][177119] Avg episode reward: [(0, '9.277')] [2023-02-24 18:26:36,416][177172] DAMAGECOUNT value on done: 107864.0 [2023-02-24 18:26:36,416][177172] Sum rewards: 4.246, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.170', 'AMMO2': '0.004', 'AMMO5': '0.020', 'AMMO4': '0.021', 'WEAPON1': '0.030', 'weapon5': '0.062', 'weapon7': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.121', 'WEAPON5': '0.350', 'HITCOUNT': '0.580', 'WEAPON3': '0.850', 'weapon2': '1.592', 'weapon3': '1.926', 'DAMAGECOUNT': '2.223', 'FRAGCOUNT': '4.000'} [2023-02-24 18:26:36,945][177154] DAMAGECOUNT value on done: 113066.0 [2023-02-24 18:26:36,946][177154] Sum rewards: 9.811, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.660', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'weapon5': '0.098', 'AMMO3': '0.104', 'AMMO4': '0.153', 'weapon7': '0.162', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon2': '0.392', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.700', 'HITCOUNT': '0.910', 'weapon4': '1.134', 'weapon3': '1.376', 'DAMAGECOUNT': '3.351', 'FRAGCOUNT': '9.500'} [2023-02-24 18:26:37,242][177154] DAMAGECOUNT value on done: 112294.0 [2023-02-24 18:26:37,242][177154] Sum rewards: 3.643, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.900', 'AMMO2': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.049', 'WEAPON1': '0.070', 'AMMO3': '0.075', 'weapon5': '0.096', 'weapon7': '0.106', 'WEAPON4': '0.150', 'weapon2': '0.156', 'HITCOUNT': '0.210', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.434', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.356', 'weapon3': '1.476', 'FRAGCOUNT': '4.000'} [2023-02-24 18:26:37,429][177154] DAMAGECOUNT value on done: 111543.0 [2023-02-24 18:26:37,430][177154] Sum rewards: 9.260, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.260', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.035', 'WEAPON1': '0.040', 'AMMO3': '0.056', 'weapon7': '0.100', 'weapon5': '0.124', 'WEAPON4': '0.150', 'weapon4': '0.214', 'WEAPON5': '0.300', 'AMMO6': '0.340', 'AMMO7': '0.340', 'HITCOUNT': '0.490', 'WEAPON3': '0.500', 'WEAPON7': '0.500', 'weapon3': '1.186', 'weapon2': '2.210', 'DAMAGECOUNT': '3.417', 'FRAGCOUNT': '5.000'} [2023-02-24 18:26:37,602][177172] DAMAGECOUNT value on done: 110833.0 [2023-02-24 18:26:37,603][177172] Sum rewards: 6.268, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.132', 'AMMO2': '0.025', 'AMMO5': '0.029', 'WEAPON1': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.130', 'WEAPON4': '0.200', 'weapon5': '0.234', 'weapon4': '0.246', 'WEAPON5': '0.650', 'HITCOUNT': '0.860', 'weapon2': '0.936', 'WEAPON3': '1.000', 'weapon3': '2.194', 'DAMAGECOUNT': '3.423', 'FRAGCOUNT': '8.000'} [2023-02-24 18:26:37,729][177154] DAMAGECOUNT value on done: 115153.0 [2023-02-24 18:26:37,729][177154] Sum rewards: 9.150, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.270', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.067', 'AMMO3': '0.094', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.280', 'WEAPON3': '0.500', 'HITCOUNT': '0.800', 'weapon2': '1.134', 'weapon3': '1.874', 'DAMAGECOUNT': '3.558', 'FRAGCOUNT': '8.000'} [2023-02-24 18:26:37,905][177172] DAMAGECOUNT value on done: 108170.0 [2023-02-24 18:26:37,905][177172] Sum rewards: 10.064, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.421', 'AMMO2': '0.012', 'AMMO5': '0.022', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO4': '0.060', 'AMMO3': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.270', 'ARMOR': '0.400', 'weapon4': '0.430', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.670', 'weapon3': '1.246', 'weapon2': '1.668', 'DAMAGECOUNT': '2.856', 'FRAGCOUNT': '8.000'} [2023-02-24 18:26:38,108][177171] DAMAGECOUNT value on done: 111486.0 [2023-02-24 18:26:38,109][177171] Sum rewards: 4.904, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.301', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'WEAPON1': '0.050', 'weapon7': '0.052', 'AMMO3': '0.066', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.134', 'WEAPON7': '0.200', 'weapon4': '0.244', 'WEAPON5': '0.250', 'HITCOUNT': '0.360', 'ARMOR': '0.512', 'WEAPON3': '0.550', 'weapon2': '1.190', 'DAMAGECOUNT': '1.341', 'weapon3': '1.410', 'FRAGCOUNT': '4.000'} [2023-02-24 18:26:38,407][177171] DAMAGECOUNT value on done: 108768.0 [2023-02-24 18:26:38,407][177171] Sum rewards: 6.669, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.700', 'AMMO2': '0.018', 'AMMO5': '0.019', 'WEAPON1': '0.030', 'AMMO4': '0.088', 'weapon5': '0.092', 'weapon7': '0.106', 'AMMO3': '0.110', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON4': '0.300', 'weapon4': '0.390', 'WEAPON7': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.650', 'HITCOUNT': '0.730', 'WEAPON3': '0.750', 'weapon3': '1.256', 'DAMAGECOUNT': '2.670', 'FRAGCOUNT': '5.000'} [2023-02-24 18:26:38,420][177157] DAMAGECOUNT value on done: 107031.0 [2023-02-24 18:26:38,421][177157] Sum rewards: 10.136, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.846', 'AMMO5': '0.010', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'AMMO3': '0.085', 'weapon7': '0.106', 'AMMO4': '0.119', 'weapon5': '0.146', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.378', 'AMMO6': '0.440', 'AMMO7': '0.440', 'WEAPON3': '0.600', 'WEAPON7': '0.600', 'HITCOUNT': '0.730', 'weapon2': '1.230', 'weapon3': '1.632', 'DAMAGECOUNT': '3.072', 'FRAGCOUNT': '9.000'} [2023-02-24 18:26:38,432][177157] DAMAGECOUNT value on done: 111597.0 [2023-02-24 18:26:38,432][177157] Sum rewards: 3.015, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.051', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.009', 'WEAPON1': '0.040', 'weapon7': '0.048', 'HITCOUNT': '0.060', 'AMMO3': '0.062', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.158', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.550', 'ARMOR': '0.572', 'DAMAGECOUNT': '1.020', 'weapon2': '1.206', 'weapon3': '1.446', 'FRAGCOUNT': '2.000'} [2023-02-24 18:26:38,471][177171] DAMAGECOUNT value on done: 107009.0 [2023-02-24 18:26:38,471][177171] Sum rewards: 8.878, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.386', 'AMMO5': '0.025', 'AMMO2': '0.038', 'WEAPON1': '0.050', 'AMMO3': '0.131', 'AMMO4': '0.188', 'weapon5': '0.218', 'WEAPON4': '0.350', 'ARMOR': '0.432', 'weapon2': '0.446', 'WEAPON5': '0.600', 'HITCOUNT': '0.810', 'weapon4': '0.822', 'WEAPON3': '0.900', 'weapon3': '1.932', 'DAMAGECOUNT': '3.072', 'FRAGCOUNT': '10.000'} [2023-02-24 18:26:38,737][177157] DAMAGECOUNT value on done: 105305.0 [2023-02-24 18:26:38,738][177157] Sum rewards: 8.614, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.270', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'ARMOR': '0.016', 'AMMO4': '0.038', 'weapon7': '0.092', 'weapon5': '0.094', 'AMMO3': '0.124', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.360', 'AMMO6': '0.420', 'AMMO7': '0.420', 'WEAPON7': '0.500', 'HITCOUNT': '0.590', 'WEAPON3': '0.850', 'weapon2': '1.262', 'weapon3': '1.792', 'DAMAGECOUNT': '2.703', 'FRAGCOUNT': '7.000'} [2023-02-24 18:26:38,748][177157] DAMAGECOUNT value on done: 108706.0 [2023-02-24 18:26:38,749][177157] Sum rewards: 13.668, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.208', 'AMMO2': '0.017', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.084', 'weapon5': '0.104', 'AMMO3': '0.136', 'weapon4': '0.148', 'WEAPON4': '0.200', 'weapon7': '0.204', 'AMMO6': '0.260', 'AMMO7': '0.260', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'ARMOR': '0.446', 'WEAPON3': '0.800', 'weapon2': '0.860', 'HITCOUNT': '1.080', 'weapon3': '2.072', 'DAMAGECOUNT': '4.968', 'FRAGCOUNT': '10.500'} [2023-02-24 18:26:38,779][177171] DAMAGECOUNT value on done: 103809.0 [2023-02-24 18:26:38,779][177171] Sum rewards: 7.212, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.364', 'AMMO2': '0.009', 'AMMO5': '0.022', 'ARMOR': '0.028', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'AMMO3': '0.083', 'WEAPON1': '0.100', 'weapon4': '0.104', 'weapon5': '0.402', 'WEAPON5': '0.600', 'HITCOUNT': '0.630', 'WEAPON3': '0.700', 'weapon2': '1.092', 'weapon3': '1.814', 'DAMAGECOUNT': '2.646', 'FRAGCOUNT': '7.000'} [2023-02-24 18:26:38,846][177153] Updated weights for policy 0, policy_version 13060 (0.0008) [2023-02-24 18:26:39,421][177155] DAMAGECOUNT value on done: 109752.0 [2023-02-24 18:26:39,422][177155] Sum rewards: 7.433, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.873', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'AMMO5': '0.022', 'AMMO4': '0.105', 'AMMO3': '0.106', 'weapon7': '0.106', 'weapon5': '0.214', 'WEAPON4': '0.300', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON5': '0.400', 'HITCOUNT': '0.550', 'weapon4': '0.630', 'WEAPON3': '0.650', 'ARMOR': '0.892', 'weapon2': '0.960', 'weapon3': '1.694', 'DAMAGECOUNT': '2.745', 'FRAGCOUNT': '7.000'} [2023-02-24 18:26:39,628][177154] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 18:26:39,709][177155] DAMAGECOUNT value on done: 114327.0 [2023-02-24 18:26:39,709][177155] Sum rewards: 9.163, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.782', 'AMMO2': '0.005', 'AMMO5': '0.017', 'AMMO4': '0.022', 'WEAPON1': '0.040', 'AMMO3': '0.076', 'WEAPON4': '0.150', 'weapon5': '0.254', 'weapon4': '0.312', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '0.550', 'weapon3': '1.388', 'weapon2': '1.636', 'DAMAGECOUNT': '2.994', 'FRAGCOUNT': '6.000'} [2023-02-24 18:26:40,017][177155] DAMAGECOUNT value on done: 112292.0 [2023-02-24 18:26:40,017][177155] Sum rewards: 7.643, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.059', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.071', 'weapon4': '0.084', 'weapon5': '0.112', 'WEAPON5': '0.250', 'HITCOUNT': '0.370', 'WEAPON3': '0.450', 'weapon3': '1.200', 'weapon2': '1.564', 'DAMAGECOUNT': '2.214', 'FRAGCOUNT': '5.000'} [2023-02-24 18:26:40,322][177155] DAMAGECOUNT value on done: 107011.0 [2023-02-24 18:26:40,322][177155] Sum rewards: 16.610, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.620', 'AMMO2': '0.011', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'weapon7': '0.054', 'AMMO4': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'weapon4': '0.140', 'weapon5': '0.190', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'HITCOUNT': '1.010', 'weapon2': '1.078', 'weapon3': '2.176', 'DAMAGECOUNT': '4.056', 'FRAGCOUNT': '15.000'} [2023-02-24 18:26:41,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 53526528. Throughput: 0: 3490.3. Samples: 13379336. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:26:41,376][177119] Avg episode reward: [(0, '9.023')] [2023-02-24 18:26:41,764][177153] Updated weights for policy 0, policy_version 13070 (0.0008) [2023-02-24 18:26:44,680][177153] Updated weights for policy 0, policy_version 13080 (0.0008) [2023-02-24 18:26:45,910][177156] DAMAGECOUNT value on done: 108476.0 [2023-02-24 18:26:45,911][177156] Sum rewards: 7.385, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.490', 'AMMO5': '0.018', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'weapon7': '0.050', 'AMMO3': '0.066', 'AMMO4': '0.097', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon2': '0.188', 'WEAPON7': '0.200', 'weapon5': '0.250', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'ARMOR': '0.464', 'WEAPON3': '0.500', 'HITCOUNT': '0.580', 'weapon3': '0.946', 'weapon4': '0.964', 'DAMAGECOUNT': '2.613', 'FRAGCOUNT': '6.000'} [2023-02-24 18:26:46,100][177156] DAMAGECOUNT value on done: 108597.0 [2023-02-24 18:26:46,100][177156] Sum rewards: 5.190, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.488', 'AMMO5': '0.020', 'AMMO2': '0.041', 'AMMO3': '0.054', 'WEAPON1': '0.060', 'WEAPON4': '0.150', 'AMMO4': '0.206', 'HITCOUNT': '0.300', 'weapon4': '0.304', 'WEAPON3': '0.350', 'weapon5': '0.392', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'weapon3': '1.226', 'DAMAGECOUNT': '1.305', 'weapon2': '1.620', 'FRAGCOUNT': '4.000'} [2023-02-24 18:26:46,218][177156] DAMAGECOUNT value on done: 109971.0 [2023-02-24 18:26:46,218][177156] Sum rewards: 0.991, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.960', 'AMMO2': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.035', 'AMMO3': '0.065', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.226', 'HITCOUNT': '0.270', 'weapon2': '0.390', 'WEAPON3': '0.450', 'ARMOR': '0.508', 'DAMAGECOUNT': '0.840', 'FRAGCOUNT': '1.000', 'weapon3': '1.072', 'weapon5': '1.898'} [2023-02-24 18:26:46,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 53596160. Throughput: 0: 3493.4. Samples: 13400408. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:26:46,376][177119] Avg episode reward: [(0, '8.809')] [2023-02-24 18:26:46,406][177156] DAMAGECOUNT value on done: 106650.0 [2023-02-24 18:26:46,406][177156] Sum rewards: 2.395, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.403', 'AMMO5': '0.005', 'AMMO2': '0.041', 'AMMO3': '0.047', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.203', 'HITCOUNT': '0.230', 'WEAPON3': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.410', 'ARMOR': '0.490', 'DAMAGECOUNT': '0.762', 'weapon3': '0.870', 'weapon2': '1.740', 'FRAGCOUNT': '2.000'} [2023-02-24 18:26:47,622][177153] Updated weights for policy 0, policy_version 13090 (0.0008) [2023-02-24 18:26:50,518][177153] Updated weights for policy 0, policy_version 13100 (0.0009) [2023-02-24 18:26:51,360][177170] DAMAGECOUNT value on done: 109365.0 [2023-02-24 18:26:51,360][177170] Sum rewards: 7.575, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.561', 'AMMO5': '0.010', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'weapon5': '0.064', 'AMMO3': '0.067', 'weapon7': '0.130', 'AMMO4': '0.139', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.340', 'WEAPON7': '0.400', 'ARMOR': '0.492', 'WEAPON3': '0.500', 'weapon4': '0.548', 'HITCOUNT': '0.550', 'weapon3': '1.110', 'DAMAGECOUNT': '2.688', 'FRAGCOUNT': '7.000'} [2023-02-24 18:26:51,381][177119] Fps is (10 sec: 13919.1, 60 sec: 13925.2, 300 sec: 13967.8). Total num frames: 53665792. Throughput: 0: 3493.8. Samples: 13410922. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:26:51,382][177119] Avg episode reward: [(0, '8.672')] [2023-02-24 18:26:51,655][177170] DAMAGECOUNT value on done: 113996.0 [2023-02-24 18:26:51,655][177170] Sum rewards: 11.465, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon7': '0.046', 'AMMO3': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'HEALTH': '0.190', 'weapon5': '0.222', 'weapon4': '0.242', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.730', 'weapon2': '1.032', 'weapon3': '1.552', 'DAMAGECOUNT': '3.030', 'FRAGCOUNT': '9.000'} [2023-02-24 18:26:51,724][177170] DAMAGECOUNT value on done: 103483.0 [2023-02-24 18:26:51,725][177170] Sum rewards: 5.602, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.460', 'AMMO5': '0.004', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'weapon5': '0.040', 'AMMO4': '0.045', 'weapon7': '0.048', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.218', 'weapon2': '0.222', 'WEAPON3': '0.450', 'HITCOUNT': '0.680', 'weapon3': '0.966', 'DAMAGECOUNT': '3.060', 'FRAGCOUNT': '5.000'} [2023-02-24 18:26:52,023][177170] DAMAGECOUNT value on done: 112620.0 [2023-02-24 18:26:52,024][177170] Sum rewards: 17.692, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.095', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'weapon7': '0.152', 'weapon4': '0.256', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON7': '0.500', 'WEAPON3': '0.500', 'HITCOUNT': '0.900', 'ARMOR': '0.913', 'weapon3': '1.370', 'weapon2': '2.032', 'DAMAGECOUNT': '3.618', 'FRAGCOUNT': '11.000'} [2023-02-24 18:26:52,974][177158] DAMAGECOUNT value on done: 107169.0 [2023-02-24 18:26:52,974][177158] Sum rewards: 7.942, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.148', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.024', 'AMMO3': '0.037', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'weapon7': '0.108', 'WEAPON5': '0.150', 'WEAPON3': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.330', 'weapon3': '0.560', 'DAMAGECOUNT': '1.584', 'weapon2': '3.020', 'FRAGCOUNT': '5.000'} [2023-02-24 18:26:53,271][177158] DAMAGECOUNT value on done: 106691.0 [2023-02-24 18:26:53,271][177158] Sum rewards: 10.227, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.791', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.012', 'WEAPON1': '0.060', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.222', 'weapon5': '0.286', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.590', 'weapon3': '1.486', 'weapon2': '1.498', 'DAMAGECOUNT': '3.060', 'FRAGCOUNT': '8.000'} [2023-02-24 18:26:53,493][177153] Updated weights for policy 0, policy_version 13110 (0.0008) [2023-02-24 18:26:53,776][177158] DAMAGECOUNT value on done: 109412.0 [2023-02-24 18:26:53,777][177158] Sum rewards: 11.199, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.810', 'AMMO2': '0.007', 'AMMO5': '0.020', 'AMMO4': '0.036', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.210', 'weapon5': '0.316', 'ARMOR': '0.455', 'WEAPON5': '0.600', 'HITCOUNT': '0.600', 'WEAPON3': '0.800', 'weapon2': '1.108', 'weapon3': '1.706', 'DAMAGECOUNT': '2.637', 'FRAGCOUNT': '11.000'} [2023-02-24 18:26:54,078][177158] DAMAGECOUNT value on done: 111306.0 [2023-02-24 18:26:54,079][177158] Sum rewards: 7.541, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.850', 'AMMO2': '0.008', 'AMMO5': '0.018', 'WEAPON1': '0.030', 'AMMO4': '0.042', 'weapon7': '0.062', 'AMMO3': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.154', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.660', 'weapon3': '1.790', 'weapon2': '1.802', 'DAMAGECOUNT': '2.736', 'FRAGCOUNT': '5.000'} [2023-02-24 18:26:55,335][177172] DAMAGECOUNT value on done: 108809.0 [2023-02-24 18:26:55,335][177172] Sum rewards: 2.936, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.272', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.035', 'weapon7': '0.054', 'AMMO4': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'weapon5': '0.232', 'WEAPON3': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.512', 'weapon3': '0.632', 'weapon2': '0.638', 'DAMAGECOUNT': '1.131', 'FRAGCOUNT': '3.000'} [2023-02-24 18:26:55,635][177172] DAMAGECOUNT value on done: 109949.0 [2023-02-24 18:26:55,635][177172] Sum rewards: 15.820, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.102', 'weapon7': '0.002', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.047', 'AMMO3': '0.083', 'weapon5': '0.196', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.237', 'WEAPON5': '0.350', 'ARMOR': '0.447', 'WEAPON3': '0.550', 'WEAPON4': '0.600', 'weapon4': '0.632', 'HITCOUNT': '0.990', 'weapon2': '1.180', 'weapon3': '1.468', 'DAMAGECOUNT': '6.255', 'FRAGCOUNT': '13.000'} [2023-02-24 18:26:56,136][177154] DAMAGECOUNT value on done: 113656.0 [2023-02-24 18:26:56,137][177154] Sum rewards: 8.638, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.820', 'AMMO2': '0.003', 'AMMO5': '0.006', 'AMMO4': '0.014', 'WEAPON1': '0.040', 'AMMO3': '0.051', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.102', 'WEAPON5': '0.200', 'HITCOUNT': '0.320', 'WEAPON3': '0.450', 'weapon3': '1.320', 'DAMAGECOUNT': '1.770', 'weapon2': '2.326', 'FRAGCOUNT': '5.500'} [2023-02-24 18:26:56,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 53735424. Throughput: 0: 3495.3. Samples: 13431904. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:26:56,376][177119] Avg episode reward: [(0, '8.623')] [2023-02-24 18:26:56,407][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000013120_53739520.pth... [2023-02-24 18:26:56,410][177153] Updated weights for policy 0, policy_version 13120 (0.0008) [2023-02-24 18:26:56,444][177154] DAMAGECOUNT value on done: 113282.0 [2023-02-24 18:26:56,445][177154] Sum rewards: 5.671, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.646', 'AMMO2': '0.025', 'AMMO5': '0.025', 'WEAPON1': '0.050', 'weapon7': '0.064', 'AMMO3': '0.083', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.124', 'WEAPON7': '0.200', 'weapon5': '0.210', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'ARMOR': '0.460', 'HITCOUNT': '0.550', 'WEAPON3': '0.600', 'weapon4': '0.780', 'weapon2': '0.878', 'weapon3': '1.464', 'DAMAGECOUNT': '2.964', 'FRAGCOUNT': '6.000'} [2023-02-24 18:26:56,466][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000012301_50384896.pth [2023-02-24 18:26:56,625][177154] DAMAGECOUNT value on done: 112437.0 [2023-02-24 18:26:56,625][177154] Sum rewards: -1.818, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.562', 'AMMO5': '0.016', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'AMMO4': '0.095', 'AMMO3': '0.167', 'weapon5': '0.188', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.606', 'HITCOUNT': '0.620', 'ARMOR': '0.924', 'weapon2': '0.934', 'WEAPON3': '0.950', 'weapon3': '1.652', 'DAMAGECOUNT': '2.682', 'FRAGCOUNT': '6.000'} [2023-02-24 18:26:56,825][177172] DAMAGECOUNT value on done: 111506.0 [2023-02-24 18:26:56,826][177172] Sum rewards: 2.710, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.250', 'AMMO5': '0.009', 'AMMO2': '0.017', 'ARMOR': '0.040', 'WEAPON1': '0.040', 'AMMO3': '0.085', 'AMMO4': '0.085', 'weapon7': '0.114', 'weapon5': '0.136', 'WEAPON4': '0.200', 'weapon4': '0.216', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'WEAPON7': '0.400', 'HITCOUNT': '0.470', 'WEAPON3': '0.600', 'weapon3': '1.486', 'weapon2': '1.812', 'DAMAGECOUNT': '2.019', 'FRAGCOUNT': '3.000'} [2023-02-24 18:26:56,924][177154] DAMAGECOUNT value on done: 116292.0 [2023-02-24 18:26:56,924][177154] Sum rewards: 3.924, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.252', 'weapon4': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.020', 'AMMO5': '0.022', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.139', 'weapon5': '0.224', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'weapon2': '0.908', 'HITCOUNT': '1.000', 'weapon3': '2.432', 'DAMAGECOUNT': '3.417', 'FRAGCOUNT': '5.000'} [2023-02-24 18:26:57,130][177172] DAMAGECOUNT value on done: 108992.0 [2023-02-24 18:26:57,131][177172] Sum rewards: 3.817, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.606', 'AMMO5': '0.014', 'AMMO2': '0.027', 'WEAPON1': '0.050', 'AMMO3': '0.075', 'weapon7': '0.116', 'AMMO4': '0.136', 'weapon5': '0.206', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.550', 'weapon2': '0.552', 'HITCOUNT': '0.560', 'weapon4': '0.708', 'ARMOR': '0.912', 'weapon3': '1.290', 'DAMAGECOUNT': '2.466', 'FRAGCOUNT': '5.000'} [2023-02-24 18:26:57,336][177171] DAMAGECOUNT value on done: 112009.0 [2023-02-24 18:26:57,336][177171] Sum rewards: 2.036, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.670', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'weapon7': '0.104', 'AMMO3': '0.105', 'weapon5': '0.112', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'HITCOUNT': '0.460', 'weapon4': '0.600', 'WEAPON3': '0.700', 'weapon2': '0.742', 'DAMAGECOUNT': '1.569', 'weapon3': '1.676', 'FRAGCOUNT': '4.000'} [2023-02-24 18:26:57,639][177171] DAMAGECOUNT value on done: 109814.0 [2023-02-24 18:26:57,639][177171] Sum rewards: 13.167, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.672', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'weapon7': '0.046', 'AMMO4': '0.066', 'AMMO3': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.164', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.508', 'WEAPON3': '0.650', 'HITCOUNT': '0.760', 'weapon2': '1.170', 'weapon3': '1.650', 'DAMAGECOUNT': '3.138', 'FRAGCOUNT': '10.000'} [2023-02-24 18:26:57,673][177157] DAMAGECOUNT value on done: 107999.0 [2023-02-24 18:26:57,674][177157] Sum rewards: 10.642, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.844', 'AMMO5': '0.010', 'AMMO2': '0.030', 'WEAPON1': '0.040', 'AMMO3': '0.103', 'weapon5': '0.128', 'WEAPON4': '0.150', 'AMMO4': '0.151', 'WEAPON5': '0.250', 'weapon4': '0.278', 'ARMOR': '0.404', 'WEAPON3': '0.700', 'HITCOUNT': '0.770', 'weapon2': '1.374', 'weapon3': '1.694', 'DAMAGECOUNT': '2.904', 'FRAGCOUNT': '10.000'} [2023-02-24 18:26:57,685][177157] DAMAGECOUNT value on done: 112615.0 [2023-02-24 18:26:57,685][177157] Sum rewards: 6.592, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.320', 'AMMO5': '0.019', 'AMMO2': '0.043', 'WEAPON1': '0.070', 'weapon4': '0.078', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'AMMO4': '0.214', 'weapon5': '0.406', 'HITCOUNT': '0.480', 'WEAPON5': '0.650', 'WEAPON3': '1.000', 'weapon2': '1.212', 'weapon3': '1.898', 'DAMAGECOUNT': '3.054', 'FRAGCOUNT': '7.000'} [2023-02-24 18:26:57,706][177171] DAMAGECOUNT value on done: 107938.0 [2023-02-24 18:26:57,706][177171] Sum rewards: 7.934, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.929', 'AMMO5': '0.015', 'AMMO2': '0.030', 'WEAPON1': '0.050', 'AMMO3': '0.130', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'weapon5': '0.320', 'weapon4': '0.372', 'ARMOR': '0.441', 'WEAPON5': '0.450', 'HITCOUNT': '0.610', 'weapon2': '0.760', 'WEAPON3': '0.850', 'weapon3': '1.946', 'DAMAGECOUNT': '2.787', 'FRAGCOUNT': '8.000'} [2023-02-24 18:26:57,984][177157] DAMAGECOUNT value on done: 106163.0 [2023-02-24 18:26:57,985][177157] Sum rewards: 12.107, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.160', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.083', 'AMMO3': '0.086', 'weapon7': '0.130', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.244', 'WEAPON7': '0.300', 'ARMOR': '0.412', 'WEAPON3': '0.550', 'HITCOUNT': '0.730', 'weapon3': '1.646', 'weapon2': '1.806', 'DAMAGECOUNT': '2.574', 'FRAGCOUNT': '9.000'} [2023-02-24 18:26:57,989][177171] DAMAGECOUNT value on done: 104465.0 [2023-02-24 18:26:57,990][177171] Sum rewards: 6.016, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.968', 'AMMO5': '0.010', 'AMMO2': '0.021', 'WEAPON1': '0.050', 'weapon7': '0.052', 'AMMO3': '0.070', 'AMMO4': '0.102', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.226', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.430', 'WEAPON3': '0.500', 'weapon4': '0.534', 'weapon2': '0.920', 'weapon3': '1.460', 'DAMAGECOUNT': '1.968', 'FRAGCOUNT': '6.000'} [2023-02-24 18:26:57,995][177157] DAMAGECOUNT value on done: 109905.0 [2023-02-24 18:26:57,996][177157] Sum rewards: 14.027, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.113', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.019', 'WEAPON1': '0.050', 'AMMO3': '0.061', 'AMMO4': '0.096', 'WEAPON4': '0.250', 'weapon5': '0.252', 'WEAPON3': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.542', 'weapon2': '0.694', 'HITCOUNT': '0.880', 'weapon3': '1.626', 'DAMAGECOUNT': '3.597', 'FRAGCOUNT': '9.000'} [2023-02-24 18:26:58,635][177155] DAMAGECOUNT value on done: 110733.0 [2023-02-24 18:26:58,635][177155] Sum rewards: 7.239, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.026', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO2': '0.041', 'weapon7': '0.050', 'AMMO3': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.205', 'weapon5': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'weapon2': '0.650', 'HITCOUNT': '0.690', 'weapon4': '0.714', 'weapon3': '1.236', 'DAMAGECOUNT': '2.943', 'FRAGCOUNT': '6.000'} [2023-02-24 18:26:58,941][177155] DAMAGECOUNT value on done: 115864.0 [2023-02-24 18:26:58,941][177155] Sum rewards: 16.281, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.929', 'AMMO5': '0.015', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'weapon5': '0.250', 'weapon4': '0.284', 'WEAPON5': '0.350', 'weapon2': '0.752', 'WEAPON3': '1.000', 'HITCOUNT': '1.040', 'weapon3': '2.188', 'DAMAGECOUNT': '4.611', 'FRAGCOUNT': '17.000'} [2023-02-24 18:26:59,252][177155] DAMAGECOUNT value on done: 113237.0 [2023-02-24 18:26:59,253][177155] Sum rewards: 6.299, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.015', 'AMMO2': '0.035', 'WEAPON1': '0.060', 'AMMO3': '0.112', 'AMMO4': '0.176', 'weapon5': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HEALTH': '0.314', 'ARMOR': '0.416', 'weapon4': '0.442', 'WEAPON3': '0.600', 'HITCOUNT': '0.630', 'weapon2': '1.130', 'weapon3': '1.748', 'DAMAGECOUNT': '2.835', 'FRAGCOUNT': '4.500'} [2023-02-24 18:26:59,349][177153] Updated weights for policy 0, policy_version 13130 (0.0008) [2023-02-24 18:26:59,549][177155] DAMAGECOUNT value on done: 108305.0 [2023-02-24 18:26:59,550][177155] Sum rewards: 9.897, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.880', 'AMMO2': '0.012', 'AMMO5': '0.026', 'weapon4': '0.044', 'AMMO4': '0.061', 'WEAPON1': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'weapon5': '0.360', 'WEAPON5': '0.650', 'WEAPON3': '0.700', 'HITCOUNT': '0.810', 'weapon2': '1.134', 'weapon3': '2.164', 'DAMAGECOUNT': '3.753', 'FRAGCOUNT': '9.000'} [2023-02-24 18:27:01,376][177119] Fps is (10 sec: 13933.8, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 53805056. Throughput: 0: 3495.6. Samples: 13452786. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:27:01,376][177119] Avg episode reward: [(0, '8.227')] [2023-02-24 18:27:02,259][177153] Updated weights for policy 0, policy_version 13140 (0.0009) [2023-02-24 18:27:05,213][177153] Updated weights for policy 0, policy_version 13150 (0.0008) [2023-02-24 18:27:05,245][177156] DAMAGECOUNT value on done: 109215.0 [2023-02-24 18:27:05,246][177156] Sum rewards: 9.828, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon7': '0.058', 'AMMO3': '0.060', 'AMMO4': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HEALTH': '0.296', 'WEAPON3': '0.350', 'weapon4': '0.404', 'HITCOUNT': '0.490', 'weapon3': '1.264', 'weapon2': '1.778', 'DAMAGECOUNT': '2.217', 'FRAGCOUNT': '7.000'} [2023-02-24 18:27:05,389][177156] DAMAGECOUNT value on done: 109519.0 [2023-02-24 18:27:05,390][177156] Sum rewards: 0.590, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.294', 'AMMO5': '0.014', 'AMMO2': '0.038', 'WEAPON1': '0.090', 'AMMO3': '0.144', 'AMMO4': '0.190', 'WEAPON4': '0.250', 'weapon5': '0.262', 'weapon4': '0.442', 'WEAPON5': '0.450', 'ARMOR': '0.451', 'HITCOUNT': '0.660', 'WEAPON3': '0.900', 'weapon2': '1.062', 'weapon3': '1.914', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.766'} [2023-02-24 18:27:05,554][177156] DAMAGECOUNT value on done: 110633.0 [2023-02-24 18:27:05,555][177156] Sum rewards: 2.699, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.470', 'AMMO5': '0.013', 'weapon7': '0.020', 'WEAPON1': '0.040', 'AMMO2': '0.043', 'weapon5': '0.062', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.137', 'AMMO4': '0.214', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon4': '0.484', 'HITCOUNT': '0.570', 'WEAPON3': '0.900', 'weapon2': '1.436', 'weapon3': '1.714', 'DAMAGECOUNT': '1.986', 'FRAGCOUNT': '5.000'} [2023-02-24 18:27:05,695][177156] DAMAGECOUNT value on done: 107731.0 [2023-02-24 18:27:05,696][177156] Sum rewards: 10.106, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.015', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO3': '0.060', 'AMMO4': '0.093', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.210', 'WEAPON4': '0.250', 'HEALTH': '0.314', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon4': '0.576', 'HITCOUNT': '0.610', 'weapon2': '0.774', 'weapon3': '1.324', 'DAMAGECOUNT': '3.243', 'FRAGCOUNT': '7.000'} [2023-02-24 18:27:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 53874688. Throughput: 0: 3494.7. Samples: 13463244. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 18:27:06,376][177119] Avg episode reward: [(0, '8.003')] [2023-02-24 18:27:08,147][177153] Updated weights for policy 0, policy_version 13160 (0.0008) [2023-02-24 18:27:10,628][177170] DAMAGECOUNT value on done: 111429.0 [2023-02-24 18:27:10,628][177170] Sum rewards: 15.403, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.590', 'AMMO5': '0.010', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'weapon5': '0.076', 'weapon7': '0.102', 'AMMO3': '0.117', 'AMMO4': '0.121', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'weapon4': '0.570', 'weapon2': '0.806', 'WEAPON3': '0.850', 'HITCOUNT': '0.910', 'weapon3': '1.734', 'DAMAGECOUNT': '4.692', 'FRAGCOUNT': '14.000'} [2023-02-24 18:27:10,916][177170] DAMAGECOUNT value on done: 115840.0 [2023-02-24 18:27:10,917][177170] Sum rewards: 9.166, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.462', 'AMMO2': '0.004', 'AMMO5': '0.012', 'AMMO4': '0.018', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.137', 'weapon5': '0.160', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.680', 'WEAPON3': '0.850', 'weapon2': '1.486', 'weapon3': '2.010', 'DAMAGECOUNT': '3.732', 'FRAGCOUNT': '9.000'} [2023-02-24 18:27:10,967][177170] DAMAGECOUNT value on done: 104944.0 [2023-02-24 18:27:10,968][177170] Sum rewards: 16.368, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.757', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'AMMO3': '0.074', 'AMMO4': '0.105', 'weapon5': '0.180', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'weapon2': '0.688', 'HITCOUNT': '0.930', 'weapon4': '0.958', 'weapon3': '1.626', 'DAMAGECOUNT': '4.383', 'FRAGCOUNT': '13.000'} [2023-02-24 18:27:11,096][177153] Updated weights for policy 0, policy_version 13170 (0.0009) [2023-02-24 18:27:11,269][177170] DAMAGECOUNT value on done: 113447.0 [2023-02-24 18:27:11,270][177170] Sum rewards: 4.472, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.146', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.043', 'AMMO3': '0.090', 'weapon5': '0.144', 'AMMO4': '0.217', 'WEAPON5': '0.250', 'AMMO6': '0.400', 'WEAPON7': '0.400', 'AMMO7': '0.400', 'ARMOR': '0.412', 'WEAPON4': '0.450', 'HITCOUNT': '0.590', 'WEAPON3': '0.600', 'weapon4': '0.690', 'weapon2': '0.694', 'weapon3': '1.278', 'DAMAGECOUNT': '2.418', 'FRAGCOUNT': '4.000'} [2023-02-24 18:27:11,376][177119] Fps is (10 sec: 13926.2, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 53944320. Throughput: 0: 3494.4. Samples: 13484272. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 18:27:11,376][177119] Avg episode reward: [(0, '8.093')] [2023-02-24 18:27:12,225][177158] DAMAGECOUNT value on done: 108361.0 [2023-02-24 18:27:12,226][177158] Sum rewards: 11.508, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.303', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.071', 'WEAPON1': '0.080', 'AMMO4': '0.112', 'weapon5': '0.350', 'WEAPON4': '0.400', 'HITCOUNT': '0.490', 'WEAPON3': '0.550', 'WEAPON5': '0.600', 'weapon4': '0.680', 'weapon3': '1.202', 'weapon2': '1.404', 'DAMAGECOUNT': '3.576', 'FRAGCOUNT': '10.000'} [2023-02-24 18:27:12,530][177158] DAMAGECOUNT value on done: 107386.0 [2023-02-24 18:27:12,531][177158] Sum rewards: 8.891, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.339', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.072', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'weapon7': '0.154', 'weapon5': '0.158', 'WEAPON5': '0.200', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'weapon4': '0.404', 'WEAPON3': '0.450', 'HITCOUNT': '0.500', 'weapon3': '1.136', 'weapon2': '1.754', 'DAMAGECOUNT': '2.085', 'FRAGCOUNT': '7.000'} [2023-02-24 18:27:13,024][177158] DAMAGECOUNT value on done: 110792.0 [2023-02-24 18:27:13,024][177158] Sum rewards: 13.720, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.242', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.034', 'weapon5': '0.090', 'AMMO3': '0.106', 'AMMO4': '0.169', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon2': '0.418', 'WEAPON3': '0.700', 'weapon4': '0.732', 'HITCOUNT': '0.980', 'weapon3': '2.100', 'DAMAGECOUNT': '4.140', 'FRAGCOUNT': '11.000'} [2023-02-24 18:27:13,322][177158] DAMAGECOUNT value on done: 112636.0 [2023-02-24 18:27:13,323][177158] Sum rewards: 5.443, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.020', 'AMMO5': '0.019', 'weapon4': '0.020', 'AMMO2': '0.021', 'weapon7': '0.048', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.109', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.196', 'WEAPON7': '0.200', 'HITCOUNT': '0.420', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'weapon2': '1.426', 'weapon3': '2.048', 'DAMAGECOUNT': '2.490', 'FRAGCOUNT': '6.000'} [2023-02-24 18:27:14,038][177153] Updated weights for policy 0, policy_version 13180 (0.0008) [2023-02-24 18:27:14,584][177172] DAMAGECOUNT value on done: 109628.0 [2023-02-24 18:27:14,585][177172] Sum rewards: 8.633, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.998', 'AMMO2': '0.011', 'AMMO5': '0.013', 'weapon7': '0.048', 'AMMO4': '0.054', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.136', 'weapon5': '0.178', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.630', 'WEAPON3': '0.950', 'weapon2': '1.370', 'weapon3': '2.032', 'DAMAGECOUNT': '2.457', 'FRAGCOUNT': '10.000'} [2023-02-24 18:27:14,882][177172] DAMAGECOUNT value on done: 111136.0 [2023-02-24 18:27:14,883][177172] Sum rewards: 12.048, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.569', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.081', 'weapon5': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.428', 'weapon2': '0.492', 'WEAPON3': '0.550', 'weapon4': '0.786', 'HITCOUNT': '0.890', 'weapon3': '1.498', 'DAMAGECOUNT': '3.561', 'FRAGCOUNT': '9.500'} [2023-02-24 18:27:15,313][177158] Large shaping reward 2.629 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.597, 199.0), ('weapon7', 0.002)] [2023-02-24 18:27:15,421][177154] DAMAGECOUNT value on done: 114806.0 [2023-02-24 18:27:15,421][177154] Sum rewards: 16.661, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.026', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'weapon4': '0.104', 'weapon5': '0.132', 'WEAPON5': '0.250', 'HEALTH': '0.341', 'WEAPON3': '0.450', 'HITCOUNT': '0.670', 'weapon3': '1.536', 'weapon2': '2.036', 'DAMAGECOUNT': '3.450', 'FRAGCOUNT': '12.000'} [2023-02-24 18:27:15,729][177154] DAMAGECOUNT value on done: 114620.0 [2023-02-24 18:27:15,729][177154] Sum rewards: 9.276, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.110', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.045', 'weapon5': '0.120', 'AMMO3': '0.133', 'AMMO4': '0.227', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'ARMOR': '0.404', 'weapon4': '0.726', 'WEAPON3': '0.850', 'HITCOUNT': '0.870', 'weapon2': '1.022', 'weapon3': '1.682', 'DAMAGECOUNT': '4.014', 'FRAGCOUNT': '7.000'} [2023-02-24 18:27:15,924][177154] DAMAGECOUNT value on done: 113264.0 [2023-02-24 18:27:15,924][177154] Sum rewards: 9.235, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.230', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.084', 'AMMO3': '0.094', 'weapon5': '0.132', 'WEAPON4': '0.250', 'weapon4': '0.294', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.560', 'weapon2': '1.058', 'weapon3': '1.600', 'DAMAGECOUNT': '2.481', 'FRAGCOUNT': '7.000'} [2023-02-24 18:27:16,057][177172] DAMAGECOUNT value on done: 111876.0 [2023-02-24 18:27:16,058][177172] Sum rewards: 3.987, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.310', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO3': '0.029', 'AMMO4': '0.039', 'weapon5': '0.046', 'weapon7': '0.054', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON3': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.250', 'weapon3': '0.268', 'weapon4': '0.354', 'weapon2': '0.496', 'DAMAGECOUNT': '1.110', 'FRAGCOUNT': '3.000'} [2023-02-24 18:27:16,221][177154] DAMAGECOUNT value on done: 117892.0 [2023-02-24 18:27:16,222][177154] Sum rewards: 3.930, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.773', 'AMMO2': '0.009', 'AMMO5': '0.012', 'AMMO4': '0.044', 'weapon7': '0.050', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'weapon5': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.154', 'WEAPON7': '0.200', 'weapon4': '0.290', 'WEAPON5': '0.350', 'HITCOUNT': '0.750', 'weapon2': '0.812', 'WEAPON3': '1.100', 'weapon3': '2.356', 'DAMAGECOUNT': '3.300', 'FRAGCOUNT': '8.000'} [2023-02-24 18:27:16,360][177172] DAMAGECOUNT value on done: 109657.0 [2023-02-24 18:27:16,360][177172] Sum rewards: 7.749, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.380', 'AMMO5': '0.006', 'WEAPON1': '0.030', 'AMMO2': '0.031', 'weapon7': '0.052', 'AMMO3': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'WEAPON4': '0.300', 'ARMOR': '0.474', 'weapon2': '0.514', 'WEAPON3': '0.550', 'HITCOUNT': '0.690', 'weapon4': '0.768', 'weapon3': '1.160', 'DAMAGECOUNT': '1.995', 'FRAGCOUNT': '6.000'} [2023-02-24 18:27:16,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 54013952. Throughput: 0: 3493.3. Samples: 13505188. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 18:27:16,376][177119] Avg episode reward: [(0, '8.327')] [2023-02-24 18:27:16,606][177171] DAMAGECOUNT value on done: 113342.0 [2023-02-24 18:27:16,606][177171] Sum rewards: 12.331, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.446', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'weapon5': '0.066', 'AMMO3': '0.134', 'AMMO4': '0.151', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.630', 'weapon2': '0.786', 'WEAPON3': '0.900', 'HITCOUNT': '1.110', 'weapon3': '2.184', 'DAMAGECOUNT': '3.999', 'FRAGCOUNT': '13.000'} [2023-02-24 18:27:16,827][177157] DAMAGECOUNT value on done: 109118.0 [2023-02-24 18:27:16,827][177157] Sum rewards: 10.503, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.628', 'AMMO5': '0.012', 'ARMOR': '0.024', 'WEAPON1': '0.030', 'AMMO2': '0.030', 'weapon5': '0.116', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'AMMO4': '0.152', 'weapon4': '0.218', 'WEAPON5': '0.300', 'HITCOUNT': '0.840', 'WEAPON3': '0.850', 'weapon2': '1.336', 'weapon3': '2.080', 'DAMAGECOUNT': '3.357', 'FRAGCOUNT': '9.000'} [2023-02-24 18:27:16,838][177157] DAMAGECOUNT value on done: 113373.0 [2023-02-24 18:27:16,838][177157] Sum rewards: 6.570, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.758', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'weapon7': '0.054', 'AMMO3': '0.060', 'AMMO4': '0.067', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.192', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'HITCOUNT': '0.360', 'WEAPON3': '0.450', 'weapon2': '0.902', 'weapon4': '0.960', 'weapon3': '1.076', 'DAMAGECOUNT': '2.274', 'FRAGCOUNT': '6.000'} [2023-02-24 18:27:16,903][177171] DAMAGECOUNT value on done: 111124.0 [2023-02-24 18:27:16,904][177171] Sum rewards: 11.079, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.926', 'AMMO5': '0.017', 'AMMO2': '0.024', 'WEAPON1': '0.050', 'AMMO4': '0.120', 'AMMO3': '0.130', 'weapon5': '0.164', 'WEAPON4': '0.250', 'weapon2': '0.324', 'WEAPON5': '0.350', 'weapon4': '0.704', 'HITCOUNT': '0.850', 'WEAPON3': '0.950', 'weapon3': '2.392', 'DAMAGECOUNT': '3.930', 'FRAGCOUNT': '11.000'} [2023-02-24 18:27:16,970][177153] Updated weights for policy 0, policy_version 13190 (0.0008) [2023-02-24 18:27:16,985][177171] DAMAGECOUNT value on done: 108709.0 [2023-02-24 18:27:16,986][177171] Sum rewards: 7.101, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.789', 'AMMO2': '0.012', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO3': '0.053', 'AMMO4': '0.059', 'weapon7': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.172', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'HITCOUNT': '0.510', 'weapon4': '0.688', 'ARMOR': '0.967', 'weapon2': '1.000', 'weapon3': '1.160', 'DAMAGECOUNT': '2.313', 'FRAGCOUNT': '4.000'} [2023-02-24 18:27:17,133][177157] DAMAGECOUNT value on done: 107166.0 [2023-02-24 18:27:17,133][177157] Sum rewards: 10.635, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.572', 'AMMO5': '0.013', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'AMMO4': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.144', 'WEAPON7': '0.200', 'weapon4': '0.250', 'WEAPON5': '0.400', 'ARMOR': '0.440', 'WEAPON3': '0.650', 'HITCOUNT': '0.680', 'weapon2': '1.608', 'weapon3': '1.662', 'DAMAGECOUNT': '3.009', 'FRAGCOUNT': '7.500'} [2023-02-24 18:27:17,144][177157] DAMAGECOUNT value on done: 110420.0 [2023-02-24 18:27:17,144][177157] Sum rewards: 5.627, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.222', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO3': '0.091', 'weapon5': '0.098', 'WEAPON4': '0.100', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.214', 'WEAPON5': '0.250', 'HITCOUNT': '0.360', 'WEAPON3': '0.500', 'ARMOR': '0.955', 'weapon2': '1.330', 'DAMAGECOUNT': '1.545', 'weapon3': '2.026', 'FRAGCOUNT': '3.000'} [2023-02-24 18:27:17,277][177171] DAMAGECOUNT value on done: 105862.0 [2023-02-24 18:27:17,277][177171] Sum rewards: 12.721, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.444', 'weapon7': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.029', 'WEAPON1': '0.040', 'AMMO3': '0.144', 'AMMO4': '0.146', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.424', 'weapon2': '0.708', 'WEAPON3': '0.850', 'HITCOUNT': '1.060', 'weapon3': '2.134', 'DAMAGECOUNT': '4.191', 'FRAGCOUNT': '12.000'} [2023-02-24 18:27:17,847][177155] DAMAGECOUNT value on done: 111433.0 [2023-02-24 18:27:17,848][177155] Sum rewards: 12.615, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.172', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'weapon7': '0.052', 'AMMO3': '0.067', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.194', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.318', 'WEAPON3': '0.400', 'HITCOUNT': '0.570', 'weapon3': '1.378', 'weapon2': '1.810', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '8.000'} [2023-02-24 18:27:18,143][177155] DAMAGECOUNT value on done: 116725.0 [2023-02-24 18:27:18,144][177155] Sum rewards: 5.873, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.225', 'AMMO5': '0.008', 'WEAPON1': '0.030', 'weapon7': '0.056', 'AMMO3': '0.059', 'AMMO2': '0.059', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.200', 'weapon5': '0.222', 'AMMO4': '0.297', 'WEAPON3': '0.400', 'ARMOR': '0.430', 'HITCOUNT': '0.490', 'WEAPON4': '0.500', 'weapon2': '0.828', 'weapon3': '0.990', 'weapon4': '1.146', 'DAMAGECOUNT': '2.583', 'FRAGCOUNT': '6.000'} [2023-02-24 18:27:18,456][177155] DAMAGECOUNT value on done: 113644.0 [2023-02-24 18:27:18,456][177155] Sum rewards: 4.137, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.650', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'ARMOR': '0.024', 'weapon7': '0.054', 'AMMO3': '0.062', 'weapon5': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.230', 'WEAPON3': '0.450', 'weapon4': '0.586', 'weapon2': '0.708', 'weapon3': '0.792', 'DAMAGECOUNT': '1.221', 'FRAGCOUNT': '5.000'} [2023-02-24 18:27:18,756][177155] DAMAGECOUNT value on done: 108645.0 [2023-02-24 18:27:18,757][177155] Sum rewards: 2.860, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.100', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.010', 'WEAPON1': '0.050', 'AMMO3': '0.059', 'WEAPON4': '0.100', 'weapon4': '0.206', 'HITCOUNT': '0.220', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'ARMOR': '0.690', 'weapon2': '0.802', 'weapon3': '0.886', 'DAMAGECOUNT': '1.020', 'weapon5': '1.788', 'FRAGCOUNT': '2.000'} [2023-02-24 18:27:19,902][177153] Updated weights for policy 0, policy_version 13200 (0.0008) [2023-02-24 18:27:21,376][177119] Fps is (10 sec: 14336.0, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 54087680. Throughput: 0: 3493.0. Samples: 13515692. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:27:21,376][177119] Avg episode reward: [(0, '8.492')] [2023-02-24 18:27:22,808][177153] Updated weights for policy 0, policy_version 13210 (0.0008) [2023-02-24 18:27:24,507][177156] DAMAGECOUNT value on done: 109643.0 [2023-02-24 18:27:24,508][177156] Sum rewards: 5.851, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.612', 'AMMO5': '0.015', 'ARMOR': '0.024', 'AMMO2': '0.032', 'weapon7': '0.052', 'WEAPON1': '0.060', 'AMMO3': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.158', 'weapon5': '0.174', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.610', 'weapon3': '1.052', 'DAMAGECOUNT': '1.284', 'weapon2': '1.440', 'FRAGCOUNT': '7.000'} [2023-02-24 18:27:24,658][177156] DAMAGECOUNT value on done: 110199.0 [2023-02-24 18:27:24,659][177156] Sum rewards: 3.188, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.068', 'AMMO5': '0.009', 'AMMO2': '0.018', 'ARMOR': '0.024', 'WEAPON1': '0.040', 'weapon7': '0.052', 'weapon5': '0.058', 'AMMO3': '0.066', 'AMMO4': '0.087', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'HITCOUNT': '0.570', 'weapon2': '0.584', 'weapon4': '0.626', 'weapon3': '1.392', 'DAMAGECOUNT': '2.040', 'FRAGCOUNT': '4.000'} [2023-02-24 18:27:24,805][177156] DAMAGECOUNT value on done: 111552.0 [2023-02-24 18:27:24,806][177156] Sum rewards: 7.685, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.825', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.060', 'weapon7': '0.096', 'AMMO4': '0.106', 'weapon5': '0.124', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.640', 'weapon4': '0.730', 'weapon2': '1.264', 'weapon3': '1.456', 'DAMAGECOUNT': '2.757', 'FRAGCOUNT': '7.000'} [2023-02-24 18:27:24,961][177156] DAMAGECOUNT value on done: 108409.0 [2023-02-24 18:27:24,961][177156] Sum rewards: 4.811, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.896', 'AMMO5': '0.009', 'WEAPON1': '0.040', 'weapon5': '0.048', 'AMMO2': '0.048', 'ARMOR': '0.080', 'AMMO3': '0.092', 'weapon7': '0.136', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'AMMO4': '0.240', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'HITCOUNT': '0.440', 'WEAPON3': '0.650', 'weapon2': '0.670', 'weapon4': '0.928', 'weapon3': '1.252', 'DAMAGECOUNT': '2.034', 'FRAGCOUNT': '6.000'} [2023-02-24 18:27:25,764][177153] Updated weights for policy 0, policy_version 13220 (0.0008) [2023-02-24 18:27:26,376][177119] Fps is (10 sec: 14335.9, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 54157312. Throughput: 0: 3495.9. Samples: 13536650. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:27:26,376][177119] Avg episode reward: [(0, '8.261')] [2023-02-24 18:27:28,671][177153] Updated weights for policy 0, policy_version 13230 (0.0008) [2023-02-24 18:27:29,812][177170] DAMAGECOUNT value on done: 112218.0 [2023-02-24 18:27:29,812][177170] Sum rewards: 8.984, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.630', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.032', 'WEAPON1': '0.040', 'weapon7': '0.054', 'AMMO3': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.159', 'weapon5': '0.182', 'WEAPON5': '0.250', 'weapon4': '0.450', 'HITCOUNT': '0.530', 'WEAPON3': '0.550', 'weapon3': '1.212', 'weapon2': '1.550', 'DAMAGECOUNT': '2.367', 'FRAGCOUNT': '7.000'} [2023-02-24 18:27:30,103][177170] DAMAGECOUNT value on done: 117350.0 [2023-02-24 18:27:30,104][177170] Sum rewards: 9.055, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.823', 'AMMO5': '0.015', 'AMMO2': '0.026', 'WEAPON1': '0.060', 'AMMO3': '0.097', 'weapon5': '0.122', 'AMMO4': '0.129', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '0.700', 'weapon4': '0.724', 'weapon2': '0.732', 'HITCOUNT': '1.180', 'weapon3': '1.962', 'DAMAGECOUNT': '4.530', 'FRAGCOUNT': '9.000'} [2023-02-24 18:27:30,198][177170] DAMAGECOUNT value on done: 105888.0 [2023-02-24 18:27:30,199][177170] Sum rewards: 6.288, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.315', 'AMMO2': '0.011', 'AMMO5': '0.017', 'ARMOR': '0.024', 'AMMO4': '0.056', 'WEAPON1': '0.060', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.146', 'weapon5': '0.210', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'HITCOUNT': '0.580', 'weapon2': '1.586', 'weapon3': '1.710', 'DAMAGECOUNT': '2.832', 'FRAGCOUNT': '3.500'} [2023-02-24 18:27:30,492][177170] DAMAGECOUNT value on done: 114212.0 [2023-02-24 18:27:30,493][177170] Sum rewards: 7.758, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.708', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO3': '0.040', 'weapon7': '0.058', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.600', 'weapon4': '0.608', 'weapon2': '0.618', 'weapon3': '0.862', 'DAMAGECOUNT': '2.295', 'FRAGCOUNT': '7.000'} [2023-02-24 18:27:31,344][177158] DAMAGECOUNT value on done: 108811.0 [2023-02-24 18:27:31,345][177158] Sum rewards: 7.051, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.009', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'AMMO3': '0.040', 'weapon7': '0.060', 'weapon5': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.131', 'HEALTH': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.370', 'weapon4': '0.392', 'ARMOR': '0.408', 'weapon3': '1.028', 'DAMAGECOUNT': '1.350', 'weapon2': '2.058', 'FRAGCOUNT': '3.000'} [2023-02-24 18:27:31,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 54226944. Throughput: 0: 3494.8. Samples: 13557676. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:27:31,376][177119] Avg episode reward: [(0, '8.265')] [2023-02-24 18:27:31,598][177153] Updated weights for policy 0, policy_version 13240 (0.0008) [2023-02-24 18:27:31,635][177158] DAMAGECOUNT value on done: 108541.0 [2023-02-24 18:27:31,635][177158] Sum rewards: 17.399, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'HEALTH': '0.025', 'AMMO2': '0.029', 'weapon7': '0.064', 'AMMO3': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.120', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.550', 'weapon4': '0.588', 'HITCOUNT': '0.920', 'weapon2': '1.388', 'weapon3': '1.524', 'DAMAGECOUNT': '3.465', 'FRAGCOUNT': '13.000'} [2023-02-24 18:27:32,220][177158] DAMAGECOUNT value on done: 112053.0 [2023-02-24 18:27:32,220][177158] Sum rewards: 12.039, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.806', 'AMMO5': '0.007', 'AMMO2': '0.030', 'ARMOR': '0.044', 'WEAPON1': '0.060', 'AMMO3': '0.079', 'weapon7': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.151', 'weapon5': '0.176', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'WEAPON4': '0.600', 'HITCOUNT': '0.630', 'weapon2': '0.784', 'weapon3': '1.024', 'weapon4': '1.200', 'DAMAGECOUNT': '3.783', 'FRAGCOUNT': '10.000'} [2023-02-24 18:27:32,521][177158] DAMAGECOUNT value on done: 113848.0 [2023-02-24 18:27:32,522][177158] Sum rewards: 7.401, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.525', 'AMMO5': '0.010', 'AMMO2': '0.026', 'WEAPON1': '0.060', 'weapon7': '0.096', 'AMMO3': '0.120', 'AMMO4': '0.132', 'weapon5': '0.140', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'ARMOR': '0.459', 'weapon4': '0.538', 'WEAPON3': '0.800', 'weapon2': '0.828', 'HITCOUNT': '0.920', 'weapon3': '1.880', 'DAMAGECOUNT': '3.636', 'FRAGCOUNT': '6.000'} [2023-02-24 18:27:33,106][177157] Large shaping reward 2.616 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.006, -2.0), ('weapon5', 0.002)] [2023-02-24 18:27:33,726][177172] DAMAGECOUNT value on done: 110800.0 [2023-02-24 18:27:33,727][177172] Sum rewards: 10.761, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.000', 'AMMO2': '0.010', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO4': '0.050', 'AMMO3': '0.080', 'weapon5': '0.278', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.700', 'weapon3': '1.486', 'weapon2': '1.992', 'DAMAGECOUNT': '3.516', 'FRAGCOUNT': '8.000'} [2023-02-24 18:27:34,027][177172] DAMAGECOUNT value on done: 111744.0 [2023-02-24 18:27:34,027][177172] Sum rewards: 4.033, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.054', 'AMMO5': '0.012', 'ARMOR': '0.024', 'WEAPON1': '0.040', 'AMMO2': '0.050', 'AMMO3': '0.072', 'weapon7': '0.072', 'weapon5': '0.076', 'AMMO4': '0.252', 'WEAPON5': '0.300', 'AMMO6': '0.420', 'AMMO7': '0.420', 'weapon2': '0.488', 'WEAPON3': '0.500', 'WEAPON7': '0.500', 'HITCOUNT': '0.680', 'WEAPON4': '0.700', 'weapon4': '1.020', 'weapon3': '1.136', 'DAMAGECOUNT': '1.824', 'FRAGCOUNT': '5.000'} [2023-02-24 18:27:34,522][177153] Updated weights for policy 0, policy_version 13250 (0.0008) [2023-02-24 18:27:34,630][177154] DAMAGECOUNT value on done: 115841.0 [2023-02-24 18:27:34,631][177154] Sum rewards: 7.952, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.827', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.042', 'WEAPON1': '0.060', 'AMMO3': '0.110', 'WEAPON4': '0.200', 'weapon5': '0.210', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon4': '0.402', 'WEAPON3': '0.750', 'HITCOUNT': '0.790', 'weapon2': '0.892', 'weapon3': '1.950', 'DAMAGECOUNT': '3.105', 'FRAGCOUNT': '7.000'} [2023-02-24 18:27:34,926][177154] DAMAGECOUNT value on done: 115923.0 [2023-02-24 18:27:34,926][177154] Sum rewards: 12.213, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.676', 'AMMO2': '0.010', 'AMMO5': '0.017', 'weapon7': '0.046', 'WEAPON1': '0.050', 'AMMO4': '0.051', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.132', 'AMMO3': '0.141', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'ARMOR': '0.442', 'WEAPON3': '0.700', 'HITCOUNT': '0.740', 'weapon4': '0.768', 'weapon2': '0.806', 'weapon3': '1.286', 'DAMAGECOUNT': '3.909', 'FRAGCOUNT': '11.000'} [2023-02-24 18:27:35,181][177154] DAMAGECOUNT value on done: 114217.0 [2023-02-24 18:27:35,181][177154] Sum rewards: 5.618, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.810', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'AMMO4': '0.071', 'weapon7': '0.126', 'weapon5': '0.148', 'WEAPON5': '0.200', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'weapon4': '0.452', 'WEAPON7': '0.500', 'HITCOUNT': '0.680', 'weapon3': '1.236', 'weapon2': '1.562', 'DAMAGECOUNT': '2.859', 'FRAGCOUNT': '4.000'} [2023-02-24 18:27:35,199][177172] DAMAGECOUNT value on done: 112822.0 [2023-02-24 18:27:35,199][177172] Sum rewards: 6.337, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.858', 'AMMO5': '0.012', 'ARMOR': '0.020', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'weapon7': '0.068', 'AMMO3': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.138', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.260', 'weapon5': '0.280', 'WEAPON3': '0.650', 'HITCOUNT': '0.670', 'weapon2': '1.190', 'weapon3': '1.850', 'DAMAGECOUNT': '2.838', 'FRAGCOUNT': '6.500'} [2023-02-24 18:27:35,482][177154] DAMAGECOUNT value on done: 118769.0 [2023-02-24 18:27:35,482][177154] Sum rewards: 9.218, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.560', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.024', 'weapon4': '0.036', 'WEAPON1': '0.040', 'weapon5': '0.060', 'weapon7': '0.068', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.122', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.480', 'WEAPON3': '0.700', 'weapon2': '1.664', 'weapon3': '1.950', 'DAMAGECOUNT': '2.631', 'FRAGCOUNT': '8.000'} [2023-02-24 18:27:35,501][177172] DAMAGECOUNT value on done: 111048.0 [2023-02-24 18:27:35,502][177172] Sum rewards: 8.540, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.237', 'AMMO5': '0.015', 'AMMO2': '0.020', 'ARMOR': '0.024', 'WEAPON1': '0.040', 'weapon7': '0.066', 'AMMO4': '0.102', 'AMMO3': '0.115', 'weapon5': '0.186', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON4': '0.400', 'WEAPON7': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'weapon4': '0.882', 'HITCOUNT': '0.980', 'weapon3': '1.170', 'weapon2': '1.314', 'DAMAGECOUNT': '4.173', 'FRAGCOUNT': '6.500'} [2023-02-24 18:27:35,830][177171] DAMAGECOUNT value on done: 115191.0 [2023-02-24 18:27:35,830][177171] Sum rewards: 23.161, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.514', 'AMMO2': '0.016', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.079', 'AMMO3': '0.134', 'WEAPON4': '0.200', 'weapon5': '0.260', 'WEAPON5': '0.400', 'weapon2': '0.500', 'weapon4': '0.584', 'WEAPON3': '0.850', 'HITCOUNT': '1.270', 'weapon3': '2.038', 'DAMAGECOUNT': '5.547', 'FRAGCOUNT': '20.000'} [2023-02-24 18:27:36,067][177157] DAMAGECOUNT value on done: 113785.0 [2023-02-24 18:27:36,067][177157] Sum rewards: 5.417, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.348', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'AMMO4': '0.046', 'weapon5': '0.046', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.264', 'WEAPON3': '0.300', 'HITCOUNT': '0.400', 'weapon2': '0.662', 'weapon3': '0.750', 'ARMOR': '1.039', 'DAMAGECOUNT': '1.236', 'FRAGCOUNT': '3.000'} [2023-02-24 18:27:36,079][177157] DAMAGECOUNT value on done: 109763.0 [2023-02-24 18:27:36,079][177157] Sum rewards: -1.307, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.898', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'AMMO3': '0.155', 'WEAPON4': '0.250', 'weapon2': '0.334', 'weapon4': '0.380', 'ARMOR': '0.400', 'HITCOUNT': '0.610', 'WEAPON3': '1.000', 'weapon3': '1.516', 'DAMAGECOUNT': '1.935', 'FRAGCOUNT': '5.000'} [2023-02-24 18:27:36,126][177171] DAMAGECOUNT value on done: 111889.0 [2023-02-24 18:27:36,126][177171] Sum rewards: 9.493, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.766', 'AMMO5': '0.008', 'AMMO2': '0.017', 'WEAPON1': '0.060', 'weapon7': '0.066', 'AMMO3': '0.078', 'AMMO4': '0.085', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.180', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.470', 'WEAPON3': '0.500', 'weapon3': '1.590', 'weapon2': '1.920', 'DAMAGECOUNT': '2.295', 'FRAGCOUNT': '6.000'} [2023-02-24 18:27:36,196][177171] DAMAGECOUNT value on done: 109853.0 [2023-02-24 18:27:36,196][177171] Sum rewards: 9.753, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.446', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon7': '0.052', 'WEAPON1': '0.070', 'AMMO3': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.148', 'WEAPON7': '0.200', 'AMMO4': '0.205', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon4': '0.612', 'WEAPON3': '0.800', 'HITCOUNT': '0.820', 'weapon2': '0.836', 'weapon3': '1.860', 'DAMAGECOUNT': '3.432', 'FRAGCOUNT': '10.000'} [2023-02-24 18:27:36,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 54296576. Throughput: 0: 3494.9. Samples: 13568176. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:27:36,376][177119] Avg episode reward: [(0, '8.386')] [2023-02-24 18:27:36,388][177157] DAMAGECOUNT value on done: 110991.0 [2023-02-24 18:27:36,389][177157] Sum rewards: 6.732, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.385', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.040', 'AMMO4': '0.117', 'weapon5': '0.144', 'WEAPON5': '0.150', 'weapon7': '0.174', 'WEAPON4': '0.200', 'WEAPON3': '0.250', 'AMMO6': '0.340', 'AMMO7': '0.340', 'HITCOUNT': '0.380', 'weapon4': '0.466', 'WEAPON7': '0.500', 'weapon3': '0.938', 'DAMAGECOUNT': '1.713', 'weapon2': '2.056', 'FRAGCOUNT': '3.000'} [2023-02-24 18:27:36,399][177157] DAMAGECOUNT value on done: 108534.0 [2023-02-24 18:27:36,400][177157] Sum rewards: 11.625, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.382', 'AMMO5': '0.017', 'AMMO2': '0.018', 'weapon7': '0.038', 'WEAPON1': '0.050', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.168', 'WEAPON7': '0.200', 'weapon4': '0.202', 'WEAPON5': '0.400', 'ARMOR': '0.490', 'WEAPON3': '0.750', 'weapon2': '0.750', 'HITCOUNT': '0.880', 'weapon3': '2.320', 'DAMAGECOUNT': '3.924', 'FRAGCOUNT': '8.000'} [2023-02-24 18:27:36,495][177171] DAMAGECOUNT value on done: 106292.0 [2023-02-24 18:27:36,495][177171] Sum rewards: 4.942, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.135', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO3': '0.055', 'weapon7': '0.062', 'AMMO4': '0.089', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'HITCOUNT': '0.360', 'WEAPON3': '0.400', 'weapon4': '0.568', 'weapon2': '1.012', 'weapon3': '1.126', 'DAMAGECOUNT': '1.290', 'FRAGCOUNT': '3.000'} [2023-02-24 18:27:37,123][177155] DAMAGECOUNT value on done: 112777.0 [2023-02-24 18:27:37,123][177155] Sum rewards: 7.736, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.873', 'AMMO2': '0.016', 'AMMO5': '0.021', 'weapon7': '0.058', 'WEAPON1': '0.060', 'AMMO4': '0.079', 'AMMO3': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.154', 'weapon5': '0.156', 'ARMOR': '0.404', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.850', 'weapon2': '1.432', 'weapon3': '1.900', 'DAMAGECOUNT': '4.032', 'FRAGCOUNT': '6.000'} [2023-02-24 18:27:37,415][177155] DAMAGECOUNT value on done: 117901.0 [2023-02-24 18:27:37,415][177155] Sum rewards: 8.700, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.333', 'AMMO2': '0.013', 'AMMO5': '0.013', 'WEAPON1': '0.060', 'AMMO4': '0.063', 'AMMO3': '0.095', 'WEAPON4': '0.200', 'weapon4': '0.264', 'weapon5': '0.268', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.720', 'ARMOR': '0.931', 'weapon2': '1.198', 'weapon3': '1.630', 'DAMAGECOUNT': '3.528', 'FRAGCOUNT': '7.500'} [2023-02-24 18:27:37,478][177153] Updated weights for policy 0, policy_version 13260 (0.0008) [2023-02-24 18:27:37,706][177155] DAMAGECOUNT value on done: 115260.0 [2023-02-24 18:27:37,707][177155] Sum rewards: 20.310, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.015', 'AMMO5': '0.007', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.111', 'weapon5': '0.218', 'WEAPON5': '0.250', 'weapon4': '0.270', 'WEAPON3': '0.650', 'weapon2': '1.176', 'HITCOUNT': '1.300', 'weapon3': '1.982', 'DAMAGECOUNT': '4.848', 'FRAGCOUNT': '16.000'} [2023-02-24 18:27:38,004][177155] DAMAGECOUNT value on done: 109645.0 [2023-02-24 18:27:38,004][177155] Sum rewards: 12.199, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.935', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.012', 'ARMOR': '0.012', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.052', 'weapon5': '0.076', 'AMMO3': '0.092', 'weapon7': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.690', 'WEAPON3': '0.750', 'weapon3': '1.676', 'weapon2': '1.842', 'DAMAGECOUNT': '3.000', 'FRAGCOUNT': '11.000'} [2023-02-24 18:27:38,844][177171] Large shaping reward 3.191 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.15, 50.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 18:27:40,436][177153] Updated weights for policy 0, policy_version 13270 (0.0008) [2023-02-24 18:27:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 54366208. Throughput: 0: 3492.9. Samples: 13589084. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:27:41,376][177119] Avg episode reward: [(0, '8.527')] [2023-02-24 18:27:42,334][177170] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:27:43,349][177153] Updated weights for policy 0, policy_version 13280 (0.0008) [2023-02-24 18:27:43,818][177156] DAMAGECOUNT value on done: 110227.0 [2023-02-24 18:27:43,818][177156] Sum rewards: 6.360, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.216', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO3': '0.040', 'AMMO4': '0.042', 'weapon7': '0.046', 'weapon5': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.420', 'weapon4': '0.444', 'weapon3': '1.012', 'weapon2': '1.304', 'DAMAGECOUNT': '1.752', 'FRAGCOUNT': '5.000'} [2023-02-24 18:27:43,996][177156] DAMAGECOUNT value on done: 112103.0 [2023-02-24 18:27:43,996][177156] Sum rewards: 15.560, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.798', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'weapon5': '0.188', 'WEAPON5': '0.300', 'weapon4': '0.420', 'WEAPON3': '0.800', 'weapon2': '1.060', 'HITCOUNT': '1.260', 'weapon3': '1.800', 'DAMAGECOUNT': '5.712', 'FRAGCOUNT': '12.000'} [2023-02-24 18:27:44,128][177156] DAMAGECOUNT value on done: 113186.0 [2023-02-24 18:27:44,129][177156] Sum rewards: 17.439, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.005', 'HEALTH': '0.006', 'AMMO2': '0.007', 'ARMOR': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.034', 'weapon5': '0.066', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.266', 'WEAPON3': '0.700', 'weapon2': '0.848', 'HITCOUNT': '1.340', 'weapon3': '2.544', 'DAMAGECOUNT': '4.902', 'FRAGCOUNT': '16.000'} [2023-02-24 18:27:44,301][177156] DAMAGECOUNT value on done: 109616.0 [2023-02-24 18:27:44,302][177156] Sum rewards: 5.080, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.608', 'ARMOR': '0.004', 'AMMO5': '0.027', 'AMMO2': '0.030', 'WEAPON1': '0.050', 'weapon4': '0.066', 'WEAPON4': '0.150', 'AMMO4': '0.150', 'AMMO3': '0.151', 'weapon5': '0.258', 'WEAPON5': '0.550', 'HITCOUNT': '0.800', 'WEAPON3': '0.950', 'weapon2': '1.276', 'weapon3': '2.104', 'DAMAGECOUNT': '3.621', 'FRAGCOUNT': '7.000'} [2023-02-24 18:27:46,276][177153] Updated weights for policy 0, policy_version 13290 (0.0008) [2023-02-24 18:27:46,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 54435840. Throughput: 0: 3493.5. Samples: 13609992. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:27:46,376][177119] Avg episode reward: [(0, '8.563')] [2023-02-24 18:27:49,002][177170] DAMAGECOUNT value on done: 113272.0 [2023-02-24 18:27:49,002][177170] Sum rewards: 13.389, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.338', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.092', 'weapon5': '0.222', 'WEAPON5': '0.250', 'weapon4': '0.306', 'WEAPON3': '0.700', 'HITCOUNT': '0.750', 'weapon2': '1.128', 'weapon3': '1.966', 'DAMAGECOUNT': '3.162', 'FRAGCOUNT': '11.000'} [2023-02-24 18:27:49,192][177153] Updated weights for policy 0, policy_version 13300 (0.0008) [2023-02-24 18:27:49,298][177170] DAMAGECOUNT value on done: 118275.0 [2023-02-24 18:27:49,299][177170] Sum rewards: 12.166, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.148', 'WEAPON5': '0.150', 'weapon7': '0.152', 'weapon5': '0.152', 'WEAPON3': '0.450', 'HITCOUNT': '0.580', 'weapon2': '1.010', 'HEALTH': '1.060', 'weapon3': '1.916', 'DAMAGECOUNT': '2.775', 'FRAGCOUNT': '8.500'} [2023-02-24 18:27:49,499][177170] DAMAGECOUNT value on done: 107760.0 [2023-02-24 18:27:49,500][177170] Sum rewards: 18.214, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.015', 'AMMO2': '0.022', 'ARMOR': '0.028', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.106', 'AMMO4': '0.108', 'AMMO3': '0.122', 'HEALTH': '0.142', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.210', 'weapon4': '0.236', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'HITCOUNT': '1.100', 'weapon2': '1.134', 'weapon3': '1.950', 'DAMAGECOUNT': '5.541', 'FRAGCOUNT': '14.000'} [2023-02-24 18:27:49,803][177170] DAMAGECOUNT value on done: 115559.0 [2023-02-24 18:27:49,803][177170] Sum rewards: 13.980, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.030', 'WEAPON1': '0.050', 'weapon5': '0.132', 'AMMO3': '0.146', 'WEAPON5': '0.250', 'HEALTH': '0.257', 'WEAPON3': '0.900', 'weapon2': '0.952', 'HITCOUNT': '1.080', 'weapon3': '2.624', 'DAMAGECOUNT': '4.041', 'FRAGCOUNT': '14.000'} [2023-02-24 18:27:50,657][177158] DAMAGECOUNT value on done: 109425.0 [2023-02-24 18:27:50,658][177158] Sum rewards: 4.421, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'ARMOR': '0.052', 'weapon7': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'AMMO4': '0.108', 'weapon5': '0.142', 'WEAPON5': '0.150', 'weapon4': '0.256', 'HEALTH': '0.312', 'HITCOUNT': '0.450', 'WEAPON3': '0.500', 'weapon3': '1.460', 'weapon2': '1.746', 'DAMAGECOUNT': '1.842', 'FRAGCOUNT': '3.500'} [2023-02-24 18:27:50,955][177158] DAMAGECOUNT value on done: 109219.0 [2023-02-24 18:27:50,956][177158] Sum rewards: 6.973, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.040', 'weapon7': '0.048', 'weapon5': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'HEALTH': '0.294', 'WEAPON3': '0.300', 'HITCOUNT': '0.560', 'weapon4': '0.618', 'weapon3': '0.950', 'weapon2': '1.806', 'DAMAGECOUNT': '2.034', 'FRAGCOUNT': '2.500'} [2023-02-24 18:27:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13995.9, 300 sec: 13968.1). Total num frames: 54505472. Throughput: 0: 3494.3. Samples: 13620488. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:27:51,376][177119] Avg episode reward: [(0, '8.904')] [2023-02-24 18:27:51,435][177158] DAMAGECOUNT value on done: 112803.0 [2023-02-24 18:27:51,436][177158] Sum rewards: 2.402, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.680', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.012', 'WEAPON1': '0.070', 'AMMO3': '0.181', 'weapon5': '0.264', 'WEAPON5': '0.350', 'HITCOUNT': '0.490', 'WEAPON3': '1.050', 'weapon2': '1.292', 'weapon3': '2.128', 'DAMAGECOUNT': '2.250', 'FRAGCOUNT': '5.000'} [2023-02-24 18:27:51,734][177158] DAMAGECOUNT value on done: 115035.0 [2023-02-24 18:27:51,735][177158] Sum rewards: 12.288, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.933', 'AMMO5': '0.017', 'AMMO2': '0.026', 'ARMOR': '0.028', 'WEAPON1': '0.050', 'weapon5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.141', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.404', 'WEAPON3': '0.900', 'HITCOUNT': '0.900', 'weapon2': '1.220', 'weapon3': '1.996', 'DAMAGECOUNT': '3.561', 'FRAGCOUNT': '13.000'} [2023-02-24 18:27:52,127][177153] Updated weights for policy 0, policy_version 13310 (0.0008) [2023-02-24 18:27:52,934][177172] DAMAGECOUNT value on done: 111447.0 [2023-02-24 18:27:52,935][177172] Sum rewards: 6.852, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.676', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon7': '0.052', 'AMMO4': '0.057', 'AMMO3': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.450', 'HITCOUNT': '0.560', 'weapon4': '0.588', 'weapon2': '0.694', 'weapon3': '1.310', 'DAMAGECOUNT': '1.941', 'FRAGCOUNT': '5.000'} [2023-02-24 18:27:53,225][177172] DAMAGECOUNT value on done: 112317.0 [2023-02-24 18:27:53,225][177172] Sum rewards: 6.734, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.770', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon7': '0.054', 'AMMO3': '0.067', 'WEAPON1': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.136', 'AMMO4': '0.141', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'HITCOUNT': '0.490', 'WEAPON3': '0.500', 'weapon4': '0.620', 'weapon3': '1.334', 'weapon2': '1.580', 'DAMAGECOUNT': '1.719', 'FRAGCOUNT': '5.000'} [2023-02-24 18:27:53,957][177154] DAMAGECOUNT value on done: 117021.0 [2023-02-24 18:27:53,958][177154] Sum rewards: 12.315, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'weapon7': '0.056', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'weapon5': '0.102', 'AMMO3': '0.109', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.136', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HEALTH': '0.225', 'WEAPON3': '0.650', 'HITCOUNT': '0.950', 'weapon2': '1.564', 'weapon3': '1.830', 'DAMAGECOUNT': '3.540', 'FRAGCOUNT': '9.000'} [2023-02-24 18:27:54,249][177154] DAMAGECOUNT value on done: 117254.0 [2023-02-24 18:27:54,249][177154] Sum rewards: 11.372, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.770', 'AMMO2': '0.014', 'AMMO5': '0.016', 'AMMO3': '0.060', 'AMMO4': '0.072', 'weapon7': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'ARMOR': '0.452', 'weapon2': '0.578', 'weapon4': '0.704', 'HITCOUNT': '0.890', 'weapon3': '1.478', 'DAMAGECOUNT': '3.570', 'FRAGCOUNT': '8.000'} [2023-02-24 18:27:54,421][177172] DAMAGECOUNT value on done: 113776.0 [2023-02-24 18:27:54,421][177172] Sum rewards: 9.618, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.573', 'AMMO5': '0.013', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'WEAPON1': '0.080', 'weapon7': '0.090', 'AMMO4': '0.097', 'weapon5': '0.110', 'AMMO3': '0.132', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.354', 'HITCOUNT': '0.600', 'weapon2': '0.840', 'WEAPON3': '0.950', 'weapon3': '2.244', 'DAMAGECOUNT': '2.862', 'FRAGCOUNT': '9.000'} [2023-02-24 18:27:54,520][177154] DAMAGECOUNT value on done: 115375.0 [2023-02-24 18:27:54,521][177154] Sum rewards: 9.461, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.978', 'weapon7': '0.006', 'AMMO5': '0.019', 'AMMO2': '0.027', 'WEAPON1': '0.090', 'AMMO4': '0.133', 'AMMO3': '0.144', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.208', 'weapon4': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.550', 'weapon2': '0.670', 'HITCOUNT': '0.890', 'WEAPON3': '0.950', 'weapon3': '2.388', 'DAMAGECOUNT': '3.474', 'FRAGCOUNT': '9.500'} [2023-02-24 18:27:54,728][177172] DAMAGECOUNT value on done: 112236.0 [2023-02-24 18:27:54,728][177172] Sum rewards: 6.724, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.984', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.075', 'weapon5': '0.152', 'AMMO4': '0.188', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.648', 'HITCOUNT': '0.720', 'weapon2': '1.060', 'weapon3': '1.192', 'DAMAGECOUNT': '3.564', 'FRAGCOUNT': '7.000'} [2023-02-24 18:27:54,829][177154] DAMAGECOUNT value on done: 119678.0 [2023-02-24 18:27:54,829][177154] Sum rewards: 7.201, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.982', 'AMMO2': '0.015', 'ARMOR': '0.016', 'AMMO5': '0.017', 'WEAPON1': '0.070', 'AMMO4': '0.075', 'AMMO3': '0.141', 'weapon4': '0.162', 'WEAPON4': '0.200', 'weapon5': '0.208', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'HITCOUNT': '0.830', 'weapon3': '1.614', 'weapon2': '1.708', 'DAMAGECOUNT': '2.727', 'FRAGCOUNT': '9.000'} [2023-02-24 18:27:55,088][177171] DAMAGECOUNT value on done: 115776.0 [2023-02-24 18:27:55,089][177171] Sum rewards: 5.242, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.177', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.142', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.330', 'weapon4': '0.358', 'WEAPON3': '0.500', 'weapon5': '0.676', 'weapon2': '0.760', 'weapon3': '1.526', 'DAMAGECOUNT': '1.755', 'FRAGCOUNT': '4.000'} [2023-02-24 18:27:55,103][177153] Updated weights for policy 0, policy_version 13320 (0.0008) [2023-02-24 18:27:55,325][177157] DAMAGECOUNT value on done: 110289.0 [2023-02-24 18:27:55,325][177157] Sum rewards: 3.396, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.715', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.017', 'WEAPON1': '0.030', 'AMMO3': '0.098', 'weapon5': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.462', 'HITCOUNT': '0.470', 'weapon4': '0.470', 'WEAPON3': '0.700', 'weapon2': '1.212', 'weapon3': '1.490', 'DAMAGECOUNT': '1.578', 'FRAGCOUNT': '4.000'} [2023-02-24 18:27:55,335][177157] DAMAGECOUNT value on done: 115799.0 [2023-02-24 18:27:55,336][177157] Sum rewards: 20.637, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.655', 'AMMO2': '0.005', 'AMMO4': '0.024', 'AMMO5': '0.026', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.134', 'weapon5': '0.200', 'weapon4': '0.342', 'ARMOR': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.878', 'WEAPON3': '0.900', 'HITCOUNT': '1.420', 'weapon3': '2.250', 'DAMAGECOUNT': '6.042', 'FRAGCOUNT': '17.000'} [2023-02-24 18:27:55,402][177171] DAMAGECOUNT value on done: 112744.0 [2023-02-24 18:27:55,402][177171] Sum rewards: 8.514, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.920', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO5': '0.018', 'WEAPON1': '0.060', 'AMMO3': '0.084', 'WEAPON5': '0.300', 'weapon5': '0.418', 'HITCOUNT': '0.600', 'WEAPON3': '0.700', 'weapon2': '1.380', 'weapon3': '1.852', 'DAMAGECOUNT': '2.565', 'FRAGCOUNT': '7.000'} [2023-02-24 18:27:55,468][177171] DAMAGECOUNT value on done: 110408.0 [2023-02-24 18:27:55,469][177171] Sum rewards: 1.876, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.680', 'AMMO5': '0.020', 'AMMO2': '0.031', 'WEAPON1': '0.060', 'AMMO3': '0.129', 'AMMO4': '0.156', 'weapon5': '0.172', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'weapon4': '0.432', 'HITCOUNT': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.470', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.665', 'weapon3': '1.870', 'FRAGCOUNT': '3.500'} [2023-02-24 18:27:55,633][177157] DAMAGECOUNT value on done: 109483.0 [2023-02-24 18:27:55,633][177157] Sum rewards: 13.821, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.385', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.034', 'WEAPON1': '0.040', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'weapon5': '0.172', 'weapon4': '0.274', 'WEAPON5': '0.300', 'ARMOR': '0.504', 'HITCOUNT': '0.660', 'WEAPON3': '0.700', 'weapon2': '1.456', 'weapon3': '1.760', 'DAMAGECOUNT': '2.847', 'FRAGCOUNT': '13.000'} [2023-02-24 18:27:55,648][177157] DAMAGECOUNT value on done: 111517.0 [2023-02-24 18:27:55,649][177157] Sum rewards: 3.758, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.450', 'AMMO5': '0.007', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'AMMO4': '0.122', 'weapon5': '0.140', 'WEAPON5': '0.150', 'weapon4': '0.252', 'HITCOUNT': '0.450', 'WEAPON3': '0.500', 'weapon2': '0.774', 'DAMAGECOUNT': '1.578', 'weapon3': '2.180', 'FRAGCOUNT': '3.000'} [2023-02-24 18:27:55,768][177171] DAMAGECOUNT value on done: 107539.0 [2023-02-24 18:27:55,769][177171] Sum rewards: 12.510, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.640', 'AMMO5': '0.012', 'AMMO2': '0.028', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO3': '0.099', 'AMMO4': '0.139', 'weapon5': '0.248', 'weapon4': '0.312', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.850', 'weapon2': '1.336', 'weapon3': '1.814', 'DAMAGECOUNT': '3.741', 'FRAGCOUNT': '9.000'} [2023-02-24 18:27:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 54575104. Throughput: 0: 3491.4. Samples: 13641384. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:27:56,376][177119] Avg episode reward: [(0, '9.108')] [2023-02-24 18:27:56,377][177155] DAMAGECOUNT value on done: 114152.0 [2023-02-24 18:27:56,378][177155] Sum rewards: 14.929, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.956', 'AMMO5': '0.017', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'AMMO4': '0.095', 'AMMO3': '0.108', 'WEAPON4': '0.200', 'weapon5': '0.232', 'weapon4': '0.376', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'weapon2': '0.798', 'HITCOUNT': '0.960', 'weapon3': '2.274', 'DAMAGECOUNT': '4.125', 'FRAGCOUNT': '13.000'} [2023-02-24 18:27:56,678][177155] DAMAGECOUNT value on done: 118840.0 [2023-02-24 18:27:56,679][177155] Sum rewards: 12.956, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.467', 'AMMO2': '0.005', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.023', 'weapon7': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.420', 'WEAPON3': '0.450', 'weapon5': '0.574', 'HITCOUNT': '0.590', 'weapon4': '0.666', 'weapon2': '0.792', 'weapon3': '1.246', 'DAMAGECOUNT': '2.817', 'FRAGCOUNT': '9.500'} [2023-02-24 18:27:56,988][177155] DAMAGECOUNT value on done: 116670.0 [2023-02-24 18:27:56,988][177155] Sum rewards: 12.400, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.098', 'ARMOR': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO2': '0.043', 'AMMO3': '0.118', 'weapon5': '0.172', 'AMMO4': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '0.700', 'weapon4': '0.854', 'weapon2': '0.930', 'HITCOUNT': '0.950', 'weapon3': '1.624', 'DAMAGECOUNT': '4.230', 'FRAGCOUNT': '11.000'} [2023-02-24 18:27:57,264][177156] Large shaping reward 2.647 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', 0.025, 5.0), ('weapon5', 0.002)] [2023-02-24 18:27:57,284][177155] DAMAGECOUNT value on done: 110642.0 [2023-02-24 18:27:57,285][177155] Sum rewards: 3.546, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.782', 'ARMOR': '0.008', 'AMMO5': '0.025', 'AMMO2': '0.029', 'WEAPON1': '0.050', 'AMMO3': '0.088', 'AMMO4': '0.143', 'weapon5': '0.192', 'weapon4': '0.286', 'WEAPON4': '0.400', 'HITCOUNT': '0.460', 'WEAPON5': '0.650', 'WEAPON3': '0.650', 'weapon2': '1.500', 'weapon3': '1.606', 'DAMAGECOUNT': '2.991', 'FRAGCOUNT': '4.500'} [2023-02-24 18:27:57,998][177153] Updated weights for policy 0, policy_version 13330 (0.0008) [2023-02-24 18:27:59,993][177170] Large shaping reward 2.652 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:28:00,947][177153] Updated weights for policy 0, policy_version 13340 (0.0009) [2023-02-24 18:28:01,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.6, 300 sec: 13968.1). Total num frames: 54644736. Throughput: 0: 3494.5. Samples: 13662442. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:28:01,376][177119] Avg episode reward: [(0, '9.146')] [2023-02-24 18:28:03,126][177156] DAMAGECOUNT value on done: 111533.0 [2023-02-24 18:28:03,127][177156] Sum rewards: 9.315, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.450', 'AMMO5': '0.014', 'AMMO2': '0.016', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.082', 'AMMO3': '0.124', 'weapon4': '0.138', 'weapon5': '0.208', 'WEAPON5': '0.300', 'weapon2': '0.724', 'WEAPON3': '0.750', 'HITCOUNT': '1.200', 'weapon3': '2.440', 'DAMAGECOUNT': '3.918', 'FRAGCOUNT': '8.000'} [2023-02-24 18:28:03,295][177156] DAMAGECOUNT value on done: 113039.0 [2023-02-24 18:28:03,296][177156] Sum rewards: 9.895, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.230', 'AMMO5': '0.012', 'AMMO2': '0.029', 'WEAPON1': '0.070', 'AMMO3': '0.105', 'AMMO4': '0.146', 'weapon5': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.420', 'ARMOR': '0.440', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'weapon2': '1.126', 'weapon3': '1.622', 'DAMAGECOUNT': '2.808', 'FRAGCOUNT': '9.000'} [2023-02-24 18:28:03,427][177156] DAMAGECOUNT value on done: 114186.0 [2023-02-24 18:28:03,428][177156] Sum rewards: 11.056, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.260', 'AMMO2': '0.010', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'weapon7': '0.046', 'AMMO4': '0.050', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.178', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'HITCOUNT': '0.820', 'weapon3': '1.514', 'weapon2': '2.060', 'DAMAGECOUNT': '3.000', 'FRAGCOUNT': '9.000'} [2023-02-24 18:28:03,603][177156] DAMAGECOUNT value on done: 110465.0 [2023-02-24 18:28:03,603][177156] Sum rewards: 3.992, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.536', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.038', 'WEAPON1': '0.060', 'AMMO3': '0.131', 'AMMO4': '0.188', 'weapon5': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.426', 'HITCOUNT': '0.520', 'WEAPON3': '0.650', 'weapon2': '0.794', 'weapon3': '2.052', 'DAMAGECOUNT': '2.502', 'FRAGCOUNT': '4.500'} [2023-02-24 18:28:03,889][177153] Updated weights for policy 0, policy_version 13350 (0.0008) [2023-02-24 18:28:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 54714368. Throughput: 0: 3494.1. Samples: 13672928. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:28:06,376][177119] Avg episode reward: [(0, '9.091')] [2023-02-24 18:28:06,811][177153] Updated weights for policy 0, policy_version 13360 (0.0009) [2023-02-24 18:28:08,191][177170] DAMAGECOUNT value on done: 114050.0 [2023-02-24 18:28:08,192][177170] Sum rewards: 7.673, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.476', 'AMMO5': '0.010', 'weapon4': '0.010', 'AMMO2': '0.014', 'ARMOR': '0.024', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.071', 'AMMO3': '0.082', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.232', 'WEAPON5': '0.300', 'HITCOUNT': '0.510', 'WEAPON3': '0.600', 'weapon3': '1.666', 'weapon2': '1.836', 'DAMAGECOUNT': '2.334', 'FRAGCOUNT': '5.000'} [2023-02-24 18:28:08,494][177170] DAMAGECOUNT value on done: 119482.0 [2023-02-24 18:28:08,495][177170] Sum rewards: 14.011, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.864', 'AMMO5': '0.025', 'AMMO2': '0.029', 'WEAPON1': '0.080', 'AMMO3': '0.120', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'weapon5': '0.248', 'weapon4': '0.336', 'weapon2': '0.464', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'HITCOUNT': '0.940', 'weapon3': '2.514', 'DAMAGECOUNT': '3.621', 'FRAGCOUNT': '14.000'} [2023-02-24 18:28:08,721][177170] DAMAGECOUNT value on done: 108863.0 [2023-02-24 18:28:08,722][177170] Sum rewards: 10.746, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.514', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO2': '0.028', 'AMMO3': '0.080', 'AMMO4': '0.140', 'weapon5': '0.150', 'weapon7': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.358', 'WEAPON7': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.710', 'weapon2': '0.910', 'weapon3': '1.796', 'DAMAGECOUNT': '2.982', 'FRAGCOUNT': '8.000'} [2023-02-24 18:28:09,025][177170] DAMAGECOUNT value on done: 116227.0 [2023-02-24 18:28:09,026][177170] Sum rewards: 9.791, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.410', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'AMMO3': '0.045', 'WEAPON4': '0.050', 'AMMO4': '0.079', 'weapon7': '0.134', 'weapon5': '0.136', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'HITCOUNT': '0.320', 'weapon4': '0.320', 'WEAPON3': '0.350', 'weapon3': '0.888', 'weapon2': '1.832', 'DAMAGECOUNT': '2.004', 'FRAGCOUNT': '6.000'} [2023-02-24 18:28:09,736][177153] Updated weights for policy 0, policy_version 13370 (0.0009) [2023-02-24 18:28:09,882][177158] DAMAGECOUNT value on done: 110393.0 [2023-02-24 18:28:09,882][177158] Sum rewards: 7.204, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.932', 'AMMO5': '0.012', 'AMMO2': '0.024', 'WEAPON1': '0.050', 'AMMO3': '0.103', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'weapon5': '0.198', 'weapon4': '0.296', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'HITCOUNT': '0.770', 'weapon2': '1.248', 'weapon3': '1.908', 'DAMAGECOUNT': '2.904', 'FRAGCOUNT': '6.000'} [2023-02-24 18:28:10,180][177158] DAMAGECOUNT value on done: 110380.0 [2023-02-24 18:28:10,181][177158] Sum rewards: 5.884, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.300', 'AMMO5': '0.016', 'AMMO2': '0.036', 'WEAPON1': '0.070', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'weapon5': '0.154', 'AMMO4': '0.180', 'weapon4': '0.302', 'ARMOR': '0.429', 'WEAPON5': '0.450', 'HITCOUNT': '0.710', 'weapon2': '0.804', 'WEAPON3': '1.050', 'weapon3': '2.208', 'DAMAGECOUNT': '3.483', 'FRAGCOUNT': '7.000'} [2023-02-24 18:28:10,647][177158] DAMAGECOUNT value on done: 113554.0 [2023-02-24 18:28:10,648][177158] Sum rewards: 7.676, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.402', 'AMMO5': '0.005', 'AMMO2': '0.043', 'AMMO3': '0.065', 'WEAPON5': '0.100', 'weapon7': '0.100', 'AMMO4': '0.217', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.490', 'weapon2': '0.808', 'weapon4': '0.930', 'weapon3': '1.176', 'DAMAGECOUNT': '2.253', 'FRAGCOUNT': '6.000'} [2023-02-24 18:28:10,932][177158] DAMAGECOUNT value on done: 115730.0 [2023-02-24 18:28:10,932][177158] Sum rewards: 3.443, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.760', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'weapon5': '0.124', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.420', 'weapon4': '0.420', 'WEAPON3': '0.600', 'weapon2': '0.820', 'weapon3': '1.488', 'DAMAGECOUNT': '2.085', 'FRAGCOUNT': '3.000'} [2023-02-24 18:28:11,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 54784000. Throughput: 0: 3492.4. Samples: 13693808. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:28:11,376][177119] Avg episode reward: [(0, '9.069')] [2023-02-24 18:28:12,232][177172] DAMAGECOUNT value on done: 112664.0 [2023-02-24 18:28:12,232][177172] Sum rewards: 7.219, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.691', 'AMMO5': '0.010', 'AMMO2': '0.032', 'WEAPON1': '0.040', 'ARMOR': '0.048', 'weapon5': '0.124', 'AMMO3': '0.148', 'AMMO4': '0.162', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.734', 'weapon2': '0.738', 'WEAPON3': '0.850', 'HITCOUNT': '1.000', 'weapon3': '2.022', 'DAMAGECOUNT': '3.651', 'FRAGCOUNT': '9.000'} [2023-02-24 18:28:12,529][177172] DAMAGECOUNT value on done: 112972.0 [2023-02-24 18:28:12,530][177172] Sum rewards: 3.232, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.260', 'AMMO2': '0.005', 'AMMO5': '0.020', 'AMMO4': '0.022', 'weapon4': '0.026', 'WEAPON4': '0.050', 'WEAPON1': '0.080', 'AMMO3': '0.138', 'weapon5': '0.332', 'HITCOUNT': '0.490', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'weapon2': '1.538', 'weapon3': '1.776', 'DAMAGECOUNT': '1.965', 'FRAGCOUNT': '5.000'} [2023-02-24 18:28:12,646][177153] Updated weights for policy 0, policy_version 13380 (0.0008) [2023-02-24 18:28:13,048][177154] DAMAGECOUNT value on done: 117993.0 [2023-02-24 18:28:13,049][177154] Sum rewards: 11.227, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.190', 'AMMO5': '0.009', 'AMMO2': '0.014', 'WEAPON1': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.068', 'weapon7': '0.094', 'weapon5': '0.126', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'WEAPON7': '0.400', 'weapon4': '0.476', 'WEAPON3': '0.500', 'HITCOUNT': '0.580', 'weapon2': '1.470', 'weapon3': '1.474', 'DAMAGECOUNT': '2.916', 'FRAGCOUNT': '8.500'} [2023-02-24 18:28:13,348][177154] DAMAGECOUNT value on done: 118025.0 [2023-02-24 18:28:13,348][177154] Sum rewards: 11.050, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.617', 'AMMO5': '0.015', 'AMMO2': '0.015', 'weapon7': '0.050', 'AMMO3': '0.073', 'AMMO4': '0.075', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.140', 'WEAPON7': '0.200', 'weapon4': '0.306', 'WEAPON5': '0.400', 'HITCOUNT': '0.460', 'WEAPON3': '0.550', 'weapon3': '1.330', 'weapon2': '1.570', 'DAMAGECOUNT': '2.313', 'FRAGCOUNT': '10.000'} [2023-02-24 18:28:13,635][177154] DAMAGECOUNT value on done: 116094.0 [2023-02-24 18:28:13,635][177154] Sum rewards: 8.034, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.210', 'AMMO2': '0.004', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO4': '0.019', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.146', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.250', 'weapon2': '0.464', 'HITCOUNT': '0.510', 'WEAPON3': '0.600', 'weapon3': '1.594', 'DAMAGECOUNT': '2.157', 'FRAGCOUNT': '7.000'} [2023-02-24 18:28:13,718][177172] DAMAGECOUNT value on done: 115558.0 [2023-02-24 18:28:13,718][177172] Sum rewards: 13.540, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.460', 'AMMO5': '0.029', 'AMMO2': '0.032', 'WEAPON1': '0.040', 'AMMO3': '0.115', 'AMMO4': '0.158', 'weapon5': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.550', 'weapon4': '0.584', 'weapon2': '0.608', 'WEAPON3': '0.750', 'HITCOUNT': '0.860', 'weapon3': '1.938', 'DAMAGECOUNT': '5.346', 'FRAGCOUNT': '11.500'} [2023-02-24 18:28:13,939][177154] DAMAGECOUNT value on done: 120152.0 [2023-02-24 18:28:13,939][177154] Sum rewards: 2.088, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.710', 'ARMOR': '0.004', 'AMMO5': '0.007', 'weapon4': '0.022', 'AMMO2': '0.029', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'AMMO4': '0.145', 'weapon5': '0.194', 'WEAPON5': '0.300', 'HITCOUNT': '0.440', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.422', 'weapon3': '1.478', 'weapon2': '1.994', 'FRAGCOUNT': '2.000'} [2023-02-24 18:28:14,017][177172] DAMAGECOUNT value on done: 113184.0 [2023-02-24 18:28:14,017][177172] Sum rewards: 8.310, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.134', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon7': '0.086', 'weapon5': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.113', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.298', 'HITCOUNT': '0.640', 'weapon2': '0.642', 'WEAPON3': '0.700', 'weapon3': '1.940', 'DAMAGECOUNT': '2.844', 'FRAGCOUNT': '7.000'} [2023-02-24 18:28:14,297][177171] DAMAGECOUNT value on done: 116701.0 [2023-02-24 18:28:14,298][177171] Sum rewards: 7.356, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.131', 'AMMO5': '0.007', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'ARMOR': '0.041', 'AMMO3': '0.060', 'weapon7': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.104', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON3': '0.300', 'weapon4': '0.406', 'HITCOUNT': '0.410', 'weapon3': '1.292', 'weapon2': '1.322', 'DAMAGECOUNT': '2.175', 'FRAGCOUNT': '5.000'} [2023-02-24 18:28:14,561][177157] DAMAGECOUNT value on done: 110945.0 [2023-02-24 18:28:14,561][177157] Sum rewards: 5.345, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.553', 'AMMO5': '0.012', 'AMMO2': '0.027', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.107', 'AMMO4': '0.135', 'weapon5': '0.188', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'HITCOUNT': '0.440', 'ARMOR': '0.450', 'weapon4': '0.634', 'WEAPON3': '0.650', 'weapon2': '0.980', 'weapon3': '1.406', 'DAMAGECOUNT': '1.968', 'FRAGCOUNT': '5.000'} [2023-02-24 18:28:14,571][177157] DAMAGECOUNT value on done: 116360.0 [2023-02-24 18:28:14,572][177157] Sum rewards: 7.259, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.826', 'AMMO2': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.033', 'AMMO3': '0.093', 'weapon5': '0.102', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.384', 'ARMOR': '0.457', 'HITCOUNT': '0.480', 'WEAPON3': '0.700', 'weapon2': '1.518', 'weapon3': '1.588', 'DAMAGECOUNT': '1.683', 'FRAGCOUNT': '6.000'} [2023-02-24 18:28:14,587][177171] DAMAGECOUNT value on done: 113604.0 [2023-02-24 18:28:14,588][177171] Sum rewards: 8.961, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.550', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.088', 'weapon7': '0.088', 'weapon5': '0.094', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.576', 'HITCOUNT': '0.670', 'weapon2': '1.374', 'weapon3': '1.546', 'DAMAGECOUNT': '2.580', 'FRAGCOUNT': '7.000'} [2023-02-24 18:28:14,648][177171] DAMAGECOUNT value on done: 111144.0 [2023-02-24 18:28:14,649][177171] Sum rewards: 3.199, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.956', 'AMMO5': '0.025', 'AMMO2': '0.039', 'WEAPON1': '0.050', 'weapon7': '0.082', 'AMMO3': '0.106', 'weapon5': '0.184', 'AMMO4': '0.193', 'WEAPON4': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'HITCOUNT': '0.470', 'WEAPON5': '0.550', 'weapon4': '0.558', 'WEAPON3': '0.650', 'weapon2': '0.678', 'weapon3': '1.522', 'DAMAGECOUNT': '2.208', 'FRAGCOUNT': '4.500'} [2023-02-24 18:28:14,865][177157] DAMAGECOUNT value on done: 110229.0 [2023-02-24 18:28:14,865][177157] Sum rewards: 2.716, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.245', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO3': '0.090', 'weapon5': '0.096', 'weapon7': '0.110', 'AMMO4': '0.126', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'HITCOUNT': '0.560', 'WEAPON3': '0.600', 'weapon4': '0.608', 'weapon2': '0.614', 'weapon3': '1.474', 'DAMAGECOUNT': '2.238', 'FRAGCOUNT': '3.500'} [2023-02-24 18:28:14,876][177157] DAMAGECOUNT value on done: 113270.0 [2023-02-24 18:28:14,876][177157] Sum rewards: 17.637, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.077', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON1': '0.040', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'weapon4': '0.124', 'weapon5': '0.182', 'WEAPON5': '0.200', 'WEAPON3': '0.800', 'HITCOUNT': '1.170', 'weapon2': '1.276', 'weapon3': '2.114', 'DAMAGECOUNT': '5.259', 'FRAGCOUNT': '14.000'} [2023-02-24 18:28:14,943][177171] DAMAGECOUNT value on done: 109833.0 [2023-02-24 18:28:14,943][177171] Sum rewards: 17.408, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.153', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon7': '0.056', 'WEAPON1': '0.070', 'AMMO3': '0.090', 'AMMO4': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.196', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.320', 'weapon4': '0.484', 'WEAPON3': '0.550', 'weapon2': '0.658', 'HITCOUNT': '1.220', 'weapon3': '2.000', 'DAMAGECOUNT': '5.082', 'FRAGCOUNT': '12.500'} [2023-02-24 18:28:15,588][177153] Updated weights for policy 0, policy_version 13390 (0.0008) [2023-02-24 18:28:15,645][177155] DAMAGECOUNT value on done: 115359.0 [2023-02-24 18:28:15,645][177155] Sum rewards: 13.466, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-2.150', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON1': '0.040', 'weapon4': '0.056', 'AMMO4': '0.070', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'weapon5': '0.108', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.670', 'WEAPON3': '0.700', 'weapon2': '1.780', 'weapon3': '1.814', 'DAMAGECOUNT': '3.621', 'FRAGCOUNT': '11.000'} [2023-02-24 18:28:15,937][177155] DAMAGECOUNT value on done: 119500.0 [2023-02-24 18:28:15,937][177155] Sum rewards: 6.405, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.278', 'AMMO5': '0.012', 'AMMO2': '0.038', 'ARMOR': '0.040', 'WEAPON1': '0.040', 'weapon5': '0.082', 'AMMO3': '0.085', 'weapon7': '0.102', 'AMMO4': '0.189', 'WEAPON5': '0.250', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON7': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'weapon4': '0.782', 'weapon3': '1.260', 'weapon2': '1.412', 'DAMAGECOUNT': '1.980', 'FRAGCOUNT': '7.000'} [2023-02-24 18:28:16,240][177155] DAMAGECOUNT value on done: 117788.0 [2023-02-24 18:28:16,240][177155] Sum rewards: 11.538, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.656', 'AMMO5': '0.010', 'AMMO2': '0.011', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.111', 'weapon5': '0.204', 'weapon4': '0.238', 'WEAPON5': '0.250', 'HITCOUNT': '0.660', 'WEAPON3': '0.750', 'weapon2': '1.192', 'weapon3': '2.022', 'DAMAGECOUNT': '3.354', 'FRAGCOUNT': '10.000'} [2023-02-24 18:28:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.6, 300 sec: 13968.1). Total num frames: 54853632. Throughput: 0: 3492.4. Samples: 13714834. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:28:16,376][177119] Avg episode reward: [(0, '8.980')] [2023-02-24 18:28:16,533][177155] DAMAGECOUNT value on done: 111509.0 [2023-02-24 18:28:16,533][177155] Sum rewards: 6.386, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.539', 'AMMO5': '0.010', 'AMMO2': '0.021', 'ARMOR': '0.024', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon7': '0.056', 'AMMO3': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.106', 'weapon4': '0.196', 'weapon5': '0.212', 'WEAPON5': '0.300', 'HITCOUNT': '0.440', 'WEAPON3': '0.550', 'weapon2': '1.440', 'weapon3': '1.738', 'DAMAGECOUNT': '2.601', 'FRAGCOUNT': '4.000'} [2023-02-24 18:28:18,485][177153] Updated weights for policy 0, policy_version 13400 (0.0008) [2023-02-24 18:28:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 54923264. Throughput: 0: 3492.6. Samples: 13725344. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:28:21,376][177119] Avg episode reward: [(0, '8.916')] [2023-02-24 18:28:21,412][177153] Updated weights for policy 0, policy_version 13410 (0.0008) [2023-02-24 18:28:22,369][177156] DAMAGECOUNT value on done: 112540.0 [2023-02-24 18:28:22,370][177156] Sum rewards: 3.370, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.720', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'weapon5': '0.016', 'WEAPON1': '0.040', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.133', 'weapon4': '0.204', 'ARMOR': '0.469', 'weapon2': '0.720', 'WEAPON3': '0.750', 'HITCOUNT': '0.760', 'weapon3': '1.576', 'FRAGCOUNT': '3.000', 'DAMAGECOUNT': '3.021'} [2023-02-24 18:28:22,527][177156] DAMAGECOUNT value on done: 114224.0 [2023-02-24 18:28:22,528][177156] Sum rewards: 11.421, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.050', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.029', 'weapon4': '0.074', 'AMMO3': '0.091', 'weapon7': '0.096', 'WEAPON4': '0.100', 'weapon5': '0.136', 'WEAPON5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.850', 'weapon2': '1.718', 'weapon3': '1.758', 'DAMAGECOUNT': '3.555', 'FRAGCOUNT': '10.000'} [2023-02-24 18:28:22,674][177156] DAMAGECOUNT value on done: 115469.0 [2023-02-24 18:28:22,675][177156] Sum rewards: 15.310, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.350', 'AMMO2': '0.013', 'AMMO3': '0.060', 'AMMO4': '0.065', 'weapon7': '0.176', 'WEAPON4': '0.200', 'weapon4': '0.258', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.820', 'weapon3': '1.470', 'weapon2': '1.758', 'DAMAGECOUNT': '3.849', 'FRAGCOUNT': '10.000'} [2023-02-24 18:28:22,840][177156] DAMAGECOUNT value on done: 112106.0 [2023-02-24 18:28:22,841][177156] Sum rewards: 16.070, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.850', 'AMMO5': '0.010', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'weapon5': '0.074', 'ARMOR': '0.080', 'AMMO4': '0.140', 'AMMO3': '0.156', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.326', 'weapon2': '0.828', 'WEAPON3': '1.000', 'HITCOUNT': '1.340', 'weapon3': '2.474', 'DAMAGECOUNT': '4.923', 'FRAGCOUNT': '17.000'} [2023-02-24 18:28:24,353][177153] Updated weights for policy 0, policy_version 13420 (0.0009) [2023-02-24 18:28:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 54992896. Throughput: 0: 3493.6. Samples: 13746294. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:28:26,376][177119] Avg episode reward: [(0, '9.123')] [2023-02-24 18:28:27,275][177153] Updated weights for policy 0, policy_version 13430 (0.0008) [2023-02-24 18:28:27,439][177170] DAMAGECOUNT value on done: 115865.0 [2023-02-24 18:28:27,440][177170] Sum rewards: 13.434, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.876', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.024', 'WEAPON1': '0.050', 'AMMO3': '0.099', 'AMMO4': '0.119', 'weapon5': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '0.650', 'weapon4': '0.662', 'weapon2': '0.800', 'HITCOUNT': '1.020', 'weapon3': '1.832', 'DAMAGECOUNT': '5.445', 'FRAGCOUNT': '12.500'} [2023-02-24 18:28:27,759][177170] DAMAGECOUNT value on done: 120220.0 [2023-02-24 18:28:27,760][177170] Sum rewards: 7.779, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.714', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.024', 'WEAPON1': '0.060', 'AMMO3': '0.078', 'AMMO4': '0.120', 'WEAPON4': '0.200', 'weapon5': '0.214', 'weapon4': '0.272', 'HITCOUNT': '0.390', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.248', 'weapon3': '1.606', 'DAMAGECOUNT': '2.214', 'FRAGCOUNT': '8.000'} [2023-02-24 18:28:27,987][177170] DAMAGECOUNT value on done: 110491.0 [2023-02-24 18:28:27,987][177170] Sum rewards: 10.201, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.750', 'AMMO2': '0.014', 'AMMO5': '0.021', 'weapon4': '0.034', 'AMMO4': '0.067', 'WEAPON1': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.138', 'AMMO3': '0.153', 'WEAPON5': '0.450', 'weapon2': '0.740', 'WEAPON3': '0.950', 'HITCOUNT': '1.100', 'weapon3': '2.710', 'DAMAGECOUNT': '4.884', 'FRAGCOUNT': '10.000'} [2023-02-24 18:28:28,282][177170] DAMAGECOUNT value on done: 117066.0 [2023-02-24 18:28:28,283][177170] Sum rewards: 6.259, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.822', 'AMMO5': '0.005', 'AMMO2': '0.014', 'ARMOR': '0.040', 'WEAPON1': '0.040', 'AMMO4': '0.069', 'AMMO3': '0.070', 'weapon5': '0.126', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.222', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'weapon3': '1.542', 'weapon2': '1.836', 'DAMAGECOUNT': '2.517', 'FRAGCOUNT': '6.000'} [2023-02-24 18:28:29,046][177158] DAMAGECOUNT value on done: 111374.0 [2023-02-24 18:28:29,046][177158] Sum rewards: 8.806, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.758', 'AMMO5': '0.010', 'AMMO2': '0.025', 'WEAPON1': '0.060', 'AMMO3': '0.089', 'weapon7': '0.096', 'WEAPON4': '0.100', 'AMMO4': '0.123', 'weapon4': '0.228', 'weapon5': '0.236', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.400', 'WEAPON7': '0.400', 'HITCOUNT': '0.570', 'WEAPON3': '0.700', 'weapon2': '1.536', 'weapon3': '1.568', 'DAMAGECOUNT': '2.943', 'FRAGCOUNT': '7.000'} [2023-02-24 18:28:29,342][177158] DAMAGECOUNT value on done: 111886.0 [2023-02-24 18:28:29,342][177158] Sum rewards: 16.156, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.510', 'AMMO5': '0.012', 'AMMO2': '0.026', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.050', 'weapon7': '0.054', 'AMMO3': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.131', 'weapon5': '0.162', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.900', 'weapon2': '1.330', 'weapon3': '2.038', 'DAMAGECOUNT': '4.518', 'FRAGCOUNT': '12.000'} [2023-02-24 18:28:29,726][177158] DAMAGECOUNT value on done: 114259.0 [2023-02-24 18:28:29,727][177158] Sum rewards: 10.242, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.680', 'AMMO5': '0.003', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'weapon5': '0.050', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'weapon7': '0.168', 'weapon4': '0.246', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON7': '0.500', 'WEAPON3': '0.500', 'HITCOUNT': '0.530', 'weapon3': '1.356', 'weapon2': '2.014', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '7.000'} [2023-02-24 18:28:30,034][177158] DAMAGECOUNT value on done: 116856.0 [2023-02-24 18:28:30,035][177158] Sum rewards: 9.032, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.532', 'AMMO5': '0.020', 'AMMO2': '0.028', 'WEAPON1': '0.070', 'weapon5': '0.102', 'AMMO3': '0.136', 'AMMO4': '0.141', 'WEAPON4': '0.200', 'WEAPON5': '0.450', 'weapon4': '0.616', 'weapon2': '0.820', 'HITCOUNT': '0.870', 'WEAPON3': '0.900', 'weapon3': '1.832', 'DAMAGECOUNT': '3.378', 'FRAGCOUNT': '10.000'} [2023-02-24 18:28:30,211][177153] Updated weights for policy 0, policy_version 13440 (0.0008) [2023-02-24 18:28:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 55062528. Throughput: 0: 3494.7. Samples: 13767252. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:28:31,376][177119] Avg episode reward: [(0, '9.406')] [2023-02-24 18:28:31,477][177172] DAMAGECOUNT value on done: 113606.0 [2023-02-24 18:28:31,477][177172] Sum rewards: 5.621, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.906', 'AMMO5': '0.021', 'AMMO2': '0.028', 'ARMOR': '0.040', 'weapon7': '0.058', 'WEAPON1': '0.060', 'AMMO3': '0.098', 'AMMO4': '0.138', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon5': '0.204', 'WEAPON4': '0.250', 'weapon4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.720', 'weapon2': '0.860', 'weapon3': '1.954', 'DAMAGECOUNT': '2.826', 'FRAGCOUNT': '5.500'} [2023-02-24 18:28:31,780][177172] DAMAGECOUNT value on done: 114197.0 [2023-02-24 18:28:31,780][177172] Sum rewards: 9.847, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.114', 'AMMO5': '0.015', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'ARMOR': '0.044', 'weapon7': '0.046', 'AMMO3': '0.073', 'AMMO4': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.570', 'HITCOUNT': '0.580', 'weapon2': '1.166', 'weapon3': '1.274', 'DAMAGECOUNT': '3.675', 'FRAGCOUNT': '9.000'} [2023-02-24 18:28:32,294][177154] DAMAGECOUNT value on done: 118827.0 [2023-02-24 18:28:32,295][177154] Sum rewards: 5.833, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.600', 'AMMO5': '0.015', 'AMMO2': '0.019', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO4': '0.095', 'weapon5': '0.096', 'AMMO3': '0.108', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.340', 'WEAPON5': '0.400', 'HITCOUNT': '0.660', 'WEAPON3': '0.800', 'weapon2': '1.550', 'weapon3': '1.700', 'DAMAGECOUNT': '2.502', 'FRAGCOUNT': '8.000'} [2023-02-24 18:28:32,590][177154] DAMAGECOUNT value on done: 119803.0 [2023-02-24 18:28:32,591][177154] Sum rewards: 15.242, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.990', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.022', 'weapon7': '0.038', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.102', 'AMMO3': '0.104', 'weapon4': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.800', 'HITCOUNT': '1.030', 'weapon2': '1.410', 'weapon3': '2.078', 'DAMAGECOUNT': '5.334', 'FRAGCOUNT': '12.000'} [2023-02-24 18:28:32,793][177154] DAMAGECOUNT value on done: 116783.0 [2023-02-24 18:28:32,794][177154] Sum rewards: 5.204, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.669', 'AMMO2': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.049', 'WEAPON1': '0.050', 'weapon5': '0.092', 'AMMO3': '0.141', 'WEAPON5': '0.200', 'ARMOR': '0.454', 'HITCOUNT': '0.460', 'WEAPON3': '0.650', 'weapon2': '1.506', 'weapon3': '1.932', 'DAMAGECOUNT': '2.067', 'FRAGCOUNT': '5.000'} [2023-02-24 18:28:32,959][177172] DAMAGECOUNT value on done: 116400.0 [2023-02-24 18:28:32,959][177172] Sum rewards: 9.490, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.682', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'weapon7': '0.054', 'AMMO3': '0.079', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.190', 'WEAPON7': '0.200', 'weapon4': '0.232', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'HITCOUNT': '0.600', 'weapon2': '0.740', 'weapon3': '1.504', 'DAMAGECOUNT': '2.526', 'FRAGCOUNT': '8.000'} [2023-02-24 18:28:33,105][177154] DAMAGECOUNT value on done: 121353.0 [2023-02-24 18:28:33,105][177154] Sum rewards: 12.924, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.235', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'AMMO2': '0.045', 'weapon7': '0.050', 'AMMO3': '0.067', 'weapon5': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.225', 'WEAPON4': '0.250', 'weapon4': '0.308', 'WEAPON3': '0.500', 'HITCOUNT': '0.700', 'weapon3': '1.370', 'weapon2': '1.438', 'DAMAGECOUNT': '3.603', 'FRAGCOUNT': '11.000'} [2023-02-24 18:28:33,141][177153] Updated weights for policy 0, policy_version 13450 (0.0008) [2023-02-24 18:28:33,258][177172] DAMAGECOUNT value on done: 114820.0 [2023-02-24 18:28:33,258][177172] Sum rewards: 15.676, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.244', 'weapon7': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.034', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.104', 'weapon5': '0.108', 'AMMO4': '0.168', 'WEAPON5': '0.250', 'ARMOR': '0.424', 'WEAPON4': '0.450', 'WEAPON3': '0.650', 'weapon4': '0.666', 'HITCOUNT': '1.060', 'weapon2': '1.114', 'weapon3': '1.660', 'DAMAGECOUNT': '4.908', 'FRAGCOUNT': '13.000'} [2023-02-24 18:28:33,569][177171] DAMAGECOUNT value on done: 117384.0 [2023-02-24 18:28:33,570][177171] Sum rewards: 7.553, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.502', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.085', 'weapon5': '0.098', 'weapon7': '0.112', 'AMMO3': '0.127', 'WEAPON5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.232', 'WEAPON7': '0.300', 'HITCOUNT': '0.510', 'WEAPON3': '0.850', 'weapon2': '0.954', 'weapon3': '1.790', 'DAMAGECOUNT': '2.049', 'FRAGCOUNT': '8.000'} [2023-02-24 18:28:33,812][177157] DAMAGECOUNT value on done: 112935.0 [2023-02-24 18:28:33,813][177157] Sum rewards: 20.846, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon7': '0.048', 'HEALTH': '0.098', 'weapon5': '0.114', 'AMMO3': '0.131', 'AMMO4': '0.137', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.404', 'weapon2': '0.714', 'WEAPON3': '0.800', 'HITCOUNT': '1.300', 'weapon3': '2.222', 'DAMAGECOUNT': '5.970', 'FRAGCOUNT': '18.000'} [2023-02-24 18:28:33,824][177157] DAMAGECOUNT value on done: 117600.0 [2023-02-24 18:28:33,825][177157] Sum rewards: 10.688, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.858', 'AMMO5': '0.025', 'ARMOR': '0.028', 'AMMO2': '0.035', 'WEAPON1': '0.090', 'AMMO3': '0.151', 'AMMO4': '0.173', 'weapon5': '0.178', 'WEAPON4': '0.350', 'weapon2': '0.528', 'weapon4': '0.576', 'WEAPON5': '0.600', 'HITCOUNT': '0.870', 'WEAPON3': '1.000', 'weapon3': '2.222', 'DAMAGECOUNT': '3.720', 'FRAGCOUNT': '10.000'} [2023-02-24 18:28:33,865][177171] DAMAGECOUNT value on done: 115315.0 [2023-02-24 18:28:33,865][177171] Sum rewards: 13.641, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.060', 'AMMO2': '0.016', 'AMMO5': '0.017', 'ARMOR': '0.036', 'WEAPON1': '0.050', 'weapon7': '0.054', 'AMMO4': '0.081', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.472', 'weapon4': '0.562', 'WEAPON3': '0.700', 'HITCOUNT': '1.140', 'weapon3': '1.654', 'DAMAGECOUNT': '5.133', 'FRAGCOUNT': '13.000'} [2023-02-24 18:28:33,930][177171] DAMAGECOUNT value on done: 112371.0 [2023-02-24 18:28:33,931][177171] Sum rewards: 8.046, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.054', 'AMMO5': '0.007', 'weapon7': '0.016', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.134', 'weapon5': '0.146', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.296', 'weapon2': '0.792', 'WEAPON3': '0.900', 'HITCOUNT': '1.080', 'weapon3': '2.428', 'DAMAGECOUNT': '3.681', 'FRAGCOUNT': '8.500'} [2023-02-24 18:28:34,112][177157] DAMAGECOUNT value on done: 111320.0 [2023-02-24 18:28:34,113][177157] Sum rewards: 12.435, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.374', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'AMMO3': '0.113', 'AMMO4': '0.157', 'WEAPON4': '0.200', 'weapon5': '0.204', 'weapon4': '0.288', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'HITCOUNT': '0.930', 'weapon2': '1.096', 'weapon3': '1.982', 'DAMAGECOUNT': '3.273', 'FRAGCOUNT': '11.000'} [2023-02-24 18:28:34,123][177157] DAMAGECOUNT value on done: 114967.0 [2023-02-24 18:28:34,124][177157] Sum rewards: 12.693, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.250', 'AMMO2': '0.014', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.067', 'weapon7': '0.068', 'weapon5': '0.074', 'AMMO3': '0.144', 'WEAPON4': '0.200', 'weapon4': '0.250', 'WEAPON5': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'ARMOR': '0.440', 'WEAPON3': '0.850', 'weapon2': '0.878', 'HITCOUNT': '0.890', 'weapon3': '2.052', 'DAMAGECOUNT': '3.891', 'FRAGCOUNT': '11.000'} [2023-02-24 18:28:34,232][177171] DAMAGECOUNT value on done: 111096.0 [2023-02-24 18:28:34,233][177171] Sum rewards: 12.408, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.587', 'AMMO5': '0.017', 'AMMO2': '0.024', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.114', 'AMMO3': '0.118', 'AMMO4': '0.122', 'weapon4': '0.336', 'WEAPON5': '0.400', 'ARMOR': '0.408', 'WEAPON3': '0.850', 'HITCOUNT': '1.040', 'weapon2': '1.148', 'weapon3': '1.968', 'DAMAGECOUNT': '3.789', 'FRAGCOUNT': '11.000'} [2023-02-24 18:28:34,860][177155] DAMAGECOUNT value on done: 116311.0 [2023-02-24 18:28:34,861][177155] Sum rewards: 7.074, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.590', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.020', 'WEAPON1': '0.020', 'weapon7': '0.054', 'weapon5': '0.060', 'AMMO3': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.630', 'WEAPON3': '0.650', 'weapon2': '1.670', 'weapon3': '1.958', 'DAMAGECOUNT': '2.856', 'FRAGCOUNT': '5.000'} [2023-02-24 18:28:35,154][177155] DAMAGECOUNT value on done: 120640.0 [2023-02-24 18:28:35,155][177155] Sum rewards: 9.881, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.470', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon7': '0.046', 'WEAPON1': '0.050', 'AMMO3': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.134', 'weapon5': '0.140', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'weapon4': '0.546', 'HITCOUNT': '0.620', 'weapon2': '0.692', 'weapon3': '1.250', 'DAMAGECOUNT': '3.420', 'FRAGCOUNT': '8.000'} [2023-02-24 18:28:35,463][177155] DAMAGECOUNT value on done: 118978.0 [2023-02-24 18:28:35,464][177155] Sum rewards: 8.909, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.798', 'AMMO5': '0.021', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'weapon7': '0.068', 'AMMO4': '0.112', 'AMMO3': '0.145', 'weapon5': '0.186', 'weapon2': '0.236', 'WEAPON4': '0.300', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.680', 'WEAPON3': '0.900', 'HITCOUNT': '1.060', 'weapon3': '2.066', 'DAMAGECOUNT': '3.570', 'FRAGCOUNT': '11.000'} [2023-02-24 18:28:35,753][177155] DAMAGECOUNT value on done: 112230.0 [2023-02-24 18:28:35,753][177155] Sum rewards: 8.129, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'HEALTH': '0.037', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO3': '0.081', 'AMMO4': '0.082', 'WEAPON4': '0.150', 'weapon4': '0.250', 'WEAPON3': '0.350', 'HITCOUNT': '0.490', 'weapon2': '0.930', 'weapon3': '1.952', 'DAMAGECOUNT': '2.163', 'FRAGCOUNT': '6.000'} [2023-02-24 18:28:36,071][177153] Updated weights for policy 0, policy_version 13460 (0.0008) [2023-02-24 18:28:36,376][177119] Fps is (10 sec: 14336.2, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 55136256. Throughput: 0: 3493.3. Samples: 13777688. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:28:36,376][177119] Avg episode reward: [(0, '9.744')] [2023-02-24 18:28:38,974][177153] Updated weights for policy 0, policy_version 13470 (0.0008) [2023-02-24 18:28:41,376][177119] Fps is (10 sec: 14336.1, 60 sec: 13994.7, 300 sec: 13968.0). Total num frames: 55205888. Throughput: 0: 3498.5. Samples: 13798818. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:28:41,376][177119] Avg episode reward: [(0, '9.744')] [2023-02-24 18:28:41,637][177156] DAMAGECOUNT value on done: 113784.0 [2023-02-24 18:28:41,638][177156] Sum rewards: 14.845, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.476', 'AMMO5': '0.016', 'WEAPON1': '0.040', 'AMMO2': '0.040', 'weapon7': '0.074', 'AMMO3': '0.075', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.202', 'weapon5': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'ARMOR': '0.412', 'WEAPON3': '0.500', 'weapon4': '0.546', 'HITCOUNT': '0.840', 'weapon3': '1.398', 'weapon2': '1.518', 'DAMAGECOUNT': '3.732', 'FRAGCOUNT': '13.000'} [2023-02-24 18:28:41,777][177156] DAMAGECOUNT value on done: 115458.0 [2023-02-24 18:28:41,777][177156] Sum rewards: 12.906, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.035', 'AMMO5': '0.012', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'weapon7': '0.060', 'AMMO3': '0.091', 'AMMO4': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.130', 'weapon4': '0.162', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.900', 'weapon2': '1.072', 'weapon3': '2.232', 'DAMAGECOUNT': '3.702', 'FRAGCOUNT': '9.000'} [2023-02-24 18:28:41,911][177153] Updated weights for policy 0, policy_version 13480 (0.0008) [2023-02-24 18:28:41,942][177156] DAMAGECOUNT value on done: 116732.0 [2023-02-24 18:28:41,942][177156] Sum rewards: 11.464, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.875', 'AMMO2': '0.014', 'AMMO5': '0.017', 'WEAPON1': '0.060', 'AMMO4': '0.071', 'AMMO3': '0.112', 'weapon5': '0.146', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.980', 'weapon2': '1.672', 'weapon3': '1.878', 'DAMAGECOUNT': '3.789', 'FRAGCOUNT': '10.000'} [2023-02-24 18:28:42,084][177156] DAMAGECOUNT value on done: 112846.0 [2023-02-24 18:28:42,085][177156] Sum rewards: 5.819, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.465', 'AMMO5': '0.012', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'AMMO3': '0.066', 'weapon7': '0.096', 'AMMO4': '0.099', 'weapon5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.216', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.440', 'WEAPON3': '0.450', 'weapon4': '0.706', 'weapon3': '1.128', 'DAMAGECOUNT': '2.220', 'FRAGCOUNT': '5.000'} [2023-02-24 18:28:44,844][177153] Updated weights for policy 0, policy_version 13490 (0.0008) [2023-02-24 18:28:46,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.6, 300 sec: 13968.1). Total num frames: 55275520. Throughput: 0: 3496.1. Samples: 13819764. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:28:46,376][177119] Avg episode reward: [(0, '9.704')] [2023-02-24 18:28:46,603][177170] DAMAGECOUNT value on done: 116565.0 [2023-02-24 18:28:46,603][177170] Sum rewards: 7.773, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.800', 'AMMO2': '0.007', 'ARMOR': '0.024', 'AMMO4': '0.036', 'weapon7': '0.054', 'AMMO3': '0.094', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.422', 'HITCOUNT': '0.520', 'WEAPON3': '0.600', 'weapon2': '0.876', 'weapon3': '1.950', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '7.000'} [2023-02-24 18:28:46,897][177170] DAMAGECOUNT value on done: 121351.0 [2023-02-24 18:28:46,897][177170] Sum rewards: 8.064, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.608', 'AMMO5': '0.005', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'AMMO3': '0.060', 'AMMO4': '0.095', 'weapon7': '0.098', 'weapon5': '0.150', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.430', 'weapon4': '0.452', 'weapon2': '1.072', 'weapon3': '1.178', 'DAMAGECOUNT': '2.793', 'FRAGCOUNT': '6.000'} [2023-02-24 18:28:47,106][177170] DAMAGECOUNT value on done: 111725.0 [2023-02-24 18:28:47,107][177170] Sum rewards: 15.840, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.066', 'AMMO5': '0.013', 'ARMOR': '0.016', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'AMMO3': '0.072', 'AMMO4': '0.081', 'weapon7': '0.110', 'WEAPON4': '0.150', 'weapon5': '0.168', 'WEAPON5': '0.200', 'weapon4': '0.264', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.630', 'weapon2': '1.564', 'weapon3': '1.640', 'DAMAGECOUNT': '3.702', 'FRAGCOUNT': '11.000'} [2023-02-24 18:28:47,400][177170] DAMAGECOUNT value on done: 117546.0 [2023-02-24 18:28:47,400][177170] Sum rewards: 4.333, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO4': '0.083', 'AMMO3': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HEALTH': '0.124', 'weapon5': '0.178', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.470', 'weapon3': '1.348', 'DAMAGECOUNT': '1.440', 'weapon2': '2.286', 'FRAGCOUNT': '3.000'} [2023-02-24 18:28:47,765][177153] Updated weights for policy 0, policy_version 13500 (0.0008) [2023-02-24 18:28:48,116][177158] DAMAGECOUNT value on done: 111865.0 [2023-02-24 18:28:48,117][177158] Sum rewards: 2.482, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-2.100', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'ARMOR': '0.004', 'AMMO5': '0.007', 'weapon5': '0.054', 'WEAPON5': '0.100', 'weapon7': '0.104', 'AMMO3': '0.110', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'HITCOUNT': '0.270', 'WEAPON7': '0.400', 'weapon4': '0.416', 'WEAPON3': '0.600', 'weapon2': '0.974', 'DAMAGECOUNT': '1.473', 'weapon3': '1.678', 'FRAGCOUNT': '3.000'} [2023-02-24 18:28:48,416][177158] DAMAGECOUNT value on done: 112546.0 [2023-02-24 18:28:48,416][177158] Sum rewards: 5.375, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.545', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon7': '0.070', 'AMMO3': '0.077', 'weapon5': '0.078', 'AMMO4': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.302', 'ARMOR': '0.455', 'HITCOUNT': '0.490', 'WEAPON3': '0.500', 'weapon2': '1.170', 'weapon3': '1.410', 'DAMAGECOUNT': '1.980', 'FRAGCOUNT': '6.000'} [2023-02-24 18:28:48,849][177158] DAMAGECOUNT value on done: 115324.0 [2023-02-24 18:28:48,850][177158] Sum rewards: 7.648, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.110', 'AMMO5': '0.007', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.072', 'weapon7': '0.084', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'weapon5': '0.188', 'WEAPON4': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.596', 'HITCOUNT': '0.700', 'weapon2': '0.746', 'weapon3': '1.480', 'DAMAGECOUNT': '3.195', 'FRAGCOUNT': '6.000'} [2023-02-24 18:28:49,139][177158] DAMAGECOUNT value on done: 117293.0 [2023-02-24 18:28:49,139][177158] Sum rewards: 2.797, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.776', 'AMMO5': '0.010', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'AMMO3': '0.089', 'AMMO4': '0.110', 'weapon7': '0.128', 'weapon5': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.314', 'AMMO6': '0.320', 'AMMO7': '0.320', 'HITCOUNT': '0.330', 'WEAPON7': '0.400', 'WEAPON3': '0.550', 'weapon2': '1.250', 'DAMAGECOUNT': '1.311', 'weapon3': '1.350', 'FRAGCOUNT': '3.000'} [2023-02-24 18:28:50,256][177158] Large shaping reward 2.612 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.03, -10.0), ('weapon7', 0.002)] [2023-02-24 18:28:50,698][177153] Updated weights for policy 0, policy_version 13510 (0.0009) [2023-02-24 18:28:50,737][177172] DAMAGECOUNT value on done: 114728.0 [2023-02-24 18:28:50,737][177172] Sum rewards: 13.305, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.969', 'AMMO5': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.052', 'WEAPON1': '0.070', 'AMMO3': '0.078', 'weapon5': '0.280', 'WEAPON5': '0.350', 'HITCOUNT': '0.550', 'WEAPON3': '0.600', 'weapon3': '1.584', 'weapon2': '1.824', 'DAMAGECOUNT': '3.366', 'FRAGCOUNT': '10.000'} [2023-02-24 18:28:51,033][177172] DAMAGECOUNT value on done: 115272.0 [2023-02-24 18:28:51,034][177172] Sum rewards: 8.670, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.362', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'weapon7': '0.064', 'weapon5': '0.082', 'AMMO3': '0.089', 'AMMO4': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.266', 'WEAPON5': '0.300', 'HITCOUNT': '0.620', 'WEAPON3': '0.650', 'weapon2': '1.124', 'weapon3': '1.540', 'DAMAGECOUNT': '3.225', 'FRAGCOUNT': '9.000'} [2023-02-24 18:28:51,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 55345152. Throughput: 0: 3494.5. Samples: 13830182. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:28:51,376][177119] Avg episode reward: [(0, '9.332')] [2023-02-24 18:28:51,479][177154] DAMAGECOUNT value on done: 120302.0 [2023-02-24 18:28:51,479][177154] Sum rewards: 6.841, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.045', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO3': '0.040', 'weapon5': '0.044', 'AMMO4': '0.069', 'WEAPON5': '0.200', 'WEAPON3': '0.250', 'weapon7': '0.272', 'AMMO6': '0.340', 'AMMO7': '0.340', 'weapon2': '0.406', 'HITCOUNT': '0.430', 'WEAPON4': '0.450', 'WEAPON7': '0.500', 'weapon3': '0.892', 'weapon4': '0.994', 'DAMAGECOUNT': '2.625', 'FRAGCOUNT': '6.000'} [2023-02-24 18:28:51,769][177154] DAMAGECOUNT value on done: 120799.0 [2023-02-24 18:28:51,769][177154] Sum rewards: 4.328, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.600', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.013', 'WEAPON1': '0.040', 'AMMO3': '0.051', 'weapon5': '0.056', 'WEAPON5': '0.100', 'weapon7': '0.168', 'WEAPON4': '0.300', 'AMMO6': '0.360', 'AMMO7': '0.360', 'WEAPON3': '0.400', 'weapon4': '0.472', 'WEAPON7': '0.600', 'HITCOUNT': '0.690', 'weapon3': '0.810', 'weapon2': '1.514', 'DAMAGECOUNT': '2.988', 'FRAGCOUNT': '3.000'} [2023-02-24 18:28:51,982][177154] DAMAGECOUNT value on done: 117627.0 [2023-02-24 18:28:51,983][177154] Sum rewards: 7.677, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.478', 'AMMO5': '0.010', 'AMMO2': '0.010', 'WEAPON1': '0.040', 'AMMO4': '0.050', 'weapon7': '0.052', 'AMMO3': '0.095', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'weapon2': '1.680', 'weapon3': '1.946', 'DAMAGECOUNT': '2.532', 'FRAGCOUNT': '5.000'} [2023-02-24 18:28:52,193][177172] DAMAGECOUNT value on done: 117320.0 [2023-02-24 18:28:52,194][177172] Sum rewards: 9.224, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.160', 'AMMO5': '0.007', 'AMMO2': '0.023', 'WEAPON1': '0.050', 'AMMO3': '0.113', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'weapon5': '0.190', 'WEAPON5': '0.200', 'ARMOR': '0.424', 'weapon4': '0.478', 'HITCOUNT': '0.660', 'WEAPON3': '0.700', 'weapon2': '1.368', 'weapon3': '1.644', 'DAMAGECOUNT': '2.760', 'FRAGCOUNT': '9.000'} [2023-02-24 18:28:52,284][177154] DAMAGECOUNT value on done: 122713.0 [2023-02-24 18:28:52,284][177154] Sum rewards: 5.627, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.230', 'weapon7': '0.006', 'AMMO2': '0.008', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'weapon5': '0.026', 'ARMOR': '0.036', 'AMMO4': '0.039', 'WEAPON4': '0.100', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.202', 'weapon4': '0.224', 'WEAPON5': '0.300', 'weapon2': '0.610', 'HITCOUNT': '0.910', 'WEAPON3': '1.350', 'weapon3': '2.582', 'DAMAGECOUNT': '4.080', 'FRAGCOUNT': '10.500'} [2023-02-24 18:28:52,505][177172] DAMAGECOUNT value on done: 115716.0 [2023-02-24 18:28:52,505][177172] Sum rewards: 8.804, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.225', 'AMMO5': '0.010', 'AMMO2': '0.038', 'WEAPON1': '0.040', 'AMMO3': '0.088', 'weapon5': '0.138', 'WEAPON4': '0.150', 'weapon4': '0.190', 'AMMO4': '0.192', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.610', 'weapon3': '1.566', 'weapon2': '1.968', 'DAMAGECOUNT': '2.688', 'FRAGCOUNT': '6.000'} [2023-02-24 18:28:52,811][177171] DAMAGECOUNT value on done: 118297.0 [2023-02-24 18:28:52,812][177171] Sum rewards: 8.346, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.525', 'AMMO2': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.048', 'WEAPON1': '0.060', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'weapon5': '0.182', 'weapon4': '0.210', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.570', 'weapon3': '1.478', 'weapon2': '1.784', 'DAMAGECOUNT': '2.739', 'FRAGCOUNT': '6.000'} [2023-02-24 18:28:53,040][177157] DAMAGECOUNT value on done: 113604.0 [2023-02-24 18:28:53,041][177157] Sum rewards: 11.828, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'AMMO3': '0.041', 'weapon7': '0.052', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'weapon5': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HEALTH': '0.130', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.238', 'WEAPON3': '0.250', 'HITCOUNT': '0.520', 'weapon3': '0.996', 'weapon2': '1.640', 'DAMAGECOUNT': '2.007', 'FRAGCOUNT': '8.000'} [2023-02-24 18:28:53,053][177157] DAMAGECOUNT value on done: 118674.0 [2023-02-24 18:28:53,053][177157] Sum rewards: 2.576, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.842', 'AMMO5': '0.012', 'AMMO2': '0.022', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.118', 'WEAPON4': '0.150', 'weapon5': '0.218', 'WEAPON5': '0.300', 'weapon4': '0.304', 'HITCOUNT': '0.620', 'WEAPON3': '0.750', 'weapon2': '0.924', 'weapon3': '2.016', 'DAMAGECOUNT': '3.222', 'FRAGCOUNT': '4.000'} [2023-02-24 18:28:53,106][177171] DAMAGECOUNT value on done: 116482.0 [2023-02-24 18:28:53,106][177171] Sum rewards: 7.937, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.230', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.029', 'WEAPON1': '0.040', 'weapon7': '0.052', 'AMMO3': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.147', 'weapon5': '0.166', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.380', 'WEAPON3': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.546', 'weapon3': '1.076', 'weapon2': '1.904', 'DAMAGECOUNT': '2.901', 'FRAGCOUNT': '7.000'} [2023-02-24 18:28:53,174][177171] DAMAGECOUNT value on done: 113241.0 [2023-02-24 18:28:53,175][177171] Sum rewards: 7.788, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.018', 'AMMO2': '0.010', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO4': '0.050', 'AMMO3': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon5': '0.356', 'weapon4': '0.436', 'ARMOR': '0.471', 'WEAPON3': '0.600', 'HITCOUNT': '0.630', 'weapon2': '0.822', 'weapon3': '1.400', 'DAMAGECOUNT': '2.610', 'FRAGCOUNT': '7.000'} [2023-02-24 18:28:53,341][177157] DAMAGECOUNT value on done: 112424.0 [2023-02-24 18:28:53,342][177157] Sum rewards: 10.912, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.455', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'ARMOR': '0.046', 'weapon7': '0.046', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.109', 'weapon5': '0.126', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'weapon4': '0.216', 'WEAPON4': '0.250', 'WEAPON3': '0.650', 'HITCOUNT': '0.870', 'weapon2': '1.326', 'weapon3': '2.036', 'DAMAGECOUNT': '3.312', 'FRAGCOUNT': '10.000'} [2023-02-24 18:28:53,352][177157] DAMAGECOUNT value on done: 116051.0 [2023-02-24 18:28:53,353][177157] Sum rewards: 11.170, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.316', 'AMMO5': '0.012', 'AMMO2': '0.020', 'WEAPON1': '0.060', 'AMMO3': '0.087', 'AMMO4': '0.100', 'weapon5': '0.262', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.630', 'weapon2': '1.622', 'weapon3': '1.790', 'DAMAGECOUNT': '3.252', 'FRAGCOUNT': '8.000'} [2023-02-24 18:28:53,480][177171] DAMAGECOUNT value on done: 111825.0 [2023-02-24 18:28:53,481][177171] Sum rewards: 7.665, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.004', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.072', 'weapon5': '0.076', 'weapon7': '0.088', 'AMMO3': '0.117', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'ARMOR': '0.461', 'HITCOUNT': '0.490', 'weapon4': '0.596', 'weapon2': '0.656', 'WEAPON3': '0.700', 'weapon3': '1.374', 'DAMAGECOUNT': '2.187', 'FRAGCOUNT': '8.000'} [2023-02-24 18:28:53,608][177153] Updated weights for policy 0, policy_version 13520 (0.0008) [2023-02-24 18:28:54,077][177155] DAMAGECOUNT value on done: 117589.0 [2023-02-24 18:28:54,077][177155] Sum rewards: 12.371, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.710', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.062', 'weapon4': '0.066', 'AMMO3': '0.155', 'weapon5': '0.170', 'WEAPON5': '0.200', 'HITCOUNT': '0.800', 'WEAPON3': '0.950', 'weapon2': '1.262', 'weapon3': '2.222', 'DAMAGECOUNT': '3.834', 'FRAGCOUNT': '13.000'} [2023-02-24 18:28:54,374][177155] DAMAGECOUNT value on done: 121315.0 [2023-02-24 18:28:54,375][177155] Sum rewards: 3.376, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.685', 'AMMO2': '0.009', 'AMMO5': '0.022', 'AMMO4': '0.044', 'weapon7': '0.054', 'WEAPON1': '0.080', 'AMMO3': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.184', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.442', 'WEAPON5': '0.500', 'HITCOUNT': '0.540', 'WEAPON3': '0.550', 'weapon2': '0.556', 'weapon3': '1.468', 'DAMAGECOUNT': '2.025', 'FRAGCOUNT': '4.500'} [2023-02-24 18:28:54,679][177155] DAMAGECOUNT value on done: 120337.0 [2023-02-24 18:28:54,679][177155] Sum rewards: 14.058, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.200', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.018', 'WEAPON1': '0.020', 'weapon7': '0.048', 'weapon5': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.143', 'WEAPON5': '0.150', 'WEAPON3': '0.950', 'HITCOUNT': '1.030', 'weapon2': '1.692', 'weapon3': '1.996', 'DAMAGECOUNT': '4.077', 'FRAGCOUNT': '13.000'} [2023-02-24 18:28:54,983][177155] DAMAGECOUNT value on done: 113163.0 [2023-02-24 18:28:54,984][177155] Sum rewards: 6.905, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.004', 'AMMO5': '0.015', 'AMMO2': '0.017', 'weapon7': '0.018', 'WEAPON1': '0.050', 'weapon5': '0.056', 'AMMO4': '0.082', 'AMMO3': '0.126', 'WEAPON5': '0.300', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.476', 'HITCOUNT': '0.630', 'WEAPON3': '0.750', 'weapon2': '1.124', 'weapon3': '1.966', 'DAMAGECOUNT': '2.799', 'FRAGCOUNT': '8.000'} [2023-02-24 18:28:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 55414784. Throughput: 0: 3497.2. Samples: 13851182. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:28:56,376][177119] Avg episode reward: [(0, '9.259')] [2023-02-24 18:28:56,381][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000013529_55414784.pth... [2023-02-24 18:28:56,440][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000012710_52060160.pth [2023-02-24 18:28:56,604][177153] Updated weights for policy 0, policy_version 13530 (0.0008) [2023-02-24 18:28:59,516][177153] Updated weights for policy 0, policy_version 13540 (0.0008) [2023-02-24 18:29:00,853][177156] DAMAGECOUNT value on done: 114592.0 [2023-02-24 18:29:00,853][177156] Sum rewards: 5.726, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.838', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon7': '0.050', 'weapon5': '0.062', 'AMMO3': '0.074', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.228', 'WEAPON3': '0.500', 'HITCOUNT': '0.500', 'weapon2': '0.714', 'weapon3': '0.802', 'DAMAGECOUNT': '2.424', 'FRAGCOUNT': '5.000'} [2023-02-24 18:29:00,969][177156] DAMAGECOUNT value on done: 116153.0 [2023-02-24 18:29:00,969][177156] Sum rewards: 9.415, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.002', 'AMMO4': '0.012', 'AMMO5': '0.020', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO3': '0.062', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.192', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HEALTH': '0.330', 'WEAPON3': '0.350', 'WEAPON5': '0.400', 'HITCOUNT': '0.430', 'weapon4': '0.434', 'weapon3': '1.300', 'weapon2': '1.310', 'DAMAGECOUNT': '2.085', 'FRAGCOUNT': '7.000'} [2023-02-24 18:29:01,158][177156] DAMAGECOUNT value on done: 117632.0 [2023-02-24 18:29:01,159][177156] Sum rewards: 6.135, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.050', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'weapon4': '0.030', 'AMMO2': '0.033', 'weapon7': '0.050', 'weapon5': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.140', 'AMMO4': '0.167', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.660', 'WEAPON3': '0.950', 'weapon2': '1.582', 'weapon3': '2.074', 'DAMAGECOUNT': '2.700', 'FRAGCOUNT': '7.000'} [2023-02-24 18:29:01,279][177156] DAMAGECOUNT value on done: 113810.0 [2023-02-24 18:29:01,280][177156] Sum rewards: 4.761, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.589', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.006', 'WEAPON1': '0.040', 'AMMO3': '0.051', 'weapon7': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.140', 'weapon5': '0.142', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'weapon3': '0.860', 'weapon2': '1.350', 'DAMAGECOUNT': '1.680', 'FRAGCOUNT': '3.000'} [2023-02-24 18:29:01,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 55484416. Throughput: 0: 3493.7. Samples: 13872050. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:29:01,376][177119] Avg episode reward: [(0, '9.081')] [2023-02-24 18:29:02,470][177153] Updated weights for policy 0, policy_version 13550 (0.0008) [2023-02-24 18:29:05,373][177153] Updated weights for policy 0, policy_version 13560 (0.0009) [2023-02-24 18:29:05,900][177170] DAMAGECOUNT value on done: 117552.0 [2023-02-24 18:29:05,902][177170] Sum rewards: 6.418, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.072', 'AMMO5': '0.007', 'weapon5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'ARMOR': '0.028', 'AMMO3': '0.099', 'weapon7': '0.100', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.676', 'WEAPON3': '0.700', 'HITCOUNT': '0.780', 'weapon2': '0.884', 'weapon3': '1.594', 'DAMAGECOUNT': '2.961', 'FRAGCOUNT': '8.000'} [2023-02-24 18:29:06,188][177170] DAMAGECOUNT value on done: 122737.0 [2023-02-24 18:29:06,189][177170] Sum rewards: 9.373, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.422', 'ARMOR': '0.004', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'AMMO2': '0.033', 'weapon5': '0.078', 'AMMO3': '0.129', 'AMMO4': '0.163', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.404', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'weapon2': '0.980', 'HITCOUNT': '1.130', 'weapon3': '2.064', 'DAMAGECOUNT': '4.158', 'FRAGCOUNT': '9.000'} [2023-02-24 18:29:06,220][177172] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon4', 0.002)] [2023-02-24 18:29:06,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 55554048. Throughput: 0: 3493.6. Samples: 13882556. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:29:06,376][177119] Avg episode reward: [(0, '9.047')] [2023-02-24 18:29:06,409][177170] DAMAGECOUNT value on done: 112789.0 [2023-02-24 18:29:06,410][177170] Sum rewards: 2.147, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.858', 'AMMO5': '0.013', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.072', 'AMMO4': '0.075', 'AMMO3': '0.133', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.678', 'WEAPON3': '0.850', 'weapon2': '0.870', 'HITCOUNT': '0.910', 'weapon3': '2.028', 'DAMAGECOUNT': '3.192', 'FRAGCOUNT': '5.000'} [2023-02-24 18:29:06,705][177170] DAMAGECOUNT value on done: 118285.0 [2023-02-24 18:29:06,706][177170] Sum rewards: 9.908, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.003', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO4': '0.048', 'AMMO3': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.188', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'weapon4': '0.460', 'HITCOUNT': '0.620', 'weapon2': '0.840', 'weapon3': '1.498', 'DAMAGECOUNT': '2.217', 'FRAGCOUNT': '6.500'} [2023-02-24 18:29:07,349][177158] DAMAGECOUNT value on done: 112921.0 [2023-02-24 18:29:07,349][177158] Sum rewards: 7.181, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.809', 'ARMOR': '0.008', 'AMMO5': '0.024', 'AMMO2': '0.039', 'WEAPON1': '0.060', 'AMMO3': '0.100', 'weapon7': '0.108', 'weapon5': '0.164', 'AMMO4': '0.196', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'weapon4': '0.380', 'WEAPON5': '0.600', 'HITCOUNT': '0.660', 'WEAPON3': '0.750', 'weapon2': '1.438', 'weapon3': '1.554', 'DAMAGECOUNT': '3.168', 'FRAGCOUNT': '5.500'} [2023-02-24 18:29:07,649][177158] DAMAGECOUNT value on done: 114080.0 [2023-02-24 18:29:07,649][177158] Sum rewards: 10.907, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.356', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO3': '0.079', 'AMMO4': '0.136', 'weapon7': '0.148', 'WEAPON3': '0.400', 'AMMO6': '0.440', 'AMMO7': '0.440', 'WEAPON4': '0.450', 'WEAPON7': '0.600', 'HITCOUNT': '0.740', 'weapon2': '1.000', 'weapon4': '1.024', 'weapon3': '1.178', 'DAMAGECOUNT': '3.798', 'FRAGCOUNT': '9.000'} [2023-02-24 18:29:08,109][177158] DAMAGECOUNT value on done: 116934.0 [2023-02-24 18:29:08,110][177158] Sum rewards: 8.406, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.272', 'AMMO5': '0.016', 'AMMO2': '0.029', 'WEAPON1': '0.050', 'AMMO4': '0.144', 'weapon5': '0.158', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.201', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.562', 'weapon4': '0.594', 'HITCOUNT': '1.190', 'WEAPON3': '1.250', 'weapon3': '2.304', 'DAMAGECOUNT': '4.830', 'FRAGCOUNT': '13.000'} [2023-02-24 18:29:08,277][177153] Updated weights for policy 0, policy_version 13570 (0.0008) [2023-02-24 18:29:08,408][177158] DAMAGECOUNT value on done: 117893.0 [2023-02-24 18:29:08,409][177158] Sum rewards: 3.996, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.555', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO3': '0.086', 'AMMO4': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.190', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.330', 'WEAPON3': '0.450', 'weapon4': '0.460', 'weapon2': '1.190', 'weapon3': '1.654', 'DAMAGECOUNT': '1.800', 'FRAGCOUNT': '4.000'} [2023-02-24 18:29:09,913][177172] DAMAGECOUNT value on done: 115966.0 [2023-02-24 18:29:09,914][177172] Sum rewards: 12.721, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.570', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon4': '0.038', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.073', 'AMMO4': '0.119', 'weapon5': '0.224', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '0.590', 'weapon3': '1.456', 'weapon2': '2.098', 'DAMAGECOUNT': '3.714', 'FRAGCOUNT': '10.000'} [2023-02-24 18:29:10,212][177172] DAMAGECOUNT value on done: 116278.0 [2023-02-24 18:29:10,212][177172] Sum rewards: 5.794, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.305', 'AMMO5': '0.011', 'AMMO2': '0.018', 'weapon7': '0.048', 'WEAPON1': '0.070', 'AMMO4': '0.088', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.224', 'weapon4': '0.236', 'WEAPON5': '0.350', 'HITCOUNT': '0.580', 'WEAPON3': '0.700', 'weapon2': '0.952', 'weapon3': '1.548', 'DAMAGECOUNT': '2.886', 'FRAGCOUNT': '5.500'} [2023-02-24 18:29:10,769][177154] DAMAGECOUNT value on done: 121447.0 [2023-02-24 18:29:10,769][177154] Sum rewards: 12.469, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.620', 'AMMO2': '0.010', 'AMMO5': '0.010', 'weapon4': '0.044', 'AMMO4': '0.049', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'weapon5': '0.124', 'WEAPON5': '0.250', 'WEAPON3': '0.750', 'HITCOUNT': '0.840', 'weapon2': '1.744', 'weapon3': '1.812', 'DAMAGECOUNT': '3.435', 'FRAGCOUNT': '12.000'} [2023-02-24 18:29:11,072][177154] DAMAGECOUNT value on done: 121483.0 [2023-02-24 18:29:11,072][177154] Sum rewards: 2.361, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.186', 'AMMO2': '0.016', 'weapon4': '0.022', 'AMMO5': '0.023', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO4': '0.081', 'weapon7': '0.090', 'AMMO3': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.416', 'WEAPON5': '0.450', 'HITCOUNT': '0.470', 'WEAPON3': '0.600', 'weapon2': '0.840', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '2.052', 'weapon3': '2.076'} [2023-02-24 18:29:11,226][177153] Updated weights for policy 0, policy_version 13580 (0.0009) [2023-02-24 18:29:11,285][177154] DAMAGECOUNT value on done: 118537.0 [2023-02-24 18:29:11,286][177154] Sum rewards: 6.063, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.720', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'weapon5': '0.046', 'AMMO4': '0.069', 'AMMO3': '0.072', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.442', 'WEAPON3': '0.550', 'HITCOUNT': '0.790', 'weapon3': '1.482', 'weapon2': '1.700', 'DAMAGECOUNT': '2.730', 'FRAGCOUNT': '6.000'} [2023-02-24 18:29:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 55623680. Throughput: 0: 3493.6. Samples: 13903504. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:29:11,376][177119] Avg episode reward: [(0, '8.979')] [2023-02-24 18:29:11,384][177172] DAMAGECOUNT value on done: 117765.0 [2023-02-24 18:29:11,384][177172] Sum rewards: 3.599, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.080', 'AMMO5': '0.015', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'AMMO3': '0.100', 'AMMO4': '0.125', 'weapon5': '0.176', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'HITCOUNT': '0.400', 'weapon4': '0.538', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.335', 'weapon2': '1.342', 'weapon3': '1.342', 'FRAGCOUNT': '4.000'} [2023-02-24 18:29:11,589][177154] DAMAGECOUNT value on done: 123640.0 [2023-02-24 18:29:11,590][177154] Sum rewards: 8.309, reward structure: {'DEATHCOUNT': '-8.250', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.023', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.118', 'weapon5': '0.146', 'weapon4': '0.162', 'WEAPON5': '0.300', 'HEALTH': '0.320', 'WEAPON3': '0.500', 'HITCOUNT': '0.650', 'weapon2': '1.468', 'weapon3': '1.806', 'DAMAGECOUNT': '2.781', 'FRAGCOUNT': '8.000'} [2023-02-24 18:29:11,683][177172] DAMAGECOUNT value on done: 116884.0 [2023-02-24 18:29:11,683][177172] Sum rewards: 10.554, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO2': '0.043', 'AMMO3': '0.088', 'HEALTH': '0.140', 'weapon5': '0.146', 'WEAPON4': '0.200', 'AMMO4': '0.215', 'WEAPON5': '0.250', 'ARMOR': '0.408', 'weapon4': '0.430', 'WEAPON3': '0.550', 'HITCOUNT': '0.730', 'weapon2': '1.446', 'weapon3': '1.604', 'DAMAGECOUNT': '3.504', 'FRAGCOUNT': '9.000'} [2023-02-24 18:29:12,091][177171] DAMAGECOUNT value on done: 119610.0 [2023-02-24 18:29:12,091][177171] Sum rewards: 7.352, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.850', 'AMMO5': '0.020', 'ARMOR': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.050', 'weapon5': '0.106', 'AMMO3': '0.113', 'AMMO4': '0.251', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '0.750', 'weapon2': '0.840', 'HITCOUNT': '1.020', 'weapon4': '1.028', 'weapon3': '1.644', 'DAMAGECOUNT': '3.939', 'FRAGCOUNT': '9.000'} [2023-02-24 18:29:12,243][177157] DAMAGECOUNT value on done: 114736.0 [2023-02-24 18:29:12,243][177157] Sum rewards: 9.495, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.890', 'AMMO5': '0.014', 'ARMOR': '0.032', 'AMMO2': '0.049', 'WEAPON1': '0.070', 'weapon7': '0.080', 'AMMO3': '0.110', 'weapon5': '0.192', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.244', 'WEAPON5': '0.350', 'weapon4': '0.450', 'WEAPON4': '0.650', 'weapon2': '0.664', 'WEAPON3': '0.750', 'HITCOUNT': '1.020', 'weapon3': '2.214', 'DAMAGECOUNT': '3.396', 'FRAGCOUNT': '11.000'} [2023-02-24 18:29:12,254][177157] DAMAGECOUNT value on done: 119786.0 [2023-02-24 18:29:12,255][177157] Sum rewards: 9.075, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.906', 'AMMO5': '0.013', 'ARMOR': '0.024', 'AMMO2': '0.030', 'weapon7': '0.044', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.074', 'weapon5': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.152', 'WEAPON7': '0.200', 'weapon4': '0.204', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.690', 'weapon3': '1.614', 'weapon2': '1.626', 'DAMAGECOUNT': '3.336', 'FRAGCOUNT': '6.000'} [2023-02-24 18:29:12,391][177171] DAMAGECOUNT value on done: 117588.0 [2023-02-24 18:29:12,391][177171] Sum rewards: 1.851, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.246', 'AMMO5': '0.017', 'AMMO2': '0.024', 'ARMOR': '0.032', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.104', 'AMMO4': '0.118', 'AMMO3': '0.160', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.526', 'weapon2': '0.546', 'HITCOUNT': '0.780', 'WEAPON3': '0.950', 'weapon3': '1.974', 'DAMAGECOUNT': '3.318', 'FRAGCOUNT': '5.500'} [2023-02-24 18:29:12,458][177171] DAMAGECOUNT value on done: 113976.0 [2023-02-24 18:29:12,458][177171] Sum rewards: 8.501, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.030', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO3': '0.088', 'weapon5': '0.178', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'HEALTH': '0.387', 'weapon4': '0.400', 'HITCOUNT': '0.440', 'WEAPON3': '0.450', 'weapon2': '1.150', 'weapon3': '1.624', 'DAMAGECOUNT': '2.205', 'FRAGCOUNT': '7.000'} [2023-02-24 18:29:12,551][177157] DAMAGECOUNT value on done: 113484.0 [2023-02-24 18:29:12,552][177157] Sum rewards: 15.218, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.560', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.077', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.110', 'WEAPON5': '0.200', 'WEAPON3': '0.500', 'HITCOUNT': '0.790', 'weapon3': '1.550', 'weapon2': '1.656', 'DAMAGECOUNT': '3.180', 'FRAGCOUNT': '11.000'} [2023-02-24 18:29:12,562][177157] DAMAGECOUNT value on done: 117080.0 [2023-02-24 18:29:12,563][177157] Sum rewards: 10.110, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.821', 'AMMO5': '0.005', 'AMMO2': '0.015', 'ARMOR': '0.016', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.072', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO3': '0.120', 'WEAPON3': '0.800', 'HITCOUNT': '0.880', 'weapon2': '1.670', 'weapon3': '1.898', 'DAMAGECOUNT': '3.087', 'FRAGCOUNT': '11.000'} [2023-02-24 18:29:12,756][177171] DAMAGECOUNT value on done: 112988.0 [2023-02-24 18:29:12,756][177171] Sum rewards: 9.152, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.058', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'weapon7': '0.102', 'AMMO3': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.242', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'weapon3': '1.182', 'weapon2': '1.648', 'DAMAGECOUNT': '3.489', 'FRAGCOUNT': '8.000'} [2023-02-24 18:29:12,883][177170] Large shaping reward 3.640 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-24 18:29:13,362][177155] DAMAGECOUNT value on done: 118526.0 [2023-02-24 18:29:13,362][177155] Sum rewards: 12.497, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.185', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'AMMO3': '0.058', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.108', 'weapon7': '0.116', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.300', 'WEAPON7': '0.400', 'HITCOUNT': '0.430', 'weapon3': '0.820', 'weapon2': '1.840', 'DAMAGECOUNT': '2.811', 'FRAGCOUNT': '8.000'} [2023-02-24 18:29:13,662][177155] DAMAGECOUNT value on done: 122222.0 [2023-02-24 18:29:13,662][177155] Sum rewards: 4.990, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.818', 'AMMO2': '0.007', 'AMMO5': '0.019', 'AMMO4': '0.037', 'WEAPON1': '0.040', 'weapon5': '0.126', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'weapon4': '0.314', 'WEAPON5': '0.400', 'ARMOR': '0.448', 'WEAPON3': '0.850', 'HITCOUNT': '0.850', 'weapon2': '1.390', 'weapon3': '1.824', 'DAMAGECOUNT': '2.721', 'FRAGCOUNT': '7.000'} [2023-02-24 18:29:14,006][177155] DAMAGECOUNT value on done: 121347.0 [2023-02-24 18:29:14,007][177155] Sum rewards: 11.300, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.070', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'weapon7': '0.054', 'AMMO3': '0.068', 'weapon5': '0.114', 'AMMO4': '0.123', 'weapon4': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.640', 'weapon3': '1.074', 'weapon2': '1.330', 'DAMAGECOUNT': '3.030', 'FRAGCOUNT': '7.500'} [2023-02-24 18:29:14,203][177153] Updated weights for policy 0, policy_version 13590 (0.0008) [2023-02-24 18:29:14,311][177155] DAMAGECOUNT value on done: 114476.0 [2023-02-24 18:29:14,311][177155] Sum rewards: 10.768, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.648', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.051', 'AMMO3': '0.111', 'weapon5': '0.114', 'WEAPON4': '0.150', 'weapon4': '0.162', 'WEAPON5': '0.200', 'WEAPON3': '0.800', 'HITCOUNT': '1.060', 'weapon2': '1.508', 'weapon3': '2.036', 'DAMAGECOUNT': '3.939', 'FRAGCOUNT': '12.000'} [2023-02-24 18:29:15,597][177155] Large shaping reward 2.611 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.579, 193.0), ('weapon7', 0.002)] [2023-02-24 18:29:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 55693312. Throughput: 0: 3492.9. Samples: 13924434. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:29:16,376][177119] Avg episode reward: [(0, '9.033')] [2023-02-24 18:29:17,149][177153] Updated weights for policy 0, policy_version 13600 (0.0008) [2023-02-24 18:29:20,087][177153] Updated weights for policy 0, policy_version 13610 (0.0008) [2023-02-24 18:29:20,128][177156] DAMAGECOUNT value on done: 115417.0 [2023-02-24 18:29:20,129][177156] Sum rewards: 7.207, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.828', 'AMMO5': '0.006', 'WEAPON1': '0.030', 'AMMO2': '0.037', 'weapon7': '0.052', 'AMMO3': '0.083', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO4': '0.187', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.475', 'WEAPON3': '0.550', 'HITCOUNT': '0.600', 'weapon4': '0.742', 'weapon2': '0.768', 'weapon3': '1.326', 'DAMAGECOUNT': '2.475', 'FRAGCOUNT': '7.000'} [2023-02-24 18:29:20,239][177156] DAMAGECOUNT value on done: 117167.0 [2023-02-24 18:29:20,239][177156] Sum rewards: 7.948, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.430', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'weapon5': '0.048', 'weapon7': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.564', 'WEAPON3': '0.700', 'HITCOUNT': '0.830', 'weapon2': '1.014', 'weapon3': '2.044', 'DAMAGECOUNT': '3.042', 'FRAGCOUNT': '8.000'} [2023-02-24 18:29:20,441][177156] DAMAGECOUNT value on done: 118208.0 [2023-02-24 18:29:20,442][177156] Sum rewards: 4.439, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.188', 'AMMO5': '0.010', 'ARMOR': '0.040', 'WEAPON1': '0.040', 'weapon5': '0.040', 'AMMO2': '0.043', 'AMMO3': '0.083', 'weapon7': '0.168', 'WEAPON5': '0.200', 'weapon2': '0.204', 'AMMO4': '0.213', 'WEAPON4': '0.250', 'WEAPON7': '0.400', 'AMMO6': '0.400', 'AMMO7': '0.400', 'HITCOUNT': '0.420', 'WEAPON3': '0.500', 'weapon3': '0.952', 'weapon4': '1.036', 'DAMAGECOUNT': '1.728', 'FRAGCOUNT': '5.000'} [2023-02-24 18:29:20,550][177156] DAMAGECOUNT value on done: 114856.0 [2023-02-24 18:29:20,551][177156] Sum rewards: 7.838, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.881', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon7': '0.048', 'WEAPON1': '0.060', 'AMMO3': '0.092', 'weapon5': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.125', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.562', 'HITCOUNT': '0.610', 'WEAPON3': '0.650', 'weapon2': '0.764', 'weapon3': '1.886', 'DAMAGECOUNT': '3.138', 'FRAGCOUNT': '8.000'} [2023-02-24 18:29:21,337][177172] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 18:29:21,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 55762944. Throughput: 0: 3491.2. Samples: 13934794. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:29:21,376][177119] Avg episode reward: [(0, '8.930')] [2023-02-24 18:29:23,008][177153] Updated weights for policy 0, policy_version 13620 (0.0008) [2023-02-24 18:29:25,183][177170] DAMAGECOUNT value on done: 119167.0 [2023-02-24 18:29:25,184][177170] Sum rewards: 20.171, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.600', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'weapon5': '0.060', 'AMMO4': '0.078', 'weapon7': '0.102', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.272', 'WEAPON7': '0.300', 'WEAPON3': '0.850', 'HITCOUNT': '0.850', 'weapon2': '1.132', 'weapon3': '1.946', 'DAMAGECOUNT': '4.674', 'FRAGCOUNT': '17.000'} [2023-02-24 18:29:25,497][177170] DAMAGECOUNT value on done: 124840.0 [2023-02-24 18:29:25,497][177170] Sum rewards: 13.633, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.177', 'ARMOR': '0.004', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.166', 'AMMO3': '0.172', 'WEAPON4': '0.250', 'weapon4': '0.312', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon2': '1.136', 'HITCOUNT': '1.300', 'weapon3': '2.056', 'DAMAGECOUNT': '6.309', 'FRAGCOUNT': '15.000'} [2023-02-24 18:29:25,725][177170] DAMAGECOUNT value on done: 113967.0 [2023-02-24 18:29:25,725][177170] Sum rewards: 9.967, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.462', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'weapon5': '0.118', 'AMMO3': '0.126', 'AMMO4': '0.166', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.516', 'weapon4': '0.526', 'WEAPON3': '0.800', 'HITCOUNT': '0.930', 'weapon2': '1.016', 'weapon3': '2.080', 'DAMAGECOUNT': '3.534', 'FRAGCOUNT': '9.000'} [2023-02-24 18:29:25,957][177153] Updated weights for policy 0, policy_version 13630 (0.0008) [2023-02-24 18:29:26,022][177170] DAMAGECOUNT value on done: 118838.0 [2023-02-24 18:29:26,022][177170] Sum rewards: 5.020, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.692', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO3': '0.056', 'AMMO4': '0.073', 'weapon5': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.270', 'weapon4': '0.270', 'WEAPON3': '0.400', 'weapon2': '0.650', 'weapon3': '1.046', 'DAMAGECOUNT': '1.659', 'FRAGCOUNT': '5.000'} [2023-02-24 18:29:26,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 55832576. Throughput: 0: 3486.3. Samples: 13955700. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:29:26,376][177119] Avg episode reward: [(0, '8.956')] [2023-02-24 18:29:26,640][177158] DAMAGECOUNT value on done: 114283.0 [2023-02-24 18:29:26,640][177158] Sum rewards: 12.553, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.336', 'AMMO5': '0.008', 'AMMO2': '0.008', 'ARMOR': '0.040', 'AMMO4': '0.042', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.120', 'AMMO3': '0.127', 'weapon4': '0.240', 'WEAPON5': '0.250', 'WEAPON3': '0.800', 'HITCOUNT': '0.950', 'weapon2': '1.224', 'weapon3': '1.894', 'DAMAGECOUNT': '4.086', 'FRAGCOUNT': '12.000'} [2023-02-24 18:29:26,940][177158] DAMAGECOUNT value on done: 114985.0 [2023-02-24 18:29:26,941][177158] Sum rewards: 7.035, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.174', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.021', 'WEAPON1': '0.050', 'weapon7': '0.060', 'AMMO3': '0.072', 'AMMO4': '0.102', 'weapon5': '0.156', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.360', 'WEAPON3': '0.550', 'HITCOUNT': '0.720', 'weapon3': '1.334', 'weapon2': '1.656', 'DAMAGECOUNT': '2.715', 'FRAGCOUNT': '8.000'} [2023-02-24 18:29:27,429][177158] DAMAGECOUNT value on done: 118232.0 [2023-02-24 18:29:27,429][177158] Sum rewards: 11.011, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.093', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.035', 'weapon7': '0.056', 'weapon5': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'AMMO4': '0.176', 'WEAPON4': '0.250', 'weapon4': '0.766', 'weapon2': '0.786', 'WEAPON3': '0.900', 'HITCOUNT': '1.100', 'weapon3': '2.002', 'DAMAGECOUNT': '3.894', 'FRAGCOUNT': '12.000'} [2023-02-24 18:29:27,719][177158] DAMAGECOUNT value on done: 118648.0 [2023-02-24 18:29:27,720][177158] Sum rewards: 8.583, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.065', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.045', 'AMMO4': '0.049', 'weapon5': '0.062', 'weapon2': '0.094', 'weapon7': '0.096', 'WEAPON5': '0.100', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.520', 'weapon3': '0.862', 'weapon4': '0.874', 'DAMAGECOUNT': '2.265', 'FRAGCOUNT': '7.000'} [2023-02-24 18:29:28,882][177153] Updated weights for policy 0, policy_version 13640 (0.0008) [2023-02-24 18:29:29,246][177172] DAMAGECOUNT value on done: 116666.0 [2023-02-24 18:29:29,247][177172] Sum rewards: 7.391, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.508', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon7': '0.052', 'AMMO3': '0.060', 'WEAPON1': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.215', 'weapon5': '0.266', 'WEAPON4': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.490', 'WEAPON5': '0.500', 'weapon4': '0.586', 'weapon2': '1.292', 'weapon3': '1.368', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '8.000'} [2023-02-24 18:29:29,546][177172] DAMAGECOUNT value on done: 117582.0 [2023-02-24 18:29:29,547][177172] Sum rewards: 14.603, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.295', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.040', 'weapon7': '0.050', 'WEAPON1': '0.070', 'AMMO3': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.112', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'HITCOUNT': '0.930', 'weapon2': '1.678', 'weapon3': '1.956', 'DAMAGECOUNT': '3.912', 'FRAGCOUNT': '11.000'} [2023-02-24 18:29:30,071][177154] DAMAGECOUNT value on done: 122880.0 [2023-02-24 18:29:30,071][177154] Sum rewards: 13.578, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.900', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'weapon5': '0.078', 'weapon7': '0.110', 'AMMO3': '0.124', 'AMMO4': '0.166', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'WEAPON7': '0.400', 'WEAPON4': '0.600', 'weapon2': '0.626', 'weapon4': '0.798', 'WEAPON3': '0.900', 'HITCOUNT': '1.050', 'weapon3': '1.534', 'DAMAGECOUNT': '4.299', 'FRAGCOUNT': '14.000'} [2023-02-24 18:29:30,363][177154] DAMAGECOUNT value on done: 122542.0 [2023-02-24 18:29:30,364][177154] Sum rewards: 5.400, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.890', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon5': '0.092', 'AMMO3': '0.099', 'weapon7': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.132', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.388', 'WEAPON4': '0.400', 'weapon4': '0.638', 'WEAPON3': '0.650', 'HITCOUNT': '0.770', 'weapon3': '1.388', 'DAMAGECOUNT': '3.177', 'FRAGCOUNT': '6.000'} [2023-02-24 18:29:30,560][177154] DAMAGECOUNT value on done: 119912.0 [2023-02-24 18:29:30,561][177154] Sum rewards: 14.328, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.642', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'weapon4': '0.030', 'weapon7': '0.048', 'weapon5': '0.070', 'AMMO4': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.135', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.950', 'HITCOUNT': '0.980', 'weapon2': '1.440', 'weapon3': '2.146', 'DAMAGECOUNT': '4.125', 'FRAGCOUNT': '15.000'} [2023-02-24 18:29:30,723][177172] DAMAGECOUNT value on done: 119401.0 [2023-02-24 18:29:30,723][177172] Sum rewards: 10.472, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.294', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'AMMO3': '0.168', 'weapon5': '0.322', 'WEAPON5': '0.500', 'HITCOUNT': '1.000', 'weapon2': '1.096', 'WEAPON3': '1.200', 'weapon3': '2.272', 'DAMAGECOUNT': '4.908', 'FRAGCOUNT': '11.000'} [2023-02-24 18:29:30,855][177154] DAMAGECOUNT value on done: 124176.0 [2023-02-24 18:29:30,855][177154] Sum rewards: 0.978, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.655', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'AMMO2': '0.052', 'AMMO3': '0.084', 'weapon7': '0.100', 'weapon5': '0.204', 'AMMO6': '0.220', 'AMMO7': '0.220', 'AMMO4': '0.260', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'HITCOUNT': '0.450', 'WEAPON3': '0.500', 'weapon4': '0.522', 'WEAPON4': '0.550', 'weapon3': '1.190', 'weapon2': '1.416', 'DAMAGECOUNT': '1.608', 'FRAGCOUNT': '2.000'} [2023-02-24 18:29:31,026][177172] DAMAGECOUNT value on done: 118368.0 [2023-02-24 18:29:31,027][177172] Sum rewards: 5.925, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.354', 'AMMO2': '0.021', 'AMMO5': '0.022', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'weapon5': '0.152', 'AMMO3': '0.164', 'weapon4': '0.172', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.784', 'HITCOUNT': '1.020', 'WEAPON3': '1.050', 'weapon3': '2.598', 'DAMAGECOUNT': '4.452', 'FRAGCOUNT': '7.000'} [2023-02-24 18:29:31,371][177171] DAMAGECOUNT value on done: 120337.0 [2023-02-24 18:29:31,372][177171] Sum rewards: 4.921, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.260', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.016', 'AMMO3': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'weapon7': '0.100', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON3': '0.300', 'WEAPON7': '0.300', 'ARMOR': '0.454', 'weapon2': '0.460', 'HITCOUNT': '0.490', 'weapon3': '0.540', 'weapon4': '0.742', 'DAMAGECOUNT': '2.181', 'FRAGCOUNT': '3.500'} [2023-02-24 18:29:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 55902208. Throughput: 0: 3486.0. Samples: 13976636. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:29:31,376][177119] Avg episode reward: [(0, '8.890')] [2023-02-24 18:29:31,615][177157] DAMAGECOUNT value on done: 115650.0 [2023-02-24 18:29:31,616][177157] Sum rewards: 4.505, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.360', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon7': '0.046', 'WEAPON1': '0.050', 'weapon5': '0.076', 'AMMO4': '0.081', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.462', 'ARMOR': '0.485', 'HITCOUNT': '0.630', 'WEAPON3': '0.950', 'weapon2': '1.102', 'weapon3': '1.988', 'DAMAGECOUNT': '2.742', 'FRAGCOUNT': '7.000'} [2023-02-24 18:29:31,626][177157] DAMAGECOUNT value on done: 120762.0 [2023-02-24 18:29:31,626][177157] Sum rewards: 3.116, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.913', 'AMMO5': '0.010', 'AMMO2': '0.032', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO3': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.160', 'weapon5': '0.184', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.530', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'weapon3': '1.420', 'weapon2': '1.558', 'DAMAGECOUNT': '2.928', 'FRAGCOUNT': '7.000'} [2023-02-24 18:29:31,669][177171] DAMAGECOUNT value on done: 119054.0 [2023-02-24 18:29:31,669][177171] Sum rewards: 16.345, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.934', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.090', 'weapon7': '0.110', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'WEAPON7': '0.400', 'ARMOR': '0.461', 'HITCOUNT': '0.590', 'weapon4': '0.598', 'weapon3': '0.912', 'weapon2': '2.068', 'DAMAGECOUNT': '4.098', 'FRAGCOUNT': '12.000'} [2023-02-24 18:29:31,732][177171] DAMAGECOUNT value on done: 115421.0 [2023-02-24 18:29:31,732][177171] Sum rewards: 10.285, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.120', 'AMMO5': '0.018', 'AMMO2': '0.042', 'WEAPON1': '0.050', 'weapon7': '0.068', 'AMMO3': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO4': '0.209', 'weapon5': '0.226', 'WEAPON5': '0.450', 'WEAPON3': '0.450', 'ARMOR': '0.457', 'WEAPON4': '0.550', 'weapon2': '0.564', 'weapon4': '0.768', 'HITCOUNT': '0.980', 'weapon3': '1.212', 'DAMAGECOUNT': '4.335', 'FRAGCOUNT': '9.500'} [2023-02-24 18:29:31,837][177153] Updated weights for policy 0, policy_version 13650 (0.0008) [2023-02-24 18:29:31,924][177157] DAMAGECOUNT value on done: 114674.0 [2023-02-24 18:29:31,924][177157] Sum rewards: 3.467, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.306', 'AMMO5': '0.006', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'weapon5': '0.088', 'AMMO4': '0.126', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'weapon4': '0.236', 'WEAPON4': '0.300', 'ARMOR': '0.489', 'weapon2': '0.754', 'HITCOUNT': '1.000', 'WEAPON3': '1.200', 'weapon3': '2.580', 'DAMAGECOUNT': '3.570', 'FRAGCOUNT': '8.000'} [2023-02-24 18:29:31,935][177157] DAMAGECOUNT value on done: 118018.0 [2023-02-24 18:29:31,936][177157] Sum rewards: 1.285, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.620', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.018', 'weapon7': '0.052', 'weapon5': '0.084', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.264', 'HITCOUNT': '0.810', 'WEAPON3': '1.150', 'weapon2': '1.284', 'weapon3': '1.742', 'DAMAGECOUNT': '2.814', 'FRAGCOUNT': '6.000'} [2023-02-24 18:29:32,023][177171] DAMAGECOUNT value on done: 113508.0 [2023-02-24 18:29:32,023][177171] Sum rewards: 7.893, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.066', 'AMMO3': '0.080', 'AMMO4': '0.108', 'weapon5': '0.110', 'HEALTH': '0.140', 'WEAPON5': '0.150', 'HITCOUNT': '0.350', 'WEAPON3': '0.400', 'DAMAGECOUNT': '1.560', 'weapon2': '1.688', 'weapon3': '1.884', 'FRAGCOUNT': '5.000'} [2023-02-24 18:29:32,672][177155] DAMAGECOUNT value on done: 120374.0 [2023-02-24 18:29:32,672][177155] Sum rewards: 22.119, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.308', 'AMMO5': '0.013', 'AMMO2': '0.027', 'WEAPON1': '0.040', 'weapon5': '0.072', 'AMMO3': '0.132', 'AMMO4': '0.133', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.512', 'WEAPON3': '0.800', 'weapon2': '0.802', 'HITCOUNT': '1.500', 'weapon3': '2.052', 'DAMAGECOUNT': '5.544', 'FRAGCOUNT': '21.000'} [2023-02-24 18:29:32,976][177155] DAMAGECOUNT value on done: 123391.0 [2023-02-24 18:29:32,976][177155] Sum rewards: 8.727, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.220', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'weapon7': '0.054', 'AMMO3': '0.070', 'AMMO4': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.186', 'WEAPON4': '0.300', 'weapon4': '0.396', 'WEAPON3': '0.400', 'ARMOR': '0.450', 'HITCOUNT': '0.620', 'weapon3': '0.722', 'weapon2': '1.950', 'DAMAGECOUNT': '3.453', 'FRAGCOUNT': '6.000'} [2023-02-24 18:29:33,317][177155] DAMAGECOUNT value on done: 122765.0 [2023-02-24 18:29:33,317][177155] Sum rewards: 12.217, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.846', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.070', 'AMMO4': '0.082', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'weapon5': '0.188', 'weapon4': '0.326', 'WEAPON5': '0.400', 'weapon2': '0.896', 'WEAPON3': '1.000', 'HITCOUNT': '1.050', 'weapon3': '2.226', 'DAMAGECOUNT': '4.254', 'FRAGCOUNT': '13.000'} [2023-02-24 18:29:33,635][177155] DAMAGECOUNT value on done: 115428.0 [2023-02-24 18:29:33,636][177155] Sum rewards: 8.907, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.706', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.046', 'weapon7': '0.072', 'AMMO4': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.126', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon4': '0.528', 'HITCOUNT': '0.610', 'WEAPON3': '0.800', 'weapon2': '0.890', 'weapon3': '1.710', 'DAMAGECOUNT': '2.856', 'FRAGCOUNT': '9.000'} [2023-02-24 18:29:34,806][177153] Updated weights for policy 0, policy_version 13660 (0.0008) [2023-02-24 18:29:36,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 55971840. Throughput: 0: 3485.2. Samples: 13987016. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:29:36,376][177119] Avg episode reward: [(0, '8.512')] [2023-02-24 18:29:37,711][177153] Updated weights for policy 0, policy_version 13670 (0.0008) [2023-02-24 18:29:39,396][177156] DAMAGECOUNT value on done: 116241.0 [2023-02-24 18:29:39,396][177156] Sum rewards: 8.151, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'weapon5': '0.052', 'AMMO4': '0.054', 'AMMO3': '0.085', 'weapon7': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HEALTH': '0.154', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.514', 'WEAPON3': '0.550', 'HITCOUNT': '0.640', 'weapon2': '0.760', 'weapon3': '1.412', 'DAMAGECOUNT': '2.472', 'FRAGCOUNT': '7.000'} [2023-02-24 18:29:39,522][177156] DAMAGECOUNT value on done: 118099.0 [2023-02-24 18:29:39,522][177156] Sum rewards: 6.255, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.085', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'weapon7': '0.030', 'weapon5': '0.080', 'AMMO3': '0.135', 'AMMO4': '0.146', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.568', 'HITCOUNT': '0.790', 'WEAPON3': '0.850', 'weapon2': '0.876', 'weapon3': '1.972', 'DAMAGECOUNT': '2.754', 'FRAGCOUNT': '7.000'} [2023-02-24 18:29:39,710][177156] DAMAGECOUNT value on done: 118657.0 [2023-02-24 18:29:39,710][177156] Sum rewards: 0.560, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.322', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.005', 'ARMOR': '0.020', 'WEAPON1': '0.030', 'weapon5': '0.086', 'weapon2': '0.096', 'weapon7': '0.106', 'AMMO3': '0.114', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'HITCOUNT': '0.280', 'WEAPON7': '0.400', 'weapon4': '0.512', 'WEAPON3': '0.700', 'weapon3': '1.106', 'DAMAGECOUNT': '1.347', 'FRAGCOUNT': '3.000'} [2023-02-24 18:29:39,833][177156] DAMAGECOUNT value on done: 116563.0 [2023-02-24 18:29:39,833][177156] Sum rewards: 10.457, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.358', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.033', 'weapon7': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.152', 'AMMO4': '0.163', 'WEAPON7': '0.200', 'weapon5': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.486', 'WEAPON3': '1.050', 'HITCOUNT': '1.080', 'weapon2': '1.082', 'weapon3': '1.748', 'DAMAGECOUNT': '5.121', 'FRAGCOUNT': '11.000'} [2023-02-24 18:29:40,669][177153] Updated weights for policy 0, policy_version 13680 (0.0008) [2023-02-24 18:29:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 56041472. Throughput: 0: 3483.4. Samples: 14007936. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:29:41,376][177119] Avg episode reward: [(0, '8.426')] [2023-02-24 18:29:43,617][177153] Updated weights for policy 0, policy_version 13690 (0.0009) [2023-02-24 18:29:44,574][177170] DAMAGECOUNT value on done: 120560.0 [2023-02-24 18:29:44,575][177170] Sum rewards: 14.365, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.074', 'ARMOR': '0.004', 'AMMO2': '0.031', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.121', 'WEAPON4': '0.150', 'AMMO4': '0.154', 'weapon4': '0.648', 'weapon2': '0.664', 'WEAPON3': '0.800', 'HITCOUNT': '1.180', 'weapon3': '2.158', 'DAMAGECOUNT': '4.179', 'FRAGCOUNT': '13.000'} [2023-02-24 18:29:44,870][177170] DAMAGECOUNT value on done: 126075.0 [2023-02-24 18:29:44,870][177170] Sum rewards: 6.524, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.066', 'AMMO5': '0.010', 'weapon7': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.048', 'weapon5': '0.060', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.240', 'ARMOR': '0.500', 'WEAPON4': '0.500', 'weapon2': '0.766', 'weapon4': '0.770', 'HITCOUNT': '1.040', 'WEAPON3': '1.300', 'weapon3': '1.888', 'DAMAGECOUNT': '3.705', 'FRAGCOUNT': '12.000'} [2023-02-24 18:29:45,102][177170] DAMAGECOUNT value on done: 115444.0 [2023-02-24 18:29:45,103][177170] Sum rewards: 9.606, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.574', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon7': '0.048', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'AMMO3': '0.113', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'weapon4': '0.566', 'WEAPON3': '0.650', 'HITCOUNT': '1.130', 'weapon2': '1.212', 'weapon3': '1.810', 'DAMAGECOUNT': '4.431', 'FRAGCOUNT': '9.000'} [2023-02-24 18:29:45,395][177170] DAMAGECOUNT value on done: 119770.0 [2023-02-24 18:29:45,395][177170] Sum rewards: 4.897, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.983', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.130', 'weapon5': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.358', 'ARMOR': '0.400', 'weapon2': '0.566', 'HITCOUNT': '0.740', 'WEAPON3': '0.850', 'weapon3': '2.048', 'DAMAGECOUNT': '2.796', 'FRAGCOUNT': '7.000'} [2023-02-24 18:29:45,943][177158] DAMAGECOUNT value on done: 115385.0 [2023-02-24 18:29:45,943][177158] Sum rewards: 5.300, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.712', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'AMMO4': '0.065', 'AMMO3': '0.152', 'weapon5': '0.166', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.562', 'weapon2': '0.864', 'HITCOUNT': '0.880', 'WEAPON3': '1.050', 'weapon3': '1.810', 'DAMAGECOUNT': '3.306', 'FRAGCOUNT': '9.000'} [2023-02-24 18:29:46,247][177158] DAMAGECOUNT value on done: 116138.0 [2023-02-24 18:29:46,247][177158] Sum rewards: 10.405, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.012', 'AMMO2': '0.020', 'WEAPON1': '0.050', 'AMMO4': '0.102', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'HEALTH': '0.264', 'weapon5': '0.280', 'WEAPON5': '0.300', 'weapon4': '0.320', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.740', 'weapon2': '1.014', 'weapon3': '1.636', 'DAMAGECOUNT': '3.459', 'FRAGCOUNT': '7.000'} [2023-02-24 18:29:46,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 56111104. Throughput: 0: 3483.6. Samples: 14028812. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:29:46,376][177119] Avg episode reward: [(0, '8.328')] [2023-02-24 18:29:46,571][177153] Updated weights for policy 0, policy_version 13700 (0.0008) [2023-02-24 18:29:46,731][177158] DAMAGECOUNT value on done: 119509.0 [2023-02-24 18:29:46,732][177158] Sum rewards: 14.243, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.037', 'AMMO3': '0.041', 'weapon7': '0.048', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HEALTH': '0.128', 'weapon5': '0.148', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.232', 'WEAPON3': '0.250', 'HITCOUNT': '0.740', 'weapon3': '0.992', 'weapon2': '1.020', 'DAMAGECOUNT': '3.831', 'FRAGCOUNT': '9.000'} [2023-02-24 18:29:47,027][177158] DAMAGECOUNT value on done: 120284.0 [2023-02-24 18:29:47,028][177158] Sum rewards: 10.646, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.066', 'AMMO2': '0.009', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'weapon5': '0.112', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon4': '0.222', 'weapon2': '0.850', 'WEAPON3': '1.200', 'HITCOUNT': '1.310', 'weapon3': '2.536', 'DAMAGECOUNT': '4.908', 'FRAGCOUNT': '13.000'} [2023-02-24 18:29:48,481][177172] DAMAGECOUNT value on done: 117459.0 [2023-02-24 18:29:48,482][177172] Sum rewards: 5.871, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.168', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.102', 'weapon7': '0.188', 'weapon4': '0.208', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.300', 'WEAPON7': '0.300', 'ARMOR': '0.497', 'HITCOUNT': '0.550', 'weapon3': '0.942', 'FRAGCOUNT': '1.500', 'weapon2': '2.114', 'DAMAGECOUNT': '2.379'} [2023-02-24 18:29:48,782][177172] DAMAGECOUNT value on done: 118938.0 [2023-02-24 18:29:48,783][177172] Sum rewards: 16.299, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.729', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.050', 'weapon7': '0.066', 'AMMO4': '0.077', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.112', 'weapon5': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.578', 'WEAPON3': '0.700', 'HITCOUNT': '0.900', 'weapon2': '1.076', 'weapon3': '1.584', 'DAMAGECOUNT': '4.068', 'FRAGCOUNT': '13.000'} [2023-02-24 18:29:49,376][177154] DAMAGECOUNT value on done: 124308.0 [2023-02-24 18:29:49,377][177154] Sum rewards: 13.013, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.130', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon7': '0.050', 'weapon5': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon4': '0.378', 'weapon2': '0.972', 'WEAPON3': '1.150', 'HITCOUNT': '1.290', 'weapon3': '2.110', 'DAMAGECOUNT': '4.284', 'FRAGCOUNT': '16.000'} [2023-02-24 18:29:49,510][177153] Updated weights for policy 0, policy_version 13710 (0.0008) [2023-02-24 18:29:49,676][177154] DAMAGECOUNT value on done: 123441.0 [2023-02-24 18:29:49,676][177154] Sum rewards: 10.963, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.068', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.009', 'WEAPON1': '0.030', 'AMMO3': '0.064', 'WEAPON4': '0.100', 'weapon7': '0.110', 'weapon5': '0.140', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'weapon4': '0.258', 'HITCOUNT': '0.360', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'weapon2': '0.760', 'weapon3': '0.924', 'DAMAGECOUNT': '2.697', 'FRAGCOUNT': '8.000'} [2023-02-24 18:29:49,851][177154] DAMAGECOUNT value on done: 120957.0 [2023-02-24 18:29:49,851][177154] Sum rewards: 10.885, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.320', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'weapon7': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.182', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'HITCOUNT': '0.910', 'weapon2': '1.510', 'weapon3': '1.562', 'DAMAGECOUNT': '3.135', 'FRAGCOUNT': '9.000'} [2023-02-24 18:29:49,967][177172] DAMAGECOUNT value on done: 120404.0 [2023-02-24 18:29:49,968][177172] Sum rewards: 5.835, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '0.006', 'AMMO2': '0.012', 'AMMO5': '0.015', 'weapon7': '0.048', 'WEAPON1': '0.060', 'AMMO4': '0.061', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'weapon4': '0.126', 'weapon5': '0.188', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'HITCOUNT': '0.740', 'weapon2': '1.550', 'weapon3': '1.698', 'DAMAGECOUNT': '3.009', 'FRAGCOUNT': '5.000'} [2023-02-24 18:29:50,157][177154] DAMAGECOUNT value on done: 124979.0 [2023-02-24 18:29:50,157][177154] Sum rewards: 5.636, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.102', 'AMMO5': '0.007', 'AMMO2': '0.022', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.108', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'weapon2': '0.376', 'WEAPON4': '0.450', 'HITCOUNT': '0.470', 'weapon3': '0.642', 'weapon4': '0.740', 'DAMAGECOUNT': '2.409', 'FRAGCOUNT': '7.000'} [2023-02-24 18:29:50,264][177172] DAMAGECOUNT value on done: 119410.0 [2023-02-24 18:29:50,264][177172] Sum rewards: 7.708, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.758', 'AMMO2': '0.003', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO4': '0.014', 'WEAPON1': '0.040', 'weapon5': '0.056', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.412', 'WEAPON3': '0.800', 'HITCOUNT': '0.820', 'weapon2': '1.394', 'weapon3': '1.564', 'DAMAGECOUNT': '3.126', 'FRAGCOUNT': '7.000'} [2023-02-24 18:29:50,706][177171] DAMAGECOUNT value on done: 121002.0 [2023-02-24 18:29:50,707][177171] Sum rewards: 6.029, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.230', 'AMMO5': '0.017', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'AMMO4': '0.139', 'weapon5': '0.176', 'weapon4': '0.180', 'WEAPON5': '0.400', 'HITCOUNT': '0.560', 'WEAPON3': '0.600', 'weapon3': '1.654', 'weapon2': '1.752', 'DAMAGECOUNT': '1.995', 'FRAGCOUNT': '6.000'} [2023-02-24 18:29:50,918][177157] DAMAGECOUNT value on done: 116606.0 [2023-02-24 18:29:50,918][177157] Sum rewards: 6.576, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.380', 'AMMO5': '0.012', 'AMMO2': '0.025', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'AMMO4': '0.125', 'weapon4': '0.160', 'weapon5': '0.262', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.660', 'WEAPON3': '0.850', 'weapon2': '1.362', 'weapon3': '1.900', 'DAMAGECOUNT': '2.868', 'FRAGCOUNT': '7.000'} [2023-02-24 18:29:50,929][177157] DAMAGECOUNT value on done: 121542.0 [2023-02-24 18:29:50,929][177157] Sum rewards: 6.204, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.574', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.045', 'weapon7': '0.048', 'AMMO3': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.225', 'weapon5': '0.290', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.378', 'ARMOR': '0.400', 'HITCOUNT': '0.540', 'WEAPON3': '0.550', 'weapon2': '1.086', 'weapon3': '1.092', 'DAMAGECOUNT': '2.340', 'FRAGCOUNT': '7.000'} [2023-02-24 18:29:50,995][177171] DAMAGECOUNT value on done: 120324.0 [2023-02-24 18:29:50,996][177171] Sum rewards: 11.779, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.946', 'AMMO5': '0.007', 'AMMO2': '0.026', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO3': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.131', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.208', 'weapon4': '0.490', 'WEAPON3': '0.600', 'HITCOUNT': '0.990', 'weapon2': '1.234', 'weapon3': '1.602', 'DAMAGECOUNT': '3.810', 'FRAGCOUNT': '11.000'} [2023-02-24 18:29:51,061][177171] DAMAGECOUNT value on done: 116450.0 [2023-02-24 18:29:51,062][177171] Sum rewards: 10.196, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.009', 'AMMO5': '0.010', 'HEALTH': '0.021', 'WEAPON1': '0.040', 'AMMO4': '0.045', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.180', 'weapon4': '0.204', 'WEAPON5': '0.250', 'ARMOR': '0.456', 'WEAPON3': '0.500', 'HITCOUNT': '0.770', 'weapon2': '1.082', 'weapon3': '1.842', 'DAMAGECOUNT': '3.087', 'FRAGCOUNT': '9.000'} [2023-02-24 18:29:51,225][177157] DAMAGECOUNT value on done: 116014.0 [2023-02-24 18:29:51,225][177157] Sum rewards: 12.202, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.151', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'weapon7': '0.102', 'AMMO3': '0.113', 'AMMO4': '0.157', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.226', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.412', 'WEAPON3': '0.700', 'HITCOUNT': '0.840', 'weapon2': '1.048', 'weapon3': '1.826', 'DAMAGECOUNT': '4.020', 'FRAGCOUNT': '12.000'} [2023-02-24 18:29:51,235][177157] DAMAGECOUNT value on done: 118796.0 [2023-02-24 18:29:51,235][177157] Sum rewards: 6.024, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.620', 'AMMO5': '0.015', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.097', 'AMMO3': '0.106', 'weapon7': '0.108', 'weapon5': '0.156', 'WEAPON5': '0.300', 'HITCOUNT': '0.340', 'AMMO6': '0.420', 'AMMO7': '0.420', 'WEAPON4': '0.450', 'WEAPON7': '0.500', 'WEAPON3': '0.650', 'weapon4': '0.754', 'ARMOR': '0.962', 'weapon3': '0.962', 'weapon2': '1.030', 'DAMAGECOUNT': '2.334', 'FRAGCOUNT': '7.000'} [2023-02-24 18:29:51,351][177171] DAMAGECOUNT value on done: 114098.0 [2023-02-24 18:29:51,351][177171] Sum rewards: 5.909, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.642', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'weapon7': '0.052', 'AMMO4': '0.058', 'AMMO3': '0.079', 'WEAPON1': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.214', 'weapon4': '0.238', 'WEAPON5': '0.300', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'weapon2': '0.752', 'weapon3': '1.346', 'DAMAGECOUNT': '1.770', 'FRAGCOUNT': '7.000'} [2023-02-24 18:29:51,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 56180736. Throughput: 0: 3483.2. Samples: 14039298. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:29:51,376][177119] Avg episode reward: [(0, '8.652')] [2023-02-24 18:29:51,844][177155] DAMAGECOUNT value on done: 121373.0 [2023-02-24 18:29:51,844][177155] Sum rewards: 13.230, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.294', 'AMMO2': '0.013', 'AMMO5': '0.013', 'weapon7': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.090', 'WEAPON1': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.298', 'WEAPON5': '0.450', 'HITCOUNT': '0.590', 'WEAPON3': '0.700', 'weapon2': '1.172', 'weapon3': '1.558', 'DAMAGECOUNT': '2.997', 'FRAGCOUNT': '12.000'} [2023-02-24 18:29:52,148][177155] DAMAGECOUNT value on done: 124605.0 [2023-02-24 18:29:52,149][177155] Sum rewards: 6.807, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.000', 'AMMO2': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.047', 'weapon7': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.218', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon4': '0.448', 'weapon2': '0.520', 'WEAPON3': '0.800', 'HITCOUNT': '0.800', 'weapon3': '1.738', 'DAMAGECOUNT': '3.642', 'FRAGCOUNT': '5.500'} [2023-02-24 18:29:52,418][177153] Updated weights for policy 0, policy_version 13720 (0.0009) [2023-02-24 18:29:52,605][177155] DAMAGECOUNT value on done: 123702.0 [2023-02-24 18:29:52,605][177155] Sum rewards: 7.410, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.013', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO4': '0.062', 'HEALTH': '0.088', 'AMMO3': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.288', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.580', 'WEAPON3': '0.600', 'weapon3': '1.504', 'weapon2': '1.958', 'DAMAGECOUNT': '2.811', 'FRAGCOUNT': '5.000'} [2023-02-24 18:29:52,900][177155] DAMAGECOUNT value on done: 116663.0 [2023-02-24 18:29:52,900][177155] Sum rewards: 14.259, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.128', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'AMMO3': '0.071', 'AMMO4': '0.085', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.182', 'WEAPON5': '0.250', 'weapon5': '0.260', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.730', 'weapon2': '1.606', 'weapon3': '1.630', 'DAMAGECOUNT': '3.705', 'FRAGCOUNT': '9.000'} [2023-02-24 18:29:55,317][177153] Updated weights for policy 0, policy_version 13730 (0.0009) [2023-02-24 18:29:56,376][177119] Fps is (10 sec: 13926.2, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 56250368. Throughput: 0: 3483.3. Samples: 14060254. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:29:56,376][177119] Avg episode reward: [(0, '8.694')] [2023-02-24 18:29:58,256][177153] Updated weights for policy 0, policy_version 13740 (0.0008) [2023-02-24 18:29:58,803][177156] DAMAGECOUNT value on done: 117507.0 [2023-02-24 18:29:58,804][177156] Sum rewards: 9.270, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.308', 'AMMO5': '0.014', 'AMMO2': '0.025', 'ARMOR': '0.040', 'WEAPON1': '0.040', 'AMMO3': '0.105', 'AMMO4': '0.127', 'weapon5': '0.188', 'weapon7': '0.254', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'AMMO6': '0.480', 'AMMO7': '0.480', 'weapon4': '0.586', 'weapon2': '0.726', 'WEAPON3': '0.750', 'WEAPON7': '0.800', 'HITCOUNT': '0.940', 'weapon3': '1.474', 'DAMAGECOUNT': '3.798', 'FRAGCOUNT': '9.000'} [2023-02-24 18:29:58,919][177156] DAMAGECOUNT value on done: 119496.0 [2023-02-24 18:29:58,920][177156] Sum rewards: 8.372, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.456', 'AMMO5': '0.026', 'AMMO2': '0.045', 'weapon7': '0.058', 'WEAPON1': '0.060', 'AMMO3': '0.102', 'AMMO4': '0.226', 'weapon5': '0.270', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.542', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'HITCOUNT': '0.760', 'weapon2': '1.258', 'weapon3': '1.318', 'DAMAGECOUNT': '3.612', 'FRAGCOUNT': '8.000'} [2023-02-24 18:29:59,122][177156] DAMAGECOUNT value on done: 119456.0 [2023-02-24 18:29:59,123][177156] Sum rewards: 8.978, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'AMMO4': '0.149', 'weapon5': '0.160', 'WEAPON5': '0.250', 'HEALTH': '0.334', 'weapon4': '0.382', 'WEAPON3': '0.500', 'HITCOUNT': '0.620', 'weapon3': '1.594', 'weapon2': '1.596', 'DAMAGECOUNT': '2.397', 'FRAGCOUNT': '6.000'} [2023-02-24 18:29:59,230][177156] DAMAGECOUNT value on done: 118076.0 [2023-02-24 18:29:59,230][177156] Sum rewards: 11.526, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.980', 'AMMO5': '0.017', 'AMMO2': '0.040', 'WEAPON1': '0.050', 'AMMO3': '0.148', 'weapon4': '0.192', 'AMMO4': '0.200', 'weapon5': '0.224', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '0.900', 'HITCOUNT': '1.090', 'weapon2': '1.600', 'weapon3': '1.706', 'DAMAGECOUNT': '4.539', 'FRAGCOUNT': '14.000'} [2023-02-24 18:30:01,205][177153] Updated weights for policy 0, policy_version 13750 (0.0008) [2023-02-24 18:30:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 56320000. Throughput: 0: 3482.8. Samples: 14081160. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:30:01,376][177119] Avg episode reward: [(0, '8.708')] [2023-02-24 18:30:03,805][177170] DAMAGECOUNT value on done: 121934.0 [2023-02-24 18:30:03,806][177170] Sum rewards: 16.155, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.145', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'weapon7': '0.048', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.146', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.240', 'weapon5': '0.402', 'weapon2': '0.738', 'WEAPON3': '0.900', 'HITCOUNT': '1.070', 'weapon3': '2.318', 'DAMAGECOUNT': '4.122', 'FRAGCOUNT': '16.000'} [2023-02-24 18:30:04,104][177170] DAMAGECOUNT value on done: 126943.0 [2023-02-24 18:30:04,104][177170] Sum rewards: 7.669, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.115', 'AMMO2': '0.005', 'AMMO5': '0.011', 'AMMO4': '0.025', 'weapon7': '0.052', 'WEAPON1': '0.060', 'AMMO3': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.208', 'weapon5': '0.224', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.650', 'weapon3': '1.284', 'weapon2': '1.892', 'DAMAGECOUNT': '2.604', 'FRAGCOUNT': '5.000'} [2023-02-24 18:30:04,177][177153] Updated weights for policy 0, policy_version 13760 (0.0008) [2023-02-24 18:30:04,334][177170] DAMAGECOUNT value on done: 116427.0 [2023-02-24 18:30:04,335][177170] Sum rewards: 5.729, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.385', 'AMMO5': '0.005', 'AMMO2': '0.025', 'AMMO3': '0.076', 'weapon7': '0.086', 'weapon5': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.368', 'HITCOUNT': '0.470', 'WEAPON3': '0.500', 'weapon4': '0.614', 'weapon3': '0.906', 'DAMAGECOUNT': '2.949', 'FRAGCOUNT': '6.000'} [2023-02-24 18:30:04,637][177170] DAMAGECOUNT value on done: 120757.0 [2023-02-24 18:30:04,637][177170] Sum rewards: 9.319, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.643', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.015', 'WEAPON1': '0.040', 'AMMO3': '0.074', 'weapon5': '0.132', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.406', 'ARMOR': '0.499', 'WEAPON3': '0.600', 'HITCOUNT': '0.820', 'weapon3': '1.470', 'weapon2': '1.684', 'DAMAGECOUNT': '2.961', 'FRAGCOUNT': '8.500'} [2023-02-24 18:30:05,181][177158] DAMAGECOUNT value on done: 116646.0 [2023-02-24 18:30:05,181][177158] Sum rewards: 14.145, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.788', 'AMMO5': '0.020', 'AMMO2': '0.037', 'weapon7': '0.048', 'WEAPON1': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.111', 'AMMO4': '0.186', 'WEAPON4': '0.200', 'weapon5': '0.316', 'weapon4': '0.360', 'ARMOR': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'HITCOUNT': '0.730', 'weapon2': '1.102', 'weapon3': '1.370', 'DAMAGECOUNT': '3.783', 'FRAGCOUNT': '13.000'} [2023-02-24 18:30:05,478][177158] DAMAGECOUNT value on done: 117211.0 [2023-02-24 18:30:05,479][177158] Sum rewards: 8.162, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.504', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.037', 'weapon7': '0.110', 'AMMO3': '0.117', 'AMMO4': '0.183', 'WEAPON4': '0.200', 'weapon5': '0.208', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'weapon4': '0.438', 'HITCOUNT': '0.730', 'WEAPON3': '0.800', 'weapon2': '0.864', 'weapon3': '1.480', 'DAMAGECOUNT': '3.219', 'FRAGCOUNT': '10.000'} [2023-02-24 18:30:05,984][177158] DAMAGECOUNT value on done: 120168.0 [2023-02-24 18:30:05,984][177158] Sum rewards: 5.605, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.577', 'AMMO5': '0.005', 'ARMOR': '0.016', 'WEAPON1': '0.030', 'AMMO2': '0.035', 'weapon7': '0.048', 'AMMO3': '0.070', 'weapon5': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'weapon4': '0.544', 'weapon3': '1.328', 'weapon2': '1.648', 'DAMAGECOUNT': '1.977', 'FRAGCOUNT': '6.000'} [2023-02-24 18:30:06,281][177158] DAMAGECOUNT value on done: 121061.0 [2023-02-24 18:30:06,282][177158] Sum rewards: 11.613, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.280', 'AMMO5': '0.011', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'AMMO3': '0.052', 'weapon5': '0.072', 'AMMO4': '0.073', 'weapon7': '0.098', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.440', 'weapon2': '0.456', 'HITCOUNT': '0.530', 'weapon3': '0.994', 'DAMAGECOUNT': '2.331', 'FRAGCOUNT': '9.000'} [2023-02-24 18:30:06,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 56389632. Throughput: 0: 3483.5. Samples: 14091550. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:30:06,376][177119] Avg episode reward: [(0, '8.953')] [2023-02-24 18:30:07,124][177153] Updated weights for policy 0, policy_version 13770 (0.0009) [2023-02-24 18:30:07,760][177172] DAMAGECOUNT value on done: 118797.0 [2023-02-24 18:30:07,761][177172] Sum rewards: 7.880, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.812', 'AMMO5': '0.020', 'AMMO2': '0.021', 'WEAPON1': '0.090', 'AMMO4': '0.106', 'AMMO3': '0.134', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.202', 'weapon4': '0.304', 'WEAPON5': '0.400', 'HITCOUNT': '0.870', 'WEAPON3': '0.900', 'weapon2': '1.002', 'weapon3': '2.078', 'DAMAGECOUNT': '4.014', 'FRAGCOUNT': '8.500'} [2023-02-24 18:30:08,062][177172] DAMAGECOUNT value on done: 120031.0 [2023-02-24 18:30:08,063][177172] Sum rewards: 12.412, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.984', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.050', 'AMMO4': '0.090', 'AMMO3': '0.091', 'weapon5': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.489', 'weapon4': '0.594', 'WEAPON3': '0.600', 'weapon2': '0.682', 'HITCOUNT': '0.810', 'weapon3': '1.658', 'DAMAGECOUNT': '3.279', 'FRAGCOUNT': '9.500'} [2023-02-24 18:30:08,738][177154] DAMAGECOUNT value on done: 125554.0 [2023-02-24 18:30:08,739][177154] Sum rewards: 6.817, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.702', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon7': '0.048', 'weapon5': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.148', 'AMMO4': '0.159', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.428', 'weapon4': '0.602', 'weapon2': '0.604', 'WEAPON3': '0.900', 'HITCOUNT': '0.920', 'weapon3': '1.824', 'DAMAGECOUNT': '3.738', 'FRAGCOUNT': '7.500'} [2023-02-24 18:30:09,032][177154] DAMAGECOUNT value on done: 124748.0 [2023-02-24 18:30:09,032][177154] Sum rewards: 12.302, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.420', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.039', 'weapon7': '0.048', 'WEAPON4': '0.050', 'WEAPON1': '0.080', 'AMMO3': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.178', 'WEAPON7': '0.200', 'weapon4': '0.210', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'weapon2': '0.816', 'HITCOUNT': '1.070', 'weapon3': '2.036', 'DAMAGECOUNT': '3.921', 'FRAGCOUNT': '11.000'} [2023-02-24 18:30:09,201][177154] DAMAGECOUNT value on done: 122798.0 [2023-02-24 18:30:09,202][177154] Sum rewards: 13.609, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.606', 'AMMO2': '0.027', 'AMMO5': '0.029', 'weapon7': '0.048', 'WEAPON1': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.132', 'AMMO3': '0.148', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.326', 'weapon2': '0.368', 'weapon5': '0.382', 'WEAPON5': '0.800', 'WEAPON3': '1.000', 'HITCOUNT': '1.110', 'weapon3': '2.248', 'DAMAGECOUNT': '5.247', 'FRAGCOUNT': '14.000'} [2023-02-24 18:30:09,246][177172] DAMAGECOUNT value on done: 121635.0 [2023-02-24 18:30:09,247][177172] Sum rewards: 11.466, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.642', 'AMMO5': '0.015', 'AMMO2': '0.027', 'WEAPON1': '0.050', 'AMMO3': '0.116', 'AMMO4': '0.137', 'weapon5': '0.258', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'ARMOR': '0.490', 'weapon4': '0.512', 'WEAPON3': '0.750', 'weapon2': '0.814', 'HITCOUNT': '0.830', 'weapon3': '1.916', 'DAMAGECOUNT': '3.693', 'FRAGCOUNT': '11.000'} [2023-02-24 18:30:09,498][177154] DAMAGECOUNT value on done: 126333.0 [2023-02-24 18:30:09,499][177154] Sum rewards: 13.126, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.510', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.040', 'AMMO4': '0.044', 'weapon4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'weapon5': '0.188', 'WEAPON3': '0.750', 'HITCOUNT': '0.930', 'weapon2': '1.668', 'weapon3': '1.874', 'DAMAGECOUNT': '4.062', 'FRAGCOUNT': '12.000'} [2023-02-24 18:30:09,546][177172] DAMAGECOUNT value on done: 121467.0 [2023-02-24 18:30:09,547][177172] Sum rewards: 22.066, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.712', 'AMMO5': '0.022', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.130', 'AMMO3': '0.133', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.334', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'weapon2': '0.952', 'HITCOUNT': '1.320', 'weapon3': '2.172', 'DAMAGECOUNT': '6.171', 'FRAGCOUNT': '18.000'} [2023-02-24 18:30:09,961][177171] DAMAGECOUNT value on done: 122362.0 [2023-02-24 18:30:09,962][177171] Sum rewards: 13.148, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.320', 'AMMO2': '0.012', 'AMMO5': '0.012', 'weapon4': '0.052', 'AMMO4': '0.058', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.148', 'weapon5': '0.392', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '1.020', 'weapon2': '1.252', 'weapon3': '1.982', 'DAMAGECOUNT': '4.080', 'FRAGCOUNT': '11.500'} [2023-02-24 18:30:10,055][177153] Updated weights for policy 0, policy_version 13780 (0.0008) [2023-02-24 18:30:10,206][177157] DAMAGECOUNT value on done: 117765.0 [2023-02-24 18:30:10,206][177157] Sum rewards: 12.798, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.540', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.050', 'weapon7': '0.052', 'AMMO3': '0.070', 'AMMO4': '0.091', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.220', 'WEAPON5': '0.250', 'weapon4': '0.272', 'WEAPON3': '0.500', 'HITCOUNT': '0.650', 'weapon2': '1.380', 'weapon3': '1.658', 'DAMAGECOUNT': '3.477', 'FRAGCOUNT': '10.000'} [2023-02-24 18:30:10,217][177157] DAMAGECOUNT value on done: 123325.0 [2023-02-24 18:30:10,217][177157] Sum rewards: 17.693, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.945', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.072', 'weapon7': '0.074', 'AMMO3': '0.097', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.244', 'WEAPON5': '0.250', 'WEAPON3': '0.800', 'HITCOUNT': '1.180', 'weapon2': '1.554', 'weapon3': '1.844', 'DAMAGECOUNT': '5.349', 'FRAGCOUNT': '15.000'} [2023-02-24 18:30:10,260][177171] DAMAGECOUNT value on done: 122029.0 [2023-02-24 18:30:10,261][177171] Sum rewards: 10.814, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.262', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.044', 'weapon7': '0.084', 'AMMO4': '0.111', 'AMMO3': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.374', 'ARMOR': '0.504', 'WEAPON3': '0.700', 'HITCOUNT': '1.320', 'weapon3': '1.438', 'weapon2': '1.744', 'DAMAGECOUNT': '5.115', 'FRAGCOUNT': '10.000'} [2023-02-24 18:30:10,342][177171] DAMAGECOUNT value on done: 117465.0 [2023-02-24 18:30:10,343][177171] Sum rewards: 10.198, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.116', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon7': '0.048', 'AMMO3': '0.057', 'AMMO4': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.136', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.608', 'weapon3': '0.764', 'weapon2': '0.768', 'HITCOUNT': '0.790', 'ARMOR': '0.863', 'DAMAGECOUNT': '3.045', 'FRAGCOUNT': '8.000'} [2023-02-24 18:30:10,521][177157] DAMAGECOUNT value on done: 116884.0 [2023-02-24 18:30:10,521][177157] Sum rewards: 0.975, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.892', 'AMMO2': '0.015', 'AMMO5': '0.026', 'AMMO4': '0.076', 'WEAPON1': '0.110', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon5': '0.204', 'weapon4': '0.238', 'ARMOR': '0.448', 'WEAPON5': '0.600', 'HITCOUNT': '0.600', 'weapon2': '0.890', 'WEAPON3': '1.100', 'weapon3': '2.080', 'DAMAGECOUNT': '2.610', 'FRAGCOUNT': '5.500'} [2023-02-24 18:30:10,532][177157] DAMAGECOUNT value on done: 120228.0 [2023-02-24 18:30:10,533][177157] Sum rewards: 13.056, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.054', 'AMMO2': '0.013', 'AMMO5': '0.018', 'AMMO4': '0.065', 'WEAPON1': '0.070', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'weapon5': '0.196', 'weapon4': '0.220', 'WEAPON5': '0.450', 'weapon2': '0.704', 'WEAPON3': '0.950', 'HITCOUNT': '1.110', 'weapon3': '2.452', 'DAMAGECOUNT': '4.296', 'FRAGCOUNT': '13.000'} [2023-02-24 18:30:10,647][177171] DAMAGECOUNT value on done: 115208.0 [2023-02-24 18:30:10,648][177171] Sum rewards: 7.620, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.804', 'AMMO2': '0.006', 'AMMO5': '0.014', 'AMMO4': '0.029', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'weapon4': '0.208', 'weapon5': '0.310', 'WEAPON5': '0.350', 'HITCOUNT': '0.690', 'WEAPON3': '0.750', 'weapon2': '0.774', 'weapon3': '2.172', 'DAMAGECOUNT': '3.330', 'FRAGCOUNT': '7.000'} [2023-02-24 18:30:11,145][177155] DAMAGECOUNT value on done: 122579.0 [2023-02-24 18:30:11,145][177155] Sum rewards: 8.598, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.900', 'AMMO5': '0.009', 'AMMO2': '0.011', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO4': '0.055', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.108', 'AMMO3': '0.127', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.422', 'ARMOR': '0.457', 'WEAPON3': '0.850', 'HITCOUNT': '0.990', 'weapon2': '1.526', 'weapon3': '1.636', 'DAMAGECOUNT': '3.618', 'FRAGCOUNT': '8.000'} [2023-02-24 18:30:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 56459264. Throughput: 0: 3483.1. Samples: 14112438. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:30:11,376][177119] Avg episode reward: [(0, '9.613')] [2023-02-24 18:30:11,445][177155] DAMAGECOUNT value on done: 125570.0 [2023-02-24 18:30:11,445][177155] Sum rewards: 9.421, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.845', 'AMMO2': '0.007', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.034', 'weapon7': '0.070', 'weapon5': '0.074', 'AMMO3': '0.089', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon2': '0.184', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.500', 'WEAPON3': '0.500', 'weapon4': '0.688', 'HITCOUNT': '0.750', 'weapon3': '1.302', 'DAMAGECOUNT': '2.895', 'FRAGCOUNT': '8.000'} [2023-02-24 18:30:11,609][177154] Large shaping reward 2.617 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.585, 195.0), ('weapon7', 0.002)] [2023-02-24 18:30:11,923][177155] DAMAGECOUNT value on done: 125007.0 [2023-02-24 18:30:11,924][177155] Sum rewards: 4.635, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.550', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.132', 'weapon2': '0.188', 'WEAPON4': '0.250', 'weapon4': '0.424', 'ARMOR': '0.454', 'HITCOUNT': '0.470', 'WEAPON3': '0.800', 'weapon3': '1.250', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '7.000'} [2023-02-24 18:30:12,227][177155] DAMAGECOUNT value on done: 118016.0 [2023-02-24 18:30:12,227][177155] Sum rewards: 8.435, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.962', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.025', 'WEAPON1': '0.050', 'weapon7': '0.052', 'AMMO3': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.125', 'weapon5': '0.148', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.450', 'weapon4': '0.634', 'WEAPON3': '0.700', 'weapon2': '0.752', 'HITCOUNT': '0.960', 'weapon3': '1.724', 'DAMAGECOUNT': '4.059', 'FRAGCOUNT': '9.000'} [2023-02-24 18:30:12,973][177153] Updated weights for policy 0, policy_version 13790 (0.0008) [2023-02-24 18:30:15,886][177153] Updated weights for policy 0, policy_version 13800 (0.0008) [2023-02-24 18:30:16,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13968.0). Total num frames: 56528896. Throughput: 0: 3485.2. Samples: 14133470. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:30:16,376][177119] Avg episode reward: [(0, '9.493')] [2023-02-24 18:30:17,546][177156] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:30:18,093][177156] DAMAGECOUNT value on done: 118753.0 [2023-02-24 18:30:18,094][177156] Sum rewards: 12.308, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.420', 'AMMO5': '0.012', 'AMMO2': '0.039', 'WEAPON1': '0.040', 'AMMO3': '0.085', 'weapon7': '0.104', 'AMMO4': '0.194', 'weapon5': '0.198', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.700', 'weapon4': '0.804', 'weapon2': '0.866', 'weapon3': '1.694', 'DAMAGECOUNT': '3.702', 'FRAGCOUNT': '10.000'} [2023-02-24 18:30:18,206][177156] DAMAGECOUNT value on done: 120593.0 [2023-02-24 18:30:18,206][177156] Sum rewards: 10.598, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.035', 'weapon7': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.034', 'WEAPON1': '0.080', 'AMMO3': '0.098', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.169', 'weapon5': '0.266', 'WEAPON5': '0.500', 'weapon4': '0.548', 'WEAPON3': '0.600', 'HITCOUNT': '0.730', 'weapon3': '1.308', 'weapon2': '1.526', 'DAMAGECOUNT': '3.291', 'FRAGCOUNT': '11.000'} [2023-02-24 18:30:18,407][177156] DAMAGECOUNT value on done: 121311.0 [2023-02-24 18:30:18,408][177156] Sum rewards: 13.440, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.576', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon7': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.123', 'WEAPON7': '0.200', 'weapon2': '0.276', 'weapon4': '0.310', 'WEAPON3': '0.700', 'HITCOUNT': '1.240', 'weapon3': '1.476', 'DAMAGECOUNT': '5.565', 'FRAGCOUNT': '12.500'} [2023-02-24 18:30:18,524][177156] DAMAGECOUNT value on done: 118625.0 [2023-02-24 18:30:18,524][177156] Sum rewards: 5.420, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.530', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.068', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.266', 'WEAPON3': '0.450', 'HITCOUNT': '0.470', 'weapon2': '0.488', 'weapon3': '0.728', 'DAMAGECOUNT': '1.647', 'FRAGCOUNT': '5.000'} [2023-02-24 18:30:18,825][177153] Updated weights for policy 0, policy_version 13810 (0.0008) [2023-02-24 18:30:21,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 56598528. Throughput: 0: 3485.7. Samples: 14143874. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 18:30:21,376][177119] Avg episode reward: [(0, '9.515')] [2023-02-24 18:30:21,490][177154] Large shaping reward 2.534 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.483, 161.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 18:30:21,778][177153] Updated weights for policy 0, policy_version 13820 (0.0008) [2023-02-24 18:30:22,993][177170] DAMAGECOUNT value on done: 122992.0 [2023-02-24 18:30:22,993][177170] Sum rewards: 6.320, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.592', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO2': '0.043', 'AMMO3': '0.129', 'weapon5': '0.196', 'AMMO4': '0.213', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'ARMOR': '0.480', 'weapon2': '0.688', 'WEAPON3': '0.800', 'weapon4': '0.860', 'HITCOUNT': '0.890', 'weapon3': '1.586', 'DAMAGECOUNT': '3.174', 'FRAGCOUNT': '9.000'} [2023-02-24 18:30:23,091][177158] Large shaping reward 2.640 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-24 18:30:23,298][177170] DAMAGECOUNT value on done: 128281.0 [2023-02-24 18:30:23,299][177170] Sum rewards: 11.559, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.367', 'ARMOR': '0.004', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.035', 'AMMO3': '0.081', 'AMMO4': '0.174', 'weapon5': '0.266', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'WEAPON4': '0.650', 'weapon2': '0.720', 'HITCOUNT': '0.940', 'weapon4': '0.960', 'weapon3': '1.390', 'DAMAGECOUNT': '4.014', 'FRAGCOUNT': '11.000'} [2023-02-24 18:30:23,507][177170] DAMAGECOUNT value on done: 116972.0 [2023-02-24 18:30:23,508][177170] Sum rewards: 4.687, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'weapon5': '0.036', 'AMMO4': '0.065', 'weapon4': '0.068', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.400', 'ARMOR': '0.405', 'HITCOUNT': '0.480', 'weapon2': '0.658', 'HEALTH': '0.764', 'weapon3': '1.598', 'DAMAGECOUNT': '1.635', 'FRAGCOUNT': '5.000'} [2023-02-24 18:30:23,807][177170] DAMAGECOUNT value on done: 121549.0 [2023-02-24 18:30:23,808][177170] Sum rewards: 8.038, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-1.070', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.007', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'AMMO3': '0.030', 'WEAPON4': '0.100', 'weapon7': '0.120', 'weapon5': '0.160', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.280', 'WEAPON3': '0.300', 'WEAPON7': '0.400', 'HITCOUNT': '0.450', 'weapon3': '0.716', 'weapon2': '1.746', 'DAMAGECOUNT': '2.376', 'FRAGCOUNT': '4.000'} [2023-02-24 18:30:24,401][177158] DAMAGECOUNT value on done: 117877.0 [2023-02-24 18:30:24,402][177158] Sum rewards: 12.157, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.997', 'AMMO5': '0.011', 'AMMO2': '0.017', 'WEAPON1': '0.060', 'AMMO4': '0.084', 'AMMO3': '0.104', 'weapon5': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'ARMOR': '0.454', 'weapon4': '0.482', 'HITCOUNT': '0.590', 'WEAPON3': '0.650', 'weapon3': '0.824', 'weapon2': '1.436', 'DAMAGECOUNT': '3.693', 'FRAGCOUNT': '11.000'} [2023-02-24 18:30:24,705][177158] DAMAGECOUNT value on done: 117802.0 [2023-02-24 18:30:24,705][177158] Sum rewards: 3.492, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.541', 'AMMO2': '0.011', 'AMMO5': '0.022', 'WEAPON1': '0.040', 'AMMO4': '0.052', 'AMMO3': '0.064', 'weapon7': '0.096', 'weapon5': '0.160', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.400', 'WEAPON7': '0.400', 'weapon4': '0.460', 'weapon3': '1.116', 'weapon2': '1.158', 'DAMAGECOUNT': '1.773', 'FRAGCOUNT': '4.000'} [2023-02-24 18:30:24,741][177153] Updated weights for policy 0, policy_version 13830 (0.0008) [2023-02-24 18:30:25,215][177158] DAMAGECOUNT value on done: 121986.0 [2023-02-24 18:30:25,215][177158] Sum rewards: 16.820, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.402', 'AMMO2': '0.017', 'AMMO5': '0.017', 'ARMOR': '0.032', 'weapon7': '0.054', 'WEAPON1': '0.060', 'AMMO4': '0.087', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.153', 'WEAPON7': '0.200', 'weapon5': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.568', 'weapon2': '0.664', 'WEAPON3': '0.950', 'HITCOUNT': '1.210', 'weapon3': '2.030', 'DAMAGECOUNT': '5.391', 'FRAGCOUNT': '16.000'} [2023-02-24 18:30:25,518][177158] DAMAGECOUNT value on done: 122044.0 [2023-02-24 18:30:25,518][177158] Sum rewards: 11.034, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.806', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'weapon7': '0.102', 'weapon5': '0.128', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'weapon4': '0.262', 'WEAPON7': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.670', 'weapon2': '0.838', 'weapon3': '1.422', 'DAMAGECOUNT': '2.949', 'FRAGCOUNT': '11.000'} [2023-02-24 18:30:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 56668160. Throughput: 0: 3483.6. Samples: 14164698. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 18:30:26,376][177119] Avg episode reward: [(0, '9.494')] [2023-02-24 18:30:27,038][177172] DAMAGECOUNT value on done: 120242.0 [2023-02-24 18:30:27,039][177172] Sum rewards: 12.607, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.824', 'weapon4': '0.020', 'AMMO2': '0.025', 'AMMO5': '0.025', 'WEAPON4': '0.050', 'WEAPON1': '0.090', 'weapon5': '0.110', 'AMMO4': '0.124', 'AMMO3': '0.157', 'ARMOR': '0.400', 'WEAPON5': '0.550', 'HITCOUNT': '1.100', 'weapon2': '1.142', 'WEAPON3': '1.150', 'weapon3': '2.404', 'DAMAGECOUNT': '4.335', 'FRAGCOUNT': '14.000'} [2023-02-24 18:30:27,335][177172] DAMAGECOUNT value on done: 120894.0 [2023-02-24 18:30:27,336][177172] Sum rewards: 7.568, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.630', 'AMMO2': '0.006', 'AMMO5': '0.013', 'AMMO4': '0.032', 'AMMO3': '0.107', 'WEAPON1': '0.110', 'weapon5': '0.266', 'HITCOUNT': '0.480', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'weapon3': '1.596', 'weapon2': '1.798', 'DAMAGECOUNT': '2.589', 'FRAGCOUNT': '7.000'} [2023-02-24 18:30:27,699][177153] Updated weights for policy 0, policy_version 13840 (0.0008) [2023-02-24 18:30:28,008][177154] DAMAGECOUNT value on done: 127256.0 [2023-02-24 18:30:28,008][177154] Sum rewards: 14.542, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.590', 'AMMO2': '0.015', 'AMMO5': '0.021', 'WEAPON1': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'weapon4': '0.216', 'weapon5': '0.356', 'WEAPON5': '0.450', 'weapon2': '0.656', 'WEAPON3': '0.900', 'HITCOUNT': '1.130', 'weapon3': '2.362', 'DAMAGECOUNT': '5.106', 'FRAGCOUNT': '14.000'} [2023-02-24 18:30:28,312][177154] DAMAGECOUNT value on done: 126507.0 [2023-02-24 18:30:28,312][177154] Sum rewards: 13.912, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.444', 'AMMO2': '0.006', 'AMMO5': '0.009', 'WEAPON1': '0.030', 'AMMO4': '0.032', 'weapon7': '0.046', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.148', 'AMMO3': '0.165', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'HITCOUNT': '1.210', 'weapon2': '1.354', 'weapon3': '2.256', 'DAMAGECOUNT': '5.259', 'FRAGCOUNT': '13.000'} [2023-02-24 18:30:28,464][177154] DAMAGECOUNT value on done: 123942.0 [2023-02-24 18:30:28,465][177154] Sum rewards: 8.036, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.356', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon7': '0.048', 'AMMO3': '0.075', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.115', 'WEAPON4': '0.200', 'weapon5': '0.272', 'WEAPON5': '0.300', 'weapon4': '0.424', 'WEAPON3': '0.500', 'HITCOUNT': '0.660', 'weapon2': '1.036', 'weapon3': '1.474', 'DAMAGECOUNT': '3.432', 'FRAGCOUNT': '7.000'} [2023-02-24 18:30:28,501][177172] DAMAGECOUNT value on done: 123200.0 [2023-02-24 18:30:28,501][177172] Sum rewards: 13.634, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.700', 'AMMO5': '0.015', 'AMMO2': '0.026', 'weapon4': '0.076', 'WEAPON1': '0.090', 'AMMO3': '0.130', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'weapon5': '0.196', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'weapon2': '0.946', 'HITCOUNT': '1.060', 'weapon3': '2.468', 'DAMAGECOUNT': '4.695', 'FRAGCOUNT': '11.000'} [2023-02-24 18:30:28,762][177154] DAMAGECOUNT value on done: 127803.0 [2023-02-24 18:30:28,763][177154] Sum rewards: 8.748, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.228', 'AMMO2': '0.004', 'ARMOR': '0.004', 'AMMO4': '0.017', 'AMMO5': '0.024', 'WEAPON1': '0.060', 'weapon7': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'weapon5': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.356', 'weapon2': '0.362', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'HITCOUNT': '0.970', 'weapon3': '2.114', 'DAMAGECOUNT': '4.410', 'FRAGCOUNT': '10.000'} [2023-02-24 18:30:28,801][177172] DAMAGECOUNT value on done: 122684.0 [2023-02-24 18:30:28,801][177172] Sum rewards: 13.708, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.636', 'AMMO5': '0.010', 'ARMOR': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon7': '0.058', 'AMMO3': '0.110', 'AMMO4': '0.121', 'weapon5': '0.134', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.262', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.840', 'weapon3': '1.668', 'weapon2': '1.690', 'DAMAGECOUNT': '3.651', 'FRAGCOUNT': '11.000'} [2023-02-24 18:30:29,252][177157] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:30:29,306][177171] DAMAGECOUNT value on done: 123069.0 [2023-02-24 18:30:29,306][177171] Sum rewards: 5.433, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.525', 'AMMO5': '0.012', 'AMMO2': '0.052', 'WEAPON1': '0.070', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'weapon5': '0.224', 'AMMO4': '0.260', 'weapon4': '0.336', 'WEAPON5': '0.400', 'HITCOUNT': '0.510', 'WEAPON3': '0.600', 'weapon3': '1.278', 'weapon2': '1.658', 'DAMAGECOUNT': '2.121', 'FRAGCOUNT': '5.000'} [2023-02-24 18:30:29,550][177157] DAMAGECOUNT value on done: 119201.0 [2023-02-24 18:30:29,550][177157] Sum rewards: 10.218, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.022', 'AMMO5': '0.012', 'AMMO2': '0.023', 'ARMOR': '0.040', 'WEAPON1': '0.050', 'AMMO4': '0.115', 'AMMO3': '0.167', 'weapon5': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.346', 'weapon2': '0.578', 'HITCOUNT': '1.010', 'WEAPON3': '1.150', 'weapon3': '2.108', 'DAMAGECOUNT': '4.308', 'FRAGCOUNT': '13.000'} [2023-02-24 18:30:29,561][177157] DAMAGECOUNT value on done: 124654.0 [2023-02-24 18:30:29,562][177157] Sum rewards: 14.212, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.438', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon7': '0.046', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.122', 'WEAPON7': '0.200', 'weapon5': '0.204', 'WEAPON5': '0.250', 'ARMOR': '0.496', 'HITCOUNT': '0.640', 'WEAPON3': '0.700', 'weapon2': '1.674', 'weapon3': '1.814', 'DAMAGECOUNT': '3.987', 'FRAGCOUNT': '11.000'} [2023-02-24 18:30:29,608][177171] DAMAGECOUNT value on done: 123688.0 [2023-02-24 18:30:29,608][177171] Sum rewards: 13.045, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.074', 'AMMO2': '0.005', 'AMMO5': '0.016', 'AMMO4': '0.024', 'WEAPON1': '0.040', 'weapon7': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'weapon5': '0.172', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.530', 'weapon2': '0.794', 'WEAPON3': '0.900', 'HITCOUNT': '0.980', 'weapon3': '1.578', 'DAMAGECOUNT': '4.977', 'FRAGCOUNT': '13.000'} [2023-02-24 18:30:29,674][177171] DAMAGECOUNT value on done: 118655.0 [2023-02-24 18:30:29,675][177171] Sum rewards: 11.344, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.837', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon7': '0.086', 'AMMO4': '0.107', 'weapon5': '0.108', 'AMMO3': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.566', 'WEAPON3': '0.750', 'HITCOUNT': '0.780', 'weapon4': '0.810', 'weapon3': '1.794', 'DAMAGECOUNT': '3.570', 'FRAGCOUNT': '13.000'} [2023-02-24 18:30:29,856][177157] DAMAGECOUNT value on done: 118708.0 [2023-02-24 18:30:29,857][177157] Sum rewards: 17.824, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.490', 'AMMO2': '0.009', 'AMMO5': '0.012', 'AMMO4': '0.043', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'weapon4': '0.192', 'weapon5': '0.264', 'WEAPON5': '0.400', 'ARMOR': '0.483', 'WEAPON3': '0.900', 'HITCOUNT': '1.100', 'weapon2': '1.362', 'weapon3': '1.822', 'DAMAGECOUNT': '5.358', 'FRAGCOUNT': '15.000'} [2023-02-24 18:30:29,867][177157] DAMAGECOUNT value on done: 120710.0 [2023-02-24 18:30:29,867][177157] Sum rewards: 4.148, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.500', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.066', 'AMMO4': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.144', 'WEAPON5': '0.150', 'weapon4': '0.256', 'HITCOUNT': '0.350', 'WEAPON3': '0.450', 'weapon2': '0.800', 'weapon3': '0.968', 'DAMAGECOUNT': '1.446', 'FRAGCOUNT': '4.000'} [2023-02-24 18:30:29,973][177171] DAMAGECOUNT value on done: 116642.0 [2023-02-24 18:30:29,974][177171] Sum rewards: 9.283, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.408', 'AMMO2': '0.015', 'AMMO5': '0.017', 'WEAPON1': '0.060', 'AMMO4': '0.072', 'AMMO3': '0.157', 'WEAPON4': '0.250', 'weapon4': '0.308', 'weapon5': '0.340', 'WEAPON5': '0.350', 'weapon2': '0.756', 'WEAPON3': '0.950', 'HITCOUNT': '1.060', 'weapon3': '2.054', 'DAMAGECOUNT': '4.302', 'FRAGCOUNT': '12.000'} [2023-02-24 18:30:30,445][177155] DAMAGECOUNT value on done: 123931.0 [2023-02-24 18:30:30,445][177155] Sum rewards: 10.005, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.882', 'AMMO5': '0.016', 'AMMO2': '0.019', 'ARMOR': '0.032', 'WEAPON1': '0.060', 'AMMO4': '0.095', 'AMMO3': '0.180', 'weapon5': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.592', 'weapon4': '0.720', 'HITCOUNT': '1.100', 'WEAPON3': '1.150', 'weapon3': '1.846', 'DAMAGECOUNT': '4.056', 'FRAGCOUNT': '13.000'} [2023-02-24 18:30:30,646][177153] Updated weights for policy 0, policy_version 13850 (0.0009) [2023-02-24 18:30:30,747][177155] DAMAGECOUNT value on done: 126641.0 [2023-02-24 18:30:30,747][177155] Sum rewards: 9.563, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.200', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'WEAPON1': '0.060', 'AMMO3': '0.098', 'weapon4': '0.132', 'weapon5': '0.266', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'weapon3': '1.572', 'weapon2': '1.742', 'DAMAGECOUNT': '3.213', 'FRAGCOUNT': '7.000'} [2023-02-24 18:30:31,231][177155] DAMAGECOUNT value on done: 126461.0 [2023-02-24 18:30:31,231][177155] Sum rewards: 7.524, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.780', 'AMMO5': '0.021', 'AMMO2': '0.041', 'WEAPON1': '0.070', 'AMMO3': '0.102', 'AMMO4': '0.203', 'weapon5': '0.250', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'weapon2': '0.736', 'weapon4': '0.808', 'ARMOR': '0.913', 'HITCOUNT': '1.110', 'weapon3': '1.588', 'DAMAGECOUNT': '4.362', 'FRAGCOUNT': '8.000'} [2023-02-24 18:30:31,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 56737792. Throughput: 0: 3484.1. Samples: 14185596. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:30:31,376][177119] Avg episode reward: [(0, '9.989')] [2023-02-24 18:30:31,530][177155] DAMAGECOUNT value on done: 119203.0 [2023-02-24 18:30:31,531][177155] Sum rewards: 4.353, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.858', 'AMMO5': '0.019', 'AMMO2': '0.034', 'WEAPON1': '0.090', 'weapon5': '0.136', 'AMMO3': '0.157', 'AMMO4': '0.168', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.428', 'weapon2': '0.764', 'HITCOUNT': '0.900', 'ARMOR': '0.908', 'WEAPON3': '1.000', 'weapon3': '2.046', 'DAMAGECOUNT': '3.561', 'FRAGCOUNT': '8.000'} [2023-02-24 18:30:33,576][177153] Updated weights for policy 0, policy_version 13860 (0.0008) [2023-02-24 18:30:36,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13968.1). Total num frames: 56807424. Throughput: 0: 3484.0. Samples: 14196080. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:30:36,376][177119] Avg episode reward: [(0, '9.954')] [2023-02-24 18:30:36,523][177153] Updated weights for policy 0, policy_version 13870 (0.0008) [2023-02-24 18:30:37,401][177156] DAMAGECOUNT value on done: 119583.0 [2023-02-24 18:30:37,401][177156] Sum rewards: 5.049, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.952', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'weapon7': '0.104', 'weapon5': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.320', 'WEAPON3': '0.550', 'HITCOUNT': '0.560', 'weapon2': '0.990', 'weapon3': '1.574', 'DAMAGECOUNT': '2.490', 'FRAGCOUNT': '6.000'} [2023-02-24 18:30:37,500][177156] DAMAGECOUNT value on done: 122468.0 [2023-02-24 18:30:37,501][177156] Sum rewards: 19.207, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.044', 'AMMO2': '0.020', 'AMMO5': '0.034', 'weapon7': '0.046', 'WEAPON1': '0.090', 'AMMO4': '0.099', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.139', 'weapon5': '0.182', 'WEAPON7': '0.200', 'weapon2': '0.396', 'WEAPON4': '0.450', 'WEAPON5': '0.650', 'weapon4': '0.670', 'WEAPON3': '0.900', 'HITCOUNT': '1.360', 'weapon3': '2.150', 'DAMAGECOUNT': '5.625', 'FRAGCOUNT': '20.000'} [2023-02-24 18:30:37,710][177156] DAMAGECOUNT value on done: 122045.0 [2023-02-24 18:30:37,710][177156] Sum rewards: 3.125, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.156', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.072', 'AMMO3': '0.082', 'weapon7': '0.164', 'AMMO4': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'AMMO6': '0.520', 'AMMO7': '0.520', 'HITCOUNT': '0.530', 'WEAPON7': '0.600', 'weapon3': '0.962', 'weapon4': '0.984', 'weapon2': '1.114', 'DAMAGECOUNT': '2.202', 'FRAGCOUNT': '4.000'} [2023-02-24 18:30:37,809][177156] DAMAGECOUNT value on done: 120170.0 [2023-02-24 18:30:37,809][177156] Sum rewards: 15.822, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.000', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO2': '0.037', 'weapon7': '0.054', 'AMMO3': '0.133', 'WEAPON5': '0.150', 'weapon5': '0.168', 'AMMO4': '0.185', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON4': '0.400', 'WEAPON7': '0.400', 'weapon4': '0.544', 'weapon2': '0.646', 'WEAPON3': '0.900', 'HITCOUNT': '1.190', 'weapon3': '2.198', 'DAMAGECOUNT': '4.635', 'FRAGCOUNT': '16.000'} [2023-02-24 18:30:39,458][177153] Updated weights for policy 0, policy_version 13880 (0.0008) [2023-02-24 18:30:41,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 56877056. Throughput: 0: 3481.9. Samples: 14216940. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:30:41,376][177119] Avg episode reward: [(0, '9.866')] [2023-02-24 18:30:42,280][177170] DAMAGECOUNT value on done: 124582.0 [2023-02-24 18:30:42,280][177170] Sum rewards: 12.456, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.517', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO2': '0.037', 'weapon5': '0.056', 'AMMO3': '0.089', 'weapon7': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.187', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '0.600', 'weapon2': '0.852', 'weapon3': '1.024', 'weapon4': '1.030', 'HITCOUNT': '1.250', 'DAMAGECOUNT': '4.770', 'FRAGCOUNT': '10.000'} [2023-02-24 18:30:42,397][177153] Updated weights for policy 0, policy_version 13890 (0.0009) [2023-02-24 18:30:42,586][177170] DAMAGECOUNT value on done: 129521.0 [2023-02-24 18:30:42,587][177170] Sum rewards: 7.292, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.802', 'ARMOR': '0.004', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO2': '0.049', 'weapon7': '0.106', 'AMMO3': '0.132', 'weapon5': '0.182', 'AMMO4': '0.244', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON7': '0.400', 'HITCOUNT': '0.810', 'WEAPON3': '0.850', 'weapon4': '0.932', 'weapon2': '1.058', 'weapon3': '1.422', 'DAMAGECOUNT': '3.720', 'FRAGCOUNT': '9.000'} [2023-02-24 18:30:42,835][177170] DAMAGECOUNT value on done: 118533.0 [2023-02-24 18:30:42,836][177170] Sum rewards: 14.567, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.026', 'AMMO5': '0.019', 'AMMO2': '0.031', 'AMMO3': '0.080', 'WEAPON1': '0.080', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'weapon5': '0.242', 'weapon4': '0.388', 'WEAPON5': '0.450', 'ARMOR': '0.453', 'WEAPON3': '0.550', 'HITCOUNT': '0.800', 'weapon2': '1.054', 'weapon3': '1.910', 'DAMAGECOUNT': '4.683', 'FRAGCOUNT': '12.000'} [2023-02-24 18:30:43,131][177170] DAMAGECOUNT value on done: 122171.0 [2023-02-24 18:30:43,132][177170] Sum rewards: 5.073, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.320', 'AMMO5': '0.015', 'AMMO2': '0.036', 'WEAPON1': '0.080', 'AMMO3': '0.088', 'AMMO4': '0.178', 'WEAPON4': '0.200', 'weapon4': '0.212', 'weapon5': '0.314', 'WEAPON5': '0.350', 'ARMOR': '0.458', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'weapon2': '1.528', 'weapon3': '1.678', 'DAMAGECOUNT': '1.866', 'FRAGCOUNT': '4.000'} [2023-02-24 18:30:43,700][177158] DAMAGECOUNT value on done: 118968.0 [2023-02-24 18:30:43,701][177158] Sum rewards: 9.358, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.260', 'AMMO5': '0.016', 'AMMO2': '0.018', 'WEAPON1': '0.080', 'AMMO4': '0.091', 'AMMO3': '0.100', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.262', 'WEAPON5': '0.400', 'weapon4': '0.436', 'WEAPON3': '0.700', 'HITCOUNT': '0.780', 'weapon2': '0.988', 'weapon3': '1.974', 'DAMAGECOUNT': '3.273', 'FRAGCOUNT': '9.000'} [2023-02-24 18:30:43,995][177158] DAMAGECOUNT value on done: 120088.0 [2023-02-24 18:30:43,995][177158] Sum rewards: 26.176, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.200', 'AMMO2': '0.010', 'AMMO5': '0.023', 'WEAPON1': '0.040', 'AMMO4': '0.050', 'weapon7': '0.052', 'weapon5': '0.076', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.408', 'WEAPON3': '0.700', 'weapon4': '0.722', 'HITCOUNT': '1.630', 'weapon3': '1.904', 'DAMAGECOUNT': '6.858', 'FRAGCOUNT': '21.000'} [2023-02-24 18:30:44,507][177158] DAMAGECOUNT value on done: 123069.0 [2023-02-24 18:30:44,508][177158] Sum rewards: 9.768, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.150', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO2': '0.031', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.155', 'weapon5': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'ARMOR': '0.482', 'HITCOUNT': '0.500', 'weapon4': '0.688', 'WEAPON3': '0.750', 'weapon2': '0.896', 'weapon3': '1.540', 'DAMAGECOUNT': '3.249', 'FRAGCOUNT': '8.000'} [2023-02-24 18:30:44,799][177158] DAMAGECOUNT value on done: 123145.0 [2023-02-24 18:30:44,799][177158] Sum rewards: 11.618, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.904', 'AMMO5': '0.019', 'AMMO2': '0.023', 'weapon7': '0.062', 'WEAPON1': '0.070', 'AMMO3': '0.071', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.114', 'WEAPON4': '0.250', 'weapon5': '0.252', 'WEAPON3': '0.450', 'ARMOR': '0.498', 'WEAPON5': '0.500', 'HITCOUNT': '0.720', 'weapon2': '0.784', 'weapon4': '0.892', 'weapon3': '1.214', 'DAMAGECOUNT': '3.303', 'FRAGCOUNT': '7.500'} [2023-02-24 18:30:45,340][177153] Updated weights for policy 0, policy_version 13900 (0.0008) [2023-02-24 18:30:46,321][177172] DAMAGECOUNT value on done: 121957.0 [2023-02-24 18:30:46,321][177172] Sum rewards: 18.074, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.518', 'AMMO5': '0.010', 'ARMOR': '0.028', 'AMMO2': '0.037', 'WEAPON1': '0.040', 'AMMO3': '0.149', 'weapon4': '0.182', 'AMMO4': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.258', 'weapon2': '0.916', 'WEAPON3': '0.950', 'HITCOUNT': '1.280', 'weapon3': '2.160', 'DAMAGECOUNT': '5.145', 'FRAGCOUNT': '17.500'} [2023-02-24 18:30:46,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 56946688. Throughput: 0: 3481.5. Samples: 14237828. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:30:46,376][177119] Avg episode reward: [(0, '10.349')] [2023-02-24 18:30:46,379][177140] Saving new best policy, reward=10.349! [2023-02-24 18:30:46,631][177172] DAMAGECOUNT value on done: 121964.0 [2023-02-24 18:30:46,632][177172] Sum rewards: 12.475, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.582', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon7': '0.054', 'AMMO3': '0.070', 'WEAPON1': '0.070', 'AMMO4': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.306', 'WEAPON3': '0.500', 'HITCOUNT': '0.690', 'weapon3': '1.304', 'weapon2': '1.982', 'DAMAGECOUNT': '3.210', 'FRAGCOUNT': '9.000'} [2023-02-24 18:30:47,301][177154] DAMAGECOUNT value on done: 128209.0 [2023-02-24 18:30:47,301][177154] Sum rewards: 0.946, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.385', 'weapon7': '0.012', 'AMMO5': '0.014', 'AMMO2': '0.032', 'WEAPON1': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.113', 'weapon5': '0.130', 'AMMO4': '0.160', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.554', 'weapon4': '0.722', 'WEAPON3': '0.750', 'HITCOUNT': '0.830', 'weapon3': '1.454', 'DAMAGECOUNT': '2.859', 'FRAGCOUNT': '5.000'} [2023-02-24 18:30:47,606][177154] DAMAGECOUNT value on done: 128002.0 [2023-02-24 18:30:47,606][177154] Sum rewards: 14.512, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.440', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON1': '0.050', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO3': '0.143', 'weapon4': '0.250', 'ARMOR': '0.446', 'WEAPON3': '0.800', 'HITCOUNT': '1.170', 'weapon2': '1.434', 'weapon3': '1.802', 'DAMAGECOUNT': '4.485', 'FRAGCOUNT': '13.000'} [2023-02-24 18:30:47,781][177154] DAMAGECOUNT value on done: 124771.0 [2023-02-24 18:30:47,781][177154] Sum rewards: 6.738, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.308', 'AMMO5': '0.022', 'AMMO2': '0.044', 'WEAPON1': '0.060', 'weapon7': '0.062', 'AMMO3': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'AMMO4': '0.219', 'weapon5': '0.272', 'weapon4': '0.512', 'HITCOUNT': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '0.650', 'weapon2': '0.858', 'weapon3': '1.360', 'DAMAGECOUNT': '2.487', 'FRAGCOUNT': '8.000'} [2023-02-24 18:30:47,839][177172] DAMAGECOUNT value on done: 124060.0 [2023-02-24 18:30:47,839][177172] Sum rewards: 5.726, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.626', 'AMMO5': '0.012', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'weapon7': '0.108', 'AMMO3': '0.115', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'weapon5': '0.184', 'WEAPON5': '0.300', 'weapon4': '0.358', 'AMMO6': '0.420', 'AMMO7': '0.420', 'WEAPON7': '0.500', 'HITCOUNT': '0.510', 'WEAPON3': '0.700', 'weapon2': '1.148', 'weapon3': '1.420', 'DAMAGECOUNT': '2.580', 'FRAGCOUNT': '7.000'} [2023-02-24 18:30:48,083][177154] DAMAGECOUNT value on done: 128633.0 [2023-02-24 18:30:48,084][177154] Sum rewards: 5.007, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.694', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'WEAPON1': '0.050', 'AMMO4': '0.071', 'weapon5': '0.100', 'AMMO3': '0.134', 'WEAPON5': '0.200', 'weapon4': '0.324', 'ARMOR': '0.528', 'HITCOUNT': '0.620', 'weapon2': '0.844', 'WEAPON3': '0.950', 'weapon3': '1.820', 'DAMAGECOUNT': '2.490', 'FRAGCOUNT': '6.000'} [2023-02-24 18:30:48,129][177172] DAMAGECOUNT value on done: 123333.0 [2023-02-24 18:30:48,130][177172] Sum rewards: 7.577, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.764', 'AMMO5': '0.015', 'AMMO2': '0.035', 'WEAPON1': '0.060', 'AMMO3': '0.129', 'AMMO4': '0.176', 'weapon5': '0.272', 'WEAPON5': '0.400', 'HITCOUNT': '0.480', 'WEAPON3': '0.950', 'weapon2': '1.318', 'DAMAGECOUNT': '1.947', 'weapon3': '2.058', 'FRAGCOUNT': '9.000'} [2023-02-24 18:30:48,304][177153] Updated weights for policy 0, policy_version 13910 (0.0008) [2023-02-24 18:30:48,537][177156] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 18:30:48,722][177171] DAMAGECOUNT value on done: 124341.0 [2023-02-24 18:30:48,722][177171] Sum rewards: 11.239, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.200', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.012', 'WEAPON1': '0.050', 'AMMO3': '0.113', 'weapon5': '0.202', 'WEAPON5': '0.300', 'WEAPON3': '0.800', 'HITCOUNT': '1.060', 'weapon2': '1.730', 'weapon3': '1.862', 'DAMAGECOUNT': '3.816', 'FRAGCOUNT': '10.000'} [2023-02-24 18:30:48,867][177157] DAMAGECOUNT value on done: 120247.0 [2023-02-24 18:30:48,867][177157] Sum rewards: 9.495, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.465', 'AMMO5': '0.009', 'AMMO2': '0.043', 'WEAPON1': '0.070', 'AMMO3': '0.103', 'weapon5': '0.154', 'WEAPON4': '0.200', 'weapon4': '0.210', 'AMMO4': '0.216', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'HITCOUNT': '0.730', 'weapon2': '1.242', 'weapon3': '2.094', 'DAMAGECOUNT': '3.138', 'FRAGCOUNT': '9.000'} [2023-02-24 18:30:48,879][177157] DAMAGECOUNT value on done: 125929.0 [2023-02-24 18:30:48,880][177157] Sum rewards: 9.929, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.339', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'AMMO2': '0.044', 'WEAPON5': '0.100', 'weapon5': '0.124', 'AMMO3': '0.141', 'AMMO4': '0.222', 'weapon7': '0.228', 'AMMO6': '0.340', 'AMMO7': '0.340', 'weapon2': '0.376', 'ARMOR': '0.462', 'WEAPON7': '0.500', 'WEAPON4': '0.550', 'HITCOUNT': '0.830', 'WEAPON3': '0.850', 'weapon4': '1.138', 'weapon3': '1.662', 'DAMAGECOUNT': '3.825', 'FRAGCOUNT': '8.500'} [2023-02-24 18:30:49,019][177171] DAMAGECOUNT value on done: 125112.0 [2023-02-24 18:30:49,020][177171] Sum rewards: 10.390, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.640', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON1': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'weapon5': '0.170', 'weapon4': '0.198', 'WEAPON5': '0.200', 'WEAPON3': '0.900', 'weapon2': '1.064', 'HITCOUNT': '1.140', 'weapon3': '2.314', 'DAMAGECOUNT': '4.272', 'FRAGCOUNT': '9.000'} [2023-02-24 18:30:49,085][177171] DAMAGECOUNT value on done: 120264.0 [2023-02-24 18:30:49,086][177171] Sum rewards: 11.875, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.896', 'AMMO5': '0.014', 'AMMO2': '0.018', 'WEAPON1': '0.050', 'weapon7': '0.054', 'AMMO4': '0.087', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'WEAPON7': '0.200', 'weapon5': '0.260', 'WEAPON5': '0.300', 'weapon4': '0.348', 'weapon2': '0.624', 'HITCOUNT': '0.990', 'WEAPON3': '1.100', 'weapon3': '2.342', 'DAMAGECOUNT': '4.827', 'FRAGCOUNT': '14.000'} [2023-02-24 18:30:49,162][177157] DAMAGECOUNT value on done: 120422.0 [2023-02-24 18:30:49,163][177157] Sum rewards: 14.409, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.395', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'AMMO3': '0.119', 'AMMO4': '0.120', 'weapon5': '0.180', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.618', 'WEAPON3': '0.850', 'weapon2': '0.882', 'HITCOUNT': '1.410', 'weapon3': '1.950', 'DAMAGECOUNT': '5.142', 'FRAGCOUNT': '15.000'} [2023-02-24 18:30:49,174][177157] DAMAGECOUNT value on done: 122435.0 [2023-02-24 18:30:49,175][177157] Sum rewards: 19.215, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.682', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO5': '0.025', 'weapon7': '0.060', 'AMMO4': '0.079', 'AMMO3': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.148', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.264', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '0.970', 'weapon2': '1.366', 'weapon3': '1.940', 'DAMAGECOUNT': '5.175', 'FRAGCOUNT': '17.000'} [2023-02-24 18:30:49,386][177171] DAMAGECOUNT value on done: 117207.0 [2023-02-24 18:30:49,386][177171] Sum rewards: 1.321, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.240', 'AMMO5': '0.012', 'ARMOR': '0.020', 'AMMO2': '0.038', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'weapon5': '0.144', 'AMMO4': '0.191', 'WEAPON5': '0.350', 'weapon4': '0.458', 'HITCOUNT': '0.460', 'WEAPON3': '0.800', 'weapon2': '1.194', 'weapon3': '1.584', 'DAMAGECOUNT': '1.695', 'FRAGCOUNT': '4.000'} [2023-02-24 18:30:49,790][177155] DAMAGECOUNT value on done: 125022.0 [2023-02-24 18:30:49,791][177155] Sum rewards: 11.277, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.007', 'WEAPON1': '0.040', 'AMMO2': '0.046', 'weapon5': '0.056', 'AMMO3': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO4': '0.231', 'HEALTH': '0.395', 'ARMOR': '0.404', 'WEAPON3': '0.550', 'HITCOUNT': '0.850', 'weapon4': '0.892', 'weapon2': '0.942', 'weapon3': '1.640', 'DAMAGECOUNT': '3.273', 'FRAGCOUNT': '9.000'} [2023-02-24 18:30:50,087][177155] DAMAGECOUNT value on done: 128069.0 [2023-02-24 18:30:50,087][177155] Sum rewards: 17.108, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.799', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.058', 'AMMO3': '0.085', 'weapon7': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.154', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.498', 'WEAPON3': '0.500', 'HITCOUNT': '0.710', 'weapon3': '1.362', 'weapon2': '2.164', 'DAMAGECOUNT': '4.284', 'FRAGCOUNT': '11.000'} [2023-02-24 18:30:50,547][177155] DAMAGECOUNT value on done: 127662.0 [2023-02-24 18:30:50,548][177155] Sum rewards: 4.812, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.012', 'AMMO2': '0.015', 'AMMO5': '0.017', 'AMMO4': '0.077', 'WEAPON1': '0.110', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'weapon4': '0.238', 'weapon5': '0.402', 'WEAPON5': '0.450', 'weapon2': '0.598', 'HITCOUNT': '0.970', 'WEAPON3': '1.000', 'weapon3': '2.294', 'DAMAGECOUNT': '3.603', 'FRAGCOUNT': '6.500'} [2023-02-24 18:30:50,851][177155] DAMAGECOUNT value on done: 120700.0 [2023-02-24 18:30:50,851][177155] Sum rewards: 10.171, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.636', 'AMMO5': '0.011', 'AMMO2': '0.034', 'WEAPON1': '0.060', 'weapon5': '0.148', 'AMMO3': '0.169', 'AMMO4': '0.172', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.408', 'WEAPON3': '0.950', 'weapon2': '1.100', 'HITCOUNT': '1.200', 'weapon3': '1.862', 'DAMAGECOUNT': '4.491', 'FRAGCOUNT': '10.000'} [2023-02-24 18:30:51,212][177153] Updated weights for policy 0, policy_version 13920 (0.0008) [2023-02-24 18:30:51,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 57016320. Throughput: 0: 3482.0. Samples: 14248238. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:30:51,376][177119] Avg episode reward: [(0, '10.427')] [2023-02-24 18:30:51,377][177140] Saving new best policy, reward=10.427! [2023-02-24 18:30:54,137][177153] Updated weights for policy 0, policy_version 13930 (0.0008) [2023-02-24 18:30:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 57085952. Throughput: 0: 3486.7. Samples: 14269340. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:30:56,376][177119] Avg episode reward: [(0, '10.427')] [2023-02-24 18:30:56,379][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000013937_57085952.pth... [2023-02-24 18:30:56,435][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000013120_53739520.pth [2023-02-24 18:30:56,645][177156] DAMAGECOUNT value on done: 121283.0 [2023-02-24 18:30:56,646][177156] Sum rewards: 17.593, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.368', 'ARMOR': '0.008', 'AMMO2': '0.013', 'AMMO5': '0.016', 'WEAPON1': '0.060', 'weapon7': '0.064', 'AMMO4': '0.067', 'AMMO3': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.416', 'WEAPON3': '0.650', 'weapon4': '0.890', 'HITCOUNT': '1.140', 'weapon3': '1.544', 'DAMAGECOUNT': '5.100', 'FRAGCOUNT': '15.000'} [2023-02-24 18:30:56,762][177156] DAMAGECOUNT value on done: 123624.0 [2023-02-24 18:30:56,763][177156] Sum rewards: 12.795, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.875', 'AMMO2': '0.006', 'AMMO5': '0.021', 'AMMO4': '0.027', 'WEAPON1': '0.060', 'AMMO3': '0.078', 'weapon7': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.676', 'HITCOUNT': '0.720', 'weapon2': '0.720', 'weapon3': '1.426', 'DAMAGECOUNT': '3.468', 'FRAGCOUNT': '12.000'} [2023-02-24 18:30:56,956][177156] DAMAGECOUNT value on done: 123333.0 [2023-02-24 18:30:56,957][177156] Sum rewards: 9.768, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.129', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.019', 'weapon7': '0.048', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.262', 'weapon4': '0.302', 'WEAPON5': '0.500', 'weapon2': '0.718', 'HITCOUNT': '0.910', 'WEAPON3': '0.950', 'weapon3': '2.046', 'DAMAGECOUNT': '3.864', 'FRAGCOUNT': '11.000'} [2023-02-24 18:30:57,058][177153] Updated weights for policy 0, policy_version 13940 (0.0008) [2023-02-24 18:30:57,075][177156] DAMAGECOUNT value on done: 121364.0 [2023-02-24 18:30:57,075][177156] Sum rewards: 13.545, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.616', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.042', 'WEAPON1': '0.060', 'AMMO3': '0.068', 'WEAPON4': '0.200', 'weapon5': '0.388', 'WEAPON5': '0.400', 'ARMOR': '0.468', 'weapon4': '0.496', 'WEAPON3': '0.500', 'HITCOUNT': '0.500', 'weapon2': '0.804', 'weapon3': '1.380', 'DAMAGECOUNT': '3.582', 'FRAGCOUNT': '9.000'} [2023-02-24 18:31:00,013][177153] Updated weights for policy 0, policy_version 13950 (0.0008) [2023-02-24 18:31:01,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 57155584. Throughput: 0: 3482.6. Samples: 14290188. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:31:01,376][177119] Avg episode reward: [(0, '10.547')] [2023-02-24 18:31:01,377][177140] Saving new best policy, reward=10.547! [2023-02-24 18:31:01,590][177170] DAMAGECOUNT value on done: 125405.0 [2023-02-24 18:31:01,591][177170] Sum rewards: 6.277, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.228', 'AMMO5': '0.015', 'AMMO2': '0.033', 'WEAPON1': '0.050', 'AMMO3': '0.082', 'AMMO4': '0.165', 'WEAPON4': '0.250', 'weapon5': '0.300', 'weapon4': '0.344', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'ARMOR': '0.465', 'HITCOUNT': '0.500', 'weapon2': '1.372', 'weapon3': '1.660', 'DAMAGECOUNT': '2.469', 'FRAGCOUNT': '5.500'} [2023-02-24 18:31:01,894][177170] DAMAGECOUNT value on done: 130552.0 [2023-02-24 18:31:01,894][177170] Sum rewards: 10.030, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.840', 'AMMO5': '0.020', 'AMMO2': '0.022', 'weapon7': '0.048', 'WEAPON1': '0.060', 'AMMO3': '0.068', 'AMMO4': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.298', 'ARMOR': '0.424', 'WEAPON3': '0.450', 'HITCOUNT': '0.470', 'WEAPON5': '0.500', 'weapon2': '0.642', 'weapon4': '0.704', 'weapon3': '1.320', 'DAMAGECOUNT': '3.093', 'FRAGCOUNT': '8.000'} [2023-02-24 18:31:02,157][177170] DAMAGECOUNT value on done: 119378.0 [2023-02-24 18:31:02,157][177170] Sum rewards: 5.847, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.832', 'AMMO2': '0.004', 'AMMO4': '0.019', 'AMMO5': '0.022', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'weapon5': '0.148', 'AMMO3': '0.171', 'weapon4': '0.288', 'weapon2': '0.392', 'WEAPON5': '0.450', 'HITCOUNT': '0.490', 'ARMOR': '0.848', 'WEAPON3': '1.000', 'weapon3': '2.422', 'DAMAGECOUNT': '2.535', 'FRAGCOUNT': '7.000'} [2023-02-24 18:31:02,455][177170] DAMAGECOUNT value on done: 123550.0 [2023-02-24 18:31:02,456][177170] Sum rewards: 12.497, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.680', 'AMMO5': '0.012', 'AMMO2': '0.034', 'WEAPON1': '0.050', 'AMMO3': '0.106', 'weapon4': '0.160', 'weapon5': '0.168', 'AMMO4': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'HITCOUNT': '0.970', 'weapon2': '1.034', 'weapon3': '2.236', 'DAMAGECOUNT': '4.137', 'FRAGCOUNT': '12.000'} [2023-02-24 18:31:02,843][177158] DAMAGECOUNT value on done: 120388.0 [2023-02-24 18:31:02,843][177158] Sum rewards: 12.983, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.403', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon7': '0.098', 'AMMO3': '0.119', 'AMMO4': '0.119', 'weapon5': '0.172', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.450', 'ARMOR': '0.488', 'WEAPON3': '0.700', 'HITCOUNT': '0.770', 'weapon2': '0.960', 'weapon4': '1.038', 'weapon3': '1.216', 'DAMAGECOUNT': '4.257', 'FRAGCOUNT': '12.000'} [2023-02-24 18:31:02,951][177153] Updated weights for policy 0, policy_version 13960 (0.0008) [2023-02-24 18:31:03,138][177158] DAMAGECOUNT value on done: 121062.0 [2023-02-24 18:31:03,139][177158] Sum rewards: 8.765, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.530', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.063', 'weapon5': '0.080', 'weapon7': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.480', 'weapon4': '0.806', 'weapon2': '0.838', 'weapon3': '0.870', 'DAMAGECOUNT': '2.922', 'FRAGCOUNT': '6.000'} [2023-02-24 18:31:03,642][177158] DAMAGECOUNT value on done: 124079.0 [2023-02-24 18:31:03,642][177158] Sum rewards: 10.438, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.090', 'AMMO5': '0.012', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.067', 'weapon7': '0.074', 'AMMO3': '0.085', 'weapon5': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.598', 'WEAPON3': '0.600', 'HITCOUNT': '0.820', 'weapon2': '1.146', 'weapon3': '1.264', 'DAMAGECOUNT': '3.030', 'FRAGCOUNT': '9.000'} [2023-02-24 18:31:03,939][177158] DAMAGECOUNT value on done: 124167.0 [2023-02-24 18:31:03,939][177158] Sum rewards: 10.353, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.905', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.028', 'weapon7': '0.062', 'AMMO3': '0.079', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'weapon5': '0.164', 'WEAPON5': '0.350', 'weapon4': '0.542', 'WEAPON3': '0.550', 'weapon2': '0.628', 'HITCOUNT': '0.720', 'weapon3': '1.456', 'DAMAGECOUNT': '3.066', 'FRAGCOUNT': '9.000'} [2023-02-24 18:31:05,483][177172] DAMAGECOUNT value on done: 122402.0 [2023-02-24 18:31:05,483][177172] Sum rewards: 6.266, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.110', 'AMMO5': '0.007', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.071', 'AMMO4': '0.147', 'weapon5': '0.186', 'WEAPON5': '0.200', 'weapon4': '0.288', 'HITCOUNT': '0.340', 'WEAPON3': '0.400', 'ARMOR': '0.424', 'weapon3': '1.212', 'DAMAGECOUNT': '1.335', 'weapon2': '1.656', 'FRAGCOUNT': '3.000'} [2023-02-24 18:31:05,773][177172] DAMAGECOUNT value on done: 122724.0 [2023-02-24 18:31:05,774][177172] Sum rewards: 7.236, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.515', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'weapon5': '0.076', 'AMMO4': '0.076', 'AMMO3': '0.083', 'WEAPON5': '0.100', 'WEAPON3': '0.600', 'HITCOUNT': '0.680', 'weapon3': '1.870', 'weapon2': '1.928', 'DAMAGECOUNT': '2.280', 'FRAGCOUNT': '7.000'} [2023-02-24 18:31:05,878][177153] Updated weights for policy 0, policy_version 13970 (0.0008) [2023-02-24 18:31:06,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 57225216. Throughput: 0: 3484.0. Samples: 14300654. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:31:06,376][177119] Avg episode reward: [(0, '10.461')] [2023-02-24 18:31:06,560][177154] DAMAGECOUNT value on done: 129568.0 [2023-02-24 18:31:06,561][177154] Sum rewards: 7.343, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.300', 'AMMO2': '0.015', 'AMMO5': '0.026', 'WEAPON1': '0.050', 'AMMO4': '0.073', 'AMMO3': '0.199', 'weapon5': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.600', 'weapon2': '0.666', 'HITCOUNT': '0.730', 'weapon4': '0.902', 'WEAPON3': '1.250', 'weapon3': '1.676', 'DAMAGECOUNT': '4.077', 'FRAGCOUNT': '11.000'} [2023-02-24 18:31:06,872][177154] DAMAGECOUNT value on done: 129952.0 [2023-02-24 18:31:06,873][177154] Sum rewards: 21.165, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.392', 'AMMO5': '0.013', 'AMMO2': '0.018', 'weapon7': '0.020', 'ARMOR': '0.024', 'WEAPON1': '0.040', 'AMMO4': '0.088', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'weapon5': '0.258', 'WEAPON5': '0.300', 'weapon4': '0.446', 'weapon2': '0.564', 'WEAPON3': '0.800', 'HITCOUNT': '1.420', 'weapon3': '2.120', 'DAMAGECOUNT': '5.850', 'FRAGCOUNT': '18.000'} [2023-02-24 18:31:07,042][177154] DAMAGECOUNT value on done: 126223.0 [2023-02-24 18:31:07,042][177154] Sum rewards: 8.866, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.747', 'AMMO5': '0.015', 'AMMO2': '0.030', 'WEAPON1': '0.030', 'weapon7': '0.050', 'weapon4': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'AMMO4': '0.148', 'weapon5': '0.238', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON5': '0.450', 'HITCOUNT': '0.700', 'WEAPON3': '0.900', 'weapon3': '1.612', 'weapon2': '1.758', 'DAMAGECOUNT': '3.756', 'FRAGCOUNT': '8.000'} [2023-02-24 18:31:07,084][177172] DAMAGECOUNT value on done: 125054.0 [2023-02-24 18:31:07,085][177172] Sum rewards: 9.255, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.739', 'AMMO5': '0.012', 'AMMO2': '0.019', 'WEAPON1': '0.060', 'weapon5': '0.068', 'AMMO3': '0.095', 'AMMO4': '0.097', 'weapon7': '0.140', 'WEAPON4': '0.150', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'weapon2': '0.474', 'HITCOUNT': '0.690', 'WEAPON3': '0.750', 'weapon4': '0.774', 'weapon3': '1.772', 'DAMAGECOUNT': '2.982', 'FRAGCOUNT': '8.000'} [2023-02-24 18:31:07,341][177154] DAMAGECOUNT value on done: 129865.0 [2023-02-24 18:31:07,342][177154] Sum rewards: 11.955, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.385', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.050', 'weapon7': '0.052', 'AMMO4': '0.072', 'AMMO3': '0.083', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.168', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.454', 'WEAPON3': '0.700', 'HITCOUNT': '0.820', 'weapon2': '0.930', 'weapon3': '1.952', 'DAMAGECOUNT': '3.696', 'FRAGCOUNT': '9.500'} [2023-02-24 18:31:07,380][177172] DAMAGECOUNT value on done: 123967.0 [2023-02-24 18:31:07,380][177172] Sum rewards: 6.799, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.924', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'ARMOR': '0.044', 'AMMO3': '0.063', 'weapon7': '0.090', 'AMMO4': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.124', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.490', 'weapon2': '0.518', 'weapon4': '0.692', 'weapon3': '1.312', 'DAMAGECOUNT': '1.902', 'FRAGCOUNT': '7.000'} [2023-02-24 18:31:07,979][177171] DAMAGECOUNT value on done: 125045.0 [2023-02-24 18:31:07,980][177171] Sum rewards: 6.853, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.980', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'weapon7': '0.046', 'AMMO3': '0.057', 'weapon5': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.520', 'weapon3': '1.064', 'DAMAGECOUNT': '2.112', 'weapon2': '2.742', 'FRAGCOUNT': '4.000'} [2023-02-24 18:31:08,031][177157] DAMAGECOUNT value on done: 120783.0 [2023-02-24 18:31:08,032][177157] Sum rewards: 5.162, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.016', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon7': '0.066', 'AMMO3': '0.081', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'weapon5': '0.162', 'WEAPON5': '0.300', 'HITCOUNT': '0.340', 'ARMOR': '0.404', 'WEAPON3': '0.500', 'weapon4': '0.552', 'weapon3': '1.294', 'DAMAGECOUNT': '1.608', 'weapon2': '1.738', 'FRAGCOUNT': '3.000'} [2023-02-24 18:31:08,043][177157] DAMAGECOUNT value on done: 127368.0 [2023-02-24 18:31:08,043][177157] Sum rewards: 15.242, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.284', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.094', 'weapon7': '0.102', 'weapon5': '0.104', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.234', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'HITCOUNT': '1.000', 'weapon3': '1.544', 'weapon2': '1.854', 'DAMAGECOUNT': '4.317', 'FRAGCOUNT': '12.000'} [2023-02-24 18:31:08,273][177171] DAMAGECOUNT value on done: 126318.0 [2023-02-24 18:31:08,274][177171] Sum rewards: 9.598, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO4': '0.046', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.085', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.178', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HEALTH': '0.266', 'weapon4': '0.284', 'WEAPON3': '0.550', 'HITCOUNT': '0.690', 'weapon3': '1.402', 'weapon2': '1.710', 'DAMAGECOUNT': '3.618', 'FRAGCOUNT': '6.000'} [2023-02-24 18:31:08,342][177171] DAMAGECOUNT value on done: 121173.0 [2023-02-24 18:31:08,342][177171] Sum rewards: 11.030, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.130', 'AMMO5': '0.007', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO3': '0.066', 'AMMO4': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.258', 'WEAPON3': '0.400', 'weapon4': '0.400', 'HITCOUNT': '0.490', 'weapon2': '0.922', 'weapon3': '1.320', 'DAMAGECOUNT': '2.727', 'FRAGCOUNT': '8.000'} [2023-02-24 18:31:08,344][177157] DAMAGECOUNT value on done: 121714.0 [2023-02-24 18:31:08,344][177157] Sum rewards: 10.281, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.448', 'AMMO2': '0.004', 'AMMO5': '0.017', 'AMMO4': '0.020', 'WEAPON1': '0.030', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.128', 'weapon5': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.503', 'WEAPON3': '0.700', 'HITCOUNT': '0.780', 'weapon2': '1.580', 'weapon3': '1.790', 'DAMAGECOUNT': '3.876', 'FRAGCOUNT': '9.000'} [2023-02-24 18:31:08,355][177157] DAMAGECOUNT value on done: 123888.0 [2023-02-24 18:31:08,355][177157] Sum rewards: 9.746, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.410', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon7': '0.046', 'AMMO3': '0.057', 'AMMO4': '0.066', 'weapon5': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.602', 'HITCOUNT': '0.610', 'weapon2': '0.800', 'weapon3': '1.050', 'DAMAGECOUNT': '3.459', 'FRAGCOUNT': '9.000'} [2023-02-24 18:31:08,639][177171] DAMAGECOUNT value on done: 117937.0 [2023-02-24 18:31:08,640][177171] Sum rewards: 6.854, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.255', 'AMMO2': '0.004', 'AMMO5': '0.013', 'AMMO4': '0.019', 'WEAPON1': '0.030', 'AMMO3': '0.078', 'weapon7': '0.100', 'weapon5': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'AMMO6': '0.440', 'AMMO7': '0.440', 'HITCOUNT': '0.440', 'WEAPON3': '0.550', 'WEAPON7': '0.600', 'weapon4': '0.906', 'weapon2': '1.068', 'weapon3': '1.332', 'DAMAGECOUNT': '2.190', 'FRAGCOUNT': '5.000'} [2023-02-24 18:31:08,822][177153] Updated weights for policy 0, policy_version 13980 (0.0008) [2023-02-24 18:31:09,102][177155] DAMAGECOUNT value on done: 125931.0 [2023-02-24 18:31:09,103][177155] Sum rewards: 9.762, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.895', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'AMMO3': '0.040', 'weapon7': '0.050', 'weapon5': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'WEAPON3': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.372', 'ARMOR': '0.457', 'HITCOUNT': '0.630', 'weapon3': '0.940', 'weapon2': '1.972', 'DAMAGECOUNT': '2.367', 'FRAGCOUNT': '7.000'} [2023-02-24 18:31:09,394][177155] DAMAGECOUNT value on done: 129400.0 [2023-02-24 18:31:09,394][177155] Sum rewards: 16.290, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.042', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.048', 'weapon7': '0.054', 'AMMO3': '0.089', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.185', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '0.600', 'weapon4': '0.718', 'weapon2': '0.862', 'HITCOUNT': '0.930', 'weapon3': '1.506', 'DAMAGECOUNT': '3.993', 'FRAGCOUNT': '14.000'} [2023-02-24 18:31:09,859][177155] DAMAGECOUNT value on done: 128880.0 [2023-02-24 18:31:09,860][177155] Sum rewards: 10.760, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.770', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'weapon7': '0.048', 'weapon5': '0.050', 'AMMO4': '0.054', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.124', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.416', 'WEAPON3': '0.750', 'weapon2': '0.894', 'HITCOUNT': '0.930', 'weapon3': '1.728', 'DAMAGECOUNT': '3.654', 'FRAGCOUNT': '12.000'} [2023-02-24 18:31:10,160][177155] DAMAGECOUNT value on done: 122423.0 [2023-02-24 18:31:10,161][177155] Sum rewards: 16.404, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.703', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'WEAPON1': '0.020', 'AMMO5': '0.026', 'weapon7': '0.076', 'AMMO3': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.262', 'ARMOR': '0.447', 'WEAPON5': '0.550', 'weapon2': '0.598', 'WEAPON3': '0.650', 'weapon4': '0.758', 'HITCOUNT': '1.090', 'weapon3': '1.486', 'DAMAGECOUNT': '5.169', 'FRAGCOUNT': '13.000'} [2023-02-24 18:31:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 57294848. Throughput: 0: 3486.0. Samples: 14321566. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:31:11,376][177119] Avg episode reward: [(0, '10.362')] [2023-02-24 18:31:11,761][177153] Updated weights for policy 0, policy_version 13990 (0.0008) [2023-02-24 18:31:14,682][177153] Updated weights for policy 0, policy_version 14000 (0.0008) [2023-02-24 18:31:16,000][177156] DAMAGECOUNT value on done: 121823.0 [2023-02-24 18:31:16,001][177156] Sum rewards: 6.939, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.520', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'ARMOR': '0.024', 'AMMO3': '0.030', 'AMMO2': '0.030', 'weapon7': '0.068', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'WEAPON3': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon2': '0.410', 'HITCOUNT': '0.430', 'WEAPON4': '0.450', 'weapon3': '0.664', 'weapon4': '0.894', 'DAMAGECOUNT': '1.620', 'FRAGCOUNT': '6.000'} [2023-02-24 18:31:16,095][177156] DAMAGECOUNT value on done: 125156.0 [2023-02-24 18:31:16,095][177156] Sum rewards: 11.000, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.190', 'AMMO5': '0.017', 'AMMO2': '0.024', 'WEAPON1': '0.050', 'AMMO4': '0.120', 'AMMO3': '0.132', 'weapon5': '0.224', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.578', 'weapon2': '0.780', 'WEAPON3': '0.900', 'HITCOUNT': '1.110', 'weapon3': '2.008', 'DAMAGECOUNT': '4.596', 'FRAGCOUNT': '11.500'} [2023-02-24 18:31:16,305][177156] DAMAGECOUNT value on done: 125510.0 [2023-02-24 18:31:16,306][177156] Sum rewards: 26.303, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.284', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon7': '0.072', 'AMMO3': '0.095', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.128', 'WEAPON7': '0.200', 'AMMO4': '0.201', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.467', 'WEAPON3': '0.650', 'weapon4': '0.810', 'weapon2': '0.862', 'HITCOUNT': '1.430', 'weapon3': '1.548', 'DAMAGECOUNT': '6.531', 'FRAGCOUNT': '21.000'} [2023-02-24 18:31:16,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 57364480. Throughput: 0: 3487.6. Samples: 14342538. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:31:16,376][177119] Avg episode reward: [(0, '10.578')] [2023-02-24 18:31:16,379][177140] Saving new best policy, reward=10.578! [2023-02-24 18:31:16,415][177156] DAMAGECOUNT value on done: 122194.0 [2023-02-24 18:31:16,415][177156] Sum rewards: 6.273, reward structure: {'DEATHCOUNT': '-6.750', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'weapon7': '0.052', 'HEALTH': '0.075', 'AMMO3': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.157', 'weapon5': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.390', 'WEAPON3': '0.400', 'weapon4': '0.432', 'weapon2': '1.480', 'weapon3': '1.542', 'DAMAGECOUNT': '2.490', 'FRAGCOUNT': '5.000'} [2023-02-24 18:31:17,670][177153] Updated weights for policy 0, policy_version 14010 (0.0008) [2023-02-24 18:31:20,602][177153] Updated weights for policy 0, policy_version 14020 (0.0009) [2023-02-24 18:31:20,829][177170] DAMAGECOUNT value on done: 126581.0 [2023-02-24 18:31:20,830][177170] Sum rewards: 11.477, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.470', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.052', 'WEAPON1': '0.060', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'weapon5': '0.110', 'WEAPON5': '0.250', 'weapon4': '0.262', 'WEAPON3': '0.500', 'HITCOUNT': '0.810', 'weapon3': '1.702', 'weapon2': '1.722', 'DAMAGECOUNT': '3.528', 'FRAGCOUNT': '8.000'} [2023-02-24 18:31:21,116][177170] DAMAGECOUNT value on done: 131619.0 [2023-02-24 18:31:21,116][177170] Sum rewards: 10.826, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.844', 'AMMO5': '0.006', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.045', 'AMMO3': '0.053', 'weapon7': '0.062', 'weapon5': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon2': '0.186', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'ARMOR': '0.493', 'HITCOUNT': '0.730', 'weapon4': '0.766', 'weapon3': '1.208', 'DAMAGECOUNT': '3.201', 'FRAGCOUNT': '8.000'} [2023-02-24 18:31:21,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 57434112. Throughput: 0: 3486.3. Samples: 14352966. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:31:21,376][177119] Avg episode reward: [(0, '10.551')] [2023-02-24 18:31:21,384][177170] DAMAGECOUNT value on done: 120237.0 [2023-02-24 18:31:21,384][177170] Sum rewards: 7.935, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.182', 'AMMO5': '0.010', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'weapon5': '0.054', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.106', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.400', 'ARMOR': '0.400', 'HITCOUNT': '0.580', 'WEAPON3': '0.700', 'weapon2': '0.750', 'weapon4': '0.802', 'weapon3': '1.328', 'DAMAGECOUNT': '2.577', 'FRAGCOUNT': '9.000'} [2023-02-24 18:31:21,683][177170] DAMAGECOUNT value on done: 124407.0 [2023-02-24 18:31:21,684][177170] Sum rewards: 5.570, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.420', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.028', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.104', 'AMMO3': '0.131', 'weapon5': '0.214', 'WEAPON5': '0.300', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'HITCOUNT': '0.720', 'WEAPON3': '0.900', 'weapon2': '1.382', 'weapon3': '1.882', 'DAMAGECOUNT': '2.571', 'FRAGCOUNT': '6.000'} [2023-02-24 18:31:22,030][177158] DAMAGECOUNT value on done: 121749.0 [2023-02-24 18:31:22,031][177158] Sum rewards: 13.784, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.583', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.024', 'WEAPON1': '0.050', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'AMMO4': '0.118', 'weapon5': '0.270', 'weapon4': '0.276', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.830', 'weapon2': '1.282', 'weapon3': '1.662', 'DAMAGECOUNT': '4.083', 'FRAGCOUNT': '12.000'} [2023-02-24 18:31:22,332][177158] DAMAGECOUNT value on done: 121662.0 [2023-02-24 18:31:22,332][177158] Sum rewards: 6.104, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.756', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.037', 'weapon7': '0.056', 'AMMO3': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.136', 'AMMO4': '0.186', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'HITCOUNT': '0.360', 'ARMOR': '0.428', 'weapon2': '0.488', 'WEAPON3': '0.600', 'weapon4': '0.798', 'weapon3': '1.646', 'DAMAGECOUNT': '1.800', 'FRAGCOUNT': '6.000'} [2023-02-24 18:31:22,865][177158] DAMAGECOUNT value on done: 125380.0 [2023-02-24 18:31:22,866][177158] Sum rewards: 13.929, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.755', 'AMMO5': '0.022', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'weapon4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.094', 'AMMO4': '0.122', 'weapon5': '0.366', 'WEAPON5': '0.500', 'HITCOUNT': '0.670', 'WEAPON3': '0.700', 'weapon2': '1.116', 'weapon3': '2.006', 'DAMAGECOUNT': '3.903', 'FRAGCOUNT': '11.000'} [2023-02-24 18:31:23,167][177158] DAMAGECOUNT value on done: 124742.0 [2023-02-24 18:31:23,168][177158] Sum rewards: 4.398, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.280', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon7': '0.050', 'AMMO3': '0.064', 'weapon5': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'weapon4': '0.518', 'HITCOUNT': '0.560', 'weapon2': '0.642', 'weapon3': '0.754', 'DAMAGECOUNT': '1.725', 'FRAGCOUNT': '5.000'} [2023-02-24 18:31:23,558][177153] Updated weights for policy 0, policy_version 14030 (0.0008) [2023-02-24 18:31:24,711][177172] DAMAGECOUNT value on done: 122988.0 [2023-02-24 18:31:24,712][177172] Sum rewards: 4.546, reward structure: {'DEATHCOUNT': '-7.500', 'ARMOR': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.044', 'AMMO3': '0.109', 'weapon5': '0.178', 'WEAPON5': '0.200', 'AMMO4': '0.218', 'HEALTH': '0.244', 'WEAPON4': '0.450', 'WEAPON3': '0.500', 'HITCOUNT': '0.520', 'weapon2': '0.710', 'weapon4': '0.832', 'weapon3': '1.734', 'DAMAGECOUNT': '1.758', 'FRAGCOUNT': '4.500'} [2023-02-24 18:31:25,009][177172] DAMAGECOUNT value on done: 123693.0 [2023-02-24 18:31:25,009][177172] Sum rewards: 12.825, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.239', 'AMMO5': '0.010', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'AMMO3': '0.061', 'AMMO4': '0.070', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.426', 'WEAPON3': '0.500', 'HITCOUNT': '0.730', 'weapon2': '1.454', 'weapon3': '1.582', 'DAMAGECOUNT': '2.907', 'FRAGCOUNT': '11.000'} [2023-02-24 18:31:25,866][177154] DAMAGECOUNT value on done: 130306.0 [2023-02-24 18:31:25,866][177154] Sum rewards: 5.107, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.336', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon7': '0.054', 'AMMO3': '0.077', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO4': '0.209', 'WEAPON4': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.680', 'weapon4': '0.774', 'ARMOR': '0.800', 'weapon2': '1.302', 'weapon3': '1.344', 'DAMAGECOUNT': '2.214', 'FRAGCOUNT': '5.000'} [2023-02-24 18:31:26,167][177154] DAMAGECOUNT value on done: 131524.0 [2023-02-24 18:31:26,168][177154] Sum rewards: 16.741, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.316', 'AMMO2': '0.015', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.073', 'AMMO3': '0.085', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'weapon4': '0.658', 'ARMOR': '0.869', 'weapon2': '1.004', 'HITCOUNT': '1.110', 'weapon3': '1.580', 'DAMAGECOUNT': '4.716', 'FRAGCOUNT': '11.000'} [2023-02-24 18:31:26,328][177154] DAMAGECOUNT value on done: 127288.0 [2023-02-24 18:31:26,329][177154] Sum rewards: 10.759, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.432', 'AMMO5': '0.019', 'AMMO2': '0.020', 'weapon7': '0.054', 'WEAPON1': '0.060', 'AMMO3': '0.084', 'AMMO4': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.162', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon2': '0.584', 'WEAPON3': '0.600', 'HITCOUNT': '0.690', 'weapon4': '0.774', 'ARMOR': '0.967', 'weapon3': '1.340', 'DAMAGECOUNT': '3.195', 'FRAGCOUNT': '9.000'} [2023-02-24 18:31:26,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 57503744. Throughput: 0: 3484.3. Samples: 14373734. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:31:26,376][177119] Avg episode reward: [(0, '10.512')] [2023-02-24 18:31:26,404][177172] DAMAGECOUNT value on done: 125997.0 [2023-02-24 18:31:26,404][177172] Sum rewards: 4.621, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.536', 'AMMO5': '0.014', 'AMMO2': '0.035', 'WEAPON1': '0.070', 'AMMO3': '0.151', 'AMMO4': '0.175', 'weapon5': '0.294', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'HITCOUNT': '0.780', 'weapon4': '0.884', 'WEAPON3': '0.900', 'weapon2': '1.068', 'weapon3': '1.356', 'DAMAGECOUNT': '2.829', 'FRAGCOUNT': '8.000'} [2023-02-24 18:31:26,508][177153] Updated weights for policy 0, policy_version 14040 (0.0009) [2023-02-24 18:31:26,630][177154] DAMAGECOUNT value on done: 130475.0 [2023-02-24 18:31:26,630][177154] Sum rewards: 2.631, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.435', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO3': '0.045', 'AMMO4': '0.088', 'weapon5': '0.114', 'WEAPON5': '0.150', 'weapon7': '0.154', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'WEAPON7': '0.400', 'HITCOUNT': '0.580', 'weapon4': '0.682', 'weapon3': '0.784', 'weapon2': '1.076', 'DAMAGECOUNT': '1.830', 'FRAGCOUNT': '3.000'} [2023-02-24 18:31:26,703][177172] DAMAGECOUNT value on done: 124831.0 [2023-02-24 18:31:26,704][177172] Sum rewards: 10.264, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.056', 'weapon7': '0.074', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'AMMO4': '0.114', 'HEALTH': '0.171', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'weapon4': '0.376', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.720', 'weapon2': '1.168', 'weapon3': '1.808', 'DAMAGECOUNT': '2.592', 'FRAGCOUNT': '7.000'} [2023-02-24 18:31:27,330][177171] DAMAGECOUNT value on done: 126399.0 [2023-02-24 18:31:27,330][177171] Sum rewards: 11.568, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.242', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.050', 'weapon7': '0.066', 'AMMO3': '0.088', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'weapon2': '0.744', 'weapon4': '0.812', 'HITCOUNT': '1.030', 'weapon3': '1.614', 'DAMAGECOUNT': '4.062', 'FRAGCOUNT': '9.000'} [2023-02-24 18:31:27,433][177157] DAMAGECOUNT value on done: 121958.0 [2023-02-24 18:31:27,433][177157] Sum rewards: 11.287, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.030', 'AMMO5': '0.006', 'WEAPON1': '0.030', 'AMMO2': '0.038', 'weapon5': '0.076', 'AMMO3': '0.104', 'WEAPON5': '0.150', 'AMMO4': '0.190', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON3': '0.600', 'ARMOR': '0.804', 'weapon4': '0.806', 'HITCOUNT': '0.960', 'weapon3': '1.734', 'DAMAGECOUNT': '3.525', 'FRAGCOUNT': '10.000'} [2023-02-24 18:31:27,445][177157] DAMAGECOUNT value on done: 128858.0 [2023-02-24 18:31:27,445][177157] Sum rewards: 15.670, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.076', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO5': '0.021', 'WEAPON1': '0.060', 'AMMO3': '0.095', 'weapon5': '0.194', 'WEAPON4': '0.200', 'weapon4': '0.416', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon2': '0.880', 'HITCOUNT': '1.130', 'weapon3': '2.006', 'DAMAGECOUNT': '4.470', 'FRAGCOUNT': '12.000'} [2023-02-24 18:31:27,624][177171] DAMAGECOUNT value on done: 127223.0 [2023-02-24 18:31:27,625][177171] Sum rewards: 8.848, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.640', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.030', 'AMMO4': '0.046', 'AMMO3': '0.100', 'weapon7': '0.118', 'weapon5': '0.140', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'weapon4': '0.292', 'WEAPON7': '0.400', 'ARMOR': '0.468', 'HITCOUNT': '0.650', 'WEAPON3': '0.750', 'weapon2': '0.810', 'weapon3': '1.772', 'DAMAGECOUNT': '2.715', 'FRAGCOUNT': '8.000'} [2023-02-24 18:31:27,699][177171] DAMAGECOUNT value on done: 122576.0 [2023-02-24 18:31:27,699][177171] Sum rewards: 14.350, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.104', 'ARMOR': '0.012', 'AMMO5': '0.020', 'AMMO2': '0.027', 'AMMO3': '0.070', 'WEAPON1': '0.080', 'AMMO4': '0.135', 'WEAPON4': '0.200', 'weapon5': '0.310', 'WEAPON5': '0.450', 'weapon4': '0.494', 'WEAPON3': '0.550', 'weapon2': '0.934', 'HITCOUNT': '0.980', 'weapon3': '1.732', 'DAMAGECOUNT': '4.209', 'FRAGCOUNT': '11.000'} [2023-02-24 18:31:27,746][177157] DAMAGECOUNT value on done: 122944.0 [2023-02-24 18:31:27,747][177157] Sum rewards: 14.760, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.540', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon7': '0.074', 'AMMO3': '0.084', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.252', 'WEAPON7': '0.300', 'weapon4': '0.358', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.910', 'weapon2': '1.154', 'weapon3': '1.708', 'DAMAGECOUNT': '3.690', 'FRAGCOUNT': '11.000'} [2023-02-24 18:31:27,759][177157] DAMAGECOUNT value on done: 124999.0 [2023-02-24 18:31:27,759][177157] Sum rewards: 15.037, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.864', 'AMMO5': '0.012', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'weapon7': '0.058', 'AMMO3': '0.087', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.164', 'WEAPON7': '0.200', 'weapon4': '0.258', 'WEAPON5': '0.350', 'ARMOR': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.840', 'weapon2': '1.596', 'weapon3': '1.670', 'DAMAGECOUNT': '3.333', 'FRAGCOUNT': '11.000'} [2023-02-24 18:31:27,987][177171] DAMAGECOUNT value on done: 119533.0 [2023-02-24 18:31:27,988][177171] Sum rewards: 18.011, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.205', 'AMMO5': '0.013', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'weapon7': '0.048', 'WEAPON4': '0.050', 'weapon5': '0.058', 'AMMO4': '0.073', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.113', 'WEAPON5': '0.200', 'weapon4': '0.420', 'weapon2': '0.628', 'WEAPON3': '0.800', 'HITCOUNT': '1.190', 'weapon3': '1.980', 'DAMAGECOUNT': '4.788', 'FRAGCOUNT': '16.000'} [2023-02-24 18:31:28,467][177155] DAMAGECOUNT value on done: 127153.0 [2023-02-24 18:31:28,467][177155] Sum rewards: 9.741, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.044', 'AMMO3': '0.070', 'weapon7': '0.102', 'AMMO4': '0.150', 'WEAPON5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'WEAPON4': '0.400', 'HEALTH': '0.429', 'weapon2': '0.734', 'ARMOR': '0.854', 'HITCOUNT': '0.900', 'weapon4': '1.132', 'weapon3': '1.232', 'DAMAGECOUNT': '3.666', 'FRAGCOUNT': '7.000'} [2023-02-24 18:31:28,773][177155] DAMAGECOUNT value on done: 130407.0 [2023-02-24 18:31:28,774][177155] Sum rewards: 9.393, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.330', 'AMMO2': '0.018', 'AMMO5': '0.019', 'WEAPON1': '0.030', 'AMMO3': '0.082', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'weapon4': '0.228', 'weapon5': '0.346', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '0.730', 'weapon2': '0.992', 'weapon3': '2.014', 'DAMAGECOUNT': '3.021', 'FRAGCOUNT': '7.000'} [2023-02-24 18:31:29,228][177155] DAMAGECOUNT value on done: 130197.0 [2023-02-24 18:31:29,229][177155] Sum rewards: 15.167, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.746', 'AMMO5': '0.007', 'AMMO2': '0.010', 'ARMOR': '0.012', 'AMMO4': '0.049', 'weapon7': '0.054', 'AMMO3': '0.063', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.218', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'weapon4': '0.586', 'HITCOUNT': '0.990', 'weapon2': '1.176', 'weapon3': '1.406', 'DAMAGECOUNT': '3.951', 'FRAGCOUNT': '12.000'} [2023-02-24 18:31:29,444][177153] Updated weights for policy 0, policy_version 14050 (0.0008) [2023-02-24 18:31:29,530][177155] DAMAGECOUNT value on done: 123689.0 [2023-02-24 18:31:29,530][177155] Sum rewards: 12.646, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.234', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon7': '0.080', 'AMMO3': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.131', 'weapon2': '0.170', 'WEAPON4': '0.250', 'weapon5': '0.272', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'weapon4': '0.894', 'HITCOUNT': '0.970', 'weapon3': '1.656', 'DAMAGECOUNT': '3.798', 'FRAGCOUNT': '10.000'} [2023-02-24 18:31:31,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 57573376. Throughput: 0: 3485.1. Samples: 14394656. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:31:31,376][177119] Avg episode reward: [(0, '10.595')] [2023-02-24 18:31:31,377][177140] Saving new best policy, reward=10.595! [2023-02-24 18:31:32,372][177153] Updated weights for policy 0, policy_version 14060 (0.0008) [2023-02-24 18:31:35,278][177153] Updated weights for policy 0, policy_version 14070 (0.0008) [2023-02-24 18:31:35,294][177156] DAMAGECOUNT value on done: 123286.0 [2023-02-24 18:31:35,294][177156] Sum rewards: 14.460, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.200', 'AMMO5': '0.015', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO3': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.118', 'weapon4': '0.174', 'WEAPON4': '0.250', 'weapon5': '0.322', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.840', 'weapon3': '1.316', 'weapon2': '1.868', 'DAMAGECOUNT': '4.389', 'FRAGCOUNT': '11.000'} [2023-02-24 18:31:35,392][177156] DAMAGECOUNT value on done: 126207.0 [2023-02-24 18:31:35,392][177156] Sum rewards: 16.649, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon7': '0.056', 'AMMO3': '0.068', 'AMMO4': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HEALTH': '0.154', 'weapon4': '0.326', 'WEAPON3': '0.350', 'HITCOUNT': '0.740', 'ARMOR': '0.851', 'weapon3': '1.216', 'weapon2': '1.892', 'DAMAGECOUNT': '3.153', 'FRAGCOUNT': '10.000'} [2023-02-24 18:31:35,596][177156] DAMAGECOUNT value on done: 126686.0 [2023-02-24 18:31:35,597][177156] Sum rewards: 10.076, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.270', 'AMMO5': '0.012', 'AMMO2': '0.019', 'WEAPON1': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'weapon5': '0.314', 'WEAPON5': '0.350', 'weapon4': '0.376', 'WEAPON3': '0.450', 'HITCOUNT': '0.700', 'weapon3': '1.394', 'weapon2': '1.586', 'DAMAGECOUNT': '3.528', 'FRAGCOUNT': '8.000'} [2023-02-24 18:31:35,695][177156] DAMAGECOUNT value on done: 123745.0 [2023-02-24 18:31:35,695][177156] Sum rewards: 14.150, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.955', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.108', 'WEAPON5': '0.250', 'weapon5': '0.252', 'weapon4': '0.288', 'ARMOR': '0.420', 'WEAPON3': '0.600', 'HITCOUNT': '0.930', 'weapon2': '1.540', 'weapon3': '1.544', 'DAMAGECOUNT': '4.653', 'FRAGCOUNT': '10.000'} [2023-02-24 18:31:36,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 57643008. Throughput: 0: 3486.6. Samples: 14405134. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:31:36,376][177119] Avg episode reward: [(0, '10.834')] [2023-02-24 18:31:36,380][177140] Saving new best policy, reward=10.834! [2023-02-24 18:31:38,204][177153] Updated weights for policy 0, policy_version 14080 (0.0008) [2023-02-24 18:31:40,095][177170] DAMAGECOUNT value on done: 128110.0 [2023-02-24 18:31:40,095][177170] Sum rewards: 23.325, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.916', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon7': '0.052', 'AMMO3': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.662', 'WEAPON3': '0.700', 'HITCOUNT': '1.280', 'weapon2': '1.354', 'weapon3': '1.470', 'DAMAGECOUNT': '4.587', 'FRAGCOUNT': '20.000'} [2023-02-24 18:31:40,394][177170] DAMAGECOUNT value on done: 132583.0 [2023-02-24 18:31:40,394][177170] Sum rewards: 8.672, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'weapon5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.042', 'AMMO3': '0.070', 'weapon7': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.212', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'weapon2': '0.566', 'HEALTH': '0.786', 'HITCOUNT': '0.880', 'weapon4': '0.892', 'weapon3': '1.644', 'DAMAGECOUNT': '2.892', 'FRAGCOUNT': '5.000'} [2023-02-24 18:31:40,647][177170] DAMAGECOUNT value on done: 120482.0 [2023-02-24 18:31:40,647][177170] Sum rewards: 1.669, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.050', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.025', 'AMMO3': '0.040', 'weapon2': '0.048', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.126', 'HITCOUNT': '0.190', 'WEAPON3': '0.250', 'weapon4': '0.486', 'weapon3': '0.506', 'DAMAGECOUNT': '0.735', 'FRAGCOUNT': '1.000'} [2023-02-24 18:31:40,943][177170] DAMAGECOUNT value on done: 126068.0 [2023-02-24 18:31:40,944][177170] Sum rewards: 17.375, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.724', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO5': '0.020', 'AMMO4': '0.032', 'weapon4': '0.036', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'weapon5': '0.422', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '0.830', 'weapon3': '1.608', 'weapon2': '1.682', 'DAMAGECOUNT': '4.983', 'FRAGCOUNT': '15.000'} [2023-02-24 18:31:41,183][177153] Updated weights for policy 0, policy_version 14090 (0.0008) [2023-02-24 18:31:41,325][177158] DAMAGECOUNT value on done: 122999.0 [2023-02-24 18:31:41,326][177158] Sum rewards: 13.349, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.736', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.045', 'weapon7': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.107', 'weapon5': '0.172', 'AMMO4': '0.225', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.374', 'WEAPON3': '0.650', 'HITCOUNT': '0.870', 'weapon3': '1.280', 'weapon2': '1.874', 'DAMAGECOUNT': '3.750', 'FRAGCOUNT': '12.000'} [2023-02-24 18:31:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 57712640. Throughput: 0: 3482.8. Samples: 14426064. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:31:41,376][177119] Avg episode reward: [(0, '10.921')] [2023-02-24 18:31:41,377][177140] Saving new best policy, reward=10.921! [2023-02-24 18:31:41,634][177158] DAMAGECOUNT value on done: 122612.0 [2023-02-24 18:31:41,635][177158] Sum rewards: 10.516, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.466', 'weapon7': '0.016', 'AMMO5': '0.022', 'AMMO2': '0.023', 'WEAPON1': '0.050', 'AMMO3': '0.096', 'AMMO4': '0.113', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.350', 'weapon5': '0.358', 'WEAPON5': '0.400', 'weapon4': '0.602', 'WEAPON3': '0.650', 'HITCOUNT': '0.710', 'weapon2': '0.926', 'weapon3': '1.716', 'DAMAGECOUNT': '2.850', 'FRAGCOUNT': '10.000'} [2023-02-24 18:31:42,175][177158] DAMAGECOUNT value on done: 127947.0 [2023-02-24 18:31:42,176][177158] Sum rewards: 16.193, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.142', 'AMMO2': '0.022', 'AMMO5': '0.022', 'WEAPON1': '0.040', 'AMMO4': '0.109', 'AMMO3': '0.127', 'weapon7': '0.148', 'weapon5': '0.266', 'WEAPON4': '0.300', 'AMMO6': '0.400', 'AMMO7': '0.400', 'ARMOR': '0.461', 'WEAPON5': '0.550', 'weapon4': '0.558', 'WEAPON7': '0.600', 'WEAPON3': '0.850', 'weapon2': '0.896', 'HITCOUNT': '1.130', 'weapon3': '1.754', 'DAMAGECOUNT': '6.201', 'FRAGCOUNT': '14.000'} [2023-02-24 18:31:42,468][177156] Large shaping reward 2.652 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:31:42,474][177158] DAMAGECOUNT value on done: 126289.0 [2023-02-24 18:31:42,474][177158] Sum rewards: 17.250, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.713', 'AMMO5': '0.020', 'AMMO2': '0.026', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'AMMO4': '0.129', 'AMMO3': '0.135', 'weapon5': '0.210', 'weapon4': '0.368', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'weapon2': '0.920', 'HITCOUNT': '1.180', 'weapon3': '2.054', 'DAMAGECOUNT': '4.641', 'FRAGCOUNT': '15.000'} [2023-02-24 18:31:43,962][177172] DAMAGECOUNT value on done: 124717.0 [2023-02-24 18:31:43,963][177172] Sum rewards: 19.073, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-2.085', 'AMMO2': '0.008', 'AMMO5': '0.011', 'AMMO4': '0.039', 'WEAPON1': '0.040', 'weapon7': '0.088', 'AMMO3': '0.091', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.214', 'WEAPON5': '0.400', 'weapon4': '0.458', 'weapon2': '0.686', 'WEAPON3': '0.700', 'HITCOUNT': '1.110', 'weapon3': '1.736', 'DAMAGECOUNT': '5.187', 'FRAGCOUNT': '15.000'} [2023-02-24 18:31:44,104][177153] Updated weights for policy 0, policy_version 14100 (0.0009) [2023-02-24 18:31:44,260][177172] DAMAGECOUNT value on done: 124815.0 [2023-02-24 18:31:44,260][177172] Sum rewards: 10.555, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.920', 'AMMO2': '0.025', 'AMMO3': '0.084', 'weapon7': '0.120', 'AMMO4': '0.125', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.498', 'WEAPON3': '0.650', 'HITCOUNT': '0.930', 'weapon2': '1.062', 'weapon3': '1.324', 'DAMAGECOUNT': '3.366', 'FRAGCOUNT': '10.000'} [2023-02-24 18:31:44,265][177157] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 18:31:45,065][177154] DAMAGECOUNT value on done: 131283.0 [2023-02-24 18:31:45,066][177154] Sum rewards: 10.208, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.257', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon7': '0.064', 'weapon4': '0.086', 'AMMO3': '0.088', 'weapon5': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.670', 'weapon3': '1.438', 'weapon2': '2.108', 'DAMAGECOUNT': '2.931', 'FRAGCOUNT': '10.000'} [2023-02-24 18:31:45,373][177154] DAMAGECOUNT value on done: 132579.0 [2023-02-24 18:31:45,373][177154] Sum rewards: 15.388, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.014', 'AMMO5': '0.003', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.014', 'WEAPON5': '0.050', 'AMMO3': '0.074', 'weapon5': '0.092', 'weapon7': '0.102', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.500', 'weapon4': '0.584', 'HITCOUNT': '0.890', 'ARMOR': '0.900', 'weapon2': '0.930', 'weapon3': '1.646', 'DAMAGECOUNT': '3.165', 'FRAGCOUNT': '10.000'} [2023-02-24 18:31:45,510][177154] DAMAGECOUNT value on done: 129566.0 [2023-02-24 18:31:45,510][177154] Sum rewards: 12.154, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.605', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'weapon7': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.173', 'weapon5': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.900', 'weapon2': '0.904', 'WEAPON3': '1.100', 'weapon3': '2.452', 'DAMAGECOUNT': '5.034', 'FRAGCOUNT': '12.000'} [2023-02-24 18:31:45,697][177172] DAMAGECOUNT value on done: 126941.0 [2023-02-24 18:31:45,698][177172] Sum rewards: 7.697, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.710', 'AMMO4': '-0.018', 'AMMO2': '-0.003', 'AMMO5': '0.025', 'WEAPON1': '0.070', 'AMMO3': '0.095', 'weapon5': '0.380', 'HITCOUNT': '0.490', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'weapon2': '1.594', 'weapon3': '1.642', 'DAMAGECOUNT': '2.832', 'FRAGCOUNT': '7.000'} [2023-02-24 18:31:45,807][177154] DAMAGECOUNT value on done: 131040.0 [2023-02-24 18:31:45,807][177154] Sum rewards: 8.782, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.700', 'AMMO2': '0.005', 'AMMO5': '0.014', 'AMMO4': '0.025', 'WEAPON1': '0.030', 'AMMO3': '0.065', 'weapon7': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.134', 'WEAPON7': '0.200', 'HITCOUNT': '0.290', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'ARMOR': '0.472', 'weapon3': '0.898', 'DAMAGECOUNT': '1.695', 'weapon2': '2.538', 'FRAGCOUNT': '5.000'} [2023-02-24 18:31:45,992][177172] DAMAGECOUNT value on done: 125637.0 [2023-02-24 18:31:45,992][177172] Sum rewards: 6.822, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon5': '0.030', 'weapon7': '0.052', 'HEALTH': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.103', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.334', 'WEAPON3': '0.500', 'HITCOUNT': '0.610', 'weapon2': '1.244', 'weapon3': '1.922', 'DAMAGECOUNT': '2.418', 'FRAGCOUNT': '5.500'} [2023-02-24 18:31:46,376][177119] Fps is (10 sec: 13926.0, 60 sec: 13926.3, 300 sec: 13954.4). Total num frames: 57782272. Throughput: 0: 3487.2. Samples: 14447114. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:31:46,376][177119] Avg episode reward: [(0, '10.969')] [2023-02-24 18:31:46,381][177140] Saving new best policy, reward=10.969! [2023-02-24 18:31:46,507][177171] DAMAGECOUNT value on done: 127089.0 [2023-02-24 18:31:46,507][177171] Sum rewards: 7.524, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.835', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.084', 'weapon7': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.234', 'HITCOUNT': '0.420', 'WEAPON3': '0.500', 'weapon3': '1.002', 'DAMAGECOUNT': '2.070', 'weapon2': '2.104', 'FRAGCOUNT': '5.000'} [2023-02-24 18:31:46,661][177157] DAMAGECOUNT value on done: 123676.0 [2023-02-24 18:31:46,662][177157] Sum rewards: 15.283, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.040', 'AMMO5': '0.009', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'weapon7': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.122', 'AMMO4': '0.135', 'weapon5': '0.136', 'WEAPON7': '0.200', 'weapon4': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '0.900', 'weapon2': '0.996', 'HITCOUNT': '1.120', 'weapon3': '2.208', 'DAMAGECOUNT': '5.088', 'FRAGCOUNT': '15.000'} [2023-02-24 18:31:46,673][177157] DAMAGECOUNT value on done: 129899.0 [2023-02-24 18:31:46,673][177157] Sum rewards: 12.245, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.415', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO3': '0.047', 'AMMO4': '0.062', 'weapon5': '0.084', 'WEAPON5': '0.100', 'weapon7': '0.116', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon2': '0.372', 'WEAPON4': '0.400', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'weapon3': '0.782', 'HITCOUNT': '0.800', 'weapon4': '1.222', 'DAMAGECOUNT': '3.123', 'FRAGCOUNT': '9.000'} [2023-02-24 18:31:46,803][177171] DAMAGECOUNT value on done: 128162.0 [2023-02-24 18:31:46,804][177171] Sum rewards: 8.509, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.809', 'AMMO5': '0.010', 'AMMO2': '0.010', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.050', 'AMMO3': '0.088', 'weapon4': '0.098', 'weapon5': '0.268', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.670', 'weapon3': '1.620', 'weapon2': '1.636', 'DAMAGECOUNT': '2.817', 'FRAGCOUNT': '7.000'} [2023-02-24 18:31:46,869][177171] DAMAGECOUNT value on done: 123631.0 [2023-02-24 18:31:46,869][177171] Sum rewards: 7.252, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.315', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'weapon5': '0.034', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'WEAPON3': '0.850', 'HITCOUNT': '0.940', 'weapon2': '1.756', 'weapon3': '2.080', 'DAMAGECOUNT': '3.165', 'FRAGCOUNT': '7.000'} [2023-02-24 18:31:46,966][177157] DAMAGECOUNT value on done: 123679.0 [2023-02-24 18:31:46,967][177157] Sum rewards: 8.856, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.415', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon4': '0.034', 'AMMO4': '0.073', 'AMMO3': '0.078', 'WEAPON5': '0.100', 'weapon7': '0.104', 'weapon5': '0.110', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.640', 'weapon3': '1.264', 'DAMAGECOUNT': '2.205', 'weapon2': '2.290', 'FRAGCOUNT': '5.500'} [2023-02-24 18:31:46,977][177157] DAMAGECOUNT value on done: 125886.0 [2023-02-24 18:31:46,978][177157] Sum rewards: 6.942, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.325', 'AMMO5': '0.015', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'AMMO3': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.106', 'AMMO4': '0.115', 'weapon5': '0.138', 'WEAPON4': '0.300', 'weapon4': '0.312', 'WEAPON5': '0.400', 'ARMOR': '0.429', 'WEAPON3': '0.700', 'HITCOUNT': '0.720', 'weapon3': '1.472', 'weapon2': '1.690', 'DAMAGECOUNT': '2.661', 'FRAGCOUNT': '5.500'} [2023-02-24 18:31:47,046][177153] Updated weights for policy 0, policy_version 14110 (0.0008) [2023-02-24 18:31:47,168][177171] DAMAGECOUNT value on done: 120269.0 [2023-02-24 18:31:47,169][177171] Sum rewards: 8.063, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.385', 'AMMO5': '0.017', 'AMMO2': '0.027', 'WEAPON1': '0.040', 'ARMOR': '0.040', 'AMMO3': '0.085', 'AMMO4': '0.132', 'weapon5': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.450', 'weapon2': '0.480', 'HITCOUNT': '0.500', 'WEAPON3': '0.550', 'weapon4': '0.644', 'weapon3': '1.378', 'DAMAGECOUNT': '2.208', 'FRAGCOUNT': '6.000'} [2023-02-24 18:31:47,796][177155] DAMAGECOUNT value on done: 128371.0 [2023-02-24 18:31:47,797][177155] Sum rewards: 15.187, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.654', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'weapon7': '0.046', 'AMMO4': '0.063', 'AMMO3': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.182', 'WEAPON5': '0.200', 'WEAPON3': '0.650', 'HITCOUNT': '0.890', 'weapon3': '1.718', 'weapon2': '1.750', 'DAMAGECOUNT': '3.654', 'FRAGCOUNT': '13.000'} [2023-02-24 18:31:48,094][177155] DAMAGECOUNT value on done: 131603.0 [2023-02-24 18:31:48,094][177155] Sum rewards: 8.978, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.890', 'AMMO5': '0.017', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'weapon7': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.141', 'weapon5': '0.188', 'WEAPON4': '0.250', 'weapon4': '0.386', 'WEAPON5': '0.400', 'ARMOR': '0.446', 'weapon2': '0.730', 'HITCOUNT': '0.820', 'WEAPON3': '0.900', 'weapon3': '2.228', 'DAMAGECOUNT': '3.588', 'FRAGCOUNT': '9.000'} [2023-02-24 18:31:48,538][177155] DAMAGECOUNT value on done: 131304.0 [2023-02-24 18:31:48,539][177155] Sum rewards: 8.907, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.097', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.036', 'AMMO4': '0.058', 'weapon7': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.127', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.532', 'weapon2': '0.610', 'HITCOUNT': '0.800', 'WEAPON3': '0.850', 'weapon3': '1.918', 'DAMAGECOUNT': '3.321', 'FRAGCOUNT': '9.000'} [2023-02-24 18:31:48,833][177155] DAMAGECOUNT value on done: 124069.0 [2023-02-24 18:31:48,833][177155] Sum rewards: 4.978, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.700', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'AMMO3': '0.058', 'WEAPON5': '0.100', 'weapon7': '0.104', 'WEAPON4': '0.200', 'HITCOUNT': '0.310', 'AMMO6': '0.440', 'AMMO7': '0.440', 'weapon4': '0.474', 'WEAPON3': '0.500', 'WEAPON7': '0.600', 'weapon3': '1.012', 'DAMAGECOUNT': '1.140', 'weapon2': '1.812', 'FRAGCOUNT': '4.000'} [2023-02-24 18:31:49,949][177153] Updated weights for policy 0, policy_version 14120 (0.0008) [2023-02-24 18:31:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 57851904. Throughput: 0: 3485.9. Samples: 14457518. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:31:51,376][177119] Avg episode reward: [(0, '10.967')] [2023-02-24 18:31:52,726][177170] Large shaping reward 2.533 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.501, 167.0), ('weapon7', 0.002)] [2023-02-24 18:31:52,900][177153] Updated weights for policy 0, policy_version 14130 (0.0009) [2023-02-24 18:31:54,502][177156] DAMAGECOUNT value on done: 124288.0 [2023-02-24 18:31:54,502][177156] Sum rewards: 7.037, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.916', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.023', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.138', 'weapon5': '0.158', 'weapon4': '0.292', 'WEAPON5': '0.500', 'weapon2': '0.636', 'HITCOUNT': '0.790', 'WEAPON3': '1.000', 'weapon3': '2.274', 'DAMAGECOUNT': '3.006', 'FRAGCOUNT': '9.000'} [2023-02-24 18:31:54,601][177156] DAMAGECOUNT value on done: 127230.0 [2023-02-24 18:31:54,602][177156] Sum rewards: 9.479, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.472', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.040', 'weapon5': '0.052', 'WEAPON5': '0.100', 'weapon7': '0.134', 'AMMO4': '0.174', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'weapon2': '0.344', 'WEAPON4': '0.350', 'weapon3': '0.608', 'HITCOUNT': '0.630', 'weapon4': '0.956', 'DAMAGECOUNT': '2.616', 'FRAGCOUNT': '9.000'} [2023-02-24 18:31:54,814][177156] DAMAGECOUNT value on done: 128081.0 [2023-02-24 18:31:54,814][177156] Sum rewards: 5.752, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.091', 'AMMO2': '0.027', 'AMMO5': '0.033', 'WEAPON1': '0.070', 'AMMO4': '0.133', 'AMMO3': '0.167', 'weapon5': '0.168', 'WEAPON4': '0.250', 'weapon4': '0.328', 'weapon2': '0.486', 'WEAPON5': '0.700', 'HITCOUNT': '0.990', 'WEAPON3': '1.100', 'weapon3': '2.456', 'DAMAGECOUNT': '4.185', 'FRAGCOUNT': '9.500'} [2023-02-24 18:31:54,921][177156] DAMAGECOUNT value on done: 124724.0 [2023-02-24 18:31:54,922][177156] Sum rewards: 9.166, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.166', 'AMMO5': '0.009', 'AMMO2': '0.011', 'ARMOR': '0.012', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO4': '0.054', 'weapon5': '0.082', 'AMMO3': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.532', 'HITCOUNT': '0.600', 'weapon4': '0.790', 'WEAPON3': '0.800', 'weapon3': '1.846', 'DAMAGECOUNT': '2.937', 'FRAGCOUNT': '9.000'} [2023-02-24 18:31:55,802][177153] Updated weights for policy 0, policy_version 14140 (0.0008) [2023-02-24 18:31:56,376][177119] Fps is (10 sec: 13926.9, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 57921536. Throughput: 0: 3487.7. Samples: 14478514. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:31:56,376][177119] Avg episode reward: [(0, '10.848')] [2023-02-24 18:31:57,453][177158] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.03, -10.0), ('weapon7', 0.002)] [2023-02-24 18:31:58,730][177153] Updated weights for policy 0, policy_version 14150 (0.0008) [2023-02-24 18:31:59,247][177170] DAMAGECOUNT value on done: 128465.0 [2023-02-24 18:31:59,248][177170] Sum rewards: 1.138, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.170', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.016', 'weapon5': '0.018', 'AMMO3': '0.057', 'weapon7': '0.058', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.270', 'weapon2': '0.318', 'WEAPON3': '0.350', 'weapon3': '0.352', 'weapon4': '0.556', 'DAMAGECOUNT': '1.065', 'FRAGCOUNT': '3.000'} [2023-02-24 18:31:59,546][177170] DAMAGECOUNT value on done: 133392.0 [2023-02-24 18:31:59,546][177170] Sum rewards: 7.497, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.000', 'AMMO5': '0.013', 'AMMO2': '0.013', 'WEAPON1': '0.040', 'weapon5': '0.060', 'AMMO4': '0.064', 'AMMO3': '0.096', 'weapon7': '0.110', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'weapon4': '0.444', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'weapon2': '0.778', 'weapon3': '1.622', 'DAMAGECOUNT': '2.427', 'FRAGCOUNT': '7.000'} [2023-02-24 18:31:59,863][177170] DAMAGECOUNT value on done: 122335.0 [2023-02-24 18:31:59,864][177170] Sum rewards: 19.256, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.597', 'AMMO5': '0.019', 'AMMO2': '0.046', 'WEAPON1': '0.050', 'weapon7': '0.052', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.123', 'WEAPON7': '0.200', 'weapon5': '0.204', 'AMMO4': '0.228', 'WEAPON4': '0.400', 'weapon2': '0.406', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'weapon4': '0.854', 'HITCOUNT': '0.980', 'weapon3': '1.942', 'DAMAGECOUNT': '5.559', 'FRAGCOUNT': '19.000'} [2023-02-24 18:32:00,161][177170] DAMAGECOUNT value on done: 127105.0 [2023-02-24 18:32:00,161][177170] Sum rewards: 7.433, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.480', 'AMMO5': '0.012', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'AMMO3': '0.099', 'weapon7': '0.100', 'weapon5': '0.132', 'AMMO4': '0.137', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'HITCOUNT': '0.540', 'WEAPON3': '0.650', 'weapon2': '0.746', 'weapon4': '0.794', 'weapon3': '1.594', 'DAMAGECOUNT': '3.111', 'FRAGCOUNT': '7.000'} [2023-02-24 18:32:00,575][177158] DAMAGECOUNT value on done: 123972.0 [2023-02-24 18:32:00,576][177158] Sum rewards: 9.738, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.295', 'AMMO2': '0.010', 'AMMO5': '0.014', 'AMMO4': '0.048', 'WEAPON1': '0.090', 'AMMO3': '0.129', 'weapon5': '0.280', 'WEAPON5': '0.450', 'HITCOUNT': '0.790', 'WEAPON3': '0.800', 'weapon2': '1.126', 'weapon3': '2.128', 'DAMAGECOUNT': '2.919', 'FRAGCOUNT': '9.000'} [2023-02-24 18:32:00,866][177158] DAMAGECOUNT value on done: 124218.0 [2023-02-24 18:32:00,866][177158] Sum rewards: 19.213, reward structure: {'DEATHCOUNT': '-6.750', 'WEAPON1': '0.010', 'weapon7': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.045', 'AMMO3': '0.070', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon5': '0.376', 'ARMOR': '0.404', 'WEAPON3': '0.450', 'HEALTH': '0.648', 'weapon4': '0.652', 'weapon2': '0.816', 'HITCOUNT': '0.930', 'weapon3': '1.602', 'DAMAGECOUNT': '4.809', 'FRAGCOUNT': '14.000'} [2023-02-24 18:32:01,376][177119] Fps is (10 sec: 14336.0, 60 sec: 13994.7, 300 sec: 13968.1). Total num frames: 57995264. Throughput: 0: 3489.2. Samples: 14499554. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:32:01,376][177119] Avg episode reward: [(0, '10.791')] [2023-02-24 18:32:01,397][177158] DAMAGECOUNT value on done: 128584.0 [2023-02-24 18:32:01,398][177158] Sum rewards: 8.906, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.130', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO3': '0.024', 'weapon5': '0.030', 'AMMO4': '0.072', 'WEAPON4': '0.150', 'WEAPON3': '0.150', 'WEAPON5': '0.150', 'weapon7': '0.204', 'HITCOUNT': '0.270', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'weapon3': '0.410', 'weapon4': '0.700', 'DAMAGECOUNT': '1.518', 'weapon2': '1.546', 'FRAGCOUNT': '5.000'} [2023-02-24 18:32:01,654][177153] Updated weights for policy 0, policy_version 14160 (0.0009) [2023-02-24 18:32:01,694][177158] DAMAGECOUNT value on done: 127114.0 [2023-02-24 18:32:01,695][177158] Sum rewards: 5.813, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.800', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon7': '0.024', 'WEAPON1': '0.030', 'weapon5': '0.062', 'AMMO3': '0.109', 'AMMO4': '0.118', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.344', 'HITCOUNT': '0.510', 'WEAPON3': '0.600', 'weapon3': '1.416', 'weapon2': '1.986', 'DAMAGECOUNT': '2.475', 'FRAGCOUNT': '6.000'} [2023-02-24 18:32:03,181][177172] DAMAGECOUNT value on done: 126070.0 [2023-02-24 18:32:03,182][177172] Sum rewards: 11.595, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.010', 'AMMO2': '0.023', 'HEALTH': '0.024', 'weapon7': '0.034', 'weapon5': '0.092', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.140', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.616', 'WEAPON3': '0.800', 'weapon2': '0.968', 'HITCOUNT': '1.210', 'weapon3': '2.002', 'DAMAGECOUNT': '4.059', 'FRAGCOUNT': '12.000'} [2023-02-24 18:32:03,477][177172] DAMAGECOUNT value on done: 125768.0 [2023-02-24 18:32:03,478][177172] Sum rewards: 7.904, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.144', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.010', 'weapon7': '0.082', 'AMMO3': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.548', 'WEAPON3': '0.550', 'weapon4': '0.676', 'HITCOUNT': '0.780', 'weapon3': '1.144', 'DAMAGECOUNT': '2.859', 'FRAGCOUNT': '8.000'} [2023-02-24 18:32:04,396][177154] DAMAGECOUNT value on done: 132419.0 [2023-02-24 18:32:04,397][177154] Sum rewards: 8.545, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.155', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.044', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'weapon7': '0.132', 'AMMO4': '0.134', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'weapon4': '0.456', 'WEAPON3': '0.600', 'HITCOUNT': '0.770', 'weapon3': '1.168', 'weapon2': '1.188', 'DAMAGECOUNT': '3.408', 'FRAGCOUNT': '9.000'} [2023-02-24 18:32:04,583][177153] Updated weights for policy 0, policy_version 14170 (0.0009) [2023-02-24 18:32:04,696][177154] DAMAGECOUNT value on done: 133854.0 [2023-02-24 18:32:04,696][177154] Sum rewards: 11.849, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.046', 'AMMO5': '0.017', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'AMMO4': '0.095', 'AMMO3': '0.133', 'weapon5': '0.184', 'WEAPON4': '0.350', 'weapon4': '0.394', 'WEAPON5': '0.450', 'weapon2': '0.904', 'WEAPON3': '0.950', 'HITCOUNT': '1.030', 'weapon3': '2.242', 'DAMAGECOUNT': '3.825', 'FRAGCOUNT': '11.500'} [2023-02-24 18:32:04,828][177154] DAMAGECOUNT value on done: 131127.0 [2023-02-24 18:32:04,828][177154] Sum rewards: 15.388, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.244', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.030', 'weapon7': '0.052', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.149', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.454', 'WEAPON3': '0.650', 'weapon2': '0.912', 'HITCOUNT': '1.040', 'weapon3': '1.908', 'DAMAGECOUNT': '4.683', 'FRAGCOUNT': '14.000'} [2023-02-24 18:32:04,905][177172] DAMAGECOUNT value on done: 127931.0 [2023-02-24 18:32:04,906][177172] Sum rewards: 10.126, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'weapon7': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.138', 'WEAPON4': '0.150', 'HEALTH': '0.186', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'weapon2': '0.572', 'weapon4': '0.672', 'HITCOUNT': '0.680', 'weapon3': '1.128', 'DAMAGECOUNT': '2.970', 'FRAGCOUNT': '7.000'} [2023-02-24 18:32:05,128][177154] DAMAGECOUNT value on done: 132190.0 [2023-02-24 18:32:05,128][177154] Sum rewards: 13.608, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.265', 'AMMO5': '0.016', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'weapon7': '0.054', 'AMMO4': '0.109', 'AMMO3': '0.110', 'weapon5': '0.198', 'WEAPON4': '0.200', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'weapon4': '0.408', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'HITCOUNT': '0.840', 'weapon2': '1.278', 'weapon3': '1.658', 'DAMAGECOUNT': '3.450', 'FRAGCOUNT': '11.000'} [2023-02-24 18:32:05,204][177172] DAMAGECOUNT value on done: 128015.0 [2023-02-24 18:32:05,204][177172] Sum rewards: 19.799, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.694', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon7': '0.056', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'weapon4': '0.100', 'weapon5': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.197', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.638', 'WEAPON3': '1.250', 'HITCOUNT': '1.320', 'weapon3': '2.800', 'DAMAGECOUNT': '6.834', 'FRAGCOUNT': '20.000'} [2023-02-24 18:32:05,751][177171] DAMAGECOUNT value on done: 128313.0 [2023-02-24 18:32:05,752][177171] Sum rewards: 14.396, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'AMMO3': '0.070', 'HEALTH': '0.070', 'weapon7': '0.100', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.450', 'weapon2': '0.692', 'HITCOUNT': '0.700', 'weapon4': '0.888', 'weapon3': '1.244', 'DAMAGECOUNT': '3.672', 'FRAGCOUNT': '12.000'} [2023-02-24 18:32:05,803][177157] DAMAGECOUNT value on done: 124742.0 [2023-02-24 18:32:05,804][177157] Sum rewards: 7.130, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.793', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON1': '0.040', 'weapon7': '0.054', 'AMMO3': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.106', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.156', 'WEAPON3': '0.650', 'HITCOUNT': '0.860', 'weapon3': '1.700', 'weapon2': '1.806', 'DAMAGECOUNT': '3.198', 'FRAGCOUNT': '6.000'} [2023-02-24 18:32:05,815][177157] DAMAGECOUNT value on done: 131147.0 [2023-02-24 18:32:05,816][177157] Sum rewards: 6.567, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.276', 'AMMO5': '0.019', 'WEAPON1': '0.050', 'AMMO2': '0.053', 'weapon5': '0.080', 'weapon7': '0.106', 'AMMO3': '0.114', 'AMMO6': '0.240', 'AMMO7': '0.240', 'AMMO4': '0.266', 'WEAPON5': '0.400', 'WEAPON7': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.668', 'WEAPON3': '0.800', 'HITCOUNT': '0.830', 'weapon2': '0.842', 'weapon3': '1.940', 'DAMAGECOUNT': '3.744', 'FRAGCOUNT': '8.000'} [2023-02-24 18:32:06,062][177171] DAMAGECOUNT value on done: 129879.0 [2023-02-24 18:32:06,063][177171] Sum rewards: 4.150, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.147', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.018', 'weapon7': '0.048', 'weapon5': '0.086', 'AMMO4': '0.087', 'AMMO3': '0.092', 'WEAPON4': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'WEAPON3': '0.600', 'weapon4': '0.744', 'HITCOUNT': '0.770', 'weapon2': '1.208', 'weapon3': '1.326', 'DAMAGECOUNT': '3.351', 'FRAGCOUNT': '6.000'} [2023-02-24 18:32:06,105][177171] DAMAGECOUNT value on done: 124459.0 [2023-02-24 18:32:06,105][177171] Sum rewards: 7.500, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.540', 'AMMO5': '0.010', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'weapon4': '0.038', 'weapon7': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.098', 'AMMO4': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.114', 'WEAPON5': '0.200', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'weapon3': '1.276', 'weapon2': '2.186', 'DAMAGECOUNT': '2.484', 'FRAGCOUNT': '6.000'} [2023-02-24 18:32:06,125][177157] DAMAGECOUNT value on done: 124084.0 [2023-02-24 18:32:06,125][177157] Sum rewards: 2.111, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.582', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.040', 'weapon5': '0.054', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'weapon4': '0.116', 'AMMO3': '0.136', 'weapon7': '0.218', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.360', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.215', 'weapon2': '1.364', 'weapon3': '1.758', 'FRAGCOUNT': '4.000'} [2023-02-24 18:32:06,136][177157] DAMAGECOUNT value on done: 127134.0 [2023-02-24 18:32:06,137][177157] Sum rewards: 11.033, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.344', 'AMMO5': '0.017', 'AMMO2': '0.023', 'weapon7': '0.026', 'WEAPON1': '0.030', 'AMMO3': '0.051', 'AMMO4': '0.112', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.274', 'WEAPON3': '0.300', 'weapon5': '0.386', 'WEAPON5': '0.500', 'HITCOUNT': '0.650', 'weapon3': '1.262', 'weapon2': '1.782', 'DAMAGECOUNT': '3.744', 'FRAGCOUNT': '8.500'} [2023-02-24 18:32:06,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 58060800. Throughput: 0: 3490.1. Samples: 14510018. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:32:06,376][177119] Avg episode reward: [(0, '10.784')] [2023-02-24 18:32:06,410][177171] DAMAGECOUNT value on done: 121783.0 [2023-02-24 18:32:06,411][177171] Sum rewards: 10.878, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.578', 'AMMO2': '0.015', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.076', 'AMMO3': '0.124', 'weapon5': '0.126', 'WEAPON4': '0.200', 'weapon4': '0.392', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '0.970', 'weapon2': '1.302', 'weapon3': '1.908', 'DAMAGECOUNT': '4.542', 'FRAGCOUNT': '9.000'} [2023-02-24 18:32:07,011][177155] DAMAGECOUNT value on done: 129416.0 [2023-02-24 18:32:07,011][177155] Sum rewards: 6.174, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.124', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.063', 'AMMO3': '0.108', 'weapon7': '0.120', 'weapon5': '0.128', 'WEAPON5': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'WEAPON7': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.810', 'weapon2': '0.820', 'weapon4': '1.060', 'weapon3': '1.296', 'DAMAGECOUNT': '3.135', 'FRAGCOUNT': '7.000'} [2023-02-24 18:32:07,314][177155] DAMAGECOUNT value on done: 133313.0 [2023-02-24 18:32:07,315][177155] Sum rewards: 10.653, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.510', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO5': '0.032', 'weapon7': '0.050', 'AMMO4': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.125', 'WEAPON7': '0.200', 'weapon5': '0.278', 'WEAPON4': '0.350', 'weapon4': '0.632', 'WEAPON5': '0.650', 'WEAPON3': '0.750', 'HITCOUNT': '0.890', 'weapon2': '0.976', 'weapon3': '1.456', 'DAMAGECOUNT': '5.130', 'FRAGCOUNT': '10.000'} [2023-02-24 18:32:07,549][177153] Updated weights for policy 0, policy_version 14180 (0.0008) [2023-02-24 18:32:07,744][177155] DAMAGECOUNT value on done: 132675.0 [2023-02-24 18:32:07,744][177155] Sum rewards: 18.802, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.937', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.085', 'AMMO3': '0.088', 'WEAPON4': '0.150', 'weapon5': '0.290', 'weapon4': '0.394', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon2': '0.990', 'HITCOUNT': '1.140', 'weapon3': '1.886', 'DAMAGECOUNT': '4.113', 'FRAGCOUNT': '17.000'} [2023-02-24 18:32:08,039][177155] DAMAGECOUNT value on done: 125033.0 [2023-02-24 18:32:08,039][177155] Sum rewards: 11.401, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.225', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'weapon7': '0.050', 'AMMO3': '0.051', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.490', 'WEAPON3': '0.500', 'weapon3': '1.236', 'weapon2': '2.498', 'DAMAGECOUNT': '2.892', 'FRAGCOUNT': '7.000'} [2023-02-24 18:32:10,459][177153] Updated weights for policy 0, policy_version 14190 (0.0008) [2023-02-24 18:32:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13968.0). Total num frames: 58134528. Throughput: 0: 3494.7. Samples: 14530994. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:32:11,376][177119] Avg episode reward: [(0, '10.888')] [2023-02-24 18:32:13,377][177153] Updated weights for policy 0, policy_version 14200 (0.0008) [2023-02-24 18:32:13,733][177156] DAMAGECOUNT value on done: 125477.0 [2023-02-24 18:32:13,734][177156] Sum rewards: 9.417, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.725', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon7': '0.104', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '1.000', 'WEAPON3': '1.100', 'weapon2': '1.152', 'weapon3': '2.118', 'DAMAGECOUNT': '3.567', 'FRAGCOUNT': '13.000'} [2023-02-24 18:32:13,833][177156] DAMAGECOUNT value on done: 128267.0 [2023-02-24 18:32:13,833][177156] Sum rewards: 7.206, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.034', 'weapon7': '0.048', 'WEAPON4': '0.050', 'weapon5': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.146', 'HEALTH': '0.147', 'WEAPON5': '0.150', 'weapon4': '0.266', 'HITCOUNT': '0.790', 'WEAPON3': '0.900', 'weapon2': '1.242', 'weapon3': '2.190', 'DAMAGECOUNT': '3.111', 'FRAGCOUNT': '9.000'} [2023-02-24 18:32:14,042][177156] DAMAGECOUNT value on done: 129337.0 [2023-02-24 18:32:14,043][177156] Sum rewards: 8.608, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.144', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.107', 'weapon5': '0.144', 'AMMO4': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'weapon2': '0.548', 'WEAPON3': '0.700', 'weapon4': '1.068', 'HITCOUNT': '1.070', 'weapon3': '1.574', 'DAMAGECOUNT': '3.768', 'FRAGCOUNT': '8.000'} [2023-02-24 18:32:14,146][177156] DAMAGECOUNT value on done: 125926.0 [2023-02-24 18:32:14,146][177156] Sum rewards: 5.323, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.270', 'AMMO5': '0.026', 'AMMO2': '0.042', 'WEAPON1': '0.060', 'weapon7': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.139', 'weapon5': '0.176', 'AMMO4': '0.208', 'WEAPON4': '0.450', 'weapon4': '0.606', 'WEAPON5': '0.650', 'HITCOUNT': '0.730', 'WEAPON3': '0.900', 'weapon2': '1.176', 'weapon3': '1.504', 'DAMAGECOUNT': '3.306', 'FRAGCOUNT': '7.000'} [2023-02-24 18:32:15,055][177170] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 18:32:16,317][177153] Updated weights for policy 0, policy_version 14210 (0.0009) [2023-02-24 18:32:16,376][177119] Fps is (10 sec: 14335.9, 60 sec: 13994.7, 300 sec: 13954.2). Total num frames: 58204160. Throughput: 0: 3495.0. Samples: 14551932. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:32:16,376][177119] Avg episode reward: [(0, '10.662')] [2023-02-24 18:32:18,470][177170] DAMAGECOUNT value on done: 128918.0 [2023-02-24 18:32:18,470][177170] Sum rewards: 4.718, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.120', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.040', 'weapon7': '0.090', 'weapon4': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.129', 'weapon5': '0.174', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'HITCOUNT': '0.330', 'weapon3': '1.062', 'DAMAGECOUNT': '1.359', 'weapon2': '2.290', 'FRAGCOUNT': '2.500'} [2023-02-24 18:32:18,769][177170] DAMAGECOUNT value on done: 135206.0 [2023-02-24 18:32:18,769][177170] Sum rewards: 19.672, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.068', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO5': '0.020', 'ARMOR': '0.036', 'weapon7': '0.052', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.127', 'weapon5': '0.176', 'WEAPON7': '0.200', 'weapon4': '0.336', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'weapon2': '0.976', 'HITCOUNT': '1.150', 'weapon3': '2.000', 'DAMAGECOUNT': '5.322', 'FRAGCOUNT': '16.000'} [2023-02-24 18:32:19,102][177170] DAMAGECOUNT value on done: 122890.0 [2023-02-24 18:32:19,103][177170] Sum rewards: 1.104, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.994', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.018', 'weapon7': '0.048', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon2': '0.144', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.472', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'weapon4': '0.648', 'FRAGCOUNT': '1.500', 'weapon3': '1.574', 'DAMAGECOUNT': '1.665'} [2023-02-24 18:32:19,249][177153] Updated weights for policy 0, policy_version 14220 (0.0008) [2023-02-24 18:32:19,405][177170] DAMAGECOUNT value on done: 128265.0 [2023-02-24 18:32:19,406][177170] Sum rewards: 16.091, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.197', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.094', 'AMMO3': '0.100', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'ARMOR': '0.400', 'weapon4': '0.494', 'WEAPON3': '0.550', 'HITCOUNT': '0.810', 'weapon2': '1.028', 'weapon3': '1.878', 'DAMAGECOUNT': '3.480', 'FRAGCOUNT': '13.000'} [2023-02-24 18:32:19,723][177158] DAMAGECOUNT value on done: 125263.0 [2023-02-24 18:32:19,724][177158] Sum rewards: 11.323, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.460', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.036', 'WEAPON1': '0.040', 'weapon7': '0.086', 'AMMO3': '0.090', 'weapon5': '0.104', 'AMMO4': '0.178', 'WEAPON5': '0.250', 'AMMO6': '0.260', 'AMMO7': '0.260', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.486', 'WEAPON3': '0.650', 'HITCOUNT': '0.860', 'weapon2': '1.284', 'weapon3': '1.662', 'DAMAGECOUNT': '3.873', 'FRAGCOUNT': '11.000'} [2023-02-24 18:32:20,023][177158] DAMAGECOUNT value on done: 125363.0 [2023-02-24 18:32:20,023][177158] Sum rewards: 5.000, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.692', 'AMMO2': '0.004', 'ARMOR': '0.016', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.021', 'weapon5': '0.072', 'AMMO3': '0.084', 'weapon7': '0.096', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.370', 'WEAPON5': '0.400', 'WEAPON7': '0.400', 'HITCOUNT': '0.510', 'WEAPON3': '0.600', 'weapon3': '1.460', 'weapon2': '1.606', 'DAMAGECOUNT': '2.835', 'FRAGCOUNT': '3.500'} [2023-02-24 18:32:20,581][177158] DAMAGECOUNT value on done: 129712.0 [2023-02-24 18:32:20,582][177158] Sum rewards: 10.523, reward structure: {'DEATHCOUNT': '-5.250', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO5': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.083', 'weapon4': '0.090', 'weapon5': '0.232', 'WEAPON5': '0.300', 'HEALTH': '0.406', 'WEAPON3': '0.500', 'HITCOUNT': '0.690', 'weapon3': '1.682', 'weapon2': '1.752', 'DAMAGECOUNT': '3.384', 'FRAGCOUNT': '6.500'} [2023-02-24 18:32:20,875][177158] DAMAGECOUNT value on done: 128182.0 [2023-02-24 18:32:20,875][177158] Sum rewards: 2.469, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.000', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.046', 'weapon7': '0.080', 'AMMO3': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO4': '0.231', 'weapon5': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon4': '0.606', 'HITCOUNT': '0.640', 'weapon2': '0.924', 'weapon3': '1.794', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '3.204'} [2023-02-24 18:32:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13954.2). Total num frames: 58273792. Throughput: 0: 3495.9. Samples: 14562450. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:32:21,376][177119] Avg episode reward: [(0, '10.508')] [2023-02-24 18:32:22,167][177153] Updated weights for policy 0, policy_version 14230 (0.0009) [2023-02-24 18:32:22,374][177172] DAMAGECOUNT value on done: 127111.0 [2023-02-24 18:32:22,375][177172] Sum rewards: 7.760, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.455', 'AMMO5': '0.021', 'AMMO2': '0.030', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.119', 'AMMO4': '0.151', 'weapon5': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.550', 'weapon4': '0.574', 'HITCOUNT': '0.740', 'weapon2': '0.848', 'WEAPON3': '0.900', 'weapon3': '2.058', 'DAMAGECOUNT': '3.123', 'FRAGCOUNT': '10.000'} [2023-02-24 18:32:22,658][177172] DAMAGECOUNT value on done: 126090.0 [2023-02-24 18:32:22,658][177172] Sum rewards: 4.371, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'AMMO3': '0.041', 'weapon5': '0.072', 'WEAPON5': '0.100', 'weapon7': '0.128', 'AMMO4': '0.154', 'HEALTH': '0.170', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.290', 'weapon2': '0.414', 'weapon4': '0.734', 'weapon3': '0.956', 'DAMAGECOUNT': '0.966', 'FRAGCOUNT': '3.000'} [2023-02-24 18:32:22,976][177154] Large shaping reward 2.614 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.582, 194.0), ('weapon7', 0.002)] [2023-02-24 18:32:23,682][177154] DAMAGECOUNT value on done: 133508.0 [2023-02-24 18:32:23,683][177154] Sum rewards: 9.239, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.663', 'AMMO5': '0.017', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'AMMO4': '0.093', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'weapon5': '0.258', 'weapon4': '0.314', 'WEAPON5': '0.400', 'HITCOUNT': '0.720', 'WEAPON3': '0.750', 'weapon2': '1.148', 'weapon3': '1.854', 'DAMAGECOUNT': '3.267', 'FRAGCOUNT': '7.500'} [2023-02-24 18:32:23,973][177154] DAMAGECOUNT value on done: 134590.0 [2023-02-24 18:32:23,974][177154] Sum rewards: 2.472, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.488', 'ARMOR': '0.004', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'weapon7': '0.060', 'AMMO3': '0.061', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.144', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.340', 'WEAPON3': '0.400', 'weapon4': '0.568', 'weapon2': '1.044', 'weapon3': '1.462', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '2.208'} [2023-02-24 18:32:24,095][177172] DAMAGECOUNT value on done: 128913.0 [2023-02-24 18:32:24,096][177172] Sum rewards: 9.385, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.536', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.072', 'AMMO4': '0.074', 'weapon5': '0.080', 'weapon7': '0.100', 'WEAPON5': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'WEAPON7': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.644', 'HITCOUNT': '0.760', 'weapon2': '1.168', 'weapon3': '1.504', 'DAMAGECOUNT': '2.946', 'FRAGCOUNT': '7.500'} [2023-02-24 18:32:24,115][177154] DAMAGECOUNT value on done: 132913.0 [2023-02-24 18:32:24,116][177154] Sum rewards: 19.873, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.405', 'AMMO5': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'weapon7': '0.112', 'AMMO4': '0.116', 'weapon5': '0.162', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.354', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '1.120', 'weapon2': '1.264', 'weapon3': '1.700', 'DAMAGECOUNT': '5.358', 'FRAGCOUNT': '15.000'} [2023-02-24 18:32:24,400][177172] DAMAGECOUNT value on done: 128885.0 [2023-02-24 18:32:24,401][177172] Sum rewards: 13.818, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.015', 'HEALTH': '0.025', 'weapon7': '0.048', 'AMMO3': '0.101', 'weapon5': '0.172', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.640', 'weapon3': '1.774', 'weapon2': '1.782', 'DAMAGECOUNT': '2.610', 'FRAGCOUNT': '11.000'} [2023-02-24 18:32:24,418][177154] DAMAGECOUNT value on done: 133174.0 [2023-02-24 18:32:24,418][177154] Sum rewards: 0.709, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.108', 'AMMO5': '0.024', 'AMMO2': '0.032', 'WEAPON1': '0.070', 'weapon7': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.138', 'AMMO4': '0.158', 'weapon5': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.398', 'weapon4': '0.462', 'WEAPON5': '0.600', 'HITCOUNT': '0.670', 'WEAPON3': '1.000', 'weapon3': '2.206', 'DAMAGECOUNT': '2.952', 'FRAGCOUNT': '4.500'} [2023-02-24 18:32:24,759][177171] Large shaping reward -2.506 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0)] [2023-02-24 18:32:25,026][177157] DAMAGECOUNT value on done: 125654.0 [2023-02-24 18:32:25,026][177157] Sum rewards: 5.449, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.271', 'AMMO5': '0.005', 'weapon5': '0.006', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'AMMO4': '0.160', 'WEAPON4': '0.450', 'ARMOR': '0.457', 'weapon2': '0.730', 'WEAPON3': '0.750', 'weapon4': '0.788', 'HITCOUNT': '0.850', 'weapon3': '1.778', 'DAMAGECOUNT': '2.736', 'FRAGCOUNT': '6.000'} [2023-02-24 18:32:25,037][177157] DAMAGECOUNT value on done: 132118.0 [2023-02-24 18:32:25,038][177157] Sum rewards: 8.666, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.720', 'AMMO5': '0.013', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.024', 'weapon7': '0.050', 'AMMO4': '0.073', 'AMMO3': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.514', 'WEAPON3': '0.700', 'HITCOUNT': '0.890', 'weapon2': '0.928', 'weapon3': '1.760', 'DAMAGECOUNT': '2.913', 'FRAGCOUNT': '8.000'} [2023-02-24 18:32:25,044][177171] DAMAGECOUNT value on done: 129597.0 [2023-02-24 18:32:25,044][177171] Sum rewards: 9.111, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.860', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.040', 'AMMO3': '0.079', 'weapon5': '0.172', 'AMMO4': '0.198', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '0.610', 'weapon4': '0.636', 'weapon2': '1.200', 'weapon3': '1.518', 'DAMAGECOUNT': '3.852', 'FRAGCOUNT': '9.000'} [2023-02-24 18:32:25,107][177153] Updated weights for policy 0, policy_version 14240 (0.0008) [2023-02-24 18:32:25,333][177157] DAMAGECOUNT value on done: 125731.0 [2023-02-24 18:32:25,334][177157] Sum rewards: 18.251, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.429', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.031', 'WEAPON1': '0.070', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'weapon5': '0.178', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'weapon4': '0.420', 'weapon2': '0.642', 'WEAPON3': '0.800', 'HITCOUNT': '1.070', 'weapon3': '2.106', 'DAMAGECOUNT': '4.941', 'FRAGCOUNT': '16.000'} [2023-02-24 18:32:25,340][177171] DAMAGECOUNT value on done: 131663.0 [2023-02-24 18:32:25,340][177171] Sum rewards: 19.898, reward structure: {'DEATHCOUNT': '-9.000', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.091', 'HEALTH': '0.102', 'AMMO3': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.382', 'WEAPON3': '0.700', 'HITCOUNT': '1.370', 'weapon2': '1.468', 'weapon3': '1.976', 'DAMAGECOUNT': '5.352', 'FRAGCOUNT': '17.000'} [2023-02-24 18:32:25,348][177157] DAMAGECOUNT value on done: 128600.0 [2023-02-24 18:32:25,349][177157] Sum rewards: 11.855, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.630', 'AMMO2': '0.009', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.043', 'AMMO3': '0.135', 'weapon5': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.546', 'weapon4': '0.692', 'WEAPON3': '0.950', 'HITCOUNT': '1.100', 'weapon3': '2.138', 'DAMAGECOUNT': '4.398', 'FRAGCOUNT': '11.500'} [2023-02-24 18:32:25,397][177171] DAMAGECOUNT value on done: 125410.0 [2023-02-24 18:32:25,398][177171] Sum rewards: 5.816, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.120', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.033', 'weapon5': '0.112', 'AMMO3': '0.113', 'AMMO4': '0.164', 'weapon7': '0.174', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON3': '0.600', 'weapon2': '0.612', 'HITCOUNT': '0.700', 'weapon4': '0.916', 'weapon3': '1.714', 'DAMAGECOUNT': '2.853', 'FRAGCOUNT': '4.000'} [2023-02-24 18:32:25,694][177171] DAMAGECOUNT value on done: 122664.0 [2023-02-24 18:32:25,694][177171] Sum rewards: 7.041, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.010', 'AMMO5': '0.019', 'AMMO2': '0.022', 'WEAPON1': '0.060', 'AMMO3': '0.061', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'weapon4': '0.302', 'weapon5': '0.366', 'HITCOUNT': '0.410', 'WEAPON3': '0.550', 'WEAPON5': '0.600', 'weapon2': '1.084', 'weapon3': '1.672', 'DAMAGECOUNT': '2.643', 'FRAGCOUNT': '6.000'} [2023-02-24 18:32:26,149][177155] DAMAGECOUNT value on done: 130740.0 [2023-02-24 18:32:26,150][177155] Sum rewards: 7.368, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.052', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.064', 'AMMO3': '0.082', 'weapon7': '0.104', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'HITCOUNT': '0.430', 'ARMOR': '0.500', 'WEAPON4': '0.550', 'weapon2': '0.568', 'weapon3': '0.710', 'weapon4': '1.060', 'DAMAGECOUNT': '2.772', 'FRAGCOUNT': '7.500'} [2023-02-24 18:32:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13954.2). Total num frames: 58343424. Throughput: 0: 3496.0. Samples: 14583386. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:32:26,376][177119] Avg episode reward: [(0, '10.444')] [2023-02-24 18:32:26,454][177155] DAMAGECOUNT value on done: 134177.0 [2023-02-24 18:32:26,454][177155] Sum rewards: 8.961, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.574', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'weapon7': '0.054', 'AMMO3': '0.102', 'weapon5': '0.128', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'ARMOR': '0.453', 'WEAPON3': '0.500', 'HITCOUNT': '0.530', 'weapon4': '0.636', 'weapon2': '1.024', 'weapon3': '1.192', 'DAMAGECOUNT': '2.592', 'FRAGCOUNT': '7.000'} [2023-02-24 18:32:26,903][177155] DAMAGECOUNT value on done: 134474.0 [2023-02-24 18:32:26,904][177155] Sum rewards: 12.551, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.373', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.087', 'weapon7': '0.172', 'WEAPON4': '0.300', 'AMMO6': '0.360', 'AMMO7': '0.360', 'WEAPON3': '0.600', 'WEAPON7': '0.600', 'HITCOUNT': '0.680', 'weapon4': '0.862', 'weapon2': '0.870', 'weapon3': '1.200', 'DAMAGECOUNT': '4.197', 'FRAGCOUNT': '11.000'} [2023-02-24 18:32:27,205][177155] DAMAGECOUNT value on done: 126023.0 [2023-02-24 18:32:27,205][177155] Sum rewards: 8.715, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.447', 'AMMO5': '0.010', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'weapon7': '0.054', 'AMMO3': '0.066', 'weapon5': '0.076', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'weapon4': '0.398', 'ARMOR': '0.428', 'WEAPON3': '0.450', 'HITCOUNT': '0.470', 'weapon2': '0.964', 'weapon3': '1.348', 'DAMAGECOUNT': '2.664', 'FRAGCOUNT': '6.000'} [2023-02-24 18:32:28,013][177153] Updated weights for policy 0, policy_version 14250 (0.0008) [2023-02-24 18:32:30,938][177153] Updated weights for policy 0, policy_version 14260 (0.0008) [2023-02-24 18:32:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13954.2). Total num frames: 58413056. Throughput: 0: 3494.7. Samples: 14604374. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:32:31,376][177119] Avg episode reward: [(0, '10.268')] [2023-02-24 18:32:33,032][177156] DAMAGECOUNT value on done: 126277.0 [2023-02-24 18:32:33,032][177156] Sum rewards: 7.279, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.132', 'AMMO2': '0.008', 'AMMO5': '0.012', 'weapon5': '0.038', 'AMMO4': '0.038', 'weapon7': '0.046', 'AMMO3': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.404', 'weapon4': '0.474', 'HITCOUNT': '0.630', 'WEAPON3': '0.650', 'weapon2': '1.102', 'weapon3': '1.422', 'DAMAGECOUNT': '2.400', 'FRAGCOUNT': '7.000'} [2023-02-24 18:32:33,130][177156] DAMAGECOUNT value on done: 130238.0 [2023-02-24 18:32:33,130][177156] Sum rewards: 15.303, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.572', 'AMMO5': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'weapon7': '0.046', 'AMMO4': '0.086', 'AMMO3': '0.104', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'ARMOR': '0.408', 'weapon4': '0.626', 'WEAPON3': '0.650', 'HITCOUNT': '0.790', 'weapon2': '0.814', 'weapon3': '1.826', 'DAMAGECOUNT': '4.113', 'FRAGCOUNT': '13.000'} [2023-02-24 18:32:33,344][177156] DAMAGECOUNT value on done: 130627.0 [2023-02-24 18:32:33,344][177156] Sum rewards: 7.640, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.392', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO2': '0.039', 'AMMO3': '0.092', 'weapon7': '0.110', 'weapon5': '0.178', 'AMMO4': '0.197', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'HITCOUNT': '0.390', 'WEAPON3': '0.600', 'weapon2': '0.698', 'weapon4': '0.748', 'weapon3': '1.068', 'DAMAGECOUNT': '3.270', 'FRAGCOUNT': '7.000'} [2023-02-24 18:32:33,452][177156] DAMAGECOUNT value on done: 126481.0 [2023-02-24 18:32:33,452][177156] Sum rewards: 1.424, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.396', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.126', 'weapon4': '0.130', 'weapon5': '0.190', 'WEAPON5': '0.250', 'HITCOUNT': '0.390', 'WEAPON3': '0.800', 'weapon2': '1.262', 'DAMAGECOUNT': '1.665', 'weapon3': '2.086', 'FRAGCOUNT': '3.000'} [2023-02-24 18:32:33,872][177153] Updated weights for policy 0, policy_version 14270 (0.0008) [2023-02-24 18:32:36,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13994.6, 300 sec: 13954.2). Total num frames: 58482688. Throughput: 0: 3496.2. Samples: 14614846. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:32:36,376][177119] Avg episode reward: [(0, '10.115')] [2023-02-24 18:32:36,797][177153] Updated weights for policy 0, policy_version 14280 (0.0008) [2023-02-24 18:32:37,624][177170] DAMAGECOUNT value on done: 130089.0 [2023-02-24 18:32:37,624][177170] Sum rewards: 12.607, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.072', 'AMMO3': '0.078', 'HEALTH': '0.090', 'weapon4': '0.144', 'WEAPON4': '0.150', 'weapon5': '0.242', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'HITCOUNT': '0.740', 'weapon3': '1.400', 'weapon2': '1.918', 'DAMAGECOUNT': '3.468', 'FRAGCOUNT': '8.000'} [2023-02-24 18:32:37,928][177170] DAMAGECOUNT value on done: 136436.0 [2023-02-24 18:32:37,929][177170] Sum rewards: 7.590, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.238', 'AMMO2': '0.007', 'AMMO5': '0.024', 'WEAPON1': '0.030', 'AMMO4': '0.035', 'WEAPON4': '0.100', 'AMMO3': '0.125', 'weapon4': '0.166', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.264', 'WEAPON5': '0.450', 'HITCOUNT': '0.700', 'WEAPON3': '0.750', 'weapon2': '0.916', 'weapon3': '2.220', 'DAMAGECOUNT': '3.690', 'FRAGCOUNT': '7.000'} [2023-02-24 18:32:38,284][177170] DAMAGECOUNT value on done: 124068.0 [2023-02-24 18:32:38,284][177170] Sum rewards: 13.474, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.859', 'AMMO2': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.018', 'AMMO3': '0.072', 'weapon5': '0.106', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon7': '0.214', 'AMMO6': '0.360', 'AMMO7': '0.360', 'weapon4': '0.410', 'WEAPON3': '0.600', 'WEAPON7': '0.600', 'weapon2': '0.830', 'HITCOUNT': '0.870', 'weapon3': '1.790', 'DAMAGECOUNT': '3.534', 'FRAGCOUNT': '9.500'} [2023-02-24 18:32:38,586][177170] DAMAGECOUNT value on done: 129415.0 [2023-02-24 18:32:38,586][177170] Sum rewards: 10.582, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.810', 'AMMO5': '0.011', 'AMMO2': '0.013', 'WEAPON1': '0.060', 'AMMO4': '0.063', 'weapon4': '0.116', 'AMMO3': '0.121', 'WEAPON4': '0.150', 'weapon5': '0.164', 'WEAPON5': '0.300', 'HITCOUNT': '0.750', 'WEAPON3': '0.800', 'weapon2': '1.284', 'weapon3': '2.110', 'DAMAGECOUNT': '3.450', 'FRAGCOUNT': '11.000'} [2023-02-24 18:32:38,979][177158] DAMAGECOUNT value on done: 126416.0 [2023-02-24 18:32:38,980][177158] Sum rewards: 9.817, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.684', 'AMMO2': '0.007', 'AMMO5': '0.011', 'AMMO4': '0.036', 'WEAPON1': '0.050', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.135', 'weapon5': '0.170', 'WEAPON5': '0.250', 'WEAPON3': '0.800', 'HITCOUNT': '0.830', 'weapon2': '1.088', 'weapon3': '2.312', 'DAMAGECOUNT': '3.459', 'FRAGCOUNT': '10.000'} [2023-02-24 18:32:39,276][177158] DAMAGECOUNT value on done: 127085.0 [2023-02-24 18:32:39,277][177158] Sum rewards: 13.432, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.328', 'AMMO5': '0.025', 'AMMO2': '0.034', 'WEAPON1': '0.050', 'AMMO3': '0.165', 'AMMO4': '0.169', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.204', 'WEAPON4': '0.250', 'ARMOR': '0.409', 'weapon4': '0.492', 'WEAPON5': '0.500', 'weapon2': '0.514', 'WEAPON3': '1.050', 'HITCOUNT': '1.260', 'weapon3': '2.372', 'DAMAGECOUNT': '5.166', 'FRAGCOUNT': '13.500'} [2023-02-24 18:32:39,738][177153] Updated weights for policy 0, policy_version 14290 (0.0008) [2023-02-24 18:32:39,841][177158] DAMAGECOUNT value on done: 130560.0 [2023-02-24 18:32:39,841][177158] Sum rewards: 8.709, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.742', 'AMMO2': '0.004', 'AMMO5': '0.011', 'AMMO4': '0.019', 'WEAPON1': '0.020', 'WEAPON4': '0.150', 'weapon5': '0.156', 'AMMO3': '0.158', 'weapon4': '0.238', 'WEAPON5': '0.250', 'HITCOUNT': '0.640', 'weapon2': '0.802', 'WEAPON3': '0.950', 'weapon3': '2.508', 'DAMAGECOUNT': '2.544', 'FRAGCOUNT': '10.000'} [2023-02-24 18:32:40,130][177158] DAMAGECOUNT value on done: 129139.0 [2023-02-24 18:32:40,130][177158] Sum rewards: 11.923, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.245', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO3': '0.040', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.114', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.350', 'weapon2': '0.374', 'HITCOUNT': '0.700', 'weapon4': '0.704', 'weapon3': '0.926', 'DAMAGECOUNT': '2.871', 'FRAGCOUNT': '9.000'} [2023-02-24 18:32:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13954.2). Total num frames: 58552320. Throughput: 0: 3494.3. Samples: 14635758. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:32:41,376][177119] Avg episode reward: [(0, '9.933')] [2023-02-24 18:32:41,573][177172] DAMAGECOUNT value on done: 128352.0 [2023-02-24 18:32:41,574][177172] Sum rewards: 13.532, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.030', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO5': '0.012', 'AMMO4': '0.044', 'weapon7': '0.052', 'AMMO3': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.148', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.246', 'WEAPON3': '0.550', 'HITCOUNT': '0.820', 'weapon2': '1.226', 'weapon3': '1.598', 'DAMAGECOUNT': '3.723', 'FRAGCOUNT': '11.000'} [2023-02-24 18:32:41,881][177172] DAMAGECOUNT value on done: 127305.0 [2023-02-24 18:32:41,881][177172] Sum rewards: 11.279, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.581', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon7': '0.048', 'weapon5': '0.066', 'AMMO4': '0.074', 'AMMO3': '0.117', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.324', 'WEAPON3': '0.800', 'HITCOUNT': '1.020', 'weapon2': '1.204', 'weapon3': '1.866', 'DAMAGECOUNT': '3.645', 'FRAGCOUNT': '10.000'} [2023-02-24 18:32:42,702][177153] Updated weights for policy 0, policy_version 14300 (0.0008) [2023-02-24 18:32:42,917][177154] DAMAGECOUNT value on done: 134806.0 [2023-02-24 18:32:42,917][177154] Sum rewards: 12.007, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.284', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.035', 'weapon7': '0.048', 'AMMO3': '0.075', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.156', 'AMMO4': '0.177', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'WEAPON3': '0.550', 'weapon4': '0.560', 'weapon2': '0.750', 'HITCOUNT': '1.060', 'weapon3': '1.574', 'DAMAGECOUNT': '3.894', 'FRAGCOUNT': '10.000'} [2023-02-24 18:32:43,231][177154] DAMAGECOUNT value on done: 135902.0 [2023-02-24 18:32:43,231][177154] Sum rewards: 9.556, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.854', 'AMMO5': '0.006', 'WEAPON1': '0.020', 'AMMO2': '0.042', 'weapon7': '0.066', 'weapon5': '0.088', 'AMMO3': '0.092', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.211', 'ARMOR': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.622', 'WEAPON3': '0.650', 'HITCOUNT': '0.940', 'weapon2': '1.232', 'weapon3': '1.604', 'DAMAGECOUNT': '3.936', 'FRAGCOUNT': '10.000'} [2023-02-24 18:32:43,372][177172] DAMAGECOUNT value on done: 129989.0 [2023-02-24 18:32:43,373][177172] Sum rewards: 9.872, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.048', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'weapon7': '0.120', 'AMMO3': '0.129', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon5': '0.240', 'weapon4': '0.370', 'WEAPON5': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '0.830', 'weapon2': '1.360', 'weapon3': '1.602', 'DAMAGECOUNT': '3.228', 'FRAGCOUNT': '10.000'} [2023-02-24 18:32:43,383][177154] DAMAGECOUNT value on done: 134096.0 [2023-02-24 18:32:43,383][177154] Sum rewards: 10.918, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.700', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon7': '0.048', 'AMMO4': '0.102', 'weapon5': '0.106', 'AMMO3': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.518', 'WEAPON3': '0.850', 'weapon2': '0.878', 'HITCOUNT': '0.910', 'weapon3': '1.994', 'DAMAGECOUNT': '3.549', 'FRAGCOUNT': '10.000'} [2023-02-24 18:32:43,672][177172] DAMAGECOUNT value on done: 129910.0 [2023-02-24 18:32:43,672][177172] Sum rewards: 7.850, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.786', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON1': '0.060', 'AMMO4': '0.095', 'AMMO3': '0.119', 'weapon5': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.346', 'WEAPON3': '0.800', 'weapon2': '0.860', 'HITCOUNT': '0.890', 'weapon3': '2.018', 'DAMAGECOUNT': '3.075', 'FRAGCOUNT': '9.000'} [2023-02-24 18:32:43,683][177154] DAMAGECOUNT value on done: 134841.0 [2023-02-24 18:32:43,684][177154] Sum rewards: 16.264, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.042', 'AMMO3': '0.094', 'HEALTH': '0.120', 'AMMO4': '0.210', 'WEAPON5': '0.250', 'weapon5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '0.550', 'weapon4': '0.752', 'weapon2': '1.032', 'HITCOUNT': '1.190', 'weapon3': '1.632', 'DAMAGECOUNT': '5.001', 'FRAGCOUNT': '13.000'} [2023-02-24 18:32:44,298][177171] DAMAGECOUNT value on done: 130632.0 [2023-02-24 18:32:44,299][177171] Sum rewards: 12.545, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.258', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'weapon7': '0.046', 'AMMO3': '0.076', 'AMMO4': '0.094', 'weapon5': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.530', 'weapon4': '0.558', 'WEAPON3': '0.600', 'weapon3': '1.358', 'weapon2': '1.560', 'DAMAGECOUNT': '3.105', 'FRAGCOUNT': '10.000'} [2023-02-24 18:32:44,313][177157] DAMAGECOUNT value on done: 126498.0 [2023-02-24 18:32:44,314][177157] Sum rewards: 9.288, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.324', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon7': '0.054', 'AMMO3': '0.060', 'AMMO4': '0.095', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.166', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.254', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.670', 'weapon3': '1.392', 'weapon2': '1.840', 'DAMAGECOUNT': '2.532', 'FRAGCOUNT': '7.000'} [2023-02-24 18:32:44,324][177157] DAMAGECOUNT value on done: 133454.0 [2023-02-24 18:32:44,325][177157] Sum rewards: 13.338, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.460', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon5': '0.072', 'AMMO3': '0.104', 'weapon7': '0.106', 'AMMO4': '0.113', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.662', 'weapon4': '0.706', 'WEAPON3': '0.750', 'HITCOUNT': '1.010', 'weapon3': '1.872', 'DAMAGECOUNT': '4.008', 'FRAGCOUNT': '11.500'} [2023-02-24 18:32:44,593][177171] DAMAGECOUNT value on done: 132278.0 [2023-02-24 18:32:44,594][177171] Sum rewards: 1.621, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.770', 'ARMOR': '0.004', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon7': '0.052', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.135', 'weapon5': '0.154', 'WEAPON7': '0.200', 'weapon4': '0.230', 'WEAPON5': '0.250', 'HITCOUNT': '0.560', 'weapon2': '0.600', 'WEAPON3': '0.750', 'weapon3': '1.672', 'DAMAGECOUNT': '1.845', 'FRAGCOUNT': '4.500'} [2023-02-24 18:32:44,619][177157] DAMAGECOUNT value on done: 126961.0 [2023-02-24 18:32:44,619][177157] Sum rewards: 16.823, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.349', 'AMMO5': '0.007', 'AMMO2': '0.011', 'ARMOR': '0.016', 'weapon7': '0.052', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.142', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.224', 'HITCOUNT': '0.630', 'WEAPON3': '0.700', 'weapon2': '1.438', 'weapon3': '1.904', 'DAMAGECOUNT': '3.690', 'FRAGCOUNT': '15.000'} [2023-02-24 18:32:44,629][177157] DAMAGECOUNT value on done: 129765.0 [2023-02-24 18:32:44,630][177157] Sum rewards: 8.873, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.630', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.030', 'AMMO4': '0.041', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'weapon5': '0.156', 'weapon4': '0.244', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'HITCOUNT': '0.860', 'weapon2': '1.342', 'weapon3': '1.534', 'DAMAGECOUNT': '3.495', 'FRAGCOUNT': '6.000'} [2023-02-24 18:32:44,632][177171] DAMAGECOUNT value on done: 126176.0 [2023-02-24 18:32:44,632][177171] Sum rewards: 8.250, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.672', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.236', 'WEAPON5': '0.350', 'HITCOUNT': '0.580', 'WEAPON3': '0.700', 'weapon2': '1.412', 'weapon3': '1.536', 'DAMAGECOUNT': '2.298', 'FRAGCOUNT': '8.000'} [2023-02-24 18:32:44,933][177171] DAMAGECOUNT value on done: 124059.0 [2023-02-24 18:32:44,933][177171] Sum rewards: 15.629, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.015', 'HEALTH': '0.026', 'WEAPON1': '0.030', 'ARMOR': '0.036', 'AMMO2': '0.042', 'AMMO3': '0.078', 'weapon5': '0.116', 'AMMO4': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.430', 'WEAPON3': '0.450', 'HITCOUNT': '1.170', 'weapon2': '1.406', 'weapon3': '1.584', 'DAMAGECOUNT': '4.185', 'FRAGCOUNT': '12.000'} [2023-02-24 18:32:45,474][177155] DAMAGECOUNT value on done: 132369.0 [2023-02-24 18:32:45,475][177155] Sum rewards: 11.280, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.622', 'AMMO5': '0.025', 'WEAPON1': '0.040', 'AMMO2': '0.041', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.152', 'weapon5': '0.196', 'AMMO4': '0.205', 'WEAPON4': '0.350', 'WEAPON5': '0.550', 'weapon2': '0.606', 'weapon4': '0.722', 'WEAPON3': '0.950', 'HITCOUNT': '1.180', 'weapon3': '1.898', 'DAMAGECOUNT': '4.887', 'FRAGCOUNT': '12.000'} [2023-02-24 18:32:45,632][177153] Updated weights for policy 0, policy_version 14310 (0.0008) [2023-02-24 18:32:45,774][177155] DAMAGECOUNT value on done: 135481.0 [2023-02-24 18:32:45,775][177155] Sum rewards: 4.974, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.210', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.057', 'weapon7': '0.072', 'AMMO3': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.120', 'AMMO4': '0.287', 'weapon2': '0.386', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'WEAPON4': '0.800', 'HITCOUNT': '0.840', 'weapon3': '0.944', 'weapon4': '1.330', 'DAMAGECOUNT': '3.912', 'FRAGCOUNT': '9.000'} [2023-02-24 18:32:46,225][177155] DAMAGECOUNT value on done: 135385.0 [2023-02-24 18:32:46,226][177155] Sum rewards: 11.714, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.032', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO3': '0.080', 'AMMO4': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.248', 'WEAPON5': '0.350', 'weapon4': '0.398', 'WEAPON3': '0.500', 'HITCOUNT': '0.650', 'weapon3': '1.286', 'weapon2': '1.624', 'DAMAGECOUNT': '2.733', 'FRAGCOUNT': '10.000'} [2023-02-24 18:32:46,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13954.2). Total num frames: 58621952. Throughput: 0: 3491.7. Samples: 14656682. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:32:46,376][177119] Avg episode reward: [(0, '9.843')] [2023-02-24 18:32:46,390][177157] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 18:32:46,521][177155] DAMAGECOUNT value on done: 126623.0 [2023-02-24 18:32:46,522][177155] Sum rewards: 4.799, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.290', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.019', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO3': '0.092', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.240', 'WEAPON5': '0.250', 'HITCOUNT': '0.490', 'WEAPON3': '0.650', 'weapon2': '1.032', 'weapon3': '1.662', 'DAMAGECOUNT': '1.800', 'FRAGCOUNT': '5.000'} [2023-02-24 18:32:46,535][177158] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 18:32:48,553][177153] Updated weights for policy 0, policy_version 14320 (0.0008) [2023-02-24 18:32:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13954.2). Total num frames: 58691584. Throughput: 0: 3493.0. Samples: 14667202. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:32:51,376][177119] Avg episode reward: [(0, '9.810')] [2023-02-24 18:32:51,490][177153] Updated weights for policy 0, policy_version 14330 (0.0008) [2023-02-24 18:32:52,296][177156] DAMAGECOUNT value on done: 127535.0 [2023-02-24 18:32:52,296][177156] Sum rewards: 13.495, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.883', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'weapon7': '0.050', 'AMMO4': '0.057', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.214', 'WEAPON5': '0.300', 'weapon4': '0.382', 'WEAPON3': '0.400', 'weapon2': '0.770', 'HITCOUNT': '0.790', 'weapon3': '1.158', 'DAMAGECOUNT': '3.774', 'FRAGCOUNT': '11.000'} [2023-02-24 18:32:52,422][177156] DAMAGECOUNT value on done: 130943.0 [2023-02-24 18:32:52,423][177156] Sum rewards: 9.693, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.012', 'AMMO2': '0.015', 'HEALTH': '0.039', 'AMMO3': '0.044', 'weapon2': '0.060', 'weapon7': '0.060', 'AMMO4': '0.075', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'ARMOR': '0.449', 'weapon4': '0.470', 'HITCOUNT': '0.570', 'weapon3': '0.726', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '7.000'} [2023-02-24 18:32:52,606][177156] DAMAGECOUNT value on done: 131938.0 [2023-02-24 18:32:52,606][177156] Sum rewards: 11.375, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.268', 'AMMO5': '0.005', 'ARMOR': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon5': '0.108', 'AMMO4': '0.109', 'AMMO3': '0.131', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.502', 'WEAPON3': '0.850', 'HITCOUNT': '0.880', 'weapon2': '1.336', 'weapon3': '1.852', 'DAMAGECOUNT': '3.933', 'FRAGCOUNT': '11.500'} [2023-02-24 18:32:52,729][177156] DAMAGECOUNT value on done: 128230.0 [2023-02-24 18:32:52,729][177156] Sum rewards: 14.313, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.340', 'ARMOR': '0.004', 'AMMO2': '0.015', 'AMMO5': '0.015', 'weapon7': '0.048', 'AMMO4': '0.074', 'WEAPON1': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.236', 'weapon4': '0.336', 'WEAPON5': '0.400', 'HITCOUNT': '0.950', 'WEAPON3': '1.000', 'weapon2': '1.014', 'weapon3': '2.002', 'DAMAGECOUNT': '5.247', 'FRAGCOUNT': '13.500'} [2023-02-24 18:32:54,401][177153] Updated weights for policy 0, policy_version 14340 (0.0008) [2023-02-24 18:32:56,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.6, 300 sec: 13954.2). Total num frames: 58761216. Throughput: 0: 3494.7. Samples: 14688254. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:32:56,376][177119] Avg episode reward: [(0, '9.919')] [2023-02-24 18:32:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000014346_58761216.pth... [2023-02-24 18:32:56,444][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000013529_55414784.pth [2023-02-24 18:32:56,844][177170] DAMAGECOUNT value on done: 131004.0 [2023-02-24 18:32:56,845][177170] Sum rewards: 11.097, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.116', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon7': '0.046', 'AMMO3': '0.070', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'AMMO4': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.224', 'weapon4': '0.264', 'WEAPON5': '0.350', 'ARMOR': '0.404', 'WEAPON3': '0.500', 'HITCOUNT': '0.740', 'weapon3': '1.360', 'weapon2': '1.504', 'DAMAGECOUNT': '2.745', 'FRAGCOUNT': '9.000'} [2023-02-24 18:32:57,140][177170] DAMAGECOUNT value on done: 138449.0 [2023-02-24 18:32:57,141][177170] Sum rewards: 15.942, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'weapon7': '0.058', 'AMMO3': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.100', 'weapon2': '0.104', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'HEALTH': '0.181', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'weapon4': '0.632', 'HITCOUNT': '0.790', 'weapon3': '1.928', 'DAMAGECOUNT': '4.239', 'FRAGCOUNT': '11.000'} [2023-02-24 18:32:57,368][177153] Updated weights for policy 0, policy_version 14350 (0.0008) [2023-02-24 18:32:57,492][177170] DAMAGECOUNT value on done: 126235.0 [2023-02-24 18:32:57,493][177170] Sum rewards: 19.480, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.975', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon7': '0.056', 'WEAPON1': '0.080', 'AMMO3': '0.084', 'AMMO4': '0.100', 'weapon5': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.580', 'WEAPON3': '0.600', 'ARMOR': '0.900', 'HITCOUNT': '1.060', 'weapon2': '1.440', 'weapon3': '1.530', 'DAMAGECOUNT': '5.001', 'FRAGCOUNT': '14.000'} [2023-02-24 18:32:57,796][177170] DAMAGECOUNT value on done: 130463.0 [2023-02-24 18:32:57,796][177170] Sum rewards: 7.535, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.308', 'AMMO5': '0.010', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'weapon4': '0.058', 'WEAPON4': '0.100', 'weapon7': '0.102', 'AMMO4': '0.102', 'AMMO3': '0.108', 'weapon5': '0.136', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'HITCOUNT': '0.740', 'WEAPON3': '0.750', 'weapon2': '1.094', 'weapon3': '1.708', 'DAMAGECOUNT': '3.144', 'FRAGCOUNT': '6.500'} [2023-02-24 18:32:58,297][177158] DAMAGECOUNT value on done: 127366.0 [2023-02-24 18:32:58,297][177158] Sum rewards: 11.177, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.282', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon7': '0.100', 'AMMO3': '0.110', 'AMMO4': '0.133', 'weapon5': '0.210', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.240', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.740', 'WEAPON3': '0.750', 'weapon2': '1.284', 'weapon3': '1.628', 'DAMAGECOUNT': '2.850', 'FRAGCOUNT': '10.000'} [2023-02-24 18:32:58,589][177158] DAMAGECOUNT value on done: 128478.0 [2023-02-24 18:32:58,589][177158] Sum rewards: 9.313, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.032', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.034', 'AMMO3': '0.128', 'AMMO4': '0.171', 'weapon5': '0.336', 'WEAPON4': '0.350', 'weapon4': '0.404', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'HITCOUNT': '0.890', 'weapon2': '1.038', 'weapon3': '1.784', 'DAMAGECOUNT': '4.179', 'FRAGCOUNT': '11.000'} [2023-02-24 18:32:59,161][177158] DAMAGECOUNT value on done: 131886.0 [2023-02-24 18:32:59,162][177158] Sum rewards: 9.254, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.705', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.023', 'WEAPON1': '0.050', 'AMMO3': '0.165', 'weapon5': '0.226', 'WEAPON5': '0.500', 'weapon2': '0.612', 'HITCOUNT': '0.870', 'WEAPON3': '1.100', 'weapon3': '2.684', 'DAMAGECOUNT': '3.978', 'FRAGCOUNT': '10.500'} [2023-02-24 18:32:59,456][177158] DAMAGECOUNT value on done: 131251.0 [2023-02-24 18:32:59,457][177158] Sum rewards: 22.086, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.610', 'AMMO5': '0.013', 'AMMO2': '0.029', 'WEAPON1': '0.040', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'AMMO4': '0.146', 'weapon5': '0.186', 'WEAPON5': '0.350', 'weapon4': '0.450', 'weapon2': '0.512', 'WEAPON3': '0.650', 'HITCOUNT': '1.510', 'weapon3': '2.028', 'DAMAGECOUNT': '6.336', 'FRAGCOUNT': '17.000'} [2023-02-24 18:33:00,315][177157] Large shaping reward 2.652 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:33:00,329][177153] Updated weights for policy 0, policy_version 14360 (0.0008) [2023-02-24 18:33:00,893][177172] DAMAGECOUNT value on done: 130250.0 [2023-02-24 18:33:00,894][177172] Sum rewards: 21.094, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.318', 'AMMO5': '0.007', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.117', 'weapon5': '0.162', 'WEAPON5': '0.200', 'WEAPON4': '0.500', 'WEAPON3': '0.700', 'weapon2': '0.830', 'weapon4': '0.962', 'HITCOUNT': '1.360', 'weapon3': '1.460', 'DAMAGECOUNT': '5.694', 'FRAGCOUNT': '20.000'} [2023-02-24 18:33:01,183][177172] DAMAGECOUNT value on done: 129444.0 [2023-02-24 18:33:01,184][177172] Sum rewards: 18.665, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.280', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.037', 'AMMO3': '0.146', 'WEAPON5': '0.250', 'weapon5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.528', 'weapon2': '0.696', 'WEAPON3': '0.950', 'HITCOUNT': '1.460', 'weapon3': '2.146', 'DAMAGECOUNT': '6.417', 'FRAGCOUNT': '15.000'} [2023-02-24 18:33:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 58830848. Throughput: 0: 3492.1. Samples: 14709076. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:33:01,376][177119] Avg episode reward: [(0, '10.418')] [2023-02-24 18:33:02,123][177154] DAMAGECOUNT value on done: 136414.0 [2023-02-24 18:33:02,124][177154] Sum rewards: 10.845, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.420', 'AMMO5': '0.018', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.148', 'WEAPON7': '0.200', 'weapon5': '0.242', 'WEAPON4': '0.250', 'weapon4': '0.340', 'WEAPON5': '0.500', 'weapon2': '0.734', 'HITCOUNT': '0.910', 'WEAPON3': '1.000', 'weapon3': '1.660', 'DAMAGECOUNT': '4.824', 'FRAGCOUNT': '11.000'} [2023-02-24 18:33:02,418][177154] DAMAGECOUNT value on done: 136469.0 [2023-02-24 18:33:02,419][177154] Sum rewards: 11.194, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.490', 'AMMO4': '-0.060', 'AMMO2': '-0.012', 'AMMO3': '0.040', 'weapon7': '0.114', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.350', 'WEAPON7': '0.400', 'HITCOUNT': '0.470', 'weapon3': '0.940', 'weapon2': '1.510', 'DAMAGECOUNT': '1.701', 'FRAGCOUNT': '8.000'} [2023-02-24 18:33:02,623][177154] DAMAGECOUNT value on done: 135118.0 [2023-02-24 18:33:02,624][177154] Sum rewards: 11.772, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.793', 'AMMO2': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.031', 'AMMO3': '0.092', 'WEAPON4': '0.150', 'weapon5': '0.158', 'WEAPON5': '0.200', 'weapon4': '0.440', 'WEAPON3': '0.450', 'ARMOR': '0.458', 'HITCOUNT': '0.680', 'weapon2': '0.694', 'weapon3': '1.610', 'DAMAGECOUNT': '3.066', 'FRAGCOUNT': '9.000'} [2023-02-24 18:33:02,631][177172] DAMAGECOUNT value on done: 130536.0 [2023-02-24 18:33:02,631][177172] Sum rewards: 3.790, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.840', 'AMMO2': '0.010', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.049', 'weapon7': '0.078', 'AMMO3': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.182', 'WEAPON4': '0.200', 'weapon4': '0.252', 'WEAPON5': '0.350', 'HITCOUNT': '0.490', 'WEAPON3': '0.550', 'weapon3': '1.398', 'DAMAGECOUNT': '1.641', 'weapon2': '1.752', 'FRAGCOUNT': '4.000'} [2023-02-24 18:33:02,919][177154] DAMAGECOUNT value on done: 135904.0 [2023-02-24 18:33:02,919][177154] Sum rewards: 11.041, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.186', 'AMMO2': '0.012', 'AMMO5': '0.016', 'WEAPON1': '0.060', 'AMMO4': '0.061', 'weapon5': '0.118', 'AMMO3': '0.137', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'ARMOR': '0.451', 'weapon4': '0.542', 'weapon2': '0.798', 'WEAPON3': '0.850', 'HITCOUNT': '0.860', 'weapon3': '1.832', 'DAMAGECOUNT': '3.189', 'FRAGCOUNT': '14.000'} [2023-02-24 18:33:02,938][177172] DAMAGECOUNT value on done: 131645.0 [2023-02-24 18:33:02,939][177172] Sum rewards: 18.604, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.067', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.079', 'weapon7': '0.104', 'AMMO3': '0.114', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.260', 'WEAPON3': '0.750', 'weapon2': '1.256', 'HITCOUNT': '1.340', 'weapon3': '2.184', 'DAMAGECOUNT': '5.205', 'FRAGCOUNT': '14.000'} [2023-02-24 18:33:03,270][177153] Updated weights for policy 0, policy_version 14370 (0.0008) [2023-02-24 18:33:03,502][177171] DAMAGECOUNT value on done: 131088.0 [2023-02-24 18:33:03,503][177171] Sum rewards: 1.109, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.250', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'weapon7': '0.048', 'AMMO3': '0.060', 'weapon5': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.180', 'HITCOUNT': '0.240', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'weapon4': '0.528', 'weapon2': '0.564', 'weapon3': '1.018', 'DAMAGECOUNT': '1.368', 'FRAGCOUNT': '3.000'} [2023-02-24 18:33:03,524][177157] DAMAGECOUNT value on done: 128115.0 [2023-02-24 18:33:03,525][177157] Sum rewards: 14.271, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.594', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon7': '0.086', 'weapon5': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'WEAPON4': '0.350', 'ARMOR': '0.474', 'weapon4': '0.548', 'WEAPON3': '0.700', 'HITCOUNT': '1.050', 'weapon2': '1.204', 'weapon3': '1.466', 'DAMAGECOUNT': '4.515', 'FRAGCOUNT': '12.000'} [2023-02-24 18:33:03,534][177157] DAMAGECOUNT value on done: 134418.0 [2023-02-24 18:33:03,535][177157] Sum rewards: 12.172, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.119', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.194', 'WEAPON7': '0.200', 'weapon5': '0.214', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.730', 'weapon2': '1.096', 'weapon3': '1.804', 'DAMAGECOUNT': '2.892', 'FRAGCOUNT': '9.000'} [2023-02-24 18:33:03,810][177171] DAMAGECOUNT value on done: 133138.0 [2023-02-24 18:33:03,811][177171] Sum rewards: 10.981, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.095', 'AMMO5': '0.008', 'AMMO2': '0.013', 'WEAPON1': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.076', 'WEAPON4': '0.150', 'weapon5': '0.184', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'weapon4': '0.476', 'HITCOUNT': '0.630', 'weapon2': '1.116', 'weapon3': '1.576', 'DAMAGECOUNT': '2.580', 'FRAGCOUNT': '8.000'} [2023-02-24 18:33:03,826][177171] DAMAGECOUNT value on done: 127493.0 [2023-02-24 18:33:03,827][177171] Sum rewards: 16.846, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.007', 'AMMO2': '0.009', 'HEALTH': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.044', 'AMMO3': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.202', 'WEAPON3': '0.300', 'weapon4': '0.338', 'ARMOR': '0.404', 'HITCOUNT': '0.780', 'weapon3': '1.198', 'weapon2': '1.282', 'DAMAGECOUNT': '3.951', 'FRAGCOUNT': '11.000'} [2023-02-24 18:33:03,836][177157] DAMAGECOUNT value on done: 127814.0 [2023-02-24 18:33:03,837][177157] Sum rewards: 2.797, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.066', 'ARMOR': '0.024', 'AMMO5': '0.025', 'AMMO2': '0.055', 'WEAPON1': '0.080', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.162', 'weapon5': '0.200', 'AMMO4': '0.274', 'WEAPON4': '0.300', 'weapon4': '0.372', 'HITCOUNT': '0.590', 'WEAPON5': '0.650', 'WEAPON3': '1.050', 'weapon2': '1.238', 'weapon3': '1.734', 'DAMAGECOUNT': '2.559', 'FRAGCOUNT': '5.000'} [2023-02-24 18:33:03,846][177157] DAMAGECOUNT value on done: 130321.0 [2023-02-24 18:33:03,847][177157] Sum rewards: 4.035, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.840', 'AMMO5': '0.015', 'AMMO2': '0.024', 'WEAPON1': '0.050', 'weapon7': '0.052', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.120', 'weapon5': '0.154', 'WEAPON7': '0.200', 'weapon4': '0.200', 'WEAPON5': '0.400', 'weapon2': '0.428', 'HITCOUNT': '0.470', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.668', 'weapon3': '1.764', 'FRAGCOUNT': '3.500'} [2023-02-24 18:33:04,124][177171] DAMAGECOUNT value on done: 125068.0 [2023-02-24 18:33:04,125][177171] Sum rewards: 3.672, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.384', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.020', 'AMMO3': '0.031', 'weapon7': '0.046', 'weapon5': '0.094', 'AMMO4': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'weapon2': '0.322', 'WEAPON4': '0.350', 'HITCOUNT': '0.490', 'weapon4': '0.612', 'weapon3': '0.724', 'DAMAGECOUNT': '2.307', 'FRAGCOUNT': '3.500'} [2023-02-24 18:33:04,749][177155] DAMAGECOUNT value on done: 133696.0 [2023-02-24 18:33:04,749][177155] Sum rewards: 12.479, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.530', 'AMMO2': '0.005', 'AMMO5': '0.023', 'AMMO4': '0.026', 'ARMOR': '0.028', 'WEAPON1': '0.090', 'AMMO3': '0.103', 'weapon2': '0.190', 'WEAPON4': '0.200', 'weapon5': '0.386', 'weapon4': '0.540', 'WEAPON5': '0.600', 'HITCOUNT': '0.670', 'WEAPON3': '0.700', 'weapon3': '1.466', 'DAMAGECOUNT': '3.981', 'FRAGCOUNT': '11.000'} [2023-02-24 18:33:05,051][177155] DAMAGECOUNT value on done: 136487.0 [2023-02-24 18:33:05,052][177155] Sum rewards: 6.964, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.831', 'AMMO2': '0.014', 'AMMO5': '0.019', 'WEAPON1': '0.040', 'AMMO4': '0.067', 'weapon7': '0.100', 'AMMO3': '0.111', 'WEAPON4': '0.150', 'weapon5': '0.164', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.254', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'ARMOR': '0.500', 'HITCOUNT': '0.630', 'weapon2': '0.632', 'WEAPON3': '0.700', 'weapon3': '1.756', 'DAMAGECOUNT': '3.018', 'FRAGCOUNT': '6.000'} [2023-02-24 18:33:05,483][177155] DAMAGECOUNT value on done: 136518.0 [2023-02-24 18:33:05,483][177155] Sum rewards: 10.611, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.320', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon7': '0.116', 'AMMO3': '0.118', 'weapon5': '0.184', 'weapon4': '0.188', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON7': '0.400', 'HITCOUNT': '0.770', 'WEAPON3': '0.800', 'weapon3': '1.284', 'weapon2': '1.588', 'DAMAGECOUNT': '3.399', 'FRAGCOUNT': '11.000'} [2023-02-24 18:33:05,788][177155] DAMAGECOUNT value on done: 127912.0 [2023-02-24 18:33:05,789][177155] Sum rewards: 10.853, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.431', 'AMMO2': '0.009', 'AMMO5': '0.018', 'AMMO4': '0.044', 'WEAPON1': '0.060', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'weapon5': '0.250', 'weapon4': '0.402', 'WEAPON5': '0.500', 'weapon2': '0.580', 'HITCOUNT': '0.880', 'WEAPON3': '0.950', 'weapon3': '2.190', 'DAMAGECOUNT': '3.867', 'FRAGCOUNT': '12.000'} [2023-02-24 18:33:06,206][177153] Updated weights for policy 0, policy_version 14380 (0.0008) [2023-02-24 18:33:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13954.2). Total num frames: 58900480. Throughput: 0: 3490.1. Samples: 14719506. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:33:06,376][177119] Avg episode reward: [(0, '10.385')] [2023-02-24 18:33:08,359][177172] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 18:33:09,150][177153] Updated weights for policy 0, policy_version 14390 (0.0009) [2023-02-24 18:33:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 58970112. Throughput: 0: 3487.2. Samples: 14740308. Policy #0 lag: (min: 0.0, avg: 0.8, max: 1.0) [2023-02-24 18:33:11,376][177119] Avg episode reward: [(0, '10.385')] [2023-02-24 18:33:11,579][177156] DAMAGECOUNT value on done: 128700.0 [2023-02-24 18:33:11,579][177156] Sum rewards: 9.529, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.649', 'AMMO2': '0.023', 'AMMO5': '0.031', 'WEAPON1': '0.070', 'AMMO4': '0.116', 'AMMO3': '0.117', 'weapon5': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.550', 'weapon4': '0.580', 'WEAPON3': '0.750', 'weapon2': '0.764', 'HITCOUNT': '0.970', 'weapon3': '2.008', 'DAMAGECOUNT': '3.495', 'FRAGCOUNT': '10.000'} [2023-02-24 18:33:11,701][177156] DAMAGECOUNT value on done: 131971.0 [2023-02-24 18:33:11,701][177156] Sum rewards: 7.756, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.421', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO4': '0.088', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.127', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon2': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'HITCOUNT': '0.850', 'weapon4': '0.910', 'weapon3': '1.786', 'DAMAGECOUNT': '3.084', 'FRAGCOUNT': '9.000'} [2023-02-24 18:33:11,893][177156] DAMAGECOUNT value on done: 132918.0 [2023-02-24 18:33:11,894][177156] Sum rewards: 10.315, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.188', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.060', 'weapon5': '0.060', 'WEAPON5': '0.100', 'weapon7': '0.102', 'AMMO4': '0.125', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.472', 'HITCOUNT': '0.750', 'weapon3': '1.322', 'weapon2': '1.822', 'DAMAGECOUNT': '2.940', 'FRAGCOUNT': '8.000'} [2023-02-24 18:33:12,026][177156] DAMAGECOUNT value on done: 129830.0 [2023-02-24 18:33:12,026][177156] Sum rewards: 20.568, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.348', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.060', 'weapon7': '0.192', 'WEAPON4': '0.200', 'weapon5': '0.204', 'WEAPON5': '0.250', 'weapon4': '0.278', 'AMMO6': '0.360', 'AMMO7': '0.360', 'WEAPON3': '0.450', 'WEAPON7': '0.600', 'HITCOUNT': '0.750', 'weapon2': '1.362', 'weapon3': '1.518', 'DAMAGECOUNT': '4.800', 'FRAGCOUNT': '14.000'} [2023-02-24 18:33:12,122][177153] Updated weights for policy 0, policy_version 14400 (0.0008) [2023-02-24 18:33:15,065][177153] Updated weights for policy 0, policy_version 14410 (0.0007) [2023-02-24 18:33:16,090][177170] DAMAGECOUNT value on done: 132077.0 [2023-02-24 18:33:16,090][177170] Sum rewards: 10.617, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.767', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.056', 'weapon7': '0.104', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'weapon5': '0.292', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'weapon4': '0.446', 'ARMOR': '0.489', 'HITCOUNT': '0.520', 'weapon3': '1.056', 'weapon2': '1.560', 'DAMAGECOUNT': '3.156', 'FRAGCOUNT': '7.000'} [2023-02-24 18:33:16,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 59039744. Throughput: 0: 3485.2. Samples: 14761210. Policy #0 lag: (min: 0.0, avg: 0.8, max: 1.0) [2023-02-24 18:33:16,376][177119] Avg episode reward: [(0, '10.409')] [2023-02-24 18:33:16,381][177170] DAMAGECOUNT value on done: 139741.0 [2023-02-24 18:33:16,382][177170] Sum rewards: 7.893, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.410', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.121', 'weapon5': '0.202', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON4': '0.400', 'ARMOR': '0.448', 'weapon4': '0.846', 'WEAPON3': '0.850', 'HITCOUNT': '1.130', 'weapon3': '1.756', 'DAMAGECOUNT': '3.876', 'FRAGCOUNT': '9.000'} [2023-02-24 18:33:16,730][177170] DAMAGECOUNT value on done: 127640.0 [2023-02-24 18:33:16,731][177170] Sum rewards: 16.778, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.233', 'AMMO5': '0.008', 'AMMO2': '0.016', 'WEAPON1': '0.050', 'AMMO4': '0.079', 'weapon7': '0.090', 'AMMO3': '0.093', 'weapon5': '0.108', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.582', 'WEAPON3': '0.700', 'weapon2': '0.802', 'HITCOUNT': '0.920', 'weapon3': '1.558', 'DAMAGECOUNT': '4.215', 'FRAGCOUNT': '15.000'} [2023-02-24 18:33:17,029][177170] DAMAGECOUNT value on done: 131846.0 [2023-02-24 18:33:17,030][177170] Sum rewards: 15.590, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.150', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon7': '0.068', 'AMMO3': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.430', 'WEAPON3': '0.600', 'HITCOUNT': '0.970', 'weapon2': '1.318', 'weapon3': '1.718', 'DAMAGECOUNT': '4.149', 'FRAGCOUNT': '13.000'} [2023-02-24 18:33:17,594][177158] DAMAGECOUNT value on done: 128482.0 [2023-02-24 18:33:17,595][177158] Sum rewards: 13.650, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.496', 'AMMO5': '0.014', 'AMMO2': '0.020', 'WEAPON1': '0.050', 'AMMO4': '0.098', 'AMMO3': '0.114', 'weapon5': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon4': '0.444', 'WEAPON3': '0.750', 'HITCOUNT': '0.750', 'weapon2': '0.918', 'weapon3': '1.716', 'DAMAGECOUNT': '3.348', 'FRAGCOUNT': '13.000'} [2023-02-24 18:33:17,891][177158] DAMAGECOUNT value on done: 129872.0 [2023-02-24 18:33:17,891][177158] Sum rewards: 9.712, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.035', 'weapon5': '0.056', 'HEALTH': '0.078', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.132', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'WEAPON4': '0.250', 'weapon4': '0.628', 'weapon2': '0.738', 'WEAPON3': '0.800', 'HITCOUNT': '1.090', 'weapon3': '2.076', 'DAMAGECOUNT': '4.182', 'FRAGCOUNT': '8.000'} [2023-02-24 18:33:17,989][177153] Updated weights for policy 0, policy_version 14420 (0.0008) [2023-02-24 18:33:18,468][177158] DAMAGECOUNT value on done: 133109.0 [2023-02-24 18:33:18,469][177158] Sum rewards: 8.317, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.346', 'AMMO5': '0.012', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'WEAPON4': '0.100', 'weapon5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.141', 'WEAPON5': '0.250', 'weapon4': '0.320', 'ARMOR': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '0.950', 'weapon2': '1.126', 'weapon3': '2.062', 'DAMAGECOUNT': '3.669', 'FRAGCOUNT': '7.500'} [2023-02-24 18:33:18,761][177158] DAMAGECOUNT value on done: 132376.0 [2023-02-24 18:33:18,761][177158] Sum rewards: 13.839, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.926', 'AMMO5': '0.010', 'AMMO2': '0.023', 'WEAPON1': '0.070', 'AMMO4': '0.114', 'AMMO3': '0.119', 'weapon5': '0.266', 'WEAPON5': '0.350', 'HITCOUNT': '0.750', 'WEAPON3': '0.850', 'weapon2': '1.262', 'weapon3': '2.076', 'DAMAGECOUNT': '3.375', 'FRAGCOUNT': '13.000'} [2023-02-24 18:33:20,232][177172] DAMAGECOUNT value on done: 131822.0 [2023-02-24 18:33:20,233][177172] Sum rewards: 16.621, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.352', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.017', 'WEAPON1': '0.060', 'AMMO4': '0.084', 'weapon7': '0.106', 'AMMO3': '0.130', 'WEAPON4': '0.150', 'weapon5': '0.180', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.282', 'WEAPON7': '0.400', 'WEAPON3': '0.900', 'weapon2': '1.040', 'HITCOUNT': '1.230', 'weapon3': '1.976', 'DAMAGECOUNT': '4.716', 'FRAGCOUNT': '15.000'} [2023-02-24 18:33:20,538][177172] DAMAGECOUNT value on done: 130599.0 [2023-02-24 18:33:20,538][177172] Sum rewards: 10.640, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.332', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.066', 'AMMO4': '0.090', 'AMMO3': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.128', 'WEAPON7': '0.200', 'weapon4': '0.210', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '0.980', 'weapon2': '1.108', 'weapon3': '1.984', 'DAMAGECOUNT': '3.465', 'FRAGCOUNT': '11.000'} [2023-02-24 18:33:20,910][177153] Updated weights for policy 0, policy_version 14430 (0.0008) [2023-02-24 18:33:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 59109376. Throughput: 0: 3485.1. Samples: 14771676. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:33:21,376][177119] Avg episode reward: [(0, '10.749')] [2023-02-24 18:33:21,519][177154] DAMAGECOUNT value on done: 137652.0 [2023-02-24 18:33:21,519][177154] Sum rewards: 8.843, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.000', 'AMMO5': '0.020', 'AMMO2': '0.021', 'WEAPON1': '0.050', 'AMMO3': '0.074', 'AMMO4': '0.105', 'WEAPON4': '0.250', 'weapon5': '0.280', 'weapon4': '0.346', 'ARMOR': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'HITCOUNT': '0.850', 'weapon2': '1.224', 'weapon3': '1.608', 'DAMAGECOUNT': '3.714', 'FRAGCOUNT': '9.000'} [2023-02-24 18:33:21,817][177154] DAMAGECOUNT value on done: 137440.0 [2023-02-24 18:33:21,818][177154] Sum rewards: 12.881, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.560', 'AMMO5': '0.005', 'AMMO2': '0.029', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.067', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.108', 'weapon5': '0.124', 'weapon4': '0.138', 'AMMO4': '0.146', 'WEAPON5': '0.200', 'WEAPON3': '0.500', 'HITCOUNT': '0.570', 'weapon3': '1.282', 'weapon2': '1.468', 'DAMAGECOUNT': '2.913', 'FRAGCOUNT': '10.000'} [2023-02-24 18:33:21,978][177172] DAMAGECOUNT value on done: 132282.0 [2023-02-24 18:33:21,979][177172] Sum rewards: 17.885, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.295', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'weapon5': '0.148', 'WEAPON4': '0.150', 'weapon4': '0.328', 'ARMOR': '0.448', 'WEAPON3': '0.450', 'weapon2': '1.148', 'HITCOUNT': '1.280', 'weapon3': '1.676', 'DAMAGECOUNT': '5.238', 'FRAGCOUNT': '13.000'} [2023-02-24 18:33:22,022][177154] DAMAGECOUNT value on done: 136435.0 [2023-02-24 18:33:22,022][177154] Sum rewards: 6.555, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.906', 'ARMOR': '0.015', 'AMMO5': '0.018', 'AMMO2': '0.024', 'WEAPON1': '0.050', 'AMMO4': '0.122', 'AMMO3': '0.167', 'weapon5': '0.204', 'WEAPON4': '0.250', 'weapon4': '0.358', 'WEAPON5': '0.450', 'weapon2': '0.788', 'HITCOUNT': '0.920', 'WEAPON3': '1.150', 'weapon3': '2.244', 'DAMAGECOUNT': '3.951', 'FRAGCOUNT': '10.000'} [2023-02-24 18:33:22,282][177172] DAMAGECOUNT value on done: 133087.0 [2023-02-24 18:33:22,282][177172] Sum rewards: 13.858, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.888', 'AMMO2': '0.013', 'ARMOR': '0.016', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.066', 'AMMO3': '0.104', 'weapon7': '0.116', 'WEAPON4': '0.200', 'weapon4': '0.250', 'AMMO6': '0.280', 'AMMO7': '0.280', 'weapon5': '0.360', 'WEAPON7': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.650', 'weapon3': '1.240', 'weapon2': '1.414', 'DAMAGECOUNT': '4.167', 'FRAGCOUNT': '11.000'} [2023-02-24 18:33:22,323][177154] DAMAGECOUNT value on done: 136753.0 [2023-02-24 18:33:22,324][177154] Sum rewards: 11.560, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.900', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.021', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO3': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.172', 'WEAPON7': '0.200', 'weapon4': '0.204', 'WEAPON5': '0.250', 'ARMOR': '0.472', 'WEAPON3': '0.550', 'HITCOUNT': '0.570', 'weapon3': '1.382', 'weapon2': '1.786', 'DAMAGECOUNT': '2.547', 'FRAGCOUNT': '9.000'} [2023-02-24 18:33:22,769][177157] DAMAGECOUNT value on done: 135276.0 [2023-02-24 18:33:22,770][177157] Sum rewards: 11.156, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.794', 'AMMO5': '0.007', 'AMMO2': '0.008', 'ARMOR': '0.008', 'AMMO4': '0.039', 'WEAPON1': '0.050', 'AMMO3': '0.068', 'WEAPON4': '0.200', 'weapon5': '0.220', 'WEAPON5': '0.250', 'weapon4': '0.404', 'WEAPON3': '0.550', 'HITCOUNT': '0.710', 'weapon3': '1.256', 'weapon2': '1.856', 'DAMAGECOUNT': '2.574', 'FRAGCOUNT': '10.000'} [2023-02-24 18:33:22,784][177171] DAMAGECOUNT value on done: 132263.0 [2023-02-24 18:33:22,785][177171] Sum rewards: 9.936, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.574', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.013', 'WEAPON1': '0.060', 'AMMO3': '0.122', 'weapon5': '0.316', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '0.760', 'weapon2': '1.162', 'weapon3': '2.144', 'DAMAGECOUNT': '3.525', 'FRAGCOUNT': '8.000'} [2023-02-24 18:33:22,789][177157] DAMAGECOUNT value on done: 128744.0 [2023-02-24 18:33:22,790][177157] Sum rewards: 8.503, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.908', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'weapon7': '0.052', 'AMMO3': '0.075', 'AMMO4': '0.083', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.202', 'WEAPON5': '0.250', 'weapon4': '0.418', 'WEAPON3': '0.450', 'HITCOUNT': '0.450', 'ARMOR': '0.453', 'weapon2': '1.024', 'weapon3': '1.610', 'DAMAGECOUNT': '1.887', 'FRAGCOUNT': '7.000'} [2023-02-24 18:33:23,073][177157] DAMAGECOUNT value on done: 130879.0 [2023-02-24 18:33:23,073][177157] Sum rewards: 3.909, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.752', 'AMMO5': '0.012', 'AMMO2': '0.022', 'WEAPON1': '0.050', 'AMMO4': '0.109', 'AMMO3': '0.112', 'WEAPON4': '0.250', 'weapon5': '0.302', 'weapon4': '0.346', 'WEAPON5': '0.350', 'HITCOUNT': '0.510', 'WEAPON3': '0.650', 'weapon3': '1.434', 'weapon2': '1.590', 'DAMAGECOUNT': '1.674', 'FRAGCOUNT': '4.000'} [2023-02-24 18:33:23,088][177171] DAMAGECOUNT value on done: 134615.0 [2023-02-24 18:33:23,088][177171] Sum rewards: 12.846, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.437', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO2': '0.029', 'weapon7': '0.090', 'AMMO3': '0.102', 'weapon5': '0.134', 'AMMO4': '0.145', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.600', 'weapon4': '0.630', 'weapon2': '0.646', 'WEAPON3': '0.850', 'HITCOUNT': '1.140', 'weapon3': '1.976', 'DAMAGECOUNT': '4.431', 'FRAGCOUNT': '11.000'} [2023-02-24 18:33:23,093][177157] DAMAGECOUNT value on done: 129181.0 [2023-02-24 18:33:23,093][177157] Sum rewards: 10.746, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.005', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO3': '0.131', 'AMMO4': '0.170', 'weapon5': '0.266', 'WEAPON5': '0.350', 'ARMOR': '0.476', 'weapon4': '0.588', 'WEAPON4': '0.600', 'WEAPON3': '0.850', 'HITCOUNT': '0.910', 'weapon2': '0.968', 'weapon3': '1.544', 'DAMAGECOUNT': '4.101', 'FRAGCOUNT': '10.000'} [2023-02-24 18:33:23,101][177171] DAMAGECOUNT value on done: 128850.0 [2023-02-24 18:33:23,101][177171] Sum rewards: 11.722, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.648', 'AMMO2': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'weapon7': '0.032', 'AMMO4': '0.060', 'AMMO3': '0.097', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.254', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.830', 'weapon2': '1.214', 'weapon3': '2.014', 'DAMAGECOUNT': '4.071', 'FRAGCOUNT': '7.000'} [2023-02-24 18:33:23,402][177171] DAMAGECOUNT value on done: 125977.0 [2023-02-24 18:33:23,403][177171] Sum rewards: 7.824, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.484', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'weapon7': '0.048', 'AMMO3': '0.057', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.120', 'AMMO4': '0.139', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.560', 'weapon4': '0.686', 'weapon3': '0.810', 'weapon2': '0.928', 'DAMAGECOUNT': '2.727', 'FRAGCOUNT': '7.000'} [2023-02-24 18:33:23,861][177153] Updated weights for policy 0, policy_version 14440 (0.0008) [2023-02-24 18:33:24,035][177155] DAMAGECOUNT value on done: 134760.0 [2023-02-24 18:33:24,035][177155] Sum rewards: 12.599, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.060', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.065', 'AMMO4': '0.079', 'weapon7': '0.096', 'weapon5': '0.144', 'weapon4': '0.198', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.630', 'weapon3': '1.132', 'weapon2': '2.110', 'DAMAGECOUNT': '3.192', 'FRAGCOUNT': '9.000'} [2023-02-24 18:33:24,345][177155] DAMAGECOUNT value on done: 137103.0 [2023-02-24 18:33:24,345][177155] Sum rewards: 1.102, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.180', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO3': '0.096', 'weapon5': '0.096', 'weapon7': '0.116', 'AMMO4': '0.170', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.300', 'HITCOUNT': '0.360', 'WEAPON4': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.650', 'weapon2': '0.706', 'weapon4': '0.724', 'weapon3': '1.118', 'DAMAGECOUNT': '1.848', 'FRAGCOUNT': '4.000'} [2023-02-24 18:33:24,786][177155] DAMAGECOUNT value on done: 137793.0 [2023-02-24 18:33:24,786][177155] Sum rewards: 13.162, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.592', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'AMMO4': '0.120', 'weapon5': '0.126', 'weapon2': '0.212', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'weapon4': '0.612', 'WEAPON3': '0.750', 'HITCOUNT': '0.990', 'weapon3': '1.952', 'DAMAGECOUNT': '3.825', 'FRAGCOUNT': '11.000'} [2023-02-24 18:33:25,084][177155] DAMAGECOUNT value on done: 129350.0 [2023-02-24 18:33:25,085][177155] Sum rewards: 16.283, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.740', 'AMMO2': '0.009', 'AMMO5': '0.017', 'AMMO4': '0.046', 'weapon7': '0.048', 'WEAPON1': '0.060', 'AMMO3': '0.085', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.336', 'WEAPON5': '0.450', 'weapon4': '0.454', 'ARMOR': '0.478', 'WEAPON3': '0.600', 'weapon2': '0.834', 'HITCOUNT': '0.880', 'weapon3': '1.780', 'DAMAGECOUNT': '4.305', 'FRAGCOUNT': '12.000'} [2023-02-24 18:33:26,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 59179008. Throughput: 0: 3484.1. Samples: 14792544. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:33:26,376][177119] Avg episode reward: [(0, '10.995')] [2023-02-24 18:33:26,380][177140] Saving new best policy, reward=10.995! [2023-02-24 18:33:26,795][177153] Updated weights for policy 0, policy_version 14450 (0.0009) [2023-02-24 18:33:29,747][177153] Updated weights for policy 0, policy_version 14460 (0.0008) [2023-02-24 18:33:30,957][177156] DAMAGECOUNT value on done: 129713.0 [2023-02-24 18:33:30,958][177156] Sum rewards: 14.429, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.406', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.008', 'AMMO4': '0.039', 'weapon7': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.073', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON3': '0.450', 'HITCOUNT': '0.700', 'weapon3': '1.110', 'weapon2': '1.760', 'DAMAGECOUNT': '3.039', 'FRAGCOUNT': '11.000'} [2023-02-24 18:33:31,097][177156] DAMAGECOUNT value on done: 133171.0 [2023-02-24 18:33:31,098][177156] Sum rewards: 6.642, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.742', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.029', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'weapon5': '0.158', 'WEAPON5': '0.200', 'weapon4': '0.352', 'weapon2': '0.768', 'HITCOUNT': '0.820', 'WEAPON3': '0.900', 'weapon3': '2.252', 'DAMAGECOUNT': '3.600', 'FRAGCOUNT': '7.000'} [2023-02-24 18:33:31,259][177156] DAMAGECOUNT value on done: 134564.0 [2023-02-24 18:33:31,259][177156] Sum rewards: 18.099, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.079', 'AMMO5': '0.015', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'AMMO3': '0.076', 'AMMO4': '0.091', 'weapon5': '0.186', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '0.500', 'weapon2': '0.888', 'HITCOUNT': '1.000', 'weapon4': '1.084', 'weapon3': '1.292', 'DAMAGECOUNT': '4.938', 'FRAGCOUNT': '15.000'} [2023-02-24 18:33:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 59248640. Throughput: 0: 3481.9. Samples: 14813366. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:33:31,376][177119] Avg episode reward: [(0, '11.098')] [2023-02-24 18:33:31,377][177140] Saving new best policy, reward=11.098! [2023-02-24 18:33:31,409][177156] DAMAGECOUNT value on done: 131468.0 [2023-02-24 18:33:31,410][177156] Sum rewards: 11.391, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.875', 'ARMOR': '0.008', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon7': '0.080', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'weapon5': '0.164', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.568', 'weapon2': '0.702', 'WEAPON3': '0.750', 'HITCOUNT': '1.030', 'weapon3': '1.878', 'DAMAGECOUNT': '4.914', 'FRAGCOUNT': '8.500'} [2023-02-24 18:33:32,695][177153] Updated weights for policy 0, policy_version 14470 (0.0008) [2023-02-24 18:33:35,394][177170] DAMAGECOUNT value on done: 133660.0 [2023-02-24 18:33:35,395][177170] Sum rewards: 14.125, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.754', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.036', 'weapon7': '0.048', 'AMMO3': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.178', 'WEAPON7': '0.200', 'weapon5': '0.246', 'WEAPON5': '0.350', 'ARMOR': '0.497', 'WEAPON3': '0.500', 'WEAPON4': '0.550', 'weapon2': '0.582', 'weapon4': '0.742', 'HITCOUNT': '0.790', 'weapon3': '1.344', 'DAMAGECOUNT': '4.482', 'FRAGCOUNT': '14.000'} [2023-02-24 18:33:35,613][177153] Updated weights for policy 0, policy_version 14480 (0.0008) [2023-02-24 18:33:35,694][177170] DAMAGECOUNT value on done: 140956.0 [2023-02-24 18:33:35,694][177170] Sum rewards: 11.307, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.384', 'AMMO5': '0.014', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'weapon5': '0.090', 'AMMO3': '0.104', 'AMMO4': '0.130', 'weapon7': '0.132', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.453', 'weapon4': '0.486', 'WEAPON3': '0.600', 'weapon2': '0.754', 'HITCOUNT': '0.870', 'weapon3': '1.456', 'DAMAGECOUNT': '3.645', 'FRAGCOUNT': '10.000'} [2023-02-24 18:33:36,051][177170] DAMAGECOUNT value on done: 128150.0 [2023-02-24 18:33:36,052][177170] Sum rewards: 7.744, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.630', 'AMMO2': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.027', 'AMMO3': '0.040', 'weapon5': '0.140', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON3': '0.300', 'weapon4': '0.348', 'HITCOUNT': '0.350', 'ARMOR': '0.490', 'weapon2': '0.734', 'weapon3': '0.982', 'DAMAGECOUNT': '1.530', 'FRAGCOUNT': '6.000'} [2023-02-24 18:33:36,346][177170] DAMAGECOUNT value on done: 132953.0 [2023-02-24 18:33:36,347][177170] Sum rewards: 8.182, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.964', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.033', 'AMMO3': '0.103', 'AMMO4': '0.163', 'WEAPON5': '0.200', 'weapon5': '0.240', 'WEAPON4': '0.400', 'WEAPON3': '0.700', 'weapon4': '0.706', 'weapon2': '0.758', 'HITCOUNT': '0.900', 'weapon3': '1.832', 'DAMAGECOUNT': '3.321', 'FRAGCOUNT': '8.000'} [2023-02-24 18:33:36,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 59318272. Throughput: 0: 3480.3. Samples: 14823816. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:33:36,376][177119] Avg episode reward: [(0, '11.222')] [2023-02-24 18:33:36,380][177140] Saving new best policy, reward=11.222! [2023-02-24 18:33:36,923][177158] DAMAGECOUNT value on done: 129540.0 [2023-02-24 18:33:36,924][177158] Sum rewards: 9.165, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.840', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.058', 'AMMO4': '0.087', 'weapon7': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.102', 'AMMO3': '0.122', 'WEAPON5': '0.200', 'HITCOUNT': '0.770', 'WEAPON3': '0.850', 'weapon2': '1.156', 'weapon3': '2.232', 'DAMAGECOUNT': '3.174', 'FRAGCOUNT': '9.000'} [2023-02-24 18:33:37,222][177158] DAMAGECOUNT value on done: 130514.0 [2023-02-24 18:33:37,222][177158] Sum rewards: 5.914, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.775', 'AMMO5': '0.010', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'weapon7': '0.062', 'AMMO3': '0.069', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.143', 'WEAPON5': '0.300', 'weapon5': '0.326', 'WEAPON3': '0.400', 'ARMOR': '0.408', 'WEAPON4': '0.450', 'HITCOUNT': '0.520', 'weapon4': '0.734', 'weapon2': '0.788', 'weapon3': '0.944', 'DAMAGECOUNT': '1.926', 'FRAGCOUNT': '6.000'} [2023-02-24 18:33:37,790][177158] DAMAGECOUNT value on done: 134941.0 [2023-02-24 18:33:37,790][177158] Sum rewards: 15.927, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.526', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'AMMO3': '0.104', 'weapon5': '0.128', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.538', 'weapon4': '0.670', 'WEAPON3': '0.700', 'HITCOUNT': '1.430', 'weapon3': '2.082', 'DAMAGECOUNT': '5.496', 'FRAGCOUNT': '14.000'} [2023-02-24 18:33:38,084][177158] DAMAGECOUNT value on done: 133219.0 [2023-02-24 18:33:38,085][177158] Sum rewards: 7.170, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.515', 'ARMOR': '0.004', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'AMMO2': '0.036', 'AMMO3': '0.139', 'AMMO4': '0.182', 'weapon5': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.500', 'weapon2': '0.626', 'weapon4': '0.736', 'WEAPON3': '0.800', 'HITCOUNT': '0.800', 'weapon3': '1.532', 'DAMAGECOUNT': '2.529', 'FRAGCOUNT': '9.000'} [2023-02-24 18:33:38,545][177153] Updated weights for policy 0, policy_version 14490 (0.0009) [2023-02-24 18:33:39,058][177158] Large shaping reward 3.652 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:33:39,580][177172] DAMAGECOUNT value on done: 132199.0 [2023-02-24 18:33:39,581][177172] Sum rewards: -1.132, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.570', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'weapon7': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.124', 'AMMO3': '0.166', 'AMMO4': '0.182', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.350', 'weapon4': '0.440', 'weapon2': '0.814', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.131', 'weapon3': '1.370', 'FRAGCOUNT': '3.000'} [2023-02-24 18:33:39,877][177172] DAMAGECOUNT value on done: 131304.0 [2023-02-24 18:33:39,878][177172] Sum rewards: 3.962, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.970', 'AMMO5': '0.016', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.085', 'weapon7': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.125', 'WEAPON7': '0.200', 'weapon5': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.522', 'weapon2': '0.550', 'HITCOUNT': '0.590', 'WEAPON3': '0.800', 'weapon3': '1.744', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '6.000'} [2023-02-24 18:33:40,792][177154] DAMAGECOUNT value on done: 138435.0 [2023-02-24 18:33:40,792][177154] Sum rewards: 9.182, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'weapon5': '0.050', 'weapon7': '0.058', 'AMMO3': '0.086', 'AMMO4': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HEALTH': '0.407', 'weapon4': '0.414', 'WEAPON3': '0.450', 'HITCOUNT': '0.620', 'weapon2': '1.166', 'weapon3': '1.446', 'DAMAGECOUNT': '2.349', 'FRAGCOUNT': '8.000'} [2023-02-24 18:33:41,104][177154] DAMAGECOUNT value on done: 138767.0 [2023-02-24 18:33:41,105][177154] Sum rewards: 12.909, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.100', 'AMMO2': '0.005', 'AMMO4': '0.026', 'AMMO3': '0.060', 'weapon7': '0.132', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'weapon4': '0.410', 'WEAPON3': '0.450', 'HITCOUNT': '0.720', 'weapon3': '1.028', 'weapon2': '1.066', 'DAMAGECOUNT': '2.781', 'FRAGCOUNT': '9.000'} [2023-02-24 18:33:41,322][177154] DAMAGECOUNT value on done: 137309.0 [2023-02-24 18:33:41,323][177154] Sum rewards: 5.361, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.905', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.026', 'WEAPON1': '0.040', 'AMMO3': '0.106', 'AMMO4': '0.131', 'weapon5': '0.154', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.450', 'HITCOUNT': '0.670', 'WEAPON3': '0.750', 'weapon2': '1.446', 'weapon3': '1.700', 'DAMAGECOUNT': '2.622', 'FRAGCOUNT': '6.000'} [2023-02-24 18:33:41,348][177172] DAMAGECOUNT value on done: 134523.0 [2023-02-24 18:33:41,349][177172] Sum rewards: 18.047, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.744', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.035', 'weapon5': '0.068', 'weapon7': '0.100', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'AMMO4': '0.173', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.450', 'weapon4': '0.644', 'weapon2': '0.706', 'WEAPON3': '0.900', 'HITCOUNT': '1.340', 'weapon3': '1.822', 'DAMAGECOUNT': '6.645', 'FRAGCOUNT': '14.000'} [2023-02-24 18:33:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 59387904. Throughput: 0: 3477.4. Samples: 14844738. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:33:41,376][177119] Avg episode reward: [(0, '10.958')] [2023-02-24 18:33:41,514][177153] Updated weights for policy 0, policy_version 14500 (0.0008) [2023-02-24 18:33:41,627][177154] DAMAGECOUNT value on done: 139011.0 [2023-02-24 18:33:41,628][177154] Sum rewards: 25.075, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.403', 'AMMO2': '0.002', 'AMMO5': '0.010', 'AMMO4': '0.011', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'weapon4': '0.088', 'AMMO3': '0.133', 'WEAPON5': '0.300', 'weapon5': '0.322', 'weapon2': '0.668', 'WEAPON3': '1.100', 'HITCOUNT': '1.390', 'weapon3': '2.570', 'DAMAGECOUNT': '6.774', 'FRAGCOUNT': '23.000'} [2023-02-24 18:33:41,644][177172] DAMAGECOUNT value on done: 135047.0 [2023-02-24 18:33:41,644][177172] Sum rewards: 16.374, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.266', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon7': '0.052', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.159', 'AMMO4': '0.178', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.620', 'weapon4': '0.858', 'WEAPON3': '0.950', 'ARMOR': '0.983', 'HITCOUNT': '1.580', 'weapon3': '2.020', 'DAMAGECOUNT': '5.880', 'FRAGCOUNT': '15.000'} [2023-02-24 18:33:42,111][177157] DAMAGECOUNT value on done: 136277.0 [2023-02-24 18:33:42,111][177157] Sum rewards: 10.518, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.825', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.008', 'WEAPON1': '0.040', 'weapon7': '0.048', 'weapon4': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.230', 'WEAPON5': '0.250', 'HITCOUNT': '0.710', 'WEAPON3': '0.800', 'weapon2': '1.492', 'weapon3': '1.806', 'DAMAGECOUNT': '3.003', 'FRAGCOUNT': '10.000'} [2023-02-24 18:33:42,138][177171] DAMAGECOUNT value on done: 133494.0 [2023-02-24 18:33:42,138][177171] Sum rewards: 12.846, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.534', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO4': '0.050', 'weapon7': '0.052', 'AMMO3': '0.083', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.368', 'WEAPON5': '0.400', 'ARMOR': '0.444', 'WEAPON3': '0.550', 'HITCOUNT': '0.700', 'weapon2': '0.942', 'weapon3': '1.636', 'DAMAGECOUNT': '3.693', 'FRAGCOUNT': '11.000'} [2023-02-24 18:33:42,140][177157] DAMAGECOUNT value on done: 129684.0 [2023-02-24 18:33:42,141][177157] Sum rewards: 11.043, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.644', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.050', 'weapon7': '0.050', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.436', 'WEAPON3': '0.550', 'HITCOUNT': '0.780', 'weapon3': '1.412', 'weapon2': '1.498', 'DAMAGECOUNT': '2.820', 'FRAGCOUNT': '10.000'} [2023-02-24 18:33:42,418][177157] DAMAGECOUNT value on done: 131954.0 [2023-02-24 18:33:42,419][177157] Sum rewards: 11.721, reward structure: {'DEATHCOUNT': '-6.000', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon7': '0.050', 'AMMO3': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.179', 'weapon5': '0.210', 'HEALTH': '0.276', 'WEAPON3': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.428', 'ARMOR': '0.456', 'HITCOUNT': '0.910', 'weapon2': '1.178', 'weapon3': '1.378', 'DAMAGECOUNT': '3.225', 'FRAGCOUNT': '8.000'} [2023-02-24 18:33:42,438][177171] DAMAGECOUNT value on done: 135911.0 [2023-02-24 18:33:42,438][177171] Sum rewards: 14.496, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.987', 'AMMO5': '0.007', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'weapon5': '0.090', 'weapon7': '0.096', 'AMMO4': '0.119', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'weapon4': '0.432', 'WEAPON3': '0.850', 'weapon2': '0.876', 'HITCOUNT': '1.000', 'weapon3': '2.020', 'DAMAGECOUNT': '3.888', 'FRAGCOUNT': '13.000'} [2023-02-24 18:33:42,449][177157] DAMAGECOUNT value on done: 130501.0 [2023-02-24 18:33:42,449][177157] Sum rewards: 14.658, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.843', 'AMMO2': '0.006', 'AMMO5': '0.013', 'AMMO4': '0.028', 'WEAPON1': '0.030', 'weapon7': '0.048', 'weapon5': '0.098', 'AMMO3': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon2': '0.162', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.576', 'WEAPON3': '0.800', 'ARMOR': '0.849', 'HITCOUNT': '1.130', 'weapon3': '2.146', 'DAMAGECOUNT': '3.960', 'FRAGCOUNT': '12.000'} [2023-02-24 18:33:42,451][177171] DAMAGECOUNT value on done: 129990.0 [2023-02-24 18:33:42,451][177171] Sum rewards: 14.359, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.900', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.034', 'weapon5': '0.066', 'AMMO3': '0.078', 'weapon7': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.272', 'WEAPON7': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.820', 'weapon3': '1.516', 'weapon2': '1.688', 'DAMAGECOUNT': '3.420', 'FRAGCOUNT': '12.000'} [2023-02-24 18:33:42,754][177171] DAMAGECOUNT value on done: 127678.0 [2023-02-24 18:33:42,755][177171] Sum rewards: 19.131, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.196', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.022', 'WEAPON4': '0.050', 'WEAPON1': '0.080', 'weapon4': '0.090', 'AMMO3': '0.105', 'weapon5': '0.280', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'HITCOUNT': '0.980', 'weapon2': '1.550', 'weapon3': '1.816', 'DAMAGECOUNT': '5.103', 'FRAGCOUNT': '15.000'} [2023-02-24 18:33:43,330][177155] DAMAGECOUNT value on done: 135682.0 [2023-02-24 18:33:43,330][177155] Sum rewards: 6.106, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.680', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.046', 'weapon7': '0.056', 'AMMO4': '0.072', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'weapon2': '0.218', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.458', 'weapon4': '0.510', 'HITCOUNT': '0.620', 'WEAPON3': '0.650', 'weapon3': '1.088', 'DAMAGECOUNT': '2.766', 'FRAGCOUNT': '6.000'} [2023-02-24 18:33:43,636][177155] DAMAGECOUNT value on done: 138319.0 [2023-02-24 18:33:43,637][177155] Sum rewards: 12.508, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.247', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO3': '0.040', 'weapon7': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.202', 'WEAPON3': '0.300', 'HITCOUNT': '0.880', 'weapon3': '0.944', 'weapon2': '1.694', 'DAMAGECOUNT': '3.648', 'FRAGCOUNT': '8.000'} [2023-02-24 18:33:44,074][177155] DAMAGECOUNT value on done: 139194.0 [2023-02-24 18:33:44,074][177155] Sum rewards: 12.081, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.992', 'AMMO5': '0.015', 'AMMO2': '0.027', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.135', 'weapon4': '0.172', 'AMMO3': '0.174', 'weapon5': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.842', 'HITCOUNT': '0.940', 'WEAPON3': '1.150', 'weapon3': '2.364', 'DAMAGECOUNT': '4.203', 'FRAGCOUNT': '13.000'} [2023-02-24 18:33:44,369][177155] DAMAGECOUNT value on done: 130573.0 [2023-02-24 18:33:44,370][177155] Sum rewards: 8.007, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.016', 'AMMO2': '0.017', 'AMMO5': '0.018', 'weapon7': '0.064', 'WEAPON1': '0.070', 'AMMO4': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'weapon4': '0.254', 'weapon5': '0.320', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'HITCOUNT': '0.760', 'weapon2': '0.940', 'weapon3': '1.758', 'DAMAGECOUNT': '3.669', 'FRAGCOUNT': '7.500'} [2023-02-24 18:33:44,480][177153] Updated weights for policy 0, policy_version 14510 (0.0008) [2023-02-24 18:33:46,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 59457536. Throughput: 0: 3478.7. Samples: 14865620. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:33:46,376][177119] Avg episode reward: [(0, '11.319')] [2023-02-24 18:33:46,379][177140] Saving new best policy, reward=11.319! [2023-02-24 18:33:47,439][177153] Updated weights for policy 0, policy_version 14520 (0.0008) [2023-02-24 18:33:50,300][177156] DAMAGECOUNT value on done: 130924.0 [2023-02-24 18:33:50,300][177156] Sum rewards: 12.199, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.661', 'AMMO5': '0.020', 'AMMO2': '0.021', 'WEAPON1': '0.050', 'AMMO4': '0.103', 'AMMO3': '0.104', 'weapon5': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.408', 'WEAPON5': '0.450', 'ARMOR': '0.521', 'WEAPON3': '0.700', 'weapon4': '0.736', 'HITCOUNT': '0.890', 'weapon3': '1.584', 'DAMAGECOUNT': '3.633', 'FRAGCOUNT': '10.000'} [2023-02-24 18:33:50,350][177153] Updated weights for policy 0, policy_version 14530 (0.0008) [2023-02-24 18:33:50,453][177156] DAMAGECOUNT value on done: 134629.0 [2023-02-24 18:33:50,453][177156] Sum rewards: 13.752, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.557', 'AMMO5': '0.015', 'AMMO2': '0.016', 'WEAPON1': '0.080', 'AMMO4': '0.080', 'AMMO3': '0.115', 'weapon5': '0.358', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.990', 'weapon2': '1.098', 'weapon3': '2.082', 'DAMAGECOUNT': '4.374', 'FRAGCOUNT': '10.000'} [2023-02-24 18:33:50,613][177156] DAMAGECOUNT value on done: 135390.0 [2023-02-24 18:33:50,614][177156] Sum rewards: 2.882, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.253', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'AMMO4': '0.106', 'AMMO3': '0.111', 'weapon5': '0.132', 'WEAPON5': '0.150', 'weapon7': '0.158', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.422', 'ARMOR': '0.455', 'HITCOUNT': '0.500', 'WEAPON3': '0.700', 'weapon4': '0.780', 'weapon3': '1.694', 'DAMAGECOUNT': '2.478', 'FRAGCOUNT': '5.000'} [2023-02-24 18:33:50,763][177156] DAMAGECOUNT value on done: 132544.0 [2023-02-24 18:33:50,764][177156] Sum rewards: 7.348, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.402', 'AMMO5': '0.017', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'AMMO3': '0.073', 'AMMO4': '0.134', 'WEAPON5': '0.300', 'weapon5': '0.332', 'weapon2': '0.356', 'WEAPON4': '0.400', 'ARMOR': '0.449', 'WEAPON3': '0.450', 'HITCOUNT': '0.610', 'weapon4': '1.116', 'weapon3': '1.478', 'DAMAGECOUNT': '3.228', 'FRAGCOUNT': '7.000'} [2023-02-24 18:33:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 59527168. Throughput: 0: 3478.4. Samples: 14876032. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:33:51,376][177119] Avg episode reward: [(0, '11.353')] [2023-02-24 18:33:51,377][177140] Saving new best policy, reward=11.353! [2023-02-24 18:33:53,306][177153] Updated weights for policy 0, policy_version 14540 (0.0008) [2023-02-24 18:33:53,787][177154] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 18:33:54,640][177170] DAMAGECOUNT value on done: 135015.0 [2023-02-24 18:33:54,641][177170] Sum rewards: 16.387, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.169', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON1': '0.050', 'weapon7': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.134', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.800', 'HITCOUNT': '0.830', 'weapon2': '1.658', 'weapon3': '1.874', 'DAMAGECOUNT': '4.065', 'FRAGCOUNT': '14.000'} [2023-02-24 18:33:54,947][177170] DAMAGECOUNT value on done: 142168.0 [2023-02-24 18:33:54,948][177170] Sum rewards: 7.216, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.054', 'AMMO5': '0.012', 'AMMO2': '0.048', 'WEAPON1': '0.050', 'AMMO3': '0.075', 'weapon5': '0.156', 'AMMO4': '0.239', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '0.550', 'weapon2': '0.596', 'HITCOUNT': '0.650', 'weapon4': '0.766', 'weapon3': '1.592', 'DAMAGECOUNT': '3.636', 'FRAGCOUNT': '5.500'} [2023-02-24 18:33:55,308][177170] DAMAGECOUNT value on done: 129985.0 [2023-02-24 18:33:55,309][177170] Sum rewards: 18.798, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.374', 'AMMO2': '0.010', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.048', 'AMMO3': '0.126', 'weapon5': '0.296', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '0.980', 'weapon2': '1.216', 'weapon3': '2.154', 'DAMAGECOUNT': '5.505', 'FRAGCOUNT': '16.000'} [2023-02-24 18:33:55,601][177170] DAMAGECOUNT value on done: 133918.0 [2023-02-24 18:33:55,602][177170] Sum rewards: 5.693, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.996', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO2': '0.044', 'weapon5': '0.086', 'AMMO3': '0.099', 'WEAPON5': '0.200', 'AMMO4': '0.221', 'WEAPON4': '0.400', 'HITCOUNT': '0.610', 'WEAPON3': '0.650', 'weapon2': '0.670', 'weapon4': '0.888', 'ARMOR': '0.961', 'weapon3': '1.912', 'DAMAGECOUNT': '2.895', 'FRAGCOUNT': '6.000'} [2023-02-24 18:33:56,168][177158] DAMAGECOUNT value on done: 130897.0 [2023-02-24 18:33:56,168][177158] Sum rewards: 15.602, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'weapon5': '0.054', 'weapon7': '0.066', 'AMMO4': '0.084', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.472', 'WEAPON3': '0.550', 'weapon2': '0.730', 'weapon4': '0.834', 'HITCOUNT': '0.900', 'weapon3': '1.306', 'DAMAGECOUNT': '4.071', 'FRAGCOUNT': '12.000'} [2023-02-24 18:33:56,249][177153] Updated weights for policy 0, policy_version 14550 (0.0008) [2023-02-24 18:33:56,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 59596800. Throughput: 0: 3479.8. Samples: 14896900. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:33:56,376][177119] Avg episode reward: [(0, '11.390')] [2023-02-24 18:33:56,380][177140] Saving new best policy, reward=11.390! [2023-02-24 18:33:56,477][177158] DAMAGECOUNT value on done: 131988.0 [2023-02-24 18:33:56,478][177158] Sum rewards: 16.144, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.733', 'AMMO5': '0.012', 'AMMO2': '0.023', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.056', 'AMMO3': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.116', 'weapon5': '0.188', 'weapon4': '0.284', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'HITCOUNT': '0.920', 'weapon2': '1.128', 'weapon3': '1.826', 'DAMAGECOUNT': '4.083', 'FRAGCOUNT': '12.000'} [2023-02-24 18:33:57,056][177158] DAMAGECOUNT value on done: 136228.0 [2023-02-24 18:33:57,057][177158] Sum rewards: 17.094, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.015', 'AMMO2': '0.027', 'weapon7': '0.046', 'WEAPON1': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.101', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'HEALTH': '0.224', 'weapon5': '0.272', 'WEAPON5': '0.400', 'weapon4': '0.478', 'WEAPON3': '0.550', 'HITCOUNT': '0.700', 'weapon2': '1.018', 'weapon3': '1.770', 'DAMAGECOUNT': '3.861', 'FRAGCOUNT': '13.000'} [2023-02-24 18:33:57,364][177158] DAMAGECOUNT value on done: 134865.0 [2023-02-24 18:33:57,365][177158] Sum rewards: 12.254, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.370', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO2': '0.038', 'weapon7': '0.102', 'weapon5': '0.110', 'AMMO3': '0.173', 'AMMO4': '0.188', 'WEAPON4': '0.250', 'AMMO6': '0.260', 'AMMO7': '0.260', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.374', 'WEAPON3': '1.000', 'HITCOUNT': '1.070', 'weapon2': '1.086', 'weapon3': '1.880', 'DAMAGECOUNT': '4.938', 'FRAGCOUNT': '11.000'} [2023-02-24 18:33:58,875][177172] DAMAGECOUNT value on done: 133754.0 [2023-02-24 18:33:58,875][177172] Sum rewards: 12.585, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.990', 'AMMO2': '0.009', 'AMMO5': '0.018', 'WEAPON1': '0.030', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'weapon5': '0.114', 'AMMO3': '0.192', 'weapon4': '0.236', 'weapon2': '0.384', 'WEAPON5': '0.450', 'HITCOUNT': '1.330', 'WEAPON3': '1.400', 'weapon3': '2.850', 'DAMAGECOUNT': '4.665', 'FRAGCOUNT': '15.000'} [2023-02-24 18:33:59,178][177172] DAMAGECOUNT value on done: 132418.0 [2023-02-24 18:33:59,178][177172] Sum rewards: 9.119, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.576', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.090', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.266', 'WEAPON3': '0.300', 'weapon4': '0.418', 'ARMOR': '0.450', 'HITCOUNT': '0.760', 'weapon3': '0.914', 'weapon2': '2.110', 'DAMAGECOUNT': '3.342', 'FRAGCOUNT': '7.000'} [2023-02-24 18:33:59,212][177153] Updated weights for policy 0, policy_version 14560 (0.0008) [2023-02-24 18:34:00,173][177154] DAMAGECOUNT value on done: 139670.0 [2023-02-24 18:34:00,174][177154] Sum rewards: 13.666, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.850', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.040', 'WEAPON1': '0.050', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.129', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.382', 'weapon2': '0.650', 'HITCOUNT': '0.930', 'WEAPON3': '1.000', 'weapon3': '2.518', 'DAMAGECOUNT': '3.705', 'FRAGCOUNT': '15.000'} [2023-02-24 18:34:00,476][177154] DAMAGECOUNT value on done: 139747.0 [2023-02-24 18:34:00,476][177154] Sum rewards: 8.054, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.170', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'weapon7': '0.046', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.141', 'weapon5': '0.144', 'AMMO4': '0.155', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.451', 'weapon4': '0.478', 'HITCOUNT': '0.720', 'WEAPON3': '0.850', 'weapon2': '1.310', 'weapon3': '1.750', 'DAMAGECOUNT': '2.940', 'FRAGCOUNT': '9.000'} [2023-02-24 18:34:00,647][177172] DAMAGECOUNT value on done: 136100.0 [2023-02-24 18:34:00,647][177172] Sum rewards: 14.159, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.078', 'AMMO5': '0.020', 'AMMO2': '0.023', 'WEAPON1': '0.050', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.115', 'weapon4': '0.298', 'weapon5': '0.332', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.920', 'weapon2': '1.328', 'weapon3': '1.720', 'DAMAGECOUNT': '4.731', 'FRAGCOUNT': '10.500'} [2023-02-24 18:34:00,693][177154] DAMAGECOUNT value on done: 138484.0 [2023-02-24 18:34:00,694][177154] Sum rewards: 9.450, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.411', 'AMMO2': '0.016', 'AMMO5': '0.029', 'WEAPON1': '0.060', 'AMMO4': '0.081', 'AMMO3': '0.116', 'weapon5': '0.222', 'WEAPON4': '0.300', 'ARMOR': '0.439', 'weapon4': '0.458', 'WEAPON5': '0.700', 'WEAPON3': '0.750', 'weapon2': '0.824', 'HITCOUNT': '0.930', 'weapon3': '1.910', 'DAMAGECOUNT': '3.525', 'FRAGCOUNT': '9.500'} [2023-02-24 18:34:00,947][177172] DAMAGECOUNT value on done: 136506.0 [2023-02-24 18:34:00,947][177172] Sum rewards: 15.010, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.016', 'ARMOR': '0.008', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon5': '0.030', 'AMMO3': '0.100', 'AMMO4': '0.128', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.536', 'WEAPON3': '0.550', 'weapon4': '0.678', 'HITCOUNT': '1.160', 'weapon3': '1.844', 'DAMAGECOUNT': '4.377', 'FRAGCOUNT': '12.000'} [2023-02-24 18:34:00,983][177154] DAMAGECOUNT value on done: 140712.0 [2023-02-24 18:34:00,984][177154] Sum rewards: 15.000, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.790', 'AMMO2': '0.023', 'AMMO5': '0.030', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO4': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.134', 'weapon5': '0.186', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.546', 'WEAPON5': '0.650', 'weapon2': '0.802', 'WEAPON3': '0.850', 'HITCOUNT': '1.440', 'weapon3': '1.782', 'DAMAGECOUNT': '5.103', 'FRAGCOUNT': '14.000'} [2023-02-24 18:34:01,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 59666432. Throughput: 0: 3476.5. Samples: 14917654. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:34:01,376][177119] Avg episode reward: [(0, '11.250')] [2023-02-24 18:34:01,469][177157] DAMAGECOUNT value on done: 138504.0 [2023-02-24 18:34:01,469][177157] Sum rewards: 19.368, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.414', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.029', 'WEAPON1': '0.050', 'weapon7': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon4': '0.178', 'weapon5': '0.344', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'weapon2': '1.028', 'HITCOUNT': '1.180', 'weapon3': '1.942', 'DAMAGECOUNT': '4.881', 'FRAGCOUNT': '16.000'} [2023-02-24 18:34:01,489][177157] DAMAGECOUNT value on done: 130522.0 [2023-02-24 18:34:01,489][177157] Sum rewards: 5.555, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.699', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon7': '0.060', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.450', 'ARMOR': '0.487', 'HITCOUNT': '0.680', 'weapon4': '0.682', 'WEAPON3': '0.750', 'weapon2': '1.010', 'weapon3': '1.464', 'DAMAGECOUNT': '2.514', 'FRAGCOUNT': '8.000'} [2023-02-24 18:34:01,499][177171] DAMAGECOUNT value on done: 134750.0 [2023-02-24 18:34:01,499][177171] Sum rewards: 9.033, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.147', 'AMMO5': '0.015', 'AMMO2': '0.016', 'AMMO4': '0.081', 'WEAPON1': '0.090', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'weapon4': '0.208', 'weapon5': '0.252', 'WEAPON5': '0.450', 'HITCOUNT': '0.660', 'WEAPON3': '0.750', 'weapon2': '1.332', 'weapon3': '1.798', 'DAMAGECOUNT': '3.768', 'FRAGCOUNT': '8.000'} [2023-02-24 18:34:01,774][177157] DAMAGECOUNT value on done: 133129.0 [2023-02-24 18:34:01,774][177157] Sum rewards: 12.349, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.687', 'AMMO2': '0.012', 'AMMO5': '0.012', 'AMMO4': '0.060', 'weapon7': '0.096', 'WEAPON1': '0.110', 'AMMO3': '0.112', 'weapon5': '0.116', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.396', 'weapon2': '0.564', 'WEAPON3': '0.800', 'HITCOUNT': '0.970', 'weapon3': '1.772', 'DAMAGECOUNT': '3.525', 'FRAGCOUNT': '11.000'} [2023-02-24 18:34:01,792][177157] DAMAGECOUNT value on done: 131939.0 [2023-02-24 18:34:01,793][177157] Sum rewards: 13.515, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.409', 'AMMO5': '0.025', 'AMMO2': '0.037', 'WEAPON1': '0.070', 'weapon5': '0.118', 'AMMO3': '0.153', 'AMMO4': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.450', 'weapon2': '0.458', 'ARMOR': '0.464', 'weapon4': '0.654', 'WEAPON3': '1.000', 'HITCOUNT': '1.190', 'weapon3': '2.358', 'DAMAGECOUNT': '4.314', 'FRAGCOUNT': '13.000'} [2023-02-24 18:34:01,794][177171] DAMAGECOUNT value on done: 137100.0 [2023-02-24 18:34:01,794][177171] Sum rewards: 8.748, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.929', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon7': '0.052', 'AMMO4': '0.077', 'AMMO3': '0.097', 'weapon5': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'ARMOR': '0.483', 'weapon2': '0.556', 'WEAPON3': '0.700', 'weapon4': '0.970', 'HITCOUNT': '1.010', 'weapon3': '1.328', 'DAMAGECOUNT': '3.567', 'FRAGCOUNT': '8.000'} [2023-02-24 18:34:01,806][177171] DAMAGECOUNT value on done: 131175.0 [2023-02-24 18:34:01,807][177171] Sum rewards: 8.930, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.155', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.030', 'AMMO4': '0.056', 'AMMO3': '0.119', 'weapon5': '0.146', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.443', 'weapon4': '0.604', 'WEAPON3': '0.900', 'HITCOUNT': '0.900', 'weapon2': '0.980', 'weapon3': '1.980', 'DAMAGECOUNT': '3.555', 'FRAGCOUNT': '9.000'} [2023-02-24 18:34:02,105][177171] DAMAGECOUNT value on done: 129437.0 [2023-02-24 18:34:02,106][177171] Sum rewards: 9.363, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.000', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.462', 'WEAPON3': '0.800', 'weapon2': '0.858', 'HITCOUNT': '1.040', 'weapon3': '1.640', 'DAMAGECOUNT': '4.377', 'FRAGCOUNT': '8.000'} [2023-02-24 18:34:02,176][177153] Updated weights for policy 0, policy_version 14570 (0.0008) [2023-02-24 18:34:02,756][177155] DAMAGECOUNT value on done: 136867.0 [2023-02-24 18:34:02,757][177155] Sum rewards: 11.137, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.948', 'AMMO5': '0.018', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.098', 'AMMO3': '0.108', 'weapon5': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.654', 'WEAPON3': '0.700', 'HITCOUNT': '0.770', 'weapon2': '0.838', 'weapon3': '1.852', 'DAMAGECOUNT': '3.555', 'FRAGCOUNT': '11.000'} [2023-02-24 18:34:03,059][177155] DAMAGECOUNT value on done: 139434.0 [2023-02-24 18:34:03,060][177155] Sum rewards: 10.928, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.801', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'AMMO3': '0.098', 'AMMO4': '0.161', 'WEAPON4': '0.200', 'weapon5': '0.260', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'weapon4': '0.652', 'HITCOUNT': '0.750', 'weapon2': '1.204', 'weapon3': '1.342', 'DAMAGECOUNT': '3.345', 'FRAGCOUNT': '9.000'} [2023-02-24 18:34:03,509][177155] DAMAGECOUNT value on done: 141906.0 [2023-02-24 18:34:03,510][177155] Sum rewards: 29.383, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.410', 'AMMO5': '0.012', 'AMMO2': '0.036', 'WEAPON1': '0.050', 'weapon5': '0.104', 'AMMO4': '0.179', 'AMMO3': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.390', 'ARMOR': '0.400', 'weapon4': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '1.950', 'weapon3': '2.746', 'DAMAGECOUNT': '8.136', 'FRAGCOUNT': '27.000'} [2023-02-24 18:34:03,807][177155] DAMAGECOUNT value on done: 131673.0 [2023-02-24 18:34:03,808][177155] Sum rewards: 10.910, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.013', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'weapon7': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HEALTH': '0.170', 'weapon5': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.450', 'WEAPON3': '0.500', 'HITCOUNT': '0.570', 'weapon4': '0.686', 'weapon3': '1.644', 'DAMAGECOUNT': '3.300', 'FRAGCOUNT': '9.000'} [2023-02-24 18:34:05,098][177153] Updated weights for policy 0, policy_version 14580 (0.0008) [2023-02-24 18:34:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 59736064. Throughput: 0: 3476.0. Samples: 14928096. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:34:06,376][177119] Avg episode reward: [(0, '11.631')] [2023-02-24 18:34:06,379][177140] Saving new best policy, reward=11.631! [2023-02-24 18:34:08,061][177153] Updated weights for policy 0, policy_version 14590 (0.0009) [2023-02-24 18:34:09,700][177156] DAMAGECOUNT value on done: 132419.0 [2023-02-24 18:34:09,700][177156] Sum rewards: 21.512, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.002', 'AMMO4': '0.008', 'HEALTH': '0.010', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.176', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.208', 'WEAPON3': '0.400', 'HITCOUNT': '1.010', 'weapon2': '1.284', 'weapon3': '1.528', 'DAMAGECOUNT': '4.485', 'FRAGCOUNT': '16.000'} [2023-02-24 18:34:09,857][177156] DAMAGECOUNT value on done: 136222.0 [2023-02-24 18:34:09,857][177156] Sum rewards: 9.744, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.916', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.039', 'weapon5': '0.136', 'AMMO3': '0.151', 'AMMO4': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.526', 'weapon4': '0.732', 'ARMOR': '0.800', 'WEAPON3': '0.950', 'HITCOUNT': '1.140', 'weapon3': '2.168', 'DAMAGECOUNT': '4.779', 'FRAGCOUNT': '9.000'} [2023-02-24 18:34:10,000][177156] DAMAGECOUNT value on done: 136152.0 [2023-02-24 18:34:10,001][177156] Sum rewards: 9.074, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.850', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'weapon5': '0.058', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon7': '0.100', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'HITCOUNT': '0.490', 'WEAPON3': '0.700', 'weapon2': '1.226', 'weapon3': '1.346', 'DAMAGECOUNT': '2.286', 'FRAGCOUNT': '8.000'} [2023-02-24 18:34:10,162][177156] DAMAGECOUNT value on done: 135082.0 [2023-02-24 18:34:10,162][177156] Sum rewards: 20.978, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.831', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO2': '0.032', 'weapon7': '0.096', 'AMMO3': '0.109', 'AMMO4': '0.160', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.280', 'WEAPON7': '0.300', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'ARMOR': '0.800', 'weapon4': '0.848', 'weapon2': '0.890', 'HITCOUNT': '1.310', 'weapon3': '1.488', 'DAMAGECOUNT': '7.614', 'FRAGCOUNT': '18.000'} [2023-02-24 18:34:10,982][177153] Updated weights for policy 0, policy_version 14600 (0.0008) [2023-02-24 18:34:11,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 59805696. Throughput: 0: 3478.0. Samples: 14949056. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:34:11,376][177119] Avg episode reward: [(0, '11.835')] [2023-02-24 18:34:11,376][177140] Saving new best policy, reward=11.835! [2023-02-24 18:34:13,913][177153] Updated weights for policy 0, policy_version 14610 (0.0008) [2023-02-24 18:34:13,975][177170] DAMAGECOUNT value on done: 136435.0 [2023-02-24 18:34:13,976][177170] Sum rewards: 10.329, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.099', 'AMMO2': '0.005', 'AMMO4': '0.022', 'ARMOR': '0.024', 'weapon7': '0.046', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon2': '0.234', 'weapon4': '0.348', 'WEAPON3': '0.950', 'HITCOUNT': '1.140', 'weapon3': '1.674', 'DAMAGECOUNT': '4.260', 'FRAGCOUNT': '12.000'} [2023-02-24 18:34:14,271][177170] DAMAGECOUNT value on done: 143547.0 [2023-02-24 18:34:14,272][177170] Sum rewards: 9.931, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.650', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.024', 'WEAPON1': '0.050', 'weapon7': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.128', 'weapon5': '0.146', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.832', 'HITCOUNT': '0.900', 'WEAPON3': '0.950', 'weapon3': '2.122', 'DAMAGECOUNT': '4.137', 'FRAGCOUNT': '9.000'} [2023-02-24 18:34:14,541][177170] DAMAGECOUNT value on done: 131229.0 [2023-02-24 18:34:14,541][177170] Sum rewards: 10.568, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.855', 'AMMO2': '0.005', 'AMMO5': '0.022', 'AMMO4': '0.023', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'weapon4': '0.316', 'weapon5': '0.354', 'weapon2': '0.394', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'HITCOUNT': '0.920', 'weapon3': '2.160', 'DAMAGECOUNT': '3.732', 'FRAGCOUNT': '11.000'} [2023-02-24 18:34:14,839][177170] DAMAGECOUNT value on done: 135018.0 [2023-02-24 18:34:14,839][177170] Sum rewards: 10.612, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.418', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'ARMOR': '0.016', 'AMMO3': '0.054', 'AMMO4': '0.076', 'weapon5': '0.110', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON3': '0.400', 'weapon4': '0.444', 'HITCOUNT': '0.810', 'weapon3': '1.086', 'weapon2': '1.154', 'DAMAGECOUNT': '3.300', 'FRAGCOUNT': '7.000'} [2023-02-24 18:34:15,444][177158] DAMAGECOUNT value on done: 131655.0 [2023-02-24 18:34:15,445][177158] Sum rewards: 7.919, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.664', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'AMMO3': '0.078', 'weapon7': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.123', 'weapon5': '0.176', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'weapon2': '0.582', 'HITCOUNT': '0.600', 'weapon4': '0.822', 'weapon3': '1.456', 'DAMAGECOUNT': '2.274', 'FRAGCOUNT': '6.000'} [2023-02-24 18:34:15,741][177158] DAMAGECOUNT value on done: 133475.0 [2023-02-24 18:34:15,741][177158] Sum rewards: 16.561, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.720', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon7': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon4': '0.162', 'WEAPON7': '0.200', 'ARMOR': '0.445', 'WEAPON3': '0.700', 'HITCOUNT': '1.070', 'weapon2': '1.390', 'weapon3': '2.070', 'DAMAGECOUNT': '4.461', 'FRAGCOUNT': '13.500'} [2023-02-24 18:34:16,361][177158] DAMAGECOUNT value on done: 137150.0 [2023-02-24 18:34:16,362][177158] Sum rewards: 8.980, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.723', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon7': '0.052', 'weapon5': '0.066', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.270', 'ARMOR': '0.450', 'weapon2': '0.584', 'HITCOUNT': '0.680', 'WEAPON3': '0.800', 'weapon3': '1.930', 'DAMAGECOUNT': '2.766', 'FRAGCOUNT': '9.000'} [2023-02-24 18:34:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 59875328. Throughput: 0: 3478.8. Samples: 14969912. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:34:16,376][177119] Avg episode reward: [(0, '11.749')] [2023-02-24 18:34:16,662][177158] DAMAGECOUNT value on done: 136308.0 [2023-02-24 18:34:16,662][177158] Sum rewards: 10.594, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.770', 'AMMO2': '0.006', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'weapon7': '0.056', 'AMMO3': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.576', 'WEAPON3': '0.600', 'weapon2': '0.972', 'HITCOUNT': '1.020', 'weapon3': '1.614', 'DAMAGECOUNT': '4.329', 'FRAGCOUNT': '9.000'} [2023-02-24 18:34:16,861][177153] Updated weights for policy 0, policy_version 14620 (0.0008) [2023-02-24 18:34:18,186][177172] DAMAGECOUNT value on done: 135429.0 [2023-02-24 18:34:18,186][177172] Sum rewards: 17.943, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.405', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon7': '0.056', 'WEAPON1': '0.060', 'AMMO4': '0.096', 'AMMO3': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.248', 'WEAPON5': '0.350', 'ARMOR': '0.475', 'weapon2': '0.620', 'weapon4': '0.632', 'WEAPON3': '0.850', 'HITCOUNT': '1.070', 'weapon3': '1.832', 'DAMAGECOUNT': '5.025', 'FRAGCOUNT': '14.000'} [2023-02-24 18:34:18,487][177172] DAMAGECOUNT value on done: 134548.0 [2023-02-24 18:34:18,487][177172] Sum rewards: 20.647, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.513', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO2': '0.042', 'weapon7': '0.042', 'AMMO3': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.184', 'WEAPON7': '0.200', 'AMMO4': '0.209', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '0.600', 'weapon4': '0.816', 'weapon2': '0.884', 'HITCOUNT': '1.510', 'weapon3': '1.656', 'DAMAGECOUNT': '6.390', 'FRAGCOUNT': '17.000'} [2023-02-24 18:34:19,423][177154] DAMAGECOUNT value on done: 141134.0 [2023-02-24 18:34:19,424][177154] Sum rewards: 14.586, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.584', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'weapon7': '0.052', 'AMMO3': '0.068', 'AMMO4': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.110', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'weapon4': '0.676', 'weapon3': '1.064', 'HITCOUNT': '1.110', 'weapon2': '1.246', 'DAMAGECOUNT': '4.392', 'FRAGCOUNT': '11.000'} [2023-02-24 18:34:19,722][177154] DAMAGECOUNT value on done: 141534.0 [2023-02-24 18:34:19,722][177154] Sum rewards: 16.092, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.422', 'AMMO5': '0.020', 'AMMO2': '0.024', 'WEAPON1': '0.050', 'AMMO3': '0.078', 'AMMO4': '0.119', 'weapon5': '0.170', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.768', 'weapon4': '1.000', 'weapon3': '1.244', 'HITCOUNT': '1.330', 'DAMAGECOUNT': '5.361', 'FRAGCOUNT': '14.000'} [2023-02-24 18:34:19,771][177153] Updated weights for policy 0, policy_version 14630 (0.0008) [2023-02-24 18:34:19,944][177154] DAMAGECOUNT value on done: 139665.0 [2023-02-24 18:34:19,945][177154] Sum rewards: 13.100, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.004', 'AMMO5': '0.010', 'AMMO2': '0.027', 'WEAPON1': '0.040', 'weapon7': '0.042', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.122', 'AMMO4': '0.132', 'WEAPON7': '0.200', 'weapon5': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.390', 'WEAPON3': '0.850', 'HITCOUNT': '0.910', 'weapon2': '0.912', 'weapon3': '2.094', 'DAMAGECOUNT': '3.543', 'FRAGCOUNT': '12.000'} [2023-02-24 18:34:19,953][177172] DAMAGECOUNT value on done: 136867.0 [2023-02-24 18:34:19,954][177172] Sum rewards: 6.046, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.960', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'ARMOR': '0.025', 'weapon7': '0.054', 'AMMO3': '0.061', 'AMMO4': '0.093', 'weapon5': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.348', 'WEAPON3': '0.400', 'WEAPON4': '0.400', 'HITCOUNT': '0.440', 'weapon4': '0.624', 'weapon3': '0.976', 'DAMAGECOUNT': '2.301', 'FRAGCOUNT': '5.000'} [2023-02-24 18:34:20,241][177154] DAMAGECOUNT value on done: 142316.0 [2023-02-24 18:34:20,242][177154] Sum rewards: 13.464, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.280', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO4': '0.063', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.122', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.252', 'ARMOR': '0.489', 'WEAPON3': '1.050', 'weapon2': '1.266', 'HITCOUNT': '1.380', 'weapon3': '1.780', 'DAMAGECOUNT': '4.812', 'FRAGCOUNT': '14.000'} [2023-02-24 18:34:20,250][177172] DAMAGECOUNT value on done: 138091.0 [2023-02-24 18:34:20,250][177172] Sum rewards: 13.833, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.880', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon7': '0.052', 'AMMO3': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.104', 'weapon5': '0.148', 'weapon2': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.610', 'weapon4': '1.108', 'weapon3': '1.228', 'DAMAGECOUNT': '4.755', 'FRAGCOUNT': '11.000'} [2023-02-24 18:34:20,763][177157] DAMAGECOUNT value on done: 131783.0 [2023-02-24 18:34:20,764][177157] Sum rewards: 14.443, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.128', 'AMMO5': '0.014', 'weapon7': '0.034', 'AMMO2': '0.035', 'WEAPON1': '0.050', 'AMMO3': '0.086', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO4': '0.173', 'WEAPON7': '0.200', 'weapon5': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'weapon2': '0.650', 'weapon4': '0.676', 'HITCOUNT': '0.910', 'weapon3': '1.622', 'DAMAGECOUNT': '3.783', 'FRAGCOUNT': '11.000'} [2023-02-24 18:34:20,775][177157] DAMAGECOUNT value on done: 139777.0 [2023-02-24 18:34:20,775][177157] Sum rewards: 11.655, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.554', 'AMMO5': '0.015', 'AMMO2': '0.023', 'WEAPON1': '0.070', 'AMMO3': '0.081', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'weapon5': '0.206', 'weapon4': '0.340', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.850', 'weapon2': '1.082', 'weapon3': '1.860', 'DAMAGECOUNT': '3.819', 'FRAGCOUNT': '9.000'} [2023-02-24 18:34:20,805][177171] DAMAGECOUNT value on done: 135665.0 [2023-02-24 18:34:20,805][177171] Sum rewards: 9.601, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.045', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.016', 'WEAPON1': '0.020', 'weapon7': '0.052', 'AMMO3': '0.085', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.158', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.322', 'weapon2': '0.588', 'WEAPON3': '0.600', 'HITCOUNT': '0.720', 'weapon3': '1.484', 'DAMAGECOUNT': '2.745', 'FRAGCOUNT': '9.000'} [2023-02-24 18:34:21,069][177157] DAMAGECOUNT value on done: 133647.0 [2023-02-24 18:34:21,070][177157] Sum rewards: 15.809, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.575', 'AMMO2': '0.009', 'AMMO5': '0.017', 'AMMO4': '0.046', 'weapon7': '0.048', 'WEAPON1': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'weapon5': '0.218', 'weapon4': '0.246', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON5': '0.500', 'weapon2': '0.830', 'WEAPON3': '0.850', 'HITCOUNT': '1.170', 'weapon3': '2.126', 'DAMAGECOUNT': '5.124', 'FRAGCOUNT': '12.500'} [2023-02-24 18:34:21,079][177157] DAMAGECOUNT value on done: 135083.0 [2023-02-24 18:34:21,080][177157] Sum rewards: 19.458, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.005', 'ARMOR': '0.004', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO2': '0.043', 'AMMO3': '0.105', 'AMMO4': '0.216', 'weapon5': '0.226', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '0.550', 'weapon3': '0.932', 'weapon2': '1.060', 'weapon4': '1.120', 'HITCOUNT': '1.150', 'DAMAGECOUNT': '5.862', 'FRAGCOUNT': '15.000'} [2023-02-24 18:34:21,103][177171] DAMAGECOUNT value on done: 132209.0 [2023-02-24 18:34:21,103][177171] Sum rewards: 12.756, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.770', 'AMMO5': '0.015', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'weapon7': '0.044', 'AMMO3': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.129', 'WEAPON7': '0.200', 'weapon5': '0.204', 'WEAPON4': '0.250', 'weapon4': '0.310', 'ARMOR': '0.412', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'HITCOUNT': '0.830', 'weapon2': '1.482', 'weapon3': '1.714', 'DAMAGECOUNT': '3.102', 'FRAGCOUNT': '11.000'} [2023-02-24 18:34:21,112][177171] DAMAGECOUNT value on done: 138846.0 [2023-02-24 18:34:21,113][177171] Sum rewards: 15.144, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.620', 'AMMO5': '0.015', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'weapon5': '0.100', 'AMMO3': '0.114', 'AMMO4': '0.116', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.366', 'weapon2': '0.626', 'WEAPON3': '0.900', 'HITCOUNT': '1.250', 'weapon3': '2.376', 'DAMAGECOUNT': '5.238', 'FRAGCOUNT': '14.000'} [2023-02-24 18:34:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 59944960. Throughput: 0: 3479.0. Samples: 14980372. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:34:21,376][177119] Avg episode reward: [(0, '12.106')] [2023-02-24 18:34:21,376][177140] Saving new best policy, reward=12.106! [2023-02-24 18:34:21,415][177171] DAMAGECOUNT value on done: 131060.0 [2023-02-24 18:34:21,416][177171] Sum rewards: 13.264, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.420', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon5': '0.040', 'AMMO4': '0.116', 'AMMO3': '0.131', 'WEAPON5': '0.250', 'ARMOR': '0.425', 'weapon2': '0.436', 'WEAPON4': '0.450', 'weapon4': '0.840', 'WEAPON3': '0.900', 'HITCOUNT': '1.330', 'weapon3': '2.092', 'DAMAGECOUNT': '4.869', 'FRAGCOUNT': '12.500'} [2023-02-24 18:34:21,450][177170] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:34:22,121][177155] DAMAGECOUNT value on done: 137578.0 [2023-02-24 18:34:22,121][177155] Sum rewards: 4.062, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.191', 'ARMOR': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.033', 'weapon5': '0.088', 'AMMO3': '0.093', 'weapon7': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON4': '0.500', 'HITCOUNT': '0.590', 'WEAPON3': '0.650', 'weapon2': '0.650', 'weapon4': '0.820', 'weapon3': '1.380', 'DAMAGECOUNT': '2.133', 'FRAGCOUNT': '7.000'} [2023-02-24 18:34:22,161][177154] Large shaping reward 2.617 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.585, 195.0), ('weapon7', 0.002)] [2023-02-24 18:34:22,419][177155] DAMAGECOUNT value on done: 140290.0 [2023-02-24 18:34:22,420][177155] Sum rewards: 13.263, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.314', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO2': '0.039', 'AMMO3': '0.069', 'weapon5': '0.162', 'AMMO4': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.374', 'WEAPON3': '0.450', 'HITCOUNT': '0.740', 'weapon3': '1.230', 'weapon2': '1.514', 'DAMAGECOUNT': '2.568', 'FRAGCOUNT': '11.000'} [2023-02-24 18:34:22,731][177153] Updated weights for policy 0, policy_version 14640 (0.0008) [2023-02-24 18:34:22,880][177155] DAMAGECOUNT value on done: 143666.0 [2023-02-24 18:34:22,880][177155] Sum rewards: 14.113, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.108', 'weapon7': '0.002', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon5': '0.072', 'AMMO4': '0.124', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.436', 'weapon4': '0.620', 'ARMOR': '0.865', 'HITCOUNT': '1.250', 'WEAPON3': '1.400', 'weapon3': '2.458', 'DAMAGECOUNT': '5.280', 'FRAGCOUNT': '16.000'} [2023-02-24 18:34:23,177][177155] DAMAGECOUNT value on done: 132982.0 [2023-02-24 18:34:23,177][177155] Sum rewards: 12.545, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.616', 'AMMO5': '0.012', 'AMMO2': '0.035', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO3': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.138', 'AMMO4': '0.176', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.498', 'WEAPON4': '0.550', 'WEAPON3': '0.600', 'HITCOUNT': '1.000', 'weapon3': '1.096', 'weapon4': '1.154', 'DAMAGECOUNT': '3.927', 'FRAGCOUNT': '13.000'} [2023-02-24 18:34:25,670][177153] Updated weights for policy 0, policy_version 14650 (0.0008) [2023-02-24 18:34:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 60014592. Throughput: 0: 3477.6. Samples: 15001232. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:34:26,376][177119] Avg episode reward: [(0, '12.208')] [2023-02-24 18:34:26,380][177140] Saving new best policy, reward=12.208! [2023-02-24 18:34:28,628][177153] Updated weights for policy 0, policy_version 14660 (0.0008) [2023-02-24 18:34:29,035][177156] DAMAGECOUNT value on done: 133624.0 [2023-02-24 18:34:29,035][177156] Sum rewards: 12.868, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.415', 'AMMO5': '0.007', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'AMMO3': '0.097', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'weapon5': '0.166', 'WEAPON5': '0.200', 'weapon4': '0.404', 'WEAPON3': '0.650', 'weapon2': '0.866', 'HITCOUNT': '1.020', 'weapon3': '1.930', 'DAMAGECOUNT': '3.615', 'FRAGCOUNT': '10.000'} [2023-02-24 18:34:29,196][177156] DAMAGECOUNT value on done: 136944.0 [2023-02-24 18:34:29,197][177156] Sum rewards: 1.419, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.758', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'WEAPON1': '0.070', 'weapon4': '0.148', 'AMMO3': '0.156', 'weapon5': '0.208', 'WEAPON5': '0.300', 'HITCOUNT': '0.590', 'weapon2': '0.886', 'WEAPON3': '0.900', 'DAMAGECOUNT': '2.166', 'weapon3': '2.376', 'FRAGCOUNT': '4.000'} [2023-02-24 18:34:29,344][177156] DAMAGECOUNT value on done: 136507.0 [2023-02-24 18:34:29,345][177156] Sum rewards: 1.302, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.400', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon7': '0.048', 'weapon5': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.100', 'AMMO3': '0.128', 'WEAPON5': '0.250', 'HITCOUNT': '0.310', 'weapon4': '0.492', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.065', 'weapon2': '1.286', 'weapon3': '1.608', 'FRAGCOUNT': '2.000'} [2023-02-24 18:34:29,500][177156] DAMAGECOUNT value on done: 137060.0 [2023-02-24 18:34:29,501][177156] Sum rewards: 15.389, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.814', 'AMMO2': '0.004', 'AMMO5': '0.018', 'AMMO4': '0.020', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.124', 'weapon4': '0.146', 'AMMO3': '0.170', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'weapon2': '1.204', 'HITCOUNT': '1.250', 'weapon3': '2.184', 'DAMAGECOUNT': '5.934', 'FRAGCOUNT': '14.000'} [2023-02-24 18:34:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 60084224. Throughput: 0: 3479.4. Samples: 15022192. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:34:31,376][177119] Avg episode reward: [(0, '12.086')] [2023-02-24 18:34:31,538][177153] Updated weights for policy 0, policy_version 14670 (0.0008) [2023-02-24 18:34:33,136][177170] DAMAGECOUNT value on done: 137137.0 [2023-02-24 18:34:33,136][177170] Sum rewards: 7.130, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.164', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'AMMO2': '0.034', 'AMMO3': '0.093', 'weapon7': '0.102', 'weapon5': '0.136', 'AMMO4': '0.169', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.320', 'WEAPON5': '0.350', 'HITCOUNT': '0.460', 'WEAPON3': '0.600', 'weapon4': '0.758', 'weapon3': '0.960', 'DAMAGECOUNT': '2.106', 'FRAGCOUNT': '8.000'} [2023-02-24 18:34:33,437][177170] DAMAGECOUNT value on done: 145405.0 [2023-02-24 18:34:33,437][177170] Sum rewards: 10.960, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.142', 'AMMO5': '0.015', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'weapon7': '0.108', 'AMMO3': '0.122', 'AMMO4': '0.122', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.626', 'weapon4': '0.714', 'WEAPON3': '0.850', 'HITCOUNT': '0.910', 'ARMOR': '0.912', 'weapon3': '1.966', 'DAMAGECOUNT': '4.674', 'FRAGCOUNT': '10.000'} [2023-02-24 18:34:33,712][177170] DAMAGECOUNT value on done: 133003.0 [2023-02-24 18:34:33,713][177170] Sum rewards: 17.455, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.075', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON1': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.096', 'weapon7': '0.098', 'WEAPON4': '0.200', 'weapon5': '0.232', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.300', 'WEAPON7': '0.400', 'ARMOR': '0.453', 'weapon4': '0.548', 'WEAPON3': '0.650', 'weapon2': '0.792', 'HITCOUNT': '0.840', 'weapon3': '1.542', 'DAMAGECOUNT': '5.022', 'FRAGCOUNT': '12.000'} [2023-02-24 18:34:34,012][177170] DAMAGECOUNT value on done: 136408.0 [2023-02-24 18:34:34,013][177170] Sum rewards: 7.182, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.702', 'AMMO2': '0.018', 'AMMO5': '0.020', 'WEAPON1': '0.050', 'AMMO4': '0.091', 'AMMO3': '0.177', 'weapon5': '0.180', 'WEAPON4': '0.200', 'ARMOR': '0.449', 'weapon4': '0.522', 'WEAPON5': '0.550', 'weapon2': '0.874', 'HITCOUNT': '1.040', 'WEAPON3': '1.150', 'weapon3': '1.892', 'DAMAGECOUNT': '4.170', 'FRAGCOUNT': '8.000'} [2023-02-24 18:34:34,464][177153] Updated weights for policy 0, policy_version 14680 (0.0009) [2023-02-24 18:34:34,707][177158] DAMAGECOUNT value on done: 133488.0 [2023-02-24 18:34:34,708][177158] Sum rewards: 22.524, reward structure: {'DEATHCOUNT': '-7.500', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.023', 'weapon7': '0.052', 'WEAPON1': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.101', 'AMMO4': '0.115', 'WEAPON4': '0.200', 'weapon5': '0.230', 'WEAPON5': '0.350', 'weapon4': '0.460', 'HEALTH': '0.480', 'WEAPON3': '0.650', 'weapon2': '0.890', 'HITCOUNT': '1.050', 'weapon3': '2.042', 'DAMAGECOUNT': '5.499', 'FRAGCOUNT': '17.500'} [2023-02-24 18:34:35,006][177158] DAMAGECOUNT value on done: 134679.0 [2023-02-24 18:34:35,007][177158] Sum rewards: 13.020, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.986', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon5': '0.030', 'AMMO3': '0.074', 'AMMO4': '0.076', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'WEAPON3': '0.550', 'weapon2': '0.828', 'weapon4': '0.912', 'HITCOUNT': '1.010', 'weapon3': '1.388', 'DAMAGECOUNT': '3.612', 'FRAGCOUNT': '11.000'} [2023-02-24 18:34:35,643][177158] DAMAGECOUNT value on done: 139428.0 [2023-02-24 18:34:35,643][177158] Sum rewards: 14.869, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.790', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'weapon7': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'weapon5': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.140', 'weapon4': '0.146', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.900', 'HITCOUNT': '0.980', 'weapon2': '1.190', 'weapon3': '2.166', 'DAMAGECOUNT': '5.334', 'FRAGCOUNT': '12.000'} [2023-02-24 18:34:35,931][177158] DAMAGECOUNT value on done: 137633.0 [2023-02-24 18:34:35,931][177158] Sum rewards: 11.069, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.650', 'AMMO5': '0.020', 'AMMO2': '0.020', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.130', 'weapon4': '0.156', 'weapon5': '0.202', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '0.890', 'weapon2': '1.058', 'weapon3': '2.246', 'DAMAGECOUNT': '3.975', 'FRAGCOUNT': '10.000'} [2023-02-24 18:34:36,376][177119] Fps is (10 sec: 13926.2, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 60153856. Throughput: 0: 3480.1. Samples: 15032638. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:34:36,376][177119] Avg episode reward: [(0, '12.209')] [2023-02-24 18:34:36,380][177140] Saving new best policy, reward=12.209! [2023-02-24 18:34:37,437][177153] Updated weights for policy 0, policy_version 14690 (0.0008) [2023-02-24 18:34:37,453][177172] DAMAGECOUNT value on done: 136471.0 [2023-02-24 18:34:37,454][177172] Sum rewards: 7.528, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.225', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'AMMO3': '0.053', 'weapon5': '0.094', 'weapon7': '0.130', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon2': '0.280', 'WEAPON3': '0.350', 'WEAPON7': '0.400', 'WEAPON4': '0.500', 'HITCOUNT': '0.720', 'weapon3': '0.936', 'weapon4': '1.094', 'DAMAGECOUNT': '3.126', 'FRAGCOUNT': '7.000'} [2023-02-24 18:34:37,760][177172] DAMAGECOUNT value on done: 136352.0 [2023-02-24 18:34:37,760][177172] Sum rewards: 16.918, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.490', 'AMMO5': '0.018', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'weapon7': '0.070', 'AMMO4': '0.091', 'AMMO3': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.254', 'WEAPON5': '0.450', 'weapon4': '0.566', 'weapon2': '0.702', 'WEAPON3': '0.750', 'HITCOUNT': '1.110', 'weapon3': '1.894', 'DAMAGECOUNT': '5.412', 'FRAGCOUNT': '13.000'} [2023-02-24 18:34:38,762][177154] DAMAGECOUNT value on done: 143009.0 [2023-02-24 18:34:38,763][177154] Sum rewards: 17.895, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.680', 'AMMO5': '0.013', 'AMMO2': '0.019', 'weapon5': '0.046', 'AMMO4': '0.094', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'weapon4': '0.154', 'WEAPON5': '0.200', 'WEAPON3': '1.000', 'weapon2': '1.374', 'HITCOUNT': '1.460', 'weapon3': '2.252', 'DAMAGECOUNT': '5.625', 'FRAGCOUNT': '16.500'} [2023-02-24 18:34:39,068][177154] DAMAGECOUNT value on done: 143243.0 [2023-02-24 18:34:39,069][177154] Sum rewards: 14.708, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.526', 'AMMO5': '0.013', 'AMMO2': '0.014', 'weapon5': '0.034', 'WEAPON1': '0.040', 'AMMO4': '0.072', 'weapon7': '0.100', 'AMMO3': '0.135', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'weapon4': '0.256', 'WEAPON7': '0.300', 'WEAPON3': '0.800', 'HITCOUNT': '1.070', 'weapon2': '1.214', 'weapon3': '1.964', 'DAMAGECOUNT': '5.082', 'FRAGCOUNT': '14.000'} [2023-02-24 18:34:39,217][177172] DAMAGECOUNT value on done: 138007.0 [2023-02-24 18:34:39,218][177172] Sum rewards: 7.648, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.020', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'AMMO4': '0.079', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'weapon5': '0.180', 'weapon4': '0.182', 'WEAPON5': '0.250', 'HITCOUNT': '0.840', 'WEAPON3': '0.900', 'weapon2': '0.996', 'weapon3': '2.218', 'DAMAGECOUNT': '3.420', 'FRAGCOUNT': '9.000'} [2023-02-24 18:34:39,293][177154] DAMAGECOUNT value on done: 141193.0 [2023-02-24 18:34:39,294][177154] Sum rewards: 13.431, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.456', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO4': '0.079', 'AMMO3': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.148', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.448', 'WEAPON3': '0.600', 'weapon4': '0.692', 'HITCOUNT': '1.130', 'weapon3': '1.914', 'DAMAGECOUNT': '4.584', 'FRAGCOUNT': '12.000'} [2023-02-24 18:34:39,522][177172] DAMAGECOUNT value on done: 139809.0 [2023-02-24 18:34:39,522][177172] Sum rewards: 15.961, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.607', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon7': '0.062', 'AMMO3': '0.087', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.142', 'WEAPON7': '0.200', 'weapon5': '0.288', 'WEAPON4': '0.350', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'weapon4': '0.718', 'HITCOUNT': '0.990', 'weapon2': '1.020', 'weapon3': '1.550', 'DAMAGECOUNT': '5.154', 'FRAGCOUNT': '13.000'} [2023-02-24 18:34:39,595][177154] DAMAGECOUNT value on done: 142826.0 [2023-02-24 18:34:39,596][177154] Sum rewards: 5.525, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.285', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'AMMO3': '0.051', 'weapon7': '0.102', 'weapon5': '0.110', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'HITCOUNT': '0.420', 'weapon4': '0.468', 'WEAPON3': '0.500', 'weapon2': '1.134', 'weapon3': '1.184', 'DAMAGECOUNT': '1.530', 'FRAGCOUNT': '3.000'} [2023-02-24 18:34:40,118][177157] DAMAGECOUNT value on done: 133135.0 [2023-02-24 18:34:40,119][177157] Sum rewards: 18.256, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.410', 'AMMO5': '0.010', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'weapon5': '0.118', 'weapon4': '0.120', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'WEAPON3': '0.650', 'HITCOUNT': '0.960', 'weapon3': '1.714', 'weapon2': '1.840', 'DAMAGECOUNT': '4.056', 'FRAGCOUNT': '15.000'} [2023-02-24 18:34:40,130][177157] DAMAGECOUNT value on done: 141319.0 [2023-02-24 18:34:40,130][177157] Sum rewards: 10.165, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.200', 'ARMOR': '0.012', 'AMMO5': '0.022', 'AMMO2': '0.041', 'WEAPON1': '0.050', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.120', 'weapon5': '0.158', 'AMMO4': '0.204', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.728', 'WEAPON3': '0.750', 'weapon4': '1.020', 'HITCOUNT': '1.140', 'weapon3': '1.538', 'DAMAGECOUNT': '4.626', 'FRAGCOUNT': '8.000'} [2023-02-24 18:34:40,231][177171] DAMAGECOUNT value on done: 136743.0 [2023-02-24 18:34:40,232][177171] Sum rewards: 11.394, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.402', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.025', 'AMMO3': '0.084', 'AMMO4': '0.127', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.268', 'weapon4': '0.334', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.920', 'weapon2': '1.292', 'weapon3': '1.784', 'DAMAGECOUNT': '3.234', 'FRAGCOUNT': '8.000'} [2023-02-24 18:34:40,395][177153] Updated weights for policy 0, policy_version 14700 (0.0008) [2023-02-24 18:34:40,430][177157] DAMAGECOUNT value on done: 134777.0 [2023-02-24 18:34:40,431][177157] Sum rewards: 11.204, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.080', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'weapon5': '0.114', 'AMMO4': '0.148', 'WEAPON4': '0.400', 'weapon2': '0.682', 'WEAPON3': '0.700', 'ARMOR': '0.861', 'HITCOUNT': '0.940', 'weapon4': '1.080', 'weapon3': '1.722', 'DAMAGECOUNT': '3.390', 'FRAGCOUNT': '11.000'} [2023-02-24 18:34:40,442][177157] DAMAGECOUNT value on done: 135642.0 [2023-02-24 18:34:40,442][177157] Sum rewards: 8.710, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.950', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'weapon5': '0.058', 'AMMO3': '0.070', 'weapon7': '0.070', 'weapon4': '0.078', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO6': '0.260', 'AMMO7': '0.260', 'WEAPON7': '0.300', 'HITCOUNT': '0.440', 'WEAPON3': '0.500', 'weapon3': '1.196', 'weapon2': '1.644', 'DAMAGECOUNT': '1.677', 'FRAGCOUNT': '7.000'} [2023-02-24 18:34:40,531][177171] DAMAGECOUNT value on done: 133897.0 [2023-02-24 18:34:40,532][177171] Sum rewards: 16.915, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.610', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.036', 'AMMO3': '0.070', 'weapon7': '0.114', 'AMMO4': '0.179', 'weapon5': '0.208', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.500', 'weapon4': '0.658', 'HITCOUNT': '0.960', 'weapon2': '1.116', 'weapon3': '1.590', 'DAMAGECOUNT': '5.064', 'FRAGCOUNT': '12.500'} [2023-02-24 18:34:40,541][177171] DAMAGECOUNT value on done: 140361.0 [2023-02-24 18:34:40,541][177171] Sum rewards: 11.513, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.523', 'AMMO2': '0.021', 'AMMO5': '0.027', 'WEAPON1': '0.030', 'AMMO4': '0.105', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'weapon5': '0.156', 'weapon4': '0.440', 'ARMOR': '0.497', 'WEAPON5': '0.550', 'weapon2': '0.640', 'WEAPON3': '1.000', 'HITCOUNT': '1.130', 'weapon3': '2.356', 'DAMAGECOUNT': '4.545', 'FRAGCOUNT': '11.000'} [2023-02-24 18:34:40,840][177171] DAMAGECOUNT value on done: 132095.0 [2023-02-24 18:34:40,840][177171] Sum rewards: 7.034, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.894', 'weapon7': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.039', 'WEAPON1': '0.050', 'weapon5': '0.092', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.152', 'AMMO3': '0.181', 'AMMO4': '0.197', 'WEAPON5': '0.400', 'HITCOUNT': '0.870', 'weapon2': '0.952', 'WEAPON3': '1.200', 'weapon3': '2.462', 'DAMAGECOUNT': '3.105', 'FRAGCOUNT': '10.000'} [2023-02-24 18:34:41,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 60223488. Throughput: 0: 3478.1. Samples: 15053416. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:34:41,376][177119] Avg episode reward: [(0, '12.416')] [2023-02-24 18:34:41,377][177140] Saving new best policy, reward=12.416! [2023-02-24 18:34:41,456][177155] DAMAGECOUNT value on done: 139178.0 [2023-02-24 18:34:41,456][177155] Sum rewards: 14.523, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.770', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.047', 'weapon5': '0.106', 'AMMO3': '0.123', 'AMMO4': '0.233', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'ARMOR': '0.408', 'weapon2': '0.538', 'weapon4': '0.816', 'WEAPON3': '0.850', 'HITCOUNT': '1.060', 'weapon3': '2.024', 'DAMAGECOUNT': '4.800', 'FRAGCOUNT': '14.000'} [2023-02-24 18:34:41,754][177155] DAMAGECOUNT value on done: 141804.0 [2023-02-24 18:34:41,755][177155] Sum rewards: 11.766, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.230', 'ARMOR': '0.004', 'AMMO2': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'weapon7': '0.052', 'weapon5': '0.058', 'AMMO4': '0.058', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.155', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.306', 'weapon2': '0.764', 'HITCOUNT': '1.040', 'WEAPON3': '1.100', 'weapon3': '2.470', 'DAMAGECOUNT': '4.542', 'FRAGCOUNT': '13.000'} [2023-02-24 18:34:42,226][177155] DAMAGECOUNT value on done: 144653.0 [2023-02-24 18:34:42,227][177155] Sum rewards: 10.112, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.580', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.040', 'AMMO3': '0.047', 'WEAPON5': '0.100', 'weapon7': '0.108', 'weapon5': '0.164', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.300', 'WEAPON7': '0.400', 'HITCOUNT': '0.520', 'weapon4': '0.542', 'weapon2': '0.762', 'weapon3': '0.792', 'DAMAGECOUNT': '2.961', 'FRAGCOUNT': '7.000'} [2023-02-24 18:34:42,533][177155] DAMAGECOUNT value on done: 134655.0 [2023-02-24 18:34:42,533][177155] Sum rewards: 18.153, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.380', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon7': '0.062', 'AMMO3': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.159', 'weapon5': '0.226', 'WEAPON4': '0.300', 'weapon4': '0.342', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '1.070', 'weapon2': '1.372', 'weapon3': '1.638', 'DAMAGECOUNT': '5.019', 'FRAGCOUNT': '13.000'} [2023-02-24 18:34:42,622][177155] Large shaping reward 2.541 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.519, 173.0), ('weapon7', 0.002)] [2023-02-24 18:34:43,327][177153] Updated weights for policy 0, policy_version 14710 (0.0008) [2023-02-24 18:34:46,222][177153] Updated weights for policy 0, policy_version 14720 (0.0008) [2023-02-24 18:34:46,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 60293120. Throughput: 0: 3482.7. Samples: 15074374. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:34:46,376][177119] Avg episode reward: [(0, '12.335')] [2023-02-24 18:34:48,348][177156] DAMAGECOUNT value on done: 135680.0 [2023-02-24 18:34:48,348][177156] Sum rewards: 14.949, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.263', 'AMMO5': '0.012', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon7': '0.058', 'AMMO4': '0.093', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.123', 'weapon5': '0.128', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.602', 'WEAPON3': '0.850', 'weapon2': '0.854', 'HITCOUNT': '1.450', 'weapon3': '1.844', 'DAMAGECOUNT': '6.168', 'FRAGCOUNT': '13.000'} [2023-02-24 18:34:48,494][177156] DAMAGECOUNT value on done: 137283.0 [2023-02-24 18:34:48,495][177156] Sum rewards: 1.575, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.630', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO3': '0.039', 'AMMO4': '0.051', 'weapon7': '0.052', 'weapon5': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.200', 'weapon2': '0.230', 'WEAPON3': '0.250', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon3': '0.456', 'weapon4': '0.596', 'DAMAGECOUNT': '1.017', 'FRAGCOUNT': '2.000'} [2023-02-24 18:34:48,663][177156] DAMAGECOUNT value on done: 137930.0 [2023-02-24 18:34:48,664][177156] Sum rewards: 15.933, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.986', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon7': '0.046', 'WEAPON1': '0.050', 'AMMO3': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.178', 'AMMO4': '0.193', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon4': '0.690', 'WEAPON3': '0.700', 'weapon2': '0.704', 'HITCOUNT': '1.160', 'weapon3': '1.926', 'DAMAGECOUNT': '4.269', 'FRAGCOUNT': '13.000'} [2023-02-24 18:34:48,806][177156] DAMAGECOUNT value on done: 137925.0 [2023-02-24 18:34:48,807][177156] Sum rewards: 10.234, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.945', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon7': '0.068', 'AMMO3': '0.073', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.444', 'ARMOR': '0.466', 'WEAPON3': '0.500', 'HITCOUNT': '0.740', 'weapon2': '0.850', 'weapon3': '1.478', 'DAMAGECOUNT': '2.595', 'FRAGCOUNT': '9.000'} [2023-02-24 18:34:49,174][177153] Updated weights for policy 0, policy_version 14730 (0.0008) [2023-02-24 18:34:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 60362752. Throughput: 0: 3482.7. Samples: 15084816. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:34:51,376][177119] Avg episode reward: [(0, '12.375')] [2023-02-24 18:34:51,713][177172] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 18:34:52,087][177153] Updated weights for policy 0, policy_version 14740 (0.0008) [2023-02-24 18:34:52,360][177170] DAMAGECOUNT value on done: 138580.0 [2023-02-24 18:34:52,361][177170] Sum rewards: 13.059, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.735', 'AMMO2': '0.002', 'ARMOR': '0.008', 'AMMO4': '0.010', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'weapon7': '0.052', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.210', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'HITCOUNT': '0.990', 'weapon2': '1.476', 'weapon3': '1.908', 'DAMAGECOUNT': '4.329', 'FRAGCOUNT': '12.000'} [2023-02-24 18:34:52,671][177170] DAMAGECOUNT value on done: 146409.0 [2023-02-24 18:34:52,671][177170] Sum rewards: 9.795, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.315', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.079', 'AMMO3': '0.083', 'weapon7': '0.128', 'WEAPON4': '0.150', 'weapon5': '0.154', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.500', 'weapon2': '0.514', 'HITCOUNT': '0.520', 'weapon4': '0.546', 'weapon3': '1.386', 'DAMAGECOUNT': '3.012', 'FRAGCOUNT': '8.000'} [2023-02-24 18:34:52,944][177170] DAMAGECOUNT value on done: 134183.0 [2023-02-24 18:34:52,945][177170] Sum rewards: 8.958, reward structure: {'DEATHCOUNT': '-6.750', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'HEALTH': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.079', 'AMMO3': '0.096', 'weapon5': '0.102', 'weapon7': '0.106', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.318', 'WEAPON3': '0.500', 'HITCOUNT': '0.640', 'weapon2': '0.888', 'weapon3': '1.366', 'DAMAGECOUNT': '3.540', 'FRAGCOUNT': '7.000'} [2023-02-24 18:34:53,239][177170] DAMAGECOUNT value on done: 137592.0 [2023-02-24 18:34:53,239][177170] Sum rewards: 13.393, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.700', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.085', 'AMMO4': '0.106', 'weapon5': '0.138', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.454', 'WEAPON3': '0.500', 'weapon4': '0.784', 'HITCOUNT': '0.890', 'weapon3': '1.118', 'weapon2': '1.664', 'DAMAGECOUNT': '3.552', 'FRAGCOUNT': '11.000'} [2023-02-24 18:34:53,966][177158] DAMAGECOUNT value on done: 134488.0 [2023-02-24 18:34:53,967][177158] Sum rewards: 6.081, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.942', 'AMMO2': '0.022', 'AMMO5': '0.027', 'WEAPON1': '0.050', 'AMMO4': '0.108', 'AMMO3': '0.117', 'WEAPON4': '0.200', 'weapon5': '0.296', 'weapon4': '0.336', 'WEAPON5': '0.500', 'HITCOUNT': '0.580', 'WEAPON3': '0.800', 'weapon2': '0.976', 'weapon3': '2.010', 'DAMAGECOUNT': '3.000', 'FRAGCOUNT': '7.000'} [2023-02-24 18:34:54,267][177158] DAMAGECOUNT value on done: 135524.0 [2023-02-24 18:34:54,267][177158] Sum rewards: 7.957, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.050', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'weapon5': '0.134', 'AMMO4': '0.160', 'WEAPON4': '0.250', 'weapon4': '0.414', 'WEAPON3': '0.600', 'HITCOUNT': '0.770', 'weapon2': '1.444', 'weapon3': '1.700', 'DAMAGECOUNT': '2.535', 'FRAGCOUNT': '9.000'} [2023-02-24 18:34:54,905][177158] DAMAGECOUNT value on done: 140946.0 [2023-02-24 18:34:54,906][177158] Sum rewards: 10.813, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.817', 'AMMO2': '0.017', 'AMMO5': '0.020', 'ARMOR': '0.024', 'AMMO4': '0.084', 'weapon5': '0.132', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'weapon4': '0.498', 'weapon2': '0.682', 'WEAPON3': '1.000', 'HITCOUNT': '1.110', 'weapon3': '2.172', 'DAMAGECOUNT': '4.554', 'FRAGCOUNT': '11.500'} [2023-02-24 18:34:55,035][177153] Updated weights for policy 0, policy_version 14750 (0.0008) [2023-02-24 18:34:55,209][177158] DAMAGECOUNT value on done: 138593.0 [2023-02-24 18:34:55,209][177158] Sum rewards: 8.527, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.353', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.050', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'weapon4': '0.222', 'weapon5': '0.230', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'HITCOUNT': '0.750', 'weapon3': '1.420', 'weapon2': '1.750', 'DAMAGECOUNT': '2.880', 'FRAGCOUNT': '8.000'} [2023-02-24 18:34:56,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 60432384. Throughput: 0: 3481.8. Samples: 15105736. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 18:34:56,376][177119] Avg episode reward: [(0, '12.318')] [2023-02-24 18:34:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000014754_60432384.pth... [2023-02-24 18:34:56,436][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000013937_57085952.pth [2023-02-24 18:34:56,813][177172] DAMAGECOUNT value on done: 137802.0 [2023-02-24 18:34:56,814][177172] Sum rewards: 8.303, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.068', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.023', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO3': '0.083', 'AMMO4': '0.114', 'weapon5': '0.234', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.570', 'WEAPON5': '0.600', 'weapon4': '0.642', 'weapon2': '0.954', 'weapon3': '1.510', 'DAMAGECOUNT': '3.966', 'FRAGCOUNT': '8.000'} [2023-02-24 18:34:57,110][177172] DAMAGECOUNT value on done: 138666.0 [2023-02-24 18:34:57,111][177172] Sum rewards: 18.544, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.160', 'AMMO5': '0.015', 'ARMOR': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.122', 'AMMO4': '0.124', 'weapon5': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.434', 'WEAPON3': '0.800', 'weapon2': '1.010', 'HITCOUNT': '1.760', 'weapon3': '2.070', 'DAMAGECOUNT': '6.942', 'FRAGCOUNT': '15.000'} [2023-02-24 18:34:57,987][177153] Updated weights for policy 0, policy_version 14760 (0.0008) [2023-02-24 18:34:58,041][177154] DAMAGECOUNT value on done: 144554.0 [2023-02-24 18:34:58,042][177154] Sum rewards: 12.952, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.095', 'weapon7': '0.106', 'AMMO3': '0.132', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'weapon4': '0.480', 'HEALTH': '0.560', 'weapon2': '0.632', 'WEAPON3': '0.700', 'HITCOUNT': '1.220', 'weapon3': '2.296', 'DAMAGECOUNT': '4.635', 'FRAGCOUNT': '11.500'} [2023-02-24 18:34:58,340][177154] DAMAGECOUNT value on done: 144777.0 [2023-02-24 18:34:58,341][177154] Sum rewards: 15.992, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'weapon7': '0.054', 'AMMO4': '0.078', 'weapon5': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'HEALTH': '0.110', 'AMMO3': '0.119', 'WEAPON5': '0.200', 'weapon2': '0.368', 'weapon4': '0.426', 'ARMOR': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '1.020', 'weapon3': '2.368', 'DAMAGECOUNT': '4.602', 'FRAGCOUNT': '12.500'} [2023-02-24 18:34:58,558][177154] DAMAGECOUNT value on done: 142841.0 [2023-02-24 18:34:58,559][177154] Sum rewards: 17.116, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.799', 'AMMO2': '0.005', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.026', 'weapon7': '0.048', 'AMMO3': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.300', 'weapon5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '0.970', 'weapon2': '1.438', 'weapon3': '1.862', 'DAMAGECOUNT': '4.899', 'FRAGCOUNT': '13.000'} [2023-02-24 18:34:58,571][177172] DAMAGECOUNT value on done: 139082.0 [2023-02-24 18:34:58,571][177172] Sum rewards: 6.436, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.556', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.018', 'AMMO4': '0.043', 'WEAPON5': '0.050', 'AMMO3': '0.098', 'weapon7': '0.166', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'WEAPON3': '0.700', 'weapon2': '0.708', 'weapon4': '0.812', 'HITCOUNT': '0.900', 'weapon3': '1.530', 'DAMAGECOUNT': '3.225', 'FRAGCOUNT': '6.000'} [2023-02-24 18:34:58,854][177154] DAMAGECOUNT value on done: 144027.0 [2023-02-24 18:34:58,854][177172] DAMAGECOUNT value on done: 141490.0 [2023-02-24 18:34:58,854][177154] Sum rewards: 7.205, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.290', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.086', 'AMMO3': '0.134', 'weapon5': '0.156', 'WEAPON5': '0.300', 'HITCOUNT': '0.870', 'WEAPON3': '0.950', 'weapon2': '1.284', 'weapon3': '2.314', 'DAMAGECOUNT': '3.603', 'FRAGCOUNT': '7.000'} [2023-02-24 18:34:58,854][177172] Sum rewards: 13.029, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.112', 'AMMO5': '0.018', 'AMMO2': '0.028', 'WEAPON1': '0.080', 'weapon7': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.138', 'AMMO3': '0.148', 'weapon5': '0.190', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.496', 'weapon2': '0.662', 'HITCOUNT': '0.950', 'WEAPON3': '1.000', 'weapon3': '2.116', 'DAMAGECOUNT': '5.043', 'FRAGCOUNT': '13.500'} [2023-02-24 18:34:59,381][177157] DAMAGECOUNT value on done: 133467.0 [2023-02-24 18:34:59,381][177157] Sum rewards: -0.582, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.771', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'weapon5': '0.032', 'WEAPON5': '0.050', 'weapon7': '0.050', 'AMMO3': '0.064', 'ARMOR': '0.064', 'AMMO4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.588', 'weapon2': '0.712', 'DAMAGECOUNT': '0.996', 'FRAGCOUNT': '1.000', 'weapon3': '1.050'} [2023-02-24 18:34:59,391][177157] DAMAGECOUNT value on done: 142978.0 [2023-02-24 18:34:59,392][177157] Sum rewards: 16.793, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.330', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'weapon5': '0.182', 'weapon4': '0.224', 'WEAPON5': '0.300', 'WEAPON3': '0.950', 'weapon2': '1.068', 'HITCOUNT': '1.180', 'weapon3': '2.224', 'DAMAGECOUNT': '4.977', 'FRAGCOUNT': '15.000'} [2023-02-24 18:34:59,462][177171] DAMAGECOUNT value on done: 137612.0 [2023-02-24 18:34:59,462][177171] Sum rewards: 4.184, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.454', 'AMMO5': '0.007', 'AMMO2': '0.013', 'ARMOR': '0.014', 'AMMO4': '0.064', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon5': '0.198', 'weapon4': '0.204', 'WEAPON5': '0.300', 'HITCOUNT': '0.610', 'WEAPON3': '0.850', 'weapon2': '1.202', 'weapon3': '2.042', 'DAMAGECOUNT': '2.607', 'FRAGCOUNT': '4.000'} [2023-02-24 18:34:59,684][177157] DAMAGECOUNT value on done: 136842.0 [2023-02-24 18:34:59,685][177157] Sum rewards: 15.019, reward structure: {'DEATHCOUNT': '-13.500', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'weapon5': '0.034', 'AMMO2': '0.036', 'weapon7': '0.052', 'HEALTH': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.176', 'AMMO4': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.564', 'weapon4': '0.730', 'WEAPON3': '1.050', 'HITCOUNT': '1.480', 'weapon3': '2.074', 'DAMAGECOUNT': '6.195', 'FRAGCOUNT': '15.000'} [2023-02-24 18:34:59,696][177157] DAMAGECOUNT value on done: 136297.0 [2023-02-24 18:34:59,696][177157] Sum rewards: 6.661, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.765', 'AMMO5': '0.005', 'AMMO2': '0.022', 'AMMO3': '0.050', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.104', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'weapon4': '0.252', 'ARMOR': '0.425', 'HITCOUNT': '0.430', 'WEAPON3': '0.450', 'weapon3': '1.238', 'weapon2': '1.516', 'DAMAGECOUNT': '1.965', 'FRAGCOUNT': '4.000'} [2023-02-24 18:34:59,753][177171] DAMAGECOUNT value on done: 135312.0 [2023-02-24 18:34:59,754][177171] Sum rewards: 10.428, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.962', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.118', 'AMMO3': '0.129', 'AMMO4': '0.131', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.536', 'weapon4': '0.704', 'WEAPON3': '0.750', 'HITCOUNT': '1.150', 'weapon3': '2.168', 'DAMAGECOUNT': '4.245', 'FRAGCOUNT': '9.500'} [2023-02-24 18:34:59,764][177171] DAMAGECOUNT value on done: 141363.0 [2023-02-24 18:34:59,764][177171] Sum rewards: 6.534, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.500', 'AMMO5': '0.012', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'AMMO3': '0.091', 'weapon7': '0.098', 'AMMO4': '0.118', 'weapon5': '0.154', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.492', 'WEAPON3': '0.550', 'weapon2': '0.622', 'HITCOUNT': '0.720', 'weapon3': '1.116', 'DAMAGECOUNT': '3.006', 'FRAGCOUNT': '5.500'} [2023-02-24 18:35:00,067][177171] DAMAGECOUNT value on done: 132925.0 [2023-02-24 18:35:00,067][177171] Sum rewards: 4.991, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.640', 'AMMO5': '0.007', 'ARMOR': '0.028', 'WEAPON1': '0.030', 'AMMO2': '0.031', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.115', 'weapon5': '0.128', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.348', 'HITCOUNT': '0.650', 'WEAPON3': '0.700', 'weapon2': '1.078', 'weapon3': '1.270', 'DAMAGECOUNT': '2.490', 'FRAGCOUNT': '6.000'} [2023-02-24 18:35:00,375][177155] Large shaping reward 2.550 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.528, 176.0), ('weapon5', 0.002)] [2023-02-24 18:35:00,727][177155] DAMAGECOUNT value on done: 140524.0 [2023-02-24 18:35:00,728][177155] Sum rewards: 10.973, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.640', 'AMMO2': '0.002', 'AMMO4': '0.012', 'AMMO5': '0.012', 'ARMOR': '0.024', 'WEAPON1': '0.050', 'weapon7': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.128', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.296', 'HITCOUNT': '0.650', 'WEAPON3': '0.700', 'weapon2': '1.328', 'weapon3': '1.428', 'DAMAGECOUNT': '4.038', 'FRAGCOUNT': '9.000'} [2023-02-24 18:35:00,909][177153] Updated weights for policy 0, policy_version 14770 (0.0009) [2023-02-24 18:35:01,024][177155] DAMAGECOUNT value on done: 142204.0 [2023-02-24 18:35:01,025][177155] Sum rewards: 0.014, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.910', 'AMMO5': '0.005', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon7': '0.048', 'WEAPON4': '0.050', 'weapon5': '0.056', 'AMMO3': '0.069', 'AMMO4': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.254', 'HITCOUNT': '0.290', 'weapon2': '0.430', 'WEAPON3': '0.500', 'weapon3': '1.186', 'DAMAGECOUNT': '1.200', 'FRAGCOUNT': '1.500'} [2023-02-24 18:35:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 60502016. Throughput: 0: 3484.3. Samples: 15126704. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 18:35:01,376][177119] Avg episode reward: [(0, '11.797')] [2023-02-24 18:35:01,486][177155] DAMAGECOUNT value on done: 145827.0 [2023-02-24 18:35:01,487][177155] Sum rewards: 12.509, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.840', 'AMMO5': '0.009', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'weapon7': '0.052', 'weapon5': '0.056', 'AMMO4': '0.085', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.366', 'WEAPON3': '0.750', 'HITCOUNT': '0.780', 'weapon2': '1.020', 'weapon3': '2.084', 'DAMAGECOUNT': '3.522', 'FRAGCOUNT': '12.000'} [2023-02-24 18:35:01,780][177155] DAMAGECOUNT value on done: 135564.0 [2023-02-24 18:35:01,780][177155] Sum rewards: 10.837, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.682', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'weapon5': '0.054', 'AMMO4': '0.071', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.222', 'ARMOR': '0.556', 'WEAPON3': '0.650', 'HITCOUNT': '0.720', 'weapon2': '0.740', 'weapon3': '1.688', 'DAMAGECOUNT': '2.727', 'FRAGCOUNT': '9.000'} [2023-02-24 18:35:03,866][177153] Updated weights for policy 0, policy_version 14780 (0.0008) [2023-02-24 18:35:06,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 60571648. Throughput: 0: 3485.9. Samples: 15137236. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:35:06,376][177119] Avg episode reward: [(0, '11.847')] [2023-02-24 18:35:06,792][177153] Updated weights for policy 0, policy_version 14790 (0.0008) [2023-02-24 18:35:07,602][177156] DAMAGECOUNT value on done: 137290.0 [2023-02-24 18:35:07,602][177156] Sum rewards: 16.798, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.358', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.034', 'WEAPON1': '0.040', 'weapon5': '0.096', 'weapon7': '0.102', 'AMMO3': '0.108', 'AMMO4': '0.171', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '0.700', 'weapon4': '0.922', 'weapon2': '0.936', 'HITCOUNT': '0.950', 'weapon3': '1.502', 'DAMAGECOUNT': '4.830', 'FRAGCOUNT': '16.000'} [2023-02-24 18:35:07,763][177156] DAMAGECOUNT value on done: 138181.0 [2023-02-24 18:35:07,764][177156] Sum rewards: 8.719, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.629', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.010', 'AMMO3': '0.047', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'weapon7': '0.170', 'WEAPON4': '0.250', 'WEAPON3': '0.300', 'weapon2': '0.330', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON7': '0.500', 'HITCOUNT': '0.650', 'weapon4': '0.750', 'weapon3': '0.804', 'DAMAGECOUNT': '2.694', 'FRAGCOUNT': '6.500'} [2023-02-24 18:35:07,912][177156] DAMAGECOUNT value on done: 139045.0 [2023-02-24 18:35:07,913][177156] Sum rewards: 8.637, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.400', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.037', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.122', 'weapon5': '0.166', 'AMMO4': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.448', 'weapon4': '0.634', 'WEAPON3': '0.650', 'HITCOUNT': '0.660', 'weapon3': '1.510', 'DAMAGECOUNT': '3.345', 'FRAGCOUNT': '8.000'} [2023-02-24 18:35:08,069][177156] DAMAGECOUNT value on done: 139258.0 [2023-02-24 18:35:08,069][177156] Sum rewards: 12.661, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.650', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon5': '0.096', 'AMMO3': '0.098', 'AMMO4': '0.107', 'weapon7': '0.110', 'WEAPON5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'weapon4': '0.504', 'WEAPON3': '0.600', 'HITCOUNT': '0.970', 'weapon2': '1.136', 'weapon3': '1.614', 'DAMAGECOUNT': '3.999', 'FRAGCOUNT': '10.000'} [2023-02-24 18:35:09,724][177153] Updated weights for policy 0, policy_version 14800 (0.0009) [2023-02-24 18:35:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 60641280. Throughput: 0: 3487.0. Samples: 15158146. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:35:11,376][177119] Avg episode reward: [(0, '11.692')] [2023-02-24 18:35:11,528][177170] DAMAGECOUNT value on done: 139559.0 [2023-02-24 18:35:11,528][177170] Sum rewards: 6.540, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'HEALTH': '0.044', 'AMMO4': '0.115', 'AMMO3': '0.133', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.182', 'weapon4': '0.220', 'WEAPON3': '0.700', 'HITCOUNT': '0.760', 'weapon3': '1.672', 'weapon2': '1.674', 'DAMAGECOUNT': '2.937', 'FRAGCOUNT': '6.000'} [2023-02-24 18:35:11,831][177170] DAMAGECOUNT value on done: 147318.0 [2023-02-24 18:35:11,831][177170] Sum rewards: 9.556, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.368', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON1': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.070', 'weapon5': '0.132', 'weapon4': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.580', 'WEAPON3': '0.600', 'weapon2': '1.590', 'weapon3': '1.716', 'DAMAGECOUNT': '2.727', 'FRAGCOUNT': '8.000'} [2023-02-24 18:35:12,141][177170] DAMAGECOUNT value on done: 135110.0 [2023-02-24 18:35:12,142][177170] Sum rewards: 10.512, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.734', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.037', 'WEAPON1': '0.040', 'weapon5': '0.062', 'AMMO3': '0.077', 'ARMOR': '0.080', 'weapon7': '0.092', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.390', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'weapon4': '0.734', 'weapon3': '1.442', 'DAMAGECOUNT': '2.781', 'FRAGCOUNT': '8.000'} [2023-02-24 18:35:12,433][177170] DAMAGECOUNT value on done: 138237.0 [2023-02-24 18:35:12,433][177170] Sum rewards: 6.241, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.024', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'weapon7': '0.110', 'weapon4': '0.224', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'HITCOUNT': '0.470', 'ARMOR': '0.509', 'WEAPON3': '0.550', 'weapon2': '1.052', 'weapon3': '1.360', 'DAMAGECOUNT': '1.935', 'FRAGCOUNT': '5.000'} [2023-02-24 18:35:12,689][177153] Updated weights for policy 0, policy_version 14810 (0.0008) [2023-02-24 18:35:13,321][177158] DAMAGECOUNT value on done: 135861.0 [2023-02-24 18:35:13,321][177158] Sum rewards: 10.269, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.942', 'AMMO2': '0.015', 'AMMO5': '0.015', 'WEAPON1': '0.070', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.172', 'weapon5': '0.214', 'weapon4': '0.398', 'WEAPON5': '0.400', 'weapon2': '0.942', 'WEAPON3': '1.000', 'HITCOUNT': '1.080', 'weapon3': '2.114', 'DAMAGECOUNT': '4.119', 'FRAGCOUNT': '11.000'} [2023-02-24 18:35:13,632][177158] DAMAGECOUNT value on done: 135953.0 [2023-02-24 18:35:13,633][177158] Sum rewards: 3.072, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.340', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.028', 'AMMO4': '0.029', 'weapon7': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.109', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.198', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.300', 'WEAPON3': '0.650', 'weapon3': '1.014', 'weapon2': '1.252', 'DAMAGECOUNT': '1.287', 'FRAGCOUNT': '4.000'} [2023-02-24 18:35:14,216][177158] DAMAGECOUNT value on done: 142146.0 [2023-02-24 18:35:14,217][177158] Sum rewards: 12.264, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.398', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO2': '0.043', 'AMMO3': '0.067', 'weapon7': '0.072', 'weapon5': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO4': '0.217', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'weapon2': '0.734', 'weapon4': '0.908', 'HITCOUNT': '1.010', 'weapon3': '1.264', 'DAMAGECOUNT': '3.600', 'FRAGCOUNT': '9.000'} [2023-02-24 18:35:14,519][177158] DAMAGECOUNT value on done: 140105.0 [2023-02-24 18:35:14,520][177158] Sum rewards: 13.882, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.262', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.086', 'weapon5': '0.142', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.404', 'WEAPON3': '0.950', 'weapon2': '1.008', 'HITCOUNT': '1.100', 'weapon3': '1.792', 'DAMAGECOUNT': '4.536', 'FRAGCOUNT': '15.000'} [2023-02-24 18:35:15,597][177153] Updated weights for policy 0, policy_version 14820 (0.0008) [2023-02-24 18:35:16,028][177172] DAMAGECOUNT value on done: 139242.0 [2023-02-24 18:35:16,029][177172] Sum rewards: 13.840, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.312', 'weapon5': '0.004', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon7': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.128', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.392', 'weapon2': '0.790', 'WEAPON3': '0.800', 'HITCOUNT': '1.090', 'weapon3': '1.890', 'DAMAGECOUNT': '4.320', 'FRAGCOUNT': '15.000'} [2023-02-24 18:35:16,325][177172] DAMAGECOUNT value on done: 139933.0 [2023-02-24 18:35:16,326][177172] Sum rewards: 9.293, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.872', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon5': '0.078', 'AMMO4': '0.078', 'AMMO3': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon2': '0.574', 'weapon4': '0.634', 'WEAPON3': '0.900', 'HITCOUNT': '0.980', 'weapon3': '2.234', 'DAMAGECOUNT': '3.801', 'FRAGCOUNT': '10.000'} [2023-02-24 18:35:16,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 60710912. Throughput: 0: 3487.0. Samples: 15179106. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:35:16,376][177119] Avg episode reward: [(0, '11.374')] [2023-02-24 18:35:17,273][177154] DAMAGECOUNT value on done: 144990.0 [2023-02-24 18:35:17,273][177154] Sum rewards: 2.234, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.636', 'AMMO5': '0.009', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'weapon7': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.100', 'weapon5': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.350', 'weapon4': '0.358', 'weapon2': '0.538', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.308', 'weapon3': '1.390', 'FRAGCOUNT': '4.000'} [2023-02-24 18:35:17,575][177154] DAMAGECOUNT value on done: 146518.0 [2023-02-24 18:35:17,576][177154] Sum rewards: 18.365, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.718', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon5': '0.186', 'WEAPON4': '0.250', 'weapon4': '0.302', 'weapon2': '0.654', 'WEAPON3': '1.050', 'HITCOUNT': '1.350', 'weapon3': '2.552', 'DAMAGECOUNT': '5.223', 'FRAGCOUNT': '19.000'} [2023-02-24 18:35:17,801][177154] DAMAGECOUNT value on done: 144427.0 [2023-02-24 18:35:17,802][177154] Sum rewards: 14.206, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'AMMO3': '0.100', 'AMMO4': '0.155', 'HEALTH': '0.180', 'weapon5': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.447', 'WEAPON3': '0.550', 'weapon4': '0.686', 'weapon2': '0.884', 'HITCOUNT': '1.130', 'weapon3': '1.546', 'DAMAGECOUNT': '4.284', 'FRAGCOUNT': '11.000'} [2023-02-24 18:35:17,807][177172] DAMAGECOUNT value on done: 140402.0 [2023-02-24 18:35:17,807][177172] Sum rewards: 15.239, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.538', 'ARMOR': '0.004', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO4': '0.057', 'AMMO3': '0.085', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.162', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'weapon4': '0.612', 'weapon2': '0.712', 'HITCOUNT': '0.890', 'weapon3': '1.252', 'DAMAGECOUNT': '3.960', 'FRAGCOUNT': '11.000'} [2023-02-24 18:35:18,099][177154] DAMAGECOUNT value on done: 145595.0 [2023-02-24 18:35:18,099][177154] Sum rewards: 18.040, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.970', 'AMMO2': '0.016', 'AMMO5': '0.017', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.158', 'WEAPON7': '0.200', 'weapon5': '0.208', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'weapon2': '1.010', 'HITCOUNT': '1.090', 'weapon3': '2.172', 'DAMAGECOUNT': '4.704', 'FRAGCOUNT': '16.000'} [2023-02-24 18:35:18,105][177172] DAMAGECOUNT value on done: 142157.0 [2023-02-24 18:35:18,106][177172] Sum rewards: 5.288, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.260', 'AMMO2': '0.017', 'AMMO5': '0.020', 'ARMOR': '0.028', 'weapon7': '0.050', 'AMMO3': '0.082', 'AMMO4': '0.084', 'WEAPON1': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.250', 'weapon5': '0.310', 'HITCOUNT': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'weapon2': '1.042', 'weapon3': '1.574', 'DAMAGECOUNT': '2.001', 'FRAGCOUNT': '4.000'} [2023-02-24 18:35:18,505][177153] Updated weights for policy 0, policy_version 14830 (0.0007) [2023-02-24 18:35:18,642][177157] DAMAGECOUNT value on done: 134934.0 [2023-02-24 18:35:18,643][177157] Sum rewards: 11.116, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.400', 'AMMO5': '0.012', 'AMMO2': '0.050', 'WEAPON1': '0.070', 'weapon7': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.145', 'weapon5': '0.150', 'WEAPON7': '0.200', 'AMMO4': '0.248', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.636', 'ARMOR': '0.828', 'WEAPON3': '0.950', 'HITCOUNT': '0.990', 'weapon4': '1.230', 'weapon3': '1.486', 'DAMAGECOUNT': '4.401', 'FRAGCOUNT': '12.000'} [2023-02-24 18:35:18,653][177157] DAMAGECOUNT value on done: 144277.0 [2023-02-24 18:35:18,653][177157] Sum rewards: 14.229, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.495', 'AMMO5': '0.021', 'AMMO2': '0.029', 'WEAPON1': '0.070', 'AMMO3': '0.128', 'AMMO4': '0.144', 'WEAPON4': '0.150', 'weapon5': '0.180', 'weapon4': '0.222', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'HITCOUNT': '0.800', 'weapon2': '1.066', 'weapon3': '2.116', 'DAMAGECOUNT': '3.897', 'FRAGCOUNT': '14.000'} [2023-02-24 18:35:18,724][177171] DAMAGECOUNT value on done: 138588.0 [2023-02-24 18:35:18,724][177171] Sum rewards: 10.371, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.541', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'ARMOR': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'weapon5': '0.124', 'AMMO4': '0.171', 'WEAPON4': '0.300', 'weapon4': '0.390', 'WEAPON3': '0.600', 'HITCOUNT': '0.750', 'weapon2': '1.182', 'weapon3': '1.410', 'DAMAGECOUNT': '2.928', 'FRAGCOUNT': '11.000'} [2023-02-24 18:35:18,815][177156] Large shaping reward 2.652 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:35:18,951][177157] DAMAGECOUNT value on done: 138427.0 [2023-02-24 18:35:18,952][177157] Sum rewards: 16.488, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.428', 'ARMOR': '0.004', 'AMMO2': '0.014', 'AMMO5': '0.024', 'weapon4': '0.046', 'weapon7': '0.064', 'AMMO4': '0.069', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.166', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.268', 'WEAPON7': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.778', 'HITCOUNT': '0.890', 'WEAPON3': '1.050', 'weapon3': '2.428', 'DAMAGECOUNT': '4.755', 'FRAGCOUNT': '15.000'} [2023-02-24 18:35:18,962][177157] DAMAGECOUNT value on done: 137586.0 [2023-02-24 18:35:18,963][177157] Sum rewards: 8.655, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.201', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO5': '0.024', 'WEAPON1': '0.060', 'AMMO3': '0.134', 'weapon5': '0.202', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'HITCOUNT': '0.960', 'weapon2': '1.102', 'weapon3': '2.290', 'DAMAGECOUNT': '3.867', 'FRAGCOUNT': '8.000'} [2023-02-24 18:35:19,006][177171] DAMAGECOUNT value on done: 137733.0 [2023-02-24 18:35:19,006][177171] Sum rewards: 24.730, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.715', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.080', 'WEAPON1': '0.080', 'AMMO3': '0.126', 'weapon5': '0.134', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.354', 'weapon4': '0.584', 'WEAPON3': '0.950', 'HITCOUNT': '1.550', 'weapon3': '2.248', 'DAMAGECOUNT': '7.263', 'FRAGCOUNT': '20.000'} [2023-02-24 18:35:19,015][177171] DAMAGECOUNT value on done: 142262.0 [2023-02-24 18:35:19,015][177171] Sum rewards: 5.057, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.314', 'AMMO5': '0.007', 'AMMO2': '0.042', 'WEAPON1': '0.050', 'AMMO3': '0.097', 'WEAPON5': '0.150', 'weapon5': '0.158', 'AMMO4': '0.211', 'WEAPON4': '0.400', 'weapon2': '0.600', 'HITCOUNT': '0.610', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'weapon4': '1.132', 'weapon3': '1.266', 'DAMAGECOUNT': '2.697', 'FRAGCOUNT': '5.000'} [2023-02-24 18:35:19,315][177171] DAMAGECOUNT value on done: 134412.0 [2023-02-24 18:35:19,316][177171] Sum rewards: 15.031, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.628', 'AMMO2': '0.008', 'ARMOR': '0.012', 'AMMO5': '0.022', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'weapon5': '0.060', 'AMMO3': '0.161', 'weapon4': '0.222', 'WEAPON5': '0.450', 'weapon2': '0.754', 'HITCOUNT': '0.940', 'WEAPON3': '0.950', 'weapon3': '2.470', 'DAMAGECOUNT': '4.461', 'FRAGCOUNT': '14.000'} [2023-02-24 18:35:19,963][177155] DAMAGECOUNT value on done: 141459.0 [2023-02-24 18:35:19,963][177155] Sum rewards: 9.325, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.348', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon7': '0.048', 'WEAPON1': '0.070', 'AMMO3': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.134', 'WEAPON4': '0.150', 'AMMO4': '0.180', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.366', 'ARMOR': '0.408', 'WEAPON3': '0.550', 'HITCOUNT': '0.760', 'weapon2': '1.184', 'weapon3': '1.600', 'DAMAGECOUNT': '2.805', 'FRAGCOUNT': '6.500'} [2023-02-24 18:35:20,264][177155] DAMAGECOUNT value on done: 143465.0 [2023-02-24 18:35:20,264][177155] Sum rewards: 9.024, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.330', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon7': '0.050', 'WEAPON1': '0.070', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.141', 'AMMO3': '0.144', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.408', 'weapon2': '0.854', 'WEAPON3': '0.950', 'HITCOUNT': '1.030', 'weapon3': '2.278', 'DAMAGECOUNT': '3.783', 'FRAGCOUNT': '10.000'} [2023-02-24 18:35:20,717][177155] DAMAGECOUNT value on done: 147026.0 [2023-02-24 18:35:20,718][177155] Sum rewards: 10.232, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.059', 'weapon7': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.107', 'weapon4': '0.226', 'weapon5': '0.286', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'HITCOUNT': '0.810', 'weapon2': '1.016', 'weapon3': '2.042', 'DAMAGECOUNT': '3.597', 'FRAGCOUNT': '9.000'} [2023-02-24 18:35:21,007][177155] DAMAGECOUNT value on done: 136265.0 [2023-02-24 18:35:21,007][177155] Sum rewards: 5.369, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.500', 'AMMO5': '0.006', 'AMMO2': '0.006', 'WEAPON1': '0.030', 'AMMO4': '0.030', 'AMMO3': '0.049', 'weapon7': '0.100', 'weapon5': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.402', 'HITCOUNT': '0.510', 'weapon3': '0.750', 'weapon2': '0.870', 'DAMAGECOUNT': '2.103', 'FRAGCOUNT': '4.000'} [2023-02-24 18:35:21,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 60780544. Throughput: 0: 3486.5. Samples: 15189530. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:35:21,376][177119] Avg episode reward: [(0, '11.030')] [2023-02-24 18:35:21,432][177153] Updated weights for policy 0, policy_version 14840 (0.0008) [2023-02-24 18:35:24,354][177153] Updated weights for policy 0, policy_version 14850 (0.0008) [2023-02-24 18:35:26,376][177119] Fps is (10 sec: 13926.2, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 60850176. Throughput: 0: 3492.8. Samples: 15210594. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:35:26,376][177119] Avg episode reward: [(0, '11.030')] [2023-02-24 18:35:26,815][177156] DAMAGECOUNT value on done: 138886.0 [2023-02-24 18:35:26,816][177156] Sum rewards: 14.514, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.285', 'AMMO5': '0.012', 'AMMO2': '0.029', 'WEAPON1': '0.040', 'AMMO3': '0.117', 'AMMO4': '0.146', 'weapon5': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.476', 'weapon2': '0.488', 'WEAPON3': '0.700', 'HITCOUNT': '1.050', 'weapon3': '2.380', 'DAMAGECOUNT': '4.788', 'FRAGCOUNT': '12.000'} [2023-02-24 18:35:26,961][177156] DAMAGECOUNT value on done: 139231.0 [2023-02-24 18:35:26,962][177156] Sum rewards: 5.536, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon7': '0.050', 'weapon5': '0.050', 'AMMO4': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'HEALTH': '0.197', 'weapon4': '0.258', 'WEAPON3': '0.600', 'weapon2': '0.700', 'HITCOUNT': '0.770', 'weapon3': '1.570', 'DAMAGECOUNT': '3.150', 'FRAGCOUNT': '5.000'} [2023-02-24 18:35:27,121][177156] DAMAGECOUNT value on done: 140644.0 [2023-02-24 18:35:27,122][177156] Sum rewards: 16.332, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.390', 'AMMO5': '0.022', 'AMMO2': '0.030', 'WEAPON1': '0.060', 'AMMO3': '0.072', 'weapon7': '0.100', 'weapon5': '0.140', 'AMMO4': '0.150', 'WEAPON4': '0.250', 'AMMO6': '0.400', 'WEAPON7': '0.400', 'AMMO7': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.500', 'weapon4': '0.540', 'weapon2': '0.972', 'HITCOUNT': '1.110', 'weapon3': '1.638', 'DAMAGECOUNT': '4.437', 'FRAGCOUNT': '12.500'} [2023-02-24 18:35:27,279][177156] DAMAGECOUNT value on done: 140155.0 [2023-02-24 18:35:27,279][177156] Sum rewards: 6.844, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.088', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.034', 'WEAPON1': '0.060', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon5': '0.182', 'WEAPON5': '0.200', 'HITCOUNT': '0.700', 'WEAPON3': '0.750', 'weapon2': '1.516', 'weapon3': '1.968', 'DAMAGECOUNT': '2.691', 'FRAGCOUNT': '7.000'} [2023-02-24 18:35:27,285][177153] Updated weights for policy 0, policy_version 14860 (0.0008) [2023-02-24 18:35:30,228][177153] Updated weights for policy 0, policy_version 14870 (0.0008) [2023-02-24 18:35:30,732][177170] DAMAGECOUNT value on done: 140966.0 [2023-02-24 18:35:30,733][177170] Sum rewards: 15.192, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.628', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.041', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'WEAPON4': '0.150', 'weapon7': '0.214', 'AMMO6': '0.340', 'AMMO7': '0.340', 'ARMOR': '0.456', 'WEAPON7': '0.500', 'weapon4': '0.520', 'WEAPON3': '0.650', 'HITCOUNT': '0.930', 'weapon2': '1.020', 'weapon3': '1.406', 'DAMAGECOUNT': '4.221', 'FRAGCOUNT': '13.000'} [2023-02-24 18:35:31,037][177170] DAMAGECOUNT value on done: 147984.0 [2023-02-24 18:35:31,037][177170] Sum rewards: 6.410, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.074', 'weapon7': '0.082', 'AMMO4': '0.096', 'AMMO3': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HEALTH': '0.216', 'ARMOR': '0.432', 'WEAPON3': '0.500', 'weapon4': '0.558', 'HITCOUNT': '0.570', 'weapon2': '0.800', 'weapon3': '1.900', 'DAMAGECOUNT': '1.998', 'FRAGCOUNT': '5.000'} [2023-02-24 18:35:31,350][177170] DAMAGECOUNT value on done: 136520.0 [2023-02-24 18:35:31,351][177170] Sum rewards: 12.672, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.725', 'AMMO5': '0.014', 'AMMO2': '0.019', 'WEAPON1': '0.050', 'AMMO4': '0.095', 'weapon7': '0.114', 'weapon5': '0.116', 'AMMO3': '0.148', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.394', 'weapon4': '0.660', 'WEAPON3': '0.950', 'HITCOUNT': '1.250', 'weapon3': '2.216', 'DAMAGECOUNT': '4.230', 'FRAGCOUNT': '13.000'} [2023-02-24 18:35:31,376][177119] Fps is (10 sec: 13926.0, 60 sec: 13926.3, 300 sec: 13940.3). Total num frames: 60919808. Throughput: 0: 3492.1. Samples: 15231520. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:35:31,377][177119] Avg episode reward: [(0, '11.209')] [2023-02-24 18:35:31,645][177170] DAMAGECOUNT value on done: 139814.0 [2023-02-24 18:35:31,645][177170] Sum rewards: 14.738, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.640', 'AMMO5': '0.022', 'AMMO2': '0.029', 'WEAPON4': '0.050', 'WEAPON1': '0.080', 'AMMO3': '0.116', 'AMMO4': '0.144', 'weapon5': '0.156', 'weapon4': '0.214', 'WEAPON5': '0.450', 'weapon2': '0.674', 'WEAPON3': '0.850', 'HITCOUNT': '1.240', 'weapon3': '2.372', 'DAMAGECOUNT': '4.731', 'FRAGCOUNT': '12.500'} [2023-02-24 18:35:32,518][177158] DAMAGECOUNT value on done: 137241.0 [2023-02-24 18:35:32,519][177158] Sum rewards: 14.644, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.776', 'AMMO5': '0.007', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'ARMOR': '0.044', 'AMMO3': '0.064', 'weapon7': '0.096', 'AMMO4': '0.124', 'weapon5': '0.134', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.500', 'weapon4': '0.660', 'weapon2': '0.706', 'HITCOUNT': '0.750', 'weapon3': '1.340', 'DAMAGECOUNT': '4.140', 'FRAGCOUNT': '13.000'} [2023-02-24 18:35:32,816][177158] DAMAGECOUNT value on done: 137301.0 [2023-02-24 18:35:32,817][177158] Sum rewards: 12.846, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.152', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO4': '0.071', 'AMMO3': '0.083', 'weapon5': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.320', 'weapon4': '0.508', 'WEAPON3': '0.550', 'HITCOUNT': '1.120', 'weapon3': '1.772', 'DAMAGECOUNT': '4.044', 'FRAGCOUNT': '11.000'} [2023-02-24 18:35:33,189][177153] Updated weights for policy 0, policy_version 14880 (0.0008) [2023-02-24 18:35:33,400][177158] DAMAGECOUNT value on done: 143218.0 [2023-02-24 18:35:33,401][177158] Sum rewards: 11.733, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.428', 'ARMOR': '0.005', 'AMMO5': '0.009', 'AMMO2': '0.024', 'WEAPON1': '0.050', 'AMMO3': '0.073', 'weapon4': '0.092', 'WEAPON4': '0.100', 'AMMO4': '0.118', 'weapon5': '0.178', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'HITCOUNT': '0.700', 'weapon3': '1.132', 'weapon2': '2.464', 'DAMAGECOUNT': '3.216', 'FRAGCOUNT': '7.000'} [2023-02-24 18:35:33,695][177158] DAMAGECOUNT value on done: 140478.0 [2023-02-24 18:35:33,695][177158] Sum rewards: 1.558, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.252', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.030', 'weapon4': '0.032', 'weapon7': '0.058', 'weapon5': '0.068', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.210', 'WEAPON3': '0.300', 'ARMOR': '0.469', 'FRAGCOUNT': '0.500', 'weapon3': '0.734', 'DAMAGECOUNT': '1.119', 'weapon2': '1.508'} [2023-02-24 18:35:35,332][177172] DAMAGECOUNT value on done: 140175.0 [2023-02-24 18:35:35,333][177172] Sum rewards: 11.131, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.820', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.026', 'weapon7': '0.066', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.121', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.492', 'WEAPON3': '0.700', 'HITCOUNT': '0.760', 'weapon2': '1.238', 'weapon3': '1.346', 'DAMAGECOUNT': '2.799', 'FRAGCOUNT': '10.000'} [2023-02-24 18:35:35,636][177172] DAMAGECOUNT value on done: 141486.0 [2023-02-24 18:35:35,636][177172] Sum rewards: 18.094, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.359', 'ARMOR': '0.012', 'AMMO2': '0.024', 'AMMO5': '0.024', 'WEAPON1': '0.070', 'AMMO4': '0.120', 'AMMO3': '0.123', 'weapon5': '0.226', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.812', 'WEAPON3': '0.850', 'weapon2': '0.922', 'HITCOUNT': '1.010', 'weapon3': '1.550', 'DAMAGECOUNT': '4.659', 'FRAGCOUNT': '15.000'} [2023-02-24 18:35:36,160][177153] Updated weights for policy 0, policy_version 14890 (0.0008) [2023-02-24 18:35:36,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 60989440. Throughput: 0: 3490.6. Samples: 15241894. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:35:36,376][177119] Avg episode reward: [(0, '11.120')] [2023-02-24 18:35:36,556][177154] DAMAGECOUNT value on done: 145475.0 [2023-02-24 18:35:36,556][177154] Sum rewards: 1.556, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.100', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.046', 'weapon7': '0.046', 'WEAPON4': '0.100', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.246', 'HITCOUNT': '0.300', 'WEAPON3': '0.350', 'weapon2': '0.482', 'weapon3': '0.606', 'DAMAGECOUNT': '1.455', 'FRAGCOUNT': '2.000'} [2023-02-24 18:35:36,864][177154] DAMAGECOUNT value on done: 147617.0 [2023-02-24 18:35:36,864][177154] Sum rewards: 12.698, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.740', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.011', 'WEAPON1': '0.040', 'AMMO3': '0.114', 'weapon5': '0.118', 'WEAPON5': '0.300', 'HITCOUNT': '0.800', 'WEAPON3': '0.850', 'weapon2': '1.822', 'weapon3': '1.866', 'DAMAGECOUNT': '3.297', 'FRAGCOUNT': '12.000'} [2023-02-24 18:35:37,080][177154] DAMAGECOUNT value on done: 146132.0 [2023-02-24 18:35:37,080][177154] Sum rewards: 15.338, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.484', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.054', 'WEAPON1': '0.060', 'weapon5': '0.104', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'WEAPON3': '1.000', 'weapon2': '1.166', 'HITCOUNT': '1.300', 'weapon3': '2.388', 'DAMAGECOUNT': '5.115', 'FRAGCOUNT': '14.000'} [2023-02-24 18:35:37,107][177172] DAMAGECOUNT value on done: 142463.0 [2023-02-24 18:35:37,108][177172] Sum rewards: 24.505, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.033', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'weapon5': '0.118', 'AMMO4': '0.164', 'WEAPON4': '0.300', 'HEALTH': '0.464', 'WEAPON3': '0.650', 'weapon4': '0.682', 'weapon2': '0.924', 'HITCOUNT': '1.410', 'weapon3': '1.744', 'DAMAGECOUNT': '6.183', 'FRAGCOUNT': '21.000'} [2023-02-24 18:35:37,379][177154] DAMAGECOUNT value on done: 147340.0 [2023-02-24 18:35:37,380][177154] Sum rewards: 16.714, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.728', 'AMMO2': '0.019', 'AMMO5': '0.020', 'WEAPON1': '0.060', 'AMMO4': '0.094', 'AMMO3': '0.118', 'weapon5': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon4': '0.612', 'weapon2': '0.730', 'WEAPON3': '0.850', 'HITCOUNT': '1.490', 'weapon3': '2.004', 'DAMAGECOUNT': '5.235', 'FRAGCOUNT': '16.000'} [2023-02-24 18:35:37,410][177172] DAMAGECOUNT value on done: 143832.0 [2023-02-24 18:35:37,410][177172] Sum rewards: 15.810, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.246', 'AMMO2': '0.004', 'AMMO5': '0.013', 'AMMO4': '0.021', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.154', 'weapon4': '0.208', 'weapon5': '0.236', 'WEAPON5': '0.350', 'weapon2': '0.574', 'WEAPON3': '1.050', 'HITCOUNT': '1.190', 'weapon3': '2.570', 'DAMAGECOUNT': '5.025', 'FRAGCOUNT': '16.000'} [2023-02-24 18:35:37,881][177157] DAMAGECOUNT value on done: 135701.0 [2023-02-24 18:35:37,882][177157] Sum rewards: 6.801, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.836', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'AMMO3': '0.067', 'AMMO4': '0.074', 'weapon7': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.206', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.460', 'weapon4': '0.480', 'weapon3': '1.066', 'weapon2': '1.110', 'DAMAGECOUNT': '2.301', 'FRAGCOUNT': '6.000'} [2023-02-24 18:35:37,892][177157] DAMAGECOUNT value on done: 145700.0 [2023-02-24 18:35:37,892][177157] Sum rewards: 17.979, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.446', 'AMMO5': '0.021', 'AMMO2': '0.039', 'AMMO3': '0.051', 'WEAPON1': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.104', 'WEAPON4': '0.150', 'AMMO4': '0.193', 'weapon5': '0.380', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.698', 'HITCOUNT': '0.880', 'weapon2': '0.918', 'weapon3': '1.044', 'DAMAGECOUNT': '4.257', 'FRAGCOUNT': '12.500'} [2023-02-24 18:35:38,032][177171] DAMAGECOUNT value on done: 139763.0 [2023-02-24 18:35:38,033][177171] Sum rewards: 7.739, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.128', 'AMMO5': '0.014', 'AMMO2': '0.033', 'WEAPON1': '0.060', 'AMMO3': '0.151', 'weapon5': '0.164', 'AMMO4': '0.165', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.596', 'WEAPON3': '0.900', 'HITCOUNT': '0.990', 'weapon2': '1.082', 'weapon3': '1.836', 'DAMAGECOUNT': '3.525', 'FRAGCOUNT': '10.000'} [2023-02-24 18:35:38,174][177157] DAMAGECOUNT value on done: 139370.0 [2023-02-24 18:35:38,175][177157] Sum rewards: 8.718, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.280', 'AMMO5': '0.011', 'AMMO2': '0.020', 'WEAPON1': '0.060', 'weapon7': '0.062', 'AMMO3': '0.069', 'AMMO4': '0.099', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.252', 'WEAPON5': '0.300', 'weapon4': '0.450', 'WEAPON3': '0.500', 'HITCOUNT': '0.500', 'weapon2': '1.144', 'weapon3': '1.312', 'DAMAGECOUNT': '2.829', 'FRAGCOUNT': '7.000'} [2023-02-24 18:35:38,184][177157] DAMAGECOUNT value on done: 139201.0 [2023-02-24 18:35:38,184][177157] Sum rewards: 17.186, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.264', 'ARMOR': '0.005', 'AMMO5': '0.011', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'weapon7': '0.078', 'AMMO3': '0.105', 'AMMO4': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.496', 'WEAPON3': '0.600', 'weapon4': '0.832', 'HITCOUNT': '1.080', 'weapon3': '1.654', 'DAMAGECOUNT': '4.845', 'FRAGCOUNT': '13.000'} [2023-02-24 18:35:38,329][177171] DAMAGECOUNT value on done: 138895.0 [2023-02-24 18:35:38,329][177171] Sum rewards: 6.486, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.988', 'AMMO5': '0.013', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.110', 'AMMO4': '0.138', 'weapon5': '0.156', 'weapon2': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.444', 'WEAPON3': '0.700', 'weapon4': '0.872', 'HITCOUNT': '0.900', 'weapon3': '1.552', 'DAMAGECOUNT': '3.486', 'FRAGCOUNT': '6.500'} [2023-02-24 18:35:38,338][177171] DAMAGECOUNT value on done: 143117.0 [2023-02-24 18:35:38,339][177171] Sum rewards: 6.568, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.850', 'AMMO5': '0.005', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'weapon7': '0.064', 'AMMO4': '0.092', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'weapon5': '0.132', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.370', 'WEAPON3': '0.700', 'HITCOUNT': '0.820', 'weapon2': '1.268', 'weapon3': '1.768', 'DAMAGECOUNT': '2.565', 'FRAGCOUNT': '6.000'} [2023-02-24 18:35:38,631][177171] DAMAGECOUNT value on done: 136183.0 [2023-02-24 18:35:38,631][177171] Sum rewards: 20.019, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.921', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON1': '0.050', 'weapon7': '0.052', 'AMMO3': '0.076', 'AMMO4': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'weapon4': '0.654', 'weapon2': '0.752', 'HITCOUNT': '1.080', 'weapon3': '1.592', 'DAMAGECOUNT': '5.313', 'FRAGCOUNT': '15.000'} [2023-02-24 18:35:39,082][177153] Updated weights for policy 0, policy_version 14900 (0.0008) [2023-02-24 18:35:39,277][177155] DAMAGECOUNT value on done: 143123.0 [2023-02-24 18:35:39,277][177155] Sum rewards: 10.042, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.050', 'AMMO5': '0.010', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.117', 'AMMO4': '0.117', 'weapon5': '0.160', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.404', 'weapon4': '0.596', 'weapon2': '0.716', 'WEAPON3': '0.800', 'HITCOUNT': '1.100', 'weapon3': '2.176', 'DAMAGECOUNT': '4.992', 'FRAGCOUNT': '9.000'} [2023-02-24 18:35:39,580][177155] DAMAGECOUNT value on done: 145347.0 [2023-02-24 18:35:39,581][177155] Sum rewards: 16.913, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.452', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'weapon7': '0.068', 'AMMO4': '0.072', 'weapon5': '0.088', 'AMMO3': '0.125', 'WEAPON5': '0.150', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'weapon2': '0.410', 'WEAPON4': '0.500', 'WEAPON3': '0.800', 'weapon4': '0.818', 'ARMOR': '0.956', 'HITCOUNT': '1.550', 'weapon3': '1.860', 'DAMAGECOUNT': '5.646', 'FRAGCOUNT': '14.000'} [2023-02-24 18:35:40,050][177155] DAMAGECOUNT value on done: 148226.0 [2023-02-24 18:35:40,051][177155] Sum rewards: 7.419, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.545', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO5': '0.017', 'AMMO4': '0.032', 'WEAPON1': '0.070', 'AMMO3': '0.142', 'weapon5': '0.148', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.404', 'HITCOUNT': '0.760', 'WEAPON3': '0.900', 'weapon2': '1.094', 'weapon3': '1.936', 'DAMAGECOUNT': '3.600', 'FRAGCOUNT': '9.000'} [2023-02-24 18:35:40,350][177155] DAMAGECOUNT value on done: 137965.0 [2023-02-24 18:35:40,351][177155] Sum rewards: 19.469, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.609', 'AMMO2': '0.011', 'AMMO5': '0.016', 'WEAPON1': '0.050', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon4': '0.184', 'weapon5': '0.242', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '1.070', 'weapon2': '1.376', 'weapon3': '1.890', 'DAMAGECOUNT': '5.085', 'FRAGCOUNT': '16.500'} [2023-02-24 18:35:41,376][177119] Fps is (10 sec: 13926.7, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 61059072. Throughput: 0: 3488.5. Samples: 15262718. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:35:41,376][177119] Avg episode reward: [(0, '11.232')] [2023-02-24 18:35:42,027][177153] Updated weights for policy 0, policy_version 14910 (0.0009) [2023-02-24 18:35:44,998][177153] Updated weights for policy 0, policy_version 14920 (0.0008) [2023-02-24 18:35:46,155][177156] DAMAGECOUNT value on done: 140533.0 [2023-02-24 18:35:46,156][177156] Sum rewards: 14.312, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.250', 'AMMO2': '0.015', 'AMMO5': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.073', 'WEAPON1': '0.080', 'weapon4': '0.106', 'AMMO3': '0.180', 'weapon5': '0.200', 'WEAPON5': '0.450', 'weapon2': '0.542', 'HITCOUNT': '1.060', 'WEAPON3': '1.350', 'weapon3': '2.750', 'DAMAGECOUNT': '4.941', 'FRAGCOUNT': '17.000'} [2023-02-24 18:35:46,304][177156] DAMAGECOUNT value on done: 140071.0 [2023-02-24 18:35:46,305][177156] Sum rewards: 7.240, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.012', 'AMMO5': '0.017', 'AMMO2': '0.028', 'ARMOR': '0.028', 'WEAPON1': '0.080', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'AMMO4': '0.139', 'weapon5': '0.246', 'WEAPON5': '0.400', 'HITCOUNT': '0.590', 'WEAPON3': '0.800', 'weapon2': '1.244', 'weapon3': '2.092', 'DAMAGECOUNT': '2.520', 'FRAGCOUNT': '8.000'} [2023-02-24 18:35:46,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 61128704. Throughput: 0: 3487.1. Samples: 15283624. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:35:46,376][177119] Avg episode reward: [(0, '11.185')] [2023-02-24 18:35:46,470][177156] DAMAGECOUNT value on done: 142207.0 [2023-02-24 18:35:46,471][177156] Sum rewards: 15.757, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.468', 'ARMOR': '0.004', 'AMMO2': '0.015', 'AMMO5': '0.017', 'WEAPON1': '0.050', 'weapon5': '0.074', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'AMMO3': '0.149', 'weapon4': '0.252', 'WEAPON5': '0.350', 'weapon2': '0.874', 'WEAPON3': '1.000', 'HITCOUNT': '1.370', 'weapon3': '2.456', 'DAMAGECOUNT': '4.689', 'FRAGCOUNT': '16.000'} [2023-02-24 18:35:46,613][177156] DAMAGECOUNT value on done: 141521.0 [2023-02-24 18:35:46,614][177156] Sum rewards: 8.231, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.477', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'AMMO2': '0.043', 'weapon5': '0.044', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.142', 'WEAPON5': '0.150', 'AMMO4': '0.215', 'weapon2': '0.294', 'WEAPON4': '0.600', 'WEAPON3': '0.850', 'weapon4': '1.004', 'HITCOUNT': '1.120', 'weapon3': '2.216', 'DAMAGECOUNT': '4.098', 'FRAGCOUNT': '10.000'} [2023-02-24 18:35:47,943][177153] Updated weights for policy 0, policy_version 14930 (0.0008) [2023-02-24 18:35:50,126][177170] DAMAGECOUNT value on done: 142016.0 [2023-02-24 18:35:50,126][177170] Sum rewards: 7.119, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.278', 'AMMO5': '0.019', 'AMMO2': '0.044', 'WEAPON1': '0.050', 'AMMO3': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.112', 'AMMO4': '0.220', 'weapon5': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'weapon4': '0.624', 'weapon2': '0.686', 'weapon3': '1.482', 'DAMAGECOUNT': '2.556', 'FRAGCOUNT': '9.000'} [2023-02-24 18:35:50,426][177170] DAMAGECOUNT value on done: 149139.0 [2023-02-24 18:35:50,427][177170] Sum rewards: 8.094, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.889', 'AMMO5': '0.010', 'AMMO2': '0.037', 'WEAPON1': '0.060', 'AMMO3': '0.120', 'AMMO4': '0.183', 'WEAPON4': '0.200', 'weapon5': '0.232', 'weapon4': '0.270', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'HITCOUNT': '0.830', 'weapon2': '1.378', 'weapon3': '1.748', 'DAMAGECOUNT': '3.465', 'FRAGCOUNT': '9.000'} [2023-02-24 18:35:50,475][177171] Large shaping reward 2.623 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.591, 197.0), ('weapon2', 0.002)] [2023-02-24 18:35:50,728][177170] DAMAGECOUNT value on done: 137820.0 [2023-02-24 18:35:50,729][177170] Sum rewards: 13.305, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO2': '0.002', 'AMMO4': '0.008', 'weapon5': '0.010', 'HEALTH': '0.010', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon4': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.138', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'ARMOR': '0.481', 'WEAPON3': '0.850', 'HITCOUNT': '1.100', 'weapon2': '1.452', 'weapon3': '2.240', 'DAMAGECOUNT': '3.900', 'FRAGCOUNT': '12.000'} [2023-02-24 18:35:50,906][177153] Updated weights for policy 0, policy_version 14940 (0.0008) [2023-02-24 18:35:51,018][177170] DAMAGECOUNT value on done: 141005.0 [2023-02-24 18:35:51,018][177170] Sum rewards: 7.569, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.234', 'AMMO2': '0.007', 'AMMO5': '0.014', 'AMMO4': '0.035', 'WEAPON1': '0.080', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'weapon5': '0.280', 'weapon4': '0.438', 'WEAPON5': '0.450', 'ARMOR': '0.459', 'WEAPON3': '0.850', 'HITCOUNT': '1.010', 'weapon2': '1.028', 'weapon3': '1.818', 'DAMAGECOUNT': '3.573', 'FRAGCOUNT': '7.000'} [2023-02-24 18:35:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 61198336. Throughput: 0: 3484.4. Samples: 15294032. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:35:51,376][177119] Avg episode reward: [(0, '11.076')] [2023-02-24 18:35:51,934][177158] DAMAGECOUNT value on done: 138386.0 [2023-02-24 18:35:51,934][177158] Sum rewards: 9.266, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.012', 'AMMO5': '0.010', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.136', 'weapon5': '0.208', 'WEAPON5': '0.250', 'weapon4': '0.270', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'HITCOUNT': '0.840', 'weapon2': '1.220', 'weapon3': '1.954', 'DAMAGECOUNT': '3.435', 'FRAGCOUNT': '10.000'} [2023-02-24 18:35:52,231][177158] DAMAGECOUNT value on done: 139729.0 [2023-02-24 18:35:52,232][177158] Sum rewards: 21.860, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.133', 'AMMO2': '0.016', 'AMMO5': '0.018', 'WEAPON1': '0.070', 'AMMO4': '0.080', 'AMMO3': '0.113', 'weapon7': '0.118', 'weapon5': '0.184', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'weapon4': '0.450', 'ARMOR': '0.453', 'weapon2': '0.776', 'WEAPON3': '0.800', 'HITCOUNT': '1.410', 'weapon3': '2.070', 'DAMAGECOUNT': '6.384', 'FRAGCOUNT': '17.000'} [2023-02-24 18:35:52,782][177158] DAMAGECOUNT value on done: 144820.0 [2023-02-24 18:35:52,782][177158] Sum rewards: 12.361, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.100', 'weapon7': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.060', 'AMMO4': '0.067', 'AMMO3': '0.151', 'weapon5': '0.196', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.316', 'WEAPON5': '0.400', 'ARMOR': '0.457', 'weapon2': '0.896', 'WEAPON3': '1.000', 'HITCOUNT': '1.240', 'weapon3': '2.192', 'DAMAGECOUNT': '4.806', 'FRAGCOUNT': '13.000'} [2023-02-24 18:35:53,095][177158] DAMAGECOUNT value on done: 142111.0 [2023-02-24 18:35:53,095][177158] Sum rewards: 11.249, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.307', 'AMMO5': '0.007', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'AMMO3': '0.130', 'AMMO4': '0.144', 'weapon5': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.296', 'WEAPON3': '0.800', 'HITCOUNT': '1.270', 'weapon2': '1.270', 'weapon3': '1.882', 'DAMAGECOUNT': '4.899', 'FRAGCOUNT': '10.000'} [2023-02-24 18:35:53,859][177153] Updated weights for policy 0, policy_version 14950 (0.0009) [2023-02-24 18:35:54,628][177172] DAMAGECOUNT value on done: 141102.0 [2023-02-24 18:35:54,629][177172] Sum rewards: 2.599, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.636', 'AMMO5': '0.010', 'AMMO2': '0.014', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO4': '0.070', 'weapon5': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.162', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.302', 'ARMOR': '0.400', 'weapon4': '0.478', 'HITCOUNT': '0.820', 'WEAPON3': '1.000', 'weapon3': '1.898', 'DAMAGECOUNT': '2.781', 'FRAGCOUNT': '5.000'} [2023-02-24 18:35:54,929][177172] DAMAGECOUNT value on done: 143052.0 [2023-02-24 18:35:54,929][177172] Sum rewards: 11.885, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.642', 'AMMO5': '0.012', 'AMMO2': '0.032', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO3': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.161', 'weapon5': '0.174', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.372', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'HITCOUNT': '0.930', 'weapon2': '1.260', 'weapon3': '1.654', 'DAMAGECOUNT': '4.473', 'FRAGCOUNT': '11.000'} [2023-02-24 18:35:55,794][177154] DAMAGECOUNT value on done: 147082.0 [2023-02-24 18:35:55,795][177154] Sum rewards: 16.370, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.763', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.028', 'weapon7': '0.072', 'AMMO3': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.164', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.608', 'WEAPON3': '0.750', 'HITCOUNT': '1.080', 'weapon2': '1.096', 'weapon3': '1.630', 'DAMAGECOUNT': '4.821', 'FRAGCOUNT': '15.000'} [2023-02-24 18:35:56,093][177154] DAMAGECOUNT value on done: 149057.0 [2023-02-24 18:35:56,093][177154] Sum rewards: 10.958, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.815', 'AMMO2': '0.018', 'AMMO5': '0.027', 'WEAPON1': '0.040', 'weapon7': '0.058', 'AMMO4': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.152', 'weapon5': '0.156', 'weapon4': '0.320', 'WEAPON5': '0.500', 'weapon2': '0.686', 'HITCOUNT': '0.990', 'WEAPON3': '1.050', 'weapon3': '2.214', 'DAMAGECOUNT': '4.320', 'FRAGCOUNT': '11.500'} [2023-02-24 18:35:56,349][177154] DAMAGECOUNT value on done: 147242.0 [2023-02-24 18:35:56,349][177154] Sum rewards: 11.152, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.264', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.047', 'weapon7': '0.052', 'AMMO4': '0.075', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.264', 'WEAPON3': '0.300', 'ARMOR': '0.483', 'weapon4': '0.568', 'HITCOUNT': '0.600', 'weapon2': '0.662', 'weapon3': '0.850', 'DAMAGECOUNT': '3.330', 'FRAGCOUNT': '7.000'} [2023-02-24 18:35:56,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 61267968. Throughput: 0: 3483.2. Samples: 15314892. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:35:56,376][177119] Avg episode reward: [(0, '11.284')] [2023-02-24 18:35:56,399][177172] DAMAGECOUNT value on done: 144048.0 [2023-02-24 18:35:56,400][177172] Sum rewards: 16.097, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.226', 'AMMO5': '0.012', 'AMMO2': '0.027', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.130', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'weapon5': '0.166', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.392', 'WEAPON3': '0.800', 'HITCOUNT': '1.110', 'weapon2': '1.148', 'weapon3': '1.720', 'DAMAGECOUNT': '4.755', 'FRAGCOUNT': '14.000'} [2023-02-24 18:35:56,650][177154] DAMAGECOUNT value on done: 148615.0 [2023-02-24 18:35:56,650][177154] Sum rewards: 13.226, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.460', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.035', 'WEAPON1': '0.060', 'AMMO3': '0.069', 'WEAPON4': '0.150', 'weapon5': '0.274', 'WEAPON5': '0.300', 'weapon4': '0.478', 'WEAPON3': '0.500', 'HITCOUNT': '0.820', 'weapon2': '1.220', 'weapon3': '1.690', 'DAMAGECOUNT': '3.825', 'FRAGCOUNT': '8.000'} [2023-02-24 18:35:56,701][177172] DAMAGECOUNT value on done: 145092.0 [2023-02-24 18:35:56,702][177172] Sum rewards: 9.069, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.945', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.050', 'AMMO4': '0.064', 'weapon7': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.122', 'WEAPON7': '0.200', 'weapon4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.514', 'WEAPON3': '0.800', 'HITCOUNT': '0.990', 'weapon3': '2.242', 'DAMAGECOUNT': '3.780', 'FRAGCOUNT': '8.500'} [2023-02-24 18:35:56,778][177153] Updated weights for policy 0, policy_version 14960 (0.0009) [2023-02-24 18:35:57,205][177157] DAMAGECOUNT value on done: 137610.0 [2023-02-24 18:35:57,205][177157] Sum rewards: 17.006, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.744', 'AMMO5': '0.027', 'AMMO2': '0.042', 'WEAPON1': '0.070', 'AMMO3': '0.095', 'AMMO4': '0.208', 'weapon5': '0.300', 'WEAPON4': '0.450', 'ARMOR': '0.455', 'weapon2': '0.596', 'WEAPON5': '0.600', 'WEAPON3': '0.600', 'weapon4': '0.896', 'HITCOUNT': '1.060', 'weapon3': '1.624', 'DAMAGECOUNT': '5.727', 'FRAGCOUNT': '14.000'} [2023-02-24 18:35:57,216][177157] DAMAGECOUNT value on done: 146149.0 [2023-02-24 18:35:57,217][177157] Sum rewards: 5.237, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.074', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'WEAPON1': '0.050', 'AMMO3': '0.070', 'weapon5': '0.162', 'WEAPON5': '0.250', 'HITCOUNT': '0.330', 'WEAPON3': '0.450', 'weapon3': '1.308', 'DAMAGECOUNT': '1.347', 'weapon2': '1.852', 'FRAGCOUNT': '4.000'} [2023-02-24 18:35:57,280][177171] DAMAGECOUNT value on done: 141412.0 [2023-02-24 18:35:57,280][177171] Sum rewards: 16.814, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.190', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.050', 'weapon5': '0.086', 'AMMO4': '0.090', 'AMMO3': '0.117', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.338', 'ARMOR': '0.505', 'WEAPON3': '0.850', 'weapon2': '1.056', 'HITCOUNT': '1.250', 'weapon3': '2.184', 'DAMAGECOUNT': '4.947', 'FRAGCOUNT': '15.000'} [2023-02-24 18:35:57,511][177157] DAMAGECOUNT value on done: 140542.0 [2023-02-24 18:35:57,512][177157] Sum rewards: 9.933, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.635', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.043', 'AMMO3': '0.106', 'weapon5': '0.114', 'AMMO4': '0.214', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.650', 'WEAPON3': '0.750', 'weapon2': '0.762', 'HITCOUNT': '1.060', 'weapon3': '1.626', 'DAMAGECOUNT': '3.516', 'FRAGCOUNT': '11.000'} [2023-02-24 18:35:57,523][177157] DAMAGECOUNT value on done: 140276.0 [2023-02-24 18:35:57,523][177157] Sum rewards: 11.396, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.404', 'AMMO5': '0.007', 'ARMOR': '0.015', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'weapon7': '0.048', 'weapon5': '0.062', 'AMMO4': '0.086', 'AMMO3': '0.093', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.432', 'WEAPON3': '0.600', 'HITCOUNT': '0.950', 'weapon3': '1.550', 'weapon2': '1.584', 'DAMAGECOUNT': '3.225', 'FRAGCOUNT': '9.000'} [2023-02-24 18:35:57,575][177171] DAMAGECOUNT value on done: 139915.0 [2023-02-24 18:35:57,576][177171] Sum rewards: 8.231, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.808', 'AMMO5': '0.012', 'AMMO2': '0.030', 'WEAPON1': '0.050', 'AMMO3': '0.130', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'weapon5': '0.186', 'weapon4': '0.234', 'WEAPON5': '0.300', 'HITCOUNT': '0.840', 'WEAPON3': '0.850', 'weapon2': '1.264', 'weapon3': '2.036', 'DAMAGECOUNT': '3.060', 'FRAGCOUNT': '8.000'} [2023-02-24 18:35:57,585][177171] DAMAGECOUNT value on done: 144644.0 [2023-02-24 18:35:57,586][177171] Sum rewards: 8.471, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.740', 'AMMO5': '0.010', 'AMMO2': '0.021', 'WEAPON1': '0.060', 'AMMO3': '0.085', 'weapon7': '0.096', 'weapon5': '0.106', 'AMMO4': '0.106', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'HITCOUNT': '0.580', 'WEAPON3': '0.650', 'weapon3': '1.300', 'weapon2': '1.972', 'DAMAGECOUNT': '2.184', 'FRAGCOUNT': '7.000'} [2023-02-24 18:35:57,877][177171] DAMAGECOUNT value on done: 137255.0 [2023-02-24 18:35:57,878][177171] Sum rewards: 11.382, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.057', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'weapon7': '0.114', 'weapon5': '0.118', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'weapon4': '0.416', 'HEALTH': '0.524', 'HITCOUNT': '0.610', 'weapon3': '1.076', 'weapon2': '1.358', 'DAMAGECOUNT': '3.192', 'FRAGCOUNT': '6.000'} [2023-02-24 18:35:58,662][177155] DAMAGECOUNT value on done: 144712.0 [2023-02-24 18:35:58,663][177155] Sum rewards: 16.613, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO2': '0.030', 'WEAPON1': '0.030', 'weapon7': '0.076', 'AMMO3': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'weapon5': '0.210', 'HEALTH': '0.283', 'WEAPON4': '0.350', 'WEAPON3': '0.550', 'weapon4': '0.696', 'weapon2': '1.004', 'HITCOUNT': '1.090', 'weapon3': '1.548', 'DAMAGECOUNT': '4.767', 'FRAGCOUNT': '15.000'} [2023-02-24 18:35:58,970][177155] DAMAGECOUNT value on done: 146256.0 [2023-02-24 18:35:58,971][177155] Sum rewards: 10.489, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.300', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.044', 'weapon7': '0.054', 'AMMO4': '0.087', 'AMMO3': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.462', 'WEAPON3': '0.650', 'HITCOUNT': '0.680', 'weapon2': '1.300', 'weapon3': '1.750', 'DAMAGECOUNT': '2.727', 'FRAGCOUNT': '9.000'} [2023-02-24 18:35:59,355][177155] DAMAGECOUNT value on done: 149103.0 [2023-02-24 18:35:59,356][177155] Sum rewards: 3.155, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.950', 'AMMO5': '0.013', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'weapon7': '0.072', 'AMMO4': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.122', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.266', 'weapon4': '0.306', 'WEAPON5': '0.400', 'HITCOUNT': '0.430', 'WEAPON3': '0.800', 'weapon2': '0.834', 'weapon3': '1.188', 'DAMAGECOUNT': '2.319', 'FRAGCOUNT': '5.000'} [2023-02-24 18:35:59,655][177155] DAMAGECOUNT value on done: 138851.0 [2023-02-24 18:35:59,655][177155] Sum rewards: 9.661, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.596', 'AMMO2': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.040', 'AMMO3': '0.048', 'weapon7': '0.048', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.196', 'WEAPON7': '0.200', 'weapon4': '0.236', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'HITCOUNT': '0.410', 'weapon2': '0.672', 'weapon3': '0.770', 'DAMAGECOUNT': '2.658', 'FRAGCOUNT': '7.000'} [2023-02-24 18:35:59,712][177153] Updated weights for policy 0, policy_version 14970 (0.0008) [2023-02-24 18:36:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 61337600. Throughput: 0: 3480.7. Samples: 15335736. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:36:01,376][177119] Avg episode reward: [(0, '11.399')] [2023-02-24 18:36:02,663][177153] Updated weights for policy 0, policy_version 14980 (0.0008) [2023-02-24 18:36:05,515][177156] DAMAGECOUNT value on done: 141777.0 [2023-02-24 18:36:05,515][177156] Sum rewards: 11.813, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.660', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.021', 'weapon7': '0.046', 'WEAPON1': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.101', 'AMMO4': '0.105', 'weapon5': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '0.550', 'weapon4': '0.664', 'HITCOUNT': '0.830', 'weapon3': '1.132', 'weapon2': '1.598', 'DAMAGECOUNT': '3.732', 'FRAGCOUNT': '10.000'} [2023-02-24 18:36:05,596][177153] Updated weights for policy 0, policy_version 14990 (0.0009) [2023-02-24 18:36:05,667][177156] DAMAGECOUNT value on done: 141410.0 [2023-02-24 18:36:05,668][177156] Sum rewards: 15.860, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.482', 'AMMO5': '0.011', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.072', 'weapon7': '0.078', 'AMMO3': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'weapon5': '0.230', 'weapon4': '0.252', 'WEAPON5': '0.400', 'ARMOR': '0.454', 'WEAPON3': '0.700', 'HITCOUNT': '0.750', 'weapon2': '1.284', 'weapon3': '1.698', 'DAMAGECOUNT': '4.017', 'FRAGCOUNT': '12.000'} [2023-02-24 18:36:05,824][177156] DAMAGECOUNT value on done: 143889.0 [2023-02-24 18:36:05,825][177156] Sum rewards: 18.695, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.398', 'weapon5': '0.002', 'AMMO5': '0.003', 'ARMOR': '0.004', 'WEAPON1': '0.030', 'AMMO2': '0.047', 'WEAPON5': '0.050', 'AMMO3': '0.132', 'weapon2': '0.222', 'AMMO4': '0.237', 'WEAPON4': '0.250', 'WEAPON3': '0.900', 'weapon4': '1.068', 'HITCOUNT': '1.490', 'weapon3': '2.112', 'DAMAGECOUNT': '5.046', 'FRAGCOUNT': '18.000'} [2023-02-24 18:36:05,976][177156] DAMAGECOUNT value on done: 142212.0 [2023-02-24 18:36:05,977][177156] Sum rewards: 10.440, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'AMMO3': '0.085', 'AMMO4': '0.136', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.224', 'weapon4': '0.268', 'WEAPON3': '0.400', 'HEALTH': '0.440', 'HITCOUNT': '0.470', 'weapon3': '1.336', 'weapon2': '1.800', 'DAMAGECOUNT': '2.073', 'FRAGCOUNT': '8.000'} [2023-02-24 18:36:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 61407232. Throughput: 0: 3481.6. Samples: 15346200. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:36:06,376][177119] Avg episode reward: [(0, '11.624')] [2023-02-24 18:36:08,514][177153] Updated weights for policy 0, policy_version 15000 (0.0008) [2023-02-24 18:36:09,406][177170] DAMAGECOUNT value on done: 143312.0 [2023-02-24 18:36:09,406][177170] Sum rewards: 11.819, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.894', 'AMMO5': '0.016', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'weapon4': '0.046', 'weapon7': '0.050', 'AMMO3': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.107', 'WEAPON4': '0.200', 'weapon5': '0.240', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '0.910', 'weapon2': '1.320', 'weapon3': '1.982', 'DAMAGECOUNT': '3.888', 'FRAGCOUNT': '11.500'} [2023-02-24 18:36:09,704][177170] DAMAGECOUNT value on done: 150634.0 [2023-02-24 18:36:09,705][177170] Sum rewards: 9.284, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.548', 'AMMO5': '0.010', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'AMMO4': '0.099', 'AMMO3': '0.151', 'weapon5': '0.178', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.446', 'ARMOR': '0.453', 'WEAPON3': '1.000', 'weapon2': '1.000', 'HITCOUNT': '1.040', 'weapon3': '1.810', 'DAMAGECOUNT': '4.485', 'FRAGCOUNT': '11.000'} [2023-02-24 18:36:09,952][177170] DAMAGECOUNT value on done: 138280.0 [2023-02-24 18:36:09,953][177170] Sum rewards: 6.699, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.573', 'AMMO5': '0.015', 'AMMO2': '0.020', 'AMMO3': '0.042', 'WEAPON1': '0.050', 'weapon7': '0.060', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'weapon5': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.216', 'HITCOUNT': '0.280', 'WEAPON3': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.489', 'weapon3': '0.876', 'DAMAGECOUNT': '1.380', 'weapon2': '1.450', 'FRAGCOUNT': '4.000'} [2023-02-24 18:36:10,242][177170] DAMAGECOUNT value on done: 142234.0 [2023-02-24 18:36:10,242][177170] Sum rewards: 16.252, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.012', 'AMMO2': '0.039', 'WEAPON1': '0.060', 'AMMO3': '0.080', 'weapon5': '0.184', 'AMMO4': '0.193', 'WEAPON4': '0.200', 'weapon4': '0.246', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.880', 'HEALTH': '1.094', 'weapon2': '1.224', 'weapon3': '1.802', 'DAMAGECOUNT': '3.687', 'FRAGCOUNT': '13.000'} [2023-02-24 18:36:11,265][177158] DAMAGECOUNT value on done: 139410.0 [2023-02-24 18:36:11,266][177158] Sum rewards: 13.086, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.109', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.062', 'AMMO3': '0.067', 'WEAPON4': '0.100', 'weapon7': '0.114', 'weapon5': '0.134', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.248', 'WEAPON7': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.491', 'HITCOUNT': '0.600', 'weapon2': '1.010', 'weapon3': '1.136', 'DAMAGECOUNT': '3.072', 'FRAGCOUNT': '10.000'} [2023-02-24 18:36:11,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 61476864. Throughput: 0: 3476.7. Samples: 15367046. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:36:11,376][177119] Avg episode reward: [(0, '11.662')] [2023-02-24 18:36:11,490][177153] Updated weights for policy 0, policy_version 15010 (0.0008) [2023-02-24 18:36:11,565][177158] DAMAGECOUNT value on done: 140600.0 [2023-02-24 18:36:11,565][177158] Sum rewards: 1.146, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.762', 'AMMO2': '0.011', 'AMMO5': '0.028', 'AMMO4': '0.057', 'WEAPON1': '0.060', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon5': '0.224', 'weapon4': '0.272', 'WEAPON5': '0.550', 'HITCOUNT': '0.710', 'weapon2': '0.818', 'WEAPON3': '1.000', 'weapon3': '2.190', 'DAMAGECOUNT': '2.613', 'FRAGCOUNT': '5.000'} [2023-02-24 18:36:12,132][177158] DAMAGECOUNT value on done: 145992.0 [2023-02-24 18:36:12,132][177158] Sum rewards: 10.443, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.646', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.040', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'weapon5': '0.162', 'weapon4': '0.216', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'HITCOUNT': '0.920', 'weapon2': '1.538', 'weapon3': '1.742', 'DAMAGECOUNT': '3.516', 'FRAGCOUNT': '10.000'} [2023-02-24 18:36:12,430][177158] DAMAGECOUNT value on done: 144292.0 [2023-02-24 18:36:12,430][177158] Sum rewards: 16.921, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.060', 'AMMO5': '0.014', 'AMMO2': '0.030', 'WEAPON1': '0.040', 'weapon7': '0.056', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.151', 'AMMO3': '0.155', 'weapon5': '0.158', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.352', 'weapon2': '0.954', 'WEAPON3': '1.000', 'HITCOUNT': '1.580', 'weapon3': '2.108', 'DAMAGECOUNT': '6.543', 'FRAGCOUNT': '16.000'} [2023-02-24 18:36:13,966][177172] DAMAGECOUNT value on done: 142117.0 [2023-02-24 18:36:13,966][177172] Sum rewards: 2.937, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.234', 'AMMO5': '0.016', 'ARMOR': '0.020', 'AMMO2': '0.035', 'WEAPON1': '0.050', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.117', 'weapon5': '0.130', 'AMMO4': '0.177', 'weapon4': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.810', 'weapon2': '1.428', 'weapon3': '1.774', 'DAMAGECOUNT': '3.045', 'FRAGCOUNT': '5.000'} [2023-02-24 18:36:14,268][177172] DAMAGECOUNT value on done: 144088.0 [2023-02-24 18:36:14,269][177172] Sum rewards: 8.126, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.158', 'AMMO5': '0.018', 'AMMO2': '0.030', 'WEAPON1': '0.070', 'AMMO3': '0.104', 'AMMO4': '0.152', 'weapon5': '0.284', 'WEAPON4': '0.300', 'weapon4': '0.530', 'WEAPON5': '0.550', 'HITCOUNT': '0.640', 'WEAPON3': '0.700', 'weapon2': '1.194', 'weapon3': '1.604', 'DAMAGECOUNT': '3.108', 'FRAGCOUNT': '9.000'} [2023-02-24 18:36:14,425][177153] Updated weights for policy 0, policy_version 15020 (0.0008) [2023-02-24 18:36:14,874][177154] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:36:15,132][177154] DAMAGECOUNT value on done: 149013.0 [2023-02-24 18:36:15,132][177154] Sum rewards: 16.552, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.723', 'AMMO5': '0.014', 'AMMO2': '0.018', 'AMMO3': '0.051', 'weapon7': '0.054', 'WEAPON1': '0.070', 'AMMO4': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.250', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.400', 'weapon2': '0.516', 'weapon4': '0.704', 'weapon3': '1.052', 'HITCOUNT': '1.120', 'DAMAGECOUNT': '5.493', 'FRAGCOUNT': '12.000'} [2023-02-24 18:36:15,428][177154] DAMAGECOUNT value on done: 150858.0 [2023-02-24 18:36:15,428][177154] Sum rewards: 11.729, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.845', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'weapon7': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.142', 'weapon5': '0.146', 'AMMO4': '0.158', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.276', 'ARMOR': '0.416', 'WEAPON4': '0.700', 'WEAPON3': '0.900', 'weapon4': '1.342', 'HITCOUNT': '1.430', 'weapon3': '1.646', 'DAMAGECOUNT': '5.403', 'FRAGCOUNT': '14.000'} [2023-02-24 18:36:15,684][177154] DAMAGECOUNT value on done: 148631.0 [2023-02-24 18:36:15,685][177154] Sum rewards: 10.738, reward structure: {'DEATHCOUNT': '-6.750', 'weapon7': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'AMMO4': '0.116', 'HEALTH': '0.140', 'weapon5': '0.158', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'weapon4': '0.418', 'WEAPON3': '0.550', 'HITCOUNT': '0.950', 'weapon2': '1.214', 'weapon3': '1.762', 'DAMAGECOUNT': '4.167', 'FRAGCOUNT': '6.500'} [2023-02-24 18:36:15,742][177172] DAMAGECOUNT value on done: 144814.0 [2023-02-24 18:36:15,743][177172] Sum rewards: 6.422, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.752', 'AMMO5': '0.010', 'AMMO2': '0.027', 'WEAPON1': '0.050', 'weapon5': '0.104', 'AMMO3': '0.115', 'AMMO4': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.396', 'HITCOUNT': '0.670', 'WEAPON3': '0.750', 'weapon2': '1.468', 'weapon3': '1.704', 'DAMAGECOUNT': '2.298', 'FRAGCOUNT': '8.000'} [2023-02-24 18:36:15,986][177154] DAMAGECOUNT value on done: 150441.0 [2023-02-24 18:36:15,986][177154] Sum rewards: 21.190, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.365', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.062', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'weapon7': '0.148', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.242', 'WEAPON3': '0.650', 'HITCOUNT': '1.190', 'weapon2': '1.496', 'weapon3': '1.892', 'DAMAGECOUNT': '5.271', 'FRAGCOUNT': '17.000'} [2023-02-24 18:36:16,044][177172] DAMAGECOUNT value on done: 147031.0 [2023-02-24 18:36:16,045][177172] Sum rewards: 15.263, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.478', 'AMMO2': '0.010', 'AMMO5': '0.014', 'AMMO4': '0.049', 'WEAPON1': '0.060', 'AMMO3': '0.142', 'weapon5': '0.172', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.540', 'weapon2': '0.788', 'WEAPON3': '0.900', 'HITCOUNT': '1.250', 'weapon3': '2.148', 'DAMAGECOUNT': '5.817', 'FRAGCOUNT': '14.000'} [2023-02-24 18:36:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 61546496. Throughput: 0: 3475.8. Samples: 15387932. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:36:16,376][177119] Avg episode reward: [(0, '11.781')] [2023-02-24 18:36:16,561][177157] DAMAGECOUNT value on done: 138619.0 [2023-02-24 18:36:16,562][177157] Sum rewards: 7.613, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.702', 'AMMO5': '0.015', 'AMMO2': '0.027', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.137', 'weapon5': '0.184', 'weapon4': '0.390', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'HITCOUNT': '0.670', 'weapon2': '0.742', 'WEAPON3': '1.000', 'weapon3': '1.960', 'DAMAGECOUNT': '3.027', 'FRAGCOUNT': '9.000'} [2023-02-24 18:36:16,569][177171] DAMAGECOUNT value on done: 143106.0 [2023-02-24 18:36:16,569][177171] Sum rewards: 10.116, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.815', 'AMMO2': '0.013', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'weapon7': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.188', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.478', 'weapon2': '0.566', 'WEAPON3': '0.850', 'HITCOUNT': '1.150', 'weapon3': '1.834', 'DAMAGECOUNT': '5.082', 'FRAGCOUNT': '8.000'} [2023-02-24 18:36:16,573][177157] DAMAGECOUNT value on done: 148117.0 [2023-02-24 18:36:16,573][177157] Sum rewards: 21.448, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.474', 'AMMO5': '0.012', 'AMMO2': '0.026', 'WEAPON1': '0.040', 'AMMO4': '0.129', 'weapon5': '0.150', 'AMMO3': '0.152', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.404', 'weapon4': '0.604', 'weapon2': '0.634', 'WEAPON3': '0.900', 'HITCOUNT': '1.500', 'weapon3': '2.216', 'DAMAGECOUNT': '5.904', 'FRAGCOUNT': '20.000'} [2023-02-24 18:36:16,860][177171] DAMAGECOUNT value on done: 141289.0 [2023-02-24 18:36:16,861][177171] Sum rewards: 11.250, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.915', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.003', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'weapon4': '0.030', 'weapon5': '0.068', 'weapon7': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.158', 'WEAPON7': '0.200', 'HITCOUNT': '1.100', 'WEAPON3': '1.150', 'weapon2': '1.398', 'weapon3': '2.126', 'DAMAGECOUNT': '4.122', 'FRAGCOUNT': '13.000'} [2023-02-24 18:36:16,870][177157] DAMAGECOUNT value on done: 142116.0 [2023-02-24 18:36:16,870][177171] DAMAGECOUNT value on done: 145578.0 [2023-02-24 18:36:16,871][177157] Sum rewards: 13.238, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.420', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.049', 'weapon5': '0.052', 'WEAPON4': '0.100', 'weapon7': '0.114', 'AMMO3': '0.135', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.234', 'WEAPON7': '0.300', 'WEAPON3': '0.900', 'HITCOUNT': '1.230', 'weapon2': '1.586', 'weapon3': '1.808', 'DAMAGECOUNT': '4.722', 'FRAGCOUNT': '11.000'} [2023-02-24 18:36:16,871][177171] Sum rewards: 7.142, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.364', 'AMMO5': '0.015', 'AMMO2': '0.023', 'weapon7': '0.050', 'WEAPON1': '0.090', 'AMMO3': '0.095', 'AMMO4': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.212', 'WEAPON4': '0.250', 'weapon4': '0.340', 'weapon2': '0.426', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'HITCOUNT': '0.710', 'weapon3': '1.536', 'DAMAGECOUNT': '2.802', 'FRAGCOUNT': '7.000'} [2023-02-24 18:36:16,881][177157] DAMAGECOUNT value on done: 141572.0 [2023-02-24 18:36:16,882][177157] Sum rewards: 10.517, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.018', 'WEAPON1': '0.030', 'AMMO2': '0.044', 'AMMO3': '0.086', 'weapon7': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HEALTH': '0.194', 'AMMO4': '0.218', 'weapon5': '0.268', 'weapon2': '0.374', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.690', 'weapon4': '0.906', 'weapon3': '1.160', 'DAMAGECOUNT': '3.888', 'FRAGCOUNT': '10.000'} [2023-02-24 18:36:17,167][177171] DAMAGECOUNT value on done: 139011.0 [2023-02-24 18:36:17,168][177171] Sum rewards: 14.484, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.098', 'AMMO5': '0.009', 'AMMO2': '0.017', 'WEAPON1': '0.050', 'AMMO4': '0.083', 'weapon5': '0.166', 'AMMO3': '0.175', 'WEAPON5': '0.250', 'weapon2': '0.976', 'WEAPON3': '1.200', 'HITCOUNT': '1.290', 'weapon3': '2.598', 'DAMAGECOUNT': '5.268', 'FRAGCOUNT': '15.000'} [2023-02-24 18:36:17,374][177153] Updated weights for policy 0, policy_version 15030 (0.0008) [2023-02-24 18:36:18,070][177155] DAMAGECOUNT value on done: 145864.0 [2023-02-24 18:36:18,070][177155] Sum rewards: 8.002, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.842', 'AMMO2': '0.016', 'AMMO5': '0.017', 'WEAPON1': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.108', 'weapon5': '0.238', 'WEAPON4': '0.300', 'weapon4': '0.384', 'ARMOR': '0.471', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'HITCOUNT': '0.790', 'weapon2': '0.844', 'weapon3': '1.842', 'DAMAGECOUNT': '3.456', 'FRAGCOUNT': '9.000'} [2023-02-24 18:36:18,369][177155] DAMAGECOUNT value on done: 147490.0 [2023-02-24 18:36:18,370][177155] Sum rewards: 8.030, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.800', 'AMMO5': '0.022', 'AMMO2': '0.025', 'WEAPON1': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'weapon5': '0.202', 'weapon4': '0.298', 'WEAPON5': '0.550', 'weapon2': '0.664', 'WEAPON3': '0.950', 'HITCOUNT': '1.040', 'weapon3': '2.370', 'DAMAGECOUNT': '3.702', 'FRAGCOUNT': '8.500'} [2023-02-24 18:36:18,755][177155] DAMAGECOUNT value on done: 150565.0 [2023-02-24 18:36:18,755][177155] Sum rewards: 13.690, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.326', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'weapon7': '0.036', 'weapon5': '0.090', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.128', 'AMMO4': '0.179', 'WEAPON4': '0.250', 'weapon2': '0.536', 'WEAPON3': '0.750', 'weapon4': '0.898', 'HITCOUNT': '1.080', 'weapon3': '1.472', 'DAMAGECOUNT': '4.386', 'FRAGCOUNT': '12.000'} [2023-02-24 18:36:19,058][177155] DAMAGECOUNT value on done: 140127.0 [2023-02-24 18:36:19,058][177155] Sum rewards: 8.037, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.550', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.030', 'WEAPON1': '0.070', 'AMMO3': '0.141', 'WEAPON4': '0.200', 'weapon5': '0.294', 'weapon4': '0.306', 'WEAPON5': '0.350', 'WEAPON3': '0.950', 'HITCOUNT': '0.980', 'weapon2': '1.076', 'weapon3': '1.846', 'DAMAGECOUNT': '3.828', 'FRAGCOUNT': '10.000'} [2023-02-24 18:36:20,338][177153] Updated weights for policy 0, policy_version 15040 (0.0008) [2023-02-24 18:36:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 61616128. Throughput: 0: 3476.5. Samples: 15398336. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:36:21,376][177119] Avg episode reward: [(0, '11.532')] [2023-02-24 18:36:23,281][177153] Updated weights for policy 0, policy_version 15050 (0.0008) [2023-02-24 18:36:24,785][177156] DAMAGECOUNT value on done: 143336.0 [2023-02-24 18:36:24,785][177156] Sum rewards: 17.123, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.798', 'AMMO5': '0.018', 'AMMO2': '0.028', 'WEAPON1': '0.070', 'AMMO3': '0.114', 'AMMO4': '0.138', 'weapon4': '0.148', 'weapon5': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'ARMOR': '0.934', 'weapon2': '1.150', 'HITCOUNT': '1.210', 'weapon3': '2.092', 'DAMAGECOUNT': '4.677', 'FRAGCOUNT': '14.000'} [2023-02-24 18:36:24,915][177156] DAMAGECOUNT value on done: 142419.0 [2023-02-24 18:36:24,916][177156] Sum rewards: 10.802, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.200', 'AMMO2': '0.010', 'AMMO5': '0.020', 'AMMO4': '0.050', 'AMMO3': '0.076', 'WEAPON1': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.224', 'weapon4': '0.424', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'weapon2': '1.072', 'weapon3': '1.658', 'DAMAGECOUNT': '3.027', 'FRAGCOUNT': '8.000'} [2023-02-24 18:36:25,084][177156] DAMAGECOUNT value on done: 144246.0 [2023-02-24 18:36:25,085][177156] Sum rewards: 2.222, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.041', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.033', 'weapon7': '0.048', 'AMMO3': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.163', 'weapon5': '0.168', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.216', 'HITCOUNT': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'weapon4': '0.816', 'weapon3': '0.966', 'DAMAGECOUNT': '1.071', 'FRAGCOUNT': '4.000'} [2023-02-24 18:36:25,219][177156] DAMAGECOUNT value on done: 143334.0 [2023-02-24 18:36:25,219][177156] Sum rewards: 11.799, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.046', 'WEAPON1': '0.060', 'HEALTH': '0.070', 'AMMO3': '0.096', 'WEAPON4': '0.200', 'weapon5': '0.218', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'weapon4': '0.612', 'HITCOUNT': '0.700', 'weapon2': '1.044', 'weapon3': '1.572', 'DAMAGECOUNT': '3.261', 'FRAGCOUNT': '9.000'} [2023-02-24 18:36:26,229][177153] Updated weights for policy 0, policy_version 15060 (0.0009) [2023-02-24 18:36:26,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 61685760. Throughput: 0: 3477.7. Samples: 15419216. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:36:26,376][177119] Avg episode reward: [(0, '11.612')] [2023-02-24 18:36:28,755][177170] DAMAGECOUNT value on done: 144423.0 [2023-02-24 18:36:28,755][177170] Sum rewards: 3.875, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.302', 'AMMO5': '0.007', 'AMMO2': '0.038', 'WEAPON1': '0.040', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.118', 'weapon5': '0.158', 'AMMO4': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.408', 'weapon2': '0.790', 'HITCOUNT': '0.810', 'weapon4': '0.826', 'WEAPON3': '0.850', 'weapon3': '1.698', 'DAMAGECOUNT': '3.093', 'FRAGCOUNT': '5.000'} [2023-02-24 18:36:29,060][177170] DAMAGECOUNT value on done: 152360.0 [2023-02-24 18:36:29,060][177170] Sum rewards: 14.617, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.974', 'ARMOR': '0.004', 'AMMO5': '0.030', 'AMMO2': '0.054', 'WEAPON1': '0.070', 'AMMO3': '0.125', 'weapon5': '0.178', 'AMMO4': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon2': '0.720', 'WEAPON3': '0.850', 'weapon4': '0.914', 'HITCOUNT': '1.400', 'weapon3': '1.696', 'DAMAGECOUNT': '5.178', 'FRAGCOUNT': '13.000'} [2023-02-24 18:36:29,193][177153] Updated weights for policy 0, policy_version 15070 (0.0008) [2023-02-24 18:36:29,291][177170] DAMAGECOUNT value on done: 139502.0 [2023-02-24 18:36:29,292][177170] Sum rewards: 9.276, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.438', 'AMMO5': '0.010', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'weapon5': '0.118', 'AMMO4': '0.139', 'AMMO3': '0.151', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.400', 'HITCOUNT': '0.990', 'WEAPON3': '1.000', 'weapon2': '1.166', 'weapon3': '2.006', 'DAMAGECOUNT': '3.666', 'FRAGCOUNT': '12.000'} [2023-02-24 18:36:29,594][177170] DAMAGECOUNT value on done: 143334.0 [2023-02-24 18:36:29,595][177170] Sum rewards: 11.136, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.482', 'AMMO5': '0.010', 'AMMO2': '0.049', 'WEAPON1': '0.060', 'weapon7': '0.074', 'AMMO3': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.142', 'AMMO4': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.396', 'WEAPON3': '0.500', 'HITCOUNT': '0.600', 'weapon2': '1.022', 'weapon3': '1.484', 'DAMAGECOUNT': '3.300', 'FRAGCOUNT': '11.000'} [2023-02-24 18:36:30,566][177158] DAMAGECOUNT value on done: 140380.0 [2023-02-24 18:36:30,566][177158] Sum rewards: 4.972, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.846', 'AMMO5': '0.015', 'AMMO2': '0.021', 'weapon4': '0.042', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.125', 'weapon5': '0.218', 'WEAPON5': '0.350', 'HITCOUNT': '0.770', 'WEAPON3': '0.800', 'weapon2': '1.092', 'weapon3': '2.210', 'DAMAGECOUNT': '2.910', 'FRAGCOUNT': '6.000'} [2023-02-24 18:36:30,872][177158] DAMAGECOUNT value on done: 141484.0 [2023-02-24 18:36:30,873][177158] Sum rewards: 4.728, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.845', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.034', 'WEAPON1': '0.050', 'AMMO3': '0.108', 'AMMO4': '0.168', 'weapon5': '0.178', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.302', 'HITCOUNT': '0.670', 'WEAPON3': '0.750', 'weapon2': '1.460', 'weapon3': '1.774', 'DAMAGECOUNT': '2.652', 'FRAGCOUNT': '3.000'} [2023-02-24 18:36:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.5, 300 sec: 13940.3). Total num frames: 61755392. Throughput: 0: 3476.1. Samples: 15440050. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:36:31,376][177119] Avg episode reward: [(0, '11.450')] [2023-02-24 18:36:31,461][177158] DAMAGECOUNT value on done: 147345.0 [2023-02-24 18:36:31,461][177158] Sum rewards: 7.857, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.410', 'AMMO5': '0.008', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'weapon7': '0.058', 'AMMO3': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.108', 'weapon5': '0.144', 'WEAPON5': '0.200', 'weapon2': '0.426', 'weapon4': '0.434', 'WEAPON3': '0.600', 'HITCOUNT': '0.780', 'weapon3': '1.402', 'DAMAGECOUNT': '4.059', 'FRAGCOUNT': '5.500'} [2023-02-24 18:36:31,765][177158] DAMAGECOUNT value on done: 145647.0 [2023-02-24 18:36:31,765][177158] Sum rewards: 11.442, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.175', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO3': '0.089', 'AMMO4': '0.100', 'weapon7': '0.108', 'weapon5': '0.160', 'WEAPON5': '0.250', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON4': '0.400', 'WEAPON7': '0.400', 'weapon2': '0.510', 'ARMOR': '0.516', 'WEAPON3': '0.550', 'HITCOUNT': '0.800', 'weapon4': '0.910', 'weapon3': '1.656', 'DAMAGECOUNT': '4.065', 'FRAGCOUNT': '9.000'} [2023-02-24 18:36:32,152][177153] Updated weights for policy 0, policy_version 15080 (0.0008) [2023-02-24 18:36:33,301][177172] DAMAGECOUNT value on done: 143221.0 [2023-02-24 18:36:33,302][177172] Sum rewards: 7.061, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.026', 'AMMO2': '0.008', 'AMMO5': '0.020', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'WEAPON1': '0.100', 'AMMO3': '0.107', 'weapon4': '0.166', 'weapon5': '0.308', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'HITCOUNT': '0.940', 'weapon2': '1.534', 'weapon3': '1.654', 'DAMAGECOUNT': '3.312', 'FRAGCOUNT': '6.000'} [2023-02-24 18:36:33,595][177172] DAMAGECOUNT value on done: 145234.0 [2023-02-24 18:36:33,595][177172] Sum rewards: 16.115, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'AMMO2': '0.037', 'AMMO3': '0.074', 'weapon5': '0.088', 'WEAPON5': '0.150', 'weapon7': '0.180', 'AMMO4': '0.183', 'WEAPON4': '0.200', 'AMMO6': '0.320', 'AMMO7': '0.320', 'HEALTH': '0.351', 'WEAPON7': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.780', 'ARMOR': '0.800', 'weapon4': '0.854', 'weapon2': '1.126', 'weapon3': '1.306', 'DAMAGECOUNT': '3.438', 'FRAGCOUNT': '11.000'} [2023-02-24 18:36:34,400][177154] DAMAGECOUNT value on done: 149916.0 [2023-02-24 18:36:34,400][177154] Sum rewards: 1.455, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.762', 'AMMO5': '0.029', 'WEAPON1': '0.060', 'AMMO3': '0.070', 'AMMO2': '0.071', 'weapon7': '0.132', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.214', 'AMMO4': '0.357', 'weapon3': '0.398', 'WEAPON3': '0.400', 'ARMOR': '0.408', 'WEAPON5': '0.500', 'HITCOUNT': '0.530', 'weapon2': '0.546', 'WEAPON4': '0.550', 'weapon4': '1.392', 'DAMAGECOUNT': '2.709', 'FRAGCOUNT': '3.000'} [2023-02-24 18:36:34,705][177154] DAMAGECOUNT value on done: 152287.0 [2023-02-24 18:36:34,706][177154] Sum rewards: 8.248, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.500', 'weapon7': '0.012', 'AMMO5': '0.025', 'AMMO2': '0.025', 'weapon4': '0.092', 'WEAPON1': '0.110', 'AMMO4': '0.126', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.252', 'WEAPON5': '0.600', 'HITCOUNT': '0.890', 'weapon2': '0.964', 'WEAPON3': '1.200', 'weapon3': '2.184', 'DAMAGECOUNT': '4.287', 'FRAGCOUNT': '11.000'} [2023-02-24 18:36:34,985][177154] DAMAGECOUNT value on done: 149582.0 [2023-02-24 18:36:34,986][177154] Sum rewards: 8.604, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.822', 'AMMO5': '0.007', 'weapon5': '0.028', 'AMMO2': '0.031', 'WEAPON1': '0.050', 'AMMO3': '0.101', 'weapon7': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'weapon2': '0.414', 'weapon4': '0.494', 'HITCOUNT': '0.580', 'WEAPON3': '0.650', 'weapon3': '1.380', 'DAMAGECOUNT': '2.835', 'FRAGCOUNT': '8.000'} [2023-02-24 18:36:35,066][177153] Updated weights for policy 0, policy_version 15090 (0.0009) [2023-02-24 18:36:35,071][177172] DAMAGECOUNT value on done: 146104.0 [2023-02-24 18:36:35,072][177172] Sum rewards: 12.501, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.500', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.077', 'AMMO3': '0.082', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.242', 'WEAPON3': '0.700', 'ARMOR': '0.909', 'HITCOUNT': '0.960', 'weapon2': '1.700', 'weapon3': '1.758', 'DAMAGECOUNT': '3.870', 'FRAGCOUNT': '10.000'} [2023-02-24 18:36:35,282][177154] DAMAGECOUNT value on done: 152326.0 [2023-02-24 18:36:35,282][177154] Sum rewards: 20.010, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.380', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.094', 'weapon5': '0.174', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.650', 'HITCOUNT': '1.300', 'weapon2': '1.636', 'weapon3': '1.906', 'DAMAGECOUNT': '5.655', 'FRAGCOUNT': '14.000'} [2023-02-24 18:36:35,368][177172] DAMAGECOUNT value on done: 147766.0 [2023-02-24 18:36:35,369][177172] Sum rewards: 7.184, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.720', 'AMMO5': '0.011', 'AMMO2': '0.017', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'AMMO3': '0.070', 'AMMO4': '0.087', 'weapon7': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.164', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.410', 'WEAPON3': '0.500', 'HITCOUNT': '0.590', 'weapon2': '1.230', 'weapon3': '1.244', 'DAMAGECOUNT': '2.205', 'FRAGCOUNT': '5.500'} [2023-02-24 18:36:35,845][177157] DAMAGECOUNT value on done: 139539.0 [2023-02-24 18:36:35,846][177157] Sum rewards: 6.792, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.020', 'AMMO2': '0.033', 'WEAPON1': '0.060', 'weapon7': '0.088', 'AMMO3': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.165', 'weapon5': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'HEALTH': '0.490', 'WEAPON3': '0.600', 'weapon4': '0.696', 'weapon2': '0.718', 'HITCOUNT': '0.850', 'ARMOR': '0.948', 'weapon3': '1.724', 'DAMAGECOUNT': '2.760', 'FRAGCOUNT': '6.000'} [2023-02-24 18:36:35,858][177157] DAMAGECOUNT value on done: 150024.0 [2023-02-24 18:36:35,858][177157] Sum rewards: 12.626, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.156', 'AMMO2': '0.010', 'AMMO5': '0.022', 'AMMO4': '0.052', 'WEAPON1': '0.060', 'weapon7': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'weapon4': '0.218', 'WEAPON5': '0.400', 'ARMOR': '0.448', 'weapon2': '0.658', 'WEAPON3': '1.150', 'HITCOUNT': '1.270', 'weapon3': '2.442', 'DAMAGECOUNT': '5.721', 'FRAGCOUNT': '12.000'} [2023-02-24 18:36:35,900][177171] DAMAGECOUNT value on done: 144420.0 [2023-02-24 18:36:35,901][177171] Sum rewards: 10.892, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.807', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.047', 'AMMO3': '0.062', 'weapon5': '0.100', 'weapon7': '0.196', 'AMMO4': '0.234', 'WEAPON5': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'WEAPON4': '0.550', 'weapon2': '0.704', 'HITCOUNT': '0.820', 'weapon4': '1.034', 'weapon3': '1.256', 'DAMAGECOUNT': '3.942', 'FRAGCOUNT': '10.000'} [2023-02-24 18:36:36,158][177157] DAMAGECOUNT value on done: 142983.0 [2023-02-24 18:36:36,158][177157] Sum rewards: 5.616, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.544', 'AMMO5': '0.012', 'AMMO2': '0.029', 'WEAPON1': '0.050', 'weapon7': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.106', 'AMMO3': '0.133', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'weapon4': '0.548', 'HITCOUNT': '0.770', 'WEAPON3': '0.850', 'weapon2': '1.020', 'weapon3': '1.780', 'DAMAGECOUNT': '2.601', 'FRAGCOUNT': '6.000'} [2023-02-24 18:36:36,168][177157] DAMAGECOUNT value on done: 142948.0 [2023-02-24 18:36:36,169][177157] Sum rewards: 10.797, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.202', 'ARMOR': '0.004', 'AMMO2': '0.010', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.052', 'AMMO3': '0.070', 'weapon7': '0.112', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon5': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'WEAPON3': '0.400', 'weapon2': '0.580', 'weapon4': '0.628', 'HITCOUNT': '0.670', 'weapon3': '1.576', 'DAMAGECOUNT': '3.825', 'FRAGCOUNT': '8.000'} [2023-02-24 18:36:36,199][177171] DAMAGECOUNT value on done: 142509.0 [2023-02-24 18:36:36,199][177171] Sum rewards: 9.255, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.000', 'AMMO2': '0.008', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'AMMO4': '0.041', 'weapon5': '0.098', 'AMMO3': '0.124', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.580', 'HITCOUNT': '0.820', 'WEAPON3': '0.850', 'ARMOR': '0.884', 'weapon2': '1.368', 'weapon3': '1.614', 'DAMAGECOUNT': '3.660', 'FRAGCOUNT': '11.000'} [2023-02-24 18:36:36,212][177171] DAMAGECOUNT value on done: 147242.0 [2023-02-24 18:36:36,213][177171] Sum rewards: 13.383, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.626', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'AMMO3': '0.157', 'weapon5': '0.222', 'weapon4': '0.298', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'weapon2': '1.038', 'HITCOUNT': '1.140', 'weapon3': '2.010', 'DAMAGECOUNT': '4.992', 'FRAGCOUNT': '14.000'} [2023-02-24 18:36:36,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 61825024. Throughput: 0: 3478.1. Samples: 15450546. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:36:36,376][177119] Avg episode reward: [(0, '10.983')] [2023-02-24 18:36:36,516][177171] DAMAGECOUNT value on done: 141690.0 [2023-02-24 18:36:36,516][177171] Sum rewards: 21.667, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.686', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'weapon7': '0.068', 'weapon5': '0.090', 'AMMO4': '0.099', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'AMMO3': '0.208', 'weapon4': '0.264', 'WEAPON5': '0.350', 'weapon2': '0.482', 'WEAPON3': '1.400', 'HITCOUNT': '1.850', 'weapon3': '2.830', 'DAMAGECOUNT': '8.001', 'FRAGCOUNT': '20.000'} [2023-02-24 18:36:37,331][177155] DAMAGECOUNT value on done: 147402.0 [2023-02-24 18:36:37,332][177155] Sum rewards: 16.731, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.104', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.040', 'AMMO4': '0.047', 'AMMO3': '0.121', 'weapon5': '0.164', 'weapon7': '0.164', 'WEAPON5': '0.200', 'AMMO6': '0.260', 'AMMO7': '0.260', 'WEAPON7': '0.300', 'weapon2': '0.688', 'WEAPON3': '0.800', 'HITCOUNT': '1.000', 'weapon3': '2.410', 'DAMAGECOUNT': '4.614', 'FRAGCOUNT': '15.000'} [2023-02-24 18:36:37,627][177155] DAMAGECOUNT value on done: 148417.0 [2023-02-24 18:36:37,628][177155] Sum rewards: 9.457, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.490', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO3': '0.060', 'AMMO4': '0.067', 'weapon5': '0.094', 'WEAPON5': '0.150', 'weapon7': '0.154', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.298', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'HITCOUNT': '0.520', 'weapon3': '0.992', 'weapon2': '1.094', 'DAMAGECOUNT': '2.751', 'FRAGCOUNT': '6.000'} [2023-02-24 18:36:38,023][177153] Updated weights for policy 0, policy_version 15100 (0.0008) [2023-02-24 18:36:38,025][177155] DAMAGECOUNT value on done: 151736.0 [2023-02-24 18:36:38,026][177155] Sum rewards: 13.931, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.856', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.089', 'AMMO4': '0.121', 'WEAPON5': '0.200', 'weapon5': '0.204', 'WEAPON4': '0.250', 'weapon7': '0.266', 'AMMO6': '0.340', 'AMMO7': '0.340', 'weapon2': '0.494', 'WEAPON7': '0.500', 'WEAPON3': '0.600', 'weapon4': '0.734', 'HITCOUNT': '0.930', 'weapon3': '1.652', 'DAMAGECOUNT': '3.513', 'FRAGCOUNT': '10.500'} [2023-02-24 18:36:38,316][177155] DAMAGECOUNT value on done: 140968.0 [2023-02-24 18:36:38,317][177155] Sum rewards: 8.505, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.236', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.039', 'AMMO3': '0.050', 'weapon7': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.120', 'AMMO4': '0.197', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'HITCOUNT': '0.450', 'weapon4': '0.576', 'weapon3': '0.802', 'weapon2': '1.104', 'DAMAGECOUNT': '2.523', 'FRAGCOUNT': '7.000'} [2023-02-24 18:36:40,966][177153] Updated weights for policy 0, policy_version 15110 (0.0009) [2023-02-24 18:36:41,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 61894656. Throughput: 0: 3478.7. Samples: 15471434. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:36:41,376][177119] Avg episode reward: [(0, '11.096')] [2023-02-24 18:36:43,850][177153] Updated weights for policy 0, policy_version 15120 (0.0008) [2023-02-24 18:36:44,151][177156] DAMAGECOUNT value on done: 144805.0 [2023-02-24 18:36:44,151][177156] Sum rewards: 12.573, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.596', 'AMMO2': '0.014', 'AMMO5': '0.017', 'AMMO4': '0.070', 'WEAPON1': '0.070', 'AMMO3': '0.159', 'weapon5': '0.186', 'WEAPON5': '0.450', 'weapon2': '1.022', 'WEAPON3': '1.050', 'HITCOUNT': '1.090', 'weapon3': '2.384', 'DAMAGECOUNT': '4.407', 'FRAGCOUNT': '13.000'} [2023-02-24 18:36:44,284][177156] DAMAGECOUNT value on done: 143901.0 [2023-02-24 18:36:44,284][177156] Sum rewards: 13.302, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.940', 'AMMO5': '0.015', 'AMMO2': '0.015', 'AMMO4': '0.077', 'WEAPON1': '0.080', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.142', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'weapon4': '0.278', 'WEAPON5': '0.400', 'weapon2': '0.916', 'HITCOUNT': '1.020', 'WEAPON3': '1.100', 'weapon3': '2.350', 'DAMAGECOUNT': '4.446', 'FRAGCOUNT': '14.500'} [2023-02-24 18:36:44,463][177156] DAMAGECOUNT value on done: 145373.0 [2023-02-24 18:36:44,464][177156] Sum rewards: 13.126, reward structure: {'DEATHCOUNT': '-5.250', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.013', 'HEALTH': '0.014', 'WEAPON1': '0.030', 'AMMO4': '0.065', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'weapon4': '0.136', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.252', 'WEAPON3': '0.450', 'HITCOUNT': '0.730', 'weapon3': '1.386', 'weapon2': '1.876', 'DAMAGECOUNT': '3.381', 'FRAGCOUNT': '9.000'} [2023-02-24 18:36:44,596][177156] DAMAGECOUNT value on done: 144805.0 [2023-02-24 18:36:44,597][177156] Sum rewards: 13.279, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.042', 'ARMOR': '0.020', 'AMMO5': '0.032', 'AMMO2': '0.034', 'weapon7': '0.082', 'AMMO3': '0.124', 'WEAPON1': '0.130', 'AMMO4': '0.171', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'weapon5': '0.234', 'weapon4': '0.646', 'WEAPON5': '0.650', 'WEAPON3': '0.750', 'weapon2': '0.772', 'HITCOUNT': '0.960', 'weapon3': '1.752', 'DAMAGECOUNT': '4.413', 'FRAGCOUNT': '11.000'} [2023-02-24 18:36:46,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 61964288. Throughput: 0: 3483.3. Samples: 15492486. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:36:46,376][177119] Avg episode reward: [(0, '11.081')] [2023-02-24 18:36:46,764][177153] Updated weights for policy 0, policy_version 15130 (0.0008) [2023-02-24 18:36:48,067][177170] DAMAGECOUNT value on done: 145781.0 [2023-02-24 18:36:48,068][177170] Sum rewards: 12.341, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-3.070', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon5': '0.038', 'ARMOR': '0.044', 'weapon7': '0.130', 'AMMO3': '0.170', 'AMMO4': '0.187', 'AMMO6': '0.260', 'AMMO7': '0.260', 'weapon2': '0.270', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.938', 'HITCOUNT': '1.010', 'WEAPON3': '1.050', 'weapon3': '1.724', 'DAMAGECOUNT': '4.074', 'FRAGCOUNT': '13.000'} [2023-02-24 18:36:48,370][177170] DAMAGECOUNT value on done: 153495.0 [2023-02-24 18:36:48,371][177170] Sum rewards: 13.970, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.195', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.008', 'AMMO4': '0.034', 'WEAPON1': '0.040', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'weapon7': '0.160', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'weapon2': '0.606', 'weapon4': '0.698', 'HITCOUNT': '0.900', 'weapon3': '1.002', 'DAMAGECOUNT': '3.405', 'FRAGCOUNT': '11.000'} [2023-02-24 18:36:48,543][177170] DAMAGECOUNT value on done: 141399.0 [2023-02-24 18:36:48,543][177170] Sum rewards: 19.064, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.650', 'AMMO2': '0.007', 'AMMO5': '0.012', 'AMMO4': '0.035', 'weapon7': '0.046', 'WEAPON1': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.156', 'weapon5': '0.178', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.892', 'WEAPON3': '1.100', 'HITCOUNT': '1.370', 'weapon3': '2.386', 'DAMAGECOUNT': '5.691', 'FRAGCOUNT': '17.000'} [2023-02-24 18:36:48,840][177170] DAMAGECOUNT value on done: 143649.0 [2023-02-24 18:36:48,840][177170] Sum rewards: 0.661, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.238', 'AMMO5': '0.022', 'AMMO2': '0.034', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.104', 'AMMO3': '0.114', 'AMMO4': '0.167', 'weapon4': '0.212', 'HITCOUNT': '0.360', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.754', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.945', 'weapon3': '1.886', 'FRAGCOUNT': '3.000'} [2023-02-24 18:36:49,728][177153] Updated weights for policy 0, policy_version 15140 (0.0008) [2023-02-24 18:36:49,877][177158] DAMAGECOUNT value on done: 141791.0 [2023-02-24 18:36:49,878][177158] Sum rewards: 13.790, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.412', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.117', 'AMMO4': '0.123', 'weapon5': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.620', 'WEAPON3': '0.750', 'HITCOUNT': '0.980', 'weapon4': '1.002', 'weapon3': '1.718', 'DAMAGECOUNT': '4.233', 'FRAGCOUNT': '11.000'} [2023-02-24 18:36:50,177][177158] DAMAGECOUNT value on done: 142542.0 [2023-02-24 18:36:50,178][177158] Sum rewards: 9.835, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.345', 'AMMO2': '0.011', 'AMMO5': '0.015', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.055', 'weapon7': '0.086', 'AMMO3': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.112', 'weapon4': '0.272', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'weapon2': '0.714', 'HITCOUNT': '0.720', 'weapon3': '1.630', 'DAMAGECOUNT': '3.174', 'FRAGCOUNT': '8.000'} [2023-02-24 18:36:50,792][177158] DAMAGECOUNT value on done: 148378.0 [2023-02-24 18:36:50,792][177158] Sum rewards: 7.832, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.578', 'AMMO5': '0.012', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'weapon4': '0.112', 'AMMO4': '0.124', 'weapon5': '0.130', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.350', 'HITCOUNT': '0.700', 'WEAPON3': '0.850', 'weapon2': '1.500', 'weapon3': '1.940', 'DAMAGECOUNT': '3.099', 'FRAGCOUNT': '10.000'} [2023-02-24 18:36:51,086][177158] DAMAGECOUNT value on done: 147157.0 [2023-02-24 18:36:51,086][177158] Sum rewards: 12.522, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.020', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO2': '0.034', 'weapon7': '0.102', 'AMMO3': '0.104', 'weapon5': '0.158', 'AMMO4': '0.171', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'ARMOR': '0.456', 'WEAPON3': '0.700', 'weapon4': '0.706', 'weapon2': '1.018', 'HITCOUNT': '1.110', 'weapon3': '1.662', 'DAMAGECOUNT': '4.530', 'FRAGCOUNT': '10.000'} [2023-02-24 18:36:51,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 62033920. Throughput: 0: 3483.1. Samples: 15502938. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:36:51,376][177119] Avg episode reward: [(0, '11.164')] [2023-02-24 18:36:52,547][177172] DAMAGECOUNT value on done: 144198.0 [2023-02-24 18:36:52,548][177172] Sum rewards: 10.546, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.248', 'AMMO5': '0.012', 'AMMO2': '0.034', 'WEAPON1': '0.040', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.105', 'weapon7': '0.136', 'AMMO4': '0.170', 'weapon5': '0.192', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.470', 'ARMOR': '0.474', 'HITCOUNT': '0.570', 'weapon4': '0.570', 'WEAPON3': '0.700', 'weapon3': '1.990', 'DAMAGECOUNT': '2.931', 'FRAGCOUNT': '10.000'} [2023-02-24 18:36:52,675][177153] Updated weights for policy 0, policy_version 15150 (0.0009) [2023-02-24 18:36:52,851][177172] DAMAGECOUNT value on done: 146792.0 [2023-02-24 18:36:52,851][177172] Sum rewards: 18.589, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.243', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon7': '0.058', 'WEAPON1': '0.060', 'AMMO3': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.137', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon5': '0.324', 'WEAPON5': '0.400', 'weapon4': '0.652', 'WEAPON3': '0.750', 'weapon2': '0.754', 'HITCOUNT': '1.010', 'weapon3': '1.620', 'DAMAGECOUNT': '4.674', 'FRAGCOUNT': '16.000'} [2023-02-24 18:36:53,677][177154] DAMAGECOUNT value on done: 151501.0 [2023-02-24 18:36:53,677][177154] Sum rewards: 17.637, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.560', 'AMMO5': '0.020', 'AMMO2': '0.035', 'WEAPON1': '0.080', 'AMMO3': '0.128', 'AMMO4': '0.176', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.248', 'WEAPON4': '0.350', 'weapon4': '0.442', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'weapon2': '0.872', 'HITCOUNT': '1.090', 'weapon3': '2.050', 'DAMAGECOUNT': '4.755', 'FRAGCOUNT': '16.000'} [2023-02-24 18:36:53,985][177154] DAMAGECOUNT value on done: 153821.0 [2023-02-24 18:36:53,985][177154] Sum rewards: 19.983, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.068', 'AMMO5': '0.011', 'AMMO2': '0.020', 'WEAPON1': '0.050', 'AMMO3': '0.083', 'AMMO4': '0.098', 'weapon5': '0.124', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.410', 'ARMOR': '0.481', 'WEAPON3': '0.600', 'HITCOUNT': '1.200', 'weapon2': '1.316', 'weapon3': '1.806', 'DAMAGECOUNT': '4.602', 'FRAGCOUNT': '15.000'} [2023-02-24 18:36:54,275][177154] DAMAGECOUNT value on done: 150416.0 [2023-02-24 18:36:54,275][177154] Sum rewards: 10.674, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.356', 'ARMOR': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'AMMO3': '0.050', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'weapon7': '0.130', 'WEAPON4': '0.200', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON3': '0.350', 'WEAPON7': '0.500', 'weapon2': '0.514', 'HITCOUNT': '0.650', 'weapon4': '0.752', 'weapon3': '0.886', 'DAMAGECOUNT': '2.502', 'FRAGCOUNT': '8.000'} [2023-02-24 18:36:54,313][177172] DAMAGECOUNT value on done: 147156.0 [2023-02-24 18:36:54,313][177172] Sum rewards: 13.281, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.260', 'weapon4': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.045', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.159', 'weapon5': '0.220', 'AMMO4': '0.224', 'WEAPON5': '0.600', 'HITCOUNT': '0.830', 'weapon2': '0.940', 'WEAPON3': '1.000', 'weapon3': '2.424', 'DAMAGECOUNT': '3.156', 'FRAGCOUNT': '14.000'} [2023-02-24 18:36:54,584][177154] DAMAGECOUNT value on done: 153575.0 [2023-02-24 18:36:54,584][177154] Sum rewards: 12.855, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.411', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'weapon7': '0.052', 'AMMO3': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.168', 'AMMO4': '0.169', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'weapon4': '0.556', 'WEAPON3': '0.600', 'weapon2': '0.706', 'HITCOUNT': '0.840', 'weapon3': '1.530', 'DAMAGECOUNT': '3.747', 'FRAGCOUNT': '11.000'} [2023-02-24 18:36:54,618][177172] DAMAGECOUNT value on done: 149101.0 [2023-02-24 18:36:54,619][177172] Sum rewards: 14.336, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.006', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.024', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.082', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'WEAPON3': '1.000', 'weapon2': '1.124', 'HITCOUNT': '1.220', 'weapon3': '2.370', 'DAMAGECOUNT': '4.005', 'FRAGCOUNT': '14.000'} [2023-02-24 18:36:55,105][177171] DAMAGECOUNT value on done: 144912.0 [2023-02-24 18:36:55,106][177171] Sum rewards: 3.543, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.755', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO3': '0.040', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO4': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.124', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'WEAPON4': '0.250', 'HITCOUNT': '0.370', 'weapon2': '0.456', 'weapon4': '0.570', 'weapon3': '0.688', 'DAMAGECOUNT': '1.476', 'FRAGCOUNT': '3.000'} [2023-02-24 18:36:55,167][177157] DAMAGECOUNT value on done: 151851.0 [2023-02-24 18:36:55,167][177157] Sum rewards: 14.987, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.607', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon7': '0.070', 'AMMO3': '0.080', 'WEAPON1': '0.080', 'AMMO4': '0.112', 'weapon4': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.238', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.790', 'weapon3': '1.550', 'weapon2': '1.652', 'DAMAGECOUNT': '4.881', 'FRAGCOUNT': '12.000'} [2023-02-24 18:36:55,178][177157] DAMAGECOUNT value on done: 140706.0 [2023-02-24 18:36:55,178][177157] Sum rewards: 8.776, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.770', 'AMMO5': '0.025', 'ARMOR': '0.032', 'AMMO2': '0.036', 'WEAPON1': '0.070', 'AMMO3': '0.156', 'AMMO4': '0.181', 'weapon4': '0.296', 'WEAPON4': '0.300', 'weapon5': '0.316', 'WEAPON5': '0.600', 'weapon2': '0.698', 'HITCOUNT': '0.880', 'WEAPON3': '1.050', 'weapon3': '2.154', 'DAMAGECOUNT': '3.501', 'FRAGCOUNT': '10.000'} [2023-02-24 18:36:55,411][177171] DAMAGECOUNT value on done: 148563.0 [2023-02-24 18:36:55,411][177171] Sum rewards: 9.465, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.103', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO2': '0.040', 'AMMO3': '0.127', 'weapon7': '0.128', 'weapon5': '0.156', 'AMMO4': '0.199', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.786', 'ARMOR': '0.857', 'HITCOUNT': '0.860', 'WEAPON3': '0.950', 'weapon3': '1.820', 'DAMAGECOUNT': '3.963', 'FRAGCOUNT': '9.000'} [2023-02-24 18:36:55,425][177171] DAMAGECOUNT value on done: 143034.0 [2023-02-24 18:36:55,425][177171] Sum rewards: 4.150, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.754', 'AMMO2': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.034', 'weapon5': '0.040', 'AMMO3': '0.065', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'ARMOR': '0.455', 'weapon2': '0.498', 'WEAPON3': '0.500', 'HITCOUNT': '0.530', 'weapon4': '0.554', 'weapon3': '1.138', 'DAMAGECOUNT': '1.575', 'FRAGCOUNT': '4.000'} [2023-02-24 18:36:55,478][177157] DAMAGECOUNT value on done: 144488.0 [2023-02-24 18:36:55,479][177157] Sum rewards: 13.419, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.229', 'AMMO2': '0.006', 'AMMO5': '0.017', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'weapon4': '0.088', 'AMMO3': '0.139', 'weapon5': '0.150', 'WEAPON5': '0.350', 'weapon2': '0.658', 'WEAPON3': '0.900', 'HITCOUNT': '1.170', 'weapon3': '2.660', 'DAMAGECOUNT': '4.620', 'FRAGCOUNT': '12.500'} [2023-02-24 18:36:55,490][177157] DAMAGECOUNT value on done: 144100.0 [2023-02-24 18:36:55,490][177157] Sum rewards: 7.706, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.252', 'AMMO2': '0.011', 'AMMO5': '0.012', 'AMMO4': '0.053', 'WEAPON1': '0.060', 'AMMO3': '0.093', 'WEAPON4': '0.150', 'weapon5': '0.202', 'WEAPON5': '0.300', 'weapon4': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.860', 'weapon2': '1.432', 'weapon3': '1.784', 'DAMAGECOUNT': '3.351', 'FRAGCOUNT': '5.500'} [2023-02-24 18:36:55,626][177153] Updated weights for policy 0, policy_version 15160 (0.0008) [2023-02-24 18:36:55,725][177171] DAMAGECOUNT value on done: 143319.0 [2023-02-24 18:36:55,725][177171] Sum rewards: 16.737, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.722', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'weapon7': '0.030', 'AMMO2': '0.034', 'AMMO3': '0.077', 'weapon5': '0.096', 'AMMO4': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON3': '0.550', 'weapon4': '0.602', 'weapon2': '1.084', 'HITCOUNT': '1.150', 'weapon3': '1.444', 'DAMAGECOUNT': '4.887', 'FRAGCOUNT': '12.000'} [2023-02-24 18:36:56,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 62103552. Throughput: 0: 3480.8. Samples: 15523684. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:36:56,376][177119] Avg episode reward: [(0, '11.180')] [2023-02-24 18:36:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000015162_62103552.pth... [2023-02-24 18:36:56,440][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000014346_58761216.pth [2023-02-24 18:36:56,589][177155] DAMAGECOUNT value on done: 147851.0 [2023-02-24 18:36:56,589][177155] Sum rewards: 4.686, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.438', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'weapon5': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.060', 'weapon7': '0.116', 'AMMO4': '0.128', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'HITCOUNT': '0.390', 'weapon2': '0.396', 'WEAPON3': '0.400', 'ARMOR': '0.486', 'weapon4': '0.614', 'weapon3': '1.182', 'DAMAGECOUNT': '1.347', 'FRAGCOUNT': '4.000'} [2023-02-24 18:36:56,889][177155] DAMAGECOUNT value on done: 150059.0 [2023-02-24 18:36:56,889][177155] Sum rewards: 13.143, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.456', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.025', 'weapon5': '0.106', 'AMMO3': '0.142', 'WEAPON5': '0.150', 'weapon7': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'weapon2': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'HITCOUNT': '1.060', 'weapon4': '1.220', 'weapon3': '1.266', 'DAMAGECOUNT': '4.926', 'FRAGCOUNT': '12.000'} [2023-02-24 18:36:57,264][177155] DAMAGECOUNT value on done: 153068.0 [2023-02-24 18:36:57,264][177155] Sum rewards: 15.644, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.448', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.021', 'ARMOR': '0.028', 'AMMO3': '0.086', 'AMMO4': '0.105', 'weapon5': '0.122', 'WEAPON4': '0.150', 'weapon7': '0.196', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.422', 'WEAPON3': '0.500', 'weapon4': '0.604', 'HITCOUNT': '0.880', 'weapon3': '1.182', 'DAMAGECOUNT': '3.981', 'FRAGCOUNT': '12.000'} [2023-02-24 18:36:57,557][177155] DAMAGECOUNT value on done: 142911.0 [2023-02-24 18:36:57,557][177155] Sum rewards: 20.479, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.360', 'AMMO5': '0.020', 'AMMO2': '0.049', 'WEAPON1': '0.050', 'AMMO3': '0.116', 'weapon5': '0.180', 'WEAPON4': '0.200', 'AMMO4': '0.243', 'weapon4': '0.498', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'weapon2': '1.122', 'HITCOUNT': '1.310', 'weapon3': '1.922', 'DAMAGECOUNT': '5.829', 'FRAGCOUNT': '18.000'} [2023-02-24 18:36:58,612][177153] Updated weights for policy 0, policy_version 15170 (0.0008) [2023-02-24 18:37:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13940.3). Total num frames: 62173184. Throughput: 0: 3481.3. Samples: 15544590. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:37:01,376][177119] Avg episode reward: [(0, '11.325')] [2023-02-24 18:37:01,524][177153] Updated weights for policy 0, policy_version 15180 (0.0008) [2023-02-24 18:37:03,520][177156] DAMAGECOUNT value on done: 146294.0 [2023-02-24 18:37:03,520][177156] Sum rewards: 13.491, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.825', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'weapon7': '0.048', 'weapon5': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'AMMO4': '0.142', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.450', 'weapon2': '0.726', 'WEAPON3': '0.750', 'HITCOUNT': '0.910', 'weapon3': '1.898', 'DAMAGECOUNT': '4.467', 'FRAGCOUNT': '12.000'} [2023-02-24 18:37:03,695][177156] DAMAGECOUNT value on done: 145268.0 [2023-02-24 18:37:03,696][177156] Sum rewards: 14.026, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.658', 'AMMO2': '0.016', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.080', 'AMMO3': '0.109', 'WEAPON4': '0.250', 'weapon5': '0.304', 'ARMOR': '0.448', 'WEAPON5': '0.450', 'weapon2': '0.584', 'weapon4': '0.702', 'WEAPON3': '0.750', 'HITCOUNT': '0.930', 'weapon3': '1.910', 'DAMAGECOUNT': '4.101', 'FRAGCOUNT': '13.000'} [2023-02-24 18:37:03,790][177172] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 18:37:03,845][177156] DAMAGECOUNT value on done: 147350.0 [2023-02-24 18:37:03,846][177156] Sum rewards: 16.470, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.784', 'AMMO2': '0.009', 'AMMO5': '0.015', 'AMMO4': '0.047', 'WEAPON1': '0.060', 'weapon7': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.158', 'AMMO3': '0.175', 'WEAPON7': '0.200', 'weapon4': '0.262', 'weapon2': '0.344', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '1.270', 'weapon3': '2.644', 'DAMAGECOUNT': '5.880', 'FRAGCOUNT': '15.000'} [2023-02-24 18:37:04,003][177156] DAMAGECOUNT value on done: 146415.0 [2023-02-24 18:37:04,004][177156] Sum rewards: 12.533, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.136', 'AMMO2': '0.005', 'AMMO5': '0.018', 'AMMO4': '0.027', 'WEAPON1': '0.070', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'weapon5': '0.358', 'weapon4': '0.500', 'WEAPON5': '0.600', 'weapon2': '0.654', 'WEAPON3': '0.900', 'HITCOUNT': '0.910', 'weapon3': '2.030', 'DAMAGECOUNT': '4.830', 'FRAGCOUNT': '10.000'} [2023-02-24 18:37:04,471][177153] Updated weights for policy 0, policy_version 15190 (0.0008) [2023-02-24 18:37:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 62242816. Throughput: 0: 3481.8. Samples: 15555018. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:37:06,376][177119] Avg episode reward: [(0, '11.491')] [2023-02-24 18:37:07,390][177153] Updated weights for policy 0, policy_version 15200 (0.0009) [2023-02-24 18:37:07,396][177170] DAMAGECOUNT value on done: 147377.0 [2023-02-24 18:37:07,396][177170] Sum rewards: 12.448, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.520', 'AMMO5': '0.014', 'AMMO2': '0.049', 'WEAPON1': '0.050', 'AMMO3': '0.120', 'weapon5': '0.124', 'AMMO4': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.340', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'weapon4': '0.880', 'HITCOUNT': '1.260', 'weapon3': '2.046', 'DAMAGECOUNT': '4.788', 'FRAGCOUNT': '11.000'} [2023-02-24 18:37:07,691][177170] DAMAGECOUNT value on done: 155461.0 [2023-02-24 18:37:07,691][177170] Sum rewards: 18.316, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.620', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.122', 'weapon5': '0.142', 'AMMO3': '0.143', 'weapon4': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.900', 'HITCOUNT': '1.120', 'weapon2': '1.254', 'weapon3': '1.718', 'DAMAGECOUNT': '5.874', 'FRAGCOUNT': '18.000'} [2023-02-24 18:37:07,845][177170] DAMAGECOUNT value on done: 142616.0 [2023-02-24 18:37:07,846][177170] Sum rewards: 6.068, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.036', 'AMMO2': '0.015', 'ARMOR': '0.016', 'AMMO5': '0.023', 'WEAPON1': '0.070', 'AMMO4': '0.074', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.126', 'AMMO3': '0.149', 'weapon5': '0.172', 'WEAPON5': '0.550', 'HITCOUNT': '0.880', 'weapon2': '0.948', 'WEAPON3': '1.000', 'weapon3': '2.400', 'DAMAGECOUNT': '3.531', 'FRAGCOUNT': '9.000'} [2023-02-24 18:37:08,150][177170] DAMAGECOUNT value on done: 144719.0 [2023-02-24 18:37:08,151][177170] Sum rewards: 7.276, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.760', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.015', 'WEAPON1': '0.060', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.188', 'weapon4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.910', 'weapon3': '1.344', 'weapon2': '1.380', 'DAMAGECOUNT': '3.210', 'FRAGCOUNT': '7.000'} [2023-02-24 18:37:09,264][177158] DAMAGECOUNT value on done: 143204.0 [2023-02-24 18:37:09,265][177158] Sum rewards: 11.216, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.514', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.061', 'weapon5': '0.134', 'AMMO3': '0.144', 'WEAPON5': '0.300', 'AMMO4': '0.307', 'weapon2': '0.548', 'WEAPON4': '0.750', 'ARMOR': '0.900', 'WEAPON3': '1.000', 'HITCOUNT': '1.150', 'weapon4': '1.238', 'weapon3': '1.676', 'DAMAGECOUNT': '4.239', 'FRAGCOUNT': '14.000'} [2023-02-24 18:37:09,564][177158] DAMAGECOUNT value on done: 143860.0 [2023-02-24 18:37:09,565][177158] Sum rewards: 8.801, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.116', 'AMMO5': '0.015', 'AMMO2': '0.038', 'WEAPON1': '0.060', 'AMMO3': '0.125', 'AMMO4': '0.189', 'weapon5': '0.214', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.444', 'WEAPON3': '0.750', 'HITCOUNT': '0.870', 'weapon2': '1.342', 'weapon3': '1.616', 'DAMAGECOUNT': '3.954', 'FRAGCOUNT': '11.000'} [2023-02-24 18:37:10,151][177158] DAMAGECOUNT value on done: 149758.0 [2023-02-24 18:37:10,152][177158] Sum rewards: 15.633, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.140', 'AMMO2': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.050', 'weapon7': '0.052', 'WEAPON1': '0.060', 'AMMO3': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.218', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon4': '0.462', 'WEAPON3': '0.550', 'HITCOUNT': '0.980', 'weapon2': '1.348', 'weapon3': '1.476', 'DAMAGECOUNT': '4.140', 'FRAGCOUNT': '12.000'} [2023-02-24 18:37:10,342][177153] Updated weights for policy 0, policy_version 15210 (0.0008) [2023-02-24 18:37:10,453][177158] DAMAGECOUNT value on done: 148374.0 [2023-02-24 18:37:10,453][177158] Sum rewards: 9.603, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.238', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.027', 'weapon7': '0.048', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.128', 'AMMO4': '0.133', 'AMMO3': '0.168', 'WEAPON7': '0.200', 'weapon4': '0.308', 'WEAPON5': '0.400', 'weapon2': '0.828', 'HITCOUNT': '0.830', 'WEAPON3': '0.900', 'weapon3': '2.026', 'DAMAGECOUNT': '3.651', 'FRAGCOUNT': '9.000'} [2023-02-24 18:37:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 62312448. Throughput: 0: 3479.9. Samples: 15575810. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:37:11,376][177119] Avg episode reward: [(0, '11.376')] [2023-02-24 18:37:11,929][177172] DAMAGECOUNT value on done: 146097.0 [2023-02-24 18:37:11,930][177172] Sum rewards: 18.343, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.156', 'AMMO5': '0.020', 'AMMO2': '0.040', 'WEAPON1': '0.060', 'AMMO3': '0.104', 'AMMO4': '0.198', 'WEAPON4': '0.250', 'weapon5': '0.294', 'ARMOR': '0.404', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'weapon2': '0.674', 'weapon4': '0.946', 'HITCOUNT': '1.360', 'weapon3': '1.602', 'DAMAGECOUNT': '5.697', 'FRAGCOUNT': '14.000'} [2023-02-24 18:37:12,237][177172] DAMAGECOUNT value on done: 148933.0 [2023-02-24 18:37:12,237][177172] Sum rewards: 18.796, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.648', 'AMMO5': '0.020', 'AMMO2': '0.029', 'WEAPON1': '0.040', 'weapon7': '0.052', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.139', 'AMMO4': '0.144', 'WEAPON7': '0.200', 'weapon5': '0.202', 'WEAPON4': '0.300', 'weapon4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '0.900', 'ARMOR': '0.921', 'weapon2': '1.092', 'HITCOUNT': '1.280', 'weapon3': '1.912', 'DAMAGECOUNT': '6.423', 'FRAGCOUNT': '17.000'} [2023-02-24 18:37:12,961][177154] DAMAGECOUNT value on done: 152181.0 [2023-02-24 18:37:12,962][177154] Sum rewards: 2.546, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.070', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.027', 'WEAPON1': '0.030', 'weapon7': '0.058', 'weapon5': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.102', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'weapon4': '0.494', 'HITCOUNT': '0.560', 'WEAPON3': '0.650', 'weapon2': '1.388', 'weapon3': '1.462', 'DAMAGECOUNT': '2.025', 'FRAGCOUNT': '4.000'} [2023-02-24 18:37:13,252][177154] DAMAGECOUNT value on done: 155068.0 [2023-02-24 18:37:13,252][177154] Sum rewards: 8.603, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.250', 'AMMO2': '0.015', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'weapon7': '0.054', 'AMMO4': '0.073', 'AMMO3': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.192', 'WEAPON7': '0.200', 'weapon4': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'HITCOUNT': '0.760', 'weapon2': '1.390', 'weapon3': '1.506', 'DAMAGECOUNT': '3.741', 'FRAGCOUNT': '9.000'} [2023-02-24 18:37:13,314][177153] Updated weights for policy 0, policy_version 15220 (0.0008) [2023-02-24 18:37:13,540][177154] DAMAGECOUNT value on done: 151492.0 [2023-02-24 18:37:13,540][177154] Sum rewards: 10.104, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.330', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon7': '0.048', 'weapon5': '0.062', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.274', 'WEAPON3': '0.500', 'weapon2': '0.718', 'HITCOUNT': '0.750', 'weapon3': '1.362', 'DAMAGECOUNT': '3.228', 'FRAGCOUNT': '8.000'} [2023-02-24 18:37:13,702][177172] DAMAGECOUNT value on done: 148710.0 [2023-02-24 18:37:13,702][177172] Sum rewards: 18.655, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.200', 'AMMO5': '0.010', 'AMMO2': '0.024', 'WEAPON1': '0.050', 'AMMO4': '0.118', 'weapon5': '0.122', 'AMMO3': '0.143', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.466', 'weapon2': '0.696', 'WEAPON3': '0.950', 'HITCOUNT': '1.120', 'weapon3': '2.280', 'DAMAGECOUNT': '4.626', 'FRAGCOUNT': '17.000'} [2023-02-24 18:37:13,846][177154] DAMAGECOUNT value on done: 154660.0 [2023-02-24 18:37:13,846][177154] Sum rewards: 9.347, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.566', 'AMMO5': '0.030', 'AMMO2': '0.047', 'WEAPON1': '0.050', 'weapon5': '0.136', 'AMMO3': '0.149', 'AMMO4': '0.234', 'WEAPON4': '0.450', 'weapon4': '0.562', 'weapon2': '0.690', 'WEAPON5': '0.700', 'HITCOUNT': '0.910', 'ARMOR': '0.938', 'WEAPON3': '0.950', 'weapon3': '1.812', 'DAMAGECOUNT': '3.255', 'FRAGCOUNT': '12.000'} [2023-02-24 18:37:14,009][177172] DAMAGECOUNT value on done: 150618.0 [2023-02-24 18:37:14,009][177172] Sum rewards: 8.228, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.614', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON1': '0.040', 'AMMO4': '0.057', 'weapon5': '0.102', 'weapon7': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.137', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.358', 'ARMOR': '0.452', 'WEAPON3': '0.900', 'HITCOUNT': '1.100', 'weapon2': '1.384', 'weapon3': '1.790', 'DAMAGECOUNT': '4.551', 'FRAGCOUNT': '7.000'} [2023-02-24 18:37:14,455][177171] DAMAGECOUNT value on done: 145769.0 [2023-02-24 18:37:14,456][177171] Sum rewards: 11.242, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.394', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.070', 'weapon7': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.128', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'ARMOR': '0.453', 'weapon4': '0.526', 'HITCOUNT': '0.650', 'weapon2': '0.740', 'weapon3': '1.150', 'DAMAGECOUNT': '2.571', 'FRAGCOUNT': '9.000'} [2023-02-24 18:37:14,476][177157] DAMAGECOUNT value on done: 153318.0 [2023-02-24 18:37:14,476][177157] Sum rewards: 12.885, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.031', 'AMMO3': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon7': '0.118', 'HEALTH': '0.150', 'AMMO4': '0.153', 'weapon5': '0.236', 'WEAPON5': '0.250', 'weapon4': '0.370', 'WEAPON3': '0.500', 'HITCOUNT': '0.890', 'weapon3': '1.432', 'weapon2': '1.574', 'DAMAGECOUNT': '4.401', 'FRAGCOUNT': '9.000'} [2023-02-24 18:37:14,487][177157] DAMAGECOUNT value on done: 141681.0 [2023-02-24 18:37:14,488][177157] Sum rewards: 8.829, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.278', 'AMMO5': '0.015', 'AMMO2': '0.027', 'WEAPON1': '0.070', 'AMMO3': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon7': '0.100', 'weapon5': '0.132', 'AMMO4': '0.135', 'WEAPON5': '0.350', 'weapon4': '0.386', 'WEAPON3': '0.650', 'HITCOUNT': '0.810', 'weapon2': '1.022', 'weapon3': '1.488', 'DAMAGECOUNT': '2.925', 'FRAGCOUNT': '8.000'} [2023-02-24 18:37:14,743][177171] DAMAGECOUNT value on done: 144529.0 [2023-02-24 18:37:14,744][177171] Sum rewards: 17.251, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.326', 'AMMO2': '0.007', 'AMMO5': '0.012', 'AMMO4': '0.034', 'WEAPON1': '0.070', 'AMMO3': '0.103', 'weapon5': '0.210', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'HITCOUNT': '0.920', 'weapon2': '1.098', 'weapon3': '2.288', 'DAMAGECOUNT': '4.485', 'FRAGCOUNT': '15.000'} [2023-02-24 18:37:14,781][177171] DAMAGECOUNT value on done: 150062.0 [2023-02-24 18:37:14,781][177171] Sum rewards: 14.185, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.800', 'AMMO5': '0.010', 'AMMO2': '0.024', 'WEAPON1': '0.050', 'AMMO3': '0.074', 'AMMO4': '0.122', 'weapon5': '0.158', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.474', 'WEAPON3': '0.600', 'HITCOUNT': '1.020', 'weapon2': '1.242', 'weapon3': '1.564', 'DAMAGECOUNT': '4.497', 'FRAGCOUNT': '13.000'} [2023-02-24 18:37:14,784][177157] DAMAGECOUNT value on done: 145993.0 [2023-02-24 18:37:14,784][177157] Sum rewards: 12.649, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.885', 'AMMO2': '0.005', 'AMMO5': '0.015', 'AMMO4': '0.025', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'weapon5': '0.192', 'weapon4': '0.250', 'WEAPON5': '0.400', 'ARMOR': '0.456', 'weapon2': '0.570', 'WEAPON3': '0.800', 'HITCOUNT': '1.100', 'weapon3': '2.194', 'DAMAGECOUNT': '4.515', 'FRAGCOUNT': '12.000'} [2023-02-24 18:37:14,795][177157] DAMAGECOUNT value on done: 145465.0 [2023-02-24 18:37:14,795][177157] Sum rewards: 10.473, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.320', 'AMMO5': '0.018', 'AMMO2': '0.020', 'weapon7': '0.064', 'WEAPON1': '0.070', 'AMMO4': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.132', 'AMMO3': '0.153', 'weapon4': '0.312', 'WEAPON5': '0.400', 'weapon2': '0.610', 'WEAPON3': '0.900', 'HITCOUNT': '0.920', 'weapon3': '2.100', 'DAMAGECOUNT': '4.095', 'FRAGCOUNT': '11.000'} [2023-02-24 18:37:15,055][177171] DAMAGECOUNT value on done: 144421.0 [2023-02-24 18:37:15,056][177171] Sum rewards: 8.584, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.425', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon7': '0.052', 'AMMO4': '0.069', 'WEAPON1': '0.070', 'AMMO3': '0.079', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.156', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'ARMOR': '0.440', 'weapon4': '0.522', 'WEAPON3': '0.650', 'HITCOUNT': '0.980', 'weapon2': '1.160', 'weapon3': '1.508', 'DAMAGECOUNT': '3.306', 'FRAGCOUNT': '6.000'} [2023-02-24 18:37:15,968][177155] DAMAGECOUNT value on done: 148845.0 [2023-02-24 18:37:15,968][177155] Sum rewards: 6.676, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.254', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO5': '0.015', 'weapon7': '0.048', 'AMMO4': '0.066', 'AMMO3': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.434', 'ARMOR': '0.457', 'HITCOUNT': '0.590', 'weapon4': '0.616', 'WEAPON3': '0.650', 'weapon3': '1.454', 'DAMAGECOUNT': '2.982', 'FRAGCOUNT': '8.000'} [2023-02-24 18:37:16,265][177155] DAMAGECOUNT value on done: 151203.0 [2023-02-24 18:37:16,265][177155] Sum rewards: 3.922, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.746', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.050', 'AMMO3': '0.126', 'weapon5': '0.136', 'WEAPON5': '0.150', 'HITCOUNT': '0.740', 'WEAPON3': '0.950', 'weapon2': '1.242', 'weapon3': '2.344', 'DAMAGECOUNT': '3.432', 'FRAGCOUNT': '4.000'} [2023-02-24 18:37:16,270][177153] Updated weights for policy 0, policy_version 15230 (0.0008) [2023-02-24 18:37:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 62382080. Throughput: 0: 3479.2. Samples: 15596616. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:37:16,376][177119] Avg episode reward: [(0, '11.336')] [2023-02-24 18:37:16,583][177155] DAMAGECOUNT value on done: 154419.0 [2023-02-24 18:37:16,583][177155] Sum rewards: 11.581, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.879', 'AMMO5': '0.012', 'ARMOR': '0.020', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'AMMO3': '0.120', 'AMMO4': '0.123', 'weapon7': '0.132', 'weapon5': '0.134', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'weapon4': '0.286', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.700', 'HITCOUNT': '1.080', 'weapon2': '1.480', 'weapon3': '1.664', 'DAMAGECOUNT': '4.053', 'FRAGCOUNT': '9.500'} [2023-02-24 18:37:16,888][177155] DAMAGECOUNT value on done: 144574.0 [2023-02-24 18:37:16,889][177155] Sum rewards: 10.895, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.794', 'ARMOR': '0.004', 'AMMO5': '0.015', 'weapon7': '0.020', 'AMMO2': '0.033', 'WEAPON1': '0.090', 'AMMO3': '0.128', 'weapon5': '0.162', 'AMMO4': '0.165', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.476', 'WEAPON3': '0.850', 'weapon2': '0.878', 'HITCOUNT': '1.180', 'weapon3': '2.048', 'DAMAGECOUNT': '4.989', 'FRAGCOUNT': '10.000'} [2023-02-24 18:37:19,188][177153] Updated weights for policy 0, policy_version 15240 (0.0008) [2023-02-24 18:37:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 62451712. Throughput: 0: 3480.1. Samples: 15607152. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:37:21,377][177119] Avg episode reward: [(0, '11.310')] [2023-02-24 18:37:22,127][177153] Updated weights for policy 0, policy_version 15250 (0.0008) [2023-02-24 18:37:22,954][177156] DAMAGECOUNT value on done: 148289.0 [2023-02-24 18:37:22,955][177156] Sum rewards: 22.574, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.815', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.061', 'weapon5': '0.100', 'AMMO3': '0.117', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.480', 'weapon2': '0.732', 'WEAPON3': '0.800', 'ARMOR': '0.908', 'HITCOUNT': '1.450', 'weapon3': '2.296', 'DAMAGECOUNT': '5.985', 'FRAGCOUNT': '19.000'} [2023-02-24 18:37:23,127][177156] DAMAGECOUNT value on done: 146243.0 [2023-02-24 18:37:23,127][177156] Sum rewards: 5.104, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.208', 'WEAPON1': '0.010', 'AMMO5': '0.031', 'AMMO2': '0.036', 'AMMO3': '0.107', 'AMMO4': '0.181', 'weapon5': '0.302', 'WEAPON4': '0.350', 'ARMOR': '0.408', 'WEAPON5': '0.500', 'weapon2': '0.616', 'HITCOUNT': '0.650', 'WEAPON3': '0.700', 'weapon4': '0.886', 'weapon3': '1.360', 'DAMAGECOUNT': '2.925', 'FRAGCOUNT': '7.000'} [2023-02-24 18:37:23,279][177156] DAMAGECOUNT value on done: 148885.0 [2023-02-24 18:37:23,279][177156] Sum rewards: 13.201, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.074', 'AMMO2': '0.021', 'AMMO5': '0.036', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'weapon4': '0.156', 'AMMO3': '0.169', 'weapon5': '0.248', 'WEAPON5': '0.750', 'weapon2': '0.836', 'HITCOUNT': '0.940', 'WEAPON3': '1.000', 'weapon3': '2.238', 'DAMAGECOUNT': '4.605', 'FRAGCOUNT': '12.000'} [2023-02-24 18:37:23,446][177156] DAMAGECOUNT value on done: 147970.0 [2023-02-24 18:37:23,447][177156] Sum rewards: 15.431, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.485', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'AMMO3': '0.069', 'weapon5': '0.070', 'weapon7': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.158', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'weapon4': '0.494', 'HITCOUNT': '1.080', 'weapon3': '1.260', 'weapon2': '1.818', 'DAMAGECOUNT': '4.665', 'FRAGCOUNT': '11.000'} [2023-02-24 18:37:25,094][177153] Updated weights for policy 0, policy_version 15260 (0.0008) [2023-02-24 18:37:26,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 62521344. Throughput: 0: 3479.9. Samples: 15628032. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:37:26,376][177119] Avg episode reward: [(0, '11.496')] [2023-02-24 18:37:26,713][177170] DAMAGECOUNT value on done: 148407.0 [2023-02-24 18:37:26,713][177170] Sum rewards: 9.352, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.050', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.032', 'WEAPON1': '0.070', 'weapon4': '0.132', 'weapon5': '0.138', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'AMMO4': '0.159', 'WEAPON5': '0.400', 'HITCOUNT': '0.750', 'WEAPON3': '0.800', 'weapon2': '0.878', 'weapon3': '2.128', 'DAMAGECOUNT': '3.090', 'FRAGCOUNT': '9.000'} [2023-02-24 18:37:27,012][177170] DAMAGECOUNT value on done: 155986.0 [2023-02-24 18:37:27,013][177170] Sum rewards: 7.380, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.032', 'AMMO3': '0.040', 'weapon7': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.148', 'WEAPON5': '0.250', 'WEAPON3': '0.250', 'HITCOUNT': '0.360', 'ARMOR': '0.400', 'HEALTH': '0.510', 'weapon3': '0.742', 'DAMAGECOUNT': '1.575', 'weapon2': '2.136', 'FRAGCOUNT': '3.500'} [2023-02-24 18:37:27,106][177170] DAMAGECOUNT value on done: 143648.0 [2023-02-24 18:37:27,107][177170] Sum rewards: 8.127, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.940', 'AMMO5': '0.028', 'AMMO2': '0.038', 'WEAPON1': '0.050', 'weapon5': '0.064', 'AMMO3': '0.096', 'AMMO4': '0.191', 'WEAPON4': '0.300', 'WEAPON5': '0.500', 'weapon4': '0.624', 'WEAPON3': '0.650', 'HITCOUNT': '0.920', 'weapon2': '1.210', 'weapon3': '1.800', 'DAMAGECOUNT': '3.096', 'FRAGCOUNT': '10.000'} [2023-02-24 18:37:27,420][177170] DAMAGECOUNT value on done: 146087.0 [2023-02-24 18:37:27,421][177170] Sum rewards: 15.634, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.120', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.031', 'WEAPON1': '0.050', 'AMMO3': '0.092', 'WEAPON5': '0.250', 'weapon5': '0.260', 'WEAPON3': '0.650', 'HITCOUNT': '0.950', 'weapon2': '1.600', 'weapon3': '1.750', 'DAMAGECOUNT': '4.104', 'FRAGCOUNT': '13.000'} [2023-02-24 18:37:28,045][177153] Updated weights for policy 0, policy_version 15270 (0.0008) [2023-02-24 18:37:28,518][177158] DAMAGECOUNT value on done: 144624.0 [2023-02-24 18:37:28,518][177158] Sum rewards: 12.722, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.390', 'AMMO5': '0.017', 'AMMO2': '0.030', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.125', 'AMMO4': '0.151', 'weapon5': '0.154', 'WEAPON5': '0.400', 'weapon2': '0.498', 'weapon4': '0.520', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'HITCOUNT': '0.820', 'weapon3': '1.996', 'DAMAGECOUNT': '4.260', 'FRAGCOUNT': '10.000'} [2023-02-24 18:37:28,821][177158] DAMAGECOUNT value on done: 145707.0 [2023-02-24 18:37:28,821][177158] Sum rewards: 20.294, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.607', 'AMMO2': '0.015', 'AMMO5': '0.015', 'AMMO4': '0.072', 'WEAPON1': '0.080', 'weapon5': '0.146', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon4': '0.324', 'WEAPON5': '0.350', 'weapon2': '0.958', 'WEAPON3': '1.150', 'HITCOUNT': '1.230', 'weapon3': '2.148', 'DAMAGECOUNT': '5.541', 'FRAGCOUNT': '20.000'} [2023-02-24 18:37:29,420][177158] DAMAGECOUNT value on done: 151252.0 [2023-02-24 18:37:29,420][177158] Sum rewards: 14.436, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.010', 'AMMO2': '0.030', 'WEAPON1': '0.030', 'AMMO3': '0.094', 'AMMO4': '0.148', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.404', 'weapon2': '0.494', 'WEAPON3': '0.550', 'weapon4': '0.658', 'HEALTH': '1.044', 'HITCOUNT': '1.240', 'weapon3': '1.890', 'DAMAGECOUNT': '4.482', 'FRAGCOUNT': '11.000'} [2023-02-24 18:37:29,724][177158] DAMAGECOUNT value on done: 149592.0 [2023-02-24 18:37:29,724][177158] Sum rewards: 12.642, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.672', 'AMMO2': '0.009', 'AMMO5': '0.011', 'AMMO4': '0.045', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.126', 'weapon5': '0.268', 'weapon4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'weapon2': '0.968', 'HITCOUNT': '1.000', 'weapon3': '1.952', 'DAMAGECOUNT': '3.654', 'FRAGCOUNT': '11.000'} [2023-02-24 18:37:30,978][177153] Updated weights for policy 0, policy_version 15280 (0.0008) [2023-02-24 18:37:31,205][177172] DAMAGECOUNT value on done: 147332.0 [2023-02-24 18:37:31,206][177172] Sum rewards: 10.892, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.236', 'AMMO5': '0.014', 'AMMO2': '0.037', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'weapon5': '0.154', 'AMMO4': '0.184', 'WEAPON5': '0.300', 'weapon4': '0.470', 'WEAPON3': '0.700', 'ARMOR': '0.780', 'HITCOUNT': '0.840', 'weapon2': '1.382', 'weapon3': '1.530', 'DAMAGECOUNT': '3.705', 'FRAGCOUNT': '9.000'} [2023-02-24 18:37:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 62590976. Throughput: 0: 3475.3. Samples: 15648874. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:37:31,376][177119] Avg episode reward: [(0, '11.753')] [2023-02-24 18:37:31,511][177172] DAMAGECOUNT value on done: 150011.0 [2023-02-24 18:37:31,511][177172] Sum rewards: 9.869, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.580', 'AMMO2': '0.003', 'AMMO4': '0.017', 'AMMO5': '0.017', 'WEAPON1': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon4': '0.168', 'weapon5': '0.216', 'ARMOR': '0.444', 'WEAPON5': '0.450', 'HITCOUNT': '0.690', 'WEAPON3': '0.800', 'weapon2': '1.106', 'weapon3': '2.026', 'DAMAGECOUNT': '3.234', 'FRAGCOUNT': '8.000'} [2023-02-24 18:37:32,338][177154] DAMAGECOUNT value on done: 153148.0 [2023-02-24 18:37:32,339][177154] Sum rewards: 5.512, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.810', 'AMMO5': '0.027', 'AMMO2': '0.041', 'weapon4': '0.044', 'WEAPON1': '0.080', 'AMMO3': '0.093', 'WEAPON4': '0.150', 'AMMO4': '0.207', 'weapon5': '0.334', 'WEAPON5': '0.650', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'weapon2': '1.446', 'weapon3': '1.758', 'DAMAGECOUNT': '2.901', 'FRAGCOUNT': '5.500'} [2023-02-24 18:37:32,645][177154] DAMAGECOUNT value on done: 156412.0 [2023-02-24 18:37:32,645][177154] Sum rewards: 16.427, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '0.000', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO2': '0.037', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.113', 'weapon5': '0.174', 'AMMO4': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.444', 'WEAPON3': '0.700', 'weapon2': '0.978', 'HITCOUNT': '0.990', 'weapon3': '2.002', 'DAMAGECOUNT': '4.032', 'FRAGCOUNT': '14.000'} [2023-02-24 18:37:32,892][177154] DAMAGECOUNT value on done: 152310.0 [2023-02-24 18:37:32,893][177154] Sum rewards: 8.233, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.490', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.077', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'weapon5': '0.194', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'weapon2': '0.580', 'HITCOUNT': '0.740', 'weapon4': '1.282', 'weapon3': '1.336', 'ARMOR': '1.377', 'DAMAGECOUNT': '2.454', 'FRAGCOUNT': '7.000'} [2023-02-24 18:37:32,960][177172] DAMAGECOUNT value on done: 150027.0 [2023-02-24 18:37:32,960][177172] Sum rewards: 9.960, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.552', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'AMMO3': '0.066', 'AMMO4': '0.086', 'weapon5': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'WEAPON3': '0.450', 'ARMOR': '0.456', 'weapon2': '0.716', 'HITCOUNT': '1.000', 'weapon4': '1.080', 'weapon3': '1.226', 'DAMAGECOUNT': '3.951', 'FRAGCOUNT': '9.000'} [2023-02-24 18:37:33,202][177154] DAMAGECOUNT value on done: 155726.0 [2023-02-24 18:37:33,203][177154] Sum rewards: 7.414, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.596', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon7': '0.052', 'WEAPON1': '0.070', 'AMMO4': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.111', 'weapon5': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.388', 'ARMOR': '0.442', 'weapon4': '0.634', 'WEAPON3': '0.700', 'HITCOUNT': '0.820', 'weapon3': '1.482', 'DAMAGECOUNT': '3.198', 'FRAGCOUNT': '9.000'} [2023-02-24 18:37:33,256][177172] DAMAGECOUNT value on done: 151812.0 [2023-02-24 18:37:33,257][177172] Sum rewards: 10.812, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.753', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.023', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO3': '0.091', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.186', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.770', 'weapon3': '1.446', 'weapon2': '1.868', 'DAMAGECOUNT': '3.582', 'FRAGCOUNT': '9.000'} [2023-02-24 18:37:33,675][177157] DAMAGECOUNT value on done: 155142.0 [2023-02-24 18:37:33,675][177157] Sum rewards: 14.424, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.476', 'AMMO5': '0.010', 'weapon7': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.052', 'AMMO3': '0.126', 'weapon5': '0.152', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.261', 'WEAPON5': '0.300', 'ARMOR': '0.432', 'WEAPON4': '0.450', 'weapon2': '0.454', 'WEAPON3': '0.800', 'weapon4': '0.934', 'HITCOUNT': '1.250', 'weapon3': '1.814', 'DAMAGECOUNT': '5.472', 'FRAGCOUNT': '14.000'} [2023-02-24 18:37:33,767][177157] DAMAGECOUNT value on done: 142760.0 [2023-02-24 18:37:33,767][177157] Sum rewards: 13.463, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.010', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.087', 'AMMO4': '0.090', 'weapon5': '0.186', 'weapon4': '0.266', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.790', 'weapon2': '1.388', 'weapon3': '1.688', 'DAMAGECOUNT': '3.237', 'FRAGCOUNT': '10.000'} [2023-02-24 18:37:33,800][177171] DAMAGECOUNT value on done: 146633.0 [2023-02-24 18:37:33,801][177171] Sum rewards: 3.806, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.474', 'AMMO5': '0.018', 'AMMO2': '0.047', 'WEAPON1': '0.050', 'AMMO3': '0.103', 'weapon5': '0.150', 'AMMO4': '0.233', 'weapon2': '0.320', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.730', 'ARMOR': '0.889', 'weapon3': '1.054', 'weapon4': '1.294', 'DAMAGECOUNT': '2.592', 'FRAGCOUNT': '6.000'} [2023-02-24 18:37:33,946][177153] Updated weights for policy 0, policy_version 15290 (0.0008) [2023-02-24 18:37:33,983][177157] DAMAGECOUNT value on done: 146855.0 [2023-02-24 18:37:33,984][177157] Sum rewards: 7.284, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.084', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO3': '0.075', 'AMMO4': '0.095', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.508', 'WEAPON3': '0.550', 'HITCOUNT': '0.710', 'weapon4': '0.748', 'weapon3': '1.444', 'DAMAGECOUNT': '2.586', 'FRAGCOUNT': '7.000'} [2023-02-24 18:37:34,074][177157] DAMAGECOUNT value on done: 146739.0 [2023-02-24 18:37:34,075][177157] Sum rewards: 8.214, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.009', 'WEAPON1': '0.030', 'AMMO2': '0.052', 'AMMO3': '0.069', 'HEALTH': '0.088', 'weapon5': '0.190', 'WEAPON5': '0.250', 'AMMO4': '0.262', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.610', 'weapon2': '0.796', 'weapon4': '0.798', 'ARMOR': '0.800', 'weapon3': '1.188', 'DAMAGECOUNT': '3.822', 'FRAGCOUNT': '6.000'} [2023-02-24 18:37:34,106][177171] DAMAGECOUNT value on done: 145734.0 [2023-02-24 18:37:34,106][177171] Sum rewards: 8.893, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.948', 'AMMO2': '0.015', 'AMMO5': '0.015', 'ARMOR': '0.050', 'WEAPON1': '0.070', 'AMMO4': '0.073', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'weapon5': '0.192', 'weapon4': '0.288', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'HITCOUNT': '0.750', 'weapon2': '1.308', 'weapon3': '1.760', 'DAMAGECOUNT': '3.615', 'FRAGCOUNT': '7.000'} [2023-02-24 18:37:34,115][177171] DAMAGECOUNT value on done: 151682.0 [2023-02-24 18:37:34,116][177171] Sum rewards: 16.058, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.360', 'AMMO2': '0.007', 'AMMO5': '0.027', 'AMMO4': '0.034', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.159', 'weapon4': '0.304', 'weapon5': '0.316', 'ARMOR': '0.451', 'WEAPON5': '0.650', 'weapon2': '0.668', 'WEAPON3': '0.950', 'HITCOUNT': '0.960', 'weapon3': '2.102', 'DAMAGECOUNT': '4.860', 'FRAGCOUNT': '14.000'} [2023-02-24 18:37:34,412][177171] DAMAGECOUNT value on done: 146530.0 [2023-02-24 18:37:34,412][177171] Sum rewards: 18.253, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.421', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.041', 'weapon7': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.100', 'AMMO3': '0.165', 'AMMO4': '0.203', 'WEAPON5': '0.300', 'ARMOR': '0.404', 'weapon2': '0.440', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'weapon4': '1.264', 'HITCOUNT': '1.470', 'weapon3': '1.598', 'DAMAGECOUNT': '6.327', 'FRAGCOUNT': '16.000'} [2023-02-24 18:37:35,274][177155] DAMAGECOUNT value on done: 149968.0 [2023-02-24 18:37:35,275][177155] Sum rewards: 9.934, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.735', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'AMMO5': '0.013', 'WEAPON1': '0.050', 'weapon7': '0.054', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.210', 'weapon4': '0.228', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '1.010', 'weapon2': '1.570', 'weapon3': '1.594', 'DAMAGECOUNT': '3.369', 'FRAGCOUNT': '7.000'} [2023-02-24 18:37:35,566][177155] DAMAGECOUNT value on done: 152854.0 [2023-02-24 18:37:35,566][177155] Sum rewards: 14.004, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.593', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.070', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.141', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.516', 'weapon4': '0.826', 'ARMOR': '0.882', 'WEAPON3': '0.900', 'HITCOUNT': '1.330', 'weapon3': '1.804', 'DAMAGECOUNT': '4.953', 'FRAGCOUNT': '13.000'} [2023-02-24 18:37:35,863][177155] DAMAGECOUNT value on done: 155466.0 [2023-02-24 18:37:35,863][177155] Sum rewards: 7.513, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.845', 'AMMO5': '0.017', 'AMMO2': '0.038', 'WEAPON1': '0.040', 'weapon7': '0.066', 'AMMO3': '0.083', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.189', 'WEAPON7': '0.200', 'weapon5': '0.230', 'WEAPON3': '0.400', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'HITCOUNT': '0.600', 'weapon2': '0.766', 'weapon3': '0.774', 'weapon4': '1.224', 'DAMAGECOUNT': '3.141', 'FRAGCOUNT': '5.500'} [2023-02-24 18:37:36,162][177155] DAMAGECOUNT value on done: 145418.0 [2023-02-24 18:37:36,162][177155] Sum rewards: 9.287, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.422', 'AMMO5': '0.019', 'AMMO2': '0.023', 'WEAPON1': '0.070', 'AMMO4': '0.114', 'AMMO3': '0.117', 'weapon5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.404', 'WEAPON5': '0.450', 'ARMOR': '0.458', 'weapon2': '0.662', 'HITCOUNT': '0.720', 'WEAPON3': '0.800', 'weapon3': '2.240', 'DAMAGECOUNT': '2.532', 'FRAGCOUNT': '10.000'} [2023-02-24 18:37:36,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 62660608. Throughput: 0: 3473.6. Samples: 15659250. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:37:36,376][177119] Avg episode reward: [(0, '11.784')] [2023-02-24 18:37:36,908][177153] Updated weights for policy 0, policy_version 15300 (0.0009) [2023-02-24 18:37:39,818][177153] Updated weights for policy 0, policy_version 15310 (0.0009) [2023-02-24 18:37:41,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 62730240. Throughput: 0: 3477.6. Samples: 15680176. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:37:41,376][177119] Avg episode reward: [(0, '11.784')] [2023-02-24 18:37:42,375][177156] DAMAGECOUNT value on done: 150045.0 [2023-02-24 18:37:42,376][177156] Sum rewards: 13.256, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.826', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'AMMO2': '0.049', 'AMMO3': '0.154', 'weapon5': '0.194', 'WEAPON5': '0.200', 'AMMO4': '0.243', 'WEAPON4': '0.350', 'weapon2': '0.484', 'weapon4': '0.538', 'WEAPON3': '0.900', 'HITCOUNT': '1.360', 'weapon3': '2.272', 'DAMAGECOUNT': '5.268', 'FRAGCOUNT': '14.000'} [2023-02-24 18:37:42,478][177156] DAMAGECOUNT value on done: 147188.0 [2023-02-24 18:37:42,479][177156] Sum rewards: 12.464, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'AMMO2': '0.014', 'ARMOR': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.071', 'HEALTH': '0.082', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'weapon5': '0.152', 'weapon4': '0.188', 'WEAPON5': '0.200', 'WEAPON3': '0.500', 'HITCOUNT': '0.820', 'weapon2': '1.418', 'weapon3': '1.940', 'DAMAGECOUNT': '2.835', 'FRAGCOUNT': '10.000'} [2023-02-24 18:37:42,688][177156] DAMAGECOUNT value on done: 150038.0 [2023-02-24 18:37:42,689][177156] Sum rewards: 12.197, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.320', 'AMMO5': '0.014', 'AMMO2': '0.032', 'WEAPON1': '0.050', 'weapon7': '0.052', 'AMMO3': '0.118', 'weapon5': '0.138', 'AMMO4': '0.161', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.468', 'ARMOR': '0.480', 'HITCOUNT': '0.710', 'WEAPON3': '0.750', 'weapon4': '1.126', 'weapon3': '1.608', 'DAMAGECOUNT': '3.459', 'FRAGCOUNT': '11.000'} [2023-02-24 18:37:42,752][177153] Updated weights for policy 0, policy_version 15320 (0.0008) [2023-02-24 18:37:42,786][177156] DAMAGECOUNT value on done: 148975.0 [2023-02-24 18:37:42,787][177156] Sum rewards: 11.623, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.010', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.048', 'AMMO3': '0.088', 'weapon5': '0.170', 'WEAPON5': '0.200', 'WEAPON3': '0.500', 'HEALTH': '0.540', 'HITCOUNT': '0.670', 'weapon3': '1.580', 'weapon2': '2.012', 'DAMAGECOUNT': '3.015', 'FRAGCOUNT': '8.000'} [2023-02-24 18:37:45,713][177153] Updated weights for policy 0, policy_version 15330 (0.0009) [2023-02-24 18:37:46,067][177170] DAMAGECOUNT value on done: 149612.0 [2023-02-24 18:37:46,067][177170] Sum rewards: 9.024, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.754', 'AMMO5': '0.015', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO3': '0.086', 'AMMO4': '0.090', 'weapon5': '0.334', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.450', 'ARMOR': '0.456', 'HITCOUNT': '0.800', 'weapon2': '0.864', 'weapon4': '0.994', 'weapon3': '1.186', 'DAMAGECOUNT': '3.615', 'FRAGCOUNT': '9.000'} [2023-02-24 18:37:46,367][177170] DAMAGECOUNT value on done: 156950.0 [2023-02-24 18:37:46,367][177170] Sum rewards: 9.618, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.121', 'AMMO5': '0.012', 'AMMO2': '0.043', 'WEAPON1': '0.060', 'AMMO3': '0.062', 'weapon5': '0.162', 'WEAPON4': '0.200', 'AMMO4': '0.215', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.524', 'HITCOUNT': '0.730', 'weapon2': '1.340', 'weapon3': '1.548', 'DAMAGECOUNT': '2.892', 'FRAGCOUNT': '7.000'} [2023-02-24 18:37:46,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 62799872. Throughput: 0: 3475.5. Samples: 15700986. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:37:46,376][177119] Avg episode reward: [(0, '11.757')] [2023-02-24 18:37:46,451][177170] DAMAGECOUNT value on done: 145325.0 [2023-02-24 18:37:46,452][177170] Sum rewards: 14.435, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.074', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.041', 'weapon5': '0.130', 'AMMO3': '0.192', 'AMMO4': '0.203', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.408', 'ARMOR': '0.452', 'weapon4': '0.552', 'WEAPON3': '1.200', 'HITCOUNT': '1.350', 'weapon3': '2.308', 'DAMAGECOUNT': '5.031', 'FRAGCOUNT': '16.000'} [2023-02-24 18:37:46,750][177170] DAMAGECOUNT value on done: 147326.0 [2023-02-24 18:37:46,750][177170] Sum rewards: 10.005, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.063', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.016', 'WEAPON1': '0.050', 'AMMO3': '0.099', 'WEAPON4': '0.200', 'weapon5': '0.246', 'weapon4': '0.394', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'HITCOUNT': '0.960', 'weapon2': '1.364', 'weapon3': '1.634', 'DAMAGECOUNT': '3.717', 'FRAGCOUNT': '8.000'} [2023-02-24 18:37:47,835][177158] DAMAGECOUNT value on done: 145771.0 [2023-02-24 18:37:47,835][177158] Sum rewards: 13.668, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.745', 'AMMO5': '0.017', 'AMMO2': '0.031', 'AMMO3': '0.054', 'WEAPON1': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.132', 'weapon7': '0.140', 'AMMO4': '0.152', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'WEAPON5': '0.450', 'HITCOUNT': '0.880', 'weapon2': '0.938', 'weapon4': '1.050', 'weapon3': '1.058', 'DAMAGECOUNT': '3.441', 'FRAGCOUNT': '11.000'} [2023-02-24 18:37:48,143][177158] DAMAGECOUNT value on done: 147746.0 [2023-02-24 18:37:48,144][177158] Sum rewards: 16.889, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.135', 'AMMO5': '0.010', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'AMMO4': '0.107', 'AMMO3': '0.118', 'WEAPON4': '0.150', 'weapon5': '0.238', 'WEAPON5': '0.300', 'weapon4': '0.566', 'weapon2': '0.686', 'WEAPON3': '0.800', 'HITCOUNT': '1.260', 'weapon3': '1.870', 'DAMAGECOUNT': '6.117', 'FRAGCOUNT': '14.000'} [2023-02-24 18:37:48,682][177153] Updated weights for policy 0, policy_version 15340 (0.0008) [2023-02-24 18:37:48,733][177158] DAMAGECOUNT value on done: 152433.0 [2023-02-24 18:37:48,734][177158] Sum rewards: 10.668, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.955', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.010', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'weapon5': '0.182', 'weapon4': '0.256', 'WEAPON5': '0.300', 'HITCOUNT': '0.790', 'WEAPON3': '0.850', 'weapon2': '1.362', 'weapon3': '1.840', 'DAMAGECOUNT': '3.543', 'FRAGCOUNT': '10.000'} [2023-02-24 18:37:49,032][177158] DAMAGECOUNT value on done: 150738.0 [2023-02-24 18:37:49,033][177158] Sum rewards: 13.722, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.986', 'AMMO5': '0.010', 'AMMO2': '0.024', 'WEAPON1': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.119', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'weapon5': '0.232', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'weapon4': '0.492', 'WEAPON3': '0.750', 'HITCOUNT': '0.900', 'weapon3': '1.396', 'weapon2': '1.478', 'DAMAGECOUNT': '3.438', 'FRAGCOUNT': '12.000'} [2023-02-24 18:37:50,522][177172] DAMAGECOUNT value on done: 149733.0 [2023-02-24 18:37:50,522][177172] Sum rewards: 28.789, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.655', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'weapon7': '0.092', 'AMMO3': '0.107', 'AMMO4': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon5': '0.180', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon2': '0.502', 'WEAPON3': '0.650', 'weapon4': '1.100', 'HITCOUNT': '1.300', 'weapon3': '1.662', 'DAMAGECOUNT': '7.203', 'FRAGCOUNT': '22.000'} [2023-02-24 18:37:50,815][177172] DAMAGECOUNT value on done: 151096.0 [2023-02-24 18:37:50,815][177172] Sum rewards: 8.861, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.276', 'AMMO2': '0.021', 'AMMO5': '0.028', 'WEAPON1': '0.050', 'AMMO4': '0.107', 'AMMO3': '0.124', 'weapon5': '0.148', 'WEAPON4': '0.300', 'weapon4': '0.490', 'WEAPON5': '0.600', 'weapon2': '0.760', 'HITCOUNT': '0.830', 'ARMOR': '0.852', 'WEAPON3': '0.900', 'weapon3': '2.172', 'DAMAGECOUNT': '3.255', 'FRAGCOUNT': '11.000'} [2023-02-24 18:37:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 62869504. Throughput: 0: 3475.2. Samples: 15711404. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:37:51,376][177119] Avg episode reward: [(0, '11.930')] [2023-02-24 18:37:51,630][177153] Updated weights for policy 0, policy_version 15350 (0.0008) [2023-02-24 18:37:51,675][177154] DAMAGECOUNT value on done: 154018.0 [2023-02-24 18:37:51,676][177154] Sum rewards: 8.117, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.629', 'AMMO5': '0.010', 'AMMO2': '0.020', 'WEAPON1': '0.050', 'AMMO3': '0.088', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'weapon4': '0.206', 'WEAPON5': '0.250', 'weapon5': '0.304', 'ARMOR': '0.492', 'WEAPON3': '0.600', 'HITCOUNT': '0.640', 'weapon2': '1.250', 'weapon3': '1.728', 'DAMAGECOUNT': '2.610', 'FRAGCOUNT': '7.000'} [2023-02-24 18:37:51,972][177154] DAMAGECOUNT value on done: 157391.0 [2023-02-24 18:37:51,973][177154] Sum rewards: 8.028, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.900', 'AMMO5': '0.010', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'AMMO3': '0.086', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'weapon5': '0.164', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'weapon4': '0.598', 'WEAPON3': '0.600', 'HITCOUNT': '0.660', 'weapon2': '0.730', 'weapon3': '1.584', 'DAMAGECOUNT': '2.937', 'FRAGCOUNT': '8.000'} [2023-02-24 18:37:52,273][177154] DAMAGECOUNT value on done: 153541.0 [2023-02-24 18:37:52,273][177154] Sum rewards: 6.314, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.488', 'AMMO2': '0.010', 'AMMO5': '0.023', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO3': '0.132', 'weapon5': '0.176', 'weapon4': '0.248', 'WEAPON5': '0.500', 'weapon2': '0.846', 'WEAPON3': '0.900', 'HITCOUNT': '0.940', 'weapon3': '2.166', 'DAMAGECOUNT': '3.693', 'FRAGCOUNT': '7.000'} [2023-02-24 18:37:52,289][177172] DAMAGECOUNT value on done: 151335.0 [2023-02-24 18:37:52,290][177172] Sum rewards: 13.107, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.595', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.047', 'AMMO3': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon7': '0.232', 'WEAPON3': '0.400', 'HITCOUNT': '0.540', 'weapon4': '0.548', 'weapon3': '1.012', 'weapon2': '1.568', 'DAMAGECOUNT': '3.324', 'FRAGCOUNT': '11.000'} [2023-02-24 18:37:52,580][177154] DAMAGECOUNT value on done: 157429.0 [2023-02-24 18:37:52,581][177154] Sum rewards: 12.375, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.959', 'AMMO5': '0.015', 'AMMO2': '0.031', 'WEAPON1': '0.040', 'AMMO3': '0.109', 'AMMO4': '0.157', 'weapon5': '0.284', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'ARMOR': '0.465', 'weapon4': '0.576', 'WEAPON3': '0.750', 'HITCOUNT': '0.950', 'weapon2': '1.070', 'weapon3': '1.642', 'DAMAGECOUNT': '5.094', 'FRAGCOUNT': '12.000'} [2023-02-24 18:37:52,597][177172] DAMAGECOUNT value on done: 152607.0 [2023-02-24 18:37:52,597][177172] Sum rewards: 7.165, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.572', 'AMMO5': '0.012', 'AMMO2': '0.014', 'WEAPON1': '0.060', 'AMMO4': '0.068', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon5': '0.144', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon4': '0.534', 'HITCOUNT': '0.540', 'WEAPON3': '0.550', 'weapon2': '1.254', 'weapon3': '1.256', 'DAMAGECOUNT': '2.385', 'FRAGCOUNT': '6.000'} [2023-02-24 18:37:53,000][177157] DAMAGECOUNT value on done: 156791.0 [2023-02-24 18:37:53,000][177157] Sum rewards: 8.373, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.857', 'AMMO2': '0.014', 'AMMO5': '0.015', 'WEAPON1': '0.050', 'AMMO4': '0.068', 'weapon5': '0.150', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'weapon4': '0.628', 'weapon2': '0.778', 'WEAPON3': '1.150', 'HITCOUNT': '1.190', 'weapon3': '2.072', 'DAMAGECOUNT': '4.587', 'FRAGCOUNT': '11.500'} [2023-02-24 18:37:53,090][177157] DAMAGECOUNT value on done: 143632.0 [2023-02-24 18:37:53,090][177157] Sum rewards: 2.849, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.020', 'AMMO5': '0.005', 'AMMO3': '0.057', 'AMMO2': '0.062', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon7': '0.288', 'WEAPON3': '0.300', 'WEAPON7': '0.300', 'AMMO4': '0.309', 'weapon2': '0.506', 'WEAPON4': '0.650', 'weapon3': '0.650', 'HITCOUNT': '0.700', 'weapon4': '1.236', 'DAMAGECOUNT': '2.616', 'FRAGCOUNT': '4.500'} [2023-02-24 18:37:53,184][177171] DAMAGECOUNT value on done: 147428.0 [2023-02-24 18:37:53,185][177171] Sum rewards: 7.774, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.680', 'AMMO5': '0.012', 'AMMO3': '0.043', 'AMMO2': '0.049', 'WEAPON1': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.126', 'weapon5': '0.134', 'AMMO4': '0.243', 'WEAPON3': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.322', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'HITCOUNT': '0.710', 'weapon3': '0.772', 'weapon4': '1.658', 'DAMAGECOUNT': '2.385', 'FRAGCOUNT': '7.000'} [2023-02-24 18:37:53,306][177157] DAMAGECOUNT value on done: 148299.0 [2023-02-24 18:37:53,306][177157] Sum rewards: 10.399, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.107', 'AMMO2': '0.016', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.081', 'AMMO3': '0.132', 'weapon5': '0.156', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'ARMOR': '0.480', 'weapon2': '0.820', 'weapon4': '0.846', 'WEAPON3': '0.850', 'HITCOUNT': '0.970', 'weapon3': '1.834', 'DAMAGECOUNT': '4.332', 'FRAGCOUNT': '10.000'} [2023-02-24 18:37:53,407][177157] DAMAGECOUNT value on done: 147819.0 [2023-02-24 18:37:53,407][177157] Sum rewards: 6.265, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.562', 'weapon5': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon7': '0.028', 'ARMOR': '0.040', 'AMMO2': '0.047', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.236', 'WEAPON5': '0.250', 'weapon2': '0.556', 'WEAPON4': '0.650', 'WEAPON3': '0.650', 'HITCOUNT': '0.870', 'weapon4': '1.184', 'weapon3': '1.876', 'DAMAGECOUNT': '3.240', 'FRAGCOUNT': '9.000'} [2023-02-24 18:37:53,479][177171] DAMAGECOUNT value on done: 147309.0 [2023-02-24 18:37:53,480][177171] Sum rewards: 20.860, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.670', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'AMMO4': '0.177', 'weapon5': '0.180', 'WEAPON5': '0.250', 'weapon4': '0.568', 'weapon2': '0.570', 'WEAPON3': '0.800', 'ARMOR': '0.800', 'HITCOUNT': '1.190', 'weapon3': '1.920', 'DAMAGECOUNT': '4.725', 'FRAGCOUNT': '19.000'} [2023-02-24 18:37:53,488][177171] DAMAGECOUNT value on done: 152502.0 [2023-02-24 18:37:53,489][177171] Sum rewards: 5.734, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.650', 'AMMO2': '0.010', 'AMMO5': '0.024', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'WEAPON1': '0.110', 'weapon5': '0.314', 'weapon4': '0.318', 'HITCOUNT': '0.530', 'weapon2': '0.580', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'weapon3': '2.134', 'DAMAGECOUNT': '2.460', 'FRAGCOUNT': '6.000'} [2023-02-24 18:37:53,787][177171] DAMAGECOUNT value on done: 147294.0 [2023-02-24 18:37:53,788][177171] Sum rewards: 3.780, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.906', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.040', 'WEAPON1': '0.080', 'AMMO3': '0.129', 'weapon5': '0.186', 'AMMO4': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'HITCOUNT': '0.540', 'weapon4': '0.546', 'WEAPON3': '0.850', 'weapon2': '1.416', 'weapon3': '1.490', 'DAMAGECOUNT': '2.292', 'FRAGCOUNT': '6.000'} [2023-02-24 18:37:54,590][177153] Updated weights for policy 0, policy_version 15360 (0.0008) [2023-02-24 18:37:54,650][177155] DAMAGECOUNT value on done: 151548.0 [2023-02-24 18:37:54,650][177155] Sum rewards: 16.515, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.405', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON1': '0.080', 'AMMO4': '0.086', 'AMMO3': '0.130', 'weapon5': '0.144', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.437', 'weapon4': '0.634', 'WEAPON3': '0.950', 'weapon2': '0.988', 'HITCOUNT': '1.160', 'weapon3': '1.688', 'DAMAGECOUNT': '4.740', 'FRAGCOUNT': '14.000'} [2023-02-24 18:37:54,943][177155] DAMAGECOUNT value on done: 154263.0 [2023-02-24 18:37:54,944][177155] Sum rewards: 9.910, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.108', 'AMMO5': '0.007', 'AMMO2': '0.029', 'WEAPON1': '0.040', 'AMMO3': '0.100', 'weapon5': '0.138', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.496', 'WEAPON3': '0.650', 'ARMOR': '0.861', 'HITCOUNT': '1.000', 'weapon2': '1.016', 'weapon3': '1.860', 'DAMAGECOUNT': '4.227', 'FRAGCOUNT': '9.000'} [2023-02-24 18:37:55,258][177155] DAMAGECOUNT value on done: 157002.0 [2023-02-24 18:37:55,259][177155] Sum rewards: 11.657, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.430', 'AMMO2': '0.005', 'AMMO5': '0.017', 'AMMO4': '0.025', 'WEAPON1': '0.040', 'weapon5': '0.144', 'AMMO3': '0.186', 'WEAPON5': '0.450', 'weapon2': '0.894', 'HITCOUNT': '1.110', 'WEAPON3': '1.250', 'weapon3': '2.608', 'DAMAGECOUNT': '4.608', 'FRAGCOUNT': '14.000'} [2023-02-24 18:37:55,566][177155] DAMAGECOUNT value on done: 146811.0 [2023-02-24 18:37:55,567][177155] Sum rewards: 13.257, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.017', 'AMMO2': '0.028', 'WEAPON1': '0.050', 'AMMO3': '0.120', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'HEALTH': '0.164', 'weapon4': '0.240', 'weapon5': '0.282', 'WEAPON5': '0.350', 'weapon2': '0.704', 'WEAPON3': '0.750', 'HITCOUNT': '1.090', 'weapon3': '2.246', 'DAMAGECOUNT': '4.179', 'FRAGCOUNT': '12.500'} [2023-02-24 18:37:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 62939136. Throughput: 0: 3476.2. Samples: 15732240. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:37:56,376][177119] Avg episode reward: [(0, '11.485')] [2023-02-24 18:37:57,528][177153] Updated weights for policy 0, policy_version 15370 (0.0008) [2023-02-24 18:38:00,473][177153] Updated weights for policy 0, policy_version 15380 (0.0008) [2023-02-24 18:38:01,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 63008768. Throughput: 0: 3477.3. Samples: 15753092. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:38:01,376][177119] Avg episode reward: [(0, '11.485')] [2023-02-24 18:38:01,778][177156] DAMAGECOUNT value on done: 152264.0 [2023-02-24 18:38:01,779][177156] Sum rewards: 23.558, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.144', 'AMMO5': '0.007', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'weapon5': '0.118', 'AMMO3': '0.123', 'AMMO4': '0.134', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.504', 'WEAPON3': '0.800', 'weapon2': '1.186', 'HITCOUNT': '1.330', 'weapon3': '1.836', 'DAMAGECOUNT': '6.657', 'FRAGCOUNT': '22.000'} [2023-02-24 18:38:01,863][177156] DAMAGECOUNT value on done: 148490.0 [2023-02-24 18:38:01,863][177156] Sum rewards: 9.117, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.834', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'weapon7': '0.060', 'AMMO3': '0.068', 'weapon5': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.145', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'ARMOR': '0.452', 'WEAPON4': '0.600', 'weapon2': '0.608', 'HITCOUNT': '0.940', 'weapon3': '1.248', 'weapon4': '1.444', 'DAMAGECOUNT': '3.906', 'FRAGCOUNT': '7.500'} [2023-02-24 18:38:02,089][177156] DAMAGECOUNT value on done: 151246.0 [2023-02-24 18:38:02,089][177156] Sum rewards: 10.402, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.953', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon7': '0.048', 'WEAPON1': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'weapon5': '0.186', 'AMMO4': '0.211', 'WEAPON5': '0.450', 'weapon2': '0.578', 'weapon4': '0.644', 'WEAPON3': '0.800', 'HITCOUNT': '0.850', 'weapon3': '1.770', 'DAMAGECOUNT': '3.624', 'FRAGCOUNT': '9.000'} [2023-02-24 18:38:02,172][177156] DAMAGECOUNT value on done: 150976.0 [2023-02-24 18:38:02,173][177156] Sum rewards: 20.178, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.270', 'AMMO5': '0.017', 'weapon4': '0.020', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon5': '0.096', 'AMMO4': '0.112', 'AMMO3': '0.153', 'WEAPON5': '0.350', 'weapon2': '0.864', 'WEAPON3': '1.050', 'HITCOUNT': '1.490', 'weapon3': '2.690', 'DAMAGECOUNT': '6.003', 'FRAGCOUNT': '19.000'} [2023-02-24 18:38:03,425][177153] Updated weights for policy 0, policy_version 15390 (0.0009) [2023-02-24 18:38:05,411][177170] DAMAGECOUNT value on done: 150307.0 [2023-02-24 18:38:05,412][177170] Sum rewards: 6.874, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.580', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.060', 'AMMO3': '0.064', 'AMMO4': '0.076', 'weapon7': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'weapon4': '0.466', 'HITCOUNT': '0.540', 'weapon3': '1.170', 'weapon2': '1.726', 'DAMAGECOUNT': '2.085', 'FRAGCOUNT': '5.000'} [2023-02-24 18:38:05,714][177170] DAMAGECOUNT value on done: 158331.0 [2023-02-24 18:38:05,715][177170] Sum rewards: 11.520, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.390', 'AMMO5': '0.015', 'AMMO2': '0.019', 'WEAPON1': '0.050', 'AMMO4': '0.097', 'AMMO3': '0.128', 'weapon5': '0.132', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.420', 'WEAPON3': '0.800', 'HITCOUNT': '1.010', 'weapon2': '1.334', 'weapon3': '1.662', 'DAMAGECOUNT': '4.143', 'FRAGCOUNT': '10.000'} [2023-02-24 18:38:05,730][177170] DAMAGECOUNT value on done: 146038.0 [2023-02-24 18:38:05,730][177170] Sum rewards: 5.430, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.108', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.050', 'AMMO3': '0.058', 'AMMO4': '0.091', 'weapon5': '0.274', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.490', 'ARMOR': '0.497', 'HITCOUNT': '0.560', 'weapon3': '0.918', 'weapon4': '1.280', 'DAMAGECOUNT': '2.139', 'FRAGCOUNT': '5.000'} [2023-02-24 18:38:06,027][177170] DAMAGECOUNT value on done: 148739.0 [2023-02-24 18:38:06,028][177170] Sum rewards: 13.344, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.800', 'AMMO5': '0.010', 'AMMO2': '0.011', 'ARMOR': '0.024', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'weapon4': '0.076', 'AMMO3': '0.106', 'weapon5': '0.156', 'WEAPON5': '0.300', 'WEAPON3': '0.800', 'HITCOUNT': '1.070', 'weapon2': '1.386', 'weapon3': '2.072', 'DAMAGECOUNT': '4.239', 'FRAGCOUNT': '12.000'} [2023-02-24 18:38:06,368][177153] Updated weights for policy 0, policy_version 15400 (0.0008) [2023-02-24 18:38:06,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 63078400. Throughput: 0: 3475.8. Samples: 15763562. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:38:06,376][177119] Avg episode reward: [(0, '11.384')] [2023-02-24 18:38:07,157][177158] DAMAGECOUNT value on done: 146674.0 [2023-02-24 18:38:07,157][177158] Sum rewards: 5.647, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.400', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon4': '0.036', 'WEAPON1': '0.080', 'AMMO3': '0.102', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'weapon5': '0.244', 'WEAPON5': '0.400', 'HITCOUNT': '0.680', 'WEAPON3': '0.700', 'weapon2': '1.606', 'weapon3': '1.650', 'DAMAGECOUNT': '2.709', 'FRAGCOUNT': '6.000'} [2023-02-24 18:38:07,453][177158] DAMAGECOUNT value on done: 149064.0 [2023-02-24 18:38:07,454][177158] Sum rewards: 11.240, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.012', 'AMMO2': '0.031', 'WEAPON1': '0.050', 'AMMO3': '0.061', 'AMMO4': '0.154', 'weapon5': '0.162', 'HEALTH': '0.194', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'weapon4': '0.822', 'HITCOUNT': '0.950', 'weapon2': '1.012', 'weapon3': '1.538', 'DAMAGECOUNT': '3.954', 'FRAGCOUNT': '8.000'} [2023-02-24 18:38:08,062][177158] DAMAGECOUNT value on done: 154365.0 [2023-02-24 18:38:08,063][177158] Sum rewards: 16.680, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.784', 'AMMO5': '0.012', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'AMMO4': '0.113', 'weapon5': '0.158', 'AMMO3': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.364', 'weapon2': '0.730', 'WEAPON3': '0.950', 'HITCOUNT': '1.460', 'weapon3': '1.854', 'DAMAGECOUNT': '5.796', 'FRAGCOUNT': '19.000'} [2023-02-24 18:38:08,359][177158] DAMAGECOUNT value on done: 152020.0 [2023-02-24 18:38:08,359][177158] Sum rewards: 11.015, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.330', 'AMMO5': '0.018', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'AMMO3': '0.095', 'AMMO4': '0.112', 'weapon5': '0.152', 'WEAPON4': '0.250', 'ARMOR': '0.430', 'WEAPON5': '0.500', 'weapon2': '0.554', 'WEAPON3': '0.650', 'HITCOUNT': '0.840', 'weapon4': '1.106', 'weapon3': '1.480', 'DAMAGECOUNT': '3.846', 'FRAGCOUNT': '9.000'} [2023-02-24 18:38:09,314][177153] Updated weights for policy 0, policy_version 15410 (0.0008) [2023-02-24 18:38:09,826][177172] DAMAGECOUNT value on done: 151514.0 [2023-02-24 18:38:09,826][177172] Sum rewards: 14.028, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.972', 'AMMO5': '0.015', 'AMMO2': '0.020', 'WEAPON1': '0.070', 'AMMO4': '0.100', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'weapon4': '0.232', 'weapon5': '0.238', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'weapon2': '0.872', 'HITCOUNT': '1.410', 'weapon3': '2.222', 'DAMAGECOUNT': '5.343', 'FRAGCOUNT': '12.000'} [2023-02-24 18:38:10,127][177172] DAMAGECOUNT value on done: 151926.0 [2023-02-24 18:38:10,128][177172] Sum rewards: 8.332, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.010', 'AMMO2': '0.027', 'WEAPON1': '0.050', 'weapon7': '0.054', 'AMMO3': '0.063', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.135', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.350', 'weapon4': '0.364', 'HEALTH': '0.450', 'HITCOUNT': '0.620', 'weapon3': '1.492', 'weapon2': '1.686', 'DAMAGECOUNT': '2.490', 'FRAGCOUNT': '5.000'} [2023-02-24 18:38:11,056][177154] DAMAGECOUNT value on done: 155098.0 [2023-02-24 18:38:11,057][177154] Sum rewards: 4.339, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.594', 'AMMO5': '0.012', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'AMMO4': '0.103', 'AMMO3': '0.118', 'weapon5': '0.146', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.642', 'WEAPON3': '0.750', 'HITCOUNT': '0.830', 'ARMOR': '0.886', 'weapon2': '1.294', 'weapon3': '1.560', 'DAMAGECOUNT': '3.240', 'FRAGCOUNT': '4.500'} [2023-02-24 18:38:11,351][177154] DAMAGECOUNT value on done: 158381.0 [2023-02-24 18:38:11,351][177154] Sum rewards: 8.832, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.478', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.043', 'WEAPON1': '0.050', 'AMMO3': '0.072', 'AMMO4': '0.216', 'weapon5': '0.260', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'WEAPON4': '0.450', 'HITCOUNT': '0.790', 'weapon4': '1.022', 'weapon2': '1.132', 'weapon3': '1.180', 'DAMAGECOUNT': '2.970', 'FRAGCOUNT': '10.000'} [2023-02-24 18:38:11,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13858.1, 300 sec: 13912.5). Total num frames: 63143936. Throughput: 0: 3474.6. Samples: 15784388. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:38:11,376][177119] Avg episode reward: [(0, '11.292')] [2023-02-24 18:38:11,603][177172] DAMAGECOUNT value on done: 152595.0 [2023-02-24 18:38:11,603][177172] Sum rewards: 13.545, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.080', 'AMMO5': '0.012', 'weapon4': '0.018', 'AMMO2': '0.029', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.105', 'AMMO4': '0.143', 'weapon5': '0.180', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.930', 'weapon3': '1.420', 'weapon2': '2.048', 'DAMAGECOUNT': '3.780', 'FRAGCOUNT': '13.000'} [2023-02-24 18:38:11,657][177154] DAMAGECOUNT value on done: 154617.0 [2023-02-24 18:38:11,658][177154] Sum rewards: 9.135, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.286', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon7': '0.056', 'AMMO3': '0.060', 'WEAPON1': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.203', 'weapon5': '0.278', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'WEAPON5': '0.500', 'weapon4': '0.662', 'weapon2': '0.682', 'HITCOUNT': '0.740', 'weapon3': '1.384', 'DAMAGECOUNT': '3.228', 'FRAGCOUNT': '8.000'} [2023-02-24 18:38:11,904][177172] DAMAGECOUNT value on done: 153921.0 [2023-02-24 18:38:11,905][177172] Sum rewards: 13.800, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.058', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'AMMO3': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.402', 'ARMOR': '0.457', 'WEAPON3': '0.800', 'weapon2': '0.858', 'HITCOUNT': '1.040', 'weapon3': '2.188', 'DAMAGECOUNT': '3.942', 'FRAGCOUNT': '14.000'} [2023-02-24 18:38:11,958][177154] DAMAGECOUNT value on done: 159065.0 [2023-02-24 18:38:11,958][177154] Sum rewards: 9.929, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.190', 'AMMO5': '0.030', 'AMMO2': '0.038', 'WEAPON1': '0.090', 'AMMO3': '0.147', 'weapon5': '0.162', 'AMMO4': '0.190', 'WEAPON4': '0.250', 'weapon4': '0.438', 'weapon2': '0.456', 'WEAPON5': '0.650', 'HITCOUNT': '1.040', 'WEAPON3': '1.100', 'weapon3': '2.314', 'DAMAGECOUNT': '4.464', 'FRAGCOUNT': '13.000'} [2023-02-24 18:38:12,244][177157] DAMAGECOUNT value on done: 158222.0 [2023-02-24 18:38:12,244][177157] Sum rewards: 16.208, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.046', 'AMMO2': '0.011', 'AMMO5': '0.012', 'weapon4': '0.020', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.103', 'weapon5': '0.214', 'WEAPON5': '0.250', 'WEAPON3': '0.650', 'HITCOUNT': '1.170', 'weapon2': '1.194', 'weapon3': '2.194', 'DAMAGECOUNT': '4.293', 'FRAGCOUNT': '15.000'} [2023-02-24 18:38:12,269][177153] Updated weights for policy 0, policy_version 15420 (0.0009) [2023-02-24 18:38:12,340][177157] DAMAGECOUNT value on done: 144071.0 [2023-02-24 18:38:12,341][177157] Sum rewards: 3.842, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.290', 'AMMO5': '0.003', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'AMMO3': '0.048', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.130', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.300', 'HITCOUNT': '0.410', 'weapon4': '0.434', 'weapon3': '0.688', 'DAMAGECOUNT': '1.317', 'weapon2': '1.848', 'FRAGCOUNT': '4.000'} [2023-02-24 18:38:12,488][177171] DAMAGECOUNT value on done: 149003.0 [2023-02-24 18:38:12,488][177171] Sum rewards: 12.628, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-3.113', 'AMMO5': '0.015', 'AMMO2': '0.020', 'WEAPON1': '0.060', 'AMMO4': '0.100', 'weapon4': '0.132', 'AMMO3': '0.140', 'WEAPON4': '0.200', 'weapon5': '0.226', 'WEAPON5': '0.500', 'weapon2': '1.116', 'WEAPON3': '1.150', 'HITCOUNT': '1.160', 'weapon3': '2.196', 'DAMAGECOUNT': '4.725', 'FRAGCOUNT': '13.000'} [2023-02-24 18:38:12,547][177157] DAMAGECOUNT value on done: 149305.0 [2023-02-24 18:38:12,548][177157] Sum rewards: 7.365, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.250', 'AMMO2': '0.006', 'AMMO5': '0.011', 'AMMO4': '0.031', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'weapon5': '0.188', 'weapon4': '0.284', 'WEAPON5': '0.350', 'HITCOUNT': '0.750', 'WEAPON3': '0.800', 'weapon2': '1.224', 'weapon3': '1.930', 'DAMAGECOUNT': '3.018', 'FRAGCOUNT': '8.000'} [2023-02-24 18:38:12,640][177157] DAMAGECOUNT value on done: 149408.0 [2023-02-24 18:38:12,640][177157] Sum rewards: 19.186, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.175', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon5': '0.068', 'AMMO3': '0.090', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.324', 'WEAPON3': '0.600', 'weapon2': '0.968', 'HITCOUNT': '1.180', 'weapon3': '2.278', 'DAMAGECOUNT': '4.767', 'FRAGCOUNT': '16.000'} [2023-02-24 18:38:12,794][177171] DAMAGECOUNT value on done: 148706.0 [2023-02-24 18:38:12,794][177171] Sum rewards: 13.056, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.133', 'AMMO2': '0.009', 'AMMO5': '0.016', 'WEAPON1': '0.040', 'AMMO4': '0.044', 'weapon7': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.168', 'WEAPON7': '0.200', 'weapon4': '0.276', 'WEAPON5': '0.300', 'ARMOR': '0.479', 'WEAPON3': '0.600', 'HITCOUNT': '0.820', 'weapon2': '1.052', 'weapon3': '1.750', 'DAMAGECOUNT': '4.191', 'FRAGCOUNT': '12.000'} [2023-02-24 18:38:12,803][177171] DAMAGECOUNT value on done: 153739.0 [2023-02-24 18:38:12,803][177171] Sum rewards: 8.834, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.669', 'AMMO5': '0.012', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'weapon5': '0.060', 'AMMO4': '0.097', 'AMMO3': '0.152', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.456', 'weapon2': '0.716', 'weapon4': '0.812', 'WEAPON3': '0.850', 'HITCOUNT': '0.980', 'weapon3': '1.856', 'DAMAGECOUNT': '3.711', 'FRAGCOUNT': '9.000'} [2023-02-24 18:38:13,094][177171] DAMAGECOUNT value on done: 148923.0 [2023-02-24 18:38:13,095][177171] Sum rewards: 15.982, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.482', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO4': '0.034', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.126', 'weapon5': '0.146', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon2': '0.328', 'weapon4': '0.516', 'WEAPON3': '0.600', 'HITCOUNT': '1.120', 'weapon3': '1.890', 'DAMAGECOUNT': '4.887', 'FRAGCOUNT': '12.000'} [2023-02-24 18:38:13,969][177155] DAMAGECOUNT value on done: 152694.0 [2023-02-24 18:38:13,969][177155] Sum rewards: 10.629, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.366', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon7': '0.048', 'WEAPON1': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.114', 'AMMO4': '0.183', 'weapon5': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.404', 'WEAPON3': '0.650', 'weapon4': '0.870', 'HITCOUNT': '0.990', 'weapon2': '1.090', 'weapon3': '1.372', 'DAMAGECOUNT': '3.438', 'FRAGCOUNT': '11.000'} [2023-02-24 18:38:14,263][177155] DAMAGECOUNT value on done: 155119.0 [2023-02-24 18:38:14,263][177155] Sum rewards: 10.163, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.467', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.025', 'WEAPON1': '0.050', 'AMMO3': '0.053', 'weapon7': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.228', 'WEAPON5': '0.350', 'WEAPON3': '0.350', 'weapon4': '0.548', 'HITCOUNT': '0.560', 'weapon3': '1.258', 'weapon2': '1.288', 'DAMAGECOUNT': '2.568', 'FRAGCOUNT': '7.000'} [2023-02-24 18:38:14,583][177155] DAMAGECOUNT value on done: 158398.0 [2023-02-24 18:38:14,583][177155] Sum rewards: 9.932, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.050', 'AMMO2': '0.011', 'AMMO5': '0.017', 'WEAPON1': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.136', 'weapon5': '0.164', 'WEAPON4': '0.250', 'weapon4': '0.320', 'WEAPON5': '0.450', 'weapon2': '0.826', 'WEAPON3': '1.050', 'HITCOUNT': '1.080', 'weapon3': '2.132', 'DAMAGECOUNT': '4.188', 'FRAGCOUNT': '12.000'} [2023-02-24 18:38:14,896][177155] DAMAGECOUNT value on done: 148380.0 [2023-02-24 18:38:14,897][177155] Sum rewards: 11.895, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.052', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.060', 'AMMO4': '0.088', 'AMMO3': '0.108', 'weapon5': '0.108', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '0.700', 'weapon4': '0.752', 'weapon2': '0.912', 'HITCOUNT': '1.270', 'weapon3': '1.762', 'DAMAGECOUNT': '4.707', 'FRAGCOUNT': '14.000'} [2023-02-24 18:38:15,182][177153] Updated weights for policy 0, policy_version 15430 (0.0009) [2023-02-24 18:38:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 63217664. Throughput: 0: 3476.8. Samples: 15805330. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:38:16,376][177119] Avg episode reward: [(0, '11.246')] [2023-02-24 18:38:18,094][177153] Updated weights for policy 0, policy_version 15440 (0.0008) [2023-02-24 18:38:21,059][177153] Updated weights for policy 0, policy_version 15450 (0.0009) [2023-02-24 18:38:21,108][177156] DAMAGECOUNT value on done: 153974.0 [2023-02-24 18:38:21,108][177156] Sum rewards: 19.548, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.370', 'AMMO2': '0.009', 'AMMO5': '0.012', 'AMMO4': '0.047', 'WEAPON1': '0.050', 'weapon5': '0.116', 'AMMO3': '0.155', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.394', 'weapon2': '0.794', 'WEAPON3': '1.000', 'HITCOUNT': '1.380', 'weapon3': '2.230', 'DAMAGECOUNT': '5.130', 'FRAGCOUNT': '22.000'} [2023-02-24 18:38:21,189][177156] DAMAGECOUNT value on done: 149165.0 [2023-02-24 18:38:21,190][177156] Sum rewards: 6.108, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.820', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO5': '0.015', 'AMMO3': '0.055', 'WEAPON1': '0.060', 'weapon5': '0.100', 'WEAPON4': '0.200', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.466', 'HITCOUNT': '0.590', 'weapon3': '0.948', 'weapon2': '1.906', 'DAMAGECOUNT': '2.025', 'FRAGCOUNT': '5.000'} [2023-02-24 18:38:21,376][177119] Fps is (10 sec: 14335.9, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 63287296. Throughput: 0: 3478.6. Samples: 15815786. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:38:21,376][177119] Avg episode reward: [(0, '11.396')] [2023-02-24 18:38:21,414][177156] DAMAGECOUNT value on done: 152873.0 [2023-02-24 18:38:21,415][177156] Sum rewards: 15.980, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.057', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.015', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'weapon5': '0.134', 'weapon4': '0.238', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '0.970', 'weapon2': '1.010', 'weapon3': '2.200', 'DAMAGECOUNT': '4.881', 'FRAGCOUNT': '16.000'} [2023-02-24 18:38:21,495][177156] DAMAGECOUNT value on done: 152398.0 [2023-02-24 18:38:21,496][177156] Sum rewards: 13.889, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.013', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'AMMO3': '0.090', 'weapon5': '0.100', 'AMMO4': '0.135', 'WEAPON4': '0.250', 'HEALTH': '0.294', 'WEAPON5': '0.300', 'weapon2': '0.404', 'ARMOR': '0.428', 'WEAPON3': '0.500', 'HITCOUNT': '0.980', 'weapon4': '1.148', 'weapon3': '1.674', 'DAMAGECOUNT': '4.266', 'FRAGCOUNT': '13.000'} [2023-02-24 18:38:23,993][177153] Updated weights for policy 0, policy_version 15460 (0.0008) [2023-02-24 18:38:24,705][177170] DAMAGECOUNT value on done: 150994.0 [2023-02-24 18:38:24,705][177170] Sum rewards: 7.149, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.015', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.017', 'WEAPON1': '0.060', 'AMMO3': '0.061', 'weapon5': '0.082', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.128', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.428', 'WEAPON3': '0.500', 'HITCOUNT': '0.530', 'weapon2': '0.530', 'weapon3': '1.444', 'DAMAGECOUNT': '2.061', 'FRAGCOUNT': '6.000'} [2023-02-24 18:38:25,004][177170] DAMAGECOUNT value on done: 147285.0 [2023-02-24 18:38:25,005][177170] Sum rewards: 13.495, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.860', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.037', 'WEAPON1': '0.040', 'weapon5': '0.078', 'AMMO3': '0.138', 'weapon7': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.320', 'weapon2': '0.858', 'WEAPON3': '0.900', 'HITCOUNT': '0.960', 'weapon3': '2.210', 'DAMAGECOUNT': '3.741', 'FRAGCOUNT': '12.000'} [2023-02-24 18:38:25,013][177170] DAMAGECOUNT value on done: 159631.0 [2023-02-24 18:38:25,014][177170] Sum rewards: 9.207, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.638', 'AMMO5': '0.017', 'AMMO2': '0.021', 'WEAPON1': '0.050', 'weapon5': '0.096', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.126', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '0.950', 'weapon2': '1.302', 'weapon3': '2.126', 'DAMAGECOUNT': '3.900', 'FRAGCOUNT': '9.000'} [2023-02-24 18:38:25,317][177170] DAMAGECOUNT value on done: 150548.0 [2023-02-24 18:38:25,317][177170] Sum rewards: 15.860, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.044', 'AMMO2': '0.015', 'AMMO5': '0.015', 'WEAPON1': '0.070', 'AMMO4': '0.076', 'weapon4': '0.096', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.192', 'AMMO3': '0.202', 'WEAPON5': '0.350', 'weapon2': '0.484', 'WEAPON3': '1.100', 'HITCOUNT': '1.450', 'weapon3': '2.776', 'DAMAGECOUNT': '5.427', 'FRAGCOUNT': '16.000'} [2023-02-24 18:38:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 63356928. Throughput: 0: 3478.4. Samples: 15836706. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:38:26,376][177119] Avg episode reward: [(0, '11.364')] [2023-02-24 18:38:26,453][177158] DAMAGECOUNT value on done: 147812.0 [2023-02-24 18:38:26,454][177158] Sum rewards: 10.233, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.620', 'AMMO5': '0.025', 'AMMO2': '0.032', 'WEAPON1': '0.070', 'AMMO3': '0.093', 'WEAPON4': '0.150', 'AMMO4': '0.160', 'weapon5': '0.264', 'ARMOR': '0.400', 'weapon4': '0.434', 'WEAPON3': '0.650', 'WEAPON5': '0.650', 'HITCOUNT': '0.720', 'weapon3': '1.264', 'weapon2': '1.276', 'DAMAGECOUNT': '3.414', 'FRAGCOUNT': '9.000'} [2023-02-24 18:38:26,746][177158] DAMAGECOUNT value on done: 150351.0 [2023-02-24 18:38:26,746][177158] Sum rewards: 9.516, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.210', 'AMMO5': '0.017', 'AMMO2': '0.023', 'WEAPON4': '0.050', 'WEAPON1': '0.090', 'AMMO3': '0.103', 'AMMO4': '0.113', 'weapon4': '0.130', 'weapon5': '0.254', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'HITCOUNT': '0.780', 'weapon2': '1.120', 'weapon3': '2.034', 'DAMAGECOUNT': '3.861', 'FRAGCOUNT': '10.000'} [2023-02-24 18:38:26,941][177153] Updated weights for policy 0, policy_version 15470 (0.0008) [2023-02-24 18:38:27,350][177158] DAMAGECOUNT value on done: 155890.0 [2023-02-24 18:38:27,351][177158] Sum rewards: 15.038, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.457', 'AMMO2': '0.014', 'AMMO5': '0.017', 'WEAPON1': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.119', 'weapon5': '0.188', 'WEAPON4': '0.250', 'weapon4': '0.272', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'weapon2': '1.096', 'HITCOUNT': '1.190', 'weapon3': '2.102', 'DAMAGECOUNT': '4.575', 'FRAGCOUNT': '16.000'} [2023-02-24 18:38:27,650][177158] DAMAGECOUNT value on done: 153671.0 [2023-02-24 18:38:27,651][177158] Sum rewards: 17.264, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.780', 'ARMOR': '0.008', 'AMMO5': '0.018', 'WEAPON1': '0.050', 'AMMO2': '0.051', 'AMMO3': '0.080', 'weapon5': '0.246', 'AMMO4': '0.256', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '0.550', 'weapon2': '0.826', 'weapon4': '0.928', 'HITCOUNT': '1.290', 'weapon3': '1.538', 'DAMAGECOUNT': '4.953', 'FRAGCOUNT': '16.000'} [2023-02-24 18:38:29,147][177172] DAMAGECOUNT value on done: 152993.0 [2023-02-24 18:38:29,148][177172] Sum rewards: 14.926, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.082', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.042', 'AMMO3': '0.065', 'WEAPON5': '0.150', 'weapon5': '0.160', 'AMMO4': '0.208', 'WEAPON4': '0.400', 'WEAPON3': '0.400', 'weapon4': '0.546', 'ARMOR': '0.900', 'HITCOUNT': '1.230', 'weapon3': '1.278', 'weapon2': '1.674', 'DAMAGECOUNT': '4.437', 'FRAGCOUNT': '11.000'} [2023-02-24 18:38:29,447][177172] DAMAGECOUNT value on done: 153217.0 [2023-02-24 18:38:29,447][177172] Sum rewards: 10.949, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.820', 'AMMO5': '0.017', 'AMMO2': '0.044', 'WEAPON1': '0.050', 'AMMO3': '0.104', 'AMMO4': '0.222', 'weapon5': '0.258', 'WEAPON4': '0.300', 'weapon4': '0.358', 'WEAPON5': '0.400', 'ARMOR': '0.460', 'WEAPON3': '0.700', 'HITCOUNT': '0.820', 'weapon2': '1.118', 'weapon3': '1.794', 'DAMAGECOUNT': '3.873', 'FRAGCOUNT': '9.000'} [2023-02-24 18:38:29,855][177153] Updated weights for policy 0, policy_version 15480 (0.0008) [2023-02-24 18:38:30,313][177154] DAMAGECOUNT value on done: 156327.0 [2023-02-24 18:38:30,313][177154] Sum rewards: 9.506, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.641', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.026', 'WEAPON1': '0.060', 'AMMO3': '0.077', 'AMMO4': '0.129', 'weapon5': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.442', 'WEAPON3': '0.600', 'HITCOUNT': '0.790', 'weapon3': '1.406', 'weapon2': '1.566', 'DAMAGECOUNT': '3.687', 'FRAGCOUNT': '9.000'} [2023-02-24 18:38:30,603][177154] DAMAGECOUNT value on done: 159759.0 [2023-02-24 18:38:30,604][177154] Sum rewards: 5.557, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.304', 'ARMOR': '0.020', 'AMMO5': '0.025', 'AMMO2': '0.038', 'WEAPON1': '0.060', 'weapon5': '0.122', 'AMMO3': '0.129', 'AMMO4': '0.191', 'WEAPON4': '0.400', 'weapon4': '0.560', 'WEAPON5': '0.600', 'weapon2': '0.872', 'WEAPON3': '0.900', 'HITCOUNT': '1.050', 'weapon3': '2.010', 'DAMAGECOUNT': '4.134', 'FRAGCOUNT': '7.000'} [2023-02-24 18:38:30,893][177154] DAMAGECOUNT value on done: 155679.0 [2023-02-24 18:38:30,894][177154] Sum rewards: 7.229, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.181', 'AMMO5': '0.027', 'AMMO2': '0.035', 'weapon7': '0.066', 'AMMO3': '0.098', 'WEAPON1': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.228', 'weapon2': '0.290', 'WEAPON5': '0.650', 'WEAPON3': '0.700', 'HITCOUNT': '0.750', 'weapon4': '0.928', 'weapon3': '1.778', 'DAMAGECOUNT': '3.186', 'FRAGCOUNT': '7.000'} [2023-02-24 18:38:30,928][177172] DAMAGECOUNT value on done: 154408.0 [2023-02-24 18:38:30,928][177172] Sum rewards: 18.476, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.652', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.050', 'AMMO4': '0.079', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'weapon4': '0.182', 'weapon5': '0.236', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'HITCOUNT': '1.230', 'weapon2': '1.230', 'weapon3': '1.964', 'DAMAGECOUNT': '5.439', 'FRAGCOUNT': '17.000'} [2023-02-24 18:38:31,196][177154] DAMAGECOUNT value on done: 159781.0 [2023-02-24 18:38:31,196][177154] Sum rewards: 7.743, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'WEAPON1': '0.040', 'AMMO2': '0.041', 'AMMO3': '0.059', 'WEAPON5': '0.200', 'AMMO4': '0.203', 'WEAPON4': '0.250', 'weapon5': '0.276', 'HEALTH': '0.288', 'WEAPON3': '0.350', 'ARMOR': '0.500', 'HITCOUNT': '0.600', 'weapon2': '0.604', 'weapon3': '1.078', 'weapon4': '1.098', 'DAMAGECOUNT': '2.148', 'FRAGCOUNT': '6.000'} [2023-02-24 18:38:31,234][177172] DAMAGECOUNT value on done: 155070.0 [2023-02-24 18:38:31,234][177172] Sum rewards: 10.087, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.434', 'AMMO5': '0.012', 'AMMO2': '0.032', 'WEAPON1': '0.060', 'AMMO3': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.158', 'AMMO4': '0.159', 'weapon5': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'weapon4': '0.766', 'HITCOUNT': '0.860', 'ARMOR': '0.900', 'weapon3': '1.118', 'weapon2': '1.484', 'DAMAGECOUNT': '3.447', 'FRAGCOUNT': '8.000'} [2023-02-24 18:38:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 63426560. Throughput: 0: 3480.1. Samples: 15857592. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:38:31,376][177119] Avg episode reward: [(0, '11.297')] [2023-02-24 18:38:31,502][177157] DAMAGECOUNT value on done: 159809.0 [2023-02-24 18:38:31,503][177157] Sum rewards: 15.743, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.828', 'AMMO2': '0.025', 'AMMO5': '0.032', 'WEAPON1': '0.050', 'AMMO4': '0.124', 'weapon5': '0.150', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon4': '0.246', 'WEAPON5': '0.600', 'weapon2': '0.730', 'HITCOUNT': '0.990', 'WEAPON3': '1.150', 'weapon3': '2.578', 'DAMAGECOUNT': '4.761', 'FRAGCOUNT': '16.000'} [2023-02-24 18:38:31,608][177157] DAMAGECOUNT value on done: 145570.0 [2023-02-24 18:38:31,609][177157] Sum rewards: 12.401, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.128', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.034', 'WEAPON1': '0.050', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.105', 'AMMO4': '0.171', 'weapon5': '0.222', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.668', 'WEAPON3': '0.700', 'weapon2': '0.844', 'HITCOUNT': '0.880', 'weapon3': '1.758', 'DAMAGECOUNT': '4.497', 'FRAGCOUNT': '12.000'} [2023-02-24 18:38:31,806][177157] DAMAGECOUNT value on done: 150568.0 [2023-02-24 18:38:31,806][177157] Sum rewards: 13.583, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.011', 'AMMO2': '0.018', 'WEAPON1': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.089', 'weapon5': '0.248', 'WEAPON5': '0.250', 'HEALTH': '0.296', 'WEAPON3': '0.400', 'HITCOUNT': '0.860', 'weapon3': '1.458', 'weapon2': '2.054', 'DAMAGECOUNT': '3.789', 'FRAGCOUNT': '8.500'} [2023-02-24 18:38:31,810][177171] DAMAGECOUNT value on done: 149624.0 [2023-02-24 18:38:31,811][177171] Sum rewards: 5.740, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.052', 'AMMO5': '0.012', 'AMMO2': '0.032', 'WEAPON1': '0.040', 'AMMO3': '0.070', 'AMMO4': '0.159', 'weapon5': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.580', 'weapon4': '0.882', 'weapon3': '0.930', 'weapon2': '1.204', 'DAMAGECOUNT': '1.863', 'FRAGCOUNT': '6.000'} [2023-02-24 18:38:31,908][177157] DAMAGECOUNT value on done: 150370.0 [2023-02-24 18:38:31,908][177157] Sum rewards: 8.359, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.194', 'ARMOR': '0.004', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.027', 'WEAPON1': '0.050', 'weapon7': '0.056', 'weapon5': '0.064', 'AMMO3': '0.095', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.276', 'WEAPON3': '0.650', 'HITCOUNT': '0.730', 'weapon4': '0.910', 'weapon3': '1.400', 'DAMAGECOUNT': '2.886', 'FRAGCOUNT': '9.000'} [2023-02-24 18:38:32,112][177171] DAMAGECOUNT value on done: 150257.0 [2023-02-24 18:38:32,112][177171] Sum rewards: 11.980, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.234', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.040', 'AMMO4': '0.066', 'AMMO3': '0.131', 'weapon5': '0.160', 'WEAPON5': '0.200', 'WEAPON3': '0.750', 'HITCOUNT': '1.200', 'weapon2': '1.730', 'weapon3': '1.760', 'DAMAGECOUNT': '4.653', 'FRAGCOUNT': '9.000'} [2023-02-24 18:38:32,122][177171] DAMAGECOUNT value on done: 155252.0 [2023-02-24 18:38:32,122][177171] Sum rewards: 13.602, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.633', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.064', 'WEAPON1': '0.070', 'AMMO4': '0.173', 'WEAPON4': '0.200', 'weapon5': '0.280', 'WEAPON5': '0.350', 'weapon4': '0.394', 'WEAPON3': '0.550', 'HITCOUNT': '0.800', 'weapon3': '1.442', 'weapon2': '1.578', 'DAMAGECOUNT': '4.539', 'FRAGCOUNT': '10.000'} [2023-02-24 18:38:32,428][177171] DAMAGECOUNT value on done: 150611.0 [2023-02-24 18:38:32,428][177171] Sum rewards: 22.334, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.289', 'AMMO2': '0.012', 'AMMO5': '0.018', 'WEAPON1': '0.040', 'AMMO4': '0.058', 'AMMO3': '0.083', 'WEAPON4': '0.200', 'weapon5': '0.312', 'ARMOR': '0.459', 'WEAPON5': '0.500', 'weapon4': '0.508', 'WEAPON3': '0.650', 'weapon2': '0.826', 'HITCOUNT': '1.190', 'weapon3': '1.952', 'DAMAGECOUNT': '5.064', 'FRAGCOUNT': '18.500'} [2023-02-24 18:38:32,775][177153] Updated weights for policy 0, policy_version 15490 (0.0009) [2023-02-24 18:38:33,116][177155] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 18:38:33,282][177155] DAMAGECOUNT value on done: 153752.0 [2023-02-24 18:38:33,282][177155] Sum rewards: 7.188, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.887', 'AMMO5': '0.017', 'AMMO2': '0.020', 'WEAPON1': '0.070', 'AMMO4': '0.101', 'AMMO3': '0.136', 'WEAPON4': '0.200', 'weapon5': '0.278', 'weapon2': '0.410', 'WEAPON5': '0.450', 'ARMOR': '0.454', 'weapon4': '0.524', 'HITCOUNT': '0.870', 'WEAPON3': '0.900', 'weapon3': '2.220', 'DAMAGECOUNT': '3.174', 'FRAGCOUNT': '7.500'} [2023-02-24 18:38:33,580][177155] DAMAGECOUNT value on done: 157164.0 [2023-02-24 18:38:33,581][177155] Sum rewards: 17.828, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.510', 'AMMO5': '0.015', 'AMMO2': '0.038', 'WEAPON1': '0.050', 'weapon5': '0.082', 'AMMO3': '0.124', 'AMMO4': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.552', 'weapon4': '0.618', 'WEAPON3': '0.850', 'HITCOUNT': '1.510', 'weapon3': '2.326', 'DAMAGECOUNT': '6.135', 'FRAGCOUNT': '15.000'} [2023-02-24 18:38:33,880][177155] DAMAGECOUNT value on done: 159794.0 [2023-02-24 18:38:33,881][177155] Sum rewards: 12.211, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.566', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon7': '0.058', 'WEAPON1': '0.060', 'AMMO3': '0.078', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.292', 'WEAPON5': '0.300', 'ARMOR': '0.495', 'weapon4': '0.496', 'WEAPON3': '0.500', 'weapon2': '1.100', 'HITCOUNT': '1.110', 'weapon3': '1.410', 'DAMAGECOUNT': '4.188', 'FRAGCOUNT': '8.500'} [2023-02-24 18:38:34,177][177155] DAMAGECOUNT value on done: 149670.0 [2023-02-24 18:38:34,177][177155] Sum rewards: 11.524, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.800', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.016', 'WEAPON1': '0.060', 'AMMO3': '0.078', 'weapon7': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.760', 'weapon4': '0.918', 'weapon2': '1.010', 'weapon3': '1.276', 'DAMAGECOUNT': '3.870', 'FRAGCOUNT': '10.000'} [2023-02-24 18:38:35,730][177153] Updated weights for policy 0, policy_version 15500 (0.0009) [2023-02-24 18:38:36,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 63496192. Throughput: 0: 3479.6. Samples: 15867986. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:38:36,376][177119] Avg episode reward: [(0, '11.554')] [2023-02-24 18:38:38,686][177153] Updated weights for policy 0, policy_version 15510 (0.0008) [2023-02-24 18:38:40,353][177156] DAMAGECOUNT value on done: 155010.0 [2023-02-24 18:38:40,354][177156] Sum rewards: 3.181, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.090', 'AMMO5': '0.017', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'weapon7': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.114', 'WEAPON4': '0.150', 'weapon5': '0.274', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'HITCOUNT': '0.570', 'weapon4': '0.594', 'WEAPON3': '0.700', 'weapon2': '0.726', 'weapon3': '1.370', 'DAMAGECOUNT': '3.108', 'FRAGCOUNT': '4.000'} [2023-02-24 18:38:40,444][177156] DAMAGECOUNT value on done: 150395.0 [2023-02-24 18:38:40,445][177156] Sum rewards: 11.085, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.714', 'AMMO2': '0.008', 'AMMO5': '0.015', 'ARMOR': '0.016', 'AMMO4': '0.040', 'weapon4': '0.044', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO3': '0.087', 'weapon5': '0.228', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '0.950', 'weapon2': '1.608', 'weapon3': '1.792', 'DAMAGECOUNT': '3.690', 'FRAGCOUNT': '9.000'} [2023-02-24 18:38:40,655][177156] DAMAGECOUNT value on done: 153358.0 [2023-02-24 18:38:40,655][177156] Sum rewards: 4.205, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.660', 'AMMO5': '0.010', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'AMMO3': '0.040', 'weapon7': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.113', 'weapon5': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'WEAPON3': '0.300', 'ARMOR': '0.500', 'weapon4': '0.768', 'weapon3': '0.852', 'weapon2': '0.930', 'DAMAGECOUNT': '1.455', 'FRAGCOUNT': '3.000'} [2023-02-24 18:38:40,758][177156] DAMAGECOUNT value on done: 152765.0 [2023-02-24 18:38:40,759][177156] Sum rewards: 2.972, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.200', 'AMMO5': '0.005', 'ARMOR': '0.005', 'AMMO3': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'weapon7': '0.046', 'WEAPON3': '0.050', 'weapon2': '0.058', 'AMMO4': '0.059', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.170', 'WEAPON7': '0.200', 'weapon3': '0.208', 'WEAPON4': '0.250', 'weapon4': '0.836', 'DAMAGECOUNT': '1.101', 'FRAGCOUNT': '2.000'} [2023-02-24 18:38:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 63565824. Throughput: 0: 3480.9. Samples: 15888880. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:38:41,376][177119] Avg episode reward: [(0, '11.361')] [2023-02-24 18:38:41,629][177153] Updated weights for policy 0, policy_version 15520 (0.0008) [2023-02-24 18:38:44,095][177170] DAMAGECOUNT value on done: 152064.0 [2023-02-24 18:38:44,096][177170] Sum rewards: 14.045, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.829', 'AMMO4': '-0.048', 'AMMO2': '-0.010', 'AMMO5': '0.010', 'WEAPON1': '0.050', 'AMMO3': '0.077', 'weapon5': '0.154', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.780', 'weapon3': '1.546', 'weapon2': '1.954', 'DAMAGECOUNT': '3.210', 'FRAGCOUNT': '11.500'} [2023-02-24 18:38:44,390][177170] DAMAGECOUNT value on done: 148703.0 [2023-02-24 18:38:44,391][177170] Sum rewards: 10.791, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.728', 'AMMO2': '0.017', 'AMMO5': '0.017', 'weapon7': '0.018', 'WEAPON1': '0.050', 'AMMO4': '0.083', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.106', 'WEAPON4': '0.200', 'weapon5': '0.204', 'weapon4': '0.328', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '1.010', 'weapon2': '1.144', 'weapon3': '1.938', 'DAMAGECOUNT': '4.254', 'FRAGCOUNT': '9.000'} [2023-02-24 18:38:44,401][177170] DAMAGECOUNT value on done: 161579.0 [2023-02-24 18:38:44,401][177170] Sum rewards: 16.178, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.100', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'weapon4': '0.058', 'AMMO4': '0.091', 'weapon5': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'WEAPON5': '0.300', 'WEAPON3': '0.900', 'weapon2': '1.034', 'HITCOUNT': '1.350', 'weapon3': '2.450', 'DAMAGECOUNT': '5.844', 'FRAGCOUNT': '15.000'} [2023-02-24 18:38:44,602][177153] Updated weights for policy 0, policy_version 15530 (0.0008) [2023-02-24 18:38:44,708][177170] DAMAGECOUNT value on done: 151920.0 [2023-02-24 18:38:44,708][177170] Sum rewards: 12.512, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.353', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.050', 'AMMO3': '0.066', 'AMMO4': '0.072', 'weapon5': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'weapon4': '0.652', 'HITCOUNT': '1.050', 'weapon3': '1.124', 'weapon2': '1.610', 'DAMAGECOUNT': '4.116', 'FRAGCOUNT': '9.000'} [2023-02-24 18:38:45,779][177158] DAMAGECOUNT value on done: 149127.0 [2023-02-24 18:38:45,779][177158] Sum rewards: 9.757, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.804', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'weapon4': '0.084', 'AMMO4': '0.099', 'AMMO3': '0.138', 'weapon5': '0.170', 'WEAPON5': '0.250', 'WEAPON3': '0.750', 'HITCOUNT': '0.890', 'weapon2': '1.636', 'weapon3': '1.712', 'DAMAGECOUNT': '3.945', 'FRAGCOUNT': '9.000'} [2023-02-24 18:38:46,065][177158] DAMAGECOUNT value on done: 151615.0 [2023-02-24 18:38:46,066][177158] Sum rewards: 11.694, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.389', 'AMMO5': '0.015', 'AMMO2': '0.025', 'WEAPON1': '0.060', 'AMMO3': '0.120', 'AMMO4': '0.123', 'weapon5': '0.174', 'WEAPON4': '0.200', 'weapon4': '0.260', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'weapon2': '0.864', 'HITCOUNT': '0.890', 'weapon3': '2.110', 'DAMAGECOUNT': '3.792', 'FRAGCOUNT': '10.000'} [2023-02-24 18:38:46,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 63635456. Throughput: 0: 3478.7. Samples: 15909636. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:38:46,376][177119] Avg episode reward: [(0, '11.429')] [2023-02-24 18:38:46,690][177158] DAMAGECOUNT value on done: 157040.0 [2023-02-24 18:38:46,691][177158] Sum rewards: 13.026, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'HEALTH': '0.010', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'AMMO3': '0.087', 'AMMO4': '0.099', 'weapon4': '0.100', 'weapon5': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON3': '0.500', 'HITCOUNT': '0.760', 'weapon3': '1.456', 'weapon2': '2.058', 'DAMAGECOUNT': '3.450', 'FRAGCOUNT': '10.000'} [2023-02-24 18:38:46,992][177158] DAMAGECOUNT value on done: 154869.0 [2023-02-24 18:38:46,992][177158] Sum rewards: 5.871, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.680', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON1': '0.030', 'AMMO4': '0.057', 'AMMO3': '0.129', 'WEAPON5': '0.150', 'weapon5': '0.156', 'WEAPON4': '0.400', 'ARMOR': '0.454', 'WEAPON3': '0.800', 'weapon4': '0.888', 'HITCOUNT': '1.010', 'weapon3': '1.272', 'weapon2': '1.342', 'DAMAGECOUNT': '3.594', 'FRAGCOUNT': '11.000'} [2023-02-24 18:38:47,570][177153] Updated weights for policy 0, policy_version 15540 (0.0008) [2023-02-24 18:38:48,492][177172] DAMAGECOUNT value on done: 154183.0 [2023-02-24 18:38:48,492][177172] Sum rewards: 6.099, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.910', 'AMMO5': '0.014', 'WEAPON1': '0.040', 'AMMO2': '0.049', 'AMMO3': '0.075', 'weapon7': '0.098', 'weapon5': '0.136', 'AMMO6': '0.240', 'AMMO7': '0.240', 'AMMO4': '0.246', 'weapon2': '0.398', 'WEAPON7': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.660', 'WEAPON4': '0.750', 'weapon3': '1.276', 'weapon4': '1.566', 'DAMAGECOUNT': '3.570', 'FRAGCOUNT': '8.000'} [2023-02-24 18:38:48,792][177172] DAMAGECOUNT value on done: 153984.0 [2023-02-24 18:38:48,793][177172] Sum rewards: 7.012, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.656', 'AMMO5': '0.012', 'AMMO2': '0.014', 'WEAPON1': '0.050', 'AMMO3': '0.068', 'AMMO4': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.116', 'WEAPON4': '0.150', 'weapon5': '0.204', 'WEAPON5': '0.350', 'weapon4': '0.452', 'WEAPON3': '0.550', 'HITCOUNT': '0.580', 'weapon3': '1.326', 'weapon2': '1.374', 'DAMAGECOUNT': '2.301', 'FRAGCOUNT': '7.500'} [2023-02-24 18:38:49,698][177154] DAMAGECOUNT value on done: 157684.0 [2023-02-24 18:38:49,699][177154] Sum rewards: 8.958, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.720', 'AMMO2': '0.008', 'AMMO5': '0.020', 'AMMO4': '0.039', 'WEAPON1': '0.050', 'weapon5': '0.116', 'AMMO3': '0.138', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.244', 'WEAPON5': '0.450', 'HITCOUNT': '0.950', 'WEAPON3': '1.000', 'weapon2': '1.134', 'weapon3': '2.158', 'DAMAGECOUNT': '4.071', 'FRAGCOUNT': '11.000'} [2023-02-24 18:38:49,992][177154] DAMAGECOUNT value on done: 161275.0 [2023-02-24 18:38:49,993][177154] Sum rewards: 14.711, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.234', 'AMMO2': '0.010', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'weapon7': '0.046', 'AMMO4': '0.051', 'weapon5': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.526', 'WEAPON3': '0.800', 'HITCOUNT': '1.180', 'weapon2': '1.390', 'weapon3': '1.732', 'DAMAGECOUNT': '4.548', 'FRAGCOUNT': '15.000'} [2023-02-24 18:38:50,286][177154] DAMAGECOUNT value on done: 157592.0 [2023-02-24 18:38:50,287][177154] Sum rewards: 22.716, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.920', 'AMMO5': '0.015', 'AMMO2': '0.016', 'weapon7': '0.058', 'WEAPON1': '0.060', 'AMMO3': '0.070', 'AMMO4': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.314', 'weapon4': '0.384', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '1.060', 'weapon2': '1.254', 'weapon3': '1.594', 'DAMAGECOUNT': '5.739', 'FRAGCOUNT': '18.000'} [2023-02-24 18:38:50,295][177172] DAMAGECOUNT value on done: 155390.0 [2023-02-24 18:38:50,295][177172] Sum rewards: 6.974, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.730', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.029', 'WEAPON1': '0.050', 'weapon7': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.138', 'AMMO3': '0.144', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.454', 'HITCOUNT': '0.650', 'weapon4': '0.800', 'WEAPON3': '0.850', 'weapon2': '0.954', 'weapon3': '1.310', 'DAMAGECOUNT': '2.946', 'FRAGCOUNT': '10.000'} [2023-02-24 18:38:50,486][177153] Updated weights for policy 0, policy_version 15550 (0.0008) [2023-02-24 18:38:50,586][177154] DAMAGECOUNT value on done: 161394.0 [2023-02-24 18:38:50,586][177154] Sum rewards: 16.662, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.198', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.012', 'WEAPON1': '0.050', 'AMMO3': '0.115', 'weapon5': '0.194', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'weapon2': '1.136', 'HITCOUNT': '1.160', 'weapon3': '2.262', 'DAMAGECOUNT': '4.839', 'FRAGCOUNT': '15.000'} [2023-02-24 18:38:50,598][177172] DAMAGECOUNT value on done: 156382.0 [2023-02-24 18:38:50,598][177172] Sum rewards: 8.579, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.382', 'AMMO5': '0.013', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.101', 'AMMO3': '0.142', 'weapon5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.268', 'WEAPON5': '0.350', 'WEAPON3': '0.950', 'HITCOUNT': '1.000', 'weapon2': '1.084', 'weapon3': '2.166', 'DAMAGECOUNT': '3.936', 'FRAGCOUNT': '10.000'} [2023-02-24 18:38:50,833][177157] DAMAGECOUNT value on done: 160440.0 [2023-02-24 18:38:50,833][177157] Sum rewards: 7.382, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.381', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.015', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon7': '0.054', 'AMMO3': '0.061', 'weapon5': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'HITCOUNT': '0.450', 'weapon4': '0.482', 'WEAPON3': '0.500', 'weapon2': '1.246', 'weapon3': '1.446', 'DAMAGECOUNT': '1.893', 'FRAGCOUNT': '5.000'} [2023-02-24 18:38:50,917][177157] DAMAGECOUNT value on done: 146899.0 [2023-02-24 18:38:50,918][177157] Sum rewards: 11.674, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.960', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon7': '0.056', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.133', 'weapon5': '0.174', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'weapon4': '0.594', 'weapon2': '0.776', 'HITCOUNT': '0.790', 'WEAPON3': '1.000', 'weapon3': '1.678', 'DAMAGECOUNT': '3.987', 'FRAGCOUNT': '12.000'} [2023-02-24 18:38:51,144][177157] DAMAGECOUNT value on done: 151849.0 [2023-02-24 18:38:51,145][177157] Sum rewards: 9.672, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.934', 'AMMO5': '0.017', 'AMMO2': '0.026', 'WEAPON1': '0.060', 'AMMO3': '0.127', 'AMMO4': '0.132', 'weapon5': '0.142', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'ARMOR': '0.472', 'weapon4': '0.588', 'WEAPON3': '0.950', 'weapon2': '1.012', 'HITCOUNT': '1.070', 'weapon3': '1.866', 'DAMAGECOUNT': '3.843', 'FRAGCOUNT': '12.000'} [2023-02-24 18:38:51,224][177157] DAMAGECOUNT value on done: 151450.0 [2023-02-24 18:38:51,224][177157] Sum rewards: 11.795, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.168', 'AMMO5': '0.020', 'AMMO2': '0.023', 'WEAPON1': '0.080', 'AMMO3': '0.105', 'AMMO4': '0.116', 'weapon5': '0.122', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.800', 'weapon2': '1.620', 'weapon3': '1.736', 'DAMAGECOUNT': '3.240', 'FRAGCOUNT': '9.000'} [2023-02-24 18:38:51,228][177171] DAMAGECOUNT value on done: 151375.0 [2023-02-24 18:38:51,229][177171] Sum rewards: 16.110, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.060', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'weapon7': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.128', 'weapon5': '0.130', 'AMMO4': '0.179', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.396', 'WEAPON4': '0.450', 'WEAPON3': '0.900', 'weapon4': '1.210', 'HITCOUNT': '1.400', 'weapon3': '1.720', 'DAMAGECOUNT': '5.253', 'FRAGCOUNT': '16.000'} [2023-02-24 18:38:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 63705088. Throughput: 0: 3477.7. Samples: 15920060. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:38:51,376][177119] Avg episode reward: [(0, '11.296')] [2023-02-24 18:38:51,526][177171] DAMAGECOUNT value on done: 151903.0 [2023-02-24 18:38:51,526][177171] Sum rewards: 15.847, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.576', 'AMMO5': '0.010', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'weapon7': '0.078', 'weapon5': '0.090', 'AMMO4': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.123', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon2': '0.402', 'WEAPON3': '0.750', 'weapon4': '0.858', 'HITCOUNT': '1.120', 'weapon3': '1.958', 'DAMAGECOUNT': '4.938', 'FRAGCOUNT': '15.000'} [2023-02-24 18:38:51,536][177171] DAMAGECOUNT value on done: 156854.0 [2023-02-24 18:38:51,536][177171] Sum rewards: 12.128, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.831', 'AMMO5': '0.015', 'AMMO2': '0.016', 'WEAPON1': '0.050', 'weapon7': '0.070', 'AMMO4': '0.081', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.131', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.244', 'WEAPON5': '0.400', 'ARMOR': '0.400', 'weapon2': '0.454', 'HITCOUNT': '0.890', 'WEAPON3': '0.900', 'weapon4': '0.976', 'weapon3': '1.886', 'DAMAGECOUNT': '4.806', 'FRAGCOUNT': '11.000'} [2023-02-24 18:38:51,842][177171] DAMAGECOUNT value on done: 152449.0 [2023-02-24 18:38:51,843][177171] Sum rewards: 10.486, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.290', 'AMMO2': '0.013', 'AMMO5': '0.015', 'AMMO4': '0.064', 'WEAPON1': '0.090', 'AMMO3': '0.151', 'weapon5': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.554', 'WEAPON3': '0.950', 'HITCOUNT': '0.980', 'weapon2': '1.098', 'weapon3': '1.566', 'DAMAGECOUNT': '5.514', 'FRAGCOUNT': '12.000'} [2023-02-24 18:38:52,635][177155] DAMAGECOUNT value on done: 155232.0 [2023-02-24 18:38:52,635][177155] Sum rewards: 12.141, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.136', 'AMMO5': '0.022', 'AMMO2': '0.034', 'WEAPON1': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.158', 'AMMO4': '0.170', 'weapon5': '0.258', 'weapon4': '0.342', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'HITCOUNT': '0.850', 'WEAPON3': '0.950', 'weapon2': '0.968', 'weapon3': '1.744', 'DAMAGECOUNT': '4.440', 'FRAGCOUNT': '12.000'} [2023-02-24 18:38:52,936][177155] DAMAGECOUNT value on done: 158920.0 [2023-02-24 18:38:52,936][177155] Sum rewards: 14.743, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.510', 'AMMO5': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'AMMO3': '0.082', 'AMMO4': '0.085', 'weapon5': '0.196', 'WEAPON4': '0.200', 'weapon4': '0.366', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon2': '0.920', 'HITCOUNT': '1.060', 'weapon3': '1.706', 'DAMAGECOUNT': '5.268', 'FRAGCOUNT': '12.000'} [2023-02-24 18:38:53,245][177155] DAMAGECOUNT value on done: 161347.0 [2023-02-24 18:38:53,246][177155] Sum rewards: 16.738, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.835', 'AMMO5': '0.015', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'AMMO3': '0.088', 'AMMO4': '0.091', 'weapon5': '0.122', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.596', 'HITCOUNT': '1.150', 'weapon3': '1.460', 'weapon2': '1.544', 'DAMAGECOUNT': '4.659', 'FRAGCOUNT': '13.000'} [2023-02-24 18:38:53,414][177153] Updated weights for policy 0, policy_version 15560 (0.0008) [2023-02-24 18:38:53,545][177155] DAMAGECOUNT value on done: 150709.0 [2023-02-24 18:38:53,546][177155] Sum rewards: 6.200, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.538', 'AMMO2': '0.022', 'AMMO5': '0.022', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.108', 'AMMO3': '0.119', 'weapon5': '0.156', 'weapon4': '0.210', 'WEAPON5': '0.450', 'HITCOUNT': '0.650', 'WEAPON3': '0.800', 'weapon2': '1.218', 'weapon3': '2.006', 'DAMAGECOUNT': '3.117', 'FRAGCOUNT': '6.000'} [2023-02-24 18:38:56,357][177153] Updated weights for policy 0, policy_version 15570 (0.0009) [2023-02-24 18:38:56,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 63774720. Throughput: 0: 3478.9. Samples: 15940940. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:38:56,376][177119] Avg episode reward: [(0, '11.602')] [2023-02-24 18:38:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000015570_63774720.pth... [2023-02-24 18:38:56,437][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000014754_60432384.pth [2023-02-24 18:38:59,328][177153] Updated weights for policy 0, policy_version 15580 (0.0009) [2023-02-24 18:38:59,755][177156] DAMAGECOUNT value on done: 156754.0 [2023-02-24 18:38:59,756][177156] Sum rewards: 13.727, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.835', 'AMMO5': '0.016', 'WEAPON1': '0.040', 'AMMO2': '0.054', 'weapon5': '0.178', 'AMMO3': '0.179', 'AMMO4': '0.268', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon2': '0.582', 'weapon4': '0.732', 'WEAPON3': '1.150', 'HITCOUNT': '1.350', 'weapon3': '2.080', 'DAMAGECOUNT': '5.232', 'FRAGCOUNT': '18.000'} [2023-02-24 18:38:59,835][177156] DAMAGECOUNT value on done: 151007.0 [2023-02-24 18:38:59,836][177156] Sum rewards: 3.264, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.349', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.035', 'WEAPON1': '0.040', 'weapon7': '0.046', 'AMMO3': '0.051', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'WEAPON3': '0.350', 'weapon2': '0.486', 'ARMOR': '0.500', 'HITCOUNT': '0.540', 'weapon3': '0.602', 'weapon4': '1.086', 'DAMAGECOUNT': '1.836', 'FRAGCOUNT': '4.000'} [2023-02-24 18:39:00,066][177156] DAMAGECOUNT value on done: 154024.0 [2023-02-24 18:39:00,066][177156] Sum rewards: 7.760, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.201', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO3': '0.040', 'WEAPON1': '0.050', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'weapon5': '0.222', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'HITCOUNT': '0.470', 'ARMOR': '0.482', 'weapon4': '0.664', 'weapon3': '1.068', 'weapon2': '1.656', 'DAMAGECOUNT': '1.998', 'FRAGCOUNT': '5.000'} [2023-02-24 18:39:00,148][177156] DAMAGECOUNT value on done: 154406.0 [2023-02-24 18:39:00,148][177156] Sum rewards: 14.404, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.860', 'ARMOR': '0.024', 'AMMO5': '0.027', 'WEAPON1': '0.030', 'AMMO2': '0.042', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.112', 'AMMO4': '0.208', 'weapon5': '0.254', 'weapon2': '0.358', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'HITCOUNT': '1.060', 'weapon4': '1.238', 'weapon3': '1.640', 'DAMAGECOUNT': '4.923', 'FRAGCOUNT': '13.000'} [2023-02-24 18:39:01,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13858.1, 300 sec: 13912.5). Total num frames: 63840256. Throughput: 0: 3476.1. Samples: 15961754. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:39:01,376][177119] Avg episode reward: [(0, '11.480')] [2023-02-24 18:39:02,293][177153] Updated weights for policy 0, policy_version 15590 (0.0008) [2023-02-24 18:39:03,417][177170] DAMAGECOUNT value on done: 152937.0 [2023-02-24 18:39:03,418][177170] Sum rewards: 7.562, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.028', 'WEAPON1': '0.060', 'HEALTH': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.100', 'AMMO3': '0.113', 'weapon5': '0.172', 'WEAPON5': '0.300', 'HITCOUNT': '0.660', 'WEAPON3': '0.700', 'weapon3': '1.520', 'weapon2': '1.826', 'DAMAGECOUNT': '2.619', 'FRAGCOUNT': '6.000'} [2023-02-24 18:39:03,707][177170] DAMAGECOUNT value on done: 149668.0 [2023-02-24 18:39:03,707][177170] Sum rewards: 7.763, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.610', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO2': '0.051', 'AMMO3': '0.107', 'weapon5': '0.220', 'AMMO4': '0.256', 'WEAPON5': '0.350', 'weapon4': '0.414', 'ARMOR': '0.437', 'WEAPON4': '0.450', 'HITCOUNT': '0.670', 'WEAPON3': '0.750', 'weapon2': '1.454', 'weapon3': '1.524', 'DAMAGECOUNT': '2.895', 'FRAGCOUNT': '8.000'} [2023-02-24 18:39:03,719][177170] DAMAGECOUNT value on done: 163278.0 [2023-02-24 18:39:03,719][177170] Sum rewards: 16.662, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.452', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.046', 'AMMO3': '0.085', 'weapon5': '0.110', 'AMMO4': '0.229', 'WEAPON5': '0.350', 'ARMOR': '0.420', 'WEAPON4': '0.550', 'WEAPON3': '0.600', 'weapon2': '0.668', 'weapon4': '1.232', 'HITCOUNT': '1.480', 'weapon3': '1.712', 'DAMAGECOUNT': '5.097', 'FRAGCOUNT': '16.000'} [2023-02-24 18:39:04,006][177170] DAMAGECOUNT value on done: 152773.0 [2023-02-24 18:39:04,007][177170] Sum rewards: 10.186, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.678', 'AMMO5': '0.010', 'ARMOR': '0.020', 'WEAPON1': '0.030', 'AMMO2': '0.044', 'AMMO3': '0.070', 'weapon7': '0.176', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.218', 'AMMO4': '0.219', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'HITCOUNT': '0.430', 'WEAPON3': '0.500', 'weapon2': '0.772', 'weapon4': '1.060', 'weapon3': '1.256', 'DAMAGECOUNT': '2.559', 'FRAGCOUNT': '9.000'} [2023-02-24 18:39:05,090][177158] DAMAGECOUNT value on done: 149869.0 [2023-02-24 18:39:05,090][177158] Sum rewards: 8.430, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.895', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.068', 'AMMO3': '0.078', 'AMMO4': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.318', 'WEAPON3': '0.500', 'HITCOUNT': '0.530', 'ARMOR': '0.804', 'weapon3': '1.030', 'weapon4': '1.070', 'DAMAGECOUNT': '2.226', 'FRAGCOUNT': '7.000'} [2023-02-24 18:39:05,219][177153] Updated weights for policy 0, policy_version 15600 (0.0009) [2023-02-24 18:39:05,393][177158] DAMAGECOUNT value on done: 152515.0 [2023-02-24 18:39:05,394][177158] Sum rewards: 7.571, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.934', 'AMMO5': '0.012', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'AMMO4': '0.110', 'AMMO3': '0.129', 'weapon5': '0.172', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.564', 'HITCOUNT': '0.740', 'WEAPON3': '0.800', 'ARMOR': '0.941', 'weapon2': '1.052', 'weapon3': '1.582', 'DAMAGECOUNT': '2.700', 'FRAGCOUNT': '9.000'} [2023-02-24 18:39:06,010][177158] DAMAGECOUNT value on done: 158280.0 [2023-02-24 18:39:06,010][177158] Sum rewards: 15.876, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.940', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.028', 'WEAPON1': '0.050', 'AMMO3': '0.077', 'AMMO4': '0.140', 'WEAPON4': '0.250', 'weapon5': '0.324', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'weapon4': '0.646', 'HITCOUNT': '0.820', 'weapon3': '1.080', 'weapon2': '1.560', 'DAMAGECOUNT': '3.720', 'FRAGCOUNT': '14.000'} [2023-02-24 18:39:06,318][177158] DAMAGECOUNT value on done: 156552.0 [2023-02-24 18:39:06,319][177158] Sum rewards: 15.709, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.162', 'AMMO5': '0.017', 'AMMO2': '0.036', 'WEAPON1': '0.040', 'AMMO3': '0.097', 'AMMO4': '0.181', 'weapon5': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon4': '0.604', 'WEAPON3': '0.650', 'weapon2': '1.130', 'HITCOUNT': '1.200', 'weapon3': '1.674', 'DAMAGECOUNT': '5.049', 'FRAGCOUNT': '15.000'} [2023-02-24 18:39:06,376][177119] Fps is (10 sec: 13516.9, 60 sec: 13858.1, 300 sec: 13912.5). Total num frames: 63909888. Throughput: 0: 3474.4. Samples: 15972132. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:39:06,376][177119] Avg episode reward: [(0, '11.374')] [2023-02-24 18:39:07,790][177172] DAMAGECOUNT value on done: 155038.0 [2023-02-24 18:39:07,790][177172] Sum rewards: 2.917, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.886', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'AMMO3': '0.144', 'AMMO4': '0.172', 'weapon5': '0.174', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.477', 'weapon4': '0.718', 'HITCOUNT': '0.750', 'WEAPON3': '0.800', 'weapon2': '1.146', 'weapon3': '1.638', 'DAMAGECOUNT': '2.565', 'FRAGCOUNT': '8.000'} [2023-02-24 18:39:08,091][177172] DAMAGECOUNT value on done: 154828.0 [2023-02-24 18:39:08,092][177172] Sum rewards: 4.232, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.224', 'AMMO5': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.060', 'AMMO4': '0.072', 'AMMO3': '0.092', 'weapon5': '0.138', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.415', 'WEAPON3': '0.600', 'HITCOUNT': '0.670', 'weapon4': '0.964', 'weapon2': '1.232', 'weapon3': '1.254', 'DAMAGECOUNT': '2.532', 'FRAGCOUNT': '5.000'} [2023-02-24 18:39:08,178][177153] Updated weights for policy 0, policy_version 15610 (0.0008) [2023-02-24 18:39:09,006][177154] DAMAGECOUNT value on done: 158630.0 [2023-02-24 18:39:09,007][177154] Sum rewards: 7.125, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.204', 'AMMO5': '0.015', 'AMMO2': '0.043', 'WEAPON1': '0.060', 'AMMO3': '0.061', 'AMMO4': '0.215', 'weapon5': '0.232', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'ARMOR': '0.463', 'WEAPON3': '0.500', 'HITCOUNT': '0.660', 'weapon4': '0.970', 'weapon3': '1.040', 'weapon2': '1.332', 'DAMAGECOUNT': '2.838', 'FRAGCOUNT': '6.000'} [2023-02-24 18:39:09,309][177154] DAMAGECOUNT value on done: 162045.0 [2023-02-24 18:39:09,310][177154] Sum rewards: 0.517, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.364', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'weapon5': '0.122', 'AMMO3': '0.123', 'AMMO4': '0.154', 'WEAPON5': '0.200', 'weapon2': '0.384', 'WEAPON4': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '0.760', 'ARMOR': '0.857', 'weapon3': '1.354', 'weapon4': '1.408', 'DAMAGECOUNT': '2.310', 'FRAGCOUNT': '3.500'} [2023-02-24 18:39:09,562][177172] DAMAGECOUNT value on done: 156896.0 [2023-02-24 18:39:09,563][177172] Sum rewards: 10.367, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.300', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO5': '0.024', 'WEAPON1': '0.070', 'AMMO3': '0.130', 'weapon5': '0.260', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'HITCOUNT': '1.040', 'weapon3': '1.610', 'weapon2': '1.796', 'DAMAGECOUNT': '4.518', 'FRAGCOUNT': '10.000'} [2023-02-24 18:39:09,600][177154] DAMAGECOUNT value on done: 159114.0 [2023-02-24 18:39:09,601][177154] Sum rewards: 13.809, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.237', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO5': '0.027', 'AMMO3': '0.081', 'AMMO4': '0.105', 'WEAPON4': '0.250', 'weapon4': '0.290', 'weapon5': '0.302', 'ARMOR': '0.453', 'WEAPON5': '0.550', 'WEAPON3': '0.550', 'HITCOUNT': '0.890', 'weapon3': '1.462', 'weapon2': '1.728', 'DAMAGECOUNT': '4.566', 'FRAGCOUNT': '12.000'} [2023-02-24 18:39:09,859][177172] DAMAGECOUNT value on done: 158024.0 [2023-02-24 18:39:09,859][177172] Sum rewards: 16.266, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.522', 'AMMO5': '0.012', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.104', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'weapon5': '0.180', 'WEAPON5': '0.300', 'weapon4': '0.406', 'WEAPON3': '0.650', 'HITCOUNT': '1.100', 'weapon2': '1.218', 'weapon3': '1.816', 'DAMAGECOUNT': '4.926', 'FRAGCOUNT': '12.500'} [2023-02-24 18:39:09,899][177154] DAMAGECOUNT value on done: 162617.0 [2023-02-24 18:39:09,900][177154] Sum rewards: 10.992, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.005', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO2': '0.036', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'weapon5': '0.164', 'AMMO4': '0.180', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.634', 'HITCOUNT': '0.660', 'weapon3': '1.118', 'weapon2': '1.612', 'DAMAGECOUNT': '3.669', 'FRAGCOUNT': '8.000'} [2023-02-24 18:39:10,157][177157] DAMAGECOUNT value on done: 162619.0 [2023-02-24 18:39:10,158][177157] Sum rewards: 24.141, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.330', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.023', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.104', 'AMMO3': '0.111', 'weapon4': '0.324', 'weapon2': '0.380', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'HITCOUNT': '1.320', 'weapon3': '2.014', 'DAMAGECOUNT': '6.537', 'FRAGCOUNT': '19.000'} [2023-02-24 18:39:10,237][177157] DAMAGECOUNT value on done: 148183.0 [2023-02-24 18:39:10,238][177157] Sum rewards: 13.280, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.434', 'AMMO5': '0.019', 'AMMO2': '0.027', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.119', 'AMMO4': '0.133', 'weapon5': '0.202', 'weapon4': '0.308', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '0.910', 'weapon2': '1.268', 'weapon3': '1.886', 'DAMAGECOUNT': '3.852', 'FRAGCOUNT': '12.000'} [2023-02-24 18:39:10,471][177157] DAMAGECOUNT value on done: 152821.0 [2023-02-24 18:39:10,472][177157] Sum rewards: 8.035, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.970', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO3': '0.060', 'WEAPON1': '0.070', 'AMMO4': '0.131', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.488', 'WEAPON3': '0.500', 'HITCOUNT': '0.580', 'weapon3': '1.056', 'weapon2': '1.386', 'DAMAGECOUNT': '2.916', 'FRAGCOUNT': '6.500'} [2023-02-24 18:39:10,557][177157] DAMAGECOUNT value on done: 152646.0 [2023-02-24 18:39:10,557][177157] Sum rewards: 12.962, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.418', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.104', 'AMMO4': '0.126', 'weapon5': '0.142', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.780', 'weapon4': '0.780', 'weapon2': '0.904', 'weapon3': '1.744', 'DAMAGECOUNT': '3.588', 'FRAGCOUNT': '11.000'} [2023-02-24 18:39:10,591][177171] DAMAGECOUNT value on done: 152307.0 [2023-02-24 18:39:10,591][177171] Sum rewards: 7.145, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.950', 'ARMOR': '0.004', 'AMMO5': '0.007', 'weapon7': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'AMMO3': '0.086', 'weapon4': '0.086', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.214', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.750', 'weapon3': '1.252', 'weapon2': '2.092', 'DAMAGECOUNT': '2.796', 'FRAGCOUNT': '6.000'} [2023-02-24 18:39:10,882][177171] DAMAGECOUNT value on done: 153119.0 [2023-02-24 18:39:10,883][177171] Sum rewards: 12.987, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.255', 'AMMO2': '0.009', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.044', 'AMMO3': '0.119', 'weapon5': '0.134', 'WEAPON4': '0.200', 'weapon4': '0.290', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'HITCOUNT': '0.820', 'weapon2': '1.364', 'weapon3': '1.912', 'DAMAGECOUNT': '3.648', 'FRAGCOUNT': '12.000'} [2023-02-24 18:39:10,892][177171] DAMAGECOUNT value on done: 158009.0 [2023-02-24 18:39:10,893][177171] Sum rewards: 6.021, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.096', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.045', 'AMMO3': '0.086', 'WEAPON5': '0.150', 'weapon5': '0.164', 'AMMO4': '0.224', 'ARMOR': '0.455', 'weapon4': '0.470', 'WEAPON4': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.970', 'weapon2': '1.332', 'weapon3': '1.678', 'DAMAGECOUNT': '3.465', 'FRAGCOUNT': '6.000'} [2023-02-24 18:39:11,126][177153] Updated weights for policy 0, policy_version 15620 (0.0009) [2023-02-24 18:39:11,189][177171] DAMAGECOUNT value on done: 153629.0 [2023-02-24 18:39:11,190][177171] Sum rewards: 11.267, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.441', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.095', 'AMMO3': '0.096', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'weapon4': '0.742', 'HITCOUNT': '0.890', 'weapon3': '1.258', 'weapon2': '1.346', 'DAMAGECOUNT': '3.540', 'FRAGCOUNT': '10.000'} [2023-02-24 18:39:11,376][177119] Fps is (10 sec: 13926.1, 60 sec: 13926.3, 300 sec: 13912.5). Total num frames: 63979520. Throughput: 0: 3472.9. Samples: 15992986. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:39:11,377][177119] Avg episode reward: [(0, '11.328')] [2023-02-24 18:39:12,026][177155] DAMAGECOUNT value on done: 156464.0 [2023-02-24 18:39:12,026][177155] Sum rewards: 8.620, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.930', 'AMMO5': '0.024', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'AMMO3': '0.106', 'AMMO4': '0.126', 'weapon5': '0.186', 'WEAPON4': '0.400', 'weapon2': '0.484', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'HITCOUNT': '0.860', 'ARMOR': '0.907', 'weapon4': '1.014', 'weapon3': '1.892', 'DAMAGECOUNT': '3.696', 'FRAGCOUNT': '10.000'} [2023-02-24 18:39:12,328][177155] DAMAGECOUNT value on done: 160663.0 [2023-02-24 18:39:12,329][177155] Sum rewards: 10.995, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.218', 'AMMO5': '0.023', 'AMMO2': '0.034', 'weapon5': '0.056', 'AMMO3': '0.139', 'AMMO4': '0.169', 'ARMOR': '0.454', 'weapon4': '0.494', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.544', 'WEAPON3': '1.000', 'HITCOUNT': '1.480', 'weapon3': '2.592', 'DAMAGECOUNT': '5.229', 'FRAGCOUNT': '12.000'} [2023-02-24 18:39:12,643][177155] DAMAGECOUNT value on done: 162341.0 [2023-02-24 18:39:12,644][177155] Sum rewards: 9.714, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.458', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon5': '0.132', 'weapon4': '0.308', 'WEAPON5': '0.400', 'ARMOR': '0.469', 'WEAPON3': '0.700', 'HITCOUNT': '0.800', 'weapon2': '1.076', 'weapon3': '1.774', 'DAMAGECOUNT': '2.982', 'FRAGCOUNT': '8.000'} [2023-02-24 18:39:12,948][177155] DAMAGECOUNT value on done: 152612.0 [2023-02-24 18:39:12,949][177155] Sum rewards: 18.560, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.254', 'AMMO5': '0.017', 'AMMO2': '0.029', 'WEAPON1': '0.050', 'weapon5': '0.134', 'AMMO3': '0.139', 'AMMO4': '0.142', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.454', 'weapon4': '0.488', 'weapon2': '0.510', 'WEAPON3': '1.000', 'HITCOUNT': '1.510', 'weapon3': '2.532', 'DAMAGECOUNT': '5.709', 'FRAGCOUNT': '17.000'} [2023-02-24 18:39:14,063][177153] Updated weights for policy 0, policy_version 15630 (0.0008) [2023-02-24 18:39:16,376][177119] Fps is (10 sec: 13926.0, 60 sec: 13858.1, 300 sec: 13912.5). Total num frames: 64049152. Throughput: 0: 3473.7. Samples: 16013910. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:39:16,377][177119] Avg episode reward: [(0, '11.237')] [2023-02-24 18:39:17,021][177153] Updated weights for policy 0, policy_version 15640 (0.0008) [2023-02-24 18:39:19,121][177156] DAMAGECOUNT value on done: 158299.0 [2023-02-24 18:39:19,121][177156] Sum rewards: 10.205, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.108', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.043', 'AMMO3': '0.119', 'weapon5': '0.188', 'AMMO4': '0.213', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.444', 'WEAPON3': '0.700', 'ARMOR': '0.858', 'HITCOUNT': '1.020', 'weapon4': '1.516', 'weapon3': '1.552', 'DAMAGECOUNT': '4.335', 'FRAGCOUNT': '8.500'} [2023-02-24 18:39:19,204][177156] DAMAGECOUNT value on done: 152482.0 [2023-02-24 18:39:19,204][177156] Sum rewards: 12.950, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.481', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'AMMO3': '0.108', 'AMMO4': '0.160', 'weapon5': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.412', 'weapon4': '0.448', 'WEAPON3': '0.750', 'HITCOUNT': '0.940', 'weapon3': '1.466', 'weapon2': '1.522', 'DAMAGECOUNT': '4.425', 'FRAGCOUNT': '11.000'} [2023-02-24 18:39:19,432][177156] DAMAGECOUNT value on done: 154780.0 [2023-02-24 18:39:19,433][177156] Sum rewards: 6.747, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.036', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON1': '0.060', 'AMMO4': '0.085', 'AMMO3': '0.086', 'WEAPON4': '0.150', 'weapon5': '0.196', 'weapon4': '0.268', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'weapon2': '1.294', 'weapon3': '1.764', 'DAMAGECOUNT': '2.268', 'FRAGCOUNT': '4.000'} [2023-02-24 18:39:19,512][177156] DAMAGECOUNT value on done: 155652.0 [2023-02-24 18:39:19,513][177156] Sum rewards: 14.284, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.680', 'AMMO2': '0.004', 'AMMO5': '0.015', 'AMMO4': '0.019', 'WEAPON1': '0.060', 'AMMO3': '0.116', 'weapon5': '0.292', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'HITCOUNT': '0.960', 'weapon2': '1.542', 'weapon3': '1.768', 'DAMAGECOUNT': '3.738', 'FRAGCOUNT': '12.000'} [2023-02-24 18:39:19,979][177153] Updated weights for policy 0, policy_version 15650 (0.0008) [2023-02-24 18:39:21,376][177119] Fps is (10 sec: 13926.8, 60 sec: 13858.1, 300 sec: 13912.5). Total num frames: 64118784. Throughput: 0: 3472.2. Samples: 16024234. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:39:21,376][177119] Avg episode reward: [(0, '11.253')] [2023-02-24 18:39:22,807][177170] DAMAGECOUNT value on done: 154304.0 [2023-02-24 18:39:22,808][177170] Sum rewards: 13.937, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.242', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'AMMO3': '0.095', 'AMMO4': '0.158', 'weapon5': '0.288', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.456', 'WEAPON3': '0.550', 'weapon4': '0.800', 'weapon2': '0.812', 'HITCOUNT': '0.910', 'weapon3': '1.782', 'DAMAGECOUNT': '4.101', 'FRAGCOUNT': '12.500'} [2023-02-24 18:39:22,910][177153] Updated weights for policy 0, policy_version 15660 (0.0008) [2023-02-24 18:39:23,102][177170] DAMAGECOUNT value on done: 150755.0 [2023-02-24 18:39:23,103][177170] Sum rewards: 9.234, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.962', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.040', 'AMMO4': '0.049', 'AMMO3': '0.087', 'WEAPON4': '0.150', 'weapon5': '0.176', 'WEAPON5': '0.250', 'weapon4': '0.556', 'WEAPON3': '0.650', 'HITCOUNT': '0.850', 'weapon2': '1.232', 'weapon3': '1.628', 'DAMAGECOUNT': '3.261', 'FRAGCOUNT': '8.000'} [2023-02-24 18:39:23,111][177170] DAMAGECOUNT value on done: 165070.0 [2023-02-24 18:39:23,112][177170] Sum rewards: 20.134, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.293', 'AMMO5': '0.007', 'weapon7': '0.008', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.040', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.101', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.476', 'WEAPON3': '0.550', 'weapon2': '1.212', 'HITCOUNT': '1.290', 'weapon3': '1.880', 'DAMAGECOUNT': '5.376', 'FRAGCOUNT': '15.500'} [2023-02-24 18:39:23,412][177170] DAMAGECOUNT value on done: 153327.0 [2023-02-24 18:39:23,413][177170] Sum rewards: 6.034, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.033', 'AMMO5': '0.007', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'AMMO3': '0.055', 'AMMO4': '0.113', 'weapon5': '0.148', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.400', 'ARMOR': '0.484', 'weapon4': '0.840', 'weapon3': '1.102', 'DAMAGECOUNT': '1.662', 'weapon2': '1.702', 'FRAGCOUNT': '4.000'} [2023-02-24 18:39:24,431][177158] DAMAGECOUNT value on done: 150587.0 [2023-02-24 18:39:24,431][177158] Sum rewards: 4.087, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.354', 'AMMO5': '0.020', 'AMMO2': '0.039', 'WEAPON1': '0.080', 'AMMO3': '0.160', 'AMMO4': '0.195', 'WEAPON4': '0.200', 'weapon5': '0.214', 'weapon4': '0.442', 'ARMOR': '0.449', 'WEAPON5': '0.500', 'weapon2': '0.644', 'HITCOUNT': '0.720', 'WEAPON3': '1.000', 'weapon3': '2.124', 'DAMAGECOUNT': '2.154', 'FRAGCOUNT': '7.000'} [2023-02-24 18:39:24,735][177158] DAMAGECOUNT value on done: 153678.0 [2023-02-24 18:39:24,735][177158] Sum rewards: 10.625, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.848', 'AMMO5': '0.013', 'WEAPON1': '0.030', 'AMMO2': '0.038', 'AMMO3': '0.116', 'weapon5': '0.142', 'AMMO4': '0.191', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.460', 'WEAPON3': '0.800', 'ARMOR': '0.869', 'HITCOUNT': '0.930', 'weapon2': '1.104', 'weapon3': '1.890', 'DAMAGECOUNT': '3.489', 'FRAGCOUNT': '13.000'} [2023-02-24 18:39:25,346][177158] DAMAGECOUNT value on done: 159074.0 [2023-02-24 18:39:25,347][177158] Sum rewards: 5.661, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.450', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.064', 'weapon7': '0.074', 'AMMO4': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.188', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'WEAPON5': '0.500', 'HITCOUNT': '0.580', 'weapon4': '0.836', 'weapon3': '0.974', 'weapon2': '1.208', 'DAMAGECOUNT': '2.382', 'FRAGCOUNT': '5.000'} [2023-02-24 18:39:25,645][177158] DAMAGECOUNT value on done: 158085.0 [2023-02-24 18:39:25,646][177158] Sum rewards: 11.440, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.810', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.045', 'weapon7': '0.052', 'AMMO3': '0.097', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.632', 'WEAPON3': '0.650', 'HITCOUNT': '0.840', 'weapon4': '0.976', 'weapon3': '1.602', 'DAMAGECOUNT': '4.599', 'FRAGCOUNT': '10.000'} [2023-02-24 18:39:25,853][177153] Updated weights for policy 0, policy_version 15670 (0.0008) [2023-02-24 18:39:26,376][177119] Fps is (10 sec: 13926.8, 60 sec: 13858.1, 300 sec: 13912.5). Total num frames: 64188416. Throughput: 0: 3471.0. Samples: 16045074. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:39:26,376][177119] Avg episode reward: [(0, '11.052')] [2023-02-24 18:39:27,200][177172] DAMAGECOUNT value on done: 156099.0 [2023-02-24 18:39:27,201][177172] Sum rewards: 7.053, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.033', 'HEALTH': '0.051', 'AMMO3': '0.105', 'AMMO4': '0.167', 'weapon5': '0.180', 'weapon4': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON3': '0.600', 'HITCOUNT': '0.850', 'weapon2': '1.294', 'weapon3': '1.988', 'DAMAGECOUNT': '3.183', 'FRAGCOUNT': '5.500'} [2023-02-24 18:39:27,503][177172] DAMAGECOUNT value on done: 155986.0 [2023-02-24 18:39:27,504][177172] Sum rewards: 7.413, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.266', 'AMMO2': '0.008', 'AMMO5': '0.020', 'AMMO4': '0.040', 'weapon5': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'weapon4': '0.354', 'WEAPON5': '0.450', 'ARMOR': '0.460', 'HITCOUNT': '0.770', 'WEAPON3': '0.850', 'weapon2': '1.048', 'weapon3': '2.182', 'DAMAGECOUNT': '3.474', 'FRAGCOUNT': '7.000'} [2023-02-24 18:39:28,011][177172] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 18:39:28,310][177154] DAMAGECOUNT value on done: 159076.0 [2023-02-24 18:39:28,310][177154] Sum rewards: 3.051, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.372', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.025', 'WEAPON1': '0.030', 'weapon7': '0.066', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.134', 'WEAPON7': '0.200', 'weapon4': '0.448', 'WEAPON5': '0.450', 'HITCOUNT': '0.450', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.338', 'weapon2': '1.360', 'weapon3': '1.654', 'FRAGCOUNT': '4.000'} [2023-02-24 18:39:28,608][177154] DAMAGECOUNT value on done: 163501.0 [2023-02-24 18:39:28,608][177154] Sum rewards: 12.272, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.096', 'AMMO5': '0.022', 'AMMO2': '0.039', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.117', 'AMMO4': '0.197', 'weapon5': '0.264', 'weapon4': '0.272', 'WEAPON5': '0.600', 'HITCOUNT': '0.740', 'WEAPON3': '0.800', 'weapon2': '1.448', 'weapon3': '1.650', 'DAMAGECOUNT': '4.368', 'FRAGCOUNT': '11.000'} [2023-02-24 18:39:28,781][177153] Updated weights for policy 0, policy_version 15680 (0.0008) [2023-02-24 18:39:28,915][177154] DAMAGECOUNT value on done: 160539.0 [2023-02-24 18:39:28,915][177154] Sum rewards: 11.415, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.986', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.028', 'weapon5': '0.130', 'AMMO4': '0.142', 'AMMO3': '0.158', 'weapon4': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'ARMOR': '0.457', 'WEAPON3': '1.000', 'HITCOUNT': '1.020', 'weapon2': '1.298', 'weapon3': '1.932', 'DAMAGECOUNT': '4.275', 'FRAGCOUNT': '13.000'} [2023-02-24 18:39:28,992][177172] DAMAGECOUNT value on done: 158204.0 [2023-02-24 18:39:28,993][177172] Sum rewards: 8.425, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.890', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.026', 'AMMO5': '0.029', 'AMMO3': '0.147', 'weapon5': '0.188', 'WEAPON4': '0.200', 'ARMOR': '0.452', 'weapon4': '0.486', 'WEAPON5': '0.700', 'weapon2': '0.924', 'HITCOUNT': '1.080', 'WEAPON3': '1.100', 'weapon3': '2.034', 'DAMAGECOUNT': '3.924', 'FRAGCOUNT': '9.000'} [2023-02-24 18:39:29,219][177154] DAMAGECOUNT value on done: 163783.0 [2023-02-24 18:39:29,220][177154] Sum rewards: 10.791, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.100', 'AMMO2': '0.011', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'weapon7': '0.052', 'AMMO4': '0.054', 'weapon5': '0.062', 'AMMO3': '0.109', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'ARMOR': '0.483', 'weapon4': '0.638', 'HITCOUNT': '0.730', 'WEAPON3': '0.800', 'weapon2': '1.364', 'weapon3': '1.560', 'DAMAGECOUNT': '3.498', 'FRAGCOUNT': '10.000'} [2023-02-24 18:39:29,292][177172] DAMAGECOUNT value on done: 159092.0 [2023-02-24 18:39:29,293][177172] Sum rewards: 7.257, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.632', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'weapon5': '0.030', 'AMMO4': '0.091', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.450', 'weapon4': '0.450', 'HITCOUNT': '0.820', 'WEAPON3': '0.900', 'weapon2': '1.000', 'weapon3': '2.110', 'DAMAGECOUNT': '3.204', 'FRAGCOUNT': '8.500'} [2023-02-24 18:39:29,519][177157] DAMAGECOUNT value on done: 163598.0 [2023-02-24 18:39:29,519][177157] Sum rewards: 8.348, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.013', 'AMMO2': '0.033', 'AMMO3': '0.079', 'weapon5': '0.090', 'AMMO4': '0.162', 'HEALTH': '0.250', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.564', 'HITCOUNT': '0.800', 'weapon2': '1.390', 'weapon3': '1.630', 'DAMAGECOUNT': '2.937', 'FRAGCOUNT': '6.500'} [2023-02-24 18:39:29,581][177157] DAMAGECOUNT value on done: 149576.0 [2023-02-24 18:39:29,581][177157] Sum rewards: 10.589, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.336', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.101', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.160', 'weapon4': '0.324', 'WEAPON3': '0.600', 'HITCOUNT': '1.070', 'weapon2': '1.632', 'weapon3': '1.634', 'DAMAGECOUNT': '4.179', 'FRAGCOUNT': '7.500'} [2023-02-24 18:39:29,823][177157] DAMAGECOUNT value on done: 153270.0 [2023-02-24 18:39:29,824][177157] Sum rewards: 1.258, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.546', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.058', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.169', 'HITCOUNT': '0.220', 'weapon5': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'weapon2': '0.576', 'weapon3': '0.694', 'ARMOR': '0.800', 'weapon4': '1.082', 'DAMAGECOUNT': '1.347', 'FRAGCOUNT': '2.000'} [2023-02-24 18:39:29,882][177157] DAMAGECOUNT value on done: 154204.0 [2023-02-24 18:39:29,882][177157] Sum rewards: 16.515, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.688', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon5': '0.036', 'WEAPON1': '0.040', 'AMMO4': '0.068', 'AMMO3': '0.165', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'weapon2': '0.774', 'weapon4': '0.896', 'WEAPON3': '1.150', 'HITCOUNT': '1.220', 'weapon3': '2.004', 'DAMAGECOUNT': '4.674', 'FRAGCOUNT': '17.000'} [2023-02-24 18:39:29,891][177171] DAMAGECOUNT value on done: 153125.0 [2023-02-24 18:39:29,892][177171] Sum rewards: 8.415, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.940', 'AMMO5': '0.003', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.048', 'weapon5': '0.054', 'WEAPON5': '0.100', 'weapon7': '0.146', 'AMMO4': '0.148', 'WEAPON3': '0.300', 'WEAPON4': '0.350', 'AMMO6': '0.420', 'AMMO7': '0.420', 'HITCOUNT': '0.470', 'WEAPON7': '0.500', 'weapon4': '0.642', 'weapon3': '0.698', 'weapon2': '1.798', 'DAMAGECOUNT': '2.454', 'FRAGCOUNT': '6.000'} [2023-02-24 18:39:30,193][177171] DAMAGECOUNT value on done: 154069.0 [2023-02-24 18:39:30,193][177171] Sum rewards: 9.104, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.481', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO3': '0.067', 'weapon7': '0.098', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.146', 'WEAPON7': '0.200', 'weapon4': '0.208', 'WEAPON5': '0.300', 'HITCOUNT': '0.590', 'WEAPON3': '0.600', 'weapon2': '1.424', 'weapon3': '1.482', 'DAMAGECOUNT': '2.850', 'FRAGCOUNT': '6.000'} [2023-02-24 18:39:30,202][177171] DAMAGECOUNT value on done: 158601.0 [2023-02-24 18:39:30,203][177171] Sum rewards: 4.100, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.962', 'AMMO5': '0.010', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'AMMO3': '0.066', 'AMMO4': '0.105', 'weapon4': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.284', 'WEAPON3': '0.450', 'HITCOUNT': '0.470', 'weapon3': '1.228', 'DAMAGECOUNT': '1.776', 'weapon2': '2.040', 'FRAGCOUNT': '4.000'} [2023-02-24 18:39:30,502][177171] DAMAGECOUNT value on done: 154870.0 [2023-02-24 18:39:30,503][177171] Sum rewards: 9.890, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.511', 'AMMO2': '0.009', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.046', 'AMMO3': '0.109', 'WEAPON4': '0.200', 'weapon5': '0.288', 'WEAPON5': '0.450', 'ARMOR': '0.452', 'weapon2': '0.716', 'WEAPON3': '0.800', 'weapon4': '0.856', 'HITCOUNT': '0.960', 'weapon3': '1.746', 'DAMAGECOUNT': '3.723', 'FRAGCOUNT': '10.000'} [2023-02-24 18:39:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13912.5). Total num frames: 64258048. Throughput: 0: 3471.5. Samples: 16065854. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:39:31,376][177119] Avg episode reward: [(0, '10.571')] [2023-02-24 18:39:31,509][177155] DAMAGECOUNT value on done: 158085.0 [2023-02-24 18:39:31,510][177155] Sum rewards: 18.328, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.626', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.045', 'AMMO3': '0.126', 'weapon5': '0.132', 'WEAPON5': '0.200', 'AMMO4': '0.223', 'WEAPON4': '0.350', 'ARMOR': '0.512', 'weapon2': '0.674', 'WEAPON3': '0.800', 'weapon4': '1.024', 'HITCOUNT': '1.140', 'weapon3': '1.840', 'DAMAGECOUNT': '4.863', 'FRAGCOUNT': '17.000'} [2023-02-24 18:39:31,753][177153] Updated weights for policy 0, policy_version 15690 (0.0008) [2023-02-24 18:39:31,811][177155] DAMAGECOUNT value on done: 162557.0 [2023-02-24 18:39:31,812][177155] Sum rewards: 16.895, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.350', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO5': '0.026', 'AMMO4': '0.035', 'weapon5': '0.090', 'AMMO3': '0.209', 'WEAPON5': '0.550', 'weapon2': '0.622', 'WEAPON3': '1.250', 'HITCOUNT': '1.380', 'weapon3': '2.874', 'DAMAGECOUNT': '5.682', 'FRAGCOUNT': '19.000'} [2023-02-24 18:39:32,121][177155] DAMAGECOUNT value on done: 163422.0 [2023-02-24 18:39:32,122][177155] Sum rewards: 12.261, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.751', 'AMMO2': '0.010', 'AMMO5': '0.019', 'AMMO4': '0.051', 'weapon7': '0.062', 'AMMO3': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.780', 'weapon4': '0.960', 'weapon2': '0.978', 'weapon3': '1.350', 'DAMAGECOUNT': '3.243', 'FRAGCOUNT': '9.000'} [2023-02-24 18:39:32,422][177155] DAMAGECOUNT value on done: 154098.0 [2023-02-24 18:39:32,422][177155] Sum rewards: 12.850, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.840', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'weapon7': '0.066', 'AMMO3': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.169', 'WEAPON7': '0.200', 'weapon5': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.448', 'ARMOR': '0.481', 'WEAPON3': '0.800', 'weapon2': '0.844', 'HITCOUNT': '0.990', 'weapon3': '2.032', 'DAMAGECOUNT': '4.458', 'FRAGCOUNT': '12.500'} [2023-02-24 18:39:34,709][177153] Updated weights for policy 0, policy_version 15700 (0.0009) [2023-02-24 18:39:36,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13912.5). Total num frames: 64327680. Throughput: 0: 3473.3. Samples: 16076360. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:39:36,376][177119] Avg episode reward: [(0, '10.611')] [2023-02-24 18:39:37,663][177153] Updated weights for policy 0, policy_version 15710 (0.0008) [2023-02-24 18:39:38,404][177156] DAMAGECOUNT value on done: 159403.0 [2023-02-24 18:39:38,404][177156] Sum rewards: 6.911, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.790', 'AMMO2': '0.014', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.067', 'weapon7': '0.108', 'AMMO3': '0.110', 'weapon5': '0.144', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'HITCOUNT': '0.830', 'weapon4': '0.848', 'weapon3': '1.112', 'weapon2': '1.476', 'DAMAGECOUNT': '3.312', 'FRAGCOUNT': '9.000'} [2023-02-24 18:39:38,484][177156] DAMAGECOUNT value on done: 152949.0 [2023-02-24 18:39:38,485][177156] Sum rewards: 5.721, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.145', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO3': '0.030', 'AMMO4': '0.043', 'weapon7': '0.064', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.360', 'weapon3': '0.650', 'weapon4': '0.698', 'weapon2': '0.776', 'DAMAGECOUNT': '1.401', 'FRAGCOUNT': '3.000'} [2023-02-24 18:39:38,713][177156] DAMAGECOUNT value on done: 156365.0 [2023-02-24 18:39:38,714][177156] Sum rewards: 13.533, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.562', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon7': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'weapon5': '0.160', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.646', 'WEAPON3': '0.800', 'weapon2': '0.906', 'HITCOUNT': '1.030', 'weapon3': '1.860', 'DAMAGECOUNT': '4.755', 'FRAGCOUNT': '11.000'} [2023-02-24 18:39:38,800][177156] DAMAGECOUNT value on done: 157002.0 [2023-02-24 18:39:38,800][177156] Sum rewards: 13.388, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.890', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO3': '0.065', 'AMMO4': '0.068', 'weapon7': '0.122', 'weapon5': '0.178', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'WEAPON7': '0.400', 'WEAPON3': '0.400', 'ARMOR': '0.457', 'HITCOUNT': '0.460', 'weapon4': '0.862', 'weapon3': '0.900', 'weapon2': '1.002', 'DAMAGECOUNT': '2.850', 'FRAGCOUNT': '10.000'} [2023-02-24 18:39:40,612][177153] Updated weights for policy 0, policy_version 15720 (0.0008) [2023-02-24 18:39:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13912.5). Total num frames: 64397312. Throughput: 0: 3471.6. Samples: 16097164. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:39:41,376][177119] Avg episode reward: [(0, '10.519')] [2023-02-24 18:39:42,133][177170] DAMAGECOUNT value on done: 156076.0 [2023-02-24 18:39:42,134][177170] Sum rewards: 16.626, reward structure: {'DEATHCOUNT': '-7.500', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.015', 'weapon7': '0.052', 'weapon5': '0.054', 'AMMO4': '0.057', 'AMMO3': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'HEALTH': '0.531', 'WEAPON3': '0.600', 'weapon4': '0.606', 'weapon2': '0.700', 'HITCOUNT': '1.190', 'weapon3': '1.992', 'DAMAGECOUNT': '5.316', 'FRAGCOUNT': '12.000'} [2023-02-24 18:39:42,434][177170] DAMAGECOUNT value on done: 151971.0 [2023-02-24 18:39:42,434][177170] Sum rewards: 16.854, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.159', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.031', 'weapon7': '0.048', 'AMMO3': '0.061', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.128', 'AMMO4': '0.156', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'ARMOR': '0.468', 'weapon2': '0.808', 'HITCOUNT': '1.000', 'weapon4': '1.174', 'weapon3': '1.400', 'DAMAGECOUNT': '3.648', 'FRAGCOUNT': '12.000'} [2023-02-24 18:39:42,443][177170] DAMAGECOUNT value on done: 166206.0 [2023-02-24 18:39:42,444][177170] Sum rewards: 8.760, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.236', 'AMMO5': '0.014', 'AMMO2': '0.015', 'ARMOR': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.059', 'AMMO4': '0.073', 'weapon5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.540', 'weapon4': '0.702', 'weapon3': '0.798', 'weapon2': '0.932', 'DAMAGECOUNT': '3.408', 'FRAGCOUNT': '8.000'} [2023-02-24 18:39:42,742][177170] DAMAGECOUNT value on done: 154563.0 [2023-02-24 18:39:42,742][177170] Sum rewards: 6.833, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.812', 'AMMO5': '0.025', 'AMMO2': '0.032', 'WEAPON1': '0.040', 'AMMO4': '0.162', 'AMMO3': '0.194', 'weapon5': '0.266', 'WEAPON4': '0.350', 'ARMOR': '0.459', 'WEAPON5': '0.650', 'weapon4': '0.662', 'HITCOUNT': '0.740', 'weapon2': '0.762', 'WEAPON3': '1.250', 'weapon3': '1.844', 'DAMAGECOUNT': '3.708', 'FRAGCOUNT': '12.000'} [2023-02-24 18:39:43,604][177153] Updated weights for policy 0, policy_version 15730 (0.0008) [2023-02-24 18:39:43,791][177158] DAMAGECOUNT value on done: 151770.0 [2023-02-24 18:39:43,791][177158] Sum rewards: 11.664, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.861', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO5': '0.025', 'AMMO4': '0.029', 'WEAPON4': '0.100', 'weapon4': '0.112', 'AMMO3': '0.118', 'weapon5': '0.186', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'HITCOUNT': '1.000', 'weapon2': '1.632', 'weapon3': '1.858', 'DAMAGECOUNT': '3.549', 'FRAGCOUNT': '10.000'} [2023-02-24 18:39:44,091][177158] DAMAGECOUNT value on done: 154947.0 [2023-02-24 18:39:44,091][177158] Sum rewards: 15.915, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.230', 'AMMO2': '0.011', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.052', 'weapon7': '0.076', 'AMMO3': '0.087', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.184', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.453', 'WEAPON3': '0.650', 'weapon2': '0.650', 'HITCOUNT': '0.930', 'weapon4': '0.938', 'weapon3': '1.722', 'DAMAGECOUNT': '3.807', 'FRAGCOUNT': '14.000'} [2023-02-24 18:39:44,772][177158] DAMAGECOUNT value on done: 160596.0 [2023-02-24 18:39:44,773][177158] Sum rewards: 8.105, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.378', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO5': '0.037', 'weapon7': '0.074', 'AMMO4': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.139', 'WEAPON7': '0.200', 'weapon5': '0.246', 'weapon2': '0.386', 'WEAPON4': '0.450', 'ARMOR': '0.457', 'WEAPON5': '0.750', 'WEAPON3': '0.850', 'HITCOUNT': '0.920', 'weapon4': '0.982', 'weapon3': '1.790', 'DAMAGECOUNT': '4.566', 'FRAGCOUNT': '8.500'} [2023-02-24 18:39:45,073][177158] DAMAGECOUNT value on done: 159420.0 [2023-02-24 18:39:45,073][177158] Sum rewards: 14.003, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.436', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON1': '0.040', 'weapon7': '0.046', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'weapon5': '0.138', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'weapon4': '0.310', 'WEAPON3': '0.650', 'HITCOUNT': '0.900', 'weapon3': '1.220', 'weapon2': '1.544', 'DAMAGECOUNT': '4.005', 'FRAGCOUNT': '12.000'} [2023-02-24 18:39:46,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.2, 300 sec: 13912.5). Total num frames: 64466944. Throughput: 0: 3469.1. Samples: 16117862. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:39:46,376][177119] Avg episode reward: [(0, '10.757')] [2023-02-24 18:39:46,562][177172] DAMAGECOUNT value on done: 157568.0 [2023-02-24 18:39:46,562][177172] Sum rewards: 16.691, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.493', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'weapon5': '0.114', 'WEAPON5': '0.200', 'weapon4': '0.270', 'WEAPON3': '0.400', 'HITCOUNT': '1.100', 'weapon3': '1.206', 'weapon2': '2.226', 'DAMAGECOUNT': '4.152', 'FRAGCOUNT': '11.000'} [2023-02-24 18:39:46,576][177153] Updated weights for policy 0, policy_version 15740 (0.0008) [2023-02-24 18:39:46,864][177172] DAMAGECOUNT value on done: 158017.0 [2023-02-24 18:39:46,865][177172] Sum rewards: 22.680, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.982', 'AMMO2': '0.007', 'AMMO5': '0.013', 'WEAPON1': '0.030', 'AMMO4': '0.036', 'WEAPON4': '0.100', 'weapon4': '0.114', 'AMMO3': '0.142', 'weapon5': '0.208', 'WEAPON5': '0.350', 'WEAPON3': '0.950', 'weapon2': '1.220', 'HITCOUNT': '1.470', 'weapon3': '2.178', 'DAMAGECOUNT': '6.093', 'FRAGCOUNT': '19.000'} [2023-02-24 18:39:47,194][177172] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 18:39:47,752][177154] DAMAGECOUNT value on done: 161057.0 [2023-02-24 18:39:47,753][177154] Sum rewards: 18.958, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.690', 'AMMO5': '0.014', 'AMMO2': '0.022', 'AMMO3': '0.106', 'AMMO4': '0.108', 'weapon5': '0.130', 'WEAPON4': '0.250', 'weapon4': '0.382', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'weapon2': '1.042', 'HITCOUNT': '1.280', 'weapon3': '2.070', 'DAMAGECOUNT': '5.943', 'FRAGCOUNT': '17.500'} [2023-02-24 18:39:48,054][177154] DAMAGECOUNT value on done: 164363.0 [2023-02-24 18:39:48,054][177154] Sum rewards: 5.745, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.040', 'AMMO2': '0.018', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'AMMO3': '0.085', 'AMMO4': '0.090', 'weapon4': '0.114', 'WEAPON4': '0.150', 'weapon5': '0.222', 'ARMOR': '0.400', 'HITCOUNT': '0.470', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'weapon3': '1.436', 'weapon2': '1.854', 'DAMAGECOUNT': '2.586', 'FRAGCOUNT': '5.000'} [2023-02-24 18:39:48,335][177172] DAMAGECOUNT value on done: 160262.0 [2023-02-24 18:39:48,336][177172] Sum rewards: 19.808, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.390', 'AMMO2': '0.012', 'AMMO5': '0.020', 'WEAPON1': '0.050', 'AMMO4': '0.059', 'WEAPON4': '0.150', 'AMMO3': '0.157', 'weapon5': '0.176', 'weapon4': '0.282', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.722', 'WEAPON3': '1.000', 'HITCOUNT': '1.380', 'weapon3': '2.466', 'DAMAGECOUNT': '6.174', 'FRAGCOUNT': '19.000'} [2023-02-24 18:39:48,351][177154] DAMAGECOUNT value on done: 161890.0 [2023-02-24 18:39:48,352][177154] Sum rewards: 19.911, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.265', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'weapon7': '0.054', 'AMMO3': '0.076', 'weapon4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'ARMOR': '0.452', 'WEAPON3': '0.600', 'HITCOUNT': '0.900', 'weapon3': '1.472', 'weapon2': '1.986', 'DAMAGECOUNT': '4.053', 'FRAGCOUNT': '16.000'} [2023-02-24 18:39:48,633][177172] DAMAGECOUNT value on done: 160114.0 [2023-02-24 18:39:48,633][177172] Sum rewards: 12.857, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.013', 'AMMO5': '0.015', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.068', 'HEALTH': '0.105', 'weapon7': '0.212', 'weapon5': '0.276', 'WEAPON5': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'weapon4': '0.328', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.550', 'weapon3': '1.196', 'weapon2': '1.572', 'DAMAGECOUNT': '3.066', 'FRAGCOUNT': '8.000'} [2023-02-24 18:39:48,651][177154] DAMAGECOUNT value on done: 164822.0 [2023-02-24 18:39:48,651][177154] Sum rewards: 7.351, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.695', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon7': '0.054', 'AMMO3': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.163', 'weapon5': '0.190', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.450', 'HITCOUNT': '0.520', 'weapon2': '0.674', 'weapon4': '0.788', 'weapon3': '1.318', 'DAMAGECOUNT': '3.117', 'FRAGCOUNT': '7.000'} [2023-02-24 18:39:48,913][177157] DAMAGECOUNT value on done: 164749.0 [2023-02-24 18:39:48,914][177157] Sum rewards: 12.725, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.130', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'ARMOR': '0.039', 'AMMO4': '0.056', 'AMMO3': '0.079', 'weapon5': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.542', 'WEAPON3': '0.600', 'HITCOUNT': '0.760', 'weapon3': '1.328', 'weapon2': '1.336', 'DAMAGECOUNT': '3.453', 'FRAGCOUNT': '10.000'} [2023-02-24 18:39:48,934][177157] DAMAGECOUNT value on done: 150878.0 [2023-02-24 18:39:48,935][177157] Sum rewards: 9.595, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.808', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'AMMO3': '0.103', 'AMMO4': '0.106', 'weapon5': '0.108', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'ARMOR': '0.496', 'WEAPON3': '0.550', 'weapon4': '0.576', 'HITCOUNT': '0.760', 'weapon3': '1.396', 'weapon2': '1.466', 'DAMAGECOUNT': '3.906', 'FRAGCOUNT': '9.000'} [2023-02-24 18:39:49,220][177157] DAMAGECOUNT value on done: 154182.0 [2023-02-24 18:39:49,221][177157] Sum rewards: 9.748, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.508', 'AMMO5': '0.015', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'AMMO3': '0.080', 'AMMO4': '0.114', 'weapon5': '0.132', 'weapon7': '0.138', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'weapon2': '0.642', 'HITCOUNT': '0.660', 'weapon4': '0.882', 'weapon3': '1.354', 'DAMAGECOUNT': '2.736', 'FRAGCOUNT': '8.000'} [2023-02-24 18:39:49,241][177157] DAMAGECOUNT value on done: 155343.0 [2023-02-24 18:39:49,242][177157] Sum rewards: 8.206, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.688', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.022', 'weapon7': '0.072', 'AMMO3': '0.106', 'AMMO4': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.126', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.410', 'WEAPON3': '0.700', 'HITCOUNT': '0.920', 'weapon2': '1.416', 'weapon3': '1.678', 'DAMAGECOUNT': '3.417', 'FRAGCOUNT': '8.000'} [2023-02-24 18:39:49,250][177171] DAMAGECOUNT value on done: 154040.0 [2023-02-24 18:39:49,250][177171] Sum rewards: 4.590, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.464', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'AMMO2': '0.038', 'weapon7': '0.058', 'AMMO3': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.176', 'AMMO4': '0.187', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.536', 'WEAPON3': '0.600', 'HITCOUNT': '0.770', 'weapon2': '1.206', 'weapon3': '1.600', 'DAMAGECOUNT': '2.745', 'FRAGCOUNT': '3.000'} [2023-02-24 18:39:49,504][177153] Updated weights for policy 0, policy_version 15750 (0.0008) [2023-02-24 18:39:49,548][177171] DAMAGECOUNT value on done: 155954.0 [2023-02-24 18:39:49,549][177171] Sum rewards: 16.410, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.766', 'AMMO5': '0.012', 'AMMO2': '0.027', 'WEAPON1': '0.050', 'AMMO4': '0.134', 'weapon4': '0.140', 'AMMO3': '0.152', 'weapon5': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.756', 'WEAPON3': '1.050', 'HITCOUNT': '1.500', 'weapon3': '2.510', 'DAMAGECOUNT': '5.655', 'FRAGCOUNT': '16.000'} [2023-02-24 18:39:49,558][177171] DAMAGECOUNT value on done: 160159.0 [2023-02-24 18:39:49,558][177171] Sum rewards: 15.796, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.774', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.037', 'weapon7': '0.060', 'AMMO3': '0.081', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.150', 'AMMO4': '0.185', 'WEAPON5': '0.250', 'ARMOR': '0.464', 'WEAPON4': '0.500', 'weapon2': '0.536', 'WEAPON3': '0.600', 'HITCOUNT': '1.030', 'weapon4': '1.294', 'weapon3': '1.388', 'DAMAGECOUNT': '4.674', 'FRAGCOUNT': '15.000'} [2023-02-24 18:39:49,852][177171] DAMAGECOUNT value on done: 156105.0 [2023-02-24 18:39:49,853][177171] Sum rewards: 8.946, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.214', 'WEAPON1': '0.020', 'AMMO5': '0.026', 'AMMO2': '0.033', 'weapon7': '0.046', 'AMMO3': '0.085', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.166', 'WEAPON7': '0.200', 'weapon5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.680', 'HITCOUNT': '0.830', 'weapon2': '1.302', 'weapon3': '1.326', 'DAMAGECOUNT': '3.705', 'FRAGCOUNT': '9.000'} [2023-02-24 18:39:50,863][177155] DAMAGECOUNT value on done: 159510.0 [2023-02-24 18:39:50,864][177155] Sum rewards: 15.868, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.694', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO3': '0.085', 'AMMO4': '0.162', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.437', 'WEAPON3': '0.550', 'weapon4': '0.602', 'weapon2': '0.878', 'HITCOUNT': '0.910', 'weapon3': '1.706', 'DAMAGECOUNT': '4.275', 'FRAGCOUNT': '13.000'} [2023-02-24 18:39:51,163][177155] DAMAGECOUNT value on done: 164385.0 [2023-02-24 18:39:51,163][177155] Sum rewards: 16.372, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.902', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.163', 'weapon5': '0.182', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'ARMOR': '0.465', 'weapon4': '0.518', 'weapon2': '0.806', 'WEAPON3': '0.850', 'HITCOUNT': '1.350', 'weapon3': '2.104', 'DAMAGECOUNT': '5.484', 'FRAGCOUNT': '15.000'} [2023-02-24 18:39:51,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13912.5). Total num frames: 64536576. Throughput: 0: 3470.2. Samples: 16128290. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 18:39:51,376][177119] Avg episode reward: [(0, '11.134')] [2023-02-24 18:39:51,523][177155] DAMAGECOUNT value on done: 165430.0 [2023-02-24 18:39:51,523][177155] Sum rewards: 12.570, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.405', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.042', 'AMMO3': '0.105', 'weapon7': '0.158', 'weapon5': '0.194', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'AMMO4': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.481', 'weapon2': '0.648', 'WEAPON3': '0.650', 'weapon4': '0.684', 'HITCOUNT': '0.900', 'weapon3': '1.452', 'DAMAGECOUNT': '5.124', 'FRAGCOUNT': '10.000'} [2023-02-24 18:39:51,824][177155] DAMAGECOUNT value on done: 155691.0 [2023-02-24 18:39:51,825][177155] Sum rewards: 15.766, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.013', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'weapon7': '0.070', 'AMMO3': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.138', 'weapon5': '0.228', 'WEAPON4': '0.250', 'HEALTH': '0.344', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'weapon4': '0.788', 'weapon2': '0.796', 'HITCOUNT': '0.980', 'weapon3': '1.524', 'DAMAGECOUNT': '4.779', 'FRAGCOUNT': '13.000'} [2023-02-24 18:39:52,462][177153] Updated weights for policy 0, policy_version 15760 (0.0008) [2023-02-24 18:39:55,388][177153] Updated weights for policy 0, policy_version 15770 (0.0008) [2023-02-24 18:39:56,326][177154] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:39:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13912.5). Total num frames: 64606208. Throughput: 0: 3471.3. Samples: 16149194. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 18:39:56,376][177119] Avg episode reward: [(0, '11.192')] [2023-02-24 18:39:57,832][177156] DAMAGECOUNT value on done: 160867.0 [2023-02-24 18:39:57,833][177156] Sum rewards: 15.654, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.740', 'WEAPON1': '0.010', 'weapon7': '0.010', 'AMMO2': '0.018', 'AMMO5': '0.020', 'AMMO4': '0.091', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'weapon4': '0.176', 'weapon5': '0.184', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '1.040', 'weapon2': '1.150', 'weapon3': '2.158', 'DAMAGECOUNT': '4.392', 'FRAGCOUNT': '14.000'} [2023-02-24 18:39:57,917][177156] DAMAGECOUNT value on done: 153993.0 [2023-02-24 18:39:57,918][177156] Sum rewards: 10.319, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.600', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'weapon7': '0.070', 'AMMO3': '0.080', 'AMMO4': '0.099', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.160', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'weapon4': '0.408', 'WEAPON3': '0.550', 'HITCOUNT': '0.610', 'weapon2': '1.206', 'weapon3': '1.826', 'DAMAGECOUNT': '3.132', 'FRAGCOUNT': '9.000'} [2023-02-24 18:39:58,146][177156] DAMAGECOUNT value on done: 157834.0 [2023-02-24 18:39:58,147][177156] Sum rewards: 16.720, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.134', 'AMMO5': '0.012', 'AMMO2': '0.036', 'WEAPON1': '0.060', 'AMMO3': '0.083', 'weapon4': '0.138', 'WEAPON4': '0.150', 'AMMO4': '0.178', 'weapon5': '0.248', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '0.760', 'weapon2': '1.344', 'weapon3': '1.800', 'DAMAGECOUNT': '4.095', 'FRAGCOUNT': '13.000'} [2023-02-24 18:39:58,231][177156] DAMAGECOUNT value on done: 158496.0 [2023-02-24 18:39:58,231][177156] Sum rewards: 16.438, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.243', 'AMMO2': '0.003', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.014', 'AMMO3': '0.103', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.428', 'WEAPON3': '0.750', 'weapon2': '0.930', 'HITCOUNT': '1.000', 'weapon3': '2.248', 'DAMAGECOUNT': '4.482', 'FRAGCOUNT': '14.000'} [2023-02-24 18:39:58,322][177153] Updated weights for policy 0, policy_version 15780 (0.0008) [2023-02-24 18:40:01,255][177153] Updated weights for policy 0, policy_version 15790 (0.0008) [2023-02-24 18:40:01,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13912.5). Total num frames: 64675840. Throughput: 0: 3469.3. Samples: 16170026. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 18:40:01,376][177119] Avg episode reward: [(0, '11.285')] [2023-02-24 18:40:01,434][177170] DAMAGECOUNT value on done: 157558.0 [2023-02-24 18:40:01,435][177170] Sum rewards: 17.720, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.492', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'weapon5': '0.054', 'AMMO4': '0.083', 'weapon7': '0.084', 'AMMO3': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.290', 'WEAPON3': '0.700', 'HITCOUNT': '1.120', 'weapon2': '1.422', 'weapon3': '1.856', 'DAMAGECOUNT': '4.446', 'FRAGCOUNT': '14.000'} [2023-02-24 18:40:01,739][177170] DAMAGECOUNT value on done: 153286.0 [2023-02-24 18:40:01,740][177170] Sum rewards: 15.312, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.096', 'AMMO2': '0.006', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.031', 'weapon7': '0.058', 'weapon5': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.228', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'HITCOUNT': '0.890', 'weapon3': '1.686', 'weapon2': '1.712', 'DAMAGECOUNT': '3.945', 'FRAGCOUNT': '14.000'} [2023-02-24 18:40:01,750][177170] DAMAGECOUNT value on done: 167023.0 [2023-02-24 18:40:01,751][177170] Sum rewards: 10.495, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.550', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.045', 'AMMO3': '0.088', 'weapon5': '0.126', 'weapon7': '0.132', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'AMMO4': '0.226', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'weapon4': '0.504', 'WEAPON3': '0.600', 'HITCOUNT': '0.640', 'weapon3': '1.290', 'weapon2': '1.712', 'DAMAGECOUNT': '2.451', 'FRAGCOUNT': '8.000'} [2023-02-24 18:40:02,053][177170] DAMAGECOUNT value on done: 156006.0 [2023-02-24 18:40:02,053][177170] Sum rewards: 17.778, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.585', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.005', 'AMMO3': '0.050', 'weapon5': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.446', 'WEAPON3': '0.450', 'weapon4': '0.658', 'HITCOUNT': '1.130', 'weapon2': '1.254', 'weapon3': '1.270', 'DAMAGECOUNT': '4.329', 'FRAGCOUNT': '12.000'} [2023-02-24 18:40:03,138][177158] DAMAGECOUNT value on done: 152961.0 [2023-02-24 18:40:03,138][177158] Sum rewards: 12.076, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.604', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'ARMOR': '0.040', 'AMMO2': '0.042', 'AMMO3': '0.090', 'weapon7': '0.100', 'weapon5': '0.172', 'AMMO4': '0.209', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'weapon2': '0.402', 'WEAPON4': '0.450', 'WEAPON3': '0.500', 'HITCOUNT': '0.820', 'weapon3': '1.220', 'weapon4': '1.250', 'DAMAGECOUNT': '3.573', 'FRAGCOUNT': '11.000'} [2023-02-24 18:40:03,438][177158] DAMAGECOUNT value on done: 156072.0 [2023-02-24 18:40:03,438][177158] Sum rewards: 12.603, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'weapon5': '0.168', 'weapon4': '0.342', 'WEAPON3': '0.450', 'HEALTH': '0.672', 'HITCOUNT': '0.790', 'weapon3': '1.492', 'weapon2': '1.568', 'DAMAGECOUNT': '3.375', 'FRAGCOUNT': '10.000'} [2023-02-24 18:40:04,144][177158] DAMAGECOUNT value on done: 161288.0 [2023-02-24 18:40:04,144][177158] Sum rewards: 8.545, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.560', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.064', 'AMMO3': '0.065', 'weapon7': '0.066', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.372', 'WEAPON3': '0.450', 'HITCOUNT': '0.500', 'weapon2': '1.022', 'weapon3': '1.228', 'DAMAGECOUNT': '2.076', 'FRAGCOUNT': '7.000'} [2023-02-24 18:40:04,220][177153] Updated weights for policy 0, policy_version 15800 (0.0008) [2023-02-24 18:40:04,446][177158] DAMAGECOUNT value on done: 160375.0 [2023-02-24 18:40:04,447][177158] Sum rewards: 8.833, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.630', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'ARMOR': '0.050', 'AMMO4': '0.057', 'weapon7': '0.058', 'AMMO3': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.422', 'WEAPON3': '0.450', 'HITCOUNT': '0.730', 'weapon3': '1.104', 'weapon2': '1.148', 'DAMAGECOUNT': '2.865', 'FRAGCOUNT': '7.000'} [2023-02-24 18:40:05,856][177172] DAMAGECOUNT value on done: 158990.0 [2023-02-24 18:40:05,857][177172] Sum rewards: 15.156, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.040', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'weapon4': '0.036', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO3': '0.070', 'weapon5': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.960', 'weapon3': '1.710', 'weapon2': '1.836', 'DAMAGECOUNT': '4.266', 'FRAGCOUNT': '11.000'} [2023-02-24 18:40:06,153][177172] DAMAGECOUNT value on done: 159096.0 [2023-02-24 18:40:06,153][177172] Sum rewards: 8.525, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.772', 'AMMO2': '0.001', 'AMMO4': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'weapon7': '0.074', 'ARMOR': '0.080', 'AMMO3': '0.085', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'weapon4': '0.432', 'WEAPON3': '0.550', 'HITCOUNT': '0.780', 'weapon3': '1.150', 'weapon2': '2.022', 'DAMAGECOUNT': '3.237', 'FRAGCOUNT': '5.000'} [2023-02-24 18:40:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13912.5). Total num frames: 64745472. Throughput: 0: 3471.8. Samples: 16180466. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:40:06,377][177119] Avg episode reward: [(0, '11.582')] [2023-02-24 18:40:07,066][177154] DAMAGECOUNT value on done: 161994.0 [2023-02-24 18:40:07,067][177154] Sum rewards: 7.079, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.500', 'AMMO2': '0.013', 'AMMO5': '0.022', 'WEAPON1': '0.040', 'weapon5': '0.056', 'AMMO3': '0.063', 'AMMO4': '0.064', 'weapon7': '0.130', 'WEAPON4': '0.150', 'AMMO6': '0.420', 'AMMO7': '0.420', 'WEAPON5': '0.450', 'weapon4': '0.466', 'WEAPON7': '0.500', 'HITCOUNT': '0.530', 'WEAPON3': '0.550', 'weapon2': '0.814', 'weapon3': '1.344', 'DAMAGECOUNT': '2.547', 'FRAGCOUNT': '6.000'} [2023-02-24 18:40:07,167][177153] Updated weights for policy 0, policy_version 15810 (0.0008) [2023-02-24 18:40:07,373][177154] DAMAGECOUNT value on done: 165206.0 [2023-02-24 18:40:07,373][177154] Sum rewards: 6.372, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.690', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'AMMO3': '0.085', 'weapon7': '0.128', 'AMMO4': '0.163', 'weapon5': '0.232', 'WEAPON4': '0.250', 'AMMO6': '0.260', 'AMMO7': '0.260', 'WEAPON7': '0.300', 'WEAPON5': '0.450', 'weapon4': '0.492', 'WEAPON3': '0.650', 'HITCOUNT': '0.670', 'weapon2': '1.124', 'weapon3': '1.652', 'DAMAGECOUNT': '2.529', 'FRAGCOUNT': '4.500'} [2023-02-24 18:40:07,624][177172] DAMAGECOUNT value on done: 160960.0 [2023-02-24 18:40:07,624][177172] Sum rewards: 6.705, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.530', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'AMMO4': '0.053', 'AMMO3': '0.061', 'weapon5': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.450', 'HITCOUNT': '0.510', 'weapon2': '0.548', 'weapon4': '0.722', 'weapon3': '0.774', 'DAMAGECOUNT': '2.094', 'FRAGCOUNT': '5.000'} [2023-02-24 18:40:07,671][177154] DAMAGECOUNT value on done: 163248.0 [2023-02-24 18:40:07,672][177154] Sum rewards: 15.014, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.656', 'AMMO5': '0.015', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'AMMO3': '0.071', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'weapon5': '0.238', 'weapon4': '0.254', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.750', 'weapon3': '1.532', 'weapon2': '1.734', 'DAMAGECOUNT': '4.074', 'FRAGCOUNT': '11.000'} [2023-02-24 18:40:07,929][177172] DAMAGECOUNT value on done: 161313.0 [2023-02-24 18:40:07,930][177172] Sum rewards: 8.584, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.620', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.118', 'AMMO4': '0.160', 'weapon5': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.494', 'WEAPON3': '0.650', 'HITCOUNT': '0.810', 'weapon3': '1.416', 'weapon2': '1.554', 'DAMAGECOUNT': '3.597', 'FRAGCOUNT': '9.000'} [2023-02-24 18:40:07,981][177154] DAMAGECOUNT value on done: 166429.0 [2023-02-24 18:40:07,982][177154] Sum rewards: 14.910, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.845', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.077', 'AMMO4': '0.121', 'weapon5': '0.168', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.606', 'WEAPON3': '0.650', 'HITCOUNT': '0.980', 'weapon2': '1.238', 'weapon3': '1.482', 'DAMAGECOUNT': '4.671', 'FRAGCOUNT': '12.000'} [2023-02-24 18:40:08,293][177157] DAMAGECOUNT value on done: 166692.0 [2023-02-24 18:40:08,294][177157] Sum rewards: 19.945, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.650', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon4': '0.034', 'ARMOR': '0.052', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'WEAPON5': '0.150', 'weapon5': '0.174', 'WEAPON3': '0.700', 'HITCOUNT': '1.320', 'weapon2': '1.512', 'weapon3': '2.018', 'DAMAGECOUNT': '5.829', 'FRAGCOUNT': '16.000'} [2023-02-24 18:40:08,317][177157] DAMAGECOUNT value on done: 152364.0 [2023-02-24 18:40:08,318][177157] Sum rewards: 14.302, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.162', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon7': '0.058', 'WEAPON1': '0.060', 'weapon4': '0.068', 'AMMO3': '0.097', 'AMMO4': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.156', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'HITCOUNT': '0.940', 'weapon3': '1.662', 'weapon2': '1.732', 'DAMAGECOUNT': '4.458', 'FRAGCOUNT': '12.000'} [2023-02-24 18:40:08,526][177171] DAMAGECOUNT value on done: 155248.0 [2023-02-24 18:40:08,527][177171] Sum rewards: 8.603, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.754', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.057', 'weapon4': '0.060', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'weapon5': '0.162', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'HITCOUNT': '0.590', 'weapon3': '1.138', 'weapon2': '2.252', 'DAMAGECOUNT': '3.624', 'FRAGCOUNT': '6.500'} [2023-02-24 18:40:08,607][177157] DAMAGECOUNT value on done: 155783.0 [2023-02-24 18:40:08,608][177157] Sum rewards: 14.946, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.127', 'weapon4': '0.014', 'ARMOR': '0.016', 'AMMO5': '0.020', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'AMMO3': '0.126', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'weapon5': '0.152', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'HITCOUNT': '1.060', 'weapon3': '1.774', 'weapon2': '1.816', 'DAMAGECOUNT': '4.803', 'FRAGCOUNT': '13.000'} [2023-02-24 18:40:08,632][177157] DAMAGECOUNT value on done: 156753.0 [2023-02-24 18:40:08,633][177157] Sum rewards: 15.327, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.010', 'weapon7': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'AMMO3': '0.060', 'weapon4': '0.060', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'weapon5': '0.182', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'HEALTH': '0.270', 'WEAPON3': '0.350', 'HITCOUNT': '1.070', 'weapon3': '1.462', 'weapon2': '2.042', 'DAMAGECOUNT': '4.230', 'FRAGCOUNT': '9.000'} [2023-02-24 18:40:08,828][177171] DAMAGECOUNT value on done: 156442.0 [2023-02-24 18:40:08,829][177171] Sum rewards: 5.106, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.165', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'weapon5': '0.044', 'ARMOR': '0.052', 'AMMO4': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon7': '0.110', 'HITCOUNT': '0.270', 'WEAPON3': '0.300', 'weapon4': '0.498', 'weapon3': '0.974', 'weapon2': '1.148', 'DAMAGECOUNT': '1.464', 'FRAGCOUNT': '2.000'} [2023-02-24 18:40:08,837][177171] DAMAGECOUNT value on done: 161519.0 [2023-02-24 18:40:08,837][177171] Sum rewards: 10.016, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.116', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.079', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'weapon5': '0.260', 'weapon4': '0.294', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'HITCOUNT': '0.830', 'weapon2': '1.292', 'weapon3': '1.890', 'DAMAGECOUNT': '4.080', 'FRAGCOUNT': '10.000'} [2023-02-24 18:40:09,129][177171] DAMAGECOUNT value on done: 157337.0 [2023-02-24 18:40:09,129][177171] Sum rewards: 14.748, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.755', 'weapon7': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'AMMO3': '0.088', 'AMMO4': '0.103', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.236', 'WEAPON5': '0.350', 'weapon4': '0.406', 'WEAPON3': '0.500', 'HITCOUNT': '0.780', 'weapon3': '1.318', 'weapon2': '1.640', 'DAMAGECOUNT': '3.696', 'FRAGCOUNT': '13.000'} [2023-02-24 18:40:10,122][177155] DAMAGECOUNT value on done: 160058.0 [2023-02-24 18:40:10,122][177155] Sum rewards: 6.630, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.566', 'AMMO2': '0.009', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'AMMO3': '0.065', 'WEAPON4': '0.100', 'weapon7': '0.106', 'weapon5': '0.142', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.290', 'WEAPON5': '0.350', 'HITCOUNT': '0.410', 'WEAPON3': '0.500', 'weapon3': '1.172', 'DAMAGECOUNT': '1.644', 'weapon2': '1.978', 'FRAGCOUNT': '5.000'} [2023-02-24 18:40:10,136][177153] Updated weights for policy 0, policy_version 15820 (0.0008) [2023-02-24 18:40:10,412][177155] DAMAGECOUNT value on done: 165563.0 [2023-02-24 18:40:10,412][177155] Sum rewards: 10.505, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.102', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon4': '0.038', 'WEAPON4': '0.050', 'weapon7': '0.064', 'AMMO3': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.102', 'weapon5': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.600', 'HITCOUNT': '0.820', 'weapon3': '1.438', 'weapon2': '1.668', 'DAMAGECOUNT': '3.534', 'FRAGCOUNT': '7.500'} [2023-02-24 18:40:10,767][177155] DAMAGECOUNT value on done: 166503.0 [2023-02-24 18:40:10,768][177155] Sum rewards: 10.827, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon7': '0.054', 'HEALTH': '0.060', 'AMMO3': '0.069', 'weapon5': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.384', 'WEAPON3': '0.400', 'HITCOUNT': '0.710', 'weapon3': '1.208', 'weapon2': '2.154', 'DAMAGECOUNT': '3.219', 'FRAGCOUNT': '7.000'} [2023-02-24 18:40:11,062][177155] DAMAGECOUNT value on done: 156819.0 [2023-02-24 18:40:11,062][177155] Sum rewards: 13.198, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.934', 'AMMO2': '0.003', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.014', 'ARMOR': '0.068', 'AMMO3': '0.070', 'weapon7': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon5': '0.152', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.560', 'weapon2': '0.702', 'weapon4': '0.710', 'weapon3': '1.434', 'DAMAGECOUNT': '3.384', 'FRAGCOUNT': '10.000'} [2023-02-24 18:40:11,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.5, 300 sec: 13912.5). Total num frames: 64815104. Throughput: 0: 3472.0. Samples: 16201314. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:40:11,376][177119] Avg episode reward: [(0, '11.674')] [2023-02-24 18:40:13,098][177153] Updated weights for policy 0, policy_version 15830 (0.0009) [2023-02-24 18:40:16,049][177153] Updated weights for policy 0, policy_version 15840 (0.0008) [2023-02-24 18:40:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.5, 300 sec: 13912.5). Total num frames: 64884736. Throughput: 0: 3471.8. Samples: 16222084. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:40:16,376][177119] Avg episode reward: [(0, '11.674')] [2023-02-24 18:40:17,297][177156] DAMAGECOUNT value on done: 162748.0 [2023-02-24 18:40:17,297][177156] Sum rewards: 17.116, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.095', 'AMMO2': '0.023', 'AMMO5': '0.033', 'WEAPON1': '0.040', 'AMMO4': '0.117', 'AMMO3': '0.120', 'weapon5': '0.244', 'WEAPON4': '0.300', 'weapon4': '0.314', 'WEAPON5': '0.650', 'WEAPON3': '0.800', 'HITCOUNT': '1.070', 'weapon2': '1.324', 'weapon3': '1.782', 'DAMAGECOUNT': '5.643', 'FRAGCOUNT': '15.000'} [2023-02-24 18:40:17,396][177156] DAMAGECOUNT value on done: 155858.0 [2023-02-24 18:40:17,397][177156] Sum rewards: 14.295, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.870', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon7': '0.048', 'WEAPON1': '0.060', 'AMMO3': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.130', 'AMMO4': '0.166', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.582', 'WEAPON3': '0.600', 'HITCOUNT': '0.780', 'weapon2': '0.972', 'weapon3': '1.320', 'DAMAGECOUNT': '4.095', 'FRAGCOUNT': '13.000'} [2023-02-24 18:40:17,575][177170] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 18:40:17,601][177156] DAMAGECOUNT value on done: 159339.0 [2023-02-24 18:40:17,602][177156] Sum rewards: 10.986, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.030', 'AMMO2': '0.003', 'weapon7': '0.014', 'AMMO4': '0.015', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'weapon5': '0.168', 'weapon4': '0.186', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '1.100', 'weapon2': '1.648', 'weapon3': '1.706', 'DAMAGECOUNT': '4.515', 'FRAGCOUNT': '10.000'} [2023-02-24 18:40:17,703][177156] DAMAGECOUNT value on done: 159945.0 [2023-02-24 18:40:17,704][177156] Sum rewards: 14.993, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.182', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'AMMO3': '0.104', 'AMMO4': '0.133', 'weapon5': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'weapon2': '0.620', 'weapon4': '0.872', 'HITCOUNT': '1.120', 'weapon3': '1.720', 'DAMAGECOUNT': '4.347', 'FRAGCOUNT': '12.000'} [2023-02-24 18:40:19,010][177153] Updated weights for policy 0, policy_version 15850 (0.0009) [2023-02-24 18:40:20,803][177170] DAMAGECOUNT value on done: 159089.0 [2023-02-24 18:40:20,804][177170] Sum rewards: 17.528, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.678', 'AMMO2': '0.005', 'AMMO5': '0.014', 'AMMO4': '0.027', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'weapon5': '0.142', 'weapon4': '0.304', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'ARMOR': '0.856', 'HITCOUNT': '1.000', 'weapon2': '1.648', 'weapon3': '1.658', 'DAMAGECOUNT': '4.413', 'FRAGCOUNT': '13.000'} [2023-02-24 18:40:21,109][177170] DAMAGECOUNT value on done: 167955.0 [2023-02-24 18:40:21,109][177170] Sum rewards: 9.893, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.513', 'AMMO5': '0.015', 'AMMO2': '0.020', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.066', 'AMMO4': '0.101', 'weapon4': '0.228', 'weapon5': '0.248', 'HITCOUNT': '0.370', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'weapon3': '1.386', 'weapon2': '1.676', 'DAMAGECOUNT': '2.796', 'FRAGCOUNT': '7.000'} [2023-02-24 18:40:21,131][177170] DAMAGECOUNT value on done: 154803.0 [2023-02-24 18:40:21,132][177170] Sum rewards: 16.739, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.936', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'weapon7': '0.060', 'AMMO3': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.176', 'WEAPON5': '0.300', 'weapon4': '0.398', 'WEAPON3': '0.600', 'HITCOUNT': '0.770', 'weapon2': '1.242', 'weapon3': '1.324', 'DAMAGECOUNT': '4.551', 'FRAGCOUNT': '13.000'} [2023-02-24 18:40:21,376][177119] Fps is (10 sec: 13516.9, 60 sec: 13858.1, 300 sec: 13898.6). Total num frames: 64950272. Throughput: 0: 3469.8. Samples: 16232500. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:40:21,376][177119] Avg episode reward: [(0, '11.911')] [2023-02-24 18:40:21,422][177170] DAMAGECOUNT value on done: 157156.0 [2023-02-24 18:40:21,422][177170] Sum rewards: 11.290, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.670', 'AMMO5': '0.010', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'AMMO3': '0.089', 'AMMO4': '0.102', 'weapon5': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.384', 'WEAPON3': '0.650', 'HITCOUNT': '0.840', 'weapon2': '1.520', 'weapon3': '1.668', 'DAMAGECOUNT': '3.450', 'FRAGCOUNT': '11.000'} [2023-02-24 18:40:21,969][177153] Updated weights for policy 0, policy_version 15860 (0.0008) [2023-02-24 18:40:22,443][177158] DAMAGECOUNT value on done: 153483.0 [2023-02-24 18:40:22,444][177158] Sum rewards: 4.759, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.644', 'AMMO2': '0.013', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'weapon7': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.128', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'HITCOUNT': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.622', 'weapon2': '0.786', 'weapon3': '1.244', 'DAMAGECOUNT': '1.566', 'FRAGCOUNT': '5.000'} [2023-02-24 18:40:22,738][177158] DAMAGECOUNT value on done: 156691.0 [2023-02-24 18:40:22,738][177158] Sum rewards: 2.159, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.318', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'weapon7': '0.054', 'AMMO3': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.118', 'AMMO4': '0.131', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.310', 'WEAPON3': '0.550', 'weapon4': '0.600', 'weapon2': '0.826', 'weapon3': '1.356', 'DAMAGECOUNT': '1.857', 'FRAGCOUNT': '3.500'} [2023-02-24 18:40:23,517][177158] DAMAGECOUNT value on done: 161994.0 [2023-02-24 18:40:23,517][177158] Sum rewards: 7.685, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.880', 'ARMOR': '0.004', 'AMMO2': '0.005', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.023', 'AMMO3': '0.093', 'weapon5': '0.138', 'WEAPON4': '0.250', 'WEAPON5': '0.500', 'HITCOUNT': '0.500', 'WEAPON3': '0.650', 'weapon4': '0.724', 'weapon2': '0.730', 'weapon3': '1.540', 'DAMAGECOUNT': '2.118', 'FRAGCOUNT': '8.000'} [2023-02-24 18:40:23,811][177158] DAMAGECOUNT value on done: 161850.0 [2023-02-24 18:40:23,811][177158] Sum rewards: 12.839, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.173', 'AMMO2': '0.005', 'AMMO5': '0.015', 'AMMO4': '0.022', 'WEAPON1': '0.040', 'weapon5': '0.054', 'weapon7': '0.098', 'AMMO3': '0.117', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.462', 'weapon2': '0.738', 'WEAPON3': '0.800', 'HITCOUNT': '0.950', 'weapon3': '2.246', 'DAMAGECOUNT': '4.425', 'FRAGCOUNT': '11.000'} [2023-02-24 18:40:24,922][177153] Updated weights for policy 0, policy_version 15870 (0.0008) [2023-02-24 18:40:25,272][177172] DAMAGECOUNT value on done: 160516.0 [2023-02-24 18:40:25,272][177172] Sum rewards: 10.957, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'weapon5': '0.162', 'WEAPON3': '0.350', 'weapon4': '0.432', 'HEALTH': '0.720', 'HITCOUNT': '0.810', 'weapon3': '1.400', 'weapon2': '1.628', 'DAMAGECOUNT': '3.678', 'FRAGCOUNT': '5.500'} [2023-02-24 18:40:25,576][177172] DAMAGECOUNT value on done: 160114.0 [2023-02-24 18:40:25,576][177172] Sum rewards: 9.846, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.100', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon7': '0.082', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.131', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.632', 'WEAPON3': '0.700', 'HITCOUNT': '0.810', 'weapon2': '0.930', 'weapon3': '1.362', 'DAMAGECOUNT': '3.054', 'FRAGCOUNT': '9.000'} [2023-02-24 18:40:26,376][177119] Fps is (10 sec: 13516.7, 60 sec: 13858.1, 300 sec: 13898.6). Total num frames: 65019904. Throughput: 0: 3467.9. Samples: 16253222. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:40:26,376][177119] Avg episode reward: [(0, '11.723')] [2023-02-24 18:40:26,503][177154] DAMAGECOUNT value on done: 163374.0 [2023-02-24 18:40:26,503][177154] Sum rewards: 8.525, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.850', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO5': '0.014', 'weapon5': '0.122', 'AMMO3': '0.139', 'WEAPON5': '0.350', 'WEAPON3': '0.900', 'HITCOUNT': '1.080', 'weapon2': '1.454', 'weapon3': '2.176', 'DAMAGECOUNT': '4.140', 'FRAGCOUNT': '10.500'} [2023-02-24 18:40:26,808][177154] DAMAGECOUNT value on done: 166484.0 [2023-02-24 18:40:26,809][177154] Sum rewards: 7.822, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.375', 'AMMO2': '0.011', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'weapon7': '0.048', 'AMMO4': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.124', 'WEAPON4': '0.200', 'weapon5': '0.220', 'WEAPON5': '0.450', 'weapon4': '0.648', 'WEAPON3': '0.900', 'HITCOUNT': '0.900', 'weapon2': '0.912', 'weapon3': '1.770', 'DAMAGECOUNT': '3.834', 'FRAGCOUNT': '9.500'} [2023-02-24 18:40:27,040][177172] DAMAGECOUNT value on done: 162536.0 [2023-02-24 18:40:27,040][177172] Sum rewards: 11.344, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.142', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon7': '0.050', 'AMMO3': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.132', 'weapon2': '0.146', 'AMMO4': '0.237', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'weapon4': '1.204', 'HITCOUNT': '1.270', 'weapon3': '1.410', 'DAMAGECOUNT': '4.728', 'FRAGCOUNT': '7.000'} [2023-02-24 18:40:27,106][177154] DAMAGECOUNT value on done: 164734.0 [2023-02-24 18:40:27,107][177154] Sum rewards: 13.544, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.694', 'AMMO5': '0.010', 'AMMO2': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.051', 'weapon5': '0.098', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.238', 'WEAPON3': '0.750', 'HITCOUNT': '1.150', 'weapon2': '1.360', 'weapon3': '1.876', 'DAMAGECOUNT': '4.458', 'FRAGCOUNT': '12.000'} [2023-02-24 18:40:27,343][177172] DAMAGECOUNT value on done: 162939.0 [2023-02-24 18:40:27,343][177172] Sum rewards: 15.569, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.752', 'AMMO5': '0.003', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.109', 'AMMO3': '0.134', 'WEAPON4': '0.300', 'weapon4': '0.344', 'WEAPON3': '0.900', 'HITCOUNT': '1.170', 'weapon2': '1.410', 'weapon3': '1.666', 'DAMAGECOUNT': '4.878', 'FRAGCOUNT': '16.000'} [2023-02-24 18:40:27,413][177154] DAMAGECOUNT value on done: 167110.0 [2023-02-24 18:40:27,414][177154] Sum rewards: 6.872, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.150', 'AMMO2': '0.005', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.025', 'weapon5': '0.068', 'AMMO3': '0.079', 'weapon7': '0.114', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'HITCOUNT': '0.440', 'weapon4': '0.478', 'WEAPON3': '0.500', 'weapon3': '1.460', 'weapon2': '1.592', 'DAMAGECOUNT': '2.043', 'FRAGCOUNT': '5.000'} [2023-02-24 18:40:27,678][177157] DAMAGECOUNT value on done: 168143.0 [2023-02-24 18:40:27,679][177157] Sum rewards: 14.737, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO3': '0.050', 'weapon5': '0.072', 'AMMO4': '0.090', 'weapon7': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.230', 'HEALTH': '0.365', 'WEAPON3': '0.400', 'HITCOUNT': '0.550', 'weapon3': '1.106', 'weapon2': '2.300', 'DAMAGECOUNT': '3.453', 'FRAGCOUNT': '11.000'} [2023-02-24 18:40:27,698][177157] DAMAGECOUNT value on done: 153687.0 [2023-02-24 18:40:27,699][177157] Sum rewards: 11.450, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.478', 'AMMO2': '0.014', 'AMMO5': '0.018', 'WEAPON1': '0.040', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'weapon4': '0.214', 'weapon5': '0.240', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '1.060', 'weapon2': '1.536', 'weapon3': '1.642', 'DAMAGECOUNT': '3.969', 'FRAGCOUNT': '10.000'} [2023-02-24 18:40:27,870][177153] Updated weights for policy 0, policy_version 15880 (0.0008) [2023-02-24 18:40:27,960][177171] DAMAGECOUNT value on done: 156101.0 [2023-02-24 18:40:27,960][177171] Sum rewards: 7.408, reward structure: {'DEATHCOUNT': '-6.000', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.023', 'ARMOR': '0.080', 'weapon5': '0.082', 'AMMO3': '0.097', 'AMMO4': '0.115', 'WEAPON4': '0.200', 'HEALTH': '0.244', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'HITCOUNT': '0.600', 'weapon4': '0.694', 'weapon2': '1.274', 'weapon3': '1.614', 'DAMAGECOUNT': '2.559', 'FRAGCOUNT': '5.000'} [2023-02-24 18:40:27,987][177157] DAMAGECOUNT value on done: 156583.0 [2023-02-24 18:40:27,987][177157] Sum rewards: 3.793, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.701', 'AMMO2': '0.001', 'AMMO4': '0.003', 'ARMOR': '0.004', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.150', 'weapon5': '0.176', 'weapon4': '0.266', 'WEAPON5': '0.500', 'HITCOUNT': '0.600', 'WEAPON3': '0.950', 'weapon2': '1.476', 'weapon3': '1.608', 'DAMAGECOUNT': '2.400', 'FRAGCOUNT': '5.500'} [2023-02-24 18:40:28,008][177157] DAMAGECOUNT value on done: 158152.0 [2023-02-24 18:40:28,008][177157] Sum rewards: 14.074, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.668', 'AMMO5': '0.012', 'AMMO2': '0.016', 'ARMOR': '0.040', 'WEAPON1': '0.040', 'AMMO4': '0.081', 'AMMO3': '0.113', 'weapon5': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.478', 'WEAPON3': '0.750', 'HITCOUNT': '1.030', 'weapon2': '1.138', 'weapon3': '1.948', 'DAMAGECOUNT': '4.197', 'FRAGCOUNT': '14.000'} [2023-02-24 18:40:28,258][177171] DAMAGECOUNT value on done: 158069.0 [2023-02-24 18:40:28,258][177171] Sum rewards: 17.649, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.760', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.056', 'AMMO3': '0.080', 'weapon7': '0.082', 'AMMO4': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'WEAPON3': '0.550', 'weapon4': '0.642', 'weapon2': '0.984', 'HITCOUNT': '1.040', 'weapon3': '1.276', 'DAMAGECOUNT': '4.881', 'FRAGCOUNT': '14.000'} [2023-02-24 18:40:28,267][177171] DAMAGECOUNT value on done: 162722.0 [2023-02-24 18:40:28,268][177171] Sum rewards: 6.692, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.020', 'ARMOR': '0.020', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.034', 'weapon7': '0.048', 'AMMO3': '0.089', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.136', 'AMMO4': '0.171', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.740', 'weapon4': '0.744', 'weapon2': '1.002', 'weapon3': '1.476', 'DAMAGECOUNT': '3.369', 'FRAGCOUNT': '7.000'} [2023-02-24 18:40:28,570][177171] DAMAGECOUNT value on done: 158447.0 [2023-02-24 18:40:28,570][177171] Sum rewards: 10.404, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.160', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.011', 'weapon7': '0.052', 'AMMO4': '0.054', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.486', 'WEAPON3': '0.500', 'HITCOUNT': '0.840', 'weapon3': '1.052', 'weapon2': '1.368', 'DAMAGECOUNT': '3.330', 'FRAGCOUNT': '9.000'} [2023-02-24 18:40:29,519][177155] DAMAGECOUNT value on done: 161385.0 [2023-02-24 18:40:29,520][177155] Sum rewards: 14.556, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.489', 'AMMO2': '0.004', 'weapon4': '0.016', 'AMMO4': '0.019', 'AMMO5': '0.019', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'weapon5': '0.158', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'HITCOUNT': '1.090', 'weapon2': '1.404', 'weapon3': '2.152', 'DAMAGECOUNT': '3.981', 'FRAGCOUNT': '14.000'} [2023-02-24 18:40:29,819][177155] DAMAGECOUNT value on done: 167119.0 [2023-02-24 18:40:29,819][177155] Sum rewards: 15.274, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.423', 'weapon4': '0.012', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'AMMO2': '0.031', 'WEAPON4': '0.050', 'AMMO3': '0.119', 'AMMO4': '0.155', 'weapon5': '0.190', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'HITCOUNT': '1.040', 'weapon2': '1.090', 'weapon3': '2.340', 'DAMAGECOUNT': '4.668', 'FRAGCOUNT': '13.000'} [2023-02-24 18:40:30,165][177155] DAMAGECOUNT value on done: 167797.0 [2023-02-24 18:40:30,165][177155] Sum rewards: 14.742, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.838', 'AMMO2': '0.015', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.076', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon5': '0.206', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'HITCOUNT': '1.000', 'weapon2': '1.630', 'weapon3': '1.790', 'DAMAGECOUNT': '3.882', 'FRAGCOUNT': '13.000'} [2023-02-24 18:40:30,469][177155] DAMAGECOUNT value on done: 158237.0 [2023-02-24 18:40:30,470][177155] Sum rewards: 8.977, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.881', 'AMMO2': '0.033', 'AMMO5': '0.034', 'ARMOR': '0.043', 'weapon7': '0.048', 'WEAPON1': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.131', 'AMMO4': '0.166', 'WEAPON7': '0.200', 'weapon5': '0.216', 'WEAPON4': '0.450', 'weapon2': '0.502', 'WEAPON5': '0.650', 'HITCOUNT': '0.720', 'WEAPON3': '0.750', 'weapon4': '0.794', 'weapon3': '1.816', 'DAMAGECOUNT': '4.254', 'FRAGCOUNT': '10.000'} [2023-02-24 18:40:30,805][177153] Updated weights for policy 0, policy_version 15890 (0.0008) [2023-02-24 18:40:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13898.6). Total num frames: 65089536. Throughput: 0: 3471.4. Samples: 16274074. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:40:31,376][177119] Avg episode reward: [(0, '12.227')] [2023-02-24 18:40:33,608][177171] Large shaping reward 2.590 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.558, 186.0), ('weapon7', 0.002)] [2023-02-24 18:40:33,775][177153] Updated weights for policy 0, policy_version 15900 (0.0008) [2023-02-24 18:40:36,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13898.6). Total num frames: 65159168. Throughput: 0: 3470.8. Samples: 16284478. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:40:36,376][177119] Avg episode reward: [(0, '12.227')] [2023-02-24 18:40:36,722][177156] DAMAGECOUNT value on done: 164104.0 [2023-02-24 18:40:36,723][177156] Sum rewards: 16.288, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.770', 'AMMO5': '0.015', 'AMMO2': '0.016', 'AMMO4': '0.080', 'AMMO3': '0.089', 'weapon5': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.274', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '1.060', 'weapon2': '1.450', 'weapon3': '1.726', 'DAMAGECOUNT': '4.068', 'FRAGCOUNT': '13.000'} [2023-02-24 18:40:36,733][177153] Updated weights for policy 0, policy_version 15910 (0.0009) [2023-02-24 18:40:36,827][177156] DAMAGECOUNT value on done: 157188.0 [2023-02-24 18:40:36,828][177156] Sum rewards: 14.887, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.045', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.056', 'AMMO3': '0.071', 'WEAPON4': '0.100', 'weapon4': '0.244', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '1.030', 'weapon2': '1.516', 'weapon3': '1.548', 'DAMAGECOUNT': '3.990', 'FRAGCOUNT': '11.000'} [2023-02-24 18:40:37,037][177156] DAMAGECOUNT value on done: 160824.0 [2023-02-24 18:40:37,037][177156] Sum rewards: 17.326, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.129', 'AMMO5': '0.007', 'weapon7': '0.014', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'AMMO3': '0.086', 'AMMO4': '0.109', 'weapon5': '0.190', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'weapon4': '0.404', 'WEAPON3': '0.550', 'HITCOUNT': '1.000', 'weapon3': '1.540', 'weapon2': '1.598', 'DAMAGECOUNT': '4.455', 'FRAGCOUNT': '12.000'} [2023-02-24 18:40:37,140][177156] DAMAGECOUNT value on done: 160801.0 [2023-02-24 18:40:37,140][177156] Sum rewards: 6.405, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.796', 'AMMO2': '0.007', 'ARMOR': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.033', 'weapon7': '0.048', 'AMMO3': '0.083', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.274', 'WEAPON3': '0.450', 'HITCOUNT': '0.540', 'weapon3': '1.208', 'weapon2': '1.664', 'DAMAGECOUNT': '2.568', 'FRAGCOUNT': '4.500'} [2023-02-24 18:40:38,598][177154] Large shaping reward 2.551 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.519, 173.0), ('weapon2', 0.002)] [2023-02-24 18:40:39,671][177153] Updated weights for policy 0, policy_version 15920 (0.0008) [2023-02-24 18:40:40,148][177170] DAMAGECOUNT value on done: 160158.0 [2023-02-24 18:40:40,149][177170] Sum rewards: 10.962, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon7': '0.046', 'WEAPON1': '0.050', 'weapon5': '0.056', 'AMMO3': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HEALTH': '0.140', 'AMMO4': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'weapon4': '0.594', 'ARMOR': '0.800', 'HITCOUNT': '0.910', 'weapon3': '1.428', 'weapon2': '1.536', 'DAMAGECOUNT': '3.207', 'FRAGCOUNT': '8.000'} [2023-02-24 18:40:40,449][177170] DAMAGECOUNT value on done: 169613.0 [2023-02-24 18:40:40,449][177170] Sum rewards: 11.722, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.003', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.016', 'WEAPON1': '0.030', 'weapon5': '0.086', 'AMMO3': '0.160', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '1.350', 'weapon2': '1.374', 'weapon3': '2.258', 'DAMAGECOUNT': '4.974', 'FRAGCOUNT': '11.000'} [2023-02-24 18:40:40,497][177170] DAMAGECOUNT value on done: 156593.0 [2023-02-24 18:40:40,498][177170] Sum rewards: 16.551, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '0.002', 'AMMO2': '0.019', 'AMMO5': '0.029', 'WEAPON1': '0.030', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.152', 'weapon5': '0.200', 'weapon4': '0.318', 'ARMOR': '0.400', 'WEAPON5': '0.550', 'weapon2': '0.654', 'WEAPON3': '0.900', 'HITCOUNT': '1.240', 'weapon3': '2.242', 'DAMAGECOUNT': '5.370', 'FRAGCOUNT': '14.000'} [2023-02-24 18:40:40,789][177170] DAMAGECOUNT value on done: 158391.0 [2023-02-24 18:40:40,790][177170] Sum rewards: 14.780, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'AMMO3': '0.050', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'weapon7': '0.158', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.250', 'WEAPON7': '0.300', 'HEALTH': '0.465', 'HITCOUNT': '0.740', 'weapon2': '0.782', 'ARMOR': '0.859', 'weapon4': '0.882', 'weapon3': '1.092', 'DAMAGECOUNT': '3.705', 'FRAGCOUNT': '9.000'} [2023-02-24 18:40:41,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13898.6). Total num frames: 65228800. Throughput: 0: 3468.8. Samples: 16305290. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:40:41,376][177119] Avg episode reward: [(0, '12.318')] [2023-02-24 18:40:41,795][177158] DAMAGECOUNT value on done: 154742.0 [2023-02-24 18:40:41,796][177158] Sum rewards: 9.589, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.665', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.009', 'WEAPON1': '0.020', 'weapon5': '0.054', 'AMMO3': '0.083', 'WEAPON5': '0.100', 'weapon7': '0.146', 'WEAPON4': '0.300', 'ARMOR': '0.464', 'WEAPON3': '0.550', 'AMMO6': '0.560', 'AMMO7': '0.560', 'weapon4': '0.694', 'HITCOUNT': '0.760', 'WEAPON7': '0.800', 'weapon2': '1.224', 'weapon3': '1.396', 'DAMAGECOUNT': '3.777', 'FRAGCOUNT': '6.500'} [2023-02-24 18:40:42,089][177158] DAMAGECOUNT value on done: 157880.0 [2023-02-24 18:40:42,089][177158] Sum rewards: 9.545, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.456', 'AMMO5': '0.013', 'AMMO2': '0.019', 'weapon5': '0.052', 'AMMO3': '0.085', 'AMMO4': '0.097', 'weapon7': '0.182', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON7': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.810', 'weapon4': '0.836', 'weapon2': '0.982', 'weapon3': '1.278', 'DAMAGECOUNT': '3.567', 'FRAGCOUNT': '9.000'} [2023-02-24 18:40:42,591][177153] Updated weights for policy 0, policy_version 15930 (0.0008) [2023-02-24 18:40:42,892][177158] DAMAGECOUNT value on done: 164401.0 [2023-02-24 18:40:42,893][177158] Sum rewards: 26.957, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.274', 'AMMO5': '0.012', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'AMMO4': '0.126', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'weapon5': '0.204', 'weapon4': '0.226', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'weapon2': '0.886', 'HITCOUNT': '1.440', 'weapon3': '2.366', 'DAMAGECOUNT': '7.221', 'FRAGCOUNT': '23.000'} [2023-02-24 18:40:43,189][177158] DAMAGECOUNT value on done: 163335.0 [2023-02-24 18:40:43,190][177158] Sum rewards: 15.637, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.100', 'weapon5': '0.008', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.043', 'AMMO3': '0.076', 'weapon7': '0.098', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'AMMO4': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.704', 'weapon2': '0.934', 'HITCOUNT': '1.010', 'weapon3': '1.612', 'DAMAGECOUNT': '4.455', 'FRAGCOUNT': '12.000'} [2023-02-24 18:40:44,700][177172] DAMAGECOUNT value on done: 161728.0 [2023-02-24 18:40:44,700][177172] Sum rewards: 13.895, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.053', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.023', 'weapon5': '0.040', 'AMMO3': '0.099', 'AMMO4': '0.112', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'weapon4': '0.606', 'ARMOR': '0.856', 'HITCOUNT': '0.990', 'weapon2': '1.376', 'weapon3': '1.732', 'DAMAGECOUNT': '3.636', 'FRAGCOUNT': '10.000'} [2023-02-24 18:40:45,011][177172] DAMAGECOUNT value on done: 161450.0 [2023-02-24 18:40:45,011][177172] Sum rewards: 6.676, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.180', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO2': '0.026', 'weapon7': '0.052', 'weapon5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.132', 'AMMO3': '0.135', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.438', 'WEAPON5': '0.550', 'HITCOUNT': '0.940', 'WEAPON3': '1.000', 'weapon2': '1.062', 'weapon3': '2.066', 'DAMAGECOUNT': '4.008', 'FRAGCOUNT': '8.000'} [2023-02-24 18:40:45,542][177153] Updated weights for policy 0, policy_version 15940 (0.0008) [2023-02-24 18:40:45,805][177154] DAMAGECOUNT value on done: 164580.0 [2023-02-24 18:40:45,806][177154] Sum rewards: 18.331, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.914', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'AMMO5': '0.007', 'weapon5': '0.050', 'AMMO3': '0.063', 'WEAPON5': '0.200', 'WEAPON3': '0.550', 'HITCOUNT': '1.050', 'weapon3': '1.362', 'weapon2': '2.140', 'DAMAGECOUNT': '3.618', 'FRAGCOUNT': '14.000'} [2023-02-24 18:40:46,095][177154] DAMAGECOUNT value on done: 167353.0 [2023-02-24 18:40:46,095][177154] Sum rewards: 8.225, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.485', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'weapon7': '0.048', 'weapon4': '0.056', 'AMMO4': '0.077', 'AMMO3': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON3': '0.700', 'HITCOUNT': '0.720', 'weapon3': '1.406', 'weapon2': '1.796', 'DAMAGECOUNT': '2.607', 'FRAGCOUNT': '7.000'} [2023-02-24 18:40:46,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13898.6). Total num frames: 65298432. Throughput: 0: 3470.4. Samples: 16326192. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:40:46,377][177119] Avg episode reward: [(0, '12.419')] [2023-02-24 18:40:46,381][177140] Saving new best policy, reward=12.419! [2023-02-24 18:40:46,386][177154] DAMAGECOUNT value on done: 165734.0 [2023-02-24 18:40:46,387][177154] Sum rewards: 11.101, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.506', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'weapon7': '0.054', 'AMMO3': '0.069', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.540', 'weapon4': '0.602', 'weapon2': '0.808', 'weapon3': '1.210', 'DAMAGECOUNT': '3.000', 'FRAGCOUNT': '8.000'} [2023-02-24 18:40:46,494][177172] DAMAGECOUNT value on done: 163908.0 [2023-02-24 18:40:46,494][177172] Sum rewards: 12.060, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.039', 'WEAPON1': '0.010', 'AMMO5': '0.025', 'AMMO2': '0.036', 'AMMO3': '0.084', 'weapon4': '0.124', 'WEAPON4': '0.150', 'AMMO4': '0.178', 'weapon5': '0.236', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.860', 'weapon2': '1.652', 'weapon3': '1.712', 'DAMAGECOUNT': '3.732', 'FRAGCOUNT': '10.500'} [2023-02-24 18:40:46,702][177154] DAMAGECOUNT value on done: 168461.0 [2023-02-24 18:40:46,702][177154] Sum rewards: 18.047, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.640', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.067', 'WEAPON4': '0.100', 'weapon7': '0.150', 'weapon4': '0.314', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON3': '0.450', 'WEAPON7': '0.500', 'HITCOUNT': '0.810', 'weapon3': '1.240', 'weapon2': '1.824', 'DAMAGECOUNT': '4.053', 'FRAGCOUNT': '13.000'} [2023-02-24 18:40:46,794][177172] DAMAGECOUNT value on done: 164912.0 [2023-02-24 18:40:46,794][177172] Sum rewards: 25.180, reward structure: {'DEATHCOUNT': '-9.000', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO3': '0.123', 'AMMO4': '0.139', 'weapon5': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'weapon2': '0.520', 'WEAPON3': '0.650', 'weapon4': '0.656', 'HEALTH': '0.776', 'HITCOUNT': '1.360', 'weapon3': '1.766', 'DAMAGECOUNT': '5.919', 'FRAGCOUNT': '21.000'} [2023-02-24 18:40:47,015][177157] DAMAGECOUNT value on done: 155064.0 [2023-02-24 18:40:47,015][177157] Sum rewards: 12.013, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '0.014', 'AMMO5': '0.015', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.111', 'weapon5': '0.180', 'WEAPON5': '0.300', 'weapon4': '0.478', 'WEAPON3': '0.700', 'weapon2': '1.080', 'HITCOUNT': '1.140', 'weapon3': '1.850', 'DAMAGECOUNT': '4.131', 'FRAGCOUNT': '10.000'} [2023-02-24 18:40:47,029][177157] DAMAGECOUNT value on done: 169249.0 [2023-02-24 18:40:47,030][177157] Sum rewards: 9.226, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.860', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.023', 'weapon5': '0.084', 'AMMO3': '0.101', 'AMMO4': '0.116', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.478', 'WEAPON3': '0.700', 'HITCOUNT': '0.940', 'weapon2': '1.134', 'weapon3': '1.912', 'DAMAGECOUNT': '3.318', 'FRAGCOUNT': '7.500'} [2023-02-24 18:40:47,317][177171] DAMAGECOUNT value on done: 157091.0 [2023-02-24 18:40:47,318][177171] Sum rewards: 14.901, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.374', 'AMMO5': '0.010', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'AMMO3': '0.061', 'AMMO4': '0.128', 'WEAPON4': '0.200', 'weapon5': '0.246', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon4': '0.402', 'WEAPON3': '0.450', 'HITCOUNT': '0.670', 'weapon2': '1.324', 'weapon3': '1.508', 'DAMAGECOUNT': '2.970', 'FRAGCOUNT': '11.000'} [2023-02-24 18:40:47,334][177157] DAMAGECOUNT value on done: 159665.0 [2023-02-24 18:40:47,334][177157] Sum rewards: 15.625, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.913', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'weapon5': '0.082', 'weapon7': '0.100', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.596', 'WEAPON3': '0.950', 'HITCOUNT': '1.050', 'weapon3': '1.424', 'weapon2': '1.466', 'DAMAGECOUNT': '4.539', 'FRAGCOUNT': '14.000'} [2023-02-24 18:40:47,346][177157] DAMAGECOUNT value on done: 158151.0 [2023-02-24 18:40:47,346][177157] Sum rewards: 13.976, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.294', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.040', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.112', 'weapon4': '0.118', 'WEAPON4': '0.150', 'weapon5': '0.166', 'AMMO4': '0.201', 'WEAPON5': '0.250', 'WEAPON3': '0.650', 'HITCOUNT': '1.100', 'weapon2': '1.610', 'weapon3': '1.788', 'DAMAGECOUNT': '4.704', 'FRAGCOUNT': '12.000'} [2023-02-24 18:40:47,612][177171] DAMAGECOUNT value on done: 159119.0 [2023-02-24 18:40:47,612][177171] Sum rewards: 5.125, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.402', 'AMMO5': '0.022', 'AMMO2': '0.035', 'WEAPON1': '0.080', 'weapon5': '0.088', 'AMMO3': '0.122', 'AMMO4': '0.175', 'WEAPON4': '0.200', 'weapon4': '0.384', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'HITCOUNT': '0.840', 'weapon2': '1.094', 'weapon3': '1.936', 'DAMAGECOUNT': '3.150', 'FRAGCOUNT': '6.500'} [2023-02-24 18:40:47,622][177171] DAMAGECOUNT value on done: 164476.0 [2023-02-24 18:40:47,622][177171] Sum rewards: 12.040, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.320', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.052', 'AMMO3': '0.077', 'WEAPON5': '0.100', 'weapon7': '0.236', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'AMMO6': '0.460', 'AMMO7': '0.460', 'weapon2': '0.628', 'WEAPON7': '0.700', 'HITCOUNT': '0.760', 'weapon4': '1.206', 'weapon3': '1.228', 'DAMAGECOUNT': '4.062', 'FRAGCOUNT': '10.000'} [2023-02-24 18:40:47,902][177171] DAMAGECOUNT value on done: 160183.0 [2023-02-24 18:40:47,903][177171] Sum rewards: 14.860, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.280', 'AMMO2': '0.010', 'AMMO5': '0.023', 'AMMO4': '0.052', 'weapon7': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.122', 'WEAPON4': '0.250', 'weapon5': '0.334', 'WEAPON5': '0.450', 'weapon4': '0.566', 'WEAPON3': '0.800', 'HITCOUNT': '0.940', 'weapon2': '0.966', 'weapon3': '1.556', 'DAMAGECOUNT': '5.208', 'FRAGCOUNT': '12.000'} [2023-02-24 18:40:48,508][177153] Updated weights for policy 0, policy_version 15950 (0.0008) [2023-02-24 18:40:48,892][177155] DAMAGECOUNT value on done: 162539.0 [2023-02-24 18:40:48,892][177155] Sum rewards: 7.944, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.057', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO2': '0.034', 'AMMO3': '0.068', 'AMMO4': '0.169', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.222', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '0.450', 'weapon2': '0.832', 'ARMOR': '0.853', 'HITCOUNT': '0.890', 'weapon4': '0.894', 'weapon3': '1.232', 'DAMAGECOUNT': '3.462', 'FRAGCOUNT': '6.000'} [2023-02-24 18:40:49,192][177155] DAMAGECOUNT value on done: 168080.0 [2023-02-24 18:40:49,192][177155] Sum rewards: 7.018, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.192', 'AMMO2': '0.015', 'AMMO5': '0.017', 'WEAPON1': '0.050', 'weapon7': '0.058', 'AMMO4': '0.074', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.158', 'weapon5': '0.164', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'HITCOUNT': '0.720', 'weapon3': '1.404', 'weapon2': '1.914', 'DAMAGECOUNT': '2.883', 'FRAGCOUNT': '5.000'} [2023-02-24 18:40:49,541][177155] DAMAGECOUNT value on done: 169946.0 [2023-02-24 18:40:49,541][177155] Sum rewards: 19.421, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.028', 'AMMO5': '0.013', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'AMMO3': '0.087', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'weapon5': '0.202', 'weapon4': '0.344', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'HITCOUNT': '1.030', 'weapon2': '1.362', 'weapon3': '1.650', 'DAMAGECOUNT': '6.447', 'FRAGCOUNT': '14.000'} [2023-02-24 18:40:49,839][177155] DAMAGECOUNT value on done: 159264.0 [2023-02-24 18:40:49,839][177155] Sum rewards: 12.902, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.502', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.043', 'AMMO3': '0.062', 'WEAPON4': '0.100', 'weapon5': '0.108', 'weapon4': '0.124', 'WEAPON5': '0.150', 'WEAPON3': '0.500', 'HITCOUNT': '0.770', 'weapon3': '1.484', 'weapon2': '1.698', 'DAMAGECOUNT': '3.081', 'FRAGCOUNT': '9.000'} [2023-02-24 18:40:51,376][177119] Fps is (10 sec: 13926.2, 60 sec: 13858.1, 300 sec: 13898.6). Total num frames: 65368064. Throughput: 0: 3468.7. Samples: 16336556. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 18:40:51,377][177119] Avg episode reward: [(0, '12.433')] [2023-02-24 18:40:51,377][177140] Saving new best policy, reward=12.433! [2023-02-24 18:40:51,481][177153] Updated weights for policy 0, policy_version 15960 (0.0009) [2023-02-24 18:40:54,320][177157] Large shaping reward 2.605 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5730000000000001, 191.0), ('weapon7', 0.002)] [2023-02-24 18:40:54,379][177153] Updated weights for policy 0, policy_version 15970 (0.0008) [2023-02-24 18:40:56,090][177156] DAMAGECOUNT value on done: 164805.0 [2023-02-24 18:40:56,091][177156] Sum rewards: 5.017, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.137', 'AMMO5': '0.009', 'AMMO2': '0.011', 'WEAPON1': '0.040', 'AMMO4': '0.054', 'AMMO3': '0.089', 'weapon7': '0.094', 'weapon5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.554', 'HITCOUNT': '0.560', 'weapon3': '1.120', 'weapon2': '1.680', 'DAMAGECOUNT': '2.103', 'FRAGCOUNT': '5.000'} [2023-02-24 18:40:56,164][177156] DAMAGECOUNT value on done: 158247.0 [2023-02-24 18:40:56,164][177156] Sum rewards: 13.086, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.889', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO3': '0.066', 'AMMO4': '0.094', 'weapon7': '0.128', 'weapon5': '0.144', 'WEAPON5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'weapon4': '0.568', 'HITCOUNT': '0.830', 'weapon3': '1.214', 'weapon2': '1.536', 'DAMAGECOUNT': '3.177', 'FRAGCOUNT': '9.000'} [2023-02-24 18:40:56,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13858.1, 300 sec: 13898.6). Total num frames: 65437696. Throughput: 0: 3470.2. Samples: 16357472. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 18:40:56,376][177119] Avg episode reward: [(0, '12.292')] [2023-02-24 18:40:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000015976_65437696.pth... [2023-02-24 18:40:56,410][177156] DAMAGECOUNT value on done: 161924.0 [2023-02-24 18:40:56,411][177156] Sum rewards: 14.840, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.760', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.054', 'AMMO3': '0.082', 'weapon5': '0.106', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.306', 'ARMOR': '0.490', 'WEAPON3': '0.650', 'HITCOUNT': '0.960', 'weapon3': '1.376', 'weapon2': '1.990', 'DAMAGECOUNT': '3.300', 'FRAGCOUNT': '12.000'} [2023-02-24 18:40:56,440][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000015162_62103552.pth [2023-02-24 18:40:56,486][177156] DAMAGECOUNT value on done: 162258.0 [2023-02-24 18:40:56,487][177156] Sum rewards: 5.698, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.504', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'AMMO2': '0.027', 'AMMO3': '0.130', 'AMMO4': '0.137', 'weapon5': '0.254', 'WEAPON4': '0.300', 'weapon4': '0.332', 'ARMOR': '0.488', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon2': '0.872', 'HITCOUNT': '1.060', 'weapon3': '2.136', 'DAMAGECOUNT': '4.371', 'FRAGCOUNT': '6.000'} [2023-02-24 18:40:57,332][177153] Updated weights for policy 0, policy_version 15980 (0.0008) [2023-02-24 18:40:59,488][177170] DAMAGECOUNT value on done: 162003.0 [2023-02-24 18:40:59,489][177170] Sum rewards: 16.846, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.000', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'WEAPON1': '0.020', 'weapon5': '0.024', 'AMMO5': '0.025', 'AMMO3': '0.205', 'WEAPON5': '0.500', 'weapon2': '0.944', 'HITCOUNT': '1.190', 'WEAPON3': '1.300', 'weapon3': '2.396', 'DAMAGECOUNT': '5.535', 'FRAGCOUNT': '18.000'} [2023-02-24 18:40:59,787][177170] DAMAGECOUNT value on done: 170973.0 [2023-02-24 18:40:59,788][177170] Sum rewards: 15.447, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.130', 'AMMO2': '0.006', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.032', 'AMMO3': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.104', 'weapon5': '0.132', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.870', 'weapon2': '1.180', 'weapon3': '2.076', 'DAMAGECOUNT': '4.080', 'FRAGCOUNT': '12.500'} [2023-02-24 18:40:59,897][177170] DAMAGECOUNT value on done: 157833.0 [2023-02-24 18:40:59,898][177170] Sum rewards: 16.062, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.590', 'ARMOR': '0.004', 'AMMO5': '0.026', 'WEAPON1': '0.030', 'AMMO2': '0.044', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.112', 'weapon5': '0.148', 'AMMO4': '0.218', 'WEAPON4': '0.300', 'weapon4': '0.392', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'HITCOUNT': '1.000', 'weapon2': '1.404', 'weapon3': '1.650', 'DAMAGECOUNT': '3.720', 'FRAGCOUNT': '15.000'} [2023-02-24 18:41:00,194][177170] DAMAGECOUNT value on done: 159239.0 [2023-02-24 18:41:00,194][177170] Sum rewards: 0.942, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.710', 'AMMO2': '0.018', 'AMMO5': '0.020', 'weapon7': '0.064', 'WEAPON1': '0.070', 'AMMO4': '0.089', 'AMMO3': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.182', 'WEAPON7': '0.200', 'weapon4': '0.280', 'HITCOUNT': '0.540', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'weapon2': '1.074', 'weapon3': '1.916', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.544'} [2023-02-24 18:41:00,295][177153] Updated weights for policy 0, policy_version 15990 (0.0008) [2023-02-24 18:41:01,035][177158] DAMAGECOUNT value on done: 155807.0 [2023-02-24 18:41:01,035][177158] Sum rewards: 9.940, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.435', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon7': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.152', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.318', 'WEAPON3': '0.600', 'HITCOUNT': '0.690', 'weapon3': '1.252', 'weapon2': '1.274', 'DAMAGECOUNT': '3.195', 'FRAGCOUNT': '8.000'} [2023-02-24 18:41:01,334][177158] DAMAGECOUNT value on done: 158985.0 [2023-02-24 18:41:01,335][177158] Sum rewards: 12.370, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.045', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'weapon7': '0.048', 'AMMO3': '0.073', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.198', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'ARMOR': '0.450', 'WEAPON3': '0.500', 'weapon4': '0.670', 'HITCOUNT': '0.680', 'weapon2': '0.782', 'weapon3': '1.198', 'DAMAGECOUNT': '3.315', 'FRAGCOUNT': '9.000'} [2023-02-24 18:41:01,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13858.1, 300 sec: 13898.6). Total num frames: 65507328. Throughput: 0: 3470.8. Samples: 16378270. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 18:41:01,376][177119] Avg episode reward: [(0, '12.008')] [2023-02-24 18:41:02,191][177158] DAMAGECOUNT value on done: 165694.0 [2023-02-24 18:41:02,191][177158] Sum rewards: 13.070, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.673', 'AMMO5': '0.015', 'AMMO2': '0.022', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.083', 'weapon4': '0.084', 'AMMO4': '0.108', 'weapon5': '0.236', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.740', 'weapon3': '1.284', 'weapon2': '1.492', 'DAMAGECOUNT': '3.879', 'FRAGCOUNT': '10.000'} [2023-02-24 18:41:02,488][177158] DAMAGECOUNT value on done: 164205.0 [2023-02-24 18:41:02,489][177158] Sum rewards: 3.790, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.110', 'AMMO5': '0.015', 'AMMO2': '0.031', 'WEAPON1': '0.050', 'weapon5': '0.064', 'weapon7': '0.094', 'AMMO3': '0.149', 'AMMO4': '0.156', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'HITCOUNT': '0.630', 'WEAPON3': '1.000', 'weapon2': '1.318', 'weapon3': '1.524', 'DAMAGECOUNT': '2.610', 'FRAGCOUNT': '8.000'} [2023-02-24 18:41:03,243][177153] Updated weights for policy 0, policy_version 16000 (0.0008) [2023-02-24 18:41:04,036][177172] DAMAGECOUNT value on done: 163123.0 [2023-02-24 18:41:04,036][177172] Sum rewards: 13.008, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.472', 'AMMO2': '0.007', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.034', 'weapon5': '0.146', 'AMMO3': '0.149', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.360', 'WEAPON3': '0.950', 'HITCOUNT': '1.070', 'weapon2': '1.158', 'weapon3': '1.884', 'DAMAGECOUNT': '4.185', 'FRAGCOUNT': '13.000'} [2023-02-24 18:41:04,330][177172] DAMAGECOUNT value on done: 162662.0 [2023-02-24 18:41:04,331][177172] Sum rewards: 7.904, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.457', 'AMMO5': '0.015', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.077', 'AMMO3': '0.115', 'WEAPON4': '0.200', 'weapon5': '0.226', 'WEAPON5': '0.350', 'weapon4': '0.550', 'WEAPON3': '0.700', 'HITCOUNT': '0.790', 'weapon2': '0.854', 'ARMOR': '0.855', 'weapon3': '1.458', 'DAMAGECOUNT': '3.636', 'FRAGCOUNT': '7.500'} [2023-02-24 18:41:05,116][177154] DAMAGECOUNT value on done: 166327.0 [2023-02-24 18:41:05,117][177154] Sum rewards: 22.413, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.550', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'weapon7': '0.030', 'AMMO2': '0.038', 'AMMO3': '0.076', 'AMMO4': '0.192', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.210', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.502', 'WEAPON3': '0.550', 'HITCOUNT': '1.100', 'weapon2': '1.368', 'weapon3': '1.376', 'DAMAGECOUNT': '5.241', 'FRAGCOUNT': '20.000'} [2023-02-24 18:41:05,425][177154] DAMAGECOUNT value on done: 168232.0 [2023-02-24 18:41:05,426][177154] Sum rewards: 9.798, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.895', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.017', 'AMMO3': '0.040', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'weapon7': '0.148', 'weapon5': '0.202', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.336', 'WEAPON3': '0.350', 'HITCOUNT': '0.390', 'weapon3': '1.034', 'weapon2': '1.098', 'DAMAGECOUNT': '2.637', 'FRAGCOUNT': '7.000'} [2023-02-24 18:41:05,750][177154] DAMAGECOUNT value on done: 166604.0 [2023-02-24 18:41:05,750][177154] Sum rewards: 7.218, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.728', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.086', 'AMMO4': '0.118', 'weapon7': '0.140', 'WEAPON4': '0.150', 'weapon5': '0.160', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'HITCOUNT': '0.550', 'WEAPON3': '0.550', 'weapon4': '0.664', 'weapon2': '0.940', 'weapon3': '1.184', 'DAMAGECOUNT': '2.610', 'FRAGCOUNT': '6.500'} [2023-02-24 18:41:05,782][177172] DAMAGECOUNT value on done: 165287.0 [2023-02-24 18:41:05,783][177172] Sum rewards: 12.663, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.631', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.039', 'WEAPON1': '0.050', 'AMMO3': '0.099', 'WEAPON4': '0.150', 'weapon4': '0.216', 'weapon5': '0.284', 'WEAPON5': '0.450', 'ARMOR': '0.492', 'WEAPON3': '0.800', 'HITCOUNT': '0.880', 'weapon2': '1.006', 'weapon3': '2.040', 'DAMAGECOUNT': '4.014', 'FRAGCOUNT': '10.500'} [2023-02-24 18:41:06,048][177154] DAMAGECOUNT value on done: 169677.0 [2023-02-24 18:41:06,049][177154] Sum rewards: 13.153, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.091', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'weapon7': '0.038', 'AMMO4': '0.061', 'AMMO3': '0.087', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon5': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.380', 'WEAPON3': '0.550', 'HITCOUNT': '0.850', 'weapon2': '1.020', 'weapon3': '1.736', 'DAMAGECOUNT': '3.648', 'FRAGCOUNT': '9.000'} [2023-02-24 18:41:06,072][177172] DAMAGECOUNT value on done: 165865.0 [2023-02-24 18:41:06,072][177172] Sum rewards: 10.336, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.750', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.043', 'AMMO3': '0.050', 'weapon7': '0.050', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'weapon4': '0.570', 'HITCOUNT': '0.680', 'weapon3': '1.056', 'weapon2': '1.502', 'DAMAGECOUNT': '2.859', 'FRAGCOUNT': '9.000'} [2023-02-24 18:41:06,181][177153] Updated weights for policy 0, policy_version 16010 (0.0008) [2023-02-24 18:41:06,313][177157] DAMAGECOUNT value on done: 156030.0 [2023-02-24 18:41:06,314][177157] Sum rewards: 12.873, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.906', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'weapon7': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.117', 'weapon5': '0.202', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.730', 'weapon3': '1.148', 'weapon2': '1.658', 'DAMAGECOUNT': '2.898', 'FRAGCOUNT': '13.000'} [2023-02-24 18:41:06,325][177157] DAMAGECOUNT value on done: 170129.0 [2023-02-24 18:41:06,325][177157] Sum rewards: 9.456, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.238', 'AMMO2': '0.005', 'AMMO5': '0.018', 'AMMO4': '0.026', 'WEAPON1': '0.060', 'weapon7': '0.070', 'AMMO3': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.162', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.800', 'weapon3': '1.680', 'weapon2': '1.704', 'DAMAGECOUNT': '2.640', 'FRAGCOUNT': '7.000'} [2023-02-24 18:41:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13898.6). Total num frames: 65576960. Throughput: 0: 3471.7. Samples: 16388726. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 18:41:06,376][177119] Avg episode reward: [(0, '12.073')] [2023-02-24 18:41:06,599][177171] DAMAGECOUNT value on done: 157965.0 [2023-02-24 18:41:06,600][177171] Sum rewards: 8.914, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.259', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'weapon5': '0.052', 'weapon7': '0.058', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.270', 'WEAPON3': '0.350', 'HITCOUNT': '0.550', 'weapon2': '0.692', 'weapon3': '1.054', 'DAMAGECOUNT': '2.622', 'FRAGCOUNT': '8.000'} [2023-02-24 18:41:06,619][177157] DAMAGECOUNT value on done: 160157.0 [2023-02-24 18:41:06,619][177157] Sum rewards: 4.483, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'HEALTH': '0.046', 'AMMO3': '0.048', 'weapon7': '0.048', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.236', 'WEAPON3': '0.250', 'HITCOUNT': '0.300', 'weapon4': '0.340', 'weapon3': '0.634', 'DAMAGECOUNT': '1.476', 'weapon2': '1.770', 'FRAGCOUNT': '3.000'} [2023-02-24 18:41:06,629][177157] DAMAGECOUNT value on done: 160117.0 [2023-02-24 18:41:06,630][177157] Sum rewards: 19.627, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.126', 'AMMO2': '0.013', 'AMMO5': '0.028', 'ARMOR': '0.040', 'WEAPON1': '0.040', 'weapon7': '0.052', 'AMMO4': '0.063', 'weapon4': '0.156', 'weapon5': '0.168', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.600', 'weapon2': '0.948', 'WEAPON3': '1.150', 'HITCOUNT': '1.410', 'weapon3': '2.320', 'DAMAGECOUNT': '5.898', 'FRAGCOUNT': '18.000'} [2023-02-24 18:41:06,880][177171] DAMAGECOUNT value on done: 160249.0 [2023-02-24 18:41:06,881][177171] Sum rewards: 14.648, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.980', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon7': '0.052', 'AMMO3': '0.054', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.304', 'WEAPON3': '0.450', 'ARMOR': '0.481', 'HITCOUNT': '0.680', 'weapon3': '1.144', 'weapon2': '1.846', 'DAMAGECOUNT': '3.390', 'FRAGCOUNT': '10.000'} [2023-02-24 18:41:06,905][177171] DAMAGECOUNT value on done: 165504.0 [2023-02-24 18:41:06,906][177171] Sum rewards: 10.050, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.839', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.032', 'weapon7': '0.048', 'AMMO3': '0.076', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.478', 'weapon2': '0.526', 'WEAPON3': '0.550', 'HITCOUNT': '0.940', 'weapon3': '1.532', 'DAMAGECOUNT': '3.084', 'FRAGCOUNT': '8.000'} [2023-02-24 18:41:07,202][177171] DAMAGECOUNT value on done: 161588.0 [2023-02-24 18:41:07,203][177171] Sum rewards: 12.552, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.090', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'AMMO5': '0.020', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon5': '0.122', 'weapon4': '0.248', 'WEAPON5': '0.400', 'ARMOR': '0.457', 'WEAPON3': '0.700', 'weapon2': '0.898', 'HITCOUNT': '0.970', 'weapon3': '1.926', 'DAMAGECOUNT': '4.215', 'FRAGCOUNT': '11.000'} [2023-02-24 18:41:08,239][177155] DAMAGECOUNT value on done: 163669.0 [2023-02-24 18:41:08,240][177155] Sum rewards: 6.083, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.555', 'AMMO2': '0.010', 'AMMO5': '0.023', 'AMMO4': '0.051', 'WEAPON1': '0.070', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'weapon5': '0.200', 'weapon4': '0.292', 'ARMOR': '0.469', 'WEAPON5': '0.500', 'HITCOUNT': '0.690', 'WEAPON3': '0.750', 'weapon2': '1.126', 'weapon3': '2.038', 'DAMAGECOUNT': '3.390', 'FRAGCOUNT': '6.500'} [2023-02-24 18:41:08,544][177155] DAMAGECOUNT value on done: 168994.0 [2023-02-24 18:41:08,544][177155] Sum rewards: 9.101, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.690', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'AMMO3': '0.106', 'AMMO4': '0.134', 'weapon5': '0.144', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.430', 'HITCOUNT': '0.660', 'WEAPON3': '0.800', 'weapon3': '1.394', 'weapon2': '1.786', 'DAMAGECOUNT': '2.742', 'FRAGCOUNT': '8.000'} [2023-02-24 18:41:08,896][177155] DAMAGECOUNT value on done: 171098.0 [2023-02-24 18:41:08,896][177155] Sum rewards: 10.519, reward structure: {'DEATHCOUNT': '-4.500', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.061', 'AMMO4': '0.091', 'HEALTH': '0.173', 'weapon4': '0.244', 'weapon5': '0.340', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.730', 'weapon3': '1.490', 'weapon2': '1.574', 'DAMAGECOUNT': '3.456', 'FRAGCOUNT': '6.000'} [2023-02-24 18:41:09,117][177153] Updated weights for policy 0, policy_version 16020 (0.0008) [2023-02-24 18:41:09,200][177155] DAMAGECOUNT value on done: 160757.0 [2023-02-24 18:41:09,200][177155] Sum rewards: 20.684, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.176', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'AMMO3': '0.090', 'weapon5': '0.092', 'AMMO4': '0.093', 'weapon7': '0.122', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'WEAPON7': '0.400', 'WEAPON3': '0.600', 'weapon4': '0.782', 'ARMOR': '0.857', 'HITCOUNT': '1.100', 'weapon2': '1.214', 'weapon3': '1.492', 'DAMAGECOUNT': '4.479', 'FRAGCOUNT': '17.000'} [2023-02-24 18:41:11,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13898.6). Total num frames: 65646592. Throughput: 0: 3475.0. Samples: 16409596. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:41:11,376][177119] Avg episode reward: [(0, '11.975')] [2023-02-24 18:41:12,065][177153] Updated weights for policy 0, policy_version 16030 (0.0008) [2023-02-24 18:41:15,020][177153] Updated weights for policy 0, policy_version 16040 (0.0009) [2023-02-24 18:41:15,473][177156] DAMAGECOUNT value on done: 167114.0 [2023-02-24 18:41:15,474][177156] Sum rewards: 24.419, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.612', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.014', 'WEAPON1': '0.020', 'weapon4': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.128', 'weapon5': '0.164', 'WEAPON5': '0.400', 'weapon2': '0.844', 'WEAPON3': '0.900', 'HITCOUNT': '1.380', 'weapon3': '2.590', 'DAMAGECOUNT': '6.927', 'FRAGCOUNT': '20.000'} [2023-02-24 18:41:15,528][177156] DAMAGECOUNT value on done: 159878.0 [2023-02-24 18:41:15,528][177156] Sum rewards: 14.704, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.088', 'weapon7': '0.002', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'AMMO3': '0.098', 'AMMO4': '0.137', 'weapon5': '0.138', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.600', 'weapon2': '0.646', 'weapon4': '0.700', 'ARMOR': '0.835', 'HITCOUNT': '0.990', 'weapon3': '1.688', 'DAMAGECOUNT': '4.893', 'FRAGCOUNT': '12.000'} [2023-02-24 18:41:15,781][177156] DAMAGECOUNT value on done: 163071.0 [2023-02-24 18:41:15,782][177156] Sum rewards: 8.715, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.578', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon5': '0.090', 'AMMO3': '0.103', 'AMMO4': '0.132', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.516', 'WEAPON3': '0.600', 'HITCOUNT': '0.810', 'weapon3': '1.146', 'weapon2': '1.316', 'DAMAGECOUNT': '3.441', 'FRAGCOUNT': '8.000'} [2023-02-24 18:41:15,837][177156] DAMAGECOUNT value on done: 163809.0 [2023-02-24 18:41:15,838][177156] Sum rewards: 14.640, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.879', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO5': '0.027', 'AMMO4': '0.093', 'AMMO3': '0.097', 'weapon5': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'ARMOR': '0.478', 'weapon4': '0.540', 'WEAPON3': '0.700', 'weapon2': '1.008', 'HITCOUNT': '1.010', 'weapon3': '1.594', 'DAMAGECOUNT': '4.653', 'FRAGCOUNT': '11.000'} [2023-02-24 18:41:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13898.6). Total num frames: 65716224. Throughput: 0: 3474.5. Samples: 16430428. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:41:16,376][177119] Avg episode reward: [(0, '12.188')] [2023-02-24 18:41:17,978][177153] Updated weights for policy 0, policy_version 16050 (0.0008) [2023-02-24 18:41:18,836][177170] DAMAGECOUNT value on done: 163182.0 [2023-02-24 18:41:18,836][177170] Sum rewards: 10.419, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.675', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon7': '0.062', 'weapon5': '0.074', 'AMMO4': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.102', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'ARMOR': '0.484', 'weapon4': '0.566', 'WEAPON3': '0.700', 'HITCOUNT': '0.820', 'weapon2': '0.998', 'weapon3': '1.450', 'DAMAGECOUNT': '3.537', 'FRAGCOUNT': '9.000'} [2023-02-24 18:41:19,130][177170] DAMAGECOUNT value on done: 172563.0 [2023-02-24 18:41:19,131][177170] Sum rewards: 17.501, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.156', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.024', 'weapon7': '0.048', 'AMMO3': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.119', 'weapon4': '0.122', 'WEAPON4': '0.150', 'weapon5': '0.206', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '0.800', 'weapon3': '1.568', 'weapon2': '1.824', 'DAMAGECOUNT': '4.770', 'FRAGCOUNT': '12.000'} [2023-02-24 18:41:19,222][177170] DAMAGECOUNT value on done: 159650.0 [2023-02-24 18:41:19,223][177170] Sum rewards: 17.722, reward structure: {'DEATHCOUNT': '-9.000', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.025', 'weapon5': '0.072', 'weapon7': '0.074', 'AMMO3': '0.092', 'HEALTH': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.124', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.457', 'weapon2': '0.590', 'WEAPON3': '0.600', 'weapon4': '0.628', 'HITCOUNT': '1.310', 'weapon3': '2.116', 'DAMAGECOUNT': '5.451', 'FRAGCOUNT': '14.000'} [2023-02-24 18:41:19,520][177170] DAMAGECOUNT value on done: 160989.0 [2023-02-24 18:41:19,520][177170] Sum rewards: 15.532, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.776', 'AMMO2': '0.008', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO4': '0.038', 'weapon5': '0.094', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'weapon4': '0.390', 'WEAPON5': '0.500', 'weapon2': '0.504', 'WEAPON3': '1.100', 'HITCOUNT': '1.350', 'weapon3': '2.412', 'DAMAGECOUNT': '5.250', 'FRAGCOUNT': '15.000'} [2023-02-24 18:41:20,343][177158] DAMAGECOUNT value on done: 157562.0 [2023-02-24 18:41:20,344][177158] Sum rewards: 19.523, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.425', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO2': '0.040', 'AMMO3': '0.097', 'AMMO4': '0.200', 'weapon5': '0.252', 'weapon2': '0.358', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.650', 'weapon4': '0.792', 'HITCOUNT': '1.170', 'weapon3': '1.826', 'DAMAGECOUNT': '5.265', 'FRAGCOUNT': '17.000'} [2023-02-24 18:41:20,643][177158] DAMAGECOUNT value on done: 160632.0 [2023-02-24 18:41:20,643][177158] Sum rewards: 16.001, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.502', 'AMMO2': '0.014', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'weapon4': '0.054', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.132', 'weapon5': '0.198', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'weapon2': '0.958', 'HITCOUNT': '1.350', 'weapon3': '2.438', 'DAMAGECOUNT': '4.941', 'FRAGCOUNT': '15.500'} [2023-02-24 18:41:20,915][177153] Updated weights for policy 0, policy_version 16060 (0.0008) [2023-02-24 18:41:21,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 65785856. Throughput: 0: 3475.8. Samples: 16440888. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:41:21,376][177119] Avg episode reward: [(0, '12.307')] [2023-02-24 18:41:21,493][177158] DAMAGECOUNT value on done: 166861.0 [2023-02-24 18:41:21,493][177158] Sum rewards: 11.611, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.402', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon7': '0.050', 'AMMO3': '0.100', 'AMMO4': '0.102', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.292', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'ARMOR': '0.451', 'WEAPON3': '0.550', 'weapon4': '0.582', 'HITCOUNT': '0.790', 'weapon3': '1.134', 'weapon2': '1.378', 'DAMAGECOUNT': '3.501', 'FRAGCOUNT': '9.000'} [2023-02-24 18:41:21,787][177158] DAMAGECOUNT value on done: 164691.0 [2023-02-24 18:41:21,787][177158] Sum rewards: 1.312, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.200', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'WEAPON1': '0.020', 'AMMO5': '0.027', 'WEAPON4': '0.100', 'weapon4': '0.100', 'AMMO3': '0.129', 'weapon5': '0.136', 'HITCOUNT': '0.430', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.458', 'weapon3': '1.578', 'weapon2': '1.616', 'FRAGCOUNT': '4.000'} [2023-02-24 18:41:23,296][177172] DAMAGECOUNT value on done: 164413.0 [2023-02-24 18:41:23,296][177172] Sum rewards: 15.486, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.545', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.042', 'AMMO3': '0.071', 'weapon5': '0.110', 'weapon7': '0.140', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.548', 'HITCOUNT': '0.960', 'weapon3': '1.334', 'weapon2': '1.500', 'DAMAGECOUNT': '3.870', 'FRAGCOUNT': '11.000'} [2023-02-24 18:41:23,594][177172] DAMAGECOUNT value on done: 164258.0 [2023-02-24 18:41:23,595][177172] Sum rewards: 16.239, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.003', 'AMMO5': '0.012', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.098', 'AMMO3': '0.150', 'weapon5': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.512', 'WEAPON3': '0.950', 'weapon2': '0.996', 'HITCOUNT': '1.280', 'weapon3': '1.940', 'DAMAGECOUNT': '4.788', 'FRAGCOUNT': '14.000'} [2023-02-24 18:41:23,869][177153] Updated weights for policy 0, policy_version 16070 (0.0008) [2023-02-24 18:41:24,496][177154] DAMAGECOUNT value on done: 168042.0 [2023-02-24 18:41:24,496][177154] Sum rewards: 18.232, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.368', 'AMMO5': '0.015', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'AMMO3': '0.100', 'AMMO4': '0.134', 'weapon5': '0.178', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '0.550', 'weapon4': '0.824', 'ARMOR': '0.854', 'HITCOUNT': '1.050', 'weapon2': '1.084', 'weapon3': '1.380', 'DAMAGECOUNT': '5.124', 'FRAGCOUNT': '15.000'} [2023-02-24 18:41:24,800][177154] DAMAGECOUNT value on done: 170083.0 [2023-02-24 18:41:24,800][177154] Sum rewards: 14.682, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.440', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon7': '0.052', 'weapon5': '0.080', 'AMMO4': '0.139', 'AMMO3': '0.157', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.564', 'weapon4': '0.630', 'WEAPON3': '0.950', 'HITCOUNT': '1.330', 'weapon3': '2.310', 'DAMAGECOUNT': '5.553', 'FRAGCOUNT': '14.000'} [2023-02-24 18:41:25,037][177172] DAMAGECOUNT value on done: 166554.0 [2023-02-24 18:41:25,037][177172] Sum rewards: 11.864, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.390', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon7': '0.094', 'WEAPON4': '0.100', 'weapon5': '0.102', 'AMMO3': '0.142', 'WEAPON5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.450', 'WEAPON3': '0.850', 'HITCOUNT': '0.870', 'weapon2': '1.326', 'weapon3': '1.522', 'DAMAGECOUNT': '3.801', 'FRAGCOUNT': '11.000'} [2023-02-24 18:41:25,113][177154] DAMAGECOUNT value on done: 167617.0 [2023-02-24 18:41:25,114][177154] Sum rewards: 6.556, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.810', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'AMMO2': '0.039', 'AMMO3': '0.138', 'AMMO4': '0.197', 'weapon5': '0.332', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon4': '0.584', 'HITCOUNT': '0.770', 'weapon2': '0.802', 'WEAPON3': '0.900', 'weapon3': '1.762', 'DAMAGECOUNT': '3.039', 'FRAGCOUNT': '8.500'} [2023-02-24 18:41:25,336][177172] DAMAGECOUNT value on done: 166415.0 [2023-02-24 18:41:25,337][177172] Sum rewards: 5.680, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.466', 'ARMOR': '0.005', 'AMMO2': '0.015', 'weapon7': '0.058', 'AMMO3': '0.065', 'AMMO4': '0.073', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.346', 'WEAPON3': '0.400', 'weapon4': '0.404', 'HITCOUNT': '0.410', 'weapon3': '0.770', 'DAMAGECOUNT': '1.650', 'FRAGCOUNT': '6.000'} [2023-02-24 18:41:25,413][177154] DAMAGECOUNT value on done: 171240.0 [2023-02-24 18:41:25,414][177154] Sum rewards: 12.656, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.143', 'AMMO2': '0.007', 'AMMO5': '0.017', 'AMMO4': '0.034', 'weapon4': '0.104', 'weapon5': '0.112', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'WEAPON5': '0.400', 'WEAPON3': '0.950', 'HITCOUNT': '1.190', 'weapon2': '1.322', 'weapon3': '2.182', 'DAMAGECOUNT': '4.689', 'FRAGCOUNT': '11.500'} [2023-02-24 18:41:25,659][177157] DAMAGECOUNT value on done: 157511.0 [2023-02-24 18:41:25,660][177157] Sum rewards: 10.635, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.164', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO5': '0.027', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.141', 'weapon5': '0.224', 'weapon4': '0.290', 'ARMOR': '0.455', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'weapon2': '1.030', 'HITCOUNT': '1.190', 'weapon3': '2.140', 'DAMAGECOUNT': '4.443', 'FRAGCOUNT': '10.000'} [2023-02-24 18:41:25,670][177157] DAMAGECOUNT value on done: 171376.0 [2023-02-24 18:41:25,671][177157] Sum rewards: 6.777, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.032', 'AMMO2': '0.008', 'AMMO5': '0.025', 'AMMO4': '0.038', 'weapon7': '0.046', 'WEAPON4': '0.050', 'weapon5': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.183', 'weapon4': '0.320', 'WEAPON5': '0.500', 'weapon2': '0.508', 'HITCOUNT': '0.910', 'WEAPON3': '1.150', 'weapon3': '2.474', 'DAMAGECOUNT': '3.741', 'FRAGCOUNT': '9.500'} [2023-02-24 18:41:25,954][177171] DAMAGECOUNT value on done: 159038.0 [2023-02-24 18:41:25,955][177171] Sum rewards: 9.613, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.030', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'weapon7': '0.082', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.133', 'weapon5': '0.182', 'WEAPON7': '0.200', 'weapon4': '0.208', 'WEAPON5': '0.350', 'ARMOR': '0.458', 'HITCOUNT': '0.780', 'WEAPON3': '0.950', 'weapon2': '1.106', 'weapon3': '1.844', 'DAMAGECOUNT': '3.219', 'FRAGCOUNT': '10.000'} [2023-02-24 18:41:25,965][177157] DAMAGECOUNT value on done: 161496.0 [2023-02-24 18:41:25,966][177157] Sum rewards: 10.200, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.930', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.040', 'weapon7': '0.048', 'weapon4': '0.056', 'AMMO4': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'weapon5': '0.198', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'HITCOUNT': '0.900', 'weapon2': '1.406', 'weapon3': '1.874', 'DAMAGECOUNT': '4.017', 'FRAGCOUNT': '8.500'} [2023-02-24 18:41:25,977][177157] DAMAGECOUNT value on done: 162317.0 [2023-02-24 18:41:25,978][177157] Sum rewards: 23.923, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.835', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.127', 'weapon5': '0.142', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.800', 'weapon2': '1.332', 'HITCOUNT': '1.550', 'weapon3': '2.194', 'DAMAGECOUNT': '6.600', 'FRAGCOUNT': '19.500'} [2023-02-24 18:41:26,256][177171] DAMAGECOUNT value on done: 161429.0 [2023-02-24 18:41:26,257][177171] Sum rewards: 9.141, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.580', 'AMMO2': '0.020', 'weapon4': '0.026', 'AMMO5': '0.029', 'WEAPON1': '0.080', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'AMMO3': '0.135', 'weapon5': '0.258', 'HITCOUNT': '0.710', 'WEAPON5': '0.800', 'WEAPON3': '1.000', 'weapon2': '1.188', 'weapon3': '1.996', 'DAMAGECOUNT': '3.531', 'FRAGCOUNT': '10.000'} [2023-02-24 18:41:26,265][177171] DAMAGECOUNT value on done: 166999.0 [2023-02-24 18:41:26,266][177171] Sum rewards: 18.140, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.880', 'AMMO5': '0.012', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'weapon7': '0.064', 'AMMO3': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.126', 'AMMO4': '0.135', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.720', 'weapon4': '0.720', 'weapon2': '1.162', 'weapon3': '1.312', 'DAMAGECOUNT': '4.485', 'FRAGCOUNT': '15.000'} [2023-02-24 18:41:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 65855488. Throughput: 0: 3476.0. Samples: 16461708. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:41:26,376][177119] Avg episode reward: [(0, '12.599')] [2023-02-24 18:41:26,379][177140] Saving new best policy, reward=12.599! [2023-02-24 18:41:26,576][177171] DAMAGECOUNT value on done: 162678.0 [2023-02-24 18:41:26,576][177171] Sum rewards: 13.499, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.713', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.039', 'weapon7': '0.048', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.154', 'AMMO4': '0.193', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon4': '0.538', 'WEAPON3': '0.700', 'HITCOUNT': '0.880', 'weapon2': '0.892', 'weapon3': '1.910', 'DAMAGECOUNT': '3.270', 'FRAGCOUNT': '13.000'} [2023-02-24 18:41:26,803][177153] Updated weights for policy 0, policy_version 16080 (0.0008) [2023-02-24 18:41:27,601][177155] DAMAGECOUNT value on done: 165259.0 [2023-02-24 18:41:27,602][177155] Sum rewards: 13.085, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.540', 'AMMO2': '0.017', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'weapon5': '0.168', 'weapon4': '0.300', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.550', 'HITCOUNT': '1.180', 'WEAPON3': '1.200', 'weapon3': '2.634', 'DAMAGECOUNT': '4.770', 'FRAGCOUNT': '14.000'} [2023-02-24 18:41:27,773][177171] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:41:27,902][177155] DAMAGECOUNT value on done: 170529.0 [2023-02-24 18:41:27,902][177155] Sum rewards: 15.682, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.772', 'AMMO5': '0.008', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.068', 'AMMO3': '0.075', 'WEAPON5': '0.150', 'weapon7': '0.162', 'WEAPON4': '0.200', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON7': '0.500', 'WEAPON3': '0.550', 'weapon4': '0.630', 'HITCOUNT': '1.140', 'weapon2': '1.266', 'weapon3': '1.372', 'DAMAGECOUNT': '4.605', 'FRAGCOUNT': '11.000'} [2023-02-24 18:41:28,277][177155] DAMAGECOUNT value on done: 172625.0 [2023-02-24 18:41:28,278][177155] Sum rewards: 21.993, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.014', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon7': '0.052', 'AMMO4': '0.068', 'AMMO3': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.112', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.260', 'ARMOR': '0.491', 'WEAPON3': '0.650', 'HITCOUNT': '0.920', 'weapon2': '1.248', 'weapon3': '1.856', 'DAMAGECOUNT': '4.581', 'FRAGCOUNT': '17.000'} [2023-02-24 18:41:28,599][177155] DAMAGECOUNT value on done: 162386.0 [2023-02-24 18:41:28,599][177155] Sum rewards: 18.320, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.706', 'AMMO5': '0.017', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'weapon5': '0.046', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.152', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'weapon2': '1.240', 'HITCOUNT': '1.270', 'weapon3': '2.202', 'DAMAGECOUNT': '4.887', 'FRAGCOUNT': '15.000'} [2023-02-24 18:41:29,742][177153] Updated weights for policy 0, policy_version 16090 (0.0008) [2023-02-24 18:41:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 65925120. Throughput: 0: 3476.0. Samples: 16482610. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:41:31,376][177119] Avg episode reward: [(0, '12.899')] [2023-02-24 18:41:31,377][177140] Saving new best policy, reward=12.899! [2023-02-24 18:41:32,704][177153] Updated weights for policy 0, policy_version 16100 (0.0008) [2023-02-24 18:41:34,799][177156] DAMAGECOUNT value on done: 167764.0 [2023-02-24 18:41:34,799][177156] Sum rewards: 6.311, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.010', 'AMMO2': '0.016', 'ARMOR': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.041', 'weapon7': '0.050', 'AMMO4': '0.081', 'weapon5': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HEALTH': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.294', 'WEAPON3': '0.300', 'HITCOUNT': '0.400', 'weapon2': '0.776', 'weapon3': '0.892', 'DAMAGECOUNT': '1.950', 'FRAGCOUNT': '5.000'} [2023-02-24 18:41:34,831][177156] DAMAGECOUNT value on done: 161308.0 [2023-02-24 18:41:34,831][177156] Sum rewards: 15.150, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.984', 'AMMO5': '0.015', 'ARMOR': '0.020', 'AMMO2': '0.036', 'WEAPON1': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.101', 'AMMO4': '0.182', 'WEAPON4': '0.250', 'weapon5': '0.312', 'weapon4': '0.406', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.910', 'weapon2': '1.450', 'weapon3': '1.462', 'DAMAGECOUNT': '4.290', 'FRAGCOUNT': '12.000'} [2023-02-24 18:41:35,111][177156] DAMAGECOUNT value on done: 164471.0 [2023-02-24 18:41:35,111][177156] Sum rewards: 14.493, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.970', 'AMMO5': '0.020', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.102', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'weapon5': '0.184', 'weapon4': '0.304', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'weapon2': '0.908', 'HITCOUNT': '0.920', 'weapon3': '1.674', 'DAMAGECOUNT': '4.080', 'FRAGCOUNT': '13.000'} [2023-02-24 18:41:35,138][177156] DAMAGECOUNT value on done: 165418.0 [2023-02-24 18:41:35,139][177156] Sum rewards: 20.502, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.530', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.052', 'AMMO3': '0.104', 'weapon4': '0.124', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'HITCOUNT': '1.250', 'weapon3': '1.716', 'weapon2': '1.786', 'DAMAGECOUNT': '4.827', 'FRAGCOUNT': '16.000'} [2023-02-24 18:41:35,644][177153] Updated weights for policy 0, policy_version 16110 (0.0009) [2023-02-24 18:41:36,364][177157] Large shaping reward 3.620 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.021, -7.0), ('ARMOR', -0.001, -1.0), ('weapon5', 0.002)] [2023-02-24 18:41:36,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 65994752. Throughput: 0: 3476.3. Samples: 16492990. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:41:36,376][177119] Avg episode reward: [(0, '12.928')] [2023-02-24 18:41:36,380][177140] Saving new best policy, reward=12.928! [2023-02-24 18:41:38,147][177170] DAMAGECOUNT value on done: 164209.0 [2023-02-24 18:41:38,148][177170] Sum rewards: 12.940, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.156', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'AMMO4': '0.066', 'WEAPON4': '0.150', 'weapon5': '0.248', 'weapon4': '0.304', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'ARMOR': '0.456', 'HITCOUNT': '0.810', 'weapon3': '1.188', 'weapon2': '1.630', 'DAMAGECOUNT': '3.081', 'FRAGCOUNT': '9.000'} [2023-02-24 18:41:38,452][177170] DAMAGECOUNT value on done: 173152.0 [2023-02-24 18:41:38,452][177170] Sum rewards: 4.401, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.230', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.010', 'weapon7': '0.048', 'WEAPON1': '0.060', 'AMMO3': '0.069', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.130', 'weapon4': '0.248', 'WEAPON5': '0.300', 'HITCOUNT': '0.360', 'WEAPON3': '0.500', 'weapon3': '0.778', 'weapon2': '1.478', 'DAMAGECOUNT': '1.767', 'FRAGCOUNT': '4.000'} [2023-02-24 18:41:38,499][177170] DAMAGECOUNT value on done: 161002.0 [2023-02-24 18:41:38,499][177170] Sum rewards: 12.059, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.280', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.020', 'WEAPON1': '0.070', 'AMMO3': '0.086', 'weapon5': '0.286', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'HITCOUNT': '0.750', 'weapon2': '1.494', 'weapon3': '1.836', 'DAMAGECOUNT': '4.056', 'FRAGCOUNT': '9.500'} [2023-02-24 18:41:38,587][177153] Updated weights for policy 0, policy_version 16120 (0.0009) [2023-02-24 18:41:38,794][177170] DAMAGECOUNT value on done: 162512.0 [2023-02-24 18:41:38,794][177170] Sum rewards: 15.682, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.013', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.064', 'HEALTH': '0.126', 'AMMO3': '0.139', 'WEAPON4': '0.150', 'weapon5': '0.202', 'WEAPON5': '0.350', 'ARMOR': '0.412', 'weapon4': '0.432', 'WEAPON3': '0.800', 'weapon2': '0.818', 'HITCOUNT': '1.140', 'weapon3': '2.172', 'DAMAGECOUNT': '4.569', 'FRAGCOUNT': '12.500'} [2023-02-24 18:41:39,678][177158] DAMAGECOUNT value on done: 158478.0 [2023-02-24 18:41:39,678][177158] Sum rewards: 11.866, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.454', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.090', 'weapon7': '0.104', 'weapon5': '0.168', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.494', 'weapon4': '0.502', 'WEAPON3': '0.600', 'HITCOUNT': '0.730', 'weapon2': '0.922', 'weapon3': '1.830', 'DAMAGECOUNT': '2.748', 'FRAGCOUNT': '11.000'} [2023-02-24 18:41:39,974][177158] DAMAGECOUNT value on done: 161835.0 [2023-02-24 18:41:39,974][177158] Sum rewards: 14.798, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.090', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'AMMO3': '0.062', 'AMMO4': '0.139', 'weapon5': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.296', 'WEAPON3': '0.400', 'HITCOUNT': '0.830', 'weapon3': '1.156', 'weapon2': '1.860', 'DAMAGECOUNT': '3.609', 'FRAGCOUNT': '11.000'} [2023-02-24 18:41:40,812][177158] DAMAGECOUNT value on done: 168000.0 [2023-02-24 18:41:40,813][177158] Sum rewards: 12.722, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.995', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon7': '0.066', 'AMMO3': '0.077', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.135', 'weapon5': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.488', 'WEAPON3': '0.500', 'HITCOUNT': '0.960', 'weapon2': '1.088', 'weapon3': '1.446', 'DAMAGECOUNT': '3.417', 'FRAGCOUNT': '11.000'} [2023-02-24 18:41:41,098][177158] DAMAGECOUNT value on done: 165041.0 [2023-02-24 18:41:41,099][177158] Sum rewards: 1.336, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.895', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO3': '0.027', 'weapon7': '0.052', 'AMMO4': '0.068', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.250', 'weapon3': '0.310', 'weapon4': '0.380', 'weapon2': '0.986', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.050'} [2023-02-24 18:41:41,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 66064384. Throughput: 0: 3475.4. Samples: 16513864. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:41:41,376][177119] Avg episode reward: [(0, '12.697')] [2023-02-24 18:41:41,521][177153] Updated weights for policy 0, policy_version 16130 (0.0009) [2023-02-24 18:41:42,596][177172] DAMAGECOUNT value on done: 165972.0 [2023-02-24 18:41:42,596][177172] Sum rewards: 10.041, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.336', 'AMMO5': '0.015', 'AMMO2': '0.019', 'weapon4': '0.036', 'WEAPON1': '0.040', 'weapon5': '0.078', 'AMMO4': '0.095', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '1.220', 'weapon2': '1.308', 'weapon3': '2.308', 'DAMAGECOUNT': '4.677', 'FRAGCOUNT': '12.000'} [2023-02-24 18:41:42,890][177172] DAMAGECOUNT value on done: 165233.0 [2023-02-24 18:41:42,891][177172] Sum rewards: 10.345, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.250', 'AMMO5': '0.015', 'AMMO2': '0.030', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.127', 'weapon5': '0.142', 'AMMO4': '0.149', 'weapon4': '0.298', 'WEAPON5': '0.400', 'HITCOUNT': '0.690', 'weapon2': '0.792', 'WEAPON3': '0.900', 'weapon3': '1.930', 'DAMAGECOUNT': '2.925', 'FRAGCOUNT': '11.000'} [2023-02-24 18:41:43,229][177155] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:41:43,788][177154] DAMAGECOUNT value on done: 169968.0 [2023-02-24 18:41:43,789][177154] Sum rewards: 22.147, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.380', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.041', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.120', 'WEAPON3': '0.600', 'weapon2': '0.960', 'weapon3': '1.312', 'HITCOUNT': '1.340', 'DAMAGECOUNT': '5.778', 'FRAGCOUNT': '17.000'} [2023-02-24 18:41:44,091][177154] DAMAGECOUNT value on done: 171071.0 [2023-02-24 18:41:44,092][177154] Sum rewards: 9.536, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.875', 'AMMO2': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.036', 'weapon7': '0.048', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.146', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.286', 'weapon2': '0.360', 'WEAPON3': '0.600', 'HITCOUNT': '0.700', 'weapon3': '1.342', 'DAMAGECOUNT': '2.964', 'FRAGCOUNT': '9.000'} [2023-02-24 18:41:44,360][177172] DAMAGECOUNT value on done: 167081.0 [2023-02-24 18:41:44,360][177172] Sum rewards: 4.218, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.043', 'weapon5': '0.048', 'HEALTH': '0.091', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'weapon7': '0.128', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'weapon2': '0.380', 'HITCOUNT': '0.430', 'ARMOR': '0.463', 'weapon4': '0.654', 'weapon3': '0.788', 'DAMAGECOUNT': '1.581', 'FRAGCOUNT': '2.000'} [2023-02-24 18:41:44,414][177154] DAMAGECOUNT value on done: 169328.0 [2023-02-24 18:41:44,414][177154] Sum rewards: 15.550, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.376', 'AMMO5': '0.015', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'AMMO4': '0.102', 'AMMO3': '0.103', 'weapon7': '0.132', 'weapon5': '0.136', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.628', 'WEAPON3': '0.750', 'weapon2': '0.912', 'HITCOUNT': '1.110', 'weapon3': '1.814', 'DAMAGECOUNT': '5.133', 'FRAGCOUNT': '13.000'} [2023-02-24 18:41:44,439][177153] Updated weights for policy 0, policy_version 16140 (0.0008) [2023-02-24 18:41:44,666][177172] DAMAGECOUNT value on done: 167472.0 [2023-02-24 18:41:44,667][177172] Sum rewards: 10.501, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.486', 'AMMO5': '0.023', 'WEAPON1': '0.040', 'AMMO2': '0.040', 'weapon5': '0.048', 'weapon7': '0.098', 'AMMO3': '0.160', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'AMMO4': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'HITCOUNT': '0.700', 'weapon2': '0.764', 'weapon4': '0.824', 'WEAPON3': '0.950', 'weapon3': '1.718', 'DAMAGECOUNT': '3.171', 'FRAGCOUNT': '11.000'} [2023-02-24 18:41:44,717][177154] DAMAGECOUNT value on done: 172468.0 [2023-02-24 18:41:44,718][177154] Sum rewards: 11.302, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.507', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.018', 'WEAPON1': '0.020', 'AMMO3': '0.092', 'weapon5': '0.150', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.398', 'WEAPON3': '0.650', 'ARMOR': '0.929', 'HITCOUNT': '0.960', 'weapon3': '1.418', 'weapon2': '1.478', 'DAMAGECOUNT': '3.684', 'FRAGCOUNT': '10.000'} [2023-02-24 18:41:44,913][177157] DAMAGECOUNT value on done: 158625.0 [2023-02-24 18:41:44,914][177157] Sum rewards: 12.750, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.092', 'ARMOR': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon7': '0.056', 'AMMO3': '0.060', 'weapon5': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.116', 'AMMO4': '0.125', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'HITCOUNT': '0.900', 'weapon3': '1.338', 'weapon2': '1.594', 'DAMAGECOUNT': '3.342', 'FRAGCOUNT': '10.000'} [2023-02-24 18:41:44,961][177157] DAMAGECOUNT value on done: 171819.0 [2023-02-24 18:41:44,961][177157] Sum rewards: 3.529, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.003', 'AMMO2': '0.019', 'AMMO3': '0.044', 'WEAPON5': '0.050', 'weapon7': '0.054', 'AMMO4': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon2': '0.106', 'WEAPON4': '0.200', 'WEAPON3': '0.250', 'HITCOUNT': '0.380', 'weapon3': '0.406', 'HEALTH': '0.592', 'weapon4': '0.702', 'DAMAGECOUNT': '1.329', 'FRAGCOUNT': '2.000'} [2023-02-24 18:41:45,239][177157] DAMAGECOUNT value on done: 162855.0 [2023-02-24 18:41:45,239][177157] Sum rewards: 16.207, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.259', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'AMMO3': '0.065', 'weapon7': '0.096', 'AMMO4': '0.112', 'weapon5': '0.178', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.350', 'WEAPON4': '0.400', 'WEAPON7': '0.400', 'weapon4': '0.758', 'HITCOUNT': '0.830', 'weapon3': '1.148', 'weapon2': '1.156', 'DAMAGECOUNT': '3.717', 'FRAGCOUNT': '14.000'} [2023-02-24 18:41:45,274][177157] DAMAGECOUNT value on done: 163416.0 [2023-02-24 18:41:45,275][177157] Sum rewards: 10.636, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.474', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon7': '0.046', 'WEAPON1': '0.050', 'AMMO4': '0.068', 'weapon5': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.436', 'weapon4': '0.608', 'WEAPON3': '0.750', 'HITCOUNT': '0.840', 'weapon2': '0.934', 'weapon3': '1.678', 'DAMAGECOUNT': '3.297', 'FRAGCOUNT': '9.500'} [2023-02-24 18:41:45,290][177171] DAMAGECOUNT value on done: 160591.0 [2023-02-24 18:41:45,291][177171] Sum rewards: 13.714, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.742', 'AMMO2': '0.014', 'AMMO5': '0.023', 'weapon7': '0.038', 'WEAPON1': '0.050', 'AMMO4': '0.070', 'weapon5': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.153', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.500', 'weapon4': '0.536', 'weapon2': '0.756', 'ARMOR': '0.918', 'WEAPON3': '1.050', 'HITCOUNT': '1.210', 'weapon3': '2.152', 'DAMAGECOUNT': '4.659', 'FRAGCOUNT': '14.000'} [2023-02-24 18:41:45,585][177171] DAMAGECOUNT value on done: 162571.0 [2023-02-24 18:41:45,586][177171] Sum rewards: 12.354, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.570', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.027', 'WEAPON1': '0.030', 'weapon7': '0.058', 'weapon2': '0.066', 'AMMO3': '0.071', 'weapon5': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.408', 'WEAPON3': '0.450', 'HITCOUNT': '0.760', 'weapon3': '0.916', 'DAMAGECOUNT': '3.399', 'FRAGCOUNT': '11.000'} [2023-02-24 18:41:45,597][177171] DAMAGECOUNT value on done: 169068.0 [2023-02-24 18:41:45,597][177171] Sum rewards: 21.609, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.868', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon5': '0.112', 'AMMO4': '0.119', 'AMMO3': '0.121', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.452', 'weapon4': '0.570', 'weapon2': '0.730', 'WEAPON3': '0.900', 'HITCOUNT': '1.540', 'weapon3': '2.274', 'DAMAGECOUNT': '6.207', 'FRAGCOUNT': '19.000'} [2023-02-24 18:41:45,890][177171] DAMAGECOUNT value on done: 163656.0 [2023-02-24 18:41:45,890][177171] Sum rewards: 10.734, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.412', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon5': '0.106', 'AMMO3': '0.141', 'AMMO4': '0.163', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon4': '0.716', 'WEAPON3': '0.900', 'HITCOUNT': '0.920', 'weapon2': '0.932', 'weapon3': '1.936', 'DAMAGECOUNT': '2.934', 'FRAGCOUNT': '12.000'} [2023-02-24 18:41:46,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 66134016. Throughput: 0: 3478.3. Samples: 16534794. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:41:46,376][177119] Avg episode reward: [(0, '12.378')] [2023-02-24 18:41:46,869][177155] DAMAGECOUNT value on done: 166614.0 [2023-02-24 18:41:46,869][177155] Sum rewards: 15.140, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.370', 'AMMO2': '0.015', 'AMMO5': '0.015', 'weapon7': '0.048', 'WEAPON1': '0.070', 'AMMO4': '0.074', 'AMMO3': '0.085', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.228', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.720', 'weapon2': '1.512', 'weapon3': '1.512', 'DAMAGECOUNT': '4.041', 'FRAGCOUNT': '11.000'} [2023-02-24 18:41:47,174][177155] DAMAGECOUNT value on done: 171232.0 [2023-02-24 18:41:47,174][177155] Sum rewards: 3.136, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.430', 'AMMO5': '0.013', 'WEAPON1': '0.030', 'AMMO2': '0.037', 'weapon5': '0.070', 'AMMO3': '0.091', 'weapon7': '0.102', 'AMMO4': '0.184', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HITCOUNT': '0.530', 'weapon2': '0.570', 'WEAPON3': '0.650', 'weapon4': '0.770', 'weapon3': '1.510', 'DAMAGECOUNT': '2.109', 'FRAGCOUNT': '5.000'} [2023-02-24 18:41:47,405][177153] Updated weights for policy 0, policy_version 16150 (0.0008) [2023-02-24 18:41:47,606][177155] DAMAGECOUNT value on done: 173555.0 [2023-02-24 18:41:47,606][177155] Sum rewards: 10.483, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.045', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.012', 'AMMO3': '0.056', 'WEAPON1': '0.060', 'WEAPON4': '0.150', 'weapon5': '0.272', 'weapon4': '0.316', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.590', 'weapon3': '1.002', 'weapon2': '1.196', 'DAMAGECOUNT': '2.790', 'FRAGCOUNT': '8.000'} [2023-02-24 18:41:47,905][177155] DAMAGECOUNT value on done: 163836.0 [2023-02-24 18:41:47,905][177155] Sum rewards: 12.617, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.240', 'AMMO2': '0.018', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'weapon7': '0.058', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.129', 'weapon5': '0.146', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.284', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'weapon2': '1.056', 'HITCOUNT': '1.190', 'weapon3': '2.048', 'DAMAGECOUNT': '4.350', 'FRAGCOUNT': '10.000'} [2023-02-24 18:41:50,322][177153] Updated weights for policy 0, policy_version 16160 (0.0009) [2023-02-24 18:41:51,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 66203648. Throughput: 0: 3478.4. Samples: 16545254. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:41:51,376][177119] Avg episode reward: [(0, '12.332')] [2023-02-24 18:41:53,238][177153] Updated weights for policy 0, policy_version 16170 (0.0008) [2023-02-24 18:41:54,184][177156] DAMAGECOUNT value on done: 168564.0 [2023-02-24 18:41:54,184][177156] Sum rewards: 6.173, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.003', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon7': '0.048', 'AMMO3': '0.077', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.122', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'weapon2': '0.672', 'HITCOUNT': '0.690', 'weapon4': '0.810', 'weapon3': '1.094', 'DAMAGECOUNT': '2.400', 'FRAGCOUNT': '8.000'} [2023-02-24 18:41:54,211][177156] DAMAGECOUNT value on done: 162543.0 [2023-02-24 18:41:54,211][177156] Sum rewards: 8.230, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.055', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'weapon7': '0.052', 'AMMO4': '0.063', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'weapon4': '0.410', 'WEAPON3': '0.800', 'weapon2': '1.060', 'HITCOUNT': '1.090', 'weapon3': '2.062', 'DAMAGECOUNT': '3.705', 'FRAGCOUNT': '7.000'} [2023-02-24 18:41:54,488][177156] DAMAGECOUNT value on done: 166274.0 [2023-02-24 18:41:54,489][177156] Sum rewards: 18.119, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.041', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'AMMO3': '0.127', 'AMMO4': '0.165', 'weapon5': '0.212', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon2': '0.670', 'weapon4': '0.688', 'WEAPON3': '0.800', 'HITCOUNT': '1.510', 'weapon3': '1.962', 'DAMAGECOUNT': '5.409', 'FRAGCOUNT': '17.000'} [2023-02-24 18:41:54,520][177156] DAMAGECOUNT value on done: 166766.0 [2023-02-24 18:41:54,521][177156] Sum rewards: 12.808, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.440', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.132', 'weapon5': '0.146', 'WEAPON5': '0.250', 'weapon4': '0.264', 'ARMOR': '0.459', 'weapon2': '0.700', 'HITCOUNT': '0.930', 'WEAPON3': '1.000', 'weapon3': '2.424', 'DAMAGECOUNT': '4.044', 'FRAGCOUNT': '12.000'} [2023-02-24 18:41:56,158][177153] Updated weights for policy 0, policy_version 16180 (0.0008) [2023-02-24 18:41:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 66273280. Throughput: 0: 3481.2. Samples: 16566252. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:41:56,376][177119] Avg episode reward: [(0, '12.312')] [2023-02-24 18:41:57,290][177170] DAMAGECOUNT value on done: 165934.0 [2023-02-24 18:41:57,291][177170] Sum rewards: 17.114, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.820', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON1': '0.060', 'weapon5': '0.062', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon4': '0.306', 'weapon2': '1.186', 'WEAPON3': '1.300', 'HITCOUNT': '1.370', 'weapon3': '2.126', 'DAMAGECOUNT': '5.175', 'FRAGCOUNT': '19.000'} [2023-02-24 18:41:57,592][177170] DAMAGECOUNT value on done: 174444.0 [2023-02-24 18:41:57,593][177170] Sum rewards: 8.026, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.566', 'AMMO5': '0.023', 'AMMO2': '0.027', 'WEAPON1': '0.090', 'AMMO3': '0.091', 'AMMO4': '0.136', 'weapon4': '0.314', 'WEAPON4': '0.350', 'weapon5': '0.386', 'ARMOR': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '0.820', 'weapon2': '0.952', 'weapon3': '1.926', 'DAMAGECOUNT': '3.876', 'FRAGCOUNT': '8.000'} [2023-02-24 18:41:57,670][177170] DAMAGECOUNT value on done: 162134.0 [2023-02-24 18:41:57,670][177170] Sum rewards: 6.515, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.094', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon7': '0.052', 'WEAPON1': '0.070', 'weapon5': '0.080', 'AMMO4': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.149', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.512', 'weapon4': '0.562', 'HITCOUNT': '0.920', 'WEAPON3': '1.000', 'weapon3': '2.010', 'DAMAGECOUNT': '3.396', 'FRAGCOUNT': '10.000'} [2023-02-24 18:41:57,967][177170] DAMAGECOUNT value on done: 163122.0 [2023-02-24 18:41:57,967][177170] Sum rewards: 4.103, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.330', 'AMMO5': '0.010', 'AMMO2': '0.010', 'WEAPON1': '0.040', 'AMMO4': '0.050', 'weapon7': '0.058', 'AMMO3': '0.068', 'weapon5': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.360', 'WEAPON3': '0.500', 'weapon4': '0.542', 'ARMOR': '0.892', 'weapon2': '0.964', 'weapon3': '1.014', 'DAMAGECOUNT': '1.830', 'FRAGCOUNT': '4.000'} [2023-02-24 18:41:58,907][177158] DAMAGECOUNT value on done: 159830.0 [2023-02-24 18:41:58,907][177158] Sum rewards: 15.269, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.472', 'ARMOR': '0.004', 'AMMO2': '0.011', 'AMMO5': '0.022', 'weapon7': '0.036', 'AMMO4': '0.053', 'WEAPON1': '0.070', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'weapon4': '0.124', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon5': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '0.820', 'weapon2': '1.178', 'weapon3': '1.798', 'DAMAGECOUNT': '4.056', 'FRAGCOUNT': '12.000'} [2023-02-24 18:41:59,095][177153] Updated weights for policy 0, policy_version 16190 (0.0009) [2023-02-24 18:41:59,209][177158] DAMAGECOUNT value on done: 163178.0 [2023-02-24 18:41:59,210][177158] Sum rewards: 15.729, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.015', 'AMMO2': '0.007', 'AMMO5': '0.022', 'AMMO4': '0.035', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO3': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.306', 'ARMOR': '0.458', 'weapon4': '0.544', 'WEAPON5': '0.550', 'weapon2': '0.554', 'WEAPON3': '0.850', 'HITCOUNT': '0.940', 'weapon3': '1.796', 'DAMAGECOUNT': '4.029', 'FRAGCOUNT': '15.000'} [2023-02-24 18:42:00,094][177158] DAMAGECOUNT value on done: 169675.0 [2023-02-24 18:42:00,095][177158] Sum rewards: 11.765, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.740', 'AMMO2': '0.017', 'AMMO5': '0.025', 'WEAPON1': '0.060', 'AMMO4': '0.083', 'weapon5': '0.094', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.500', 'weapon4': '0.540', 'weapon2': '0.980', 'WEAPON3': '1.100', 'HITCOUNT': '1.270', 'weapon3': '1.936', 'DAMAGECOUNT': '5.025', 'FRAGCOUNT': '13.000'} [2023-02-24 18:42:00,399][177158] DAMAGECOUNT value on done: 166221.0 [2023-02-24 18:42:00,399][177158] Sum rewards: 13.389, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.860', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO2': '0.041', 'weapon7': '0.050', 'AMMO3': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO4': '0.206', 'weapon5': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'ARMOR': '0.800', 'HITCOUNT': '0.830', 'weapon4': '0.836', 'weapon3': '1.068', 'weapon2': '1.192', 'DAMAGECOUNT': '3.540', 'FRAGCOUNT': '11.000'} [2023-02-24 18:42:01,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 66342912. Throughput: 0: 3481.7. Samples: 16587102. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:42:01,376][177119] Avg episode reward: [(0, '12.352')] [2023-02-24 18:42:01,829][177172] DAMAGECOUNT value on done: 167512.0 [2023-02-24 18:42:01,830][177172] Sum rewards: 17.411, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.435', 'AMMO2': '0.007', 'AMMO5': '0.018', 'AMMO4': '0.033', 'weapon7': '0.048', 'WEAPON1': '0.060', 'AMMO3': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.386', 'WEAPON3': '0.600', 'ARMOR': '0.901', 'HITCOUNT': '1.180', 'weapon2': '1.194', 'weapon3': '1.554', 'DAMAGECOUNT': '4.620', 'FRAGCOUNT': '14.000'} [2023-02-24 18:42:02,062][177153] Updated weights for policy 0, policy_version 16200 (0.0008) [2023-02-24 18:42:02,125][177172] DAMAGECOUNT value on done: 166463.0 [2023-02-24 18:42:02,126][177172] Sum rewards: 12.042, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.976', 'AMMO2': '0.009', 'AMMO5': '0.014', 'AMMO4': '0.044', 'WEAPON1': '0.060', 'weapon4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.161', 'weapon5': '0.268', 'WEAPON5': '0.400', 'HITCOUNT': '0.930', 'WEAPON3': '0.950', 'weapon2': '1.286', 'weapon3': '2.010', 'DAMAGECOUNT': '3.690', 'FRAGCOUNT': '12.000'} [2023-02-24 18:42:03,085][177154] DAMAGECOUNT value on done: 171530.0 [2023-02-24 18:42:03,086][177154] Sum rewards: 20.711, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '0.014', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'weapon7': '0.058', 'WEAPON1': '0.060', 'AMMO3': '0.080', 'AMMO4': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.154', 'weapon5': '0.170', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '1.230', 'weapon2': '1.278', 'weapon3': '1.806', 'DAMAGECOUNT': '4.686', 'FRAGCOUNT': '15.000'} [2023-02-24 18:42:03,401][177154] DAMAGECOUNT value on done: 171740.0 [2023-02-24 18:42:03,401][177154] Sum rewards: 5.128, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.634', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.046', 'AMMO3': '0.085', 'weapon5': '0.102', 'weapon7': '0.152', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'AMMO4': '0.231', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'ARMOR': '0.457', 'weapon4': '0.574', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'weapon2': '0.862', 'weapon3': '1.136', 'DAMAGECOUNT': '2.007', 'FRAGCOUNT': '6.000'} [2023-02-24 18:42:03,654][177172] DAMAGECOUNT value on done: 167957.0 [2023-02-24 18:42:03,654][177172] Sum rewards: 8.589, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.246', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon7': '0.062', 'AMMO3': '0.076', 'AMMO4': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.242', 'WEAPON4': '0.300', 'weapon4': '0.436', 'WEAPON3': '0.500', 'HITCOUNT': '0.580', 'weapon2': '0.698', 'weapon3': '0.838', 'DAMAGECOUNT': '2.628', 'FRAGCOUNT': '8.000'} [2023-02-24 18:42:03,719][177154] DAMAGECOUNT value on done: 170544.0 [2023-02-24 18:42:03,719][177154] Sum rewards: 13.128, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.046', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'HEALTH': '0.145', 'AMMO4': '0.167', 'weapon7': '0.178', 'WEAPON4': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'weapon2': '0.630', 'HITCOUNT': '0.890', 'weapon4': '0.934', 'weapon3': '1.232', 'DAMAGECOUNT': '3.648', 'FRAGCOUNT': '10.000'} [2023-02-24 18:42:03,956][177172] DAMAGECOUNT value on done: 168656.0 [2023-02-24 18:42:03,956][177172] Sum rewards: 10.723, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.741', 'AMMO5': '0.019', 'WEAPON1': '0.030', 'AMMO2': '0.034', 'AMMO3': '0.109', 'AMMO4': '0.171', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon5': '0.324', 'weapon4': '0.416', 'ARMOR': '0.455', 'HITCOUNT': '0.640', 'WEAPON3': '0.650', 'weapon3': '1.274', 'weapon2': '1.490', 'DAMAGECOUNT': '3.552', 'FRAGCOUNT': '10.000'} [2023-02-24 18:42:04,018][177154] DAMAGECOUNT value on done: 173729.0 [2023-02-24 18:42:04,019][177154] Sum rewards: 10.827, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.948', 'AMMO2': '0.015', 'AMMO5': '0.017', 'weapon7': '0.048', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO4': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.146', 'AMMO3': '0.163', 'weapon4': '0.230', 'WEAPON5': '0.450', 'weapon2': '0.610', 'HITCOUNT': '1.020', 'WEAPON3': '1.050', 'weapon3': '2.246', 'DAMAGECOUNT': '3.783', 'FRAGCOUNT': '12.000'} [2023-02-24 18:42:04,211][177157] DAMAGECOUNT value on done: 159389.0 [2023-02-24 18:42:04,212][177157] Sum rewards: 9.295, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.699', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon7': '0.048', 'AMMO4': '0.049', 'AMMO3': '0.050', 'WEAPON1': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.168', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'HITCOUNT': '0.490', 'weapon3': '1.230', 'weapon2': '1.460', 'DAMAGECOUNT': '2.292', 'FRAGCOUNT': '6.000'} [2023-02-24 18:42:04,234][177157] DAMAGECOUNT value on done: 172876.0 [2023-02-24 18:42:04,234][177157] Sum rewards: 7.495, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.665', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'WEAPON1': '0.040', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'weapon5': '0.144', 'WEAPON5': '0.200', 'weapon4': '0.214', 'WEAPON3': '0.600', 'HITCOUNT': '0.820', 'weapon2': '0.848', 'weapon3': '1.182', 'DAMAGECOUNT': '3.171', 'FRAGCOUNT': '6.000'} [2023-02-24 18:42:04,517][177157] DAMAGECOUNT value on done: 163396.0 [2023-02-24 18:42:04,517][177157] Sum rewards: 7.785, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.780', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.012', 'weapon7': '0.050', 'AMMO3': '0.070', 'WEAPON1': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.230', 'HITCOUNT': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'weapon3': '1.582', 'DAMAGECOUNT': '1.623', 'weapon2': '1.640', 'FRAGCOUNT': '6.000'} [2023-02-24 18:42:04,537][177157] DAMAGECOUNT value on done: 164436.0 [2023-02-24 18:42:04,537][177157] Sum rewards: 8.073, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.078', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon7': '0.048', 'WEAPON1': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.103', 'AMMO4': '0.181', 'weapon5': '0.320', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.368', 'WEAPON3': '0.600', 'HITCOUNT': '0.650', 'weapon2': '1.008', 'weapon3': '1.702', 'DAMAGECOUNT': '3.060', 'FRAGCOUNT': '8.000'} [2023-02-24 18:42:04,635][177171] DAMAGECOUNT value on done: 162026.0 [2023-02-24 18:42:04,635][177171] Sum rewards: 14.544, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.378', 'weapon7': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.030', 'WEAPON1': '0.040', 'AMMO3': '0.094', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.148', 'weapon5': '0.340', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'ARMOR': '0.456', 'WEAPON3': '0.600', 'weapon4': '0.698', 'weapon2': '0.782', 'HITCOUNT': '1.010', 'weapon3': '1.592', 'DAMAGECOUNT': '4.305', 'FRAGCOUNT': '12.000'} [2023-02-24 18:42:04,933][177171] DAMAGECOUNT value on done: 164061.0 [2023-02-24 18:42:04,933][177171] Sum rewards: 16.528, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.834', 'AMMO2': '0.004', 'AMMO5': '0.014', 'AMMO4': '0.022', 'WEAPON1': '0.060', 'AMMO3': '0.146', 'weapon5': '0.222', 'WEAPON5': '0.300', 'weapon2': '0.602', 'WEAPON3': '0.850', 'HITCOUNT': '1.210', 'weapon3': '2.712', 'DAMAGECOUNT': '4.470', 'FRAGCOUNT': '15.000'} [2023-02-24 18:42:04,943][177171] DAMAGECOUNT value on done: 170608.0 [2023-02-24 18:42:04,944][177171] Sum rewards: 18.400, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.128', 'WEAPON5': '0.200', 'weapon4': '0.250', 'weapon5': '0.286', 'weapon2': '0.436', 'WEAPON3': '0.700', 'HEALTH': '0.716', 'HITCOUNT': '1.110', 'weapon3': '2.020', 'DAMAGECOUNT': '4.620', 'FRAGCOUNT': '16.000'} [2023-02-24 18:42:05,052][177153] Updated weights for policy 0, policy_version 16210 (0.0008) [2023-02-24 18:42:05,241][177171] DAMAGECOUNT value on done: 164643.0 [2023-02-24 18:42:05,241][177171] Sum rewards: 9.029, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.481', 'AMMO2': '0.013', 'AMMO5': '0.030', 'weapon7': '0.052', 'AMMO4': '0.063', 'WEAPON1': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.125', 'WEAPON4': '0.200', 'weapon5': '0.296', 'weapon4': '0.360', 'ARMOR': '0.460', 'WEAPON5': '0.600', 'HITCOUNT': '0.800', 'weapon2': '0.880', 'WEAPON3': '0.900', 'weapon3': '1.390', 'DAMAGECOUNT': '2.961', 'FRAGCOUNT': '9.500'} [2023-02-24 18:42:06,214][177155] DAMAGECOUNT value on done: 167991.0 [2023-02-24 18:42:06,214][177155] Sum rewards: 13.810, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.443', 'AMMO2': '0.004', 'AMMO5': '0.015', 'AMMO4': '0.018', 'ARMOR': '0.032', 'WEAPON1': '0.050', 'AMMO3': '0.097', 'weapon4': '0.190', 'WEAPON4': '0.200', 'weapon5': '0.390', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'HITCOUNT': '0.830', 'weapon2': '1.266', 'weapon3': '1.780', 'DAMAGECOUNT': '4.131', 'FRAGCOUNT': '11.000'} [2023-02-24 18:42:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 66412544. Throughput: 0: 3478.8. Samples: 16597436. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:42:06,376][177119] Avg episode reward: [(0, '12.477')] [2023-02-24 18:42:06,516][177155] DAMAGECOUNT value on done: 172710.0 [2023-02-24 18:42:06,517][177155] Sum rewards: 14.182, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.585', 'AMMO5': '0.015', 'AMMO2': '0.015', 'WEAPON1': '0.050', 'weapon7': '0.050', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.124', 'WEAPON7': '0.200', 'weapon5': '0.278', 'weapon4': '0.314', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'weapon2': '0.882', 'HITCOUNT': '1.080', 'weapon3': '2.010', 'DAMAGECOUNT': '4.434', 'FRAGCOUNT': '12.000'} [2023-02-24 18:42:06,958][177155] DAMAGECOUNT value on done: 174404.0 [2023-02-24 18:42:06,959][177155] Sum rewards: 3.264, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.750', 'AMMO2': '0.016', 'AMMO5': '0.022', 'weapon7': '0.056', 'WEAPON1': '0.070', 'ARMOR': '0.076', 'AMMO4': '0.081', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.232', 'WEAPON4': '0.300', 'weapon4': '0.370', 'weapon2': '0.446', 'HITCOUNT': '0.480', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'weapon3': '1.686', 'DAMAGECOUNT': '2.535', 'FRAGCOUNT': '5.000'} [2023-02-24 18:42:07,262][177155] DAMAGECOUNT value on done: 165039.0 [2023-02-24 18:42:07,263][177155] Sum rewards: 11.443, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.872', 'AMMO2': '0.021', 'AMMO5': '0.022', 'weapon4': '0.048', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'WEAPON1': '0.110', 'AMMO3': '0.123', 'weapon5': '0.336', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'HITCOUNT': '0.910', 'weapon2': '0.926', 'weapon3': '2.204', 'DAMAGECOUNT': '3.309', 'FRAGCOUNT': '11.000'} [2023-02-24 18:42:07,967][177153] Updated weights for policy 0, policy_version 16220 (0.0008) [2023-02-24 18:42:10,732][177171] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:42:10,915][177153] Updated weights for policy 0, policy_version 16230 (0.0009) [2023-02-24 18:42:11,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 66482176. Throughput: 0: 3478.1. Samples: 16618224. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:42:11,376][177119] Avg episode reward: [(0, '12.393')] [2023-02-24 18:42:13,592][177156] DAMAGECOUNT value on done: 169858.0 [2023-02-24 18:42:13,593][177156] Sum rewards: 8.960, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.580', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO2': '0.058', 'AMMO3': '0.076', 'WEAPON5': '0.250', 'weapon5': '0.266', 'AMMO4': '0.292', 'ARMOR': '0.460', 'WEAPON3': '0.500', 'WEAPON4': '0.700', 'weapon4': '0.904', 'weapon3': '1.104', 'HITCOUNT': '1.120', 'weapon2': '1.378', 'DAMAGECOUNT': '3.882', 'FRAGCOUNT': '7.000'} [2023-02-24 18:42:13,620][177156] DAMAGECOUNT value on done: 164279.0 [2023-02-24 18:42:13,621][177156] Sum rewards: 20.227, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.111', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'AMMO3': '0.130', 'weapon5': '0.298', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'weapon2': '1.092', 'HITCOUNT': '1.320', 'weapon3': '2.232', 'DAMAGECOUNT': '5.208', 'FRAGCOUNT': '18.000'} [2023-02-24 18:42:13,891][177153] Updated weights for policy 0, policy_version 16240 (0.0008) [2023-02-24 18:42:13,899][177156] DAMAGECOUNT value on done: 167363.0 [2023-02-24 18:42:13,899][177156] Sum rewards: 10.176, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.705', 'AMMO5': '0.012', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO3': '0.105', 'AMMO4': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.166', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.284', 'WEAPON3': '0.700', 'HITCOUNT': '0.830', 'weapon2': '1.256', 'weapon3': '1.852', 'DAMAGECOUNT': '3.267', 'FRAGCOUNT': '9.000'} [2023-02-24 18:42:13,928][177156] DAMAGECOUNT value on done: 168330.0 [2023-02-24 18:42:13,928][177156] Sum rewards: 19.679, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.393', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.008', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'weapon7': '0.058', 'weapon5': '0.066', 'AMMO3': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.600', 'HITCOUNT': '0.970', 'weapon2': '1.558', 'weapon3': '1.772', 'DAMAGECOUNT': '4.692', 'FRAGCOUNT': '15.000'} [2023-02-24 18:42:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 66551808. Throughput: 0: 3476.4. Samples: 16639046. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:42:16,376][177119] Avg episode reward: [(0, '12.520')] [2023-02-24 18:42:16,725][177170] DAMAGECOUNT value on done: 167821.0 [2023-02-24 18:42:16,726][177170] Sum rewards: 21.070, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.079', 'AMMO2': '0.013', 'AMMO5': '0.019', 'WEAPON4': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.086', 'WEAPON1': '0.090', 'weapon4': '0.126', 'weapon5': '0.474', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '1.020', 'weapon2': '1.072', 'weapon3': '1.822', 'DAMAGECOUNT': '5.661', 'FRAGCOUNT': '16.500'} [2023-02-24 18:42:16,842][177153] Updated weights for policy 0, policy_version 16250 (0.0008) [2023-02-24 18:42:17,014][177170] DAMAGECOUNT value on done: 175629.0 [2023-02-24 18:42:17,015][177170] Sum rewards: 13.703, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.306', 'AMMO2': '0.011', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.109', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.248', 'weapon4': '0.308', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.680', 'weapon2': '0.918', 'weapon3': '1.726', 'DAMAGECOUNT': '3.555', 'FRAGCOUNT': '12.000'} [2023-02-24 18:42:17,108][177170] DAMAGECOUNT value on done: 163676.0 [2023-02-24 18:42:17,109][177170] Sum rewards: 14.042, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.861', 'AMMO2': '0.024', 'AMMO5': '0.025', 'WEAPON1': '0.040', 'AMMO3': '0.114', 'AMMO4': '0.120', 'WEAPON4': '0.250', 'weapon5': '0.256', 'weapon4': '0.394', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'ARMOR': '0.846', 'weapon2': '1.100', 'HITCOUNT': '1.200', 'weapon3': '1.908', 'DAMAGECOUNT': '4.626', 'FRAGCOUNT': '11.000'} [2023-02-24 18:42:17,403][177170] DAMAGECOUNT value on done: 164766.0 [2023-02-24 18:42:17,403][177170] Sum rewards: 11.840, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.015', 'AMMO2': '0.009', 'AMMO5': '0.019', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'weapon4': '0.136', 'AMMO3': '0.145', 'weapon5': '0.394', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'HITCOUNT': '1.040', 'weapon2': '1.234', 'weapon3': '1.834', 'DAMAGECOUNT': '4.932', 'FRAGCOUNT': '11.500'} [2023-02-24 18:42:18,291][177158] DAMAGECOUNT value on done: 161321.0 [2023-02-24 18:42:18,292][177158] Sum rewards: 6.592, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.154', 'AMMO5': '0.017', 'ARMOR': '0.033', 'AMMO2': '0.042', 'WEAPON1': '0.070', 'weapon5': '0.130', 'AMMO3': '0.148', 'AMMO4': '0.207', 'WEAPON5': '0.400', 'weapon4': '0.414', 'WEAPON4': '0.550', 'weapon2': '0.886', 'WEAPON3': '1.000', 'HITCOUNT': '1.080', 'weapon3': '2.046', 'DAMAGECOUNT': '4.473', 'FRAGCOUNT': '11.000'} [2023-02-24 18:42:18,587][177158] DAMAGECOUNT value on done: 164906.0 [2023-02-24 18:42:18,587][177158] Sum rewards: 15.630, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.755', 'AMMO2': '0.012', 'AMMO5': '0.015', 'weapon4': '0.026', 'WEAPON4': '0.050', 'AMMO4': '0.061', 'WEAPON1': '0.080', 'weapon7': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.151', 'weapon5': '0.186', 'WEAPON5': '0.400', 'weapon2': '0.946', 'WEAPON3': '1.050', 'HITCOUNT': '1.250', 'weapon3': '2.338', 'DAMAGECOUNT': '5.184', 'FRAGCOUNT': '15.000'} [2023-02-24 18:42:19,442][177158] DAMAGECOUNT value on done: 170385.0 [2023-02-24 18:42:19,442][177158] Sum rewards: 2.416, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.191', 'AMMO5': '0.022', 'AMMO2': '0.026', 'WEAPON1': '0.050', 'weapon7': '0.064', 'AMMO3': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.130', 'WEAPON7': '0.200', 'weapon5': '0.368', 'WEAPON4': '0.400', 'weapon4': '0.410', 'WEAPON3': '0.500', 'WEAPON5': '0.550', 'HITCOUNT': '0.610', 'weapon2': '0.926', 'weapon3': '1.146', 'DAMAGECOUNT': '2.130', 'FRAGCOUNT': '4.000'} [2023-02-24 18:42:19,741][177158] DAMAGECOUNT value on done: 167378.0 [2023-02-24 18:42:19,741][177158] Sum rewards: 7.326, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.780', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon7': '0.046', 'AMMO3': '0.050', 'WEAPON1': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.127', 'WEAPON5': '0.250', 'weapon5': '0.256', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.426', 'HITCOUNT': '0.610', 'weapon3': '1.066', 'weapon2': '1.320', 'DAMAGECOUNT': '2.871', 'FRAGCOUNT': '6.000'} [2023-02-24 18:42:19,810][177153] Updated weights for policy 0, policy_version 16260 (0.0008) [2023-02-24 18:42:20,215][177171] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:42:21,232][177172] DAMAGECOUNT value on done: 168990.0 [2023-02-24 18:42:21,233][177172] Sum rewards: 19.632, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.620', 'AMMO5': '0.014', 'AMMO2': '0.026', 'WEAPON1': '0.060', 'weapon5': '0.106', 'AMMO3': '0.116', 'AMMO4': '0.129', 'weapon7': '0.136', 'WEAPON4': '0.200', 'weapon4': '0.342', 'WEAPON5': '0.350', 'AMMO6': '0.400', 'WEAPON7': '0.400', 'AMMO7': '0.400', 'WEAPON3': '0.650', 'weapon2': '0.882', 'HITCOUNT': '1.000', 'weapon3': '1.856', 'DAMAGECOUNT': '4.434', 'FRAGCOUNT': '17.000'} [2023-02-24 18:42:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 66621440. Throughput: 0: 3478.2. Samples: 16649508. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:42:21,376][177119] Avg episode reward: [(0, '12.211')] [2023-02-24 18:42:21,528][177172] DAMAGECOUNT value on done: 168017.0 [2023-02-24 18:42:21,529][177172] Sum rewards: 13.391, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.853', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO5': '0.025', 'WEAPON4': '0.100', 'AMMO4': '0.120', 'weapon5': '0.152', 'AMMO3': '0.190', 'weapon4': '0.208', 'WEAPON5': '0.500', 'HITCOUNT': '1.080', 'WEAPON3': '1.150', 'weapon2': '1.150', 'weapon3': '2.112', 'DAMAGECOUNT': '4.662', 'FRAGCOUNT': '15.000'} [2023-02-24 18:42:22,455][177154] DAMAGECOUNT value on done: 172529.0 [2023-02-24 18:42:22,456][177154] Sum rewards: 2.800, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.201', 'weapon7': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.038', 'WEAPON1': '0.050', 'AMMO3': '0.095', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.192', 'weapon5': '0.276', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.780', 'ARMOR': '0.800', 'weapon4': '0.914', 'weapon2': '0.970', 'weapon3': '1.318', 'DAMAGECOUNT': '2.997', 'FRAGCOUNT': '3.500'} [2023-02-24 18:42:22,758][177153] Updated weights for policy 0, policy_version 16270 (0.0008) [2023-02-24 18:42:22,763][177154] DAMAGECOUNT value on done: 173386.0 [2023-02-24 18:42:22,764][177154] Sum rewards: 9.454, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.094', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO4': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.136', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.536', 'weapon2': '1.056', 'HITCOUNT': '1.110', 'WEAPON3': '1.150', 'weapon3': '1.752', 'DAMAGECOUNT': '4.038', 'FRAGCOUNT': '11.000'} [2023-02-24 18:42:23,011][177172] DAMAGECOUNT value on done: 168988.0 [2023-02-24 18:42:23,012][177172] Sum rewards: 8.990, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.430', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.024', 'weapon7': '0.048', 'WEAPON1': '0.070', 'AMMO4': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.127', 'weapon5': '0.134', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.378', 'WEAPON5': '0.450', 'HITCOUNT': '0.820', 'WEAPON3': '0.900', 'weapon2': '0.980', 'weapon3': '1.816', 'DAMAGECOUNT': '3.093', 'FRAGCOUNT': '9.000'} [2023-02-24 18:42:23,059][177154] DAMAGECOUNT value on done: 171755.0 [2023-02-24 18:42:23,060][177154] Sum rewards: 10.832, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.568', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'weapon5': '0.128', 'AMMO3': '0.135', 'weapon4': '0.196', 'HITCOUNT': '0.740', 'WEAPON3': '0.750', 'weapon2': '1.418', 'weapon3': '1.620', 'DAMAGECOUNT': '3.633', 'FRAGCOUNT': '10.000'} [2023-02-24 18:42:23,299][177172] DAMAGECOUNT value on done: 170540.0 [2023-02-24 18:42:23,300][177172] Sum rewards: 17.972, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.866', 'AMMO2': '0.012', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.058', 'weapon7': '0.068', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.121', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.414', 'weapon2': '0.736', 'WEAPON3': '0.850', 'HITCOUNT': '1.200', 'weapon3': '2.088', 'DAMAGECOUNT': '5.652', 'FRAGCOUNT': '15.500'} [2023-02-24 18:42:23,367][177154] DAMAGECOUNT value on done: 175402.0 [2023-02-24 18:42:23,367][177154] Sum rewards: 14.275, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.140', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.031', 'weapon7': '0.046', 'weapon5': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.141', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'WEAPON4': '0.350', 'weapon4': '0.608', 'WEAPON3': '0.900', 'weapon2': '0.998', 'HITCOUNT': '1.160', 'weapon3': '1.928', 'DAMAGECOUNT': '5.019', 'FRAGCOUNT': '14.000'} [2023-02-24 18:42:23,580][177157] DAMAGECOUNT value on done: 160552.0 [2023-02-24 18:42:23,580][177157] Sum rewards: 9.810, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.949', 'ARMOR': '0.004', 'AMMO2': '0.014', 'AMMO5': '0.015', 'weapon7': '0.054', 'WEAPON1': '0.060', 'AMMO4': '0.067', 'weapon4': '0.092', 'AMMO3': '0.102', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.296', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'HITCOUNT': '0.530', 'WEAPON3': '0.650', 'weapon2': '1.474', 'weapon3': '1.672', 'DAMAGECOUNT': '3.489', 'FRAGCOUNT': '8.500'} [2023-02-24 18:42:23,658][177157] DAMAGECOUNT value on done: 174648.0 [2023-02-24 18:42:23,658][177157] Sum rewards: 15.173, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.554', 'AMMO5': '0.015', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon7': '0.070', 'AMMO4': '0.097', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.138', 'weapon5': '0.156', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.394', 'WEAPON4': '0.400', 'weapon4': '0.726', 'WEAPON3': '0.800', 'HITCOUNT': '1.380', 'weapon3': '1.956', 'DAMAGECOUNT': '5.316', 'FRAGCOUNT': '14.000'} [2023-02-24 18:42:23,900][177157] DAMAGECOUNT value on done: 164545.0 [2023-02-24 18:42:23,900][177157] Sum rewards: 7.565, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.800', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon4': '0.056', 'WEAPON4': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.173', 'weapon5': '0.176', 'WEAPON5': '0.300', 'HITCOUNT': '0.880', 'weapon2': '1.020', 'WEAPON3': '1.150', 'weapon3': '2.394', 'DAMAGECOUNT': '3.447', 'FRAGCOUNT': '10.000'} [2023-02-24 18:42:23,971][177157] DAMAGECOUNT value on done: 165630.0 [2023-02-24 18:42:23,972][177157] Sum rewards: 9.090, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.706', 'AMMO5': '0.012', 'AMMO2': '0.037', 'WEAPON1': '0.040', 'AMMO3': '0.126', 'AMMO4': '0.184', 'weapon4': '0.208', 'weapon5': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON3': '0.750', 'HITCOUNT': '0.970', 'weapon2': '1.038', 'weapon3': '1.936', 'DAMAGECOUNT': '3.582', 'FRAGCOUNT': '9.000'} [2023-02-24 18:42:23,985][177171] DAMAGECOUNT value on done: 163485.0 [2023-02-24 18:42:23,986][177171] Sum rewards: 17.553, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.080', 'AMMO5': '0.022', 'AMMO2': '0.036', 'weapon7': '0.052', 'WEAPON1': '0.070', 'AMMO3': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.178', 'WEAPON7': '0.200', 'weapon5': '0.224', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'weapon4': '0.660', 'HITCOUNT': '0.950', 'weapon3': '1.730', 'DAMAGECOUNT': '4.191', 'FRAGCOUNT': '15.000'} [2023-02-24 18:42:24,286][177171] DAMAGECOUNT value on done: 164981.0 [2023-02-24 18:42:24,286][177171] Sum rewards: 8.070, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.840', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO3': '0.068', 'AMMO4': '0.077', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'WEAPON4': '0.550', 'HITCOUNT': '0.670', 'weapon2': '0.780', 'weapon4': '0.824', 'weapon3': '1.150', 'DAMAGECOUNT': '2.760', 'FRAGCOUNT': '9.000'} [2023-02-24 18:42:24,295][177171] DAMAGECOUNT value on done: 172228.0 [2023-02-24 18:42:24,295][177171] Sum rewards: 17.626, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.471', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'weapon5': '0.106', 'weapon7': '0.146', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'weapon4': '0.564', 'weapon2': '0.620', 'HITCOUNT': '0.890', 'weapon3': '1.166', 'DAMAGECOUNT': '4.560', 'FRAGCOUNT': '15.000'} [2023-02-24 18:42:24,602][177171] DAMAGECOUNT value on done: 165703.0 [2023-02-24 18:42:24,602][177171] Sum rewards: 9.161, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.016', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'AMMO3': '0.136', 'AMMO4': '0.136', 'weapon5': '0.160', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.386', 'weapon2': '0.880', 'WEAPON3': '0.950', 'HITCOUNT': '0.960', 'weapon3': '1.924', 'DAMAGECOUNT': '3.180', 'FRAGCOUNT': '10.000'} [2023-02-24 18:42:25,625][177155] DAMAGECOUNT value on done: 169837.0 [2023-02-24 18:42:25,626][177155] Sum rewards: 18.238, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.570', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.101', 'AMMO4': '0.105', 'weapon5': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.174', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.800', 'weapon2': '0.998', 'HITCOUNT': '1.260', 'weapon3': '1.840', 'DAMAGECOUNT': '5.538', 'FRAGCOUNT': '14.000'} [2023-02-24 18:42:25,707][177153] Updated weights for policy 0, policy_version 16280 (0.0008) [2023-02-24 18:42:25,935][177155] DAMAGECOUNT value on done: 173985.0 [2023-02-24 18:42:25,936][177155] Sum rewards: 14.607, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.330', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.019', 'weapon7': '0.056', 'weapon4': '0.062', 'AMMO4': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon5': '0.208', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '1.010', 'weapon2': '1.308', 'weapon3': '1.576', 'DAMAGECOUNT': '3.825', 'FRAGCOUNT': '12.000'} [2023-02-24 18:42:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 66691072. Throughput: 0: 3475.1. Samples: 16670244. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:42:26,376][177119] Avg episode reward: [(0, '12.251')] [2023-02-24 18:42:26,393][177155] DAMAGECOUNT value on done: 175888.0 [2023-02-24 18:42:26,394][177155] Sum rewards: 17.927, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.000', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon7': '0.048', 'AMMO3': '0.086', 'AMMO4': '0.091', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.478', 'WEAPON3': '0.650', 'weapon4': '0.848', 'HITCOUNT': '1.280', 'weapon3': '1.588', 'DAMAGECOUNT': '4.452', 'FRAGCOUNT': '14.000'} [2023-02-24 18:42:26,696][177155] DAMAGECOUNT value on done: 167081.0 [2023-02-24 18:42:26,697][177155] Sum rewards: 18.337, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.160', 'AMMO5': '0.014', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'weapon4': '0.080', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon5': '0.186', 'WEAPON5': '0.300', 'weapon2': '0.692', 'WEAPON3': '1.200', 'HITCOUNT': '1.440', 'weapon3': '2.708', 'DAMAGECOUNT': '6.126', 'FRAGCOUNT': '20.000'} [2023-02-24 18:42:28,651][177153] Updated weights for policy 0, policy_version 16290 (0.0008) [2023-02-24 18:42:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 66760704. Throughput: 0: 3472.5. Samples: 16691058. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:42:31,376][177119] Avg episode reward: [(0, '12.297')] [2023-02-24 18:42:31,599][177153] Updated weights for policy 0, policy_version 16300 (0.0008) [2023-02-24 18:42:32,994][177156] DAMAGECOUNT value on done: 170782.0 [2023-02-24 18:42:32,995][177156] Sum rewards: 11.963, reward structure: {'DEATHCOUNT': '-6.000', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.024', 'weapon7': '0.052', 'AMMO3': '0.079', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'weapon5': '0.156', 'WEAPON5': '0.300', 'HEALTH': '0.370', 'ARMOR': '0.400', 'weapon4': '0.416', 'WEAPON3': '0.450', 'HITCOUNT': '0.700', 'weapon3': '1.268', 'weapon2': '1.376', 'DAMAGECOUNT': '2.772', 'FRAGCOUNT': '9.000'} [2023-02-24 18:42:33,026][177156] DAMAGECOUNT value on done: 165117.0 [2023-02-24 18:42:33,027][177156] Sum rewards: 5.921, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.290', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.022', 'WEAPON4': '0.050', 'weapon4': '0.056', 'WEAPON1': '0.080', 'AMMO3': '0.124', 'weapon5': '0.506', 'WEAPON5': '0.650', 'HITCOUNT': '0.650', 'WEAPON3': '0.900', 'weapon2': '1.396', 'weapon3': '1.506', 'DAMAGECOUNT': '2.514', 'FRAGCOUNT': '8.000'} [2023-02-24 18:42:33,307][177156] DAMAGECOUNT value on done: 169513.0 [2023-02-24 18:42:33,308][177156] Sum rewards: 21.381, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.884', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.061', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.212', 'weapon4': '0.334', 'ARMOR': '0.453', 'WEAPON3': '0.800', 'weapon2': '0.942', 'HITCOUNT': '1.380', 'weapon3': '1.830', 'DAMAGECOUNT': '6.420', 'FRAGCOUNT': '18.000'} [2023-02-24 18:42:33,337][177156] DAMAGECOUNT value on done: 169380.0 [2023-02-24 18:42:33,338][177156] Sum rewards: 12.715, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.230', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.022', 'weapon7': '0.060', 'AMMO3': '0.089', 'AMMO4': '0.109', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.462', 'weapon2': '0.480', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'weapon3': '1.510', 'DAMAGECOUNT': '3.150', 'FRAGCOUNT': '13.000'} [2023-02-24 18:42:34,562][177153] Updated weights for policy 0, policy_version 16310 (0.0009) [2023-02-24 18:42:36,137][177170] DAMAGECOUNT value on done: 169309.0 [2023-02-24 18:42:36,138][177170] Sum rewards: 13.773, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.659', 'AMMO5': '0.017', 'AMMO2': '0.023', 'WEAPON1': '0.060', 'AMMO4': '0.112', 'AMMO3': '0.120', 'weapon4': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon5': '0.498', 'weapon2': '0.772', 'WEAPON3': '0.800', 'HITCOUNT': '1.250', 'weapon3': '2.174', 'DAMAGECOUNT': '4.464', 'FRAGCOUNT': '13.000'} [2023-02-24 18:42:36,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 66830336. Throughput: 0: 3471.0. Samples: 16701450. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:42:36,376][177119] Avg episode reward: [(0, '12.201')] [2023-02-24 18:42:36,439][177170] DAMAGECOUNT value on done: 177128.0 [2023-02-24 18:42:36,439][177170] Sum rewards: 13.219, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.690', 'AMMO5': '0.010', 'AMMO2': '0.014', 'WEAPON1': '0.040', 'weapon4': '0.050', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'AMMO3': '0.126', 'weapon5': '0.206', 'WEAPON5': '0.350', 'WEAPON3': '0.950', 'HITCOUNT': '0.950', 'weapon2': '1.326', 'weapon3': '1.718', 'DAMAGECOUNT': '4.497', 'FRAGCOUNT': '13.000'} [2023-02-24 18:42:36,556][177170] DAMAGECOUNT value on done: 165456.0 [2023-02-24 18:42:36,557][177170] Sum rewards: 19.938, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.078', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'weapon5': '0.212', 'weapon4': '0.356', 'weapon2': '0.856', 'WEAPON3': '0.950', 'HITCOUNT': '1.270', 'weapon3': '2.212', 'DAMAGECOUNT': '5.340', 'FRAGCOUNT': '19.000'} [2023-02-24 18:42:36,852][177170] DAMAGECOUNT value on done: 165850.0 [2023-02-24 18:42:36,853][177170] Sum rewards: 10.183, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.468', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'weapon7': '0.048', 'weapon5': '0.048', 'AMMO3': '0.067', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'weapon4': '0.466', 'WEAPON3': '0.500', 'HITCOUNT': '0.690', 'weapon2': '0.842', 'weapon3': '1.240', 'DAMAGECOUNT': '3.252', 'FRAGCOUNT': '8.000'} [2023-02-24 18:42:37,507][177153] Updated weights for policy 0, policy_version 16320 (0.0008) [2023-02-24 18:42:37,619][177158] DAMAGECOUNT value on done: 162920.0 [2023-02-24 18:42:37,620][177158] Sum rewards: 15.475, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.412', 'AMMO2': '0.012', 'AMMO5': '0.017', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.218', 'weapon4': '0.246', 'WEAPON4': '0.300', 'ARMOR': '0.456', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'HITCOUNT': '1.040', 'weapon2': '1.528', 'weapon3': '1.562', 'DAMAGECOUNT': '4.797', 'FRAGCOUNT': '13.000'} [2023-02-24 18:42:37,912][177158] DAMAGECOUNT value on done: 165849.0 [2023-02-24 18:42:37,913][177158] Sum rewards: 9.047, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.060', 'AMMO5': '0.007', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'weapon5': '0.072', 'AMMO3': '0.077', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'weapon4': '0.670', 'HITCOUNT': '0.800', 'weapon2': '0.868', 'weapon3': '1.502', 'DAMAGECOUNT': '2.829', 'FRAGCOUNT': '6.000'} [2023-02-24 18:42:38,743][177158] DAMAGECOUNT value on done: 171513.0 [2023-02-24 18:42:38,743][177158] Sum rewards: 10.829, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.596', 'AMMO2': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.049', 'WEAPON1': '0.070', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'weapon5': '0.188', 'weapon4': '0.272', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'HITCOUNT': '0.820', 'weapon2': '1.002', 'weapon3': '1.842', 'DAMAGECOUNT': '3.384', 'FRAGCOUNT': '9.500'} [2023-02-24 18:42:39,043][177158] DAMAGECOUNT value on done: 169063.0 [2023-02-24 18:42:39,044][177158] Sum rewards: 12.262, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.050', 'AMMO5': '0.015', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'AMMO4': '0.110', 'weapon5': '0.196', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'weapon4': '0.346', 'WEAPON5': '0.350', 'weapon2': '0.810', 'WEAPON3': '1.250', 'HITCOUNT': '1.330', 'weapon3': '2.290', 'DAMAGECOUNT': '5.055', 'FRAGCOUNT': '14.000'} [2023-02-24 18:42:40,441][177153] Updated weights for policy 0, policy_version 16330 (0.0008) [2023-02-24 18:42:40,571][177172] DAMAGECOUNT value on done: 170823.0 [2023-02-24 18:42:40,572][177172] Sum rewards: 17.771, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.834', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'ARMOR': '0.045', 'weapon5': '0.054', 'AMMO4': '0.118', 'AMMO3': '0.131', 'WEAPON5': '0.200', 'weapon4': '0.436', 'WEAPON4': '0.500', 'weapon2': '0.800', 'WEAPON3': '0.950', 'HITCOUNT': '1.410', 'weapon3': '2.160', 'DAMAGECOUNT': '5.499', 'FRAGCOUNT': '17.000'} [2023-02-24 18:42:40,869][177172] DAMAGECOUNT value on done: 168910.0 [2023-02-24 18:42:40,870][177172] Sum rewards: 10.921, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.077', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'AMMO5': '0.015', 'AMMO3': '0.066', 'WEAPON1': '0.090', 'weapon5': '0.342', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.660', 'weapon3': '1.372', 'weapon2': '1.536', 'DAMAGECOUNT': '2.679', 'FRAGCOUNT': '8.000'} [2023-02-24 18:42:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 66899968. Throughput: 0: 3468.1. Samples: 16722318. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:42:41,376][177119] Avg episode reward: [(0, '12.178')] [2023-02-24 18:42:41,853][177154] DAMAGECOUNT value on done: 173869.0 [2023-02-24 18:42:41,854][177154] Sum rewards: 13.117, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.098', 'weapon7': '0.004', 'AMMO2': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.061', 'AMMO3': '0.090', 'weapon4': '0.134', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.350', 'weapon5': '0.414', 'WEAPON3': '0.600', 'HITCOUNT': '0.980', 'weapon2': '1.270', 'weapon3': '1.734', 'DAMAGECOUNT': '4.020', 'FRAGCOUNT': '11.000'} [2023-02-24 18:42:42,155][177154] DAMAGECOUNT value on done: 174821.0 [2023-02-24 18:42:42,155][177154] Sum rewards: 6.792, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.940', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.020', 'WEAPON1': '0.060', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.128', 'AMMO3': '0.162', 'weapon4': '0.304', 'WEAPON5': '0.350', 'weapon2': '0.736', 'HITCOUNT': '1.090', 'WEAPON3': '1.150', 'weapon3': '2.208', 'DAMAGECOUNT': '4.305', 'FRAGCOUNT': '8.500'} [2023-02-24 18:42:42,432][177172] DAMAGECOUNT value on done: 170877.0 [2023-02-24 18:42:42,432][177172] Sum rewards: 20.014, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.584', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.171', 'weapon4': '0.252', 'weapon5': '0.288', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon2': '0.704', 'WEAPON3': '1.050', 'HITCOUNT': '1.380', 'weapon3': '2.332', 'DAMAGECOUNT': '5.667', 'FRAGCOUNT': '19.000'} [2023-02-24 18:42:42,461][177154] DAMAGECOUNT value on done: 173387.0 [2023-02-24 18:42:42,461][177154] Sum rewards: 14.820, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.149', 'AMMO2': '0.006', 'AMMO5': '0.011', 'AMMO4': '0.029', 'WEAPON1': '0.030', 'WEAPON4': '0.100', 'weapon4': '0.108', 'weapon5': '0.142', 'AMMO3': '0.149', 'WEAPON5': '0.250', 'weapon2': '0.500', 'WEAPON3': '1.000', 'HITCOUNT': '1.300', 'weapon3': '2.948', 'DAMAGECOUNT': '4.896', 'FRAGCOUNT': '13.500'} [2023-02-24 18:42:42,729][177172] DAMAGECOUNT value on done: 171705.0 [2023-02-24 18:42:42,729][177172] Sum rewards: 8.060, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.462', 'AMMO2': '0.007', 'AMMO5': '0.025', 'weapon7': '0.026', 'AMMO4': '0.035', 'WEAPON1': '0.080', 'AMMO3': '0.131', 'weapon4': '0.142', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.256', 'WEAPON5': '0.600', 'HITCOUNT': '0.800', 'WEAPON3': '0.900', 'weapon2': '0.920', 'weapon3': '2.104', 'DAMAGECOUNT': '3.495', 'FRAGCOUNT': '9.000'} [2023-02-24 18:42:42,750][177154] DAMAGECOUNT value on done: 176371.0 [2023-02-24 18:42:42,750][177154] Sum rewards: 6.975, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.728', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'ARMOR': '0.004', 'AMMO5': '0.030', 'WEAPON1': '0.060', 'weapon5': '0.110', 'AMMO3': '0.143', 'WEAPON4': '0.200', 'weapon4': '0.230', 'WEAPON5': '0.500', 'HITCOUNT': '0.810', 'WEAPON3': '0.900', 'weapon2': '1.058', 'weapon3': '1.756', 'DAMAGECOUNT': '2.907', 'FRAGCOUNT': '10.000'} [2023-02-24 18:42:42,977][177157] DAMAGECOUNT value on done: 161455.0 [2023-02-24 18:42:42,977][177157] Sum rewards: 12.352, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.957', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.007', 'WEAPON1': '0.040', 'AMMO3': '0.066', 'weapon7': '0.100', 'weapon5': '0.152', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'WEAPON7': '0.400', 'HITCOUNT': '0.430', 'WEAPON3': '0.550', 'weapon3': '1.212', 'weapon2': '1.700', 'DAMAGECOUNT': '2.709', 'FRAGCOUNT': '9.000'} [2023-02-24 18:42:43,015][177157] DAMAGECOUNT value on done: 175488.0 [2023-02-24 18:42:43,016][177157] Sum rewards: 7.898, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.524', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO3': '0.064', 'weapon7': '0.090', 'AMMO4': '0.095', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'WEAPON4': '0.400', 'HITCOUNT': '0.770', 'weapon4': '0.772', 'weapon3': '1.154', 'weapon2': '1.408', 'DAMAGECOUNT': '2.520', 'FRAGCOUNT': '6.000'} [2023-02-24 18:42:43,281][177157] DAMAGECOUNT value on done: 165982.0 [2023-02-24 18:42:43,282][177157] Sum rewards: 11.731, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.883', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO3': '0.114', 'weapon5': '0.132', 'AMMO4': '0.142', 'weapon4': '0.192', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '0.750', 'HITCOUNT': '0.970', 'weapon2': '1.260', 'weapon3': '1.864', 'DAMAGECOUNT': '4.296', 'FRAGCOUNT': '13.000'} [2023-02-24 18:42:43,320][177157] DAMAGECOUNT value on done: 167401.0 [2023-02-24 18:42:43,320][177157] Sum rewards: 20.884, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.731', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO5': '0.017', 'weapon7': '0.030', 'AMMO4': '0.037', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon5': '0.442', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'weapon2': '1.090', 'HITCOUNT': '1.130', 'weapon3': '2.070', 'DAMAGECOUNT': '5.313', 'FRAGCOUNT': '17.000'} [2023-02-24 18:42:43,393][177171] DAMAGECOUNT value on done: 164493.0 [2023-02-24 18:42:43,394][177171] Sum rewards: 6.650, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.160', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO3': '0.059', 'weapon7': '0.070', 'AMMO4': '0.079', 'weapon5': '0.148', 'WEAPON5': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.632', 'weapon2': '0.746', 'HITCOUNT': '0.760', 'weapon3': '1.016', 'DAMAGECOUNT': '3.024', 'FRAGCOUNT': '6.000'} [2023-02-24 18:42:43,419][177153] Updated weights for policy 0, policy_version 16340 (0.0008) [2023-02-24 18:42:43,672][177171] DAMAGECOUNT value on done: 166416.0 [2023-02-24 18:42:43,673][177171] Sum rewards: 11.276, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.131', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'weapon7': '0.048', 'AMMO3': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.154', 'AMMO4': '0.161', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '0.650', 'weapon4': '0.678', 'weapon2': '0.868', 'HITCOUNT': '1.190', 'weapon3': '1.592', 'DAMAGECOUNT': '4.305', 'FRAGCOUNT': '10.000'} [2023-02-24 18:42:43,682][177171] DAMAGECOUNT value on done: 174128.0 [2023-02-24 18:42:43,683][177171] Sum rewards: 17.248, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.120', 'AMMO5': '0.015', 'AMMO2': '0.035', 'WEAPON1': '0.050', 'weapon7': '0.126', 'AMMO3': '0.131', 'AMMO4': '0.177', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.254', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'WEAPON4': '0.450', 'ARMOR': '0.452', 'weapon2': '0.574', 'weapon4': '0.618', 'WEAPON3': '0.900', 'HITCOUNT': '1.390', 'weapon3': '1.956', 'DAMAGECOUNT': '5.700', 'FRAGCOUNT': '16.000'} [2023-02-24 18:42:43,981][177171] DAMAGECOUNT value on done: 167728.0 [2023-02-24 18:42:43,982][177171] Sum rewards: 18.897, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.765', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon7': '0.026', 'AMMO2': '0.035', 'AMMO3': '0.097', 'AMMO4': '0.177', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.218', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.744', 'WEAPON3': '0.750', 'weapon4': '0.908', 'HITCOUNT': '1.330', 'weapon3': '1.674', 'DAMAGECOUNT': '6.075', 'FRAGCOUNT': '16.000'} [2023-02-24 18:42:44,967][177155] DAMAGECOUNT value on done: 170669.0 [2023-02-24 18:42:44,968][177155] Sum rewards: 6.231, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.974', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO4': '0.061', 'AMMO3': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.160', 'weapon4': '0.398', 'ARMOR': '0.400', 'HITCOUNT': '0.670', 'WEAPON3': '0.700', 'weapon2': '0.824', 'weapon3': '1.250', 'DAMAGECOUNT': '2.496', 'FRAGCOUNT': '8.000'} [2023-02-24 18:42:45,274][177155] DAMAGECOUNT value on done: 176365.0 [2023-02-24 18:42:45,275][177155] Sum rewards: 26.663, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.194', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.129', 'weapon5': '0.366', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'weapon2': '1.052', 'HITCOUNT': '1.440', 'weapon3': '2.170', 'DAMAGECOUNT': '7.140', 'FRAGCOUNT': '22.000'} [2023-02-24 18:42:45,708][177155] DAMAGECOUNT value on done: 176848.0 [2023-02-24 18:42:45,709][177155] Sum rewards: 10.898, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.117', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO5': '0.028', 'weapon7': '0.046', 'AMMO3': '0.073', 'WEAPON1': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.228', 'ARMOR': '0.400', 'weapon4': '0.436', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'weapon2': '1.054', 'weapon3': '1.670', 'DAMAGECOUNT': '2.880', 'FRAGCOUNT': '8.000'} [2023-02-24 18:42:45,999][177155] DAMAGECOUNT value on done: 168217.0 [2023-02-24 18:42:46,000][177155] Sum rewards: 11.473, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.200', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'weapon7': '0.052', 'AMMO4': '0.103', 'AMMO3': '0.105', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.240', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON3': '0.750', 'HITCOUNT': '0.960', 'weapon2': '1.056', 'weapon3': '1.806', 'DAMAGECOUNT': '3.408', 'FRAGCOUNT': '11.000'} [2023-02-24 18:42:46,347][177153] Updated weights for policy 0, policy_version 16350 (0.0008) [2023-02-24 18:42:46,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 66969600. Throughput: 0: 3466.6. Samples: 16743100. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:42:46,376][177119] Avg episode reward: [(0, '12.406')] [2023-02-24 18:42:49,299][177153] Updated weights for policy 0, policy_version 16360 (0.0008) [2023-02-24 18:42:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 67039232. Throughput: 0: 3469.7. Samples: 16753574. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:42:51,376][177119] Avg episode reward: [(0, '12.406')] [2023-02-24 18:42:51,619][177155] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-24 18:42:52,254][177153] Updated weights for policy 0, policy_version 16370 (0.0008) [2023-02-24 18:42:52,413][177156] DAMAGECOUNT value on done: 172030.0 [2023-02-24 18:42:52,413][177156] Sum rewards: 9.452, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.926', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.032', 'WEAPON1': '0.060', 'weapon7': '0.062', 'AMMO3': '0.105', 'weapon5': '0.122', 'AMMO4': '0.158', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.596', 'WEAPON3': '0.700', 'HITCOUNT': '0.760', 'weapon2': '0.972', 'weapon3': '1.390', 'DAMAGECOUNT': '3.744', 'FRAGCOUNT': '10.000'} [2023-02-24 18:42:52,437][177156] DAMAGECOUNT value on done: 166661.0 [2023-02-24 18:42:52,437][177156] Sum rewards: 16.284, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.775', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'weapon7': '0.102', 'AMMO3': '0.127', 'WEAPON4': '0.200', 'weapon5': '0.214', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'weapon4': '0.424', 'WEAPON5': '0.450', 'ARMOR': '0.475', 'weapon2': '0.756', 'WEAPON3': '0.850', 'HITCOUNT': '0.950', 'weapon3': '1.958', 'DAMAGECOUNT': '4.632', 'FRAGCOUNT': '15.000'} [2023-02-24 18:42:52,730][177156] DAMAGECOUNT value on done: 171333.0 [2023-02-24 18:42:52,730][177156] Sum rewards: 14.342, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.425', 'AMMO2': '0.021', 'AMMO5': '0.022', 'ARMOR': '0.024', 'WEAPON1': '0.050', 'AMMO4': '0.106', 'AMMO3': '0.123', 'weapon4': '0.252', 'weapon5': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.550', 'weapon2': '0.758', 'WEAPON3': '0.800', 'HITCOUNT': '1.050', 'weapon3': '2.246', 'DAMAGECOUNT': '5.460', 'FRAGCOUNT': '13.500'} [2023-02-24 18:42:52,750][177156] DAMAGECOUNT value on done: 170224.0 [2023-02-24 18:42:52,751][177156] Sum rewards: 8.622, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.693', 'AMMO5': '0.010', 'AMMO2': '0.014', 'WEAPON1': '0.040', 'AMMO4': '0.070', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon7': '0.110', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.216', 'WEAPON5': '0.250', 'weapon4': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.700', 'weapon2': '1.214', 'weapon3': '1.568', 'DAMAGECOUNT': '2.532', 'FRAGCOUNT': '7.500'} [2023-02-24 18:42:55,226][177153] Updated weights for policy 0, policy_version 16380 (0.0009) [2023-02-24 18:42:55,508][177170] DAMAGECOUNT value on done: 170726.0 [2023-02-24 18:42:55,509][177170] Sum rewards: 10.275, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'AMMO2': '0.035', 'weapon7': '0.058', 'AMMO3': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.134', 'WEAPON4': '0.150', 'AMMO4': '0.173', 'WEAPON5': '0.400', 'weapon4': '0.432', 'WEAPON3': '0.550', 'HEALTH': '0.640', 'weapon2': '1.026', 'HITCOUNT': '1.030', 'weapon3': '1.676', 'DAMAGECOUNT': '4.251', 'FRAGCOUNT': '7.500'} [2023-02-24 18:42:55,801][177170] DAMAGECOUNT value on done: 178509.0 [2023-02-24 18:42:55,802][177170] Sum rewards: 12.153, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.724', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.015', 'WEAPON1': '0.060', 'AMMO3': '0.136', 'weapon5': '0.292', 'WEAPON5': '0.400', 'HITCOUNT': '0.870', 'WEAPON3': '0.900', 'weapon2': '0.954', 'weapon3': '2.346', 'DAMAGECOUNT': '4.143', 'FRAGCOUNT': '11.000'} [2023-02-24 18:42:55,921][177170] DAMAGECOUNT value on done: 167001.0 [2023-02-24 18:42:55,922][177170] Sum rewards: 14.392, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.657', 'AMMO2': '0.015', 'AMMO5': '0.026', 'WEAPON1': '0.050', 'AMMO4': '0.073', 'weapon5': '0.116', 'AMMO3': '0.132', 'WEAPON4': '0.200', 'weapon4': '0.240', 'weapon2': '0.462', 'WEAPON5': '0.600', 'WEAPON3': '1.000', 'HITCOUNT': '1.310', 'weapon3': '2.690', 'DAMAGECOUNT': '4.635', 'FRAGCOUNT': '15.000'} [2023-02-24 18:42:56,221][177170] DAMAGECOUNT value on done: 168518.0 [2023-02-24 18:42:56,222][177170] Sum rewards: 25.237, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.022', 'AMMO2': '0.012', 'weapon4': '0.018', 'AMMO5': '0.019', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.122', 'weapon5': '0.278', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'weapon2': '1.026', 'HITCOUNT': '1.440', 'weapon3': '2.148', 'DAMAGECOUNT': '8.004', 'FRAGCOUNT': '20.000'} [2023-02-24 18:42:56,376][177119] Fps is (10 sec: 13516.9, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 67104768. Throughput: 0: 3471.3. Samples: 16774432. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:42:56,376][177119] Avg episode reward: [(0, '12.646')] [2023-02-24 18:42:56,407][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000016384_67108864.pth... [2023-02-24 18:42:56,469][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000015570_63774720.pth [2023-02-24 18:42:56,842][177158] DAMAGECOUNT value on done: 163360.0 [2023-02-24 18:42:56,842][177158] Sum rewards: 6.562, reward structure: {'DEATHCOUNT': '-0.750', 'HEALTH': '-0.260', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'weapon5': '0.004', 'AMMO5': '0.005', 'weapon2': '0.022', 'AMMO3': '0.025', 'weapon7': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.204', 'HITCOUNT': '0.270', 'weapon3': '0.386', 'ARMOR': '0.442', 'DAMAGECOUNT': '1.320', 'FRAGCOUNT': '4.000'} [2023-02-24 18:42:57,140][177158] DAMAGECOUNT value on done: 167716.0 [2023-02-24 18:42:57,141][177158] Sum rewards: 19.127, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.338', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'weapon5': '0.186', 'WEAPON5': '0.300', 'weapon4': '0.334', 'ARMOR': '0.400', 'weapon2': '0.772', 'WEAPON3': '0.800', 'HITCOUNT': '1.280', 'weapon3': '1.990', 'DAMAGECOUNT': '5.601', 'FRAGCOUNT': '16.000'} [2023-02-24 18:42:57,972][177158] DAMAGECOUNT value on done: 172604.0 [2023-02-24 18:42:57,973][177158] Sum rewards: 11.085, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.090', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.030', 'AMMO2': '0.035', 'AMMO3': '0.094', 'weapon7': '0.108', 'AMMO4': '0.175', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.550', 'WEAPON3': '0.600', 'weapon2': '0.648', 'HITCOUNT': '0.810', 'weapon3': '1.414', 'DAMAGECOUNT': '3.273', 'FRAGCOUNT': '9.000'} [2023-02-24 18:42:58,189][177153] Updated weights for policy 0, policy_version 16390 (0.0008) [2023-02-24 18:42:58,274][177158] DAMAGECOUNT value on done: 170341.0 [2023-02-24 18:42:58,274][177158] Sum rewards: 12.084, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.007', 'AMMO5': '0.015', 'weapon5': '0.018', 'AMMO4': '0.035', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.058', 'weapon4': '0.086', 'AMMO3': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'HEALTH': '0.370', 'WEAPON3': '0.650', 'HITCOUNT': '1.080', 'weapon2': '1.340', 'weapon3': '2.142', 'DAMAGECOUNT': '3.834', 'FRAGCOUNT': '9.000'} [2023-02-24 18:42:59,869][177172] DAMAGECOUNT value on done: 171675.0 [2023-02-24 18:42:59,869][177172] Sum rewards: 11.575, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.222', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'WEAPON4': '0.050', 'weapon5': '0.062', 'weapon4': '0.072', 'weapon7': '0.072', 'WEAPON5': '0.100', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.570', 'weapon3': '0.896', 'weapon2': '1.326', 'DAMAGECOUNT': '2.556', 'FRAGCOUNT': '8.000'} [2023-02-24 18:43:00,169][177172] DAMAGECOUNT value on done: 169965.0 [2023-02-24 18:43:00,170][177172] Sum rewards: 8.034, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.318', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.046', 'AMMO3': '0.078', 'weapon7': '0.162', 'weapon5': '0.182', 'AMMO4': '0.229', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'ARMOR': '0.455', 'WEAPON4': '0.550', 'HITCOUNT': '0.660', 'weapon2': '0.884', 'weapon4': '0.926', 'weapon3': '1.146', 'DAMAGECOUNT': '3.165', 'FRAGCOUNT': '8.500'} [2023-02-24 18:43:01,129][177153] Updated weights for policy 0, policy_version 16400 (0.0008) [2023-02-24 18:43:01,200][177154] DAMAGECOUNT value on done: 175340.0 [2023-02-24 18:43:01,200][177154] Sum rewards: 14.020, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'AMMO3': '0.080', 'AMMO4': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HEALTH': '0.298', 'ARMOR': '0.404', 'weapon5': '0.418', 'WEAPON3': '0.500', 'weapon4': '0.646', 'weapon2': '0.942', 'HITCOUNT': '1.140', 'weapon3': '1.450', 'DAMAGECOUNT': '4.413', 'FRAGCOUNT': '9.000'} [2023-02-24 18:43:01,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 67174400. Throughput: 0: 3471.2. Samples: 16795252. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:43:01,376][177119] Avg episode reward: [(0, '12.686')] [2023-02-24 18:43:01,495][177154] DAMAGECOUNT value on done: 175974.0 [2023-02-24 18:43:01,495][177154] Sum rewards: 12.143, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.868', 'AMMO2': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.030', 'weapon4': '0.036', 'weapon7': '0.048', 'AMMO3': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.224', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'HITCOUNT': '0.920', 'weapon2': '0.984', 'weapon3': '1.506', 'DAMAGECOUNT': '3.459', 'FRAGCOUNT': '11.000'} [2023-02-24 18:43:01,800][177154] DAMAGECOUNT value on done: 175785.0 [2023-02-24 18:43:01,800][177154] Sum rewards: 21.658, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.045', 'weapon7': '0.094', 'AMMO3': '0.095', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.180', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HEALTH': '0.433', 'WEAPON3': '0.550', 'HITCOUNT': '1.120', 'weapon2': '1.598', 'weapon3': '1.880', 'DAMAGECOUNT': '5.694', 'FRAGCOUNT': '16.000'} [2023-02-24 18:43:01,816][177172] DAMAGECOUNT value on done: 172325.0 [2023-02-24 18:43:01,817][177172] Sum rewards: 12.305, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.315', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'weapon7': '0.050', 'AMMO3': '0.055', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.132', 'AMMO4': '0.148', 'WEAPON5': '0.200', 'WEAPON3': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.550', 'weapon2': '0.768', 'HITCOUNT': '0.950', 'weapon3': '0.964', 'DAMAGECOUNT': '4.344', 'FRAGCOUNT': '11.000'} [2023-02-24 18:43:02,097][177154] DAMAGECOUNT value on done: 177309.0 [2023-02-24 18:43:02,098][177154] Sum rewards: 10.809, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.380', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.077', 'weapon7': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.123', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.268', 'WEAPON3': '0.500', 'HITCOUNT': '0.650', 'weapon2': '1.382', 'weapon3': '1.450', 'DAMAGECOUNT': '2.814', 'FRAGCOUNT': '9.000'} [2023-02-24 18:43:02,104][177172] DAMAGECOUNT value on done: 173824.0 [2023-02-24 18:43:02,104][177172] Sum rewards: 17.807, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.122', 'AMMO2': '0.017', 'AMMO5': '0.017', 'WEAPON1': '0.060', 'AMMO4': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.110', 'weapon7': '0.134', 'WEAPON4': '0.150', 'weapon5': '0.210', 'weapon4': '0.340', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'weapon2': '0.734', 'HITCOUNT': '1.050', 'weapon3': '2.012', 'DAMAGECOUNT': '5.157', 'FRAGCOUNT': '14.000'} [2023-02-24 18:43:02,348][177170] Large shaping reward 2.563 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5760000000000001, 192.0), ('HEALTH', -0.045, -15.0), ('weapon7', 0.002)] [2023-02-24 18:43:02,362][177157] DAMAGECOUNT value on done: 162871.0 [2023-02-24 18:43:02,362][177157] Sum rewards: 15.353, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.521', 'AMMO2': '0.005', 'AMMO5': '0.015', 'AMMO4': '0.025', 'WEAPON1': '0.030', 'AMMO3': '0.095', 'weapon7': '0.136', 'weapon5': '0.186', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.358', 'weapon2': '0.542', 'WEAPON3': '0.600', 'ARMOR': '0.958', 'HITCOUNT': '0.980', 'weapon3': '1.906', 'DAMAGECOUNT': '4.248', 'FRAGCOUNT': '12.000'} [2023-02-24 18:43:02,381][177157] DAMAGECOUNT value on done: 177075.0 [2023-02-24 18:43:02,382][177157] Sum rewards: 13.332, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.800', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO5': '0.020', 'AMMO4': '0.071', 'weapon7': '0.116', 'AMMO3': '0.130', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'weapon5': '0.268', 'weapon4': '0.282', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'weapon2': '0.850', 'HITCOUNT': '1.370', 'weapon3': '2.050', 'DAMAGECOUNT': '4.761', 'FRAGCOUNT': '11.000'} [2023-02-24 18:43:02,664][177157] DAMAGECOUNT value on done: 167226.0 [2023-02-24 18:43:02,665][177157] Sum rewards: 12.530, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.226', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.118', 'weapon4': '0.234', 'weapon5': '0.346', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'weapon2': '0.890', 'HITCOUNT': '0.950', 'weapon3': '1.914', 'DAMAGECOUNT': '3.732', 'FRAGCOUNT': '11.000'} [2023-02-24 18:43:02,687][177157] DAMAGECOUNT value on done: 168345.0 [2023-02-24 18:43:02,688][177157] Sum rewards: 10.998, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.428', 'AMMO5': '0.017', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'weapon7': '0.050', 'AMMO3': '0.084', 'AMMO4': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.356', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon2': '0.606', 'HITCOUNT': '0.610', 'ARMOR': '0.866', 'weapon3': '1.698', 'DAMAGECOUNT': '2.832', 'FRAGCOUNT': '9.000'} [2023-02-24 18:43:02,731][177171] DAMAGECOUNT value on done: 165524.0 [2023-02-24 18:43:02,731][177171] Sum rewards: 12.287, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.563', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.021', 'AMMO4': '0.037', 'AMMO3': '0.073', 'WEAPON4': '0.150', 'weapon5': '0.326', 'weapon4': '0.444', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon2': '0.730', 'HITCOUNT': '0.830', 'ARMOR': '0.854', 'weapon3': '1.574', 'DAMAGECOUNT': '3.093', 'FRAGCOUNT': '9.000'} [2023-02-24 18:43:03,032][177171] DAMAGECOUNT value on done: 167487.0 [2023-02-24 18:43:03,033][177171] Sum rewards: 13.213, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.320', 'AMMO2': '0.012', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.059', 'AMMO3': '0.103', 'weapon5': '0.248', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.482', 'weapon2': '0.622', 'WEAPON3': '0.750', 'HITCOUNT': '0.810', 'weapon3': '1.646', 'DAMAGECOUNT': '3.213', 'FRAGCOUNT': '13.000'} [2023-02-24 18:43:03,042][177171] DAMAGECOUNT value on done: 175402.0 [2023-02-24 18:43:03,042][177171] Sum rewards: 12.238, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.247', 'AMMO5': '0.005', 'AMMO2': '0.009', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'AMMO4': '0.045', 'weapon5': '0.046', 'weapon7': '0.056', 'AMMO3': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.460', 'WEAPON3': '0.550', 'HITCOUNT': '0.900', 'weapon3': '1.150', 'weapon2': '1.222', 'DAMAGECOUNT': '3.807', 'FRAGCOUNT': '11.000'} [2023-02-24 18:43:03,202][177171] Large shaping reward 3.632 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:43:03,340][177171] DAMAGECOUNT value on done: 169393.0 [2023-02-24 18:43:03,340][177171] Sum rewards: 20.075, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.256', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'weapon7': '0.138', 'weapon5': '0.176', 'weapon4': '0.210', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '1.060', 'weapon2': '1.136', 'weapon3': '1.780', 'DAMAGECOUNT': '4.986', 'FRAGCOUNT': '16.000'} [2023-02-24 18:43:04,071][177153] Updated weights for policy 0, policy_version 16410 (0.0008) [2023-02-24 18:43:04,251][177155] DAMAGECOUNT value on done: 172229.0 [2023-02-24 18:43:04,251][177155] Sum rewards: 21.306, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.210', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'weapon7': '0.042', 'AMMO4': '0.055', 'AMMO3': '0.084', 'weapon5': '0.114', 'weapon4': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON3': '0.550', 'weapon2': '1.150', 'HITCOUNT': '1.180', 'weapon3': '1.936', 'DAMAGECOUNT': '4.680', 'FRAGCOUNT': '16.500'} [2023-02-24 18:43:04,548][177155] DAMAGECOUNT value on done: 177330.0 [2023-02-24 18:43:04,548][177155] Sum rewards: 12.713, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.686', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.019', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.074', 'AMMO3': '0.081', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.228', 'WEAPON3': '0.600', 'HITCOUNT': '0.650', 'weapon3': '1.456', 'weapon2': '1.744', 'DAMAGECOUNT': '2.895', 'FRAGCOUNT': '10.000'} [2023-02-24 18:43:05,007][177155] DAMAGECOUNT value on done: 178503.0 [2023-02-24 18:43:05,007][177155] Sum rewards: 21.493, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.748', 'AMMO2': '0.010', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'AMMO3': '0.114', 'weapon4': '0.160', 'weapon5': '0.272', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'HITCOUNT': '1.040', 'weapon2': '1.318', 'weapon3': '1.918', 'DAMAGECOUNT': '4.677', 'FRAGCOUNT': '19.000'} [2023-02-24 18:43:05,299][177155] DAMAGECOUNT value on done: 169462.0 [2023-02-24 18:43:05,300][177155] Sum rewards: 10.810, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.194', 'AMMO2': '0.011', 'AMMO5': '0.015', 'WEAPON1': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.103', 'weapon4': '0.138', 'WEAPON4': '0.200', 'weapon5': '0.296', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'HITCOUNT': '0.810', 'weapon2': '1.280', 'weapon3': '1.660', 'DAMAGECOUNT': '3.735', 'FRAGCOUNT': '10.000'} [2023-02-24 18:43:06,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.2, 300 sec: 13898.6). Total num frames: 67244032. Throughput: 0: 3470.3. Samples: 16805670. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:43:06,376][177119] Avg episode reward: [(0, '13.165')] [2023-02-24 18:43:06,380][177140] Saving new best policy, reward=13.165! [2023-02-24 18:43:07,039][177153] Updated weights for policy 0, policy_version 16420 (0.0008) [2023-02-24 18:43:09,970][177153] Updated weights for policy 0, policy_version 16430 (0.0008) [2023-02-24 18:43:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 67313664. Throughput: 0: 3472.9. Samples: 16826524. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:43:11,376][177119] Avg episode reward: [(0, '13.165')] [2023-02-24 18:43:11,842][177156] DAMAGECOUNT value on done: 172734.0 [2023-02-24 18:43:11,843][177156] Sum rewards: 8.461, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.680', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'AMMO3': '0.050', 'weapon7': '0.050', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.256', 'WEAPON3': '0.400', 'HITCOUNT': '0.550', 'weapon3': '1.244', 'weapon2': '1.640', 'DAMAGECOUNT': '2.112', 'FRAGCOUNT': '7.000'} [2023-02-24 18:43:11,854][177156] DAMAGECOUNT value on done: 167873.0 [2023-02-24 18:43:11,854][177156] Sum rewards: 9.246, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.657', 'AMMO5': '0.015', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'AMMO4': '0.079', 'AMMO3': '0.093', 'WEAPON4': '0.150', 'weapon5': '0.168', 'WEAPON5': '0.350', 'weapon4': '0.362', 'WEAPON3': '0.600', 'weapon2': '1.004', 'HITCOUNT': '1.020', 'weapon3': '1.380', 'DAMAGECOUNT': '3.636', 'FRAGCOUNT': '7.000'} [2023-02-24 18:43:12,146][177156] DAMAGECOUNT value on done: 172219.0 [2023-02-24 18:43:12,147][177156] Sum rewards: 5.155, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.286', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.070', 'weapon7': '0.070', 'weapon5': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.452', 'weapon4': '0.586', 'HITCOUNT': '0.800', 'weapon2': '1.046', 'weapon3': '1.444', 'DAMAGECOUNT': '2.658', 'FRAGCOUNT': '3.500'} [2023-02-24 18:43:12,157][177156] DAMAGECOUNT value on done: 171528.0 [2023-02-24 18:43:12,158][177156] Sum rewards: 12.374, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.125', 'AMMO2': '0.009', 'AMMO5': '0.015', 'AMMO4': '0.043', 'weapon7': '0.062', 'weapon5': '0.076', 'AMMO3': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO6': '0.320', 'AMMO7': '0.320', 'weapon4': '0.338', 'WEAPON7': '0.400', 'ARMOR': '0.464', 'WEAPON3': '0.750', 'HITCOUNT': '1.070', 'weapon2': '1.294', 'weapon3': '1.908', 'DAMAGECOUNT': '3.912', 'FRAGCOUNT': '11.000'} [2023-02-24 18:43:12,909][177153] Updated weights for policy 0, policy_version 16440 (0.0008) [2023-02-24 18:43:14,802][177170] DAMAGECOUNT value on done: 172638.0 [2023-02-24 18:43:14,802][177170] Sum rewards: 20.859, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.015', 'AMMO5': '0.013', 'AMMO2': '0.020', 'weapon7': '0.060', 'AMMO4': '0.098', 'AMMO3': '0.110', 'weapon5': '0.130', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.378', 'WEAPON3': '0.800', 'weapon2': '0.920', 'HITCOUNT': '1.280', 'weapon3': '2.180', 'DAMAGECOUNT': '5.736', 'FRAGCOUNT': '18.000'} [2023-02-24 18:43:15,103][177170] DAMAGECOUNT value on done: 179351.0 [2023-02-24 18:43:15,103][177170] Sum rewards: 8.258, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.605', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.030', 'weapon5': '0.066', 'weapon7': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.250', 'weapon4': '0.350', 'HITCOUNT': '0.380', 'WEAPON7': '0.400', 'weapon3': '0.678', 'weapon2': '0.824', 'DAMAGECOUNT': '2.226', 'FRAGCOUNT': '5.000'} [2023-02-24 18:43:15,279][177170] DAMAGECOUNT value on done: 169156.0 [2023-02-24 18:43:15,279][177170] Sum rewards: 23.316, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.955', 'AMMO2': '0.011', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO4': '0.056', 'AMMO3': '0.061', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.184', 'weapon4': '0.316', 'WEAPON5': '0.400', 'ARMOR': '0.450', 'WEAPON3': '0.500', 'weapon2': '1.152', 'HITCOUNT': '1.240', 'weapon3': '1.430', 'DAMAGECOUNT': '6.438', 'FRAGCOUNT': '16.000'} [2023-02-24 18:43:15,573][177170] DAMAGECOUNT value on done: 169563.0 [2023-02-24 18:43:15,573][177170] Sum rewards: 11.398, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.280', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.035', 'weapon7': '0.050', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.186', 'WEAPON7': '0.200', 'weapon4': '0.208', 'WEAPON5': '0.250', 'WEAPON3': '0.650', 'HITCOUNT': '0.790', 'weapon2': '1.168', 'weapon3': '1.548', 'DAMAGECOUNT': '3.135', 'FRAGCOUNT': '10.000'} [2023-02-24 18:43:15,879][177153] Updated weights for policy 0, policy_version 16450 (0.0008) [2023-02-24 18:43:16,166][177158] DAMAGECOUNT value on done: 164504.0 [2023-02-24 18:43:16,167][177158] Sum rewards: 8.583, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.200', 'AMMO5': '0.012', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'weapon5': '0.076', 'AMMO4': '0.099', 'weapon7': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.286', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.770', 'WEAPON3': '1.100', 'weapon2': '1.180', 'weapon3': '1.826', 'DAMAGECOUNT': '3.432', 'FRAGCOUNT': '11.000'} [2023-02-24 18:43:16,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 67383296. Throughput: 0: 3471.8. Samples: 16847288. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:43:16,376][177119] Avg episode reward: [(0, '13.014')] [2023-02-24 18:43:16,460][177158] DAMAGECOUNT value on done: 169413.0 [2023-02-24 18:43:16,460][177158] Sum rewards: 13.864, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.430', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon7': '0.022', 'AMMO4': '0.087', 'weapon5': '0.098', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.118', 'weapon4': '0.216', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '0.800', 'HITCOUNT': '1.070', 'weapon2': '1.344', 'weapon3': '1.732', 'DAMAGECOUNT': '5.091', 'FRAGCOUNT': '12.000'} [2023-02-24 18:43:17,322][177158] DAMAGECOUNT value on done: 174333.0 [2023-02-24 18:43:17,323][177158] Sum rewards: 18.015, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.200', 'AMMO2': '0.013', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'weapon7': '0.054', 'AMMO4': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'weapon5': '0.186', 'weapon4': '0.354', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '1.010', 'weapon2': '1.190', 'weapon3': '1.414', 'DAMAGECOUNT': '5.187', 'FRAGCOUNT': '14.000'} [2023-02-24 18:43:17,638][177158] DAMAGECOUNT value on done: 172247.0 [2023-02-24 18:43:17,638][177158] Sum rewards: 24.697, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'weapon7': '0.050', 'AMMO3': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.116', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'weapon4': '0.254', 'ARMOR': '0.412', 'WEAPON3': '0.500', 'HEALTH': '0.684', 'HITCOUNT': '1.190', 'weapon2': '1.372', 'weapon3': '1.590', 'DAMAGECOUNT': '5.718', 'FRAGCOUNT': '18.000'} [2023-02-24 18:43:18,841][177153] Updated weights for policy 0, policy_version 16460 (0.0008) [2023-02-24 18:43:19,184][177172] DAMAGECOUNT value on done: 173490.0 [2023-02-24 18:43:19,185][177172] Sum rewards: 17.291, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.676', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO5': '0.025', 'weapon5': '0.040', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'weapon4': '0.232', 'WEAPON5': '0.400', 'weapon2': '0.958', 'WEAPON3': '1.050', 'HITCOUNT': '1.310', 'weapon3': '2.300', 'DAMAGECOUNT': '5.445', 'FRAGCOUNT': '17.000'} [2023-02-24 18:43:19,496][177172] DAMAGECOUNT value on done: 171475.0 [2023-02-24 18:43:19,497][177172] Sum rewards: 15.245, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.368', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon4': '0.216', 'weapon5': '0.332', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'ARMOR': '0.922', 'HITCOUNT': '1.040', 'weapon2': '1.070', 'weapon3': '1.956', 'DAMAGECOUNT': '4.530', 'FRAGCOUNT': '12.000'} [2023-02-24 18:43:20,561][177154] DAMAGECOUNT value on done: 176673.0 [2023-02-24 18:43:20,562][177154] Sum rewards: 9.055, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.806', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.117', 'AMMO4': '0.118', 'weapon5': '0.124', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.512', 'WEAPON3': '0.800', 'weapon2': '0.930', 'HITCOUNT': '0.940', 'weapon3': '1.812', 'DAMAGECOUNT': '3.999', 'FRAGCOUNT': '9.000'} [2023-02-24 18:43:20,863][177154] DAMAGECOUNT value on done: 176773.0 [2023-02-24 18:43:20,864][177154] Sum rewards: 10.998, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon7': '0.064', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'HEALTH': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.348', 'AMMO6': '0.400', 'WEAPON7': '0.400', 'AMMO7': '0.400', 'ARMOR': '0.454', 'WEAPON3': '0.500', 'HITCOUNT': '0.750', 'weapon2': '1.086', 'weapon3': '1.350', 'DAMAGECOUNT': '2.397', 'FRAGCOUNT': '9.000'} [2023-02-24 18:43:21,146][177172] DAMAGECOUNT value on done: 173141.0 [2023-02-24 18:43:21,147][177172] Sum rewards: 9.125, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.920', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO3': '0.079', 'weapon5': '0.084', 'WEAPON4': '0.100', 'weapon7': '0.118', 'weapon4': '0.194', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'ARMOR': '0.481', 'WEAPON3': '0.550', 'HITCOUNT': '0.630', 'weapon3': '1.008', 'weapon2': '1.146', 'DAMAGECOUNT': '2.448', 'FRAGCOUNT': '6.000'} [2023-02-24 18:43:21,157][177154] DAMAGECOUNT value on done: 177588.0 [2023-02-24 18:43:21,158][177154] Sum rewards: 16.564, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.080', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.021', 'AMMO2': '0.030', 'AMMO3': '0.098', 'weapon4': '0.108', 'AMMO4': '0.148', 'WEAPON4': '0.300', 'weapon5': '0.386', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '1.110', 'weapon2': '1.114', 'weapon3': '2.006', 'DAMAGECOUNT': '5.409', 'FRAGCOUNT': '14.000'} [2023-02-24 18:43:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.2, 300 sec: 13884.7). Total num frames: 67452928. Throughput: 0: 3473.1. Samples: 16857738. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:43:21,376][177119] Avg episode reward: [(0, '13.317')] [2023-02-24 18:43:21,377][177140] Saving new best policy, reward=13.317! [2023-02-24 18:43:21,461][177172] DAMAGECOUNT value on done: 174291.0 [2023-02-24 18:43:21,461][177172] Sum rewards: 5.263, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.540', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon5': '0.030', 'AMMO3': '0.046', 'weapon7': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.440', 'weapon4': '0.460', 'weapon2': '0.546', 'weapon3': '0.834', 'DAMAGECOUNT': '1.401', 'FRAGCOUNT': '5.000'} [2023-02-24 18:43:21,486][177154] DAMAGECOUNT value on done: 177694.0 [2023-02-24 18:43:21,486][177154] Sum rewards: 5.744, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.390', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.019', 'AMMO3': '0.030', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.052', 'HITCOUNT': '0.200', 'weapon5': '0.214', 'WEAPON3': '0.250', 'WEAPON5': '0.300', 'weapon3': '0.748', 'weapon2': '1.052', 'DAMAGECOUNT': '1.155', 'FRAGCOUNT': '5.000'} [2023-02-24 18:43:21,808][177153] Updated weights for policy 0, policy_version 16470 (0.0008) [2023-02-24 18:43:21,814][177157] DAMAGECOUNT value on done: 164640.0 [2023-02-24 18:43:21,814][177157] Sum rewards: 21.774, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.212', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO3': '0.104', 'AMMO4': '0.128', 'weapon5': '0.148', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.370', 'ARMOR': '0.404', 'WEAPON3': '0.550', 'weapon4': '0.692', 'HITCOUNT': '1.150', 'weapon3': '1.900', 'DAMAGECOUNT': '5.307', 'FRAGCOUNT': '16.000'} [2023-02-24 18:43:21,826][177157] DAMAGECOUNT value on done: 178557.0 [2023-02-24 18:43:21,827][177157] Sum rewards: 18.631, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.812', 'AMMO2': '0.007', 'AMMO5': '0.014', 'ARMOR': '0.020', 'weapon7': '0.024', 'AMMO4': '0.034', 'WEAPON1': '0.040', 'weapon4': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.082', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.218', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '1.070', 'weapon2': '1.260', 'weapon3': '1.882', 'DAMAGECOUNT': '4.446', 'FRAGCOUNT': '15.000'} [2023-02-24 18:43:22,067][177171] DAMAGECOUNT value on done: 166960.0 [2023-02-24 18:43:22,068][177171] Sum rewards: 9.725, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.220', 'ARMOR': '0.004', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO5': '0.025', 'WEAPON1': '0.050', 'AMMO3': '0.112', 'weapon5': '0.228', 'WEAPON4': '0.300', 'weapon4': '0.458', 'weapon2': '0.528', 'WEAPON5': '0.600', 'WEAPON3': '0.850', 'HITCOUNT': '0.850', 'weapon3': '1.852', 'DAMAGECOUNT': '4.308', 'FRAGCOUNT': '10.000'} [2023-02-24 18:43:22,118][177157] DAMAGECOUNT value on done: 168770.0 [2023-02-24 18:43:22,118][177157] Sum rewards: 13.869, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.072', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'AMMO3': '0.126', 'AMMO4': '0.171', 'WEAPON4': '0.200', 'weapon5': '0.230', 'weapon4': '0.312', 'ARMOR': '0.404', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'HITCOUNT': '1.000', 'weapon2': '1.120', 'weapon3': '1.872', 'DAMAGECOUNT': '4.632', 'FRAGCOUNT': '14.000'} [2023-02-24 18:43:22,129][177157] DAMAGECOUNT value on done: 169549.0 [2023-02-24 18:43:22,129][177157] Sum rewards: 9.191, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.390', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon7': '0.042', 'AMMO4': '0.074', 'weapon5': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.111', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.386', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'HITCOUNT': '0.880', 'weapon2': '1.414', 'weapon3': '1.576', 'DAMAGECOUNT': '3.612', 'FRAGCOUNT': '8.000'} [2023-02-24 18:43:22,357][177171] DAMAGECOUNT value on done: 168502.0 [2023-02-24 18:43:22,358][177171] Sum rewards: 14.023, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.446', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.082', 'weapon5': '0.296', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'WEAPON5': '0.450', 'HITCOUNT': '0.790', 'weapon3': '1.210', 'weapon2': '1.958', 'DAMAGECOUNT': '2.985', 'FRAGCOUNT': '11.000'} [2023-02-24 18:43:22,370][177171] DAMAGECOUNT value on done: 176643.0 [2023-02-24 18:43:22,371][177171] Sum rewards: 12.935, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.636', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon7': '0.048', 'weapon5': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.125', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.800', 'HITCOUNT': '1.040', 'weapon2': '1.602', 'weapon3': '1.974', 'DAMAGECOUNT': '3.723', 'FRAGCOUNT': '11.000'} [2023-02-24 18:43:22,657][177171] DAMAGECOUNT value on done: 170633.0 [2023-02-24 18:43:22,658][177171] Sum rewards: 16.397, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'weapon7': '0.066', 'AMMO4': '0.080', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'HEALTH': '0.102', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.164', 'WEAPON7': '0.200', 'WEAPON3': '0.500', 'HITCOUNT': '0.890', 'weapon2': '1.450', 'weapon3': '1.760', 'DAMAGECOUNT': '3.720', 'FRAGCOUNT': '12.000'} [2023-02-24 18:43:23,645][177155] DAMAGECOUNT value on done: 173861.0 [2023-02-24 18:43:23,645][177155] Sum rewards: 15.533, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.893', 'weapon7': '0.002', 'AMMO5': '0.015', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.096', 'weapon5': '0.182', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon2': '0.632', 'weapon4': '0.638', 'WEAPON3': '0.750', 'HITCOUNT': '1.020', 'weapon3': '1.986', 'DAMAGECOUNT': '4.896', 'FRAGCOUNT': '12.000'} [2023-02-24 18:43:23,945][177155] DAMAGECOUNT value on done: 178699.0 [2023-02-24 18:43:23,946][177155] Sum rewards: 10.162, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.891', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon7': '0.066', 'AMMO3': '0.077', 'WEAPON5': '0.100', 'weapon5': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.473', 'weapon4': '0.546', 'HITCOUNT': '1.010', 'weapon2': '1.010', 'weapon3': '1.532', 'DAMAGECOUNT': '4.107', 'FRAGCOUNT': '7.500'} [2023-02-24 18:43:24,388][177155] DAMAGECOUNT value on done: 180296.0 [2023-02-24 18:43:24,388][177155] Sum rewards: 13.573, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.489', 'AMMO5': '0.022', 'AMMO2': '0.024', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'AMMO4': '0.118', 'AMMO3': '0.124', 'WEAPON4': '0.200', 'weapon5': '0.258', 'weapon4': '0.442', 'WEAPON5': '0.550', 'weapon2': '0.648', 'WEAPON3': '0.850', 'HITCOUNT': '1.180', 'weapon3': '1.844', 'DAMAGECOUNT': '4.980', 'FRAGCOUNT': '11.000'} [2023-02-24 18:43:24,689][177155] DAMAGECOUNT value on done: 171022.0 [2023-02-24 18:43:24,689][177155] Sum rewards: 12.989, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.145', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO4': '0.041', 'AMMO3': '0.108', 'weapon7': '0.112', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'weapon4': '0.344', 'weapon5': '0.348', 'WEAPON7': '0.400', 'ARMOR': '0.455', 'WEAPON5': '0.500', 'HITCOUNT': '0.730', 'WEAPON3': '0.750', 'weapon2': '0.942', 'weapon3': '1.644', 'DAMAGECOUNT': '4.680', 'FRAGCOUNT': '12.000'} [2023-02-24 18:43:24,785][177153] Updated weights for policy 0, policy_version 16480 (0.0008) [2023-02-24 18:43:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 67522560. Throughput: 0: 3469.5. Samples: 16878444. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:43:26,376][177119] Avg episode reward: [(0, '13.531')] [2023-02-24 18:43:26,379][177140] Saving new best policy, reward=13.531! [2023-02-24 18:43:27,718][177153] Updated weights for policy 0, policy_version 16490 (0.0008) [2023-02-24 18:43:30,678][177153] Updated weights for policy 0, policy_version 16500 (0.0008) [2023-02-24 18:43:31,223][177156] DAMAGECOUNT value on done: 174082.0 [2023-02-24 18:43:31,223][177156] Sum rewards: 14.659, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.159', 'AMMO5': '0.014', 'AMMO2': '0.015', 'WEAPON1': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.095', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.276', 'weapon4': '0.348', 'WEAPON5': '0.400', 'ARMOR': '0.459', 'WEAPON3': '0.700', 'HITCOUNT': '0.900', 'weapon2': '1.058', 'weapon3': '1.582', 'DAMAGECOUNT': '4.044', 'FRAGCOUNT': '11.000'} [2023-02-24 18:43:31,234][177156] DAMAGECOUNT value on done: 169278.0 [2023-02-24 18:43:31,234][177156] Sum rewards: 16.957, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.380', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'AMMO3': '0.070', 'weapon7': '0.082', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.154', 'weapon5': '0.182', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'HITCOUNT': '0.980', 'weapon2': '1.224', 'weapon3': '1.592', 'DAMAGECOUNT': '4.215', 'FRAGCOUNT': '12.000'} [2023-02-24 18:43:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 67592192. Throughput: 0: 3470.1. Samples: 16899256. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:43:31,376][177119] Avg episode reward: [(0, '13.519')] [2023-02-24 18:43:31,532][177156] DAMAGECOUNT value on done: 173349.0 [2023-02-24 18:43:31,533][177156] Sum rewards: 10.413, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.678', 'AMMO5': '0.015', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.094', 'AMMO3': '0.103', 'weapon5': '0.106', 'weapon7': '0.130', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.676', 'weapon2': '0.690', 'HITCOUNT': '0.780', 'WEAPON3': '0.800', 'weapon3': '1.428', 'DAMAGECOUNT': '3.390', 'FRAGCOUNT': '10.000'} [2023-02-24 18:43:31,546][177156] DAMAGECOUNT value on done: 173192.0 [2023-02-24 18:43:31,546][177156] Sum rewards: 15.650, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.970', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.052', 'AMMO3': '0.124', 'AMMO4': '0.147', 'WEAPON5': '0.200', 'weapon2': '0.278', 'WEAPON4': '0.450', 'ARMOR': '0.459', 'weapon4': '0.810', 'WEAPON3': '0.850', 'HITCOUNT': '1.370', 'weapon3': '2.096', 'DAMAGECOUNT': '4.992', 'FRAGCOUNT': '13.000'} [2023-02-24 18:43:33,629][177153] Updated weights for policy 0, policy_version 16510 (0.0008) [2023-02-24 18:43:34,154][177170] DAMAGECOUNT value on done: 173826.0 [2023-02-24 18:43:34,154][177170] Sum rewards: 16.022, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.980', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO3': '0.050', 'AMMO4': '0.053', 'weapon7': '0.066', 'weapon5': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.476', 'weapon4': '0.508', 'weapon2': '0.600', 'HITCOUNT': '0.890', 'weapon3': '1.184', 'DAMAGECOUNT': '3.564', 'FRAGCOUNT': '12.000'} [2023-02-24 18:43:34,457][177170] DAMAGECOUNT value on done: 180194.0 [2023-02-24 18:43:34,457][177170] Sum rewards: 7.540, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.288', 'AMMO2': '0.004', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.021', 'weapon7': '0.048', 'WEAPON4': '0.050', 'weapon5': '0.066', 'AMMO3': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.202', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'weapon2': '0.742', 'weapon3': '1.104', 'DAMAGECOUNT': '2.529', 'FRAGCOUNT': '8.000'} [2023-02-24 18:43:34,685][177170] DAMAGECOUNT value on done: 170136.0 [2023-02-24 18:43:34,686][177170] Sum rewards: 9.059, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.541', 'AMMO2': '0.009', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.044', 'AMMO3': '0.070', 'weapon5': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'weapon4': '0.542', 'weapon2': '0.724', 'HITCOUNT': '0.800', 'weapon3': '1.464', 'DAMAGECOUNT': '2.940', 'FRAGCOUNT': '7.000'} [2023-02-24 18:43:34,991][177170] DAMAGECOUNT value on done: 170821.0 [2023-02-24 18:43:34,992][177170] Sum rewards: 13.226, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.980', 'AMMO5': '0.005', 'AMMO2': '0.023', 'AMMO3': '0.099', 'weapon5': '0.110', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'weapon4': '0.526', 'WEAPON3': '0.650', 'weapon2': '0.946', 'HITCOUNT': '0.980', 'weapon3': '1.480', 'DAMAGECOUNT': '3.774', 'FRAGCOUNT': '11.000'} [2023-02-24 18:43:35,553][177158] DAMAGECOUNT value on done: 165385.0 [2023-02-24 18:43:35,553][177158] Sum rewards: 8.704, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.641', 'AMMO2': '0.016', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.060', 'AMMO4': '0.078', 'WEAPON4': '0.200', 'weapon5': '0.238', 'weapon4': '0.338', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'HITCOUNT': '0.770', 'weapon3': '1.330', 'weapon2': '1.534', 'DAMAGECOUNT': '2.643', 'FRAGCOUNT': '6.000'} [2023-02-24 18:43:35,854][177158] DAMAGECOUNT value on done: 170715.0 [2023-02-24 18:43:35,855][177158] Sum rewards: 9.722, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.830', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.023', 'WEAPON1': '0.030', 'weapon5': '0.062', 'weapon7': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.121', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.488', 'WEAPON3': '0.700', 'weapon2': '1.026', 'HITCOUNT': '1.090', 'weapon3': '1.686', 'DAMAGECOUNT': '3.906', 'FRAGCOUNT': '11.000'} [2023-02-24 18:43:36,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.2, 300 sec: 13884.7). Total num frames: 67661824. Throughput: 0: 3467.8. Samples: 16909626. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:43:36,376][177119] Avg episode reward: [(0, '13.270')] [2023-02-24 18:43:36,576][177153] Updated weights for policy 0, policy_version 16520 (0.0008) [2023-02-24 18:43:36,731][177158] DAMAGECOUNT value on done: 176046.0 [2023-02-24 18:43:36,731][177158] Sum rewards: 18.370, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.246', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon7': '0.022', 'AMMO5': '0.022', 'AMMO4': '0.075', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.120', 'weapon5': '0.174', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'HITCOUNT': '1.020', 'weapon2': '1.438', 'weapon3': '1.880', 'DAMAGECOUNT': '5.139', 'FRAGCOUNT': '14.000'} [2023-02-24 18:43:37,031][177158] DAMAGECOUNT value on done: 173548.0 [2023-02-24 18:43:37,031][177158] Sum rewards: 8.074, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.880', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'weapon4': '0.024', 'weapon7': '0.038', 'weapon5': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.151', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.800', 'WEAPON3': '1.050', 'weapon2': '1.558', 'weapon3': '2.050', 'DAMAGECOUNT': '3.903', 'FRAGCOUNT': '11.000'} [2023-02-24 18:43:38,572][177172] DAMAGECOUNT value on done: 175206.0 [2023-02-24 18:43:38,573][177172] Sum rewards: 12.402, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.443', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.140', 'weapon5': '0.178', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.429', 'weapon4': '0.486', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'weapon2': '0.924', 'HITCOUNT': '1.060', 'weapon3': '2.004', 'DAMAGECOUNT': '5.148', 'FRAGCOUNT': '11.000'} [2023-02-24 18:43:38,872][177172] DAMAGECOUNT value on done: 172926.0 [2023-02-24 18:43:38,872][177172] Sum rewards: 12.427, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.232', 'AMMO2': '0.010', 'AMMO5': '0.013', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'AMMO3': '0.133', 'weapon5': '0.144', 'weapon4': '0.162', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'ARMOR': '0.854', 'weapon2': '0.922', 'HITCOUNT': '1.070', 'weapon3': '2.046', 'DAMAGECOUNT': '4.353', 'FRAGCOUNT': '10.000'} [2023-02-24 18:43:39,524][177153] Updated weights for policy 0, policy_version 16530 (0.0009) [2023-02-24 18:43:39,980][177154] DAMAGECOUNT value on done: 177777.0 [2023-02-24 18:43:39,980][177154] Sum rewards: 12.043, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.837', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'weapon7': '0.054', 'AMMO3': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.268', 'WEAPON3': '0.450', 'ARMOR': '0.499', 'HITCOUNT': '0.830', 'weapon3': '1.146', 'weapon2': '1.864', 'DAMAGECOUNT': '3.312', 'FRAGCOUNT': '9.000'} [2023-02-24 18:43:40,281][177154] DAMAGECOUNT value on done: 179109.0 [2023-02-24 18:43:40,282][177154] Sum rewards: 26.308, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.150', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'ARMOR': '0.016', 'AMMO4': '0.048', 'AMMO3': '0.141', 'WEAPON5': '0.200', 'weapon5': '0.208', 'WEAPON4': '0.250', 'weapon4': '0.496', 'weapon2': '0.726', 'WEAPON3': '0.900', 'HITCOUNT': '1.460', 'weapon3': '1.978', 'DAMAGECOUNT': '7.008', 'FRAGCOUNT': '23.000'} [2023-02-24 18:43:40,542][177172] DAMAGECOUNT value on done: 174619.0 [2023-02-24 18:43:40,542][177172] Sum rewards: 16.760, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.282', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'weapon4': '0.222', 'weapon5': '0.286', 'WEAPON5': '0.350', 'WEAPON3': '0.950', 'HITCOUNT': '1.050', 'weapon2': '1.080', 'weapon3': '1.914', 'DAMAGECOUNT': '4.434', 'FRAGCOUNT': '17.000'} [2023-02-24 18:43:40,584][177154] DAMAGECOUNT value on done: 178926.0 [2023-02-24 18:43:40,585][177154] Sum rewards: 10.603, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.440', 'AMMO5': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.085', 'AMMO3': '0.094', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.100', 'weapon5': '0.226', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'HITCOUNT': '0.900', 'weapon3': '1.368', 'weapon2': '1.706', 'DAMAGECOUNT': '4.014', 'FRAGCOUNT': '8.000'} [2023-02-24 18:43:40,839][177172] DAMAGECOUNT value on done: 176257.0 [2023-02-24 18:43:40,840][177172] Sum rewards: 22.718, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.331', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO3': '0.083', 'weapon5': '0.146', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '1.250', 'weapon2': '1.652', 'weapon3': '1.914', 'DAMAGECOUNT': '5.898', 'FRAGCOUNT': '17.000'} [2023-02-24 18:43:40,882][177154] DAMAGECOUNT value on done: 178935.0 [2023-02-24 18:43:40,883][177154] Sum rewards: 5.247, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.691', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.027', 'AMMO3': '0.121', 'AMMO4': '0.135', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon5': '0.386', 'ARMOR': '0.404', 'weapon4': '0.622', 'WEAPON3': '0.650', 'HITCOUNT': '0.980', 'weapon2': '1.042', 'weapon3': '1.368', 'DAMAGECOUNT': '3.723', 'FRAGCOUNT': '5.500'} [2023-02-24 18:43:41,197][177157] DAMAGECOUNT value on done: 165564.0 [2023-02-24 18:43:41,197][177157] Sum rewards: 13.448, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.267', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.049', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.142', 'WEAPON5': '0.200', 'WEAPON3': '0.300', 'weapon4': '0.312', 'ARMOR': '0.461', 'HITCOUNT': '0.730', 'weapon3': '1.258', 'weapon2': '1.796', 'DAMAGECOUNT': '2.772', 'FRAGCOUNT': '10.000'} [2023-02-24 18:43:41,208][177157] DAMAGECOUNT value on done: 179615.0 [2023-02-24 18:43:41,209][177157] Sum rewards: 8.115, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.604', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.027', 'WEAPON1': '0.040', 'AMMO3': '0.098', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.146', 'WEAPON4': '0.150', 'weapon4': '0.196', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '0.830', 'weapon3': '1.626', 'weapon2': '1.664', 'DAMAGECOUNT': '3.174', 'FRAGCOUNT': '7.000'} [2023-02-24 18:43:41,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13884.8). Total num frames: 67731456. Throughput: 0: 3467.2. Samples: 16930456. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:43:41,376][177119] Avg episode reward: [(0, '13.323')] [2023-02-24 18:43:41,455][177171] DAMAGECOUNT value on done: 168403.0 [2023-02-24 18:43:41,456][177171] Sum rewards: 13.101, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.414', 'AMMO2': '0.009', 'AMMO5': '0.015', 'AMMO4': '0.046', 'AMMO3': '0.115', 'weapon5': '0.262', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'HITCOUNT': '1.080', 'weapon3': '1.742', 'weapon2': '1.766', 'DAMAGECOUNT': '4.329', 'FRAGCOUNT': '11.000'} [2023-02-24 18:43:41,504][177157] DAMAGECOUNT value on done: 169815.0 [2023-02-24 18:43:41,505][177157] Sum rewards: 9.827, reward structure: {'DEATHCOUNT': '-6.000', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'weapon7': '0.054', 'AMMO3': '0.083', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.204', 'weapon4': '0.228', 'HEALTH': '0.414', 'WEAPON3': '0.450', 'WEAPON5': '0.450', 'HITCOUNT': '0.740', 'weapon2': '1.104', 'weapon3': '1.380', 'DAMAGECOUNT': '3.135', 'FRAGCOUNT': '7.000'} [2023-02-24 18:43:41,515][177157] DAMAGECOUNT value on done: 170941.0 [2023-02-24 18:43:41,516][177157] Sum rewards: 14.994, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.061', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'weapon7': '0.110', 'AMMO3': '0.117', 'weapon5': '0.178', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.222', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.798', 'WEAPON3': '0.800', 'HITCOUNT': '1.020', 'weapon3': '1.974', 'DAMAGECOUNT': '4.176', 'FRAGCOUNT': '13.000'} [2023-02-24 18:43:41,743][177171] DAMAGECOUNT value on done: 169054.0 [2023-02-24 18:43:41,744][177171] Sum rewards: 2.572, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.510', 'AMMO2': '0.001', 'AMMO4': '0.005', 'weapon5': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'AMMO3': '0.076', 'weapon7': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'weapon4': '0.436', 'HITCOUNT': '0.490', 'WEAPON3': '0.550', 'weapon2': '0.836', 'weapon3': '1.106', 'DAMAGECOUNT': '1.656', 'FRAGCOUNT': '2.000'} [2023-02-24 18:43:41,754][177171] DAMAGECOUNT value on done: 177593.0 [2023-02-24 18:43:41,755][177171] Sum rewards: 7.516, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.627', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'weapon7': '0.058', 'WEAPON1': '0.070', 'AMMO3': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.188', 'weapon4': '0.216', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.670', 'weapon2': '0.888', 'weapon3': '1.598', 'DAMAGECOUNT': '2.685', 'FRAGCOUNT': '7.000'} [2023-02-24 18:43:42,057][177171] DAMAGECOUNT value on done: 171557.0 [2023-02-24 18:43:42,057][177171] Sum rewards: 5.735, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.580', 'AMMO5': '0.006', 'AMMO2': '0.014', 'ARMOR': '0.028', 'weapon5': '0.034', 'AMMO4': '0.071', 'weapon7': '0.080', 'AMMO3': '0.083', 'WEAPON5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.264', 'WEAPON7': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.730', 'weapon2': '1.272', 'weapon3': '1.520', 'DAMAGECOUNT': '2.772', 'FRAGCOUNT': '7.000'} [2023-02-24 18:43:42,474][177153] Updated weights for policy 0, policy_version 16540 (0.0008) [2023-02-24 18:43:43,021][177155] DAMAGECOUNT value on done: 174906.0 [2023-02-24 18:43:43,021][177155] Sum rewards: 11.579, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.523', 'AMMO4': '-0.074', 'AMMO2': '-0.015', 'AMMO5': '0.013', 'WEAPON4': '0.050', 'weapon7': '0.052', 'weapon4': '0.056', 'AMMO3': '0.082', 'weapon5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.476', 'WEAPON3': '0.700', 'HITCOUNT': '0.820', 'weapon3': '1.572', 'weapon2': '1.744', 'DAMAGECOUNT': '3.135', 'FRAGCOUNT': '9.000'} [2023-02-24 18:43:43,326][177155] DAMAGECOUNT value on done: 179866.0 [2023-02-24 18:43:43,326][177155] Sum rewards: 12.481, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.386', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO3': '0.084', 'AMMO4': '0.103', 'weapon5': '0.142', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.282', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'weapon2': '0.836', 'HITCOUNT': '0.940', 'weapon3': '1.448', 'DAMAGECOUNT': '3.501', 'FRAGCOUNT': '11.000'} [2023-02-24 18:43:43,781][177155] DAMAGECOUNT value on done: 181081.0 [2023-02-24 18:43:43,782][177155] Sum rewards: 10.997, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.614', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO3': '0.047', 'weapon7': '0.056', 'AMMO4': '0.098', 'weapon5': '0.130', 'WEAPON5': '0.150', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON3': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.606', 'HITCOUNT': '0.630', 'weapon2': '0.830', 'weapon3': '0.834', 'DAMAGECOUNT': '2.355', 'FRAGCOUNT': '8.000'} [2023-02-24 18:43:44,090][177155] DAMAGECOUNT value on done: 172232.0 [2023-02-24 18:43:44,090][177155] Sum rewards: 10.636, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.173', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.061', 'AMMO3': '0.085', 'weapon5': '0.110', 'WEAPON5': '0.250', 'weapon4': '0.306', 'WEAPON4': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.770', 'weapon3': '1.306', 'weapon2': '1.764', 'DAMAGECOUNT': '3.630', 'FRAGCOUNT': '11.000'} [2023-02-24 18:43:45,410][177153] Updated weights for policy 0, policy_version 16550 (0.0008) [2023-02-24 18:43:46,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.2, 300 sec: 13884.7). Total num frames: 67801088. Throughput: 0: 3467.5. Samples: 16951288. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 18:43:46,376][177119] Avg episode reward: [(0, '13.098')] [2023-02-24 18:43:48,375][177153] Updated weights for policy 0, policy_version 16560 (0.0008) [2023-02-24 18:43:50,670][177156] DAMAGECOUNT value on done: 175241.0 [2023-02-24 18:43:50,671][177156] Sum rewards: 11.353, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.764', 'AMMO2': '0.012', 'AMMO5': '0.015', 'ARMOR': '0.032', 'AMMO4': '0.058', 'AMMO3': '0.115', 'WEAPON4': '0.150', 'weapon5': '0.204', 'weapon4': '0.242', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'HITCOUNT': '0.840', 'weapon2': '1.014', 'weapon3': '2.108', 'DAMAGECOUNT': '3.477', 'FRAGCOUNT': '11.000'} [2023-02-24 18:43:50,685][177156] DAMAGECOUNT value on done: 171030.0 [2023-02-24 18:43:50,685][177156] Sum rewards: 19.528, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.080', 'AMMO2': '0.013', 'ARMOR': '0.015', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.066', 'weapon4': '0.070', 'WEAPON4': '0.100', 'weapon5': '0.112', 'AMMO3': '0.133', 'WEAPON5': '0.450', 'WEAPON3': '0.900', 'HITCOUNT': '1.130', 'weapon2': '1.156', 'weapon3': '2.166', 'DAMAGECOUNT': '5.256', 'FRAGCOUNT': '18.000'} [2023-02-24 18:43:50,973][177156] DAMAGECOUNT value on done: 175455.0 [2023-02-24 18:43:50,974][177156] Sum rewards: 14.572, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.656', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.089', 'weapon7': '0.136', 'weapon5': '0.182', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.350', 'weapon4': '0.384', 'WEAPON7': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.760', 'weapon2': '1.226', 'weapon3': '1.364', 'DAMAGECOUNT': '4.818', 'FRAGCOUNT': '11.000'} [2023-02-24 18:43:50,986][177156] DAMAGECOUNT value on done: 174430.0 [2023-02-24 18:43:50,986][177156] Sum rewards: 15.237, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.010', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.072', 'HEALTH': '0.110', 'weapon7': '0.142', 'weapon4': '0.166', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.218', 'WEAPON3': '0.500', 'HITCOUNT': '0.790', 'weapon2': '1.336', 'weapon3': '1.544', 'DAMAGECOUNT': '3.669', 'FRAGCOUNT': '11.000'} [2023-02-24 18:43:51,311][177153] Updated weights for policy 0, policy_version 16570 (0.0008) [2023-02-24 18:43:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 67870720. Throughput: 0: 3467.4. Samples: 16961702. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 18:43:51,376][177119] Avg episode reward: [(0, '13.152')] [2023-02-24 18:43:53,551][177170] DAMAGECOUNT value on done: 174778.0 [2023-02-24 18:43:53,551][177170] Sum rewards: 13.347, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'AMMO2': '0.023', 'ARMOR': '0.024', 'weapon7': '0.052', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'weapon5': '0.128', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'weapon4': '0.292', 'WEAPON3': '0.350', 'HEALTH': '0.424', 'HITCOUNT': '0.690', 'weapon3': '1.444', 'weapon2': '1.586', 'DAMAGECOUNT': '2.856', 'FRAGCOUNT': '9.000'} [2023-02-24 18:43:53,854][177170] DAMAGECOUNT value on done: 181337.0 [2023-02-24 18:43:53,855][177170] Sum rewards: 11.122, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.702', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon7': '0.046', 'weapon5': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.104', 'AMMO4': '0.111', 'AMMO3': '0.116', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.900', 'weapon3': '1.534', 'weapon2': '1.950', 'DAMAGECOUNT': '3.429', 'FRAGCOUNT': '10.000'} [2023-02-24 18:43:54,077][177170] DAMAGECOUNT value on done: 171213.0 [2023-02-24 18:43:54,078][177170] Sum rewards: 5.763, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.532', 'AMMO2': '0.003', 'AMMO5': '0.015', 'AMMO4': '0.017', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.130', 'AMMO3': '0.138', 'weapon5': '0.140', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'HITCOUNT': '0.990', 'weapon2': '1.232', 'weapon3': '2.118', 'DAMAGECOUNT': '3.231', 'FRAGCOUNT': '6.000'} [2023-02-24 18:43:54,244][177153] Updated weights for policy 0, policy_version 16580 (0.0009) [2023-02-24 18:43:54,379][177170] DAMAGECOUNT value on done: 172003.0 [2023-02-24 18:43:54,380][177170] Sum rewards: 13.630, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.610', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO4': '0.073', 'AMMO3': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.272', 'weapon4': '0.284', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.800', 'weapon3': '1.378', 'weapon2': '1.516', 'DAMAGECOUNT': '3.546', 'FRAGCOUNT': '11.000'} [2023-02-24 18:43:54,864][177158] DAMAGECOUNT value on done: 166406.0 [2023-02-24 18:43:54,865][177158] Sum rewards: 9.033, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.722', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.013', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.084', 'WEAPON4': '0.150', 'weapon7': '0.196', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon2': '0.368', 'weapon4': '0.422', 'WEAPON3': '0.600', 'HITCOUNT': '0.830', 'weapon3': '1.376', 'DAMAGECOUNT': '3.063', 'FRAGCOUNT': '7.000'} [2023-02-24 18:43:55,161][177158] DAMAGECOUNT value on done: 171992.0 [2023-02-24 18:43:55,162][177158] Sum rewards: 17.453, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.030', 'ARMOR': '0.036', 'weapon7': '0.058', 'AMMO3': '0.067', 'AMMO4': '0.149', 'weapon5': '0.168', 'HEALTH': '0.178', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'weapon4': '0.512', 'HITCOUNT': '0.710', 'weapon2': '1.120', 'weapon3': '1.286', 'DAMAGECOUNT': '3.831', 'FRAGCOUNT': '13.000'} [2023-02-24 18:43:56,036][177158] DAMAGECOUNT value on done: 177100.0 [2023-02-24 18:43:56,037][177158] Sum rewards: 5.201, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.355', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'AMMO5': '0.010', 'weapon7': '0.048', 'AMMO3': '0.059', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.266', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.600', 'weapon3': '0.996', 'weapon2': '1.654', 'DAMAGECOUNT': '3.162', 'FRAGCOUNT': '6.000'} [2023-02-24 18:43:56,341][177158] DAMAGECOUNT value on done: 175217.0 [2023-02-24 18:43:56,342][177158] Sum rewards: 13.306, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.228', 'AMMO2': '0.008', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.039', 'WEAPON4': '0.100', 'AMMO3': '0.145', 'weapon5': '0.168', 'weapon4': '0.194', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '1.000', 'weapon2': '1.426', 'weapon3': '1.900', 'DAMAGECOUNT': '5.007', 'FRAGCOUNT': '13.000'} [2023-02-24 18:43:56,376][177119] Fps is (10 sec: 13926.2, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 67940352. Throughput: 0: 3467.5. Samples: 16982562. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:43:56,376][177119] Avg episode reward: [(0, '12.933')] [2023-02-24 18:43:57,189][177153] Updated weights for policy 0, policy_version 16590 (0.0009) [2023-02-24 18:43:57,274][177155] Large shaping reward 2.604 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.582, 194.0), ('weapon2', 0.002)] [2023-02-24 18:43:57,845][177172] DAMAGECOUNT value on done: 175969.0 [2023-02-24 18:43:57,845][177172] Sum rewards: 6.960, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.764', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'AMMO3': '0.040', 'weapon5': '0.068', 'weapon7': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon4': '0.182', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'WEAPON3': '0.300', 'ARMOR': '0.457', 'HITCOUNT': '0.570', 'weapon3': '0.940', 'weapon2': '1.496', 'DAMAGECOUNT': '2.289', 'FRAGCOUNT': '5.000'} [2023-02-24 18:43:58,149][177172] DAMAGECOUNT value on done: 174433.0 [2023-02-24 18:43:58,149][177172] Sum rewards: 15.840, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.985', 'AMMO4': '-0.073', 'AMMO2': '-0.014', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'weapon4': '0.152', 'weapon5': '0.174', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.450', 'ARMOR': '0.476', 'WEAPON3': '0.700', 'HITCOUNT': '1.050', 'weapon2': '1.608', 'weapon3': '1.690', 'DAMAGECOUNT': '4.521', 'FRAGCOUNT': '13.000'} [2023-02-24 18:43:59,339][177154] DAMAGECOUNT value on done: 178944.0 [2023-02-24 18:43:59,339][177154] Sum rewards: 14.789, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.500', 'AMMO4': '-0.018', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.076', 'weapon5': '0.112', 'WEAPON5': '0.150', 'weapon7': '0.166', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.680', 'weapon2': '1.260', 'weapon3': '1.550', 'DAMAGECOUNT': '3.501', 'FRAGCOUNT': '11.000'} [2023-02-24 18:43:59,630][177154] DAMAGECOUNT value on done: 181155.0 [2023-02-24 18:43:59,631][177154] Sum rewards: 14.969, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.220', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon5': '0.062', 'AMMO3': '0.115', 'AMMO4': '0.164', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.516', 'weapon2': '0.682', 'WEAPON3': '0.800', 'HITCOUNT': '1.480', 'weapon3': '2.284', 'DAMAGECOUNT': '6.138', 'FRAGCOUNT': '13.000'} [2023-02-24 18:43:59,839][177172] DAMAGECOUNT value on done: 175946.0 [2023-02-24 18:43:59,839][177172] Sum rewards: 16.225, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.380', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.070', 'AMMO4': '0.085', 'weapon7': '0.144', 'weapon4': '0.188', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '1.030', 'weapon2': '1.304', 'weapon3': '1.576', 'DAMAGECOUNT': '3.981', 'FRAGCOUNT': '12.000'} [2023-02-24 18:43:59,936][177154] DAMAGECOUNT value on done: 180231.0 [2023-02-24 18:43:59,936][177154] Sum rewards: 13.088, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.425', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.008', 'WEAPON4': '0.050', 'weapon7': '0.052', 'AMMO3': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.144', 'weapon4': '0.146', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.650', 'HITCOUNT': '0.880', 'weapon2': '1.466', 'weapon3': '1.690', 'DAMAGECOUNT': '3.915', 'FRAGCOUNT': '10.000'} [2023-02-24 18:44:00,070][177158] Large shaping reward 3.652 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:44:00,141][177153] Updated weights for policy 0, policy_version 16600 (0.0008) [2023-02-24 18:44:00,142][177172] DAMAGECOUNT value on done: 177255.0 [2023-02-24 18:44:00,142][177172] Sum rewards: 8.658, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.114', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.049', 'weapon7': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.168', 'WEAPON7': '0.200', 'weapon4': '0.226', 'WEAPON5': '0.300', 'HITCOUNT': '0.670', 'WEAPON3': '0.700', 'weapon2': '1.214', 'weapon3': '1.436', 'DAMAGECOUNT': '2.994', 'FRAGCOUNT': '8.000'} [2023-02-24 18:44:00,236][177154] DAMAGECOUNT value on done: 179549.0 [2023-02-24 18:44:00,237][177154] Sum rewards: 7.090, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.978', 'AMMO5': '0.004', 'AMMO2': '0.004', 'AMMO4': '0.020', 'weapon5': '0.026', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'weapon7': '0.184', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'weapon4': '0.360', 'WEAPON7': '0.400', 'HITCOUNT': '0.490', 'ARMOR': '0.492', 'WEAPON3': '0.500', 'weapon2': '0.998', 'weapon3': '1.108', 'DAMAGECOUNT': '1.842', 'FRAGCOUNT': '6.000'} [2023-02-24 18:44:00,522][177157] DAMAGECOUNT value on done: 166676.0 [2023-02-24 18:44:00,522][177157] Sum rewards: 10.232, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.280', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.089', 'weapon5': '0.182', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'HITCOUNT': '0.860', 'weapon2': '1.330', 'weapon3': '1.512', 'DAMAGECOUNT': '3.336', 'FRAGCOUNT': '9.000'} [2023-02-24 18:44:00,534][177157] DAMAGECOUNT value on done: 181425.0 [2023-02-24 18:44:00,534][177157] Sum rewards: 13.342, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.120', 'AMMO5': '0.015', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon7': '0.052', 'AMMO4': '0.088', 'AMMO3': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.158', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.520', 'WEAPON3': '0.650', 'HITCOUNT': '0.840', 'weapon2': '1.048', 'weapon3': '1.390', 'DAMAGECOUNT': '4.464', 'FRAGCOUNT': '9.500'} [2023-02-24 18:44:00,797][177171] DAMAGECOUNT value on done: 169517.0 [2023-02-24 18:44:00,798][177171] Sum rewards: 9.700, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.208', 'AMMO2': '0.017', 'ARMOR': '0.020', 'AMMO5': '0.022', 'WEAPON1': '0.050', 'AMMO4': '0.085', 'AMMO3': '0.111', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.256', 'WEAPON4': '0.350', 'weapon4': '0.450', 'WEAPON5': '0.500', 'HITCOUNT': '0.640', 'WEAPON3': '0.700', 'weapon2': '0.784', 'weapon3': '1.980', 'DAMAGECOUNT': '3.342', 'FRAGCOUNT': '10.000'} [2023-02-24 18:44:00,826][177157] DAMAGECOUNT value on done: 170756.0 [2023-02-24 18:44:00,827][177157] Sum rewards: 8.853, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.950', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO3': '0.050', 'weapon7': '0.056', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.202', 'weapon4': '0.206', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'ARMOR': '0.458', 'HITCOUNT': '0.510', 'weapon3': '1.220', 'weapon2': '1.452', 'DAMAGECOUNT': '2.823', 'FRAGCOUNT': '6.000'} [2023-02-24 18:44:00,838][177157] DAMAGECOUNT value on done: 172086.0 [2023-02-24 18:44:00,838][177157] Sum rewards: 9.232, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.832', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.044', 'weapon7': '0.050', 'weapon4': '0.060', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.168', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.650', 'HITCOUNT': '0.870', 'weapon2': '1.228', 'weapon3': '1.642', 'DAMAGECOUNT': '3.435', 'FRAGCOUNT': '7.000'} [2023-02-24 18:44:01,096][177171] DAMAGECOUNT value on done: 169979.0 [2023-02-24 18:44:01,097][177171] Sum rewards: 11.504, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.365', 'AMMO5': '0.007', 'AMMO2': '0.028', 'ARMOR': '0.040', 'AMMO3': '0.080', 'weapon5': '0.090', 'AMMO4': '0.139', 'WEAPON5': '0.200', 'weapon4': '0.234', 'WEAPON4': '0.250', 'WEAPON3': '0.600', 'HITCOUNT': '0.770', 'weapon3': '1.496', 'weapon2': '1.910', 'DAMAGECOUNT': '2.775', 'FRAGCOUNT': '10.000'} [2023-02-24 18:44:01,106][177171] DAMAGECOUNT value on done: 178916.0 [2023-02-24 18:44:01,106][177171] Sum rewards: 10.183, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.625', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'AMMO3': '0.098', 'AMMO4': '0.101', 'weapon5': '0.118', 'WEAPON5': '0.150', 'weapon7': '0.160', 'WEAPON4': '0.200', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.570', 'HITCOUNT': '0.980', 'weapon2': '1.222', 'weapon3': '1.362', 'DAMAGECOUNT': '3.969', 'FRAGCOUNT': '7.000'} [2023-02-24 18:44:01,376][177119] Fps is (10 sec: 13926.0, 60 sec: 13926.3, 300 sec: 13898.6). Total num frames: 68009984. Throughput: 0: 3470.2. Samples: 17003450. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:44:01,377][177119] Avg episode reward: [(0, '12.656')] [2023-02-24 18:44:01,403][177171] DAMAGECOUNT value on done: 172544.0 [2023-02-24 18:44:01,403][177171] Sum rewards: 3.825, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.280', 'AMMO2': '0.014', 'AMMO5': '0.022', 'WEAPON1': '0.050', 'weapon7': '0.056', 'AMMO4': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.130', 'WEAPON7': '0.200', 'weapon5': '0.230', 'WEAPON4': '0.350', 'weapon4': '0.358', 'WEAPON5': '0.600', 'HITCOUNT': '0.600', 'WEAPON3': '0.850', 'weapon2': '1.202', 'weapon3': '1.672', 'DAMAGECOUNT': '2.961', 'FRAGCOUNT': '7.000'} [2023-02-24 18:44:02,328][177155] DAMAGECOUNT value on done: 175857.0 [2023-02-24 18:44:02,329][177155] Sum rewards: 9.075, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO3': '0.044', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.104', 'AMMO4': '0.193', 'WEAPON5': '0.200', 'WEAPON3': '0.250', 'WEAPON4': '0.250', 'HEALTH': '0.368', 'weapon4': '0.570', 'HITCOUNT': '0.620', 'weapon3': '0.798', 'weapon2': '0.928', 'DAMAGECOUNT': '2.853', 'FRAGCOUNT': '6.000'} [2023-02-24 18:44:02,353][177172] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-24 18:44:02,624][177155] DAMAGECOUNT value on done: 180513.0 [2023-02-24 18:44:02,624][177155] Sum rewards: 6.128, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.150', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'weapon7': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.230', 'WEAPON5': '0.400', 'HITCOUNT': '0.410', 'WEAPON3': '0.500', 'weapon2': '0.954', 'weapon3': '1.300', 'DAMAGECOUNT': '1.941', 'FRAGCOUNT': '4.000'} [2023-02-24 18:44:03,053][177153] Updated weights for policy 0, policy_version 16610 (0.0008) [2023-02-24 18:44:03,094][177155] DAMAGECOUNT value on done: 181692.0 [2023-02-24 18:44:03,094][177155] Sum rewards: 1.425, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.840', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.074', 'weapon5': '0.102', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.510', 'weapon3': '1.134', 'weapon2': '1.284', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.833'} [2023-02-24 18:44:03,392][177155] DAMAGECOUNT value on done: 173081.0 [2023-02-24 18:44:03,393][177155] Sum rewards: 6.148, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.690', 'AMMO5': '0.015', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'ARMOR': '0.072', 'AMMO3': '0.084', 'AMMO4': '0.093', 'weapon5': '0.114', 'WEAPON4': '0.200', 'weapon4': '0.232', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.600', 'weapon2': '1.020', 'weapon3': '1.612', 'DAMAGECOUNT': '2.547', 'FRAGCOUNT': '6.000'} [2023-02-24 18:44:05,987][177153] Updated weights for policy 0, policy_version 16620 (0.0008) [2023-02-24 18:44:06,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 68079616. Throughput: 0: 3472.7. Samples: 17014010. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:44:06,376][177119] Avg episode reward: [(0, '12.234')] [2023-02-24 18:44:08,926][177153] Updated weights for policy 0, policy_version 16630 (0.0008) [2023-02-24 18:44:09,972][177156] DAMAGECOUNT value on done: 176407.0 [2023-02-24 18:44:09,972][177156] Sum rewards: 6.645, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.650', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.021', 'WEAPON4': '0.050', 'weapon4': '0.056', 'WEAPON1': '0.080', 'AMMO3': '0.128', 'weapon5': '0.238', 'WEAPON5': '0.600', 'HITCOUNT': '0.840', 'WEAPON3': '1.000', 'weapon2': '1.370', 'weapon3': '1.904', 'DAMAGECOUNT': '3.498', 'FRAGCOUNT': '7.000'} [2023-02-24 18:44:09,982][177156] DAMAGECOUNT value on done: 171642.0 [2023-02-24 18:44:09,982][177156] Sum rewards: 1.198, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.936', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.034', 'AMMO3': '0.111', 'weapon5': '0.162', 'AMMO4': '0.167', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'HITCOUNT': '0.520', 'weapon4': '0.644', 'WEAPON3': '0.700', 'weapon2': '0.972', 'weapon3': '1.710', 'DAMAGECOUNT': '1.836', 'FRAGCOUNT': '4.000'} [2023-02-24 18:44:10,282][177156] DAMAGECOUNT value on done: 176607.0 [2023-02-24 18:44:10,283][177156] Sum rewards: 9.490, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.088', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.052', 'weapon7': '0.072', 'AMMO4': '0.076', 'AMMO3': '0.098', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.500', 'WEAPON3': '0.700', 'HITCOUNT': '0.720', 'weapon2': '1.428', 'weapon3': '1.482', 'DAMAGECOUNT': '3.282', 'FRAGCOUNT': '8.000'} [2023-02-24 18:44:10,293][177156] DAMAGECOUNT value on done: 174885.0 [2023-02-24 18:44:10,293][177156] Sum rewards: 4.201, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.034', 'AMMO3': '0.054', 'weapon7': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HEALTH': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.238', 'WEAPON3': '0.300', 'HITCOUNT': '0.330', 'weapon2': '0.650', 'weapon3': '1.082', 'DAMAGECOUNT': '1.365', 'FRAGCOUNT': '3.000'} [2023-02-24 18:44:11,376][177119] Fps is (10 sec: 13926.8, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 68149248. Throughput: 0: 3475.9. Samples: 17034860. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:44:11,376][177119] Avg episode reward: [(0, '11.786')] [2023-02-24 18:44:11,867][177153] Updated weights for policy 0, policy_version 16640 (0.0008) [2023-02-24 18:44:12,852][177170] DAMAGECOUNT value on done: 175842.0 [2023-02-24 18:44:12,852][177170] Sum rewards: 11.674, reward structure: {'DEATHCOUNT': '-6.000', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.045', 'ARMOR': '0.068', 'AMMO3': '0.091', 'weapon5': '0.120', 'WEAPON4': '0.200', 'AMMO4': '0.225', 'WEAPON5': '0.250', 'HEALTH': '0.280', 'weapon2': '0.524', 'WEAPON3': '0.550', 'HITCOUNT': '0.800', 'weapon4': '0.886', 'weapon3': '1.420', 'DAMAGECOUNT': '3.192', 'FRAGCOUNT': '9.000'} [2023-02-24 18:44:13,156][177170] DAMAGECOUNT value on done: 182307.0 [2023-02-24 18:44:13,156][177170] Sum rewards: 10.419, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.292', 'AMMO5': '0.014', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon4': '0.020', 'AMMO4': '0.087', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'weapon5': '0.100', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.900', 'weapon2': '1.550', 'weapon3': '1.654', 'DAMAGECOUNT': '2.910', 'FRAGCOUNT': '8.000'} [2023-02-24 18:44:13,377][177170] DAMAGECOUNT value on done: 172669.0 [2023-02-24 18:44:13,377][177170] Sum rewards: 14.269, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.826', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.085', 'AMMO3': '0.119', 'weapon5': '0.122', 'WEAPON5': '0.200', 'weapon4': '0.200', 'ARMOR': '0.498', 'WEAPON3': '0.650', 'HITCOUNT': '1.040', 'weapon3': '1.608', 'weapon2': '1.610', 'DAMAGECOUNT': '4.368', 'FRAGCOUNT': '12.000'} [2023-02-24 18:44:13,677][177170] DAMAGECOUNT value on done: 173343.0 [2023-02-24 18:44:13,677][177170] Sum rewards: 13.005, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.575', 'AMMO2': '0.005', 'AMMO5': '0.016', 'AMMO4': '0.024', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO3': '0.095', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.178', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.276', 'WEAPON5': '0.400', 'weapon2': '0.612', 'WEAPON3': '0.650', 'HITCOUNT': '0.870', 'weapon3': '1.466', 'DAMAGECOUNT': '4.020', 'FRAGCOUNT': '12.000'} [2023-02-24 18:44:14,141][177158] DAMAGECOUNT value on done: 167200.0 [2023-02-24 18:44:14,142][177158] Sum rewards: 10.059, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.040', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.050', 'weapon7': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.534', 'HITCOUNT': '0.570', 'weapon2': '0.588', 'weapon3': '0.896', 'DAMAGECOUNT': '2.382', 'FRAGCOUNT': '9.000'} [2023-02-24 18:44:14,445][177158] DAMAGECOUNT value on done: 172547.0 [2023-02-24 18:44:14,446][177158] Sum rewards: 6.541, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.335', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'weapon7': '0.056', 'AMMO3': '0.058', 'weapon4': '0.064', 'AMMO4': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.112', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'HITCOUNT': '0.530', 'weapon3': '1.050', 'weapon2': '1.642', 'DAMAGECOUNT': '1.665', 'FRAGCOUNT': '5.000'} [2023-02-24 18:44:14,817][177153] Updated weights for policy 0, policy_version 16650 (0.0008) [2023-02-24 18:44:15,346][177158] DAMAGECOUNT value on done: 178136.0 [2023-02-24 18:44:15,346][177158] Sum rewards: 8.507, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.368', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.037', 'weapon7': '0.050', 'AMMO3': '0.054', 'WEAPON5': '0.100', 'weapon5': '0.140', 'AMMO4': '0.187', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.404', 'WEAPON4': '0.500', 'HITCOUNT': '0.660', 'weapon2': '0.848', 'weapon4': '0.934', 'weapon3': '1.088', 'DAMAGECOUNT': '3.108', 'FRAGCOUNT': '8.000'} [2023-02-24 18:44:15,643][177158] DAMAGECOUNT value on done: 177124.0 [2023-02-24 18:44:15,644][177158] Sum rewards: 20.909, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.053', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon7': '0.050', 'AMMO3': '0.081', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.156', 'weapon2': '0.268', 'weapon4': '0.402', 'WEAPON3': '0.500', 'HITCOUNT': '1.150', 'weapon3': '1.892', 'DAMAGECOUNT': '4.986', 'FRAGCOUNT': '16.000'} [2023-02-24 18:44:16,362][177157] Large shaping reward 2.602 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('weapon7', 0.002)] [2023-02-24 18:44:16,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 68218880. Throughput: 0: 3477.2. Samples: 17055732. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:44:16,376][177119] Avg episode reward: [(0, '11.749')] [2023-02-24 18:44:16,449][177156] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-24 18:44:17,119][177172] DAMAGECOUNT value on done: 176935.0 [2023-02-24 18:44:17,120][177172] Sum rewards: 7.128, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'weapon7': '0.050', 'AMMO4': '0.084', 'weapon4': '0.094', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'HEALTH': '0.176', 'WEAPON7': '0.200', 'WEAPON3': '0.700', 'HITCOUNT': '0.760', 'weapon3': '1.356', 'weapon2': '1.658', 'DAMAGECOUNT': '2.898', 'FRAGCOUNT': '6.000'} [2023-02-24 18:44:17,418][177172] DAMAGECOUNT value on done: 175209.0 [2023-02-24 18:44:17,419][177172] Sum rewards: 6.385, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.885', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO3': '0.095', 'weapon5': '0.156', 'WEAPON5': '0.200', 'HITCOUNT': '0.580', 'WEAPON3': '0.650', 'weapon2': '1.482', 'weapon3': '2.028', 'DAMAGECOUNT': '2.328', 'FRAGCOUNT': '5.000'} [2023-02-24 18:44:17,750][177153] Updated weights for policy 0, policy_version 16660 (0.0008) [2023-02-24 18:44:18,647][177154] DAMAGECOUNT value on done: 179979.0 [2023-02-24 18:44:18,647][177154] Sum rewards: 8.765, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.150', 'AMMO4': '-0.072', 'AMMO2': '-0.014', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'weapon4': '0.184', 'weapon5': '0.224', 'WEAPON5': '0.350', 'ARMOR': '0.479', 'WEAPON3': '0.650', 'HITCOUNT': '0.740', 'weapon3': '1.462', 'weapon2': '1.596', 'DAMAGECOUNT': '3.105', 'FRAGCOUNT': '8.000'} [2023-02-24 18:44:18,951][177154] DAMAGECOUNT value on done: 182391.0 [2023-02-24 18:44:18,952][177154] Sum rewards: 12.010, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.420', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.076', 'weapon4': '0.144', 'weapon5': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '0.850', 'weapon2': '1.236', 'weapon3': '1.326', 'DAMAGECOUNT': '3.708', 'FRAGCOUNT': '10.000'} [2023-02-24 18:44:19,128][177172] DAMAGECOUNT value on done: 177688.0 [2023-02-24 18:44:19,129][177172] Sum rewards: 19.436, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.609', 'weapon7': '0.008', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon5': '0.096', 'AMMO4': '0.129', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.216', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'weapon2': '1.110', 'HITCOUNT': '1.150', 'weapon3': '2.170', 'DAMAGECOUNT': '5.070', 'FRAGCOUNT': '17.000'} [2023-02-24 18:44:19,253][177154] DAMAGECOUNT value on done: 181423.0 [2023-02-24 18:44:19,254][177154] Sum rewards: 9.076, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.402', 'AMMO5': '0.015', 'AMMO2': '0.031', 'ARMOR': '0.032', 'AMMO3': '0.104', 'weapon5': '0.112', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.424', 'WEAPON3': '0.650', 'weapon2': '0.840', 'HITCOUNT': '0.920', 'weapon3': '1.822', 'DAMAGECOUNT': '3.576', 'FRAGCOUNT': '7.000'} [2023-02-24 18:44:19,420][177172] DAMAGECOUNT value on done: 178563.0 [2023-02-24 18:44:19,420][177172] Sum rewards: 12.171, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.057', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon5': '0.048', 'weapon7': '0.054', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.600', 'weapon4': '0.680', 'ARMOR': '0.804', 'weapon2': '0.878', 'HITCOUNT': '0.940', 'weapon3': '1.028', 'DAMAGECOUNT': '3.924', 'FRAGCOUNT': '10.000'} [2023-02-24 18:44:19,549][177154] DAMAGECOUNT value on done: 180611.0 [2023-02-24 18:44:19,549][177154] Sum rewards: 7.572, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.242', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.018', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.124', 'weapon4': '0.132', 'weapon5': '0.180', 'WEAPON5': '0.350', 'HITCOUNT': '0.520', 'WEAPON3': '0.800', 'weapon2': '1.190', 'weapon3': '1.392', 'DAMAGECOUNT': '3.183', 'FRAGCOUNT': '8.000'} [2023-02-24 18:44:19,794][177157] DAMAGECOUNT value on done: 167577.0 [2023-02-24 18:44:19,794][177157] Sum rewards: 10.538, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.555', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.046', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'weapon7': '0.108', 'weapon5': '0.186', 'weapon4': '0.194', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.510', 'weapon2': '0.830', 'weapon3': '1.326', 'DAMAGECOUNT': '2.703', 'FRAGCOUNT': '8.000'} [2023-02-24 18:44:19,805][177157] DAMAGECOUNT value on done: 182664.0 [2023-02-24 18:44:19,805][177157] Sum rewards: 17.065, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.860', 'AMMO2': '0.001', 'AMMO4': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO3': '0.048', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.122', 'weapon5': '0.190', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'weapon4': '0.422', 'HITCOUNT': '0.660', 'weapon2': '0.790', 'weapon3': '0.802', 'ARMOR': '0.907', 'DAMAGECOUNT': '3.717', 'FRAGCOUNT': '12.000'} [2023-02-24 18:44:20,060][177171] DAMAGECOUNT value on done: 170601.0 [2023-02-24 18:44:20,060][177171] Sum rewards: 6.387, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.900', 'AMMO2': '0.004', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO4': '0.018', 'WEAPON1': '0.040', 'AMMO3': '0.068', 'weapon5': '0.078', 'weapon7': '0.186', 'WEAPON4': '0.200', 'weapon4': '0.246', 'WEAPON5': '0.300', 'AMMO6': '0.440', 'AMMO7': '0.440', 'WEAPON3': '0.500', 'WEAPON7': '0.600', 'HITCOUNT': '0.690', 'weapon3': '1.266', 'weapon2': '1.320', 'DAMAGECOUNT': '2.625', 'FRAGCOUNT': '6.000'} [2023-02-24 18:44:20,099][177157] DAMAGECOUNT value on done: 171264.0 [2023-02-24 18:44:20,099][177157] Sum rewards: 3.071, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.472', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.044', 'ARMOR': '0.044', 'weapon7': '0.054', 'AMMO3': '0.068', 'weapon5': '0.188', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.219', 'WEAPON5': '0.300', 'HITCOUNT': '0.390', 'WEAPON3': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.816', 'weapon3': '0.896', 'weapon4': '1.008', 'DAMAGECOUNT': '1.524', 'FRAGCOUNT': '4.000'} [2023-02-24 18:44:20,111][177157] DAMAGECOUNT value on done: 173184.0 [2023-02-24 18:44:20,111][177157] Sum rewards: 9.624, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.012', 'AMMO2': '0.022', 'WEAPON1': '0.060', 'AMMO3': '0.085', 'AMMO4': '0.107', 'weapon5': '0.136', 'WEAPON4': '0.150', 'weapon7': '0.164', 'HEALTH': '0.177', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.476', 'WEAPON3': '0.550', 'HITCOUNT': '0.780', 'weapon2': '0.970', 'weapon3': '1.490', 'DAMAGECOUNT': '3.294', 'FRAGCOUNT': '7.000'} [2023-02-24 18:44:20,345][177171] DAMAGECOUNT value on done: 171271.0 [2023-02-24 18:44:20,345][177171] Sum rewards: 11.194, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.471', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.061', 'weapon7': '0.076', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'weapon5': '0.160', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.266', 'WEAPON7': '0.300', 'WEAPON3': '0.700', 'weapon2': '0.862', 'HITCOUNT': '0.870', 'weapon3': '2.044', 'DAMAGECOUNT': '3.876', 'FRAGCOUNT': '9.000'} [2023-02-24 18:44:20,352][177171] DAMAGECOUNT value on done: 179527.0 [2023-02-24 18:44:20,352][177171] Sum rewards: 2.659, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.254', 'AMMO2': '0.009', 'AMMO5': '0.015', 'AMMO4': '0.043', 'AMMO3': '0.067', 'weapon5': '0.100', 'weapon7': '0.178', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.334', 'AMMO6': '0.360', 'AMMO7': '0.360', 'WEAPON3': '0.400', 'HITCOUNT': '0.470', 'WEAPON7': '0.600', 'weapon3': '0.618', 'weapon2': '0.676', 'DAMAGECOUNT': '1.833', 'FRAGCOUNT': '4.000'} [2023-02-24 18:44:20,649][177153] Updated weights for policy 0, policy_version 16670 (0.0008) [2023-02-24 18:44:20,649][177171] DAMAGECOUNT value on done: 174002.0 [2023-02-24 18:44:20,650][177171] Sum rewards: 12.466, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.265', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.018', 'WEAPON1': '0.030', 'AMMO3': '0.099', 'WEAPON4': '0.150', 'weapon5': '0.214', 'weapon4': '0.320', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'weapon2': '1.104', 'HITCOUNT': '1.210', 'weapon3': '1.848', 'DAMAGECOUNT': '4.374', 'FRAGCOUNT': '10.000'} [2023-02-24 18:44:21,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 68288512. Throughput: 0: 3479.2. Samples: 17066188. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:44:21,376][177119] Avg episode reward: [(0, '11.120')] [2023-02-24 18:44:21,527][177155] DAMAGECOUNT value on done: 176291.0 [2023-02-24 18:44:21,527][177155] Sum rewards: 3.025, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.060', 'weapon5': '0.002', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.035', 'AMMO3': '0.045', 'WEAPON5': '0.150', 'weapon7': '0.176', 'WEAPON4': '0.200', 'weapon4': '0.280', 'WEAPON3': '0.300', 'HITCOUNT': '0.330', 'ARMOR': '0.380', 'AMMO6': '0.440', 'AMMO7': '0.440', 'WEAPON7': '0.600', 'weapon3': '0.890', 'weapon2': '0.990', 'DAMAGECOUNT': '1.302', 'FRAGCOUNT': '2.000'} [2023-02-24 18:44:21,825][177155] DAMAGECOUNT value on done: 181823.0 [2023-02-24 18:44:21,826][177155] Sum rewards: 11.675, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.997', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'ARMOR': '0.032', 'weapon5': '0.062', 'AMMO4': '0.090', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.266', 'WEAPON3': '0.700', 'HITCOUNT': '0.970', 'weapon2': '1.642', 'weapon3': '1.740', 'DAMAGECOUNT': '3.930', 'FRAGCOUNT': '11.000'} [2023-02-24 18:44:22,295][177155] DAMAGECOUNT value on done: 182906.0 [2023-02-24 18:44:22,295][177155] Sum rewards: 12.510, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.760', 'AMMO5': '0.007', 'AMMO2': '0.031', 'AMMO3': '0.051', 'weapon7': '0.140', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO4': '0.154', 'WEAPON3': '0.350', 'WEAPON4': '0.450', 'ARMOR': '0.469', 'HITCOUNT': '0.520', 'AMMO6': '0.620', 'AMMO7': '0.620', 'weapon4': '0.622', 'WEAPON7': '0.700', 'weapon3': '0.992', 'weapon2': '1.102', 'DAMAGECOUNT': '3.642', 'FRAGCOUNT': '10.000'} [2023-02-24 18:44:22,480][177155] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 18:44:22,590][177155] DAMAGECOUNT value on done: 174542.0 [2023-02-24 18:44:22,591][177155] Sum rewards: 11.020, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.536', 'AMMO2': '0.006', 'AMMO5': '0.012', 'weapon4': '0.020', 'AMMO4': '0.029', 'WEAPON1': '0.030', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.122', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'HITCOUNT': '1.110', 'weapon2': '1.632', 'weapon3': '1.872', 'DAMAGECOUNT': '4.383', 'FRAGCOUNT': '8.500'} [2023-02-24 18:44:23,605][177153] Updated weights for policy 0, policy_version 16680 (0.0008) [2023-02-24 18:44:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 68358144. Throughput: 0: 3480.4. Samples: 17087074. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:44:26,376][177119] Avg episode reward: [(0, '10.977')] [2023-02-24 18:44:26,511][177153] Updated weights for policy 0, policy_version 16690 (0.0008) [2023-02-24 18:44:29,323][177156] DAMAGECOUNT value on done: 177338.0 [2023-02-24 18:44:29,324][177156] Sum rewards: 11.288, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.450', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon7': '0.050', 'AMMO3': '0.061', 'AMMO4': '0.075', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.110', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.200', 'WEAPON3': '0.450', 'HITCOUNT': '0.590', 'weapon2': '1.036', 'weapon3': '1.252', 'DAMAGECOUNT': '2.793', 'FRAGCOUNT': '9.000'} [2023-02-24 18:44:29,335][177156] DAMAGECOUNT value on done: 172904.0 [2023-02-24 18:44:29,336][177156] Sum rewards: 13.058, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'weapon4': '0.024', 'AMMO4': '0.052', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon7': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HEALTH': '0.136', 'WEAPON5': '0.150', 'weapon5': '0.162', 'WEAPON7': '0.200', 'WEAPON3': '0.550', 'HITCOUNT': '0.870', 'weapon2': '1.150', 'weapon3': '1.660', 'DAMAGECOUNT': '3.786', 'FRAGCOUNT': '9.000'} [2023-02-24 18:44:29,478][177153] Updated weights for policy 0, policy_version 16700 (0.0008) [2023-02-24 18:44:29,640][177156] DAMAGECOUNT value on done: 178003.0 [2023-02-24 18:44:29,641][177156] Sum rewards: 12.495, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.050', 'AMMO2': '0.009', 'AMMO5': '0.012', 'AMMO4': '0.043', 'WEAPON1': '0.050', 'weapon7': '0.060', 'AMMO3': '0.087', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.264', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.870', 'weapon2': '1.384', 'weapon3': '1.528', 'DAMAGECOUNT': '4.062', 'FRAGCOUNT': '11.000'} [2023-02-24 18:44:29,651][177156] DAMAGECOUNT value on done: 175945.0 [2023-02-24 18:44:29,652][177156] Sum rewards: 11.529, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.922', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.031', 'AMMO3': '0.056', 'weapon5': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.328', 'WEAPON3': '0.400', 'HITCOUNT': '0.730', 'weapon3': '1.128', 'weapon2': '1.968', 'DAMAGECOUNT': '3.180', 'FRAGCOUNT': '10.000'} [2023-02-24 18:44:31,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 68427776. Throughput: 0: 3483.1. Samples: 17108026. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 18:44:31,376][177119] Avg episode reward: [(0, '10.938')] [2023-02-24 18:44:32,143][177170] DAMAGECOUNT value on done: 176414.0 [2023-02-24 18:44:32,143][177170] Sum rewards: 5.091, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-1.040', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO3': '0.049', 'weapon7': '0.124', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'HITCOUNT': '0.440', 'weapon3': '0.780', 'weapon2': '0.832', 'DAMAGECOUNT': '1.716', 'FRAGCOUNT': '3.000'} [2023-02-24 18:44:32,402][177153] Updated weights for policy 0, policy_version 16710 (0.0008) [2023-02-24 18:44:32,436][177170] DAMAGECOUNT value on done: 183469.0 [2023-02-24 18:44:32,437][177170] Sum rewards: 12.202, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.150', 'AMMO2': '0.007', 'AMMO5': '0.010', 'weapon4': '0.022', 'AMMO4': '0.034', 'WEAPON1': '0.040', 'AMMO3': '0.051', 'weapon7': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.810', 'weapon3': '1.218', 'weapon2': '1.496', 'DAMAGECOUNT': '3.486', 'FRAGCOUNT': '10.000'} [2023-02-24 18:44:32,640][177170] DAMAGECOUNT value on done: 174614.0 [2023-02-24 18:44:32,640][177170] Sum rewards: 16.453, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.665', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.017', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.112', 'weapon5': '0.130', 'WEAPON5': '0.250', 'WEAPON3': '0.850', 'weapon2': '0.858', 'HITCOUNT': '1.270', 'weapon3': '2.164', 'DAMAGECOUNT': '5.835', 'FRAGCOUNT': '13.000'} [2023-02-24 18:44:32,937][177170] DAMAGECOUNT value on done: 174932.0 [2023-02-24 18:44:32,938][177170] Sum rewards: 13.096, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.470', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'weapon5': '0.046', 'AMMO4': '0.100', 'AMMO3': '0.111', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.438', 'weapon2': '0.750', 'WEAPON3': '0.800', 'HITCOUNT': '1.320', 'weapon3': '2.246', 'DAMAGECOUNT': '4.767', 'FRAGCOUNT': '11.000'} [2023-02-24 18:44:33,404][177158] DAMAGECOUNT value on done: 168074.0 [2023-02-24 18:44:33,404][177158] Sum rewards: 5.766, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.698', 'AMMO5': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.050', 'weapon7': '0.052', 'AMMO4': '0.085', 'AMMO3': '0.093', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.288', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.404', 'HITCOUNT': '0.590', 'weapon4': '0.654', 'WEAPON3': '0.700', 'weapon2': '1.000', 'weapon3': '1.506', 'DAMAGECOUNT': '2.622', 'FRAGCOUNT': '6.500'} [2023-02-24 18:44:33,708][177158] DAMAGECOUNT value on done: 173464.0 [2023-02-24 18:44:33,709][177158] Sum rewards: 0.984, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.330', 'AMMO2': '0.014', 'AMMO5': '0.015', 'WEAPON1': '0.060', 'AMMO4': '0.070', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.137', 'weapon4': '0.146', 'WEAPON4': '0.150', 'weapon5': '0.182', 'WEAPON5': '0.400', 'HITCOUNT': '0.650', 'WEAPON3': '0.850', 'weapon2': '1.176', 'weapon3': '2.162', 'DAMAGECOUNT': '2.751', 'FRAGCOUNT': '4.500'} [2023-02-24 18:44:34,608][177158] DAMAGECOUNT value on done: 179700.0 [2023-02-24 18:44:34,609][177158] Sum rewards: 15.095, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.240', 'AMMO5': '0.015', 'AMMO2': '0.022', 'WEAPON1': '0.050', 'weapon7': '0.110', 'AMMO4': '0.111', 'AMMO3': '0.114', 'weapon5': '0.174', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON7': '0.400', 'weapon4': '0.526', 'WEAPON3': '0.800', 'weapon2': '0.836', 'HITCOUNT': '0.960', 'weapon3': '1.694', 'DAMAGECOUNT': '4.692', 'FRAGCOUNT': '13.000'} [2023-02-24 18:44:34,908][177158] DAMAGECOUNT value on done: 178305.0 [2023-02-24 18:44:34,909][177158] Sum rewards: 14.055, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.563', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'ARMOR': '0.064', 'weapon4': '0.098', 'AMMO3': '0.102', 'weapon5': '0.136', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON3': '0.650', 'HITCOUNT': '0.810', 'weapon2': '1.148', 'weapon3': '1.646', 'DAMAGECOUNT': '3.543', 'FRAGCOUNT': '11.500'} [2023-02-24 18:44:35,354][177153] Updated weights for policy 0, policy_version 16720 (0.0008) [2023-02-24 18:44:35,810][177172] Large shaping reward 2.639 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0)] [2023-02-24 18:44:36,367][177172] DAMAGECOUNT value on done: 178536.0 [2023-02-24 18:44:36,368][177172] Sum rewards: 13.984, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.890', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'WEAPON1': '0.020', 'AMMO5': '0.028', 'AMMO3': '0.135', 'weapon5': '0.336', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'weapon2': '1.128', 'HITCOUNT': '1.170', 'weapon3': '1.974', 'DAMAGECOUNT': '4.803', 'FRAGCOUNT': '13.000'} [2023-02-24 18:44:36,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 68497408. Throughput: 0: 3484.5. Samples: 17118506. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 18:44:36,376][177119] Avg episode reward: [(0, '10.783')] [2023-02-24 18:44:36,668][177172] DAMAGECOUNT value on done: 176086.0 [2023-02-24 18:44:36,668][177172] Sum rewards: 10.392, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'ARMOR': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon7': '0.056', 'AMMO3': '0.059', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'weapon5': '0.156', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.300', 'HEALTH': '0.318', 'weapon4': '0.398', 'HITCOUNT': '0.540', 'weapon3': '1.014', 'weapon2': '1.384', 'DAMAGECOUNT': '2.631', 'FRAGCOUNT': '7.000'} [2023-02-24 18:44:37,518][177155] Large shaping reward 2.571 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.549, 183.0), ('weapon5', 0.002)] [2023-02-24 18:44:37,894][177154] DAMAGECOUNT value on done: 181584.0 [2023-02-24 18:44:37,895][177154] Sum rewards: 15.942, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.764', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'weapon4': '0.044', 'WEAPON4': '0.050', 'weapon5': '0.052', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.162', 'WEAPON3': '0.900', 'HITCOUNT': '1.100', 'weapon2': '1.332', 'weapon3': '2.300', 'DAMAGECOUNT': '4.815', 'FRAGCOUNT': '14.000'} [2023-02-24 18:44:38,195][177154] DAMAGECOUNT value on done: 183038.0 [2023-02-24 18:44:38,195][177154] Sum rewards: 6.170, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.040', 'AMMO5': '0.015', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'AMMO3': '0.070', 'weapon7': '0.100', 'AMMO4': '0.103', 'weapon5': '0.178', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'HITCOUNT': '0.320', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'weapon4': '0.442', 'weapon2': '1.046', 'weapon3': '1.194', 'DAMAGECOUNT': '1.941', 'FRAGCOUNT': '5.000'} [2023-02-24 18:44:38,297][177153] Updated weights for policy 0, policy_version 16730 (0.0007) [2023-02-24 18:44:38,407][177172] DAMAGECOUNT value on done: 178977.0 [2023-02-24 18:44:38,407][177172] Sum rewards: 15.630, reward structure: {'DEATHCOUNT': '-3.750', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'AMMO3': '0.053', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'weapon7': '0.164', 'WEAPON5': '0.200', 'weapon5': '0.270', 'HEALTH': '0.286', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON3': '0.350', 'WEAPON7': '0.400', 'weapon4': '0.492', 'HITCOUNT': '0.570', 'weapon3': '0.884', 'weapon2': '0.906', 'DAMAGECOUNT': '3.867', 'FRAGCOUNT': '10.000'} [2023-02-24 18:44:38,506][177154] DAMAGECOUNT value on done: 182821.0 [2023-02-24 18:44:38,506][177154] Sum rewards: 12.592, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.343', 'AMMO5': '0.014', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'AMMO3': '0.085', 'AMMO4': '0.114', 'weapon5': '0.148', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.502', 'ARMOR': '0.503', 'WEAPON3': '0.550', 'HITCOUNT': '0.880', 'weapon2': '1.076', 'weapon3': '1.456', 'DAMAGECOUNT': '4.194', 'FRAGCOUNT': '11.000'} [2023-02-24 18:44:38,701][177172] DAMAGECOUNT value on done: 179722.0 [2023-02-24 18:44:38,702][177172] Sum rewards: 6.468, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.756', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.033', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.106', 'AMMO4': '0.167', 'weapon5': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.330', 'WEAPON3': '0.600', 'HITCOUNT': '0.730', 'weapon2': '1.140', 'weapon3': '1.262', 'DAMAGECOUNT': '3.018', 'FRAGCOUNT': '7.000'} [2023-02-24 18:44:38,812][177154] DAMAGECOUNT value on done: 181627.0 [2023-02-24 18:44:38,813][177154] Sum rewards: 7.969, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.153', 'AMMO5': '0.014', 'AMMO2': '0.025', 'weapon7': '0.054', 'WEAPON1': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.125', 'AMMO3': '0.155', 'WEAPON7': '0.200', 'weapon5': '0.212', 'WEAPON4': '0.300', 'weapon4': '0.320', 'WEAPON5': '0.400', 'HITCOUNT': '0.950', 'WEAPON3': '1.000', 'weapon2': '1.042', 'weapon3': '1.706', 'DAMAGECOUNT': '3.048', 'FRAGCOUNT': '10.000'} [2023-02-24 18:44:39,082][177157] DAMAGECOUNT value on done: 168378.0 [2023-02-24 18:44:39,082][177157] Sum rewards: 7.918, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.604', 'AMMO2': '0.007', 'AMMO5': '0.012', 'AMMO4': '0.033', 'WEAPON1': '0.060', 'AMMO3': '0.069', 'weapon5': '0.178', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '0.560', 'weapon3': '1.162', 'weapon2': '1.688', 'DAMAGECOUNT': '2.403', 'FRAGCOUNT': '6.000'} [2023-02-24 18:44:39,093][177157] DAMAGECOUNT value on done: 183482.0 [2023-02-24 18:44:39,093][177157] Sum rewards: 5.801, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.092', 'AMMO5': '0.015', 'AMMO2': '0.047', 'WEAPON1': '0.070', 'AMMO3': '0.111', 'weapon4': '0.154', 'weapon5': '0.214', 'AMMO4': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'HITCOUNT': '0.420', 'WEAPON3': '0.750', 'weapon2': '1.616', 'weapon3': '1.658', 'DAMAGECOUNT': '2.454', 'FRAGCOUNT': '6.000'} [2023-02-24 18:44:39,355][177171] DAMAGECOUNT value on done: 171755.0 [2023-02-24 18:44:39,356][177171] Sum rewards: 12.898, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.940', 'AMMO4': '-0.061', 'AMMO2': '-0.012', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'weapon7': '0.054', 'weapon5': '0.072', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.136', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'HITCOUNT': '0.920', 'weapon2': '1.248', 'weapon3': '1.556', 'DAMAGECOUNT': '3.462', 'FRAGCOUNT': '11.000'} [2023-02-24 18:44:39,396][177157] DAMAGECOUNT value on done: 172178.0 [2023-02-24 18:44:39,396][177157] Sum rewards: 4.755, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.114', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.027', 'weapon5': '0.108', 'AMMO4': '0.136', 'AMMO3': '0.184', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon4': '0.516', 'HITCOUNT': '0.730', 'weapon2': '1.062', 'WEAPON3': '1.150', 'weapon3': '1.822', 'DAMAGECOUNT': '2.742', 'FRAGCOUNT': '9.000'} [2023-02-24 18:44:39,406][177157] DAMAGECOUNT value on done: 174808.0 [2023-02-24 18:44:39,407][177157] Sum rewards: 9.491, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.630', 'weapon5': '0.010', 'AMMO2': '0.016', 'AMMO5': '0.035', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.077', 'AMMO3': '0.145', 'weapon4': '0.146', 'WEAPON5': '0.600', 'WEAPON3': '1.050', 'weapon2': '1.194', 'HITCOUNT': '1.240', 'weapon3': '2.376', 'DAMAGECOUNT': '4.872', 'FRAGCOUNT': '9.000'} [2023-02-24 18:44:39,659][177171] DAMAGECOUNT value on done: 172720.0 [2023-02-24 18:44:39,660][177171] Sum rewards: 11.722, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.260', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.040', 'weapon7': '0.046', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.102', 'AMMO3': '0.140', 'weapon5': '0.148', 'AMMO4': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'HITCOUNT': '1.140', 'weapon2': '1.510', 'weapon3': '1.778', 'DAMAGECOUNT': '4.347', 'FRAGCOUNT': '13.000'} [2023-02-24 18:44:39,669][177171] DAMAGECOUNT value on done: 180697.0 [2023-02-24 18:44:39,670][177171] Sum rewards: 10.472, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.200', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.029', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'weapon7': '0.102', 'AMMO4': '0.147', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.300', 'WEAPON7': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.508', 'HITCOUNT': '0.720', 'weapon2': '0.848', 'weapon3': '1.004', 'DAMAGECOUNT': '3.510', 'FRAGCOUNT': '9.000'} [2023-02-24 18:44:39,972][177171] DAMAGECOUNT value on done: 174888.0 [2023-02-24 18:44:39,972][177171] Sum rewards: 10.556, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.370', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'AMMO4': '0.050', 'weapon7': '0.134', 'weapon5': '0.186', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'WEAPON3': '0.300', 'weapon4': '0.398', 'WEAPON7': '0.400', 'HITCOUNT': '0.560', 'weapon2': '0.874', 'weapon3': '1.038', 'DAMAGECOUNT': '2.658', 'FRAGCOUNT': '8.500'} [2023-02-24 18:44:40,753][177155] DAMAGECOUNT value on done: 177744.0 [2023-02-24 18:44:40,754][177155] Sum rewards: 14.273, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.942', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.006', 'WEAPON1': '0.020', 'weapon7': '0.060', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'weapon5': '0.104', 'WEAPON5': '0.150', 'weapon4': '0.206', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'weapon2': '0.536', 'WEAPON3': '0.550', 'HITCOUNT': '0.750', 'weapon3': '1.466', 'DAMAGECOUNT': '4.155', 'FRAGCOUNT': '12.000'} [2023-02-24 18:44:41,055][177155] DAMAGECOUNT value on done: 182791.0 [2023-02-24 18:44:41,055][177155] Sum rewards: 8.653, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.939', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.029', 'weapon5': '0.084', 'AMMO3': '0.088', 'weapon7': '0.138', 'AMMO4': '0.144', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'ARMOR': '0.493', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'weapon4': '0.682', 'weapon2': '0.808', 'weapon3': '1.280', 'DAMAGECOUNT': '2.904', 'FRAGCOUNT': '7.000'} [2023-02-24 18:44:41,237][177153] Updated weights for policy 0, policy_version 16740 (0.0009) [2023-02-24 18:44:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 68567040. Throughput: 0: 3483.2. Samples: 17139304. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:44:41,376][177119] Avg episode reward: [(0, '10.332')] [2023-02-24 18:44:41,535][177155] DAMAGECOUNT value on done: 184292.0 [2023-02-24 18:44:41,535][177155] Sum rewards: 12.494, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.968', 'AMMO2': '0.014', 'AMMO5': '0.022', 'WEAPON1': '0.060', 'AMMO4': '0.070', 'weapon4': '0.088', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.111', 'weapon5': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'HITCOUNT': '0.800', 'weapon2': '1.154', 'weapon3': '2.212', 'DAMAGECOUNT': '4.158', 'FRAGCOUNT': '12.000'} [2023-02-24 18:44:41,834][177155] DAMAGECOUNT value on done: 175726.0 [2023-02-24 18:44:41,835][177155] Sum rewards: 12.082, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.144', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.029', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'weapon5': '0.130', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.244', 'ARMOR': '0.424', 'WEAPON3': '0.600', 'HITCOUNT': '0.840', 'weapon3': '1.492', 'weapon2': '1.506', 'DAMAGECOUNT': '3.552', 'FRAGCOUNT': '9.000'} [2023-02-24 18:44:43,317][177170] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 18:44:44,164][177153] Updated weights for policy 0, policy_version 16750 (0.0008) [2023-02-24 18:44:46,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 68636672. Throughput: 0: 3484.8. Samples: 17160266. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:44:46,376][177119] Avg episode reward: [(0, '10.446')] [2023-02-24 18:44:47,058][177153] Updated weights for policy 0, policy_version 16760 (0.0008) [2023-02-24 18:44:48,568][177156] DAMAGECOUNT value on done: 178214.0 [2023-02-24 18:44:48,569][177156] Sum rewards: 9.514, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.200', 'AMMO2': '0.016', 'AMMO3': '0.048', 'AMMO4': '0.078', 'weapon7': '0.104', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'weapon4': '0.466', 'HITCOUNT': '0.620', 'weapon2': '0.640', 'weapon3': '0.814', 'DAMAGECOUNT': '2.628', 'FRAGCOUNT': '7.000'} [2023-02-24 18:44:48,579][177156] DAMAGECOUNT value on done: 173970.0 [2023-02-24 18:44:48,579][177156] Sum rewards: 9.815, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.993', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'ARMOR': '0.040', 'weapon7': '0.054', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.110', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.450', 'weapon2': '0.674', 'HITCOUNT': '0.750', 'weapon3': '1.088', 'DAMAGECOUNT': '3.198', 'FRAGCOUNT': '8.000'} [2023-02-24 18:44:48,883][177156] DAMAGECOUNT value on done: 179450.0 [2023-02-24 18:44:48,883][177156] Sum rewards: 13.262, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.022', 'AMMO2': '0.023', 'WEAPON1': '0.060', 'HEALTH': '0.070', 'AMMO4': '0.115', 'AMMO3': '0.118', 'weapon5': '0.184', 'WEAPON4': '0.200', 'weapon4': '0.270', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon2': '0.800', 'HITCOUNT': '1.050', 'weapon3': '2.258', 'DAMAGECOUNT': '4.341', 'FRAGCOUNT': '10.000'} [2023-02-24 18:44:48,894][177156] DAMAGECOUNT value on done: 176782.0 [2023-02-24 18:44:48,894][177156] Sum rewards: 4.765, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.244', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.125', 'weapon5': '0.240', 'WEAPON5': '0.250', 'HITCOUNT': '0.570', 'WEAPON3': '0.800', 'weapon2': '1.306', 'weapon3': '1.764', 'DAMAGECOUNT': '2.511', 'FRAGCOUNT': '9.000'} [2023-02-24 18:44:50,017][177153] Updated weights for policy 0, policy_version 16770 (0.0008) [2023-02-24 18:44:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 68706304. Throughput: 0: 3482.2. Samples: 17170708. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:44:51,376][177119] Avg episode reward: [(0, '10.362')] [2023-02-24 18:44:51,426][177170] DAMAGECOUNT value on done: 178121.0 [2023-02-24 18:44:51,426][177170] Sum rewards: 21.245, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.561', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'weapon7': '0.040', 'AMMO3': '0.076', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.129', 'WEAPON4': '0.300', 'weapon4': '0.384', 'weapon5': '0.388', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon2': '1.010', 'HITCOUNT': '1.100', 'weapon3': '1.630', 'DAMAGECOUNT': '5.121', 'FRAGCOUNT': '17.000'} [2023-02-24 18:44:51,727][177170] DAMAGECOUNT value on done: 185054.0 [2023-02-24 18:44:51,728][177170] Sum rewards: 10.394, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.689', 'AMMO2': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.060', 'WEAPON4': '0.150', 'AMMO3': '0.155', 'weapon5': '0.222', 'weapon4': '0.382', 'weapon2': '0.406', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '1.130', 'weapon3': '2.456', 'DAMAGECOUNT': '4.755', 'FRAGCOUNT': '11.500'} [2023-02-24 18:44:51,957][177170] DAMAGECOUNT value on done: 175659.0 [2023-02-24 18:44:51,957][177170] Sum rewards: 6.704, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.215', 'AMMO2': '0.015', 'AMMO5': '0.017', 'AMMO4': '0.076', 'AMMO3': '0.087', 'WEAPON1': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.190', 'weapon5': '0.216', 'HITCOUNT': '0.540', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'weapon2': '1.434', 'weapon3': '1.654', 'DAMAGECOUNT': '2.799', 'FRAGCOUNT': '7.000'} [2023-02-24 18:44:52,268][177170] DAMAGECOUNT value on done: 175913.0 [2023-02-24 18:44:52,268][177170] Sum rewards: 11.202, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.490', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'weapon5': '0.028', 'AMMO3': '0.060', 'AMMO4': '0.087', 'WEAPON5': '0.150', 'weapon7': '0.152', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.714', 'HITCOUNT': '0.720', 'weapon2': '0.924', 'weapon3': '1.438', 'DAMAGECOUNT': '2.943', 'FRAGCOUNT': '9.000'} [2023-02-24 18:44:52,728][177158] DAMAGECOUNT value on done: 169992.0 [2023-02-24 18:44:52,729][177158] Sum rewards: 20.940, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.380', 'AMMO2': '0.006', 'AMMO5': '0.017', 'AMMO4': '0.031', 'WEAPON1': '0.050', 'AMMO3': '0.085', 'WEAPON4': '0.200', 'weapon5': '0.272', 'WEAPON5': '0.400', 'weapon4': '0.402', 'WEAPON3': '0.550', 'weapon2': '0.712', 'HITCOUNT': '1.050', 'weapon3': '1.790', 'DAMAGECOUNT': '5.754', 'FRAGCOUNT': '16.000'} [2023-02-24 18:44:53,008][177153] Updated weights for policy 0, policy_version 16780 (0.0009) [2023-02-24 18:44:53,031][177158] DAMAGECOUNT value on done: 174786.0 [2023-02-24 18:44:53,031][177158] Sum rewards: 9.932, reward structure: {'DEATHCOUNT': '-7.500', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.033', 'WEAPON1': '0.060', 'AMMO3': '0.092', 'HEALTH': '0.094', 'WEAPON4': '0.150', 'AMMO4': '0.163', 'weapon5': '0.252', 'WEAPON5': '0.400', 'weapon4': '0.426', 'weapon2': '0.600', 'WEAPON3': '0.650', 'HITCOUNT': '0.990', 'weapon3': '2.034', 'DAMAGECOUNT': '3.966', 'FRAGCOUNT': '7.500'} [2023-02-24 18:44:53,929][177158] DAMAGECOUNT value on done: 180224.0 [2023-02-24 18:44:53,930][177158] Sum rewards: 7.340, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.250', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'AMMO3': '0.040', 'weapon7': '0.054', 'AMMO4': '0.097', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.244', 'WEAPON3': '0.250', 'HITCOUNT': '0.330', 'weapon2': '0.746', 'weapon3': '0.850', 'DAMAGECOUNT': '1.572', 'FRAGCOUNT': '7.000'} [2023-02-24 18:44:54,241][177158] DAMAGECOUNT value on done: 180026.0 [2023-02-24 18:44:54,242][177158] Sum rewards: 6.442, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.442', 'AMMO2': '0.008', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'AMMO4': '0.041', 'AMMO3': '0.097', 'weapon7': '0.154', 'WEAPON4': '0.200', 'weapon5': '0.232', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.258', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon2': '0.874', 'HITCOUNT': '0.950', 'weapon3': '1.816', 'DAMAGECOUNT': '3.663', 'FRAGCOUNT': '4.500'} [2023-02-24 18:44:55,692][177172] DAMAGECOUNT value on done: 179834.0 [2023-02-24 18:44:55,693][177172] Sum rewards: 10.051, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.260', 'AMMO2': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'weapon7': '0.052', 'AMMO4': '0.060', 'AMMO3': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.252', 'weapon5': '0.260', 'WEAPON3': '0.500', 'WEAPON5': '0.500', 'HITCOUNT': '0.530', 'weapon2': '0.858', 'weapon3': '1.078', 'DAMAGECOUNT': '3.894', 'FRAGCOUNT': '8.000'} [2023-02-24 18:44:55,944][177153] Updated weights for policy 0, policy_version 16790 (0.0008) [2023-02-24 18:44:55,991][177172] DAMAGECOUNT value on done: 177245.0 [2023-02-24 18:44:55,992][177172] Sum rewards: 11.277, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.940', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.012', 'AMMO3': '0.076', 'weapon5': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.318', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '1.000', 'weapon2': '1.110', 'weapon3': '1.236', 'DAMAGECOUNT': '3.477', 'FRAGCOUNT': '9.000'} [2023-02-24 18:44:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 68775936. Throughput: 0: 3480.7. Samples: 17191492. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:44:56,377][177119] Avg episode reward: [(0, '10.207')] [2023-02-24 18:44:56,381][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000016791_68775936.pth... [2023-02-24 18:44:56,438][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000015976_65437696.pth [2023-02-24 18:44:57,354][177154] DAMAGECOUNT value on done: 183257.0 [2023-02-24 18:44:57,354][177154] Sum rewards: 14.268, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.486', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'weapon7': '0.052', 'AMMO4': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'weapon5': '0.128', 'WEAPON4': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'weapon4': '0.458', 'weapon2': '0.622', 'WEAPON3': '0.750', 'HITCOUNT': '1.220', 'weapon3': '2.096', 'DAMAGECOUNT': '5.019', 'FRAGCOUNT': '13.500'} [2023-02-24 18:44:57,655][177154] DAMAGECOUNT value on done: 184709.0 [2023-02-24 18:44:57,655][177154] Sum rewards: 13.234, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.206', 'AMMO5': '0.016', 'AMMO2': '0.022', 'ARMOR': '0.024', 'weapon5': '0.076', 'AMMO4': '0.110', 'AMMO3': '0.179', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.440', 'weapon2': '0.922', 'WEAPON3': '1.200', 'HITCOUNT': '1.430', 'weapon3': '2.108', 'DAMAGECOUNT': '5.013', 'FRAGCOUNT': '13.000'} [2023-02-24 18:44:57,735][177172] DAMAGECOUNT value on done: 179934.0 [2023-02-24 18:44:57,736][177172] Sum rewards: 6.793, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'HEALTH': '0.060', 'AMMO4': '0.068', 'AMMO3': '0.092', 'weapon5': '0.108', 'WEAPON5': '0.150', 'weapon4': '0.150', 'WEAPON3': '0.550', 'HITCOUNT': '0.560', 'weapon3': '1.296', 'weapon2': '1.786', 'DAMAGECOUNT': '2.871', 'FRAGCOUNT': '5.000'} [2023-02-24 18:44:57,962][177154] DAMAGECOUNT value on done: 184369.0 [2023-02-24 18:44:57,962][177154] Sum rewards: 15.289, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.609', 'AMMO5': '0.007', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'AMMO3': '0.057', 'weapon7': '0.100', 'weapon5': '0.104', 'AMMO4': '0.140', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'weapon2': '0.604', 'weapon4': '0.942', 'weapon3': '0.988', 'HITCOUNT': '1.030', 'DAMAGECOUNT': '4.329', 'FRAGCOUNT': '12.000'} [2023-02-24 18:44:58,033][177172] DAMAGECOUNT value on done: 180506.0 [2023-02-24 18:44:58,034][177172] Sum rewards: 7.464, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'weapon7': '0.068', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'HEALTH': '0.166', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'weapon4': '0.506', 'HITCOUNT': '0.800', 'weapon2': '0.980', 'weapon3': '1.242', 'DAMAGECOUNT': '2.352', 'FRAGCOUNT': '6.000'} [2023-02-24 18:44:58,259][177154] DAMAGECOUNT value on done: 183236.0 [2023-02-24 18:44:58,260][177154] Sum rewards: 14.806, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.661', 'AMMO2': '0.009', 'AMMO5': '0.020', 'AMMO4': '0.044', 'WEAPON1': '0.060', 'AMMO3': '0.162', 'weapon5': '0.174', 'WEAPON4': '0.300', 'weapon4': '0.432', 'WEAPON5': '0.450', 'weapon2': '0.612', 'WEAPON3': '1.000', 'HITCOUNT': '1.110', 'weapon3': '2.068', 'DAMAGECOUNT': '4.776', 'FRAGCOUNT': '15.000'} [2023-02-24 18:44:58,477][177157] DAMAGECOUNT value on done: 169268.0 [2023-02-24 18:44:58,477][177157] Sum rewards: 8.699, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.462', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon7': '0.012', 'AMMO2': '0.022', 'ARMOR': '0.024', 'weapon5': '0.062', 'AMMO3': '0.096', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.502', 'WEAPON3': '0.650', 'HITCOUNT': '0.810', 'weapon3': '1.230', 'weapon2': '1.408', 'DAMAGECOUNT': '2.670', 'FRAGCOUNT': '9.000'} [2023-02-24 18:44:58,488][177157] DAMAGECOUNT value on done: 184104.0 [2023-02-24 18:44:58,489][177157] Sum rewards: 5.290, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.938', 'AMMO2': '0.005', 'AMMO5': '0.019', 'AMMO4': '0.026', 'WEAPON1': '0.040', 'AMMO3': '0.060', 'WEAPON4': '0.150', 'weapon5': '0.154', 'weapon4': '0.208', 'WEAPON5': '0.400', 'ARMOR': '0.455', 'WEAPON3': '0.500', 'HITCOUNT': '0.530', 'weapon2': '1.070', 'weapon3': '1.244', 'DAMAGECOUNT': '1.866', 'FRAGCOUNT': '4.000'} [2023-02-24 18:44:58,665][177171] DAMAGECOUNT value on done: 172557.0 [2023-02-24 18:44:58,666][177171] Sum rewards: 5.885, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.522', 'AMMO5': '0.012', 'AMMO2': '0.022', 'WEAPON1': '0.050', 'AMMO3': '0.080', 'AMMO4': '0.109', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.240', 'WEAPON4': '0.350', 'ARMOR': '0.404', 'weapon4': '0.516', 'WEAPON3': '0.550', 'weapon2': '0.564', 'HITCOUNT': '0.600', 'weapon3': '1.454', 'DAMAGECOUNT': '2.406', 'FRAGCOUNT': '6.000'} [2023-02-24 18:44:58,789][177157] DAMAGECOUNT value on done: 173547.0 [2023-02-24 18:44:58,790][177157] Sum rewards: 13.563, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.860', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO5': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.074', 'weapon7': '0.114', 'weapon5': '0.162', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.524', 'weapon2': '0.622', 'HITCOUNT': '0.660', 'weapon3': '1.156', 'DAMAGECOUNT': '4.107', 'FRAGCOUNT': '10.000'} [2023-02-24 18:44:58,801][177157] DAMAGECOUNT value on done: 176108.0 [2023-02-24 18:44:58,801][177157] Sum rewards: 18.611, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.007', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO3': '0.098', 'weapon5': '0.150', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '1.060', 'weapon2': '1.418', 'weapon3': '2.020', 'DAMAGECOUNT': '3.900', 'FRAGCOUNT': '15.000'} [2023-02-24 18:44:58,909][177153] Updated weights for policy 0, policy_version 16800 (0.0008) [2023-02-24 18:44:58,963][177171] DAMAGECOUNT value on done: 174806.0 [2023-02-24 18:44:58,963][177171] Sum rewards: 13.038, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.215', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO3': '0.050', 'AMMO4': '0.079', 'weapon7': '0.096', 'weapon5': '0.190', 'WEAPON5': '0.250', 'WEAPON3': '0.250', 'weapon2': '0.320', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON4': '0.350', 'WEAPON7': '0.500', 'weapon4': '0.502', 'HITCOUNT': '0.550', 'weapon3': '0.902', 'DAMAGECOUNT': '4.758', 'FRAGCOUNT': '9.000'} [2023-02-24 18:44:58,973][177171] DAMAGECOUNT value on done: 181130.0 [2023-02-24 18:44:58,973][177171] Sum rewards: 5.997, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.054', 'AMMO4': '0.061', 'weapon5': '0.162', 'WEAPON5': '0.200', 'weapon4': '0.200', 'HEALTH': '0.271', 'HITCOUNT': '0.380', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'weapon3': '1.114', 'DAMAGECOUNT': '1.299', 'weapon2': '1.596', 'FRAGCOUNT': '5.000'} [2023-02-24 18:44:59,271][177171] DAMAGECOUNT value on done: 176387.0 [2023-02-24 18:44:59,272][177171] Sum rewards: 16.523, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.500', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON1': '0.030', 'weapon7': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.446', 'WEAPON3': '0.450', 'HITCOUNT': '0.770', 'weapon2': '0.940', 'weapon3': '1.238', 'DAMAGECOUNT': '4.497', 'FRAGCOUNT': '12.000'} [2023-02-24 18:45:00,112][177156] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-24 18:45:00,132][177155] DAMAGECOUNT value on done: 179296.0 [2023-02-24 18:45:00,133][177155] Sum rewards: 22.401, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.509', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.020', 'AMMO3': '0.080', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.184', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.304', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '1.240', 'weapon2': '1.372', 'weapon3': '1.782', 'DAMAGECOUNT': '4.656', 'FRAGCOUNT': '17.500'} [2023-02-24 18:45:00,442][177155] DAMAGECOUNT value on done: 183506.0 [2023-02-24 18:45:00,443][177155] Sum rewards: 10.879, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.424', 'AMMO5': '0.006', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'AMMO3': '0.050', 'weapon7': '0.052', 'weapon5': '0.082', 'AMMO4': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'weapon4': '0.438', 'HITCOUNT': '0.450', 'weapon2': '0.678', 'weapon3': '1.010', 'DAMAGECOUNT': '2.145', 'FRAGCOUNT': '8.000'} [2023-02-24 18:45:00,899][177155] DAMAGECOUNT value on done: 185642.0 [2023-02-24 18:45:00,900][177155] Sum rewards: 10.614, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.710', 'AMMO2': '0.007', 'AMMO5': '0.018', 'AMMO4': '0.035', 'WEAPON1': '0.070', 'AMMO3': '0.122', 'weapon5': '0.254', 'WEAPON5': '0.500', 'HITCOUNT': '0.900', 'WEAPON3': '0.950', 'weapon2': '1.020', 'weapon3': '2.318', 'DAMAGECOUNT': '3.630', 'FRAGCOUNT': '10.000'} [2023-02-24 18:45:01,199][177155] DAMAGECOUNT value on done: 176703.0 [2023-02-24 18:45:01,200][177155] Sum rewards: 8.254, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.392', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.020', 'AMMO3': '0.083', 'weapon5': '0.264', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '0.670', 'weapon3': '1.276', 'weapon2': '1.770', 'DAMAGECOUNT': '2.931', 'FRAGCOUNT': '6.000'} [2023-02-24 18:45:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.5, 300 sec: 13898.6). Total num frames: 68845568. Throughput: 0: 3477.9. Samples: 17212238. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:45:01,376][177119] Avg episode reward: [(0, '10.393')] [2023-02-24 18:45:01,860][177153] Updated weights for policy 0, policy_version 16810 (0.0008) [2023-02-24 18:45:04,803][177153] Updated weights for policy 0, policy_version 16820 (0.0008) [2023-02-24 18:45:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 68915200. Throughput: 0: 3479.4. Samples: 17222760. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 18:45:06,376][177119] Avg episode reward: [(0, '10.393')] [2023-02-24 18:45:07,750][177153] Updated weights for policy 0, policy_version 16830 (0.0008) [2023-02-24 18:45:07,772][177172] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:45:07,978][177156] DAMAGECOUNT value on done: 179682.0 [2023-02-24 18:45:07,979][177156] Sum rewards: 11.423, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.550', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.156', 'weapon5': '0.156', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'HITCOUNT': '1.080', 'weapon2': '1.276', 'weapon3': '2.270', 'DAMAGECOUNT': '4.404', 'FRAGCOUNT': '12.000'} [2023-02-24 18:45:07,990][177156] DAMAGECOUNT value on done: 175653.0 [2023-02-24 18:45:07,990][177156] Sum rewards: 19.931, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.620', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon7': '0.050', 'AMMO4': '0.082', 'AMMO3': '0.084', 'weapon5': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.424', 'ARMOR': '0.488', 'WEAPON3': '0.550', 'HITCOUNT': '0.980', 'weapon2': '1.302', 'weapon3': '1.424', 'DAMAGECOUNT': '5.001', 'FRAGCOUNT': '16.000'} [2023-02-24 18:45:08,291][177156] DAMAGECOUNT value on done: 180941.0 [2023-02-24 18:45:08,292][177156] Sum rewards: 16.031, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.635', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.016', 'WEAPON1': '0.030', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.200', 'weapon4': '0.222', 'WEAPON5': '0.400', 'ARMOR': '0.454', 'WEAPON3': '0.600', 'HITCOUNT': '0.990', 'weapon2': '1.182', 'weapon3': '1.936', 'DAMAGECOUNT': '4.473', 'FRAGCOUNT': '12.000'} [2023-02-24 18:45:08,303][177156] DAMAGECOUNT value on done: 178286.0 [2023-02-24 18:45:08,304][177156] Sum rewards: 15.075, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.046', 'weapon7': '0.056', 'AMMO3': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.231', 'WEAPON3': '0.500', 'HEALTH': '0.510', 'weapon4': '0.614', 'weapon2': '0.946', 'HITCOUNT': '1.000', 'weapon3': '1.298', 'DAMAGECOUNT': '4.512', 'FRAGCOUNT': '12.000'} [2023-02-24 18:45:10,722][177153] Updated weights for policy 0, policy_version 16840 (0.0008) [2023-02-24 18:45:10,750][177170] DAMAGECOUNT value on done: 180047.0 [2023-02-24 18:45:10,750][177170] Sum rewards: 17.454, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.300', 'AMMO5': '0.020', 'AMMO2': '0.034', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.125', 'weapon5': '0.138', 'AMMO4': '0.170', 'WEAPON4': '0.250', 'weapon4': '0.286', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'weapon2': '0.962', 'HITCOUNT': '1.270', 'weapon3': '2.082', 'DAMAGECOUNT': '5.778', 'FRAGCOUNT': '15.000'} [2023-02-24 18:45:11,046][177170] DAMAGECOUNT value on done: 186654.0 [2023-02-24 18:45:11,047][177170] Sum rewards: 13.446, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.016', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.064', 'weapon5': '0.110', 'AMMO3': '0.133', 'WEAPON5': '0.200', 'WEAPON3': '0.750', 'HITCOUNT': '1.150', 'weapon2': '1.588', 'weapon3': '1.874', 'DAMAGECOUNT': '4.800', 'FRAGCOUNT': '12.000'} [2023-02-24 18:45:11,251][177170] DAMAGECOUNT value on done: 176163.0 [2023-02-24 18:45:11,251][177170] Sum rewards: 1.412, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.478', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.044', 'weapon7': '0.058', 'AMMO3': '0.067', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.220', 'WEAPON4': '0.300', 'weapon2': '0.330', 'HITCOUNT': '0.430', 'ARMOR': '0.456', 'WEAPON3': '0.500', 'weapon4': '0.852', 'weapon3': '1.152', 'DAMAGECOUNT': '1.512', 'FRAGCOUNT': '3.000'} [2023-02-24 18:45:11,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 68984832. Throughput: 0: 3480.9. Samples: 17243716. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 18:45:11,376][177119] Avg episode reward: [(0, '10.940')] [2023-02-24 18:45:11,545][177170] DAMAGECOUNT value on done: 176846.0 [2023-02-24 18:45:11,546][177170] Sum rewards: 11.992, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.882', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'weapon7': '0.054', 'AMMO3': '0.056', 'AMMO4': '0.059', 'weapon5': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.490', 'HITCOUNT': '0.660', 'weapon3': '1.076', 'weapon2': '1.378', 'DAMAGECOUNT': '2.799', 'FRAGCOUNT': '10.000'} [2023-02-24 18:45:12,036][177158] DAMAGECOUNT value on done: 171025.0 [2023-02-24 18:45:12,036][177158] Sum rewards: 11.026, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.923', 'AMMO5': '0.019', 'AMMO2': '0.020', 'weapon7': '0.046', 'AMMO3': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.218', 'weapon5': '0.226', 'WEAPON3': '0.400', 'HITCOUNT': '0.480', 'WEAPON5': '0.550', 'weapon3': '1.088', 'weapon2': '2.002', 'DAMAGECOUNT': '3.099', 'FRAGCOUNT': '9.000'} [2023-02-24 18:45:12,326][177158] DAMAGECOUNT value on done: 175451.0 [2023-02-24 18:45:12,327][177158] Sum rewards: 6.724, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.625', 'AMMO2': '0.004', 'AMMO5': '0.012', 'AMMO4': '0.017', 'WEAPON1': '0.050', 'AMMO3': '0.058', 'ARMOR': '0.072', 'WEAPON4': '0.150', 'weapon5': '0.182', 'WEAPON5': '0.350', 'WEAPON3': '0.350', 'weapon4': '0.420', 'HITCOUNT': '0.620', 'weapon3': '0.916', 'weapon2': '1.402', 'DAMAGECOUNT': '1.995', 'FRAGCOUNT': '6.000'} [2023-02-24 18:45:13,181][177158] DAMAGECOUNT value on done: 181215.0 [2023-02-24 18:45:13,181][177158] Sum rewards: 12.218, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.050', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO2': '0.029', 'AMMO3': '0.052', 'weapon7': '0.134', 'AMMO4': '0.147', 'weapon5': '0.186', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'WEAPON3': '0.300', 'WEAPON7': '0.400', 'HITCOUNT': '0.550', 'weapon2': '0.734', 'weapon3': '0.836', 'weapon4': '0.892', 'DAMAGECOUNT': '2.973', 'FRAGCOUNT': '10.000'} [2023-02-24 18:45:13,481][177158] DAMAGECOUNT value on done: 181241.0 [2023-02-24 18:45:13,482][177158] Sum rewards: 6.796, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.540', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.025', 'WEAPON1': '0.060', 'AMMO3': '0.106', 'weapon5': '0.350', 'WEAPON5': '0.650', 'HITCOUNT': '0.690', 'WEAPON3': '0.700', 'weapon2': '1.552', 'weapon3': '1.592', 'DAMAGECOUNT': '3.645', 'FRAGCOUNT': '6.500'} [2023-02-24 18:45:13,683][177153] Updated weights for policy 0, policy_version 16850 (0.0008) [2023-02-24 18:45:15,037][177172] DAMAGECOUNT value on done: 181402.0 [2023-02-24 18:45:15,038][177172] Sum rewards: 14.543, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.564', 'AMMO2': '0.007', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.034', 'ARMOR': '0.036', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'weapon5': '0.152', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.362', 'WEAPON3': '0.700', 'HITCOUNT': '0.980', 'weapon2': '1.018', 'weapon3': '1.914', 'DAMAGECOUNT': '4.704', 'FRAGCOUNT': '13.000'} [2023-02-24 18:45:15,328][177172] DAMAGECOUNT value on done: 178226.0 [2023-02-24 18:45:15,329][177172] Sum rewards: 5.236, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.444', 'AMMO5': '0.012', 'AMMO2': '0.037', 'WEAPON1': '0.050', 'weapon7': '0.054', 'AMMO3': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.187', 'weapon5': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.500', 'HITCOUNT': '0.510', 'weapon2': '1.066', 'weapon3': '1.444', 'DAMAGECOUNT': '2.943', 'FRAGCOUNT': '7.000'} [2023-02-24 18:45:16,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13912.5). Total num frames: 69054464. Throughput: 0: 3476.8. Samples: 17264484. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:45:16,376][177119] Avg episode reward: [(0, '10.924')] [2023-02-24 18:45:16,614][177154] DAMAGECOUNT value on done: 184551.0 [2023-02-24 18:45:16,615][177154] Sum rewards: 12.400, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.570', 'AMMO2': '0.005', 'AMMO5': '0.006', 'AMMO4': '0.024', 'WEAPON1': '0.060', 'weapon4': '0.062', 'weapon5': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'WEAPON5': '0.200', 'WEAPON3': '0.850', 'HITCOUNT': '0.910', 'weapon2': '1.436', 'weapon3': '1.990', 'DAMAGECOUNT': '3.882', 'FRAGCOUNT': '11.000'} [2023-02-24 18:45:16,646][177153] Updated weights for policy 0, policy_version 16860 (0.0009) [2023-02-24 18:45:16,913][177154] DAMAGECOUNT value on done: 185220.0 [2023-02-24 18:45:16,913][177154] Sum rewards: 3.740, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.470', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon5': '0.026', 'AMMO3': '0.074', 'AMMO4': '0.110', 'weapon7': '0.184', 'WEAPON4': '0.200', 'HITCOUNT': '0.260', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'weapon4': '0.516', 'weapon2': '0.598', 'weapon3': '1.110', 'DAMAGECOUNT': '1.533', 'FRAGCOUNT': '3.000'} [2023-02-24 18:45:17,104][177172] DAMAGECOUNT value on done: 180796.0 [2023-02-24 18:45:17,105][177172] Sum rewards: 11.834, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.940', 'AMMO2': '0.010', 'AMMO4': '0.048', 'AMMO3': '0.074', 'weapon7': '0.182', 'WEAPON4': '0.250', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON7': '0.500', 'WEAPON3': '0.500', 'HITCOUNT': '0.630', 'weapon4': '0.644', 'weapon2': '0.806', 'weapon3': '1.114', 'DAMAGECOUNT': '2.586', 'FRAGCOUNT': '10.000'} [2023-02-24 18:45:17,219][177154] DAMAGECOUNT value on done: 185530.0 [2023-02-24 18:45:17,219][177154] Sum rewards: 12.189, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.280', 'AMMO2': '0.005', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.023', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.154', 'weapon5': '0.256', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'HITCOUNT': '0.750', 'weapon2': '1.362', 'weapon3': '1.796', 'DAMAGECOUNT': '3.483', 'FRAGCOUNT': '11.000'} [2023-02-24 18:45:17,410][177172] DAMAGECOUNT value on done: 182137.0 [2023-02-24 18:45:17,411][177172] Sum rewards: 10.877, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.020', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO5': '0.020', 'weapon7': '0.058', 'AMMO4': '0.075', 'weapon5': '0.094', 'AMMO3': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'ARMOR': '0.451', 'weapon2': '0.594', 'WEAPON3': '0.700', 'weapon4': '0.860', 'HITCOUNT': '1.000', 'weapon3': '1.272', 'DAMAGECOUNT': '4.806', 'FRAGCOUNT': '13.000'} [2023-02-24 18:45:17,510][177154] DAMAGECOUNT value on done: 184060.0 [2023-02-24 18:45:17,511][177154] Sum rewards: 5.232, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.300', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'weapon7': '0.050', 'weapon5': '0.064', 'AMMO3': '0.070', 'AMMO4': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'weapon3': '1.682', 'weapon2': '1.970', 'DAMAGECOUNT': '2.472', 'FRAGCOUNT': '5.000'} [2023-02-24 18:45:17,784][177157] DAMAGECOUNT value on done: 171094.0 [2023-02-24 18:45:17,785][177157] Sum rewards: 18.701, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.336', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.012', 'WEAPON1': '0.060', 'AMMO3': '0.081', 'weapon5': '0.260', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'HITCOUNT': '1.080', 'weapon2': '1.334', 'weapon3': '1.848', 'DAMAGECOUNT': '5.478', 'FRAGCOUNT': '14.000'} [2023-02-24 18:45:17,799][177157] DAMAGECOUNT value on done: 184842.0 [2023-02-24 18:45:17,799][177157] Sum rewards: 4.898, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.248', 'AMMO2': '0.016', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.080', 'AMMO3': '0.106', 'weapon4': '0.126', 'WEAPON4': '0.150', 'weapon5': '0.234', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.630', 'weapon2': '1.170', 'weapon3': '1.872', 'DAMAGECOUNT': '2.214', 'FRAGCOUNT': '3.500'} [2023-02-24 18:45:18,053][177171] DAMAGECOUNT value on done: 173461.0 [2023-02-24 18:45:18,054][177171] Sum rewards: 9.379, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.260', 'AMMO2': '0.002', 'AMMO5': '0.010', 'AMMO4': '0.012', 'WEAPON1': '0.030', 'AMMO3': '0.068', 'weapon5': '0.084', 'WEAPON4': '0.100', 'weapon7': '0.102', 'weapon4': '0.146', 'WEAPON5': '0.250', 'AMMO6': '0.420', 'AMMO7': '0.420', 'WEAPON3': '0.450', 'WEAPON7': '0.500', 'HITCOUNT': '0.520', 'ARMOR': '0.608', 'weapon2': '1.018', 'weapon3': '1.292', 'DAMAGECOUNT': '2.607', 'FRAGCOUNT': '8.000'} [2023-02-24 18:45:18,098][177157] DAMAGECOUNT value on done: 174970.0 [2023-02-24 18:45:18,099][177157] Sum rewards: 10.814, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.705', 'weapon7': '0.018', 'AMMO5': '0.018', 'AMMO2': '0.022', 'WEAPON1': '0.050', 'AMMO4': '0.111', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.224', 'weapon5': '0.260', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'weapon2': '0.818', 'HITCOUNT': '1.060', 'weapon3': '2.242', 'DAMAGECOUNT': '4.269', 'FRAGCOUNT': '10.000'} [2023-02-24 18:45:18,108][177157] DAMAGECOUNT value on done: 176873.0 [2023-02-24 18:45:18,108][177157] Sum rewards: 8.126, reward structure: {'DEATHCOUNT': '-6.000', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'weapon7': '0.048', 'AMMO3': '0.073', 'weapon5': '0.100', 'AMMO4': '0.156', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HEALTH': '0.298', 'weapon4': '0.382', 'WEAPON3': '0.450', 'HITCOUNT': '0.670', 'weapon2': '1.098', 'weapon3': '1.490', 'DAMAGECOUNT': '2.295', 'FRAGCOUNT': '6.000'} [2023-02-24 18:45:18,356][177171] DAMAGECOUNT value on done: 175921.0 [2023-02-24 18:45:18,356][177171] Sum rewards: 12.613, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.808', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.132', 'WEAPON7': '0.200', 'WEAPON3': '0.650', 'HITCOUNT': '0.710', 'weapon2': '1.518', 'weapon3': '1.722', 'DAMAGECOUNT': '3.339', 'FRAGCOUNT': '10.000'} [2023-02-24 18:45:18,365][177171] DAMAGECOUNT value on done: 182374.0 [2023-02-24 18:45:18,366][177171] Sum rewards: 11.621, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'ARMOR': '0.032', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.070', 'weapon7': '0.084', 'AMMO3': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HEALTH': '0.220', 'weapon4': '0.320', 'WEAPON3': '0.600', 'weapon2': '0.786', 'HITCOUNT': '0.960', 'weapon3': '1.768', 'DAMAGECOUNT': '3.732', 'FRAGCOUNT': '9.000'} [2023-02-24 18:45:18,666][177171] DAMAGECOUNT value on done: 177335.0 [2023-02-24 18:45:18,667][177171] Sum rewards: 4.093, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.441', 'AMMO2': '0.014', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.068', 'AMMO3': '0.114', 'weapon5': '0.172', 'WEAPON4': '0.200', 'weapon4': '0.282', 'WEAPON5': '0.450', 'HITCOUNT': '0.670', 'WEAPON3': '0.800', 'weapon2': '1.296', 'weapon3': '1.574', 'DAMAGECOUNT': '2.844', 'FRAGCOUNT': '6.000'} [2023-02-24 18:45:19,477][177155] DAMAGECOUNT value on done: 180456.0 [2023-02-24 18:45:19,478][177155] Sum rewards: 10.192, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.180', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON1': '0.040', 'AMMO4': '0.056', 'AMMO3': '0.061', 'weapon4': '0.084', 'weapon5': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'HITCOUNT': '0.790', 'weapon3': '1.464', 'weapon2': '1.622', 'DAMAGECOUNT': '3.480', 'FRAGCOUNT': '8.000'} [2023-02-24 18:45:19,591][177153] Updated weights for policy 0, policy_version 16870 (0.0009) [2023-02-24 18:45:19,780][177155] DAMAGECOUNT value on done: 185280.0 [2023-02-24 18:45:19,780][177155] Sum rewards: 22.130, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.608', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO3': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.178', 'weapon4': '0.188', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'weapon2': '1.142', 'HITCOUNT': '1.370', 'weapon3': '1.756', 'DAMAGECOUNT': '5.322', 'FRAGCOUNT': '18.000'} [2023-02-24 18:45:20,195][177155] DAMAGECOUNT value on done: 186867.0 [2023-02-24 18:45:20,196][177155] Sum rewards: 11.437, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.015', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON5': '0.050', 'weapon7': '0.052', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.218', 'weapon2': '0.488', 'WEAPON3': '0.600', 'HITCOUNT': '0.950', 'weapon3': '1.490', 'DAMAGECOUNT': '3.675', 'FRAGCOUNT': '11.000'} [2023-02-24 18:45:20,492][177155] DAMAGECOUNT value on done: 177775.0 [2023-02-24 18:45:20,493][177155] Sum rewards: 4.262, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.200', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.027', 'WEAPON1': '0.040', 'AMMO3': '0.116', 'AMMO4': '0.135', 'weapon5': '0.302', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '0.750', 'HITCOUNT': '0.780', 'weapon4': '0.786', 'weapon2': '0.924', 'weapon3': '1.466', 'DAMAGECOUNT': '3.216', 'FRAGCOUNT': '6.500'} [2023-02-24 18:45:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13912.5). Total num frames: 69124096. Throughput: 0: 3475.0. Samples: 17274882. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:45:21,376][177119] Avg episode reward: [(0, '10.919')] [2023-02-24 18:45:22,536][177153] Updated weights for policy 0, policy_version 16880 (0.0008) [2023-02-24 18:45:25,477][177153] Updated weights for policy 0, policy_version 16890 (0.0008) [2023-02-24 18:45:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13912.5). Total num frames: 69193728. Throughput: 0: 3478.4. Samples: 17295834. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:45:26,376][177119] Avg episode reward: [(0, '10.919')] [2023-02-24 18:45:27,374][177156] DAMAGECOUNT value on done: 176350.0 [2023-02-24 18:45:27,374][177156] Sum rewards: 5.426, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.696', 'AMMO5': '0.018', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.106', 'weapon4': '0.108', 'AMMO4': '0.134', 'weapon5': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'HITCOUNT': '0.460', 'WEAPON3': '0.550', 'weapon3': '1.362', 'weapon2': '1.756', 'DAMAGECOUNT': '2.091', 'FRAGCOUNT': '6.500'} [2023-02-24 18:45:27,395][177156] DAMAGECOUNT value on done: 180264.0 [2023-02-24 18:45:27,396][177156] Sum rewards: 1.990, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.486', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.060', 'weapon7': '0.070', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.372', 'HITCOUNT': '0.440', 'WEAPON3': '0.600', 'weapon2': '0.718', 'weapon3': '1.402', 'DAMAGECOUNT': '1.746', 'FRAGCOUNT': '2.000'} [2023-02-24 18:45:27,689][177156] DAMAGECOUNT value on done: 179716.0 [2023-02-24 18:45:27,690][177156] Sum rewards: 11.226, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.245', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO4': '0.031', 'weapon7': '0.046', 'AMMO3': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.148', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.450', 'WEAPON3': '0.800', 'HITCOUNT': '0.920', 'weapon2': '1.186', 'weapon3': '1.592', 'DAMAGECOUNT': '4.290', 'FRAGCOUNT': '11.000'} [2023-02-24 18:45:27,700][177156] DAMAGECOUNT value on done: 183725.0 [2023-02-24 18:45:27,701][177156] Sum rewards: 26.284, reward structure: {'DEATHCOUNT': '-8.250', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon7': '0.048', 'AMMO4': '0.104', 'AMMO3': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.154', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.306', 'HEALTH': '0.315', 'WEAPON3': '0.550', 'weapon2': '1.156', 'HITCOUNT': '1.290', 'weapon3': '2.010', 'DAMAGECOUNT': '7.152', 'FRAGCOUNT': '20.500'} [2023-02-24 18:45:28,415][177153] Updated weights for policy 0, policy_version 16900 (0.0008) [2023-02-24 18:45:29,967][177170] DAMAGECOUNT value on done: 180917.0 [2023-02-24 18:45:29,968][177170] Sum rewards: 6.257, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.648', 'AMMO5': '0.009', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO3': '0.071', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.124', 'weapon5': '0.182', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.506', 'HITCOUNT': '0.630', 'weapon2': '1.036', 'weapon3': '1.544', 'DAMAGECOUNT': '2.610', 'FRAGCOUNT': '6.000'} [2023-02-24 18:45:30,268][177170] DAMAGECOUNT value on done: 187760.0 [2023-02-24 18:45:30,269][177170] Sum rewards: 5.849, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.462', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON1': '0.050', 'AMMO4': '0.087', 'AMMO3': '0.112', 'weapon4': '0.158', 'weapon5': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'HITCOUNT': '0.770', 'weapon2': '0.998', 'weapon3': '2.138', 'DAMAGECOUNT': '3.318', 'FRAGCOUNT': '6.500'} [2023-02-24 18:45:30,560][177170] DAMAGECOUNT value on done: 177955.0 [2023-02-24 18:45:30,561][177170] Sum rewards: 16.989, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.908', 'AMMO5': '0.013', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'weapon7': '0.046', 'AMMO3': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.112', 'weapon5': '0.156', 'weapon4': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'weapon2': '1.142', 'HITCOUNT': '1.200', 'weapon3': '1.648', 'DAMAGECOUNT': '5.376', 'FRAGCOUNT': '14.000'} [2023-02-24 18:45:30,856][177170] DAMAGECOUNT value on done: 177563.0 [2023-02-24 18:45:30,856][177170] Sum rewards: 5.023, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.015', 'weapon4': '0.020', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.074', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.108', 'weapon5': '0.236', 'HEALTH': '0.261', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'HITCOUNT': '0.520', 'weapon2': '1.578', 'weapon3': '1.598', 'DAMAGECOUNT': '2.151', 'FRAGCOUNT': '2.500'} [2023-02-24 18:45:31,376][177119] Fps is (10 sec: 13516.9, 60 sec: 13858.2, 300 sec: 13898.6). Total num frames: 69259264. Throughput: 0: 3475.2. Samples: 17316648. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:45:31,376][177119] Avg episode reward: [(0, '10.844')] [2023-02-24 18:45:31,404][177153] Updated weights for policy 0, policy_version 16910 (0.0008) [2023-02-24 18:45:31,459][177158] DAMAGECOUNT value on done: 172561.0 [2023-02-24 18:45:31,459][177158] Sum rewards: 19.166, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.088', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO5': '0.020', 'weapon7': '0.066', 'AMMO4': '0.072', 'AMMO3': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.172', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'weapon2': '0.822', 'HITCOUNT': '1.030', 'weapon3': '2.096', 'DAMAGECOUNT': '4.608', 'FRAGCOUNT': '15.000'} [2023-02-24 18:45:31,762][177158] DAMAGECOUNT value on done: 176539.0 [2023-02-24 18:45:31,763][177158] Sum rewards: 6.810, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.976', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO4': '0.030', 'weapon4': '0.040', 'AMMO3': '0.070', 'WEAPON4': '0.150', 'weapon5': '0.170', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.710', 'weapon3': '1.292', 'weapon2': '2.048', 'DAMAGECOUNT': '2.844', 'FRAGCOUNT': '7.000'} [2023-02-24 18:45:32,535][177158] DAMAGECOUNT value on done: 182909.0 [2023-02-24 18:45:32,535][177158] Sum rewards: 17.822, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.876', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'AMMO5': '0.003', 'weapon5': '0.046', 'AMMO3': '0.078', 'weapon7': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.252', 'WEAPON7': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.008', 'HITCOUNT': '1.130', 'weapon3': '1.330', 'DAMAGECOUNT': '5.082', 'FRAGCOUNT': '15.000'} [2023-02-24 18:45:32,829][177158] DAMAGECOUNT value on done: 182849.0 [2023-02-24 18:45:32,830][177158] Sum rewards: 18.797, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'AMMO4': '0.121', 'weapon5': '0.142', 'WEAPON5': '0.400', 'weapon4': '0.408', 'HEALTH': '0.482', 'weapon2': '0.618', 'WEAPON3': '0.650', 'HITCOUNT': '1.050', 'weapon3': '2.070', 'DAMAGECOUNT': '4.824', 'FRAGCOUNT': '16.000'} [2023-02-24 18:45:34,337][177153] Updated weights for policy 0, policy_version 16920 (0.0008) [2023-02-24 18:45:34,404][177172] DAMAGECOUNT value on done: 182244.0 [2023-02-24 18:45:34,404][177172] Sum rewards: 6.196, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.510', 'AMMO5': '0.006', 'AMMO2': '0.014', 'WEAPON1': '0.040', 'AMMO4': '0.070', 'weapon5': '0.096', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.350', 'HITCOUNT': '0.620', 'WEAPON3': '0.700', 'weapon2': '1.120', 'weapon3': '1.500', 'DAMAGECOUNT': '2.526', 'FRAGCOUNT': '6.000'} [2023-02-24 18:45:34,705][177172] DAMAGECOUNT value on done: 179700.0 [2023-02-24 18:45:34,705][177172] Sum rewards: 10.108, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.720', 'ARMOR': '0.004', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.102', 'AMMO3': '0.123', 'weapon5': '0.234', 'weapon4': '0.280', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'HITCOUNT': '0.780', 'WEAPON3': '0.850', 'weapon2': '1.532', 'weapon3': '1.540', 'DAMAGECOUNT': '4.422', 'FRAGCOUNT': '11.000'} [2023-02-24 18:45:35,925][177154] DAMAGECOUNT value on done: 185484.0 [2023-02-24 18:45:35,925][177154] Sum rewards: 7.901, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.438', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.114', 'AMMO3': '0.121', 'WEAPON5': '0.450', 'HITCOUNT': '0.840', 'WEAPON3': '0.900', 'weapon2': '1.422', 'weapon3': '2.160', 'DAMAGECOUNT': '2.799', 'FRAGCOUNT': '8.000'} [2023-02-24 18:45:36,230][177154] DAMAGECOUNT value on done: 186181.0 [2023-02-24 18:45:36,230][177154] Sum rewards: 6.798, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.280', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.020', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.143', 'weapon5': '0.182', 'weapon4': '0.210', 'WEAPON5': '0.500', 'HITCOUNT': '0.700', 'WEAPON3': '0.800', 'weapon2': '1.560', 'weapon3': '1.688', 'DAMAGECOUNT': '2.883', 'FRAGCOUNT': '9.000'} [2023-02-24 18:45:36,376][177119] Fps is (10 sec: 13516.7, 60 sec: 13858.1, 300 sec: 13898.6). Total num frames: 69328896. Throughput: 0: 3474.4. Samples: 17327058. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:45:36,376][177119] Avg episode reward: [(0, '10.952')] [2023-02-24 18:45:36,497][177172] DAMAGECOUNT value on done: 181810.0 [2023-02-24 18:45:36,497][177172] Sum rewards: 9.832, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.871', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.031', 'WEAPON1': '0.040', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'weapon4': '0.106', 'weapon5': '0.172', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.650', 'HITCOUNT': '0.870', 'weapon2': '1.184', 'weapon3': '1.804', 'DAMAGECOUNT': '3.042', 'FRAGCOUNT': '7.000'} [2023-02-24 18:45:36,542][177154] DAMAGECOUNT value on done: 186524.0 [2023-02-24 18:45:36,543][177154] Sum rewards: 5.213, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.784', 'AMMO5': '0.014', 'AMMO2': '0.017', 'weapon7': '0.048', 'WEAPON1': '0.060', 'AMMO4': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.122', 'weapon5': '0.188', 'WEAPON4': '0.300', 'weapon4': '0.322', 'WEAPON5': '0.450', 'HITCOUNT': '0.690', 'WEAPON3': '0.700', 'weapon3': '1.228', 'weapon2': '1.244', 'DAMAGECOUNT': '2.982', 'FRAGCOUNT': '6.500'} [2023-02-24 18:45:36,801][177172] DAMAGECOUNT value on done: 183511.0 [2023-02-24 18:45:36,801][177172] Sum rewards: 14.235, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.425', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.031', 'ARMOR': '0.040', 'weapon7': '0.048', 'AMMO3': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.155', 'weapon5': '0.192', 'weapon2': '0.460', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'weapon4': '0.928', 'HITCOUNT': '1.000', 'weapon3': '1.752', 'DAMAGECOUNT': '4.122', 'FRAGCOUNT': '13.000'} [2023-02-24 18:45:36,848][177154] DAMAGECOUNT value on done: 185253.0 [2023-02-24 18:45:36,848][177154] Sum rewards: 12.351, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.378', 'AMMO5': '0.009', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'weapon7': '0.050', 'weapon5': '0.088', 'AMMO4': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.126', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.500', 'WEAPON3': '0.700', 'weapon2': '0.700', 'HITCOUNT': '0.910', 'weapon3': '1.774', 'DAMAGECOUNT': '3.579', 'FRAGCOUNT': '13.000'} [2023-02-24 18:45:37,058][177157] DAMAGECOUNT value on done: 171329.0 [2023-02-24 18:45:37,059][177157] Sum rewards: 2.680, reward structure: {'DEATHCOUNT': '-0.750', 'HEALTH': '-0.525', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.013', 'weapon7': '0.048', 'HITCOUNT': '0.070', 'weapon2': '0.092', 'WEAPON3': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon3': '0.184', 'WEAPON7': '0.200', 'weapon4': '0.204', 'DAMAGECOUNT': '0.705', 'FRAGCOUNT': '2.000'} [2023-02-24 18:45:37,070][177157] DAMAGECOUNT value on done: 186052.0 [2023-02-24 18:45:37,070][177157] Sum rewards: 11.208, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.772', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'weapon5': '0.114', 'AMMO3': '0.136', 'AMMO4': '0.143', 'WEAPON5': '0.200', 'weapon4': '0.246', 'WEAPON4': '0.250', 'WEAPON3': '0.750', 'HITCOUNT': '0.900', 'weapon2': '1.098', 'weapon3': '1.940', 'DAMAGECOUNT': '3.630', 'FRAGCOUNT': '10.000'} [2023-02-24 18:45:37,270][177153] Updated weights for policy 0, policy_version 16930 (0.0008) [2023-02-24 18:45:37,357][177171] DAMAGECOUNT value on done: 174415.0 [2023-02-24 18:45:37,357][177171] Sum rewards: 5.975, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.996', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.041', 'weapon5': '0.074', 'AMMO3': '0.075', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.152', 'WEAPON7': '0.200', 'AMMO4': '0.205', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.566', 'HITCOUNT': '0.770', 'weapon2': '1.110', 'weapon3': '1.236', 'DAMAGECOUNT': '2.862', 'FRAGCOUNT': '5.000'} [2023-02-24 18:45:37,373][177157] DAMAGECOUNT value on done: 176012.0 [2023-02-24 18:45:37,373][177157] Sum rewards: 14.068, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'AMMO4': '0.091', 'weapon5': '0.104', 'WEAPON5': '0.150', 'WEAPON3': '0.300', 'HEALTH': '0.556', 'HITCOUNT': '0.700', 'weapon3': '1.016', 'weapon2': '2.422', 'DAMAGECOUNT': '3.126', 'FRAGCOUNT': '10.000'} [2023-02-24 18:45:37,385][177157] DAMAGECOUNT value on done: 178299.0 [2023-02-24 18:45:37,385][177157] Sum rewards: 13.361, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.265', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO3': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.214', 'weapon4': '0.390', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.870', 'weapon2': '0.900', 'weapon3': '1.792', 'DAMAGECOUNT': '4.275', 'FRAGCOUNT': '11.000'} [2023-02-24 18:45:37,650][177171] DAMAGECOUNT value on done: 177073.0 [2023-02-24 18:45:37,651][177171] Sum rewards: 8.598, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.400', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO5': '0.023', 'WEAPON1': '0.080', 'AMMO3': '0.115', 'weapon5': '0.242', 'WEAPON4': '0.300', 'weapon4': '0.376', 'WEAPON5': '0.650', 'WEAPON3': '0.850', 'HITCOUNT': '0.910', 'weapon2': '1.224', 'weapon3': '1.754', 'DAMAGECOUNT': '3.456', 'FRAGCOUNT': '10.000'} [2023-02-24 18:45:37,660][177171] DAMAGECOUNT value on done: 183618.0 [2023-02-24 18:45:37,661][177171] Sum rewards: 6.595, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.972', 'AMMO5': '0.015', 'AMMO2': '0.027', 'weapon7': '0.052', 'AMMO3': '0.094', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.132', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'WEAPON3': '0.600', 'weapon4': '0.704', 'weapon2': '0.836', 'HITCOUNT': '0.920', 'ARMOR': '1.321', 'weapon3': '1.376', 'DAMAGECOUNT': '3.732', 'FRAGCOUNT': '7.000'} [2023-02-24 18:45:37,967][177171] DAMAGECOUNT value on done: 177785.0 [2023-02-24 18:45:37,967][177171] Sum rewards: 5.331, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.538', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon7': '0.052', 'AMMO3': '0.071', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.118', 'weapon4': '0.258', 'HITCOUNT': '0.260', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'weapon3': '1.052', 'DAMAGECOUNT': '1.350', 'weapon2': '1.368', 'FRAGCOUNT': '4.000'} [2023-02-24 18:45:38,829][177155] DAMAGECOUNT value on done: 181763.0 [2023-02-24 18:45:38,829][177155] Sum rewards: 15.321, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.555', 'AMMO2': '0.005', 'AMMO5': '0.015', 'weapon4': '0.026', 'AMMO4': '0.027', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon5': '0.186', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'HITCOUNT': '0.830', 'weapon3': '1.514', 'weapon2': '1.642', 'DAMAGECOUNT': '3.921', 'FRAGCOUNT': '12.000'} [2023-02-24 18:45:39,128][177155] DAMAGECOUNT value on done: 186595.0 [2023-02-24 18:45:39,128][177155] Sum rewards: 10.579, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'HEALTH': '0.064', 'AMMO3': '0.100', 'weapon5': '0.134', 'AMMO4': '0.156', 'weapon7': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON3': '0.550', 'weapon4': '0.564', 'HITCOUNT': '0.860', 'weapon2': '0.932', 'weapon3': '1.192', 'DAMAGECOUNT': '3.945', 'FRAGCOUNT': '11.000'} [2023-02-24 18:45:39,536][177155] DAMAGECOUNT value on done: 188078.0 [2023-02-24 18:45:39,537][177155] Sum rewards: 10.112, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.419', 'AMMO2': '0.019', 'AMMO5': '0.020', 'WEAPON1': '0.050', 'weapon4': '0.084', 'AMMO4': '0.095', 'AMMO3': '0.120', 'weapon5': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.500', 'HITCOUNT': '0.790', 'WEAPON3': '0.800', 'weapon2': '1.550', 'weapon3': '1.764', 'DAMAGECOUNT': '3.633', 'FRAGCOUNT': '10.000'} [2023-02-24 18:45:39,833][177155] DAMAGECOUNT value on done: 178817.0 [2023-02-24 18:45:39,833][177155] Sum rewards: 3.916, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.310', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon7': '0.068', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.124', 'AMMO3': '0.132', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.378', 'HITCOUNT': '0.670', 'WEAPON3': '0.700', 'weapon2': '0.966', 'weapon3': '1.402', 'DAMAGECOUNT': '3.126', 'FRAGCOUNT': '5.000'} [2023-02-24 18:45:40,204][177153] Updated weights for policy 0, policy_version 16940 (0.0008) [2023-02-24 18:45:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.2, 300 sec: 13898.6). Total num frames: 69398528. Throughput: 0: 3476.3. Samples: 17347924. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:45:41,376][177119] Avg episode reward: [(0, '10.819')] [2023-02-24 18:45:43,147][177153] Updated weights for policy 0, policy_version 16950 (0.0008) [2023-02-24 18:45:46,100][177153] Updated weights for policy 0, policy_version 16960 (0.0008) [2023-02-24 18:45:46,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13898.6). Total num frames: 69468160. Throughput: 0: 3477.9. Samples: 17368742. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:45:46,376][177119] Avg episode reward: [(0, '10.819')] [2023-02-24 18:45:46,856][177156] DAMAGECOUNT value on done: 182102.0 [2023-02-24 18:45:46,857][177156] Sum rewards: 19.511, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.055', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.023', 'AMMO4': '0.117', 'weapon5': '0.118', 'AMMO3': '0.137', 'weapon4': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.804', 'WEAPON3': '0.850', 'HITCOUNT': '1.330', 'weapon3': '1.844', 'DAMAGECOUNT': '5.514', 'FRAGCOUNT': '18.000'} [2023-02-24 18:45:46,868][177156] DAMAGECOUNT value on done: 178015.0 [2023-02-24 18:45:46,869][177156] Sum rewards: 15.718, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.645', 'AMMO2': '0.011', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'AMMO4': '0.056', 'AMMO3': '0.106', 'WEAPON4': '0.250', 'weapon5': '0.334', 'weapon4': '0.426', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon2': '1.042', 'HITCOUNT': '1.200', 'weapon3': '1.840', 'DAMAGECOUNT': '4.995', 'FRAGCOUNT': '14.000'} [2023-02-24 18:45:47,167][177156] DAMAGECOUNT value on done: 184947.0 [2023-02-24 18:45:47,167][177156] Sum rewards: 8.914, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.547', 'AMMO2': '0.022', 'AMMO5': '0.024', 'WEAPON1': '0.060', 'AMMO4': '0.108', 'AMMO3': '0.113', 'weapon5': '0.192', 'weapon4': '0.262', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'WEAPON5': '0.550', 'HITCOUNT': '0.690', 'WEAPON3': '0.800', 'weapon3': '1.264', 'weapon2': '1.960', 'DAMAGECOUNT': '3.666', 'FRAGCOUNT': '8.500'} [2023-02-24 18:45:47,178][177156] DAMAGECOUNT value on done: 180926.0 [2023-02-24 18:45:47,179][177156] Sum rewards: 13.688, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.390', 'AMMO5': '0.020', 'AMMO2': '0.034', 'WEAPON1': '0.040', 'AMMO3': '0.079', 'AMMO4': '0.169', 'weapon5': '0.248', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.574', 'HITCOUNT': '0.840', 'weapon3': '0.950', 'weapon2': '1.744', 'DAMAGECOUNT': '3.630', 'FRAGCOUNT': '9.000'} [2023-02-24 18:45:49,038][177153] Updated weights for policy 0, policy_version 16970 (0.0008) [2023-02-24 18:45:49,261][177170] DAMAGECOUNT value on done: 182390.0 [2023-02-24 18:45:49,262][177170] Sum rewards: 13.932, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.571', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'AMMO3': '0.121', 'AMMO4': '0.164', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.218', 'WEAPON5': '0.500', 'weapon4': '0.520', 'weapon2': '0.556', 'WEAPON3': '0.850', 'HITCOUNT': '1.060', 'weapon3': '1.974', 'DAMAGECOUNT': '4.419', 'FRAGCOUNT': '12.500'} [2023-02-24 18:45:49,560][177170] DAMAGECOUNT value on done: 188652.0 [2023-02-24 18:45:49,561][177170] Sum rewards: 7.228, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.714', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.029', 'weapon7': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.059', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.116', 'weapon5': '0.130', 'weapon4': '0.136', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'HITCOUNT': '0.770', 'weapon2': '1.534', 'weapon3': '1.574', 'DAMAGECOUNT': '2.676', 'FRAGCOUNT': '6.000'} [2023-02-24 18:45:49,854][177170] DAMAGECOUNT value on done: 179261.0 [2023-02-24 18:45:49,855][177170] Sum rewards: 14.965, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.650', 'AMMO2': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO4': '0.042', 'weapon7': '0.050', 'AMMO3': '0.051', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.222', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'weapon4': '0.404', 'HITCOUNT': '0.750', 'weapon2': '1.150', 'weapon3': '1.230', 'DAMAGECOUNT': '3.918', 'FRAGCOUNT': '11.000'} [2023-02-24 18:45:50,158][177170] DAMAGECOUNT value on done: 178339.0 [2023-02-24 18:45:50,158][177170] Sum rewards: 6.026, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.240', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.075', 'weapon5': '0.076', 'weapon7': '0.080', 'AMMO3': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.446', 'weapon2': '0.522', 'HITCOUNT': '0.550', 'WEAPON3': '0.650', 'weapon3': '1.378', 'DAMAGECOUNT': '2.328', 'FRAGCOUNT': '6.000'} [2023-02-24 18:45:50,765][177158] DAMAGECOUNT value on done: 174134.0 [2023-02-24 18:45:50,766][177158] Sum rewards: 15.658, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.250', 'AMMO5': '0.020', 'AMMO2': '0.031', 'WEAPON1': '0.050', 'AMMO3': '0.134', 'weapon5': '0.146', 'AMMO4': '0.155', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon4': '0.692', 'weapon2': '0.722', 'ARMOR': '0.800', 'WEAPON3': '0.850', 'HITCOUNT': '1.250', 'weapon3': '1.838', 'DAMAGECOUNT': '4.719', 'FRAGCOUNT': '16.000'} [2023-02-24 18:45:51,067][177158] DAMAGECOUNT value on done: 177723.0 [2023-02-24 18:45:51,067][177158] Sum rewards: 11.526, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.350', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO3': '0.085', 'weapon7': '0.182', 'WEAPON4': '0.200', 'AMMO6': '0.360', 'AMMO7': '0.360', 'weapon4': '0.476', 'WEAPON3': '0.600', 'WEAPON7': '0.600', 'HITCOUNT': '0.730', 'weapon2': '0.808', 'weapon3': '1.182', 'DAMAGECOUNT': '3.552', 'FRAGCOUNT': '9.000'} [2023-02-24 18:45:51,376][177119] Fps is (10 sec: 13926.0, 60 sec: 13858.1, 300 sec: 13898.6). Total num frames: 69537792. Throughput: 0: 3474.4. Samples: 17379110. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:45:51,377][177119] Avg episode reward: [(0, '10.925')] [2023-02-24 18:45:51,813][177158] DAMAGECOUNT value on done: 184165.0 [2023-02-24 18:45:51,813][177158] Sum rewards: 9.225, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.439', 'AMMO2': '0.017', 'AMMO5': '0.025', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.087', 'weapon5': '0.116', 'AMMO3': '0.142', 'weapon4': '0.236', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'weapon2': '0.884', 'HITCOUNT': '1.090', 'weapon3': '2.134', 'DAMAGECOUNT': '3.723', 'FRAGCOUNT': '8.000'} [2023-02-24 18:45:51,992][177153] Updated weights for policy 0, policy_version 16980 (0.0008) [2023-02-24 18:45:52,112][177158] DAMAGECOUNT value on done: 184846.0 [2023-02-24 18:45:52,112][177158] Sum rewards: 17.692, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.508', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.039', 'AMMO3': '0.116', 'weapon5': '0.144', 'AMMO4': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.550', 'WEAPON3': '0.750', 'weapon4': '0.808', 'weapon2': '0.840', 'HITCOUNT': '1.700', 'weapon3': '1.832', 'DAMAGECOUNT': '5.991', 'FRAGCOUNT': '14.000'} [2023-02-24 18:45:53,686][177172] DAMAGECOUNT value on done: 184973.0 [2023-02-24 18:45:53,686][177172] Sum rewards: 19.836, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.690', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'weapon7': '0.074', 'AMMO4': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.183', 'WEAPON7': '0.200', 'weapon5': '0.252', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.502', 'weapon4': '0.668', 'WEAPON3': '1.250', 'HITCOUNT': '1.530', 'weapon3': '1.974', 'DAMAGECOUNT': '8.187', 'FRAGCOUNT': '19.500'} [2023-02-24 18:45:53,997][177172] DAMAGECOUNT value on done: 180540.0 [2023-02-24 18:45:53,997][177172] Sum rewards: 7.602, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'weapon5': '0.070', 'AMMO3': '0.087', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'HEALTH': '0.168', 'weapon4': '0.226', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.580', 'weapon2': '0.684', 'weapon3': '1.212', 'DAMAGECOUNT': '2.520', 'FRAGCOUNT': '6.000'} [2023-02-24 18:45:54,903][177153] Updated weights for policy 0, policy_version 16990 (0.0009) [2023-02-24 18:45:55,338][177154] DAMAGECOUNT value on done: 186816.0 [2023-02-24 18:45:55,338][177154] Sum rewards: 13.819, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.295', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'AMMO3': '0.060', 'weapon7': '0.062', 'AMMO4': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.204', 'WEAPON3': '0.450', 'weapon4': '0.672', 'HITCOUNT': '0.830', 'weapon3': '1.226', 'weapon2': '1.386', 'DAMAGECOUNT': '3.996', 'FRAGCOUNT': '9.500'} [2023-02-24 18:45:55,635][177154] DAMAGECOUNT value on done: 188083.0 [2023-02-24 18:45:55,636][177154] Sum rewards: 17.367, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.566', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.124', 'weapon5': '0.180', 'AMMO4': '0.201', 'WEAPON4': '0.400', 'weapon4': '0.468', 'WEAPON3': '0.750', 'weapon2': '0.978', 'HITCOUNT': '1.530', 'weapon3': '1.940', 'DAMAGECOUNT': '5.706', 'FRAGCOUNT': '16.000'} [2023-02-24 18:45:55,781][177172] DAMAGECOUNT value on done: 183467.0 [2023-02-24 18:45:55,781][177172] Sum rewards: 11.970, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.030', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO5': '0.032', 'AMMO4': '0.068', 'AMMO3': '0.182', 'weapon5': '0.262', 'WEAPON4': '0.300', 'weapon4': '0.432', 'ARMOR': '0.456', 'WEAPON5': '0.750', 'weapon2': '0.918', 'WEAPON3': '1.150', 'HITCOUNT': '1.210', 'weapon3': '1.744', 'DAMAGECOUNT': '4.971', 'FRAGCOUNT': '13.000'} [2023-02-24 18:45:55,946][177154] DAMAGECOUNT value on done: 188817.0 [2023-02-24 18:45:55,947][177154] Sum rewards: 20.611, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.608', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO3': '0.156', 'WEAPON4': '0.250', 'weapon4': '0.254', 'WEAPON3': '1.000', 'weapon2': '1.144', 'HITCOUNT': '1.430', 'weapon3': '2.118', 'DAMAGECOUNT': '6.879', 'FRAGCOUNT': '19.000'} [2023-02-24 18:45:56,079][177172] DAMAGECOUNT value on done: 184868.0 [2023-02-24 18:45:56,079][177172] Sum rewards: 8.172, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.786', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.042', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.173', 'AMMO4': '0.212', 'weapon5': '0.282', 'WEAPON4': '0.400', 'ARMOR': '0.450', 'WEAPON5': '0.550', 'weapon4': '0.616', 'weapon2': '0.664', 'HITCOUNT': '0.830', 'WEAPON3': '1.050', 'weapon3': '1.472', 'DAMAGECOUNT': '4.071', 'FRAGCOUNT': '10.000'} [2023-02-24 18:45:56,246][177154] DAMAGECOUNT value on done: 186892.0 [2023-02-24 18:45:56,246][177154] Sum rewards: 17.344, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.532', 'ARMOR': '0.004', 'AMMO2': '0.016', 'AMMO5': '0.025', 'WEAPON1': '0.030', 'AMMO3': '0.065', 'weapon7': '0.066', 'AMMO4': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.212', 'weapon4': '0.446', 'WEAPON5': '0.450', 'WEAPON3': '0.450', 'HITCOUNT': '0.990', 'weapon2': '1.182', 'weapon3': '1.350', 'DAMAGECOUNT': '4.917', 'FRAGCOUNT': '13.000'} [2023-02-24 18:45:56,351][177157] DAMAGECOUNT value on done: 187395.0 [2023-02-24 18:45:56,352][177157] Sum rewards: 11.326, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.390', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.042', 'WEAPON1': '0.050', 'AMMO3': '0.086', 'AMMO4': '0.210', 'weapon4': '0.298', 'weapon5': '0.398', 'WEAPON4': '0.400', 'WEAPON3': '0.600', 'WEAPON5': '0.650', 'HITCOUNT': '0.900', 'weapon2': '1.124', 'weapon3': '1.652', 'DAMAGECOUNT': '4.029', 'FRAGCOUNT': '12.000'} [2023-02-24 18:45:56,362][177157] DAMAGECOUNT value on done: 172704.0 [2023-02-24 18:45:56,363][177157] Sum rewards: 9.128, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.092', 'AMMO5': '0.022', 'AMMO2': '0.029', 'WEAPON1': '0.050', 'AMMO3': '0.140', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'weapon5': '0.268', 'weapon4': '0.386', 'WEAPON5': '0.400', 'ARMOR': '0.400', 'weapon2': '0.606', 'WEAPON3': '0.900', 'HITCOUNT': '0.980', 'weapon3': '1.816', 'DAMAGECOUNT': '4.125', 'FRAGCOUNT': '9.500'} [2023-02-24 18:45:56,376][177119] Fps is (10 sec: 14336.0, 60 sec: 13926.4, 300 sec: 13912.5). Total num frames: 69611520. Throughput: 0: 3474.6. Samples: 17400074. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:45:56,376][177119] Avg episode reward: [(0, '11.231')] [2023-02-24 18:45:56,660][177157] DAMAGECOUNT value on done: 179656.0 [2023-02-24 18:45:56,660][177157] Sum rewards: 10.385, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.008', 'ARMOR': '0.016', 'AMMO5': '0.017', 'AMMO2': '0.023', 'WEAPON1': '0.050', 'AMMO4': '0.112', 'AMMO3': '0.135', 'weapon5': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.550', 'weapon2': '0.610', 'weapon4': '0.666', 'HITCOUNT': '0.860', 'WEAPON3': '0.900', 'weapon3': '1.798', 'DAMAGECOUNT': '4.071', 'FRAGCOUNT': '10.000'} [2023-02-24 18:45:56,671][177157] DAMAGECOUNT value on done: 177018.0 [2023-02-24 18:45:56,672][177171] DAMAGECOUNT value on done: 175531.0 [2023-02-24 18:45:56,672][177171] Sum rewards: 12.263, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.265', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.013', 'WEAPON1': '0.030', 'weapon7': '0.050', 'AMMO3': '0.051', 'weapon5': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'HITCOUNT': '0.810', 'weapon3': '1.186', 'weapon2': '1.938', 'DAMAGECOUNT': '3.348', 'FRAGCOUNT': '7.000'} [2023-02-24 18:45:56,672][177157] Sum rewards: 11.277, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.536', 'AMMO5': '0.010', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'AMMO3': '0.040', 'weapon7': '0.054', 'AMMO4': '0.067', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.278', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.470', 'weapon3': '0.964', 'weapon2': '1.066', 'DAMAGECOUNT': '3.018', 'FRAGCOUNT': '8.000'} [2023-02-24 18:45:56,970][177171] DAMAGECOUNT value on done: 179440.0 [2023-02-24 18:45:56,971][177171] Sum rewards: 26.015, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.438', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.058', 'AMMO3': '0.110', 'weapon5': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.414', 'WEAPON3': '0.700', 'weapon2': '1.048', 'HITCOUNT': '1.760', 'weapon3': '1.834', 'DAMAGECOUNT': '7.101', 'FRAGCOUNT': '21.000'} [2023-02-24 18:45:56,981][177171] DAMAGECOUNT value on done: 184527.0 [2023-02-24 18:45:56,982][177171] Sum rewards: 8.979, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.209', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON1': '0.040', 'AMMO4': '0.054', 'AMMO3': '0.077', 'weapon5': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.306', 'ARMOR': '0.500', 'weapon2': '0.514', 'WEAPON3': '0.600', 'HITCOUNT': '0.800', 'weapon3': '1.588', 'DAMAGECOUNT': '2.727', 'FRAGCOUNT': '7.000'} [2023-02-24 18:45:57,280][177171] DAMAGECOUNT value on done: 178829.0 [2023-02-24 18:45:57,280][177171] Sum rewards: 11.006, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.110', 'AMMO3': '0.117', 'AMMO4': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.534', 'weapon2': '0.610', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'HEALTH': '0.822', 'HITCOUNT': '0.830', 'weapon3': '1.960', 'DAMAGECOUNT': '3.132', 'FRAGCOUNT': '10.000'} [2023-02-24 18:45:57,832][177153] Updated weights for policy 0, policy_version 17000 (0.0008) [2023-02-24 18:45:58,180][177155] DAMAGECOUNT value on done: 182801.0 [2023-02-24 18:45:58,180][177155] Sum rewards: 11.082, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.664', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.010', 'weapon7': '0.048', 'AMMO3': '0.059', 'WEAPON1': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.226', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.500', 'weapon3': '1.026', 'weapon2': '1.392', 'DAMAGECOUNT': '3.114', 'FRAGCOUNT': '8.000'} [2023-02-24 18:45:58,483][177155] DAMAGECOUNT value on done: 188288.0 [2023-02-24 18:45:58,483][177155] Sum rewards: 11.693, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.152', 'AMMO5': '0.011', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'AMMO4': '0.088', 'weapon4': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'weapon5': '0.168', 'WEAPON5': '0.300', 'weapon2': '0.876', 'WEAPON3': '1.050', 'HITCOUNT': '1.120', 'weapon3': '2.406', 'DAMAGECOUNT': '5.079', 'FRAGCOUNT': '11.000'} [2023-02-24 18:45:58,889][177155] DAMAGECOUNT value on done: 189324.0 [2023-02-24 18:45:58,889][177155] Sum rewards: 10.888, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.912', 'AMMO5': '0.010', 'AMMO2': '0.032', 'WEAPON1': '0.040', 'AMMO3': '0.123', 'weapon5': '0.126', 'AMMO4': '0.159', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.350', 'WEAPON3': '0.800', 'weapon2': '0.954', 'HITCOUNT': '0.980', 'weapon3': '2.138', 'DAMAGECOUNT': '3.738', 'FRAGCOUNT': '10.000'} [2023-02-24 18:45:59,187][177155] DAMAGECOUNT value on done: 179697.0 [2023-02-24 18:45:59,187][177155] Sum rewards: 8.974, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.390', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.010', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO3': '0.050', 'AMMO4': '0.051', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.218', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'weapon4': '0.396', 'HITCOUNT': '0.660', 'weapon3': '1.050', 'weapon2': '1.496', 'DAMAGECOUNT': '2.640', 'FRAGCOUNT': '6.000'} [2023-02-24 18:46:00,807][177153] Updated weights for policy 0, policy_version 17010 (0.0008) [2023-02-24 18:46:01,376][177119] Fps is (10 sec: 13926.7, 60 sec: 13858.1, 300 sec: 13898.6). Total num frames: 69677056. Throughput: 0: 3475.9. Samples: 17420898. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:46:01,376][177119] Avg episode reward: [(0, '11.358')] [2023-02-24 18:46:03,765][177153] Updated weights for policy 0, policy_version 17020 (0.0008) [2023-02-24 18:46:06,292][177156] DAMAGECOUNT value on done: 184247.0 [2023-02-24 18:46:06,293][177156] Sum rewards: 23.970, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.772', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'WEAPON1': '0.010', 'AMMO5': '0.021', 'WEAPON4': '0.100', 'AMMO3': '0.151', 'weapon4': '0.210', 'weapon5': '0.218', 'WEAPON5': '0.400', 'ARMOR': '0.451', 'weapon2': '0.500', 'WEAPON3': '1.000', 'HITCOUNT': '1.490', 'weapon3': '2.514', 'DAMAGECOUNT': '6.435', 'FRAGCOUNT': '22.000'} [2023-02-24 18:46:06,304][177156] DAMAGECOUNT value on done: 179100.0 [2023-02-24 18:46:06,305][177156] Sum rewards: 12.704, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.460', 'AMMO2': '0.011', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'AMMO4': '0.054', 'AMMO3': '0.096', 'weapon7': '0.096', 'weapon5': '0.222', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.276', 'WEAPON4': '0.300', 'WEAPON7': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.800', 'weapon2': '0.952', 'weapon3': '1.664', 'DAMAGECOUNT': '3.255', 'FRAGCOUNT': '12.000'} [2023-02-24 18:46:06,376][177119] Fps is (10 sec: 13516.9, 60 sec: 13858.2, 300 sec: 13898.6). Total num frames: 69746688. Throughput: 0: 3473.2. Samples: 17431174. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:46:06,376][177119] Avg episode reward: [(0, '11.392')] [2023-02-24 18:46:06,600][177156] DAMAGECOUNT value on done: 186159.0 [2023-02-24 18:46:06,601][177156] Sum rewards: 9.753, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.702', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.175', 'weapon5': '0.200', 'weapon4': '0.204', 'WEAPON5': '0.500', 'HITCOUNT': '0.730', 'WEAPON3': '1.150', 'weapon2': '1.192', 'weapon3': '1.928', 'DAMAGECOUNT': '3.636', 'FRAGCOUNT': '11.000'} [2023-02-24 18:46:06,612][177156] DAMAGECOUNT value on done: 181843.0 [2023-02-24 18:46:06,613][177156] Sum rewards: 10.319, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.256', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon7': '0.056', 'AMMO3': '0.087', 'AMMO4': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.180', 'weapon4': '0.286', 'WEAPON3': '0.500', 'HITCOUNT': '0.690', 'weapon3': '1.126', 'weapon2': '1.444', 'DAMAGECOUNT': '2.751', 'FRAGCOUNT': '8.000'} [2023-02-24 18:46:06,736][177153] Updated weights for policy 0, policy_version 17030 (0.0008) [2023-02-24 18:46:07,244][177172] Large shaping reward -2.534 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 18:46:08,625][177170] DAMAGECOUNT value on done: 183663.0 [2023-02-24 18:46:08,626][177170] Sum rewards: 12.054, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.173', 'AMMO2': '0.008', 'AMMO5': '0.020', 'AMMO4': '0.040', 'WEAPON1': '0.080', 'AMMO3': '0.105', 'weapon5': '0.322', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'HITCOUNT': '0.750', 'weapon2': '1.346', 'weapon3': '1.886', 'DAMAGECOUNT': '3.819', 'FRAGCOUNT': '9.500'} [2023-02-24 18:46:08,927][177170] DAMAGECOUNT value on done: 189820.0 [2023-02-24 18:46:08,928][177170] Sum rewards: 10.523, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO3': '0.081', 'AMMO4': '0.097', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.138', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HEALTH': '0.216', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'weapon4': '0.630', 'HITCOUNT': '0.850', 'weapon2': '0.910', 'weapon3': '1.540', 'DAMAGECOUNT': '3.504', 'FRAGCOUNT': '7.000'} [2023-02-24 18:46:09,211][177170] DAMAGECOUNT value on done: 180695.0 [2023-02-24 18:46:09,211][177170] Sum rewards: 10.698, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.703', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.026', 'weapon7': '0.048', 'AMMO4': '0.131', 'AMMO3': '0.150', 'weapon5': '0.166', 'WEAPON4': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.510', 'WEAPON3': '0.950', 'HITCOUNT': '1.080', 'weapon2': '1.112', 'weapon3': '1.404', 'DAMAGECOUNT': '4.302', 'FRAGCOUNT': '12.000'} [2023-02-24 18:46:09,512][177170] DAMAGECOUNT value on done: 179713.0 [2023-02-24 18:46:09,513][177170] Sum rewards: 13.017, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.190', 'AMMO2': '0.008', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO4': '0.038', 'weapon5': '0.056', 'weapon7': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.131', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.312', 'WEAPON3': '0.800', 'HITCOUNT': '0.930', 'weapon2': '1.058', 'weapon3': '1.764', 'DAMAGECOUNT': '4.122', 'FRAGCOUNT': '13.000'} [2023-02-24 18:46:09,718][177153] Updated weights for policy 0, policy_version 17040 (0.0008) [2023-02-24 18:46:10,140][177158] DAMAGECOUNT value on done: 175223.0 [2023-02-24 18:46:10,141][177158] Sum rewards: 11.292, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.386', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.032', 'weapon7': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.110', 'weapon5': '0.150', 'AMMO4': '0.159', 'WEAPON4': '0.200', 'weapon4': '0.308', 'WEAPON5': '0.400', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.840', 'weapon2': '1.052', 'weapon3': '1.660', 'DAMAGECOUNT': '3.267', 'FRAGCOUNT': '12.000'} [2023-02-24 18:46:10,446][177158] DAMAGECOUNT value on done: 178758.0 [2023-02-24 18:46:10,447][177158] Sum rewards: 8.595, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.850', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.024', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon7': '0.050', 'weapon5': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.109', 'weapon4': '0.226', 'WEAPON5': '0.300', 'HITCOUNT': '0.660', 'weapon2': '0.720', 'WEAPON3': '0.850', 'weapon3': '1.654', 'DAMAGECOUNT': '3.105', 'FRAGCOUNT': '9.000'} [2023-02-24 18:46:11,201][177158] DAMAGECOUNT value on done: 185919.0 [2023-02-24 18:46:11,202][177158] Sum rewards: 17.862, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.034', 'ARMOR': '0.008', 'AMMO2': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.042', 'AMMO3': '0.105', 'weapon5': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.474', 'WEAPON3': '0.750', 'HITCOUNT': '1.300', 'weapon2': '1.412', 'weapon3': '1.512', 'DAMAGECOUNT': '5.262', 'FRAGCOUNT': '13.000'} [2023-02-24 18:46:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13898.6). Total num frames: 69816320. Throughput: 0: 3468.4. Samples: 17451914. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:46:11,376][177119] Avg episode reward: [(0, '11.297')] [2023-02-24 18:46:11,502][177158] DAMAGECOUNT value on done: 186062.0 [2023-02-24 18:46:11,503][177158] Sum rewards: 10.927, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.264', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'weapon7': '0.060', 'AMMO3': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.144', 'WEAPON7': '0.200', 'weapon5': '0.210', 'WEAPON4': '0.300', 'weapon4': '0.352', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.890', 'weapon2': '1.408', 'weapon3': '1.452', 'DAMAGECOUNT': '3.648', 'FRAGCOUNT': '11.000'} [2023-02-24 18:46:12,656][177153] Updated weights for policy 0, policy_version 17050 (0.0008) [2023-02-24 18:46:13,151][177172] DAMAGECOUNT value on done: 186402.0 [2023-02-24 18:46:13,152][177172] Sum rewards: 8.155, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.488', 'ARMOR': '0.012', 'AMMO2': '0.016', 'AMMO5': '0.022', 'WEAPON1': '0.040', 'AMMO4': '0.082', 'weapon7': '0.098', 'weapon5': '0.118', 'weapon4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.172', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.450', 'HITCOUNT': '0.870', 'weapon2': '0.928', 'WEAPON3': '1.050', 'weapon3': '2.130', 'DAMAGECOUNT': '4.287', 'FRAGCOUNT': '9.000'} [2023-02-24 18:46:13,449][177172] DAMAGECOUNT value on done: 181393.0 [2023-02-24 18:46:13,450][177172] Sum rewards: 7.374, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.390', 'AMMO2': '0.008', 'AMMO5': '0.020', 'AMMO4': '0.039', 'WEAPON1': '0.040', 'weapon4': '0.054', 'AMMO3': '0.077', 'WEAPON4': '0.200', 'weapon5': '0.324', 'HITCOUNT': '0.520', 'WEAPON5': '0.600', 'WEAPON3': '0.600', 'weapon3': '1.536', 'weapon2': '1.686', 'DAMAGECOUNT': '2.559', 'FRAGCOUNT': '6.500'} [2023-02-24 18:46:14,751][177154] DAMAGECOUNT value on done: 187504.0 [2023-02-24 18:46:14,752][177154] Sum rewards: 7.152, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.970', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'AMMO3': '0.066', 'weapon5': '0.106', 'weapon7': '0.138', 'AMMO4': '0.162', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.430', 'WEAPON3': '0.450', 'weapon4': '0.620', 'weapon3': '0.914', 'weapon2': '1.374', 'DAMAGECOUNT': '2.064', 'FRAGCOUNT': '5.000'} [2023-02-24 18:46:15,058][177154] DAMAGECOUNT value on done: 190165.0 [2023-02-24 18:46:15,058][177154] Sum rewards: 20.157, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.312', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'weapon7': '0.056', 'AMMO4': '0.091', 'AMMO3': '0.095', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.154', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '0.650', 'weapon4': '0.722', 'weapon2': '0.838', 'HITCOUNT': '1.220', 'weapon3': '1.430', 'DAMAGECOUNT': '5.646', 'FRAGCOUNT': '16.000'} [2023-02-24 18:46:15,241][177172] DAMAGECOUNT value on done: 185004.0 [2023-02-24 18:46:15,242][177172] Sum rewards: 12.819, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.550', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.112', 'weapon5': '0.114', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.462', 'weapon2': '0.740', 'WEAPON3': '0.750', 'HITCOUNT': '1.170', 'weapon3': '2.140', 'DAMAGECOUNT': '4.611', 'FRAGCOUNT': '10.000'} [2023-02-24 18:46:15,370][177154] DAMAGECOUNT value on done: 190178.0 [2023-02-24 18:46:15,370][177154] Sum rewards: 10.404, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.322', 'AMMO2': '0.010', 'AMMO5': '0.025', 'weapon4': '0.036', 'AMMO4': '0.052', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'weapon5': '0.212', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'HITCOUNT': '1.050', 'weapon2': '1.652', 'weapon3': '1.776', 'DAMAGECOUNT': '4.083', 'FRAGCOUNT': '11.000'} [2023-02-24 18:46:15,544][177172] DAMAGECOUNT value on done: 185725.0 [2023-02-24 18:46:15,544][177172] Sum rewards: 5.906, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.176', 'AMMO2': '0.016', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'weapon7': '0.052', 'AMMO4': '0.077', 'weapon5': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'weapon4': '0.212', 'WEAPON5': '0.400', 'ARMOR': '0.432', 'HITCOUNT': '0.760', 'weapon2': '0.766', 'WEAPON3': '0.850', 'weapon3': '1.806', 'DAMAGECOUNT': '2.571', 'FRAGCOUNT': '6.000'} [2023-02-24 18:46:15,600][177153] Updated weights for policy 0, policy_version 17060 (0.0008) [2023-02-24 18:46:15,669][177154] DAMAGECOUNT value on done: 188288.0 [2023-02-24 18:46:15,669][177154] Sum rewards: 14.903, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.380', 'WEAPON1': '0.010', 'weapon7': '0.012', 'AMMO2': '0.016', 'AMMO5': '0.017', 'AMMO4': '0.082', 'weapon5': '0.142', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.308', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '1.060', 'weapon2': '1.302', 'weapon3': '1.898', 'DAMAGECOUNT': '4.188', 'FRAGCOUNT': '14.000'} [2023-02-24 18:46:15,823][177157] DAMAGECOUNT value on done: 188858.0 [2023-02-24 18:46:15,823][177157] Sum rewards: 9.333, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.780', 'AMMO5': '0.025', 'WEAPON1': '0.030', 'AMMO2': '0.053', 'AMMO3': '0.133', 'weapon5': '0.260', 'AMMO4': '0.263', 'WEAPON4': '0.450', 'weapon4': '0.508', 'WEAPON5': '0.650', 'weapon2': '0.774', 'WEAPON3': '0.850', 'HITCOUNT': '1.030', 'weapon3': '1.948', 'DAMAGECOUNT': '4.389', 'FRAGCOUNT': '9.500'} [2023-02-24 18:46:15,835][177157] DAMAGECOUNT value on done: 174341.0 [2023-02-24 18:46:15,835][177157] Sum rewards: 15.484, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.584', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.043', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'weapon5': '0.214', 'weapon4': '0.298', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.950', 'weapon2': '0.958', 'HITCOUNT': '1.150', 'weapon3': '2.234', 'DAMAGECOUNT': '4.911', 'FRAGCOUNT': '15.000'} [2023-02-24 18:46:16,126][177157] DAMAGECOUNT value on done: 181277.0 [2023-02-24 18:46:16,127][177157] Sum rewards: 9.505, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.038', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO4': '0.095', 'AMMO3': '0.157', 'weapon5': '0.208', 'weapon4': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.550', 'weapon2': '0.600', 'WEAPON3': '0.950', 'HITCOUNT': '1.220', 'weapon3': '2.524', 'DAMAGECOUNT': '4.863', 'FRAGCOUNT': '11.000'} [2023-02-24 18:46:16,137][177157] DAMAGECOUNT value on done: 178427.0 [2023-02-24 18:46:16,137][177171] DAMAGECOUNT value on done: 177142.0 [2023-02-24 18:46:16,138][177157] Sum rewards: 15.262, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.754', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO4': '0.067', 'weapon7': '0.074', 'AMMO3': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.234', 'ARMOR': '0.400', 'weapon4': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'HITCOUNT': '0.810', 'weapon2': '1.282', 'weapon3': '1.660', 'DAMAGECOUNT': '4.227', 'FRAGCOUNT': '14.000'} [2023-02-24 18:46:16,138][177171] Sum rewards: 16.928, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.660', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'AMMO3': '0.133', 'AMMO4': '0.176', 'WEAPON4': '0.200', 'weapon5': '0.214', 'weapon4': '0.266', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'weapon2': '1.020', 'HITCOUNT': '1.030', 'weapon3': '1.896', 'DAMAGECOUNT': '4.833', 'FRAGCOUNT': '16.000'} [2023-02-24 18:46:16,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13898.6). Total num frames: 69885952. Throughput: 0: 3466.3. Samples: 17472634. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:46:16,376][177119] Avg episode reward: [(0, '11.505')] [2023-02-24 18:46:16,445][177171] DAMAGECOUNT value on done: 180848.0 [2023-02-24 18:46:16,445][177171] Sum rewards: 12.582, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.806', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon7': '0.064', 'weapon4': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.127', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'weapon5': '0.204', 'WEAPON5': '0.450', 'HITCOUNT': '0.740', 'WEAPON3': '0.900', 'weapon2': '1.334', 'weapon3': '1.558', 'DAMAGECOUNT': '4.224', 'FRAGCOUNT': '13.000'} [2023-02-24 18:46:16,453][177171] DAMAGECOUNT value on done: 186048.0 [2023-02-24 18:46:16,454][177171] Sum rewards: 12.492, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.118', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.022', 'weapon7': '0.058', 'weapon4': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.134', 'WEAPON4': '0.150', 'weapon5': '0.266', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'HITCOUNT': '0.880', 'weapon2': '1.304', 'weapon3': '1.870', 'DAMAGECOUNT': '4.563', 'FRAGCOUNT': '13.000'} [2023-02-24 18:46:16,752][177171] DAMAGECOUNT value on done: 180713.0 [2023-02-24 18:46:16,753][177171] Sum rewards: 15.874, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.516', 'AMMO5': '0.022', 'AMMO2': '0.031', 'WEAPON1': '0.050', 'AMMO3': '0.142', 'AMMO4': '0.152', 'WEAPON4': '0.300', 'weapon5': '0.304', 'ARMOR': '0.400', 'weapon4': '0.460', 'WEAPON5': '0.550', 'weapon2': '0.710', 'WEAPON3': '0.900', 'HITCOUNT': '1.450', 'weapon3': '2.016', 'DAMAGECOUNT': '5.652', 'FRAGCOUNT': '14.500'} [2023-02-24 18:46:17,569][177155] DAMAGECOUNT value on done: 184336.0 [2023-02-24 18:46:17,569][177155] Sum rewards: 11.663, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.737', 'AMMO2': '0.017', 'AMMO5': '0.017', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO4': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.130', 'WEAPON7': '0.200', 'weapon5': '0.222', 'WEAPON4': '0.250', 'weapon4': '0.332', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'HITCOUNT': '0.930', 'weapon2': '1.218', 'weapon3': '1.556', 'DAMAGECOUNT': '4.605', 'FRAGCOUNT': '11.000'} [2023-02-24 18:46:17,870][177155] DAMAGECOUNT value on done: 189907.0 [2023-02-24 18:46:17,871][177155] Sum rewards: 9.471, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.031', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'AMMO5': '0.038', 'AMMO4': '0.064', 'AMMO3': '0.197', 'weapon5': '0.296', 'WEAPON4': '0.300', 'ARMOR': '0.493', 'weapon4': '0.512', 'weapon2': '0.624', 'WEAPON5': '0.800', 'HITCOUNT': '1.110', 'WEAPON3': '1.250', 'weapon3': '2.168', 'DAMAGECOUNT': '4.857', 'FRAGCOUNT': '14.000'} [2023-02-24 18:46:18,283][177155] DAMAGECOUNT value on done: 190812.0 [2023-02-24 18:46:18,284][177155] Sum rewards: 16.511, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.390', 'AMMO2': '0.014', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'weapon7': '0.060', 'AMMO4': '0.071', 'AMMO3': '0.079', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.272', 'WEAPON5': '0.350', 'weapon4': '0.362', 'ARMOR': '0.400', 'weapon2': '0.464', 'WEAPON3': '0.500', 'HITCOUNT': '0.760', 'weapon3': '1.374', 'DAMAGECOUNT': '4.464', 'FRAGCOUNT': '11.500'} [2023-02-24 18:46:18,553][177153] Updated weights for policy 0, policy_version 17070 (0.0008) [2023-02-24 18:46:18,582][177155] DAMAGECOUNT value on done: 180538.0 [2023-02-24 18:46:18,582][177155] Sum rewards: 5.131, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.240', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon7': '0.060', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.240', 'WEAPON3': '0.550', 'HITCOUNT': '0.650', 'weapon3': '0.776', 'weapon2': '1.152', 'DAMAGECOUNT': '2.523', 'FRAGCOUNT': '5.000'} [2023-02-24 18:46:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13898.6). Total num frames: 69955584. Throughput: 0: 3466.0. Samples: 17483028. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 18:46:21,376][177119] Avg episode reward: [(0, '11.727')] [2023-02-24 18:46:21,509][177153] Updated weights for policy 0, policy_version 17080 (0.0009) [2023-02-24 18:46:24,454][177153] Updated weights for policy 0, policy_version 17090 (0.0007) [2023-02-24 18:46:25,741][177156] DAMAGECOUNT value on done: 185690.0 [2023-02-24 18:46:25,741][177156] Sum rewards: 9.138, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.462', 'AMMO5': '0.017', 'AMMO2': '0.025', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.174', 'weapon5': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'ARMOR': '0.440', 'weapon4': '0.494', 'weapon2': '0.680', 'HITCOUNT': '1.060', 'WEAPON3': '1.150', 'weapon3': '2.142', 'DAMAGECOUNT': '4.329', 'FRAGCOUNT': '10.000'} [2023-02-24 18:46:25,773][177156] DAMAGECOUNT value on done: 180314.0 [2023-02-24 18:46:25,773][177156] Sum rewards: 11.105, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.362', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon7': '0.052', 'AMMO3': '0.075', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.139', 'weapon5': '0.198', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.736', 'HITCOUNT': '0.740', 'ARMOR': '0.854', 'weapon3': '1.044', 'weapon2': '1.112', 'DAMAGECOUNT': '3.639', 'FRAGCOUNT': '7.500'} [2023-02-24 18:46:26,054][177156] DAMAGECOUNT value on done: 187022.0 [2023-02-24 18:46:26,054][177156] Sum rewards: 11.865, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.010', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'AMMO3': '0.051', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.114', 'weapon5': '0.132', 'WEAPON5': '0.200', 'weapon4': '0.232', 'WEAPON3': '0.350', 'HEALTH': '0.454', 'HITCOUNT': '0.550', 'weapon3': '1.248', 'weapon2': '1.916', 'DAMAGECOUNT': '2.589', 'FRAGCOUNT': '8.000'} [2023-02-24 18:46:26,085][177156] DAMAGECOUNT value on done: 183263.0 [2023-02-24 18:46:26,086][177156] Sum rewards: 12.474, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.406', 'AMMO2': '0.006', 'AMMO5': '0.017', 'AMMO4': '0.029', 'WEAPON1': '0.050', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'weapon5': '0.186', 'weapon4': '0.364', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'HITCOUNT': '0.810', 'WEAPON3': '0.850', 'weapon2': '1.078', 'weapon3': '1.874', 'DAMAGECOUNT': '4.197', 'FRAGCOUNT': '10.000'} [2023-02-24 18:46:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13898.6). Total num frames: 70025216. Throughput: 0: 3465.3. Samples: 17503864. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 18:46:26,376][177119] Avg episode reward: [(0, '11.692')] [2023-02-24 18:46:27,444][177153] Updated weights for policy 0, policy_version 17100 (0.0009) [2023-02-24 18:46:27,980][177170] DAMAGECOUNT value on done: 184796.0 [2023-02-24 18:46:27,980][177170] Sum rewards: 8.552, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.441', 'AMMO2': '0.009', 'AMMO5': '0.015', 'AMMO4': '0.043', 'weapon5': '0.058', 'weapon7': '0.102', 'AMMO3': '0.113', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.334', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'HITCOUNT': '0.870', 'weapon2': '0.874', 'weapon3': '1.436', 'DAMAGECOUNT': '3.399', 'FRAGCOUNT': '9.000'} [2023-02-24 18:46:28,289][177170] DAMAGECOUNT value on done: 191655.0 [2023-02-24 18:46:28,291][177170] Sum rewards: 19.874, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.066', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'weapon5': '0.214', 'WEAPON5': '0.300', 'weapon4': '0.334', 'WEAPON3': '0.800', 'weapon2': '0.866', 'HITCOUNT': '1.460', 'weapon3': '2.094', 'DAMAGECOUNT': '5.505', 'FRAGCOUNT': '17.000'} [2023-02-24 18:46:28,564][177170] DAMAGECOUNT value on done: 182116.0 [2023-02-24 18:46:28,564][177170] Sum rewards: 14.932, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.018', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon7': '0.046', 'AMMO3': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.139', 'WEAPON5': '0.200', 'weapon5': '0.202', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'weapon4': '0.632', 'HITCOUNT': '0.920', 'weapon3': '1.018', 'weapon2': '1.092', 'DAMAGECOUNT': '4.263', 'FRAGCOUNT': '13.000'} [2023-02-24 18:46:28,860][177170] DAMAGECOUNT value on done: 180668.0 [2023-02-24 18:46:28,861][177170] Sum rewards: 11.169, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.274', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.074', 'weapon5': '0.108', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.228', 'WEAPON3': '0.500', 'HITCOUNT': '0.770', 'weapon3': '1.564', 'weapon2': '1.778', 'DAMAGECOUNT': '2.865', 'FRAGCOUNT': '9.000'} [2023-02-24 18:46:29,546][177158] DAMAGECOUNT value on done: 175723.0 [2023-02-24 18:46:29,547][177158] Sum rewards: 9.186, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.474', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO3': '0.041', 'weapon7': '0.048', 'ARMOR': '0.068', 'AMMO4': '0.085', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.110', 'WEAPON4': '0.150', 'weapon5': '0.150', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'HITCOUNT': '0.350', 'weapon3': '0.998', 'weapon2': '1.274', 'DAMAGECOUNT': '1.500', 'FRAGCOUNT': '7.000'} [2023-02-24 18:46:29,852][177158] DAMAGECOUNT value on done: 180520.0 [2023-02-24 18:46:29,852][177158] Sum rewards: 17.118, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.961', 'AMMO5': '0.017', 'AMMO2': '0.020', 'AMMO3': '0.093', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'weapon4': '0.222', 'weapon5': '0.286', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'weapon2': '1.194', 'HITCOUNT': '1.250', 'weapon3': '1.860', 'DAMAGECOUNT': '5.286', 'FRAGCOUNT': '14.000'} [2023-02-24 18:46:30,406][177153] Updated weights for policy 0, policy_version 17110 (0.0008) [2023-02-24 18:46:30,583][177158] DAMAGECOUNT value on done: 186801.0 [2023-02-24 18:46:30,583][177158] Sum rewards: 8.917, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.716', 'AMMO2': '0.008', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO4': '0.038', 'weapon7': '0.048', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.136', 'WEAPON7': '0.200', 'weapon4': '0.260', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.550', 'weapon2': '1.192', 'weapon3': '1.456', 'DAMAGECOUNT': '2.646', 'FRAGCOUNT': '7.000'} [2023-02-24 18:46:30,876][177158] DAMAGECOUNT value on done: 187418.0 [2023-02-24 18:46:30,877][177158] Sum rewards: 14.415, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon5': '0.074', 'AMMO3': '0.087', 'AMMO4': '0.127', 'HEALTH': '0.155', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.452', 'WEAPON3': '0.500', 'HITCOUNT': '0.930', 'weapon3': '1.334', 'weapon2': '1.504', 'DAMAGECOUNT': '3.888', 'FRAGCOUNT': '13.000'} [2023-02-24 18:46:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 70094848. Throughput: 0: 3463.7. Samples: 17524608. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:46:31,376][177119] Avg episode reward: [(0, '11.944')] [2023-02-24 18:46:32,529][177172] DAMAGECOUNT value on done: 187662.0 [2023-02-24 18:46:32,530][177172] Sum rewards: 8.338, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.040', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO4': '0.078', 'weapon4': '0.138', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'weapon5': '0.244', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'HITCOUNT': '1.160', 'weapon2': '1.346', 'weapon3': '1.982', 'DAMAGECOUNT': '3.780', 'FRAGCOUNT': '11.000'} [2023-02-24 18:46:32,825][177172] DAMAGECOUNT value on done: 183141.0 [2023-02-24 18:46:32,825][177172] Sum rewards: 18.336, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.492', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon7': '0.048', 'AMMO3': '0.076', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.156', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'ARMOR': '0.804', 'weapon4': '0.860', 'weapon2': '0.866', 'HITCOUNT': '1.250', 'weapon3': '1.378', 'DAMAGECOUNT': '5.244', 'FRAGCOUNT': '14.000'} [2023-02-24 18:46:33,350][177153] Updated weights for policy 0, policy_version 17120 (0.0008) [2023-02-24 18:46:34,150][177154] DAMAGECOUNT value on done: 188830.0 [2023-02-24 18:46:34,151][177154] Sum rewards: 13.516, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.454', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'AMMO4': '0.080', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.138', 'WEAPON4': '0.250', 'weapon4': '0.380', 'WEAPON3': '0.950', 'HITCOUNT': '1.120', 'weapon2': '1.242', 'weapon3': '1.840', 'DAMAGECOUNT': '3.978', 'FRAGCOUNT': '13.000'} [2023-02-24 18:46:34,448][177154] DAMAGECOUNT value on done: 191437.0 [2023-02-24 18:46:34,448][177154] Sum rewards: 15.305, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.713', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.010', 'AMMO3': '0.060', 'weapon7': '0.062', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.182', 'WEAPON7': '0.200', 'weapon4': '0.224', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.730', 'weapon2': '0.806', 'weapon3': '1.370', 'DAMAGECOUNT': '3.816', 'FRAGCOUNT': '12.000'} [2023-02-24 18:46:34,599][177172] DAMAGECOUNT value on done: 186531.0 [2023-02-24 18:46:34,599][177172] Sum rewards: 14.248, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.606', 'AMMO2': '0.002', 'AMMO4': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'weapon7': '0.054', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.136', 'WEAPON7': '0.200', 'weapon4': '0.222', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'HITCOUNT': '0.810', 'weapon2': '1.036', 'weapon3': '2.098', 'DAMAGECOUNT': '3.981', 'FRAGCOUNT': '11.000'} [2023-02-24 18:46:34,755][177154] DAMAGECOUNT value on done: 191577.0 [2023-02-24 18:46:34,756][177154] Sum rewards: 12.125, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'HEALTH': '0.046', 'weapon5': '0.094', 'AMMO3': '0.108', 'weapon4': '0.114', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON3': '0.650', 'HITCOUNT': '1.050', 'weapon2': '1.534', 'weapon3': '1.592', 'DAMAGECOUNT': '4.197', 'FRAGCOUNT': '9.000'} [2023-02-24 18:46:34,901][177172] DAMAGECOUNT value on done: 186802.0 [2023-02-24 18:46:34,901][177172] Sum rewards: 4.653, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.573', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'weapon4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.250', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'HITCOUNT': '0.850', 'weapon2': '1.042', 'weapon3': '1.874', 'DAMAGECOUNT': '3.231', 'FRAGCOUNT': '5.000'} [2023-02-24 18:46:35,062][177154] DAMAGECOUNT value on done: 190323.0 [2023-02-24 18:46:35,062][177154] Sum rewards: 20.309, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.760', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon4': '0.042', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'weapon5': '0.142', 'WEAPON5': '0.350', 'WEAPON3': '0.900', 'HITCOUNT': '1.320', 'weapon2': '1.602', 'weapon3': '1.884', 'DAMAGECOUNT': '6.105', 'FRAGCOUNT': '17.000'} [2023-02-24 18:46:35,187][177157] DAMAGECOUNT value on done: 190170.0 [2023-02-24 18:46:35,188][177157] Sum rewards: 14.310, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.587', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO4': '0.025', 'AMMO3': '0.095', 'WEAPON4': '0.150', 'weapon5': '0.286', 'weapon4': '0.320', 'ARMOR': '0.461', 'WEAPON3': '0.600', 'WEAPON5': '0.650', 'HITCOUNT': '0.670', 'weapon2': '1.208', 'weapon3': '1.698', 'DAMAGECOUNT': '3.936', 'FRAGCOUNT': '13.000'} [2023-02-24 18:46:35,199][177157] DAMAGECOUNT value on done: 175860.0 [2023-02-24 18:46:35,199][177157] Sum rewards: 13.821, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.482', 'weapon7': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.088', 'AMMO3': '0.090', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.170', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.284', 'WEAPON3': '0.650', 'HITCOUNT': '1.020', 'weapon3': '1.596', 'weapon2': '1.744', 'DAMAGECOUNT': '4.557', 'FRAGCOUNT': '11.000'} [2023-02-24 18:46:35,514][177157] DAMAGECOUNT value on done: 182032.0 [2023-02-24 18:46:35,514][177157] Sum rewards: 4.505, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.040', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'weapon7': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.112', 'WEAPON4': '0.150', 'weapon4': '0.442', 'HITCOUNT': '0.660', 'WEAPON3': '0.700', 'weapon2': '0.978', 'weapon3': '1.252', 'DAMAGECOUNT': '2.265', 'FRAGCOUNT': '6.000'} [2023-02-24 18:46:35,524][177157] DAMAGECOUNT value on done: 179639.0 [2023-02-24 18:46:35,525][177157] Sum rewards: 9.959, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.628', 'AMMO2': '0.013', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'AMMO4': '0.065', 'AMMO3': '0.121', 'weapon4': '0.180', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.294', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'HITCOUNT': '0.950', 'weapon2': '1.036', 'weapon3': '1.926', 'DAMAGECOUNT': '3.636', 'FRAGCOUNT': '10.000'} [2023-02-24 18:46:35,533][177171] DAMAGECOUNT value on done: 177648.0 [2023-02-24 18:46:35,533][177171] Sum rewards: 5.063, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.327', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO3': '0.054', 'weapon7': '0.110', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.350', 'WEAPON4': '0.400', 'WEAPON7': '0.400', 'HITCOUNT': '0.430', 'weapon3': '0.600', 'weapon2': '0.646', 'weapon4': '0.888', 'DAMAGECOUNT': '1.518', 'FRAGCOUNT': '5.000'} [2023-02-24 18:46:35,838][177171] DAMAGECOUNT value on done: 182741.0 [2023-02-24 18:46:35,839][177171] Sum rewards: 17.696, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.150', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.027', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.141', 'weapon5': '0.302', 'WEAPON4': '0.400', 'weapon2': '0.402', 'WEAPON5': '0.450', 'weapon4': '0.626', 'WEAPON3': '0.950', 'HITCOUNT': '1.160', 'weapon3': '1.452', 'DAMAGECOUNT': '5.679', 'FRAGCOUNT': '16.000'} [2023-02-24 18:46:35,847][177171] DAMAGECOUNT value on done: 187370.0 [2023-02-24 18:46:35,847][177171] Sum rewards: 12.354, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.696', 'AMMO2': '0.009', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'AMMO3': '0.105', 'weapon4': '0.202', 'weapon5': '0.294', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.720', 'weapon3': '1.472', 'weapon2': '1.592', 'DAMAGECOUNT': '3.966', 'FRAGCOUNT': '11.000'} [2023-02-24 18:46:36,141][177171] DAMAGECOUNT value on done: 182177.0 [2023-02-24 18:46:36,142][177171] Sum rewards: 13.362, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.762', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.047', 'weapon7': '0.050', 'weapon5': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.153', 'AMMO4': '0.235', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON4': '0.550', 'weapon4': '0.828', 'WEAPON3': '0.950', 'HITCOUNT': '1.090', 'weapon3': '1.912', 'DAMAGECOUNT': '4.392', 'FRAGCOUNT': '14.000'} [2023-02-24 18:46:36,323][177153] Updated weights for policy 0, policy_version 17130 (0.0008) [2023-02-24 18:46:36,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 70164480. Throughput: 0: 3465.7. Samples: 17535064. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:46:36,376][177119] Avg episode reward: [(0, '12.231')] [2023-02-24 18:46:37,004][177155] DAMAGECOUNT value on done: 186269.0 [2023-02-24 18:46:37,005][177155] Sum rewards: 16.168, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.660', 'AMMO5': '0.017', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.100', 'AMMO3': '0.110', 'WEAPON4': '0.200', 'weapon4': '0.246', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'weapon2': '1.206', 'HITCOUNT': '1.380', 'weapon3': '1.610', 'DAMAGECOUNT': '5.799', 'FRAGCOUNT': '14.000'} [2023-02-24 18:46:37,297][177155] DAMAGECOUNT value on done: 191163.0 [2023-02-24 18:46:37,298][177155] Sum rewards: 7.413, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.208', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'weapon7': '0.064', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.136', 'WEAPON7': '0.200', 'weapon5': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'weapon4': '0.478', 'HITCOUNT': '0.620', 'weapon2': '0.856', 'WEAPON3': '0.950', 'weapon3': '1.624', 'DAMAGECOUNT': '3.480', 'FRAGCOUNT': '9.000'} [2023-02-24 18:46:37,706][177155] DAMAGECOUNT value on done: 192127.0 [2023-02-24 18:46:37,706][177155] Sum rewards: 9.521, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.922', 'AMMO5': '0.015', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'AMMO4': '0.090', 'weapon4': '0.144', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.286', 'WEAPON5': '0.450', 'HITCOUNT': '0.900', 'WEAPON3': '0.950', 'weapon2': '1.116', 'weapon3': '1.938', 'DAMAGECOUNT': '3.945', 'FRAGCOUNT': '10.000'} [2023-02-24 18:46:38,010][177155] DAMAGECOUNT value on done: 181214.0 [2023-02-24 18:46:38,010][177155] Sum rewards: 5.650, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.819', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.012', 'AMMO3': '0.071', 'weapon7': '0.108', 'weapon5': '0.124', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.300', 'WEAPON7': '0.400', 'weapon2': '0.474', 'weapon4': '0.484', 'WEAPON3': '0.500', 'HITCOUNT': '0.560', 'weapon3': '1.240', 'DAMAGECOUNT': '2.028', 'FRAGCOUNT': '5.500'} [2023-02-24 18:46:39,257][177153] Updated weights for policy 0, policy_version 17140 (0.0008) [2023-02-24 18:46:41,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 70234112. Throughput: 0: 3461.8. Samples: 17555854. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:46:41,376][177119] Avg episode reward: [(0, '12.280')] [2023-02-24 18:46:42,227][177153] Updated weights for policy 0, policy_version 17150 (0.0009) [2023-02-24 18:46:44,507][177155] Large shaping reward 2.562 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.54, 180.0), ('weapon5', 0.002)] [2023-02-24 18:46:45,211][177153] Updated weights for policy 0, policy_version 17160 (0.0008) [2023-02-24 18:46:45,213][177156] DAMAGECOUNT value on done: 187533.0 [2023-02-24 18:46:45,214][177156] Sum rewards: 9.376, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.260', 'AMMO5': '0.014', 'AMMO2': '0.028', 'weapon7': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.142', 'AMMO3': '0.170', 'weapon5': '0.176', 'WEAPON4': '0.200', 'weapon4': '0.242', 'WEAPON5': '0.350', 'weapon2': '0.980', 'WEAPON3': '1.200', 'HITCOUNT': '1.350', 'weapon3': '2.128', 'DAMAGECOUNT': '5.529', 'FRAGCOUNT': '10.000'} [2023-02-24 18:46:45,244][177156] DAMAGECOUNT value on done: 182068.0 [2023-02-24 18:46:45,245][177156] Sum rewards: 16.699, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.446', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.030', 'AMMO4': '0.056', 'weapon7': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'weapon5': '0.192', 'WEAPON5': '0.250', 'weapon4': '0.254', 'weapon2': '0.830', 'WEAPON3': '0.900', 'HITCOUNT': '1.360', 'weapon3': '2.042', 'DAMAGECOUNT': '5.262', 'FRAGCOUNT': '15.000'} [2023-02-24 18:46:45,535][177156] DAMAGECOUNT value on done: 188212.0 [2023-02-24 18:46:45,536][177156] Sum rewards: 12.391, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.250', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.060', 'AMMO3': '0.064', 'weapon7': '0.116', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.440', 'WEAPON3': '0.500', 'HITCOUNT': '0.790', 'weapon2': '0.836', 'weapon3': '1.258', 'DAMAGECOUNT': '3.570', 'FRAGCOUNT': '9.000'} [2023-02-24 18:46:45,564][177156] DAMAGECOUNT value on done: 185023.0 [2023-02-24 18:46:45,565][177156] Sum rewards: 19.818, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.848', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon5': '0.088', 'AMMO3': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.328', 'WEAPON3': '0.800', 'weapon2': '0.904', 'HITCOUNT': '1.430', 'weapon3': '2.034', 'DAMAGECOUNT': '5.280', 'FRAGCOUNT': '16.000'} [2023-02-24 18:46:46,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 70299648. Throughput: 0: 3456.9. Samples: 17576460. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:46:46,376][177119] Avg episode reward: [(0, '12.463')] [2023-02-24 18:46:47,462][177170] DAMAGECOUNT value on done: 186544.0 [2023-02-24 18:46:47,462][177170] Sum rewards: 18.719, reward structure: {'DEATHCOUNT': '-9.000', 'weapon7': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.025', 'AMMO2': '0.045', 'AMMO3': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.200', 'AMMO4': '0.226', 'weapon5': '0.324', 'WEAPON5': '0.500', 'weapon4': '0.552', 'WEAPON3': '0.600', 'HEALTH': '0.763', 'weapon2': '0.804', 'HITCOUNT': '1.240', 'weapon3': '1.782', 'DAMAGECOUNT': '5.244', 'FRAGCOUNT': '15.000'} [2023-02-24 18:46:47,763][177170] DAMAGECOUNT value on done: 192939.0 [2023-02-24 18:46:47,763][177170] Sum rewards: 14.185, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.930', 'AMMO5': '0.017', 'AMMO2': '0.022', 'AMMO3': '0.072', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'weapon5': '0.248', 'weapon4': '0.436', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '0.970', 'weapon2': '1.264', 'weapon3': '1.672', 'DAMAGECOUNT': '3.852', 'FRAGCOUNT': '12.000'} [2023-02-24 18:46:48,043][177170] DAMAGECOUNT value on done: 184038.0 [2023-02-24 18:46:48,044][177170] Sum rewards: 14.547, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.955', 'AMMO2': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.059', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'weapon5': '0.176', 'weapon4': '0.206', 'WEAPON5': '0.450', 'weapon2': '1.134', 'WEAPON3': '1.200', 'HITCOUNT': '1.500', 'weapon3': '2.124', 'DAMAGECOUNT': '5.766', 'FRAGCOUNT': '15.000'} [2023-02-24 18:46:48,207][177153] Updated weights for policy 0, policy_version 17170 (0.0008) [2023-02-24 18:46:48,344][177170] DAMAGECOUNT value on done: 182444.0 [2023-02-24 18:46:48,344][177170] Sum rewards: 15.726, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.830', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.014', 'AMMO3': '0.115', 'WEAPON4': '0.250', 'weapon5': '0.380', 'weapon4': '0.426', 'ARMOR': '0.456', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'weapon2': '0.924', 'HITCOUNT': '1.130', 'weapon3': '1.422', 'DAMAGECOUNT': '5.328', 'FRAGCOUNT': '12.500'} [2023-02-24 18:46:48,996][177158] DAMAGECOUNT value on done: 176984.0 [2023-02-24 18:46:48,997][177158] Sum rewards: 12.508, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.284', 'AMMO5': '0.030', 'WEAPON1': '0.040', 'AMMO2': '0.052', 'AMMO3': '0.098', 'AMMO4': '0.260', 'WEAPON4': '0.300', 'weapon5': '0.300', 'weapon2': '0.340', 'WEAPON3': '0.650', 'WEAPON5': '0.650', 'weapon4': '0.680', 'HITCOUNT': '0.750', 'ARMOR': '0.800', 'weapon3': '2.058', 'DAMAGECOUNT': '3.783', 'FRAGCOUNT': '11.000'} [2023-02-24 18:46:49,301][177158] DAMAGECOUNT value on done: 181927.0 [2023-02-24 18:46:49,301][177158] Sum rewards: 15.308, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.448', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon5': '0.146', 'weapon4': '0.208', 'WEAPON5': '0.250', 'ARMOR': '0.497', 'WEAPON3': '0.750', 'HITCOUNT': '1.050', 'weapon2': '1.554', 'weapon3': '1.778', 'DAMAGECOUNT': '4.221', 'FRAGCOUNT': '14.000'} [2023-02-24 18:46:50,034][177158] DAMAGECOUNT value on done: 188228.0 [2023-02-24 18:46:50,034][177158] Sum rewards: 17.295, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.910', 'AMMO2': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'ARMOR': '0.040', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'weapon5': '0.154', 'WEAPON5': '0.200', 'weapon4': '0.286', 'WEAPON3': '0.800', 'HITCOUNT': '0.990', 'weapon2': '1.096', 'weapon3': '1.776', 'DAMAGECOUNT': '4.281', 'FRAGCOUNT': '15.000'} [2023-02-24 18:46:50,344][177158] DAMAGECOUNT value on done: 189247.0 [2023-02-24 18:46:50,344][177158] Sum rewards: 15.990, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.378', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'weapon5': '0.108', 'AMMO3': '0.114', 'AMMO4': '0.114', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.354', 'WEAPON3': '0.700', 'weapon2': '1.278', 'HITCOUNT': '1.380', 'weapon3': '1.890', 'DAMAGECOUNT': '5.487', 'FRAGCOUNT': '15.000'} [2023-02-24 18:46:51,169][177153] Updated weights for policy 0, policy_version 17180 (0.0008) [2023-02-24 18:46:51,376][177119] Fps is (10 sec: 13516.9, 60 sec: 13858.2, 300 sec: 13884.7). Total num frames: 70369280. Throughput: 0: 3459.3. Samples: 17586844. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:46:51,376][177119] Avg episode reward: [(0, '12.706')] [2023-02-24 18:46:51,975][177172] DAMAGECOUNT value on done: 189259.0 [2023-02-24 18:46:51,975][177172] Sum rewards: 16.373, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.262', 'AMMO2': '0.012', 'weapon4': '0.016', 'AMMO5': '0.028', 'WEAPON4': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.118', 'weapon5': '0.200', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'HITCOUNT': '0.860', 'weapon2': '1.132', 'weapon3': '2.318', 'DAMAGECOUNT': '4.791', 'FRAGCOUNT': '14.000'} [2023-02-24 18:46:52,276][177172] DAMAGECOUNT value on done: 184323.0 [2023-02-24 18:46:52,277][177172] Sum rewards: 5.239, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.118', 'AMMO5': '0.025', 'AMMO2': '0.039', 'AMMO3': '0.195', 'AMMO4': '0.197', 'weapon5': '0.224', 'WEAPON4': '0.350', 'ARMOR': '0.451', 'weapon4': '0.492', 'WEAPON5': '0.550', 'weapon2': '0.604', 'HITCOUNT': '0.950', 'WEAPON3': '1.250', 'weapon3': '2.234', 'DAMAGECOUNT': '3.546', 'FRAGCOUNT': '9.000'} [2023-02-24 18:46:53,654][177154] DAMAGECOUNT value on done: 189718.0 [2023-02-24 18:46:53,655][177154] Sum rewards: 0.916, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.256', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'AMMO5': '0.025', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.152', 'weapon5': '0.204', 'weapon2': '0.258', 'ARMOR': '0.434', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon4': '0.746', 'HITCOUNT': '0.770', 'WEAPON3': '0.900', 'weapon3': '2.008', 'DAMAGECOUNT': '2.664', 'FRAGCOUNT': '4.500'} [2023-02-24 18:46:53,968][177154] DAMAGECOUNT value on done: 193028.0 [2023-02-24 18:46:53,969][177154] Sum rewards: 11.055, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.090', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'AMMO2': '0.053', 'AMMO3': '0.085', 'AMMO4': '0.264', 'weapon7': '0.286', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.410', 'weapon5': '0.420', 'WEAPON4': '0.500', 'WEAPON3': '0.500', 'WEAPON5': '0.600', 'weapon2': '0.780', 'HITCOUNT': '1.150', 'weapon3': '1.630', 'DAMAGECOUNT': '4.773', 'FRAGCOUNT': '9.500'} [2023-02-24 18:46:54,075][177172] DAMAGECOUNT value on done: 187706.0 [2023-02-24 18:46:54,076][177172] Sum rewards: 9.401, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.476', 'AMMO5': '0.022', 'AMMO2': '0.048', 'AMMO3': '0.101', 'weapon5': '0.172', 'AMMO4': '0.239', 'weapon4': '0.252', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'HITCOUNT': '0.890', 'weapon2': '1.480', 'weapon3': '1.548', 'DAMAGECOUNT': '3.525', 'FRAGCOUNT': '10.000'} [2023-02-24 18:46:54,142][177153] Updated weights for policy 0, policy_version 17190 (0.0009) [2023-02-24 18:46:54,274][177154] DAMAGECOUNT value on done: 193968.0 [2023-02-24 18:46:54,274][177154] Sum rewards: 18.170, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.416', 'AMMO2': '0.005', 'AMMO5': '0.009', 'AMMO4': '0.027', 'WEAPON1': '0.040', 'weapon4': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon5': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.900', 'WEAPON3': '1.350', 'HITCOUNT': '1.710', 'weapon3': '2.484', 'DAMAGECOUNT': '7.173', 'FRAGCOUNT': '19.000'} [2023-02-24 18:46:54,366][177172] DAMAGECOUNT value on done: 188572.0 [2023-02-24 18:46:54,367][177172] Sum rewards: 18.561, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.000', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.020', 'WEAPON1': '0.050', 'AMMO3': '0.105', 'weapon5': '0.306', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'HITCOUNT': '1.000', 'weapon2': '1.290', 'weapon3': '2.090', 'DAMAGECOUNT': '5.301', 'FRAGCOUNT': '15.000'} [2023-02-24 18:46:54,575][177154] DAMAGECOUNT value on done: 192526.0 [2023-02-24 18:46:54,576][177154] Sum rewards: 18.676, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.480', 'AMMO2': '0.006', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.031', 'weapon4': '0.062', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'weapon5': '0.240', 'WEAPON5': '0.450', 'weapon2': '1.076', 'WEAPON3': '1.100', 'HITCOUNT': '1.520', 'weapon3': '2.224', 'DAMAGECOUNT': '6.609', 'FRAGCOUNT': '18.000'} [2023-02-24 18:46:54,641][177157] DAMAGECOUNT value on done: 191526.0 [2023-02-24 18:46:54,641][177157] Sum rewards: 7.977, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.352', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon4': '0.142', 'weapon5': '0.158', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.990', 'WEAPON3': '1.000', 'weapon2': '1.212', 'weapon3': '1.770', 'DAMAGECOUNT': '4.068', 'FRAGCOUNT': '9.000'} [2023-02-24 18:46:54,652][177157] DAMAGECOUNT value on done: 176581.0 [2023-02-24 18:46:54,653][177157] Sum rewards: 4.818, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.747', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon7': '0.054', 'AMMO3': '0.058', 'weapon5': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.328', 'WEAPON3': '0.400', 'weapon4': '0.538', 'HITCOUNT': '0.620', 'weapon3': '0.960', 'DAMAGECOUNT': '2.163', 'FRAGCOUNT': '4.000'} [2023-02-24 18:46:54,952][177157] DAMAGECOUNT value on done: 183737.0 [2023-02-24 18:46:54,952][177157] Sum rewards: 20.665, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.433', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO3': '0.132', 'AMMO4': '0.187', 'weapon2': '0.250', 'weapon5': '0.362', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'ARMOR': '0.456', 'weapon4': '0.716', 'WEAPON3': '0.850', 'HITCOUNT': '1.220', 'weapon3': '1.706', 'DAMAGECOUNT': '5.115', 'FRAGCOUNT': '20.000'} [2023-02-24 18:46:54,962][177157] DAMAGECOUNT value on done: 180927.0 [2023-02-24 18:46:54,963][177157] Sum rewards: 14.082, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.235', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'weapon4': '0.044', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'weapon5': '0.206', 'ARMOR': '0.436', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'HITCOUNT': '0.950', 'weapon2': '1.384', 'weapon3': '1.964', 'DAMAGECOUNT': '3.864', 'FRAGCOUNT': '12.000'} [2023-02-24 18:46:55,044][177171] DAMAGECOUNT value on done: 179936.0 [2023-02-24 18:46:55,045][177171] Sum rewards: 19.360, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.301', 'AMMO5': '0.015', 'AMMO2': '0.017', 'AMMO4': '0.086', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon4': '0.246', 'weapon5': '0.290', 'WEAPON5': '0.400', 'weapon2': '0.856', 'WEAPON3': '1.250', 'HITCOUNT': '1.710', 'weapon3': '2.292', 'DAMAGECOUNT': '6.864', 'FRAGCOUNT': '20.000'} [2023-02-24 18:46:55,340][177171] DAMAGECOUNT value on done: 184558.0 [2023-02-24 18:46:55,341][177171] Sum rewards: 12.316, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.441', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'weapon4': '0.014', 'AMMO5': '0.019', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'AMMO3': '0.167', 'weapon5': '0.304', 'WEAPON5': '0.400', 'weapon2': '0.804', 'WEAPON3': '1.000', 'HITCOUNT': '1.280', 'weapon3': '2.448', 'DAMAGECOUNT': '5.451', 'FRAGCOUNT': '12.000'} [2023-02-24 18:46:55,350][177171] DAMAGECOUNT value on done: 189190.0 [2023-02-24 18:46:55,350][177171] Sum rewards: 13.808, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.601', 'AMMO2': '0.022', 'AMMO5': '0.025', 'AMMO4': '0.112', 'AMMO3': '0.136', 'weapon5': '0.226', 'WEAPON4': '0.300', 'weapon4': '0.424', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'weapon2': '0.986', 'HITCOUNT': '1.420', 'weapon3': '1.848', 'DAMAGECOUNT': '5.460', 'FRAGCOUNT': '12.000'} [2023-02-24 18:46:55,649][177171] DAMAGECOUNT value on done: 183376.0 [2023-02-24 18:46:55,650][177171] Sum rewards: 11.541, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.480', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.023', 'weapon7': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.304', 'weapon4': '0.466', 'WEAPON3': '0.800', 'HITCOUNT': '0.830', 'weapon3': '2.006', 'DAMAGECOUNT': '3.597', 'FRAGCOUNT': '11.000'} [2023-02-24 18:46:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13789.9, 300 sec: 13884.7). Total num frames: 70438912. Throughput: 0: 3457.5. Samples: 17607500. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:46:56,376][177119] Avg episode reward: [(0, '12.597')] [2023-02-24 18:46:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000017197_70438912.pth... [2023-02-24 18:46:56,437][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000016384_67108864.pth [2023-02-24 18:46:56,460][177155] DAMAGECOUNT value on done: 186888.0 [2023-02-24 18:46:56,461][177155] Sum rewards: 3.947, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.222', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon7': '0.048', 'AMMO3': '0.085', 'AMMO4': '0.087', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.326', 'WEAPON5': '0.350', 'weapon5': '0.354', 'HITCOUNT': '0.420', 'WEAPON3': '0.550', 'weapon3': '0.928', 'weapon2': '0.996', 'DAMAGECOUNT': '1.857', 'FRAGCOUNT': '3.000'} [2023-02-24 18:46:56,766][177155] DAMAGECOUNT value on done: 192346.0 [2023-02-24 18:46:56,767][177155] Sum rewards: 6.437, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.028', 'AMMO2': '0.012', 'AMMO5': '0.025', 'WEAPON1': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.107', 'weapon5': '0.136', 'weapon4': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'HITCOUNT': '0.830', 'weapon2': '1.296', 'weapon3': '1.500', 'DAMAGECOUNT': '3.549', 'FRAGCOUNT': '8.000'} [2023-02-24 18:46:57,112][177153] Updated weights for policy 0, policy_version 17200 (0.0008) [2023-02-24 18:46:57,183][177155] DAMAGECOUNT value on done: 193467.0 [2023-02-24 18:46:57,184][177155] Sum rewards: 9.714, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.432', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO2': '0.035', 'AMMO3': '0.110', 'AMMO4': '0.175', 'weapon4': '0.288', 'weapon5': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '0.780', 'weapon2': '1.318', 'weapon3': '1.628', 'DAMAGECOUNT': '4.020', 'FRAGCOUNT': '11.000'} [2023-02-24 18:46:57,484][177155] DAMAGECOUNT value on done: 182021.0 [2023-02-24 18:46:57,485][177155] Sum rewards: 8.681, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.190', 'AMMO2': '0.011', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.055', 'AMMO3': '0.091', 'weapon5': '0.412', 'WEAPON5': '0.500', 'HITCOUNT': '0.520', 'WEAPON3': '0.650', 'weapon2': '1.576', 'weapon3': '1.594', 'DAMAGECOUNT': '2.421', 'FRAGCOUNT': '8.000'} [2023-02-24 18:47:00,069][177153] Updated weights for policy 0, policy_version 17210 (0.0009) [2023-02-24 18:47:01,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 70508544. Throughput: 0: 3458.9. Samples: 17628286. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:47:01,376][177119] Avg episode reward: [(0, '12.312')] [2023-02-24 18:47:01,449][177156] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 18:47:02,188][177154] Large shaping reward 2.544 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.522, 174.0), ('weapon5', 0.002)] [2023-02-24 18:47:03,050][177153] Updated weights for policy 0, policy_version 17220 (0.0008) [2023-02-24 18:47:04,683][177156] DAMAGECOUNT value on done: 188589.0 [2023-02-24 18:47:04,684][177156] Sum rewards: 8.163, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.510', 'AMMO2': '0.003', 'AMMO4': '0.012', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'WEAPON4': '0.050', 'AMMO3': '0.135', 'weapon4': '0.176', 'weapon5': '0.342', 'WEAPON5': '0.500', 'HITCOUNT': '0.770', 'WEAPON3': '0.800', 'weapon2': '0.858', 'weapon3': '2.068', 'DAMAGECOUNT': '3.168', 'FRAGCOUNT': '8.000'} [2023-02-24 18:47:04,740][177156] DAMAGECOUNT value on done: 183775.0 [2023-02-24 18:47:04,741][177156] Sum rewards: 16.354, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.092', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.127', 'weapon5': '0.202', 'weapon4': '0.276', 'WEAPON5': '0.300', 'HEALTH': '0.329', 'WEAPON3': '0.600', 'HITCOUNT': '0.820', 'weapon2': '1.164', 'weapon3': '1.932', 'DAMAGECOUNT': '4.797', 'FRAGCOUNT': '12.000'} [2023-02-24 18:47:04,996][177156] DAMAGECOUNT value on done: 190695.0 [2023-02-24 18:47:04,996][177156] Sum rewards: 26.901, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.995', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO4': '0.040', 'AMMO3': '0.131', 'weapon5': '0.156', 'WEAPON4': '0.250', 'weapon4': '0.290', 'WEAPON5': '0.450', 'weapon2': '0.830', 'WEAPON3': '0.950', 'HITCOUNT': '1.750', 'weapon3': '2.316', 'DAMAGECOUNT': '7.449', 'FRAGCOUNT': '24.000'} [2023-02-24 18:47:05,055][177156] DAMAGECOUNT value on done: 185738.0 [2023-02-24 18:47:05,055][177156] Sum rewards: 4.734, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.058', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'weapon7': '0.050', 'AMMO3': '0.069', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'weapon5': '0.230', 'WEAPON5': '0.300', 'HITCOUNT': '0.340', 'WEAPON3': '0.450', 'weapon4': '0.626', 'weapon2': '0.702', 'weapon3': '0.946', 'DAMAGECOUNT': '2.145', 'FRAGCOUNT': '5.000'} [2023-02-24 18:47:06,036][177153] Updated weights for policy 0, policy_version 17230 (0.0008) [2023-02-24 18:47:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 70578176. Throughput: 0: 3456.3. Samples: 17638562. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:47:06,376][177119] Avg episode reward: [(0, '12.447')] [2023-02-24 18:47:06,823][177170] DAMAGECOUNT value on done: 188156.0 [2023-02-24 18:47:06,823][177170] Sum rewards: 16.389, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.466', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO3': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.168', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.252', 'weapon5': '0.254', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'weapon2': '0.836', 'HITCOUNT': '1.150', 'weapon3': '1.588', 'DAMAGECOUNT': '4.836', 'FRAGCOUNT': '15.000'} [2023-02-24 18:47:07,120][177170] DAMAGECOUNT value on done: 193558.0 [2023-02-24 18:47:07,120][177170] Sum rewards: 7.940, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.135', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.028', 'AMMO3': '0.040', 'weapon7': '0.056', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.204', 'WEAPON3': '0.250', 'weapon5': '0.276', 'HITCOUNT': '0.440', 'weapon2': '0.644', 'weapon3': '1.066', 'DAMAGECOUNT': '1.857', 'FRAGCOUNT': '5.500'} [2023-02-24 18:47:07,395][177170] DAMAGECOUNT value on done: 185703.0 [2023-02-24 18:47:07,395][177170] Sum rewards: 17.519, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.717', 'AMMO4': '-0.048', 'AMMO2': '-0.009', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO3': '0.093', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.288', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'HITCOUNT': '0.960', 'weapon2': '1.156', 'weapon3': '2.018', 'DAMAGECOUNT': '4.995', 'FRAGCOUNT': '14.000'} [2023-02-24 18:47:07,698][177170] DAMAGECOUNT value on done: 183964.0 [2023-02-24 18:47:07,698][177170] Sum rewards: 10.455, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.684', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon5': '0.092', 'AMMO3': '0.159', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.622', 'weapon4': '0.724', 'ARMOR': '0.800', 'WEAPON3': '0.950', 'HITCOUNT': '1.260', 'weapon3': '1.940', 'DAMAGECOUNT': '4.560', 'FRAGCOUNT': '10.500'} [2023-02-24 18:47:08,534][177158] DAMAGECOUNT value on done: 178720.0 [2023-02-24 18:47:08,534][177158] Sum rewards: 17.937, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.670', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon7': '0.078', 'AMMO3': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.185', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.366', 'WEAPON4': '0.400', 'WEAPON3': '0.650', 'weapon4': '0.788', 'HITCOUNT': '1.440', 'weapon3': '1.706', 'DAMAGECOUNT': '5.208', 'FRAGCOUNT': '16.000'} [2023-02-24 18:47:08,838][177158] DAMAGECOUNT value on done: 183055.0 [2023-02-24 18:47:08,838][177158] Sum rewards: 10.471, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.750', 'AMMO2': '0.004', 'AMMO5': '0.015', 'AMMO4': '0.019', 'weapon4': '0.108', 'AMMO3': '0.115', 'WEAPON4': '0.150', 'weapon5': '0.174', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.790', 'weapon2': '1.304', 'weapon3': '1.558', 'DAMAGECOUNT': '3.384', 'FRAGCOUNT': '11.000'} [2023-02-24 18:47:09,033][177153] Updated weights for policy 0, policy_version 17240 (0.0008) [2023-02-24 18:47:09,553][177158] DAMAGECOUNT value on done: 188772.0 [2023-02-24 18:47:09,553][177158] Sum rewards: 5.910, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.439', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'weapon4': '0.118', 'WEAPON5': '0.200', 'weapon5': '0.204', 'WEAPON3': '0.400', 'HITCOUNT': '0.450', 'weapon2': '0.566', 'ARMOR': '0.977', 'weapon3': '1.106', 'DAMAGECOUNT': '1.632', 'FRAGCOUNT': '5.000'} [2023-02-24 18:47:09,860][177158] DAMAGECOUNT value on done: 191686.0 [2023-02-24 18:47:09,861][177158] Sum rewards: 27.255, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.138', 'AMMO5': '0.017', 'AMMO2': '0.025', 'AMMO3': '0.093', 'weapon5': '0.100', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.622', 'WEAPON3': '0.650', 'weapon2': '0.888', 'HITCOUNT': '1.710', 'weapon3': '1.798', 'DAMAGECOUNT': '7.317', 'FRAGCOUNT': '21.000'} [2023-02-24 18:47:10,243][177156] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:47:11,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13789.9, 300 sec: 13870.9). Total num frames: 70643712. Throughput: 0: 3449.6. Samples: 17659096. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:47:11,376][177119] Avg episode reward: [(0, '12.555')] [2023-02-24 18:47:11,465][177172] DAMAGECOUNT value on done: 190589.0 [2023-02-24 18:47:11,466][177172] Sum rewards: 10.783, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'AMMO3': '0.075', 'AMMO4': '0.161', 'HEALTH': '0.180', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon5': '0.394', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.528', 'weapon2': '1.004', 'HITCOUNT': '1.010', 'weapon3': '1.366', 'DAMAGECOUNT': '3.990', 'FRAGCOUNT': '6.500'} [2023-02-24 18:47:11,766][177172] DAMAGECOUNT value on done: 185627.0 [2023-02-24 18:47:11,766][177172] Sum rewards: 13.977, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.010', 'AMMO2': '0.036', 'HEALTH': '0.047', 'AMMO3': '0.085', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.181', 'weapon5': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon7': '0.288', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.554', 'HITCOUNT': '0.870', 'weapon2': '1.194', 'weapon3': '1.388', 'DAMAGECOUNT': '3.912', 'FRAGCOUNT': '11.000'} [2023-02-24 18:47:12,004][177153] Updated weights for policy 0, policy_version 17250 (0.0009) [2023-02-24 18:47:13,313][177154] DAMAGECOUNT value on done: 191546.0 [2023-02-24 18:47:13,314][177154] Sum rewards: 14.420, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.494', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.037', 'weapon5': '0.066', 'weapon7': '0.072', 'weapon4': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '1.000', 'weapon2': '1.006', 'HITCOUNT': '1.290', 'weapon3': '2.458', 'DAMAGECOUNT': '5.484', 'FRAGCOUNT': '14.000'} [2023-02-24 18:47:13,603][177172] DAMAGECOUNT value on done: 189227.0 [2023-02-24 18:47:13,604][177172] Sum rewards: 9.527, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.400', 'AMMO5': '0.023', 'AMMO2': '0.039', 'WEAPON4': '0.100', 'AMMO3': '0.146', 'weapon5': '0.164', 'AMMO4': '0.197', 'weapon4': '0.228', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'HITCOUNT': '0.890', 'WEAPON3': '0.900', 'weapon2': '1.582', 'weapon3': '1.694', 'DAMAGECOUNT': '4.563', 'FRAGCOUNT': '8.500'} [2023-02-24 18:47:13,617][177154] DAMAGECOUNT value on done: 194613.0 [2023-02-24 18:47:13,618][177154] Sum rewards: 14.358, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.674', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'AMMO2': '0.030', 'weapon4': '0.030', 'weapon5': '0.102', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'WEAPON5': '0.550', 'weapon2': '1.064', 'HITCOUNT': '1.130', 'WEAPON3': '1.150', 'weapon3': '2.454', 'DAMAGECOUNT': '4.755', 'FRAGCOUNT': '17.000'} [2023-02-24 18:47:13,916][177154] DAMAGECOUNT value on done: 196220.0 [2023-02-24 18:47:13,916][177154] Sum rewards: 19.330, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.984', 'AMMO2': '0.011', 'AMMO5': '0.012', 'AMMO4': '0.057', 'weapon7': '0.062', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.139', 'weapon5': '0.184', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.350', 'weapon2': '0.668', 'WEAPON3': '0.850', 'HITCOUNT': '1.470', 'weapon3': '2.314', 'DAMAGECOUNT': '6.756', 'FRAGCOUNT': '17.000'} [2023-02-24 18:47:13,918][177172] DAMAGECOUNT value on done: 189288.0 [2023-02-24 18:47:13,919][177172] Sum rewards: 10.610, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.315', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'AMMO3': '0.067', 'AMMO4': '0.089', 'weapon5': '0.092', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon4': '0.100', 'weapon7': '0.112', 'WEAPON5': '0.200', 'WEAPON3': '0.450', 'HITCOUNT': '0.460', 'weapon3': '1.266', 'weapon2': '1.816', 'DAMAGECOUNT': '2.148', 'FRAGCOUNT': '9.000'} [2023-02-24 18:47:14,159][177157] DAMAGECOUNT value on done: 194018.0 [2023-02-24 18:47:14,159][177157] Sum rewards: 25.292, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.732', 'AMMO5': '0.020', 'AMMO2': '0.062', 'AMMO3': '0.080', 'ARMOR': '0.304', 'AMMO4': '0.308', 'weapon5': '0.330', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'WEAPON4': '0.650', 'weapon4': '0.806', 'weapon2': '0.848', 'weapon3': '1.400', 'HITCOUNT': '1.790', 'DAMAGECOUNT': '7.476', 'FRAGCOUNT': '20.000'} [2023-02-24 18:47:14,214][177157] DAMAGECOUNT value on done: 178259.0 [2023-02-24 18:47:14,215][177157] Sum rewards: 11.737, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.810', 'AMMO5': '0.025', 'AMMO2': '0.044', 'weapon5': '0.160', 'AMMO3': '0.163', 'AMMO4': '0.219', 'WEAPON5': '0.450', 'weapon2': '0.568', 'WEAPON4': '0.700', 'weapon4': '0.808', 'WEAPON3': '1.000', 'HITCOUNT': '1.200', 'weapon3': '1.676', 'DAMAGECOUNT': '5.034', 'FRAGCOUNT': '16.000'} [2023-02-24 18:47:14,218][177154] DAMAGECOUNT value on done: 195010.0 [2023-02-24 18:47:14,219][177154] Sum rewards: 20.748, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.376', 'AMMO5': '0.028', 'AMMO2': '0.042', 'AMMO3': '0.133', 'AMMO4': '0.211', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon5': '0.476', 'weapon2': '0.534', 'weapon4': '0.538', 'WEAPON5': '0.700', 'WEAPON3': '0.950', 'HITCOUNT': '1.210', 'weapon3': '1.814', 'DAMAGECOUNT': '7.437', 'FRAGCOUNT': '19.500'} [2023-02-24 18:47:14,470][177157] DAMAGECOUNT value on done: 185077.0 [2023-02-24 18:47:14,470][177157] Sum rewards: 12.858, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.610', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.011', 'WEAPON1': '0.040', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.200', 'weapon5': '0.254', 'WEAPON5': '0.400', 'ARMOR': '0.436', 'WEAPON3': '0.700', 'HITCOUNT': '0.720', 'weapon3': '1.484', 'weapon2': '1.528', 'DAMAGECOUNT': '4.020', 'FRAGCOUNT': '12.000'} [2023-02-24 18:47:14,523][177157] DAMAGECOUNT value on done: 182872.0 [2023-02-24 18:47:14,523][177157] Sum rewards: 18.021, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.476', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO3': '0.118', 'weapon5': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.461', 'weapon4': '0.478', 'WEAPON3': '0.850', 'weapon2': '0.952', 'HITCOUNT': '1.270', 'weapon3': '1.952', 'DAMAGECOUNT': '5.835', 'FRAGCOUNT': '15.000'} [2023-02-24 18:47:14,554][177171] DAMAGECOUNT value on done: 181691.0 [2023-02-24 18:47:14,554][177171] Sum rewards: 14.132, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.005', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'weapon5': '0.136', 'AMMO3': '0.140', 'WEAPON5': '0.350', 'weapon2': '0.704', 'WEAPON3': '0.900', 'HITCOUNT': '1.230', 'weapon3': '2.618', 'DAMAGECOUNT': '5.265', 'FRAGCOUNT': '12.000'} [2023-02-24 18:47:14,855][177171] DAMAGECOUNT value on done: 185825.0 [2023-02-24 18:47:14,856][177171] Sum rewards: 9.572, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.210', 'AMMO2': '0.022', 'AMMO5': '0.024', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.125', 'weapon5': '0.190', 'WEAPON4': '0.250', 'weapon4': '0.432', 'WEAPON5': '0.450', 'HITCOUNT': '0.700', 'WEAPON3': '0.800', 'weapon2': '1.244', 'weapon3': '1.538', 'DAMAGECOUNT': '3.801', 'FRAGCOUNT': '9.000'} [2023-02-24 18:47:14,866][177171] DAMAGECOUNT value on done: 191082.0 [2023-02-24 18:47:14,866][177171] Sum rewards: 18.061, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.775', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'AMMO3': '0.103', 'AMMO4': '0.138', 'weapon5': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '0.700', 'weapon4': '0.786', 'weapon2': '0.822', 'HITCOUNT': '1.220', 'weapon3': '1.486', 'DAMAGECOUNT': '5.376', 'FRAGCOUNT': '18.000'} [2023-02-24 18:47:15,007][177153] Updated weights for policy 0, policy_version 17260 (0.0009) [2023-02-24 18:47:15,166][177171] DAMAGECOUNT value on done: 185743.0 [2023-02-24 18:47:15,167][177171] Sum rewards: 23.626, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.460', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'weapon7': '0.076', 'AMMO4': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.128', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.258', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.000', 'HITCOUNT': '1.510', 'weapon3': '2.406', 'DAMAGECOUNT': '7.101', 'FRAGCOUNT': '21.000'} [2023-02-24 18:47:15,979][177155] DAMAGECOUNT value on done: 188469.0 [2023-02-24 18:47:15,979][177155] Sum rewards: 5.192, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.130', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO2': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.154', 'AMMO3': '0.173', 'AMMO4': '0.250', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.710', 'weapon4': '0.720', 'HITCOUNT': '1.040', 'WEAPON3': '1.150', 'weapon3': '1.594', 'DAMAGECOUNT': '4.743', 'FRAGCOUNT': '10.000'} [2023-02-24 18:47:16,278][177155] DAMAGECOUNT value on done: 193758.0 [2023-02-24 18:47:16,279][177155] Sum rewards: 14.228, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.274', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'AMMO3': '0.100', 'AMMO4': '0.159', 'weapon5': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.518', 'weapon2': '0.644', 'WEAPON3': '0.650', 'HITCOUNT': '1.000', 'weapon3': '2.012', 'DAMAGECOUNT': '4.236', 'FRAGCOUNT': '11.000'} [2023-02-24 18:47:16,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13789.9, 300 sec: 13870.9). Total num frames: 70713344. Throughput: 0: 3448.8. Samples: 17679806. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:47:16,376][177119] Avg episode reward: [(0, '13.073')] [2023-02-24 18:47:16,673][177155] DAMAGECOUNT value on done: 195893.0 [2023-02-24 18:47:16,673][177155] Sum rewards: 21.716, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.315', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.026', 'AMMO3': '0.114', 'weapon5': '0.174', 'WEAPON4': '0.200', 'weapon4': '0.242', 'WEAPON5': '0.250', 'WEAPON3': '0.700', 'weapon2': '0.838', 'HITCOUNT': '1.570', 'weapon3': '2.124', 'DAMAGECOUNT': '7.278', 'FRAGCOUNT': '17.500'} [2023-02-24 18:47:16,980][177155] DAMAGECOUNT value on done: 183120.0 [2023-02-24 18:47:16,980][177155] Sum rewards: 10.370, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.722', 'AMMO2': '0.013', 'AMMO5': '0.015', 'AMMO4': '0.063', 'AMMO3': '0.072', 'weapon7': '0.162', 'weapon5': '0.184', 'WEAPON4': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon2': '0.618', 'weapon4': '0.654', 'HITCOUNT': '0.660', 'weapon3': '1.064', 'DAMAGECOUNT': '3.297', 'FRAGCOUNT': '8.000'} [2023-02-24 18:47:17,959][177153] Updated weights for policy 0, policy_version 17270 (0.0008) [2023-02-24 18:47:20,913][177153] Updated weights for policy 0, policy_version 17280 (0.0008) [2023-02-24 18:47:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13870.9). Total num frames: 70782976. Throughput: 0: 3447.2. Samples: 17690186. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:47:21,376][177119] Avg episode reward: [(0, '13.111')] [2023-02-24 18:47:23,882][177153] Updated weights for policy 0, policy_version 17290 (0.0008) [2023-02-24 18:47:24,243][177156] DAMAGECOUNT value on done: 189459.0 [2023-02-24 18:47:24,244][177156] Sum rewards: 10.853, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.854', 'AMMO5': '0.005', 'ARMOR': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'weapon5': '0.066', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'weapon4': '0.260', 'WEAPON4': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.720', 'weapon2': '1.234', 'weapon3': '1.312', 'DAMAGECOUNT': '2.610', 'FRAGCOUNT': '11.000'} [2023-02-24 18:47:24,289][177156] DAMAGECOUNT value on done: 185552.0 [2023-02-24 18:47:24,290][177156] Sum rewards: 15.430, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.638', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon5': '0.054', 'AMMO4': '0.079', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'weapon4': '0.214', 'WEAPON5': '0.300', 'weapon2': '0.966', 'WEAPON3': '1.100', 'HITCOUNT': '1.440', 'weapon3': '2.422', 'DAMAGECOUNT': '5.331', 'FRAGCOUNT': '16.000'} [2023-02-24 18:47:24,564][177156] DAMAGECOUNT value on done: 192806.0 [2023-02-24 18:47:24,564][177156] Sum rewards: 18.649, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.120', 'AMMO2': '0.025', 'AMMO5': '0.030', 'weapon7': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.124', 'AMMO3': '0.132', 'weapon5': '0.194', 'WEAPON7': '0.200', 'WEAPON4': '0.550', 'weapon4': '0.578', 'WEAPON5': '0.650', 'weapon2': '0.720', 'ARMOR': '0.927', 'WEAPON3': '0.950', 'HITCOUNT': '1.290', 'weapon3': '2.056', 'DAMAGECOUNT': '6.279', 'FRAGCOUNT': '18.000'} [2023-02-24 18:47:24,603][177156] DAMAGECOUNT value on done: 187295.0 [2023-02-24 18:47:24,603][177156] Sum rewards: 11.070, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.876', 'WEAPON1': '0.010', 'AMMO5': '0.024', 'AMMO2': '0.024', 'AMMO4': '0.122', 'AMMO3': '0.131', 'WEAPON4': '0.200', 'weapon4': '0.298', 'weapon5': '0.374', 'WEAPON5': '0.550', 'weapon2': '0.792', 'WEAPON3': '0.800', 'HITCOUNT': '0.890', 'weapon3': '2.060', 'DAMAGECOUNT': '4.671', 'FRAGCOUNT': '10.000'} [2023-02-24 18:47:26,216][177170] DAMAGECOUNT value on done: 189622.0 [2023-02-24 18:47:26,217][177170] Sum rewards: 14.374, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.054', 'AMMO5': '0.007', 'weapon7': '0.018', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.117', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.540', 'WEAPON3': '0.750', 'weapon2': '0.870', 'HITCOUNT': '1.060', 'weapon3': '1.678', 'DAMAGECOUNT': '4.398', 'FRAGCOUNT': '14.000'} [2023-02-24 18:47:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13870.9). Total num frames: 70852608. Throughput: 0: 3446.8. Samples: 17710958. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:47:26,377][177119] Avg episode reward: [(0, '13.295')] [2023-02-24 18:47:26,518][177170] DAMAGECOUNT value on done: 194749.0 [2023-02-24 18:47:26,519][177170] Sum rewards: 7.778, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.599', 'AMMO5': '0.015', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO4': '0.078', 'AMMO3': '0.109', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.320', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'weapon2': '0.830', 'HITCOUNT': '0.890', 'weapon3': '1.808', 'DAMAGECOUNT': '3.573', 'FRAGCOUNT': '8.000'} [2023-02-24 18:47:26,840][177170] DAMAGECOUNT value on done: 187286.0 [2023-02-24 18:47:26,841][177170] Sum rewards: 10.849, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.302', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.093', 'AMMO4': '0.115', 'weapon5': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.506', 'weapon4': '0.546', 'WEAPON3': '0.550', 'ARMOR': '0.856', 'HITCOUNT': '0.950', 'weapon3': '1.624', 'DAMAGECOUNT': '4.740', 'FRAGCOUNT': '8.000'} [2023-02-24 18:47:26,850][177153] Updated weights for policy 0, policy_version 17300 (0.0008) [2023-02-24 18:47:27,137][177170] DAMAGECOUNT value on done: 185094.0 [2023-02-24 18:47:27,138][177170] Sum rewards: 13.944, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.310', 'AMMO2': '0.003', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.016', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO3': '0.123', 'WEAPON3': '0.800', 'HITCOUNT': '0.890', 'weapon3': '1.538', 'weapon2': '2.020', 'DAMAGECOUNT': '3.390', 'FRAGCOUNT': '13.000'} [2023-02-24 18:47:27,901][177158] DAMAGECOUNT value on done: 180095.0 [2023-02-24 18:47:27,901][177158] Sum rewards: 16.151, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.468', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO3': '0.111', 'AMMO4': '0.130', 'weapon5': '0.134', 'weapon4': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.750', 'HITCOUNT': '1.050', 'weapon2': '1.612', 'weapon3': '1.676', 'DAMAGECOUNT': '4.125', 'FRAGCOUNT': '14.000'} [2023-02-24 18:47:28,210][177158] DAMAGECOUNT value on done: 184386.0 [2023-02-24 18:47:28,210][177158] Sum rewards: 13.013, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.315', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon7': '0.058', 'AMMO3': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'weapon5': '0.188', 'weapon4': '0.222', 'WEAPON5': '0.350', 'weapon2': '0.382', 'WEAPON3': '0.600', 'HITCOUNT': '0.860', 'weapon3': '1.240', 'DAMAGECOUNT': '3.993', 'FRAGCOUNT': '12.500'} [2023-02-24 18:47:28,932][177158] DAMAGECOUNT value on done: 190314.0 [2023-02-24 18:47:28,932][177158] Sum rewards: 14.530, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.643', 'AMMO2': '0.013', 'AMMO5': '0.029', 'AMMO4': '0.064', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.132', 'weapon4': '0.140', 'weapon5': '0.380', 'weapon2': '0.590', 'WEAPON5': '0.800', 'WEAPON3': '0.950', 'HITCOUNT': '1.000', 'weapon3': '2.268', 'DAMAGECOUNT': '4.626', 'FRAGCOUNT': '14.000'} [2023-02-24 18:47:29,225][177158] DAMAGECOUNT value on done: 193648.0 [2023-02-24 18:47:29,226][177158] Sum rewards: 19.107, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.790', 'AMMO2': '0.013', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.062', 'weapon4': '0.074', 'AMMO3': '0.095', 'WEAPON4': '0.200', 'weapon5': '0.258', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '1.010', 'weapon2': '1.334', 'weapon3': '1.532', 'DAMAGECOUNT': '5.886', 'FRAGCOUNT': '16.000'} [2023-02-24 18:47:29,831][177153] Updated weights for policy 0, policy_version 17310 (0.0009) [2023-02-24 18:47:31,009][177172] DAMAGECOUNT value on done: 192789.0 [2023-02-24 18:47:31,009][177172] Sum rewards: 21.500, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.330', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO5': '0.024', 'weapon5': '0.078', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon2': '0.350', 'weapon4': '0.428', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '1.650', 'weapon3': '2.780', 'DAMAGECOUNT': '6.600', 'FRAGCOUNT': '23.000'} [2023-02-24 18:47:31,310][177172] DAMAGECOUNT value on done: 187636.0 [2023-02-24 18:47:31,310][177172] Sum rewards: 19.891, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.048', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.020', 'AMMO3': '0.092', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'weapon4': '0.252', 'weapon5': '0.326', 'ARMOR': '0.404', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon2': '1.266', 'HITCOUNT': '1.400', 'weapon3': '1.872', 'DAMAGECOUNT': '6.027', 'FRAGCOUNT': '14.500'} [2023-02-24 18:47:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13870.9). Total num frames: 70922240. Throughput: 0: 3448.8. Samples: 17731658. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:47:31,376][177119] Avg episode reward: [(0, '13.500')] [2023-02-24 18:47:32,749][177154] DAMAGECOUNT value on done: 193086.0 [2023-02-24 18:47:32,750][177154] Sum rewards: 12.943, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.372', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon7': '0.068', 'AMMO3': '0.113', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'AMMO4': '0.213', 'weapon5': '0.216', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.552', 'WEAPON3': '0.750', 'HITCOUNT': '0.950', 'weapon3': '1.314', 'weapon2': '1.316', 'DAMAGECOUNT': '4.605', 'FRAGCOUNT': '15.000'} [2023-02-24 18:47:32,768][177153] Updated weights for policy 0, policy_version 17320 (0.0008) [2023-02-24 18:47:33,057][177154] DAMAGECOUNT value on done: 195941.0 [2023-02-24 18:47:33,057][177154] Sum rewards: 12.215, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.138', 'WEAPON1': '0.020', 'AMMO5': '0.030', 'AMMO2': '0.036', 'weapon7': '0.100', 'weapon5': '0.122', 'AMMO3': '0.142', 'AMMO4': '0.181', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.342', 'WEAPON5': '0.650', 'weapon2': '0.658', 'WEAPON3': '0.950', 'HITCOUNT': '0.970', 'weapon3': '1.628', 'DAMAGECOUNT': '3.984', 'FRAGCOUNT': '14.000'} [2023-02-24 18:47:33,065][177172] DAMAGECOUNT value on done: 190421.0 [2023-02-24 18:47:33,065][177172] Sum rewards: 14.495, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.745', 'AMMO2': '0.015', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'weapon4': '0.038', 'AMMO4': '0.077', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.364', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '0.700', 'weapon2': '1.490', 'weapon3': '1.686', 'DAMAGECOUNT': '3.582', 'FRAGCOUNT': '12.000'} [2023-02-24 18:47:33,355][177172] DAMAGECOUNT value on done: 191131.0 [2023-02-24 18:47:33,355][177172] Sum rewards: 18.270, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.135', 'AMMO5': '0.025', 'AMMO2': '0.034', 'WEAPON1': '0.040', 'weapon7': '0.096', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.164', 'AMMO4': '0.169', 'weapon5': '0.172', 'WEAPON4': '0.350', 'weapon2': '0.536', 'WEAPON5': '0.550', 'weapon4': '0.582', 'WEAPON3': '1.000', 'HITCOUNT': '1.350', 'weapon3': '2.258', 'DAMAGECOUNT': '5.529', 'FRAGCOUNT': '17.000'} [2023-02-24 18:47:33,362][177154] DAMAGECOUNT value on done: 198402.0 [2023-02-24 18:47:33,363][177154] Sum rewards: 17.320, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.914', 'AMMO2': '0.024', 'AMMO5': '0.033', 'WEAPON1': '0.060', 'AMMO4': '0.118', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'weapon5': '0.268', 'weapon4': '0.290', 'ARMOR': '0.400', 'WEAPON5': '0.650', 'weapon2': '0.686', 'WEAPON3': '1.000', 'HITCOUNT': '1.440', 'weapon3': '2.372', 'DAMAGECOUNT': '6.546', 'FRAGCOUNT': '14.500'} [2023-02-24 18:47:33,553][177157] DAMAGECOUNT value on done: 196241.0 [2023-02-24 18:47:33,554][177157] Sum rewards: 18.806, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.079', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'weapon7': '0.048', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.143', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.252', 'WEAPON5': '0.350', 'weapon4': '0.352', 'weapon2': '0.760', 'WEAPON3': '1.100', 'HITCOUNT': '1.610', 'weapon3': '2.174', 'DAMAGECOUNT': '6.492', 'FRAGCOUNT': '18.000'} [2023-02-24 18:47:33,652][177157] DAMAGECOUNT value on done: 180370.0 [2023-02-24 18:47:33,653][177157] Sum rewards: 17.253, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.136', 'AMMO5': '0.020', 'AMMO2': '0.022', 'WEAPON1': '0.050', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'weapon4': '0.176', 'AMMO3': '0.196', 'weapon5': '0.312', 'WEAPON5': '0.500', 'weapon2': '1.132', 'WEAPON3': '1.150', 'HITCOUNT': '1.310', 'weapon3': '1.930', 'DAMAGECOUNT': '6.333', 'FRAGCOUNT': '17.000'} [2023-02-24 18:47:33,660][177154] DAMAGECOUNT value on done: 196856.0 [2023-02-24 18:47:33,660][177154] Sum rewards: 16.002, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.830', 'AMMO5': '0.012', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'AMMO4': '0.100', 'AMMO3': '0.121', 'weapon5': '0.164', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.392', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'weapon2': '0.986', 'HITCOUNT': '1.380', 'weapon3': '1.928', 'DAMAGECOUNT': '5.538', 'FRAGCOUNT': '16.000'} [2023-02-24 18:47:33,858][177157] DAMAGECOUNT value on done: 186206.0 [2023-02-24 18:47:33,859][177157] Sum rewards: 10.603, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.880', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'weapon4': '0.070', 'AMMO3': '0.080', 'AMMO4': '0.088', 'WEAPON4': '0.200', 'weapon5': '0.208', 'WEAPON5': '0.350', 'ARMOR': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '1.010', 'weapon2': '1.676', 'weapon3': '1.806', 'DAMAGECOUNT': '3.387', 'FRAGCOUNT': '9.000'} [2023-02-24 18:47:33,948][177171] DAMAGECOUNT value on done: 183647.0 [2023-02-24 18:47:33,948][177171] Sum rewards: 16.920, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.206', 'AMMO2': '0.006', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'weapon4': '0.354', 'weapon5': '0.382', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'weapon2': '0.952', 'HITCOUNT': '1.360', 'weapon3': '1.866', 'DAMAGECOUNT': '5.868', 'FRAGCOUNT': '14.000'} [2023-02-24 18:47:33,964][177157] DAMAGECOUNT value on done: 184016.0 [2023-02-24 18:47:33,964][177157] Sum rewards: 9.845, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.138', 'AMMO5': '0.012', 'AMMO2': '0.037', 'WEAPON1': '0.060', 'AMMO3': '0.096', 'AMMO4': '0.185', 'weapon5': '0.266', 'weapon4': '0.334', 'WEAPON4': '0.350', 'ARMOR': '0.408', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'HITCOUNT': '0.800', 'weapon2': '1.156', 'weapon3': '1.446', 'DAMAGECOUNT': '3.432', 'FRAGCOUNT': '12.000'} [2023-02-24 18:47:34,249][177171] DAMAGECOUNT value on done: 186645.0 [2023-02-24 18:47:34,250][177171] Sum rewards: 2.280, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.670', 'AMMO5': '0.024', 'WEAPON1': '0.030', 'AMMO2': '0.034', 'AMMO3': '0.112', 'AMMO4': '0.169', 'weapon4': '0.192', 'WEAPON4': '0.200', 'weapon5': '0.258', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.710', 'weapon2': '1.364', 'weapon3': '1.798', 'DAMAGECOUNT': '2.460', 'FRAGCOUNT': '3.500'} [2023-02-24 18:47:34,259][177171] DAMAGECOUNT value on done: 192619.0 [2023-02-24 18:47:34,259][177171] Sum rewards: 18.982, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.690', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'AMMO3': '0.078', 'WEAPON5': '0.100', 'weapon7': '0.130', 'AMMO4': '0.137', 'weapon5': '0.150', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.550', 'weapon4': '0.674', 'weapon2': '0.932', 'HITCOUNT': '0.960', 'weapon3': '1.368', 'DAMAGECOUNT': '4.611', 'FRAGCOUNT': '15.000'} [2023-02-24 18:47:34,553][177171] DAMAGECOUNT value on done: 186578.0 [2023-02-24 18:47:34,553][177171] Sum rewards: 7.731, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.960', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.005', 'weapon7': '0.056', 'weapon5': '0.072', 'AMMO3': '0.077', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'weapon4': '0.620', 'HITCOUNT': '0.650', 'weapon3': '1.014', 'weapon2': '1.346', 'DAMAGECOUNT': '2.505', 'FRAGCOUNT': '7.500'} [2023-02-24 18:47:35,429][177155] DAMAGECOUNT value on done: 189824.0 [2023-02-24 18:47:35,430][177155] Sum rewards: 7.713, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.115', 'AMMO2': '0.003', 'AMMO5': '0.011', 'AMMO4': '0.014', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO3': '0.083', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.120', 'weapon4': '0.126', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'weapon2': '0.902', 'weapon3': '1.146', 'DAMAGECOUNT': '2.565', 'FRAGCOUNT': '7.000'} [2023-02-24 18:47:35,700][177153] Updated weights for policy 0, policy_version 17330 (0.0008) [2023-02-24 18:47:35,730][177155] DAMAGECOUNT value on done: 195425.0 [2023-02-24 18:47:35,731][177155] Sum rewards: 15.930, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.775', 'AMMO2': '0.016', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.082', 'AMMO3': '0.122', 'weapon4': '0.136', 'WEAPON4': '0.200', 'weapon5': '0.272', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon2': '1.012', 'HITCOUNT': '1.340', 'weapon3': '2.234', 'DAMAGECOUNT': '5.001', 'FRAGCOUNT': '14.000'} [2023-02-24 18:47:36,108][177155] DAMAGECOUNT value on done: 197858.0 [2023-02-24 18:47:36,108][177155] Sum rewards: 13.864, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.698', 'AMMO5': '0.019', 'WEAPON1': '0.030', 'AMMO2': '0.048', 'weapon5': '0.072', 'AMMO3': '0.211', 'AMMO4': '0.239', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.550', 'weapon2': '0.860', 'WEAPON3': '1.250', 'HITCOUNT': '1.590', 'weapon3': '2.098', 'DAMAGECOUNT': '5.895', 'FRAGCOUNT': '17.000'} [2023-02-24 18:47:36,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13870.9). Total num frames: 70991872. Throughput: 0: 3450.0. Samples: 17742096. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:47:36,376][177119] Avg episode reward: [(0, '13.733')] [2023-02-24 18:47:36,380][177140] Saving new best policy, reward=13.733! [2023-02-24 18:47:36,403][177155] DAMAGECOUNT value on done: 184551.0 [2023-02-24 18:47:36,404][177155] Sum rewards: 15.392, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.171', 'AMMO2': '0.020', 'AMMO5': '0.024', 'AMMO4': '0.097', 'AMMO3': '0.104', 'weapon5': '0.170', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'ARMOR': '0.500', 'weapon4': '0.524', 'WEAPON3': '0.750', 'HITCOUNT': '1.140', 'weapon2': '1.214', 'weapon3': '1.676', 'DAMAGECOUNT': '4.293', 'FRAGCOUNT': '16.000'} [2023-02-24 18:47:38,653][177153] Updated weights for policy 0, policy_version 17340 (0.0008) [2023-02-24 18:47:41,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13789.9, 300 sec: 13870.9). Total num frames: 71061504. Throughput: 0: 3453.7. Samples: 17762914. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:47:41,376][177119] Avg episode reward: [(0, '13.753')] [2023-02-24 18:47:41,377][177140] Saving new best policy, reward=13.753! [2023-02-24 18:47:41,624][177153] Updated weights for policy 0, policy_version 17350 (0.0008) [2023-02-24 18:47:42,564][177172] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 18:47:43,756][177156] DAMAGECOUNT value on done: 190570.0 [2023-02-24 18:47:43,757][177156] Sum rewards: 10.017, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.580', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.016', 'WEAPON1': '0.040', 'weapon7': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.206', 'weapon5': '0.246', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'HITCOUNT': '0.750', 'weapon2': '1.208', 'weapon3': '1.628', 'DAMAGECOUNT': '3.333', 'FRAGCOUNT': '9.000'} [2023-02-24 18:47:43,796][177156] DAMAGECOUNT value on done: 187535.0 [2023-02-24 18:47:43,797][177156] Sum rewards: 15.323, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.744', 'AMMO2': '0.014', 'AMMO5': '0.021', 'AMMO4': '0.072', 'AMMO3': '0.145', 'weapon5': '0.178', 'WEAPON4': '0.300', 'weapon4': '0.442', 'WEAPON5': '0.500', 'weapon2': '0.784', 'ARMOR': '0.788', 'WEAPON3': '1.000', 'HITCOUNT': '1.330', 'weapon3': '2.294', 'DAMAGECOUNT': '5.949', 'FRAGCOUNT': '13.000'} [2023-02-24 18:47:44,069][177156] DAMAGECOUNT value on done: 195769.0 [2023-02-24 18:47:44,070][177156] Sum rewards: 23.886, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.558', 'AMMO5': '0.025', 'AMMO2': '0.033', 'WEAPON1': '0.040', 'AMMO3': '0.143', 'AMMO4': '0.166', 'WEAPON4': '0.300', 'weapon5': '0.306', 'weapon4': '0.322', 'ARMOR': '0.400', 'WEAPON5': '0.600', 'weapon2': '0.732', 'WEAPON3': '1.000', 'HITCOUNT': '2.040', 'weapon3': '2.198', 'DAMAGECOUNT': '8.889', 'FRAGCOUNT': '21.000'} [2023-02-24 18:47:44,108][177156] DAMAGECOUNT value on done: 188775.0 [2023-02-24 18:47:44,108][177156] Sum rewards: 15.771, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.340', 'AMMO2': '0.007', 'AMMO5': '0.025', 'WEAPON1': '0.030', 'AMMO4': '0.033', 'WEAPON4': '0.100', 'weapon5': '0.128', 'AMMO3': '0.129', 'weapon4': '0.204', 'ARMOR': '0.451', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'HITCOUNT': '1.140', 'weapon2': '1.378', 'weapon3': '1.996', 'DAMAGECOUNT': '4.440', 'FRAGCOUNT': '13.000'} [2023-02-24 18:47:44,587][177153] Updated weights for policy 0, policy_version 17360 (0.0009) [2023-02-24 18:47:45,629][177170] DAMAGECOUNT value on done: 191971.0 [2023-02-24 18:47:45,630][177170] Sum rewards: 24.656, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.445', 'AMMO5': '0.020', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'AMMO3': '0.100', 'AMMO4': '0.108', 'weapon5': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.600', 'weapon4': '0.636', 'weapon2': '0.690', 'WEAPON3': '0.750', 'HITCOUNT': '1.290', 'weapon3': '1.898', 'DAMAGECOUNT': '7.047', 'FRAGCOUNT': '23.000'} [2023-02-24 18:47:45,931][177170] DAMAGECOUNT value on done: 195857.0 [2023-02-24 18:47:45,931][177170] Sum rewards: 7.325, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.132', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.051', 'weapon7': '0.084', 'weapon4': '0.104', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.218', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '0.790', 'weapon2': '1.440', 'weapon3': '1.810', 'DAMAGECOUNT': '3.324', 'FRAGCOUNT': '7.000'} [2023-02-24 18:47:46,250][177170] DAMAGECOUNT value on done: 188201.0 [2023-02-24 18:47:46,251][177170] Sum rewards: 7.172, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.590', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO3': '0.073', 'weapon5': '0.120', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.469', 'weapon4': '0.480', 'WEAPON3': '0.600', 'HITCOUNT': '0.660', 'weapon2': '1.230', 'weapon3': '1.548', 'DAMAGECOUNT': '2.745', 'FRAGCOUNT': '7.000'} [2023-02-24 18:47:46,376][177119] Fps is (10 sec: 13517.0, 60 sec: 13789.9, 300 sec: 13857.0). Total num frames: 71127040. Throughput: 0: 3449.1. Samples: 17783494. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:47:46,376][177119] Avg episode reward: [(0, '14.023')] [2023-02-24 18:47:46,401][177140] Saving new best policy, reward=14.023! [2023-02-24 18:47:46,567][177170] DAMAGECOUNT value on done: 187076.0 [2023-02-24 18:47:46,567][177170] Sum rewards: 21.481, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.113', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.068', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'WEAPON4': '0.300', 'WEAPON3': '0.700', 'weapon4': '0.802', 'weapon2': '0.944', 'weapon3': '1.164', 'HITCOUNT': '1.480', 'DAMAGECOUNT': '5.826', 'FRAGCOUNT': '17.000'} [2023-02-24 18:47:47,343][177158] DAMAGECOUNT value on done: 181486.0 [2023-02-24 18:47:47,343][177158] Sum rewards: 11.508, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.228', 'AMMO5': '0.015', 'AMMO2': '0.018', 'WEAPON1': '0.070', 'AMMO4': '0.089', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'weapon5': '0.202', 'WEAPON5': '0.300', 'weapon4': '0.302', 'weapon2': '0.768', 'WEAPON3': '0.950', 'HITCOUNT': '1.020', 'weapon3': '2.282', 'DAMAGECOUNT': '4.173', 'FRAGCOUNT': '12.000'} [2023-02-24 18:47:47,622][177153] Updated weights for policy 0, policy_version 17370 (0.0009) [2023-02-24 18:47:47,649][177158] DAMAGECOUNT value on done: 185039.0 [2023-02-24 18:47:47,650][177158] Sum rewards: 8.099, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.970', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'weapon7': '0.116', 'weapon4': '0.212', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.230', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.320', 'WEAPON3': '0.350', 'weapon3': '1.062', 'weapon2': '1.508', 'DAMAGECOUNT': '1.959', 'FRAGCOUNT': '5.000'} [2023-02-24 18:47:48,359][177158] DAMAGECOUNT value on done: 191860.0 [2023-02-24 18:47:48,359][177158] Sum rewards: 20.379, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.098', 'AMMO2': '0.007', 'AMMO5': '0.017', 'AMMO4': '0.032', 'WEAPON1': '0.070', 'AMMO3': '0.074', 'weapon7': '0.074', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.262', 'WEAPON7': '0.300', 'weapon4': '0.442', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon2': '0.982', 'HITCOUNT': '1.070', 'weapon3': '1.568', 'DAMAGECOUNT': '4.638', 'FRAGCOUNT': '17.000'} [2023-02-24 18:47:48,661][177158] DAMAGECOUNT value on done: 196040.0 [2023-02-24 18:47:48,661][177158] Sum rewards: 24.762, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.420', 'AMMO2': '0.011', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.053', 'weapon7': '0.078', 'AMMO3': '0.099', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.146', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.322', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'weapon2': '1.134', 'HITCOUNT': '1.500', 'weapon3': '1.888', 'DAMAGECOUNT': '7.176', 'FRAGCOUNT': '20.000'} [2023-02-24 18:47:50,451][177172] DAMAGECOUNT value on done: 193247.0 [2023-02-24 18:47:50,451][177172] Sum rewards: 4.950, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.916', 'AMMO2': '0.004', 'AMMO5': '0.013', 'AMMO4': '0.017', 'AMMO3': '0.036', 'weapon5': '0.052', 'weapon7': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'HITCOUNT': '0.380', 'weapon4': '0.450', 'weapon3': '0.584', 'weapon2': '0.676', 'DAMAGECOUNT': '1.374', 'FRAGCOUNT': '4.000'} [2023-02-24 18:47:50,572][177153] Updated weights for policy 0, policy_version 17380 (0.0008) [2023-02-24 18:47:50,758][177172] DAMAGECOUNT value on done: 189147.0 [2023-02-24 18:47:50,759][177172] Sum rewards: 10.500, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.262', 'AMMO5': '0.019', 'WEAPON1': '0.030', 'ARMOR': '0.036', 'AMMO2': '0.039', 'weapon5': '0.164', 'AMMO3': '0.165', 'AMMO4': '0.194', 'weapon4': '0.344', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.844', 'WEAPON3': '1.000', 'HITCOUNT': '1.300', 'weapon3': '2.294', 'DAMAGECOUNT': '4.533', 'FRAGCOUNT': '12.000'} [2023-02-24 18:47:51,376][177119] Fps is (10 sec: 13516.7, 60 sec: 13789.9, 300 sec: 13870.9). Total num frames: 71196672. Throughput: 0: 3448.9. Samples: 17793762. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:47:51,376][177119] Avg episode reward: [(0, '13.931')] [2023-02-24 18:47:52,230][177154] DAMAGECOUNT value on done: 194605.0 [2023-02-24 18:47:52,230][177154] Sum rewards: 11.332, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.658', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.138', 'weapon4': '0.212', 'weapon5': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'HITCOUNT': '1.120', 'weapon2': '1.324', 'weapon3': '1.940', 'DAMAGECOUNT': '4.557', 'FRAGCOUNT': '13.000'} [2023-02-24 18:47:52,540][177154] DAMAGECOUNT value on done: 197762.0 [2023-02-24 18:47:52,540][177154] Sum rewards: 15.961, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.010', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO4': '0.057', 'AMMO3': '0.186', 'weapon5': '0.224', 'WEAPON4': '0.300', 'weapon4': '0.350', 'weapon2': '0.508', 'WEAPON5': '0.650', 'WEAPON3': '1.250', 'HITCOUNT': '1.420', 'weapon3': '2.506', 'DAMAGECOUNT': '5.463', 'FRAGCOUNT': '18.000'} [2023-02-24 18:47:52,549][177172] DAMAGECOUNT value on done: 192584.0 [2023-02-24 18:47:52,550][177172] Sum rewards: 24.336, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.133', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon5': '0.038', 'AMMO4': '0.114', 'AMMO3': '0.126', 'WEAPON4': '0.250', 'weapon4': '0.298', 'WEAPON5': '0.350', 'WEAPON3': '0.900', 'weapon2': '1.408', 'HITCOUNT': '1.470', 'weapon3': '1.966', 'DAMAGECOUNT': '6.489', 'FRAGCOUNT': '22.000'} [2023-02-24 18:47:52,848][177172] DAMAGECOUNT value on done: 191828.0 [2023-02-24 18:47:52,849][177172] Sum rewards: 7.800, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.552', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.040', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.198', 'weapon4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'HITCOUNT': '0.510', 'weapon3': '1.002', 'weapon2': '1.962', 'DAMAGECOUNT': '2.091', 'FRAGCOUNT': '5.000'} [2023-02-24 18:47:52,850][177154] DAMAGECOUNT value on done: 200249.0 [2023-02-24 18:47:52,850][177154] Sum rewards: 14.615, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.778', 'AMMO5': '0.023', 'AMMO2': '0.032', 'weapon5': '0.072', 'AMMO3': '0.144', 'AMMO4': '0.158', 'ARMOR': '0.453', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.594', 'weapon2': '0.676', 'WEAPON3': '0.900', 'HITCOUNT': '1.380', 'weapon3': '2.120', 'DAMAGECOUNT': '5.541', 'FRAGCOUNT': '16.000'} [2023-02-24 18:47:53,008][177157] DAMAGECOUNT value on done: 197221.0 [2023-02-24 18:47:53,009][177157] Sum rewards: 11.818, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.036', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO3': '0.062', 'weapon5': '0.066', 'AMMO4': '0.103', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'weapon4': '0.480', 'WEAPON3': '0.500', 'HITCOUNT': '0.760', 'weapon2': '0.792', 'weapon3': '1.322', 'DAMAGECOUNT': '2.940', 'FRAGCOUNT': '11.000'} [2023-02-24 18:47:53,100][177157] DAMAGECOUNT value on done: 182286.0 [2023-02-24 18:47:53,101][177157] Sum rewards: 22.022, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.206', 'AMMO5': '0.020', 'AMMO2': '0.027', 'WEAPON1': '0.040', 'weapon4': '0.090', 'AMMO3': '0.116', 'AMMO4': '0.133', 'WEAPON4': '0.150', 'weapon5': '0.318', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon2': '1.094', 'HITCOUNT': '1.330', 'weapon3': '2.112', 'DAMAGECOUNT': '5.748', 'FRAGCOUNT': '18.000'} [2023-02-24 18:47:53,150][177154] DAMAGECOUNT value on done: 198229.0 [2023-02-24 18:47:53,150][177154] Sum rewards: 12.516, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.004', 'AMMO2': '0.013', 'AMMO5': '0.014', 'ARMOR': '0.024', 'WEAPON1': '0.030', 'AMMO4': '0.064', 'AMMO3': '0.080', 'weapon7': '0.136', 'weapon5': '0.206', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.610', 'HITCOUNT': '0.770', 'weapon2': '0.930', 'weapon3': '1.334', 'DAMAGECOUNT': '4.119', 'FRAGCOUNT': '11.500'} [2023-02-24 18:47:53,321][177157] DAMAGECOUNT value on done: 186946.0 [2023-02-24 18:47:53,322][177157] Sum rewards: 11.625, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.120', 'AMMO2': '0.010', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.048', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.160', 'weapon5': '0.308', 'WEAPON3': '0.350', 'WEAPON5': '0.400', 'HITCOUNT': '0.440', 'weapon3': '1.046', 'weapon2': '2.048', 'DAMAGECOUNT': '2.220', 'FRAGCOUNT': '9.000'} [2023-02-24 18:47:53,417][177157] DAMAGECOUNT value on done: 185482.0 [2023-02-24 18:47:53,418][177157] Sum rewards: 13.541, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.032', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.040', 'weapon7': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.121', 'weapon5': '0.184', 'AMMO4': '0.199', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.408', 'WEAPON3': '0.800', 'weapon4': '0.964', 'HITCOUNT': '1.090', 'weapon3': '1.678', 'DAMAGECOUNT': '4.398', 'FRAGCOUNT': '14.000'} [2023-02-24 18:47:53,491][177171] DAMAGECOUNT value on done: 185831.0 [2023-02-24 18:47:53,491][177171] Sum rewards: 24.026, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.119', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'weapon4': '0.240', 'weapon5': '0.244', 'WEAPON5': '0.450', 'weapon2': '0.790', 'WEAPON3': '0.850', 'HITCOUNT': '1.410', 'weapon3': '1.802', 'DAMAGECOUNT': '6.552', 'FRAGCOUNT': '20.000'} [2023-02-24 18:47:53,521][177153] Updated weights for policy 0, policy_version 17390 (0.0008) [2023-02-24 18:47:53,781][177171] DAMAGECOUNT value on done: 188672.0 [2023-02-24 18:47:53,782][177171] Sum rewards: 22.070, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.007', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'weapon7': '0.056', 'weapon5': '0.058', 'AMMO3': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.143', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.602', 'weapon4': '0.638', 'WEAPON3': '0.750', 'HITCOUNT': '1.550', 'weapon3': '1.968', 'DAMAGECOUNT': '6.081', 'FRAGCOUNT': '19.000'} [2023-02-24 18:47:53,789][177171] DAMAGECOUNT value on done: 194146.0 [2023-02-24 18:47:53,790][177171] Sum rewards: 15.855, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.920', 'AMMO5': '0.024', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.072', 'AMMO4': '0.122', 'AMMO3': '0.141', 'weapon5': '0.194', 'WEAPON5': '0.550', 'weapon2': '0.866', 'WEAPON3': '0.900', 'HITCOUNT': '1.100', 'weapon3': '2.360', 'DAMAGECOUNT': '4.581', 'FRAGCOUNT': '14.000'} [2023-02-24 18:47:54,080][177171] DAMAGECOUNT value on done: 188447.0 [2023-02-24 18:47:54,081][177171] Sum rewards: 17.516, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.939', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'AMMO5': '0.022', 'AMMO4': '0.099', 'AMMO3': '0.110', 'weapon5': '0.254', 'WEAPON4': '0.350', 'ARMOR': '0.463', 'WEAPON5': '0.600', 'WEAPON3': '0.650', 'weapon4': '0.658', 'weapon2': '0.830', 'HITCOUNT': '1.180', 'weapon3': '1.602', 'DAMAGECOUNT': '5.607', 'FRAGCOUNT': '15.000'} [2023-02-24 18:47:54,921][177155] DAMAGECOUNT value on done: 191562.0 [2023-02-24 18:47:54,922][177155] Sum rewards: 19.010, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.926', 'AMMO2': '0.009', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'AMMO4': '0.045', 'weapon4': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon5': '0.354', 'ARMOR': '0.457', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'HITCOUNT': '1.050', 'weapon2': '1.438', 'weapon3': '1.814', 'DAMAGECOUNT': '5.004', 'FRAGCOUNT': '15.000'} [2023-02-24 18:47:55,220][177155] DAMAGECOUNT value on done: 197722.0 [2023-02-24 18:47:55,221][177155] Sum rewards: 20.920, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.804', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'WEAPON4': '0.100', 'AMMO4': '0.100', 'AMMO3': '0.104', 'weapon5': '0.248', 'weapon4': '0.248', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'weapon2': '1.228', 'HITCOUNT': '1.390', 'weapon3': '1.860', 'DAMAGECOUNT': '6.891', 'FRAGCOUNT': '18.000'} [2023-02-24 18:47:55,628][177155] DAMAGECOUNT value on done: 199871.0 [2023-02-24 18:47:55,629][177155] Sum rewards: 17.996, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.965', 'weapon5': '0.002', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.041', 'AMMO3': '0.119', 'WEAPON5': '0.150', 'AMMO4': '0.204', 'WEAPON4': '0.500', 'WEAPON3': '0.850', 'weapon4': '0.914', 'weapon2': '0.930', 'HITCOUNT': '1.700', 'weapon3': '1.732', 'DAMAGECOUNT': '6.039', 'FRAGCOUNT': '18.000'} [2023-02-24 18:47:55,930][177155] DAMAGECOUNT value on done: 186166.0 [2023-02-24 18:47:55,930][177155] Sum rewards: 16.666, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.452', 'AMMO5': '0.013', 'AMMO2': '0.028', 'AMMO3': '0.061', 'weapon7': '0.062', 'weapon4': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.139', 'WEAPON4': '0.200', 'weapon5': '0.242', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.840', 'weapon2': '0.998', 'weapon3': '1.442', 'DAMAGECOUNT': '4.845', 'FRAGCOUNT': '13.000'} [2023-02-24 18:47:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13789.9, 300 sec: 13870.9). Total num frames: 71266304. Throughput: 0: 3453.2. Samples: 17814488. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:47:56,376][177119] Avg episode reward: [(0, '14.565')] [2023-02-24 18:47:56,379][177140] Saving new best policy, reward=14.565! [2023-02-24 18:47:56,496][177153] Updated weights for policy 0, policy_version 17400 (0.0008) [2023-02-24 18:47:59,450][177153] Updated weights for policy 0, policy_version 17410 (0.0008) [2023-02-24 18:48:01,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13789.9, 300 sec: 13870.9). Total num frames: 71335936. Throughput: 0: 3452.1. Samples: 17835152. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:48:01,376][177119] Avg episode reward: [(0, '14.565')] [2023-02-24 18:48:02,420][177153] Updated weights for policy 0, policy_version 17420 (0.0008) [2023-02-24 18:48:03,317][177156] DAMAGECOUNT value on done: 193155.0 [2023-02-24 18:48:03,317][177156] Sum rewards: 22.957, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.220', 'AMMO5': '0.027', 'AMMO2': '0.030', 'WEAPON1': '0.040', 'AMMO3': '0.131', 'AMMO4': '0.151', 'weapon5': '0.294', 'WEAPON4': '0.450', 'weapon4': '0.480', 'WEAPON5': '0.700', 'weapon2': '0.728', 'WEAPON3': '1.000', 'HITCOUNT': '1.810', 'weapon3': '2.080', 'DAMAGECOUNT': '7.755', 'FRAGCOUNT': '22.500'} [2023-02-24 18:48:03,358][177156] DAMAGECOUNT value on done: 188729.0 [2023-02-24 18:48:03,358][177156] Sum rewards: 10.966, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.636', 'AMMO5': '0.017', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'weapon7': '0.062', 'AMMO4': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.117', 'weapon5': '0.132', 'WEAPON4': '0.150', 'weapon4': '0.230', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'HITCOUNT': '0.860', 'weapon2': '1.298', 'weapon3': '1.864', 'DAMAGECOUNT': '3.582', 'FRAGCOUNT': '10.000'} [2023-02-24 18:48:03,631][177156] DAMAGECOUNT value on done: 197109.0 [2023-02-24 18:48:03,631][177156] Sum rewards: 16.943, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.723', 'AMMO2': '0.012', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.058', 'AMMO3': '0.076', 'WEAPON4': '0.150', 'weapon5': '0.274', 'weapon4': '0.386', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.870', 'weapon2': '1.188', 'weapon3': '1.542', 'DAMAGECOUNT': '4.020', 'FRAGCOUNT': '14.000'} [2023-02-24 18:48:03,668][177156] DAMAGECOUNT value on done: 190003.0 [2023-02-24 18:48:03,668][177156] Sum rewards: 12.938, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.611', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO5': '0.025', 'AMMO3': '0.111', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'weapon4': '0.220', 'weapon5': '0.300', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'HITCOUNT': '0.800', 'weapon2': '1.046', 'weapon3': '1.648', 'DAMAGECOUNT': '3.684', 'FRAGCOUNT': '13.000'} [2023-02-24 18:48:05,117][177170] DAMAGECOUNT value on done: 193823.0 [2023-02-24 18:48:05,117][177170] Sum rewards: 15.506, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.159', 'AMMO5': '0.014', 'AMMO2': '0.015', 'WEAPON1': '0.060', 'AMMO4': '0.077', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'weapon5': '0.236', 'weapon4': '0.260', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.630', 'WEAPON3': '1.000', 'HITCOUNT': '1.340', 'weapon3': '2.128', 'DAMAGECOUNT': '5.556', 'FRAGCOUNT': '15.000'} [2023-02-24 18:48:05,381][177153] Updated weights for policy 0, policy_version 17430 (0.0008) [2023-02-24 18:48:05,411][177170] DAMAGECOUNT value on done: 198057.0 [2023-02-24 18:48:05,412][177170] Sum rewards: 25.302, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.008', 'AMMO5': '0.020', 'AMMO4': '0.042', 'WEAPON1': '0.050', 'AMMO3': '0.132', 'HEALTH': '0.153', 'weapon5': '0.168', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'weapon2': '1.480', 'HITCOUNT': '1.620', 'weapon3': '2.078', 'DAMAGECOUNT': '6.600', 'FRAGCOUNT': '20.000'} [2023-02-24 18:48:05,740][177170] DAMAGECOUNT value on done: 190504.0 [2023-02-24 18:48:05,740][177170] Sum rewards: 23.321, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.178', 'AMMO5': '0.010', 'AMMO2': '0.020', 'WEAPON1': '0.060', 'weapon5': '0.066', 'AMMO4': '0.100', 'AMMO3': '0.141', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'weapon4': '0.432', 'WEAPON3': '0.900', 'weapon2': '1.042', 'HITCOUNT': '1.600', 'weapon3': '1.818', 'DAMAGECOUNT': '6.909', 'FRAGCOUNT': '21.000'} [2023-02-24 18:48:06,051][177170] DAMAGECOUNT value on done: 188187.0 [2023-02-24 18:48:06,052][177170] Sum rewards: 7.868, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.552', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO3': '0.090', 'AMMO4': '0.127', 'weapon5': '0.190', 'WEAPON5': '0.400', 'ARMOR': '0.500', 'WEAPON4': '0.500', 'weapon4': '0.670', 'WEAPON3': '0.700', 'HITCOUNT': '0.820', 'weapon2': '1.174', 'weapon3': '1.376', 'DAMAGECOUNT': '3.333', 'FRAGCOUNT': '11.000'} [2023-02-24 18:48:06,376][177119] Fps is (10 sec: 13926.2, 60 sec: 13789.8, 300 sec: 13870.9). Total num frames: 71405568. Throughput: 0: 3450.3. Samples: 17845448. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:48:06,376][177119] Avg episode reward: [(0, '15.074')] [2023-02-24 18:48:06,380][177140] Saving new best policy, reward=15.074! [2023-02-24 18:48:06,808][177158] DAMAGECOUNT value on done: 183905.0 [2023-02-24 18:48:06,809][177158] Sum rewards: 22.150, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.880', 'AMMO2': '0.016', 'AMMO5': '0.035', 'WEAPON1': '0.060', 'AMMO4': '0.080', 'AMMO3': '0.135', 'weapon5': '0.192', 'WEAPON4': '0.300', 'weapon4': '0.338', 'WEAPON5': '0.700', 'WEAPON3': '0.950', 'weapon2': '1.096', 'HITCOUNT': '1.420', 'weapon3': '1.956', 'DAMAGECOUNT': '7.251', 'FRAGCOUNT': '21.000'} [2023-02-24 18:48:07,114][177158] DAMAGECOUNT value on done: 186187.0 [2023-02-24 18:48:07,115][177158] Sum rewards: 12.571, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.661', 'AMMO5': '0.019', 'AMMO2': '0.026', 'WEAPON1': '0.040', 'AMMO3': '0.067', 'AMMO4': '0.127', 'weapon5': '0.210', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'WEAPON5': '0.450', 'ARMOR': '0.454', 'weapon4': '0.502', 'HITCOUNT': '0.870', 'weapon3': '1.168', 'weapon2': '1.654', 'DAMAGECOUNT': '3.444', 'FRAGCOUNT': '11.000'} [2023-02-24 18:48:07,862][177158] DAMAGECOUNT value on done: 193311.0 [2023-02-24 18:48:07,863][177158] Sum rewards: 10.415, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.206', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'weapon5': '0.016', 'AMMO4': '0.066', 'AMMO3': '0.107', 'WEAPON5': '0.150', 'weapon7': '0.248', 'weapon2': '0.302', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON4': '0.350', 'WEAPON7': '0.500', 'WEAPON3': '0.650', 'weapon4': '0.746', 'HITCOUNT': '1.010', 'weapon3': '1.412', 'DAMAGECOUNT': '4.353', 'FRAGCOUNT': '10.000'} [2023-02-24 18:48:08,168][177158] DAMAGECOUNT value on done: 197750.0 [2023-02-24 18:48:08,168][177158] Sum rewards: 15.793, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.238', 'AMMO5': '0.017', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.098', 'AMMO3': '0.118', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.448', 'WEAPON3': '0.850', 'weapon2': '1.006', 'HITCOUNT': '1.200', 'weapon3': '2.098', 'DAMAGECOUNT': '5.130', 'FRAGCOUNT': '15.000'} [2023-02-24 18:48:08,378][177153] Updated weights for policy 0, policy_version 17440 (0.0008) [2023-02-24 18:48:09,966][177172] DAMAGECOUNT value on done: 194652.0 [2023-02-24 18:48:09,967][177172] Sum rewards: 16.453, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.274', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon4': '0.026', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.130', 'weapon5': '0.140', 'WEAPON5': '0.200', 'WEAPON3': '0.800', 'HITCOUNT': '0.940', 'weapon2': '1.154', 'weapon3': '1.958', 'DAMAGECOUNT': '4.215', 'FRAGCOUNT': '16.000'} [2023-02-24 18:48:10,275][177172] DAMAGECOUNT value on done: 190525.0 [2023-02-24 18:48:10,276][177172] Sum rewards: 10.393, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.440', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO3': '0.128', 'weapon5': '0.142', 'WEAPON5': '0.450', 'ARMOR': '0.500', 'WEAPON3': '0.850', 'HITCOUNT': '1.060', 'weapon2': '1.324', 'weapon3': '2.214', 'DAMAGECOUNT': '4.134', 'FRAGCOUNT': '9.000'} [2023-02-24 18:48:11,354][177153] Updated weights for policy 0, policy_version 17450 (0.0008) [2023-02-24 18:48:11,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 71475200. Throughput: 0: 3447.5. Samples: 17866096. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:48:11,376][177119] Avg episode reward: [(0, '15.145')] [2023-02-24 18:48:11,377][177140] Saving new best policy, reward=15.145! [2023-02-24 18:48:11,862][177154] DAMAGECOUNT value on done: 196103.0 [2023-02-24 18:48:11,862][177154] Sum rewards: 15.232, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.100', 'AMMO2': '0.006', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'weapon5': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.164', 'weapon4': '0.198', 'WEAPON5': '0.300', 'weapon2': '0.788', 'WEAPON3': '0.950', 'HITCOUNT': '1.070', 'weapon3': '2.622', 'DAMAGECOUNT': '4.494', 'FRAGCOUNT': '15.000'} [2023-02-24 18:48:12,089][177172] DAMAGECOUNT value on done: 193657.0 [2023-02-24 18:48:12,089][177172] Sum rewards: 8.545, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.076', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'WEAPON4': '0.050', 'weapon7': '0.058', 'AMMO3': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.115', 'weapon5': '0.150', 'weapon4': '0.204', 'WEAPON5': '0.400', 'HITCOUNT': '0.630', 'WEAPON3': '0.650', 'weapon3': '1.142', 'weapon2': '1.546', 'DAMAGECOUNT': '3.219', 'FRAGCOUNT': '7.000'} [2023-02-24 18:48:12,165][177154] DAMAGECOUNT value on done: 198896.0 [2023-02-24 18:48:12,166][177154] Sum rewards: 8.660, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.080', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO5': '0.020', 'weapon7': '0.048', 'AMMO3': '0.091', 'AMMO4': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.142', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'weapon4': '0.406', 'WEAPON3': '0.650', 'HITCOUNT': '1.030', 'weapon2': '1.192', 'weapon3': '1.596', 'DAMAGECOUNT': '3.402', 'FRAGCOUNT': '9.000'} [2023-02-24 18:48:12,386][177172] DAMAGECOUNT value on done: 193557.0 [2023-02-24 18:48:12,387][177172] Sum rewards: 15.215, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.495', 'AMMO2': '0.008', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'AMMO4': '0.037', 'AMMO3': '0.080', 'weapon5': '0.262', 'WEAPON4': '0.300', 'ARMOR': '0.451', 'weapon4': '0.508', 'WEAPON3': '0.600', 'WEAPON5': '0.600', 'HITCOUNT': '0.980', 'weapon2': '1.184', 'weapon3': '1.490', 'DAMAGECOUNT': '5.157', 'FRAGCOUNT': '11.000'} [2023-02-24 18:48:12,474][177154] DAMAGECOUNT value on done: 202398.0 [2023-02-24 18:48:12,475][177154] Sum rewards: 19.013, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.840', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.074', 'AMMO3': '0.180', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.334', 'weapon2': '0.640', 'WEAPON3': '1.200', 'HITCOUNT': '1.870', 'weapon3': '2.452', 'DAMAGECOUNT': '6.447', 'FRAGCOUNT': '20.000'} [2023-02-24 18:48:12,516][177157] DAMAGECOUNT value on done: 198016.0 [2023-02-24 18:48:12,517][177157] Sum rewards: 5.771, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.945', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'weapon7': '0.048', 'AMMO3': '0.055', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.158', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.358', 'WEAPON3': '0.400', 'ARMOR': '0.466', 'HITCOUNT': '0.610', 'weapon2': '0.880', 'weapon3': '0.978', 'DAMAGECOUNT': '2.385', 'FRAGCOUNT': '4.000'} [2023-02-24 18:48:12,623][177157] DAMAGECOUNT value on done: 183784.0 [2023-02-24 18:48:12,624][177157] Sum rewards: 13.520, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.102', 'AMMO5': '0.014', 'AMMO2': '0.022', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.090', 'AMMO4': '0.111', 'weapon4': '0.198', 'weapon5': '0.202', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '1.030', 'weapon2': '1.272', 'weapon3': '1.888', 'DAMAGECOUNT': '4.494', 'FRAGCOUNT': '10.000'} [2023-02-24 18:48:12,773][177154] DAMAGECOUNT value on done: 199843.0 [2023-02-24 18:48:12,774][177154] Sum rewards: 11.168, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.182', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.023', 'weapon5': '0.102', 'AMMO4': '0.114', 'AMMO3': '0.153', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'ARMOR': '0.500', 'weapon4': '0.600', 'weapon2': '0.830', 'WEAPON3': '0.900', 'HITCOUNT': '1.250', 'weapon3': '2.044', 'DAMAGECOUNT': '4.842', 'FRAGCOUNT': '10.500'} [2023-02-24 18:48:12,841][177157] DAMAGECOUNT value on done: 188698.0 [2023-02-24 18:48:12,841][177157] Sum rewards: 15.315, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.864', 'AMMO2': '0.012', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.057', 'AMMO3': '0.094', 'weapon4': '0.140', 'WEAPON4': '0.150', 'weapon5': '0.392', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'weapon2': '0.964', 'HITCOUNT': '1.210', 'weapon3': '1.914', 'DAMAGECOUNT': '5.256', 'FRAGCOUNT': '13.000'} [2023-02-24 18:48:12,930][177157] DAMAGECOUNT value on done: 187216.0 [2023-02-24 18:48:12,931][177157] Sum rewards: 11.446, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.295', 'WEAPON1': '0.010', 'AMMO5': '0.025', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.137', 'weapon5': '0.228', 'WEAPON4': '0.300', 'weapon4': '0.424', 'ARMOR': '0.454', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'weapon2': '0.994', 'HITCOUNT': '1.060', 'weapon3': '1.968', 'DAMAGECOUNT': '5.184', 'FRAGCOUNT': '10.000'} [2023-02-24 18:48:13,000][177171] DAMAGECOUNT value on done: 187843.0 [2023-02-24 18:48:13,001][177171] Sum rewards: 18.312, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.300', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO3': '0.126', 'weapon5': '0.158', 'AMMO4': '0.172', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.620', 'WEAPON3': '0.900', 'weapon2': '1.082', 'HITCOUNT': '1.500', 'weapon3': '1.866', 'DAMAGECOUNT': '6.036', 'FRAGCOUNT': '20.000'} [2023-02-24 18:48:13,299][177171] DAMAGECOUNT value on done: 190021.0 [2023-02-24 18:48:13,299][177171] Sum rewards: 17.949, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.006', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.052', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.180', 'weapon4': '0.202', 'WEAPON3': '0.450', 'HITCOUNT': '0.880', 'weapon3': '1.508', 'weapon2': '1.528', 'DAMAGECOUNT': '4.047', 'FRAGCOUNT': '14.000'} [2023-02-24 18:48:13,309][177171] DAMAGECOUNT value on done: 195725.0 [2023-02-24 18:48:13,310][177171] Sum rewards: 13.519, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.995', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.040', 'AMMO3': '0.139', 'weapon5': '0.154', 'AMMO4': '0.199', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.602', 'WEAPON3': '0.800', 'HITCOUNT': '1.050', 'weapon2': '1.102', 'weapon3': '1.666', 'DAMAGECOUNT': '4.737', 'FRAGCOUNT': '16.000'} [2023-02-24 18:48:13,607][177171] DAMAGECOUNT value on done: 190044.0 [2023-02-24 18:48:13,608][177171] Sum rewards: 13.963, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.908', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon4': '0.016', 'AMMO5': '0.025', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'AMMO3': '0.145', 'weapon5': '0.190', 'WEAPON5': '0.600', 'weapon2': '0.926', 'WEAPON3': '1.050', 'HITCOUNT': '1.120', 'weapon3': '2.560', 'DAMAGECOUNT': '4.791', 'FRAGCOUNT': '14.000'} [2023-02-24 18:48:14,338][177153] Updated weights for policy 0, policy_version 17460 (0.0008) [2023-02-24 18:48:14,422][177155] DAMAGECOUNT value on done: 192047.0 [2023-02-24 18:48:14,423][177155] Sum rewards: 5.026, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.080', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO3': '0.051', 'weapon7': '0.062', 'weapon5': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'weapon3': '1.012', 'DAMAGECOUNT': '1.455', 'weapon2': '1.610', 'FRAGCOUNT': '5.000'} [2023-02-24 18:48:14,723][177155] DAMAGECOUNT value on done: 199740.0 [2023-02-24 18:48:14,724][177155] Sum rewards: 20.224, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.744', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'AMMO5': '0.025', 'AMMO4': '0.116', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'weapon5': '0.258', 'ARMOR': '0.400', 'weapon4': '0.504', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'weapon2': '0.948', 'HITCOUNT': '1.310', 'weapon3': '1.594', 'DAMAGECOUNT': '6.054', 'FRAGCOUNT': '17.000'} [2023-02-24 18:48:15,110][177155] DAMAGECOUNT value on done: 201473.0 [2023-02-24 18:48:15,110][177155] Sum rewards: 16.444, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.490', 'AMMO2': '0.009', 'AMMO5': '0.017', 'AMMO4': '0.046', 'WEAPON1': '0.060', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.163', 'weapon5': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.450', 'weapon4': '0.480', 'WEAPON3': '0.850', 'weapon2': '0.884', 'HITCOUNT': '0.970', 'weapon3': '1.760', 'DAMAGECOUNT': '4.806', 'FRAGCOUNT': '15.000'} [2023-02-24 18:48:15,409][177155] DAMAGECOUNT value on done: 187648.0 [2023-02-24 18:48:15,409][177155] Sum rewards: 12.891, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.430', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO4': '0.023', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'weapon4': '0.200', 'weapon5': '0.284', 'WEAPON5': '0.500', 'weapon2': '0.668', 'WEAPON3': '0.850', 'HITCOUNT': '1.110', 'weapon3': '1.972', 'DAMAGECOUNT': '4.446', 'FRAGCOUNT': '13.000'} [2023-02-24 18:48:16,376][177119] Fps is (10 sec: 13517.0, 60 sec: 13789.9, 300 sec: 13857.0). Total num frames: 71540736. Throughput: 0: 3445.5. Samples: 17886706. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:48:16,376][177119] Avg episode reward: [(0, '14.764')] [2023-02-24 18:48:17,282][177153] Updated weights for policy 0, policy_version 17470 (0.0008) [2023-02-24 18:48:20,230][177153] Updated weights for policy 0, policy_version 17480 (0.0008) [2023-02-24 18:48:21,376][177119] Fps is (10 sec: 13516.7, 60 sec: 13789.9, 300 sec: 13857.0). Total num frames: 71610368. Throughput: 0: 3442.9. Samples: 17897026. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:48:21,376][177119] Avg episode reward: [(0, '14.764')] [2023-02-24 18:48:22,897][177156] DAMAGECOUNT value on done: 194869.0 [2023-02-24 18:48:22,898][177156] Sum rewards: 14.583, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.795', 'AMMO5': '0.020', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.125', 'weapon5': '0.282', 'weapon4': '0.298', 'weapon2': '0.328', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'HITCOUNT': '1.060', 'weapon3': '1.942', 'DAMAGECOUNT': '5.142', 'FRAGCOUNT': '13.500'} [2023-02-24 18:48:22,932][177156] DAMAGECOUNT value on done: 190822.0 [2023-02-24 18:48:22,933][177156] Sum rewards: 19.593, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.436', 'AMMO5': '0.017', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon5': '0.098', 'AMMO4': '0.109', 'AMMO3': '0.133', 'weapon4': '0.204', 'WEAPON5': '0.350', 'weapon2': '0.636', 'WEAPON3': '0.900', 'HITCOUNT': '1.390', 'weapon3': '2.560', 'DAMAGECOUNT': '6.279', 'FRAGCOUNT': '15.500'} [2023-02-24 18:48:23,207][177156] DAMAGECOUNT value on done: 199074.0 [2023-02-24 18:48:23,207][177156] Sum rewards: 18.501, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.561', 'AMMO2': '0.021', 'AMMO5': '0.023', 'WEAPON1': '0.050', 'AMMO4': '0.102', 'AMMO3': '0.141', 'WEAPON4': '0.200', 'weapon5': '0.228', 'ARMOR': '0.408', 'weapon4': '0.464', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'weapon2': '1.146', 'HITCOUNT': '1.200', 'weapon3': '1.784', 'DAMAGECOUNT': '5.895', 'FRAGCOUNT': '16.000'} [2023-02-24 18:48:23,207][177153] Updated weights for policy 0, policy_version 17490 (0.0008) [2023-02-24 18:48:23,246][177156] DAMAGECOUNT value on done: 191426.0 [2023-02-24 18:48:23,247][177156] Sum rewards: 13.827, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.550', 'AMMO2': '0.019', 'AMMO5': '0.021', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'weapon4': '0.064', 'AMMO4': '0.092', 'AMMO3': '0.114', 'weapon5': '0.252', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'HITCOUNT': '0.950', 'weapon2': '1.004', 'weapon3': '2.082', 'DAMAGECOUNT': '4.269', 'FRAGCOUNT': '12.500'} [2023-02-24 18:48:24,578][177170] DAMAGECOUNT value on done: 195885.0 [2023-02-24 18:48:24,579][177170] Sum rewards: 18.190, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.086', 'AMMO2': '0.011', 'AMMO5': '0.028', 'WEAPON1': '0.030', 'AMMO4': '0.056', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'weapon4': '0.240', 'weapon5': '0.340', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '0.870', 'weapon2': '1.384', 'weapon3': '1.684', 'DAMAGECOUNT': '6.186', 'FRAGCOUNT': '16.000'} [2023-02-24 18:48:24,877][177170] DAMAGECOUNT value on done: 199449.0 [2023-02-24 18:48:24,878][177170] Sum rewards: 5.338, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.975', 'AMMO5': '0.020', 'AMMO2': '0.021', 'WEAPON1': '0.050', 'AMMO4': '0.104', 'AMMO3': '0.146', 'WEAPON4': '0.250', 'weapon5': '0.262', 'weapon4': '0.274', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'HITCOUNT': '0.970', 'weapon2': '1.032', 'weapon3': '1.858', 'DAMAGECOUNT': '4.176', 'FRAGCOUNT': '8.000'} [2023-02-24 18:48:25,219][177170] DAMAGECOUNT value on done: 192331.0 [2023-02-24 18:48:25,219][177170] Sum rewards: 17.281, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.580', 'AMMO2': '0.009', 'AMMO5': '0.015', 'AMMO4': '0.046', 'AMMO3': '0.065', 'weapon5': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.454', 'WEAPON3': '0.550', 'weapon4': '0.832', 'HITCOUNT': '1.270', 'weapon3': '1.366', 'DAMAGECOUNT': '5.481', 'FRAGCOUNT': '13.000'} [2023-02-24 18:48:25,515][177170] DAMAGECOUNT value on done: 190163.0 [2023-02-24 18:48:25,516][177170] Sum rewards: 18.647, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.267', 'AMMO2': '0.013', 'AMMO5': '0.022', 'WEAPON4': '0.050', 'WEAPON1': '0.050', 'AMMO4': '0.062', 'weapon4': '0.072', 'AMMO3': '0.145', 'weapon5': '0.396', 'WEAPON5': '0.650', 'weapon2': '0.964', 'WEAPON3': '1.000', 'HITCOUNT': '1.180', 'weapon3': '2.132', 'DAMAGECOUNT': '5.928', 'FRAGCOUNT': '17.000'} [2023-02-24 18:48:26,162][177153] Updated weights for policy 0, policy_version 17500 (0.0008) [2023-02-24 18:48:26,356][177158] DAMAGECOUNT value on done: 185503.0 [2023-02-24 18:48:26,356][177158] Sum rewards: 12.246, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.219', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'weapon7': '0.052', 'AMMO4': '0.091', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.151', 'WEAPON7': '0.200', 'weapon5': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.316', 'WEAPON5': '0.350', 'weapon4': '0.436', 'HITCOUNT': '0.900', 'WEAPON3': '1.000', 'weapon3': '1.830', 'DAMAGECOUNT': '4.794', 'FRAGCOUNT': '14.000'} [2023-02-24 18:48:26,376][177119] Fps is (10 sec: 13926.2, 60 sec: 13789.8, 300 sec: 13857.0). Total num frames: 71680000. Throughput: 0: 3440.7. Samples: 17917746. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:48:26,376][177119] Avg episode reward: [(0, '14.928')] [2023-02-24 18:48:26,661][177158] DAMAGECOUNT value on done: 188253.0 [2023-02-24 18:48:26,661][177158] Sum rewards: 17.617, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.243', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'AMMO3': '0.134', 'AMMO4': '0.160', 'ARMOR': '0.412', 'weapon5': '0.484', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'weapon2': '0.698', 'WEAPON3': '0.850', 'weapon4': '0.918', 'HITCOUNT': '1.370', 'weapon3': '1.404', 'DAMAGECOUNT': '6.198', 'FRAGCOUNT': '18.000'} [2023-02-24 18:48:27,405][177158] DAMAGECOUNT value on done: 195277.0 [2023-02-24 18:48:27,405][177158] Sum rewards: 18.590, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.311', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO3': '0.120', 'weapon5': '0.254', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'weapon2': '0.954', 'HITCOUNT': '1.210', 'weapon3': '2.450', 'DAMAGECOUNT': '5.898', 'FRAGCOUNT': '15.000'} [2023-02-24 18:48:27,704][177158] DAMAGECOUNT value on done: 198968.0 [2023-02-24 18:48:27,704][177158] Sum rewards: 16.022, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.510', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'weapon4': '0.056', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'AMMO3': '0.128', 'WEAPON5': '0.200', 'weapon5': '0.250', 'ARMOR': '0.500', 'WEAPON3': '0.800', 'HITCOUNT': '0.860', 'weapon2': '1.490', 'weapon3': '1.876', 'DAMAGECOUNT': '3.654', 'FRAGCOUNT': '15.000'} [2023-02-24 18:48:29,136][177153] Updated weights for policy 0, policy_version 17510 (0.0008) [2023-02-24 18:48:29,386][177172] DAMAGECOUNT value on done: 196075.0 [2023-02-24 18:48:29,387][177172] Sum rewards: 16.198, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.028', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO3': '0.078', 'AMMO4': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.524', 'WEAPON3': '0.600', 'weapon2': '0.956', 'HITCOUNT': '1.030', 'weapon3': '1.410', 'DAMAGECOUNT': '4.269', 'FRAGCOUNT': '13.000'} [2023-02-24 18:48:29,687][177172] DAMAGECOUNT value on done: 191453.0 [2023-02-24 18:48:29,687][177172] Sum rewards: 2.942, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.108', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon7': '0.060', 'AMMO3': '0.069', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.152', 'WEAPON7': '0.200', 'AMMO4': '0.221', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.450', 'weapon2': '0.576', 'WEAPON4': '0.600', 'weapon4': '0.762', 'weapon3': '1.112', 'DAMAGECOUNT': '2.784', 'FRAGCOUNT': '6.500'} [2023-02-24 18:48:31,370][177154] DAMAGECOUNT value on done: 197127.0 [2023-02-24 18:48:31,370][177154] Sum rewards: 10.691, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.006', 'AMMO5': '0.013', 'AMMO4': '0.027', 'HEALTH': '0.032', 'WEAPON1': '0.050', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.214', 'weapon5': '0.244', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.750', 'weapon2': '1.376', 'weapon3': '1.636', 'DAMAGECOUNT': '3.072', 'FRAGCOUNT': '7.500'} [2023-02-24 18:48:31,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13789.9, 300 sec: 13857.0). Total num frames: 71749632. Throughput: 0: 3443.7. Samples: 17938462. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 18:48:31,376][177119] Avg episode reward: [(0, '15.024')] [2023-02-24 18:48:31,500][177172] DAMAGECOUNT value on done: 195038.0 [2023-02-24 18:48:31,501][177172] Sum rewards: 12.105, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.500', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO5': '0.015', 'WEAPON1': '0.090', 'AMMO3': '0.125', 'weapon5': '0.220', 'WEAPON5': '0.450', 'HITCOUNT': '0.830', 'WEAPON3': '0.900', 'weapon2': '1.514', 'weapon3': '1.866', 'DAMAGECOUNT': '4.143', 'FRAGCOUNT': '11.000'} [2023-02-24 18:48:31,674][177154] DAMAGECOUNT value on done: 200436.0 [2023-02-24 18:48:31,674][177154] Sum rewards: 12.388, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.271', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'WEAPON4': '0.100', 'weapon4': '0.122', 'weapon5': '0.130', 'AMMO3': '0.175', 'WEAPON5': '0.250', 'WEAPON3': '1.100', 'HITCOUNT': '1.160', 'weapon2': '1.364', 'weapon3': '2.126', 'DAMAGECOUNT': '4.620', 'FRAGCOUNT': '14.000'} [2023-02-24 18:48:31,791][177172] DAMAGECOUNT value on done: 194787.0 [2023-02-24 18:48:31,792][177172] Sum rewards: 11.643, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.624', 'AMMO5': '0.019', 'AMMO2': '0.020', 'weapon7': '0.056', 'WEAPON1': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.100', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'weapon4': '0.160', 'weapon5': '0.250', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'HITCOUNT': '0.950', 'weapon2': '1.034', 'weapon3': '1.940', 'DAMAGECOUNT': '3.690', 'FRAGCOUNT': '12.000'} [2023-02-24 18:48:31,976][177154] DAMAGECOUNT value on done: 204784.0 [2023-02-24 18:48:31,977][177154] Sum rewards: 24.795, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.404', 'AMMO2': '0.017', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.085', 'weapon4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.148', 'weapon5': '0.198', 'WEAPON5': '0.400', 'weapon2': '0.850', 'WEAPON3': '0.900', 'HITCOUNT': '1.530', 'weapon3': '2.420', 'DAMAGECOUNT': '7.158', 'FRAGCOUNT': '21.000'} [2023-02-24 18:48:32,013][177157] DAMAGECOUNT value on done: 199866.0 [2023-02-24 18:48:32,013][177157] Sum rewards: 20.157, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.875', 'ARMOR': '0.008', 'AMMO2': '0.009', 'AMMO5': '0.029', 'AMMO4': '0.043', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.135', 'weapon5': '0.136', 'weapon4': '0.270', 'WEAPON5': '0.700', 'WEAPON3': '0.950', 'weapon2': '1.110', 'HITCOUNT': '1.280', 'weapon3': '2.152', 'DAMAGECOUNT': '5.550', 'FRAGCOUNT': '17.000'} [2023-02-24 18:48:32,109][177153] Updated weights for policy 0, policy_version 17520 (0.0008) [2023-02-24 18:48:32,111][177157] DAMAGECOUNT value on done: 185381.0 [2023-02-24 18:48:32,112][177157] Sum rewards: 15.334, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.556', 'AMMO2': '0.014', 'AMMO5': '0.017', 'AMMO4': '0.068', 'WEAPON1': '0.070', 'AMMO3': '0.106', 'weapon5': '0.206', 'weapon4': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'HITCOUNT': '1.280', 'weapon2': '1.374', 'weapon3': '1.678', 'DAMAGECOUNT': '4.791', 'FRAGCOUNT': '13.000'} [2023-02-24 18:48:32,275][177154] DAMAGECOUNT value on done: 201687.0 [2023-02-24 18:48:32,276][177154] Sum rewards: 15.848, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.500', 'AMMO5': '0.014', 'AMMO2': '0.016', 'AMMO4': '0.080', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'weapon4': '0.158', 'weapon5': '0.202', 'WEAPON5': '0.400', 'weapon2': '0.590', 'WEAPON3': '1.050', 'HITCOUNT': '1.140', 'weapon3': '2.618', 'DAMAGECOUNT': '5.532', 'FRAGCOUNT': '15.000'} [2023-02-24 18:48:32,309][177157] DAMAGECOUNT value on done: 190242.0 [2023-02-24 18:48:32,309][177157] Sum rewards: 8.969, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.144', 'AMMO2': '0.005', 'AMMO5': '0.017', 'AMMO4': '0.026', 'WEAPON1': '0.070', 'AMMO3': '0.142', 'WEAPON4': '0.200', 'weapon5': '0.252', 'weapon4': '0.434', 'WEAPON5': '0.550', 'weapon2': '0.566', 'WEAPON3': '0.950', 'HITCOUNT': '1.080', 'weapon3': '1.938', 'DAMAGECOUNT': '4.632', 'FRAGCOUNT': '10.000'} [2023-02-24 18:48:32,413][177157] DAMAGECOUNT value on done: 188899.0 [2023-02-24 18:48:32,414][177157] Sum rewards: 13.515, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.927', 'AMMO2': '0.024', 'AMMO5': '0.032', 'WEAPON1': '0.070', 'AMMO4': '0.122', 'AMMO3': '0.138', 'WEAPON4': '0.250', 'weapon4': '0.266', 'weapon5': '0.320', 'WEAPON5': '0.800', 'weapon2': '0.910', 'WEAPON3': '1.000', 'HITCOUNT': '1.170', 'weapon3': '2.040', 'DAMAGECOUNT': '5.049', 'FRAGCOUNT': '14.000'} [2023-02-24 18:48:32,494][177171] DAMAGECOUNT value on done: 189381.0 [2023-02-24 18:48:32,495][177171] Sum rewards: 10.247, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.942', 'AMMO2': '0.014', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.068', 'AMMO3': '0.118', 'weapon5': '0.192', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.470', 'WEAPON3': '0.700', 'weapon4': '0.768', 'HITCOUNT': '1.320', 'weapon3': '2.030', 'DAMAGECOUNT': '4.614', 'FRAGCOUNT': '10.500'} [2023-02-24 18:48:32,786][177171] DAMAGECOUNT value on done: 192107.0 [2023-02-24 18:48:32,787][177171] Sum rewards: 20.010, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.524', 'AMMO2': '0.011', 'AMMO5': '0.020', 'AMMO4': '0.055', 'WEAPON1': '0.070', 'WEAPON4': '0.150', 'weapon5': '0.152', 'AMMO3': '0.182', 'weapon2': '0.308', 'weapon4': '0.362', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '1.340', 'weapon3': '2.476', 'DAMAGECOUNT': '6.258', 'FRAGCOUNT': '19.500'} [2023-02-24 18:48:32,795][177171] DAMAGECOUNT value on done: 196845.0 [2023-02-24 18:48:32,795][177171] Sum rewards: 10.705, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.002', 'ARMOR': '0.004', 'AMMO2': '0.010', 'AMMO5': '0.022', 'WEAPON1': '0.040', 'AMMO4': '0.049', 'AMMO3': '0.069', 'weapon7': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.258', 'weapon4': '0.436', 'WEAPON3': '0.450', 'WEAPON5': '0.550', 'HITCOUNT': '0.630', 'weapon2': '0.952', 'weapon3': '1.334', 'DAMAGECOUNT': '3.360', 'FRAGCOUNT': '9.000'} [2023-02-24 18:48:33,091][177171] DAMAGECOUNT value on done: 192822.0 [2023-02-24 18:48:33,092][177171] Sum rewards: 34.444, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.012', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'HEALTH': '0.089', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'weapon4': '0.314', 'WEAPON5': '0.350', 'weapon5': '0.406', 'WEAPON3': '0.650', 'weapon2': '0.966', 'HITCOUNT': '1.610', 'weapon3': '1.856', 'DAMAGECOUNT': '8.334', 'FRAGCOUNT': '27.000'} [2023-02-24 18:48:33,945][177155] DAMAGECOUNT value on done: 193502.0 [2023-02-24 18:48:33,945][177155] Sum rewards: 10.995, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.790', 'AMMO2': '0.020', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'AMMO3': '0.097', 'AMMO4': '0.102', 'weapon5': '0.188', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON5': '0.550', 'weapon4': '0.590', 'WEAPON3': '0.600', 'HITCOUNT': '0.940', 'weapon3': '1.218', 'weapon2': '1.412', 'DAMAGECOUNT': '4.365', 'FRAGCOUNT': '10.000'} [2023-02-24 18:48:34,247][177155] DAMAGECOUNT value on done: 201090.0 [2023-02-24 18:48:34,247][177155] Sum rewards: 15.059, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.905', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.015', 'weapon7': '0.060', 'AMMO4': '0.072', 'AMMO3': '0.074', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon2': '0.374', 'WEAPON4': '0.450', 'ARMOR': '0.500', 'WEAPON3': '0.650', 'weapon4': '0.694', 'HITCOUNT': '1.070', 'weapon3': '1.404', 'DAMAGECOUNT': '4.050', 'FRAGCOUNT': '13.000'} [2023-02-24 18:48:34,643][177155] DAMAGECOUNT value on done: 203211.0 [2023-02-24 18:48:34,643][177155] Sum rewards: 11.278, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.690', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'WEAPON4': '0.100', 'AMMO3': '0.145', 'AMMO4': '0.174', 'weapon5': '0.228', 'weapon4': '0.274', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.874', 'HITCOUNT': '0.920', 'WEAPON3': '1.000', 'weapon3': '2.072', 'DAMAGECOUNT': '4.809', 'FRAGCOUNT': '12.000'} [2023-02-24 18:48:34,942][177155] DAMAGECOUNT value on done: 188660.0 [2023-02-24 18:48:34,943][177155] Sum rewards: 10.717, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.600', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.078', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'weapon5': '0.102', 'WEAPON4': '0.150', 'weapon4': '0.298', 'WEAPON3': '0.600', 'HITCOUNT': '0.950', 'weapon3': '1.630', 'weapon2': '1.736', 'DAMAGECOUNT': '3.036', 'FRAGCOUNT': '10.000'} [2023-02-24 18:48:35,063][177153] Updated weights for policy 0, policy_version 17530 (0.0009) [2023-02-24 18:48:36,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13789.9, 300 sec: 13857.0). Total num frames: 71819264. Throughput: 0: 3446.5. Samples: 17948854. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 18:48:36,376][177119] Avg episode reward: [(0, '15.026')] [2023-02-24 18:48:38,013][177153] Updated weights for policy 0, policy_version 17540 (0.0008) [2023-02-24 18:48:40,959][177153] Updated weights for policy 0, policy_version 17550 (0.0008) [2023-02-24 18:48:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13857.0). Total num frames: 71888896. Throughput: 0: 3448.5. Samples: 17969670. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 18:48:41,376][177119] Avg episode reward: [(0, '15.026')] [2023-02-24 18:48:42,324][177156] DAMAGECOUNT value on done: 196173.0 [2023-02-24 18:48:42,325][177156] Sum rewards: 15.361, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.455', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO4': '0.025', 'weapon7': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.152', 'AMMO3': '0.157', 'WEAPON7': '0.200', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'HITCOUNT': '1.060', 'weapon2': '1.298', 'weapon3': '2.108', 'DAMAGECOUNT': '3.912', 'FRAGCOUNT': '15.000'} [2023-02-24 18:48:42,365][177156] DAMAGECOUNT value on done: 192299.0 [2023-02-24 18:48:42,365][177156] Sum rewards: 10.468, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.180', 'AMMO5': '0.027', 'WEAPON1': '0.030', 'AMMO2': '0.050', 'AMMO3': '0.064', 'AMMO4': '0.248', 'weapon5': '0.320', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.500', 'weapon4': '0.558', 'HITCOUNT': '0.890', 'weapon2': '1.258', 'weapon3': '1.372', 'DAMAGECOUNT': '4.431', 'FRAGCOUNT': '8.500'} [2023-02-24 18:48:42,641][177156] DAMAGECOUNT value on done: 199895.0 [2023-02-24 18:48:42,642][177156] Sum rewards: 7.967, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.117', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO3': '0.051', 'weapon7': '0.056', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.137', 'weapon5': '0.158', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.350', 'WEAPON4': '0.400', 'HITCOUNT': '0.680', 'weapon3': '0.714', 'weapon4': '0.718', 'weapon2': '0.932', 'DAMAGECOUNT': '2.463', 'FRAGCOUNT': '7.000'} [2023-02-24 18:48:42,679][177156] DAMAGECOUNT value on done: 192780.0 [2023-02-24 18:48:42,679][177156] Sum rewards: 11.001, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.005', 'AMMO2': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.022', 'weapon7': '0.064', 'weapon5': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.128', 'weapon4': '0.130', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.834', 'WEAPON3': '0.900', 'HITCOUNT': '0.900', 'weapon3': '1.486', 'DAMAGECOUNT': '4.062', 'FRAGCOUNT': '11.000'} [2023-02-24 18:48:43,955][177170] DAMAGECOUNT value on done: 197356.0 [2023-02-24 18:48:43,955][177170] Sum rewards: 12.428, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.770', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO3': '0.104', 'weapon5': '0.228', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.930', 'weapon3': '1.608', 'weapon2': '1.800', 'DAMAGECOUNT': '4.413', 'FRAGCOUNT': '9.000'} [2023-02-24 18:48:43,973][177153] Updated weights for policy 0, policy_version 17560 (0.0008) [2023-02-24 18:48:44,254][177170] DAMAGECOUNT value on done: 201686.0 [2023-02-24 18:48:44,254][177170] Sum rewards: 21.241, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.065', 'AMMO2': '0.003', 'AMMO5': '0.013', 'AMMO4': '0.015', 'WEAPON1': '0.030', 'weapon7': '0.056', 'AMMO3': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.252', 'weapon4': '0.338', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.200', 'HITCOUNT': '1.370', 'weapon3': '1.828', 'DAMAGECOUNT': '6.711', 'FRAGCOUNT': '17.000'} [2023-02-24 18:48:44,622][177170] DAMAGECOUNT value on done: 194508.0 [2023-02-24 18:48:44,622][177170] Sum rewards: 17.315, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.687', 'AMMO5': '0.015', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'weapon5': '0.154', 'AMMO3': '0.164', 'weapon4': '0.298', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon2': '1.422', 'HITCOUNT': '1.680', 'weapon3': '1.784', 'DAMAGECOUNT': '6.531', 'FRAGCOUNT': '15.000'} [2023-02-24 18:48:44,919][177170] DAMAGECOUNT value on done: 191362.0 [2023-02-24 18:48:44,919][177170] Sum rewards: 10.950, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.398', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO3': '0.111', 'WEAPON4': '0.150', 'weapon5': '0.228', 'weapon4': '0.318', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'HITCOUNT': '0.900', 'weapon2': '1.010', 'weapon3': '1.992', 'DAMAGECOUNT': '3.597', 'FRAGCOUNT': '11.000'} [2023-02-24 18:48:45,795][177158] DAMAGECOUNT value on done: 187305.0 [2023-02-24 18:48:45,796][177158] Sum rewards: 19.281, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.048', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.360', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '1.390', 'weapon2': '1.556', 'weapon3': '1.836', 'DAMAGECOUNT': '5.406', 'FRAGCOUNT': '15.000'} [2023-02-24 18:48:46,088][177158] DAMAGECOUNT value on done: 190071.0 [2023-02-24 18:48:46,089][177158] Sum rewards: 13.801, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.900', 'AMMO5': '0.009', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.135', 'weapon5': '0.158', 'WEAPON5': '0.200', 'weapon4': '0.352', 'WEAPON3': '0.750', 'weapon2': '1.348', 'HITCOUNT': '1.390', 'weapon3': '1.914', 'DAMAGECOUNT': '5.454', 'FRAGCOUNT': '12.500'} [2023-02-24 18:48:46,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 71958528. Throughput: 0: 3449.8. Samples: 17990394. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:48:46,376][177119] Avg episode reward: [(0, '14.925')] [2023-02-24 18:48:46,815][177158] DAMAGECOUNT value on done: 197495.0 [2023-02-24 18:48:46,815][177158] Sum rewards: 17.193, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.578', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.060', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'WEAPON4': '0.250', 'weapon4': '0.286', 'weapon2': '1.142', 'WEAPON3': '1.150', 'HITCOUNT': '1.600', 'weapon3': '2.152', 'DAMAGECOUNT': '6.654', 'FRAGCOUNT': '16.500'} [2023-02-24 18:48:46,920][177153] Updated weights for policy 0, policy_version 17570 (0.0008) [2023-02-24 18:48:47,120][177158] DAMAGECOUNT value on done: 200466.0 [2023-02-24 18:48:47,120][177158] Sum rewards: 13.624, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.440', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.045', 'weapon7': '0.050', 'AMMO3': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.212', 'weapon4': '0.232', 'WEAPON5': '0.250', 'WEAPON3': '0.650', 'HITCOUNT': '0.930', 'weapon2': '1.024', 'weapon3': '1.650', 'DAMAGECOUNT': '4.494', 'FRAGCOUNT': '10.000'} [2023-02-24 18:48:48,824][177172] DAMAGECOUNT value on done: 197581.0 [2023-02-24 18:48:48,825][177172] Sum rewards: 14.704, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.880', 'AMMO5': '0.011', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon4': '0.020', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'weapon5': '0.152', 'WEAPON5': '0.250', 'WEAPON3': '0.800', 'HITCOUNT': '1.160', 'weapon2': '1.548', 'weapon3': '2.026', 'DAMAGECOUNT': '4.518', 'FRAGCOUNT': '13.000'} [2023-02-24 18:48:49,131][177172] DAMAGECOUNT value on done: 192567.0 [2023-02-24 18:48:49,132][177172] Sum rewards: 11.248, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.019', 'AMMO5': '0.012', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'weapon7': '0.048', 'weapon5': '0.070', 'AMMO4': '0.071', 'AMMO3': '0.083', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.532', 'WEAPON3': '0.550', 'weapon2': '0.586', 'HITCOUNT': '0.710', 'weapon3': '1.238', 'DAMAGECOUNT': '3.342', 'FRAGCOUNT': '10.000'} [2023-02-24 18:48:49,853][177153] Updated weights for policy 0, policy_version 17580 (0.0008) [2023-02-24 18:48:50,766][177154] DAMAGECOUNT value on done: 198551.0 [2023-02-24 18:48:50,767][177154] Sum rewards: 14.553, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.079', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.071', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'weapon7': '0.178', 'weapon4': '0.196', 'weapon5': '0.220', 'WEAPON3': '0.500', 'HITCOUNT': '0.910', 'weapon2': '1.142', 'weapon3': '1.534', 'DAMAGECOUNT': '4.272', 'FRAGCOUNT': '11.000'} [2023-02-24 18:48:50,912][177172] DAMAGECOUNT value on done: 196444.0 [2023-02-24 18:48:50,913][177172] Sum rewards: 11.694, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.796', 'AMMO2': '0.016', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'weapon7': '0.078', 'AMMO4': '0.081', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.124', 'weapon5': '0.124', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.516', 'WEAPON3': '0.850', 'HITCOUNT': '0.910', 'weapon2': '1.032', 'weapon3': '1.194', 'DAMAGECOUNT': '4.218', 'FRAGCOUNT': '11.000'} [2023-02-24 18:48:51,074][177154] DAMAGECOUNT value on done: 202141.0 [2023-02-24 18:48:51,075][177154] Sum rewards: 14.042, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.845', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.119', 'weapon7': '0.122', 'weapon5': '0.194', 'AMMO4': '0.251', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.558', 'HITCOUNT': '0.740', 'weapon2': '0.744', 'WEAPON3': '0.850', 'weapon3': '1.862', 'DAMAGECOUNT': '4.215', 'FRAGCOUNT': '14.000'} [2023-02-24 18:48:51,223][177172] DAMAGECOUNT value on done: 196408.0 [2023-02-24 18:48:51,224][177172] Sum rewards: 12.569, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon5': '0.024', 'AMMO4': '0.109', 'AMMO3': '0.138', 'HEALTH': '0.140', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'weapon4': '0.746', 'WEAPON3': '0.750', 'weapon2': '1.220', 'HITCOUNT': '1.300', 'weapon3': '1.750', 'DAMAGECOUNT': '4.863', 'FRAGCOUNT': '11.500'} [2023-02-24 18:48:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 72028160. Throughput: 0: 3452.2. Samples: 18000794. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:48:51,376][177119] Avg episode reward: [(0, '14.933')] [2023-02-24 18:48:51,378][177154] DAMAGECOUNT value on done: 206893.0 [2023-02-24 18:48:51,378][177154] Sum rewards: 23.600, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.608', 'AMMO2': '0.003', 'AMMO5': '0.015', 'AMMO4': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.120', 'AMMO3': '0.121', 'WEAPON4': '0.150', 'weapon4': '0.286', 'WEAPON5': '0.300', 'ARMOR': '0.462', 'WEAPON3': '0.750', 'weapon2': '0.888', 'HITCOUNT': '1.370', 'weapon3': '1.880', 'DAMAGECOUNT': '6.327', 'FRAGCOUNT': '19.000'} [2023-02-24 18:48:51,474][177157] DAMAGECOUNT value on done: 201728.0 [2023-02-24 18:48:51,474][177157] Sum rewards: 18.014, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.084', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.050', 'AMMO4': '0.087', 'AMMO3': '0.088', 'WEAPON4': '0.150', 'weapon5': '0.210', 'WEAPON5': '0.350', 'weapon4': '0.376', 'WEAPON3': '0.650', 'HITCOUNT': '1.010', 'weapon2': '1.382', 'weapon3': '1.632', 'DAMAGECOUNT': '5.586', 'FRAGCOUNT': '15.000'} [2023-02-24 18:48:51,535][177157] DAMAGECOUNT value on done: 186531.0 [2023-02-24 18:48:51,536][177157] Sum rewards: 6.929, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.844', 'AMMO2': '0.014', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.069', 'weapon5': '0.134', 'AMMO3': '0.139', 'WEAPON4': '0.200', 'weapon4': '0.220', 'WEAPON5': '0.400', 'ARMOR': '0.452', 'WEAPON3': '1.000', 'HITCOUNT': '1.010', 'weapon2': '1.580', 'weapon3': '1.820', 'DAMAGECOUNT': '3.450', 'FRAGCOUNT': '8.000'} [2023-02-24 18:48:51,677][177154] DAMAGECOUNT value on done: 202886.0 [2023-02-24 18:48:51,677][177154] Sum rewards: 13.724, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.727', 'AMMO2': '0.016', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.077', 'AMMO3': '0.120', 'weapon5': '0.166', 'WEAPON4': '0.300', 'weapon4': '0.340', 'WEAPON5': '0.450', 'WEAPON3': '0.900', 'HITCOUNT': '1.080', 'weapon2': '1.318', 'weapon3': '1.800', 'DAMAGECOUNT': '3.597', 'FRAGCOUNT': '12.000'} [2023-02-24 18:48:51,780][177157] DAMAGECOUNT value on done: 191668.0 [2023-02-24 18:48:51,781][177157] Sum rewards: 13.953, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.720', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.032', 'AMMO3': '0.110', 'weapon5': '0.148', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'HITCOUNT': '1.000', 'weapon2': '1.292', 'weapon3': '2.234', 'DAMAGECOUNT': '4.278', 'FRAGCOUNT': '12.000'} [2023-02-24 18:48:51,832][177171] DAMAGECOUNT value on done: 191005.0 [2023-02-24 18:48:51,833][177171] Sum rewards: 12.664, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.968', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.146', 'weapon5': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.490', 'WEAPON3': '0.850', 'weapon2': '0.872', 'HITCOUNT': '1.070', 'weapon3': '1.850', 'DAMAGECOUNT': '4.872', 'FRAGCOUNT': '13.000'} [2023-02-24 18:48:51,849][177157] DAMAGECOUNT value on done: 190000.0 [2023-02-24 18:48:51,849][177157] Sum rewards: 11.059, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.482', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.015', 'AMMO4': '0.060', 'AMMO3': '0.102', 'weapon4': '0.134', 'weapon5': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'HITCOUNT': '0.860', 'weapon3': '1.656', 'weapon2': '1.752', 'DAMAGECOUNT': '3.303', 'FRAGCOUNT': '9.000'} [2023-02-24 18:48:52,133][177171] DAMAGECOUNT value on done: 194002.0 [2023-02-24 18:48:52,134][177171] Sum rewards: 18.652, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.170', 'AMMO2': '0.003', 'AMMO4': '0.013', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO3': '0.089', 'WEAPON4': '0.150', 'weapon4': '0.160', 'weapon5': '0.310', 'ARMOR': '0.466', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'HITCOUNT': '1.100', 'weapon2': '1.466', 'weapon3': '1.588', 'DAMAGECOUNT': '5.685', 'FRAGCOUNT': '13.500'} [2023-02-24 18:48:52,144][177171] DAMAGECOUNT value on done: 198816.0 [2023-02-24 18:48:52,145][177171] Sum rewards: 19.188, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.600', 'AMMO2': '0.014', 'AMMO5': '0.022', 'weapon7': '0.062', 'AMMO4': '0.070', 'AMMO3': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.152', 'WEAPON7': '0.200', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon4': '0.724', 'weapon2': '0.784', 'WEAPON3': '0.850', 'HITCOUNT': '1.550', 'weapon3': '1.790', 'DAMAGECOUNT': '5.913', 'FRAGCOUNT': '18.000'} [2023-02-24 18:48:52,441][177171] DAMAGECOUNT value on done: 193370.0 [2023-02-24 18:48:52,441][177171] Sum rewards: 5.239, reward structure: {'DEATHCOUNT': '-5.250', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO3': '0.020', 'AMMO2': '0.040', 'weapon7': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON3': '0.100', 'HEALTH': '0.148', 'weapon5': '0.182', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'WEAPON4': '0.300', 'HITCOUNT': '0.360', 'weapon4': '0.482', 'weapon3': '0.500', 'weapon2': '0.904', 'DAMAGECOUNT': '1.644', 'FRAGCOUNT': '5.000'} [2023-02-24 18:48:52,824][177153] Updated weights for policy 0, policy_version 17590 (0.0009) [2023-02-24 18:48:53,417][177155] DAMAGECOUNT value on done: 195041.0 [2023-02-24 18:48:53,417][177155] Sum rewards: 19.351, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.857', 'WEAPON1': '0.010', 'weapon7': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO3': '0.079', 'AMMO4': '0.111', 'weapon5': '0.164', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.588', 'WEAPON3': '0.600', 'HITCOUNT': '1.000', 'weapon2': '1.290', 'weapon3': '1.452', 'DAMAGECOUNT': '4.617', 'FRAGCOUNT': '15.000'} [2023-02-24 18:48:53,716][177155] DAMAGECOUNT value on done: 202793.0 [2023-02-24 18:48:53,717][177155] Sum rewards: 12.916, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.650', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.056', 'weapon5': '0.102', 'weapon7': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.123', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.462', 'WEAPON3': '0.800', 'weapon2': '0.840', 'HITCOUNT': '1.260', 'weapon3': '1.712', 'DAMAGECOUNT': '5.109', 'FRAGCOUNT': '12.000'} [2023-02-24 18:48:54,108][177155] DAMAGECOUNT value on done: 204819.0 [2023-02-24 18:48:54,109][177155] Sum rewards: 16.232, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.920', 'AMMO5': '0.016', 'AMMO2': '0.027', 'AMMO3': '0.108', 'AMMO4': '0.135', 'weapon4': '0.204', 'weapon5': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'HITCOUNT': '1.040', 'weapon2': '1.306', 'weapon3': '1.970', 'DAMAGECOUNT': '4.824', 'FRAGCOUNT': '15.000'} [2023-02-24 18:48:54,411][177155] DAMAGECOUNT value on done: 190348.0 [2023-02-24 18:48:54,411][177155] Sum rewards: 16.786, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.058', 'AMMO2': '0.011', 'AMMO5': '0.019', 'WEAPON1': '0.040', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'AMMO3': '0.152', 'weapon5': '0.208', 'weapon4': '0.246', 'WEAPON5': '0.500', 'weapon2': '0.684', 'WEAPON3': '1.000', 'HITCOUNT': '1.370', 'weapon3': '2.142', 'DAMAGECOUNT': '5.064', 'FRAGCOUNT': '16.000'} [2023-02-24 18:48:55,811][177153] Updated weights for policy 0, policy_version 17600 (0.0009) [2023-02-24 18:48:56,376][177119] Fps is (10 sec: 13516.9, 60 sec: 13789.9, 300 sec: 13843.1). Total num frames: 72093696. Throughput: 0: 3452.5. Samples: 18021460. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:48:56,376][177119] Avg episode reward: [(0, '14.766')] [2023-02-24 18:48:56,406][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000017602_72097792.pth... [2023-02-24 18:48:56,465][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000016791_68775936.pth [2023-02-24 18:48:58,788][177153] Updated weights for policy 0, policy_version 17610 (0.0009) [2023-02-24 18:49:01,376][177119] Fps is (10 sec: 13516.7, 60 sec: 13789.9, 300 sec: 13843.1). Total num frames: 72163328. Throughput: 0: 3454.7. Samples: 18042168. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:49:01,376][177119] Avg episode reward: [(0, '14.766')] [2023-02-24 18:49:01,753][177153] Updated weights for policy 0, policy_version 17620 (0.0008) [2023-02-24 18:49:01,831][177156] DAMAGECOUNT value on done: 197880.0 [2023-02-24 18:49:01,831][177156] Sum rewards: 17.037, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.744', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO3': '0.080', 'WEAPON4': '0.150', 'weapon5': '0.152', 'weapon4': '0.218', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '1.180', 'weapon2': '1.434', 'weapon3': '1.820', 'DAMAGECOUNT': '5.121', 'FRAGCOUNT': '15.000'} [2023-02-24 18:49:01,870][177156] DAMAGECOUNT value on done: 193848.0 [2023-02-24 18:49:01,870][177156] Sum rewards: 10.312, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.381', 'AMMO2': '0.008', 'AMMO5': '0.027', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'weapon4': '0.088', 'AMMO3': '0.161', 'weapon5': '0.310', 'WEAPON5': '0.550', 'weapon2': '0.818', 'WEAPON3': '0.950', 'HITCOUNT': '1.120', 'weapon3': '2.366', 'DAMAGECOUNT': '4.647', 'FRAGCOUNT': '11.000'} [2023-02-24 18:49:02,139][177156] DAMAGECOUNT value on done: 201405.0 [2023-02-24 18:49:02,139][177156] Sum rewards: 11.984, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.225', 'AMMO2': '0.009', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.045', 'weapon5': '0.068', 'weapon4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'HITCOUNT': '1.100', 'weapon2': '1.754', 'weapon3': '1.828', 'DAMAGECOUNT': '4.530', 'FRAGCOUNT': '11.000'} [2023-02-24 18:49:02,178][177156] DAMAGECOUNT value on done: 194331.0 [2023-02-24 18:49:02,179][177156] Sum rewards: 12.011, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.071', 'AMMO5': '0.017', 'AMMO2': '0.019', 'AMMO4': '0.097', 'AMMO3': '0.134', 'weapon5': '0.176', 'WEAPON4': '0.200', 'weapon4': '0.228', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '0.920', 'weapon2': '1.248', 'weapon3': '1.990', 'DAMAGECOUNT': '4.653', 'FRAGCOUNT': '11.000'} [2023-02-24 18:49:03,356][177170] DAMAGECOUNT value on done: 198632.0 [2023-02-24 18:49:03,356][177170] Sum rewards: 12.815, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.236', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon5': '0.064', 'weapon7': '0.080', 'AMMO3': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.104', 'weapon2': '0.184', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.498', 'WEAPON3': '0.600', 'HITCOUNT': '0.810', 'weapon3': '1.438', 'DAMAGECOUNT': '3.828', 'FRAGCOUNT': '12.000'} [2023-02-24 18:49:03,664][177170] DAMAGECOUNT value on done: 203672.0 [2023-02-24 18:49:03,664][177170] Sum rewards: 22.392, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.106', 'AMMO5': '0.022', 'AMMO2': '0.029', 'AMMO3': '0.088', 'AMMO4': '0.146', 'weapon5': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon4': '0.730', 'weapon2': '0.810', 'ARMOR': '0.856', 'HITCOUNT': '1.380', 'weapon3': '1.570', 'DAMAGECOUNT': '5.958', 'FRAGCOUNT': '17.000'} [2023-02-24 18:49:04,033][177170] DAMAGECOUNT value on done: 196309.0 [2023-02-24 18:49:04,033][177170] Sum rewards: 18.184, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.300', 'AMMO2': '0.007', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO4': '0.032', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'weapon4': '0.124', 'weapon5': '0.202', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '1.150', 'weapon3': '1.498', 'weapon2': '2.034', 'DAMAGECOUNT': '5.133', 'FRAGCOUNT': '14.000'} [2023-02-24 18:49:04,336][177170] DAMAGECOUNT value on done: 193057.0 [2023-02-24 18:49:04,336][177170] Sum rewards: 18.684, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.444', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO5': '0.015', 'weapon7': '0.050', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.154', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '1.050', 'HITCOUNT': '1.330', 'weapon2': '1.436', 'weapon3': '2.252', 'DAMAGECOUNT': '5.085', 'FRAGCOUNT': '17.000'} [2023-02-24 18:49:04,726][177153] Updated weights for policy 0, policy_version 17630 (0.0008) [2023-02-24 18:49:05,257][177158] DAMAGECOUNT value on done: 188974.0 [2023-02-24 18:49:05,258][177158] Sum rewards: 12.628, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.100', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.014', 'WEAPON1': '0.040', 'AMMO3': '0.098', 'weapon5': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.442', 'weapon2': '0.588', 'WEAPON3': '0.750', 'HITCOUNT': '1.210', 'weapon3': '1.982', 'DAMAGECOUNT': '5.007', 'FRAGCOUNT': '9.500'} [2023-02-24 18:49:05,565][177158] DAMAGECOUNT value on done: 191199.0 [2023-02-24 18:49:05,566][177158] Sum rewards: 10.879, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.365', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.027', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'weapon5': '0.170', 'weapon4': '0.212', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'HITCOUNT': '0.750', 'weapon2': '1.114', 'weapon3': '2.034', 'DAMAGECOUNT': '3.384', 'FRAGCOUNT': '9.000'} [2023-02-24 18:49:06,306][177158] DAMAGECOUNT value on done: 199280.0 [2023-02-24 18:49:06,306][177158] Sum rewards: 12.679, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.278', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO2': '0.031', 'AMMO3': '0.106', 'AMMO4': '0.155', 'weapon5': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.500', 'weapon2': '0.528', 'weapon4': '0.554', 'WEAPON3': '0.800', 'HITCOUNT': '1.250', 'weapon3': '2.074', 'DAMAGECOUNT': '5.352', 'FRAGCOUNT': '11.000'} [2023-02-24 18:49:06,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13789.9, 300 sec: 13843.1). Total num frames: 72232960. Throughput: 0: 3455.2. Samples: 18052508. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:49:06,376][177119] Avg episode reward: [(0, '14.337')] [2023-02-24 18:49:06,608][177158] DAMAGECOUNT value on done: 201770.0 [2023-02-24 18:49:06,608][177158] Sum rewards: 7.998, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.982', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.016', 'weapon5': '0.122', 'AMMO3': '0.134', 'WEAPON5': '0.150', 'weapon2': '0.790', 'WEAPON3': '0.850', 'HITCOUNT': '1.010', 'weapon3': '1.738', 'DAMAGECOUNT': '3.912', 'FRAGCOUNT': '8.000'} [2023-02-24 18:49:07,664][177153] Updated weights for policy 0, policy_version 17640 (0.0008) [2023-02-24 18:49:08,316][177172] DAMAGECOUNT value on done: 198978.0 [2023-02-24 18:49:08,317][177172] Sum rewards: 16.964, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.600', 'AMMO5': '0.004', 'AMMO2': '0.019', 'weapon5': '0.024', 'weapon7': '0.084', 'AMMO3': '0.087', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.540', 'WEAPON3': '0.650', 'weapon2': '0.746', 'HITCOUNT': '1.250', 'weapon3': '1.736', 'DAMAGECOUNT': '4.191', 'FRAGCOUNT': '13.000'} [2023-02-24 18:49:08,619][177172] DAMAGECOUNT value on done: 194708.0 [2023-02-24 18:49:08,619][177172] Sum rewards: 19.155, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.725', 'AMMO2': '0.018', 'AMMO5': '0.019', 'AMMO4': '0.091', 'AMMO3': '0.097', 'weapon5': '0.156', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.588', 'WEAPON3': '0.700', 'weapon2': '1.246', 'HITCOUNT': '1.720', 'weapon3': '1.772', 'DAMAGECOUNT': '6.423', 'FRAGCOUNT': '15.500'} [2023-02-24 18:49:10,156][177158] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 18:49:10,250][177154] DAMAGECOUNT value on done: 199967.0 [2023-02-24 18:49:10,250][177154] Sum rewards: 17.880, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.086', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.145', 'AMMO4': '0.145', 'weapon5': '0.224', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.446', 'WEAPON3': '0.850', 'weapon2': '0.928', 'HITCOUNT': '1.080', 'weapon3': '2.032', 'DAMAGECOUNT': '4.248', 'FRAGCOUNT': '16.500'} [2023-02-24 18:49:10,378][177172] DAMAGECOUNT value on done: 197417.0 [2023-02-24 18:49:10,378][177172] Sum rewards: 4.781, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.264', 'AMMO2': '0.002', 'AMMO4': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'WEAPON4': '0.100', 'AMMO3': '0.143', 'weapon4': '0.188', 'weapon5': '0.192', 'WEAPON5': '0.450', 'HITCOUNT': '0.830', 'WEAPON3': '0.950', 'weapon2': '1.090', 'weapon3': '2.146', 'DAMAGECOUNT': '2.919', 'FRAGCOUNT': '6.000'} [2023-02-24 18:49:10,552][177154] DAMAGECOUNT value on done: 203133.0 [2023-02-24 18:49:10,553][177154] Sum rewards: 14.849, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.460', 'AMMO4': '-0.018', 'AMMO2': '-0.003', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'AMMO3': '0.078', 'weapon5': '0.144', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.620', 'ARMOR': '0.960', 'weapon2': '1.492', 'weapon3': '1.550', 'DAMAGECOUNT': '2.976', 'FRAGCOUNT': '11.000'} [2023-02-24 18:49:10,626][177153] Updated weights for policy 0, policy_version 17650 (0.0008) [2023-02-24 18:49:10,672][177172] DAMAGECOUNT value on done: 198263.0 [2023-02-24 18:49:10,672][177172] Sum rewards: 19.937, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.580', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.024', 'weapon4': '0.040', 'WEAPON1': '0.050', 'AMMO3': '0.119', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'weapon5': '0.324', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'HITCOUNT': '1.040', 'weapon2': '1.362', 'weapon3': '1.898', 'DAMAGECOUNT': '5.565', 'FRAGCOUNT': '16.000'} [2023-02-24 18:49:10,861][177154] DAMAGECOUNT value on done: 208952.0 [2023-02-24 18:49:10,862][177154] Sum rewards: 24.235, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.880', 'AMMO5': '0.015', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon7': '0.058', 'AMMO4': '0.094', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'ARMOR': '0.455', 'WEAPON3': '0.700', 'weapon4': '0.734', 'weapon2': '0.994', 'HITCOUNT': '1.510', 'weapon3': '1.550', 'DAMAGECOUNT': '6.177', 'FRAGCOUNT': '18.000'} [2023-02-24 18:49:11,011][177157] DAMAGECOUNT value on done: 203995.0 [2023-02-24 18:49:11,012][177157] Sum rewards: 24.288, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.052', 'AMMO2': '0.013', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.066', 'AMMO3': '0.134', 'WEAPON4': '0.200', 'weapon5': '0.210', 'weapon4': '0.218', 'WEAPON5': '0.400', 'WEAPON3': '0.950', 'weapon2': '1.008', 'HITCOUNT': '1.540', 'weapon3': '2.244', 'DAMAGECOUNT': '6.801', 'FRAGCOUNT': '23.000'} [2023-02-24 18:49:11,069][177157] DAMAGECOUNT value on done: 188041.0 [2023-02-24 18:49:11,070][177157] Sum rewards: 15.710, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.283', 'AMMO2': '0.013', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.116', 'weapon5': '0.220', 'weapon4': '0.222', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'weapon2': '0.894', 'HITCOUNT': '1.000', 'weapon3': '2.346', 'DAMAGECOUNT': '4.530', 'FRAGCOUNT': '12.500'} [2023-02-24 18:49:11,159][177154] DAMAGECOUNT value on done: 204334.0 [2023-02-24 18:49:11,159][177154] Sum rewards: 14.366, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.388', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.017', 'WEAPON1': '0.020', 'weapon7': '0.052', 'AMMO3': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.226', 'weapon4': '0.282', 'WEAPON5': '0.400', 'ARMOR': '0.470', 'WEAPON3': '0.750', 'weapon2': '1.002', 'HITCOUNT': '1.090', 'weapon3': '1.588', 'DAMAGECOUNT': '4.344', 'FRAGCOUNT': '13.000'} [2023-02-24 18:49:11,325][177157] DAMAGECOUNT value on done: 193534.0 [2023-02-24 18:49:11,325][177157] Sum rewards: 16.048, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.393', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.035', 'AMMO3': '0.099', 'AMMO4': '0.174', 'weapon5': '0.408', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon4': '0.574', 'WEAPON3': '0.650', 'weapon2': '0.768', 'HITCOUNT': '0.920', 'weapon3': '1.652', 'DAMAGECOUNT': '5.586', 'FRAGCOUNT': '16.000'} [2023-02-24 18:49:11,344][177171] DAMAGECOUNT value on done: 192523.0 [2023-02-24 18:49:11,344][177171] Sum rewards: 14.035, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.426', 'AMMO5': '0.024', 'WEAPON1': '0.030', 'AMMO2': '0.044', 'AMMO3': '0.110', 'AMMO4': '0.220', 'weapon4': '0.286', 'weapon5': '0.328', 'WEAPON4': '0.400', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'HITCOUNT': '0.950', 'weapon2': '1.258', 'weapon3': '1.706', 'DAMAGECOUNT': '4.554', 'FRAGCOUNT': '14.000'} [2023-02-24 18:49:11,375][177157] DAMAGECOUNT value on done: 191554.0 [2023-02-24 18:49:11,375][177157] Sum rewards: 13.399, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.850', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.015', 'AMMO4': '0.053', 'AMMO3': '0.116', 'weapon5': '0.228', 'WEAPON4': '0.250', 'weapon4': '0.310', 'WEAPON5': '0.400', 'ARMOR': '0.500', 'WEAPON3': '0.850', 'weapon2': '0.910', 'HITCOUNT': '1.150', 'weapon3': '2.034', 'DAMAGECOUNT': '4.662', 'FRAGCOUNT': '12.000'} [2023-02-24 18:49:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13843.1). Total num frames: 72302592. Throughput: 0: 3455.6. Samples: 18073246. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 18:49:11,376][177119] Avg episode reward: [(0, '14.758')] [2023-02-24 18:49:11,647][177171] DAMAGECOUNT value on done: 195687.0 [2023-02-24 18:49:11,647][177171] Sum rewards: 16.042, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.868', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'weapon7': '0.052', 'weapon5': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.147', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '1.000', 'HITCOUNT': '1.330', 'weapon3': '1.634', 'weapon2': '1.802', 'DAMAGECOUNT': '5.055', 'FRAGCOUNT': '15.000'} [2023-02-24 18:49:11,657][177171] DAMAGECOUNT value on done: 200335.0 [2023-02-24 18:49:11,657][177171] Sum rewards: 15.623, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.042', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO3': '0.078', 'weapon5': '0.086', 'weapon7': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.320', 'WEAPON3': '0.500', 'HITCOUNT': '0.790', 'weapon3': '1.388', 'weapon2': '1.772', 'DAMAGECOUNT': '4.557', 'FRAGCOUNT': '12.000'} [2023-02-24 18:49:11,954][177171] DAMAGECOUNT value on done: 195584.0 [2023-02-24 18:49:11,955][177171] Sum rewards: 22.165, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.248', 'AMMO2': '0.023', 'AMMO5': '0.027', 'WEAPON1': '0.030', 'weapon4': '0.104', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon5': '0.234', 'WEAPON5': '0.450', 'weapon2': '1.084', 'WEAPON3': '1.150', 'HITCOUNT': '1.490', 'weapon3': '2.234', 'DAMAGECOUNT': '6.642', 'FRAGCOUNT': '21.000'} [2023-02-24 18:49:12,814][177155] DAMAGECOUNT value on done: 196257.0 [2023-02-24 18:49:12,815][177155] Sum rewards: 11.667, reward structure: {'DEATHCOUNT': '-6.750', 'WEAPON1': '0.010', 'HEALTH': '0.017', 'AMMO2': '0.026', 'AMMO5': '0.027', 'AMMO3': '0.093', 'AMMO4': '0.128', 'WEAPON4': '0.300', 'weapon5': '0.382', 'WEAPON5': '0.500', 'weapon2': '0.512', 'WEAPON3': '0.550', 'weapon4': '0.604', 'HITCOUNT': '0.970', 'ARMOR': '1.286', 'weapon3': '1.364', 'DAMAGECOUNT': '3.648', 'FRAGCOUNT': '8.000'} [2023-02-24 18:49:13,117][177155] DAMAGECOUNT value on done: 203954.0 [2023-02-24 18:49:13,118][177155] Sum rewards: 10.629, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.653', 'AMMO5': '0.015', 'AMMO2': '0.023', 'AMMO3': '0.065', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.114', 'weapon5': '0.134', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.548', 'HITCOUNT': '0.830', 'weapon3': '1.242', 'weapon2': '1.628', 'DAMAGECOUNT': '3.483', 'FRAGCOUNT': '9.000'} [2023-02-24 18:49:13,500][177155] DAMAGECOUNT value on done: 205467.0 [2023-02-24 18:49:13,500][177155] Sum rewards: 0.993, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.432', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'AMMO3': '0.054', 'weapon5': '0.116', 'AMMO4': '0.121', 'WEAPON5': '0.200', 'WEAPON3': '0.400', 'WEAPON4': '0.550', 'HITCOUNT': '0.600', 'ARMOR': '0.890', 'weapon3': '0.920', 'weapon4': '0.940', 'weapon2': '1.148', 'DAMAGECOUNT': '1.944', 'FRAGCOUNT': '2.000'} [2023-02-24 18:49:13,600][177153] Updated weights for policy 0, policy_version 17660 (0.0008) [2023-02-24 18:49:13,798][177155] DAMAGECOUNT value on done: 192022.0 [2023-02-24 18:49:13,798][177155] Sum rewards: 19.636, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.289', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.040', 'AMMO4': '0.063', 'AMMO3': '0.082', 'weapon5': '0.166', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'weapon4': '0.706', 'weapon2': '0.840', 'ARMOR': '0.860', 'HITCOUNT': '1.090', 'weapon3': '1.806', 'DAMAGECOUNT': '4.899', 'FRAGCOUNT': '12.000'} [2023-02-24 18:49:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 72372224. Throughput: 0: 3456.0. Samples: 18093984. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 18:49:16,376][177119] Avg episode reward: [(0, '14.708')] [2023-02-24 18:49:16,551][177153] Updated weights for policy 0, policy_version 17670 (0.0008) [2023-02-24 18:49:19,501][177153] Updated weights for policy 0, policy_version 17680 (0.0008) [2023-02-24 18:49:21,236][177156] DAMAGECOUNT value on done: 199122.0 [2023-02-24 18:49:21,237][177156] Sum rewards: 10.331, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.732', 'AMMO2': '0.015', 'AMMO5': '0.025', 'WEAPON4': '0.050', 'weapon7': '0.054', 'WEAPON1': '0.060', 'AMMO4': '0.075', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.128', 'weapon5': '0.128', 'weapon4': '0.208', 'WEAPON5': '0.600', 'weapon2': '0.692', 'HITCOUNT': '0.880', 'WEAPON3': '0.900', 'weapon3': '1.722', 'DAMAGECOUNT': '3.726', 'FRAGCOUNT': '10.000'} [2023-02-24 18:49:21,290][177156] DAMAGECOUNT value on done: 195436.0 [2023-02-24 18:49:21,290][177156] Sum rewards: 10.731, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.490', 'AMMO2': '0.016', 'AMMO5': '0.035', 'weapon7': '0.064', 'weapon4': '0.072', 'WEAPON1': '0.080', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.150', 'weapon5': '0.198', 'WEAPON7': '0.200', 'WEAPON5': '0.750', 'HITCOUNT': '0.930', 'WEAPON3': '0.950', 'weapon2': '0.998', 'weapon3': '2.342', 'DAMAGECOUNT': '4.764', 'FRAGCOUNT': '10.000'} [2023-02-24 18:49:21,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 72441856. Throughput: 0: 3458.0. Samples: 18104464. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:49:21,376][177119] Avg episode reward: [(0, '14.666')] [2023-02-24 18:49:21,540][177156] DAMAGECOUNT value on done: 203338.0 [2023-02-24 18:49:21,540][177156] Sum rewards: 17.551, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.128', 'AMMO2': '0.007', 'AMMO5': '0.023', 'AMMO4': '0.035', 'WEAPON1': '0.050', 'AMMO3': '0.138', 'WEAPON4': '0.200', 'weapon5': '0.230', 'weapon4': '0.414', 'WEAPON5': '0.550', 'WEAPON3': '0.950', 'weapon2': '0.976', 'HITCOUNT': '1.400', 'weapon3': '1.906', 'DAMAGECOUNT': '5.799', 'FRAGCOUNT': '16.000'} [2023-02-24 18:49:21,603][177156] DAMAGECOUNT value on done: 195653.0 [2023-02-24 18:49:21,603][177156] Sum rewards: 14.638, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.099', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'AMMO3': '0.126', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'weapon5': '0.150', 'weapon4': '0.302', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'weapon2': '0.846', 'HITCOUNT': '1.120', 'weapon3': '2.070', 'DAMAGECOUNT': '3.966', 'FRAGCOUNT': '14.000'} [2023-02-24 18:49:22,465][177153] Updated weights for policy 0, policy_version 17690 (0.0008) [2023-02-24 18:49:22,781][177170] DAMAGECOUNT value on done: 200290.0 [2023-02-24 18:49:22,781][177170] Sum rewards: 18.231, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.066', 'AMMO2': '0.016', 'AMMO5': '0.022', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.080', 'AMMO3': '0.110', 'weapon4': '0.160', 'weapon5': '0.210', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'weapon2': '1.100', 'HITCOUNT': '1.120', 'weapon3': '2.154', 'DAMAGECOUNT': '4.974', 'FRAGCOUNT': '16.000'} [2023-02-24 18:49:23,078][177170] DAMAGECOUNT value on done: 205695.0 [2023-02-24 18:49:23,079][177170] Sum rewards: 18.386, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.098', 'AMMO2': '0.020', 'AMMO5': '0.030', 'WEAPON1': '0.050', 'AMMO4': '0.100', 'AMMO3': '0.143', 'weapon5': '0.260', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon4': '0.670', 'WEAPON5': '0.700', 'weapon2': '0.700', 'WEAPON3': '0.900', 'HITCOUNT': '1.360', 'weapon3': '1.732', 'DAMAGECOUNT': '6.069', 'FRAGCOUNT': '16.500'} [2023-02-24 18:49:23,445][177170] DAMAGECOUNT value on done: 197258.0 [2023-02-24 18:49:23,445][177170] Sum rewards: 1.526, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.354', 'AMMO5': '0.025', 'WEAPON1': '0.030', 'AMMO2': '0.042', 'AMMO3': '0.170', 'AMMO4': '0.208', 'weapon5': '0.238', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon4': '0.486', 'WEAPON5': '0.550', 'HITCOUNT': '0.700', 'WEAPON3': '0.950', 'weapon2': '0.996', 'weapon3': '1.638', 'DAMAGECOUNT': '2.847', 'FRAGCOUNT': '6.000'} [2023-02-24 18:49:23,747][177170] DAMAGECOUNT value on done: 194401.0 [2023-02-24 18:49:23,747][177170] Sum rewards: 9.190, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.790', 'AMMO2': '0.010', 'AMMO5': '0.018', 'WEAPON1': '0.040', 'AMMO4': '0.050', 'weapon5': '0.084', 'AMMO3': '0.118', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'ARMOR': '0.470', 'weapon4': '0.634', 'weapon2': '0.752', 'WEAPON3': '0.800', 'HITCOUNT': '0.900', 'weapon3': '1.922', 'DAMAGECOUNT': '4.032', 'FRAGCOUNT': '9.500'} [2023-02-24 18:49:24,638][177158] DAMAGECOUNT value on done: 190522.0 [2023-02-24 18:49:24,639][177158] Sum rewards: 15.134, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.376', 'AMMO5': '0.015', 'AMMO2': '0.019', 'WEAPON1': '0.060', 'AMMO4': '0.097', 'AMMO3': '0.097', 'weapon5': '0.276', 'weapon4': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'HITCOUNT': '0.970', 'weapon2': '1.372', 'weapon3': '1.682', 'DAMAGECOUNT': '4.644', 'FRAGCOUNT': '13.000'} [2023-02-24 18:49:24,941][177158] DAMAGECOUNT value on done: 192202.0 [2023-02-24 18:49:24,941][177158] Sum rewards: 7.013, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.064', 'AMMO5': '0.016', 'AMMO2': '0.028', 'weapon7': '0.088', 'AMMO3': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.141', 'weapon5': '0.166', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.676', 'WEAPON3': '0.700', 'HITCOUNT': '0.860', 'weapon2': '0.988', 'weapon3': '1.608', 'DAMAGECOUNT': '3.009', 'FRAGCOUNT': '7.500'} [2023-02-24 18:49:25,421][177153] Updated weights for policy 0, policy_version 17700 (0.0009) [2023-02-24 18:49:25,679][177158] DAMAGECOUNT value on done: 201263.0 [2023-02-24 18:49:25,679][177158] Sum rewards: 21.032, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.834', 'AMMO2': '0.005', 'AMMO5': '0.022', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'WEAPON1': '0.080', 'weapon4': '0.114', 'AMMO3': '0.151', 'weapon5': '0.298', 'weapon2': '0.514', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'HITCOUNT': '1.460', 'weapon3': '2.646', 'DAMAGECOUNT': '5.949', 'FRAGCOUNT': '18.000'} [2023-02-24 18:49:25,979][177158] DAMAGECOUNT value on done: 202618.0 [2023-02-24 18:49:25,979][177158] Sum rewards: 8.093, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.455', 'AMMO5': '0.013', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.075', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'weapon5': '0.206', 'WEAPON5': '0.300', 'weapon4': '0.406', 'WEAPON3': '0.650', 'HITCOUNT': '0.750', 'weapon2': '1.054', 'weapon3': '1.756', 'DAMAGECOUNT': '2.544', 'FRAGCOUNT': '8.000'} [2023-02-24 18:49:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 72511488. Throughput: 0: 3458.2. Samples: 18125288. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:49:26,376][177119] Avg episode reward: [(0, '14.421')] [2023-02-24 18:49:27,659][177172] DAMAGECOUNT value on done: 199676.0 [2023-02-24 18:49:27,659][177172] Sum rewards: 2.538, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.864', 'AMMO2': '0.014', 'AMMO5': '0.014', 'AMMO4': '0.067', 'AMMO3': '0.079', 'weapon7': '0.102', 'weapon5': '0.130', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.242', 'WEAPON7': '0.300', 'HITCOUNT': '0.320', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon2': '0.624', 'weapon3': '0.826', 'DAMAGECOUNT': '2.094', 'FRAGCOUNT': '4.000'} [2023-02-24 18:49:27,948][177172] DAMAGECOUNT value on done: 196199.0 [2023-02-24 18:49:27,949][177172] Sum rewards: 11.102, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.112', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'AMMO4': '0.088', 'AMMO3': '0.089', 'WEAPON4': '0.150', 'weapon5': '0.168', 'WEAPON5': '0.200', 'weapon4': '0.328', 'ARMOR': '0.404', 'WEAPON3': '0.600', 'HITCOUNT': '1.040', 'weapon2': '1.086', 'weapon3': '1.328', 'DAMAGECOUNT': '4.428', 'FRAGCOUNT': '8.000'} [2023-02-24 18:49:28,369][177153] Updated weights for policy 0, policy_version 17710 (0.0008) [2023-02-24 18:49:29,613][177154] DAMAGECOUNT value on done: 200564.0 [2023-02-24 18:49:29,614][177154] Sum rewards: 7.421, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '0.000', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.040', 'weapon4': '0.040', 'WEAPON4': '0.050', 'weapon7': '0.058', 'AMMO4': '0.065', 'AMMO3': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.244', 'WEAPON5': '0.250', 'HITCOUNT': '0.330', 'WEAPON3': '0.450', 'weapon2': '1.002', 'weapon3': '1.202', 'DAMAGECOUNT': '1.791', 'FRAGCOUNT': '6.000'} [2023-02-24 18:49:29,720][177172] DAMAGECOUNT value on done: 199121.0 [2023-02-24 18:49:29,721][177172] Sum rewards: 13.873, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.777', 'AMMO2': '0.019', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.096', 'AMMO3': '0.101', 'weapon5': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon4': '0.522', 'WEAPON3': '0.750', 'ARMOR': '0.836', 'HITCOUNT': '1.120', 'weapon2': '1.420', 'weapon3': '1.574', 'DAMAGECOUNT': '5.112', 'FRAGCOUNT': '12.000'} [2023-02-24 18:49:29,911][177154] DAMAGECOUNT value on done: 204546.0 [2023-02-24 18:49:29,911][177154] Sum rewards: 12.710, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.700', 'AMMO2': '0.009', 'AMMO5': '0.019', 'WEAPON1': '0.030', 'AMMO4': '0.044', 'weapon4': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon5': '0.244', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'HITCOUNT': '0.860', 'weapon2': '1.584', 'weapon3': '1.830', 'DAMAGECOUNT': '4.239', 'FRAGCOUNT': '10.000'} [2023-02-24 18:49:30,024][177172] DAMAGECOUNT value on done: 199036.0 [2023-02-24 18:49:30,024][177172] Sum rewards: 5.348, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.056', 'AMMO2': '0.016', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'AMMO3': '0.068', 'AMMO4': '0.080', 'weapon5': '0.210', 'HITCOUNT': '0.400', 'ARMOR': '0.451', 'WEAPON3': '0.500', 'WEAPON4': '0.500', 'weapon4': '0.538', 'WEAPON5': '0.550', 'weapon3': '1.130', 'weapon2': '1.332', 'DAMAGECOUNT': '2.319', 'FRAGCOUNT': '6.000'} [2023-02-24 18:49:30,219][177154] DAMAGECOUNT value on done: 210495.0 [2023-02-24 18:49:30,220][177154] Sum rewards: 15.325, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.329', 'AMMO5': '0.017', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'AMMO3': '0.092', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'weapon4': '0.270', 'weapon5': '0.366', 'WEAPON5': '0.400', 'ARMOR': '0.453', 'WEAPON3': '0.550', 'HITCOUNT': '0.860', 'weapon2': '0.916', 'weapon3': '1.744', 'DAMAGECOUNT': '4.629', 'FRAGCOUNT': '11.000'} [2023-02-24 18:49:30,403][177157] DAMAGECOUNT value on done: 204885.0 [2023-02-24 18:49:30,404][177157] Sum rewards: 9.726, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.720', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO3': '0.047', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon7': '0.056', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.128', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'weapon3': '0.608', 'HITCOUNT': '0.720', 'weapon2': '1.054', 'DAMAGECOUNT': '2.670', 'FRAGCOUNT': '8.000'} [2023-02-24 18:49:30,473][177157] DAMAGECOUNT value on done: 190211.0 [2023-02-24 18:49:30,473][177157] Sum rewards: 16.341, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.332', 'AMMO5': '0.017', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'AMMO4': '0.096', 'weapon4': '0.106', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.276', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'HITCOUNT': '1.150', 'weapon2': '1.362', 'weapon3': '1.856', 'DAMAGECOUNT': '6.510', 'FRAGCOUNT': '15.000'} [2023-02-24 18:49:30,521][177154] DAMAGECOUNT value on done: 206319.0 [2023-02-24 18:49:30,522][177154] Sum rewards: 18.095, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.498', 'AMMO2': '0.020', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'AMMO4': '0.098', 'AMMO3': '0.170', 'weapon5': '0.176', 'weapon2': '0.324', 'ARMOR': '0.476', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.746', 'WEAPON3': '1.100', 'HITCOUNT': '1.370', 'weapon3': '2.106', 'DAMAGECOUNT': '5.955', 'FRAGCOUNT': '19.000'} [2023-02-24 18:49:30,726][177157] DAMAGECOUNT value on done: 194783.0 [2023-02-24 18:49:30,727][177157] Sum rewards: 6.887, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.898', 'AMMO5': '0.020', 'AMMO2': '0.023', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.166', 'weapon5': '0.208', 'weapon4': '0.326', 'WEAPON5': '0.500', 'weapon2': '0.536', 'HITCOUNT': '0.780', 'ARMOR': '0.800', 'WEAPON3': '1.150', 'weapon3': '2.276', 'DAMAGECOUNT': '3.747', 'FRAGCOUNT': '8.500'} [2023-02-24 18:49:30,758][177171] DAMAGECOUNT value on done: 193988.0 [2023-02-24 18:49:30,759][177171] Sum rewards: 11.521, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.538', 'WEAPON1': '0.010', 'AMMO5': '0.024', 'AMMO2': '0.027', 'AMMO3': '0.119', 'AMMO4': '0.136', 'WEAPON4': '0.200', 'weapon4': '0.338', 'weapon5': '0.362', 'ARMOR': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'HITCOUNT': '0.930', 'weapon2': '0.954', 'weapon3': '1.664', 'DAMAGECOUNT': '4.395', 'FRAGCOUNT': '11.000'} [2023-02-24 18:49:30,782][177157] DAMAGECOUNT value on done: 192535.0 [2023-02-24 18:49:30,782][177157] Sum rewards: 6.662, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.305', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon7': '0.050', 'weapon5': '0.056', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.510', 'WEAPON3': '0.650', 'weapon2': '0.724', 'HITCOUNT': '0.780', 'weapon3': '1.776', 'DAMAGECOUNT': '2.943', 'FRAGCOUNT': '6.000'} [2023-02-24 18:49:31,053][177171] DAMAGECOUNT value on done: 197329.0 [2023-02-24 18:49:31,054][177171] Sum rewards: 19.332, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.064', 'AMMO2': '0.009', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.043', 'AMMO3': '0.109', 'weapon7': '0.144', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.568', 'weapon2': '0.670', 'WEAPON3': '0.750', 'HITCOUNT': '1.200', 'weapon3': '1.974', 'DAMAGECOUNT': '4.926', 'FRAGCOUNT': '16.000'} [2023-02-24 18:49:31,063][177171] DAMAGECOUNT value on done: 201825.0 [2023-02-24 18:49:31,063][177171] Sum rewards: 19.404, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.182', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO5': '0.018', 'AMMO4': '0.064', 'AMMO3': '0.104', 'WEAPON4': '0.250', 'weapon5': '0.288', 'WEAPON5': '0.350', 'weapon4': '0.398', 'ARMOR': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '1.050', 'weapon2': '1.336', 'weapon3': '1.634', 'DAMAGECOUNT': '4.470', 'FRAGCOUNT': '16.000'} [2023-02-24 18:49:31,335][177153] Updated weights for policy 0, policy_version 17720 (0.0008) [2023-02-24 18:49:31,364][177171] DAMAGECOUNT value on done: 196711.0 [2023-02-24 18:49:31,365][177171] Sum rewards: 7.944, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.128', 'AMMO2': '0.023', 'AMMO5': '0.025', 'WEAPON1': '0.040', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.192', 'weapon5': '0.260', 'WEAPON5': '0.600', 'weapon2': '0.748', 'HITCOUNT': '0.870', 'WEAPON3': '1.150', 'weapon3': '2.488', 'DAMAGECOUNT': '3.381', 'FRAGCOUNT': '11.000'} [2023-02-24 18:49:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 72581120. Throughput: 0: 3459.2. Samples: 18146060. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:49:31,376][177119] Avg episode reward: [(0, '13.973')] [2023-02-24 18:49:32,158][177155] DAMAGECOUNT value on done: 198080.0 [2023-02-24 18:49:32,158][177155] Sum rewards: 16.796, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.000', 'AMMO5': '0.024', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'AMMO4': '0.128', 'AMMO3': '0.139', 'weapon5': '0.182', 'WEAPON4': '0.250', 'weapon4': '0.372', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.874', 'WEAPON3': '0.900', 'HITCOUNT': '1.200', 'weapon3': '2.052', 'DAMAGECOUNT': '5.469', 'FRAGCOUNT': '15.000'} [2023-02-24 18:49:32,462][177155] DAMAGECOUNT value on done: 205474.0 [2023-02-24 18:49:32,463][177155] Sum rewards: 14.014, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.038', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon7': '0.014', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.162', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'weapon4': '0.426', 'WEAPON3': '1.000', 'weapon2': '1.098', 'HITCOUNT': '1.170', 'weapon3': '1.850', 'DAMAGECOUNT': '4.560', 'FRAGCOUNT': '13.000'} [2023-02-24 18:49:32,858][177155] DAMAGECOUNT value on done: 206304.0 [2023-02-24 18:49:32,858][177155] Sum rewards: 7.755, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO3': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.108', 'weapon4': '0.198', 'WEAPON5': '0.200', 'WEAPON3': '0.500', 'HEALTH': '0.589', 'HITCOUNT': '0.670', 'weapon2': '0.924', 'weapon3': '1.514', 'DAMAGECOUNT': '2.511', 'FRAGCOUNT': '6.000'} [2023-02-24 18:49:33,160][177155] DAMAGECOUNT value on done: 193232.0 [2023-02-24 18:49:33,161][177155] Sum rewards: 15.492, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.430', 'AMMO2': '0.009', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'weapon7': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.113', 'weapon4': '0.206', 'weapon5': '0.280', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'HITCOUNT': '1.030', 'weapon2': '1.234', 'weapon3': '1.630', 'DAMAGECOUNT': '3.630', 'FRAGCOUNT': '13.000'} [2023-02-24 18:49:34,292][177153] Updated weights for policy 0, policy_version 17730 (0.0009) [2023-02-24 18:49:36,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 72650752. Throughput: 0: 3459.9. Samples: 18156490. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:49:36,376][177119] Avg episode reward: [(0, '13.759')] [2023-02-24 18:49:37,238][177153] Updated weights for policy 0, policy_version 17740 (0.0008) [2023-02-24 18:49:38,800][177157] Large shaping reward 2.598 for [('FRAGCOUNT', 3.0, 3.0), ('DEATHCOUNT', -0.75, 1.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.276, 92.0), ('HEALTH', 0.075, 15.0), ('WEAPON3', -0.05, -1.0), ('AMMO3', -0.003, -6.0)] [2023-02-24 18:49:40,175][177153] Updated weights for policy 0, policy_version 17750 (0.0008) [2023-02-24 18:49:40,638][177156] DAMAGECOUNT value on done: 200111.0 [2023-02-24 18:49:40,638][177156] Sum rewards: 7.105, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.143', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.062', 'AMMO3': '0.084', 'weapon7': '0.140', 'weapon5': '0.142', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.436', 'HITCOUNT': '0.470', 'WEAPON3': '0.500', 'weapon2': '1.016', 'weapon3': '1.216', 'DAMAGECOUNT': '2.967', 'FRAGCOUNT': '5.000'} [2023-02-24 18:49:40,726][177156] DAMAGECOUNT value on done: 197059.0 [2023-02-24 18:49:40,726][177156] Sum rewards: 15.520, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.084', 'WEAPON1': '0.020', 'AMMO5': '0.026', 'AMMO2': '0.029', 'AMMO3': '0.090', 'AMMO4': '0.145', 'weapon5': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.500', 'weapon4': '0.512', 'WEAPON3': '0.550', 'HITCOUNT': '1.010', 'weapon2': '1.146', 'weapon3': '1.638', 'DAMAGECOUNT': '4.869', 'FRAGCOUNT': '12.000'} [2023-02-24 18:49:40,945][177156] DAMAGECOUNT value on done: 205442.0 [2023-02-24 18:49:40,946][177156] Sum rewards: 18.577, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.862', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO2': '0.030', 'AMMO3': '0.133', 'AMMO4': '0.147', 'weapon5': '0.240', 'WEAPON4': '0.300', 'weapon4': '0.382', 'WEAPON5': '0.450', 'weapon2': '0.716', 'WEAPON3': '0.850', 'HITCOUNT': '1.470', 'weapon3': '2.114', 'DAMAGECOUNT': '6.312', 'FRAGCOUNT': '16.000'} [2023-02-24 18:49:41,040][177156] DAMAGECOUNT value on done: 196734.0 [2023-02-24 18:49:41,040][177156] Sum rewards: 10.053, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.760', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.050', 'AMMO3': '0.053', 'weapon7': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'weapon2': '0.216', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'ARMOR': '0.400', 'weapon4': '0.642', 'HITCOUNT': '0.870', 'weapon3': '1.168', 'DAMAGECOUNT': '3.243', 'FRAGCOUNT': '8.000'} [2023-02-24 18:49:41,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 72716288. Throughput: 0: 3463.9. Samples: 18177334. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:49:41,376][177119] Avg episode reward: [(0, '13.791')] [2023-02-24 18:49:42,099][177170] DAMAGECOUNT value on done: 201752.0 [2023-02-24 18:49:42,099][177170] Sum rewards: 9.274, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.647', 'AMMO2': '0.010', 'AMMO5': '0.015', 'weapon7': '0.048', 'AMMO4': '0.050', 'weapon5': '0.110', 'AMMO3': '0.130', 'WEAPON4': '0.250', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.372', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '0.950', 'weapon2': '1.358', 'weapon3': '1.542', 'DAMAGECOUNT': '4.386', 'FRAGCOUNT': '11.000'} [2023-02-24 18:49:42,405][177170] DAMAGECOUNT value on done: 207490.0 [2023-02-24 18:49:42,406][177170] Sum rewards: 10.877, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.686', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO2': '0.028', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.122', 'AMMO4': '0.138', 'AMMO3': '0.181', 'weapon5': '0.214', 'WEAPON4': '0.350', 'weapon2': '0.388', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.804', 'WEAPON3': '1.100', 'HITCOUNT': '1.310', 'weapon3': '1.848', 'DAMAGECOUNT': '5.385', 'FRAGCOUNT': '12.000'} [2023-02-24 18:49:42,773][177170] DAMAGECOUNT value on done: 198592.0 [2023-02-24 18:49:42,773][177170] Sum rewards: 8.270, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.420', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'weapon5': '0.088', 'AMMO3': '0.144', 'WEAPON5': '0.350', 'WEAPON3': '0.950', 'HITCOUNT': '0.980', 'weapon2': '1.520', 'weapon3': '1.912', 'DAMAGECOUNT': '4.002', 'FRAGCOUNT': '8.000'} [2023-02-24 18:49:43,032][177172] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 18:49:43,069][177170] DAMAGECOUNT value on done: 196814.0 [2023-02-24 18:49:43,070][177170] Sum rewards: 23.639, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.112', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'weapon5': '0.140', 'AMMO3': '0.142', 'AMMO4': '0.163', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.558', 'weapon2': '0.962', 'WEAPON3': '1.000', 'HITCOUNT': '1.700', 'weapon3': '1.924', 'DAMAGECOUNT': '7.239', 'FRAGCOUNT': '20.000'} [2023-02-24 18:49:43,136][177153] Updated weights for policy 0, policy_version 17760 (0.0008) [2023-02-24 18:49:43,938][177158] DAMAGECOUNT value on done: 192214.0 [2023-02-24 18:49:43,939][177158] Sum rewards: 16.879, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.756', 'AMMO2': '0.016', 'AMMO5': '0.016', 'WEAPON1': '0.030', 'weapon7': '0.046', 'AMMO4': '0.078', 'AMMO3': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.188', 'WEAPON7': '0.200', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon4': '0.798', 'weapon2': '1.018', 'HITCOUNT': '1.230', 'weapon3': '1.400', 'DAMAGECOUNT': '5.040', 'FRAGCOUNT': '15.000'} [2023-02-24 18:49:44,238][177158] DAMAGECOUNT value on done: 193659.0 [2023-02-24 18:49:44,238][177158] Sum rewards: 11.295, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.670', 'AMMO5': '0.015', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon7': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.218', 'weapon4': '0.226', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.790', 'weapon2': '1.220', 'weapon3': '1.762', 'DAMAGECOUNT': '4.371', 'FRAGCOUNT': '10.000'} [2023-02-24 18:49:44,989][177158] DAMAGECOUNT value on done: 202412.0 [2023-02-24 18:49:44,989][177158] Sum rewards: 15.083, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.214', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'weapon7': '0.052', 'AMMO3': '0.065', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.170', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.450', 'HITCOUNT': '0.930', 'weapon3': '1.356', 'weapon2': '1.896', 'DAMAGECOUNT': '3.447', 'FRAGCOUNT': '10.000'} [2023-02-24 18:49:45,292][177158] DAMAGECOUNT value on done: 203873.0 [2023-02-24 18:49:45,293][177158] Sum rewards: 10.127, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.300', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'AMMO3': '0.090', 'weapon7': '0.112', 'weapon5': '0.118', 'AMMO4': '0.182', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.440', 'WEAPON3': '0.600', 'weapon2': '0.642', 'HITCOUNT': '0.840', 'weapon3': '1.124', 'DAMAGECOUNT': '3.765', 'FRAGCOUNT': '11.000'} [2023-02-24 18:49:46,111][177153] Updated weights for policy 0, policy_version 17770 (0.0009) [2023-02-24 18:49:46,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 72785920. Throughput: 0: 3466.0. Samples: 18198138. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:49:46,376][177119] Avg episode reward: [(0, '13.779')] [2023-02-24 18:49:47,130][177172] DAMAGECOUNT value on done: 201200.0 [2023-02-24 18:49:47,130][177172] Sum rewards: 14.293, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.042', 'AMMO2': '0.002', 'AMMO5': '0.010', 'AMMO4': '0.011', 'WEAPON4': '0.050', 'AMMO3': '0.125', 'weapon5': '0.152', 'weapon4': '0.196', 'WEAPON5': '0.250', 'WEAPON3': '0.900', 'HITCOUNT': '0.980', 'weapon2': '1.248', 'weapon3': '2.088', 'DAMAGECOUNT': '4.572', 'FRAGCOUNT': '13.000'} [2023-02-24 18:49:47,426][177172] DAMAGECOUNT value on done: 197822.0 [2023-02-24 18:49:47,427][177172] Sum rewards: 10.600, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.947', 'WEAPON1': '0.010', 'AMMO5': '0.024', 'AMMO2': '0.034', 'AMMO3': '0.105', 'AMMO4': '0.168', 'weapon5': '0.262', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon2': '0.620', 'weapon4': '0.640', 'WEAPON3': '0.750', 'HITCOUNT': '1.000', 'weapon3': '2.080', 'DAMAGECOUNT': '4.854', 'FRAGCOUNT': '10.500'} [2023-02-24 18:49:48,980][177154] DAMAGECOUNT value on done: 201495.0 [2023-02-24 18:49:48,981][177154] Sum rewards: 6.036, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.322', 'AMMO5': '0.005', 'AMMO2': '0.035', 'AMMO3': '0.046', 'weapon5': '0.046', 'weapon7': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.173', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'WEAPON4': '0.300', 'ARMOR': '0.412', 'HITCOUNT': '0.460', 'weapon3': '0.610', 'weapon2': '0.786', 'weapon4': '1.002', 'DAMAGECOUNT': '2.793', 'FRAGCOUNT': '4.000'} [2023-02-24 18:49:49,100][177153] Updated weights for policy 0, policy_version 17780 (0.0008) [2023-02-24 18:49:49,171][177172] DAMAGECOUNT value on done: 201001.0 [2023-02-24 18:49:49,172][177172] Sum rewards: 19.125, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.419', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon5': '0.154', 'weapon4': '0.164', 'WEAPON5': '0.300', 'WEAPON3': '0.800', 'HITCOUNT': '1.200', 'weapon2': '1.330', 'weapon3': '2.124', 'DAMAGECOUNT': '5.640', 'FRAGCOUNT': '15.000'} [2023-02-24 18:49:49,275][177154] DAMAGECOUNT value on done: 206084.0 [2023-02-24 18:49:49,275][177154] Sum rewards: 16.182, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.268', 'AMMO5': '0.028', 'AMMO2': '0.038', 'WEAPON1': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'weapon5': '0.176', 'AMMO4': '0.190', 'weapon4': '0.298', 'weapon2': '0.356', 'ARMOR': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'HITCOUNT': '1.150', 'weapon3': '2.686', 'DAMAGECOUNT': '4.614', 'FRAGCOUNT': '16.000'} [2023-02-24 18:49:49,471][177172] DAMAGECOUNT value on done: 200584.0 [2023-02-24 18:49:49,472][177172] Sum rewards: 15.993, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.075', 'AMMO5': '0.005', 'AMMO2': '0.006', 'ARMOR': '0.008', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'weapon4': '0.066', 'weapon5': '0.124', 'AMMO3': '0.126', 'WEAPON5': '0.200', 'WEAPON3': '1.000', 'HITCOUNT': '1.220', 'weapon2': '1.418', 'weapon3': '2.172', 'DAMAGECOUNT': '4.644', 'FRAGCOUNT': '16.000'} [2023-02-24 18:49:49,573][177154] DAMAGECOUNT value on done: 212598.0 [2023-02-24 18:49:49,573][177154] Sum rewards: 22.375, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.294', 'AMMO2': '0.002', 'AMMO4': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'weapon7': '0.064', 'AMMO3': '0.086', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon5': '0.186', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.296', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '1.220', 'weapon2': '1.468', 'weapon3': '1.732', 'DAMAGECOUNT': '6.309', 'FRAGCOUNT': '17.000'} [2023-02-24 18:49:49,782][177157] DAMAGECOUNT value on done: 205288.0 [2023-02-24 18:49:49,782][177157] Sum rewards: 0.749, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.120', 'AMMO5': '0.004', 'ARMOR': '0.004', 'AMMO2': '0.011', 'weapon5': '0.038', 'AMMO4': '0.055', 'AMMO3': '0.056', 'WEAPON5': '0.100', 'weapon7': '0.164', 'HITCOUNT': '0.190', 'WEAPON3': '0.300', 'WEAPON4': '0.300', 'AMMO6': '0.440', 'AMMO7': '0.440', 'weapon3': '0.464', 'weapon2': '0.484', 'weapon4': '0.510', 'WEAPON7': '0.600', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.209'} [2023-02-24 18:49:49,818][177157] DAMAGECOUNT value on done: 191689.0 [2023-02-24 18:49:49,819][177157] Sum rewards: 15.105, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.204', 'AMMO5': '0.012', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.070', 'AMMO3': '0.090', 'weapon7': '0.094', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.222', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'weapon5': '0.304', 'WEAPON3': '0.550', 'HITCOUNT': '0.900', 'weapon2': '1.390', 'weapon3': '1.518', 'DAMAGECOUNT': '4.434', 'FRAGCOUNT': '12.000'} [2023-02-24 18:49:49,866][177154] DAMAGECOUNT value on done: 207746.0 [2023-02-24 18:49:49,866][177154] Sum rewards: 11.950, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.020', 'AMMO2': '0.027', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.148', 'weapon5': '0.162', 'HEALTH': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.462', 'WEAPON3': '0.800', 'ARMOR': '0.851', 'weapon2': '0.868', 'HITCOUNT': '0.980', 'weapon3': '1.564', 'DAMAGECOUNT': '4.281', 'FRAGCOUNT': '11.000'} [2023-02-24 18:49:50,089][177157] DAMAGECOUNT value on done: 196454.0 [2023-02-24 18:49:50,089][177157] Sum rewards: 17.826, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.570', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.034', 'AMMO3': '0.113', 'weapon5': '0.126', 'AMMO4': '0.168', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon4': '0.460', 'WEAPON3': '0.700', 'HITCOUNT': '1.230', 'weapon2': '1.378', 'weapon3': '1.734', 'DAMAGECOUNT': '5.013', 'FRAGCOUNT': '14.000'} [2023-02-24 18:49:50,096][177171] DAMAGECOUNT value on done: 194776.0 [2023-02-24 18:49:50,097][177171] Sum rewards: 4.410, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.628', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO4': '0.067', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.123', 'WEAPON4': '0.200', 'weapon5': '0.212', 'weapon4': '0.432', 'ARMOR': '0.497', 'HITCOUNT': '0.520', 'WEAPON5': '0.550', 'weapon2': '0.586', 'WEAPON3': '0.800', 'weapon3': '1.264', 'DAMAGECOUNT': '2.364', 'FRAGCOUNT': '7.000'} [2023-02-24 18:49:50,125][177157] DAMAGECOUNT value on done: 194055.0 [2023-02-24 18:49:50,126][177157] Sum rewards: 15.129, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.284', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.111', 'AMMO4': '0.126', 'weapon4': '0.174', 'WEAPON4': '0.200', 'weapon5': '0.308', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'HITCOUNT': '1.060', 'weapon2': '1.398', 'weapon3': '1.812', 'DAMAGECOUNT': '4.560', 'FRAGCOUNT': '14.000'} [2023-02-24 18:49:50,397][177171] DAMAGECOUNT value on done: 198650.0 [2023-02-24 18:49:50,397][177171] Sum rewards: 16.123, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'AMMO4': '0.110', 'weapon7': '0.124', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'HEALTH': '0.260', 'WEAPON3': '0.400', 'weapon4': '0.402', 'weapon2': '0.848', 'HITCOUNT': '1.020', 'weapon3': '1.412', 'DAMAGECOUNT': '3.963', 'FRAGCOUNT': '12.000'} [2023-02-24 18:49:50,407][177171] DAMAGECOUNT value on done: 203090.0 [2023-02-24 18:49:50,407][177171] Sum rewards: 10.955, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.548', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'ARMOR': '0.020', 'AMMO2': '0.028', 'AMMO3': '0.090', 'weapon7': '0.110', 'AMMO4': '0.139', 'weapon5': '0.192', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'WEAPON3': '0.600', 'weapon4': '0.754', 'HITCOUNT': '0.890', 'weapon2': '0.940', 'weapon3': '1.528', 'DAMAGECOUNT': '3.795', 'FRAGCOUNT': '9.000'} [2023-02-24 18:49:50,699][177171] DAMAGECOUNT value on done: 197725.0 [2023-02-24 18:49:50,700][177171] Sum rewards: 9.564, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'HEALTH': '0.026', 'AMMO3': '0.061', 'weapon5': '0.076', 'AMMO4': '0.106', 'weapon7': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.238', 'WEAPON7': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.850', 'weapon2': '1.252', 'weapon3': '1.254', 'DAMAGECOUNT': '3.042', 'FRAGCOUNT': '7.000'} [2023-02-24 18:49:51,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 72855552. Throughput: 0: 3467.3. Samples: 18208538. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:49:51,376][177119] Avg episode reward: [(0, '13.527')] [2023-02-24 18:49:51,559][177155] DAMAGECOUNT value on done: 199357.0 [2023-02-24 18:49:51,559][177155] Sum rewards: 10.551, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.169', 'AMMO5': '0.013', 'AMMO2': '0.020', 'weapon5': '0.086', 'AMMO4': '0.098', 'AMMO3': '0.144', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.416', 'ARMOR': '0.453', 'WEAPON3': '0.950', 'weapon2': '1.048', 'HITCOUNT': '1.100', 'weapon3': '2.210', 'DAMAGECOUNT': '3.831', 'FRAGCOUNT': '12.000'} [2023-02-24 18:49:51,857][177155] DAMAGECOUNT value on done: 207292.0 [2023-02-24 18:49:51,858][177155] Sum rewards: 19.605, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.481', 'AMMO2': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.038', 'ARMOR': '0.040', 'weapon7': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.124', 'weapon5': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.354', 'WEAPON3': '0.800', 'weapon2': '0.852', 'HITCOUNT': '1.410', 'weapon3': '2.156', 'DAMAGECOUNT': '5.454', 'FRAGCOUNT': '16.000'} [2023-02-24 18:49:51,974][177156] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:49:52,027][177153] Updated weights for policy 0, policy_version 17790 (0.0008) [2023-02-24 18:49:52,241][177155] DAMAGECOUNT value on done: 207304.0 [2023-02-24 18:49:52,242][177155] Sum rewards: 8.480, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.085', 'AMMO5': '0.009', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.095', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.115', 'weapon5': '0.140', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.632', 'WEAPON3': '0.800', 'HITCOUNT': '0.840', 'weapon2': '1.102', 'weapon3': '1.742', 'DAMAGECOUNT': '3.000', 'FRAGCOUNT': '7.000'} [2023-02-24 18:49:52,539][177155] DAMAGECOUNT value on done: 194002.0 [2023-02-24 18:49:52,539][177155] Sum rewards: 6.609, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.034', 'AMMO2': '0.018', 'AMMO5': '0.025', 'AMMO4': '0.089', 'AMMO3': '0.127', 'weapon5': '0.146', 'WEAPON4': '0.200', 'weapon4': '0.354', 'WEAPON5': '0.550', 'HITCOUNT': '0.570', 'WEAPON3': '0.750', 'weapon3': '1.498', 'weapon2': '1.506', 'DAMAGECOUNT': '2.310', 'FRAGCOUNT': '7.000'} [2023-02-24 18:49:53,379][177170] Large shaping reward 2.518 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.486, 162.0), ('weapon7', 0.002)] [2023-02-24 18:49:54,951][177153] Updated weights for policy 0, policy_version 17800 (0.0008) [2023-02-24 18:49:56,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13829.2). Total num frames: 72925184. Throughput: 0: 3470.8. Samples: 18229430. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:49:56,376][177119] Avg episode reward: [(0, '13.438')] [2023-02-24 18:49:57,874][177153] Updated weights for policy 0, policy_version 17810 (0.0008) [2023-02-24 18:50:00,099][177156] DAMAGECOUNT value on done: 201947.0 [2023-02-24 18:50:00,100][177156] Sum rewards: 19.682, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.947', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO4': '0.102', 'weapon5': '0.122', 'AMMO3': '0.131', 'WEAPON4': '0.200', 'weapon4': '0.276', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'HITCOUNT': '1.220', 'weapon2': '1.470', 'weapon3': '1.854', 'DAMAGECOUNT': '5.508', 'FRAGCOUNT': '19.000'} [2023-02-24 18:50:00,122][177156] DAMAGECOUNT value on done: 198056.0 [2023-02-24 18:50:00,122][177156] Sum rewards: 9.975, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.290', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.082', 'AMMO3': '0.095', 'weapon7': '0.108', 'AMMO4': '0.129', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.550', 'weapon4': '0.620', 'HITCOUNT': '0.670', 'weapon2': '0.806', 'weapon3': '1.438', 'DAMAGECOUNT': '2.991', 'FRAGCOUNT': '9.000'} [2023-02-24 18:50:00,409][177156] DAMAGECOUNT value on done: 207052.0 [2023-02-24 18:50:00,410][177156] Sum rewards: 15.576, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.944', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon5': '0.062', 'AMMO3': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.125', 'weapon7': '0.142', 'WEAPON7': '0.200', 'weapon4': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'weapon2': '1.216', 'HITCOUNT': '1.260', 'weapon3': '2.008', 'DAMAGECOUNT': '4.830', 'FRAGCOUNT': '13.000'} [2023-02-24 18:50:00,433][177156] DAMAGECOUNT value on done: 198445.0 [2023-02-24 18:50:00,433][177156] Sum rewards: 13.940, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.600', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.040', 'weapon7': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.476', 'weapon4': '0.646', 'WEAPON3': '0.650', 'HITCOUNT': '1.070', 'weapon3': '1.448', 'DAMAGECOUNT': '5.100', 'FRAGCOUNT': '11.000'} [2023-02-24 18:50:00,847][177153] Updated weights for policy 0, policy_version 17820 (0.0008) [2023-02-24 18:50:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13829.2). Total num frames: 72994816. Throughput: 0: 3472.4. Samples: 18250244. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:50:01,376][177119] Avg episode reward: [(0, '13.377')] [2023-02-24 18:50:01,450][177170] DAMAGECOUNT value on done: 203109.0 [2023-02-24 18:50:01,450][177170] Sum rewards: 17.761, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.060', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO4': '0.028', 'weapon7': '0.048', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'weapon5': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '1.060', 'weapon2': '1.474', 'weapon3': '1.668', 'DAMAGECOUNT': '4.071', 'FRAGCOUNT': '13.000'} [2023-02-24 18:50:01,751][177170] DAMAGECOUNT value on done: 208573.0 [2023-02-24 18:50:01,752][177170] Sum rewards: 13.574, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.330', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO3': '0.056', 'weapon7': '0.174', 'AMMO4': '0.197', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.232', 'WEAPON7': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.486', 'HITCOUNT': '0.640', 'weapon3': '1.120', 'weapon2': '1.356', 'DAMAGECOUNT': '3.249', 'FRAGCOUNT': '9.000'} [2023-02-24 18:50:02,092][177170] DAMAGECOUNT value on done: 199959.0 [2023-02-24 18:50:02,093][177170] Sum rewards: 14.544, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.849', 'AMMO5': '0.013', 'weapon5': '0.022', 'AMMO2': '0.027', 'AMMO3': '0.070', 'AMMO4': '0.133', 'WEAPON5': '0.250', 'weapon4': '0.268', 'WEAPON4': '0.350', 'WEAPON3': '0.500', 'weapon2': '0.838', 'HITCOUNT': '1.030', 'weapon3': '1.632', 'DAMAGECOUNT': '4.011', 'FRAGCOUNT': '13.000'} [2023-02-24 18:50:02,393][177170] DAMAGECOUNT value on done: 198339.0 [2023-02-24 18:50:02,394][177170] Sum rewards: 17.956, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.075', 'WEAPON4': '0.150', 'AMMO4': '0.177', 'WEAPON5': '0.200', 'weapon5': '0.208', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HEALTH': '0.468', 'weapon4': '0.542', 'HITCOUNT': '1.080', 'weapon3': '1.232', 'weapon2': '1.394', 'DAMAGECOUNT': '4.575', 'FRAGCOUNT': '13.000'} [2023-02-24 18:50:02,669][177157] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:50:03,279][177158] DAMAGECOUNT value on done: 193680.0 [2023-02-24 18:50:03,280][177158] Sum rewards: 12.307, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.379', 'AMMO5': '0.014', 'weapon5': '0.024', 'AMMO2': '0.039', 'AMMO3': '0.196', 'AMMO4': '0.196', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.446', 'weapon2': '0.538', 'WEAPON3': '1.200', 'HITCOUNT': '1.250', 'weapon3': '2.734', 'DAMAGECOUNT': '4.398', 'FRAGCOUNT': '14.000'} [2023-02-24 18:50:03,580][177158] DAMAGECOUNT value on done: 194786.0 [2023-02-24 18:50:03,580][177158] Sum rewards: 10.319, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.976', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.030', 'AMMO4': '0.038', 'weapon5': '0.052', 'AMMO3': '0.107', 'weapon7': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.412', 'weapon2': '0.624', 'WEAPON3': '0.700', 'HITCOUNT': '0.890', 'weapon3': '1.626', 'DAMAGECOUNT': '3.381', 'FRAGCOUNT': '9.000'} [2023-02-24 18:50:03,793][177153] Updated weights for policy 0, policy_version 17830 (0.0008) [2023-02-24 18:50:04,321][177158] DAMAGECOUNT value on done: 204002.0 [2023-02-24 18:50:04,322][177158] Sum rewards: 15.947, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.945', 'AMMO2': '0.012', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.061', 'weapon4': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.133', 'weapon5': '0.178', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '1.030', 'weapon3': '1.672', 'weapon2': '1.754', 'DAMAGECOUNT': '4.770', 'FRAGCOUNT': '13.000'} [2023-02-24 18:50:04,618][177158] DAMAGECOUNT value on done: 205328.0 [2023-02-24 18:50:04,619][177158] Sum rewards: 12.817, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.136', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.117', 'weapon5': '0.126', 'AMMO4': '0.165', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'ARMOR': '0.450', 'weapon2': '0.614', 'weapon4': '0.674', 'WEAPON3': '0.800', 'HITCOUNT': '1.030', 'weapon3': '1.358', 'DAMAGECOUNT': '4.365', 'FRAGCOUNT': '13.000'} [2023-02-24 18:50:06,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13829.2). Total num frames: 73064448. Throughput: 0: 3470.4. Samples: 18260630. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:50:06,376][177119] Avg episode reward: [(0, '13.295')] [2023-02-24 18:50:06,448][177172] DAMAGECOUNT value on done: 202471.0 [2023-02-24 18:50:06,449][177172] Sum rewards: 8.736, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.260', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'weapon5': '0.058', 'weapon4': '0.086', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'WEAPON5': '0.200', 'WEAPON3': '0.800', 'HITCOUNT': '0.930', 'weapon2': '1.242', 'weapon3': '2.254', 'DAMAGECOUNT': '3.813', 'FRAGCOUNT': '9.000'} [2023-02-24 18:50:06,751][177172] DAMAGECOUNT value on done: 199075.0 [2023-02-24 18:50:06,751][177172] Sum rewards: 12.626, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.243', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'weapon5': '0.154', 'WEAPON5': '0.250', 'weapon4': '0.456', 'weapon2': '0.458', 'WEAPON3': '0.700', 'HITCOUNT': '0.770', 'ARMOR': '0.869', 'weapon3': '1.624', 'DAMAGECOUNT': '3.759', 'FRAGCOUNT': '11.000'} [2023-02-24 18:50:06,760][177153] Updated weights for policy 0, policy_version 17840 (0.0008) [2023-02-24 18:50:08,292][177154] DAMAGECOUNT value on done: 202586.0 [2023-02-24 18:50:08,293][177154] Sum rewards: 5.544, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.030', 'AMMO2': '0.019', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.093', 'AMMO3': '0.157', 'weapon5': '0.180', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.470', 'ARMOR': '0.472', 'HITCOUNT': '0.690', 'WEAPON3': '0.950', 'weapon2': '1.146', 'weapon3': '1.784', 'DAMAGECOUNT': '3.273', 'FRAGCOUNT': '8.000'} [2023-02-24 18:50:08,504][177172] DAMAGECOUNT value on done: 201569.0 [2023-02-24 18:50:08,504][177172] Sum rewards: 3.137, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.576', 'AMMO5': '0.005', 'AMMO2': '0.037', 'AMMO3': '0.085', 'weapon5': '0.092', 'weapon7': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.184', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.430', 'ARMOR': '0.460', 'WEAPON3': '0.550', 'weapon4': '0.664', 'weapon3': '0.808', 'weapon2': '1.074', 'DAMAGECOUNT': '1.704', 'FRAGCOUNT': '4.000'} [2023-02-24 18:50:08,596][177154] DAMAGECOUNT value on done: 207111.0 [2023-02-24 18:50:08,597][177154] Sum rewards: 8.181, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.142', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'weapon4': '0.054', 'AMMO4': '0.087', 'AMMO3': '0.111', 'WEAPON4': '0.200', 'weapon5': '0.212', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.740', 'weapon3': '1.706', 'weapon2': '1.720', 'DAMAGECOUNT': '3.081', 'FRAGCOUNT': '7.000'} [2023-02-24 18:50:08,803][177172] DAMAGECOUNT value on done: 202124.0 [2023-02-24 18:50:08,804][177172] Sum rewards: 16.923, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.464', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon7': '0.076', 'weapon5': '0.108', 'AMMO3': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.185', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.540', 'WEAPON3': '0.700', 'weapon2': '0.700', 'HITCOUNT': '0.970', 'weapon3': '1.980', 'DAMAGECOUNT': '4.620', 'FRAGCOUNT': '16.000'} [2023-02-24 18:50:08,897][177154] DAMAGECOUNT value on done: 214537.0 [2023-02-24 18:50:08,898][177154] Sum rewards: 15.704, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.774', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.106', 'AMMO4': '0.148', 'WEAPON4': '0.250', 'weapon5': '0.258', 'WEAPON5': '0.450', 'weapon4': '0.548', 'WEAPON3': '0.700', 'weapon2': '1.008', 'HITCOUNT': '1.060', 'weapon3': '1.716', 'DAMAGECOUNT': '5.817', 'FRAGCOUNT': '13.000'} [2023-02-24 18:50:09,186][177157] DAMAGECOUNT value on done: 206593.0 [2023-02-24 18:50:09,186][177157] Sum rewards: 12.528, reward structure: {'DEATHCOUNT': '-9.000', 'ARMOR': '0.004', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO2': '0.030', 'AMMO3': '0.106', 'weapon5': '0.122', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'weapon4': '0.300', 'WEAPON5': '0.350', 'HEALTH': '0.410', 'WEAPON3': '0.600', 'HITCOUNT': '1.090', 'weapon2': '1.220', 'weapon3': '1.982', 'DAMAGECOUNT': '3.915', 'FRAGCOUNT': '11.000'} [2023-02-24 18:50:09,206][177154] DAMAGECOUNT value on done: 209347.0 [2023-02-24 18:50:09,207][177154] Sum rewards: 12.890, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.830', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.112', 'weapon5': '0.152', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.434', 'WEAPON3': '0.800', 'weapon2': '0.848', 'HITCOUNT': '1.120', 'weapon3': '2.164', 'DAMAGECOUNT': '4.803', 'FRAGCOUNT': '12.500'} [2023-02-24 18:50:09,227][177157] DAMAGECOUNT value on done: 192939.0 [2023-02-24 18:50:09,227][177157] Sum rewards: 12.556, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.552', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'AMMO3': '0.085', 'AMMO4': '0.142', 'weapon7': '0.166', 'weapon5': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'AMMO6': '0.420', 'AMMO7': '0.420', 'WEAPON7': '0.500', 'WEAPON3': '0.500', 'weapon4': '0.638', 'weapon2': '0.844', 'HITCOUNT': '0.960', 'weapon3': '1.616', 'DAMAGECOUNT': '3.750', 'FRAGCOUNT': '12.000'} [2023-02-24 18:50:09,362][177171] DAMAGECOUNT value on done: 195821.0 [2023-02-24 18:50:09,362][177171] Sum rewards: 9.031, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.406', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.045', 'weapon7': '0.054', 'weapon5': '0.064', 'AMMO3': '0.066', 'ARMOR': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.227', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'weapon4': '0.518', 'weapon2': '0.690', 'HITCOUNT': '0.760', 'weapon3': '1.142', 'DAMAGECOUNT': '3.135', 'FRAGCOUNT': '9.000'} [2023-02-24 18:50:09,498][177157] DAMAGECOUNT value on done: 197799.0 [2023-02-24 18:50:09,499][177157] Sum rewards: 15.402, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.352', 'AMMO2': '0.010', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.047', 'AMMO3': '0.097', 'weapon5': '0.228', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.790', 'weapon2': '1.726', 'weapon3': '1.726', 'DAMAGECOUNT': '4.035', 'FRAGCOUNT': '12.000'} [2023-02-24 18:50:09,536][177157] DAMAGECOUNT value on done: 195685.0 [2023-02-24 18:50:09,536][177157] Sum rewards: 19.197, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.616', 'AMMO2': '0.013', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.064', 'AMMO3': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.192', 'WEAPON7': '0.200', 'weapon5': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'ARMOR': '0.462', 'weapon2': '0.516', 'WEAPON3': '0.550', 'weapon4': '0.752', 'HITCOUNT': '0.890', 'weapon3': '1.222', 'DAMAGECOUNT': '4.794', 'FRAGCOUNT': '15.000'} [2023-02-24 18:50:09,629][177171] DAMAGECOUNT value on done: 199771.0 [2023-02-24 18:50:09,629][177171] Sum rewards: 13.187, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.210', 'ARMOR': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.085', 'AMMO4': '0.120', 'weapon7': '0.128', 'weapon5': '0.150', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'weapon4': '0.488', 'WEAPON3': '0.500', 'weapon2': '0.760', 'HITCOUNT': '0.770', 'weapon3': '1.624', 'DAMAGECOUNT': '3.363', 'FRAGCOUNT': '12.000'} [2023-02-24 18:50:09,668][177171] DAMAGECOUNT value on done: 205045.0 [2023-02-24 18:50:09,668][177171] Sum rewards: 16.182, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.295', 'AMMO2': '0.007', 'AMMO5': '0.017', 'AMMO4': '0.033', 'weapon5': '0.110', 'AMMO3': '0.199', 'WEAPON5': '0.350', 'weapon2': '1.014', 'HITCOUNT': '1.290', 'WEAPON3': '1.300', 'weapon3': '2.542', 'DAMAGECOUNT': '5.865', 'FRAGCOUNT': '17.000'} [2023-02-24 18:50:09,726][177153] Updated weights for policy 0, policy_version 17850 (0.0008) [2023-02-24 18:50:09,938][177171] DAMAGECOUNT value on done: 198549.0 [2023-02-24 18:50:09,938][177171] Sum rewards: 6.993, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.829', 'AMMO5': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO4': '0.076', 'AMMO3': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.228', 'WEAPON5': '0.250', 'weapon4': '0.420', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'weapon2': '0.688', 'weapon3': '1.390', 'DAMAGECOUNT': '2.472', 'FRAGCOUNT': '6.500'} [2023-02-24 18:50:10,952][177155] DAMAGECOUNT value on done: 200453.0 [2023-02-24 18:50:10,952][177155] Sum rewards: 13.261, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.920', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.083', 'weapon7': '0.174', 'WEAPON4': '0.200', 'weapon5': '0.234', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.396', 'WEAPON7': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '0.650', 'weapon2': '0.672', 'weapon3': '1.524', 'DAMAGECOUNT': '3.288', 'FRAGCOUNT': '11.000'} [2023-02-24 18:50:11,264][177155] DAMAGECOUNT value on done: 207687.0 [2023-02-24 18:50:11,264][177155] Sum rewards: 6.632, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.615', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.032', 'weapon7': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.208', 'HITCOUNT': '0.280', 'WEAPON3': '0.300', 'weapon3': '0.736', 'weapon2': '1.076', 'DAMAGECOUNT': '1.185', 'FRAGCOUNT': '4.000'} [2023-02-24 18:50:11,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.2, 300 sec: 13829.2). Total num frames: 73134080. Throughput: 0: 3469.7. Samples: 18281422. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:50:11,376][177119] Avg episode reward: [(0, '12.623')] [2023-02-24 18:50:11,639][177155] DAMAGECOUNT value on done: 209145.0 [2023-02-24 18:50:11,639][177155] Sum rewards: 18.200, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.999', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO3': '0.092', 'weapon4': '0.096', 'WEAPON4': '0.100', 'weapon5': '0.260', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'weapon2': '1.060', 'HITCOUNT': '1.340', 'weapon3': '2.190', 'DAMAGECOUNT': '5.523', 'FRAGCOUNT': '14.000'} [2023-02-24 18:50:11,941][177155] DAMAGECOUNT value on done: 195692.0 [2023-02-24 18:50:11,942][177155] Sum rewards: 18.675, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.750', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.015', 'weapon5': '0.102', 'AMMO3': '0.108', 'WEAPON5': '0.250', 'WEAPON3': '0.750', 'HITCOUNT': '1.180', 'weapon2': '1.702', 'weapon3': '2.014', 'DAMAGECOUNT': '5.070', 'FRAGCOUNT': '15.000'} [2023-02-24 18:50:12,639][177153] Updated weights for policy 0, policy_version 17860 (0.0009) [2023-02-24 18:50:15,596][177153] Updated weights for policy 0, policy_version 17870 (0.0009) [2023-02-24 18:50:15,704][177156] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 18:50:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13829.2). Total num frames: 73203712. Throughput: 0: 3473.1. Samples: 18302350. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:50:16,376][177119] Avg episode reward: [(0, '12.614')] [2023-02-24 18:50:18,559][177153] Updated weights for policy 0, policy_version 17880 (0.0008) [2023-02-24 18:50:19,450][177156] DAMAGECOUNT value on done: 203058.0 [2023-02-24 18:50:19,450][177156] Sum rewards: 10.113, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.125', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.036', 'AMMO3': '0.128', 'AMMO4': '0.182', 'weapon5': '0.188', 'weapon4': '0.214', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'HITCOUNT': '0.990', 'weapon2': '1.506', 'weapon3': '1.718', 'DAMAGECOUNT': '3.333', 'FRAGCOUNT': '11.000'} [2023-02-24 18:50:19,471][177156] DAMAGECOUNT value on done: 199281.0 [2023-02-24 18:50:19,472][177156] Sum rewards: 12.056, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.960', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.012', 'weapon4': '0.048', 'WEAPON4': '0.050', 'weapon7': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.147', 'weapon5': '0.178', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.770', 'ARMOR': '0.927', 'WEAPON3': '0.950', 'weapon2': '1.272', 'weapon3': '1.674', 'DAMAGECOUNT': '3.675', 'FRAGCOUNT': '11.000'} [2023-02-24 18:50:19,759][177156] DAMAGECOUNT value on done: 207810.0 [2023-02-24 18:50:19,759][177156] Sum rewards: 4.212, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.380', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO3': '0.084', 'weapon7': '0.130', 'weapon5': '0.142', 'AMMO4': '0.181', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.480', 'HITCOUNT': '0.510', 'WEAPON3': '0.600', 'weapon2': '0.996', 'weapon3': '1.256', 'DAMAGECOUNT': '2.274', 'FRAGCOUNT': '5.000'} [2023-02-24 18:50:19,781][177156] DAMAGECOUNT value on done: 199257.0 [2023-02-24 18:50:19,781][177156] Sum rewards: 4.717, reward structure: {'DEATHCOUNT': '-8.250', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO2': '0.022', 'ARMOR': '0.036', 'WEAPON4': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.113', 'weapon5': '0.216', 'weapon4': '0.226', 'HEALTH': '0.262', 'WEAPON5': '0.500', 'HITCOUNT': '0.520', 'WEAPON3': '0.700', 'weapon2': '1.370', 'weapon3': '1.814', 'DAMAGECOUNT': '2.436', 'FRAGCOUNT': '4.500'} [2023-02-24 18:50:20,759][177170] DAMAGECOUNT value on done: 204202.0 [2023-02-24 18:50:20,759][177170] Sum rewards: 9.191, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.982', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon5': '0.058', 'AMMO3': '0.112', 'AMMO4': '0.139', 'WEAPON4': '0.300', 'weapon4': '0.348', 'WEAPON5': '0.350', 'ARMOR': '0.412', 'WEAPON3': '0.750', 'HITCOUNT': '0.870', 'weapon2': '1.126', 'weapon3': '1.636', 'DAMAGECOUNT': '3.279', 'FRAGCOUNT': '9.000'} [2023-02-24 18:50:21,056][177170] DAMAGECOUNT value on done: 209746.0 [2023-02-24 18:50:21,056][177170] Sum rewards: 12.830, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.124', 'AMMO5': '0.018', 'AMMO2': '0.020', 'weapon4': '0.096', 'AMMO4': '0.099', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'weapon5': '0.258', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'HITCOUNT': '0.700', 'weapon2': '1.138', 'weapon3': '1.940', 'DAMAGECOUNT': '3.519', 'FRAGCOUNT': '12.000'} [2023-02-24 18:50:21,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13829.2). Total num frames: 73273344. Throughput: 0: 3471.3. Samples: 18312698. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:50:21,376][177119] Avg episode reward: [(0, '12.505')] [2023-02-24 18:50:21,392][177170] DAMAGECOUNT value on done: 202034.0 [2023-02-24 18:50:21,392][177170] Sum rewards: 17.681, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.264', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'weapon5': '0.102', 'AMMO3': '0.131', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'weapon2': '1.376', 'HITCOUNT': '1.470', 'weapon3': '2.062', 'DAMAGECOUNT': '6.225', 'FRAGCOUNT': '15.000'} [2023-02-24 18:50:21,562][177153] Updated weights for policy 0, policy_version 17890 (0.0009) [2023-02-24 18:50:21,700][177170] DAMAGECOUNT value on done: 199732.0 [2023-02-24 18:50:21,700][177170] Sum rewards: 6.924, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.221', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.013', 'weapon5': '0.014', 'AMMO4': '0.052', 'ARMOR': '0.064', 'AMMO3': '0.187', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.430', 'weapon2': '0.688', 'HITCOUNT': '1.050', 'WEAPON3': '1.200', 'weapon3': '2.198', 'DAMAGECOUNT': '4.179', 'FRAGCOUNT': '9.000'} [2023-02-24 18:50:22,615][177158] DAMAGECOUNT value on done: 195556.0 [2023-02-24 18:50:22,616][177158] Sum rewards: 17.819, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.553', 'AMMO5': '0.028', 'AMMO2': '0.030', 'WEAPON1': '0.030', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.148', 'AMMO3': '0.164', 'WEAPON4': '0.250', 'weapon5': '0.292', 'weapon2': '0.322', 'ARMOR': '0.400', 'WEAPON5': '0.550', 'weapon4': '0.658', 'WEAPON3': '1.050', 'HITCOUNT': '1.300', 'weapon3': '1.922', 'DAMAGECOUNT': '5.628', 'FRAGCOUNT': '16.000'} [2023-02-24 18:50:22,923][177158] DAMAGECOUNT value on done: 196438.0 [2023-02-24 18:50:22,924][177158] Sum rewards: 16.715, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.530', 'AMMO2': '0.011', 'AMMO5': '0.012', 'ARMOR': '0.036', 'WEAPON1': '0.040', 'AMMO4': '0.055', 'weapon7': '0.066', 'AMMO3': '0.137', 'weapon5': '0.190', 'WEAPON4': '0.200', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.446', 'weapon2': '0.882', 'WEAPON3': '0.950', 'HITCOUNT': '1.130', 'weapon3': '1.884', 'DAMAGECOUNT': '4.956', 'FRAGCOUNT': '15.000'} [2023-02-24 18:50:23,816][177158] DAMAGECOUNT value on done: 205556.0 [2023-02-24 18:50:23,816][177158] Sum rewards: 15.177, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.641', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'weapon5': '0.144', 'AMMO3': '0.155', 'WEAPON5': '0.200', 'weapon4': '0.310', 'WEAPON3': '0.850', 'HITCOUNT': '1.040', 'weapon2': '1.070', 'weapon3': '1.786', 'DAMAGECOUNT': '4.662', 'FRAGCOUNT': '14.000'} [2023-02-24 18:50:24,118][177158] DAMAGECOUNT value on done: 206802.0 [2023-02-24 18:50:24,118][177158] Sum rewards: 13.333, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.105', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon7': '0.090', 'AMMO3': '0.162', 'weapon5': '0.164', 'weapon4': '0.186', 'WEAPON4': '0.200', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.982', 'WEAPON3': '1.000', 'HITCOUNT': '1.120', 'weapon3': '2.250', 'DAMAGECOUNT': '4.422', 'FRAGCOUNT': '13.000'} [2023-02-24 18:50:24,537][177153] Updated weights for policy 0, policy_version 17900 (0.0008) [2023-02-24 18:50:25,872][177172] DAMAGECOUNT value on done: 204283.0 [2023-02-24 18:50:25,873][177172] Sum rewards: 13.787, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.605', 'AMMO2': '0.014', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.069', 'weapon7': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.124', 'weapon5': '0.152', 'AMMO3': '0.169', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '1.060', 'weapon2': '1.088', 'weapon3': '1.992', 'DAMAGECOUNT': '5.436', 'FRAGCOUNT': '13.000'} [2023-02-24 18:50:26,168][177172] DAMAGECOUNT value on done: 200467.0 [2023-02-24 18:50:26,169][177172] Sum rewards: 15.044, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.296', 'AMMO5': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.093', 'AMMO4': '0.129', 'weapon5': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'weapon4': '0.612', 'HITCOUNT': '0.910', 'weapon2': '1.198', 'weapon3': '1.220', 'ARMOR': '1.250', 'DAMAGECOUNT': '4.176', 'FRAGCOUNT': '12.500'} [2023-02-24 18:50:26,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.2, 300 sec: 13843.1). Total num frames: 73342976. Throughput: 0: 3468.5. Samples: 18333416. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:50:26,376][177119] Avg episode reward: [(0, '12.654')] [2023-02-24 18:50:27,477][177153] Updated weights for policy 0, policy_version 17910 (0.0008) [2023-02-24 18:50:27,685][177154] DAMAGECOUNT value on done: 204100.0 [2023-02-24 18:50:27,685][177154] Sum rewards: 11.937, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.120', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'AMMO5': '0.024', 'AMMO4': '0.116', 'weapon5': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'weapon4': '0.282', 'WEAPON5': '0.600', 'weapon2': '0.964', 'HITCOUNT': '0.980', 'WEAPON3': '1.050', 'weapon3': '2.272', 'DAMAGECOUNT': '4.542', 'FRAGCOUNT': '11.000'} [2023-02-24 18:50:27,937][177172] DAMAGECOUNT value on done: 203372.0 [2023-02-24 18:50:27,937][177172] Sum rewards: 18.311, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.030', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon7': '0.070', 'AMMO3': '0.071', 'AMMO4': '0.073', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.242', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'weapon2': '0.592', 'weapon4': '0.666', 'HITCOUNT': '0.850', 'weapon3': '1.252', 'DAMAGECOUNT': '5.409', 'FRAGCOUNT': '13.000'} [2023-02-24 18:50:27,989][177154] DAMAGECOUNT value on done: 208891.0 [2023-02-24 18:50:27,990][177154] Sum rewards: 17.094, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.260', 'AMMO5': '0.014', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'weapon7': '0.082', 'AMMO4': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.116', 'weapon5': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.622', 'weapon2': '0.846', 'WEAPON3': '0.850', 'HITCOUNT': '1.040', 'weapon3': '1.770', 'DAMAGECOUNT': '5.340', 'FRAGCOUNT': '14.500'} [2023-02-24 18:50:28,241][177172] DAMAGECOUNT value on done: 202964.0 [2023-02-24 18:50:28,241][177172] Sum rewards: 9.395, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.593', 'AMMO5': '0.011', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'weapon7': '0.056', 'AMMO3': '0.072', 'AMMO4': '0.074', 'weapon5': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'weapon4': '0.434', 'WEAPON3': '0.550', 'HITCOUNT': '0.790', 'weapon2': '1.198', 'weapon3': '1.360', 'DAMAGECOUNT': '2.520', 'FRAGCOUNT': '7.000'} [2023-02-24 18:50:28,302][177154] DAMAGECOUNT value on done: 215584.0 [2023-02-24 18:50:28,302][177154] Sum rewards: 11.375, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.000', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.037', 'weapon7': '0.050', 'AMMO3': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.178', 'AMMO4': '0.182', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.366', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.730', 'weapon2': '1.172', 'weapon3': '1.494', 'DAMAGECOUNT': '3.141', 'FRAGCOUNT': '11.000'} [2023-02-24 18:50:28,582][177157] DAMAGECOUNT value on done: 208034.0 [2023-02-24 18:50:28,583][177157] Sum rewards: 16.605, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.033', 'AMMO2': '0.019', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.096', 'AMMO3': '0.111', 'weapon5': '0.234', 'WEAPON4': '0.250', 'weapon4': '0.430', 'ARMOR': '0.455', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'weapon2': '0.834', 'HITCOUNT': '0.990', 'weapon3': '2.006', 'DAMAGECOUNT': '4.323', 'FRAGCOUNT': '14.000'} [2023-02-24 18:50:28,600][177154] DAMAGECOUNT value on done: 210827.0 [2023-02-24 18:50:28,600][177154] Sum rewards: 13.335, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.140', 'AMMO5': '0.010', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'AMMO4': '0.106', 'weapon5': '0.178', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon4': '0.202', 'WEAPON5': '0.300', 'weapon2': '0.860', 'HITCOUNT': '1.080', 'WEAPON3': '1.200', 'weapon3': '2.386', 'DAMAGECOUNT': '4.440', 'FRAGCOUNT': '16.000'} [2023-02-24 18:50:28,630][177157] DAMAGECOUNT value on done: 194594.0 [2023-02-24 18:50:28,631][177157] Sum rewards: 16.901, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.328', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.017', 'AMMO4': '0.087', 'AMMO3': '0.119', 'weapon5': '0.250', 'WEAPON5': '0.350', 'HITCOUNT': '0.740', 'WEAPON3': '0.750', 'weapon2': '1.242', 'weapon3': '2.184', 'DAMAGECOUNT': '4.965', 'FRAGCOUNT': '14.000'} [2023-02-24 18:50:28,807][177171] DAMAGECOUNT value on done: 197984.0 [2023-02-24 18:50:28,808][177171] Sum rewards: 21.594, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.682', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.106', 'AMMO3': '0.131', 'AMMO4': '0.174', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.688', 'weapon2': '0.774', 'WEAPON3': '0.800', 'HITCOUNT': '1.410', 'weapon3': '1.500', 'DAMAGECOUNT': '6.489', 'FRAGCOUNT': '18.000'} [2023-02-24 18:50:28,893][177157] DAMAGECOUNT value on done: 199238.0 [2023-02-24 18:50:28,894][177157] Sum rewards: 16.366, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.115', 'AMMO2': '0.003', 'AMMO5': '0.015', 'AMMO4': '0.017', 'WEAPON1': '0.040', 'weapon7': '0.046', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.115', 'WEAPON4': '0.200', 'weapon5': '0.288', 'WEAPON5': '0.400', 'weapon4': '0.406', 'ARMOR': '0.458', 'WEAPON3': '0.750', 'HITCOUNT': '0.890', 'weapon2': '0.902', 'weapon3': '1.834', 'DAMAGECOUNT': '4.317', 'FRAGCOUNT': '14.000'} [2023-02-24 18:50:28,949][177157] DAMAGECOUNT value on done: 197746.0 [2023-02-24 18:50:28,950][177157] Sum rewards: 23.034, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.752', 'AMMO2': '0.002', 'AMMO4': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'WEAPON4': '0.100', 'AMMO3': '0.141', 'weapon4': '0.226', 'WEAPON5': '0.250', 'weapon5': '0.330', 'WEAPON3': '0.750', 'weapon2': '1.096', 'HITCOUNT': '1.300', 'weapon3': '1.876', 'DAMAGECOUNT': '6.183', 'FRAGCOUNT': '19.000'} [2023-02-24 18:50:29,092][177171] DAMAGECOUNT value on done: 201651.0 [2023-02-24 18:50:29,093][177171] Sum rewards: 21.192, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.918', 'AMMO2': '0.002', 'ARMOR': '0.004', 'AMMO4': '0.010', 'AMMO5': '0.024', 'WEAPON1': '0.030', 'weapon4': '0.044', 'WEAPON4': '0.050', 'AMMO3': '0.142', 'weapon5': '0.282', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'weapon2': '1.130', 'HITCOUNT': '1.300', 'weapon3': '2.152', 'DAMAGECOUNT': '5.640', 'FRAGCOUNT': '18.000'} [2023-02-24 18:50:29,118][177171] DAMAGECOUNT value on done: 207124.0 [2023-02-24 18:50:29,118][177171] Sum rewards: 22.892, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.548', 'AMMO2': '0.009', 'weapon4': '0.018', 'AMMO5': '0.025', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO3': '0.116', 'weapon5': '0.290', 'WEAPON5': '0.600', 'weapon2': '0.768', 'WEAPON3': '0.800', 'HITCOUNT': '1.330', 'weapon3': '2.340', 'DAMAGECOUNT': '6.237', 'FRAGCOUNT': '19.000'} [2023-02-24 18:50:29,399][177171] DAMAGECOUNT value on done: 200155.0 [2023-02-24 18:50:29,399][177171] Sum rewards: 13.836, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.707', 'AMMO2': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'weapon4': '0.060', 'AMMO3': '0.098', 'weapon5': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'HITCOUNT': '1.150', 'weapon2': '1.432', 'weapon3': '1.862', 'DAMAGECOUNT': '4.818', 'FRAGCOUNT': '10.500'} [2023-02-24 18:50:29,881][177171] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 18:50:30,337][177155] DAMAGECOUNT value on done: 201554.0 [2023-02-24 18:50:30,337][177155] Sum rewards: 11.988, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.132', 'AMMO2': '0.002', 'AMMO5': '0.010', 'AMMO4': '0.012', 'AMMO3': '0.079', 'weapon7': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.188', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'WEAPON4': '0.400', 'ARMOR': '0.454', 'weapon2': '0.456', 'HITCOUNT': '0.640', 'weapon4': '0.848', 'weapon3': '1.002', 'DAMAGECOUNT': '3.303', 'FRAGCOUNT': '9.000'} [2023-02-24 18:50:30,453][177153] Updated weights for policy 0, policy_version 17920 (0.0009) [2023-02-24 18:50:30,636][177155] DAMAGECOUNT value on done: 208954.0 [2023-02-24 18:50:30,637][177155] Sum rewards: 12.509, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.424', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.044', 'AMMO3': '0.101', 'weapon5': '0.160', 'AMMO4': '0.219', 'weapon4': '0.344', 'WEAPON5': '0.350', 'ARMOR': '0.454', 'WEAPON4': '0.500', 'WEAPON3': '0.750', 'HITCOUNT': '0.950', 'weapon2': '1.506', 'weapon3': '1.720', 'DAMAGECOUNT': '3.801', 'FRAGCOUNT': '13.000'} [2023-02-24 18:50:31,022][177155] DAMAGECOUNT value on done: 210561.0 [2023-02-24 18:50:31,023][177155] Sum rewards: 13.883, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.566', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.088', 'AMMO3': '0.105', 'weapon7': '0.118', 'weapon5': '0.158', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.438', 'WEAPON3': '0.750', 'weapon2': '0.764', 'HITCOUNT': '0.800', 'weapon3': '1.840', 'DAMAGECOUNT': '4.248', 'FRAGCOUNT': '12.000'} [2023-02-24 18:50:31,325][177155] DAMAGECOUNT value on done: 197439.0 [2023-02-24 18:50:31,325][177155] Sum rewards: 17.277, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.384', 'AMMO5': '0.019', 'WEAPON1': '0.030', 'AMMO2': '0.030', 'AMMO3': '0.118', 'AMMO4': '0.151', 'weapon4': '0.250', 'WEAPON4': '0.300', 'weapon5': '0.376', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'weapon2': '0.904', 'HITCOUNT': '1.000', 'weapon3': '1.920', 'DAMAGECOUNT': '4.662', 'FRAGCOUNT': '16.000'} [2023-02-24 18:50:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 73412608. Throughput: 0: 3466.4. Samples: 18354126. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:50:31,376][177119] Avg episode reward: [(0, '13.415')] [2023-02-24 18:50:33,358][177153] Updated weights for policy 0, policy_version 17930 (0.0008) [2023-02-24 18:50:36,308][177153] Updated weights for policy 0, policy_version 17940 (0.0008) [2023-02-24 18:50:36,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 73482240. Throughput: 0: 3467.8. Samples: 18364590. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:50:36,376][177119] Avg episode reward: [(0, '13.415')] [2023-02-24 18:50:38,883][177156] DAMAGECOUNT value on done: 204473.0 [2023-02-24 18:50:38,883][177156] Sum rewards: 15.898, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.600', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.100', 'weapon7': '0.102', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.220', 'weapon5': '0.262', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.670', 'weapon2': '1.406', 'weapon3': '1.500', 'DAMAGECOUNT': '4.245', 'FRAGCOUNT': '10.000'} [2023-02-24 18:50:38,903][177156] DAMAGECOUNT value on done: 201139.0 [2023-02-24 18:50:38,904][177156] Sum rewards: 19.173, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.662', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon7': '0.050', 'AMMO4': '0.089', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.154', 'AMMO3': '0.158', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'ARMOR': '0.440', 'weapon4': '0.632', 'WEAPON3': '0.950', 'weapon2': '1.032', 'HITCOUNT': '1.120', 'weapon3': '1.758', 'DAMAGECOUNT': '5.334', 'FRAGCOUNT': '20.000'} [2023-02-24 18:50:39,196][177156] DAMAGECOUNT value on done: 208979.0 [2023-02-24 18:50:39,196][177156] Sum rewards: 11.540, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.115', 'AMMO5': '0.020', 'AMMO2': '0.036', 'WEAPON1': '0.040', 'AMMO3': '0.070', 'AMMO4': '0.178', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.342', 'ARMOR': '0.404', 'weapon4': '0.444', 'WEAPON3': '0.500', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'HITCOUNT': '0.900', 'weapon2': '1.184', 'weapon3': '1.580', 'DAMAGECOUNT': '3.507', 'FRAGCOUNT': '10.000'} [2023-02-24 18:50:39,219][177156] DAMAGECOUNT value on done: 200626.0 [2023-02-24 18:50:39,219][177156] Sum rewards: 16.284, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.420', 'AMMO2': '0.003', 'AMMO5': '0.009', 'AMMO4': '0.017', 'WEAPON1': '0.040', 'weapon7': '0.048', 'WEAPON4': '0.050', 'weapon5': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.141', 'weapon4': '0.142', 'WEAPON5': '0.250', 'weapon2': '0.800', 'WEAPON3': '1.000', 'HITCOUNT': '1.140', 'weapon3': '2.564', 'DAMAGECOUNT': '4.107', 'FRAGCOUNT': '16.000'} [2023-02-24 18:50:39,287][177153] Updated weights for policy 0, policy_version 17950 (0.0008) [2023-02-24 18:50:40,229][177170] DAMAGECOUNT value on done: 205932.0 [2023-02-24 18:50:40,230][177170] Sum rewards: 15.251, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.146', 'AMMO5': '0.017', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.110', 'WEAPON4': '0.250', 'weapon5': '0.312', 'WEAPON5': '0.450', 'ARMOR': '0.472', 'weapon4': '0.486', 'WEAPON3': '0.750', 'weapon2': '0.966', 'HITCOUNT': '1.200', 'weapon3': '1.684', 'DAMAGECOUNT': '5.190', 'FRAGCOUNT': '13.000'} [2023-02-24 18:50:40,528][177170] DAMAGECOUNT value on done: 211455.0 [2023-02-24 18:50:40,529][177170] Sum rewards: 22.574, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.785', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO4': '0.120', 'AMMO3': '0.121', 'weapon4': '0.266', 'WEAPON4': '0.300', 'WEAPON3': '0.750', 'weapon2': '1.240', 'HITCOUNT': '1.370', 'weapon3': '1.962', 'DAMAGECOUNT': '5.127', 'FRAGCOUNT': '19.000'} [2023-02-24 18:50:40,848][177170] DAMAGECOUNT value on done: 204860.0 [2023-02-24 18:50:40,848][177170] Sum rewards: 30.250, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.819', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.103', 'weapon7': '0.114', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.226', 'WEAPON5': '0.250', 'weapon5': '0.250', 'ARMOR': '0.400', 'weapon2': '0.694', 'WEAPON3': '0.700', 'HITCOUNT': '1.240', 'weapon3': '1.866', 'DAMAGECOUNT': '8.478', 'FRAGCOUNT': '22.000'} [2023-02-24 18:50:41,148][177170] DAMAGECOUNT value on done: 201728.0 [2023-02-24 18:50:41,149][177170] Sum rewards: 17.157, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.026', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon7': '0.056', 'weapon5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.142', 'WEAPON5': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.810', 'weapon4': '0.936', 'WEAPON3': '0.950', 'HITCOUNT': '1.250', 'weapon3': '1.620', 'DAMAGECOUNT': '5.898', 'FRAGCOUNT': '16.000'} [2023-02-24 18:50:41,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13843.1). Total num frames: 73551872. Throughput: 0: 3466.3. Samples: 18385414. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:50:41,376][177119] Avg episode reward: [(0, '13.843')] [2023-02-24 18:50:41,991][177158] DAMAGECOUNT value on done: 196499.0 [2023-02-24 18:50:41,991][177158] Sum rewards: 6.638, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.344', 'weapon7': '0.006', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.147', 'AMMO3': '0.166', 'weapon5': '0.232', 'WEAPON4': '0.350', 'weapon4': '0.368', 'WEAPON5': '0.450', 'HITCOUNT': '0.730', 'weapon2': '0.768', 'WEAPON3': '1.150', 'weapon3': '2.166', 'DAMAGECOUNT': '2.829', 'FRAGCOUNT': '9.000'} [2023-02-24 18:50:42,235][177153] Updated weights for policy 0, policy_version 17960 (0.0009) [2023-02-24 18:50:42,294][177158] DAMAGECOUNT value on done: 198219.0 [2023-02-24 18:50:42,294][177158] Sum rewards: 14.850, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.290', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon7': '0.068', 'AMMO4': '0.077', 'AMMO3': '0.159', 'weapon4': '0.160', 'weapon5': '0.184', 'WEAPON4': '0.200', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'weapon2': '0.956', 'WEAPON3': '1.100', 'HITCOUNT': '1.240', 'weapon3': '2.180', 'DAMAGECOUNT': '5.343', 'FRAGCOUNT': '14.000'} [2023-02-24 18:50:43,191][177158] DAMAGECOUNT value on done: 207384.0 [2023-02-24 18:50:43,191][177158] Sum rewards: 18.087, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.122', 'AMMO5': '0.020', 'ARMOR': '0.024', 'AMMO2': '0.030', 'AMMO3': '0.133', 'AMMO4': '0.148', 'weapon5': '0.256', 'weapon4': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'HITCOUNT': '1.160', 'weapon2': '1.298', 'weapon3': '1.918', 'DAMAGECOUNT': '5.484', 'FRAGCOUNT': '19.000'} [2023-02-24 18:50:43,497][177158] DAMAGECOUNT value on done: 208765.0 [2023-02-24 18:50:43,498][177158] Sum rewards: 14.322, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.156', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.022', 'weapon7': '0.058', 'AMMO4': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.121', 'weapon5': '0.166', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.504', 'WEAPON3': '0.700', 'weapon2': '0.852', 'weapon3': '0.934', 'HITCOUNT': '1.060', 'DAMAGECOUNT': '5.889', 'FRAGCOUNT': '12.000'} [2023-02-24 18:50:45,173][177153] Updated weights for policy 0, policy_version 17970 (0.0008) [2023-02-24 18:50:45,209][177172] DAMAGECOUNT value on done: 205184.0 [2023-02-24 18:50:45,209][177172] Sum rewards: 11.645, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.395', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.012', 'AMMO3': '0.060', 'weapon7': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.188', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.620', 'weapon3': '1.310', 'weapon2': '1.640', 'DAMAGECOUNT': '2.703', 'FRAGCOUNT': '8.000'} [2023-02-24 18:50:45,515][177172] DAMAGECOUNT value on done: 201705.0 [2023-02-24 18:50:45,516][177172] Sum rewards: 15.183, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.645', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.027', 'weapon7': '0.048', 'AMMO3': '0.063', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.134', 'WEAPON7': '0.200', 'weapon5': '0.212', 'weapon4': '0.276', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'WEAPON5': '0.500', 'HITCOUNT': '0.740', 'weapon3': '1.304', 'weapon2': '1.634', 'DAMAGECOUNT': '3.714', 'FRAGCOUNT': '12.000'} [2023-02-24 18:50:46,376][177119] Fps is (10 sec: 13926.7, 60 sec: 13926.5, 300 sec: 13843.1). Total num frames: 73621504. Throughput: 0: 3465.5. Samples: 18406190. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:50:46,376][177119] Avg episode reward: [(0, '13.848')] [2023-02-24 18:50:47,070][177154] DAMAGECOUNT value on done: 206122.0 [2023-02-24 18:50:47,070][177154] Sum rewards: 17.801, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.901', 'AMMO2': '0.005', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.027', 'weapon7': '0.046', 'WEAPON4': '0.050', 'weapon4': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.122', 'WEAPON7': '0.200', 'weapon5': '0.310', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'HITCOUNT': '1.200', 'weapon2': '1.508', 'weapon3': '1.604', 'DAMAGECOUNT': '6.066', 'FRAGCOUNT': '15.000'} [2023-02-24 18:50:47,274][177172] DAMAGECOUNT value on done: 204781.0 [2023-02-24 18:50:47,274][177172] Sum rewards: 15.646, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.212', 'AMMO2': '0.002', 'AMMO5': '0.010', 'AMMO4': '0.012', 'weapon5': '0.060', 'AMMO3': '0.096', 'weapon7': '0.098', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.840', 'weapon2': '1.456', 'weapon3': '1.466', 'DAMAGECOUNT': '4.227', 'FRAGCOUNT': '12.000'} [2023-02-24 18:50:47,381][177154] DAMAGECOUNT value on done: 210167.0 [2023-02-24 18:50:47,382][177154] Sum rewards: 11.853, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.042', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.043', 'AMMO3': '0.074', 'weapon7': '0.158', 'AMMO4': '0.215', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.270', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'weapon4': '0.608', 'HITCOUNT': '0.810', 'weapon3': '1.134', 'weapon2': '1.150', 'DAMAGECOUNT': '3.828', 'FRAGCOUNT': '11.000'} [2023-02-24 18:50:47,569][177172] DAMAGECOUNT value on done: 204111.0 [2023-02-24 18:50:47,570][177172] Sum rewards: 12.819, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.188', 'ARMOR': '0.004', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon7': '0.080', 'AMMO3': '0.082', 'AMMO4': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.202', 'weapon4': '0.374', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '0.670', 'weapon2': '0.924', 'weapon3': '1.384', 'DAMAGECOUNT': '3.441', 'FRAGCOUNT': '11.000'} [2023-02-24 18:50:47,689][177154] DAMAGECOUNT value on done: 217647.0 [2023-02-24 18:50:47,690][177154] Sum rewards: 21.819, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.668', 'ARMOR': '0.004', 'AMMO2': '0.013', 'AMMO5': '0.013', 'AMMO4': '0.064', 'weapon4': '0.068', 'WEAPON4': '0.100', 'weapon7': '0.106', 'AMMO3': '0.125', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.206', 'WEAPON5': '0.300', 'WEAPON3': '0.800', 'HITCOUNT': '1.040', 'weapon2': '1.324', 'weapon3': '1.764', 'DAMAGECOUNT': '5.709', 'FRAGCOUNT': '17.000'} [2023-02-24 18:50:47,966][177157] DAMAGECOUNT value on done: 209184.0 [2023-02-24 18:50:47,966][177157] Sum rewards: 16.368, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.080', 'AMMO2': '0.006', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.030', 'weapon7': '0.054', 'AMMO3': '0.083', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.154', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.314', 'WEAPON3': '0.600', 'HITCOUNT': '0.730', 'weapon2': '0.980', 'weapon3': '1.276', 'DAMAGECOUNT': '3.450', 'FRAGCOUNT': '14.000'} [2023-02-24 18:50:47,995][177154] DAMAGECOUNT value on done: 212175.0 [2023-02-24 18:50:47,996][177154] Sum rewards: 18.537, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.125', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.033', 'weapon7': '0.046', 'AMMO3': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.140', 'WEAPON5': '0.200', 'weapon4': '0.226', 'WEAPON3': '0.650', 'HITCOUNT': '1.070', 'weapon2': '1.312', 'weapon3': '1.430', 'DAMAGECOUNT': '4.044', 'FRAGCOUNT': '16.000'} [2023-02-24 18:50:48,004][177157] DAMAGECOUNT value on done: 196790.0 [2023-02-24 18:50:48,004][177157] Sum rewards: 19.244, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.660', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.025', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'weapon5': '0.182', 'WEAPON5': '0.300', 'weapon4': '0.306', 'WEAPON3': '0.800', 'weapon2': '1.132', 'HITCOUNT': '1.490', 'weapon3': '2.042', 'DAMAGECOUNT': '6.588', 'FRAGCOUNT': '15.000'} [2023-02-24 18:50:48,131][177153] Updated weights for policy 0, policy_version 17980 (0.0009) [2023-02-24 18:50:48,160][177171] DAMAGECOUNT value on done: 199243.0 [2023-02-24 18:50:48,160][177171] Sum rewards: 8.456, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.945', 'ARMOR': '0.004', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon7': '0.056', 'AMMO3': '0.076', 'AMMO4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.178', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.506', 'WEAPON3': '0.600', 'weapon2': '0.862', 'HITCOUNT': '0.900', 'weapon3': '1.428', 'DAMAGECOUNT': '3.597', 'FRAGCOUNT': '9.000'} [2023-02-24 18:50:48,278][177157] DAMAGECOUNT value on done: 200229.0 [2023-02-24 18:50:48,278][177157] Sum rewards: 8.701, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.214', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.070', 'AMMO3': '0.089', 'weapon7': '0.106', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'weapon4': '0.476', 'weapon2': '0.668', 'HITCOUNT': '0.670', 'weapon3': '1.072', 'DAMAGECOUNT': '2.973', 'FRAGCOUNT': '8.000'} [2023-02-24 18:50:48,315][177157] DAMAGECOUNT value on done: 199361.0 [2023-02-24 18:50:48,315][177157] Sum rewards: 11.878, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.717', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.048', 'weapon7': '0.052', 'AMMO4': '0.080', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.422', 'WEAPON4': '0.450', 'weapon4': '0.624', 'WEAPON3': '0.850', 'HITCOUNT': '1.230', 'weapon3': '1.466', 'DAMAGECOUNT': '4.845', 'FRAGCOUNT': '12.000'} [2023-02-24 18:50:48,468][177171] DAMAGECOUNT value on done: 208409.0 [2023-02-24 18:50:48,469][177171] Sum rewards: 12.997, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.850', 'AMMO2': '0.010', 'AMMO5': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'weapon7': '0.052', 'AMMO3': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.100', 'weapon4': '0.230', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.870', 'weapon3': '1.380', 'weapon2': '1.762', 'DAMAGECOUNT': '3.855', 'FRAGCOUNT': '11.000'} [2023-02-24 18:50:48,490][177171] DAMAGECOUNT value on done: 203165.0 [2023-02-24 18:50:48,490][177171] Sum rewards: 13.669, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.303', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.028', 'AMMO3': '0.060', 'WEAPON5': '0.150', 'weapon5': '0.156', 'weapon7': '0.166', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'ARMOR': '0.486', 'WEAPON7': '0.500', 'weapon4': '0.724', 'weapon2': '0.814', 'HITCOUNT': '0.870', 'weapon3': '1.030', 'DAMAGECOUNT': '4.542', 'FRAGCOUNT': '9.000'} [2023-02-24 18:50:48,795][177171] DAMAGECOUNT value on done: 201553.0 [2023-02-24 18:50:48,796][177171] Sum rewards: 9.467, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.232', 'AMMO2': '0.020', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'weapon7': '0.046', 'AMMO3': '0.090', 'AMMO4': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.378', 'ARMOR': '0.456', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'HITCOUNT': '0.820', 'weapon2': '0.926', 'weapon3': '1.810', 'DAMAGECOUNT': '3.771', 'FRAGCOUNT': '7.000'} [2023-02-24 18:50:49,687][177155] DAMAGECOUNT value on done: 202404.0 [2023-02-24 18:50:49,687][177155] Sum rewards: 9.494, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.795', 'AMMO5': '0.010', 'AMMO2': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.052', 'weapon7': '0.054', 'AMMO3': '0.081', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.370', 'WEAPON3': '0.550', 'HITCOUNT': '0.640', 'weapon3': '1.016', 'weapon2': '1.362', 'DAMAGECOUNT': '2.550', 'FRAGCOUNT': '10.000'} [2023-02-24 18:50:49,983][177155] DAMAGECOUNT value on done: 210630.0 [2023-02-24 18:50:49,983][177155] Sum rewards: 15.065, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.113', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO3': '0.118', 'WEAPON4': '0.150', 'weapon4': '0.248', 'weapon5': '0.352', 'WEAPON5': '0.450', 'ARMOR': '0.471', 'WEAPON3': '0.850', 'HITCOUNT': '1.000', 'weapon2': '1.100', 'weapon3': '1.868', 'DAMAGECOUNT': '5.028', 'FRAGCOUNT': '13.000'} [2023-02-24 18:50:50,365][177155] DAMAGECOUNT value on done: 212350.0 [2023-02-24 18:50:50,366][177155] Sum rewards: 17.803, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.918', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.044', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.100', 'AMMO3': '0.126', 'AMMO4': '0.221', 'weapon5': '0.232', 'weapon2': '0.406', 'WEAPON4': '0.450', 'weapon4': '0.488', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'HITCOUNT': '1.320', 'weapon3': '2.230', 'DAMAGECOUNT': '5.367', 'FRAGCOUNT': '16.000'} [2023-02-24 18:50:50,671][177155] DAMAGECOUNT value on done: 198130.0 [2023-02-24 18:50:50,671][177155] Sum rewards: 6.092, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.827', 'AMMO2': '0.019', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'AMMO4': '0.094', 'AMMO3': '0.113', 'weapon5': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.292', 'WEAPON5': '0.400', 'ARMOR': '0.497', 'HITCOUNT': '0.570', 'WEAPON3': '0.750', 'weapon2': '0.948', 'weapon3': '1.730', 'DAMAGECOUNT': '2.073', 'FRAGCOUNT': '8.000'} [2023-02-24 18:50:51,115][177153] Updated weights for policy 0, policy_version 17990 (0.0008) [2023-02-24 18:50:51,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13858.1, 300 sec: 13815.3). Total num frames: 73687040. Throughput: 0: 3464.8. Samples: 18416546. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:50:51,376][177119] Avg episode reward: [(0, '14.009')] [2023-02-24 18:50:54,054][177153] Updated weights for policy 0, policy_version 18000 (0.0008) [2023-02-24 18:50:56,376][177119] Fps is (10 sec: 13516.2, 60 sec: 13858.1, 300 sec: 13829.2). Total num frames: 73756672. Throughput: 0: 3465.5. Samples: 18437372. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:50:56,377][177119] Avg episode reward: [(0, '14.009')] [2023-02-24 18:50:56,382][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000018007_73756672.pth... [2023-02-24 18:50:56,439][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000017197_70438912.pth [2023-02-24 18:50:57,015][177153] Updated weights for policy 0, policy_version 18010 (0.0008) [2023-02-24 18:50:58,332][177156] DAMAGECOUNT value on done: 205926.0 [2023-02-24 18:50:58,332][177156] Sum rewards: 13.152, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.880', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.124', 'weapon5': '0.214', 'weapon4': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'HITCOUNT': '1.150', 'weapon2': '1.476', 'weapon3': '1.686', 'DAMAGECOUNT': '4.359', 'FRAGCOUNT': '13.000'} [2023-02-24 18:50:58,356][177156] DAMAGECOUNT value on done: 202046.0 [2023-02-24 18:50:58,357][177156] Sum rewards: 4.719, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.768', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon7': '0.090', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO3': '0.170', 'AMMO4': '0.174', 'WEAPON7': '0.200', 'weapon5': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'ARMOR': '0.436', 'HITCOUNT': '0.540', 'weapon4': '0.612', 'weapon2': '0.892', 'WEAPON3': '0.950', 'weapon3': '1.512', 'DAMAGECOUNT': '2.721', 'FRAGCOUNT': '8.000'} [2023-02-24 18:50:58,647][177156] DAMAGECOUNT value on done: 210337.0 [2023-02-24 18:50:58,648][177156] Sum rewards: 11.676, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.048', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO4': '0.021', 'weapon4': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'weapon5': '0.178', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'HITCOUNT': '1.100', 'weapon2': '1.292', 'weapon3': '2.098', 'DAMAGECOUNT': '4.074', 'FRAGCOUNT': '10.000'} [2023-02-24 18:50:58,668][177156] DAMAGECOUNT value on done: 202884.0 [2023-02-24 18:50:58,668][177156] Sum rewards: 17.059, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.881', 'AMMO2': '0.013', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'weapon7': '0.058', 'AMMO4': '0.064', 'AMMO3': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.178', 'WEAPON4': '0.200', 'weapon4': '0.318', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.012', 'HITCOUNT': '1.460', 'weapon3': '1.884', 'DAMAGECOUNT': '6.774', 'FRAGCOUNT': '12.000'} [2023-02-24 18:50:59,653][177170] DAMAGECOUNT value on done: 206806.0 [2023-02-24 18:50:59,654][177170] Sum rewards: 7.124, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.015', 'AMMO2': '0.020', 'weapon7': '0.050', 'AMMO3': '0.098', 'AMMO4': '0.099', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.170', 'WEAPON7': '0.200', 'HEALTH': '0.244', 'WEAPON5': '0.300', 'weapon4': '0.332', 'WEAPON3': '0.500', 'HITCOUNT': '0.700', 'weapon2': '1.260', 'weapon3': '1.374', 'DAMAGECOUNT': '2.622', 'FRAGCOUNT': '7.000'} [2023-02-24 18:50:59,963][177170] DAMAGECOUNT value on done: 213260.0 [2023-02-24 18:50:59,963][177170] Sum rewards: 12.858, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.332', 'AMMO5': '0.015', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO4': '0.090', 'AMMO3': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.216', 'WEAPON5': '0.400', 'weapon4': '0.516', 'weapon2': '0.774', 'WEAPON3': '0.800', 'HITCOUNT': '0.890', 'weapon3': '1.960', 'DAMAGECOUNT': '3.915', 'FRAGCOUNT': '11.000'} [2023-02-24 18:50:59,994][177153] Updated weights for policy 0, policy_version 18020 (0.0008) [2023-02-24 18:51:00,274][177170] DAMAGECOUNT value on done: 206387.0 [2023-02-24 18:51:00,275][177170] Sum rewards: 16.753, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.053', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.035', 'AMMO3': '0.084', 'weapon7': '0.094', 'weapon5': '0.158', 'AMMO4': '0.174', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon4': '0.578', 'WEAPON3': '0.650', 'HITCOUNT': '1.010', 'weapon2': '1.022', 'weapon3': '1.402', 'DAMAGECOUNT': '4.581', 'FRAGCOUNT': '13.000'} [2023-02-24 18:51:00,593][177170] DAMAGECOUNT value on done: 203242.0 [2023-02-24 18:51:00,594][177170] Sum rewards: 15.990, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.915', 'AMMO5': '0.012', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.107', 'AMMO4': '0.136', 'weapon5': '0.156', 'WEAPON4': '0.250', 'weapon4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'weapon2': '0.764', 'HITCOUNT': '0.990', 'weapon3': '1.792', 'DAMAGECOUNT': '4.542', 'FRAGCOUNT': '14.000'} [2023-02-24 18:51:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13829.2). Total num frames: 73826304. Throughput: 0: 3457.8. Samples: 18457952. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 18:51:01,376][177119] Avg episode reward: [(0, '13.958')] [2023-02-24 18:51:01,453][177158] DAMAGECOUNT value on done: 198359.0 [2023-02-24 18:51:01,454][177158] Sum rewards: 19.086, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.840', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'weapon7': '0.054', 'AMMO4': '0.095', 'AMMO3': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.218', 'weapon4': '0.378', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'weapon2': '0.970', 'HITCOUNT': '1.450', 'weapon3': '1.912', 'DAMAGECOUNT': '5.580', 'FRAGCOUNT': '15.500'} [2023-02-24 18:51:01,749][177158] DAMAGECOUNT value on done: 200579.0 [2023-02-24 18:51:01,750][177158] Sum rewards: 22.808, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.090', 'AMMO5': '0.013', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.074', 'AMMO4': '0.096', 'AMMO3': '0.162', 'weapon4': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.890', 'WEAPON3': '1.150', 'HITCOUNT': '1.840', 'weapon3': '2.554', 'DAMAGECOUNT': '7.080', 'FRAGCOUNT': '20.000'} [2023-02-24 18:51:02,659][177158] DAMAGECOUNT value on done: 209004.0 [2023-02-24 18:51:02,660][177158] Sum rewards: 15.127, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.828', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon7': '0.058', 'AMMO3': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.101', 'weapon5': '0.136', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.461', 'WEAPON3': '0.550', 'weapon4': '0.560', 'weapon2': '0.570', 'HITCOUNT': '1.060', 'weapon3': '1.440', 'DAMAGECOUNT': '4.860', 'FRAGCOUNT': '12.000'} [2023-02-24 18:51:02,962][177158] DAMAGECOUNT value on done: 209832.0 [2023-02-24 18:51:02,963][177158] Sum rewards: 13.225, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.140', 'AMMO5': '0.007', 'AMMO2': '0.016', 'ARMOR': '0.040', 'weapon7': '0.066', 'AMMO4': '0.082', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.432', 'WEAPON3': '0.650', 'weapon2': '0.794', 'HITCOUNT': '0.930', 'weapon3': '1.246', 'DAMAGECOUNT': '3.201', 'FRAGCOUNT': '11.000'} [2023-02-24 18:51:02,981][177153] Updated weights for policy 0, policy_version 18030 (0.0008) [2023-02-24 18:51:04,674][177172] DAMAGECOUNT value on done: 206251.0 [2023-02-24 18:51:04,675][177172] Sum rewards: 12.009, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.024', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO5': '0.025', 'weapon7': '0.054', 'AMMO3': '0.081', 'AMMO4': '0.081', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.114', 'weapon5': '0.310', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '0.820', 'weapon2': '1.326', 'weapon3': '1.844', 'DAMAGECOUNT': '3.201', 'FRAGCOUNT': '8.000'} [2023-02-24 18:51:04,980][177172] DAMAGECOUNT value on done: 202746.0 [2023-02-24 18:51:04,980][177172] Sum rewards: 13.247, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.012', 'HEALTH': '0.022', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'AMMO3': '0.073', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.270', 'weapon5': '0.278', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.830', 'weapon2': '1.334', 'weapon3': '1.718', 'DAMAGECOUNT': '3.123', 'FRAGCOUNT': '9.000'} [2023-02-24 18:51:05,959][177153] Updated weights for policy 0, policy_version 18040 (0.0009) [2023-02-24 18:51:06,376][177119] Fps is (10 sec: 13926.7, 60 sec: 13858.1, 300 sec: 13829.2). Total num frames: 73895936. Throughput: 0: 3457.4. Samples: 18468282. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 18:51:06,376][177119] Avg episode reward: [(0, '14.049')] [2023-02-24 18:51:06,553][177154] DAMAGECOUNT value on done: 207458.0 [2023-02-24 18:51:06,554][177154] Sum rewards: 11.370, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.140', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO4': '0.044', 'weapon7': '0.074', 'AMMO3': '0.089', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.422', 'WEAPON3': '0.600', 'HITCOUNT': '0.880', 'weapon2': '1.122', 'weapon3': '1.626', 'DAMAGECOUNT': '4.008', 'FRAGCOUNT': '9.000'} [2023-02-24 18:51:06,697][177172] DAMAGECOUNT value on done: 206568.0 [2023-02-24 18:51:06,697][177172] Sum rewards: 20.355, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.510', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.020', 'weapon4': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'weapon5': '0.184', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '0.990', 'weapon2': '1.690', 'weapon3': '1.762', 'DAMAGECOUNT': '5.361', 'FRAGCOUNT': '15.000'} [2023-02-24 18:51:06,868][177154] DAMAGECOUNT value on done: 211694.0 [2023-02-24 18:51:06,868][177154] Sum rewards: 10.143, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.780', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.032', 'AMMO3': '0.139', 'AMMO4': '0.162', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.282', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon4': '0.646', 'weapon2': '0.698', 'HITCOUNT': '0.870', 'WEAPON3': '0.950', 'weapon3': '1.920', 'DAMAGECOUNT': '4.581', 'FRAGCOUNT': '12.000'} [2023-02-24 18:51:06,995][177172] DAMAGECOUNT value on done: 205120.0 [2023-02-24 18:51:06,996][177172] Sum rewards: 8.638, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.704', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.006', 'WEAPON1': '0.010', 'weapon5': '0.048', 'AMMO3': '0.083', 'ARMOR': '0.092', 'WEAPON5': '0.100', 'weapon7': '0.116', 'WEAPON4': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.360', 'WEAPON7': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.710', 'weapon2': '1.256', 'weapon3': '1.698', 'DAMAGECOUNT': '3.027', 'FRAGCOUNT': '7.000'} [2023-02-24 18:51:07,183][177154] DAMAGECOUNT value on done: 219629.0 [2023-02-24 18:51:07,184][177154] Sum rewards: 15.431, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.447', 'ARMOR': '0.004', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.039', 'weapon7': '0.104', 'AMMO3': '0.107', 'weapon5': '0.172', 'AMMO4': '0.195', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.688', 'WEAPON3': '0.700', 'weapon2': '0.846', 'HITCOUNT': '1.100', 'weapon3': '1.704', 'DAMAGECOUNT': '5.046', 'FRAGCOUNT': '13.000'} [2023-02-24 18:51:07,488][177154] DAMAGECOUNT value on done: 213032.0 [2023-02-24 18:51:07,488][177154] Sum rewards: 9.116, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.782', 'AMMO5': '0.005', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.034', 'weapon7': '0.052', 'AMMO3': '0.059', 'weapon5': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.280', 'WEAPON3': '0.400', 'HITCOUNT': '0.770', 'weapon3': '0.934', 'weapon2': '1.522', 'DAMAGECOUNT': '2.571', 'FRAGCOUNT': '7.000'} [2023-02-24 18:51:07,501][177157] DAMAGECOUNT value on done: 211978.0 [2023-02-24 18:51:07,502][177157] Sum rewards: 24.064, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.830', 'WEAPON1': '0.010', 'AMMO5': '0.032', 'AMMO2': '0.050', 'AMMO3': '0.116', 'AMMO4': '0.248', 'weapon5': '0.258', 'ARMOR': '0.400', 'WEAPON4': '0.500', 'WEAPON5': '0.650', 'weapon2': '0.656', 'weapon4': '0.714', 'WEAPON3': '0.750', 'weapon3': '1.538', 'HITCOUNT': '1.590', 'DAMAGECOUNT': '8.382', 'FRAGCOUNT': '19.000'} [2023-02-24 18:51:07,540][177157] DAMAGECOUNT value on done: 198584.0 [2023-02-24 18:51:07,540][177157] Sum rewards: 13.108, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.040', 'AMMO2': '0.024', 'AMMO5': '0.027', 'WEAPON1': '0.040', 'AMMO4': '0.120', 'weapon4': '0.190', 'AMMO3': '0.193', 'weapon5': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.500', 'weapon2': '0.608', 'WEAPON3': '1.200', 'HITCOUNT': '1.390', 'weapon3': '2.524', 'DAMAGECOUNT': '5.382', 'FRAGCOUNT': '15.000'} [2023-02-24 18:51:07,692][177171] DAMAGECOUNT value on done: 200518.0 [2023-02-24 18:51:07,693][177171] Sum rewards: 11.203, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.200', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.010', 'weapon7': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.138', 'weapon5': '0.144', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.700', 'HITCOUNT': '0.750', 'weapon3': '1.304', 'weapon2': '1.844', 'DAMAGECOUNT': '3.825', 'FRAGCOUNT': '8.000'} [2023-02-24 18:51:07,811][177157] DAMAGECOUNT value on done: 201484.0 [2023-02-24 18:51:07,811][177157] Sum rewards: 10.509, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.140', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.031', 'ARMOR': '0.040', 'weapon5': '0.052', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.426', 'weapon2': '0.706', 'HITCOUNT': '0.840', 'WEAPON3': '1.050', 'weapon3': '1.928', 'DAMAGECOUNT': '3.645', 'FRAGCOUNT': '13.000'} [2023-02-24 18:51:07,851][177157] DAMAGECOUNT value on done: 201332.0 [2023-02-24 18:51:07,852][177157] Sum rewards: 20.404, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.877', 'AMMO5': '0.015', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'AMMO3': '0.104', 'AMMO4': '0.107', 'weapon5': '0.126', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.502', 'WEAPON3': '0.650', 'weapon2': '0.774', 'HITCOUNT': '1.270', 'weapon3': '1.628', 'DAMAGECOUNT': '5.913', 'FRAGCOUNT': '17.000'} [2023-02-24 18:51:07,991][177171] DAMAGECOUNT value on done: 204095.0 [2023-02-24 18:51:07,991][177171] Sum rewards: 6.148, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.653', 'AMMO5': '0.017', 'AMMO2': '0.038', 'WEAPON1': '0.050', 'weapon4': '0.106', 'AMMO3': '0.125', 'weapon5': '0.146', 'WEAPON4': '0.150', 'AMMO4': '0.192', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '0.760', 'weapon2': '1.546', 'weapon3': '1.730', 'DAMAGECOUNT': '2.790', 'FRAGCOUNT': '7.000'} [2023-02-24 18:51:08,001][177171] DAMAGECOUNT value on done: 210382.0 [2023-02-24 18:51:08,002][177171] Sum rewards: 11.965, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.782', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO2': '0.032', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.106', 'AMMO4': '0.158', 'AMMO3': '0.201', 'WEAPON4': '0.350', 'weapon4': '0.434', 'WEAPON5': '0.500', 'weapon2': '0.570', 'WEAPON3': '1.200', 'HITCOUNT': '1.370', 'weapon3': '2.510', 'DAMAGECOUNT': '5.919', 'FRAGCOUNT': '15.000'} [2023-02-24 18:51:08,307][177171] DAMAGECOUNT value on done: 203014.0 [2023-02-24 18:51:08,308][177171] Sum rewards: 16.159, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.593', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.140', 'weapon5': '0.168', 'WEAPON5': '0.350', 'ARMOR': '0.484', 'WEAPON4': '0.600', 'weapon2': '0.828', 'WEAPON3': '0.850', 'weapon4': '0.890', 'HITCOUNT': '1.190', 'weapon3': '1.458', 'DAMAGECOUNT': '4.383', 'FRAGCOUNT': '16.000'} [2023-02-24 18:51:08,929][177153] Updated weights for policy 0, policy_version 18050 (0.0009) [2023-02-24 18:51:09,155][177155] DAMAGECOUNT value on done: 203495.0 [2023-02-24 18:51:09,156][177155] Sum rewards: 10.303, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.410', 'AMMO2': '0.019', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'weapon7': '0.052', 'AMMO4': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon4': '0.130', 'weapon5': '0.218', 'ARMOR': '0.456', 'WEAPON5': '0.500', 'HITCOUNT': '0.770', 'WEAPON3': '0.800', 'weapon2': '1.444', 'weapon3': '1.644', 'DAMAGECOUNT': '3.273', 'FRAGCOUNT': '10.000'} [2023-02-24 18:51:09,450][177155] DAMAGECOUNT value on done: 212146.0 [2023-02-24 18:51:09,451][177155] Sum rewards: 12.163, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.134', 'AMMO2': '0.016', 'AMMO5': '0.022', 'WEAPON1': '0.040', 'AMMO4': '0.078', 'AMMO3': '0.132', 'weapon5': '0.232', 'WEAPON4': '0.250', 'weapon4': '0.448', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'weapon2': '1.032', 'HITCOUNT': '1.130', 'weapon3': '1.818', 'DAMAGECOUNT': '4.548', 'FRAGCOUNT': '12.000'} [2023-02-24 18:51:09,774][177155] DAMAGECOUNT value on done: 213553.0 [2023-02-24 18:51:09,775][177155] Sum rewards: 15.952, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.600', 'AMMO2': '0.007', 'AMMO5': '0.019', 'WEAPON1': '0.030', 'weapon4': '0.032', 'AMMO4': '0.035', 'weapon7': '0.048', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.232', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.960', 'weapon3': '1.572', 'weapon2': '1.592', 'DAMAGECOUNT': '3.609', 'FRAGCOUNT': '12.000'} [2023-02-24 18:51:10,081][177155] DAMAGECOUNT value on done: 200026.0 [2023-02-24 18:51:10,081][177155] Sum rewards: 17.351, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.460', 'AMMO2': '0.006', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.030', 'weapon5': '0.164', 'AMMO3': '0.178', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'HITCOUNT': '1.200', 'weapon2': '1.254', 'weapon3': '2.308', 'DAMAGECOUNT': '5.688', 'FRAGCOUNT': '15.000'} [2023-02-24 18:51:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13829.2). Total num frames: 73965568. Throughput: 0: 3459.2. Samples: 18489078. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 18:51:11,376][177119] Avg episode reward: [(0, '14.317')] [2023-02-24 18:51:11,877][177153] Updated weights for policy 0, policy_version 18060 (0.0009) [2023-02-24 18:51:14,827][177153] Updated weights for policy 0, policy_version 18070 (0.0008) [2023-02-24 18:51:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13829.2). Total num frames: 74035200. Throughput: 0: 3461.5. Samples: 18509894. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:51:16,376][177119] Avg episode reward: [(0, '14.317')] [2023-02-24 18:51:17,733][177156] DAMAGECOUNT value on done: 207537.0 [2023-02-24 18:51:17,734][177156] Sum rewards: 19.312, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.554', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.134', 'weapon4': '0.160', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.318', 'WEAPON5': '0.550', 'WEAPON3': '0.950', 'weapon2': '0.962', 'HITCOUNT': '1.070', 'weapon3': '2.182', 'DAMAGECOUNT': '4.833', 'FRAGCOUNT': '18.000'} [2023-02-24 18:51:17,757][177156] DAMAGECOUNT value on done: 204091.0 [2023-02-24 18:51:17,757][177156] Sum rewards: 21.110, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.154', 'weapon7': '0.002', 'AMMO2': '0.017', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.085', 'AMMO3': '0.110', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.282', 'ARMOR': '0.400', 'weapon4': '0.460', 'WEAPON5': '0.500', 'weapon2': '0.686', 'WEAPON3': '0.850', 'HITCOUNT': '1.060', 'weapon3': '2.088', 'DAMAGECOUNT': '6.135', 'FRAGCOUNT': '17.000'} [2023-02-24 18:51:17,769][177153] Updated weights for policy 0, policy_version 18080 (0.0008) [2023-02-24 18:51:18,036][177156] DAMAGECOUNT value on done: 212302.0 [2023-02-24 18:51:18,037][177156] Sum rewards: 14.818, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.740', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'weapon5': '0.046', 'AMMO4': '0.053', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'weapon7': '0.104', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'WEAPON7': '0.400', 'ARMOR': '0.467', 'weapon4': '0.548', 'WEAPON3': '0.600', 'HITCOUNT': '0.870', 'weapon2': '0.888', 'weapon3': '1.280', 'DAMAGECOUNT': '4.095', 'FRAGCOUNT': '12.000'} [2023-02-24 18:51:18,058][177156] DAMAGECOUNT value on done: 204832.0 [2023-02-24 18:51:18,059][177156] Sum rewards: 20.140, reward structure: {'DEATHCOUNT': '-10.500', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'weapon5': '0.224', 'weapon4': '0.268', 'HEALTH': '0.412', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'weapon2': '0.910', 'HITCOUNT': '1.150', 'weapon3': '2.180', 'DAMAGECOUNT': '5.844', 'FRAGCOUNT': '18.000'} [2023-02-24 18:51:19,123][177170] DAMAGECOUNT value on done: 208214.0 [2023-02-24 18:51:19,123][177170] Sum rewards: 13.148, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.875', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.029', 'AMMO3': '0.112', 'AMMO4': '0.143', 'WEAPON4': '0.150', 'weapon5': '0.196', 'weapon4': '0.398', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'weapon2': '0.908', 'HITCOUNT': '1.070', 'weapon3': '1.806', 'DAMAGECOUNT': '4.224', 'FRAGCOUNT': '12.000'} [2023-02-24 18:51:19,433][177170] DAMAGECOUNT value on done: 215251.0 [2023-02-24 18:51:19,433][177170] Sum rewards: 21.320, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.348', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.026', 'weapon4': '0.122', 'AMMO4': '0.130', 'AMMO3': '0.141', 'weapon5': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.450', 'weapon2': '0.812', 'WEAPON3': '0.950', 'HITCOUNT': '1.590', 'weapon3': '2.548', 'DAMAGECOUNT': '5.973', 'FRAGCOUNT': '20.000'} [2023-02-24 18:51:19,739][177170] DAMAGECOUNT value on done: 208074.0 [2023-02-24 18:51:19,740][177170] Sum rewards: 19.836, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.178', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'AMMO3': '0.083', 'AMMO4': '0.135', 'weapon5': '0.162', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.506', 'weapon2': '0.618', 'HITCOUNT': '1.160', 'weapon3': '1.434', 'DAMAGECOUNT': '5.061', 'FRAGCOUNT': '14.000'} [2023-02-24 18:51:20,035][177170] DAMAGECOUNT value on done: 205487.0 [2023-02-24 18:51:20,035][177170] Sum rewards: 23.872, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.417', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.027', 'AMMO3': '0.118', 'AMMO4': '0.134', 'WEAPON4': '0.200', 'weapon4': '0.240', 'weapon5': '0.304', 'WEAPON5': '0.650', 'WEAPON3': '0.850', 'weapon2': '1.238', 'HITCOUNT': '1.440', 'weapon3': '1.810', 'DAMAGECOUNT': '6.735', 'FRAGCOUNT': '19.000'} [2023-02-24 18:51:20,729][177153] Updated weights for policy 0, policy_version 18090 (0.0008) [2023-02-24 18:51:20,840][177158] DAMAGECOUNT value on done: 199751.0 [2023-02-24 18:51:20,840][177158] Sum rewards: 5.761, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.500', 'WEAPON1': '0.010', 'AMMO5': '0.029', 'AMMO2': '0.049', 'AMMO3': '0.087', 'AMMO4': '0.246', 'weapon5': '0.304', 'ARMOR': '0.456', 'WEAPON4': '0.500', 'WEAPON3': '0.500', 'weapon4': '0.528', 'WEAPON5': '0.550', 'HITCOUNT': '0.910', 'weapon2': '1.162', 'weapon3': '1.614', 'DAMAGECOUNT': '3.816', 'FRAGCOUNT': '6.000'} [2023-02-24 18:51:21,139][177158] DAMAGECOUNT value on done: 201907.0 [2023-02-24 18:51:21,140][177158] Sum rewards: 14.317, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.930', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.037', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO3': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.232', 'WEAPON5': '0.350', 'weapon4': '0.482', 'WEAPON3': '0.800', 'weapon2': '0.808', 'HITCOUNT': '0.870', 'weapon3': '1.630', 'DAMAGECOUNT': '3.984', 'FRAGCOUNT': '13.000'} [2023-02-24 18:51:21,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13829.2). Total num frames: 74104832. Throughput: 0: 3460.5. Samples: 18520312. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:51:21,376][177119] Avg episode reward: [(0, '14.954')] [2023-02-24 18:51:22,038][177158] DAMAGECOUNT value on done: 210949.0 [2023-02-24 18:51:22,039][177158] Sum rewards: 22.985, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.432', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO3': '0.107', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'weapon5': '0.160', 'WEAPON4': '0.300', 'weapon4': '0.428', 'ARMOR': '0.494', 'WEAPON3': '0.650', 'weapon2': '1.022', 'HITCOUNT': '1.380', 'weapon3': '1.996', 'DAMAGECOUNT': '5.835', 'FRAGCOUNT': '19.000'} [2023-02-24 18:51:22,343][177158] DAMAGECOUNT value on done: 210941.0 [2023-02-24 18:51:22,344][177158] Sum rewards: 12.645, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.040', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.125', 'weapon5': '0.132', 'AMMO4': '0.166', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'ARMOR': '0.404', 'weapon4': '0.484', 'weapon2': '0.486', 'WEAPON3': '0.750', 'HITCOUNT': '0.850', 'weapon3': '2.042', 'DAMAGECOUNT': '3.327', 'FRAGCOUNT': '13.000'} [2023-02-24 18:51:23,673][177153] Updated weights for policy 0, policy_version 18100 (0.0008) [2023-02-24 18:51:24,069][177172] DAMAGECOUNT value on done: 207196.0 [2023-02-24 18:51:24,069][177172] Sum rewards: 12.201, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.005', 'weapon7': '0.052', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'weapon5': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HEALTH': '0.199', 'WEAPON7': '0.200', 'WEAPON3': '0.450', 'ARMOR': '0.494', 'HITCOUNT': '0.770', 'weapon3': '1.568', 'weapon2': '1.596', 'DAMAGECOUNT': '2.835', 'FRAGCOUNT': '8.000'} [2023-02-24 18:51:24,376][177172] DAMAGECOUNT value on done: 203759.0 [2023-02-24 18:51:24,376][177172] Sum rewards: 8.255, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.090', 'AMMO2': '0.012', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.060', 'weapon7': '0.100', 'AMMO3': '0.126', 'weapon5': '0.178', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.450', 'weapon4': '0.656', 'weapon2': '0.724', 'HITCOUNT': '0.740', 'WEAPON3': '0.800', 'weapon3': '1.482', 'DAMAGECOUNT': '3.039', 'FRAGCOUNT': '9.000'} [2023-02-24 18:51:25,920][177154] DAMAGECOUNT value on done: 209448.0 [2023-02-24 18:51:25,921][177154] Sum rewards: 18.170, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.020', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.120', 'weapon5': '0.148', 'WEAPON5': '0.250', 'weapon4': '0.272', 'WEAPON3': '0.800', 'weapon2': '0.998', 'HITCOUNT': '1.330', 'weapon3': '1.334', 'DAMAGECOUNT': '5.970', 'FRAGCOUNT': '15.000'} [2023-02-24 18:51:25,955][177172] DAMAGECOUNT value on done: 207941.0 [2023-02-24 18:51:25,955][177172] Sum rewards: 11.780, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.620', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO5': '0.025', 'WEAPON1': '0.030', 'WEAPON4': '0.100', 'weapon4': '0.124', 'AMMO3': '0.130', 'weapon5': '0.208', 'WEAPON5': '0.600', 'WEAPON3': '1.000', 'HITCOUNT': '1.050', 'weapon2': '1.066', 'weapon3': '2.168', 'DAMAGECOUNT': '4.119', 'FRAGCOUNT': '12.000'} [2023-02-24 18:51:26,225][177154] DAMAGECOUNT value on done: 213006.0 [2023-02-24 18:51:26,226][177154] Sum rewards: 7.042, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.126', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO4': '0.081', 'AMMO3': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.388', 'weapon4': '0.570', 'WEAPON3': '0.700', 'HITCOUNT': '0.760', 'weapon3': '0.990', 'DAMAGECOUNT': '3.936', 'FRAGCOUNT': '8.500'} [2023-02-24 18:51:26,255][177172] DAMAGECOUNT value on done: 205798.0 [2023-02-24 18:51:26,255][177172] Sum rewards: 5.690, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.785', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon7': '0.048', 'AMMO3': '0.094', 'weapon5': '0.130', 'AMMO4': '0.154', 'WEAPON4': '0.300', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'HITCOUNT': '0.410', 'ARMOR': '0.451', 'weapon4': '0.644', 'WEAPON3': '0.700', 'weapon2': '0.760', 'weapon3': '1.154', 'DAMAGECOUNT': '2.034', 'FRAGCOUNT': '6.000'} [2023-02-24 18:51:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13829.2). Total num frames: 74174464. Throughput: 0: 3460.6. Samples: 18541140. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:51:26,376][177119] Avg episode reward: [(0, '14.777')] [2023-02-24 18:51:26,531][177154] DAMAGECOUNT value on done: 220886.0 [2023-02-24 18:51:26,531][177154] Sum rewards: 9.899, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.118', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.089', 'AMMO4': '0.107', 'weapon5': '0.144', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'weapon4': '0.440', 'WEAPON3': '0.700', 'weapon2': '0.720', 'HITCOUNT': '0.960', 'weapon3': '1.830', 'DAMAGECOUNT': '3.771', 'FRAGCOUNT': '9.000'} [2023-02-24 18:51:26,653][177153] Updated weights for policy 0, policy_version 18110 (0.0009) [2023-02-24 18:51:26,829][177157] DAMAGECOUNT value on done: 213460.0 [2023-02-24 18:51:26,830][177157] Sum rewards: 11.527, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.229', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.100', 'weapon7': '0.104', 'AMMO3': '0.144', 'weapon2': '0.218', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'AMMO6': '0.440', 'AMMO7': '0.440', 'WEAPON7': '0.600', 'weapon4': '0.678', 'WEAPON3': '1.000', 'HITCOUNT': '1.010', 'weapon3': '1.456', 'DAMAGECOUNT': '4.446', 'FRAGCOUNT': '13.000'} [2023-02-24 18:51:26,833][177154] DAMAGECOUNT value on done: 214252.0 [2023-02-24 18:51:26,833][177154] Sum rewards: 11.179, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.455', 'weapon7': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO3': '0.095', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.244', 'weapon5': '0.252', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.840', 'weapon2': '1.254', 'weapon3': '1.910', 'DAMAGECOUNT': '3.660', 'FRAGCOUNT': '9.000'} [2023-02-24 18:51:26,867][177157] DAMAGECOUNT value on done: 199605.0 [2023-02-24 18:51:26,867][177157] Sum rewards: 10.570, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.225', 'AMMO5': '0.019', 'AMMO2': '0.029', 'weapon7': '0.052', 'AMMO3': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.147', 'WEAPON7': '0.200', 'weapon5': '0.254', 'WEAPON5': '0.450', 'ARMOR': '0.460', 'WEAPON4': '0.550', 'WEAPON3': '0.550', 'HITCOUNT': '0.690', 'weapon4': '0.830', 'weapon2': '0.832', 'weapon3': '1.348', 'DAMAGECOUNT': '3.063', 'FRAGCOUNT': '11.000'} [2023-02-24 18:51:27,071][177171] DAMAGECOUNT value on done: 201890.0 [2023-02-24 18:51:27,072][177171] Sum rewards: 11.773, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.778', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.034', 'weapon5': '0.050', 'AMMO3': '0.096', 'weapon7': '0.148', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'AMMO6': '0.340', 'AMMO7': '0.340', 'weapon2': '0.432', 'WEAPON4': '0.450', 'WEAPON7': '0.500', 'WEAPON3': '0.550', 'weapon4': '0.858', 'HITCOUNT': '1.000', 'weapon3': '1.298', 'DAMAGECOUNT': '4.116', 'FRAGCOUNT': '11.000'} [2023-02-24 18:51:27,133][177157] DAMAGECOUNT value on done: 202740.0 [2023-02-24 18:51:27,134][177157] Sum rewards: 16.961, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.864', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'weapon5': '0.134', 'WEAPON5': '0.150', 'ARMOR': '0.400', 'weapon4': '0.460', 'WEAPON3': '0.750', 'weapon2': '0.808', 'HITCOUNT': '0.950', 'weapon3': '1.798', 'DAMAGECOUNT': '3.768', 'FRAGCOUNT': '15.000'} [2023-02-24 18:51:27,168][177157] DAMAGECOUNT value on done: 202867.0 [2023-02-24 18:51:27,169][177157] Sum rewards: 20.662, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.746', 'AMMO5': '0.017', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'AMMO3': '0.066', 'AMMO4': '0.096', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.164', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon4': '0.656', 'weapon2': '0.928', 'HITCOUNT': '1.140', 'weapon3': '1.376', 'DAMAGECOUNT': '4.605', 'FRAGCOUNT': '16.000'} [2023-02-24 18:51:27,381][177171] DAMAGECOUNT value on done: 206229.0 [2023-02-24 18:51:27,382][177171] Sum rewards: 15.732, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.848', 'AMMO5': '0.022', 'AMMO2': '0.038', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.132', 'AMMO4': '0.191', 'weapon5': '0.224', 'WEAPON4': '0.450', 'WEAPON5': '0.600', 'weapon4': '0.762', 'WEAPON3': '0.800', 'weapon2': '0.844', 'HITCOUNT': '1.180', 'weapon3': '1.580', 'DAMAGECOUNT': '6.153', 'FRAGCOUNT': '14.500'} [2023-02-24 18:51:27,390][177171] DAMAGECOUNT value on done: 212106.0 [2023-02-24 18:51:27,391][177171] Sum rewards: 16.146, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.166', 'AMMO2': '0.008', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.134', 'weapon4': '0.152', 'weapon5': '0.176', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '0.930', 'weapon2': '1.154', 'weapon3': '2.208', 'DAMAGECOUNT': '5.172', 'FRAGCOUNT': '14.000'} [2023-02-24 18:51:27,693][177171] DAMAGECOUNT value on done: 204821.0 [2023-02-24 18:51:27,693][177171] Sum rewards: 19.646, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.810', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.077', 'AMMO3': '0.090', 'weapon7': '0.096', 'weapon5': '0.124', 'weapon4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '1.060', 'weapon2': '1.684', 'weapon3': '1.730', 'DAMAGECOUNT': '5.421', 'FRAGCOUNT': '15.000'} [2023-02-24 18:51:28,550][177155] DAMAGECOUNT value on done: 205584.0 [2023-02-24 18:51:28,550][177155] Sum rewards: 16.026, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.120', 'AMMO2': '0.023', 'AMMO5': '0.029', 'AMMO4': '0.116', 'AMMO3': '0.162', 'weapon4': '0.232', 'WEAPON4': '0.250', 'weapon5': '0.350', 'WEAPON5': '0.650', 'weapon2': '0.660', 'WEAPON3': '1.100', 'HITCOUNT': '1.490', 'weapon3': '2.316', 'DAMAGECOUNT': '6.267', 'FRAGCOUNT': '15.000'} [2023-02-24 18:51:28,849][177155] DAMAGECOUNT value on done: 212973.0 [2023-02-24 18:51:28,850][177155] Sum rewards: 9.167, reward structure: {'DEATHCOUNT': '-5.250', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'AMMO3': '0.043', 'weapon7': '0.048', 'HEALTH': '0.063', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.120', 'weapon5': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'weapon4': '0.476', 'HITCOUNT': '0.520', 'weapon2': '0.634', 'weapon3': '0.804', 'DAMAGECOUNT': '2.451', 'FRAGCOUNT': '8.000'} [2023-02-24 18:51:29,153][177155] DAMAGECOUNT value on done: 215550.0 [2023-02-24 18:51:29,154][177155] Sum rewards: 17.138, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.867', 'AMMO2': '0.004', 'AMMO4': '0.017', 'weapon4': '0.034', 'AMMO5': '0.039', 'WEAPON4': '0.100', 'AMMO3': '0.184', 'weapon5': '0.210', 'weapon2': '0.750', 'WEAPON5': '0.850', 'HITCOUNT': '1.220', 'WEAPON3': '1.300', 'weapon3': '2.556', 'DAMAGECOUNT': '5.991', 'FRAGCOUNT': '18.000'} [2023-02-24 18:51:29,453][177155] DAMAGECOUNT value on done: 201902.0 [2023-02-24 18:51:29,454][177155] Sum rewards: 16.095, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.857', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO3': '0.141', 'weapon5': '0.146', 'AMMO4': '0.191', 'weapon4': '0.266', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '0.850', 'weapon2': '1.056', 'HITCOUNT': '1.220', 'weapon3': '2.140', 'DAMAGECOUNT': '5.628', 'FRAGCOUNT': '15.000'} [2023-02-24 18:51:29,578][177153] Updated weights for policy 0, policy_version 18120 (0.0008) [2023-02-24 18:51:31,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13829.2). Total num frames: 74244096. Throughput: 0: 3460.2. Samples: 18561900. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:51:31,376][177119] Avg episode reward: [(0, '14.464')] [2023-02-24 18:51:32,519][177153] Updated weights for policy 0, policy_version 18130 (0.0008) [2023-02-24 18:51:35,504][177153] Updated weights for policy 0, policy_version 18140 (0.0008) [2023-02-24 18:51:36,376][177119] Fps is (10 sec: 13516.7, 60 sec: 13789.9, 300 sec: 13815.3). Total num frames: 74309632. Throughput: 0: 3461.3. Samples: 18572306. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:51:36,376][177119] Avg episode reward: [(0, '14.464')] [2023-02-24 18:51:37,132][177156] DAMAGECOUNT value on done: 209151.0 [2023-02-24 18:51:37,133][177156] Sum rewards: 17.761, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.460', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.066', 'AMMO3': '0.075', 'weapon5': '0.102', 'WEAPON5': '0.200', 'weapon4': '0.272', 'WEAPON4': '0.300', 'ARMOR': '0.533', 'WEAPON3': '0.600', 'HITCOUNT': '1.320', 'weapon3': '1.366', 'weapon2': '1.756', 'DAMAGECOUNT': '4.842', 'FRAGCOUNT': '16.000'} [2023-02-24 18:51:37,143][177156] DAMAGECOUNT value on done: 205489.0 [2023-02-24 18:51:37,144][177156] Sum rewards: 12.231, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.750', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'ARMOR': '0.024', 'weapon5': '0.026', 'AMMO4': '0.043', 'weapon7': '0.048', 'AMMO3': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.178', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.750', 'HITCOUNT': '0.940', 'weapon2': '1.444', 'weapon3': '1.648', 'DAMAGECOUNT': '4.194', 'FRAGCOUNT': '9.500'} [2023-02-24 18:51:37,441][177156] DAMAGECOUNT value on done: 213985.0 [2023-02-24 18:51:37,441][177156] Sum rewards: 14.576, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.562', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO5': '0.030', 'AMMO4': '0.035', 'AMMO3': '0.133', 'weapon5': '0.290', 'WEAPON4': '0.300', 'weapon4': '0.472', 'WEAPON5': '0.700', 'weapon2': '0.734', 'WEAPON3': '0.900', 'HITCOUNT': '1.170', 'weapon3': '2.048', 'DAMAGECOUNT': '5.049', 'FRAGCOUNT': '12.500'} [2023-02-24 18:51:37,452][177156] DAMAGECOUNT value on done: 206511.0 [2023-02-24 18:51:37,452][177156] Sum rewards: 16.619, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.332', 'AMMO2': '0.011', 'AMMO5': '0.014', 'weapon7': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.170', 'WEAPON5': '0.350', 'weapon4': '0.358', 'WEAPON3': '0.750', 'HITCOUNT': '1.010', 'weapon2': '1.108', 'weapon3': '1.800', 'DAMAGECOUNT': '5.037', 'FRAGCOUNT': '13.500'} [2023-02-24 18:51:38,473][177153] Updated weights for policy 0, policy_version 18150 (0.0008) [2023-02-24 18:51:38,515][177170] DAMAGECOUNT value on done: 209586.0 [2023-02-24 18:51:38,516][177170] Sum rewards: 9.123, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.215', 'AMMO2': '0.004', 'AMMO5': '0.014', 'AMMO4': '0.021', 'AMMO3': '0.136', 'weapon5': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.490', 'WEAPON3': '0.850', 'HITCOUNT': '0.900', 'weapon2': '0.996', 'weapon3': '1.806', 'DAMAGECOUNT': '4.116', 'FRAGCOUNT': '9.500'} [2023-02-24 18:51:38,820][177170] DAMAGECOUNT value on done: 216524.0 [2023-02-24 18:51:38,820][177170] Sum rewards: 10.388, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.020', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.154', 'AMMO3': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.306', 'ARMOR': '0.400', 'weapon2': '0.708', 'WEAPON3': '0.950', 'HITCOUNT': '1.010', 'weapon3': '2.434', 'DAMAGECOUNT': '3.819', 'FRAGCOUNT': '11.500'} [2023-02-24 18:51:39,132][177170] DAMAGECOUNT value on done: 209481.0 [2023-02-24 18:51:39,132][177170] Sum rewards: 8.043, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.224', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon7': '0.046', 'AMMO4': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.117', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.170', 'weapon4': '0.300', 'WEAPON3': '0.750', 'HITCOUNT': '0.960', 'weapon2': '1.474', 'weapon3': '1.752', 'DAMAGECOUNT': '4.221', 'FRAGCOUNT': '8.500'} [2023-02-24 18:51:39,433][177170] DAMAGECOUNT value on done: 206660.0 [2023-02-24 18:51:39,433][177170] Sum rewards: 10.507, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.520', 'AMMO5': '0.012', 'AMMO2': '0.018', 'ARMOR': '0.044', 'AMMO3': '0.061', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'weapon5': '0.256', 'weapon4': '0.264', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.580', 'weapon2': '1.384', 'weapon3': '1.496', 'DAMAGECOUNT': '3.519', 'FRAGCOUNT': '7.500'} [2023-02-24 18:51:40,281][177158] DAMAGECOUNT value on done: 201443.0 [2023-02-24 18:51:40,281][177158] Sum rewards: 18.160, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.156', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.020', 'AMMO3': '0.073', 'AMMO4': '0.102', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.260', 'WEAPON4': '0.300', 'weapon4': '0.332', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '1.140', 'weapon2': '1.314', 'weapon3': '1.574', 'DAMAGECOUNT': '5.076', 'FRAGCOUNT': '15.000'} [2023-02-24 18:51:40,569][177158] DAMAGECOUNT value on done: 203075.0 [2023-02-24 18:51:40,569][177158] Sum rewards: 15.674, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'AMMO3': '0.060', 'weapon5': '0.086', 'weapon7': '0.096', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.350', 'AMMO6': '0.420', 'AMMO7': '0.420', 'HEALTH': '0.490', 'WEAPON7': '0.500', 'weapon4': '0.534', 'HITCOUNT': '0.720', 'weapon2': '0.940', 'weapon3': '1.288', 'DAMAGECOUNT': '3.504', 'FRAGCOUNT': '11.000'} [2023-02-24 18:51:41,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 74379264. Throughput: 0: 3459.4. Samples: 18593046. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:51:41,376][177119] Avg episode reward: [(0, '14.231')] [2023-02-24 18:51:41,448][177153] Updated weights for policy 0, policy_version 18160 (0.0009) [2023-02-24 18:51:41,458][177158] DAMAGECOUNT value on done: 212140.0 [2023-02-24 18:51:41,458][177158] Sum rewards: 12.122, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.085', 'weapon4': '0.214', 'weapon5': '0.294', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.550', 'HEALTH': '0.696', 'weapon3': '1.366', 'weapon2': '1.426', 'DAMAGECOUNT': '3.549', 'FRAGCOUNT': '6.500'} [2023-02-24 18:51:41,758][177158] DAMAGECOUNT value on done: 212339.0 [2023-02-24 18:51:41,759][177158] Sum rewards: 17.902, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.016', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'AMMO3': '0.087', 'AMMO4': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.110', 'weapon5': '0.194', 'weapon4': '0.236', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.890', 'weapon2': '1.080', 'weapon3': '1.650', 'DAMAGECOUNT': '4.194', 'FRAGCOUNT': '13.000'} [2023-02-24 18:51:43,508][177172] DAMAGECOUNT value on done: 208790.0 [2023-02-24 18:51:43,508][177172] Sum rewards: 14.247, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.349', 'AMMO2': '0.016', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'weapon5': '0.240', 'weapon4': '0.326', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'weapon2': '0.952', 'HITCOUNT': '1.110', 'weapon3': '1.966', 'DAMAGECOUNT': '4.782', 'FRAGCOUNT': '12.000'} [2023-02-24 18:51:43,819][177172] DAMAGECOUNT value on done: 205382.0 [2023-02-24 18:51:43,819][177172] Sum rewards: 19.445, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.248', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon7': '0.048', 'weapon4': '0.084', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.156', 'weapon5': '0.158', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.900', 'HITCOUNT': '1.000', 'weapon2': '1.430', 'weapon3': '1.954', 'DAMAGECOUNT': '4.869', 'FRAGCOUNT': '17.000'} [2023-02-24 18:51:44,415][177153] Updated weights for policy 0, policy_version 18170 (0.0008) [2023-02-24 18:51:45,335][177154] DAMAGECOUNT value on done: 210551.0 [2023-02-24 18:51:45,336][177154] Sum rewards: 14.105, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.016', 'AMMO3': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.079', 'HEALTH': '0.115', 'weapon7': '0.154', 'WEAPON4': '0.200', 'WEAPON3': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'weapon4': '0.550', 'HITCOUNT': '0.930', 'weapon3': '0.952', 'weapon2': '1.102', 'DAMAGECOUNT': '3.309', 'FRAGCOUNT': '9.000'} [2023-02-24 18:51:45,396][177172] DAMAGECOUNT value on done: 209975.0 [2023-02-24 18:51:45,396][177172] Sum rewards: 16.612, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.630', 'AMMO2': '0.011', 'AMMO5': '0.029', 'AMMO4': '0.057', 'AMMO3': '0.160', 'weapon5': '0.164', 'weapon4': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.600', 'weapon2': '1.032', 'WEAPON3': '1.100', 'HITCOUNT': '1.560', 'weapon3': '2.286', 'DAMAGECOUNT': '6.102', 'FRAGCOUNT': '17.000'} [2023-02-24 18:51:45,639][177154] DAMAGECOUNT value on done: 214518.0 [2023-02-24 18:51:45,640][177154] Sum rewards: 15.315, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.601', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.007', 'weapon7': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'weapon5': '0.132', 'WEAPON5': '0.200', 'weapon4': '0.242', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.800', 'HITCOUNT': '1.090', 'weapon2': '1.296', 'weapon3': '1.844', 'DAMAGECOUNT': '4.536', 'FRAGCOUNT': '13.000'} [2023-02-24 18:51:45,706][177172] DAMAGECOUNT value on done: 207052.0 [2023-02-24 18:51:45,707][177172] Sum rewards: 11.129, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.960', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.072', 'ARMOR': '0.076', 'weapon7': '0.090', 'AMMO3': '0.109', 'weapon5': '0.162', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.300', 'WEAPON7': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.730', 'weapon4': '0.736', 'WEAPON3': '0.800', 'HITCOUNT': '0.800', 'weapon3': '1.326', 'DAMAGECOUNT': '3.762', 'FRAGCOUNT': '12.000'} [2023-02-24 18:51:45,961][177154] DAMAGECOUNT value on done: 222655.0 [2023-02-24 18:51:45,962][177154] Sum rewards: 17.884, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.456', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon7': '0.062', 'AMMO3': '0.065', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.168', 'WEAPON7': '0.200', 'weapon5': '0.250', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'weapon2': '0.650', 'weapon4': '0.694', 'ARMOR': '0.800', 'HITCOUNT': '0.920', 'weapon3': '1.286', 'DAMAGECOUNT': '5.307', 'FRAGCOUNT': '14.000'} [2023-02-24 18:51:46,260][177154] DAMAGECOUNT value on done: 215192.0 [2023-02-24 18:51:46,260][177154] Sum rewards: 13.128, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.350', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon7': '0.048', 'AMMO4': '0.072', 'AMMO3': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.160', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'ARMOR': '0.475', 'weapon4': '0.488', 'WEAPON3': '0.550', 'weapon2': '0.630', 'HITCOUNT': '0.740', 'weapon3': '1.576', 'DAMAGECOUNT': '2.820', 'FRAGCOUNT': '11.000'} [2023-02-24 18:51:46,320][177157] DAMAGECOUNT value on done: 215186.0 [2023-02-24 18:51:46,320][177157] Sum rewards: 13.919, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.940', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.027', 'weapon7': '0.056', 'AMMO3': '0.079', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.164', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'weapon4': '0.596', 'weapon2': '0.942', 'HITCOUNT': '1.170', 'weapon3': '1.392', 'DAMAGECOUNT': '5.178', 'FRAGCOUNT': '10.500'} [2023-02-24 18:51:46,360][177157] DAMAGECOUNT value on done: 200681.0 [2023-02-24 18:51:46,360][177157] Sum rewards: 12.213, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.330', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon7': '0.048', 'AMMO3': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.158', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.270', 'WEAPON3': '0.550', 'HITCOUNT': '0.810', 'weapon3': '1.434', 'weapon2': '1.696', 'DAMAGECOUNT': '3.228', 'FRAGCOUNT': '11.000'} [2023-02-24 18:51:46,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13789.8, 300 sec: 13829.2). Total num frames: 74448896. Throughput: 0: 3462.2. Samples: 18613750. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:51:46,376][177119] Avg episode reward: [(0, '14.148')] [2023-02-24 18:51:46,516][177171] DAMAGECOUNT value on done: 203469.0 [2023-02-24 18:51:46,516][177171] Sum rewards: 21.830, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.600', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.090', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.204', 'weapon4': '0.204', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'weapon2': '1.218', 'HITCOUNT': '1.220', 'weapon3': '1.984', 'DAMAGECOUNT': '4.737', 'FRAGCOUNT': '18.000'} [2023-02-24 18:51:46,638][177157] DAMAGECOUNT value on done: 203929.0 [2023-02-24 18:51:46,639][177157] Sum rewards: 7.091, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.806', 'AMMO5': '0.018', 'AMMO2': '0.023', 'ARMOR': '0.060', 'weapon5': '0.072', 'AMMO4': '0.115', 'weapon4': '0.126', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.784', 'HITCOUNT': '1.060', 'WEAPON3': '1.100', 'weapon3': '2.694', 'DAMAGECOUNT': '3.567', 'FRAGCOUNT': '11.000'} [2023-02-24 18:51:46,677][177157] DAMAGECOUNT value on done: 204103.0 [2023-02-24 18:51:46,677][177157] Sum rewards: 9.839, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.090', 'AMMO2': '0.012', 'AMMO5': '0.012', 'AMMO4': '0.062', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.102', 'weapon4': '0.116', 'AMMO3': '0.132', 'WEAPON5': '0.300', 'WEAPON3': '0.800', 'HITCOUNT': '0.960', 'weapon2': '1.680', 'weapon3': '1.830', 'DAMAGECOUNT': '3.708', 'FRAGCOUNT': '9.000'} [2023-02-24 18:51:46,802][177171] DAMAGECOUNT value on done: 206979.0 [2023-02-24 18:51:46,802][177171] Sum rewards: 7.732, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.145', 'AMMO2': '0.004', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.020', 'AMMO3': '0.060', 'weapon7': '0.070', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO6': '0.280', 'AMMO7': '0.280', 'weapon4': '0.322', 'WEAPON7': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.550', 'weapon3': '1.264', 'weapon2': '1.952', 'DAMAGECOUNT': '2.250', 'FRAGCOUNT': '4.000'} [2023-02-24 18:51:46,811][177171] DAMAGECOUNT value on done: 214236.0 [2023-02-24 18:51:46,811][177171] Sum rewards: 22.428, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.513', 'ARMOR': '0.004', 'AMMO2': '0.012', 'AMMO5': '0.015', 'AMMO4': '0.060', 'AMMO3': '0.140', 'weapon5': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.380', 'WEAPON3': '0.950', 'weapon2': '0.952', 'HITCOUNT': '1.350', 'weapon3': '2.166', 'DAMAGECOUNT': '6.390', 'FRAGCOUNT': '19.000'} [2023-02-24 18:51:47,108][177171] DAMAGECOUNT value on done: 206231.0 [2023-02-24 18:51:47,109][177171] Sum rewards: 16.747, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.230', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO3': '0.084', 'weapon7': '0.104', 'weapon5': '0.124', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON7': '0.400', 'ARMOR': '0.455', 'WEAPON3': '0.550', 'weapon4': '0.636', 'HITCOUNT': '0.940', 'weapon2': '1.108', 'weapon3': '1.308', 'DAMAGECOUNT': '4.230', 'FRAGCOUNT': '13.000'} [2023-02-24 18:51:47,369][177153] Updated weights for policy 0, policy_version 18180 (0.0008) [2023-02-24 18:51:47,985][177155] DAMAGECOUNT value on done: 206823.0 [2023-02-24 18:51:47,985][177155] Sum rewards: 11.244, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.965', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'weapon7': '0.054', 'AMMO4': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.130', 'AMMO3': '0.133', 'WEAPON5': '0.200', 'weapon4': '0.244', 'HITCOUNT': '0.750', 'weapon2': '0.806', 'WEAPON3': '0.900', 'weapon3': '1.340', 'DAMAGECOUNT': '3.717', 'FRAGCOUNT': '12.000'} [2023-02-24 18:51:48,285][177155] DAMAGECOUNT value on done: 214335.0 [2023-02-24 18:51:48,285][177155] Sum rewards: 12.359, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.176', 'AMMO2': '0.007', 'AMMO5': '0.016', 'WEAPON1': '0.030', 'AMMO4': '0.035', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'weapon5': '0.246', 'WEAPON5': '0.350', 'weapon4': '0.374', 'weapon2': '0.478', 'WEAPON3': '0.800', 'HITCOUNT': '1.000', 'weapon3': '2.244', 'DAMAGECOUNT': '4.086', 'FRAGCOUNT': '12.000'} [2023-02-24 18:51:48,575][177155] DAMAGECOUNT value on done: 217473.0 [2023-02-24 18:51:48,576][177155] Sum rewards: 20.558, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.824', 'AMMO2': '0.002', 'WEAPON1': '0.010', 'AMMO4': '0.010', 'AMMO5': '0.012', 'weapon7': '0.046', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.112', 'weapon5': '0.204', 'weapon4': '0.284', 'WEAPON5': '0.350', 'weapon2': '0.606', 'WEAPON3': '0.800', 'HITCOUNT': '1.160', 'weapon3': '2.116', 'DAMAGECOUNT': '5.769', 'FRAGCOUNT': '17.000'} [2023-02-24 18:51:48,737][177157] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 18:51:48,870][177155] DAMAGECOUNT value on done: 203434.0 [2023-02-24 18:51:48,871][177155] Sum rewards: 18.093, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.994', 'AMMO2': '0.016', 'AMMO5': '0.017', 'weapon7': '0.072', 'AMMO4': '0.078', 'AMMO3': '0.094', 'weapon5': '0.242', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'weapon4': '0.470', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'HITCOUNT': '1.090', 'weapon2': '1.132', 'weapon3': '1.440', 'DAMAGECOUNT': '4.596', 'FRAGCOUNT': '15.000'} [2023-02-24 18:51:50,274][177153] Updated weights for policy 0, policy_version 18190 (0.0008) [2023-02-24 18:51:51,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13829.2). Total num frames: 74518528. Throughput: 0: 3465.1. Samples: 18624212. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:51:51,376][177119] Avg episode reward: [(0, '14.216')] [2023-02-24 18:51:53,161][177153] Updated weights for policy 0, policy_version 18200 (0.0008) [2023-02-24 18:51:55,459][177170] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:51:56,107][177153] Updated weights for policy 0, policy_version 18210 (0.0008) [2023-02-24 18:51:56,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.2, 300 sec: 13829.2). Total num frames: 74588160. Throughput: 0: 3470.8. Samples: 18645264. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:51:56,376][177119] Avg episode reward: [(0, '14.216')] [2023-02-24 18:51:56,443][177156] DAMAGECOUNT value on done: 210827.0 [2023-02-24 18:51:56,443][177156] Sum rewards: 11.284, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.879', 'AMMO2': '0.011', 'AMMO5': '0.012', 'weapon5': '0.052', 'AMMO4': '0.053', 'AMMO3': '0.116', 'weapon7': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.252', 'weapon2': '0.548', 'WEAPON3': '0.700', 'HITCOUNT': '1.000', 'weapon3': '1.882', 'DAMAGECOUNT': '5.028', 'FRAGCOUNT': '12.000'} [2023-02-24 18:51:56,453][177156] DAMAGECOUNT value on done: 206846.0 [2023-02-24 18:51:56,454][177156] Sum rewards: 14.845, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.574', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon7': '0.052', 'AMMO3': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.192', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.770', 'weapon3': '1.452', 'weapon2': '1.674', 'DAMAGECOUNT': '4.071', 'FRAGCOUNT': '11.000'} [2023-02-24 18:51:56,750][177156] DAMAGECOUNT value on done: 215110.0 [2023-02-24 18:51:56,751][177156] Sum rewards: 11.224, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.630', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.061', 'weapon5': '0.066', 'WEAPON5': '0.100', 'weapon7': '0.118', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.242', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.820', 'weapon2': '0.886', 'weapon3': '0.962', 'DAMAGECOUNT': '3.375', 'FRAGCOUNT': '7.000'} [2023-02-24 18:51:56,761][177156] DAMAGECOUNT value on done: 207159.0 [2023-02-24 18:51:56,761][177156] Sum rewards: 5.827, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.138', 'AMMO4': '0.188', 'WEAPON4': '0.200', 'HEALTH': '0.215', 'WEAPON3': '0.450', 'weapon4': '0.486', 'HITCOUNT': '0.530', 'weapon2': '1.052', 'weapon3': '1.086', 'DAMAGECOUNT': '1.944', 'FRAGCOUNT': '5.000'} [2023-02-24 18:51:57,727][177170] DAMAGECOUNT value on done: 211386.0 [2023-02-24 18:51:57,727][177170] Sum rewards: 15.585, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.922', 'ARMOR': '0.004', 'AMMO2': '0.010', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.048', 'weapon7': '0.058', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'weapon5': '0.152', 'WEAPON7': '0.200', 'weapon4': '0.346', 'WEAPON5': '0.350', 'weapon2': '0.744', 'WEAPON3': '0.800', 'HITCOUNT': '1.230', 'weapon3': '1.836', 'DAMAGECOUNT': '5.400', 'FRAGCOUNT': '13.000'} [2023-02-24 18:51:58,024][177170] DAMAGECOUNT value on done: 217529.0 [2023-02-24 18:51:58,024][177170] Sum rewards: 10.662, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.395', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon5': '0.058', 'AMMO3': '0.062', 'weapon7': '0.068', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.650', 'weapon3': '1.242', 'weapon2': '1.594', 'DAMAGECOUNT': '2.715', 'FRAGCOUNT': '7.000'} [2023-02-24 18:51:58,343][177170] DAMAGECOUNT value on done: 210871.0 [2023-02-24 18:51:58,343][177170] Sum rewards: 14.267, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.620', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.008', 'weapon7': '0.048', 'AMMO3': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.174', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'HITCOUNT': '0.850', 'weapon2': '1.066', 'weapon3': '1.480', 'DAMAGECOUNT': '4.170', 'FRAGCOUNT': '11.000'} [2023-02-24 18:51:58,643][177170] DAMAGECOUNT value on done: 207700.0 [2023-02-24 18:51:58,643][177170] Sum rewards: 12.125, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.724', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'AMMO3': '0.050', 'weapon5': '0.058', 'ARMOR': '0.073', 'WEAPON4': '0.100', 'weapon4': '0.100', 'weapon7': '0.104', 'WEAPON5': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'HITCOUNT': '0.690', 'weapon3': '1.032', 'weapon2': '1.148', 'DAMAGECOUNT': '3.087', 'FRAGCOUNT': '8.000'} [2023-02-24 18:51:59,046][177153] Updated weights for policy 0, policy_version 18220 (0.0008) [2023-02-24 18:51:59,539][177158] DAMAGECOUNT value on done: 202007.0 [2023-02-24 18:51:59,540][177158] Sum rewards: 5.213, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.408', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon7': '0.056', 'AMMO3': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'weapon5': '0.202', 'HITCOUNT': '0.370', 'WEAPON3': '0.500', 'ARMOR': '0.800', 'weapon3': '1.052', 'DAMAGECOUNT': '1.692', 'weapon2': '1.712', 'FRAGCOUNT': '3.000'} [2023-02-24 18:51:59,841][177158] DAMAGECOUNT value on done: 204821.0 [2023-02-24 18:51:59,841][177158] Sum rewards: 17.685, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.188', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.068', 'AMMO3': '0.098', 'AMMO4': '0.102', 'weapon7': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'weapon4': '0.538', 'WEAPON3': '0.600', 'weapon2': '0.788', 'HITCOUNT': '1.170', 'weapon3': '1.398', 'DAMAGECOUNT': '5.238', 'FRAGCOUNT': '13.000'} [2023-02-24 18:52:00,723][177158] DAMAGECOUNT value on done: 213158.0 [2023-02-24 18:52:00,723][177158] Sum rewards: 10.992, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.009', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO4': '0.046', 'weapon7': '0.068', 'AMMO3': '0.089', 'WEAPON4': '0.150', 'HEALTH': '0.195', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'weapon2': '0.772', 'HITCOUNT': '0.800', 'weapon3': '1.398', 'DAMAGECOUNT': '3.054', 'FRAGCOUNT': '9.000'} [2023-02-24 18:52:01,021][177158] DAMAGECOUNT value on done: 213808.0 [2023-02-24 18:52:01,022][177158] Sum rewards: 12.397, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.256', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.015', 'weapon5': '0.050', 'weapon7': '0.052', 'AMMO4': '0.054', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.162', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'HITCOUNT': '1.010', 'weapon2': '1.572', 'weapon3': '1.970', 'DAMAGECOUNT': '4.407', 'FRAGCOUNT': '10.000'} [2023-02-24 18:52:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.2, 300 sec: 13829.2). Total num frames: 74657792. Throughput: 0: 3470.9. Samples: 18666082. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:52:01,376][177119] Avg episode reward: [(0, '14.159')] [2023-02-24 18:52:02,002][177153] Updated weights for policy 0, policy_version 18230 (0.0008) [2023-02-24 18:52:02,787][177172] DAMAGECOUNT value on done: 209734.0 [2023-02-24 18:52:02,787][177172] Sum rewards: 10.112, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.910', 'weapon7': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.094', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.460', 'WEAPON3': '0.650', 'HITCOUNT': '0.740', 'weapon2': '1.202', 'weapon3': '1.420', 'DAMAGECOUNT': '2.832', 'FRAGCOUNT': '8.000'} [2023-02-24 18:52:03,088][177172] DAMAGECOUNT value on done: 206877.0 [2023-02-24 18:52:03,088][177172] Sum rewards: 8.848, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.834', 'AMMO5': '0.017', 'AMMO2': '0.021', 'weapon7': '0.030', 'AMMO4': '0.106', 'AMMO3': '0.162', 'weapon5': '0.162', 'WEAPON4': '0.300', 'weapon4': '0.344', 'AMMO6': '0.400', 'WEAPON7': '0.400', 'AMMO7': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.554', 'HITCOUNT': '1.000', 'WEAPON3': '1.050', 'weapon3': '2.350', 'DAMAGECOUNT': '4.485', 'FRAGCOUNT': '12.000'} [2023-02-24 18:52:04,668][177172] DAMAGECOUNT value on done: 210976.0 [2023-02-24 18:52:04,668][177172] Sum rewards: 9.801, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.138', 'AMMO2': '0.004', 'weapon5': '0.006', 'AMMO5': '0.013', 'AMMO4': '0.019', 'AMMO3': '0.121', 'weapon7': '0.132', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'weapon4': '0.374', 'WEAPON7': '0.400', 'weapon2': '0.608', 'HITCOUNT': '0.750', 'WEAPON3': '0.800', 'weapon3': '2.030', 'DAMAGECOUNT': '3.003', 'FRAGCOUNT': '10.000'} [2023-02-24 18:52:04,689][177154] DAMAGECOUNT value on done: 211502.0 [2023-02-24 18:52:04,690][177154] Sum rewards: 5.087, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.335', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'weapon7': '0.002', 'AMMO5': '0.005', 'weapon5': '0.092', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.262', 'HITCOUNT': '0.720', 'WEAPON3': '0.950', 'weapon2': '1.184', 'weapon3': '2.118', 'DAMAGECOUNT': '2.853', 'FRAGCOUNT': '8.000'} [2023-02-24 18:52:04,951][177153] Updated weights for policy 0, policy_version 18240 (0.0008) [2023-02-24 18:52:04,971][177172] DAMAGECOUNT value on done: 208956.0 [2023-02-24 18:52:04,972][177172] Sum rewards: 7.688, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.129', 'AMMO5': '0.015', 'AMMO2': '0.019', 'AMMO3': '0.083', 'AMMO4': '0.095', 'weapon7': '0.096', 'weapon5': '0.202', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.570', 'HITCOUNT': '0.780', 'weapon3': '1.048', 'weapon2': '1.116', 'DAMAGECOUNT': '3.912', 'FRAGCOUNT': '7.000'} [2023-02-24 18:52:04,995][177154] DAMAGECOUNT value on done: 216034.0 [2023-02-24 18:52:04,996][177154] Sum rewards: 21.360, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.748', 'AMMO2': '0.011', 'AMMO5': '0.015', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.130', 'WEAPON7': '0.200', 'weapon4': '0.278', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '1.070', 'weapon2': '1.398', 'weapon3': '1.780', 'DAMAGECOUNT': '4.548', 'FRAGCOUNT': '16.000'} [2023-02-24 18:52:05,288][177154] DAMAGECOUNT value on done: 223870.0 [2023-02-24 18:52:05,288][177154] Sum rewards: 11.521, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.026', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.031', 'AMMO3': '0.112', 'weapon5': '0.138', 'WEAPON4': '0.150', 'weapon4': '0.222', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'HITCOUNT': '0.960', 'weapon2': '1.346', 'weapon3': '1.622', 'DAMAGECOUNT': '3.645', 'FRAGCOUNT': '10.000'} [2023-02-24 18:52:05,585][177154] DAMAGECOUNT value on done: 215960.0 [2023-02-24 18:52:05,585][177154] Sum rewards: 6.219, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.965', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.017', 'AMMO3': '0.067', 'weapon7': '0.084', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.152', 'WEAPON7': '0.200', 'weapon4': '0.216', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '0.570', 'weapon2': '1.176', 'weapon3': '1.198', 'DAMAGECOUNT': '2.304', 'FRAGCOUNT': '4.500'} [2023-02-24 18:52:05,629][177157] DAMAGECOUNT value on done: 217523.0 [2023-02-24 18:52:05,630][177157] Sum rewards: 18.393, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.505', 'AMMO2': '0.012', 'AMMO5': '0.014', 'weapon4': '0.042', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.173', 'weapon5': '0.236', 'WEAPON5': '0.400', 'weapon2': '0.806', 'WEAPON3': '1.200', 'HITCOUNT': '1.520', 'weapon3': '2.574', 'DAMAGECOUNT': '7.011', 'FRAGCOUNT': '16.500'} [2023-02-24 18:52:05,667][177157] DAMAGECOUNT value on done: 200963.0 [2023-02-24 18:52:05,667][177157] Sum rewards: 3.974, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.725', 'AMMO2': '0.011', 'AMMO3': '0.020', 'AMMO4': '0.052', 'WEAPON3': '0.100', 'weapon7': '0.166', 'weapon2': '0.228', 'HITCOUNT': '0.240', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'weapon3': '0.380', 'WEAPON7': '0.400', 'weapon4': '0.476', 'DAMAGECOUNT': '0.846', 'FRAGCOUNT': '4.000'} [2023-02-24 18:52:05,903][177171] DAMAGECOUNT value on done: 205387.0 [2023-02-24 18:52:05,903][177171] Sum rewards: 14.375, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.534', 'AMMO5': '0.015', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.124', 'AMMO3': '0.204', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON4': '0.350', 'ARMOR': '0.457', 'weapon4': '0.552', 'WEAPON3': '1.250', 'HITCOUNT': '1.250', 'weapon3': '1.968', 'DAMAGECOUNT': '5.754', 'FRAGCOUNT': '17.000'} [2023-02-24 18:52:05,930][177157] DAMAGECOUNT value on done: 205126.0 [2023-02-24 18:52:05,930][177157] Sum rewards: 7.402, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.210', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO4': '0.045', 'weapon7': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.145', 'WEAPON7': '0.200', 'weapon5': '0.248', 'WEAPON4': '0.250', 'weapon4': '0.326', 'WEAPON5': '0.600', 'WEAPON3': '1.000', 'HITCOUNT': '1.020', 'weapon2': '1.118', 'weapon3': '1.706', 'DAMAGECOUNT': '3.591', 'FRAGCOUNT': '9.500'} [2023-02-24 18:52:05,965][177157] DAMAGECOUNT value on done: 205381.0 [2023-02-24 18:52:05,966][177157] Sum rewards: 11.259, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.662', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.024', 'weapon5': '0.104', 'weapon7': '0.110', 'AMMO4': '0.117', 'AMMO3': '0.134', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'ARMOR': '0.404', 'weapon4': '0.504', 'weapon2': '0.808', 'WEAPON3': '0.850', 'HITCOUNT': '0.910', 'weapon3': '1.452', 'DAMAGECOUNT': '3.834', 'FRAGCOUNT': '12.000'} [2023-02-24 18:52:06,210][177171] DAMAGECOUNT value on done: 207790.0 [2023-02-24 18:52:06,211][177171] Sum rewards: 7.112, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.855', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon7': '0.054', 'weapon5': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.113', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.598', 'HITCOUNT': '0.640', 'weapon2': '0.654', 'WEAPON3': '0.700', 'weapon3': '1.392', 'DAMAGECOUNT': '2.433', 'FRAGCOUNT': '8.000'} [2023-02-24 18:52:06,220][177171] DAMAGECOUNT value on done: 215850.0 [2023-02-24 18:52:06,221][177171] Sum rewards: 14.802, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.780', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'WEAPON4': '0.050', 'weapon4': '0.078', 'weapon5': '0.140', 'AMMO3': '0.190', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '1.170', 'weapon2': '1.518', 'weapon3': '1.828', 'DAMAGECOUNT': '4.842', 'FRAGCOUNT': '15.000'} [2023-02-24 18:52:06,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 74727424. Throughput: 0: 3469.9. Samples: 18676458. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:52:06,376][177119] Avg episode reward: [(0, '13.550')] [2023-02-24 18:52:06,520][177171] DAMAGECOUNT value on done: 208026.0 [2023-02-24 18:52:06,521][177171] Sum rewards: 16.718, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.030', 'weapon4': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.066', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'WEAPON3': '0.750', 'HITCOUNT': '1.210', 'weapon2': '1.524', 'weapon3': '2.152', 'DAMAGECOUNT': '5.385', 'FRAGCOUNT': '13.000'} [2023-02-24 18:52:07,249][177155] DAMAGECOUNT value on done: 208142.0 [2023-02-24 18:52:07,250][177155] Sum rewards: 12.914, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.955', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.066', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'weapon7': '0.126', 'WEAPON5': '0.200', 'weapon4': '0.210', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON7': '0.500', 'WEAPON3': '0.750', 'HITCOUNT': '1.010', 'weapon2': '1.458', 'weapon3': '1.756', 'DAMAGECOUNT': '3.957', 'FRAGCOUNT': '10.000'} [2023-02-24 18:52:07,547][177155] DAMAGECOUNT value on done: 216031.0 [2023-02-24 18:52:07,548][177155] Sum rewards: 13.682, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.257', 'AMMO5': '0.005', 'AMMO2': '0.024', 'ARMOR': '0.036', 'weapon7': '0.072', 'weapon5': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.141', 'WEAPON4': '0.450', 'weapon2': '0.602', 'weapon4': '0.852', 'WEAPON3': '0.950', 'HITCOUNT': '1.290', 'weapon3': '1.830', 'DAMAGECOUNT': '5.088', 'FRAGCOUNT': '13.000'} [2023-02-24 18:52:07,847][177155] DAMAGECOUNT value on done: 218378.0 [2023-02-24 18:52:07,848][177155] Sum rewards: 9.606, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.042', 'WEAPON4': '0.050', 'AMMO3': '0.062', 'AMMO4': '0.070', 'weapon7': '0.072', 'WEAPON5': '0.100', 'HEALTH': '0.140', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.230', 'WEAPON3': '0.400', 'HITCOUNT': '0.700', 'weapon2': '0.714', 'weapon3': '1.194', 'DAMAGECOUNT': '2.715', 'FRAGCOUNT': '7.000'} [2023-02-24 18:52:07,873][177153] Updated weights for policy 0, policy_version 18250 (0.0008) [2023-02-24 18:52:08,139][177155] DAMAGECOUNT value on done: 204703.0 [2023-02-24 18:52:08,140][177155] Sum rewards: 13.971, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.200', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.080', 'weapon7': '0.102', 'AMMO4': '0.146', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.264', 'WEAPON5': '0.300', 'weapon5': '0.346', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.610', 'weapon3': '1.360', 'weapon2': '1.412', 'DAMAGECOUNT': '3.807', 'FRAGCOUNT': '11.500'} [2023-02-24 18:52:10,825][177153] Updated weights for policy 0, policy_version 18260 (0.0009) [2023-02-24 18:52:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 74797056. Throughput: 0: 3471.6. Samples: 18697360. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:52:11,376][177119] Avg episode reward: [(0, '13.567')] [2023-02-24 18:52:13,767][177153] Updated weights for policy 0, policy_version 18270 (0.0008) [2023-02-24 18:52:15,738][177156] DAMAGECOUNT value on done: 211900.0 [2023-02-24 18:52:15,739][177156] Sum rewards: 13.212, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.194', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'AMMO3': '0.084', 'weapon5': '0.092', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon7': '0.238', 'AMMO6': '0.420', 'AMMO7': '0.420', 'weapon2': '0.464', 'weapon4': '0.466', 'WEAPON7': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.680', 'weapon3': '1.334', 'DAMAGECOUNT': '3.219', 'FRAGCOUNT': '10.000'} [2023-02-24 18:52:15,749][177156] DAMAGECOUNT value on done: 207765.0 [2023-02-24 18:52:15,750][177156] Sum rewards: 14.157, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'AMMO2': '0.025', 'AMMO3': '0.061', 'HEALTH': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'weapon5': '0.148', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.492', 'weapon4': '0.734', 'HITCOUNT': '0.740', 'weapon2': '0.976', 'weapon3': '1.400', 'DAMAGECOUNT': '2.757', 'FRAGCOUNT': '11.000'} [2023-02-24 18:52:16,041][177156] DAMAGECOUNT value on done: 216055.0 [2023-02-24 18:52:16,041][177156] Sum rewards: 6.196, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.200', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.030', 'AMMO3': '0.074', 'WEAPON5': '0.100', 'weapon7': '0.142', 'WEAPON4': '0.200', 'weapon4': '0.300', 'AMMO6': '0.400', 'AMMO7': '0.400', 'WEAPON3': '0.500', 'WEAPON7': '0.600', 'HITCOUNT': '0.710', 'weapon3': '1.416', 'weapon2': '1.444', 'DAMAGECOUNT': '2.835', 'FRAGCOUNT': '5.000'} [2023-02-24 18:52:16,053][177156] DAMAGECOUNT value on done: 208209.0 [2023-02-24 18:52:16,053][177156] Sum rewards: 12.936, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.418', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.034', 'AMMO3': '0.065', 'weapon7': '0.106', 'weapon5': '0.164', 'AMMO4': '0.167', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.350', 'weapon4': '0.488', 'weapon2': '0.572', 'HITCOUNT': '0.610', 'weapon3': '0.846', 'DAMAGECOUNT': '3.150', 'FRAGCOUNT': '10.000'} [2023-02-24 18:52:16,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 74866688. Throughput: 0: 3475.8. Samples: 18718310. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:52:16,376][177119] Avg episode reward: [(0, '13.474')] [2023-02-24 18:52:16,711][177153] Updated weights for policy 0, policy_version 18280 (0.0008) [2023-02-24 18:52:17,105][177170] DAMAGECOUNT value on done: 212832.0 [2023-02-24 18:52:17,106][177170] Sum rewards: 12.355, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.675', 'AMMO5': '0.016', 'AMMO2': '0.023', 'weapon7': '0.048', 'AMMO4': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.122', 'weapon4': '0.136', 'weapon5': '0.138', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.748', 'WEAPON3': '0.750', 'HITCOUNT': '0.810', 'weapon3': '1.696', 'DAMAGECOUNT': '4.338', 'FRAGCOUNT': '12.000'} [2023-02-24 18:52:17,410][177170] DAMAGECOUNT value on done: 219011.0 [2023-02-24 18:52:17,411][177170] Sum rewards: 16.402, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.530', 'weapon7': '0.004', 'ARMOR': '0.008', 'AMMO2': '0.013', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.064', 'weapon5': '0.094', 'AMMO3': '0.097', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'HITCOUNT': '1.020', 'weapon2': '1.158', 'weapon3': '2.076', 'DAMAGECOUNT': '4.446', 'FRAGCOUNT': '15.000'} [2023-02-24 18:52:17,711][177170] DAMAGECOUNT value on done: 212656.0 [2023-02-24 18:52:17,712][177170] Sum rewards: 13.118, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.740', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon5': '0.166', 'AMMO3': '0.203', 'weapon4': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.634', 'HITCOUNT': '1.270', 'WEAPON3': '1.350', 'weapon3': '2.648', 'DAMAGECOUNT': '5.355', 'FRAGCOUNT': '15.000'} [2023-02-24 18:52:18,014][177170] DAMAGECOUNT value on done: 209320.0 [2023-02-24 18:52:18,014][177170] Sum rewards: 12.599, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.910', 'AMMO2': '0.012', 'AMMO5': '0.012', 'AMMO4': '0.061', 'AMMO3': '0.102', 'weapon5': '0.176', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.457', 'weapon4': '0.470', 'WEAPON3': '0.700', 'HITCOUNT': '1.180', 'weapon2': '1.218', 'weapon3': '1.860', 'DAMAGECOUNT': '4.860', 'FRAGCOUNT': '10.000'} [2023-02-24 18:52:18,857][177158] DAMAGECOUNT value on done: 203332.0 [2023-02-24 18:52:18,858][177158] Sum rewards: 14.622, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.145', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.007', 'weapon7': '0.048', 'AMMO3': '0.068', 'weapon5': '0.070', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.222', 'ARMOR': '0.460', 'WEAPON3': '0.550', 'HITCOUNT': '0.890', 'weapon3': '1.228', 'weapon2': '1.464', 'DAMAGECOUNT': '3.795', 'FRAGCOUNT': '10.000'} [2023-02-24 18:52:19,160][177158] DAMAGECOUNT value on done: 206117.0 [2023-02-24 18:52:19,161][177158] Sum rewards: 16.227, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.400', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'AMMO3': '0.060', 'weapon7': '0.150', 'WEAPON4': '0.250', 'AMMO6': '0.400', 'AMMO7': '0.400', 'weapon4': '0.566', 'WEAPON3': '0.600', 'WEAPON7': '0.600', 'weapon2': '0.802', 'HITCOUNT': '0.960', 'weapon3': '1.458', 'DAMAGECOUNT': '3.888', 'FRAGCOUNT': '12.000'} [2023-02-24 18:52:19,682][177153] Updated weights for policy 0, policy_version 18290 (0.0008) [2023-02-24 18:52:20,041][177158] DAMAGECOUNT value on done: 214711.0 [2023-02-24 18:52:20,041][177158] Sum rewards: 19.204, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.760', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.021', 'weapon5': '0.026', 'AMMO3': '0.097', 'AMMO4': '0.107', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.520', 'WEAPON3': '0.700', 'weapon2': '0.896', 'HITCOUNT': '1.300', 'weapon3': '2.016', 'DAMAGECOUNT': '4.659', 'FRAGCOUNT': '15.000'} [2023-02-24 18:52:20,341][177158] DAMAGECOUNT value on done: 215016.0 [2023-02-24 18:52:20,341][177158] Sum rewards: 9.517, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.950', 'AMMO2': '0.006', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO4': '0.032', 'weapon7': '0.060', 'AMMO3': '0.097', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon5': '0.162', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.584', 'WEAPON3': '0.650', 'HITCOUNT': '0.720', 'weapon2': '0.848', 'weapon3': '1.278', 'DAMAGECOUNT': '3.624', 'FRAGCOUNT': '9.000'} [2023-02-24 18:52:21,376][177119] Fps is (10 sec: 13926.2, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 74936320. Throughput: 0: 3475.1. Samples: 18728686. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:52:21,376][177119] Avg episode reward: [(0, '13.079')] [2023-02-24 18:52:22,181][177172] DAMAGECOUNT value on done: 210998.0 [2023-02-24 18:52:22,182][177172] Sum rewards: 13.125, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.005', 'AMMO2': '0.017', 'AMMO5': '0.017', 'weapon7': '0.048', 'AMMO4': '0.083', 'AMMO3': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.120', 'weapon4': '0.168', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.488', 'WEAPON3': '0.550', 'HITCOUNT': '0.860', 'weapon3': '1.140', 'weapon2': '1.572', 'DAMAGECOUNT': '3.792', 'FRAGCOUNT': '11.000'} [2023-02-24 18:52:22,478][177172] DAMAGECOUNT value on done: 208342.0 [2023-02-24 18:52:22,478][177172] Sum rewards: 12.491, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.700', 'AMMO5': '0.017', 'AMMO2': '0.027', 'weapon5': '0.104', 'weapon7': '0.122', 'AMMO4': '0.136', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.394', 'WEAPON3': '0.900', 'weapon2': '0.988', 'HITCOUNT': '1.070', 'weapon3': '1.586', 'DAMAGECOUNT': '4.395', 'FRAGCOUNT': '11.000'} [2023-02-24 18:52:22,655][177153] Updated weights for policy 0, policy_version 18300 (0.0009) [2023-02-24 18:52:24,027][177154] DAMAGECOUNT value on done: 212936.0 [2023-02-24 18:52:24,028][177154] Sum rewards: 12.615, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.650', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon7': '0.066', 'AMMO3': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.436', 'ARMOR': '0.439', 'WEAPON3': '0.750', 'weapon2': '1.102', 'HITCOUNT': '1.210', 'weapon3': '1.908', 'DAMAGECOUNT': '4.302', 'FRAGCOUNT': '9.000'} [2023-02-24 18:52:24,046][177172] DAMAGECOUNT value on done: 212851.0 [2023-02-24 18:52:24,046][177172] Sum rewards: 17.920, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.084', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon7': '0.048', 'AMMO3': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.162', 'WEAPON7': '0.200', 'weapon4': '0.236', 'weapon5': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'weapon2': '1.228', 'HITCOUNT': '1.250', 'weapon3': '1.722', 'DAMAGECOUNT': '5.625', 'FRAGCOUNT': '14.000'} [2023-02-24 18:52:24,329][177154] DAMAGECOUNT value on done: 217764.0 [2023-02-24 18:52:24,329][177154] Sum rewards: 13.138, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.340', 'AMMO5': '0.016', 'AMMO2': '0.029', 'weapon7': '0.052', 'AMMO3': '0.129', 'AMMO4': '0.145', 'WEAPON4': '0.250', 'weapon5': '0.266', 'WEAPON5': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'weapon4': '0.512', 'weapon2': '0.776', 'WEAPON3': '0.800', 'HITCOUNT': '1.060', 'weapon3': '1.912', 'DAMAGECOUNT': '5.190', 'FRAGCOUNT': '10.000'} [2023-02-24 18:52:24,346][177172] DAMAGECOUNT value on done: 210401.0 [2023-02-24 18:52:24,347][177172] Sum rewards: 14.373, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.960', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.138', 'AMMO3': '0.145', 'WEAPON5': '0.200', 'AMMO4': '0.236', 'weapon4': '0.328', 'WEAPON4': '0.350', 'WEAPON3': '0.900', 'HITCOUNT': '1.100', 'weapon2': '1.100', 'weapon3': '2.190', 'DAMAGECOUNT': '4.335', 'FRAGCOUNT': '14.000'} [2023-02-24 18:52:24,639][177154] DAMAGECOUNT value on done: 224946.0 [2023-02-24 18:52:24,639][177154] Sum rewards: 9.464, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.070', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO3': '0.080', 'AMMO4': '0.098', 'weapon7': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.162', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.820', 'weapon2': '1.228', 'weapon3': '1.468', 'DAMAGECOUNT': '3.228', 'FRAGCOUNT': '8.000'} [2023-02-24 18:52:24,882][177157] DAMAGECOUNT value on done: 218522.0 [2023-02-24 18:52:24,883][177157] Sum rewards: 7.935, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.022', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.074', 'AMMO3': '0.091', 'weapon7': '0.106', 'weapon5': '0.154', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.242', 'WEAPON5': '0.300', 'WEAPON7': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.710', 'weapon2': '0.936', 'weapon3': '1.568', 'DAMAGECOUNT': '2.997', 'FRAGCOUNT': '6.000'} [2023-02-24 18:52:24,918][177157] DAMAGECOUNT value on done: 202622.0 [2023-02-24 18:52:24,918][177157] Sum rewards: 11.345, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.994', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.057', 'weapon5': '0.102', 'weapon7': '0.134', 'AMMO3': '0.194', 'AMMO4': '0.283', 'weapon4': '0.304', 'WEAPON5': '0.350', 'AMMO6': '0.440', 'AMMO7': '0.440', 'WEAPON4': '0.500', 'WEAPON7': '0.600', 'weapon2': '0.958', 'HITCOUNT': '1.190', 'WEAPON3': '1.200', 'weapon3': '2.090', 'DAMAGECOUNT': '4.977', 'FRAGCOUNT': '14.000'} [2023-02-24 18:52:24,937][177154] DAMAGECOUNT value on done: 217455.0 [2023-02-24 18:52:24,938][177154] Sum rewards: 15.225, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.121', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO4': '0.025', 'weapon7': '0.052', 'AMMO3': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.128', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.272', 'WEAPON5': '0.400', 'ARMOR': '0.498', 'WEAPON3': '0.500', 'HITCOUNT': '0.710', 'weapon3': '1.234', 'weapon2': '1.606', 'DAMAGECOUNT': '4.467', 'FRAGCOUNT': '11.000'} [2023-02-24 18:52:25,191][177157] DAMAGECOUNT value on done: 206647.0 [2023-02-24 18:52:25,191][177157] Sum rewards: 9.468, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.490', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon4': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.159', 'weapon5': '0.230', 'WEAPON5': '0.350', 'HITCOUNT': '1.040', 'WEAPON3': '1.150', 'weapon2': '1.154', 'weapon3': '1.914', 'DAMAGECOUNT': '4.488', 'FRAGCOUNT': '11.000'} [2023-02-24 18:52:25,233][177157] DAMAGECOUNT value on done: 206105.0 [2023-02-24 18:52:25,234][177157] Sum rewards: 8.969, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.655', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.032', 'weapon5': '0.048', 'ARMOR': '0.064', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'weapon7': '0.116', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.456', 'WEAPON3': '0.500', 'HITCOUNT': '0.610', 'weapon2': '0.740', 'weapon3': '1.266', 'DAMAGECOUNT': '2.172', 'FRAGCOUNT': '7.000'} [2023-02-24 18:52:25,244][177171] DAMAGECOUNT value on done: 207254.0 [2023-02-24 18:52:25,245][177171] Sum rewards: 23.980, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.840', 'AMMO2': '0.010', 'weapon5': '0.012', 'AMMO5': '0.013', 'AMMO4': '0.052', 'AMMO3': '0.100', 'weapon7': '0.126', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.750', 'HITCOUNT': '1.460', 'weapon2': '1.476', 'weapon3': '2.120', 'DAMAGECOUNT': '5.601', 'FRAGCOUNT': '19.000'} [2023-02-24 18:52:25,539][177171] DAMAGECOUNT value on done: 208985.0 [2023-02-24 18:52:25,540][177171] Sum rewards: 9.000, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.000', 'AMMO2': '0.001', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.006', 'WEAPON1': '0.010', 'AMMO3': '0.043', 'weapon5': '0.074', 'WEAPON5': '0.100', 'weapon7': '0.230', 'WEAPON3': '0.300', 'WEAPON4': '0.300', 'AMMO6': '0.360', 'AMMO7': '0.360', 'HITCOUNT': '0.480', 'WEAPON7': '0.600', 'weapon4': '0.654', 'weapon3': '0.760', 'weapon2': '0.800', 'DAMAGECOUNT': '2.412', 'FRAGCOUNT': '7.000'} [2023-02-24 18:52:25,549][177171] DAMAGECOUNT value on done: 217137.0 [2023-02-24 18:52:25,550][177171] Sum rewards: 9.900, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.720', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon7': '0.046', 'weapon5': '0.054', 'AMMO3': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.218', 'WEAPON3': '0.700', 'HITCOUNT': '0.850', 'weapon2': '1.150', 'weapon3': '1.546', 'DAMAGECOUNT': '3.861', 'FRAGCOUNT': '9.000'} [2023-02-24 18:52:25,599][177153] Updated weights for policy 0, policy_version 18310 (0.0008) [2023-02-24 18:52:25,846][177171] DAMAGECOUNT value on done: 209517.0 [2023-02-24 18:52:25,847][177171] Sum rewards: 12.241, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.319', 'AMMO2': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.042', 'weapon5': '0.106', 'AMMO3': '0.121', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.298', 'ARMOR': '0.496', 'WEAPON3': '0.800', 'HITCOUNT': '1.170', 'weapon2': '1.180', 'weapon3': '1.886', 'DAMAGECOUNT': '4.473', 'FRAGCOUNT': '10.000'} [2023-02-24 18:52:26,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 75005952. Throughput: 0: 3474.2. Samples: 18749384. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:52:26,376][177119] Avg episode reward: [(0, '13.183')] [2023-02-24 18:52:26,610][177155] DAMAGECOUNT value on done: 209153.0 [2023-02-24 18:52:26,611][177155] Sum rewards: 6.962, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.260', 'AMMO2': '0.012', 'AMMO5': '0.016', 'AMMO4': '0.059', 'AMMO3': '0.112', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.474', 'WEAPON3': '0.650', 'HITCOUNT': '0.770', 'weapon2': '0.806', 'weapon3': '1.974', 'DAMAGECOUNT': '3.033', 'FRAGCOUNT': '8.500'} [2023-02-24 18:52:26,922][177155] DAMAGECOUNT value on done: 217820.0 [2023-02-24 18:52:26,923][177155] Sum rewards: 22.082, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.007', 'AMMO5': '0.023', 'AMMO4': '0.034', 'HEALTH': '0.053', 'AMMO3': '0.091', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.244', 'weapon5': '0.346', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '1.040', 'weapon2': '1.224', 'weapon3': '1.852', 'DAMAGECOUNT': '5.367', 'FRAGCOUNT': '16.000'} [2023-02-24 18:52:27,230][177155] DAMAGECOUNT value on done: 219986.0 [2023-02-24 18:52:27,230][177155] Sum rewards: 13.935, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.450', 'AMMO2': '0.013', 'AMMO5': '0.015', 'weapon7': '0.060', 'AMMO4': '0.065', 'AMMO3': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.222', 'WEAPON5': '0.350', 'weapon4': '0.372', 'WEAPON4': '0.400', 'ARMOR': '0.460', 'WEAPON3': '0.850', 'HITCOUNT': '0.950', 'weapon2': '1.266', 'weapon3': '1.482', 'DAMAGECOUNT': '4.824', 'FRAGCOUNT': '12.000'} [2023-02-24 18:52:27,531][177155] DAMAGECOUNT value on done: 205891.0 [2023-02-24 18:52:27,532][177155] Sum rewards: 11.046, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.964', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.020', 'weapon7': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.130', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.214', 'weapon4': '0.366', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'HITCOUNT': '0.930', 'weapon2': '1.010', 'weapon3': '1.628', 'DAMAGECOUNT': '3.564', 'FRAGCOUNT': '10.500'} [2023-02-24 18:52:28,568][177153] Updated weights for policy 0, policy_version 18320 (0.0009) [2023-02-24 18:52:31,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 75075584. Throughput: 0: 3477.3. Samples: 18770228. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:52:31,376][177119] Avg episode reward: [(0, '13.002')] [2023-02-24 18:52:31,517][177153] Updated weights for policy 0, policy_version 18330 (0.0008) [2023-02-24 18:52:34,457][177153] Updated weights for policy 0, policy_version 18340 (0.0008) [2023-02-24 18:52:35,145][177156] DAMAGECOUNT value on done: 213344.0 [2023-02-24 18:52:35,146][177156] Sum rewards: 18.739, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.302', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO3': '0.040', 'AMMO4': '0.043', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.152', 'weapon7': '0.154', 'weapon4': '0.234', 'WEAPON3': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'HITCOUNT': '0.770', 'weapon3': '0.958', 'weapon2': '0.998', 'DAMAGECOUNT': '4.332', 'FRAGCOUNT': '12.000'} [2023-02-24 18:52:35,157][177156] DAMAGECOUNT value on done: 209315.0 [2023-02-24 18:52:35,157][177156] Sum rewards: 10.851, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.320', 'AMMO5': '0.019', 'AMMO2': '0.024', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.116', 'AMMO4': '0.117', 'AMMO3': '0.122', 'weapon5': '0.158', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'HITCOUNT': '0.900', 'weapon2': '1.624', 'weapon3': '1.726', 'DAMAGECOUNT': '4.650', 'FRAGCOUNT': '11.500'} [2023-02-24 18:52:35,456][177156] DAMAGECOUNT value on done: 217327.0 [2023-02-24 18:52:35,457][177156] Sum rewards: 10.736, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.583', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon7': '0.054', 'AMMO3': '0.094', 'AMMO4': '0.114', 'weapon5': '0.150', 'AMMO6': '0.260', 'AMMO7': '0.260', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.501', 'WEAPON3': '0.650', 'weapon2': '0.656', 'weapon4': '0.884', 'HITCOUNT': '0.920', 'weapon3': '1.430', 'DAMAGECOUNT': '3.816', 'FRAGCOUNT': '9.000'} [2023-02-24 18:52:35,468][177156] DAMAGECOUNT value on done: 209557.0 [2023-02-24 18:52:35,468][177156] Sum rewards: 11.694, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.400', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.030', 'weapon7': '0.052', 'weapon5': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.115', 'AMMO4': '0.147', 'WEAPON5': '0.250', 'weapon4': '0.440', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'HITCOUNT': '0.950', 'weapon2': '1.406', 'weapon3': '1.752', 'DAMAGECOUNT': '4.044', 'FRAGCOUNT': '12.000'} [2023-02-24 18:52:36,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13843.1). Total num frames: 75145216. Throughput: 0: 3477.7. Samples: 18780708. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:52:36,376][177119] Avg episode reward: [(0, '12.937')] [2023-02-24 18:52:36,516][177170] DAMAGECOUNT value on done: 215290.0 [2023-02-24 18:52:36,516][177170] Sum rewards: 19.969, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.340', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.042', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'weapon4': '0.224', 'weapon2': '0.904', 'WEAPON3': '1.050', 'HITCOUNT': '1.470', 'weapon3': '2.064', 'DAMAGECOUNT': '6.474', 'FRAGCOUNT': '18.000'} [2023-02-24 18:52:36,822][177170] DAMAGECOUNT value on done: 220961.0 [2023-02-24 18:52:36,823][177170] Sum rewards: 23.795, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.310', 'AMMO2': '0.007', 'AMMO5': '0.014', 'AMMO4': '0.036', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'weapon4': '0.234', 'weapon5': '0.248', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.168', 'HITCOUNT': '1.440', 'weapon3': '1.860', 'DAMAGECOUNT': '5.850', 'FRAGCOUNT': '18.000'} [2023-02-24 18:52:37,128][177170] DAMAGECOUNT value on done: 213973.0 [2023-02-24 18:52:37,129][177170] Sum rewards: 14.579, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.038', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO3': '0.102', 'AMMO4': '0.145', 'weapon5': '0.214', 'weapon4': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.412', 'WEAPON3': '0.550', 'HITCOUNT': '0.720', 'weapon3': '0.870', 'weapon2': '1.512', 'DAMAGECOUNT': '3.951', 'FRAGCOUNT': '13.000'} [2023-02-24 18:52:37,409][177153] Updated weights for policy 0, policy_version 18350 (0.0008) [2023-02-24 18:52:37,440][177170] DAMAGECOUNT value on done: 210350.0 [2023-02-24 18:52:37,440][177170] Sum rewards: 9.782, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.768', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.074', 'AMMO3': '0.108', 'weapon7': '0.118', 'WEAPON5': '0.300', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON4': '0.350', 'ARMOR': '0.404', 'weapon2': '0.438', 'WEAPON7': '0.500', 'weapon4': '0.714', 'HITCOUNT': '0.760', 'WEAPON3': '0.800', 'weapon3': '1.614', 'DAMAGECOUNT': '3.090', 'FRAGCOUNT': '9.000'} [2023-02-24 18:52:38,270][177158] DAMAGECOUNT value on done: 204935.0 [2023-02-24 18:52:38,270][177158] Sum rewards: 12.296, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.120', 'ARMOR': '0.004', 'AMMO2': '0.014', 'AMMO5': '0.015', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.150', 'weapon5': '0.152', 'weapon4': '0.236', 'WEAPON5': '0.350', 'weapon2': '0.804', 'WEAPON3': '1.000', 'HITCOUNT': '1.170', 'weapon3': '2.292', 'DAMAGECOUNT': '4.809', 'FRAGCOUNT': '12.000'} [2023-02-24 18:52:38,572][177158] DAMAGECOUNT value on done: 207962.0 [2023-02-24 18:52:38,572][177158] Sum rewards: 17.222, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.603', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO3': '0.159', 'AMMO4': '0.175', 'weapon5': '0.286', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.802', 'weapon2': '0.854', 'WEAPON3': '1.000', 'HITCOUNT': '1.120', 'weapon3': '1.742', 'DAMAGECOUNT': '5.535', 'FRAGCOUNT': '16.000'} [2023-02-24 18:52:39,456][177158] DAMAGECOUNT value on done: 215471.0 [2023-02-24 18:52:39,456][177158] Sum rewards: 8.878, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.300', 'AMMO2': '0.001', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.006', 'AMMO3': '0.092', 'weapon5': '0.132', 'WEAPON5': '0.150', 'weapon2': '0.292', 'WEAPON4': '0.300', 'weapon4': '0.648', 'WEAPON3': '0.650', 'HITCOUNT': '0.680', 'weapon3': '1.438', 'DAMAGECOUNT': '2.280', 'FRAGCOUNT': '8.000'} [2023-02-24 18:52:39,749][177158] DAMAGECOUNT value on done: 216311.0 [2023-02-24 18:52:39,750][177158] Sum rewards: 14.867, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.886', 'AMMO5': '0.006', 'AMMO2': '0.012', 'weapon7': '0.052', 'AMMO4': '0.060', 'weapon4': '0.066', 'AMMO3': '0.089', 'weapon5': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.600', 'HITCOUNT': '0.940', 'weapon3': '1.176', 'weapon2': '1.270', 'DAMAGECOUNT': '3.885', 'FRAGCOUNT': '12.000'} [2023-02-24 18:52:40,394][177153] Updated weights for policy 0, policy_version 18360 (0.0008) [2023-02-24 18:52:41,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13857.0). Total num frames: 75214848. Throughput: 0: 3471.0. Samples: 18801460. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:52:41,376][177119] Avg episode reward: [(0, '13.159')] [2023-02-24 18:52:41,554][177172] DAMAGECOUNT value on done: 211881.0 [2023-02-24 18:52:41,554][177172] Sum rewards: 10.024, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON5': '0.050', 'weapon5': '0.058', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.104', 'HEALTH': '0.460', 'WEAPON3': '0.600', 'HITCOUNT': '0.660', 'weapon2': '1.370', 'weapon3': '1.652', 'DAMAGECOUNT': '2.649', 'FRAGCOUNT': '8.000'} [2023-02-24 18:52:41,845][177172] DAMAGECOUNT value on done: 209070.0 [2023-02-24 18:52:41,846][177172] Sum rewards: 3.666, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.710', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.085', 'weapon7': '0.114', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.530', 'weapon4': '0.588', 'weapon3': '1.124', 'weapon2': '1.256', 'DAMAGECOUNT': '2.184', 'FRAGCOUNT': '5.000'} [2023-02-24 18:52:43,348][177153] Updated weights for policy 0, policy_version 18370 (0.0008) [2023-02-24 18:52:43,389][177172] DAMAGECOUNT value on done: 215563.0 [2023-02-24 18:52:43,390][177172] Sum rewards: 23.444, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.765', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon7': '0.050', 'AMMO3': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.156', 'weapon5': '0.174', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.486', 'WEAPON3': '0.700', 'weapon2': '1.218', 'HITCOUNT': '1.460', 'weapon3': '1.810', 'DAMAGECOUNT': '6.336', 'FRAGCOUNT': '19.000'} [2023-02-24 18:52:43,422][177154] DAMAGECOUNT value on done: 214710.0 [2023-02-24 18:52:43,423][177154] Sum rewards: 19.502, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.370', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO3': '0.104', 'AMMO4': '0.141', 'weapon5': '0.146', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.476', 'WEAPON3': '0.700', 'weapon2': '0.892', 'HITCOUNT': '1.450', 'weapon3': '2.042', 'DAMAGECOUNT': '5.322', 'FRAGCOUNT': '17.000'} [2023-02-24 18:52:43,689][177172] DAMAGECOUNT value on done: 210740.0 [2023-02-24 18:52:43,690][177172] Sum rewards: 3.933, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.064', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.022', 'AMMO3': '0.024', 'weapon5': '0.058', 'WEAPON5': '0.100', 'weapon7': '0.106', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.200', 'weapon3': '0.402', 'weapon2': '0.440', 'weapon4': '0.560', 'DAMAGECOUNT': '1.017', 'FRAGCOUNT': '3.000'} [2023-02-24 18:52:43,725][177154] DAMAGECOUNT value on done: 218785.0 [2023-02-24 18:52:43,725][177154] Sum rewards: 13.152, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.584', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO3': '0.089', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'weapon5': '0.152', 'WEAPON5': '0.250', 'weapon4': '0.388', 'WEAPON3': '0.600', 'HITCOUNT': '0.870', 'weapon2': '1.550', 'weapon3': '1.744', 'DAMAGECOUNT': '3.063', 'FRAGCOUNT': '10.000'} [2023-02-24 18:52:44,037][177154] DAMAGECOUNT value on done: 226939.0 [2023-02-24 18:52:44,037][177154] Sum rewards: 15.606, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.940', 'AMMO2': '0.005', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.026', 'WEAPON4': '0.100', 'weapon5': '0.158', 'AMMO3': '0.162', 'weapon4': '0.172', 'WEAPON5': '0.500', 'weapon2': '0.856', 'HITCOUNT': '1.080', 'WEAPON3': '1.100', 'weapon3': '2.370', 'DAMAGECOUNT': '5.979', 'FRAGCOUNT': '14.000'} [2023-02-24 18:52:44,250][177157] DAMAGECOUNT value on done: 219585.0 [2023-02-24 18:52:44,250][177157] Sum rewards: 10.109, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.760', 'AMMO2': '0.013', 'AMMO5': '0.019', 'AMMO4': '0.064', 'AMMO3': '0.106', 'WEAPON4': '0.150', 'weapon5': '0.160', 'weapon4': '0.202', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'HITCOUNT': '0.890', 'weapon3': '1.620', 'weapon2': '1.756', 'DAMAGECOUNT': '3.189', 'FRAGCOUNT': '10.000'} [2023-02-24 18:52:44,287][177157] DAMAGECOUNT value on done: 203711.0 [2023-02-24 18:52:44,287][177157] Sum rewards: 9.018, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.886', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon5': '0.030', 'AMMO4': '0.072', 'AMMO3': '0.080', 'weapon7': '0.142', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.550', 'weapon4': '0.710', 'HITCOUNT': '0.740', 'weapon2': '0.838', 'weapon3': '1.002', 'DAMAGECOUNT': '3.267', 'FRAGCOUNT': '8.000'} [2023-02-24 18:52:44,342][177154] DAMAGECOUNT value on done: 218807.0 [2023-02-24 18:52:44,342][177154] Sum rewards: 12.034, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.290', 'AMMO5': '0.003', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.056', 'weapon7': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.124', 'AMMO4': '0.149', 'WEAPON4': '0.250', 'weapon4': '0.350', 'ARMOR': '0.504', 'weapon2': '0.688', 'WEAPON3': '0.800', 'HITCOUNT': '0.910', 'weapon3': '1.744', 'DAMAGECOUNT': '4.056', 'FRAGCOUNT': '11.500'} [2023-02-24 18:52:44,562][177157] DAMAGECOUNT value on done: 208187.0 [2023-02-24 18:52:44,563][177157] Sum rewards: 12.859, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.910', 'ARMOR': '0.008', 'AMMO2': '0.024', 'AMMO5': '0.030', 'weapon5': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.123', 'weapon4': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.650', 'weapon2': '0.972', 'WEAPON3': '1.000', 'HITCOUNT': '1.040', 'weapon3': '2.184', 'DAMAGECOUNT': '4.620', 'FRAGCOUNT': '14.000'} [2023-02-24 18:52:44,593][177171] DAMAGECOUNT value on done: 208060.0 [2023-02-24 18:52:44,593][177171] Sum rewards: 8.024, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.255', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.039', 'weapon5': '0.062', 'AMMO3': '0.070', 'weapon7': '0.118', 'WEAPON5': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.450', 'HITCOUNT': '0.730', 'weapon2': '0.886', 'weapon4': '1.000', 'weapon3': '1.004', 'DAMAGECOUNT': '2.418', 'FRAGCOUNT': '7.000'} [2023-02-24 18:52:44,601][177157] DAMAGECOUNT value on done: 207438.0 [2023-02-24 18:52:44,601][177157] Sum rewards: 14.395, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.875', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon7': '0.048', 'AMMO3': '0.056', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.174', 'AMMO4': '0.193', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.774', 'weapon2': '0.796', 'HITCOUNT': '1.030', 'weapon3': '1.108', 'DAMAGECOUNT': '3.999', 'FRAGCOUNT': '13.000'} [2023-02-24 18:52:44,887][177171] DAMAGECOUNT value on done: 210115.0 [2023-02-24 18:52:44,888][177171] Sum rewards: 8.318, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.915', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.094', 'WEAPON4': '0.100', 'weapon4': '0.100', 'AMMO3': '0.138', 'AMMO4': '0.150', 'WEAPON5': '0.250', 'HITCOUNT': '0.800', 'WEAPON3': '0.950', 'weapon2': '0.950', 'weapon3': '1.768', 'DAMAGECOUNT': '3.390', 'FRAGCOUNT': '9.000'} [2023-02-24 18:52:44,896][177171] DAMAGECOUNT value on done: 218662.0 [2023-02-24 18:52:44,897][177171] Sum rewards: 12.124, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.314', 'AMMO2': '0.014', 'AMMO5': '0.015', 'weapon4': '0.032', 'weapon7': '0.048', 'WEAPON4': '0.050', 'weapon5': '0.056', 'AMMO4': '0.071', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.216', 'WEAPON5': '0.300', 'weapon2': '1.030', 'HITCOUNT': '1.110', 'WEAPON3': '1.350', 'weapon3': '2.270', 'DAMAGECOUNT': '4.575', 'FRAGCOUNT': '15.000'} [2023-02-24 18:52:45,193][177171] DAMAGECOUNT value on done: 210862.0 [2023-02-24 18:52:45,194][177171] Sum rewards: 11.183, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.178', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'AMMO4': '0.092', 'weapon5': '0.122', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'weapon4': '0.156', 'WEAPON5': '0.300', 'WEAPON3': '0.900', 'HITCOUNT': '0.920', 'weapon2': '1.264', 'weapon3': '2.214', 'DAMAGECOUNT': '4.035', 'FRAGCOUNT': '11.000'} [2023-02-24 18:52:46,040][177155] DAMAGECOUNT value on done: 210793.0 [2023-02-24 18:52:46,040][177155] Sum rewards: 11.352, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.116', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.084', 'AMMO3': '0.147', 'AMMO4': '0.247', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon2': '0.508', 'weapon4': '0.546', 'WEAPON3': '0.900', 'HITCOUNT': '1.090', 'weapon3': '2.066', 'DAMAGECOUNT': '4.410', 'FRAGCOUNT': '12.000'} [2023-02-24 18:52:46,312][177153] Updated weights for policy 0, policy_version 18380 (0.0009) [2023-02-24 18:52:46,341][177155] DAMAGECOUNT value on done: 218921.0 [2023-02-24 18:52:46,342][177155] Sum rewards: 6.316, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.074', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'weapon5': '0.014', 'weapon7': '0.052', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.140', 'weapon4': '0.176', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.780', 'WEAPON3': '0.900', 'weapon2': '1.196', 'weapon3': '1.802', 'DAMAGECOUNT': '3.303', 'FRAGCOUNT': '8.000'} [2023-02-24 18:52:46,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13857.0). Total num frames: 75284480. Throughput: 0: 3468.6. Samples: 18822168. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:52:46,376][177119] Avg episode reward: [(0, '12.626')] [2023-02-24 18:52:46,650][177155] DAMAGECOUNT value on done: 220921.0 [2023-02-24 18:52:46,651][177155] Sum rewards: 5.872, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.475', 'AMMO2': '0.004', 'AMMO4': '0.021', 'weapon7': '0.050', 'AMMO3': '0.082', 'weapon4': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON3': '0.600', 'HITCOUNT': '0.800', 'weapon3': '1.540', 'weapon2': '1.706', 'DAMAGECOUNT': '2.805', 'FRAGCOUNT': '5.000'} [2023-02-24 18:52:46,945][177155] DAMAGECOUNT value on done: 207097.0 [2023-02-24 18:52:46,946][177155] Sum rewards: 8.393, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.550', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.054', 'AMMO3': '0.102', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.398', 'ARMOR': '0.500', 'WEAPON3': '0.700', 'HITCOUNT': '0.930', 'weapon2': '1.432', 'weapon3': '1.614', 'DAMAGECOUNT': '3.618', 'FRAGCOUNT': '9.000'} [2023-02-24 18:52:47,950][177157] Large shaping reward 2.626 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.594, 198.0), ('weapon7', 0.002)] [2023-02-24 18:52:49,234][177153] Updated weights for policy 0, policy_version 18390 (0.0008) [2023-02-24 18:52:51,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13857.0). Total num frames: 75354112. Throughput: 0: 3471.7. Samples: 18832686. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:52:51,376][177119] Avg episode reward: [(0, '12.377')] [2023-02-24 18:52:52,187][177153] Updated weights for policy 0, policy_version 18400 (0.0008) [2023-02-24 18:52:54,531][177156] DAMAGECOUNT value on done: 215162.0 [2023-02-24 18:52:54,532][177156] Sum rewards: 17.169, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.770', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'AMMO4': '0.136', 'WEAPON4': '0.300', 'weapon2': '0.698', 'weapon4': '0.792', 'WEAPON3': '0.800', 'HITCOUNT': '1.330', 'weapon3': '1.584', 'DAMAGECOUNT': '5.454', 'FRAGCOUNT': '15.500'} [2023-02-24 18:52:54,543][177156] DAMAGECOUNT value on done: 210676.0 [2023-02-24 18:52:54,543][177156] Sum rewards: 15.222, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.460', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon5': '0.090', 'weapon4': '0.096', 'AMMO3': '0.103', 'AMMO4': '0.109', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'HITCOUNT': '1.050', 'weapon2': '1.342', 'weapon3': '1.752', 'DAMAGECOUNT': '4.083', 'FRAGCOUNT': '12.000'} [2023-02-24 18:52:54,844][177156] DAMAGECOUNT value on done: 218995.0 [2023-02-24 18:52:54,844][177156] Sum rewards: 16.220, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.150', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'AMMO5': '0.013', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'weapon5': '0.164', 'weapon4': '0.218', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'weapon2': '0.980', 'HITCOUNT': '1.260', 'weapon3': '2.020', 'DAMAGECOUNT': '5.004', 'FRAGCOUNT': '14.000'} [2023-02-24 18:52:54,854][177156] DAMAGECOUNT value on done: 209875.0 [2023-02-24 18:52:54,854][177156] Sum rewards: 2.971, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.604', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.021', 'AMMO3': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.106', 'weapon7': '0.194', 'WEAPON3': '0.200', 'weapon2': '0.212', 'HITCOUNT': '0.220', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON4': '0.450', 'weapon3': '0.480', 'WEAPON7': '0.500', 'DAMAGECOUNT': '0.954', 'weapon4': '1.206', 'FRAGCOUNT': '2.000'} [2023-02-24 18:52:55,152][177153] Updated weights for policy 0, policy_version 18410 (0.0009) [2023-02-24 18:52:55,908][177170] DAMAGECOUNT value on done: 216311.0 [2023-02-24 18:52:55,909][177170] Sum rewards: 9.309, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.650', 'ARMOR': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.037', 'weapon7': '0.058', 'AMMO3': '0.066', 'weapon5': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.186', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'weapon4': '0.536', 'HITCOUNT': '0.670', 'weapon3': '0.842', 'weapon2': '1.066', 'DAMAGECOUNT': '3.063', 'FRAGCOUNT': '8.000'} [2023-02-24 18:52:56,209][177170] DAMAGECOUNT value on done: 222482.0 [2023-02-24 18:52:56,209][177170] Sum rewards: 7.554, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.073', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon7': '0.048', 'AMMO2': '0.052', 'weapon5': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'AMMO4': '0.259', 'weapon2': '0.592', 'WEAPON4': '0.600', 'weapon4': '0.894', 'WEAPON3': '1.050', 'HITCOUNT': '1.190', 'weapon3': '1.702', 'DAMAGECOUNT': '4.563', 'FRAGCOUNT': '11.000'} [2023-02-24 18:52:56,376][177119] Fps is (10 sec: 13926.2, 60 sec: 13926.4, 300 sec: 13857.0). Total num frames: 75423744. Throughput: 0: 3469.1. Samples: 18853472. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:52:56,376][177119] Avg episode reward: [(0, '12.178')] [2023-02-24 18:52:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000018414_75423744.pth... [2023-02-24 18:52:56,436][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000017602_72097792.pth [2023-02-24 18:52:56,534][177170] DAMAGECOUNT value on done: 215348.0 [2023-02-24 18:52:56,534][177170] Sum rewards: 14.825, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.138', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon7': '0.058', 'weapon5': '0.078', 'AMMO3': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'weapon4': '0.726', 'HITCOUNT': '0.930', 'weapon2': '1.028', 'weapon3': '1.530', 'DAMAGECOUNT': '4.125', 'FRAGCOUNT': '12.000'} [2023-02-24 18:52:56,835][177170] DAMAGECOUNT value on done: 211225.0 [2023-02-24 18:52:56,835][177170] Sum rewards: 5.753, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.578', 'AMMO2': '0.003', 'AMMO4': '0.017', 'AMMO5': '0.028', 'weapon7': '0.050', 'weapon5': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.136', 'WEAPON5': '0.550', 'HITCOUNT': '0.680', 'WEAPON3': '0.950', 'weapon2': '1.018', 'weapon3': '1.880', 'DAMAGECOUNT': '2.625', 'FRAGCOUNT': '8.000'} [2023-02-24 18:52:57,692][177158] DAMAGECOUNT value on done: 206136.0 [2023-02-24 18:52:57,692][177158] Sum rewards: 12.710, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.400', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.080', 'weapon7': '0.122', 'weapon5': '0.146', 'WEAPON4': '0.150', 'weapon4': '0.168', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'WEAPON7': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.890', 'weapon2': '1.260', 'weapon3': '1.666', 'DAMAGECOUNT': '3.603', 'FRAGCOUNT': '10.000'} [2023-02-24 18:52:57,998][177158] DAMAGECOUNT value on done: 209450.0 [2023-02-24 18:52:57,998][177158] Sum rewards: 13.834, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.570', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.061', 'AMMO3': '0.080', 'weapon7': '0.090', 'WEAPON5': '0.200', 'weapon5': '0.250', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON4': '0.300', 'WEAPON7': '0.400', 'ARMOR': '0.448', 'WEAPON3': '0.550', 'weapon2': '0.624', 'weapon4': '0.630', 'HITCOUNT': '0.940', 'weapon3': '1.534', 'DAMAGECOUNT': '4.464', 'FRAGCOUNT': '10.000'} [2023-02-24 18:52:58,149][177153] Updated weights for policy 0, policy_version 18420 (0.0008) [2023-02-24 18:52:58,883][177158] DAMAGECOUNT value on done: 217342.0 [2023-02-24 18:52:58,883][177158] Sum rewards: 14.848, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.830', 'ARMOR': '0.005', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'AMMO3': '0.093', 'AMMO4': '0.189', 'weapon5': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.450', 'WEAPON3': '0.650', 'weapon2': '0.794', 'HITCOUNT': '1.090', 'weapon3': '1.928', 'DAMAGECOUNT': '5.409', 'FRAGCOUNT': '12.500'} [2023-02-24 18:52:59,181][177158] DAMAGECOUNT value on done: 217645.0 [2023-02-24 18:52:59,181][177158] Sum rewards: 13.301, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.885', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'weapon7': '0.048', 'weapon4': '0.076', 'AMMO3': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.128', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.870', 'weapon3': '1.196', 'weapon2': '1.352', 'DAMAGECOUNT': '4.002', 'FRAGCOUNT': '11.000'} [2023-02-24 18:53:01,005][177172] DAMAGECOUNT value on done: 213705.0 [2023-02-24 18:53:01,006][177172] Sum rewards: 12.688, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.280', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.072', 'weapon5': '0.102', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.322', 'weapon2': '0.738', 'WEAPON3': '1.250', 'HITCOUNT': '1.250', 'weapon3': '2.566', 'DAMAGECOUNT': '5.472', 'FRAGCOUNT': '14.000'} [2023-02-24 18:53:01,145][177153] Updated weights for policy 0, policy_version 18430 (0.0008) [2023-02-24 18:53:01,305][177172] DAMAGECOUNT value on done: 210381.0 [2023-02-24 18:53:01,306][177172] Sum rewards: 10.855, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.242', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.134', 'weapon5': '0.174', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.356', 'ARMOR': '0.400', 'WEAPON3': '0.950', 'weapon2': '1.012', 'HITCOUNT': '1.120', 'weapon3': '2.110', 'DAMAGECOUNT': '3.933', 'FRAGCOUNT': '12.000'} [2023-02-24 18:53:01,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 75489280. Throughput: 0: 3461.2. Samples: 18874062. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:53:01,376][177119] Avg episode reward: [(0, '12.240')] [2023-02-24 18:53:02,847][177172] DAMAGECOUNT value on done: 217776.0 [2023-02-24 18:53:02,847][177172] Sum rewards: 21.541, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.089', 'AMMO5': '0.017', 'AMMO2': '0.026', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.166', 'weapon5': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.286', 'weapon2': '0.848', 'WEAPON3': '0.950', 'HITCOUNT': '1.510', 'weapon3': '1.800', 'DAMAGECOUNT': '6.639', 'FRAGCOUNT': '19.000'} [2023-02-24 18:53:02,893][177154] DAMAGECOUNT value on done: 216264.0 [2023-02-24 18:53:02,893][177154] Sum rewards: 15.690, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.015', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'weapon5': '0.196', 'WEAPON5': '0.300', 'weapon4': '0.348', 'ARMOR': '0.400', 'weapon2': '0.948', 'WEAPON3': '0.950', 'HITCOUNT': '1.130', 'weapon3': '2.064', 'DAMAGECOUNT': '4.662', 'FRAGCOUNT': '15.000'} [2023-02-24 18:53:03,152][177172] DAMAGECOUNT value on done: 211913.0 [2023-02-24 18:53:03,152][177172] Sum rewards: 15.120, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.802', 'AMMO5': '0.003', 'AMMO2': '0.004', 'ARMOR': '0.004', 'AMMO4': '0.018', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'weapon7': '0.130', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.440', 'WEAPON3': '0.550', 'weapon2': '0.686', 'HITCOUNT': '0.870', 'weapon3': '1.026', 'DAMAGECOUNT': '3.519', 'FRAGCOUNT': '12.000'} [2023-02-24 18:53:03,198][177154] DAMAGECOUNT value on done: 221134.0 [2023-02-24 18:53:03,198][177154] Sum rewards: 20.261, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.465', 'AMMO2': '0.002', 'AMMO4': '0.007', 'AMMO5': '0.022', 'WEAPON4': '0.100', 'weapon4': '0.110', 'weapon5': '0.152', 'AMMO3': '0.204', 'WEAPON5': '0.450', 'weapon2': '0.742', 'WEAPON3': '1.300', 'HITCOUNT': '1.850', 'weapon3': '2.490', 'DAMAGECOUNT': '7.047', 'FRAGCOUNT': '19.500'} [2023-02-24 18:53:03,516][177154] DAMAGECOUNT value on done: 228271.0 [2023-02-24 18:53:03,516][177154] Sum rewards: 14.195, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.738', 'AMMO5': '0.019', 'AMMO2': '0.021', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.134', 'weapon5': '0.152', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon4': '0.484', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'HITCOUNT': '0.960', 'weapon2': '1.238', 'weapon3': '1.622', 'DAMAGECOUNT': '3.996', 'FRAGCOUNT': '13.000'} [2023-02-24 18:53:03,699][177157] DAMAGECOUNT value on done: 221371.0 [2023-02-24 18:53:03,699][177157] Sum rewards: 16.917, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.654', 'ARMOR': '0.004', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO4': '0.109', 'AMMO3': '0.116', 'weapon5': '0.168', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.594', 'WEAPON3': '0.750', 'weapon2': '0.920', 'HITCOUNT': '1.230', 'weapon3': '1.610', 'DAMAGECOUNT': '5.358', 'FRAGCOUNT': '16.000'} [2023-02-24 18:53:03,711][177157] DAMAGECOUNT value on done: 205050.0 [2023-02-24 18:53:03,711][177157] Sum rewards: 14.126, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.020', 'AMMO2': '0.016', 'AMMO5': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.080', 'AMMO3': '0.090', 'weapon4': '0.218', 'weapon5': '0.224', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '1.050', 'weapon2': '1.338', 'weapon3': '1.896', 'DAMAGECOUNT': '4.017', 'FRAGCOUNT': '11.000'} [2023-02-24 18:53:03,812][177154] DAMAGECOUNT value on done: 220043.0 [2023-02-24 18:53:03,812][177154] Sum rewards: 14.030, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.886', 'AMMO5': '0.005', 'AMMO2': '0.031', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.108', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'WEAPON4': '0.350', 'weapon4': '0.580', 'WEAPON3': '0.650', 'ARMOR': '0.910', 'HITCOUNT': '0.960', 'weapon2': '1.076', 'weapon3': '1.550', 'DAMAGECOUNT': '3.708', 'FRAGCOUNT': '11.000'} [2023-02-24 18:53:04,020][177171] DAMAGECOUNT value on done: 209937.0 [2023-02-24 18:53:04,020][177171] Sum rewards: 18.727, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.130', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.052', 'AMMO4': '0.064', 'weapon7': '0.066', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.159', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.358', 'weapon2': '0.862', 'ARMOR': '0.913', 'WEAPON3': '1.000', 'HITCOUNT': '1.290', 'weapon3': '1.606', 'DAMAGECOUNT': '5.631', 'FRAGCOUNT': '17.000'} [2023-02-24 18:53:04,022][177157] DAMAGECOUNT value on done: 209218.0 [2023-02-24 18:53:04,022][177157] Sum rewards: 10.342, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.126', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon7': '0.052', 'AMMO3': '0.060', 'AMMO4': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.172', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.472', 'HITCOUNT': '0.850', 'weapon2': '0.888', 'weapon3': '1.380', 'DAMAGECOUNT': '3.093', 'FRAGCOUNT': '6.500'} [2023-02-24 18:53:04,032][177157] DAMAGECOUNT value on done: 209025.0 [2023-02-24 18:53:04,033][177157] Sum rewards: 17.383, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.350', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.103', 'AMMO4': '0.129', 'weapon5': '0.132', 'WEAPON4': '0.150', 'weapon4': '0.286', 'WEAPON5': '0.400', 'ARMOR': '0.404', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'weapon2': '0.910', 'weapon3': '1.586', 'DAMAGECOUNT': '4.761', 'FRAGCOUNT': '14.000'} [2023-02-24 18:53:04,127][177153] Updated weights for policy 0, policy_version 18440 (0.0009) [2023-02-24 18:53:04,217][177156] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-24 18:53:04,320][177171] DAMAGECOUNT value on done: 211917.0 [2023-02-24 18:53:04,321][177171] Sum rewards: 17.965, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.590', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon7': '0.080', 'weapon5': '0.088', 'AMMO3': '0.094', 'AMMO4': '0.097', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'weapon2': '0.972', 'HITCOUNT': '1.110', 'weapon3': '1.440', 'DAMAGECOUNT': '5.406', 'FRAGCOUNT': '15.000'} [2023-02-24 18:53:04,330][177171] DAMAGECOUNT value on done: 220009.0 [2023-02-24 18:53:04,330][177171] Sum rewards: 12.231, reward structure: {'DEATHCOUNT': '-7.500', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.017', 'HEALTH': '0.064', 'weapon5': '0.068', 'AMMO4': '0.082', 'AMMO3': '0.098', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.554', 'WEAPON3': '0.600', 'weapon2': '0.870', 'HITCOUNT': '1.120', 'weapon3': '1.642', 'DAMAGECOUNT': '4.041', 'FRAGCOUNT': '10.000'} [2023-02-24 18:53:04,635][177171] DAMAGECOUNT value on done: 212108.0 [2023-02-24 18:53:04,636][177171] Sum rewards: 13.490, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.515', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.010', 'weapon7': '0.048', 'AMMO3': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.194', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.318', 'WEAPON3': '0.500', 'HITCOUNT': '0.840', 'weapon2': '0.856', 'weapon3': '1.592', 'DAMAGECOUNT': '3.738', 'FRAGCOUNT': '9.500'} [2023-02-24 18:53:05,489][177155] DAMAGECOUNT value on done: 212344.0 [2023-02-24 18:53:05,489][177155] Sum rewards: 10.646, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.695', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.088', 'AMMO4': '0.098', 'AMMO3': '0.102', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'weapon2': '0.746', 'weapon4': '0.760', 'HITCOUNT': '1.110', 'weapon3': '1.424', 'DAMAGECOUNT': '4.638', 'FRAGCOUNT': '8.500'} [2023-02-24 18:53:05,793][177155] DAMAGECOUNT value on done: 220795.0 [2023-02-24 18:53:05,794][177155] Sum rewards: 15.323, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.220', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon7': '0.068', 'AMMO4': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.112', 'weapon5': '0.166', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'weapon2': '1.098', 'HITCOUNT': '1.170', 'WEAPON3': '1.300', 'weapon3': '2.064', 'DAMAGECOUNT': '5.622', 'FRAGCOUNT': '17.000'} [2023-02-24 18:53:06,106][177155] DAMAGECOUNT value on done: 222006.0 [2023-02-24 18:53:06,106][177155] Sum rewards: 11.579, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.190', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon7': '0.106', 'AMMO3': '0.129', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.216', 'WEAPON3': '0.750', 'HITCOUNT': '0.900', 'weapon2': '1.046', 'weapon3': '1.990', 'DAMAGECOUNT': '3.255', 'FRAGCOUNT': '10.000'} [2023-02-24 18:53:06,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 75558912. Throughput: 0: 3458.5. Samples: 18884320. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:53:06,376][177119] Avg episode reward: [(0, '13.022')] [2023-02-24 18:53:06,401][177155] DAMAGECOUNT value on done: 208147.0 [2023-02-24 18:53:06,401][177155] Sum rewards: 4.379, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.593', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.018', 'AMMO3': '0.063', 'weapon5': '0.180', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.310', 'WEAPON3': '0.500', 'HITCOUNT': '0.750', 'weapon3': '1.344', 'weapon2': '1.550', 'DAMAGECOUNT': '3.150', 'FRAGCOUNT': '3.500'} [2023-02-24 18:53:07,064][177153] Updated weights for policy 0, policy_version 18450 (0.0008) [2023-02-24 18:53:10,013][177153] Updated weights for policy 0, policy_version 18460 (0.0009) [2023-02-24 18:53:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 75628544. Throughput: 0: 3460.0. Samples: 18905084. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:53:11,376][177119] Avg episode reward: [(0, '12.899')] [2023-02-24 18:53:12,974][177153] Updated weights for policy 0, policy_version 18470 (0.0009) [2023-02-24 18:53:13,781][177171] Large shaping reward 2.594 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5640000000000001, 188.0)] [2023-02-24 18:53:14,011][177156] DAMAGECOUNT value on done: 211854.0 [2023-02-24 18:53:14,011][177156] Sum rewards: 8.635, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.200', 'AMMO2': '0.014', 'AMMO5': '0.020', 'AMMO4': '0.068', 'weapon5': '0.076', 'weapon7': '0.104', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.372', 'WEAPON5': '0.400', 'HITCOUNT': '0.660', 'weapon2': '0.926', 'WEAPON3': '1.000', 'weapon3': '1.318', 'DAMAGECOUNT': '3.534', 'FRAGCOUNT': '11.000'} [2023-02-24 18:53:14,032][177156] DAMAGECOUNT value on done: 216552.0 [2023-02-24 18:53:14,032][177156] Sum rewards: 9.577, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.665', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.059', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.125', 'weapon4': '0.168', 'WEAPON3': '0.800', 'HITCOUNT': '1.140', 'weapon2': '1.612', 'weapon3': '2.056', 'DAMAGECOUNT': '4.170', 'FRAGCOUNT': '8.000'} [2023-02-24 18:53:14,338][177156] DAMAGECOUNT value on done: 220507.0 [2023-02-24 18:53:14,338][177156] Sum rewards: 16.047, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.028', 'AMMO5': '0.010', 'AMMO2': '0.010', 'weapon4': '0.046', 'AMMO4': '0.051', 'AMMO3': '0.084', 'WEAPON4': '0.150', 'weapon5': '0.212', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.930', 'weapon3': '1.694', 'weapon2': '1.700', 'DAMAGECOUNT': '4.287', 'FRAGCOUNT': '13.000'} [2023-02-24 18:53:14,348][177156] DAMAGECOUNT value on done: 211074.0 [2023-02-24 18:53:14,349][177156] Sum rewards: 13.179, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.980', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO3': '0.071', 'WEAPON4': '0.100', 'weapon7': '0.116', 'weapon5': '0.136', 'WEAPON5': '0.150', 'weapon4': '0.230', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '1.040', 'weapon3': '1.236', 'weapon2': '1.598', 'DAMAGECOUNT': '3.597', 'FRAGCOUNT': '9.000'} [2023-02-24 18:53:15,427][177170] DAMAGECOUNT value on done: 216959.0 [2023-02-24 18:53:15,428][177170] Sum rewards: 7.744, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO3': '0.030', 'HEALTH': '0.045', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'weapon5': '0.066', 'weapon7': '0.126', 'weapon4': '0.212', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.250', 'WEAPON7': '0.300', 'HITCOUNT': '0.510', 'weapon3': '0.746', 'weapon2': '1.160', 'DAMAGECOUNT': '1.944', 'FRAGCOUNT': '4.000'} [2023-02-24 18:53:15,731][177170] DAMAGECOUNT value on done: 224628.0 [2023-02-24 18:53:15,731][177170] Sum rewards: 24.120, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.059', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'weapon5': '0.054', 'AMMO3': '0.099', 'weapon7': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.304', 'WEAPON3': '0.750', 'weapon2': '1.020', 'weapon3': '1.742', 'HITCOUNT': '1.770', 'DAMAGECOUNT': '6.438', 'FRAGCOUNT': '18.000'} [2023-02-24 18:53:15,960][177153] Updated weights for policy 0, policy_version 18480 (0.0008) [2023-02-24 18:53:16,037][177170] DAMAGECOUNT value on done: 217453.0 [2023-02-24 18:53:16,038][177170] Sum rewards: 12.523, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.512', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'weapon7': '0.054', 'AMMO3': '0.077', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.166', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.770', 'weapon2': '1.470', 'weapon3': '1.552', 'DAMAGECOUNT': '4.515', 'FRAGCOUNT': '10.000'} [2023-02-24 18:53:16,344][177170] DAMAGECOUNT value on done: 213230.0 [2023-02-24 18:53:16,344][177170] Sum rewards: 20.766, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.080', 'AMMO2': '0.008', 'AMMO5': '0.027', 'AMMO4': '0.038', 'weapon4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'weapon5': '0.216', 'WEAPON5': '0.650', 'WEAPON3': '0.950', 'weapon2': '1.362', 'HITCOUNT': '1.490', 'weapon3': '2.026', 'DAMAGECOUNT': '6.015', 'FRAGCOUNT': '18.000'} [2023-02-24 18:53:16,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 75698176. Throughput: 0: 3458.6. Samples: 18925866. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:53:16,376][177119] Avg episode reward: [(0, '13.058')] [2023-02-24 18:53:17,196][177158] DAMAGECOUNT value on done: 207798.0 [2023-02-24 18:53:17,196][177158] Sum rewards: 16.282, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.090', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO5': '0.015', 'weapon4': '0.038', 'WEAPON4': '0.050', 'AMMO3': '0.108', 'weapon5': '0.266', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'HITCOUNT': '1.120', 'weapon2': '1.402', 'weapon3': '1.920', 'DAMAGECOUNT': '4.986', 'FRAGCOUNT': '13.000'} [2023-02-24 18:53:17,496][177158] DAMAGECOUNT value on done: 210994.0 [2023-02-24 18:53:17,496][177158] Sum rewards: 19.571, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.753', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon7': '0.060', 'AMMO4': '0.064', 'AMMO3': '0.083', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.130', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'weapon2': '0.662', 'weapon4': '0.776', 'HITCOUNT': '1.180', 'weapon3': '1.676', 'DAMAGECOUNT': '4.632', 'FRAGCOUNT': '15.000'} [2023-02-24 18:53:18,395][177158] DAMAGECOUNT value on done: 218848.0 [2023-02-24 18:53:18,395][177158] Sum rewards: 15.598, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.790', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.012', 'weapon7': '0.056', 'AMMO3': '0.071', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.180', 'weapon4': '0.198', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'ARMOR': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.910', 'weapon2': '1.186', 'weapon3': '1.586', 'DAMAGECOUNT': '4.518', 'FRAGCOUNT': '11.000'} [2023-02-24 18:53:18,700][177158] DAMAGECOUNT value on done: 218551.0 [2023-02-24 18:53:18,701][177158] Sum rewards: 8.805, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.550', 'ARMOR': '0.005', 'AMMO2': '0.014', 'AMMO5': '0.017', 'weapon7': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.196', 'weapon4': '0.380', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.640', 'weapon2': '0.722', 'weapon3': '1.754', 'DAMAGECOUNT': '2.718', 'FRAGCOUNT': '8.000'} [2023-02-24 18:53:18,930][177153] Updated weights for policy 0, policy_version 18490 (0.0008) [2023-02-24 18:53:20,454][177172] DAMAGECOUNT value on done: 215013.0 [2023-02-24 18:53:20,455][177172] Sum rewards: 12.421, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.499', 'AMMO2': '0.018', 'AMMO5': '0.024', 'AMMO4': '0.091', 'AMMO3': '0.154', 'weapon4': '0.162', 'weapon5': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.450', 'ARMOR': '0.483', 'WEAPON3': '0.950', 'HITCOUNT': '1.060', 'weapon2': '1.310', 'weapon3': '1.902', 'DAMAGECOUNT': '3.924', 'FRAGCOUNT': '12.000'} [2023-02-24 18:53:20,777][177172] DAMAGECOUNT value on done: 211097.0 [2023-02-24 18:53:20,777][177172] Sum rewards: 6.864, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.222', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.015', 'WEAPON1': '0.020', 'weapon7': '0.050', 'AMMO3': '0.058', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.126', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.490', 'WEAPON3': '0.500', 'weapon4': '0.548', 'ARMOR': '0.855', 'weapon3': '1.030', 'weapon2': '1.292', 'DAMAGECOUNT': '2.148', 'FRAGCOUNT': '4.500'} [2023-02-24 18:53:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.2, 300 sec: 13857.0). Total num frames: 75767808. Throughput: 0: 3457.1. Samples: 18936276. Policy #0 lag: (min: 0.0, avg: 1.0, max: 2.0) [2023-02-24 18:53:21,376][177119] Avg episode reward: [(0, '13.000')] [2023-02-24 18:53:21,897][177153] Updated weights for policy 0, policy_version 18500 (0.0009) [2023-02-24 18:53:22,252][177172] DAMAGECOUNT value on done: 220255.0 [2023-02-24 18:53:22,252][177172] Sum rewards: 17.989, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.260', 'AMMO2': '0.015', 'AMMO5': '0.026', 'AMMO4': '0.076', 'weapon4': '0.120', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon5': '0.244', 'WEAPON5': '0.550', 'weapon2': '0.724', 'WEAPON3': '1.200', 'HITCOUNT': '1.490', 'weapon3': '2.474', 'DAMAGECOUNT': '7.437', 'FRAGCOUNT': '18.000'} [2023-02-24 18:53:22,256][177154] DAMAGECOUNT value on done: 217914.0 [2023-02-24 18:53:22,256][177154] Sum rewards: 18.234, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.510', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon7': '0.054', 'AMMO4': '0.061', 'AMMO3': '0.073', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.230', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.334', 'WEAPON3': '0.450', 'HITCOUNT': '0.910', 'weapon2': '0.968', 'weapon3': '1.202', 'DAMAGECOUNT': '4.950', 'FRAGCOUNT': '12.000'} [2023-02-24 18:53:22,556][177172] DAMAGECOUNT value on done: 213227.0 [2023-02-24 18:53:22,556][177172] Sum rewards: 7.905, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.120', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.038', 'AMMO4': '0.104', 'AMMO3': '0.108', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'weapon4': '0.534', 'WEAPON3': '0.800', 'weapon2': '1.018', 'HITCOUNT': '1.090', 'weapon3': '1.864', 'DAMAGECOUNT': '3.942', 'FRAGCOUNT': '9.000'} [2023-02-24 18:53:22,559][177154] DAMAGECOUNT value on done: 222001.0 [2023-02-24 18:53:22,560][177154] Sum rewards: 6.621, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.440', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO3': '0.054', 'weapon7': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON3': '0.400', 'HITCOUNT': '0.630', 'weapon3': '1.046', 'weapon2': '1.726', 'DAMAGECOUNT': '2.601', 'FRAGCOUNT': '4.000'} [2023-02-24 18:53:22,860][177154] DAMAGECOUNT value on done: 229535.0 [2023-02-24 18:53:22,861][177154] Sum rewards: 9.140, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.374', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.026', 'AMMO3': '0.091', 'weapon7': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.129', 'weapon5': '0.188', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'weapon4': '0.412', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '0.770', 'weapon2': '1.162', 'weapon3': '1.222', 'DAMAGECOUNT': '3.792', 'FRAGCOUNT': '8.000'} [2023-02-24 18:53:23,093][177157] DAMAGECOUNT value on done: 206914.0 [2023-02-24 18:53:23,093][177157] Sum rewards: 13.920, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.300', 'AMMO2': '0.007', 'AMMO5': '0.014', 'AMMO4': '0.036', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'weapon4': '0.148', 'weapon5': '0.218', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'HITCOUNT': '0.960', 'weapon2': '1.384', 'weapon3': '1.986', 'DAMAGECOUNT': '5.592', 'FRAGCOUNT': '12.500'} [2023-02-24 18:53:23,113][177157] DAMAGECOUNT value on done: 222521.0 [2023-02-24 18:53:23,113][177157] Sum rewards: 10.271, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.425', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.004', 'weapon5': '0.038', 'weapon7': '0.046', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.700', 'HITCOUNT': '0.850', 'weapon3': '1.368', 'weapon2': '1.590', 'DAMAGECOUNT': '3.450', 'FRAGCOUNT': '8.000'} [2023-02-24 18:53:23,155][177154] DAMAGECOUNT value on done: 220905.0 [2023-02-24 18:53:23,156][177154] Sum rewards: 9.566, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.532', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon7': '0.048', 'AMMO3': '0.087', 'AMMO4': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.232', 'WEAPON3': '0.600', 'HITCOUNT': '0.710', 'weapon2': '1.462', 'weapon3': '1.554', 'DAMAGECOUNT': '2.586', 'FRAGCOUNT': '8.000'} [2023-02-24 18:53:23,411][177157] DAMAGECOUNT value on done: 210400.0 [2023-02-24 18:53:23,411][177157] Sum rewards: 12.078, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.832', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon7': '0.086', 'weapon4': '0.104', 'weapon5': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.800', 'HITCOUNT': '0.920', 'weapon3': '1.398', 'weapon2': '1.446', 'DAMAGECOUNT': '4.125', 'FRAGCOUNT': '12.000'} [2023-02-24 18:53:23,413][177171] DAMAGECOUNT value on done: 211691.0 [2023-02-24 18:53:23,414][177171] Sum rewards: 18.701, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.230', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'weapon5': '0.160', 'WEAPON5': '0.300', 'WEAPON3': '1.000', 'HITCOUNT': '1.150', 'weapon2': '1.182', 'weapon3': '2.002', 'DAMAGECOUNT': '5.262', 'FRAGCOUNT': '17.000'} [2023-02-24 18:53:23,422][177157] DAMAGECOUNT value on done: 211574.0 [2023-02-24 18:53:23,422][177157] Sum rewards: 18.177, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.538', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon7': '0.050', 'weapon5': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.242', 'WEAPON7': '0.300', 'ARMOR': '0.454', 'WEAPON3': '0.800', 'weapon2': '1.332', 'HITCOUNT': '1.350', 'weapon3': '2.008', 'DAMAGECOUNT': '5.868', 'FRAGCOUNT': '14.000'} [2023-02-24 18:53:23,713][177171] DAMAGECOUNT value on done: 220878.0 [2023-02-24 18:53:23,713][177171] Sum rewards: 11.720, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.026', 'AMMO3': '0.050', 'weapon7': '0.108', 'AMMO4': '0.132', 'WEAPON4': '0.200', 'WEAPON3': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'ARMOR': '0.493', 'HEALTH': '0.619', 'weapon4': '0.644', 'HITCOUNT': '0.690', 'weapon2': '0.800', 'weapon3': '0.810', 'DAMAGECOUNT': '2.607', 'FRAGCOUNT': '7.000'} [2023-02-24 18:53:23,726][177171] DAMAGECOUNT value on done: 213814.0 [2023-02-24 18:53:23,726][177171] Sum rewards: 18.119, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.702', 'AMMO2': '0.007', 'weapon4': '0.018', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.115', 'WEAPON3': '0.750', 'HITCOUNT': '1.430', 'weapon2': '1.712', 'weapon3': '1.912', 'DAMAGECOUNT': '5.691', 'FRAGCOUNT': '15.000'} [2023-02-24 18:53:24,024][177171] DAMAGECOUNT value on done: 213591.0 [2023-02-24 18:53:24,025][177171] Sum rewards: 17.388, reward structure: {'DEATHCOUNT': '-4.500', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.074', 'HEALTH': '0.080', 'weapon7': '0.104', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.202', 'weapon5': '0.214', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'HITCOUNT': '0.640', 'weapon3': '1.234', 'weapon2': '1.612', 'DAMAGECOUNT': '4.449', 'FRAGCOUNT': '12.000'} [2023-02-24 18:53:24,836][177153] Updated weights for policy 0, policy_version 18510 (0.0008) [2023-02-24 18:53:24,915][177155] DAMAGECOUNT value on done: 214263.0 [2023-02-24 18:53:24,916][177155] Sum rewards: 16.271, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.010', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.091', 'weapon5': '0.176', 'weapon4': '0.198', 'WEAPON5': '0.200', 'HEALTH': '0.340', 'WEAPON3': '0.600', 'HITCOUNT': '1.170', 'weapon2': '1.222', 'weapon3': '2.146', 'DAMAGECOUNT': '5.757', 'FRAGCOUNT': '11.000'} [2023-02-24 18:53:25,214][177155] DAMAGECOUNT value on done: 222151.0 [2023-02-24 18:53:25,214][177155] Sum rewards: 18.329, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.995', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'weapon5': '0.048', 'weapon7': '0.048', 'AMMO3': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.750', 'HITCOUNT': '1.030', 'weapon2': '1.728', 'weapon3': '1.922', 'DAMAGECOUNT': '4.068', 'FRAGCOUNT': '15.000'} [2023-02-24 18:53:25,522][177155] DAMAGECOUNT value on done: 223366.0 [2023-02-24 18:53:25,522][177155] Sum rewards: 15.420, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.152', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.014', 'ARMOR': '0.016', 'WEAPON4': '0.050', 'weapon4': '0.064', 'AMMO4': '0.070', 'AMMO3': '0.125', 'WEAPON5': '0.200', 'WEAPON3': '0.900', 'weapon2': '0.980', 'HITCOUNT': '1.010', 'weapon3': '2.300', 'DAMAGECOUNT': '4.080', 'FRAGCOUNT': '15.000'} [2023-02-24 18:53:25,828][177155] DAMAGECOUNT value on done: 208731.0 [2023-02-24 18:53:25,829][177155] Sum rewards: 4.663, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.660', 'AMMO2': '0.003', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.012', 'ARMOR': '0.020', 'weapon4': '0.036', 'WEAPON5': '0.050', 'weapon7': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.470', 'WEAPON3': '0.700', 'weapon2': '1.094', 'weapon3': '1.466', 'DAMAGECOUNT': '1.752', 'FRAGCOUNT': '5.000'} [2023-02-24 18:53:26,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 75837440. Throughput: 0: 3457.9. Samples: 18957064. Policy #0 lag: (min: 0.0, avg: 1.0, max: 2.0) [2023-02-24 18:53:26,376][177119] Avg episode reward: [(0, '13.146')] [2023-02-24 18:53:27,803][177153] Updated weights for policy 0, policy_version 18520 (0.0008) [2023-02-24 18:53:30,736][177153] Updated weights for policy 0, policy_version 18530 (0.0008) [2023-02-24 18:53:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 75907072. Throughput: 0: 3458.7. Samples: 18977808. Policy #0 lag: (min: 0.0, avg: 1.0, max: 2.0) [2023-02-24 18:53:31,376][177119] Avg episode reward: [(0, '13.146')] [2023-02-24 18:53:33,497][177156] DAMAGECOUNT value on done: 217807.0 [2023-02-24 18:53:33,497][177156] Sum rewards: 10.749, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.429', 'AMMO2': '0.010', 'AMMO5': '0.013', 'AMMO4': '0.052', 'weapon4': '0.082', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.122', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'HITCOUNT': '0.680', 'WEAPON3': '0.800', 'weapon2': '1.568', 'weapon3': '1.962', 'DAMAGECOUNT': '3.765', 'FRAGCOUNT': '12.000'} [2023-02-24 18:53:33,509][177156] DAMAGECOUNT value on done: 213529.0 [2023-02-24 18:53:33,509][177156] Sum rewards: 18.499, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.916', 'weapon7': '0.014', 'AMMO5': '0.025', 'AMMO2': '0.028', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.142', 'weapon5': '0.160', 'AMMO3': '0.163', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'weapon4': '0.610', 'weapon2': '0.752', 'WEAPON3': '1.100', 'HITCOUNT': '1.350', 'weapon3': '2.046', 'DAMAGECOUNT': '5.025', 'FRAGCOUNT': '19.000'} [2023-02-24 18:53:33,680][177153] Updated weights for policy 0, policy_version 18540 (0.0008) [2023-02-24 18:53:33,809][177156] DAMAGECOUNT value on done: 221646.0 [2023-02-24 18:53:33,810][177156] Sum rewards: 12.995, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.670', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon7': '0.066', 'weapon4': '0.076', 'weapon5': '0.078', 'AMMO3': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'WEAPON3': '0.650', 'HITCOUNT': '0.900', 'weapon2': '1.398', 'weapon3': '1.508', 'DAMAGECOUNT': '3.417', 'FRAGCOUNT': '10.000'} [2023-02-24 18:53:33,821][177156] DAMAGECOUNT value on done: 212895.0 [2023-02-24 18:53:33,822][177156] Sum rewards: 16.160, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.695', 'AMMO2': '0.011', 'AMMO5': '0.012', 'AMMO4': '0.054', 'weapon5': '0.060', 'AMMO3': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.456', 'weapon2': '0.750', 'WEAPON3': '0.900', 'HITCOUNT': '1.640', 'weapon3': '2.374', 'DAMAGECOUNT': '5.463', 'FRAGCOUNT': '13.000'} [2023-02-24 18:53:34,842][177170] DAMAGECOUNT value on done: 218173.0 [2023-02-24 18:53:34,842][177170] Sum rewards: 10.144, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.535', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.010', 'WEAPON4': '0.050', 'AMMO3': '0.098', 'weapon5': '0.110', 'weapon7': '0.112', 'weapon4': '0.212', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'WEAPON7': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.970', 'weapon2': '1.348', 'weapon3': '1.546', 'DAMAGECOUNT': '3.642', 'FRAGCOUNT': '7.000'} [2023-02-24 18:53:35,152][177170] DAMAGECOUNT value on done: 225333.0 [2023-02-24 18:53:35,153][177170] Sum rewards: 10.086, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.664', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'weapon5': '0.064', 'AMMO3': '0.075', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.146', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.352', 'ARMOR': '0.460', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'weapon2': '0.892', 'weapon3': '1.262', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '9.000'} [2023-02-24 18:53:35,464][177170] DAMAGECOUNT value on done: 219251.0 [2023-02-24 18:53:35,464][177170] Sum rewards: 21.478, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.640', 'AMMO2': '0.004', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO4': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.032', 'weapon7': '0.046', 'WEAPON4': '0.050', 'weapon4': '0.096', 'AMMO3': '0.149', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'weapon2': '1.294', 'HITCOUNT': '1.530', 'weapon3': '2.218', 'DAMAGECOUNT': '5.394', 'FRAGCOUNT': '19.000'} [2023-02-24 18:53:35,762][177170] DAMAGECOUNT value on done: 215276.0 [2023-02-24 18:53:35,762][177170] Sum rewards: 17.154, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.083', 'AMMO2': '0.008', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'AMMO4': '0.039', 'weapon7': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.136', 'weapon4': '0.158', 'weapon5': '0.182', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.500', 'weapon2': '0.794', 'WEAPON3': '1.000', 'HITCOUNT': '1.330', 'weapon3': '2.426', 'DAMAGECOUNT': '6.138', 'FRAGCOUNT': '14.000'} [2023-02-24 18:53:36,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 75976704. Throughput: 0: 3455.9. Samples: 18988202. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:53:36,376][177119] Avg episode reward: [(0, '13.258')] [2023-02-24 18:53:36,565][177158] DAMAGECOUNT value on done: 209020.0 [2023-02-24 18:53:36,565][177158] Sum rewards: 15.032, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.806', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.022', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'weapon7': '0.106', 'AMMO4': '0.108', 'weapon4': '0.162', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.600', 'HITCOUNT': '0.950', 'weapon2': '1.078', 'weapon3': '1.640', 'DAMAGECOUNT': '3.666', 'FRAGCOUNT': '14.000'} [2023-02-24 18:53:36,638][177153] Updated weights for policy 0, policy_version 18550 (0.0008) [2023-02-24 18:53:36,866][177158] DAMAGECOUNT value on done: 212024.0 [2023-02-24 18:53:36,867][177158] Sum rewards: 9.766, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.680', 'AMMO2': '0.009', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'weapon7': '0.028', 'AMMO4': '0.045', 'AMMO3': '0.106', 'WEAPON4': '0.150', 'weapon5': '0.198', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.258', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.860', 'weapon2': '0.910', 'weapon3': '1.802', 'DAMAGECOUNT': '3.090', 'FRAGCOUNT': '8.000'} [2023-02-24 18:53:37,725][177158] DAMAGECOUNT value on done: 220209.0 [2023-02-24 18:53:37,725][177158] Sum rewards: 11.865, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.153', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.238', 'WEAPON5': '0.250', 'WEAPON3': '0.750', 'weapon2': '0.934', 'HITCOUNT': '1.070', 'weapon3': '1.888', 'DAMAGECOUNT': '4.083', 'FRAGCOUNT': '9.000'} [2023-02-24 18:53:38,024][177158] DAMAGECOUNT value on done: 219871.0 [2023-02-24 18:53:38,024][177158] Sum rewards: 13.460, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.745', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon7': '0.052', 'weapon5': '0.078', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.210', 'WEAPON3': '0.700', 'weapon2': '0.792', 'HITCOUNT': '1.030', 'weapon3': '1.566', 'DAMAGECOUNT': '3.960', 'FRAGCOUNT': '12.000'} [2023-02-24 18:53:39,581][177153] Updated weights for policy 0, policy_version 18560 (0.0008) [2023-02-24 18:53:39,867][177172] DAMAGECOUNT value on done: 217093.0 [2023-02-24 18:53:39,867][177172] Sum rewards: 22.710, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.416', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO4': '0.097', 'AMMO3': '0.120', 'WEAPON4': '0.200', 'weapon5': '0.208', 'weapon4': '0.428', 'weapon2': '0.486', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'HITCOUNT': '1.610', 'weapon3': '2.372', 'DAMAGECOUNT': '6.240', 'FRAGCOUNT': '19.000'} [2023-02-24 18:53:40,169][177172] DAMAGECOUNT value on done: 212211.0 [2023-02-24 18:53:40,169][177172] Sum rewards: 11.427, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.837', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.070', 'AMMO3': '0.080', 'AMMO4': '0.093', 'weapon7': '0.106', 'WEAPON5': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'WEAPON7': '0.400', 'weapon4': '0.486', 'WEAPON3': '0.550', 'weapon2': '0.646', 'HITCOUNT': '1.000', 'weapon3': '1.828', 'DAMAGECOUNT': '3.342', 'FRAGCOUNT': '8.000'} [2023-02-24 18:53:41,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.2, 300 sec: 13857.0). Total num frames: 76046336. Throughput: 0: 3458.0. Samples: 19009080. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:53:41,376][177119] Avg episode reward: [(0, '13.124')] [2023-02-24 18:53:41,588][177154] DAMAGECOUNT value on done: 219986.0 [2023-02-24 18:53:41,589][177154] Sum rewards: 21.156, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.265', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.032', 'AMMO4': '0.060', 'AMMO3': '0.113', 'weapon5': '0.242', 'WEAPON4': '0.250', 'weapon4': '0.378', 'WEAPON5': '0.650', 'WEAPON3': '0.800', 'weapon2': '0.950', 'HITCOUNT': '1.570', 'weapon3': '2.134', 'DAMAGECOUNT': '6.216', 'FRAGCOUNT': '18.000'} [2023-02-24 18:53:41,653][177172] DAMAGECOUNT value on done: 221407.0 [2023-02-24 18:53:41,653][177172] Sum rewards: 9.948, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.175', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon7': '0.054', 'AMMO4': '0.070', 'AMMO3': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.354', 'WEAPON3': '0.600', 'HITCOUNT': '0.930', 'weapon3': '1.074', 'weapon2': '1.168', 'DAMAGECOUNT': '3.456', 'FRAGCOUNT': '8.000'} [2023-02-24 18:53:41,893][177154] DAMAGECOUNT value on done: 223297.0 [2023-02-24 18:53:41,893][177154] Sum rewards: 4.923, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.980', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.028', 'AMMO3': '0.129', 'AMMO4': '0.141', 'weapon5': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon4': '0.718', 'weapon2': '0.792', 'WEAPON3': '0.850', 'HITCOUNT': '0.930', 'weapon3': '1.720', 'DAMAGECOUNT': '3.888', 'FRAGCOUNT': '8.500'} [2023-02-24 18:53:41,946][177172] DAMAGECOUNT value on done: 214629.0 [2023-02-24 18:53:41,947][177172] Sum rewards: 12.488, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.900', 'AMMO5': '0.015', 'AMMO2': '0.022', 'AMMO3': '0.073', 'AMMO4': '0.110', 'WEAPON4': '0.200', 'weapon5': '0.216', 'WEAPON5': '0.300', 'ARMOR': '0.455', 'WEAPON3': '0.550', 'weapon4': '0.680', 'weapon2': '0.918', 'HITCOUNT': '0.990', 'weapon3': '1.152', 'DAMAGECOUNT': '4.206', 'FRAGCOUNT': '9.500'} [2023-02-24 18:53:42,189][177154] DAMAGECOUNT value on done: 230889.0 [2023-02-24 18:53:42,189][177154] Sum rewards: 15.577, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.652', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.036', 'weapon7': '0.048', 'AMMO4': '0.072', 'AMMO3': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.150', 'WEAPON5': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '0.850', 'weapon2': '1.566', 'weapon3': '1.826', 'DAMAGECOUNT': '4.062', 'FRAGCOUNT': '13.000'} [2023-02-24 18:53:42,471][177157] DAMAGECOUNT value on done: 208630.0 [2023-02-24 18:53:42,472][177157] Sum rewards: 16.444, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.541', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon7': '0.102', 'AMMO3': '0.105', 'weapon5': '0.130', 'weapon4': '0.142', 'WEAPON4': '0.150', 'AMMO4': '0.180', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'HITCOUNT': '1.060', 'weapon2': '1.322', 'weapon3': '1.746', 'DAMAGECOUNT': '5.148', 'FRAGCOUNT': '12.000'} [2023-02-24 18:53:42,481][177157] DAMAGECOUNT value on done: 223736.0 [2023-02-24 18:53:42,482][177157] Sum rewards: 12.171, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.040', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon7': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'weapon4': '0.080', 'weapon5': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.600', 'HITCOUNT': '0.740', 'weapon3': '1.368', 'weapon2': '1.374', 'DAMAGECOUNT': '3.645', 'FRAGCOUNT': '9.000'} [2023-02-24 18:53:42,491][177154] DAMAGECOUNT value on done: 222082.0 [2023-02-24 18:53:42,492][177154] Sum rewards: 13.515, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.268', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon7': '0.034', 'weapon5': '0.062', 'AMMO4': '0.104', 'AMMO3': '0.109', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.422', 'ARMOR': '0.440', 'weapon4': '0.444', 'WEAPON3': '0.750', 'HITCOUNT': '0.880', 'weapon3': '1.668', 'DAMAGECOUNT': '3.531', 'FRAGCOUNT': '12.000'} [2023-02-24 18:53:42,511][177153] Updated weights for policy 0, policy_version 18570 (0.0008) [2023-02-24 18:53:42,780][177157] DAMAGECOUNT value on done: 212780.0 [2023-02-24 18:53:42,781][177157] Sum rewards: 17.778, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.010', 'AMMO5': '0.012', 'AMMO2': '0.013', 'weapon7': '0.048', 'AMMO4': '0.064', 'weapon4': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon5': '0.160', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'weapon2': '1.120', 'HITCOUNT': '1.160', 'weapon3': '1.976', 'DAMAGECOUNT': '5.340', 'FRAGCOUNT': '14.000'} [2023-02-24 18:53:42,792][177157] DAMAGECOUNT value on done: 212732.0 [2023-02-24 18:53:42,792][177157] Sum rewards: 12.333, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.700', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO5': '0.014', 'weapon7': '0.050', 'AMMO3': '0.106', 'weapon5': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'HITCOUNT': '0.670', 'WEAPON3': '0.750', 'weapon2': '0.996', 'weapon3': '1.386', 'DAMAGECOUNT': '3.474', 'FRAGCOUNT': '11.000'} [2023-02-24 18:53:42,816][177171] DAMAGECOUNT value on done: 213331.0 [2023-02-24 18:53:42,817][177171] Sum rewards: 13.800, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.050', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'AMMO5': '0.022', 'AMMO3': '0.121', 'WEAPON4': '0.150', 'weapon5': '0.210', 'weapon4': '0.352', 'ARMOR': '0.404', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'HITCOUNT': '1.020', 'weapon3': '1.538', 'weapon2': '1.622', 'DAMAGECOUNT': '4.920', 'FRAGCOUNT': '10.000'} [2023-02-24 18:53:43,121][177171] DAMAGECOUNT value on done: 221638.0 [2023-02-24 18:53:43,121][177171] Sum rewards: 7.635, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.560', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.042', 'AMMO4': '0.081', 'AMMO3': '0.090', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.448', 'WEAPON3': '0.500', 'ARMOR': '0.500', 'weapon2': '0.530', 'HITCOUNT': '0.610', 'weapon3': '1.390', 'DAMAGECOUNT': '2.280', 'FRAGCOUNT': '8.000'} [2023-02-24 18:53:43,133][177171] DAMAGECOUNT value on done: 215489.0 [2023-02-24 18:53:43,133][177171] Sum rewards: 19.082, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.102', 'weapon5': '0.206', 'AMMO4': '0.220', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'HEALTH': '0.392', 'weapon4': '0.614', 'WEAPON3': '0.650', 'weapon2': '1.050', 'HITCOUNT': '1.330', 'weapon3': '1.736', 'DAMAGECOUNT': '5.025', 'FRAGCOUNT': '15.000'} [2023-02-24 18:53:43,433][177171] DAMAGECOUNT value on done: 215007.0 [2023-02-24 18:53:43,433][177171] Sum rewards: 14.598, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.522', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon7': '0.078', 'AMMO3': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.123', 'weapon4': '0.138', 'WEAPON7': '0.200', 'weapon5': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.456', 'WEAPON3': '0.700', 'HITCOUNT': '1.030', 'weapon2': '1.446', 'weapon3': '1.800', 'DAMAGECOUNT': '4.248', 'FRAGCOUNT': '13.000'} [2023-02-24 18:53:44,192][177170] Large shaping reward -2.506 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0)] [2023-02-24 18:53:44,301][177155] DAMAGECOUNT value on done: 215543.0 [2023-02-24 18:53:44,301][177155] Sum rewards: 12.399, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.004', 'AMMO5': '0.024', 'AMMO2': '0.033', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.118', 'AMMO4': '0.164', 'weapon5': '0.170', 'WEAPON4': '0.300', 'weapon2': '0.476', 'WEAPON5': '0.500', 'weapon4': '0.538', 'WEAPON3': '0.700', 'HITCOUNT': '1.070', 'weapon3': '2.118', 'DAMAGECOUNT': '3.840', 'FRAGCOUNT': '11.000'} [2023-02-24 18:53:44,592][177155] DAMAGECOUNT value on done: 223318.0 [2023-02-24 18:53:44,593][177155] Sum rewards: 10.232, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.670', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'ARMOR': '0.004', 'AMMO5': '0.010', 'weapon7': '0.052', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.206', 'WEAPON5': '0.250', 'weapon4': '0.318', 'WEAPON3': '0.750', 'HITCOUNT': '0.840', 'weapon2': '0.990', 'weapon3': '2.066', 'DAMAGECOUNT': '3.501', 'FRAGCOUNT': '9.000'} [2023-02-24 18:53:44,892][177155] DAMAGECOUNT value on done: 225112.0 [2023-02-24 18:53:44,892][177155] Sum rewards: 15.102, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.484', 'AMMO2': '0.005', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.025', 'weapon7': '0.038', 'weapon5': '0.100', 'AMMO3': '0.149', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.376', 'weapon2': '0.702', 'WEAPON3': '1.050', 'HITCOUNT': '1.410', 'weapon3': '2.492', 'DAMAGECOUNT': '5.238', 'FRAGCOUNT': '13.000'} [2023-02-24 18:53:45,200][177155] DAMAGECOUNT value on done: 209914.0 [2023-02-24 18:53:45,200][177155] Sum rewards: 10.388, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.945', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.019', 'weapon5': '0.070', 'WEAPON4': '0.100', 'weapon7': '0.100', 'AMMO3': '0.104', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.260', 'WEAPON7': '0.300', 'WEAPON3': '0.850', 'HITCOUNT': '0.960', 'weapon2': '1.134', 'weapon3': '1.736', 'DAMAGECOUNT': '3.549', 'FRAGCOUNT': '10.000'} [2023-02-24 18:53:45,443][177153] Updated weights for policy 0, policy_version 18580 (0.0008) [2023-02-24 18:53:46,284][177171] Large shaping reward -2.534 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 18:53:46,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 76115968. Throughput: 0: 3463.1. Samples: 19029900. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:53:46,376][177119] Avg episode reward: [(0, '13.409')] [2023-02-24 18:53:48,338][177153] Updated weights for policy 0, policy_version 18590 (0.0008) [2023-02-24 18:53:51,154][177171] Large shaping reward 2.517 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.495, 165.0), ('weapon5', 0.002)] [2023-02-24 18:53:51,229][177153] Updated weights for policy 0, policy_version 18600 (0.0008) [2023-02-24 18:53:51,348][177172] Large shaping reward 2.581 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.549, 183.0), ('weapon7', 0.002)] [2023-02-24 18:53:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 76185600. Throughput: 0: 3470.0. Samples: 19040470. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:53:51,376][177119] Avg episode reward: [(0, '13.409')] [2023-02-24 18:53:52,724][177156] DAMAGECOUNT value on done: 218814.0 [2023-02-24 18:53:52,725][177156] Sum rewards: 9.966, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.880', 'AMMO2': '0.019', 'weapon7': '0.046', 'AMMO4': '0.095', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.121', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.346', 'weapon4': '0.428', 'WEAPON3': '0.750', 'HITCOUNT': '0.810', 'weapon3': '1.720', 'DAMAGECOUNT': '3.021', 'FRAGCOUNT': '12.000'} [2023-02-24 18:53:52,735][177156] DAMAGECOUNT value on done: 214540.0 [2023-02-24 18:53:52,736][177156] Sum rewards: 8.546, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.060', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.025', 'AMMO3': '0.060', 'weapon4': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'weapon7': '0.178', 'WEAPON4': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.690', 'weapon2': '1.190', 'weapon3': '1.350', 'DAMAGECOUNT': '3.033', 'FRAGCOUNT': '7.000'} [2023-02-24 18:53:53,035][177156] DAMAGECOUNT value on done: 223252.0 [2023-02-24 18:53:53,036][177156] Sum rewards: 12.123, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.910', 'AMMO2': '0.008', 'AMMO5': '0.020', 'AMMO4': '0.039', 'weapon5': '0.104', 'AMMO3': '0.116', 'weapon7': '0.124', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.504', 'weapon2': '0.620', 'WEAPON3': '0.800', 'HITCOUNT': '0.870', 'weapon3': '1.540', 'DAMAGECOUNT': '4.818', 'FRAGCOUNT': '10.000'} [2023-02-24 18:53:53,045][177156] DAMAGECOUNT value on done: 213709.0 [2023-02-24 18:53:53,046][177156] Sum rewards: 7.117, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.762', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.103', 'weapon5': '0.150', 'AMMO4': '0.191', 'weapon4': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.630', 'weapon3': '1.432', 'weapon2': '1.514', 'DAMAGECOUNT': '2.412', 'FRAGCOUNT': '8.000'} [2023-02-24 18:53:54,146][177153] Updated weights for policy 0, policy_version 18610 (0.0008) [2023-02-24 18:53:54,148][177170] DAMAGECOUNT value on done: 219422.0 [2023-02-24 18:53:54,149][177170] Sum rewards: 10.821, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.710', 'AMMO2': '0.003', 'AMMO5': '0.008', 'AMMO4': '0.016', 'weapon7': '0.050', 'WEAPON4': '0.100', 'weapon5': '0.118', 'AMMO3': '0.144', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.230', 'WEAPON3': '0.950', 'HITCOUNT': '1.100', 'weapon2': '1.288', 'weapon3': '1.726', 'DAMAGECOUNT': '3.747', 'FRAGCOUNT': '10.500'} [2023-02-24 18:53:54,447][177170] DAMAGECOUNT value on done: 227105.0 [2023-02-24 18:53:54,448][177170] Sum rewards: 14.947, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.256', 'AMMO2': '0.016', 'AMMO5': '0.024', 'AMMO4': '0.081', 'AMMO3': '0.168', 'weapon5': '0.228', 'WEAPON4': '0.300', 'weapon4': '0.326', 'WEAPON5': '0.600', 'weapon2': '0.650', 'WEAPON3': '1.100', 'HITCOUNT': '1.180', 'weapon3': '2.278', 'DAMAGECOUNT': '5.001', 'FRAGCOUNT': '15.000'} [2023-02-24 18:53:54,760][177170] DAMAGECOUNT value on done: 220428.0 [2023-02-24 18:53:54,760][177170] Sum rewards: 10.086, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.680', 'AMMO5': '0.010', 'AMMO2': '0.011', 'weapon7': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.132', 'WEAPON4': '0.150', 'weapon5': '0.216', 'WEAPON5': '0.300', 'HITCOUNT': '0.710', 'WEAPON3': '0.750', 'weapon2': '1.426', 'weapon3': '1.528', 'DAMAGECOUNT': '3.531', 'FRAGCOUNT': '8.500'} [2023-02-24 18:53:55,055][177170] DAMAGECOUNT value on done: 217011.0 [2023-02-24 18:53:55,056][177170] Sum rewards: 18.172, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.150', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.017', 'weapon7': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.089', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.200', 'weapon4': '0.292', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '1.260', 'weapon2': '1.396', 'weapon3': '1.740', 'DAMAGECOUNT': '5.205', 'FRAGCOUNT': '14.000'} [2023-02-24 18:53:55,747][177158] DAMAGECOUNT value on done: 210558.0 [2023-02-24 18:53:55,747][177158] Sum rewards: 19.063, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.712', 'AMMO5': '0.013', 'AMMO2': '0.021', 'weapon5': '0.080', 'AMMO4': '0.106', 'AMMO3': '0.120', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.690', 'weapon2': '0.706', 'WEAPON3': '0.900', 'ARMOR': '0.950', 'HITCOUNT': '1.250', 'weapon3': '2.124', 'DAMAGECOUNT': '4.614', 'FRAGCOUNT': '17.000'} [2023-02-24 18:53:56,048][177158] DAMAGECOUNT value on done: 212267.0 [2023-02-24 18:53:56,049][177158] Sum rewards: 2.763, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.370', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO3': '0.024', 'WEAPON5': '0.050', 'weapon7': '0.056', 'weapon5': '0.058', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon2': '0.126', 'WEAPON3': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.220', 'weapon3': '0.410', 'weapon4': '0.426', 'ARMOR': '0.474', 'DAMAGECOUNT': '0.729', 'FRAGCOUNT': '2.000'} [2023-02-24 18:53:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.2, 300 sec: 13870.9). Total num frames: 76255232. Throughput: 0: 3476.3. Samples: 19061516. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:53:56,376][177119] Avg episode reward: [(0, '13.541')] [2023-02-24 18:53:56,918][177158] DAMAGECOUNT value on done: 221861.0 [2023-02-24 18:53:56,918][177158] Sum rewards: 18.208, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.470', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO3': '0.080', 'AMMO4': '0.098', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.250', 'weapon5': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.444', 'WEAPON3': '0.600', 'weapon2': '1.092', 'HITCOUNT': '1.170', 'weapon3': '1.808', 'DAMAGECOUNT': '4.956', 'FRAGCOUNT': '14.000'} [2023-02-24 18:53:57,122][177153] Updated weights for policy 0, policy_version 18620 (0.0008) [2023-02-24 18:53:57,218][177158] DAMAGECOUNT value on done: 220399.0 [2023-02-24 18:53:57,218][177158] Sum rewards: 2.939, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.758', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon7': '0.058', 'AMMO3': '0.059', 'weapon5': '0.080', 'AMMO4': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.370', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'weapon4': '0.776', 'weapon3': '1.020', 'weapon2': '1.178', 'DAMAGECOUNT': '1.584', 'FRAGCOUNT': '2.000'} [2023-02-24 18:53:59,044][177172] DAMAGECOUNT value on done: 217851.0 [2023-02-24 18:53:59,045][177172] Sum rewards: 5.573, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.487', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon7': '0.076', 'weapon2': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.126', 'AMMO4': '0.170', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.640', 'WEAPON3': '0.800', 'weapon4': '1.094', 'weapon3': '1.482', 'DAMAGECOUNT': '2.274', 'FRAGCOUNT': '8.000'} [2023-02-24 18:53:59,338][177172] DAMAGECOUNT value on done: 213264.0 [2023-02-24 18:53:59,339][177172] Sum rewards: 14.569, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.804', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon7': '0.054', 'weapon5': '0.072', 'AMMO3': '0.087', 'AMMO4': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.459', 'weapon4': '0.586', 'WEAPON3': '0.600', 'HITCOUNT': '0.810', 'weapon2': '0.836', 'weapon3': '1.478', 'DAMAGECOUNT': '3.159', 'FRAGCOUNT': '13.000'} [2023-02-24 18:54:00,075][177153] Updated weights for policy 0, policy_version 18630 (0.0009) [2023-02-24 18:54:00,811][177172] DAMAGECOUNT value on done: 222950.0 [2023-02-24 18:54:00,811][177172] Sum rewards: 15.446, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.272', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.118', 'weapon5': '0.126', 'AMMO3': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.386', 'ARMOR': '0.400', 'weapon2': '0.734', 'WEAPON3': '0.800', 'HITCOUNT': '1.050', 'weapon3': '1.606', 'DAMAGECOUNT': '4.629', 'FRAGCOUNT': '14.000'} [2023-02-24 18:54:00,906][177154] DAMAGECOUNT value on done: 221201.0 [2023-02-24 18:54:00,907][177154] Sum rewards: 17.200, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.242', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'weapon5': '0.106', 'AMMO3': '0.111', 'weapon7': '0.124', 'WEAPON5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.414', 'WEAPON3': '0.750', 'HITCOUNT': '0.850', 'weapon2': '0.970', 'weapon3': '1.662', 'DAMAGECOUNT': '3.645', 'FRAGCOUNT': '17.000'} [2023-02-24 18:54:01,114][177172] DAMAGECOUNT value on done: 215321.0 [2023-02-24 18:54:01,115][177172] Sum rewards: 9.151, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.210', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO3': '0.051', 'AMMO4': '0.060', 'weapon2': '0.076', 'weapon7': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'weapon3': '0.542', 'HITCOUNT': '0.690', 'weapon4': '0.748', 'DAMAGECOUNT': '2.076', 'FRAGCOUNT': '7.000'} [2023-02-24 18:54:01,202][177154] DAMAGECOUNT value on done: 224482.0 [2023-02-24 18:54:01,202][177154] Sum rewards: 13.690, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.720', 'AMMO5': '0.005', 'AMMO2': '0.022', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'weapon5': '0.110', 'weapon7': '0.112', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.550', 'weapon4': '0.690', 'HITCOUNT': '0.970', 'weapon2': '1.300', 'weapon3': '1.468', 'DAMAGECOUNT': '3.555', 'FRAGCOUNT': '11.000'} [2023-02-24 18:54:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13870.9). Total num frames: 76324864. Throughput: 0: 3479.4. Samples: 19082440. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:54:01,376][177119] Avg episode reward: [(0, '13.521')] [2023-02-24 18:54:01,502][177154] DAMAGECOUNT value on done: 233118.0 [2023-02-24 18:54:01,503][177154] Sum rewards: 23.077, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.459', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.028', 'AMMO3': '0.138', 'AMMO4': '0.141', 'weapon5': '0.252', 'weapon4': '0.396', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.860', 'WEAPON3': '0.900', 'HITCOUNT': '1.350', 'weapon3': '1.962', 'DAMAGECOUNT': '6.687', 'FRAGCOUNT': '20.000'} [2023-02-24 18:54:01,699][177157] DAMAGECOUNT value on done: 209280.0 [2023-02-24 18:54:01,699][177157] Sum rewards: 6.656, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.790', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO3': '0.057', 'weapon7': '0.132', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'weapon2': '0.548', 'HITCOUNT': '0.580', 'weapon3': '0.726', 'weapon4': '0.746', 'DAMAGECOUNT': '1.950', 'FRAGCOUNT': '5.000'} [2023-02-24 18:54:01,710][177157] DAMAGECOUNT value on done: 225894.0 [2023-02-24 18:54:01,710][177157] Sum rewards: 21.946, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.075', 'weapon7': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.022', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.124', 'weapon5': '0.154', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.518', 'WEAPON3': '0.800', 'weapon2': '1.278', 'HITCOUNT': '1.520', 'weapon3': '1.700', 'DAMAGECOUNT': '6.474', 'FRAGCOUNT': '18.000'} [2023-02-24 18:54:01,804][177154] DAMAGECOUNT value on done: 223662.0 [2023-02-24 18:54:01,804][177154] Sum rewards: 16.185, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.100', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.062', 'AMMO3': '0.080', 'AMMO4': '0.081', 'weapon7': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO6': '0.260', 'AMMO7': '0.260', 'WEAPON7': '0.300', 'weapon4': '0.406', 'WEAPON3': '0.600', 'weapon2': '0.762', 'HITCOUNT': '1.070', 'weapon3': '1.492', 'DAMAGECOUNT': '4.740', 'FRAGCOUNT': '12.000'} [2023-02-24 18:54:02,003][177157] DAMAGECOUNT value on done: 213509.0 [2023-02-24 18:54:02,004][177157] Sum rewards: 5.581, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.426', 'AMMO5': '0.018', 'AMMO2': '0.020', 'weapon4': '0.022', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon5': '0.182', 'WEAPON5': '0.450', 'HITCOUNT': '0.670', 'WEAPON3': '0.750', 'ARMOR': '0.871', 'weapon2': '1.372', 'weapon3': '1.912', 'DAMAGECOUNT': '2.187', 'FRAGCOUNT': '5.000'} [2023-02-24 18:54:02,014][177157] DAMAGECOUNT value on done: 214250.0 [2023-02-24 18:54:02,014][177157] Sum rewards: 16.160, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.090', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon7': '0.050', 'weapon5': '0.054', 'AMMO4': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'weapon4': '0.274', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '1.110', 'weapon2': '1.260', 'weapon3': '2.076', 'DAMAGECOUNT': '4.554', 'FRAGCOUNT': '14.000'} [2023-02-24 18:54:02,016][177171] DAMAGECOUNT value on done: 214267.0 [2023-02-24 18:54:02,017][177171] Sum rewards: 12.799, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'AMMO2': '0.035', 'AMMO3': '0.042', 'WEAPON5': '0.050', 'weapon7': '0.104', 'weapon5': '0.146', 'AMMO4': '0.173', 'WEAPON4': '0.200', 'HEALTH': '0.290', 'WEAPON3': '0.300', 'weapon2': '0.398', 'AMMO6': '0.400', 'WEAPON7': '0.400', 'AMMO7': '0.400', 'HITCOUNT': '0.740', 'weapon4': '0.892', 'weapon3': '0.914', 'DAMAGECOUNT': '2.808', 'FRAGCOUNT': '9.000'} [2023-02-24 18:54:02,317][177171] DAMAGECOUNT value on done: 223604.0 [2023-02-24 18:54:02,318][177171] Sum rewards: 15.201, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.720', 'AMMO2': '0.016', 'AMMO5': '0.017', 'weapon7': '0.062', 'AMMO4': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.118', 'AMMO3': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.498', 'weapon4': '0.748', 'WEAPON3': '0.900', 'HITCOUNT': '1.310', 'weapon3': '2.076', 'DAMAGECOUNT': '5.898', 'FRAGCOUNT': '13.000'} [2023-02-24 18:54:02,330][177171] DAMAGECOUNT value on done: 216143.0 [2023-02-24 18:54:02,330][177171] Sum rewards: 2.434, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.505', 'AMMO5': '0.015', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'AMMO3': '0.052', 'weapon7': '0.054', 'AMMO4': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'HITCOUNT': '0.480', 'weapon4': '0.594', 'weapon2': '0.612', 'weapon3': '0.954', 'DAMAGECOUNT': '1.962', 'FRAGCOUNT': '2.500'} [2023-02-24 18:54:02,631][177171] DAMAGECOUNT value on done: 216194.0 [2023-02-24 18:54:02,632][177171] Sum rewards: 9.060, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.609', 'AMMO2': '0.005', 'AMMO5': '0.017', 'weapon4': '0.020', 'AMMO4': '0.025', 'weapon7': '0.048', 'WEAPON4': '0.050', 'weapon5': '0.098', 'AMMO3': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.650', 'HITCOUNT': '0.740', 'weapon2': '1.580', 'weapon3': '1.606', 'DAMAGECOUNT': '3.540', 'FRAGCOUNT': '8.000'} [2023-02-24 18:54:02,992][177153] Updated weights for policy 0, policy_version 18640 (0.0009) [2023-02-24 18:54:03,474][177155] DAMAGECOUNT value on done: 217705.0 [2023-02-24 18:54:03,474][177155] Sum rewards: 24.362, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'weapon5': '0.062', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'weapon7': '0.166', 'HEALTH': '0.230', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON3': '0.600', 'weapon4': '0.678', 'weapon2': '0.734', 'HITCOUNT': '1.210', 'weapon3': '1.834', 'DAMAGECOUNT': '6.186', 'FRAGCOUNT': '18.000'} [2023-02-24 18:54:03,784][177155] DAMAGECOUNT value on done: 224699.0 [2023-02-24 18:54:03,784][177155] Sum rewards: 16.090, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.438', 'AMMO5': '0.022', 'AMMO2': '0.027', 'WEAPON4': '0.100', 'AMMO3': '0.125', 'AMMO4': '0.135', 'weapon5': '0.204', 'weapon4': '0.392', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'weapon2': '0.856', 'HITCOUNT': '1.040', 'weapon3': '1.934', 'DAMAGECOUNT': '4.143', 'FRAGCOUNT': '15.000'} [2023-02-24 18:54:04,085][177155] DAMAGECOUNT value on done: 225337.0 [2023-02-24 18:54:04,085][177155] Sum rewards: 3.372, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO2': '0.012', 'AMMO3': '0.045', 'WEAPON4': '0.050', 'weapon7': '0.052', 'AMMO4': '0.058', 'weapon4': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.220', 'WEAPON3': '0.250', 'HEALTH': '0.308', 'DAMAGECOUNT': '0.675', 'weapon2': '0.732', 'weapon3': '0.830', 'FRAGCOUNT': '2.000'} [2023-02-24 18:54:04,385][177155] DAMAGECOUNT value on done: 210806.0 [2023-02-24 18:54:04,385][177155] Sum rewards: 11.303, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'AMMO2': '0.016', 'ARMOR': '0.025', 'WEAPON5': '0.050', 'AMMO3': '0.065', 'AMMO4': '0.080', 'weapon4': '0.096', 'WEAPON4': '0.100', 'weapon7': '0.114', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'HEALTH': '0.410', 'HITCOUNT': '0.590', 'weapon3': '1.238', 'weapon2': '1.340', 'DAMAGECOUNT': '2.676', 'FRAGCOUNT': '8.000'} [2023-02-24 18:54:05,907][177153] Updated weights for policy 0, policy_version 18650 (0.0008) [2023-02-24 18:54:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13870.9). Total num frames: 76394496. Throughput: 0: 3480.2. Samples: 19092886. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:54:06,376][177119] Avg episode reward: [(0, '13.143')] [2023-02-24 18:54:08,859][177153] Updated weights for policy 0, policy_version 18660 (0.0008) [2023-02-24 18:54:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13870.9). Total num frames: 76464128. Throughput: 0: 3481.9. Samples: 19113748. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:54:11,376][177119] Avg episode reward: [(0, '13.143')] [2023-02-24 18:54:11,797][177153] Updated weights for policy 0, policy_version 18670 (0.0008) [2023-02-24 18:54:12,084][177156] DAMAGECOUNT value on done: 220759.0 [2023-02-24 18:54:12,084][177156] Sum rewards: 23.418, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.555', 'AMMO5': '0.007', 'AMMO2': '0.017', 'ARMOR': '0.040', 'weapon5': '0.064', 'AMMO4': '0.085', 'AMMO3': '0.114', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.354', 'WEAPON3': '0.750', 'weapon2': '1.188', 'HITCOUNT': '1.490', 'weapon3': '1.878', 'DAMAGECOUNT': '5.835', 'FRAGCOUNT': '20.000'} [2023-02-24 18:54:12,094][177156] DAMAGECOUNT value on done: 215945.0 [2023-02-24 18:54:12,095][177156] Sum rewards: 14.737, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.092', 'AMMO2': '0.012', 'AMMO5': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.080', 'WEAPON4': '0.200', 'weapon5': '0.274', 'WEAPON5': '0.300', 'weapon4': '0.332', 'ARMOR': '0.435', 'WEAPON3': '0.500', 'HITCOUNT': '1.130', 'weapon2': '1.158', 'weapon3': '1.372', 'DAMAGECOUNT': '4.215', 'FRAGCOUNT': '10.000'} [2023-02-24 18:54:12,392][177156] DAMAGECOUNT value on done: 224276.0 [2023-02-24 18:54:12,393][177156] Sum rewards: 14.697, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.711', 'AMMO5': '0.010', 'AMMO2': '0.018', 'ARMOR': '0.064', 'AMMO3': '0.074', 'AMMO4': '0.088', 'weapon5': '0.094', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'weapon4': '0.642', 'weapon2': '0.646', 'HITCOUNT': '0.780', 'weapon3': '1.670', 'DAMAGECOUNT': '3.072', 'FRAGCOUNT': '11.000'} [2023-02-24 18:54:12,404][177156] DAMAGECOUNT value on done: 214988.0 [2023-02-24 18:54:12,405][177156] Sum rewards: 15.060, reward structure: {'DEATHCOUNT': '-5.250', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO3': '0.050', 'weapon7': '0.088', 'AMMO4': '0.132', 'weapon5': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO6': '0.260', 'AMMO7': '0.260', 'weapon4': '0.284', 'WEAPON7': '0.300', 'WEAPON3': '0.300', 'HEALTH': '0.331', 'HITCOUNT': '0.530', 'weapon3': '1.032', 'weapon2': '1.288', 'DAMAGECOUNT': '3.837', 'FRAGCOUNT': '11.000'} [2023-02-24 18:54:13,146][177170] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:54:13,376][177170] DAMAGECOUNT value on done: 220734.0 [2023-02-24 18:54:13,377][177170] Sum rewards: 9.981, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.244', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.014', 'WEAPON1': '0.020', 'weapon4': '0.052', 'weapon7': '0.058', 'AMMO3': '0.071', 'weapon5': '0.092', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'HITCOUNT': '0.740', 'weapon3': '1.198', 'weapon2': '2.188', 'DAMAGECOUNT': '3.936', 'FRAGCOUNT': '6.000'} [2023-02-24 18:54:13,677][177170] DAMAGECOUNT value on done: 227706.0 [2023-02-24 18:54:13,677][177170] Sum rewards: 5.663, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.461', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.056', 'weapon7': '0.058', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'AMMO6': '0.360', 'AMMO7': '0.360', 'WEAPON7': '0.400', 'WEAPON4': '0.400', 'HITCOUNT': '0.430', 'ARMOR': '0.501', 'WEAPON3': '0.750', 'weapon4': '0.822', 'weapon2': '1.094', 'weapon3': '1.326', 'DAMAGECOUNT': '1.737', 'FRAGCOUNT': '6.000'} [2023-02-24 18:54:13,990][177170] DAMAGECOUNT value on done: 221923.0 [2023-02-24 18:54:13,990][177170] Sum rewards: 19.936, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.499', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon7': '0.056', 'AMMO3': '0.070', 'weapon5': '0.098', 'AMMO4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.398', 'WEAPON3': '0.450', 'HITCOUNT': '1.130', 'weapon2': '1.332', 'weapon3': '1.398', 'DAMAGECOUNT': '4.485', 'FRAGCOUNT': '16.000'} [2023-02-24 18:54:14,289][177170] DAMAGECOUNT value on done: 218820.0 [2023-02-24 18:54:14,289][177170] Sum rewards: 18.049, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.395', 'AMMO2': '0.015', 'AMMO5': '0.018', 'weapon7': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.156', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.350', 'WEAPON3': '0.750', 'weapon2': '1.008', 'HITCOUNT': '1.350', 'weapon3': '2.006', 'DAMAGECOUNT': '5.427', 'FRAGCOUNT': '14.500'} [2023-02-24 18:54:14,749][177153] Updated weights for policy 0, policy_version 18680 (0.0008) [2023-02-24 18:54:15,061][177158] DAMAGECOUNT value on done: 212157.0 [2023-02-24 18:54:15,062][177158] Sum rewards: 16.682, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.007', 'AMMO2': '0.015', 'AMMO5': '0.017', 'weapon7': '0.028', 'AMMO4': '0.076', 'AMMO3': '0.085', 'weapon5': '0.146', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.444', 'ARMOR': '0.466', 'WEAPON3': '0.700', 'weapon2': '0.744', 'HITCOUNT': '1.120', 'weapon3': '1.430', 'DAMAGECOUNT': '4.797', 'FRAGCOUNT': '14.000'} [2023-02-24 18:54:15,357][177158] DAMAGECOUNT value on done: 213261.0 [2023-02-24 18:54:15,358][177158] Sum rewards: 8.610, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.870', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO3': '0.097', 'AMMO4': '0.097', 'weapon5': '0.164', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'ARMOR': '0.500', 'weapon4': '0.586', 'HITCOUNT': '0.600', 'WEAPON3': '0.650', 'weapon2': '0.860', 'weapon3': '1.712', 'DAMAGECOUNT': '2.982', 'FRAGCOUNT': '8.000'} [2023-02-24 18:54:16,229][177158] DAMAGECOUNT value on done: 222655.0 [2023-02-24 18:54:16,229][177158] Sum rewards: 8.512, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon7': '0.054', 'AMMO3': '0.087', 'AMMO4': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.450', 'HITCOUNT': '0.510', 'weapon4': '0.568', 'HEALTH': '0.571', 'weapon3': '1.206', 'weapon2': '1.306', 'DAMAGECOUNT': '2.382', 'FRAGCOUNT': '7.000'} [2023-02-24 18:54:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13870.9). Total num frames: 76533760. Throughput: 0: 3484.9. Samples: 19134628. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:54:16,376][177119] Avg episode reward: [(0, '13.359')] [2023-02-24 18:54:16,524][177158] DAMAGECOUNT value on done: 222108.0 [2023-02-24 18:54:16,524][177158] Sum rewards: 16.308, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.529', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.018', 'weapon7': '0.050', 'AMMO4': '0.091', 'weapon4': '0.092', 'AMMO3': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'HITCOUNT': '1.140', 'weapon3': '1.394', 'weapon2': '1.870', 'DAMAGECOUNT': '5.127', 'FRAGCOUNT': '13.000'} [2023-02-24 18:54:17,697][177153] Updated weights for policy 0, policy_version 18690 (0.0008) [2023-02-24 18:54:18,082][177171] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.588, 196.0), ('weapon7', 0.002)] [2023-02-24 18:54:18,389][177172] DAMAGECOUNT value on done: 219098.0 [2023-02-24 18:54:18,390][177172] Sum rewards: 16.954, reward structure: {'DEATHCOUNT': '-4.500', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO3': '0.054', 'weapon7': '0.068', 'HEALTH': '0.126', 'weapon5': '0.152', 'AMMO4': '0.158', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'weapon2': '0.766', 'HITCOUNT': '0.780', 'ARMOR': '0.800', 'weapon4': '0.982', 'weapon3': '1.020', 'DAMAGECOUNT': '3.741', 'FRAGCOUNT': '11.000'} [2023-02-24 18:54:18,691][177172] DAMAGECOUNT value on done: 214588.0 [2023-02-24 18:54:18,691][177172] Sum rewards: 14.900, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.970', 'AMMO2': '0.007', 'AMMO5': '0.019', 'weapon7': '0.030', 'AMMO4': '0.036', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'weapon5': '0.198', 'weapon4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'HITCOUNT': '0.950', 'weapon2': '1.172', 'weapon3': '1.828', 'DAMAGECOUNT': '3.972', 'FRAGCOUNT': '13.000'} [2023-02-24 18:54:19,062][177171] Large shaping reward 3.441 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.39, 130.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 18:54:20,179][177172] DAMAGECOUNT value on done: 224873.0 [2023-02-24 18:54:20,179][177172] Sum rewards: 21.387, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.941', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO3': '0.080', 'AMMO4': '0.090', 'weapon5': '0.164', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.558', 'WEAPON3': '0.600', 'weapon2': '1.150', 'HITCOUNT': '1.430', 'weapon3': '1.462', 'DAMAGECOUNT': '5.769', 'FRAGCOUNT': '15.000'} [2023-02-24 18:54:20,233][177154] DAMAGECOUNT value on done: 222653.0 [2023-02-24 18:54:20,234][177154] Sum rewards: 10.768, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.080', 'AMMO2': '0.011', 'AMMO5': '0.029', 'AMMO4': '0.055', 'weapon5': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'weapon4': '0.378', 'WEAPON5': '0.650', 'weapon2': '0.900', 'HITCOUNT': '1.050', 'WEAPON3': '1.150', 'weapon3': '2.344', 'DAMAGECOUNT': '4.356', 'FRAGCOUNT': '12.000'} [2023-02-24 18:54:20,495][177172] DAMAGECOUNT value on done: 217220.0 [2023-02-24 18:54:20,495][177172] Sum rewards: 13.949, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.763', 'AMMO2': '0.014', 'AMMO5': '0.015', 'weapon7': '0.048', 'AMMO4': '0.069', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.123', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.232', 'weapon4': '0.340', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'weapon2': '1.006', 'HITCOUNT': '1.100', 'weapon3': '1.928', 'DAMAGECOUNT': '5.697', 'FRAGCOUNT': '10.500'} [2023-02-24 18:54:20,544][177154] DAMAGECOUNT value on done: 225747.0 [2023-02-24 18:54:20,544][177154] Sum rewards: 11.534, reward structure: {'DEATHCOUNT': '-9.000', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'AMMO5': '0.023', 'weapon7': '0.034', 'AMMO4': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.202', 'weapon4': '0.204', 'HEALTH': '0.320', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'HITCOUNT': '0.920', 'weapon2': '1.142', 'weapon3': '2.084', 'DAMAGECOUNT': '3.795', 'FRAGCOUNT': '10.000'} [2023-02-24 18:54:20,667][177153] Updated weights for policy 0, policy_version 18700 (0.0008) [2023-02-24 18:54:20,840][177154] DAMAGECOUNT value on done: 234620.0 [2023-02-24 18:54:20,841][177154] Sum rewards: 15.105, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.348', 'weapon7': '0.002', 'AMMO2': '0.017', 'AMMO5': '0.017', 'weapon4': '0.020', 'ARMOR': '0.040', 'AMMO4': '0.083', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'weapon5': '0.234', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.990', 'weapon2': '1.394', 'weapon3': '2.032', 'DAMAGECOUNT': '4.506', 'FRAGCOUNT': '12.000'} [2023-02-24 18:54:20,975][177157] DAMAGECOUNT value on done: 210619.0 [2023-02-24 18:54:20,975][177157] Sum rewards: 14.129, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.160', 'AMMO2': '0.014', 'AMMO5': '0.015', 'AMMO4': '0.072', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'weapon5': '0.164', 'WEAPON5': '0.300', 'weapon4': '0.364', 'ARMOR': '0.473', 'WEAPON3': '0.600', 'HITCOUNT': '0.850', 'weapon2': '1.116', 'weapon3': '1.544', 'DAMAGECOUNT': '4.017', 'FRAGCOUNT': '12.000'} [2023-02-24 18:54:20,986][177157] DAMAGECOUNT value on done: 227257.0 [2023-02-24 18:54:20,986][177157] Sum rewards: 15.659, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.315', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.031', 'AMMO3': '0.073', 'weapon7': '0.100', 'weapon5': '0.150', 'WEAPON4': '0.200', 'AMMO6': '0.280', 'AMMO7': '0.280', 'weapon4': '0.336', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.830', 'weapon2': '0.846', 'weapon3': '1.186', 'DAMAGECOUNT': '4.089', 'FRAGCOUNT': '11.000'} [2023-02-24 18:54:21,136][177154] DAMAGECOUNT value on done: 224965.0 [2023-02-24 18:54:21,136][177154] Sum rewards: 16.013, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.525', 'AMMO5': '0.019', 'AMMO2': '0.024', 'weapon7': '0.050', 'AMMO3': '0.069', 'AMMO4': '0.120', 'weapon5': '0.186', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON4': '0.400', 'WEAPON7': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.500', 'weapon4': '0.508', 'HITCOUNT': '0.790', 'weapon2': '1.160', 'weapon3': '1.262', 'DAMAGECOUNT': '3.909', 'FRAGCOUNT': '13.000'} [2023-02-24 18:54:21,286][177157] DAMAGECOUNT value on done: 214295.0 [2023-02-24 18:54:21,287][177157] Sum rewards: 6.773, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.122', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.013', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO3': '0.057', 'AMMO4': '0.063', 'weapon7': '0.110', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'weapon2': '0.390', 'HITCOUNT': '0.550', 'weapon4': '0.566', 'weapon3': '0.962', 'DAMAGECOUNT': '2.313', 'FRAGCOUNT': '5.000'} [2023-02-24 18:54:21,298][177157] DAMAGECOUNT value on done: 215436.0 [2023-02-24 18:54:21,298][177157] Sum rewards: 14.509, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.670', 'AMMO2': '0.015', 'AMMO5': '0.018', 'AMMO3': '0.070', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'weapon5': '0.160', 'WEAPON5': '0.300', 'weapon4': '0.422', 'WEAPON3': '0.450', 'HITCOUNT': '0.880', 'weapon3': '1.364', 'weapon2': '1.466', 'DAMAGECOUNT': '3.558', 'FRAGCOUNT': '13.000'} [2023-02-24 18:54:21,318][177171] DAMAGECOUNT value on done: 215473.0 [2023-02-24 18:54:21,319][177171] Sum rewards: 13.541, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.510', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.028', 'weapon5': '0.056', 'AMMO3': '0.075', 'weapon7': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO6': '0.340', 'AMMO7': '0.340', 'weapon4': '0.386', 'WEAPON7': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.890', 'weapon2': '0.998', 'weapon3': '1.110', 'DAMAGECOUNT': '3.618', 'FRAGCOUNT': '10.000'} [2023-02-24 18:54:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13870.9). Total num frames: 76603392. Throughput: 0: 3486.3. Samples: 19145086. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:54:21,376][177119] Avg episode reward: [(0, '13.530')] [2023-02-24 18:54:21,624][177171] DAMAGECOUNT value on done: 225852.0 [2023-02-24 18:54:21,625][177171] Sum rewards: 24.967, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.794', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.107', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.458', 'WEAPON3': '0.650', 'weapon2': '1.332', 'HITCOUNT': '1.460', 'weapon3': '1.498', 'DAMAGECOUNT': '6.744', 'FRAGCOUNT': '21.000'} [2023-02-24 18:54:21,638][177171] DAMAGECOUNT value on done: 216848.0 [2023-02-24 18:54:21,638][177171] Sum rewards: 9.448, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.330', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.018', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'weapon7': '0.148', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'weapon4': '0.408', 'weapon2': '0.450', 'HITCOUNT': '0.520', 'weapon3': '0.754', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '7.000'} [2023-02-24 18:54:21,944][177171] DAMAGECOUNT value on done: 217742.0 [2023-02-24 18:54:21,945][177171] Sum rewards: 8.565, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.157', 'AMMO5': '0.020', 'AMMO2': '0.022', 'weapon7': '0.022', 'weapon4': '0.096', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'weapon5': '0.238', 'WEAPON5': '0.450', 'weapon2': '0.794', 'WEAPON3': '1.050', 'HITCOUNT': '1.140', 'weapon3': '2.470', 'DAMAGECOUNT': '4.644', 'FRAGCOUNT': '11.000'} [2023-02-24 18:54:22,876][177155] DAMAGECOUNT value on done: 219534.0 [2023-02-24 18:54:22,876][177155] Sum rewards: 22.361, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.060', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.058', 'weapon7': '0.060', 'AMMO3': '0.083', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.211', 'ARMOR': '0.450', 'weapon2': '0.450', 'WEAPON3': '0.550', 'WEAPON4': '0.550', 'weapon4': '1.012', 'HITCOUNT': '1.190', 'weapon3': '1.380', 'DAMAGECOUNT': '5.487', 'FRAGCOUNT': '18.000'} [2023-02-24 18:54:23,177][177155] DAMAGECOUNT value on done: 226487.0 [2023-02-24 18:54:23,177][177155] Sum rewards: 23.090, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.622', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon7': '0.104', 'AMMO3': '0.109', 'weapon5': '0.110', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.700', 'HITCOUNT': '1.100', 'weapon3': '1.642', 'weapon2': '1.680', 'DAMAGECOUNT': '5.364', 'FRAGCOUNT': '18.000'} [2023-02-24 18:54:23,484][177155] DAMAGECOUNT value on done: 226826.0 [2023-02-24 18:54:23,484][177155] Sum rewards: 15.470, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.846', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'AMMO3': '0.047', 'weapon7': '0.084', 'weapon5': '0.090', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.290', 'WEAPON3': '0.350', 'ARMOR': '0.482', 'weapon3': '0.804', 'HITCOUNT': '0.830', 'weapon2': '1.216', 'DAMAGECOUNT': '4.467', 'FRAGCOUNT': '10.000'} [2023-02-24 18:54:23,606][177153] Updated weights for policy 0, policy_version 18710 (0.0008) [2023-02-24 18:54:23,786][177155] DAMAGECOUNT value on done: 212216.0 [2023-02-24 18:54:23,786][177155] Sum rewards: 15.450, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.645', 'AMMO2': '0.011', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'weapon4': '0.118', 'AMMO3': '0.119', 'weapon5': '0.202', 'WEAPON5': '0.500', 'HITCOUNT': '0.830', 'WEAPON3': '0.850', 'weapon2': '1.298', 'weapon3': '1.996', 'DAMAGECOUNT': '4.230', 'FRAGCOUNT': '15.000'} [2023-02-24 18:54:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13870.9). Total num frames: 76673024. Throughput: 0: 3483.6. Samples: 19165844. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:54:26,376][177119] Avg episode reward: [(0, '13.666')] [2023-02-24 18:54:26,548][177153] Updated weights for policy 0, policy_version 18720 (0.0008) [2023-02-24 18:54:29,481][177153] Updated weights for policy 0, policy_version 18730 (0.0008) [2023-02-24 18:54:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13870.9). Total num frames: 76742656. Throughput: 0: 3486.9. Samples: 19186812. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:54:31,376][177119] Avg episode reward: [(0, '13.666')] [2023-02-24 18:54:31,456][177156] DAMAGECOUNT value on done: 221830.0 [2023-02-24 18:54:31,457][177156] Sum rewards: 13.580, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.500', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon7': '0.054', 'AMMO3': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.122', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.700', 'HITCOUNT': '0.710', 'weapon3': '1.508', 'weapon2': '1.848', 'DAMAGECOUNT': '3.213', 'FRAGCOUNT': '12.000'} [2023-02-24 18:54:31,467][177156] DAMAGECOUNT value on done: 217050.0 [2023-02-24 18:54:31,468][177156] Sum rewards: 11.278, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.170', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.010', 'WEAPON4': '0.050', 'AMMO3': '0.095', 'weapon5': '0.132', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.224', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'HITCOUNT': '0.810', 'weapon2': '1.240', 'weapon3': '1.668', 'DAMAGECOUNT': '3.315', 'FRAGCOUNT': '10.000'} [2023-02-24 18:54:31,767][177156] DAMAGECOUNT value on done: 225314.0 [2023-02-24 18:54:31,768][177156] Sum rewards: 8.739, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.815', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO3': '0.070', 'AMMO4': '0.130', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.206', 'weapon2': '0.442', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.590', 'weapon4': '0.840', 'weapon3': '1.266', 'DAMAGECOUNT': '3.114', 'FRAGCOUNT': '7.000'} [2023-02-24 18:54:31,781][177156] DAMAGECOUNT value on done: 216010.0 [2023-02-24 18:54:31,782][177156] Sum rewards: 9.140, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.306', 'AMMO2': '0.016', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'AMMO4': '0.078', 'AMMO3': '0.103', 'WEAPON4': '0.150', 'weapon5': '0.214', 'weapon4': '0.322', 'WEAPON5': '0.350', 'HITCOUNT': '0.580', 'WEAPON3': '0.650', 'weapon2': '1.376', 'weapon3': '1.472', 'DAMAGECOUNT': '3.066', 'FRAGCOUNT': '7.000'} [2023-02-24 18:54:32,409][177153] Updated weights for policy 0, policy_version 18740 (0.0008) [2023-02-24 18:54:32,603][177170] DAMAGECOUNT value on done: 222350.0 [2023-02-24 18:54:32,604][177170] Sum rewards: 16.238, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.456', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.009', 'weapon7': '0.012', 'WEAPON4': '0.050', 'AMMO3': '0.072', 'weapon5': '0.122', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.214', 'WEAPON3': '0.550', 'HITCOUNT': '0.990', 'weapon3': '1.520', 'weapon2': '1.748', 'DAMAGECOUNT': '4.848', 'FRAGCOUNT': '11.000'} [2023-02-24 18:54:32,904][177170] DAMAGECOUNT value on done: 230273.0 [2023-02-24 18:54:32,904][177170] Sum rewards: 18.243, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.904', 'AMMO5': '0.015', 'AMMO2': '0.022', 'weapon7': '0.050', 'AMMO3': '0.089', 'AMMO4': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.282', 'WEAPON5': '0.300', 'weapon4': '0.396', 'WEAPON3': '0.600', 'HITCOUNT': '1.140', 'weapon2': '1.238', 'weapon3': '1.750', 'DAMAGECOUNT': '6.213', 'FRAGCOUNT': '13.000'} [2023-02-24 18:54:33,210][177170] DAMAGECOUNT value on done: 222685.0 [2023-02-24 18:54:33,210][177170] Sum rewards: 10.709, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.057', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.260', 'HEALTH': '0.350', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.520', 'weapon3': '1.004', 'weapon2': '1.670', 'DAMAGECOUNT': '2.286', 'FRAGCOUNT': '7.000'} [2023-02-24 18:54:33,508][177170] DAMAGECOUNT value on done: 219450.0 [2023-02-24 18:54:33,509][177170] Sum rewards: 7.510, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.710', 'AMMO2': '0.003', 'AMMO4': '0.012', 'AMMO3': '0.047', 'weapon7': '0.058', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'weapon4': '0.390', 'weapon2': '0.474', 'HITCOUNT': '0.590', 'weapon3': '0.816', 'DAMAGECOUNT': '1.890', 'FRAGCOUNT': '6.000'} [2023-02-24 18:54:34,348][177158] DAMAGECOUNT value on done: 213340.0 [2023-02-24 18:54:34,349][177158] Sum rewards: 14.270, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.430', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.012', 'weapon7': '0.056', 'AMMO3': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.164', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'weapon4': '0.406', 'WEAPON3': '0.550', 'HITCOUNT': '0.840', 'weapon3': '1.048', 'weapon2': '1.482', 'DAMAGECOUNT': '3.549', 'FRAGCOUNT': '11.000'} [2023-02-24 18:54:34,651][177158] DAMAGECOUNT value on done: 214917.0 [2023-02-24 18:54:34,652][177158] Sum rewards: 14.561, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.558', 'AMMO5': '0.016', 'ARMOR': '0.016', 'WEAPON1': '0.030', 'AMMO2': '0.031', 'weapon5': '0.116', 'AMMO4': '0.154', 'AMMO3': '0.156', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.546', 'weapon4': '0.758', 'WEAPON3': '1.000', 'HITCOUNT': '1.330', 'weapon3': '2.098', 'DAMAGECOUNT': '4.968', 'FRAGCOUNT': '14.000'} [2023-02-24 18:54:35,342][177153] Updated weights for policy 0, policy_version 18750 (0.0008) [2023-02-24 18:54:35,512][177158] DAMAGECOUNT value on done: 224150.0 [2023-02-24 18:54:35,512][177158] Sum rewards: 16.633, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.484', 'AMMO5': '0.005', 'AMMO2': '0.029', 'AMMO3': '0.085', 'weapon5': '0.114', 'AMMO4': '0.143', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.342', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '1.220', 'weapon2': '1.256', 'weapon3': '1.588', 'DAMAGECOUNT': '4.485', 'FRAGCOUNT': '15.000'} [2023-02-24 18:54:35,809][177158] DAMAGECOUNT value on done: 222710.0 [2023-02-24 18:54:35,809][177158] Sum rewards: 7.380, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.521', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.050', 'weapon5': '0.056', 'weapon7': '0.060', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'HITCOUNT': '0.430', 'weapon4': '0.438', 'ARMOR': '0.552', 'weapon3': '1.272', 'weapon2': '1.540', 'DAMAGECOUNT': '1.806', 'FRAGCOUNT': '5.000'} [2023-02-24 18:54:36,267][177156] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200.0), ('weapon7', 0.002)] [2023-02-24 18:54:36,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13884.7). Total num frames: 76812288. Throughput: 0: 3484.9. Samples: 19197290. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:54:36,376][177119] Avg episode reward: [(0, '13.429')] [2023-02-24 18:54:37,743][177172] DAMAGECOUNT value on done: 220084.0 [2023-02-24 18:54:37,743][177172] Sum rewards: 9.952, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.706', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon5': '0.022', 'WEAPON4': '0.050', 'weapon7': '0.052', 'AMMO4': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.101', 'weapon4': '0.138', 'WEAPON5': '0.200', 'WEAPON3': '0.650', 'HITCOUNT': '0.850', 'weapon3': '1.238', 'weapon2': '2.232', 'DAMAGECOUNT': '2.958', 'FRAGCOUNT': '7.000'} [2023-02-24 18:54:38,040][177172] DAMAGECOUNT value on done: 215517.0 [2023-02-24 18:54:38,041][177172] Sum rewards: 5.672, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.220', 'AMMO2': '0.014', 'AMMO5': '0.018', 'weapon7': '0.048', 'AMMO4': '0.071', 'weapon4': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.178', 'WEAPON5': '0.350', 'HITCOUNT': '0.800', 'WEAPON3': '1.100', 'weapon2': '1.384', 'weapon3': '2.016', 'DAMAGECOUNT': '2.787', 'FRAGCOUNT': '9.000'} [2023-02-24 18:54:38,277][177153] Updated weights for policy 0, policy_version 18760 (0.0008) [2023-02-24 18:54:39,523][177172] DAMAGECOUNT value on done: 226376.0 [2023-02-24 18:54:39,523][177172] Sum rewards: 10.006, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.695', 'AMMO2': '0.014', 'AMMO5': '0.025', 'AMMO4': '0.072', 'AMMO3': '0.137', 'weapon5': '0.148', 'WEAPON4': '0.150', 'weapon4': '0.354', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'HITCOUNT': '1.150', 'weapon2': '1.180', 'weapon3': '2.162', 'DAMAGECOUNT': '4.509', 'FRAGCOUNT': '9.500'} [2023-02-24 18:54:39,558][177154] DAMAGECOUNT value on done: 224196.0 [2023-02-24 18:54:39,558][177154] Sum rewards: 15.248, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon7': '0.086', 'AMMO3': '0.092', 'HEALTH': '0.110', 'weapon5': '0.186', 'AMMO4': '0.194', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.372', 'WEAPON3': '0.500', 'weapon4': '0.816', 'HITCOUNT': '0.930', 'weapon3': '1.134', 'DAMAGECOUNT': '4.629', 'FRAGCOUNT': '12.500'} [2023-02-24 18:54:39,821][177172] DAMAGECOUNT value on done: 218508.0 [2023-02-24 18:54:39,822][177172] Sum rewards: 15.596, reward structure: {'DEATHCOUNT': '-6.750', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.018', 'weapon7': '0.048', 'AMMO3': '0.090', 'AMMO4': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.194', 'WEAPON5': '0.350', 'weapon4': '0.428', 'HEALTH': '0.498', 'WEAPON3': '0.550', 'weapon2': '0.638', 'HITCOUNT': '0.990', 'weapon3': '2.168', 'DAMAGECOUNT': '3.864', 'FRAGCOUNT': '12.000'} [2023-02-24 18:54:39,857][177154] DAMAGECOUNT value on done: 226916.0 [2023-02-24 18:54:39,857][177154] Sum rewards: 11.850, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.332', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.120', 'AMMO4': '0.126', 'AMMO3': '0.137', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.418', 'WEAPON3': '0.800', 'HITCOUNT': '0.890', 'weapon2': '1.094', 'weapon3': '1.696', 'DAMAGECOUNT': '3.507', 'FRAGCOUNT': '11.000'} [2023-02-24 18:54:40,148][177154] DAMAGECOUNT value on done: 236146.0 [2023-02-24 18:54:40,148][177154] Sum rewards: 13.596, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.330', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon7': '0.054', 'weapon5': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.111', 'weapon2': '0.194', 'WEAPON5': '0.200', 'AMMO4': '0.230', 'WEAPON4': '0.450', 'WEAPON3': '0.700', 'weapon4': '1.076', 'HITCOUNT': '1.170', 'weapon3': '1.716', 'DAMAGECOUNT': '4.578', 'FRAGCOUNT': '12.000'} [2023-02-24 18:54:40,286][177157] DAMAGECOUNT value on done: 213066.0 [2023-02-24 18:54:40,287][177157] Sum rewards: 28.063, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.980', 'AMMO5': '0.017', 'ARMOR': '0.039', 'AMMO2': '0.043', 'AMMO3': '0.080', 'weapon7': '0.140', 'AMMO4': '0.213', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.278', 'WEAPON7': '0.300', 'weapon2': '0.398', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '0.600', 'weapon4': '1.062', 'HITCOUNT': '1.440', 'weapon3': '1.452', 'DAMAGECOUNT': '7.341', 'FRAGCOUNT': '21.000'} [2023-02-24 18:54:40,300][177157] DAMAGECOUNT value on done: 228431.0 [2023-02-24 18:54:40,301][177157] Sum rewards: 8.438, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.840', 'weapon7': '0.002', 'AMMO2': '0.015', 'AMMO5': '0.023', 'AMMO4': '0.073', 'weapon5': '0.120', 'AMMO3': '0.123', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.220', 'WEAPON5': '0.500', 'HITCOUNT': '0.760', 'WEAPON3': '0.850', 'weapon2': '1.444', 'weapon3': '1.826', 'DAMAGECOUNT': '3.522', 'FRAGCOUNT': '7.500'} [2023-02-24 18:54:40,448][177154] DAMAGECOUNT value on done: 226149.0 [2023-02-24 18:54:40,449][177154] Sum rewards: 8.422, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.081', 'AMMO2': '0.002', 'ARMOR': '0.004', 'AMMO4': '0.012', 'AMMO5': '0.024', 'weapon4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.174', 'weapon5': '0.236', 'WEAPON5': '0.550', 'HITCOUNT': '0.710', 'WEAPON3': '1.150', 'weapon2': '1.306', 'weapon3': '2.122', 'DAMAGECOUNT': '3.552', 'FRAGCOUNT': '12.000'} [2023-02-24 18:54:40,589][177157] DAMAGECOUNT value on done: 215455.0 [2023-02-24 18:54:40,590][177157] Sum rewards: 14.708, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.290', 'AMMO2': '0.009', 'AMMO5': '0.012', 'weapon5': '0.030', 'AMMO4': '0.045', 'weapon7': '0.048', 'AMMO3': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.650', 'HITCOUNT': '0.940', 'weapon3': '1.596', 'weapon2': '1.660', 'DAMAGECOUNT': '3.480', 'FRAGCOUNT': '12.000'} [2023-02-24 18:54:40,603][177157] DAMAGECOUNT value on done: 216594.0 [2023-02-24 18:54:40,603][177157] Sum rewards: 11.557, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.320', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.075', 'weapon7': '0.076', 'WEAPON4': '0.150', 'weapon5': '0.172', 'WEAPON5': '0.200', 'weapon4': '0.286', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.730', 'weapon2': '1.522', 'weapon3': '1.590', 'DAMAGECOUNT': '3.474', 'FRAGCOUNT': '8.000'} [2023-02-24 18:54:40,624][177171] DAMAGECOUNT value on done: 216063.0 [2023-02-24 18:54:40,624][177171] Sum rewards: 6.981, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.007', 'weapon7': '0.048', 'AMMO3': '0.068', 'weapon5': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HEALTH': '0.198', 'WEAPON5': '0.200', 'HITCOUNT': '0.310', 'WEAPON3': '0.350', 'weapon3': '1.208', 'weapon2': '1.444', 'DAMAGECOUNT': '1.770', 'FRAGCOUNT': '4.000'} [2023-02-24 18:54:40,815][177156] Large shaping reward 2.619 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0)] [2023-02-24 18:54:40,938][177171] DAMAGECOUNT value on done: 227030.0 [2023-02-24 18:54:40,938][177171] Sum rewards: 14.741, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.180', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.007', 'AMMO3': '0.067', 'weapon7': '0.098', 'weapon5': '0.144', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.570', 'weapon3': '1.248', 'weapon2': '1.612', 'DAMAGECOUNT': '3.534', 'FRAGCOUNT': '10.000'} [2023-02-24 18:54:40,949][177171] DAMAGECOUNT value on done: 218033.0 [2023-02-24 18:54:40,949][177171] Sum rewards: 14.069, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.224', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.026', 'AMMO3': '0.088', 'weapon7': '0.106', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.506', 'WEAPON3': '0.600', 'weapon2': '0.810', 'HITCOUNT': '0.920', 'weapon3': '1.594', 'DAMAGECOUNT': '3.555', 'FRAGCOUNT': '12.500'} [2023-02-24 18:54:41,243][177153] Updated weights for policy 0, policy_version 18770 (0.0009) [2023-02-24 18:54:41,248][177171] DAMAGECOUNT value on done: 219110.0 [2023-02-24 18:54:41,248][177171] Sum rewards: 11.211, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.042', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'weapon5': '0.162', 'WEAPON5': '0.300', 'weapon4': '0.428', 'WEAPON3': '0.850', 'HITCOUNT': '0.930', 'weapon2': '1.352', 'weapon3': '1.684', 'DAMAGECOUNT': '4.104', 'FRAGCOUNT': '11.000'} [2023-02-24 18:54:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13884.7). Total num frames: 76881920. Throughput: 0: 3479.4. Samples: 19218090. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:54:41,376][177119] Avg episode reward: [(0, '13.225')] [2023-02-24 18:54:42,144][177155] DAMAGECOUNT value on done: 220537.0 [2023-02-24 18:54:42,145][177155] Sum rewards: 10.673, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.515', 'AMMO2': '0.011', 'AMMO5': '0.012', 'weapon7': '0.048', 'AMMO4': '0.053', 'AMMO3': '0.068', 'weapon5': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.358', 'WEAPON3': '0.450', 'weapon2': '0.884', 'HITCOUNT': '0.950', 'weapon3': '1.308', 'DAMAGECOUNT': '3.009', 'FRAGCOUNT': '7.500'} [2023-02-24 18:54:42,442][177155] DAMAGECOUNT value on done: 227477.0 [2023-02-24 18:54:42,442][177155] Sum rewards: 10.139, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.247', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.086', 'AMMO3': '0.093', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON3': '0.650', 'weapon4': '0.676', 'HITCOUNT': '0.700', 'ARMOR': '0.869', 'weapon2': '1.334', 'weapon3': '1.374', 'DAMAGECOUNT': '2.970', 'FRAGCOUNT': '9.000'} [2023-02-24 18:54:42,742][177155] DAMAGECOUNT value on done: 227961.0 [2023-02-24 18:54:42,742][177155] Sum rewards: 15.154, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.060', 'weapon5': '0.064', 'weapon7': '0.106', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'HEALTH': '0.605', 'HITCOUNT': '0.850', 'weapon3': '1.268', 'weapon2': '1.370', 'DAMAGECOUNT': '3.405', 'FRAGCOUNT': '10.000'} [2023-02-24 18:54:43,048][177155] DAMAGECOUNT value on done: 213121.0 [2023-02-24 18:54:43,049][177155] Sum rewards: 9.532, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.315', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.027', 'weapon5': '0.028', 'WEAPON4': '0.050', 'AMMO3': '0.051', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.296', 'WEAPON3': '0.400', 'weapon2': '0.708', 'HITCOUNT': '0.780', 'weapon3': '1.274', 'DAMAGECOUNT': '2.715', 'FRAGCOUNT': '6.000'} [2023-02-24 18:54:44,186][177153] Updated weights for policy 0, policy_version 18780 (0.0008) [2023-02-24 18:54:45,900][177154] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 18:54:46,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13884.7). Total num frames: 76951552. Throughput: 0: 3480.4. Samples: 19239056. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:54:46,376][177119] Avg episode reward: [(0, '13.128')] [2023-02-24 18:54:47,110][177153] Updated weights for policy 0, policy_version 18790 (0.0008) [2023-02-24 18:54:50,039][177153] Updated weights for policy 0, policy_version 18800 (0.0008) [2023-02-24 18:54:50,801][177156] DAMAGECOUNT value on done: 223172.0 [2023-02-24 18:54:50,801][177156] Sum rewards: 15.682, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.110', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon7': '0.076', 'AMMO3': '0.077', 'AMMO4': '0.095', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.124', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.840', 'weapon4': '0.884', 'weapon3': '0.888', 'weapon2': '1.056', 'DAMAGECOUNT': '3.888', 'FRAGCOUNT': '13.000'} [2023-02-24 18:54:50,811][177156] DAMAGECOUNT value on done: 218694.0 [2023-02-24 18:54:50,812][177156] Sum rewards: 14.898, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.065', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon7': '0.080', 'AMMO3': '0.107', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.750', 'weapon4': '0.768', 'weapon2': '0.786', 'HITCOUNT': '1.200', 'weapon3': '1.804', 'DAMAGECOUNT': '4.932', 'FRAGCOUNT': '12.000'} [2023-02-24 18:54:51,112][177156] DAMAGECOUNT value on done: 226771.0 [2023-02-24 18:54:51,112][177156] Sum rewards: 17.976, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.621', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon5': '0.128', 'weapon7': '0.196', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.418', 'HITCOUNT': '1.000', 'weapon2': '1.152', 'weapon3': '1.404', 'DAMAGECOUNT': '4.371', 'FRAGCOUNT': '13.500'} [2023-02-24 18:54:51,124][177156] DAMAGECOUNT value on done: 217727.0 [2023-02-24 18:54:51,124][177156] Sum rewards: 16.681, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.913', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.013', 'WEAPON1': '0.020', 'AMMO3': '0.102', 'WEAPON4': '0.200', 'weapon4': '0.252', 'weapon5': '0.260', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'HITCOUNT': '1.160', 'weapon2': '1.160', 'weapon3': '1.860', 'DAMAGECOUNT': '5.151', 'FRAGCOUNT': '14.000'} [2023-02-24 18:54:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13884.7). Total num frames: 77021184. Throughput: 0: 3481.7. Samples: 19249564. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:54:51,376][177119] Avg episode reward: [(0, '13.299')] [2023-02-24 18:54:51,929][177170] DAMAGECOUNT value on done: 223502.0 [2023-02-24 18:54:51,930][177170] Sum rewards: 9.313, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.225', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.036', 'weapon7': '0.046', 'AMMO3': '0.077', 'weapon5': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.516', 'WEAPON3': '0.600', 'HITCOUNT': '0.960', 'weapon3': '1.522', 'weapon2': '1.524', 'DAMAGECOUNT': '3.456', 'FRAGCOUNT': '6.000'} [2023-02-24 18:54:52,228][177170] DAMAGECOUNT value on done: 231809.0 [2023-02-24 18:54:52,228][177170] Sum rewards: 17.672, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.732', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'AMMO3': '0.066', 'weapon7': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.220', 'weapon5': '0.242', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.980', 'weapon2': '1.162', 'weapon3': '1.342', 'DAMAGECOUNT': '4.608', 'FRAGCOUNT': '13.000'} [2023-02-24 18:54:52,527][177170] DAMAGECOUNT value on done: 223932.0 [2023-02-24 18:54:52,528][177170] Sum rewards: 11.691, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.980', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.015', 'weapon5': '0.076', 'weapon7': '0.094', 'AMMO3': '0.095', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.700', 'HITCOUNT': '0.850', 'weapon2': '1.430', 'weapon3': '1.752', 'DAMAGECOUNT': '3.741', 'FRAGCOUNT': '9.000'} [2023-02-24 18:54:52,827][177170] DAMAGECOUNT value on done: 221143.0 [2023-02-24 18:54:52,827][177170] Sum rewards: 13.220, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.027', 'WEAPON1': '0.010', 'AMMO5': '0.032', 'AMMO2': '0.040', 'weapon7': '0.052', 'weapon5': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.180', 'AMMO4': '0.199', 'WEAPON7': '0.200', 'weapon4': '0.392', 'WEAPON4': '0.450', 'ARMOR': '0.473', 'WEAPON5': '0.550', 'weapon2': '0.806', 'HITCOUNT': '1.170', 'WEAPON3': '1.200', 'weapon3': '2.328', 'DAMAGECOUNT': '5.079', 'FRAGCOUNT': '14.000'} [2023-02-24 18:54:53,012][177153] Updated weights for policy 0, policy_version 18810 (0.0008) [2023-02-24 18:54:53,681][177158] DAMAGECOUNT value on done: 214111.0 [2023-02-24 18:54:53,681][177158] Sum rewards: 8.234, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.159', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO3': '0.081', 'AMMO4': '0.094', 'weapon7': '0.096', 'weapon5': '0.160', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON7': '0.400', 'weapon4': '0.464', 'HITCOUNT': '0.620', 'WEAPON3': '0.650', 'weapon2': '0.856', 'weapon3': '1.850', 'DAMAGECOUNT': '2.313', 'FRAGCOUNT': '7.500'} [2023-02-24 18:54:53,985][177158] DAMAGECOUNT value on done: 216451.0 [2023-02-24 18:54:53,985][177158] Sum rewards: 16.053, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.079', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.018', 'AMMO3': '0.088', 'AMMO4': '0.090', 'WEAPON4': '0.200', 'weapon5': '0.222', 'weapon4': '0.266', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '1.060', 'weapon2': '1.482', 'weapon3': '1.782', 'DAMAGECOUNT': '4.602', 'FRAGCOUNT': '13.000'} [2023-02-24 18:54:54,765][177158] DAMAGECOUNT value on done: 225518.0 [2023-02-24 18:54:54,766][177158] Sum rewards: 15.129, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.435', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO3': '0.056', 'AMMO4': '0.079', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.294', 'weapon4': '0.368', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.790', 'weapon3': '1.086', 'weapon2': '1.190', 'DAMAGECOUNT': '4.104', 'FRAGCOUNT': '10.000'} [2023-02-24 18:54:55,065][177158] DAMAGECOUNT value on done: 224096.0 [2023-02-24 18:54:55,066][177158] Sum rewards: 12.561, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.634', 'AMMO2': '0.013', 'AMMO5': '0.017', 'AMMO3': '0.060', 'AMMO4': '0.062', 'weapon7': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.216', 'weapon4': '0.298', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.910', 'weapon3': '1.292', 'weapon2': '1.772', 'DAMAGECOUNT': '4.158', 'FRAGCOUNT': '9.000'} [2023-02-24 18:54:56,001][177153] Updated weights for policy 0, policy_version 18820 (0.0009) [2023-02-24 18:54:56,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13884.7). Total num frames: 77090816. Throughput: 0: 3481.2. Samples: 19270400. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:54:56,376][177119] Avg episode reward: [(0, '13.420')] [2023-02-24 18:54:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000018821_77090816.pth... [2023-02-24 18:54:56,436][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000018007_73756672.pth [2023-02-24 18:54:57,014][177172] DAMAGECOUNT value on done: 222057.0 [2023-02-24 18:54:57,014][177172] Sum rewards: 21.268, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.055', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.022', 'AMMO3': '0.114', 'weapon5': '0.220', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'weapon2': '1.322', 'HITCOUNT': '1.370', 'weapon3': '1.828', 'DAMAGECOUNT': '5.919', 'FRAGCOUNT': '17.000'} [2023-02-24 18:54:57,317][177172] DAMAGECOUNT value on done: 216639.0 [2023-02-24 18:54:57,318][177172] Sum rewards: 12.552, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.667', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon7': '0.046', 'AMMO4': '0.051', 'AMMO3': '0.064', 'WEAPON4': '0.150', 'weapon5': '0.162', 'WEAPON5': '0.200', 'weapon4': '0.236', 'AMMO6': '0.420', 'AMMO7': '0.420', 'WEAPON3': '0.500', 'WEAPON7': '0.500', 'HITCOUNT': '0.680', 'weapon2': '1.240', 'weapon3': '1.416', 'DAMAGECOUNT': '3.366', 'FRAGCOUNT': '9.000'} [2023-02-24 18:54:58,774][177172] DAMAGECOUNT value on done: 227439.0 [2023-02-24 18:54:58,774][177172] Sum rewards: 11.727, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'HEALTH': '0.018', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon7': '0.168', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'weapon4': '0.528', 'weapon2': '0.730', 'weapon3': '0.904', 'HITCOUNT': '0.910', 'DAMAGECOUNT': '3.189', 'FRAGCOUNT': '9.000'} [2023-02-24 18:54:58,822][177154] DAMAGECOUNT value on done: 225697.0 [2023-02-24 18:54:58,823][177154] Sum rewards: 15.422, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.505', 'AMMO5': '0.017', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.121', 'weapon7': '0.122', 'weapon5': '0.196', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.614', 'weapon2': '0.728', 'WEAPON3': '0.750', 'HITCOUNT': '1.020', 'weapon3': '1.986', 'DAMAGECOUNT': '4.503', 'FRAGCOUNT': '12.000'} [2023-02-24 18:54:58,958][177153] Updated weights for policy 0, policy_version 18830 (0.0009) [2023-02-24 18:54:59,075][177172] DAMAGECOUNT value on done: 219956.0 [2023-02-24 18:54:59,076][177172] Sum rewards: 15.731, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.690', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.038', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.174', 'weapon4': '0.228', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.780', 'weapon2': '1.172', 'weapon3': '1.536', 'DAMAGECOUNT': '4.344', 'FRAGCOUNT': '12.000'} [2023-02-24 18:54:59,132][177154] DAMAGECOUNT value on done: 228599.0 [2023-02-24 18:54:59,132][177154] Sum rewards: 19.337, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.630', 'AMMO5': '0.012', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'AMMO3': '0.098', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'weapon4': '0.102', 'weapon5': '0.150', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '1.050', 'weapon2': '1.262', 'weapon3': '1.804', 'DAMAGECOUNT': '5.049', 'FRAGCOUNT': '16.000'} [2023-02-24 18:54:59,441][177154] DAMAGECOUNT value on done: 236935.0 [2023-02-24 18:54:59,442][177154] Sum rewards: 8.002, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.761', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'AMMO2': '0.036', 'weapon5': '0.044', 'AMMO3': '0.084', 'AMMO4': '0.179', 'weapon7': '0.180', 'WEAPON5': '0.200', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.394', 'WEAPON3': '0.550', 'HITCOUNT': '0.580', 'weapon4': '0.654', 'weapon3': '1.434', 'DAMAGECOUNT': '2.367', 'FRAGCOUNT': '8.500'} [2023-02-24 18:54:59,635][177157] DAMAGECOUNT value on done: 214535.0 [2023-02-24 18:54:59,635][177157] Sum rewards: 16.086, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.880', 'AMMO5': '0.015', 'AMMO2': '0.017', 'AMMO4': '0.087', 'AMMO3': '0.094', 'WEAPON4': '0.300', 'weapon5': '0.318', 'WEAPON5': '0.400', 'weapon4': '0.436', 'WEAPON3': '0.700', 'weapon2': '0.822', 'HITCOUNT': '1.110', 'weapon3': '2.010', 'DAMAGECOUNT': '4.407', 'FRAGCOUNT': '13.000'} [2023-02-24 18:54:59,645][177157] DAMAGECOUNT value on done: 229844.0 [2023-02-24 18:54:59,646][177157] Sum rewards: 11.679, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.070', 'AMMO2': '0.006', 'ARMOR': '0.020', 'AMMO5': '0.027', 'AMMO4': '0.029', 'weapon7': '0.048', 'AMMO3': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.240', 'weapon4': '0.308', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'HITCOUNT': '1.020', 'weapon2': '1.302', 'weapon3': '1.658', 'DAMAGECOUNT': '4.239', 'FRAGCOUNT': '11.000'} [2023-02-24 18:54:59,740][177154] DAMAGECOUNT value on done: 227059.0 [2023-02-24 18:54:59,741][177154] Sum rewards: 8.305, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.220', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.011', 'ARMOR': '0.040', 'WEAPON1': '0.040', 'weapon7': '0.058', 'AMMO3': '0.108', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.244', 'WEAPON5': '0.250', 'HITCOUNT': '0.680', 'WEAPON3': '0.850', 'weapon2': '1.150', 'weapon3': '1.866', 'DAMAGECOUNT': '2.730', 'FRAGCOUNT': '8.500'} [2023-02-24 18:54:59,922][177171] DAMAGECOUNT value on done: 216586.0 [2023-02-24 18:54:59,923][177171] Sum rewards: 3.163, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.420', 'AMMO5': '0.010', 'weapon5': '0.012', 'AMMO2': '0.016', 'AMMO3': '0.051', 'AMMO4': '0.081', 'weapon7': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.300', 'weapon4': '0.318', 'HITCOUNT': '0.490', 'weapon3': '0.964', 'weapon2': '1.538', 'DAMAGECOUNT': '1.569', 'FRAGCOUNT': '3.000'} [2023-02-24 18:54:59,940][177157] DAMAGECOUNT value on done: 217326.0 [2023-02-24 18:54:59,941][177157] Sum rewards: 18.317, reward structure: {'DEATHCOUNT': '-9.750', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO2': '0.042', 'weapon5': '0.102', 'AMMO3': '0.105', 'AMMO4': '0.208', 'WEAPON4': '0.300', 'HEALTH': '0.330', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.560', 'WEAPON3': '0.600', 'weapon2': '1.088', 'HITCOUNT': '1.370', 'weapon3': '1.908', 'DAMAGECOUNT': '5.613', 'FRAGCOUNT': '15.000'} [2023-02-24 18:54:59,951][177157] DAMAGECOUNT value on done: 217534.0 [2023-02-24 18:54:59,952][177157] Sum rewards: 10.442, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.285', 'AMMO5': '0.010', 'AMMO2': '0.011', 'weapon7': '0.040', 'AMMO4': '0.053', 'AMMO3': '0.058', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.364', 'WEAPON3': '0.400', 'ARMOR': '0.477', 'HITCOUNT': '0.700', 'weapon3': '0.984', 'weapon2': '1.972', 'DAMAGECOUNT': '2.820', 'FRAGCOUNT': '8.000'} [2023-02-24 18:55:00,223][177171] DAMAGECOUNT value on done: 228114.0 [2023-02-24 18:55:00,224][177171] Sum rewards: 11.545, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.602', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.038', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'weapon7': '0.106', 'weapon5': '0.126', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.234', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.740', 'weapon2': '1.402', 'weapon3': '1.500', 'DAMAGECOUNT': '3.252', 'FRAGCOUNT': '9.000'} [2023-02-24 18:55:00,236][177171] DAMAGECOUNT value on done: 219243.0 [2023-02-24 18:55:00,236][177171] Sum rewards: 12.003, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.805', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.052', 'AMMO3': '0.093', 'WEAPON5': '0.150', 'weapon7': '0.184', 'AMMO4': '0.189', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon2': '0.266', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.600', 'weapon4': '0.810', 'HITCOUNT': '0.870', 'weapon3': '1.624', 'DAMAGECOUNT': '3.630', 'FRAGCOUNT': '10.000'} [2023-02-24 18:55:00,534][177171] DAMAGECOUNT value on done: 220475.0 [2023-02-24 18:55:00,535][177171] Sum rewards: 15.562, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.968', 'AMMO5': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.094', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.532', 'WEAPON3': '0.700', 'weapon4': '0.980', 'HITCOUNT': '1.270', 'weapon3': '1.612', 'DAMAGECOUNT': '4.095', 'FRAGCOUNT': '12.000'} [2023-02-24 18:55:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13884.7). Total num frames: 77160448. Throughput: 0: 3478.4. Samples: 19291156. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:55:01,376][177119] Avg episode reward: [(0, '13.450')] [2023-02-24 18:55:01,434][177155] DAMAGECOUNT value on done: 221921.0 [2023-02-24 18:55:01,435][177155] Sum rewards: 10.007, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.076', 'AMMO5': '0.015', 'AMMO2': '0.027', 'ARMOR': '0.032', 'weapon5': '0.054', 'AMMO3': '0.127', 'AMMO4': '0.134', 'weapon7': '0.140', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.454', 'WEAPON3': '0.850', 'weapon4': '0.928', 'HITCOUNT': '1.020', 'weapon3': '1.560', 'DAMAGECOUNT': '4.152', 'FRAGCOUNT': '11.000'} [2023-02-24 18:55:01,728][177155] DAMAGECOUNT value on done: 229815.0 [2023-02-24 18:55:01,729][177155] Sum rewards: 29.013, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.130', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon7': '0.034', 'AMMO3': '0.088', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.150', 'weapon5': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'weapon4': '0.566', 'weapon2': '0.628', 'HITCOUNT': '1.250', 'weapon3': '1.712', 'DAMAGECOUNT': '7.014', 'FRAGCOUNT': '22.000'} [2023-02-24 18:55:01,894][177153] Updated weights for policy 0, policy_version 18840 (0.0008) [2023-02-24 18:55:02,042][177155] DAMAGECOUNT value on done: 228741.0 [2023-02-24 18:55:02,042][177155] Sum rewards: 3.798, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.760', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'weapon7': '0.082', 'AMMO3': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.182', 'weapon5': '0.186', 'WEAPON4': '0.350', 'weapon4': '0.372', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'weapon3': '1.114', 'weapon2': '1.354', 'DAMAGECOUNT': '2.340', 'FRAGCOUNT': '5.000'} [2023-02-24 18:55:02,333][177155] DAMAGECOUNT value on done: 214179.0 [2023-02-24 18:55:02,333][177155] Sum rewards: 11.605, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.250', 'AMMO2': '0.002', 'ARMOR': '0.004', 'AMMO4': '0.012', 'AMMO5': '0.015', 'weapon7': '0.046', 'AMMO3': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.502', 'HITCOUNT': '0.630', 'WEAPON3': '0.700', 'weapon2': '1.050', 'weapon3': '1.462', 'DAMAGECOUNT': '3.174', 'FRAGCOUNT': '10.000'} [2023-02-24 18:55:02,678][177157] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 18:55:04,844][177153] Updated weights for policy 0, policy_version 18850 (0.0009) [2023-02-24 18:55:06,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13884.7). Total num frames: 77230080. Throughput: 0: 3478.4. Samples: 19301612. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:55:06,376][177119] Avg episode reward: [(0, '13.599')] [2023-02-24 18:55:07,767][177153] Updated weights for policy 0, policy_version 18860 (0.0008) [2023-02-24 18:55:10,202][177156] DAMAGECOUNT value on done: 225157.0 [2023-02-24 18:55:10,202][177156] Sum rewards: 24.041, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.310', 'AMMO2': '0.013', 'AMMO5': '0.017', 'weapon7': '0.054', 'AMMO4': '0.065', 'AMMO3': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.122', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.300', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '1.130', 'weapon2': '1.382', 'weapon3': '1.492', 'DAMAGECOUNT': '5.955', 'FRAGCOUNT': '19.000'} [2023-02-24 18:55:10,232][177156] DAMAGECOUNT value on done: 220202.0 [2023-02-24 18:55:10,233][177156] Sum rewards: 16.428, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.420', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'ARMOR': '0.032', 'AMMO3': '0.106', 'AMMO4': '0.118', 'weapon4': '0.232', 'WEAPON4': '0.250', 'weapon5': '0.276', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'HITCOUNT': '0.940', 'weapon2': '1.344', 'weapon3': '1.712', 'DAMAGECOUNT': '4.524', 'FRAGCOUNT': '13.000'} [2023-02-24 18:55:10,510][177156] DAMAGECOUNT value on done: 228172.0 [2023-02-24 18:55:10,510][177156] Sum rewards: 11.300, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.130', 'AMMO2': '0.006', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'weapon7': '0.050', 'AMMO3': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.514', 'WEAPON3': '0.750', 'weapon2': '0.900', 'HITCOUNT': '1.090', 'weapon3': '1.586', 'DAMAGECOUNT': '4.203', 'FRAGCOUNT': '10.000'} [2023-02-24 18:55:10,539][177156] DAMAGECOUNT value on done: 219394.0 [2023-02-24 18:55:10,539][177156] Sum rewards: 18.809, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.704', 'AMMO5': '0.020', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'AMMO4': '0.127', 'weapon5': '0.182', 'weapon4': '0.254', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'weapon2': '1.152', 'HITCOUNT': '1.460', 'weapon3': '2.040', 'DAMAGECOUNT': '5.001', 'FRAGCOUNT': '16.000'} [2023-02-24 18:55:10,755][177153] Updated weights for policy 0, policy_version 18870 (0.0008) [2023-02-24 18:55:11,334][177170] DAMAGECOUNT value on done: 224744.0 [2023-02-24 18:55:11,334][177170] Sum rewards: 12.242, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.246', 'AMMO2': '0.005', 'weapon4': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.027', 'AMMO3': '0.040', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.158', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'HITCOUNT': '0.750', 'weapon3': '0.944', 'weapon2': '1.822', 'DAMAGECOUNT': '3.726', 'FRAGCOUNT': '7.000'} [2023-02-24 18:55:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13884.7). Total num frames: 77299712. Throughput: 0: 3479.2. Samples: 19322406. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:55:11,376][177119] Avg episode reward: [(0, '13.642')] [2023-02-24 18:55:11,641][177170] DAMAGECOUNT value on done: 232867.0 [2023-02-24 18:55:11,642][177170] Sum rewards: 9.680, reward structure: {'DEATHCOUNT': '-6.750', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.016', 'AMMO4': '0.078', 'AMMO3': '0.091', 'weapon7': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.132', 'WEAPON5': '0.250', 'weapon4': '0.356', 'WEAPON3': '0.550', 'HEALTH': '0.648', 'weapon2': '0.886', 'HITCOUNT': '0.900', 'weapon3': '1.826', 'DAMAGECOUNT': '3.174', 'FRAGCOUNT': '7.000'} [2023-02-24 18:55:11,949][177170] DAMAGECOUNT value on done: 224743.0 [2023-02-24 18:55:11,949][177170] Sum rewards: 7.509, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.548', 'ARMOR': '0.004', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.022', 'weapon5': '0.044', 'weapon7': '0.066', 'AMMO3': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.386', 'WEAPON3': '0.400', 'weapon2': '0.424', 'HITCOUNT': '0.510', 'weapon3': '1.046', 'DAMAGECOUNT': '2.433', 'FRAGCOUNT': '7.000'} [2023-02-24 18:55:12,248][177170] DAMAGECOUNT value on done: 223033.0 [2023-02-24 18:55:12,248][177170] Sum rewards: 21.196, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.310', 'AMMO2': '0.018', 'AMMO5': '0.018', 'AMMO4': '0.089', 'weapon5': '0.098', 'AMMO3': '0.133', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.512', 'weapon4': '0.642', 'WEAPON3': '0.900', 'HITCOUNT': '1.640', 'weapon3': '2.286', 'DAMAGECOUNT': '5.670', 'FRAGCOUNT': '19.000'} [2023-02-24 18:55:12,985][177158] DAMAGECOUNT value on done: 215088.0 [2023-02-24 18:55:12,986][177158] Sum rewards: 12.439, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.661', 'AMMO2': '0.009', 'AMMO5': '0.012', 'AMMO4': '0.047', 'AMMO3': '0.072', 'weapon5': '0.162', 'weapon7': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'AMMO6': '0.340', 'AMMO7': '0.340', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.484', 'WEAPON7': '0.500', 'HITCOUNT': '0.530', 'weapon3': '1.142', 'weapon2': '1.254', 'DAMAGECOUNT': '2.931', 'FRAGCOUNT': '9.000'} [2023-02-24 18:55:13,287][177158] DAMAGECOUNT value on done: 218435.0 [2023-02-24 18:55:13,287][177158] Sum rewards: 21.314, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.994', 'ARMOR': '0.012', 'AMMO2': '0.015', 'AMMO5': '0.020', 'weapon4': '0.050', 'WEAPON1': '0.070', 'AMMO4': '0.074', 'AMMO3': '0.082', 'WEAPON4': '0.200', 'weapon5': '0.322', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'HITCOUNT': '1.110', 'weapon2': '1.206', 'weapon3': '1.794', 'DAMAGECOUNT': '5.952', 'FRAGCOUNT': '17.000'} [2023-02-24 18:55:13,700][177153] Updated weights for policy 0, policy_version 18880 (0.0008) [2023-02-24 18:55:14,094][177158] DAMAGECOUNT value on done: 227280.0 [2023-02-24 18:55:14,094][177158] Sum rewards: 21.008, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.940', 'AMMO2': '0.020', 'AMMO5': '0.021', 'weapon5': '0.054', 'AMMO4': '0.097', 'AMMO3': '0.112', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.588', 'WEAPON3': '0.800', 'weapon2': '0.996', 'HITCOUNT': '1.320', 'weapon3': '1.454', 'DAMAGECOUNT': '5.286', 'FRAGCOUNT': '18.000'} [2023-02-24 18:55:14,395][177158] DAMAGECOUNT value on done: 225292.0 [2023-02-24 18:55:14,396][177158] Sum rewards: 9.889, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.157', 'ARMOR': '0.004', 'AMMO2': '0.017', 'AMMO5': '0.017', 'weapon5': '0.078', 'AMMO4': '0.082', 'AMMO3': '0.083', 'weapon4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.900', 'weapon3': '1.604', 'weapon2': '1.882', 'DAMAGECOUNT': '3.588', 'FRAGCOUNT': '7.500'} [2023-02-24 18:55:16,349][177172] DAMAGECOUNT value on done: 223889.0 [2023-02-24 18:55:16,350][177172] Sum rewards: 13.336, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.820', 'AMMO5': '0.007', 'AMMO2': '0.035', 'AMMO3': '0.068', 'weapon7': '0.074', 'weapon5': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.174', 'WEAPON7': '0.200', 'WEAPON3': '0.500', 'WEAPON4': '0.600', 'HITCOUNT': '0.720', 'weapon4': '0.738', 'weapon2': '1.060', 'weapon3': '1.260', 'DAMAGECOUNT': '3.996', 'FRAGCOUNT': '12.000'} [2023-02-24 18:55:16,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13884.7). Total num frames: 77369344. Throughput: 0: 3476.4. Samples: 19343250. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:55:16,376][177119] Avg episode reward: [(0, '13.658')] [2023-02-24 18:55:16,623][177153] Updated weights for policy 0, policy_version 18890 (0.0008) [2023-02-24 18:55:16,645][177172] DAMAGECOUNT value on done: 217516.0 [2023-02-24 18:55:16,646][177172] Sum rewards: 12.497, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.111', 'AMMO4': '-0.048', 'AMMO2': '-0.010', 'AMMO5': '0.007', 'AMMO3': '0.050', 'WEAPON4': '0.100', 'weapon7': '0.194', 'weapon4': '0.210', 'weapon5': '0.220', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.453', 'HITCOUNT': '0.480', 'weapon2': '1.226', 'weapon3': '1.264', 'DAMAGECOUNT': '2.631', 'FRAGCOUNT': '9.000'} [2023-02-24 18:55:18,106][177172] DAMAGECOUNT value on done: 228407.0 [2023-02-24 18:55:18,107][177172] Sum rewards: 14.580, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.011', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'weapon7': '0.114', 'weapon5': '0.124', 'WEAPON5': '0.150', 'weapon4': '0.156', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.660', 'weapon3': '1.380', 'weapon2': '1.612', 'DAMAGECOUNT': '2.904', 'FRAGCOUNT': '11.000'} [2023-02-24 18:55:18,141][177154] DAMAGECOUNT value on done: 227007.0 [2023-02-24 18:55:18,142][177154] Sum rewards: 16.506, reward structure: {'DEATHCOUNT': '-7.500', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO3': '0.134', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'HEALTH': '0.216', 'weapon5': '0.238', 'WEAPON5': '0.300', 'weapon4': '0.470', 'WEAPON3': '0.700', 'HITCOUNT': '0.810', 'weapon2': '1.154', 'weapon3': '1.636', 'DAMAGECOUNT': '3.930', 'FRAGCOUNT': '14.000'} [2023-02-24 18:55:18,398][177172] DAMAGECOUNT value on done: 221423.0 [2023-02-24 18:55:18,398][177172] Sum rewards: 14.888, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.940', 'ARMOR': '0.004', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon7': '0.054', 'AMMO3': '0.106', 'AMMO4': '0.109', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.524', 'WEAPON3': '0.650', 'weapon2': '0.682', 'HITCOUNT': '0.910', 'weapon3': '1.340', 'DAMAGECOUNT': '4.401', 'FRAGCOUNT': '13.000'} [2023-02-24 18:55:18,440][177154] DAMAGECOUNT value on done: 229495.0 [2023-02-24 18:55:18,440][177154] Sum rewards: 13.003, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.380', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.040', 'AMMO3': '0.060', 'weapon7': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.122', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.400', 'weapon4': '0.512', 'HITCOUNT': '0.710', 'weapon2': '1.114', 'weapon3': '1.266', 'DAMAGECOUNT': '2.688', 'FRAGCOUNT': '10.000'} [2023-02-24 18:55:18,737][177154] DAMAGECOUNT value on done: 237490.0 [2023-02-24 18:55:18,737][177154] Sum rewards: 5.870, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.686', 'AMMO2': '0.002', 'AMMO4': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'weapon7': '0.048', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.176', 'WEAPON7': '0.200', 'weapon4': '0.240', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.460', 'weapon3': '1.024', 'weapon2': '1.358', 'DAMAGECOUNT': '1.665', 'FRAGCOUNT': '4.000'} [2023-02-24 18:55:18,994][177157] DAMAGECOUNT value on done: 215741.0 [2023-02-24 18:55:18,994][177157] Sum rewards: 12.497, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.206', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO3': '0.102', 'AMMO4': '0.153', 'weapon5': '0.182', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'ARMOR': '0.452', 'WEAPON3': '0.550', 'weapon4': '0.934', 'HITCOUNT': '1.000', 'weapon2': '1.000', 'weapon3': '1.268', 'DAMAGECOUNT': '3.618', 'FRAGCOUNT': '9.500'} [2023-02-24 18:55:19,004][177157] DAMAGECOUNT value on done: 231826.0 [2023-02-24 18:55:19,004][177157] Sum rewards: 15.836, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.768', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO2': '0.036', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.142', 'AMMO4': '0.180', 'weapon5': '0.192', 'WEAPON4': '0.200', 'weapon4': '0.442', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'weapon2': '1.010', 'HITCOUNT': '1.140', 'weapon3': '1.692', 'DAMAGECOUNT': '5.625', 'FRAGCOUNT': '14.000'} [2023-02-24 18:55:19,042][177154] DAMAGECOUNT value on done: 228663.0 [2023-02-24 18:55:19,042][177154] Sum rewards: 17.936, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.265', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.056', 'AMMO4': '0.069', 'AMMO3': '0.084', 'weapon7': '0.120', 'WEAPON5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.284', 'WEAPON7': '0.300', 'WEAPON3': '0.600', 'weapon2': '1.200', 'HITCOUNT': '1.240', 'weapon3': '1.324', 'DAMAGECOUNT': '4.812', 'FRAGCOUNT': '15.000'} [2023-02-24 18:55:19,239][177171] DAMAGECOUNT value on done: 218487.0 [2023-02-24 18:55:19,240][177171] Sum rewards: 15.867, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.632', 'AMMO2': '0.009', 'AMMO5': '0.012', 'AMMO4': '0.044', 'weapon7': '0.082', 'AMMO3': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.292', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'weapon2': '0.880', 'HITCOUNT': '1.390', 'weapon3': '2.204', 'DAMAGECOUNT': '5.703', 'FRAGCOUNT': '13.000'} [2023-02-24 18:55:19,302][177157] DAMAGECOUNT value on done: 218787.0 [2023-02-24 18:55:19,302][177157] Sum rewards: 14.834, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.882', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'weapon7': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.162', 'weapon4': '0.176', 'WEAPON7': '0.200', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'weapon2': '0.920', 'HITCOUNT': '0.950', 'weapon3': '1.912', 'DAMAGECOUNT': '4.383', 'FRAGCOUNT': '12.000'} [2023-02-24 18:55:19,314][177157] DAMAGECOUNT value on done: 218299.0 [2023-02-24 18:55:19,314][177157] Sum rewards: 7.949, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.640', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'weapon7': '0.054', 'AMMO3': '0.075', 'weapon5': '0.084', 'AMMO4': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'WEAPON3': '0.500', 'HITCOUNT': '0.530', 'weapon2': '1.100', 'weapon3': '1.112', 'DAMAGECOUNT': '2.295', 'FRAGCOUNT': '6.000'} [2023-02-24 18:55:19,538][177171] DAMAGECOUNT value on done: 229271.0 [2023-02-24 18:55:19,539][177171] Sum rewards: 14.951, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.020', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.060', 'weapon7': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.166', 'weapon4': '0.234', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.790', 'weapon3': '1.224', 'weapon2': '1.616', 'DAMAGECOUNT': '3.471', 'FRAGCOUNT': '10.000'} [2023-02-24 18:55:19,551][177171] DAMAGECOUNT value on done: 220468.0 [2023-02-24 18:55:19,551][177171] Sum rewards: 7.125, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.648', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon7': '0.072', 'AMMO4': '0.151', 'AMMO3': '0.154', 'weapon5': '0.158', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.466', 'weapon4': '0.732', 'HITCOUNT': '0.860', 'WEAPON3': '0.950', 'weapon3': '1.460', 'DAMAGECOUNT': '3.675', 'FRAGCOUNT': '11.000'} [2023-02-24 18:55:19,558][177153] Updated weights for policy 0, policy_version 18900 (0.0008) [2023-02-24 18:55:19,844][177171] DAMAGECOUNT value on done: 221422.0 [2023-02-24 18:55:19,845][177171] Sum rewards: 12.285, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.240', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon5': '0.074', 'AMMO3': '0.095', 'weapon7': '0.126', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.570', 'WEAPON3': '0.650', 'weapon4': '0.666', 'HITCOUNT': '0.720', 'weapon3': '1.456', 'DAMAGECOUNT': '2.841', 'FRAGCOUNT': '11.000'} [2023-02-24 18:55:20,762][177155] DAMAGECOUNT value on done: 223139.0 [2023-02-24 18:55:20,763][177155] Sum rewards: 11.219, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.990', 'AMMO2': '0.007', 'AMMO5': '0.019', 'AMMO4': '0.034', 'weapon7': '0.088', 'weapon5': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.234', 'WEAPON5': '0.450', 'HITCOUNT': '0.730', 'WEAPON3': '0.850', 'weapon2': '1.184', 'weapon3': '1.966', 'DAMAGECOUNT': '3.654', 'FRAGCOUNT': '11.500'} [2023-02-24 18:55:20,792][177171] Large shaping reward -2.531 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28200000000000003, -94.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 18:55:21,053][177155] DAMAGECOUNT value on done: 231084.0 [2023-02-24 18:55:21,054][177155] Sum rewards: 11.338, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.210', 'AMMO5': '0.012', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO3': '0.055', 'AMMO4': '0.070', 'weapon7': '0.120', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.238', 'WEAPON5': '0.250', 'weapon5': '0.312', 'WEAPON3': '0.350', 'HITCOUNT': '0.750', 'weapon3': '1.024', 'weapon2': '1.190', 'DAMAGECOUNT': '3.762', 'FRAGCOUNT': '8.000'} [2023-02-24 18:55:21,357][177155] DAMAGECOUNT value on done: 229808.0 [2023-02-24 18:55:21,358][177155] Sum rewards: 10.438, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.230', 'AMMO5': '0.022', 'AMMO2': '0.034', 'WEAPON1': '0.060', 'AMMO3': '0.152', 'AMMO4': '0.167', 'weapon5': '0.178', 'weapon4': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.550', 'HITCOUNT': '0.810', 'weapon2': '0.966', 'WEAPON3': '1.000', 'weapon3': '1.832', 'DAMAGECOUNT': '3.201', 'FRAGCOUNT': '13.000'} [2023-02-24 18:55:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13884.7). Total num frames: 77438976. Throughput: 0: 3476.8. Samples: 19353746. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:55:21,376][177119] Avg episode reward: [(0, '13.423')] [2023-02-24 18:55:21,653][177155] DAMAGECOUNT value on done: 215049.0 [2023-02-24 18:55:21,653][177155] Sum rewards: 12.200, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.050', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.005', 'weapon7': '0.048', 'AMMO3': '0.059', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.292', 'WEAPON3': '0.450', 'ARMOR': '0.479', 'HITCOUNT': '0.580', 'weapon3': '1.048', 'weapon2': '1.464', 'DAMAGECOUNT': '2.610', 'FRAGCOUNT': '9.000'} [2023-02-24 18:55:22,498][177153] Updated weights for policy 0, policy_version 18910 (0.0008) [2023-02-24 18:55:25,415][177153] Updated weights for policy 0, policy_version 18920 (0.0009) [2023-02-24 18:55:26,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13884.7). Total num frames: 77508608. Throughput: 0: 3482.3. Samples: 19374794. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:55:26,376][177119] Avg episode reward: [(0, '13.459')] [2023-02-24 18:55:28,376][177153] Updated weights for policy 0, policy_version 18930 (0.0008) [2023-02-24 18:55:28,743][177172] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:55:29,508][177156] DAMAGECOUNT value on done: 226209.0 [2023-02-24 18:55:29,508][177156] Sum rewards: 8.347, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.672', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'AMMO3': '0.086', 'weapon7': '0.132', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.264', 'WEAPON5': '0.300', 'weapon4': '0.312', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.670', 'weapon3': '1.246', 'weapon2': '1.386', 'DAMAGECOUNT': '3.156', 'FRAGCOUNT': '7.000'} [2023-02-24 18:55:29,547][177156] DAMAGECOUNT value on done: 222167.0 [2023-02-24 18:55:29,547][177156] Sum rewards: 22.013, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.860', 'AMMO2': '0.008', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.038', 'weapon7': '0.050', 'weapon4': '0.088', 'WEAPON4': '0.100', 'weapon5': '0.112', 'AMMO3': '0.142', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'weapon2': '0.952', 'WEAPON3': '1.000', 'HITCOUNT': '1.410', 'weapon3': '2.392', 'DAMAGECOUNT': '5.895', 'FRAGCOUNT': '18.500'} [2023-02-24 18:55:29,823][177156] DAMAGECOUNT value on done: 229194.0 [2023-02-24 18:55:29,824][177156] Sum rewards: 10.160, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.069', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.062', 'AMMO3': '0.073', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'weapon4': '0.446', 'WEAPON3': '0.450', 'HITCOUNT': '0.570', 'weapon3': '1.210', 'weapon2': '1.220', 'DAMAGECOUNT': '3.066', 'FRAGCOUNT': '8.000'} [2023-02-24 18:55:29,863][177156] DAMAGECOUNT value on done: 220868.0 [2023-02-24 18:55:29,863][177156] Sum rewards: 19.065, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.587', 'AMMO2': '0.003', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO4': '0.016', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO3': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.152', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.586', 'WEAPON3': '0.650', 'weapon2': '0.804', 'HITCOUNT': '0.980', 'weapon3': '1.816', 'DAMAGECOUNT': '4.422', 'FRAGCOUNT': '16.000'} [2023-02-24 18:55:30,648][177170] DAMAGECOUNT value on done: 225914.0 [2023-02-24 18:55:30,649][177170] Sum rewards: 9.577, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.105', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO5': '0.022', 'AMMO4': '0.037', 'AMMO3': '0.135', 'weapon4': '0.240', 'WEAPON4': '0.250', 'weapon5': '0.250', 'WEAPON5': '0.600', 'HITCOUNT': '0.760', 'WEAPON3': '1.000', 'weapon2': '1.134', 'weapon3': '1.982', 'DAMAGECOUNT': '3.510', 'FRAGCOUNT': '10.000'} [2023-02-24 18:55:30,944][177170] DAMAGECOUNT value on done: 233975.0 [2023-02-24 18:55:30,945][177170] Sum rewards: 12.118, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.626', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'AMMO3': '0.101', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'weapon5': '0.234', 'weapon4': '0.312', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'HITCOUNT': '0.750', 'weapon2': '1.370', 'weapon3': '1.714', 'DAMAGECOUNT': '3.324', 'FRAGCOUNT': '11.000'} [2023-02-24 18:55:31,244][177170] DAMAGECOUNT value on done: 225472.0 [2023-02-24 18:55:31,245][177170] Sum rewards: 2.891, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.058', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO5': '0.033', 'AMMO4': '0.088', 'AMMO3': '0.174', 'weapon5': '0.182', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON5': '0.550', 'HITCOUNT': '0.580', 'weapon4': '0.726', 'weapon2': '0.892', 'WEAPON3': '1.050', 'weapon3': '1.810', 'DAMAGECOUNT': '2.187', 'FRAGCOUNT': '5.500'} [2023-02-24 18:55:31,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 77574144. Throughput: 0: 3476.6. Samples: 19395504. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:55:31,376][177119] Avg episode reward: [(0, '13.201')] [2023-02-24 18:55:31,377][177153] Updated weights for policy 0, policy_version 18940 (0.0008) [2023-02-24 18:55:31,539][177170] DAMAGECOUNT value on done: 225048.0 [2023-02-24 18:55:31,539][177170] Sum rewards: 15.141, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.532', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.131', 'weapon5': '0.148', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.444', 'ARMOR': '0.446', 'weapon2': '0.462', 'WEAPON3': '0.900', 'HITCOUNT': '1.400', 'weapon3': '2.110', 'DAMAGECOUNT': '6.045', 'FRAGCOUNT': '12.000'} [2023-02-24 18:55:32,231][177158] DAMAGECOUNT value on done: 216870.0 [2023-02-24 18:55:32,232][177158] Sum rewards: 19.116, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.903', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.012', 'AMMO3': '0.097', 'weapon7': '0.126', 'WEAPON4': '0.200', 'weapon5': '0.206', 'WEAPON5': '0.350', 'AMMO6': '0.400', 'AMMO7': '0.400', 'ARMOR': '0.461', 'weapon4': '0.578', 'WEAPON3': '0.600', 'WEAPON7': '0.600', 'weapon2': '0.658', 'HITCOUNT': '1.050', 'weapon3': '1.444', 'DAMAGECOUNT': '5.346', 'FRAGCOUNT': '15.000'} [2023-02-24 18:55:32,541][177158] DAMAGECOUNT value on done: 220195.0 [2023-02-24 18:55:32,541][177158] Sum rewards: 15.518, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.724', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'AMMO2': '0.042', 'AMMO3': '0.100', 'AMMO4': '0.209', 'weapon5': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon4': '0.452', 'WEAPON3': '0.750', 'weapon2': '0.906', 'HITCOUNT': '1.120', 'weapon3': '1.822', 'DAMAGECOUNT': '5.280', 'FRAGCOUNT': '13.000'} [2023-02-24 18:55:33,336][177158] DAMAGECOUNT value on done: 228293.0 [2023-02-24 18:55:33,336][177158] Sum rewards: 9.733, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.186', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO5': '0.017', 'weapon7': '0.048', 'AMMO3': '0.068', 'AMMO4': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'weapon5': '0.206', 'WEAPON3': '0.350', 'weapon4': '0.382', 'WEAPON5': '0.400', 'ARMOR': '0.490', 'HITCOUNT': '0.700', 'weapon2': '1.044', 'weapon3': '1.060', 'DAMAGECOUNT': '3.039', 'FRAGCOUNT': '7.500'} [2023-02-24 18:55:33,640][177158] DAMAGECOUNT value on done: 226425.0 [2023-02-24 18:55:33,640][177158] Sum rewards: 9.804, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.078', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO5': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.069', 'weapon4': '0.094', 'AMMO3': '0.105', 'weapon5': '0.186', 'WEAPON5': '0.250', 'HITCOUNT': '0.630', 'WEAPON3': '0.650', 'weapon2': '1.264', 'weapon3': '1.896', 'DAMAGECOUNT': '3.399', 'FRAGCOUNT': '8.000'} [2023-02-24 18:55:34,307][177153] Updated weights for policy 0, policy_version 18950 (0.0008) [2023-02-24 18:55:35,649][177172] DAMAGECOUNT value on done: 225108.0 [2023-02-24 18:55:35,650][177172] Sum rewards: 15.315, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.420', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.053', 'weapon7': '0.054', 'weapon5': '0.070', 'AMMO4': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'weapon4': '0.510', 'weapon2': '0.818', 'HITCOUNT': '0.980', 'weapon3': '1.062', 'DAMAGECOUNT': '3.657', 'FRAGCOUNT': '11.000'} [2023-02-24 18:55:35,952][177172] DAMAGECOUNT value on done: 218850.0 [2023-02-24 18:55:35,952][177172] Sum rewards: 11.322, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.080', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'weapon7': '0.050', 'AMMO3': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.108', 'weapon2': '0.156', 'AMMO4': '0.172', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '0.700', 'ARMOR': '0.804', 'HITCOUNT': '1.040', 'weapon4': '1.072', 'weapon3': '1.578', 'DAMAGECOUNT': '4.002', 'FRAGCOUNT': '9.000'} [2023-02-24 18:55:36,376][177119] Fps is (10 sec: 13516.7, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 77643776. Throughput: 0: 3474.0. Samples: 19405892. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:55:36,376][177119] Avg episode reward: [(0, '13.254')] [2023-02-24 18:55:37,268][177153] Updated weights for policy 0, policy_version 18960 (0.0008) [2023-02-24 18:55:37,407][177154] DAMAGECOUNT value on done: 228375.0 [2023-02-24 18:55:37,407][177154] Sum rewards: 10.899, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.381', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.060', 'weapon7': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.135', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.424', 'weapon4': '0.532', 'WEAPON3': '0.850', 'HITCOUNT': '1.040', 'weapon3': '1.734', 'DAMAGECOUNT': '4.104', 'FRAGCOUNT': '12.000'} [2023-02-24 18:55:37,431][177172] DAMAGECOUNT value on done: 229462.0 [2023-02-24 18:55:37,432][177172] Sum rewards: 10.239, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.614', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'weapon7': '0.100', 'weapon5': '0.134', 'weapon4': '0.172', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.680', 'weapon2': '1.426', 'weapon3': '1.506', 'DAMAGECOUNT': '3.165', 'FRAGCOUNT': '8.000'} [2023-02-24 18:55:37,704][177154] DAMAGECOUNT value on done: 231152.0 [2023-02-24 18:55:37,704][177154] Sum rewards: 16.689, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.938', 'WEAPON1': '0.010', 'AMMO5': '0.023', 'AMMO2': '0.044', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.115', 'AMMO4': '0.217', 'weapon4': '0.342', 'weapon5': '0.366', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '1.020', 'weapon2': '1.268', 'weapon3': '1.560', 'DAMAGECOUNT': '4.662', 'FRAGCOUNT': '14.500'} [2023-02-24 18:55:37,730][177172] DAMAGECOUNT value on done: 222855.0 [2023-02-24 18:55:37,730][177172] Sum rewards: 16.108, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.080', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.025', 'AMMO3': '0.057', 'weapon5': '0.078', 'AMMO4': '0.124', 'weapon7': '0.180', 'WEAPON5': '0.200', 'weapon2': '0.256', 'WEAPON4': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.824', 'HITCOUNT': '0.900', 'weapon3': '0.902', 'DAMAGECOUNT': '4.086', 'FRAGCOUNT': '13.000'} [2023-02-24 18:55:37,989][177154] DAMAGECOUNT value on done: 238458.0 [2023-02-24 18:55:37,989][177154] Sum rewards: 0.647, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.862', 'AMMO5': '0.027', 'WEAPON1': '0.030', 'AMMO2': '0.045', 'weapon7': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.128', 'AMMO4': '0.225', 'weapon5': '0.264', 'WEAPON4': '0.400', 'weapon4': '0.530', 'HITCOUNT': '0.640', 'WEAPON5': '0.650', 'weapon2': '0.786', 'WEAPON3': '0.800', 'weapon3': '1.970', 'DAMAGECOUNT': '2.904', 'FRAGCOUNT': '3.000'} [2023-02-24 18:55:38,287][177154] DAMAGECOUNT value on done: 229288.0 [2023-02-24 18:55:38,288][177154] Sum rewards: 8.129, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.214', 'AMMO4': '-0.059', 'AMMO2': '-0.012', 'AMMO5': '0.005', 'weapon5': '0.048', 'AMMO3': '0.055', 'WEAPON4': '0.100', 'weapon7': '0.112', 'WEAPON5': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.262', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.500', 'weapon3': '0.912', 'weapon2': '1.564', 'DAMAGECOUNT': '1.875', 'FRAGCOUNT': '7.000'} [2023-02-24 18:55:38,366][177157] DAMAGECOUNT value on done: 217697.0 [2023-02-24 18:55:38,366][177157] Sum rewards: 14.467, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.022', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.177', 'weapon5': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'weapon4': '0.470', 'weapon2': '0.478', 'WEAPON3': '1.100', 'HITCOUNT': '1.200', 'weapon3': '2.184', 'DAMAGECOUNT': '5.868', 'FRAGCOUNT': '14.000'} [2023-02-24 18:55:38,377][177157] DAMAGECOUNT value on done: 232960.0 [2023-02-24 18:55:38,378][177157] Sum rewards: 5.534, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.332', 'ARMOR': '0.004', 'AMMO2': '0.013', 'AMMO5': '0.021', 'WEAPON1': '0.030', 'weapon7': '0.048', 'AMMO4': '0.062', 'AMMO3': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.272', 'weapon4': '0.380', 'WEAPON5': '0.550', 'HITCOUNT': '0.830', 'WEAPON3': '0.850', 'weapon2': '0.916', 'weapon3': '1.980', 'DAMAGECOUNT': '3.402', 'FRAGCOUNT': '6.500'} [2023-02-24 18:55:38,635][177171] DAMAGECOUNT value on done: 220167.0 [2023-02-24 18:55:38,635][177171] Sum rewards: 13.693, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.330', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.027', 'WEAPON1': '0.030', 'AMMO3': '0.095', 'weapon5': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.678', 'WEAPON3': '0.700', 'weapon4': '0.756', 'ARMOR': '0.958', 'HITCOUNT': '0.980', 'weapon3': '1.406', 'DAMAGECOUNT': '4.995', 'FRAGCOUNT': '9.500'} [2023-02-24 18:55:38,684][177157] DAMAGECOUNT value on done: 220232.0 [2023-02-24 18:55:38,685][177157] Sum rewards: 12.952, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.014', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon4': '0.072', 'AMMO3': '0.095', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'weapon7': '0.100', 'HEALTH': '0.126', 'weapon5': '0.238', 'WEAPON5': '0.250', 'AMMO6': '0.420', 'AMMO7': '0.420', 'WEAPON7': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.740', 'weapon2': '1.574', 'weapon3': '1.732', 'DAMAGECOUNT': '4.335', 'FRAGCOUNT': '9.000'} [2023-02-24 18:55:38,696][177157] DAMAGECOUNT value on done: 219274.0 [2023-02-24 18:55:38,697][177157] Sum rewards: 6.392, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.331', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.042', 'AMMO3': '0.071', 'weapon5': '0.092', 'weapon7': '0.110', 'AMMO4': '0.209', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.450', 'ARMOR': '0.472', 'WEAPON3': '0.550', 'WEAPON4': '0.550', 'weapon4': '0.690', 'HITCOUNT': '0.770', 'weapon2': '0.786', 'weapon3': '1.226', 'DAMAGECOUNT': '2.925', 'FRAGCOUNT': '7.000'} [2023-02-24 18:55:38,934][177171] DAMAGECOUNT value on done: 230726.0 [2023-02-24 18:55:38,935][177171] Sum rewards: 15.399, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.490', 'AMMO2': '0.010', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'AMMO4': '0.049', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'weapon5': '0.202', 'weapon4': '0.380', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '1.000', 'weapon2': '1.174', 'weapon3': '1.750', 'DAMAGECOUNT': '4.365', 'FRAGCOUNT': '14.000'} [2023-02-24 18:55:38,948][177171] DAMAGECOUNT value on done: 222450.0 [2023-02-24 18:55:38,949][177171] Sum rewards: 20.526, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.945', 'AMMO5': '0.012', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'AMMO3': '0.127', 'AMMO4': '0.138', 'weapon5': '0.158', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.380', 'weapon4': '0.744', 'WEAPON3': '0.900', 'HITCOUNT': '1.430', 'weapon3': '2.268', 'DAMAGECOUNT': '5.946', 'FRAGCOUNT': '18.000'} [2023-02-24 18:55:39,252][177171] DAMAGECOUNT value on done: 223169.0 [2023-02-24 18:55:39,253][177171] Sum rewards: 13.364, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.045', 'AMMO2': '0.004', 'AMMO5': '0.018', 'AMMO4': '0.021', 'ARMOR': '0.028', 'WEAPON1': '0.040', 'AMMO3': '0.145', 'weapon5': '0.190', 'WEAPON4': '0.250', 'weapon4': '0.414', 'WEAPON5': '0.450', 'weapon2': '0.786', 'WEAPON3': '1.000', 'HITCOUNT': '1.290', 'weapon3': '2.032', 'DAMAGECOUNT': '5.241', 'FRAGCOUNT': '12.500'} [2023-02-24 18:55:40,135][177155] DAMAGECOUNT value on done: 224477.0 [2023-02-24 18:55:40,135][177155] Sum rewards: 17.014, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.950', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'weapon4': '0.022', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'AMMO3': '0.124', 'weapon5': '0.188', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'HITCOUNT': '0.890', 'weapon2': '1.184', 'weapon3': '2.160', 'DAMAGECOUNT': '4.014', 'FRAGCOUNT': '15.000'} [2023-02-24 18:55:40,211][177153] Updated weights for policy 0, policy_version 18970 (0.0008) [2023-02-24 18:55:40,432][177155] DAMAGECOUNT value on done: 233409.0 [2023-02-24 18:55:40,433][177155] Sum rewards: 28.209, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.240', 'AMMO5': '0.017', 'AMMO2': '0.033', 'weapon5': '0.110', 'AMMO3': '0.141', 'AMMO4': '0.166', 'WEAPON5': '0.350', 'ARMOR': '0.448', 'WEAPON4': '0.450', 'weapon2': '0.482', 'weapon4': '0.720', 'WEAPON3': '0.900', 'HITCOUNT': '1.840', 'weapon3': '2.316', 'DAMAGECOUNT': '6.975', 'FRAGCOUNT': '25.000'} [2023-02-24 18:55:40,742][177155] DAMAGECOUNT value on done: 231140.0 [2023-02-24 18:55:40,742][177155] Sum rewards: 14.806, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.606', 'AMMO2': '0.014', 'AMMO5': '0.014', 'WEAPON1': '0.040', 'AMMO4': '0.072', 'AMMO3': '0.103', 'weapon5': '0.174', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'ARMOR': '0.490', 'weapon4': '0.574', 'WEAPON3': '0.650', 'HITCOUNT': '1.000', 'weapon2': '1.142', 'weapon3': '1.642', 'DAMAGECOUNT': '3.996', 'FRAGCOUNT': '11.000'} [2023-02-24 18:55:41,031][177155] DAMAGECOUNT value on done: 216948.0 [2023-02-24 18:55:41,031][177155] Sum rewards: 20.121, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.984', 'AMMO2': '0.014', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon5': '0.120', 'ARMOR': '0.408', 'WEAPON5': '0.450', 'weapon4': '0.486', 'WEAPON3': '0.750', 'weapon2': '0.854', 'HITCOUNT': '1.220', 'weapon3': '2.020', 'DAMAGECOUNT': '5.697', 'FRAGCOUNT': '17.000'} [2023-02-24 18:55:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 77713408. Throughput: 0: 3473.4. Samples: 19426702. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:55:41,376][177119] Avg episode reward: [(0, '13.465')] [2023-02-24 18:55:43,148][177153] Updated weights for policy 0, policy_version 18980 (0.0009) [2023-02-24 18:55:46,100][177153] Updated weights for policy 0, policy_version 18990 (0.0008) [2023-02-24 18:55:46,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.2, 300 sec: 13884.7). Total num frames: 77783040. Throughput: 0: 3474.6. Samples: 19447512. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:55:46,376][177119] Avg episode reward: [(0, '13.465')] [2023-02-24 18:55:49,000][177156] DAMAGECOUNT value on done: 228194.0 [2023-02-24 18:55:49,001][177156] Sum rewards: 18.830, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'weapon4': '0.084', 'AMMO4': '0.102', 'weapon5': '0.116', 'AMMO3': '0.134', 'WEAPON5': '0.200', 'HEALTH': '0.233', 'WEAPON3': '0.750', 'weapon2': '0.924', 'HITCOUNT': '1.380', 'weapon3': '2.104', 'DAMAGECOUNT': '5.955', 'FRAGCOUNT': '15.000'} [2023-02-24 18:55:49,010][177156] DAMAGECOUNT value on done: 222847.0 [2023-02-24 18:55:49,011][177156] Sum rewards: 8.839, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon7': '0.074', 'weapon5': '0.074', 'AMMO4': '0.074', 'AMMO3': '0.081', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'HEALTH': '0.180', 'weapon4': '0.336', 'WEAPON3': '0.500', 'HITCOUNT': '0.600', 'weapon3': '1.240', 'weapon2': '1.318', 'DAMAGECOUNT': '2.040', 'FRAGCOUNT': '7.000'} [2023-02-24 18:55:49,068][177153] Updated weights for policy 0, policy_version 19000 (0.0008) [2023-02-24 18:55:49,309][177156] DAMAGECOUNT value on done: 231424.0 [2023-02-24 18:55:49,309][177156] Sum rewards: 13.984, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.352', 'AMMO5': '0.010', 'ARMOR': '0.028', 'AMMO2': '0.029', 'weapon5': '0.100', 'AMMO4': '0.143', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.212', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.746', 'weapon2': '0.790', 'WEAPON3': '1.250', 'HITCOUNT': '1.550', 'weapon3': '1.938', 'DAMAGECOUNT': '6.690', 'FRAGCOUNT': '15.000'} [2023-02-24 18:55:49,321][177156] DAMAGECOUNT value on done: 223256.0 [2023-02-24 18:55:49,322][177156] Sum rewards: 31.918, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.961', 'AMMO2': '0.004', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO4': '0.019', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO3': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.526', 'weapon2': '0.588', 'WEAPON3': '0.800', 'HITCOUNT': '1.580', 'weapon3': '1.818', 'DAMAGECOUNT': '7.164', 'FRAGCOUNT': '28.000'} [2023-02-24 18:55:50,019][177170] DAMAGECOUNT value on done: 227677.0 [2023-02-24 18:55:50,019][177170] Sum rewards: 21.401, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.440', 'AMMO2': '0.007', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'weapon4': '0.020', 'AMMO4': '0.034', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon5': '0.146', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'HITCOUNT': '1.370', 'weapon2': '1.566', 'weapon3': '1.862', 'DAMAGECOUNT': '5.289', 'FRAGCOUNT': '19.000'} [2023-02-24 18:55:50,321][177170] DAMAGECOUNT value on done: 235116.0 [2023-02-24 18:55:50,322][177170] Sum rewards: 10.424, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.133', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon5': '0.088', 'AMMO4': '0.093', 'weapon7': '0.106', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.378', 'WEAPON3': '0.750', 'HITCOUNT': '0.880', 'weapon2': '1.100', 'weapon3': '1.760', 'DAMAGECOUNT': '3.423', 'FRAGCOUNT': '11.000'} [2023-02-24 18:55:50,616][177170] DAMAGECOUNT value on done: 227083.0 [2023-02-24 18:55:50,617][177170] Sum rewards: 15.501, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.592', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon7': '0.094', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.406', 'weapon2': '0.624', 'WEAPON3': '0.650', 'HITCOUNT': '1.000', 'weapon3': '1.326', 'DAMAGECOUNT': '4.833', 'FRAGCOUNT': '12.000'} [2023-02-24 18:55:50,725][177171] Large shaping reward -2.524 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HITCOUNT', 0.01, 1.0), ('DAMAGECOUNT', 0.015, 5.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 18:55:50,910][177170] DAMAGECOUNT value on done: 227017.0 [2023-02-24 18:55:50,910][177170] Sum rewards: 20.690, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.640', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.057', 'weapon5': '0.088', 'weapon7': '0.134', 'WEAPON5': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'WEAPON7': '0.400', 'weapon4': '0.414', 'WEAPON3': '0.450', 'weapon3': '0.998', 'HITCOUNT': '1.090', 'weapon2': '1.122', 'DAMAGECOUNT': '5.907', 'FRAGCOUNT': '16.000'} [2023-02-24 18:55:51,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13884.8). Total num frames: 77852672. Throughput: 0: 3472.1. Samples: 19457856. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:55:51,377][177119] Avg episode reward: [(0, '13.773')] [2023-02-24 18:55:51,669][177158] DAMAGECOUNT value on done: 218208.0 [2023-02-24 18:55:51,670][177158] Sum rewards: 12.659, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.348', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'weapon5': '0.106', 'AMMO3': '0.125', 'weapon4': '0.160', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '0.970', 'weapon2': '1.272', 'weapon3': '2.158', 'DAMAGECOUNT': '4.014', 'FRAGCOUNT': '12.000'} [2023-02-24 18:55:51,969][177158] DAMAGECOUNT value on done: 221574.0 [2023-02-24 18:55:51,970][177158] Sum rewards: 15.655, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.206', 'AMMO2': '0.013', 'AMMO5': '0.016', 'AMMO4': '0.062', 'weapon7': '0.080', 'AMMO3': '0.088', 'weapon5': '0.196', 'WEAPON4': '0.200', 'weapon4': '0.294', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.790', 'weapon2': '0.860', 'weapon3': '1.734', 'DAMAGECOUNT': '4.137', 'FRAGCOUNT': '13.000'} [2023-02-24 18:55:52,011][177153] Updated weights for policy 0, policy_version 19010 (0.0008) [2023-02-24 18:55:52,477][177154] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:55:52,767][177158] DAMAGECOUNT value on done: 230595.0 [2023-02-24 18:55:52,767][177158] Sum rewards: 26.663, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.292', 'AMMO5': '0.015', 'AMMO2': '0.022', 'WEAPON4': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.147', 'weapon5': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.284', 'ARMOR': '0.400', 'weapon4': '0.624', 'WEAPON3': '0.850', 'HITCOUNT': '1.390', 'weapon3': '1.898', 'DAMAGECOUNT': '6.906', 'FRAGCOUNT': '22.000'} [2023-02-24 18:55:53,073][177158] DAMAGECOUNT value on done: 227421.0 [2023-02-24 18:55:53,073][177158] Sum rewards: 8.059, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.400', 'AMMO5': '0.011', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'AMMO4': '0.069', 'AMMO3': '0.083', 'weapon4': '0.098', 'WEAPON4': '0.100', 'weapon5': '0.266', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.650', 'weapon3': '1.534', 'weapon2': '1.766', 'DAMAGECOUNT': '2.988', 'FRAGCOUNT': '6.000'} [2023-02-24 18:55:54,969][177153] Updated weights for policy 0, policy_version 19020 (0.0009) [2023-02-24 18:55:55,013][177172] DAMAGECOUNT value on done: 226130.0 [2023-02-24 18:55:55,013][177172] Sum rewards: 4.744, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.778', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO5': '0.035', 'AMMO4': '0.068', 'AMMO3': '0.135', 'weapon5': '0.218', 'WEAPON4': '0.300', 'weapon4': '0.424', 'HITCOUNT': '0.790', 'WEAPON5': '0.800', 'WEAPON3': '0.900', 'weapon2': '1.232', 'weapon3': '1.520', 'DAMAGECOUNT': '3.066', 'FRAGCOUNT': '7.000'} [2023-02-24 18:55:55,320][177172] DAMAGECOUNT value on done: 219649.0 [2023-02-24 18:55:55,321][177172] Sum rewards: 7.624, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.186', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO2': '0.036', 'weapon4': '0.058', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.181', 'weapon5': '0.294', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.510', 'weapon3': '1.498', 'weapon2': '1.698', 'DAMAGECOUNT': '2.397', 'FRAGCOUNT': '6.000'} [2023-02-24 18:55:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 77922304. Throughput: 0: 3473.2. Samples: 19478700. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:55:56,376][177119] Avg episode reward: [(0, '13.766')] [2023-02-24 18:55:56,783][177154] DAMAGECOUNT value on done: 229648.0 [2023-02-24 18:55:56,784][177154] Sum rewards: 16.089, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.180', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.023', 'WEAPON1': '0.030', 'AMMO3': '0.060', 'weapon7': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.450', 'HITCOUNT': '0.870', 'weapon3': '1.382', 'weapon2': '1.516', 'DAMAGECOUNT': '3.819', 'FRAGCOUNT': '11.000'} [2023-02-24 18:55:56,802][177172] DAMAGECOUNT value on done: 230620.0 [2023-02-24 18:55:56,802][177172] Sum rewards: 16.608, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.156', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'AMMO3': '0.064', 'weapon7': '0.068', 'weapon5': '0.180', 'AMMO4': '0.182', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.326', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.870', 'weapon4': '0.976', 'weapon3': '1.420', 'DAMAGECOUNT': '3.474', 'FRAGCOUNT': '13.000'} [2023-02-24 18:55:57,083][177154] DAMAGECOUNT value on done: 233443.0 [2023-02-24 18:55:57,084][177154] Sum rewards: 21.862, reward structure: {'DEATHCOUNT': '-12.750', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'weapon7': '0.018', 'AMMO2': '0.022', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.106', 'AMMO4': '0.110', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon4': '0.214', 'HEALTH': '0.278', 'WEAPON5': '0.300', 'weapon2': '0.562', 'WEAPON3': '1.100', 'HITCOUNT': '1.680', 'weapon3': '2.660', 'DAMAGECOUNT': '6.852', 'FRAGCOUNT': '20.000'} [2023-02-24 18:55:57,101][177172] DAMAGECOUNT value on done: 224398.0 [2023-02-24 18:55:57,102][177172] Sum rewards: 12.894, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.640', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.120', 'AMMO3': '0.145', 'WEAPON4': '0.200', 'weapon4': '0.348', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '1.120', 'weapon2': '1.172', 'weapon3': '2.082', 'DAMAGECOUNT': '4.629', 'FRAGCOUNT': '14.000'} [2023-02-24 18:55:57,383][177154] DAMAGECOUNT value on done: 240721.0 [2023-02-24 18:55:57,384][177154] Sum rewards: 21.644, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.530', 'AMMO2': '0.011', 'AMMO5': '0.020', 'weapon4': '0.020', 'WEAPON1': '0.050', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'weapon5': '0.288', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'weapon2': '1.036', 'HITCOUNT': '1.520', 'weapon3': '2.214', 'DAMAGECOUNT': '6.789', 'FRAGCOUNT': '18.500'} [2023-02-24 18:55:57,679][177154] DAMAGECOUNT value on done: 230317.0 [2023-02-24 18:55:57,680][177154] Sum rewards: 14.880, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.557', 'AMMO2': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.021', 'AMMO3': '0.030', 'WEAPON4': '0.150', 'weapon5': '0.160', 'weapon7': '0.192', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.250', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'HITCOUNT': '0.490', 'weapon4': '0.516', 'weapon3': '0.758', 'weapon2': '0.792', 'DAMAGECOUNT': '3.066', 'FRAGCOUNT': '11.000'} [2023-02-24 18:55:57,735][177157] DAMAGECOUNT value on done: 219048.0 [2023-02-24 18:55:57,735][177157] Sum rewards: 10.353, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.702', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.015', 'AMMO4': '0.053', 'AMMO3': '0.123', 'WEAPON4': '0.250', 'weapon5': '0.288', 'WEAPON5': '0.400', 'weapon4': '0.484', 'WEAPON3': '0.800', 'weapon2': '0.866', 'HITCOUNT': '0.970', 'weapon3': '1.982', 'DAMAGECOUNT': '4.053', 'FRAGCOUNT': '9.000'} [2023-02-24 18:55:57,747][177157] DAMAGECOUNT value on done: 234696.0 [2023-02-24 18:55:57,747][177157] Sum rewards: 20.109, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.562', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.054', 'AMMO3': '0.093', 'weapon5': '0.284', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'HITCOUNT': '1.110', 'weapon2': '1.418', 'weapon3': '1.896', 'DAMAGECOUNT': '5.208', 'FRAGCOUNT': '16.000'} [2023-02-24 18:55:57,918][177153] Updated weights for policy 0, policy_version 19030 (0.0008) [2023-02-24 18:55:57,953][177171] DAMAGECOUNT value on done: 221846.0 [2023-02-24 18:55:57,953][177171] Sum rewards: 18.718, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.730', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon7': '0.060', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.224', 'WEAPON3': '0.550', 'HITCOUNT': '1.110', 'weapon2': '1.194', 'weapon3': '1.634', 'DAMAGECOUNT': '5.037', 'FRAGCOUNT': '14.000'} [2023-02-24 18:55:58,039][177157] DAMAGECOUNT value on done: 220997.0 [2023-02-24 18:55:58,039][177157] Sum rewards: 6.084, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.242', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO3': '0.075', 'weapon7': '0.092', 'AMMO4': '0.097', 'weapon5': '0.108', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.680', 'weapon4': '0.780', 'weapon3': '1.290', 'weapon2': '1.344', 'DAMAGECOUNT': '2.295', 'FRAGCOUNT': '4.000'} [2023-02-24 18:55:58,050][177157] DAMAGECOUNT value on done: 220716.0 [2023-02-24 18:55:58,050][177157] Sum rewards: 14.151, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.400', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon7': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.122', 'AMMO3': '0.141', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.562', 'weapon2': '0.692', 'WEAPON3': '0.950', 'HITCOUNT': '1.090', 'weapon3': '1.966', 'DAMAGECOUNT': '4.326', 'FRAGCOUNT': '13.000'} [2023-02-24 18:55:58,239][177171] DAMAGECOUNT value on done: 223135.0 [2023-02-24 18:55:58,240][177171] Sum rewards: 9.062, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.755', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO3': '0.079', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'weapon7': '0.102', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'weapon4': '0.522', 'WEAPON3': '0.550', 'HITCOUNT': '0.550', 'weapon2': '0.612', 'weapon3': '1.304', 'DAMAGECOUNT': '2.055', 'FRAGCOUNT': '7.000'} [2023-02-24 18:55:58,258][177171] DAMAGECOUNT value on done: 231379.0 [2023-02-24 18:55:58,258][177171] Sum rewards: 5.296, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.438', 'ARMOR': '0.005', 'AMMO5': '0.009', 'AMMO2': '0.037', 'AMMO3': '0.040', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO4': '0.184', 'WEAPON3': '0.250', 'weapon7': '0.252', 'AMMO6': '0.340', 'AMMO7': '0.340', 'HITCOUNT': '0.440', 'WEAPON4': '0.500', 'WEAPON7': '0.500', 'weapon2': '0.684', 'weapon3': '0.746', 'weapon4': '0.942', 'DAMAGECOUNT': '1.959', 'FRAGCOUNT': '3.500'} [2023-02-24 18:55:58,540][177171] DAMAGECOUNT value on done: 224887.0 [2023-02-24 18:55:58,541][177171] Sum rewards: 18.498, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.212', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO2': '0.044', 'AMMO3': '0.111', 'weapon5': '0.114', 'AMMO4': '0.220', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.670', 'WEAPON3': '0.800', 'weapon2': '0.970', 'HITCOUNT': '1.300', 'weapon3': '1.674', 'DAMAGECOUNT': '5.154', 'FRAGCOUNT': '15.000'} [2023-02-24 18:55:59,514][177155] DAMAGECOUNT value on done: 226386.0 [2023-02-24 18:55:59,515][177155] Sum rewards: 17.016, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.126', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.120', 'AMMO4': '0.148', 'weapon5': '0.190', 'WEAPON4': '0.400', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.608', 'WEAPON3': '0.800', 'weapon2': '0.916', 'HITCOUNT': '1.400', 'weapon3': '1.714', 'DAMAGECOUNT': '5.727', 'FRAGCOUNT': '15.000'} [2023-02-24 18:55:59,816][177155] DAMAGECOUNT value on done: 234884.0 [2023-02-24 18:55:59,817][177155] Sum rewards: 16.920, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.946', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO3': '0.058', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.104', 'weapon5': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.532', 'HITCOUNT': '0.760', 'weapon3': '0.830', 'weapon2': '1.840', 'DAMAGECOUNT': '4.425', 'FRAGCOUNT': '13.000'} [2023-02-24 18:56:00,121][177155] DAMAGECOUNT value on done: 232250.0 [2023-02-24 18:56:00,122][177155] Sum rewards: 12.064, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.520', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.036', 'AMMO3': '0.096', 'AMMO4': '0.098', 'WEAPON5': '0.150', 'weapon7': '0.152', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON4': '0.400', 'weapon2': '0.402', 'WEAPON7': '0.500', 'WEAPON3': '0.550', 'weapon4': '0.812', 'HITCOUNT': '0.830', 'weapon3': '1.022', 'DAMAGECOUNT': '3.330', 'FRAGCOUNT': '11.000'} [2023-02-24 18:56:00,416][177155] DAMAGECOUNT value on done: 218147.0 [2023-02-24 18:56:00,417][177155] Sum rewards: 11.973, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.992', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'AMMO5': '0.003', 'weapon5': '0.044', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'WEAPON3': '0.650', 'HITCOUNT': '0.850', 'weapon2': '1.386', 'weapon3': '1.556', 'DAMAGECOUNT': '3.597', 'FRAGCOUNT': '10.000'} [2023-02-24 18:56:00,871][177153] Updated weights for policy 0, policy_version 19040 (0.0008) [2023-02-24 18:56:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 77991936. Throughput: 0: 3474.0. Samples: 19499578. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:56:01,376][177119] Avg episode reward: [(0, '14.020')] [2023-02-24 18:56:03,824][177153] Updated weights for policy 0, policy_version 19050 (0.0008) [2023-02-24 18:56:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 78061568. Throughput: 0: 3472.4. Samples: 19510002. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 18:56:06,376][177119] Avg episode reward: [(0, '14.020')] [2023-02-24 18:56:06,745][177153] Updated weights for policy 0, policy_version 19060 (0.0008) [2023-02-24 18:56:08,342][177156] DAMAGECOUNT value on done: 229343.0 [2023-02-24 18:56:08,343][177156] Sum rewards: 8.769, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.740', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO3': '0.072', 'weapon7': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.139', 'weapon5': '0.176', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.388', 'WEAPON3': '0.500', 'HITCOUNT': '0.580', 'weapon2': '0.968', 'weapon3': '1.616', 'DAMAGECOUNT': '3.447', 'FRAGCOUNT': '8.000'} [2023-02-24 18:56:08,353][177156] DAMAGECOUNT value on done: 224122.0 [2023-02-24 18:56:08,354][177156] Sum rewards: 7.428, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.720', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon4': '0.104', 'AMMO4': '0.108', 'AMMO3': '0.138', 'weapon7': '0.140', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon5': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.646', 'HITCOUNT': '0.780', 'WEAPON3': '0.850', 'weapon3': '2.170', 'DAMAGECOUNT': '3.825', 'FRAGCOUNT': '8.000'} [2023-02-24 18:56:08,652][177156] DAMAGECOUNT value on done: 232547.0 [2023-02-24 18:56:08,652][177156] Sum rewards: 9.891, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.402', 'AMMO2': '0.013', 'AMMO5': '0.016', 'AMMO4': '0.063', 'weapon5': '0.098', 'AMMO3': '0.111', 'weapon7': '0.156', 'WEAPON4': '0.200', 'weapon4': '0.310', 'WEAPON5': '0.350', 'AMMO6': '0.380', 'AMMO7': '0.380', 'WEAPON7': '0.500', 'WEAPON3': '0.750', 'HITCOUNT': '0.880', 'weapon2': '0.892', 'weapon3': '2.074', 'DAMAGECOUNT': '3.369', 'FRAGCOUNT': '9.000'} [2023-02-24 18:56:08,662][177156] DAMAGECOUNT value on done: 223943.0 [2023-02-24 18:56:08,662][177156] Sum rewards: 7.823, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'HEALTH': '0.012', 'AMMO2': '0.017', 'AMMO3': '0.046', 'AMMO4': '0.084', 'weapon7': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.228', 'WEAPON3': '0.250', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.540', 'weapon3': '0.818', 'weapon2': '1.528', 'DAMAGECOUNT': '2.061', 'FRAGCOUNT': '5.000'} [2023-02-24 18:56:09,327][177170] DAMAGECOUNT value on done: 229189.0 [2023-02-24 18:56:09,328][177170] Sum rewards: 16.651, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.640', 'AMMO2': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.061', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'weapon5': '0.162', 'weapon4': '0.192', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '1.160', 'weapon2': '1.486', 'weapon3': '1.874', 'DAMAGECOUNT': '4.536', 'FRAGCOUNT': '14.000'} [2023-02-24 18:56:09,616][177170] DAMAGECOUNT value on done: 236676.0 [2023-02-24 18:56:09,616][177170] Sum rewards: 19.632, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.158', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.107', 'weapon7': '0.108', 'weapon5': '0.160', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.400', 'WEAPON7': '0.400', 'weapon4': '0.446', 'ARMOR': '0.632', 'WEAPON3': '0.700', 'weapon2': '0.886', 'HITCOUNT': '1.150', 'weapon3': '1.694', 'DAMAGECOUNT': '4.680', 'FRAGCOUNT': '17.000'} [2023-02-24 18:56:09,678][177153] Updated weights for policy 0, policy_version 19070 (0.0008) [2023-02-24 18:56:09,903][177170] DAMAGECOUNT value on done: 227550.0 [2023-02-24 18:56:09,904][177170] Sum rewards: -2.192, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.986', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.055', 'AMMO4': '0.107', 'ARMOR': '0.120', 'weapon5': '0.196', 'WEAPON4': '0.200', 'weapon4': '0.314', 'WEAPON3': '0.350', 'HITCOUNT': '0.370', 'WEAPON5': '0.400', 'weapon3': '0.994', 'DAMAGECOUNT': '1.401', 'weapon2': '1.482'} [2023-02-24 18:56:10,201][177170] DAMAGECOUNT value on done: 227217.0 [2023-02-24 18:56:10,202][177170] Sum rewards: 4.478, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'AMMO3': '0.040', 'ARMOR': '0.044', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.108', 'HITCOUNT': '0.140', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'WEAPON3': '0.200', 'WEAPON5': '0.200', 'HEALTH': '0.374', 'weapon4': '0.512', 'DAMAGECOUNT': '0.600', 'weapon3': '0.866', 'weapon2': '1.120', 'FRAGCOUNT': '4.000'} [2023-02-24 18:56:11,039][177158] DAMAGECOUNT value on done: 220154.0 [2023-02-24 18:56:11,039][177158] Sum rewards: 18.438, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.290', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'AMMO5': '0.026', 'AMMO4': '0.108', 'AMMO3': '0.143', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.240', 'WEAPON4': '0.300', 'weapon4': '0.412', 'WEAPON5': '0.600', 'WEAPON3': '0.850', 'weapon2': '1.194', 'HITCOUNT': '1.200', 'weapon3': '1.684', 'DAMAGECOUNT': '5.838', 'FRAGCOUNT': '17.000'} [2023-02-24 18:56:11,337][177158] DAMAGECOUNT value on done: 222404.0 [2023-02-24 18:56:11,338][177158] Sum rewards: 8.463, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.770', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.072', 'weapon7': '0.074', 'AMMO3': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.276', 'weapon2': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.750', 'weapon3': '1.494', 'DAMAGECOUNT': '2.490', 'FRAGCOUNT': '8.000'} [2023-02-24 18:56:11,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 78131200. Throughput: 0: 3468.9. Samples: 19530896. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:56:11,376][177119] Avg episode reward: [(0, '13.544')] [2023-02-24 18:56:12,131][177158] DAMAGECOUNT value on done: 231473.0 [2023-02-24 18:56:12,132][177158] Sum rewards: 5.905, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.003', 'AMMO5': '0.021', 'AMMO2': '0.035', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.120', 'weapon5': '0.130', 'AMMO3': '0.143', 'AMMO4': '0.176', 'WEAPON4': '0.300', 'WEAPON5': '0.500', 'weapon4': '0.546', 'HITCOUNT': '0.710', 'weapon2': '0.752', 'WEAPON3': '0.850', 'weapon3': '1.940', 'DAMAGECOUNT': '2.634', 'FRAGCOUNT': '6.000'} [2023-02-24 18:56:12,433][177158] DAMAGECOUNT value on done: 229064.0 [2023-02-24 18:56:12,434][177158] Sum rewards: 17.723, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.016', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon7': '0.062', 'AMMO3': '0.078', 'AMMO4': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.160', 'WEAPON5': '0.250', 'weapon4': '0.342', 'WEAPON3': '0.500', 'HITCOUNT': '0.860', 'weapon2': '1.060', 'weapon3': '1.182', 'DAMAGECOUNT': '4.929', 'FRAGCOUNT': '13.000'} [2023-02-24 18:56:12,629][177153] Updated weights for policy 0, policy_version 19080 (0.0008) [2023-02-24 18:56:14,367][177172] DAMAGECOUNT value on done: 227858.0 [2023-02-24 18:56:14,368][177172] Sum rewards: 17.734, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.596', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon7': '0.072', 'AMMO3': '0.134', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon5': '0.238', 'AMMO4': '0.261', 'weapon2': '0.336', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.882', 'WEAPON3': '0.950', 'HITCOUNT': '1.310', 'weapon3': '1.974', 'DAMAGECOUNT': '5.184', 'FRAGCOUNT': '15.000'} [2023-02-24 18:56:14,666][177172] DAMAGECOUNT value on done: 220759.0 [2023-02-24 18:56:14,666][177172] Sum rewards: 10.068, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.010', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO3': '0.040', 'weapon7': '0.062', 'weapon5': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.420', 'weapon4': '0.466', 'weapon3': '1.004', 'weapon2': '1.116', 'DAMAGECOUNT': '3.330', 'FRAGCOUNT': '7.000'} [2023-02-24 18:56:15,560][177153] Updated weights for policy 0, policy_version 19090 (0.0008) [2023-02-24 18:56:16,096][177154] DAMAGECOUNT value on done: 231103.0 [2023-02-24 18:56:16,097][177154] Sum rewards: 16.659, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.845', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.070', 'AMMO3': '0.080', 'AMMO4': '0.083', 'weapon7': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.188', 'WEAPON7': '0.200', 'WEAPON3': '0.600', 'HITCOUNT': '0.930', 'weapon2': '1.570', 'weapon3': '1.770', 'DAMAGECOUNT': '4.365', 'FRAGCOUNT': '13.000'} [2023-02-24 18:56:16,173][177172] DAMAGECOUNT value on done: 232180.0 [2023-02-24 18:56:16,173][177172] Sum rewards: 15.635, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.925', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon5': '0.046', 'weapon7': '0.086', 'AMMO3': '0.097', 'AMMO4': '0.127', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.322', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '1.190', 'weapon2': '1.208', 'weapon3': '1.818', 'DAMAGECOUNT': '4.680', 'FRAGCOUNT': '13.000'} [2023-02-24 18:56:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 78200832. Throughput: 0: 3471.3. Samples: 19551714. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:56:16,376][177119] Avg episode reward: [(0, '13.448')] [2023-02-24 18:56:16,393][177154] DAMAGECOUNT value on done: 234649.0 [2023-02-24 18:56:16,394][177154] Sum rewards: 11.682, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.080', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.020', 'AMMO3': '0.093', 'AMMO4': '0.101', 'weapon5': '0.104', 'weapon7': '0.160', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'AMMO6': '0.420', 'AMMO7': '0.420', 'WEAPON7': '0.500', 'weapon4': '0.604', 'WEAPON3': '0.650', 'weapon2': '0.808', 'HITCOUNT': '0.810', 'weapon3': '1.432', 'DAMAGECOUNT': '3.618', 'FRAGCOUNT': '9.000'} [2023-02-24 18:56:16,471][177172] DAMAGECOUNT value on done: 225361.0 [2023-02-24 18:56:16,471][177172] Sum rewards: 12.073, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.201', 'AMMO2': '0.009', 'AMMO5': '0.010', 'weapon7': '0.034', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'weapon4': '0.068', 'AMMO3': '0.080', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.112', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'HITCOUNT': '0.820', 'weapon2': '1.352', 'weapon3': '1.904', 'DAMAGECOUNT': '2.889', 'FRAGCOUNT': '9.000'} [2023-02-24 18:56:16,692][177154] DAMAGECOUNT value on done: 241141.0 [2023-02-24 18:56:16,693][177154] Sum rewards: 3.955, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.095', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'AMMO3': '0.035', 'weapon5': '0.048', 'weapon7': '0.052', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'weapon2': '0.282', 'HITCOUNT': '0.350', 'weapon4': '0.448', 'weapon3': '0.540', 'DAMAGECOUNT': '1.260', 'FRAGCOUNT': '4.000'} [2023-02-24 18:56:16,985][177154] DAMAGECOUNT value on done: 231838.0 [2023-02-24 18:56:16,986][177154] Sum rewards: 16.220, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.700', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon7': '0.048', 'AMMO3': '0.105', 'AMMO4': '0.118', 'WEAPON4': '0.250', 'AMMO6': '0.260', 'AMMO7': '0.260', 'weapon5': '0.294', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.448', 'WEAPON3': '0.700', 'HITCOUNT': '0.920', 'weapon2': '0.930', 'weapon3': '1.818', 'DAMAGECOUNT': '4.563', 'FRAGCOUNT': '13.000'} [2023-02-24 18:56:17,106][177157] DAMAGECOUNT value on done: 219835.0 [2023-02-24 18:56:17,106][177157] Sum rewards: 9.566, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO3': '0.072', 'AMMO4': '0.083', 'weapon7': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.124', 'weapon5': '0.166', 'HEALTH': '0.180', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.580', 'weapon3': '1.228', 'weapon2': '1.452', 'DAMAGECOUNT': '2.361', 'FRAGCOUNT': '7.000'} [2023-02-24 18:56:17,117][177157] DAMAGECOUNT value on done: 236200.0 [2023-02-24 18:56:17,117][177157] Sum rewards: 10.577, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.896', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'weapon7': '0.020', 'AMMO2': '0.024', 'AMMO4': '0.121', 'AMMO3': '0.147', 'weapon5': '0.152', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.420', 'ARMOR': '0.444', 'WEAPON3': '1.000', 'weapon2': '1.056', 'HITCOUNT': '1.120', 'weapon3': '1.832', 'DAMAGECOUNT': '4.512', 'FRAGCOUNT': '12.500'} [2023-02-24 18:56:17,268][177171] DAMAGECOUNT value on done: 224367.0 [2023-02-24 18:56:17,268][177171] Sum rewards: 26.000, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.014', 'weapon7': '0.016', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.028', 'AMMO3': '0.083', 'AMMO4': '0.141', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.362', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon4': '0.600', 'weapon2': '0.606', 'HITCOUNT': '1.730', 'weapon3': '1.742', 'DAMAGECOUNT': '7.563', 'FRAGCOUNT': '20.500'} [2023-02-24 18:56:17,412][177157] DAMAGECOUNT value on done: 222621.0 [2023-02-24 18:56:17,412][177157] Sum rewards: 18.648, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.905', 'AMMO2': '0.013', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.234', 'weapon4': '0.282', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '1.030', 'weapon2': '1.328', 'weapon3': '1.504', 'DAMAGECOUNT': '4.872', 'FRAGCOUNT': '13.000'} [2023-02-24 18:56:17,423][177157] DAMAGECOUNT value on done: 221913.0 [2023-02-24 18:56:17,423][177157] Sum rewards: 10.103, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.464', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.150', 'AMMO3': '0.165', 'AMMO4': '0.170', 'weapon7': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'weapon4': '0.488', 'weapon2': '0.826', 'HITCOUNT': '0.860', 'WEAPON3': '1.000', 'weapon3': '1.692', 'DAMAGECOUNT': '3.591', 'FRAGCOUNT': '12.000'} [2023-02-24 18:56:17,545][177171] DAMAGECOUNT value on done: 224586.0 [2023-02-24 18:56:17,545][177171] Sum rewards: 15.094, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.617', 'AMMO5': '0.026', 'AMMO2': '0.036', 'AMMO3': '0.167', 'AMMO4': '0.179', 'weapon5': '0.228', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon4': '0.454', 'WEAPON5': '0.650', 'weapon2': '0.822', 'WEAPON3': '0.950', 'HITCOUNT': '1.030', 'weapon3': '1.866', 'DAMAGECOUNT': '4.353', 'FRAGCOUNT': '15.000'} [2023-02-24 18:56:17,571][177171] DAMAGECOUNT value on done: 232345.0 [2023-02-24 18:56:17,572][177171] Sum rewards: 7.625, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.401', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.057', 'AMMO3': '0.078', 'weapon5': '0.098', 'weapon7': '0.108', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.234', 'WEAPON7': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.660', 'weapon3': '1.248', 'weapon2': '1.286', 'DAMAGECOUNT': '2.898', 'FRAGCOUNT': '5.000'} [2023-02-24 18:56:17,859][177171] DAMAGECOUNT value on done: 225310.0 [2023-02-24 18:56:17,860][177171] Sum rewards: 0.107, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.230', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.026', 'AMMO3': '0.060', 'weapon7': '0.062', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.152', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.266', 'HITCOUNT': '0.280', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'weapon2': '0.592', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.269', 'weapon3': '1.472'} [2023-02-24 18:56:18,551][177153] Updated weights for policy 0, policy_version 19100 (0.0009) [2023-02-24 18:56:18,802][177155] DAMAGECOUNT value on done: 226642.0 [2023-02-24 18:56:18,803][177155] Sum rewards: 3.446, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.796', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO3': '0.038', 'HITCOUNT': '0.140', 'weapon7': '0.172', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.300', 'WEAPON7': '0.400', 'weapon3': '0.576', 'DAMAGECOUNT': '0.768', 'weapon2': '0.928', 'FRAGCOUNT': '2.000'} [2023-02-24 18:56:19,109][177155] DAMAGECOUNT value on done: 235414.0 [2023-02-24 18:56:19,109][177155] Sum rewards: 3.216, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.336', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO3': '0.071', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.206', 'weapon4': '0.294', 'HITCOUNT': '0.420', 'WEAPON3': '0.450', 'weapon3': '1.124', 'DAMAGECOUNT': '1.590', 'weapon2': '1.692', 'FRAGCOUNT': '4.000'} [2023-02-24 18:56:19,426][177155] DAMAGECOUNT value on done: 233908.0 [2023-02-24 18:56:19,427][177155] Sum rewards: 11.508, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.919', 'AMMO2': '0.004', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.021', 'weapon4': '0.028', 'WEAPON4': '0.050', 'AMMO3': '0.153', 'weapon5': '0.202', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'HITCOUNT': '1.140', 'weapon2': '1.354', 'weapon3': '1.962', 'DAMAGECOUNT': '4.974', 'FRAGCOUNT': '11.000'} [2023-02-24 18:56:19,719][177155] DAMAGECOUNT value on done: 218659.0 [2023-02-24 18:56:19,719][177155] Sum rewards: 3.685, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.575', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.026', 'weapon7': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.186', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.274', 'HITCOUNT': '0.430', 'WEAPON3': '0.700', 'weapon3': '1.196', 'weapon2': '1.250', 'DAMAGECOUNT': '1.536', 'FRAGCOUNT': '4.000'} [2023-02-24 18:56:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 78270464. Throughput: 0: 3471.5. Samples: 19562110. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:56:21,376][177119] Avg episode reward: [(0, '12.983')] [2023-02-24 18:56:21,477][177153] Updated weights for policy 0, policy_version 19110 (0.0008) [2023-02-24 18:56:24,431][177153] Updated weights for policy 0, policy_version 19120 (0.0009) [2023-02-24 18:56:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 78340096. Throughput: 0: 3469.2. Samples: 19582816. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:56:26,376][177119] Avg episode reward: [(0, '12.983')] [2023-02-24 18:56:27,393][177153] Updated weights for policy 0, policy_version 19130 (0.0008) [2023-02-24 18:56:27,760][177156] DAMAGECOUNT value on done: 230124.0 [2023-02-24 18:56:27,761][177156] Sum rewards: 4.884, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.450', 'AMMO2': '0.010', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.047', 'AMMO3': '0.091', 'weapon7': '0.100', 'weapon5': '0.182', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'WEAPON7': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.448', 'HITCOUNT': '0.480', 'WEAPON3': '0.650', 'weapon2': '0.906', 'weapon3': '1.214', 'DAMAGECOUNT': '2.343', 'FRAGCOUNT': '6.000'} [2023-02-24 18:56:27,774][177156] DAMAGECOUNT value on done: 225661.0 [2023-02-24 18:56:27,774][177156] Sum rewards: 16.530, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.770', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'ARMOR': '0.004', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon7': '0.062', 'weapon4': '0.068', 'weapon5': '0.082', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.123', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.900', 'HITCOUNT': '1.060', 'weapon2': '1.592', 'weapon3': '1.732', 'DAMAGECOUNT': '4.617', 'FRAGCOUNT': '14.000'} [2023-02-24 18:56:28,085][177156] DAMAGECOUNT value on done: 234143.0 [2023-02-24 18:56:28,085][177156] Sum rewards: 17.476, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.312', 'AMMO4': '-0.079', 'AMMO2': '-0.016', 'AMMO5': '0.012', 'AMMO3': '0.076', 'weapon5': '0.282', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.860', 'weapon3': '1.452', 'weapon2': '1.812', 'DAMAGECOUNT': '4.788', 'FRAGCOUNT': '13.000'} [2023-02-24 18:56:28,096][177156] DAMAGECOUNT value on done: 225757.0 [2023-02-24 18:56:28,097][177156] Sum rewards: 17.305, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.992', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon7': '0.072', 'AMMO3': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.168', 'weapon5': '0.214', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '0.600', 'weapon2': '0.608', 'weapon4': '0.720', 'HITCOUNT': '1.190', 'weapon3': '1.450', 'DAMAGECOUNT': '5.442', 'FRAGCOUNT': '13.000'} [2023-02-24 18:56:28,740][177170] DAMAGECOUNT value on done: 231158.0 [2023-02-24 18:56:28,740][177170] Sum rewards: 22.952, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.414', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.010', 'weapon7': '0.046', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.126', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.800', 'HITCOUNT': '1.310', 'weapon2': '1.318', 'weapon3': '1.768', 'DAMAGECOUNT': '5.637', 'FRAGCOUNT': '20.000'} [2023-02-24 18:56:29,035][177170] DAMAGECOUNT value on done: 238284.0 [2023-02-24 18:56:29,036][177170] Sum rewards: 12.332, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.976', 'AMMO2': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.058', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'weapon4': '0.162', 'weapon5': '0.270', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '1.070', 'weapon2': '1.284', 'weapon3': '1.740', 'DAMAGECOUNT': '4.824', 'FRAGCOUNT': '12.000'} [2023-02-24 18:56:29,328][177170] DAMAGECOUNT value on done: 229319.0 [2023-02-24 18:56:29,328][177170] Sum rewards: 21.577, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '0.016', 'AMMO5': '0.016', 'AMMO2': '0.041', 'AMMO3': '0.082', 'WEAPON4': '0.150', 'AMMO4': '0.206', 'weapon5': '0.282', 'WEAPON5': '0.350', 'weapon2': '0.534', 'WEAPON3': '0.550', 'weapon4': '0.700', 'ARMOR': '0.800', 'HITCOUNT': '1.120', 'weapon3': '1.672', 'DAMAGECOUNT': '5.307', 'FRAGCOUNT': '15.000'} [2023-02-24 18:56:29,625][177170] DAMAGECOUNT value on done: 228945.0 [2023-02-24 18:56:29,625][177170] Sum rewards: 17.962, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.219', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO5': '0.022', 'weapon7': '0.056', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.127', 'WEAPON7': '0.200', 'weapon4': '0.206', 'weapon5': '0.232', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'weapon2': '1.126', 'HITCOUNT': '1.130', 'weapon3': '1.646', 'DAMAGECOUNT': '5.184', 'FRAGCOUNT': '16.000'} [2023-02-24 18:56:30,351][177153] Updated weights for policy 0, policy_version 19140 (0.0008) [2023-02-24 18:56:30,448][177158] DAMAGECOUNT value on done: 221654.0 [2023-02-24 18:56:30,449][177158] Sum rewards: 16.619, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.150', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.057', 'AMMO3': '0.099', 'WEAPON4': '0.150', 'weapon4': '0.216', 'weapon5': '0.272', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'HITCOUNT': '1.110', 'weapon2': '1.198', 'weapon3': '1.822', 'DAMAGECOUNT': '4.500', 'FRAGCOUNT': '14.000'} [2023-02-24 18:56:30,753][177158] DAMAGECOUNT value on done: 224549.0 [2023-02-24 18:56:30,753][177158] Sum rewards: 18.725, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.216', 'AMMO5': '0.025', 'AMMO2': '0.032', 'AMMO3': '0.130', 'AMMO4': '0.162', 'weapon5': '0.292', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon2': '0.428', 'WEAPON5': '0.600', 'weapon4': '0.778', 'WEAPON3': '0.850', 'HITCOUNT': '1.550', 'weapon3': '1.958', 'DAMAGECOUNT': '6.435', 'FRAGCOUNT': '15.000'} [2023-02-24 18:56:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 78409728. Throughput: 0: 3467.5. Samples: 19603550. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:56:31,376][177119] Avg episode reward: [(0, '13.382')] [2023-02-24 18:56:31,546][177158] DAMAGECOUNT value on done: 233080.0 [2023-02-24 18:56:31,547][177158] Sum rewards: 18.909, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.081', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon7': '0.112', 'HEALTH': '0.137', 'weapon5': '0.190', 'WEAPON5': '0.200', 'AMMO6': '0.260', 'AMMO7': '0.260', 'WEAPON7': '0.300', 'weapon4': '0.372', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'weapon2': '0.942', 'HITCOUNT': '1.000', 'weapon3': '2.020', 'DAMAGECOUNT': '4.821', 'FRAGCOUNT': '13.000'} [2023-02-24 18:56:31,850][177158] DAMAGECOUNT value on done: 230660.0 [2023-02-24 18:56:31,851][177158] Sum rewards: 17.371, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.465', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon7': '0.048', 'AMMO3': '0.069', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.102', 'AMMO4': '0.116', 'WEAPON5': '0.200', 'weapon4': '0.270', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '1.060', 'weapon3': '1.070', 'weapon2': '1.532', 'DAMAGECOUNT': '4.788', 'FRAGCOUNT': '12.000'} [2023-02-24 18:56:33,335][177153] Updated weights for policy 0, policy_version 19150 (0.0008) [2023-02-24 18:56:33,800][177172] DAMAGECOUNT value on done: 229786.0 [2023-02-24 18:56:33,801][177172] Sum rewards: 15.990, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.952', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO5': '0.028', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.138', 'weapon5': '0.184', 'WEAPON4': '0.350', 'WEAPON5': '0.550', 'weapon2': '0.660', 'weapon4': '0.742', 'ARMOR': '0.847', 'WEAPON3': '0.900', 'HITCOUNT': '1.470', 'weapon3': '1.844', 'DAMAGECOUNT': '5.784', 'FRAGCOUNT': '13.000'} [2023-02-24 18:56:34,092][177172] DAMAGECOUNT value on done: 222473.0 [2023-02-24 18:56:34,093][177172] Sum rewards: 18.787, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon7': '0.048', 'AMMO4': '0.076', 'AMMO3': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.206', 'HEALTH': '0.347', 'weapon4': '0.420', 'WEAPON3': '0.450', 'ARMOR': '0.491', 'weapon2': '0.630', 'HITCOUNT': '0.800', 'weapon3': '0.922', 'DAMAGECOUNT': '5.142', 'FRAGCOUNT': '13.000'} [2023-02-24 18:56:35,587][177172] DAMAGECOUNT value on done: 233007.0 [2023-02-24 18:56:35,587][177172] Sum rewards: 5.921, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.923', 'AMMO2': '0.006', 'AMMO5': '0.022', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'weapon7': '0.062', 'AMMO3': '0.099', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.156', 'WEAPON7': '0.200', 'weapon5': '0.312', 'ARMOR': '0.400', 'HITCOUNT': '0.530', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'weapon2': '0.816', 'weapon3': '1.940', 'DAMAGECOUNT': '2.481', 'FRAGCOUNT': '5.000'} [2023-02-24 18:56:35,623][177154] DAMAGECOUNT value on done: 232521.0 [2023-02-24 18:56:35,623][177154] Sum rewards: 14.434, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.265', 'AMMO2': '0.012', 'AMMO5': '0.015', 'ARMOR': '0.032', 'AMMO4': '0.059', 'weapon7': '0.080', 'AMMO3': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon4': '0.534', 'weapon2': '0.690', 'WEAPON3': '0.850', 'HITCOUNT': '0.890', 'weapon3': '1.860', 'DAMAGECOUNT': '4.254', 'FRAGCOUNT': '14.000'} [2023-02-24 18:56:35,882][177172] DAMAGECOUNT value on done: 226585.0 [2023-02-24 18:56:35,883][177172] Sum rewards: 14.822, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.184', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'AMMO4': '0.176', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.230', 'weapon4': '0.264', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'HITCOUNT': '1.040', 'weapon2': '1.330', 'weapon3': '1.874', 'DAMAGECOUNT': '3.672', 'FRAGCOUNT': '12.000'} [2023-02-24 18:56:35,917][177154] DAMAGECOUNT value on done: 236363.0 [2023-02-24 18:56:35,917][177154] Sum rewards: 12.353, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.090', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.015', 'AMMO3': '0.175', 'weapon5': '0.254', 'WEAPON5': '0.500', 'weapon2': '1.090', 'WEAPON3': '1.100', 'HITCOUNT': '1.120', 'weapon3': '2.322', 'DAMAGECOUNT': '5.142', 'FRAGCOUNT': '14.000'} [2023-02-24 18:56:36,216][177154] DAMAGECOUNT value on done: 242345.0 [2023-02-24 18:56:36,216][177154] Sum rewards: 10.419, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.550', 'AMMO2': '0.010', 'AMMO5': '0.010', 'AMMO4': '0.048', 'weapon7': '0.054', 'weapon5': '0.076', 'AMMO3': '0.099', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.284', 'WEAPON3': '0.800', 'weapon2': '0.882', 'HITCOUNT': '1.020', 'weapon3': '1.984', 'DAMAGECOUNT': '3.612', 'FRAGCOUNT': '9.000'} [2023-02-24 18:56:36,281][177153] Updated weights for policy 0, policy_version 19160 (0.0009) [2023-02-24 18:56:36,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 78479360. Throughput: 0: 3466.8. Samples: 19613864. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:56:36,376][177119] Avg episode reward: [(0, '13.575')] [2023-02-24 18:56:36,527][177154] DAMAGECOUNT value on done: 233582.0 [2023-02-24 18:56:36,527][177154] Sum rewards: 10.021, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.710', 'AMMO5': '0.019', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'weapon7': '0.032', 'AMMO3': '0.093', 'AMMO4': '0.145', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.250', 'WEAPON4': '0.300', 'weapon5': '0.364', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'HITCOUNT': '0.880', 'weapon2': '1.344', 'weapon3': '1.566', 'DAMAGECOUNT': '5.208', 'FRAGCOUNT': '6.500'} [2023-02-24 18:56:36,597][177157] DAMAGECOUNT value on done: 221096.0 [2023-02-24 18:56:36,598][177157] Sum rewards: 8.499, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.862', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.038', 'AMMO3': '0.098', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.308', 'WEAPON3': '0.600', 'HITCOUNT': '1.010', 'weapon3': '1.328', 'weapon2': '1.472', 'DAMAGECOUNT': '3.783', 'FRAGCOUNT': '7.000'} [2023-02-24 18:56:36,608][177157] DAMAGECOUNT value on done: 238272.0 [2023-02-24 18:56:36,608][177157] Sum rewards: 21.341, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.620', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'weapon7': '0.052', 'AMMO4': '0.065', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.204', 'WEAPON5': '0.250', 'weapon2': '0.816', 'WEAPON3': '0.850', 'HITCOUNT': '1.520', 'weapon3': '2.370', 'DAMAGECOUNT': '6.216', 'FRAGCOUNT': '18.000'} [2023-02-24 18:56:36,730][177171] DAMAGECOUNT value on done: 226422.0 [2023-02-24 18:56:36,730][177171] Sum rewards: 23.784, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.043', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO3': '0.090', 'AMMO4': '0.123', 'weapon5': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'weapon4': '0.454', 'weapon2': '0.542', 'WEAPON3': '0.750', 'HITCOUNT': '1.530', 'weapon3': '2.124', 'DAMAGECOUNT': '6.165', 'FRAGCOUNT': '19.000'} [2023-02-24 18:56:36,908][177157] DAMAGECOUNT value on done: 224197.0 [2023-02-24 18:56:36,908][177157] Sum rewards: 15.038, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.550', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'AMMO3': '0.103', 'AMMO4': '0.108', 'weapon5': '0.146', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.326', 'WEAPON3': '0.650', 'HITCOUNT': '1.100', 'weapon2': '1.394', 'weapon3': '1.744', 'DAMAGECOUNT': '4.728', 'FRAGCOUNT': '11.000'} [2023-02-24 18:56:36,919][177157] DAMAGECOUNT value on done: 224509.0 [2023-02-24 18:56:36,919][177157] Sum rewards: 26.173, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.263', 'AMMO5': '0.010', 'AMMO2': '0.042', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'weapon5': '0.180', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.209', 'weapon7': '0.232', 'WEAPON4': '0.350', 'weapon4': '0.394', 'ARMOR': '0.400', 'weapon2': '0.588', 'WEAPON3': '0.950', 'HITCOUNT': '1.700', 'weapon3': '2.192', 'DAMAGECOUNT': '7.788', 'FRAGCOUNT': '22.000'} [2023-02-24 18:56:36,996][177171] DAMAGECOUNT value on done: 226456.0 [2023-02-24 18:56:36,996][177171] Sum rewards: 16.015, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.478', 'AMMO5': '0.018', 'AMMO2': '0.027', 'AMMO3': '0.129', 'AMMO4': '0.136', 'WEAPON4': '0.200', 'weapon5': '0.240', 'weapon4': '0.362', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'weapon2': '0.984', 'HITCOUNT': '1.270', 'weapon3': '1.866', 'DAMAGECOUNT': '5.610', 'FRAGCOUNT': '14.500'} [2023-02-24 18:56:37,039][177171] DAMAGECOUNT value on done: 233450.0 [2023-02-24 18:56:37,040][177171] Sum rewards: 7.846, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.609', 'ARMOR': '0.004', 'WEAPON1': '0.030', 'AMMO2': '0.035', 'AMMO5': '0.035', 'AMMO3': '0.148', 'weapon4': '0.172', 'AMMO4': '0.177', 'weapon5': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.750', 'HITCOUNT': '0.790', 'WEAPON3': '0.850', 'weapon2': '1.146', 'weapon3': '1.928', 'DAMAGECOUNT': '3.315', 'FRAGCOUNT': '10.000'} [2023-02-24 18:56:37,300][177171] DAMAGECOUNT value on done: 226901.0 [2023-02-24 18:56:37,300][177171] Sum rewards: 15.143, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.582', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO2': '0.026', 'weapon7': '0.114', 'AMMO4': '0.131', 'AMMO3': '0.174', 'weapon5': '0.178', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.452', 'ARMOR': '0.463', 'WEAPON5': '0.500', 'weapon4': '0.962', 'WEAPON3': '1.150', 'HITCOUNT': '1.290', 'weapon3': '1.778', 'DAMAGECOUNT': '4.773', 'FRAGCOUNT': '15.000'} [2023-02-24 18:56:38,276][177155] DAMAGECOUNT value on done: 228554.0 [2023-02-24 18:56:38,276][177155] Sum rewards: 16.144, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.565', 'AMMO2': '0.015', 'AMMO5': '0.019', 'AMMO4': '0.074', 'AMMO3': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.198', 'weapon4': '0.364', 'WEAPON5': '0.400', 'weapon2': '0.592', 'WEAPON3': '0.750', 'HITCOUNT': '1.610', 'weapon3': '2.200', 'DAMAGECOUNT': '5.736', 'FRAGCOUNT': '14.500'} [2023-02-24 18:56:38,576][177155] DAMAGECOUNT value on done: 236883.0 [2023-02-24 18:56:38,576][177155] Sum rewards: 17.525, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon7': '0.048', 'AMMO3': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'HEALTH': '0.220', 'weapon4': '0.246', 'weapon5': '0.274', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.710', 'weapon2': '1.244', 'weapon3': '1.684', 'DAMAGECOUNT': '4.407', 'FRAGCOUNT': '13.000'} [2023-02-24 18:56:38,879][177155] DAMAGECOUNT value on done: 234905.0 [2023-02-24 18:56:38,880][177155] Sum rewards: 9.899, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.900', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.010', 'weapon7': '0.048', 'weapon5': '0.054', 'AMMO3': '0.075', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.298', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.500', 'weapon2': '0.608', 'HITCOUNT': '0.650', 'weapon3': '1.114', 'DAMAGECOUNT': '2.991', 'FRAGCOUNT': '9.000'} [2023-02-24 18:56:39,180][177155] DAMAGECOUNT value on done: 220434.0 [2023-02-24 18:56:39,180][177155] Sum rewards: 20.673, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.183', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon7': '0.076', 'AMMO4': '0.090', 'AMMO3': '0.100', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.406', 'ARMOR': '0.457', 'WEAPON3': '0.650', 'weapon4': '0.776', 'HITCOUNT': '1.240', 'weapon3': '1.358', 'DAMAGECOUNT': '5.325', 'FRAGCOUNT': '17.000'} [2023-02-24 18:56:39,240][177153] Updated weights for policy 0, policy_version 19170 (0.0009) [2023-02-24 18:56:41,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 78548992. Throughput: 0: 3466.2. Samples: 19634680. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:56:41,376][177119] Avg episode reward: [(0, '14.114')] [2023-02-24 18:56:42,191][177153] Updated weights for policy 0, policy_version 19180 (0.0009) [2023-02-24 18:56:45,143][177153] Updated weights for policy 0, policy_version 19190 (0.0008) [2023-02-24 18:56:46,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 78618624. Throughput: 0: 3463.3. Samples: 19655428. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:56:46,376][177119] Avg episode reward: [(0, '14.114')] [2023-02-24 18:56:47,223][177156] DAMAGECOUNT value on done: 231979.0 [2023-02-24 18:56:47,224][177156] Sum rewards: 16.994, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.312', 'AMMO2': '0.002', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO4': '0.012', 'AMMO5': '0.014', 'AMMO3': '0.084', 'weapon5': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.414', 'WEAPON3': '0.650', 'weapon2': '1.116', 'HITCOUNT': '1.330', 'weapon3': '1.586', 'DAMAGECOUNT': '5.565', 'FRAGCOUNT': '13.500'} [2023-02-24 18:56:47,234][177156] DAMAGECOUNT value on done: 226716.0 [2023-02-24 18:56:47,234][177156] Sum rewards: 11.299, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.487', 'AMMO4': '-0.083', 'AMMO2': '-0.017', 'AMMO5': '0.025', 'weapon7': '0.086', 'AMMO3': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.166', 'WEAPON7': '0.200', 'WEAPON5': '0.650', 'WEAPON3': '0.800', 'HITCOUNT': '0.800', 'weapon3': '1.438', 'weapon2': '1.700', 'DAMAGECOUNT': '3.165', 'FRAGCOUNT': '11.000'} [2023-02-24 18:56:47,530][177156] DAMAGECOUNT value on done: 235878.0 [2023-02-24 18:56:47,530][177156] Sum rewards: 15.455, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.776', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon7': '0.084', 'AMMO3': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.139', 'weapon5': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.494', 'WEAPON3': '0.550', 'HITCOUNT': '1.140', 'weapon2': '1.190', 'weapon3': '1.630', 'DAMAGECOUNT': '5.205', 'FRAGCOUNT': '14.000'} [2023-02-24 18:56:47,540][177156] DAMAGECOUNT value on done: 227059.0 [2023-02-24 18:56:47,541][177156] Sum rewards: 11.737, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.446', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon7': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.126', 'weapon5': '0.134', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon2': '0.608', 'weapon4': '0.786', 'WEAPON3': '0.800', 'HITCOUNT': '0.990', 'weapon3': '1.690', 'DAMAGECOUNT': '3.906', 'FRAGCOUNT': '10.000'} [2023-02-24 18:56:48,099][177153] Updated weights for policy 0, policy_version 19200 (0.0008) [2023-02-24 18:56:48,136][177170] DAMAGECOUNT value on done: 232677.0 [2023-02-24 18:56:48,137][177170] Sum rewards: 15.473, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.827', 'AMMO5': '0.017', 'AMMO2': '0.020', 'AMMO4': '0.097', 'AMMO3': '0.138', 'weapon4': '0.180', 'WEAPON4': '0.200', 'weapon5': '0.296', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'HITCOUNT': '0.940', 'weapon2': '1.044', 'weapon3': '2.010', 'DAMAGECOUNT': '4.557', 'FRAGCOUNT': '13.000'} [2023-02-24 18:56:48,439][177170] DAMAGECOUNT value on done: 240234.0 [2023-02-24 18:56:48,439][177170] Sum rewards: 21.143, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.103', 'weapon5': '0.002', 'AMMO5': '0.005', 'weapon7': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.057', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'WEAPON4': '0.350', 'weapon4': '0.616', 'weapon2': '0.700', 'WEAPON3': '1.200', 'HITCOUNT': '1.460', 'weapon3': '2.148', 'DAMAGECOUNT': '5.850', 'FRAGCOUNT': '20.000'} [2023-02-24 18:56:48,743][177170] DAMAGECOUNT value on done: 230631.0 [2023-02-24 18:56:48,744][177170] Sum rewards: 12.964, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.853', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon4': '0.038', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.126', 'weapon5': '0.198', 'WEAPON5': '0.300', 'WEAPON3': '0.800', 'HITCOUNT': '1.000', 'weapon2': '1.236', 'weapon3': '2.176', 'DAMAGECOUNT': '3.936', 'FRAGCOUNT': '12.000'} [2023-02-24 18:56:49,044][177170] DAMAGECOUNT value on done: 230697.0 [2023-02-24 18:56:49,044][177170] Sum rewards: 18.969, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.115', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon7': '0.104', 'AMMO3': '0.135', 'AMMO4': '0.164', 'weapon5': '0.240', 'WEAPON5': '0.250', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'weapon2': '0.392', 'WEAPON4': '0.400', 'ARMOR': '0.431', 'weapon4': '0.648', 'WEAPON3': '0.850', 'HITCOUNT': '1.240', 'weapon3': '1.528', 'DAMAGECOUNT': '5.256', 'FRAGCOUNT': '15.000'} [2023-02-24 18:56:49,808][177158] DAMAGECOUNT value on done: 222983.0 [2023-02-24 18:56:49,809][177158] Sum rewards: 10.753, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.470', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.033', 'weapon7': '0.058', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.122', 'weapon4': '0.152', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon2': '1.012', 'HITCOUNT': '1.070', 'WEAPON3': '1.100', 'weapon3': '2.282', 'DAMAGECOUNT': '3.987', 'FRAGCOUNT': '12.000'} [2023-02-24 18:56:50,105][177158] DAMAGECOUNT value on done: 226200.0 [2023-02-24 18:56:50,106][177158] Sum rewards: 22.070, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.600', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO5': '0.014', 'AMMO4': '0.065', 'AMMO3': '0.076', 'weapon7': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.604', 'HITCOUNT': '1.040', 'weapon2': '1.044', 'weapon3': '1.544', 'DAMAGECOUNT': '4.953', 'FRAGCOUNT': '17.000'} [2023-02-24 18:56:50,920][177158] DAMAGECOUNT value on done: 234642.0 [2023-02-24 18:56:50,920][177158] Sum rewards: 17.382, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.665', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.008', 'WEAPON1': '0.010', 'weapon7': '0.072', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'weapon5': '0.140', 'WEAPON4': '0.200', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'weapon4': '0.452', 'WEAPON3': '0.600', 'weapon2': '0.952', 'HITCOUNT': '1.340', 'weapon3': '1.602', 'DAMAGECOUNT': '4.686', 'FRAGCOUNT': '12.000'} [2023-02-24 18:56:51,058][177153] Updated weights for policy 0, policy_version 19210 (0.0008) [2023-02-24 18:56:51,221][177158] DAMAGECOUNT value on done: 231689.0 [2023-02-24 18:56:51,221][177158] Sum rewards: 8.657, reward structure: {'DEATHCOUNT': '-7.500', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon5': '0.050', 'AMMO3': '0.095', 'weapon7': '0.148', 'AMMO4': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'HEALTH': '0.310', 'weapon4': '0.448', 'WEAPON3': '0.500', 'weapon2': '0.594', 'HITCOUNT': '0.770', 'weapon3': '1.504', 'DAMAGECOUNT': '3.087', 'FRAGCOUNT': '7.000'} [2023-02-24 18:56:51,376][177119] Fps is (10 sec: 13926.2, 60 sec: 13926.4, 300 sec: 13898.6). Total num frames: 78688256. Throughput: 0: 3463.1. Samples: 19665842. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:56:51,376][177119] Avg episode reward: [(0, '13.726')] [2023-02-24 18:56:53,151][177172] DAMAGECOUNT value on done: 230518.0 [2023-02-24 18:56:53,152][177172] Sum rewards: 9.982, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.443', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO3': '0.055', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'weapon7': '0.108', 'weapon5': '0.192', 'weapon4': '0.218', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.380', 'WEAPON3': '0.400', 'weapon3': '1.116', 'weapon2': '1.262', 'DAMAGECOUNT': '2.196', 'FRAGCOUNT': '7.000'} [2023-02-24 18:56:53,456][177172] DAMAGECOUNT value on done: 223244.0 [2023-02-24 18:56:53,456][177172] Sum rewards: 7.563, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'AMMO3': '0.050', 'weapon7': '0.050', 'weapon5': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.180', 'weapon4': '0.220', 'HEALTH': '0.226', 'WEAPON3': '0.300', 'HITCOUNT': '0.590', 'weapon3': '1.186', 'weapon2': '1.484', 'DAMAGECOUNT': '2.313', 'FRAGCOUNT': '5.500'} [2023-02-24 18:56:54,009][177153] Updated weights for policy 0, policy_version 19220 (0.0008) [2023-02-24 18:56:54,955][177172] DAMAGECOUNT value on done: 234212.0 [2023-02-24 18:56:54,956][177172] Sum rewards: 11.723, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.380', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.097', 'AMMO3': '0.121', 'weapon5': '0.166', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.448', 'HITCOUNT': '0.830', 'WEAPON3': '0.850', 'weapon2': '1.082', 'weapon3': '1.704', 'DAMAGECOUNT': '3.615', 'FRAGCOUNT': '11.000'} [2023-02-24 18:56:55,045][177154] DAMAGECOUNT value on done: 233553.0 [2023-02-24 18:56:55,046][177154] Sum rewards: 18.301, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.148', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.046', 'AMMO3': '0.070', 'weapon4': '0.086', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.162', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'HITCOUNT': '0.850', 'weapon2': '1.576', 'weapon3': '1.592', 'DAMAGECOUNT': '3.096', 'FRAGCOUNT': '15.000'} [2023-02-24 18:56:55,246][177172] DAMAGECOUNT value on done: 227222.0 [2023-02-24 18:56:55,246][177172] Sum rewards: 6.003, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.945', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.082', 'weapon7': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.109', 'weapon5': '0.116', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.306', 'HITCOUNT': '0.540', 'WEAPON3': '0.550', 'weapon2': '1.132', 'weapon3': '1.316', 'DAMAGECOUNT': '1.911', 'FRAGCOUNT': '6.000'} [2023-02-24 18:56:55,348][177154] DAMAGECOUNT value on done: 237714.0 [2023-02-24 18:56:55,348][177154] Sum rewards: 15.062, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.160', 'AMMO2': '0.007', 'AMMO5': '0.012', 'AMMO4': '0.032', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.126', 'weapon5': '0.134', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '1.090', 'weapon2': '1.412', 'weapon3': '2.008', 'DAMAGECOUNT': '4.053', 'FRAGCOUNT': '12.000'} [2023-02-24 18:56:55,643][177154] DAMAGECOUNT value on done: 243878.0 [2023-02-24 18:56:55,643][177154] Sum rewards: 21.894, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.374', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO5': '0.020', 'weapon7': '0.070', 'AMMO4': '0.075', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'weapon4': '0.148', 'weapon5': '0.196', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'weapon2': '1.140', 'HITCOUNT': '1.150', 'weapon3': '2.034', 'DAMAGECOUNT': '4.599', 'FRAGCOUNT': '18.000'} [2023-02-24 18:56:55,944][177154] DAMAGECOUNT value on done: 234849.0 [2023-02-24 18:56:55,945][177154] Sum rewards: 10.399, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.285', 'AMMO2': '0.008', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.040', 'AMMO3': '0.105', 'WEAPON4': '0.150', 'weapon4': '0.152', 'weapon5': '0.220', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'HITCOUNT': '0.930', 'weapon2': '1.232', 'weapon3': '2.060', 'DAMAGECOUNT': '3.801', 'FRAGCOUNT': '10.000'} [2023-02-24 18:56:55,970][177157] DAMAGECOUNT value on done: 222502.0 [2023-02-24 18:56:55,970][177157] Sum rewards: 12.695, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.218', 'AMMO2': '0.012', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.059', 'AMMO3': '0.147', 'weapon4': '0.178', 'weapon5': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon2': '1.090', 'HITCOUNT': '1.120', 'weapon3': '2.120', 'DAMAGECOUNT': '4.218', 'FRAGCOUNT': '13.000'} [2023-02-24 18:56:55,982][177157] DAMAGECOUNT value on done: 239664.0 [2023-02-24 18:56:55,983][177157] Sum rewards: 15.890, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.875', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'weapon7': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.064', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.180', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'weapon4': '0.542', 'weapon2': '0.614', 'HITCOUNT': '0.760', 'weapon3': '1.330', 'DAMAGECOUNT': '4.176', 'FRAGCOUNT': '12.000'} [2023-02-24 18:56:56,121][177171] DAMAGECOUNT value on done: 227959.0 [2023-02-24 18:56:56,121][177171] Sum rewards: 15.584, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.884', 'AMMO2': '0.017', 'AMMO5': '0.023', 'weapon7': '0.050', 'AMMO4': '0.082', 'AMMO3': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.240', 'WEAPON4': '0.400', 'ARMOR': '0.454', 'weapon4': '0.520', 'WEAPON5': '0.650', 'WEAPON3': '0.750', 'HITCOUNT': '0.930', 'weapon2': '1.208', 'weapon3': '1.482', 'DAMAGECOUNT': '4.611', 'FRAGCOUNT': '13.000'} [2023-02-24 18:56:56,279][177157] DAMAGECOUNT value on done: 225527.0 [2023-02-24 18:56:56,280][177157] Sum rewards: 5.603, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.496', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO2': '0.029', 'AMMO3': '0.140', 'AMMO4': '0.142', 'weapon5': '0.232', 'WEAPON4': '0.250', 'weapon4': '0.432', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'HITCOUNT': '1.060', 'weapon2': '1.210', 'weapon3': '1.670', 'DAMAGECOUNT': '3.990', 'FRAGCOUNT': '7.000'} [2023-02-24 18:56:56,290][177157] DAMAGECOUNT value on done: 225498.0 [2023-02-24 18:56:56,291][177157] Sum rewards: 12.758, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.997', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon5': '0.242', 'weapon4': '0.256', 'ARMOR': '0.404', 'WEAPON5': '0.500', 'WEAPON3': '0.500', 'HITCOUNT': '0.690', 'weapon2': '1.200', 'weapon3': '1.270', 'DAMAGECOUNT': '2.967', 'FRAGCOUNT': '10.000'} [2023-02-24 18:56:56,374][177171] DAMAGECOUNT value on done: 228023.0 [2023-02-24 18:56:56,374][177171] Sum rewards: 16.420, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.697', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'ARMOR': '0.004', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon5': '0.176', 'weapon4': '0.232', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '1.030', 'weapon2': '1.086', 'weapon3': '1.610', 'DAMAGECOUNT': '4.701', 'FRAGCOUNT': '13.000'} [2023-02-24 18:56:56,376][177119] Fps is (10 sec: 13516.7, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 78753792. Throughput: 0: 3461.6. Samples: 19686670. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:56:56,376][177119] Avg episode reward: [(0, '13.463')] [2023-02-24 18:56:56,386][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000019228_78757888.pth... [2023-02-24 18:56:56,430][177171] DAMAGECOUNT value on done: 234606.0 [2023-02-24 18:56:56,430][177171] Sum rewards: 9.639, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.938', 'AMMO2': '0.011', 'AMMO5': '0.018', 'AMMO4': '0.053', 'weapon4': '0.112', 'AMMO3': '0.159', 'weapon5': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.450', 'HITCOUNT': '0.810', 'WEAPON3': '0.950', 'weapon2': '1.124', 'weapon3': '2.032', 'DAMAGECOUNT': '3.468', 'FRAGCOUNT': '10.000'} [2023-02-24 18:56:56,444][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000018414_75423744.pth [2023-02-24 18:56:56,690][177171] DAMAGECOUNT value on done: 228077.0 [2023-02-24 18:56:56,690][177171] Sum rewards: 13.902, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.610', 'AMMO2': '0.007', 'AMMO5': '0.017', 'AMMO4': '0.033', 'WEAPON1': '0.040', 'AMMO3': '0.096', 'weapon5': '0.214', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.720', 'weapon2': '1.436', 'weapon3': '1.570', 'DAMAGECOUNT': '3.528', 'FRAGCOUNT': '11.000'} [2023-02-24 18:56:57,009][177153] Updated weights for policy 0, policy_version 19230 (0.0008) [2023-02-24 18:56:57,650][177155] DAMAGECOUNT value on done: 230344.0 [2023-02-24 18:56:57,650][177155] Sum rewards: 13.380, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.724', 'AMMO5': '0.026', 'AMMO2': '0.035', 'weapon7': '0.062', 'AMMO3': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.176', 'WEAPON7': '0.200', 'weapon5': '0.264', 'weapon2': '0.292', 'ARMOR': '0.404', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon4': '0.594', 'WEAPON3': '0.800', 'HITCOUNT': '0.900', 'weapon3': '2.126', 'DAMAGECOUNT': '5.370', 'FRAGCOUNT': '13.000'} [2023-02-24 18:56:57,949][177155] DAMAGECOUNT value on done: 237844.0 [2023-02-24 18:56:57,950][177155] Sum rewards: 7.048, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.428', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon7': '0.076', 'AMMO4': '0.089', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'weapon4': '0.216', 'weapon5': '0.230', 'WEAPON5': '0.350', 'weapon2': '0.450', 'HITCOUNT': '0.510', 'WEAPON3': '0.600', 'weapon3': '1.258', 'DAMAGECOUNT': '2.883', 'FRAGCOUNT': '7.000'} [2023-02-24 18:56:58,269][177155] DAMAGECOUNT value on done: 236368.0 [2023-02-24 18:56:58,270][177155] Sum rewards: 13.762, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.110', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'weapon5': '0.202', 'weapon4': '0.382', 'WEAPON5': '0.400', 'WEAPON3': '0.950', 'weapon2': '1.022', 'HITCOUNT': '1.100', 'weapon3': '1.918', 'DAMAGECOUNT': '4.389', 'FRAGCOUNT': '13.000'} [2023-02-24 18:56:58,576][177155] DAMAGECOUNT value on done: 222244.0 [2023-02-24 18:56:58,576][177155] Sum rewards: 19.447, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.516', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.040', 'weapon5': '0.078', 'weapon7': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.320', 'weapon2': '0.658', 'WEAPON3': '0.750', 'HITCOUNT': '1.270', 'weapon3': '1.664', 'DAMAGECOUNT': '5.430', 'FRAGCOUNT': '17.000'} [2023-02-24 18:56:59,923][177153] Updated weights for policy 0, policy_version 19240 (0.0008) [2023-02-24 18:57:01,376][177119] Fps is (10 sec: 13516.7, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 78823424. Throughput: 0: 3458.7. Samples: 19707356. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:57:01,376][177119] Avg episode reward: [(0, '13.480')] [2023-02-24 18:57:02,840][177153] Updated weights for policy 0, policy_version 19250 (0.0008) [2023-02-24 18:57:02,930][177155] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO2', -0.0001, -1.0), ('AMMO4', -0.0005, -1.0), ('weapon4', 0.002)] [2023-02-24 18:57:05,790][177153] Updated weights for policy 0, policy_version 19260 (0.0008) [2023-02-24 18:57:06,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13858.2, 300 sec: 13884.7). Total num frames: 78893056. Throughput: 0: 3460.2. Samples: 19717820. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 18:57:06,376][177119] Avg episode reward: [(0, '13.480')] [2023-02-24 18:57:06,603][177156] DAMAGECOUNT value on done: 233278.0 [2023-02-24 18:57:06,604][177156] Sum rewards: 5.076, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.880', 'WEAPON1': '0.030', 'AMMO5': '0.032', 'AMMO2': '0.056', 'AMMO3': '0.157', 'weapon5': '0.226', 'AMMO4': '0.279', 'weapon4': '0.396', 'ARMOR': '0.462', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'weapon2': '0.832', 'HITCOUNT': '0.980', 'WEAPON3': '1.050', 'weapon3': '2.110', 'DAMAGECOUNT': '3.897', 'FRAGCOUNT': '9.000'} [2023-02-24 18:57:06,615][177156] DAMAGECOUNT value on done: 227588.0 [2023-02-24 18:57:06,615][177156] Sum rewards: 9.736, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.225', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO3': '0.062', 'AMMO4': '0.084', 'weapon7': '0.126', 'weapon5': '0.190', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'ARMOR': '0.408', 'AMMO6': '0.420', 'AMMO7': '0.420', 'WEAPON3': '0.450', 'WEAPON7': '0.500', 'HITCOUNT': '0.670', 'weapon4': '0.722', 'weapon3': '0.942', 'weapon2': '1.124', 'DAMAGECOUNT': '2.616', 'FRAGCOUNT': '9.000'} [2023-02-24 18:57:06,913][177156] DAMAGECOUNT value on done: 238005.0 [2023-02-24 18:57:06,914][177156] Sum rewards: 17.498, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.138', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.172', 'weapon4': '0.180', 'AMMO3': '0.210', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon2': '0.966', 'WEAPON3': '1.450', 'HITCOUNT': '1.520', 'weapon3': '2.340', 'DAMAGECOUNT': '5.847', 'FRAGCOUNT': '18.000'} [2023-02-24 18:57:06,926][177156] DAMAGECOUNT value on done: 228516.0 [2023-02-24 18:57:06,927][177156] Sum rewards: 18.807, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO3': '0.083', 'AMMO4': '0.084', 'weapon5': '0.124', 'weapon7': '0.146', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.246', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HEALTH': '0.458', 'weapon2': '0.650', 'HITCOUNT': '1.050', 'weapon3': '1.358', 'DAMAGECOUNT': '4.371', 'FRAGCOUNT': '13.000'} [2023-02-24 18:57:07,481][177170] DAMAGECOUNT value on done: 233488.0 [2023-02-24 18:57:07,482][177170] Sum rewards: 7.712, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.866', 'AMMO2': '0.009', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.045', 'AMMO3': '0.050', 'weapon7': '0.142', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.250', 'weapon5': '0.278', 'WEAPON7': '0.300', 'weapon4': '0.428', 'WEAPON5': '0.450', 'HITCOUNT': '0.460', 'weapon3': '0.818', 'weapon2': '1.040', 'DAMAGECOUNT': '2.433', 'FRAGCOUNT': '5.000'} [2023-02-24 18:57:07,784][177170] DAMAGECOUNT value on done: 240414.0 [2023-02-24 18:57:07,785][177170] Sum rewards: -2.361, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-2.115', 'AMMO5': '0.005', 'AMMO2': '0.007', 'ARMOR': '0.016', 'AMMO4': '0.033', 'AMMO3': '0.043', 'WEAPON5': '0.100', 'HITCOUNT': '0.180', 'weapon7': '0.184', 'weapon2': '0.238', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.300', 'weapon3': '0.388', 'WEAPON4': '0.400', 'WEAPON7': '0.400', 'DAMAGECOUNT': '0.540', 'weapon4': '0.690', 'FRAGCOUNT': '1.000'} [2023-02-24 18:57:08,094][177170] DAMAGECOUNT value on done: 231943.0 [2023-02-24 18:57:08,095][177170] Sum rewards: 12.300, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.409', 'AMMO2': '0.002', 'AMMO5': '0.010', 'AMMO4': '0.010', 'WEAPON1': '0.030', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.140', 'weapon5': '0.180', 'WEAPON5': '0.300', 'HITCOUNT': '0.900', 'WEAPON3': '0.950', 'weapon2': '1.362', 'weapon3': '1.948', 'DAMAGECOUNT': '3.936', 'FRAGCOUNT': '12.000'} [2023-02-24 18:57:08,391][177170] DAMAGECOUNT value on done: 232784.0 [2023-02-24 18:57:08,391][177170] Sum rewards: 17.677, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.981', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.111', 'WEAPON4': '0.150', 'weapon5': '0.244', 'WEAPON5': '0.350', 'weapon4': '0.356', 'WEAPON3': '0.800', 'weapon2': '1.052', 'HITCOUNT': '1.080', 'weapon3': '1.834', 'DAMAGECOUNT': '6.261', 'FRAGCOUNT': '15.000'} [2023-02-24 18:57:08,742][177153] Updated weights for policy 0, policy_version 19270 (0.0008) [2023-02-24 18:57:09,231][177158] DAMAGECOUNT value on done: 224389.0 [2023-02-24 18:57:09,232][177158] Sum rewards: 13.703, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.774', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'AMMO3': '0.169', 'weapon5': '0.220', 'weapon4': '0.256', 'WEAPON5': '0.400', 'weapon2': '1.032', 'WEAPON3': '1.050', 'HITCOUNT': '1.180', 'weapon3': '2.136', 'DAMAGECOUNT': '4.218', 'FRAGCOUNT': '14.000'} [2023-02-24 18:57:09,542][177158] DAMAGECOUNT value on done: 227807.0 [2023-02-24 18:57:09,542][177158] Sum rewards: 16.272, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.715', 'AMMO2': '0.020', 'AMMO5': '0.028', 'AMMO4': '0.097', 'AMMO3': '0.107', 'weapon7': '0.110', 'weapon5': '0.184', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.400', 'WEAPON7': '0.400', 'ARMOR': '0.456', 'weapon4': '0.456', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'weapon2': '0.932', 'HITCOUNT': '1.000', 'weapon3': '1.546', 'DAMAGECOUNT': '4.821', 'FRAGCOUNT': '14.000'} [2023-02-24 18:57:10,342][177158] DAMAGECOUNT value on done: 237012.0 [2023-02-24 18:57:10,343][177158] Sum rewards: 25.798, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.496', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO4': '0.035', 'AMMO3': '0.137', 'WEAPON4': '0.250', 'weapon5': '0.256', 'weapon4': '0.320', 'WEAPON5': '0.650', 'weapon2': '0.826', 'WEAPON3': '1.000', 'HITCOUNT': '1.710', 'weapon3': '2.200', 'DAMAGECOUNT': '7.110', 'FRAGCOUNT': '22.500'} [2023-02-24 18:57:10,648][177158] DAMAGECOUNT value on done: 233701.0 [2023-02-24 18:57:10,648][177158] Sum rewards: 21.427, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.714', 'AMMO5': '0.015', 'AMMO2': '0.026', 'weapon4': '0.078', 'AMMO3': '0.104', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'weapon5': '0.232', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'HITCOUNT': '1.300', 'weapon2': '1.470', 'weapon3': '1.800', 'DAMAGECOUNT': '6.036', 'FRAGCOUNT': '18.000'} [2023-02-24 18:57:11,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 78962688. Throughput: 0: 3460.3. Samples: 19738530. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 18:57:11,376][177119] Avg episode reward: [(0, '13.812')] [2023-02-24 18:57:11,727][177153] Updated weights for policy 0, policy_version 19280 (0.0009) [2023-02-24 18:57:12,634][177172] DAMAGECOUNT value on done: 231973.0 [2023-02-24 18:57:12,634][177172] Sum rewards: 11.290, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.392', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.018', 'AMMO2': '0.021', 'AMMO4': '0.107', 'AMMO3': '0.129', 'weapon7': '0.136', 'WEAPON5': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon2': '0.382', 'WEAPON7': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.540', 'WEAPON3': '0.850', 'HITCOUNT': '1.110', 'weapon3': '1.472', 'DAMAGECOUNT': '4.365', 'FRAGCOUNT': '12.000'} [2023-02-24 18:57:12,937][177172] DAMAGECOUNT value on done: 224736.0 [2023-02-24 18:57:12,938][177172] Sum rewards: 9.749, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.427', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.144', 'AMMO3': '0.164', 'weapon5': '0.174', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.494', 'weapon2': '0.746', 'WEAPON3': '0.950', 'HITCOUNT': '1.060', 'weapon3': '1.724', 'DAMAGECOUNT': '4.476', 'FRAGCOUNT': '11.000'} [2023-02-24 18:57:14,428][177172] DAMAGECOUNT value on done: 235757.0 [2023-02-24 18:57:14,429][177172] Sum rewards: 18.880, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.036', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.016', 'AMMO3': '0.085', 'weapon5': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '1.010', 'weapon2': '1.554', 'weapon3': '1.752', 'DAMAGECOUNT': '4.635', 'FRAGCOUNT': '14.000'} [2023-02-24 18:57:14,472][177154] DAMAGECOUNT value on done: 234856.0 [2023-02-24 18:57:14,473][177154] Sum rewards: 10.002, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.138', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.132', 'weapon5': '0.158', 'weapon4': '0.354', 'WEAPON5': '0.450', 'HITCOUNT': '0.850', 'WEAPON3': '0.900', 'weapon2': '0.964', 'weapon3': '2.166', 'DAMAGECOUNT': '3.909', 'FRAGCOUNT': '10.000'} [2023-02-24 18:57:14,684][177153] Updated weights for policy 0, policy_version 19290 (0.0008) [2023-02-24 18:57:14,739][177172] DAMAGECOUNT value on done: 227979.0 [2023-02-24 18:57:14,739][177172] Sum rewards: 4.361, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.470', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon7': '0.078', 'weapon5': '0.080', 'AMMO3': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'HITCOUNT': '0.530', 'WEAPON3': '0.600', 'weapon4': '0.614', 'weapon2': '0.730', 'weapon3': '1.130', 'DAMAGECOUNT': '2.271', 'FRAGCOUNT': '6.000'} [2023-02-24 18:57:14,777][177154] DAMAGECOUNT value on done: 239496.0 [2023-02-24 18:57:14,777][177154] Sum rewards: 15.255, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.786', 'AMMO2': '0.018', 'AMMO5': '0.022', 'weapon7': '0.048', 'AMMO4': '0.091', 'AMMO3': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon2': '0.270', 'weapon5': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.550', 'weapon4': '0.596', 'WEAPON3': '0.700', 'ARMOR': '0.854', 'HITCOUNT': '1.010', 'weapon3': '1.582', 'DAMAGECOUNT': '5.346', 'FRAGCOUNT': '12.000'} [2023-02-24 18:57:15,084][177154] DAMAGECOUNT value on done: 245628.0 [2023-02-24 18:57:15,085][177154] Sum rewards: 16.845, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.080', 'AMMO5': '0.015', 'AMMO2': '0.023', 'AMMO4': '0.116', 'AMMO3': '0.124', 'weapon7': '0.176', 'weapon4': '0.210', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'weapon5': '0.268', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '1.050', 'weapon2': '1.200', 'weapon3': '1.762', 'DAMAGECOUNT': '5.250', 'FRAGCOUNT': '16.000'} [2023-02-24 18:57:15,381][177157] DAMAGECOUNT value on done: 224388.0 [2023-02-24 18:57:15,382][177157] Sum rewards: 20.449, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.012', 'HEALTH': '0.015', 'AMMO2': '0.030', 'weapon7': '0.048', 'AMMO3': '0.081', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'weapon5': '0.190', 'WEAPON5': '0.250', 'weapon4': '0.536', 'WEAPON3': '0.550', 'weapon2': '0.624', 'HITCOUNT': '1.130', 'weapon3': '1.484', 'DAMAGECOUNT': '5.649', 'FRAGCOUNT': '16.000'} [2023-02-24 18:57:15,386][177154] DAMAGECOUNT value on done: 236960.0 [2023-02-24 18:57:15,387][177154] Sum rewards: 18.469, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.992', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.101', 'AMMO4': '0.105', 'weapon5': '0.164', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'ARMOR': '0.449', 'weapon4': '0.682', 'WEAPON3': '0.700', 'weapon2': '0.946', 'HITCOUNT': '1.670', 'weapon3': '1.818', 'DAMAGECOUNT': '6.333', 'FRAGCOUNT': '16.000'} [2023-02-24 18:57:15,392][177157] DAMAGECOUNT value on done: 241959.0 [2023-02-24 18:57:15,392][177157] Sum rewards: 20.036, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.990', 'AMMO5': '0.014', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'weapon7': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.124', 'AMMO4': '0.141', 'WEAPON7': '0.200', 'weapon4': '0.220', 'weapon5': '0.256', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '0.900', 'weapon2': '0.932', 'HITCOUNT': '1.290', 'weapon3': '1.974', 'DAMAGECOUNT': '6.510', 'FRAGCOUNT': '18.000'} [2023-02-24 18:57:15,482][177171] DAMAGECOUNT value on done: 228864.0 [2023-02-24 18:57:15,483][177171] Sum rewards: 11.335, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.007', 'AMMO5': '0.012', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO3': '0.057', 'WEAPON1': '0.060', 'HEALTH': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.112', 'weapon5': '0.122', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.620', 'weapon2': '0.864', 'weapon3': '1.112', 'DAMAGECOUNT': '2.715', 'FRAGCOUNT': '9.000'} [2023-02-24 18:57:15,682][177157] DAMAGECOUNT value on done: 227816.0 [2023-02-24 18:57:15,682][177157] Sum rewards: 19.710, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.047', 'weapon7': '0.002', 'AMMO2': '0.011', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'AMMO4': '0.054', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.184', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'weapon4': '0.250', 'WEAPON5': '0.500', 'weapon2': '0.710', 'WEAPON3': '1.400', 'HITCOUNT': '1.610', 'weapon3': '2.390', 'DAMAGECOUNT': '6.867', 'FRAGCOUNT': '20.000'} [2023-02-24 18:57:15,691][177157] DAMAGECOUNT value on done: 226408.0 [2023-02-24 18:57:15,692][177157] Sum rewards: 8.947, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.862', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO4': '0.053', 'weapon7': '0.080', 'AMMO3': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.192', 'weapon5': '0.374', 'WEAPON5': '0.550', 'HITCOUNT': '0.660', 'WEAPON3': '0.700', 'weapon2': '0.918', 'weapon3': '1.752', 'DAMAGECOUNT': '2.730', 'FRAGCOUNT': '8.000'} [2023-02-24 18:57:15,709][177171] DAMAGECOUNT value on done: 230286.0 [2023-02-24 18:57:15,709][177171] Sum rewards: 17.240, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.530', 'ARMOR': '0.004', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.026', 'AMMO3': '0.058', 'WEAPON4': '0.100', 'weapon7': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.218', 'weapon5': '0.276', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON3': '0.400', 'WEAPON7': '0.500', 'HITCOUNT': '0.880', 'weapon3': '1.006', 'weapon2': '1.018', 'DAMAGECOUNT': '4.989', 'FRAGCOUNT': '11.000'} [2023-02-24 18:57:15,787][177171] DAMAGECOUNT value on done: 235419.0 [2023-02-24 18:57:15,788][177171] Sum rewards: 9.084, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.170', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.082', 'WEAPON5': '0.150', 'weapon7': '0.152', 'weapon5': '0.152', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'weapon4': '0.436', 'WEAPON3': '0.550', 'HITCOUNT': '0.590', 'weapon3': '1.218', 'weapon2': '1.402', 'DAMAGECOUNT': '2.439', 'FRAGCOUNT': '8.000'} [2023-02-24 18:57:16,016][177171] DAMAGECOUNT value on done: 230145.0 [2023-02-24 18:57:16,017][177171] Sum rewards: 18.294, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.982', 'AMMO2': '0.006', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'weapon4': '0.086', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'weapon5': '0.284', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'weapon2': '1.340', 'HITCOUNT': '1.580', 'weapon3': '1.962', 'DAMAGECOUNT': '6.204', 'FRAGCOUNT': '16.000'} [2023-02-24 18:57:16,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 79032320. Throughput: 0: 3460.7. Samples: 19759282. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 18:57:16,376][177119] Avg episode reward: [(0, '13.918')] [2023-02-24 18:57:17,132][177155] DAMAGECOUNT value on done: 231742.0 [2023-02-24 18:57:17,132][177155] Sum rewards: 15.527, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.796', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.111', 'weapon7': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.124', 'WEAPON7': '0.200', 'weapon5': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.688', 'WEAPON3': '0.700', 'weapon4': '0.710', 'HITCOUNT': '0.810', 'weapon3': '1.560', 'DAMAGECOUNT': '4.158', 'FRAGCOUNT': '14.000'} [2023-02-24 18:57:17,438][177155] DAMAGECOUNT value on done: 239714.0 [2023-02-24 18:57:17,438][177155] Sum rewards: 12.232, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.006', 'weapon7': '0.012', 'AMMO5': '0.022', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'weapon4': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.154', 'weapon5': '0.168', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.938', 'WEAPON3': '1.100', 'HITCOUNT': '1.260', 'weapon3': '2.306', 'DAMAGECOUNT': '5.610', 'FRAGCOUNT': '14.000'} [2023-02-24 18:57:17,644][177153] Updated weights for policy 0, policy_version 19300 (0.0008) [2023-02-24 18:57:17,751][177155] DAMAGECOUNT value on done: 237567.0 [2023-02-24 18:57:17,752][177155] Sum rewards: 13.006, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.686', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon7': '0.052', 'AMMO4': '0.129', 'AMMO3': '0.130', 'weapon5': '0.270', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'weapon4': '0.320', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'HITCOUNT': '0.910', 'weapon2': '1.104', 'weapon3': '1.866', 'DAMAGECOUNT': '3.597', 'FRAGCOUNT': '11.000'} [2023-02-24 18:57:18,054][177155] DAMAGECOUNT value on done: 223635.0 [2023-02-24 18:57:18,054][177155] Sum rewards: 3.127, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.280', 'AMMO5': '0.029', 'WEAPON1': '0.030', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon5': '0.184', 'AMMO3': '0.213', 'weapon2': '0.318', 'WEAPON4': '0.600', 'weapon4': '0.618', 'WEAPON5': '0.650', 'HITCOUNT': '0.760', 'ARMOR': '0.919', 'WEAPON3': '1.250', 'weapon3': '2.226', 'DAMAGECOUNT': '4.173', 'FRAGCOUNT': '10.000'} [2023-02-24 18:57:20,602][177153] Updated weights for policy 0, policy_version 19310 (0.0008) [2023-02-24 18:57:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 79101952. Throughput: 0: 3463.9. Samples: 19769738. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 18:57:21,376][177119] Avg episode reward: [(0, '14.028')] [2023-02-24 18:57:23,540][177153] Updated weights for policy 0, policy_version 19320 (0.0008) [2023-02-24 18:57:26,054][177156] DAMAGECOUNT value on done: 234618.0 [2023-02-24 18:57:26,055][177156] Sum rewards: 13.104, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.136', 'AMMO2': '0.020', 'AMMO5': '0.020', 'WEAPON1': '0.070', 'AMMO4': '0.100', 'AMMO3': '0.151', 'weapon4': '0.178', 'WEAPON4': '0.250', 'weapon5': '0.390', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'HITCOUNT': '1.000', 'weapon2': '1.074', 'weapon3': '1.816', 'DAMAGECOUNT': '4.020', 'FRAGCOUNT': '12.000'} [2023-02-24 18:57:26,064][177156] DAMAGECOUNT value on done: 228873.0 [2023-02-24 18:57:26,065][177156] Sum rewards: 9.653, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.602', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO4': '0.046', 'AMMO3': '0.163', 'weapon5': '0.206', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'HITCOUNT': '1.060', 'weapon2': '1.374', 'weapon3': '2.042', 'DAMAGECOUNT': '3.825', 'FRAGCOUNT': '10.000'} [2023-02-24 18:57:26,364][177156] DAMAGECOUNT value on done: 239336.0 [2023-02-24 18:57:26,365][177156] Sum rewards: 12.879, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.439', 'AMMO2': '0.005', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'weapon7': '0.070', 'AMMO3': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.206', 'weapon5': '0.292', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'HITCOUNT': '0.860', 'weapon2': '1.196', 'weapon3': '1.804', 'DAMAGECOUNT': '3.993', 'FRAGCOUNT': '10.500'} [2023-02-24 18:57:26,376][177156] DAMAGECOUNT value on done: 230217.0 [2023-02-24 18:57:26,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.2, 300 sec: 13884.7). Total num frames: 79171584. Throughput: 0: 3463.1. Samples: 19790518. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 18:57:26,376][177156] Sum rewards: 18.757, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.890', 'AMMO2': '0.014', 'AMMO5': '0.030', 'WEAPON1': '0.030', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'weapon4': '0.196', 'weapon5': '0.240', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'weapon2': '1.032', 'HITCOUNT': '1.150', 'weapon3': '2.168', 'DAMAGECOUNT': '5.103', 'FRAGCOUNT': '17.000'} [2023-02-24 18:57:26,376][177119] Avg episode reward: [(0, '14.202')] [2023-02-24 18:57:26,512][177153] Updated weights for policy 0, policy_version 19330 (0.0008) [2023-02-24 18:57:26,787][177170] DAMAGECOUNT value on done: 234890.0 [2023-02-24 18:57:26,788][177170] Sum rewards: 15.596, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.341', 'AMMO2': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.038', 'weapon7': '0.120', 'AMMO3': '0.124', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'weapon5': '0.258', 'weapon4': '0.278', 'WEAPON7': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '1.030', 'weapon2': '1.058', 'weapon3': '1.744', 'DAMAGECOUNT': '4.206', 'FRAGCOUNT': '14.000'} [2023-02-24 18:57:27,084][177170] DAMAGECOUNT value on done: 240926.0 [2023-02-24 18:57:27,085][177170] Sum rewards: 6.492, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.505', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.016', 'AMMO3': '0.036', 'weapon2': '0.076', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'weapon7': '0.174', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON3': '0.250', 'WEAPON7': '0.300', 'HITCOUNT': '0.350', 'weapon4': '0.548', 'weapon3': '0.580', 'DAMAGECOUNT': '1.536', 'FRAGCOUNT': '6.000'} [2023-02-24 18:57:27,471][177170] DAMAGECOUNT value on done: 233173.0 [2023-02-24 18:57:27,471][177170] Sum rewards: 10.150, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.128', 'AMMO2': '0.009', 'AMMO5': '0.019', 'AMMO4': '0.044', 'WEAPON1': '0.060', 'AMMO3': '0.086', 'weapon7': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon2': '0.696', 'WEAPON3': '0.700', 'weapon4': '0.738', 'HITCOUNT': '0.900', 'weapon3': '1.398', 'DAMAGECOUNT': '3.690', 'FRAGCOUNT': '9.000'} [2023-02-24 18:57:27,769][177170] DAMAGECOUNT value on done: 234119.0 [2023-02-24 18:57:27,770][177170] Sum rewards: 10.381, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.940', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.023', 'AMMO3': '0.083', 'weapon7': '0.104', 'weapon5': '0.162', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.328', 'WEAPON7': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.750', 'weapon2': '1.006', 'weapon3': '1.712', 'DAMAGECOUNT': '4.005', 'FRAGCOUNT': '8.000'} [2023-02-24 18:57:28,593][177158] DAMAGECOUNT value on done: 225686.0 [2023-02-24 18:57:28,593][177158] Sum rewards: 13.904, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.470', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.022', 'AMMO3': '0.057', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'weapon7': '0.110', 'weapon2': '0.164', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.710', 'weapon4': '0.720', 'weapon3': '0.792', 'DAMAGECOUNT': '3.291', 'FRAGCOUNT': '11.000'} [2023-02-24 18:57:28,886][177158] DAMAGECOUNT value on done: 229297.0 [2023-02-24 18:57:28,886][177158] Sum rewards: 15.949, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.910', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon7': '0.060', 'AMMO3': '0.111', 'AMMO4': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.162', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.274', 'WEAPON4': '0.400', 'WEAPON3': '0.650', 'weapon4': '0.708', 'ARMOR': '0.857', 'weapon3': '1.032', 'HITCOUNT': '1.040', 'DAMAGECOUNT': '4.470', 'FRAGCOUNT': '13.000'} [2023-02-24 18:57:29,463][177153] Updated weights for policy 0, policy_version 19340 (0.0008) [2023-02-24 18:57:29,549][177158] DAMAGECOUNT value on done: 238509.0 [2023-02-24 18:57:29,549][177158] Sum rewards: 11.176, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.075', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'weapon5': '0.082', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.232', 'ARMOR': '0.457', 'weapon2': '0.976', 'HITCOUNT': '1.030', 'WEAPON3': '1.100', 'weapon3': '2.056', 'DAMAGECOUNT': '4.491', 'FRAGCOUNT': '13.000'} [2023-02-24 18:57:29,859][177158] DAMAGECOUNT value on done: 234917.0 [2023-02-24 18:57:29,860][177158] Sum rewards: 8.831, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.805', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.012', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.126', 'weapon7': '0.140', 'WEAPON4': '0.150', 'weapon5': '0.160', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.414', 'HITCOUNT': '0.600', 'WEAPON3': '0.800', 'ARMOR': '0.800', 'weapon2': '1.040', 'weapon3': '1.252', 'DAMAGECOUNT': '3.648', 'FRAGCOUNT': '9.000'} [2023-02-24 18:57:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 79241216. Throughput: 0: 3464.0. Samples: 19811310. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 18:57:31,376][177119] Avg episode reward: [(0, '13.968')] [2023-02-24 18:57:31,888][177158] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:57:32,097][177172] DAMAGECOUNT value on done: 233164.0 [2023-02-24 18:57:32,097][177172] Sum rewards: 6.042, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.830', 'AMMO2': '0.025', 'AMMO5': '0.033', 'WEAPON1': '0.040', 'AMMO4': '0.125', 'AMMO3': '0.172', 'weapon5': '0.332', 'WEAPON4': '0.450', 'weapon2': '0.476', 'weapon4': '0.630', 'WEAPON5': '0.700', 'HITCOUNT': '0.790', 'WEAPON3': '1.000', 'weapon3': '1.776', 'DAMAGECOUNT': '3.573', 'FRAGCOUNT': '9.000'} [2023-02-24 18:57:32,403][177153] Updated weights for policy 0, policy_version 19350 (0.0008) [2023-02-24 18:57:32,403][177172] DAMAGECOUNT value on done: 226391.0 [2023-02-24 18:57:32,404][177172] Sum rewards: 18.531, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.632', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.089', 'weapon7': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.416', 'WEAPON3': '0.450', 'weapon2': '0.502', 'HITCOUNT': '1.010', 'weapon3': '1.718', 'DAMAGECOUNT': '4.965', 'FRAGCOUNT': '14.000'} [2023-02-24 18:57:33,824][177154] DAMAGECOUNT value on done: 236364.0 [2023-02-24 18:57:33,825][177154] Sum rewards: 12.241, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.922', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.013', 'weapon7': '0.048', 'AMMO4': '0.065', 'AMMO3': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.202', 'weapon4': '0.218', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.970', 'weapon2': '1.432', 'weapon3': '1.744', 'DAMAGECOUNT': '4.524', 'FRAGCOUNT': '8.000'} [2023-02-24 18:57:33,879][177172] DAMAGECOUNT value on done: 237318.0 [2023-02-24 18:57:33,879][177172] Sum rewards: 11.623, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.480', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon7': '0.054', 'AMMO4': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.158', 'weapon5': '0.182', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.300', 'weapon2': '0.978', 'WEAPON3': '1.050', 'HITCOUNT': '1.210', 'weapon3': '2.152', 'DAMAGECOUNT': '4.683', 'FRAGCOUNT': '11.000'} [2023-02-24 18:57:34,123][177154] DAMAGECOUNT value on done: 241162.0 [2023-02-24 18:57:34,123][177154] Sum rewards: 14.375, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.885', 'AMMO2': '0.008', 'AMMO5': '0.011', 'AMMO4': '0.040', 'weapon7': '0.052', 'AMMO3': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.228', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'weapon2': '0.846', 'HITCOUNT': '1.200', 'weapon3': '1.524', 'DAMAGECOUNT': '4.998', 'FRAGCOUNT': '12.000'} [2023-02-24 18:57:34,181][177172] DAMAGECOUNT value on done: 229379.0 [2023-02-24 18:57:34,181][177172] Sum rewards: 10.428, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.049', 'AMMO5': '0.018', 'AMMO2': '0.027', 'WEAPON1': '0.040', 'weapon5': '0.110', 'AMMO3': '0.112', 'AMMO4': '0.136', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.438', 'ARMOR': '0.532', 'WEAPON3': '0.700', 'weapon4': '0.852', 'HITCOUNT': '1.060', 'weapon3': '1.502', 'DAMAGECOUNT': '4.200', 'FRAGCOUNT': '10.000'} [2023-02-24 18:57:34,229][177158] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 18:57:34,423][177154] DAMAGECOUNT value on done: 246764.0 [2023-02-24 18:57:34,423][177154] Sum rewards: 7.663, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.655', 'AMMO2': '0.013', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'weapon7': '0.052', 'AMMO4': '0.067', 'weapon5': '0.096', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.518', 'weapon4': '0.534', 'WEAPON3': '0.800', 'HITCOUNT': '0.890', 'weapon3': '1.760', 'DAMAGECOUNT': '3.408', 'FRAGCOUNT': '6.000'} [2023-02-24 18:57:34,726][177154] DAMAGECOUNT value on done: 238186.0 [2023-02-24 18:57:34,726][177154] Sum rewards: 11.051, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.332', 'AMMO5': '0.017', 'AMMO2': '0.029', 'WEAPON1': '0.040', 'AMMO3': '0.076', 'weapon5': '0.098', 'weapon7': '0.104', 'AMMO4': '0.145', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.368', 'ARMOR': '0.429', 'WEAPON3': '0.450', 'HITCOUNT': '0.900', 'weapon2': '1.204', 'weapon3': '1.256', 'DAMAGECOUNT': '3.678', 'FRAGCOUNT': '8.000'} [2023-02-24 18:57:34,857][177157] DAMAGECOUNT value on done: 225943.0 [2023-02-24 18:57:34,857][177157] Sum rewards: 16.237, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.412', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.116', 'AMMO4': '0.117', 'weapon5': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon4': '0.684', 'WEAPON3': '0.700', 'HITCOUNT': '1.040', 'weapon3': '1.336', 'weapon2': '1.380', 'DAMAGECOUNT': '4.665', 'FRAGCOUNT': '13.000'} [2023-02-24 18:57:34,867][177157] DAMAGECOUNT value on done: 243646.0 [2023-02-24 18:57:34,868][177157] Sum rewards: 17.550, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.330', 'AMMO5': '0.010', 'weapon4': '0.016', 'AMMO2': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'AMMO4': '0.130', 'weapon5': '0.204', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.970', 'weapon2': '1.598', 'weapon3': '1.884', 'DAMAGECOUNT': '5.061', 'FRAGCOUNT': '13.000'} [2023-02-24 18:57:34,903][177171] DAMAGECOUNT value on done: 231037.0 [2023-02-24 18:57:34,904][177171] Sum rewards: 24.867, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.537', 'AMMO2': '0.008', 'AMMO5': '0.012', 'AMMO4': '0.041', 'weapon7': '0.048', 'AMMO3': '0.111', 'weapon5': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'weapon4': '0.458', 'WEAPON3': '0.750', 'weapon2': '0.954', 'HITCOUNT': '1.490', 'weapon3': '1.956', 'DAMAGECOUNT': '6.519', 'FRAGCOUNT': '18.500'} [2023-02-24 18:57:35,128][177171] DAMAGECOUNT value on done: 232668.0 [2023-02-24 18:57:35,129][177171] Sum rewards: 17.235, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.666', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.170', 'AMMO3': '0.179', 'WEAPON5': '0.300', 'weapon4': '0.308', 'WEAPON4': '0.350', 'weapon2': '0.632', 'WEAPON3': '1.100', 'HITCOUNT': '1.880', 'weapon3': '2.414', 'DAMAGECOUNT': '7.146', 'FRAGCOUNT': '16.000'} [2023-02-24 18:57:35,163][177157] DAMAGECOUNT value on done: 229414.0 [2023-02-24 18:57:35,164][177157] Sum rewards: 17.016, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.238', 'AMMO2': '0.010', 'AMMO5': '0.018', 'AMMO4': '0.051', 'AMMO3': '0.098', 'weapon4': '0.146', 'WEAPON4': '0.150', 'weapon5': '0.260', 'WEAPON5': '0.450', 'ARMOR': '0.460', 'WEAPON3': '0.700', 'HITCOUNT': '1.150', 'weapon2': '1.352', 'weapon3': '1.854', 'DAMAGECOUNT': '4.554', 'FRAGCOUNT': '16.000'} [2023-02-24 18:57:35,175][177157] DAMAGECOUNT value on done: 227728.0 [2023-02-24 18:57:35,176][177157] Sum rewards: 6.599, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.260', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.144', 'weapon4': '0.176', 'weapon5': '0.316', 'WEAPON5': '0.400', 'HITCOUNT': '0.840', 'WEAPON3': '1.050', 'weapon2': '1.184', 'weapon3': '1.996', 'DAMAGECOUNT': '3.960', 'FRAGCOUNT': '8.000'} [2023-02-24 18:57:35,207][177171] DAMAGECOUNT value on done: 236726.0 [2023-02-24 18:57:35,207][177171] Sum rewards: 12.321, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.300', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'weapon7': '0.058', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.143', 'weapon5': '0.158', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.206', 'weapon2': '0.494', 'WEAPON3': '0.900', 'HITCOUNT': '1.080', 'weapon3': '1.922', 'DAMAGECOUNT': '3.921', 'FRAGCOUNT': '13.000'} [2023-02-24 18:57:35,366][177153] Updated weights for policy 0, policy_version 19360 (0.0008) [2023-02-24 18:57:35,427][177171] DAMAGECOUNT value on done: 231196.0 [2023-02-24 18:57:35,427][177171] Sum rewards: 14.449, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.480', 'ARMOR': '0.005', 'AMMO5': '0.011', 'AMMO2': '0.023', 'AMMO3': '0.078', 'AMMO4': '0.115', 'weapon4': '0.120', 'weapon7': '0.148', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon5': '0.254', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.710', 'weapon2': '1.236', 'weapon3': '1.496', 'DAMAGECOUNT': '3.153', 'FRAGCOUNT': '11.000'} [2023-02-24 18:57:36,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 79310848. Throughput: 0: 3464.4. Samples: 19821738. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 18:57:36,376][177119] Avg episode reward: [(0, '13.720')] [2023-02-24 18:57:36,567][177155] DAMAGECOUNT value on done: 233849.0 [2023-02-24 18:57:36,567][177155] Sum rewards: 17.039, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.472', 'ARMOR': '0.004', 'AMMO2': '0.004', 'WEAPON1': '0.020', 'AMMO4': '0.021', 'AMMO5': '0.022', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'weapon5': '0.232', 'weapon4': '0.394', 'WEAPON5': '0.550', 'weapon2': '0.774', 'WEAPON3': '1.050', 'HITCOUNT': '1.390', 'weapon3': '2.176', 'DAMAGECOUNT': '6.321', 'FRAGCOUNT': '15.000'} [2023-02-24 18:57:36,873][177155] DAMAGECOUNT value on done: 240793.0 [2023-02-24 18:57:36,874][177155] Sum rewards: 8.504, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.026', 'AMMO5': '0.016', 'WEAPON1': '0.030', 'AMMO2': '0.038', 'AMMO3': '0.072', 'weapon5': '0.078', 'weapon7': '0.134', 'AMMO4': '0.190', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.720', 'weapon4': '0.852', 'weapon3': '1.004', 'DAMAGECOUNT': '3.237', 'FRAGCOUNT': '10.000'} [2023-02-24 18:57:37,184][177155] DAMAGECOUNT value on done: 239161.0 [2023-02-24 18:57:37,185][177155] Sum rewards: 13.646, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.275', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.127', 'weapon4': '0.186', 'weapon5': '0.220', 'WEAPON5': '0.350', 'WEAPON3': '0.900', 'HITCOUNT': '1.140', 'weapon2': '1.258', 'weapon3': '2.064', 'DAMAGECOUNT': '4.782', 'FRAGCOUNT': '12.000'} [2023-02-24 18:57:37,491][177155] DAMAGECOUNT value on done: 225086.0 [2023-02-24 18:57:37,491][177155] Sum rewards: 9.854, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.735', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon7': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.133', 'AMMO4': '0.169', 'WEAPON7': '0.200', 'weapon5': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.498', 'WEAPON4': '0.650', 'weapon4': '0.852', 'WEAPON3': '0.900', 'HITCOUNT': '0.930', 'weapon3': '1.568', 'DAMAGECOUNT': '4.353', 'FRAGCOUNT': '12.000'} [2023-02-24 18:57:38,342][177153] Updated weights for policy 0, policy_version 19370 (0.0009) [2023-02-24 18:57:41,297][177153] Updated weights for policy 0, policy_version 19380 (0.0008) [2023-02-24 18:57:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 79380480. Throughput: 0: 3464.2. Samples: 19842558. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 18:57:41,376][177119] Avg episode reward: [(0, '13.558')] [2023-02-24 18:57:42,801][177154] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 18:57:44,266][177153] Updated weights for policy 0, policy_version 19390 (0.0008) [2023-02-24 18:57:45,447][177156] DAMAGECOUNT value on done: 235853.0 [2023-02-24 18:57:45,448][177156] Sum rewards: 11.714, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.648', 'AMMO5': '0.015', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.120', 'weapon5': '0.130', 'weapon7': '0.148', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.414', 'AMMO6': '0.420', 'AMMO7': '0.420', 'WEAPON7': '0.500', 'WEAPON3': '0.750', 'HITCOUNT': '0.950', 'weapon2': '0.986', 'weapon3': '1.596', 'DAMAGECOUNT': '3.705', 'FRAGCOUNT': '13.000'} [2023-02-24 18:57:45,458][177156] DAMAGECOUNT value on done: 230376.0 [2023-02-24 18:57:45,459][177156] Sum rewards: 15.565, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.753', 'AMMO2': '0.008', 'AMMO5': '0.012', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.040', 'AMMO3': '0.095', 'WEAPON4': '0.150', 'weapon5': '0.190', 'weapon4': '0.264', 'WEAPON5': '0.400', 'AMMO6': '0.500', 'WEAPON7': '0.500', 'AMMO7': '0.500', 'WEAPON3': '0.750', 'HITCOUNT': '0.750', 'weapon2': '1.480', 'weapon3': '1.642', 'DAMAGECOUNT': '4.500', 'FRAGCOUNT': '13.000'} [2023-02-24 18:57:45,756][177156] DAMAGECOUNT value on done: 241076.0 [2023-02-24 18:57:45,757][177156] Sum rewards: 16.543, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.310', 'AMMO5': '0.008', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.094', 'AMMO4': '0.097', 'AMMO3': '0.099', 'weapon5': '0.166', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'HITCOUNT': '1.050', 'weapon2': '1.528', 'weapon3': '1.970', 'DAMAGECOUNT': '5.220', 'FRAGCOUNT': '14.000'} [2023-02-24 18:57:45,767][177156] DAMAGECOUNT value on done: 231515.0 [2023-02-24 18:57:45,768][177156] Sum rewards: 12.718, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.948', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.112', 'AMMO3': '0.129', 'weapon7': '0.174', 'weapon5': '0.188', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'weapon4': '0.706', 'weapon2': '0.792', 'WEAPON3': '0.800', 'HITCOUNT': '0.990', 'weapon3': '1.606', 'DAMAGECOUNT': '3.894', 'FRAGCOUNT': '11.500'} [2023-02-24 18:57:46,095][177170] DAMAGECOUNT value on done: 236467.0 [2023-02-24 18:57:46,096][177170] Sum rewards: 14.404, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.140', 'AMMO5': '0.015', 'weapon7': '0.050', 'AMMO2': '0.057', 'weapon5': '0.126', 'AMMO3': '0.154', 'AMMO4': '0.287', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.356', 'WEAPON4': '0.550', 'WEAPON3': '0.850', 'weapon2': '0.884', 'HITCOUNT': '1.180', 'weapon3': '2.054', 'DAMAGECOUNT': '4.731', 'FRAGCOUNT': '15.000'} [2023-02-24 18:57:46,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 79450112. Throughput: 0: 3464.4. Samples: 19863252. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:57:46,376][177119] Avg episode reward: [(0, '13.455')] [2023-02-24 18:57:46,416][177170] DAMAGECOUNT value on done: 242384.0 [2023-02-24 18:57:46,417][177170] Sum rewards: 13.100, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.984', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.014', 'AMMO5': '0.020', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.139', 'weapon5': '0.246', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'HITCOUNT': '0.990', 'weapon2': '1.060', 'weapon3': '2.330', 'DAMAGECOUNT': '4.374', 'FRAGCOUNT': '11.000'} [2023-02-24 18:57:46,936][177170] DAMAGECOUNT value on done: 235081.0 [2023-02-24 18:57:46,937][177170] Sum rewards: 15.322, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.742', 'AMMO2': '0.002', 'AMMO4': '0.012', 'AMMO5': '0.025', 'weapon4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.163', 'weapon5': '0.330', 'weapon2': '0.508', 'WEAPON5': '0.700', 'WEAPON3': '1.250', 'HITCOUNT': '1.310', 'weapon3': '2.614', 'DAMAGECOUNT': '5.724', 'FRAGCOUNT': '15.000'} [2023-02-24 18:57:47,205][177153] Updated weights for policy 0, policy_version 19400 (0.0008) [2023-02-24 18:57:47,234][177170] DAMAGECOUNT value on done: 234969.0 [2023-02-24 18:57:47,234][177170] Sum rewards: 5.623, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.410', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.032', 'AMMO3': '0.057', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'weapon7': '0.120', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'weapon2': '0.362', 'WEAPON3': '0.400', 'weapon4': '0.630', 'HITCOUNT': '0.660', 'weapon3': '1.000', 'DAMAGECOUNT': '2.550', 'FRAGCOUNT': '5.000'} [2023-02-24 18:57:47,868][177158] DAMAGECOUNT value on done: 226870.0 [2023-02-24 18:57:47,869][177158] Sum rewards: 11.685, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.367', 'AMMO5': '0.012', 'AMMO2': '0.023', 'ARMOR': '0.024', 'weapon7': '0.052', 'AMMO3': '0.072', 'AMMO4': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.136', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'weapon4': '0.598', 'HITCOUNT': '0.840', 'weapon2': '1.196', 'weapon3': '1.440', 'DAMAGECOUNT': '3.552', 'FRAGCOUNT': '10.000'} [2023-02-24 18:57:48,168][177158] DAMAGECOUNT value on done: 231024.0 [2023-02-24 18:57:48,168][177158] Sum rewards: 20.272, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.145', 'AMMO2': '0.016', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'weapon7': '0.056', 'AMMO4': '0.078', 'AMMO3': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.288', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.840', 'weapon2': '1.320', 'weapon3': '1.640', 'DAMAGECOUNT': '5.055', 'FRAGCOUNT': '16.000'} [2023-02-24 18:57:48,836][177158] DAMAGECOUNT value on done: 240154.0 [2023-02-24 18:57:48,837][177158] Sum rewards: 16.313, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '0.000', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'AMMO3': '0.086', 'AMMO4': '0.096', 'weapon5': '0.196', 'weapon4': '0.206', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'HITCOUNT': '0.980', 'weapon2': '1.338', 'weapon3': '1.396', 'DAMAGECOUNT': '4.935', 'FRAGCOUNT': '13.000'} [2023-02-24 18:57:49,142][177158] DAMAGECOUNT value on done: 235382.0 [2023-02-24 18:57:49,143][177158] Sum rewards: 4.170, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.500', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon5': '0.024', 'AMMO3': '0.038', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon7': '0.152', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HITCOUNT': '0.220', 'weapon4': '0.284', 'WEAPON7': '0.300', 'WEAPON3': '0.300', 'weapon2': '0.538', 'weapon3': '0.578', 'DAMAGECOUNT': '1.221', 'FRAGCOUNT': '4.000'} [2023-02-24 18:57:50,162][177153] Updated weights for policy 0, policy_version 19410 (0.0008) [2023-02-24 18:57:51,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.2, 300 sec: 13884.8). Total num frames: 79519744. Throughput: 0: 3463.7. Samples: 19873688. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:57:51,376][177119] Avg episode reward: [(0, '13.250')] [2023-02-24 18:57:51,505][177172] DAMAGECOUNT value on done: 234320.0 [2023-02-24 18:57:51,506][177172] Sum rewards: 7.980, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.730', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'AMMO5': '0.032', 'weapon7': '0.076', 'AMMO4': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.121', 'WEAPON4': '0.150', 'weapon4': '0.334', 'weapon5': '0.384', 'weapon2': '0.518', 'HITCOUNT': '0.590', 'WEAPON5': '0.700', 'WEAPON3': '0.800', 'weapon3': '2.094', 'DAMAGECOUNT': '3.468', 'FRAGCOUNT': '8.000'} [2023-02-24 18:57:51,810][177172] DAMAGECOUNT value on done: 228455.0 [2023-02-24 18:57:51,810][177172] Sum rewards: 22.748, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.945', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon7': '0.058', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.161', 'AMMO4': '0.167', 'weapon5': '0.196', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.824', 'weapon2': '0.834', 'WEAPON3': '0.950', 'HITCOUNT': '1.580', 'weapon3': '1.592', 'DAMAGECOUNT': '6.192', 'FRAGCOUNT': '22.000'} [2023-02-24 18:57:53,142][177153] Updated weights for policy 0, policy_version 19420 (0.0009) [2023-02-24 18:57:53,210][177154] DAMAGECOUNT value on done: 237194.0 [2023-02-24 18:57:53,211][177154] Sum rewards: 7.857, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.108', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon7': '0.052', 'AMMO3': '0.070', 'AMMO4': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.220', 'weapon4': '0.222', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.700', 'weapon2': '1.482', 'weapon3': '1.492', 'DAMAGECOUNT': '2.490', 'FRAGCOUNT': '5.000'} [2023-02-24 18:57:53,307][177172] DAMAGECOUNT value on done: 238980.0 [2023-02-24 18:57:53,307][177172] Sum rewards: 13.879, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.171', 'AMMO2': '0.008', 'AMMO5': '0.022', 'AMMO4': '0.042', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'weapon4': '0.160', 'weapon5': '0.178', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon2': '1.014', 'HITCOUNT': '1.240', 'weapon3': '2.364', 'DAMAGECOUNT': '4.986', 'FRAGCOUNT': '13.000'} [2023-02-24 18:57:53,509][177154] DAMAGECOUNT value on done: 242958.0 [2023-02-24 18:57:53,510][177154] Sum rewards: 19.725, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.056', 'ARMOR': '0.004', 'AMMO2': '0.017', 'AMMO5': '0.017', 'AMMO3': '0.076', 'AMMO4': '0.087', 'weapon7': '0.132', 'weapon5': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'AMMO6': '0.440', 'AMMO7': '0.440', 'WEAPON3': '0.600', 'WEAPON7': '0.600', 'weapon4': '0.644', 'HITCOUNT': '0.890', 'weapon2': '1.048', 'weapon3': '1.270', 'DAMAGECOUNT': '5.373', 'FRAGCOUNT': '15.000'} [2023-02-24 18:57:53,608][177172] DAMAGECOUNT value on done: 230936.0 [2023-02-24 18:57:53,609][177172] Sum rewards: 9.083, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.204', 'AMMO2': '0.019', 'AMMO5': '0.019', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'weapon5': '0.116', 'AMMO3': '0.147', 'weapon4': '0.374', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'HITCOUNT': '0.960', 'WEAPON3': '1.000', 'weapon2': '1.104', 'weapon3': '2.082', 'DAMAGECOUNT': '4.671', 'FRAGCOUNT': '10.000'} [2023-02-24 18:57:53,809][177154] DAMAGECOUNT value on done: 248146.0 [2023-02-24 18:57:53,809][177154] Sum rewards: 16.070, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.015', 'AMMO5': '0.017', 'weapon7': '0.060', 'AMMO4': '0.074', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.115', 'HEALTH': '0.148', 'WEAPON4': '0.150', 'weapon4': '0.346', 'WEAPON5': '0.350', 'weapon5': '0.360', 'ARMOR': '0.453', 'WEAPON3': '0.600', 'weapon2': '0.730', 'HITCOUNT': '0.990', 'weapon3': '1.716', 'DAMAGECOUNT': '4.146', 'FRAGCOUNT': '13.000'} [2023-02-24 18:57:54,115][177154] DAMAGECOUNT value on done: 239641.0 [2023-02-24 18:57:54,116][177154] Sum rewards: 15.730, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.162', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO3': '0.094', 'AMMO4': '0.175', 'weapon5': '0.198', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.550', 'weapon4': '0.604', 'weapon2': '1.032', 'HITCOUNT': '1.130', 'weapon3': '1.536', 'DAMAGECOUNT': '4.365', 'FRAGCOUNT': '13.000'} [2023-02-24 18:57:54,268][177157] DAMAGECOUNT value on done: 227630.0 [2023-02-24 18:57:54,268][177157] Sum rewards: 14.200, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.045', 'AMMO2': '0.004', 'AMMO5': '0.012', 'AMMO4': '0.018', 'weapon4': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.115', 'weapon5': '0.324', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'HITCOUNT': '1.130', 'weapon2': '1.154', 'weapon3': '1.746', 'DAMAGECOUNT': '5.061', 'FRAGCOUNT': '12.000'} [2023-02-24 18:57:54,292][177157] DAMAGECOUNT value on done: 245363.0 [2023-02-24 18:57:54,293][177157] Sum rewards: 15.431, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.340', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon7': '0.070', 'AMMO3': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.159', 'weapon5': '0.214', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.750', 'weapon2': '0.750', 'weapon4': '0.754', 'HITCOUNT': '0.950', 'weapon3': '1.686', 'DAMAGECOUNT': '5.151', 'FRAGCOUNT': '15.000'} [2023-02-24 18:57:54,329][177171] DAMAGECOUNT value on done: 231746.0 [2023-02-24 18:57:54,330][177171] Sum rewards: 3.827, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.042', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.081', 'AMMO3': '0.109', 'weapon5': '0.204', 'WEAPON5': '0.250', 'weapon4': '0.282', 'WEAPON4': '0.350', 'ARMOR': '0.431', 'HITCOUNT': '0.510', 'WEAPON3': '0.700', 'weapon2': '1.160', 'weapon3': '1.888', 'DAMAGECOUNT': '2.127', 'FRAGCOUNT': '5.000'} [2023-02-24 18:57:54,580][177171] DAMAGECOUNT value on done: 233874.0 [2023-02-24 18:57:54,580][177171] Sum rewards: 8.514, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.318', 'AMMO5': '0.017', 'AMMO2': '0.033', 'weapon7': '0.054', 'weapon5': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.157', 'AMMO4': '0.165', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.318', 'WEAPON5': '0.350', 'HITCOUNT': '0.860', 'WEAPON3': '1.000', 'weapon2': '1.034', 'weapon3': '1.704', 'DAMAGECOUNT': '3.618', 'FRAGCOUNT': '12.000'} [2023-02-24 18:57:54,608][177157] DAMAGECOUNT value on done: 229373.0 [2023-02-24 18:57:54,608][177157] Sum rewards: 15.063, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.837', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.021', 'weapon7': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'weapon4': '0.248', 'weapon5': '0.258', 'ARMOR': '0.449', 'WEAPON5': '0.500', 'weapon2': '0.812', 'WEAPON3': '0.900', 'HITCOUNT': '1.150', 'weapon3': '2.112', 'DAMAGECOUNT': '4.935', 'FRAGCOUNT': '14.500'} [2023-02-24 18:57:54,617][177157] DAMAGECOUNT value on done: 230655.0 [2023-02-24 18:57:54,617][177157] Sum rewards: 9.801, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.550', 'AMMO5': '0.019', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.119', 'WEAPON4': '0.200', 'weapon4': '0.308', 'weapon5': '0.334', 'WEAPON5': '0.500', 'weapon2': '0.618', 'HITCOUNT': '0.850', 'WEAPON3': '0.900', 'weapon3': '1.906', 'DAMAGECOUNT': '3.723', 'FRAGCOUNT': '10.000'} [2023-02-24 18:57:54,637][177171] DAMAGECOUNT value on done: 238407.0 [2023-02-24 18:57:54,637][177171] Sum rewards: 9.632, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.100', 'AMMO5': '0.017', 'AMMO2': '0.022', 'WEAPON4': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.196', 'weapon5': '0.200', 'weapon4': '0.330', 'WEAPON5': '0.400', 'HITCOUNT': '1.150', 'weapon2': '1.184', 'WEAPON3': '1.250', 'weapon3': '1.978', 'DAMAGECOUNT': '5.043', 'FRAGCOUNT': '12.500'} [2023-02-24 18:57:54,880][177171] DAMAGECOUNT value on done: 232735.0 [2023-02-24 18:57:54,881][177171] Sum rewards: 10.836, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.947', 'AMMO5': '0.010', 'AMMO2': '0.011', 'weapon7': '0.048', 'AMMO4': '0.056', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.128', 'weapon5': '0.198', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.234', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'weapon2': '0.778', 'HITCOUNT': '1.080', 'weapon3': '1.932', 'DAMAGECOUNT': '4.617', 'FRAGCOUNT': '11.000'} [2023-02-24 18:57:55,945][177155] DAMAGECOUNT value on done: 234711.0 [2023-02-24 18:57:55,946][177155] Sum rewards: 10.313, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.039', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.034', 'AMMO3': '0.054', 'WEAPON5': '0.100', 'weapon7': '0.166', 'AMMO4': '0.170', 'weapon2': '0.204', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON3': '0.350', 'WEAPON4': '0.400', 'WEAPON7': '0.400', 'weapon4': '0.612', 'HITCOUNT': '0.750', 'weapon3': '0.872', 'DAMAGECOUNT': '2.586', 'FRAGCOUNT': '9.000'} [2023-02-24 18:57:56,098][177153] Updated weights for policy 0, policy_version 19430 (0.0009) [2023-02-24 18:57:56,245][177155] DAMAGECOUNT value on done: 242820.0 [2023-02-24 18:57:56,245][177155] Sum rewards: 15.466, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.084', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO5': '0.017', 'AMMO4': '0.067', 'weapon7': '0.088', 'AMMO3': '0.138', 'weapon5': '0.228', 'WEAPON4': '0.250', 'weapon4': '0.280', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'weapon2': '1.150', 'HITCOUNT': '1.270', 'weapon3': '1.912', 'DAMAGECOUNT': '6.081', 'FRAGCOUNT': '14.000'} [2023-02-24 18:57:56,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 79585280. Throughput: 0: 3464.6. Samples: 19894436. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:57:56,376][177119] Avg episode reward: [(0, '13.124')] [2023-02-24 18:57:56,557][177155] DAMAGECOUNT value on done: 241314.0 [2023-02-24 18:57:56,558][177155] Sum rewards: 19.511, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.650', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.044', 'AMMO3': '0.161', 'weapon5': '0.164', 'WEAPON5': '0.400', 'weapon2': '0.856', 'WEAPON3': '1.050', 'HITCOUNT': '1.560', 'weapon3': '2.430', 'DAMAGECOUNT': '6.459', 'FRAGCOUNT': '17.000'} [2023-02-24 18:57:56,862][177155] DAMAGECOUNT value on done: 226586.0 [2023-02-24 18:57:56,862][177155] Sum rewards: 14.701, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.732', 'AMMO5': '0.015', 'AMMO2': '0.017', 'weapon7': '0.054', 'AMMO3': '0.078', 'AMMO4': '0.085', 'WEAPON4': '0.250', 'weapon4': '0.250', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'weapon5': '0.368', 'WEAPON3': '0.550', 'HITCOUNT': '0.880', 'weapon3': '1.386', 'weapon2': '1.500', 'DAMAGECOUNT': '4.500', 'FRAGCOUNT': '11.000'} [2023-02-24 18:57:59,021][177153] Updated weights for policy 0, policy_version 19440 (0.0008) [2023-02-24 18:58:01,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13858.2, 300 sec: 13884.8). Total num frames: 79654912. Throughput: 0: 3467.7. Samples: 19915330. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:58:01,376][177119] Avg episode reward: [(0, '13.231')] [2023-02-24 18:58:01,972][177153] Updated weights for policy 0, policy_version 19450 (0.0009) [2023-02-24 18:58:04,884][177156] DAMAGECOUNT value on done: 237352.0 [2023-02-24 18:58:04,884][177156] Sum rewards: 12.395, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.300', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon5': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon7': '0.110', 'AMMO3': '0.114', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'weapon2': '0.516', 'weapon4': '0.670', 'WEAPON3': '0.800', 'HITCOUNT': '1.060', 'weapon3': '1.574', 'DAMAGECOUNT': '4.497', 'FRAGCOUNT': '11.000'} [2023-02-24 18:58:04,896][177156] DAMAGECOUNT value on done: 232545.0 [2023-02-24 18:58:04,897][177156] Sum rewards: 22.695, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.040', 'weapon5': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.033', 'AMMO3': '0.105', 'AMMO4': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.574', 'weapon2': '0.656', 'WEAPON3': '0.750', 'HITCOUNT': '1.670', 'weapon3': '2.050', 'DAMAGECOUNT': '6.507', 'FRAGCOUNT': '19.000'} [2023-02-24 18:58:04,959][177153] Updated weights for policy 0, policy_version 19460 (0.0008) [2023-02-24 18:58:05,192][177156] DAMAGECOUNT value on done: 242306.0 [2023-02-24 18:58:05,192][177156] Sum rewards: 9.858, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-3.435', 'AMMO2': '0.009', 'AMMO5': '0.014', 'AMMO4': '0.044', 'weapon7': '0.056', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.144', 'WEAPON7': '0.200', 'weapon5': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.396', 'HITCOUNT': '0.840', 'WEAPON3': '1.050', 'weapon2': '1.138', 'weapon3': '1.712', 'DAMAGECOUNT': '3.690', 'FRAGCOUNT': '12.000'} [2023-02-24 18:58:05,202][177156] DAMAGECOUNT value on done: 233283.0 [2023-02-24 18:58:05,203][177156] Sum rewards: 19.593, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.540', 'AMMO2': '0.002', 'AMMO5': '0.011', 'AMMO4': '0.012', 'WEAPON4': '0.050', 'weapon7': '0.088', 'weapon5': '0.096', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.134', 'WEAPON5': '0.150', 'weapon4': '0.204', 'ARMOR': '0.493', 'WEAPON3': '1.000', 'weapon2': '1.278', 'HITCOUNT': '1.420', 'weapon3': '1.840', 'DAMAGECOUNT': '5.304', 'FRAGCOUNT': '18.000'} [2023-02-24 18:58:05,523][177170] DAMAGECOUNT value on done: 238339.0 [2023-02-24 18:58:05,524][177170] Sum rewards: 11.121, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.400', 'AMMO5': '0.012', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'AMMO4': '0.138', 'weapon5': '0.168', 'AMMO3': '0.189', 'weapon4': '0.376', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.646', 'HITCOUNT': '1.250', 'WEAPON3': '1.300', 'weapon3': '2.408', 'DAMAGECOUNT': '5.616', 'FRAGCOUNT': '15.000'} [2023-02-24 18:58:05,812][177170] DAMAGECOUNT value on done: 243946.0 [2023-02-24 18:58:05,813][177170] Sum rewards: 15.462, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.200', 'AMMO5': '0.018', 'AMMO2': '0.040', 'AMMO3': '0.122', 'weapon5': '0.122', 'weapon7': '0.126', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'AMMO4': '0.201', 'WEAPON5': '0.400', 'ARMOR': '0.462', 'WEAPON4': '0.550', 'weapon2': '0.660', 'weapon4': '0.744', 'WEAPON3': '0.800', 'HITCOUNT': '1.120', 'weapon3': '1.510', 'DAMAGECOUNT': '4.686', 'FRAGCOUNT': '15.000'} [2023-02-24 18:58:06,333][177170] DAMAGECOUNT value on done: 236139.0 [2023-02-24 18:58:06,333][177170] Sum rewards: 7.225, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.343', 'AMMO5': '0.003', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.115', 'weapon7': '0.166', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'weapon2': '0.560', 'weapon4': '0.654', 'WEAPON3': '0.700', 'HITCOUNT': '0.940', 'weapon3': '1.920', 'DAMAGECOUNT': '3.174', 'FRAGCOUNT': '8.000'} [2023-02-24 18:58:06,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 79724544. Throughput: 0: 3465.3. Samples: 19925678. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:58:06,376][177119] Avg episode reward: [(0, '13.355')] [2023-02-24 18:58:06,635][177170] DAMAGECOUNT value on done: 236815.0 [2023-02-24 18:58:06,635][177170] Sum rewards: 17.456, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.455', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon7': '0.096', 'AMMO4': '0.101', 'AMMO3': '0.139', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.272', 'WEAPON7': '0.300', 'weapon4': '0.314', 'WEAPON5': '0.350', 'weapon2': '0.680', 'WEAPON3': '1.050', 'HITCOUNT': '1.120', 'weapon3': '2.078', 'DAMAGECOUNT': '5.238', 'FRAGCOUNT': '18.000'} [2023-02-24 18:58:07,192][177158] DAMAGECOUNT value on done: 228585.0 [2023-02-24 18:58:07,192][177158] Sum rewards: 10.881, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.372', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'AMMO3': '0.150', 'AMMO4': '0.162', 'weapon5': '0.230', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.694', 'WEAPON3': '0.850', 'weapon4': '0.888', 'HITCOUNT': '1.210', 'weapon3': '1.554', 'DAMAGECOUNT': '5.145', 'FRAGCOUNT': '11.000'} [2023-02-24 18:58:07,492][177158] DAMAGECOUNT value on done: 232163.0 [2023-02-24 18:58:07,492][177158] Sum rewards: 9.465, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.465', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.049', 'weapon7': '0.124', 'AMMO3': '0.128', 'weapon4': '0.162', 'weapon5': '0.168', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'AMMO4': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.900', 'HITCOUNT': '0.920', 'weapon2': '1.096', 'weapon3': '1.790', 'DAMAGECOUNT': '3.417', 'FRAGCOUNT': '9.000'} [2023-02-24 18:58:07,890][177153] Updated weights for policy 0, policy_version 19470 (0.0008) [2023-02-24 18:58:08,161][177158] DAMAGECOUNT value on done: 240719.0 [2023-02-24 18:58:08,162][177158] Sum rewards: 6.102, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.748', 'AMMO2': '0.012', 'AMMO5': '0.015', 'ARMOR': '0.020', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO4': '0.058', 'AMMO3': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.290', 'weapon5': '0.302', 'HITCOUNT': '0.380', 'WEAPON5': '0.450', 'weapon2': '0.524', 'WEAPON3': '0.700', 'weapon3': '1.566', 'DAMAGECOUNT': '1.695', 'FRAGCOUNT': '7.000'} [2023-02-24 18:58:08,455][177158] DAMAGECOUNT value on done: 236692.0 [2023-02-24 18:58:08,455][177158] Sum rewards: 12.122, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.740', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.037', 'weapon5': '0.048', 'WEAPON5': '0.100', 'weapon7': '0.114', 'AMMO3': '0.123', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'WEAPON7': '0.400', 'weapon4': '0.482', 'WEAPON3': '0.750', 'HITCOUNT': '0.960', 'weapon2': '1.238', 'weapon3': '1.888', 'DAMAGECOUNT': '3.930', 'FRAGCOUNT': '11.000'} [2023-02-24 18:58:10,829][177153] Updated weights for policy 0, policy_version 19480 (0.0009) [2023-02-24 18:58:10,876][177172] DAMAGECOUNT value on done: 235074.0 [2023-02-24 18:58:10,876][177172] Sum rewards: 8.576, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.530', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.024', 'AMMO3': '0.090', 'weapon5': '0.228', 'WEAPON5': '0.250', 'ARMOR': '0.500', 'HITCOUNT': '0.590', 'WEAPON3': '0.650', 'weapon2': '1.484', 'weapon3': '2.010', 'DAMAGECOUNT': '2.262', 'FRAGCOUNT': '7.000'} [2023-02-24 18:58:11,194][177172] DAMAGECOUNT value on done: 229730.0 [2023-02-24 18:58:11,194][177172] Sum rewards: 14.757, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.225', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.097', 'weapon5': '0.110', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '0.900', 'weapon2': '1.418', 'weapon3': '1.714', 'DAMAGECOUNT': '3.825', 'FRAGCOUNT': '13.000'} [2023-02-24 18:58:11,376][177119] Fps is (10 sec: 13926.0, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 79794176. Throughput: 0: 3466.6. Samples: 19946514. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:58:11,377][177119] Avg episode reward: [(0, '13.307')] [2023-02-24 18:58:12,590][177154] DAMAGECOUNT value on done: 238101.0 [2023-02-24 18:58:12,590][177154] Sum rewards: 4.216, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.767', 'AMMO5': '0.014', 'AMMO2': '0.027', 'weapon5': '0.076', 'AMMO4': '0.135', 'AMMO3': '0.135', 'weapon7': '0.216', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'AMMO6': '0.420', 'AMMO7': '0.420', 'WEAPON7': '0.500', 'weapon4': '0.502', 'HITCOUNT': '0.600', 'WEAPON3': '0.750', 'weapon2': '1.080', 'weapon3': '1.486', 'DAMAGECOUNT': '2.721', 'FRAGCOUNT': '5.000'} [2023-02-24 18:58:12,682][177172] DAMAGECOUNT value on done: 240589.0 [2023-02-24 18:58:12,682][177172] Sum rewards: 12.943, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.106', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'weapon4': '0.116', 'AMMO3': '0.147', 'WEAPON5': '0.300', 'weapon5': '0.424', 'WEAPON3': '0.950', 'weapon2': '0.956', 'HITCOUNT': '1.300', 'weapon3': '2.164', 'DAMAGECOUNT': '4.827', 'FRAGCOUNT': '11.000'} [2023-02-24 18:58:12,881][177154] DAMAGECOUNT value on done: 244153.0 [2023-02-24 18:58:12,882][177154] Sum rewards: 11.977, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.650', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'AMMO3': '0.100', 'weapon7': '0.100', 'weapon5': '0.112', 'AMMO4': '0.141', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.324', 'WEAPON3': '0.600', 'HITCOUNT': '0.840', 'weapon2': '0.924', 'weapon3': '1.362', 'DAMAGECOUNT': '3.585', 'FRAGCOUNT': '10.000'} [2023-02-24 18:58:12,984][177172] DAMAGECOUNT value on done: 232363.0 [2023-02-24 18:58:12,985][177172] Sum rewards: 16.729, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.704', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.072', 'AMMO4': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon7': '0.112', 'WEAPON5': '0.150', 'weapon2': '0.358', 'weapon4': '0.460', 'WEAPON3': '0.700', 'HITCOUNT': '0.990', 'weapon3': '1.448', 'DAMAGECOUNT': '4.281', 'FRAGCOUNT': '15.000'} [2023-02-24 18:58:13,180][177154] DAMAGECOUNT value on done: 250107.0 [2023-02-24 18:58:13,181][177154] Sum rewards: 15.973, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.874', 'AMMO5': '0.019', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.106', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'ARMOR': '0.432', 'weapon4': '0.436', 'weapon2': '0.554', 'WEAPON3': '1.350', 'HITCOUNT': '1.570', 'weapon3': '2.278', 'DAMAGECOUNT': '5.883', 'FRAGCOUNT': '18.000'} [2023-02-24 18:58:13,476][177154] DAMAGECOUNT value on done: 240843.0 [2023-02-24 18:58:13,476][177154] Sum rewards: 12.302, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.838', 'AMMO5': '0.015', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.088', 'weapon4': '0.090', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'weapon5': '0.256', 'WEAPON5': '0.450', 'weapon2': '0.886', 'HITCOUNT': '0.970', 'WEAPON3': '1.050', 'weapon3': '2.408', 'DAMAGECOUNT': '3.606', 'FRAGCOUNT': '13.000'} [2023-02-24 18:58:13,667][177171] DAMAGECOUNT value on done: 232648.0 [2023-02-24 18:58:13,668][177171] Sum rewards: 0.744, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.474', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.015', 'WEAPON1': '0.020', 'weapon7': '0.050', 'AMMO3': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.188', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.240', 'WEAPON5': '0.250', 'weapon2': '0.652', 'HITCOUNT': '0.760', 'WEAPON3': '0.900', 'weapon3': '1.920', 'DAMAGECOUNT': '2.706', 'FRAGCOUNT': '3.000'} [2023-02-24 18:58:13,688][177157] DAMAGECOUNT value on done: 228897.0 [2023-02-24 18:58:13,688][177157] Sum rewards: 10.681, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.640', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon7': '0.066', 'AMMO3': '0.109', 'weapon5': '0.114', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.476', 'weapon4': '0.534', 'WEAPON3': '0.750', 'HITCOUNT': '0.810', 'weapon2': '0.850', 'weapon3': '1.724', 'DAMAGECOUNT': '3.801', 'FRAGCOUNT': '11.000'} [2023-02-24 18:58:13,698][177157] DAMAGECOUNT value on done: 247190.0 [2023-02-24 18:58:13,699][177157] Sum rewards: 16.792, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.210', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.133', 'weapon5': '0.166', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'weapon2': '0.984', 'HITCOUNT': '1.410', 'weapon3': '2.128', 'DAMAGECOUNT': '5.481', 'FRAGCOUNT': '14.000'} [2023-02-24 18:58:13,790][177153] Updated weights for policy 0, policy_version 19490 (0.0009) [2023-02-24 18:58:13,924][177171] DAMAGECOUNT value on done: 234488.0 [2023-02-24 18:58:13,925][177171] Sum rewards: 1.870, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.890', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.074', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon4': '0.194', 'WEAPON4': '0.200', 'HITCOUNT': '0.470', 'WEAPON3': '1.100', 'weapon2': '1.120', 'weapon3': '1.840', 'DAMAGECOUNT': '1.842', 'FRAGCOUNT': '7.000'} [2023-02-24 18:58:13,977][177171] DAMAGECOUNT value on done: 240203.0 [2023-02-24 18:58:13,978][177171] Sum rewards: 13.418, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.970', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO2': '0.032', 'weapon7': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.129', 'AMMO4': '0.160', 'weapon4': '0.196', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.266', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'HITCOUNT': '1.110', 'weapon2': '1.150', 'weapon3': '1.976', 'DAMAGECOUNT': '5.388', 'FRAGCOUNT': '11.000'} [2023-02-24 18:58:13,997][177157] DAMAGECOUNT value on done: 232413.0 [2023-02-24 18:58:13,998][177157] Sum rewards: 13.883, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.672', 'AMMO2': '0.004', 'AMMO5': '0.014', 'AMMO4': '0.019', 'WEAPON1': '0.020', 'weapon4': '0.108', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'weapon5': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.914', 'WEAPON3': '1.150', 'HITCOUNT': '1.450', 'weapon3': '2.286', 'DAMAGECOUNT': '5.274', 'FRAGCOUNT': '15.000'} [2023-02-24 18:58:14,010][177157] DAMAGECOUNT value on done: 230711.0 [2023-02-24 18:58:14,010][177157] Sum rewards: 12.550, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.260', 'AMMO5': '0.010', 'AMMO2': '0.042', 'AMMO3': '0.100', 'weapon7': '0.168', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'AMMO4': '0.211', 'weapon5': '0.236', 'WEAPON4': '0.300', 'weapon4': '0.548', 'WEAPON3': '0.550', 'weapon2': '0.716', 'HITCOUNT': '1.110', 'weapon3': '1.504', 'DAMAGECOUNT': '4.014', 'FRAGCOUNT': '10.000'} [2023-02-24 18:58:14,229][177171] DAMAGECOUNT value on done: 234129.0 [2023-02-24 18:58:14,229][177171] Sum rewards: 12.608, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.470', 'AMMO2': '0.000', 'AMMO4': '0.002', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'weapon5': '0.132', 'weapon4': '0.204', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'HITCOUNT': '0.890', 'weapon2': '1.416', 'weapon3': '1.662', 'DAMAGECOUNT': '4.182', 'FRAGCOUNT': '11.000'} [2023-02-24 18:58:15,330][177155] DAMAGECOUNT value on done: 236062.0 [2023-02-24 18:58:15,330][177155] Sum rewards: 13.804, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.398', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO3': '0.117', 'AMMO4': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.290', 'weapon4': '0.310', 'WEAPON3': '0.800', 'weapon2': '0.904', 'HITCOUNT': '0.990', 'weapon3': '2.110', 'DAMAGECOUNT': '4.053', 'FRAGCOUNT': '13.000'} [2023-02-24 18:58:15,628][177155] DAMAGECOUNT value on done: 245014.0 [2023-02-24 18:58:15,629][177155] Sum rewards: 18.710, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.802', 'AMMO5': '0.016', 'AMMO2': '0.026', 'WEAPON4': '0.100', 'AMMO4': '0.128', 'AMMO3': '0.158', 'weapon4': '0.220', 'weapon5': '0.266', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '1.170', 'weapon2': '1.338', 'weapon3': '1.918', 'DAMAGECOUNT': '6.222', 'FRAGCOUNT': '16.000'} [2023-02-24 18:58:15,935][177155] DAMAGECOUNT value on done: 241660.0 [2023-02-24 18:58:15,935][177155] Sum rewards: 4.257, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.702', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO3': '0.036', 'WEAPON1': '0.040', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'weapon5': '0.152', 'weapon7': '0.190', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.300', 'WEAPON5': '0.300', 'HITCOUNT': '0.360', 'weapon2': '0.446', 'weapon4': '0.476', 'weapon3': '0.628', 'DAMAGECOUNT': '1.038', 'FRAGCOUNT': '3.000'} [2023-02-24 18:58:16,229][177155] DAMAGECOUNT value on done: 228190.0 [2023-02-24 18:58:16,230][177155] Sum rewards: 16.159, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.406', 'AMMO2': '0.007', 'AMMO5': '0.012', 'AMMO4': '0.036', 'WEAPON1': '0.040', 'AMMO3': '0.099', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.274', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'HITCOUNT': '1.190', 'weapon2': '1.480', 'weapon3': '1.964', 'DAMAGECOUNT': '4.812', 'FRAGCOUNT': '12.000'} [2023-02-24 18:58:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 79863808. Throughput: 0: 3467.5. Samples: 19967346. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:58:16,376][177119] Avg episode reward: [(0, '12.632')] [2023-02-24 18:58:16,753][177153] Updated weights for policy 0, policy_version 19500 (0.0008) [2023-02-24 18:58:19,703][177153] Updated weights for policy 0, policy_version 19510 (0.0009) [2023-02-24 18:58:21,376][177119] Fps is (10 sec: 13926.7, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 79933440. Throughput: 0: 3467.1. Samples: 19977758. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:58:21,376][177119] Avg episode reward: [(0, '12.632')] [2023-02-24 18:58:22,670][177153] Updated weights for policy 0, policy_version 19520 (0.0009) [2023-02-24 18:58:24,227][177156] DAMAGECOUNT value on done: 238197.0 [2023-02-24 18:58:24,228][177156] Sum rewards: 5.527, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.768', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.030', 'AMMO3': '0.071', 'AMMO4': '0.114', 'weapon7': '0.142', 'WEAPON5': '0.150', 'AMMO6': '0.340', 'AMMO7': '0.340', 'weapon2': '0.414', 'WEAPON3': '0.450', 'WEAPON4': '0.500', 'WEAPON7': '0.500', 'weapon4': '0.576', 'HITCOUNT': '0.660', 'weapon3': '0.942', 'DAMAGECOUNT': '2.535', 'FRAGCOUNT': '7.000'} [2023-02-24 18:58:24,238][177156] DAMAGECOUNT value on done: 234184.0 [2023-02-24 18:58:24,239][177156] Sum rewards: 11.183, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.770', 'WEAPON1': '0.020', 'AMMO5': '0.028', 'AMMO2': '0.029', 'AMMO3': '0.138', 'AMMO4': '0.144', 'WEAPON4': '0.250', 'weapon5': '0.328', 'weapon4': '0.470', 'WEAPON5': '0.550', 'weapon2': '0.704', 'WEAPON3': '0.850', 'HITCOUNT': '0.940', 'weapon3': '1.336', 'DAMAGECOUNT': '4.917', 'FRAGCOUNT': '11.000'} [2023-02-24 18:58:24,534][177156] DAMAGECOUNT value on done: 243370.0 [2023-02-24 18:58:24,535][177156] Sum rewards: 7.580, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.568', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon5': '0.058', 'AMMO4': '0.081', 'weapon7': '0.138', 'AMMO3': '0.165', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON7': '0.400', 'weapon2': '0.446', 'ARMOR': '0.461', 'weapon4': '0.498', 'HITCOUNT': '0.760', 'WEAPON3': '1.100', 'weapon3': '2.220', 'DAMAGECOUNT': '3.192', 'FRAGCOUNT': '10.000'} [2023-02-24 18:58:24,546][177156] DAMAGECOUNT value on done: 234538.0 [2023-02-24 18:58:24,547][177156] Sum rewards: 16.297, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.365', 'AMMO5': '0.003', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'weapon5': '0.018', 'AMMO4': '0.029', 'WEAPON5': '0.050', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.132', 'WEAPON7': '0.200', 'weapon4': '0.258', 'weapon2': '0.270', 'WEAPON3': '0.500', 'HITCOUNT': '0.980', 'weapon3': '1.530', 'DAMAGECOUNT': '3.765', 'FRAGCOUNT': '13.000'} [2023-02-24 18:58:24,897][177170] DAMAGECOUNT value on done: 239430.0 [2023-02-24 18:58:24,898][177170] Sum rewards: 10.289, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.456', 'AMMO2': '0.006', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.156', 'weapon5': '0.184', 'weapon4': '0.264', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'weapon2': '0.598', 'HITCOUNT': '0.600', 'weapon3': '1.014', 'DAMAGECOUNT': '3.273', 'FRAGCOUNT': '7.000'} [2023-02-24 18:58:25,203][177170] DAMAGECOUNT value on done: 245629.0 [2023-02-24 18:58:25,204][177170] Sum rewards: 16.635, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.864', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.081', 'AMMO3': '0.099', 'weapon5': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.458', 'weapon4': '0.636', 'WEAPON3': '0.750', 'weapon2': '0.788', 'HITCOUNT': '1.160', 'weapon3': '1.722', 'DAMAGECOUNT': '5.049', 'FRAGCOUNT': '13.500'} [2023-02-24 18:58:25,622][177153] Updated weights for policy 0, policy_version 19530 (0.0008) [2023-02-24 18:58:25,728][177170] DAMAGECOUNT value on done: 237344.0 [2023-02-24 18:58:25,729][177170] Sum rewards: 12.275, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO3': '0.145', 'weapon4': '0.148', 'AMMO4': '0.194', 'WEAPON4': '0.200', 'weapon5': '0.226', 'WEAPON5': '0.250', 'HEALTH': '0.296', 'HITCOUNT': '0.800', 'WEAPON3': '0.850', 'weapon2': '1.344', 'weapon3': '1.908', 'DAMAGECOUNT': '3.615', 'FRAGCOUNT': '12.000'} [2023-02-24 18:58:26,034][177170] DAMAGECOUNT value on done: 237857.0 [2023-02-24 18:58:26,035][177170] Sum rewards: 11.663, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.338', 'AMMO5': '0.015', 'AMMO2': '0.022', 'weapon7': '0.066', 'AMMO3': '0.101', 'AMMO4': '0.109', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.380', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.830', 'weapon2': '1.148', 'weapon3': '1.684', 'DAMAGECOUNT': '3.126', 'FRAGCOUNT': '10.000'} [2023-02-24 18:58:26,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 80003072. Throughput: 0: 3463.2. Samples: 19998400. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:58:26,376][177119] Avg episode reward: [(0, '12.563')] [2023-02-24 18:58:26,533][177158] DAMAGECOUNT value on done: 229257.0 [2023-02-24 18:58:26,533][177158] Sum rewards: 10.783, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.110', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'weapon7': '0.052', 'AMMO3': '0.054', 'AMMO4': '0.061', 'weapon5': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON3': '0.300', 'WEAPON4': '0.300', 'weapon3': '0.494', 'HITCOUNT': '0.580', 'weapon4': '0.584', 'weapon2': '0.854', 'ARMOR': '0.907', 'DAMAGECOUNT': '2.016', 'FRAGCOUNT': '8.000'} [2023-02-24 18:58:26,830][177158] DAMAGECOUNT value on done: 233863.0 [2023-02-24 18:58:26,831][177158] Sum rewards: 11.645, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.140', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'weapon4': '0.272', 'weapon2': '0.612', 'WEAPON3': '1.200', 'HITCOUNT': '1.360', 'weapon3': '2.480', 'DAMAGECOUNT': '5.100', 'FRAGCOUNT': '15.000'} [2023-02-24 18:58:27,475][177158] DAMAGECOUNT value on done: 242271.0 [2023-02-24 18:58:27,476][177158] Sum rewards: 12.066, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.489', 'AMMO2': '0.014', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.071', 'AMMO3': '0.118', 'weapon5': '0.146', 'weapon4': '0.362', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon2': '1.074', 'HITCOUNT': '1.090', 'weapon3': '1.584', 'DAMAGECOUNT': '4.656', 'FRAGCOUNT': '11.000'} [2023-02-24 18:58:27,771][177158] DAMAGECOUNT value on done: 237509.0 [2023-02-24 18:58:27,771][177158] Sum rewards: 10.812, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'AMMO3': '0.052', 'HEALTH': '0.052', 'weapon5': '0.066', 'weapon7': '0.108', 'weapon4': '0.194', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.500', 'weapon2': '0.810', 'weapon3': '0.922', 'DAMAGECOUNT': '2.451', 'FRAGCOUNT': '8.000'} [2023-02-24 18:58:28,577][177153] Updated weights for policy 0, policy_version 19540 (0.0008) [2023-02-24 18:58:30,351][177172] DAMAGECOUNT value on done: 236402.0 [2023-02-24 18:58:30,351][177172] Sum rewards: 10.556, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.310', 'AMMO5': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.056', 'weapon4': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.144', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.950', 'weapon2': '0.962', 'HITCOUNT': '1.060', 'weapon3': '2.082', 'DAMAGECOUNT': '3.984', 'FRAGCOUNT': '10.000'} [2023-02-24 18:58:30,649][177172] DAMAGECOUNT value on done: 231938.0 [2023-02-24 18:58:30,649][177172] Sum rewards: 20.600, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.469', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO4': '0.021', 'AMMO5': '0.021', 'AMMO3': '0.185', 'weapon5': '0.256', 'WEAPON5': '0.550', 'weapon2': '0.892', 'WEAPON3': '1.150', 'HITCOUNT': '1.340', 'weapon3': '2.516', 'DAMAGECOUNT': '6.624', 'FRAGCOUNT': '19.000'} [2023-02-24 18:58:31,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 80072704. Throughput: 0: 3466.8. Samples: 20019256. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:58:31,376][177119] Avg episode reward: [(0, '12.603')] [2023-02-24 18:58:31,515][177153] Updated weights for policy 0, policy_version 19550 (0.0008) [2023-02-24 18:58:32,000][177154] DAMAGECOUNT value on done: 240038.0 [2023-02-24 18:58:32,000][177154] Sum rewards: 15.575, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.015', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'HEALTH': '0.040', 'weapon5': '0.046', 'AMMO4': '0.100', 'AMMO3': '0.113', 'weapon7': '0.144', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.334', 'weapon2': '0.574', 'WEAPON3': '0.650', 'HITCOUNT': '1.150', 'weapon3': '1.898', 'DAMAGECOUNT': '4.911', 'FRAGCOUNT': '12.000'} [2023-02-24 18:58:32,155][177172] DAMAGECOUNT value on done: 241923.0 [2023-02-24 18:58:32,156][177172] Sum rewards: 11.480, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.800', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO5': '0.016', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'weapon5': '0.194', 'weapon4': '0.240', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'weapon2': '0.978', 'HITCOUNT': '1.010', 'weapon3': '2.156', 'DAMAGECOUNT': '4.002', 'FRAGCOUNT': '10.500'} [2023-02-24 18:58:32,303][177154] DAMAGECOUNT value on done: 246027.0 [2023-02-24 18:58:32,304][177154] Sum rewards: 16.586, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.471', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO5': '0.029', 'AMMO4': '0.040', 'AMMO3': '0.107', 'weapon5': '0.378', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'HITCOUNT': '1.040', 'weapon2': '1.184', 'weapon3': '1.978', 'DAMAGECOUNT': '5.622', 'FRAGCOUNT': '13.000'} [2023-02-24 18:58:32,450][177172] DAMAGECOUNT value on done: 233630.0 [2023-02-24 18:58:32,451][177172] Sum rewards: 12.433, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.168', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.066', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'AMMO4': '0.165', 'weapon4': '0.196', 'WEAPON4': '0.250', 'WEAPON3': '0.900', 'HITCOUNT': '0.990', 'weapon2': '1.084', 'weapon3': '2.300', 'DAMAGECOUNT': '3.801', 'FRAGCOUNT': '13.000'} [2023-02-24 18:58:32,605][177154] DAMAGECOUNT value on done: 251640.0 [2023-02-24 18:58:32,605][177154] Sum rewards: 18.764, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.779', 'AMMO5': '0.008', 'AMMO2': '0.013', 'weapon5': '0.062', 'AMMO4': '0.063', 'weapon7': '0.072', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.102', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.330', 'WEAPON3': '0.650', 'weapon2': '1.004', 'HITCOUNT': '1.150', 'weapon3': '1.890', 'DAMAGECOUNT': '4.599', 'FRAGCOUNT': '15.000'} [2023-02-24 18:58:32,904][177154] DAMAGECOUNT value on done: 242242.0 [2023-02-24 18:58:32,905][177154] Sum rewards: 10.145, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.218', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.155', 'weapon4': '0.214', 'ARMOR': '0.455', 'WEAPON3': '0.900', 'HITCOUNT': '1.230', 'weapon2': '1.334', 'weapon3': '2.042', 'DAMAGECOUNT': '4.197', 'FRAGCOUNT': '9.000'} [2023-02-24 18:58:33,092][177157] DAMAGECOUNT value on done: 230568.0 [2023-02-24 18:58:33,093][177157] Sum rewards: 18.977, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.540', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.029', 'AMMO3': '0.081', 'weapon7': '0.094', 'AMMO4': '0.144', 'weapon5': '0.158', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '0.500', 'weapon2': '0.544', 'weapon4': '0.708', 'weapon3': '1.116', 'HITCOUNT': '1.220', 'DAMAGECOUNT': '5.013', 'FRAGCOUNT': '16.000'} [2023-02-24 18:58:33,102][177157] DAMAGECOUNT value on done: 248463.0 [2023-02-24 18:58:33,103][177157] Sum rewards: 11.903, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.686', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon7': '0.058', 'AMMO3': '0.097', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.131', 'weapon5': '0.194', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '0.500', 'weapon4': '0.624', 'HITCOUNT': '0.840', 'weapon2': '0.868', 'weapon3': '1.134', 'DAMAGECOUNT': '3.819', 'FRAGCOUNT': '10.000'} [2023-02-24 18:58:33,145][177171] DAMAGECOUNT value on done: 234479.0 [2023-02-24 18:58:33,146][177171] Sum rewards: 20.861, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.015', 'AMMO2': '0.029', 'HEALTH': '0.040', 'AMMO4': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'weapon5': '0.178', 'WEAPON5': '0.250', 'weapon4': '0.404', 'WEAPON3': '0.850', 'weapon2': '0.912', 'HITCOUNT': '1.230', 'weapon3': '2.014', 'DAMAGECOUNT': '5.493', 'FRAGCOUNT': '18.000'} [2023-02-24 18:58:33,408][177157] DAMAGECOUNT value on done: 234081.0 [2023-02-24 18:58:33,409][177157] Sum rewards: 16.618, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.150', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.018', 'ARMOR': '0.028', 'weapon7': '0.060', 'AMMO4': '0.088', 'AMMO3': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.518', 'WEAPON3': '0.750', 'weapon2': '0.796', 'HITCOUNT': '1.210', 'weapon3': '1.542', 'DAMAGECOUNT': '5.004', 'FRAGCOUNT': '13.000'} [2023-02-24 18:58:33,418][177157] DAMAGECOUNT value on done: 231571.0 [2023-02-24 18:58:33,419][177157] Sum rewards: 10.738, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.740', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.051', 'weapon7': '0.070', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.196', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon5': '0.302', 'WEAPON3': '0.400', 'HITCOUNT': '0.400', 'weapon2': '1.134', 'weapon3': '1.218', 'DAMAGECOUNT': '2.580', 'FRAGCOUNT': '8.000'} [2023-02-24 18:58:33,431][177171] DAMAGECOUNT value on done: 236157.0 [2023-02-24 18:58:33,431][177171] Sum rewards: 15.807, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.790', 'AMMO2': '0.018', 'AMMO5': '0.030', 'WEAPON1': '0.040', 'AMMO4': '0.090', 'AMMO3': '0.174', 'weapon5': '0.192', 'WEAPON4': '0.200', 'weapon4': '0.398', 'weapon2': '0.548', 'WEAPON5': '0.700', 'WEAPON3': '1.100', 'HITCOUNT': '1.130', 'weapon3': '2.220', 'DAMAGECOUNT': '5.007', 'FRAGCOUNT': '17.000'} [2023-02-24 18:58:33,462][177171] DAMAGECOUNT value on done: 241765.0 [2023-02-24 18:58:33,462][177171] Sum rewards: 14.464, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.074', 'AMMO2': '0.014', 'AMMO5': '0.015', 'weapon4': '0.018', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO4': '0.069', 'weapon5': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.144', 'WEAPON5': '0.300', 'WEAPON3': '0.900', 'HITCOUNT': '1.150', 'weapon2': '1.168', 'weapon3': '1.824', 'DAMAGECOUNT': '4.686', 'FRAGCOUNT': '13.000'} [2023-02-24 18:58:33,744][177171] DAMAGECOUNT value on done: 235537.0 [2023-02-24 18:58:33,744][177171] Sum rewards: 14.658, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.548', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon7': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.121', 'AMMO4': '0.126', 'WEAPON7': '0.200', 'weapon5': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.430', 'WEAPON3': '0.750', 'weapon2': '0.920', 'HITCOUNT': '1.150', 'weapon3': '1.272', 'DAMAGECOUNT': '4.224', 'FRAGCOUNT': '14.000'} [2023-02-24 18:58:34,485][177153] Updated weights for policy 0, policy_version 19560 (0.0008) [2023-02-24 18:58:34,778][177155] DAMAGECOUNT value on done: 237159.0 [2023-02-24 18:58:34,778][177155] Sum rewards: 9.011, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.010', 'AMMO5': '0.007', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'weapon5': '0.080', 'AMMO3': '0.134', 'AMMO4': '0.147', 'WEAPON5': '0.200', 'weapon4': '0.310', 'WEAPON4': '0.350', 'HITCOUNT': '0.790', 'WEAPON3': '0.850', 'weapon2': '1.262', 'weapon3': '2.042', 'DAMAGECOUNT': '3.291', 'FRAGCOUNT': '11.000'} [2023-02-24 18:58:35,078][177155] DAMAGECOUNT value on done: 246093.0 [2023-02-24 18:58:35,078][177155] Sum rewards: 3.967, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.440', 'AMMO2': '0.016', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'weapon7': '0.040', 'AMMO4': '0.081', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.123', 'WEAPON7': '0.200', 'weapon4': '0.280', 'WEAPON4': '0.300', 'weapon5': '0.334', 'WEAPON5': '0.550', 'HITCOUNT': '0.810', 'WEAPON3': '0.850', 'weapon2': '1.496', 'weapon3': '1.540', 'DAMAGECOUNT': '3.237', 'FRAGCOUNT': '6.000'} [2023-02-24 18:58:35,378][177155] DAMAGECOUNT value on done: 243294.0 [2023-02-24 18:58:35,379][177155] Sum rewards: 15.654, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.887', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.035', 'weapon7': '0.046', 'AMMO3': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.176', 'weapon5': '0.224', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon4': '0.422', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '1.030', 'weapon2': '1.410', 'weapon3': '1.556', 'DAMAGECOUNT': '4.902', 'FRAGCOUNT': '12.000'} [2023-02-24 18:58:35,679][177155] DAMAGECOUNT value on done: 230613.0 [2023-02-24 18:58:35,679][177155] Sum rewards: 25.605, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.330', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.012', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'weapon5': '0.168', 'weapon4': '0.204', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'weapon2': '1.064', 'HITCOUNT': '1.680', 'weapon3': '2.058', 'DAMAGECOUNT': '7.269', 'FRAGCOUNT': '22.000'} [2023-02-24 18:58:36,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 80142336. Throughput: 0: 3465.1. Samples: 20029618. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 18:58:36,376][177119] Avg episode reward: [(0, '12.853')] [2023-02-24 18:58:37,431][177153] Updated weights for policy 0, policy_version 19570 (0.0008) [2023-02-24 18:58:40,407][177153] Updated weights for policy 0, policy_version 19580 (0.0009) [2023-02-24 18:58:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 80211968. Throughput: 0: 3464.4. Samples: 20050336. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:58:41,376][177119] Avg episode reward: [(0, '12.853')] [2023-02-24 18:58:43,348][177153] Updated weights for policy 0, policy_version 19590 (0.0008) [2023-02-24 18:58:43,629][177156] DAMAGECOUNT value on done: 239628.0 [2023-02-24 18:58:43,630][177156] Sum rewards: 14.703, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.505', 'AMMO5': '0.007', 'AMMO2': '0.044', 'AMMO3': '0.077', 'weapon5': '0.088', 'WEAPON5': '0.200', 'AMMO4': '0.220', 'WEAPON4': '0.500', 'WEAPON3': '0.600', 'weapon4': '0.792', 'HITCOUNT': '1.040', 'weapon2': '1.086', 'weapon3': '1.510', 'DAMAGECOUNT': '4.293', 'FRAGCOUNT': '14.000'} [2023-02-24 18:58:43,638][177156] DAMAGECOUNT value on done: 235141.0 [2023-02-24 18:58:43,638][177156] Sum rewards: 11.197, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.586', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'weapon7': '0.052', 'AMMO4': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.124', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.272', 'ARMOR': '0.400', 'HITCOUNT': '0.570', 'weapon2': '0.814', 'WEAPON3': '0.850', 'weapon3': '1.400', 'DAMAGECOUNT': '2.871', 'FRAGCOUNT': '12.000'} [2023-02-24 18:58:43,937][177156] DAMAGECOUNT value on done: 245500.0 [2023-02-24 18:58:43,937][177156] Sum rewards: 21.247, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.550', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon7': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.129', 'weapon5': '0.136', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.452', 'weapon4': '0.540', 'weapon2': '0.686', 'WEAPON3': '0.900', 'HITCOUNT': '1.550', 'weapon3': '2.178', 'DAMAGECOUNT': '6.390', 'FRAGCOUNT': '17.000'} [2023-02-24 18:58:43,950][177156] DAMAGECOUNT value on done: 235762.0 [2023-02-24 18:58:43,950][177156] Sum rewards: 13.528, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.280', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'AMMO3': '0.064', 'weapon7': '0.144', 'AMMO4': '0.160', 'weapon5': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'weapon4': '0.366', 'WEAPON7': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.780', 'weapon2': '0.792', 'weapon3': '1.506', 'DAMAGECOUNT': '3.672', 'FRAGCOUNT': '11.000'} [2023-02-24 18:58:44,316][177170] DAMAGECOUNT value on done: 240401.0 [2023-02-24 18:58:44,316][177170] Sum rewards: 6.028, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.394', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO4': '0.076', 'AMMO3': '0.110', 'weapon5': '0.174', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'ARMOR': '0.500', 'weapon4': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '0.650', 'weapon2': '0.884', 'weapon3': '1.410', 'DAMAGECOUNT': '2.913', 'FRAGCOUNT': '7.000'} [2023-02-24 18:58:44,614][177170] DAMAGECOUNT value on done: 246805.0 [2023-02-24 18:58:44,615][177170] Sum rewards: 11.548, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.472', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.010', 'AMMO3': '0.086', 'weapon7': '0.116', 'WEAPON5': '0.150', 'weapon5': '0.168', 'WEAPON4': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'ARMOR': '0.454', 'weapon4': '0.534', 'WEAPON3': '0.650', 'HITCOUNT': '0.740', 'weapon2': '1.096', 'weapon3': '1.688', 'DAMAGECOUNT': '3.528', 'FRAGCOUNT': '10.000'} [2023-02-24 18:58:45,135][177170] DAMAGECOUNT value on done: 238788.0 [2023-02-24 18:58:45,136][177170] Sum rewards: 9.943, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.956', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon7': '0.054', 'AMMO3': '0.070', 'AMMO4': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.192', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.246', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.742', 'HITCOUNT': '0.900', 'weapon3': '1.102', 'DAMAGECOUNT': '4.332', 'FRAGCOUNT': '8.000'} [2023-02-24 18:58:45,436][177170] DAMAGECOUNT value on done: 239319.0 [2023-02-24 18:58:45,437][177170] Sum rewards: 15.403, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.082', 'AMMO5': '0.015', 'AMMO2': '0.031', 'WEAPON1': '0.050', 'AMMO3': '0.074', 'AMMO4': '0.156', 'weapon5': '0.288', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon4': '0.530', 'HITCOUNT': '0.720', 'weapon2': '1.004', 'weapon3': '1.530', 'DAMAGECOUNT': '4.386', 'FRAGCOUNT': '11.000'} [2023-02-24 18:58:45,840][177158] DAMAGECOUNT value on done: 230620.0 [2023-02-24 18:58:45,841][177158] Sum rewards: 13.149, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.211', 'AMMO2': '0.008', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.037', 'weapon5': '0.070', 'AMMO3': '0.109', 'weapon4': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'HITCOUNT': '1.090', 'weapon2': '1.262', 'weapon3': '2.068', 'DAMAGECOUNT': '4.089', 'FRAGCOUNT': '13.000'} [2023-02-24 18:58:46,145][177158] DAMAGECOUNT value on done: 234339.0 [2023-02-24 18:58:46,145][177158] Sum rewards: 2.119, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.736', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.056', 'AMMO3': '0.064', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.195', 'WEAPON5': '0.200', 'weapon2': '0.272', 'WEAPON3': '0.300', 'HITCOUNT': '0.340', 'WEAPON4': '0.450', 'weapon3': '0.462', 'weapon4': '0.772', 'ARMOR': '0.894', 'DAMAGECOUNT': '1.428', 'FRAGCOUNT': '3.000'} [2023-02-24 18:58:46,325][177153] Updated weights for policy 0, policy_version 19600 (0.0009) [2023-02-24 18:58:46,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 80281600. Throughput: 0: 3461.6. Samples: 20071104. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:58:46,376][177119] Avg episode reward: [(0, '12.711')] [2023-02-24 18:58:46,391][177154] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 18:58:46,857][177158] DAMAGECOUNT value on done: 243841.0 [2023-02-24 18:58:46,858][177158] Sum rewards: 12.090, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.610', 'AMMO5': '0.012', 'AMMO2': '0.023', 'WEAPON1': '0.060', 'AMMO4': '0.113', 'AMMO3': '0.125', 'weapon5': '0.198', 'WEAPON4': '0.250', 'weapon4': '0.342', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'HITCOUNT': '0.900', 'weapon2': '1.150', 'weapon3': '1.866', 'DAMAGECOUNT': '4.710', 'FRAGCOUNT': '11.000'} [2023-02-24 18:58:47,161][177158] DAMAGECOUNT value on done: 238925.0 [2023-02-24 18:58:47,161][177158] Sum rewards: 11.103, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.620', 'AMMO5': '0.009', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'weapon7': '0.052', 'AMMO3': '0.059', 'AMMO4': '0.062', 'weapon5': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'weapon2': '0.356', 'HITCOUNT': '0.620', 'weapon4': '0.626', 'weapon3': '0.936', 'DAMAGECOUNT': '3.048', 'FRAGCOUNT': '9.000'} [2023-02-24 18:58:49,282][177153] Updated weights for policy 0, policy_version 19610 (0.0008) [2023-02-24 18:58:49,761][177172] DAMAGECOUNT value on done: 237546.0 [2023-02-24 18:58:49,761][177172] Sum rewards: 7.146, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.050', 'AMMO5': '0.011', 'weapon5': '0.024', 'AMMO2': '0.029', 'WEAPON1': '0.040', 'weapon7': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.141', 'AMMO4': '0.145', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.406', 'weapon2': '0.624', 'HITCOUNT': '0.790', 'WEAPON3': '0.950', 'weapon3': '1.758', 'DAMAGECOUNT': '3.342', 'FRAGCOUNT': '9.000'} [2023-02-24 18:58:50,059][177172] DAMAGECOUNT value on done: 232759.0 [2023-02-24 18:58:50,059][177172] Sum rewards: 4.248, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.344', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.048', 'WEAPON1': '0.070', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.160', 'WEAPON4': '0.350', 'ARMOR': '0.468', 'HITCOUNT': '0.560', 'weapon4': '0.682', 'weapon2': '0.854', 'WEAPON3': '1.000', 'weapon3': '1.474', 'DAMAGECOUNT': '2.463', 'FRAGCOUNT': '8.000'} [2023-02-24 18:58:51,035][177171] Large shaping reward 2.640 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-24 18:58:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 80351232. Throughput: 0: 3462.8. Samples: 20081506. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:58:51,376][177119] Avg episode reward: [(0, '12.528')] [2023-02-24 18:58:51,450][177154] DAMAGECOUNT value on done: 242165.0 [2023-02-24 18:58:51,451][177154] Sum rewards: 18.645, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.115', 'AMMO2': '0.009', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.044', 'AMMO3': '0.154', 'weapon5': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.454', 'ARMOR': '0.457', 'weapon2': '0.802', 'WEAPON3': '1.050', 'HITCOUNT': '1.410', 'weapon3': '2.044', 'DAMAGECOUNT': '6.306', 'FRAGCOUNT': '17.000'} [2023-02-24 18:58:51,558][177172] DAMAGECOUNT value on done: 244018.0 [2023-02-24 18:58:51,558][177172] Sum rewards: 21.257, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.012', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon5': '0.052', 'AMMO3': '0.173', 'WEAPON5': '0.250', 'weapon2': '0.724', 'WEAPON3': '1.150', 'HITCOUNT': '1.520', 'weapon3': '2.870', 'DAMAGECOUNT': '6.285', 'FRAGCOUNT': '20.000'} [2023-02-24 18:58:51,753][177154] DAMAGECOUNT value on done: 247482.0 [2023-02-24 18:58:51,754][177154] Sum rewards: 18.584, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.040', 'AMMO3': '0.060', 'weapon5': '0.124', 'WEAPON4': '0.150', 'AMMO4': '0.200', 'weapon4': '0.234', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'HEALTH': '0.512', 'HITCOUNT': '1.060', 'weapon3': '1.404', 'weapon2': '1.894', 'DAMAGECOUNT': '4.365', 'FRAGCOUNT': '12.000'} [2023-02-24 18:58:51,863][177172] DAMAGECOUNT value on done: 235843.0 [2023-02-24 18:58:51,863][177172] Sum rewards: 19.109, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.972', 'ARMOR': '0.004', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'AMMO5': '0.031', 'AMMO4': '0.132', 'AMMO3': '0.138', 'weapon5': '0.260', 'weapon4': '0.504', 'WEAPON4': '0.550', 'WEAPON5': '0.750', 'weapon2': '0.810', 'WEAPON3': '1.050', 'HITCOUNT': '1.410', 'weapon3': '1.996', 'DAMAGECOUNT': '6.639', 'FRAGCOUNT': '20.000'} [2023-02-24 18:58:52,060][177154] DAMAGECOUNT value on done: 252409.0 [2023-02-24 18:58:52,060][177154] Sum rewards: 4.055, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.206', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.063', 'AMMO4': '0.117', 'weapon5': '0.230', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.452', 'HITCOUNT': '0.600', 'weapon3': '1.462', 'weapon2': '1.522', 'DAMAGECOUNT': '2.307', 'FRAGCOUNT': '4.000'} [2023-02-24 18:58:52,256][177153] Updated weights for policy 0, policy_version 19620 (0.0008) [2023-02-24 18:58:52,362][177154] DAMAGECOUNT value on done: 243881.0 [2023-02-24 18:58:52,363][177154] Sum rewards: 18.423, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.605', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.010', 'WEAPON1': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.102', 'AMMO3': '0.114', 'weapon4': '0.202', 'WEAPON5': '0.300', 'ARMOR': '0.489', 'WEAPON3': '0.950', 'HITCOUNT': '1.030', 'weapon2': '1.340', 'weapon3': '1.950', 'DAMAGECOUNT': '4.917', 'FRAGCOUNT': '17.000'} [2023-02-24 18:58:52,535][177157] DAMAGECOUNT value on done: 231531.0 [2023-02-24 18:58:52,535][177157] Sum rewards: 11.683, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.648', 'AMMO2': '0.012', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.059', 'AMMO3': '0.070', 'weapon7': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.270', 'weapon4': '0.330', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'weapon2': '0.632', 'HITCOUNT': '0.770', 'weapon3': '1.552', 'DAMAGECOUNT': '2.889', 'FRAGCOUNT': '9.000'} [2023-02-24 18:58:52,544][177157] DAMAGECOUNT value on done: 249279.0 [2023-02-24 18:58:52,545][177157] Sum rewards: 6.391, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.400', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.038', 'weapon7': '0.062', 'AMMO3': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.140', 'AMMO4': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.460', 'weapon4': '0.584', 'weapon2': '0.868', 'weapon3': '1.034', 'DAMAGECOUNT': '2.448', 'FRAGCOUNT': '7.000'} [2023-02-24 18:58:52,565][177171] DAMAGECOUNT value on done: 236244.0 [2023-02-24 18:58:52,566][177171] Sum rewards: 15.293, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.762', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO3': '0.086', 'AMMO4': '0.183', 'weapon5': '0.210', 'WEAPON5': '0.400', 'weapon4': '0.416', 'ARMOR': '0.437', 'WEAPON4': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '1.120', 'weapon2': '1.166', 'weapon3': '1.830', 'DAMAGECOUNT': '5.295', 'FRAGCOUNT': '13.000'} [2023-02-24 18:58:52,835][177157] DAMAGECOUNT value on done: 236014.0 [2023-02-24 18:58:52,835][177157] Sum rewards: 18.630, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.311', 'AMMO2': '0.010', 'AMMO5': '0.023', 'WEAPON1': '0.030', 'AMMO4': '0.051', 'AMMO3': '0.135', 'weapon5': '0.288', 'WEAPON4': '0.300', 'weapon4': '0.414', 'ARMOR': '0.457', 'WEAPON5': '0.550', 'weapon2': '0.620', 'WEAPON3': '0.950', 'HITCOUNT': '1.350', 'weapon3': '1.964', 'DAMAGECOUNT': '5.799', 'FRAGCOUNT': '17.000'} [2023-02-24 18:58:52,844][177171] DAMAGECOUNT value on done: 237557.0 [2023-02-24 18:58:52,844][177171] Sum rewards: 11.329, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.580', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon5': '0.036', 'AMMO4': '0.103', 'weapon4': '0.138', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.700', 'HITCOUNT': '0.980', 'weapon2': '1.078', 'weapon3': '1.936', 'DAMAGECOUNT': '4.200', 'FRAGCOUNT': '10.500'} [2023-02-24 18:58:52,848][177157] DAMAGECOUNT value on done: 232936.0 [2023-02-24 18:58:52,848][177157] Sum rewards: 13.940, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.420', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.018', 'WEAPON1': '0.060', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'weapon4': '0.150', 'weapon5': '0.244', 'WEAPON5': '0.400', 'ARMOR': '0.439', 'WEAPON3': '0.650', 'HITCOUNT': '1.050', 'weapon2': '1.492', 'weapon3': '1.626', 'DAMAGECOUNT': '4.095', 'FRAGCOUNT': '9.500'} [2023-02-24 18:58:52,873][177171] DAMAGECOUNT value on done: 243344.0 [2023-02-24 18:58:52,874][177171] Sum rewards: 15.365, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.370', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO4': '0.033', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'weapon5': '0.212', 'weapon4': '0.294', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.920', 'weapon2': '1.258', 'weapon3': '1.384', 'DAMAGECOUNT': '4.311', 'FRAGCOUNT': '13.000'} [2023-02-24 18:58:53,161][177171] DAMAGECOUNT value on done: 236504.0 [2023-02-24 18:58:53,162][177171] Sum rewards: 9.498, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.135', 'AMMO2': '0.007', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.032', 'weapon4': '0.038', 'WEAPON4': '0.050', 'AMMO3': '0.084', 'weapon5': '0.276', 'WEAPON5': '0.400', 'ARMOR': '0.468', 'HITCOUNT': '0.500', 'WEAPON3': '0.600', 'weapon3': '1.204', 'weapon2': '1.536', 'DAMAGECOUNT': '2.901', 'FRAGCOUNT': '7.000'} [2023-02-24 18:58:54,246][177155] DAMAGECOUNT value on done: 238232.0 [2023-02-24 18:58:54,247][177155] Sum rewards: 12.966, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.130', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.076', 'weapon5': '0.286', 'WEAPON5': '0.500', 'HITCOUNT': '0.520', 'WEAPON3': '0.550', 'weapon2': '1.050', 'weapon3': '1.626', 'DAMAGECOUNT': '3.219', 'FRAGCOUNT': '10.000'} [2023-02-24 18:58:54,556][177155] DAMAGECOUNT value on done: 247386.0 [2023-02-24 18:58:54,556][177155] Sum rewards: 10.875, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.592', 'AMMO5': '0.010', 'AMMO2': '0.037', 'WEAPON1': '0.050', 'weapon7': '0.066', 'AMMO3': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.185', 'weapon5': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.418', 'weapon2': '0.590', 'WEAPON3': '0.650', 'HITCOUNT': '0.900', 'weapon3': '1.524', 'DAMAGECOUNT': '3.879', 'FRAGCOUNT': '11.000'} [2023-02-24 18:58:54,879][177155] DAMAGECOUNT value on done: 244520.0 [2023-02-24 18:58:54,880][177155] Sum rewards: 8.728, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.672', 'AMMO5': '0.012', 'AMMO2': '0.023', 'WEAPON1': '0.050', 'AMMO3': '0.097', 'AMMO4': '0.117', 'WEAPON4': '0.200', 'weapon5': '0.230', 'weapon4': '0.298', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'HITCOUNT': '0.840', 'weapon2': '1.320', 'weapon3': '1.784', 'DAMAGECOUNT': '3.678', 'FRAGCOUNT': '8.000'} [2023-02-24 18:58:55,175][177155] DAMAGECOUNT value on done: 232084.0 [2023-02-24 18:58:55,175][177155] Sum rewards: 12.599, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.118', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.077', 'AMMO4': '0.115', 'weapon5': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'weapon4': '0.892', 'HITCOUNT': '0.980', 'weapon2': '1.070', 'weapon3': '1.392', 'DAMAGECOUNT': '4.413', 'FRAGCOUNT': '10.000'} [2023-02-24 18:58:55,260][177153] Updated weights for policy 0, policy_version 19630 (0.0008) [2023-02-24 18:58:56,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 80416768. Throughput: 0: 3458.7. Samples: 20102154. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:58:56,376][177119] Avg episode reward: [(0, '12.793')] [2023-02-24 18:58:56,381][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000019633_80416768.pth... [2023-02-24 18:58:56,447][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000018821_77090816.pth [2023-02-24 18:58:58,211][177153] Updated weights for policy 0, policy_version 19640 (0.0009) [2023-02-24 18:59:01,194][177153] Updated weights for policy 0, policy_version 19650 (0.0008) [2023-02-24 18:59:01,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 80486400. Throughput: 0: 3456.2. Samples: 20122876. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 18:59:01,376][177119] Avg episode reward: [(0, '12.793')] [2023-02-24 18:59:03,173][177156] DAMAGECOUNT value on done: 241030.0 [2023-02-24 18:59:03,173][177156] Sum rewards: 11.914, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.218', 'AMMO5': '0.017', 'AMMO2': '0.022', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.106', 'AMMO4': '0.108', 'AMMO3': '0.133', 'WEAPON5': '0.300', 'weapon4': '0.306', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'weapon2': '0.804', 'HITCOUNT': '0.910', 'weapon3': '2.064', 'DAMAGECOUNT': '4.206', 'FRAGCOUNT': '10.500'} [2023-02-24 18:59:03,184][177156] DAMAGECOUNT value on done: 236551.0 [2023-02-24 18:59:03,184][177156] Sum rewards: 12.374, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.365', 'AMMO2': '0.020', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'weapon7': '0.044', 'AMMO4': '0.098', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.107', 'weapon5': '0.254', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.584', 'weapon4': '0.594', 'WEAPON3': '0.850', 'HITCOUNT': '1.000', 'weapon3': '1.986', 'DAMAGECOUNT': '4.230', 'FRAGCOUNT': '12.000'} [2023-02-24 18:59:03,491][177156] DAMAGECOUNT value on done: 247327.0 [2023-02-24 18:59:03,491][177156] Sum rewards: 22.678, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.322', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'weapon4': '0.014', 'AMMO5': '0.014', 'AMMO4': '0.064', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.226', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '1.290', 'weapon2': '1.638', 'weapon3': '1.860', 'DAMAGECOUNT': '5.481', 'FRAGCOUNT': '18.000'} [2023-02-24 18:59:03,502][177156] DAMAGECOUNT value on done: 237763.0 [2023-02-24 18:59:03,502][177156] Sum rewards: 15.793, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.140', 'ARMOR': '0.004', 'AMMO2': '0.017', 'AMMO5': '0.021', 'WEAPON1': '0.040', 'AMMO4': '0.086', 'AMMO3': '0.119', 'weapon5': '0.304', 'weapon2': '0.598', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '0.850', 'weapon4': '0.930', 'HITCOUNT': '1.390', 'weapon3': '1.570', 'DAMAGECOUNT': '6.003', 'FRAGCOUNT': '17.000'} [2023-02-24 18:59:03,720][177170] DAMAGECOUNT value on done: 241424.0 [2023-02-24 18:59:03,720][177170] Sum rewards: 11.428, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.086', 'AMMO3': '0.097', 'weapon5': '0.206', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HEALTH': '0.704', 'HITCOUNT': '0.890', 'weapon2': '1.198', 'weapon3': '1.866', 'DAMAGECOUNT': '3.069', 'FRAGCOUNT': '8.000'} [2023-02-24 18:59:04,022][177170] DAMAGECOUNT value on done: 247820.0 [2023-02-24 18:59:04,023][177170] Sum rewards: 8.582, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.114', 'AMMO2': '0.020', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'AMMO3': '0.086', 'AMMO4': '0.097', 'weapon5': '0.184', 'WEAPON4': '0.300', 'weapon4': '0.416', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '0.770', 'weapon2': '1.218', 'weapon3': '1.500', 'DAMAGECOUNT': '3.045', 'FRAGCOUNT': '8.500'} [2023-02-24 18:59:04,176][177153] Updated weights for policy 0, policy_version 19660 (0.0008) [2023-02-24 18:59:04,552][177170] DAMAGECOUNT value on done: 240518.0 [2023-02-24 18:59:04,552][177170] Sum rewards: 19.598, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.728', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon5': '0.044', 'AMMO3': '0.081', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'WEAPON3': '0.550', 'weapon4': '0.722', 'weapon2': '0.864', 'HITCOUNT': '1.310', 'weapon3': '1.348', 'DAMAGECOUNT': '5.190', 'FRAGCOUNT': '15.000'} [2023-02-24 18:59:04,865][177170] DAMAGECOUNT value on done: 240895.0 [2023-02-24 18:59:04,866][177170] Sum rewards: 15.897, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.138', 'AMMO2': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO4': '0.033', 'AMMO3': '0.103', 'weapon4': '0.114', 'WEAPON4': '0.150', 'weapon5': '0.188', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '0.890', 'weapon2': '1.318', 'weapon3': '1.764', 'DAMAGECOUNT': '4.728', 'FRAGCOUNT': '13.000'} [2023-02-24 18:59:05,343][177158] DAMAGECOUNT value on done: 232395.0 [2023-02-24 18:59:05,343][177158] Sum rewards: 20.145, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.710', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO3': '0.090', 'weapon5': '0.158', 'WEAPON5': '0.400', 'ARMOR': '0.473', 'WEAPON3': '0.650', 'HITCOUNT': '1.110', 'weapon2': '1.630', 'weapon3': '1.770', 'DAMAGECOUNT': '5.325', 'FRAGCOUNT': '16.000'} [2023-02-24 18:59:05,634][177158] DAMAGECOUNT value on done: 235627.0 [2023-02-24 18:59:05,635][177158] Sum rewards: 14.884, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.272', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.044', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.126', 'weapon5': '0.128', 'AMMO4': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.324', 'weapon4': '0.698', 'WEAPON3': '0.750', 'HITCOUNT': '1.060', 'weapon3': '1.998', 'DAMAGECOUNT': '3.864', 'FRAGCOUNT': '14.000'} [2023-02-24 18:59:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 80556032. Throughput: 0: 3455.9. Samples: 20133274. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:59:06,376][177119] Avg episode reward: [(0, '12.815')] [2023-02-24 18:59:06,400][177158] DAMAGECOUNT value on done: 245649.0 [2023-02-24 18:59:06,400][177158] Sum rewards: 18.648, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.802', 'AMMO2': '0.019', 'AMMO5': '0.022', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO4': '0.095', 'AMMO3': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.150', 'WEAPON7': '0.200', 'ARMOR': '0.404', 'WEAPON5': '0.450', 'weapon4': '0.538', 'WEAPON3': '0.800', 'weapon2': '0.822', 'HITCOUNT': '1.340', 'weapon3': '1.590', 'DAMAGECOUNT': '5.424', 'FRAGCOUNT': '16.000'} [2023-02-24 18:59:06,703][177158] DAMAGECOUNT value on done: 241245.0 [2023-02-24 18:59:06,703][177158] Sum rewards: 24.064, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.080', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO5': '0.025', 'AMMO4': '0.106', 'AMMO3': '0.136', 'WEAPON4': '0.350', 'weapon5': '0.390', 'weapon4': '0.448', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'weapon2': '0.854', 'HITCOUNT': '1.370', 'weapon3': '1.858', 'DAMAGECOUNT': '6.915', 'FRAGCOUNT': '21.000'} [2023-02-24 18:59:07,124][177153] Updated weights for policy 0, policy_version 19670 (0.0008) [2023-02-24 18:59:09,099][177172] DAMAGECOUNT value on done: 238648.0 [2023-02-24 18:59:09,099][177172] Sum rewards: 11.529, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.147', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.005', 'weapon7': '0.056', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'ARMOR': '0.468', 'WEAPON3': '0.650', 'HITCOUNT': '0.940', 'weapon2': '1.622', 'weapon3': '1.636', 'DAMAGECOUNT': '3.306', 'FRAGCOUNT': '9.000'} [2023-02-24 18:59:09,394][177172] DAMAGECOUNT value on done: 233189.0 [2023-02-24 18:59:09,394][177172] Sum rewards: 4.535, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO3': '0.030', 'AMMO4': '0.050', 'weapon7': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HEALTH': '0.122', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.228', 'HITCOUNT': '0.350', 'weapon3': '0.714', 'DAMAGECOUNT': '1.290', 'weapon2': '1.694', 'FRAGCOUNT': '2.000'} [2023-02-24 18:59:10,053][177153] Updated weights for policy 0, policy_version 19680 (0.0008) [2023-02-24 18:59:10,748][177154] DAMAGECOUNT value on done: 242654.0 [2023-02-24 18:59:10,749][177154] Sum rewards: 3.580, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.814', 'AMMO5': '0.013', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.020', 'weapon7': '0.058', 'AMMO3': '0.069', 'AMMO4': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'HITCOUNT': '0.320', 'weapon4': '0.426', 'WEAPON3': '0.500', 'weapon2': '0.626', 'weapon3': '1.096', 'DAMAGECOUNT': '1.467', 'FRAGCOUNT': '4.000'} [2023-02-24 18:59:10,853][177172] DAMAGECOUNT value on done: 246106.0 [2023-02-24 18:59:10,853][177172] Sum rewards: 24.981, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.145', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO3': '0.076', 'WEAPON4': '0.150', 'AMMO4': '0.172', 'WEAPON5': '0.300', 'weapon5': '0.314', 'ARMOR': '0.404', 'WEAPON3': '0.550', 'weapon4': '0.572', 'weapon2': '1.054', 'HITCOUNT': '1.430', 'weapon3': '1.540', 'DAMAGECOUNT': '6.264', 'FRAGCOUNT': '19.000'} [2023-02-24 18:59:11,048][177154] DAMAGECOUNT value on done: 248768.0 [2023-02-24 18:59:11,048][177154] Sum rewards: 12.453, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.292', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.102', 'weapon4': '0.282', 'weapon5': '0.308', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'HITCOUNT': '0.770', 'weapon2': '0.914', 'weapon3': '1.824', 'DAMAGECOUNT': '3.858', 'FRAGCOUNT': '9.500'} [2023-02-24 18:59:11,150][177172] DAMAGECOUNT value on done: 236524.0 [2023-02-24 18:59:11,151][177172] Sum rewards: 8.691, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.700', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.015', 'AMMO3': '0.048', 'WEAPON4': '0.100', 'weapon7': '0.100', 'weapon5': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.208', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.480', 'weapon3': '0.740', 'weapon2': '1.248', 'DAMAGECOUNT': '2.043', 'FRAGCOUNT': '6.000'} [2023-02-24 18:59:11,335][177154] DAMAGECOUNT value on done: 253226.0 [2023-02-24 18:59:11,335][177154] Sum rewards: 9.570, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.045', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.134', 'HEALTH': '0.145', 'WEAPON5': '0.150', 'weapon4': '0.192', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'HITCOUNT': '0.640', 'weapon3': '0.880', 'weapon2': '0.994', 'DAMAGECOUNT': '2.436', 'FRAGCOUNT': '6.000'} [2023-02-24 18:59:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.2, 300 sec: 13870.9). Total num frames: 80625664. Throughput: 0: 3462.4. Samples: 20154206. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:59:11,376][177119] Avg episode reward: [(0, '13.087')] [2023-02-24 18:59:11,629][177154] DAMAGECOUNT value on done: 245409.0 [2023-02-24 18:59:11,629][177154] Sum rewards: 13.566, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.328', 'AMMO5': '0.015', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.114', 'weapon5': '0.116', 'WEAPON5': '0.300', 'weapon4': '0.324', 'WEAPON3': '0.700', 'weapon2': '0.944', 'HITCOUNT': '1.180', 'weapon3': '2.112', 'DAMAGECOUNT': '4.584', 'FRAGCOUNT': '10.000'} [2023-02-24 18:59:11,941][177157] DAMAGECOUNT value on done: 250735.0 [2023-02-24 18:59:11,942][177157] Sum rewards: 11.880, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.308', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO5': '0.024', 'ARMOR': '0.028', 'AMMO3': '0.083', 'AMMO4': '0.084', 'weapon4': '0.182', 'WEAPON4': '0.200', 'weapon5': '0.450', 'WEAPON3': '0.550', 'WEAPON5': '0.550', 'HITCOUNT': '0.890', 'weapon3': '1.376', 'weapon2': '1.626', 'DAMAGECOUNT': '4.368', 'FRAGCOUNT': '9.500'} [2023-02-24 18:59:11,943][177171] DAMAGECOUNT value on done: 237629.0 [2023-02-24 18:59:11,944][177171] Sum rewards: 10.721, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.932', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.039', 'AMMO3': '0.092', 'AMMO4': '0.194', 'weapon5': '0.374', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'weapon2': '0.670', 'HITCOUNT': '0.920', 'weapon4': '0.982', 'weapon3': '1.368', 'DAMAGECOUNT': '3.567', 'FRAGCOUNT': '10.000'} [2023-02-24 18:59:11,953][177157] DAMAGECOUNT value on done: 233300.0 [2023-02-24 18:59:11,953][177157] Sum rewards: 17.507, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.591', 'ARMOR': '0.004', 'AMMO2': '0.017', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.085', 'AMMO3': '0.120', 'weapon4': '0.174', 'weapon5': '0.220', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'weapon2': '0.874', 'HITCOUNT': '1.260', 'weapon3': '2.086', 'DAMAGECOUNT': '5.307', 'FRAGCOUNT': '14.000'} [2023-02-24 18:59:12,239][177171] DAMAGECOUNT value on done: 244254.0 [2023-02-24 18:59:12,240][177171] Sum rewards: 10.677, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.210', 'AMMO2': '0.010', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'AMMO4': '0.049', 'AMMO3': '0.088', 'WEAPON4': '0.150', 'weapon5': '0.208', 'weapon4': '0.304', 'WEAPON5': '0.400', 'HITCOUNT': '0.680', 'WEAPON3': '0.700', 'weapon2': '1.156', 'weapon3': '1.610', 'DAMAGECOUNT': '2.730', 'FRAGCOUNT': '9.000'} [2023-02-24 18:59:12,244][177157] DAMAGECOUNT value on done: 234470.0 [2023-02-24 18:59:12,245][177157] Sum rewards: 17.236, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.626', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'weapon7': '0.050', 'AMMO3': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.440', 'WEAPON3': '0.650', 'HITCOUNT': '1.180', 'weapon3': '1.466', 'weapon2': '1.478', 'DAMAGECOUNT': '4.602', 'FRAGCOUNT': '13.000'} [2023-02-24 18:59:12,254][177171] DAMAGECOUNT value on done: 238857.0 [2023-02-24 18:59:12,254][177171] Sum rewards: 13.760, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.010', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'AMMO3': '0.133', 'weapon5': '0.184', 'WEAPON5': '0.250', 'weapon4': '0.296', 'HEALTH': '0.330', 'WEAPON3': '0.700', 'HITCOUNT': '0.880', 'weapon2': '0.964', 'weapon3': '2.114', 'DAMAGECOUNT': '3.900', 'FRAGCOUNT': '12.000'} [2023-02-24 18:59:12,255][177157] DAMAGECOUNT value on done: 236669.0 [2023-02-24 18:59:12,256][177157] Sum rewards: 3.216, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.730', 'AMMO5': '0.017', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'AMMO3': '0.055', 'AMMO4': '0.099', 'weapon7': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.454', 'weapon4': '0.484', 'HITCOUNT': '0.630', 'weapon3': '0.792', 'DAMAGECOUNT': '1.965', 'FRAGCOUNT': '3.000'} [2023-02-24 18:59:12,556][177171] DAMAGECOUNT value on done: 238083.0 [2023-02-24 18:59:12,557][177171] Sum rewards: 11.783, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.170', 'WEAPON1': '0.010', 'weapon7': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.040', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.116', 'AMMO4': '0.198', 'weapon5': '0.250', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.580', 'weapon4': '0.638', 'WEAPON3': '0.700', 'HITCOUNT': '1.390', 'weapon3': '2.016', 'DAMAGECOUNT': '4.737', 'FRAGCOUNT': '11.000'} [2023-02-24 18:59:13,024][177153] Updated weights for policy 0, policy_version 19690 (0.0008) [2023-02-24 18:59:13,612][177155] DAMAGECOUNT value on done: 239496.0 [2023-02-24 18:59:13,613][177155] Sum rewards: 9.219, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.702', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'AMMO5': '0.007', 'weapon4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'weapon5': '0.192', 'WEAPON5': '0.300', 'WEAPON3': '0.900', 'HITCOUNT': '1.070', 'weapon2': '1.466', 'weapon3': '1.702', 'DAMAGECOUNT': '3.792', 'FRAGCOUNT': '8.000'} [2023-02-24 18:59:13,913][177155] DAMAGECOUNT value on done: 249379.0 [2023-02-24 18:59:13,913][177155] Sum rewards: 20.986, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.228', 'AMMO2': '0.006', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.032', 'weapon7': '0.050', 'AMMO3': '0.137', 'weapon5': '0.152', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.900', 'HITCOUNT': '1.030', 'weapon2': '1.232', 'weapon3': '1.852', 'DAMAGECOUNT': '5.079', 'FRAGCOUNT': '18.000'} [2023-02-24 18:59:14,319][177155] DAMAGECOUNT value on done: 245779.0 [2023-02-24 18:59:14,320][177155] Sum rewards: 13.237, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.585', 'AMMO2': '0.010', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.047', 'AMMO3': '0.060', 'weapon5': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.244', 'WEAPON5': '0.250', 'weapon7': '0.288', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON3': '0.450', 'WEAPON7': '0.500', 'HITCOUNT': '0.860', 'weapon3': '1.428', 'weapon2': '1.438', 'DAMAGECOUNT': '3.777', 'FRAGCOUNT': '8.000'} [2023-02-24 18:59:14,618][177155] DAMAGECOUNT value on done: 233601.0 [2023-02-24 18:59:14,619][177155] Sum rewards: 15.708, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.728', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.030', 'WEAPON1': '0.040', 'weapon7': '0.068', 'weapon5': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.103', 'AMMO4': '0.149', 'weapon2': '0.430', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '0.650', 'weapon4': '1.036', 'HITCOUNT': '1.300', 'weapon3': '1.718', 'DAMAGECOUNT': '4.551', 'FRAGCOUNT': '14.000'} [2023-02-24 18:59:15,941][177153] Updated weights for policy 0, policy_version 19700 (0.0008) [2023-02-24 18:59:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 80695296. Throughput: 0: 3463.0. Samples: 20175090. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:59:16,376][177119] Avg episode reward: [(0, '13.257')] [2023-02-24 18:59:18,887][177153] Updated weights for policy 0, policy_version 19710 (0.0008) [2023-02-24 18:59:19,818][177155] Large shaping reward 2.596 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5640000000000001, 188.0), ('weapon7', 0.002)] [2023-02-24 18:59:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 80764928. Throughput: 0: 3463.7. Samples: 20185484. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:59:21,376][177119] Avg episode reward: [(0, '13.257')] [2023-02-24 18:59:21,843][177153] Updated weights for policy 0, policy_version 19720 (0.0008) [2023-02-24 18:59:22,530][177156] DAMAGECOUNT value on done: 242636.0 [2023-02-24 18:59:22,530][177156] Sum rewards: 19.081, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.141', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.040', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.136', 'weapon4': '0.140', 'weapon5': '0.164', 'WEAPON5': '0.300', 'WEAPON3': '0.950', 'HITCOUNT': '1.120', 'weapon2': '1.154', 'weapon3': '2.190', 'DAMAGECOUNT': '4.818', 'FRAGCOUNT': '17.000'} [2023-02-24 18:59:22,603][177156] DAMAGECOUNT value on done: 238332.0 [2023-02-24 18:59:22,604][177156] Sum rewards: 20.037, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.245', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.022', 'AMMO4': '0.060', 'weapon7': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.800', 'HITCOUNT': '1.080', 'weapon2': '1.776', 'weapon3': '1.802', 'DAMAGECOUNT': '5.298', 'FRAGCOUNT': '17.000'} [2023-02-24 18:59:22,851][177156] DAMAGECOUNT value on done: 248650.0 [2023-02-24 18:59:22,851][177156] Sum rewards: 13.605, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.344', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon4': '0.054', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.147', 'weapon5': '0.156', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'HITCOUNT': '0.940', 'WEAPON3': '0.950', 'weapon2': '1.104', 'weapon3': '1.738', 'DAMAGECOUNT': '3.969', 'FRAGCOUNT': '14.000'} [2023-02-24 18:59:22,911][177156] DAMAGECOUNT value on done: 239248.0 [2023-02-24 18:59:22,911][177156] Sum rewards: 12.708, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.140', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon7': '0.046', 'weapon5': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.696', 'WEAPON3': '0.850', 'HITCOUNT': '0.930', 'weapon3': '1.578', 'DAMAGECOUNT': '4.455', 'FRAGCOUNT': '12.000'} [2023-02-24 18:59:23,049][177170] DAMAGECOUNT value on done: 242657.0 [2023-02-24 18:59:23,050][177170] Sum rewards: 12.279, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.210', 'AMMO5': '0.017', 'AMMO2': '0.045', 'AMMO3': '0.090', 'weapon5': '0.110', 'AMMO4': '0.223', 'weapon4': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '1.010', 'weapon2': '1.210', 'weapon3': '1.930', 'DAMAGECOUNT': '3.699', 'FRAGCOUNT': '11.000'} [2023-02-24 18:59:23,348][177170] DAMAGECOUNT value on done: 249074.0 [2023-02-24 18:59:23,348][177170] Sum rewards: 16.796, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.165', 'AMMO5': '0.003', 'AMMO2': '0.019', 'ARMOR': '0.020', 'AMMO3': '0.040', 'weapon5': '0.052', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'WEAPON3': '0.250', 'weapon7': '0.330', 'AMMO6': '0.420', 'AMMO7': '0.420', 'WEAPON7': '0.500', 'weapon4': '0.672', 'weapon2': '0.902', 'weapon3': '0.938', 'HITCOUNT': '0.940', 'DAMAGECOUNT': '3.762', 'FRAGCOUNT': '11.000'} [2023-02-24 18:59:23,834][177170] DAMAGECOUNT value on done: 241887.0 [2023-02-24 18:59:23,834][177170] Sum rewards: 13.166, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.488', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon7': '0.130', 'AMMO3': '0.141', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'AMMO4': '0.206', 'weapon5': '0.210', 'WEAPON5': '0.300', 'weapon4': '0.678', 'weapon2': '0.734', 'WEAPON3': '0.950', 'HITCOUNT': '1.150', 'weapon3': '1.682', 'DAMAGECOUNT': '4.107', 'FRAGCOUNT': '14.000'} [2023-02-24 18:59:24,128][177170] DAMAGECOUNT value on done: 242211.0 [2023-02-24 18:59:24,129][177170] Sum rewards: 10.870, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.447', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'AMMO3': '0.133', 'AMMO4': '0.157', 'weapon5': '0.164', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.516', 'weapon2': '0.838', 'WEAPON3': '0.950', 'HITCOUNT': '1.000', 'weapon3': '2.092', 'DAMAGECOUNT': '3.948', 'FRAGCOUNT': '13.000'} [2023-02-24 18:59:24,669][177158] DAMAGECOUNT value on done: 234083.0 [2023-02-24 18:59:24,669][177158] Sum rewards: 16.778, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.122', 'weapon7': '0.002', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.099', 'AMMO4': '0.149', 'weapon5': '0.168', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'ARMOR': '0.457', 'weapon2': '0.568', 'weapon4': '0.610', 'WEAPON3': '0.650', 'HITCOUNT': '1.100', 'weapon3': '1.816', 'DAMAGECOUNT': '5.064', 'FRAGCOUNT': '14.000'} [2023-02-24 18:59:24,772][177153] Updated weights for policy 0, policy_version 19730 (0.0008) [2023-02-24 18:59:24,972][177158] DAMAGECOUNT value on done: 237024.0 [2023-02-24 18:59:24,972][177158] Sum rewards: 12.842, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.920', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'weapon7': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.130', 'WEAPON7': '0.200', 'weapon4': '0.204', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.810', 'weapon2': '1.006', 'weapon3': '1.466', 'DAMAGECOUNT': '4.191', 'FRAGCOUNT': '11.000'} [2023-02-24 18:59:25,765][177158] DAMAGECOUNT value on done: 246916.0 [2023-02-24 18:59:25,766][177158] Sum rewards: 8.769, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.565', 'AMMO2': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.050', 'AMMO4': '0.060', 'weapon4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'weapon5': '0.254', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '0.880', 'weapon2': '1.250', 'weapon3': '1.822', 'DAMAGECOUNT': '3.801', 'FRAGCOUNT': '9.000'} [2023-02-24 18:59:26,068][177158] DAMAGECOUNT value on done: 243604.0 [2023-02-24 18:59:26,069][177158] Sum rewards: 26.093, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.962', 'AMMO2': '0.008', 'AMMO5': '0.017', 'AMMO4': '0.040', 'WEAPON1': '0.060', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'weapon5': '0.168', 'weapon4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.834', 'WEAPON3': '0.900', 'HITCOUNT': '1.630', 'weapon3': '2.284', 'DAMAGECOUNT': '7.077', 'FRAGCOUNT': '22.000'} [2023-02-24 18:59:26,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 80834560. Throughput: 0: 3465.7. Samples: 20206294. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:59:26,376][177119] Avg episode reward: [(0, '13.644')] [2023-02-24 18:59:27,727][177153] Updated weights for policy 0, policy_version 19740 (0.0008) [2023-02-24 18:59:28,385][177172] DAMAGECOUNT value on done: 240198.0 [2023-02-24 18:59:28,385][177172] Sum rewards: 14.609, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.144', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.097', 'AMMO4': '0.131', 'ARMOR': '0.502', 'WEAPON4': '0.550', 'WEAPON3': '0.700', 'weapon2': '0.754', 'weapon4': '0.916', 'HITCOUNT': '1.330', 'weapon3': '1.576', 'DAMAGECOUNT': '4.650', 'FRAGCOUNT': '13.000'} [2023-02-24 18:59:28,684][177172] DAMAGECOUNT value on done: 234263.0 [2023-02-24 18:59:28,684][177172] Sum rewards: 10.864, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.900', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO3': '0.090', 'weapon5': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'weapon4': '0.440', 'WEAPON3': '0.750', 'HITCOUNT': '0.800', 'weapon2': '0.904', 'weapon3': '1.748', 'DAMAGECOUNT': '3.222', 'FRAGCOUNT': '10.000'} [2023-02-24 18:59:30,131][177154] DAMAGECOUNT value on done: 243907.0 [2023-02-24 18:59:30,131][177154] Sum rewards: 15.932, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.517', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO3': '0.060', 'AMMO4': '0.061', 'WEAPON5': '0.100', 'weapon5': '0.100', 'weapon7': '0.142', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon4': '0.400', 'AMMO6': '0.440', 'AMMO7': '0.440', 'WEAPON3': '0.450', 'WEAPON7': '0.600', 'weapon2': '1.016', 'HITCOUNT': '1.030', 'weapon3': '1.424', 'DAMAGECOUNT': '3.759', 'FRAGCOUNT': '11.000'} [2023-02-24 18:59:30,179][177172] DAMAGECOUNT value on done: 247211.0 [2023-02-24 18:59:30,180][177172] Sum rewards: 14.346, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'AMMO4': '0.135', 'weapon5': '0.176', 'WEAPON5': '0.200', 'weapon4': '0.282', 'WEAPON3': '0.350', 'HEALTH': '0.653', 'HITCOUNT': '0.770', 'weapon2': '1.068', 'weapon3': '1.668', 'DAMAGECOUNT': '3.315', 'FRAGCOUNT': '10.000'} [2023-02-24 18:59:30,427][177154] DAMAGECOUNT value on done: 250598.0 [2023-02-24 18:59:30,428][177154] Sum rewards: 17.856, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.855', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO3': '0.090', 'weapon4': '0.112', 'AMMO4': '0.148', 'WEAPON4': '0.250', 'weapon5': '0.258', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'weapon2': '1.140', 'HITCOUNT': '1.220', 'weapon3': '2.104', 'DAMAGECOUNT': '5.490', 'FRAGCOUNT': '15.000'} [2023-02-24 18:59:30,475][177172] DAMAGECOUNT value on done: 237628.0 [2023-02-24 18:59:30,476][177172] Sum rewards: 9.805, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.771', 'AMMO5': '0.015', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO3': '0.053', 'AMMO4': '0.088', 'weapon7': '0.174', 'weapon5': '0.190', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'weapon4': '0.312', 'WEAPON3': '0.350', 'WEAPON5': '0.400', 'HITCOUNT': '0.630', 'weapon2': '1.128', 'weapon3': '1.146', 'DAMAGECOUNT': '3.312', 'FRAGCOUNT': '7.000'} [2023-02-24 18:59:30,667][177153] Updated weights for policy 0, policy_version 19750 (0.0008) [2023-02-24 18:59:30,716][177154] DAMAGECOUNT value on done: 255376.0 [2023-02-24 18:59:30,717][177154] Sum rewards: 23.149, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.012', 'AMMO5': '0.014', 'ARMOR': '0.016', 'WEAPON1': '0.040', 'AMMO4': '0.062', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.180', 'HEALTH': '0.256', 'weapon4': '0.288', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'weapon2': '0.914', 'HITCOUNT': '1.250', 'weapon3': '2.016', 'DAMAGECOUNT': '6.450', 'FRAGCOUNT': '18.000'} [2023-02-24 18:59:31,018][177154] DAMAGECOUNT value on done: 247828.0 [2023-02-24 18:59:31,019][177154] Sum rewards: 24.431, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.736', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO5': '0.025', 'weapon7': '0.050', 'AMMO4': '0.085', 'AMMO3': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.164', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.404', 'WEAPON5': '0.450', 'ARMOR': '0.465', 'WEAPON3': '0.700', 'weapon2': '1.266', 'HITCOUNT': '1.360', 'weapon3': '1.626', 'DAMAGECOUNT': '7.248', 'FRAGCOUNT': '18.000'} [2023-02-24 18:59:31,208][177157] DAMAGECOUNT value on done: 251519.0 [2023-02-24 18:59:31,208][177157] Sum rewards: 9.761, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.830', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.012', 'AMMO3': '0.040', 'WEAPON4': '0.150', 'weapon5': '0.226', 'weapon4': '0.328', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.540', 'weapon3': '0.956', 'ARMOR': '0.974', 'weapon2': '1.792', 'DAMAGECOUNT': '2.352', 'FRAGCOUNT': '7.000'} [2023-02-24 18:59:31,265][177171] DAMAGECOUNT value on done: 238671.0 [2023-02-24 18:59:31,266][177171] Sum rewards: 7.441, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.973', 'AMMO2': '0.009', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.044', 'weapon7': '0.048', 'AMMO3': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.154', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.266', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.670', 'weapon3': '0.834', 'weapon2': '1.020', 'DAMAGECOUNT': '3.126', 'FRAGCOUNT': '6.000'} [2023-02-24 18:59:31,283][177157] DAMAGECOUNT value on done: 234247.0 [2023-02-24 18:59:31,283][177157] Sum rewards: 9.049, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.713', 'AMMO5': '0.005', 'weapon4': '0.008', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'ARMOR': '0.044', 'AMMO4': '0.053', 'weapon7': '0.078', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO3': '0.114', 'WEAPON4': '0.150', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '0.800', 'weapon2': '1.646', 'weapon3': '1.742', 'DAMAGECOUNT': '2.841', 'FRAGCOUNT': '7.000'} [2023-02-24 18:59:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 80904192. Throughput: 0: 3467.0. Samples: 20227120. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 18:59:31,376][177119] Avg episode reward: [(0, '13.703')] [2023-02-24 18:59:31,531][177157] DAMAGECOUNT value on done: 235854.0 [2023-02-24 18:59:31,531][177157] Sum rewards: 14.047, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.775', 'AMMO2': '0.009', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.043', 'AMMO3': '0.100', 'weapon7': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.258', 'ARMOR': '0.472', 'WEAPON3': '0.650', 'HITCOUNT': '0.850', 'weapon2': '0.936', 'weapon3': '1.706', 'DAMAGECOUNT': '4.152', 'FRAGCOUNT': '12.000'} [2023-02-24 18:59:31,591][177171] DAMAGECOUNT value on done: 245579.0 [2023-02-24 18:59:31,591][177171] Sum rewards: 14.966, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.123', 'AMMO4': '-0.066', 'AMMO2': '-0.013', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'weapon7': '0.050', 'AMMO3': '0.090', 'weapon5': '0.170', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.890', 'ARMOR': '0.907', 'weapon2': '1.350', 'weapon3': '1.808', 'DAMAGECOUNT': '3.975', 'FRAGCOUNT': '10.000'} [2023-02-24 18:59:31,604][177157] DAMAGECOUNT value on done: 236942.0 [2023-02-24 18:59:31,604][177171] DAMAGECOUNT value on done: 240247.0 [2023-02-24 18:59:31,605][177157] Sum rewards: 2.314, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.434', 'AMMO5': '0.003', 'AMMO2': '0.006', 'ARMOR': '0.008', 'AMMO3': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.030', 'WEAPON3': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.056', 'HITCOUNT': '0.220', 'weapon7': '0.226', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon3': '0.244', 'WEAPON4': '0.300', 'WEAPON7': '0.400', 'weapon2': '0.464', 'weapon4': '0.622', 'DAMAGECOUNT': '0.819', 'FRAGCOUNT': '1.000'} [2023-02-24 18:59:31,605][177171] Sum rewards: 13.662, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.484', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'weapon5': '0.066', 'weapon7': '0.080', 'AMMO3': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.137', 'WEAPON4': '0.250', 'weapon4': '0.336', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'weapon2': '1.062', 'HITCOUNT': '1.100', 'weapon3': '1.562', 'DAMAGECOUNT': '4.170', 'FRAGCOUNT': '12.000'} [2023-02-24 18:59:31,905][177171] DAMAGECOUNT value on done: 239728.0 [2023-02-24 18:59:31,906][177171] Sum rewards: 13.450, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.295', 'weapon7': '0.002', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO4': '0.055', 'AMMO3': '0.109', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'weapon5': '0.398', 'WEAPON5': '0.450', 'weapon4': '0.682', 'weapon2': '0.692', 'WEAPON3': '0.750', 'HITCOUNT': '1.190', 'weapon3': '1.778', 'DAMAGECOUNT': '4.935', 'FRAGCOUNT': '11.000'} [2023-02-24 18:59:32,975][177155] DAMAGECOUNT value on done: 241059.0 [2023-02-24 18:59:32,975][177155] Sum rewards: 12.335, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.655', 'AMMO5': '0.012', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'weapon7': '0.052', 'AMMO4': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.125', 'weapon5': '0.134', 'WEAPON7': '0.200', 'weapon2': '0.266', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'weapon4': '0.828', 'HITCOUNT': '1.310', 'weapon3': '1.910', 'DAMAGECOUNT': '4.689', 'FRAGCOUNT': '9.500'} [2023-02-24 18:59:33,283][177155] DAMAGECOUNT value on done: 251192.0 [2023-02-24 18:59:33,284][177155] Sum rewards: 22.700, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.482', 'ARMOR': '0.004', 'AMMO2': '0.005', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.023', 'AMMO3': '0.080', 'weapon7': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.148', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.450', 'weapon4': '0.494', 'WEAPON3': '0.550', 'weapon2': '0.682', 'HITCOUNT': '1.140', 'weapon3': '1.404', 'DAMAGECOUNT': '5.439', 'FRAGCOUNT': '18.000'} [2023-02-24 18:59:33,623][177153] Updated weights for policy 0, policy_version 19760 (0.0008) [2023-02-24 18:59:33,710][177155] DAMAGECOUNT value on done: 247500.0 [2023-02-24 18:59:33,711][177155] Sum rewards: 17.629, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.666', 'AMMO5': '0.012', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'weapon7': '0.058', 'AMMO4': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.100', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'weapon4': '0.246', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '1.140', 'weapon2': '1.260', 'weapon3': '2.042', 'DAMAGECOUNT': '5.163', 'FRAGCOUNT': '16.000'} [2023-02-24 18:59:34,010][177155] DAMAGECOUNT value on done: 234624.0 [2023-02-24 18:59:34,010][177155] Sum rewards: 5.763, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.830', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.030', 'AMMO4': '0.045', 'weapon5': '0.072', 'AMMO3': '0.129', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.470', 'weapon2': '0.844', 'HITCOUNT': '0.880', 'WEAPON3': '0.900', 'weapon3': '2.020', 'DAMAGECOUNT': '3.039', 'FRAGCOUNT': '7.000'} [2023-02-24 18:59:36,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 80973824. Throughput: 0: 3467.6. Samples: 20237548. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:59:36,376][177119] Avg episode reward: [(0, '13.530')] [2023-02-24 18:59:36,558][177153] Updated weights for policy 0, policy_version 19770 (0.0008) [2023-02-24 18:59:39,518][177153] Updated weights for policy 0, policy_version 19780 (0.0008) [2023-02-24 18:59:41,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 81043456. Throughput: 0: 3474.6. Samples: 20258512. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:59:41,376][177119] Avg episode reward: [(0, '13.530')] [2023-02-24 18:59:41,866][177156] DAMAGECOUNT value on done: 243545.0 [2023-02-24 18:59:41,867][177156] Sum rewards: 10.795, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.112', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.014', 'AMMO3': '0.104', 'weapon5': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.206', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'HITCOUNT': '0.720', 'weapon2': '1.410', 'weapon3': '1.652', 'DAMAGECOUNT': '2.727', 'FRAGCOUNT': '9.000'} [2023-02-24 18:59:41,919][177156] DAMAGECOUNT value on done: 239608.0 [2023-02-24 18:59:41,919][177156] Sum rewards: 8.832, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.984', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.130', 'weapon5': '0.168', 'WEAPON5': '0.200', 'weapon4': '0.360', 'ARMOR': '0.404', 'WEAPON3': '0.850', 'HITCOUNT': '0.960', 'weapon2': '1.250', 'weapon3': '1.866', 'DAMAGECOUNT': '3.828', 'FRAGCOUNT': '9.000'} [2023-02-24 18:59:42,171][177156] DAMAGECOUNT value on done: 249707.0 [2023-02-24 18:59:42,171][177156] Sum rewards: 4.879, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.272', 'AMMO5': '0.017', 'AMMO2': '0.045', 'WEAPON1': '0.060', 'AMMO3': '0.092', 'weapon5': '0.222', 'AMMO4': '0.224', 'weapon4': '0.488', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'WEAPON4': '0.600', 'HITCOUNT': '0.770', 'weapon2': '1.442', 'weapon3': '1.470', 'DAMAGECOUNT': '3.171', 'FRAGCOUNT': '8.000'} [2023-02-24 18:59:42,228][177156] DAMAGECOUNT value on done: 240138.0 [2023-02-24 18:59:42,229][177156] Sum rewards: 7.869, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.846', 'AMMO2': '0.021', 'weapon7': '0.054', 'AMMO3': '0.077', 'AMMO4': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.284', 'WEAPON3': '0.400', 'ARMOR': '0.400', 'HITCOUNT': '0.700', 'weapon3': '1.000', 'weapon2': '1.866', 'DAMAGECOUNT': '2.670', 'FRAGCOUNT': '5.000'} [2023-02-24 18:59:42,290][177170] DAMAGECOUNT value on done: 243667.0 [2023-02-24 18:59:42,290][177170] Sum rewards: 9.605, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.714', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.014', 'WEAPON1': '0.020', 'weapon5': '0.068', 'WEAPON4': '0.100', 'weapon7': '0.102', 'AMMO3': '0.103', 'WEAPON5': '0.150', 'weapon4': '0.214', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.870', 'weapon2': '1.366', 'weapon3': '1.634', 'DAMAGECOUNT': '3.030', 'FRAGCOUNT': '8.000'} [2023-02-24 18:59:42,434][177153] Updated weights for policy 0, policy_version 19790 (0.0008) [2023-02-24 18:59:42,594][177170] DAMAGECOUNT value on done: 250548.0 [2023-02-24 18:59:42,594][177170] Sum rewards: 12.879, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.180', 'AMMO5': '0.015', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.076', 'AMMO3': '0.098', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.422', 'WEAPON3': '0.650', 'weapon2': '1.000', 'HITCOUNT': '1.130', 'weapon3': '1.836', 'DAMAGECOUNT': '4.422', 'FRAGCOUNT': '9.500'} [2023-02-24 18:59:43,079][177170] DAMAGECOUNT value on done: 243195.0 [2023-02-24 18:59:43,080][177170] Sum rewards: 12.852, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'HEALTH': '0.030', 'AMMO3': '0.064', 'weapon7': '0.092', 'AMMO4': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.254', 'WEAPON5': '0.300', 'weapon4': '0.416', 'WEAPON3': '0.450', 'weapon2': '0.660', 'HITCOUNT': '0.910', 'weapon3': '1.196', 'DAMAGECOUNT': '3.924', 'FRAGCOUNT': '9.000'} [2023-02-24 18:59:43,368][177170] DAMAGECOUNT value on done: 243647.0 [2023-02-24 18:59:43,368][177170] Sum rewards: 17.118, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.292', 'AMMO2': '0.004', 'AMMO4': '0.018', 'AMMO5': '0.022', 'WEAPON1': '0.050', 'AMMO3': '0.103', 'WEAPON4': '0.150', 'weapon4': '0.240', 'weapon5': '0.250', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '0.800', 'weapon2': '1.164', 'weapon3': '1.600', 'DAMAGECOUNT': '4.308', 'FRAGCOUNT': '15.000'} [2023-02-24 18:59:43,913][177158] DAMAGECOUNT value on done: 235853.0 [2023-02-24 18:59:43,913][177158] Sum rewards: 12.316, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.210', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'ARMOR': '0.020', 'AMMO2': '0.039', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.100', 'AMMO3': '0.124', 'AMMO4': '0.197', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.676', 'WEAPON3': '0.800', 'weapon2': '0.800', 'HITCOUNT': '1.150', 'weapon3': '1.626', 'DAMAGECOUNT': '5.250', 'FRAGCOUNT': '11.500'} [2023-02-24 18:59:44,206][177158] DAMAGECOUNT value on done: 237694.0 [2023-02-24 18:59:44,206][177158] Sum rewards: 9.238, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.246', 'AMMO5': '0.003', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'AMMO3': '0.047', 'weapon7': '0.048', 'WEAPON5': '0.050', 'weapon2': '0.084', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'HITCOUNT': '0.510', 'weapon3': '0.588', 'weapon4': '0.680', 'DAMAGECOUNT': '2.010', 'FRAGCOUNT': '8.000'} [2023-02-24 18:59:44,972][177158] DAMAGECOUNT value on done: 248185.0 [2023-02-24 18:59:44,973][177158] Sum rewards: 7.658, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.270', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon7': '0.052', 'weapon5': '0.054', 'AMMO3': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.132', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.396', 'WEAPON4': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.666', 'HITCOUNT': '0.890', 'weapon3': '0.950', 'DAMAGECOUNT': '3.807', 'FRAGCOUNT': '7.000'} [2023-02-24 18:59:45,271][177158] DAMAGECOUNT value on done: 245591.0 [2023-02-24 18:59:45,271][177158] Sum rewards: 17.646, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.924', 'AMMO2': '0.020', 'AMMO5': '0.028', 'WEAPON1': '0.040', 'AMMO4': '0.101', 'AMMO3': '0.160', 'weapon5': '0.256', 'WEAPON4': '0.400', 'weapon4': '0.556', 'weapon2': '0.614', 'WEAPON5': '0.750', 'WEAPON3': '1.150', 'HITCOUNT': '1.320', 'weapon3': '1.964', 'DAMAGECOUNT': '5.961', 'FRAGCOUNT': '17.000'} [2023-02-24 18:59:45,366][177153] Updated weights for policy 0, policy_version 19800 (0.0008) [2023-02-24 18:59:46,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 81113088. Throughput: 0: 3478.8. Samples: 20279424. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:59:46,376][177119] Avg episode reward: [(0, '13.269')] [2023-02-24 18:59:47,666][177172] DAMAGECOUNT value on done: 241653.0 [2023-02-24 18:59:47,666][177172] Sum rewards: 13.048, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.150', 'AMMO2': '0.009', 'AMMO5': '0.015', 'AMMO4': '0.044', 'AMMO3': '0.138', 'WEAPON4': '0.250', 'weapon5': '0.344', 'weapon4': '0.460', 'WEAPON5': '0.550', 'weapon2': '0.696', 'WEAPON3': '0.900', 'HITCOUNT': '0.900', 'weapon3': '2.026', 'DAMAGECOUNT': '4.365', 'FRAGCOUNT': '12.000'} [2023-02-24 18:59:47,984][177172] DAMAGECOUNT value on done: 235047.0 [2023-02-24 18:59:47,984][177172] Sum rewards: 7.880, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'AMMO2': '0.029', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon7': '0.100', 'HEALTH': '0.138', 'weapon5': '0.140', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.204', 'WEAPON3': '0.400', 'HITCOUNT': '0.570', 'weapon2': '1.118', 'weapon3': '1.316', 'DAMAGECOUNT': '2.352', 'FRAGCOUNT': '5.000'} [2023-02-24 18:59:48,317][177153] Updated weights for policy 0, policy_version 19810 (0.0008) [2023-02-24 18:59:49,458][177154] DAMAGECOUNT value on done: 246115.0 [2023-02-24 18:59:49,459][177154] Sum rewards: 22.310, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.250', 'AMMO2': '0.009', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.045', 'AMMO3': '0.136', 'WEAPON4': '0.200', 'weapon4': '0.322', 'weapon5': '0.334', 'WEAPON5': '0.350', 'weapon2': '0.898', 'WEAPON3': '0.900', 'HITCOUNT': '1.190', 'weapon3': '1.756', 'DAMAGECOUNT': '6.624', 'FRAGCOUNT': '19.000'} [2023-02-24 18:59:49,476][177172] DAMAGECOUNT value on done: 248621.0 [2023-02-24 18:59:49,477][177172] Sum rewards: 14.062, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.076', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'AMMO4': '0.156', 'weapon5': '0.158', 'WEAPON5': '0.200', 'weapon4': '0.216', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '1.080', 'weapon2': '1.464', 'weapon3': '1.738', 'DAMAGECOUNT': '4.230', 'FRAGCOUNT': '12.000'} [2023-02-24 18:59:49,750][177154] DAMAGECOUNT value on done: 252093.0 [2023-02-24 18:59:49,751][177154] Sum rewards: 16.583, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.936', 'AMMO5': '0.016', 'AMMO2': '0.017', 'weapon4': '0.018', 'WEAPON1': '0.040', 'AMMO4': '0.083', 'AMMO3': '0.090', 'weapon5': '0.090', 'WEAPON4': '0.100', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '1.190', 'weapon2': '1.364', 'weapon3': '2.076', 'DAMAGECOUNT': '4.485', 'FRAGCOUNT': '13.000'} [2023-02-24 18:59:49,782][177172] DAMAGECOUNT value on done: 238368.0 [2023-02-24 18:59:49,783][177172] Sum rewards: 5.672, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.260', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon7': '0.064', 'AMMO4': '0.073', 'AMMO3': '0.075', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.176', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.426', 'HITCOUNT': '0.490', 'WEAPON3': '0.500', 'weapon2': '0.744', 'weapon3': '1.140', 'DAMAGECOUNT': '2.220', 'FRAGCOUNT': '6.000'} [2023-02-24 18:59:50,056][177154] DAMAGECOUNT value on done: 256354.0 [2023-02-24 18:59:50,057][177154] Sum rewards: 12.460, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.042', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon7': '0.058', 'AMMO3': '0.060', 'AMMO4': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.286', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'weapon4': '0.422', 'WEAPON3': '0.450', 'HITCOUNT': '0.820', 'weapon2': '1.178', 'weapon3': '1.564', 'DAMAGECOUNT': '2.934', 'FRAGCOUNT': '7.000'} [2023-02-24 18:59:50,357][177154] DAMAGECOUNT value on done: 248791.0 [2023-02-24 18:59:50,358][177154] Sum rewards: 2.887, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.122', 'weapon7': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.029', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.143', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'weapon5': '0.282', 'weapon4': '0.334', 'WEAPON5': '0.350', 'HITCOUNT': '0.670', 'WEAPON3': '0.900', 'weapon2': '0.960', 'weapon3': '2.016', 'DAMAGECOUNT': '2.889', 'FRAGCOUNT': '5.000'} [2023-02-24 18:59:50,562][177157] DAMAGECOUNT value on done: 253179.0 [2023-02-24 18:59:50,563][177157] Sum rewards: 17.038, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.570', 'AMMO5': '0.015', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.127', 'WEAPON5': '0.200', 'weapon5': '0.220', 'WEAPON3': '0.800', 'weapon2': '1.160', 'HITCOUNT': '1.250', 'weapon3': '2.250', 'DAMAGECOUNT': '4.980', 'FRAGCOUNT': '14.000'} [2023-02-24 18:59:50,607][177171] DAMAGECOUNT value on done: 239830.0 [2023-02-24 18:59:50,607][177171] Sum rewards: 11.069, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.412', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'weapon5': '0.062', 'weapon7': '0.078', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.550', 'HITCOUNT': '0.610', 'weapon2': '1.090', 'weapon3': '1.360', 'DAMAGECOUNT': '3.342', 'FRAGCOUNT': '9.000'} [2023-02-24 18:59:50,618][177157] DAMAGECOUNT value on done: 235519.0 [2023-02-24 18:59:50,619][177157] Sum rewards: 15.034, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.061', 'weapon7': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.128', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.304', 'HEALTH': '0.329', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.870', 'weapon2': '0.912', 'weapon3': '1.480', 'DAMAGECOUNT': '3.816', 'FRAGCOUNT': '10.000'} [2023-02-24 18:59:50,874][177157] DAMAGECOUNT value on done: 237161.0 [2023-02-24 18:59:50,874][177157] Sum rewards: 7.535, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.404', 'ARMOR': '0.008', 'AMMO2': '0.015', 'AMMO5': '0.016', 'WEAPON1': '0.030', 'AMMO4': '0.074', 'weapon5': '0.178', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon4': '0.346', 'weapon2': '0.354', 'WEAPON5': '0.400', 'HITCOUNT': '1.060', 'WEAPON3': '1.250', 'weapon3': '2.626', 'DAMAGECOUNT': '3.921', 'FRAGCOUNT': '11.000'} [2023-02-24 18:59:50,902][177171] DAMAGECOUNT value on done: 241803.0 [2023-02-24 18:59:50,903][177171] Sum rewards: 12.529, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.260', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'weapon5': '0.124', 'AMMO4': '0.148', 'weapon2': '0.266', 'WEAPON4': '0.300', 'weapon4': '0.532', 'WEAPON3': '0.700', 'HITCOUNT': '1.180', 'weapon3': '1.510', 'DAMAGECOUNT': '4.668', 'FRAGCOUNT': '12.000'} [2023-02-24 18:59:50,912][177171] DAMAGECOUNT value on done: 246937.0 [2023-02-24 18:59:50,912][177171] Sum rewards: 16.436, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.679', 'AMMO5': '0.014', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.061', 'weapon7': '0.062', 'AMMO4': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.144', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.350', 'WEAPON3': '0.450', 'weapon2': '0.862', 'HITCOUNT': '0.900', 'weapon3': '1.348', 'DAMAGECOUNT': '4.074', 'FRAGCOUNT': '13.000'} [2023-02-24 18:59:50,931][177157] DAMAGECOUNT value on done: 238937.0 [2023-02-24 18:59:50,931][177157] Sum rewards: 19.596, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.500', 'AMMO2': '0.013', 'AMMO5': '0.017', 'WEAPON1': '0.050', 'AMMO4': '0.063', 'weapon7': '0.090', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'weapon5': '0.182', 'weapon4': '0.184', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'weapon2': '1.010', 'HITCOUNT': '1.350', 'weapon3': '1.974', 'DAMAGECOUNT': '5.985', 'FRAGCOUNT': '17.000'} [2023-02-24 18:59:51,213][177171] DAMAGECOUNT value on done: 241372.0 [2023-02-24 18:59:51,213][177171] Sum rewards: 16.541, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.290', 'AMMO2': '0.010', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.052', 'weapon7': '0.080', 'AMMO3': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.256', 'WEAPON5': '0.350', 'weapon2': '0.498', 'weapon4': '0.514', 'WEAPON3': '0.700', 'HITCOUNT': '0.960', 'weapon3': '1.448', 'DAMAGECOUNT': '4.932', 'FRAGCOUNT': '14.000'} [2023-02-24 18:59:51,300][177153] Updated weights for policy 0, policy_version 19820 (0.0008) [2023-02-24 18:59:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 81182720. Throughput: 0: 3480.1. Samples: 20289878. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:59:51,376][177119] Avg episode reward: [(0, '13.356')] [2023-02-24 18:59:52,328][177155] DAMAGECOUNT value on done: 242494.0 [2023-02-24 18:59:52,328][177155] Sum rewards: 17.035, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.750', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.016', 'AMMO5': '0.018', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'weapon4': '0.170', 'weapon5': '0.348', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'HITCOUNT': '1.020', 'weapon2': '1.396', 'weapon3': '1.738', 'DAMAGECOUNT': '4.305', 'FRAGCOUNT': '15.000'} [2023-02-24 18:59:52,625][177155] DAMAGECOUNT value on done: 252968.0 [2023-02-24 18:59:52,626][177155] Sum rewards: 17.857, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.680', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'AMMO5': '0.023', 'AMMO4': '0.104', 'AMMO3': '0.135', 'weapon5': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon4': '0.734', 'weapon2': '0.802', 'WEAPON3': '0.850', 'HITCOUNT': '1.270', 'weapon3': '1.774', 'DAMAGECOUNT': '5.328', 'FRAGCOUNT': '14.000'} [2023-02-24 18:59:53,043][177155] DAMAGECOUNT value on done: 248821.0 [2023-02-24 18:59:53,044][177155] Sum rewards: 15.347, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon7': '0.054', 'AMMO3': '0.061', 'weapon5': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HEALTH': '0.110', 'AMMO4': '0.126', 'WEAPON4': '0.300', 'weapon2': '0.390', 'WEAPON3': '0.400', 'weapon4': '0.710', 'HITCOUNT': '0.900', 'weapon3': '1.386', 'DAMAGECOUNT': '3.963', 'FRAGCOUNT': '11.000'} [2023-02-24 18:59:53,340][177155] DAMAGECOUNT value on done: 236602.0 [2023-02-24 18:59:53,340][177155] Sum rewards: 19.468, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.045', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO2': '0.032', 'AMMO3': '0.105', 'AMMO4': '0.159', 'weapon4': '0.310', 'weapon5': '0.382', 'WEAPON4': '0.400', 'ARMOR': '0.454', 'WEAPON5': '0.700', 'WEAPON3': '0.750', 'weapon2': '1.076', 'HITCOUNT': '1.380', 'weapon3': '1.786', 'DAMAGECOUNT': '5.934', 'FRAGCOUNT': '17.000'} [2023-02-24 18:59:54,234][177153] Updated weights for policy 0, policy_version 19830 (0.0008) [2023-02-24 18:59:56,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13870.9). Total num frames: 81252352. Throughput: 0: 3477.8. Samples: 20310706. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 18:59:56,376][177119] Avg episode reward: [(0, '13.552')] [2023-02-24 18:59:57,167][177153] Updated weights for policy 0, policy_version 19840 (0.0008) [2023-02-24 19:00:00,143][177153] Updated weights for policy 0, policy_version 19850 (0.0008) [2023-02-24 19:00:01,216][177156] DAMAGECOUNT value on done: 245006.0 [2023-02-24 19:00:01,216][177156] Sum rewards: 16.783, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.880', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.023', 'AMMO5': '0.025', 'weapon7': '0.050', 'AMMO3': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.264', 'weapon4': '0.272', 'WEAPON4': '0.300', 'ARMOR': '0.481', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'HITCOUNT': '0.950', 'weapon2': '1.478', 'weapon3': '1.574', 'DAMAGECOUNT': '4.383', 'FRAGCOUNT': '13.000'} [2023-02-24 19:00:01,273][177156] DAMAGECOUNT value on done: 240507.0 [2023-02-24 19:00:01,273][177156] Sum rewards: 7.312, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.750', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.026', 'WEAPON4': '0.050', 'weapon7': '0.064', 'weapon5': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'AMMO4': '0.131', 'weapon4': '0.218', 'WEAPON3': '0.700', 'HITCOUNT': '0.730', 'weapon2': '1.144', 'weapon3': '1.480', 'DAMAGECOUNT': '2.697', 'FRAGCOUNT': '7.000'} [2023-02-24 19:00:01,376][177119] Fps is (10 sec: 13926.2, 60 sec: 13926.4, 300 sec: 13870.9). Total num frames: 81321984. Throughput: 0: 3475.6. Samples: 20331494. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:00:01,376][177119] Avg episode reward: [(0, '13.555')] [2023-02-24 19:00:01,526][177156] DAMAGECOUNT value on done: 251137.0 [2023-02-24 19:00:01,526][177156] Sum rewards: 8.762, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.320', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.100', 'AMMO4': '0.146', 'AMMO3': '0.147', 'weapon4': '0.182', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '1.050', 'weapon2': '1.084', 'HITCOUNT': '1.190', 'weapon3': '2.356', 'DAMAGECOUNT': '4.290', 'FRAGCOUNT': '12.000'} [2023-02-24 19:00:01,540][177170] DAMAGECOUNT value on done: 245473.0 [2023-02-24 19:00:01,541][177170] Sum rewards: 10.522, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.440', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'weapon7': '0.084', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.126', 'weapon5': '0.180', 'WEAPON7': '0.200', 'weapon4': '0.212', 'WEAPON5': '0.300', 'WEAPON3': '0.800', 'HITCOUNT': '0.850', 'weapon2': '1.262', 'weapon3': '1.836', 'DAMAGECOUNT': '4.218', 'FRAGCOUNT': '9.000'} [2023-02-24 19:00:01,590][177156] DAMAGECOUNT value on done: 241916.0 [2023-02-24 19:00:01,590][177156] Sum rewards: 17.126, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.903', 'WEAPON1': '0.010', 'AMMO5': '0.025', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.136', 'AMMO3': '0.144', 'WEAPON4': '0.200', 'weapon4': '0.384', 'ARMOR': '0.469', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'HITCOUNT': '1.090', 'weapon2': '1.284', 'weapon3': '1.768', 'DAMAGECOUNT': '5.214', 'FRAGCOUNT': '14.000'} [2023-02-24 19:00:01,845][177170] DAMAGECOUNT value on done: 251348.0 [2023-02-24 19:00:01,845][177170] Sum rewards: 7.692, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.018', 'AMMO2': '0.010', 'AMMO5': '0.010', 'weapon7': '0.048', 'AMMO4': '0.049', 'AMMO3': '0.067', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.122', 'weapon4': '0.192', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'HITCOUNT': '0.520', 'weapon3': '0.824', 'weapon2': '0.978', 'DAMAGECOUNT': '2.400', 'FRAGCOUNT': '6.000'} [2023-02-24 19:00:02,346][177170] DAMAGECOUNT value on done: 244400.0 [2023-02-24 19:00:02,346][177170] Sum rewards: 10.789, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.725', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'AMMO3': '0.117', 'WEAPON4': '0.350', 'weapon4': '0.444', 'WEAPON3': '0.750', 'weapon2': '0.760', 'HITCOUNT': '1.020', 'weapon3': '1.728', 'DAMAGECOUNT': '3.615', 'FRAGCOUNT': '11.000'} [2023-02-24 19:00:02,644][177170] DAMAGECOUNT value on done: 245555.0 [2023-02-24 19:00:02,644][177170] Sum rewards: 23.325, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.500', 'AMMO2': '0.017', 'AMMO5': '0.025', 'WEAPON1': '0.030', 'weapon4': '0.036', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'AMMO3': '0.159', 'weapon5': '0.166', 'WEAPON5': '0.550', 'weapon2': '0.918', 'WEAPON3': '0.950', 'HITCOUNT': '1.270', 'weapon3': '2.546', 'DAMAGECOUNT': '5.724', 'FRAGCOUNT': '21.000'} [2023-02-24 19:00:03,114][177153] Updated weights for policy 0, policy_version 19860 (0.0008) [2023-02-24 19:00:03,238][177158] DAMAGECOUNT value on done: 237602.0 [2023-02-24 19:00:03,239][177158] Sum rewards: 16.040, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.182', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.005', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'weapon2': '1.094', 'WEAPON3': '1.150', 'HITCOUNT': '1.260', 'weapon3': '2.572', 'DAMAGECOUNT': '5.247', 'FRAGCOUNT': '17.000'} [2023-02-24 19:00:03,537][177158] DAMAGECOUNT value on done: 238662.0 [2023-02-24 19:00:03,537][177158] Sum rewards: 6.843, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.485', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.037', 'weapon7': '0.048', 'AMMO3': '0.137', 'weapon5': '0.138', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'weapon4': '0.302', 'HITCOUNT': '0.840', 'WEAPON3': '0.900', 'weapon2': '1.454', 'weapon3': '1.610', 'DAMAGECOUNT': '2.904', 'FRAGCOUNT': '7.000'} [2023-02-24 19:00:04,373][177158] DAMAGECOUNT value on done: 249301.0 [2023-02-24 19:00:04,374][177158] Sum rewards: 10.864, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.454', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon5': '0.086', 'AMMO3': '0.098', 'AMMO4': '0.107', 'weapon7': '0.188', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.528', 'weapon4': '0.566', 'WEAPON3': '0.650', 'HITCOUNT': '0.800', 'weapon3': '1.522', 'DAMAGECOUNT': '3.348', 'FRAGCOUNT': '10.500'} [2023-02-24 19:00:04,676][177158] DAMAGECOUNT value on done: 248017.0 [2023-02-24 19:00:04,676][177158] Sum rewards: 24.544, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.458', 'AMMO2': '0.005', 'AMMO5': '0.017', 'AMMO4': '0.027', 'weapon7': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.135', 'weapon5': '0.184', 'WEAPON5': '0.450', 'WEAPON3': '0.900', 'weapon2': '1.068', 'HITCOUNT': '1.300', 'weapon3': '2.296', 'DAMAGECOUNT': '7.233', 'FRAGCOUNT': '20.000'} [2023-02-24 19:00:06,046][177153] Updated weights for policy 0, policy_version 19870 (0.0008) [2023-02-24 19:00:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13870.9). Total num frames: 81391616. Throughput: 0: 3475.6. Samples: 20341886. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:00:06,376][177119] Avg episode reward: [(0, '13.524')] [2023-02-24 19:00:07,071][177172] DAMAGECOUNT value on done: 243352.0 [2023-02-24 19:00:07,071][177172] Sum rewards: 14.377, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.338', 'weapon7': '0.002', 'ARMOR': '0.005', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.090', 'AMMO4': '0.127', 'weapon5': '0.194', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon4': '0.576', 'WEAPON3': '0.600', 'weapon2': '0.990', 'HITCOUNT': '1.210', 'weapon3': '1.758', 'DAMAGECOUNT': '5.097', 'FRAGCOUNT': '12.500'} [2023-02-24 19:00:07,365][177172] DAMAGECOUNT value on done: 236970.0 [2023-02-24 19:00:07,366][177172] Sum rewards: 20.836, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.226', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.036', 'weapon5': '0.160', 'AMMO3': '0.177', 'AMMO4': '0.181', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.366', 'weapon2': '0.552', 'WEAPON3': '1.250', 'HITCOUNT': '1.630', 'weapon3': '2.620', 'DAMAGECOUNT': '5.769', 'FRAGCOUNT': '21.000'} [2023-02-24 19:00:08,796][177154] DAMAGECOUNT value on done: 248129.0 [2023-02-24 19:00:08,797][177154] Sum rewards: 16.556, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.360', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon7': '0.048', 'weapon5': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.140', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.950', 'weapon2': '0.980', 'HITCOUNT': '1.090', 'weapon3': '2.044', 'DAMAGECOUNT': '5.142', 'FRAGCOUNT': '15.000'} [2023-02-24 19:00:08,838][177172] DAMAGECOUNT value on done: 250525.0 [2023-02-24 19:00:08,839][177172] Sum rewards: 20.288, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.970', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.018', 'AMMO3': '0.075', 'AMMO4': '0.089', 'WEAPON4': '0.300', 'weapon4': '0.334', 'weapon5': '0.416', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon2': '0.828', 'HITCOUNT': '1.000', 'weapon3': '1.676', 'DAMAGECOUNT': '5.247', 'FRAGCOUNT': '15.500'} [2023-02-24 19:00:09,020][177153] Updated weights for policy 0, policy_version 19880 (0.0008) [2023-02-24 19:00:09,098][177154] DAMAGECOUNT value on done: 253441.0 [2023-02-24 19:00:09,098][177154] Sum rewards: 9.641, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.830', 'ARMOR': '0.005', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon7': '0.074', 'weapon5': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.130', 'AMMO4': '0.137', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON4': '0.400', 'weapon4': '0.702', 'WEAPON3': '0.850', 'HITCOUNT': '0.900', 'weapon3': '1.698', 'DAMAGECOUNT': '4.044', 'FRAGCOUNT': '10.000'} [2023-02-24 19:00:09,133][177172] DAMAGECOUNT value on done: 239105.0 [2023-02-24 19:00:09,134][177172] Sum rewards: 9.106, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.469', 'AMMO5': '0.003', 'AMMO2': '0.005', 'ARMOR': '0.008', 'AMMO4': '0.026', 'AMMO3': '0.060', 'weapon7': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'weapon4': '0.340', 'HITCOUNT': '0.620', 'weapon2': '0.844', 'weapon3': '1.242', 'DAMAGECOUNT': '2.211', 'FRAGCOUNT': '7.000'} [2023-02-24 19:00:09,413][177154] DAMAGECOUNT value on done: 257571.0 [2023-02-24 19:00:09,413][177154] Sum rewards: 12.679, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.971', 'weapon7': '0.002', 'AMMO5': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO3': '0.131', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.240', 'WEAPON5': '0.300', 'HITCOUNT': '0.610', 'WEAPON3': '0.800', 'weapon2': '1.326', 'weapon3': '1.894', 'DAMAGECOUNT': '3.651', 'FRAGCOUNT': '12.000'} [2023-02-24 19:00:09,708][177154] DAMAGECOUNT value on done: 251445.0 [2023-02-24 19:00:09,708][177154] Sum rewards: 24.102, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.460', 'ARMOR': '0.012', 'AMMO5': '0.025', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon4': '0.192', 'weapon5': '0.230', 'AMMO3': '0.236', 'WEAPON4': '0.350', 'weapon2': '0.494', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '1.940', 'weapon3': '2.742', 'DAMAGECOUNT': '7.962', 'FRAGCOUNT': '23.000'} [2023-02-24 19:00:09,939][177157] DAMAGECOUNT value on done: 254453.0 [2023-02-24 19:00:09,939][177157] Sum rewards: 9.332, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.711', 'weapon7': '0.006', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.030', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.136', 'AMMO4': '0.147', 'weapon5': '0.170', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon4': '0.630', 'WEAPON3': '0.850', 'HITCOUNT': '0.940', 'weapon2': '1.200', 'weapon3': '1.638', 'DAMAGECOUNT': '3.822', 'FRAGCOUNT': '10.000'} [2023-02-24 19:00:09,992][177171] DAMAGECOUNT value on done: 240799.0 [2023-02-24 19:00:09,992][177171] Sum rewards: 9.628, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.340', 'AMMO5': '0.018', 'AMMO2': '0.034', 'WEAPON1': '0.040', 'AMMO3': '0.100', 'weapon7': '0.108', 'AMMO4': '0.169', 'WEAPON4': '0.300', 'weapon5': '0.310', 'weapon4': '0.354', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'AMMO6': '0.660', 'AMMO7': '0.660', 'WEAPON7': '0.700', 'HITCOUNT': '0.780', 'weapon2': '1.142', 'weapon3': '1.486', 'DAMAGECOUNT': '2.907', 'FRAGCOUNT': '8.000'} [2023-02-24 19:00:10,003][177157] DAMAGECOUNT value on done: 237659.0 [2023-02-24 19:00:10,004][177157] Sum rewards: 16.455, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.704', 'AMMO5': '0.015', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.079', 'weapon5': '0.118', 'AMMO3': '0.161', 'WEAPON4': '0.250', 'weapon4': '0.322', 'WEAPON5': '0.350', 'weapon2': '0.550', 'WEAPON3': '1.000', 'HITCOUNT': '1.440', 'weapon3': '2.668', 'DAMAGECOUNT': '6.420', 'FRAGCOUNT': '15.000'} [2023-02-24 19:00:10,250][177157] DAMAGECOUNT value on done: 238713.0 [2023-02-24 19:00:10,251][177157] Sum rewards: 12.664, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.060', 'AMMO2': '0.014', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.068', 'AMMO3': '0.102', 'WEAPON4': '0.200', 'weapon5': '0.260', 'weapon4': '0.442', 'WEAPON5': '0.500', 'weapon2': '0.686', 'WEAPON3': '0.750', 'HITCOUNT': '1.040', 'weapon3': '2.216', 'DAMAGECOUNT': '4.656', 'FRAGCOUNT': '11.000'} [2023-02-24 19:00:10,292][177171] DAMAGECOUNT value on done: 248030.0 [2023-02-24 19:00:10,292][177171] Sum rewards: 10.761, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.765', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon7': '0.048', 'AMMO3': '0.085', 'AMMO4': '0.089', 'weapon5': '0.140', 'WEAPON5': '0.200', 'weapon4': '0.204', 'WEAPON4': '0.250', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.860', 'weapon2': '1.288', 'weapon3': '1.458', 'DAMAGECOUNT': '3.279', 'FRAGCOUNT': '8.500'} [2023-02-24 19:00:10,305][177171] DAMAGECOUNT value on done: 243243.0 [2023-02-24 19:00:10,305][177171] Sum rewards: 11.107, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.023', 'AMMO5': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon7': '0.058', 'weapon5': '0.088', 'AMMO3': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.250', 'weapon4': '0.378', 'weapon2': '0.582', 'WEAPON3': '0.750', 'HITCOUNT': '1.070', 'weapon3': '1.818', 'DAMAGECOUNT': '4.320', 'FRAGCOUNT': '9.000'} [2023-02-24 19:00:10,314][177157] DAMAGECOUNT value on done: 241056.0 [2023-02-24 19:00:10,314][177157] Sum rewards: 23.939, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.542', 'AMMO5': '0.020', 'ARMOR': '0.020', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.146', 'weapon5': '0.204', 'weapon4': '0.370', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.860', 'WEAPON3': '0.900', 'HITCOUNT': '1.620', 'weapon3': '2.222', 'DAMAGECOUNT': '6.357', 'FRAGCOUNT': '22.000'} [2023-02-24 19:00:10,613][177171] DAMAGECOUNT value on done: 242789.0 [2023-02-24 19:00:10,613][177171] Sum rewards: 16.742, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.600', 'AMMO5': '0.011', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'AMMO3': '0.111', 'AMMO4': '0.114', 'weapon5': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'weapon4': '0.374', 'weapon2': '0.470', 'WEAPON3': '0.700', 'HITCOUNT': '1.140', 'weapon3': '2.232', 'DAMAGECOUNT': '4.251', 'FRAGCOUNT': '14.000'} [2023-02-24 19:00:11,376][177119] Fps is (10 sec: 13517.0, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 81457152. Throughput: 0: 3475.5. Samples: 20362692. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:00:11,376][177119] Avg episode reward: [(0, '13.732')] [2023-02-24 19:00:11,720][177155] DAMAGECOUNT value on done: 244201.0 [2023-02-24 19:00:11,720][177155] Sum rewards: 16.837, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.300', 'AMMO4': '-0.048', 'AMMO2': '-0.010', 'AMMO5': '0.019', 'WEAPON1': '0.080', 'AMMO3': '0.138', 'weapon5': '0.224', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'weapon2': '0.982', 'HITCOUNT': '1.260', 'weapon3': '2.220', 'DAMAGECOUNT': '5.121', 'FRAGCOUNT': '15.000'} [2023-02-24 19:00:11,983][177153] Updated weights for policy 0, policy_version 19890 (0.0008) [2023-02-24 19:00:12,020][177155] DAMAGECOUNT value on done: 254412.0 [2023-02-24 19:00:12,020][177155] Sum rewards: 14.343, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.860', 'AMMO2': '0.005', 'AMMO5': '0.013', 'AMMO4': '0.023', 'AMMO3': '0.088', 'weapon5': '0.146', 'WEAPON4': '0.150', 'weapon7': '0.158', 'WEAPON5': '0.200', 'weapon4': '0.238', 'AMMO6': '0.340', 'AMMO7': '0.340', 'ARMOR': '0.400', 'WEAPON7': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.800', 'weapon3': '1.134', 'weapon2': '1.286', 'DAMAGECOUNT': '4.332', 'FRAGCOUNT': '10.500'} [2023-02-24 19:00:12,397][177155] DAMAGECOUNT value on done: 250348.0 [2023-02-24 19:00:12,397][177155] Sum rewards: 14.853, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.888', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.094', 'weapon4': '0.142', 'AMMO3': '0.147', 'WEAPON5': '0.150', 'WEAPON3': '0.950', 'HITCOUNT': '1.120', 'weapon2': '1.418', 'weapon3': '2.070', 'DAMAGECOUNT': '4.581', 'FRAGCOUNT': '15.000'} [2023-02-24 19:00:12,693][177155] DAMAGECOUNT value on done: 237970.0 [2023-02-24 19:00:12,693][177155] Sum rewards: 6.612, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.090', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'weapon7': '0.006', 'AMMO5': '0.010', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.101', 'weapon5': '0.108', 'WEAPON4': '0.200', 'weapon4': '0.208', 'WEAPON5': '0.250', 'WEAPON3': '0.750', 'HITCOUNT': '1.110', 'weapon2': '1.118', 'weapon3': '1.948', 'DAMAGECOUNT': '4.104', 'FRAGCOUNT': '5.000'} [2023-02-24 19:00:14,884][177153] Updated weights for policy 0, policy_version 19900 (0.0008) [2023-02-24 19:00:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13870.9). Total num frames: 81530880. Throughput: 0: 3478.4. Samples: 20383650. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 19:00:16,376][177119] Avg episode reward: [(0, '13.798')] [2023-02-24 19:00:17,809][177153] Updated weights for policy 0, policy_version 19910 (0.0008) [2023-02-24 19:00:20,582][177156] DAMAGECOUNT value on done: 246422.0 [2023-02-24 19:00:20,583][177156] Sum rewards: 13.014, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.458', 'AMMO5': '0.022', 'AMMO2': '0.041', 'AMMO3': '0.097', 'weapon4': '0.200', 'AMMO4': '0.206', 'weapon5': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '1.060', 'weapon2': '1.342', 'weapon3': '1.860', 'DAMAGECOUNT': '4.248', 'FRAGCOUNT': '11.000'} [2023-02-24 19:00:20,604][177156] DAMAGECOUNT value on done: 241748.0 [2023-02-24 19:00:20,604][177156] Sum rewards: 12.077, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.816', 'AMMO2': '0.005', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.024', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.104', 'weapon4': '0.106', 'AMMO3': '0.108', 'WEAPON3': '0.750', 'HITCOUNT': '0.910', 'ARMOR': '0.952', 'weapon2': '1.290', 'weapon3': '2.196', 'DAMAGECOUNT': '3.723', 'FRAGCOUNT': '10.000'} [2023-02-24 19:00:20,736][177153] Updated weights for policy 0, policy_version 19920 (0.0008) [2023-02-24 19:00:20,821][177170] DAMAGECOUNT value on done: 247557.0 [2023-02-24 19:00:20,821][177170] Sum rewards: 13.706, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.289', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.318', 'weapon4': '0.562', 'WEAPON3': '1.250', 'HITCOUNT': '1.470', 'weapon3': '1.908', 'DAMAGECOUNT': '6.252', 'FRAGCOUNT': '16.000'} [2023-02-24 19:00:20,901][177156] DAMAGECOUNT value on done: 252631.0 [2023-02-24 19:00:20,902][177156] Sum rewards: 13.347, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.635', 'ARMOR': '0.008', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'AMMO3': '0.087', 'weapon7': '0.162', 'AMMO4': '0.171', 'weapon5': '0.204', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.370', 'WEAPON7': '0.400', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '0.550', 'weapon2': '0.900', 'HITCOUNT': '0.960', 'weapon3': '1.438', 'DAMAGECOUNT': '4.482', 'FRAGCOUNT': '12.000'} [2023-02-24 19:00:20,923][177156] DAMAGECOUNT value on done: 242890.0 [2023-02-24 19:00:20,923][177156] Sum rewards: 7.956, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.308', 'AMMO5': '0.005', 'AMMO2': '0.022', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'weapon7': '0.116', 'weapon5': '0.140', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'HITCOUNT': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.454', 'weapon3': '0.632', 'weapon4': '0.642', 'weapon2': '0.946', 'DAMAGECOUNT': '2.922', 'FRAGCOUNT': '7.000'} [2023-02-24 19:00:21,119][177170] DAMAGECOUNT value on done: 253264.0 [2023-02-24 19:00:21,119][177170] Sum rewards: 15.053, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.862', 'AMMO2': '0.007', 'AMMO5': '0.012', 'AMMO4': '0.036', 'weapon5': '0.116', 'AMMO3': '0.149', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.340', 'weapon2': '0.912', 'WEAPON3': '1.050', 'HITCOUNT': '1.210', 'weapon3': '2.334', 'DAMAGECOUNT': '5.748', 'FRAGCOUNT': '15.000'} [2023-02-24 19:00:21,376][177119] Fps is (10 sec: 14336.0, 60 sec: 13926.4, 300 sec: 13870.9). Total num frames: 81600512. Throughput: 0: 3480.3. Samples: 20394160. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 19:00:21,376][177119] Avg episode reward: [(0, '13.567')] [2023-02-24 19:00:21,605][177170] DAMAGECOUNT value on done: 245234.0 [2023-02-24 19:00:21,605][177170] Sum rewards: 5.763, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.350', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.054', 'weapon5': '0.058', 'weapon7': '0.172', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'WEAPON7': '0.400', 'weapon4': '0.490', 'HITCOUNT': '0.510', 'weapon2': '0.596', 'weapon3': '1.142', 'DAMAGECOUNT': '2.502', 'FRAGCOUNT': '5.000'} [2023-02-24 19:00:21,905][177170] DAMAGECOUNT value on done: 247202.0 [2023-02-24 19:00:21,905][177170] Sum rewards: 14.558, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.364', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.020', 'WEAPON1': '0.060', 'AMMO4': '0.098', 'AMMO3': '0.138', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.404', 'weapon2': '0.844', 'HITCOUNT': '0.850', 'WEAPON3': '0.950', 'weapon3': '2.120', 'DAMAGECOUNT': '4.941', 'FRAGCOUNT': '13.000'} [2023-02-24 19:00:22,447][177158] DAMAGECOUNT value on done: 238752.0 [2023-02-24 19:00:22,448][177158] Sum rewards: 6.898, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.240', 'AMMO5': '0.016', 'AMMO2': '0.027', 'WEAPON1': '0.060', 'AMMO3': '0.116', 'AMMO4': '0.132', 'WEAPON4': '0.250', 'weapon5': '0.270', 'weapon4': '0.336', 'WEAPON5': '0.500', 'HITCOUNT': '0.790', 'WEAPON3': '0.850', 'weapon2': '1.160', 'weapon3': '1.680', 'DAMAGECOUNT': '3.450', 'FRAGCOUNT': '7.000'} [2023-02-24 19:00:22,749][177158] DAMAGECOUNT value on done: 239125.0 [2023-02-24 19:00:22,750][177158] Sum rewards: 4.051, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.326', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.011', 'weapon5': '0.022', 'AMMO4': '0.057', 'AMMO3': '0.058', 'weapon7': '0.096', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon2': '0.136', 'WEAPON7': '0.200', 'HITCOUNT': '0.240', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'weapon4': '0.406', 'weapon3': '0.508', 'DAMAGECOUNT': '1.389', 'FRAGCOUNT': '5.000'} [2023-02-24 19:00:23,564][177158] DAMAGECOUNT value on done: 250153.0 [2023-02-24 19:00:23,565][177158] Sum rewards: 6.956, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.400', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.056', 'weapon7': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.113', 'weapon5': '0.122', 'WEAPON5': '0.350', 'weapon4': '0.432', 'WEAPON3': '0.450', 'weapon2': '0.484', 'HITCOUNT': '0.620', 'weapon3': '1.120', 'DAMAGECOUNT': '2.556', 'FRAGCOUNT': '5.000'} [2023-02-24 19:00:23,710][177153] Updated weights for policy 0, policy_version 19930 (0.0008) [2023-02-24 19:00:23,860][177158] DAMAGECOUNT value on done: 249439.0 [2023-02-24 19:00:23,861][177158] Sum rewards: 10.094, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.211', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO4': '0.077', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.120', 'weapon7': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.380', 'weapon2': '0.692', 'WEAPON3': '0.850', 'HITCOUNT': '0.880', 'weapon3': '1.568', 'DAMAGECOUNT': '4.266', 'FRAGCOUNT': '10.000'} [2023-02-24 19:00:26,340][177172] DAMAGECOUNT value on done: 243636.0 [2023-02-24 19:00:26,341][177172] Sum rewards: 0.729, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.274', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.034', 'AMMO3': '0.044', 'WEAPON5': '0.050', 'weapon7': '0.152', 'AMMO4': '0.169', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.250', 'WEAPON7': '0.300', 'HITCOUNT': '0.320', 'WEAPON4': '0.500', 'weapon2': '0.530', 'weapon3': '0.586', 'DAMAGECOUNT': '0.852', 'FRAGCOUNT': '1.000', 'weapon4': '1.020'} [2023-02-24 19:00:26,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13884.7). Total num frames: 81670144. Throughput: 0: 3478.2. Samples: 20415032. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 19:00:26,376][177119] Avg episode reward: [(0, '13.095')] [2023-02-24 19:00:26,626][177153] Updated weights for policy 0, policy_version 19940 (0.0009) [2023-02-24 19:00:26,644][177172] DAMAGECOUNT value on done: 238130.0 [2023-02-24 19:00:26,644][177172] Sum rewards: 12.700, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.920', 'AMMO2': '0.012', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.061', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'weapon5': '0.112', 'weapon4': '0.234', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '0.880', 'weapon2': '1.090', 'weapon3': '1.878', 'DAMAGECOUNT': '3.480', 'FRAGCOUNT': '11.500'} [2023-02-24 19:00:28,102][177154] DAMAGECOUNT value on done: 248444.0 [2023-02-24 19:00:28,102][177154] Sum rewards: 1.636, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.395', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.031', 'AMMO3': '0.053', 'weapon7': '0.084', 'weapon5': '0.092', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.144', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.260', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.945', 'weapon3': '0.992', 'weapon2': '1.206'} [2023-02-24 19:00:28,123][177172] DAMAGECOUNT value on done: 252677.0 [2023-02-24 19:00:28,124][177172] Sum rewards: 19.956, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.535', 'WEAPON1': '0.010', 'AMMO5': '0.025', 'AMMO2': '0.032', 'weapon7': '0.106', 'AMMO3': '0.112', 'AMMO4': '0.160', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon5': '0.252', 'WEAPON7': '0.400', 'WEAPON4': '0.400', 'ARMOR': '0.404', 'WEAPON5': '0.450', 'weapon4': '0.464', 'WEAPON3': '0.700', 'weapon2': '0.762', 'HITCOUNT': '1.490', 'weapon3': '2.038', 'DAMAGECOUNT': '6.456', 'FRAGCOUNT': '15.500'} [2023-02-24 19:00:28,396][177154] DAMAGECOUNT value on done: 254816.0 [2023-02-24 19:00:28,397][177154] Sum rewards: 14.380, reward structure: {'DEATHCOUNT': '-6.750', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO3': '0.086', 'AMMO4': '0.135', 'weapon5': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HEALTH': '0.230', 'weapon4': '0.304', 'ARMOR': '0.404', 'WEAPON3': '0.500', 'HITCOUNT': '0.800', 'weapon2': '0.962', 'weapon3': '1.466', 'DAMAGECOUNT': '4.125', 'FRAGCOUNT': '11.500'} [2023-02-24 19:00:28,414][177172] DAMAGECOUNT value on done: 239762.0 [2023-02-24 19:00:28,415][177172] Sum rewards: 3.357, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'HEALTH': '0.020', 'AMMO2': '0.041', 'weapon7': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.111', 'weapon5': '0.198', 'WEAPON5': '0.200', 'AMMO4': '0.205', 'WEAPON4': '0.250', 'HITCOUNT': '0.390', 'ARMOR': '0.408', 'weapon4': '0.564', 'WEAPON3': '0.600', 'weapon2': '0.774', 'weapon3': '1.244', 'DAMAGECOUNT': '1.971', 'FRAGCOUNT': '5.000'} [2023-02-24 19:00:28,689][177154] DAMAGECOUNT value on done: 258838.0 [2023-02-24 19:00:28,689][177154] Sum rewards: 14.082, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.020', 'AMMO5': '0.013', 'WEAPON1': '0.030', 'AMMO2': '0.033', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.107', 'AMMO4': '0.165', 'weapon5': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'weapon2': '0.636', 'weapon4': '0.648', 'HITCOUNT': '0.750', 'weapon3': '1.634', 'DAMAGECOUNT': '3.801', 'FRAGCOUNT': '12.000'} [2023-02-24 19:00:28,994][177154] DAMAGECOUNT value on done: 252804.0 [2023-02-24 19:00:28,994][177154] Sum rewards: 14.031, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.678', 'weapon7': '0.012', 'AMMO2': '0.012', 'AMMO5': '0.022', 'WEAPON1': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.226', 'weapon4': '0.280', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '1.000', 'weapon2': '1.144', 'weapon3': '1.932', 'DAMAGECOUNT': '4.077', 'FRAGCOUNT': '13.500'} [2023-02-24 19:00:29,249][177157] DAMAGECOUNT value on done: 256255.0 [2023-02-24 19:00:29,250][177157] Sum rewards: 16.278, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.282', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.019', 'weapon7': '0.072', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.234', 'weapon2': '0.568', 'WEAPON3': '0.900', 'HITCOUNT': '1.290', 'weapon3': '1.824', 'DAMAGECOUNT': '5.406', 'FRAGCOUNT': '16.000'} [2023-02-24 19:00:29,295][177157] DAMAGECOUNT value on done: 238308.0 [2023-02-24 19:00:29,295][177157] Sum rewards: 4.927, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.148', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.056', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'weapon7': '0.134', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'HITCOUNT': '0.500', 'weapon4': '0.512', 'WEAPON3': '0.550', 'weapon2': '0.826', 'weapon3': '1.314', 'DAMAGECOUNT': '1.947', 'FRAGCOUNT': '4.000'} [2023-02-24 19:00:29,303][177171] DAMAGECOUNT value on done: 241949.0 [2023-02-24 19:00:29,304][177171] Sum rewards: 14.914, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.707', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.031', 'WEAPON1': '0.040', 'AMMO3': '0.063', 'AMMO4': '0.157', 'WEAPON4': '0.200', 'weapon5': '0.364', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon4': '0.580', 'HITCOUNT': '0.650', 'weapon2': '1.168', 'weapon3': '1.446', 'DAMAGECOUNT': '3.450', 'FRAGCOUNT': '11.000'} [2023-02-24 19:00:29,553][177153] Updated weights for policy 0, policy_version 19950 (0.0009) [2023-02-24 19:00:29,557][177157] DAMAGECOUNT value on done: 240121.0 [2023-02-24 19:00:29,557][177157] Sum rewards: 14.782, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.963', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.033', 'AMMO3': '0.095', 'weapon7': '0.124', 'weapon5': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.340', 'WEAPON7': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '1.000', 'weapon2': '1.030', 'weapon3': '1.606', 'DAMAGECOUNT': '4.224', 'FRAGCOUNT': '12.000'} [2023-02-24 19:00:29,597][177171] DAMAGECOUNT value on done: 244407.0 [2023-02-24 19:00:29,597][177171] Sum rewards: 14.151, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.020', 'weapon7': '0.050', 'HEALTH': '0.072', 'AMMO3': '0.081', 'weapon5': '0.096', 'AMMO4': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'WEAPON3': '0.550', 'weapon4': '0.736', 'HITCOUNT': '0.880', 'weapon2': '0.904', 'weapon3': '1.308', 'DAMAGECOUNT': '3.492', 'FRAGCOUNT': '12.000'} [2023-02-24 19:00:29,601][177157] DAMAGECOUNT value on done: 242690.0 [2023-02-24 19:00:29,601][177157] Sum rewards: 14.678, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.474', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon7': '0.092', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.127', 'WEAPON4': '0.250', 'weapon5': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.652', 'weapon2': '0.746', 'WEAPON3': '0.850', 'HITCOUNT': '1.090', 'weapon3': '1.338', 'DAMAGECOUNT': '4.902', 'FRAGCOUNT': '14.000'} [2023-02-24 19:00:29,607][177171] DAMAGECOUNT value on done: 250073.0 [2023-02-24 19:00:29,608][177171] Sum rewards: 17.597, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.240', 'AMMO5': '0.015', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'weapon5': '0.090', 'AMMO4': '0.094', 'AMMO3': '0.120', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.408', 'WEAPON3': '0.900', 'weapon2': '0.956', 'HITCOUNT': '1.540', 'weapon3': '2.086', 'DAMAGECOUNT': '6.129', 'FRAGCOUNT': '15.000'} [2023-02-24 19:00:29,897][177171] DAMAGECOUNT value on done: 244759.0 [2023-02-24 19:00:29,898][177171] Sum rewards: 16.734, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.536', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO2': '0.038', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.128', 'AMMO3': '0.136', 'AMMO4': '0.188', 'weapon4': '0.308', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'weapon2': '0.928', 'HITCOUNT': '1.390', 'weapon3': '2.346', 'DAMAGECOUNT': '5.910', 'FRAGCOUNT': '15.500'} [2023-02-24 19:00:30,967][177155] DAMAGECOUNT value on done: 244981.0 [2023-02-24 19:00:30,967][177155] Sum rewards: 3.705, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.744', 'AMMO2': '0.006', 'AMMO4': '0.028', 'AMMO5': '0.029', 'WEAPON1': '0.060', 'weapon7': '0.088', 'AMMO3': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.144', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.384', 'ARMOR': '0.465', 'WEAPON5': '0.550', 'HITCOUNT': '0.580', 'weapon2': '0.594', 'WEAPON3': '0.700', 'weapon3': '1.236', 'DAMAGECOUNT': '2.340', 'FRAGCOUNT': '5.000'} [2023-02-24 19:00:31,287][177155] DAMAGECOUNT value on done: 256083.0 [2023-02-24 19:00:31,288][177155] Sum rewards: 16.463, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.583', 'AMMO2': '0.004', 'AMMO5': '0.017', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO3': '0.134', 'weapon5': '0.134', 'weapon4': '0.236', 'WEAPON5': '0.450', 'weapon2': '0.776', 'WEAPON3': '0.900', 'HITCOUNT': '1.110', 'weapon3': '2.380', 'DAMAGECOUNT': '5.013', 'FRAGCOUNT': '14.000'} [2023-02-24 19:00:31,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13884.7). Total num frames: 81739776. Throughput: 0: 3478.0. Samples: 20435934. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 19:00:31,376][177119] Avg episode reward: [(0, '12.763')] [2023-02-24 19:00:31,635][177155] DAMAGECOUNT value on done: 252123.0 [2023-02-24 19:00:31,636][177155] Sum rewards: 13.956, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.900', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO4': '0.069', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'weapon4': '0.210', 'weapon5': '0.336', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'weapon2': '1.000', 'HITCOUNT': '1.170', 'weapon3': '2.066', 'DAMAGECOUNT': '5.325', 'FRAGCOUNT': '12.000'} [2023-02-24 19:00:31,930][177155] DAMAGECOUNT value on done: 239718.0 [2023-02-24 19:00:31,930][177155] Sum rewards: 11.376, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.276', 'ARMOR': '0.004', 'AMMO2': '0.017', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'weapon7': '0.052', 'AMMO4': '0.085', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.144', 'AMMO3': '0.155', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.468', 'weapon2': '0.578', 'WEAPON3': '1.050', 'HITCOUNT': '1.280', 'weapon3': '2.178', 'DAMAGECOUNT': '5.244', 'FRAGCOUNT': '14.000'} [2023-02-24 19:00:32,475][177153] Updated weights for policy 0, policy_version 19960 (0.0008) [2023-02-24 19:00:35,436][177153] Updated weights for policy 0, policy_version 19970 (0.0009) [2023-02-24 19:00:36,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13884.7). Total num frames: 81809408. Throughput: 0: 3480.3. Samples: 20446492. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 19:00:36,376][177119] Avg episode reward: [(0, '12.859')] [2023-02-24 19:00:38,379][177153] Updated weights for policy 0, policy_version 19980 (0.0008) [2023-02-24 19:00:39,934][177156] DAMAGECOUNT value on done: 248355.0 [2023-02-24 19:00:39,935][177156] Sum rewards: 19.646, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.015', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon7': '0.064', 'AMMO4': '0.079', 'weapon5': '0.090', 'AMMO3': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'HEALTH': '0.162', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.404', 'WEAPON3': '0.600', 'weapon2': '0.730', 'HITCOUNT': '1.370', 'weapon3': '2.296', 'DAMAGECOUNT': '5.799', 'FRAGCOUNT': '14.500'} [2023-02-24 19:00:39,954][177156] DAMAGECOUNT value on done: 242988.0 [2023-02-24 19:00:39,955][177156] Sum rewards: 9.729, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.620', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.024', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.114', 'AMMO4': '0.121', 'AMMO3': '0.182', 'WEAPON4': '0.300', 'ARMOR': '0.458', 'weapon2': '0.634', 'weapon4': '0.662', 'HITCOUNT': '1.070', 'WEAPON3': '1.200', 'weapon3': '1.944', 'DAMAGECOUNT': '3.720', 'FRAGCOUNT': '12.000'} [2023-02-24 19:00:40,057][177170] DAMAGECOUNT value on done: 248875.0 [2023-02-24 19:00:40,057][177170] Sum rewards: 11.493, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.248', 'ARMOR': '0.004', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon7': '0.048', 'AMMO3': '0.093', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.120', 'weapon5': '0.166', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.370', 'WEAPON3': '0.500', 'HITCOUNT': '0.740', 'weapon3': '1.264', 'weapon2': '1.530', 'DAMAGECOUNT': '3.954', 'FRAGCOUNT': '8.000'} [2023-02-24 19:00:40,244][177156] DAMAGECOUNT value on done: 253910.0 [2023-02-24 19:00:40,244][177156] Sum rewards: 17.637, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.921', 'AMMO2': '0.018', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'AMMO3': '0.083', 'AMMO4': '0.091', 'weapon4': '0.092', 'WEAPON4': '0.100', 'weapon5': '0.284', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '1.050', 'weapon2': '1.436', 'weapon3': '1.714', 'DAMAGECOUNT': '3.837', 'FRAGCOUNT': '14.000'} [2023-02-24 19:00:40,266][177156] DAMAGECOUNT value on done: 243838.0 [2023-02-24 19:00:40,267][177156] Sum rewards: 4.331, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.084', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'weapon7': '0.080', 'weapon5': '0.092', 'AMMO3': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.228', 'weapon2': '0.236', 'WEAPON3': '0.650', 'HITCOUNT': '0.740', 'weapon3': '1.626', 'DAMAGECOUNT': '2.844', 'FRAGCOUNT': '5.000'} [2023-02-24 19:00:40,356][177170] DAMAGECOUNT value on done: 254700.0 [2023-02-24 19:00:40,356][177170] Sum rewards: 13.089, reward structure: {'DEATHCOUNT': '-7.500', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.110', 'HEALTH': '0.320', 'weapon5': '0.338', 'WEAPON5': '0.400', 'weapon4': '0.410', 'WEAPON3': '0.650', 'HITCOUNT': '0.720', 'weapon2': '0.818', 'weapon3': '1.764', 'DAMAGECOUNT': '4.308', 'FRAGCOUNT': '10.500'} [2023-02-24 19:00:40,915][177170] DAMAGECOUNT value on done: 245740.0 [2023-02-24 19:00:40,916][177170] Sum rewards: 5.485, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.600', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.055', 'AMMO3': '0.060', 'weapon5': '0.086', 'weapon7': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.210', 'weapon4': '0.310', 'WEAPON3': '0.400', 'weapon2': '0.572', 'weapon3': '0.710', 'DAMAGECOUNT': '1.518', 'FRAGCOUNT': '5.000'} [2023-02-24 19:00:41,221][177170] DAMAGECOUNT value on done: 248229.0 [2023-02-24 19:00:41,222][177170] Sum rewards: 7.424, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.920', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.011', 'WEAPON4': '0.050', 'weapon7': '0.062', 'weapon5': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.102', 'weapon4': '0.208', 'WEAPON5': '0.250', 'WEAPON3': '0.750', 'HITCOUNT': '0.800', 'weapon2': '0.882', 'weapon3': '1.506', 'DAMAGECOUNT': '3.081', 'FRAGCOUNT': '7.000'} [2023-02-24 19:00:41,342][177153] Updated weights for policy 0, policy_version 19990 (0.0008) [2023-02-24 19:00:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13884.7). Total num frames: 81879040. Throughput: 0: 3479.2. Samples: 20467270. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:00:41,376][177119] Avg episode reward: [(0, '12.839')] [2023-02-24 19:00:41,787][177158] DAMAGECOUNT value on done: 239818.0 [2023-02-24 19:00:41,788][177158] Sum rewards: 7.771, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.720', 'AMMO5': '0.016', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO4': '0.125', 'AMMO3': '0.139', 'weapon4': '0.148', 'weapon5': '0.238', 'WEAPON5': '0.350', 'weapon2': '0.772', 'HITCOUNT': '0.940', 'WEAPON3': '1.000', 'weapon3': '2.400', 'DAMAGECOUNT': '3.198', 'FRAGCOUNT': '9.000'} [2023-02-24 19:00:42,087][177158] DAMAGECOUNT value on done: 240242.0 [2023-02-24 19:00:42,088][177158] Sum rewards: 13.069, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.985', 'AMMO5': '0.015', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.078', 'weapon7': '0.094', 'weapon5': '0.224', 'AMMO6': '0.260', 'AMMO7': '0.260', 'weapon4': '0.274', 'WEAPON7': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '0.770', 'weapon2': '1.198', 'weapon3': '1.538', 'DAMAGECOUNT': '3.351', 'FRAGCOUNT': '9.000'} [2023-02-24 19:00:42,852][177158] DAMAGECOUNT value on done: 252229.0 [2023-02-24 19:00:42,853][177158] Sum rewards: 19.015, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.670', 'AMMO4': '-0.033', 'AMMO2': '-0.006', 'AMMO5': '0.014', 'WEAPON1': '0.060', 'AMMO3': '0.134', 'weapon5': '0.280', 'WEAPON5': '0.400', 'WEAPON3': '0.950', 'weapon2': '0.980', 'HITCOUNT': '1.390', 'weapon3': '2.288', 'DAMAGECOUNT': '6.228', 'FRAGCOUNT': '17.000'} [2023-02-24 19:00:43,146][177158] DAMAGECOUNT value on done: 251898.0 [2023-02-24 19:00:43,146][177158] Sum rewards: 24.485, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.209', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.169', 'weapon5': '0.212', 'WEAPON4': '0.250', 'ARMOR': '0.454', 'WEAPON5': '0.500', 'weapon4': '0.526', 'weapon2': '0.598', 'WEAPON3': '1.050', 'HITCOUNT': '1.750', 'weapon3': '2.364', 'DAMAGECOUNT': '7.377', 'FRAGCOUNT': '21.500'} [2023-02-24 19:00:44,289][177153] Updated weights for policy 0, policy_version 20000 (0.0008) [2023-02-24 19:00:45,628][177172] DAMAGECOUNT value on done: 245815.0 [2023-02-24 19:00:45,629][177172] Sum rewards: 20.600, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.100', 'AMMO5': '0.019', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'weapon7': '0.074', 'AMMO3': '0.075', 'AMMO4': '0.131', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon5': '0.346', 'weapon2': '0.486', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon4': '0.714', 'ARMOR': '0.855', 'HITCOUNT': '1.290', 'weapon3': '1.526', 'DAMAGECOUNT': '6.537', 'FRAGCOUNT': '16.500'} [2023-02-24 19:00:45,931][177172] DAMAGECOUNT value on done: 239341.0 [2023-02-24 19:00:45,932][177172] Sum rewards: 8.703, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.776', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.120', 'AMMO4': '0.125', 'weapon5': '0.136', 'WEAPON4': '0.200', 'weapon4': '0.344', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'HITCOUNT': '0.810', 'weapon2': '0.916', 'weapon3': '2.130', 'DAMAGECOUNT': '3.633', 'FRAGCOUNT': '8.000'} [2023-02-24 19:00:46,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13884.7). Total num frames: 81948672. Throughput: 0: 3480.9. Samples: 20488136. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:00:46,376][177119] Avg episode reward: [(0, '13.035')] [2023-02-24 19:00:47,219][177153] Updated weights for policy 0, policy_version 20010 (0.0008) [2023-02-24 19:00:47,403][177154] DAMAGECOUNT value on done: 250400.0 [2023-02-24 19:00:47,403][177154] Sum rewards: 18.791, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.408', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'weapon7': '0.020', 'AMMO2': '0.033', 'AMMO3': '0.120', 'weapon5': '0.162', 'AMMO4': '0.164', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.358', 'weapon4': '0.594', 'WEAPON3': '0.800', 'HITCOUNT': '1.360', 'weapon3': '2.232', 'DAMAGECOUNT': '5.868', 'FRAGCOUNT': '16.000'} [2023-02-24 19:00:47,406][177172] DAMAGECOUNT value on done: 254052.0 [2023-02-24 19:00:47,407][177172] Sum rewards: 8.309, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.244', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'weapon5': '0.030', 'AMMO2': '0.032', 'ARMOR': '0.040', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'AMMO4': '0.162', 'WEAPON4': '0.300', 'weapon4': '0.350', 'weapon2': '0.826', 'WEAPON3': '1.000', 'HITCOUNT': '1.020', 'weapon3': '2.340', 'DAMAGECOUNT': '4.110', 'FRAGCOUNT': '11.000'} [2023-02-24 19:00:47,706][177154] DAMAGECOUNT value on done: 255574.0 [2023-02-24 19:00:47,706][177154] Sum rewards: 6.149, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.616', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.030', 'WEAPON1': '0.050', 'AMMO3': '0.073', 'weapon7': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.147', 'weapon5': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.450', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'weapon2': '0.992', 'weapon3': '1.226', 'DAMAGECOUNT': '2.274', 'FRAGCOUNT': '7.000'} [2023-02-24 19:00:47,719][177172] DAMAGECOUNT value on done: 241830.0 [2023-02-24 19:00:47,719][177172] Sum rewards: 15.944, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.865', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'weapon5': '0.056', 'AMMO4': '0.065', 'AMMO3': '0.102', 'weapon7': '0.182', 'WEAPON5': '0.200', 'weapon4': '0.220', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.700', 'weapon2': '0.790', 'HITCOUNT': '0.900', 'weapon3': '1.862', 'DAMAGECOUNT': '4.359', 'FRAGCOUNT': '13.000'} [2023-02-24 19:00:48,000][177154] DAMAGECOUNT value on done: 260243.0 [2023-02-24 19:00:48,000][177154] Sum rewards: 10.121, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.500', 'AMMO5': '0.022', 'AMMO2': '0.034', 'WEAPON1': '0.040', 'weapon7': '0.040', 'weapon4': '0.098', 'AMMO3': '0.146', 'weapon5': '0.158', 'AMMO4': '0.171', 'WEAPON4': '0.200', 'AMMO6': '0.360', 'AMMO7': '0.360', 'WEAPON7': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '0.950', 'weapon2': '0.968', 'HITCOUNT': '0.990', 'weapon3': '2.418', 'DAMAGECOUNT': '4.215', 'FRAGCOUNT': '10.000'} [2023-02-24 19:00:48,302][177154] DAMAGECOUNT value on done: 254195.0 [2023-02-24 19:00:48,303][177154] Sum rewards: 15.810, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.915', 'AMMO5': '0.018', 'AMMO2': '0.036', 'weapon5': '0.040', 'AMMO3': '0.106', 'AMMO4': '0.179', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.396', 'ARMOR': '0.404', 'WEAPON3': '0.650', 'weapon2': '0.772', 'HITCOUNT': '1.160', 'weapon3': '2.142', 'DAMAGECOUNT': '4.173', 'FRAGCOUNT': '13.500'} [2023-02-24 19:00:48,545][177157] DAMAGECOUNT value on done: 239179.0 [2023-02-24 19:00:48,545][177157] Sum rewards: 10.046, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.540', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO3': '0.030', 'WEAPON1': '0.040', 'AMMO4': '0.062', 'weapon5': '0.122', 'weapon7': '0.136', 'WEAPON5': '0.150', 'WEAPON3': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'HITCOUNT': '0.350', 'weapon3': '0.578', 'weapon4': '0.810', 'weapon2': '0.888', 'DAMAGECOUNT': '2.613', 'FRAGCOUNT': '8.000'} [2023-02-24 19:00:48,555][177157] DAMAGECOUNT value on done: 257767.0 [2023-02-24 19:00:48,556][177157] Sum rewards: 17.039, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.950', 'AMMO2': '0.012', 'AMMO5': '0.014', 'AMMO4': '0.062', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'weapon5': '0.198', 'weapon4': '0.268', 'WEAPON5': '0.350', 'ARMOR': '0.458', 'WEAPON3': '0.700', 'weapon2': '1.004', 'HITCOUNT': '1.230', 'weapon3': '2.148', 'DAMAGECOUNT': '4.536', 'FRAGCOUNT': '15.000'} [2023-02-24 19:00:48,589][177171] DAMAGECOUNT value on done: 244029.0 [2023-02-24 19:00:48,590][177171] Sum rewards: 20.194, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.238', 'AMMO5': '0.015', 'AMMO2': '0.026', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'weapon4': '0.112', 'AMMO4': '0.129', 'AMMO3': '0.136', 'weapon5': '0.178', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'weapon2': '1.186', 'HITCOUNT': '1.190', 'weapon3': '2.130', 'DAMAGECOUNT': '6.240', 'FRAGCOUNT': '16.000'} [2023-02-24 19:00:48,851][177157] DAMAGECOUNT value on done: 244266.0 [2023-02-24 19:00:48,852][177157] Sum rewards: 14.685, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.570', 'AMMO2': '0.014', 'AMMO5': '0.029', 'WEAPON1': '0.030', 'AMMO4': '0.069', 'weapon4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon5': '0.448', 'WEAPON3': '0.750', 'WEAPON5': '0.800', 'HITCOUNT': '0.860', 'weapon2': '1.002', 'weapon3': '1.982', 'DAMAGECOUNT': '4.728', 'FRAGCOUNT': '13.500'} [2023-02-24 19:00:48,862][177157] DAMAGECOUNT value on done: 240849.0 [2023-02-24 19:00:48,862][177157] Sum rewards: 8.852, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.765', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'AMMO3': '0.030', 'WEAPON5': '0.050', 'weapon7': '0.080', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.230', 'WEAPON3': '0.250', 'weapon2': '0.496', 'HITCOUNT': '0.510', 'weapon3': '0.530', 'DAMAGECOUNT': '2.184', 'FRAGCOUNT': '7.000'} [2023-02-24 19:00:48,886][177171] DAMAGECOUNT value on done: 246153.0 [2023-02-24 19:00:48,886][177171] Sum rewards: 19.177, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.058', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.055', 'weapon5': '0.078', 'AMMO3': '0.127', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.296', 'WEAPON3': '0.800', 'HITCOUNT': '1.270', 'weapon2': '1.598', 'weapon3': '1.774', 'DAMAGECOUNT': '5.238', 'FRAGCOUNT': '16.000'} [2023-02-24 19:00:48,897][177171] DAMAGECOUNT value on done: 251151.0 [2023-02-24 19:00:48,897][177171] Sum rewards: 5.919, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.160', 'AMMO2': '0.006', 'AMMO5': '0.022', 'AMMO4': '0.031', 'WEAPON1': '0.050', 'weapon5': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'weapon4': '0.144', 'WEAPON5': '0.350', 'HITCOUNT': '0.690', 'WEAPON3': '0.750', 'weapon2': '1.204', 'weapon3': '2.060', 'DAMAGECOUNT': '3.234', 'FRAGCOUNT': '5.000'} [2023-02-24 19:00:49,191][177171] DAMAGECOUNT value on done: 245786.0 [2023-02-24 19:00:49,192][177171] Sum rewards: 10.426, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.270', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO3': '0.085', 'weapon5': '0.116', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.810', 'weapon2': '1.300', 'weapon3': '1.866', 'DAMAGECOUNT': '3.081', 'FRAGCOUNT': '8.000'} [2023-02-24 19:00:50,167][177153] Updated weights for policy 0, policy_version 20020 (0.0008) [2023-02-24 19:00:50,325][177155] DAMAGECOUNT value on done: 246861.0 [2023-02-24 19:00:50,325][177155] Sum rewards: 19.230, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.075', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.128', 'AMMO3': '0.141', 'weapon5': '0.186', 'WEAPON5': '0.500', 'weapon2': '0.882', 'WEAPON3': '0.950', 'HITCOUNT': '1.280', 'weapon3': '2.262', 'DAMAGECOUNT': '5.640', 'FRAGCOUNT': '18.000'} [2023-02-24 19:00:50,618][177155] DAMAGECOUNT value on done: 256601.0 [2023-02-24 19:00:50,619][177155] Sum rewards: 6.408, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.063', 'WEAPON4': '0.100', 'HEALTH': '0.172', 'weapon7': '0.214', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.382', 'HITCOUNT': '0.390', 'WEAPON3': '0.400', 'weapon2': '0.462', 'weapon3': '1.254', 'DAMAGECOUNT': '1.554', 'FRAGCOUNT': '5.000'} [2023-02-24 19:00:50,919][177155] DAMAGECOUNT value on done: 253609.0 [2023-02-24 19:00:50,919][177155] Sum rewards: 14.155, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.300', 'AMMO5': '0.014', 'AMMO2': '0.023', 'weapon7': '0.038', 'WEAPON1': '0.040', 'AMMO3': '0.075', 'AMMO4': '0.117', 'weapon5': '0.164', 'WEAPON5': '0.300', 'AMMO6': '0.400', 'WEAPON7': '0.400', 'AMMO7': '0.400', 'ARMOR': '0.480', 'WEAPON4': '0.550', 'WEAPON3': '0.600', 'weapon4': '0.672', 'HITCOUNT': '1.080', 'weapon2': '1.198', 'weapon3': '1.446', 'DAMAGECOUNT': '4.458', 'FRAGCOUNT': '13.000'} [2023-02-24 19:00:51,217][177155] DAMAGECOUNT value on done: 240490.0 [2023-02-24 19:00:51,218][177155] Sum rewards: 9.040, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.664', 'AMMO2': '0.004', 'AMMO5': '0.012', 'AMMO4': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.070', 'weapon7': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.188', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.442', 'ARMOR': '0.453', 'WEAPON3': '0.500', 'weapon2': '0.536', 'HITCOUNT': '0.690', 'weapon3': '1.648', 'DAMAGECOUNT': '2.316', 'FRAGCOUNT': '7.000'} [2023-02-24 19:00:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13884.7). Total num frames: 82018304. Throughput: 0: 3481.9. Samples: 20498570. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:00:51,376][177119] Avg episode reward: [(0, '12.978')] [2023-02-24 19:00:53,121][177153] Updated weights for policy 0, policy_version 20030 (0.0008) [2023-02-24 19:00:56,069][177153] Updated weights for policy 0, policy_version 20040 (0.0009) [2023-02-24 19:00:56,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13884.7). Total num frames: 82087936. Throughput: 0: 3483.5. Samples: 20519450. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 19:00:56,376][177119] Avg episode reward: [(0, '12.978')] [2023-02-24 19:00:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000020041_82087936.pth... [2023-02-24 19:00:56,436][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000019228_78757888.pth [2023-02-24 19:00:58,437][177170] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 19:00:59,023][177153] Updated weights for policy 0, policy_version 20050 (0.0008) [2023-02-24 19:00:59,355][177156] DAMAGECOUNT value on done: 250038.0 [2023-02-24 19:00:59,356][177156] Sum rewards: 9.337, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.008', 'AMMO5': '0.022', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'AMMO4': '0.125', 'AMMO3': '0.234', 'weapon5': '0.234', 'WEAPON4': '0.250', 'weapon4': '0.326', 'WEAPON5': '0.500', 'weapon2': '0.836', 'HITCOUNT': '1.170', 'WEAPON3': '1.400', 'weapon3': '2.134', 'DAMAGECOUNT': '5.049', 'FRAGCOUNT': '12.500'} [2023-02-24 19:00:59,358][177170] DAMAGECOUNT value on done: 249893.0 [2023-02-24 19:00:59,359][177170] Sum rewards: 10.322, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.887', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.071', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.114', 'weapon4': '0.210', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.830', 'weapon3': '1.360', 'weapon2': '1.960', 'DAMAGECOUNT': '3.054', 'FRAGCOUNT': '9.000'} [2023-02-24 19:00:59,379][177156] DAMAGECOUNT value on done: 244534.0 [2023-02-24 19:00:59,379][177156] Sum rewards: 15.171, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.682', 'AMMO2': '0.019', 'WEAPON1': '0.030', 'AMMO5': '0.036', 'AMMO4': '0.092', 'AMMO3': '0.148', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon5': '0.262', 'weapon7': '0.262', 'WEAPON7': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.520', 'WEAPON5': '0.700', 'weapon4': '0.780', 'WEAPON3': '1.000', 'HITCOUNT': '1.070', 'weapon3': '1.666', 'DAMAGECOUNT': '4.638', 'FRAGCOUNT': '15.000'} [2023-02-24 19:00:59,655][177170] DAMAGECOUNT value on done: 256713.0 [2023-02-24 19:00:59,655][177170] Sum rewards: 17.589, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.876', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO3': '0.100', 'weapon5': '0.122', 'AMMO4': '0.123', 'weapon7': '0.204', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.540', 'WEAPON3': '0.650', 'HITCOUNT': '0.960', 'weapon2': '1.108', 'weapon3': '1.466', 'DAMAGECOUNT': '5.772', 'FRAGCOUNT': '14.500'} [2023-02-24 19:00:59,668][177156] DAMAGECOUNT value on done: 255865.0 [2023-02-24 19:00:59,668][177156] Sum rewards: 23.679, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.528', 'weapon7': '0.014', 'AMMO5': '0.015', 'AMMO2': '0.040', 'WEAPON1': '0.040', 'AMMO3': '0.095', 'weapon5': '0.156', 'AMMO4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.428', 'WEAPON3': '0.550', 'weapon2': '0.868', 'HITCOUNT': '1.280', 'weapon3': '1.556', 'DAMAGECOUNT': '5.865', 'FRAGCOUNT': '20.000'} [2023-02-24 19:00:59,690][177156] DAMAGECOUNT value on done: 245190.0 [2023-02-24 19:00:59,691][177156] Sum rewards: 12.049, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.903', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.025', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'AMMO3': '0.150', 'weapon4': '0.202', 'weapon5': '0.264', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.796', 'WEAPON3': '0.950', 'HITCOUNT': '0.970', 'weapon3': '2.288', 'DAMAGECOUNT': '4.056', 'FRAGCOUNT': '12.000'} [2023-02-24 19:00:59,974][177171] Large shaping reward 2.541 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.519, 173.0), ('weapon5', 0.002)] [2023-02-24 19:01:00,243][177170] DAMAGECOUNT value on done: 246689.0 [2023-02-24 19:01:00,243][177170] Sum rewards: 9.202, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.510', 'ARMOR': '0.004', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.021', 'AMMO3': '0.087', 'weapon7': '0.176', 'weapon5': '0.190', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'WEAPON3': '0.650', 'weapon2': '0.682', 'weapon4': '0.742', 'HITCOUNT': '0.870', 'weapon3': '1.636', 'DAMAGECOUNT': '2.847', 'FRAGCOUNT': '8.000'} [2023-02-24 19:01:00,544][177170] DAMAGECOUNT value on done: 249302.0 [2023-02-24 19:01:00,544][177170] Sum rewards: 4.327, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.290', 'AMMO5': '0.007', 'ARMOR': '0.008', 'weapon5': '0.016', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon7': '0.050', 'AMMO3': '0.090', 'AMMO4': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.306', 'WEAPON4': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.710', 'weapon2': '1.164', 'weapon3': '1.526', 'DAMAGECOUNT': '3.219', 'FRAGCOUNT': '6.000'} [2023-02-24 19:01:01,153][177158] DAMAGECOUNT value on done: 240901.0 [2023-02-24 19:01:01,154][177158] Sum rewards: 10.248, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.300', 'AMMO5': '0.010', 'AMMO2': '0.027', 'WEAPON1': '0.040', 'AMMO3': '0.095', 'AMMO4': '0.133', 'WEAPON4': '0.150', 'weapon5': '0.252', 'weapon4': '0.268', 'WEAPON5': '0.300', 'ARMOR': '0.456', 'WEAPON3': '0.700', 'HITCOUNT': '0.860', 'weapon2': '1.330', 'weapon3': '1.678', 'DAMAGECOUNT': '3.249', 'FRAGCOUNT': '8.000'} [2023-02-24 19:01:01,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13858.2, 300 sec: 13870.9). Total num frames: 82153472. Throughput: 0: 3478.7. Samples: 20540192. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 19:01:01,376][177119] Avg episode reward: [(0, '12.796')] [2023-02-24 19:01:01,450][177158] DAMAGECOUNT value on done: 241758.0 [2023-02-24 19:01:01,450][177158] Sum rewards: 8.929, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.778', 'ARMOR': '0.008', 'AMMO2': '0.009', 'AMMO5': '0.026', 'AMMO4': '0.044', 'WEAPON1': '0.050', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'weapon4': '0.198', 'weapon5': '0.208', 'WEAPON5': '0.650', 'weapon2': '0.658', 'WEAPON3': '0.900', 'HITCOUNT': '1.050', 'weapon3': '2.312', 'DAMAGECOUNT': '4.548', 'FRAGCOUNT': '10.000'} [2023-02-24 19:01:01,986][177153] Updated weights for policy 0, policy_version 20060 (0.0008) [2023-02-24 19:01:02,146][177158] DAMAGECOUNT value on done: 253962.0 [2023-02-24 19:01:02,146][177158] Sum rewards: 16.526, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.122', 'weapon7': '0.012', 'AMMO5': '0.021', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.135', 'weapon5': '0.250', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.468', 'ARMOR': '0.484', 'weapon2': '0.808', 'WEAPON3': '0.850', 'HITCOUNT': '1.380', 'weapon3': '1.866', 'DAMAGECOUNT': '5.199', 'FRAGCOUNT': '14.000'} [2023-02-24 19:01:02,448][177158] DAMAGECOUNT value on done: 252980.0 [2023-02-24 19:01:02,448][177158] Sum rewards: 11.508, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.693', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon7': '0.048', 'WEAPON1': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.166', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.424', 'WEAPON3': '0.500', 'weapon2': '0.664', 'HITCOUNT': '0.870', 'weapon3': '1.354', 'DAMAGECOUNT': '3.246', 'FRAGCOUNT': '12.000'} [2023-02-24 19:01:04,915][177153] Updated weights for policy 0, policy_version 20070 (0.0008) [2023-02-24 19:01:04,997][177172] DAMAGECOUNT value on done: 247195.0 [2023-02-24 19:01:04,997][177172] Sum rewards: 14.715, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.560', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'weapon7': '0.060', 'AMMO4': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.101', 'weapon5': '0.168', 'weapon4': '0.220', 'WEAPON5': '0.250', 'WEAPON3': '0.650', 'weapon2': '1.102', 'HITCOUNT': '1.150', 'weapon3': '1.710', 'DAMAGECOUNT': '4.140', 'FRAGCOUNT': '12.000'} [2023-02-24 19:01:05,297][177172] DAMAGECOUNT value on done: 240643.0 [2023-02-24 19:01:05,297][177172] Sum rewards: 10.928, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.372', 'AMMO2': '0.010', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.047', 'AMMO3': '0.097', 'weapon7': '0.132', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.280', 'weapon4': '0.320', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'HITCOUNT': '0.830', 'weapon2': '0.870', 'weapon3': '1.848', 'DAMAGECOUNT': '3.906', 'FRAGCOUNT': '9.500'} [2023-02-24 19:01:06,376][177119] Fps is (10 sec: 13516.7, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 82223104. Throughput: 0: 3475.6. Samples: 20550562. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 19:01:06,376][177119] Avg episode reward: [(0, '12.775')] [2023-02-24 19:01:06,787][177154] DAMAGECOUNT value on done: 251977.0 [2023-02-24 19:01:06,788][177154] Sum rewards: 14.579, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.095', 'AMMO5': '0.014', 'AMMO2': '0.046', 'AMMO3': '0.103', 'weapon5': '0.204', 'AMMO4': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'weapon4': '0.464', 'WEAPON3': '0.650', 'HITCOUNT': '1.090', 'weapon2': '1.148', 'weapon3': '1.740', 'DAMAGECOUNT': '4.731', 'FRAGCOUNT': '13.000'} [2023-02-24 19:01:06,798][177172] DAMAGECOUNT value on done: 255012.0 [2023-02-24 19:01:06,799][177172] Sum rewards: 11.141, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.220', 'AMMO5': '0.020', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'AMMO3': '0.092', 'AMMO4': '0.139', 'WEAPON4': '0.250', 'weapon4': '0.252', 'weapon5': '0.326', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '0.860', 'weapon2': '1.150', 'weapon3': '1.874', 'DAMAGECOUNT': '2.880', 'FRAGCOUNT': '10.000'} [2023-02-24 19:01:07,089][177154] DAMAGECOUNT value on done: 257134.0 [2023-02-24 19:01:07,089][177154] Sum rewards: 15.048, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.841', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.104', 'AMMO3': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.516', 'WEAPON3': '0.850', 'weapon2': '1.002', 'HITCOUNT': '1.340', 'weapon3': '1.830', 'DAMAGECOUNT': '4.680', 'FRAGCOUNT': '13.500'} [2023-02-24 19:01:07,092][177172] DAMAGECOUNT value on done: 243207.0 [2023-02-24 19:01:07,092][177172] Sum rewards: 14.056, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.420', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO5': '0.016', 'WEAPON1': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'weapon4': '0.192', 'weapon5': '0.330', 'ARMOR': '0.471', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'weapon2': '0.984', 'HITCOUNT': '1.080', 'weapon3': '1.898', 'DAMAGECOUNT': '4.131', 'FRAGCOUNT': '13.000'} [2023-02-24 19:01:07,388][177154] DAMAGECOUNT value on done: 261238.0 [2023-02-24 19:01:07,389][177154] Sum rewards: 9.870, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.560', 'AMMO2': '0.008', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.040', 'weapon7': '0.068', 'AMMO3': '0.091', 'weapon5': '0.128', 'WEAPON4': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'weapon4': '0.484', 'weapon2': '0.522', 'WEAPON3': '0.650', 'HITCOUNT': '0.700', 'weapon3': '1.568', 'DAMAGECOUNT': '2.985', 'FRAGCOUNT': '10.000'} [2023-02-24 19:01:07,691][177154] DAMAGECOUNT value on done: 255656.0 [2023-02-24 19:01:07,691][177154] Sum rewards: 15.642, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.780', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON1': '0.030', 'weapon7': '0.048', 'weapon4': '0.056', 'AMMO4': '0.057', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'weapon5': '0.198', 'WEAPON5': '0.250', 'WEAPON3': '0.750', 'HITCOUNT': '1.040', 'weapon2': '1.376', 'weapon3': '1.896', 'DAMAGECOUNT': '4.383', 'FRAGCOUNT': '14.000'} [2023-02-24 19:01:07,890][177153] Updated weights for policy 0, policy_version 20080 (0.0008) [2023-02-24 19:01:07,941][177171] DAMAGECOUNT value on done: 245411.0 [2023-02-24 19:01:07,941][177171] Sum rewards: 14.202, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.358', 'AMMO5': '0.024', 'AMMO2': '0.041', 'WEAPON1': '0.050', 'weapon7': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.117', 'AMMO4': '0.205', 'weapon5': '0.220', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.412', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon2': '0.756', 'HITCOUNT': '0.990', 'weapon3': '1.390', 'DAMAGECOUNT': '4.146', 'FRAGCOUNT': '14.500'} [2023-02-24 19:01:08,036][177157] DAMAGECOUNT value on done: 241737.0 [2023-02-24 19:01:08,037][177157] Sum rewards: 24.512, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.804', 'weapon7': '0.010', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'AMMO2': '0.036', 'AMMO3': '0.132', 'AMMO4': '0.181', 'weapon4': '0.192', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'weapon2': '1.234', 'HITCOUNT': '1.650', 'weapon3': '1.962', 'DAMAGECOUNT': '7.674', 'FRAGCOUNT': '21.000'} [2023-02-24 19:01:08,046][177157] DAMAGECOUNT value on done: 259060.0 [2023-02-24 19:01:08,047][177157] Sum rewards: 12.362, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.424', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.086', 'weapon5': '0.158', 'weapon4': '0.234', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'weapon2': '0.666', 'HITCOUNT': '0.970', 'weapon3': '1.300', 'DAMAGECOUNT': '3.879', 'FRAGCOUNT': '9.000'} [2023-02-24 19:01:08,239][177171] DAMAGECOUNT value on done: 247986.0 [2023-02-24 19:01:08,240][177171] Sum rewards: 20.543, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.451', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'AMMO5': '0.033', 'weapon4': '0.110', 'AMMO4': '0.141', 'AMMO3': '0.148', 'WEAPON4': '0.200', 'weapon5': '0.240', 'WEAPON5': '0.650', 'weapon2': '0.766', 'WEAPON3': '1.000', 'HITCOUNT': '1.450', 'weapon3': '2.448', 'DAMAGECOUNT': '5.499', 'FRAGCOUNT': '19.000'} [2023-02-24 19:01:08,258][177171] DAMAGECOUNT value on done: 252900.0 [2023-02-24 19:01:08,259][177171] Sum rewards: 18.213, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.685', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon7': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.117', 'weapon5': '0.160', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.358', 'WEAPON3': '0.750', 'weapon2': '0.958', 'HITCOUNT': '1.290', 'weapon3': '2.092', 'DAMAGECOUNT': '5.247', 'FRAGCOUNT': '16.500'} [2023-02-24 19:01:08,355][177157] DAMAGECOUNT value on done: 245519.0 [2023-02-24 19:01:08,356][177157] Sum rewards: 13.895, reward structure: {'DEATHCOUNT': '-6.750', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO3': '0.074', 'WEAPON4': '0.100', 'AMMO4': '0.151', 'weapon5': '0.196', 'HEALTH': '0.202', 'weapon4': '0.208', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.940', 'weapon3': '1.398', 'weapon2': '1.814', 'DAMAGECOUNT': '3.759', 'FRAGCOUNT': '11.000'} [2023-02-24 19:01:08,367][177157] DAMAGECOUNT value on done: 242210.0 [2023-02-24 19:01:08,367][177157] Sum rewards: 14.887, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.277', 'AMMO5': '0.018', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'AMMO4': '0.119', 'AMMO3': '0.124', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.302', 'weapon5': '0.310', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'weapon2': '0.920', 'HITCOUNT': '0.960', 'weapon3': '2.064', 'DAMAGECOUNT': '4.083', 'FRAGCOUNT': '13.000'} [2023-02-24 19:01:08,543][177171] DAMAGECOUNT value on done: 246911.0 [2023-02-24 19:01:08,543][177171] Sum rewards: 11.290, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.731', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.135', 'WEAPON5': '0.150', 'weapon5': '0.180', 'HITCOUNT': '0.800', 'WEAPON3': '0.900', 'weapon2': '1.178', 'weapon3': '1.602', 'DAMAGECOUNT': '3.375', 'FRAGCOUNT': '11.000'} [2023-02-24 19:01:09,770][177155] DAMAGECOUNT value on done: 248731.0 [2023-02-24 19:01:09,771][177155] Sum rewards: 24.008, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.269', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.010', 'AMMO3': '0.060', 'weapon7': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.174', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'weapon4': '0.450', 'ARMOR': '0.850', 'weapon2': '0.978', 'HITCOUNT': '1.270', 'weapon3': '1.402', 'DAMAGECOUNT': '5.610', 'FRAGCOUNT': '16.500'} [2023-02-24 19:01:10,069][177155] DAMAGECOUNT value on done: 258534.0 [2023-02-24 19:01:10,070][177155] Sum rewards: 21.034, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.004', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.044', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'AMMO4': '0.163', 'WEAPON5': '0.250', 'weapon4': '0.570', 'weapon2': '0.672', 'WEAPON3': '0.800', 'HITCOUNT': '1.540', 'weapon3': '2.380', 'DAMAGECOUNT': '5.799', 'FRAGCOUNT': '17.500'} [2023-02-24 19:01:10,368][177155] DAMAGECOUNT value on done: 255623.0 [2023-02-24 19:01:10,368][177155] Sum rewards: 19.531, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.359', 'AMMO2': '0.011', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.053', 'weapon7': '0.088', 'weapon5': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.128', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.244', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'weapon2': '0.906', 'HITCOUNT': '1.330', 'weapon3': '2.360', 'DAMAGECOUNT': '6.042', 'FRAGCOUNT': '17.500'} [2023-02-24 19:01:10,658][177155] DAMAGECOUNT value on done: 242315.0 [2023-02-24 19:01:10,658][177155] Sum rewards: 13.395, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.435', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO4': '0.068', 'AMMO3': '0.143', 'weapon5': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.374', 'weapon2': '0.634', 'WEAPON3': '1.000', 'HITCOUNT': '1.150', 'weapon3': '2.482', 'DAMAGECOUNT': '5.475', 'FRAGCOUNT': '12.500'} [2023-02-24 19:01:10,861][177153] Updated weights for policy 0, policy_version 20090 (0.0008) [2023-02-24 19:01:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13870.9). Total num frames: 82292736. Throughput: 0: 3472.0. Samples: 20571270. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:01:11,376][177119] Avg episode reward: [(0, '12.921')] [2023-02-24 19:01:13,793][177153] Updated weights for policy 0, policy_version 20100 (0.0009) [2023-02-24 19:01:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 82362368. Throughput: 0: 3471.1. Samples: 20592134. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:01:16,376][177119] Avg episode reward: [(0, '12.921')] [2023-02-24 19:01:16,736][177153] Updated weights for policy 0, policy_version 20110 (0.0009) [2023-02-24 19:01:18,775][177170] DAMAGECOUNT value on done: 251893.0 [2023-02-24 19:01:18,776][177170] Sum rewards: 19.593, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.510', 'AMMO5': '0.022', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'AMMO3': '0.124', 'AMMO4': '0.125', 'WEAPON4': '0.300', 'weapon4': '0.384', 'weapon5': '0.404', 'WEAPON5': '0.600', 'weapon2': '0.708', 'WEAPON3': '0.850', 'HITCOUNT': '1.280', 'weapon3': '1.990', 'DAMAGECOUNT': '6.000', 'FRAGCOUNT': '16.500'} [2023-02-24 19:01:18,786][177156] DAMAGECOUNT value on done: 250804.0 [2023-02-24 19:01:18,787][177156] Sum rewards: 7.503, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.518', 'AMMO2': '0.005', 'AMMO5': '0.011', 'AMMO4': '0.025', 'AMMO3': '0.025', 'weapon7': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.182', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon3': '0.372', 'HITCOUNT': '0.390', 'weapon4': '0.488', 'ARMOR': '0.950', 'DAMAGECOUNT': '2.298', 'FRAGCOUNT': '4.000'} [2023-02-24 19:01:18,813][177156] DAMAGECOUNT value on done: 245696.0 [2023-02-24 19:01:18,814][177156] Sum rewards: 8.168, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.392', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon7': '0.068', 'AMMO3': '0.096', 'weapon5': '0.110', 'AMMO4': '0.143', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.458', 'WEAPON3': '0.600', 'HITCOUNT': '0.950', 'weapon2': '1.018', 'weapon3': '1.790', 'DAMAGECOUNT': '3.486', 'FRAGCOUNT': '7.000'} [2023-02-24 19:01:19,077][177170] DAMAGECOUNT value on done: 257812.0 [2023-02-24 19:01:19,078][177170] Sum rewards: 9.927, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.574', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'AMMO3': '0.089', 'weapon5': '0.102', 'weapon7': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.134', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '0.650', 'weapon4': '0.794', 'ARMOR': '0.932', 'weapon2': '0.958', 'HITCOUNT': '0.960', 'weapon3': '1.622', 'DAMAGECOUNT': '3.297', 'FRAGCOUNT': '8.000'} [2023-02-24 19:01:19,083][177156] DAMAGECOUNT value on done: 257385.0 [2023-02-24 19:01:19,083][177156] Sum rewards: 14.916, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.103', 'HEALTH': '0.140', 'WEAPON4': '0.150', 'weapon5': '0.182', 'WEAPON5': '0.250', 'weapon4': '0.290', 'WEAPON3': '0.650', 'weapon2': '0.684', 'HITCOUNT': '0.990', 'weapon3': '2.126', 'DAMAGECOUNT': '4.560', 'FRAGCOUNT': '11.500'} [2023-02-24 19:01:19,112][177156] DAMAGECOUNT value on done: 246614.0 [2023-02-24 19:01:19,112][177156] Sum rewards: 12.689, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.219', 'AMMO5': '0.014', 'AMMO2': '0.018', 'weapon7': '0.056', 'AMMO4': '0.092', 'AMMO3': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.164', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.384', 'WEAPON3': '0.700', 'HITCOUNT': '1.190', 'weapon2': '1.190', 'weapon3': '1.590', 'DAMAGECOUNT': '4.272', 'FRAGCOUNT': '11.500'} [2023-02-24 19:01:19,219][177171] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon3', 0.002)] [2023-02-24 19:01:19,653][177153] Updated weights for policy 0, policy_version 20120 (0.0008) [2023-02-24 19:01:19,675][177170] DAMAGECOUNT value on done: 248315.0 [2023-02-24 19:01:19,676][177170] Sum rewards: 20.569, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.327', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.030', 'AMMO3': '0.114', 'weapon5': '0.178', 'WEAPON5': '0.200', 'WEAPON3': '0.800', 'HITCOUNT': '1.140', 'weapon2': '1.304', 'weapon3': '1.978', 'DAMAGECOUNT': '4.878', 'FRAGCOUNT': '18.000'} [2023-02-24 19:01:19,970][177170] DAMAGECOUNT value on done: 250957.0 [2023-02-24 19:01:19,971][177170] Sum rewards: 13.133, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.813', 'weapon7': '0.006', 'AMMO5': '0.023', 'AMMO2': '0.057', 'AMMO3': '0.176', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.285', 'weapon5': '0.312', 'WEAPON4': '0.450', 'weapon4': '0.544', 'WEAPON5': '0.700', 'weapon2': '0.816', 'ARMOR': '0.853', 'WEAPON3': '1.100', 'HITCOUNT': '1.140', 'weapon3': '1.918', 'DAMAGECOUNT': '4.965', 'FRAGCOUNT': '13.000'} [2023-02-24 19:01:20,546][177158] DAMAGECOUNT value on done: 242215.0 [2023-02-24 19:01:20,546][177158] Sum rewards: 16.088, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.185', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.087', 'AMMO4': '0.106', 'weapon7': '0.130', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.256', 'WEAPON3': '0.600', 'HITCOUNT': '1.030', 'weapon2': '1.144', 'weapon3': '1.648', 'DAMAGECOUNT': '3.942', 'FRAGCOUNT': '13.000'} [2023-02-24 19:01:20,844][177158] DAMAGECOUNT value on done: 243328.0 [2023-02-24 19:01:20,845][177158] Sum rewards: 16.124, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.621', 'AMMO2': '0.014', 'AMMO5': '0.019', 'AMMO4': '0.068', 'AMMO3': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon7': '0.158', 'weapon4': '0.212', 'weapon5': '0.380', 'WEAPON5': '0.550', 'WEAPON3': '0.550', 'HITCOUNT': '0.870', 'weapon2': '1.126', 'weapon3': '1.558', 'DAMAGECOUNT': '4.710', 'FRAGCOUNT': '12.000'} [2023-02-24 19:01:21,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 82432000. Throughput: 0: 3469.1. Samples: 20602604. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:01:21,376][177119] Avg episode reward: [(0, '13.030')] [2023-02-24 19:01:21,521][177158] DAMAGECOUNT value on done: 255694.0 [2023-02-24 19:01:21,521][177158] Sum rewards: 20.951, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.550', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.015', 'weapon7': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.128', 'WEAPON7': '0.200', 'weapon4': '0.236', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'weapon2': '0.924', 'HITCOUNT': '1.280', 'weapon3': '1.938', 'DAMAGECOUNT': '5.196', 'FRAGCOUNT': '19.000'} [2023-02-24 19:01:21,827][177158] DAMAGECOUNT value on done: 254718.0 [2023-02-24 19:01:21,828][177158] Sum rewards: 18.452, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.457', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.027', 'weapon7': '0.050', 'weapon5': '0.114', 'AMMO4': '0.137', 'AMMO3': '0.140', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.824', 'WEAPON3': '0.950', 'HITCOUNT': '1.260', 'weapon3': '2.194', 'DAMAGECOUNT': '5.214', 'FRAGCOUNT': '18.000'} [2023-02-24 19:01:22,609][177153] Updated weights for policy 0, policy_version 20130 (0.0008) [2023-02-24 19:01:24,299][177172] DAMAGECOUNT value on done: 249375.0 [2023-02-24 19:01:24,300][177172] Sum rewards: 19.846, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.520', 'AMMO2': '0.005', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.022', 'weapon7': '0.048', 'AMMO3': '0.099', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.522', 'WEAPON3': '0.700', 'weapon2': '0.934', 'HITCOUNT': '1.390', 'weapon3': '1.466', 'DAMAGECOUNT': '6.540', 'FRAGCOUNT': '16.000'} [2023-02-24 19:01:24,596][177172] DAMAGECOUNT value on done: 242058.0 [2023-02-24 19:01:24,596][177172] Sum rewards: 16.035, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.228', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.152', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.210', 'weapon4': '0.284', 'WEAPON3': '0.450', 'ARMOR': '0.458', 'weapon2': '0.582', 'HITCOUNT': '0.980', 'weapon3': '1.338', 'DAMAGECOUNT': '4.245', 'FRAGCOUNT': '12.000'} [2023-02-24 19:01:25,485][177155] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 19:01:25,569][177153] Updated weights for policy 0, policy_version 20140 (0.0008) [2023-02-24 19:01:26,087][177172] DAMAGECOUNT value on done: 256715.0 [2023-02-24 19:01:26,087][177172] Sum rewards: 16.738, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.554', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon7': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.103', 'AMMO4': '0.140', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON4': '0.350', 'weapon4': '0.646', 'WEAPON3': '0.700', 'HITCOUNT': '1.330', 'weapon3': '1.468', 'DAMAGECOUNT': '5.109', 'FRAGCOUNT': '14.000'} [2023-02-24 19:01:26,090][177154] DAMAGECOUNT value on done: 253663.0 [2023-02-24 19:01:26,090][177154] Sum rewards: 16.979, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.337', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO3': '0.055', 'weapon7': '0.064', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.164', 'WEAPON7': '0.200', 'weapon5': '0.240', 'WEAPON3': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.428', 'WEAPON4': '0.450', 'HITCOUNT': '0.770', 'weapon2': '0.788', 'weapon3': '1.050', 'DAMAGECOUNT': '5.058', 'FRAGCOUNT': '14.000'} [2023-02-24 19:01:26,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 82501632. Throughput: 0: 3471.5. Samples: 20623488. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:01:26,376][177119] Avg episode reward: [(0, '13.637')] [2023-02-24 19:01:26,390][177172] DAMAGECOUNT value on done: 244901.0 [2023-02-24 19:01:26,391][177172] Sum rewards: 19.206, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.020', 'ARMOR': '0.004', 'weapon7': '0.006', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO3': '0.124', 'weapon5': '0.190', 'AMMO4': '0.193', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.228', 'WEAPON4': '0.250', 'WEAPON3': '0.650', 'HITCOUNT': '1.220', 'weapon2': '1.550', 'weapon3': '1.628', 'DAMAGECOUNT': '5.082', 'FRAGCOUNT': '17.000'} [2023-02-24 19:01:26,392][177154] DAMAGECOUNT value on done: 259086.0 [2023-02-24 19:01:26,393][177154] Sum rewards: 17.846, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.890', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO5': '0.029', 'AMMO4': '0.074', 'weapon7': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon5': '0.254', 'weapon4': '0.314', 'ARMOR': '0.478', 'WEAPON5': '0.550', 'weapon2': '0.974', 'WEAPON3': '1.150', 'HITCOUNT': '1.260', 'weapon3': '1.998', 'DAMAGECOUNT': '5.856', 'FRAGCOUNT': '18.000'} [2023-02-24 19:01:26,701][177154] DAMAGECOUNT value on done: 262678.0 [2023-02-24 19:01:26,701][177154] Sum rewards: 14.037, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.736', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO4': '0.065', 'AMMO3': '0.134', 'weapon5': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.700', 'weapon4': '0.778', 'WEAPON3': '0.850', 'ARMOR': '0.853', 'HITCOUNT': '1.280', 'weapon3': '1.776', 'DAMAGECOUNT': '4.320', 'FRAGCOUNT': '13.000'} [2023-02-24 19:01:26,996][177154] DAMAGECOUNT value on done: 256946.0 [2023-02-24 19:01:26,997][177154] Sum rewards: 11.061, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.556', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO4': '0.040', 'weapon5': '0.082', 'weapon7': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.162', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.252', 'WEAPON5': '0.300', 'weapon2': '0.642', 'HITCOUNT': '1.040', 'WEAPON3': '1.050', 'weapon3': '2.356', 'DAMAGECOUNT': '3.870', 'FRAGCOUNT': '11.000'} [2023-02-24 19:01:27,198][177171] DAMAGECOUNT value on done: 246724.0 [2023-02-24 19:01:27,198][177171] Sum rewards: 13.799, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.630', 'WEAPON1': '0.020', 'AMMO5': '0.026', 'AMMO2': '0.036', 'AMMO3': '0.100', 'AMMO4': '0.182', 'WEAPON4': '0.300', 'weapon5': '0.380', 'weapon4': '0.446', 'ARMOR': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'HITCOUNT': '0.860', 'weapon2': '1.204', 'weapon3': '1.634', 'DAMAGECOUNT': '3.939', 'FRAGCOUNT': '11.000'} [2023-02-24 19:01:27,352][177157] DAMAGECOUNT value on done: 242773.0 [2023-02-24 19:01:27,353][177157] Sum rewards: 10.002, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.420', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon7': '0.064', 'weapon5': '0.076', 'AMMO3': '0.077', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'weapon4': '0.514', 'weapon3': '0.554', 'weapon2': '0.576', 'HITCOUNT': '0.870', 'DAMAGECOUNT': '3.108', 'FRAGCOUNT': '7.000'} [2023-02-24 19:01:27,364][177157] DAMAGECOUNT value on done: 260752.0 [2023-02-24 19:01:27,364][177157] Sum rewards: 14.584, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.730', 'AMMO5': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.121', 'WEAPON4': '0.250', 'weapon5': '0.258', 'weapon4': '0.342', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'weapon2': '1.114', 'HITCOUNT': '1.210', 'weapon3': '1.896', 'DAMAGECOUNT': '5.076', 'FRAGCOUNT': '12.000'} [2023-02-24 19:01:27,483][177171] DAMAGECOUNT value on done: 249641.0 [2023-02-24 19:01:27,484][177171] Sum rewards: 10.431, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.978', 'AMMO5': '0.009', 'weapon5': '0.018', 'AMMO2': '0.025', 'weapon7': '0.064', 'AMMO4': '0.124', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'weapon4': '0.540', 'weapon2': '0.720', 'WEAPON3': '1.150', 'HITCOUNT': '1.200', 'weapon3': '1.818', 'DAMAGECOUNT': '4.965', 'FRAGCOUNT': '13.000'} [2023-02-24 19:01:27,502][177171] DAMAGECOUNT value on done: 254158.0 [2023-02-24 19:01:27,503][177171] Sum rewards: 10.568, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.745', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.017', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'weapon7': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.122', 'WEAPON7': '0.200', 'weapon5': '0.212', 'weapon4': '0.214', 'WEAPON5': '0.450', 'HITCOUNT': '0.750', 'WEAPON3': '0.800', 'weapon2': '1.040', 'weapon3': '1.486', 'DAMAGECOUNT': '3.774', 'FRAGCOUNT': '11.000'} [2023-02-24 19:01:27,662][177157] DAMAGECOUNT value on done: 247403.0 [2023-02-24 19:01:27,662][177157] Sum rewards: 10.578, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.671', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.149', 'AMMO3': '0.173', 'weapon4': '0.180', 'weapon5': '0.242', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.862', 'WEAPON3': '1.200', 'HITCOUNT': '1.460', 'weapon3': '2.336', 'DAMAGECOUNT': '5.652', 'FRAGCOUNT': '13.000'} [2023-02-24 19:01:27,673][177157] DAMAGECOUNT value on done: 243136.0 [2023-02-24 19:01:27,674][177157] Sum rewards: 10.004, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.532', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO5': '0.018', 'AMMO3': '0.074', 'AMMO4': '0.082', 'weapon7': '0.098', 'weapon5': '0.196', 'weapon4': '0.224', 'WEAPON4': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.680', 'weapon2': '0.694', 'weapon3': '1.476', 'DAMAGECOUNT': '2.778', 'FRAGCOUNT': '8.000'} [2023-02-24 19:01:27,800][177171] DAMAGECOUNT value on done: 248770.0 [2023-02-24 19:01:27,800][177171] Sum rewards: 22.524, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.288', 'AMMO2': '0.016', 'AMMO5': '0.017', 'AMMO4': '0.078', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.150', 'weapon4': '0.158', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.004', 'HITCOUNT': '1.160', 'weapon3': '2.164', 'DAMAGECOUNT': '5.574', 'FRAGCOUNT': '18.000'} [2023-02-24 19:01:28,534][177153] Updated weights for policy 0, policy_version 20150 (0.0008) [2023-02-24 19:01:29,143][177155] DAMAGECOUNT value on done: 250602.0 [2023-02-24 19:01:29,144][177155] Sum rewards: 17.985, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.058', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO4': '0.121', 'AMMO3': '0.142', 'weapon5': '0.248', 'WEAPON4': '0.250', 'weapon4': '0.302', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.540', 'WEAPON3': '1.000', 'HITCOUNT': '1.310', 'weapon3': '2.378', 'DAMAGECOUNT': '5.613', 'FRAGCOUNT': '16.000'} [2023-02-24 19:01:29,443][177155] DAMAGECOUNT value on done: 259572.0 [2023-02-24 19:01:29,444][177155] Sum rewards: 10.202, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.050', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO3': '0.071', 'weapon7': '0.094', 'AMMO4': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.134', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.470', 'WEAPON3': '0.500', 'HITCOUNT': '0.730', 'weapon3': '1.160', 'weapon2': '1.348', 'DAMAGECOUNT': '3.114', 'FRAGCOUNT': '9.000'} [2023-02-24 19:01:29,745][177155] DAMAGECOUNT value on done: 256811.0 [2023-02-24 19:01:29,745][177155] Sum rewards: 13.589, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.066', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon5': '0.104', 'AMMO3': '0.110', 'AMMO4': '0.129', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.402', 'ARMOR': '0.497', 'WEAPON3': '0.650', 'HITCOUNT': '0.870', 'weapon2': '1.200', 'weapon3': '1.542', 'DAMAGECOUNT': '3.564', 'FRAGCOUNT': '10.000'} [2023-02-24 19:01:30,049][177155] DAMAGECOUNT value on done: 243203.0 [2023-02-24 19:01:30,050][177155] Sum rewards: 9.242, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.200', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.110', 'weapon7': '0.130', 'weapon5': '0.136', 'WEAPON5': '0.200', 'WEAPON3': '0.550', 'HITCOUNT': '0.650', 'weapon2': '1.140', 'weapon3': '1.270', 'DAMAGECOUNT': '2.664', 'FRAGCOUNT': '8.000'} [2023-02-24 19:01:30,721][177156] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0)] [2023-02-24 19:01:31,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 82571264. Throughput: 0: 3469.3. Samples: 20644254. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:01:31,376][177119] Avg episode reward: [(0, '13.844')] [2023-02-24 19:01:31,479][177153] Updated weights for policy 0, policy_version 20160 (0.0008) [2023-02-24 19:01:34,408][177153] Updated weights for policy 0, policy_version 20170 (0.0008) [2023-02-24 19:01:36,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 82640896. Throughput: 0: 3470.9. Samples: 20654762. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:01:36,376][177119] Avg episode reward: [(0, '13.844')] [2023-02-24 19:01:37,352][177153] Updated weights for policy 0, policy_version 20180 (0.0009) [2023-02-24 19:01:38,090][177170] DAMAGECOUNT value on done: 253054.0 [2023-02-24 19:01:38,090][177170] Sum rewards: 10.037, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.473', 'AMMO5': '0.025', 'AMMO2': '0.027', 'WEAPON4': '0.050', 'AMMO3': '0.123', 'AMMO4': '0.133', 'weapon4': '0.184', 'weapon5': '0.286', 'ARMOR': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'HITCOUNT': '0.800', 'weapon2': '1.106', 'weapon3': '1.792', 'DAMAGECOUNT': '3.483', 'FRAGCOUNT': '9.000'} [2023-02-24 19:01:38,219][177156] DAMAGECOUNT value on done: 247148.0 [2023-02-24 19:01:38,220][177156] Sum rewards: 15.028, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.855', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.041', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.105', 'weapon5': '0.196', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'HITCOUNT': '0.990', 'weapon3': '1.676', 'weapon2': '1.902', 'DAMAGECOUNT': '4.356', 'FRAGCOUNT': '12.000'} [2023-02-24 19:01:38,231][177156] DAMAGECOUNT value on done: 252398.0 [2023-02-24 19:01:38,231][177156] Sum rewards: 16.924, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.436', 'AMMO5': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.109', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.282', 'weapon4': '0.364', 'WEAPON5': '0.400', 'ARMOR': '0.500', 'WEAPON3': '0.700', 'weapon2': '0.722', 'HITCOUNT': '1.160', 'weapon3': '2.096', 'DAMAGECOUNT': '4.782', 'FRAGCOUNT': '13.500'} [2023-02-24 19:01:38,384][177170] DAMAGECOUNT value on done: 259209.0 [2023-02-24 19:01:38,384][177170] Sum rewards: 13.155, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.049', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon7': '0.068', 'AMMO3': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.124', 'weapon5': '0.192', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'weapon4': '0.628', 'weapon2': '1.120', 'HITCOUNT': '1.210', 'weapon3': '1.558', 'DAMAGECOUNT': '4.191', 'FRAGCOUNT': '10.000'} [2023-02-24 19:01:38,519][177156] DAMAGECOUNT value on done: 247849.0 [2023-02-24 19:01:38,520][177156] Sum rewards: 14.580, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon5': '0.094', 'AMMO3': '0.095', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HEALTH': '0.215', 'weapon4': '0.536', 'WEAPON3': '0.600', 'weapon2': '0.872', 'HITCOUNT': '0.980', 'weapon3': '1.990', 'DAMAGECOUNT': '3.705', 'FRAGCOUNT': '11.000'} [2023-02-24 19:01:38,529][177156] DAMAGECOUNT value on done: 259262.0 [2023-02-24 19:01:38,530][177156] Sum rewards: 14.232, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.225', 'AMMO5': '0.019', 'AMMO2': '0.036', 'weapon7': '0.074', 'AMMO3': '0.143', 'AMMO4': '0.178', 'weapon5': '0.214', 'AMMO6': '0.400', 'WEAPON7': '0.400', 'AMMO7': '0.400', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'weapon2': '0.734', 'weapon4': '0.800', 'WEAPON3': '0.900', 'HITCOUNT': '1.350', 'weapon3': '1.628', 'DAMAGECOUNT': '5.631', 'FRAGCOUNT': '13.000'} [2023-02-24 19:01:38,984][177170] DAMAGECOUNT value on done: 249383.0 [2023-02-24 19:01:38,984][177170] Sum rewards: 8.619, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.036', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'WEAPON4': '0.100', 'weapon4': '0.118', 'AMMO3': '0.142', 'weapon5': '0.250', 'WEAPON5': '0.450', 'HITCOUNT': '0.840', 'WEAPON3': '0.950', 'weapon2': '1.036', 'weapon3': '2.258', 'DAMAGECOUNT': '3.204', 'FRAGCOUNT': '11.000'} [2023-02-24 19:01:39,277][177170] DAMAGECOUNT value on done: 252736.0 [2023-02-24 19:01:39,278][177170] Sum rewards: 17.000, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.680', 'AMMO5': '0.013', 'AMMO2': '0.016', 'weapon7': '0.056', 'AMMO4': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.110', 'AMMO3': '0.122', 'weapon5': '0.256', 'WEAPON5': '0.300', 'WEAPON3': '0.800', 'HITCOUNT': '0.890', 'weapon2': '1.594', 'weapon3': '1.720', 'DAMAGECOUNT': '5.322', 'FRAGCOUNT': '15.000'} [2023-02-24 19:01:39,900][177158] DAMAGECOUNT value on done: 243546.0 [2023-02-24 19:01:39,900][177158] Sum rewards: 13.193, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.080', 'AMMO2': '0.025', 'AMMO5': '0.026', 'weapon4': '0.088', 'AMMO3': '0.112', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'weapon5': '0.216', 'ARMOR': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '0.830', 'weapon2': '1.016', 'weapon3': '1.694', 'DAMAGECOUNT': '3.993', 'FRAGCOUNT': '11.000'} [2023-02-24 19:01:40,193][177158] DAMAGECOUNT value on done: 245084.0 [2023-02-24 19:01:40,194][177158] Sum rewards: 18.590, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.417', 'AMMO5': '0.014', 'AMMO2': '0.022', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.111', 'WEAPON4': '0.150', 'weapon5': '0.280', 'weapon4': '0.366', 'WEAPON5': '0.400', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'weapon2': '0.914', 'HITCOUNT': '1.140', 'weapon3': '2.080', 'DAMAGECOUNT': '5.268', 'FRAGCOUNT': '13.500'} [2023-02-24 19:01:40,276][177153] Updated weights for policy 0, policy_version 20190 (0.0008) [2023-02-24 19:01:40,894][177158] DAMAGECOUNT value on done: 256929.0 [2023-02-24 19:01:40,894][177158] Sum rewards: 11.606, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.136', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO3': '0.145', 'AMMO4': '0.158', 'weapon5': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.320', 'ARMOR': '0.400', 'HITCOUNT': '0.710', 'WEAPON3': '0.900', 'weapon2': '1.058', 'weapon3': '1.690', 'DAMAGECOUNT': '3.705', 'FRAGCOUNT': '12.000'} [2023-02-24 19:01:41,201][177158] DAMAGECOUNT value on done: 256726.0 [2023-02-24 19:01:41,202][177158] Sum rewards: 22.074, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.537', 'AMMO2': '0.002', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.011', 'weapon5': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.122', 'weapon7': '0.202', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'WEAPON7': '0.400', 'weapon4': '0.554', 'weapon2': '0.668', 'WEAPON3': '0.750', 'HITCOUNT': '1.410', 'weapon3': '1.846', 'DAMAGECOUNT': '6.024', 'FRAGCOUNT': '18.000'} [2023-02-24 19:01:41,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 82710528. Throughput: 0: 3469.3. Samples: 20675568. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:01:41,376][177119] Avg episode reward: [(0, '14.251')] [2023-02-24 19:01:43,203][177153] Updated weights for policy 0, policy_version 20200 (0.0008) [2023-02-24 19:01:43,699][177172] DAMAGECOUNT value on done: 252040.0 [2023-02-24 19:01:43,699][177172] Sum rewards: 20.670, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.285', 'AMMO2': '0.002', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.010', 'AMMO3': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.108', 'weapon4': '0.226', 'weapon7': '0.260', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.780', 'weapon2': '1.038', 'weapon3': '1.308', 'DAMAGECOUNT': '4.995', 'FRAGCOUNT': '15.000'} [2023-02-24 19:01:43,998][177172] DAMAGECOUNT value on done: 243069.0 [2023-02-24 19:01:43,998][177172] Sum rewards: 10.150, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.950', 'AMMO5': '0.007', 'AMMO2': '0.035', 'AMMO3': '0.103', 'weapon5': '0.158', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.526', 'WEAPON3': '0.700', 'HITCOUNT': '0.780', 'weapon2': '1.048', 'weapon3': '1.636', 'DAMAGECOUNT': '3.033', 'FRAGCOUNT': '10.000'} [2023-02-24 19:01:45,388][177154] DAMAGECOUNT value on done: 254523.0 [2023-02-24 19:01:45,389][177154] Sum rewards: 7.769, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.329', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO3': '0.072', 'weapon5': '0.096', 'AMMO4': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon7': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.378', 'WEAPON3': '0.500', 'HITCOUNT': '0.630', 'weapon4': '0.770', 'weapon3': '1.066', 'DAMAGECOUNT': '2.580', 'FRAGCOUNT': '6.000'} [2023-02-24 19:01:45,503][177172] DAMAGECOUNT value on done: 257916.0 [2023-02-24 19:01:45,504][177172] Sum rewards: 9.540, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.120', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.100', 'weapon4': '0.154', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.900', 'HITCOUNT': '0.950', 'WEAPON3': '1.000', 'weapon3': '2.422', 'DAMAGECOUNT': '3.603', 'FRAGCOUNT': '12.000'} [2023-02-24 19:01:45,698][177154] DAMAGECOUNT value on done: 259871.0 [2023-02-24 19:01:45,698][177154] Sum rewards: 8.603, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.180', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.056', 'AMMO3': '0.070', 'AMMO4': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.116', 'WEAPON4': '0.150', 'weapon2': '0.184', 'ARMOR': '0.450', 'WEAPON3': '0.450', 'weapon4': '0.496', 'HITCOUNT': '0.700', 'weapon3': '1.004', 'DAMAGECOUNT': '2.355', 'FRAGCOUNT': '6.000'} [2023-02-24 19:01:45,805][177172] DAMAGECOUNT value on done: 246268.0 [2023-02-24 19:01:45,806][177172] Sum rewards: 9.842, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.780', 'AMMO5': '0.030', 'AMMO2': '0.036', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.144', 'AMMO4': '0.180', 'weapon5': '0.226', 'WEAPON4': '0.500', 'weapon4': '0.550', 'WEAPON5': '0.700', 'weapon2': '0.892', 'WEAPON3': '0.950', 'HITCOUNT': '1.020', 'weapon3': '1.692', 'DAMAGECOUNT': '4.101', 'FRAGCOUNT': '11.000'} [2023-02-24 19:01:46,018][177154] DAMAGECOUNT value on done: 264172.0 [2023-02-24 19:01:46,018][177154] Sum rewards: 12.268, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.414', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.137', 'weapon5': '0.144', 'AMMO4': '0.189', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.320', 'weapon2': '0.332', 'WEAPON3': '0.850', 'HITCOUNT': '0.910', 'weapon3': '1.908', 'DAMAGECOUNT': '4.482', 'FRAGCOUNT': '14.000'} [2023-02-24 19:01:46,193][177153] Updated weights for policy 0, policy_version 20210 (0.0008) [2023-02-24 19:01:46,315][177154] DAMAGECOUNT value on done: 258406.0 [2023-02-24 19:01:46,316][177154] Sum rewards: 16.084, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.342', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.052', 'weapon7': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.130', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.354', 'WEAPON3': '0.750', 'weapon2': '0.950', 'HITCOUNT': '1.060', 'weapon3': '1.592', 'DAMAGECOUNT': '4.380', 'FRAGCOUNT': '13.000'} [2023-02-24 19:01:46,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 82780160. Throughput: 0: 3472.8. Samples: 20696468. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:01:46,376][177119] Avg episode reward: [(0, '13.993')] [2023-02-24 19:01:46,512][177171] DAMAGECOUNT value on done: 247300.0 [2023-02-24 19:01:46,513][177171] Sum rewards: 4.505, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.684', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO3': '0.047', 'weapon5': '0.068', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'weapon7': '0.118', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HITCOUNT': '0.240', 'WEAPON7': '0.300', 'weapon4': '0.326', 'WEAPON3': '0.400', 'weapon2': '0.570', 'weapon3': '0.784', 'DAMAGECOUNT': '1.728', 'FRAGCOUNT': '5.000'} [2023-02-24 19:01:46,671][177157] DAMAGECOUNT value on done: 244067.0 [2023-02-24 19:01:46,672][177157] Sum rewards: 15.834, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.082', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.041', 'AMMO3': '0.078', 'weapon5': '0.306', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.710', 'weapon3': '1.410', 'weapon2': '1.716', 'DAMAGECOUNT': '3.882', 'FRAGCOUNT': '11.000'} [2023-02-24 19:01:46,682][177157] DAMAGECOUNT value on done: 262129.0 [2023-02-24 19:01:46,683][177157] Sum rewards: 9.979, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.500', 'AMMO4': '-0.065', 'AMMO2': '-0.013', 'AMMO5': '0.011', 'weapon7': '0.028', 'weapon5': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.138', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.216', 'WEAPON5': '0.300', 'WEAPON3': '0.950', 'HITCOUNT': '1.030', 'weapon2': '1.346', 'weapon3': '1.870', 'DAMAGECOUNT': '4.131', 'FRAGCOUNT': '10.000'} [2023-02-24 19:01:46,807][177171] DAMAGECOUNT value on done: 250856.0 [2023-02-24 19:01:46,808][177171] Sum rewards: 7.792, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.054', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.047', 'AMMO3': '0.092', 'weapon7': '0.160', 'weapon5': '0.180', 'AMMO4': '0.234', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon2': '0.332', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'WEAPON3': '0.600', 'weapon4': '0.694', 'WEAPON4': '0.700', 'HITCOUNT': '0.900', 'weapon3': '1.262', 'DAMAGECOUNT': '3.645', 'FRAGCOUNT': '8.000'} [2023-02-24 19:01:46,827][177171] DAMAGECOUNT value on done: 255237.0 [2023-02-24 19:01:46,828][177171] Sum rewards: 10.676, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.460', 'AMMO2': '0.007', 'AMMO5': '0.013', 'AMMO4': '0.036', 'AMMO3': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.134', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.304', 'WEAPON5': '0.400', 'weapon4': '0.506', 'WEAPON3': '0.600', 'weapon2': '0.732', 'HITCOUNT': '0.750', 'weapon3': '1.396', 'DAMAGECOUNT': '3.237', 'FRAGCOUNT': '10.000'} [2023-02-24 19:01:46,980][177157] DAMAGECOUNT value on done: 249037.0 [2023-02-24 19:01:46,981][177157] Sum rewards: 9.429, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.010', 'AMMO5': '0.030', 'AMMO2': '0.032', 'AMMO3': '0.152', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'weapon5': '0.256', 'ARMOR': '0.404', 'weapon4': '0.444', 'WEAPON5': '0.700', 'weapon2': '0.724', 'HITCOUNT': '0.810', 'WEAPON3': '1.050', 'weapon3': '2.158', 'DAMAGECOUNT': '4.821', 'FRAGCOUNT': '10.000'} [2023-02-24 19:01:46,991][177157] DAMAGECOUNT value on done: 244256.0 [2023-02-24 19:01:46,992][177157] Sum rewards: 5.500, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.566', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.036', 'WEAPON1': '0.060', 'weapon5': '0.154', 'AMMO3': '0.159', 'AMMO4': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.246', 'HITCOUNT': '0.750', 'WEAPON3': '1.000', 'weapon2': '1.178', 'weapon3': '2.028', 'DAMAGECOUNT': '3.360', 'FRAGCOUNT': '7.000'} [2023-02-24 19:01:47,112][177171] DAMAGECOUNT value on done: 250184.0 [2023-02-24 19:01:47,113][177171] Sum rewards: 13.019, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.005', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO2': '0.031', 'AMMO3': '0.109', 'weapon4': '0.140', 'AMMO4': '0.156', 'weapon5': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'ARMOR': '0.491', 'WEAPON3': '0.800', 'HITCOUNT': '0.990', 'weapon2': '1.166', 'weapon3': '2.154', 'DAMAGECOUNT': '4.242', 'FRAGCOUNT': '12.000'} [2023-02-24 19:01:48,398][177155] DAMAGECOUNT value on done: 252163.0 [2023-02-24 19:01:48,398][177155] Sum rewards: 11.963, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.680', 'AMMO5': '0.021', 'AMMO2': '0.035', 'AMMO3': '0.141', 'AMMO4': '0.177', 'weapon5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.404', 'weapon4': '0.420', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'weapon2': '0.854', 'HITCOUNT': '1.120', 'weapon3': '1.736', 'DAMAGECOUNT': '4.683', 'FRAGCOUNT': '11.000'} [2023-02-24 19:01:48,697][177155] DAMAGECOUNT value on done: 260494.0 [2023-02-24 19:01:48,698][177155] Sum rewards: 1.337, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.682', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.018', 'weapon5': '0.070', 'AMMO4': '0.088', 'weapon7': '0.094', 'weapon4': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'weapon2': '0.634', 'HITCOUNT': '0.690', 'WEAPON3': '0.900', 'weapon3': '1.932', 'DAMAGECOUNT': '2.766', 'FRAGCOUNT': '3.000'} [2023-02-24 19:01:48,990][177155] DAMAGECOUNT value on done: 257750.0 [2023-02-24 19:01:48,991][177155] Sum rewards: 9.502, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.820', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.018', 'AMMO4': '0.054', 'AMMO3': '0.101', 'weapon5': '0.270', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'HITCOUNT': '0.540', 'WEAPON3': '0.650', 'weapon3': '1.424', 'weapon2': '1.876', 'DAMAGECOUNT': '2.817', 'FRAGCOUNT': '7.000'} [2023-02-24 19:01:49,139][177153] Updated weights for policy 0, policy_version 20220 (0.0009) [2023-02-24 19:01:49,282][177155] DAMAGECOUNT value on done: 243673.0 [2023-02-24 19:01:49,283][177155] Sum rewards: 4.449, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.352', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO3': '0.033', 'weapon7': '0.076', 'weapon5': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.164', 'WEAPON3': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.280', 'HITCOUNT': '0.340', 'weapon2': '0.454', 'weapon3': '0.662', 'DAMAGECOUNT': '1.410', 'FRAGCOUNT': '4.000'} [2023-02-24 19:01:51,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 82849792. Throughput: 0: 3474.3. Samples: 20706906. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:01:51,376][177119] Avg episode reward: [(0, '13.489')] [2023-02-24 19:01:52,102][177153] Updated weights for policy 0, policy_version 20230 (0.0008) [2023-02-24 19:01:55,062][177153] Updated weights for policy 0, policy_version 20240 (0.0008) [2023-02-24 19:01:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 82919424. Throughput: 0: 3475.6. Samples: 20727672. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:01:56,376][177119] Avg episode reward: [(0, '13.489')] [2023-02-24 19:01:57,434][177170] DAMAGECOUNT value on done: 254118.0 [2023-02-24 19:01:57,435][177170] Sum rewards: 6.365, reward structure: {'DEATHCOUNT': '-8.250', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.015', 'HEALTH': '0.045', 'AMMO4': '0.077', 'AMMO3': '0.086', 'weapon4': '0.194', 'WEAPON4': '0.200', 'weapon5': '0.304', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.680', 'weapon2': '1.100', 'weapon3': '1.754', 'DAMAGECOUNT': '3.192', 'FRAGCOUNT': '6.000'} [2023-02-24 19:01:57,548][177156] DAMAGECOUNT value on done: 253875.0 [2023-02-24 19:01:57,549][177156] Sum rewards: 15.163, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.014', 'AMMO2': '0.014', 'AMMO5': '0.020', 'AMMO4': '0.071', 'AMMO3': '0.104', 'weapon7': '0.114', 'WEAPON4': '0.150', 'weapon5': '0.152', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.384', 'WEAPON5': '0.400', 'ARMOR': '0.428', 'WEAPON3': '0.750', 'HITCOUNT': '1.040', 'weapon2': '1.098', 'weapon3': '1.670', 'DAMAGECOUNT': '4.431', 'FRAGCOUNT': '11.500'} [2023-02-24 19:01:57,561][177156] DAMAGECOUNT value on done: 248209.0 [2023-02-24 19:01:57,562][177156] Sum rewards: 12.057, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.016', 'AMMO2': '0.035', 'HEALTH': '0.076', 'AMMO3': '0.105', 'AMMO4': '0.174', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon7': '0.224', 'weapon5': '0.242', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.402', 'weapon4': '0.556', 'WEAPON3': '0.650', 'HITCOUNT': '0.730', 'weapon3': '1.774', 'DAMAGECOUNT': '3.183', 'FRAGCOUNT': '11.500'} [2023-02-24 19:01:57,734][177170] DAMAGECOUNT value on done: 260687.0 [2023-02-24 19:01:57,734][177170] Sum rewards: 13.555, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.082', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO3': '0.078', 'AMMO4': '0.131', 'weapon5': '0.216', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'ARMOR': '0.503', 'WEAPON3': '0.600', 'weapon2': '0.844', 'HITCOUNT': '0.900', 'weapon4': '0.936', 'weapon3': '1.308', 'DAMAGECOUNT': '4.434', 'FRAGCOUNT': '13.000'} [2023-02-24 19:01:57,867][177156] DAMAGECOUNT value on done: 260097.0 [2023-02-24 19:01:57,868][177156] Sum rewards: 11.579, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.766', 'AMMO5': '0.007', 'AMMO2': '0.012', 'ARMOR': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.070', 'weapon7': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.138', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.202', 'WEAPON3': '0.550', 'HITCOUNT': '0.650', 'weapon2': '1.266', 'weapon3': '1.544', 'DAMAGECOUNT': '2.505', 'FRAGCOUNT': '9.000'} [2023-02-24 19:01:57,878][177156] DAMAGECOUNT value on done: 249189.0 [2023-02-24 19:01:57,879][177156] Sum rewards: 14.376, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.930', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO3': '0.074', 'AMMO4': '0.125', 'weapon5': '0.256', 'WEAPON5': '0.300', 'weapon4': '0.308', 'WEAPON4': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '0.830', 'weapon3': '1.174', 'weapon2': '1.486', 'DAMAGECOUNT': '4.020', 'FRAGCOUNT': '12.000'} [2023-02-24 19:01:57,986][177153] Updated weights for policy 0, policy_version 20250 (0.0008) [2023-02-24 19:01:58,339][177170] DAMAGECOUNT value on done: 250700.0 [2023-02-24 19:01:58,339][177170] Sum rewards: 15.639, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.199', 'AMMO5': '0.010', 'AMMO2': '0.040', 'AMMO3': '0.152', 'weapon5': '0.200', 'AMMO4': '0.201', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.380', 'ARMOR': '0.404', 'WEAPON3': '0.850', 'HITCOUNT': '0.940', 'weapon2': '0.958', 'weapon3': '1.902', 'DAMAGECOUNT': '3.951', 'FRAGCOUNT': '15.000'} [2023-02-24 19:01:58,637][177170] DAMAGECOUNT value on done: 254189.0 [2023-02-24 19:01:58,637][177170] Sum rewards: 12.211, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.344', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.122', 'AMMO3': '0.141', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon7': '0.200', 'AMMO4': '0.223', 'weapon4': '0.338', 'WEAPON4': '0.450', 'WEAPON3': '0.850', 'weapon2': '0.932', 'HITCOUNT': '0.940', 'weapon3': '1.650', 'DAMAGECOUNT': '4.356', 'FRAGCOUNT': '13.000'} [2023-02-24 19:01:59,224][177158] DAMAGECOUNT value on done: 245273.0 [2023-02-24 19:01:59,224][177158] Sum rewards: 15.623, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.546', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO5': '0.019', 'AMMO4': '0.085', 'AMMO3': '0.119', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.202', 'WEAPON4': '0.250', 'weapon4': '0.354', 'WEAPON5': '0.450', 'weapon2': '0.796', 'WEAPON3': '0.850', 'HITCOUNT': '1.210', 'weapon3': '2.022', 'DAMAGECOUNT': '5.181', 'FRAGCOUNT': '12.500'} [2023-02-24 19:01:59,520][177158] DAMAGECOUNT value on done: 246941.0 [2023-02-24 19:01:59,521][177158] Sum rewards: 14.091, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.130', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.078', 'AMMO3': '0.162', 'AMMO4': '0.188', 'WEAPON5': '0.300', 'weapon4': '0.410', 'WEAPON4': '0.450', 'weapon2': '0.758', 'WEAPON3': '1.000', 'HITCOUNT': '1.300', 'weapon3': '2.454', 'DAMAGECOUNT': '5.571', 'FRAGCOUNT': '16.000'} [2023-02-24 19:02:00,215][177158] DAMAGECOUNT value on done: 258214.0 [2023-02-24 19:02:00,216][177158] Sum rewards: 8.855, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.860', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.034', 'weapon7': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.108', 'AMMO3': '0.116', 'WEAPON5': '0.150', 'AMMO4': '0.172', 'WEAPON4': '0.250', 'weapon4': '0.388', 'WEAPON3': '0.700', 'weapon2': '0.702', 'HITCOUNT': '0.730', 'weapon3': '1.380', 'DAMAGECOUNT': '3.855', 'FRAGCOUNT': '9.000'} [2023-02-24 19:02:00,515][177158] DAMAGECOUNT value on done: 257904.0 [2023-02-24 19:02:00,515][177158] Sum rewards: 4.473, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.134', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO3': '0.112', 'weapon5': '0.146', 'AMMO4': '0.179', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.368', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.990', 'weapon2': '1.246', 'weapon3': '1.884', 'DAMAGECOUNT': '3.534', 'FRAGCOUNT': '5.000'} [2023-02-24 19:02:00,944][177153] Updated weights for policy 0, policy_version 20260 (0.0008) [2023-02-24 19:02:01,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13884.7). Total num frames: 82989056. Throughput: 0: 3474.3. Samples: 20748478. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:02:01,376][177119] Avg episode reward: [(0, '13.424')] [2023-02-24 19:02:03,114][177172] DAMAGECOUNT value on done: 253440.0 [2023-02-24 19:02:03,115][177172] Sum rewards: 8.549, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.462', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon7': '0.060', 'AMMO3': '0.085', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.121', 'weapon5': '0.134', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'WEAPON4': '0.550', 'weapon2': '0.846', 'weapon4': '0.864', 'HITCOUNT': '0.960', 'weapon3': '1.104', 'DAMAGECOUNT': '4.200', 'FRAGCOUNT': '8.000'} [2023-02-24 19:02:03,417][177172] DAMAGECOUNT value on done: 244399.0 [2023-02-24 19:02:03,418][177172] Sum rewards: 10.497, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.534', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.013', 'AMMO5': '0.014', 'weapon7': '0.058', 'weapon5': '0.124', 'AMMO3': '0.146', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.402', 'weapon4': '0.534', 'ARMOR': '0.905', 'HITCOUNT': '0.910', 'WEAPON3': '0.950', 'weapon3': '1.902', 'DAMAGECOUNT': '3.990', 'FRAGCOUNT': '10.000'} [2023-02-24 19:02:03,938][177153] Updated weights for policy 0, policy_version 20270 (0.0009) [2023-02-24 19:02:04,848][177154] DAMAGECOUNT value on done: 256866.0 [2023-02-24 19:02:04,848][177154] Sum rewards: 21.474, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.398', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'WEAPON4': '0.050', 'weapon4': '0.114', 'AMMO3': '0.133', 'weapon5': '0.268', 'WEAPON5': '0.300', 'weapon2': '0.674', 'WEAPON3': '0.900', 'HITCOUNT': '1.580', 'weapon3': '2.576', 'DAMAGECOUNT': '7.029', 'FRAGCOUNT': '18.000'} [2023-02-24 19:02:04,888][177172] DAMAGECOUNT value on done: 260027.0 [2023-02-24 19:02:04,888][177172] Sum rewards: 20.275, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.803', 'AMMO5': '0.007', 'AMMO2': '0.048', 'AMMO3': '0.103', 'weapon5': '0.172', 'WEAPON5': '0.200', 'AMMO4': '0.238', 'weapon2': '0.318', 'WEAPON4': '0.400', 'WEAPON3': '0.700', 'ARMOR': '0.804', 'weapon4': '1.046', 'HITCOUNT': '1.590', 'weapon3': '1.868', 'DAMAGECOUNT': '6.333', 'FRAGCOUNT': '15.500'} [2023-02-24 19:02:05,146][177154] DAMAGECOUNT value on done: 260381.0 [2023-02-24 19:02:05,146][177154] Sum rewards: 3.026, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.266', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon7': '0.058', 'AMMO3': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.270', 'HITCOUNT': '0.420', 'WEAPON3': '0.600', 'weapon2': '0.682', 'weapon3': '1.148', 'DAMAGECOUNT': '1.530', 'FRAGCOUNT': '5.000'} [2023-02-24 19:02:05,185][177172] DAMAGECOUNT value on done: 247902.0 [2023-02-24 19:02:05,186][177172] Sum rewards: 13.315, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.022', 'ARMOR': '0.008', 'AMMO5': '0.034', 'weapon7': '0.054', 'AMMO2': '0.054', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.159', 'weapon5': '0.160', 'AMMO4': '0.270', 'weapon2': '0.450', 'WEAPON4': '0.500', 'WEAPON5': '0.650', 'weapon4': '0.680', 'WEAPON3': '1.000', 'HITCOUNT': '1.050', 'weapon3': '2.066', 'DAMAGECOUNT': '4.902', 'FRAGCOUNT': '15.000'} [2023-02-24 19:02:05,438][177154] DAMAGECOUNT value on done: 266031.0 [2023-02-24 19:02:05,439][177154] Sum rewards: 18.572, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.016', 'AMMO2': '0.024', 'HEALTH': '0.038', 'AMMO3': '0.092', 'weapon7': '0.114', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'weapon5': '0.202', 'WEAPON5': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'weapon4': '0.474', 'WEAPON3': '0.600', 'weapon2': '0.824', 'HITCOUNT': '1.310', 'weapon3': '1.992', 'DAMAGECOUNT': '5.577', 'FRAGCOUNT': '13.500'} [2023-02-24 19:02:05,737][177154] DAMAGECOUNT value on done: 259910.0 [2023-02-24 19:02:05,738][177154] Sum rewards: 14.793, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.343', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon7': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.137', 'AMMO3': '0.147', 'WEAPON7': '0.200', 'weapon5': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.352', 'weapon2': '0.922', 'WEAPON3': '1.000', 'HITCOUNT': '1.110', 'weapon3': '1.998', 'DAMAGECOUNT': '4.512', 'FRAGCOUNT': '16.000'} [2023-02-24 19:02:05,922][177171] DAMAGECOUNT value on done: 248630.0 [2023-02-24 19:02:05,922][177171] Sum rewards: 10.191, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.440', 'AMMO2': '0.004', 'AMMO5': '0.009', 'AMMO4': '0.022', 'WEAPON4': '0.100', 'weapon4': '0.104', 'weapon5': '0.112', 'AMMO3': '0.136', 'WEAPON5': '0.250', 'ARMOR': '0.457', 'WEAPON3': '0.900', 'HITCOUNT': '1.080', 'weapon2': '1.334', 'weapon3': '2.132', 'DAMAGECOUNT': '3.990', 'FRAGCOUNT': '10.000'} [2023-02-24 19:02:06,058][177157] DAMAGECOUNT value on done: 245414.0 [2023-02-24 19:02:06,059][177157] Sum rewards: 12.590, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.959', 'AMMO5': '0.025', 'WEAPON1': '0.030', 'AMMO2': '0.033', 'AMMO3': '0.138', 'AMMO4': '0.164', 'weapon5': '0.330', 'WEAPON4': '0.350', 'ARMOR': '0.454', 'weapon4': '0.498', 'WEAPON5': '0.650', 'weapon2': '0.666', 'WEAPON3': '0.950', 'HITCOUNT': '0.960', 'weapon3': '2.010', 'DAMAGECOUNT': '4.041', 'FRAGCOUNT': '13.000'} [2023-02-24 19:02:06,070][177157] DAMAGECOUNT value on done: 263960.0 [2023-02-24 19:02:06,070][177157] Sum rewards: 9.607, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.066', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.056', 'weapon5': '0.082', 'AMMO3': '0.177', 'WEAPON5': '0.250', 'AMMO4': '0.281', 'weapon4': '0.412', 'WEAPON4': '0.500', 'weapon2': '0.816', 'WEAPON3': '1.200', 'HITCOUNT': '1.340', 'weapon3': '2.302', 'DAMAGECOUNT': '5.493', 'FRAGCOUNT': '14.000'} [2023-02-24 19:02:06,210][177171] DAMAGECOUNT value on done: 251701.0 [2023-02-24 19:02:06,211][177171] Sum rewards: 11.755, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.458', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.033', 'AMMO3': '0.072', 'weapon4': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon7': '0.122', 'weapon5': '0.142', 'AMMO4': '0.166', 'WEAPON4': '0.200', 'WEAPON3': '0.450', 'HITCOUNT': '0.660', 'weapon2': '0.714', 'weapon3': '1.122', 'DAMAGECOUNT': '2.535', 'FRAGCOUNT': '10.000'} [2023-02-24 19:02:06,230][177171] DAMAGECOUNT value on done: 256696.0 [2023-02-24 19:02:06,230][177171] Sum rewards: 12.674, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.090', 'AMMO5': '0.023', 'AMMO2': '0.042', 'AMMO3': '0.110', 'AMMO4': '0.209', 'weapon5': '0.260', 'ARMOR': '0.408', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon4': '0.652', 'WEAPON3': '0.700', 'weapon2': '0.914', 'HITCOUNT': '1.240', 'weapon3': '1.828', 'DAMAGECOUNT': '4.377', 'FRAGCOUNT': '11.000'} [2023-02-24 19:02:06,370][177157] DAMAGECOUNT value on done: 250327.0 [2023-02-24 19:02:06,370][177157] Sum rewards: 13.373, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.038', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.027', 'AMMO3': '0.114', 'weapon7': '0.134', 'weapon5': '0.148', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'WEAPON7': '0.400', 'WEAPON3': '0.800', 'HITCOUNT': '0.940', 'weapon2': '1.368', 'weapon3': '1.660', 'DAMAGECOUNT': '3.825', 'FRAGCOUNT': '11.000'} [2023-02-24 19:02:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13884.7). Total num frames: 83058688. Throughput: 0: 3470.4. Samples: 20758772. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:02:06,376][177119] Avg episode reward: [(0, '13.423')] [2023-02-24 19:02:06,382][177157] DAMAGECOUNT value on done: 245856.0 [2023-02-24 19:02:06,383][177157] Sum rewards: 16.135, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.305', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.042', 'AMMO3': '0.120', 'weapon5': '0.168', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.708', 'weapon4': '0.748', 'WEAPON3': '0.850', 'HITCOUNT': '1.320', 'weapon3': '1.666', 'DAMAGECOUNT': '4.800', 'FRAGCOUNT': '15.500'} [2023-02-24 19:02:06,515][177171] DAMAGECOUNT value on done: 251874.0 [2023-02-24 19:02:06,516][177171] Sum rewards: 10.245, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.644', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO2': '0.038', 'weapon7': '0.052', 'AMMO3': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.170', 'AMMO4': '0.189', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.428', 'WEAPON3': '0.700', 'HITCOUNT': '0.810', 'weapon2': '1.176', 'weapon3': '1.772', 'DAMAGECOUNT': '3.570', 'FRAGCOUNT': '10.000'} [2023-02-24 19:02:06,922][177153] Updated weights for policy 0, policy_version 20280 (0.0008) [2023-02-24 19:02:07,835][177155] DAMAGECOUNT value on done: 253675.0 [2023-02-24 19:02:07,836][177155] Sum rewards: 17.820, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.430', 'AMMO2': '0.025', 'AMMO5': '0.026', 'AMMO3': '0.115', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'weapon5': '0.246', 'ARMOR': '0.462', 'WEAPON5': '0.550', 'weapon4': '0.610', 'WEAPON3': '0.700', 'weapon2': '0.836', 'HITCOUNT': '0.940', 'weapon3': '1.630', 'DAMAGECOUNT': '4.536', 'FRAGCOUNT': '14.000'} [2023-02-24 19:02:08,141][177155] DAMAGECOUNT value on done: 261774.0 [2023-02-24 19:02:08,142][177155] Sum rewards: 11.591, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.225', 'AMMO5': '0.016', 'AMMO2': '0.031', 'weapon7': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.108', 'AMMO3': '0.113', 'AMMO4': '0.157', 'weapon4': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'HITCOUNT': '0.840', 'weapon2': '0.898', 'weapon3': '2.126', 'DAMAGECOUNT': '3.840', 'FRAGCOUNT': '11.000'} [2023-02-24 19:02:08,442][177155] DAMAGECOUNT value on done: 259622.0 [2023-02-24 19:02:08,442][177155] Sum rewards: 18.661, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.527', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'weapon5': '0.046', 'AMMO3': '0.108', 'AMMO4': '0.150', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.404', 'weapon2': '0.470', 'weapon4': '0.558', 'WEAPON3': '0.700', 'HITCOUNT': '1.340', 'weapon3': '2.234', 'DAMAGECOUNT': '5.616', 'FRAGCOUNT': '14.500'} [2023-02-24 19:02:08,735][177155] DAMAGECOUNT value on done: 245183.0 [2023-02-24 19:02:08,735][177155] Sum rewards: 19.229, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.205', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO3': '0.093', 'AMMO4': '0.099', 'weapon5': '0.122', 'weapon7': '0.138', 'AMMO6': '0.260', 'AMMO7': '0.260', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.398', 'WEAPON3': '0.700', 'weapon2': '0.946', 'HITCOUNT': '1.040', 'weapon3': '1.816', 'DAMAGECOUNT': '4.530', 'FRAGCOUNT': '15.000'} [2023-02-24 19:02:09,854][177153] Updated weights for policy 0, policy_version 20290 (0.0009) [2023-02-24 19:02:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13884.7). Total num frames: 83128320. Throughput: 0: 3469.0. Samples: 20779594. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:02:11,376][177119] Avg episode reward: [(0, '13.336')] [2023-02-24 19:02:12,781][177153] Updated weights for policy 0, policy_version 20300 (0.0008) [2023-02-24 19:02:15,746][177153] Updated weights for policy 0, policy_version 20310 (0.0008) [2023-02-24 19:02:16,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13884.7). Total num frames: 83197952. Throughput: 0: 3469.5. Samples: 20800382. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:02:16,376][177119] Avg episode reward: [(0, '13.336')] [2023-02-24 19:02:16,857][177170] DAMAGECOUNT value on done: 255441.0 [2023-02-24 19:02:16,858][177170] Sum rewards: 14.767, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.761', 'AMMO5': '0.018', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.127', 'weapon5': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.464', 'weapon4': '0.818', 'WEAPON3': '0.850', 'ARMOR': '0.868', 'HITCOUNT': '1.090', 'weapon3': '1.864', 'DAMAGECOUNT': '3.969', 'FRAGCOUNT': '13.500'} [2023-02-24 19:02:17,008][177156] DAMAGECOUNT value on done: 255041.0 [2023-02-24 19:02:17,009][177156] Sum rewards: 14.471, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.900', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO3': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.132', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.270', 'WEAPON3': '0.600', 'HITCOUNT': '0.830', 'weapon2': '1.222', 'weapon3': '1.464', 'DAMAGECOUNT': '3.498', 'FRAGCOUNT': '11.000'} [2023-02-24 19:02:17,020][177156] DAMAGECOUNT value on done: 250376.0 [2023-02-24 19:02:17,020][177156] Sum rewards: 19.915, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.061', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.032', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.161', 'AMMO3': '0.173', 'weapon5': '0.216', 'weapon2': '0.334', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.744', 'WEAPON3': '1.100', 'HITCOUNT': '1.570', 'weapon3': '2.168', 'DAMAGECOUNT': '6.501', 'FRAGCOUNT': '19.000'} [2023-02-24 19:02:17,159][177170] DAMAGECOUNT value on done: 262373.0 [2023-02-24 19:02:17,160][177170] Sum rewards: 15.400, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.873', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO3': '0.091', 'weapon5': '0.104', 'AMMO4': '0.121', 'WEAPON5': '0.200', 'WEAPON4': '0.550', 'WEAPON3': '0.650', 'weapon4': '0.884', 'weapon2': '1.142', 'weapon3': '1.458', 'HITCOUNT': '1.480', 'DAMAGECOUNT': '5.058', 'FRAGCOUNT': '13.000'} [2023-02-24 19:02:17,315][177156] DAMAGECOUNT value on done: 261813.0 [2023-02-24 19:02:17,316][177156] Sum rewards: 13.689, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.460', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO5': '0.023', 'WEAPON4': '0.050', 'weapon4': '0.126', 'AMMO3': '0.173', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.322', 'WEAPON5': '0.550', 'weapon2': '1.166', 'WEAPON3': '1.200', 'HITCOUNT': '1.240', 'weapon3': '2.094', 'DAMAGECOUNT': '5.148', 'FRAGCOUNT': '14.000'} [2023-02-24 19:02:17,328][177156] DAMAGECOUNT value on done: 250690.0 [2023-02-24 19:02:17,328][177156] Sum rewards: 14.190, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.120', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.036', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.131', 'AMMO4': '0.146', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.430', 'weapon2': '0.764', 'WEAPON3': '0.850', 'HITCOUNT': '1.180', 'weapon3': '1.630', 'DAMAGECOUNT': '4.503', 'FRAGCOUNT': '13.000'} [2023-02-24 19:02:17,777][177170] DAMAGECOUNT value on done: 252349.0 [2023-02-24 19:02:17,778][177170] Sum rewards: 14.774, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.708', 'AMMO2': '0.008', 'AMMO5': '0.033', 'AMMO4': '0.040', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon5': '0.214', 'weapon2': '0.300', 'weapon4': '0.330', 'WEAPON5': '0.550', 'ARMOR': '0.923', 'HITCOUNT': '1.110', 'WEAPON3': '1.200', 'weapon3': '2.696', 'DAMAGECOUNT': '4.947', 'FRAGCOUNT': '14.500'} [2023-02-24 19:02:18,081][177170] DAMAGECOUNT value on done: 255734.0 [2023-02-24 19:02:18,082][177170] Sum rewards: 15.000, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.674', 'WEAPON1': '0.010', 'AMMO5': '0.029', 'AMMO2': '0.045', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.118', 'AMMO3': '0.123', 'weapon5': '0.212', 'AMMO4': '0.223', 'ARMOR': '0.404', 'WEAPON4': '0.500', 'WEAPON5': '0.650', 'weapon2': '0.682', 'WEAPON3': '0.700', 'weapon4': '0.716', 'HITCOUNT': '1.160', 'weapon3': '1.668', 'DAMAGECOUNT': '4.635', 'FRAGCOUNT': '15.000'} [2023-02-24 19:02:18,653][177158] DAMAGECOUNT value on done: 246654.0 [2023-02-24 19:02:18,654][177158] Sum rewards: 15.551, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.112', 'AMMO2': '0.015', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.073', 'weapon4': '0.090', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.300', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'HITCOUNT': '0.820', 'weapon2': '1.306', 'weapon3': '1.676', 'DAMAGECOUNT': '4.143', 'FRAGCOUNT': '13.500'} [2023-02-24 19:02:18,732][177153] Updated weights for policy 0, policy_version 20320 (0.0008) [2023-02-24 19:02:18,958][177158] DAMAGECOUNT value on done: 248803.0 [2023-02-24 19:02:18,958][177158] Sum rewards: 15.169, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.056', 'AMMO5': '0.018', 'AMMO2': '0.037', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'AMMO4': '0.185', 'weapon5': '0.230', 'WEAPON5': '0.300', 'weapon4': '0.484', 'weapon2': '0.560', 'WEAPON3': '1.150', 'ARMOR': '1.200', 'HITCOUNT': '1.450', 'weapon3': '2.196', 'DAMAGECOUNT': '5.586', 'FRAGCOUNT': '14.000'} [2023-02-24 19:02:19,634][177158] DAMAGECOUNT value on done: 259547.0 [2023-02-24 19:02:19,635][177158] Sum rewards: 11.273, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.960', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO4': '0.024', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon5': '0.178', 'weapon4': '0.196', 'WEAPON5': '0.300', 'ARMOR': '0.451', 'WEAPON3': '0.750', 'HITCOUNT': '0.820', 'weapon2': '0.996', 'weapon3': '1.834', 'DAMAGECOUNT': '3.948', 'FRAGCOUNT': '10.000'} [2023-02-24 19:02:19,936][177158] DAMAGECOUNT value on done: 259197.0 [2023-02-24 19:02:19,937][177158] Sum rewards: 12.992, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.291', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.091', 'AMMO4': '0.129', 'weapon5': '0.180', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'weapon4': '0.630', 'WEAPON3': '0.650', 'HITCOUNT': '0.800', 'weapon2': '0.944', 'weapon3': '1.420', 'DAMAGECOUNT': '3.879', 'FRAGCOUNT': '12.000'} [2023-02-24 19:02:20,484][177154] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 19:02:21,376][177119] Fps is (10 sec: 13516.9, 60 sec: 13858.2, 300 sec: 13870.9). Total num frames: 83263488. Throughput: 0: 3464.8. Samples: 20810676. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:02:21,376][177119] Avg episode reward: [(0, '13.264')] [2023-02-24 19:02:21,692][177153] Updated weights for policy 0, policy_version 20330 (0.0008) [2023-02-24 19:02:22,485][177172] DAMAGECOUNT value on done: 254611.0 [2023-02-24 19:02:22,485][177172] Sum rewards: 10.466, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.630', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.029', 'WEAPON1': '0.040', 'weapon4': '0.044', 'WEAPON4': '0.100', 'AMMO3': '0.135', 'AMMO4': '0.143', 'weapon5': '0.220', 'WEAPON5': '0.500', 'HITCOUNT': '0.780', 'WEAPON3': '0.800', 'weapon2': '1.424', 'weapon3': '1.842', 'DAMAGECOUNT': '3.513', 'FRAGCOUNT': '9.000'} [2023-02-24 19:02:22,793][177172] DAMAGECOUNT value on done: 246150.0 [2023-02-24 19:02:22,794][177172] Sum rewards: 18.739, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.720', 'AMMO2': '0.018', 'AMMO5': '0.020', 'AMMO4': '0.088', 'AMMO3': '0.098', 'weapon4': '0.118', 'WEAPON4': '0.150', 'weapon5': '0.298', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'HITCOUNT': '1.050', 'weapon2': '1.312', 'weapon3': '1.866', 'DAMAGECOUNT': '5.241', 'FRAGCOUNT': '14.000'} [2023-02-24 19:02:24,242][177154] DAMAGECOUNT value on done: 258346.0 [2023-02-24 19:02:24,243][177154] Sum rewards: 14.378, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.613', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.103', 'weapon7': '0.110', 'AMMO3': '0.134', 'weapon5': '0.214', 'WEAPON4': '0.300', 'weapon4': '0.322', 'weapon2': '0.466', 'WEAPON5': '0.500', 'HITCOUNT': '0.890', 'WEAPON3': '0.900', 'weapon3': '2.252', 'DAMAGECOUNT': '4.440', 'FRAGCOUNT': '14.000'} [2023-02-24 19:02:24,285][177172] DAMAGECOUNT value on done: 261632.0 [2023-02-24 19:02:24,285][177172] Sum rewards: 13.887, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.695', 'AMMO5': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon7': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.142', 'AMMO3': '0.162', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.372', 'weapon2': '0.784', 'WEAPON3': '0.950', 'HITCOUNT': '1.220', 'weapon3': '1.934', 'DAMAGECOUNT': '4.815', 'FRAGCOUNT': '13.000'} [2023-02-24 19:02:24,551][177154] DAMAGECOUNT value on done: 261882.0 [2023-02-24 19:02:24,552][177154] Sum rewards: 11.317, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.294', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.010', 'weapon7': '0.048', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.136', 'weapon5': '0.146', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.324', 'weapon2': '0.478', 'WEAPON3': '0.850', 'HITCOUNT': '1.080', 'weapon3': '1.666', 'DAMAGECOUNT': '4.434', 'FRAGCOUNT': '11.500'} [2023-02-24 19:02:24,589][177172] DAMAGECOUNT value on done: 249731.0 [2023-02-24 19:02:24,589][177172] Sum rewards: 22.666, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.030', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.098', 'weapon5': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.302', 'WEAPON3': '0.650', 'HITCOUNT': '1.320', 'weapon3': '1.530', 'weapon2': '1.562', 'DAMAGECOUNT': '5.487', 'FRAGCOUNT': '18.000'} [2023-02-24 19:02:24,672][177153] Updated weights for policy 0, policy_version 20340 (0.0008) [2023-02-24 19:02:24,849][177154] DAMAGECOUNT value on done: 267639.0 [2023-02-24 19:02:24,849][177154] Sum rewards: 16.721, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.600', 'AMMO2': '0.014', 'AMMO5': '0.015', 'AMMO4': '0.072', 'AMMO3': '0.110', 'WEAPON4': '0.200', 'weapon5': '0.312', 'WEAPON5': '0.350', 'weapon4': '0.404', 'WEAPON3': '0.650', 'weapon2': '0.802', 'ARMOR': '0.856', 'HITCOUNT': '1.080', 'weapon3': '1.882', 'DAMAGECOUNT': '4.824', 'FRAGCOUNT': '14.000'} [2023-02-24 19:02:25,146][177154] DAMAGECOUNT value on done: 261695.0 [2023-02-24 19:02:25,147][177154] Sum rewards: 17.755, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.031', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'weapon5': '0.100', 'AMMO3': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.404', 'weapon2': '0.654', 'WEAPON3': '0.950', 'HITCOUNT': '1.330', 'weapon3': '2.350', 'DAMAGECOUNT': '5.355', 'FRAGCOUNT': '16.000'} [2023-02-24 19:02:25,405][177171] DAMAGECOUNT value on done: 249896.0 [2023-02-24 19:02:25,406][177171] Sum rewards: 13.760, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.682', 'AMMO2': '0.012', 'AMMO5': '0.015', 'AMMO4': '0.059', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'weapon4': '0.232', 'weapon5': '0.248', 'WEAPON5': '0.400', 'ARMOR': '0.454', 'WEAPON3': '0.600', 'HITCOUNT': '0.910', 'weapon2': '1.484', 'weapon3': '1.536', 'DAMAGECOUNT': '3.798', 'FRAGCOUNT': '10.500'} [2023-02-24 19:02:25,470][177157] DAMAGECOUNT value on done: 247444.0 [2023-02-24 19:02:25,470][177157] Sum rewards: 12.237, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.480', 'WEAPON1': '0.010', 'AMMO5': '0.027', 'AMMO2': '0.034', 'AMMO4': '0.167', 'AMMO3': '0.228', 'weapon5': '0.228', 'weapon4': '0.384', 'WEAPON4': '0.450', 'weapon2': '0.476', 'ARMOR': '0.484', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '1.430', 'weapon3': '2.494', 'DAMAGECOUNT': '5.955', 'FRAGCOUNT': '17.000'} [2023-02-24 19:02:25,482][177157] DAMAGECOUNT value on done: 265335.0 [2023-02-24 19:02:25,483][177157] Sum rewards: 13.031, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.630', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.011', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'weapon7': '0.138', 'weapon5': '0.202', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.224', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'ARMOR': '0.453', 'WEAPON3': '0.650', 'HITCOUNT': '0.790', 'weapon2': '0.910', 'weapon3': '1.180', 'DAMAGECOUNT': '4.125', 'FRAGCOUNT': '10.000'} [2023-02-24 19:02:25,563][177171] Large shaping reward -2.541 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', 0.15, 30.0), ('ARMOR', -0.1, -100.0), ('AMMO2', 0.01, 50.0), ('WEAPON3', -0.05, -1.0), ('AMMO4', 0.05, 50.0), ('WEAPON5', -0.05, -1.0), ('AMMO5', -0.0005, -1.0), ('AMMO6', -0.1, -100.0), ('WEAPON7', -0.1, -1.0), ('AMMO7', -0.1, -100.0)] [2023-02-24 19:02:25,690][177171] DAMAGECOUNT value on done: 253470.0 [2023-02-24 19:02:25,691][177171] Sum rewards: 14.088, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.914', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon5': '0.134', 'AMMO4': '0.164', 'AMMO3': '0.168', 'WEAPON4': '0.300', 'weapon2': '0.322', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon4': '0.604', 'WEAPON3': '1.050', 'HITCOUNT': '1.240', 'weapon3': '2.166', 'DAMAGECOUNT': '5.307', 'FRAGCOUNT': '14.000'} [2023-02-24 19:02:25,712][177171] DAMAGECOUNT value on done: 258529.0 [2023-02-24 19:02:25,712][177171] Sum rewards: 18.589, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.330', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.091', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.216', 'weapon4': '0.226', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'weapon2': '1.340', 'HITCOUNT': '1.450', 'weapon3': '1.566', 'DAMAGECOUNT': '5.499', 'FRAGCOUNT': '12.500'} [2023-02-24 19:02:25,781][177157] DAMAGECOUNT value on done: 251603.0 [2023-02-24 19:02:25,781][177157] Sum rewards: 11.837, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.015', 'AMMO2': '0.022', 'weapon7': '0.064', 'AMMO3': '0.077', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.107', 'WEAPON4': '0.200', 'weapon5': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'HEALTH': '0.418', 'WEAPON3': '0.450', 'weapon2': '0.458', 'weapon4': '0.560', 'HITCOUNT': '1.050', 'weapon3': '1.338', 'DAMAGECOUNT': '3.828', 'FRAGCOUNT': '8.000'} [2023-02-24 19:02:25,793][177157] DAMAGECOUNT value on done: 247542.0 [2023-02-24 19:02:25,793][177157] Sum rewards: 16.321, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.670', 'AMMO2': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.051', 'AMMO3': '0.091', 'weapon5': '0.152', 'WEAPON4': '0.350', 'ARMOR': '0.449', 'WEAPON5': '0.450', 'weapon4': '0.574', 'WEAPON3': '0.700', 'weapon2': '1.070', 'weapon3': '1.238', 'HITCOUNT': '1.280', 'DAMAGECOUNT': '5.058', 'FRAGCOUNT': '15.000'} [2023-02-24 19:02:26,003][177171] DAMAGECOUNT value on done: 253093.0 [2023-02-24 19:02:26,003][177171] Sum rewards: 7.034, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.955', 'AMMO2': '0.011', 'AMMO5': '0.020', 'AMMO4': '0.053', 'AMMO3': '0.136', 'weapon5': '0.292', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.408', 'WEAPON3': '0.800', 'weapon4': '0.858', 'HITCOUNT': '0.890', 'weapon3': '1.864', 'DAMAGECOUNT': '3.657', 'FRAGCOUNT': '9.000'} [2023-02-24 19:02:26,376][177119] Fps is (10 sec: 13516.9, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 83333120. Throughput: 0: 3462.8. Samples: 20831392. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:02:26,376][177119] Avg episode reward: [(0, '13.070')] [2023-02-24 19:02:27,283][177155] DAMAGECOUNT value on done: 255583.0 [2023-02-24 19:02:27,284][177155] Sum rewards: 19.875, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.765', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.128', 'weapon5': '0.392', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'weapon2': '1.004', 'HITCOUNT': '1.230', 'weapon3': '2.182', 'DAMAGECOUNT': '5.724', 'FRAGCOUNT': '17.000'} [2023-02-24 19:02:27,578][177155] DAMAGECOUNT value on done: 263996.0 [2023-02-24 19:02:27,578][177155] Sum rewards: 23.096, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.916', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'AMMO4': '0.062', 'weapon4': '0.120', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'weapon5': '0.296', 'WEAPON5': '0.550', 'weapon2': '0.786', 'WEAPON3': '1.050', 'HITCOUNT': '1.460', 'weapon3': '2.350', 'DAMAGECOUNT': '6.666', 'FRAGCOUNT': '21.000'} [2023-02-24 19:02:27,640][177153] Updated weights for policy 0, policy_version 20350 (0.0008) [2023-02-24 19:02:27,874][177155] DAMAGECOUNT value on done: 261325.0 [2023-02-24 19:02:27,874][177155] Sum rewards: 15.847, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.971', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.026', 'AMMO3': '0.115', 'AMMO4': '0.129', 'weapon5': '0.184', 'WEAPON4': '0.200', 'weapon4': '0.270', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'weapon2': '0.778', 'HITCOUNT': '1.220', 'weapon3': '2.364', 'DAMAGECOUNT': '5.109', 'FRAGCOUNT': '12.000'} [2023-02-24 19:02:28,177][177155] DAMAGECOUNT value on done: 246188.0 [2023-02-24 19:02:28,178][177155] Sum rewards: 9.901, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.456', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon7': '0.046', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.422', 'ARMOR': '0.500', 'WEAPON3': '0.550', 'weapon2': '0.696', 'HITCOUNT': '0.750', 'weapon3': '1.138', 'DAMAGECOUNT': '3.015', 'FRAGCOUNT': '9.000'} [2023-02-24 19:02:30,601][177153] Updated weights for policy 0, policy_version 20360 (0.0008) [2023-02-24 19:02:31,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 83402752. Throughput: 0: 3459.1. Samples: 20852128. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:02:31,376][177119] Avg episode reward: [(0, '13.221')] [2023-02-24 19:02:33,561][177153] Updated weights for policy 0, policy_version 20370 (0.0008) [2023-02-24 19:02:36,350][177170] DAMAGECOUNT value on done: 256971.0 [2023-02-24 19:02:36,351][177170] Sum rewards: 14.778, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.950', 'WEAPON1': '0.010', 'AMMO5': '0.026', 'AMMO2': '0.029', 'weapon4': '0.108', 'AMMO3': '0.144', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'weapon5': '0.214', 'WEAPON5': '0.650', 'WEAPON3': '0.950', 'HITCOUNT': '1.230', 'weapon2': '1.368', 'weapon3': '1.814', 'DAMAGECOUNT': '4.590', 'FRAGCOUNT': '15.000'} [2023-02-24 19:02:36,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 83472384. Throughput: 0: 3458.7. Samples: 20862548. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:02:36,376][177119] Avg episode reward: [(0, '13.189')] [2023-02-24 19:02:36,519][177156] DAMAGECOUNT value on done: 257963.0 [2023-02-24 19:02:36,520][177156] Sum rewards: 23.621, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.902', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO3': '0.151', 'AMMO4': '0.159', 'weapon5': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.522', 'weapon2': '0.548', 'WEAPON3': '1.100', 'HITCOUNT': '1.740', 'weapon3': '2.246', 'DAMAGECOUNT': '8.766', 'FRAGCOUNT': '22.000'} [2023-02-24 19:02:36,529][177156] DAMAGECOUNT value on done: 252052.0 [2023-02-24 19:02:36,529][177156] Sum rewards: 18.921, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.482', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.038', 'weapon4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.168', 'weapon5': '0.272', 'WEAPON5': '0.350', 'weapon2': '0.740', 'WEAPON3': '1.050', 'HITCOUNT': '1.180', 'weapon3': '2.354', 'DAMAGECOUNT': '5.028', 'FRAGCOUNT': '18.000'} [2023-02-24 19:02:36,534][177153] Updated weights for policy 0, policy_version 20380 (0.0008) [2023-02-24 19:02:36,651][177170] DAMAGECOUNT value on done: 263349.0 [2023-02-24 19:02:36,651][177170] Sum rewards: 6.854, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.719', 'AMMO5': '0.015', 'AMMO2': '0.018', 'weapon7': '0.038', 'AMMO4': '0.091', 'AMMO3': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.122', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'HITCOUNT': '0.750', 'weapon2': '1.694', 'weapon3': '1.862', 'DAMAGECOUNT': '2.928', 'FRAGCOUNT': '6.000'} [2023-02-24 19:02:36,826][177156] DAMAGECOUNT value on done: 263908.0 [2023-02-24 19:02:36,827][177156] Sum rewards: 22.373, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.250', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.085', 'AMMO3': '0.117', 'weapon4': '0.168', 'weapon5': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'WEAPON3': '0.900', 'weapon2': '1.156', 'HITCOUNT': '1.430', 'weapon3': '1.996', 'DAMAGECOUNT': '6.285', 'FRAGCOUNT': '19.000'} [2023-02-24 19:02:36,838][177156] DAMAGECOUNT value on done: 251886.0 [2023-02-24 19:02:36,838][177156] Sum rewards: 8.705, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.060', 'AMMO2': '0.009', 'AMMO5': '0.025', 'AMMO4': '0.047', 'weapon4': '0.098', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'weapon5': '0.174', 'WEAPON5': '0.550', 'HITCOUNT': '0.840', 'WEAPON3': '0.850', 'weapon2': '0.992', 'weapon3': '2.054', 'DAMAGECOUNT': '3.588', 'FRAGCOUNT': '10.000'} [2023-02-24 19:02:37,261][177170] DAMAGECOUNT value on done: 253637.0 [2023-02-24 19:02:37,262][177170] Sum rewards: 11.537, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.520', 'AMMO2': '0.012', 'AMMO5': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.120', 'weapon4': '0.216', 'weapon5': '0.238', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'HITCOUNT': '1.030', 'weapon2': '1.118', 'weapon3': '1.880', 'DAMAGECOUNT': '3.864', 'FRAGCOUNT': '9.000'} [2023-02-24 19:02:37,558][177170] DAMAGECOUNT value on done: 257273.0 [2023-02-24 19:02:37,558][177170] Sum rewards: 17.286, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.308', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.054', 'AMMO3': '0.084', 'weapon5': '0.224', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.790', 'weapon2': '1.682', 'weapon3': '1.754', 'DAMAGECOUNT': '4.302', 'FRAGCOUNT': '13.000'} [2023-02-24 19:02:38,119][177158] DAMAGECOUNT value on done: 248284.0 [2023-02-24 19:02:38,119][177158] Sum rewards: 14.176, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.196', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO2': '0.025', 'AMMO3': '0.122', 'AMMO4': '0.126', 'weapon5': '0.272', 'WEAPON4': '0.350', 'ARMOR': '0.449', 'WEAPON5': '0.450', 'weapon4': '0.634', 'WEAPON3': '0.750', 'weapon2': '0.762', 'HITCOUNT': '1.030', 'weapon3': '1.718', 'DAMAGECOUNT': '4.890', 'FRAGCOUNT': '12.000'} [2023-02-24 19:02:38,423][177158] DAMAGECOUNT value on done: 250869.0 [2023-02-24 19:02:38,424][177158] Sum rewards: 20.415, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.514', 'AMMO5': '0.017', 'AMMO2': '0.027', 'AMMO3': '0.108', 'AMMO4': '0.137', 'weapon4': '0.164', 'WEAPON4': '0.200', 'weapon5': '0.294', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'weapon2': '0.752', 'HITCOUNT': '1.300', 'weapon3': '2.182', 'DAMAGECOUNT': '6.198', 'FRAGCOUNT': '16.000'} [2023-02-24 19:02:39,083][177158] DAMAGECOUNT value on done: 261302.0 [2023-02-24 19:02:39,083][177158] Sum rewards: 14.491, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.212', 'AMMO2': '0.019', 'AMMO5': '0.022', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'weapon5': '0.158', 'weapon4': '0.178', 'AMMO3': '0.188', 'WEAPON5': '0.450', 'weapon2': '0.744', 'WEAPON3': '1.050', 'HITCOUNT': '1.270', 'weapon3': '2.366', 'DAMAGECOUNT': '5.265', 'FRAGCOUNT': '14.000'} [2023-02-24 19:02:39,380][177158] DAMAGECOUNT value on done: 260806.0 [2023-02-24 19:02:39,380][177158] Sum rewards: 14.043, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.104', 'AMMO5': '0.026', 'AMMO2': '0.032', 'AMMO3': '0.147', 'AMMO4': '0.159', 'weapon5': '0.212', 'WEAPON4': '0.400', 'weapon4': '0.566', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'weapon2': '0.992', 'HITCOUNT': '1.230', 'weapon3': '1.756', 'DAMAGECOUNT': '4.827', 'FRAGCOUNT': '14.000'} [2023-02-24 19:02:39,497][177153] Updated weights for policy 0, policy_version 20390 (0.0008) [2023-02-24 19:02:41,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 83542016. Throughput: 0: 3455.6. Samples: 20883176. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:02:41,376][177119] Avg episode reward: [(0, '13.487')] [2023-02-24 19:02:41,947][177172] DAMAGECOUNT value on done: 255611.0 [2023-02-24 19:02:41,948][177172] Sum rewards: 12.186, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.408', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.013', 'AMMO3': '0.030', 'weapon7': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.462', 'weapon2': '0.632', 'weapon3': '0.752', 'ARMOR': '0.800', 'HITCOUNT': '0.940', 'DAMAGECOUNT': '3.000', 'FRAGCOUNT': '8.000'} [2023-02-24 19:02:42,253][177172] DAMAGECOUNT value on done: 248163.0 [2023-02-24 19:02:42,254][177172] Sum rewards: 22.517, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.445', 'AMMO2': '0.006', 'AMMO5': '0.022', 'AMMO4': '0.029', 'weapon7': '0.054', 'AMMO3': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.276', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'weapon2': '0.830', 'HITCOUNT': '1.100', 'weapon3': '1.706', 'DAMAGECOUNT': '6.039', 'FRAGCOUNT': '20.000'} [2023-02-24 19:02:42,444][177153] Updated weights for policy 0, policy_version 20400 (0.0008) [2023-02-24 19:02:43,722][177154] DAMAGECOUNT value on done: 260008.0 [2023-02-24 19:02:43,723][177154] Sum rewards: 18.999, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.012', 'AMMO2': '0.016', 'weapon7': '0.050', 'AMMO4': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.106', 'weapon5': '0.108', 'HEALTH': '0.124', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.390', 'WEAPON3': '0.600', 'weapon2': '1.152', 'HITCOUNT': '1.210', 'weapon3': '1.464', 'DAMAGECOUNT': '4.986', 'FRAGCOUNT': '14.000'} [2023-02-24 19:02:43,749][177172] DAMAGECOUNT value on done: 263539.0 [2023-02-24 19:02:43,750][177172] Sum rewards: 22.174, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon5': '0.088', 'AMMO3': '0.090', 'AMMO4': '0.142', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.480', 'WEAPON3': '0.550', 'HEALTH': '0.761', 'weapon2': '1.040', 'HITCOUNT': '1.360', 'weapon3': '1.984', 'DAMAGECOUNT': '5.721', 'FRAGCOUNT': '17.000'} [2023-02-24 19:02:44,024][177154] DAMAGECOUNT value on done: 263643.0 [2023-02-24 19:02:44,024][177154] Sum rewards: 12.989, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.558', 'AMMO5': '0.020', 'AMMO2': '0.036', 'AMMO3': '0.131', 'AMMO4': '0.181', 'weapon5': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.706', 'WEAPON3': '0.750', 'weapon2': '0.758', 'HITCOUNT': '1.330', 'weapon3': '1.836', 'DAMAGECOUNT': '5.283', 'FRAGCOUNT': '10.500'} [2023-02-24 19:02:44,048][177172] DAMAGECOUNT value on done: 251516.0 [2023-02-24 19:02:44,049][177172] Sum rewards: 15.118, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.161', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.029', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon5': '0.134', 'weapon4': '0.240', 'WEAPON5': '0.300', 'WEAPON3': '0.800', 'weapon2': '1.274', 'HITCOUNT': '1.350', 'weapon3': '2.058', 'DAMAGECOUNT': '5.355', 'FRAGCOUNT': '12.000'} [2023-02-24 19:02:44,308][177154] DAMAGECOUNT value on done: 269304.0 [2023-02-24 19:02:44,309][177154] Sum rewards: 15.755, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.130', 'AMMO2': '0.007', 'AMMO5': '0.014', 'AMMO4': '0.032', 'AMMO3': '0.090', 'weapon5': '0.108', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.422', 'WEAPON3': '0.700', 'HITCOUNT': '1.110', 'weapon2': '1.316', 'weapon3': '1.690', 'DAMAGECOUNT': '4.995', 'FRAGCOUNT': '12.000'} [2023-02-24 19:02:44,608][177154] DAMAGECOUNT value on done: 263275.0 [2023-02-24 19:02:44,609][177154] Sum rewards: 17.247, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.446', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon7': '0.060', 'AMMO3': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.172', 'AMMO4': '0.184', 'WEAPON5': '0.250', 'weapon4': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '1.090', 'weapon3': '1.200', 'weapon2': '1.334', 'DAMAGECOUNT': '4.740', 'FRAGCOUNT': '16.000'} [2023-02-24 19:02:44,869][177171] DAMAGECOUNT value on done: 251540.0 [2023-02-24 19:02:44,870][177171] Sum rewards: 13.251, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.268', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.170', 'WEAPON4': '0.250', 'weapon5': '0.266', 'weapon4': '0.316', 'WEAPON5': '0.400', 'weapon2': '0.708', 'WEAPON3': '1.000', 'HITCOUNT': '1.290', 'weapon3': '2.266', 'DAMAGECOUNT': '4.932', 'FRAGCOUNT': '13.000'} [2023-02-24 19:02:44,912][177157] DAMAGECOUNT value on done: 249215.0 [2023-02-24 19:02:44,912][177157] Sum rewards: 23.478, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.539', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'weapon7': '0.050', 'weapon5': '0.064', 'AMMO3': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon4': '0.176', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.244', 'HITCOUNT': '1.260', 'weapon3': '1.834', 'DAMAGECOUNT': '5.313', 'FRAGCOUNT': '19.000'} [2023-02-24 19:02:44,924][177157] DAMAGECOUNT value on done: 267175.0 [2023-02-24 19:02:44,925][177157] Sum rewards: 21.213, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.715', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.007', 'weapon5': '0.028', 'WEAPON4': '0.050', 'weapon4': '0.054', 'AMMO3': '0.122', 'weapon7': '0.138', 'WEAPON5': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '1.360', 'weapon2': '1.568', 'weapon3': '1.730', 'DAMAGECOUNT': '5.520', 'FRAGCOUNT': '18.000'} [2023-02-24 19:02:45,160][177171] DAMAGECOUNT value on done: 254785.0 [2023-02-24 19:02:45,160][177171] Sum rewards: 10.098, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.259', 'AMMO5': '0.023', 'AMMO2': '0.064', 'AMMO3': '0.138', 'AMMO4': '0.320', 'weapon5': '0.324', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'weapon4': '0.644', 'weapon2': '0.664', 'WEAPON3': '0.850', 'HITCOUNT': '1.010', 'weapon3': '1.724', 'DAMAGECOUNT': '3.945', 'FRAGCOUNT': '11.000'} [2023-02-24 19:02:45,182][177171] DAMAGECOUNT value on done: 260159.0 [2023-02-24 19:02:45,182][177171] Sum rewards: 11.042, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.485', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'WEAPON4': '0.300', 'weapon2': '0.484', 'weapon4': '0.658', 'WEAPON3': '1.050', 'HITCOUNT': '1.410', 'weapon3': '2.108', 'DAMAGECOUNT': '4.890', 'FRAGCOUNT': '13.000'} [2023-02-24 19:02:45,229][177157] DAMAGECOUNT value on done: 254033.0 [2023-02-24 19:02:45,230][177157] Sum rewards: 24.678, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.185', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO5': '0.027', 'weapon7': '0.078', 'AMMO4': '0.079', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.144', 'weapon5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.452', 'weapon2': '0.530', 'WEAPON5': '0.550', 'ARMOR': '0.849', 'WEAPON3': '1.000', 'HITCOUNT': '1.700', 'weapon3': '2.128', 'DAMAGECOUNT': '7.290', 'FRAGCOUNT': '21.000'} [2023-02-24 19:02:45,240][177157] DAMAGECOUNT value on done: 249338.0 [2023-02-24 19:02:45,241][177157] Sum rewards: 14.177, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.740', 'AMMO2': '0.022', 'AMMO5': '0.025', 'AMMO4': '0.112', 'weapon4': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'weapon5': '0.240', 'WEAPON5': '0.500', 'weapon2': '0.572', 'WEAPON3': '1.050', 'HITCOUNT': '1.120', 'weapon3': '2.442', 'DAMAGECOUNT': '5.388', 'FRAGCOUNT': '15.000'} [2023-02-24 19:02:45,437][177153] Updated weights for policy 0, policy_version 20410 (0.0008) [2023-02-24 19:02:45,470][177171] DAMAGECOUNT value on done: 254670.0 [2023-02-24 19:02:45,471][177171] Sum rewards: 13.233, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.181', 'AMMO2': '0.028', 'AMMO5': '0.030', 'AMMO3': '0.135', 'weapon5': '0.140', 'AMMO4': '0.141', 'WEAPON4': '0.300', 'weapon4': '0.434', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'weapon2': '1.040', 'HITCOUNT': '1.160', 'weapon3': '1.874', 'DAMAGECOUNT': '4.731', 'FRAGCOUNT': '13.000'} [2023-02-24 19:02:46,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 83611648. Throughput: 0: 3454.4. Samples: 20903924. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:02:46,376][177119] Avg episode reward: [(0, '14.183')] [2023-02-24 19:02:46,698][177155] DAMAGECOUNT value on done: 257104.0 [2023-02-24 19:02:46,699][177155] Sum rewards: 13.326, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.828', 'AMMO5': '0.019', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'AMMO4': '0.112', 'weapon4': '0.116', 'weapon5': '0.126', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'HITCOUNT': '1.070', 'weapon2': '1.140', 'weapon3': '1.842', 'DAMAGECOUNT': '4.563', 'FRAGCOUNT': '15.000'} [2023-02-24 19:02:46,994][177155] DAMAGECOUNT value on done: 264973.0 [2023-02-24 19:02:46,995][177155] Sum rewards: 4.003, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.670', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO3': '0.050', 'AMMO4': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon7': '0.132', 'weapon5': '0.180', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'ARMOR': '0.400', 'weapon4': '0.436', 'HITCOUNT': '0.480', 'weapon3': '0.806', 'weapon2': '1.152', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '2.031'} [2023-02-24 19:02:47,306][177155] DAMAGECOUNT value on done: 262696.0 [2023-02-24 19:02:47,306][177155] Sum rewards: 11.804, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.380', 'AMMO2': '0.002', 'AMMO4': '0.007', 'AMMO5': '0.022', 'WEAPON1': '0.040', 'AMMO3': '0.146', 'WEAPON4': '0.250', 'weapon5': '0.272', 'weapon4': '0.390', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'HITCOUNT': '1.060', 'weapon2': '1.158', 'weapon3': '1.674', 'DAMAGECOUNT': '4.113', 'FRAGCOUNT': '11.000'} [2023-02-24 19:02:47,610][177155] DAMAGECOUNT value on done: 248083.0 [2023-02-24 19:02:47,611][177155] Sum rewards: 20.339, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.536', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.027', 'weapon4': '0.030', 'WEAPON4': '0.050', 'weapon7': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.134', 'AMMO4': '0.137', 'weapon5': '0.262', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '1.180', 'weapon2': '1.184', 'weapon3': '1.906', 'DAMAGECOUNT': '5.685', 'FRAGCOUNT': '17.000'} [2023-02-24 19:02:48,391][177153] Updated weights for policy 0, policy_version 20420 (0.0008) [2023-02-24 19:02:51,340][177153] Updated weights for policy 0, policy_version 20430 (0.0008) [2023-02-24 19:02:51,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.2, 300 sec: 13884.7). Total num frames: 83681280. Throughput: 0: 3457.2. Samples: 20914344. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:02:51,376][177119] Avg episode reward: [(0, '14.292')] [2023-02-24 19:02:51,732][177156] Large shaping reward 3.276 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.225, 75.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 19:02:54,314][177153] Updated weights for policy 0, policy_version 20440 (0.0008) [2023-02-24 19:02:55,765][177170] DAMAGECOUNT value on done: 259009.0 [2023-02-24 19:02:55,765][177170] Sum rewards: 25.986, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.012', 'AMMO2': '0.023', 'HEALTH': '0.051', 'AMMO3': '0.070', 'AMMO4': '0.115', 'WEAPON4': '0.200', 'weapon5': '0.240', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'weapon2': '0.636', 'weapon4': '0.794', 'HITCOUNT': '1.320', 'weapon3': '1.610', 'DAMAGECOUNT': '6.114', 'FRAGCOUNT': '18.000'} [2023-02-24 19:02:56,031][177156] DAMAGECOUNT value on done: 259695.0 [2023-02-24 19:02:56,031][177156] Sum rewards: 15.617, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.665', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO3': '0.121', 'AMMO4': '0.160', 'weapon5': '0.220', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.452', 'WEAPON3': '0.750', 'weapon2': '0.800', 'HITCOUNT': '1.220', 'weapon3': '2.118', 'DAMAGECOUNT': '5.196', 'FRAGCOUNT': '15.000'} [2023-02-24 19:02:56,042][177156] DAMAGECOUNT value on done: 253710.0 [2023-02-24 19:02:56,043][177156] Sum rewards: 19.897, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.385', 'AMMO2': '0.007', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO4': '0.033', 'AMMO3': '0.093', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.130', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.226', 'weapon5': '0.256', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '1.050', 'weapon2': '1.226', 'weapon3': '1.496', 'DAMAGECOUNT': '4.974', 'FRAGCOUNT': '16.000'} [2023-02-24 19:02:56,063][177170] DAMAGECOUNT value on done: 264468.0 [2023-02-24 19:02:56,063][177170] Sum rewards: 8.990, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.692', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.131', 'weapon5': '0.234', 'weapon4': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'HITCOUNT': '0.940', 'weapon2': '1.376', 'weapon3': '1.638', 'DAMAGECOUNT': '3.357', 'FRAGCOUNT': '10.000'} [2023-02-24 19:02:56,329][177156] DAMAGECOUNT value on done: 265910.0 [2023-02-24 19:02:56,330][177156] Sum rewards: 21.302, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.946', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.082', 'AMMO3': '0.137', 'weapon5': '0.156', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'weapon4': '0.458', 'weapon2': '0.798', 'WEAPON3': '0.800', 'HITCOUNT': '1.520', 'weapon3': '2.062', 'DAMAGECOUNT': '6.006', 'FRAGCOUNT': '17.500'} [2023-02-24 19:02:56,346][177156] DAMAGECOUNT value on done: 253958.0 [2023-02-24 19:02:56,347][177156] Sum rewards: 14.585, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.060', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.183', 'weapon5': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.304', 'ARMOR': '0.404', 'WEAPON3': '1.100', 'weapon2': '1.118', 'HITCOUNT': '1.580', 'weapon3': '2.130', 'DAMAGECOUNT': '6.216', 'FRAGCOUNT': '17.000'} [2023-02-24 19:02:56,376][177119] Fps is (10 sec: 13516.9, 60 sec: 13789.9, 300 sec: 13870.9). Total num frames: 83746816. Throughput: 0: 3454.2. Samples: 20935034. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:02:56,376][177119] Avg episode reward: [(0, '14.868')] [2023-02-24 19:02:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000020447_83750912.pth... [2023-02-24 19:02:56,438][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000019633_80416768.pth [2023-02-24 19:02:56,675][177170] DAMAGECOUNT value on done: 254205.0 [2023-02-24 19:02:56,676][177170] Sum rewards: 8.147, reward structure: {'DEATHCOUNT': '-4.500', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'AMMO3': '0.050', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.189', 'WEAPON5': '0.200', 'weapon5': '0.244', 'WEAPON4': '0.250', 'WEAPON3': '0.250', 'HITCOUNT': '0.400', 'weapon4': '0.470', 'HEALTH': '0.578', 'weapon2': '0.860', 'weapon3': '1.002', 'DAMAGECOUNT': '1.704', 'FRAGCOUNT': '6.000'} [2023-02-24 19:02:56,975][177170] DAMAGECOUNT value on done: 258584.0 [2023-02-24 19:02:56,976][177170] Sum rewards: 13.643, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.425', 'AMMO2': '0.013', 'AMMO5': '0.015', 'AMMO3': '0.060', 'weapon7': '0.064', 'AMMO4': '0.067', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'weapon5': '0.220', 'weapon4': '0.356', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '0.870', 'weapon2': '1.294', 'weapon3': '1.556', 'DAMAGECOUNT': '3.753', 'FRAGCOUNT': '11.000'} [2023-02-24 19:02:57,276][177153] Updated weights for policy 0, policy_version 20450 (0.0008) [2023-02-24 19:02:57,597][177158] DAMAGECOUNT value on done: 249542.0 [2023-02-24 19:02:57,598][177158] Sum rewards: 12.151, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.250', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.090', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'weapon4': '0.272', 'weapon5': '0.350', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'weapon2': '0.728', 'HITCOUNT': '0.930', 'weapon3': '2.090', 'DAMAGECOUNT': '3.774', 'FRAGCOUNT': '10.000'} [2023-02-24 19:02:57,896][177158] DAMAGECOUNT value on done: 252898.0 [2023-02-24 19:02:57,897][177158] Sum rewards: 12.271, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.360', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.046', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.166', 'AMMO3': '0.215', 'AMMO4': '0.228', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.466', 'weapon2': '0.866', 'HITCOUNT': '1.250', 'WEAPON3': '1.350', 'weapon3': '2.082', 'DAMAGECOUNT': '6.087', 'FRAGCOUNT': '15.000'} [2023-02-24 19:02:58,542][177158] DAMAGECOUNT value on done: 262766.0 [2023-02-24 19:02:58,542][177158] Sum rewards: 15.870, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.260', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon7': '0.054', 'AMMO4': '0.107', 'AMMO3': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.198', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.360', 'WEAPON3': '0.750', 'HITCOUNT': '0.930', 'weapon2': '0.966', 'weapon3': '1.410', 'DAMAGECOUNT': '4.392', 'FRAGCOUNT': '15.000'} [2023-02-24 19:02:58,840][177158] DAMAGECOUNT value on done: 262488.0 [2023-02-24 19:02:58,841][177158] Sum rewards: 16.829, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.648', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.078', 'AMMO3': '0.099', 'weapon7': '0.102', 'weapon5': '0.198', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.316', 'weapon2': '0.592', 'WEAPON3': '0.600', 'HITCOUNT': '1.120', 'weapon3': '1.310', 'DAMAGECOUNT': '5.046', 'FRAGCOUNT': '13.500'} [2023-02-24 19:03:00,180][177170] Large shaping reward 3.321 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.27, 90.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 19:03:00,233][177153] Updated weights for policy 0, policy_version 20460 (0.0009) [2023-02-24 19:03:01,376][177119] Fps is (10 sec: 13516.5, 60 sec: 13789.8, 300 sec: 13870.9). Total num frames: 83816448. Throughput: 0: 3452.3. Samples: 20955738. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:03:01,377][177119] Avg episode reward: [(0, '14.863')] [2023-02-24 19:03:01,424][177172] DAMAGECOUNT value on done: 257357.0 [2023-02-24 19:03:01,424][177172] Sum rewards: 19.887, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.360', 'AMMO5': '0.005', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.092', 'AMMO3': '0.113', 'weapon5': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.486', 'WEAPON3': '0.800', 'weapon2': '0.854', 'HITCOUNT': '1.390', 'weapon3': '1.996', 'DAMAGECOUNT': '5.238', 'FRAGCOUNT': '17.000'} [2023-02-24 19:03:01,728][177172] DAMAGECOUNT value on done: 250594.0 [2023-02-24 19:03:01,728][177172] Sum rewards: 20.977, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.747', 'AMMO5': '0.014', 'AMMO2': '0.030', 'AMMO3': '0.138', 'AMMO4': '0.147', 'weapon5': '0.162', 'weapon4': '0.166', 'WEAPON4': '0.200', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.900', 'weapon2': '1.162', 'HITCOUNT': '1.800', 'weapon3': '2.212', 'DAMAGECOUNT': '7.293', 'FRAGCOUNT': '16.000'} [2023-02-24 19:03:03,192][177154] DAMAGECOUNT value on done: 262197.0 [2023-02-24 19:03:03,193][177154] Sum rewards: 24.668, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.885', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO3': '0.139', 'weapon5': '0.148', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.286', 'WEAPON3': '0.850', 'weapon2': '1.118', 'HITCOUNT': '1.610', 'weapon3': '2.194', 'DAMAGECOUNT': '6.567', 'FRAGCOUNT': '21.000'} [2023-02-24 19:03:03,210][177153] Updated weights for policy 0, policy_version 20470 (0.0008) [2023-02-24 19:03:03,211][177172] DAMAGECOUNT value on done: 264948.0 [2023-02-24 19:03:03,212][177172] Sum rewards: 11.610, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.360', 'AMMO2': '0.012', 'AMMO5': '0.015', 'AMMO4': '0.060', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.224', 'weapon4': '0.226', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon2': '0.950', 'HITCOUNT': '1.220', 'weapon3': '2.036', 'DAMAGECOUNT': '4.227', 'FRAGCOUNT': '8.500'} [2023-02-24 19:03:03,493][177154] DAMAGECOUNT value on done: 265264.0 [2023-02-24 19:03:03,494][177154] Sum rewards: 15.918, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.432', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.023', 'AMMO4': '0.117', 'AMMO3': '0.121', 'WEAPON4': '0.150', 'weapon5': '0.218', 'weapon4': '0.272', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon2': '0.596', 'WEAPON3': '0.750', 'HITCOUNT': '0.820', 'weapon3': '1.894', 'DAMAGECOUNT': '4.863', 'FRAGCOUNT': '14.000'} [2023-02-24 19:03:03,509][177172] DAMAGECOUNT value on done: 253303.0 [2023-02-24 19:03:03,509][177172] Sum rewards: 13.515, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.821', 'AMMO2': '0.018', 'AMMO5': '0.022', 'AMMO4': '0.090', 'AMMO3': '0.185', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.396', 'weapon4': '0.448', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '1.250', 'weapon3': '2.402', 'DAMAGECOUNT': '5.361', 'FRAGCOUNT': '16.000'} [2023-02-24 19:03:03,817][177154] DAMAGECOUNT value on done: 271241.0 [2023-02-24 19:03:03,818][177154] Sum rewards: 16.096, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.885', 'AMMO5': '0.017', 'AMMO2': '0.020', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'weapon7': '0.104', 'AMMO3': '0.161', 'weapon5': '0.182', 'WEAPON5': '0.350', 'weapon4': '0.350', 'weapon2': '0.494', 'WEAPON3': '1.000', 'HITCOUNT': '1.300', 'weapon3': '2.440', 'DAMAGECOUNT': '5.811', 'FRAGCOUNT': '15.500'} [2023-02-24 19:03:04,126][177154] DAMAGECOUNT value on done: 265326.0 [2023-02-24 19:03:04,126][177154] Sum rewards: 14.649, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.310', 'ARMOR': '0.004', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.077', 'AMMO3': '0.169', 'weapon5': '0.308', 'WEAPON5': '0.350', 'AMMO4': '0.383', 'weapon4': '0.558', 'weapon2': '0.594', 'WEAPON4': '0.700', 'WEAPON3': '1.000', 'HITCOUNT': '1.530', 'weapon3': '2.100', 'DAMAGECOUNT': '6.153', 'FRAGCOUNT': '18.000'} [2023-02-24 19:03:04,326][177171] DAMAGECOUNT value on done: 253563.0 [2023-02-24 19:03:04,326][177171] Sum rewards: 20.528, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.140', 'AMMO5': '0.016', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.083', 'AMMO3': '0.145', 'weapon4': '0.226', 'weapon5': '0.348', 'WEAPON5': '0.450', 'weapon2': '0.506', 'WEAPON3': '0.900', 'HITCOUNT': '1.280', 'weapon3': '2.308', 'DAMAGECOUNT': '6.069', 'FRAGCOUNT': '18.000'} [2023-02-24 19:03:04,355][177157] DAMAGECOUNT value on done: 269200.0 [2023-02-24 19:03:04,356][177157] Sum rewards: 18.035, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.440', 'weapon7': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.187', 'AMMO4': '0.190', 'weapon5': '0.242', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.518', 'weapon4': '0.542', 'WEAPON3': '1.150', 'HITCOUNT': '1.460', 'weapon3': '2.248', 'DAMAGECOUNT': '6.075', 'FRAGCOUNT': '21.000'} [2023-02-24 19:03:04,380][177157] DAMAGECOUNT value on done: 250969.0 [2023-02-24 19:03:04,381][177157] Sum rewards: 17.729, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.465', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.023', 'AMMO3': '0.098', 'AMMO4': '0.116', 'weapon5': '0.168', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon7': '0.266', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.442', 'WEAPON3': '0.600', 'weapon4': '0.924', 'weapon3': '1.046', 'HITCOUNT': '1.290', 'DAMAGECOUNT': '5.262', 'FRAGCOUNT': '14.000'} [2023-02-24 19:03:04,618][177171] DAMAGECOUNT value on done: 256809.0 [2023-02-24 19:03:04,618][177171] Sum rewards: 17.587, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.880', 'AMMO5': '0.009', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.064', 'weapon4': '0.130', 'AMMO3': '0.148', 'weapon5': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.424', 'WEAPON3': '1.100', 'weapon2': '1.210', 'HITCOUNT': '1.410', 'weapon3': '2.230', 'DAMAGECOUNT': '6.057', 'FRAGCOUNT': '16.000'} [2023-02-24 19:03:04,637][177171] DAMAGECOUNT value on done: 261587.0 [2023-02-24 19:03:04,637][177171] Sum rewards: 13.721, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.016', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon7': '0.064', 'AMMO3': '0.113', 'weapon5': '0.160', 'AMMO6': '0.220', 'AMMO7': '0.220', 'AMMO4': '0.263', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '0.600', 'weapon2': '0.638', 'HITCOUNT': '0.950', 'weapon4': '1.034', 'weapon3': '1.368', 'DAMAGECOUNT': '4.284', 'FRAGCOUNT': '13.000'} [2023-02-24 19:03:04,661][177157] DAMAGECOUNT value on done: 250300.0 [2023-02-24 19:03:04,662][177157] Sum rewards: 12.095, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.161', 'AMMO5': '0.007', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'weapon7': '0.052', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.145', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'weapon4': '0.394', 'HITCOUNT': '0.670', 'weapon2': '1.128', 'weapon3': '1.262', 'DAMAGECOUNT': '2.886', 'FRAGCOUNT': '8.000'} [2023-02-24 19:03:04,684][177157] DAMAGECOUNT value on done: 255996.0 [2023-02-24 19:03:04,685][177157] Sum rewards: 13.906, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.550', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon7': '0.046', 'AMMO4': '0.069', 'weapon5': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.154', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.672', 'weapon2': '0.930', 'WEAPON3': '1.050', 'HITCOUNT': '1.610', 'weapon3': '1.640', 'DAMAGECOUNT': '5.889', 'FRAGCOUNT': '14.000'} [2023-02-24 19:03:04,923][177171] DAMAGECOUNT value on done: 256558.0 [2023-02-24 19:03:04,923][177171] Sum rewards: 21.278, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.978', 'AMMO2': '0.009', 'AMMO5': '0.020', 'AMMO4': '0.047', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'weapon5': '0.222', 'weapon4': '0.280', 'WEAPON5': '0.350', 'ARMOR': '0.447', 'weapon2': '0.594', 'WEAPON3': '1.000', 'HITCOUNT': '1.300', 'weapon3': '2.464', 'DAMAGECOUNT': '5.664', 'FRAGCOUNT': '20.000'} [2023-02-24 19:03:06,193][177153] Updated weights for policy 0, policy_version 20480 (0.0008) [2023-02-24 19:03:06,205][177155] DAMAGECOUNT value on done: 259978.0 [2023-02-24 19:03:06,206][177155] Sum rewards: 23.210, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.574', 'AMMO2': '0.021', 'AMMO5': '0.022', 'weapon7': '0.066', 'AMMO4': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.196', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.224', 'weapon5': '0.314', 'WEAPON5': '0.500', 'weapon2': '0.656', 'WEAPON3': '1.200', 'HITCOUNT': '1.770', 'weapon3': '2.226', 'DAMAGECOUNT': '8.592', 'FRAGCOUNT': '21.000'} [2023-02-24 19:03:06,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13789.9, 300 sec: 13870.9). Total num frames: 83886080. Throughput: 0: 3452.6. Samples: 20966042. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:03:06,376][177119] Avg episode reward: [(0, '15.713')] [2023-02-24 19:03:06,379][177140] Saving new best policy, reward=15.713! [2023-02-24 19:03:06,519][177155] DAMAGECOUNT value on done: 266709.0 [2023-02-24 19:03:06,519][177155] Sum rewards: 15.902, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.573', 'AMMO2': '0.014', 'AMMO5': '0.018', 'AMMO4': '0.071', 'weapon7': '0.084', 'AMMO3': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.194', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon4': '0.484', 'WEAPON3': '0.800', 'weapon2': '0.960', 'HITCOUNT': '1.340', 'weapon3': '1.946', 'DAMAGECOUNT': '5.208', 'FRAGCOUNT': '14.500'} [2023-02-24 19:03:06,824][177155] DAMAGECOUNT value on done: 264869.0 [2023-02-24 19:03:06,824][177155] Sum rewards: 20.502, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.737', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.017', 'weapon7': '0.066', 'AMMO4': '0.083', 'AMMO3': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.518', 'WEAPON3': '0.550', 'weapon2': '0.742', 'HITCOUNT': '1.400', 'weapon3': '1.566', 'DAMAGECOUNT': '6.519', 'FRAGCOUNT': '16.000'} [2023-02-24 19:03:07,127][177155] DAMAGECOUNT value on done: 250080.0 [2023-02-24 19:03:07,128][177155] Sum rewards: 19.387, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.286', 'AMMO5': '0.018', 'AMMO2': '0.020', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'weapon4': '0.128', 'AMMO3': '0.175', 'weapon5': '0.256', 'WEAPON5': '0.500', 'weapon2': '0.638', 'WEAPON3': '1.100', 'HITCOUNT': '1.330', 'weapon3': '2.564', 'DAMAGECOUNT': '5.991', 'FRAGCOUNT': '19.000'} [2023-02-24 19:03:09,180][177153] Updated weights for policy 0, policy_version 20490 (0.0008) [2023-02-24 19:03:11,376][177119] Fps is (10 sec: 13926.7, 60 sec: 13789.9, 300 sec: 13870.9). Total num frames: 83955712. Throughput: 0: 3450.4. Samples: 20986662. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:03:11,376][177119] Avg episode reward: [(0, '15.874')] [2023-02-24 19:03:11,377][177140] Saving new best policy, reward=15.874! [2023-02-24 19:03:12,174][177153] Updated weights for policy 0, policy_version 20500 (0.0008) [2023-02-24 19:03:15,131][177153] Updated weights for policy 0, policy_version 20510 (0.0008) [2023-02-24 19:03:15,285][177170] DAMAGECOUNT value on done: 260874.0 [2023-02-24 19:03:15,285][177170] Sum rewards: 19.682, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.711', 'AMMO2': '0.010', 'AMMO5': '0.012', 'weapon7': '0.048', 'AMMO4': '0.052', 'AMMO3': '0.077', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.274', 'WEAPON4': '0.300', 'weapon5': '0.376', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '1.120', 'weapon2': '1.372', 'weapon3': '1.466', 'DAMAGECOUNT': '5.595', 'FRAGCOUNT': '16.000'} [2023-02-24 19:03:15,540][177156] DAMAGECOUNT value on done: 261693.0 [2023-02-24 19:03:15,540][177156] Sum rewards: 17.279, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.250', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.135', 'weapon5': '0.150', 'AMMO4': '0.239', 'WEAPON5': '0.300', 'weapon2': '0.496', 'WEAPON4': '0.650', 'WEAPON3': '0.850', 'weapon4': '0.952', 'weapon3': '1.418', 'HITCOUNT': '1.420', 'DAMAGECOUNT': '5.994', 'FRAGCOUNT': '16.000'} [2023-02-24 19:03:15,551][177156] DAMAGECOUNT value on done: 254778.0 [2023-02-24 19:03:15,552][177156] Sum rewards: 15.139, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'AMMO3': '0.042', 'WEAPON4': '0.050', 'weapon7': '0.064', 'AMMO4': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.152', 'HEALTH': '0.195', 'WEAPON5': '0.200', 'weapon4': '0.210', 'WEAPON3': '0.300', 'HITCOUNT': '0.670', 'weapon3': '0.784', 'weapon2': '0.810', 'DAMAGECOUNT': '3.204', 'FRAGCOUNT': '11.000'} [2023-02-24 19:03:15,581][177170] DAMAGECOUNT value on done: 265463.0 [2023-02-24 19:03:15,582][177170] Sum rewards: 11.625, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.371', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.023', 'weapon7': '0.052', 'AMMO3': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.210', 'weapon5': '0.270', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.740', 'weapon2': '1.166', 'weapon3': '1.538', 'DAMAGECOUNT': '2.985', 'FRAGCOUNT': '11.000'} [2023-02-24 19:03:15,853][177156] DAMAGECOUNT value on done: 268125.0 [2023-02-24 19:03:15,853][177156] Sum rewards: 22.324, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.495', 'AMMO2': '0.005', 'AMMO5': '0.017', 'AMMO4': '0.027', 'weapon4': '0.070', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'weapon5': '0.296', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'weapon2': '1.372', 'HITCOUNT': '1.400', 'weapon3': '1.882', 'DAMAGECOUNT': '6.645', 'FRAGCOUNT': '18.000'} [2023-02-24 19:03:15,865][177156] DAMAGECOUNT value on done: 256312.0 [2023-02-24 19:03:15,865][177156] Sum rewards: 24.436, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.915', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO3': '0.115', 'AMMO4': '0.168', 'weapon5': '0.174', 'WEAPON5': '0.300', 'ARMOR': '0.436', 'WEAPON4': '0.600', 'weapon2': '0.724', 'WEAPON3': '0.750', 'weapon4': '0.766', 'HITCOUNT': '1.510', 'weapon3': '1.950', 'DAMAGECOUNT': '7.062', 'FRAGCOUNT': '19.000'} [2023-02-24 19:03:16,164][177170] DAMAGECOUNT value on done: 256963.0 [2023-02-24 19:03:16,165][177170] Sum rewards: 29.907, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.311', 'AMMO2': '0.022', 'AMMO5': '0.028', 'AMMO4': '0.108', 'weapon5': '0.184', 'AMMO3': '0.198', 'WEAPON4': '0.350', 'weapon4': '0.396', 'ARMOR': '0.400', 'weapon2': '0.488', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'HITCOUNT': '2.010', 'weapon3': '2.560', 'DAMAGECOUNT': '8.274', 'FRAGCOUNT': '29.000'} [2023-02-24 19:03:16,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13789.9, 300 sec: 13870.9). Total num frames: 84025344. Throughput: 0: 3445.4. Samples: 21007172. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:03:16,376][177119] Avg episode reward: [(0, '16.113')] [2023-02-24 19:03:16,380][177140] Saving new best policy, reward=16.113! [2023-02-24 19:03:16,477][177170] DAMAGECOUNT value on done: 260875.0 [2023-02-24 19:03:16,477][177170] Sum rewards: 26.612, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.094', 'AMMO2': '0.010', 'AMMO5': '0.021', 'AMMO4': '0.052', 'weapon7': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.143', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon5': '0.324', 'ARMOR': '0.452', 'WEAPON5': '0.500', 'weapon2': '0.510', 'weapon4': '0.578', 'WEAPON3': '0.900', 'HITCOUNT': '1.570', 'weapon3': '1.954', 'DAMAGECOUNT': '6.873', 'FRAGCOUNT': '22.000'} [2023-02-24 19:03:16,785][177157] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-24 19:03:17,149][177158] DAMAGECOUNT value on done: 251422.0 [2023-02-24 19:03:17,149][177158] Sum rewards: 18.473, reward structure: {'DEATHCOUNT': '-9.000', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO5': '0.022', 'AMMO4': '0.095', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'weapon5': '0.232', 'HEALTH': '0.258', 'weapon4': '0.290', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'weapon2': '0.918', 'HITCOUNT': '1.390', 'weapon3': '2.174', 'DAMAGECOUNT': '5.640', 'FRAGCOUNT': '15.000'} [2023-02-24 19:03:17,449][177158] DAMAGECOUNT value on done: 254987.0 [2023-02-24 19:03:17,450][177158] Sum rewards: 19.321, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.240', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.044', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'AMMO4': '0.220', 'weapon4': '0.492', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'weapon2': '1.110', 'HITCOUNT': '1.480', 'weapon3': '1.976', 'DAMAGECOUNT': '6.267', 'FRAGCOUNT': '19.000'} [2023-02-24 19:03:18,117][177158] DAMAGECOUNT value on done: 264235.0 [2023-02-24 19:03:18,117][177158] Sum rewards: 12.950, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.544', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.043', 'weapon7': '0.080', 'AMMO3': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO4': '0.212', 'weapon4': '0.372', 'WEAPON4': '0.400', 'weapon5': '0.402', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon2': '0.728', 'HITCOUNT': '1.060', 'weapon3': '1.912', 'DAMAGECOUNT': '4.407', 'FRAGCOUNT': '12.000'} [2023-02-24 19:03:18,127][177153] Updated weights for policy 0, policy_version 20520 (0.0008) [2023-02-24 19:03:18,420][177158] DAMAGECOUNT value on done: 263972.0 [2023-02-24 19:03:18,420][177158] Sum rewards: 16.137, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.418', 'AMMO2': '0.011', 'AMMO5': '0.012', 'weapon4': '0.032', 'WEAPON4': '0.050', 'weapon7': '0.052', 'AMMO4': '0.057', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.105', 'weapon5': '0.128', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.850', 'weapon2': '1.008', 'weapon3': '1.324', 'DAMAGECOUNT': '4.425', 'FRAGCOUNT': '14.000'} [2023-02-24 19:03:20,970][177172] DAMAGECOUNT value on done: 259211.0 [2023-02-24 19:03:20,971][177172] Sum rewards: 23.345, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.702', 'AMMO2': '0.015', 'AMMO5': '0.022', 'AMMO4': '0.074', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'weapon4': '0.272', 'weapon5': '0.364', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'weapon2': '1.262', 'HITCOUNT': '1.480', 'weapon3': '1.572', 'DAMAGECOUNT': '5.562', 'FRAGCOUNT': '20.000'} [2023-02-24 19:03:21,069][177153] Updated weights for policy 0, policy_version 20530 (0.0009) [2023-02-24 19:03:21,266][177172] DAMAGECOUNT value on done: 251888.0 [2023-02-24 19:03:21,267][177172] Sum rewards: 9.598, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.706', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.025', 'weapon5': '0.108', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'weapon4': '0.294', 'WEAPON5': '0.550', 'WEAPON3': '0.950', 'HITCOUNT': '1.060', 'weapon2': '1.296', 'weapon3': '1.534', 'DAMAGECOUNT': '3.882', 'FRAGCOUNT': '12.000'} [2023-02-24 19:03:21,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 84094976. Throughput: 0: 3443.5. Samples: 21017506. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:03:21,376][177119] Avg episode reward: [(0, '16.340')] [2023-02-24 19:03:21,377][177140] Saving new best policy, reward=16.340! [2023-02-24 19:03:22,735][177154] DAMAGECOUNT value on done: 264140.0 [2023-02-24 19:03:22,735][177154] Sum rewards: 14.936, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.810', 'AMMO2': '0.007', 'AMMO5': '0.022', 'AMMO4': '0.035', 'AMMO3': '0.145', 'weapon5': '0.232', 'WEAPON4': '0.300', 'weapon4': '0.336', 'ARMOR': '0.446', 'WEAPON5': '0.550', 'weapon2': '0.738', 'WEAPON3': '1.100', 'HITCOUNT': '1.270', 'weapon3': '2.236', 'DAMAGECOUNT': '5.829', 'FRAGCOUNT': '15.000'} [2023-02-24 19:03:22,767][177172] DAMAGECOUNT value on done: 266206.0 [2023-02-24 19:03:22,768][177172] Sum rewards: 10.886, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.114', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon7': '0.056', 'AMMO4': '0.074', 'AMMO3': '0.083', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.184', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.262', 'WEAPON3': '0.550', 'HITCOUNT': '0.700', 'weapon2': '0.810', 'weapon3': '1.292', 'DAMAGECOUNT': '3.774', 'FRAGCOUNT': '10.000'} [2023-02-24 19:03:23,032][177154] DAMAGECOUNT value on done: 267277.0 [2023-02-24 19:03:23,032][177154] Sum rewards: 21.247, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.645', 'AMMO2': '0.005', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.024', 'weapon7': '0.054', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.120', 'weapon5': '0.132', 'AMMO3': '0.141', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.874', 'WEAPON3': '0.950', 'HITCOUNT': '1.540', 'weapon3': '2.140', 'DAMAGECOUNT': '6.039', 'FRAGCOUNT': '19.000'} [2023-02-24 19:03:23,067][177172] DAMAGECOUNT value on done: 255570.0 [2023-02-24 19:03:23,068][177172] Sum rewards: 20.779, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.036', 'AMMO2': '0.010', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'weapon7': '0.046', 'AMMO4': '0.050', 'AMMO3': '0.111', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.242', 'weapon5': '0.314', 'ARMOR': '0.453', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon2': '1.134', 'HITCOUNT': '1.290', 'weapon3': '1.816', 'DAMAGECOUNT': '6.801', 'FRAGCOUNT': '15.000'} [2023-02-24 19:03:23,334][177154] DAMAGECOUNT value on done: 272569.0 [2023-02-24 19:03:23,334][177154] Sum rewards: 12.194, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.613', 'AMMO2': '0.009', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.047', 'AMMO3': '0.075', 'WEAPON4': '0.150', 'weapon5': '0.190', 'weapon4': '0.368', 'WEAPON5': '0.400', 'ARMOR': '0.455', 'WEAPON3': '0.500', 'HITCOUNT': '0.870', 'weapon3': '1.290', 'weapon2': '1.434', 'DAMAGECOUNT': '3.984', 'FRAGCOUNT': '9.000'} [2023-02-24 19:03:23,632][177154] DAMAGECOUNT value on done: 266931.0 [2023-02-24 19:03:23,632][177154] Sum rewards: 16.973, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.845', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.010', 'AMMO3': '0.054', 'weapon7': '0.088', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.232', 'weapon4': '0.238', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.820', 'weapon2': '0.880', 'weapon3': '1.232', 'DAMAGECOUNT': '4.815', 'FRAGCOUNT': '12.000'} [2023-02-24 19:03:23,864][177171] DAMAGECOUNT value on done: 254756.0 [2023-02-24 19:03:23,865][177171] Sum rewards: 8.024, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.136', 'WEAPON1': '0.020', 'AMMO5': '0.030', 'AMMO2': '0.030', 'AMMO3': '0.111', 'AMMO4': '0.152', 'weapon5': '0.280', 'weapon4': '0.416', 'WEAPON4': '0.450', 'HITCOUNT': '0.640', 'WEAPON5': '0.700', 'WEAPON3': '0.700', 'weapon2': '0.806', 'weapon3': '1.996', 'DAMAGECOUNT': '3.579', 'FRAGCOUNT': '9.000'} [2023-02-24 19:03:23,945][177157] DAMAGECOUNT value on done: 253302.0 [2023-02-24 19:03:23,946][177157] Sum rewards: 21.149, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.874', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon4': '0.016', 'AMMO5': '0.021', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'weapon5': '0.418', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'weapon2': '0.900', 'HITCOUNT': '1.110', 'weapon3': '2.276', 'DAMAGECOUNT': '6.825', 'FRAGCOUNT': '18.000'} [2023-02-24 19:03:23,958][177157] DAMAGECOUNT value on done: 270910.0 [2023-02-24 19:03:23,958][177157] Sum rewards: 15.024, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.195', 'AMMO2': '0.008', 'AMMO5': '0.030', 'AMMO4': '0.038', 'WEAPON4': '0.100', 'weapon5': '0.180', 'AMMO3': '0.189', 'weapon4': '0.190', 'weapon2': '0.570', 'WEAPON5': '0.700', 'HITCOUNT': '1.140', 'WEAPON3': '1.250', 'weapon3': '2.694', 'DAMAGECOUNT': '5.130', 'FRAGCOUNT': '17.000'} [2023-02-24 19:03:24,028][177153] Updated weights for policy 0, policy_version 20540 (0.0008) [2023-02-24 19:03:24,157][177171] DAMAGECOUNT value on done: 258340.0 [2023-02-24 19:03:24,157][177171] Sum rewards: 14.072, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.446', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon7': '0.050', 'AMMO3': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.171', 'weapon5': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.449', 'WEAPON3': '0.450', 'weapon2': '0.626', 'weapon4': '0.942', 'HITCOUNT': '1.100', 'weapon3': '1.240', 'DAMAGECOUNT': '4.593', 'FRAGCOUNT': '11.000'} [2023-02-24 19:03:24,178][177171] DAMAGECOUNT value on done: 263266.0 [2023-02-24 19:03:24,179][177171] Sum rewards: 13.810, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.802', 'AMMO5': '0.020', 'AMMO2': '0.028', 'AMMO4': '0.141', 'AMMO3': '0.183', 'weapon5': '0.226', 'WEAPON4': '0.250', 'weapon4': '0.254', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'weapon2': '0.894', 'WEAPON3': '1.000', 'HITCOUNT': '1.260', 'weapon3': '2.118', 'DAMAGECOUNT': '5.037', 'FRAGCOUNT': '16.000'} [2023-02-24 19:03:24,258][177157] DAMAGECOUNT value on done: 257179.0 [2023-02-24 19:03:24,259][177157] Sum rewards: 13.266, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.125', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.034', 'AMMO3': '0.113', 'AMMO4': '0.169', 'weapon5': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.378', 'ARMOR': '0.460', 'WEAPON3': '0.750', 'weapon2': '0.904', 'HITCOUNT': '1.000', 'weapon3': '1.820', 'DAMAGECOUNT': '3.549', 'FRAGCOUNT': '12.000'} [2023-02-24 19:03:24,271][177157] DAMAGECOUNT value on done: 252296.0 [2023-02-24 19:03:24,271][177157] Sum rewards: 17.626, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.058', 'ARMOR': '0.004', 'AMMO2': '0.005', 'AMMO5': '0.020', 'AMMO4': '0.023', 'weapon5': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'weapon4': '0.334', 'WEAPON5': '0.450', 'weapon2': '0.710', 'WEAPON3': '1.250', 'HITCOUNT': '1.500', 'weapon3': '2.426', 'DAMAGECOUNT': '5.988', 'FRAGCOUNT': '17.000'} [2023-02-24 19:03:24,471][177171] DAMAGECOUNT value on done: 258168.0 [2023-02-24 19:03:24,472][177171] Sum rewards: 19.857, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.484', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO3': '0.073', 'AMMO4': '0.082', 'WEAPON4': '0.150', 'weapon5': '0.166', 'weapon4': '0.176', 'WEAPON5': '0.200', 'WEAPON3': '0.500', 'HITCOUNT': '1.240', 'weapon2': '1.366', 'weapon3': '1.524', 'DAMAGECOUNT': '4.830', 'FRAGCOUNT': '16.000'} [2023-02-24 19:03:25,849][177155] DAMAGECOUNT value on done: 262397.0 [2023-02-24 19:03:25,850][177155] Sum rewards: 30.275, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.725', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON5': '0.150', 'weapon5': '0.158', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.344', 'WEAPON3': '1.100', 'weapon2': '1.206', 'HITCOUNT': '1.880', 'weapon3': '1.982', 'DAMAGECOUNT': '7.257', 'FRAGCOUNT': '28.000'} [2023-02-24 19:03:26,151][177155] DAMAGECOUNT value on done: 268819.0 [2023-02-24 19:03:26,151][177155] Sum rewards: 11.417, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.894', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO4': '0.142', 'AMMO3': '0.177', 'weapon5': '0.208', 'WEAPON5': '0.350', 'weapon2': '0.450', 'ARMOR': '0.456', 'WEAPON4': '0.500', 'weapon4': '0.618', 'WEAPON3': '1.150', 'HITCOUNT': '1.430', 'weapon3': '2.184', 'DAMAGECOUNT': '6.330', 'FRAGCOUNT': '13.000'} [2023-02-24 19:03:26,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13789.9, 300 sec: 13857.0). Total num frames: 84160512. Throughput: 0: 3445.1. Samples: 21038204. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:03:26,376][177119] Avg episode reward: [(0, '16.618')] [2023-02-24 19:03:26,380][177140] Saving new best policy, reward=16.618! [2023-02-24 19:03:26,449][177155] DAMAGECOUNT value on done: 267328.0 [2023-02-24 19:03:26,449][177155] Sum rewards: 18.575, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.041', 'AMMO5': '0.028', 'AMMO2': '0.029', 'AMMO4': '0.143', 'AMMO3': '0.185', 'weapon5': '0.228', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon2': '0.414', 'WEAPON5': '0.450', 'weapon4': '0.474', 'WEAPON3': '1.050', 'HITCOUNT': '1.850', 'weapon3': '2.488', 'DAMAGECOUNT': '7.377', 'FRAGCOUNT': '17.500'} [2023-02-24 19:03:26,765][177155] DAMAGECOUNT value on done: 252252.0 [2023-02-24 19:03:26,765][177155] Sum rewards: 16.266, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.503', 'WEAPON1': '0.010', 'AMMO5': '0.024', 'AMMO2': '0.029', 'weapon4': '0.144', 'AMMO4': '0.144', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'weapon5': '0.314', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'weapon2': '1.066', 'HITCOUNT': '1.290', 'weapon3': '2.098', 'DAMAGECOUNT': '6.336', 'FRAGCOUNT': '14.000'} [2023-02-24 19:03:27,037][177153] Updated weights for policy 0, policy_version 20550 (0.0008) [2023-02-24 19:03:30,040][177153] Updated weights for policy 0, policy_version 20560 (0.0008) [2023-02-24 19:03:31,376][177119] Fps is (10 sec: 13516.7, 60 sec: 13789.9, 300 sec: 13857.0). Total num frames: 84230144. Throughput: 0: 3439.6. Samples: 21058706. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 19:03:31,376][177119] Avg episode reward: [(0, '16.732')] [2023-02-24 19:03:31,377][177140] Saving new best policy, reward=16.732! [2023-02-24 19:03:33,015][177153] Updated weights for policy 0, policy_version 20570 (0.0008) [2023-02-24 19:03:34,834][177170] DAMAGECOUNT value on done: 263340.0 [2023-02-24 19:03:34,835][177170] Sum rewards: 23.356, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.939', 'AMMO2': '0.007', 'AMMO5': '0.012', 'AMMO4': '0.036', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'weapon5': '0.160', 'WEAPON5': '0.300', 'weapon4': '0.464', 'WEAPON3': '0.850', 'weapon2': '0.878', 'HITCOUNT': '1.760', 'weapon3': '2.152', 'DAMAGECOUNT': '7.398', 'FRAGCOUNT': '19.000'} [2023-02-24 19:03:35,065][177156] DAMAGECOUNT value on done: 262642.0 [2023-02-24 19:03:35,066][177156] Sum rewards: 3.132, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.620', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon5': '0.060', 'AMMO3': '0.107', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.568', 'WEAPON3': '0.700', 'HITCOUNT': '0.760', 'weapon3': '0.812', 'weapon2': '0.966', 'DAMAGECOUNT': '2.847', 'FRAGCOUNT': '5.000'} [2023-02-24 19:03:35,077][177156] DAMAGECOUNT value on done: 256723.0 [2023-02-24 19:03:35,078][177156] Sum rewards: 19.642, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.342', 'AMMO2': '0.016', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.081', 'AMMO3': '0.112', 'weapon4': '0.274', 'WEAPON4': '0.300', 'weapon5': '0.312', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'weapon2': '0.898', 'HITCOUNT': '1.200', 'weapon3': '2.118', 'DAMAGECOUNT': '5.835', 'FRAGCOUNT': '17.500'} [2023-02-24 19:03:35,130][177170] DAMAGECOUNT value on done: 266351.0 [2023-02-24 19:03:35,131][177170] Sum rewards: 9.110, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.752', 'AMMO2': '0.014', 'AMMO5': '0.017', 'AMMO3': '0.050', 'AMMO4': '0.069', 'weapon4': '0.098', 'WEAPON4': '0.100', 'weapon5': '0.286', 'WEAPON3': '0.400', 'WEAPON5': '0.500', 'HITCOUNT': '0.810', 'weapon3': '1.146', 'weapon2': '1.958', 'DAMAGECOUNT': '2.664', 'FRAGCOUNT': '7.000'} [2023-02-24 19:03:35,375][177156] DAMAGECOUNT value on done: 269953.0 [2023-02-24 19:03:35,376][177156] Sum rewards: 23.438, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.606', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.065', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.246', 'weapon4': '0.356', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'ARMOR': '0.852', 'HITCOUNT': '0.980', 'weapon3': '1.226', 'weapon2': '1.336', 'DAMAGECOUNT': '5.484', 'FRAGCOUNT': '17.000'} [2023-02-24 19:03:35,389][177156] DAMAGECOUNT value on done: 258472.0 [2023-02-24 19:03:35,389][177156] Sum rewards: 24.259, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.187', 'ARMOR': '0.004', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.137', 'AMMO4': '0.142', 'weapon5': '0.172', 'WEAPON4': '0.200', 'weapon4': '0.294', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'weapon2': '1.010', 'HITCOUNT': '1.770', 'weapon3': '2.026', 'DAMAGECOUNT': '6.480', 'FRAGCOUNT': '20.000'} [2023-02-24 19:03:35,706][177170] DAMAGECOUNT value on done: 258165.0 [2023-02-24 19:03:35,706][177170] Sum rewards: 11.397, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.060', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.134', 'weapon4': '0.182', 'weapon5': '0.238', 'WEAPON5': '0.450', 'WEAPON3': '0.900', 'HITCOUNT': '0.910', 'weapon2': '1.372', 'weapon3': '1.804', 'DAMAGECOUNT': '3.606', 'FRAGCOUNT': '12.000'} [2023-02-24 19:03:35,984][177153] Updated weights for policy 0, policy_version 20580 (0.0009) [2023-02-24 19:03:35,998][177170] DAMAGECOUNT value on done: 263088.0 [2023-02-24 19:03:35,999][177170] Sum rewards: 25.946, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.435', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'WEAPON4': '0.100', 'AMMO3': '0.125', 'weapon4': '0.218', 'weapon5': '0.266', 'WEAPON5': '0.400', 'weapon2': '0.918', 'WEAPON3': '0.950', 'HITCOUNT': '1.530', 'weapon3': '2.014', 'DAMAGECOUNT': '6.639', 'FRAGCOUNT': '22.000'} [2023-02-24 19:03:36,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13789.9, 300 sec: 13857.0). Total num frames: 84299776. Throughput: 0: 3439.0. Samples: 21069098. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 19:03:36,376][177119] Avg episode reward: [(0, '16.806')] [2023-02-24 19:03:36,380][177140] Saving new best policy, reward=16.806! [2023-02-24 19:03:36,676][177158] DAMAGECOUNT value on done: 252835.0 [2023-02-24 19:03:36,677][177158] Sum rewards: 5.485, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.660', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.130', 'AMMO3': '0.165', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon2': '0.604', 'weapon4': '0.874', 'WEAPON3': '1.100', 'HITCOUNT': '1.180', 'weapon3': '1.988', 'DAMAGECOUNT': '4.239', 'FRAGCOUNT': '9.000'} [2023-02-24 19:03:36,978][177158] DAMAGECOUNT value on done: 256717.0 [2023-02-24 19:03:36,979][177158] Sum rewards: 12.790, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.788', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'AMMO2': '0.037', 'AMMO3': '0.107', 'weapon5': '0.166', 'AMMO4': '0.185', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.540', 'WEAPON3': '0.750', 'weapon4': '0.944', 'HITCOUNT': '1.080', 'weapon3': '1.384', 'DAMAGECOUNT': '5.190', 'FRAGCOUNT': '14.000'} [2023-02-24 19:03:37,612][177158] DAMAGECOUNT value on done: 266364.0 [2023-02-24 19:03:37,613][177158] Sum rewards: 24.277, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.590', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.027', 'weapon7': '0.088', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.218', 'WEAPON3': '0.800', 'weapon2': '0.948', 'HITCOUNT': '1.430', 'weapon3': '1.984', 'DAMAGECOUNT': '6.387', 'FRAGCOUNT': '21.000'} [2023-02-24 19:03:37,906][177158] DAMAGECOUNT value on done: 265452.0 [2023-02-24 19:03:37,906][177158] Sum rewards: 16.913, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.787', 'AMMO5': '0.017', 'AMMO2': '0.033', 'AMMO3': '0.113', 'AMMO4': '0.164', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.208', 'weapon4': '0.346', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'ARMOR': '0.436', 'WEAPON3': '0.650', 'HITCOUNT': '1.050', 'weapon2': '1.168', 'weapon3': '2.024', 'DAMAGECOUNT': '4.440', 'FRAGCOUNT': '14.000'} [2023-02-24 19:03:38,945][177153] Updated weights for policy 0, policy_version 20590 (0.0009) [2023-02-24 19:03:40,468][177172] DAMAGECOUNT value on done: 260695.0 [2023-02-24 19:03:40,468][177172] Sum rewards: 14.985, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.688', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.020', 'weapon5': '0.040', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.180', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'weapon2': '0.716', 'HITCOUNT': '0.890', 'weapon3': '1.408', 'DAMAGECOUNT': '4.452', 'FRAGCOUNT': '12.000'} [2023-02-24 19:03:40,775][177172] DAMAGECOUNT value on done: 253597.0 [2023-02-24 19:03:40,775][177172] Sum rewards: 17.669, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.991', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.033', 'AMMO3': '0.132', 'AMMO4': '0.166', 'weapon4': '0.170', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.600', 'WEAPON3': '0.900', 'HITCOUNT': '1.000', 'weapon2': '1.018', 'weapon3': '1.980', 'DAMAGECOUNT': '5.112', 'FRAGCOUNT': '17.000'} [2023-02-24 19:03:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13857.0). Total num frames: 84369408. Throughput: 0: 3439.5. Samples: 21089810. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 19:03:41,376][177119] Avg episode reward: [(0, '16.783')] [2023-02-24 19:03:41,881][177153] Updated weights for policy 0, policy_version 20600 (0.0008) [2023-02-24 19:03:42,251][177172] DAMAGECOUNT value on done: 267875.0 [2023-02-24 19:03:42,252][177172] Sum rewards: 16.026, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.584', 'AMMO2': '0.015', 'AMMO5': '0.015', 'AMMO4': '0.073', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'weapon5': '0.214', 'weapon4': '0.240', 'WEAPON5': '0.400', 'weapon2': '0.944', 'WEAPON3': '1.000', 'HITCOUNT': '1.290', 'weapon3': '2.052', 'DAMAGECOUNT': '5.007', 'FRAGCOUNT': '15.000'} [2023-02-24 19:03:42,284][177154] DAMAGECOUNT value on done: 265451.0 [2023-02-24 19:03:42,285][177154] Sum rewards: 11.893, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.279', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'weapon7': '0.058', 'AMMO4': '0.063', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.340', 'weapon2': '0.398', 'WEAPON3': '0.650', 'HITCOUNT': '0.870', 'weapon3': '1.322', 'DAMAGECOUNT': '3.933', 'FRAGCOUNT': '12.000'} [2023-02-24 19:03:42,541][177172] DAMAGECOUNT value on done: 258756.0 [2023-02-24 19:03:42,541][177172] Sum rewards: 32.321, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.275', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.087', 'weapon5': '0.144', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon4': '0.352', 'WEAPON5': '0.400', 'ARMOR': '0.400', 'weapon2': '0.404', 'WEAPON3': '1.250', 'HITCOUNT': '2.000', 'weapon3': '2.562', 'DAMAGECOUNT': '9.558', 'FRAGCOUNT': '29.000'} [2023-02-24 19:03:42,583][177154] DAMAGECOUNT value on done: 268697.0 [2023-02-24 19:03:42,584][177154] Sum rewards: 9.307, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.792', 'AMMO5': '0.017', 'AMMO2': '0.033', 'weapon7': '0.084', 'AMMO3': '0.108', 'AMMO4': '0.166', 'weapon5': '0.188', 'weapon2': '0.264', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '0.700', 'weapon4': '0.944', 'HITCOUNT': '1.070', 'weapon3': '1.714', 'DAMAGECOUNT': '4.260', 'FRAGCOUNT': '11.000'} [2023-02-24 19:03:42,877][177154] DAMAGECOUNT value on done: 274014.0 [2023-02-24 19:03:42,877][177154] Sum rewards: 7.457, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.108', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.042', 'weapon5': '0.130', 'AMMO3': '0.183', 'AMMO4': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.453', 'weapon2': '0.638', 'weapon4': '0.728', 'HITCOUNT': '0.990', 'WEAPON3': '1.200', 'weapon3': '2.022', 'DAMAGECOUNT': '4.335', 'FRAGCOUNT': '10.000'} [2023-02-24 19:03:43,181][177154] DAMAGECOUNT value on done: 269427.0 [2023-02-24 19:03:43,182][177154] Sum rewards: 23.033, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.979', 'AMMO5': '0.017', 'AMMO2': '0.035', 'AMMO3': '0.138', 'AMMO4': '0.172', 'weapon5': '0.332', 'WEAPON5': '0.350', 'weapon4': '0.362', 'WEAPON4': '0.400', 'weapon2': '0.786', 'WEAPON3': '0.800', 'HITCOUNT': '1.800', 'weapon3': '2.082', 'DAMAGECOUNT': '7.488', 'FRAGCOUNT': '19.000'} [2023-02-24 19:03:43,454][177171] DAMAGECOUNT value on done: 256435.0 [2023-02-24 19:03:43,454][177171] Sum rewards: 12.058, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.544', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.138', 'AMMO3': '0.153', 'AMMO4': '0.207', 'WEAPON4': '0.250', 'weapon2': '0.252', 'WEAPON5': '0.300', 'ARMOR': '0.450', 'weapon4': '0.536', 'WEAPON3': '1.000', 'HITCOUNT': '1.130', 'weapon3': '2.000', 'DAMAGECOUNT': '5.037', 'FRAGCOUNT': '13.000'} [2023-02-24 19:03:43,507][177157] DAMAGECOUNT value on done: 255342.0 [2023-02-24 19:03:43,508][177157] Sum rewards: 18.575, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.685', 'AMMO5': '0.023', 'AMMO2': '0.032', 'AMMO3': '0.133', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'weapon4': '0.308', 'weapon5': '0.380', 'weapon2': '0.460', 'WEAPON5': '0.650', 'WEAPON3': '0.950', 'HITCOUNT': '1.340', 'weapon3': '2.256', 'DAMAGECOUNT': '6.120', 'FRAGCOUNT': '17.000'} [2023-02-24 19:03:43,518][177157] DAMAGECOUNT value on done: 273687.0 [2023-02-24 19:03:43,519][177157] Sum rewards: 30.700, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.398', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon5': '0.146', 'AMMO3': '0.147', 'AMMO4': '0.189', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.586', 'weapon2': '0.760', 'WEAPON3': '0.900', 'HITCOUNT': '1.970', 'weapon3': '2.106', 'DAMAGECOUNT': '8.331', 'FRAGCOUNT': '26.000'} [2023-02-24 19:03:43,658][177171] DAMAGECOUNT value on done: 260340.0 [2023-02-24 19:03:43,659][177171] Sum rewards: 13.389, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.744', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.042', 'AMMO3': '0.155', 'AMMO4': '0.209', 'weapon5': '0.224', 'weapon2': '0.404', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'weapon4': '0.662', 'ARMOR': '0.835', 'WEAPON3': '1.100', 'HITCOUNT': '1.480', 'weapon3': '2.182', 'DAMAGECOUNT': '6.000', 'FRAGCOUNT': '16.000'} [2023-02-24 19:03:43,766][177171] DAMAGECOUNT value on done: 264887.0 [2023-02-24 19:03:43,767][177171] Sum rewards: 15.059, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.989', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.020', 'AMMO4': '0.102', 'AMMO3': '0.141', 'WEAPON4': '0.200', 'weapon5': '0.280', 'ARMOR': '0.400', 'weapon4': '0.436', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'weapon2': '1.058', 'HITCOUNT': '1.120', 'weapon3': '1.698', 'DAMAGECOUNT': '4.863', 'FRAGCOUNT': '14.000'} [2023-02-24 19:03:43,822][177157] DAMAGECOUNT value on done: 259247.0 [2023-02-24 19:03:43,822][177157] Sum rewards: 13.043, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.701', 'AMMO5': '0.025', 'AMMO2': '0.030', 'WEAPON1': '0.040', 'AMMO4': '0.151', 'weapon5': '0.182', 'AMMO3': '0.194', 'WEAPON4': '0.300', 'weapon4': '0.318', 'WEAPON5': '0.600', 'weapon2': '0.708', 'WEAPON3': '1.300', 'HITCOUNT': '1.350', 'weapon3': '2.342', 'DAMAGECOUNT': '6.204', 'FRAGCOUNT': '14.000'} [2023-02-24 19:03:43,833][177157] DAMAGECOUNT value on done: 254484.0 [2023-02-24 19:03:43,833][177157] Sum rewards: 20.836, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.522', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO3': '0.155', 'AMMO4': '0.196', 'weapon4': '0.204', 'weapon5': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'weapon2': '1.102', 'HITCOUNT': '1.320', 'weapon3': '2.048', 'DAMAGECOUNT': '6.564', 'FRAGCOUNT': '20.000'} [2023-02-24 19:03:43,963][177171] DAMAGECOUNT value on done: 259937.0 [2023-02-24 19:03:43,963][177171] Sum rewards: 18.492, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.660', 'AMMO2': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.049', 'weapon5': '0.068', 'weapon7': '0.136', 'AMMO3': '0.141', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON7': '0.400', 'weapon2': '0.650', 'weapon4': '0.690', 'WEAPON3': '0.900', 'HITCOUNT': '1.260', 'weapon3': '1.394', 'DAMAGECOUNT': '5.307', 'FRAGCOUNT': '17.000'} [2023-02-24 19:03:44,814][177153] Updated weights for policy 0, policy_version 20610 (0.0008) [2023-02-24 19:03:45,361][177155] DAMAGECOUNT value on done: 264614.0 [2023-02-24 19:03:45,362][177155] Sum rewards: 21.092, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.792', 'AMMO5': '0.015', 'AMMO2': '0.023', 'weapon7': '0.062', 'AMMO4': '0.112', 'AMMO3': '0.125', 'weapon5': '0.150', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.612', 'WEAPON3': '0.800', 'weapon2': '0.942', 'HITCOUNT': '1.440', 'weapon3': '1.452', 'DAMAGECOUNT': '6.651', 'FRAGCOUNT': '18.000'} [2023-02-24 19:03:45,659][177155] DAMAGECOUNT value on done: 270890.0 [2023-02-24 19:03:45,660][177155] Sum rewards: 22.328, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.834', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'weapon5': '0.238', 'WEAPON5': '0.350', 'weapon4': '0.360', 'weapon2': '0.850', 'WEAPON3': '0.950', 'HITCOUNT': '1.350', 'weapon3': '2.166', 'DAMAGECOUNT': '6.213', 'FRAGCOUNT': '20.000'} [2023-02-24 19:03:45,955][177155] DAMAGECOUNT value on done: 269192.0 [2023-02-24 19:03:45,956][177155] Sum rewards: 16.557, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.177', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'weapon7': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.196', 'WEAPON7': '0.200', 'weapon5': '0.310', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'weapon2': '0.932', 'HITCOUNT': '1.310', 'weapon3': '1.982', 'DAMAGECOUNT': '5.592', 'FRAGCOUNT': '13.000'} [2023-02-24 19:03:46,256][177155] DAMAGECOUNT value on done: 254367.0 [2023-02-24 19:03:46,257][177155] Sum rewards: 20.313, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.286', 'AMMO5': '0.026', 'WEAPON1': '0.030', 'AMMO2': '0.034', 'AMMO3': '0.137', 'AMMO4': '0.168', 'weapon5': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.358', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'weapon2': '1.032', 'HITCOUNT': '1.410', 'weapon3': '1.880', 'DAMAGECOUNT': '6.345', 'FRAGCOUNT': '18.000'} [2023-02-24 19:03:46,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13857.0). Total num frames: 84439040. Throughput: 0: 3441.8. Samples: 21110620. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 19:03:46,376][177119] Avg episode reward: [(0, '17.040')] [2023-02-24 19:03:46,379][177140] Saving new best policy, reward=17.040! [2023-02-24 19:03:47,781][177153] Updated weights for policy 0, policy_version 20620 (0.0008) [2023-02-24 19:03:50,748][177153] Updated weights for policy 0, policy_version 20630 (0.0008) [2023-02-24 19:03:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13870.9). Total num frames: 84508672. Throughput: 0: 3442.2. Samples: 21120942. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 19:03:51,376][177119] Avg episode reward: [(0, '17.040')] [2023-02-24 19:03:53,723][177153] Updated weights for policy 0, policy_version 20640 (0.0008) [2023-02-24 19:03:54,192][177170] DAMAGECOUNT value on done: 265173.0 [2023-02-24 19:03:54,192][177170] Sum rewards: 19.038, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.470', 'AMMO5': '0.015', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.136', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.208', 'WEAPON5': '0.400', 'weapon5': '0.424', 'weapon2': '0.788', 'WEAPON3': '0.800', 'HITCOUNT': '0.960', 'weapon3': '2.094', 'DAMAGECOUNT': '5.499', 'FRAGCOUNT': '17.000'} [2023-02-24 19:03:54,498][177170] DAMAGECOUNT value on done: 268132.0 [2023-02-24 19:03:54,499][177170] Sum rewards: 21.324, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.340', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.055', 'AMMO3': '0.076', 'weapon5': '0.138', 'weapon7': '0.148', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'AMMO4': '0.276', 'WEAPON4': '0.350', 'WEAPON3': '0.500', 'weapon4': '0.640', 'weapon2': '0.710', 'HITCOUNT': '0.950', 'weapon3': '1.508', 'DAMAGECOUNT': '4.743', 'FRAGCOUNT': '19.000'} [2023-02-24 19:03:54,514][177156] DAMAGECOUNT value on done: 264745.0 [2023-02-24 19:03:54,515][177156] Sum rewards: 23.713, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.200', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'weapon5': '0.234', 'WEAPON5': '0.300', 'weapon4': '0.310', 'ARMOR': '0.456', 'weapon2': '0.692', 'WEAPON3': '0.850', 'HITCOUNT': '1.380', 'weapon3': '2.238', 'DAMAGECOUNT': '6.309', 'FRAGCOUNT': '20.000'} [2023-02-24 19:03:54,525][177156] DAMAGECOUNT value on done: 257951.0 [2023-02-24 19:03:54,526][177156] Sum rewards: 14.980, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.330', 'AMMO2': '0.008', 'AMMO5': '0.012', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'weapon7': '0.058', 'AMMO3': '0.097', 'weapon4': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.192', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.592', 'WEAPON3': '0.750', 'HITCOUNT': '0.910', 'weapon3': '2.026', 'DAMAGECOUNT': '3.684', 'FRAGCOUNT': '13.000'} [2023-02-24 19:03:54,818][177156] DAMAGECOUNT value on done: 271339.0 [2023-02-24 19:03:54,818][177156] Sum rewards: 10.211, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.499', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.061', 'AMMO3': '0.125', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.270', 'WEAPON5': '0.300', 'AMMO4': '0.304', 'weapon4': '0.434', 'WEAPON4': '0.700', 'WEAPON3': '0.800', 'HITCOUNT': '0.890', 'weapon2': '1.358', 'weapon3': '1.440', 'DAMAGECOUNT': '4.158', 'FRAGCOUNT': '11.000'} [2023-02-24 19:03:54,830][177156] DAMAGECOUNT value on done: 259783.0 [2023-02-24 19:03:54,830][177156] Sum rewards: 5.146, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.715', 'AMMO5': '0.022', 'AMMO2': '0.038', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.155', 'AMMO4': '0.189', 'WEAPON4': '0.250', 'weapon5': '0.332', 'ARMOR': '0.462', 'weapon4': '0.484', 'weapon2': '0.584', 'WEAPON5': '0.600', 'HITCOUNT': '0.910', 'WEAPON3': '1.000', 'weapon3': '1.554', 'DAMAGECOUNT': '3.933', 'FRAGCOUNT': '6.500'} [2023-02-24 19:03:55,086][177170] DAMAGECOUNT value on done: 259127.0 [2023-02-24 19:03:55,086][177170] Sum rewards: 7.779, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.080', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO3': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.155', 'weapon5': '0.204', 'WEAPON5': '0.300', 'weapon4': '0.564', 'weapon2': '0.640', 'WEAPON3': '0.650', 'HITCOUNT': '0.830', 'weapon3': '1.836', 'DAMAGECOUNT': '2.886', 'FRAGCOUNT': '5.500'} [2023-02-24 19:03:55,393][177170] DAMAGECOUNT value on done: 264577.0 [2023-02-24 19:03:55,394][177170] Sum rewards: 16.587, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO3': '0.075', 'HEALTH': '0.150', 'weapon5': '0.176', 'AMMO4': '0.197', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'weapon4': '0.476', 'HITCOUNT': '0.970', 'weapon2': '1.306', 'weapon3': '1.520', 'DAMAGECOUNT': '4.467', 'FRAGCOUNT': '13.000'} [2023-02-24 19:03:56,108][177158] DAMAGECOUNT value on done: 253862.0 [2023-02-24 19:03:56,109][177158] Sum rewards: 9.308, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.627', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.017', 'weapon7': '0.050', 'AMMO4': '0.083', 'AMMO3': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.162', 'WEAPON4': '0.200', 'weapon4': '0.378', 'WEAPON5': '0.400', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.720', 'weapon2': '0.872', 'weapon3': '1.306', 'DAMAGECOUNT': '3.081', 'FRAGCOUNT': '8.000'} [2023-02-24 19:03:56,376][177119] Fps is (10 sec: 13516.9, 60 sec: 13789.9, 300 sec: 13857.0). Total num frames: 84574208. Throughput: 0: 3445.2. Samples: 21141696. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 19:03:56,376][177119] Avg episode reward: [(0, '16.909')] [2023-02-24 19:03:56,419][177158] DAMAGECOUNT value on done: 259160.0 [2023-02-24 19:03:56,419][177158] Sum rewards: 27.599, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.008', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon5': '0.272', 'WEAPON5': '0.300', 'ARMOR': '0.493', 'WEAPON3': '0.750', 'weapon2': '1.028', 'HITCOUNT': '1.290', 'weapon3': '2.098', 'DAMAGECOUNT': '7.314', 'FRAGCOUNT': '23.000'} [2023-02-24 19:03:56,704][177153] Updated weights for policy 0, policy_version 20650 (0.0009) [2023-02-24 19:03:57,072][177158] DAMAGECOUNT value on done: 267607.0 [2023-02-24 19:03:57,072][177158] Sum rewards: 8.422, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.764', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'ARMOR': '0.004', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'WEAPON4': '0.100', 'AMMO3': '0.153', 'weapon4': '0.190', 'weapon5': '0.258', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'HITCOUNT': '1.020', 'weapon2': '1.020', 'weapon3': '2.030', 'DAMAGECOUNT': '3.729', 'FRAGCOUNT': '8.500'} [2023-02-24 19:03:57,386][177158] DAMAGECOUNT value on done: 267354.0 [2023-02-24 19:03:57,387][177158] Sum rewards: 16.588, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.533', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.012', 'AMMO3': '0.180', 'weapon5': '0.278', 'WEAPON5': '0.350', 'weapon2': '1.042', 'WEAPON3': '1.100', 'HITCOUNT': '1.420', 'weapon3': '2.274', 'DAMAGECOUNT': '5.706', 'FRAGCOUNT': '16.000'} [2023-02-24 19:03:59,631][177153] Updated weights for policy 0, policy_version 20660 (0.0008) [2023-02-24 19:03:59,866][177172] DAMAGECOUNT value on done: 261670.0 [2023-02-24 19:03:59,867][177172] Sum rewards: 10.787, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.522', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'weapon7': '0.078', 'AMMO4': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.137', 'weapon4': '0.226', 'WEAPON5': '0.300', 'weapon5': '0.322', 'weapon2': '0.328', 'HITCOUNT': '0.730', 'WEAPON3': '0.800', 'weapon3': '1.992', 'DAMAGECOUNT': '2.925', 'FRAGCOUNT': '12.000'} [2023-02-24 19:04:00,168][177172] DAMAGECOUNT value on done: 255774.0 [2023-02-24 19:04:00,168][177172] Sum rewards: 20.132, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.410', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.139', 'weapon5': '0.186', 'WEAPON4': '0.200', 'weapon4': '0.206', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'weapon2': '1.360', 'HITCOUNT': '1.590', 'weapon3': '1.900', 'DAMAGECOUNT': '6.531', 'FRAGCOUNT': '17.000'} [2023-02-24 19:04:01,376][177119] Fps is (10 sec: 13516.7, 60 sec: 13789.9, 300 sec: 13857.0). Total num frames: 84643840. Throughput: 0: 3452.7. Samples: 21162544. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:04:01,377][177119] Avg episode reward: [(0, '17.136')] [2023-02-24 19:04:01,377][177140] Saving new best policy, reward=17.136! [2023-02-24 19:04:01,705][177172] DAMAGECOUNT value on done: 269008.0 [2023-02-24 19:04:01,706][177172] Sum rewards: 8.863, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.930', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'weapon5': '0.062', 'AMMO3': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.154', 'WEAPON7': '0.200', 'weapon4': '0.236', 'weapon2': '0.426', 'WEAPON3': '0.500', 'HITCOUNT': '0.740', 'weapon3': '1.082', 'DAMAGECOUNT': '3.399', 'FRAGCOUNT': '7.000'} [2023-02-24 19:04:01,732][177154] DAMAGECOUNT value on done: 266703.0 [2023-02-24 19:04:01,732][177154] Sum rewards: 15.398, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.240', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'weapon5': '0.114', 'WEAPON5': '0.200', 'weapon4': '0.226', 'ARMOR': '0.486', 'WEAPON3': '0.650', 'HITCOUNT': '1.050', 'weapon2': '1.286', 'weapon3': '1.468', 'DAMAGECOUNT': '3.756', 'FRAGCOUNT': '14.000'} [2023-02-24 19:04:02,000][177172] DAMAGECOUNT value on done: 260441.0 [2023-02-24 19:04:02,000][177172] Sum rewards: 15.147, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.390', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.125', 'AMMO4': '0.145', 'weapon5': '0.170', 'WEAPON5': '0.300', 'weapon4': '0.308', 'WEAPON4': '0.400', 'WEAPON3': '0.800', 'weapon2': '0.868', 'HITCOUNT': '1.250', 'weapon3': '2.056', 'DAMAGECOUNT': '5.055', 'FRAGCOUNT': '14.000'} [2023-02-24 19:04:02,033][177154] DAMAGECOUNT value on done: 271709.0 [2023-02-24 19:04:02,033][177154] Sum rewards: 31.005, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.306', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'weapon5': '0.172', 'weapon4': '0.196', 'AMMO3': '0.245', 'WEAPON5': '0.450', 'weapon2': '0.530', 'WEAPON3': '1.500', 'HITCOUNT': '2.230', 'weapon3': '2.710', 'DAMAGECOUNT': '9.036', 'FRAGCOUNT': '30.000'} [2023-02-24 19:04:02,333][177154] DAMAGECOUNT value on done: 275620.0 [2023-02-24 19:04:02,333][177154] Sum rewards: 16.265, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.614', 'AMMO5': '0.017', 'AMMO2': '0.031', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'AMMO4': '0.155', 'weapon4': '0.176', 'weapon5': '0.208', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'HITCOUNT': '1.130', 'weapon2': '1.158', 'weapon3': '2.152', 'DAMAGECOUNT': '4.818', 'FRAGCOUNT': '15.000'} [2023-02-24 19:04:02,604][177153] Updated weights for policy 0, policy_version 20670 (0.0008) [2023-02-24 19:04:02,630][177154] DAMAGECOUNT value on done: 271667.0 [2023-02-24 19:04:02,630][177154] Sum rewards: 26.047, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.706', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.090', 'weapon4': '0.094', 'AMMO4': '0.116', 'WEAPON4': '0.200', 'weapon5': '0.240', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'weapon2': '1.216', 'HITCOUNT': '1.230', 'weapon3': '2.040', 'DAMAGECOUNT': '6.720', 'FRAGCOUNT': '22.000'} [2023-02-24 19:04:02,881][177157] DAMAGECOUNT value on done: 256941.0 [2023-02-24 19:04:02,882][177157] Sum rewards: 11.606, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.650', 'AMMO5': '0.017', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon4': '0.036', 'AMMO4': '0.096', 'AMMO3': '0.138', 'WEAPON4': '0.200', 'weapon5': '0.316', 'WEAPON5': '0.500', 'weapon2': '0.890', 'WEAPON3': '0.900', 'HITCOUNT': '0.910', 'weapon3': '2.166', 'DAMAGECOUNT': '4.797', 'FRAGCOUNT': '12.000'} [2023-02-24 19:04:02,892][177157] DAMAGECOUNT value on done: 275000.0 [2023-02-24 19:04:02,892][177157] Sum rewards: 15.520, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.304', 'AMMO5': '0.009', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon4': '0.080', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'weapon5': '0.108', 'WEAPON5': '0.200', 'ARMOR': '0.296', 'WEAPON3': '0.650', 'HITCOUNT': '0.970', 'weapon2': '1.178', 'weapon3': '1.896', 'DAMAGECOUNT': '3.939', 'FRAGCOUNT': '13.000'} [2023-02-24 19:04:02,934][177171] DAMAGECOUNT value on done: 259272.0 [2023-02-24 19:04:02,934][177171] Sum rewards: 28.595, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.015', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO3': '0.147', 'WEAPON5': '0.250', 'weapon5': '0.302', 'weapon2': '0.694', 'WEAPON3': '1.000', 'HITCOUNT': '1.510', 'weapon3': '2.194', 'DAMAGECOUNT': '8.511', 'FRAGCOUNT': '25.000'} [2023-02-24 19:04:03,119][177171] DAMAGECOUNT value on done: 262241.0 [2023-02-24 19:04:03,120][177171] Sum rewards: 17.116, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.007', 'AMMO5': '0.016', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'AMMO4': '0.101', 'AMMO3': '0.146', 'WEAPON4': '0.200', 'weapon4': '0.292', 'weapon5': '0.334', 'weapon2': '0.390', 'WEAPON5': '0.400', 'ARMOR': '0.449', 'WEAPON3': '1.000', 'HITCOUNT': '1.500', 'weapon3': '2.532', 'DAMAGECOUNT': '5.703', 'FRAGCOUNT': '14.000'} [2023-02-24 19:04:03,176][177157] DAMAGECOUNT value on done: 260218.0 [2023-02-24 19:04:03,176][177157] Sum rewards: 8.594, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.708', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO2': '0.027', 'weapon7': '0.060', 'weapon5': '0.064', 'AMMO3': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.134', 'weapon2': '0.168', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'ARMOR': '0.493', 'WEAPON4': '0.500', 'WEAPON3': '0.600', 'weapon4': '0.754', 'HITCOUNT': '0.770', 'weapon3': '1.352', 'DAMAGECOUNT': '2.913', 'FRAGCOUNT': '9.000'} [2023-02-24 19:04:03,186][177157] DAMAGECOUNT value on done: 255657.0 [2023-02-24 19:04:03,186][177157] Sum rewards: 11.604, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.410', 'AMMO5': '0.007', 'weapon5': '0.016', 'AMMO2': '0.021', 'AMMO3': '0.056', 'AMMO4': '0.105', 'weapon7': '0.128', 'WEAPON5': '0.150', 'weapon2': '0.226', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.542', 'HITCOUNT': '0.750', 'weapon3': '0.818', 'DAMAGECOUNT': '3.465', 'FRAGCOUNT': '11.000'} [2023-02-24 19:04:03,241][177171] DAMAGECOUNT value on done: 266516.0 [2023-02-24 19:04:03,241][177171] Sum rewards: 13.159, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.310', 'AMMO5': '0.029', 'AMMO2': '0.044', 'AMMO3': '0.119', 'AMMO4': '0.220', 'weapon4': '0.240', 'weapon5': '0.294', 'WEAPON4': '0.450', 'WEAPON5': '0.650', 'WEAPON3': '0.750', 'HITCOUNT': '1.150', 'weapon2': '1.242', 'weapon3': '1.894', 'DAMAGECOUNT': '4.887', 'FRAGCOUNT': '13.000'} [2023-02-24 19:04:03,425][177171] DAMAGECOUNT value on done: 261717.0 [2023-02-24 19:04:03,425][177171] Sum rewards: 12.948, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.270', 'AMMO2': '0.017', 'AMMO5': '0.017', 'AMMO4': '0.082', 'AMMO3': '0.128', 'weapon5': '0.174', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.442', 'weapon2': '0.730', 'WEAPON3': '0.800', 'HITCOUNT': '1.120', 'weapon3': '1.982', 'DAMAGECOUNT': '5.226', 'FRAGCOUNT': '14.000'} [2023-02-24 19:04:04,834][177155] DAMAGECOUNT value on done: 266284.0 [2023-02-24 19:04:04,835][177155] Sum rewards: 14.241, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.448', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'AMMO5': '0.030', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'weapon5': '0.284', 'weapon4': '0.344', 'WEAPON5': '0.600', 'weapon2': '0.796', 'HITCOUNT': '1.100', 'WEAPON3': '1.300', 'weapon3': '2.146', 'DAMAGECOUNT': '5.010', 'FRAGCOUNT': '17.000'} [2023-02-24 19:04:05,139][177155] DAMAGECOUNT value on done: 273055.0 [2023-02-24 19:04:05,139][177155] Sum rewards: 19.322, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.480', 'AMMO5': '0.017', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.163', 'WEAPON4': '0.250', 'weapon5': '0.260', 'WEAPON5': '0.350', 'weapon4': '0.388', 'weapon2': '0.930', 'WEAPON3': '1.050', 'HITCOUNT': '1.360', 'weapon3': '2.144', 'DAMAGECOUNT': '6.495', 'FRAGCOUNT': '17.000'} [2023-02-24 19:04:05,439][177155] DAMAGECOUNT value on done: 271161.0 [2023-02-24 19:04:05,439][177155] Sum rewards: 17.973, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.480', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO5': '0.018', 'AMMO4': '0.083', 'AMMO3': '0.088', 'WEAPON4': '0.350', 'weapon5': '0.376', 'ARMOR': '0.448', 'WEAPON5': '0.550', 'weapon4': '0.550', 'WEAPON3': '0.600', 'weapon2': '1.070', 'HITCOUNT': '1.240', 'weapon3': '1.646', 'DAMAGECOUNT': '5.907', 'FRAGCOUNT': '14.000'} [2023-02-24 19:04:05,564][177153] Updated weights for policy 0, policy_version 20680 (0.0009) [2023-02-24 19:04:05,742][177155] DAMAGECOUNT value on done: 255810.0 [2023-02-24 19:04:05,743][177155] Sum rewards: 13.605, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.156', 'AMMO5': '0.014', 'AMMO2': '0.025', 'AMMO3': '0.061', 'AMMO4': '0.126', 'weapon5': '0.178', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'WEAPON4': '0.450', 'ARMOR': '0.453', 'weapon4': '0.872', 'weapon2': '0.982', 'HITCOUNT': '1.280', 'weapon3': '1.290', 'DAMAGECOUNT': '4.329', 'FRAGCOUNT': '10.000'} [2023-02-24 19:04:06,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13789.9, 300 sec: 13857.0). Total num frames: 84713472. Throughput: 0: 3451.6. Samples: 21172828. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:04:06,376][177119] Avg episode reward: [(0, '17.057')] [2023-02-24 19:04:08,505][177153] Updated weights for policy 0, policy_version 20690 (0.0008) [2023-02-24 19:04:09,055][177154] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 19:04:11,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13789.9, 300 sec: 13857.0). Total num frames: 84783104. Throughput: 0: 3453.9. Samples: 21193628. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:04:11,376][177119] Avg episode reward: [(0, '17.057')] [2023-02-24 19:04:11,473][177153] Updated weights for policy 0, policy_version 20700 (0.0008) [2023-02-24 19:04:13,616][177170] DAMAGECOUNT value on done: 267713.0 [2023-02-24 19:04:13,616][177170] Sum rewards: 24.783, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.550', 'AMMO5': '0.020', 'AMMO2': '0.033', 'AMMO3': '0.154', 'AMMO4': '0.164', 'weapon4': '0.254', 'weapon5': '0.272', 'WEAPON4': '0.450', 'WEAPON5': '0.600', 'weapon2': '0.732', 'WEAPON3': '1.050', 'HITCOUNT': '1.680', 'weapon3': '2.304', 'DAMAGECOUNT': '7.620', 'FRAGCOUNT': '24.000'} [2023-02-24 19:04:13,929][177170] DAMAGECOUNT value on done: 269321.0 [2023-02-24 19:04:13,930][177170] Sum rewards: 9.172, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.600', 'AMMO5': '0.023', 'AMMO2': '0.032', 'AMMO3': '0.153', 'AMMO4': '0.159', 'weapon5': '0.224', 'WEAPON4': '0.250', 'weapon4': '0.336', 'WEAPON5': '0.550', 'HITCOUNT': '0.760', 'WEAPON3': '0.850', 'weapon2': '1.252', 'weapon3': '1.866', 'DAMAGECOUNT': '3.567', 'FRAGCOUNT': '9.000'} [2023-02-24 19:04:13,981][177156] DAMAGECOUNT value on done: 266509.0 [2023-02-24 19:04:13,981][177156] Sum rewards: 17.197, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.100', 'AMMO2': '0.006', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'AMMO3': '0.095', 'WEAPON4': '0.150', 'weapon4': '0.234', 'weapon5': '0.418', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'weapon2': '0.902', 'HITCOUNT': '1.050', 'weapon3': '2.034', 'DAMAGECOUNT': '5.292', 'FRAGCOUNT': '13.500'} [2023-02-24 19:04:13,991][177156] DAMAGECOUNT value on done: 259942.0 [2023-02-24 19:04:13,992][177156] Sum rewards: 27.022, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.932', 'AMMO2': '0.010', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.050', 'weapon7': '0.098', 'AMMO3': '0.106', 'weapon5': '0.154', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.604', 'weapon2': '0.672', 'WEAPON3': '0.700', 'weapon3': '1.472', 'HITCOUNT': '1.490', 'DAMAGECOUNT': '5.973', 'FRAGCOUNT': '22.000'} [2023-02-24 19:04:14,291][177156] DAMAGECOUNT value on done: 272909.0 [2023-02-24 19:04:14,292][177156] Sum rewards: 13.674, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.540', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO4': '0.042', 'AMMO3': '0.155', 'weapon5': '0.308', 'WEAPON5': '0.550', 'weapon2': '0.894', 'HITCOUNT': '1.000', 'WEAPON3': '1.050', 'weapon3': '2.456', 'DAMAGECOUNT': '4.710', 'FRAGCOUNT': '13.000'} [2023-02-24 19:04:14,302][177156] DAMAGECOUNT value on done: 261837.0 [2023-02-24 19:04:14,303][177156] Sum rewards: 22.033, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.208', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'AMMO2': '0.050', 'AMMO3': '0.158', 'weapon5': '0.186', 'AMMO4': '0.251', 'WEAPON4': '0.350', 'weapon4': '0.440', 'ARMOR': '0.457', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'weapon2': '0.996', 'HITCOUNT': '1.340', 'weapon3': '1.996', 'DAMAGECOUNT': '6.072', 'FRAGCOUNT': '20.000'} [2023-02-24 19:04:14,461][177153] Updated weights for policy 0, policy_version 20710 (0.0008) [2023-02-24 19:04:14,498][177170] DAMAGECOUNT value on done: 261376.0 [2023-02-24 19:04:14,499][177170] Sum rewards: 22.050, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.162', 'AMMO2': '0.016', 'AMMO5': '0.029', 'WEAPON4': '0.050', 'AMMO4': '0.082', 'weapon4': '0.088', 'AMMO3': '0.196', 'weapon5': '0.198', 'WEAPON5': '0.600', 'weapon2': '0.802', 'WEAPON3': '1.200', 'HITCOUNT': '1.570', 'weapon3': '2.634', 'DAMAGECOUNT': '6.747', 'FRAGCOUNT': '21.000'} [2023-02-24 19:04:14,798][177170] DAMAGECOUNT value on done: 267009.0 [2023-02-24 19:04:14,799][177170] Sum rewards: 19.032, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.392', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.032', 'AMMO5': '0.032', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'weapon4': '0.222', 'weapon5': '0.368', 'weapon2': '0.744', 'WEAPON5': '0.800', 'WEAPON3': '1.100', 'HITCOUNT': '1.630', 'weapon3': '2.314', 'DAMAGECOUNT': '7.296', 'FRAGCOUNT': '17.000'} [2023-02-24 19:04:15,530][177158] DAMAGECOUNT value on done: 255691.0 [2023-02-24 19:04:15,531][177158] Sum rewards: 21.336, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.035', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO5': '0.031', 'AMMO3': '0.086', 'AMMO4': '0.094', 'WEAPON4': '0.250', 'weapon5': '0.292', 'weapon4': '0.518', 'WEAPON3': '0.600', 'WEAPON5': '0.700', 'weapon2': '0.974', 'HITCOUNT': '1.220', 'weapon3': '1.840', 'DAMAGECOUNT': '5.487', 'FRAGCOUNT': '17.000'} [2023-02-24 19:04:15,836][177158] DAMAGECOUNT value on done: 261303.0 [2023-02-24 19:04:15,837][177158] Sum rewards: 21.584, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.074', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon7': '0.052', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.142', 'AMMO4': '0.176', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.372', 'WEAPON4': '0.400', 'WEAPON3': '0.650', 'weapon4': '0.878', 'weapon3': '1.718', 'HITCOUNT': '1.740', 'DAMAGECOUNT': '6.429', 'FRAGCOUNT': '18.000'} [2023-02-24 19:04:16,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13789.9, 300 sec: 13857.0). Total num frames: 84852736. Throughput: 0: 3458.7. Samples: 21214346. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:04:16,376][177119] Avg episode reward: [(0, '17.141')] [2023-02-24 19:04:16,380][177140] Saving new best policy, reward=17.141! [2023-02-24 19:04:16,499][177158] DAMAGECOUNT value on done: 268964.0 [2023-02-24 19:04:16,500][177158] Sum rewards: 15.607, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.016', 'AMMO5': '0.020', 'weapon7': '0.048', 'AMMO4': '0.080', 'AMMO3': '0.089', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.220', 'weapon5': '0.272', 'WEAPON5': '0.400', 'HEALTH': '0.406', 'WEAPON3': '0.500', 'weapon2': '1.028', 'HITCOUNT': '1.050', 'weapon3': '1.566', 'DAMAGECOUNT': '4.071', 'FRAGCOUNT': '12.000'} [2023-02-24 19:04:16,800][177158] DAMAGECOUNT value on done: 269262.0 [2023-02-24 19:04:16,800][177158] Sum rewards: 19.773, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.434', 'AMMO5': '0.013', 'AMMO2': '0.027', 'AMMO3': '0.124', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'weapon5': '0.224', 'WEAPON5': '0.350', 'weapon4': '0.398', 'WEAPON3': '0.850', 'weapon2': '0.952', 'HITCOUNT': '1.400', 'weapon3': '1.858', 'DAMAGECOUNT': '5.724', 'FRAGCOUNT': '18.000'} [2023-02-24 19:04:17,413][177153] Updated weights for policy 0, policy_version 20720 (0.0008) [2023-02-24 19:04:19,361][177172] DAMAGECOUNT value on done: 263176.0 [2023-02-24 19:04:19,362][177172] Sum rewards: 12.544, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.771', 'AMMO2': '0.014', 'AMMO5': '0.015', 'AMMO4': '0.068', 'weapon7': '0.078', 'AMMO3': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'weapon5': '0.324', 'ARMOR': '0.400', 'weapon4': '0.414', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'weapon2': '0.874', 'HITCOUNT': '1.090', 'weapon3': '1.524', 'DAMAGECOUNT': '4.518', 'FRAGCOUNT': '11.500'} [2023-02-24 19:04:19,666][177172] DAMAGECOUNT value on done: 257650.0 [2023-02-24 19:04:19,667][177172] Sum rewards: 14.782, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.096', 'AMMO5': '0.012', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'weapon5': '0.130', 'AMMO3': '0.136', 'AMMO4': '0.143', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.530', 'WEAPON3': '0.800', 'weapon2': '1.336', 'HITCOUNT': '1.360', 'weapon3': '1.594', 'DAMAGECOUNT': '5.628', 'FRAGCOUNT': '14.000'} [2023-02-24 19:04:20,406][177153] Updated weights for policy 0, policy_version 20730 (0.0008) [2023-02-24 19:04:21,111][177154] DAMAGECOUNT value on done: 269592.0 [2023-02-24 19:04:21,112][177154] Sum rewards: 26.176, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.248', 'AMMO5': '0.019', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.181', 'weapon4': '0.262', 'WEAPON4': '0.300', 'weapon5': '0.382', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.494', 'WEAPON3': '1.150', 'HITCOUNT': '1.570', 'weapon3': '2.450', 'DAMAGECOUNT': '8.667', 'FRAGCOUNT': '24.000'} [2023-02-24 19:04:21,146][177172] DAMAGECOUNT value on done: 271636.0 [2023-02-24 19:04:21,146][177172] Sum rewards: 28.715, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.097', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.138', 'weapon5': '0.148', 'WEAPON4': '0.250', 'weapon4': '0.344', 'ARMOR': '0.400', 'WEAPON3': '0.850', 'weapon2': '0.920', 'HITCOUNT': '1.800', 'weapon3': '2.346', 'DAMAGECOUNT': '7.875', 'FRAGCOUNT': '24.000'} [2023-02-24 19:04:21,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13789.9, 300 sec: 13857.0). Total num frames: 84922368. Throughput: 0: 3456.3. Samples: 21224632. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:04:21,376][177119] Avg episode reward: [(0, '17.083')] [2023-02-24 19:04:21,415][177154] DAMAGECOUNT value on done: 272927.0 [2023-02-24 19:04:21,415][177154] Sum rewards: 10.997, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.242', 'AMMO5': '0.016', 'AMMO2': '0.017', 'weapon7': '0.048', 'weapon5': '0.060', 'AMMO3': '0.082', 'AMMO4': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon4': '0.424', 'weapon2': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '1.030', 'weapon3': '1.426', 'DAMAGECOUNT': '3.654', 'FRAGCOUNT': '9.000'} [2023-02-24 19:04:21,447][177172] DAMAGECOUNT value on done: 262479.0 [2023-02-24 19:04:21,447][177172] Sum rewards: 19.399, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.873', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.103', 'weapon5': '0.130', 'AMMO3': '0.132', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.448', 'weapon2': '0.652', 'WEAPON3': '0.900', 'HITCOUNT': '1.480', 'weapon3': '2.324', 'DAMAGECOUNT': '6.114', 'FRAGCOUNT': '16.000'} [2023-02-24 19:04:21,665][177154] DAMAGECOUNT value on done: 276000.0 [2023-02-24 19:04:21,665][177154] Sum rewards: 2.910, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.003', 'AMMO3': '0.014', 'weapon5': '0.018', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon7': '0.056', 'HEALTH': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON3': '0.100', 'WEAPON7': '0.100', 'weapon2': '0.116', 'AMMO4': '0.149', 'weapon3': '0.154', 'HITCOUNT': '0.170', 'WEAPON4': '0.250', 'weapon4': '0.272', 'DAMAGECOUNT': '1.140', 'FRAGCOUNT': '3.000'} [2023-02-24 19:04:21,970][177154] DAMAGECOUNT value on done: 273415.0 [2023-02-24 19:04:21,970][177154] Sum rewards: 13.434, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.914', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.129', 'weapon4': '0.156', 'WEAPON4': '0.200', 'weapon5': '0.226', 'WEAPON5': '0.400', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'weapon2': '1.132', 'HITCOUNT': '1.290', 'weapon3': '1.858', 'DAMAGECOUNT': '5.244', 'FRAGCOUNT': '13.000'} [2023-02-24 19:04:22,295][177157] DAMAGECOUNT value on done: 258719.0 [2023-02-24 19:04:22,295][177157] Sum rewards: 20.736, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.586', 'AMMO5': '0.021', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'AMMO4': '0.128', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'weapon5': '0.336', 'weapon4': '0.364', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.810', 'WEAPON3': '0.950', 'HITCOUNT': '1.290', 'weapon3': '2.018', 'DAMAGECOUNT': '5.334', 'FRAGCOUNT': '20.000'} [2023-02-24 19:04:22,316][177157] DAMAGECOUNT value on done: 277113.0 [2023-02-24 19:04:22,316][177157] Sum rewards: 26.420, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.704', 'AMMO2': '0.016', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.080', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'weapon5': '0.182', 'weapon4': '0.354', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.754', 'WEAPON3': '0.850', 'HITCOUNT': '1.600', 'weapon3': '2.270', 'DAMAGECOUNT': '6.339', 'FRAGCOUNT': '21.000'} [2023-02-24 19:04:22,375][177171] DAMAGECOUNT value on done: 260642.0 [2023-02-24 19:04:22,376][177171] Sum rewards: 11.425, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.025', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.028', 'weapon7': '0.058', 'AMMO3': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.270', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'weapon2': '1.022', 'HITCOUNT': '1.080', 'weapon3': '1.558', 'DAMAGECOUNT': '4.110', 'FRAGCOUNT': '10.000'} [2023-02-24 19:04:22,572][177171] DAMAGECOUNT value on done: 263478.0 [2023-02-24 19:04:22,573][177171] Sum rewards: 9.666, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.650', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO3': '0.099', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'weapon5': '0.298', 'WEAPON5': '0.350', 'weapon4': '0.412', 'WEAPON3': '0.700', 'HITCOUNT': '0.890', 'weapon2': '1.234', 'weapon3': '1.548', 'DAMAGECOUNT': '3.711', 'FRAGCOUNT': '9.000'} [2023-02-24 19:04:22,603][177157] DAMAGECOUNT value on done: 261352.0 [2023-02-24 19:04:22,604][177157] Sum rewards: 11.982, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.015', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.088', 'AMMO4': '0.096', 'weapon5': '0.188', 'HEALTH': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'weapon4': '0.706', 'HITCOUNT': '0.760', 'weapon2': '0.870', 'weapon3': '1.390', 'DAMAGECOUNT': '3.402', 'FRAGCOUNT': '9.000'} [2023-02-24 19:04:22,623][177157] DAMAGECOUNT value on done: 257427.0 [2023-02-24 19:04:22,623][177157] Sum rewards: 20.513, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.858', 'AMMO2': '0.021', 'AMMO5': '0.027', 'AMMO4': '0.102', 'AMMO3': '0.201', 'weapon4': '0.238', 'weapon5': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.550', 'weapon2': '0.612', 'WEAPON3': '1.350', 'HITCOUNT': '1.420', 'weapon3': '2.542', 'DAMAGECOUNT': '5.310', 'FRAGCOUNT': '24.000'} [2023-02-24 19:04:22,676][177171] DAMAGECOUNT value on done: 268427.0 [2023-02-24 19:04:22,676][177171] Sum rewards: 17.337, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.534', 'AMMO5': '0.015', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'weapon4': '0.088', 'AMMO4': '0.110', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'weapon5': '0.304', 'WEAPON5': '0.450', 'WEAPON3': '0.900', 'weapon2': '0.950', 'HITCOUNT': '1.080', 'weapon3': '2.148', 'DAMAGECOUNT': '5.733', 'FRAGCOUNT': '14.000'} [2023-02-24 19:04:22,871][177171] DAMAGECOUNT value on done: 264058.0 [2023-02-24 19:04:22,871][177171] Sum rewards: 24.646, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.198', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.218', 'weapon5': '0.258', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.532', 'WEAPON3': '1.100', 'HITCOUNT': '1.470', 'weapon3': '2.662', 'DAMAGECOUNT': '7.023', 'FRAGCOUNT': '24.000'} [2023-02-24 19:04:23,399][177153] Updated weights for policy 0, policy_version 20740 (0.0008) [2023-02-24 19:04:24,401][177155] DAMAGECOUNT value on done: 268422.0 [2023-02-24 19:04:24,402][177155] Sum rewards: 24.877, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.130', 'AMMO5': '0.016', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'weapon5': '0.218', 'weapon4': '0.342', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'weapon2': '1.022', 'HITCOUNT': '1.690', 'weapon3': '2.198', 'DAMAGECOUNT': '6.414', 'FRAGCOUNT': '21.500'} [2023-02-24 19:04:24,703][177155] DAMAGECOUNT value on done: 274886.0 [2023-02-24 19:04:24,704][177155] Sum rewards: 18.772, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.492', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.023', 'weapon7': '0.054', 'AMMO4': '0.115', 'weapon5': '0.130', 'AMMO3': '0.155', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.442', 'weapon2': '0.902', 'WEAPON3': '1.050', 'HITCOUNT': '1.380', 'weapon3': '2.126', 'DAMAGECOUNT': '5.493', 'FRAGCOUNT': '17.000'} [2023-02-24 19:04:25,006][177155] DAMAGECOUNT value on done: 273220.0 [2023-02-24 19:04:25,007][177155] Sum rewards: 14.588, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.664', 'AMMO2': '0.025', 'AMMO5': '0.025', 'weapon4': '0.114', 'AMMO4': '0.126', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon5': '0.254', 'weapon2': '0.588', 'WEAPON5': '0.650', 'WEAPON3': '1.300', 'HITCOUNT': '1.510', 'weapon3': '2.534', 'DAMAGECOUNT': '6.177', 'FRAGCOUNT': '17.000'} [2023-02-24 19:04:25,320][177155] DAMAGECOUNT value on done: 257897.0 [2023-02-24 19:04:25,320][177155] Sum rewards: 18.388, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.507', 'AMMO2': '0.023', 'AMMO5': '0.024', 'WEAPON1': '0.060', 'AMMO4': '0.116', 'AMMO3': '0.130', 'weapon4': '0.210', 'WEAPON4': '0.250', 'weapon5': '0.280', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'weapon2': '1.018', 'HITCOUNT': '1.260', 'weapon3': '1.962', 'DAMAGECOUNT': '6.261', 'FRAGCOUNT': '19.000'} [2023-02-24 19:04:26,354][177153] Updated weights for policy 0, policy_version 20750 (0.0008) [2023-02-24 19:04:26,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 84992000. Throughput: 0: 3456.6. Samples: 21245358. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:04:26,376][177119] Avg episode reward: [(0, '17.216')] [2023-02-24 19:04:26,380][177140] Saving new best policy, reward=17.216! [2023-02-24 19:04:27,211][177171] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 19:04:28,126][177154] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0)] [2023-02-24 19:04:29,298][177153] Updated weights for policy 0, policy_version 20760 (0.0008) [2023-02-24 19:04:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 85061632. Throughput: 0: 3455.6. Samples: 21266122. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:04:31,376][177119] Avg episode reward: [(0, '17.216')] [2023-02-24 19:04:32,275][177153] Updated weights for policy 0, policy_version 20770 (0.0009) [2023-02-24 19:04:33,042][177170] DAMAGECOUNT value on done: 269359.0 [2023-02-24 19:04:33,042][177170] Sum rewards: 12.158, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.152', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon7': '0.046', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.123', 'weapon5': '0.176', 'AMMO4': '0.182', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.722', 'WEAPON3': '0.750', 'weapon2': '0.946', 'HITCOUNT': '1.110', 'weapon3': '1.580', 'DAMAGECOUNT': '4.938', 'FRAGCOUNT': '11.500'} [2023-02-24 19:04:33,351][177170] DAMAGECOUNT value on done: 271846.0 [2023-02-24 19:04:33,352][177170] Sum rewards: 29.547, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.592', 'AMMO5': '0.017', 'AMMO2': '0.031', 'AMMO3': '0.101', 'AMMO4': '0.156', 'weapon5': '0.342', 'weapon2': '0.424', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon4': '0.724', 'WEAPON3': '0.750', 'HITCOUNT': '1.660', 'weapon3': '1.858', 'DAMAGECOUNT': '7.575', 'FRAGCOUNT': '23.000'} [2023-02-24 19:04:33,486][177156] DAMAGECOUNT value on done: 268739.0 [2023-02-24 19:04:33,486][177156] Sum rewards: 19.368, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.772', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.042', 'AMMO3': '0.144', 'weapon5': '0.150', 'AMMO4': '0.209', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'ARMOR': '0.500', 'weapon4': '0.654', 'weapon2': '0.762', 'WEAPON3': '0.950', 'HITCOUNT': '1.510', 'weapon3': '2.002', 'DAMAGECOUNT': '6.690', 'FRAGCOUNT': '18.000'} [2023-02-24 19:04:33,497][177156] DAMAGECOUNT value on done: 261894.0 [2023-02-24 19:04:33,497][177156] Sum rewards: 16.733, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon7': '0.052', 'weapon5': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.173', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'HEALTH': '0.330', 'weapon4': '0.394', 'ARMOR': '0.408', 'WEAPON3': '0.900', 'weapon2': '0.984', 'HITCOUNT': '1.500', 'weapon3': '1.954', 'DAMAGECOUNT': '5.856', 'FRAGCOUNT': '16.000'} [2023-02-24 19:04:33,794][177156] DAMAGECOUNT value on done: 275174.0 [2023-02-24 19:04:33,794][177156] Sum rewards: 20.898, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.095', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.024', 'WEAPON4': '0.050', 'weapon4': '0.070', 'weapon5': '0.120', 'AMMO4': '0.122', 'AMMO3': '0.181', 'WEAPON5': '0.550', 'weapon2': '1.034', 'WEAPON3': '1.200', 'HITCOUNT': '1.580', 'weapon3': '2.474', 'DAMAGECOUNT': '6.795', 'FRAGCOUNT': '20.000'} [2023-02-24 19:04:33,805][177156] DAMAGECOUNT value on done: 263589.0 [2023-02-24 19:04:33,806][177156] Sum rewards: 17.885, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.096', 'AMMO2': '0.015', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'weapon5': '0.274', 'weapon4': '0.342', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'weapon2': '0.854', 'HITCOUNT': '1.250', 'weapon3': '1.952', 'DAMAGECOUNT': '5.256', 'FRAGCOUNT': '14.000'} [2023-02-24 19:04:33,917][177170] DAMAGECOUNT value on done: 263141.0 [2023-02-24 19:04:33,918][177170] Sum rewards: 18.003, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.800', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.021', 'weapon7': '0.066', 'AMMO4': '0.106', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.136', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.286', 'WEAPON3': '0.900', 'weapon2': '0.932', 'HITCOUNT': '1.410', 'weapon3': '2.324', 'DAMAGECOUNT': '5.295', 'FRAGCOUNT': '16.000'} [2023-02-24 19:04:34,210][177170] DAMAGECOUNT value on done: 268462.0 [2023-02-24 19:04:34,210][177170] Sum rewards: 13.040, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.176', 'AMMO5': '0.009', 'AMMO2': '0.012', 'weapon7': '0.058', 'AMMO4': '0.058', 'AMMO3': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.136', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.370', 'weapon2': '0.590', 'WEAPON3': '0.850', 'HITCOUNT': '1.150', 'weapon3': '1.766', 'DAMAGECOUNT': '4.359', 'FRAGCOUNT': '13.000'} [2023-02-24 19:04:34,966][177158] DAMAGECOUNT value on done: 257711.0 [2023-02-24 19:04:34,966][177158] Sum rewards: 22.779, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.924', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.048', 'AMMO3': '0.106', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'weapon5': '0.178', 'WEAPON5': '0.250', 'WEAPON3': '0.750', 'weapon2': '1.214', 'HITCOUNT': '1.490', 'weapon3': '2.266', 'DAMAGECOUNT': '6.060', 'FRAGCOUNT': '20.000'} [2023-02-24 19:04:35,230][177153] Updated weights for policy 0, policy_version 20780 (0.0008) [2023-02-24 19:04:35,259][177158] DAMAGECOUNT value on done: 262185.0 [2023-02-24 19:04:35,259][177158] Sum rewards: 8.504, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.520', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon7': '0.104', 'AMMO3': '0.115', 'AMMO4': '0.118', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.598', 'weapon2': '0.616', 'WEAPON3': '0.700', 'HITCOUNT': '0.710', 'weapon3': '0.960', 'DAMAGECOUNT': '2.646', 'FRAGCOUNT': '11.000'} [2023-02-24 19:04:35,854][177158] DAMAGECOUNT value on done: 269808.0 [2023-02-24 19:04:35,855][177158] Sum rewards: 7.013, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.681', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.040', 'AMMO3': '0.050', 'weapon7': '0.086', 'weapon5': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'WEAPON4': '0.300', 'ARMOR': '0.404', 'HITCOUNT': '0.460', 'weapon4': '0.578', 'weapon2': '0.696', 'weapon3': '0.758', 'DAMAGECOUNT': '2.532', 'FRAGCOUNT': '6.000'} [2023-02-24 19:04:36,153][177158] DAMAGECOUNT value on done: 270909.0 [2023-02-24 19:04:36,153][177158] Sum rewards: 19.784, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.300', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.015', 'AMMO3': '0.129', 'weapon5': '0.258', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'HITCOUNT': '0.990', 'weapon2': '1.270', 'weapon3': '2.018', 'DAMAGECOUNT': '4.941', 'FRAGCOUNT': '17.000'} [2023-02-24 19:04:36,376][177119] Fps is (10 sec: 13516.6, 60 sec: 13789.8, 300 sec: 13843.1). Total num frames: 85127168. Throughput: 0: 3455.3. Samples: 21276430. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:04:36,377][177119] Avg episode reward: [(0, '17.105')] [2023-02-24 19:04:38,196][177153] Updated weights for policy 0, policy_version 20790 (0.0008) [2023-02-24 19:04:38,829][177172] DAMAGECOUNT value on done: 264822.0 [2023-02-24 19:04:38,829][177172] Sum rewards: 16.094, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.570', 'AMMO5': '0.021', 'AMMO2': '0.027', 'AMMO4': '0.137', 'AMMO3': '0.144', 'weapon4': '0.144', 'WEAPON4': '0.150', 'weapon5': '0.292', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.822', 'WEAPON3': '0.900', 'HITCOUNT': '1.140', 'weapon3': '2.348', 'DAMAGECOUNT': '4.938', 'FRAGCOUNT': '16.000'} [2023-02-24 19:04:39,127][177172] DAMAGECOUNT value on done: 259824.0 [2023-02-24 19:04:39,128][177172] Sum rewards: 16.958, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.974', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.139', 'WEAPON4': '0.150', 'weapon4': '0.160', 'weapon5': '0.162', 'WEAPON5': '0.250', 'WEAPON3': '0.900', 'weapon2': '1.172', 'HITCOUNT': '1.590', 'weapon3': '2.196', 'DAMAGECOUNT': '6.522', 'FRAGCOUNT': '15.000'} [2023-02-24 19:04:40,593][177172] DAMAGECOUNT value on done: 273552.0 [2023-02-24 19:04:40,594][177172] Sum rewards: 20.132, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.840', 'WEAPON1': '0.010', 'AMMO5': '0.021', 'AMMO2': '0.034', 'AMMO3': '0.131', 'weapon5': '0.172', 'AMMO4': '0.172', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.618', 'WEAPON3': '0.700', 'ARMOR': '0.961', 'HITCOUNT': '1.170', 'weapon2': '1.228', 'weapon3': '1.456', 'DAMAGECOUNT': '5.748', 'FRAGCOUNT': '17.500'} [2023-02-24 19:04:40,597][177154] DAMAGECOUNT value on done: 270933.0 [2023-02-24 19:04:40,597][177154] Sum rewards: 10.000, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.529', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.021', 'AMMO3': '0.091', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'weapon5': '0.260', 'weapon4': '0.278', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.790', 'weapon2': '1.342', 'weapon3': '1.372', 'DAMAGECOUNT': '3.543', 'FRAGCOUNT': '10.000'} [2023-02-24 19:04:40,894][177172] DAMAGECOUNT value on done: 264152.0 [2023-02-24 19:04:40,894][177172] Sum rewards: 17.986, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.256', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'AMMO5': '0.023', 'weapon7': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.134', 'weapon5': '0.164', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'WEAPON5': '0.500', 'weapon4': '0.682', 'weapon2': '0.722', 'WEAPON3': '0.800', 'ARMOR': '0.854', 'HITCOUNT': '1.270', 'weapon3': '1.602', 'DAMAGECOUNT': '5.019', 'FRAGCOUNT': '15.000'} [2023-02-24 19:04:40,897][177154] DAMAGECOUNT value on done: 274772.0 [2023-02-24 19:04:40,898][177154] Sum rewards: 19.285, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.810', 'AMMO5': '0.028', 'AMMO2': '0.037', 'AMMO3': '0.177', 'weapon5': '0.182', 'AMMO4': '0.186', 'WEAPON4': '0.250', 'weapon4': '0.512', 'WEAPON5': '0.550', 'weapon2': '0.910', 'WEAPON3': '1.100', 'HITCOUNT': '1.480', 'weapon3': '2.148', 'DAMAGECOUNT': '5.535', 'FRAGCOUNT': '20.000'} [2023-02-24 19:04:41,103][177154] DAMAGECOUNT value on done: 277982.0 [2023-02-24 19:04:41,104][177154] Sum rewards: 16.250, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.110', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.034', 'AMMO3': '0.139', 'AMMO4': '0.167', 'weapon5': '0.234', 'WEAPON4': '0.300', 'weapon4': '0.302', 'WEAPON5': '0.550', 'WEAPON3': '0.950', 'weapon2': '0.970', 'HITCOUNT': '1.440', 'weapon3': '2.054', 'DAMAGECOUNT': '5.946', 'FRAGCOUNT': '13.500'} [2023-02-24 19:04:41,164][177153] Updated weights for policy 0, policy_version 20800 (0.0009) [2023-02-24 19:04:41,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13789.9, 300 sec: 13843.1). Total num frames: 85196800. Throughput: 0: 3456.0. Samples: 21297216. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:04:41,376][177119] Avg episode reward: [(0, '17.191')] [2023-02-24 19:04:41,406][177154] DAMAGECOUNT value on done: 275011.0 [2023-02-24 19:04:41,407][177154] Sum rewards: 10.578, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.590', 'AMMO2': '0.008', 'AMMO5': '0.012', 'AMMO4': '0.039', 'AMMO3': '0.100', 'weapon5': '0.126', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.314', 'WEAPON3': '0.750', 'weapon2': '0.964', 'HITCOUNT': '1.300', 'weapon3': '1.716', 'DAMAGECOUNT': '4.788', 'FRAGCOUNT': '9.000'} [2023-02-24 19:04:41,752][177157] DAMAGECOUNT value on done: 278370.0 [2023-02-24 19:04:41,753][177157] Sum rewards: 14.666, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.566', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.018', 'AMMO3': '0.061', 'AMMO4': '0.087', 'weapon4': '0.148', 'WEAPON4': '0.200', 'weapon5': '0.298', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '0.780', 'weapon3': '1.524', 'weapon2': '1.572', 'DAMAGECOUNT': '3.771', 'FRAGCOUNT': '12.000'} [2023-02-24 19:04:41,774][177157] DAMAGECOUNT value on done: 261314.0 [2023-02-24 19:04:41,775][177157] Sum rewards: 29.994, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO3': '0.157', 'AMMO4': '0.158', 'weapon5': '0.190', 'WEAPON4': '0.200', 'HEALTH': '0.230', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'weapon4': '0.448', 'weapon2': '0.774', 'WEAPON3': '0.900', 'HITCOUNT': '1.910', 'weapon3': '2.250', 'DAMAGECOUNT': '7.785', 'FRAGCOUNT': '27.000'} [2023-02-24 19:04:41,789][177171] DAMAGECOUNT value on done: 262056.0 [2023-02-24 19:04:41,789][177171] Sum rewards: 16.629, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.813', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'WEAPON4': '0.050', 'AMMO4': '0.144', 'AMMO3': '0.152', 'weapon5': '0.188', 'weapon4': '0.196', 'WEAPON5': '0.400', 'weapon2': '0.908', 'WEAPON3': '0.950', 'HITCOUNT': '1.070', 'weapon3': '2.074', 'DAMAGECOUNT': '4.242', 'FRAGCOUNT': '16.000'} [2023-02-24 19:04:41,941][177171] DAMAGECOUNT value on done: 265071.0 [2023-02-24 19:04:41,942][177171] Sum rewards: 12.888, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.690', 'AMMO2': '0.002', 'AMMO4': '0.007', 'AMMO5': '0.021', 'WEAPON1': '0.040', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.171', 'weapon5': '0.192', 'WEAPON5': '0.550', 'weapon2': '1.008', 'HITCOUNT': '1.120', 'WEAPON3': '1.150', 'weapon3': '2.100', 'DAMAGECOUNT': '4.779', 'FRAGCOUNT': '14.000'} [2023-02-24 19:04:42,061][177157] DAMAGECOUNT value on done: 259460.0 [2023-02-24 19:04:42,062][177157] Sum rewards: 21.304, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.192', 'AMMO2': '0.013', 'AMMO5': '0.015', 'AMMO4': '0.063', 'AMMO3': '0.086', 'WEAPON4': '0.250', 'weapon5': '0.270', 'weapon4': '0.364', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'weapon2': '1.244', 'HITCOUNT': '1.380', 'weapon3': '1.562', 'DAMAGECOUNT': '6.099', 'FRAGCOUNT': '17.000'} [2023-02-24 19:04:42,083][177157] DAMAGECOUNT value on done: 263151.0 [2023-02-24 19:04:42,084][177157] Sum rewards: 20.966, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.197', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon7': '0.082', 'AMMO3': '0.089', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.111', 'weapon4': '0.126', 'weapon5': '0.180', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'weapon2': '1.318', 'HITCOUNT': '1.400', 'weapon3': '1.618', 'DAMAGECOUNT': '5.397', 'FRAGCOUNT': '16.000'} [2023-02-24 19:04:42,098][177171] DAMAGECOUNT value on done: 269782.0 [2023-02-24 19:04:42,099][177171] Sum rewards: 14.352, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.636', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.072', 'AMMO3': '0.110', 'WEAPON4': '0.200', 'weapon4': '0.214', 'weapon5': '0.236', 'WEAPON5': '0.250', 'ARMOR': '0.456', 'WEAPON3': '0.700', 'HITCOUNT': '0.880', 'weapon2': '1.272', 'weapon3': '1.998', 'DAMAGECOUNT': '4.065', 'FRAGCOUNT': '12.000'} [2023-02-24 19:04:42,251][177171] DAMAGECOUNT value on done: 265902.0 [2023-02-24 19:04:42,251][177171] Sum rewards: 20.582, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.297', 'AMMO5': '0.018', 'AMMO2': '0.032', 'weapon7': '0.052', 'AMMO3': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.144', 'weapon5': '0.158', 'AMMO4': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '1.100', 'weapon2': '1.322', 'weapon3': '2.092', 'DAMAGECOUNT': '5.457', 'FRAGCOUNT': '17.000'} [2023-02-24 19:04:43,869][177155] DAMAGECOUNT value on done: 269254.0 [2023-02-24 19:04:43,870][177155] Sum rewards: 7.974, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.520', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO3': '0.067', 'weapon7': '0.080', 'AMMO4': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.206', 'weapon4': '0.238', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.520', 'weapon2': '1.018', 'weapon3': '1.128', 'DAMAGECOUNT': '2.496', 'FRAGCOUNT': '9.000'} [2023-02-24 19:04:44,123][177153] Updated weights for policy 0, policy_version 20810 (0.0008) [2023-02-24 19:04:44,167][177155] DAMAGECOUNT value on done: 277357.0 [2023-02-24 19:04:44,168][177155] Sum rewards: 23.349, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.390', 'AMMO5': '0.020', 'AMMO2': '0.035', 'weapon7': '0.052', 'AMMO3': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.176', 'weapon5': '0.324', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon4': '0.418', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'weapon2': '0.696', 'HITCOUNT': '1.330', 'weapon3': '1.730', 'DAMAGECOUNT': '7.413', 'FRAGCOUNT': '19.000'} [2023-02-24 19:04:44,468][177155] DAMAGECOUNT value on done: 274840.0 [2023-02-24 19:04:44,469][177155] Sum rewards: 13.991, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.833', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.168', 'WEAPON4': '0.250', 'weapon2': '0.254', 'ARMOR': '0.404', 'weapon4': '0.496', 'WEAPON3': '1.100', 'HITCOUNT': '1.200', 'weapon3': '1.882', 'DAMAGECOUNT': '4.860', 'FRAGCOUNT': '14.000'} [2023-02-24 19:04:44,770][177155] DAMAGECOUNT value on done: 260202.0 [2023-02-24 19:04:44,770][177155] Sum rewards: 22.349, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.254', 'AMMO5': '0.024', 'AMMO2': '0.035', 'AMMO3': '0.171', 'AMMO4': '0.174', 'weapon5': '0.248', 'weapon2': '0.358', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.584', 'WEAPON3': '1.050', 'ARMOR': '1.253', 'HITCOUNT': '1.600', 'weapon3': '2.390', 'DAMAGECOUNT': '6.915', 'FRAGCOUNT': '21.000'} [2023-02-24 19:04:46,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13789.9, 300 sec: 13843.1). Total num frames: 85266432. Throughput: 0: 3454.8. Samples: 21318008. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:04:46,376][177119] Avg episode reward: [(0, '17.225')] [2023-02-24 19:04:46,379][177140] Saving new best policy, reward=17.225! [2023-02-24 19:04:47,072][177153] Updated weights for policy 0, policy_version 20820 (0.0008) [2023-02-24 19:04:50,011][177153] Updated weights for policy 0, policy_version 20830 (0.0008) [2023-02-24 19:04:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13843.1). Total num frames: 85336064. Throughput: 0: 3456.3. Samples: 21328362. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:04:51,376][177119] Avg episode reward: [(0, '17.225')] [2023-02-24 19:04:52,467][177170] DAMAGECOUNT value on done: 270890.0 [2023-02-24 19:04:52,468][177170] Sum rewards: 16.260, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.134', 'AMMO5': '0.020', 'AMMO2': '0.039', 'AMMO3': '0.117', 'AMMO4': '0.195', 'weapon5': '0.216', 'WEAPON4': '0.400', 'ARMOR': '0.439', 'WEAPON5': '0.450', 'weapon4': '0.610', 'WEAPON3': '0.700', 'HITCOUNT': '1.180', 'weapon2': '1.286', 'weapon3': '1.648', 'DAMAGECOUNT': '4.593', 'FRAGCOUNT': '16.000'} [2023-02-24 19:04:52,780][177170] DAMAGECOUNT value on done: 273376.0 [2023-02-24 19:04:52,781][177170] Sum rewards: 12.813, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.277', 'AMMO5': '0.021', 'AMMO2': '0.059', 'AMMO3': '0.090', 'weapon5': '0.250', 'AMMO4': '0.296', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'weapon4': '0.702', 'HITCOUNT': '0.800', 'weapon2': '0.846', 'weapon3': '1.536', 'DAMAGECOUNT': '4.590', 'FRAGCOUNT': '11.000'} [2023-02-24 19:04:52,990][177156] DAMAGECOUNT value on done: 270244.0 [2023-02-24 19:04:52,990][177156] Sum rewards: 10.729, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.750', 'AMMO5': '0.015', 'AMMO2': '0.026', 'weapon5': '0.130', 'AMMO4': '0.130', 'AMMO3': '0.142', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.610', 'WEAPON3': '0.850', 'weapon2': '1.226', 'weapon3': '1.314', 'HITCOUNT': '1.320', 'DAMAGECOUNT': '4.515', 'FRAGCOUNT': '9.000'} [2023-02-24 19:04:52,998][177153] Updated weights for policy 0, policy_version 20840 (0.0008) [2023-02-24 19:04:53,000][177156] DAMAGECOUNT value on done: 263764.0 [2023-02-24 19:04:53,001][177156] Sum rewards: 13.218, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.070', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.024', 'AMMO4': '0.117', 'AMMO3': '0.131', 'WEAPON4': '0.300', 'weapon5': '0.364', 'ARMOR': '0.446', 'WEAPON5': '0.500', 'weapon4': '0.646', 'weapon2': '0.734', 'WEAPON3': '0.800', 'HITCOUNT': '1.250', 'weapon3': '1.824', 'DAMAGECOUNT': '5.610', 'FRAGCOUNT': '12.000'} [2023-02-24 19:04:53,298][177156] DAMAGECOUNT value on done: 277581.0 [2023-02-24 19:04:53,299][177156] Sum rewards: 23.196, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.185', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon5': '0.078', 'AMMO4': '0.155', 'AMMO3': '0.189', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.478', 'weapon4': '0.708', 'WEAPON3': '1.300', 'HITCOUNT': '1.830', 'weapon3': '2.326', 'DAMAGECOUNT': '7.221', 'FRAGCOUNT': '24.000'} [2023-02-24 19:04:53,311][177156] DAMAGECOUNT value on done: 264751.0 [2023-02-24 19:04:53,311][177156] Sum rewards: 9.311, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.367', 'AMMO2': '0.019', 'AMMO5': '0.025', 'WEAPON1': '0.060', 'AMMO4': '0.095', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'weapon5': '0.314', 'weapon4': '0.356', 'WEAPON5': '0.650', 'WEAPON3': '0.700', 'HITCOUNT': '0.890', 'weapon2': '0.976', 'weapon3': '1.924', 'DAMAGECOUNT': '2.970', 'FRAGCOUNT': '8.000'} [2023-02-24 19:04:53,346][177170] DAMAGECOUNT value on done: 264516.0 [2023-02-24 19:04:53,346][177170] Sum rewards: 8.430, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.996', 'AMMO5': '0.013', 'AMMO2': '0.024', 'AMMO4': '0.121', 'AMMO3': '0.132', 'weapon5': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.350', 'weapon4': '0.420', 'WEAPON3': '0.900', 'weapon2': '0.932', 'HITCOUNT': '1.100', 'weapon3': '1.760', 'DAMAGECOUNT': '4.125', 'FRAGCOUNT': '10.000'} [2023-02-24 19:04:53,643][177170] DAMAGECOUNT value on done: 270197.0 [2023-02-24 19:04:53,644][177170] Sum rewards: 17.778, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.700', 'AMMO5': '0.014', 'AMMO2': '0.016', 'WEAPON1': '0.040', 'AMMO4': '0.079', 'AMMO3': '0.142', 'weapon5': '0.262', 'WEAPON5': '0.450', 'WEAPON3': '0.900', 'weapon2': '1.110', 'HITCOUNT': '1.200', 'weapon3': '2.310', 'DAMAGECOUNT': '5.205', 'FRAGCOUNT': '16.000'} [2023-02-24 19:04:54,399][177158] DAMAGECOUNT value on done: 260416.0 [2023-02-24 19:04:54,400][177158] Sum rewards: 28.044, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.181', 'AMMO2': '0.003', 'AMMO5': '0.011', 'AMMO4': '0.017', 'AMMO3': '0.190', 'weapon5': '0.218', 'WEAPON5': '0.250', 'weapon2': '0.806', 'WEAPON3': '1.200', 'HITCOUNT': '1.820', 'weapon3': '2.594', 'DAMAGECOUNT': '8.115', 'FRAGCOUNT': '26.000'} [2023-02-24 19:04:54,698][177158] DAMAGECOUNT value on done: 263358.0 [2023-02-24 19:04:54,698][177158] Sum rewards: 9.209, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.382', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO2': '0.030', 'AMMO3': '0.144', 'AMMO4': '0.147', 'weapon5': '0.246', 'WEAPON4': '0.250', 'weapon4': '0.394', 'WEAPON5': '0.600', 'HITCOUNT': '0.940', 'WEAPON3': '0.950', 'weapon2': '0.972', 'weapon3': '2.106', 'DAMAGECOUNT': '3.519', 'FRAGCOUNT': '10.000'} [2023-02-24 19:04:55,320][177158] DAMAGECOUNT value on done: 271177.0 [2023-02-24 19:04:55,320][177158] Sum rewards: 10.686, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.920', 'AMMO2': '0.009', 'AMMO5': '0.019', 'AMMO4': '0.045', 'AMMO3': '0.114', 'weapon5': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'ARMOR': '0.461', 'weapon4': '0.482', 'WEAPON3': '0.800', 'HITCOUNT': '1.050', 'weapon2': '1.064', 'weapon3': '1.544', 'DAMAGECOUNT': '4.107', 'FRAGCOUNT': '11.000'} [2023-02-24 19:04:55,621][177158] DAMAGECOUNT value on done: 273589.0 [2023-02-24 19:04:55,621][177158] Sum rewards: 26.712, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.369', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.143', 'weapon5': '0.214', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.456', 'weapon4': '0.458', 'WEAPON3': '0.950', 'HITCOUNT': '1.770', 'weapon3': '2.116', 'DAMAGECOUNT': '8.040', 'FRAGCOUNT': '24.000'} [2023-02-24 19:04:55,983][177153] Updated weights for policy 0, policy_version 20850 (0.0008) [2023-02-24 19:04:56,262][177155] Large shaping reward 2.505 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.483, 161.0), ('weapon5', 0.002)] [2023-02-24 19:04:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 85405696. Throughput: 0: 3453.1. Samples: 21349016. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:04:56,376][177119] Avg episode reward: [(0, '17.098')] [2023-02-24 19:04:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000020851_85405696.pth... [2023-02-24 19:04:56,436][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000020041_82087936.pth [2023-02-24 19:04:58,298][177172] DAMAGECOUNT value on done: 267006.0 [2023-02-24 19:04:58,298][177172] Sum rewards: 22.966, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.940', 'ARMOR': '0.004', 'AMMO2': '0.019', 'AMMO5': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.094', 'weapon4': '0.116', 'AMMO3': '0.123', 'weapon5': '0.210', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'HITCOUNT': '1.340', 'weapon2': '1.404', 'weapon3': '1.774', 'DAMAGECOUNT': '6.552', 'FRAGCOUNT': '20.000'} [2023-02-24 19:04:58,598][177172] DAMAGECOUNT value on done: 262141.0 [2023-02-24 19:04:58,599][177172] Sum rewards: 20.983, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.209', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.104', 'weapon4': '0.216', 'weapon5': '0.252', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'weapon2': '1.138', 'HITCOUNT': '1.400', 'weapon3': '2.080', 'DAMAGECOUNT': '6.951', 'FRAGCOUNT': '17.000'} [2023-02-24 19:04:58,967][177153] Updated weights for policy 0, policy_version 20860 (0.0008) [2023-02-24 19:05:00,041][177154] DAMAGECOUNT value on done: 272902.0 [2023-02-24 19:05:00,041][177154] Sum rewards: 17.182, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.752', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO4': '0.060', 'AMMO3': '0.195', 'weapon5': '0.238', 'WEAPON4': '0.300', 'weapon4': '0.422', 'WEAPON5': '0.700', 'weapon2': '0.996', 'WEAPON3': '1.300', 'HITCOUNT': '1.300', 'weapon3': '1.958', 'DAMAGECOUNT': '5.907', 'FRAGCOUNT': '17.000'} [2023-02-24 19:05:00,059][177172] DAMAGECOUNT value on done: 274969.0 [2023-02-24 19:05:00,060][177172] Sum rewards: 11.631, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.448', 'AMMO5': '0.016', 'AMMO2': '0.025', 'weapon7': '0.048', 'AMMO3': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.127', 'weapon5': '0.180', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.430', 'WEAPON3': '0.750', 'weapon4': '0.790', 'HITCOUNT': '0.880', 'weapon3': '1.584', 'DAMAGECOUNT': '4.251', 'FRAGCOUNT': '12.000'} [2023-02-24 19:05:00,338][177154] DAMAGECOUNT value on done: 276350.0 [2023-02-24 19:05:00,340][177154] Sum rewards: 12.445, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.335', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.128', 'weapon5': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.463', 'weapon4': '0.498', 'weapon2': '0.888', 'WEAPON3': '0.900', 'HITCOUNT': '1.140', 'weapon3': '2.106', 'DAMAGECOUNT': '4.734', 'FRAGCOUNT': '13.000'} [2023-02-24 19:05:00,355][177172] DAMAGECOUNT value on done: 266453.0 [2023-02-24 19:05:00,356][177172] Sum rewards: 21.321, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.772', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'AMMO3': '0.125', 'AMMO4': '0.179', 'weapon5': '0.200', 'weapon4': '0.372', 'ARMOR': '0.466', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon2': '0.880', 'WEAPON3': '0.950', 'HITCOUNT': '1.490', 'weapon3': '2.152', 'DAMAGECOUNT': '6.903', 'FRAGCOUNT': '19.000'} [2023-02-24 19:05:00,562][177154] DAMAGECOUNT value on done: 279497.0 [2023-02-24 19:05:00,563][177154] Sum rewards: 11.974, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.732', 'AMMO5': '0.019', 'AMMO2': '0.031', 'AMMO3': '0.144', 'AMMO4': '0.152', 'weapon5': '0.218', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.508', 'WEAPON3': '0.850', 'ARMOR': '0.854', 'weapon4': '0.902', 'HITCOUNT': '1.030', 'weapon3': '1.352', 'DAMAGECOUNT': '4.545', 'FRAGCOUNT': '10.500'} [2023-02-24 19:05:00,863][177154] DAMAGECOUNT value on done: 276993.0 [2023-02-24 19:05:00,863][177154] Sum rewards: 18.633, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.681', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon7': '0.100', 'AMMO3': '0.113', 'AMMO4': '0.126', 'weapon5': '0.176', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.652', 'WEAPON3': '0.750', 'weapon2': '0.870', 'HITCOUNT': '1.390', 'weapon3': '1.618', 'DAMAGECOUNT': '5.946', 'FRAGCOUNT': '16.500'} [2023-02-24 19:05:01,168][177157] DAMAGECOUNT value on done: 279327.0 [2023-02-24 19:05:01,168][177157] Sum rewards: 8.514, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.935', 'AMMO2': '0.018', 'AMMO5': '0.019', 'weapon7': '0.074', 'AMMO4': '0.088', 'AMMO3': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.248', 'weapon4': '0.252', 'WEAPON3': '0.500', 'WEAPON5': '0.550', 'HITCOUNT': '0.740', 'weapon3': '1.048', 'weapon2': '1.298', 'DAMAGECOUNT': '2.871', 'FRAGCOUNT': '8.000'} [2023-02-24 19:05:01,237][177171] DAMAGECOUNT value on done: 264471.0 [2023-02-24 19:05:01,237][177171] Sum rewards: 25.949, reward structure: {'DEATHCOUNT': '-9.000', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO3': '0.118', 'HEALTH': '0.148', 'AMMO4': '0.166', 'weapon5': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.478', 'WEAPON3': '0.700', 'weapon2': '1.060', 'HITCOUNT': '1.400', 'weapon3': '1.796', 'DAMAGECOUNT': '7.245', 'FRAGCOUNT': '21.000'} [2023-02-24 19:05:01,250][177157] DAMAGECOUNT value on done: 264202.0 [2023-02-24 19:05:01,250][177157] Sum rewards: 30.407, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.902', 'weapon4': '0.018', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO2': '0.026', 'AMMO3': '0.104', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'weapon5': '0.334', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'weapon2': '1.160', 'HITCOUNT': '1.520', 'weapon3': '2.162', 'DAMAGECOUNT': '8.664', 'FRAGCOUNT': '24.000'} [2023-02-24 19:05:01,369][177171] DAMAGECOUNT value on done: 266409.0 [2023-02-24 19:05:01,369][177171] Sum rewards: 9.950, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.933', 'weapon7': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.034', 'AMMO3': '0.132', 'AMMO4': '0.172', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.260', 'WEAPON5': '0.450', 'weapon4': '0.540', 'WEAPON3': '0.750', 'HITCOUNT': '0.850', 'weapon2': '1.164', 'weapon3': '1.694', 'DAMAGECOUNT': '4.014', 'FRAGCOUNT': '10.500'} [2023-02-24 19:05:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.2, 300 sec: 13843.1). Total num frames: 85475328. Throughput: 0: 3451.4. Samples: 21369658. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:05:01,376][177119] Avg episode reward: [(0, '17.323')] [2023-02-24 19:05:01,377][177140] Saving new best policy, reward=17.323! [2023-02-24 19:05:01,488][177157] DAMAGECOUNT value on done: 261410.0 [2023-02-24 19:05:01,488][177157] Sum rewards: 16.227, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.830', 'weapon5': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon7': '0.058', 'AMMO4': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.137', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'ARMOR': '0.455', 'weapon4': '0.628', 'weapon2': '0.802', 'WEAPON3': '0.900', 'HITCOUNT': '1.550', 'weapon3': '2.016', 'DAMAGECOUNT': '5.850', 'FRAGCOUNT': '16.000'} [2023-02-24 19:05:01,563][177171] DAMAGECOUNT value on done: 271893.0 [2023-02-24 19:05:01,563][177171] Sum rewards: 19.815, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.980', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO3': '0.128', 'AMMO4': '0.214', 'weapon5': '0.370', 'WEAPON5': '0.450', 'weapon4': '0.496', 'WEAPON4': '0.550', 'WEAPON3': '0.750', 'weapon2': '0.754', 'HITCOUNT': '1.200', 'weapon3': '1.990', 'DAMAGECOUNT': '6.333', 'FRAGCOUNT': '18.000'} [2023-02-24 19:05:01,571][177157] DAMAGECOUNT value on done: 264933.0 [2023-02-24 19:05:01,572][177157] Sum rewards: 14.791, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.818', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.062', 'AMMO3': '0.138', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'WEAPON4': '0.450', 'weapon2': '0.598', 'ARMOR': '0.866', 'WEAPON3': '0.900', 'weapon4': '0.970', 'HITCOUNT': '1.370', 'weapon3': '1.578', 'DAMAGECOUNT': '5.346', 'FRAGCOUNT': '14.500'} [2023-02-24 19:05:01,699][177171] DAMAGECOUNT value on done: 267551.0 [2023-02-24 19:05:01,700][177171] Sum rewards: 17.112, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.260', 'AMMO2': '0.019', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'weapon4': '0.144', 'weapon5': '0.302', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'HITCOUNT': '1.290', 'weapon2': '1.512', 'weapon3': '1.772', 'DAMAGECOUNT': '4.932', 'FRAGCOUNT': '15.000'} [2023-02-24 19:05:01,935][177153] Updated weights for policy 0, policy_version 20870 (0.0008) [2023-02-24 19:05:03,057][177172] Large shaping reward 2.535 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.08700000000000001, -29.0), ('weapon5', 0.002)] [2023-02-24 19:05:03,322][177155] DAMAGECOUNT value on done: 271340.0 [2023-02-24 19:05:03,322][177155] Sum rewards: 22.559, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.265', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon7': '0.066', 'AMMO3': '0.094', 'AMMO4': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.214', 'weapon4': '0.254', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'weapon2': '1.030', 'HITCOUNT': '1.220', 'weapon3': '1.864', 'DAMAGECOUNT': '6.258', 'FRAGCOUNT': '17.000'} [2023-02-24 19:05:03,623][177155] DAMAGECOUNT value on done: 280247.0 [2023-02-24 19:05:03,623][177155] Sum rewards: 29.179, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.617', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.160', 'weapon5': '0.244', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.444', 'ARMOR': '0.459', 'weapon2': '0.868', 'WEAPON3': '1.000', 'HITCOUNT': '1.650', 'weapon3': '2.078', 'DAMAGECOUNT': '8.670', 'FRAGCOUNT': '24.000'} [2023-02-24 19:05:03,924][177155] DAMAGECOUNT value on done: 277083.0 [2023-02-24 19:05:03,924][177155] Sum rewards: 25.059, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.017', 'AMMO2': '0.035', 'AMMO3': '0.140', 'AMMO4': '0.177', 'WEAPON4': '0.300', 'weapon5': '0.344', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'HEALTH': '0.471', 'weapon4': '0.474', 'WEAPON3': '0.750', 'weapon2': '0.844', 'HITCOUNT': '1.480', 'weapon3': '1.946', 'DAMAGECOUNT': '6.729', 'FRAGCOUNT': '21.000'} [2023-02-24 19:05:04,218][177155] DAMAGECOUNT value on done: 262241.0 [2023-02-24 19:05:04,219][177155] Sum rewards: 20.943, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.224', 'weapon7': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.035', 'AMMO3': '0.143', 'AMMO4': '0.173', 'weapon5': '0.178', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.400', 'ARMOR': '0.457', 'WEAPON4': '0.650', 'weapon2': '0.656', 'WEAPON3': '0.850', 'weapon4': '0.918', 'HITCOUNT': '1.390', 'weapon3': '1.824', 'DAMAGECOUNT': '6.117', 'FRAGCOUNT': '19.000'} [2023-02-24 19:05:04,906][177153] Updated weights for policy 0, policy_version 20880 (0.0008) [2023-02-24 19:05:06,376][177119] Fps is (10 sec: 13516.9, 60 sec: 13789.9, 300 sec: 13843.1). Total num frames: 85540864. Throughput: 0: 3452.4. Samples: 21379992. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:05:06,376][177119] Avg episode reward: [(0, '17.628')] [2023-02-24 19:05:06,393][177140] Saving new best policy, reward=17.628! [2023-02-24 19:05:07,898][177153] Updated weights for policy 0, policy_version 20890 (0.0009) [2023-02-24 19:05:10,820][177153] Updated weights for policy 0, policy_version 20900 (0.0008) [2023-02-24 19:05:11,376][177119] Fps is (10 sec: 13516.6, 60 sec: 13789.8, 300 sec: 13829.2). Total num frames: 85610496. Throughput: 0: 3452.3. Samples: 21400714. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:05:11,377][177119] Avg episode reward: [(0, '17.628')] [2023-02-24 19:05:12,033][177170] DAMAGECOUNT value on done: 272770.0 [2023-02-24 19:05:12,033][177170] Sum rewards: 17.247, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.152', 'AMMO5': '0.015', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.101', 'AMMO3': '0.131', 'weapon5': '0.150', 'WEAPON4': '0.300', 'weapon2': '0.338', 'WEAPON5': '0.350', 'weapon4': '0.506', 'WEAPON3': '0.950', 'HITCOUNT': '1.540', 'weapon3': '2.078', 'DAMAGECOUNT': '5.640', 'FRAGCOUNT': '17.000'} [2023-02-24 19:05:12,336][177170] DAMAGECOUNT value on done: 275013.0 [2023-02-24 19:05:12,336][177170] Sum rewards: 15.955, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.762', 'AMMO5': '0.021', 'AMMO2': '0.025', 'weapon7': '0.062', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.125', 'AMMO3': '0.131', 'WEAPON7': '0.200', 'weapon5': '0.234', 'weapon2': '0.326', 'ARMOR': '0.449', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.740', 'WEAPON3': '0.900', 'HITCOUNT': '1.220', 'weapon3': '1.882', 'DAMAGECOUNT': '4.911', 'FRAGCOUNT': '15.000'} [2023-02-24 19:05:12,501][177156] DAMAGECOUNT value on done: 272148.0 [2023-02-24 19:05:12,501][177156] Sum rewards: 17.643, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.712', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO3': '0.146', 'AMMO4': '0.147', 'WEAPON5': '0.200', 'weapon5': '0.258', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon4': '0.500', 'WEAPON3': '0.900', 'weapon2': '0.902', 'HITCOUNT': '1.330', 'weapon3': '1.966', 'DAMAGECOUNT': '5.712', 'FRAGCOUNT': '16.000'} [2023-02-24 19:05:12,556][177156] DAMAGECOUNT value on done: 264943.0 [2023-02-24 19:05:12,556][177156] Sum rewards: 10.830, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.812', 'AMMO4': '-0.018', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO3': '0.128', 'weapon5': '0.168', 'WEAPON5': '0.250', 'WEAPON3': '0.950', 'HITCOUNT': '1.000', 'weapon2': '1.136', 'weapon3': '1.966', 'DAMAGECOUNT': '3.537', 'FRAGCOUNT': '11.000'} [2023-02-24 19:05:12,811][177156] DAMAGECOUNT value on done: 278978.0 [2023-02-24 19:05:12,811][177156] Sum rewards: 11.991, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.040', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.116', 'AMMO4': '0.123', 'weapon5': '0.228', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.722', 'WEAPON3': '0.800', 'weapon2': '1.116', 'HITCOUNT': '1.230', 'weapon3': '1.648', 'DAMAGECOUNT': '4.191', 'FRAGCOUNT': '12.000'} [2023-02-24 19:05:12,872][177156] DAMAGECOUNT value on done: 266283.0 [2023-02-24 19:05:12,873][177156] Sum rewards: 14.890, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.956', 'AMMO5': '0.017', 'AMMO2': '0.046', 'AMMO3': '0.147', 'weapon5': '0.180', 'AMMO4': '0.230', 'weapon4': '0.322', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.796', 'WEAPON3': '0.800', 'HITCOUNT': '1.250', 'weapon3': '1.912', 'DAMAGECOUNT': '4.596', 'FRAGCOUNT': '15.000'} [2023-02-24 19:05:12,885][177170] DAMAGECOUNT value on done: 266587.0 [2023-02-24 19:05:12,885][177170] Sum rewards: 22.265, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.424', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.015', 'AMMO4': '0.053', 'weapon7': '0.056', 'AMMO3': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.262', 'weapon4': '0.272', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'weapon2': '0.926', 'HITCOUNT': '1.280', 'weapon3': '2.086', 'DAMAGECOUNT': '6.213', 'FRAGCOUNT': '18.000'} [2023-02-24 19:05:13,188][177170] DAMAGECOUNT value on done: 272597.0 [2023-02-24 19:05:13,189][177170] Sum rewards: 20.157, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.150', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.100', 'AMMO3': '0.155', 'weapon5': '0.164', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'weapon2': '1.090', 'HITCOUNT': '1.710', 'weapon3': '2.200', 'DAMAGECOUNT': '7.200', 'FRAGCOUNT': '17.000'} [2023-02-24 19:05:13,802][177153] Updated weights for policy 0, policy_version 20910 (0.0008) [2023-02-24 19:05:13,874][177158] DAMAGECOUNT value on done: 262541.0 [2023-02-24 19:05:13,874][177158] Sum rewards: 24.333, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.226', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.137', 'AMMO3': '0.153', 'weapon5': '0.204', 'WEAPON5': '0.350', 'ARMOR': '0.457', 'WEAPON4': '0.500', 'weapon4': '0.584', 'weapon2': '0.774', 'WEAPON3': '0.950', 'HITCOUNT': '1.520', 'weapon3': '2.016', 'DAMAGECOUNT': '6.375', 'FRAGCOUNT': '22.000'} [2023-02-24 19:05:14,168][177158] DAMAGECOUNT value on done: 264325.0 [2023-02-24 19:05:14,168][177158] Sum rewards: 8.342, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.130', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.082', 'AMMO3': '0.121', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.370', 'HITCOUNT': '0.790', 'WEAPON3': '0.850', 'weapon2': '1.030', 'weapon3': '1.522', 'DAMAGECOUNT': '2.901', 'FRAGCOUNT': '11.000'} [2023-02-24 19:05:14,742][177158] DAMAGECOUNT value on done: 273922.0 [2023-02-24 19:05:14,743][177158] Sum rewards: 28.745, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.906', 'AMMO5': '0.021', 'AMMO2': '0.035', 'weapon7': '0.068', 'AMMO3': '0.143', 'AMMO4': '0.173', 'weapon5': '0.188', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.418', 'WEAPON5': '0.450', 'weapon4': '0.552', 'WEAPON3': '0.900', 'HITCOUNT': '1.770', 'weapon3': '1.858', 'DAMAGECOUNT': '8.235', 'FRAGCOUNT': '26.000'} [2023-02-24 19:05:15,044][177158] DAMAGECOUNT value on done: 274582.0 [2023-02-24 19:05:15,045][177158] Sum rewards: 12.892, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.224', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO3': '0.070', 'weapon5': '0.076', 'weapon7': '0.096', 'AMMO4': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.318', 'WEAPON3': '0.450', 'HITCOUNT': '0.850', 'weapon2': '1.008', 'weapon3': '1.286', 'DAMAGECOUNT': '2.979', 'FRAGCOUNT': '11.000'} [2023-02-24 19:05:15,543][177157] Large shaping reward 2.575 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.543, 181.0), ('weapon5', 0.002)] [2023-02-24 19:05:16,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 85680128. Throughput: 0: 3449.6. Samples: 21421354. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:05:16,376][177119] Avg episode reward: [(0, '17.480')] [2023-02-24 19:05:16,786][177153] Updated weights for policy 0, policy_version 20920 (0.0008) [2023-02-24 19:05:17,797][177172] DAMAGECOUNT value on done: 268267.0 [2023-02-24 19:05:17,797][177172] Sum rewards: 11.773, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.532', 'AMMO2': '0.004', 'weapon4': '0.020', 'AMMO4': '0.021', 'AMMO5': '0.022', 'WEAPON4': '0.050', 'AMMO3': '0.100', 'weapon5': '0.224', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'HITCOUNT': '1.030', 'weapon2': '1.326', 'weapon3': '1.974', 'DAMAGECOUNT': '3.783', 'FRAGCOUNT': '11.000'} [2023-02-24 19:05:18,095][177172] DAMAGECOUNT value on done: 263947.0 [2023-02-24 19:05:18,096][177172] Sum rewards: 18.338, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.970', 'weapon7': '0.014', 'AMMO2': '0.015', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.074', 'AMMO3': '0.135', 'weapon5': '0.182', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.530', 'WEAPON3': '0.800', 'ARMOR': '0.902', 'weapon2': '0.974', 'HITCOUNT': '1.390', 'weapon3': '1.636', 'DAMAGECOUNT': '5.418', 'FRAGCOUNT': '18.000'} [2023-02-24 19:05:19,543][177154] DAMAGECOUNT value on done: 274886.0 [2023-02-24 19:05:19,544][177154] Sum rewards: 17.303, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.892', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.104', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.344', 'WEAPON3': '0.900', 'weapon2': '0.970', 'HITCOUNT': '1.380', 'weapon3': '1.758', 'DAMAGECOUNT': '5.952', 'FRAGCOUNT': '16.000'} [2023-02-24 19:05:19,581][177172] DAMAGECOUNT value on done: 277596.0 [2023-02-24 19:05:19,582][177172] Sum rewards: 23.824, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.728', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO2': '0.027', 'AMMO3': '0.135', 'AMMO4': '0.136', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.274', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon2': '0.494', 'weapon4': '0.574', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'HITCOUNT': '1.530', 'weapon3': '2.178', 'DAMAGECOUNT': '7.758', 'FRAGCOUNT': '20.000'} [2023-02-24 19:05:19,733][177153] Updated weights for policy 0, policy_version 20930 (0.0008) [2023-02-24 19:05:19,855][177154] DAMAGECOUNT value on done: 279022.0 [2023-02-24 19:05:19,856][177154] Sum rewards: 26.166, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.874', 'AMMO5': '0.025', 'AMMO2': '0.042', 'AMMO3': '0.135', 'AMMO4': '0.212', 'weapon5': '0.270', 'weapon2': '0.356', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'weapon4': '0.946', 'ARMOR': '1.313', 'weapon3': '1.614', 'HITCOUNT': '1.660', 'DAMAGECOUNT': '8.016', 'FRAGCOUNT': '19.000'} [2023-02-24 19:05:19,889][177172] DAMAGECOUNT value on done: 268844.0 [2023-02-24 19:05:19,889][177172] Sum rewards: 24.851, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.855', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.038', 'AMMO3': '0.124', 'WEAPON4': '0.200', 'weapon5': '0.292', 'weapon4': '0.390', 'ARMOR': '0.458', 'WEAPON5': '0.500', 'weapon2': '0.894', 'WEAPON3': '0.950', 'HITCOUNT': '1.790', 'weapon3': '2.154', 'DAMAGECOUNT': '7.143', 'FRAGCOUNT': '20.000'} [2023-02-24 19:05:20,075][177154] DAMAGECOUNT value on done: 280881.0 [2023-02-24 19:05:20,075][177154] Sum rewards: 14.839, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.498', 'AMMO5': '0.018', 'AMMO2': '0.024', 'WEAPON4': '0.050', 'AMMO3': '0.100', 'AMMO4': '0.119', 'weapon4': '0.218', 'weapon5': '0.246', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.930', 'weapon2': '1.196', 'weapon3': '1.934', 'DAMAGECOUNT': '4.152', 'FRAGCOUNT': '12.000'} [2023-02-24 19:05:20,382][177154] DAMAGECOUNT value on done: 278105.0 [2023-02-24 19:05:20,382][177154] Sum rewards: 11.307, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.880', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'AMMO3': '0.072', 'weapon4': '0.084', 'AMMO4': '0.087', 'weapon5': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.860', 'weapon2': '1.460', 'weapon3': '1.750', 'DAMAGECOUNT': '3.336', 'FRAGCOUNT': '10.000'} [2023-02-24 19:05:20,628][177157] DAMAGECOUNT value on done: 280428.0 [2023-02-24 19:05:20,629][177157] Sum rewards: 9.483, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.376', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.041', 'weapon7': '0.082', 'AMMO3': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.106', 'WEAPON5': '0.200', 'WEAPON3': '0.550', 'HITCOUNT': '0.680', 'weapon2': '0.712', 'weapon3': '1.518', 'DAMAGECOUNT': '3.303', 'FRAGCOUNT': '7.500'} [2023-02-24 19:05:20,715][177171] DAMAGECOUNT value on done: 266506.0 [2023-02-24 19:05:20,716][177171] Sum rewards: 22.518, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.270', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.031', 'weapon4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'weapon5': '0.214', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'weapon2': '1.286', 'HITCOUNT': '1.310', 'weapon3': '1.752', 'DAMAGECOUNT': '6.105', 'FRAGCOUNT': '19.000'} [2023-02-24 19:05:20,721][177157] DAMAGECOUNT value on done: 265189.0 [2023-02-24 19:05:20,721][177157] Sum rewards: 11.731, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.067', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'HEALTH': '0.101', 'weapon4': '0.248', 'weapon5': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.680', 'weapon2': '1.420', 'weapon3': '1.608', 'DAMAGECOUNT': '2.961', 'FRAGCOUNT': '9.000'} [2023-02-24 19:05:20,815][177171] DAMAGECOUNT value on done: 267359.0 [2023-02-24 19:05:20,815][177171] Sum rewards: 5.692, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.940', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.052', 'weapon7': '0.058', 'AMMO3': '0.109', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.174', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.526', 'HITCOUNT': '0.710', 'WEAPON3': '0.750', 'weapon2': '0.866', 'weapon3': '1.656', 'DAMAGECOUNT': '2.850', 'FRAGCOUNT': '7.000'} [2023-02-24 19:05:20,937][177157] DAMAGECOUNT value on done: 263349.0 [2023-02-24 19:05:20,938][177157] Sum rewards: 21.614, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.590', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'AMMO2': '0.036', 'AMMO3': '0.105', 'AMMO4': '0.180', 'weapon4': '0.356', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon5': '0.426', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon2': '1.194', 'HITCOUNT': '1.350', 'weapon3': '1.588', 'DAMAGECOUNT': '5.817', 'FRAGCOUNT': '19.000'} [2023-02-24 19:05:21,026][177157] DAMAGECOUNT value on done: 266321.0 [2023-02-24 19:05:21,026][177157] Sum rewards: 8.455, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.776', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'weapon4': '0.036', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO3': '0.161', 'WEAPON3': '1.000', 'HITCOUNT': '1.000', 'weapon2': '1.224', 'weapon3': '1.992', 'DAMAGECOUNT': '4.164', 'FRAGCOUNT': '10.000'} [2023-02-24 19:05:21,028][177171] DAMAGECOUNT value on done: 273898.0 [2023-02-24 19:05:21,029][177171] Sum rewards: 16.905, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.120', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.037', 'AMMO3': '0.153', 'AMMO4': '0.187', 'weapon5': '0.226', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon4': '0.452', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'HITCOUNT': '1.190', 'weapon2': '1.240', 'weapon3': '1.782', 'DAMAGECOUNT': '6.015', 'FRAGCOUNT': '16.000'} [2023-02-24 19:05:21,129][177171] DAMAGECOUNT value on done: 269214.0 [2023-02-24 19:05:21,130][177171] Sum rewards: 15.056, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.458', 'AMMO2': '0.014', 'AMMO5': '0.017', 'AMMO4': '0.068', 'weapon4': '0.088', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'weapon5': '0.206', 'WEAPON5': '0.400', 'weapon2': '0.936', 'WEAPON3': '1.100', 'HITCOUNT': '1.210', 'weapon3': '2.396', 'DAMAGECOUNT': '4.989', 'FRAGCOUNT': '16.000'} [2023-02-24 19:05:21,376][177119] Fps is (10 sec: 13926.7, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 85749760. Throughput: 0: 3452.9. Samples: 21431810. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:05:21,376][177119] Avg episode reward: [(0, '17.323')] [2023-02-24 19:05:22,703][177153] Updated weights for policy 0, policy_version 20940 (0.0008) [2023-02-24 19:05:22,843][177155] DAMAGECOUNT value on done: 273094.0 [2023-02-24 19:05:22,844][177155] Sum rewards: 17.133, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.322', 'AMMO2': '0.006', 'AMMO5': '0.020', 'AMMO4': '0.030', 'WEAPON4': '0.150', 'weapon5': '0.178', 'AMMO3': '0.189', 'weapon4': '0.190', 'WEAPON5': '0.500', 'weapon2': '1.020', 'WEAPON3': '1.200', 'HITCOUNT': '1.210', 'weapon3': '2.250', 'DAMAGECOUNT': '5.262', 'FRAGCOUNT': '19.000'} [2023-02-24 19:05:23,135][177155] DAMAGECOUNT value on done: 282671.0 [2023-02-24 19:05:23,135][177155] Sum rewards: 23.067, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.895', 'AMMO2': '0.014', 'AMMO5': '0.022', 'AMMO4': '0.068', 'weapon5': '0.110', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.334', 'weapon4': '0.354', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'HITCOUNT': '1.860', 'weapon3': '2.840', 'DAMAGECOUNT': '7.272', 'FRAGCOUNT': '24.000'} [2023-02-24 19:05:23,437][177155] DAMAGECOUNT value on done: 278771.0 [2023-02-24 19:05:23,438][177155] Sum rewards: 21.696, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.630', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.015', 'WEAPON4': '0.050', 'weapon4': '0.084', 'weapon5': '0.088', 'AMMO3': '0.129', 'WEAPON5': '0.350', 'WEAPON3': '0.950', 'HITCOUNT': '1.290', 'weapon2': '1.326', 'weapon3': '2.232', 'DAMAGECOUNT': '5.064', 'FRAGCOUNT': '20.000'} [2023-02-24 19:05:23,741][177155] DAMAGECOUNT value on done: 264124.0 [2023-02-24 19:05:23,741][177155] Sum rewards: 11.780, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.350', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.040', 'AMMO3': '0.117', 'AMMO4': '0.199', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.202', 'WEAPON5': '0.300', 'weapon4': '0.466', 'WEAPON4': '0.600', 'WEAPON3': '0.750', 'HITCOUNT': '1.230', 'weapon2': '1.322', 'weapon3': '1.640', 'DAMAGECOUNT': '5.649', 'FRAGCOUNT': '13.000'} [2023-02-24 19:05:25,675][177153] Updated weights for policy 0, policy_version 20950 (0.0008) [2023-02-24 19:05:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 85819392. Throughput: 0: 3450.3. Samples: 21452478. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:05:26,376][177119] Avg episode reward: [(0, '17.315')] [2023-02-24 19:05:28,656][177153] Updated weights for policy 0, policy_version 20960 (0.0008) [2023-02-24 19:05:31,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 85889024. Throughput: 0: 3446.4. Samples: 21473096. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:05:31,376][177119] Avg episode reward: [(0, '17.315')] [2023-02-24 19:05:31,493][177170] DAMAGECOUNT value on done: 274094.0 [2023-02-24 19:05:31,493][177170] Sum rewards: 10.136, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.690', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.075', 'weapon7': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.214', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.398', 'WEAPON3': '0.500', 'weapon2': '0.746', 'HITCOUNT': '0.830', 'weapon3': '0.890', 'DAMAGECOUNT': '3.972', 'FRAGCOUNT': '9.000'} [2023-02-24 19:05:31,621][177153] Updated weights for policy 0, policy_version 20970 (0.0008) [2023-02-24 19:05:31,794][177170] DAMAGECOUNT value on done: 277367.0 [2023-02-24 19:05:31,795][177170] Sum rewards: 18.130, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.550', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.012', 'WEAPON4': '0.100', 'AMMO3': '0.156', 'weapon5': '0.174', 'WEAPON5': '0.200', 'weapon4': '0.200', 'WEAPON3': '1.100', 'weapon2': '1.346', 'HITCOUNT': '1.610', 'weapon3': '1.984', 'DAMAGECOUNT': '7.062', 'FRAGCOUNT': '18.000'} [2023-02-24 19:05:31,983][177156] DAMAGECOUNT value on done: 274153.0 [2023-02-24 19:05:31,983][177156] Sum rewards: 21.884, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.685', 'AMMO2': '0.012', 'AMMO5': '0.014', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.102', 'AMMO3': '0.119', 'weapon5': '0.248', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'weapon2': '1.258', 'HITCOUNT': '1.330', 'weapon3': '2.110', 'DAMAGECOUNT': '6.015', 'FRAGCOUNT': '19.000'} [2023-02-24 19:05:32,013][177156] DAMAGECOUNT value on done: 267517.0 [2023-02-24 19:05:32,013][177156] Sum rewards: 25.092, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.964', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO4': '0.044', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'weapon5': '0.284', 'weapon4': '0.300', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'weapon2': '0.998', 'HITCOUNT': '1.620', 'weapon3': '2.032', 'DAMAGECOUNT': '7.722', 'FRAGCOUNT': '22.500'} [2023-02-24 19:05:32,292][177156] DAMAGECOUNT value on done: 279766.0 [2023-02-24 19:05:32,292][177156] Sum rewards: 7.859, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.034', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.066', 'weapon5': '0.068', 'AMMO3': '0.093', 'weapon7': '0.114', 'WEAPON5': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'WEAPON7': '0.400', 'HITCOUNT': '0.590', 'weapon4': '0.634', 'WEAPON3': '0.650', 'weapon2': '0.654', 'weapon3': '1.092', 'DAMAGECOUNT': '2.364', 'FRAGCOUNT': '8.000'} [2023-02-24 19:05:32,321][177156] DAMAGECOUNT value on done: 268525.0 [2023-02-24 19:05:32,322][177156] Sum rewards: 21.295, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.316', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.056', 'weapon7': '0.076', 'AMMO3': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.318', 'weapon4': '0.384', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'weapon2': '1.076', 'HITCOUNT': '1.550', 'weapon3': '1.806', 'DAMAGECOUNT': '6.726', 'FRAGCOUNT': '18.500'} [2023-02-24 19:05:32,353][177170] DAMAGECOUNT value on done: 268654.0 [2023-02-24 19:05:32,353][177170] Sum rewards: 20.393, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.246', 'AMMO2': '0.017', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.086', 'AMMO3': '0.151', 'weapon5': '0.234', 'WEAPON4': '0.250', 'weapon4': '0.464', 'WEAPON5': '0.500', 'weapon2': '0.620', 'WEAPON3': '1.000', 'HITCOUNT': '1.580', 'weapon3': '2.246', 'DAMAGECOUNT': '6.201', 'FRAGCOUNT': '18.000'} [2023-02-24 19:05:32,658][177170] DAMAGECOUNT value on done: 273772.0 [2023-02-24 19:05:32,659][177170] Sum rewards: 9.817, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.886', 'ARMOR': '0.004', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.093', 'AMMO4': '0.110', 'weapon5': '0.160', 'weapon4': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.810', 'weapon2': '1.352', 'weapon3': '1.382', 'DAMAGECOUNT': '3.525', 'FRAGCOUNT': '11.000'} [2023-02-24 19:05:33,425][177158] DAMAGECOUNT value on done: 264562.0 [2023-02-24 19:05:33,426][177158] Sum rewards: 23.861, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.650', 'AMMO5': '0.012', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.110', 'weapon5': '0.234', 'weapon4': '0.238', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'weapon2': '1.352', 'HITCOUNT': '1.610', 'weapon3': '1.818', 'DAMAGECOUNT': '6.063', 'FRAGCOUNT': '20.000'} [2023-02-24 19:05:33,722][177158] DAMAGECOUNT value on done: 267065.0 [2023-02-24 19:05:33,722][177158] Sum rewards: 30.783, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.220', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon7': '0.038', 'AMMO3': '0.137', 'AMMO4': '0.150', 'weapon5': '0.186', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.396', 'weapon2': '0.736', 'WEAPON3': '0.850', 'HITCOUNT': '1.700', 'weapon3': '2.150', 'DAMAGECOUNT': '8.220', 'FRAGCOUNT': '25.000'} [2023-02-24 19:05:34,250][177158] DAMAGECOUNT value on done: 276182.0 [2023-02-24 19:05:34,250][177158] Sum rewards: 19.980, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.592', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO5': '0.027', 'AMMO4': '0.042', 'WEAPON4': '0.150', 'AMMO3': '0.156', 'weapon4': '0.244', 'weapon5': '0.250', 'weapon2': '0.666', 'WEAPON5': '0.700', 'WEAPON3': '1.100', 'HITCOUNT': '1.460', 'weapon3': '2.468', 'DAMAGECOUNT': '6.780', 'FRAGCOUNT': '18.000'} [2023-02-24 19:05:34,547][177158] DAMAGECOUNT value on done: 276034.0 [2023-02-24 19:05:34,548][177158] Sum rewards: 7.701, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.088', 'AMMO5': '0.022', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.162', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon5': '0.404', 'weapon2': '0.640', 'WEAPON5': '0.650', 'weapon4': '0.828', 'WEAPON3': '1.000', 'HITCOUNT': '1.150', 'weapon3': '1.622', 'DAMAGECOUNT': '4.356', 'FRAGCOUNT': '9.000'} [2023-02-24 19:05:34,610][177153] Updated weights for policy 0, policy_version 20980 (0.0008) [2023-02-24 19:05:36,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13789.9, 300 sec: 13815.3). Total num frames: 85954560. Throughput: 0: 3445.3. Samples: 21483400. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:05:36,376][177119] Avg episode reward: [(0, '17.242')] [2023-02-24 19:05:37,267][177172] DAMAGECOUNT value on done: 269663.0 [2023-02-24 19:05:37,267][177172] Sum rewards: 12.602, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.160', 'AMMO2': '0.002', 'AMMO4': '0.010', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'weapon4': '0.088', 'AMMO3': '0.100', 'WEAPON4': '0.200', 'weapon5': '0.350', 'WEAPON5': '0.650', 'WEAPON3': '0.750', 'HITCOUNT': '0.780', 'weapon2': '1.378', 'weapon3': '1.476', 'DAMAGECOUNT': '4.188', 'FRAGCOUNT': '13.000'} [2023-02-24 19:05:37,574][177153] Updated weights for policy 0, policy_version 20990 (0.0008) [2023-02-24 19:05:37,579][177172] DAMAGECOUNT value on done: 265536.0 [2023-02-24 19:05:37,579][177172] Sum rewards: 16.556, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.074', 'AMMO2': '0.010', 'AMMO5': '0.015', 'weapon4': '0.024', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'weapon5': '0.176', 'WEAPON5': '0.350', 'ARMOR': '0.475', 'WEAPON3': '0.700', 'HITCOUNT': '1.030', 'weapon2': '1.160', 'weapon3': '1.670', 'DAMAGECOUNT': '4.767', 'FRAGCOUNT': '14.500'} [2023-02-24 19:05:39,053][177172] DAMAGECOUNT value on done: 280467.0 [2023-02-24 19:05:39,053][177172] Sum rewards: 28.831, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.140', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.014', 'weapon5': '0.036', 'WEAPON4': '0.050', 'weapon4': '0.146', 'AMMO3': '0.192', 'WEAPON5': '0.300', 'weapon2': '0.614', 'WEAPON3': '1.300', 'HITCOUNT': '2.140', 'weapon3': '2.804', 'DAMAGECOUNT': '8.613', 'FRAGCOUNT': '26.000'} [2023-02-24 19:05:39,072][177154] DAMAGECOUNT value on done: 276657.0 [2023-02-24 19:05:39,072][177154] Sum rewards: 18.561, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.190', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.039', 'AMMO3': '0.105', 'weapon7': '0.106', 'weapon5': '0.202', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON7': '0.400', 'weapon4': '0.458', 'WEAPON3': '0.650', 'weapon2': '0.794', 'HITCOUNT': '0.960', 'weapon3': '1.176', 'DAMAGECOUNT': '5.313', 'FRAGCOUNT': '16.000'} [2023-02-24 19:05:39,353][177172] DAMAGECOUNT value on done: 270768.0 [2023-02-24 19:05:39,353][177172] Sum rewards: 21.991, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.457', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO3': '0.072', 'WEAPON4': '0.150', 'weapon5': '0.150', 'WEAPON5': '0.300', 'weapon4': '0.338', 'WEAPON3': '0.600', 'weapon2': '1.328', 'weapon3': '1.486', 'HITCOUNT': '1.490', 'DAMAGECOUNT': '5.772', 'FRAGCOUNT': '17.000'} [2023-02-24 19:05:39,381][177154] DAMAGECOUNT value on done: 281086.0 [2023-02-24 19:05:39,382][177154] Sum rewards: 19.209, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.565', 'AMMO2': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.020', 'AMMO3': '0.102', 'weapon7': '0.102', 'WEAPON5': '0.200', 'weapon5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'WEAPON7': '0.400', 'weapon4': '0.462', 'WEAPON3': '0.700', 'weapon2': '0.856', 'HITCOUNT': '1.190', 'weapon3': '1.704', 'DAMAGECOUNT': '6.087', 'FRAGCOUNT': '17.000'} [2023-02-24 19:05:39,589][177154] DAMAGECOUNT value on done: 282785.0 [2023-02-24 19:05:39,589][177154] Sum rewards: 14.079, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.180', 'AMMO5': '0.010', 'AMMO2': '0.054', 'AMMO3': '0.148', 'weapon5': '0.166', 'AMMO4': '0.272', 'WEAPON5': '0.350', 'ARMOR': '0.452', 'WEAPON4': '0.650', 'weapon4': '0.796', 'weapon2': '0.824', 'WEAPON3': '0.950', 'HITCOUNT': '1.260', 'weapon3': '1.864', 'DAMAGECOUNT': '5.712', 'FRAGCOUNT': '14.000'} [2023-02-24 19:05:39,882][177154] DAMAGECOUNT value on done: 280725.0 [2023-02-24 19:05:39,882][177154] Sum rewards: 28.304, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.230', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'weapon4': '0.118', 'AMMO3': '0.141', 'weapon5': '0.174', 'WEAPON5': '0.200', 'WEAPON3': '0.950', 'weapon2': '1.058', 'HITCOUNT': '1.650', 'weapon3': '2.118', 'DAMAGECOUNT': '7.860', 'FRAGCOUNT': '24.000'} [2023-02-24 19:05:40,130][177157] DAMAGECOUNT value on done: 283138.0 [2023-02-24 19:05:40,130][177157] Sum rewards: 23.611, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.610', 'AMMO5': '0.026', 'AMMO2': '0.053', 'AMMO3': '0.122', 'weapon5': '0.238', 'AMMO4': '0.266', 'WEAPON4': '0.500', 'weapon4': '0.508', 'WEAPON5': '0.600', 'weapon2': '0.762', 'WEAPON3': '0.900', 'HITCOUNT': '1.740', 'weapon3': '2.126', 'DAMAGECOUNT': '8.130', 'FRAGCOUNT': '22.000'} [2023-02-24 19:05:40,236][177171] DAMAGECOUNT value on done: 268040.0 [2023-02-24 19:05:40,237][177171] Sum rewards: 14.305, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.564', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO5': '0.025', 'AMMO4': '0.120', 'AMMO3': '0.172', 'WEAPON4': '0.300', 'weapon5': '0.316', 'weapon4': '0.362', 'WEAPON5': '0.700', 'weapon2': '0.958', 'HITCOUNT': '1.060', 'WEAPON3': '1.100', 'weapon3': '1.860', 'DAMAGECOUNT': '4.602', 'FRAGCOUNT': '15.000'} [2023-02-24 19:05:40,251][177157] DAMAGECOUNT value on done: 266469.0 [2023-02-24 19:05:40,251][177157] Sum rewards: 12.375, reward structure: {'DEATHCOUNT': '-6.000', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon7': '0.052', 'AMMO3': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.107', 'weapon5': '0.196', 'WEAPON5': '0.200', 'HEALTH': '0.228', 'weapon4': '0.430', 'WEAPON3': '0.550', 'HITCOUNT': '0.830', 'weapon2': '1.048', 'weapon3': '1.370', 'DAMAGECOUNT': '3.840', 'FRAGCOUNT': '9.000'} [2023-02-24 19:05:40,326][177171] DAMAGECOUNT value on done: 268539.0 [2023-02-24 19:05:40,327][177171] Sum rewards: 8.331, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.340', 'AMMO5': '0.017', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.085', 'AMMO3': '0.096', 'weapon5': '0.196', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.780', 'weapon2': '1.370', 'weapon3': '1.614', 'DAMAGECOUNT': '3.540', 'FRAGCOUNT': '8.000'} [2023-02-24 19:05:40,447][177157] DAMAGECOUNT value on done: 265418.0 [2023-02-24 19:05:40,448][177157] Sum rewards: 15.334, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.348', 'AMMO5': '0.028', 'AMMO2': '0.029', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.132', 'AMMO4': '0.144', 'WEAPON7': '0.200', 'weapon4': '0.256', 'weapon5': '0.326', 'WEAPON4': '0.500', 'WEAPON5': '0.850', 'WEAPON3': '1.000', 'weapon2': '1.090', 'HITCOUNT': '1.230', 'weapon3': '1.860', 'DAMAGECOUNT': '6.207', 'FRAGCOUNT': '15.000'} [2023-02-24 19:05:40,532][177153] Updated weights for policy 0, policy_version 21000 (0.0008) [2023-02-24 19:05:40,552][177171] DAMAGECOUNT value on done: 275792.0 [2023-02-24 19:05:40,552][177171] Sum rewards: 18.515, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.854', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO3': '0.129', 'AMMO4': '0.144', 'weapon4': '0.264', 'weapon5': '0.266', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.882', 'WEAPON3': '0.900', 'HITCOUNT': '1.120', 'weapon3': '2.128', 'DAMAGECOUNT': '5.682', 'FRAGCOUNT': '17.000'} [2023-02-24 19:05:40,563][177157] DAMAGECOUNT value on done: 268453.0 [2023-02-24 19:05:40,564][177157] Sum rewards: 22.517, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.222', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.040', 'WEAPON4': '0.100', 'weapon4': '0.138', 'AMMO3': '0.159', 'weapon5': '0.218', 'WEAPON5': '0.400', 'weapon2': '0.856', 'WEAPON3': '1.000', 'HITCOUNT': '1.420', 'weapon3': '2.488', 'DAMAGECOUNT': '6.396', 'FRAGCOUNT': '21.000'} [2023-02-24 19:05:40,631][177171] DAMAGECOUNT value on done: 270878.0 [2023-02-24 19:05:40,632][177171] Sum rewards: 14.866, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.236', 'AMMO2': '0.021', 'AMMO5': '0.022', 'AMMO4': '0.106', 'AMMO3': '0.124', 'WEAPON4': '0.200', 'weapon4': '0.286', 'weapon5': '0.294', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'weapon2': '0.912', 'HITCOUNT': '1.130', 'weapon3': '1.914', 'DAMAGECOUNT': '4.992', 'FRAGCOUNT': '13.000'} [2023-02-24 19:05:41,376][177119] Fps is (10 sec: 13516.7, 60 sec: 13789.9, 300 sec: 13815.3). Total num frames: 86024192. Throughput: 0: 3446.7. Samples: 21504116. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:05:41,376][177119] Avg episode reward: [(0, '17.546')] [2023-02-24 19:05:42,332][177155] DAMAGECOUNT value on done: 275352.0 [2023-02-24 19:05:42,333][177155] Sum rewards: 21.428, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.132', 'AMMO2': '0.004', 'AMMO5': '0.017', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.082', 'AMMO3': '0.147', 'weapon5': '0.150', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon2': '0.998', 'WEAPON3': '1.000', 'HITCOUNT': '1.440', 'weapon3': '2.128', 'DAMAGECOUNT': '6.774', 'FRAGCOUNT': '20.500'} [2023-02-24 19:05:42,635][177155] DAMAGECOUNT value on done: 284472.0 [2023-02-24 19:05:42,635][177155] Sum rewards: 17.289, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.190', 'AMMO5': '0.006', 'AMMO2': '0.010', 'weapon4': '0.024', 'weapon5': '0.040', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'weapon2': '0.832', 'WEAPON3': '0.900', 'HITCOUNT': '1.450', 'weapon3': '2.852', 'DAMAGECOUNT': '5.403', 'FRAGCOUNT': '17.000'} [2023-02-24 19:05:42,934][177155] DAMAGECOUNT value on done: 280651.0 [2023-02-24 19:05:42,935][177155] Sum rewards: 17.580, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.300', 'AMMO2': '0.011', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.053', 'AMMO3': '0.159', 'weapon4': '0.172', 'WEAPON4': '0.200', 'weapon5': '0.268', 'ARMOR': '0.456', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'HITCOUNT': '1.130', 'weapon2': '1.146', 'weapon3': '1.858', 'DAMAGECOUNT': '5.640', 'FRAGCOUNT': '17.000'} [2023-02-24 19:05:43,241][177155] DAMAGECOUNT value on done: 265384.0 [2023-02-24 19:05:43,241][177155] Sum rewards: 8.728, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.496', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO2': '0.022', 'weapon4': '0.038', 'WEAPON4': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.161', 'weapon5': '0.220', 'WEAPON5': '0.550', 'HITCOUNT': '0.970', 'WEAPON3': '1.150', 'weapon2': '1.154', 'weapon3': '2.178', 'DAMAGECOUNT': '3.780', 'FRAGCOUNT': '12.000'} [2023-02-24 19:05:43,493][177153] Updated weights for policy 0, policy_version 21010 (0.0008) [2023-02-24 19:05:46,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13789.9, 300 sec: 13815.3). Total num frames: 86093824. Throughput: 0: 3450.4. Samples: 21524926. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:05:46,376][177119] Avg episode reward: [(0, '17.425')] [2023-02-24 19:05:46,474][177153] Updated weights for policy 0, policy_version 21020 (0.0008) [2023-02-24 19:05:49,440][177153] Updated weights for policy 0, policy_version 21030 (0.0008) [2023-02-24 19:05:50,879][177170] DAMAGECOUNT value on done: 275100.0 [2023-02-24 19:05:50,879][177170] Sum rewards: 9.370, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.670', 'AMMO2': '0.002', 'AMMO5': '0.004', 'AMMO4': '0.009', 'weapon5': '0.022', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'weapon4': '0.146', 'WEAPON4': '0.150', 'weapon7': '0.164', 'AMMO6': '0.380', 'AMMO7': '0.380', 'WEAPON7': '0.500', 'HITCOUNT': '0.720', 'WEAPON3': '0.800', 'weapon2': '0.812', 'weapon3': '1.218', 'DAMAGECOUNT': '3.018', 'FRAGCOUNT': '10.000'} [2023-02-24 19:05:51,171][177170] DAMAGECOUNT value on done: 278973.0 [2023-02-24 19:05:51,172][177170] Sum rewards: 15.985, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.580', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.094', 'AMMO3': '0.114', 'weapon5': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.398', 'weapon4': '0.622', 'WEAPON3': '0.750', 'HITCOUNT': '1.070', 'weapon3': '1.848', 'DAMAGECOUNT': '4.818', 'FRAGCOUNT': '15.000'} [2023-02-24 19:05:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13815.3). Total num frames: 86163456. Throughput: 0: 3450.8. Samples: 21535278. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:05:51,376][177119] Avg episode reward: [(0, '17.365')] [2023-02-24 19:05:51,478][177156] DAMAGECOUNT value on done: 275379.0 [2023-02-24 19:05:51,479][177156] Sum rewards: 18.523, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.350', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.077', 'weapon5': '0.114', 'weapon4': '0.122', 'WEAPON5': '0.150', 'WEAPON3': '0.500', 'HITCOUNT': '0.960', 'weapon3': '1.414', 'weapon2': '1.956', 'DAMAGECOUNT': '3.678', 'FRAGCOUNT': '15.000'} [2023-02-24 19:05:51,513][177156] DAMAGECOUNT value on done: 269397.0 [2023-02-24 19:05:51,513][177156] Sum rewards: 15.729, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.662', 'AMMO2': '0.013', 'AMMO5': '0.017', 'weapon4': '0.022', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.164', 'weapon5': '0.188', 'WEAPON5': '0.400', 'weapon2': '0.852', 'HITCOUNT': '1.100', 'WEAPON3': '1.150', 'weapon3': '2.428', 'DAMAGECOUNT': '5.640', 'FRAGCOUNT': '16.000'} [2023-02-24 19:05:51,723][177170] DAMAGECOUNT value on done: 270353.0 [2023-02-24 19:05:51,723][177170] Sum rewards: 12.461, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.400', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon5': '0.098', 'AMMO3': '0.105', 'AMMO4': '0.190', 'WEAPON5': '0.250', 'weapon4': '0.290', 'WEAPON4': '0.350', 'WEAPON3': '0.750', 'weapon2': '0.988', 'HITCOUNT': '1.470', 'weapon3': '1.972', 'DAMAGECOUNT': '5.097', 'FRAGCOUNT': '12.000'} [2023-02-24 19:05:51,789][177156] DAMAGECOUNT value on done: 281791.0 [2023-02-24 19:05:51,790][177156] Sum rewards: 12.711, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.338', 'AMMO5': '0.018', 'AMMO2': '0.050', 'AMMO3': '0.121', 'AMMO4': '0.248', 'weapon5': '0.262', 'WEAPON5': '0.350', 'ARMOR': '0.456', 'weapon4': '0.492', 'WEAPON4': '0.550', 'WEAPON3': '0.700', 'weapon2': '0.736', 'HITCOUNT': '1.330', 'weapon3': '2.160', 'DAMAGECOUNT': '6.075', 'FRAGCOUNT': '11.500'} [2023-02-24 19:05:51,819][177156] DAMAGECOUNT value on done: 269568.0 [2023-02-24 19:05:51,820][177156] Sum rewards: 9.041, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.436', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.041', 'AMMO3': '0.131', 'weapon5': '0.164', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.203', 'WEAPON5': '0.400', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.460', 'WEAPON3': '0.850', 'HITCOUNT': '0.930', 'weapon2': '1.184', 'weapon3': '1.800', 'DAMAGECOUNT': '3.129', 'FRAGCOUNT': '11.000'} [2023-02-24 19:05:52,025][177170] DAMAGECOUNT value on done: 275639.0 [2023-02-24 19:05:52,026][177170] Sum rewards: 17.619, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.020', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.129', 'weapon5': '0.134', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.614', 'WEAPON3': '0.750', 'weapon2': '1.056', 'HITCOUNT': '1.630', 'weapon3': '1.960', 'DAMAGECOUNT': '5.601', 'FRAGCOUNT': '15.000'} [2023-02-24 19:05:52,401][177153] Updated weights for policy 0, policy_version 21040 (0.0008) [2023-02-24 19:05:52,914][177158] DAMAGECOUNT value on done: 266001.0 [2023-02-24 19:05:52,914][177158] Sum rewards: 6.864, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.868', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.052', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'weapon4': '0.258', 'weapon2': '0.886', 'WEAPON3': '0.950', 'HITCOUNT': '1.130', 'weapon3': '2.244', 'DAMAGECOUNT': '4.317', 'FRAGCOUNT': '10.000'} [2023-02-24 19:05:53,215][177158] DAMAGECOUNT value on done: 268768.0 [2023-02-24 19:05:53,216][177158] Sum rewards: 15.900, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.114', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon7': '0.072', 'weapon5': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'weapon4': '0.384', 'weapon2': '0.800', 'WEAPON3': '1.050', 'HITCOUNT': '1.260', 'weapon3': '2.322', 'DAMAGECOUNT': '5.109', 'FRAGCOUNT': '17.000'} [2023-02-24 19:05:53,753][177158] DAMAGECOUNT value on done: 278212.0 [2023-02-24 19:05:53,754][177158] Sum rewards: 15.033, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.785', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.036', 'weapon7': '0.066', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.156', 'AMMO3': '0.173', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'ARMOR': '0.453', 'weapon2': '0.542', 'weapon4': '0.740', 'WEAPON3': '1.050', 'HITCOUNT': '1.690', 'weapon3': '2.094', 'DAMAGECOUNT': '6.090', 'FRAGCOUNT': '14.000'} [2023-02-24 19:05:54,058][177158] DAMAGECOUNT value on done: 278283.0 [2023-02-24 19:05:54,059][177158] Sum rewards: 17.210, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.506', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.076', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'WEAPON4': '0.350', 'weapon4': '0.384', 'weapon2': '0.784', 'WEAPON3': '0.950', 'HITCOUNT': '1.720', 'weapon3': '2.468', 'DAMAGECOUNT': '6.747', 'FRAGCOUNT': '18.000'} [2023-02-24 19:05:55,367][177153] Updated weights for policy 0, policy_version 21050 (0.0008) [2023-02-24 19:05:56,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 86233088. Throughput: 0: 3452.1. Samples: 21556056. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:05:56,376][177119] Avg episode reward: [(0, '17.295')] [2023-02-24 19:05:56,708][177172] DAMAGECOUNT value on done: 271382.0 [2023-02-24 19:05:56,709][177172] Sum rewards: 16.847, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.248', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO5': '0.024', 'weapon7': '0.054', 'AMMO4': '0.069', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.110', 'AMMO3': '0.123', 'WEAPON4': '0.200', 'weapon4': '0.310', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'weapon2': '1.142', 'HITCOUNT': '1.170', 'weapon3': '1.712', 'DAMAGECOUNT': '5.157', 'FRAGCOUNT': '14.000'} [2023-02-24 19:05:57,018][177172] DAMAGECOUNT value on done: 267680.0 [2023-02-24 19:05:57,019][177172] Sum rewards: 16.339, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.086', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO5': '0.027', 'AMMO4': '0.068', 'AMMO3': '0.163', 'weapon5': '0.278', 'WEAPON4': '0.350', 'weapon2': '0.542', 'weapon4': '0.542', 'WEAPON5': '0.650', 'WEAPON3': '1.000', 'HITCOUNT': '1.380', 'weapon3': '1.964', 'DAMAGECOUNT': '6.432', 'FRAGCOUNT': '16.000'} [2023-02-24 19:05:58,330][177153] Updated weights for policy 0, policy_version 21060 (0.0008) [2023-02-24 19:05:58,420][177154] DAMAGECOUNT value on done: 278206.0 [2023-02-24 19:05:58,420][177154] Sum rewards: 14.334, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.598', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'AMMO3': '0.117', 'AMMO4': '0.137', 'WEAPON4': '0.300', 'weapon5': '0.348', 'WEAPON5': '0.400', 'weapon4': '0.596', 'WEAPON3': '0.750', 'HITCOUNT': '0.960', 'weapon2': '1.282', 'weapon3': '1.332', 'DAMAGECOUNT': '4.647', 'FRAGCOUNT': '13.000'} [2023-02-24 19:05:58,497][177172] DAMAGECOUNT value on done: 282277.0 [2023-02-24 19:05:58,498][177172] Sum rewards: 17.612, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.908', 'AMMO2': '0.019', 'AMMO5': '0.021', 'AMMO4': '0.097', 'AMMO3': '0.118', 'weapon5': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.612', 'WEAPON3': '0.800', 'weapon2': '0.926', 'HITCOUNT': '1.380', 'weapon3': '1.794', 'DAMAGECOUNT': '5.430', 'FRAGCOUNT': '17.000'} [2023-02-24 19:05:58,718][177154] DAMAGECOUNT value on done: 282420.0 [2023-02-24 19:05:58,718][177154] Sum rewards: 12.549, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.770', 'AMMO5': '0.004', 'AMMO2': '0.008', 'weapon5': '0.038', 'AMMO4': '0.041', 'weapon7': '0.074', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.338', 'WEAPON3': '0.450', 'weapon2': '0.710', 'HITCOUNT': '0.830', 'weapon3': '1.248', 'DAMAGECOUNT': '3.702', 'FRAGCOUNT': '11.000'} [2023-02-24 19:05:58,800][177172] DAMAGECOUNT value on done: 272151.0 [2023-02-24 19:05:58,801][177172] Sum rewards: 12.290, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.454', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.048', 'weapon7': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.141', 'AMMO4': '0.157', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.860', 'WEAPON3': '0.900', 'weapon2': '1.026', 'HITCOUNT': '1.410', 'weapon3': '1.618', 'DAMAGECOUNT': '4.149', 'FRAGCOUNT': '12.000'} [2023-02-24 19:05:58,936][177154] DAMAGECOUNT value on done: 283985.0 [2023-02-24 19:05:58,936][177154] Sum rewards: 11.461, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.822', 'AMMO2': '0.018', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'weapon7': '0.068', 'AMMO4': '0.091', 'AMMO3': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'weapon5': '0.244', 'weapon4': '0.378', 'ARMOR': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '0.670', 'weapon2': '1.202', 'weapon3': '1.268', 'DAMAGECOUNT': '3.600', 'FRAGCOUNT': '11.000'} [2023-02-24 19:05:59,238][177154] DAMAGECOUNT value on done: 281912.0 [2023-02-24 19:05:59,239][177154] Sum rewards: 11.407, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.218', 'AMMO2': '0.023', 'AMMO5': '0.031', 'WEAPON1': '0.040', 'AMMO3': '0.080', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'weapon4': '0.154', 'weapon5': '0.376', 'WEAPON3': '0.450', 'WEAPON5': '0.700', 'HITCOUNT': '1.000', 'weapon2': '1.366', 'weapon3': '1.576', 'DAMAGECOUNT': '3.561', 'FRAGCOUNT': '11.000'} [2023-02-24 19:05:59,517][177157] DAMAGECOUNT value on done: 284583.0 [2023-02-24 19:05:59,517][177157] Sum rewards: 13.219, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.989', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.248', 'weapon5': '0.250', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'weapon2': '0.864', 'HITCOUNT': '0.900', 'weapon3': '2.006', 'DAMAGECOUNT': '4.335', 'FRAGCOUNT': '11.000'} [2023-02-24 19:05:59,673][177157] DAMAGECOUNT value on done: 267427.0 [2023-02-24 19:05:59,673][177157] Sum rewards: 8.007, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.595', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO3': '0.079', 'weapon5': '0.132', 'weapon7': '0.174', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'AMMO6': '0.360', 'AMMO7': '0.360', 'weapon4': '0.558', 'WEAPON3': '0.600', 'WEAPON7': '0.600', 'HITCOUNT': '0.790', 'weapon2': '0.978', 'weapon3': '1.014', 'DAMAGECOUNT': '2.874', 'FRAGCOUNT': '9.000'} [2023-02-24 19:05:59,677][177171] DAMAGECOUNT value on done: 270350.0 [2023-02-24 19:05:59,677][177171] Sum rewards: 25.457, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.880', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.031', 'AMMO3': '0.128', 'AMMO4': '0.155', 'weapon5': '0.300', 'weapon4': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.800', 'WEAPON3': '0.950', 'HITCOUNT': '1.460', 'weapon3': '2.172', 'DAMAGECOUNT': '6.930', 'FRAGCOUNT': '23.000'} [2023-02-24 19:05:59,718][177171] DAMAGECOUNT value on done: 269969.0 [2023-02-24 19:05:59,719][177171] Sum rewards: 15.259, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.340', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.015', 'WEAPON1': '0.060', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.146', 'weapon5': '0.212', 'WEAPON5': '0.400', 'WEAPON3': '0.950', 'weapon2': '1.154', 'HITCOUNT': '1.170', 'weapon3': '1.996', 'DAMAGECOUNT': '4.290', 'FRAGCOUNT': '15.000'} [2023-02-24 19:05:59,820][177157] DAMAGECOUNT value on done: 266498.0 [2023-02-24 19:05:59,821][177157] Sum rewards: 7.994, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.860', 'AMMO2': '0.010', 'AMMO5': '0.013', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.129', 'weapon5': '0.174', 'weapon4': '0.220', 'WEAPON5': '0.400', 'HITCOUNT': '0.890', 'WEAPON3': '0.900', 'weapon3': '1.614', 'weapon2': '1.622', 'DAMAGECOUNT': '3.240', 'FRAGCOUNT': '8.000'} [2023-02-24 19:05:59,979][177157] DAMAGECOUNT value on done: 270178.0 [2023-02-24 19:05:59,979][177157] Sum rewards: 18.427, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.432', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.015', 'WEAPON1': '0.060', 'weapon7': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.130', 'weapon5': '0.260', 'WEAPON5': '0.450', 'WEAPON3': '0.900', 'weapon2': '1.008', 'HITCOUNT': '1.130', 'weapon3': '1.866', 'DAMAGECOUNT': '5.175', 'FRAGCOUNT': '16.000'} [2023-02-24 19:05:59,984][177171] DAMAGECOUNT value on done: 277218.0 [2023-02-24 19:05:59,984][177171] Sum rewards: 10.480, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.842', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.040', 'weapon7': '0.052', 'AMMO4': '0.066', 'AMMO3': '0.084', 'WEAPON4': '0.200', 'weapon5': '0.238', 'weapon4': '0.290', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'HITCOUNT': '1.030', 'weapon2': '1.042', 'weapon3': '1.326', 'DAMAGECOUNT': '4.278', 'FRAGCOUNT': '10.000'} [2023-02-24 19:06:00,022][177171] DAMAGECOUNT value on done: 272588.0 [2023-02-24 19:06:00,022][177171] Sum rewards: 16.250, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.673', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.028', 'AMMO3': '0.123', 'AMMO4': '0.138', 'weapon5': '0.280', 'WEAPON4': '0.300', 'weapon4': '0.354', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'weapon2': '0.990', 'HITCOUNT': '1.350', 'weapon3': '1.948', 'DAMAGECOUNT': '5.130', 'FRAGCOUNT': '16.000'} [2023-02-24 19:06:01,288][177153] Updated weights for policy 0, policy_version 21070 (0.0009) [2023-02-24 19:06:01,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 86302720. Throughput: 0: 3454.2. Samples: 21576792. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:06:01,377][177119] Avg episode reward: [(0, '16.708')] [2023-02-24 19:06:01,742][177155] DAMAGECOUNT value on done: 277343.0 [2023-02-24 19:06:01,742][177155] Sum rewards: 20.374, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.050', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO5': '0.024', 'AMMO4': '0.075', 'AMMO3': '0.213', 'weapon4': '0.226', 'WEAPON4': '0.250', 'weapon5': '0.328', 'WEAPON5': '0.700', 'weapon2': '0.814', 'WEAPON3': '1.250', 'HITCOUNT': '1.600', 'weapon3': '2.196', 'DAMAGECOUNT': '5.973', 'FRAGCOUNT': '23.000'} [2023-02-24 19:06:02,033][177155] DAMAGECOUNT value on done: 286432.0 [2023-02-24 19:06:02,033][177155] Sum rewards: 19.136, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.681', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon7': '0.072', 'AMMO4': '0.091', 'AMMO3': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.196', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.528', 'weapon2': '0.584', 'WEAPON3': '0.750', 'HITCOUNT': '1.150', 'weapon3': '1.504', 'DAMAGECOUNT': '5.880', 'FRAGCOUNT': '17.000'} [2023-02-24 19:06:02,327][177155] DAMAGECOUNT value on done: 282790.0 [2023-02-24 19:06:02,328][177155] Sum rewards: 13.915, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.630', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO2': '0.031', 'AMMO3': '0.118', 'AMMO4': '0.156', 'WEAPON4': '0.400', 'weapon5': '0.402', 'WEAPON5': '0.600', 'weapon2': '0.604', 'weapon4': '0.646', 'WEAPON3': '0.700', 'HITCOUNT': '1.470', 'weapon3': '1.950', 'DAMAGECOUNT': '6.417', 'FRAGCOUNT': '11.500'} [2023-02-24 19:06:02,628][177155] DAMAGECOUNT value on done: 267149.0 [2023-02-24 19:06:02,629][177155] Sum rewards: 16.413, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.950', 'AMMO2': '0.004', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.117', 'weapon5': '0.148', 'weapon4': '0.256', 'WEAPON5': '0.300', 'weapon2': '0.564', 'WEAPON3': '0.850', 'HITCOUNT': '1.140', 'weapon3': '1.892', 'DAMAGECOUNT': '4.875', 'FRAGCOUNT': '15.000'} [2023-02-24 19:06:04,231][177153] Updated weights for policy 0, policy_version 21080 (0.0008) [2023-02-24 19:06:06,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13829.2). Total num frames: 86372352. Throughput: 0: 3455.1. Samples: 21587288. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 19:06:06,376][177119] Avg episode reward: [(0, '16.727')] [2023-02-24 19:06:07,179][177153] Updated weights for policy 0, policy_version 21090 (0.0009) [2023-02-24 19:06:10,145][177153] Updated weights for policy 0, policy_version 21100 (0.0009) [2023-02-24 19:06:10,276][177170] DAMAGECOUNT value on done: 276830.0 [2023-02-24 19:06:10,277][177170] Sum rewards: 13.833, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.622', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'AMMO3': '0.083', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon5': '0.280', 'weapon4': '0.304', 'WEAPON3': '0.600', 'weapon2': '1.124', 'HITCOUNT': '1.360', 'weapon3': '1.680', 'DAMAGECOUNT': '5.190', 'FRAGCOUNT': '10.000'} [2023-02-24 19:06:10,580][177170] DAMAGECOUNT value on done: 281307.0 [2023-02-24 19:06:10,581][177170] Sum rewards: 19.253, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.520', 'AMMO2': '0.016', 'AMMO5': '0.018', 'AMMO4': '0.078', 'AMMO3': '0.139', 'WEAPON4': '0.150', 'weapon5': '0.178', 'weapon4': '0.302', 'WEAPON5': '0.450', 'weapon2': '0.874', 'WEAPON3': '0.950', 'HITCOUNT': '1.730', 'weapon3': '2.386', 'DAMAGECOUNT': '7.002', 'FRAGCOUNT': '16.000'} [2023-02-24 19:06:10,883][177156] DAMAGECOUNT value on done: 277726.0 [2023-02-24 19:06:10,884][177156] Sum rewards: 25.527, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.878', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO5': '0.027', 'WEAPON1': '0.050', 'weapon5': '0.160', 'AMMO3': '0.193', 'WEAPON5': '0.400', 'weapon2': '0.614', 'WEAPON3': '1.300', 'HITCOUNT': '1.730', 'weapon3': '2.870', 'DAMAGECOUNT': '7.041', 'FRAGCOUNT': '25.000'} [2023-02-24 19:06:10,913][177156] DAMAGECOUNT value on done: 270947.0 [2023-02-24 19:06:10,914][177156] Sum rewards: 17.538, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.904', 'AMMO2': '0.004', 'AMMO5': '0.017', 'AMMO4': '0.019', 'WEAPON1': '0.030', 'AMMO3': '0.066', 'WEAPON4': '0.200', 'weapon5': '0.296', 'WEAPON3': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.518', 'weapon2': '0.734', 'HITCOUNT': '0.810', 'weapon3': '1.398', 'DAMAGECOUNT': '4.650', 'FRAGCOUNT': '14.000'} [2023-02-24 19:06:11,147][177170] DAMAGECOUNT value on done: 272189.0 [2023-02-24 19:06:11,147][177170] Sum rewards: 16.198, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.390', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.033', 'WEAPON1': '0.050', 'AMMO3': '0.155', 'AMMO4': '0.164', 'WEAPON4': '0.200', 'weapon5': '0.272', 'WEAPON5': '0.500', 'weapon4': '0.516', 'weapon2': '0.882', 'WEAPON3': '0.950', 'HITCOUNT': '1.230', 'weapon3': '1.852', 'DAMAGECOUNT': '5.508', 'FRAGCOUNT': '15.000'} [2023-02-24 19:06:11,199][177156] DAMAGECOUNT value on done: 282816.0 [2023-02-24 19:06:11,199][177156] Sum rewards: 11.057, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.924', 'AMMO5': '0.011', 'AMMO2': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.061', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'weapon5': '0.160', 'weapon4': '0.164', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.780', 'weapon3': '1.512', 'weapon2': '1.586', 'DAMAGECOUNT': '3.075', 'FRAGCOUNT': '11.000'} [2023-02-24 19:06:11,233][177156] DAMAGECOUNT value on done: 270967.0 [2023-02-24 19:06:11,233][177156] Sum rewards: 8.366, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.660', 'AMMO5': '0.024', 'AMMO2': '0.040', 'WEAPON1': '0.040', 'weapon4': '0.046', 'WEAPON4': '0.150', 'weapon5': '0.152', 'AMMO4': '0.198', 'AMMO3': '0.250', 'WEAPON5': '0.500', 'weapon2': '0.918', 'HITCOUNT': '1.050', 'WEAPON3': '1.500', 'weapon3': '2.460', 'DAMAGECOUNT': '4.197', 'FRAGCOUNT': '13.000'} [2023-02-24 19:06:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.2, 300 sec: 13829.2). Total num frames: 86441984. Throughput: 0: 3457.9. Samples: 21608084. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 19:06:11,376][177119] Avg episode reward: [(0, '16.359')] [2023-02-24 19:06:11,449][177170] DAMAGECOUNT value on done: 278376.0 [2023-02-24 19:06:11,450][177170] Sum rewards: 27.722, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.294', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon5': '0.292', 'WEAPON5': '0.400', 'weapon4': '0.412', 'weapon2': '0.914', 'WEAPON3': '1.200', 'HITCOUNT': '1.940', 'weapon3': '2.056', 'DAMAGECOUNT': '8.211', 'FRAGCOUNT': '25.000'} [2023-02-24 19:06:12,294][177158] DAMAGECOUNT value on done: 268019.0 [2023-02-24 19:06:12,295][177158] Sum rewards: 18.915, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.882', 'AMMO5': '0.015', 'AMMO2': '0.024', 'WEAPON1': '0.060', 'AMMO4': '0.119', 'AMMO3': '0.144', 'weapon5': '0.350', 'ARMOR': '0.479', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'weapon4': '0.658', 'weapon2': '0.796', 'WEAPON3': '1.050', 'HITCOUNT': '1.220', 'weapon3': '1.828', 'DAMAGECOUNT': '6.054', 'FRAGCOUNT': '17.000'} [2023-02-24 19:06:12,594][177158] DAMAGECOUNT value on done: 269977.0 [2023-02-24 19:06:12,595][177158] Sum rewards: 12.050, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.020', 'AMMO2': '0.021', 'HEALTH': '0.062', 'weapon7': '0.074', 'AMMO4': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.121', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'weapon4': '0.452', 'WEAPON3': '0.650', 'HITCOUNT': '0.900', 'weapon2': '0.994', 'weapon3': '1.392', 'DAMAGECOUNT': '3.627', 'FRAGCOUNT': '10.000'} [2023-02-24 19:06:13,142][177153] Updated weights for policy 0, policy_version 21110 (0.0008) [2023-02-24 19:06:13,178][177158] DAMAGECOUNT value on done: 279713.0 [2023-02-24 19:06:13,178][177158] Sum rewards: 19.590, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.115', 'AMMO5': '0.011', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.068', 'AMMO3': '0.071', 'weapon4': '0.150', 'weapon5': '0.254', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '1.010', 'weapon2': '1.528', 'weapon3': '1.686', 'DAMAGECOUNT': '4.503', 'FRAGCOUNT': '14.000'} [2023-02-24 19:06:13,493][177158] DAMAGECOUNT value on done: 280189.0 [2023-02-24 19:06:13,493][177158] Sum rewards: 15.838, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.039', 'AMMO2': '0.009', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.046', 'weapon5': '0.168', 'AMMO3': '0.186', 'weapon4': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'weapon2': '1.002', 'WEAPON3': '1.150', 'HITCOUNT': '1.340', 'weapon3': '2.170', 'DAMAGECOUNT': '5.718', 'FRAGCOUNT': '16.500'} [2023-02-24 19:06:16,113][177153] Updated weights for policy 0, policy_version 21120 (0.0008) [2023-02-24 19:06:16,164][177172] DAMAGECOUNT value on done: 273399.0 [2023-02-24 19:06:16,165][177172] Sum rewards: 8.650, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.882', 'ARMOR': '0.016', 'AMMO2': '0.020', 'AMMO5': '0.027', 'WEAPON1': '0.040', 'AMMO4': '0.100', 'AMMO3': '0.180', 'weapon5': '0.286', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon4': '0.584', 'weapon2': '0.636', 'WEAPON3': '1.050', 'HITCOUNT': '1.160', 'weapon3': '1.732', 'DAMAGECOUNT': '6.051', 'FRAGCOUNT': '10.500'} [2023-02-24 19:06:16,376][177119] Fps is (10 sec: 13516.9, 60 sec: 13789.9, 300 sec: 13815.3). Total num frames: 86507520. Throughput: 0: 3458.8. Samples: 21628740. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 19:06:16,376][177119] Avg episode reward: [(0, '16.342')] [2023-02-24 19:06:16,466][177172] DAMAGECOUNT value on done: 269615.0 [2023-02-24 19:06:16,467][177172] Sum rewards: 16.836, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.885', 'AMMO2': '0.013', 'AMMO5': '0.025', 'WEAPON1': '0.030', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.174', 'weapon4': '0.222', 'weapon5': '0.294', 'WEAPON5': '0.650', 'weapon2': '0.708', 'WEAPON3': '1.100', 'HITCOUNT': '1.190', 'weapon3': '2.344', 'DAMAGECOUNT': '5.805', 'FRAGCOUNT': '17.000'} [2023-02-24 19:06:17,768][177154] DAMAGECOUNT value on done: 278837.0 [2023-02-24 19:06:17,768][177154] Sum rewards: 6.805, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.477', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.041', 'weapon5': '0.046', 'weapon7': '0.048', 'AMMO3': '0.051', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'weapon4': '0.398', 'HITCOUNT': '0.490', 'weapon3': '0.638', 'weapon2': '0.952', 'DAMAGECOUNT': '1.893', 'FRAGCOUNT': '4.000'} [2023-02-24 19:06:17,959][177172] DAMAGECOUNT value on done: 283899.0 [2023-02-24 19:06:17,960][177172] Sum rewards: 18.388, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.330', 'AMMO2': '0.006', 'AMMO5': '0.016', 'AMMO4': '0.029', 'weapon7': '0.070', 'AMMO3': '0.122', 'WEAPON4': '0.200', 'weapon5': '0.242', 'AMMO6': '0.320', 'AMMO7': '0.320', 'weapon4': '0.370', 'WEAPON7': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'weapon2': '1.070', 'HITCOUNT': '1.090', 'weapon3': '1.896', 'DAMAGECOUNT': '4.866', 'FRAGCOUNT': '15.000'} [2023-02-24 19:06:18,075][177154] DAMAGECOUNT value on done: 284381.0 [2023-02-24 19:06:18,076][177154] Sum rewards: 24.927, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.588', 'AMMO2': '0.018', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.089', 'AMMO3': '0.112', 'WEAPON4': '0.150', 'weapon5': '0.186', 'weapon4': '0.382', 'WEAPON5': '0.450', 'ARMOR': '0.457', 'WEAPON3': '0.700', 'weapon2': '1.268', 'HITCOUNT': '1.430', 'weapon3': '1.850', 'DAMAGECOUNT': '5.883', 'FRAGCOUNT': '20.000'} [2023-02-24 19:06:18,254][177172] DAMAGECOUNT value on done: 274338.0 [2023-02-24 19:06:18,254][177172] Sum rewards: 20.863, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.510', 'AMMO2': '0.015', 'AMMO5': '0.019', 'WEAPON1': '0.030', 'AMMO4': '0.074', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon5': '0.226', 'weapon4': '0.256', 'WEAPON5': '0.400', 'weapon2': '0.544', 'WEAPON3': '1.250', 'HITCOUNT': '1.440', 'weapon3': '2.152', 'DAMAGECOUNT': '6.561', 'FRAGCOUNT': '21.000'} [2023-02-24 19:06:18,296][177154] DAMAGECOUNT value on done: 286930.0 [2023-02-24 19:06:18,296][177154] Sum rewards: 26.820, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.620', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO2': '0.031', 'AMMO3': '0.099', 'AMMO4': '0.153', 'weapon5': '0.338', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon4': '0.582', 'WEAPON3': '0.700', 'weapon2': '0.864', 'HITCOUNT': '1.720', 'weapon3': '1.768', 'DAMAGECOUNT': '8.835', 'FRAGCOUNT': '22.000'} [2023-02-24 19:06:18,594][177154] DAMAGECOUNT value on done: 283342.0 [2023-02-24 19:06:18,595][177154] Sum rewards: 13.106, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.212', 'AMMO2': '0.009', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.044', 'AMMO3': '0.138', 'weapon5': '0.222', 'weapon4': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.872', 'WEAPON3': '1.000', 'HITCOUNT': '1.150', 'weapon3': '2.272', 'DAMAGECOUNT': '4.290', 'FRAGCOUNT': '14.000'} [2023-02-24 19:06:18,842][177157] DAMAGECOUNT value on done: 285590.0 [2023-02-24 19:06:18,843][177157] Sum rewards: 11.111, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.320', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO3': '0.058', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.178', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'ARMOR': '0.495', 'HITCOUNT': '0.530', 'weapon4': '0.638', 'weapon3': '0.900', 'weapon2': '1.384', 'DAMAGECOUNT': '3.021', 'FRAGCOUNT': '9.000'} [2023-02-24 19:06:19,067][177153] Updated weights for policy 0, policy_version 21130 (0.0008) [2023-02-24 19:06:19,103][177157] DAMAGECOUNT value on done: 269499.0 [2023-02-24 19:06:19,104][177157] Sum rewards: 18.300, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.472', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.085', 'AMMO3': '0.134', 'weapon5': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.362', 'WEAPON3': '0.800', 'weapon2': '1.242', 'HITCOUNT': '1.340', 'weapon3': '1.642', 'DAMAGECOUNT': '6.216', 'FRAGCOUNT': '15.000'} [2023-02-24 19:06:19,146][177157] DAMAGECOUNT value on done: 268214.0 [2023-02-24 19:06:19,146][177157] Sum rewards: 17.049, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.520', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.036', 'AMMO3': '0.086', 'AMMO4': '0.180', 'weapon5': '0.254', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon4': '0.556', 'weapon2': '0.880', 'HITCOUNT': '1.160', 'weapon3': '1.740', 'DAMAGECOUNT': '5.148', 'FRAGCOUNT': '14.000'} [2023-02-24 19:06:19,148][177171] DAMAGECOUNT value on done: 272136.0 [2023-02-24 19:06:19,148][177171] Sum rewards: 15.900, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.176', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'AMMO2': '0.028', 'AMMO3': '0.098', 'AMMO4': '0.141', 'weapon5': '0.296', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'weapon4': '0.680', 'WEAPON3': '0.800', 'weapon2': '1.086', 'HITCOUNT': '1.270', 'weapon3': '1.574', 'DAMAGECOUNT': '5.358', 'FRAGCOUNT': '16.000'} [2023-02-24 19:06:19,185][177171] DAMAGECOUNT value on done: 271733.0 [2023-02-24 19:06:19,186][177171] Sum rewards: 20.083, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.543', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon7': '0.054', 'weapon5': '0.058', 'AMMO4': '0.063', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.336', 'weapon2': '0.688', 'WEAPON3': '0.800', 'HITCOUNT': '1.220', 'weapon3': '1.586', 'DAMAGECOUNT': '5.292', 'FRAGCOUNT': '19.000'} [2023-02-24 19:06:19,419][177157] DAMAGECOUNT value on done: 271720.0 [2023-02-24 19:06:19,419][177157] Sum rewards: 12.184, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-3.084', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.020', 'weapon7': '0.048', 'WEAPON1': '0.060', 'weapon5': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.122', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.450', 'ARMOR': '0.457', 'weapon2': '0.460', 'weapon4': '0.476', 'WEAPON3': '0.850', 'HITCOUNT': '1.150', 'weapon3': '1.850', 'DAMAGECOUNT': '4.626', 'FRAGCOUNT': '13.000'} [2023-02-24 19:06:19,456][177171] DAMAGECOUNT value on done: 279125.0 [2023-02-24 19:06:19,457][177171] Sum rewards: 20.929, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.360', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.040', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon7': '0.100', 'weapon5': '0.108', 'AMMO3': '0.111', 'AMMO4': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.508', 'WEAPON3': '0.650', 'weapon2': '0.848', 'HITCOUNT': '1.460', 'weapon3': '1.978', 'DAMAGECOUNT': '5.721', 'FRAGCOUNT': '17.000'} [2023-02-24 19:06:19,493][177171] DAMAGECOUNT value on done: 274925.0 [2023-02-24 19:06:19,494][177171] Sum rewards: 26.129, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.038', 'HEALTH': '0.041', 'AMMO3': '0.096', 'weapon5': '0.190', 'AMMO4': '0.192', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'weapon4': '0.564', 'weapon2': '1.150', 'HITCOUNT': '1.590', 'weapon3': '1.838', 'DAMAGECOUNT': '7.011', 'FRAGCOUNT': '20.000'} [2023-02-24 19:06:21,219][177155] DAMAGECOUNT value on done: 279119.0 [2023-02-24 19:06:21,219][177155] Sum rewards: 20.028, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.192', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.082', 'AMMO3': '0.115', 'weapon4': '0.154', 'weapon5': '0.290', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '1.080', 'weapon2': '1.120', 'weapon3': '1.752', 'DAMAGECOUNT': '5.328', 'FRAGCOUNT': '16.000'} [2023-02-24 19:06:21,376][177119] Fps is (10 sec: 13516.5, 60 sec: 13789.8, 300 sec: 13815.3). Total num frames: 86577152. Throughput: 0: 3459.5. Samples: 21639078. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 19:06:21,377][177119] Avg episode reward: [(0, '16.542')] [2023-02-24 19:06:21,510][177155] DAMAGECOUNT value on done: 287801.0 [2023-02-24 19:06:21,511][177155] Sum rewards: 10.990, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.364', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'weapon4': '0.024', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'weapon5': '0.264', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'HITCOUNT': '1.000', 'weapon2': '1.326', 'weapon3': '1.918', 'DAMAGECOUNT': '4.107', 'FRAGCOUNT': '10.500'} [2023-02-24 19:06:21,811][177155] DAMAGECOUNT value on done: 285110.0 [2023-02-24 19:06:21,811][177155] Sum rewards: 15.249, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.820', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.056', 'WEAPON4': '0.150', 'AMMO3': '0.155', 'weapon5': '0.270', 'weapon4': '0.318', 'WEAPON5': '0.400', 'WEAPON3': '0.950', 'weapon2': '1.264', 'HITCOUNT': '1.420', 'weapon3': '1.812', 'DAMAGECOUNT': '6.960', 'FRAGCOUNT': '13.500'} [2023-02-24 19:06:22,010][177153] Updated weights for policy 0, policy_version 21140 (0.0008) [2023-02-24 19:06:22,110][177155] DAMAGECOUNT value on done: 269288.0 [2023-02-24 19:06:22,110][177155] Sum rewards: 20.350, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.740', 'AMMO5': '0.027', 'AMMO2': '0.035', 'WEAPON1': '0.040', 'AMMO3': '0.121', 'AMMO4': '0.174', 'WEAPON4': '0.400', 'ARMOR': '0.451', 'weapon5': '0.492', 'WEAPON5': '0.600', 'weapon4': '0.614', 'weapon2': '0.724', 'WEAPON3': '0.800', 'HITCOUNT': '1.090', 'weapon3': '1.604', 'DAMAGECOUNT': '6.417', 'FRAGCOUNT': '19.000'} [2023-02-24 19:06:24,936][177153] Updated weights for policy 0, policy_version 21150 (0.0008) [2023-02-24 19:06:26,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13789.9, 300 sec: 13815.3). Total num frames: 86646784. Throughput: 0: 3461.2. Samples: 21659868. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 19:06:26,376][177119] Avg episode reward: [(0, '16.604')] [2023-02-24 19:06:27,617][177158] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 19:06:27,938][177153] Updated weights for policy 0, policy_version 21160 (0.0008) [2023-02-24 19:06:29,734][177170] DAMAGECOUNT value on done: 278929.0 [2023-02-24 19:06:29,735][177170] Sum rewards: 21.535, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.663', 'AMMO2': '0.012', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.061', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'weapon5': '0.264', 'weapon4': '0.384', 'WEAPON5': '0.450', 'weapon2': '0.910', 'WEAPON3': '1.050', 'HITCOUNT': '1.440', 'weapon3': '1.728', 'DAMAGECOUNT': '6.297', 'FRAGCOUNT': '20.000'} [2023-02-24 19:06:30,037][177170] DAMAGECOUNT value on done: 282519.0 [2023-02-24 19:06:30,037][177170] Sum rewards: 14.786, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.636', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon7': '0.046', 'AMMO3': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'weapon5': '0.236', 'WEAPON5': '0.250', 'weapon4': '0.384', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.810', 'weapon2': '0.826', 'weapon3': '1.332', 'DAMAGECOUNT': '3.636', 'FRAGCOUNT': '13.000'} [2023-02-24 19:06:30,386][177156] DAMAGECOUNT value on done: 278812.0 [2023-02-24 19:06:30,386][177156] Sum rewards: 10.289, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.245', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO3': '0.078', 'weapon7': '0.120', 'weapon5': '0.128', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'WEAPON7': '0.400', 'weapon4': '0.466', 'WEAPON3': '0.600', 'HITCOUNT': '0.720', 'weapon2': '0.992', 'weapon3': '1.114', 'DAMAGECOUNT': '3.258', 'FRAGCOUNT': '8.000'} [2023-02-24 19:06:30,397][177156] DAMAGECOUNT value on done: 272568.0 [2023-02-24 19:06:30,397][177156] Sum rewards: 15.190, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.064', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.104', 'AMMO4': '0.129', 'weapon5': '0.294', 'WEAPON4': '0.350', 'weapon4': '0.468', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon2': '1.038', 'HITCOUNT': '1.150', 'weapon3': '1.794', 'DAMAGECOUNT': '4.863', 'FRAGCOUNT': '14.000'} [2023-02-24 19:06:30,589][177170] DAMAGECOUNT value on done: 273737.0 [2023-02-24 19:06:30,589][177170] Sum rewards: 12.369, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.290', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO5': '0.035', 'WEAPON1': '0.040', 'AMMO3': '0.196', 'weapon5': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.354', 'WEAPON5': '0.750', 'ARMOR': '0.893', 'weapon2': '0.978', 'HITCOUNT': '1.040', 'WEAPON3': '1.300', 'weapon3': '1.944', 'DAMAGECOUNT': '4.644', 'FRAGCOUNT': '15.000'} [2023-02-24 19:06:30,697][177156] DAMAGECOUNT value on done: 284579.0 [2023-02-24 19:06:30,698][177156] Sum rewards: 13.031, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.568', 'AMMO2': '0.032', 'AMMO5': '0.036', 'WEAPON1': '0.050', 'AMMO4': '0.162', 'AMMO3': '0.170', 'weapon5': '0.256', 'weapon4': '0.382', 'WEAPON4': '0.400', 'ARMOR': '0.453', 'weapon2': '0.662', 'WEAPON5': '0.750', 'WEAPON3': '1.100', 'HITCOUNT': '1.300', 'weapon3': '2.306', 'DAMAGECOUNT': '5.289', 'FRAGCOUNT': '14.000'} [2023-02-24 19:06:30,708][177156] DAMAGECOUNT value on done: 272539.0 [2023-02-24 19:06:30,708][177156] Sum rewards: 17.122, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.190', 'AMMO2': '0.007', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.034', 'AMMO3': '0.118', 'WEAPON4': '0.150', 'weapon5': '0.242', 'weapon4': '0.294', 'WEAPON5': '0.400', 'ARMOR': '0.500', 'WEAPON3': '0.750', 'weapon2': '1.084', 'HITCOUNT': '1.110', 'weapon3': '1.622', 'DAMAGECOUNT': '4.716', 'FRAGCOUNT': '17.000'} [2023-02-24 19:06:30,881][177170] DAMAGECOUNT value on done: 280237.0 [2023-02-24 19:06:30,882][177170] Sum rewards: 17.308, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.470', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon7': '0.052', 'AMMO3': '0.097', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO4': '0.168', 'weapon5': '0.190', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'ARMOR': '0.400', 'WEAPON4': '0.550', 'weapon2': '0.666', 'WEAPON3': '0.700', 'weapon4': '1.182', 'weapon3': '1.354', 'HITCOUNT': '1.370', 'DAMAGECOUNT': '5.583', 'FRAGCOUNT': '14.500'} [2023-02-24 19:06:30,897][177153] Updated weights for policy 0, policy_version 21170 (0.0008) [2023-02-24 19:06:31,376][177119] Fps is (10 sec: 13926.7, 60 sec: 13789.9, 300 sec: 13815.3). Total num frames: 86716416. Throughput: 0: 3457.8. Samples: 21680528. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 19:06:31,376][177119] Avg episode reward: [(0, '16.331')] [2023-02-24 19:06:31,719][177158] DAMAGECOUNT value on done: 270138.0 [2023-02-24 19:06:31,719][177158] Sum rewards: 21.519, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.360', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON1': '0.050', 'AMMO3': '0.120', 'AMMO4': '0.141', 'weapon5': '0.160', 'WEAPON5': '0.200', 'weapon4': '0.306', 'WEAPON4': '0.400', 'ARMOR': '0.472', 'WEAPON3': '0.850', 'weapon2': '1.170', 'HITCOUNT': '1.730', 'weapon3': '1.890', 'DAMAGECOUNT': '6.357', 'FRAGCOUNT': '19.000'} [2023-02-24 19:06:32,023][177158] DAMAGECOUNT value on done: 272299.0 [2023-02-24 19:06:32,023][177158] Sum rewards: 23.478, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.104', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.038', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon5': '0.404', 'WEAPON5': '0.450', 'ARMOR': '0.457', 'weapon4': '0.500', 'weapon2': '0.744', 'WEAPON3': '1.300', 'HITCOUNT': '1.540', 'weapon3': '1.990', 'DAMAGECOUNT': '6.966', 'FRAGCOUNT': '22.000'} [2023-02-24 19:06:32,606][177158] DAMAGECOUNT value on done: 281015.0 [2023-02-24 19:06:32,607][177158] Sum rewards: 16.270, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.864', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.013', 'AMMO3': '0.080', 'weapon7': '0.138', 'weapon5': '0.152', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON7': '0.400', 'weapon4': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.880', 'weapon3': '1.352', 'DAMAGECOUNT': '3.906', 'FRAGCOUNT': '14.000'} [2023-02-24 19:06:32,912][177158] DAMAGECOUNT value on done: 281857.0 [2023-02-24 19:06:32,913][177158] Sum rewards: 18.179, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.830', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'AMMO4': '0.047', 'AMMO3': '0.071', 'weapon4': '0.164', 'WEAPON4': '0.250', 'weapon5': '0.264', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '1.210', 'weapon2': '1.362', 'weapon3': '1.678', 'DAMAGECOUNT': '5.004', 'FRAGCOUNT': '14.000'} [2023-02-24 19:06:33,891][177153] Updated weights for policy 0, policy_version 21180 (0.0008) [2023-02-24 19:06:35,665][177172] DAMAGECOUNT value on done: 275649.0 [2023-02-24 19:06:35,665][177172] Sum rewards: 23.210, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.150', 'AMMO2': '0.003', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.014', 'weapon4': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.095', 'weapon5': '0.206', 'WEAPON5': '0.250', 'WEAPON3': '0.750', 'weapon2': '1.400', 'HITCOUNT': '1.480', 'weapon3': '2.072', 'DAMAGECOUNT': '6.750', 'FRAGCOUNT': '18.000'} [2023-02-24 19:06:35,973][177172] DAMAGECOUNT value on done: 272053.0 [2023-02-24 19:06:35,974][177172] Sum rewards: 19.450, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.533', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.050', 'AMMO3': '0.126', 'AMMO4': '0.250', 'WEAPON5': '0.500', 'weapon5': '0.536', 'WEAPON4': '0.550', 'WEAPON3': '0.700', 'weapon2': '0.800', 'weapon4': '0.956', 'weapon3': '1.194', 'HITCOUNT': '1.480', 'DAMAGECOUNT': '7.314', 'FRAGCOUNT': '16.000'} [2023-02-24 19:06:36,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13815.3). Total num frames: 86786048. Throughput: 0: 3455.6. Samples: 21690780. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:06:36,376][177119] Avg episode reward: [(0, '16.412')] [2023-02-24 19:06:36,905][177153] Updated weights for policy 0, policy_version 21190 (0.0008) [2023-02-24 19:06:37,254][177154] DAMAGECOUNT value on done: 280384.0 [2023-02-24 19:06:37,254][177154] Sum rewards: 7.498, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.924', 'AMMO5': '0.014', 'AMMO2': '0.035', 'AMMO4': '0.174', 'AMMO3': '0.194', 'weapon5': '0.324', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.548', 'weapon2': '0.550', 'HITCOUNT': '0.880', 'WEAPON3': '1.100', 'weapon3': '1.862', 'DAMAGECOUNT': '4.641', 'FRAGCOUNT': '9.500'} [2023-02-24 19:06:37,466][177172] DAMAGECOUNT value on done: 285592.0 [2023-02-24 19:06:37,467][177172] Sum rewards: 24.690, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.755', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'AMMO3': '0.041', 'AMMO4': '0.104', 'weapon5': '0.234', 'WEAPON5': '0.350', 'WEAPON3': '0.350', 'WEAPON4': '0.400', 'ARMOR': '0.426', 'weapon2': '0.532', 'weapon4': '0.794', 'weapon3': '0.994', 'HITCOUNT': '1.100', 'DAMAGECOUNT': '5.079', 'FRAGCOUNT': '18.000'} [2023-02-24 19:06:37,560][177154] DAMAGECOUNT value on done: 286063.0 [2023-02-24 19:06:37,561][177154] Sum rewards: 10.994, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.250', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO3': '0.091', 'weapon7': '0.162', 'AMMO4': '0.172', 'weapon5': '0.214', 'WEAPON5': '0.300', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON4': '0.450', 'WEAPON7': '0.500', 'WEAPON3': '0.500', 'weapon2': '0.536', 'weapon4': '0.992', 'HITCOUNT': '1.070', 'weapon3': '1.230', 'DAMAGECOUNT': '5.046', 'FRAGCOUNT': '7.500'} [2023-02-24 19:06:37,774][177172] DAMAGECOUNT value on done: 275826.0 [2023-02-24 19:06:37,775][177172] Sum rewards: 12.907, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.194', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.130', 'AMMO4': '0.190', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon5': '0.366', 'ARMOR': '0.400', 'weapon4': '0.406', 'WEAPON3': '0.800', 'weapon2': '0.834', 'HITCOUNT': '1.060', 'weapon3': '1.950', 'DAMAGECOUNT': '4.464', 'FRAGCOUNT': '14.000'} [2023-02-24 19:06:37,776][177154] DAMAGECOUNT value on done: 289044.0 [2023-02-24 19:06:37,776][177154] Sum rewards: 20.619, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.101', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.016', 'AMMO4': '0.055', 'AMMO3': '0.105', 'WEAPON4': '0.150', 'weapon5': '0.306', 'weapon4': '0.334', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'weapon2': '0.884', 'HITCOUNT': '1.210', 'weapon3': '1.946', 'DAMAGECOUNT': '6.342', 'FRAGCOUNT': '15.000'} [2023-02-24 19:06:38,066][177154] DAMAGECOUNT value on done: 285227.0 [2023-02-24 19:06:38,066][177154] Sum rewards: 23.977, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.974', 'AMMO2': '0.005', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.023', 'AMMO3': '0.148', 'weapon5': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.930', 'WEAPON3': '0.950', 'HITCOUNT': '1.410', 'weapon3': '2.336', 'DAMAGECOUNT': '5.655', 'FRAGCOUNT': '22.000'} [2023-02-24 19:06:38,337][177157] DAMAGECOUNT value on done: 287183.0 [2023-02-24 19:06:38,337][177157] Sum rewards: 17.224, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.290', 'AMMO2': '0.006', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.027', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'weapon5': '0.244', 'WEAPON5': '0.400', 'weapon4': '0.504', 'ARMOR': '0.848', 'weapon2': '0.896', 'WEAPON3': '0.900', 'HITCOUNT': '0.960', 'weapon3': '1.842', 'DAMAGECOUNT': '4.779', 'FRAGCOUNT': '15.000'} [2023-02-24 19:06:38,621][177157] DAMAGECOUNT value on done: 271665.0 [2023-02-24 19:06:38,621][177157] Sum rewards: 19.098, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.444', 'ARMOR': '0.004', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.110', 'weapon5': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.352', 'weapon2': '0.690', 'WEAPON3': '0.700', 'HITCOUNT': '1.470', 'weapon3': '1.966', 'DAMAGECOUNT': '6.498', 'FRAGCOUNT': '15.000'} [2023-02-24 19:06:38,649][177157] DAMAGECOUNT value on done: 269701.0 [2023-02-24 19:06:38,649][177157] Sum rewards: 17.356, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.828', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.122', 'AMMO3': '0.148', 'WEAPON4': '0.200', 'weapon5': '0.214', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon4': '0.460', 'WEAPON3': '0.900', 'HITCOUNT': '0.910', 'weapon2': '1.294', 'weapon3': '1.688', 'DAMAGECOUNT': '4.461', 'FRAGCOUNT': '16.000'} [2023-02-24 19:06:38,725][177171] DAMAGECOUNT value on done: 273977.0 [2023-02-24 19:06:38,726][177171] Sum rewards: 18.450, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.725', 'AMMO5': '0.011', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon7': '0.056', 'AMMO4': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.161', 'weapon5': '0.178', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.486', 'weapon2': '0.748', 'WEAPON3': '0.950', 'HITCOUNT': '1.430', 'weapon3': '2.212', 'DAMAGECOUNT': '5.523', 'FRAGCOUNT': '17.000'} [2023-02-24 19:06:38,764][177171] DAMAGECOUNT value on done: 273148.0 [2023-02-24 19:06:38,764][177171] Sum rewards: 13.755, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.570', 'AMMO5': '0.019', 'AMMO2': '0.025', 'AMMO3': '0.101', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'weapon5': '0.176', 'weapon4': '0.178', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.900', 'weapon2': '1.336', 'weapon3': '1.772', 'DAMAGECOUNT': '4.245', 'FRAGCOUNT': '11.000'} [2023-02-24 19:06:38,935][177157] DAMAGECOUNT value on done: 273395.0 [2023-02-24 19:06:38,935][177157] Sum rewards: 13.739, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.158', 'AMMO2': '0.016', 'AMMO5': '0.027', 'AMMO4': '0.077', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'weapon4': '0.250', 'weapon5': '0.336', 'WEAPON5': '0.700', 'WEAPON3': '0.950', 'HITCOUNT': '1.030', 'weapon2': '1.240', 'weapon3': '1.710', 'DAMAGECOUNT': '5.025', 'FRAGCOUNT': '13.000'} [2023-02-24 19:06:39,039][177171] DAMAGECOUNT value on done: 281050.0 [2023-02-24 19:06:39,039][177171] Sum rewards: 19.924, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.129', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon4': '0.100', 'AMMO3': '0.131', 'WEAPON4': '0.200', 'weapon5': '0.234', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'weapon2': '1.028', 'HITCOUNT': '1.420', 'weapon3': '2.034', 'DAMAGECOUNT': '5.775', 'FRAGCOUNT': '18.500'} [2023-02-24 19:06:39,078][177171] DAMAGECOUNT value on done: 277033.0 [2023-02-24 19:06:39,079][177171] Sum rewards: 14.288, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.596', 'ARMOR': '0.004', 'AMMO5': '0.028', 'AMMO2': '0.034', 'AMMO3': '0.145', 'AMMO4': '0.172', 'WEAPON4': '0.300', 'weapon5': '0.376', 'WEAPON5': '0.600', 'weapon4': '0.610', 'weapon2': '0.844', 'WEAPON3': '0.900', 'HITCOUNT': '1.390', 'weapon3': '1.656', 'DAMAGECOUNT': '6.324', 'FRAGCOUNT': '13.000'} [2023-02-24 19:06:39,895][177153] Updated weights for policy 0, policy_version 21200 (0.0008) [2023-02-24 19:06:40,717][177155] DAMAGECOUNT value on done: 281899.0 [2023-02-24 19:06:40,718][177155] Sum rewards: 23.815, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.260', 'WEAPON1': '0.010', 'AMMO5': '0.025', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon5': '0.278', 'weapon4': '0.410', 'weapon2': '0.472', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'HITCOUNT': '1.790', 'weapon3': '2.500', 'DAMAGECOUNT': '8.262', 'FRAGCOUNT': '21.000'} [2023-02-24 19:06:41,014][177155] DAMAGECOUNT value on done: 289217.0 [2023-02-24 19:06:41,015][177155] Sum rewards: 13.026, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.333', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.046', 'weapon7': '0.050', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.204', 'weapon4': '0.244', 'WEAPON3': '0.450', 'ARMOR': '0.460', 'weapon2': '0.558', 'HITCOUNT': '0.950', 'weapon3': '1.302', 'DAMAGECOUNT': '4.248', 'FRAGCOUNT': '10.000'} [2023-02-24 19:06:41,310][177155] DAMAGECOUNT value on done: 287439.0 [2023-02-24 19:06:41,311][177155] Sum rewards: 22.951, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.634', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO5': '0.027', 'AMMO4': '0.054', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'weapon5': '0.262', 'weapon4': '0.264', 'WEAPON5': '0.750', 'WEAPON3': '0.900', 'weapon2': '1.158', 'HITCOUNT': '1.410', 'weapon3': '1.964', 'DAMAGECOUNT': '6.987', 'FRAGCOUNT': '18.000'} [2023-02-24 19:06:41,376][177119] Fps is (10 sec: 13516.9, 60 sec: 13789.9, 300 sec: 13801.4). Total num frames: 86851584. Throughput: 0: 3451.4. Samples: 21711370. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:06:41,376][177119] Avg episode reward: [(0, '16.327')] [2023-02-24 19:06:41,609][177155] DAMAGECOUNT value on done: 271629.0 [2023-02-24 19:06:41,610][177155] Sum rewards: 19.224, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.702', 'AMMO5': '0.018', 'AMMO2': '0.027', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.108', 'AMMO4': '0.133', 'AMMO3': '0.214', 'weapon4': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.922', 'WEAPON3': '1.200', 'HITCOUNT': '1.730', 'weapon3': '2.376', 'DAMAGECOUNT': '7.023', 'FRAGCOUNT': '17.000'} [2023-02-24 19:06:42,876][177153] Updated weights for policy 0, policy_version 21210 (0.0008) [2023-02-24 19:06:45,847][177153] Updated weights for policy 0, policy_version 21220 (0.0008) [2023-02-24 19:06:46,376][177119] Fps is (10 sec: 13516.9, 60 sec: 13789.9, 300 sec: 13801.4). Total num frames: 86921216. Throughput: 0: 3450.0. Samples: 21732042. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:06:46,376][177119] Avg episode reward: [(0, '16.371')] [2023-02-24 19:06:46,549][177158] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.34500000000000003, 115.0), ('AMMO3', -0.001, -2.0), ('WEAPON5', 0.1, 1.0), ('AMMO5', 0.005, 5.0), ('weapon3', 0.002)] [2023-02-24 19:06:48,818][177153] Updated weights for policy 0, policy_version 21230 (0.0008) [2023-02-24 19:06:49,237][177170] DAMAGECOUNT value on done: 279919.0 [2023-02-24 19:06:49,238][177170] Sum rewards: 10.551, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.010', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO3': '0.051', 'AMMO4': '0.072', 'weapon7': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HEALTH': '0.220', 'weapon5': '0.238', 'weapon4': '0.244', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'weapon2': '0.428', 'HITCOUNT': '0.560', 'weapon3': '0.762', 'DAMAGECOUNT': '2.970', 'FRAGCOUNT': '7.000'} [2023-02-24 19:06:49,536][177170] DAMAGECOUNT value on done: 283636.0 [2023-02-24 19:06:49,536][177170] Sum rewards: 9.976, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.148', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.093', 'AMMO4': '0.114', 'WEAPON4': '0.300', 'weapon5': '0.336', 'WEAPON5': '0.450', 'weapon4': '0.464', 'WEAPON3': '0.550', 'HITCOUNT': '0.630', 'weapon3': '1.236', 'weapon2': '1.290', 'DAMAGECOUNT': '3.351', 'FRAGCOUNT': '9.000'} [2023-02-24 19:06:49,980][177156] DAMAGECOUNT value on done: 280724.0 [2023-02-24 19:06:49,981][177156] Sum rewards: 14.588, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.205', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.053', 'weapon5': '0.142', 'AMMO3': '0.148', 'AMMO4': '0.267', 'WEAPON5': '0.450', 'ARMOR': '0.460', 'WEAPON4': '0.600', 'weapon4': '0.774', 'weapon2': '0.864', 'WEAPON3': '0.900', 'weapon3': '1.372', 'HITCOUNT': '1.490', 'DAMAGECOUNT': '5.736', 'FRAGCOUNT': '14.000'} [2023-02-24 19:06:49,989][177156] DAMAGECOUNT value on done: 274467.0 [2023-02-24 19:06:49,989][177156] Sum rewards: 15.400, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.832', 'AMMO5': '0.006', 'AMMO2': '0.040', 'weapon5': '0.054', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.202', 'weapon2': '0.380', 'WEAPON4': '0.450', 'ARMOR': '0.456', 'weapon4': '0.608', 'WEAPON3': '1.000', 'HITCOUNT': '1.480', 'weapon3': '2.458', 'DAMAGECOUNT': '5.697', 'FRAGCOUNT': '14.000'} [2023-02-24 19:06:50,126][177170] DAMAGECOUNT value on done: 275637.0 [2023-02-24 19:06:50,126][177170] Sum rewards: 18.318, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.875', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'ARMOR': '0.004', 'AMMO5': '0.011', 'weapon4': '0.132', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'weapon5': '0.226', 'WEAPON5': '0.350', 'WEAPON3': '0.900', 'weapon2': '1.298', 'HITCOUNT': '1.370', 'weapon3': '1.922', 'DAMAGECOUNT': '5.700', 'FRAGCOUNT': '16.000'} [2023-02-24 19:06:50,274][177156] DAMAGECOUNT value on done: 286830.0 [2023-02-24 19:06:50,275][177156] Sum rewards: 19.957, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.730', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO3': '0.134', 'WEAPON4': '0.150', 'weapon4': '0.388', 'WEAPON3': '0.850', 'weapon2': '0.878', 'HITCOUNT': '1.640', 'weapon3': '2.080', 'DAMAGECOUNT': '6.753', 'FRAGCOUNT': '15.000'} [2023-02-24 19:06:50,287][177156] DAMAGECOUNT value on done: 275865.0 [2023-02-24 19:06:50,287][177156] Sum rewards: 30.071, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.465', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.149', 'weapon5': '0.260', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.576', 'weapon4': '0.796', 'WEAPON3': '0.950', 'HITCOUNT': '1.830', 'weapon3': '1.976', 'DAMAGECOUNT': '9.966', 'FRAGCOUNT': '23.000'} [2023-02-24 19:06:50,417][177170] DAMAGECOUNT value on done: 282144.0 [2023-02-24 19:06:50,418][177170] Sum rewards: 18.142, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.339', 'AMMO2': '0.012', 'AMMO5': '0.015', 'AMMO4': '0.060', 'AMMO3': '0.067', 'weapon4': '0.244', 'WEAPON4': '0.250', 'weapon5': '0.302', 'WEAPON5': '0.400', 'ARMOR': '0.404', 'WEAPON3': '0.500', 'HITCOUNT': '1.120', 'weapon3': '1.384', 'weapon2': '1.502', 'DAMAGECOUNT': '5.721', 'FRAGCOUNT': '13.500'} [2023-02-24 19:06:51,347][177158] DAMAGECOUNT value on done: 272298.0 [2023-02-24 19:06:51,347][177158] Sum rewards: 22.089, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.758', 'AMMO2': '0.009', 'AMMO5': '0.025', 'AMMO4': '0.045', 'AMMO3': '0.161', 'WEAPON4': '0.300', 'weapon5': '0.362', 'weapon4': '0.508', 'WEAPON5': '0.650', 'weapon2': '0.916', 'WEAPON3': '0.950', 'HITCOUNT': '1.290', 'weapon3': '1.900', 'DAMAGECOUNT': '6.480', 'FRAGCOUNT': '20.000'} [2023-02-24 19:06:51,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13789.9, 300 sec: 13801.4). Total num frames: 86990848. Throughput: 0: 3446.6. Samples: 21742384. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 19:06:51,376][177119] Avg episode reward: [(0, '16.591')] [2023-02-24 19:06:51,654][177158] DAMAGECOUNT value on done: 274358.0 [2023-02-24 19:06:51,654][177158] Sum rewards: 20.763, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'AMMO4': '0.172', 'HEALTH': '0.291', 'WEAPON5': '0.300', 'weapon5': '0.330', 'weapon4': '0.582', 'WEAPON3': '0.650', 'weapon2': '0.728', 'HITCOUNT': '1.380', 'weapon3': '1.844', 'DAMAGECOUNT': '6.177', 'FRAGCOUNT': '17.000'} [2023-02-24 19:06:51,796][177153] Updated weights for policy 0, policy_version 21240 (0.0008) [2023-02-24 19:06:52,257][177158] DAMAGECOUNT value on done: 283940.0 [2023-02-24 19:06:52,258][177158] Sum rewards: 30.606, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.136', 'AMMO5': '0.019', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'AMMO3': '0.215', 'weapon5': '0.310', 'weapon4': '0.324', 'WEAPON5': '0.450', 'weapon2': '0.652', 'WEAPON3': '1.300', 'HITCOUNT': '1.900', 'weapon3': '2.260', 'DAMAGECOUNT': '8.775', 'FRAGCOUNT': '28.000'} [2023-02-24 19:06:52,552][177158] DAMAGECOUNT value on done: 283433.0 [2023-02-24 19:06:52,552][177158] Sum rewards: 16.576, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.490', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.138', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'WEAPON3': '0.850', 'weapon2': '1.126', 'HITCOUNT': '1.250', 'weapon3': '1.926', 'DAMAGECOUNT': '4.728', 'FRAGCOUNT': '15.000'} [2023-02-24 19:06:54,742][177153] Updated weights for policy 0, policy_version 21250 (0.0008) [2023-02-24 19:06:55,191][177172] DAMAGECOUNT value on done: 277519.0 [2023-02-24 19:06:55,191][177172] Sum rewards: 16.824, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.810', 'AMMO2': '0.011', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.056', 'AMMO3': '0.113', 'WEAPON4': '0.200', 'weapon4': '0.332', 'weapon5': '0.394', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'weapon2': '0.990', 'HITCOUNT': '1.290', 'weapon3': '1.640', 'DAMAGECOUNT': '5.610', 'FRAGCOUNT': '14.000'} [2023-02-24 19:06:55,499][177172] DAMAGECOUNT value on done: 273969.0 [2023-02-24 19:06:55,499][177172] Sum rewards: 22.682, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.050', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.128', 'AMMO3': '0.132', 'AMMO4': '0.182', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.548', 'weapon4': '0.810', 'WEAPON3': '0.850', 'HITCOUNT': '1.380', 'weapon3': '1.608', 'DAMAGECOUNT': '5.748', 'FRAGCOUNT': '20.000'} [2023-02-24 19:06:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13789.8, 300 sec: 13801.4). Total num frames: 87060480. Throughput: 0: 3443.2. Samples: 21763030. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 19:06:56,376][177119] Avg episode reward: [(0, '17.044')] [2023-02-24 19:06:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000021255_87060480.pth... [2023-02-24 19:06:56,436][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000020447_83750912.pth [2023-02-24 19:06:56,736][177154] DAMAGECOUNT value on done: 282854.0 [2023-02-24 19:06:56,737][177154] Sum rewards: 22.174, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.690', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.120', 'weapon5': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.414', 'WEAPON3': '0.900', 'weapon2': '0.902', 'HITCOUNT': '1.460', 'weapon3': '2.122', 'DAMAGECOUNT': '7.410', 'FRAGCOUNT': '18.000'} [2023-02-24 19:06:57,014][177172] DAMAGECOUNT value on done: 287435.0 [2023-02-24 19:06:57,015][177172] Sum rewards: 12.545, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.115', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.022', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'weapon2': '0.300', 'weapon5': '0.318', 'WEAPON5': '0.450', 'weapon4': '0.466', 'WEAPON3': '1.050', 'HITCOUNT': '1.230', 'weapon3': '2.464', 'DAMAGECOUNT': '5.529', 'FRAGCOUNT': '13.000'} [2023-02-24 19:06:57,039][177154] DAMAGECOUNT value on done: 287788.0 [2023-02-24 19:06:57,039][177154] Sum rewards: 18.438, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.748', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'weapon4': '0.202', 'weapon5': '0.274', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'weapon2': '1.160', 'HITCOUNT': '1.280', 'weapon3': '1.994', 'DAMAGECOUNT': '5.175', 'FRAGCOUNT': '16.000'} [2023-02-24 19:06:57,297][177154] DAMAGECOUNT value on done: 291209.0 [2023-02-24 19:06:57,298][177154] Sum rewards: 18.055, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.192', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.174', 'AMMO4': '0.174', 'AMMO3': '0.217', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.502', 'weapon4': '0.876', 'WEAPON3': '1.250', 'HITCOUNT': '1.510', 'weapon3': '1.802', 'DAMAGECOUNT': '6.495', 'FRAGCOUNT': '17.000'} [2023-02-24 19:06:57,318][177172] DAMAGECOUNT value on done: 277942.0 [2023-02-24 19:06:57,319][177172] Sum rewards: 22.921, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.734', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'WEAPON4': '0.050', 'weapon4': '0.068', 'AMMO3': '0.112', 'weapon5': '0.122', 'WEAPON5': '0.150', 'WEAPON3': '0.750', 'weapon2': '1.204', 'HITCOUNT': '1.540', 'weapon3': '1.856', 'DAMAGECOUNT': '6.348', 'FRAGCOUNT': '19.000'} [2023-02-24 19:06:57,601][177154] DAMAGECOUNT value on done: 286765.0 [2023-02-24 19:06:57,602][177154] Sum rewards: 11.773, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.805', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'AMMO3': '0.134', 'AMMO4': '0.134', 'WEAPON4': '0.350', 'weapon5': '0.428', 'ARMOR': '0.453', 'WEAPON5': '0.500', 'weapon4': '0.606', 'WEAPON3': '0.850', 'weapon2': '0.914', 'HITCOUNT': '1.120', 'weapon3': '1.660', 'DAMAGECOUNT': '4.614', 'FRAGCOUNT': '10.000'} [2023-02-24 19:06:57,742][177153] Updated weights for policy 0, policy_version 21260 (0.0008) [2023-02-24 19:06:57,894][177157] DAMAGECOUNT value on done: 288869.0 [2023-02-24 19:06:57,895][177157] Sum rewards: 14.025, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.536', 'AMMO2': '0.019', 'AMMO5': '0.021', 'AMMO4': '0.094', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'weapon4': '0.154', 'weapon5': '0.314', 'ARMOR': '0.455', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'weapon2': '1.088', 'HITCOUNT': '1.230', 'weapon3': '1.986', 'DAMAGECOUNT': '5.058', 'FRAGCOUNT': '13.000'} [2023-02-24 19:06:58,181][177171] DAMAGECOUNT value on done: 275529.0 [2023-02-24 19:06:58,182][177171] Sum rewards: 16.596, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.410', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.078', 'WEAPON5': '0.100', 'weapon5': '0.138', 'weapon4': '0.220', 'WEAPON3': '0.500', 'HITCOUNT': '0.970', 'weapon2': '1.198', 'weapon3': '1.500', 'DAMAGECOUNT': '4.656', 'FRAGCOUNT': '12.000'} [2023-02-24 19:06:58,193][177157] DAMAGECOUNT value on done: 274459.0 [2023-02-24 19:06:58,193][177157] Sum rewards: 22.262, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.649', 'AMMO5': '0.011', 'AMMO2': '0.044', 'AMMO3': '0.138', 'weapon5': '0.170', 'AMMO4': '0.222', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.660', 'weapon2': '0.736', 'WEAPON3': '0.900', 'HITCOUNT': '1.640', 'weapon3': '2.108', 'DAMAGECOUNT': '8.382', 'FRAGCOUNT': '21.000'} [2023-02-24 19:06:58,203][177157] DAMAGECOUNT value on done: 272146.0 [2023-02-24 19:06:58,203][177157] Sum rewards: 19.830, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.209', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.185', 'weapon5': '0.210', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.662', 'weapon2': '0.938', 'WEAPON3': '1.050', 'HITCOUNT': '1.590', 'weapon3': '1.900', 'DAMAGECOUNT': '7.032', 'FRAGCOUNT': '18.000'} [2023-02-24 19:06:58,218][177171] DAMAGECOUNT value on done: 275334.0 [2023-02-24 19:06:58,218][177171] Sum rewards: 11.021, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.756', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.156', 'AMMO3': '0.177', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.576', 'weapon2': '0.702', 'WEAPON3': '1.100', 'HITCOUNT': '1.650', 'weapon3': '1.928', 'DAMAGECOUNT': '6.558', 'FRAGCOUNT': '11.000'} [2023-02-24 19:06:58,482][177171] DAMAGECOUNT value on done: 281670.0 [2023-02-24 19:06:58,482][177171] Sum rewards: 3.033, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.338', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.007', 'AMMO3': '0.082', 'weapon7': '0.090', 'weapon5': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.500', 'weapon2': '0.522', 'weapon4': '0.526', 'WEAPON3': '0.600', 'weapon3': '1.256', 'DAMAGECOUNT': '1.860', 'FRAGCOUNT': '4.000'} [2023-02-24 19:06:58,500][177157] DAMAGECOUNT value on done: 275144.0 [2023-02-24 19:06:58,501][177157] Sum rewards: 15.735, reward structure: {'DEATHCOUNT': '-11.250', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'AMMO5': '0.020', 'HEALTH': '0.058', 'AMMO4': '0.099', 'AMMO3': '0.151', 'WEAPON4': '0.250', 'weapon5': '0.326', 'weapon4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.510', 'WEAPON3': '0.850', 'HITCOUNT': '1.170', 'weapon3': '2.324', 'DAMAGECOUNT': '5.247', 'FRAGCOUNT': '15.000'} [2023-02-24 19:06:58,521][177171] DAMAGECOUNT value on done: 278527.0 [2023-02-24 19:06:58,521][177171] Sum rewards: 11.566, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.796', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon7': '0.054', 'AMMO4': '0.063', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'weapon5': '0.184', 'WEAPON5': '0.300', 'weapon2': '0.342', 'weapon4': '0.404', 'WEAPON3': '0.700', 'HITCOUNT': '0.930', 'weapon3': '1.578', 'DAMAGECOUNT': '4.482', 'FRAGCOUNT': '11.000'} [2023-02-24 19:07:00,240][177155] DAMAGECOUNT value on done: 284318.0 [2023-02-24 19:07:00,240][177155] Sum rewards: 23.589, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.906', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.132', 'WEAPON4': '0.300', 'weapon5': '0.326', 'WEAPON5': '0.550', 'weapon2': '0.604', 'weapon4': '0.628', 'WEAPON3': '0.850', 'HITCOUNT': '1.590', 'weapon3': '2.056', 'DAMAGECOUNT': '7.257', 'FRAGCOUNT': '19.000'} [2023-02-24 19:07:00,542][177155] DAMAGECOUNT value on done: 291014.0 [2023-02-24 19:07:00,543][177155] Sum rewards: 16.680, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.786', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'AMMO5': '0.019', 'WEAPON1': '0.030', 'AMMO3': '0.158', 'weapon5': '0.258', 'WEAPON5': '0.550', 'weapon2': '0.900', 'WEAPON3': '1.150', 'HITCOUNT': '1.390', 'weapon3': '2.426', 'DAMAGECOUNT': '5.391', 'FRAGCOUNT': '17.000'} [2023-02-24 19:07:00,733][177153] Updated weights for policy 0, policy_version 21270 (0.0008) [2023-02-24 19:07:00,842][177155] DAMAGECOUNT value on done: 289205.0 [2023-02-24 19:07:00,842][177155] Sum rewards: 16.989, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.855', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.039', 'AMMO3': '0.109', 'AMMO4': '0.194', 'weapon5': '0.208', 'WEAPON5': '0.350', 'WEAPON4': '0.600', 'WEAPON3': '0.700', 'weapon4': '0.940', 'weapon2': '0.992', 'HITCOUNT': '1.230', 'weapon3': '1.404', 'DAMAGECOUNT': '5.298', 'FRAGCOUNT': '15.000'} [2023-02-24 19:07:01,139][177155] DAMAGECOUNT value on done: 272381.0 [2023-02-24 19:07:01,140][177155] Sum rewards: 8.666, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.010', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.021', 'weapon7': '0.056', 'AMMO3': '0.061', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.176', 'WEAPON7': '0.200', 'weapon4': '0.284', 'HITCOUNT': '0.420', 'WEAPON3': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.626', 'weapon3': '1.076', 'DAMAGECOUNT': '2.256', 'FRAGCOUNT': '7.000'} [2023-02-24 19:07:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13801.4). Total num frames: 87130112. Throughput: 0: 3440.6. Samples: 21783566. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 19:07:01,376][177119] Avg episode reward: [(0, '17.301')] [2023-02-24 19:07:03,717][177153] Updated weights for policy 0, policy_version 21280 (0.0009) [2023-02-24 19:07:06,376][177119] Fps is (10 sec: 13516.7, 60 sec: 13721.6, 300 sec: 13787.5). Total num frames: 87195648. Throughput: 0: 3440.1. Samples: 21793884. Policy #0 lag: (min: 0.0, avg: 1.0, max: 2.0) [2023-02-24 19:07:06,376][177119] Avg episode reward: [(0, '17.301')] [2023-02-24 19:07:06,680][177153] Updated weights for policy 0, policy_version 21290 (0.0008) [2023-02-24 19:07:08,796][177170] DAMAGECOUNT value on done: 281439.0 [2023-02-24 19:07:08,797][177170] Sum rewards: 13.886, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.730', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.136', 'weapon5': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.450', 'WEAPON3': '0.900', 'weapon2': '0.938', 'HITCOUNT': '1.110', 'weapon3': '1.874', 'DAMAGECOUNT': '4.560', 'FRAGCOUNT': '16.000'} [2023-02-24 19:07:09,103][177170] DAMAGECOUNT value on done: 286502.0 [2023-02-24 19:07:09,104][177170] Sum rewards: 25.383, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.256', 'AMMO5': '0.015', 'AMMO2': '0.020', 'weapon7': '0.056', 'AMMO4': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.145', 'weapon5': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.634', 'WEAPON3': '0.900', 'weapon2': '0.970', 'HITCOUNT': '1.710', 'weapon3': '1.886', 'DAMAGECOUNT': '8.595', 'FRAGCOUNT': '21.000'} [2023-02-24 19:07:09,595][177156] DAMAGECOUNT value on done: 282142.0 [2023-02-24 19:07:09,596][177156] Sum rewards: 16.138, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.580', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'AMMO3': '0.085', 'weapon4': '0.100', 'weapon5': '0.126', 'WEAPON4': '0.150', 'AMMO4': '0.154', 'WEAPON5': '0.200', 'WEAPON3': '0.550', 'HITCOUNT': '1.200', 'weapon3': '1.666', 'weapon2': '1.682', 'DAMAGECOUNT': '4.254', 'FRAGCOUNT': '14.000'} [2023-02-24 19:07:09,607][177156] DAMAGECOUNT value on done: 276758.0 [2023-02-24 19:07:09,607][177156] Sum rewards: 21.120, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.219', 'AMMO4': '-0.059', 'AMMO2': '-0.012', 'AMMO5': '0.022', 'AMMO3': '0.122', 'weapon5': '0.346', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'HITCOUNT': '1.360', 'weapon2': '1.460', 'weapon3': '1.926', 'DAMAGECOUNT': '6.873', 'FRAGCOUNT': '18.000'} [2023-02-24 19:07:09,668][177153] Updated weights for policy 0, policy_version 21300 (0.0009) [2023-02-24 19:07:09,723][177170] DAMAGECOUNT value on done: 277256.0 [2023-02-24 19:07:09,723][177170] Sum rewards: 12.981, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.104', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.042', 'AMMO3': '0.131', 'weapon5': '0.242', 'WEAPON4': '0.250', 'weapon4': '0.272', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'weapon2': '1.160', 'HITCOUNT': '1.180', 'weapon3': '2.020', 'DAMAGECOUNT': '4.857', 'FRAGCOUNT': '14.000'} [2023-02-24 19:07:09,906][177156] DAMAGECOUNT value on done: 288701.0 [2023-02-24 19:07:09,906][177156] Sum rewards: 17.903, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.666', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.092', 'AMMO3': '0.146', 'weapon4': '0.170', 'weapon5': '0.388', 'WEAPON5': '0.400', 'weapon2': '0.410', 'WEAPON3': '1.050', 'HITCOUNT': '1.470', 'weapon3': '2.734', 'DAMAGECOUNT': '5.613', 'FRAGCOUNT': '16.000'} [2023-02-24 19:07:09,920][177156] DAMAGECOUNT value on done: 277820.0 [2023-02-24 19:07:09,920][177156] Sum rewards: 19.827, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.122', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.044', 'AMMO3': '0.169', 'AMMO4': '0.219', 'weapon5': '0.294', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon4': '0.636', 'weapon2': '0.790', 'ARMOR': '0.896', 'WEAPON3': '1.050', 'HITCOUNT': '1.360', 'weapon3': '1.906', 'DAMAGECOUNT': '5.556', 'FRAGCOUNT': '18.500'} [2023-02-24 19:07:10,025][177170] DAMAGECOUNT value on done: 283665.0 [2023-02-24 19:07:10,025][177170] Sum rewards: 17.173, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.230', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'weapon5': '0.062', 'weapon7': '0.082', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.488', 'WEAPON3': '0.850', 'HITCOUNT': '0.970', 'weapon3': '1.188', 'weapon2': '1.316', 'DAMAGECOUNT': '4.413', 'FRAGCOUNT': '16.000'} [2023-02-24 19:07:10,927][177158] DAMAGECOUNT value on done: 273907.0 [2023-02-24 19:07:10,927][177158] Sum rewards: 19.293, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.846', 'AMMO2': '0.012', 'AMMO5': '0.013', 'AMMO4': '0.061', 'AMMO3': '0.097', 'WEAPON4': '0.250', 'weapon5': '0.260', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.480', 'WEAPON3': '0.600', 'HITCOUNT': '1.110', 'weapon3': '1.246', 'weapon2': '1.382', 'DAMAGECOUNT': '4.827', 'FRAGCOUNT': '15.000'} [2023-02-24 19:07:11,230][177158] DAMAGECOUNT value on done: 276219.0 [2023-02-24 19:07:11,231][177158] Sum rewards: 14.066, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.830', 'AMMO2': '0.008', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.038', 'AMMO3': '0.121', 'weapon5': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.426', 'WEAPON3': '0.750', 'weapon2': '1.042', 'HITCOUNT': '1.270', 'weapon3': '1.798', 'DAMAGECOUNT': '5.583', 'FRAGCOUNT': '13.000'} [2023-02-24 19:07:11,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13721.6, 300 sec: 13787.6). Total num frames: 87265280. Throughput: 0: 3435.9. Samples: 21814484. Policy #0 lag: (min: 0.0, avg: 1.0, max: 2.0) [2023-02-24 19:07:11,376][177119] Avg episode reward: [(0, '17.347')] [2023-02-24 19:07:11,825][177158] DAMAGECOUNT value on done: 285735.0 [2023-02-24 19:07:11,825][177158] Sum rewards: 18.588, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.048', 'AMMO2': '0.012', 'AMMO5': '0.021', 'WEAPON1': '0.040', 'AMMO4': '0.057', 'AMMO3': '0.105', 'WEAPON4': '0.150', 'weapon5': '0.192', 'ARMOR': '0.400', 'WEAPON5': '0.550', 'weapon4': '0.602', 'WEAPON3': '0.700', 'weapon2': '0.842', 'HITCOUNT': '1.290', 'weapon3': '1.790', 'DAMAGECOUNT': '5.385', 'FRAGCOUNT': '15.000'} [2023-02-24 19:07:12,127][177158] DAMAGECOUNT value on done: 285401.0 [2023-02-24 19:07:12,127][177158] Sum rewards: 18.569, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.235', 'AMMO2': '0.011', 'AMMO5': '0.023', 'AMMO4': '0.055', 'AMMO3': '0.141', 'WEAPON4': '0.200', 'weapon4': '0.202', 'weapon5': '0.442', 'WEAPON5': '0.450', 'weapon2': '0.574', 'WEAPON3': '0.850', 'HITCOUNT': '1.510', 'weapon3': '2.442', 'DAMAGECOUNT': '5.904', 'FRAGCOUNT': '15.000'} [2023-02-24 19:07:12,648][177153] Updated weights for policy 0, policy_version 21310 (0.0008) [2023-02-24 19:07:14,808][177172] DAMAGECOUNT value on done: 278525.0 [2023-02-24 19:07:14,808][177172] Sum rewards: 11.758, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.600', 'AMMO2': '0.012', 'AMMO5': '0.016', 'weapon7': '0.046', 'AMMO4': '0.059', 'AMMO3': '0.101', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.620', 'WEAPON3': '0.700', 'HITCOUNT': '0.780', 'weapon2': '0.792', 'weapon3': '1.260', 'DAMAGECOUNT': '3.018', 'FRAGCOUNT': '13.000'} [2023-02-24 19:07:15,112][177172] DAMAGECOUNT value on done: 275983.0 [2023-02-24 19:07:15,112][177172] Sum rewards: 18.893, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.126', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.181', 'weapon5': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.412', 'weapon2': '0.608', 'WEAPON3': '1.100', 'HITCOUNT': '1.500', 'weapon3': '2.460', 'DAMAGECOUNT': '6.042', 'FRAGCOUNT': '19.000'} [2023-02-24 19:07:15,629][177153] Updated weights for policy 0, policy_version 21320 (0.0008) [2023-02-24 19:07:16,261][177154] DAMAGECOUNT value on done: 284504.0 [2023-02-24 19:07:16,262][177154] Sum rewards: 15.148, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.915', 'AMMO5': '0.024', 'AMMO2': '0.033', 'AMMO3': '0.122', 'AMMO4': '0.166', 'WEAPON4': '0.300', 'weapon5': '0.318', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'weapon4': '0.570', 'WEAPON3': '0.700', 'weapon2': '1.046', 'HITCOUNT': '1.100', 'weapon3': '1.564', 'DAMAGECOUNT': '4.470', 'FRAGCOUNT': '13.000'} [2023-02-24 19:07:16,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13789.8, 300 sec: 13801.4). Total num frames: 87334912. Throughput: 0: 3436.0. Samples: 21835148. Policy #0 lag: (min: 0.0, avg: 1.0, max: 2.0) [2023-02-24 19:07:16,376][177119] Avg episode reward: [(0, '17.310')] [2023-02-24 19:07:16,563][177154] DAMAGECOUNT value on done: 289641.0 [2023-02-24 19:07:16,563][177154] Sum rewards: 16.824, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.847', 'AMMO2': '0.015', 'AMMO5': '0.015', 'weapon7': '0.052', 'AMMO4': '0.073', 'AMMO3': '0.099', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon5': '0.362', 'WEAPON5': '0.400', 'weapon4': '0.504', 'WEAPON3': '0.650', 'weapon2': '0.852', 'HITCOUNT': '0.980', 'weapon3': '1.370', 'DAMAGECOUNT': '5.559', 'FRAGCOUNT': '15.000'} [2023-02-24 19:07:16,591][177172] DAMAGECOUNT value on done: 289053.0 [2023-02-24 19:07:16,591][177172] Sum rewards: 15.368, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.297', 'AMMO2': '0.004', 'AMMO5': '0.008', 'AMMO4': '0.022', 'ARMOR': '0.030', 'weapon7': '0.052', 'AMMO3': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.146', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON4': '0.350', 'WEAPON3': '0.750', 'weapon4': '0.960', 'HITCOUNT': '1.260', 'weapon3': '1.890', 'DAMAGECOUNT': '4.854', 'FRAGCOUNT': '12.000'} [2023-02-24 19:07:16,849][177154] DAMAGECOUNT value on done: 292894.0 [2023-02-24 19:07:16,850][177154] Sum rewards: 19.215, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.510', 'weapon7': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.107', 'AMMO4': '0.125', 'WEAPON4': '0.300', 'weapon5': '0.326', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'weapon4': '0.772', 'weapon2': '0.940', 'HITCOUNT': '1.220', 'weapon3': '1.676', 'DAMAGECOUNT': '5.055', 'FRAGCOUNT': '16.000'} [2023-02-24 19:07:16,882][177172] DAMAGECOUNT value on done: 280561.0 [2023-02-24 19:07:16,883][177172] Sum rewards: 28.003, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.992', 'AMMO5': '0.020', 'AMMO2': '0.057', 'AMMO3': '0.148', 'weapon5': '0.240', 'AMMO4': '0.283', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon2': '0.732', 'WEAPON3': '0.900', 'weapon4': '1.016', 'weapon3': '1.672', 'HITCOUNT': '1.820', 'DAMAGECOUNT': '7.857', 'FRAGCOUNT': '24.000'} [2023-02-24 19:07:17,157][177154] DAMAGECOUNT value on done: 288844.0 [2023-02-24 19:07:17,158][177154] Sum rewards: 19.689, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.807', 'ARMOR': '0.004', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'AMMO3': '0.121', 'AMMO4': '0.135', 'WEAPON4': '0.200', 'weapon5': '0.216', 'WEAPON5': '0.400', 'weapon2': '0.704', 'weapon4': '0.714', 'WEAPON3': '0.800', 'HITCOUNT': '1.670', 'weapon3': '2.030', 'DAMAGECOUNT': '5.937', 'FRAGCOUNT': '15.000'} [2023-02-24 19:07:17,445][177157] DAMAGECOUNT value on done: 290543.0 [2023-02-24 19:07:17,446][177157] Sum rewards: 13.208, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.434', 'WEAPON1': '0.010', 'AMMO5': '0.026', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.184', 'weapon4': '0.212', 'weapon5': '0.294', 'WEAPON4': '0.300', 'weapon2': '0.610', 'WEAPON5': '0.650', 'HITCOUNT': '1.050', 'WEAPON3': '1.100', 'weapon3': '2.516', 'DAMAGECOUNT': '5.022', 'FRAGCOUNT': '14.500'} [2023-02-24 19:07:17,736][177171] DAMAGECOUNT value on done: 277364.0 [2023-02-24 19:07:17,736][177171] Sum rewards: 18.967, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.380', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO5': '0.017', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.143', 'weapon4': '0.252', 'weapon5': '0.334', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'weapon2': '1.184', 'HITCOUNT': '1.300', 'weapon3': '1.744', 'DAMAGECOUNT': '5.928', 'FRAGCOUNT': '17.000'} [2023-02-24 19:07:17,745][177157] DAMAGECOUNT value on done: 276884.0 [2023-02-24 19:07:17,746][177157] Sum rewards: 17.983, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.441', 'AMMO2': '0.005', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.025', 'weapon4': '0.064', 'WEAPON4': '0.100', 'weapon5': '0.198', 'AMMO3': '0.216', 'WEAPON5': '0.500', 'weapon2': '0.592', 'WEAPON3': '1.450', 'HITCOUNT': '1.570', 'weapon3': '2.640', 'DAMAGECOUNT': '7.275', 'FRAGCOUNT': '20.000'} [2023-02-24 19:07:17,747][177171] DAMAGECOUNT value on done: 277575.0 [2023-02-24 19:07:17,748][177171] Sum rewards: 23.098, reward structure: {'DEATHCOUNT': '-4.500', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO5': '0.017', 'AMMO3': '0.070', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'weapon4': '0.250', 'WEAPON5': '0.300', 'weapon5': '0.326', 'WEAPON3': '0.400', 'HEALTH': '0.512', 'HITCOUNT': '0.980', 'weapon2': '1.200', 'weapon3': '1.202', 'DAMAGECOUNT': '6.138', 'FRAGCOUNT': '16.000'} [2023-02-24 19:07:17,755][177157] DAMAGECOUNT value on done: 273615.0 [2023-02-24 19:07:17,756][177157] Sum rewards: 15.011, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.677', 'AMMO2': '0.013', 'AMMO5': '0.019', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'weapon5': '0.242', 'weapon4': '0.434', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'weapon2': '0.948', 'HITCOUNT': '1.010', 'weapon3': '1.936', 'DAMAGECOUNT': '4.407', 'FRAGCOUNT': '12.000'} [2023-02-24 19:07:18,047][177171] DAMAGECOUNT value on done: 280062.0 [2023-02-24 19:07:18,047][177171] Sum rewards: 13.025, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.210', 'AMMO2': '0.005', 'AMMO5': '0.020', 'AMMO4': '0.026', 'WEAPON4': '0.100', 'AMMO3': '0.126', 'ARMOR': '0.400', 'weapon4': '0.424', 'weapon5': '0.448', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'HITCOUNT': '0.850', 'weapon2': '0.906', 'weapon3': '1.924', 'DAMAGECOUNT': '4.605', 'FRAGCOUNT': '12.000'} [2023-02-24 19:07:18,056][177157] DAMAGECOUNT value on done: 276614.0 [2023-02-24 19:07:18,056][177157] Sum rewards: 16.322, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.280', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.020', 'AMMO3': '0.097', 'WEAPON4': '0.200', 'weapon5': '0.242', 'WEAPON5': '0.550', 'weapon4': '0.572', 'weapon2': '0.578', 'WEAPON3': '0.700', 'HITCOUNT': '1.040', 'weapon3': '1.472', 'DAMAGECOUNT': '4.410', 'FRAGCOUNT': '13.000'} [2023-02-24 19:07:18,060][177171] DAMAGECOUNT value on done: 283519.0 [2023-02-24 19:07:18,060][177171] Sum rewards: 20.859, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.670', 'AMMO5': '0.027', 'AMMO2': '0.030', 'AMMO3': '0.085', 'AMMO4': '0.148', 'weapon5': '0.384', 'ARMOR': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.576', 'WEAPON3': '0.600', 'WEAPON5': '0.600', 'weapon4': '0.678', 'HITCOUNT': '1.250', 'weapon3': '1.654', 'DAMAGECOUNT': '5.547', 'FRAGCOUNT': '19.000'} [2023-02-24 19:07:18,601][177153] Updated weights for policy 0, policy_version 21330 (0.0008) [2023-02-24 19:07:19,811][177155] DAMAGECOUNT value on done: 286626.0 [2023-02-24 19:07:19,811][177155] Sum rewards: 23.329, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.720', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.060', 'AMMO4': '0.066', 'weapon7': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.644', 'WEAPON3': '0.850', 'weapon2': '1.122', 'HITCOUNT': '1.710', 'weapon3': '1.764', 'DAMAGECOUNT': '6.924', 'FRAGCOUNT': '21.000'} [2023-02-24 19:07:20,110][177155] DAMAGECOUNT value on done: 292720.0 [2023-02-24 19:07:20,110][177155] Sum rewards: 14.291, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.595', 'AMMO4': '-0.061', 'AMMO2': '-0.012', 'AMMO5': '0.019', 'AMMO3': '0.114', 'WEAPON4': '0.200', 'weapon5': '0.358', 'weapon4': '0.480', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'HITCOUNT': '1.210', 'weapon2': '1.284', 'weapon3': '1.576', 'DAMAGECOUNT': '5.118', 'FRAGCOUNT': '12.000'} [2023-02-24 19:07:20,404][177155] DAMAGECOUNT value on done: 291199.0 [2023-02-24 19:07:20,404][177155] Sum rewards: 18.119, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.466', 'ARMOR': '0.004', 'AMMO2': '0.011', 'AMMO5': '0.019', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'weapon4': '0.064', 'AMMO3': '0.201', 'weapon5': '0.214', 'WEAPON5': '0.450', 'weapon2': '0.784', 'WEAPON3': '1.250', 'HITCOUNT': '1.380', 'weapon3': '2.368', 'DAMAGECOUNT': '5.982', 'FRAGCOUNT': '18.000'} [2023-02-24 19:07:20,715][177155] DAMAGECOUNT value on done: 274498.0 [2023-02-24 19:07:20,715][177155] Sum rewards: 19.025, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.396', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'weapon5': '0.120', 'AMMO4': '0.124', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon4': '0.450', 'weapon2': '0.902', 'WEAPON3': '1.100', 'HITCOUNT': '1.510', 'weapon3': '2.298', 'DAMAGECOUNT': '6.351', 'FRAGCOUNT': '17.000'} [2023-02-24 19:07:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13801.4). Total num frames: 87404544. Throughput: 0: 3438.3. Samples: 21845504. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 19:07:21,376][177119] Avg episode reward: [(0, '17.494')] [2023-02-24 19:07:21,575][177153] Updated weights for policy 0, policy_version 21340 (0.0008) [2023-02-24 19:07:24,539][177153] Updated weights for policy 0, policy_version 21350 (0.0009) [2023-02-24 19:07:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13801.4). Total num frames: 87474176. Throughput: 0: 3441.1. Samples: 21866218. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 19:07:26,376][177119] Avg episode reward: [(0, '17.494')] [2023-02-24 19:07:27,498][177153] Updated weights for policy 0, policy_version 21360 (0.0008) [2023-02-24 19:07:28,294][177170] DAMAGECOUNT value on done: 283707.0 [2023-02-24 19:07:28,294][177170] Sum rewards: 16.340, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.595', 'AMMO5': '0.019', 'AMMO2': '0.020', 'AMMO4': '0.097', 'AMMO3': '0.141', 'WEAPON4': '0.200', 'weapon4': '0.200', 'weapon5': '0.270', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'weapon2': '1.116', 'HITCOUNT': '1.310', 'weapon3': '2.008', 'DAMAGECOUNT': '6.804', 'FRAGCOUNT': '14.000'} [2023-02-24 19:07:28,598][177170] DAMAGECOUNT value on done: 288521.0 [2023-02-24 19:07:28,599][177170] Sum rewards: 21.354, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.794', 'AMMO5': '0.021', 'AMMO2': '0.021', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.104', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'weapon5': '0.216', 'weapon4': '0.420', 'weapon2': '0.462', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'HITCOUNT': '1.380', 'weapon3': '1.812', 'DAMAGECOUNT': '6.057', 'FRAGCOUNT': '18.000'} [2023-02-24 19:07:29,117][177156] DAMAGECOUNT value on done: 284183.0 [2023-02-24 19:07:29,118][177156] Sum rewards: 26.176, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.495', 'AMMO2': '0.008', 'AMMO5': '0.010', 'weapon4': '0.020', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'AMMO3': '0.097', 'weapon5': '0.218', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '1.570', 'weapon2': '1.654', 'weapon3': '1.680', 'DAMAGECOUNT': '6.123', 'FRAGCOUNT': '21.000'} [2023-02-24 19:07:29,129][177156] DAMAGECOUNT value on done: 278275.0 [2023-02-24 19:07:29,130][177156] Sum rewards: 17.089, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.309', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.108', 'weapon4': '0.166', 'WEAPON4': '0.200', 'weapon5': '0.288', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '1.080', 'weapon2': '1.170', 'weapon3': '1.826', 'DAMAGECOUNT': '4.551', 'FRAGCOUNT': '15.000'} [2023-02-24 19:07:29,203][177170] DAMAGECOUNT value on done: 280553.0 [2023-02-24 19:07:29,203][177170] Sum rewards: 38.981, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.600', 'AMMO5': '0.009', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.078', 'AMMO3': '0.135', 'weapon5': '0.156', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.280', 'weapon2': '0.852', 'WEAPON3': '0.950', 'HITCOUNT': '2.310', 'weapon3': '2.384', 'DAMAGECOUNT': '9.891', 'FRAGCOUNT': '32.000'} [2023-02-24 19:07:29,426][177156] DAMAGECOUNT value on done: 290582.0 [2023-02-24 19:07:29,426][177156] Sum rewards: 21.083, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.412', 'AMMO2': '0.013', 'AMMO5': '0.015', 'AMMO4': '0.062', 'AMMO3': '0.070', 'WEAPON4': '0.200', 'weapon5': '0.324', 'weapon4': '0.368', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.930', 'weapon3': '1.238', 'weapon2': '1.332', 'DAMAGECOUNT': '5.643', 'FRAGCOUNT': '16.000'} [2023-02-24 19:07:29,437][177156] DAMAGECOUNT value on done: 280043.0 [2023-02-24 19:07:29,437][177156] Sum rewards: 23.309, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.490', 'AMMO2': '0.008', 'AMMO5': '0.027', 'AMMO4': '0.039', 'weapon7': '0.132', 'AMMO3': '0.144', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'weapon5': '0.342', 'weapon4': '0.394', 'WEAPON7': '0.400', 'WEAPON5': '0.750', 'weapon2': '0.884', 'WEAPON3': '0.900', 'HITCOUNT': '1.260', 'weapon3': '1.820', 'DAMAGECOUNT': '6.669', 'FRAGCOUNT': '21.000'} [2023-02-24 19:07:29,496][177170] DAMAGECOUNT value on done: 284808.0 [2023-02-24 19:07:29,496][177170] Sum rewards: 15.254, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.105', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.045', 'WEAPON5': '0.050', 'weapon7': '0.050', 'AMMO3': '0.051', 'weapon5': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.178', 'WEAPON3': '0.350', 'weapon2': '0.540', 'HITCOUNT': '0.860', 'weapon3': '1.302', 'DAMAGECOUNT': '3.429', 'FRAGCOUNT': '11.000'} [2023-02-24 19:07:30,375][177158] DAMAGECOUNT value on done: 276768.0 [2023-02-24 19:07:30,376][177158] Sum rewards: 26.639, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.384', 'AMMO2': '0.018', 'AMMO5': '0.027', 'WEAPON1': '0.030', 'AMMO4': '0.088', 'AMMO3': '0.134', 'weapon5': '0.314', 'WEAPON4': '0.550', 'weapon2': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '0.850', 'ARMOR': '0.853', 'weapon4': '0.984', 'HITCOUNT': '1.410', 'weapon3': '1.732', 'DAMAGECOUNT': '8.583', 'FRAGCOUNT': '22.000'} [2023-02-24 19:07:30,492][177153] Updated weights for policy 0, policy_version 21370 (0.0008) [2023-02-24 19:07:30,678][177158] DAMAGECOUNT value on done: 277495.0 [2023-02-24 19:07:30,679][177158] Sum rewards: 13.474, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.007', 'AMMO2': '0.044', 'AMMO3': '0.062', 'weapon7': '0.110', 'weapon5': '0.146', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'AMMO4': '0.220', 'WEAPON3': '0.400', 'HEALTH': '0.524', 'weapon4': '0.626', 'HITCOUNT': '0.670', 'weapon2': '1.104', 'weapon3': '1.232', 'DAMAGECOUNT': '3.828', 'FRAGCOUNT': '11.000'} [2023-02-24 19:07:31,276][177158] DAMAGECOUNT value on done: 287090.0 [2023-02-24 19:07:31,277][177158] Sum rewards: 11.315, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.300', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.011', 'weapon5': '0.042', 'weapon7': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'WEAPON7': '0.400', 'weapon4': '0.518', 'weapon2': '0.638', 'WEAPON3': '1.000', 'HITCOUNT': '1.070', 'weapon3': '1.454', 'DAMAGECOUNT': '4.065', 'FRAGCOUNT': '13.000'} [2023-02-24 19:07:31,376][177119] Fps is (10 sec: 13516.9, 60 sec: 13721.6, 300 sec: 13787.6). Total num frames: 87539712. Throughput: 0: 3439.8. Samples: 21886832. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 19:07:31,376][177119] Avg episode reward: [(0, '18.095')] [2023-02-24 19:07:31,399][177140] Saving new best policy, reward=18.095! [2023-02-24 19:07:31,597][177158] DAMAGECOUNT value on done: 287747.0 [2023-02-24 19:07:31,598][177158] Sum rewards: 25.228, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.928', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO5': '0.017', 'AMMO4': '0.064', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'weapon5': '0.224', 'weapon4': '0.390', 'WEAPON5': '0.400', 'weapon2': '0.450', 'WEAPON3': '0.850', 'HITCOUNT': '1.690', 'weapon3': '2.228', 'DAMAGECOUNT': '7.038', 'FRAGCOUNT': '20.000'} [2023-02-24 19:07:33,482][177153] Updated weights for policy 0, policy_version 21380 (0.0009) [2023-02-24 19:07:34,290][177172] DAMAGECOUNT value on done: 280736.0 [2023-02-24 19:07:34,291][177172] Sum rewards: 22.689, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.267', 'AMMO5': '0.017', 'AMMO2': '0.028', 'AMMO4': '0.142', 'AMMO3': '0.154', 'weapon5': '0.256', 'WEAPON4': '0.300', 'ARMOR': '0.453', 'weapon4': '0.462', 'WEAPON5': '0.500', 'weapon2': '0.908', 'WEAPON3': '0.950', 'HITCOUNT': '1.530', 'weapon3': '2.122', 'DAMAGECOUNT': '6.633', 'FRAGCOUNT': '20.000'} [2023-02-24 19:07:34,592][177172] DAMAGECOUNT value on done: 278625.0 [2023-02-24 19:07:34,592][177172] Sum rewards: 28.076, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.942', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.149', 'WEAPON4': '0.250', 'weapon4': '0.388', 'weapon5': '0.412', 'WEAPON5': '0.650', 'WEAPON3': '0.900', 'weapon2': '1.212', 'HITCOUNT': '1.340', 'weapon3': '1.628', 'DAMAGECOUNT': '7.902', 'FRAGCOUNT': '23.000'} [2023-02-24 19:07:35,782][177154] DAMAGECOUNT value on done: 285730.0 [2023-02-24 19:07:35,783][177154] Sum rewards: 7.908, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.977', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.111', 'WEAPON4': '0.200', 'weapon4': '0.322', 'weapon5': '0.322', 'ARMOR': '0.404', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'HITCOUNT': '0.850', 'weapon2': '0.998', 'weapon3': '1.892', 'DAMAGECOUNT': '3.678', 'FRAGCOUNT': '7.000'} [2023-02-24 19:07:36,073][177172] DAMAGECOUNT value on done: 290839.0 [2023-02-24 19:07:36,074][177172] Sum rewards: 19.000, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.775', 'AMMO5': '0.012', 'AMMO2': '0.025', 'WEAPON4': '0.100', 'AMMO4': '0.123', 'weapon5': '0.144', 'AMMO3': '0.145', 'weapon4': '0.188', 'WEAPON5': '0.250', 'ARMOR': '0.452', 'WEAPON3': '0.850', 'weapon2': '0.868', 'HITCOUNT': '1.200', 'weapon3': '2.060', 'DAMAGECOUNT': '5.358', 'FRAGCOUNT': '17.000'} [2023-02-24 19:07:36,081][177154] DAMAGECOUNT value on done: 291523.0 [2023-02-24 19:07:36,082][177154] Sum rewards: 21.763, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.494', 'AMMO5': '0.006', 'AMMO2': '0.020', 'ARMOR': '0.028', 'weapon5': '0.088', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'WEAPON4': '0.250', 'weapon4': '0.524', 'weapon2': '0.808', 'WEAPON3': '1.150', 'HITCOUNT': '1.560', 'weapon3': '2.258', 'DAMAGECOUNT': '5.646', 'FRAGCOUNT': '22.000'} [2023-02-24 19:07:36,365][177154] DAMAGECOUNT value on done: 295131.0 [2023-02-24 19:07:36,366][177154] Sum rewards: 20.782, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.980', 'AMMO2': '0.013', 'AMMO5': '0.020', 'AMMO4': '0.064', 'AMMO3': '0.125', 'WEAPON4': '0.200', 'weapon4': '0.204', 'weapon5': '0.440', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'weapon2': '0.974', 'HITCOUNT': '1.280', 'weapon3': '2.080', 'DAMAGECOUNT': '6.711', 'FRAGCOUNT': '18.000'} [2023-02-24 19:07:36,367][177172] DAMAGECOUNT value on done: 282202.0 [2023-02-24 19:07:36,367][177172] Sum rewards: 21.254, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.538', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'AMMO3': '0.086', 'weapon5': '0.100', 'weapon7': '0.104', 'WEAPON5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.600', 'weapon2': '1.088', 'HITCOUNT': '1.140', 'weapon3': '1.742', 'DAMAGECOUNT': '4.923', 'FRAGCOUNT': '16.000'} [2023-02-24 19:07:36,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13721.6, 300 sec: 13787.6). Total num frames: 87609344. Throughput: 0: 3438.0. Samples: 21897096. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 19:07:36,376][177119] Avg episode reward: [(0, '18.155')] [2023-02-24 19:07:36,379][177140] Saving new best policy, reward=18.155! [2023-02-24 19:07:36,489][177153] Updated weights for policy 0, policy_version 21390 (0.0008) [2023-02-24 19:07:36,672][177154] DAMAGECOUNT value on done: 291096.0 [2023-02-24 19:07:36,672][177154] Sum rewards: 21.077, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.446', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.130', 'weapon5': '0.172', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'ARMOR': '0.500', 'weapon4': '0.654', 'weapon2': '0.784', 'WEAPON3': '0.900', 'HITCOUNT': '1.530', 'weapon3': '2.064', 'DAMAGECOUNT': '6.756', 'FRAGCOUNT': '17.000'} [2023-02-24 19:07:36,968][177157] DAMAGECOUNT value on done: 292704.0 [2023-02-24 19:07:36,969][177157] Sum rewards: 18.466, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.124', 'AMMO5': '0.020', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.181', 'weapon5': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.592', 'weapon4': '0.598', 'WEAPON3': '1.000', 'HITCOUNT': '1.570', 'weapon3': '2.002', 'DAMAGECOUNT': '6.483', 'FRAGCOUNT': '18.000'} [2023-02-24 19:07:37,265][177157] DAMAGECOUNT value on done: 278208.0 [2023-02-24 19:07:37,265][177157] Sum rewards: 12.139, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon7': '0.052', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.126', 'WEAPON7': '0.200', 'AMMO4': '0.211', 'WEAPON4': '0.250', 'HEALTH': '0.251', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'weapon4': '0.736', 'weapon2': '0.998', 'HITCOUNT': '1.050', 'weapon3': '1.544', 'DAMAGECOUNT': '3.972', 'FRAGCOUNT': '11.000'} [2023-02-24 19:07:37,276][177157] DAMAGECOUNT value on done: 275812.0 [2023-02-24 19:07:37,276][177157] Sum rewards: 25.443, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.770', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon7': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.121', 'weapon5': '0.182', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.465', 'weapon4': '0.616', 'WEAPON3': '0.750', 'weapon2': '1.054', 'weapon3': '1.438', 'HITCOUNT': '1.630', 'DAMAGECOUNT': '6.591', 'FRAGCOUNT': '20.000'} [2023-02-24 19:07:37,278][177171] DAMAGECOUNT value on done: 280001.0 [2023-02-24 19:07:37,278][177171] Sum rewards: 29.324, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.360', 'WEAPON1': '0.010', 'AMMO5': '0.025', 'AMMO2': '0.026', 'weapon5': '0.098', 'AMMO3': '0.111', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'weapon4': '0.230', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'weapon2': '1.202', 'HITCOUNT': '1.810', 'weapon3': '2.332', 'DAMAGECOUNT': '7.911', 'FRAGCOUNT': '22.500'} [2023-02-24 19:07:37,289][177171] DAMAGECOUNT value on done: 279897.0 [2023-02-24 19:07:37,290][177171] Sum rewards: 22.859, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.460', 'AMMO5': '0.020', 'AMMO2': '0.040', 'AMMO3': '0.169', 'AMMO4': '0.202', 'weapon5': '0.344', 'weapon4': '0.396', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon2': '0.898', 'WEAPON3': '1.000', 'HITCOUNT': '1.810', 'weapon3': '1.924', 'DAMAGECOUNT': '6.966', 'FRAGCOUNT': '20.000'} [2023-02-24 19:07:37,573][177157] DAMAGECOUNT value on done: 278494.0 [2023-02-24 19:07:37,574][177157] Sum rewards: 20.979, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.084', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon5': '0.094', 'AMMO4': '0.102', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.332', 'WEAPON3': '0.650', 'weapon2': '1.058', 'HITCOUNT': '1.290', 'weapon3': '1.948', 'DAMAGECOUNT': '5.640', 'FRAGCOUNT': '17.000'} [2023-02-24 19:07:37,588][177171] DAMAGECOUNT value on done: 282419.0 [2023-02-24 19:07:37,588][177171] Sum rewards: 22.295, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.213', 'AMMO5': '0.022', 'AMMO2': '0.024', 'WEAPON1': '0.060', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'weapon5': '0.204', 'ARMOR': '0.400', 'weapon2': '0.468', 'WEAPON5': '0.500', 'weapon4': '0.604', 'WEAPON3': '1.000', 'HITCOUNT': '1.660', 'weapon3': '2.300', 'DAMAGECOUNT': '7.071', 'FRAGCOUNT': '19.000'} [2023-02-24 19:07:37,599][177171] DAMAGECOUNT value on done: 285584.0 [2023-02-24 19:07:37,600][177171] Sum rewards: 26.916, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.310', 'AMMO5': '0.015', 'AMMO2': '0.016', 'weapon7': '0.052', 'AMMO4': '0.082', 'AMMO3': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.218', 'WEAPON5': '0.350', 'weapon4': '0.428', 'weapon2': '0.580', 'WEAPON3': '0.600', 'HITCOUNT': '1.370', 'weapon3': '1.788', 'DAMAGECOUNT': '6.195', 'FRAGCOUNT': '21.000'} [2023-02-24 19:07:39,337][177155] DAMAGECOUNT value on done: 289054.0 [2023-02-24 19:07:39,337][177155] Sum rewards: 19.621, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.014', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.140', 'HEALTH': '0.155', 'WEAPON4': '0.200', 'weapon5': '0.206', 'weapon4': '0.272', 'WEAPON5': '0.300', 'WEAPON3': '0.800', 'weapon2': '0.806', 'HITCOUNT': '1.630', 'weapon3': '2.442', 'DAMAGECOUNT': '7.284', 'FRAGCOUNT': '15.000'} [2023-02-24 19:07:39,440][177153] Updated weights for policy 0, policy_version 21400 (0.0008) [2023-02-24 19:07:39,635][177155] DAMAGECOUNT value on done: 294151.0 [2023-02-24 19:07:39,635][177155] Sum rewards: 13.080, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.573', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon7': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.107', 'WEAPON4': '0.200', 'weapon5': '0.200', 'AMMO6': '0.320', 'AMMO7': '0.320', 'weapon4': '0.334', 'WEAPON7': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.970', 'weapon2': '1.160', 'weapon3': '1.716', 'DAMAGECOUNT': '4.293', 'FRAGCOUNT': '11.000'} [2023-02-24 19:07:39,942][177155] DAMAGECOUNT value on done: 292833.0 [2023-02-24 19:07:39,943][177155] Sum rewards: 13.589, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.952', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.049', 'AMMO3': '0.067', 'weapon5': '0.226', 'AMMO4': '0.243', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.500', 'weapon2': '0.670', 'weapon4': '0.870', 'HITCOUNT': '1.160', 'weapon3': '1.470', 'DAMAGECOUNT': '4.902', 'FRAGCOUNT': '11.000'} [2023-02-24 19:07:39,980][177154] Large shaping reward 2.514 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.492, 164.0), ('weapon5', 0.002)] [2023-02-24 19:07:40,247][177155] DAMAGECOUNT value on done: 276290.0 [2023-02-24 19:07:40,247][177155] Sum rewards: 19.526, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.112', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO3': '0.127', 'AMMO4': '0.144', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.264', 'weapon4': '0.508', 'WEAPON3': '0.700', 'weapon2': '1.152', 'HITCOUNT': '1.400', 'weapon3': '1.728', 'DAMAGECOUNT': '5.376', 'FRAGCOUNT': '16.000'} [2023-02-24 19:07:41,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13789.8, 300 sec: 13787.6). Total num frames: 87678976. Throughput: 0: 3437.4. Samples: 21917714. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 19:07:41,377][177119] Avg episode reward: [(0, '18.676')] [2023-02-24 19:07:41,377][177140] Saving new best policy, reward=18.676! [2023-02-24 19:07:42,423][177153] Updated weights for policy 0, policy_version 21410 (0.0008) [2023-02-24 19:07:45,379][177153] Updated weights for policy 0, policy_version 21420 (0.0008) [2023-02-24 19:07:46,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.8, 300 sec: 13787.6). Total num frames: 87748608. Throughput: 0: 3439.4. Samples: 21938340. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 19:07:46,376][177119] Avg episode reward: [(0, '18.676')] [2023-02-24 19:07:47,682][177156] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-24 19:07:47,844][177170] DAMAGECOUNT value on done: 285061.0 [2023-02-24 19:07:47,845][177170] Sum rewards: 15.512, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.770', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.094', 'AMMO3': '0.121', 'weapon5': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.408', 'WEAPON3': '0.800', 'weapon2': '0.990', 'HITCOUNT': '1.030', 'weapon3': '1.974', 'DAMAGECOUNT': '4.062', 'FRAGCOUNT': '15.000'} [2023-02-24 19:07:48,147][177170] DAMAGECOUNT value on done: 290766.0 [2023-02-24 19:07:48,148][177170] Sum rewards: 25.002, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.213', 'AMMO2': '0.005', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.024', 'AMMO3': '0.113', 'WEAPON4': '0.200', 'weapon5': '0.284', 'weapon4': '0.378', 'WEAPON5': '0.450', 'ARMOR': '0.453', 'weapon2': '0.582', 'WEAPON3': '0.850', 'HITCOUNT': '1.300', 'weapon3': '2.308', 'DAMAGECOUNT': '6.735', 'FRAGCOUNT': '20.000'} [2023-02-24 19:07:48,388][177153] Updated weights for policy 0, policy_version 21430 (0.0008) [2023-02-24 19:07:48,618][177156] DAMAGECOUNT value on done: 285912.0 [2023-02-24 19:07:48,618][177156] Sum rewards: 19.419, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'weapon7': '0.068', 'AMMO4': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.115', 'weapon5': '0.170', 'weapon4': '0.240', 'WEAPON5': '0.250', 'HEALTH': '0.524', 'WEAPON3': '0.650', 'weapon2': '0.828', 'HITCOUNT': '1.150', 'weapon3': '2.036', 'DAMAGECOUNT': '5.187', 'FRAGCOUNT': '16.000'} [2023-02-24 19:07:48,629][177156] DAMAGECOUNT value on done: 280168.0 [2023-02-24 19:07:48,629][177156] Sum rewards: 23.361, reward structure: {'DEATHCOUNT': '-5.250', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.029', 'weapon7': '0.072', 'AMMO3': '0.080', 'HEALTH': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.136', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.500', 'weapon4': '0.672', 'weapon2': '0.888', 'HITCOUNT': '1.210', 'weapon3': '1.436', 'DAMAGECOUNT': '5.679', 'FRAGCOUNT': '17.000'} [2023-02-24 19:07:48,776][177170] DAMAGECOUNT value on done: 282077.0 [2023-02-24 19:07:48,776][177170] Sum rewards: 13.616, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.902', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO3': '0.114', 'AMMO4': '0.121', 'WEAPON4': '0.200', 'weapon5': '0.224', 'WEAPON5': '0.350', 'weapon4': '0.444', 'WEAPON3': '0.750', 'weapon2': '0.902', 'HITCOUNT': '0.910', 'weapon3': '1.884', 'DAMAGECOUNT': '4.572', 'FRAGCOUNT': '13.000'} [2023-02-24 19:07:48,926][177156] DAMAGECOUNT value on done: 292247.0 [2023-02-24 19:07:48,926][177156] Sum rewards: 14.515, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.924', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.085', 'weapon5': '0.128', 'AMMO3': '0.170', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.346', 'weapon2': '0.800', 'WEAPON3': '1.050', 'HITCOUNT': '1.090', 'weapon3': '2.468', 'DAMAGECOUNT': '4.995', 'FRAGCOUNT': '16.000'} [2023-02-24 19:07:48,939][177156] DAMAGECOUNT value on done: 281922.0 [2023-02-24 19:07:48,940][177156] Sum rewards: 21.389, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.360', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.074', 'AMMO3': '0.103', 'AMMO4': '0.104', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.524', 'WEAPON3': '0.650', 'weapon2': '1.084', 'HITCOUNT': '1.370', 'weapon3': '1.976', 'DAMAGECOUNT': '5.583', 'FRAGCOUNT': '19.000'} [2023-02-24 19:07:49,080][177170] DAMAGECOUNT value on done: 286917.0 [2023-02-24 19:07:49,080][177170] Sum rewards: 24.519, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.874', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.114', 'weapon5': '0.368', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'weapon2': '1.174', 'HITCOUNT': '1.500', 'weapon3': '2.112', 'DAMAGECOUNT': '6.327', 'FRAGCOUNT': '20.000'} [2023-02-24 19:07:49,965][177158] DAMAGECOUNT value on done: 277873.0 [2023-02-24 19:07:49,966][177158] Sum rewards: 10.249, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.270', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon7': '0.052', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.322', 'weapon2': '0.488', 'WEAPON3': '0.600', 'HITCOUNT': '0.850', 'weapon3': '1.128', 'DAMAGECOUNT': '3.315', 'FRAGCOUNT': '9.000'} [2023-02-24 19:07:50,267][177158] DAMAGECOUNT value on done: 279545.0 [2023-02-24 19:07:50,267][177158] Sum rewards: 20.920, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.170', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.144', 'WEAPON4': '0.300', 'weapon4': '0.378', 'WEAPON3': '1.000', 'weapon2': '1.050', 'HITCOUNT': '1.630', 'weapon3': '2.328', 'DAMAGECOUNT': '6.150', 'FRAGCOUNT': '19.000'} [2023-02-24 19:07:50,861][177158] DAMAGECOUNT value on done: 289035.0 [2023-02-24 19:07:50,862][177158] Sum rewards: 17.180, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.720', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO2': '0.025', 'AMMO4': '0.126', 'AMMO3': '0.137', 'weapon5': '0.256', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.632', 'WEAPON3': '0.800', 'weapon2': '0.886', 'HITCOUNT': '1.300', 'weapon3': '1.908', 'DAMAGECOUNT': '5.835', 'FRAGCOUNT': '17.000'} [2023-02-24 19:07:51,162][177158] DAMAGECOUNT value on done: 289629.0 [2023-02-24 19:07:51,163][177158] Sum rewards: 14.912, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.550', 'AMMO5': '0.012', 'weapon7': '0.034', 'AMMO2': '0.037', 'weapon5': '0.086', 'AMMO3': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO4': '0.183', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.534', 'weapon2': '0.812', 'WEAPON3': '0.900', 'HITCOUNT': '1.410', 'weapon3': '1.788', 'DAMAGECOUNT': '5.646', 'FRAGCOUNT': '15.000'} [2023-02-24 19:07:51,356][177153] Updated weights for policy 0, policy_version 21440 (0.0008) [2023-02-24 19:07:51,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13789.9, 300 sec: 13801.4). Total num frames: 87818240. Throughput: 0: 3438.2. Samples: 21948602. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 19:07:51,376][177119] Avg episode reward: [(0, '18.721')] [2023-02-24 19:07:51,376][177140] Saving new best policy, reward=18.721! [2023-02-24 19:07:53,867][177172] DAMAGECOUNT value on done: 282212.0 [2023-02-24 19:07:53,868][177172] Sum rewards: 17.645, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'AMMO2': '0.025', 'AMMO3': '0.078', 'weapon7': '0.098', 'WEAPON5': '0.100', 'HEALTH': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.122', 'weapon5': '0.162', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'WEAPON3': '0.500', 'weapon4': '0.516', 'weapon2': '1.168', 'HITCOUNT': '1.200', 'weapon3': '1.574', 'DAMAGECOUNT': '4.338', 'FRAGCOUNT': '13.000'} [2023-02-24 19:07:54,174][177172] DAMAGECOUNT value on done: 280056.0 [2023-02-24 19:07:54,174][177172] Sum rewards: 11.640, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.242', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.069', 'AMMO3': '0.130', 'WEAPON4': '0.250', 'weapon5': '0.296', 'WEAPON5': '0.350', 'weapon4': '0.452', 'HITCOUNT': '0.810', 'WEAPON3': '0.900', 'weapon2': '0.926', 'weapon3': '1.882', 'DAMAGECOUNT': '4.293', 'FRAGCOUNT': '11.000'} [2023-02-24 19:07:54,341][177153] Updated weights for policy 0, policy_version 21450 (0.0008) [2023-02-24 19:07:55,385][177154] DAMAGECOUNT value on done: 287491.0 [2023-02-24 19:07:55,385][177154] Sum rewards: 18.256, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.455', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'weapon7': '0.054', 'AMMO3': '0.085', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.226', 'weapon4': '0.276', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'weapon2': '0.916', 'HITCOUNT': '1.060', 'weapon3': '1.896', 'DAMAGECOUNT': '4.863', 'FRAGCOUNT': '14.000'} [2023-02-24 19:07:55,686][177172] DAMAGECOUNT value on done: 292916.0 [2023-02-24 19:07:55,686][177172] Sum rewards: 20.718, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.370', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.350', 'weapon5': '0.362', 'weapon2': '0.364', 'weapon4': '0.634', 'WEAPON3': '0.850', 'HITCOUNT': '1.660', 'weapon3': '2.168', 'DAMAGECOUNT': '6.231', 'FRAGCOUNT': '17.000'} [2023-02-24 19:07:55,692][177154] DAMAGECOUNT value on done: 294093.0 [2023-02-24 19:07:55,692][177154] Sum rewards: 25.061, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.670', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO4': '0.072', 'AMMO3': '0.148', 'WEAPON4': '0.200', 'weapon4': '0.246', 'weapon5': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.678', 'WEAPON3': '0.850', 'HITCOUNT': '1.430', 'weapon3': '2.192', 'DAMAGECOUNT': '7.710', 'FRAGCOUNT': '21.000'} [2023-02-24 19:07:55,989][177154] DAMAGECOUNT value on done: 296811.0 [2023-02-24 19:07:55,990][177154] Sum rewards: 19.929, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.074', 'AMMO5': '0.014', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.099', 'WEAPON4': '0.200', 'weapon5': '0.212', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'weapon4': '0.726', 'weapon2': '1.170', 'HITCOUNT': '1.310', 'weapon3': '1.526', 'DAMAGECOUNT': '5.040', 'FRAGCOUNT': '17.000'} [2023-02-24 19:07:55,990][177172] DAMAGECOUNT value on done: 284286.0 [2023-02-24 19:07:55,990][177172] Sum rewards: 23.524, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.843', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.108', 'AMMO4': '0.114', 'weapon5': '0.168', 'weapon2': '0.266', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '0.700', 'weapon4': '0.890', 'HITCOUNT': '1.370', 'weapon3': '1.944', 'DAMAGECOUNT': '6.252', 'FRAGCOUNT': '20.000'} [2023-02-24 19:07:56,300][177154] DAMAGECOUNT value on done: 292836.0 [2023-02-24 19:07:56,301][177154] Sum rewards: 21.279, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.122', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.104', 'weapon5': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.244', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'weapon2': '0.854', 'HITCOUNT': '1.200', 'weapon3': '1.808', 'DAMAGECOUNT': '5.220', 'FRAGCOUNT': '19.000'} [2023-02-24 19:07:56,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13721.6, 300 sec: 13787.6). Total num frames: 87883776. Throughput: 0: 3438.7. Samples: 21969226. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 19:07:56,376][177119] Avg episode reward: [(0, '18.659')] [2023-02-24 19:07:56,546][177157] DAMAGECOUNT value on done: 294555.0 [2023-02-24 19:07:56,547][177157] Sum rewards: 14.277, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.578', 'AMMO5': '0.016', 'AMMO2': '0.020', 'AMMO4': '0.102', 'AMMO3': '0.133', 'weapon5': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon4': '0.614', 'WEAPON3': '0.800', 'weapon2': '1.000', 'HITCOUNT': '1.260', 'weapon3': '1.864', 'DAMAGECOUNT': '5.553', 'FRAGCOUNT': '14.000'} [2023-02-24 19:07:56,842][177157] DAMAGECOUNT value on done: 277509.0 [2023-02-24 19:07:56,842][177157] Sum rewards: 15.932, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.543', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO3': '0.124', 'AMMO4': '0.168', 'weapon5': '0.296', 'WEAPON5': '0.350', 'ARMOR': '0.453', 'WEAPON4': '0.550', 'WEAPON3': '0.750', 'weapon4': '0.812', 'weapon2': '0.868', 'HITCOUNT': '1.160', 'weapon3': '1.554', 'DAMAGECOUNT': '5.091', 'FRAGCOUNT': '15.000'} [2023-02-24 19:07:56,855][177157] DAMAGECOUNT value on done: 280157.0 [2023-02-24 19:07:56,856][177157] Sum rewards: 19.998, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.675', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.012', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'weapon5': '0.142', 'weapon4': '0.222', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'weapon2': '0.972', 'HITCOUNT': '1.310', 'weapon3': '2.172', 'DAMAGECOUNT': '5.847', 'FRAGCOUNT': '17.000'} [2023-02-24 19:07:56,864][177171] DAMAGECOUNT value on done: 281892.0 [2023-02-24 19:07:56,864][177171] Sum rewards: 18.656, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.930', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO3': '0.084', 'AMMO4': '0.155', 'weapon4': '0.180', 'WEAPON4': '0.200', 'weapon5': '0.220', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'weapon2': '1.088', 'HITCOUNT': '1.270', 'weapon3': '2.020', 'DAMAGECOUNT': '5.673', 'FRAGCOUNT': '16.000'} [2023-02-24 19:07:56,876][177171] DAMAGECOUNT value on done: 281655.0 [2023-02-24 19:07:56,876][177171] Sum rewards: 19.210, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.015', 'AMMO2': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.089', 'weapon4': '0.110', 'AMMO4': '0.150', 'HEALTH': '0.309', 'WEAPON5': '0.350', 'weapon5': '0.470', 'WEAPON3': '0.500', 'HITCOUNT': '1.030', 'weapon2': '1.390', 'weapon3': '1.692', 'DAMAGECOUNT': '5.274', 'FRAGCOUNT': '13.000'} [2023-02-24 19:07:57,160][177157] DAMAGECOUNT value on done: 279762.0 [2023-02-24 19:07:57,160][177157] Sum rewards: 12.536, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.096', 'AMMO5': '0.014', 'AMMO2': '0.016', 'ARMOR': '0.020', 'weapon7': '0.048', 'AMMO4': '0.081', 'AMMO3': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.200', 'weapon5': '0.206', 'WEAPON4': '0.300', 'weapon4': '0.450', 'weapon2': '0.518', 'WEAPON3': '0.550', 'HITCOUNT': '0.930', 'weapon3': '1.100', 'DAMAGECOUNT': '3.804', 'FRAGCOUNT': '11.000'} [2023-02-24 19:07:57,175][177171] DAMAGECOUNT value on done: 283494.0 [2023-02-24 19:07:57,175][177171] Sum rewards: 12.492, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.064', 'AMMO5': '0.015', 'AMMO2': '0.016', 'AMMO3': '0.050', 'weapon7': '0.054', 'AMMO4': '0.079', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.338', 'WEAPON3': '0.400', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.700', 'ARMOR': '0.841', 'HITCOUNT': '0.910', 'weapon2': '0.938', 'weapon3': '1.450', 'DAMAGECOUNT': '3.225', 'FRAGCOUNT': '10.000'} [2023-02-24 19:07:57,186][177171] DAMAGECOUNT value on done: 287639.0 [2023-02-24 19:07:57,186][177171] Sum rewards: 20.842, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.882', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.070', 'AMMO3': '0.138', 'WEAPON5': '0.150', 'AMMO4': '0.206', 'WEAPON4': '0.450', 'weapon4': '0.808', 'WEAPON3': '0.850', 'weapon2': '0.960', 'weapon3': '1.628', 'HITCOUNT': '1.750', 'DAMAGECOUNT': '6.165', 'FRAGCOUNT': '19.000'} [2023-02-24 19:07:57,298][177153] Updated weights for policy 0, policy_version 21460 (0.0008) [2023-02-24 19:07:58,963][177155] DAMAGECOUNT value on done: 291905.0 [2023-02-24 19:07:58,963][177155] Sum rewards: 27.678, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.545', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.010', 'weapon7': '0.060', 'AMMO3': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.162', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.448', 'WEAPON3': '0.850', 'weapon2': '0.936', 'HITCOUNT': '1.610', 'weapon3': '1.976', 'DAMAGECOUNT': '8.553', 'FRAGCOUNT': '21.000'} [2023-02-24 19:07:59,266][177155] DAMAGECOUNT value on done: 296137.0 [2023-02-24 19:07:59,266][177155] Sum rewards: 19.673, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.588', 'AMMO5': '0.011', 'AMMO2': '0.037', 'AMMO3': '0.124', 'AMMO4': '0.184', 'weapon5': '0.218', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.500', 'WEAPON3': '0.800', 'weapon2': '0.934', 'HITCOUNT': '1.380', 'weapon3': '1.864', 'DAMAGECOUNT': '5.958', 'FRAGCOUNT': '19.000'} [2023-02-24 19:07:59,565][177155] DAMAGECOUNT value on done: 294622.0 [2023-02-24 19:07:59,565][177155] Sum rewards: 15.774, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.382', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.145', 'weapon5': '0.242', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'weapon2': '0.882', 'HITCOUNT': '1.030', 'weapon3': '2.050', 'DAMAGECOUNT': '5.367', 'FRAGCOUNT': '12.000'} [2023-02-24 19:07:59,866][177155] DAMAGECOUNT value on done: 278202.0 [2023-02-24 19:07:59,867][177155] Sum rewards: 15.889, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.849', 'AMMO5': '0.015', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.140', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon4': '0.246', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon2': '0.870', 'WEAPON3': '1.100', 'HITCOUNT': '1.250', 'weapon3': '2.412', 'DAMAGECOUNT': '5.736', 'FRAGCOUNT': '16.000'} [2023-02-24 19:08:00,273][177153] Updated weights for policy 0, policy_version 21470 (0.0008) [2023-02-24 19:08:01,376][177119] Fps is (10 sec: 13516.7, 60 sec: 13721.6, 300 sec: 13787.6). Total num frames: 87953408. Throughput: 0: 3436.2. Samples: 21989776. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:08:01,376][177119] Avg episode reward: [(0, '18.936')] [2023-02-24 19:08:01,377][177140] Saving new best policy, reward=18.936! [2023-02-24 19:08:03,253][177153] Updated weights for policy 0, policy_version 21480 (0.0009) [2023-02-24 19:08:06,246][177153] Updated weights for policy 0, policy_version 21490 (0.0008) [2023-02-24 19:08:06,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13789.9, 300 sec: 13787.6). Total num frames: 88023040. Throughput: 0: 3434.0. Samples: 22000032. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:08:06,376][177119] Avg episode reward: [(0, '18.936')] [2023-02-24 19:08:07,389][177170] DAMAGECOUNT value on done: 287317.0 [2023-02-24 19:08:07,390][177170] Sum rewards: 22.207, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.228', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.127', 'weapon5': '0.174', 'weapon2': '0.188', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '0.850', 'weapon4': '0.956', 'HITCOUNT': '1.660', 'weapon3': '1.886', 'DAMAGECOUNT': '6.768', 'FRAGCOUNT': '19.000'} [2023-02-24 19:08:07,688][177170] DAMAGECOUNT value on done: 293060.0 [2023-02-24 19:08:07,688][177170] Sum rewards: 24.115, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.295', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.012', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'weapon5': '0.180', 'weapon4': '0.296', 'WEAPON5': '0.300', 'weapon2': '0.490', 'WEAPON3': '0.950', 'HITCOUNT': '1.720', 'weapon3': '2.628', 'DAMAGECOUNT': '6.882', 'FRAGCOUNT': '20.000'} [2023-02-24 19:08:08,214][177156] DAMAGECOUNT value on done: 287601.0 [2023-02-24 19:08:08,215][177156] Sum rewards: 16.991, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.120', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.034', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.171', 'AMMO3': '0.182', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon5': '0.358', 'weapon2': '0.408', 'weapon4': '0.588', 'WEAPON3': '0.950', 'HITCOUNT': '1.250', 'weapon3': '2.154', 'DAMAGECOUNT': '5.067', 'FRAGCOUNT': '17.000'} [2023-02-24 19:08:08,226][177156] DAMAGECOUNT value on done: 281433.0 [2023-02-24 19:08:08,226][177156] Sum rewards: 14.842, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.125', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO5': '0.015', 'AMMO4': '0.070', 'AMMO3': '0.106', 'WEAPON4': '0.200', 'weapon5': '0.206', 'weapon4': '0.326', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.950', 'weapon2': '1.156', 'weapon3': '1.768', 'DAMAGECOUNT': '3.795', 'FRAGCOUNT': '13.000'} [2023-02-24 19:08:08,321][177170] DAMAGECOUNT value on done: 284497.0 [2023-02-24 19:08:08,321][177170] Sum rewards: 24.888, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.870', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.040', 'weapon7': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.128', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.350', 'weapon2': '0.636', 'WEAPON3': '0.800', 'HITCOUNT': '1.710', 'weapon3': '2.038', 'DAMAGECOUNT': '7.260', 'FRAGCOUNT': '20.000'} [2023-02-24 19:08:08,523][177156] DAMAGECOUNT value on done: 294912.0 [2023-02-24 19:08:08,523][177156] Sum rewards: 28.689, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.566', 'AMMO5': '0.017', 'AMMO2': '0.036', 'AMMO3': '0.144', 'AMMO4': '0.179', 'weapon5': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.604', 'weapon2': '0.744', 'WEAPON3': '0.800', 'HITCOUNT': '1.940', 'weapon3': '2.098', 'DAMAGECOUNT': '7.995', 'FRAGCOUNT': '25.000'} [2023-02-24 19:08:08,534][177156] DAMAGECOUNT value on done: 283328.0 [2023-02-24 19:08:08,535][177156] Sum rewards: 9.266, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.173', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.124', 'weapon5': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.658', 'WEAPON3': '0.700', 'weapon4': '0.884', 'HITCOUNT': '0.990', 'weapon3': '1.536', 'DAMAGECOUNT': '4.218', 'FRAGCOUNT': '9.000'} [2023-02-24 19:08:08,619][177170] DAMAGECOUNT value on done: 288494.0 [2023-02-24 19:08:08,619][177170] Sum rewards: 20.021, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.196', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.027', 'WEAPON1': '0.030', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.116', 'weapon5': '0.256', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.890', 'weapon2': '1.034', 'weapon3': '1.982', 'DAMAGECOUNT': '4.731', 'FRAGCOUNT': '16.000'} [2023-02-24 19:08:09,234][177153] Updated weights for policy 0, policy_version 21500 (0.0008) [2023-02-24 19:08:09,560][177158] DAMAGECOUNT value on done: 280002.0 [2023-02-24 19:08:09,560][177158] Sum rewards: 22.580, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.024', 'AMMO5': '0.007', 'AMMO2': '0.036', 'WEAPON4': '0.150', 'weapon5': '0.168', 'AMMO3': '0.169', 'AMMO4': '0.180', 'WEAPON5': '0.200', 'weapon2': '0.608', 'weapon4': '0.608', 'WEAPON3': '1.000', 'HITCOUNT': '1.700', 'weapon3': '2.390', 'DAMAGECOUNT': '6.387', 'FRAGCOUNT': '19.500'} [2023-02-24 19:08:09,865][177158] DAMAGECOUNT value on done: 280938.0 [2023-02-24 19:08:09,865][177158] Sum rewards: 13.281, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.584', 'AMMO5': '0.009', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.078', 'weapon5': '0.082', 'weapon7': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.118', 'WEAPON4': '0.150', 'weapon4': '0.236', 'WEAPON5': '0.250', 'WEAPON3': '0.700', 'weapon2': '1.074', 'HITCOUNT': '1.110', 'weapon3': '1.694', 'DAMAGECOUNT': '4.179', 'FRAGCOUNT': '12.000'} [2023-02-24 19:08:10,465][177158] DAMAGECOUNT value on done: 291107.0 [2023-02-24 19:08:10,465][177158] Sum rewards: 18.158, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.028', 'AMMO2': '0.007', 'AMMO5': '0.019', 'AMMO4': '0.034', 'WEAPON4': '0.100', 'AMMO3': '0.151', 'weapon4': '0.192', 'weapon5': '0.352', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'HITCOUNT': '1.200', 'weapon2': '1.292', 'weapon3': '1.722', 'DAMAGECOUNT': '6.216', 'FRAGCOUNT': '17.000'} [2023-02-24 19:08:10,761][177158] DAMAGECOUNT value on done: 291286.0 [2023-02-24 19:08:10,761][177158] Sum rewards: 16.650, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.614', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.019', 'weapon7': '0.050', 'AMMO3': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.136', 'weapon5': '0.326', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'HITCOUNT': '1.200', 'weapon2': '1.304', 'weapon3': '1.514', 'DAMAGECOUNT': '4.971', 'FRAGCOUNT': '13.000'} [2023-02-24 19:08:11,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13789.9, 300 sec: 13787.6). Total num frames: 88092672. Throughput: 0: 3432.1. Samples: 22020664. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:08:11,376][177119] Avg episode reward: [(0, '19.150')] [2023-02-24 19:08:11,376][177140] Saving new best policy, reward=19.150! [2023-02-24 19:08:12,204][177153] Updated weights for policy 0, policy_version 21510 (0.0008) [2023-02-24 19:08:13,520][177172] DAMAGECOUNT value on done: 284316.0 [2023-02-24 19:08:13,521][177172] Sum rewards: 24.309, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.150', 'AMMO5': '0.016', 'AMMO2': '0.030', 'AMMO3': '0.138', 'AMMO4': '0.150', 'weapon5': '0.194', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'weapon4': '0.808', 'HITCOUNT': '1.570', 'weapon3': '2.244', 'DAMAGECOUNT': '6.312', 'FRAGCOUNT': '21.000'} [2023-02-24 19:08:13,825][177172] DAMAGECOUNT value on done: 282088.0 [2023-02-24 19:08:13,825][177172] Sum rewards: 16.904, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.494', 'AMMO2': '0.002', 'ARMOR': '0.004', 'AMMO4': '0.009', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'weapon5': '0.402', 'WEAPON5': '0.450', 'weapon4': '0.452', 'weapon2': '0.730', 'WEAPON3': '0.750', 'HITCOUNT': '1.390', 'weapon3': '2.050', 'DAMAGECOUNT': '6.096', 'FRAGCOUNT': '13.000'} [2023-02-24 19:08:14,455][177157] Large shaping reward 2.560 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.54, 180.0)] [2023-02-24 19:08:14,993][177154] DAMAGECOUNT value on done: 290079.0 [2023-02-24 19:08:14,994][177154] Sum rewards: 30.906, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.172', 'AMMO2': '0.009', 'AMMO5': '0.020', 'AMMO4': '0.042', 'weapon7': '0.056', 'AMMO3': '0.083', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'weapon2': '0.414', 'weapon5': '0.498', 'WEAPON3': '0.550', 'weapon4': '0.622', 'ARMOR': '0.861', 'HITCOUNT': '1.420', 'weapon3': '1.824', 'DAMAGECOUNT': '7.689', 'FRAGCOUNT': '22.000'} [2023-02-24 19:08:15,163][177153] Updated weights for policy 0, policy_version 21520 (0.0008) [2023-02-24 19:08:15,317][177154] DAMAGECOUNT value on done: 295698.0 [2023-02-24 19:08:15,318][177154] Sum rewards: 17.092, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.430', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.032', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.121', 'AMMO4': '0.161', 'WEAPON4': '0.250', 'weapon5': '0.250', 'weapon4': '0.414', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'weapon2': '0.760', 'HITCOUNT': '1.100', 'weapon3': '1.534', 'DAMAGECOUNT': '4.815', 'FRAGCOUNT': '15.000'} [2023-02-24 19:08:15,323][177172] DAMAGECOUNT value on done: 294514.0 [2023-02-24 19:08:15,324][177172] Sum rewards: 15.345, reward structure: {'DEATHCOUNT': '-9.750', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'weapon7': '0.016', 'AMMO2': '0.019', 'AMMO4': '0.094', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.135', 'WEAPON4': '0.200', 'weapon5': '0.204', 'HEALTH': '0.294', 'WEAPON5': '0.300', 'weapon2': '0.380', 'ARMOR': '0.500', 'weapon4': '0.626', 'WEAPON3': '0.750', 'HITCOUNT': '1.140', 'weapon3': '2.320', 'DAMAGECOUNT': '4.794', 'FRAGCOUNT': '13.000'} [2023-02-24 19:08:15,616][177154] DAMAGECOUNT value on done: 298618.0 [2023-02-24 19:08:15,617][177154] Sum rewards: 20.009, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.646', 'AMMO5': '0.008', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon7': '0.048', 'AMMO3': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.270', 'weapon4': '0.414', 'ARMOR': '0.447', 'weapon2': '0.564', 'WEAPON3': '0.700', 'HITCOUNT': '1.250', 'weapon3': '1.992', 'DAMAGECOUNT': '5.421', 'FRAGCOUNT': '17.000'} [2023-02-24 19:08:15,632][177172] DAMAGECOUNT value on done: 286601.0 [2023-02-24 19:08:15,633][177172] Sum rewards: 27.511, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.447', 'AMMO2': '0.021', 'AMMO5': '0.030', 'AMMO4': '0.107', 'AMMO3': '0.181', 'weapon5': '0.226', 'WEAPON4': '0.300', 'weapon4': '0.480', 'ARMOR': '0.486', 'weapon2': '0.584', 'WEAPON5': '0.600', 'WEAPON3': '1.000', 'HITCOUNT': '1.600', 'weapon3': '2.398', 'DAMAGECOUNT': '6.945', 'FRAGCOUNT': '26.000'} [2023-02-24 19:08:15,926][177154] DAMAGECOUNT value on done: 295201.0 [2023-02-24 19:08:15,927][177154] Sum rewards: 18.359, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.450', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.041', 'WEAPON1': '0.050', 'AMMO3': '0.165', 'AMMO4': '0.207', 'weapon5': '0.444', 'WEAPON4': '0.450', 'weapon4': '0.474', 'WEAPON5': '0.550', 'weapon2': '0.612', 'WEAPON3': '0.950', 'HITCOUNT': '1.440', 'weapon3': '2.058', 'DAMAGECOUNT': '7.095', 'FRAGCOUNT': '18.000'} [2023-02-24 19:08:16,152][177157] DAMAGECOUNT value on done: 296611.0 [2023-02-24 19:08:16,152][177157] Sum rewards: 22.433, reward structure: {'DEATHCOUNT': '-9.750', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.147', 'HEALTH': '0.204', 'weapon4': '0.278', 'WEAPON4': '0.300', 'weapon5': '0.376', 'WEAPON5': '0.400', 'weapon2': '0.732', 'WEAPON3': '0.800', 'HITCOUNT': '1.150', 'weapon3': '2.152', 'DAMAGECOUNT': '6.168', 'FRAGCOUNT': '19.000'} [2023-02-24 19:08:16,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13789.9, 300 sec: 13787.6). Total num frames: 88162304. Throughput: 0: 3431.4. Samples: 22041244. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:08:16,376][177119] Avg episode reward: [(0, '19.593')] [2023-02-24 19:08:16,379][177140] Saving new best policy, reward=19.593! [2023-02-24 19:08:16,427][177171] DAMAGECOUNT value on done: 283841.0 [2023-02-24 19:08:16,428][177171] Sum rewards: 17.362, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.685', 'AMMO2': '0.007', 'AMMO5': '0.009', 'AMMO4': '0.035', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'weapon5': '0.196', 'weapon4': '0.288', 'WEAPON5': '0.300', 'weapon2': '0.932', 'WEAPON3': '1.200', 'HITCOUNT': '1.640', 'weapon3': '2.216', 'DAMAGECOUNT': '5.847', 'FRAGCOUNT': '18.000'} [2023-02-24 19:08:16,440][177171] DAMAGECOUNT value on done: 283930.0 [2023-02-24 19:08:16,440][177171] Sum rewards: 18.096, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.356', 'AMMO5': '0.027', 'AMMO2': '0.029', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.134', 'AMMO4': '0.143', 'WEAPON4': '0.300', 'weapon5': '0.348', 'WEAPON5': '0.600', 'weapon2': '0.776', 'weapon4': '0.854', 'WEAPON3': '0.900', 'HITCOUNT': '1.700', 'weapon3': '1.766', 'DAMAGECOUNT': '6.825', 'FRAGCOUNT': '16.000'} [2023-02-24 19:08:16,469][177157] DAMAGECOUNT value on done: 280265.0 [2023-02-24 19:08:16,470][177157] Sum rewards: 30.737, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.919', 'AMMO2': '0.005', 'AMMO5': '0.020', 'AMMO4': '0.027', 'WEAPON4': '0.100', 'AMMO3': '0.167', 'weapon4': '0.322', 'weapon5': '0.382', 'weapon2': '0.436', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '1.870', 'weapon3': '2.504', 'DAMAGECOUNT': '8.223', 'FRAGCOUNT': '26.000'} [2023-02-24 19:08:16,483][177157] DAMAGECOUNT value on done: 281804.0 [2023-02-24 19:08:16,483][177157] Sum rewards: 12.164, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.475', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.112', 'weapon5': '0.182', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.424', 'ARMOR': '0.453', 'WEAPON3': '0.750', 'weapon2': '1.090', 'HITCOUNT': '1.140', 'weapon3': '1.854', 'DAMAGECOUNT': '4.941', 'FRAGCOUNT': '11.000'} [2023-02-24 19:08:16,744][177171] DAMAGECOUNT value on done: 285419.0 [2023-02-24 19:08:16,745][177171] Sum rewards: 20.309, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.380', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.030', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.149', 'AMMO3': '0.154', 'weapon5': '0.164', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.672', 'weapon4': '0.860', 'WEAPON3': '0.950', 'HITCOUNT': '1.580', 'weapon3': '1.924', 'DAMAGECOUNT': '5.775', 'FRAGCOUNT': '18.000'} [2023-02-24 19:08:16,756][177171] DAMAGECOUNT value on done: 288950.0 [2023-02-24 19:08:16,757][177171] Sum rewards: 11.980, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.500', 'AMMO5': '0.016', 'AMMO2': '0.031', 'AMMO3': '0.060', 'weapon7': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'weapon5': '0.404', 'weapon4': '0.410', 'WEAPON3': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.570', 'HITCOUNT': '0.810', 'weapon3': '1.628', 'DAMAGECOUNT': '3.933', 'FRAGCOUNT': '9.000'} [2023-02-24 19:08:16,792][177157] DAMAGECOUNT value on done: 280943.0 [2023-02-24 19:08:16,793][177157] Sum rewards: 13.925, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.830', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'AMMO3': '0.071', 'WEAPON4': '0.100', 'weapon4': '0.102', 'WEAPON5': '0.250', 'weapon5': '0.264', 'WEAPON3': '0.500', 'weapon2': '0.986', 'HITCOUNT': '1.020', 'weapon3': '1.420', 'DAMAGECOUNT': '3.543', 'FRAGCOUNT': '11.000'} [2023-02-24 19:08:18,184][177153] Updated weights for policy 0, policy_version 21530 (0.0008) [2023-02-24 19:08:18,570][177155] DAMAGECOUNT value on done: 293730.0 [2023-02-24 19:08:18,571][177155] Sum rewards: 21.392, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.006', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.029', 'AMMO3': '0.119', 'AMMO4': '0.143', 'weapon5': '0.188', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.440', 'WEAPON3': '0.750', 'weapon2': '1.042', 'HITCOUNT': '1.210', 'weapon3': '1.882', 'DAMAGECOUNT': '5.475', 'FRAGCOUNT': '18.000'} [2023-02-24 19:08:18,873][177155] DAMAGECOUNT value on done: 297865.0 [2023-02-24 19:08:18,874][177155] Sum rewards: 18.092, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.420', 'AMMO4': '-0.069', 'AMMO2': '-0.014', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO3': '0.043', 'weapon7': '0.050', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.260', 'weapon5': '0.316', 'WEAPON3': '0.400', 'WEAPON5': '0.500', 'HITCOUNT': '0.720', 'weapon3': '1.114', 'weapon2': '1.178', 'DAMAGECOUNT': '5.184', 'FRAGCOUNT': '13.000'} [2023-02-24 19:08:19,178][177155] DAMAGECOUNT value on done: 297053.0 [2023-02-24 19:08:19,179][177155] Sum rewards: 27.803, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.270', 'AMMO2': '0.011', 'AMMO5': '0.015', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO3': '0.134', 'weapon5': '0.340', 'WEAPON5': '0.400', 'weapon2': '0.728', 'WEAPON3': '0.850', 'HITCOUNT': '1.760', 'weapon3': '2.534', 'DAMAGECOUNT': '7.293', 'FRAGCOUNT': '22.000'} [2023-02-24 19:08:19,489][177155] DAMAGECOUNT value on done: 279468.0 [2023-02-24 19:08:19,489][177155] Sum rewards: 9.258, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.940', 'AMMO2': '0.015', 'AMMO5': '0.017', 'weapon7': '0.046', 'AMMO4': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'weapon4': '0.330', 'weapon5': '0.392', 'WEAPON5': '0.450', 'HITCOUNT': '0.800', 'WEAPON3': '0.900', 'weapon2': '1.104', 'weapon3': '1.684', 'DAMAGECOUNT': '3.798', 'FRAGCOUNT': '10.000'} [2023-02-24 19:08:21,128][177153] Updated weights for policy 0, policy_version 21540 (0.0008) [2023-02-24 19:08:21,376][177119] Fps is (10 sec: 13516.3, 60 sec: 13721.5, 300 sec: 13787.5). Total num frames: 88227840. Throughput: 0: 3430.7. Samples: 22051480. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:08:21,377][177119] Avg episode reward: [(0, '19.551')] [2023-02-24 19:08:24,078][177153] Updated weights for policy 0, policy_version 21550 (0.0008) [2023-02-24 19:08:25,100][177157] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 19:08:26,376][177119] Fps is (10 sec: 13516.6, 60 sec: 13721.6, 300 sec: 13787.6). Total num frames: 88297472. Throughput: 0: 3433.4. Samples: 22072218. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:08:26,376][177119] Avg episode reward: [(0, '19.551')] [2023-02-24 19:08:26,896][177170] DAMAGECOUNT value on done: 290276.0 [2023-02-24 19:08:26,896][177170] Sum rewards: 31.265, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.580', 'AMMO2': '0.011', 'AMMO5': '0.020', 'AMMO4': '0.057', 'AMMO3': '0.174', 'weapon5': '0.224', 'WEAPON4': '0.250', 'weapon4': '0.412', 'WEAPON5': '0.450', 'weapon2': '0.600', 'WEAPON3': '1.050', 'HITCOUNT': '2.060', 'weapon3': '2.410', 'DAMAGECOUNT': '8.877', 'FRAGCOUNT': '28.000'} [2023-02-24 19:08:27,056][177153] Updated weights for policy 0, policy_version 21560 (0.0008) [2023-02-24 19:08:27,197][177170] DAMAGECOUNT value on done: 294239.0 [2023-02-24 19:08:27,198][177170] Sum rewards: 10.814, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.690', 'AMMO2': '0.016', 'AMMO5': '0.017', 'AMMO3': '0.040', 'weapon7': '0.048', 'AMMO4': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.284', 'WEAPON3': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.556', 'weapon4': '0.612', 'HITCOUNT': '0.650', 'weapon3': '0.880', 'DAMAGECOUNT': '3.528', 'FRAGCOUNT': '7.000'} [2023-02-24 19:08:27,750][177156] DAMAGECOUNT value on done: 288420.0 [2023-02-24 19:08:27,750][177156] Sum rewards: 11.164, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.708', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon7': '0.046', 'AMMO3': '0.063', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.173', 'WEAPON4': '0.200', 'weapon5': '0.278', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.630', 'weapon4': '0.718', 'weapon2': '0.814', 'weapon3': '1.246', 'DAMAGECOUNT': '2.457', 'FRAGCOUNT': '9.000'} [2023-02-24 19:08:27,761][177156] DAMAGECOUNT value on done: 283204.0 [2023-02-24 19:08:27,762][177156] Sum rewards: 14.286, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.766', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.055', 'weapon7': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.142', 'weapon5': '0.166', 'WEAPON5': '0.250', 'weapon4': '0.280', 'weapon2': '0.832', 'WEAPON3': '0.950', 'HITCOUNT': '1.230', 'weapon3': '2.146', 'DAMAGECOUNT': '5.313', 'FRAGCOUNT': '14.000'} [2023-02-24 19:08:27,833][177170] DAMAGECOUNT value on done: 286361.0 [2023-02-24 19:08:27,834][177170] Sum rewards: 17.359, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon7': '0.040', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.143', 'AMMO3': '0.161', 'weapon5': '0.274', 'HEALTH': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.850', 'weapon4': '0.864', 'weapon2': '0.910', 'HITCOUNT': '1.360', 'weapon3': '1.642', 'DAMAGECOUNT': '5.592', 'FRAGCOUNT': '15.500'} [2023-02-24 19:08:28,053][177156] DAMAGECOUNT value on done: 296986.0 [2023-02-24 19:08:28,054][177156] Sum rewards: 19.044, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.980', 'AMMO5': '0.011', 'AMMO2': '0.017', 'weapon7': '0.072', 'AMMO4': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.144', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon5': '0.326', 'WEAPON5': '0.350', 'weapon4': '0.352', 'weapon2': '0.992', 'WEAPON3': '1.000', 'HITCOUNT': '1.520', 'weapon3': '1.944', 'DAMAGECOUNT': '6.222', 'FRAGCOUNT': '18.000'} [2023-02-24 19:08:28,065][177156] DAMAGECOUNT value on done: 285906.0 [2023-02-24 19:08:28,065][177156] Sum rewards: 24.219, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.952', 'AMMO5': '0.017', 'AMMO2': '0.045', 'AMMO3': '0.147', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.223', 'weapon2': '0.402', 'ARMOR': '0.460', 'WEAPON4': '0.500', 'weapon5': '0.526', 'WEAPON5': '0.550', 'weapon4': '0.786', 'WEAPON3': '0.900', 'HITCOUNT': '1.430', 'weapon3': '1.916', 'DAMAGECOUNT': '7.668', 'FRAGCOUNT': '21.000'} [2023-02-24 19:08:28,138][177170] DAMAGECOUNT value on done: 290274.0 [2023-02-24 19:08:28,139][177170] Sum rewards: 21.622, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.315', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.086', 'weapon5': '0.276', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '1.130', 'weapon2': '1.510', 'weapon3': '1.770', 'DAMAGECOUNT': '5.340', 'FRAGCOUNT': '17.000'} [2023-02-24 19:08:29,040][177158] DAMAGECOUNT value on done: 282448.0 [2023-02-24 19:08:29,040][177158] Sum rewards: 22.004, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.274', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.023', 'AMMO2': '0.041', 'AMMO4': '0.204', 'AMMO3': '0.212', 'weapon5': '0.270', 'WEAPON4': '0.350', 'weapon4': '0.356', 'WEAPON5': '0.550', 'weapon2': '0.776', 'WEAPON3': '1.250', 'HITCOUNT': '1.540', 'weapon3': '2.104', 'DAMAGECOUNT': '7.338', 'FRAGCOUNT': '22.000'} [2023-02-24 19:08:29,340][177158] DAMAGECOUNT value on done: 282008.0 [2023-02-24 19:08:29,341][177158] Sum rewards: 9.687, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.250', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.046', 'AMMO3': '0.112', 'weapon7': '0.118', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'weapon2': '0.182', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.960', 'weapon3': '0.980', 'weapon4': '1.142', 'DAMAGECOUNT': '3.210', 'FRAGCOUNT': '11.000'} [2023-02-24 19:08:29,939][177158] DAMAGECOUNT value on done: 293069.0 [2023-02-24 19:08:29,940][177158] Sum rewards: 21.415, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.548', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO5': '0.017', 'AMMO4': '0.066', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'weapon5': '0.224', 'weapon4': '0.230', 'WEAPON5': '0.400', 'weapon2': '0.820', 'WEAPON3': '0.900', 'HITCOUNT': '1.410', 'weapon3': '1.938', 'DAMAGECOUNT': '5.886', 'FRAGCOUNT': '19.000'} [2023-02-24 19:08:30,026][177153] Updated weights for policy 0, policy_version 21570 (0.0008) [2023-02-24 19:08:30,242][177158] DAMAGECOUNT value on done: 292909.0 [2023-02-24 19:08:30,243][177158] Sum rewards: 18.025, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.039', 'AMMO2': '0.009', 'AMMO5': '0.012', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.084', 'weapon7': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.162', 'WEAPON5': '0.300', 'weapon5': '0.332', 'WEAPON3': '0.450', 'HITCOUNT': '1.000', 'weapon2': '1.016', 'weapon3': '1.844', 'DAMAGECOUNT': '4.866', 'FRAGCOUNT': '12.000'} [2023-02-24 19:08:31,376][177119] Fps is (10 sec: 13926.8, 60 sec: 13789.9, 300 sec: 13787.6). Total num frames: 88367104. Throughput: 0: 3434.4. Samples: 22092888. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:08:31,376][177119] Avg episode reward: [(0, '19.216')] [2023-02-24 19:08:33,002][177153] Updated weights for policy 0, policy_version 21580 (0.0008) [2023-02-24 19:08:33,094][177172] DAMAGECOUNT value on done: 286100.0 [2023-02-24 19:08:33,095][177172] Sum rewards: 19.901, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.300', 'AMMO2': '0.013', 'AMMO5': '0.015', 'AMMO4': '0.065', 'AMMO3': '0.099', 'WEAPON4': '0.200', 'weapon5': '0.334', 'WEAPON5': '0.400', 'ARMOR': '0.441', 'weapon4': '0.524', 'WEAPON3': '0.600', 'weapon2': '0.722', 'HITCOUNT': '1.020', 'weapon3': '2.166', 'DAMAGECOUNT': '5.352', 'FRAGCOUNT': '15.000'} [2023-02-24 19:08:33,399][177172] DAMAGECOUNT value on done: 283357.0 [2023-02-24 19:08:33,399][177172] Sum rewards: 6.793, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.440', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon7': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.116', 'AMMO4': '0.259', 'WEAPON5': '0.350', 'weapon5': '0.428', 'weapon4': '0.580', 'WEAPON4': '0.600', 'WEAPON3': '0.650', 'HITCOUNT': '0.800', 'weapon2': '0.940', 'weapon3': '1.510', 'DAMAGECOUNT': '3.807', 'FRAGCOUNT': '10.500'} [2023-02-24 19:08:34,581][177154] DAMAGECOUNT value on done: 291451.0 [2023-02-24 19:08:34,582][177154] Sum rewards: 12.086, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.930', 'AMMO2': '0.007', 'AMMO5': '0.017', 'AMMO4': '0.034', 'weapon7': '0.046', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.129', 'weapon5': '0.196', 'WEAPON5': '0.450', 'weapon2': '0.840', 'WEAPON3': '0.850', 'HITCOUNT': '0.920', 'weapon3': '2.110', 'DAMAGECOUNT': '4.116', 'FRAGCOUNT': '10.500'} [2023-02-24 19:08:34,887][177154] DAMAGECOUNT value on done: 297198.0 [2023-02-24 19:08:34,888][177154] Sum rewards: 15.319, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.861', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.022', 'AMMO3': '0.129', 'weapon5': '0.366', 'WEAPON5': '0.600', 'WEAPON3': '0.850', 'HITCOUNT': '0.980', 'weapon2': '0.984', 'weapon3': '2.256', 'DAMAGECOUNT': '4.500', 'FRAGCOUNT': '13.000'} [2023-02-24 19:08:34,901][177172] DAMAGECOUNT value on done: 296781.0 [2023-02-24 19:08:34,902][177172] Sum rewards: 20.200, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.022', 'AMMO2': '0.008', 'AMMO5': '0.012', 'AMMO4': '0.041', 'AMMO3': '0.127', 'WEAPON5': '0.250', 'weapon5': '0.272', 'weapon2': '0.710', 'WEAPON3': '0.750', 'HITCOUNT': '1.470', 'weapon3': '2.780', 'DAMAGECOUNT': '6.801', 'FRAGCOUNT': '16.000'} [2023-02-24 19:08:35,179][177154] DAMAGECOUNT value on done: 300452.0 [2023-02-24 19:08:35,180][177154] Sum rewards: 17.061, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.080', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO5': '0.014', 'AMMO4': '0.042', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'weapon5': '0.212', 'WEAPON5': '0.300', 'weapon4': '0.438', 'weapon2': '0.698', 'WEAPON3': '1.000', 'HITCOUNT': '1.290', 'weapon3': '2.282', 'DAMAGECOUNT': '5.502', 'FRAGCOUNT': '16.000'} [2023-02-24 19:08:35,198][177172] DAMAGECOUNT value on done: 288733.0 [2023-02-24 19:08:35,199][177172] Sum rewards: 18.512, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.328', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon7': '0.048', 'WEAPON5': '0.050', 'weapon5': '0.078', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.146', 'AMMO3': '0.190', 'WEAPON7': '0.200', 'weapon2': '0.514', 'WEAPON3': '1.100', 'HITCOUNT': '1.470', 'weapon3': '2.274', 'DAMAGECOUNT': '6.396', 'FRAGCOUNT': '18.000'} [2023-02-24 19:08:35,476][177154] DAMAGECOUNT value on done: 297121.0 [2023-02-24 19:08:35,477][177154] Sum rewards: 19.627, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.760', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.105', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon5': '0.350', 'weapon4': '0.394', 'WEAPON3': '0.700', 'weapon2': '1.214', 'HITCOUNT': '1.400', 'weapon3': '1.524', 'DAMAGECOUNT': '5.760', 'FRAGCOUNT': '16.000'} [2023-02-24 19:08:35,697][177157] DAMAGECOUNT value on done: 298691.0 [2023-02-24 19:08:35,697][177157] Sum rewards: 13.469, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.466', 'WEAPON1': '0.010', 'AMMO2': '0.032', 'AMMO5': '0.036', 'AMMO4': '0.160', 'AMMO3': '0.211', 'weapon5': '0.300', 'weapon4': '0.340', 'WEAPON4': '0.400', 'weapon2': '0.618', 'WEAPON5': '0.700', 'WEAPON3': '1.200', 'HITCOUNT': '1.340', 'weapon3': '2.348', 'DAMAGECOUNT': '6.240', 'FRAGCOUNT': '17.000'} [2023-02-24 19:08:35,994][177171] DAMAGECOUNT value on done: 286368.0 [2023-02-24 19:08:35,994][177171] Sum rewards: 22.630, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.098', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.153', 'weapon5': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.312', 'weapon2': '0.884', 'WEAPON3': '1.000', 'HITCOUNT': '1.540', 'weapon3': '2.212', 'DAMAGECOUNT': '7.581', 'FRAGCOUNT': '20.000'} [2023-02-24 19:08:35,998][177153] Updated weights for policy 0, policy_version 21590 (0.0008) [2023-02-24 19:08:36,005][177171] DAMAGECOUNT value on done: 285620.0 [2023-02-24 19:08:36,005][177171] Sum rewards: 17.157, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.707', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon7': '0.066', 'AMMO3': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO4': '0.216', 'weapon5': '0.220', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'WEAPON4': '0.450', 'weapon4': '0.598', 'weapon2': '0.846', 'HITCOUNT': '1.020', 'weapon3': '1.554', 'DAMAGECOUNT': '5.070', 'FRAGCOUNT': '15.000'} [2023-02-24 19:08:36,011][177157] DAMAGECOUNT value on done: 282462.0 [2023-02-24 19:08:36,012][177157] Sum rewards: 19.646, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.900', 'ARMOR': '0.004', 'AMMO2': '0.025', 'AMMO5': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.136', 'weapon5': '0.214', 'WEAPON4': '0.350', 'weapon4': '0.404', 'WEAPON5': '0.550', 'weapon2': '0.564', 'WEAPON3': '0.850', 'HITCOUNT': '1.390', 'weapon3': '2.382', 'DAMAGECOUNT': '6.528', 'FRAGCOUNT': '19.000'} [2023-02-24 19:08:36,026][177157] DAMAGECOUNT value on done: 284117.0 [2023-02-24 19:08:36,026][177157] Sum rewards: 19.732, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.084', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon5': '0.154', 'weapon4': '0.172', 'AMMO4': '0.188', 'AMMO3': '0.220', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.402', 'WEAPON3': '1.350', 'HITCOUNT': '1.550', 'weapon3': '2.920', 'DAMAGECOUNT': '6.909', 'FRAGCOUNT': '23.000'} [2023-02-24 19:08:36,303][177171] DAMAGECOUNT value on done: 287070.0 [2023-02-24 19:08:36,304][177171] Sum rewards: 11.396, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.790', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.158', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'weapon2': '0.282', 'WEAPON5': '0.300', 'weapon4': '0.342', 'WEAPON3': '1.000', 'HITCOUNT': '1.380', 'weapon3': '2.952', 'DAMAGECOUNT': '4.953', 'FRAGCOUNT': '13.000'} [2023-02-24 19:08:36,313][177171] DAMAGECOUNT value on done: 290774.0 [2023-02-24 19:08:36,314][177171] Sum rewards: 19.551, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.750', 'AMMO2': '0.014', 'AMMO5': '0.023', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.190', 'weapon5': '0.524', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'weapon2': '0.826', 'HITCOUNT': '1.140', 'weapon3': '2.038', 'DAMAGECOUNT': '5.472', 'FRAGCOUNT': '17.000'} [2023-02-24 19:08:36,335][177157] DAMAGECOUNT value on done: 283242.0 [2023-02-24 19:08:36,335][177157] Sum rewards: 19.146, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.638', 'AMMO5': '0.020', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.141', 'weapon5': '0.188', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.500', 'weapon4': '0.598', 'WEAPON3': '0.900', 'HITCOUNT': '1.370', 'weapon3': '2.408', 'DAMAGECOUNT': '6.897', 'FRAGCOUNT': '18.000'} [2023-02-24 19:08:36,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13787.6). Total num frames: 88436736. Throughput: 0: 3433.9. Samples: 22103126. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:08:36,376][177119] Avg episode reward: [(0, '18.693')] [2023-02-24 19:08:36,616][177154] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 19:08:38,077][177155] DAMAGECOUNT value on done: 295234.0 [2023-02-24 19:08:38,078][177155] Sum rewards: 13.903, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.280', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.030', 'AMMO3': '0.116', 'AMMO4': '0.148', 'WEAPON4': '0.200', 'weapon5': '0.210', 'WEAPON5': '0.300', 'weapon4': '0.384', 'WEAPON3': '0.700', 'weapon2': '0.916', 'HITCOUNT': '1.010', 'weapon3': '1.882', 'DAMAGECOUNT': '4.512', 'FRAGCOUNT': '12.000'} [2023-02-24 19:08:38,374][177155] DAMAGECOUNT value on done: 300215.0 [2023-02-24 19:08:38,374][177155] Sum rewards: 26.825, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.273', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.086', 'AMMO3': '0.105', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.236', 'WEAPON4': '0.250', 'weapon5': '0.286', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'weapon2': '0.912', 'HITCOUNT': '1.450', 'weapon3': '2.096', 'DAMAGECOUNT': '7.050', 'FRAGCOUNT': '19.000'} [2023-02-24 19:08:38,678][177155] DAMAGECOUNT value on done: 299516.0 [2023-02-24 19:08:38,679][177155] Sum rewards: 28.011, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.150', 'ARMOR': '0.004', 'AMMO2': '0.012', 'AMMO5': '0.017', 'AMMO4': '0.057', 'AMMO3': '0.128', 'weapon5': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.410', 'WEAPON3': '0.800', 'weapon2': '1.004', 'HITCOUNT': '1.660', 'weapon3': '2.004', 'DAMAGECOUNT': '7.389', 'FRAGCOUNT': '24.000'} [2023-02-24 19:08:38,942][177153] Updated weights for policy 0, policy_version 21600 (0.0008) [2023-02-24 19:08:38,969][177155] DAMAGECOUNT value on done: 281647.0 [2023-02-24 19:08:38,970][177155] Sum rewards: 20.129, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.878', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.025', 'weapon5': '0.066', 'AMMO3': '0.088', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'weapon7': '0.150', 'AMMO6': '0.260', 'AMMO7': '0.260', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.600', 'weapon2': '0.658', 'weapon4': '0.682', 'weapon3': '1.434', 'HITCOUNT': '1.600', 'DAMAGECOUNT': '6.537', 'FRAGCOUNT': '16.000'} [2023-02-24 19:08:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13787.6). Total num frames: 88506368. Throughput: 0: 3436.5. Samples: 22123868. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:08:41,376][177119] Avg episode reward: [(0, '18.651')] [2023-02-24 19:08:41,914][177153] Updated weights for policy 0, policy_version 21610 (0.0008) [2023-02-24 19:08:44,882][177153] Updated weights for policy 0, policy_version 21620 (0.0008) [2023-02-24 19:08:45,739][177158] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-24 19:08:46,376][177119] Fps is (10 sec: 13516.7, 60 sec: 13721.6, 300 sec: 13773.7). Total num frames: 88571904. Throughput: 0: 3439.6. Samples: 22144558. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:08:46,376][177119] Avg episode reward: [(0, '18.651')] [2023-02-24 19:08:46,430][177170] DAMAGECOUNT value on done: 292778.0 [2023-02-24 19:08:46,431][177170] Sum rewards: 21.584, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.945', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.037', 'AMMO3': '0.160', 'AMMO4': '0.184', 'weapon5': '0.316', 'WEAPON4': '0.400', 'weapon4': '0.502', 'WEAPON5': '0.600', 'WEAPON3': '1.000', 'weapon2': '1.142', 'HITCOUNT': '1.340', 'weapon3': '1.572', 'DAMAGECOUNT': '7.494', 'FRAGCOUNT': '21.000'} [2023-02-24 19:08:46,736][177170] DAMAGECOUNT value on done: 296027.0 [2023-02-24 19:08:46,737][177170] Sum rewards: 19.478, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.170', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO3': '0.095', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'weapon4': '0.250', 'weapon5': '0.342', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'weapon2': '1.010', 'HITCOUNT': '1.170', 'weapon3': '1.958', 'DAMAGECOUNT': '5.334', 'FRAGCOUNT': '15.000'} [2023-02-24 19:08:47,298][177156] DAMAGECOUNT value on done: 291015.0 [2023-02-24 19:08:47,299][177156] Sum rewards: 24.532, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.043', 'AMMO2': '0.012', 'AMMO5': '0.017', 'AMMO4': '0.059', 'weapon4': '0.062', 'WEAPON4': '0.100', 'weapon5': '0.140', 'AMMO3': '0.150', 'WEAPON5': '0.400', 'weapon2': '0.786', 'WEAPON3': '1.100', 'HITCOUNT': '1.720', 'weapon3': '2.744', 'DAMAGECOUNT': '7.785', 'FRAGCOUNT': '22.000'} [2023-02-24 19:08:47,309][177156] DAMAGECOUNT value on done: 284576.0 [2023-02-24 19:08:47,310][177156] Sum rewards: 12.889, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.034', 'AMMO2': '0.015', 'AMMO5': '0.015', 'weapon7': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.074', 'weapon5': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.135', 'WEAPON5': '0.300', 'weapon4': '0.308', 'ARMOR': '0.400', 'WEAPON3': '0.850', 'weapon2': '0.898', 'HITCOUNT': '1.050', 'weapon3': '1.786', 'DAMAGECOUNT': '4.116', 'FRAGCOUNT': '11.000'} [2023-02-24 19:08:47,344][177170] DAMAGECOUNT value on done: 288339.0 [2023-02-24 19:08:47,345][177170] Sum rewards: 18.782, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.082', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'weapon5': '0.222', 'weapon4': '0.240', 'WEAPON5': '0.250', 'ARMOR': '0.500', 'WEAPON3': '0.700', 'HITCOUNT': '1.230', 'weapon2': '1.352', 'weapon3': '1.722', 'DAMAGECOUNT': '5.481', 'FRAGCOUNT': '15.000'} [2023-02-24 19:08:47,613][177156] DAMAGECOUNT value on done: 299014.0 [2023-02-24 19:08:47,613][177156] Sum rewards: 18.885, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.568', 'AMMO2': '0.006', 'AMMO5': '0.023', 'AMMO4': '0.029', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'weapon5': '0.298', 'weapon4': '0.352', 'WEAPON5': '0.600', 'weapon2': '0.636', 'WEAPON3': '1.000', 'HITCOUNT': '1.390', 'weapon3': '2.180', 'DAMAGECOUNT': '6.084', 'FRAGCOUNT': '18.000'} [2023-02-24 19:08:47,624][177156] DAMAGECOUNT value on done: 287479.0 [2023-02-24 19:08:47,625][177156] Sum rewards: 12.747, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.825', 'AMMO5': '0.025', 'AMMO2': '0.034', 'AMMO3': '0.129', 'AMMO4': '0.171', 'weapon5': '0.226', 'WEAPON4': '0.350', 'weapon4': '0.370', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'weapon2': '0.944', 'HITCOUNT': '1.370', 'weapon3': '2.184', 'DAMAGECOUNT': '4.719', 'FRAGCOUNT': '13.000'} [2023-02-24 19:08:47,649][177170] DAMAGECOUNT value on done: 292132.0 [2023-02-24 19:08:47,650][177170] Sum rewards: 19.320, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.534', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.022', 'AMMO3': '0.103', 'AMMO4': '0.111', 'weapon4': '0.194', 'weapon5': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'weapon2': '0.806', 'HITCOUNT': '1.130', 'weapon3': '2.026', 'DAMAGECOUNT': '5.574', 'FRAGCOUNT': '16.000'} [2023-02-24 19:08:47,904][177153] Updated weights for policy 0, policy_version 21630 (0.0008) [2023-02-24 19:08:48,593][177158] DAMAGECOUNT value on done: 284238.0 [2023-02-24 19:08:48,594][177158] Sum rewards: 22.243, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.197', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.038', 'weapon7': '0.048', 'AMMO3': '0.089', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.462', 'WEAPON3': '0.600', 'weapon4': '0.636', 'weapon2': '0.930', 'HITCOUNT': '1.400', 'weapon3': '1.938', 'DAMAGECOUNT': '5.370', 'FRAGCOUNT': '16.000'} [2023-02-24 19:08:48,894][177158] DAMAGECOUNT value on done: 283662.0 [2023-02-24 19:08:48,894][177158] Sum rewards: 10.822, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.511', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon5': '0.176', 'AMMO3': '0.185', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.574', 'weapon2': '0.662', 'WEAPON3': '1.100', 'HITCOUNT': '1.330', 'weapon3': '2.120', 'DAMAGECOUNT': '4.962', 'FRAGCOUNT': '14.000'} [2023-02-24 19:08:49,496][177158] DAMAGECOUNT value on done: 295264.0 [2023-02-24 19:08:49,496][177158] Sum rewards: 13.377, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.270', 'AMMO5': '0.015', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.182', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'weapon2': '0.344', 'WEAPON5': '0.450', 'weapon4': '0.516', 'WEAPON3': '1.300', 'HITCOUNT': '1.500', 'weapon3': '2.634', 'DAMAGECOUNT': '6.585', 'FRAGCOUNT': '16.000'} [2023-02-24 19:08:49,803][177158] DAMAGECOUNT value on done: 294622.0 [2023-02-24 19:08:49,803][177158] Sum rewards: 19.631, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.360', 'AMMO2': '0.010', 'AMMO5': '0.012', 'weapon7': '0.048', 'AMMO4': '0.048', 'AMMO3': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.192', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.455', 'weapon4': '0.480', 'WEAPON3': '0.550', 'weapon2': '0.716', 'HITCOUNT': '1.210', 'weapon3': '1.630', 'DAMAGECOUNT': '5.019', 'FRAGCOUNT': '16.000'} [2023-02-24 19:08:50,857][177153] Updated weights for policy 0, policy_version 21640 (0.0008) [2023-02-24 19:08:51,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13721.6, 300 sec: 13787.5). Total num frames: 88641536. Throughput: 0: 3440.4. Samples: 22154852. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:08:51,376][177119] Avg episode reward: [(0, '18.562')] [2023-02-24 19:08:52,564][177172] DAMAGECOUNT value on done: 287896.0 [2023-02-24 19:08:52,565][177172] Sum rewards: 21.680, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.014', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'weapon7': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.153', 'AMMO4': '0.171', 'WEAPON7': '0.200', 'weapon5': '0.222', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.654', 'weapon2': '0.860', 'WEAPON3': '0.950', 'HITCOUNT': '1.190', 'weapon3': '1.672', 'DAMAGECOUNT': '5.388', 'FRAGCOUNT': '20.000'} [2023-02-24 19:08:52,872][177172] DAMAGECOUNT value on done: 285513.0 [2023-02-24 19:08:52,873][177172] Sum rewards: 19.913, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.016', 'AMMO5': '0.017', 'AMMO2': '0.031', 'AMMO3': '0.129', 'AMMO4': '0.157', 'weapon5': '0.206', 'WEAPON5': '0.350', 'weapon4': '0.438', 'WEAPON4': '0.450', 'weapon2': '0.706', 'WEAPON3': '0.850', 'HITCOUNT': '1.500', 'weapon3': '2.126', 'DAMAGECOUNT': '6.468', 'FRAGCOUNT': '19.000'} [2023-02-24 19:08:53,800][177153] Updated weights for policy 0, policy_version 21650 (0.0008) [2023-02-24 19:08:54,024][177154] DAMAGECOUNT value on done: 293188.0 [2023-02-24 19:08:54,024][177154] Sum rewards: 20.209, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.620', 'weapon4': '0.002', 'AMMO5': '0.015', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'weapon5': '0.266', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '0.930', 'weapon3': '1.568', 'weapon2': '1.786', 'DAMAGECOUNT': '5.211', 'FRAGCOUNT': '18.000'} [2023-02-24 19:08:54,323][177154] DAMAGECOUNT value on done: 298642.0 [2023-02-24 19:08:54,324][177154] Sum rewards: 10.816, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.830', 'AMMO5': '0.014', 'AMMO2': '0.029', 'ARMOR': '0.032', 'AMMO3': '0.143', 'AMMO4': '0.147', 'weapon5': '0.186', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.414', 'weapon2': '0.762', 'WEAPON3': '0.900', 'HITCOUNT': '1.140', 'weapon3': '2.296', 'DAMAGECOUNT': '4.332', 'FRAGCOUNT': '12.000'} [2023-02-24 19:08:54,361][177172] DAMAGECOUNT value on done: 298807.0 [2023-02-24 19:08:54,361][177172] Sum rewards: 17.674, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.376', 'AMMO5': '0.019', 'weapon7': '0.048', 'AMMO2': '0.055', 'AMMO3': '0.065', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO4': '0.276', 'weapon5': '0.302', 'ARMOR': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.450', 'WEAPON4': '0.700', 'weapon4': '0.892', 'weapon2': '0.946', 'weapon3': '1.248', 'HITCOUNT': '1.290', 'DAMAGECOUNT': '5.919', 'FRAGCOUNT': '16.000'} [2023-02-24 19:08:54,613][177154] DAMAGECOUNT value on done: 302209.0 [2023-02-24 19:08:54,613][177154] Sum rewards: 19.846, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.515', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'weapon4': '0.078', 'weapon7': '0.090', 'AMMO3': '0.139', 'WEAPON5': '0.150', 'weapon5': '0.160', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'weapon2': '0.742', 'WEAPON3': '1.050', 'HITCOUNT': '1.360', 'weapon3': '2.598', 'DAMAGECOUNT': '5.271', 'FRAGCOUNT': '18.000'} [2023-02-24 19:08:54,660][177172] DAMAGECOUNT value on done: 290469.0 [2023-02-24 19:08:54,660][177172] Sum rewards: 15.492, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.112', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.025', 'weapon7': '0.054', 'AMMO3': '0.059', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.126', 'WEAPON4': '0.250', 'weapon5': '0.304', 'WEAPON3': '0.450', 'WEAPON5': '0.600', 'weapon4': '0.622', 'HITCOUNT': '1.080', 'weapon3': '1.178', 'weapon2': '1.324', 'DAMAGECOUNT': '5.208', 'FRAGCOUNT': '11.000'} [2023-02-24 19:08:54,919][177154] DAMAGECOUNT value on done: 299974.0 [2023-02-24 19:08:54,920][177154] Sum rewards: 26.095, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.096', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon7': '0.054', 'AMMO4': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.144', 'AMMO3': '0.184', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.346', 'weapon4': '0.460', 'WEAPON3': '1.100', 'HITCOUNT': '1.910', 'weapon3': '2.376', 'DAMAGECOUNT': '8.559', 'FRAGCOUNT': '23.000'} [2023-02-24 19:08:55,119][177157] DAMAGECOUNT value on done: 300437.0 [2023-02-24 19:08:55,119][177157] Sum rewards: 14.487, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.610', 'AMMO2': '0.019', 'AMMO5': '0.020', 'AMMO4': '0.094', 'AMMO3': '0.132', 'weapon4': '0.178', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.260', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'HITCOUNT': '1.040', 'weapon2': '1.234', 'weapon3': '1.782', 'DAMAGECOUNT': '5.238', 'FRAGCOUNT': '11.500'} [2023-02-24 19:08:55,406][177171] DAMAGECOUNT value on done: 288330.0 [2023-02-24 19:08:55,406][177171] Sum rewards: 16.576, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.344', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon7': '0.046', 'AMMO4': '0.053', 'weapon4': '0.068', 'WEAPON4': '0.100', 'weapon5': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'WEAPON7': '0.200', 'weapon2': '0.618', 'WEAPON3': '0.950', 'HITCOUNT': '1.480', 'weapon3': '2.828', 'DAMAGECOUNT': '5.886', 'FRAGCOUNT': '16.000'} [2023-02-24 19:08:55,416][177157] DAMAGECOUNT value on done: 284535.0 [2023-02-24 19:08:55,416][177171] DAMAGECOUNT value on done: 287232.0 [2023-02-24 19:08:55,416][177157] Sum rewards: 23.158, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.290', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.021', 'weapon4': '0.036', 'WEAPON4': '0.100', 'AMMO3': '0.149', 'weapon5': '0.270', 'WEAPON5': '0.550', 'weapon2': '0.824', 'WEAPON3': '1.000', 'HITCOUNT': '1.490', 'weapon3': '2.530', 'DAMAGECOUNT': '6.219', 'FRAGCOUNT': '21.000'} [2023-02-24 19:08:55,416][177171] Sum rewards: 11.858, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.987', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon7': '0.048', 'weapon5': '0.066', 'AMMO4': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.434', 'weapon2': '0.532', 'WEAPON3': '1.000', 'HITCOUNT': '1.470', 'weapon3': '2.262', 'DAMAGECOUNT': '4.836', 'FRAGCOUNT': '14.000'} [2023-02-24 19:08:55,428][177157] DAMAGECOUNT value on done: 286187.0 [2023-02-24 19:08:55,428][177157] Sum rewards: 27.392, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.024', 'HEALTH': '0.049', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'AMMO4': '0.120', 'weapon5': '0.188', 'WEAPON5': '0.200', 'weapon4': '0.206', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'weapon2': '1.016', 'HITCOUNT': '1.500', 'weapon3': '2.042', 'DAMAGECOUNT': '6.210', 'FRAGCOUNT': '20.000'} [2023-02-24 19:08:55,721][177171] DAMAGECOUNT value on done: 288083.0 [2023-02-24 19:08:55,721][177171] Sum rewards: 10.553, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.276', 'AMMO5': '0.022', 'AMMO2': '0.034', 'AMMO3': '0.072', 'AMMO4': '0.172', 'weapon5': '0.304', 'WEAPON4': '0.400', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.696', 'HITCOUNT': '0.810', 'weapon2': '0.836', 'weapon3': '1.614', 'DAMAGECOUNT': '3.018', 'FRAGCOUNT': '10.000'} [2023-02-24 19:08:55,732][177171] DAMAGECOUNT value on done: 291943.0 [2023-02-24 19:08:55,732][177171] Sum rewards: 9.253, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.790', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.057', 'AMMO3': '0.088', 'weapon7': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.484', 'WEAPON3': '0.550', 'weapon2': '0.704', 'HITCOUNT': '0.920', 'weapon3': '1.330', 'DAMAGECOUNT': '3.507', 'FRAGCOUNT': '7.000'} [2023-02-24 19:08:55,733][177157] DAMAGECOUNT value on done: 285707.0 [2023-02-24 19:08:55,733][177157] Sum rewards: 22.638, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.562', 'AMMO5': '0.008', 'weapon5': '0.024', 'AMMO2': '0.034', 'weapon7': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'AMMO4': '0.170', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.332', 'WEAPON4': '0.350', 'weapon2': '0.650', 'WEAPON3': '0.900', 'HITCOUNT': '1.660', 'weapon3': '2.286', 'DAMAGECOUNT': '7.395', 'FRAGCOUNT': '21.000'} [2023-02-24 19:08:56,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13787.6). Total num frames: 88711168. Throughput: 0: 3443.3. Samples: 22175614. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:08:56,376][177119] Avg episode reward: [(0, '18.537')] [2023-02-24 19:08:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000021658_88711168.pth... [2023-02-24 19:08:56,440][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000020851_85405696.pth [2023-02-24 19:08:56,794][177153] Updated weights for policy 0, policy_version 21660 (0.0008) [2023-02-24 19:08:57,537][177155] DAMAGECOUNT value on done: 297283.0 [2023-02-24 19:08:57,537][177155] Sum rewards: 13.404, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.860', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.141', 'AMMO4': '0.177', 'weapon5': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.348', 'weapon2': '0.558', 'WEAPON3': '0.950', 'HITCOUNT': '1.420', 'weapon3': '2.438', 'DAMAGECOUNT': '6.147', 'FRAGCOUNT': '13.500'} [2023-02-24 19:08:57,835][177155] DAMAGECOUNT value on done: 301969.0 [2023-02-24 19:08:57,836][177155] Sum rewards: 19.009, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.765', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.100', 'weapon4': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.184', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '1.100', 'weapon2': '1.136', 'weapon3': '1.788', 'DAMAGECOUNT': '5.262', 'FRAGCOUNT': '15.000'} [2023-02-24 19:08:58,135][177155] DAMAGECOUNT value on done: 300933.0 [2023-02-24 19:08:58,135][177155] Sum rewards: 13.748, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.990', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO5': '0.012', 'weapon7': '0.052', 'AMMO3': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.218', 'weapon4': '0.254', 'WEAPON5': '0.350', 'weapon2': '0.712', 'WEAPON3': '0.800', 'HITCOUNT': '0.910', 'weapon3': '1.968', 'DAMAGECOUNT': '4.251', 'FRAGCOUNT': '13.000'} [2023-02-24 19:08:58,437][177155] DAMAGECOUNT value on done: 284317.0 [2023-02-24 19:08:58,438][177155] Sum rewards: 25.250, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.788', 'ARMOR': '0.004', 'AMMO5': '0.036', 'AMMO2': '0.040', 'AMMO3': '0.106', 'AMMO4': '0.199', 'weapon5': '0.308', 'WEAPON4': '0.550', 'WEAPON5': '0.750', 'WEAPON3': '0.750', 'weapon4': '0.752', 'weapon2': '0.792', 'HITCOUNT': '1.560', 'weapon3': '1.680', 'DAMAGECOUNT': '8.010', 'FRAGCOUNT': '22.000'} [2023-02-24 19:08:59,746][177153] Updated weights for policy 0, policy_version 21670 (0.0009) [2023-02-24 19:09:01,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13789.9, 300 sec: 13787.5). Total num frames: 88780800. Throughput: 0: 3446.3. Samples: 22196326. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:09:01,376][177119] Avg episode reward: [(0, '18.600')] [2023-02-24 19:09:02,738][177153] Updated weights for policy 0, policy_version 21680 (0.0008) [2023-02-24 19:09:05,703][177153] Updated weights for policy 0, policy_version 21690 (0.0008) [2023-02-24 19:09:05,913][177170] DAMAGECOUNT value on done: 295100.0 [2023-02-24 19:09:05,914][177170] Sum rewards: 24.275, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.522', 'AMMO5': '0.020', 'AMMO2': '0.031', 'AMMO3': '0.145', 'AMMO4': '0.153', 'weapon4': '0.244', 'weapon5': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.500', 'weapon2': '0.572', 'WEAPON3': '0.950', 'HITCOUNT': '1.380', 'weapon3': '2.532', 'DAMAGECOUNT': '6.966', 'FRAGCOUNT': '22.000'} [2023-02-24 19:09:06,208][177170] DAMAGECOUNT value on done: 298036.0 [2023-02-24 19:09:06,208][177170] Sum rewards: 18.134, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.374', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon4': '0.158', 'weapon5': '0.172', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.702', 'WEAPON3': '1.150', 'HITCOUNT': '1.380', 'weapon3': '2.694', 'DAMAGECOUNT': '6.027', 'FRAGCOUNT': '17.000'} [2023-02-24 19:09:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.8, 300 sec: 13787.6). Total num frames: 88850432. Throughput: 0: 3448.7. Samples: 22206670. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:09:06,376][177119] Avg episode reward: [(0, '18.551')] [2023-02-24 19:09:06,816][177170] DAMAGECOUNT value on done: 289885.0 [2023-02-24 19:09:06,817][177170] Sum rewards: 13.582, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.010', 'ARMOR': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.043', 'AMMO3': '0.079', 'AMMO4': '0.214', 'weapon5': '0.318', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'WEAPON4': '0.500', 'weapon4': '0.520', 'weapon2': '0.790', 'HITCOUNT': '1.040', 'weapon3': '1.828', 'DAMAGECOUNT': '4.638', 'FRAGCOUNT': '12.000'} [2023-02-24 19:09:06,832][177156] DAMAGECOUNT value on done: 293020.0 [2023-02-24 19:09:06,832][177156] Sum rewards: 17.992, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.000', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.007', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.606', 'weapon2': '0.772', 'WEAPON3': '0.800', 'HITCOUNT': '1.500', 'weapon3': '2.062', 'DAMAGECOUNT': '6.015', 'FRAGCOUNT': '13.500'} [2023-02-24 19:09:06,845][177156] DAMAGECOUNT value on done: 286682.0 [2023-02-24 19:09:06,846][177156] Sum rewards: 13.740, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.827', 'AMMO5': '0.015', 'AMMO2': '0.059', 'weapon5': '0.106', 'AMMO3': '0.206', 'AMMO4': '0.295', 'WEAPON5': '0.400', 'weapon4': '0.506', 'WEAPON4': '0.650', 'weapon2': '0.974', 'WEAPON3': '1.250', 'HITCOUNT': '1.640', 'weapon3': '2.148', 'DAMAGECOUNT': '6.318', 'FRAGCOUNT': '18.000'} [2023-02-24 19:09:07,126][177170] DAMAGECOUNT value on done: 294509.0 [2023-02-24 19:09:07,126][177170] Sum rewards: 26.104, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.124', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.250', 'weapon4': '0.394', 'weapon2': '0.706', 'WEAPON3': '0.900', 'HITCOUNT': '1.590', 'weapon3': '2.390', 'DAMAGECOUNT': '7.131', 'FRAGCOUNT': '22.000'} [2023-02-24 19:09:07,146][177156] DAMAGECOUNT value on done: 301073.0 [2023-02-24 19:09:07,147][177156] Sum rewards: 14.385, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.668', 'AMMO5': '0.020', 'AMMO2': '0.041', 'AMMO3': '0.131', 'weapon5': '0.138', 'AMMO4': '0.206', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.620', 'WEAPON3': '0.750', 'weapon2': '0.848', 'HITCOUNT': '1.220', 'weapon3': '2.002', 'DAMAGECOUNT': '6.177', 'FRAGCOUNT': '15.000'} [2023-02-24 19:09:07,159][177156] DAMAGECOUNT value on done: 289221.0 [2023-02-24 19:09:07,160][177156] Sum rewards: 17.743, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.485', 'AMMO5': '0.014', 'AMMO2': '0.027', 'weapon7': '0.046', 'weapon5': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.102', 'AMMO4': '0.137', 'WEAPON4': '0.250', 'weapon4': '0.252', 'WEAPON5': '0.350', 'ARMOR': '0.450', 'WEAPON3': '0.650', 'weapon2': '1.216', 'HITCOUNT': '1.340', 'weapon3': '1.538', 'DAMAGECOUNT': '5.226', 'FRAGCOUNT': '17.000'} [2023-02-24 19:09:08,033][177158] DAMAGECOUNT value on done: 285178.0 [2023-02-24 19:09:08,034][177158] Sum rewards: 6.507, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.093', 'AMMO5': '0.014', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon7': '0.086', 'AMMO3': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.218', 'WEAPON5': '0.400', 'weapon4': '0.408', 'WEAPON3': '0.750', 'weapon2': '0.788', 'HITCOUNT': '0.790', 'weapon3': '1.768', 'DAMAGECOUNT': '2.820', 'FRAGCOUNT': '7.000'} [2023-02-24 19:09:08,344][177158] DAMAGECOUNT value on done: 285229.0 [2023-02-24 19:09:08,344][177158] Sum rewards: 12.758, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.549', 'AMMO5': '0.018', 'AMMO2': '0.029', 'weapon7': '0.048', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.144', 'WEAPON7': '0.200', 'weapon5': '0.214', 'weapon4': '0.294', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.678', 'WEAPON3': '0.700', 'HITCOUNT': '0.970', 'weapon3': '1.708', 'DAMAGECOUNT': '4.701', 'FRAGCOUNT': '12.000'} [2023-02-24 19:09:08,674][177153] Updated weights for policy 0, policy_version 21700 (0.0008) [2023-02-24 19:09:08,940][177158] DAMAGECOUNT value on done: 296815.0 [2023-02-24 19:09:08,940][177158] Sum rewards: 16.091, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.868', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.073', 'AMMO3': '0.083', 'weapon7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.204', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.242', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.800', 'weapon3': '1.012', 'weapon2': '1.074', 'DAMAGECOUNT': '4.653', 'FRAGCOUNT': '13.000'} [2023-02-24 19:09:09,236][177158] DAMAGECOUNT value on done: 296324.0 [2023-02-24 19:09:09,237][177158] Sum rewards: 13.706, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.190', 'AMMO2': '0.021', 'weapon7': '0.024', 'AMMO5': '0.025', 'AMMO4': '0.103', 'AMMO3': '0.130', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.238', 'WEAPON4': '0.400', 'ARMOR': '0.456', 'weapon4': '0.522', 'WEAPON5': '0.650', 'WEAPON3': '0.950', 'weapon2': '1.110', 'HITCOUNT': '1.280', 'weapon3': '1.780', 'DAMAGECOUNT': '5.106', 'FRAGCOUNT': '13.000'} [2023-02-24 19:09:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.8, 300 sec: 13787.6). Total num frames: 88920064. Throughput: 0: 3447.6. Samples: 22227362. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:09:11,376][177119] Avg episode reward: [(0, '18.150')] [2023-02-24 19:09:11,635][177153] Updated weights for policy 0, policy_version 21710 (0.0008) [2023-02-24 19:09:12,055][177172] DAMAGECOUNT value on done: 289508.0 [2023-02-24 19:09:12,055][177172] Sum rewards: 17.545, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.758', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.106', 'weapon5': '0.144', 'AMMO4': '0.192', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.458', 'WEAPON3': '0.600', 'weapon2': '1.086', 'HITCOUNT': '1.290', 'weapon3': '1.690', 'DAMAGECOUNT': '4.836', 'FRAGCOUNT': '17.000'} [2023-02-24 19:09:12,361][177172] DAMAGECOUNT value on done: 289085.0 [2023-02-24 19:09:12,362][177172] Sum rewards: 24.537, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.570', 'AMMO5': '0.015', 'AMMO2': '0.017', 'weapon7': '0.058', 'AMMO4': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'AMMO3': '0.202', 'weapon5': '0.216', 'weapon4': '0.304', 'weapon2': '0.372', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '1.680', 'weapon3': '2.600', 'DAMAGECOUNT': '8.016', 'FRAGCOUNT': '24.000'} [2023-02-24 19:09:13,498][177154] DAMAGECOUNT value on done: 294416.0 [2023-02-24 19:09:13,498][177154] Sum rewards: 6.699, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.930', 'AMMO2': '0.023', 'AMMO5': '0.031', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'AMMO3': '0.154', 'weapon5': '0.208', 'weapon4': '0.258', 'WEAPON5': '0.600', 'weapon2': '0.694', 'HITCOUNT': '0.890', 'WEAPON3': '1.000', 'weapon3': '1.824', 'DAMAGECOUNT': '3.684', 'FRAGCOUNT': '8.000'} [2023-02-24 19:09:13,800][177154] DAMAGECOUNT value on done: 300789.0 [2023-02-24 19:09:13,801][177154] Sum rewards: 21.593, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.022', 'AMMO2': '0.003', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO4': '0.017', 'WEAPON4': '0.050', 'weapon4': '0.060', 'AMMO3': '0.158', 'weapon5': '0.176', 'WEAPON5': '0.300', 'weapon2': '0.712', 'WEAPON3': '0.900', 'HITCOUNT': '1.420', 'weapon3': '2.612', 'DAMAGECOUNT': '6.441', 'FRAGCOUNT': '18.000'} [2023-02-24 19:09:13,835][177172] DAMAGECOUNT value on done: 300234.0 [2023-02-24 19:09:13,835][177172] Sum rewards: 9.760, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.840', 'AMMO5': '0.017', 'AMMO2': '0.018', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'weapon4': '0.202', 'weapon5': '0.210', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'HITCOUNT': '0.980', 'weapon2': '1.418', 'weapon3': '1.678', 'DAMAGECOUNT': '4.281', 'FRAGCOUNT': '13.000'} [2023-02-24 19:09:14,089][177154] DAMAGECOUNT value on done: 303496.0 [2023-02-24 19:09:14,090][177154] Sum rewards: 11.794, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.730', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.008', 'AMMO3': '0.055', 'weapon7': '0.136', 'weapon5': '0.196', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.300', 'weapon4': '0.396', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.640', 'weapon2': '0.700', 'weapon3': '1.262', 'DAMAGECOUNT': '3.561', 'FRAGCOUNT': '10.000'} [2023-02-24 19:09:14,125][177172] DAMAGECOUNT value on done: 292424.0 [2023-02-24 19:09:14,126][177172] Sum rewards: 20.394, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.983', 'weapon7': '0.002', 'AMMO2': '0.008', 'AMMO5': '0.020', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'weapon4': '0.120', 'AMMO3': '0.125', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.250', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'HITCOUNT': '1.280', 'weapon2': '1.342', 'weapon3': '1.722', 'DAMAGECOUNT': '5.865', 'FRAGCOUNT': '17.000'} [2023-02-24 19:09:14,392][177154] DAMAGECOUNT value on done: 301521.0 [2023-02-24 19:09:14,392][177154] Sum rewards: 14.590, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.470', 'AMMO5': '0.015', 'AMMO2': '0.040', 'AMMO3': '0.076', 'weapon7': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.198', 'WEAPON7': '0.200', 'weapon5': '0.282', 'WEAPON3': '0.450', 'WEAPON5': '0.450', 'ARMOR': '0.456', 'WEAPON4': '0.600', 'weapon3': '0.736', 'weapon2': '0.812', 'HITCOUNT': '0.910', 'weapon4': '1.370', 'DAMAGECOUNT': '4.641', 'FRAGCOUNT': '12.000'} [2023-02-24 19:09:14,583][177153] Updated weights for policy 0, policy_version 21720 (0.0008) [2023-02-24 19:09:14,601][177157] DAMAGECOUNT value on done: 302136.0 [2023-02-24 19:09:14,602][177157] Sum rewards: 10.382, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.122', 'AMMO5': '0.017', 'weapon7': '0.048', 'AMMO2': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.124', 'weapon5': '0.238', 'AMMO4': '0.321', 'WEAPON5': '0.400', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.572', 'weapon4': '0.744', 'WEAPON3': '0.900', 'HITCOUNT': '1.250', 'weapon3': '1.828', 'DAMAGECOUNT': '5.097', 'FRAGCOUNT': '11.000'} [2023-02-24 19:09:14,829][177171] DAMAGECOUNT value on done: 290268.0 [2023-02-24 19:09:14,830][177171] Sum rewards: 18.218, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.801', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'ARMOR': '0.008', 'AMMO5': '0.018', 'WEAPON4': '0.050', 'weapon7': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.123', 'weapon5': '0.156', 'weapon4': '0.190', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'weapon2': '0.736', 'WEAPON3': '0.850', 'HITCOUNT': '1.180', 'weapon3': '1.758', 'DAMAGECOUNT': '5.799', 'FRAGCOUNT': '16.500'} [2023-02-24 19:09:14,843][177171] DAMAGECOUNT value on done: 288817.0 [2023-02-24 19:09:14,843][177171] Sum rewards: 18.892, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.419', 'AMMO2': '0.008', 'AMMO5': '0.012', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'weapon7': '0.054', 'AMMO3': '0.093', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.168', 'weapon5': '0.182', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.650', 'weapon2': '1.264', 'HITCOUNT': '1.270', 'weapon3': '2.126', 'DAMAGECOUNT': '4.755', 'FRAGCOUNT': '14.000'} [2023-02-24 19:09:14,903][177157] DAMAGECOUNT value on done: 286418.0 [2023-02-24 19:09:14,903][177157] Sum rewards: 13.495, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.060', 'AMMO5': '0.015', 'AMMO2': '0.021', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.172', 'weapon4': '0.262', 'WEAPON3': '0.700', 'HITCOUNT': '1.070', 'weapon2': '1.130', 'weapon3': '1.664', 'DAMAGECOUNT': '5.649', 'FRAGCOUNT': '11.000'} [2023-02-24 19:09:14,916][177157] DAMAGECOUNT value on done: 287516.0 [2023-02-24 19:09:14,916][177157] Sum rewards: 12.895, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.230', 'AMMO5': '0.015', 'AMMO2': '0.016', 'weapon7': '0.050', 'AMMO4': '0.079', 'weapon5': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.129', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.444', 'weapon4': '0.504', 'WEAPON3': '0.700', 'HITCOUNT': '1.160', 'weapon3': '1.860', 'DAMAGECOUNT': '3.942', 'FRAGCOUNT': '14.000'} [2023-02-24 19:09:15,155][177171] DAMAGECOUNT value on done: 289998.0 [2023-02-24 19:09:15,155][177171] Sum rewards: 21.146, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.125', 'AMMO2': '0.010', 'AMMO5': '0.022', 'AMMO4': '0.047', 'AMMO3': '0.098', 'weapon4': '0.158', 'WEAPON4': '0.200', 'weapon5': '0.300', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'HITCOUNT': '1.180', 'weapon2': '1.244', 'weapon3': '1.766', 'DAMAGECOUNT': '5.745', 'FRAGCOUNT': '17.000'} [2023-02-24 19:09:15,166][177171] DAMAGECOUNT value on done: 293420.0 [2023-02-24 19:09:15,166][177171] Sum rewards: 13.787, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.200', 'AMMO2': '0.011', 'AMMO5': '0.012', 'AMMO4': '0.055', 'weapon7': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.304', 'weapon4': '0.360', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '0.870', 'weapon2': '0.934', 'weapon3': '1.860', 'DAMAGECOUNT': '4.431', 'FRAGCOUNT': '12.500'} [2023-02-24 19:09:15,228][177157] DAMAGECOUNT value on done: 287706.0 [2023-02-24 19:09:15,229][177157] Sum rewards: 21.809, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.110', 'AMMO3': '0.128', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'HEALTH': '0.434', 'weapon4': '0.478', 'weapon2': '0.668', 'WEAPON3': '0.700', 'HITCOUNT': '1.470', 'weapon3': '2.248', 'DAMAGECOUNT': '5.997', 'FRAGCOUNT': '18.000'} [2023-02-24 19:09:16,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13789.8, 300 sec: 13787.6). Total num frames: 88989696. Throughput: 0: 3448.8. Samples: 22248084. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:09:16,376][177119] Avg episode reward: [(0, '17.428')] [2023-02-24 19:09:17,017][177155] DAMAGECOUNT value on done: 299784.0 [2023-02-24 19:09:17,017][177155] Sum rewards: 21.307, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.660', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO3': '0.115', 'AMMO4': '0.125', 'weapon5': '0.186', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.704', 'WEAPON3': '0.750', 'weapon4': '0.780', 'HITCOUNT': '1.590', 'weapon3': '1.828', 'DAMAGECOUNT': '7.503', 'FRAGCOUNT': '20.000'} [2023-02-24 19:09:17,326][177155] DAMAGECOUNT value on done: 303568.0 [2023-02-24 19:09:17,326][177155] Sum rewards: 15.755, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.752', 'AMMO2': '0.006', 'AMMO5': '0.006', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'weapon5': '0.190', 'weapon4': '0.212', 'WEAPON3': '0.900', 'weapon2': '1.126', 'HITCOUNT': '1.260', 'weapon3': '2.120', 'DAMAGECOUNT': '4.797', 'FRAGCOUNT': '14.500'} [2023-02-24 19:09:17,535][177153] Updated weights for policy 0, policy_version 21730 (0.0008) [2023-02-24 19:09:17,626][177155] DAMAGECOUNT value on done: 303650.0 [2023-02-24 19:09:17,626][177155] Sum rewards: 20.413, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.634', 'AMMO2': '0.007', 'AMMO5': '0.012', 'AMMO4': '0.036', 'weapon5': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'weapon4': '0.508', 'weapon2': '0.812', 'WEAPON3': '1.200', 'HITCOUNT': '1.890', 'weapon3': '2.336', 'DAMAGECOUNT': '7.851', 'FRAGCOUNT': '19.000'} [2023-02-24 19:09:17,924][177155] DAMAGECOUNT value on done: 285618.0 [2023-02-24 19:09:17,924][177155] Sum rewards: 14.940, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.784', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO3': '0.064', 'AMMO4': '0.083', 'weapon5': '0.148', 'weapon7': '0.162', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'weapon4': '0.352', 'WEAPON7': '0.400', 'WEAPON3': '0.550', 'weapon2': '0.882', 'HITCOUNT': '0.900', 'weapon3': '1.328', 'DAMAGECOUNT': '3.903', 'FRAGCOUNT': '13.000'} [2023-02-24 19:09:20,474][177153] Updated weights for policy 0, policy_version 21740 (0.0008) [2023-02-24 19:09:21,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.2, 300 sec: 13787.6). Total num frames: 89059328. Throughput: 0: 3453.9. Samples: 22258552. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:09:21,376][177119] Avg episode reward: [(0, '17.569')] [2023-02-24 19:09:23,423][177153] Updated weights for policy 0, policy_version 21750 (0.0008) [2023-02-24 19:09:25,300][177170] DAMAGECOUNT value on done: 296492.0 [2023-02-24 19:09:25,301][177170] Sum rewards: 16.513, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.616', 'AMMO2': '0.017', 'AMMO5': '0.018', 'AMMO4': '0.083', 'AMMO3': '0.096', 'weapon7': '0.116', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.224', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'weapon4': '0.304', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon2': '0.872', 'HITCOUNT': '0.880', 'weapon3': '1.802', 'DAMAGECOUNT': '4.176', 'FRAGCOUNT': '14.000'} [2023-02-24 19:09:25,603][177170] DAMAGECOUNT value on done: 299759.0 [2023-02-24 19:09:25,603][177170] Sum rewards: 19.534, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.129', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.107', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.300', 'weapon4': '0.522', 'WEAPON3': '0.650', 'weapon2': '0.742', 'HITCOUNT': '1.120', 'weapon3': '1.816', 'DAMAGECOUNT': '5.169', 'FRAGCOUNT': '17.000'} [2023-02-24 19:09:26,217][177170] DAMAGECOUNT value on done: 291715.0 [2023-02-24 19:09:26,218][177170] Sum rewards: 17.282, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.900', 'AMMO2': '0.006', 'AMMO5': '0.020', 'AMMO4': '0.030', 'AMMO3': '0.125', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.242', 'weapon4': '0.286', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'HITCOUNT': '1.160', 'weapon2': '1.170', 'weapon3': '1.952', 'DAMAGECOUNT': '5.490', 'FRAGCOUNT': '15.000'} [2023-02-24 19:09:26,233][177156] DAMAGECOUNT value on done: 294765.0 [2023-02-24 19:09:26,233][177156] Sum rewards: 14.985, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.550', 'ARMOR': '0.004', 'AMMO5': '0.020', 'weapon7': '0.032', 'AMMO2': '0.037', 'AMMO3': '0.098', 'AMMO4': '0.186', 'weapon5': '0.198', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.346', 'WEAPON4': '0.400', 'WEAPON3': '0.700', 'weapon2': '0.962', 'HITCOUNT': '1.250', 'weapon3': '2.166', 'DAMAGECOUNT': '5.235', 'FRAGCOUNT': '13.000'} [2023-02-24 19:09:26,244][177156] DAMAGECOUNT value on done: 288075.0 [2023-02-24 19:09:26,244][177156] Sum rewards: 11.591, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.596', 'ARMOR': '0.004', 'AMMO2': '0.014', 'AMMO5': '0.015', 'AMMO4': '0.069', 'weapon5': '0.076', 'weapon7': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.380', 'weapon4': '0.518', 'WEAPON3': '0.750', 'HITCOUNT': '0.960', 'weapon3': '1.828', 'DAMAGECOUNT': '4.179', 'FRAGCOUNT': '10.500'} [2023-02-24 19:09:26,376][177119] Fps is (10 sec: 13516.7, 60 sec: 13789.9, 300 sec: 13773.7). Total num frames: 89124864. Throughput: 0: 3456.9. Samples: 22279430. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:09:26,376][177119] Avg episode reward: [(0, '17.290')] [2023-02-24 19:09:26,392][177153] Updated weights for policy 0, policy_version 21760 (0.0008) [2023-02-24 19:09:26,517][177170] DAMAGECOUNT value on done: 295485.0 [2023-02-24 19:09:26,517][177170] Sum rewards: 9.872, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.110', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'AMMO3': '0.078', 'weapon5': '0.168', 'WEAPON4': '0.250', 'weapon4': '0.294', 'WEAPON5': '0.350', 'ARMOR': '0.483', 'WEAPON3': '0.650', 'HITCOUNT': '0.700', 'weapon2': '1.276', 'weapon3': '1.550', 'DAMAGECOUNT': '2.928', 'FRAGCOUNT': '10.000'} [2023-02-24 19:09:26,541][177156] DAMAGECOUNT value on done: 303031.0 [2023-02-24 19:09:26,542][177156] Sum rewards: 15.258, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.131', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.073', 'AMMO3': '0.092', 'WEAPON4': '0.150', 'weapon5': '0.204', 'weapon4': '0.264', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'weapon2': '0.932', 'HITCOUNT': '0.990', 'weapon3': '1.632', 'DAMAGECOUNT': '5.874', 'FRAGCOUNT': '12.000'} [2023-02-24 19:09:26,553][177156] DAMAGECOUNT value on done: 290067.0 [2023-02-24 19:09:26,553][177156] Sum rewards: 3.002, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.817', 'AMMO5': '0.008', 'AMMO2': '0.044', 'AMMO3': '0.123', 'weapon7': '0.124', 'weapon5': '0.142', 'WEAPON5': '0.200', 'AMMO4': '0.221', 'ARMOR': '0.400', 'AMMO6': '0.440', 'AMMO7': '0.440', 'WEAPON4': '0.500', 'WEAPON7': '0.600', 'HITCOUNT': '0.690', 'WEAPON3': '0.750', 'weapon4': '0.778', 'weapon2': '0.948', 'weapon3': '1.622', 'DAMAGECOUNT': '2.538', 'FRAGCOUNT': '7.000'} [2023-02-24 19:09:27,457][177158] DAMAGECOUNT value on done: 286703.0 [2023-02-24 19:09:27,457][177158] Sum rewards: 10.774, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.930', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO3': '0.072', 'AMMO4': '0.216', 'weapon5': '0.322', 'weapon4': '0.360', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon2': '1.094', 'HITCOUNT': '1.110', 'weapon3': '1.744', 'DAMAGECOUNT': '4.575', 'FRAGCOUNT': '9.000'} [2023-02-24 19:09:27,751][177158] DAMAGECOUNT value on done: 287309.0 [2023-02-24 19:09:27,752][177158] Sum rewards: 20.734, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.471', 'AMMO2': '0.014', 'weapon4': '0.016', 'AMMO5': '0.021', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'weapon5': '0.100', 'AMMO3': '0.112', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'weapon2': '1.342', 'HITCOUNT': '1.510', 'weapon3': '2.328', 'DAMAGECOUNT': '6.240', 'FRAGCOUNT': '18.000'} [2023-02-24 19:09:28,343][177158] DAMAGECOUNT value on done: 298581.0 [2023-02-24 19:09:28,343][177158] Sum rewards: 17.250, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.020', 'AMMO2': '0.012', 'AMMO5': '0.015', 'weapon4': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '1.100', 'weapon2': '1.384', 'weapon3': '1.552', 'DAMAGECOUNT': '5.298', 'FRAGCOUNT': '14.000'} [2023-02-24 19:09:28,645][177158] DAMAGECOUNT value on done: 297884.0 [2023-02-24 19:09:28,645][177158] Sum rewards: 18.134, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.280', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.010', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.102', 'weapon7': '0.102', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON3': '0.700', 'weapon2': '0.776', 'weapon4': '0.804', 'HITCOUNT': '1.010', 'weapon3': '1.544', 'DAMAGECOUNT': '4.680', 'FRAGCOUNT': '16.000'} [2023-02-24 19:09:29,345][177153] Updated weights for policy 0, policy_version 21770 (0.0008) [2023-02-24 19:09:31,376][177119] Fps is (10 sec: 13516.9, 60 sec: 13789.9, 300 sec: 13787.6). Total num frames: 89194496. Throughput: 0: 3460.2. Samples: 22300266. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:09:31,376][177119] Avg episode reward: [(0, '17.055')] [2023-02-24 19:09:31,402][177172] DAMAGECOUNT value on done: 290433.0 [2023-02-24 19:09:31,403][177172] Sum rewards: 11.149, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO3': '0.064', 'HEALTH': '0.084', 'AMMO4': '0.118', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.342', 'WEAPON3': '0.400', 'ARMOR': '0.499', 'HITCOUNT': '0.540', 'weapon4': '0.658', 'weapon2': '1.158', 'weapon3': '1.254', 'DAMAGECOUNT': '2.745', 'FRAGCOUNT': '8.000'} [2023-02-24 19:09:31,706][177172] DAMAGECOUNT value on done: 290829.0 [2023-02-24 19:09:31,706][177172] Sum rewards: 10.437, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.766', 'AMMO2': '0.019', 'AMMO5': '0.020', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'weapon4': '0.160', 'AMMO3': '0.206', 'weapon5': '0.208', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.814', 'HITCOUNT': '1.170', 'WEAPON3': '1.200', 'weapon3': '2.380', 'DAMAGECOUNT': '5.232', 'FRAGCOUNT': '13.000'} [2023-02-24 19:09:32,272][177153] Updated weights for policy 0, policy_version 21780 (0.0008) [2023-02-24 19:09:32,854][177154] DAMAGECOUNT value on done: 296062.0 [2023-02-24 19:09:32,855][177154] Sum rewards: 8.566, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.062', 'AMMO5': '0.027', 'AMMO2': '0.029', 'AMMO4': '0.147', 'AMMO3': '0.203', 'weapon5': '0.260', 'weapon4': '0.284', 'WEAPON4': '0.300', 'weapon2': '0.494', 'WEAPON5': '0.550', 'HITCOUNT': '1.280', 'WEAPON3': '1.350', 'weapon3': '2.516', 'DAMAGECOUNT': '4.938', 'FRAGCOUNT': '12.000'} [2023-02-24 19:09:33,152][177154] DAMAGECOUNT value on done: 302513.0 [2023-02-24 19:09:33,153][177154] Sum rewards: 19.363, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.490', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'weapon7': '0.060', 'AMMO3': '0.062', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.192', 'WEAPON7': '0.200', 'weapon5': '0.404', 'WEAPON5': '0.550', 'WEAPON3': '0.550', 'HITCOUNT': '0.870', 'weapon2': '1.186', 'weapon3': '1.736', 'DAMAGECOUNT': '5.172', 'FRAGCOUNT': '14.000'} [2023-02-24 19:09:33,163][177172] DAMAGECOUNT value on done: 302439.0 [2023-02-24 19:09:33,163][177172] Sum rewards: 14.371, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.180', 'AMMO2': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.048', 'weapon7': '0.058', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.210', 'WEAPON5': '0.400', 'weapon4': '0.500', 'weapon2': '0.708', 'WEAPON3': '0.850', 'HITCOUNT': '1.130', 'weapon3': '2.040', 'DAMAGECOUNT': '5.115', 'FRAGCOUNT': '12.000'} [2023-02-24 19:09:33,450][177154] DAMAGECOUNT value on done: 305490.0 [2023-02-24 19:09:33,450][177154] Sum rewards: 19.826, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.456', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon7': '0.052', 'AMMO3': '0.101', 'AMMO4': '0.106', 'weapon5': '0.136', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.506', 'WEAPON3': '0.650', 'weapon2': '0.968', 'HITCOUNT': '1.150', 'weapon3': '1.800', 'DAMAGECOUNT': '5.982', 'FRAGCOUNT': '16.000'} [2023-02-24 19:09:33,457][177172] DAMAGECOUNT value on done: 293524.0 [2023-02-24 19:09:33,458][177172] Sum rewards: 11.462, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.715', 'AMMO2': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'weapon7': '0.064', 'AMMO3': '0.085', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.204', 'weapon5': '0.280', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '0.780', 'weapon2': '1.386', 'weapon3': '1.710', 'DAMAGECOUNT': '3.300', 'FRAGCOUNT': '9.000'} [2023-02-24 19:09:33,742][177154] DAMAGECOUNT value on done: 303445.0 [2023-02-24 19:09:33,742][177154] Sum rewards: 19.536, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.200', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO3': '0.092', 'weapon7': '0.122', 'AMMO4': '0.138', 'weapon5': '0.180', 'WEAPON5': '0.300', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON4': '0.400', 'WEAPON7': '0.500', 'WEAPON3': '0.600', 'weapon2': '0.738', 'weapon4': '0.822', 'HITCOUNT': '1.240', 'weapon3': '1.612', 'DAMAGECOUNT': '5.772', 'FRAGCOUNT': '15.000'} [2023-02-24 19:09:33,967][177157] DAMAGECOUNT value on done: 303896.0 [2023-02-24 19:09:33,968][177157] Sum rewards: 14.916, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.820', 'ARMOR': '0.004', 'AMMO2': '0.032', 'AMMO5': '0.032', 'weapon7': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.123', 'weapon5': '0.138', 'AMMO4': '0.157', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.650', 'weapon4': '0.652', 'weapon2': '0.816', 'WEAPON3': '0.850', 'HITCOUNT': '1.230', 'weapon3': '1.688', 'DAMAGECOUNT': '5.280', 'FRAGCOUNT': '14.000'} [2023-02-24 19:09:34,160][177171] DAMAGECOUNT value on done: 291540.0 [2023-02-24 19:09:34,161][177171] Sum rewards: 13.481, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.734', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.076', 'weapon7': '0.100', 'AMMO4': '0.190', 'weapon5': '0.196', 'WEAPON4': '0.250', 'AMMO6': '0.260', 'AMMO7': '0.260', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'weapon2': '0.594', 'weapon4': '0.730', 'HITCOUNT': '0.870', 'weapon3': '1.368', 'DAMAGECOUNT': '3.816', 'FRAGCOUNT': '11.000'} [2023-02-24 19:09:34,172][177171] DAMAGECOUNT value on done: 290331.0 [2023-02-24 19:09:34,172][177171] Sum rewards: 12.744, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.000', 'ARMOR': '0.008', 'AMMO5': '0.023', 'weapon7': '0.048', 'AMMO2': '0.056', 'AMMO3': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO4': '0.279', 'weapon5': '0.310', 'weapon2': '0.434', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'WEAPON4': '0.700', 'HITCOUNT': '0.900', 'weapon4': '1.184', 'weapon3': '1.324', 'DAMAGECOUNT': '4.542', 'FRAGCOUNT': '13.000'} [2023-02-24 19:09:34,261][177157] DAMAGECOUNT value on done: 288591.0 [2023-02-24 19:09:34,262][177157] Sum rewards: 19.486, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.880', 'AMMO5': '0.019', 'AMMO2': '0.029', 'AMMO4': '0.144', 'AMMO3': '0.148', 'weapon5': '0.230', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'ARMOR': '0.459', 'weapon2': '0.474', 'weapon4': '0.564', 'WEAPON3': '0.900', 'HITCOUNT': '1.480', 'weapon3': '2.300', 'DAMAGECOUNT': '6.519', 'FRAGCOUNT': '17.000'} [2023-02-24 19:09:34,274][177157] DAMAGECOUNT value on done: 288870.0 [2023-02-24 19:09:34,275][177157] Sum rewards: 12.033, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.710', 'AMMO5': '0.010', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'weapon7': '0.058', 'AMMO4': '0.071', 'AMMO3': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.268', 'WEAPON5': '0.300', 'weapon4': '0.426', 'weapon2': '0.634', 'WEAPON3': '0.700', 'HITCOUNT': '0.800', 'weapon3': '2.172', 'DAMAGECOUNT': '4.062', 'FRAGCOUNT': '10.000'} [2023-02-24 19:09:34,476][177171] DAMAGECOUNT value on done: 291856.0 [2023-02-24 19:09:34,476][177171] Sum rewards: 14.225, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.495', 'AMMO5': '0.013', 'AMMO2': '0.019', 'weapon7': '0.048', 'weapon5': '0.082', 'AMMO3': '0.091', 'AMMO4': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.350', 'weapon4': '0.440', 'WEAPON3': '0.650', 'weapon2': '0.784', 'HITCOUNT': '1.050', 'weapon3': '1.572', 'DAMAGECOUNT': '5.574', 'FRAGCOUNT': '12.000'} [2023-02-24 19:09:34,486][177171] DAMAGECOUNT value on done: 295240.0 [2023-02-24 19:09:34,487][177171] Sum rewards: 16.309, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.798', 'AMMO5': '0.020', 'AMMO2': '0.036', 'weapon7': '0.046', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.108', 'AMMO4': '0.182', 'WEAPON4': '0.250', 'weapon5': '0.316', 'weapon4': '0.358', 'WEAPON5': '0.500', 'weapon2': '0.554', 'WEAPON3': '0.700', 'HITCOUNT': '1.080', 'weapon3': '1.696', 'DAMAGECOUNT': '5.460', 'FRAGCOUNT': '13.000'} [2023-02-24 19:09:34,579][177157] DAMAGECOUNT value on done: 289494.0 [2023-02-24 19:09:34,579][177157] Sum rewards: 14.942, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.060', 'AMMO2': '0.009', 'AMMO5': '0.017', 'AMMO4': '0.043', 'weapon7': '0.092', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.121', 'weapon4': '0.152', 'WEAPON7': '0.200', 'weapon5': '0.324', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'weapon2': '0.924', 'HITCOUNT': '1.030', 'weapon3': '2.086', 'DAMAGECOUNT': '5.364', 'FRAGCOUNT': '14.000'} [2023-02-24 19:09:35,212][177153] Updated weights for policy 0, policy_version 21790 (0.0009) [2023-02-24 19:09:36,351][177155] DAMAGECOUNT value on done: 301128.0 [2023-02-24 19:09:36,352][177155] Sum rewards: 10.565, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.145', 'AMMO2': '0.004', 'AMMO5': '0.015', 'AMMO4': '0.022', 'weapon7': '0.050', 'AMMO3': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.344', 'WEAPON5': '0.400', 'ARMOR': '0.449', 'weapon4': '0.568', 'WEAPON3': '0.600', 'HITCOUNT': '0.720', 'weapon2': '1.004', 'weapon3': '1.022', 'DAMAGECOUNT': '4.032', 'FRAGCOUNT': '11.000'} [2023-02-24 19:09:36,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13787.5). Total num frames: 89264128. Throughput: 0: 3462.1. Samples: 22310648. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:09:36,376][177119] Avg episode reward: [(0, '16.556')] [2023-02-24 19:09:36,653][177155] DAMAGECOUNT value on done: 304053.0 [2023-02-24 19:09:36,653][177155] Sum rewards: 6.343, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.100', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.012', 'weapon7': '0.056', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.200', 'weapon4': '0.268', 'HITCOUNT': '0.280', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'weapon2': '1.064', 'DAMAGECOUNT': '1.455', 'weapon3': '1.598', 'FRAGCOUNT': '7.000'} [2023-02-24 19:09:36,955][177155] DAMAGECOUNT value on done: 305294.0 [2023-02-24 19:09:36,955][177155] Sum rewards: 13.416, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.854', 'AMMO2': '0.018', 'AMMO5': '0.024', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.178', 'weapon5': '0.220', 'WEAPON5': '0.600', 'weapon2': '0.834', 'HITCOUNT': '1.080', 'WEAPON3': '1.100', 'weapon3': '2.596', 'DAMAGECOUNT': '4.932', 'FRAGCOUNT': '14.000'} [2023-02-24 19:09:37,250][177155] DAMAGECOUNT value on done: 287201.0 [2023-02-24 19:09:37,250][177155] Sum rewards: 19.544, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.391', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.071', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.100', 'weapon5': '0.118', 'WEAPON5': '0.350', 'weapon4': '0.524', 'WEAPON3': '0.550', 'weapon2': '0.636', 'HITCOUNT': '1.020', 'weapon3': '1.654', 'DAMAGECOUNT': '4.749', 'FRAGCOUNT': '15.000'} [2023-02-24 19:09:38,147][177153] Updated weights for policy 0, policy_version 21800 (0.0008) [2023-02-24 19:09:41,125][177153] Updated weights for policy 0, policy_version 21810 (0.0008) [2023-02-24 19:09:41,376][177119] Fps is (10 sec: 13926.0, 60 sec: 13789.8, 300 sec: 13787.5). Total num frames: 89333760. Throughput: 0: 3466.0. Samples: 22331584. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:09:41,377][177119] Avg episode reward: [(0, '16.448')] [2023-02-24 19:09:44,047][177153] Updated weights for policy 0, policy_version 21820 (0.0008) [2023-02-24 19:09:44,626][177170] DAMAGECOUNT value on done: 297894.0 [2023-02-24 19:09:44,627][177170] Sum rewards: 17.411, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.028', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO3': '0.077', 'AMMO4': '0.091', 'weapon7': '0.154', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.450', 'weapon4': '0.638', 'HITCOUNT': '1.150', 'weapon2': '1.258', 'weapon3': '1.592', 'DAMAGECOUNT': '4.206', 'FRAGCOUNT': '12.000'} [2023-02-24 19:09:44,917][177170] DAMAGECOUNT value on done: 301012.0 [2023-02-24 19:09:44,917][177170] Sum rewards: 13.748, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.026', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.041', 'AMMO3': '0.099', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.114', 'WEAPON4': '0.200', 'AMMO4': '0.203', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon4': '0.456', 'WEAPON3': '0.650', 'HITCOUNT': '0.980', 'weapon2': '1.108', 'weapon3': '1.582', 'DAMAGECOUNT': '3.759', 'FRAGCOUNT': '12.000'} [2023-02-24 19:09:45,542][177170] DAMAGECOUNT value on done: 293880.0 [2023-02-24 19:09:45,542][177170] Sum rewards: 20.903, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.466', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO5': '0.027', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.104', 'AMMO4': '0.131', 'weapon4': '0.244', 'weapon5': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.700', 'WEAPON3': '0.750', 'weapon2': '0.852', 'HITCOUNT': '1.390', 'weapon3': '2.148', 'DAMAGECOUNT': '6.495', 'FRAGCOUNT': '19.000'} [2023-02-24 19:09:45,558][177156] DAMAGECOUNT value on done: 296509.0 [2023-02-24 19:09:45,558][177156] Sum rewards: 19.341, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.480', 'AMMO2': '0.018', 'AMMO5': '0.020', 'weapon7': '0.022', 'AMMO4': '0.091', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'weapon4': '0.176', 'weapon5': '0.206', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '1.210', 'weapon2': '1.326', 'weapon3': '1.926', 'DAMAGECOUNT': '5.232', 'FRAGCOUNT': '16.000'} [2023-02-24 19:09:45,569][177156] DAMAGECOUNT value on done: 289545.0 [2023-02-24 19:09:45,570][177156] Sum rewards: 14.275, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.745', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.061', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'weapon5': '0.232', 'weapon4': '0.296', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.770', 'weapon2': '1.046', 'weapon3': '1.502', 'DAMAGECOUNT': '4.344', 'FRAGCOUNT': '11.000'} [2023-02-24 19:09:45,859][177170] DAMAGECOUNT value on done: 296393.0 [2023-02-24 19:09:45,860][177170] Sum rewards: 9.111, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.435', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.087', 'AMMO3': '0.093', 'weapon5': '0.106', 'weapon7': '0.114', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'ARMOR': '0.454', 'HITCOUNT': '0.530', 'WEAPON3': '0.550', 'weapon4': '0.682', 'weapon2': '0.746', 'weapon3': '1.190', 'DAMAGECOUNT': '2.724', 'FRAGCOUNT': '7.000'} [2023-02-24 19:09:45,878][177156] DAMAGECOUNT value on done: 304442.0 [2023-02-24 19:09:45,878][177156] Sum rewards: 16.478, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.165', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO3': '0.069', 'AMMO4': '0.088', 'weapon7': '0.104', 'weapon5': '0.130', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.500', 'weapon2': '0.626', 'HITCOUNT': '0.810', 'weapon4': '1.056', 'weapon3': '1.162', 'DAMAGECOUNT': '4.185', 'FRAGCOUNT': '13.000'} [2023-02-24 19:09:45,889][177156] DAMAGECOUNT value on done: 291539.0 [2023-02-24 19:09:45,889][177156] Sum rewards: 12.934, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.970', 'AMMO2': '0.017', 'AMMO5': '0.022', 'AMMO4': '0.084', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.148', 'weapon5': '0.196', 'WEAPON4': '0.200', 'weapon4': '0.206', 'WEAPON5': '0.400', 'ARMOR': '0.468', 'WEAPON3': '0.900', 'HITCOUNT': '1.160', 'weapon2': '1.428', 'weapon3': '1.708', 'DAMAGECOUNT': '4.416', 'FRAGCOUNT': '13.000'} [2023-02-24 19:09:46,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.2, 300 sec: 13787.6). Total num frames: 89403392. Throughput: 0: 3467.7. Samples: 22352374. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:09:46,376][177119] Avg episode reward: [(0, '16.017')] [2023-02-24 19:09:46,741][177158] DAMAGECOUNT value on done: 288064.0 [2023-02-24 19:09:46,741][177158] Sum rewards: 13.244, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.530', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.014', 'AMMO4': '0.030', 'AMMO3': '0.077', 'WEAPON5': '0.100', 'weapon7': '0.122', 'WEAPON4': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON3': '0.600', 'weapon4': '0.738', 'HITCOUNT': '1.120', 'weapon2': '1.218', 'weapon3': '1.626', 'DAMAGECOUNT': '4.083', 'FRAGCOUNT': '10.000'} [2023-02-24 19:09:47,028][177153] Updated weights for policy 0, policy_version 21830 (0.0008) [2023-02-24 19:09:47,038][177158] DAMAGECOUNT value on done: 288388.0 [2023-02-24 19:09:47,039][177158] Sum rewards: 9.386, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.510', 'AMMO2': '0.009', 'AMMO5': '0.012', 'weapon4': '0.030', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon5': '0.290', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'HITCOUNT': '0.710', 'weapon2': '1.212', 'weapon3': '1.742', 'DAMAGECOUNT': '3.237', 'FRAGCOUNT': '9.000'} [2023-02-24 19:09:47,639][177158] DAMAGECOUNT value on done: 299498.0 [2023-02-24 19:09:47,639][177158] Sum rewards: 9.914, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.720', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.057', 'AMMO3': '0.067', 'weapon5': '0.116', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon7': '0.238', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON3': '0.450', 'WEAPON7': '0.500', 'weapon4': '0.752', 'HITCOUNT': '0.760', 'weapon3': '1.102', 'weapon2': '1.274', 'DAMAGECOUNT': '2.751', 'FRAGCOUNT': '6.000'} [2023-02-24 19:09:47,938][177158] DAMAGECOUNT value on done: 299713.0 [2023-02-24 19:09:47,939][177158] Sum rewards: 18.715, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.466', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.060', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'weapon4': '0.184', 'weapon5': '0.214', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon7': '0.234', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '1.200', 'weapon2': '1.364', 'weapon3': '1.544', 'DAMAGECOUNT': '5.487', 'FRAGCOUNT': '13.000'} [2023-02-24 19:09:49,967][177153] Updated weights for policy 0, policy_version 21840 (0.0009) [2023-02-24 19:09:50,696][177172] DAMAGECOUNT value on done: 291956.0 [2023-02-24 19:09:50,697][177172] Sum rewards: 6.267, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.356', 'AMMO2': '0.009', 'AMMO5': '0.015', 'AMMO4': '0.046', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon4': '0.202', 'weapon5': '0.228', 'WEAPON5': '0.450', 'weapon2': '0.848', 'HITCOUNT': '1.060', 'WEAPON3': '1.250', 'weapon3': '2.310', 'DAMAGECOUNT': '4.569', 'FRAGCOUNT': '8.500'} [2023-02-24 19:09:50,988][177172] DAMAGECOUNT value on done: 292093.0 [2023-02-24 19:09:50,989][177172] Sum rewards: 12.416, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.015', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.005', 'weapon7': '0.050', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.123', 'WEAPON7': '0.200', 'weapon4': '0.276', 'ARMOR': '0.490', 'WEAPON3': '0.800', 'HITCOUNT': '1.060', 'weapon2': '1.336', 'weapon3': '2.028', 'DAMAGECOUNT': '3.792', 'FRAGCOUNT': '11.000'} [2023-02-24 19:09:51,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13858.1, 300 sec: 13787.6). Total num frames: 89473024. Throughput: 0: 3468.7. Samples: 22362762. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:09:51,376][177119] Avg episode reward: [(0, '15.688')] [2023-02-24 19:09:52,172][177154] DAMAGECOUNT value on done: 296989.0 [2023-02-24 19:09:52,172][177154] Sum rewards: 10.069, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.474', 'ARMOR': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.040', 'weapon5': '0.054', 'AMMO3': '0.082', 'WEAPON5': '0.100', 'weapon7': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.199', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.444', 'WEAPON3': '0.500', 'HITCOUNT': '0.830', 'weapon3': '1.368', 'weapon4': '1.528', 'DAMAGECOUNT': '2.781', 'FRAGCOUNT': '7.000'} [2023-02-24 19:09:52,272][177172] Large shaping reward 2.502 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.48, 160.0), ('weapon5', 0.002)] [2023-02-24 19:09:52,476][177154] DAMAGECOUNT value on done: 303909.0 [2023-02-24 19:09:52,476][177154] Sum rewards: 13.798, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.790', 'AMMO5': '0.005', 'AMMO2': '0.029', 'AMMO3': '0.050', 'weapon4': '0.060', 'weapon5': '0.100', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'weapon7': '0.184', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'HITCOUNT': '0.850', 'weapon3': '1.282', 'weapon2': '1.344', 'DAMAGECOUNT': '4.188', 'FRAGCOUNT': '11.000'} [2023-02-24 19:09:52,476][177172] DAMAGECOUNT value on done: 304078.0 [2023-02-24 19:09:52,477][177172] Sum rewards: 14.752, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.270', 'AMMO5': '0.015', 'AMMO2': '0.019', 'AMMO4': '0.097', 'AMMO3': '0.156', 'weapon4': '0.230', 'weapon5': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'HITCOUNT': '1.140', 'weapon2': '1.214', 'weapon3': '1.794', 'DAMAGECOUNT': '4.917', 'FRAGCOUNT': '16.000'} [2023-02-24 19:09:52,776][177154] DAMAGECOUNT value on done: 306964.0 [2023-02-24 19:09:52,777][177154] Sum rewards: 18.690, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.940', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.056', 'AMMO3': '0.065', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.128', 'WEAPON5': '0.200', 'weapon7': '0.256', 'weapon4': '0.490', 'WEAPON3': '0.550', 'weapon2': '1.086', 'HITCOUNT': '1.140', 'weapon3': '1.546', 'DAMAGECOUNT': '4.197', 'FRAGCOUNT': '14.000'} [2023-02-24 19:09:52,786][177172] DAMAGECOUNT value on done: 295638.0 [2023-02-24 19:09:52,787][177172] Sum rewards: 20.024, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.016', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.027', 'AMMO3': '0.122', 'weapon5': '0.124', 'AMMO4': '0.136', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon4': '0.700', 'weapon2': '0.796', 'WEAPON3': '0.800', 'HITCOUNT': '1.440', 'weapon3': '2.022', 'DAMAGECOUNT': '6.342', 'FRAGCOUNT': '16.000'} [2023-02-24 19:09:52,915][177153] Updated weights for policy 0, policy_version 21850 (0.0008) [2023-02-24 19:09:53,076][177154] DAMAGECOUNT value on done: 305000.0 [2023-02-24 19:09:53,077][177154] Sum rewards: 12.124, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.835', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon7': '0.058', 'AMMO3': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.124', 'weapon5': '0.172', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.572', 'WEAPON3': '0.600', 'weapon4': '0.956', 'HITCOUNT': '1.150', 'weapon3': '1.788', 'DAMAGECOUNT': '4.665', 'FRAGCOUNT': '10.000'} [2023-02-24 19:09:53,341][177157] DAMAGECOUNT value on done: 305643.0 [2023-02-24 19:09:53,342][177157] Sum rewards: 20.688, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.868', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.097', 'AMMO4': '0.110', 'weapon5': '0.154', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'weapon2': '1.034', 'HITCOUNT': '1.150', 'weapon3': '2.358', 'DAMAGECOUNT': '5.241', 'FRAGCOUNT': '17.000'} [2023-02-24 19:09:53,620][177171] DAMAGECOUNT value on done: 293209.0 [2023-02-24 19:09:53,621][177171] Sum rewards: 17.013, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.352', 'AMMO2': '0.014', 'AMMO5': '0.022', 'AMMO4': '0.071', 'weapon7': '0.092', 'AMMO3': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.186', 'WEAPON7': '0.200', 'weapon4': '0.344', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'weapon2': '1.002', 'HITCOUNT': '1.410', 'weapon3': '1.956', 'DAMAGECOUNT': '5.007', 'FRAGCOUNT': '13.000'} [2023-02-24 19:09:53,633][177171] DAMAGECOUNT value on done: 291813.0 [2023-02-24 19:09:53,633][177171] Sum rewards: 14.513, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.906', 'AMMO2': '0.024', 'AMMO5': '0.025', 'AMMO4': '0.118', 'weapon5': '0.140', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.240', 'WEAPON5': '0.500', 'weapon2': '0.882', 'WEAPON3': '0.950', 'HITCOUNT': '1.240', 'weapon3': '2.394', 'DAMAGECOUNT': '4.446', 'FRAGCOUNT': '14.000'} [2023-02-24 19:09:53,641][177157] DAMAGECOUNT value on done: 290359.0 [2023-02-24 19:09:53,642][177157] Sum rewards: 20.810, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.685', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.020', 'WEAPON4': '0.100', 'AMMO3': '0.136', 'weapon4': '0.178', 'weapon5': '0.246', 'ARMOR': '0.459', 'WEAPON5': '0.550', 'weapon2': '0.948', 'WEAPON3': '1.050', 'HITCOUNT': '1.360', 'weapon3': '2.172', 'DAMAGECOUNT': '5.304', 'FRAGCOUNT': '18.500'} [2023-02-24 19:09:53,654][177157] DAMAGECOUNT value on done: 290631.0 [2023-02-24 19:09:53,655][177157] Sum rewards: 20.364, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.570', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.057', 'weapon7': '0.072', 'weapon5': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.130', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.200', 'WEAPON3': '0.850', 'HITCOUNT': '1.360', 'weapon2': '1.414', 'weapon3': '1.926', 'DAMAGECOUNT': '5.283', 'FRAGCOUNT': '17.000'} [2023-02-24 19:09:53,935][177171] DAMAGECOUNT value on done: 293308.0 [2023-02-24 19:09:53,935][177171] Sum rewards: 16.415, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.840', 'AMMO5': '0.009', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon7': '0.072', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.144', 'weapon4': '0.144', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '1.000', 'HITCOUNT': '1.220', 'weapon2': '1.286', 'weapon3': '2.056', 'DAMAGECOUNT': '4.356', 'FRAGCOUNT': '16.000'} [2023-02-24 19:09:53,946][177171] DAMAGECOUNT value on done: 296972.0 [2023-02-24 19:09:53,946][177171] Sum rewards: 18.136, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.340', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon7': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.103', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'weapon5': '0.184', 'weapon4': '0.194', 'WEAPON5': '0.200', 'WEAPON3': '0.650', 'HITCOUNT': '1.170', 'weapon2': '1.262', 'weapon3': '1.838', 'DAMAGECOUNT': '5.196', 'FRAGCOUNT': '13.000'} [2023-02-24 19:09:53,955][177157] DAMAGECOUNT value on done: 290955.0 [2023-02-24 19:09:53,956][177157] Sum rewards: 17.487, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.620', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO3': '0.052', 'weapon4': '0.080', 'WEAPON4': '0.100', 'AMMO4': '0.123', 'weapon7': '0.166', 'weapon5': '0.206', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.890', 'weapon3': '1.310', 'weapon2': '1.874', 'DAMAGECOUNT': '4.383', 'FRAGCOUNT': '12.000'} [2023-02-24 19:09:55,752][177155] DAMAGECOUNT value on done: 303116.0 [2023-02-24 19:09:55,753][177155] Sum rewards: 17.728, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.105', 'AMMO2': '0.015', 'AMMO5': '0.025', 'weapon7': '0.052', 'AMMO4': '0.074', 'AMMO3': '0.104', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.158', 'WEAPON7': '0.200', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'weapon2': '0.940', 'HITCOUNT': '1.390', 'weapon3': '2.306', 'DAMAGECOUNT': '5.964', 'FRAGCOUNT': '14.000'} [2023-02-24 19:09:55,877][177153] Updated weights for policy 0, policy_version 21860 (0.0008) [2023-02-24 19:09:56,046][177155] DAMAGECOUNT value on done: 305381.0 [2023-02-24 19:09:56,047][177155] Sum rewards: 15.683, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.725', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO3': '0.060', 'AMMO4': '0.074', 'weapon7': '0.112', 'weapon5': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.794', 'HITCOUNT': '0.800', 'weapon2': '0.930', 'weapon3': '1.368', 'DAMAGECOUNT': '3.984', 'FRAGCOUNT': '11.000'} [2023-02-24 19:09:56,360][177155] DAMAGECOUNT value on done: 306963.0 [2023-02-24 19:09:56,360][177155] Sum rewards: 17.845, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.650', 'weapon7': '0.014', 'AMMO5': '0.020', 'AMMO2': '0.026', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.122', 'AMMO4': '0.131', 'weapon2': '0.230', 'weapon5': '0.294', 'WEAPON4': '0.350', 'ARMOR': '0.457', 'WEAPON5': '0.500', 'weapon4': '0.598', 'WEAPON3': '0.750', 'HITCOUNT': '1.090', 'weapon3': '2.356', 'DAMAGECOUNT': '5.007', 'FRAGCOUNT': '16.000'} [2023-02-24 19:09:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13787.6). Total num frames: 89542656. Throughput: 0: 3469.1. Samples: 22383472. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:09:56,376][177119] Avg episode reward: [(0, '15.569')] [2023-02-24 19:09:56,659][177155] DAMAGECOUNT value on done: 289344.0 [2023-02-24 19:09:56,659][177155] Sum rewards: 19.128, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.820', 'AMMO4': '-0.072', 'AMMO2': '-0.014', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.072', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.266', 'WEAPON5': '0.600', 'WEAPON3': '0.650', 'HITCOUNT': '1.160', 'weapon2': '1.658', 'weapon3': '1.810', 'DAMAGECOUNT': '6.429', 'FRAGCOUNT': '13.000'} [2023-02-24 19:09:58,827][177153] Updated weights for policy 0, policy_version 21870 (0.0009) [2023-02-24 19:09:59,848][177158] Large shaping reward 3.291 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.24, 80.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 19:10:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13801.4). Total num frames: 89612288. Throughput: 0: 3471.2. Samples: 22404288. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:10:01,376][177119] Avg episode reward: [(0, '15.534')] [2023-02-24 19:10:01,787][177153] Updated weights for policy 0, policy_version 21880 (0.0008) [2023-02-24 19:10:04,087][177170] DAMAGECOUNT value on done: 300355.0 [2023-02-24 19:10:04,088][177170] Sum rewards: 22.608, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.710', 'ARMOR': '0.004', 'weapon7': '0.016', 'AMMO5': '0.017', 'AMMO2': '0.030', 'weapon5': '0.062', 'AMMO3': '0.131', 'AMMO4': '0.149', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.688', 'weapon4': '0.756', 'WEAPON3': '0.850', 'HITCOUNT': '1.770', 'weapon3': '2.112', 'DAMAGECOUNT': '7.383', 'FRAGCOUNT': '18.000'} [2023-02-24 19:10:04,397][177170] DAMAGECOUNT value on done: 302686.0 [2023-02-24 19:10:04,397][177170] Sum rewards: 13.538, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.037', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'weapon4': '0.122', 'weapon5': '0.196', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon2': '0.996', 'HITCOUNT': '1.310', 'weapon3': '2.264', 'DAMAGECOUNT': '5.022', 'FRAGCOUNT': '10.500'} [2023-02-24 19:10:04,758][177153] Updated weights for policy 0, policy_version 21890 (0.0008) [2023-02-24 19:10:04,986][177170] DAMAGECOUNT value on done: 295629.0 [2023-02-24 19:10:04,986][177170] Sum rewards: 20.519, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.460', 'AMMO5': '0.021', 'AMMO2': '0.025', 'AMMO3': '0.098', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'weapon5': '0.266', 'weapon4': '0.412', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'weapon2': '0.828', 'HITCOUNT': '1.160', 'weapon3': '1.994', 'DAMAGECOUNT': '5.247', 'FRAGCOUNT': '17.000'} [2023-02-24 19:10:05,036][177156] DAMAGECOUNT value on done: 298435.0 [2023-02-24 19:10:05,037][177156] Sum rewards: 17.790, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.784', 'AMMO5': '0.014', 'AMMO2': '0.035', 'AMMO3': '0.079', 'AMMO4': '0.175', 'weapon5': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'weapon2': '0.800', 'weapon4': '0.964', 'HITCOUNT': '1.220', 'weapon3': '1.576', 'DAMAGECOUNT': '5.778', 'FRAGCOUNT': '14.000'} [2023-02-24 19:10:05,046][177156] DAMAGECOUNT value on done: 291138.0 [2023-02-24 19:10:05,046][177156] Sum rewards: 11.647, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.185', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.046', 'AMMO3': '0.113', 'weapon5': '0.184', 'AMMO4': '0.229', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.460', 'WEAPON3': '0.650', 'HITCOUNT': '0.790', 'weapon2': '1.122', 'weapon3': '1.784', 'DAMAGECOUNT': '4.779', 'FRAGCOUNT': '10.000'} [2023-02-24 19:10:05,288][177170] DAMAGECOUNT value on done: 298145.0 [2023-02-24 19:10:05,288][177170] Sum rewards: 16.675, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.075', 'AMMO2': '0.008', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.042', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'weapon4': '0.254', 'weapon5': '0.316', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'weapon2': '1.046', 'HITCOUNT': '1.120', 'weapon3': '1.868', 'DAMAGECOUNT': '5.256', 'FRAGCOUNT': '15.000'} [2023-02-24 19:10:05,338][177156] DAMAGECOUNT value on done: 305834.0 [2023-02-24 19:10:05,338][177156] Sum rewards: 13.907, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.324', 'AMMO5': '0.011', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO3': '0.088', 'AMMO4': '0.089', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.449', 'WEAPON3': '0.600', 'weapon4': '0.634', 'HITCOUNT': '0.970', 'weapon2': '1.136', 'weapon3': '1.682', 'DAMAGECOUNT': '4.176', 'FRAGCOUNT': '10.000'} [2023-02-24 19:10:05,348][177156] DAMAGECOUNT value on done: 293389.0 [2023-02-24 19:10:05,349][177156] Sum rewards: 19.507, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.970', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.090', 'AMMO3': '0.125', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.596', 'WEAPON3': '0.800', 'weapon2': '1.130', 'HITCOUNT': '1.390', 'weapon3': '1.778', 'DAMAGECOUNT': '5.550', 'FRAGCOUNT': '16.000'} [2023-02-24 19:10:06,127][177158] DAMAGECOUNT value on done: 289210.0 [2023-02-24 19:10:06,127][177158] Sum rewards: 9.024, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.512', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.020', 'weapon7': '0.050', 'AMMO4': '0.098', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.140', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'weapon4': '0.716', 'HITCOUNT': '0.850', 'weapon2': '1.200', 'weapon3': '1.602', 'DAMAGECOUNT': '3.438', 'FRAGCOUNT': '8.000'} [2023-02-24 19:10:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13801.4). Total num frames: 89681920. Throughput: 0: 3470.5. Samples: 22414726. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:10:06,376][177119] Avg episode reward: [(0, '15.395')] [2023-02-24 19:10:06,427][177158] DAMAGECOUNT value on done: 289633.0 [2023-02-24 19:10:06,428][177158] Sum rewards: 9.718, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.736', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.029', 'weapon7': '0.064', 'AMMO3': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.145', 'weapon5': '0.198', 'WEAPON7': '0.200', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.480', 'WEAPON3': '0.750', 'HITCOUNT': '0.950', 'weapon4': '1.238', 'weapon3': '1.642', 'DAMAGECOUNT': '3.735', 'FRAGCOUNT': '9.000'} [2023-02-24 19:10:06,597][177157] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-24 19:10:06,919][177158] DAMAGECOUNT value on done: 300487.0 [2023-02-24 19:10:06,920][177158] Sum rewards: 11.887, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.650', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.056', 'weapon5': '0.076', 'AMMO4': '0.131', 'weapon7': '0.194', 'WEAPON5': '0.300', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '0.500', 'WEAPON7': '0.500', 'HITCOUNT': '0.670', 'weapon2': '0.722', 'weapon4': '1.248', 'weapon3': '1.334', 'DAMAGECOUNT': '2.967', 'FRAGCOUNT': '9.000'} [2023-02-24 19:10:07,216][177158] DAMAGECOUNT value on done: 301047.0 [2023-02-24 19:10:07,217][177158] Sum rewards: 14.214, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.957', 'AMMO5': '0.017', 'AMMO2': '0.042', 'AMMO3': '0.091', 'weapon4': '0.094', 'WEAPON4': '0.150', 'AMMO4': '0.209', 'weapon5': '0.304', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.810', 'weapon2': '0.986', 'weapon3': '2.116', 'DAMAGECOUNT': '4.002', 'FRAGCOUNT': '12.000'} [2023-02-24 19:10:07,703][177153] Updated weights for policy 0, policy_version 21900 (0.0008) [2023-02-24 19:10:10,133][177172] DAMAGECOUNT value on done: 293056.0 [2023-02-24 19:10:10,133][177172] Sum rewards: 14.654, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'AMMO3': '0.060', 'weapon7': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.163', 'weapon5': '0.204', 'HEALTH': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'weapon3': '0.822', 'HITCOUNT': '0.850', 'weapon2': '0.922', 'weapon4': '1.296', 'DAMAGECOUNT': '3.300', 'FRAGCOUNT': '10.000'} [2023-02-24 19:10:10,440][177172] DAMAGECOUNT value on done: 294123.0 [2023-02-24 19:10:10,440][177172] Sum rewards: 19.914, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.806', 'AMMO2': '0.010', 'AMMO5': '0.014', 'AMMO4': '0.049', 'weapon7': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.123', 'weapon5': '0.188', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'weapon2': '1.104', 'HITCOUNT': '1.260', 'weapon3': '2.332', 'DAMAGECOUNT': '6.090', 'FRAGCOUNT': '17.000'} [2023-02-24 19:10:10,674][177153] Updated weights for policy 0, policy_version 21910 (0.0008) [2023-02-24 19:10:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13801.4). Total num frames: 89751552. Throughput: 0: 3467.8. Samples: 22435482. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:10:11,376][177119] Avg episode reward: [(0, '15.324')] [2023-02-24 19:10:11,583][177154] DAMAGECOUNT value on done: 298761.0 [2023-02-24 19:10:11,583][177154] Sum rewards: 23.047, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.170', 'AMMO2': '0.017', 'AMMO5': '0.017', 'AMMO4': '0.083', 'weapon7': '0.084', 'AMMO3': '0.090', 'weapon5': '0.190', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '1.510', 'weapon2': '1.562', 'weapon3': '1.848', 'DAMAGECOUNT': '5.316', 'FRAGCOUNT': '17.000'} [2023-02-24 19:10:11,882][177154] DAMAGECOUNT value on done: 305039.0 [2023-02-24 19:10:11,882][177154] Sum rewards: 13.854, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '0.000', 'AMMO2': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.041', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon7': '0.156', 'weapon4': '0.212', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.280', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.650', 'weapon2': '1.218', 'weapon3': '1.506', 'DAMAGECOUNT': '3.390', 'FRAGCOUNT': '10.000'} [2023-02-24 19:10:11,921][177172] DAMAGECOUNT value on done: 305992.0 [2023-02-24 19:10:11,921][177172] Sum rewards: 16.079, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.607', 'ARMOR': '0.004', 'AMMO5': '0.027', 'AMMO2': '0.030', 'AMMO3': '0.140', 'AMMO4': '0.150', 'weapon5': '0.268', 'WEAPON4': '0.300', 'weapon4': '0.456', 'WEAPON5': '0.600', 'weapon2': '0.806', 'WEAPON3': '0.900', 'HITCOUNT': '1.180', 'weapon3': '2.082', 'DAMAGECOUNT': '5.742', 'FRAGCOUNT': '15.500'} [2023-02-24 19:10:12,169][177154] DAMAGECOUNT value on done: 308621.0 [2023-02-24 19:10:12,169][177154] Sum rewards: 18.244, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.135', 'AMMO2': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.158', 'weapon4': '0.224', 'weapon5': '0.276', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.930', 'weapon2': '0.930', 'weapon3': '1.856', 'DAMAGECOUNT': '4.971', 'FRAGCOUNT': '13.000'} [2023-02-24 19:10:12,219][177172] DAMAGECOUNT value on done: 297346.0 [2023-02-24 19:10:12,219][177172] Sum rewards: 18.396, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.992', 'AMMO5': '0.016', 'AMMO2': '0.049', 'AMMO3': '0.094', 'weapon5': '0.224', 'AMMO4': '0.246', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.648', 'WEAPON3': '0.650', 'weapon2': '0.868', 'HITCOUNT': '1.250', 'weapon3': '1.768', 'DAMAGECOUNT': '5.124', 'FRAGCOUNT': '15.000'} [2023-02-24 19:10:12,457][177154] DAMAGECOUNT value on done: 306090.0 [2023-02-24 19:10:12,458][177154] Sum rewards: 11.245, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.207', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO3': '0.075', 'weapon7': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.138', 'weapon5': '0.196', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'WEAPON3': '0.500', 'weapon2': '0.658', 'weapon4': '0.704', 'HITCOUNT': '0.720', 'weapon3': '1.336', 'DAMAGECOUNT': '3.270', 'FRAGCOUNT': '9.000'} [2023-02-24 19:10:12,715][177157] DAMAGECOUNT value on done: 307163.0 [2023-02-24 19:10:12,716][177157] Sum rewards: 19.238, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.900', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.064', 'weapon7': '0.078', 'weapon5': '0.082', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.246', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'HITCOUNT': '0.940', 'weapon2': '1.502', 'weapon3': '1.680', 'DAMAGECOUNT': '4.536', 'FRAGCOUNT': '15.000'} [2023-02-24 19:10:12,941][177171] DAMAGECOUNT value on done: 294334.0 [2023-02-24 19:10:12,942][177171] Sum rewards: 10.667, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.890', 'AMMO2': '0.006', 'AMMO5': '0.009', 'AMMO4': '0.028', 'AMMO3': '0.064', 'weapon7': '0.084', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.162', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'weapon4': '0.534', 'HITCOUNT': '0.950', 'weapon2': '0.980', 'weapon3': '1.324', 'DAMAGECOUNT': '3.375', 'FRAGCOUNT': '8.000'} [2023-02-24 19:10:12,952][177171] DAMAGECOUNT value on done: 293521.0 [2023-02-24 19:10:12,952][177171] Sum rewards: 24.965, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.530', 'AMMO2': '0.011', 'AMMO5': '0.017', 'weapon4': '0.046', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'weapon7': '0.108', 'AMMO3': '0.129', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.286', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '1.180', 'weapon2': '1.396', 'weapon3': '1.904', 'DAMAGECOUNT': '5.124', 'FRAGCOUNT': '20.000'} [2023-02-24 19:10:13,017][177157] DAMAGECOUNT value on done: 291642.0 [2023-02-24 19:10:13,017][177157] Sum rewards: 14.258, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.235', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO3': '0.068', 'weapon7': '0.084', 'AMMO4': '0.090', 'weapon5': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.862', 'HITCOUNT': '0.970', 'weapon2': '1.106', 'weapon3': '1.260', 'DAMAGECOUNT': '3.849', 'FRAGCOUNT': '11.000'} [2023-02-24 19:10:13,029][177157] DAMAGECOUNT value on done: 292630.0 [2023-02-24 19:10:13,029][177157] Sum rewards: 27.267, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.460', 'AMMO5': '0.017', 'AMMO2': '0.022', 'weapon7': '0.044', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.108', 'WEAPON4': '0.250', 'weapon5': '0.258', 'WEAPON5': '0.300', 'weapon4': '0.360', 'WEAPON3': '0.650', 'weapon2': '1.074', 'HITCOUNT': '1.190', 'weapon3': '1.800', 'DAMAGECOUNT': '5.997', 'FRAGCOUNT': '22.000'} [2023-02-24 19:10:13,250][177171] DAMAGECOUNT value on done: 294762.0 [2023-02-24 19:10:13,251][177171] Sum rewards: 14.782, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.860', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.050', 'weapon7': '0.072', 'AMMO4': '0.089', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.116', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.552', 'WEAPON3': '0.700', 'HITCOUNT': '0.990', 'weapon4': '1.130', 'weapon3': '1.336', 'DAMAGECOUNT': '4.362', 'FRAGCOUNT': '13.000'} [2023-02-24 19:10:13,264][177171] DAMAGECOUNT value on done: 298208.0 [2023-02-24 19:10:13,265][177171] Sum rewards: 15.826, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.104', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.058', 'AMMO3': '0.063', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'weapon7': '0.186', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'WEAPON7': '0.500', 'weapon2': '0.724', 'HITCOUNT': '0.860', 'weapon3': '0.968', 'weapon4': '1.044', 'DAMAGECOUNT': '3.708', 'FRAGCOUNT': '13.000'} [2023-02-24 19:10:13,336][177157] DAMAGECOUNT value on done: 292734.0 [2023-02-24 19:10:13,336][177157] Sum rewards: 14.549, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.010', 'AMMO2': '0.011', 'AMMO5': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'weapon4': '0.098', 'AMMO3': '0.134', 'weapon5': '0.200', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'weapon2': '1.040', 'HITCOUNT': '1.370', 'weapon3': '2.196', 'DAMAGECOUNT': '5.337', 'FRAGCOUNT': '12.000'} [2023-02-24 19:10:13,602][177153] Updated weights for policy 0, policy_version 21920 (0.0008) [2023-02-24 19:10:15,192][177155] DAMAGECOUNT value on done: 305050.0 [2023-02-24 19:10:15,192][177155] Sum rewards: 13.812, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.761', 'AMMO5': '0.009', 'weapon7': '0.018', 'AMMO2': '0.036', 'weapon5': '0.090', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.119', 'AMMO4': '0.178', 'WEAPON5': '0.250', 'ARMOR': '0.471', 'WEAPON4': '0.500', 'weapon2': '0.734', 'weapon4': '0.846', 'WEAPON3': '0.950', 'HITCOUNT': '1.510', 'weapon3': '2.010', 'DAMAGECOUNT': '5.802', 'FRAGCOUNT': '14.000'} [2023-02-24 19:10:15,496][177155] DAMAGECOUNT value on done: 306209.0 [2023-02-24 19:10:15,497][177155] Sum rewards: 7.202, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.600', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO3': '0.048', 'AMMO4': '0.067', 'weapon5': '0.120', 'weapon7': '0.142', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'weapon4': '0.382', 'HITCOUNT': '0.510', 'weapon3': '0.904', 'weapon2': '1.576', 'DAMAGECOUNT': '2.484', 'FRAGCOUNT': '4.000'} [2023-02-24 19:10:15,792][177155] DAMAGECOUNT value on done: 308439.0 [2023-02-24 19:10:15,792][177155] Sum rewards: 11.560, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.805', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon7': '0.050', 'weapon5': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.127', 'AMMO4': '0.135', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.694', 'WEAPON3': '0.850', 'HITCOUNT': '1.020', 'weapon2': '1.284', 'weapon3': '1.740', 'DAMAGECOUNT': '4.428', 'FRAGCOUNT': '11.000'} [2023-02-24 19:10:16,089][177155] DAMAGECOUNT value on done: 291745.0 [2023-02-24 19:10:16,090][177155] Sum rewards: 27.733, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.556', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.073', 'AMMO3': '0.110', 'weapon5': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.370', 'WEAPON3': '0.700', 'weapon2': '0.710', 'HITCOUNT': '1.770', 'weapon3': '2.256', 'DAMAGECOUNT': '7.203', 'FRAGCOUNT': '22.000'} [2023-02-24 19:10:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13801.4). Total num frames: 89821184. Throughput: 0: 3467.4. Samples: 22456300. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:10:16,376][177119] Avg episode reward: [(0, '15.478')] [2023-02-24 19:10:16,556][177153] Updated weights for policy 0, policy_version 21930 (0.0009) [2023-02-24 19:10:19,509][177153] Updated weights for policy 0, policy_version 21940 (0.0008) [2023-02-24 19:10:21,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13801.4). Total num frames: 89890816. Throughput: 0: 3467.8. Samples: 22466700. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:10:21,376][177119] Avg episode reward: [(0, '15.478')] [2023-02-24 19:10:22,436][177153] Updated weights for policy 0, policy_version 21950 (0.0008) [2023-02-24 19:10:23,384][177170] DAMAGECOUNT value on done: 301403.0 [2023-02-24 19:10:23,384][177170] Sum rewards: 11.966, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.070', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.097', 'weapon5': '0.112', 'weapon2': '0.190', 'WEAPON5': '0.200', 'weapon7': '0.264', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON4': '0.400', 'WEAPON7': '0.400', 'ARMOR': '0.465', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'weapon3': '0.990', 'weapon4': '1.790', 'DAMAGECOUNT': '3.144', 'FRAGCOUNT': '10.000'} [2023-02-24 19:10:23,687][177170] DAMAGECOUNT value on done: 303556.0 [2023-02-24 19:10:23,687][177170] Sum rewards: 11.364, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.113', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO3': '0.030', 'AMMO4': '0.056', 'weapon5': '0.076', 'weapon7': '0.112', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon2': '0.484', 'HITCOUNT': '0.530', 'weapon3': '0.672', 'weapon4': '1.576', 'DAMAGECOUNT': '2.610', 'FRAGCOUNT': '7.000'} [2023-02-24 19:10:24,303][177170] DAMAGECOUNT value on done: 297043.0 [2023-02-24 19:10:24,304][177170] Sum rewards: 15.499, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.063', 'AMMO5': '0.019', 'WEAPON1': '0.030', 'AMMO2': '0.031', 'AMMO3': '0.076', 'AMMO4': '0.153', 'weapon5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.302', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '1.080', 'weapon2': '1.340', 'weapon3': '1.788', 'DAMAGECOUNT': '4.242', 'FRAGCOUNT': '12.000'} [2023-02-24 19:10:24,381][177156] DAMAGECOUNT value on done: 299749.0 [2023-02-24 19:10:24,381][177156] Sum rewards: 16.361, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.041', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'weapon7': '0.136', 'weapon5': '0.182', 'AMMO4': '0.205', 'HEALTH': '0.206', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.900', 'weapon4': '0.960', 'weapon2': '0.990', 'weapon3': '1.014', 'DAMAGECOUNT': '3.942', 'FRAGCOUNT': '11.000'} [2023-02-24 19:10:24,424][177156] DAMAGECOUNT value on done: 292673.0 [2023-02-24 19:10:24,425][177156] Sum rewards: 11.571, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.332', 'AMMO2': '0.019', 'AMMO5': '0.020', 'AMMO4': '0.095', 'weapon4': '0.144', 'AMMO3': '0.150', 'WEAPON4': '0.200', 'weapon5': '0.292', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'weapon2': '1.004', 'HITCOUNT': '1.230', 'weapon3': '2.094', 'DAMAGECOUNT': '4.605', 'FRAGCOUNT': '11.500'} [2023-02-24 19:10:24,603][177170] DAMAGECOUNT value on done: 299186.0 [2023-02-24 19:10:24,603][177170] Sum rewards: 13.392, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.620', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO3': '0.063', 'weapon7': '0.066', 'AMMO4': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'weapon4': '0.400', 'HITCOUNT': '0.860', 'weapon2': '1.002', 'weapon3': '1.608', 'DAMAGECOUNT': '3.123', 'FRAGCOUNT': '10.000'} [2023-02-24 19:10:24,685][177156] DAMAGECOUNT value on done: 307758.0 [2023-02-24 19:10:24,686][177156] Sum rewards: 19.412, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.329', 'AMMO5': '0.021', 'AMMO2': '0.022', 'AMMO3': '0.067', 'weapon7': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.107', 'WEAPON4': '0.300', 'weapon5': '0.318', 'WEAPON3': '0.500', 'WEAPON5': '0.550', 'weapon4': '0.740', 'HITCOUNT': '0.840', 'weapon2': '1.068', 'weapon3': '1.212', 'DAMAGECOUNT': '5.352', 'FRAGCOUNT': '16.000'} [2023-02-24 19:10:24,729][177156] DAMAGECOUNT value on done: 294640.0 [2023-02-24 19:10:24,730][177156] Sum rewards: 10.738, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.420', 'AMMO2': '0.006', 'AMMO5': '0.022', 'AMMO4': '0.031', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon7': '0.176', 'WEAPON7': '0.200', 'weapon5': '0.314', 'weapon4': '0.356', 'WEAPON5': '0.500', 'weapon2': '0.534', 'WEAPON3': '0.600', 'HITCOUNT': '0.830', 'weapon3': '2.068', 'DAMAGECOUNT': '3.753', 'FRAGCOUNT': '8.000'} [2023-02-24 19:10:25,420][177153] Updated weights for policy 0, policy_version 21960 (0.0008) [2023-02-24 19:10:25,565][177158] DAMAGECOUNT value on done: 291240.0 [2023-02-24 19:10:25,565][177158] Sum rewards: 25.043, reward structure: {'DEATHCOUNT': '-9.000', 'WEAPON1': '0.020', 'AMMO5': '0.027', 'AMMO2': '0.042', 'AMMO3': '0.091', 'AMMO4': '0.208', 'WEAPON4': '0.300', 'weapon5': '0.434', 'HEALTH': '0.436', 'WEAPON3': '0.500', 'weapon4': '0.512', 'weapon2': '0.592', 'WEAPON5': '0.600', 'HITCOUNT': '1.220', 'weapon3': '1.970', 'DAMAGECOUNT': '6.090', 'FRAGCOUNT': '21.000'} [2023-02-24 19:10:25,863][177158] DAMAGECOUNT value on done: 291132.0 [2023-02-24 19:10:25,864][177158] Sum rewards: 14.863, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.710', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'AMMO3': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.126', 'weapon7': '0.134', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'weapon2': '0.582', 'HITCOUNT': '0.800', 'weapon3': '1.260', 'weapon4': '1.338', 'DAMAGECOUNT': '4.497', 'FRAGCOUNT': '12.000'} [2023-02-24 19:10:26,344][177158] DAMAGECOUNT value on done: 302530.0 [2023-02-24 19:10:26,345][177158] Sum rewards: 20.287, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.950', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO4': '0.050', 'AMMO3': '0.074', 'WEAPON4': '0.250', 'weapon5': '0.356', 'weapon4': '0.482', 'WEAPON3': '0.550', 'WEAPON5': '0.600', 'weapon2': '0.918', 'HITCOUNT': '1.050', 'weapon3': '1.724', 'DAMAGECOUNT': '6.129', 'FRAGCOUNT': '15.000'} [2023-02-24 19:10:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13801.4). Total num frames: 89960448. Throughput: 0: 3465.1. Samples: 22487512. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:10:26,376][177119] Avg episode reward: [(0, '15.408')] [2023-02-24 19:10:26,647][177158] DAMAGECOUNT value on done: 303021.0 [2023-02-24 19:10:26,648][177158] Sum rewards: 21.844, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.675', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.110', 'AMMO3': '0.168', 'AMMO4': '0.185', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.376', 'weapon2': '0.800', 'WEAPON3': '1.000', 'HITCOUNT': '1.290', 'weapon3': '2.070', 'DAMAGECOUNT': '5.922', 'FRAGCOUNT': '21.000'} [2023-02-24 19:10:28,375][177153] Updated weights for policy 0, policy_version 21970 (0.0008) [2023-02-24 19:10:29,511][177172] DAMAGECOUNT value on done: 294917.0 [2023-02-24 19:10:29,511][177172] Sum rewards: 6.533, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.590', 'AMMO5': '0.022', 'AMMO2': '0.053', 'weapon7': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.124', 'AMMO3': '0.197', 'WEAPON7': '0.200', 'AMMO4': '0.264', 'WEAPON5': '0.400', 'ARMOR': '0.453', 'weapon2': '0.614', 'WEAPON4': '0.700', 'weapon4': '0.898', 'WEAPON3': '1.300', 'HITCOUNT': '1.550', 'weapon3': '1.966', 'DAMAGECOUNT': '5.583', 'FRAGCOUNT': '10.000'} [2023-02-24 19:10:29,813][177172] DAMAGECOUNT value on done: 295850.0 [2023-02-24 19:10:29,814][177172] Sum rewards: 25.591, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.037', 'HEALTH': '0.076', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.250', 'weapon5': '0.254', 'weapon4': '0.356', 'WEAPON3': '0.500', 'weapon2': '0.870', 'HITCOUNT': '1.370', 'weapon3': '1.986', 'DAMAGECOUNT': '5.181', 'FRAGCOUNT': '19.000'} [2023-02-24 19:10:30,973][177154] DAMAGECOUNT value on done: 300605.0 [2023-02-24 19:10:30,973][177154] Sum rewards: 14.533, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.108', 'AMMO5': '0.027', 'AMMO2': '0.038', 'AMMO3': '0.159', 'AMMO4': '0.192', 'weapon5': '0.274', 'weapon4': '0.422', 'WEAPON4': '0.500', 'weapon2': '0.574', 'WEAPON5': '0.650', 'WEAPON3': '1.050', 'HITCOUNT': '1.230', 'weapon3': '2.242', 'DAMAGECOUNT': '5.532', 'FRAGCOUNT': '15.000'} [2023-02-24 19:10:31,276][177154] DAMAGECOUNT value on done: 306943.0 [2023-02-24 19:10:31,277][177154] Sum rewards: 12.083, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.044', 'AMMO5': '0.024', 'AMMO2': '0.041', 'weapon7': '0.084', 'AMMO3': '0.144', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon5': '0.166', 'WEAPON7': '0.200', 'AMMO4': '0.206', 'weapon4': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'weapon2': '0.976', 'HITCOUNT': '1.320', 'weapon3': '2.218', 'DAMAGECOUNT': '5.712', 'FRAGCOUNT': '13.500'} [2023-02-24 19:10:31,316][177172] DAMAGECOUNT value on done: 307429.0 [2023-02-24 19:10:31,317][177172] Sum rewards: 15.724, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.915', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO3': '0.067', 'AMMO4': '0.067', 'weapon5': '0.092', 'WEAPON4': '0.100', 'weapon7': '0.130', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.550', 'weapon2': '0.626', 'weapon4': '0.892', 'HITCOUNT': '0.980', 'weapon3': '1.502', 'DAMAGECOUNT': '4.311', 'FRAGCOUNT': '11.000'} [2023-02-24 19:10:31,340][177153] Updated weights for policy 0, policy_version 21980 (0.0008) [2023-02-24 19:10:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13815.3). Total num frames: 90030080. Throughput: 0: 3462.9. Samples: 22508206. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:10:31,376][177119] Avg episode reward: [(0, '15.561')] [2023-02-24 19:10:31,565][177154] DAMAGECOUNT value on done: 310333.0 [2023-02-24 19:10:31,565][177154] Sum rewards: 17.649, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.760', 'ARMOR': '0.004', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.020', 'WEAPON1': '0.020', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.134', 'WEAPON7': '0.200', 'weapon4': '0.208', 'weapon5': '0.254', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'weapon2': '0.672', 'HITCOUNT': '0.980', 'weapon3': '1.750', 'DAMAGECOUNT': '5.136', 'FRAGCOUNT': '13.000'} [2023-02-24 19:10:31,612][177172] DAMAGECOUNT value on done: 299382.0 [2023-02-24 19:10:31,613][177172] Sum rewards: 24.811, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.478', 'AMMO2': '0.005', 'AMMO5': '0.017', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'weapon5': '0.060', 'AMMO3': '0.138', 'weapon7': '0.166', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.338', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'weapon2': '1.050', 'HITCOUNT': '1.400', 'weapon3': '1.990', 'DAMAGECOUNT': '6.108', 'FRAGCOUNT': '21.000'} [2023-02-24 19:10:31,863][177154] DAMAGECOUNT value on done: 307910.0 [2023-02-24 19:10:31,864][177154] Sum rewards: 19.721, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.580', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.031', 'weapon5': '0.092', 'WEAPON4': '0.100', 'weapon7': '0.104', 'AMMO3': '0.117', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.780', 'WEAPON3': '0.850', 'weapon4': '0.948', 'HITCOUNT': '1.450', 'weapon3': '1.752', 'DAMAGECOUNT': '5.460', 'FRAGCOUNT': '17.000'} [2023-02-24 19:10:32,126][177157] DAMAGECOUNT value on done: 308938.0 [2023-02-24 19:10:32,126][177157] Sum rewards: 20.415, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.060', 'AMMO2': '0.012', 'AMMO5': '0.025', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.133', 'weapon5': '0.210', 'weapon4': '0.218', 'WEAPON5': '0.500', 'weapon2': '0.758', 'WEAPON3': '0.900', 'HITCOUNT': '1.210', 'weapon3': '2.326', 'DAMAGECOUNT': '5.325', 'FRAGCOUNT': '18.000'} [2023-02-24 19:10:32,350][177171] DAMAGECOUNT value on done: 295883.0 [2023-02-24 19:10:32,351][177171] Sum rewards: 16.331, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.139', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'weapon4': '0.110', 'AMMO3': '0.139', 'weapon5': '0.292', 'WEAPON5': '0.300', 'WEAPON3': '0.950', 'weapon2': '1.078', 'HITCOUNT': '1.230', 'weapon3': '2.224', 'DAMAGECOUNT': '4.647', 'FRAGCOUNT': '17.000'} [2023-02-24 19:10:32,362][177171] DAMAGECOUNT value on done: 295980.0 [2023-02-24 19:10:32,362][177171] Sum rewards: 26.100, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.350', 'ARMOR': '0.004', 'AMMO2': '0.015', 'AMMO5': '0.025', 'WEAPON1': '0.030', 'AMMO4': '0.077', 'weapon4': '0.128', 'AMMO3': '0.142', 'WEAPON4': '0.200', 'weapon5': '0.396', 'WEAPON5': '0.600', 'weapon2': '0.848', 'WEAPON3': '0.900', 'HITCOUNT': '1.170', 'weapon3': '2.038', 'DAMAGECOUNT': '7.377', 'FRAGCOUNT': '21.000'} [2023-02-24 19:10:32,422][177157] DAMAGECOUNT value on done: 293298.0 [2023-02-24 19:10:32,423][177157] Sum rewards: 10.706, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.782', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.162', 'weapon5': '0.276', 'WEAPON4': '0.450', 'ARMOR': '0.451', 'WEAPON5': '0.500', 'weapon4': '0.706', 'weapon2': '0.716', 'WEAPON3': '0.900', 'HITCOUNT': '1.170', 'weapon3': '1.968', 'DAMAGECOUNT': '4.968', 'FRAGCOUNT': '12.000'} [2023-02-24 19:10:32,435][177157] DAMAGECOUNT value on done: 294266.0 [2023-02-24 19:10:32,435][177157] Sum rewards: 18.263, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.520', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.037', 'AMMO3': '0.061', 'weapon7': '0.098', 'AMMO4': '0.184', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'weapon2': '0.876', 'HITCOUNT': '0.890', 'weapon4': '0.918', 'weapon3': '1.078', 'DAMAGECOUNT': '4.893', 'FRAGCOUNT': '14.000'} [2023-02-24 19:10:32,662][177171] DAMAGECOUNT value on done: 297373.0 [2023-02-24 19:10:32,662][177171] Sum rewards: 29.584, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.400', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'AMMO3': '0.125', 'weapon5': '0.194', 'WEAPON5': '0.250', 'weapon4': '0.254', 'WEAPON3': '0.800', 'weapon2': '0.932', 'HITCOUNT': '1.690', 'weapon3': '2.294', 'DAMAGECOUNT': '7.833', 'FRAGCOUNT': '23.000'} [2023-02-24 19:10:32,673][177171] DAMAGECOUNT value on done: 299381.0 [2023-02-24 19:10:32,673][177171] Sum rewards: 8.799, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.880', 'AMMO5': '0.013', 'AMMO2': '0.024', 'AMMO3': '0.090', 'weapon7': '0.092', 'weapon5': '0.116', 'AMMO4': '0.120', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'HITCOUNT': '0.740', 'weapon4': '0.928', 'weapon2': '1.116', 'weapon3': '1.380', 'DAMAGECOUNT': '3.519', 'FRAGCOUNT': '8.000'} [2023-02-24 19:10:32,736][177157] DAMAGECOUNT value on done: 294012.0 [2023-02-24 19:10:32,736][177157] Sum rewards: 13.105, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.168', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO3': '0.094', 'AMMO4': '0.185', 'WEAPON4': '0.300', 'weapon5': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.418', 'WEAPON3': '0.600', 'ARMOR': '0.850', 'HITCOUNT': '0.980', 'weapon4': '1.044', 'weapon3': '1.704', 'DAMAGECOUNT': '3.834', 'FRAGCOUNT': '10.000'} [2023-02-24 19:10:34,298][177153] Updated weights for policy 0, policy_version 21990 (0.0008) [2023-02-24 19:10:34,557][177155] DAMAGECOUNT value on done: 306705.0 [2023-02-24 19:10:34,558][177155] Sum rewards: 18.157, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.865', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.010', 'AMMO3': '0.090', 'weapon5': '0.246', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'HITCOUNT': '1.200', 'weapon2': '1.288', 'weapon3': '2.174', 'DAMAGECOUNT': '4.965', 'FRAGCOUNT': '14.000'} [2023-02-24 19:10:34,860][177155] DAMAGECOUNT value on done: 308337.0 [2023-02-24 19:10:34,860][177155] Sum rewards: 24.340, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.550', 'AMMO5': '0.014', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.108', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.148', 'WEAPON7': '0.200', 'weapon2': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'weapon4': '1.052', 'HITCOUNT': '1.390', 'weapon3': '1.884', 'DAMAGECOUNT': '6.384', 'FRAGCOUNT': '21.000'} [2023-02-24 19:10:35,146][177155] DAMAGECOUNT value on done: 309876.0 [2023-02-24 19:10:35,147][177155] Sum rewards: 16.818, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.521', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.045', 'weapon7': '0.062', 'AMMO3': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'weapon2': '0.644', 'HITCOUNT': '0.860', 'weapon4': '0.984', 'weapon3': '1.722', 'DAMAGECOUNT': '4.311', 'FRAGCOUNT': '13.000'} [2023-02-24 19:10:35,455][177155] DAMAGECOUNT value on done: 293536.0 [2023-02-24 19:10:35,456][177155] Sum rewards: 18.481, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.262', 'AMMO5': '0.024', 'AMMO2': '0.024', 'WEAPON4': '0.050', 'weapon4': '0.110', 'AMMO4': '0.120', 'AMMO3': '0.188', 'weapon5': '0.216', 'weapon2': '0.308', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'HITCOUNT': '1.260', 'weapon3': '2.870', 'DAMAGECOUNT': '5.373', 'FRAGCOUNT': '18.000'} [2023-02-24 19:10:36,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13815.3). Total num frames: 90099712. Throughput: 0: 3464.0. Samples: 22518644. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:10:36,376][177119] Avg episode reward: [(0, '16.177')] [2023-02-24 19:10:37,260][177153] Updated weights for policy 0, policy_version 22000 (0.0009) [2023-02-24 19:10:40,232][177153] Updated weights for policy 0, policy_version 22010 (0.0008) [2023-02-24 19:10:41,376][177119] Fps is (10 sec: 13516.9, 60 sec: 13858.2, 300 sec: 13801.4). Total num frames: 90165248. Throughput: 0: 3466.3. Samples: 22539454. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:10:41,376][177119] Avg episode reward: [(0, '16.177')] [2023-02-24 19:10:42,758][177170] DAMAGECOUNT value on done: 303005.0 [2023-02-24 19:10:42,759][177170] Sum rewards: 15.473, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.510', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO3': '0.075', 'AMMO4': '0.077', 'weapon4': '0.080', 'WEAPON4': '0.150', 'weapon5': '0.172', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'HITCOUNT': '1.030', 'weapon2': '1.314', 'weapon3': '1.506', 'DAMAGECOUNT': '4.806', 'FRAGCOUNT': '12.000'} [2023-02-24 19:10:43,060][177170] DAMAGECOUNT value on done: 304743.0 [2023-02-24 19:10:43,060][177170] Sum rewards: 11.618, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.989', 'AMMO5': '0.014', 'AMMO2': '0.020', 'weapon7': '0.084', 'AMMO4': '0.098', 'AMMO3': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.156', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.618', 'WEAPON3': '0.750', 'weapon2': '0.884', 'HITCOUNT': '0.990', 'weapon3': '1.740', 'DAMAGECOUNT': '3.561', 'FRAGCOUNT': '11.000'} [2023-02-24 19:10:43,179][177153] Updated weights for policy 0, policy_version 22020 (0.0008) [2023-02-24 19:10:43,777][177170] DAMAGECOUNT value on done: 298596.0 [2023-02-24 19:10:43,777][177170] Sum rewards: 18.924, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.865', 'AMMO2': '0.007', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.036', 'weapon7': '0.048', 'AMMO3': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.244', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'weapon4': '0.576', 'weapon2': '0.996', 'HITCOUNT': '1.220', 'weapon3': '1.470', 'DAMAGECOUNT': '4.659', 'FRAGCOUNT': '15.000'} [2023-02-24 19:10:43,823][177156] DAMAGECOUNT value on done: 301991.0 [2023-02-24 19:10:43,824][177156] Sum rewards: 18.953, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.741', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.032', 'WEAPON4': '0.100', 'weapon4': '0.148', 'AMMO3': '0.157', 'weapon5': '0.160', 'WEAPON5': '0.350', 'weapon2': '0.654', 'WEAPON3': '1.050', 'HITCOUNT': '1.690', 'weapon3': '2.606', 'DAMAGECOUNT': '6.726', 'FRAGCOUNT': '16.000'} [2023-02-24 19:10:43,869][177156] DAMAGECOUNT value on done: 294531.0 [2023-02-24 19:10:43,869][177156] Sum rewards: 25.791, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO4': '0.067', 'HEALTH': '0.094', 'AMMO3': '0.125', 'weapon5': '0.192', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'weapon2': '1.232', 'HITCOUNT': '1.290', 'weapon3': '2.212', 'DAMAGECOUNT': '5.574', 'FRAGCOUNT': '22.000'} [2023-02-24 19:10:44,073][177170] DAMAGECOUNT value on done: 300414.0 [2023-02-24 19:10:44,074][177170] Sum rewards: 11.683, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.200', 'AMMO2': '0.014', 'AMMO5': '0.019', 'AMMO4': '0.068', 'weapon7': '0.074', 'AMMO3': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.124', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.370', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'weapon4': '0.624', 'HITCOUNT': '0.810', 'weapon3': '1.222', 'DAMAGECOUNT': '3.684', 'FRAGCOUNT': '10.000'} [2023-02-24 19:10:44,127][177156] DAMAGECOUNT value on done: 310004.0 [2023-02-24 19:10:44,128][177156] Sum rewards: 23.273, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'weapon7': '0.068', 'AMMO4': '0.084', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'weapon5': '0.142', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.272', 'WEAPON7': '0.300', 'HEALTH': '0.370', 'WEAPON3': '0.550', 'weapon2': '1.168', 'HITCOUNT': '1.540', 'weapon3': '2.088', 'DAMAGECOUNT': '6.738', 'FRAGCOUNT': '16.000'} [2023-02-24 19:10:44,173][177156] DAMAGECOUNT value on done: 296592.0 [2023-02-24 19:10:44,174][177156] Sum rewards: 21.066, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.730', 'AMMO2': '0.008', 'AMMO5': '0.015', 'weapon4': '0.020', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.154', 'weapon5': '0.228', 'WEAPON5': '0.400', 'weapon2': '1.016', 'WEAPON3': '1.050', 'HITCOUNT': '1.310', 'weapon3': '2.398', 'DAMAGECOUNT': '5.856', 'FRAGCOUNT': '20.000'} [2023-02-24 19:10:44,918][177158] DAMAGECOUNT value on done: 291879.0 [2023-02-24 19:10:44,918][177158] Sum rewards: 9.015, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.430', 'AMMO2': '0.009', 'AMMO5': '0.011', 'WEAPON1': '0.030', 'AMMO4': '0.045', 'weapon5': '0.046', 'AMMO3': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'HITCOUNT': '0.630', 'weapon2': '1.082', 'weapon4': '1.094', 'weapon3': '1.268', 'DAMAGECOUNT': '1.917', 'FRAGCOUNT': '8.000'} [2023-02-24 19:10:45,223][177158] DAMAGECOUNT value on done: 292190.0 [2023-02-24 19:10:45,224][177158] Sum rewards: 7.858, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.728', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.029', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'AMMO4': '0.142', 'weapon5': '0.180', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'weapon2': '0.744', 'HITCOUNT': '0.800', 'weapon4': '0.804', 'weapon3': '1.446', 'DAMAGECOUNT': '3.174', 'FRAGCOUNT': '7.000'} [2023-02-24 19:10:45,590][177158] DAMAGECOUNT value on done: 303392.0 [2023-02-24 19:10:45,591][177158] Sum rewards: 11.184, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.860', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon7': '0.074', 'AMMO3': '0.083', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.174', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'HITCOUNT': '0.600', 'weapon2': '0.990', 'weapon3': '1.560', 'DAMAGECOUNT': '2.586', 'FRAGCOUNT': '10.000'} [2023-02-24 19:10:45,903][177158] DAMAGECOUNT value on done: 304778.0 [2023-02-24 19:10:45,903][177158] Sum rewards: 22.699, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.100', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.298', 'weapon5': '0.310', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '1.090', 'weapon2': '1.280', 'weapon3': '1.796', 'DAMAGECOUNT': '5.271', 'FRAGCOUNT': '17.000'} [2023-02-24 19:10:46,151][177153] Updated weights for policy 0, policy_version 22030 (0.0008) [2023-02-24 19:10:46,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13858.1, 300 sec: 13801.4). Total num frames: 90234880. Throughput: 0: 3467.0. Samples: 22560304. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:10:46,376][177119] Avg episode reward: [(0, '16.412')] [2023-02-24 19:10:48,919][177172] DAMAGECOUNT value on done: 296682.0 [2023-02-24 19:10:48,919][177172] Sum rewards: 19.118, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.406', 'ARMOR': '0.008', 'weapon7': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.034', 'AMMO3': '0.068', 'AMMO4': '0.170', 'weapon5': '0.242', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'weapon2': '0.838', 'weapon4': '0.914', 'HITCOUNT': '1.180', 'weapon3': '1.448', 'DAMAGECOUNT': '5.295', 'FRAGCOUNT': '14.000'} [2023-02-24 19:10:49,090][177153] Updated weights for policy 0, policy_version 22040 (0.0008) [2023-02-24 19:10:49,221][177172] DAMAGECOUNT value on done: 297704.0 [2023-02-24 19:10:49,221][177172] Sum rewards: 18.551, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.533', 'AMMO2': '0.021', 'AMMO5': '0.030', 'weapon7': '0.052', 'AMMO3': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.103', 'WEAPON4': '0.250', 'weapon5': '0.266', 'weapon4': '0.330', 'WEAPON3': '0.450', 'WEAPON5': '0.500', 'weapon2': '1.148', 'HITCOUNT': '1.260', 'weapon3': '1.492', 'DAMAGECOUNT': '5.562', 'FRAGCOUNT': '14.000'} [2023-02-24 19:10:50,295][177154] DAMAGECOUNT value on done: 301820.0 [2023-02-24 19:10:50,295][177154] Sum rewards: 9.832, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.720', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon7': '0.050', 'AMMO3': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.140', 'weapon5': '0.160', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.446', 'WEAPON3': '0.750', 'HITCOUNT': '0.970', 'weapon2': '1.090', 'weapon3': '1.420', 'DAMAGECOUNT': '3.645', 'FRAGCOUNT': '10.000'} [2023-02-24 19:10:50,597][177154] DAMAGECOUNT value on done: 307989.0 [2023-02-24 19:10:50,597][177154] Sum rewards: 11.585, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.030', 'ARMOR': '0.005', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.032', 'AMMO3': '0.055', 'weapon5': '0.060', 'weapon7': '0.066', 'weapon4': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'HITCOUNT': '0.710', 'weapon2': '1.080', 'weapon3': '1.182', 'DAMAGECOUNT': '3.138', 'FRAGCOUNT': '10.000'} [2023-02-24 19:10:50,717][177172] DAMAGECOUNT value on done: 310626.0 [2023-02-24 19:10:50,717][177172] Sum rewards: 30.505, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.352', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.123', 'WEAPON4': '0.200', 'weapon4': '0.292', 'WEAPON5': '0.350', 'weapon5': '0.374', 'ARMOR': '0.464', 'weapon2': '0.650', 'WEAPON3': '0.800', 'HITCOUNT': '1.800', 'weapon3': '2.306', 'DAMAGECOUNT': '9.582', 'FRAGCOUNT': '23.000'} [2023-02-24 19:10:50,888][177154] DAMAGECOUNT value on done: 311957.0 [2023-02-24 19:10:50,889][177154] Sum rewards: 18.729, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.700', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon7': '0.064', 'AMMO3': '0.070', 'AMMO4': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.168', 'WEAPON7': '0.200', 'weapon5': '0.240', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'HITCOUNT': '0.880', 'weapon2': '1.530', 'weapon3': '1.666', 'DAMAGECOUNT': '4.872', 'FRAGCOUNT': '16.000'} [2023-02-24 19:10:51,024][177172] DAMAGECOUNT value on done: 301285.0 [2023-02-24 19:10:51,025][177172] Sum rewards: 19.352, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.127', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.044', 'AMMO3': '0.099', 'weapon4': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon5': '0.300', 'WEAPON3': '0.700', 'weapon2': '1.086', 'HITCOUNT': '1.390', 'weapon3': '2.118', 'DAMAGECOUNT': '5.709', 'FRAGCOUNT': '16.000'} [2023-02-24 19:10:51,195][177154] DAMAGECOUNT value on done: 309799.0 [2023-02-24 19:10:51,196][177154] Sum rewards: 18.691, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'weapon4': '0.146', 'weapon5': '0.226', 'WEAPON5': '0.250', 'HEALTH': '0.610', 'WEAPON3': '0.800', 'weapon2': '0.926', 'HITCOUNT': '1.280', 'weapon3': '2.194', 'DAMAGECOUNT': '5.667', 'FRAGCOUNT': '16.000'} [2023-02-24 19:10:51,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13801.4). Total num frames: 90304512. Throughput: 0: 3466.5. Samples: 22570720. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:10:51,376][177119] Avg episode reward: [(0, '16.928')] [2023-02-24 19:10:51,459][177157] DAMAGECOUNT value on done: 310531.0 [2023-02-24 19:10:51,459][177157] Sum rewards: 16.721, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.720', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.080', 'AMMO3': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.160', 'AMMO4': '0.180', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.438', 'WEAPON3': '0.550', 'weapon2': '0.608', 'weapon4': '0.904', 'HITCOUNT': '1.060', 'weapon3': '1.546', 'DAMAGECOUNT': '4.779', 'FRAGCOUNT': '12.000'} [2023-02-24 19:10:51,751][177157] DAMAGECOUNT value on done: 295469.0 [2023-02-24 19:10:51,752][177157] Sum rewards: 22.148, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.085', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon7': '0.054', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.148', 'AMMO4': '0.156', 'weapon5': '0.178', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'ARMOR': '0.456', 'weapon4': '0.498', 'weapon2': '0.642', 'WEAPON3': '0.900', 'HITCOUNT': '1.520', 'weapon3': '2.232', 'DAMAGECOUNT': '6.513', 'FRAGCOUNT': '20.000'} [2023-02-24 19:10:51,765][177157] DAMAGECOUNT value on done: 296150.0 [2023-02-24 19:10:51,766][177157] Sum rewards: 22.254, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.055', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.070', 'weapon7': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.276', 'WEAPON5': '0.400', 'weapon4': '0.400', 'WEAPON3': '0.550', 'weapon2': '0.660', 'HITCOUNT': '1.210', 'weapon3': '1.574', 'DAMAGECOUNT': '5.652', 'FRAGCOUNT': '17.000'} [2023-02-24 19:10:51,816][177171] DAMAGECOUNT value on done: 298278.0 [2023-02-24 19:10:51,816][177171] Sum rewards: 23.633, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.244', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon4': '0.026', 'WEAPON4': '0.050', 'AMMO4': '0.084', 'AMMO3': '0.126', 'weapon5': '0.140', 'WEAPON5': '0.300', 'WEAPON3': '0.800', 'weapon2': '1.502', 'HITCOUNT': '1.820', 'weapon3': '2.042', 'DAMAGECOUNT': '7.185', 'FRAGCOUNT': '18.000'} [2023-02-24 19:10:51,827][177171] DAMAGECOUNT value on done: 298323.0 [2023-02-24 19:10:51,827][177171] Sum rewards: 24.062, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.007', 'AMMO2': '0.031', 'AMMO3': '0.123', 'weapon5': '0.152', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HEALTH': '0.356', 'weapon4': '0.630', 'WEAPON3': '0.650', 'weapon2': '0.842', 'HITCOUNT': '1.520', 'weapon3': '1.918', 'DAMAGECOUNT': '7.029', 'FRAGCOUNT': '20.000'} [2023-02-24 19:10:52,073][177157] DAMAGECOUNT value on done: 295501.0 [2023-02-24 19:10:52,073][177157] Sum rewards: 14.003, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.330', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'AMMO5': '0.035', 'AMMO3': '0.140', 'AMMO4': '0.159', 'weapon4': '0.284', 'WEAPON4': '0.350', 'weapon5': '0.442', 'weapon2': '0.780', 'WEAPON5': '0.800', 'WEAPON3': '0.900', 'HITCOUNT': '0.920', 'weapon3': '1.994', 'DAMAGECOUNT': '4.467', 'FRAGCOUNT': '13.000'} [2023-02-24 19:10:52,077][177153] Updated weights for policy 0, policy_version 22050 (0.0008) [2023-02-24 19:10:52,124][177171] DAMAGECOUNT value on done: 298863.0 [2023-02-24 19:10:52,125][177171] Sum rewards: 12.471, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.996', 'AMMO2': '0.023', 'AMMO5': '0.030', 'weapon7': '0.070', 'AMMO4': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.126', 'AMMO3': '0.195', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.388', 'WEAPON5': '0.650', 'weapon4': '0.966', 'HITCOUNT': '1.110', 'WEAPON3': '1.250', 'weapon3': '2.034', 'DAMAGECOUNT': '4.470', 'FRAGCOUNT': '16.000'} [2023-02-24 19:10:52,136][177171] DAMAGECOUNT value on done: 300828.0 [2023-02-24 19:10:52,136][177171] Sum rewards: 11.315, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.135', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'weapon7': '0.046', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.104', 'AMMO3': '0.116', 'AMMO4': '0.188', 'weapon2': '0.412', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'WEAPON3': '0.750', 'HITCOUNT': '1.050', 'weapon4': '1.250', 'weapon3': '1.418', 'DAMAGECOUNT': '4.341', 'FRAGCOUNT': '13.000'} [2023-02-24 19:10:53,925][177155] DAMAGECOUNT value on done: 307714.0 [2023-02-24 19:10:53,926][177155] Sum rewards: 12.763, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.798', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO3': '0.074', 'weapon5': '0.132', 'weapon7': '0.152', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.650', 'weapon3': '1.052', 'weapon2': '1.912', 'DAMAGECOUNT': '3.027', 'FRAGCOUNT': '11.000'} [2023-02-24 19:10:54,234][177155] DAMAGECOUNT value on done: 310738.0 [2023-02-24 19:10:54,235][177155] Sum rewards: 28.915, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.022', 'AMMO5': '0.012', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'weapon7': '0.060', 'AMMO4': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.128', 'weapon4': '0.130', 'weapon5': '0.142', 'WEAPON5': '0.250', 'WEAPON3': '0.750', 'weapon2': '1.526', 'HITCOUNT': '1.580', 'weapon3': '1.964', 'DAMAGECOUNT': '7.203', 'FRAGCOUNT': '23.000'} [2023-02-24 19:10:54,537][177155] DAMAGECOUNT value on done: 312400.0 [2023-02-24 19:10:54,537][177155] Sum rewards: 24.745, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.862', 'AMMO5': '0.015', 'AMMO2': '0.027', 'weapon7': '0.048', 'weapon5': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.135', 'AMMO3': '0.169', 'WEAPON7': '0.200', 'weapon2': '0.224', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.952', 'WEAPON3': '1.100', 'HITCOUNT': '1.930', 'weapon3': '2.406', 'DAMAGECOUNT': '7.572', 'FRAGCOUNT': '22.000'} [2023-02-24 19:10:54,843][177155] DAMAGECOUNT value on done: 294783.0 [2023-02-24 19:10:54,843][177155] Sum rewards: 13.071, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.300', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.011', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.088', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'weapon4': '0.366', 'WEAPON3': '0.700', 'HITCOUNT': '0.850', 'weapon2': '0.910', 'weapon3': '1.686', 'DAMAGECOUNT': '3.741', 'FRAGCOUNT': '11.000'} [2023-02-24 19:10:55,026][177153] Updated weights for policy 0, policy_version 22060 (0.0008) [2023-02-24 19:10:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13801.4). Total num frames: 90374144. Throughput: 0: 3463.8. Samples: 22591352. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:10:56,376][177119] Avg episode reward: [(0, '17.088')] [2023-02-24 19:10:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000022064_90374144.pth... [2023-02-24 19:10:56,438][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000021255_87060480.pth [2023-02-24 19:10:58,000][177153] Updated weights for policy 0, policy_version 22070 (0.0009) [2023-02-24 19:11:00,973][177153] Updated weights for policy 0, policy_version 22080 (0.0008) [2023-02-24 19:11:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13801.4). Total num frames: 90443776. Throughput: 0: 3462.5. Samples: 22612110. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:11:01,376][177119] Avg episode reward: [(0, '17.088')] [2023-02-24 19:11:02,185][177170] DAMAGECOUNT value on done: 304865.0 [2023-02-24 19:11:02,185][177170] Sum rewards: 19.101, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.810', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.012', 'weapon4': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.141', 'weapon5': '0.146', 'WEAPON5': '0.350', 'WEAPON3': '0.900', 'weapon2': '1.066', 'HITCOUNT': '1.410', 'weapon3': '2.428', 'DAMAGECOUNT': '5.580', 'FRAGCOUNT': '17.000'} [2023-02-24 19:11:02,482][177170] DAMAGECOUNT value on done: 305736.0 [2023-02-24 19:11:02,482][177170] Sum rewards: 8.891, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.007', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO3': '0.082', 'weapon5': '0.108', 'AMMO4': '0.122', 'weapon7': '0.158', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.770', 'weapon4': '1.194', 'weapon3': '1.566', 'DAMAGECOUNT': '2.979', 'FRAGCOUNT': '8.000'} [2023-02-24 19:11:03,171][177170] DAMAGECOUNT value on done: 300285.0 [2023-02-24 19:11:03,171][177170] Sum rewards: 18.929, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.770', 'AMMO2': '0.007', 'AMMO5': '0.012', 'AMMO4': '0.035', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.077', 'weapon4': '0.082', 'weapon5': '0.264', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '0.980', 'weapon2': '1.504', 'weapon3': '1.780', 'DAMAGECOUNT': '5.067', 'FRAGCOUNT': '14.000'} [2023-02-24 19:11:03,295][177156] DAMAGECOUNT value on done: 303875.0 [2023-02-24 19:11:03,296][177156] Sum rewards: 18.277, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.018', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO3': '0.117', 'AMMO4': '0.125', 'WEAPON4': '0.200', 'weapon4': '0.236', 'weapon5': '0.374', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'weapon2': '1.062', 'HITCOUNT': '1.450', 'weapon3': '1.878', 'DAMAGECOUNT': '5.652', 'FRAGCOUNT': '16.000'} [2023-02-24 19:11:03,321][177156] DAMAGECOUNT value on done: 295932.0 [2023-02-24 19:11:03,321][177156] Sum rewards: 16.693, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.660', 'AMMO5': '0.007', 'AMMO2': '0.033', 'AMMO3': '0.061', 'weapon5': '0.098', 'weapon7': '0.126', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'weapon2': '0.856', 'HITCOUNT': '0.900', 'weapon3': '0.978', 'weapon4': '1.036', 'DAMAGECOUNT': '4.203', 'FRAGCOUNT': '14.000'} [2023-02-24 19:11:03,458][177170] DAMAGECOUNT value on done: 301678.0 [2023-02-24 19:11:03,458][177170] Sum rewards: 10.018, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.102', 'AMMO5': '0.010', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'AMMO3': '0.106', 'AMMO4': '0.128', 'weapon4': '0.242', 'WEAPON4': '0.250', 'weapon5': '0.260', 'WEAPON5': '0.300', 'WEAPON3': '0.800', 'weapon2': '0.818', 'HITCOUNT': '0.930', 'weapon3': '1.928', 'DAMAGECOUNT': '3.792', 'FRAGCOUNT': '10.000'} [2023-02-24 19:11:03,603][177156] DAMAGECOUNT value on done: 311394.0 [2023-02-24 19:11:03,603][177156] Sum rewards: 12.300, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.281', 'AMMO2': '0.015', 'AMMO5': '0.019', 'WEAPON1': '0.030', 'AMMO4': '0.076', 'AMMO3': '0.091', 'WEAPON4': '0.200', 'weapon5': '0.238', 'WEAPON5': '0.450', 'weapon4': '0.476', 'WEAPON3': '0.600', 'weapon2': '0.918', 'HITCOUNT': '1.030', 'weapon3': '2.018', 'DAMAGECOUNT': '4.170', 'FRAGCOUNT': '10.500'} [2023-02-24 19:11:03,630][177156] DAMAGECOUNT value on done: 298725.0 [2023-02-24 19:11:03,630][177156] Sum rewards: 21.321, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.608', 'AMMO5': '0.025', 'AMMO2': '0.038', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.166', 'AMMO4': '0.189', 'weapon5': '0.264', 'WEAPON4': '0.300', 'weapon4': '0.446', 'weapon2': '0.562', 'WEAPON5': '0.650', 'WEAPON3': '1.150', 'HITCOUNT': '1.460', 'weapon3': '2.152', 'DAMAGECOUNT': '6.399', 'FRAGCOUNT': '21.000'} [2023-02-24 19:11:03,921][177153] Updated weights for policy 0, policy_version 22090 (0.0008) [2023-02-24 19:11:04,388][177158] DAMAGECOUNT value on done: 294242.0 [2023-02-24 19:11:04,388][177158] Sum rewards: 22.693, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.985', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.141', 'AMMO4': '0.150', 'weapon5': '0.156', 'weapon4': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'ARMOR': '0.461', 'WEAPON3': '0.850', 'weapon2': '1.126', 'HITCOUNT': '1.450', 'weapon3': '2.060', 'DAMAGECOUNT': '7.089', 'FRAGCOUNT': '19.000'} [2023-02-24 19:11:04,685][177158] DAMAGECOUNT value on done: 293801.0 [2023-02-24 19:11:04,686][177158] Sum rewards: 18.400, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.200', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.039', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'weapon5': '0.222', 'weapon4': '0.238', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'HITCOUNT': '0.990', 'weapon2': '1.242', 'weapon3': '1.972', 'DAMAGECOUNT': '4.833', 'FRAGCOUNT': '16.000'} [2023-02-24 19:11:05,015][177158] DAMAGECOUNT value on done: 305992.0 [2023-02-24 19:11:05,015][177158] Sum rewards: 26.108, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.165', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.100', 'weapon5': '0.178', 'WEAPON4': '0.200', 'weapon4': '0.274', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'weapon2': '1.270', 'HITCOUNT': '1.630', 'weapon3': '2.030', 'DAMAGECOUNT': '7.800', 'FRAGCOUNT': '21.000'} [2023-02-24 19:11:05,313][177158] DAMAGECOUNT value on done: 306119.0 [2023-02-24 19:11:05,313][177158] Sum rewards: 12.059, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.335', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon7': '0.048', 'AMMO3': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.136', 'WEAPON7': '0.200', 'weapon5': '0.212', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.416', 'weapon2': '0.504', 'WEAPON3': '0.750', 'HITCOUNT': '0.920', 'weapon3': '2.008', 'DAMAGECOUNT': '4.023', 'FRAGCOUNT': '12.000'} [2023-02-24 19:11:06,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13801.4). Total num frames: 90513408. Throughput: 0: 3462.2. Samples: 22622500. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:11:06,376][177119] Avg episode reward: [(0, '17.070')] [2023-02-24 19:11:06,831][177153] Updated weights for policy 0, policy_version 22100 (0.0008) [2023-02-24 19:11:07,727][177155] Large shaping reward 2.603 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5730000000000001, 191.0)] [2023-02-24 19:11:08,414][177172] DAMAGECOUNT value on done: 298096.0 [2023-02-24 19:11:08,415][177172] Sum rewards: 15.236, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.128', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.052', 'weapon7': '0.100', 'AMMO3': '0.107', 'AMMO4': '0.110', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon2': '0.406', 'WEAPON3': '0.700', 'HITCOUNT': '1.120', 'weapon4': '1.280', 'weapon3': '1.732', 'DAMAGECOUNT': '4.242', 'FRAGCOUNT': '13.000'} [2023-02-24 19:11:08,710][177172] DAMAGECOUNT value on done: 299374.0 [2023-02-24 19:11:08,710][177172] Sum rewards: 11.088, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.420', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO3': '0.097', 'AMMO4': '0.146', 'weapon5': '0.210', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.482', 'WEAPON3': '0.600', 'weapon4': '0.764', 'HITCOUNT': '0.940', 'weapon3': '1.112', 'DAMAGECOUNT': '5.001', 'FRAGCOUNT': '9.000'} [2023-02-24 19:11:09,723][177154] DAMAGECOUNT value on done: 303505.0 [2023-02-24 19:11:09,724][177154] Sum rewards: 23.174, reward structure: {'DEATHCOUNT': '-6.750', 'ARMOR': '0.004', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'weapon7': '0.050', 'AMMO3': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'weapon5': '0.230', 'HEALTH': '0.263', 'WEAPON5': '0.300', 'weapon4': '0.534', 'WEAPON3': '0.550', 'weapon2': '0.858', 'HITCOUNT': '1.360', 'weapon3': '1.978', 'DAMAGECOUNT': '5.055', 'FRAGCOUNT': '18.000'} [2023-02-24 19:11:09,762][177153] Updated weights for policy 0, policy_version 22110 (0.0008) [2023-02-24 19:11:10,037][177154] DAMAGECOUNT value on done: 309595.0 [2023-02-24 19:11:10,038][177154] Sum rewards: 19.142, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.384', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.036', 'AMMO3': '0.091', 'weapon7': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.179', 'WEAPON7': '0.200', 'weapon5': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'weapon2': '0.756', 'weapon4': '0.892', 'HITCOUNT': '1.060', 'weapon3': '1.374', 'DAMAGECOUNT': '4.818', 'FRAGCOUNT': '15.000'} [2023-02-24 19:11:10,185][177172] DAMAGECOUNT value on done: 312796.0 [2023-02-24 19:11:10,185][177172] Sum rewards: 22.198, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.625', 'AMMO2': '0.005', 'AMMO5': '0.014', 'weapon4': '0.014', 'AMMO4': '0.027', 'WEAPON4': '0.100', 'weapon5': '0.146', 'AMMO3': '0.153', 'WEAPON5': '0.400', 'ARMOR': '0.400', 'weapon2': '0.830', 'WEAPON3': '1.050', 'HITCOUNT': '1.550', 'weapon3': '2.624', 'DAMAGECOUNT': '6.510', 'FRAGCOUNT': '19.000'} [2023-02-24 19:11:10,347][177154] DAMAGECOUNT value on done: 314074.0 [2023-02-24 19:11:10,347][177154] Sum rewards: 20.823, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.770', 'AMMO2': '0.015', 'AMMO5': '0.017', 'weapon5': '0.062', 'AMMO4': '0.072', 'AMMO3': '0.152', 'WEAPON4': '0.250', 'weapon4': '0.372', 'WEAPON5': '0.400', 'weapon2': '0.564', 'WEAPON3': '1.050', 'HITCOUNT': '1.410', 'weapon3': '2.628', 'DAMAGECOUNT': '6.351', 'FRAGCOUNT': '19.000'} [2023-02-24 19:11:10,488][177172] DAMAGECOUNT value on done: 303197.0 [2023-02-24 19:11:10,489][177172] Sum rewards: 22.122, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.100', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.136', 'weapon5': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.372', 'ARMOR': '0.400', 'weapon2': '0.690', 'WEAPON3': '0.900', 'HITCOUNT': '1.330', 'weapon3': '2.254', 'DAMAGECOUNT': '5.736', 'FRAGCOUNT': '19.000'} [2023-02-24 19:11:10,644][177154] DAMAGECOUNT value on done: 311640.0 [2023-02-24 19:11:10,645][177154] Sum rewards: 17.406, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.042', 'WEAPON1': '0.010', 'AMMO5': '0.021', 'AMMO2': '0.037', 'AMMO3': '0.157', 'AMMO4': '0.184', 'WEAPON4': '0.250', 'weapon5': '0.256', 'weapon4': '0.296', 'WEAPON5': '0.350', 'weapon2': '0.868', 'WEAPON3': '0.900', 'HITCOUNT': '1.200', 'weapon3': '2.146', 'DAMAGECOUNT': '5.523', 'FRAGCOUNT': '17.000'} [2023-02-24 19:11:10,855][177157] DAMAGECOUNT value on done: 311905.0 [2023-02-24 19:11:10,856][177157] Sum rewards: 15.292, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.272', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.028', 'weapon7': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'weapon5': '0.112', 'AMMO4': '0.133', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'HITCOUNT': '1.030', 'weapon2': '1.288', 'weapon3': '2.112', 'DAMAGECOUNT': '4.122', 'FRAGCOUNT': '12.000'} [2023-02-24 19:11:11,161][177157] DAMAGECOUNT value on done: 297123.0 [2023-02-24 19:11:11,162][177157] Sum rewards: 15.680, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.070', 'weapon5': '0.110', 'weapon7': '0.120', 'AMMO4': '0.173', 'weapon4': '0.194', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'HEALTH': '0.966', 'HITCOUNT': '0.990', 'weapon2': '1.138', 'weapon3': '1.712', 'DAMAGECOUNT': '4.962', 'FRAGCOUNT': '12.000'} [2023-02-24 19:11:11,174][177157] DAMAGECOUNT value on done: 297354.0 [2023-02-24 19:11:11,174][177157] Sum rewards: 17.232, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.844', 'AMMO5': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon7': '0.030', 'weapon4': '0.058', 'AMMO4': '0.074', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon5': '0.178', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.880', 'weapon2': '1.458', 'weapon3': '1.822', 'DAMAGECOUNT': '3.612', 'FRAGCOUNT': '15.000'} [2023-02-24 19:11:11,188][177171] DAMAGECOUNT value on done: 299505.0 [2023-02-24 19:11:11,189][177171] Sum rewards: 8.257, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.808', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.120', 'weapon7': '0.148', 'WEAPON4': '0.200', 'weapon5': '0.302', 'WEAPON5': '0.400', 'weapon4': '0.476', 'weapon2': '0.798', 'WEAPON3': '0.800', 'HITCOUNT': '0.910', 'weapon3': '1.776', 'DAMAGECOUNT': '3.681', 'FRAGCOUNT': '9.000'} [2023-02-24 19:11:11,203][177171] DAMAGECOUNT value on done: 300225.0 [2023-02-24 19:11:11,204][177171] Sum rewards: 21.519, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.630', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.148', 'weapon5': '0.232', 'WEAPON4': '0.250', 'weapon4': '0.288', 'WEAPON5': '0.350', 'WEAPON3': '0.900', 'weapon2': '1.190', 'HITCOUNT': '1.310', 'weapon3': '1.912', 'DAMAGECOUNT': '5.706', 'FRAGCOUNT': '19.000'} [2023-02-24 19:11:11,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13815.3). Total num frames: 90583040. Throughput: 0: 3462.7. Samples: 22643332. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:11:11,376][177119] Avg episode reward: [(0, '17.367')] [2023-02-24 19:11:11,475][177157] DAMAGECOUNT value on done: 296780.0 [2023-02-24 19:11:11,476][177157] Sum rewards: 12.078, reward structure: {'DEATHCOUNT': '-6.750', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO5': '0.017', 'weapon7': '0.062', 'AMMO4': '0.065', 'AMMO3': '0.089', 'HEALTH': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.162', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '0.770', 'weapon4': '0.834', 'weapon2': '0.920', 'weapon3': '1.494', 'DAMAGECOUNT': '3.837', 'FRAGCOUNT': '9.000'} [2023-02-24 19:11:11,495][177171] DAMAGECOUNT value on done: 300300.0 [2023-02-24 19:11:11,496][177171] Sum rewards: 12.718, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.860', 'AMMO2': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.018', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.104', 'AMMO3': '0.105', 'WEAPON5': '0.200', 'WEAPON3': '0.700', 'HITCOUNT': '1.110', 'weapon2': '1.146', 'weapon3': '2.006', 'DAMAGECOUNT': '4.311', 'FRAGCOUNT': '9.500'} [2023-02-24 19:11:11,504][177171] DAMAGECOUNT value on done: 302755.0 [2023-02-24 19:11:11,505][177171] Sum rewards: 17.956, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.323', 'AMMO2': '0.013', 'AMMO5': '0.015', 'AMMO4': '0.065', 'weapon7': '0.086', 'weapon5': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.130', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.532', 'weapon4': '0.708', 'WEAPON3': '0.850', 'HITCOUNT': '1.420', 'weapon3': '1.982', 'DAMAGECOUNT': '5.781', 'FRAGCOUNT': '15.000'} [2023-02-24 19:11:12,700][177153] Updated weights for policy 0, policy_version 22120 (0.0008) [2023-02-24 19:11:13,322][177155] DAMAGECOUNT value on done: 309742.0 [2023-02-24 19:11:13,323][177155] Sum rewards: 23.295, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.136', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon7': '0.046', 'AMMO4': '0.058', 'AMMO3': '0.064', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'weapon4': '0.546', 'weapon2': '0.906', 'weapon3': '1.364', 'HITCOUNT': '1.390', 'DAMAGECOUNT': '6.084', 'FRAGCOUNT': '17.000'} [2023-02-24 19:11:13,628][177155] DAMAGECOUNT value on done: 312889.0 [2023-02-24 19:11:13,628][177155] Sum rewards: 22.909, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.460', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon7': '0.064', 'AMMO3': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.143', 'WEAPON7': '0.200', 'weapon2': '0.314', 'weapon5': '0.334', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '0.910', 'weapon4': '1.192', 'weapon3': '1.540', 'DAMAGECOUNT': '6.453', 'FRAGCOUNT': '18.000'} [2023-02-24 19:11:13,928][177155] DAMAGECOUNT value on done: 314660.0 [2023-02-24 19:11:13,929][177155] Sum rewards: 24.560, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.418', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.022', 'AMMO4': '0.107', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'weapon4': '0.196', 'weapon5': '0.210', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'weapon2': '1.008', 'HITCOUNT': '1.550', 'weapon3': '2.246', 'DAMAGECOUNT': '6.780', 'FRAGCOUNT': '21.000'} [2023-02-24 19:11:14,233][177155] DAMAGECOUNT value on done: 296917.0 [2023-02-24 19:11:14,234][177155] Sum rewards: 20.725, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.128', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.016', 'WEAPON4': '0.050', 'weapon4': '0.076', 'weapon5': '0.150', 'AMMO3': '0.167', 'WEAPON5': '0.300', 'weapon2': '0.920', 'WEAPON3': '1.100', 'HITCOUNT': '1.660', 'weapon3': '2.496', 'DAMAGECOUNT': '6.402', 'FRAGCOUNT': '19.000'} [2023-02-24 19:11:15,655][177153] Updated weights for policy 0, policy_version 22130 (0.0008) [2023-02-24 19:11:16,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13815.3). Total num frames: 90652672. Throughput: 0: 3465.9. Samples: 22664170. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 19:11:16,376][177119] Avg episode reward: [(0, '17.486')] [2023-02-24 19:11:18,602][177153] Updated weights for policy 0, policy_version 22140 (0.0008) [2023-02-24 19:11:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13815.3). Total num frames: 90722304. Throughput: 0: 3464.3. Samples: 22674536. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 19:11:21,376][177119] Avg episode reward: [(0, '17.486')] [2023-02-24 19:11:21,470][177170] DAMAGECOUNT value on done: 306140.0 [2023-02-24 19:11:21,470][177170] Sum rewards: 15.778, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'AMMO4': '0.125', 'weapon5': '0.210', 'WEAPON5': '0.350', 'HEALTH': '0.360', 'WEAPON3': '0.600', 'weapon2': '0.800', 'weapon4': '0.852', 'HITCOUNT': '1.050', 'weapon3': '1.740', 'DAMAGECOUNT': '3.825', 'FRAGCOUNT': '12.000'} [2023-02-24 19:11:21,563][177153] Updated weights for policy 0, policy_version 22150 (0.0008) [2023-02-24 19:11:21,769][177170] DAMAGECOUNT value on done: 307330.0 [2023-02-24 19:11:21,769][177170] Sum rewards: 13.222, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.163', 'AMMO5': '0.024', 'AMMO2': '0.026', 'WEAPON4': '0.100', 'AMMO4': '0.129', 'weapon4': '0.144', 'AMMO3': '0.174', 'weapon5': '0.206', 'WEAPON5': '0.550', 'weapon2': '0.780', 'WEAPON3': '1.050', 'HITCOUNT': '1.170', 'weapon3': '2.500', 'DAMAGECOUNT': '4.782', 'FRAGCOUNT': '14.000'} [2023-02-24 19:11:22,470][177170] DAMAGECOUNT value on done: 301209.0 [2023-02-24 19:11:22,470][177170] Sum rewards: 11.359, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.414', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.017', 'AMMO3': '0.047', 'weapon5': '0.064', 'weapon7': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.300', 'WEAPON7': '0.400', 'weapon3': '0.644', 'HITCOUNT': '0.800', 'weapon4': '1.022', 'weapon2': '1.158', 'DAMAGECOUNT': '2.772', 'FRAGCOUNT': '8.000'} [2023-02-24 19:11:22,750][177156] DAMAGECOUNT value on done: 305539.0 [2023-02-24 19:11:22,751][177156] Sum rewards: 14.926, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.980', 'AMMO2': '0.010', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.052', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'weapon5': '0.164', 'weapon4': '0.176', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'HITCOUNT': '1.110', 'weapon2': '1.212', 'weapon3': '1.712', 'DAMAGECOUNT': '4.992', 'FRAGCOUNT': '14.000'} [2023-02-24 19:11:22,773][177156] DAMAGECOUNT value on done: 297786.0 [2023-02-24 19:11:22,773][177156] Sum rewards: 21.274, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.120', 'AMMO2': '0.004', 'WEAPON1': '0.020', 'AMMO4': '0.021', 'AMMO5': '0.025', 'AMMO3': '0.118', 'WEAPON4': '0.200', 'weapon4': '0.224', 'weapon5': '0.338', 'weapon2': '0.626', 'WEAPON5': '0.700', 'WEAPON3': '0.900', 'HITCOUNT': '1.330', 'weapon3': '2.326', 'DAMAGECOUNT': '5.562', 'FRAGCOUNT': '20.000'} [2023-02-24 19:11:22,777][177170] DAMAGECOUNT value on done: 303475.0 [2023-02-24 19:11:22,777][177170] Sum rewards: 15.518, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.058', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO3': '0.080', 'AMMO4': '0.173', 'weapon5': '0.180', 'weapon7': '0.276', 'WEAPON5': '0.400', 'weapon2': '0.482', 'WEAPON3': '0.500', 'WEAPON4': '0.500', 'AMMO6': '0.540', 'AMMO7': '0.540', 'WEAPON7': '0.700', 'weapon4': '0.942', 'HITCOUNT': '1.010', 'weapon3': '1.564', 'DAMAGECOUNT': '5.391', 'FRAGCOUNT': '13.000'} [2023-02-24 19:11:23,071][177156] DAMAGECOUNT value on done: 313089.0 [2023-02-24 19:11:23,072][177156] Sum rewards: 12.859, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.430', 'WEAPON1': '0.010', 'AMMO5': '0.025', 'AMMO2': '0.036', 'AMMO3': '0.116', 'AMMO4': '0.179', 'WEAPON4': '0.300', 'weapon4': '0.332', 'weapon5': '0.402', 'WEAPON5': '0.550', 'weapon2': '0.712', 'WEAPON3': '0.800', 'HITCOUNT': '1.340', 'weapon3': '2.152', 'DAMAGECOUNT': '5.085', 'FRAGCOUNT': '12.000'} [2023-02-24 19:11:23,092][177156] DAMAGECOUNT value on done: 300415.0 [2023-02-24 19:11:23,092][177156] Sum rewards: 13.494, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.555', 'ARMOR': '0.004', 'AMMO2': '0.015', 'AMMO5': '0.018', 'WEAPON1': '0.040', 'AMMO4': '0.074', 'AMMO3': '0.117', 'WEAPON4': '0.200', 'weapon5': '0.214', 'weapon4': '0.260', 'WEAPON5': '0.400', 'weapon2': '0.552', 'WEAPON3': '0.900', 'HITCOUNT': '1.290', 'weapon3': '2.644', 'DAMAGECOUNT': '5.070', 'FRAGCOUNT': '14.000'} [2023-02-24 19:11:23,814][177158] DAMAGECOUNT value on done: 295669.0 [2023-02-24 19:11:23,815][177158] Sum rewards: 8.823, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.200', 'AMMO2': '0.005', 'AMMO4': '0.022', 'AMMO5': '0.025', 'weapon7': '0.080', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.150', 'AMMO3': '0.152', 'WEAPON7': '0.200', 'weapon4': '0.228', 'WEAPON5': '0.550', 'WEAPON3': '0.950', 'HITCOUNT': '1.130', 'weapon2': '1.500', 'weapon3': '1.660', 'DAMAGECOUNT': '4.281', 'FRAGCOUNT': '8.000'} [2023-02-24 19:11:24,113][177158] DAMAGECOUNT value on done: 295642.0 [2023-02-24 19:11:24,113][177158] Sum rewards: 20.113, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.452', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'weapon7': '0.056', 'AMMO3': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.128', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.244', 'WEAPON3': '0.500', 'weapon4': '0.528', 'HITCOUNT': '1.240', 'weapon2': '1.372', 'weapon3': '1.502', 'DAMAGECOUNT': '5.523', 'FRAGCOUNT': '16.000'} [2023-02-24 19:11:24,446][177158] DAMAGECOUNT value on done: 307602.0 [2023-02-24 19:11:24,446][177158] Sum rewards: 12.054, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.010', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.091', 'AMMO4': '0.142', 'weapon5': '0.248', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'weapon2': '0.586', 'weapon4': '0.730', 'HITCOUNT': '1.050', 'weapon3': '1.926', 'DAMAGECOUNT': '4.830', 'FRAGCOUNT': '9.500'} [2023-02-24 19:11:24,531][177153] Updated weights for policy 0, policy_version 22160 (0.0008) [2023-02-24 19:11:24,742][177158] DAMAGECOUNT value on done: 307900.0 [2023-02-24 19:11:24,742][177158] Sum rewards: 22.078, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.576', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.070', 'AMMO3': '0.104', 'weapon5': '0.220', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'weapon2': '1.142', 'HITCOUNT': '1.280', 'weapon3': '2.000', 'DAMAGECOUNT': '5.343', 'FRAGCOUNT': '19.000'} [2023-02-24 19:11:26,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.2, 300 sec: 13815.3). Total num frames: 90791936. Throughput: 0: 3462.5. Samples: 22695268. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 19:11:26,376][177119] Avg episode reward: [(0, '17.595')] [2023-02-24 19:11:27,136][177171] Large shaping reward 2.502 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.48, 160.0), ('weapon5', 0.002)] [2023-02-24 19:11:27,473][177153] Updated weights for policy 0, policy_version 22170 (0.0008) [2023-02-24 19:11:27,801][177172] DAMAGECOUNT value on done: 299261.0 [2023-02-24 19:11:27,802][177172] Sum rewards: 10.551, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.696', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO2': '0.027', 'weapon7': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.112', 'AMMO4': '0.135', 'weapon5': '0.144', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'weapon2': '0.536', 'WEAPON3': '0.750', 'HITCOUNT': '0.930', 'weapon4': '0.960', 'weapon3': '1.302', 'DAMAGECOUNT': '3.495', 'FRAGCOUNT': '11.000'} [2023-02-24 19:11:28,102][177172] DAMAGECOUNT value on done: 301831.0 [2023-02-24 19:11:28,103][177172] Sum rewards: 24.769, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.600', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.056', 'AMMO4': '0.067', 'weapon7': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.152', 'WEAPON5': '0.200', 'weapon4': '0.230', 'weapon2': '0.730', 'WEAPON3': '1.100', 'HITCOUNT': '1.880', 'weapon3': '2.578', 'DAMAGECOUNT': '7.371', 'FRAGCOUNT': '22.000'} [2023-02-24 19:11:29,171][177154] DAMAGECOUNT value on done: 305150.0 [2023-02-24 19:11:29,171][177154] Sum rewards: 17.723, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.140', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'AMMO3': '0.145', 'weapon5': '0.154', 'weapon4': '0.204', 'WEAPON5': '0.250', 'WEAPON3': '0.800', 'weapon2': '0.980', 'HITCOUNT': '1.300', 'weapon3': '2.228', 'DAMAGECOUNT': '4.935', 'FRAGCOUNT': '15.000'} [2023-02-24 19:11:29,475][177154] DAMAGECOUNT value on done: 310560.0 [2023-02-24 19:11:29,476][177154] Sum rewards: 8.081, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.010', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.060', 'AMMO3': '0.087', 'weapon7': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'WEAPON4': '0.250', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.690', 'weapon2': '0.730', 'weapon4': '0.822', 'weapon3': '1.156', 'DAMAGECOUNT': '2.895', 'FRAGCOUNT': '8.000'} [2023-02-24 19:11:29,594][177172] DAMAGECOUNT value on done: 313959.0 [2023-02-24 19:11:29,594][177172] Sum rewards: 7.278, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.330', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.021', 'weapon7': '0.054', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.164', 'AMMO3': '0.191', 'WEAPON7': '0.200', 'weapon2': '0.262', 'WEAPON5': '0.450', 'HITCOUNT': '0.810', 'weapon4': '0.860', 'WEAPON3': '1.050', 'weapon3': '2.140', 'DAMAGECOUNT': '3.489', 'FRAGCOUNT': '9.000'} [2023-02-24 19:11:29,778][177154] DAMAGECOUNT value on done: 316010.0 [2023-02-24 19:11:29,779][177154] Sum rewards: 15.289, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.302', 'AMMO5': '0.014', 'AMMO2': '0.028', 'weapon5': '0.106', 'weapon7': '0.106', 'AMMO4': '0.142', 'AMMO3': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.712', 'weapon2': '0.800', 'WEAPON3': '0.900', 'HITCOUNT': '1.340', 'weapon3': '1.464', 'DAMAGECOUNT': '5.808', 'FRAGCOUNT': '13.500'} [2023-02-24 19:11:29,896][177172] DAMAGECOUNT value on done: 304727.0 [2023-02-24 19:11:29,897][177172] Sum rewards: 16.653, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.035', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.061', 'weapon4': '0.080', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'weapon5': '0.234', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'HITCOUNT': '1.290', 'weapon2': '1.386', 'weapon3': '1.962', 'DAMAGECOUNT': '4.590', 'FRAGCOUNT': '13.000'} [2023-02-24 19:11:30,078][177154] DAMAGECOUNT value on done: 313411.0 [2023-02-24 19:11:30,078][177154] Sum rewards: 16.818, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.788', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon7': '0.048', 'AMMO3': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.184', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.254', 'WEAPON5': '0.350', 'weapon4': '0.626', 'WEAPON3': '0.650', 'weapon2': '0.688', 'HITCOUNT': '1.150', 'weapon3': '1.756', 'DAMAGECOUNT': '5.313', 'FRAGCOUNT': '14.000'} [2023-02-24 19:11:30,256][177157] DAMAGECOUNT value on done: 312940.0 [2023-02-24 19:11:30,257][177157] Sum rewards: 12.039, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-1.070', 'AMMO2': '0.005', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.023', 'AMMO3': '0.033', 'weapon7': '0.094', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.134', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.300', 'weapon2': '0.550', 'HITCOUNT': '0.630', 'weapon3': '0.690', 'weapon4': '1.030', 'DAMAGECOUNT': '3.105', 'FRAGCOUNT': '8.000'} [2023-02-24 19:11:30,463][177153] Updated weights for policy 0, policy_version 22180 (0.0008) [2023-02-24 19:11:30,556][177157] DAMAGECOUNT value on done: 298872.0 [2023-02-24 19:11:30,557][177157] Sum rewards: 16.732, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.883', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO3': '0.103', 'AMMO4': '0.125', 'weapon4': '0.186', 'weapon5': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'weapon2': '1.356', 'HITCOUNT': '1.380', 'weapon3': '1.788', 'DAMAGECOUNT': '5.247', 'FRAGCOUNT': '15.000'} [2023-02-24 19:11:30,569][177157] DAMAGECOUNT value on done: 298372.0 [2023-02-24 19:11:30,570][177157] Sum rewards: 10.606, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.485', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'weapon7': '0.070', 'AMMO3': '0.085', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.156', 'WEAPON7': '0.200', 'weapon5': '0.244', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.522', 'WEAPON3': '0.650', 'HITCOUNT': '0.750', 'weapon4': '0.814', 'weapon3': '1.992', 'DAMAGECOUNT': '3.054', 'FRAGCOUNT': '10.000'} [2023-02-24 19:11:30,654][177171] DAMAGECOUNT value on done: 301614.0 [2023-02-24 19:11:30,655][177171] Sum rewards: 24.661, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.900', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.021', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'AMMO3': '0.146', 'weapon4': '0.192', 'weapon5': '0.340', 'WEAPON5': '0.500', 'weapon2': '0.680', 'WEAPON3': '0.800', 'HITCOUNT': '1.310', 'weapon3': '2.332', 'DAMAGECOUNT': '6.327', 'FRAGCOUNT': '21.000'} [2023-02-24 19:11:30,667][177171] DAMAGECOUNT value on done: 302076.0 [2023-02-24 19:11:30,668][177171] Sum rewards: 16.588, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.913', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.056', 'AMMO3': '0.110', 'WEAPON4': '0.200', 'weapon5': '0.236', 'weapon4': '0.248', 'WEAPON5': '0.300', 'weapon2': '0.792', 'WEAPON3': '0.850', 'HITCOUNT': '1.270', 'weapon3': '2.342', 'DAMAGECOUNT': '5.553', 'FRAGCOUNT': '14.000'} [2023-02-24 19:11:30,877][177157] DAMAGECOUNT value on done: 299452.0 [2023-02-24 19:11:30,877][177157] Sum rewards: 31.885, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.870', 'AMMO5': '0.015', 'AMMO2': '0.019', 'AMMO4': '0.094', 'AMMO3': '0.106', 'weapon5': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'ARMOR': '0.451', 'weapon4': '0.560', 'WEAPON3': '0.750', 'weapon2': '1.190', 'weapon3': '1.736', 'HITCOUNT': '1.850', 'DAMAGECOUNT': '8.016', 'FRAGCOUNT': '27.000'} [2023-02-24 19:11:30,970][177171] DAMAGECOUNT value on done: 302421.0 [2023-02-24 19:11:30,971][177171] Sum rewards: 20.921, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.056', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO2': '0.030', 'AMMO3': '0.094', 'AMMO4': '0.150', 'weapon5': '0.264', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'weapon2': '0.666', 'weapon4': '0.676', 'HITCOUNT': '1.470', 'weapon3': '1.818', 'DAMAGECOUNT': '6.363', 'FRAGCOUNT': '17.500'} [2023-02-24 19:11:30,981][177171] DAMAGECOUNT value on done: 305144.0 [2023-02-24 19:11:30,982][177171] Sum rewards: 19.811, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.428', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.035', 'weapon7': '0.046', 'AMMO3': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.176', 'WEAPON7': '0.200', 'weapon5': '0.276', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'weapon2': '0.750', 'weapon4': '0.770', 'HITCOUNT': '1.500', 'weapon3': '1.748', 'DAMAGECOUNT': '7.167', 'FRAGCOUNT': '15.500'} [2023-02-24 19:11:31,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13815.3). Total num frames: 90861568. Throughput: 0: 3458.9. Samples: 22715956. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 19:11:31,376][177119] Avg episode reward: [(0, '17.377')] [2023-02-24 19:11:32,781][177155] DAMAGECOUNT value on done: 310750.0 [2023-02-24 19:11:32,782][177155] Sum rewards: 13.885, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.591', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon7': '0.062', 'weapon5': '0.092', 'AMMO3': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.482', 'WEAPON3': '0.600', 'weapon2': '0.646', 'HITCOUNT': '0.830', 'weapon4': '1.000', 'weapon3': '1.766', 'DAMAGECOUNT': '3.024', 'FRAGCOUNT': '11.000'} [2023-02-24 19:11:33,090][177155] DAMAGECOUNT value on done: 314432.0 [2023-02-24 19:11:33,090][177155] Sum rewards: 15.996, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.740', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'AMMO5': '0.024', 'weapon4': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.089', 'AMMO4': '0.111', 'weapon5': '0.354', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'weapon2': '1.010', 'HITCOUNT': '1.140', 'weapon3': '2.048', 'DAMAGECOUNT': '4.629', 'FRAGCOUNT': '12.000'} [2023-02-24 19:11:33,393][177155] DAMAGECOUNT value on done: 315952.0 [2023-02-24 19:11:33,393][177155] Sum rewards: 15.988, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.788', 'AMMO5': '0.017', 'AMMO2': '0.050', 'AMMO3': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.102', 'weapon5': '0.212', 'AMMO4': '0.249', 'WEAPON4': '0.300', 'weapon4': '0.342', 'WEAPON5': '0.450', 'WEAPON3': '0.450', 'HITCOUNT': '0.810', 'weapon2': '1.078', 'weapon3': '1.474', 'DAMAGECOUNT': '3.876', 'FRAGCOUNT': '13.000'} [2023-02-24 19:11:33,430][177153] Updated weights for policy 0, policy_version 22190 (0.0008) [2023-02-24 19:11:33,698][177155] DAMAGECOUNT value on done: 298709.0 [2023-02-24 19:11:33,698][177155] Sum rewards: 20.036, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.160', 'AMMO5': '0.007', 'AMMO2': '0.049', 'weapon5': '0.054', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'weapon7': '0.124', 'AMMO6': '0.240', 'AMMO7': '0.240', 'AMMO4': '0.243', 'WEAPON7': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '0.500', 'weapon2': '0.624', 'weapon3': '1.216', 'HITCOUNT': '1.400', 'weapon4': '1.532', 'DAMAGECOUNT': '5.376', 'FRAGCOUNT': '16.000'} [2023-02-24 19:11:36,367][177153] Updated weights for policy 0, policy_version 22200 (0.0009) [2023-02-24 19:11:36,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13829.2). Total num frames: 90931200. Throughput: 0: 3458.7. Samples: 22726360. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 19:11:36,376][177119] Avg episode reward: [(0, '17.338')] [2023-02-24 19:11:39,322][177153] Updated weights for policy 0, policy_version 22210 (0.0009) [2023-02-24 19:11:40,823][177170] DAMAGECOUNT value on done: 307226.0 [2023-02-24 19:11:40,823][177170] Sum rewards: 11.461, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.560', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'weapon7': '0.056', 'AMMO3': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.248', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'HITCOUNT': '0.910', 'weapon2': '1.334', 'weapon3': '1.608', 'DAMAGECOUNT': '3.258', 'FRAGCOUNT': '7.000'} [2023-02-24 19:11:41,123][177170] DAMAGECOUNT value on done: 309469.0 [2023-02-24 19:11:41,123][177170] Sum rewards: 19.927, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.315', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.041', 'AMMO3': '0.084', 'AMMO4': '0.205', 'weapon5': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.500', 'weapon4': '0.510', 'WEAPON3': '0.550', 'weapon2': '0.948', 'HITCOUNT': '1.460', 'weapon3': '1.896', 'DAMAGECOUNT': '6.417', 'FRAGCOUNT': '16.000'} [2023-02-24 19:11:41,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13858.1, 300 sec: 13815.3). Total num frames: 90996736. Throughput: 0: 3462.1. Samples: 22747146. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 19:11:41,377][177119] Avg episode reward: [(0, '17.227')] [2023-02-24 19:11:41,817][177170] DAMAGECOUNT value on done: 303009.0 [2023-02-24 19:11:41,818][177170] Sum rewards: 17.055, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.415', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'WEAPON4': '0.100', 'weapon5': '0.118', 'AMMO3': '0.120', 'weapon4': '0.232', 'WEAPON5': '0.350', 'WEAPON3': '0.900', 'HITCOUNT': '1.330', 'weapon2': '1.494', 'weapon3': '1.906', 'DAMAGECOUNT': '5.400', 'FRAGCOUNT': '15.000'} [2023-02-24 19:11:42,124][177170] DAMAGECOUNT value on done: 305592.0 [2023-02-24 19:11:42,125][177170] Sum rewards: 14.111, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.460', 'AMMO2': '0.032', 'AMMO5': '0.032', 'WEAPON1': '0.050', 'AMMO4': '0.158', 'AMMO3': '0.195', 'weapon4': '0.252', 'weapon5': '0.312', 'WEAPON4': '0.350', 'weapon2': '0.532', 'WEAPON5': '0.700', 'WEAPON3': '1.200', 'HITCOUNT': '1.310', 'weapon3': '2.348', 'DAMAGECOUNT': '6.351', 'FRAGCOUNT': '14.000'} [2023-02-24 19:11:42,176][177156] DAMAGECOUNT value on done: 306758.0 [2023-02-24 19:11:42,176][177156] Sum rewards: 14.014, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.913', 'ARMOR': '0.004', 'AMMO5': '0.012', 'weapon7': '0.032', 'AMMO2': '0.039', 'AMMO3': '0.068', 'AMMO4': '0.196', 'weapon5': '0.278', 'WEAPON4': '0.300', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.392', 'WEAPON3': '0.450', 'HITCOUNT': '0.990', 'weapon3': '1.308', 'weapon2': '1.500', 'DAMAGECOUNT': '3.657', 'FRAGCOUNT': '12.000'} [2023-02-24 19:11:42,197][177156] DAMAGECOUNT value on done: 298998.0 [2023-02-24 19:11:42,197][177156] Sum rewards: 13.077, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.728', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.012', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'weapon5': '0.164', 'weapon4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '0.950', 'weapon2': '1.016', 'weapon3': '1.628', 'DAMAGECOUNT': '3.636', 'FRAGCOUNT': '11.000'} [2023-02-24 19:11:42,277][177153] Updated weights for policy 0, policy_version 22220 (0.0008) [2023-02-24 19:11:42,418][177155] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-24 19:11:42,486][177156] DAMAGECOUNT value on done: 314813.0 [2023-02-24 19:11:42,487][177156] Sum rewards: 21.054, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.929', 'AMMO2': '0.011', 'AMMO5': '0.020', 'WEAPON1': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.126', 'weapon5': '0.220', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'HITCOUNT': '1.330', 'weapon2': '1.358', 'weapon3': '2.042', 'DAMAGECOUNT': '5.172', 'FRAGCOUNT': '20.000'} [2023-02-24 19:11:42,506][177156] DAMAGECOUNT value on done: 301837.0 [2023-02-24 19:11:42,507][177156] Sum rewards: 17.565, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.820', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.074', 'WEAPON4': '0.150', 'weapon4': '0.200', 'weapon5': '0.246', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '0.950', 'weapon2': '1.334', 'weapon3': '1.680', 'DAMAGECOUNT': '4.266', 'FRAGCOUNT': '13.000'} [2023-02-24 19:11:43,198][177158] DAMAGECOUNT value on done: 295909.0 [2023-02-24 19:11:43,198][177158] Sum rewards: 4.373, reward structure: {'DEATHCOUNT': '-0.750', 'HEALTH': '-0.285', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO3': '0.010', 'weapon2': '0.072', 'WEAPON3': '0.100', 'weapon7': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon3': '0.246', 'DAMAGECOUNT': '0.720', 'weapon4': '1.318', 'FRAGCOUNT': '2.000'} [2023-02-24 19:11:43,500][177158] DAMAGECOUNT value on done: 297464.0 [2023-02-24 19:11:43,501][177158] Sum rewards: 11.220, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.886', 'AMMO5': '0.019', 'WEAPON1': '0.040', 'weapon7': '0.040', 'AMMO2': '0.044', 'AMMO3': '0.135', 'weapon5': '0.194', 'AMMO4': '0.221', 'AMMO6': '0.360', 'AMMO7': '0.360', 'WEAPON7': '0.400', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon4': '0.558', 'weapon2': '0.710', 'WEAPON3': '1.000', 'HITCOUNT': '1.310', 'weapon3': '1.998', 'DAMAGECOUNT': '5.466', 'FRAGCOUNT': '13.000'} [2023-02-24 19:11:43,838][177158] DAMAGECOUNT value on done: 309278.0 [2023-02-24 19:11:43,839][177158] Sum rewards: 16.482, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.350', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.023', 'weapon7': '0.054', 'AMMO3': '0.071', 'AMMO4': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.198', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.482', 'WEAPON3': '0.600', 'weapon2': '0.718', 'HITCOUNT': '1.380', 'weapon3': '1.746', 'DAMAGECOUNT': '5.028', 'FRAGCOUNT': '13.000'} [2023-02-24 19:11:44,138][177158] DAMAGECOUNT value on done: 309727.0 [2023-02-24 19:11:44,139][177158] Sum rewards: 21.111, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.162', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO3': '0.072', 'AMMO4': '0.224', 'WEAPON5': '0.250', 'weapon5': '0.272', 'weapon2': '0.444', 'WEAPON4': '0.450', 'WEAPON3': '0.500', 'weapon4': '0.804', 'HITCOUNT': '1.430', 'weapon3': '1.772', 'DAMAGECOUNT': '5.481', 'FRAGCOUNT': '17.000'} [2023-02-24 19:11:45,256][177153] Updated weights for policy 0, policy_version 22230 (0.0008) [2023-02-24 19:11:46,376][177119] Fps is (10 sec: 13516.5, 60 sec: 13858.1, 300 sec: 13815.3). Total num frames: 91066368. Throughput: 0: 3462.1. Samples: 22767904. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 19:11:46,377][177119] Avg episode reward: [(0, '16.907')] [2023-02-24 19:11:47,205][177172] DAMAGECOUNT value on done: 300743.0 [2023-02-24 19:11:47,205][177172] Sum rewards: 16.527, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.245', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.028', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon5': '0.110', 'WEAPON5': '0.250', 'weapon4': '0.276', 'WEAPON3': '0.450', 'ARMOR': '0.476', 'HITCOUNT': '0.960', 'weapon2': '1.088', 'weapon3': '1.752', 'DAMAGECOUNT': '4.446', 'FRAGCOUNT': '12.000'} [2023-02-24 19:11:47,509][177172] DAMAGECOUNT value on done: 304525.0 [2023-02-24 19:11:47,510][177172] Sum rewards: 28.344, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.714', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.037', 'AMMO3': '0.126', 'weapon5': '0.162', 'AMMO4': '0.183', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.394', 'weapon4': '0.656', 'WEAPON3': '0.800', 'HITCOUNT': '1.870', 'weapon3': '2.374', 'DAMAGECOUNT': '8.082', 'FRAGCOUNT': '25.000'} [2023-02-24 19:11:48,209][177153] Updated weights for policy 0, policy_version 22240 (0.0008) [2023-02-24 19:11:48,610][177154] DAMAGECOUNT value on done: 307420.0 [2023-02-24 19:11:48,611][177154] Sum rewards: 20.529, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.869', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO5': '0.022', 'AMMO4': '0.072', 'AMMO3': '0.091', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon5': '0.406', 'weapon2': '0.568', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'weapon4': '0.898', 'HITCOUNT': '1.310', 'weapon3': '1.696', 'DAMAGECOUNT': '6.810', 'FRAGCOUNT': '16.000'} [2023-02-24 19:11:48,909][177154] DAMAGECOUNT value on done: 312463.0 [2023-02-24 19:11:48,910][177154] Sum rewards: 17.194, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.482', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'AMMO3': '0.136', 'weapon5': '0.186', 'WEAPON5': '0.400', 'weapon4': '0.402', 'WEAPON3': '0.950', 'weapon2': '1.004', 'HITCOUNT': '1.360', 'weapon3': '2.034', 'DAMAGECOUNT': '5.709', 'FRAGCOUNT': '16.000'} [2023-02-24 19:11:48,991][177172] DAMAGECOUNT value on done: 316567.0 [2023-02-24 19:11:48,992][177172] Sum rewards: 24.705, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.724', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO5': '0.022', 'AMMO4': '0.096', 'AMMO3': '0.112', 'weapon5': '0.218', 'WEAPON4': '0.250', 'weapon4': '0.414', 'WEAPON5': '0.500', 'weapon2': '0.706', 'WEAPON3': '0.750', 'HITCOUNT': '1.980', 'weapon3': '2.274', 'DAMAGECOUNT': '7.824', 'FRAGCOUNT': '20.000'} [2023-02-24 19:11:49,204][177154] DAMAGECOUNT value on done: 317410.0 [2023-02-24 19:11:49,205][177154] Sum rewards: 13.810, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.005', 'AMMO5': '0.020', 'AMMO4': '0.025', 'WEAPON1': '0.040', 'AMMO3': '0.099', 'weapon5': '0.238', 'HEALTH': '0.364', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.910', 'weapon2': '1.146', 'weapon3': '2.062', 'DAMAGECOUNT': '4.200', 'FRAGCOUNT': '10.500'} [2023-02-24 19:11:49,290][177172] DAMAGECOUNT value on done: 306680.0 [2023-02-24 19:11:49,290][177172] Sum rewards: 17.056, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.310', 'WEAPON1': '0.020', 'AMMO5': '0.028', 'AMMO2': '0.037', 'AMMO3': '0.142', 'AMMO4': '0.187', 'WEAPON4': '0.300', 'weapon5': '0.346', 'WEAPON5': '0.550', 'weapon2': '0.690', 'weapon4': '0.750', 'WEAPON3': '0.850', 'HITCOUNT': '1.370', 'weapon3': '1.736', 'DAMAGECOUNT': '5.859', 'FRAGCOUNT': '16.000'} [2023-02-24 19:11:49,508][177154] DAMAGECOUNT value on done: 315327.0 [2023-02-24 19:11:49,509][177154] Sum rewards: 17.513, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.759', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.029', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'weapon4': '0.162', 'weapon5': '0.216', 'WEAPON5': '0.450', 'weapon2': '0.554', 'WEAPON3': '0.950', 'HITCOUNT': '1.360', 'weapon3': '2.078', 'DAMAGECOUNT': '5.748', 'FRAGCOUNT': '17.000'} [2023-02-24 19:11:49,783][177157] DAMAGECOUNT value on done: 314725.0 [2023-02-24 19:11:49,784][177157] Sum rewards: 12.866, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.202', 'AMMO5': '0.014', 'AMMO2': '0.040', 'AMMO3': '0.082', 'AMMO4': '0.202', 'weapon5': '0.252', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.470', 'WEAPON3': '0.550', 'weapon2': '0.932', 'HITCOUNT': '1.270', 'weapon3': '2.050', 'DAMAGECOUNT': '5.355', 'FRAGCOUNT': '11.000'} [2023-02-24 19:11:50,069][177171] DAMAGECOUNT value on done: 303352.0 [2023-02-24 19:11:50,069][177171] Sum rewards: 20.864, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.514', 'AMMO2': '0.017', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'AMMO3': '0.070', 'AMMO4': '0.083', 'weapon4': '0.138', 'WEAPON4': '0.150', 'weapon5': '0.246', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon2': '1.138', 'HITCOUNT': '1.360', 'weapon3': '1.952', 'DAMAGECOUNT': '5.214', 'FRAGCOUNT': '16.000'} [2023-02-24 19:11:50,079][177171] DAMAGECOUNT value on done: 304211.0 [2023-02-24 19:11:50,079][177171] Sum rewards: 18.763, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.558', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'weapon5': '0.156', 'AMMO3': '0.164', 'WEAPON5': '0.300', 'weapon4': '0.328', 'weapon2': '0.408', 'WEAPON3': '1.000', 'HITCOUNT': '1.800', 'weapon3': '2.744', 'DAMAGECOUNT': '6.405', 'FRAGCOUNT': '17.000'} [2023-02-24 19:11:50,081][177157] DAMAGECOUNT value on done: 301382.0 [2023-02-24 19:11:50,082][177157] Sum rewards: 23.021, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.756', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'weapon5': '0.240', 'WEAPON5': '0.450', 'weapon4': '0.508', 'WEAPON3': '0.800', 'weapon2': '1.376', 'weapon3': '1.508', 'HITCOUNT': '1.680', 'DAMAGECOUNT': '7.530', 'FRAGCOUNT': '19.000'} [2023-02-24 19:11:50,094][177157] DAMAGECOUNT value on done: 300403.0 [2023-02-24 19:11:50,095][177157] Sum rewards: 23.565, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.268', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.060', 'weapon7': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.106', 'weapon5': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'WEAPON3': '0.450', 'weapon2': '0.822', 'weapon4': '1.060', 'weapon3': '1.288', 'HITCOUNT': '1.570', 'DAMAGECOUNT': '6.093', 'FRAGCOUNT': '17.000'} [2023-02-24 19:11:50,384][177171] DAMAGECOUNT value on done: 304120.0 [2023-02-24 19:11:50,385][177171] Sum rewards: 19.368, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.010', 'HEALTH': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.065', 'weapon4': '0.092', 'WEAPON5': '0.200', 'weapon5': '0.270', 'WEAPON3': '0.400', 'HITCOUNT': '1.110', 'weapon2': '1.464', 'weapon3': '1.746', 'DAMAGECOUNT': '5.097', 'FRAGCOUNT': '14.000'} [2023-02-24 19:11:50,389][177157] DAMAGECOUNT value on done: 301507.0 [2023-02-24 19:11:50,390][177157] Sum rewards: 21.256, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.316', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO5': '0.016', 'WEAPON4': '0.150', 'AMMO3': '0.156', 'weapon5': '0.208', 'weapon2': '0.348', 'WEAPON5': '0.400', 'weapon4': '0.470', 'WEAPON3': '1.150', 'HITCOUNT': '1.390', 'weapon3': '2.106', 'DAMAGECOUNT': '6.165', 'FRAGCOUNT': '20.000'} [2023-02-24 19:11:50,397][177171] DAMAGECOUNT value on done: 306505.0 [2023-02-24 19:11:50,398][177171] Sum rewards: 11.758, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.682', 'AMMO2': '0.004', 'weapon7': '0.008', 'AMMO5': '0.012', 'AMMO4': '0.018', 'WEAPON1': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.133', 'weapon4': '0.156', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.336', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '1.000', 'weapon2': '1.130', 'weapon3': '1.782', 'DAMAGECOUNT': '4.080', 'FRAGCOUNT': '12.000'} [2023-02-24 19:11:51,174][177153] Updated weights for policy 0, policy_version 22250 (0.0008) [2023-02-24 19:11:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13815.3). Total num frames: 91136000. Throughput: 0: 3460.7. Samples: 22778232. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 19:11:51,376][177119] Avg episode reward: [(0, '17.159')] [2023-02-24 19:11:52,272][177155] DAMAGECOUNT value on done: 312899.0 [2023-02-24 19:11:52,273][177155] Sum rewards: 17.014, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.666', 'AMMO2': '0.002', 'AMMO4': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO3': '0.139', 'WEAPON4': '0.200', 'weapon5': '0.230', 'weapon4': '0.344', 'WEAPON5': '0.400', 'WEAPON3': '0.950', 'weapon2': '0.970', 'HITCOUNT': '1.530', 'weapon3': '1.934', 'DAMAGECOUNT': '6.447', 'FRAGCOUNT': '13.000'} [2023-02-24 19:11:52,570][177155] DAMAGECOUNT value on done: 316548.0 [2023-02-24 19:11:52,571][177155] Sum rewards: 21.023, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.002', 'AMMO2': '0.021', 'AMMO5': '0.022', 'AMMO4': '0.106', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'weapon5': '0.210', 'weapon4': '0.212', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'weapon2': '1.224', 'HITCOUNT': '1.530', 'weapon3': '2.024', 'DAMAGECOUNT': '6.348', 'FRAGCOUNT': '17.000'} [2023-02-24 19:11:52,861][177155] DAMAGECOUNT value on done: 317545.0 [2023-02-24 19:11:52,862][177155] Sum rewards: 14.608, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.490', 'AMMO2': '0.017', 'AMMO5': '0.019', 'weapon7': '0.034', 'WEAPON1': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.115', 'weapon5': '0.186', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.562', 'weapon2': '0.640', 'WEAPON3': '0.850', 'HITCOUNT': '1.250', 'weapon3': '1.760', 'DAMAGECOUNT': '4.779', 'FRAGCOUNT': '13.000'} [2023-02-24 19:11:53,160][177155] DAMAGECOUNT value on done: 301302.0 [2023-02-24 19:11:53,161][177155] Sum rewards: 23.827, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.728', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.041', 'AMMO3': '0.138', 'AMMO4': '0.205', 'WEAPON4': '0.300', 'weapon5': '0.310', 'WEAPON5': '0.500', 'weapon4': '0.500', 'weapon2': '0.690', 'WEAPON3': '0.800', 'HITCOUNT': '1.190', 'weapon3': '2.134', 'DAMAGECOUNT': '7.464', 'FRAGCOUNT': '20.000'} [2023-02-24 19:11:54,153][177153] Updated weights for policy 0, policy_version 22260 (0.0008) [2023-02-24 19:11:55,753][177157] Large shaping reward 2.633 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.582, 194.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 19:11:56,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13858.1, 300 sec: 13815.3). Total num frames: 91205632. Throughput: 0: 3459.3. Samples: 22799002. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 19:11:56,376][177119] Avg episode reward: [(0, '17.306')] [2023-02-24 19:11:57,096][177153] Updated weights for policy 0, policy_version 22270 (0.0008) [2023-02-24 19:12:00,060][177153] Updated weights for policy 0, policy_version 22280 (0.0008) [2023-02-24 19:12:00,258][177170] DAMAGECOUNT value on done: 308537.0 [2023-02-24 19:12:00,259][177170] Sum rewards: 15.719, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.225', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon7': '0.046', 'AMMO3': '0.065', 'AMMO4': '0.140', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.268', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'weapon2': '0.836', 'HITCOUNT': '0.950', 'weapon4': '1.042', 'weapon3': '1.378', 'DAMAGECOUNT': '3.933', 'FRAGCOUNT': '11.000'} [2023-02-24 19:12:00,563][177170] DAMAGECOUNT value on done: 310769.0 [2023-02-24 19:12:00,564][177170] Sum rewards: 13.594, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.202', 'AMMO5': '0.007', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'weapon5': '0.118', 'AMMO4': '0.119', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'weapon4': '0.186', 'WEAPON5': '0.200', 'WEAPON3': '0.850', 'HITCOUNT': '0.940', 'weapon2': '1.186', 'weapon3': '1.938', 'DAMAGECOUNT': '3.900', 'FRAGCOUNT': '14.000'} [2023-02-24 19:12:01,273][177170] DAMAGECOUNT value on done: 304529.0 [2023-02-24 19:12:01,273][177170] Sum rewards: 13.608, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.210', 'AMMO5': '0.010', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'weapon7': '0.036', 'AMMO3': '0.068', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'weapon5': '0.236', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'weapon4': '0.562', 'HITCOUNT': '0.990', 'weapon2': '1.264', 'weapon3': '1.360', 'DAMAGECOUNT': '4.560', 'FRAGCOUNT': '11.000'} [2023-02-24 19:12:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13829.2). Total num frames: 91275264. Throughput: 0: 3457.5. Samples: 22819758. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 19:12:01,376][177119] Avg episode reward: [(0, '17.071')] [2023-02-24 19:12:01,570][177170] DAMAGECOUNT value on done: 307548.0 [2023-02-24 19:12:01,570][177170] Sum rewards: 22.966, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.716', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon7': '0.054', 'AMMO3': '0.096', 'AMMO4': '0.099', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.196', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.447', 'WEAPON3': '0.600', 'weapon2': '0.696', 'weapon4': '0.858', 'HITCOUNT': '1.510', 'weapon3': '1.540', 'DAMAGECOUNT': '5.868', 'FRAGCOUNT': '19.000'} [2023-02-24 19:12:01,669][177156] DAMAGECOUNT value on done: 308222.0 [2023-02-24 19:12:01,669][177156] Sum rewards: 11.107, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.802', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon7': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.116', 'weapon5': '0.240', 'AMMO4': '0.247', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '0.750', 'HITCOUNT': '0.940', 'weapon4': '0.944', 'weapon2': '1.034', 'weapon3': '1.208', 'DAMAGECOUNT': '4.392', 'FRAGCOUNT': '12.000'} [2023-02-24 19:12:01,689][177156] DAMAGECOUNT value on done: 300854.0 [2023-02-24 19:12:01,690][177156] Sum rewards: 22.575, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.290', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.075', 'AMMO3': '0.095', 'weapon5': '0.198', 'WEAPON4': '0.250', 'weapon4': '0.314', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'weapon2': '1.216', 'HITCOUNT': '1.560', 'weapon3': '1.780', 'DAMAGECOUNT': '5.376', 'FRAGCOUNT': '18.000'} [2023-02-24 19:12:01,974][177156] DAMAGECOUNT value on done: 316683.0 [2023-02-24 19:12:01,975][177156] Sum rewards: 16.830, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.941', 'AMMO2': '0.010', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.051', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.141', 'weapon5': '0.156', 'WEAPON4': '0.250', 'weapon4': '0.276', 'WEAPON5': '0.350', 'weapon2': '0.882', 'WEAPON3': '0.950', 'HITCOUNT': '1.400', 'weapon3': '2.112', 'DAMAGECOUNT': '5.610', 'FRAGCOUNT': '16.000'} [2023-02-24 19:12:01,994][177156] DAMAGECOUNT value on done: 303042.0 [2023-02-24 19:12:01,994][177156] Sum rewards: 8.969, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.790', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.019', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.194', 'weapon5': '0.244', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.860', 'weapon2': '1.188', 'weapon3': '1.350', 'DAMAGECOUNT': '3.615', 'FRAGCOUNT': '8.000'} [2023-02-24 19:12:02,626][177158] DAMAGECOUNT value on done: 297746.0 [2023-02-24 19:12:02,627][177158] Sum rewards: 22.366, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.744', 'AMMO2': '0.009', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'weapon4': '0.034', 'AMMO4': '0.042', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'weapon5': '0.292', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon2': '1.156', 'HITCOUNT': '1.260', 'weapon3': '2.088', 'DAMAGECOUNT': '5.511', 'FRAGCOUNT': '19.000'} [2023-02-24 19:12:02,929][177158] DAMAGECOUNT value on done: 299887.0 [2023-02-24 19:12:02,930][177158] Sum rewards: 26.534, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.260', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.039', 'weapon5': '0.106', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.350', 'weapon4': '0.520', 'weapon2': '0.524', 'WEAPON3': '0.950', 'HITCOUNT': '1.920', 'weapon3': '2.044', 'DAMAGECOUNT': '7.269', 'FRAGCOUNT': '22.000'} [2023-02-24 19:12:03,023][177153] Updated weights for policy 0, policy_version 22290 (0.0008) [2023-02-24 19:12:03,259][177158] DAMAGECOUNT value on done: 311114.0 [2023-02-24 19:12:03,260][177158] Sum rewards: 20.901, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.650', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.033', 'AMMO3': '0.125', 'AMMO4': '0.166', 'weapon5': '0.238', 'WEAPON4': '0.250', 'weapon4': '0.448', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'weapon3': '1.382', 'HITCOUNT': '1.440', 'weapon2': '1.480', 'DAMAGECOUNT': '5.508', 'FRAGCOUNT': '20.000'} [2023-02-24 19:12:03,559][177158] DAMAGECOUNT value on done: 311207.0 [2023-02-24 19:12:03,560][177158] Sum rewards: 12.745, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.136', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO5': '0.020', 'weapon4': '0.020', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.145', 'weapon5': '0.278', 'ARMOR': '0.443', 'WEAPON5': '0.450', 'WEAPON3': '0.900', 'HITCOUNT': '1.140', 'weapon2': '1.656', 'weapon3': '1.692', 'DAMAGECOUNT': '4.440', 'FRAGCOUNT': '13.000'} [2023-02-24 19:12:05,996][177153] Updated weights for policy 0, policy_version 22300 (0.0008) [2023-02-24 19:12:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13829.2). Total num frames: 91344896. Throughput: 0: 3455.6. Samples: 22830036. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 19:12:06,376][177119] Avg episode reward: [(0, '17.335')] [2023-02-24 19:12:06,692][177172] DAMAGECOUNT value on done: 302903.0 [2023-02-24 19:12:06,692][177172] Sum rewards: 24.894, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.248', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'weapon5': '0.282', 'weapon4': '0.290', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'weapon2': '1.000', 'HITCOUNT': '1.350', 'weapon3': '1.896', 'DAMAGECOUNT': '6.480', 'FRAGCOUNT': '18.000'} [2023-02-24 19:12:06,994][177172] DAMAGECOUNT value on done: 306447.0 [2023-02-24 19:12:06,995][177172] Sum rewards: 20.977, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.455', 'AMMO5': '0.020', 'AMMO2': '0.046', 'AMMO3': '0.119', 'AMMO4': '0.231', 'weapon5': '0.328', 'WEAPON4': '0.400', 'ARMOR': '0.451', 'WEAPON5': '0.500', 'weapon2': '0.552', 'WEAPON3': '0.700', 'weapon4': '1.032', 'HITCOUNT': '1.340', 'weapon3': '1.446', 'DAMAGECOUNT': '5.766', 'FRAGCOUNT': '17.000'} [2023-02-24 19:12:08,133][177154] DAMAGECOUNT value on done: 309287.0 [2023-02-24 19:12:08,134][177154] Sum rewards: 12.387, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.122', 'AMMO5': '0.025', 'WEAPON1': '0.030', 'AMMO2': '0.038', 'weapon5': '0.076', 'AMMO3': '0.183', 'AMMO4': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.550', 'weapon4': '0.650', 'weapon2': '0.854', 'WEAPON3': '1.100', 'HITCOUNT': '1.480', 'weapon3': '1.984', 'DAMAGECOUNT': '5.601', 'FRAGCOUNT': '15.000'} [2023-02-24 19:12:08,437][177154] DAMAGECOUNT value on done: 314156.0 [2023-02-24 19:12:08,438][177154] Sum rewards: 20.532, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.720', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.052', 'AMMO4': '0.124', 'weapon5': '0.270', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'weapon2': '0.442', 'WEAPON4': '0.450', 'weapon4': '1.082', 'weapon3': '1.198', 'HITCOUNT': '1.300', 'DAMAGECOUNT': '5.079', 'FRAGCOUNT': '15.000'} [2023-02-24 19:12:08,463][177172] DAMAGECOUNT value on done: 318683.0 [2023-02-24 19:12:08,464][177172] Sum rewards: 16.306, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.202', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.036', 'AMMO3': '0.138', 'AMMO4': '0.178', 'WEAPON4': '0.250', 'weapon5': '0.394', 'weapon2': '0.418', 'WEAPON5': '0.550', 'weapon4': '0.568', 'WEAPON3': '0.950', 'HITCOUNT': '1.420', 'weapon3': '1.732', 'DAMAGECOUNT': '6.348', 'FRAGCOUNT': '16.000'} [2023-02-24 19:12:08,739][177154] DAMAGECOUNT value on done: 318781.0 [2023-02-24 19:12:08,739][177154] Sum rewards: 8.335, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.112', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.133', 'weapon5': '0.312', 'WEAPON4': '0.450', 'ARMOR': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.564', 'WEAPON3': '0.700', 'HITCOUNT': '1.100', 'weapon3': '1.148', 'weapon4': '1.554', 'DAMAGECOUNT': '4.113', 'FRAGCOUNT': '8.000'} [2023-02-24 19:12:08,763][177172] DAMAGECOUNT value on done: 309251.0 [2023-02-24 19:12:08,763][177172] Sum rewards: 21.499, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.730', 'AMMO5': '0.005', 'AMMO2': '0.062', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO3': '0.136', 'AMMO4': '0.309', 'WEAPON4': '0.500', 'weapon2': '0.606', 'WEAPON3': '0.850', 'weapon4': '1.106', 'HITCOUNT': '1.850', 'weapon3': '1.884', 'DAMAGECOUNT': '7.713', 'FRAGCOUNT': '20.000'} [2023-02-24 19:12:08,971][177153] Updated weights for policy 0, policy_version 22310 (0.0008) [2023-02-24 19:12:09,041][177154] DAMAGECOUNT value on done: 317797.0 [2023-02-24 19:12:09,041][177154] Sum rewards: 24.705, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.143', 'ARMOR': '0.004', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.120', 'WEAPON4': '0.200', 'weapon5': '0.224', 'WEAPON5': '0.400', 'weapon4': '0.404', 'WEAPON3': '0.800', 'weapon2': '0.870', 'HITCOUNT': '1.860', 'weapon3': '2.130', 'DAMAGECOUNT': '7.410', 'FRAGCOUNT': '21.000'} [2023-02-24 19:12:09,181][177157] DAMAGECOUNT value on done: 317151.0 [2023-02-24 19:12:09,182][177157] Sum rewards: 19.297, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.690', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.036', 'AMMO3': '0.129', 'weapon4': '0.174', 'AMMO4': '0.180', 'WEAPON4': '0.200', 'weapon5': '0.366', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '1.060', 'weapon2': '1.234', 'weapon3': '1.940', 'DAMAGECOUNT': '6.492', 'FRAGCOUNT': '16.000'} [2023-02-24 19:12:09,479][177157] DAMAGECOUNT value on done: 303691.0 [2023-02-24 19:12:09,480][177157] Sum rewards: 22.100, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.622', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.155', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'weapon5': '0.210', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon2': '0.542', 'weapon4': '0.648', 'WEAPON3': '1.100', 'HITCOUNT': '1.640', 'weapon3': '2.120', 'DAMAGECOUNT': '6.927', 'FRAGCOUNT': '22.000'} [2023-02-24 19:12:09,491][177171] DAMAGECOUNT value on done: 305518.0 [2023-02-24 19:12:09,491][177171] Sum rewards: 23.796, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.020', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.022', 'WEAPON1': '0.040', 'AMMO3': '0.091', 'weapon5': '0.388', 'WEAPON5': '0.650', 'WEAPON3': '0.750', 'weapon2': '1.122', 'HITCOUNT': '1.170', 'weapon3': '2.096', 'DAMAGECOUNT': '6.498', 'FRAGCOUNT': '18.000'} [2023-02-24 19:12:09,493][177157] DAMAGECOUNT value on done: 302185.0 [2023-02-24 19:12:09,493][177157] Sum rewards: 14.853, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.700', 'WEAPON1': '0.030', 'AMMO5': '0.035', 'AMMO2': '0.039', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.108', 'AMMO4': '0.193', 'WEAPON4': '0.250', 'weapon5': '0.386', 'weapon2': '0.536', 'WEAPON3': '0.600', 'WEAPON5': '0.800', 'weapon4': '0.954', 'HITCOUNT': '1.010', 'weapon3': '1.410', 'DAMAGECOUNT': '5.346', 'FRAGCOUNT': '14.000'} [2023-02-24 19:12:09,502][177171] DAMAGECOUNT value on done: 305471.0 [2023-02-24 19:12:09,502][177171] Sum rewards: 12.816, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.190', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.032', 'weapon4': '0.080', 'AMMO3': '0.118', 'AMMO4': '0.161', 'WEAPON4': '0.250', 'weapon5': '0.376', 'WEAPON5': '0.650', 'WEAPON3': '0.800', 'HITCOUNT': '0.820', 'weapon2': '1.402', 'weapon3': '1.762', 'DAMAGECOUNT': '3.780', 'FRAGCOUNT': '13.000'} [2023-02-24 19:12:09,796][177157] DAMAGECOUNT value on done: 303485.0 [2023-02-24 19:12:09,796][177157] Sum rewards: 20.729, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.004', 'AMMO5': '0.017', 'AMMO2': '0.022', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.109', 'weapon5': '0.132', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.530', 'WEAPON3': '0.900', 'weapon4': '1.036', 'HITCOUNT': '1.400', 'weapon3': '1.846', 'DAMAGECOUNT': '5.934', 'FRAGCOUNT': '20.000'} [2023-02-24 19:12:09,801][177171] DAMAGECOUNT value on done: 305873.0 [2023-02-24 19:12:09,802][177171] Sum rewards: 16.111, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.840', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO4': '0.066', 'AMMO3': '0.093', 'weapon7': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.160', 'WEAPON4': '0.250', 'weapon2': '0.356', 'ARMOR': '0.461', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'weapon4': '1.312', 'HITCOUNT': '1.360', 'weapon3': '1.534', 'DAMAGECOUNT': '5.259', 'FRAGCOUNT': '14.500'} [2023-02-24 19:12:09,813][177171] DAMAGECOUNT value on done: 308119.0 [2023-02-24 19:12:09,813][177171] Sum rewards: 15.361, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.080', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'AMMO3': '0.050', 'AMMO4': '0.101', 'WEAPON4': '0.300', 'weapon5': '0.302', 'WEAPON3': '0.350', 'WEAPON5': '0.500', 'weapon2': '0.964', 'weapon3': '0.988', 'weapon4': '1.018', 'HITCOUNT': '1.220', 'DAMAGECOUNT': '4.842', 'FRAGCOUNT': '13.000'} [2023-02-24 19:12:11,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13829.2). Total num frames: 91414528. Throughput: 0: 3454.6. Samples: 22850726. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 19:12:11,376][177119] Avg episode reward: [(0, '17.412')] [2023-02-24 19:12:11,727][177155] DAMAGECOUNT value on done: 314307.0 [2023-02-24 19:12:11,727][177155] Sum rewards: 17.870, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.087', 'AMMO3': '0.109', 'weapon5': '0.190', 'weapon4': '0.272', 'WEAPON5': '0.350', 'HEALTH': '0.442', 'WEAPON3': '0.600', 'HITCOUNT': '1.120', 'weapon2': '1.200', 'weapon3': '1.654', 'DAMAGECOUNT': '4.224', 'FRAGCOUNT': '15.000'} [2023-02-24 19:12:11,944][177153] Updated weights for policy 0, policy_version 22320 (0.0008) [2023-02-24 19:12:12,033][177155] DAMAGECOUNT value on done: 318278.0 [2023-02-24 19:12:12,033][177155] Sum rewards: 13.979, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.948', 'WEAPON1': '0.020', 'AMMO5': '0.026', 'AMMO2': '0.040', 'AMMO3': '0.121', 'WEAPON4': '0.200', 'AMMO4': '0.202', 'weapon4': '0.360', 'ARMOR': '0.400', 'weapon5': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon2': '1.026', 'HITCOUNT': '1.140', 'weapon3': '1.700', 'DAMAGECOUNT': '5.190', 'FRAGCOUNT': '12.500'} [2023-02-24 19:12:12,339][177155] DAMAGECOUNT value on done: 319441.0 [2023-02-24 19:12:12,340][177155] Sum rewards: 21.000, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.953', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'weapon7': '0.024', 'AMMO2': '0.024', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'weapon4': '0.202', 'weapon5': '0.256', 'WEAPON5': '0.400', 'WEAPON3': '0.950', 'weapon2': '1.062', 'HITCOUNT': '1.290', 'weapon3': '2.046', 'DAMAGECOUNT': '5.688', 'FRAGCOUNT': '19.000'} [2023-02-24 19:12:12,646][177155] DAMAGECOUNT value on done: 302957.0 [2023-02-24 19:12:12,646][177155] Sum rewards: 12.648, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.280', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.029', 'AMMO3': '0.142', 'AMMO4': '0.143', 'weapon5': '0.196', 'weapon2': '0.250', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '0.800', 'HITCOUNT': '1.330', 'weapon4': '1.400', 'weapon3': '1.652', 'DAMAGECOUNT': '4.965', 'FRAGCOUNT': '15.000'} [2023-02-24 19:12:14,925][177153] Updated weights for policy 0, policy_version 22330 (0.0008) [2023-02-24 19:12:16,376][177119] Fps is (10 sec: 13517.0, 60 sec: 13789.9, 300 sec: 13815.3). Total num frames: 91480064. Throughput: 0: 3456.0. Samples: 22871478. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 19:12:16,376][177119] Avg episode reward: [(0, '17.425')] [2023-02-24 19:12:17,904][177153] Updated weights for policy 0, policy_version 22340 (0.0008) [2023-02-24 19:12:19,720][177170] DAMAGECOUNT value on done: 309863.0 [2023-02-24 19:12:19,721][177170] Sum rewards: 12.992, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.470', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'AMMO3': '0.086', 'AMMO4': '0.158', 'weapon5': '0.232', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'ARMOR': '0.459', 'WEAPON3': '0.550', 'weapon4': '0.958', 'HITCOUNT': '0.970', 'weapon2': '1.038', 'weapon3': '1.304', 'DAMAGECOUNT': '3.978', 'FRAGCOUNT': '12.000'} [2023-02-24 19:12:20,026][177170] DAMAGECOUNT value on done: 311965.0 [2023-02-24 19:12:20,027][177170] Sum rewards: 11.831, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.530', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.090', 'AMMO4': '0.124', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon5': '0.380', 'WEAPON3': '0.550', 'weapon4': '0.552', 'weapon2': '0.894', 'HITCOUNT': '1.060', 'weapon3': '1.668', 'DAMAGECOUNT': '3.588', 'FRAGCOUNT': '11.000'} [2023-02-24 19:12:20,751][177170] DAMAGECOUNT value on done: 306641.0 [2023-02-24 19:12:20,752][177170] Sum rewards: 22.724, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.690', 'AMMO2': '0.002', 'WEAPON1': '0.010', 'AMMO4': '0.011', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'AMMO3': '0.079', 'weapon4': '0.170', 'weapon5': '0.470', 'WEAPON3': '0.550', 'WEAPON5': '0.550', 'HITCOUNT': '1.260', 'weapon2': '1.430', 'weapon3': '1.478', 'DAMAGECOUNT': '6.336', 'FRAGCOUNT': '17.000'} [2023-02-24 19:12:20,887][177153] Updated weights for policy 0, policy_version 22350 (0.0009) [2023-02-24 19:12:21,042][177170] DAMAGECOUNT value on done: 309212.0 [2023-02-24 19:12:21,042][177170] Sum rewards: 16.254, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.802', 'AMMO5': '0.011', 'AMMO2': '0.018', 'AMMO3': '0.081', 'AMMO4': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.132', 'weapon5': '0.188', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'weapon4': '0.570', 'HITCOUNT': '1.250', 'weapon2': '1.340', 'weapon3': '1.346', 'DAMAGECOUNT': '4.992', 'FRAGCOUNT': '13.000'} [2023-02-24 19:12:21,167][177156] DAMAGECOUNT value on done: 309448.0 [2023-02-24 19:12:21,168][177156] Sum rewards: 11.445, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'AMMO3': '0.030', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.118', 'weapon5': '0.192', 'WEAPON3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'HEALTH': '0.417', 'HITCOUNT': '0.730', 'weapon3': '0.732', 'weapon4': '1.102', 'weapon2': '1.584', 'DAMAGECOUNT': '3.678', 'FRAGCOUNT': '7.000'} [2023-02-24 19:12:21,190][177156] DAMAGECOUNT value on done: 302549.0 [2023-02-24 19:12:21,191][177156] Sum rewards: 17.428, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.890', 'AMMO5': '0.010', 'AMMO2': '0.031', 'WEAPON4': '0.050', 'AMMO3': '0.053', 'AMMO4': '0.156', 'weapon4': '0.244', 'weapon5': '0.332', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'HITCOUNT': '1.230', 'weapon2': '1.404', 'weapon3': '1.422', 'DAMAGECOUNT': '5.085', 'FRAGCOUNT': '12.000'} [2023-02-24 19:12:21,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13789.9, 300 sec: 13815.3). Total num frames: 91549696. Throughput: 0: 3454.4. Samples: 22881808. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 19:12:21,376][177119] Avg episode reward: [(0, '17.147')] [2023-02-24 19:12:21,476][177156] DAMAGECOUNT value on done: 317751.0 [2023-02-24 19:12:21,476][177156] Sum rewards: 12.930, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.288', 'AMMO2': '0.009', 'AMMO5': '0.015', 'AMMO3': '0.030', 'AMMO4': '0.045', 'weapon7': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.126', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.466', 'weapon3': '0.630', 'HITCOUNT': '0.650', 'weapon2': '0.662', 'weapon4': '1.034', 'DAMAGECOUNT': '3.069', 'FRAGCOUNT': '9.000'} [2023-02-24 19:12:21,497][177156] DAMAGECOUNT value on done: 304609.0 [2023-02-24 19:12:21,497][177156] Sum rewards: 17.699, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.624', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.036', 'weapon4': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.150', 'AMMO4': '0.178', 'weapon5': '0.336', 'WEAPON5': '0.500', 'weapon2': '0.728', 'WEAPON3': '0.900', 'HITCOUNT': '1.000', 'weapon3': '2.362', 'DAMAGECOUNT': '4.701', 'FRAGCOUNT': '18.000'} [2023-02-24 19:12:22,142][177158] DAMAGECOUNT value on done: 299326.0 [2023-02-24 19:12:22,142][177158] Sum rewards: 16.205, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.935', 'AMMO2': '0.007', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.032', 'AMMO3': '0.060', 'WEAPON4': '0.150', 'weapon4': '0.340', 'WEAPON5': '0.350', 'weapon5': '0.396', 'WEAPON3': '0.500', 'HITCOUNT': '1.000', 'weapon2': '1.168', 'weapon3': '1.612', 'DAMAGECOUNT': '4.740', 'FRAGCOUNT': '12.000'} [2023-02-24 19:12:22,448][177158] DAMAGECOUNT value on done: 302248.0 [2023-02-24 19:12:22,448][177158] Sum rewards: 21.217, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.260', 'AMMO2': '0.010', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.125', 'weapon5': '0.212', 'weapon4': '0.230', 'WEAPON5': '0.350', 'weapon2': '0.798', 'WEAPON3': '0.800', 'HITCOUNT': '1.620', 'weapon3': '2.312', 'DAMAGECOUNT': '7.083', 'FRAGCOUNT': '16.000'} [2023-02-24 19:12:22,781][177158] DAMAGECOUNT value on done: 312867.0 [2023-02-24 19:12:22,782][177158] Sum rewards: 17.923, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.088', 'weapon7': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'AMMO4': '0.090', 'AMMO3': '0.101', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.244', 'WEAPON4': '0.250', 'weapon4': '0.420', 'WEAPON5': '0.500', 'weapon2': '0.666', 'WEAPON3': '0.700', 'HITCOUNT': '1.150', 'weapon3': '2.202', 'DAMAGECOUNT': '5.259', 'FRAGCOUNT': '15.000'} [2023-02-24 19:12:23,086][177158] DAMAGECOUNT value on done: 313121.0 [2023-02-24 19:12:23,086][177158] Sum rewards: 20.236, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.070', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO3': '0.105', 'WEAPON4': '0.200', 'weapon5': '0.328', 'ARMOR': '0.437', 'WEAPON5': '0.450', 'weapon2': '0.480', 'weapon4': '0.700', 'WEAPON3': '0.800', 'HITCOUNT': '1.380', 'weapon3': '1.904', 'DAMAGECOUNT': '5.742', 'FRAGCOUNT': '16.500'} [2023-02-24 19:12:23,855][177153] Updated weights for policy 0, policy_version 22360 (0.0008) [2023-02-24 19:12:26,213][177172] DAMAGECOUNT value on done: 305094.0 [2023-02-24 19:12:26,213][177172] Sum rewards: 18.498, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.510', 'WEAPON1': '0.020', 'AMMO5': '0.031', 'AMMO2': '0.049', 'AMMO3': '0.122', 'AMMO4': '0.243', 'weapon5': '0.272', 'WEAPON4': '0.500', 'weapon4': '0.584', 'WEAPON5': '0.650', 'WEAPON3': '0.850', 'weapon2': '1.036', 'HITCOUNT': '1.510', 'weapon3': '1.818', 'DAMAGECOUNT': '6.573', 'FRAGCOUNT': '18.000'} [2023-02-24 19:12:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 91619328. Throughput: 0: 3450.3. Samples: 22902410. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 19:12:26,376][177119] Avg episode reward: [(0, '17.411')] [2023-02-24 19:12:26,505][177172] DAMAGECOUNT value on done: 308156.0 [2023-02-24 19:12:26,506][177172] Sum rewards: 21.042, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.780', 'AMMO2': '0.012', 'AMMO5': '0.015', 'AMMO4': '0.059', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'weapon5': '0.246', 'WEAPON5': '0.400', 'weapon4': '0.402', 'WEAPON3': '0.550', 'HITCOUNT': '1.230', 'weapon2': '1.294', 'weapon3': '1.558', 'DAMAGECOUNT': '5.127', 'FRAGCOUNT': '16.000'} [2023-02-24 19:12:26,809][177153] Updated weights for policy 0, policy_version 22370 (0.0008) [2023-02-24 19:12:27,571][177154] DAMAGECOUNT value on done: 311015.0 [2023-02-24 19:12:27,572][177154] Sum rewards: 16.925, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.162', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.047', 'AMMO3': '0.131', 'weapon5': '0.166', 'AMMO4': '0.237', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '0.800', 'weapon2': '0.864', 'weapon4': '1.004', 'HITCOUNT': '1.390', 'weapon3': '1.588', 'DAMAGECOUNT': '5.184', 'FRAGCOUNT': '18.000'} [2023-02-24 19:12:27,865][177154] DAMAGECOUNT value on done: 315286.0 [2023-02-24 19:12:27,865][177154] Sum rewards: 11.125, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.915', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.007', 'weapon4': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.058', 'weapon7': '0.064', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.152', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'HITCOUNT': '0.530', 'weapon3': '1.022', 'weapon2': '1.398', 'DAMAGECOUNT': '3.390', 'FRAGCOUNT': '8.000'} [2023-02-24 19:12:27,985][177172] DAMAGECOUNT value on done: 320574.0 [2023-02-24 19:12:27,985][177172] Sum rewards: 17.218, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.111', 'AMMO2': '0.008', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.038', 'AMMO3': '0.119', 'weapon5': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'ARMOR': '0.484', 'weapon2': '0.624', 'WEAPON3': '0.700', 'weapon4': '1.252', 'weapon3': '1.382', 'HITCOUNT': '1.490', 'DAMAGECOUNT': '5.673', 'FRAGCOUNT': '13.000'} [2023-02-24 19:12:28,164][177154] DAMAGECOUNT value on done: 320541.0 [2023-02-24 19:12:28,165][177154] Sum rewards: 18.180, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.211', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.017', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.094', 'weapon4': '0.176', 'WEAPON5': '0.300', 'weapon2': '0.438', 'weapon5': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '1.110', 'weapon3': '2.320', 'DAMAGECOUNT': '5.280', 'FRAGCOUNT': '13.500'} [2023-02-24 19:12:28,285][177172] DAMAGECOUNT value on done: 310789.0 [2023-02-24 19:12:28,285][177172] Sum rewards: 8.993, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.450', 'AMMO5': '0.029', 'AMMO2': '0.053', 'AMMO3': '0.111', 'weapon5': '0.148', 'AMMO4': '0.267', 'WEAPON4': '0.400', 'WEAPON5': '0.600', 'weapon2': '0.668', 'weapon4': '0.768', 'WEAPON3': '0.800', 'HITCOUNT': '1.220', 'weapon3': '2.014', 'DAMAGECOUNT': '4.614', 'FRAGCOUNT': '10.000'} [2023-02-24 19:12:28,470][177154] DAMAGECOUNT value on done: 319621.0 [2023-02-24 19:12:28,470][177154] Sum rewards: 13.604, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.348', 'AMMO2': '0.015', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.073', 'AMMO3': '0.155', 'weapon5': '0.220', 'WEAPON4': '0.300', 'weapon4': '0.344', 'WEAPON5': '0.450', 'weapon2': '0.596', 'WEAPON3': '1.050', 'HITCOUNT': '1.320', 'weapon3': '2.420', 'DAMAGECOUNT': '5.472', 'FRAGCOUNT': '14.000'} [2023-02-24 19:12:28,652][177157] DAMAGECOUNT value on done: 317886.0 [2023-02-24 19:12:28,652][177157] Sum rewards: 8.973, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.290', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'AMMO3': '0.066', 'AMMO4': '0.134', 'WEAPON4': '0.300', 'weapon5': '0.358', 'weapon4': '0.400', 'WEAPON3': '0.450', 'WEAPON5': '0.500', 'HITCOUNT': '0.630', 'weapon3': '1.200', 'weapon2': '1.456', 'DAMAGECOUNT': '2.205', 'FRAGCOUNT': '10.000'} [2023-02-24 19:12:28,968][177157] DAMAGECOUNT value on done: 305601.0 [2023-02-24 19:12:28,968][177157] Sum rewards: 19.256, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.216', 'WEAPON1': '0.010', 'AMMO5': '0.028', 'AMMO2': '0.045', 'AMMO3': '0.107', 'AMMO4': '0.224', 'WEAPON4': '0.250', 'weapon5': '0.330', 'weapon4': '0.396', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'weapon2': '0.898', 'HITCOUNT': '1.130', 'weapon3': '2.024', 'DAMAGECOUNT': '5.730', 'FRAGCOUNT': '17.000'} [2023-02-24 19:12:28,980][177157] DAMAGECOUNT value on done: 304862.0 [2023-02-24 19:12:28,980][177157] Sum rewards: 29.644, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.798', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'weapon4': '0.020', 'AMMO5': '0.026', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.112', 'weapon5': '0.366', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon2': '1.062', 'HITCOUNT': '1.620', 'weapon3': '2.144', 'DAMAGECOUNT': '7.695', 'FRAGCOUNT': '23.500'} [2023-02-24 19:12:29,031][177171] DAMAGECOUNT value on done: 307199.0 [2023-02-24 19:12:29,032][177171] Sum rewards: 15.360, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.738', 'AMMO2': '0.009', 'AMMO5': '0.015', 'AMMO4': '0.043', 'weapon4': '0.104', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'weapon5': '0.290', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'HITCOUNT': '1.100', 'weapon2': '1.224', 'weapon3': '1.842', 'DAMAGECOUNT': '5.043', 'FRAGCOUNT': '14.000'} [2023-02-24 19:12:29,042][177171] DAMAGECOUNT value on done: 307054.0 [2023-02-24 19:12:29,042][177171] Sum rewards: 17.657, reward structure: {'DEATHCOUNT': '-7.500', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO5': '0.019', 'WEAPON4': '0.050', 'AMMO4': '0.076', 'weapon7': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.119', 'HEALTH': '0.240', 'weapon5': '0.246', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'weapon4': '0.650', 'weapon2': '0.814', 'HITCOUNT': '0.870', 'weapon3': '1.814', 'DAMAGECOUNT': '4.749', 'FRAGCOUNT': '14.000'} [2023-02-24 19:12:29,277][177157] DAMAGECOUNT value on done: 305577.0 [2023-02-24 19:12:29,278][177157] Sum rewards: 24.364, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.318', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'AMMO5': '0.022', 'weapon7': '0.028', 'AMMO4': '0.106', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'weapon5': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.318', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'weapon2': '1.142', 'HITCOUNT': '1.430', 'weapon3': '2.022', 'DAMAGECOUNT': '6.276', 'FRAGCOUNT': '21.000'} [2023-02-24 19:12:29,338][177171] DAMAGECOUNT value on done: 307848.0 [2023-02-24 19:12:29,339][177171] Sum rewards: 12.477, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.700', 'AMMO2': '0.031', 'AMMO5': '0.032', 'AMMO3': '0.150', 'AMMO4': '0.156', 'weapon5': '0.190', 'weapon2': '0.578', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'ARMOR': '0.912', 'WEAPON3': '0.950', 'weapon4': '1.252', 'HITCOUNT': '1.360', 'weapon3': '1.670', 'DAMAGECOUNT': '5.445', 'FRAGCOUNT': '14.000'} [2023-02-24 19:12:29,350][177171] DAMAGECOUNT value on done: 311069.0 [2023-02-24 19:12:29,351][177171] Sum rewards: 27.203, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.692', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.165', 'weapon5': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.682', 'weapon2': '0.752', 'WEAPON3': '1.000', 'HITCOUNT': '1.960', 'weapon3': '2.058', 'DAMAGECOUNT': '8.850', 'FRAGCOUNT': '23.000'} [2023-02-24 19:12:29,799][177153] Updated weights for policy 0, policy_version 22380 (0.0008) [2023-02-24 19:12:31,263][177155] DAMAGECOUNT value on done: 316903.0 [2023-02-24 19:12:31,264][177155] Sum rewards: 27.481, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.135', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.048', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.136', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon2': '0.710', 'weapon4': '0.808', 'WEAPON3': '0.900', 'HITCOUNT': '2.020', 'weapon3': '2.062', 'DAMAGECOUNT': '7.788', 'FRAGCOUNT': '23.000'} [2023-02-24 19:12:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 91688960. Throughput: 0: 3450.2. Samples: 22923162. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:12:31,376][177119] Avg episode reward: [(0, '17.786')] [2023-02-24 19:12:31,566][177155] DAMAGECOUNT value on done: 320747.0 [2023-02-24 19:12:31,567][177155] Sum rewards: 25.343, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.140', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO5': '0.020', 'AMMO4': '0.071', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'weapon4': '0.212', 'weapon5': '0.332', 'WEAPON5': '0.500', 'weapon2': '0.802', 'WEAPON3': '0.850', 'HITCOUNT': '1.730', 'weapon3': '2.252', 'DAMAGECOUNT': '7.407', 'FRAGCOUNT': '21.000'} [2023-02-24 19:12:31,862][177155] DAMAGECOUNT value on done: 321959.0 [2023-02-24 19:12:31,863][177155] Sum rewards: 22.168, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.482', 'AMMO2': '0.018', 'AMMO5': '0.026', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'weapon5': '0.364', 'WEAPON5': '0.550', 'weapon2': '0.592', 'weapon4': '0.656', 'WEAPON3': '1.100', 'HITCOUNT': '1.540', 'weapon3': '1.844', 'DAMAGECOUNT': '7.554', 'FRAGCOUNT': '20.500'} [2023-02-24 19:12:32,161][177155] DAMAGECOUNT value on done: 305170.0 [2023-02-24 19:12:32,161][177155] Sum rewards: 23.982, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.907', 'AMMO5': '0.015', 'AMMO2': '0.030', 'WEAPON1': '0.030', 'AMMO3': '0.117', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'weapon5': '0.400', 'weapon4': '0.462', 'WEAPON3': '0.750', 'weapon2': '0.756', 'HITCOUNT': '1.590', 'weapon3': '1.850', 'DAMAGECOUNT': '6.639', 'FRAGCOUNT': '19.000'} [2023-02-24 19:12:32,765][177153] Updated weights for policy 0, policy_version 22390 (0.0008) [2023-02-24 19:12:35,721][177153] Updated weights for policy 0, policy_version 22400 (0.0009) [2023-02-24 19:12:36,376][177119] Fps is (10 sec: 13926.2, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 91758592. Throughput: 0: 3452.3. Samples: 22933584. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:12:36,376][177119] Avg episode reward: [(0, '17.775')] [2023-02-24 19:12:38,665][177153] Updated weights for policy 0, policy_version 22410 (0.0008) [2023-02-24 19:12:39,167][177170] DAMAGECOUNT value on done: 311521.0 [2023-02-24 19:12:39,167][177170] Sum rewards: 15.136, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.462', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.032', 'AMMO3': '0.079', 'AMMO4': '0.160', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon5': '0.266', 'weapon7': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON7': '0.400', 'weapon4': '0.508', 'WEAPON3': '0.600', 'HITCOUNT': '0.970', 'weapon2': '1.056', 'weapon3': '1.304', 'DAMAGECOUNT': '4.974', 'FRAGCOUNT': '13.000'} [2023-02-24 19:12:39,465][177170] DAMAGECOUNT value on done: 313218.0 [2023-02-24 19:12:39,465][177170] Sum rewards: 13.572, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.400', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.012', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'weapon5': '0.164', 'weapon4': '0.270', 'WEAPON5': '0.350', 'ARMOR': '0.495', 'WEAPON3': '0.650', 'HITCOUNT': '1.020', 'weapon2': '1.092', 'weapon3': '1.530', 'DAMAGECOUNT': '3.714', 'FRAGCOUNT': '10.000'} [2023-02-24 19:12:40,089][177170] DAMAGECOUNT value on done: 308586.0 [2023-02-24 19:12:40,090][177170] Sum rewards: 18.445, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.376', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO5': '0.017', 'weapon4': '0.074', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'weapon5': '0.114', 'AMMO3': '0.176', 'WEAPON5': '0.350', 'weapon2': '0.736', 'WEAPON3': '1.150', 'HITCOUNT': '1.400', 'weapon3': '2.764', 'DAMAGECOUNT': '5.835', 'FRAGCOUNT': '19.000'} [2023-02-24 19:12:40,396][177170] DAMAGECOUNT value on done: 310986.0 [2023-02-24 19:12:40,396][177170] Sum rewards: 13.929, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.316', 'AMMO2': '0.002', 'AMMO4': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.024', 'WEAPON4': '0.100', 'AMMO3': '0.159', 'weapon5': '0.184', 'weapon4': '0.268', 'weapon2': '0.506', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'HITCOUNT': '1.180', 'weapon3': '2.530', 'DAMAGECOUNT': '5.322', 'FRAGCOUNT': '14.000'} [2023-02-24 19:12:40,595][177156] DAMAGECOUNT value on done: 310936.0 [2023-02-24 19:12:40,596][177156] Sum rewards: 14.438, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.438', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO3': '0.091', 'AMMO4': '0.162', 'weapon5': '0.304', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'ARMOR': '0.462', 'weapon4': '0.490', 'WEAPON3': '0.600', 'HITCOUNT': '0.890', 'weapon2': '1.138', 'weapon3': '1.728', 'DAMAGECOUNT': '4.464', 'FRAGCOUNT': '13.000'} [2023-02-24 19:12:40,615][177156] DAMAGECOUNT value on done: 304986.0 [2023-02-24 19:12:40,615][177156] Sum rewards: 22.156, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.802', 'AMMO5': '0.017', 'AMMO2': '0.029', 'weapon7': '0.046', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.145', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.220', 'WEAPON5': '0.400', 'weapon2': '0.414', 'weapon4': '0.498', 'WEAPON3': '1.100', 'HITCOUNT': '1.610', 'weapon3': '2.348', 'DAMAGECOUNT': '7.311', 'FRAGCOUNT': '21.000'} [2023-02-24 19:12:40,901][177156] DAMAGECOUNT value on done: 320281.0 [2023-02-24 19:12:40,901][177156] Sum rewards: 19.905, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.128', 'AMMO5': '0.030', 'AMMO2': '0.038', 'AMMO4': '0.190', 'AMMO3': '0.192', 'weapon5': '0.280', 'WEAPON4': '0.500', 'weapon4': '0.530', 'weapon2': '0.542', 'WEAPON5': '0.650', 'WEAPON3': '1.100', 'HITCOUNT': '1.580', 'weapon3': '2.310', 'DAMAGECOUNT': '7.590', 'FRAGCOUNT': '20.000'} [2023-02-24 19:12:40,924][177156] DAMAGECOUNT value on done: 306340.0 [2023-02-24 19:12:40,924][177156] Sum rewards: 18.426, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.016', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'weapon7': '0.010', 'AMMO5': '0.012', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'weapon5': '0.192', 'WEAPON5': '0.300', 'weapon4': '0.352', 'WEAPON3': '0.850', 'weapon2': '0.954', 'HITCOUNT': '1.240', 'weapon3': '2.050', 'DAMAGECOUNT': '5.193', 'FRAGCOUNT': '17.000'} [2023-02-24 19:12:41,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13829.2). Total num frames: 91828224. Throughput: 0: 3453.9. Samples: 22954426. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:12:41,376][177119] Avg episode reward: [(0, '17.850')] [2023-02-24 19:12:41,540][177158] DAMAGECOUNT value on done: 301725.0 [2023-02-24 19:12:41,541][177158] Sum rewards: 21.650, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.286', 'AMMO2': '0.015', 'AMMO5': '0.027', 'AMMO4': '0.074', 'AMMO3': '0.126', 'WEAPON4': '0.250', 'weapon5': '0.264', 'weapon2': '0.420', 'weapon4': '0.478', 'WEAPON5': '0.600', 'WEAPON3': '0.850', 'HITCOUNT': '1.560', 'weapon3': '2.324', 'DAMAGECOUNT': '7.197', 'FRAGCOUNT': '20.000'} [2023-02-24 19:12:41,629][177153] Updated weights for policy 0, policy_version 22420 (0.0009) [2023-02-24 19:12:41,844][177158] DAMAGECOUNT value on done: 304295.0 [2023-02-24 19:12:41,845][177158] Sum rewards: 24.803, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.834', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'weapon4': '0.136', 'weapon5': '0.244', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'weapon2': '1.016', 'HITCOUNT': '1.270', 'weapon3': '1.834', 'DAMAGECOUNT': '6.141', 'FRAGCOUNT': '22.000'} [2023-02-24 19:12:42,184][177158] DAMAGECOUNT value on done: 313850.0 [2023-02-24 19:12:42,185][177158] Sum rewards: 5.502, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.642', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.050', 'weapon5': '0.058', 'AMMO4': '0.067', 'AMMO3': '0.127', 'weapon4': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.614', 'HITCOUNT': '0.860', 'WEAPON3': '0.900', 'weapon3': '1.916', 'DAMAGECOUNT': '2.949', 'FRAGCOUNT': '8.000'} [2023-02-24 19:12:42,487][177158] DAMAGECOUNT value on done: 314205.0 [2023-02-24 19:12:42,488][177158] Sum rewards: 5.120, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.332', 'AMMO5': '0.022', 'AMMO2': '0.049', 'weapon7': '0.062', 'AMMO3': '0.123', 'weapon5': '0.200', 'AMMO4': '0.245', 'WEAPON5': '0.500', 'AMMO6': '0.500', 'WEAPON7': '0.500', 'AMMO7': '0.500', 'weapon4': '0.524', 'WEAPON4': '0.600', 'WEAPON3': '0.800', 'HITCOUNT': '0.880', 'weapon2': '1.080', 'weapon3': '1.614', 'DAMAGECOUNT': '3.252', 'FRAGCOUNT': '8.000'} [2023-02-24 19:12:44,563][177153] Updated weights for policy 0, policy_version 22430 (0.0008) [2023-02-24 19:12:45,646][177172] DAMAGECOUNT value on done: 307240.0 [2023-02-24 19:12:45,646][177172] Sum rewards: 26.165, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.650', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.032', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'weapon5': '0.158', 'WEAPON5': '0.200', 'ARMOR': '0.458', 'weapon4': '0.500', 'WEAPON3': '0.800', 'weapon2': '0.828', 'HITCOUNT': '1.460', 'weapon3': '2.206', 'DAMAGECOUNT': '6.438', 'FRAGCOUNT': '21.000'} [2023-02-24 19:12:45,949][177172] DAMAGECOUNT value on done: 309449.0 [2023-02-24 19:12:45,950][177172] Sum rewards: 13.847, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.011', 'AMMO5': '0.012', 'AMMO4': '0.056', 'AMMO3': '0.138', 'HEALTH': '0.184', 'weapon5': '0.212', 'WEAPON5': '0.250', 'WEAPON3': '0.800', 'weapon2': '0.988', 'HITCOUNT': '1.000', 'weapon3': '2.316', 'DAMAGECOUNT': '3.879', 'FRAGCOUNT': '13.000'} [2023-02-24 19:12:46,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13858.2, 300 sec: 13829.2). Total num frames: 91897856. Throughput: 0: 3453.6. Samples: 22975170. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:12:46,376][177119] Avg episode reward: [(0, '18.008')] [2023-02-24 19:12:46,950][177154] DAMAGECOUNT value on done: 312244.0 [2023-02-24 19:12:46,950][177154] Sum rewards: 9.969, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.466', 'AMMO2': '0.022', 'AMMO5': '0.024', 'AMMO4': '0.109', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'weapon5': '0.170', 'weapon4': '0.388', 'WEAPON5': '0.400', 'weapon2': '0.616', 'WEAPON3': '0.950', 'HITCOUNT': '1.100', 'weapon3': '2.426', 'DAMAGECOUNT': '3.687', 'FRAGCOUNT': '11.000'} [2023-02-24 19:12:47,244][177154] DAMAGECOUNT value on done: 316517.0 [2023-02-24 19:12:47,245][177154] Sum rewards: 13.912, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.763', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'weapon7': '0.024', 'ARMOR': '0.025', 'AMMO2': '0.028', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.102', 'weapon5': '0.124', 'AMMO4': '0.139', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.920', 'weapon2': '0.998', 'weapon3': '1.794', 'DAMAGECOUNT': '3.693', 'FRAGCOUNT': '13.000'} [2023-02-24 19:12:47,413][177172] DAMAGECOUNT value on done: 322439.0 [2023-02-24 19:12:47,414][177172] Sum rewards: 18.099, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.828', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.012', 'WEAPON4': '0.050', 'weapon5': '0.074', 'AMMO3': '0.142', 'WEAPON5': '0.300', 'weapon4': '0.456', 'weapon2': '0.742', 'WEAPON3': '0.950', 'HITCOUNT': '1.310', 'weapon3': '2.302', 'DAMAGECOUNT': '5.595', 'FRAGCOUNT': '16.000'} [2023-02-24 19:12:47,532][177154] DAMAGECOUNT value on done: 321803.0 [2023-02-24 19:12:47,532][177154] Sum rewards: 11.331, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.096', 'AMMO5': '0.020', 'AMMO2': '0.034', 'AMMO3': '0.078', 'AMMO4': '0.171', 'WEAPON4': '0.250', 'weapon4': '0.264', 'weapon5': '0.300', 'WEAPON3': '0.500', 'WEAPON5': '0.600', 'HITCOUNT': '0.890', 'weapon3': '1.358', 'weapon2': '1.676', 'DAMAGECOUNT': '3.786', 'FRAGCOUNT': '10.000'} [2023-02-24 19:12:47,542][177153] Updated weights for policy 0, policy_version 22440 (0.0008) [2023-02-24 19:12:47,709][177172] DAMAGECOUNT value on done: 312498.0 [2023-02-24 19:12:47,710][177172] Sum rewards: 14.672, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.720', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.166', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.449', 'weapon4': '0.806', 'weapon2': '1.002', 'WEAPON3': '1.050', 'HITCOUNT': '1.120', 'weapon3': '1.552', 'DAMAGECOUNT': '5.127', 'FRAGCOUNT': '14.000'} [2023-02-24 19:12:47,823][177154] DAMAGECOUNT value on done: 321468.0 [2023-02-24 19:12:47,823][177154] Sum rewards: 20.012, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.752', 'AMMO5': '0.009', 'AMMO2': '0.021', 'WEAPON1': '0.050', 'AMMO4': '0.104', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'weapon5': '0.154', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'weapon4': '0.470', 'weapon2': '0.620', 'WEAPON3': '0.850', 'HITCOUNT': '1.510', 'weapon3': '2.016', 'DAMAGECOUNT': '5.541', 'FRAGCOUNT': '17.000'} [2023-02-24 19:12:48,046][177157] DAMAGECOUNT value on done: 318839.0 [2023-02-24 19:12:48,047][177157] Sum rewards: 7.706, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.115', 'AMMO5': '0.005', 'AMMO2': '0.023', 'AMMO3': '0.087', 'weapon5': '0.110', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon7': '0.220', 'weapon2': '0.612', 'WEAPON3': '0.650', 'HITCOUNT': '0.680', 'weapon4': '0.952', 'weapon3': '1.306', 'DAMAGECOUNT': '2.859', 'FRAGCOUNT': '8.000'} [2023-02-24 19:12:48,348][177157] DAMAGECOUNT value on done: 306971.0 [2023-02-24 19:12:48,349][177157] Sum rewards: 12.688, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.230', 'AMMO5': '0.014', 'AMMO2': '0.022', 'AMMO3': '0.105', 'AMMO4': '0.108', 'weapon5': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.516', 'WEAPON3': '0.700', 'weapon2': '0.900', 'HITCOUNT': '1.200', 'weapon3': '1.950', 'DAMAGECOUNT': '4.110', 'FRAGCOUNT': '11.000'} [2023-02-24 19:12:48,361][177157] DAMAGECOUNT value on done: 306703.0 [2023-02-24 19:12:48,362][177157] Sum rewards: 18.178, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.698', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.025', 'weapon5': '0.060', 'AMMO4': '0.125', 'AMMO3': '0.173', 'WEAPON4': '0.300', 'weapon4': '0.358', 'WEAPON5': '0.400', 'weapon2': '0.792', 'WEAPON3': '1.150', 'HITCOUNT': '1.460', 'weapon3': '2.482', 'DAMAGECOUNT': '5.523', 'FRAGCOUNT': '20.000'} [2023-02-24 19:12:48,445][177171] DAMAGECOUNT value on done: 307979.0 [2023-02-24 19:12:48,446][177171] Sum rewards: 8.870, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.460', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.061', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'weapon5': '0.246', 'WEAPON5': '0.250', 'weapon4': '0.366', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'weapon2': '0.960', 'weapon3': '1.938', 'DAMAGECOUNT': '2.340', 'FRAGCOUNT': '7.000'} [2023-02-24 19:12:48,456][177171] DAMAGECOUNT value on done: 308972.0 [2023-02-24 19:12:48,456][177171] Sum rewards: 26.350, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.553', 'weapon7': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO3': '0.101', 'AMMO4': '0.126', 'weapon5': '0.192', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'weapon4': '0.736', 'weapon2': '0.888', 'HITCOUNT': '1.500', 'weapon3': '1.914', 'DAMAGECOUNT': '5.754', 'FRAGCOUNT': '21.000'} [2023-02-24 19:12:48,662][177157] DAMAGECOUNT value on done: 307763.0 [2023-02-24 19:12:48,663][177157] Sum rewards: 21.639, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.946', 'AMMO2': '0.007', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.037', 'AMMO3': '0.127', 'weapon5': '0.176', 'WEAPON5': '0.200', 'weapon2': '0.288', 'WEAPON4': '0.350', 'weapon4': '0.922', 'WEAPON3': '0.950', 'HITCOUNT': '1.770', 'weapon3': '2.172', 'DAMAGECOUNT': '6.558', 'FRAGCOUNT': '19.000'} [2023-02-24 19:12:48,755][177171] DAMAGECOUNT value on done: 309258.0 [2023-02-24 19:12:48,756][177171] Sum rewards: 19.420, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.074', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO3': '0.055', 'weapon7': '0.084', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.175', 'weapon5': '0.226', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.890', 'weapon2': '0.962', 'weapon4': '1.112', 'weapon3': '1.212', 'DAMAGECOUNT': '4.230', 'FRAGCOUNT': '15.000'} [2023-02-24 19:12:48,766][177171] DAMAGECOUNT value on done: 313206.0 [2023-02-24 19:12:48,767][177171] Sum rewards: 21.288, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.158', 'AMMO5': '0.014', 'AMMO2': '0.019', 'weapon7': '0.076', 'AMMO4': '0.095', 'AMMO3': '0.097', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.492', 'ARMOR': '0.497', 'weapon4': '0.564', 'WEAPON3': '0.700', 'HITCOUNT': '1.400', 'weapon3': '1.856', 'DAMAGECOUNT': '6.411', 'FRAGCOUNT': '17.000'} [2023-02-24 19:12:50,498][177153] Updated weights for policy 0, policy_version 22450 (0.0008) [2023-02-24 19:12:50,639][177155] DAMAGECOUNT value on done: 317937.0 [2023-02-24 19:12:50,640][177155] Sum rewards: 9.193, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.315', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.070', 'AMMO3': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.126', 'AMMO4': '0.137', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.536', 'WEAPON3': '0.650', 'HITCOUNT': '0.840', 'weapon3': '1.104', 'weapon4': '1.458', 'DAMAGECOUNT': '3.102', 'FRAGCOUNT': '9.000'} [2023-02-24 19:12:50,943][177155] DAMAGECOUNT value on done: 323163.0 [2023-02-24 19:12:50,944][177155] Sum rewards: 24.280, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.285', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'AMMO3': '0.097', 'AMMO4': '0.168', 'weapon5': '0.258', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.506', 'WEAPON3': '0.600', 'weapon2': '0.634', 'HITCOUNT': '1.100', 'weapon3': '1.534', 'DAMAGECOUNT': '7.248', 'FRAGCOUNT': '20.000'} [2023-02-24 19:12:51,244][177155] DAMAGECOUNT value on done: 323392.0 [2023-02-24 19:12:51,244][177155] Sum rewards: 13.057, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.835', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon7': '0.064', 'AMMO3': '0.085', 'AMMO4': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.134', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.920', 'weapon2': '0.930', 'weapon4': '1.030', 'weapon3': '1.326', 'DAMAGECOUNT': '4.299', 'FRAGCOUNT': '12.000'} [2023-02-24 19:12:51,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 91963392. Throughput: 0: 3455.6. Samples: 22985540. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:12:51,376][177119] Avg episode reward: [(0, '17.385')] [2023-02-24 19:12:51,541][177155] DAMAGECOUNT value on done: 307290.0 [2023-02-24 19:12:51,541][177155] Sum rewards: 15.354, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.814', 'ARMOR': '0.004', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'AMMO3': '0.162', 'AMMO4': '0.179', 'WEAPON4': '0.300', 'weapon5': '0.310', 'WEAPON5': '0.400', 'weapon2': '0.442', 'weapon4': '0.556', 'WEAPON3': '1.050', 'HITCOUNT': '1.560', 'weapon3': '2.024', 'DAMAGECOUNT': '6.360', 'FRAGCOUNT': '15.000'} [2023-02-24 19:12:53,454][177153] Updated weights for policy 0, policy_version 22460 (0.0008) [2023-02-24 19:12:56,376][177119] Fps is (10 sec: 13516.6, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 92033024. Throughput: 0: 3459.8. Samples: 23006416. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:12:56,376][177119] Avg episode reward: [(0, '17.421')] [2023-02-24 19:12:56,410][177153] Updated weights for policy 0, policy_version 22470 (0.0008) [2023-02-24 19:12:56,410][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000022470_92037120.pth... [2023-02-24 19:12:56,467][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000021658_88711168.pth [2023-02-24 19:12:58,484][177170] DAMAGECOUNT value on done: 312981.0 [2023-02-24 19:12:58,485][177170] Sum rewards: 19.881, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'weapon5': '0.098', 'AMMO4': '0.105', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HEALTH': '0.450', 'ARMOR': '0.492', 'WEAPON3': '0.550', 'weapon4': '0.582', 'HITCOUNT': '0.980', 'weapon2': '1.188', 'weapon3': '1.838', 'DAMAGECOUNT': '4.380', 'FRAGCOUNT': '17.000'} [2023-02-24 19:12:58,785][177170] DAMAGECOUNT value on done: 314356.0 [2023-02-24 19:12:58,785][177170] Sum rewards: 12.933, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.716', 'AMMO5': '0.012', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.032', 'AMMO4': '0.097', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon7': '0.226', 'WEAPON5': '0.250', 'WEAPON3': '0.250', 'weapon2': '0.268', 'weapon5': '0.300', 'ARMOR': '0.477', 'HITCOUNT': '0.620', 'weapon3': '0.832', 'weapon4': '1.192', 'DAMAGECOUNT': '3.414', 'FRAGCOUNT': '8.000'} [2023-02-24 19:12:59,386][177153] Updated weights for policy 0, policy_version 22480 (0.0008) [2023-02-24 19:12:59,485][177170] DAMAGECOUNT value on done: 310535.0 [2023-02-24 19:12:59,486][177170] Sum rewards: 25.908, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.546', 'AMMO2': '0.005', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.025', 'AMMO3': '0.091', 'WEAPON4': '0.300', 'weapon5': '0.328', 'WEAPON5': '0.350', 'weapon4': '0.560', 'weapon2': '0.632', 'WEAPON3': '0.650', 'HITCOUNT': '1.580', 'weapon3': '2.050', 'DAMAGECOUNT': '5.847', 'FRAGCOUNT': '20.000'} [2023-02-24 19:12:59,789][177170] DAMAGECOUNT value on done: 313570.0 [2023-02-24 19:12:59,790][177170] Sum rewards: 26.172, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.457', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.100', 'AMMO3': '0.127', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.514', 'weapon2': '0.676', 'WEAPON3': '0.850', 'HITCOUNT': '1.940', 'weapon3': '2.044', 'DAMAGECOUNT': '7.752', 'FRAGCOUNT': '22.000'} [2023-02-24 19:13:00,047][177156] DAMAGECOUNT value on done: 312901.0 [2023-02-24 19:13:00,047][177156] Sum rewards: 16.053, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.647', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO5': '0.028', 'AMMO4': '0.118', 'AMMO3': '0.136', 'weapon5': '0.254', 'weapon4': '0.326', 'WEAPON4': '0.400', 'WEAPON5': '0.700', 'weapon2': '0.796', 'WEAPON3': '0.900', 'HITCOUNT': '1.460', 'weapon3': '2.144', 'DAMAGECOUNT': '5.895', 'FRAGCOUNT': '16.000'} [2023-02-24 19:13:00,068][177156] DAMAGECOUNT value on done: 306380.0 [2023-02-24 19:13:00,068][177156] Sum rewards: 13.867, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.410', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'weapon5': '0.034', 'AMMO4': '0.070', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'weapon7': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.454', 'WEAPON3': '0.700', 'HITCOUNT': '0.980', 'weapon4': '1.150', 'weapon3': '1.896', 'DAMAGECOUNT': '4.182', 'FRAGCOUNT': '13.000'} [2023-02-24 19:13:00,360][177156] DAMAGECOUNT value on done: 321856.0 [2023-02-24 19:13:00,361][177156] Sum rewards: 14.346, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.154', 'AMMO2': '0.004', 'AMMO5': '0.012', 'AMMO4': '0.017', 'WEAPON1': '0.040', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'weapon5': '0.164', 'WEAPON5': '0.300', 'weapon4': '0.466', 'WEAPON3': '0.550', 'HITCOUNT': '0.970', 'weapon2': '1.180', 'weapon3': '1.884', 'DAMAGECOUNT': '4.725', 'FRAGCOUNT': '10.000'} [2023-02-24 19:13:00,380][177156] DAMAGECOUNT value on done: 307524.0 [2023-02-24 19:13:00,381][177156] Sum rewards: 14.994, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.038', 'AMMO3': '0.103', 'weapon5': '0.208', 'WEAPON5': '0.350', 'HEALTH': '0.380', 'WEAPON3': '0.650', 'HITCOUNT': '0.880', 'weapon2': '1.284', 'weapon3': '2.264', 'DAMAGECOUNT': '3.552', 'FRAGCOUNT': '12.000'} [2023-02-24 19:13:00,943][177158] DAMAGECOUNT value on done: 303291.0 [2023-02-24 19:13:00,943][177158] Sum rewards: 12.876, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.666', 'WEAPON1': '0.010', 'AMMO5': '0.024', 'AMMO2': '0.054', 'AMMO3': '0.089', 'AMMO4': '0.270', 'weapon5': '0.302', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'weapon4': '0.550', 'WEAPON3': '0.600', 'weapon2': '1.006', 'HITCOUNT': '1.090', 'weapon3': '1.648', 'DAMAGECOUNT': '4.698', 'FRAGCOUNT': '12.000'} [2023-02-24 19:13:01,053][177155] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 19:13:01,244][177158] DAMAGECOUNT value on done: 305906.0 [2023-02-24 19:13:01,245][177158] Sum rewards: 16.914, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.320', 'AMMO2': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.026', 'AMMO3': '0.086', 'WEAPON4': '0.200', 'weapon5': '0.202', 'WEAPON5': '0.250', 'ARMOR': '0.454', 'WEAPON3': '0.550', 'weapon2': '0.736', 'weapon4': '0.950', 'HITCOUNT': '1.180', 'weapon3': '1.734', 'DAMAGECOUNT': '4.833', 'FRAGCOUNT': '12.000'} [2023-02-24 19:13:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 92102656. Throughput: 0: 3459.5. Samples: 23027156. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:13:01,376][177119] Avg episode reward: [(0, '17.400')] [2023-02-24 19:13:01,543][177158] DAMAGECOUNT value on done: 316112.0 [2023-02-24 19:13:01,544][177158] Sum rewards: 25.668, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.516', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.023', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'weapon5': '0.148', 'weapon4': '0.226', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'weapon2': '0.820', 'HITCOUNT': '1.440', 'weapon3': '2.350', 'DAMAGECOUNT': '6.786', 'FRAGCOUNT': '22.000'} [2023-02-24 19:13:01,859][177158] DAMAGECOUNT value on done: 316340.0 [2023-02-24 19:13:01,859][177158] Sum rewards: 24.272, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.260', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.141', 'weapon5': '0.154', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.276', 'WEAPON3': '0.800', 'weapon2': '0.854', 'HITCOUNT': '1.520', 'weapon3': '2.002', 'DAMAGECOUNT': '6.405', 'FRAGCOUNT': '20.000'} [2023-02-24 19:13:02,329][177153] Updated weights for policy 0, policy_version 22490 (0.0008) [2023-02-24 19:13:03,525][177157] Large shaping reward 2.505 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.483, 161.0), ('weapon2', 0.002)] [2023-02-24 19:13:05,090][177172] DAMAGECOUNT value on done: 309413.0 [2023-02-24 19:13:05,091][177172] Sum rewards: 16.712, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.012', 'AMMO5': '0.025', 'AMMO2': '0.036', 'weapon7': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.141', 'weapon5': '0.152', 'AMMO4': '0.179', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.652', 'WEAPON3': '0.800', 'weapon4': '0.854', 'HITCOUNT': '1.480', 'weapon3': '1.912', 'DAMAGECOUNT': '6.519', 'FRAGCOUNT': '16.000'} [2023-02-24 19:13:05,302][177153] Updated weights for policy 0, policy_version 22500 (0.0009) [2023-02-24 19:13:05,390][177172] DAMAGECOUNT value on done: 311472.0 [2023-02-24 19:13:05,391][177172] Sum rewards: 23.652, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.324', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO3': '0.079', 'AMMO4': '0.164', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon5': '0.352', 'WEAPON3': '0.550', 'weapon4': '0.612', 'HITCOUNT': '1.150', 'weapon2': '1.150', 'weapon3': '1.490', 'DAMAGECOUNT': '6.069', 'FRAGCOUNT': '20.000'} [2023-02-24 19:13:06,305][177154] DAMAGECOUNT value on done: 313859.0 [2023-02-24 19:13:06,305][177154] Sum rewards: 15.573, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.168', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.015', 'AMMO3': '0.135', 'weapon5': '0.164', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'weapon2': '1.086', 'HITCOUNT': '1.100', 'weapon3': '2.196', 'DAMAGECOUNT': '4.845', 'FRAGCOUNT': '15.000'} [2023-02-24 19:13:06,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 92172288. Throughput: 0: 3459.2. Samples: 23037472. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:13:06,376][177119] Avg episode reward: [(0, '17.503')] [2023-02-24 19:13:06,604][177154] DAMAGECOUNT value on done: 318468.0 [2023-02-24 19:13:06,605][177154] Sum rewards: 15.486, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.011', 'AMMO2': '0.019', 'AMMO5': '0.026', 'WEAPON1': '0.040', 'AMMO4': '0.096', 'AMMO3': '0.109', 'weapon5': '0.270', 'WEAPON4': '0.300', 'weapon4': '0.356', 'WEAPON5': '0.600', 'weapon2': '0.620', 'WEAPON3': '0.750', 'HITCOUNT': '1.000', 'weapon3': '2.208', 'DAMAGECOUNT': '5.853', 'FRAGCOUNT': '14.000'} [2023-02-24 19:13:06,851][177172] DAMAGECOUNT value on done: 323959.0 [2023-02-24 19:13:06,851][177172] Sum rewards: 20.165, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.580', 'AMMO4': '-0.053', 'AMMO2': '-0.010', 'AMMO5': '0.010', 'WEAPON1': '0.070', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'weapon5': '0.230', 'weapon4': '0.302', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'HITCOUNT': '1.080', 'weapon2': '1.096', 'weapon3': '1.782', 'DAMAGECOUNT': '4.560', 'FRAGCOUNT': '16.000'} [2023-02-24 19:13:06,903][177154] DAMAGECOUNT value on done: 324756.0 [2023-02-24 19:13:06,903][177154] Sum rewards: 25.627, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.516', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO5': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.184', 'weapon5': '0.326', 'WEAPON4': '0.400', 'ARMOR': '0.452', 'weapon4': '0.524', 'WEAPON5': '0.550', 'weapon2': '0.696', 'WEAPON3': '1.250', 'HITCOUNT': '1.740', 'weapon3': '2.018', 'DAMAGECOUNT': '8.859', 'FRAGCOUNT': '24.000'} [2023-02-24 19:13:07,152][177172] DAMAGECOUNT value on done: 314610.0 [2023-02-24 19:13:07,152][177172] Sum rewards: 23.192, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.441', 'AMMO4': '-0.018', 'AMMO2': '-0.003', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.108', 'weapon5': '0.272', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'weapon2': '0.986', 'HITCOUNT': '1.560', 'weapon3': '2.260', 'DAMAGECOUNT': '6.336', 'FRAGCOUNT': '18.500'} [2023-02-24 19:13:07,203][177154] DAMAGECOUNT value on done: 321922.0 [2023-02-24 19:13:07,204][177154] Sum rewards: 6.194, reward structure: {'DEATHCOUNT': '-4.500', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.020', 'AMMO3': '0.030', 'HEALTH': '0.082', 'AMMO4': '0.099', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.174', 'weapon5': '0.196', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.552', 'weapon3': '0.718', 'weapon4': '1.070', 'DAMAGECOUNT': '1.362', 'FRAGCOUNT': '5.000'} [2023-02-24 19:13:07,518][177157] DAMAGECOUNT value on done: 319982.0 [2023-02-24 19:13:07,519][177157] Sum rewards: 11.837, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.410', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.084', 'weapon5': '0.114', 'AMMO4': '0.142', 'weapon7': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'AMMO6': '0.420', 'AMMO7': '0.420', 'WEAPON7': '0.500', 'WEAPON3': '0.500', 'weapon2': '0.756', 'weapon3': '0.808', 'HITCOUNT': '0.890', 'weapon4': '1.482', 'DAMAGECOUNT': '3.429', 'FRAGCOUNT': '9.000'} [2023-02-24 19:13:07,812][177157] DAMAGECOUNT value on done: 308559.0 [2023-02-24 19:13:07,812][177157] Sum rewards: 19.580, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.250', 'AMMO5': '0.015', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.139', 'weapon5': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.484', 'weapon4': '0.738', 'WEAPON3': '0.850', 'HITCOUNT': '1.510', 'weapon3': '1.996', 'DAMAGECOUNT': '5.568', 'FRAGCOUNT': '19.000'} [2023-02-24 19:13:07,822][177157] DAMAGECOUNT value on done: 308867.0 [2023-02-24 19:13:07,822][177157] Sum rewards: 22.694, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.014', 'AMMO5': '0.015', 'HEALTH': '0.023', 'WEAPON4': '0.050', 'weapon4': '0.060', 'AMMO4': '0.072', 'AMMO3': '0.124', 'weapon5': '0.216', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'weapon2': '0.874', 'HITCOUNT': '1.220', 'weapon3': '2.538', 'DAMAGECOUNT': '5.688', 'FRAGCOUNT': '19.000'} [2023-02-24 19:13:07,872][177171] DAMAGECOUNT value on done: 309538.0 [2023-02-24 19:13:07,873][177171] Sum rewards: 15.280, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.006', 'AMMO5': '0.017', 'AMMO2': '0.021', 'weapon7': '0.066', 'AMMO4': '0.103', 'AMMO3': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.592', 'WEAPON3': '0.650', 'HITCOUNT': '1.110', 'weapon4': '1.216', 'weapon3': '1.420', 'DAMAGECOUNT': '4.677', 'FRAGCOUNT': '12.500'} [2023-02-24 19:13:07,884][177171] DAMAGECOUNT value on done: 310422.0 [2023-02-24 19:13:07,885][177171] Sum rewards: 11.968, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.500', 'ARMOR': '0.008', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon7': '0.098', 'AMMO4': '0.141', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'weapon5': '0.196', 'weapon4': '0.292', 'AMMO6': '0.380', 'AMMO7': '0.380', 'WEAPON5': '0.400', 'WEAPON7': '0.500', 'weapon2': '0.898', 'HITCOUNT': '1.000', 'WEAPON3': '1.050', 'weapon3': '2.156', 'DAMAGECOUNT': '4.350', 'FRAGCOUNT': '12.000'} [2023-02-24 19:13:08,125][177157] DAMAGECOUNT value on done: 309815.0 [2023-02-24 19:13:08,126][177157] Sum rewards: 14.678, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.670', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO3': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon7': '0.118', 'AMMO4': '0.184', 'weapon5': '0.242', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'weapon4': '0.696', 'weapon2': '0.898', 'HITCOUNT': '0.990', 'weapon3': '1.334', 'DAMAGECOUNT': '4.356', 'FRAGCOUNT': '11.000'} [2023-02-24 19:13:08,186][177171] DAMAGECOUNT value on done: 311199.0 [2023-02-24 19:13:08,187][177171] Sum rewards: 16.364, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.540', 'AMMO5': '0.028', 'AMMO2': '0.033', 'AMMO4': '0.165', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'weapon5': '0.346', 'weapon4': '0.350', 'weapon2': '0.532', 'WEAPON5': '0.750', 'WEAPON3': '1.200', 'HITCOUNT': '1.350', 'weapon3': '2.392', 'DAMAGECOUNT': '5.823', 'FRAGCOUNT': '16.000'} [2023-02-24 19:13:08,198][177171] DAMAGECOUNT value on done: 314939.0 [2023-02-24 19:13:08,198][177171] Sum rewards: 14.565, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.491', 'AMMO2': '0.008', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.041', 'AMMO3': '0.105', 'WEAPON4': '0.250', 'weapon4': '0.438', 'WEAPON5': '0.450', 'weapon2': '0.494', 'weapon5': '0.502', 'WEAPON3': '0.850', 'HITCOUNT': '1.220', 'weapon3': '1.944', 'DAMAGECOUNT': '5.199', 'FRAGCOUNT': '13.000'} [2023-02-24 19:13:08,274][177153] Updated weights for policy 0, policy_version 22510 (0.0008) [2023-02-24 19:13:10,122][177155] DAMAGECOUNT value on done: 319341.0 [2023-02-24 19:13:10,122][177155] Sum rewards: 13.846, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.725', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO3': '0.078', 'weapon7': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.180', 'weapon5': '0.184', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.976', 'weapon2': '0.984', 'HITCOUNT': '1.050', 'weapon3': '1.256', 'DAMAGECOUNT': '4.212', 'FRAGCOUNT': '14.500'} [2023-02-24 19:13:10,421][177155] DAMAGECOUNT value on done: 324890.0 [2023-02-24 19:13:10,421][177155] Sum rewards: 13.194, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.195', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.040', 'AMMO3': '0.073', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.202', 'weapon7': '0.206', 'weapon5': '0.222', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.408', 'WEAPON3': '0.550', 'HITCOUNT': '1.030', 'weapon4': '1.126', 'weapon3': '1.450', 'DAMAGECOUNT': '5.052', 'FRAGCOUNT': '10.500'} [2023-02-24 19:13:10,630][177171] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 19:13:10,716][177155] DAMAGECOUNT value on done: 325658.0 [2023-02-24 19:13:10,717][177155] Sum rewards: 24.651, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.938', 'AMMO2': '0.024', 'AMMO5': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.071', 'weapon7': '0.084', 'AMMO4': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.416', 'ARMOR': '0.445', 'WEAPON3': '0.500', 'WEAPON4': '0.550', 'weapon2': '0.610', 'WEAPON5': '0.750', 'weapon4': '1.078', 'weapon3': '1.138', 'HITCOUNT': '1.760', 'DAMAGECOUNT': '6.798', 'FRAGCOUNT': '20.000'} [2023-02-24 19:13:11,015][177155] DAMAGECOUNT value on done: 308725.0 [2023-02-24 19:13:11,015][177155] Sum rewards: 12.628, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.007', 'HEALTH': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.033', 'AMMO3': '0.133', 'weapon5': '0.178', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'weapon2': '1.146', 'HITCOUNT': '1.180', 'weapon3': '2.160', 'DAMAGECOUNT': '4.305', 'FRAGCOUNT': '10.500'} [2023-02-24 19:13:11,254][177153] Updated weights for policy 0, policy_version 22520 (0.0008) [2023-02-24 19:13:11,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 92241920. Throughput: 0: 3459.4. Samples: 23058084. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:13:11,376][177119] Avg episode reward: [(0, '17.248')] [2023-02-24 19:13:14,233][177153] Updated weights for policy 0, policy_version 22530 (0.0008) [2023-02-24 19:13:14,689][177157] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 19:13:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 92311552. Throughput: 0: 3459.6. Samples: 23078846. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:13:16,376][177119] Avg episode reward: [(0, '17.248')] [2023-02-24 19:13:17,180][177153] Updated weights for policy 0, policy_version 22540 (0.0009) [2023-02-24 19:13:17,903][177170] DAMAGECOUNT value on done: 314176.0 [2023-02-24 19:13:17,903][177170] Sum rewards: 13.211, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.850', 'AMMO2': '0.009', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'AMMO4': '0.042', 'weapon7': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.152', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.628', 'WEAPON3': '0.650', 'HITCOUNT': '0.960', 'weapon2': '0.962', 'weapon3': '1.676', 'DAMAGECOUNT': '3.585', 'FRAGCOUNT': '11.000'} [2023-02-24 19:13:18,213][177170] DAMAGECOUNT value on done: 316903.0 [2023-02-24 19:13:18,213][177170] Sum rewards: 22.632, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.948', 'AMMO5': '0.021', 'AMMO2': '0.033', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO4': '0.162', 'AMMO3': '0.191', 'weapon5': '0.264', 'weapon2': '0.436', 'weapon4': '0.438', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '1.690', 'weapon3': '2.464', 'DAMAGECOUNT': '7.641', 'FRAGCOUNT': '19.000'} [2023-02-24 19:13:18,940][177170] DAMAGECOUNT value on done: 312177.0 [2023-02-24 19:13:18,941][177170] Sum rewards: 18.365, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.069', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'weapon5': '0.246', 'WEAPON5': '0.250', 'HEALTH': '0.302', 'WEAPON3': '0.400', 'weapon4': '0.470', 'HITCOUNT': '1.190', 'weapon3': '1.274', 'weapon2': '1.328', 'DAMAGECOUNT': '4.926', 'FRAGCOUNT': '13.500'} [2023-02-24 19:13:19,240][177170] DAMAGECOUNT value on done: 315594.0 [2023-02-24 19:13:19,241][177170] Sum rewards: 16.749, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.415', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO3': '0.109', 'AMMO4': '0.163', 'weapon5': '0.326', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.648', 'weapon4': '0.684', 'WEAPON3': '0.700', 'HITCOUNT': '1.450', 'weapon3': '1.866', 'DAMAGECOUNT': '6.072', 'FRAGCOUNT': '15.000'} [2023-02-24 19:13:19,592][177156] DAMAGECOUNT value on done: 315240.0 [2023-02-24 19:13:19,593][177156] Sum rewards: 20.669, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.648', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'weapon5': '0.202', 'weapon4': '0.230', 'WEAPON5': '0.350', 'weapon2': '0.954', 'WEAPON3': '1.100', 'HITCOUNT': '1.760', 'weapon3': '2.276', 'DAMAGECOUNT': '7.017', 'FRAGCOUNT': '18.000'} [2023-02-24 19:13:19,614][177156] DAMAGECOUNT value on done: 308213.0 [2023-02-24 19:13:19,614][177156] Sum rewards: 20.604, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.650', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.056', 'weapon7': '0.058', 'AMMO4': '0.073', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.154', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '0.350', 'weapon2': '0.540', 'weapon3': '0.984', 'HITCOUNT': '1.070', 'weapon4': '1.388', 'DAMAGECOUNT': '5.499', 'FRAGCOUNT': '16.000'} [2023-02-24 19:13:19,902][177156] DAMAGECOUNT value on done: 323380.0 [2023-02-24 19:13:19,902][177156] Sum rewards: 13.174, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.897', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO4': '0.027', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.148', 'weapon5': '0.320', 'WEAPON5': '0.650', 'weapon2': '0.762', 'WEAPON3': '1.000', 'HITCOUNT': '1.070', 'weapon3': '2.294', 'DAMAGECOUNT': '4.572', 'FRAGCOUNT': '13.500'} [2023-02-24 19:13:19,925][177156] DAMAGECOUNT value on done: 308835.0 [2023-02-24 19:13:19,925][177156] Sum rewards: 15.868, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.396', 'ARMOR': '0.004', 'AMMO2': '0.016', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.080', 'AMMO3': '0.109', 'weapon5': '0.190', 'weapon4': '0.218', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '1.040', 'weapon2': '1.228', 'weapon3': '2.038', 'DAMAGECOUNT': '3.933', 'FRAGCOUNT': '13.000'} [2023-02-24 19:13:20,183][177153] Updated weights for policy 0, policy_version 22550 (0.0008) [2023-02-24 19:13:20,495][177158] DAMAGECOUNT value on done: 304198.0 [2023-02-24 19:13:20,495][177158] Sum rewards: 11.850, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.447', 'AMMO5': '0.008', 'AMMO2': '0.013', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.078', 'weapon5': '0.228', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'HITCOUNT': '0.550', 'weapon2': '0.608', 'weapon4': '0.720', 'weapon3': '1.728', 'DAMAGECOUNT': '2.721', 'FRAGCOUNT': '10.000'} [2023-02-24 19:13:20,802][177158] DAMAGECOUNT value on done: 308447.0 [2023-02-24 19:13:20,803][177158] Sum rewards: 26.503, reward structure: {'DEATHCOUNT': '-8.250', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.044', 'AMMO3': '0.080', 'AMMO4': '0.221', 'weapon5': '0.222', 'HEALTH': '0.299', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'weapon4': '0.580', 'weapon2': '0.864', 'weapon3': '1.504', 'HITCOUNT': '1.690', 'DAMAGECOUNT': '7.623', 'FRAGCOUNT': '20.500'} [2023-02-24 19:13:21,102][177158] DAMAGECOUNT value on done: 318356.0 [2023-02-24 19:13:21,102][177158] Sum rewards: 20.833, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.782', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon5': '0.096', 'AMMO3': '0.105', 'AMMO4': '0.161', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.486', 'weapon4': '0.614', 'WEAPON3': '0.800', 'HITCOUNT': '1.590', 'weapon3': '2.384', 'DAMAGECOUNT': '6.732', 'FRAGCOUNT': '17.000'} [2023-02-24 19:13:21,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13858.2, 300 sec: 13843.1). Total num frames: 92381184. Throughput: 0: 3457.0. Samples: 23089150. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:13:21,376][177119] Avg episode reward: [(0, '17.541')] [2023-02-24 19:13:21,394][177158] DAMAGECOUNT value on done: 318049.0 [2023-02-24 19:13:21,395][177158] Sum rewards: 22.087, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.635', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.024', 'weapon7': '0.048', 'AMMO3': '0.071', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.121', 'WEAPON7': '0.200', 'weapon5': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'weapon4': '0.454', 'WEAPON3': '0.600', 'weapon2': '1.040', 'HITCOUNT': '1.250', 'weapon3': '1.870', 'DAMAGECOUNT': '4.857', 'FRAGCOUNT': '18.000'} [2023-02-24 19:13:23,151][177153] Updated weights for policy 0, policy_version 22560 (0.0008) [2023-02-24 19:13:24,558][177172] DAMAGECOUNT value on done: 311156.0 [2023-02-24 19:13:24,559][177172] Sum rewards: 17.780, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.360', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.049', 'AMMO3': '0.105', 'AMMO4': '0.247', 'weapon5': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.550', 'weapon4': '0.600', 'WEAPON3': '0.650', 'weapon2': '0.910', 'HITCOUNT': '1.040', 'weapon3': '1.798', 'DAMAGECOUNT': '5.229', 'FRAGCOUNT': '17.000'} [2023-02-24 19:13:24,857][177172] DAMAGECOUNT value on done: 313099.0 [2023-02-24 19:13:24,857][177172] Sum rewards: 14.613, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.390', 'AMMO2': '0.011', 'AMMO5': '0.026', 'WEAPON1': '0.030', 'AMMO4': '0.054', 'AMMO3': '0.128', 'WEAPON4': '0.250', 'weapon5': '0.254', 'weapon4': '0.444', 'weapon2': '0.570', 'WEAPON5': '0.600', 'WEAPON3': '0.850', 'HITCOUNT': '1.290', 'weapon3': '2.366', 'DAMAGECOUNT': '4.881', 'FRAGCOUNT': '14.000'} [2023-02-24 19:13:25,814][177154] DAMAGECOUNT value on done: 315821.0 [2023-02-24 19:13:25,814][177154] Sum rewards: 18.285, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.465', 'AMMO2': '0.002', 'AMMO4': '0.012', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'WEAPON4': '0.050', 'AMMO3': '0.112', 'weapon4': '0.134', 'weapon5': '0.310', 'WEAPON5': '0.650', 'WEAPON3': '0.900', 'weapon2': '1.160', 'HITCOUNT': '1.230', 'weapon3': '2.010', 'DAMAGECOUNT': '5.886', 'FRAGCOUNT': '15.000'} [2023-02-24 19:13:26,099][177153] Updated weights for policy 0, policy_version 22570 (0.0008) [2023-02-24 19:13:26,114][177154] DAMAGECOUNT value on done: 320466.0 [2023-02-24 19:13:26,114][177154] Sum rewards: 20.140, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.068', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.133', 'weapon5': '0.292', 'WEAPON4': '0.450', 'WEAPON5': '0.600', 'weapon4': '0.638', 'weapon2': '0.716', 'WEAPON3': '0.850', 'HITCOUNT': '1.360', 'weapon3': '1.748', 'DAMAGECOUNT': '5.994', 'FRAGCOUNT': '19.000'} [2023-02-24 19:13:26,302][177172] DAMAGECOUNT value on done: 325939.0 [2023-02-24 19:13:26,303][177172] Sum rewards: 17.789, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.456', 'AMMO5': '0.016', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'weapon5': '0.244', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.468', 'weapon2': '0.964', 'WEAPON3': '1.000', 'HITCOUNT': '1.380', 'weapon3': '1.680', 'DAMAGECOUNT': '5.940', 'FRAGCOUNT': '16.000'} [2023-02-24 19:13:26,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13789.8, 300 sec: 13829.2). Total num frames: 92446720. Throughput: 0: 3454.7. Samples: 23109886. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:13:26,376][177119] Avg episode reward: [(0, '17.530')] [2023-02-24 19:13:26,417][177154] DAMAGECOUNT value on done: 325677.0 [2023-02-24 19:13:26,417][177154] Sum rewards: 8.322, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.980', 'AMMO2': '0.014', 'AMMO5': '0.022', 'WEAPON1': '0.030', 'AMMO4': '0.068', 'AMMO3': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.102', 'WEAPON4': '0.150', 'weapon5': '0.192', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon2': '0.570', 'HITCOUNT': '0.610', 'weapon4': '0.866', 'weapon3': '1.274', 'DAMAGECOUNT': '2.763', 'FRAGCOUNT': '8.000'} [2023-02-24 19:13:26,623][177172] DAMAGECOUNT value on done: 316307.0 [2023-02-24 19:13:26,623][177172] Sum rewards: 14.869, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.984', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO4': '0.046', 'weapon7': '0.066', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.153', 'WEAPON7': '0.200', 'weapon5': '0.302', 'weapon4': '0.366', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'weapon2': '0.998', 'HITCOUNT': '1.280', 'weapon3': '1.856', 'DAMAGECOUNT': '5.091', 'FRAGCOUNT': '13.500'} [2023-02-24 19:13:26,720][177154] DAMAGECOUNT value on done: 323605.0 [2023-02-24 19:13:26,721][177154] Sum rewards: 15.773, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.462', 'AMMO5': '0.025', 'AMMO2': '0.027', 'AMMO3': '0.060', 'AMMO4': '0.134', 'weapon5': '0.294', 'WEAPON4': '0.400', 'WEAPON3': '0.400', 'WEAPON5': '0.600', 'weapon4': '0.920', 'weapon2': '0.984', 'weapon3': '1.002', 'HITCOUNT': '1.340', 'DAMAGECOUNT': '5.049', 'FRAGCOUNT': '14.000'} [2023-02-24 19:13:27,007][177157] DAMAGECOUNT value on done: 321745.0 [2023-02-24 19:13:27,007][177157] Sum rewards: 18.158, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.460', 'AMMO5': '0.015', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'AMMO3': '0.104', 'AMMO4': '0.111', 'weapon5': '0.178', 'WEAPON4': '0.250', 'weapon4': '0.344', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'weapon2': '1.162', 'HITCOUNT': '1.370', 'weapon3': '1.942', 'DAMAGECOUNT': '5.289', 'FRAGCOUNT': '16.000'} [2023-02-24 19:13:27,319][177157] DAMAGECOUNT value on done: 311013.0 [2023-02-24 19:13:27,319][177157] Sum rewards: 18.254, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.297', 'AMMO2': '0.010', 'AMMO5': '0.024', 'weapon4': '0.048', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'weapon5': '0.168', 'AMMO3': '0.187', 'WEAPON5': '0.500', 'weapon2': '0.856', 'WEAPON3': '1.100', 'HITCOUNT': '1.760', 'weapon3': '2.562', 'DAMAGECOUNT': '6.438', 'FRAGCOUNT': '17.000'} [2023-02-24 19:13:27,333][177171] DAMAGECOUNT value on done: 310873.0 [2023-02-24 19:13:27,333][177171] Sum rewards: 16.186, reward structure: {'DEATHCOUNT': '-6.000', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'weapon7': '0.060', 'AMMO3': '0.065', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.128', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HEALTH': '0.225', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'weapon4': '0.788', 'HITCOUNT': '0.820', 'weapon2': '1.122', 'weapon3': '1.478', 'DAMAGECOUNT': '4.005', 'FRAGCOUNT': '12.000'} [2023-02-24 19:13:27,333][177157] DAMAGECOUNT value on done: 310531.0 [2023-02-24 19:13:27,334][177157] Sum rewards: 22.803, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.310', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO3': '0.067', 'AMMO4': '0.187', 'weapon5': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon4': '0.804', 'weapon2': '1.014', 'HITCOUNT': '1.180', 'weapon3': '1.362', 'DAMAGECOUNT': '5.868', 'FRAGCOUNT': '18.000'} [2023-02-24 19:13:27,344][177171] DAMAGECOUNT value on done: 312363.0 [2023-02-24 19:13:27,345][177171] Sum rewards: 11.891, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.320', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.038', 'AMMO3': '0.161', 'AMMO4': '0.191', 'WEAPON4': '0.250', 'weapon5': '0.258', 'weapon4': '0.464', 'WEAPON5': '0.550', 'weapon2': '0.554', 'WEAPON3': '1.000', 'HITCOUNT': '1.400', 'weapon3': '2.230', 'DAMAGECOUNT': '5.823', 'FRAGCOUNT': '13.000'} [2023-02-24 19:13:27,637][177157] DAMAGECOUNT value on done: 312693.0 [2023-02-24 19:13:27,637][177157] Sum rewards: 25.531, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.172', 'AMMO5': '0.014', 'AMMO2': '0.032', 'AMMO3': '0.131', 'AMMO4': '0.161', 'weapon5': '0.162', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon2': '0.798', 'WEAPON3': '0.800', 'weapon4': '1.110', 'weapon3': '1.710', 'HITCOUNT': '1.900', 'DAMAGECOUNT': '8.634', 'FRAGCOUNT': '23.000'} [2023-02-24 19:13:27,643][177171] DAMAGECOUNT value on done: 313128.0 [2023-02-24 19:13:27,644][177171] Sum rewards: 14.013, reward structure: {'DEATHCOUNT': '-9.750', 'WEAPON1': '0.030', 'AMMO5': '0.030', 'AMMO2': '0.032', 'weapon5': '0.072', 'AMMO3': '0.124', 'AMMO4': '0.160', 'WEAPON4': '0.200', 'weapon2': '0.344', 'ARMOR': '0.400', 'HEALTH': '0.534', 'WEAPON5': '0.600', 'WEAPON3': '0.650', 'weapon4': '1.086', 'HITCOUNT': '1.300', 'weapon3': '1.414', 'DAMAGECOUNT': '5.787', 'FRAGCOUNT': '11.000'} [2023-02-24 19:13:27,655][177171] DAMAGECOUNT value on done: 317376.0 [2023-02-24 19:13:27,655][177171] Sum rewards: 22.024, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.184', 'AMMO5': '0.024', 'AMMO2': '0.032', 'AMMO3': '0.152', 'AMMO4': '0.161', 'weapon5': '0.324', 'WEAPON4': '0.350', 'weapon2': '0.358', 'weapon4': '0.458', 'WEAPON5': '0.600', 'WEAPON3': '0.850', 'HITCOUNT': '1.720', 'weapon3': '2.118', 'DAMAGECOUNT': '7.311', 'FRAGCOUNT': '18.500'} [2023-02-24 19:13:29,078][177153] Updated weights for policy 0, policy_version 22580 (0.0009) [2023-02-24 19:13:29,671][177155] DAMAGECOUNT value on done: 321310.0 [2023-02-24 19:13:29,671][177155] Sum rewards: 19.526, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.468', 'AMMO2': '0.007', 'AMMO5': '0.012', 'AMMO4': '0.033', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'weapon4': '0.154', 'weapon5': '0.190', 'WEAPON5': '0.300', 'weapon2': '0.856', 'WEAPON3': '0.900', 'HITCOUNT': '1.560', 'weapon3': '2.542', 'DAMAGECOUNT': '5.907', 'FRAGCOUNT': '18.000'} [2023-02-24 19:13:29,965][177155] DAMAGECOUNT value on done: 327080.0 [2023-02-24 19:13:29,966][177155] Sum rewards: 23.091, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.816', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.036', 'AMMO3': '0.107', 'AMMO4': '0.178', 'weapon5': '0.222', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.464', 'WEAPON3': '0.800', 'weapon2': '1.038', 'HITCOUNT': '1.530', 'weapon3': '1.834', 'DAMAGECOUNT': '6.570', 'FRAGCOUNT': '21.000'} [2023-02-24 19:13:30,269][177155] DAMAGECOUNT value on done: 327390.0 [2023-02-24 19:13:30,269][177155] Sum rewards: 9.553, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.449', 'WEAPON1': '0.010', 'AMMO5': '0.029', 'AMMO2': '0.047', 'AMMO3': '0.100', 'AMMO4': '0.235', 'weapon5': '0.272', 'weapon2': '0.406', 'WEAPON5': '0.650', 'WEAPON3': '0.750', 'WEAPON4': '0.800', 'HITCOUNT': '1.260', 'weapon4': '1.270', 'weapon3': '1.476', 'DAMAGECOUNT': '5.196', 'FRAGCOUNT': '11.000'} [2023-02-24 19:13:30,573][177155] DAMAGECOUNT value on done: 309931.0 [2023-02-24 19:13:30,574][177155] Sum rewards: 11.227, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.848', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.020', 'AMMO4': '0.102', 'AMMO3': '0.115', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon7': '0.170', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.232', 'WEAPON5': '0.450', 'weapon4': '0.468', 'HITCOUNT': '0.680', 'WEAPON3': '0.700', 'weapon2': '0.720', 'weapon3': '1.818', 'DAMAGECOUNT': '3.600', 'FRAGCOUNT': '10.500'} [2023-02-24 19:13:31,376][177119] Fps is (10 sec: 13516.6, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 92516352. Throughput: 0: 3453.7. Samples: 23130586. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:13:31,376][177119] Avg episode reward: [(0, '17.422')] [2023-02-24 19:13:32,043][177153] Updated weights for policy 0, policy_version 22590 (0.0008) [2023-02-24 19:13:35,023][177153] Updated weights for policy 0, policy_version 22600 (0.0009) [2023-02-24 19:13:36,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 92585984. Throughput: 0: 3454.3. Samples: 23140982. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:13:36,376][177119] Avg episode reward: [(0, '17.422')] [2023-02-24 19:13:37,343][177170] DAMAGECOUNT value on done: 316294.0 [2023-02-24 19:13:37,344][177170] Sum rewards: 25.111, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.682', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.091', 'weapon5': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.468', 'WEAPON3': '0.550', 'weapon2': '1.416', 'HITCOUNT': '1.420', 'weapon3': '1.560', 'DAMAGECOUNT': '6.354', 'FRAGCOUNT': '20.000'} [2023-02-24 19:13:37,644][177170] DAMAGECOUNT value on done: 318783.0 [2023-02-24 19:13:37,645][177170] Sum rewards: 21.560, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.256', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'weapon7': '0.064', 'weapon4': '0.076', 'weapon5': '0.082', 'AMMO3': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'WEAPON3': '0.600', 'weapon2': '1.186', 'HITCOUNT': '1.370', 'weapon3': '1.818', 'DAMAGECOUNT': '5.640', 'FRAGCOUNT': '17.000'} [2023-02-24 19:13:37,990][177153] Updated weights for policy 0, policy_version 22610 (0.0008) [2023-02-24 19:13:38,402][177170] DAMAGECOUNT value on done: 314214.0 [2023-02-24 19:13:38,403][177170] Sum rewards: 19.495, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.372', 'AMMO5': '0.012', 'AMMO2': '0.017', 'weapon4': '0.082', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'weapon5': '0.146', 'AMMO3': '0.155', 'WEAPON5': '0.250', 'weapon2': '0.838', 'WEAPON3': '0.900', 'HITCOUNT': '1.640', 'weapon3': '2.534', 'DAMAGECOUNT': '6.111', 'FRAGCOUNT': '17.500'} [2023-02-24 19:13:38,694][177170] DAMAGECOUNT value on done: 318132.0 [2023-02-24 19:13:38,695][177170] Sum rewards: 20.993, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.107', 'ARMOR': '0.016', 'AMMO2': '0.017', 'AMMO5': '0.019', 'AMMO4': '0.082', 'AMMO3': '0.164', 'weapon5': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.380', 'weapon4': '0.388', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '1.560', 'weapon3': '2.748', 'DAMAGECOUNT': '7.614', 'FRAGCOUNT': '21.000'} [2023-02-24 19:13:39,086][177156] DAMAGECOUNT value on done: 316999.0 [2023-02-24 19:13:39,087][177156] Sum rewards: 15.143, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.239', 'AMMO2': '0.005', 'AMMO5': '0.017', 'AMMO4': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.132', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.400', 'ARMOR': '0.451', 'weapon4': '0.522', 'weapon2': '0.836', 'WEAPON3': '0.900', 'HITCOUNT': '1.260', 'weapon3': '1.986', 'DAMAGECOUNT': '5.277', 'FRAGCOUNT': '15.000'} [2023-02-24 19:13:39,109][177156] DAMAGECOUNT value on done: 309666.0 [2023-02-24 19:13:39,110][177156] Sum rewards: 13.719, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.878', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon4': '0.034', 'AMMO3': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon7': '0.108', 'AMMO4': '0.114', 'weapon5': '0.120', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.830', 'weapon2': '1.660', 'weapon3': '1.722', 'DAMAGECOUNT': '4.254', 'FRAGCOUNT': '11.000'} [2023-02-24 19:13:39,398][177156] DAMAGECOUNT value on done: 325690.0 [2023-02-24 19:13:39,399][177156] Sum rewards: 18.835, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.714', 'AMMO2': '0.005', 'AMMO5': '0.020', 'AMMO4': '0.023', 'AMMO3': '0.159', 'weapon5': '0.260', 'WEAPON4': '0.350', 'ARMOR': '0.438', 'WEAPON5': '0.600', 'weapon2': '0.600', 'weapon4': '0.842', 'WEAPON3': '1.000', 'HITCOUNT': '1.560', 'weapon3': '2.012', 'DAMAGECOUNT': '6.930', 'FRAGCOUNT': '18.000'} [2023-02-24 19:13:39,419][177156] DAMAGECOUNT value on done: 311445.0 [2023-02-24 19:13:39,420][177156] Sum rewards: 18.282, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.360', 'AMMO5': '0.017', 'AMMO2': '0.023', 'weapon7': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.121', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON3': '0.800', 'weapon4': '1.010', 'HITCOUNT': '1.530', 'weapon3': '2.034', 'DAMAGECOUNT': '6.030', 'FRAGCOUNT': '16.000'} [2023-02-24 19:13:39,942][177158] DAMAGECOUNT value on done: 306159.0 [2023-02-24 19:13:39,943][177158] Sum rewards: 13.529, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.782', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO5': '0.026', 'AMMO4': '0.113', 'AMMO3': '0.162', 'weapon5': '0.190', 'WEAPON4': '0.300', 'weapon4': '0.332', 'weapon2': '0.576', 'WEAPON5': '0.600', 'WEAPON3': '1.050', 'HITCOUNT': '1.490', 'weapon3': '2.546', 'DAMAGECOUNT': '5.883', 'FRAGCOUNT': '15.500'} [2023-02-24 19:13:40,243][177158] DAMAGECOUNT value on done: 310212.0 [2023-02-24 19:13:40,243][177158] Sum rewards: 18.882, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.410', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'weapon5': '0.154', 'WEAPON5': '0.250', 'weapon4': '0.322', 'WEAPON3': '0.650', 'weapon2': '1.000', 'HITCOUNT': '1.470', 'weapon3': '2.032', 'DAMAGECOUNT': '5.295', 'FRAGCOUNT': '16.000'} [2023-02-24 19:13:40,542][177158] DAMAGECOUNT value on done: 320285.0 [2023-02-24 19:13:40,543][177158] Sum rewards: 22.990, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.223', 'AMMO2': '0.001', 'AMMO4': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO3': '0.109', 'weapon5': '0.242', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'weapon2': '1.156', 'HITCOUNT': '1.420', 'weapon3': '2.168', 'DAMAGECOUNT': '5.787', 'FRAGCOUNT': '18.000'} [2023-02-24 19:13:40,847][177158] DAMAGECOUNT value on done: 319678.0 [2023-02-24 19:13:40,848][177158] Sum rewards: 15.625, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.943', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.031', 'AMMO3': '0.116', 'weapon5': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.453', 'weapon2': '0.660', 'weapon4': '0.684', 'WEAPON3': '0.800', 'HITCOUNT': '1.280', 'weapon3': '1.884', 'DAMAGECOUNT': '4.887', 'FRAGCOUNT': '15.000'} [2023-02-24 19:13:40,948][177153] Updated weights for policy 0, policy_version 22620 (0.0008) [2023-02-24 19:13:41,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13789.9, 300 sec: 13843.1). Total num frames: 92655616. Throughput: 0: 3447.4. Samples: 23161548. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:13:41,376][177119] Avg episode reward: [(0, '17.314')] [2023-02-24 19:13:42,929][177171] Large shaping reward 2.575 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.555, 185.0)] [2023-02-24 19:13:43,917][177153] Updated weights for policy 0, policy_version 22630 (0.0008) [2023-02-24 19:13:43,989][177172] DAMAGECOUNT value on done: 313109.0 [2023-02-24 19:13:43,990][177172] Sum rewards: 14.574, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.310', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO3': '0.085', 'AMMO4': '0.164', 'weapon5': '0.216', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '0.550', 'weapon2': '0.678', 'weapon4': '0.940', 'HITCOUNT': '1.510', 'weapon3': '1.874', 'DAMAGECOUNT': '5.859', 'FRAGCOUNT': '13.000'} [2023-02-24 19:13:44,288][177172] DAMAGECOUNT value on done: 314951.0 [2023-02-24 19:13:44,288][177172] Sum rewards: 14.301, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.766', 'AMMO2': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'weapon7': '0.052', 'AMMO4': '0.061', 'AMMO3': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.556', 'WEAPON3': '0.650', 'weapon2': '0.876', 'HITCOUNT': '1.340', 'weapon3': '1.746', 'DAMAGECOUNT': '5.556', 'FRAGCOUNT': '13.000'} [2023-02-24 19:13:45,298][177154] DAMAGECOUNT value on done: 318305.0 [2023-02-24 19:13:45,298][177154] Sum rewards: 25.529, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.168', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.041', 'AMMO3': '0.132', 'weapon5': '0.178', 'AMMO4': '0.205', 'weapon4': '0.346', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'weapon2': '1.072', 'HITCOUNT': '1.440', 'weapon3': '2.088', 'DAMAGECOUNT': '7.452', 'FRAGCOUNT': '23.000'} [2023-02-24 19:13:45,594][177154] DAMAGECOUNT value on done: 323363.0 [2023-02-24 19:13:45,595][177154] Sum rewards: 28.096, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.411', 'AMMO2': '0.013', 'AMMO5': '0.022', 'AMMO4': '0.066', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'weapon5': '0.216', 'weapon4': '0.412', 'WEAPON5': '0.550', 'weapon2': '0.816', 'WEAPON3': '0.900', 'HITCOUNT': '1.910', 'weapon3': '2.108', 'DAMAGECOUNT': '8.691', 'FRAGCOUNT': '24.000'} [2023-02-24 19:13:45,726][177172] DAMAGECOUNT value on done: 326983.0 [2023-02-24 19:13:45,726][177172] Sum rewards: 9.900, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'AMMO2': '0.019', 'HEALTH': '0.028', 'AMMO3': '0.080', 'weapon7': '0.086', 'AMMO4': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.156', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'weapon2': '0.506', 'HITCOUNT': '0.730', 'weapon3': '1.450', 'weapon4': '1.458', 'DAMAGECOUNT': '3.132', 'FRAGCOUNT': '7.000'} [2023-02-24 19:13:45,894][177154] DAMAGECOUNT value on done: 327502.0 [2023-02-24 19:13:45,895][177154] Sum rewards: 22.273, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.498', 'AMMO5': '0.012', 'AMMO2': '0.051', 'AMMO3': '0.054', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.122', 'weapon7': '0.144', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'AMMO4': '0.256', 'WEAPON3': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.474', 'ARMOR': '0.800', 'weapon3': '1.168', 'HITCOUNT': '1.310', 'weapon4': '1.414', 'DAMAGECOUNT': '5.475', 'FRAGCOUNT': '17.500'} [2023-02-24 19:13:46,030][177172] DAMAGECOUNT value on done: 318190.0 [2023-02-24 19:13:46,030][177172] Sum rewards: 18.945, reward structure: {'DEATHCOUNT': '-9.750', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'HEALTH': '0.027', 'AMMO2': '0.036', 'AMMO3': '0.110', 'AMMO4': '0.179', 'weapon5': '0.298', 'WEAPON4': '0.350', 'weapon4': '0.466', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon2': '1.290', 'HITCOUNT': '1.530', 'weapon3': '1.626', 'DAMAGECOUNT': '5.649', 'FRAGCOUNT': '16.000'} [2023-02-24 19:13:46,199][177154] DAMAGECOUNT value on done: 325949.0 [2023-02-24 19:13:46,199][177154] Sum rewards: 17.394, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.578', 'AMMO5': '0.028', 'AMMO2': '0.035', 'weapon5': '0.128', 'AMMO4': '0.173', 'AMMO3': '0.207', 'WEAPON4': '0.350', 'ARMOR': '0.465', 'WEAPON5': '0.600', 'weapon4': '0.664', 'weapon2': '0.778', 'WEAPON3': '1.200', 'HITCOUNT': '1.640', 'weapon3': '2.172', 'DAMAGECOUNT': '7.032', 'FRAGCOUNT': '18.000'} [2023-02-24 19:13:46,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13789.9, 300 sec: 13843.1). Total num frames: 92725248. Throughput: 0: 3449.2. Samples: 23182368. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 19:13:46,376][177119] Avg episode reward: [(0, '17.615')] [2023-02-24 19:13:46,464][177157] DAMAGECOUNT value on done: 323647.0 [2023-02-24 19:13:46,464][177157] Sum rewards: 17.394, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.260', 'AMMO2': '0.018', 'AMMO5': '0.024', 'weapon4': '0.038', 'AMMO4': '0.089', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'weapon5': '0.382', 'WEAPON5': '0.650', 'WEAPON3': '0.800', 'weapon2': '0.880', 'HITCOUNT': '1.120', 'weapon3': '2.160', 'DAMAGECOUNT': '5.706', 'FRAGCOUNT': '15.500'} [2023-02-24 19:13:46,756][177157] DAMAGECOUNT value on done: 313533.0 [2023-02-24 19:13:46,757][177157] Sum rewards: 25.230, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.570', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.024', 'AMMO3': '0.117', 'AMMO4': '0.120', 'weapon5': '0.204', 'WEAPON4': '0.350', 'weapon4': '0.440', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'weapon2': '1.028', 'HITCOUNT': '1.640', 'weapon3': '1.836', 'DAMAGECOUNT': '7.560', 'FRAGCOUNT': '22.000'} [2023-02-24 19:13:46,768][177157] DAMAGECOUNT value on done: 312290.0 [2023-02-24 19:13:46,769][177157] Sum rewards: 18.225, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.325', 'AMMO2': '0.007', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.092', 'weapon4': '0.256', 'weapon5': '0.300', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '1.030', 'weapon2': '1.134', 'weapon3': '1.728', 'DAMAGECOUNT': '5.277', 'FRAGCOUNT': '15.000'} [2023-02-24 19:13:46,778][177171] DAMAGECOUNT value on done: 312550.0 [2023-02-24 19:13:46,779][177171] Sum rewards: 9.337, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.334', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'weapon7': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.026', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.130', 'AMMO3': '0.136', 'weapon5': '0.186', 'weapon4': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'weapon2': '0.930', 'HITCOUNT': '1.050', 'weapon3': '2.198', 'DAMAGECOUNT': '5.031', 'FRAGCOUNT': '13.000'} [2023-02-24 19:13:46,790][177171] DAMAGECOUNT value on done: 313239.0 [2023-02-24 19:13:46,790][177171] Sum rewards: 4.254, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.050', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.020', 'WEAPON4': '0.100', 'AMMO4': '0.100', 'AMMO3': '0.145', 'weapon4': '0.182', 'weapon5': '0.280', 'WEAPON5': '0.400', 'HITCOUNT': '0.560', 'WEAPON3': '0.800', 'weapon3': '1.384', 'weapon2': '1.676', 'DAMAGECOUNT': '2.628', 'FRAGCOUNT': '6.000'} [2023-02-24 19:13:46,853][177153] Updated weights for policy 0, policy_version 22640 (0.0008) [2023-02-24 19:13:47,073][177157] DAMAGECOUNT value on done: 315108.0 [2023-02-24 19:13:47,074][177157] Sum rewards: 26.520, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.106', 'AMMO5': '0.026', 'AMMO2': '0.032', 'weapon7': '0.060', 'AMMO3': '0.117', 'weapon5': '0.144', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO4': '0.162', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.500', 'weapon4': '0.528', 'weapon2': '0.766', 'WEAPON3': '0.900', 'HITCOUNT': '1.760', 'weapon3': '2.066', 'DAMAGECOUNT': '7.245', 'FRAGCOUNT': '24.000'} [2023-02-24 19:13:47,099][177171] DAMAGECOUNT value on done: 315175.0 [2023-02-24 19:13:47,099][177171] Sum rewards: 17.127, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.562', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.028', 'weapon5': '0.104', 'AMMO4': '0.141', 'AMMO3': '0.162', 'WEAPON4': '0.450', 'weapon4': '0.490', 'WEAPON5': '0.550', 'weapon2': '0.628', 'WEAPON3': '1.050', 'HITCOUNT': '1.850', 'weapon3': '2.312', 'DAMAGECOUNT': '6.141', 'FRAGCOUNT': '20.000'} [2023-02-24 19:13:47,111][177171] DAMAGECOUNT value on done: 318838.0 [2023-02-24 19:13:47,111][177171] Sum rewards: 8.506, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.542', 'AMMO5': '0.016', 'AMMO2': '0.047', 'AMMO3': '0.112', 'AMMO4': '0.235', 'weapon5': '0.310', 'weapon4': '0.428', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'HITCOUNT': '0.580', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'weapon3': '1.104', 'weapon2': '1.180', 'DAMAGECOUNT': '4.386', 'FRAGCOUNT': '9.000'} [2023-02-24 19:13:49,125][177155] DAMAGECOUNT value on done: 323147.0 [2023-02-24 19:13:49,126][177155] Sum rewards: 21.546, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.105', 'AMMO2': '0.012', 'AMMO5': '0.019', 'AMMO4': '0.057', 'AMMO3': '0.172', 'weapon5': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.314', 'WEAPON5': '0.500', 'weapon2': '0.700', 'WEAPON3': '1.150', 'HITCOUNT': '1.390', 'weapon3': '2.446', 'DAMAGECOUNT': '5.511', 'FRAGCOUNT': '23.000'} [2023-02-24 19:13:49,426][177155] DAMAGECOUNT value on done: 330242.0 [2023-02-24 19:13:49,427][177155] Sum rewards: 32.391, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.462', 'AMMO5': '0.017', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.176', 'weapon5': '0.236', 'weapon4': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.526', 'WEAPON3': '1.100', 'HITCOUNT': '2.020', 'weapon3': '2.662', 'DAMAGECOUNT': '9.486', 'FRAGCOUNT': '30.000'} [2023-02-24 19:13:49,724][177155] DAMAGECOUNT value on done: 328084.0 [2023-02-24 19:13:49,724][177155] Sum rewards: 9.623, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.720', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.019', 'weapon7': '0.048', 'AMMO3': '0.054', 'weapon5': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.248', 'WEAPON3': '0.400', 'HITCOUNT': '0.520', 'weapon3': '0.964', 'weapon4': '1.622', 'DAMAGECOUNT': '2.082', 'FRAGCOUNT': '8.000'} [2023-02-24 19:13:49,825][177153] Updated weights for policy 0, policy_version 22650 (0.0008) [2023-02-24 19:13:50,022][177155] DAMAGECOUNT value on done: 311211.0 [2023-02-24 19:13:50,023][177155] Sum rewards: 16.970, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.245', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.063', 'WEAPON4': '0.100', 'weapon5': '0.178', 'weapon4': '0.334', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '1.080', 'weapon2': '1.254', 'weapon3': '1.594', 'DAMAGECOUNT': '3.840', 'FRAGCOUNT': '14.000'} [2023-02-24 19:13:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 92794880. Throughput: 0: 3449.2. Samples: 23192684. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 19:13:51,376][177119] Avg episode reward: [(0, '17.683')] [2023-02-24 19:13:52,796][177153] Updated weights for policy 0, policy_version 22660 (0.0008) [2023-02-24 19:13:55,778][177153] Updated weights for policy 0, policy_version 22670 (0.0008) [2023-02-24 19:13:56,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 92864512. Throughput: 0: 3450.0. Samples: 23213336. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 19:13:56,376][177119] Avg episode reward: [(0, '17.683')] [2023-02-24 19:13:56,791][177170] DAMAGECOUNT value on done: 318814.0 [2023-02-24 19:13:56,791][177170] Sum rewards: 24.962, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.259', 'AMMO2': '0.018', 'AMMO5': '0.020', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'weapon5': '0.154', 'AMMO3': '0.168', 'weapon4': '0.262', 'WEAPON5': '0.500', 'weapon2': '0.674', 'WEAPON3': '1.050', 'HITCOUNT': '1.710', 'weapon3': '2.616', 'DAMAGECOUNT': '7.560', 'FRAGCOUNT': '21.000'} [2023-02-24 19:13:57,091][177170] DAMAGECOUNT value on done: 319568.0 [2023-02-24 19:13:57,091][177170] Sum rewards: 8.281, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.670', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.024', 'WEAPON1': '0.030', 'weapon7': '0.056', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.158', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.338', 'HITCOUNT': '0.570', 'weapon2': '0.612', 'WEAPON3': '0.650', 'weapon3': '1.558', 'DAMAGECOUNT': '2.355', 'FRAGCOUNT': '7.000'} [2023-02-24 19:13:57,861][177170] DAMAGECOUNT value on done: 316115.0 [2023-02-24 19:13:57,861][177170] Sum rewards: 19.579, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.380', 'AMMO5': '0.014', 'AMMO2': '0.022', 'AMMO3': '0.086', 'AMMO4': '0.109', 'weapon5': '0.264', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'ARMOR': '0.452', 'WEAPON3': '0.650', 'weapon4': '0.816', 'HITCOUNT': '1.220', 'weapon3': '1.884', 'DAMAGECOUNT': '5.703', 'FRAGCOUNT': '17.000'} [2023-02-24 19:13:58,167][177170] DAMAGECOUNT value on done: 319712.0 [2023-02-24 19:13:58,167][177170] Sum rewards: 13.088, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.965', 'AMMO5': '0.012', 'AMMO2': '0.040', 'AMMO3': '0.089', 'weapon5': '0.190', 'AMMO4': '0.199', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'ARMOR': '0.476', 'weapon4': '0.560', 'WEAPON3': '0.700', 'HITCOUNT': '1.020', 'weapon2': '1.182', 'weapon3': '1.744', 'DAMAGECOUNT': '4.740', 'FRAGCOUNT': '13.000'} [2023-02-24 19:13:58,560][177156] DAMAGECOUNT value on done: 319232.0 [2023-02-24 19:13:58,560][177156] Sum rewards: 18.779, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.740', 'AMMO5': '0.024', 'WEAPON1': '0.030', 'AMMO2': '0.036', 'AMMO3': '0.116', 'AMMO4': '0.180', 'weapon5': '0.274', 'weapon4': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'weapon2': '0.786', 'HITCOUNT': '1.410', 'weapon3': '2.314', 'DAMAGECOUNT': '6.699', 'FRAGCOUNT': '17.000'} [2023-02-24 19:13:58,581][177156] DAMAGECOUNT value on done: 311869.0 [2023-02-24 19:13:58,582][177156] Sum rewards: 22.369, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.380', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon5': '0.104', 'AMMO4': '0.114', 'AMMO3': '0.125', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.434', 'weapon2': '0.626', 'WEAPON3': '1.000', 'HITCOUNT': '1.640', 'weapon3': '2.544', 'DAMAGECOUNT': '6.609', 'FRAGCOUNT': '20.000'} [2023-02-24 19:13:58,750][177153] Updated weights for policy 0, policy_version 22680 (0.0008) [2023-02-24 19:13:58,878][177156] DAMAGECOUNT value on done: 327780.0 [2023-02-24 19:13:58,878][177156] Sum rewards: 22.074, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.144', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon5': '0.070', 'AMMO4': '0.147', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'weapon2': '0.336', 'WEAPON5': '0.350', 'weapon4': '0.592', 'WEAPON3': '1.000', 'HITCOUNT': '1.550', 'weapon3': '2.736', 'DAMAGECOUNT': '6.270', 'FRAGCOUNT': '21.000'} [2023-02-24 19:13:58,897][177156] DAMAGECOUNT value on done: 312470.0 [2023-02-24 19:13:58,897][177156] Sum rewards: 9.645, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.055', 'AMMO3': '0.088', 'WEAPON4': '0.150', 'weapon4': '0.158', 'weapon5': '0.184', 'HEALTH': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.500', 'HITCOUNT': '0.810', 'weapon2': '1.086', 'weapon3': '1.600', 'DAMAGECOUNT': '3.075', 'FRAGCOUNT': '9.000'} [2023-02-24 19:13:59,413][177158] DAMAGECOUNT value on done: 307869.0 [2023-02-24 19:13:59,413][177158] Sum rewards: 13.686, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.860', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon7': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.120', 'weapon5': '0.144', 'AMMO3': '0.170', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON4': '0.350', 'weapon4': '0.762', 'WEAPON3': '1.000', 'HITCOUNT': '1.220', 'weapon3': '2.318', 'DAMAGECOUNT': '5.130', 'FRAGCOUNT': '16.000'} [2023-02-24 19:13:59,716][177158] DAMAGECOUNT value on done: 312608.0 [2023-02-24 19:13:59,717][177158] Sum rewards: 22.492, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.294', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'weapon5': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'WEAPON5': '0.150', 'weapon4': '0.280', 'weapon2': '0.748', 'WEAPON3': '0.850', 'HITCOUNT': '1.730', 'weapon3': '2.094', 'DAMAGECOUNT': '7.188', 'FRAGCOUNT': '18.000'} [2023-02-24 19:14:00,012][177158] DAMAGECOUNT value on done: 322130.0 [2023-02-24 19:14:00,012][177158] Sum rewards: 18.677, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.678', 'AMMO5': '0.010', 'AMMO2': '0.042', 'AMMO3': '0.107', 'weapon5': '0.128', 'AMMO4': '0.212', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.544', 'WEAPON3': '0.700', 'weapon4': '0.722', 'HITCOUNT': '1.440', 'weapon3': '1.964', 'DAMAGECOUNT': '5.535', 'FRAGCOUNT': '16.500'} [2023-02-24 19:14:00,313][177158] DAMAGECOUNT value on done: 321675.0 [2023-02-24 19:14:00,313][177158] Sum rewards: 18.168, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.118', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO3': '0.073', 'weapon5': '0.120', 'AMMO4': '0.156', 'WEAPON5': '0.200', 'WEAPON3': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.552', 'weapon4': '1.006', 'weapon3': '1.562', 'HITCOUNT': '1.730', 'DAMAGECOUNT': '5.991', 'FRAGCOUNT': '15.000'} [2023-02-24 19:14:01,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 92930048. Throughput: 0: 3449.8. Samples: 23234086. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:14:01,376][177119] Avg episode reward: [(0, '17.741')] [2023-02-24 19:14:01,708][177153] Updated weights for policy 0, policy_version 22690 (0.0009) [2023-02-24 19:14:03,399][177172] DAMAGECOUNT value on done: 314900.0 [2023-02-24 19:14:03,400][177172] Sum rewards: 18.043, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.002', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO5': '0.020', 'AMMO4': '0.081', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'weapon4': '0.248', 'weapon5': '0.292', 'WEAPON5': '0.450', 'WEAPON3': '0.900', 'weapon2': '0.974', 'HITCOUNT': '1.130', 'weapon3': '2.014', 'DAMAGECOUNT': '5.373', 'FRAGCOUNT': '18.000'} [2023-02-24 19:14:03,701][177172] DAMAGECOUNT value on done: 317445.0 [2023-02-24 19:14:03,702][177172] Sum rewards: 26.357, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.065', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.054', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon7': '0.100', 'AMMO4': '0.147', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.514', 'weapon2': '0.524', 'WEAPON3': '1.100', 'HITCOUNT': '1.850', 'weapon3': '2.338', 'DAMAGECOUNT': '7.482', 'FRAGCOUNT': '26.000'} [2023-02-24 19:14:04,674][177153] Updated weights for policy 0, policy_version 22700 (0.0009) [2023-02-24 19:14:04,809][177154] DAMAGECOUNT value on done: 320795.0 [2023-02-24 19:14:04,810][177154] Sum rewards: 22.114, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.172', 'AMMO2': '0.022', 'AMMO5': '0.022', 'WEAPON4': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.175', 'weapon5': '0.294', 'weapon4': '0.378', 'WEAPON5': '0.600', 'weapon2': '0.706', 'WEAPON3': '1.100', 'HITCOUNT': '1.780', 'weapon3': '2.280', 'DAMAGECOUNT': '7.470', 'FRAGCOUNT': '21.000'} [2023-02-24 19:14:05,109][177154] DAMAGECOUNT value on done: 325698.0 [2023-02-24 19:14:05,110][177154] Sum rewards: 20.233, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.151', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.068', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'weapon2': '0.546', 'weapon4': '0.694', 'WEAPON3': '0.950', 'HITCOUNT': '1.860', 'weapon3': '2.066', 'DAMAGECOUNT': '7.005', 'FRAGCOUNT': '19.000'} [2023-02-24 19:14:05,147][177172] DAMAGECOUNT value on done: 328714.0 [2023-02-24 19:14:05,148][177172] Sum rewards: 11.525, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.621', 'AMMO5': '0.017', 'AMMO2': '0.046', 'AMMO3': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.146', 'WEAPON7': '0.200', 'weapon7': '0.218', 'AMMO4': '0.229', 'WEAPON5': '0.350', 'weapon2': '0.454', 'ARMOR': '0.485', 'WEAPON3': '0.550', 'WEAPON4': '0.650', 'HITCOUNT': '1.020', 'weapon3': '1.104', 'weapon4': '1.402', 'DAMAGECOUNT': '5.193', 'FRAGCOUNT': '10.500'} [2023-02-24 19:14:05,407][177154] DAMAGECOUNT value on done: 330318.0 [2023-02-24 19:14:05,408][177154] Sum rewards: 24.732, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.708', 'AMMO5': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'weapon5': '0.158', 'AMMO3': '0.239', 'weapon4': '0.314', 'WEAPON5': '0.350', 'weapon2': '0.676', 'WEAPON3': '1.450', 'HITCOUNT': '2.080', 'weapon3': '2.430', 'DAMAGECOUNT': '8.448', 'FRAGCOUNT': '26.000'} [2023-02-24 19:14:05,456][177172] DAMAGECOUNT value on done: 320599.0 [2023-02-24 19:14:05,456][177172] Sum rewards: 24.493, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.146', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.094', 'AMMO3': '0.108', 'AMMO4': '0.112', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.650', 'weapon2': '1.112', 'HITCOUNT': '1.490', 'weapon3': '2.236', 'DAMAGECOUNT': '7.227', 'FRAGCOUNT': '20.000'} [2023-02-24 19:14:05,716][177154] DAMAGECOUNT value on done: 328619.0 [2023-02-24 19:14:05,716][177154] Sum rewards: 24.311, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.451', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.054', 'AMMO3': '0.097', 'AMMO4': '0.268', 'weapon5': '0.322', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '0.650', 'weapon2': '0.888', 'weapon4': '1.142', 'weapon3': '1.374', 'HITCOUNT': '1.690', 'DAMAGECOUNT': '8.010', 'FRAGCOUNT': '20.000'} [2023-02-24 19:14:06,003][177157] DAMAGECOUNT value on done: 325759.0 [2023-02-24 19:14:06,003][177157] Sum rewards: 22.355, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.520', 'AMMO2': '0.003', 'ARMOR': '0.004', 'AMMO4': '0.014', 'AMMO5': '0.015', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'weapon5': '0.260', 'weapon4': '0.298', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'weapon2': '1.276', 'HITCOUNT': '1.600', 'weapon3': '1.944', 'DAMAGECOUNT': '6.336', 'FRAGCOUNT': '19.000'} [2023-02-24 19:14:06,304][177157] DAMAGECOUNT value on done: 314824.0 [2023-02-24 19:14:06,305][177157] Sum rewards: 15.035, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.360', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO5': '0.010', 'weapon7': '0.054', 'AMMO3': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.186', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'weapon4': '0.720', 'weapon2': '0.914', 'HITCOUNT': '1.100', 'weapon3': '1.586', 'DAMAGECOUNT': '3.873', 'FRAGCOUNT': '14.000'} [2023-02-24 19:14:06,317][177157] DAMAGECOUNT value on done: 314371.0 [2023-02-24 19:14:06,318][177157] Sum rewards: 16.349, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.360', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.034', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.130', 'AMMO4': '0.170', 'weapon5': '0.210', 'weapon4': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.476', 'WEAPON3': '0.900', 'HITCOUNT': '1.470', 'weapon3': '2.738', 'DAMAGECOUNT': '6.243', 'FRAGCOUNT': '16.000'} [2023-02-24 19:14:06,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 92999680. Throughput: 0: 3449.9. Samples: 23244398. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:14:06,376][177119] Avg episode reward: [(0, '17.795')] [2023-02-24 19:14:06,387][177171] DAMAGECOUNT value on done: 314011.0 [2023-02-24 19:14:06,388][177171] Sum rewards: 12.224, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.245', 'ARMOR': '0.004', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.041', 'AMMO3': '0.138', 'WEAPON4': '0.200', 'AMMO4': '0.203', 'weapon5': '0.214', 'weapon4': '0.448', 'WEAPON5': '0.450', 'weapon2': '0.564', 'WEAPON3': '0.800', 'HITCOUNT': '1.020', 'weapon3': '1.964', 'DAMAGECOUNT': '4.383', 'FRAGCOUNT': '11.000'} [2023-02-24 19:14:06,398][177171] DAMAGECOUNT value on done: 314976.0 [2023-02-24 19:14:06,398][177171] Sum rewards: 15.956, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.035', 'ARMOR': '0.004', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon7': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.175', 'WEAPON7': '0.200', 'WEAPON4': '0.550', 'WEAPON3': '0.650', 'weapon4': '0.778', 'weapon2': '0.780', 'weapon3': '1.304', 'HITCOUNT': '1.510', 'DAMAGECOUNT': '5.211', 'FRAGCOUNT': '16.000'} [2023-02-24 19:14:06,619][177157] DAMAGECOUNT value on done: 317692.0 [2023-02-24 19:14:06,620][177157] Sum rewards: 29.249, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.001', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'weapon5': '0.132', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon4': '0.208', 'weapon2': '0.568', 'WEAPON3': '1.200', 'HITCOUNT': '1.770', 'weapon3': '2.722', 'DAMAGECOUNT': '7.752', 'FRAGCOUNT': '28.000'} [2023-02-24 19:14:06,700][177171] DAMAGECOUNT value on done: 318169.0 [2023-02-24 19:14:06,701][177171] Sum rewards: 35.506, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.072', 'AMMO2': '0.008', 'AMMO5': '0.012', 'AMMO4': '0.040', 'AMMO3': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.212', 'weapon4': '0.232', 'WEAPON3': '0.750', 'weapon2': '0.804', 'HITCOUNT': '2.070', 'weapon3': '2.488', 'DAMAGECOUNT': '8.982', 'FRAGCOUNT': '28.500'} [2023-02-24 19:14:06,713][177171] DAMAGECOUNT value on done: 321232.0 [2023-02-24 19:14:06,714][177171] Sum rewards: 17.126, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.304', 'WEAPON1': '0.010', 'AMMO5': '0.032', 'AMMO2': '0.034', 'AMMO4': '0.170', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'weapon5': '0.276', 'weapon4': '0.504', 'weapon2': '0.586', 'WEAPON5': '0.650', 'WEAPON3': '1.300', 'HITCOUNT': '1.710', 'weapon3': '2.242', 'DAMAGECOUNT': '7.182', 'FRAGCOUNT': '19.000'} [2023-02-24 19:14:07,634][177153] Updated weights for policy 0, policy_version 22710 (0.0008) [2023-02-24 19:14:08,636][177155] DAMAGECOUNT value on done: 324542.0 [2023-02-24 19:14:08,637][177155] Sum rewards: 6.781, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.134', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'weapon7': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.147', 'AMMO4': '0.163', 'weapon5': '0.246', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.770', 'weapon4': '0.788', 'WEAPON3': '0.900', 'HITCOUNT': '1.050', 'weapon3': '1.716', 'DAMAGECOUNT': '4.185', 'FRAGCOUNT': '9.000'} [2023-02-24 19:14:08,945][177155] DAMAGECOUNT value on done: 332511.0 [2023-02-24 19:14:08,946][177155] Sum rewards: 20.507, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.529', 'AMMO5': '0.019', 'AMMO2': '0.042', 'AMMO3': '0.124', 'weapon5': '0.128', 'AMMO4': '0.208', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.558', 'WEAPON3': '0.750', 'weapon4': '0.754', 'HITCOUNT': '1.680', 'weapon3': '1.816', 'DAMAGECOUNT': '6.807', 'FRAGCOUNT': '19.500'} [2023-02-24 19:14:09,247][177155] DAMAGECOUNT value on done: 330000.0 [2023-02-24 19:14:09,247][177155] Sum rewards: 23.209, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.088', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon4': '0.104', 'AMMO3': '0.112', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'weapon5': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'weapon2': '1.074', 'HITCOUNT': '1.240', 'weapon3': '2.128', 'DAMAGECOUNT': '5.748', 'FRAGCOUNT': '21.000'} [2023-02-24 19:14:09,547][177155] DAMAGECOUNT value on done: 313650.0 [2023-02-24 19:14:09,547][177155] Sum rewards: 21.469, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.126', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.138', 'weapon5': '0.188', 'weapon4': '0.218', 'WEAPON5': '0.400', 'weapon2': '0.810', 'WEAPON3': '0.950', 'HITCOUNT': '1.760', 'weapon3': '2.478', 'DAMAGECOUNT': '7.317', 'FRAGCOUNT': '18.000'} [2023-02-24 19:14:09,651][177156] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 19:14:10,604][177153] Updated weights for policy 0, policy_version 22720 (0.0009) [2023-02-24 19:14:11,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 93069312. Throughput: 0: 3447.2. Samples: 23265012. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:14:11,376][177119] Avg episode reward: [(0, '18.284')] [2023-02-24 19:14:13,567][177153] Updated weights for policy 0, policy_version 22730 (0.0009) [2023-02-24 19:14:16,280][177170] DAMAGECOUNT value on done: 320404.0 [2023-02-24 19:14:16,280][177170] Sum rewards: 15.216, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.220', 'ARMOR': '0.004', 'AMMO2': '0.016', 'AMMO5': '0.019', 'AMMO4': '0.077', 'weapon7': '0.086', 'AMMO3': '0.091', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.248', 'WEAPON4': '0.300', 'weapon2': '0.398', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '0.870', 'weapon3': '1.356', 'weapon4': '1.460', 'DAMAGECOUNT': '4.770', 'FRAGCOUNT': '12.000'} [2023-02-24 19:14:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 93138944. Throughput: 0: 3448.2. Samples: 23285756. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:14:16,376][177119] Avg episode reward: [(0, '18.297')] [2023-02-24 19:14:16,544][177153] Updated weights for policy 0, policy_version 22740 (0.0008) [2023-02-24 19:14:16,578][177170] DAMAGECOUNT value on done: 321618.0 [2023-02-24 19:14:16,579][177170] Sum rewards: 14.455, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.276', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.044', 'weapon5': '0.130', 'AMMO3': '0.190', 'AMMO4': '0.219', 'WEAPON4': '0.400', 'ARMOR': '0.454', 'WEAPON5': '0.500', 'weapon2': '0.738', 'weapon4': '0.838', 'WEAPON3': '1.150', 'HITCOUNT': '1.500', 'weapon3': '1.878', 'DAMAGECOUNT': '6.150', 'FRAGCOUNT': '16.000'} [2023-02-24 19:14:17,305][177170] DAMAGECOUNT value on done: 317675.0 [2023-02-24 19:14:17,305][177170] Sum rewards: 12.330, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.760', 'ARMOR': '0.004', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.024', 'weapon7': '0.068', 'AMMO3': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.576', 'WEAPON3': '0.750', 'weapon4': '1.010', 'HITCOUNT': '1.280', 'weapon3': '1.736', 'DAMAGECOUNT': '4.680', 'FRAGCOUNT': '11.000'} [2023-02-24 19:14:17,599][177170] DAMAGECOUNT value on done: 322820.0 [2023-02-24 19:14:17,600][177170] Sum rewards: 28.201, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.598', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.029', 'AMMO3': '0.114', 'AMMO4': '0.143', 'weapon5': '0.248', 'weapon4': '0.324', 'WEAPON4': '0.450', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'weapon2': '0.910', 'weapon3': '1.958', 'HITCOUNT': '2.120', 'DAMAGECOUNT': '9.324', 'FRAGCOUNT': '25.000'} [2023-02-24 19:14:18,049][177156] DAMAGECOUNT value on done: 321120.0 [2023-02-24 19:14:18,050][177156] Sum rewards: 16.949, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.220', 'AMMO5': '0.017', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'weapon4': '0.062', 'AMMO4': '0.109', 'AMMO3': '0.131', 'weapon5': '0.264', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon2': '1.140', 'HITCOUNT': '1.310', 'weapon3': '2.200', 'DAMAGECOUNT': '5.664', 'FRAGCOUNT': '15.000'} [2023-02-24 19:14:18,071][177156] DAMAGECOUNT value on done: 313834.0 [2023-02-24 19:14:18,071][177156] Sum rewards: 16.686, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.560', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO5': '0.016', 'WEAPON1': '0.040', 'AMMO4': '0.044', 'AMMO3': '0.128', 'WEAPON4': '0.300', 'weapon5': '0.310', 'WEAPON5': '0.550', 'weapon4': '0.628', 'weapon2': '0.740', 'WEAPON3': '0.900', 'HITCOUNT': '1.270', 'weapon3': '1.912', 'DAMAGECOUNT': '5.895', 'FRAGCOUNT': '17.000'} [2023-02-24 19:14:18,360][177156] DAMAGECOUNT value on done: 329352.0 [2023-02-24 19:14:18,361][177156] Sum rewards: 13.354, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.386', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'AMMO3': '0.085', 'AMMO4': '0.141', 'weapon4': '0.182', 'WEAPON4': '0.200', 'weapon5': '0.230', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '0.890', 'weapon2': '1.478', 'weapon3': '1.866', 'DAMAGECOUNT': '4.356', 'FRAGCOUNT': '11.000'} [2023-02-24 19:14:18,384][177156] DAMAGECOUNT value on done: 314185.0 [2023-02-24 19:14:18,384][177156] Sum rewards: 11.909, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.014', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.033', 'weapon4': '0.046', 'AMMO3': '0.123', 'AMMO4': '0.164', 'WEAPON4': '0.200', 'weapon5': '0.322', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'weapon2': '0.876', 'HITCOUNT': '1.000', 'weapon3': '2.372', 'DAMAGECOUNT': '5.145', 'FRAGCOUNT': '12.500'} [2023-02-24 19:14:18,835][177158] DAMAGECOUNT value on done: 309743.0 [2023-02-24 19:14:18,836][177158] Sum rewards: 16.535, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.488', 'AMMO2': '0.014', 'AMMO5': '0.027', 'AMMO4': '0.071', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'weapon4': '0.198', 'weapon5': '0.312', 'WEAPON5': '0.650', 'WEAPON3': '0.950', 'weapon2': '1.186', 'HITCOUNT': '1.300', 'weapon3': '1.906', 'DAMAGECOUNT': '5.622', 'FRAGCOUNT': '16.000'} [2023-02-24 19:14:19,136][177158] DAMAGECOUNT value on done: 314526.0 [2023-02-24 19:14:19,136][177158] Sum rewards: 22.660, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.288', 'AMMO5': '0.015', 'AMMO2': '0.016', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.139', 'weapon5': '0.250', 'weapon4': '0.256', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'weapon2': '1.068', 'HITCOUNT': '1.290', 'weapon3': '2.028', 'DAMAGECOUNT': '5.754', 'FRAGCOUNT': '20.000'} [2023-02-24 19:14:19,227][177157] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 19:14:19,426][177158] DAMAGECOUNT value on done: 323184.0 [2023-02-24 19:14:19,426][177158] Sum rewards: 6.298, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.710', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon7': '0.070', 'AMMO4': '0.090', 'AMMO3': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.414', 'WEAPON3': '0.700', 'HITCOUNT': '0.810', 'weapon4': '1.000', 'weapon3': '1.364', 'DAMAGECOUNT': '3.162', 'FRAGCOUNT': '8.000'} [2023-02-24 19:14:19,534][177153] Updated weights for policy 0, policy_version 22750 (0.0008) [2023-02-24 19:14:19,729][177158] DAMAGECOUNT value on done: 323411.0 [2023-02-24 19:14:19,729][177158] Sum rewards: 16.614, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.910', 'ARMOR': '0.004', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.144', 'AMMO3': '0.146', 'weapon4': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.594', 'WEAPON3': '0.900', 'HITCOUNT': '1.470', 'weapon3': '2.326', 'DAMAGECOUNT': '5.208', 'FRAGCOUNT': '15.500'} [2023-02-24 19:14:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.8, 300 sec: 13843.1). Total num frames: 93208576. Throughput: 0: 3448.1. Samples: 23296146. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:14:21,376][177119] Avg episode reward: [(0, '18.140')] [2023-02-24 19:14:22,527][177153] Updated weights for policy 0, policy_version 22760 (0.0009) [2023-02-24 19:14:22,881][177172] DAMAGECOUNT value on done: 317175.0 [2023-02-24 19:14:22,881][177172] Sum rewards: 18.470, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.032', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.100', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'weapon5': '0.178', 'WEAPON5': '0.250', 'weapon2': '0.452', 'WEAPON3': '0.850', 'weapon4': '1.088', 'HITCOUNT': '1.680', 'weapon3': '1.862', 'DAMAGECOUNT': '6.825', 'FRAGCOUNT': '15.000'} [2023-02-24 19:14:23,180][177172] DAMAGECOUNT value on done: 319296.0 [2023-02-24 19:14:23,180][177172] Sum rewards: 15.135, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.105', 'AMMO2': '0.024', 'AMMO5': '0.025', 'AMMO4': '0.118', 'AMMO3': '0.169', 'weapon5': '0.324', 'WEAPON4': '0.350', 'weapon2': '0.502', 'WEAPON5': '0.700', 'weapon4': '0.822', 'WEAPON3': '0.950', 'HITCOUNT': '1.470', 'weapon3': '2.028', 'DAMAGECOUNT': '5.508', 'FRAGCOUNT': '17.000'} [2023-02-24 19:14:24,342][177154] DAMAGECOUNT value on done: 322855.0 [2023-02-24 19:14:24,343][177154] Sum rewards: 16.975, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.345', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.045', 'weapon5': '0.056', 'weapon7': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'WEAPON7': '0.200', 'weapon4': '0.500', 'weapon2': '0.712', 'WEAPON3': '0.950', 'HITCOUNT': '1.430', 'weapon3': '2.158', 'DAMAGECOUNT': '6.180', 'FRAGCOUNT': '17.000'} [2023-02-24 19:14:24,642][177154] DAMAGECOUNT value on done: 328603.0 [2023-02-24 19:14:24,642][177154] Sum rewards: 28.164, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.246', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.013', 'weapon5': '0.052', 'AMMO4': '0.066', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'WEAPON4': '0.300', 'weapon4': '0.442', 'weapon2': '0.836', 'WEAPON3': '1.100', 'HITCOUNT': '1.990', 'weapon3': '2.304', 'DAMAGECOUNT': '8.715', 'FRAGCOUNT': '27.000'} [2023-02-24 19:14:24,658][177172] DAMAGECOUNT value on done: 330650.0 [2023-02-24 19:14:24,659][177172] Sum rewards: 14.068, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.252', 'ARMOR': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'weapon7': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.172', 'AMMO3': '0.173', 'WEAPON7': '0.200', 'weapon5': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.536', 'weapon2': '0.684', 'WEAPON3': '1.100', 'HITCOUNT': '1.300', 'weapon3': '2.228', 'DAMAGECOUNT': '5.808', 'FRAGCOUNT': '15.000'} [2023-02-24 19:14:24,938][177154] DAMAGECOUNT value on done: 332363.0 [2023-02-24 19:14:24,938][177154] Sum rewards: 20.008, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.332', 'AMMO5': '0.011', 'AMMO2': '0.015', 'weapon7': '0.038', 'WEAPON1': '0.040', 'AMMO4': '0.076', 'AMMO3': '0.101', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.284', 'WEAPON5': '0.350', 'weapon4': '0.502', 'WEAPON3': '0.600', 'weapon2': '0.832', 'HITCOUNT': '1.130', 'weapon3': '1.876', 'DAMAGECOUNT': '6.135', 'FRAGCOUNT': '16.000'} [2023-02-24 19:14:24,957][177172] DAMAGECOUNT value on done: 322944.0 [2023-02-24 19:14:24,958][177172] Sum rewards: 20.731, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.452', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.057', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.149', 'weapon5': '0.178', 'AMMO4': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.542', 'weapon2': '0.672', 'WEAPON3': '0.950', 'HITCOUNT': '1.640', 'weapon3': '2.298', 'DAMAGECOUNT': '7.035', 'FRAGCOUNT': '20.000'} [2023-02-24 19:14:25,237][177154] DAMAGECOUNT value on done: 330745.0 [2023-02-24 19:14:25,237][177154] Sum rewards: 20.929, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.180', 'AMMO2': '0.005', 'AMMO5': '0.019', 'AMMO4': '0.024', 'AMMO3': '0.107', 'WEAPON4': '0.200', 'weapon5': '0.280', 'weapon4': '0.410', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'weapon2': '1.090', 'HITCOUNT': '1.210', 'weapon3': '1.736', 'DAMAGECOUNT': '6.378', 'FRAGCOUNT': '17.000'} [2023-02-24 19:14:25,507][177153] Updated weights for policy 0, policy_version 22770 (0.0008) [2023-02-24 19:14:25,527][177157] DAMAGECOUNT value on done: 327975.0 [2023-02-24 19:14:25,527][177157] Sum rewards: 20.181, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.598', 'AMMO5': '0.014', 'AMMO2': '0.022', 'weapon4': '0.100', 'AMMO4': '0.111', 'weapon5': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'WEAPON5': '0.350', 'weapon2': '0.848', 'WEAPON3': '1.150', 'HITCOUNT': '1.510', 'weapon3': '2.550', 'DAMAGECOUNT': '6.648', 'FRAGCOUNT': '20.000'} [2023-02-24 19:14:25,824][177157] DAMAGECOUNT value on done: 317441.0 [2023-02-24 19:14:25,825][177157] Sum rewards: 22.518, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.940', 'AMMO5': '0.017', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'weapon7': '0.080', 'weapon5': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.140', 'AMMO3': '0.170', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'weapon2': '0.456', 'WEAPON4': '0.500', 'weapon4': '0.622', 'WEAPON3': '1.200', 'HITCOUNT': '1.870', 'weapon3': '2.286', 'DAMAGECOUNT': '7.851', 'FRAGCOUNT': '23.000'} [2023-02-24 19:14:25,837][177157] DAMAGECOUNT value on done: 316141.0 [2023-02-24 19:14:25,837][177157] Sum rewards: 17.962, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.254', 'AMMO5': '0.015', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.091', 'weapon5': '0.122', 'AMMO4': '0.138', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '0.550', 'weapon2': '0.568', 'weapon4': '1.222', 'weapon3': '1.502', 'HITCOUNT': '1.690', 'DAMAGECOUNT': '5.310', 'FRAGCOUNT': '16.000'} [2023-02-24 19:14:25,893][177171] DAMAGECOUNT value on done: 315903.0 [2023-02-24 19:14:25,894][177171] Sum rewards: 18.503, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.678', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO2': '0.040', 'weapon7': '0.088', 'AMMO3': '0.098', 'AMMO4': '0.197', 'weapon5': '0.282', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON4': '0.400', 'WEAPON7': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.532', 'WEAPON3': '0.650', 'weapon2': '0.778', 'HITCOUNT': '1.010', 'weapon3': '1.642', 'DAMAGECOUNT': '5.676', 'FRAGCOUNT': '17.000'} [2023-02-24 19:14:25,905][177171] DAMAGECOUNT value on done: 317360.0 [2023-02-24 19:14:25,905][177171] Sum rewards: 22.243, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.650', 'AMMO2': '0.020', 'AMMO5': '0.022', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.138', 'weapon5': '0.196', 'weapon4': '0.312', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'weapon2': '1.122', 'HITCOUNT': '1.700', 'weapon3': '2.128', 'DAMAGECOUNT': '7.152', 'FRAGCOUNT': '19.000'} [2023-02-24 19:14:26,143][177157] DAMAGECOUNT value on done: 319997.0 [2023-02-24 19:14:26,143][177157] Sum rewards: 22.829, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.135', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.022', 'AMMO3': '0.089', 'AMMO4': '0.110', 'weapon4': '0.176', 'WEAPON4': '0.250', 'weapon5': '0.322', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.242', 'HITCOUNT': '1.350', 'weapon3': '1.980', 'DAMAGECOUNT': '6.849', 'FRAGCOUNT': '18.000'} [2023-02-24 19:14:26,205][177171] DAMAGECOUNT value on done: 320216.0 [2023-02-24 19:14:26,205][177171] Sum rewards: 19.059, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.691', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon7': '0.020', 'AMMO4': '0.050', 'weapon5': '0.068', 'AMMO3': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.258', 'weapon2': '0.800', 'WEAPON3': '0.850', 'HITCOUNT': '1.520', 'weapon3': '2.446', 'DAMAGECOUNT': '6.141', 'FRAGCOUNT': '17.000'} [2023-02-24 19:14:26,216][177171] DAMAGECOUNT value on done: 323175.0 [2023-02-24 19:14:26,216][177171] Sum rewards: 12.570, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.780', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO2': '0.035', 'AMMO4': '0.172', 'AMMO3': '0.177', 'weapon5': '0.206', 'weapon4': '0.280', 'WEAPON4': '0.300', 'weapon2': '0.420', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '1.360', 'weapon3': '2.672', 'DAMAGECOUNT': '5.829', 'FRAGCOUNT': '13.500'} [2023-02-24 19:14:26,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 93274112. Throughput: 0: 3448.7. Samples: 23316740. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:14:26,376][177119] Avg episode reward: [(0, '18.401')] [2023-02-24 19:14:28,145][177155] DAMAGECOUNT value on done: 326930.0 [2023-02-24 19:14:28,145][177155] Sum rewards: 26.534, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.824', 'AMMO2': '0.010', 'AMMO5': '0.027', 'WEAPON1': '0.030', 'weapon4': '0.044', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'AMMO3': '0.164', 'weapon5': '0.200', 'ARMOR': '0.400', 'WEAPON5': '0.600', 'weapon2': '0.630', 'WEAPON3': '1.000', 'HITCOUNT': '1.760', 'weapon3': '2.730', 'DAMAGECOUNT': '7.164', 'FRAGCOUNT': '23.000'} [2023-02-24 19:14:28,457][177153] Updated weights for policy 0, policy_version 22780 (0.0008) [2023-02-24 19:14:28,457][177155] DAMAGECOUNT value on done: 334518.0 [2023-02-24 19:14:28,458][177155] Sum rewards: 16.361, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.984', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon5': '0.062', 'AMMO4': '0.170', 'AMMO3': '0.199', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.420', 'weapon4': '0.682', 'WEAPON3': '1.200', 'HITCOUNT': '1.560', 'weapon3': '2.382', 'DAMAGECOUNT': '6.021', 'FRAGCOUNT': '19.000'} [2023-02-24 19:14:28,757][177155] DAMAGECOUNT value on done: 331239.0 [2023-02-24 19:14:28,757][177155] Sum rewards: 11.013, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.446', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO3': '0.081', 'AMMO4': '0.082', 'weapon7': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.180', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'HITCOUNT': '0.730', 'weapon4': '0.766', 'weapon2': '0.902', 'weapon3': '1.524', 'DAMAGECOUNT': '3.717', 'FRAGCOUNT': '8.000'} [2023-02-24 19:14:29,062][177155] DAMAGECOUNT value on done: 315577.0 [2023-02-24 19:14:29,063][177155] Sum rewards: 18.382, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.310', 'ARMOR': '0.004', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO4': '0.132', 'AMMO3': '0.147', 'weapon5': '0.168', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.554', 'weapon2': '0.674', 'WEAPON3': '0.950', 'HITCOUNT': '1.570', 'weapon3': '2.080', 'DAMAGECOUNT': '5.751', 'FRAGCOUNT': '19.000'} [2023-02-24 19:14:31,376][177119] Fps is (10 sec: 13516.5, 60 sec: 13789.8, 300 sec: 13829.2). Total num frames: 93343744. Throughput: 0: 3445.0. Samples: 23337392. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 19:14:31,377][177119] Avg episode reward: [(0, '18.389')] [2023-02-24 19:14:31,422][177153] Updated weights for policy 0, policy_version 22790 (0.0008) [2023-02-24 19:14:34,347][177153] Updated weights for policy 0, policy_version 22800 (0.0008) [2023-02-24 19:14:35,761][177170] DAMAGECOUNT value on done: 322277.0 [2023-02-24 19:14:35,761][177170] Sum rewards: 24.713, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.125', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.017', 'weapon7': '0.064', 'weapon4': '0.070', 'AMMO4': '0.082', 'weapon5': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'weapon2': '1.010', 'HITCOUNT': '1.320', 'weapon3': '2.490', 'DAMAGECOUNT': '5.619', 'FRAGCOUNT': '21.000'} [2023-02-24 19:14:36,066][177170] DAMAGECOUNT value on done: 322871.0 [2023-02-24 19:14:36,066][177170] Sum rewards: 11.533, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.735', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO5': '0.020', 'weapon4': '0.040', 'AMMO4': '0.092', 'AMMO3': '0.103', 'WEAPON4': '0.150', 'weapon5': '0.318', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '0.930', 'weapon2': '1.192', 'weapon3': '1.934', 'DAMAGECOUNT': '3.759', 'FRAGCOUNT': '10.000'} [2023-02-24 19:14:36,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 93413376. Throughput: 0: 3445.5. Samples: 23347730. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 19:14:36,376][177119] Avg episode reward: [(0, '18.325')] [2023-02-24 19:14:36,830][177170] DAMAGECOUNT value on done: 319559.0 [2023-02-24 19:14:36,831][177170] Sum rewards: 14.626, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.660', 'AMMO5': '0.022', 'AMMO2': '0.025', 'AMMO3': '0.123', 'AMMO4': '0.124', 'weapon5': '0.242', 'WEAPON4': '0.250', 'weapon4': '0.362', 'WEAPON5': '0.550', 'weapon2': '0.740', 'WEAPON3': '0.850', 'HITCOUNT': '1.130', 'weapon3': '1.966', 'DAMAGECOUNT': '5.652', 'FRAGCOUNT': '14.000'} [2023-02-24 19:14:37,123][177170] DAMAGECOUNT value on done: 324525.0 [2023-02-24 19:14:37,123][177170] Sum rewards: 14.393, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.794', 'AMMO5': '0.020', 'AMMO2': '0.027', 'weapon5': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.101', 'weapon7': '0.128', 'AMMO4': '0.135', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon4': '0.532', 'WEAPON3': '0.600', 'HITCOUNT': '1.290', 'weapon3': '1.418', 'weapon2': '1.464', 'DAMAGECOUNT': '5.115', 'FRAGCOUNT': '14.500'} [2023-02-24 19:14:37,324][177153] Updated weights for policy 0, policy_version 22810 (0.0008) [2023-02-24 19:14:37,652][177156] DAMAGECOUNT value on done: 322733.0 [2023-02-24 19:14:37,652][177156] Sum rewards: 22.412, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.102', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO4': '0.031', 'AMMO3': '0.117', 'weapon5': '0.376', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'weapon2': '0.850', 'HITCOUNT': '1.320', 'weapon3': '2.282', 'DAMAGECOUNT': '4.839', 'FRAGCOUNT': '19.000'} [2023-02-24 19:14:37,663][177156] DAMAGECOUNT value on done: 315708.0 [2023-02-24 19:14:37,664][177156] Sum rewards: 21.131, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.762', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.031', 'AMMO3': '0.135', 'weapon5': '0.148', 'WEAPON4': '0.150', 'AMMO4': '0.152', 'weapon2': '0.208', 'WEAPON5': '0.250', 'weapon4': '0.756', 'WEAPON3': '0.850', 'HITCOUNT': '1.500', 'weapon3': '2.076', 'DAMAGECOUNT': '5.622', 'FRAGCOUNT': '19.000'} [2023-02-24 19:14:37,958][177156] DAMAGECOUNT value on done: 330933.0 [2023-02-24 19:14:37,958][177156] Sum rewards: 14.358, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.420', 'AMMO2': '0.009', 'AMMO5': '0.021', 'AMMO4': '0.044', 'weapon7': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.134', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.450', 'weapon2': '0.482', 'weapon4': '0.778', 'WEAPON3': '1.000', 'HITCOUNT': '1.220', 'weapon3': '2.236', 'DAMAGECOUNT': '4.728', 'FRAGCOUNT': '14.000'} [2023-02-24 19:14:37,969][177156] DAMAGECOUNT value on done: 316418.0 [2023-02-24 19:14:37,969][177156] Sum rewards: 24.764, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.716', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'weapon4': '0.058', 'weapon7': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.176', 'WEAPON7': '0.200', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon2': '0.906', 'HITCOUNT': '1.320', 'weapon3': '2.292', 'DAMAGECOUNT': '6.699', 'FRAGCOUNT': '21.000'} [2023-02-24 19:14:38,240][177158] DAMAGECOUNT value on done: 311010.0 [2023-02-24 19:14:38,240][177158] Sum rewards: 11.409, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.580', 'AMMO2': '0.008', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'weapon4': '0.020', 'AMMO4': '0.042', 'AMMO3': '0.060', 'WEAPON4': '0.150', 'weapon5': '0.362', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.700', 'weapon3': '1.444', 'weapon2': '1.512', 'DAMAGECOUNT': '3.801', 'FRAGCOUNT': '9.000'} [2023-02-24 19:14:38,544][177158] DAMAGECOUNT value on done: 316410.0 [2023-02-24 19:14:38,545][177158] Sum rewards: 24.363, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.328', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'AMMO4': '0.136', 'weapon5': '0.216', 'weapon4': '0.398', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'weapon2': '0.832', 'weapon3': '1.280', 'HITCOUNT': '1.290', 'DAMAGECOUNT': '5.652', 'FRAGCOUNT': '19.000'} [2023-02-24 19:14:38,844][177158] DAMAGECOUNT value on done: 325055.0 [2023-02-24 19:14:38,844][177158] Sum rewards: 16.530, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.048', 'ARMOR': '0.004', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.111', 'weapon4': '0.140', 'AMMO4': '0.147', 'weapon5': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'WEAPON3': '0.700', 'HITCOUNT': '1.310', 'weapon3': '1.484', 'weapon2': '1.784', 'DAMAGECOUNT': '5.538', 'FRAGCOUNT': '14.000'} [2023-02-24 19:14:39,143][177158] DAMAGECOUNT value on done: 325373.0 [2023-02-24 19:14:39,143][177158] Sum rewards: 18.299, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.522', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'weapon5': '0.052', 'AMMO3': '0.083', 'weapon7': '0.088', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.135', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'weapon4': '0.682', 'weapon2': '1.106', 'weapon3': '1.396', 'HITCOUNT': '1.510', 'DAMAGECOUNT': '5.886', 'FRAGCOUNT': '14.000'} [2023-02-24 19:14:40,276][177153] Updated weights for policy 0, policy_version 22820 (0.0008) [2023-02-24 19:14:41,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13789.8, 300 sec: 13829.2). Total num frames: 93483008. Throughput: 0: 3446.9. Samples: 23368446. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 19:14:41,376][177119] Avg episode reward: [(0, '18.409')] [2023-02-24 19:14:42,405][177172] DAMAGECOUNT value on done: 319243.0 [2023-02-24 19:14:42,405][177172] Sum rewards: 24.031, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.007', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'HEALTH': '0.080', 'AMMO3': '0.084', 'weapon4': '0.086', 'weapon5': '0.248', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'weapon2': '1.036', 'HITCOUNT': '1.290', 'weapon3': '2.030', 'DAMAGECOUNT': '6.204', 'FRAGCOUNT': '18.000'} [2023-02-24 19:14:42,710][177172] DAMAGECOUNT value on done: 320757.0 [2023-02-24 19:14:42,710][177172] Sum rewards: 10.499, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.294', 'ARMOR': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.037', 'AMMO3': '0.076', 'weapon7': '0.082', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.112', 'AMMO4': '0.186', 'WEAPON5': '0.300', 'WEAPON4': '0.550', 'WEAPON3': '0.550', 'weapon2': '0.632', 'weapon4': '1.048', 'HITCOUNT': '1.120', 'weapon3': '1.612', 'DAMAGECOUNT': '4.383', 'FRAGCOUNT': '9.000'} [2023-02-24 19:14:43,263][177153] Updated weights for policy 0, policy_version 22830 (0.0009) [2023-02-24 19:14:43,866][177154] DAMAGECOUNT value on done: 325593.0 [2023-02-24 19:14:43,866][177154] Sum rewards: 26.711, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.426', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.024', 'AMMO2': '0.037', 'AMMO3': '0.146', 'AMMO4': '0.184', 'weapon5': '0.216', 'WEAPON4': '0.300', 'weapon4': '0.434', 'WEAPON5': '0.550', 'weapon2': '0.774', 'WEAPON3': '0.950', 'HITCOUNT': '1.840', 'weapon3': '2.204', 'DAMAGECOUNT': '8.214', 'FRAGCOUNT': '23.500'} [2023-02-24 19:14:44,170][177172] DAMAGECOUNT value on done: 332951.0 [2023-02-24 19:14:44,171][177172] Sum rewards: 22.535, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.889', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO4': '0.078', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'weapon5': '0.252', 'weapon4': '0.292', 'ARMOR': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'weapon2': '1.074', 'HITCOUNT': '1.650', 'weapon3': '1.848', 'DAMAGECOUNT': '6.903', 'FRAGCOUNT': '20.000'} [2023-02-24 19:14:44,174][177154] DAMAGECOUNT value on done: 330854.0 [2023-02-24 19:14:44,174][177154] Sum rewards: 17.784, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.422', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO3': '0.120', 'AMMO4': '0.128', 'weapon5': '0.288', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.410', 'weapon2': '0.524', 'WEAPON3': '0.800', 'HITCOUNT': '1.760', 'weapon3': '2.478', 'DAMAGECOUNT': '6.753', 'FRAGCOUNT': '16.500'} [2023-02-24 19:14:44,474][177172] DAMAGECOUNT value on done: 324579.0 [2023-02-24 19:14:44,474][177172] Sum rewards: 18.070, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.670', 'AMMO2': '0.011', 'AMMO5': '0.024', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'weapon5': '0.120', 'AMMO3': '0.130', 'weapon4': '0.186', 'ARMOR': '0.457', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'weapon2': '1.028', 'HITCOUNT': '1.190', 'weapon3': '2.382', 'DAMAGECOUNT': '4.905', 'FRAGCOUNT': '16.000'} [2023-02-24 19:14:44,476][177154] DAMAGECOUNT value on done: 334936.0 [2023-02-24 19:14:44,477][177154] Sum rewards: 24.569, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.356', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO4': '0.074', 'AMMO3': '0.106', 'weapon5': '0.202', 'WEAPON4': '0.350', 'WEAPON5': '0.550', 'weapon2': '0.682', 'WEAPON3': '0.750', 'weapon4': '0.844', 'HITCOUNT': '1.480', 'weapon3': '1.862', 'DAMAGECOUNT': '7.719', 'FRAGCOUNT': '21.000'} [2023-02-24 19:14:44,776][177154] DAMAGECOUNT value on done: 333317.0 [2023-02-24 19:14:44,777][177154] Sum rewards: 32.167, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.800', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.017', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'AMMO3': '0.144', 'weapon5': '0.226', 'WEAPON5': '0.400', 'ARMOR': '0.455', 'weapon4': '0.544', 'weapon2': '0.794', 'WEAPON3': '0.950', 'HITCOUNT': '1.570', 'weapon3': '1.970', 'DAMAGECOUNT': '7.716', 'FRAGCOUNT': '28.000'} [2023-02-24 19:14:45,070][177157] DAMAGECOUNT value on done: 330756.0 [2023-02-24 19:14:45,070][177157] Sum rewards: 29.434, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.784', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.101', 'weapon5': '0.154', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.614', 'weapon4': '0.636', 'WEAPON3': '0.800', 'HITCOUNT': '2.030', 'weapon3': '2.208', 'DAMAGECOUNT': '8.343', 'FRAGCOUNT': '23.000'} [2023-02-24 19:14:45,371][177157] DAMAGECOUNT value on done: 318923.0 [2023-02-24 19:14:45,372][177157] Sum rewards: 14.414, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.140', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.088', 'weapon4': '0.134', 'AMMO4': '0.146', 'weapon5': '0.150', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '1.040', 'weapon2': '1.064', 'weapon3': '1.658', 'DAMAGECOUNT': '4.446', 'FRAGCOUNT': '12.000'} [2023-02-24 19:14:45,385][177157] DAMAGECOUNT value on done: 318188.0 [2023-02-24 19:14:45,386][177157] Sum rewards: 19.784, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.256', 'ARMOR': '0.004', 'AMMO2': '0.011', 'AMMO5': '0.020', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'AMMO3': '0.133', 'weapon5': '0.186', 'weapon4': '0.348', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'weapon2': '0.972', 'HITCOUNT': '1.610', 'weapon3': '2.062', 'DAMAGECOUNT': '6.141', 'FRAGCOUNT': '17.000'} [2023-02-24 19:14:45,413][177171] DAMAGECOUNT value on done: 318359.0 [2023-02-24 19:14:45,413][177171] Sum rewards: 19.806, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.936', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.122', 'AMMO3': '0.153', 'weapon5': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.548', 'weapon2': '0.672', 'WEAPON3': '0.950', 'HITCOUNT': '1.650', 'weapon3': '2.234', 'DAMAGECOUNT': '7.368', 'FRAGCOUNT': '19.000'} [2023-02-24 19:14:45,424][177171] DAMAGECOUNT value on done: 320028.0 [2023-02-24 19:14:45,424][177171] Sum rewards: 23.894, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.862', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.099', 'AMMO3': '0.114', 'WEAPON4': '0.200', 'weapon5': '0.240', 'WEAPON5': '0.300', 'weapon4': '0.546', 'WEAPON3': '0.750', 'weapon2': '0.786', 'weapon3': '1.826', 'HITCOUNT': '1.870', 'DAMAGECOUNT': '7.995', 'FRAGCOUNT': '19.000'} [2023-02-24 19:14:45,689][177157] DAMAGECOUNT value on done: 322653.0 [2023-02-24 19:14:45,690][177157] Sum rewards: 26.443, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.452', 'weapon7': '0.002', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO2': '0.048', 'AMMO3': '0.060', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.241', 'WEAPON3': '0.350', 'weapon5': '0.568', 'WEAPON4': '0.600', 'WEAPON5': '0.750', 'weapon4': '0.750', 'weapon3': '0.890', 'weapon2': '1.204', 'HITCOUNT': '1.400', 'DAMAGECOUNT': '7.938', 'FRAGCOUNT': '24.000'} [2023-02-24 19:14:45,712][177171] DAMAGECOUNT value on done: 322180.0 [2023-02-24 19:14:45,713][177171] Sum rewards: 22.839, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.160', 'AMMO5': '0.020', 'AMMO2': '0.024', 'weapon4': '0.072', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'AMMO4': '0.118', 'weapon5': '0.306', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '1.120', 'weapon2': '1.440', 'weapon3': '1.866', 'DAMAGECOUNT': '5.892', 'FRAGCOUNT': '17.000'} [2023-02-24 19:14:45,723][177171] DAMAGECOUNT value on done: 325453.0 [2023-02-24 19:14:45,723][177171] Sum rewards: 22.270, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.973', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon7': '0.070', 'AMMO3': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.148', 'AMMO4': '0.157', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.454', 'weapon4': '0.656', 'WEAPON3': '0.750', 'weapon2': '0.826', 'HITCOUNT': '1.790', 'weapon3': '1.910', 'DAMAGECOUNT': '6.834', 'FRAGCOUNT': '19.000'} [2023-02-24 19:14:46,252][177153] Updated weights for policy 0, policy_version 22840 (0.0008) [2023-02-24 19:14:46,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 93552640. Throughput: 0: 3443.3. Samples: 23389036. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 19:14:46,376][177119] Avg episode reward: [(0, '19.039')] [2023-02-24 19:14:47,697][177155] DAMAGECOUNT value on done: 329127.0 [2023-02-24 19:14:47,697][177155] Sum rewards: 22.755, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.673', 'AMMO2': '0.012', 'AMMO5': '0.017', 'AMMO4': '0.061', 'weapon4': '0.128', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'weapon5': '0.240', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon2': '1.132', 'HITCOUNT': '1.790', 'weapon3': '2.216', 'DAMAGECOUNT': '6.591', 'FRAGCOUNT': '22.000'} [2023-02-24 19:14:48,001][177155] DAMAGECOUNT value on done: 337788.0 [2023-02-24 19:14:48,002][177155] Sum rewards: 27.879, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.860', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.036', 'weapon5': '0.132', 'AMMO4': '0.180', 'AMMO3': '0.207', 'weapon2': '0.422', 'weapon4': '0.458', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.250', 'weapon3': '2.664', 'DAMAGECOUNT': '9.810', 'FRAGCOUNT': '28.000'} [2023-02-24 19:14:48,292][177155] DAMAGECOUNT value on done: 333116.0 [2023-02-24 19:14:48,293][177155] Sum rewards: 15.729, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.437', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.040', 'weapon7': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.130', 'AMMO4': '0.199', 'WEAPON7': '0.200', 'weapon2': '0.266', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '1.330', 'weapon3': '1.460', 'weapon4': '1.566', 'DAMAGECOUNT': '5.631', 'FRAGCOUNT': '12.500'} [2023-02-24 19:14:48,599][177155] DAMAGECOUNT value on done: 317483.0 [2023-02-24 19:14:48,600][177155] Sum rewards: 24.056, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.412', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.027', 'AMMO3': '0.060', 'weapon7': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.294', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.522', 'weapon2': '1.008', 'HITCOUNT': '1.270', 'weapon3': '1.410', 'DAMAGECOUNT': '5.718', 'FRAGCOUNT': '18.000'} [2023-02-24 19:14:49,220][177153] Updated weights for policy 0, policy_version 22850 (0.0008) [2023-02-24 19:14:51,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 93622272. Throughput: 0: 3444.4. Samples: 23399398. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 19:14:51,376][177119] Avg episode reward: [(0, '19.380')] [2023-02-24 19:14:52,183][177153] Updated weights for policy 0, policy_version 22860 (0.0008) [2023-02-24 19:14:55,156][177153] Updated weights for policy 0, policy_version 22870 (0.0009) [2023-02-24 19:14:55,294][177170] DAMAGECOUNT value on done: 324136.0 [2023-02-24 19:14:55,295][177170] Sum rewards: 19.642, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.600', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon7': '0.042', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'weapon5': '0.236', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'weapon4': '0.742', 'weapon2': '0.892', 'HITCOUNT': '1.320', 'weapon3': '1.630', 'DAMAGECOUNT': '5.577', 'FRAGCOUNT': '14.000'} [2023-02-24 19:14:55,598][177170] DAMAGECOUNT value on done: 325253.0 [2023-02-24 19:14:55,598][177170] Sum rewards: 26.050, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.150', 'AMMO5': '0.015', 'AMMO2': '0.017', 'AMMO4': '0.086', 'AMMO3': '0.160', 'weapon5': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.560', 'weapon4': '0.626', 'WEAPON3': '1.000', 'HITCOUNT': '1.740', 'weapon3': '2.298', 'DAMAGECOUNT': '7.146', 'FRAGCOUNT': '24.000'} [2023-02-24 19:14:56,353][177170] DAMAGECOUNT value on done: 320673.0 [2023-02-24 19:14:56,354][177170] Sum rewards: 10.195, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.627', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.032', 'AMMO3': '0.064', 'AMMO4': '0.158', 'weapon5': '0.316', 'WEAPON4': '0.350', 'WEAPON3': '0.350', 'WEAPON5': '0.400', 'HITCOUNT': '0.860', 'weapon4': '0.860', 'weapon3': '1.020', 'weapon2': '1.048', 'DAMAGECOUNT': '3.342', 'FRAGCOUNT': '8.000'} [2023-02-24 19:14:56,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 93691904. Throughput: 0: 3446.0. Samples: 23420080. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 19:14:56,376][177119] Avg episode reward: [(0, '19.303')] [2023-02-24 19:14:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000022874_93691904.pth... [2023-02-24 19:14:56,437][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000022064_90374144.pth [2023-02-24 19:14:56,671][177170] DAMAGECOUNT value on done: 326524.0 [2023-02-24 19:14:56,672][177170] Sum rewards: 20.756, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.492', 'AMMO4': '-0.075', 'AMMO2': '-0.015', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO3': '0.137', 'weapon5': '0.252', 'WEAPON5': '0.600', 'WEAPON3': '1.000', 'HITCOUNT': '1.240', 'weapon2': '1.378', 'weapon3': '1.944', 'DAMAGECOUNT': '5.997', 'FRAGCOUNT': '19.000'} [2023-02-24 19:14:57,185][177156] DAMAGECOUNT value on done: 324985.0 [2023-02-24 19:14:57,185][177156] Sum rewards: 20.657, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.954', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.050', 'AMMO3': '0.095', 'weapon5': '0.206', 'AMMO4': '0.249', 'WEAPON5': '0.300', 'weapon2': '0.452', 'WEAPON4': '0.500', 'WEAPON3': '0.700', 'weapon4': '1.238', 'HITCOUNT': '1.580', 'weapon3': '1.714', 'DAMAGECOUNT': '6.756', 'FRAGCOUNT': '20.000'} [2023-02-24 19:14:57,196][177156] DAMAGECOUNT value on done: 317977.0 [2023-02-24 19:14:57,197][177156] Sum rewards: 27.410, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.568', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO2': '0.016', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon5': '0.186', 'WEAPON5': '0.200', 'WEAPON3': '0.650', 'weapon2': '1.244', 'HITCOUNT': '1.480', 'weapon3': '1.838', 'DAMAGECOUNT': '6.807', 'FRAGCOUNT': '22.000'} [2023-02-24 19:14:57,495][177156] DAMAGECOUNT value on done: 333849.0 [2023-02-24 19:14:57,495][177156] Sum rewards: 35.611, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.724', 'AMMO5': '0.024', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.153', 'WEAPON4': '0.250', 'weapon2': '0.284', 'weapon5': '0.304', 'ARMOR': '0.400', 'weapon4': '0.478', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'HITCOUNT': '2.050', 'weapon3': '2.570', 'DAMAGECOUNT': '8.748', 'FRAGCOUNT': '30.000'} [2023-02-24 19:14:57,506][177156] DAMAGECOUNT value on done: 318060.0 [2023-02-24 19:14:57,507][177156] Sum rewards: 15.019, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.238', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.022', 'AMMO3': '0.052', 'AMMO4': '0.109', 'WEAPON4': '0.200', 'weapon5': '0.222', 'WEAPON3': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.402', 'weapon3': '0.954', 'HITCOUNT': '0.990', 'weapon2': '1.602', 'DAMAGECOUNT': '4.926', 'FRAGCOUNT': '11.000'} [2023-02-24 19:14:57,781][177158] DAMAGECOUNT value on done: 312933.0 [2023-02-24 19:14:57,782][177158] Sum rewards: 19.651, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.458', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'AMMO4': '0.102', 'AMMO3': '0.110', 'weapon5': '0.192', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.564', 'weapon2': '0.662', 'WEAPON3': '0.700', 'HITCOUNT': '1.390', 'weapon3': '1.798', 'DAMAGECOUNT': '5.769', 'FRAGCOUNT': '18.000'} [2023-02-24 19:14:58,082][177158] DAMAGECOUNT value on done: 318264.0 [2023-02-24 19:14:58,082][177158] Sum rewards: 16.038, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.376', 'AMMO5': '0.014', 'AMMO2': '0.057', 'AMMO3': '0.085', 'weapon5': '0.196', 'AMMO4': '0.287', 'WEAPON5': '0.350', 'ARMOR': '0.408', 'WEAPON3': '0.550', 'WEAPON4': '0.600', 'weapon2': '0.686', 'weapon3': '1.174', 'weapon4': '1.284', 'HITCOUNT': '1.410', 'DAMAGECOUNT': '5.562', 'FRAGCOUNT': '15.000'} [2023-02-24 19:14:58,178][177153] Updated weights for policy 0, policy_version 22880 (0.0008) [2023-02-24 19:14:58,375][177158] DAMAGECOUNT value on done: 327763.0 [2023-02-24 19:14:58,375][177158] Sum rewards: 22.303, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.651', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.036', 'weapon7': '0.062', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.138', 'AMMO4': '0.178', 'WEAPON7': '0.200', 'weapon5': '0.342', 'WEAPON4': '0.400', 'weapon4': '0.576', 'WEAPON5': '0.600', 'WEAPON3': '0.850', 'weapon2': '1.012', 'weapon3': '1.550', 'HITCOUNT': '1.600', 'DAMAGECOUNT': '8.124', 'FRAGCOUNT': '20.000'} [2023-02-24 19:14:58,671][177158] DAMAGECOUNT value on done: 326891.0 [2023-02-24 19:14:58,672][177158] Sum rewards: 17.373, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.830', 'AMMO2': '0.008', 'AMMO5': '0.014', 'AMMO4': '0.040', 'weapon5': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'weapon4': '0.218', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'weapon2': '0.934', 'HITCOUNT': '1.300', 'weapon3': '2.440', 'DAMAGECOUNT': '4.554', 'FRAGCOUNT': '17.000'} [2023-02-24 19:15:01,178][177153] Updated weights for policy 0, policy_version 22890 (0.0009) [2023-02-24 19:15:01,376][177119] Fps is (10 sec: 13516.7, 60 sec: 13789.8, 300 sec: 13815.3). Total num frames: 93757440. Throughput: 0: 3441.4. Samples: 23440618. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 19:15:01,376][177119] Avg episode reward: [(0, '19.693')] [2023-02-24 19:15:01,377][177140] Saving new best policy, reward=19.693! [2023-02-24 19:15:01,991][177172] DAMAGECOUNT value on done: 320856.0 [2023-02-24 19:15:01,992][177172] Sum rewards: 15.311, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.648', 'AMMO2': '0.008', 'AMMO5': '0.020', 'AMMO4': '0.039', 'AMMO3': '0.100', 'WEAPON4': '0.300', 'weapon5': '0.342', 'weapon4': '0.404', 'ARMOR': '0.457', 'WEAPON5': '0.550', 'WEAPON3': '0.550', 'HITCOUNT': '1.250', 'weapon3': '1.258', 'weapon2': '1.342', 'DAMAGECOUNT': '4.839', 'FRAGCOUNT': '13.000'} [2023-02-24 19:15:02,297][177172] DAMAGECOUNT value on done: 322338.0 [2023-02-24 19:15:02,298][177172] Sum rewards: 16.295, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.407', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO3': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.121', 'weapon7': '0.140', 'WEAPON4': '0.150', 'weapon5': '0.182', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.444', 'WEAPON3': '0.700', 'HITCOUNT': '0.980', 'weapon2': '1.048', 'weapon3': '1.590', 'DAMAGECOUNT': '4.743', 'FRAGCOUNT': '14.000'} [2023-02-24 19:15:03,385][177154] DAMAGECOUNT value on done: 327263.0 [2023-02-24 19:15:03,386][177154] Sum rewards: 12.147, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.862', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO2': '0.031', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'AMMO4': '0.153', 'weapon5': '0.328', 'weapon4': '0.346', 'WEAPON5': '0.550', 'weapon2': '0.584', 'WEAPON3': '0.750', 'HITCOUNT': '1.250', 'weapon3': '1.704', 'DAMAGECOUNT': '5.010', 'FRAGCOUNT': '11.000'} [2023-02-24 19:15:03,694][177154] DAMAGECOUNT value on done: 332515.0 [2023-02-24 19:15:03,695][177154] Sum rewards: 13.326, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.604', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.036', 'AMMO3': '0.134', 'WEAPON4': '0.150', 'weapon5': '0.234', 'weapon4': '0.372', 'WEAPON5': '0.400', 'weapon2': '0.920', 'WEAPON3': '1.000', 'HITCOUNT': '1.280', 'weapon3': '2.122', 'DAMAGECOUNT': '4.983', 'FRAGCOUNT': '14.000'} [2023-02-24 19:15:03,762][177172] DAMAGECOUNT value on done: 334987.0 [2023-02-24 19:15:03,763][177172] Sum rewards: 22.952, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.508', 'AMMO2': '0.004', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.022', 'AMMO3': '0.093', 'WEAPON4': '0.200', 'weapon5': '0.330', 'weapon4': '0.378', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon2': '0.680', 'HITCOUNT': '1.130', 'weapon3': '2.180', 'DAMAGECOUNT': '6.108', 'FRAGCOUNT': '18.000'} [2023-02-24 19:15:04,004][177154] DAMAGECOUNT value on done: 336886.0 [2023-02-24 19:15:04,005][177154] Sum rewards: 19.261, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.870', 'AMMO5': '0.022', 'AMMO2': '0.027', 'AMMO3': '0.127', 'AMMO4': '0.136', 'WEAPON4': '0.200', 'weapon4': '0.320', 'weapon5': '0.370', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon2': '1.174', 'HITCOUNT': '1.300', 'weapon3': '1.804', 'DAMAGECOUNT': '5.850', 'FRAGCOUNT': '18.000'} [2023-02-24 19:15:04,066][177172] DAMAGECOUNT value on done: 326725.0 [2023-02-24 19:15:04,066][177172] Sum rewards: 23.991, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.846', 'ARMOR': '0.004', 'AMMO5': '0.029', 'AMMO2': '0.053', 'AMMO3': '0.063', 'AMMO4': '0.264', 'weapon2': '0.342', 'weapon5': '0.406', 'WEAPON3': '0.500', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'weapon4': '1.202', 'HITCOUNT': '1.420', 'weapon3': '1.466', 'DAMAGECOUNT': '6.438', 'FRAGCOUNT': '21.000'} [2023-02-24 19:15:04,167][177153] Updated weights for policy 0, policy_version 22900 (0.0009) [2023-02-24 19:15:04,311][177154] DAMAGECOUNT value on done: 335313.0 [2023-02-24 19:15:04,312][177154] Sum rewards: 18.493, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.880', 'AMMO2': '0.010', 'AMMO5': '0.022', 'AMMO4': '0.049', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.140', 'weapon4': '0.252', 'weapon5': '0.324', 'weapon2': '0.478', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'HITCOUNT': '1.380', 'weapon3': '2.230', 'DAMAGECOUNT': '5.988', 'FRAGCOUNT': '16.000'} [2023-02-24 19:15:04,589][177157] DAMAGECOUNT value on done: 332966.0 [2023-02-24 19:15:04,590][177157] Sum rewards: 25.046, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.010', 'AMMO2': '0.015', 'HEALTH': '0.026', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'weapon4': '0.102', 'AMMO3': '0.120', 'WEAPON5': '0.200', 'weapon5': '0.254', 'WEAPON3': '0.700', 'weapon2': '0.826', 'HITCOUNT': '1.510', 'weapon3': '2.476', 'DAMAGECOUNT': '6.630', 'FRAGCOUNT': '21.000'} [2023-02-24 19:15:04,894][177157] DAMAGECOUNT value on done: 320537.0 [2023-02-24 19:15:04,895][177157] Sum rewards: 17.572, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.320', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO5': '0.019', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.172', 'weapon5': '0.264', 'WEAPON5': '0.300', 'weapon4': '0.328', 'weapon2': '0.702', 'WEAPON3': '1.050', 'HITCOUNT': '1.180', 'weapon3': '2.338', 'DAMAGECOUNT': '4.842', 'FRAGCOUNT': '18.000'} [2023-02-24 19:15:04,908][177157] DAMAGECOUNT value on done: 320329.0 [2023-02-24 19:15:04,909][177157] Sum rewards: 18.029, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.450', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon7': '0.076', 'AMMO4': '0.108', 'AMMO3': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.148', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.482', 'WEAPON3': '0.750', 'weapon2': '1.132', 'HITCOUNT': '1.340', 'weapon3': '1.698', 'DAMAGECOUNT': '6.198', 'FRAGCOUNT': '14.000'} [2023-02-24 19:15:04,996][177171] DAMAGECOUNT value on done: 320717.0 [2023-02-24 19:15:04,996][177171] Sum rewards: 22.983, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.084', 'AMMO5': '0.031', 'AMMO2': '0.040', 'weapon5': '0.162', 'AMMO3': '0.164', 'AMMO4': '0.198', 'weapon4': '0.308', 'WEAPON4': '0.400', 'ARMOR': '0.456', 'WEAPON5': '0.600', 'weapon2': '0.722', 'WEAPON3': '0.950', 'HITCOUNT': '1.420', 'weapon3': '2.504', 'DAMAGECOUNT': '6.612', 'FRAGCOUNT': '23.000'} [2023-02-24 19:15:05,008][177171] DAMAGECOUNT value on done: 322530.0 [2023-02-24 19:15:05,009][177171] Sum rewards: 23.489, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.616', 'AMMO5': '0.011', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.165', 'weapon5': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.416', 'weapon2': '0.494', 'WEAPON3': '1.100', 'HITCOUNT': '2.000', 'weapon3': '2.590', 'DAMAGECOUNT': '7.506', 'FRAGCOUNT': '22.000'} [2023-02-24 19:15:05,212][177157] DAMAGECOUNT value on done: 324777.0 [2023-02-24 19:15:05,213][177157] Sum rewards: 20.266, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.523', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'weapon4': '0.092', 'AMMO3': '0.113', 'AMMO4': '0.113', 'WEAPON4': '0.200', 'weapon5': '0.336', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon2': '0.846', 'HITCOUNT': '1.320', 'weapon3': '2.270', 'DAMAGECOUNT': '6.372', 'FRAGCOUNT': '17.000'} [2023-02-24 19:15:05,303][177171] DAMAGECOUNT value on done: 324062.0 [2023-02-24 19:15:05,304][177171] Sum rewards: 16.664, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.634', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'weapon4': '0.178', 'AMMO3': '0.179', 'weapon5': '0.424', 'weapon2': '0.454', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '1.330', 'weapon3': '2.528', 'DAMAGECOUNT': '5.646', 'FRAGCOUNT': '17.000'} [2023-02-24 19:15:05,317][177171] DAMAGECOUNT value on done: 327111.0 [2023-02-24 19:15:05,317][177171] Sum rewards: 12.763, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.768', 'WEAPON1': '0.020', 'AMMO5': '0.029', 'AMMO2': '0.036', 'AMMO3': '0.148', 'AMMO4': '0.178', 'weapon5': '0.224', 'WEAPON4': '0.250', 'weapon4': '0.400', 'WEAPON5': '0.650', 'WEAPON3': '0.900', 'weapon2': '0.914', 'HITCOUNT': '1.260', 'weapon3': '2.048', 'DAMAGECOUNT': '4.974', 'FRAGCOUNT': '13.000'} [2023-02-24 19:15:06,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13789.9, 300 sec: 13815.3). Total num frames: 93827072. Throughput: 0: 3438.0. Samples: 23450858. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 19:15:06,376][177119] Avg episode reward: [(0, '19.571')] [2023-02-24 19:15:07,107][177153] Updated weights for policy 0, policy_version 22910 (0.0008) [2023-02-24 19:15:07,243][177155] DAMAGECOUNT value on done: 331545.0 [2023-02-24 19:15:07,244][177155] Sum rewards: 27.789, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.080', 'AMMO2': '0.011', 'AMMO5': '0.012', 'weapon7': '0.054', 'AMMO4': '0.055', 'AMMO3': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.166', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.562', 'weapon2': '0.668', 'WEAPON3': '0.700', 'HITCOUNT': '1.840', 'weapon3': '2.250', 'DAMAGECOUNT': '7.254', 'FRAGCOUNT': '24.000'} [2023-02-24 19:15:07,546][177155] DAMAGECOUNT value on done: 339672.0 [2023-02-24 19:15:07,546][177155] Sum rewards: 18.596, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.150', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon7': '0.054', 'AMMO3': '0.084', 'AMMO4': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.240', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '0.650', 'weapon4': '0.750', 'weapon2': '0.884', 'HITCOUNT': '1.560', 'weapon3': '1.794', 'DAMAGECOUNT': '5.652', 'FRAGCOUNT': '16.000'} [2023-02-24 19:15:07,849][177155] DAMAGECOUNT value on done: 335681.0 [2023-02-24 19:15:07,849][177155] Sum rewards: 25.067, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.030', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO4': '0.028', 'AMMO3': '0.119', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.308', 'weapon5': '0.320', 'weapon4': '0.620', 'WEAPON3': '0.850', 'HITCOUNT': '1.880', 'weapon3': '2.150', 'DAMAGECOUNT': '7.695', 'FRAGCOUNT': '20.000'} [2023-02-24 19:15:08,150][177155] DAMAGECOUNT value on done: 319403.0 [2023-02-24 19:15:08,150][177155] Sum rewards: 20.288, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.377', 'AMMO5': '0.010', 'AMMO2': '0.011', 'weapon4': '0.036', 'WEAPON4': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.147', 'WEAPON5': '0.250', 'weapon5': '0.314', 'weapon2': '0.936', 'WEAPON3': '1.000', 'HITCOUNT': '1.310', 'weapon3': '2.286', 'DAMAGECOUNT': '5.760', 'FRAGCOUNT': '20.000'} [2023-02-24 19:15:10,040][177153] Updated weights for policy 0, policy_version 22920 (0.0009) [2023-02-24 19:15:11,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13789.9, 300 sec: 13815.3). Total num frames: 93896704. Throughput: 0: 3441.8. Samples: 23471620. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 19:15:11,376][177119] Avg episode reward: [(0, '19.510')] [2023-02-24 19:15:13,022][177153] Updated weights for policy 0, policy_version 22930 (0.0008) [2023-02-24 19:15:14,807][177170] DAMAGECOUNT value on done: 325799.0 [2023-02-24 19:15:14,807][177170] Sum rewards: 13.745, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.096', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.064', 'AMMO3': '0.101', 'weapon5': '0.188', 'WEAPON5': '0.300', 'AMMO4': '0.322', 'WEAPON3': '0.600', 'WEAPON4': '0.600', 'weapon2': '0.632', 'weapon4': '0.824', 'HITCOUNT': '1.160', 'weapon3': '1.282', 'DAMAGECOUNT': '4.989', 'FRAGCOUNT': '15.000'} [2023-02-24 19:15:15,106][177170] DAMAGECOUNT value on done: 326550.0 [2023-02-24 19:15:15,106][177170] Sum rewards: 12.122, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.251', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.030', 'AMMO3': '0.062', 'weapon5': '0.080', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'WEAPON3': '0.400', 'weapon4': '0.622', 'weapon2': '0.642', 'HITCOUNT': '1.150', 'weapon3': '1.330', 'DAMAGECOUNT': '3.891', 'FRAGCOUNT': '11.000'} [2023-02-24 19:15:15,856][177170] DAMAGECOUNT value on done: 323073.0 [2023-02-24 19:15:15,856][177170] Sum rewards: 26.283, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.455', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.040', 'AMMO3': '0.113', 'weapon5': '0.188', 'AMMO4': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.496', 'weapon4': '0.510', 'WEAPON3': '0.700', 'weapon2': '0.836', 'weapon3': '1.774', 'HITCOUNT': '1.800', 'DAMAGECOUNT': '7.200', 'FRAGCOUNT': '22.000'} [2023-02-24 19:15:15,986][177153] Updated weights for policy 0, policy_version 22940 (0.0008) [2023-02-24 19:15:16,157][177170] DAMAGECOUNT value on done: 328388.0 [2023-02-24 19:15:16,158][177170] Sum rewards: 17.202, reward structure: {'DEATHCOUNT': '-9.000', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.029', 'AMMO3': '0.122', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'weapon5': '0.226', 'weapon4': '0.290', 'WEAPON5': '0.300', 'HEALTH': '0.572', 'WEAPON3': '0.650', 'weapon2': '0.932', 'HITCOUNT': '1.380', 'weapon3': '2.292', 'DAMAGECOUNT': '5.592', 'FRAGCOUNT': '13.500'} [2023-02-24 19:15:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13815.3). Total num frames: 93966336. Throughput: 0: 3443.7. Samples: 23492358. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 19:15:16,376][177119] Avg episode reward: [(0, '19.484')] [2023-02-24 19:15:16,781][177156] DAMAGECOUNT value on done: 328069.0 [2023-02-24 19:15:16,781][177156] Sum rewards: 32.248, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.098', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.076', 'AMMO4': '0.092', 'AMMO3': '0.145', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.388', 'weapon4': '0.736', 'WEAPON3': '0.900', 'weapon3': '2.288', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '9.252', 'FRAGCOUNT': '27.000'} [2023-02-24 19:15:16,792][177156] DAMAGECOUNT value on done: 320147.0 [2023-02-24 19:15:16,792][177156] Sum rewards: 15.785, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.512', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.034', 'AMMO3': '0.077', 'AMMO4': '0.170', 'WEAPON4': '0.350', 'weapon5': '0.410', 'weapon2': '0.580', 'WEAPON3': '0.600', 'WEAPON5': '0.600', 'weapon4': '0.730', 'HITCOUNT': '1.400', 'weapon3': '1.478', 'DAMAGECOUNT': '6.090', 'FRAGCOUNT': '13.000'} [2023-02-24 19:15:17,090][177156] DAMAGECOUNT value on done: 336785.0 [2023-02-24 19:15:17,091][177156] Sum rewards: 27.665, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.900', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.046', 'AMMO3': '0.125', 'AMMO4': '0.232', 'weapon2': '0.374', 'weapon5': '0.392', 'WEAPON4': '0.450', 'weapon4': '0.456', 'WEAPON5': '0.600', 'WEAPON3': '0.900', 'HITCOUNT': '2.080', 'weapon3': '2.322', 'DAMAGECOUNT': '8.808', 'FRAGCOUNT': '24.000'} [2023-02-24 19:15:17,101][177156] DAMAGECOUNT value on done: 319902.0 [2023-02-24 19:15:17,102][177156] Sum rewards: 19.551, reward structure: {'DEATHCOUNT': '-6.750', 'ARMOR': '0.004', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'HEALTH': '0.063', 'AMMO3': '0.078', 'weapon4': '0.124', 'AMMO4': '0.169', 'WEAPON4': '0.200', 'weapon5': '0.216', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '1.120', 'weapon2': '1.532', 'weapon3': '1.540', 'DAMAGECOUNT': '5.436', 'FRAGCOUNT': '15.000'} [2023-02-24 19:15:17,280][177158] DAMAGECOUNT value on done: 314366.0 [2023-02-24 19:15:17,281][177158] Sum rewards: 15.752, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.422', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'weapon4': '0.126', 'weapon5': '0.192', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'HITCOUNT': '1.080', 'weapon2': '1.382', 'weapon3': '1.940', 'DAMAGECOUNT': '4.299', 'FRAGCOUNT': '15.000'} [2023-02-24 19:15:17,577][177158] DAMAGECOUNT value on done: 319924.0 [2023-02-24 19:15:17,577][177158] Sum rewards: 13.144, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.691', 'AMMO5': '0.010', 'AMMO2': '0.027', 'WEAPON1': '0.040', 'AMMO3': '0.080', 'AMMO4': '0.136', 'weapon5': '0.180', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '0.500', 'weapon4': '0.604', 'HITCOUNT': '1.210', 'weapon2': '1.306', 'weapon3': '1.462', 'DAMAGECOUNT': '4.980', 'FRAGCOUNT': '13.000'} [2023-02-24 19:15:17,869][177158] DAMAGECOUNT value on done: 329569.0 [2023-02-24 19:15:17,870][177158] Sum rewards: 16.368, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.370', 'AMMO2': '0.015', 'AMMO5': '0.016', 'WEAPON1': '0.030', 'weapon4': '0.048', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'AMMO3': '0.142', 'weapon5': '0.222', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'weapon2': '1.126', 'HITCOUNT': '1.140', 'weapon3': '2.256', 'DAMAGECOUNT': '5.418', 'FRAGCOUNT': '15.000'} [2023-02-24 19:15:18,168][177158] DAMAGECOUNT value on done: 329096.0 [2023-02-24 19:15:18,168][177158] Sum rewards: 24.696, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.060', 'AMMO5': '0.017', 'AMMO2': '0.047', 'AMMO3': '0.106', 'weapon5': '0.176', 'AMMO4': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.542', 'WEAPON3': '0.650', 'weapon4': '0.844', 'HITCOUNT': '1.760', 'weapon3': '1.916', 'DAMAGECOUNT': '6.615', 'FRAGCOUNT': '21.000'} [2023-02-24 19:15:18,942][177153] Updated weights for policy 0, policy_version 22950 (0.0008) [2023-02-24 19:15:21,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13789.9, 300 sec: 13815.3). Total num frames: 94035968. Throughput: 0: 3444.8. Samples: 23502746. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 19:15:21,376][177119] Avg episode reward: [(0, '19.845')] [2023-02-24 19:15:21,377][177140] Saving new best policy, reward=19.845! [2023-02-24 19:15:21,488][177172] DAMAGECOUNT value on done: 323160.0 [2023-02-24 19:15:21,488][177172] Sum rewards: 18.983, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.944', 'AMMO5': '0.017', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.123', 'weapon5': '0.124', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.718', 'weapon2': '0.810', 'WEAPON3': '0.850', 'HITCOUNT': '1.780', 'weapon3': '1.900', 'DAMAGECOUNT': '6.912', 'FRAGCOUNT': '18.000'} [2023-02-24 19:15:21,800][177172] DAMAGECOUNT value on done: 323942.0 [2023-02-24 19:15:21,801][177172] Sum rewards: 14.119, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.054', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.051', 'weapon5': '0.104', 'AMMO3': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.362', 'WEAPON3': '0.950', 'weapon2': '1.122', 'HITCOUNT': '1.240', 'weapon3': '2.058', 'DAMAGECOUNT': '4.812', 'FRAGCOUNT': '14.000'} [2023-02-24 19:15:21,971][177153] Updated weights for policy 0, policy_version 22960 (0.0008) [2023-02-24 19:15:22,901][177154] DAMAGECOUNT value on done: 328692.0 [2023-02-24 19:15:22,902][177154] Sum rewards: 12.198, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.640', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.043', 'AMMO3': '0.077', 'AMMO4': '0.214', 'WEAPON5': '0.300', 'weapon5': '0.342', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.714', 'HITCOUNT': '1.000', 'weapon2': '1.050', 'weapon3': '1.432', 'DAMAGECOUNT': '4.287', 'FRAGCOUNT': '10.000'} [2023-02-24 19:15:23,200][177154] DAMAGECOUNT value on done: 334998.0 [2023-02-24 19:15:23,200][177154] Sum rewards: 22.419, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.322', 'ARMOR': '0.004', 'AMMO2': '0.020', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.098', 'AMMO3': '0.150', 'weapon5': '0.316', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.576', 'WEAPON3': '0.900', 'weapon4': '1.008', 'HITCOUNT': '1.640', 'weapon3': '1.640', 'DAMAGECOUNT': '7.449', 'FRAGCOUNT': '22.000'} [2023-02-24 19:15:23,243][177172] DAMAGECOUNT value on done: 336643.0 [2023-02-24 19:15:23,243][177172] Sum rewards: 16.513, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.060', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'weapon7': '0.052', 'weapon5': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.104', 'weapon2': '0.124', 'WEAPON5': '0.200', 'WEAPON3': '0.750', 'weapon4': '0.958', 'HITCOUNT': '1.010', 'weapon3': '1.676', 'DAMAGECOUNT': '4.968', 'FRAGCOUNT': '14.000'} [2023-02-24 19:15:23,495][177154] DAMAGECOUNT value on done: 339139.0 [2023-02-24 19:15:23,496][177154] Sum rewards: 26.135, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.428', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'weapon7': '0.072', 'AMMO3': '0.092', 'AMMO4': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.432', 'weapon2': '0.620', 'WEAPON3': '0.650', 'HITCOUNT': '1.490', 'weapon3': '2.200', 'DAMAGECOUNT': '6.759', 'FRAGCOUNT': '22.000'} [2023-02-24 19:15:23,545][177172] DAMAGECOUNT value on done: 329154.0 [2023-02-24 19:15:23,545][177172] Sum rewards: 21.094, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.250', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.046', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'weapon5': '0.130', 'AMMO3': '0.141', 'WEAPON5': '0.200', 'WEAPON3': '0.850', 'weapon2': '1.182', 'HITCOUNT': '1.500', 'weapon3': '2.280', 'DAMAGECOUNT': '7.287', 'FRAGCOUNT': '18.000'} [2023-02-24 19:15:23,800][177154] DAMAGECOUNT value on done: 337370.0 [2023-02-24 19:15:23,801][177154] Sum rewards: 24.358, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.895', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon7': '0.074', 'AMMO3': '0.118', 'AMMO4': '0.133', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon5': '0.214', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.428', 'weapon4': '0.674', 'WEAPON3': '0.750', 'HITCOUNT': '1.570', 'weapon3': '1.952', 'DAMAGECOUNT': '6.171', 'FRAGCOUNT': '21.000'} [2023-02-24 19:15:23,947][177157] DAMAGECOUNT value on done: 335820.0 [2023-02-24 19:15:23,948][177157] Sum rewards: 23.613, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.710', 'AMMO5': '0.021', 'AMMO2': '0.048', 'AMMO3': '0.127', 'AMMO4': '0.239', 'weapon5': '0.328', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon2': '0.674', 'weapon4': '0.938', 'weapon3': '1.776', 'HITCOUNT': '1.910', 'DAMAGECOUNT': '8.562', 'FRAGCOUNT': '19.500'} [2023-02-24 19:15:24,250][177157] DAMAGECOUNT value on done: 321989.0 [2023-02-24 19:15:24,251][177157] Sum rewards: 17.720, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.005', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'AMMO3': '0.088', 'HEALTH': '0.090', 'weapon4': '0.116', 'weapon5': '0.146', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'weapon2': '0.894', 'HITCOUNT': '1.170', 'weapon3': '1.948', 'DAMAGECOUNT': '4.356', 'FRAGCOUNT': '14.000'} [2023-02-24 19:15:24,265][177157] DAMAGECOUNT value on done: 321934.0 [2023-02-24 19:15:24,265][177157] Sum rewards: 17.243, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.596', 'AMMO4': '-0.058', 'AMMO2': '-0.012', 'AMMO5': '0.013', 'WEAPON1': '0.030', 'AMMO3': '0.088', 'weapon5': '0.234', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '1.100', 'weapon2': '1.220', 'weapon3': '1.658', 'DAMAGECOUNT': '4.815', 'FRAGCOUNT': '13.000'} [2023-02-24 19:15:24,525][177171] DAMAGECOUNT value on done: 322289.0 [2023-02-24 19:15:24,526][177171] Sum rewards: 12.919, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.771', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.021', 'WEAPON1': '0.030', 'AMMO3': '0.126', 'weapon5': '0.228', 'WEAPON5': '0.250', 'WEAPON3': '0.850', 'weapon2': '1.010', 'HITCOUNT': '1.220', 'weapon3': '2.474', 'DAMAGECOUNT': '4.716', 'FRAGCOUNT': '11.000'} [2023-02-24 19:15:24,537][177171] DAMAGECOUNT value on done: 324570.0 [2023-02-24 19:15:24,538][177171] Sum rewards: 21.867, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-3.220', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'weapon4': '0.018', 'AMMO5': '0.026', 'WEAPON4': '0.100', 'AMMO3': '0.155', 'weapon5': '0.214', 'WEAPON5': '0.600', 'weapon2': '1.124', 'WEAPON3': '1.150', 'HITCOUNT': '1.250', 'weapon3': '2.340', 'DAMAGECOUNT': '6.120', 'FRAGCOUNT': '21.000'} [2023-02-24 19:15:24,573][177157] DAMAGECOUNT value on done: 326094.0 [2023-02-24 19:15:24,574][177157] Sum rewards: 16.630, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.865', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.074', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.290', 'WEAPON3': '0.700', 'weapon2': '0.880', 'HITCOUNT': '1.080', 'weapon3': '1.718', 'DAMAGECOUNT': '3.951', 'FRAGCOUNT': '15.000'} [2023-02-24 19:15:24,843][177171] DAMAGECOUNT value on done: 325947.0 [2023-02-24 19:15:24,843][177171] Sum rewards: 20.896, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.270', 'AMMO2': '0.006', 'AMMO5': '0.017', 'AMMO4': '0.031', 'WEAPON1': '0.040', 'AMMO3': '0.076', 'weapon5': '0.246', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'WEAPON5': '0.550', 'weapon4': '0.984', 'weapon3': '1.064', 'weapon2': '1.076', 'HITCOUNT': '1.420', 'DAMAGECOUNT': '5.655', 'FRAGCOUNT': '17.000'} [2023-02-24 19:15:24,854][177171] DAMAGECOUNT value on done: 329456.0 [2023-02-24 19:15:24,855][177171] Sum rewards: 19.120, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.876', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO5': '0.018', 'AMMO4': '0.083', 'AMMO3': '0.107', 'WEAPON4': '0.200', 'weapon5': '0.338', 'WEAPON5': '0.400', 'weapon4': '0.692', 'WEAPON3': '0.700', 'weapon2': '1.048', 'weapon3': '1.458', 'HITCOUNT': '1.640', 'DAMAGECOUNT': '7.035', 'FRAGCOUNT': '15.500'} [2023-02-24 19:15:24,982][177153] Updated weights for policy 0, policy_version 22970 (0.0008) [2023-02-24 19:15:26,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13789.9, 300 sec: 13801.4). Total num frames: 94101504. Throughput: 0: 3440.1. Samples: 23523252. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 19:15:26,376][177119] Avg episode reward: [(0, '19.946')] [2023-02-24 19:15:26,379][177140] Saving new best policy, reward=19.946! [2023-02-24 19:15:26,728][177155] DAMAGECOUNT value on done: 333792.0 [2023-02-24 19:15:26,728][177155] Sum rewards: 22.952, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.590', 'AMMO2': '0.007', 'AMMO5': '0.014', 'AMMO4': '0.034', 'WEAPON1': '0.040', 'AMMO3': '0.145', 'weapon5': '0.290', 'WEAPON5': '0.500', 'weapon2': '0.514', 'WEAPON3': '1.050', 'HITCOUNT': '1.430', 'weapon3': '2.776', 'DAMAGECOUNT': '6.741', 'FRAGCOUNT': '20.000'} [2023-02-24 19:15:27,025][177155] DAMAGECOUNT value on done: 341934.0 [2023-02-24 19:15:27,025][177155] Sum rewards: 23.321, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.625', 'AMMO5': '0.015', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'AMMO4': '0.104', 'AMMO3': '0.122', 'WEAPON4': '0.200', 'weapon4': '0.248', 'weapon5': '0.298', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'weapon2': '1.118', 'HITCOUNT': '1.600', 'weapon3': '1.854', 'DAMAGECOUNT': '6.786', 'FRAGCOUNT': '21.000'} [2023-02-24 19:15:27,322][177155] DAMAGECOUNT value on done: 337400.0 [2023-02-24 19:15:27,322][177155] Sum rewards: 22.168, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.566', 'AMMO2': '0.010', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.047', 'weapon7': '0.068', 'AMMO3': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'weapon4': '0.682', 'WEAPON3': '0.700', 'weapon2': '0.764', 'HITCOUNT': '1.310', 'weapon3': '1.758', 'DAMAGECOUNT': '5.157', 'FRAGCOUNT': '18.000'} [2023-02-24 19:15:27,622][177155] DAMAGECOUNT value on done: 321677.0 [2023-02-24 19:15:27,623][177155] Sum rewards: 22.534, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.552', 'AMMO5': '0.015', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'AMMO4': '0.088', 'weapon5': '0.122', 'AMMO3': '0.161', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon2': '0.716', 'weapon4': '0.742', 'WEAPON3': '1.000', 'HITCOUNT': '1.540', 'weapon3': '2.072', 'DAMAGECOUNT': '6.822', 'FRAGCOUNT': '21.000'} [2023-02-24 19:15:27,943][177153] Updated weights for policy 0, policy_version 22980 (0.0008) [2023-02-24 19:15:30,876][177153] Updated weights for policy 0, policy_version 22990 (0.0008) [2023-02-24 19:15:31,376][177119] Fps is (10 sec: 13516.7, 60 sec: 13789.9, 300 sec: 13801.4). Total num frames: 94171136. Throughput: 0: 3445.0. Samples: 23544060. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 19:15:31,376][177119] Avg episode reward: [(0, '20.089')] [2023-02-24 19:15:31,377][177140] Saving new best policy, reward=20.089! [2023-02-24 19:15:33,834][177153] Updated weights for policy 0, policy_version 23000 (0.0009) [2023-02-24 19:15:34,240][177170] DAMAGECOUNT value on done: 327420.0 [2023-02-24 19:15:34,241][177170] Sum rewards: 13.638, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.268', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.056', 'AMMO3': '0.060', 'AMMO4': '0.280', 'weapon5': '0.334', 'WEAPON3': '0.350', 'WEAPON5': '0.550', 'WEAPON4': '0.550', 'weapon4': '0.652', 'weapon2': '0.930', 'HITCOUNT': '1.090', 'weapon3': '1.190', 'DAMAGECOUNT': '4.833', 'FRAGCOUNT': '12.000'} [2023-02-24 19:15:34,543][177170] DAMAGECOUNT value on done: 327988.0 [2023-02-24 19:15:34,544][177170] Sum rewards: 17.618, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.312', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.083', 'weapon5': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'weapon7': '0.230', 'weapon4': '0.364', 'WEAPON3': '0.550', 'HITCOUNT': '0.960', 'weapon2': '1.038', 'weapon3': '1.764', 'DAMAGECOUNT': '4.314', 'FRAGCOUNT': '14.000'} [2023-02-24 19:15:35,302][177170] DAMAGECOUNT value on done: 324936.0 [2023-02-24 19:15:35,303][177170] Sum rewards: 19.279, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.414', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.021', 'AMMO3': '0.101', 'AMMO4': '0.104', 'weapon5': '0.250', 'weapon4': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'weapon2': '0.802', 'HITCOUNT': '1.550', 'weapon3': '2.220', 'DAMAGECOUNT': '5.589', 'FRAGCOUNT': '18.000'} [2023-02-24 19:15:35,598][177170] DAMAGECOUNT value on done: 329238.0 [2023-02-24 19:15:35,598][177170] Sum rewards: 11.511, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.720', 'AMMO2': '0.005', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.025', 'AMMO3': '0.053', 'WEAPON4': '0.100', 'weapon7': '0.110', 'weapon5': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.680', 'weapon2': '0.722', 'weapon4': '1.146', 'weapon3': '1.304', 'DAMAGECOUNT': '2.550', 'FRAGCOUNT': '8.000'} [2023-02-24 19:15:36,343][177156] DAMAGECOUNT value on done: 330491.0 [2023-02-24 19:15:36,343][177156] Sum rewards: 27.084, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.141', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'weapon5': '0.212', 'WEAPON5': '0.350', 'weapon4': '0.514', 'WEAPON3': '0.700', 'weapon2': '1.146', 'weapon3': '1.622', 'HITCOUNT': '1.650', 'DAMAGECOUNT': '7.170', 'FRAGCOUNT': '22.000'} [2023-02-24 19:15:36,353][177156] DAMAGECOUNT value on done: 322129.0 [2023-02-24 19:15:36,354][177156] Sum rewards: 19.602, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.332', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.139', 'weapon4': '0.216', 'weapon5': '0.240', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'weapon2': '1.048', 'HITCOUNT': '1.310', 'weapon3': '1.626', 'DAMAGECOUNT': '5.946', 'FRAGCOUNT': '18.000'} [2023-02-24 19:15:36,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13815.3). Total num frames: 94240768. Throughput: 0: 3443.2. Samples: 23554344. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:15:36,376][177119] Avg episode reward: [(0, '20.091')] [2023-02-24 19:15:36,379][177140] Saving new best policy, reward=20.091! [2023-02-24 19:15:36,665][177156] DAMAGECOUNT value on done: 338972.0 [2023-02-24 19:15:36,666][177156] Sum rewards: 24.522, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.462', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'AMMO3': '0.083', 'AMMO4': '0.137', 'WEAPON4': '0.300', 'weapon5': '0.308', 'WEAPON5': '0.450', 'weapon4': '0.590', 'WEAPON3': '0.650', 'weapon2': '0.810', 'HITCOUNT': '1.340', 'weapon3': '1.942', 'DAMAGECOUNT': '6.561', 'FRAGCOUNT': '21.000'} [2023-02-24 19:15:36,675][177156] DAMAGECOUNT value on done: 321538.0 [2023-02-24 19:15:36,676][177156] Sum rewards: 14.551, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.103', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon7': '0.048', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.128', 'AMMO3': '0.131', 'weapon5': '0.156', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.750', 'weapon2': '0.884', 'weapon4': '0.920', 'HITCOUNT': '1.210', 'weapon3': '1.576', 'DAMAGECOUNT': '4.908', 'FRAGCOUNT': '13.000'} [2023-02-24 19:15:36,836][177153] Updated weights for policy 0, policy_version 23010 (0.0008) [2023-02-24 19:15:36,860][177158] DAMAGECOUNT value on done: 317018.0 [2023-02-24 19:15:36,861][177158] Sum rewards: 24.738, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.394', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO4': '0.035', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'weapon4': '0.204', 'weapon5': '0.360', 'WEAPON5': '0.600', 'WEAPON3': '1.000', 'weapon2': '1.046', 'HITCOUNT': '1.580', 'weapon3': '2.020', 'DAMAGECOUNT': '7.953', 'FRAGCOUNT': '21.000'} [2023-02-24 19:15:37,159][177158] DAMAGECOUNT value on done: 321831.0 [2023-02-24 19:15:37,159][177158] Sum rewards: 11.877, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.530', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO5': '0.015', 'AMMO4': '0.065', 'AMMO3': '0.145', 'weapon5': '0.174', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.614', 'WEAPON3': '0.850', 'weapon4': '1.174', 'weapon3': '1.666', 'HITCOUNT': '1.710', 'DAMAGECOUNT': '5.721', 'FRAGCOUNT': '11.000'} [2023-02-24 19:15:37,451][177158] DAMAGECOUNT value on done: 331891.0 [2023-02-24 19:15:37,451][177158] Sum rewards: 16.738, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.856', 'AMMO5': '0.022', 'AMMO2': '0.025', 'WEAPON1': '0.050', 'AMMO4': '0.127', 'AMMO3': '0.133', 'WEAPON4': '0.250', 'weapon4': '0.426', 'weapon5': '0.434', 'WEAPON5': '0.550', 'weapon2': '0.572', 'WEAPON3': '0.850', 'HITCOUNT': '1.630', 'weapon3': '2.058', 'DAMAGECOUNT': '6.966', 'FRAGCOUNT': '15.500'} [2023-02-24 19:15:37,755][177158] DAMAGECOUNT value on done: 331195.0 [2023-02-24 19:15:37,756][177158] Sum rewards: 25.348, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.942', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.084', 'WEAPON4': '0.200', 'weapon5': '0.260', 'WEAPON5': '0.350', 'weapon4': '0.474', 'WEAPON3': '0.550', 'weapon3': '1.234', 'HITCOUNT': '1.380', 'weapon2': '1.598', 'DAMAGECOUNT': '6.297', 'FRAGCOUNT': '19.000'} [2023-02-24 19:15:39,794][177153] Updated weights for policy 0, policy_version 23020 (0.0008) [2023-02-24 19:15:41,050][177172] DAMAGECOUNT value on done: 324925.0 [2023-02-24 19:15:41,051][177172] Sum rewards: 13.424, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.077', 'AMMO2': '0.019', 'AMMO5': '0.020', 'AMMO4': '0.097', 'AMMO3': '0.187', 'weapon5': '0.192', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.512', 'weapon4': '0.526', 'WEAPON3': '1.050', 'HITCOUNT': '1.330', 'weapon3': '2.422', 'DAMAGECOUNT': '5.295', 'FRAGCOUNT': '15.000'} [2023-02-24 19:15:41,353][177172] DAMAGECOUNT value on done: 326069.0 [2023-02-24 19:15:41,354][177172] Sum rewards: 18.097, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.200', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.016', 'AMMO4': '0.080', 'AMMO3': '0.113', 'WEAPON4': '0.250', 'weapon5': '0.394', 'WEAPON5': '0.400', 'weapon4': '0.414', 'weapon2': '0.634', 'WEAPON3': '0.700', 'HITCOUNT': '1.320', 'weapon3': '1.820', 'DAMAGECOUNT': '6.381', 'FRAGCOUNT': '15.000'} [2023-02-24 19:15:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13815.3). Total num frames: 94310400. Throughput: 0: 3441.6. Samples: 23574952. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:15:41,376][177119] Avg episode reward: [(0, '20.109')] [2023-02-24 19:15:41,377][177140] Saving new best policy, reward=20.109! [2023-02-24 19:15:42,412][177172] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 19:15:42,463][177154] DAMAGECOUNT value on done: 330399.0 [2023-02-24 19:15:42,464][177154] Sum rewards: 19.371, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.520', 'AMMO2': '0.019', 'AMMO5': '0.025', 'WEAPON1': '0.050', 'AMMO4': '0.093', 'AMMO3': '0.127', 'weapon4': '0.232', 'WEAPON4': '0.250', 'weapon5': '0.306', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'weapon2': '1.076', 'HITCOUNT': '1.210', 'weapon3': '2.082', 'DAMAGECOUNT': '5.121', 'FRAGCOUNT': '18.000'} [2023-02-24 19:15:42,764][177154] DAMAGECOUNT value on done: 337158.0 [2023-02-24 19:15:42,764][177154] Sum rewards: 25.827, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.100', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.022', 'AMMO3': '0.099', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.111', 'weapon5': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.538', 'WEAPON3': '0.650', 'weapon2': '1.172', 'HITCOUNT': '1.440', 'weapon3': '1.740', 'DAMAGECOUNT': '6.480', 'FRAGCOUNT': '21.000'} [2023-02-24 19:15:42,780][177153] Updated weights for policy 0, policy_version 23030 (0.0008) [2023-02-24 19:15:42,807][177172] DAMAGECOUNT value on done: 338498.0 [2023-02-24 19:15:42,808][177172] Sum rewards: 21.528, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.540', 'AMMO2': '0.019', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.093', 'AMMO3': '0.110', 'WEAPON4': '0.200', 'weapon5': '0.280', 'weapon4': '0.432', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon2': '1.042', 'HITCOUNT': '1.350', 'weapon3': '1.838', 'DAMAGECOUNT': '5.565', 'FRAGCOUNT': '17.500'} [2023-02-24 19:15:43,056][177154] DAMAGECOUNT value on done: 341430.0 [2023-02-24 19:15:43,057][177154] Sum rewards: 23.300, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.836', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.033', 'WEAPON1': '0.050', 'AMMO3': '0.114', 'AMMO4': '0.165', 'weapon5': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.494', 'WEAPON3': '0.800', 'weapon2': '1.222', 'weapon3': '1.728', 'HITCOUNT': '1.850', 'DAMAGECOUNT': '6.873', 'FRAGCOUNT': '19.000'} [2023-02-24 19:15:43,103][177172] DAMAGECOUNT value on done: 330902.0 [2023-02-24 19:15:43,104][177172] Sum rewards: 14.218, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.176', 'weapon7': '0.002', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.118', 'AMMO4': '0.146', 'AMMO3': '0.148', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.382', 'WEAPON4': '0.400', 'weapon2': '0.692', 'WEAPON3': '0.950', 'HITCOUNT': '1.300', 'weapon3': '2.260', 'DAMAGECOUNT': '5.244', 'FRAGCOUNT': '15.000'} [2023-02-24 19:15:43,358][177154] DAMAGECOUNT value on done: 339968.0 [2023-02-24 19:15:43,358][177154] Sum rewards: 25.928, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.553', 'weapon7': '0.002', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO5': '0.022', 'AMMO4': '0.089', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.160', 'weapon5': '0.182', 'WEAPON4': '0.200', 'weapon4': '0.284', 'WEAPON5': '0.450', 'weapon2': '0.534', 'WEAPON3': '1.000', 'HITCOUNT': '1.930', 'weapon3': '2.506', 'DAMAGECOUNT': '7.794', 'FRAGCOUNT': '23.000'} [2023-02-24 19:15:43,506][177157] DAMAGECOUNT value on done: 337070.0 [2023-02-24 19:15:43,506][177157] Sum rewards: 15.443, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.880', 'AMMO5': '0.015', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.040', 'AMMO4': '0.122', 'WEAPON3': '0.250', 'weapon5': '0.258', 'weapon4': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'HITCOUNT': '0.850', 'weapon3': '0.986', 'weapon2': '1.268', 'DAMAGECOUNT': '3.750', 'FRAGCOUNT': '13.000'} [2023-02-24 19:15:43,798][177157] DAMAGECOUNT value on done: 323172.0 [2023-02-24 19:15:43,798][177157] Sum rewards: 15.531, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.831', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon7': '0.060', 'AMMO3': '0.092', 'AMMO4': '0.105', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.550', 'weapon2': '0.606', 'HITCOUNT': '0.940', 'weapon4': '1.308', 'weapon3': '1.454', 'DAMAGECOUNT': '3.714', 'FRAGCOUNT': '14.000'} [2023-02-24 19:15:43,807][177157] DAMAGECOUNT value on done: 323623.0 [2023-02-24 19:15:43,808][177157] Sum rewards: 17.733, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.053', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'weapon5': '0.162', 'weapon4': '0.470', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'HITCOUNT': '1.140', 'weapon2': '1.256', 'weapon3': '1.550', 'DAMAGECOUNT': '4.902', 'FRAGCOUNT': '16.000'} [2023-02-24 19:15:43,991][177171] DAMAGECOUNT value on done: 323694.0 [2023-02-24 19:15:43,991][177171] Sum rewards: 13.657, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.262', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.047', 'AMMO3': '0.098', 'WEAPON4': '0.150', 'weapon5': '0.268', 'WEAPON5': '0.450', 'weapon4': '0.564', 'WEAPON3': '0.600', 'weapon2': '0.796', 'HITCOUNT': '1.140', 'weapon3': '1.554', 'DAMAGECOUNT': '4.215', 'FRAGCOUNT': '10.000'} [2023-02-24 19:15:44,001][177171] DAMAGECOUNT value on done: 325682.0 [2023-02-24 19:15:44,002][177171] Sum rewards: 9.841, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.353', 'AMMO5': '0.013', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'weapon7': '0.062', 'AMMO3': '0.076', 'AMMO4': '0.097', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.190', 'WEAPON7': '0.200', 'weapon4': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'HITCOUNT': '0.820', 'weapon3': '1.300', 'weapon2': '1.632', 'DAMAGECOUNT': '3.336', 'FRAGCOUNT': '10.000'} [2023-02-24 19:15:44,105][177157] DAMAGECOUNT value on done: 329131.0 [2023-02-24 19:15:44,105][177157] Sum rewards: 29.952, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.658', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.028', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.157', 'weapon5': '0.222', 'WEAPON5': '0.350', 'weapon4': '0.394', 'weapon2': '0.700', 'WEAPON3': '0.950', 'HITCOUNT': '1.720', 'weapon3': '2.160', 'DAMAGECOUNT': '9.111', 'FRAGCOUNT': '25.000'} [2023-02-24 19:15:44,297][177171] DAMAGECOUNT value on done: 327792.0 [2023-02-24 19:15:44,297][177171] Sum rewards: 18.636, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.440', 'AMMO5': '0.017', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'AMMO4': '0.098', 'weapon5': '0.156', 'AMMO3': '0.163', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.580', 'WEAPON3': '0.950', 'weapon4': '1.022', 'HITCOUNT': '1.550', 'weapon3': '1.894', 'DAMAGECOUNT': '5.535', 'FRAGCOUNT': '18.000'} [2023-02-24 19:15:44,310][177171] DAMAGECOUNT value on done: 330314.0 [2023-02-24 19:15:44,311][177171] Sum rewards: 9.394, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.320', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.028', 'AMMO2': '0.029', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.118', 'AMMO4': '0.143', 'WEAPON3': '0.200', 'WEAPON5': '0.300', 'weapon3': '0.336', 'weapon2': '0.410', 'WEAPON4': '0.450', 'HITCOUNT': '0.450', 'weapon4': '2.068', 'DAMAGECOUNT': '2.274', 'FRAGCOUNT': '8.000'} [2023-02-24 19:15:45,722][177153] Updated weights for policy 0, policy_version 23040 (0.0008) [2023-02-24 19:15:46,243][177155] DAMAGECOUNT value on done: 336104.0 [2023-02-24 19:15:46,243][177155] Sum rewards: 24.270, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.318', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.030', 'AMMO3': '0.095', 'AMMO4': '0.148', 'weapon5': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.448', 'WEAPON3': '0.650', 'weapon2': '0.796', 'HITCOUNT': '1.390', 'weapon3': '1.720', 'DAMAGECOUNT': '6.936', 'FRAGCOUNT': '20.000'} [2023-02-24 19:15:46,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13815.3). Total num frames: 94380032. Throughput: 0: 3443.6. Samples: 23595582. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:15:46,376][177119] Avg episode reward: [(0, '19.770')] [2023-02-24 19:15:46,550][177155] DAMAGECOUNT value on done: 343517.0 [2023-02-24 19:15:46,550][177155] Sum rewards: 15.940, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.840', 'AMMO2': '0.006', 'AMMO5': '0.011', 'AMMO4': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.135', 'weapon4': '0.180', 'weapon5': '0.260', 'WEAPON5': '0.300', 'WEAPON3': '0.900', 'weapon2': '1.108', 'HITCOUNT': '1.150', 'weapon3': '2.100', 'DAMAGECOUNT': '4.749', 'FRAGCOUNT': '15.000'} [2023-02-24 19:15:46,845][177155] DAMAGECOUNT value on done: 339847.0 [2023-02-24 19:15:46,845][177155] Sum rewards: 17.415, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.888', 'AMMO5': '0.017', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'weapon5': '0.264', 'WEAPON5': '0.350', 'weapon2': '0.372', 'weapon4': '0.600', 'WEAPON3': '1.050', 'HITCOUNT': '1.840', 'weapon3': '2.400', 'DAMAGECOUNT': '7.341', 'FRAGCOUNT': '17.000'} [2023-02-24 19:15:47,148][177155] DAMAGECOUNT value on done: 323599.0 [2023-02-24 19:15:47,149][177155] Sum rewards: 21.757, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.356', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'AMMO5': '0.021', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'weapon4': '0.066', 'AMMO3': '0.129', 'weapon5': '0.310', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'weapon2': '1.226', 'HITCOUNT': '1.340', 'weapon3': '2.036', 'DAMAGECOUNT': '5.766', 'FRAGCOUNT': '18.000'} [2023-02-24 19:15:48,688][177153] Updated weights for policy 0, policy_version 23050 (0.0008) [2023-02-24 19:15:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13815.3). Total num frames: 94449664. Throughput: 0: 3446.7. Samples: 23605960. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 19:15:51,376][177119] Avg episode reward: [(0, '19.606')] [2023-02-24 19:15:51,644][177153] Updated weights for policy 0, policy_version 23060 (0.0008) [2023-02-24 19:15:53,777][177170] DAMAGECOUNT value on done: 329406.0 [2023-02-24 19:15:53,777][177170] Sum rewards: 22.490, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.108', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.129', 'AMMO4': '0.175', 'weapon5': '0.184', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.562', 'weapon2': '0.668', 'WEAPON3': '0.850', 'HITCOUNT': '1.580', 'weapon3': '2.282', 'DAMAGECOUNT': '5.958', 'FRAGCOUNT': '22.000'} [2023-02-24 19:15:54,075][177170] DAMAGECOUNT value on done: 330923.0 [2023-02-24 19:15:54,076][177170] Sum rewards: 32.227, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.256', 'AMMO2': '0.011', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'AMMO4': '0.055', 'AMMO3': '0.109', 'WEAPON4': '0.300', 'weapon4': '0.374', 'weapon5': '0.418', 'WEAPON5': '0.500', 'weapon2': '0.706', 'WEAPON3': '0.800', 'HITCOUNT': '1.990', 'weapon3': '2.108', 'DAMAGECOUNT': '8.805', 'FRAGCOUNT': '28.000'} [2023-02-24 19:15:54,613][177153] Updated weights for policy 0, policy_version 23070 (0.0009) [2023-02-24 19:15:54,797][177170] DAMAGECOUNT value on done: 326505.0 [2023-02-24 19:15:54,798][177170] Sum rewards: 13.591, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO3': '0.088', 'AMMO4': '0.136', 'WEAPON4': '0.300', 'HEALTH': '0.306', 'WEAPON5': '0.350', 'weapon5': '0.380', 'WEAPON3': '0.450', 'weapon2': '0.494', 'weapon4': '1.066', 'weapon3': '1.242', 'HITCOUNT': '1.280', 'DAMAGECOUNT': '4.707', 'FRAGCOUNT': '11.000'} [2023-02-24 19:15:55,101][177170] DAMAGECOUNT value on done: 331763.0 [2023-02-24 19:15:55,101][177170] Sum rewards: 30.441, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.880', 'AMMO2': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.050', 'AMMO3': '0.090', 'WEAPON4': '0.150', 'weapon4': '0.242', 'weapon5': '0.310', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'weapon2': '1.000', 'HITCOUNT': '1.870', 'weapon3': '2.156', 'DAMAGECOUNT': '7.575', 'FRAGCOUNT': '25.000'} [2023-02-24 19:15:55,863][177156] DAMAGECOUNT value on done: 332404.0 [2023-02-24 19:15:55,864][177156] Sum rewards: 21.080, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.114', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.114', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'weapon7': '0.210', 'weapon5': '0.234', 'WEAPON5': '0.350', 'weapon4': '0.438', 'weapon2': '0.730', 'WEAPON3': '0.750', 'HITCOUNT': '1.400', 'weapon3': '1.754', 'DAMAGECOUNT': '5.739', 'FRAGCOUNT': '18.000'} [2023-02-24 19:15:55,875][177156] DAMAGECOUNT value on done: 323991.0 [2023-02-24 19:15:55,876][177156] Sum rewards: 19.249, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.983', 'AMMO5': '0.013', 'AMMO2': '0.014', 'WEAPON1': '0.050', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'weapon4': '0.226', 'weapon5': '0.266', 'WEAPON5': '0.350', 'weapon2': '0.840', 'WEAPON3': '0.850', 'HITCOUNT': '1.470', 'weapon3': '2.266', 'DAMAGECOUNT': '5.586', 'FRAGCOUNT': '18.000'} [2023-02-24 19:15:56,174][177156] DAMAGECOUNT value on done: 341490.0 [2023-02-24 19:15:56,175][177156] Sum rewards: 24.460, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.830', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO5': '0.025', 'AMMO3': '0.077', 'AMMO4': '0.106', 'weapon5': '0.340', 'WEAPON4': '0.500', 'WEAPON3': '0.550', 'weapon2': '0.568', 'WEAPON5': '0.650', 'weapon4': '1.102', 'weapon3': '1.326', 'HITCOUNT': '1.950', 'DAMAGECOUNT': '7.554', 'FRAGCOUNT': '20.500'} [2023-02-24 19:15:56,186][177156] DAMAGECOUNT value on done: 324203.0 [2023-02-24 19:15:56,187][177156] Sum rewards: 23.844, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.388', 'WEAPON1': '0.010', 'AMMO5': '0.025', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.138', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.450', 'weapon2': '0.496', 'weapon4': '0.514', 'WEAPON3': '1.100', 'HITCOUNT': '1.930', 'weapon3': '2.542', 'DAMAGECOUNT': '7.995', 'FRAGCOUNT': '23.000'} [2023-02-24 19:15:56,261][177171] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-24 19:15:56,265][177158] DAMAGECOUNT value on done: 318687.0 [2023-02-24 19:15:56,266][177158] Sum rewards: 19.623, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.885', 'AMMO2': '0.008', 'AMMO5': '0.020', 'AMMO4': '0.038', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.095', 'weapon4': '0.220', 'weapon5': '0.232', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '1.160', 'weapon2': '1.256', 'weapon3': '1.922', 'DAMAGECOUNT': '5.007', 'FRAGCOUNT': '16.000'} [2023-02-24 19:15:56,376][177119] Fps is (10 sec: 13516.5, 60 sec: 13721.6, 300 sec: 13801.4). Total num frames: 94515200. Throughput: 0: 3446.2. Samples: 23626700. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 19:15:56,377][177119] Avg episode reward: [(0, '19.799')] [2023-02-24 19:15:56,573][177158] DAMAGECOUNT value on done: 323135.0 [2023-02-24 19:15:56,573][177158] Sum rewards: 15.091, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.857', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO3': '0.060', 'WEAPON4': '0.250', 'weapon5': '0.258', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.716', 'HITCOUNT': '0.950', 'weapon2': '1.278', 'weapon3': '1.280', 'DAMAGECOUNT': '3.912', 'FRAGCOUNT': '12.000'} [2023-02-24 19:15:56,874][177158] DAMAGECOUNT value on done: 332589.0 [2023-02-24 19:15:56,874][177158] Sum rewards: 9.341, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO3': '0.024', 'WEAPON4': '0.050', 'weapon7': '0.064', 'AMMO4': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.114', 'WEAPON3': '0.150', 'HEALTH': '0.286', 'weapon3': '0.472', 'HITCOUNT': '0.480', 'weapon2': '0.882', 'weapon4': '1.450', 'DAMAGECOUNT': '2.094', 'FRAGCOUNT': '5.000'} [2023-02-24 19:15:57,175][177158] DAMAGECOUNT value on done: 332847.0 [2023-02-24 19:15:57,175][177158] Sum rewards: 13.467, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.374', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'weapon7': '0.088', 'AMMO3': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.157', 'WEAPON7': '0.200', 'weapon5': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.376', 'WEAPON3': '0.600', 'weapon3': '1.222', 'HITCOUNT': '1.330', 'weapon4': '1.644', 'DAMAGECOUNT': '4.956', 'FRAGCOUNT': '12.000'} [2023-02-24 19:15:57,599][177153] Updated weights for policy 0, policy_version 23080 (0.0008) [2023-02-24 19:16:00,486][177172] DAMAGECOUNT value on done: 327135.0 [2023-02-24 19:16:00,487][177172] Sum rewards: 21.429, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.005', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'weapon4': '0.124', 'AMMO3': '0.141', 'weapon5': '0.248', 'WEAPON5': '0.300', 'weapon2': '0.898', 'WEAPON3': '0.900', 'HITCOUNT': '1.710', 'weapon3': '2.322', 'DAMAGECOUNT': '6.630', 'FRAGCOUNT': '18.000'} [2023-02-24 19:16:00,548][177153] Updated weights for policy 0, policy_version 23090 (0.0009) [2023-02-24 19:16:00,784][177172] DAMAGECOUNT value on done: 327193.0 [2023-02-24 19:16:00,784][177172] Sum rewards: 11.661, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.610', 'AMMO2': '0.006', 'ARMOR': '0.008', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.032', 'AMMO3': '0.092', 'WEAPON4': '0.200', 'weapon5': '0.262', 'weapon4': '0.338', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.840', 'weapon2': '0.918', 'weapon3': '1.318', 'DAMAGECOUNT': '3.372', 'FRAGCOUNT': '10.000'} [2023-02-24 19:16:01,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13789.9, 300 sec: 13801.4). Total num frames: 94584832. Throughput: 0: 3446.1. Samples: 23647434. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 19:16:01,376][177119] Avg episode reward: [(0, '19.371')] [2023-02-24 19:16:01,917][177154] DAMAGECOUNT value on done: 332247.0 [2023-02-24 19:16:01,917][177154] Sum rewards: 17.552, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.330', 'AMMO2': '0.003', 'AMMO5': '0.013', 'AMMO4': '0.017', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.073', 'weapon5': '0.280', 'weapon4': '0.296', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'weapon2': '1.066', 'HITCOUNT': '1.160', 'weapon3': '1.612', 'DAMAGECOUNT': '5.541', 'FRAGCOUNT': '13.000'} [2023-02-24 19:16:02,216][177154] DAMAGECOUNT value on done: 339402.0 [2023-02-24 19:16:02,217][177154] Sum rewards: 24.182, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.508', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO5': '0.027', 'AMMO2': '0.059', 'AMMO3': '0.115', 'weapon5': '0.172', 'weapon2': '0.288', 'AMMO4': '0.293', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'weapon4': '0.992', 'HITCOUNT': '1.700', 'weapon3': '1.888', 'DAMAGECOUNT': '6.732', 'FRAGCOUNT': '22.000'} [2023-02-24 19:16:02,235][177172] DAMAGECOUNT value on done: 340519.0 [2023-02-24 19:16:02,236][177172] Sum rewards: 18.165, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.179', 'AMMO5': '0.025', 'AMMO2': '0.053', 'weapon5': '0.146', 'AMMO3': '0.151', 'AMMO4': '0.266', 'WEAPON5': '0.400', 'ARMOR': '0.455', 'WEAPON4': '0.500', 'weapon2': '0.520', 'weapon4': '0.846', 'WEAPON3': '0.900', 'HITCOUNT': '1.400', 'weapon3': '2.118', 'DAMAGECOUNT': '6.063', 'FRAGCOUNT': '19.000'} [2023-02-24 19:16:02,517][177154] DAMAGECOUNT value on done: 343174.0 [2023-02-24 19:16:02,517][177154] Sum rewards: 12.614, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.303', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO5': '0.027', 'AMMO2': '0.031', 'AMMO3': '0.149', 'AMMO4': '0.155', 'WEAPON4': '0.250', 'weapon5': '0.282', 'weapon4': '0.284', 'WEAPON5': '0.550', 'weapon2': '0.752', 'WEAPON3': '0.800', 'HITCOUNT': '1.180', 'weapon3': '2.200', 'DAMAGECOUNT': '5.232', 'FRAGCOUNT': '13.000'} [2023-02-24 19:16:02,534][177172] DAMAGECOUNT value on done: 333114.0 [2023-02-24 19:16:02,535][177172] Sum rewards: 21.874, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.476', 'AMMO2': '0.026', 'AMMO5': '0.032', 'WEAPON1': '0.040', 'AMMO3': '0.111', 'AMMO4': '0.131', 'weapon4': '0.208', 'WEAPON4': '0.300', 'weapon5': '0.340', 'WEAPON5': '0.750', 'weapon2': '0.772', 'WEAPON3': '0.800', 'HITCOUNT': '1.750', 'weapon3': '2.204', 'DAMAGECOUNT': '6.636', 'FRAGCOUNT': '19.000'} [2023-02-24 19:16:02,816][177154] DAMAGECOUNT value on done: 342520.0 [2023-02-24 19:16:02,817][177154] Sum rewards: 25.521, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.655', 'AMMO2': '0.010', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.049', 'weapon7': '0.074', 'AMMO3': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.270', 'weapon4': '0.288', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'weapon2': '0.816', 'HITCOUNT': '1.630', 'weapon3': '1.732', 'DAMAGECOUNT': '7.581', 'FRAGCOUNT': '19.000'} [2023-02-24 19:16:02,937][177157] DAMAGECOUNT value on done: 339298.0 [2023-02-24 19:16:02,937][177157] Sum rewards: 17.218, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.744', 'AMMO5': '0.020', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.138', 'AMMO3': '0.187', 'WEAPON4': '0.400', 'weapon4': '0.496', 'WEAPON5': '0.500', 'weapon2': '0.582', 'WEAPON3': '1.100', 'HITCOUNT': '1.620', 'weapon3': '2.344', 'DAMAGECOUNT': '6.684', 'FRAGCOUNT': '19.000'} [2023-02-24 19:16:03,238][177157] DAMAGECOUNT value on done: 325287.0 [2023-02-24 19:16:03,238][177157] Sum rewards: 18.907, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.924', 'AMMO5': '0.026', 'AMMO2': '0.030', 'AMMO3': '0.139', 'AMMO4': '0.149', 'weapon5': '0.280', 'WEAPON4': '0.350', 'weapon4': '0.500', 'WEAPON5': '0.700', 'WEAPON3': '0.850', 'weapon2': '1.120', 'HITCOUNT': '1.770', 'weapon3': '1.822', 'DAMAGECOUNT': '6.345', 'FRAGCOUNT': '17.000'} [2023-02-24 19:16:03,248][177157] DAMAGECOUNT value on done: 326010.0 [2023-02-24 19:16:03,249][177157] Sum rewards: 31.424, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.650', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.104', 'AMMO3': '0.115', 'AMMO4': '0.166', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.436', 'WEAPON3': '0.800', 'weapon4': '0.986', 'weapon3': '1.834', 'HITCOUNT': '1.960', 'DAMAGECOUNT': '7.161', 'FRAGCOUNT': '29.000'} [2023-02-24 19:16:03,462][177171] DAMAGECOUNT value on done: 326493.0 [2023-02-24 19:16:03,463][177171] Sum rewards: 34.174, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.628', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.169', 'weapon5': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.512', 'weapon2': '0.668', 'WEAPON3': '1.050', 'HITCOUNT': '1.970', 'weapon3': '2.266', 'DAMAGECOUNT': '8.190', 'FRAGCOUNT': '32.000'} [2023-02-24 19:16:03,474][177171] DAMAGECOUNT value on done: 327392.0 [2023-02-24 19:16:03,475][177171] Sum rewards: 17.406, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.748', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO5': '0.020', 'AMMO3': '0.088', 'AMMO4': '0.093', 'weapon5': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.652', 'weapon2': '0.936', 'HITCOUNT': '1.490', 'weapon3': '1.692', 'DAMAGECOUNT': '5.130', 'FRAGCOUNT': '17.000'} [2023-02-24 19:16:03,535][177153] Updated weights for policy 0, policy_version 23100 (0.0008) [2023-02-24 19:16:03,552][177157] DAMAGECOUNT value on done: 331158.0 [2023-02-24 19:16:03,553][177157] Sum rewards: 24.735, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.215', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon7': '0.076', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.138', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.266', 'WEAPON5': '0.350', 'weapon4': '0.506', 'WEAPON3': '0.700', 'weapon2': '0.828', 'HITCOUNT': '1.500', 'weapon3': '1.902', 'DAMAGECOUNT': '6.081', 'FRAGCOUNT': '21.000'} [2023-02-24 19:16:03,776][177171] DAMAGECOUNT value on done: 329936.0 [2023-02-24 19:16:03,777][177171] Sum rewards: 22.519, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.209', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO3': '0.080', 'WEAPON4': '0.150', 'AMMO4': '0.168', 'weapon5': '0.242', 'WEAPON5': '0.300', 'weapon4': '0.468', 'WEAPON3': '0.500', 'weapon2': '0.602', 'HITCOUNT': '1.510', 'weapon3': '1.774', 'DAMAGECOUNT': '6.387', 'FRAGCOUNT': '18.000'} [2023-02-24 19:16:03,786][177171] DAMAGECOUNT value on done: 332026.0 [2023-02-24 19:16:03,787][177171] Sum rewards: 13.696, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.668', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'AMMO3': '0.089', 'weapon4': '0.258', 'weapon5': '0.360', 'WEAPON3': '0.650', 'WEAPON5': '0.650', 'HITCOUNT': '0.860', 'weapon2': '1.180', 'weapon3': '1.784', 'DAMAGECOUNT': '5.136', 'FRAGCOUNT': '10.000'} [2023-02-24 19:16:05,747][177155] DAMAGECOUNT value on done: 337825.0 [2023-02-24 19:16:05,748][177155] Sum rewards: 18.014, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.342', 'AMMO5': '0.018', 'AMMO2': '0.040', 'AMMO3': '0.097', 'weapon7': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.172', 'WEAPON7': '0.200', 'AMMO4': '0.201', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.530', 'WEAPON3': '0.650', 'weapon4': '1.124', 'HITCOUNT': '1.260', 'weapon3': '1.596', 'DAMAGECOUNT': '5.163', 'FRAGCOUNT': '15.000'} [2023-02-24 19:16:06,046][177155] DAMAGECOUNT value on done: 345006.0 [2023-02-24 19:16:06,047][177155] Sum rewards: 17.293, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.988', 'AMMO2': '0.017', 'AMMO5': '0.025', 'WEAPON1': '0.030', 'AMMO4': '0.085', 'AMMO3': '0.114', 'weapon5': '0.186', 'WEAPON4': '0.250', 'weapon4': '0.432', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'weapon2': '0.846', 'HITCOUNT': '0.980', 'weapon3': '1.998', 'DAMAGECOUNT': '4.467', 'FRAGCOUNT': '15.000'} [2023-02-24 19:16:06,351][177155] DAMAGECOUNT value on done: 342184.0 [2023-02-24 19:16:06,351][177155] Sum rewards: 26.386, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.065', 'AMMO2': '0.014', 'AMMO5': '0.019', 'AMMO4': '0.068', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.143', 'weapon5': '0.158', 'WEAPON4': '0.200', 'weapon4': '0.316', 'WEAPON5': '0.450', 'weapon2': '0.580', 'WEAPON3': '1.000', 'HITCOUNT': '1.640', 'weapon3': '2.552', 'DAMAGECOUNT': '7.011', 'FRAGCOUNT': '23.000'} [2023-02-24 19:16:06,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13789.9, 300 sec: 13801.4). Total num frames: 94654464. Throughput: 0: 3445.0. Samples: 23657772. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 19:16:06,376][177119] Avg episode reward: [(0, '19.733')] [2023-02-24 19:16:06,509][177153] Updated weights for policy 0, policy_version 23110 (0.0008) [2023-02-24 19:16:06,647][177155] DAMAGECOUNT value on done: 325643.0 [2023-02-24 19:16:06,647][177155] Sum rewards: 23.111, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.023', 'AMMO5': '0.017', 'AMMO2': '0.040', 'AMMO3': '0.129', 'AMMO4': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.296', 'WEAPON4': '0.300', 'weapon4': '0.738', 'WEAPON3': '0.750', 'weapon2': '0.758', 'HITCOUNT': '1.380', 'weapon3': '1.894', 'DAMAGECOUNT': '6.132', 'FRAGCOUNT': '20.000'} [2023-02-24 19:16:09,475][177153] Updated weights for policy 0, policy_version 23120 (0.0008) [2023-02-24 19:16:11,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13789.9, 300 sec: 13801.4). Total num frames: 94724096. Throughput: 0: 3449.3. Samples: 23678470. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 19:16:11,376][177119] Avg episode reward: [(0, '19.837')] [2023-02-24 19:16:12,414][177153] Updated weights for policy 0, policy_version 23130 (0.0008) [2023-02-24 19:16:13,190][177170] DAMAGECOUNT value on done: 331190.0 [2023-02-24 19:16:13,191][177170] Sum rewards: 17.180, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.840', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.025', 'AMMO3': '0.125', 'weapon5': '0.298', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'weapon2': '0.892', 'HITCOUNT': '1.320', 'weapon3': '2.260', 'DAMAGECOUNT': '5.352', 'FRAGCOUNT': '14.000'} [2023-02-24 19:16:13,504][177170] DAMAGECOUNT value on done: 332698.0 [2023-02-24 19:16:13,505][177170] Sum rewards: 16.638, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.263', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO3': '0.091', 'AMMO4': '0.110', 'weapon7': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.154', 'WEAPON7': '0.200', 'weapon4': '0.254', 'WEAPON3': '0.550', 'HITCOUNT': '1.560', 'weapon3': '1.588', 'weapon2': '1.640', 'DAMAGECOUNT': '5.325', 'FRAGCOUNT': '13.000'} [2023-02-24 19:16:14,234][177170] DAMAGECOUNT value on done: 328595.0 [2023-02-24 19:16:14,234][177170] Sum rewards: 18.668, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.120', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.046', 'AMMO3': '0.122', 'weapon5': '0.176', 'AMMO4': '0.227', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.702', 'WEAPON3': '0.750', 'weapon2': '1.200', 'weapon3': '1.590', 'HITCOUNT': '1.820', 'DAMAGECOUNT': '6.270', 'FRAGCOUNT': '18.000'} [2023-02-24 19:16:14,538][177170] DAMAGECOUNT value on done: 333686.0 [2023-02-24 19:16:14,538][177170] Sum rewards: 20.506, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.252', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'weapon7': '0.112', 'AMMO4': '0.127', 'weapon5': '0.182', 'WEAPON5': '0.300', 'weapon4': '0.386', 'weapon2': '0.472', 'WEAPON3': '0.700', 'HITCOUNT': '1.580', 'weapon3': '2.066', 'DAMAGECOUNT': '5.769', 'FRAGCOUNT': '16.000'} [2023-02-24 19:16:15,277][177156] DAMAGECOUNT value on done: 334089.0 [2023-02-24 19:16:15,277][177156] Sum rewards: 18.276, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.119', 'AMMO2': '0.010', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.048', 'weapon7': '0.084', 'AMMO3': '0.089', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.192', 'WEAPON7': '0.200', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'weapon2': '0.738', 'weapon4': '0.804', 'HITCOUNT': '0.950', 'weapon3': '1.698', 'DAMAGECOUNT': '5.055', 'FRAGCOUNT': '14.000'} [2023-02-24 19:16:15,288][177156] DAMAGECOUNT value on done: 326082.0 [2023-02-24 19:16:15,288][177156] Sum rewards: 24.644, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.952', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.020', 'AMMO3': '0.122', 'weapon5': '0.222', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'weapon2': '0.870', 'HITCOUNT': '1.720', 'weapon3': '2.634', 'DAMAGECOUNT': '6.273', 'FRAGCOUNT': '20.000'} [2023-02-24 19:16:15,382][177153] Updated weights for policy 0, policy_version 23140 (0.0008) [2023-02-24 19:16:15,586][177156] DAMAGECOUNT value on done: 343760.0 [2023-02-24 19:16:15,587][177156] Sum rewards: 29.975, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.042', 'weapon7': '0.048', 'weapon5': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon2': '0.380', 'HEALTH': '0.518', 'WEAPON3': '0.650', 'HITCOUNT': '1.350', 'weapon4': '1.364', 'weapon3': '1.866', 'DAMAGECOUNT': '6.810', 'FRAGCOUNT': '25.000'} [2023-02-24 19:16:15,596][177156] DAMAGECOUNT value on done: 326192.0 [2023-02-24 19:16:15,597][177156] Sum rewards: 21.457, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.585', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'weapon5': '0.152', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.282', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'weapon2': '1.174', 'HITCOUNT': '1.470', 'weapon3': '1.942', 'DAMAGECOUNT': '5.967', 'FRAGCOUNT': '19.000'} [2023-02-24 19:16:15,712][177158] DAMAGECOUNT value on done: 320231.0 [2023-02-24 19:16:15,712][177158] Sum rewards: 22.300, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.356', 'ARMOR': '0.004', 'AMMO2': '0.011', 'AMMO5': '0.026', 'AMMO4': '0.054', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'weapon5': '0.252', 'weapon2': '0.562', 'weapon4': '0.588', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'HITCOUNT': '1.160', 'weapon3': '1.820', 'DAMAGECOUNT': '4.632', 'FRAGCOUNT': '19.000'} [2023-02-24 19:16:16,009][177158] DAMAGECOUNT value on done: 325539.0 [2023-02-24 19:16:16,010][177158] Sum rewards: 22.793, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.200', 'AMMO2': '0.024', 'AMMO5': '0.026', 'AMMO4': '0.119', 'AMMO3': '0.152', 'weapon5': '0.178', 'WEAPON4': '0.250', 'weapon4': '0.578', 'WEAPON5': '0.600', 'weapon2': '0.710', 'WEAPON3': '0.850', 'HITCOUNT': '1.850', 'weapon3': '2.194', 'DAMAGECOUNT': '7.212', 'FRAGCOUNT': '19.000'} [2023-02-24 19:16:16,305][177158] DAMAGECOUNT value on done: 333176.0 [2023-02-24 19:16:16,306][177158] Sum rewards: 7.604, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.042', 'AMMO3': '0.071', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'HEALTH': '0.318', 'weapon7': '0.362', 'WEAPON3': '0.400', 'HITCOUNT': '0.420', 'weapon3': '1.472', 'weapon2': '1.650', 'DAMAGECOUNT': '1.761', 'FRAGCOUNT': '4.000'} [2023-02-24 19:16:16,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13789.9, 300 sec: 13801.4). Total num frames: 94793728. Throughput: 0: 3448.4. Samples: 23699238. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 19:16:16,376][177119] Avg episode reward: [(0, '19.669')] [2023-02-24 19:16:16,602][177158] DAMAGECOUNT value on done: 334972.0 [2023-02-24 19:16:16,603][177158] Sum rewards: 26.588, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.983', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO4': '0.023', 'AMMO3': '0.101', 'weapon5': '0.172', 'WEAPON4': '0.200', 'weapon4': '0.336', 'WEAPON5': '0.350', 'ARMOR': '0.495', 'WEAPON3': '0.650', 'weapon2': '1.210', 'HITCOUNT': '1.480', 'weapon3': '1.632', 'DAMAGECOUNT': '6.375', 'FRAGCOUNT': '22.000'} [2023-02-24 19:16:18,316][177153] Updated weights for policy 0, policy_version 23150 (0.0008) [2023-02-24 19:16:19,913][177172] DAMAGECOUNT value on done: 329386.0 [2023-02-24 19:16:19,914][177172] Sum rewards: 19.876, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.202', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO3': '0.064', 'AMMO4': '0.092', 'WEAPON4': '0.350', 'weapon5': '0.372', 'WEAPON3': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.672', 'weapon2': '0.868', 'weapon3': '1.448', 'HITCOUNT': '1.700', 'DAMAGECOUNT': '6.753', 'FRAGCOUNT': '16.000'} [2023-02-24 19:16:20,205][177172] DAMAGECOUNT value on done: 329596.0 [2023-02-24 19:16:20,205][177172] Sum rewards: 26.069, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.245', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.078', 'AMMO4': '0.109', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.120', 'AMMO3': '0.141', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.400', 'weapon4': '0.830', 'WEAPON3': '0.900', 'HITCOUNT': '1.530', 'weapon3': '1.878', 'DAMAGECOUNT': '7.209', 'FRAGCOUNT': '23.000'} [2023-02-24 19:16:21,237][177153] Updated weights for policy 0, policy_version 23160 (0.0008) [2023-02-24 19:16:21,265][177154] DAMAGECOUNT value on done: 332486.0 [2023-02-24 19:16:21,266][177154] Sum rewards: 4.703, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.417', 'AMMO5': '0.007', 'AMMO3': '0.020', 'AMMO2': '0.024', 'weapon7': '0.054', 'AMMO4': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.138', 'WEAPON3': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.192', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.210', 'weapon3': '0.642', 'DAMAGECOUNT': '0.717', 'weapon4': '1.306', 'FRAGCOUNT': '3.000'} [2023-02-24 19:16:21,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13789.8, 300 sec: 13801.4). Total num frames: 94863360. Throughput: 0: 3453.7. Samples: 23709760. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 19:16:21,376][177119] Avg episode reward: [(0, '19.793')] [2023-02-24 19:16:21,575][177154] DAMAGECOUNT value on done: 341299.0 [2023-02-24 19:16:21,575][177154] Sum rewards: 20.665, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.492', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.114', 'weapon5': '0.120', 'weapon7': '0.120', 'WEAPON5': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.354', 'WEAPON3': '0.650', 'weapon2': '0.834', 'HITCOUNT': '1.420', 'weapon3': '1.842', 'DAMAGECOUNT': '5.691', 'FRAGCOUNT': '18.000'} [2023-02-24 19:16:21,637][177172] DAMAGECOUNT value on done: 341590.0 [2023-02-24 19:16:21,637][177172] Sum rewards: 14.696, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.332', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.069', 'AMMO4': '0.088', 'WEAPON4': '0.200', 'WEAPON3': '0.450', 'weapon2': '0.548', 'weapon4': '0.778', 'HITCOUNT': '0.860', 'weapon3': '1.454', 'DAMAGECOUNT': '3.213', 'FRAGCOUNT': '11.000'} [2023-02-24 19:16:21,877][177154] DAMAGECOUNT value on done: 344880.0 [2023-02-24 19:16:21,877][177154] Sum rewards: 17.783, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.442', 'AMMO2': '0.013', 'AMMO5': '0.014', 'AMMO4': '0.063', 'AMMO3': '0.099', 'weapon5': '0.270', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'HITCOUNT': '1.250', 'weapon2': '1.398', 'weapon3': '2.000', 'DAMAGECOUNT': '5.118', 'FRAGCOUNT': '13.000'} [2023-02-24 19:16:21,940][177172] DAMAGECOUNT value on done: 335337.0 [2023-02-24 19:16:21,941][177172] Sum rewards: 27.462, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.455', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO3': '0.052', 'AMMO4': '0.061', 'WEAPON5': '0.250', 'weapon2': '0.286', 'weapon5': '0.332', 'WEAPON4': '0.350', 'WEAPON3': '0.350', 'weapon4': '1.446', 'weapon3': '1.474', 'HITCOUNT': '1.860', 'DAMAGECOUNT': '6.669', 'FRAGCOUNT': '20.000'} [2023-02-24 19:16:22,175][177154] DAMAGECOUNT value on done: 344064.0 [2023-02-24 19:16:22,176][177154] Sum rewards: 16.465, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.416', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.029', 'AMMO3': '0.061', 'weapon7': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.146', 'WEAPON7': '0.200', 'weapon5': '0.256', 'WEAPON3': '0.450', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.784', 'weapon4': '0.980', 'HITCOUNT': '1.190', 'weapon3': '1.354', 'DAMAGECOUNT': '4.632', 'FRAGCOUNT': '14.000'} [2023-02-24 19:16:22,349][177157] DAMAGECOUNT value on done: 341540.0 [2023-02-24 19:16:22,349][177157] Sum rewards: 26.385, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.416', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon7': '0.070', 'AMMO4': '0.082', 'AMMO3': '0.085', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.302', 'weapon4': '0.400', 'WEAPON3': '0.550', 'weapon2': '0.958', 'HITCOUNT': '1.490', 'weapon3': '1.862', 'DAMAGECOUNT': '6.726', 'FRAGCOUNT': '20.000'} [2023-02-24 19:16:22,642][177157] DAMAGECOUNT value on done: 327283.0 [2023-02-24 19:16:22,643][177157] Sum rewards: 20.926, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.710', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.114', 'WEAPON4': '0.200', 'weapon5': '0.210', 'weapon4': '0.238', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'weapon2': '1.038', 'HITCOUNT': '1.530', 'weapon3': '2.196', 'DAMAGECOUNT': '5.988', 'FRAGCOUNT': '18.000'} [2023-02-24 19:16:22,651][177157] DAMAGECOUNT value on done: 326915.0 [2023-02-24 19:16:22,652][177157] Sum rewards: 10.926, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.902', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon7': '0.022', 'WEAPON1': '0.030', 'AMMO3': '0.060', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'weapon5': '0.192', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.456', 'HITCOUNT': '0.740', 'weapon2': '1.212', 'weapon3': '1.368', 'DAMAGECOUNT': '2.715', 'FRAGCOUNT': '9.000'} [2023-02-24 19:16:22,844][177171] DAMAGECOUNT value on done: 328423.0 [2023-02-24 19:16:22,845][177171] Sum rewards: 16.205, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.178', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO5': '0.015', 'AMMO4': '0.062', 'AMMO3': '0.137', 'WEAPON4': '0.200', 'weapon5': '0.260', 'WEAPON5': '0.350', 'weapon4': '0.396', 'weapon2': '0.670', 'WEAPON3': '0.850', 'HITCOUNT': '1.420', 'weapon3': '2.210', 'DAMAGECOUNT': '5.790', 'FRAGCOUNT': '14.000'} [2023-02-24 19:16:22,855][177171] DAMAGECOUNT value on done: 328969.0 [2023-02-24 19:16:22,856][177171] Sum rewards: 16.914, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.354', 'AMMO5': '0.005', 'AMMO2': '0.029', 'ARMOR': '0.032', 'AMMO3': '0.058', 'weapon5': '0.140', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'AMMO6': '0.280', 'AMMO7': '0.280', 'weapon7': '0.288', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.856', 'HITCOUNT': '0.960', 'weapon4': '0.988', 'weapon3': '1.074', 'DAMAGECOUNT': '4.731', 'FRAGCOUNT': '13.000'} [2023-02-24 19:16:22,949][177157] DAMAGECOUNT value on done: 332093.0 [2023-02-24 19:16:22,950][177157] Sum rewards: 3.674, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.870', 'AMMO5': '0.009', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.086', 'AMMO4': '0.095', 'AMMO3': '0.103', 'weapon7': '0.182', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'weapon2': '0.378', 'WEAPON4': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.800', 'weapon3': '1.172', 'weapon4': '1.694', 'DAMAGECOUNT': '2.805', 'FRAGCOUNT': '6.000'} [2023-02-24 19:16:23,154][177171] DAMAGECOUNT value on done: 332176.0 [2023-02-24 19:16:23,155][177171] Sum rewards: 25.494, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.133', 'AMMO2': '0.005', 'AMMO5': '0.017', 'AMMO4': '0.024', 'WEAPON1': '0.040', 'AMMO3': '0.081', 'WEAPON4': '0.150', 'weapon5': '0.172', 'weapon4': '0.198', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon2': '1.030', 'HITCOUNT': '1.510', 'weapon3': '1.644', 'DAMAGECOUNT': '6.705', 'FRAGCOUNT': '20.000'} [2023-02-24 19:16:23,165][177171] DAMAGECOUNT value on done: 332900.0 [2023-02-24 19:16:23,166][177171] Sum rewards: 8.844, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.520', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'weapon5': '0.050', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.107', 'WEAPON5': '0.200', 'HITCOUNT': '0.720', 'WEAPON3': '0.750', 'weapon2': '0.894', 'weapon3': '1.228', 'weapon4': '1.296', 'DAMAGECOUNT': '2.622', 'FRAGCOUNT': '8.000'} [2023-02-24 19:16:24,206][177153] Updated weights for policy 0, policy_version 23170 (0.0008) [2023-02-24 19:16:25,157][177155] DAMAGECOUNT value on done: 340232.0 [2023-02-24 19:16:25,157][177155] Sum rewards: 22.634, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.630', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'weapon7': '0.056', 'AMMO4': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.108', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'weapon4': '0.266', 'WEAPON5': '0.300', 'weapon2': '0.910', 'WEAPON3': '1.100', 'HITCOUNT': '1.620', 'weapon3': '2.368', 'DAMAGECOUNT': '7.221', 'FRAGCOUNT': '21.000'} [2023-02-24 19:16:25,464][177155] DAMAGECOUNT value on done: 347256.0 [2023-02-24 19:16:25,465][177155] Sum rewards: 24.192, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.874', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.026', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'weapon4': '0.158', 'weapon5': '0.254', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'weapon2': '1.010', 'HITCOUNT': '1.450', 'weapon3': '2.242', 'DAMAGECOUNT': '6.750', 'FRAGCOUNT': '21.000'} [2023-02-24 19:16:25,770][177155] DAMAGECOUNT value on done: 343565.0 [2023-02-24 19:16:25,771][177155] Sum rewards: 11.323, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.051', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.091', 'weapon4': '0.106', 'AMMO3': '0.113', 'weapon5': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'weapon2': '0.822', 'HITCOUNT': '1.150', 'weapon3': '1.806', 'DAMAGECOUNT': '4.143', 'FRAGCOUNT': '11.000'} [2023-02-24 19:16:26,069][177155] DAMAGECOUNT value on done: 327388.0 [2023-02-24 19:16:26,070][177155] Sum rewards: 15.029, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.324', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO2': '0.039', 'AMMO3': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon7': '0.144', 'weapon5': '0.186', 'AMMO4': '0.194', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'weapon2': '0.664', 'weapon4': '0.730', 'HITCOUNT': '1.190', 'weapon3': '1.778', 'DAMAGECOUNT': '5.235', 'FRAGCOUNT': '14.000'} [2023-02-24 19:16:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13801.4). Total num frames: 94932992. Throughput: 0: 3459.4. Samples: 23730626. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 19:16:26,376][177119] Avg episode reward: [(0, '19.484')] [2023-02-24 19:16:27,146][177153] Updated weights for policy 0, policy_version 23180 (0.0009) [2023-02-24 19:16:30,116][177153] Updated weights for policy 0, policy_version 23190 (0.0009) [2023-02-24 19:16:31,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13801.4). Total num frames: 95002624. Throughput: 0: 3461.9. Samples: 23751366. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 19:16:31,376][177119] Avg episode reward: [(0, '19.484')] [2023-02-24 19:16:32,550][177170] DAMAGECOUNT value on done: 332345.0 [2023-02-24 19:16:32,550][177170] Sum rewards: 11.121, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.100', 'AMMO2': '0.011', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.055', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.121', 'weapon7': '0.128', 'WEAPON4': '0.150', 'weapon5': '0.210', 'WEAPON5': '0.400', 'weapon4': '0.684', 'weapon2': '0.740', 'HITCOUNT': '0.810', 'WEAPON3': '0.850', 'weapon3': '1.762', 'DAMAGECOUNT': '3.465', 'FRAGCOUNT': '11.000'} [2023-02-24 19:16:32,852][177170] DAMAGECOUNT value on done: 334982.0 [2023-02-24 19:16:32,852][177170] Sum rewards: 16.993, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.100', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.119', 'weapon5': '0.148', 'weapon7': '0.162', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.668', 'WEAPON3': '0.750', 'weapon2': '0.774', 'HITCOUNT': '1.160', 'weapon3': '1.376', 'DAMAGECOUNT': '5.649', 'FRAGCOUNT': '15.000'} [2023-02-24 19:16:33,086][177153] Updated weights for policy 0, policy_version 23200 (0.0008) [2023-02-24 19:16:33,509][177170] DAMAGECOUNT value on done: 330871.0 [2023-02-24 19:16:33,509][177170] Sum rewards: 28.088, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.404', 'AMMO2': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.048', 'AMMO3': '0.118', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.400', 'weapon4': '0.648', 'WEAPON3': '0.650', 'weapon2': '0.692', 'HITCOUNT': '1.470', 'weapon3': '2.070', 'DAMAGECOUNT': '6.828', 'FRAGCOUNT': '22.000'} [2023-02-24 19:16:33,818][177170] DAMAGECOUNT value on done: 335758.0 [2023-02-24 19:16:33,819][177170] Sum rewards: 18.275, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.780', 'AMMO2': '0.015', 'AMMO5': '0.017', 'AMMO4': '0.073', 'weapon5': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.156', 'AMMO3': '0.182', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.444', 'weapon4': '1.018', 'WEAPON3': '1.150', 'HITCOUNT': '1.220', 'weapon3': '1.740', 'DAMAGECOUNT': '6.216', 'FRAGCOUNT': '19.000'} [2023-02-24 19:16:34,683][177156] DAMAGECOUNT value on done: 336115.0 [2023-02-24 19:16:34,683][177156] Sum rewards: 18.625, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.600', 'AMMO5': '0.016', 'AMMO2': '0.016', 'weapon7': '0.050', 'AMMO4': '0.081', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.124', 'AMMO3': '0.136', 'WEAPON5': '0.400', 'weapon2': '0.402', 'WEAPON3': '0.950', 'weapon4': '1.138', 'HITCOUNT': '1.550', 'weapon3': '1.884', 'DAMAGECOUNT': '6.078', 'FRAGCOUNT': '16.000'} [2023-02-24 19:16:34,694][177156] DAMAGECOUNT value on done: 328079.0 [2023-02-24 19:16:34,695][177156] Sum rewards: 23.129, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.174', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'weapon4': '0.016', 'AMMO2': '0.021', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'weapon5': '0.286', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'weapon2': '1.044', 'HITCOUNT': '1.260', 'weapon3': '2.214', 'DAMAGECOUNT': '5.991', 'FRAGCOUNT': '18.000'} [2023-02-24 19:16:34,990][177156] DAMAGECOUNT value on done: 345615.0 [2023-02-24 19:16:34,991][177156] Sum rewards: 14.452, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.435', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.021', 'weapon7': '0.064', 'AMMO3': '0.089', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.103', 'weapon5': '0.110', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'weapon2': '0.764', 'weapon4': '0.846', 'HITCOUNT': '1.270', 'weapon3': '1.780', 'DAMAGECOUNT': '4.965', 'FRAGCOUNT': '12.500'} [2023-02-24 19:16:35,002][177156] DAMAGECOUNT value on done: 327654.0 [2023-02-24 19:16:35,003][177156] Sum rewards: 21.307, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.687', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.098', 'AMMO3': '0.105', 'weapon5': '0.158', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'weapon4': '0.438', 'WEAPON3': '0.700', 'weapon2': '0.922', 'HITCOUNT': '1.300', 'weapon3': '1.704', 'DAMAGECOUNT': '4.386', 'FRAGCOUNT': '18.000'} [2023-02-24 19:16:35,160][177158] DAMAGECOUNT value on done: 321297.0 [2023-02-24 19:16:35,161][177158] Sum rewards: 11.917, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.209', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.083', 'WEAPON4': '0.200', 'weapon5': '0.216', 'WEAPON5': '0.350', 'ARMOR': '0.495', 'WEAPON3': '0.550', 'weapon2': '0.550', 'HITCOUNT': '0.980', 'weapon3': '1.130', 'weapon4': '1.364', 'DAMAGECOUNT': '3.198', 'FRAGCOUNT': '10.000'} [2023-02-24 19:16:35,455][177158] DAMAGECOUNT value on done: 327029.0 [2023-02-24 19:16:35,456][177158] Sum rewards: 12.792, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.888', 'AMMO2': '0.011', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.053', 'AMMO3': '0.109', 'WEAPON4': '0.200', 'weapon4': '0.228', 'weapon5': '0.292', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon2': '0.932', 'HITCOUNT': '1.130', 'weapon3': '1.968', 'DAMAGECOUNT': '4.470', 'FRAGCOUNT': '12.000'} [2023-02-24 19:16:35,737][177158] DAMAGECOUNT value on done: 335776.0 [2023-02-24 19:16:35,738][177158] Sum rewards: 23.316, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.110', 'AMMO5': '0.016', 'AMMO2': '0.045', 'AMMO3': '0.108', 'weapon4': '0.162', 'AMMO4': '0.223', 'weapon5': '0.322', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '0.650', 'weapon2': '0.766', 'HITCOUNT': '1.530', 'weapon3': '2.304', 'DAMAGECOUNT': '7.800', 'FRAGCOUNT': '21.000'} [2023-02-24 19:16:36,036][177158] DAMAGECOUNT value on done: 338327.0 [2023-02-24 19:16:36,036][177158] Sum rewards: 34.354, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.120', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO3': '0.113', 'AMMO4': '0.160', 'weapon5': '0.160', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.610', 'WEAPON3': '0.750', 'weapon2': '0.852', 'weapon3': '2.028', 'HITCOUNT': '2.390', 'DAMAGECOUNT': '10.065', 'FRAGCOUNT': '29.000'} [2023-02-24 19:16:36,063][177153] Updated weights for policy 0, policy_version 23210 (0.0008) [2023-02-24 19:16:36,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13815.3). Total num frames: 95072256. Throughput: 0: 3459.1. Samples: 23761620. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 19:16:36,376][177119] Avg episode reward: [(0, '19.440')] [2023-02-24 19:16:39,021][177153] Updated weights for policy 0, policy_version 23220 (0.0008) [2023-02-24 19:16:39,341][177172] DAMAGECOUNT value on done: 330860.0 [2023-02-24 19:16:39,342][177172] Sum rewards: 10.140, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.750', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO4': '0.089', 'AMMO3': '0.127', 'WEAPON4': '0.300', 'weapon5': '0.308', 'ARMOR': '0.454', 'weapon4': '0.494', 'WEAPON5': '0.650', 'weapon2': '0.660', 'WEAPON3': '0.800', 'HITCOUNT': '1.130', 'weapon3': '2.146', 'DAMAGECOUNT': '4.422', 'FRAGCOUNT': '10.000'} [2023-02-24 19:16:39,642][177172] DAMAGECOUNT value on done: 331699.0 [2023-02-24 19:16:39,642][177172] Sum rewards: 23.262, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.851', 'AMMO5': '0.014', 'AMMO2': '0.030', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.122', 'AMMO3': '0.128', 'AMMO4': '0.148', 'WEAPON7': '0.200', 'weapon5': '0.248', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.386', 'ARMOR': '0.400', 'weapon4': '0.730', 'WEAPON3': '0.800', 'HITCOUNT': '1.430', 'weapon3': '2.028', 'DAMAGECOUNT': '6.309', 'FRAGCOUNT': '20.000'} [2023-02-24 19:16:40,691][177154] DAMAGECOUNT value on done: 334128.0 [2023-02-24 19:16:40,692][177154] Sum rewards: 19.276, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.368', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.018', 'AMMO3': '0.085', 'weapon5': '0.194', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '1.210', 'weapon2': '1.342', 'weapon3': '1.488', 'DAMAGECOUNT': '4.926', 'FRAGCOUNT': '14.000'} [2023-02-24 19:16:40,996][177154] DAMAGECOUNT value on done: 342981.0 [2023-02-24 19:16:40,996][177154] Sum rewards: 14.384, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.704', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.017', 'weapon4': '0.044', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'weapon5': '0.198', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'weapon2': '1.118', 'HITCOUNT': '1.200', 'weapon3': '2.210', 'DAMAGECOUNT': '5.046', 'FRAGCOUNT': '13.000'} [2023-02-24 19:16:41,078][177172] DAMAGECOUNT value on done: 342936.0 [2023-02-24 19:16:41,078][177172] Sum rewards: 11.867, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.391', 'AMMO2': '0.010', 'AMMO5': '0.022', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'AMMO3': '0.176', 'weapon4': '0.220', 'weapon5': '0.274', 'WEAPON5': '0.550', 'weapon2': '0.618', 'HITCOUNT': '0.990', 'WEAPON3': '1.150', 'weapon3': '2.558', 'DAMAGECOUNT': '4.038', 'FRAGCOUNT': '14.000'} [2023-02-24 19:16:41,296][177154] DAMAGECOUNT value on done: 347150.0 [2023-02-24 19:16:41,296][177154] Sum rewards: 15.605, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.501', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.029', 'AMMO4': '0.147', 'AMMO3': '0.202', 'weapon5': '0.216', 'weapon4': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.780', 'WEAPON3': '1.200', 'HITCOUNT': '1.570', 'weapon3': '2.342', 'DAMAGECOUNT': '6.810', 'FRAGCOUNT': '18.000'} [2023-02-24 19:16:41,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13789.9, 300 sec: 13801.4). Total num frames: 95137792. Throughput: 0: 3460.3. Samples: 23782412. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 19:16:41,376][177172] DAMAGECOUNT value on done: 336822.0 [2023-02-24 19:16:41,376][177119] Avg episode reward: [(0, '19.283')] [2023-02-24 19:16:41,376][177172] Sum rewards: 14.086, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.955', 'AMMO5': '0.015', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'weapon7': '0.066', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.208', 'weapon5': '0.226', 'WEAPON5': '0.400', 'ARMOR': '0.455', 'weapon2': '0.934', 'WEAPON3': '1.000', 'HITCOUNT': '1.150', 'weapon3': '2.176', 'DAMAGECOUNT': '4.455', 'FRAGCOUNT': '12.500'} [2023-02-24 19:16:41,597][177154] DAMAGECOUNT value on done: 346705.0 [2023-02-24 19:16:41,598][177154] Sum rewards: 27.454, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.404', 'AMMO2': '0.018', 'AMMO5': '0.022', 'AMMO4': '0.091', 'AMMO3': '0.137', 'weapon5': '0.318', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'weapon2': '0.926', 'HITCOUNT': '1.680', 'weapon3': '2.442', 'DAMAGECOUNT': '7.923', 'FRAGCOUNT': '22.000'} [2023-02-24 19:16:41,819][177157] DAMAGECOUNT value on done: 343141.0 [2023-02-24 19:16:41,819][177157] Sum rewards: 15.654, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.870', 'AMMO2': '0.006', 'AMMO5': '0.011', 'AMMO4': '0.030', 'WEAPON1': '0.040', 'AMMO3': '0.077', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon7': '0.100', 'weapon5': '0.206', 'WEAPON5': '0.300', 'weapon4': '0.460', 'WEAPON3': '0.600', 'HITCOUNT': '1.100', 'weapon2': '1.348', 'weapon3': '1.542', 'DAMAGECOUNT': '4.803', 'FRAGCOUNT': '11.500'} [2023-02-24 19:16:41,973][177153] Updated weights for policy 0, policy_version 23230 (0.0008) [2023-02-24 19:16:42,117][177157] DAMAGECOUNT value on done: 329560.0 [2023-02-24 19:16:42,117][177157] Sum rewards: 20.983, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.147', 'AMMO5': '0.009', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon4': '0.130', 'AMMO3': '0.137', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.734', 'WEAPON3': '1.000', 'HITCOUNT': '1.670', 'weapon3': '2.806', 'DAMAGECOUNT': '6.831', 'FRAGCOUNT': '19.000'} [2023-02-24 19:16:42,126][177157] DAMAGECOUNT value on done: 329034.0 [2023-02-24 19:16:42,126][177157] Sum rewards: 14.946, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.067', 'AMMO5': '0.020', 'ARMOR': '0.028', 'AMMO2': '0.033', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.164', 'AMMO3': '0.201', 'weapon5': '0.220', 'weapon4': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.652', 'WEAPON3': '1.150', 'HITCOUNT': '1.440', 'weapon3': '2.472', 'DAMAGECOUNT': '6.357', 'FRAGCOUNT': '17.000'} [2023-02-24 19:16:42,295][177171] DAMAGECOUNT value on done: 329743.0 [2023-02-24 19:16:42,295][177171] Sum rewards: 11.517, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.378', 'AMMO5': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.067', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'weapon5': '0.252', 'WEAPON5': '0.300', 'weapon4': '0.302', 'WEAPON3': '0.450', 'HITCOUNT': '0.860', 'weapon2': '1.230', 'weapon3': '1.454', 'DAMAGECOUNT': '3.960', 'FRAGCOUNT': '8.000'} [2023-02-24 19:16:42,306][177171] DAMAGECOUNT value on done: 331293.0 [2023-02-24 19:16:42,307][177171] Sum rewards: 23.046, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.946', 'AMMO2': '0.014', 'AMMO5': '0.015', 'AMMO4': '0.072', 'weapon5': '0.132', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'weapon4': '0.220', 'WEAPON5': '0.250', 'weapon2': '0.852', 'WEAPON3': '1.000', 'HITCOUNT': '1.630', 'weapon3': '2.482', 'DAMAGECOUNT': '6.972', 'FRAGCOUNT': '22.000'} [2023-02-24 19:16:42,428][177157] DAMAGECOUNT value on done: 333937.0 [2023-02-24 19:16:42,429][177157] Sum rewards: 17.635, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.872', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.104', 'weapon7': '0.156', 'AMMO4': '0.164', 'weapon5': '0.180', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '0.650', 'weapon2': '0.838', 'weapon4': '0.872', 'HITCOUNT': '1.370', 'weapon3': '1.374', 'DAMAGECOUNT': '5.532', 'FRAGCOUNT': '16.000'} [2023-02-24 19:16:42,600][177171] DAMAGECOUNT value on done: 334263.0 [2023-02-24 19:16:42,601][177171] Sum rewards: 24.390, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.780', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.019', 'WEAPON4': '0.050', 'weapon4': '0.078', 'AMMO3': '0.133', 'weapon5': '0.158', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'weapon2': '0.938', 'HITCOUNT': '1.810', 'weapon3': '2.480', 'DAMAGECOUNT': '6.261', 'FRAGCOUNT': '21.000'} [2023-02-24 19:16:42,611][177171] DAMAGECOUNT value on done: 334681.0 [2023-02-24 19:16:42,612][177171] Sum rewards: 13.130, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.099', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'weapon7': '0.030', 'weapon5': '0.104', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.202', 'WEAPON3': '0.950', 'weapon2': '1.080', 'HITCOUNT': '1.400', 'weapon3': '2.106', 'DAMAGECOUNT': '5.343', 'FRAGCOUNT': '13.000'} [2023-02-24 19:16:44,555][177155] DAMAGECOUNT value on done: 341785.0 [2023-02-24 19:16:44,556][177155] Sum rewards: 14.386, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.136', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.090', 'weapon5': '0.132', 'weapon7': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'weapon4': '0.560', 'WEAPON3': '0.600', 'weapon2': '0.706', 'HITCOUNT': '1.120', 'weapon3': '1.644', 'DAMAGECOUNT': '4.659', 'FRAGCOUNT': '11.000'} [2023-02-24 19:16:44,855][177155] DAMAGECOUNT value on done: 348512.0 [2023-02-24 19:16:44,856][177155] Sum rewards: 13.101, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.480', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO2': '0.031', 'AMMO3': '0.075', 'weapon4': '0.076', 'WEAPON4': '0.150', 'AMMO4': '0.156', 'weapon5': '0.442', 'WEAPON3': '0.550', 'HITCOUNT': '0.630', 'WEAPON5': '0.650', 'weapon3': '1.438', 'weapon2': '1.820', 'DAMAGECOUNT': '3.768', 'FRAGCOUNT': '10.000'} [2023-02-24 19:16:44,943][177153] Updated weights for policy 0, policy_version 23240 (0.0008) [2023-02-24 19:16:45,142][177155] DAMAGECOUNT value on done: 344982.0 [2023-02-24 19:16:45,142][177155] Sum rewards: 17.109, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.036', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.018', 'AMMO3': '0.065', 'weapon5': '0.078', 'AMMO4': '0.088', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '0.500', 'weapon2': '0.922', 'weapon4': '1.030', 'HITCOUNT': '1.300', 'weapon3': '1.468', 'DAMAGECOUNT': '4.251', 'FRAGCOUNT': '13.000'} [2023-02-24 19:16:45,434][177155] DAMAGECOUNT value on done: 328878.0 [2023-02-24 19:16:45,434][177155] Sum rewards: 13.728, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.295', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.030', 'AMMO4': '0.050', 'WEAPON5': '0.050', 'weapon7': '0.084', 'AMMO3': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.584', 'WEAPON3': '0.700', 'HITCOUNT': '1.130', 'weapon4': '1.178', 'weapon3': '1.742', 'DAMAGECOUNT': '4.470', 'FRAGCOUNT': '11.000'} [2023-02-24 19:16:46,376][177119] Fps is (10 sec: 13516.5, 60 sec: 13789.8, 300 sec: 13801.4). Total num frames: 95207424. Throughput: 0: 3463.3. Samples: 23803284. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 19:16:46,377][177119] Avg episode reward: [(0, '19.091')] [2023-02-24 19:16:47,886][177153] Updated weights for policy 0, policy_version 23250 (0.0008) [2023-02-24 19:16:50,810][177153] Updated weights for policy 0, policy_version 23260 (0.0009) [2023-02-24 19:16:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13801.4). Total num frames: 95277056. Throughput: 0: 3464.8. Samples: 23813688. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 19:16:51,376][177119] Avg episode reward: [(0, '19.091')] [2023-02-24 19:16:51,969][177170] DAMAGECOUNT value on done: 334660.0 [2023-02-24 19:16:51,969][177170] Sum rewards: 25.411, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.610', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.086', 'AMMO4': '0.099', 'AMMO3': '0.114', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.508', 'WEAPON3': '0.800', 'weapon2': '0.858', 'HITCOUNT': '1.830', 'weapon3': '2.154', 'DAMAGECOUNT': '6.945', 'FRAGCOUNT': '23.000'} [2023-02-24 19:16:52,272][177170] DAMAGECOUNT value on done: 336398.0 [2023-02-24 19:16:52,273][177170] Sum rewards: 18.053, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.345', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'weapon5': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon7': '0.230', 'WEAPON3': '0.700', 'weapon2': '0.766', 'weapon4': '0.830', 'HITCOUNT': '0.920', 'weapon3': '1.438', 'DAMAGECOUNT': '4.248', 'FRAGCOUNT': '16.000'} [2023-02-24 19:16:52,919][177170] DAMAGECOUNT value on done: 332549.0 [2023-02-24 19:16:52,919][177170] Sum rewards: 18.588, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.130', 'AMMO5': '0.009', 'weapon7': '0.040', 'AMMO2': '0.043', 'weapon5': '0.086', 'AMMO3': '0.125', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'AMMO4': '0.215', 'WEAPON5': '0.250', 'weapon4': '0.272', 'WEAPON4': '0.300', 'WEAPON3': '0.750', 'weapon2': '1.014', 'HITCOUNT': '1.460', 'weapon3': '2.350', 'DAMAGECOUNT': '5.034', 'FRAGCOUNT': '17.000'} [2023-02-24 19:16:53,217][177170] DAMAGECOUNT value on done: 337015.0 [2023-02-24 19:16:53,218][177170] Sum rewards: 15.836, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.810', 'AMMO5': '0.015', 'AMMO2': '0.022', 'AMMO3': '0.076', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'weapon5': '0.308', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.472', 'WEAPON3': '0.550', 'HITCOUNT': '1.050', 'weapon2': '1.214', 'weapon3': '1.560', 'DAMAGECOUNT': '3.771', 'FRAGCOUNT': '14.000'} [2023-02-24 19:16:53,746][177153] Updated weights for policy 0, policy_version 23270 (0.0008) [2023-02-24 19:16:54,005][177156] DAMAGECOUNT value on done: 338358.0 [2023-02-24 19:16:54,005][177156] Sum rewards: 17.395, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.641', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon7': '0.052', 'weapon5': '0.054', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.147', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.450', 'weapon2': '0.470', 'WEAPON3': '0.950', 'weapon4': '1.144', 'HITCOUNT': '1.590', 'weapon3': '1.916', 'DAMAGECOUNT': '6.729', 'FRAGCOUNT': '17.000'} [2023-02-24 19:16:54,016][177156] DAMAGECOUNT value on done: 329498.0 [2023-02-24 19:16:54,016][177156] Sum rewards: 15.195, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.866', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.090', 'AMMO4': '0.105', 'weapon5': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'ARMOR': '0.428', 'weapon2': '0.458', 'WEAPON3': '0.650', 'weapon4': '0.916', 'HITCOUNT': '1.120', 'weapon3': '1.850', 'DAMAGECOUNT': '4.257', 'FRAGCOUNT': '12.000'} [2023-02-24 19:16:54,315][177156] DAMAGECOUNT value on done: 347782.0 [2023-02-24 19:16:54,315][177156] Sum rewards: 19.089, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.900', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'AMMO3': '0.140', 'AMMO4': '0.167', 'weapon5': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.492', 'WEAPON3': '0.850', 'weapon2': '0.978', 'HITCOUNT': '1.460', 'weapon3': '1.954', 'DAMAGECOUNT': '6.501', 'FRAGCOUNT': '18.000'} [2023-02-24 19:16:54,327][177156] DAMAGECOUNT value on done: 328359.0 [2023-02-24 19:16:54,328][177156] Sum rewards: 9.485, reward structure: {'DEATHCOUNT': '-4.500', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO3': '0.040', 'weapon7': '0.074', 'weapon5': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HEALTH': '0.120', 'AMMO4': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.200', 'HITCOUNT': '0.450', 'weapon3': '0.578', 'weapon2': '0.818', 'weapon4': '1.614', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '7.000'} [2023-02-24 19:16:54,450][177158] DAMAGECOUNT value on done: 322751.0 [2023-02-24 19:16:54,451][177158] Sum rewards: 14.272, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.548', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.029', 'weapon7': '0.052', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.123', 'AMMO4': '0.143', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon5': '0.330', 'WEAPON5': '0.500', 'weapon4': '0.784', 'WEAPON3': '0.800', 'weapon2': '0.816', 'HITCOUNT': '0.850', 'weapon3': '1.514', 'DAMAGECOUNT': '4.362', 'FRAGCOUNT': '14.000'} [2023-02-24 19:16:54,754][177158] DAMAGECOUNT value on done: 329185.0 [2023-02-24 19:16:54,755][177158] Sum rewards: 26.941, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.890', 'AMMO2': '0.012', 'AMMO5': '0.019', 'AMMO4': '0.059', 'AMMO3': '0.111', 'WEAPON4': '0.200', 'weapon4': '0.250', 'weapon5': '0.370', 'WEAPON5': '0.550', 'weapon2': '0.656', 'WEAPON3': '0.750', 'HITCOUNT': '1.490', 'weapon3': '2.396', 'DAMAGECOUNT': '6.468', 'FRAGCOUNT': '22.000'} [2023-02-24 19:16:55,042][177158] DAMAGECOUNT value on done: 338113.0 [2023-02-24 19:16:55,042][177158] Sum rewards: 19.454, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.235', 'AMMO5': '0.010', 'AMMO2': '0.043', 'AMMO3': '0.091', 'weapon5': '0.208', 'AMMO4': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'WEAPON3': '0.650', 'weapon2': '0.656', 'weapon4': '0.756', 'weapon3': '1.518', 'HITCOUNT': '1.580', 'DAMAGECOUNT': '7.011', 'FRAGCOUNT': '17.000'} [2023-02-24 19:16:55,338][177158] DAMAGECOUNT value on done: 339650.0 [2023-02-24 19:16:55,338][177158] Sum rewards: 11.538, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.175', 'AMMO5': '0.010', 'ARMOR': '0.032', 'AMMO2': '0.045', 'weapon7': '0.046', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.112', 'AMMO4': '0.223', 'WEAPON5': '0.250', 'weapon5': '0.296', 'WEAPON4': '0.350', 'WEAPON3': '0.650', 'HITCOUNT': '0.700', 'weapon2': '0.702', 'weapon4': '1.200', 'weapon3': '1.328', 'DAMAGECOUNT': '3.969', 'FRAGCOUNT': '10.000'} [2023-02-24 19:16:56,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13858.2, 300 sec: 13801.4). Total num frames: 95346688. Throughput: 0: 3467.3. Samples: 23834498. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 19:16:56,376][177119] Avg episode reward: [(0, '18.536')] [2023-02-24 19:16:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000023279_95350784.pth... [2023-02-24 19:16:56,439][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000022470_92037120.pth [2023-02-24 19:16:56,684][177153] Updated weights for policy 0, policy_version 23280 (0.0009) [2023-02-24 19:16:58,686][177172] DAMAGECOUNT value on done: 332318.0 [2023-02-24 19:16:58,687][177172] Sum rewards: 12.876, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.719', 'AMMO5': '0.017', 'AMMO2': '0.023', 'weapon7': '0.078', 'AMMO4': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.125', 'weapon5': '0.138', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'ARMOR': '0.455', 'weapon2': '0.550', 'WEAPON3': '0.750', 'weapon4': '0.826', 'HITCOUNT': '1.190', 'weapon3': '2.082', 'DAMAGECOUNT': '4.359', 'FRAGCOUNT': '11.500'} [2023-02-24 19:16:58,988][177172] DAMAGECOUNT value on done: 333194.0 [2023-02-24 19:16:58,989][177172] Sum rewards: 14.939, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.722', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.076', 'AMMO3': '0.084', 'weapon7': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.550', 'weapon2': '0.756', 'weapon4': '1.020', 'HITCOUNT': '1.030', 'weapon3': '1.542', 'DAMAGECOUNT': '4.485', 'FRAGCOUNT': '12.000'} [2023-02-24 19:16:59,686][177153] Updated weights for policy 0, policy_version 23290 (0.0008) [2023-02-24 19:17:00,134][177154] DAMAGECOUNT value on done: 335832.0 [2023-02-24 19:17:00,135][177154] Sum rewards: 16.143, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.330', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.115', 'AMMO4': '0.119', 'weapon5': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'ARMOR': '0.456', 'weapon4': '0.546', 'WEAPON3': '0.800', 'weapon2': '1.122', 'HITCOUNT': '1.470', 'weapon3': '1.956', 'DAMAGECOUNT': '5.112', 'FRAGCOUNT': '14.000'} [2023-02-24 19:17:00,435][177154] DAMAGECOUNT value on done: 345024.0 [2023-02-24 19:17:00,436][177154] Sum rewards: 15.481, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.464', 'AMMO5': '0.020', 'AMMO2': '0.031', 'AMMO3': '0.153', 'AMMO4': '0.155', 'weapon5': '0.344', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon2': '0.532', 'weapon4': '0.694', 'WEAPON3': '0.900', 'HITCOUNT': '1.230', 'weapon3': '2.044', 'DAMAGECOUNT': '5.742', 'FRAGCOUNT': '17.000'} [2023-02-24 19:17:00,443][177172] DAMAGECOUNT value on done: 345242.0 [2023-02-24 19:17:00,444][177172] Sum rewards: 19.370, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.320', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.041', 'AMMO3': '0.098', 'AMMO4': '0.203', 'weapon5': '0.350', 'weapon4': '0.418', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'weapon2': '0.830', 'HITCOUNT': '1.380', 'weapon3': '1.660', 'DAMAGECOUNT': '6.813', 'FRAGCOUNT': '17.000'} [2023-02-24 19:17:00,733][177154] DAMAGECOUNT value on done: 348973.0 [2023-02-24 19:17:00,733][177154] Sum rewards: 20.636, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.307', 'AMMO2': '0.001', 'AMMO4': '0.005', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO3': '0.140', 'WEAPON4': '0.200', 'weapon5': '0.264', 'WEAPON5': '0.350', 'weapon4': '0.690', 'weapon2': '0.710', 'WEAPON3': '0.900', 'HITCOUNT': '1.210', 'weapon3': '1.480', 'DAMAGECOUNT': '5.469', 'FRAGCOUNT': '19.000'} [2023-02-24 19:17:00,737][177172] DAMAGECOUNT value on done: 338178.0 [2023-02-24 19:17:00,738][177172] Sum rewards: 12.431, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.138', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.021', 'weapon7': '0.072', 'weapon5': '0.096', 'AMMO4': '0.107', 'AMMO3': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.454', 'weapon2': '0.524', 'WEAPON3': '0.850', 'HITCOUNT': '1.080', 'weapon3': '2.420', 'DAMAGECOUNT': '4.068', 'FRAGCOUNT': '13.000'} [2023-02-24 19:17:01,037][177154] DAMAGECOUNT value on done: 349134.0 [2023-02-24 19:17:01,037][177154] Sum rewards: 26.139, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.036', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.028', 'AMMO4': '0.138', 'AMMO3': '0.141', 'weapon5': '0.290', 'WEAPON4': '0.300', 'weapon4': '0.422', 'WEAPON5': '0.450', 'weapon2': '0.758', 'WEAPON3': '0.850', 'HITCOUNT': '1.630', 'weapon3': '2.104', 'DAMAGECOUNT': '7.287', 'FRAGCOUNT': '23.000'} [2023-02-24 19:17:01,150][177157] DAMAGECOUNT value on done: 345266.0 [2023-02-24 19:17:01,151][177157] Sum rewards: 21.900, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.574', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'weapon5': '0.132', 'AMMO3': '0.138', 'WEAPON4': '0.250', 'weapon4': '0.272', 'weapon2': '0.774', 'WEAPON3': '0.800', 'HITCOUNT': '1.720', 'weapon3': '2.250', 'DAMAGECOUNT': '6.375', 'FRAGCOUNT': '20.000'} [2023-02-24 19:17:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.2, 300 sec: 13801.4). Total num frames: 95416320. Throughput: 0: 3467.8. Samples: 23855290. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 19:17:01,376][177119] Avg episode reward: [(0, '18.630')] [2023-02-24 19:17:01,450][177157] DAMAGECOUNT value on done: 330409.0 [2023-02-24 19:17:01,451][177157] Sum rewards: 9.130, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.243', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO3': '0.056', 'AMMO4': '0.177', 'weapon7': '0.188', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'HITCOUNT': '0.610', 'weapon4': '0.674', 'weapon2': '1.118', 'weapon3': '1.278', 'DAMAGECOUNT': '2.547', 'FRAGCOUNT': '7.000'} [2023-02-24 19:17:01,460][177157] DAMAGECOUNT value on done: 330069.0 [2023-02-24 19:17:01,460][177157] Sum rewards: 7.932, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.080', 'ARMOR': '0.004', 'AMMO2': '0.020', 'AMMO5': '0.029', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'weapon4': '0.124', 'weapon5': '0.352', 'WEAPON5': '0.650', 'WEAPON3': '0.800', 'HITCOUNT': '0.830', 'weapon2': '1.376', 'weapon3': '1.920', 'DAMAGECOUNT': '3.105', 'FRAGCOUNT': '8.000'} [2023-02-24 19:17:01,571][177171] DAMAGECOUNT value on done: 331566.0 [2023-02-24 19:17:01,572][177171] Sum rewards: 18.033, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.680', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.041', 'AMMO3': '0.134', 'weapon4': '0.146', 'WEAPON4': '0.200', 'weapon5': '0.234', 'WEAPON5': '0.300', 'WEAPON3': '0.900', 'weapon2': '1.024', 'HITCOUNT': '1.420', 'weapon3': '2.326', 'DAMAGECOUNT': '5.469', 'FRAGCOUNT': '18.000'} [2023-02-24 19:17:01,582][177171] DAMAGECOUNT value on done: 331797.0 [2023-02-24 19:17:01,583][177171] Sum rewards: 7.524, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.008', 'AMMO3': '0.030', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'weapon7': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HEALTH': '0.172', 'WEAPON3': '0.200', 'HITCOUNT': '0.300', 'weapon3': '0.480', 'weapon2': '0.856', 'weapon4': '1.252', 'DAMAGECOUNT': '1.512', 'FRAGCOUNT': '6.000'} [2023-02-24 19:17:01,743][177157] DAMAGECOUNT value on done: 335148.0 [2023-02-24 19:17:01,744][177157] Sum rewards: 16.812, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.368', 'AMMO5': '0.016', 'weapon7': '0.034', 'AMMO2': '0.035', 'AMMO3': '0.102', 'AMMO4': '0.174', 'weapon5': '0.278', 'WEAPON4': '0.300', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'weapon4': '0.342', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'HITCOUNT': '0.800', 'weapon2': '1.056', 'weapon3': '1.760', 'DAMAGECOUNT': '3.633', 'FRAGCOUNT': '16.000'} [2023-02-24 19:17:01,882][177171] DAMAGECOUNT value on done: 334725.0 [2023-02-24 19:17:01,882][177171] Sum rewards: 1.698, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.940', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'weapon7': '0.058', 'weapon5': '0.062', 'AMMO3': '0.064', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.250', 'WEAPON3': '0.400', 'weapon4': '0.652', 'weapon2': '0.716', 'weapon3': '0.858', 'DAMAGECOUNT': '1.386', 'FRAGCOUNT': '2.000'} [2023-02-24 19:17:01,894][177171] DAMAGECOUNT value on done: 336511.0 [2023-02-24 19:17:01,894][177171] Sum rewards: 24.248, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.852', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.019', 'weapon7': '0.074', 'AMMO4': '0.095', 'AMMO3': '0.099', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon2': '0.690', 'HITCOUNT': '1.230', 'weapon4': '1.250', 'weapon3': '1.344', 'DAMAGECOUNT': '5.490', 'FRAGCOUNT': '21.000'} [2023-02-24 19:17:02,659][177153] Updated weights for policy 0, policy_version 23300 (0.0008) [2023-02-24 19:17:04,017][177155] DAMAGECOUNT value on done: 343403.0 [2023-02-24 19:17:04,018][177155] Sum rewards: 8.231, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.740', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.164', 'weapon5': '0.212', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.422', 'WEAPON3': '0.950', 'weapon2': '1.086', 'HITCOUNT': '1.270', 'weapon3': '1.910', 'DAMAGECOUNT': '4.854', 'FRAGCOUNT': '11.000'} [2023-02-24 19:17:04,320][177155] DAMAGECOUNT value on done: 350088.0 [2023-02-24 19:17:04,320][177155] Sum rewards: 11.465, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.366', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.015', 'AMMO3': '0.106', 'WEAPON4': '0.150', 'weapon4': '0.164', 'weapon5': '0.202', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '1.190', 'weapon2': '1.276', 'weapon3': '2.092', 'DAMAGECOUNT': '4.728', 'FRAGCOUNT': '11.500'} [2023-02-24 19:17:04,624][177155] DAMAGECOUNT value on done: 346795.0 [2023-02-24 19:17:04,624][177155] Sum rewards: 14.906, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.829', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.030', 'weapon5': '0.114', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'AMMO4': '0.150', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.572', 'WEAPON3': '0.850', 'weapon4': '0.866', 'HITCOUNT': '1.420', 'weapon3': '2.188', 'DAMAGECOUNT': '5.439', 'FRAGCOUNT': '15.000'} [2023-02-24 19:17:04,925][177155] DAMAGECOUNT value on done: 330162.0 [2023-02-24 19:17:04,926][177155] Sum rewards: 14.571, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.558', 'AMMO5': '0.016', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'AMMO3': '0.057', 'weapon7': '0.064', 'AMMO4': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.212', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.404', 'WEAPON3': '0.450', 'HITCOUNT': '0.920', 'weapon3': '1.242', 'weapon4': '1.422', 'DAMAGECOUNT': '3.852', 'FRAGCOUNT': '11.000'} [2023-02-24 19:17:05,624][177153] Updated weights for policy 0, policy_version 23310 (0.0008) [2023-02-24 19:17:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13801.4). Total num frames: 95485952. Throughput: 0: 3463.1. Samples: 23865600. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 19:17:06,376][177119] Avg episode reward: [(0, '17.575')] [2023-02-24 19:17:08,590][177153] Updated weights for policy 0, policy_version 23320 (0.0008) [2023-02-24 19:17:11,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13815.3). Total num frames: 95555584. Throughput: 0: 3459.9. Samples: 23886320. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 19:17:11,376][177119] Avg episode reward: [(0, '17.575')] [2023-02-24 19:17:11,381][177170] DAMAGECOUNT value on done: 336941.0 [2023-02-24 19:17:11,381][177170] Sum rewards: 18.984, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.075', 'AMMO5': '0.022', 'AMMO2': '0.041', 'weapon5': '0.190', 'AMMO3': '0.200', 'AMMO4': '0.206', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.638', 'weapon2': '0.654', 'WEAPON3': '1.200', 'HITCOUNT': '1.640', 'weapon3': '2.124', 'DAMAGECOUNT': '6.843', 'FRAGCOUNT': '21.000'} [2023-02-24 19:17:11,552][177153] Updated weights for policy 0, policy_version 23330 (0.0008) [2023-02-24 19:17:11,683][177170] DAMAGECOUNT value on done: 337343.0 [2023-02-24 19:17:11,684][177170] Sum rewards: 8.342, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.174', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO3': '0.020', 'AMMO2': '0.031', 'weapon5': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.106', 'AMMO4': '0.155', 'WEAPON3': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.308', 'weapon3': '0.678', 'HITCOUNT': '0.720', 'weapon4': '1.364', 'DAMAGECOUNT': '2.835', 'FRAGCOUNT': '5.000'} [2023-02-24 19:17:11,975][177158] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 19:17:12,305][177170] DAMAGECOUNT value on done: 334601.0 [2023-02-24 19:17:12,305][177170] Sum rewards: 19.780, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.948', 'AMMO2': '0.011', 'AMMO5': '0.024', 'AMMO4': '0.056', 'AMMO3': '0.130', 'weapon5': '0.156', 'WEAPON4': '0.200', 'weapon4': '0.424', 'WEAPON5': '0.550', 'weapon2': '0.818', 'WEAPON3': '0.950', 'HITCOUNT': '1.660', 'weapon3': '2.342', 'DAMAGECOUNT': '6.156', 'FRAGCOUNT': '18.000'} [2023-02-24 19:17:12,609][177170] DAMAGECOUNT value on done: 339135.0 [2023-02-24 19:17:12,609][177170] Sum rewards: 19.152, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.850', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO5': '0.015', 'AMMO3': '0.134', 'WEAPON4': '0.150', 'weapon5': '0.284', 'weapon4': '0.292', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'weapon2': '1.030', 'HITCOUNT': '1.500', 'weapon3': '2.020', 'DAMAGECOUNT': '6.360', 'FRAGCOUNT': '16.000'} [2023-02-24 19:17:13,491][177156] DAMAGECOUNT value on done: 339546.0 [2023-02-24 19:17:13,491][177156] Sum rewards: 17.186, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.013', 'AMMO5': '0.012', 'AMMO2': '0.033', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.167', 'WEAPON5': '0.300', 'weapon5': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.452', 'HITCOUNT': '0.830', 'weapon2': '1.134', 'weapon3': '1.386', 'DAMAGECOUNT': '3.564', 'FRAGCOUNT': '13.000'} [2023-02-24 19:17:13,503][177156] DAMAGECOUNT value on done: 331718.0 [2023-02-24 19:17:13,503][177156] Sum rewards: 23.940, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.154', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO3': '0.115', 'AMMO4': '0.150', 'weapon5': '0.304', 'WEAPON5': '0.450', 'weapon2': '0.484', 'WEAPON4': '0.550', 'WEAPON3': '0.750', 'weapon4': '0.922', 'HITCOUNT': '1.790', 'weapon3': '1.870', 'DAMAGECOUNT': '6.660', 'FRAGCOUNT': '20.000'} [2023-02-24 19:17:13,805][177156] DAMAGECOUNT value on done: 348885.0 [2023-02-24 19:17:13,805][177156] Sum rewards: 13.148, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'AMMO2': '0.022', 'AMMO3': '0.065', 'weapon7': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'WEAPON4': '0.150', 'weapon5': '0.180', 'HEALTH': '0.210', 'WEAPON3': '0.350', 'HITCOUNT': '0.550', 'weapon3': '0.666', 'weapon2': '0.762', 'weapon4': '1.532', 'DAMAGECOUNT': '3.309', 'FRAGCOUNT': '10.000'} [2023-02-24 19:17:13,815][177156] DAMAGECOUNT value on done: 329796.0 [2023-02-24 19:17:13,815][177156] Sum rewards: 9.875, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.606', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.126', 'weapon5': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.240', 'weapon2': '0.632', 'WEAPON3': '0.850', 'HITCOUNT': '1.060', 'weapon3': '2.546', 'DAMAGECOUNT': '4.311', 'FRAGCOUNT': '10.000'} [2023-02-24 19:17:13,894][177158] DAMAGECOUNT value on done: 324964.0 [2023-02-24 19:17:13,895][177158] Sum rewards: 20.931, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.175', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.090', 'weapon7': '0.092', 'AMMO3': '0.117', 'AMMO4': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon4': '0.734', 'WEAPON3': '0.800', 'weapon2': '1.140', 'HITCOUNT': '1.300', 'weapon3': '1.666', 'DAMAGECOUNT': '6.375', 'FRAGCOUNT': '18.000'} [2023-02-24 19:17:14,195][177158] DAMAGECOUNT value on done: 330445.0 [2023-02-24 19:17:14,195][177158] Sum rewards: 15.973, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.367', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'AMMO4': '0.050', 'weapon7': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.154', 'weapon2': '0.184', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'weapon4': '0.602', 'HITCOUNT': '0.800', 'weapon3': '1.018', 'DAMAGECOUNT': '3.780', 'FRAGCOUNT': '12.000'} [2023-02-24 19:17:14,476][177158] DAMAGECOUNT value on done: 340056.0 [2023-02-24 19:17:14,477][177158] Sum rewards: 25.223, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.810', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.134', 'AMMO3': '0.138', 'WEAPON5': '0.200', 'weapon5': '0.302', 'WEAPON3': '0.700', 'weapon2': '1.268', 'HITCOUNT': '1.400', 'weapon3': '1.586', 'DAMAGECOUNT': '5.829', 'FRAGCOUNT': '21.000'} [2023-02-24 19:17:14,519][177153] Updated weights for policy 0, policy_version 23340 (0.0008) [2023-02-24 19:17:14,779][177158] DAMAGECOUNT value on done: 341560.0 [2023-02-24 19:17:14,780][177158] Sum rewards: 17.866, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.240', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.047', 'weapon7': '0.062', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.106', 'AMMO4': '0.235', 'weapon5': '0.314', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.584', 'WEAPON3': '0.650', 'weapon4': '0.896', 'weapon3': '1.430', 'HITCOUNT': '1.520', 'DAMAGECOUNT': '5.730', 'FRAGCOUNT': '16.000'} [2023-02-24 19:17:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13815.3). Total num frames: 95625216. Throughput: 0: 3460.2. Samples: 23907074. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 19:17:16,376][177119] Avg episode reward: [(0, '17.157')] [2023-02-24 19:17:17,487][177153] Updated weights for policy 0, policy_version 23350 (0.0009) [2023-02-24 19:17:18,202][177172] DAMAGECOUNT value on done: 334126.0 [2023-02-24 19:17:18,202][177172] Sum rewards: 19.846, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.494', 'AMMO5': '0.016', 'AMMO2': '0.021', 'AMMO4': '0.102', 'AMMO3': '0.121', 'WEAPON4': '0.200', 'weapon5': '0.258', 'weapon4': '0.324', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'weapon2': '0.842', 'HITCOUNT': '1.080', 'weapon3': '2.102', 'DAMAGECOUNT': '5.424', 'FRAGCOUNT': '17.000'} [2023-02-24 19:17:18,507][177172] DAMAGECOUNT value on done: 334716.0 [2023-02-24 19:17:18,507][177172] Sum rewards: 12.811, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.000', 'AMMO5': '0.017', 'AMMO2': '0.034', 'AMMO3': '0.123', 'AMMO4': '0.169', 'weapon5': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon4': '0.584', 'WEAPON3': '0.750', 'weapon2': '0.756', 'HITCOUNT': '1.190', 'weapon3': '1.976', 'DAMAGECOUNT': '4.566', 'FRAGCOUNT': '13.000'} [2023-02-24 19:17:19,595][177154] DAMAGECOUNT value on done: 337869.0 [2023-02-24 19:17:19,595][177154] Sum rewards: 17.415, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.902', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon5': '0.068', 'AMMO4': '0.082', 'weapon7': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.173', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.690', 'weapon2': '0.712', 'WEAPON3': '1.150', 'HITCOUNT': '1.460', 'weapon3': '2.064', 'DAMAGECOUNT': '6.111', 'FRAGCOUNT': '18.000'} [2023-02-24 19:17:19,897][177154] DAMAGECOUNT value on done: 346763.0 [2023-02-24 19:17:19,897][177154] Sum rewards: 17.851, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.017', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'HEALTH': '0.166', 'weapon5': '0.178', 'weapon4': '0.398', 'WEAPON5': '0.400', 'weapon2': '0.468', 'WEAPON3': '0.900', 'HITCOUNT': '1.240', 'weapon3': '2.668', 'DAMAGECOUNT': '5.217', 'FRAGCOUNT': '17.000'} [2023-02-24 19:17:19,946][177172] DAMAGECOUNT value on done: 347037.0 [2023-02-24 19:17:19,946][177172] Sum rewards: 19.778, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.512', 'AMMO2': '0.014', 'AMMO5': '0.016', 'AMMO4': '0.072', 'AMMO3': '0.099', 'WEAPON4': '0.300', 'weapon5': '0.316', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'weapon2': '0.756', 'ARMOR': '0.936', 'weapon4': '1.164', 'HITCOUNT': '1.420', 'weapon3': '1.462', 'DAMAGECOUNT': '5.385', 'FRAGCOUNT': '15.000'} [2023-02-24 19:17:20,195][177154] DAMAGECOUNT value on done: 349759.0 [2023-02-24 19:17:20,195][177154] Sum rewards: 6.698, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.347', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.035', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'weapon5': '0.156', 'weapon4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'HITCOUNT': '0.630', 'weapon2': '1.076', 'weapon3': '1.254', 'DAMAGECOUNT': '2.358', 'FRAGCOUNT': '5.000'} [2023-02-24 19:17:20,239][177172] DAMAGECOUNT value on done: 339759.0 [2023-02-24 19:17:20,240][177172] Sum rewards: 17.736, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.463', 'AMMO2': '0.003', 'weapon7': '0.010', 'AMMO4': '0.017', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.216', 'weapon4': '0.250', 'WEAPON5': '0.450', 'weapon2': '0.696', 'WEAPON3': '0.850', 'HITCOUNT': '1.300', 'weapon3': '2.046', 'DAMAGECOUNT': '4.743', 'FRAGCOUNT': '16.000'} [2023-02-24 19:17:20,440][177153] Updated weights for policy 0, policy_version 23360 (0.0008) [2023-02-24 19:17:20,499][177154] DAMAGECOUNT value on done: 351754.0 [2023-02-24 19:17:20,500][177154] Sum rewards: 21.025, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.719', 'AMMO2': '0.024', 'AMMO5': '0.029', 'AMMO4': '0.118', 'AMMO3': '0.139', 'WEAPON4': '0.250', 'weapon5': '0.356', 'weapon4': '0.436', 'WEAPON5': '0.600', 'weapon2': '0.706', 'WEAPON3': '0.950', 'HITCOUNT': '1.660', 'weapon3': '2.158', 'DAMAGECOUNT': '7.818', 'FRAGCOUNT': '18.000'} [2023-02-24 19:17:20,556][177157] DAMAGECOUNT value on done: 347001.0 [2023-02-24 19:17:20,556][177157] Sum rewards: 12.674, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.836', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon7': '0.050', 'AMMO3': '0.110', 'AMMO4': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon5': '0.338', 'ARMOR': '0.400', 'weapon2': '0.658', 'WEAPON3': '0.800', 'weapon4': '0.820', 'HITCOUNT': '1.310', 'weapon3': '1.682', 'DAMAGECOUNT': '5.205', 'FRAGCOUNT': '13.500'} [2023-02-24 19:17:20,826][177157] DAMAGECOUNT value on done: 331819.0 [2023-02-24 19:17:20,826][177157] Sum rewards: 12.426, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.424', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'weapon7': '0.092', 'AMMO3': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.260', 'WEAPON3': '0.750', 'HITCOUNT': '0.900', 'weapon2': '1.562', 'weapon3': '1.750', 'DAMAGECOUNT': '4.110', 'FRAGCOUNT': '11.000'} [2023-02-24 19:17:20,860][177157] DAMAGECOUNT value on done: 332082.0 [2023-02-24 19:17:20,860][177157] Sum rewards: 19.894, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.303', 'AMMO5': '0.020', 'AMMO2': '0.022', 'AMMO4': '0.107', 'AMMO3': '0.114', 'weapon2': '0.220', 'WEAPON4': '0.300', 'weapon5': '0.390', 'ARMOR': '0.434', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'weapon4': '1.032', 'HITCOUNT': '1.320', 'weapon3': '1.498', 'DAMAGECOUNT': '6.039', 'FRAGCOUNT': '16.000'} [2023-02-24 19:17:21,101][177171] DAMAGECOUNT value on done: 332914.0 [2023-02-24 19:17:21,102][177171] Sum rewards: 13.486, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon5': '0.126', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'weapon2': '0.572', 'HEALTH': '0.860', 'HITCOUNT': '1.080', 'weapon4': '1.132', 'weapon3': '1.374', 'DAMAGECOUNT': '4.044', 'FRAGCOUNT': '9.000'} [2023-02-24 19:17:21,113][177171] DAMAGECOUNT value on done: 334145.0 [2023-02-24 19:17:21,113][177171] Sum rewards: 27.149, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.960', 'AMMO2': '0.004', 'AMMO4': '0.017', 'AMMO5': '0.018', 'weapon5': '0.052', 'AMMO3': '0.111', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.444', 'weapon2': '0.476', 'WEAPON3': '0.800', 'HITCOUNT': '2.000', 'weapon3': '2.244', 'DAMAGECOUNT': '7.044', 'FRAGCOUNT': '22.000'} [2023-02-24 19:17:21,137][177157] DAMAGECOUNT value on done: 336967.0 [2023-02-24 19:17:21,138][177157] Sum rewards: 18.693, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.470', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.006', 'weapon4': '0.020', 'WEAPON4': '0.050', 'weapon7': '0.082', 'AMMO3': '0.085', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.130', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.600', 'HITCOUNT': '1.160', 'weapon3': '1.608', 'weapon2': '1.906', 'DAMAGECOUNT': '5.457', 'FRAGCOUNT': '16.000'} [2023-02-24 19:17:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.2, 300 sec: 13815.3). Total num frames: 95694848. Throughput: 0: 3462.0. Samples: 23917412. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 19:17:21,376][177119] Avg episode reward: [(0, '16.789')] [2023-02-24 19:17:21,411][177171] DAMAGECOUNT value on done: 337029.0 [2023-02-24 19:17:21,411][177171] Sum rewards: 18.155, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.453', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.048', 'AMMO3': '0.123', 'weapon5': '0.134', 'AMMO4': '0.240', 'weapon4': '0.342', 'WEAPON5': '0.400', 'weapon2': '0.570', 'WEAPON4': '0.600', 'WEAPON3': '0.900', 'HITCOUNT': '1.680', 'weapon3': '2.638', 'DAMAGECOUNT': '6.912', 'FRAGCOUNT': '19.000'} [2023-02-24 19:17:21,422][177171] DAMAGECOUNT value on done: 338625.0 [2023-02-24 19:17:21,422][177171] Sum rewards: 16.418, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.375', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.170', 'AMMO3': '0.187', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.376', 'weapon2': '0.510', 'WEAPON3': '1.100', 'HITCOUNT': '1.460', 'weapon3': '2.624', 'DAMAGECOUNT': '6.342', 'FRAGCOUNT': '18.000'} [2023-02-24 19:17:23,412][177153] Updated weights for policy 0, policy_version 23370 (0.0008) [2023-02-24 19:17:23,499][177155] DAMAGECOUNT value on done: 345195.0 [2023-02-24 19:17:23,499][177155] Sum rewards: 19.281, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.294', 'AMMO5': '0.005', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.154', 'WEAPON4': '0.300', 'weapon4': '0.428', 'weapon2': '0.832', 'WEAPON3': '0.900', 'HITCOUNT': '1.450', 'weapon3': '1.932', 'DAMAGECOUNT': '5.376', 'FRAGCOUNT': '20.000'} [2023-02-24 19:17:23,804][177155] DAMAGECOUNT value on done: 352395.0 [2023-02-24 19:17:23,804][177155] Sum rewards: 21.136, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.414', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.020', 'AMMO3': '0.091', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon5': '0.408', 'WEAPON3': '0.600', 'weapon4': '0.640', 'weapon2': '0.746', 'HITCOUNT': '1.550', 'weapon3': '1.696', 'DAMAGECOUNT': '6.921', 'FRAGCOUNT': '15.000'} [2023-02-24 19:17:24,103][177155] DAMAGECOUNT value on done: 348179.0 [2023-02-24 19:17:24,103][177155] Sum rewards: 15.414, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.250', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.034', 'weapon7': '0.052', 'AMMO3': '0.055', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'weapon2': '0.916', 'HITCOUNT': '1.070', 'weapon4': '1.198', 'weapon3': '1.446', 'DAMAGECOUNT': '4.152', 'FRAGCOUNT': '10.000'} [2023-02-24 19:17:24,406][177155] DAMAGECOUNT value on done: 332718.0 [2023-02-24 19:17:24,407][177155] Sum rewards: 17.243, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.013', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon7': '0.036', 'AMMO4': '0.071', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.110', 'WEAPON4': '0.250', 'weapon5': '0.304', 'WEAPON5': '0.350', 'weapon4': '0.506', 'weapon2': '0.576', 'WEAPON3': '0.700', 'HITCOUNT': '1.580', 'weapon3': '2.178', 'DAMAGECOUNT': '6.768', 'FRAGCOUNT': '13.500'} [2023-02-24 19:17:26,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13789.9, 300 sec: 13801.4). Total num frames: 95760384. Throughput: 0: 3459.9. Samples: 23938108. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 19:17:26,376][177119] Avg episode reward: [(0, '17.045')] [2023-02-24 19:17:26,394][177153] Updated weights for policy 0, policy_version 23380 (0.0008) [2023-02-24 19:17:28,554][177172] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 19:17:29,377][177153] Updated weights for policy 0, policy_version 23390 (0.0008) [2023-02-24 19:17:30,828][177170] DAMAGECOUNT value on done: 338530.0 [2023-02-24 19:17:30,828][177170] Sum rewards: 15.259, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.944', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'weapon4': '0.024', 'AMMO4': '0.041', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.250', 'weapon5': '0.320', 'WEAPON3': '0.650', 'weapon2': '1.090', 'HITCOUNT': '1.280', 'weapon3': '2.068', 'DAMAGECOUNT': '4.767', 'FRAGCOUNT': '11.500'} [2023-02-24 19:17:31,129][177170] DAMAGECOUNT value on done: 339470.0 [2023-02-24 19:17:31,130][177170] Sum rewards: 23.748, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.548', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO3': '0.075', 'AMMO4': '0.155', 'weapon5': '0.246', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'weapon2': '0.550', 'weapon4': '1.030', 'HITCOUNT': '1.370', 'weapon3': '1.792', 'DAMAGECOUNT': '6.381', 'FRAGCOUNT': '19.000'} [2023-02-24 19:17:31,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13789.9, 300 sec: 13801.4). Total num frames: 95830016. Throughput: 0: 3455.1. Samples: 23958764. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 19:17:31,376][177119] Avg episode reward: [(0, '16.967')] [2023-02-24 19:17:31,794][177170] DAMAGECOUNT value on done: 335791.0 [2023-02-24 19:17:31,794][177170] Sum rewards: 16.236, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon7': '0.056', 'HEALTH': '0.074', 'AMMO4': '0.083', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.260', 'weapon5': '0.296', 'WEAPON3': '0.500', 'HITCOUNT': '0.990', 'weapon2': '1.258', 'weapon3': '1.716', 'DAMAGECOUNT': '3.570', 'FRAGCOUNT': '14.000'} [2023-02-24 19:17:32,095][177170] DAMAGECOUNT value on done: 340626.0 [2023-02-24 19:17:32,096][177170] Sum rewards: 16.755, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.310', 'AMMO2': '0.004', 'AMMO5': '0.012', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.113', 'WEAPON5': '0.250', 'weapon5': '0.282', 'weapon4': '0.532', 'WEAPON3': '0.700', 'weapon2': '0.744', 'HITCOUNT': '1.320', 'weapon3': '2.064', 'DAMAGECOUNT': '4.473', 'FRAGCOUNT': '14.000'} [2023-02-24 19:17:32,357][177153] Updated weights for policy 0, policy_version 23400 (0.0008) [2023-02-24 19:17:33,004][177156] DAMAGECOUNT value on done: 341498.0 [2023-02-24 19:17:33,005][177156] Sum rewards: 17.709, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.469', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO4': '0.037', 'weapon5': '0.088', 'AMMO3': '0.118', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.582', 'weapon4': '0.594', 'WEAPON3': '0.800', 'HITCOUNT': '1.620', 'weapon3': '2.352', 'DAMAGECOUNT': '5.856', 'FRAGCOUNT': '14.000'} [2023-02-24 19:17:33,015][177156] DAMAGECOUNT value on done: 333382.0 [2023-02-24 19:17:33,016][177156] Sum rewards: 22.073, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.824', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO3': '0.121', 'AMMO4': '0.146', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.384', 'ARMOR': '0.404', 'weapon4': '0.482', 'WEAPON3': '0.750', 'weapon2': '0.800', 'HITCOUNT': '1.220', 'weapon3': '2.046', 'DAMAGECOUNT': '4.992', 'FRAGCOUNT': '20.000'} [2023-02-24 19:17:33,315][177156] DAMAGECOUNT value on done: 351253.0 [2023-02-24 19:17:33,316][177156] Sum rewards: 22.302, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.700', 'AMMO5': '0.025', 'AMMO2': '0.029', 'AMMO3': '0.139', 'AMMO4': '0.146', 'WEAPON4': '0.400', 'weapon5': '0.408', 'weapon4': '0.432', 'weapon2': '0.468', 'WEAPON5': '0.700', 'WEAPON3': '0.850', 'HITCOUNT': '1.500', 'weapon3': '2.300', 'DAMAGECOUNT': '7.104', 'FRAGCOUNT': '20.000'} [2023-02-24 19:17:33,328][177156] DAMAGECOUNT value on done: 332497.0 [2023-02-24 19:17:33,328][177156] Sum rewards: 31.259, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.672', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.016', 'AMMO3': '0.115', 'WEAPON4': '0.200', 'weapon5': '0.282', 'WEAPON5': '0.300', 'weapon4': '0.364', 'WEAPON3': '0.800', 'weapon2': '0.850', 'HITCOUNT': '2.050', 'weapon3': '2.098', 'DAMAGECOUNT': '8.103', 'FRAGCOUNT': '26.000'} [2023-02-24 19:17:33,355][177158] DAMAGECOUNT value on done: 326782.0 [2023-02-24 19:17:33,356][177158] Sum rewards: 17.770, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.535', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.019', 'AMMO4': '0.092', 'AMMO3': '0.140', 'weapon4': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon5': '0.330', 'weapon2': '0.544', 'WEAPON3': '0.850', 'HITCOUNT': '1.350', 'weapon3': '2.566', 'DAMAGECOUNT': '5.454', 'FRAGCOUNT': '17.000'} [2023-02-24 19:17:33,658][177158] DAMAGECOUNT value on done: 332630.0 [2023-02-24 19:17:33,659][177158] Sum rewards: 25.161, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.104', 'AMMO3': '0.125', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.470', 'HEALTH': '0.516', 'weapon2': '0.564', 'WEAPON3': '0.700', 'HITCOUNT': '1.800', 'weapon3': '2.618', 'DAMAGECOUNT': '6.555', 'FRAGCOUNT': '21.000'} [2023-02-24 19:17:33,945][177158] DAMAGECOUNT value on done: 341656.0 [2023-02-24 19:17:33,945][177158] Sum rewards: 16.620, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.178', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.100', 'weapon5': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'WEAPON3': '0.650', 'weapon4': '0.834', 'weapon2': '0.898', 'HITCOUNT': '1.380', 'weapon3': '1.766', 'DAMAGECOUNT': '4.800', 'FRAGCOUNT': '14.000'} [2023-02-24 19:17:34,240][177158] DAMAGECOUNT value on done: 343410.0 [2023-02-24 19:17:34,240][177158] Sum rewards: 20.361, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.863', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon7': '0.048', 'AMMO4': '0.098', 'AMMO3': '0.148', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.516', 'weapon4': '0.522', 'WEAPON3': '0.950', 'HITCOUNT': '1.450', 'weapon3': '2.222', 'DAMAGECOUNT': '5.550', 'FRAGCOUNT': '19.000'} [2023-02-24 19:17:35,309][177153] Updated weights for policy 0, policy_version 23410 (0.0008) [2023-02-24 19:17:36,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13789.9, 300 sec: 13801.4). Total num frames: 95899648. Throughput: 0: 3453.6. Samples: 23969100. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 19:17:36,376][177119] Avg episode reward: [(0, '17.246')] [2023-02-24 19:17:37,696][177172] DAMAGECOUNT value on done: 335596.0 [2023-02-24 19:17:37,696][177172] Sum rewards: 10.690, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.992', 'ARMOR': '0.004', 'weapon7': '0.018', 'AMMO5': '0.020', 'AMMO2': '0.042', 'AMMO3': '0.114', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.211', 'weapon5': '0.316', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon4': '0.658', 'WEAPON3': '0.700', 'weapon2': '0.726', 'HITCOUNT': '1.120', 'weapon3': '1.742', 'DAMAGECOUNT': '4.410', 'FRAGCOUNT': '12.000'} [2023-02-24 19:17:38,002][177172] DAMAGECOUNT value on done: 336613.0 [2023-02-24 19:17:38,002][177172] Sum rewards: 17.542, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.898', 'AMMO2': '0.015', 'AMMO5': '0.016', 'AMMO4': '0.076', 'AMMO3': '0.117', 'WEAPON4': '0.250', 'weapon5': '0.366', 'WEAPON5': '0.400', 'weapon2': '0.470', 'weapon4': '0.702', 'WEAPON3': '0.750', 'HITCOUNT': '1.440', 'weapon3': '1.896', 'DAMAGECOUNT': '5.691', 'FRAGCOUNT': '15.500'} [2023-02-24 19:17:38,274][177153] Updated weights for policy 0, policy_version 23420 (0.0008) [2023-02-24 19:17:39,107][177154] DAMAGECOUNT value on done: 339865.0 [2023-02-24 19:17:39,108][177154] Sum rewards: 21.175, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.790', 'AMMO2': '0.012', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'AMMO3': '0.140', 'weapon5': '0.232', 'weapon2': '0.284', 'weapon4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.900', 'HITCOUNT': '1.400', 'weapon3': '2.914', 'DAMAGECOUNT': '5.988', 'FRAGCOUNT': '19.000'} [2023-02-24 19:17:39,416][177154] DAMAGECOUNT value on done: 349148.0 [2023-02-24 19:17:39,416][177154] Sum rewards: 24.653, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.105', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.090', 'AMMO3': '0.129', 'WEAPON4': '0.300', 'weapon2': '0.608', 'WEAPON3': '0.700', 'weapon4': '0.864', 'HITCOUNT': '1.860', 'weapon3': '2.224', 'DAMAGECOUNT': '7.155', 'FRAGCOUNT': '22.000'} [2023-02-24 19:17:39,457][177172] DAMAGECOUNT value on done: 349006.0 [2023-02-24 19:17:39,457][177172] Sum rewards: 18.627, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.580', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'AMMO5': '0.021', 'AMMO4': '0.100', 'AMMO3': '0.115', 'WEAPON4': '0.300', 'weapon5': '0.494', 'WEAPON5': '0.500', 'weapon4': '0.534', 'weapon2': '0.640', 'WEAPON3': '0.700', 'HITCOUNT': '1.370', 'weapon3': '1.986', 'DAMAGECOUNT': '5.907', 'FRAGCOUNT': '17.000'} [2023-02-24 19:17:39,708][177154] DAMAGECOUNT value on done: 352488.0 [2023-02-24 19:17:39,709][177154] Sum rewards: 26.766, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.102', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'AMMO3': '0.168', 'AMMO4': '0.182', 'weapon5': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.482', 'weapon2': '0.594', 'WEAPON3': '1.100', 'HITCOUNT': '2.140', 'weapon3': '2.484', 'DAMAGECOUNT': '8.187', 'FRAGCOUNT': '24.000'} [2023-02-24 19:17:39,762][177172] DAMAGECOUNT value on done: 341698.0 [2023-02-24 19:17:39,763][177172] Sum rewards: 19.191, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.796', 'AMMO5': '0.017', 'AMMO2': '0.025', 'AMMO4': '0.126', 'AMMO3': '0.138', 'WEAPON4': '0.250', 'weapon4': '0.256', 'WEAPON5': '0.300', 'weapon5': '0.316', 'ARMOR': '0.400', 'weapon2': '0.522', 'WEAPON3': '0.850', 'HITCOUNT': '1.410', 'weapon3': '2.560', 'DAMAGECOUNT': '5.817', 'FRAGCOUNT': '19.000'} [2023-02-24 19:17:40,012][177154] DAMAGECOUNT value on done: 353235.0 [2023-02-24 19:17:40,013][177154] Sum rewards: 18.582, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.096', 'weapon4': '0.130', 'weapon5': '0.244', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'weapon2': '0.996', 'HEALTH': '1.106', 'HITCOUNT': '1.200', 'weapon3': '2.198', 'DAMAGECOUNT': '4.443', 'FRAGCOUNT': '14.000'} [2023-02-24 19:17:40,083][177157] DAMAGECOUNT value on done: 348850.0 [2023-02-24 19:17:40,084][177157] Sum rewards: 17.437, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.710', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'weapon4': '0.124', 'AMMO3': '0.131', 'AMMO4': '0.155', 'weapon5': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'weapon2': '0.826', 'HITCOUNT': '1.340', 'weapon3': '2.226', 'DAMAGECOUNT': '5.547', 'FRAGCOUNT': '18.000'} [2023-02-24 19:17:40,308][177157] DAMAGECOUNT value on done: 334264.0 [2023-02-24 19:17:40,309][177157] Sum rewards: 24.878, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.180', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.039', 'WEAPON5': '0.050', 'AMMO3': '0.160', 'AMMO4': '0.195', 'WEAPON4': '0.400', 'ARMOR': '0.462', 'weapon4': '0.582', 'weapon2': '0.734', 'WEAPON3': '0.900', 'HITCOUNT': '1.730', 'weapon3': '2.448', 'DAMAGECOUNT': '7.335', 'FRAGCOUNT': '23.000'} [2023-02-24 19:17:40,394][177157] DAMAGECOUNT value on done: 334365.0 [2023-02-24 19:17:40,395][177157] Sum rewards: 25.424, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.117', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'HEALTH': '0.210', 'WEAPON4': '0.250', 'weapon5': '0.300', 'weapon4': '0.610', 'WEAPON3': '0.650', 'weapon2': '1.062', 'HITCOUNT': '1.370', 'weapon3': '1.574', 'DAMAGECOUNT': '6.849', 'FRAGCOUNT': '20.000'} [2023-02-24 19:17:40,594][177171] DAMAGECOUNT value on done: 335478.0 [2023-02-24 19:17:40,595][177171] Sum rewards: 24.368, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.682', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.171', 'weapon5': '0.216', 'weapon4': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.806', 'WEAPON3': '1.150', 'HITCOUNT': '1.750', 'weapon3': '2.492', 'DAMAGECOUNT': '7.692', 'FRAGCOUNT': '23.000'} [2023-02-24 19:17:40,611][177171] DAMAGECOUNT value on done: 336050.0 [2023-02-24 19:17:40,612][177171] Sum rewards: 19.287, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.631', 'AMMO5': '0.028', 'WEAPON1': '0.030', 'AMMO2': '0.045', 'AMMO3': '0.149', 'AMMO4': '0.223', 'weapon2': '0.412', 'WEAPON4': '0.450', 'weapon5': '0.460', 'weapon4': '0.636', 'WEAPON5': '0.650', 'WEAPON3': '0.900', 'HITCOUNT': '1.430', 'weapon3': '2.040', 'DAMAGECOUNT': '5.715', 'FRAGCOUNT': '20.000'} [2023-02-24 19:17:40,629][177157] DAMAGECOUNT value on done: 339108.0 [2023-02-24 19:17:40,629][177157] Sum rewards: 22.050, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.960', 'AMMO5': '0.011', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'AMMO4': '0.122', 'AMMO3': '0.126', 'weapon2': '0.174', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.350', 'weapon5': '0.400', 'ARMOR': '0.435', 'WEAPON4': '0.550', 'WEAPON3': '0.800', 'weapon3': '1.136', 'HITCOUNT': '1.460', 'weapon4': '1.608', 'DAMAGECOUNT': '6.423', 'FRAGCOUNT': '19.000'} [2023-02-24 19:17:40,906][177171] DAMAGECOUNT value on done: 338858.0 [2023-02-24 19:17:40,907][177171] Sum rewards: 20.117, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.266', 'AMMO2': '0.015', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'weapon7': '0.066', 'AMMO4': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.134', 'weapon5': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.350', 'weapon2': '0.644', 'WEAPON3': '0.850', 'weapon4': '0.960', 'HITCOUNT': '1.170', 'weapon3': '1.750', 'DAMAGECOUNT': '5.487', 'FRAGCOUNT': '19.000'} [2023-02-24 19:17:40,917][177171] DAMAGECOUNT value on done: 340383.0 [2023-02-24 19:17:40,918][177171] Sum rewards: 24.835, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.609', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.089', 'weapon4': '0.192', 'WEAPON5': '0.200', 'weapon5': '0.288', 'WEAPON3': '0.650', 'weapon2': '1.292', 'HITCOUNT': '1.500', 'weapon3': '1.824', 'DAMAGECOUNT': '5.274', 'FRAGCOUNT': '20.000'} [2023-02-24 19:17:41,240][177153] Updated weights for policy 0, policy_version 23430 (0.0008) [2023-02-24 19:17:41,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13801.4). Total num frames: 95969280. Throughput: 0: 3450.8. Samples: 23989782. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 19:17:41,376][177119] Avg episode reward: [(0, '17.787')] [2023-02-24 19:17:41,394][177155] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 19:17:43,031][177155] DAMAGECOUNT value on done: 347265.0 [2023-02-24 19:17:43,032][177155] Sum rewards: 25.138, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.540', 'AMMO2': '0.006', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.031', 'AMMO3': '0.134', 'WEAPON4': '0.200', 'weapon5': '0.382', 'WEAPON5': '0.400', 'weapon2': '0.426', 'ARMOR': '0.455', 'weapon4': '0.620', 'WEAPON3': '0.850', 'HITCOUNT': '1.740', 'weapon3': '2.188', 'DAMAGECOUNT': '6.210', 'FRAGCOUNT': '22.000'} [2023-02-24 19:17:43,333][177155] DAMAGECOUNT value on done: 354437.0 [2023-02-24 19:17:43,334][177155] Sum rewards: 16.999, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.712', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.026', 'weapon4': '0.044', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'weapon5': '0.180', 'AMMO3': '0.197', 'WEAPON5': '0.500', 'weapon2': '0.852', 'WEAPON3': '1.150', 'HITCOUNT': '1.490', 'weapon3': '2.574', 'DAMAGECOUNT': '6.126', 'FRAGCOUNT': '17.000'} [2023-02-24 19:17:43,578][177155] DAMAGECOUNT value on done: 351221.0 [2023-02-24 19:17:43,578][177155] Sum rewards: 33.750, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.641', 'AMMO2': '0.010', 'AMMO5': '0.019', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'AMMO3': '0.163', 'weapon4': '0.244', 'weapon5': '0.432', 'weapon2': '0.452', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'HITCOUNT': '1.750', 'weapon3': '2.498', 'DAMAGECOUNT': '9.126', 'FRAGCOUNT': '28.000'} [2023-02-24 19:17:43,877][177155] DAMAGECOUNT value on done: 333872.0 [2023-02-24 19:17:43,878][177155] Sum rewards: 10.357, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.120', 'AMMO2': '0.007', 'AMMO5': '0.013', 'AMMO4': '0.033', 'WEAPON1': '0.040', 'AMMO3': '0.077', 'WEAPON4': '0.150', 'weapon4': '0.320', 'weapon5': '0.396', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'HITCOUNT': '0.690', 'weapon2': '0.756', 'weapon3': '1.082', 'DAMAGECOUNT': '3.462', 'FRAGCOUNT': '9.500'} [2023-02-24 19:17:44,179][177153] Updated weights for policy 0, policy_version 23440 (0.0008) [2023-02-24 19:17:46,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.2, 300 sec: 13815.3). Total num frames: 96038912. Throughput: 0: 3453.7. Samples: 24010706. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 19:17:46,376][177119] Avg episode reward: [(0, '17.867')] [2023-02-24 19:17:47,123][177153] Updated weights for policy 0, policy_version 23450 (0.0007) [2023-02-24 19:17:50,101][177153] Updated weights for policy 0, policy_version 23460 (0.0008) [2023-02-24 19:17:50,195][177170] DAMAGECOUNT value on done: 340819.0 [2023-02-24 19:17:50,196][177170] Sum rewards: 19.410, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.578', 'ARMOR': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO2': '0.040', 'AMMO3': '0.157', 'weapon5': '0.170', 'AMMO4': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.430', 'WEAPON4': '0.550', 'weapon4': '0.854', 'WEAPON3': '0.950', 'HITCOUNT': '1.820', 'weapon3': '2.032', 'DAMAGECOUNT': '6.867', 'FRAGCOUNT': '18.000'} [2023-02-24 19:17:50,502][177170] DAMAGECOUNT value on done: 341818.0 [2023-02-24 19:17:50,503][177170] Sum rewards: 22.289, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.072', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO3': '0.074', 'weapon7': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.173', 'weapon5': '0.194', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.468', 'WEAPON3': '0.500', 'WEAPON4': '0.600', 'weapon3': '0.712', 'HITCOUNT': '1.260', 'weapon4': '1.964', 'DAMAGECOUNT': '7.044', 'FRAGCOUNT': '19.500'} [2023-02-24 19:17:51,152][177170] DAMAGECOUNT value on done: 337878.0 [2023-02-24 19:17:51,152][177170] Sum rewards: 24.793, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.786', 'AMMO5': '0.015', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'AMMO3': '0.101', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'weapon4': '0.324', 'weapon5': '0.398', 'WEAPON5': '0.400', 'weapon2': '0.546', 'WEAPON3': '0.800', 'HITCOUNT': '1.620', 'weapon3': '2.294', 'DAMAGECOUNT': '6.261', 'FRAGCOUNT': '21.000'} [2023-02-24 19:17:51,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13815.3). Total num frames: 96108544. Throughput: 0: 3455.3. Samples: 24021088. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 19:17:51,376][177119] Avg episode reward: [(0, '18.086')] [2023-02-24 19:17:51,445][177170] DAMAGECOUNT value on done: 341775.0 [2023-02-24 19:17:51,445][177170] Sum rewards: 14.622, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.565', 'AMMO2': '0.005', 'AMMO5': '0.011', 'AMMO4': '0.024', 'WEAPON1': '0.040', 'AMMO3': '0.042', 'WEAPON4': '0.050', 'weapon7': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.270', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.464', 'weapon4': '0.686', 'HITCOUNT': '0.690', 'weapon3': '1.398', 'DAMAGECOUNT': '3.447', 'FRAGCOUNT': '10.000'} [2023-02-24 19:17:52,482][177156] DAMAGECOUNT value on done: 343601.0 [2023-02-24 19:17:52,482][177156] Sum rewards: 23.043, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.547', 'AMMO5': '0.022', 'AMMO2': '0.048', 'AMMO3': '0.109', 'weapon5': '0.236', 'AMMO4': '0.241', 'weapon2': '0.312', 'ARMOR': '0.456', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '0.650', 'weapon4': '1.406', 'HITCOUNT': '1.540', 'weapon3': '1.660', 'DAMAGECOUNT': '6.309', 'FRAGCOUNT': '21.000'} [2023-02-24 19:17:52,493][177156] DAMAGECOUNT value on done: 334911.0 [2023-02-24 19:17:52,493][177156] Sum rewards: 17.326, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.272', 'AMMO5': '0.009', 'AMMO2': '0.043', 'AMMO3': '0.084', 'weapon5': '0.110', 'weapon7': '0.172', 'WEAPON5': '0.200', 'AMMO4': '0.213', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'WEAPON3': '0.600', 'weapon2': '0.600', 'weapon4': '0.612', 'HITCOUNT': '1.160', 'weapon3': '2.068', 'DAMAGECOUNT': '4.587', 'FRAGCOUNT': '15.000'} [2023-02-24 19:17:52,739][177158] DAMAGECOUNT value on done: 328197.0 [2023-02-24 19:17:52,740][177158] Sum rewards: 15.151, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.070', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO3': '0.066', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'weapon5': '0.246', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'weapon4': '0.668', 'weapon2': '0.826', 'HITCOUNT': '1.130', 'weapon3': '1.226', 'DAMAGECOUNT': '4.245', 'FRAGCOUNT': '12.000'} [2023-02-24 19:17:52,780][177156] DAMAGECOUNT value on done: 353282.0 [2023-02-24 19:17:52,781][177156] Sum rewards: 21.846, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.450', 'AMMO2': '0.005', 'AMMO4': '0.027', 'AMMO5': '0.027', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.132', 'AMMO3': '0.158', 'weapon5': '0.294', 'weapon2': '0.398', 'WEAPON5': '0.600', 'WEAPON3': '1.000', 'HITCOUNT': '1.300', 'weapon3': '2.678', 'DAMAGECOUNT': '6.087', 'FRAGCOUNT': '21.000'} [2023-02-24 19:17:52,812][177156] DAMAGECOUNT value on done: 335030.0 [2023-02-24 19:17:52,812][177156] Sum rewards: 31.266, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.250', 'AMMO5': '0.011', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'weapon5': '0.248', 'WEAPON5': '0.250', 'weapon4': '0.322', 'weapon2': '0.486', 'WEAPON3': '0.800', 'HITCOUNT': '1.880', 'weapon3': '2.626', 'DAMAGECOUNT': '7.599', 'FRAGCOUNT': '26.000'} [2023-02-24 19:17:53,041][177158] DAMAGECOUNT value on done: 334685.0 [2023-02-24 19:17:53,042][177158] Sum rewards: 24.038, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.640', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'AMMO5': '0.017', 'WEAPON1': '0.080', 'AMMO3': '0.093', 'weapon5': '0.390', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon2': '0.774', 'HITCOUNT': '1.360', 'weapon3': '2.350', 'DAMAGECOUNT': '6.165', 'FRAGCOUNT': '18.500'} [2023-02-24 19:17:53,103][177153] Updated weights for policy 0, policy_version 23470 (0.0008) [2023-02-24 19:17:53,330][177158] DAMAGECOUNT value on done: 344052.0 [2023-02-24 19:17:53,330][177158] Sum rewards: 25.344, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.640', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.131', 'weapon2': '0.198', 'weapon5': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.424', 'WEAPON3': '0.850', 'weapon4': '1.018', 'HITCOUNT': '1.890', 'weapon3': '2.228', 'DAMAGECOUNT': '7.188', 'FRAGCOUNT': '21.000'} [2023-02-24 19:17:53,634][177158] DAMAGECOUNT value on done: 345805.0 [2023-02-24 19:17:53,635][177158] Sum rewards: 23.688, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.260', 'AMMO2': '0.011', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.147', 'weapon4': '0.214', 'weapon5': '0.272', 'WEAPON5': '0.450', 'weapon2': '0.466', 'WEAPON3': '0.950', 'HITCOUNT': '1.700', 'weapon3': '2.612', 'DAMAGECOUNT': '7.185', 'FRAGCOUNT': '19.000'} [2023-02-24 19:17:54,548][177154] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 19:17:56,063][177153] Updated weights for policy 0, policy_version 23480 (0.0008) [2023-02-24 19:17:56,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.2, 300 sec: 13815.3). Total num frames: 96178176. Throughput: 0: 3454.2. Samples: 24041758. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:17:56,377][177119] Avg episode reward: [(0, '18.521')] [2023-02-24 19:17:57,161][177172] DAMAGECOUNT value on done: 337063.0 [2023-02-24 19:17:57,161][177172] Sum rewards: 15.698, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.046', 'AMMO5': '0.017', 'AMMO2': '0.027', 'AMMO4': '0.136', 'AMMO3': '0.148', 'weapon5': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.370', 'ARMOR': '0.800', 'WEAPON3': '0.900', 'weapon4': '1.024', 'HITCOUNT': '1.230', 'weapon3': '1.942', 'DAMAGECOUNT': '4.401', 'FRAGCOUNT': '14.000'} [2023-02-24 19:17:57,468][177172] DAMAGECOUNT value on done: 338513.0 [2023-02-24 19:17:57,468][177172] Sum rewards: 17.517, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.985', 'AMMO5': '0.028', 'WEAPON1': '0.040', 'AMMO2': '0.043', 'AMMO3': '0.121', 'weapon2': '0.204', 'AMMO4': '0.213', 'weapon5': '0.360', 'ARMOR': '0.448', 'WEAPON4': '0.500', 'weapon4': '0.664', 'WEAPON5': '0.700', 'WEAPON3': '0.850', 'HITCOUNT': '1.360', 'weapon3': '2.322', 'DAMAGECOUNT': '5.400', 'FRAGCOUNT': '17.000'} [2023-02-24 19:17:58,549][177154] DAMAGECOUNT value on done: 341813.0 [2023-02-24 19:17:58,549][177154] Sum rewards: 18.436, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.710', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO3': '0.160', 'weapon5': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon2': '1.108', 'HITCOUNT': '1.350', 'weapon3': '2.282', 'DAMAGECOUNT': '5.844', 'FRAGCOUNT': '17.000'} [2023-02-24 19:17:58,846][177154] DAMAGECOUNT value on done: 351429.0 [2023-02-24 19:17:58,847][177154] Sum rewards: 24.053, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.675', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'weapon7': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.266', 'weapon2': '0.416', 'weapon4': '0.534', 'WEAPON3': '0.700', 'HITCOUNT': '1.110', 'weapon3': '1.778', 'DAMAGECOUNT': '5.997', 'FRAGCOUNT': '19.000'} [2023-02-24 19:17:58,985][177172] DAMAGECOUNT value on done: 350858.0 [2023-02-24 19:17:58,986][177172] Sum rewards: 20.134, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.079', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO5': '0.025', 'AMMO4': '0.080', 'AMMO3': '0.114', 'weapon5': '0.162', 'WEAPON4': '0.250', 'weapon2': '0.332', 'weapon4': '0.480', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'HITCOUNT': '1.670', 'weapon3': '2.518', 'DAMAGECOUNT': '5.556', 'FRAGCOUNT': '17.000'} [2023-02-24 19:17:59,046][177153] Updated weights for policy 0, policy_version 23490 (0.0008) [2023-02-24 19:17:59,149][177154] DAMAGECOUNT value on done: 354358.0 [2023-02-24 19:17:59,150][177154] Sum rewards: 22.958, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.750', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.136', 'WEAPON5': '0.300', 'weapon5': '0.436', 'WEAPON3': '0.600', 'weapon2': '0.766', 'HITCOUNT': '1.400', 'weapon3': '2.256', 'DAMAGECOUNT': '5.610', 'FRAGCOUNT': '18.000'} [2023-02-24 19:17:59,296][177172] DAMAGECOUNT value on done: 343973.0 [2023-02-24 19:17:59,297][177172] Sum rewards: 22.487, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.362', 'AMMO2': '0.003', 'AMMO5': '0.015', 'AMMO4': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.120', 'WEAPON4': '0.200', 'weapon5': '0.400', 'weapon4': '0.486', 'weapon2': '0.488', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'HITCOUNT': '1.470', 'weapon3': '2.106', 'DAMAGECOUNT': '6.825', 'FRAGCOUNT': '18.000'} [2023-02-24 19:17:59,452][177154] DAMAGECOUNT value on done: 354871.0 [2023-02-24 19:17:59,453][177154] Sum rewards: 12.860, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.400', 'AMMO5': '0.016', 'AMMO2': '0.031', 'AMMO3': '0.084', 'AMMO4': '0.156', 'weapon5': '0.160', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '0.600', 'weapon4': '0.646', 'weapon2': '0.738', 'HITCOUNT': '1.340', 'weapon3': '1.580', 'DAMAGECOUNT': '4.908', 'FRAGCOUNT': '11.500'} [2023-02-24 19:17:59,496][177157] DAMAGECOUNT value on done: 351065.0 [2023-02-24 19:17:59,497][177157] Sum rewards: 24.414, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.940', 'AMMO5': '0.006', 'AMMO2': '0.026', 'AMMO3': '0.061', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'weapon5': '0.240', 'WEAPON4': '0.250', 'WEAPON3': '0.500', 'weapon2': '0.846', 'weapon4': '0.852', 'HITCOUNT': '1.650', 'weapon3': '1.750', 'DAMAGECOUNT': '6.645', 'FRAGCOUNT': '19.000'} [2023-02-24 19:17:59,717][177157] DAMAGECOUNT value on done: 336502.0 [2023-02-24 19:17:59,717][177157] Sum rewards: 22.740, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.930', 'AMMO5': '0.006', 'AMMO2': '0.018', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'weapon4': '0.118', 'AMMO3': '0.136', 'WEAPON5': '0.150', 'weapon5': '0.174', 'ARMOR': '0.491', 'WEAPON3': '0.800', 'weapon2': '1.048', 'HITCOUNT': '1.800', 'weapon3': '2.276', 'DAMAGECOUNT': '6.714', 'FRAGCOUNT': '18.000'} [2023-02-24 19:17:59,807][177157] DAMAGECOUNT value on done: 336550.0 [2023-02-24 19:17:59,807][177157] Sum rewards: 22.276, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.590', 'AMMO2': '0.015', 'AMMO5': '0.023', 'weapon5': '0.066', 'AMMO4': '0.076', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'weapon4': '0.196', 'WEAPON5': '0.450', 'weapon2': '0.864', 'WEAPON3': '0.950', 'HITCOUNT': '1.750', 'weapon3': '2.634', 'DAMAGECOUNT': '6.555', 'FRAGCOUNT': '19.000'} [2023-02-24 19:18:00,024][177157] DAMAGECOUNT value on done: 340540.0 [2023-02-24 19:18:00,024][177157] Sum rewards: 11.384, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.025', 'WEAPON1': '0.030', 'AMMO2': '0.046', 'AMMO3': '0.060', 'HEALTH': '0.114', 'AMMO4': '0.232', 'weapon4': '0.304', 'WEAPON3': '0.350', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon5': '0.610', 'weapon2': '0.782', 'HITCOUNT': '0.820', 'weapon3': '1.714', 'DAMAGECOUNT': '4.296', 'FRAGCOUNT': '10.000'} [2023-02-24 19:18:00,093][177171] DAMAGECOUNT value on done: 337029.0 [2023-02-24 19:18:00,094][177171] Sum rewards: 17.720, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.085', 'AMMO2': '0.005', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.023', 'AMMO3': '0.050', 'WEAPON4': '0.200', 'weapon2': '0.444', 'WEAPON3': '0.450', 'WEAPON5': '0.500', 'weapon5': '0.508', 'weapon4': '0.826', 'HITCOUNT': '0.990', 'weapon3': '1.620', 'DAMAGECOUNT': '4.653', 'FRAGCOUNT': '13.000'} [2023-02-24 19:18:00,105][177171] DAMAGECOUNT value on done: 338102.0 [2023-02-24 19:18:00,105][177171] Sum rewards: 24.052, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.069', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'AMMO3': '0.117', 'AMMO4': '0.134', 'WEAPON4': '0.200', 'weapon4': '0.260', 'weapon5': '0.330', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon2': '0.914', 'HITCOUNT': '1.300', 'weapon3': '2.094', 'DAMAGECOUNT': '6.156', 'FRAGCOUNT': '20.500'} [2023-02-24 19:18:00,399][177171] DAMAGECOUNT value on done: 341467.0 [2023-02-24 19:18:00,400][177171] Sum rewards: 19.984, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.022', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.064', 'weapon5': '0.110', 'AMMO3': '0.143', 'AMMO4': '0.322', 'weapon2': '0.422', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '0.800', 'weapon4': '1.004', 'HITCOUNT': '1.930', 'weapon3': '2.002', 'DAMAGECOUNT': '7.827', 'FRAGCOUNT': '18.000'} [2023-02-24 19:18:00,410][177171] DAMAGECOUNT value on done: 342628.0 [2023-02-24 19:18:00,411][177171] Sum rewards: 23.363, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.540', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.077', 'AMMO4': '0.144', 'weapon5': '0.268', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.742', 'weapon2': '0.868', 'weapon3': '1.498', 'HITCOUNT': '1.760', 'DAMAGECOUNT': '6.735', 'FRAGCOUNT': '18.000'} [2023-02-24 19:18:01,376][177119] Fps is (10 sec: 13516.7, 60 sec: 13789.9, 300 sec: 13801.4). Total num frames: 96243712. Throughput: 0: 3450.2. Samples: 24062332. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:18:01,376][177119] Avg episode reward: [(0, '19.050')] [2023-02-24 19:18:02,028][177153] Updated weights for policy 0, policy_version 23500 (0.0008) [2023-02-24 19:18:02,538][177155] DAMAGECOUNT value on done: 349496.0 [2023-02-24 19:18:02,538][177155] Sum rewards: 25.951, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.764', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'WEAPON5': '0.250', 'weapon5': '0.306', 'WEAPON3': '0.800', 'weapon2': '0.824', 'HITCOUNT': '1.510', 'weapon3': '2.456', 'DAMAGECOUNT': '6.693', 'FRAGCOUNT': '21.000'} [2023-02-24 19:18:02,834][177155] DAMAGECOUNT value on done: 356141.0 [2023-02-24 19:18:02,835][177155] Sum rewards: 19.702, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.753', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.042', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'weapon4': '0.236', 'weapon5': '0.344', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '1.170', 'weapon3': '1.536', 'weapon2': '1.704', 'DAMAGECOUNT': '5.112', 'FRAGCOUNT': '16.000'} [2023-02-24 19:18:03,049][177155] DAMAGECOUNT value on done: 354254.0 [2023-02-24 19:18:03,050][177155] Sum rewards: 31.708, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.227', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO3': '0.137', 'AMMO4': '0.207', 'WEAPON4': '0.250', 'weapon5': '0.354', 'WEAPON5': '0.400', 'weapon2': '0.592', 'weapon4': '0.650', 'WEAPON3': '0.850', 'HITCOUNT': '1.760', 'weapon3': '2.080', 'DAMAGECOUNT': '9.099', 'FRAGCOUNT': '27.000'} [2023-02-24 19:18:03,354][177155] DAMAGECOUNT value on done: 335666.0 [2023-02-24 19:18:03,354][177155] Sum rewards: 25.135, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.963', 'AMMO2': '0.012', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.057', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'weapon5': '0.258', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'weapon4': '0.576', 'weapon2': '0.684', 'WEAPON3': '0.850', 'HITCOUNT': '1.380', 'weapon3': '2.164', 'DAMAGECOUNT': '5.382', 'FRAGCOUNT': '21.000'} [2023-02-24 19:18:04,974][177153] Updated weights for policy 0, policy_version 23510 (0.0008) [2023-02-24 19:18:06,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13789.9, 300 sec: 13801.4). Total num frames: 96313344. Throughput: 0: 3451.8. Samples: 24072744. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:18:06,376][177119] Avg episode reward: [(0, '19.572')] [2023-02-24 19:18:07,933][177153] Updated weights for policy 0, policy_version 23520 (0.0008) [2023-02-24 19:18:09,636][177170] DAMAGECOUNT value on done: 342610.0 [2023-02-24 19:18:09,636][177170] Sum rewards: 18.238, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.889', 'AMMO2': '0.012', 'AMMO5': '0.012', 'AMMO4': '0.062', 'AMMO3': '0.083', 'weapon5': '0.140', 'weapon4': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.465', 'WEAPON3': '0.600', 'HITCOUNT': '1.210', 'weapon2': '1.392', 'weapon3': '1.760', 'DAMAGECOUNT': '5.148', 'FRAGCOUNT': '15.000'} [2023-02-24 19:18:09,936][177170] DAMAGECOUNT value on done: 343974.0 [2023-02-24 19:18:09,937][177170] Sum rewards: 22.757, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.135', 'AMMO5': '0.014', 'AMMO2': '0.033', 'WEAPON1': '0.040', 'AMMO3': '0.095', 'AMMO4': '0.164', 'weapon5': '0.280', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.610', 'WEAPON3': '0.650', 'weapon4': '0.854', 'HITCOUNT': '1.510', 'weapon3': '1.874', 'DAMAGECOUNT': '6.468', 'FRAGCOUNT': '18.000'} [2023-02-24 19:18:10,600][177170] DAMAGECOUNT value on done: 340186.0 [2023-02-24 19:18:10,600][177170] Sum rewards: 26.276, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.570', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.020', 'AMMO3': '0.076', 'AMMO4': '0.101', 'weapon5': '0.190', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'ARMOR': '0.470', 'weapon2': '0.560', 'WEAPON3': '0.600', 'weapon4': '1.052', 'HITCOUNT': '1.640', 'weapon3': '1.938', 'DAMAGECOUNT': '6.924', 'FRAGCOUNT': '21.000'} [2023-02-24 19:18:10,889][177153] Updated weights for policy 0, policy_version 23530 (0.0008) [2023-02-24 19:18:10,897][177170] DAMAGECOUNT value on done: 343690.0 [2023-02-24 19:18:10,898][177170] Sum rewards: 15.043, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.030', 'AMMO5': '0.012', 'AMMO2': '0.012', 'weapon5': '0.052', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.128', 'weapon4': '0.218', 'WEAPON5': '0.250', 'weapon2': '0.718', 'WEAPON3': '0.900', 'HITCOUNT': '1.620', 'weapon3': '2.758', 'DAMAGECOUNT': '5.745', 'FRAGCOUNT': '12.500'} [2023-02-24 19:18:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13801.4). Total num frames: 96382976. Throughput: 0: 3452.5. Samples: 24093470. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:18:11,376][177119] Avg episode reward: [(0, '19.904')] [2023-02-24 19:18:11,916][177156] DAMAGECOUNT value on done: 345685.0 [2023-02-24 19:18:11,916][177156] Sum rewards: 20.770, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.328', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.015', 'AMMO3': '0.115', 'weapon5': '0.368', 'WEAPON5': '0.400', 'weapon2': '0.642', 'WEAPON3': '0.700', 'HITCOUNT': '1.100', 'weapon3': '2.522', 'DAMAGECOUNT': '5.997', 'FRAGCOUNT': '16.000'} [2023-02-24 19:18:11,997][177156] DAMAGECOUNT value on done: 336804.0 [2023-02-24 19:18:11,998][177156] Sum rewards: 20.419, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.940', 'AMMO2': '0.000', 'AMMO4': '0.002', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'weapon4': '0.160', 'weapon5': '0.210', 'WEAPON5': '0.350', 'weapon2': '0.660', 'WEAPON3': '0.800', 'HITCOUNT': '1.420', 'weapon3': '2.576', 'DAMAGECOUNT': '5.679', 'FRAGCOUNT': '17.500'} [2023-02-24 19:18:12,218][177158] DAMAGECOUNT value on done: 330399.0 [2023-02-24 19:18:12,218][177158] Sum rewards: 24.286, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.495', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.070', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.168', 'weapon4': '0.418', 'WEAPON3': '0.500', 'weapon2': '0.984', 'HITCOUNT': '1.410', 'weapon3': '1.754', 'DAMAGECOUNT': '6.606', 'FRAGCOUNT': '17.000'} [2023-02-24 19:18:12,230][177156] DAMAGECOUNT value on done: 354877.0 [2023-02-24 19:18:12,231][177156] Sum rewards: 13.690, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.153', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.023', 'weapon4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'AMMO4': '0.116', 'weapon5': '0.402', 'WEAPON5': '0.450', 'weapon2': '0.718', 'WEAPON3': '0.800', 'HITCOUNT': '1.300', 'weapon3': '2.438', 'DAMAGECOUNT': '4.785', 'FRAGCOUNT': '11.000'} [2023-02-24 19:18:12,314][177156] DAMAGECOUNT value on done: 337733.0 [2023-02-24 19:18:12,314][177156] Sum rewards: 28.611, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.002', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.095', 'AMMO4': '0.118', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon5': '0.356', 'weapon4': '0.566', 'WEAPON3': '0.600', 'weapon2': '0.608', 'weapon3': '1.760', 'HITCOUNT': '1.990', 'DAMAGECOUNT': '8.109', 'FRAGCOUNT': '21.500'} [2023-02-24 19:18:12,510][177158] DAMAGECOUNT value on done: 335837.0 [2023-02-24 19:18:12,511][177158] Sum rewards: 9.586, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.479', 'AMMO5': '0.017', 'AMMO2': '0.025', 'weapon7': '0.046', 'AMMO3': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.125', 'WEAPON7': '0.200', 'weapon2': '0.300', 'WEAPON5': '0.350', 'weapon5': '0.354', 'WEAPON4': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '0.890', 'weapon4': '1.070', 'weapon3': '1.410', 'DAMAGECOUNT': '3.456', 'FRAGCOUNT': '9.000'} [2023-02-24 19:18:12,817][177158] DAMAGECOUNT value on done: 345275.0 [2023-02-24 19:18:12,817][177158] Sum rewards: 15.822, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.942', 'ARMOR': '0.004', 'AMMO2': '0.017', 'AMMO5': '0.017', 'weapon7': '0.058', 'AMMO4': '0.085', 'AMMO3': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'weapon2': '0.424', 'WEAPON3': '0.600', 'weapon4': '0.688', 'HITCOUNT': '0.890', 'weapon3': '1.716', 'DAMAGECOUNT': '3.669', 'FRAGCOUNT': '12.000'} [2023-02-24 19:18:13,113][177158] DAMAGECOUNT value on done: 347666.0 [2023-02-24 19:18:13,114][177158] Sum rewards: 18.586, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.230', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO3': '0.086', 'AMMO4': '0.194', 'weapon5': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.444', 'WEAPON3': '0.600', 'weapon2': '1.022', 'HITCOUNT': '1.330', 'weapon3': '1.868', 'DAMAGECOUNT': '5.583', 'FRAGCOUNT': '16.000'} [2023-02-24 19:18:13,866][177153] Updated weights for policy 0, policy_version 23540 (0.0008) [2023-02-24 19:18:14,438][177170] Large shaping reward 2.568 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.546, 182.0), ('weapon5', 0.002)] [2023-02-24 19:18:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13801.4). Total num frames: 96452608. Throughput: 0: 3456.4. Samples: 24114304. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:18:16,376][177119] Avg episode reward: [(0, '20.117')] [2023-02-24 19:18:16,380][177140] Saving new best policy, reward=20.117! [2023-02-24 19:18:16,639][177172] DAMAGECOUNT value on done: 338705.0 [2023-02-24 19:18:16,640][177172] Sum rewards: 16.540, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.281', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.022', 'AMMO3': '0.096', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'weapon5': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.352', 'WEAPON3': '0.650', 'HITCOUNT': '1.010', 'weapon2': '1.192', 'weapon3': '1.570', 'DAMAGECOUNT': '4.926', 'FRAGCOUNT': '14.000'} [2023-02-24 19:18:16,837][177153] Updated weights for policy 0, policy_version 23550 (0.0008) [2023-02-24 19:18:16,947][177172] DAMAGECOUNT value on done: 340612.0 [2023-02-24 19:18:16,948][177172] Sum rewards: 21.795, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.550', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO2': '0.024', 'weapon4': '0.082', 'AMMO4': '0.120', 'AMMO3': '0.128', 'WEAPON4': '0.250', 'weapon5': '0.268', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'weapon2': '1.022', 'HITCOUNT': '1.500', 'weapon3': '2.314', 'DAMAGECOUNT': '6.297', 'FRAGCOUNT': '19.000'} [2023-02-24 19:18:17,920][177154] DAMAGECOUNT value on done: 344359.0 [2023-02-24 19:18:17,920][177154] Sum rewards: 27.216, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.080', 'AMMO5': '0.017', 'AMMO2': '0.031', 'AMMO3': '0.100', 'AMMO4': '0.154', 'weapon5': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'weapon2': '0.568', 'WEAPON3': '0.700', 'weapon4': '1.010', 'weapon3': '1.756', 'HITCOUNT': '1.900', 'DAMAGECOUNT': '7.638', 'FRAGCOUNT': '21.000'} [2023-02-24 19:18:18,221][177154] DAMAGECOUNT value on done: 353478.0 [2023-02-24 19:18:18,221][177154] Sum rewards: 21.399, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.018', 'ARMOR': '0.004', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon7': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.121', 'AMMO3': '0.142', 'WEAPON7': '0.200', 'weapon5': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.698', 'weapon4': '0.762', 'WEAPON3': '0.800', 'HITCOUNT': '1.260', 'weapon3': '1.596', 'DAMAGECOUNT': '6.147', 'FRAGCOUNT': '19.000'} [2023-02-24 19:18:18,446][177172] DAMAGECOUNT value on done: 352265.0 [2023-02-24 19:18:18,447][177172] Sum rewards: 10.210, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.863', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO3': '0.092', 'AMMO4': '0.115', 'weapon5': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'weapon4': '0.576', 'weapon2': '1.134', 'HITCOUNT': '1.150', 'weapon3': '1.696', 'DAMAGECOUNT': '4.221', 'FRAGCOUNT': '9.000'} [2023-02-24 19:18:18,515][177154] DAMAGECOUNT value on done: 356612.0 [2023-02-24 19:18:18,516][177154] Sum rewards: 25.235, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.655', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'AMMO3': '0.105', 'weapon5': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.248', 'ARMOR': '0.454', 'weapon4': '0.562', 'WEAPON3': '0.800', 'HITCOUNT': '1.660', 'weapon3': '1.742', 'DAMAGECOUNT': '6.762', 'FRAGCOUNT': '20.000'} [2023-02-24 19:18:18,750][177172] DAMAGECOUNT value on done: 346372.0 [2023-02-24 19:18:18,751][177172] Sum rewards: 34.793, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.045', 'HEALTH': '0.094', 'AMMO3': '0.098', 'WEAPON5': '0.150', 'weapon5': '0.254', 'WEAPON3': '0.600', 'weapon2': '1.000', 'HITCOUNT': '1.880', 'weapon3': '2.448', 'DAMAGECOUNT': '7.197', 'FRAGCOUNT': '27.000'} [2023-02-24 19:18:18,821][177154] DAMAGECOUNT value on done: 355804.0 [2023-02-24 19:18:18,821][177154] Sum rewards: 11.745, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.140', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.029', 'AMMO3': '0.046', 'weapon7': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.164', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'weapon2': '0.454', 'HITCOUNT': '0.650', 'weapon4': '0.718', 'weapon3': '1.036', 'DAMAGECOUNT': '2.799', 'FRAGCOUNT': '8.000'} [2023-02-24 19:18:18,921][177157] DAMAGECOUNT value on done: 352346.0 [2023-02-24 19:18:18,922][177157] Sum rewards: 13.635, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO3': '0.057', 'AMMO4': '0.075', 'HEALTH': '0.088', 'weapon7': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.238', 'WEAPON3': '0.300', 'weapon2': '0.532', 'HITCOUNT': '0.680', 'weapon3': '0.906', 'weapon4': '1.202', 'DAMAGECOUNT': '3.843', 'FRAGCOUNT': '10.000'} [2023-02-24 19:18:19,123][177157] DAMAGECOUNT value on done: 338357.0 [2023-02-24 19:18:19,123][177157] Sum rewards: 20.714, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.485', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.069', 'AMMO4': '0.146', 'weapon5': '0.376', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.500', 'weapon4': '0.694', 'weapon2': '0.738', 'HITCOUNT': '1.500', 'weapon3': '1.694', 'DAMAGECOUNT': '5.565', 'FRAGCOUNT': '16.000'} [2023-02-24 19:18:19,233][177157] DAMAGECOUNT value on done: 338864.0 [2023-02-24 19:18:19,234][177157] Sum rewards: 26.056, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.523', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.037', 'AMMO3': '0.072', 'WEAPON4': '0.150', 'weapon5': '0.290', 'WEAPON5': '0.300', 'weapon4': '0.320', 'WEAPON3': '0.500', 'weapon2': '0.926', 'HITCOUNT': '1.480', 'weapon3': '1.962', 'DAMAGECOUNT': '6.774', 'FRAGCOUNT': '19.000'} [2023-02-24 19:18:19,433][177157] DAMAGECOUNT value on done: 343043.0 [2023-02-24 19:18:19,434][177157] Sum rewards: 25.112, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.202', 'AMMO5': '0.022', 'AMMO2': '0.027', 'AMMO3': '0.130', 'AMMO4': '0.134', 'WEAPON4': '0.300', 'weapon4': '0.332', 'weapon5': '0.380', 'WEAPON5': '0.550', 'weapon2': '0.640', 'WEAPON3': '0.850', 'HITCOUNT': '1.680', 'weapon3': '2.260', 'DAMAGECOUNT': '7.509', 'FRAGCOUNT': '22.000'} [2023-02-24 19:18:19,487][177171] DAMAGECOUNT value on done: 339695.0 [2023-02-24 19:18:19,487][177171] Sum rewards: 20.884, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.530', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.056', 'weapon5': '0.122', 'AMMO3': '0.208', 'AMMO4': '0.280', 'WEAPON5': '0.400', 'weapon2': '0.496', 'WEAPON4': '0.750', 'weapon4': '0.798', 'WEAPON3': '1.150', 'HITCOUNT': '2.010', 'weapon3': '2.108', 'DAMAGECOUNT': '7.998', 'FRAGCOUNT': '22.000'} [2023-02-24 19:18:19,497][177171] DAMAGECOUNT value on done: 340891.0 [2023-02-24 19:18:19,497][177171] Sum rewards: 33.335, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.638', 'AMMO2': '0.013', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO4': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.141', 'WEAPON4': '0.200', 'weapon2': '0.308', 'weapon5': '0.318', 'WEAPON5': '0.500', 'weapon4': '0.504', 'WEAPON3': '0.850', 'HITCOUNT': '1.850', 'weapon3': '2.470', 'DAMAGECOUNT': '8.367', 'FRAGCOUNT': '27.000'} [2023-02-24 19:18:19,787][177171] DAMAGECOUNT value on done: 342598.0 [2023-02-24 19:18:19,788][177171] Sum rewards: 14.813, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.739', 'AMMO2': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.027', 'AMMO3': '0.045', 'weapon5': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon7': '0.252', 'WEAPON3': '0.350', 'AMMO6': '0.400', 'AMMO7': '0.400', 'WEAPON7': '0.600', 'HITCOUNT': '0.620', 'weapon2': '0.652', 'weapon4': '0.774', 'weapon3': '1.184', 'DAMAGECOUNT': '3.393', 'FRAGCOUNT': '10.000'} [2023-02-24 19:18:19,797][177171] DAMAGECOUNT value on done: 344531.0 [2023-02-24 19:18:19,797][177171] Sum rewards: 22.143, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.305', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.012', 'WEAPON4': '0.050', 'AMMO3': '0.114', 'weapon4': '0.134', 'weapon5': '0.284', 'WEAPON5': '0.400', 'weapon2': '0.748', 'WEAPON3': '0.750', 'HITCOUNT': '1.250', 'weapon3': '2.490', 'DAMAGECOUNT': '5.709', 'FRAGCOUNT': '19.000'} [2023-02-24 19:18:19,800][177153] Updated weights for policy 0, policy_version 23560 (0.0008) [2023-02-24 19:18:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13815.3). Total num frames: 96522240. Throughput: 0: 3454.7. Samples: 24124560. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:18:21,376][177119] Avg episode reward: [(0, '20.857')] [2023-02-24 19:18:21,377][177140] Saving new best policy, reward=20.857! [2023-02-24 19:18:22,051][177155] DAMAGECOUNT value on done: 351636.0 [2023-02-24 19:18:22,051][177155] Sum rewards: 23.582, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.899', 'AMMO5': '0.015', 'AMMO2': '0.016', 'AMMO4': '0.077', 'AMMO3': '0.131', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'weapon4': '0.332', 'weapon2': '0.488', 'WEAPON3': '0.850', 'HITCOUNT': '1.590', 'weapon3': '2.720', 'DAMAGECOUNT': '6.420', 'FRAGCOUNT': '21.000'} [2023-02-24 19:18:22,354][177155] DAMAGECOUNT value on done: 358060.0 [2023-02-24 19:18:22,355][177155] Sum rewards: 22.477, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.022', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO3': '0.084', 'AMMO4': '0.125', 'weapon5': '0.172', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'weapon4': '0.502', 'weapon2': '1.020', 'HITCOUNT': '1.280', 'weapon3': '1.924', 'DAMAGECOUNT': '5.757', 'FRAGCOUNT': '18.000'} [2023-02-24 19:18:22,567][177155] DAMAGECOUNT value on done: 355357.0 [2023-02-24 19:18:22,568][177155] Sum rewards: 10.740, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.820', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO3': '0.090', 'AMMO4': '0.109', 'weapon5': '0.170', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.580', 'WEAPON3': '0.600', 'weapon2': '0.792', 'HITCOUNT': '0.880', 'weapon3': '1.600', 'DAMAGECOUNT': '3.309', 'FRAGCOUNT': '9.000'} [2023-02-24 19:18:22,806][177153] Updated weights for policy 0, policy_version 23570 (0.0008) [2023-02-24 19:18:22,875][177155] DAMAGECOUNT value on done: 337512.0 [2023-02-24 19:18:22,875][177155] Sum rewards: 22.398, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.405', 'AMMO2': '0.001', 'ARMOR': '0.004', 'AMMO4': '0.004', 'AMMO5': '0.023', 'WEAPON4': '0.050', 'weapon4': '0.060', 'AMMO3': '0.101', 'weapon5': '0.410', 'weapon2': '0.478', 'WEAPON5': '0.600', 'WEAPON3': '0.650', 'HITCOUNT': '1.040', 'weapon3': '2.594', 'DAMAGECOUNT': '5.538', 'FRAGCOUNT': '18.000'} [2023-02-24 19:18:25,748][177153] Updated weights for policy 0, policy_version 23580 (0.0008) [2023-02-24 19:18:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13815.3). Total num frames: 96591872. Throughput: 0: 3454.8. Samples: 24145248. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:18:26,376][177119] Avg episode reward: [(0, '20.845')] [2023-02-24 19:18:28,678][177153] Updated weights for policy 0, policy_version 23590 (0.0009) [2023-02-24 19:18:29,010][177170] DAMAGECOUNT value on done: 344371.0 [2023-02-24 19:18:29,010][177170] Sum rewards: 16.309, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.969', 'AMMO5': '0.018', 'AMMO2': '0.030', 'AMMO3': '0.075', 'weapon4': '0.146', 'AMMO4': '0.150', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon5': '0.474', 'WEAPON3': '0.600', 'weapon2': '0.752', 'HITCOUNT': '1.090', 'weapon3': '2.060', 'DAMAGECOUNT': '5.283', 'FRAGCOUNT': '15.000'} [2023-02-24 19:18:29,316][177170] DAMAGECOUNT value on done: 345735.0 [2023-02-24 19:18:29,317][177170] Sum rewards: 19.173, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.812', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon7': '0.100', 'AMMO3': '0.107', 'AMMO4': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.600', 'weapon4': '0.622', 'weapon2': '0.842', 'HITCOUNT': '1.260', 'weapon3': '1.594', 'DAMAGECOUNT': '5.283', 'FRAGCOUNT': '16.000'} [2023-02-24 19:18:29,962][177170] DAMAGECOUNT value on done: 341406.0 [2023-02-24 19:18:29,962][177170] Sum rewards: 17.358, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.485', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.014', 'WEAPON1': '0.020', 'AMMO3': '0.041', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.182', 'WEAPON5': '0.200', 'WEAPON3': '0.350', 'weapon4': '0.784', 'HITCOUNT': '0.990', 'weapon2': '1.072', 'weapon3': '1.124', 'DAMAGECOUNT': '3.660', 'FRAGCOUNT': '12.000'} [2023-02-24 19:18:30,261][177170] DAMAGECOUNT value on done: 345288.0 [2023-02-24 19:18:30,261][177170] Sum rewards: 22.427, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.017', 'AMMO2': '0.033', 'AMMO3': '0.073', 'AMMO4': '0.164', 'weapon5': '0.172', 'WEAPON4': '0.250', 'weapon2': '0.274', 'WEAPON5': '0.350', 'HEALTH': '0.375', 'WEAPON3': '0.450', 'weapon4': '1.346', 'HITCOUNT': '1.360', 'weapon3': '1.768', 'DAMAGECOUNT': '4.794', 'FRAGCOUNT': '17.000'} [2023-02-24 19:18:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13815.3). Total num frames: 96661504. Throughput: 0: 3452.4. Samples: 24166064. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:18:31,376][177119] Avg episode reward: [(0, '20.867')] [2023-02-24 19:18:31,377][177140] Saving new best policy, reward=20.867! [2023-02-24 19:18:31,415][177156] DAMAGECOUNT value on done: 347185.0 [2023-02-24 19:18:31,416][177156] Sum rewards: 19.425, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.135', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO3': '0.061', 'weapon5': '0.098', 'weapon7': '0.100', 'AMMO4': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'weapon2': '0.568', 'weapon4': '0.724', 'HITCOUNT': '0.970', 'weapon3': '1.696', 'DAMAGECOUNT': '4.500', 'FRAGCOUNT': '14.000'} [2023-02-24 19:18:31,500][177156] DAMAGECOUNT value on done: 338861.0 [2023-02-24 19:18:31,501][177156] Sum rewards: 26.038, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.690', 'AMMO5': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon7': '0.064', 'AMMO4': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.230', 'WEAPON5': '0.250', 'weapon4': '0.378', 'weapon2': '0.858', 'WEAPON3': '0.950', 'HITCOUNT': '1.290', 'weapon3': '2.178', 'DAMAGECOUNT': '6.171', 'FRAGCOUNT': '22.000'} [2023-02-24 19:18:31,660][177153] Updated weights for policy 0, policy_version 23600 (0.0008) [2023-02-24 19:18:31,724][177156] DAMAGECOUNT value on done: 356563.0 [2023-02-24 19:18:31,725][177156] Sum rewards: 20.252, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.710', 'ARMOR': '0.004', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon7': '0.048', 'AMMO3': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.115', 'WEAPON4': '0.200', 'weapon5': '0.340', 'WEAPON5': '0.350', 'weapon4': '0.640', 'WEAPON3': '0.650', 'weapon2': '0.734', 'HITCOUNT': '0.840', 'weapon3': '1.778', 'DAMAGECOUNT': '5.058', 'FRAGCOUNT': '18.000'} [2023-02-24 19:18:31,734][177158] DAMAGECOUNT value on done: 332113.0 [2023-02-24 19:18:31,735][177158] Sum rewards: 21.818, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.092', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.095', 'weapon5': '0.108', 'weapon7': '0.110', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'AMMO6': '0.420', 'AMMO7': '0.420', 'WEAPON7': '0.500', 'weapon2': '0.594', 'WEAPON3': '0.600', 'weapon4': '1.152', 'HITCOUNT': '1.300', 'weapon3': '1.450', 'DAMAGECOUNT': '5.142', 'FRAGCOUNT': '17.000'} [2023-02-24 19:18:31,804][177156] DAMAGECOUNT value on done: 339521.0 [2023-02-24 19:18:31,804][177156] Sum rewards: 25.560, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.009', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'AMMO3': '0.084', 'AMMO4': '0.124', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.340', 'ARMOR': '0.400', 'weapon4': '0.542', 'WEAPON3': '0.550', 'weapon2': '0.684', 'HITCOUNT': '1.240', 'weapon3': '1.796', 'DAMAGECOUNT': '5.364', 'FRAGCOUNT': '20.000'} [2023-02-24 19:18:32,027][177158] DAMAGECOUNT value on done: 338082.0 [2023-02-24 19:18:32,028][177158] Sum rewards: 26.261, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.516', 'AMMO2': '0.013', 'AMMO5': '0.022', 'AMMO4': '0.067', 'weapon5': '0.134', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'ARMOR': '0.455', 'weapon4': '0.456', 'weapon2': '0.614', 'WEAPON3': '1.000', 'HITCOUNT': '1.740', 'weapon3': '2.594', 'DAMAGECOUNT': '6.735', 'FRAGCOUNT': '23.000'} [2023-02-24 19:18:32,313][177158] DAMAGECOUNT value on done: 347789.0 [2023-02-24 19:18:32,314][177158] Sum rewards: 27.965, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.372', 'AMMO5': '0.018', 'AMMO2': '0.035', 'AMMO3': '0.137', 'AMMO4': '0.177', 'weapon5': '0.376', 'weapon4': '0.388', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.678', 'WEAPON3': '0.850', 'HITCOUNT': '1.580', 'weapon3': '2.214', 'DAMAGECOUNT': '7.533', 'FRAGCOUNT': '26.000'} [2023-02-24 19:18:32,611][177158] DAMAGECOUNT value on done: 349816.0 [2023-02-24 19:18:32,611][177158] Sum rewards: 19.089, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.478', 'ARMOR': '0.005', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.129', 'weapon5': '0.136', 'AMMO4': '0.176', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.416', 'WEAPON3': '0.800', 'weapon2': '1.150', 'HITCOUNT': '1.560', 'weapon3': '1.900', 'DAMAGECOUNT': '6.450', 'FRAGCOUNT': '17.000'} [2023-02-24 19:18:34,612][177153] Updated weights for policy 0, policy_version 23610 (0.0009) [2023-02-24 19:18:36,119][177172] DAMAGECOUNT value on done: 341095.0 [2023-02-24 19:18:36,120][177172] Sum rewards: 23.988, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.396', 'AMMO2': '0.022', 'AMMO5': '0.026', 'WEAPON1': '0.030', 'AMMO4': '0.109', 'weapon4': '0.158', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon5': '0.332', 'weapon2': '0.572', 'WEAPON5': '0.600', 'WEAPON3': '1.000', 'HITCOUNT': '1.460', 'weapon3': '2.536', 'DAMAGECOUNT': '7.170', 'FRAGCOUNT': '23.000'} [2023-02-24 19:18:36,376][177119] Fps is (10 sec: 13516.9, 60 sec: 13789.9, 300 sec: 13801.4). Total num frames: 96727040. Throughput: 0: 3452.2. Samples: 24176436. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:18:36,376][177119] Avg episode reward: [(0, '21.140')] [2023-02-24 19:18:36,397][177140] Saving new best policy, reward=21.140! [2023-02-24 19:18:36,439][177172] DAMAGECOUNT value on done: 343185.0 [2023-02-24 19:18:36,440][177172] Sum rewards: 27.040, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.386', 'weapon7': '0.010', 'AMMO2': '0.014', 'AMMO5': '0.015', 'AMMO4': '0.071', 'AMMO3': '0.111', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.326', 'WEAPON5': '0.400', 'weapon4': '0.502', 'weapon2': '0.526', 'WEAPON3': '0.800', 'HITCOUNT': '1.910', 'weapon3': '2.222', 'DAMAGECOUNT': '7.719', 'FRAGCOUNT': '19.000'} [2023-02-24 19:18:37,408][177154] DAMAGECOUNT value on done: 345551.0 [2023-02-24 19:18:37,408][177154] Sum rewards: 14.922, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.009', 'AMMO2': '0.018', 'AMMO3': '0.050', 'weapon7': '0.088', 'AMMO4': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.150', 'WEAPON5': '0.200', 'HEALTH': '0.252', 'weapon2': '0.282', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'weapon4': '0.648', 'HITCOUNT': '0.940', 'weapon3': '1.170', 'DAMAGECOUNT': '3.576', 'FRAGCOUNT': '10.000'} [2023-02-24 19:18:37,600][177153] Updated weights for policy 0, policy_version 23620 (0.0008) [2023-02-24 19:18:37,709][177154] DAMAGECOUNT value on done: 355581.0 [2023-02-24 19:18:37,709][177154] Sum rewards: 18.923, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.482', 'ARMOR': '0.008', 'AMMO5': '0.015', 'weapon7': '0.024', 'AMMO2': '0.029', 'AMMO3': '0.118', 'AMMO4': '0.142', 'weapon5': '0.196', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.800', 'weapon2': '0.818', 'HITCOUNT': '1.650', 'weapon3': '2.310', 'DAMAGECOUNT': '6.309', 'FRAGCOUNT': '15.500'} [2023-02-24 19:18:37,951][177172] DAMAGECOUNT value on done: 353647.0 [2023-02-24 19:18:37,951][177172] Sum rewards: 14.625, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.609', 'AMMO2': '0.009', 'AMMO5': '0.015', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'AMMO3': '0.093', 'weapon7': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.348', 'WEAPON5': '0.350', 'weapon4': '0.408', 'weapon2': '0.438', 'WEAPON3': '0.650', 'HITCOUNT': '1.010', 'weapon3': '1.778', 'DAMAGECOUNT': '4.146', 'FRAGCOUNT': '11.500'} [2023-02-24 19:18:38,013][177154] DAMAGECOUNT value on done: 359074.0 [2023-02-24 19:18:38,013][177154] Sum rewards: 25.471, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.110', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.132', 'weapon5': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.454', 'WEAPON3': '0.850', 'weapon2': '0.940', 'HITCOUNT': '2.010', 'weapon3': '2.108', 'DAMAGECOUNT': '7.386', 'FRAGCOUNT': '21.500'} [2023-02-24 19:18:38,252][177172] DAMAGECOUNT value on done: 348815.0 [2023-02-24 19:18:38,253][177172] Sum rewards: 31.399, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.260', 'AMMO4': '-0.028', 'AMMO2': '-0.005', 'AMMO5': '0.010', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'weapon4': '0.180', 'weapon5': '0.244', 'WEAPON5': '0.250', 'WEAPON3': '0.700', 'weapon2': '0.984', 'HITCOUNT': '1.690', 'weapon3': '2.364', 'DAMAGECOUNT': '7.329', 'FRAGCOUNT': '24.000'} [2023-02-24 19:18:38,318][177154] DAMAGECOUNT value on done: 357177.0 [2023-02-24 19:18:38,319][177154] Sum rewards: 12.066, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.336', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.023', 'AMMO3': '0.082', 'AMMO4': '0.113', 'WEAPON4': '0.250', 'weapon5': '0.256', 'WEAPON5': '0.350', 'weapon4': '0.534', 'WEAPON3': '0.600', 'weapon2': '0.660', 'HITCOUNT': '1.100', 'weapon3': '2.036', 'DAMAGECOUNT': '4.119', 'FRAGCOUNT': '10.000'} [2023-02-24 19:18:38,414][177157] DAMAGECOUNT value on done: 353879.0 [2023-02-24 19:18:38,414][177157] Sum rewards: 11.478, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.930', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO3': '0.135', 'AMMO4': '0.187', 'WEAPON5': '0.200', 'weapon5': '0.270', 'WEAPON4': '0.350', 'weapon4': '0.478', 'weapon2': '0.732', 'WEAPON3': '0.800', 'HITCOUNT': '1.170', 'weapon3': '1.940', 'DAMAGECOUNT': '4.599', 'FRAGCOUNT': '12.000'} [2023-02-24 19:18:38,630][177157] DAMAGECOUNT value on done: 340433.0 [2023-02-24 19:18:38,631][177157] Sum rewards: 23.210, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.100', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.030', 'weapon4': '0.096', 'AMMO3': '0.112', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'weapon5': '0.314', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'weapon2': '0.912', 'HITCOUNT': '1.340', 'weapon3': '2.168', 'DAMAGECOUNT': '6.216', 'FRAGCOUNT': '20.000'} [2023-02-24 19:18:38,724][177157] DAMAGECOUNT value on done: 341222.0 [2023-02-24 19:18:38,724][177157] Sum rewards: 24.006, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.168', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.021', 'AMMO2': '0.028', 'AMMO3': '0.118', 'AMMO4': '0.141', 'weapon5': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon4': '0.526', 'weapon2': '0.550', 'WEAPON3': '0.750', 'HITCOUNT': '1.750', 'weapon3': '2.070', 'DAMAGECOUNT': '7.074', 'FRAGCOUNT': '19.000'} [2023-02-24 19:18:38,900][177171] DAMAGECOUNT value on done: 340991.0 [2023-02-24 19:18:38,900][177171] Sum rewards: 10.576, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.374', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.014', 'WEAPON4': '0.100', 'weapon7': '0.112', 'weapon5': '0.114', 'AMMO3': '0.136', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.300', 'weapon4': '0.384', 'WEAPON7': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '0.950', 'weapon2': '1.274', 'weapon3': '1.802', 'DAMAGECOUNT': '3.888', 'FRAGCOUNT': '11.000'} [2023-02-24 19:18:38,911][177171] DAMAGECOUNT value on done: 342295.0 [2023-02-24 19:18:38,912][177171] Sum rewards: 12.914, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.488', 'AMMO5': '0.011', 'AMMO2': '0.014', 'WEAPON1': '0.030', 'AMMO4': '0.070', 'AMMO3': '0.080', 'weapon7': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.274', 'weapon5': '0.280', 'WEAPON3': '0.550', 'HITCOUNT': '0.970', 'weapon2': '1.176', 'weapon3': '1.494', 'DAMAGECOUNT': '4.212', 'FRAGCOUNT': '10.000'} [2023-02-24 19:18:38,944][177157] DAMAGECOUNT value on done: 345250.0 [2023-02-24 19:18:38,944][177157] Sum rewards: 25.654, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.932', 'AMMO2': '0.013', 'AMMO5': '0.024', 'weapon7': '0.062', 'AMMO4': '0.063', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.141', 'weapon4': '0.194', 'weapon5': '0.458', 'WEAPON5': '0.500', 'weapon2': '0.690', 'WEAPON3': '0.850', 'HITCOUNT': '1.420', 'weapon3': '2.180', 'DAMAGECOUNT': '6.591', 'FRAGCOUNT': '22.000'} [2023-02-24 19:18:39,208][177171] DAMAGECOUNT value on done: 343986.0 [2023-02-24 19:18:39,209][177171] Sum rewards: 14.924, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'HEALTH': '0.018', 'AMMO2': '0.042', 'AMMO3': '0.054', 'weapon5': '0.092', 'WEAPON5': '0.100', 'weapon2': '0.152', 'AMMO4': '0.210', 'WEAPON3': '0.300', 'WEAPON4': '0.450', 'HITCOUNT': '1.090', 'weapon3': '1.118', 'weapon4': '1.128', 'DAMAGECOUNT': '4.164', 'FRAGCOUNT': '12.000'} [2023-02-24 19:18:39,219][177171] DAMAGECOUNT value on done: 345668.0 [2023-02-24 19:18:39,220][177171] Sum rewards: 10.444, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.466', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.071', 'WEAPON4': '0.100', 'weapon7': '0.112', 'weapon4': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.302', 'WEAPON3': '0.500', 'HITCOUNT': '0.780', 'weapon2': '1.434', 'weapon3': '1.674', 'DAMAGECOUNT': '3.411', 'FRAGCOUNT': '8.000'} [2023-02-24 19:18:40,568][177153] Updated weights for policy 0, policy_version 23630 (0.0008) [2023-02-24 19:18:41,376][177119] Fps is (10 sec: 13516.7, 60 sec: 13789.9, 300 sec: 13801.4). Total num frames: 96796672. Throughput: 0: 3452.1. Samples: 24197104. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:18:41,376][177119] Avg episode reward: [(0, '20.801')] [2023-02-24 19:18:41,476][177155] DAMAGECOUNT value on done: 353007.0 [2023-02-24 19:18:41,477][177155] Sum rewards: 15.695, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.700', 'AMMO2': '0.007', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.035', 'weapon7': '0.060', 'AMMO3': '0.069', 'weapon5': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.342', 'WEAPON3': '0.550', 'HITCOUNT': '0.850', 'weapon4': '1.106', 'weapon3': '1.512', 'DAMAGECOUNT': '4.113', 'FRAGCOUNT': '13.000'} [2023-02-24 19:18:41,781][177155] DAMAGECOUNT value on done: 359878.0 [2023-02-24 19:18:41,781][177155] Sum rewards: 15.825, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.228', 'AMMO5': '0.017', 'AMMO2': '0.035', 'AMMO3': '0.154', 'weapon5': '0.176', 'AMMO4': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.428', 'weapon4': '0.536', 'WEAPON3': '1.000', 'HITCOUNT': '1.490', 'weapon3': '2.536', 'DAMAGECOUNT': '5.454', 'FRAGCOUNT': '15.000'} [2023-02-24 19:18:41,975][177155] DAMAGECOUNT value on done: 357207.0 [2023-02-24 19:18:41,976][177155] Sum rewards: 24.992, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.220', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon5': '0.240', 'weapon4': '0.422', 'WEAPON3': '0.450', 'weapon2': '1.114', 'HITCOUNT': '1.130', 'weapon3': '1.718', 'DAMAGECOUNT': '5.550', 'FRAGCOUNT': '19.000'} [2023-02-24 19:18:42,272][177155] DAMAGECOUNT value on done: 340634.0 [2023-02-24 19:18:42,273][177155] Sum rewards: 34.939, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.602', 'AMMO5': '0.020', 'AMMO2': '0.035', 'AMMO3': '0.106', 'weapon4': '0.122', 'AMMO4': '0.177', 'WEAPON4': '0.200', 'weapon5': '0.336', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'weapon2': '0.750', 'HITCOUNT': '1.770', 'weapon3': '2.482', 'DAMAGECOUNT': '9.342', 'FRAGCOUNT': '28.000'} [2023-02-24 19:18:43,524][177153] Updated weights for policy 0, policy_version 23640 (0.0008) [2023-02-24 19:18:46,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13801.4). Total num frames: 96866304. Throughput: 0: 3458.4. Samples: 24217962. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:18:46,376][177119] Avg episode reward: [(0, '20.853')] [2023-02-24 19:18:46,484][177153] Updated weights for policy 0, policy_version 23650 (0.0008) [2023-02-24 19:18:48,424][177170] DAMAGECOUNT value on done: 345797.0 [2023-02-24 19:18:48,424][177170] Sum rewards: 14.630, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.819', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'weapon7': '0.048', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.144', 'WEAPON7': '0.200', 'weapon5': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.600', 'weapon2': '0.836', 'weapon4': '0.978', 'HITCOUNT': '1.170', 'weapon3': '1.534', 'DAMAGECOUNT': '4.278', 'FRAGCOUNT': '12.000'} [2023-02-24 19:18:48,729][177170] DAMAGECOUNT value on done: 347374.0 [2023-02-24 19:18:48,730][177170] Sum rewards: 17.567, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.750', 'AMMO5': '0.015', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'AMMO3': '0.076', 'AMMO4': '0.086', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon5': '0.300', 'weapon4': '0.482', 'WEAPON3': '0.500', 'HITCOUNT': '1.020', 'weapon2': '1.182', 'weapon3': '1.462', 'DAMAGECOUNT': '4.797', 'FRAGCOUNT': '13.000'} [2023-02-24 19:18:49,329][177170] DAMAGECOUNT value on done: 343153.0 [2023-02-24 19:18:49,330][177170] Sum rewards: 15.942, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'WEAPON5': '0.250', 'HEALTH': '0.272', 'weapon4': '0.298', 'weapon5': '0.300', 'WEAPON3': '0.650', 'weapon2': '0.882', 'HITCOUNT': '1.350', 'weapon3': '1.882', 'DAMAGECOUNT': '5.241', 'FRAGCOUNT': '12.000'} [2023-02-24 19:18:49,440][177153] Updated weights for policy 0, policy_version 23660 (0.0008) [2023-02-24 19:18:49,640][177170] DAMAGECOUNT value on done: 346368.0 [2023-02-24 19:18:49,641][177170] Sum rewards: 14.542, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.085', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.015', 'weapon7': '0.028', 'AMMO3': '0.053', 'AMMO4': '0.072', 'weapon4': '0.078', 'WEAPON4': '0.100', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'weapon2': '0.430', 'ARMOR': '0.444', 'HITCOUNT': '0.730', 'weapon3': '1.134', 'DAMAGECOUNT': '3.180', 'FRAGCOUNT': '11.000'} [2023-02-24 19:18:50,825][177156] DAMAGECOUNT value on done: 349143.0 [2023-02-24 19:18:50,825][177156] Sum rewards: 24.029, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.916', 'AMMO5': '0.020', 'AMMO2': '0.022', 'AMMO4': '0.109', 'AMMO3': '0.114', 'WEAPON4': '0.200', 'weapon4': '0.256', 'weapon5': '0.274', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'weapon2': '1.040', 'HITCOUNT': '1.430', 'weapon3': '1.706', 'DAMAGECOUNT': '5.874', 'FRAGCOUNT': '21.000'} [2023-02-24 19:18:50,911][177156] DAMAGECOUNT value on done: 340673.0 [2023-02-24 19:18:50,912][177156] Sum rewards: 21.000, reward structure: {'DEATHCOUNT': '-6.000', 'ARMOR': '0.004', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'AMMO2': '0.044', 'AMMO3': '0.072', 'HEALTH': '0.098', 'AMMO4': '0.221', 'WEAPON4': '0.250', 'weapon5': '0.266', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.758', 'weapon2': '0.786', 'HITCOUNT': '1.370', 'weapon3': '1.788', 'DAMAGECOUNT': '5.436', 'FRAGCOUNT': '15.000'} [2023-02-24 19:18:51,123][177156] DAMAGECOUNT value on done: 358238.0 [2023-02-24 19:18:51,123][177156] Sum rewards: 20.928, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.259', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.072', 'AMMO4': '0.073', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.100', 'WEAPON5': '0.250', 'weapon5': '0.364', 'WEAPON3': '0.450', 'weapon4': '0.476', 'weapon2': '0.804', 'HITCOUNT': '0.880', 'weapon3': '1.778', 'DAMAGECOUNT': '5.025', 'FRAGCOUNT': '15.000'} [2023-02-24 19:18:51,148][177158] DAMAGECOUNT value on done: 333650.0 [2023-02-24 19:18:51,148][177158] Sum rewards: 19.868, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.237', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.022', 'weapon4': '0.074', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'AMMO4': '0.111', 'WEAPON5': '0.350', 'weapon5': '0.396', 'WEAPON3': '0.550', 'HITCOUNT': '1.060', 'weapon2': '1.062', 'weapon3': '1.894', 'DAMAGECOUNT': '4.611', 'FRAGCOUNT': '15.000'} [2023-02-24 19:18:51,223][177156] DAMAGECOUNT value on done: 340496.0 [2023-02-24 19:18:51,223][177156] Sum rewards: 12.851, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.240', 'AMMO2': '0.001', 'AMMO4': '0.005', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO3': '0.099', 'WEAPON5': '0.300', 'weapon5': '0.470', 'WEAPON3': '0.550', 'HITCOUNT': '0.690', 'weapon2': '0.882', 'weapon3': '1.396', 'DAMAGECOUNT': '2.925', 'FRAGCOUNT': '11.000'} [2023-02-24 19:18:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13801.4). Total num frames: 96935936. Throughput: 0: 3458.6. Samples: 24228380. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:18:51,376][177119] Avg episode reward: [(0, '20.563')] [2023-02-24 19:18:51,452][177158] DAMAGECOUNT value on done: 340874.0 [2023-02-24 19:18:51,453][177158] Sum rewards: 21.207, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.967', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO5': '0.024', 'AMMO4': '0.111', 'AMMO3': '0.172', 'WEAPON4': '0.400', 'weapon5': '0.408', 'weapon2': '0.456', 'WEAPON5': '0.550', 'weapon4': '0.676', 'WEAPON3': '1.000', 'HITCOUNT': '1.850', 'weapon3': '2.108', 'DAMAGECOUNT': '8.376', 'FRAGCOUNT': '20.500'} [2023-02-24 19:18:51,743][177158] DAMAGECOUNT value on done: 349614.0 [2023-02-24 19:18:51,744][177158] Sum rewards: 17.265, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.068', 'AMMO5': '0.018', 'AMMO2': '0.029', 'AMMO3': '0.094', 'weapon7': '0.122', 'AMMO4': '0.144', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon5': '0.300', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'weapon4': '0.866', 'HITCOUNT': '1.250', 'weapon3': '1.776', 'DAMAGECOUNT': '5.475', 'FRAGCOUNT': '14.000'} [2023-02-24 19:18:52,041][177158] DAMAGECOUNT value on done: 351445.0 [2023-02-24 19:18:52,042][177158] Sum rewards: 22.002, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.358', 'AMMO2': '0.010', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.050', 'AMMO3': '0.068', 'WEAPON4': '0.150', 'weapon5': '0.318', 'WEAPON5': '0.350', 'weapon4': '0.392', 'WEAPON3': '0.500', 'weapon2': '1.056', 'HITCOUNT': '1.230', 'weapon3': '1.296', 'DAMAGECOUNT': '4.887', 'FRAGCOUNT': '18.000'} [2023-02-24 19:18:52,414][177153] Updated weights for policy 0, policy_version 23670 (0.0008) [2023-02-24 19:18:55,336][177153] Updated weights for policy 0, policy_version 23680 (0.0008) [2023-02-24 19:18:55,546][177172] DAMAGECOUNT value on done: 343749.0 [2023-02-24 19:18:55,547][177172] Sum rewards: 17.805, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.865', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'AMMO2': '0.035', 'weapon7': '0.066', 'AMMO3': '0.144', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO4': '0.173', 'WEAPON7': '0.200', 'weapon5': '0.286', 'WEAPON4': '0.450', 'weapon2': '0.512', 'WEAPON5': '0.650', 'weapon4': '0.658', 'WEAPON3': '1.000', 'HITCOUNT': '1.750', 'weapon3': '1.920', 'DAMAGECOUNT': '7.962', 'FRAGCOUNT': '16.500'} [2023-02-24 19:18:55,849][177172] DAMAGECOUNT value on done: 344287.0 [2023-02-24 19:18:55,849][177172] Sum rewards: 16.834, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.310', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.020', 'WEAPON1': '0.050', 'AMMO3': '0.084', 'weapon2': '0.246', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'weapon5': '0.722', 'weapon3': '2.330', 'DAMAGECOUNT': '3.306', 'FRAGCOUNT': '14.000'} [2023-02-24 19:18:56,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13815.3). Total num frames: 97005568. Throughput: 0: 3458.9. Samples: 24249120. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:18:56,376][177119] Avg episode reward: [(0, '20.417')] [2023-02-24 19:18:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000023683_97005568.pth... [2023-02-24 19:18:56,438][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000022874_93691904.pth [2023-02-24 19:18:56,673][177154] DAMAGECOUNT value on done: 346579.0 [2023-02-24 19:18:56,673][177154] Sum rewards: 12.072, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.670', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'weapon7': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.214', 'WEAPON5': '0.250', 'weapon4': '0.604', 'WEAPON3': '0.700', 'HITCOUNT': '0.750', 'weapon2': '0.826', 'weapon3': '1.628', 'DAMAGECOUNT': '3.084', 'FRAGCOUNT': '11.000'} [2023-02-24 19:18:56,972][177154] DAMAGECOUNT value on done: 356208.0 [2023-02-24 19:18:56,972][177154] Sum rewards: 8.593, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.665', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO3': '0.038', 'WEAPON5': '0.100', 'weapon7': '0.192', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON3': '0.300', 'WEAPON7': '0.400', 'HITCOUNT': '0.400', 'weapon3': '0.720', 'weapon2': '1.292', 'DAMAGECOUNT': '1.881', 'FRAGCOUNT': '5.000'} [2023-02-24 19:18:57,284][177154] DAMAGECOUNT value on done: 361991.0 [2023-02-24 19:18:57,284][177154] Sum rewards: 29.639, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.910', 'AMMO2': '0.006', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'weapon4': '0.094', 'AMMO3': '0.116', 'weapon5': '0.486', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon2': '0.828', 'HITCOUNT': '1.610', 'weapon3': '2.036', 'DAMAGECOUNT': '8.751', 'FRAGCOUNT': '22.000'} [2023-02-24 19:18:57,351][177172] DAMAGECOUNT value on done: 356028.0 [2023-02-24 19:18:57,352][177172] Sum rewards: 29.654, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.740', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.033', 'AMMO3': '0.100', 'AMMO4': '0.166', 'WEAPON5': '0.300', 'weapon2': '0.312', 'weapon5': '0.406', 'WEAPON4': '0.450', 'WEAPON3': '0.600', 'weapon4': '1.076', 'weapon3': '1.758', 'HITCOUNT': '1.760', 'DAMAGECOUNT': '7.143', 'FRAGCOUNT': '23.000'} [2023-02-24 19:18:57,585][177154] DAMAGECOUNT value on done: 358091.0 [2023-02-24 19:18:57,585][177154] Sum rewards: 11.135, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.470', 'AMMO2': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.060', 'AMMO3': '0.117', 'WEAPON5': '0.300', 'weapon5': '0.494', 'WEAPON3': '0.600', 'HITCOUNT': '0.690', 'weapon2': '0.984', 'weapon3': '1.800', 'DAMAGECOUNT': '2.742', 'FRAGCOUNT': '9.000'} [2023-02-24 19:18:57,649][177172] DAMAGECOUNT value on done: 350343.0 [2023-02-24 19:18:57,650][177172] Sum rewards: 14.529, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.652', 'AMMO2': '0.017', 'AMMO5': '0.022', 'WEAPON1': '0.050', 'AMMO4': '0.085', 'AMMO3': '0.095', 'WEAPON4': '0.150', 'weapon4': '0.170', 'weapon2': '0.464', 'WEAPON5': '0.550', 'weapon5': '0.588', 'WEAPON3': '0.600', 'HITCOUNT': '1.130', 'weapon3': '2.176', 'DAMAGECOUNT': '4.584', 'FRAGCOUNT': '12.000'} [2023-02-24 19:18:57,834][177157] DAMAGECOUNT value on done: 355774.0 [2023-02-24 19:18:57,835][177157] Sum rewards: 23.112, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.920', 'AMMO2': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.038', 'AMMO3': '0.072', 'WEAPON4': '0.300', 'weapon5': '0.304', 'WEAPON5': '0.350', 'weapon4': '0.424', 'WEAPON3': '0.550', 'weapon2': '0.646', 'HITCOUNT': '1.430', 'weapon3': '1.944', 'DAMAGECOUNT': '5.685', 'FRAGCOUNT': '20.000'} [2023-02-24 19:18:58,056][177157] DAMAGECOUNT value on done: 342412.0 [2023-02-24 19:18:58,057][177157] Sum rewards: 18.823, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.070', 'AMMO5': '0.018', 'AMMO2': '0.038', 'WEAPON1': '0.050', 'AMMO3': '0.108', 'AMMO4': '0.192', 'weapon4': '0.264', 'weapon5': '0.362', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'weapon2': '0.844', 'HITCOUNT': '1.450', 'weapon3': '2.080', 'DAMAGECOUNT': '5.937', 'FRAGCOUNT': '17.000'} [2023-02-24 19:18:58,148][177157] DAMAGECOUNT value on done: 342725.0 [2023-02-24 19:18:58,148][177157] Sum rewards: 11.027, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.236', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon7': '0.072', 'AMMO3': '0.113', 'AMMO4': '0.114', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'WEAPON3': '0.650', 'weapon3': '0.668', 'weapon2': '0.698', 'HITCOUNT': '0.940', 'weapon4': '1.090', 'DAMAGECOUNT': '4.209', 'FRAGCOUNT': '14.000'} [2023-02-24 19:18:58,319][177153] Updated weights for policy 0, policy_version 23690 (0.0008) [2023-02-24 19:18:58,326][177171] DAMAGECOUNT value on done: 343280.0 [2023-02-24 19:18:58,326][177171] Sum rewards: 25.881, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.110', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.034', 'WEAPON1': '0.040', 'AMMO3': '0.106', 'AMMO4': '0.169', 'WEAPON4': '0.250', 'weapon4': '0.288', 'weapon5': '0.330', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'weapon2': '1.010', 'HITCOUNT': '1.700', 'weapon3': '2.026', 'DAMAGECOUNT': '6.867', 'FRAGCOUNT': '22.000'} [2023-02-24 19:18:58,336][177171] DAMAGECOUNT value on done: 345114.0 [2023-02-24 19:18:58,336][177171] Sum rewards: 27.787, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.320', 'AMMO2': '0.016', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.079', 'AMMO3': '0.121', 'weapon5': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.500', 'weapon2': '0.506', 'weapon4': '0.758', 'WEAPON3': '0.850', 'HITCOUNT': '1.830', 'weapon3': '2.210', 'DAMAGECOUNT': '8.457', 'FRAGCOUNT': '23.000'} [2023-02-24 19:18:58,375][177157] DAMAGECOUNT value on done: 347654.0 [2023-02-24 19:18:58,375][177157] Sum rewards: 22.264, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.660', 'AMMO2': '0.015', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'AMMO4': '0.074', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'weapon5': '0.318', 'WEAPON5': '0.500', 'weapon2': '0.642', 'WEAPON3': '0.850', 'HITCOUNT': '1.520', 'weapon3': '2.416', 'DAMAGECOUNT': '7.212', 'FRAGCOUNT': '18.000'} [2023-02-24 19:18:58,632][177171] DAMAGECOUNT value on done: 345867.0 [2023-02-24 19:18:58,633][177171] Sum rewards: 17.197, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.244', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.024', 'WEAPON1': '0.050', 'AMMO3': '0.116', 'AMMO4': '0.120', 'WEAPON4': '0.300', 'weapon4': '0.348', 'weapon5': '0.390', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'weapon2': '0.782', 'HITCOUNT': '1.350', 'weapon3': '1.940', 'DAMAGECOUNT': '5.643', 'FRAGCOUNT': '15.000'} [2023-02-24 19:18:58,644][177171] DAMAGECOUNT value on done: 347617.0 [2023-02-24 19:18:58,644][177171] Sum rewards: 15.669, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.174', 'AMMO5': '0.015', 'AMMO2': '0.027', 'WEAPON1': '0.040', 'AMMO3': '0.114', 'AMMO4': '0.135', 'weapon7': '0.164', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.240', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.582', 'WEAPON3': '0.700', 'weapon4': '0.726', 'HITCOUNT': '1.120', 'weapon3': '1.652', 'DAMAGECOUNT': '5.787', 'FRAGCOUNT': '16.000'} [2023-02-24 19:19:00,834][177155] DAMAGECOUNT value on done: 354968.0 [2023-02-24 19:19:00,834][177155] Sum rewards: 22.857, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.200', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.027', 'WEAPON1': '0.050', 'AMMO3': '0.115', 'WEAPON4': '0.200', 'weapon4': '0.362', 'weapon5': '0.456', 'weapon2': '0.632', 'WEAPON5': '0.650', 'WEAPON3': '0.850', 'HITCOUNT': '1.500', 'weapon3': '2.078', 'DAMAGECOUNT': '5.883', 'FRAGCOUNT': '19.000'} [2023-02-24 19:19:01,136][177155] DAMAGECOUNT value on done: 361481.0 [2023-02-24 19:19:01,137][177155] Sum rewards: 11.205, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.580', 'AMMO5': '0.025', 'AMMO2': '0.029', 'WEAPON1': '0.050', 'AMMO3': '0.126', 'AMMO4': '0.144', 'WEAPON4': '0.150', 'weapon4': '0.238', 'weapon5': '0.428', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon2': '0.950', 'HITCOUNT': '1.270', 'weapon3': '2.016', 'DAMAGECOUNT': '4.809', 'FRAGCOUNT': '10.000'} [2023-02-24 19:19:01,261][177153] Updated weights for policy 0, policy_version 23700 (0.0008) [2023-02-24 19:19:01,343][177155] DAMAGECOUNT value on done: 359207.0 [2023-02-24 19:19:01,343][177155] Sum rewards: 19.248, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.018', 'AMMO2': '0.013', 'AMMO5': '0.021', 'WEAPON1': '0.060', 'AMMO4': '0.065', 'AMMO3': '0.097', 'WEAPON4': '0.150', 'weapon4': '0.260', 'weapon5': '0.266', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'weapon2': '0.906', 'HITCOUNT': '1.530', 'weapon3': '2.248', 'DAMAGECOUNT': '6.000', 'FRAGCOUNT': '15.000'} [2023-02-24 19:19:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13815.3). Total num frames: 97075200. Throughput: 0: 3458.3. Samples: 24269926. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:19:01,376][177119] Avg episode reward: [(0, '20.167')] [2023-02-24 19:19:01,635][177155] DAMAGECOUNT value on done: 342324.0 [2023-02-24 19:19:01,635][177155] Sum rewards: 22.439, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.247', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon7': '0.062', 'AMMO4': '0.062', 'AMMO3': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon5': '0.154', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'weapon2': '0.540', 'weapon4': '0.732', 'HITCOUNT': '1.290', 'weapon3': '1.396', 'DAMAGECOUNT': '5.070', 'FRAGCOUNT': '18.000'} [2023-02-24 19:19:04,218][177153] Updated weights for policy 0, policy_version 23710 (0.0008) [2023-02-24 19:19:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13815.3). Total num frames: 97144832. Throughput: 0: 3462.2. Samples: 24280358. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:19:06,376][177119] Avg episode reward: [(0, '20.158')] [2023-02-24 19:19:07,175][177153] Updated weights for policy 0, policy_version 23720 (0.0008) [2023-02-24 19:19:07,811][177170] DAMAGECOUNT value on done: 347265.0 [2023-02-24 19:19:07,812][177170] Sum rewards: 8.183, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.376', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.027', 'weapon5': '0.050', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.141', 'WEAPON5': '0.200', 'weapon2': '0.446', 'weapon4': '0.500', 'WEAPON3': '0.800', 'HITCOUNT': '0.880', 'weapon3': '1.268', 'DAMAGECOUNT': '4.389', 'FRAGCOUNT': '9.000'} [2023-02-24 19:19:08,119][177170] DAMAGECOUNT value on done: 349145.0 [2023-02-24 19:19:08,119][177170] Sum rewards: 18.204, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.734', 'ARMOR': '0.004', 'AMMO2': '0.014', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.068', 'AMMO3': '0.090', 'WEAPON4': '0.250', 'weapon5': '0.276', 'WEAPON5': '0.400', 'weapon4': '0.522', 'WEAPON3': '0.650', 'weapon2': '0.732', 'HITCOUNT': '1.340', 'weapon3': '1.994', 'DAMAGECOUNT': '5.313', 'FRAGCOUNT': '14.000'} [2023-02-24 19:19:08,713][177170] DAMAGECOUNT value on done: 344015.0 [2023-02-24 19:19:08,714][177170] Sum rewards: 10.678, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.560', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon4': '0.206', 'weapon5': '0.270', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.640', 'weapon2': '0.834', 'weapon3': '1.424', 'DAMAGECOUNT': '2.586', 'FRAGCOUNT': '8.000'} [2023-02-24 19:19:08,934][177170] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 19:19:09,009][177170] DAMAGECOUNT value on done: 348858.0 [2023-02-24 19:19:09,010][177170] Sum rewards: 24.774, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.489', 'WEAPON1': '0.010', 'AMMO5': '0.028', 'AMMO2': '0.045', 'AMMO3': '0.132', 'AMMO4': '0.226', 'weapon5': '0.322', 'WEAPON4': '0.350', 'weapon2': '0.518', 'WEAPON5': '0.650', 'weapon4': '0.744', 'WEAPON3': '0.900', 'HITCOUNT': '1.670', 'weapon3': '1.948', 'DAMAGECOUNT': '7.470', 'FRAGCOUNT': '22.000'} [2023-02-24 19:19:10,098][177153] Updated weights for policy 0, policy_version 23730 (0.0009) [2023-02-24 19:19:10,190][177156] DAMAGECOUNT value on done: 351351.0 [2023-02-24 19:19:10,191][177156] Sum rewards: 24.241, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.600', 'AMMO2': '0.008', 'AMMO5': '0.019', 'AMMO4': '0.038', 'WEAPON1': '0.070', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'weapon4': '0.204', 'weapon5': '0.338', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon2': '0.622', 'HITCOUNT': '1.360', 'weapon3': '1.962', 'DAMAGECOUNT': '6.624', 'FRAGCOUNT': '19.000'} [2023-02-24 19:19:10,276][177156] DAMAGECOUNT value on done: 342653.0 [2023-02-24 19:19:10,276][177156] Sum rewards: 19.445, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.592', 'AMMO5': '0.012', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'AMMO3': '0.080', 'AMMO4': '0.140', 'weapon4': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'weapon5': '0.500', 'weapon2': '0.886', 'HITCOUNT': '1.420', 'weapon3': '1.872', 'DAMAGECOUNT': '5.940', 'FRAGCOUNT': '16.000'} [2023-02-24 19:19:10,475][177158] DAMAGECOUNT value on done: 335251.0 [2023-02-24 19:19:10,476][177158] Sum rewards: 17.390, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.814', 'ARMOR': '0.008', 'AMMO5': '0.014', 'WEAPON1': '0.030', 'AMMO2': '0.036', 'AMMO3': '0.081', 'AMMO4': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon5': '0.442', 'WEAPON3': '0.500', 'weapon2': '0.546', 'weapon4': '0.768', 'weapon3': '0.934', 'HITCOUNT': '0.960', 'DAMAGECOUNT': '4.803', 'FRAGCOUNT': '15.000'} [2023-02-24 19:19:10,506][177156] DAMAGECOUNT value on done: 360241.0 [2023-02-24 19:19:10,507][177156] Sum rewards: 22.126, reward structure: {'DEATHCOUNT': '-9.000', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.032', 'weapon7': '0.048', 'WEAPON1': '0.060', 'AMMO3': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.160', 'weapon5': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'HEALTH': '0.379', 'WEAPON3': '0.500', 'weapon2': '0.658', 'weapon4': '0.996', 'HITCOUNT': '1.360', 'weapon3': '1.598', 'DAMAGECOUNT': '6.009', 'FRAGCOUNT': '18.000'} [2023-02-24 19:19:10,586][177156] DAMAGECOUNT value on done: 341761.0 [2023-02-24 19:19:10,586][177156] Sum rewards: 15.668, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.486', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.012', 'AMMO3': '0.050', 'WEAPON1': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.246', 'WEAPON5': '0.300', 'weapon5': '0.354', 'WEAPON3': '0.400', 'HITCOUNT': '0.870', 'weapon2': '1.090', 'weapon3': '1.576', 'DAMAGECOUNT': '3.795', 'FRAGCOUNT': '10.000'} [2023-02-24 19:19:10,779][177158] DAMAGECOUNT value on done: 342787.0 [2023-02-24 19:19:10,780][177158] Sum rewards: 19.018, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.463', 'AMMO5': '0.014', 'AMMO2': '0.020', 'WEAPON1': '0.050', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.136', 'WEAPON5': '0.350', 'weapon4': '0.402', 'weapon5': '0.420', 'weapon2': '0.634', 'WEAPON3': '0.800', 'HITCOUNT': '1.140', 'weapon3': '1.826', 'DAMAGECOUNT': '5.739', 'FRAGCOUNT': '16.000'} [2023-02-24 19:19:11,085][177158] DAMAGECOUNT value on done: 350712.0 [2023-02-24 19:19:11,085][177158] Sum rewards: 13.553, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.100', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.023', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.077', 'weapon4': '0.098', 'weapon5': '0.182', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'HITCOUNT': '0.860', 'weapon2': '0.994', 'weapon3': '1.510', 'DAMAGECOUNT': '3.294', 'FRAGCOUNT': '11.000'} [2023-02-24 19:19:11,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13815.3). Total num frames: 97214464. Throughput: 0: 3465.0. Samples: 24301174. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:19:11,376][177119] Avg episode reward: [(0, '19.588')] [2023-02-24 19:19:11,381][177158] DAMAGECOUNT value on done: 352588.0 [2023-02-24 19:19:11,382][177158] Sum rewards: 10.912, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.230', 'AMMO2': '0.008', 'AMMO5': '0.025', 'AMMO4': '0.042', 'WEAPON1': '0.050', 'weapon7': '0.056', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.130', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.248', 'weapon4': '0.414', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'weapon2': '0.780', 'HITCOUNT': '0.880', 'weapon3': '1.540', 'DAMAGECOUNT': '3.429', 'FRAGCOUNT': '10.000'} [2023-02-24 19:19:13,043][177153] Updated weights for policy 0, policy_version 23740 (0.0008) [2023-02-24 19:19:15,004][177172] DAMAGECOUNT value on done: 345680.0 [2023-02-24 19:19:15,004][177172] Sum rewards: 23.116, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.204', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO2': '0.030', 'AMMO3': '0.082', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.362', 'WEAPON3': '0.500', 'weapon2': '0.736', 'weapon4': '0.796', 'HITCOUNT': '1.450', 'weapon3': '1.730', 'DAMAGECOUNT': '5.793', 'FRAGCOUNT': '18.000'} [2023-02-24 19:19:15,308][177172] DAMAGECOUNT value on done: 345887.0 [2023-02-24 19:19:15,308][177172] Sum rewards: 14.570, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.355', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO3': '0.030', 'WEAPON1': '0.030', 'AMMO4': '0.119', 'WEAPON3': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.406', 'WEAPON5': '0.500', 'weapon5': '0.536', 'HITCOUNT': '0.960', 'weapon3': '0.998', 'weapon2': '1.098', 'DAMAGECOUNT': '4.800', 'FRAGCOUNT': '11.000'} [2023-02-24 19:19:15,984][177153] Updated weights for policy 0, policy_version 23750 (0.0008) [2023-02-24 19:19:16,100][177154] DAMAGECOUNT value on done: 348883.0 [2023-02-24 19:19:16,100][177154] Sum rewards: 25.134, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.005', 'AMMO2': '0.010', 'AMMO5': '0.023', 'AMMO4': '0.050', 'WEAPON1': '0.050', 'AMMO3': '0.081', 'WEAPON4': '0.350', 'weapon5': '0.528', 'WEAPON3': '0.550', 'weapon2': '0.576', 'WEAPON5': '0.600', 'weapon4': '0.728', 'HITCOUNT': '1.550', 'weapon3': '1.630', 'DAMAGECOUNT': '6.912', 'FRAGCOUNT': '18.500'} [2023-02-24 19:19:16,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13815.3). Total num frames: 97284096. Throughput: 0: 3464.3. Samples: 24321956. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 19:19:16,376][177119] Avg episode reward: [(0, '19.648')] [2023-02-24 19:19:16,404][177154] DAMAGECOUNT value on done: 358157.0 [2023-02-24 19:19:16,404][177154] Sum rewards: 20.167, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.556', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'AMMO4': '0.088', 'AMMO3': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.262', 'weapon5': '0.278', 'WEAPON5': '0.400', 'weapon2': '0.706', 'WEAPON3': '1.000', 'HITCOUNT': '1.170', 'weapon3': '2.292', 'DAMAGECOUNT': '5.847', 'FRAGCOUNT': '19.000'} [2023-02-24 19:19:16,693][177154] DAMAGECOUNT value on done: 362827.0 [2023-02-24 19:19:16,693][177154] Sum rewards: 11.882, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.334', 'AMMO5': '0.014', 'AMMO2': '0.018', 'weapon4': '0.020', 'WEAPON1': '0.040', 'AMMO4': '0.091', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'weapon5': '0.162', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.640', 'weapon2': '0.706', 'weapon3': '1.568', 'DAMAGECOUNT': '2.508', 'FRAGCOUNT': '11.000'} [2023-02-24 19:19:16,794][177172] DAMAGECOUNT value on done: 358798.0 [2023-02-24 19:19:16,795][177172] Sum rewards: 27.695, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.222', 'AMMO2': '0.016', 'AMMO5': '0.020', 'WEAPON4': '0.050', 'WEAPON1': '0.070', 'AMMO4': '0.081', 'weapon4': '0.086', 'AMMO3': '0.106', 'weapon5': '0.366', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'weapon2': '1.006', 'HITCOUNT': '1.920', 'weapon3': '2.036', 'DAMAGECOUNT': '8.310', 'FRAGCOUNT': '21.000'} [2023-02-24 19:19:16,990][177154] DAMAGECOUNT value on done: 360197.0 [2023-02-24 19:19:16,990][177154] Sum rewards: 20.837, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.312', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon4': '0.088', 'AMMO3': '0.095', 'AMMO4': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon5': '0.542', 'WEAPON3': '0.600', 'weapon2': '0.784', 'HITCOUNT': '1.410', 'weapon3': '2.064', 'DAMAGECOUNT': '6.318', 'FRAGCOUNT': '16.000'} [2023-02-24 19:19:17,093][177172] DAMAGECOUNT value on done: 352122.0 [2023-02-24 19:19:17,093][177172] Sum rewards: 21.784, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.562', 'AMMO2': '0.012', 'AMMO5': '0.020', 'WEAPON1': '0.050', 'AMMO3': '0.052', 'AMMO4': '0.060', 'WEAPON4': '0.200', 'weapon5': '0.314', 'WEAPON3': '0.350', 'WEAPON5': '0.550', 'weapon4': '0.688', 'weapon2': '1.288', 'HITCOUNT': '1.320', 'weapon3': '1.354', 'DAMAGECOUNT': '5.337', 'FRAGCOUNT': '16.000'} [2023-02-24 19:19:17,207][177157] DAMAGECOUNT value on done: 358180.0 [2023-02-24 19:19:17,207][177157] Sum rewards: 31.158, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.916', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.062', 'AMMO3': '0.072', 'WEAPON5': '0.200', 'weapon5': '0.278', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'weapon4': '0.606', 'weapon2': '1.038', 'weapon3': '1.390', 'HITCOUNT': '1.800', 'DAMAGECOUNT': '7.218', 'FRAGCOUNT': '23.000'} [2023-02-24 19:19:17,411][177157] DAMAGECOUNT value on done: 343977.0 [2023-02-24 19:19:17,412][177157] Sum rewards: 12.857, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.450', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO5': '0.022', 'WEAPON1': '0.050', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'weapon5': '0.254', 'weapon4': '0.286', 'ARMOR': '0.453', 'WEAPON5': '0.500', 'weapon2': '0.760', 'WEAPON3': '0.850', 'HITCOUNT': '1.160', 'weapon3': '1.978', 'DAMAGECOUNT': '4.695', 'FRAGCOUNT': '12.000'} [2023-02-24 19:19:17,515][177157] DAMAGECOUNT value on done: 343533.0 [2023-02-24 19:19:17,515][177157] Sum rewards: 4.397, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.190', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'weapon7': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon2': '0.132', 'WEAPON7': '0.200', 'weapon5': '0.226', 'WEAPON5': '0.250', 'weapon4': '0.458', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'weapon3': '1.428', 'DAMAGECOUNT': '2.424', 'FRAGCOUNT': '4.000'} [2023-02-24 19:19:17,628][177171] DAMAGECOUNT value on done: 344421.0 [2023-02-24 19:19:17,628][177171] Sum rewards: 12.550, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.771', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'weapon5': '0.068', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'weapon7': '0.128', 'weapon4': '0.174', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.780', 'weapon3': '1.186', 'weapon2': '1.956', 'DAMAGECOUNT': '3.423', 'FRAGCOUNT': '10.000'} [2023-02-24 19:19:17,639][177171] DAMAGECOUNT value on done: 346749.0 [2023-02-24 19:19:17,639][177171] Sum rewards: 16.666, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.702', 'AMMO5': '0.013', 'AMMO2': '0.015', 'weapon4': '0.016', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'WEAPON5': '0.400', 'weapon5': '0.428', 'WEAPON3': '0.700', 'HITCOUNT': '0.980', 'weapon2': '1.246', 'weapon3': '1.882', 'DAMAGECOUNT': '4.905', 'FRAGCOUNT': '14.000'} [2023-02-24 19:19:17,720][177157] DAMAGECOUNT value on done: 349221.0 [2023-02-24 19:19:17,721][177157] Sum rewards: 21.856, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.012', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.057', 'WEAPON4': '0.100', 'AMMO4': '0.142', 'weapon4': '0.216', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'weapon5': '0.340', 'HEALTH': '0.895', 'HITCOUNT': '1.160', 'weapon3': '1.272', 'weapon2': '1.352', 'DAMAGECOUNT': '4.701', 'FRAGCOUNT': '15.500'} [2023-02-24 19:19:17,936][177171] DAMAGECOUNT value on done: 347437.0 [2023-02-24 19:19:17,937][177171] Sum rewards: 9.210, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.984', 'AMMO2': '0.007', 'AMMO5': '0.019', 'weapon4': '0.036', 'AMMO4': '0.036', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.151', 'weapon5': '0.260', 'WEAPON5': '0.450', 'weapon2': '0.970', 'WEAPON3': '1.000', 'HITCOUNT': '1.120', 'weapon3': '2.294', 'DAMAGECOUNT': '4.710', 'FRAGCOUNT': '9.000'} [2023-02-24 19:19:17,947][177171] DAMAGECOUNT value on done: 349905.0 [2023-02-24 19:19:17,948][177171] Sum rewards: 23.422, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.168', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.035', 'WEAPON1': '0.050', 'weapon7': '0.056', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.133', 'AMMO4': '0.174', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.280', 'WEAPON4': '0.450', 'weapon4': '0.706', 'weapon2': '0.716', 'WEAPON3': '0.800', 'HITCOUNT': '1.720', 'weapon3': '1.902', 'DAMAGECOUNT': '6.864', 'FRAGCOUNT': '22.000'} [2023-02-24 19:19:18,999][177153] Updated weights for policy 0, policy_version 23760 (0.0008) [2023-02-24 19:19:20,244][177155] DAMAGECOUNT value on done: 356324.0 [2023-02-24 19:19:20,244][177155] Sum rewards: 15.592, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.675', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO5': '0.009', 'WEAPON1': '0.030', 'AMMO3': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.258', 'weapon4': '0.534', 'weapon2': '0.684', 'WEAPON3': '0.700', 'HITCOUNT': '1.100', 'weapon3': '1.368', 'DAMAGECOUNT': '4.068', 'FRAGCOUNT': '14.000'} [2023-02-24 19:19:20,552][177155] DAMAGECOUNT value on done: 362561.0 [2023-02-24 19:19:20,553][177155] Sum rewards: 12.454, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.390', 'AMMO2': '0.014', 'AMMO5': '0.016', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'AMMO4': '0.069', 'AMMO3': '0.109', 'weapon4': '0.180', 'WEAPON5': '0.400', 'weapon5': '0.408', 'WEAPON3': '0.700', 'HITCOUNT': '0.860', 'weapon2': '0.888', 'weapon3': '1.850', 'DAMAGECOUNT': '3.240', 'FRAGCOUNT': '11.000'} [2023-02-24 19:19:20,757][177155] DAMAGECOUNT value on done: 361370.0 [2023-02-24 19:19:20,758][177155] Sum rewards: 15.091, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.910', 'AMMO5': '0.025', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'AMMO4': '0.125', 'AMMO3': '0.152', 'weapon2': '0.222', 'WEAPON4': '0.500', 'weapon5': '0.524', 'WEAPON5': '0.700', 'weapon4': '0.830', 'WEAPON3': '0.900', 'HITCOUNT': '1.600', 'weapon3': '1.618', 'DAMAGECOUNT': '6.489', 'FRAGCOUNT': '17.000'} [2023-02-24 19:19:21,058][177155] DAMAGECOUNT value on done: 343750.0 [2023-02-24 19:19:21,059][177155] Sum rewards: 16.062, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.605', 'AMMO2': '0.009', 'AMMO5': '0.016', 'weapon4': '0.020', 'WEAPON1': '0.040', 'AMMO4': '0.044', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'WEAPON5': '0.450', 'weapon5': '0.460', 'WEAPON3': '0.650', 'weapon2': '1.000', 'HITCOUNT': '1.070', 'weapon3': '1.694', 'DAMAGECOUNT': '4.278', 'FRAGCOUNT': '13.000'} [2023-02-24 19:19:21,376][177119] Fps is (10 sec: 13926.2, 60 sec: 13858.1, 300 sec: 13829.2). Total num frames: 97353728. Throughput: 0: 3463.7. Samples: 24332302. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 19:19:21,376][177119] Avg episode reward: [(0, '18.943')] [2023-02-24 19:19:21,959][177153] Updated weights for policy 0, policy_version 23770 (0.0008) [2023-02-24 19:19:24,919][177153] Updated weights for policy 0, policy_version 23780 (0.0008) [2023-02-24 19:19:26,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13789.9, 300 sec: 13815.3). Total num frames: 97419264. Throughput: 0: 3466.8. Samples: 24353110. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 19:19:26,376][177119] Avg episode reward: [(0, '18.943')] [2023-02-24 19:19:27,225][177170] DAMAGECOUNT value on done: 349014.0 [2023-02-24 19:19:27,226][177170] Sum rewards: 14.159, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.254', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'AMMO3': '0.097', 'AMMO4': '0.178', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon5': '0.532', 'weapon2': '0.544', 'WEAPON3': '0.550', 'weapon4': '0.636', 'HITCOUNT': '1.210', 'weapon3': '1.698', 'DAMAGECOUNT': '5.247', 'FRAGCOUNT': '12.000'} [2023-02-24 19:19:27,527][177170] DAMAGECOUNT value on done: 350833.0 [2023-02-24 19:19:27,527][177170] Sum rewards: 18.050, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.070', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.152', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'weapon2': '0.606', 'weapon4': '0.706', 'HITCOUNT': '0.990', 'weapon3': '1.386', 'DAMAGECOUNT': '5.064', 'FRAGCOUNT': '14.000'} [2023-02-24 19:19:27,889][177153] Updated weights for policy 0, policy_version 23790 (0.0008) [2023-02-24 19:19:28,124][177170] DAMAGECOUNT value on done: 344987.0 [2023-02-24 19:19:28,125][177170] Sum rewards: 11.673, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.836', 'AMMO2': '0.009', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.113', 'weapon2': '0.228', 'weapon5': '0.254', 'WEAPON5': '0.500', 'weapon4': '0.608', 'WEAPON3': '0.700', 'HITCOUNT': '0.740', 'weapon3': '1.706', 'DAMAGECOUNT': '2.916', 'FRAGCOUNT': '11.000'} [2023-02-24 19:19:28,430][177170] DAMAGECOUNT value on done: 350438.0 [2023-02-24 19:19:28,431][177170] Sum rewards: 16.525, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.097', 'AMMO2': '0.002', 'ARMOR': '0.004', 'AMMO4': '0.012', 'WEAPON1': '0.020', 'AMMO5': '0.027', 'AMMO3': '0.088', 'WEAPON4': '0.350', 'weapon5': '0.538', 'WEAPON5': '0.600', 'WEAPON3': '0.650', 'weapon2': '0.792', 'weapon4': '0.824', 'HITCOUNT': '1.280', 'weapon3': '1.444', 'DAMAGECOUNT': '4.740', 'FRAGCOUNT': '14.000'} [2023-02-24 19:19:29,603][177156] DAMAGECOUNT value on done: 352943.0 [2023-02-24 19:19:29,604][177156] Sum rewards: 13.900, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.450', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.015', 'AMMO5': '0.019', 'AMMO3': '0.130', 'weapon5': '0.330', 'WEAPON5': '0.450', 'weapon2': '0.822', 'WEAPON3': '0.900', 'HITCOUNT': '1.100', 'weapon3': '2.294', 'DAMAGECOUNT': '4.776', 'FRAGCOUNT': '12.000'} [2023-02-24 19:19:29,744][177156] DAMAGECOUNT value on done: 344773.0 [2023-02-24 19:19:29,744][177156] Sum rewards: 24.604, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.209', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.017', 'WEAPON1': '0.040', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.300', 'weapon4': '0.370', 'weapon5': '0.390', 'WEAPON3': '0.400', 'weapon2': '1.206', 'HITCOUNT': '1.340', 'weapon3': '1.694', 'DAMAGECOUNT': '6.360', 'FRAGCOUNT': '17.000'} [2023-02-24 19:19:29,912][177158] DAMAGECOUNT value on done: 336990.0 [2023-02-24 19:19:29,913][177158] Sum rewards: 18.983, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.009', 'AMMO5': '0.019', 'WEAPON1': '0.030', 'AMMO4': '0.044', 'AMMO3': '0.078', 'ARMOR': '0.400', 'HEALTH': '0.442', 'WEAPON3': '0.450', 'WEAPON5': '0.450', 'weapon5': '0.618', 'weapon2': '0.876', 'HITCOUNT': '1.020', 'weapon3': '1.580', 'DAMAGECOUNT': '5.217', 'FRAGCOUNT': '13.000'} [2023-02-24 19:19:29,925][177156] DAMAGECOUNT value on done: 361605.0 [2023-02-24 19:19:29,926][177156] Sum rewards: 12.539, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.312', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO5': '0.011', 'WEAPON1': '0.040', 'AMMO4': '0.045', 'AMMO3': '0.069', 'WEAPON4': '0.100', 'weapon4': '0.152', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'weapon5': '0.572', 'weapon2': '0.806', 'HITCOUNT': '0.840', 'weapon3': '1.660', 'DAMAGECOUNT': '4.092', 'FRAGCOUNT': '9.000'} [2023-02-24 19:19:30,050][177156] DAMAGECOUNT value on done: 344061.0 [2023-02-24 19:19:30,050][177156] Sum rewards: 21.745, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.560', 'ARMOR': '0.004', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO4': '0.041', 'AMMO3': '0.173', 'weapon5': '0.232', 'WEAPON4': '0.250', 'weapon4': '0.306', 'WEAPON5': '0.350', 'weapon2': '0.624', 'WEAPON3': '1.050', 'HITCOUNT': '1.620', 'weapon3': '2.470', 'DAMAGECOUNT': '6.900', 'FRAGCOUNT': '22.000'} [2023-02-24 19:19:30,215][177158] DAMAGECOUNT value on done: 343921.0 [2023-02-24 19:19:30,216][177158] Sum rewards: 13.623, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.134', 'AMMO2': '0.007', 'AMMO5': '0.012', 'AMMO4': '0.035', 'WEAPON1': '0.040', 'weapon7': '0.066', 'AMMO3': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.322', 'WEAPON5': '0.400', 'weapon5': '0.408', 'WEAPON3': '0.550', 'weapon2': '0.676', 'HITCOUNT': '0.840', 'weapon3': '1.726', 'DAMAGECOUNT': '3.402', 'FRAGCOUNT': '11.000'} [2023-02-24 19:19:30,510][177158] DAMAGECOUNT value on done: 352240.0 [2023-02-24 19:19:30,511][177158] Sum rewards: 16.690, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.766', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon7': '0.030', 'AMMO3': '0.102', 'AMMO4': '0.121', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.232', 'WEAPON5': '0.250', 'weapon5': '0.344', 'ARMOR': '0.446', 'WEAPON3': '0.550', 'HITCOUNT': '0.830', 'weapon2': '0.844', 'weapon3': '2.036', 'DAMAGECOUNT': '4.584', 'FRAGCOUNT': '13.000'} [2023-02-24 19:19:30,820][177158] DAMAGECOUNT value on done: 354414.0 [2023-02-24 19:19:30,821][177158] Sum rewards: 16.374, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.345', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'AMMO2': '0.029', 'AMMO3': '0.119', 'AMMO4': '0.144', 'weapon5': '0.428', 'weapon4': '0.478', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'weapon2': '0.952', 'HITCOUNT': '1.510', 'weapon3': '1.682', 'DAMAGECOUNT': '5.478', 'FRAGCOUNT': '18.000'} [2023-02-24 19:19:30,857][177153] Updated weights for policy 0, policy_version 23800 (0.0008) [2023-02-24 19:19:31,376][177119] Fps is (10 sec: 13516.9, 60 sec: 13789.9, 300 sec: 13815.3). Total num frames: 97488896. Throughput: 0: 3462.0. Samples: 24373752. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:19:31,376][177119] Avg episode reward: [(0, '18.511')] [2023-02-24 19:19:33,808][177153] Updated weights for policy 0, policy_version 23810 (0.0008) [2023-02-24 19:19:34,440][177172] DAMAGECOUNT value on done: 347423.0 [2023-02-24 19:19:34,440][177172] Sum rewards: 15.324, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.049', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.059', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'WEAPON5': '0.300', 'weapon5': '0.506', 'WEAPON3': '0.600', 'weapon2': '0.614', 'HITCOUNT': '1.020', 'weapon3': '2.190', 'DAMAGECOUNT': '5.229', 'FRAGCOUNT': '12.000'} [2023-02-24 19:19:34,741][177172] DAMAGECOUNT value on done: 348400.0 [2023-02-24 19:19:34,742][177172] Sum rewards: 26.567, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.016', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'weapon4': '0.088', 'AMMO4': '0.094', 'AMMO3': '0.105', 'WEAPON5': '0.350', 'weapon5': '0.400', 'WEAPON3': '0.600', 'HEALTH': '0.674', 'weapon2': '0.930', 'HITCOUNT': '1.920', 'weapon3': '2.032', 'DAMAGECOUNT': '7.539', 'FRAGCOUNT': '20.000'} [2023-02-24 19:19:35,557][177154] DAMAGECOUNT value on done: 351610.0 [2023-02-24 19:19:35,557][177154] Sum rewards: 25.159, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.546', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.037', 'AMMO3': '0.133', 'AMMO4': '0.184', 'weapon5': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.838', 'WEAPON3': '0.850', 'weapon4': '0.852', 'weapon3': '1.568', 'HITCOUNT': '1.870', 'DAMAGECOUNT': '8.181', 'FRAGCOUNT': '23.000'} [2023-02-24 19:19:35,858][177154] DAMAGECOUNT value on done: 360865.0 [2023-02-24 19:19:35,859][177154] Sum rewards: 30.515, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.146', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'AMMO3': '0.092', 'AMMO4': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon5': '0.516', 'weapon4': '0.546', 'WEAPON3': '0.600', 'weapon2': '0.620', 'weapon3': '1.880', 'HITCOUNT': '2.080', 'DAMAGECOUNT': '8.124', 'FRAGCOUNT': '23.000'} [2023-02-24 19:19:36,156][177154] DAMAGECOUNT value on done: 364219.0 [2023-02-24 19:19:36,156][177154] Sum rewards: 14.072, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.076', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.031', 'WEAPON1': '0.060', 'AMMO3': '0.099', 'AMMO4': '0.156', 'WEAPON4': '0.300', 'weapon4': '0.336', 'WEAPON5': '0.600', 'WEAPON3': '0.600', 'weapon2': '0.628', 'weapon5': '0.646', 'HITCOUNT': '0.990', 'weapon3': '1.746', 'DAMAGECOUNT': '4.176', 'FRAGCOUNT': '13.000'} [2023-02-24 19:19:36,256][177172] DAMAGECOUNT value on done: 360295.0 [2023-02-24 19:19:36,256][177172] Sum rewards: 18.349, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.660', 'AMMO5': '0.024', 'AMMO2': '0.030', 'WEAPON1': '0.030', 'AMMO3': '0.082', 'AMMO4': '0.148', 'WEAPON4': '0.250', 'weapon4': '0.428', 'WEAPON3': '0.500', 'WEAPON5': '0.550', 'weapon5': '0.574', 'weapon2': '1.096', 'HITCOUNT': '1.230', 'weapon3': '1.326', 'DAMAGECOUNT': '4.491', 'FRAGCOUNT': '15.000'} [2023-02-24 19:19:36,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13815.3). Total num frames: 97558528. Throughput: 0: 3462.6. Samples: 24384196. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:19:36,376][177119] Avg episode reward: [(0, '18.312')] [2023-02-24 19:19:36,465][177154] DAMAGECOUNT value on done: 362181.0 [2023-02-24 19:19:36,466][177154] Sum rewards: 19.321, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.180', 'AMMO2': '0.015', 'AMMO5': '0.018', 'AMMO4': '0.076', 'WEAPON1': '0.080', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'weapon4': '0.240', 'weapon5': '0.544', 'WEAPON5': '0.550', 'weapon2': '0.654', 'WEAPON3': '0.700', 'HITCOUNT': '1.190', 'weapon3': '2.040', 'DAMAGECOUNT': '5.952', 'FRAGCOUNT': '15.000'} [2023-02-24 19:19:36,558][177172] DAMAGECOUNT value on done: 354223.0 [2023-02-24 19:19:36,559][177172] Sum rewards: 23.504, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.808', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO5': '0.019', 'WEAPON1': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'weapon4': '0.132', 'weapon5': '0.368', 'WEAPON5': '0.450', 'weapon2': '0.784', 'WEAPON3': '0.900', 'HITCOUNT': '1.560', 'weapon3': '2.268', 'DAMAGECOUNT': '6.303', 'FRAGCOUNT': '22.000'} [2023-02-24 19:19:36,670][177157] DAMAGECOUNT value on done: 360475.0 [2023-02-24 19:19:36,670][177157] Sum rewards: 23.307, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.820', 'AMMO2': '0.017', 'AMMO5': '0.019', 'WEAPON1': '0.030', 'AMMO4': '0.083', 'AMMO3': '0.121', 'weapon2': '0.282', 'WEAPON4': '0.350', 'weapon5': '0.356', 'WEAPON5': '0.450', 'weapon4': '0.624', 'WEAPON3': '0.800', 'HITCOUNT': '1.690', 'weapon3': '2.170', 'DAMAGECOUNT': '6.885', 'FRAGCOUNT': '21.000'} [2023-02-24 19:19:36,772][177153] Updated weights for policy 0, policy_version 23820 (0.0009) [2023-02-24 19:19:36,899][177157] DAMAGECOUNT value on done: 346987.0 [2023-02-24 19:19:36,899][177157] Sum rewards: 34.412, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.248', 'ARMOR': '0.004', 'AMMO2': '0.017', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.083', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'weapon4': '0.302', 'WEAPON5': '0.400', 'weapon5': '0.432', 'weapon2': '0.540', 'WEAPON3': '0.750', 'HITCOUNT': '1.720', 'weapon3': '2.304', 'DAMAGECOUNT': '9.030', 'FRAGCOUNT': '27.000'} [2023-02-24 19:19:36,985][177157] DAMAGECOUNT value on done: 345126.0 [2023-02-24 19:19:36,985][177157] Sum rewards: 18.618, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.415', 'AMMO2': '0.009', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.044', 'weapon7': '0.054', 'AMMO3': '0.081', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.250', 'weapon5': '0.262', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'weapon2': '0.764', 'weapon4': '1.084', 'weapon3': '1.172', 'HITCOUNT': '1.300', 'DAMAGECOUNT': '4.779', 'FRAGCOUNT': '15.000'} [2023-02-24 19:19:37,041][177171] DAMAGECOUNT value on done: 346389.0 [2023-02-24 19:19:37,042][177171] Sum rewards: 15.771, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.534', 'AMMO2': '0.018', 'AMMO5': '0.021', 'WEAPON1': '0.050', 'AMMO4': '0.091', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'weapon4': '0.182', 'weapon2': '0.330', 'WEAPON5': '0.550', 'weapon5': '0.588', 'WEAPON3': '0.800', 'HITCOUNT': '1.080', 'weapon3': '2.162', 'DAMAGECOUNT': '5.904', 'FRAGCOUNT': '13.500'} [2023-02-24 19:19:37,051][177171] DAMAGECOUNT value on done: 348493.0 [2023-02-24 19:19:37,051][177171] Sum rewards: 13.755, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.690', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'AMMO3': '0.096', 'AMMO4': '0.106', 'WEAPON5': '0.200', 'weapon4': '0.226', 'weapon5': '0.236', 'WEAPON4': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '1.280', 'weapon3': '1.280', 'weapon2': '1.300', 'DAMAGECOUNT': '5.232', 'FRAGCOUNT': '12.000'} [2023-02-24 19:19:37,201][177157] DAMAGECOUNT value on done: 350982.0 [2023-02-24 19:19:37,201][177157] Sum rewards: 20.490, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.416', 'AMMO2': '0.016', 'AMMO5': '0.021', 'WEAPON1': '0.050', 'AMMO4': '0.081', 'AMMO3': '0.084', 'WEAPON4': '0.150', 'weapon4': '0.372', 'weapon5': '0.448', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'HITCOUNT': '1.190', 'weapon3': '1.278', 'weapon2': '1.532', 'DAMAGECOUNT': '5.283', 'FRAGCOUNT': '17.000'} [2023-02-24 19:19:37,334][177171] DAMAGECOUNT value on done: 348702.0 [2023-02-24 19:19:37,334][177171] Sum rewards: 15.968, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.937', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.040', 'AMMO3': '0.078', 'weapon7': '0.098', 'AMMO4': '0.199', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.232', 'WEAPON7': '0.300', 'WEAPON3': '0.450', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon3': '0.558', 'weapon2': '0.680', 'HITCOUNT': '0.970', 'weapon4': '1.402', 'DAMAGECOUNT': '3.780', 'FRAGCOUNT': '12.000'} [2023-02-24 19:19:37,347][177171] DAMAGECOUNT value on done: 351632.0 [2023-02-24 19:19:37,348][177171] Sum rewards: 18.382, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.640', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.015', 'WEAPON1': '0.050', 'AMMO3': '0.100', 'WEAPON4': '0.200', 'weapon5': '0.350', 'weapon4': '0.360', 'WEAPON5': '0.450', 'weapon2': '0.628', 'WEAPON3': '0.650', 'HITCOUNT': '1.300', 'weapon3': '1.492', 'DAMAGECOUNT': '5.181', 'FRAGCOUNT': '15.000'} [2023-02-24 19:19:39,679][177155] DAMAGECOUNT value on done: 358470.0 [2023-02-24 19:19:39,679][177155] Sum rewards: 21.191, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.910', 'AMMO5': '0.010', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'weapon7': '0.046', 'AMMO3': '0.105', 'AMMO4': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.348', 'weapon4': '0.410', 'weapon5': '0.570', 'WEAPON3': '0.750', 'HITCOUNT': '1.410', 'weapon3': '2.156', 'DAMAGECOUNT': '6.438', 'FRAGCOUNT': '17.000'} [2023-02-24 19:19:39,715][177153] Updated weights for policy 0, policy_version 23830 (0.0008) [2023-02-24 19:19:39,987][177155] DAMAGECOUNT value on done: 363981.0 [2023-02-24 19:19:39,988][177155] Sum rewards: 14.876, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.433', 'AMMO5': '0.017', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'AMMO3': '0.081', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'weapon4': '0.188', 'WEAPON5': '0.350', 'weapon5': '0.452', 'WEAPON3': '0.500', 'HITCOUNT': '1.030', 'weapon2': '1.136', 'weapon3': '1.732', 'DAMAGECOUNT': '4.260', 'FRAGCOUNT': '12.000'} [2023-02-24 19:19:40,188][177155] DAMAGECOUNT value on done: 363454.0 [2023-02-24 19:19:40,189][177155] Sum rewards: 23.655, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.484', 'weapon4': '0.012', 'AMMO2': '0.021', 'AMMO5': '0.024', 'WEAPON1': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.103', 'AMMO3': '0.152', 'weapon2': '0.476', 'weapon5': '0.510', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'HITCOUNT': '1.450', 'weapon3': '2.490', 'DAMAGECOUNT': '6.252', 'FRAGCOUNT': '21.000'} [2023-02-24 19:19:40,491][177155] DAMAGECOUNT value on done: 345147.0 [2023-02-24 19:19:40,491][177155] Sum rewards: 11.167, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.203', 'AMMO2': '0.007', 'AMMO5': '0.020', 'AMMO4': '0.036', 'WEAPON1': '0.040', 'weapon7': '0.070', 'AMMO3': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.282', 'weapon5': '0.546', 'WEAPON5': '0.600', 'weapon4': '0.608', 'WEAPON3': '0.750', 'HITCOUNT': '0.910', 'weapon3': '1.814', 'DAMAGECOUNT': '4.191', 'FRAGCOUNT': '11.000'} [2023-02-24 19:19:41,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13815.3). Total num frames: 97628160. Throughput: 0: 3462.8. Samples: 24404948. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:19:41,376][177119] Avg episode reward: [(0, '18.550')] [2023-02-24 19:19:42,663][177153] Updated weights for policy 0, policy_version 23840 (0.0008) [2023-02-24 19:19:45,609][177153] Updated weights for policy 0, policy_version 23850 (0.0009) [2023-02-24 19:19:46,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13815.3). Total num frames: 97697792. Throughput: 0: 3464.0. Samples: 24425808. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:19:46,376][177119] Avg episode reward: [(0, '18.550')] [2023-02-24 19:19:46,630][177170] DAMAGECOUNT value on done: 351518.0 [2023-02-24 19:19:46,631][177170] Sum rewards: 20.227, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.312', 'ARMOR': '0.004', 'AMMO2': '0.018', 'AMMO5': '0.021', 'WEAPON1': '0.040', 'AMMO4': '0.090', 'AMMO3': '0.104', 'WEAPON4': '0.250', 'weapon2': '0.338', 'weapon5': '0.522', 'weapon4': '0.560', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'HITCOUNT': '1.710', 'weapon3': '1.820', 'DAMAGECOUNT': '7.512', 'FRAGCOUNT': '17.000'} [2023-02-24 19:19:46,857][177170] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-24 19:19:46,929][177170] DAMAGECOUNT value on done: 352656.0 [2023-02-24 19:19:46,930][177170] Sum rewards: 18.322, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.138', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.016', 'AMMO4': '0.054', 'AMMO3': '0.095', 'WEAPON5': '0.400', 'weapon5': '0.436', 'WEAPON3': '0.650', 'weapon2': '0.998', 'HITCOUNT': '1.260', 'weapon3': '2.060', 'DAMAGECOUNT': '5.469', 'FRAGCOUNT': '14.000'} [2023-02-24 19:19:47,545][177170] DAMAGECOUNT value on done: 347264.0 [2023-02-24 19:19:47,545][177170] Sum rewards: 19.251, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.020', 'AMMO2': '0.029', 'WEAPON1': '0.030', 'AMMO3': '0.114', 'AMMO4': '0.144', 'weapon2': '0.186', 'WEAPON4': '0.250', 'HEALTH': '0.422', 'weapon4': '0.448', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon5': '0.658', 'HITCOUNT': '1.250', 'weapon3': '2.074', 'DAMAGECOUNT': '6.825', 'FRAGCOUNT': '15.500'} [2023-02-24 19:19:47,849][177170] DAMAGECOUNT value on done: 352929.0 [2023-02-24 19:19:47,849][177170] Sum rewards: 27.246, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.694', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO3': '0.113', 'AMMO4': '0.142', 'WEAPON4': '0.200', 'weapon5': '0.312', 'WEAPON5': '0.350', 'weapon4': '0.516', 'WEAPON3': '0.800', 'weapon2': '0.824', 'HITCOUNT': '1.800', 'weapon3': '1.862', 'DAMAGECOUNT': '7.473', 'FRAGCOUNT': '22.000'} [2023-02-24 19:19:48,573][177153] Updated weights for policy 0, policy_version 23860 (0.0008) [2023-02-24 19:19:49,039][177156] DAMAGECOUNT value on done: 354845.0 [2023-02-24 19:19:49,039][177156] Sum rewards: 22.215, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.015', 'AMMO2': '0.004', 'AMMO5': '0.013', 'AMMO4': '0.022', 'weapon7': '0.058', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.152', 'weapon4': '0.152', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.216', 'WEAPON5': '0.350', 'ARMOR': '0.472', 'weapon2': '0.912', 'WEAPON3': '0.950', 'HITCOUNT': '1.350', 'weapon3': '1.982', 'DAMAGECOUNT': '5.706', 'FRAGCOUNT': '21.000'} [2023-02-24 19:19:49,173][177156] DAMAGECOUNT value on done: 346120.0 [2023-02-24 19:19:49,174][177156] Sum rewards: 12.266, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.743', 'AMMO5': '0.013', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.097', 'weapon4': '0.202', 'weapon5': '0.348', 'WEAPON5': '0.350', 'weapon2': '0.524', 'WEAPON3': '0.650', 'HITCOUNT': '1.020', 'weapon3': '1.882', 'DAMAGECOUNT': '4.041', 'FRAGCOUNT': '10.500'} [2023-02-24 19:19:49,349][177156] DAMAGECOUNT value on done: 362752.0 [2023-02-24 19:19:49,350][177156] Sum rewards: 5.137, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.655', 'AMMO5': '0.020', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'AMMO4': '0.123', 'AMMO3': '0.139', 'WEAPON5': '0.400', 'weapon5': '0.426', 'WEAPON4': '0.450', 'weapon2': '0.476', 'weapon4': '0.658', 'WEAPON3': '0.800', 'HITCOUNT': '1.070', 'weapon3': '1.734', 'DAMAGECOUNT': '3.441', 'FRAGCOUNT': '6.000'} [2023-02-24 19:19:49,351][177158] DAMAGECOUNT value on done: 339904.0 [2023-02-24 19:19:49,352][177158] Sum rewards: 27.994, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.745', 'AMMO2': '0.005', 'weapon4': '0.018', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'AMMO3': '0.160', 'weapon5': '0.306', 'weapon2': '0.414', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '2.060', 'weapon3': '2.820', 'DAMAGECOUNT': '8.742', 'FRAGCOUNT': '25.000'} [2023-02-24 19:19:49,480][177156] DAMAGECOUNT value on done: 346491.0 [2023-02-24 19:19:49,481][177156] Sum rewards: 26.684, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.658', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.012', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon2': '0.262', 'weapon5': '0.366', 'WEAPON5': '0.400', 'weapon4': '0.536', 'WEAPON3': '0.800', 'HITCOUNT': '1.650', 'weapon3': '2.270', 'DAMAGECOUNT': '7.290', 'FRAGCOUNT': '22.000'} [2023-02-24 19:19:49,653][177158] DAMAGECOUNT value on done: 345623.0 [2023-02-24 19:19:49,653][177158] Sum rewards: 17.817, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.646', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'weapon7': '0.052', 'AMMO4': '0.057', 'AMMO3': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.292', 'WEAPON4': '0.300', 'WEAPON3': '0.600', 'weapon4': '0.734', 'weapon2': '0.920', 'HITCOUNT': '1.270', 'weapon3': '1.326', 'DAMAGECOUNT': '5.106', 'FRAGCOUNT': '14.000'} [2023-02-24 19:19:49,954][177158] DAMAGECOUNT value on done: 354358.0 [2023-02-24 19:19:49,954][177158] Sum rewards: 21.280, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.977', 'AMMO2': '0.020', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'AMMO4': '0.098', 'AMMO3': '0.105', 'weapon5': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'weapon2': '0.706', 'weapon4': '0.980', 'weapon3': '1.576', 'HITCOUNT': '1.610', 'DAMAGECOUNT': '6.354', 'FRAGCOUNT': '18.000'} [2023-02-24 19:19:50,257][177158] DAMAGECOUNT value on done: 355290.0 [2023-02-24 19:19:50,257][177158] Sum rewards: 8.862, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.358', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO3': '0.066', 'AMMO4': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.320', 'weapon5': '0.392', 'WEAPON3': '0.400', 'HITCOUNT': '0.540', 'weapon2': '1.142', 'weapon3': '1.306', 'DAMAGECOUNT': '2.628', 'FRAGCOUNT': '7.000'} [2023-02-24 19:19:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13815.3). Total num frames: 97767424. Throughput: 0: 3460.8. Samples: 24436094. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:19:51,376][177119] Avg episode reward: [(0, '18.423')] [2023-02-24 19:19:51,520][177153] Updated weights for policy 0, policy_version 23870 (0.0008) [2023-02-24 19:19:53,890][177172] DAMAGECOUNT value on done: 349919.0 [2023-02-24 19:19:53,891][177172] Sum rewards: 26.544, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.752', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'AMMO3': '0.156', 'AMMO4': '0.179', 'weapon5': '0.282', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.556', 'weapon4': '0.742', 'WEAPON3': '0.900', 'HITCOUNT': '1.770', 'weapon3': '2.050', 'DAMAGECOUNT': '7.488', 'FRAGCOUNT': '23.000'} [2023-02-24 19:19:54,192][177172] DAMAGECOUNT value on done: 350287.0 [2023-02-24 19:19:54,192][177172] Sum rewards: 16.114, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.250', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.134', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon5': '0.338', 'weapon2': '0.448', 'weapon4': '0.654', 'WEAPON3': '0.900', 'HITCOUNT': '1.540', 'weapon3': '2.072', 'DAMAGECOUNT': '5.661', 'FRAGCOUNT': '15.000'} [2023-02-24 19:19:54,460][177153] Updated weights for policy 0, policy_version 23880 (0.0008) [2023-02-24 19:19:54,977][177154] DAMAGECOUNT value on done: 353107.0 [2023-02-24 19:19:54,977][177154] Sum rewards: 12.854, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.010', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.050', 'AMMO3': '0.073', 'HEALTH': '0.101', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'weapon5': '0.718', 'weapon2': '0.866', 'HITCOUNT': '0.960', 'weapon3': '1.798', 'DAMAGECOUNT': '4.491', 'FRAGCOUNT': '7.500'} [2023-02-24 19:19:55,282][177154] DAMAGECOUNT value on done: 363174.0 [2023-02-24 19:19:55,282][177154] Sum rewards: 23.456, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.540', 'AMMO5': '0.015', 'AMMO2': '0.023', 'WEAPON1': '0.050', 'weapon5': '0.062', 'AMMO3': '0.112', 'AMMO4': '0.117', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.480', 'WEAPON3': '0.800', 'weapon2': '0.836', 'HITCOUNT': '1.790', 'weapon3': '2.134', 'DAMAGECOUNT': '6.927', 'FRAGCOUNT': '20.000'} [2023-02-24 19:19:55,598][177154] DAMAGECOUNT value on done: 365721.0 [2023-02-24 19:19:55,599][177154] Sum rewards: 17.126, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.917', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon7': '0.058', 'AMMO3': '0.064', 'AMMO4': '0.073', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon5': '0.348', 'WEAPON3': '0.400', 'weapon2': '0.568', 'weapon4': '0.576', 'weapon3': '0.868', 'HITCOUNT': '1.190', 'DAMAGECOUNT': '4.506', 'FRAGCOUNT': '13.000'} [2023-02-24 19:19:55,689][177172] DAMAGECOUNT value on done: 362116.0 [2023-02-24 19:19:55,689][177172] Sum rewards: 18.393, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.602', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO3': '0.079', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.105', 'weapon5': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'weapon4': '0.590', 'weapon2': '0.760', 'HITCOUNT': '0.980', 'weapon3': '1.072', 'DAMAGECOUNT': '5.463', 'FRAGCOUNT': '15.000'} [2023-02-24 19:19:55,907][177154] DAMAGECOUNT value on done: 363451.0 [2023-02-24 19:19:55,908][177154] Sum rewards: 15.113, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.823', 'AMMO2': '0.002', 'AMMO4': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO3': '0.125', 'WEAPON5': '0.300', 'weapon2': '0.300', 'weapon5': '0.456', 'WEAPON3': '0.800', 'HITCOUNT': '1.000', 'weapon3': '2.588', 'DAMAGECOUNT': '3.810', 'FRAGCOUNT': '14.000'} [2023-02-24 19:19:55,987][177172] DAMAGECOUNT value on done: 356049.0 [2023-02-24 19:19:55,987][177172] Sum rewards: 17.677, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.310', 'AMMO5': '0.020', 'AMMO2': '0.027', 'AMMO4': '0.132', 'AMMO3': '0.139', 'WEAPON4': '0.300', 'weapon4': '0.310', 'weapon2': '0.510', 'WEAPON5': '0.550', 'weapon5': '0.656', 'WEAPON3': '0.800', 'HITCOUNT': '1.370', 'weapon3': '1.944', 'DAMAGECOUNT': '5.478', 'FRAGCOUNT': '18.000'} [2023-02-24 19:19:56,019][177157] DAMAGECOUNT value on done: 362426.0 [2023-02-24 19:19:56,019][177157] Sum rewards: 25.020, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.790', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'AMMO5': '0.025', 'WEAPON1': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.133', 'weapon4': '0.238', 'weapon5': '0.484', 'WEAPON5': '0.650', 'WEAPON3': '0.900', 'weapon2': '0.936', 'HITCOUNT': '1.240', 'weapon3': '1.736', 'DAMAGECOUNT': '5.853', 'FRAGCOUNT': '22.000'} [2023-02-24 19:19:56,233][177157] DAMAGECOUNT value on done: 349407.0 [2023-02-24 19:19:56,234][177157] Sum rewards: 25.798, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.019', 'ARMOR': '0.004', 'AMMO5': '0.034', 'AMMO2': '0.050', 'WEAPON1': '0.050', 'AMMO3': '0.122', 'AMMO4': '0.248', 'weapon2': '0.290', 'weapon5': '0.572', 'WEAPON4': '0.600', 'WEAPON3': '0.800', 'weapon4': '0.838', 'WEAPON5': '0.850', 'HITCOUNT': '1.620', 'weapon3': '1.728', 'DAMAGECOUNT': '7.260', 'FRAGCOUNT': '25.000'} [2023-02-24 19:19:56,326][177157] DAMAGECOUNT value on done: 347650.0 [2023-02-24 19:19:56,326][177157] Sum rewards: 21.821, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.927', 'AMMO2': '0.026', 'AMMO5': '0.027', 'AMMO4': '0.127', 'AMMO3': '0.150', 'weapon4': '0.186', 'WEAPON4': '0.250', 'weapon5': '0.510', 'weapon2': '0.648', 'WEAPON5': '0.700', 'WEAPON3': '0.950', 'HITCOUNT': '1.640', 'weapon3': '2.212', 'DAMAGECOUNT': '7.572', 'FRAGCOUNT': '20.000'} [2023-02-24 19:19:56,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13829.2). Total num frames: 97837056. Throughput: 0: 3459.3. Samples: 24456842. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:19:56,377][177119] Avg episode reward: [(0, '18.632')] [2023-02-24 19:19:56,435][177171] DAMAGECOUNT value on done: 348079.0 [2023-02-24 19:19:56,436][177171] Sum rewards: 19.854, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.176', 'AMMO2': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.058', 'AMMO3': '0.101', 'WEAPON5': '0.350', 'weapon5': '0.468', 'weapon2': '0.584', 'WEAPON3': '0.650', 'HITCOUNT': '1.210', 'weapon3': '2.242', 'DAMAGECOUNT': '5.070', 'FRAGCOUNT': '16.000'} [2023-02-24 19:19:56,447][177171] DAMAGECOUNT value on done: 350474.0 [2023-02-24 19:19:56,447][177171] Sum rewards: 18.210, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.450', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.035', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.138', 'weapon4': '0.230', 'WEAPON5': '0.250', 'weapon2': '0.424', 'weapon5': '0.426', 'WEAPON3': '0.950', 'HITCOUNT': '1.510', 'weapon3': '2.346', 'DAMAGECOUNT': '5.943', 'FRAGCOUNT': '17.000'} [2023-02-24 19:19:56,544][177157] DAMAGECOUNT value on done: 351441.0 [2023-02-24 19:19:56,545][177157] Sum rewards: 0.064, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.288', 'AMMO2': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.036', 'weapon7': '0.056', 'AMMO3': '0.058', 'weapon2': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.226', 'WEAPON5': '0.250', 'HITCOUNT': '0.260', 'WEAPON3': '0.350', 'FRAGCOUNT': '0.500', 'weapon4': '0.566', 'weapon3': '0.664', 'DAMAGECOUNT': '1.377'} [2023-02-24 19:19:56,746][177171] DAMAGECOUNT value on done: 350517.0 [2023-02-24 19:19:56,747][177171] Sum rewards: 19.418, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.100', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.300', 'weapon4': '0.386', 'weapon5': '0.460', 'WEAPON3': '0.600', 'weapon2': '0.614', 'HITCOUNT': '1.220', 'weapon3': '1.798', 'DAMAGECOUNT': '5.445', 'FRAGCOUNT': '14.000'} [2023-02-24 19:19:56,758][177171] DAMAGECOUNT value on done: 352992.0 [2023-02-24 19:19:56,758][177171] Sum rewards: 15.305, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.730', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.068', 'AMMO4': '0.088', 'WEAPON5': '0.200', 'weapon4': '0.220', 'weapon5': '0.440', 'WEAPON3': '0.500', 'weapon2': '0.792', 'HITCOUNT': '1.110', 'weapon3': '1.932', 'DAMAGECOUNT': '4.080', 'FRAGCOUNT': '11.000'} [2023-02-24 19:19:57,429][177153] Updated weights for policy 0, policy_version 23890 (0.0008) [2023-02-24 19:19:59,072][177155] DAMAGECOUNT value on done: 360859.0 [2023-02-24 19:19:59,072][177155] Sum rewards: 26.137, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.404', 'AMMO5': '0.020', 'AMMO2': '0.025', 'WEAPON1': '0.040', 'AMMO4': '0.125', 'AMMO3': '0.138', 'WEAPON4': '0.300', 'weapon4': '0.306', 'weapon5': '0.360', 'weapon2': '0.494', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'HITCOUNT': '1.720', 'weapon3': '2.396', 'DAMAGECOUNT': '7.167', 'FRAGCOUNT': '25.000'} [2023-02-24 19:19:59,376][177155] DAMAGECOUNT value on done: 366207.0 [2023-02-24 19:19:59,377][177155] Sum rewards: 20.976, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.018', 'AMMO2': '0.020', 'WEAPON1': '0.060', 'weapon4': '0.072', 'WEAPON4': '0.100', 'AMMO4': '0.100', 'HEALTH': '0.103', 'AMMO3': '0.110', 'weapon5': '0.364', 'WEAPON5': '0.450', 'weapon2': '0.602', 'WEAPON3': '0.700', 'HITCOUNT': '1.340', 'weapon3': '2.508', 'DAMAGECOUNT': '6.678', 'FRAGCOUNT': '16.000'} [2023-02-24 19:19:59,600][177155] DAMAGECOUNT value on done: 365059.0 [2023-02-24 19:19:59,600][177155] Sum rewards: 15.091, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.216', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.104', 'WEAPON4': '0.200', 'weapon5': '0.220', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'weapon4': '0.684', 'weapon2': '0.830', 'HITCOUNT': '0.900', 'weapon3': '1.648', 'DAMAGECOUNT': '4.815', 'FRAGCOUNT': '12.000'} [2023-02-24 19:19:59,897][177155] DAMAGECOUNT value on done: 346685.0 [2023-02-24 19:19:59,898][177155] Sum rewards: 15.881, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.262', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO3': '0.078', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'weapon5': '0.528', 'HITCOUNT': '0.910', 'weapon2': '0.912', 'weapon3': '1.676', 'DAMAGECOUNT': '4.614', 'FRAGCOUNT': '11.000'} [2023-02-24 19:20:00,401][177153] Updated weights for policy 0, policy_version 23900 (0.0008) [2023-02-24 19:20:01,107][177156] Large shaping reward 2.562 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.54, 180.0), ('weapon5', 0.002)] [2023-02-24 19:20:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13829.2). Total num frames: 97906688. Throughput: 0: 3460.5. Samples: 24477678. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:20:01,376][177119] Avg episode reward: [(0, '18.379')] [2023-02-24 19:20:03,322][177153] Updated weights for policy 0, policy_version 23910 (0.0008) [2023-02-24 19:20:06,024][177170] DAMAGECOUNT value on done: 353003.0 [2023-02-24 19:20:06,025][177170] Sum rewards: 18.054, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.335', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.028', 'AMMO3': '0.073', 'WEAPON5': '0.300', 'weapon5': '0.492', 'WEAPON3': '0.500', 'weapon2': '0.816', 'HITCOUNT': '0.960', 'weapon3': '2.234', 'DAMAGECOUNT': '4.455', 'FRAGCOUNT': '13.000'} [2023-02-24 19:20:06,289][177153] Updated weights for policy 0, policy_version 23920 (0.0008) [2023-02-24 19:20:06,327][177170] DAMAGECOUNT value on done: 354713.0 [2023-02-24 19:20:06,327][177170] Sum rewards: 26.629, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.159', 'AMMO2': '0.013', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.065', 'AMMO3': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.450', 'weapon4': '0.468', 'weapon5': '0.516', 'WEAPON3': '0.700', 'weapon2': '0.700', 'HITCOUNT': '1.300', 'weapon3': '1.816', 'DAMAGECOUNT': '6.171', 'FRAGCOUNT': '22.000'} [2023-02-24 19:20:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13829.2). Total num frames: 97976320. Throughput: 0: 3462.0. Samples: 24488094. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:20:06,376][177119] Avg episode reward: [(0, '18.485')] [2023-02-24 19:20:06,921][177170] DAMAGECOUNT value on done: 349398.0 [2023-02-24 19:20:06,921][177170] Sum rewards: 20.069, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.980', 'AMMO5': '0.011', 'AMMO2': '0.016', 'WEAPON1': '0.030', 'AMMO4': '0.081', 'AMMO3': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'weapon4': '0.368', 'weapon5': '0.416', 'WEAPON3': '0.600', 'weapon2': '0.776', 'HITCOUNT': '1.600', 'weapon3': '1.950', 'DAMAGECOUNT': '6.402', 'FRAGCOUNT': '15.000'} [2023-02-24 19:20:07,219][177170] DAMAGECOUNT value on done: 354393.0 [2023-02-24 19:20:07,220][177170] Sum rewards: 17.508, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.012', 'AMMO5': '0.013', 'HEALTH': '0.016', 'weapon4': '0.018', 'WEAPON4': '0.050', 'AMMO3': '0.058', 'AMMO4': '0.059', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'weapon2': '0.630', 'weapon5': '0.716', 'HITCOUNT': '0.940', 'weapon3': '1.704', 'DAMAGECOUNT': '4.392', 'FRAGCOUNT': '12.000'} [2023-02-24 19:20:08,444][177156] DAMAGECOUNT value on done: 356452.0 [2023-02-24 19:20:08,445][177156] Sum rewards: 16.764, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.548', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'weapon4': '0.024', 'AMMO3': '0.073', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'WEAPON3': '0.600', 'weapon2': '0.696', 'WEAPON5': '0.700', 'weapon5': '0.830', 'HITCOUNT': '0.860', 'weapon3': '1.750', 'DAMAGECOUNT': '4.791', 'FRAGCOUNT': '13.000'} [2023-02-24 19:20:08,561][177156] DAMAGECOUNT value on done: 347158.0 [2023-02-24 19:20:08,561][177156] Sum rewards: 9.611, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'HEALTH': '0.043', 'weapon7': '0.048', 'AMMO3': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.164', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.350', 'HITCOUNT': '0.680', 'weapon3': '1.016', 'weapon2': '1.456', 'DAMAGECOUNT': '3.114', 'FRAGCOUNT': '5.000'} [2023-02-24 19:20:08,662][177158] DAMAGECOUNT value on done: 341631.0 [2023-02-24 19:20:08,663][177158] Sum rewards: 21.523, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.790', 'AMMO2': '0.012', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'AMMO3': '0.060', 'AMMO4': '0.062', 'WEAPON4': '0.200', 'weapon4': '0.392', 'WEAPON3': '0.400', 'weapon5': '0.450', 'WEAPON5': '0.500', 'weapon2': '1.008', 'HITCOUNT': '1.120', 'weapon3': '1.368', 'DAMAGECOUNT': '5.181', 'FRAGCOUNT': '16.000'} [2023-02-24 19:20:08,748][177156] DAMAGECOUNT value on done: 364408.0 [2023-02-24 19:20:08,749][177156] Sum rewards: 17.372, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.040', 'AMMO5': '0.026', 'AMMO2': '0.040', 'WEAPON1': '0.070', 'AMMO3': '0.106', 'AMMO4': '0.198', 'WEAPON4': '0.350', 'weapon5': '0.452', 'WEAPON5': '0.550', 'weapon4': '0.578', 'WEAPON3': '0.650', 'weapon2': '0.848', 'HITCOUNT': '1.210', 'weapon3': '1.616', 'DAMAGECOUNT': '4.968', 'FRAGCOUNT': '15.000'} [2023-02-24 19:20:08,863][177156] DAMAGECOUNT value on done: 349111.0 [2023-02-24 19:20:08,863][177156] Sum rewards: 29.446, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.013', 'AMMO2': '0.030', 'WEAPON1': '0.030', 'AMMO3': '0.086', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'weapon5': '0.408', 'weapon4': '0.450', 'WEAPON3': '0.500', 'HEALTH': '0.754', 'weapon2': '0.790', 'HITCOUNT': '1.660', 'weapon3': '1.796', 'DAMAGECOUNT': '7.830', 'FRAGCOUNT': '22.000'} [2023-02-24 19:20:08,967][177158] DAMAGECOUNT value on done: 347239.0 [2023-02-24 19:20:08,968][177158] Sum rewards: 19.078, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.140', 'AMMO2': '0.007', 'AMMO5': '0.017', 'AMMO4': '0.033', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.079', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon4': '0.144', 'weapon5': '0.222', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'weapon2': '1.240', 'HITCOUNT': '1.250', 'weapon3': '1.888', 'DAMAGECOUNT': '4.848', 'FRAGCOUNT': '13.500'} [2023-02-24 19:20:09,255][177153] Updated weights for policy 0, policy_version 23930 (0.0008) [2023-02-24 19:20:09,267][177158] DAMAGECOUNT value on done: 355468.0 [2023-02-24 19:20:09,268][177158] Sum rewards: 9.409, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.175', 'AMMO5': '0.003', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO2': '0.037', 'weapon7': '0.048', 'AMMO3': '0.051', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.126', 'AMMO4': '0.184', 'weapon2': '0.218', 'WEAPON3': '0.350', 'WEAPON4': '0.400', 'weapon3': '0.748', 'HITCOUNT': '0.800', 'weapon4': '0.866', 'DAMAGECOUNT': '3.330', 'FRAGCOUNT': '9.000'} [2023-02-24 19:20:09,559][177158] DAMAGECOUNT value on done: 356906.0 [2023-02-24 19:20:09,559][177158] Sum rewards: 15.309, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.042', 'AMMO2': '0.025', 'AMMO5': '0.028', 'WEAPON1': '0.030', 'AMMO4': '0.127', 'AMMO3': '0.133', 'weapon4': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.396', 'weapon5': '0.644', 'WEAPON5': '0.750', 'WEAPON3': '0.850', 'HITCOUNT': '1.080', 'weapon3': '2.154', 'DAMAGECOUNT': '4.848', 'FRAGCOUNT': '14.000'} [2023-02-24 19:20:11,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13829.2). Total num frames: 98045952. Throughput: 0: 3462.9. Samples: 24508940. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:20:11,376][177119] Avg episode reward: [(0, '18.378')] [2023-02-24 19:20:12,195][177153] Updated weights for policy 0, policy_version 23940 (0.0008) [2023-02-24 19:20:13,214][177172] DAMAGECOUNT value on done: 351967.0 [2023-02-24 19:20:13,214][177172] Sum rewards: 19.225, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.626', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO4': '0.046', 'AMMO3': '0.113', 'WEAPON4': '0.300', 'weapon5': '0.318', 'WEAPON5': '0.350', 'weapon4': '0.462', 'WEAPON3': '0.700', 'weapon2': '1.118', 'HITCOUNT': '1.290', 'weapon3': '1.476', 'DAMAGECOUNT': '6.144', 'FRAGCOUNT': '19.000'} [2023-02-24 19:20:13,506][177172] DAMAGECOUNT value on done: 351472.0 [2023-02-24 19:20:13,507][177172] Sum rewards: 12.540, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.652', 'AMMO5': '0.012', 'AMMO2': '0.014', 'WEAPON1': '0.040', 'weapon4': '0.064', 'AMMO4': '0.069', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.400', 'weapon5': '0.580', 'WEAPON3': '0.600', 'HITCOUNT': '0.910', 'weapon2': '0.998', 'weapon3': '1.752', 'DAMAGECOUNT': '3.555', 'FRAGCOUNT': '10.000'} [2023-02-24 19:20:14,437][177154] DAMAGECOUNT value on done: 355036.0 [2023-02-24 19:20:14,437][177154] Sum rewards: 16.866, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.200', 'AMMO2': '0.008', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'weapon4': '0.030', 'AMMO4': '0.037', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'WEAPON5': '0.300', 'weapon5': '0.430', 'WEAPON3': '0.750', 'weapon2': '0.770', 'HITCOUNT': '1.280', 'weapon3': '1.930', 'DAMAGECOUNT': '5.781', 'FRAGCOUNT': '14.000'} [2023-02-24 19:20:14,738][177154] DAMAGECOUNT value on done: 364723.0 [2023-02-24 19:20:14,739][177154] Sum rewards: 17.062, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.850', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'weapon4': '0.018', 'AMMO5': '0.023', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.156', 'weapon5': '0.392', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'weapon2': '1.024', 'HITCOUNT': '1.060', 'weapon3': '2.000', 'DAMAGECOUNT': '4.647', 'FRAGCOUNT': '15.500'} [2023-02-24 19:20:14,966][177172] DAMAGECOUNT value on done: 362365.0 [2023-02-24 19:20:14,967][177172] Sum rewards: 2.216, reward structure: {'DEATHCOUNT': '-0.750', 'HEALTH': '-0.070', 'AMMO2': '0.000', 'AMMO4': '0.001', 'weapon3': '0.006', 'AMMO3': '0.020', 'weapon7': '0.048', 'WEAPON3': '0.050', 'weapon2': '0.074', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.430', 'DAMAGECOUNT': '0.747', 'FRAGCOUNT': '1.000'} [2023-02-24 19:20:15,042][177154] DAMAGECOUNT value on done: 367286.0 [2023-02-24 19:20:15,043][177154] Sum rewards: 11.553, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.479', 'AMMO5': '0.018', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'AMMO4': '0.103', 'AMMO3': '0.117', 'WEAPON4': '0.200', 'weapon4': '0.330', 'WEAPON5': '0.500', 'weapon5': '0.522', 'weapon2': '0.610', 'WEAPON3': '0.750', 'HITCOUNT': '0.980', 'weapon3': '1.906', 'DAMAGECOUNT': '4.695', 'FRAGCOUNT': '10.500'} [2023-02-24 19:20:15,152][177153] Updated weights for policy 0, policy_version 23950 (0.0008) [2023-02-24 19:20:15,270][177172] DAMAGECOUNT value on done: 357089.0 [2023-02-24 19:20:15,270][177172] Sum rewards: 13.847, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.250', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.041', 'AMMO3': '0.046', 'weapon7': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.234', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'weapon4': '0.578', 'HITCOUNT': '0.750', 'weapon3': '1.156', 'weapon2': '1.436', 'DAMAGECOUNT': '3.120', 'FRAGCOUNT': '10.000'} [2023-02-24 19:20:15,333][177154] DAMAGECOUNT value on done: 365420.0 [2023-02-24 19:20:15,334][177154] Sum rewards: 25.123, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.059', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.046', 'AMMO3': '0.093', 'WEAPON4': '0.200', 'weapon2': '0.288', 'weapon5': '0.460', 'WEAPON5': '0.500', 'weapon4': '0.562', 'WEAPON3': '0.650', 'HITCOUNT': '1.350', 'weapon3': '2.066', 'DAMAGECOUNT': '5.907', 'FRAGCOUNT': '20.000'} [2023-02-24 19:20:15,433][177157] DAMAGECOUNT value on done: 364464.0 [2023-02-24 19:20:15,433][177157] Sum rewards: 22.751, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.042', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.088', 'AMMO4': '0.110', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.440', 'WEAPON3': '0.550', 'weapon5': '0.558', 'weapon4': '0.638', 'HITCOUNT': '1.520', 'weapon3': '1.872', 'DAMAGECOUNT': '6.114', 'FRAGCOUNT': '17.000'} [2023-02-24 19:20:15,644][177157] DAMAGECOUNT value on done: 351406.0 [2023-02-24 19:20:15,644][177157] Sum rewards: 24.493, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.496', 'AMMO2': '0.010', 'AMMO5': '0.019', 'AMMO4': '0.049', 'weapon7': '0.052', 'AMMO3': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.196', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.500', 'WEAPON5': '0.500', 'weapon5': '0.582', 'HITCOUNT': '1.080', 'weapon2': '1.378', 'weapon3': '1.412', 'DAMAGECOUNT': '5.997', 'FRAGCOUNT': '20.000'} [2023-02-24 19:20:15,744][177157] DAMAGECOUNT value on done: 350112.0 [2023-02-24 19:20:15,744][177157] Sum rewards: 23.059, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.123', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO5': '0.017', 'AMMO3': '0.095', 'weapon5': '0.446', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'weapon2': '1.006', 'HITCOUNT': '1.480', 'weapon3': '1.936', 'DAMAGECOUNT': '6.984', 'FRAGCOUNT': '17.000'} [2023-02-24 19:20:15,851][177171] DAMAGECOUNT value on done: 351367.0 [2023-02-24 19:20:15,852][177171] Sum rewards: 25.386, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.004', 'AMMO5': '0.008', 'AMMO2': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.061', 'AMMO3': '0.098', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon7': '0.210', 'weapon5': '0.214', 'weapon4': '0.232', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'weapon2': '0.596', 'WEAPON3': '0.650', 'HITCOUNT': '1.230', 'weapon3': '2.094', 'DAMAGECOUNT': '7.164', 'FRAGCOUNT': '20.000'} [2023-02-24 19:20:15,864][177171] DAMAGECOUNT value on done: 352685.0 [2023-02-24 19:20:15,865][177171] Sum rewards: 23.678, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.904', 'AMMO2': '0.008', 'AMMO5': '0.012', 'AMMO4': '0.037', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'WEAPON5': '0.300', 'weapon5': '0.354', 'WEAPON3': '0.750', 'weapon2': '0.934', 'HITCOUNT': '1.560', 'weapon3': '2.188', 'DAMAGECOUNT': '6.633', 'FRAGCOUNT': '19.000'} [2023-02-24 19:20:15,952][177157] DAMAGECOUNT value on done: 353733.0 [2023-02-24 19:20:15,952][177157] Sum rewards: 26.897, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.660', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.029', 'weapon4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.144', 'WEAPON5': '0.450', 'weapon5': '0.620', 'WEAPON3': '0.650', 'weapon2': '0.708', 'HITCOUNT': '1.360', 'weapon3': '2.172', 'DAMAGECOUNT': '6.867', 'FRAGCOUNT': '21.000'} [2023-02-24 19:20:16,168][177171] DAMAGECOUNT value on done: 351753.0 [2023-02-24 19:20:16,168][177171] Sum rewards: 14.950, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.022', 'AMMO2': '0.040', 'weapon7': '0.052', 'HEALTH': '0.071', 'AMMO3': '0.088', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.199', 'WEAPON5': '0.400', 'weapon4': '0.404', 'weapon5': '0.480', 'WEAPON3': '0.500', 'HITCOUNT': '0.750', 'weapon2': '1.064', 'weapon3': '1.472', 'DAMAGECOUNT': '3.708', 'FRAGCOUNT': '12.000'} [2023-02-24 19:20:16,179][177171] DAMAGECOUNT value on done: 354081.0 [2023-02-24 19:20:16,179][177171] Sum rewards: 10.508, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.140', 'AMMO5': '0.010', 'weapon7': '0.024', 'AMMO2': '0.027', 'weapon4': '0.052', 'AMMO3': '0.067', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.304', 'WEAPON3': '0.400', 'HITCOUNT': '0.710', 'weapon2': '1.020', 'weapon3': '2.012', 'DAMAGECOUNT': '3.267', 'FRAGCOUNT': '7.000'} [2023-02-24 19:20:16,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13858.2, 300 sec: 13829.2). Total num frames: 98115584. Throughput: 0: 3464.0. Samples: 24529634. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:20:16,376][177119] Avg episode reward: [(0, '18.427')] [2023-02-24 19:20:18,115][177153] Updated weights for policy 0, policy_version 23960 (0.0009) [2023-02-24 19:20:18,460][177155] DAMAGECOUNT value on done: 362379.0 [2023-02-24 19:20:18,461][177155] Sum rewards: 14.801, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.170', 'AMMO5': '0.018', 'AMMO2': '0.019', 'weapon4': '0.030', 'WEAPON1': '0.040', 'AMMO3': '0.095', 'AMMO4': '0.097', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'weapon2': '0.792', 'HITCOUNT': '1.090', 'weapon3': '2.180', 'DAMAGECOUNT': '4.560', 'FRAGCOUNT': '13.000'} [2023-02-24 19:20:18,764][177155] DAMAGECOUNT value on done: 368066.0 [2023-02-24 19:20:18,764][177155] Sum rewards: 19.767, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.390', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.030', 'AMMO3': '0.116', 'AMMO4': '0.148', 'weapon4': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.500', 'weapon5': '0.532', 'WEAPON3': '0.600', 'weapon2': '1.196', 'HITCOUNT': '1.440', 'weapon3': '1.602', 'DAMAGECOUNT': '5.559', 'FRAGCOUNT': '17.000'} [2023-02-24 19:20:18,972][177155] DAMAGECOUNT value on done: 366913.0 [2023-02-24 19:20:18,973][177155] Sum rewards: 23.956, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.266', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO3': '0.050', 'AMMO4': '0.162', 'WEAPON3': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.506', 'weapon5': '0.530', 'weapon3': '1.196', 'weapon4': '1.316', 'HITCOUNT': '1.430', 'DAMAGECOUNT': '5.562', 'FRAGCOUNT': '19.000'} [2023-02-24 19:20:19,267][177155] DAMAGECOUNT value on done: 347816.0 [2023-02-24 19:20:19,268][177155] Sum rewards: 12.403, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.540', 'AMMO5': '0.007', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.063', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.384', 'weapon5': '0.386', 'WEAPON3': '0.400', 'HITCOUNT': '0.720', 'weapon2': '0.918', 'weapon3': '1.234', 'DAMAGECOUNT': '3.393', 'FRAGCOUNT': '9.000'} [2023-02-24 19:20:21,035][177153] Updated weights for policy 0, policy_version 23970 (0.0008) [2023-02-24 19:20:21,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 98185216. Throughput: 0: 3464.5. Samples: 24540100. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:20:21,376][177119] Avg episode reward: [(0, '18.425')] [2023-02-24 19:20:23,972][177153] Updated weights for policy 0, policy_version 23980 (0.0008) [2023-02-24 19:20:25,414][177170] DAMAGECOUNT value on done: 354803.0 [2023-02-24 19:20:25,414][177170] Sum rewards: 19.652, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.752', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.104', 'weapon4': '0.140', 'weapon5': '0.332', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'weapon2': '0.722', 'HITCOUNT': '1.290', 'weapon3': '2.424', 'DAMAGECOUNT': '5.400', 'FRAGCOUNT': '17.000'} [2023-02-24 19:20:25,703][177170] DAMAGECOUNT value on done: 356492.0 [2023-02-24 19:20:25,703][177170] Sum rewards: 24.199, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.558', 'AMMO5': '0.018', 'AMMO2': '0.019', 'WEAPON1': '0.040', 'weapon7': '0.052', 'AMMO4': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.126', 'weapon5': '0.142', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.457', 'weapon4': '0.508', 'WEAPON3': '0.800', 'weapon2': '0.894', 'HITCOUNT': '1.480', 'weapon3': '1.998', 'DAMAGECOUNT': '5.337', 'FRAGCOUNT': '21.000'} [2023-02-24 19:20:26,309][177170] DAMAGECOUNT value on done: 351186.0 [2023-02-24 19:20:26,310][177170] Sum rewards: 18.859, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.167', 'AMMO2': '0.008', 'AMMO5': '0.016', 'AMMO4': '0.040', 'WEAPON1': '0.050', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.126', 'weapon4': '0.144', 'weapon2': '0.370', 'WEAPON5': '0.450', 'weapon5': '0.488', 'WEAPON3': '0.750', 'HITCOUNT': '1.390', 'weapon3': '2.356', 'DAMAGECOUNT': '5.364', 'FRAGCOUNT': '16.000'} [2023-02-24 19:20:26,376][177119] Fps is (10 sec: 13926.2, 60 sec: 13926.4, 300 sec: 13843.1). Total num frames: 98254848. Throughput: 0: 3465.7. Samples: 24560904. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:20:26,376][177119] Avg episode reward: [(0, '18.620')] [2023-02-24 19:20:26,603][177170] DAMAGECOUNT value on done: 356873.0 [2023-02-24 19:20:26,604][177170] Sum rewards: 22.302, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.841', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.038', 'WEAPON1': '0.040', 'AMMO3': '0.131', 'AMMO4': '0.189', 'WEAPON4': '0.350', 'weapon4': '0.400', 'weapon2': '0.406', 'weapon5': '0.416', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'HITCOUNT': '1.790', 'weapon3': '2.272', 'DAMAGECOUNT': '7.440', 'FRAGCOUNT': '19.000'} [2023-02-24 19:20:26,944][177153] Updated weights for policy 0, policy_version 23990 (0.0008) [2023-02-24 19:20:27,769][177156] DAMAGECOUNT value on done: 357849.0 [2023-02-24 19:20:27,770][177156] Sum rewards: 10.862, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.255', 'AMMO2': '0.012', 'AMMO5': '0.028', 'AMMO4': '0.059', 'AMMO3': '0.087', 'WEAPON4': '0.300', 'weapon4': '0.406', 'weapon2': '0.618', 'WEAPON3': '0.650', 'weapon5': '0.718', 'WEAPON5': '0.750', 'HITCOUNT': '0.980', 'weapon3': '1.818', 'DAMAGECOUNT': '4.191', 'FRAGCOUNT': '10.000'} [2023-02-24 19:20:27,904][177156] DAMAGECOUNT value on done: 348684.0 [2023-02-24 19:20:27,904][177156] Sum rewards: 16.283, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.430', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'weapon7': '0.052', 'AMMO4': '0.060', 'AMMO3': '0.075', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.342', 'weapon4': '0.444', 'WEAPON3': '0.500', 'HITCOUNT': '1.090', 'weapon2': '1.096', 'weapon3': '1.640', 'DAMAGECOUNT': '4.578', 'FRAGCOUNT': '12.000'} [2023-02-24 19:20:28,051][177158] DAMAGECOUNT value on done: 343655.0 [2023-02-24 19:20:28,051][177158] Sum rewards: 21.453, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.035', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'AMMO4': '0.104', 'weapon2': '0.352', 'WEAPON5': '0.500', 'weapon4': '0.540', 'weapon5': '0.564', 'WEAPON3': '0.700', 'HITCOUNT': '1.310', 'weapon3': '1.838', 'DAMAGECOUNT': '6.072', 'FRAGCOUNT': '17.000'} [2023-02-24 19:20:28,089][177156] DAMAGECOUNT value on done: 365988.0 [2023-02-24 19:20:28,089][177156] Sum rewards: 17.196, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.736', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon7': '0.048', 'AMMO3': '0.105', 'AMMO4': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.194', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.406', 'WEAPON3': '0.700', 'weapon2': '0.974', 'HITCOUNT': '1.150', 'weapon3': '1.812', 'DAMAGECOUNT': '4.740', 'FRAGCOUNT': '16.000'} [2023-02-24 19:20:28,210][177156] DAMAGECOUNT value on done: 351439.0 [2023-02-24 19:20:28,211][177156] Sum rewards: 23.612, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.966', 'AMMO2': '0.008', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.039', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon2': '0.338', 'WEAPON5': '0.500', 'weapon5': '0.648', 'WEAPON3': '0.700', 'HITCOUNT': '1.410', 'weapon3': '2.382', 'DAMAGECOUNT': '6.984', 'FRAGCOUNT': '18.000'} [2023-02-24 19:20:28,356][177158] DAMAGECOUNT value on done: 349885.0 [2023-02-24 19:20:28,356][177158] Sum rewards: 27.938, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.936', 'ARMOR': '0.004', 'AMMO2': '0.014', 'AMMO5': '0.019', 'WEAPON1': '0.040', 'AMMO4': '0.071', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'weapon4': '0.182', 'weapon5': '0.268', 'WEAPON5': '0.400', 'weapon2': '0.720', 'WEAPON3': '1.000', 'HITCOUNT': '1.640', 'weapon3': '2.204', 'DAMAGECOUNT': '7.938', 'FRAGCOUNT': '25.000'} [2023-02-24 19:20:28,659][177158] DAMAGECOUNT value on done: 356709.0 [2023-02-24 19:20:28,660][177158] Sum rewards: 14.949, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.610', 'AMMO2': '0.011', 'AMMO5': '0.015', 'AMMO4': '0.054', 'WEAPON1': '0.090', 'AMMO3': '0.091', 'weapon5': '0.316', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'HITCOUNT': '0.970', 'weapon2': '0.998', 'weapon3': '2.340', 'DAMAGECOUNT': '3.723', 'FRAGCOUNT': '12.000'} [2023-02-24 19:20:28,955][177158] DAMAGECOUNT value on done: 359892.0 [2023-02-24 19:20:28,956][177158] Sum rewards: 26.128, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.258', 'AMMO5': '0.021', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'weapon7': '0.050', 'AMMO4': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.155', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.266', 'WEAPON5': '0.450', 'weapon5': '0.514', 'weapon2': '0.676', 'WEAPON3': '0.900', 'HITCOUNT': '1.720', 'weapon3': '2.072', 'DAMAGECOUNT': '8.958', 'FRAGCOUNT': '21.000'} [2023-02-24 19:20:29,902][177153] Updated weights for policy 0, policy_version 24000 (0.0008) [2023-02-24 19:20:31,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13843.1). Total num frames: 98324480. Throughput: 0: 3464.1. Samples: 24581694. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:20:31,376][177119] Avg episode reward: [(0, '18.963')] [2023-02-24 19:20:32,545][177172] DAMAGECOUNT value on done: 353752.0 [2023-02-24 19:20:32,546][177172] Sum rewards: 19.295, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.384', 'AMMO5': '0.019', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'weapon7': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.145', 'weapon5': '0.236', 'WEAPON4': '0.250', 'weapon4': '0.378', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.538', 'WEAPON3': '0.900', 'HITCOUNT': '1.280', 'weapon3': '1.940', 'DAMAGECOUNT': '5.355', 'FRAGCOUNT': '18.000'} [2023-02-24 19:20:32,840][177172] DAMAGECOUNT value on done: 352715.0 [2023-02-24 19:20:32,840][177172] Sum rewards: 5.969, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.082', 'WEAPON1': '0.020', 'AMMO5': '0.026', 'AMMO2': '0.056', 'AMMO3': '0.140', 'AMMO4': '0.281', 'ARMOR': '0.400', 'weapon5': '0.532', 'weapon4': '0.598', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '0.700', 'HITCOUNT': '0.740', 'weapon3': '1.134', 'weapon2': '1.194', 'DAMAGECOUNT': '3.729', 'FRAGCOUNT': '10.000'} [2023-02-24 19:20:32,856][177153] Updated weights for policy 0, policy_version 24010 (0.0008) [2023-02-24 19:20:33,828][177154] DAMAGECOUNT value on done: 356401.0 [2023-02-24 19:20:33,829][177154] Sum rewards: 13.977, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.542', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'weapon7': '0.042', 'AMMO3': '0.051', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.170', 'WEAPON3': '0.250', 'WEAPON4': '0.300', 'weapon5': '0.308', 'WEAPON5': '0.350', 'ARMOR': '0.404', 'weapon4': '0.602', 'HITCOUNT': '0.650', 'weapon2': '0.910', 'weapon3': '1.020', 'DAMAGECOUNT': '4.095', 'FRAGCOUNT': '9.500'} [2023-02-24 19:20:34,128][177154] DAMAGECOUNT value on done: 366581.0 [2023-02-24 19:20:34,129][177154] Sum rewards: 17.810, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.387', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon7': '0.050', 'AMMO3': '0.061', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.174', 'weapon5': '0.212', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.512', 'weapon2': '0.736', 'HITCOUNT': '1.380', 'weapon3': '1.602', 'DAMAGECOUNT': '5.574', 'FRAGCOUNT': '14.000'} [2023-02-24 19:20:34,327][177172] DAMAGECOUNT value on done: 364534.0 [2023-02-24 19:20:34,328][177172] Sum rewards: 26.435, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.012', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.102', 'AMMO3': '0.105', 'WEAPON4': '0.150', 'weapon4': '0.252', 'WEAPON5': '0.350', 'weapon5': '0.414', 'WEAPON3': '0.600', 'HEALTH': '0.640', 'weapon2': '0.950', 'HITCOUNT': '1.820', 'weapon3': '1.982', 'DAMAGECOUNT': '6.507', 'FRAGCOUNT': '20.000'} [2023-02-24 19:20:34,427][177154] DAMAGECOUNT value on done: 369611.0 [2023-02-24 19:20:34,428][177154] Sum rewards: 21.015, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.168', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO5': '0.026', 'AMMO4': '0.072', 'AMMO3': '0.126', 'weapon4': '0.164', 'WEAPON4': '0.200', 'weapon2': '0.244', 'WEAPON5': '0.650', 'weapon5': '0.656', 'WEAPON3': '0.850', 'HITCOUNT': '1.520', 'weapon3': '2.416', 'DAMAGECOUNT': '6.975', 'FRAGCOUNT': '18.000'} [2023-02-24 19:20:34,629][177172] DAMAGECOUNT value on done: 359038.0 [2023-02-24 19:20:34,629][177172] Sum rewards: 23.560, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.488', 'AMMO5': '0.015', 'AMMO2': '0.020', 'WEAPON1': '0.040', 'AMMO3': '0.082', 'AMMO4': '0.098', 'WEAPON4': '0.250', 'weapon4': '0.342', 'WEAPON5': '0.450', 'weapon5': '0.472', 'WEAPON3': '0.600', 'weapon2': '1.006', 'HITCOUNT': '1.280', 'weapon3': '1.796', 'DAMAGECOUNT': '5.847', 'FRAGCOUNT': '19.500'} [2023-02-24 19:20:34,724][177154] DAMAGECOUNT value on done: 367049.0 [2023-02-24 19:20:34,724][177154] Sum rewards: 21.927, reward structure: {'DEATHCOUNT': '-7.500', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO5': '0.023', 'weapon4': '0.032', 'WEAPON4': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.107', 'HEALTH': '0.274', 'weapon5': '0.456', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon2': '0.874', 'HITCOUNT': '1.190', 'weapon3': '2.338', 'DAMAGECOUNT': '4.887', 'FRAGCOUNT': '18.000'} [2023-02-24 19:20:34,787][177157] DAMAGECOUNT value on done: 367085.0 [2023-02-24 19:20:34,787][177157] Sum rewards: 34.818, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'weapon7': '0.018', 'AMMO2': '0.032', 'AMMO3': '0.064', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HEALTH': '0.270', 'weapon4': '0.314', 'weapon5': '0.356', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'weapon2': '1.070', 'weapon3': '1.436', 'HITCOUNT': '1.530', 'DAMAGECOUNT': '7.863', 'FRAGCOUNT': '26.000'} [2023-02-24 19:20:35,008][177157] DAMAGECOUNT value on done: 352884.0 [2023-02-24 19:20:35,009][177157] Sum rewards: 16.458, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.992', 'ARMOR': '0.004', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'weapon7': '0.054', 'AMMO3': '0.075', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.160', 'weapon5': '0.220', 'weapon2': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.800', 'HITCOUNT': '1.200', 'weapon3': '1.372', 'DAMAGECOUNT': '4.434', 'FRAGCOUNT': '14.000'} [2023-02-24 19:20:35,097][177157] DAMAGECOUNT value on done: 352188.0 [2023-02-24 19:20:35,098][177157] Sum rewards: 18.684, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.835', 'AMMO2': '0.015', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.074', 'AMMO3': '0.105', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'weapon5': '0.550', 'weapon2': '0.650', 'WEAPON3': '0.750', 'weapon4': '0.750', 'HITCOUNT': '1.450', 'weapon3': '1.512', 'DAMAGECOUNT': '6.228', 'FRAGCOUNT': '15.500'} [2023-02-24 19:20:35,309][177171] DAMAGECOUNT value on done: 353569.0 [2023-02-24 19:20:35,309][177171] Sum rewards: 22.621, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.926', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.043', 'AMMO3': '0.132', 'AMMO4': '0.216', 'weapon5': '0.310', 'WEAPON4': '0.350', 'weapon4': '0.376', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon2': '0.828', 'HITCOUNT': '1.300', 'weapon3': '1.856', 'DAMAGECOUNT': '6.606', 'FRAGCOUNT': '20.000'} [2023-02-24 19:20:35,319][177157] DAMAGECOUNT value on done: 355151.0 [2023-02-24 19:20:35,319][177157] Sum rewards: 17.166, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.224', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.032', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.222', 'weapon5': '0.296', 'WEAPON3': '0.500', 'weapon2': '1.072', 'HITCOUNT': '1.100', 'weapon3': '2.020', 'DAMAGECOUNT': '4.254', 'FRAGCOUNT': '12.000'} [2023-02-24 19:20:35,321][177171] DAMAGECOUNT value on done: 355364.0 [2023-02-24 19:20:35,321][177171] Sum rewards: 24.237, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.387', 'ARMOR': '0.004', 'AMMO2': '0.020', 'AMMO5': '0.024', 'WEAPON1': '0.040', 'weapon7': '0.048', 'AMMO4': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.169', 'WEAPON7': '0.200', 'weapon5': '0.266', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'weapon2': '0.606', 'weapon4': '0.754', 'WEAPON3': '1.050', 'weapon3': '1.800', 'HITCOUNT': '1.860', 'DAMAGECOUNT': '7.992', 'FRAGCOUNT': '21.000'} [2023-02-24 19:20:35,613][177171] DAMAGECOUNT value on done: 353699.0 [2023-02-24 19:20:35,614][177171] Sum rewards: 20.320, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.220', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon4': '0.030', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'AMMO4': '0.115', 'weapon5': '0.390', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'weapon2': '1.358', 'HITCOUNT': '1.360', 'weapon3': '1.844', 'DAMAGECOUNT': '5.838', 'FRAGCOUNT': '16.000'} [2023-02-24 19:20:35,624][177171] DAMAGECOUNT value on done: 356006.0 [2023-02-24 19:20:35,624][177171] Sum rewards: 22.289, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.092', 'AMMO4': '0.099', 'WEAPON5': '0.200', 'weapon4': '0.202', 'HEALTH': '0.222', 'weapon5': '0.272', 'WEAPON3': '0.600', 'weapon2': '1.056', 'HITCOUNT': '1.450', 'weapon3': '1.984', 'DAMAGECOUNT': '5.775', 'FRAGCOUNT': '17.000'} [2023-02-24 19:20:35,816][177153] Updated weights for policy 0, policy_version 24020 (0.0008) [2023-02-24 19:20:36,376][177119] Fps is (10 sec: 13517.0, 60 sec: 13858.1, 300 sec: 13829.2). Total num frames: 98390016. Throughput: 0: 3466.7. Samples: 24592096. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 19:20:36,376][177119] Avg episode reward: [(0, '18.895')] [2023-02-24 19:20:37,844][177155] DAMAGECOUNT value on done: 365175.0 [2023-02-24 19:20:37,845][177155] Sum rewards: 27.582, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.680', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.108', 'AMMO4': '0.159', 'WEAPON5': '0.300', 'weapon5': '0.320', 'WEAPON4': '0.350', 'weapon4': '0.530', 'WEAPON3': '0.750', 'weapon2': '1.270', 'weapon3': '1.566', 'HITCOUNT': '2.130', 'DAMAGECOUNT': '8.388', 'FRAGCOUNT': '23.500'} [2023-02-24 19:20:38,143][177155] DAMAGECOUNT value on done: 370051.0 [2023-02-24 19:20:38,144][177155] Sum rewards: 19.575, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.630', 'ARMOR': '0.004', 'AMMO2': '0.019', 'AMMO5': '0.019', 'WEAPON1': '0.060', 'AMMO4': '0.096', 'AMMO3': '0.141', 'weapon4': '0.252', 'WEAPON4': '0.300', 'weapon5': '0.362', 'WEAPON5': '0.500', 'weapon2': '0.504', 'WEAPON3': '0.950', 'HITCOUNT': '1.390', 'weapon3': '2.402', 'DAMAGECOUNT': '5.955', 'FRAGCOUNT': '19.000'} [2023-02-24 19:20:38,355][177155] DAMAGECOUNT value on done: 367952.0 [2023-02-24 19:20:38,356][177155] Sum rewards: 7.513, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.091', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO4': '0.035', 'AMMO3': '0.092', 'WEAPON4': '0.250', 'weapon4': '0.386', 'WEAPON5': '0.500', 'weapon5': '0.504', 'weapon2': '0.584', 'WEAPON3': '0.650', 'HITCOUNT': '0.850', 'weapon3': '1.838', 'DAMAGECOUNT': '3.117', 'FRAGCOUNT': '6.500'} [2023-02-24 19:20:38,665][177155] DAMAGECOUNT value on done: 349772.0 [2023-02-24 19:20:38,665][177155] Sum rewards: 21.442, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.085', 'AMMO2': '0.010', 'AMMO5': '0.014', 'AMMO4': '0.048', 'AMMO3': '0.090', 'WEAPON4': '0.150', 'weapon4': '0.254', 'weapon5': '0.388', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.990', 'weapon2': '1.106', 'weapon3': '1.708', 'DAMAGECOUNT': '5.868', 'FRAGCOUNT': '16.000'} [2023-02-24 19:20:38,791][177153] Updated weights for policy 0, policy_version 24030 (0.0008) [2023-02-24 19:20:41,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13858.1, 300 sec: 13829.2). Total num frames: 98459648. Throughput: 0: 3468.6. Samples: 24612928. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 19:20:41,376][177119] Avg episode reward: [(0, '18.970')] [2023-02-24 19:20:41,754][177153] Updated weights for policy 0, policy_version 24040 (0.0008) [2023-02-24 19:20:44,715][177153] Updated weights for policy 0, policy_version 24050 (0.0008) [2023-02-24 19:20:44,830][177170] DAMAGECOUNT value on done: 357507.0 [2023-02-24 19:20:44,831][177170] Sum rewards: 25.841, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.105', 'WEAPON1': '0.010', 'AMMO5': '0.026', 'AMMO2': '0.039', 'AMMO3': '0.153', 'AMMO4': '0.192', 'weapon4': '0.268', 'WEAPON4': '0.350', 'weapon2': '0.418', 'weapon5': '0.452', 'WEAPON5': '0.650', 'WEAPON3': '0.950', 'HITCOUNT': '1.910', 'weapon3': '2.416', 'DAMAGECOUNT': '8.112', 'FRAGCOUNT': '22.500'} [2023-02-24 19:20:45,132][177170] DAMAGECOUNT value on done: 358594.0 [2023-02-24 19:20:45,133][177170] Sum rewards: 25.634, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.919', 'ARMOR': '0.004', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO4': '0.024', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'weapon4': '0.338', 'WEAPON5': '0.500', 'weapon5': '0.608', 'WEAPON3': '0.700', 'weapon2': '0.744', 'HITCOUNT': '1.340', 'weapon3': '1.696', 'DAMAGECOUNT': '6.306', 'FRAGCOUNT': '20.000'} [2023-02-24 19:20:45,732][177170] DAMAGECOUNT value on done: 353076.0 [2023-02-24 19:20:45,732][177170] Sum rewards: 18.241, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.714', 'AMMO5': '0.026', 'AMMO2': '0.038', 'weapon7': '0.066', 'AMMO3': '0.134', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO4': '0.190', 'WEAPON7': '0.200', 'weapon4': '0.242', 'WEAPON4': '0.300', 'weapon5': '0.482', 'WEAPON5': '0.700', 'WEAPON3': '0.850', 'weapon2': '0.996', 'HITCOUNT': '1.050', 'weapon3': '1.690', 'DAMAGECOUNT': '5.670', 'FRAGCOUNT': '16.000'} [2023-02-24 19:20:46,038][177170] DAMAGECOUNT value on done: 359105.0 [2023-02-24 19:20:46,038][177170] Sum rewards: 25.304, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.492', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO2': '0.025', 'AMMO3': '0.071', 'AMMO4': '0.124', 'WEAPON4': '0.300', 'weapon5': '0.356', 'WEAPON3': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.508', 'weapon4': '0.742', 'HITCOUNT': '1.660', 'weapon3': '1.872', 'DAMAGECOUNT': '6.696', 'FRAGCOUNT': '20.000'} [2023-02-24 19:20:46,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13858.2, 300 sec: 13829.2). Total num frames: 98529280. Throughput: 0: 3464.3. Samples: 24633572. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 19:20:46,376][177119] Avg episode reward: [(0, '19.212')] [2023-02-24 19:20:47,182][177156] DAMAGECOUNT value on done: 360407.0 [2023-02-24 19:20:47,183][177156] Sum rewards: 32.029, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.972', 'ARMOR': '0.004', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.108', 'AMMO4': '0.123', 'WEAPON4': '0.350', 'weapon5': '0.408', 'WEAPON5': '0.450', 'weapon2': '0.594', 'WEAPON3': '0.700', 'weapon4': '0.816', 'HITCOUNT': '1.720', 'weapon3': '1.746', 'DAMAGECOUNT': '7.674', 'FRAGCOUNT': '25.000'} [2023-02-24 19:20:47,308][177156] DAMAGECOUNT value on done: 349941.0 [2023-02-24 19:20:47,308][177156] Sum rewards: 16.679, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon7': '0.048', 'AMMO3': '0.059', 'AMMO4': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '0.300', 'HEALTH': '0.351', 'weapon4': '0.532', 'HITCOUNT': '0.640', 'weapon3': '0.990', 'weapon2': '1.224', 'DAMAGECOUNT': '3.771', 'FRAGCOUNT': '12.000'} [2023-02-24 19:20:47,442][177158] DAMAGECOUNT value on done: 344908.0 [2023-02-24 19:20:47,443][177158] Sum rewards: 11.102, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.388', 'AMMO5': '0.017', 'AMMO2': '0.029', 'AMMO3': '0.096', 'weapon4': '0.138', 'AMMO4': '0.143', 'WEAPON4': '0.300', 'weapon5': '0.360', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.860', 'weapon3': '1.340', 'weapon2': '1.348', 'DAMAGECOUNT': '3.759', 'FRAGCOUNT': '11.000'} [2023-02-24 19:20:47,494][177156] DAMAGECOUNT value on done: 368344.0 [2023-02-24 19:20:47,495][177156] Sum rewards: 20.881, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.044', 'AMMO5': '0.020', 'AMMO2': '0.026', 'WEAPON1': '0.040', 'AMMO4': '0.129', 'AMMO3': '0.142', 'WEAPON4': '0.350', 'weapon5': '0.370', 'weapon4': '0.440', 'weapon2': '0.502', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'HITCOUNT': '1.800', 'weapon3': '2.238', 'DAMAGECOUNT': '7.068', 'FRAGCOUNT': '18.000'} [2023-02-24 19:20:47,621][177156] DAMAGECOUNT value on done: 354165.0 [2023-02-24 19:20:47,622][177156] Sum rewards: 27.399, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.773', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.048', 'AMMO3': '0.106', 'AMMO4': '0.240', 'weapon5': '0.298', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon4': '0.638', 'WEAPON3': '0.650', 'weapon2': '0.996', 'weapon3': '1.650', 'HITCOUNT': '1.830', 'DAMAGECOUNT': '8.178', 'FRAGCOUNT': '21.000'} [2023-02-24 19:20:47,677][177153] Updated weights for policy 0, policy_version 24060 (0.0008) [2023-02-24 19:20:47,744][177158] DAMAGECOUNT value on done: 353084.0 [2023-02-24 19:20:47,745][177158] Sum rewards: 34.373, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.258', 'AMMO5': '0.018', 'AMMO2': '0.026', 'AMMO3': '0.120', 'AMMO4': '0.129', 'WEAPON4': '0.250', 'weapon5': '0.332', 'weapon4': '0.394', 'weapon2': '0.490', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'HITCOUNT': '2.170', 'weapon3': '2.304', 'DAMAGECOUNT': '9.597', 'FRAGCOUNT': '26.000'} [2023-02-24 19:20:48,094][177158] DAMAGECOUNT value on done: 358672.0 [2023-02-24 19:20:48,094][177158] Sum rewards: 16.537, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.412', 'AMMO2': '0.014', 'AMMO5': '0.017', 'weapon7': '0.052', 'weapon4': '0.066', 'AMMO4': '0.069', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.129', 'weapon5': '0.168', 'WEAPON5': '0.350', 'weapon2': '0.632', 'WEAPON3': '0.800', 'HITCOUNT': '1.310', 'weapon3': '2.052', 'DAMAGECOUNT': '5.889', 'FRAGCOUNT': '14.000'} [2023-02-24 19:20:48,403][177158] DAMAGECOUNT value on done: 361540.0 [2023-02-24 19:20:48,404][177158] Sum rewards: 12.817, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.236', 'AMMO5': '0.020', 'AMMO2': '0.036', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.117', 'weapon5': '0.136', 'AMMO4': '0.178', 'WEAPON4': '0.350', 'weapon4': '0.438', 'WEAPON5': '0.450', 'weapon2': '0.674', 'WEAPON3': '0.750', 'HITCOUNT': '1.260', 'weapon3': '1.850', 'DAMAGECOUNT': '4.944', 'FRAGCOUNT': '13.000'} [2023-02-24 19:20:50,653][177153] Updated weights for policy 0, policy_version 24070 (0.0009) [2023-02-24 19:20:51,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 98598912. Throughput: 0: 3463.1. Samples: 24643932. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:20:51,376][177119] Avg episode reward: [(0, '19.403')] [2023-02-24 19:20:51,963][177172] DAMAGECOUNT value on done: 354657.0 [2023-02-24 19:20:51,964][177172] Sum rewards: 10.572, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.566', 'AMMO2': '0.002', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.011', 'WEAPON1': '0.020', 'AMMO3': '0.030', 'weapon4': '0.044', 'weapon7': '0.064', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.250', 'weapon5': '0.322', 'HITCOUNT': '0.490', 'weapon2': '0.692', 'weapon3': '0.696', 'DAMAGECOUNT': '2.715', 'FRAGCOUNT': '8.000'} [2023-02-24 19:20:52,261][177172] DAMAGECOUNT value on done: 355276.0 [2023-02-24 19:20:52,261][177172] Sum rewards: 26.748, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.262', 'ARMOR': '0.012', 'AMMO5': '0.029', 'AMMO2': '0.036', 'AMMO3': '0.121', 'AMMO4': '0.182', 'weapon5': '0.286', 'weapon2': '0.380', 'WEAPON4': '0.500', 'WEAPON5': '0.700', 'WEAPON3': '0.850', 'weapon4': '1.064', 'weapon3': '1.716', 'HITCOUNT': '1.950', 'DAMAGECOUNT': '7.683', 'FRAGCOUNT': '22.500'} [2023-02-24 19:20:53,267][177154] DAMAGECOUNT value on done: 357928.0 [2023-02-24 19:20:53,268][177154] Sum rewards: 21.459, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.690', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.027', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'weapon4': '0.146', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'weapon5': '0.468', 'WEAPON3': '0.500', 'weapon2': '0.726', 'HITCOUNT': '1.190', 'weapon3': '1.858', 'DAMAGECOUNT': '4.581', 'FRAGCOUNT': '17.000'} [2023-02-24 19:20:53,571][177154] DAMAGECOUNT value on done: 368527.0 [2023-02-24 19:20:53,571][177154] Sum rewards: 25.369, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.911', 'AMMO5': '0.022', 'AMMO2': '0.026', 'AMMO3': '0.102', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'weapon5': '0.338', 'weapon4': '0.434', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'weapon2': '0.792', 'HITCOUNT': '1.640', 'weapon3': '2.106', 'DAMAGECOUNT': '5.838', 'FRAGCOUNT': '21.000'} [2023-02-24 19:20:53,624][177153] Updated weights for policy 0, policy_version 24080 (0.0008) [2023-02-24 19:20:53,756][177172] DAMAGECOUNT value on done: 366538.0 [2023-02-24 19:20:53,757][177172] Sum rewards: 21.997, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.345', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'AMMO3': '0.109', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon5': '0.338', 'weapon4': '0.372', 'WEAPON3': '0.600', 'weapon2': '0.756', 'HITCOUNT': '1.590', 'weapon3': '2.230', 'DAMAGECOUNT': '6.012', 'FRAGCOUNT': '18.000'} [2023-02-24 19:20:53,875][177154] DAMAGECOUNT value on done: 372505.0 [2023-02-24 19:20:53,876][177154] Sum rewards: 32.935, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.044', 'AMMO2': '0.007', 'AMMO5': '0.017', 'AMMO4': '0.034', 'WEAPON1': '0.040', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon4': '0.222', 'weapon5': '0.344', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'weapon2': '1.090', 'HITCOUNT': '1.960', 'weapon3': '2.098', 'DAMAGECOUNT': '8.424', 'FRAGCOUNT': '27.000'} [2023-02-24 19:20:54,047][177172] DAMAGECOUNT value on done: 361098.0 [2023-02-24 19:20:54,048][177172] Sum rewards: 18.714, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.852', 'AMMO2': '0.020', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.098', 'AMMO3': '0.118', 'WEAPON4': '0.300', 'weapon4': '0.334', 'weapon5': '0.378', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'weapon2': '0.776', 'HITCOUNT': '1.350', 'weapon3': '2.072', 'DAMAGECOUNT': '6.180', 'FRAGCOUNT': '15.000'} [2023-02-24 19:20:54,174][177154] DAMAGECOUNT value on done: 368518.0 [2023-02-24 19:20:54,175][177154] Sum rewards: 15.834, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.917', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO5': '0.011', 'AMMO4': '0.038', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'weapon4': '0.144', 'WEAPON5': '0.300', 'weapon5': '0.338', 'WEAPON3': '0.650', 'weapon2': '0.888', 'HITCOUNT': '1.200', 'weapon3': '2.324', 'DAMAGECOUNT': '4.407', 'FRAGCOUNT': '13.000'} [2023-02-24 19:20:54,287][177157] DAMAGECOUNT value on done: 369988.0 [2023-02-24 19:20:54,287][177157] Sum rewards: 24.556, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.125', 'AMMO5': '0.012', 'AMMO2': '0.053', 'AMMO3': '0.112', 'AMMO4': '0.266', 'WEAPON5': '0.300', 'weapon5': '0.368', 'weapon4': '0.470', 'WEAPON4': '0.500', 'WEAPON3': '0.750', 'weapon2': '0.854', 'weapon3': '1.888', 'HITCOUNT': '1.910', 'DAMAGECOUNT': '8.697', 'FRAGCOUNT': '21.000'} [2023-02-24 19:20:54,422][177157] DAMAGECOUNT value on done: 354538.0 [2023-02-24 19:20:54,423][177157] Sum rewards: 24.552, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.595', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO3': '0.092', 'AMMO4': '0.133', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'weapon5': '0.442', 'WEAPON3': '0.500', 'weapon4': '0.552', 'weapon2': '0.838', 'HITCOUNT': '1.260', 'weapon3': '1.628', 'DAMAGECOUNT': '4.962', 'FRAGCOUNT': '19.000'} [2023-02-24 19:20:54,599][177157] DAMAGECOUNT value on done: 354013.0 [2023-02-24 19:20:54,600][177157] Sum rewards: 19.419, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.650', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.012', 'AMMO4': '0.056', 'AMMO3': '0.086', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.440', 'weapon5': '0.550', 'WEAPON3': '0.600', 'weapon2': '0.868', 'HITCOUNT': '1.420', 'weapon3': '1.590', 'DAMAGECOUNT': '5.475', 'FRAGCOUNT': '16.000'} [2023-02-24 19:20:54,732][177157] DAMAGECOUNT value on done: 357545.0 [2023-02-24 19:20:54,732][177157] Sum rewards: 21.259, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.354', 'ARMOR': '0.004', 'AMMO5': '0.018', 'WEAPON1': '0.030', 'AMMO2': '0.044', 'AMMO3': '0.135', 'AMMO4': '0.218', 'weapon4': '0.350', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon5': '0.700', 'WEAPON3': '0.800', 'weapon2': '0.806', 'HITCOUNT': '1.430', 'weapon3': '1.596', 'DAMAGECOUNT': '7.182', 'FRAGCOUNT': '19.000'} [2023-02-24 19:20:54,766][177171] DAMAGECOUNT value on done: 355534.0 [2023-02-24 19:20:54,767][177171] Sum rewards: 23.432, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.458', 'AMMO2': '0.003', 'AMMO5': '0.014', 'AMMO4': '0.016', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'weapon4': '0.180', 'weapon5': '0.224', 'WEAPON5': '0.350', 'weapon2': '0.710', 'WEAPON3': '0.750', 'HITCOUNT': '1.630', 'weapon3': '2.152', 'DAMAGECOUNT': '5.895', 'FRAGCOUNT': '20.000'} [2023-02-24 19:20:54,777][177171] DAMAGECOUNT value on done: 357384.0 [2023-02-24 19:20:54,778][177171] Sum rewards: 20.824, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.224', 'AMMO5': '0.030', 'AMMO2': '0.041', 'AMMO3': '0.087', 'weapon4': '0.180', 'AMMO4': '0.202', 'WEAPON4': '0.400', 'weapon5': '0.414', 'WEAPON3': '0.600', 'WEAPON5': '0.650', 'weapon2': '0.860', 'HITCOUNT': '1.480', 'weapon3': '2.090', 'DAMAGECOUNT': '6.015', 'FRAGCOUNT': '18.000'} [2023-02-24 19:20:55,079][177171] DAMAGECOUNT value on done: 356137.0 [2023-02-24 19:20:55,079][177171] Sum rewards: 23.910, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.001', 'AMMO5': '0.006', 'AMMO2': '0.038', 'AMMO3': '0.075', 'weapon7': '0.110', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO4': '0.192', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'weapon4': '0.828', 'weapon2': '0.838', 'HITCOUNT': '1.480', 'weapon3': '1.650', 'DAMAGECOUNT': '7.314', 'FRAGCOUNT': '18.000'} [2023-02-24 19:20:55,092][177171] DAMAGECOUNT value on done: 358356.0 [2023-02-24 19:20:55,093][177171] Sum rewards: 23.671, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.370', 'AMMO2': '0.010', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.051', 'AMMO3': '0.120', 'WEAPON4': '0.200', 'weapon4': '0.280', 'weapon5': '0.372', 'WEAPON5': '0.450', 'weapon2': '0.464', 'WEAPON3': '0.850', 'HITCOUNT': '1.650', 'weapon3': '2.506', 'DAMAGECOUNT': '7.050', 'FRAGCOUNT': '20.000'} [2023-02-24 19:20:56,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 98668544. Throughput: 0: 3459.8. Samples: 24664630. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:20:56,376][177119] Avg episode reward: [(0, '19.812')] [2023-02-24 19:20:56,380][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000024089_98668544.pth... [2023-02-24 19:20:56,437][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000023279_95350784.pth [2023-02-24 19:20:56,623][177153] Updated weights for policy 0, policy_version 24090 (0.0008) [2023-02-24 19:20:57,351][177155] DAMAGECOUNT value on done: 367111.0 [2023-02-24 19:20:57,352][177155] Sum rewards: 18.396, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.006', 'AMMO2': '0.013', 'AMMO5': '0.027', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'AMMO3': '0.154', 'weapon4': '0.248', 'weapon5': '0.280', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'weapon2': '1.142', 'HITCOUNT': '1.510', 'weapon3': '2.006', 'DAMAGECOUNT': '5.808', 'FRAGCOUNT': '17.000'} [2023-02-24 19:20:57,652][177155] DAMAGECOUNT value on done: 372795.0 [2023-02-24 19:20:57,653][177155] Sum rewards: 30.376, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.963', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO4': '0.033', 'AMMO3': '0.154', 'WEAPON5': '0.300', 'weapon5': '0.330', 'WEAPON3': '0.900', 'weapon2': '1.236', 'HITCOUNT': '1.980', 'weapon3': '2.142', 'DAMAGECOUNT': '8.232', 'FRAGCOUNT': '25.000'} [2023-02-24 19:20:57,930][177155] DAMAGECOUNT value on done: 369828.0 [2023-02-24 19:20:57,930][177155] Sum rewards: 22.123, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.705', 'AMMO2': '0.008', 'AMMO5': '0.013', 'AMMO4': '0.037', 'AMMO3': '0.066', 'WEAPON4': '0.100', 'weapon4': '0.152', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'weapon5': '0.556', 'weapon2': '0.960', 'HITCOUNT': '1.130', 'weapon3': '1.578', 'DAMAGECOUNT': '5.628', 'FRAGCOUNT': '17.000'} [2023-02-24 19:20:58,227][177155] DAMAGECOUNT value on done: 352242.0 [2023-02-24 19:20:58,228][177155] Sum rewards: 30.814, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.187', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.102', 'AMMO3': '0.124', 'weapon5': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.606', 'WEAPON3': '0.800', 'weapon4': '0.888', 'weapon3': '1.856', 'HITCOUNT': '2.010', 'DAMAGECOUNT': '7.410', 'FRAGCOUNT': '25.000'} [2023-02-24 19:20:59,617][177153] Updated weights for policy 0, policy_version 24100 (0.0008) [2023-02-24 19:21:01,376][177119] Fps is (10 sec: 13516.9, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 98734080. Throughput: 0: 3456.6. Samples: 24685182. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:21:01,376][177119] Avg episode reward: [(0, '20.299')] [2023-02-24 19:21:02,587][177153] Updated weights for policy 0, policy_version 24110 (0.0008) [2023-02-24 19:21:04,351][177170] DAMAGECOUNT value on done: 359970.0 [2023-02-24 19:21:04,351][177170] Sum rewards: 25.672, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.080', 'AMMO2': '0.020', 'AMMO5': '0.020', 'AMMO3': '0.074', 'AMMO4': '0.099', 'WEAPON4': '0.300', 'weapon2': '0.452', 'weapon5': '0.520', 'weapon4': '0.530', 'WEAPON5': '0.550', 'WEAPON3': '0.550', 'HITCOUNT': '1.670', 'weapon3': '2.078', 'DAMAGECOUNT': '7.389', 'FRAGCOUNT': '20.000'} [2023-02-24 19:21:04,657][177170] DAMAGECOUNT value on done: 360520.0 [2023-02-24 19:21:04,658][177170] Sum rewards: 18.657, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.850', 'AMMO5': '0.023', 'AMMO2': '0.041', 'AMMO3': '0.125', 'AMMO4': '0.204', 'weapon2': '0.300', 'weapon4': '0.466', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon5': '0.692', 'WEAPON3': '0.850', 'HITCOUNT': '1.390', 'weapon3': '2.088', 'DAMAGECOUNT': '5.778', 'FRAGCOUNT': '19.000'} [2023-02-24 19:21:05,256][177170] DAMAGECOUNT value on done: 355451.0 [2023-02-24 19:21:05,256][177170] Sum rewards: 25.626, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.124', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.015', 'AMMO4': '0.056', 'AMMO3': '0.124', 'WEAPON4': '0.250', 'weapon4': '0.254', 'weapon5': '0.326', 'WEAPON5': '0.350', 'weapon2': '0.448', 'WEAPON3': '0.750', 'HITCOUNT': '1.960', 'weapon3': '2.570', 'DAMAGECOUNT': '7.125', 'FRAGCOUNT': '22.000'} [2023-02-24 19:21:05,560][177170] DAMAGECOUNT value on done: 361256.0 [2023-02-24 19:21:05,561][177170] Sum rewards: 24.721, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.422', 'AMMO5': '0.016', 'AMMO2': '0.037', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.118', 'AMMO4': '0.184', 'weapon5': '0.256', 'WEAPON5': '0.400', 'weapon2': '0.564', 'WEAPON4': '0.600', 'WEAPON3': '0.750', 'weapon4': '0.992', 'HITCOUNT': '1.840', 'weapon3': '1.882', 'DAMAGECOUNT': '6.453', 'FRAGCOUNT': '23.000'} [2023-02-24 19:21:05,564][177153] Updated weights for policy 0, policy_version 24120 (0.0009) [2023-02-24 19:21:06,376][177119] Fps is (10 sec: 13516.7, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 98803712. Throughput: 0: 3454.1. Samples: 24695536. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:21:06,376][177119] Avg episode reward: [(0, '20.465')] [2023-02-24 19:21:06,663][177156] DAMAGECOUNT value on done: 362827.0 [2023-02-24 19:21:06,664][177156] Sum rewards: 20.924, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.725', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO3': '0.124', 'AMMO4': '0.205', 'weapon5': '0.268', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.472', 'weapon4': '0.654', 'WEAPON3': '0.800', 'HITCOUNT': '1.660', 'weapon3': '2.000', 'DAMAGECOUNT': '7.260', 'FRAGCOUNT': '18.000'} [2023-02-24 19:21:06,837][177156] DAMAGECOUNT value on done: 351867.0 [2023-02-24 19:21:06,837][177156] Sum rewards: 18.870, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.552', 'AMMO2': '0.011', 'AMMO5': '0.015', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO3': '0.147', 'weapon2': '0.386', 'WEAPON5': '0.450', 'weapon5': '0.552', 'WEAPON3': '0.900', 'HITCOUNT': '1.440', 'weapon3': '2.484', 'DAMAGECOUNT': '5.778', 'FRAGCOUNT': '17.000'} [2023-02-24 19:21:06,946][177158] DAMAGECOUNT value on done: 346677.0 [2023-02-24 19:21:06,946][177158] Sum rewards: 20.577, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.675', 'AMMO5': '0.012', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO3': '0.064', 'AMMO4': '0.068', 'WEAPON4': '0.200', 'weapon4': '0.258', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon5': '0.572', 'weapon2': '0.674', 'HITCOUNT': '1.220', 'weapon3': '2.092', 'DAMAGECOUNT': '5.307', 'FRAGCOUNT': '16.000'} [2023-02-24 19:21:06,968][177156] DAMAGECOUNT value on done: 370272.0 [2023-02-24 19:21:06,968][177156] Sum rewards: 17.417, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.086', 'ARMOR': '0.004', 'AMMO2': '0.011', 'AMMO5': '0.034', 'AMMO4': '0.057', 'AMMO3': '0.131', 'weapon4': '0.146', 'WEAPON4': '0.150', 'weapon2': '0.570', 'weapon5': '0.722', 'WEAPON5': '0.800', 'WEAPON3': '0.850', 'HITCOUNT': '1.260', 'weapon3': '1.984', 'DAMAGECOUNT': '5.784', 'FRAGCOUNT': '15.000'} [2023-02-24 19:21:07,143][177156] DAMAGECOUNT value on done: 355847.0 [2023-02-24 19:21:07,143][177156] Sum rewards: 20.366, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.068', 'AMMO5': '0.015', 'AMMO2': '0.020', 'AMMO3': '0.045', 'weapon7': '0.076', 'AMMO4': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon5': '0.552', 'weapon2': '0.768', 'weapon4': '0.910', 'weapon3': '0.914', 'HITCOUNT': '1.400', 'DAMAGECOUNT': '5.046', 'FRAGCOUNT': '16.000'} [2023-02-24 19:21:07,247][177158] DAMAGECOUNT value on done: 354867.0 [2023-02-24 19:21:07,247][177158] Sum rewards: 18.651, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.126', 'AMMO2': '0.012', 'AMMO5': '0.019', 'weapon4': '0.052', 'AMMO4': '0.061', 'AMMO3': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.500', 'weapon5': '0.510', 'WEAPON3': '0.550', 'weapon2': '0.918', 'HITCOUNT': '1.030', 'weapon3': '2.038', 'DAMAGECOUNT': '5.349', 'FRAGCOUNT': '15.000'} [2023-02-24 19:21:07,619][177158] DAMAGECOUNT value on done: 360910.0 [2023-02-24 19:21:07,620][177158] Sum rewards: 23.378, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.255', 'AMMO5': '0.024', 'AMMO2': '0.028', 'AMMO3': '0.136', 'AMMO4': '0.140', 'weapon4': '0.300', 'weapon2': '0.324', 'WEAPON4': '0.350', 'weapon5': '0.366', 'WEAPON5': '0.650', 'WEAPON3': '0.950', 'HITCOUNT': '1.550', 'weapon3': '2.600', 'DAMAGECOUNT': '6.714', 'FRAGCOUNT': '22.000'} [2023-02-24 19:21:07,926][177158] DAMAGECOUNT value on done: 363876.0 [2023-02-24 19:21:07,927][177158] Sum rewards: 23.404, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.670', 'AMMO5': '0.019', 'AMMO2': '0.023', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.107', 'AMMO4': '0.113', 'WEAPON4': '0.200', 'weapon4': '0.308', 'weapon5': '0.410', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'weapon2': '0.990', 'HITCOUNT': '1.580', 'weapon3': '1.868', 'DAMAGECOUNT': '7.008', 'FRAGCOUNT': '19.000'} [2023-02-24 19:21:08,517][177153] Updated weights for policy 0, policy_version 24130 (0.0008) [2023-02-24 19:21:11,376][177119] Fps is (10 sec: 13926.3, 60 sec: 13789.8, 300 sec: 13829.2). Total num frames: 98873344. Throughput: 0: 3453.3. Samples: 24716302. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:21:11,376][177119] Avg episode reward: [(0, '20.625')] [2023-02-24 19:21:11,449][177172] DAMAGECOUNT value on done: 356775.0 [2023-02-24 19:21:11,449][177172] Sum rewards: 25.638, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.635', 'ARMOR': '0.004', 'AMMO2': '0.011', 'AMMO5': '0.017', 'AMMO4': '0.055', 'AMMO3': '0.091', 'weapon4': '0.116', 'WEAPON4': '0.200', 'WEAPON5': '0.550', 'weapon2': '0.570', 'WEAPON3': '0.650', 'weapon5': '0.768', 'HITCOUNT': '1.500', 'weapon3': '2.136', 'DAMAGECOUNT': '6.354', 'FRAGCOUNT': '21.000'} [2023-02-24 19:21:11,473][177153] Updated weights for policy 0, policy_version 24140 (0.0009) [2023-02-24 19:21:11,749][177172] DAMAGECOUNT value on done: 357727.0 [2023-02-24 19:21:11,750][177172] Sum rewards: 27.205, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'weapon4': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.145', 'weapon5': '0.168', 'WEAPON5': '0.200', 'HEALTH': '0.264', 'WEAPON3': '0.850', 'weapon2': '0.874', 'HITCOUNT': '1.960', 'weapon3': '2.492', 'DAMAGECOUNT': '7.353', 'FRAGCOUNT': '22.500'} [2023-02-24 19:21:12,796][177154] DAMAGECOUNT value on done: 359970.0 [2023-02-24 19:21:12,796][177154] Sum rewards: 22.913, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.882', 'AMMO5': '0.007', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.318', 'weapon4': '0.350', 'WEAPON3': '0.950', 'weapon2': '0.978', 'HITCOUNT': '1.440', 'weapon3': '1.848', 'DAMAGECOUNT': '6.126', 'FRAGCOUNT': '21.000'} [2023-02-24 19:21:13,095][177154] DAMAGECOUNT value on done: 369376.0 [2023-02-24 19:21:13,096][177154] Sum rewards: 6.269, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.032', 'AMMO5': '0.015', 'AMMO2': '0.022', 'AMMO3': '0.051', 'weapon7': '0.070', 'AMMO4': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.186', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.380', 'HITCOUNT': '0.540', 'weapon2': '0.894', 'weapon3': '1.148', 'DAMAGECOUNT': '2.547', 'FRAGCOUNT': '5.000'} [2023-02-24 19:21:13,243][177172] DAMAGECOUNT value on done: 368475.0 [2023-02-24 19:21:13,243][177172] Sum rewards: 23.051, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.115', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.035', 'AMMO3': '0.070', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'weapon4': '0.428', 'weapon5': '0.494', 'weapon2': '1.120', 'weapon3': '1.366', 'HITCOUNT': '1.520', 'DAMAGECOUNT': '5.766', 'FRAGCOUNT': '16.000'} [2023-02-24 19:21:13,394][177154] DAMAGECOUNT value on done: 374863.0 [2023-02-24 19:21:13,395][177154] Sum rewards: 24.736, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.880', 'ARMOR': '0.004', 'AMMO2': '0.004', 'AMMO4': '0.021', 'AMMO5': '0.022', 'AMMO3': '0.106', 'weapon4': '0.134', 'WEAPON4': '0.150', 'weapon5': '0.420', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon2': '0.804', 'HITCOUNT': '1.540', 'weapon3': '2.286', 'DAMAGECOUNT': '7.074', 'FRAGCOUNT': '21.000'} [2023-02-24 19:21:13,558][177172] DAMAGECOUNT value on done: 363729.0 [2023-02-24 19:21:13,559][177172] Sum rewards: 26.020, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.412', 'ARMOR': '0.004', 'AMMO2': '0.011', 'AMMO5': '0.017', 'AMMO4': '0.053', 'AMMO3': '0.096', 'weapon4': '0.148', 'WEAPON4': '0.200', 'weapon5': '0.474', 'WEAPON5': '0.500', 'weapon2': '0.698', 'WEAPON3': '0.750', 'HITCOUNT': '1.760', 'weapon3': '2.078', 'DAMAGECOUNT': '7.893', 'FRAGCOUNT': '21.000'} [2023-02-24 19:21:13,704][177154] DAMAGECOUNT value on done: 370851.0 [2023-02-24 19:21:13,705][177154] Sum rewards: 22.179, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.474', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.141', 'AMMO4': '0.187', 'WEAPON5': '0.350', 'weapon5': '0.356', 'WEAPON4': '0.400', 'weapon2': '0.434', 'weapon4': '0.536', 'WEAPON3': '0.900', 'HITCOUNT': '1.820', 'weapon3': '2.124', 'DAMAGECOUNT': '6.999', 'FRAGCOUNT': '21.000'} [2023-02-24 19:21:13,767][177157] DAMAGECOUNT value on done: 372354.0 [2023-02-24 19:21:13,768][177157] Sum rewards: 22.588, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.263', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.148', 'WEAPON5': '0.200', 'weapon5': '0.218', 'WEAPON4': '0.250', 'weapon4': '0.530', 'weapon2': '0.544', 'WEAPON3': '0.950', 'HITCOUNT': '1.850', 'weapon3': '2.216', 'DAMAGECOUNT': '7.098', 'FRAGCOUNT': '21.000'} [2023-02-24 19:21:13,921][177157] DAMAGECOUNT value on done: 356294.0 [2023-02-24 19:21:13,922][177157] Sum rewards: 21.264, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.100', 'AMMO2': '0.012', 'AMMO5': '0.018', 'AMMO4': '0.061', 'AMMO3': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.402', 'weapon5': '0.416', 'WEAPON3': '0.650', 'weapon2': '0.680', 'HITCOUNT': '1.570', 'weapon3': '2.154', 'DAMAGECOUNT': '5.268', 'FRAGCOUNT': '17.000'} [2023-02-24 19:21:14,077][177157] DAMAGECOUNT value on done: 356132.0 [2023-02-24 19:21:14,078][177157] Sum rewards: 19.124, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.342', 'WEAPON1': '0.010', 'AMMO5': '0.026', 'AMMO2': '0.036', 'AMMO4': '0.179', 'AMMO3': '0.188', 'weapon2': '0.312', 'WEAPON4': '0.350', 'weapon4': '0.496', 'WEAPON5': '0.600', 'weapon5': '0.716', 'WEAPON3': '1.050', 'HITCOUNT': '1.680', 'weapon3': '1.966', 'DAMAGECOUNT': '6.357', 'FRAGCOUNT': '20.000'} [2023-02-24 19:21:14,225][177157] DAMAGECOUNT value on done: 359550.0 [2023-02-24 19:21:14,226][177157] Sum rewards: 19.497, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.247', 'weapon7': '0.012', 'AMMO2': '0.014', 'AMMO5': '0.027', 'AMMO4': '0.068', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.264', 'weapon5': '0.440', 'weapon2': '0.554', 'WEAPON5': '0.650', 'WEAPON3': '0.950', 'HITCOUNT': '1.280', 'weapon3': '2.262', 'DAMAGECOUNT': '6.015', 'FRAGCOUNT': '17.000'} [2023-02-24 19:21:14,268][177171] DAMAGECOUNT value on done: 357811.0 [2023-02-24 19:21:14,269][177171] Sum rewards: 25.062, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.009', 'AMMO2': '0.010', 'ARMOR': '0.012', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'HEALTH': '0.084', 'weapon4': '0.104', 'AMMO3': '0.123', 'weapon5': '0.188', 'WEAPON5': '0.200', 'WEAPON3': '0.750', 'weapon2': '0.924', 'HITCOUNT': '1.620', 'weapon3': '2.360', 'DAMAGECOUNT': '6.831', 'FRAGCOUNT': '20.000'} [2023-02-24 19:21:14,280][177171] DAMAGECOUNT value on done: 359821.0 [2023-02-24 19:21:14,281][177171] Sum rewards: 25.117, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.580', 'AMMO2': '0.015', 'weapon4': '0.018', 'AMMO5': '0.019', 'AMMO4': '0.072', 'AMMO3': '0.134', 'WEAPON4': '0.200', 'weapon2': '0.476', 'WEAPON5': '0.550', 'weapon5': '0.656', 'WEAPON3': '0.900', 'HITCOUNT': '1.670', 'weapon3': '2.426', 'DAMAGECOUNT': '7.311', 'FRAGCOUNT': '22.000'} [2023-02-24 19:21:14,443][177153] Updated weights for policy 0, policy_version 24150 (0.0008) [2023-02-24 19:21:14,576][177171] DAMAGECOUNT value on done: 357675.0 [2023-02-24 19:21:14,577][177171] Sum rewards: 20.580, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.175', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.068', 'weapon4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.300', 'weapon5': '0.364', 'WEAPON3': '0.400', 'HITCOUNT': '1.120', 'weapon2': '1.286', 'weapon3': '1.850', 'DAMAGECOUNT': '4.614', 'FRAGCOUNT': '15.000'} [2023-02-24 19:21:14,588][177171] DAMAGECOUNT value on done: 359481.0 [2023-02-24 19:21:14,589][177171] Sum rewards: 10.380, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.740', 'AMMO4': '-0.063', 'AMMO2': '-0.013', 'ARMOR': '0.004', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'weapon4': '0.206', 'weapon5': '0.494', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'HITCOUNT': '0.830', 'weapon2': '1.034', 'weapon3': '1.766', 'DAMAGECOUNT': '3.375', 'FRAGCOUNT': '9.000'} [2023-02-24 19:21:16,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 98942976. Throughput: 0: 3452.5. Samples: 24737056. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:21:16,376][177119] Avg episode reward: [(0, '21.168')] [2023-02-24 19:21:16,380][177140] Saving new best policy, reward=21.168! [2023-02-24 19:21:16,811][177155] DAMAGECOUNT value on done: 369216.0 [2023-02-24 19:21:16,811][177155] Sum rewards: 22.311, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.200', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon4': '0.078', 'AMMO4': '0.102', 'AMMO3': '0.120', 'WEAPON4': '0.250', 'WEAPON5': '0.500', 'weapon5': '0.530', 'weapon2': '0.742', 'WEAPON3': '0.750', 'HITCOUNT': '1.390', 'weapon3': '2.174', 'DAMAGECOUNT': '6.315', 'FRAGCOUNT': '19.500'} [2023-02-24 19:21:17,119][177155] DAMAGECOUNT value on done: 374730.0 [2023-02-24 19:21:17,120][177155] Sum rewards: 17.630, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.325', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO3': '0.063', 'AMMO4': '0.133', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.477', 'weapon5': '0.480', 'WEAPON5': '0.500', 'weapon4': '0.520', 'weapon2': '0.726', 'HITCOUNT': '1.320', 'weapon3': '1.538', 'DAMAGECOUNT': '5.805', 'FRAGCOUNT': '14.000'} [2023-02-24 19:21:17,393][177153] Updated weights for policy 0, policy_version 24160 (0.0008) [2023-02-24 19:21:17,422][177155] DAMAGECOUNT value on done: 371066.0 [2023-02-24 19:21:17,423][177155] Sum rewards: 11.136, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.094', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.014', 'weapon7': '0.048', 'AMMO4': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.116', 'weapon5': '0.162', 'WEAPON4': '0.200', 'weapon4': '0.264', 'WEAPON5': '0.300', 'weapon2': '0.494', 'WEAPON3': '0.650', 'HITCOUNT': '1.050', 'weapon3': '1.330', 'DAMAGECOUNT': '3.714', 'FRAGCOUNT': '11.000'} [2023-02-24 19:21:17,743][177155] DAMAGECOUNT value on done: 354864.0 [2023-02-24 19:21:17,743][177155] Sum rewards: 27.911, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.340', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO5': '0.019', 'AMMO4': '0.081', 'AMMO3': '0.140', 'WEAPON4': '0.200', 'weapon4': '0.282', 'weapon5': '0.328', 'weapon2': '0.442', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'HITCOUNT': '1.850', 'weapon3': '2.566', 'DAMAGECOUNT': '7.866', 'FRAGCOUNT': '24.000'} [2023-02-24 19:21:20,342][177153] Updated weights for policy 0, policy_version 24170 (0.0008) [2023-02-24 19:21:21,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 99012608. Throughput: 0: 3451.1. Samples: 24747394. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 19:21:21,376][177119] Avg episode reward: [(0, '21.197')] [2023-02-24 19:21:21,376][177140] Saving new best policy, reward=21.197! [2023-02-24 19:21:23,334][177153] Updated weights for policy 0, policy_version 24180 (0.0008) [2023-02-24 19:21:23,774][177170] DAMAGECOUNT value on done: 362023.0 [2023-02-24 19:21:23,775][177170] Sum rewards: 18.619, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.182', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.028', 'AMMO3': '0.136', 'AMMO4': '0.138', 'weapon5': '0.212', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.548', 'WEAPON3': '0.750', 'weapon2': '0.974', 'HITCOUNT': '1.620', 'weapon3': '1.814', 'DAMAGECOUNT': '6.159', 'FRAGCOUNT': '17.000'} [2023-02-24 19:21:24,082][177170] DAMAGECOUNT value on done: 362917.0 [2023-02-24 19:21:24,083][177170] Sum rewards: 28.240, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.447', 'AMMO5': '0.012', 'AMMO2': '0.016', 'weapon7': '0.052', 'AMMO4': '0.078', 'weapon5': '0.146', 'WEAPON4': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO3': '0.190', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.442', 'weapon2': '0.840', 'WEAPON3': '1.050', 'HITCOUNT': '1.870', 'weapon3': '2.080', 'DAMAGECOUNT': '7.191', 'FRAGCOUNT': '25.000'} [2023-02-24 19:21:24,195][177155] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 19:21:24,691][177170] DAMAGECOUNT value on done: 357912.0 [2023-02-24 19:21:24,691][177170] Sum rewards: 25.000, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.264', 'AMMO2': '0.006', 'AMMO5': '0.020', 'AMMO4': '0.031', 'WEAPON4': '0.100', 'AMMO3': '0.155', 'weapon4': '0.172', 'WEAPON5': '0.400', 'weapon5': '0.500', 'weapon2': '0.660', 'WEAPON3': '1.000', 'HITCOUNT': '1.550', 'weapon3': '2.286', 'DAMAGECOUNT': '7.383', 'FRAGCOUNT': '21.000'} [2023-02-24 19:21:24,990][177170] DAMAGECOUNT value on done: 363039.0 [2023-02-24 19:21:24,991][177170] Sum rewards: 19.238, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.685', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon7': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.101', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'weapon5': '0.202', 'weapon4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'weapon2': '1.012', 'HITCOUNT': '1.350', 'weapon3': '1.770', 'DAMAGECOUNT': '5.349', 'FRAGCOUNT': '15.000'} [2023-02-24 19:21:26,159][177156] DAMAGECOUNT value on done: 365545.0 [2023-02-24 19:21:26,159][177156] Sum rewards: 27.664, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.368', 'AMMO2': '0.016', 'AMMO5': '0.022', 'AMMO4': '0.078', 'weapon4': '0.120', 'AMMO3': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.500', 'weapon5': '0.508', 'weapon2': '0.588', 'WEAPON3': '0.900', 'HITCOUNT': '1.680', 'weapon3': '2.380', 'DAMAGECOUNT': '8.154', 'FRAGCOUNT': '25.000'} [2023-02-24 19:21:26,314][177153] Updated weights for policy 0, policy_version 24190 (0.0008) [2023-02-24 19:21:26,339][177156] DAMAGECOUNT value on done: 353405.0 [2023-02-24 19:21:26,340][177156] Sum rewards: 14.486, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.526', 'AMMO5': '0.023', 'AMMO2': '0.040', 'AMMO3': '0.072', 'AMMO4': '0.199', 'weapon5': '0.302', 'WEAPON4': '0.350', 'weapon4': '0.440', 'WEAPON3': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.994', 'HITCOUNT': '1.100', 'weapon3': '1.928', 'DAMAGECOUNT': '4.614', 'FRAGCOUNT': '11.500'} [2023-02-24 19:21:26,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 99082240. Throughput: 0: 3446.6. Samples: 24768026. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:21:26,376][177119] Avg episode reward: [(0, '21.382')] [2023-02-24 19:21:26,380][177140] Saving new best policy, reward=21.382! [2023-02-24 19:21:26,426][177158] DAMAGECOUNT value on done: 348661.0 [2023-02-24 19:21:26,427][177158] Sum rewards: 16.767, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.628', 'AMMO2': '0.003', 'weapon4': '0.016', 'AMMO4': '0.017', 'AMMO5': '0.024', 'WEAPON4': '0.100', 'AMMO3': '0.166', 'weapon5': '0.494', 'weapon2': '0.636', 'WEAPON5': '0.650', 'WEAPON3': '1.050', 'HITCOUNT': '1.440', 'weapon3': '2.346', 'DAMAGECOUNT': '5.952', 'FRAGCOUNT': '16.000'} [2023-02-24 19:21:26,484][177156] DAMAGECOUNT value on done: 372171.0 [2023-02-24 19:21:26,484][177156] Sum rewards: 25.404, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.581', 'AMMO2': '0.015', 'weapon4': '0.016', 'WEAPON1': '0.020', 'AMMO5': '0.031', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'weapon2': '0.352', 'weapon5': '0.676', 'WEAPON5': '0.750', 'WEAPON3': '0.750', 'HITCOUNT': '1.360', 'weapon3': '2.542', 'DAMAGECOUNT': '5.697', 'FRAGCOUNT': '22.000'} [2023-02-24 19:21:26,661][177156] DAMAGECOUNT value on done: 358028.0 [2023-02-24 19:21:26,661][177156] Sum rewards: 28.400, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.167', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.042', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'weapon4': '0.144', 'WEAPON5': '0.350', 'weapon5': '0.452', 'WEAPON3': '0.650', 'weapon2': '1.138', 'HITCOUNT': '1.650', 'weapon3': '1.856', 'DAMAGECOUNT': '6.543', 'FRAGCOUNT': '24.000'} [2023-02-24 19:21:26,731][177158] DAMAGECOUNT value on done: 357856.0 [2023-02-24 19:21:26,731][177158] Sum rewards: 32.840, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.272', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO5': '0.022', 'AMMO4': '0.080', 'AMMO3': '0.142', 'WEAPON4': '0.200', 'weapon5': '0.314', 'weapon4': '0.316', 'weapon2': '0.416', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'HITCOUNT': '2.240', 'weapon3': '2.588', 'DAMAGECOUNT': '8.967', 'FRAGCOUNT': '27.000'} [2023-02-24 19:21:27,120][177158] DAMAGECOUNT value on done: 362710.0 [2023-02-24 19:21:27,121][177158] Sum rewards: 16.281, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.284', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO5': '0.027', 'weapon4': '0.032', 'WEAPON4': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.136', 'weapon5': '0.362', 'WEAPON5': '0.650', 'WEAPON3': '0.850', 'weapon2': '1.074', 'HITCOUNT': '1.340', 'weapon3': '2.190', 'DAMAGECOUNT': '5.400', 'FRAGCOUNT': '15.000'} [2023-02-24 19:21:27,419][177158] DAMAGECOUNT value on done: 365972.0 [2023-02-24 19:21:27,419][177158] Sum rewards: 22.961, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.204', 'ARMOR': '0.004', 'AMMO2': '0.005', 'AMMO5': '0.019', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.112', 'weapon7': '0.146', 'AMMO3': '0.155', 'WEAPON5': '0.400', 'weapon5': '0.420', 'weapon2': '0.454', 'WEAPON3': '0.950', 'HITCOUNT': '1.590', 'weapon3': '2.248', 'DAMAGECOUNT': '6.288', 'FRAGCOUNT': '20.000'} [2023-02-24 19:21:29,276][177153] Updated weights for policy 0, policy_version 24200 (0.0008) [2023-02-24 19:21:30,971][177172] DAMAGECOUNT value on done: 358897.0 [2023-02-24 19:21:30,971][177172] Sum rewards: 21.451, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.047', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO5': '0.020', 'AMMO4': '0.045', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'weapon4': '0.386', 'weapon5': '0.406', 'WEAPON5': '0.450', 'weapon2': '0.660', 'WEAPON3': '0.900', 'HITCOUNT': '1.470', 'weapon3': '2.180', 'DAMAGECOUNT': '6.366', 'FRAGCOUNT': '19.000'} [2023-02-24 19:21:31,271][177172] DAMAGECOUNT value on done: 359560.0 [2023-02-24 19:21:31,271][177172] Sum rewards: 21.981, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.009', 'AMMO5': '0.021', 'AMMO2': '0.026', 'AMMO3': '0.084', 'AMMO4': '0.128', 'WEAPON4': '0.400', 'weapon5': '0.430', 'WEAPON5': '0.500', 'weapon4': '0.512', 'WEAPON3': '0.550', 'weapon2': '0.854', 'HITCOUNT': '1.370', 'weapon3': '1.616', 'DAMAGECOUNT': '5.499', 'FRAGCOUNT': '17.000'} [2023-02-24 19:21:31,376][177119] Fps is (10 sec: 13926.2, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 99151872. Throughput: 0: 3445.8. Samples: 24788634. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:21:31,376][177119] Avg episode reward: [(0, '21.658')] [2023-02-24 19:21:31,377][177140] Saving new best policy, reward=21.658! [2023-02-24 19:21:32,244][177153] Updated weights for policy 0, policy_version 24210 (0.0008) [2023-02-24 19:21:32,323][177154] DAMAGECOUNT value on done: 362356.0 [2023-02-24 19:21:32,323][177154] Sum rewards: 24.831, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.663', 'AMMO2': '0.006', 'AMMO5': '0.018', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'weapon4': '0.056', 'AMMO3': '0.129', 'WEAPON5': '0.350', 'weapon5': '0.380', 'WEAPON3': '0.850', 'weapon2': '0.940', 'HITCOUNT': '1.540', 'weapon3': '2.238', 'DAMAGECOUNT': '7.158', 'FRAGCOUNT': '20.000'} [2023-02-24 19:21:32,619][177154] DAMAGECOUNT value on done: 371272.0 [2023-02-24 19:21:32,619][177154] Sum rewards: 19.488, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.820', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO3': '0.079', 'AMMO4': '0.082', 'WEAPON4': '0.250', 'weapon4': '0.280', 'WEAPON5': '0.300', 'weapon5': '0.398', 'WEAPON3': '0.550', 'weapon2': '1.048', 'HITCOUNT': '1.390', 'weapon3': '1.714', 'DAMAGECOUNT': '5.688', 'FRAGCOUNT': '17.000'} [2023-02-24 19:21:32,772][177172] DAMAGECOUNT value on done: 370555.0 [2023-02-24 19:21:32,773][177172] Sum rewards: 23.239, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.030', 'AMMO2': '0.011', 'AMMO5': '0.015', 'weapon4': '0.036', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'WEAPON5': '0.500', 'weapon2': '0.558', 'weapon5': '0.598', 'WEAPON3': '0.750', 'HITCOUNT': '1.500', 'weapon3': '2.290', 'DAMAGECOUNT': '6.240', 'FRAGCOUNT': '19.000'} [2023-02-24 19:21:32,923][177154] DAMAGECOUNT value on done: 376949.0 [2023-02-24 19:21:32,924][177154] Sum rewards: 21.228, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.279', 'AMMO2': '0.018', 'AMMO5': '0.025', 'AMMO4': '0.088', 'AMMO3': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.384', 'weapon5': '0.388', 'ARMOR': '0.404', 'weapon2': '0.434', 'WEAPON5': '0.650', 'WEAPON3': '0.850', 'HITCOUNT': '1.410', 'weapon3': '2.268', 'DAMAGECOUNT': '6.258', 'FRAGCOUNT': '18.000'} [2023-02-24 19:21:33,071][177172] DAMAGECOUNT value on done: 365743.0 [2023-02-24 19:21:33,071][177172] Sum rewards: 24.178, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.011', 'AMMO2': '0.019', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'HEALTH': '0.164', 'weapon4': '0.188', 'WEAPON5': '0.300', 'weapon5': '0.424', 'WEAPON3': '0.650', 'weapon2': '0.996', 'HITCOUNT': '1.500', 'weapon3': '2.082', 'DAMAGECOUNT': '6.042', 'FRAGCOUNT': '19.000'} [2023-02-24 19:21:33,215][177154] DAMAGECOUNT value on done: 372996.0 [2023-02-24 19:21:33,216][177154] Sum rewards: 23.472, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.901', 'AMMO5': '0.014', 'AMMO2': '0.023', 'AMMO3': '0.096', 'AMMO4': '0.116', 'WEAPON4': '0.250', 'weapon4': '0.388', 'WEAPON5': '0.400', 'weapon5': '0.406', 'WEAPON3': '0.650', 'weapon2': '0.828', 'HITCOUNT': '1.680', 'weapon3': '1.836', 'DAMAGECOUNT': '6.435', 'FRAGCOUNT': '18.000'} [2023-02-24 19:21:33,287][177157] DAMAGECOUNT value on done: 375036.0 [2023-02-24 19:21:33,288][177157] Sum rewards: 24.535, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.714', 'AMMO5': '0.029', 'AMMO2': '0.031', 'AMMO4': '0.155', 'AMMO3': '0.179', 'weapon4': '0.192', 'weapon5': '0.386', 'WEAPON4': '0.400', 'WEAPON5': '0.650', 'weapon2': '0.796', 'WEAPON3': '1.150', 'HITCOUNT': '1.710', 'weapon3': '2.274', 'DAMAGECOUNT': '8.046', 'FRAGCOUNT': '24.000'} [2023-02-24 19:21:33,406][177157] DAMAGECOUNT value on done: 358402.0 [2023-02-24 19:21:33,406][177157] Sum rewards: 19.221, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.064', 'AMMO5': '0.016', 'AMMO2': '0.032', 'AMMO3': '0.091', 'AMMO4': '0.157', 'WEAPON4': '0.350', 'weapon2': '0.436', 'WEAPON5': '0.450', 'weapon4': '0.480', 'weapon5': '0.486', 'WEAPON3': '0.600', 'HITCOUNT': '1.420', 'weapon3': '1.942', 'DAMAGECOUNT': '6.324', 'FRAGCOUNT': '15.000'} [2023-02-24 19:21:33,590][177157] DAMAGECOUNT value on done: 358159.0 [2023-02-24 19:21:33,590][177157] Sum rewards: 21.996, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.260', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO5': '0.019', 'AMMO3': '0.074', 'WEAPON4': '0.200', 'weapon4': '0.274', 'weapon5': '0.290', 'WEAPON5': '0.550', 'WEAPON3': '0.550', 'weapon2': '0.960', 'HITCOUNT': '1.280', 'weapon3': '1.458', 'DAMAGECOUNT': '6.081', 'FRAGCOUNT': '16.000'} [2023-02-24 19:21:33,715][177157] DAMAGECOUNT value on done: 361172.0 [2023-02-24 19:21:33,716][177157] Sum rewards: 16.657, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.586', 'AMMO2': '0.010', 'AMMO5': '0.020', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'AMMO3': '0.134', 'weapon4': '0.146', 'weapon2': '0.336', 'WEAPON5': '0.500', 'weapon5': '0.556', 'WEAPON3': '0.850', 'HITCOUNT': '1.190', 'weapon3': '2.536', 'DAMAGECOUNT': '4.866', 'FRAGCOUNT': '15.000'} [2023-02-24 19:21:33,765][177171] DAMAGECOUNT value on done: 359410.0 [2023-02-24 19:21:33,765][177171] Sum rewards: 16.377, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.766', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO5': '0.031', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'weapon4': '0.128', 'AMMO3': '0.143', 'weapon5': '0.408', 'WEAPON5': '0.700', 'weapon2': '0.740', 'WEAPON3': '0.850', 'HITCOUNT': '1.280', 'weapon3': '2.166', 'DAMAGECOUNT': '4.797', 'FRAGCOUNT': '14.000'} [2023-02-24 19:21:33,776][177171] DAMAGECOUNT value on done: 361373.0 [2023-02-24 19:21:33,777][177171] Sum rewards: 21.161, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.375', 'AMMO4': '-0.064', 'AMMO2': '-0.013', 'AMMO5': '0.005', 'weapon7': '0.100', 'AMMO3': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.212', 'WEAPON3': '0.700', 'weapon2': '1.098', 'HITCOUNT': '1.340', 'weapon3': '1.506', 'DAMAGECOUNT': '4.656', 'FRAGCOUNT': '19.000'} [2023-02-24 19:21:34,093][177171] DAMAGECOUNT value on done: 358838.0 [2023-02-24 19:21:34,093][177171] Sum rewards: 16.461, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.011', 'AMMO5': '0.011', 'AMMO3': '0.050', 'AMMO4': '0.055', 'HEALTH': '0.218', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'weapon5': '0.420', 'HITCOUNT': '0.830', 'weapon2': '0.996', 'weapon3': '1.730', 'DAMAGECOUNT': '3.489', 'FRAGCOUNT': '11.000'} [2023-02-24 19:21:34,104][177171] DAMAGECOUNT value on done: 361187.0 [2023-02-24 19:21:34,105][177171] Sum rewards: 20.443, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.858', 'AMMO2': '0.004', 'AMMO5': '0.015', 'AMMO4': '0.019', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'weapon4': '0.318', 'weapon5': '0.390', 'WEAPON5': '0.450', 'weapon2': '0.532', 'WEAPON3': '0.700', 'HITCOUNT': '1.360', 'weapon3': '2.388', 'DAMAGECOUNT': '5.118', 'FRAGCOUNT': '18.000'} [2023-02-24 19:21:35,201][177153] Updated weights for policy 0, policy_version 24220 (0.0009) [2023-02-24 19:21:36,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 99221504. Throughput: 0: 3444.3. Samples: 24798926. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 19:21:36,376][177119] Avg episode reward: [(0, '21.754')] [2023-02-24 19:21:36,380][177140] Saving new best policy, reward=21.754! [2023-02-24 19:21:36,407][177155] DAMAGECOUNT value on done: 371828.0 [2023-02-24 19:21:36,407][177155] Sum rewards: 24.877, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.230', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO5': '0.017', 'weapon5': '0.132', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.514', 'weapon4': '0.520', 'WEAPON3': '1.000', 'HITCOUNT': '1.930', 'weapon3': '2.288', 'DAMAGECOUNT': '7.536', 'FRAGCOUNT': '20.500'} [2023-02-24 19:21:36,714][177155] DAMAGECOUNT value on done: 377006.0 [2023-02-24 19:21:36,714][177155] Sum rewards: 23.694, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.608', 'AMMO5': '0.010', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'AMMO3': '0.134', 'AMMO4': '0.137', 'WEAPON5': '0.200', 'weapon5': '0.242', 'WEAPON4': '0.250', 'ARMOR': '0.404', 'weapon4': '0.492', 'weapon2': '0.734', 'WEAPON3': '0.800', 'HITCOUNT': '1.880', 'weapon3': '2.134', 'DAMAGECOUNT': '6.828', 'FRAGCOUNT': '19.000'} [2023-02-24 19:21:37,013][177155] DAMAGECOUNT value on done: 372875.0 [2023-02-24 19:21:37,013][177155] Sum rewards: 13.709, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.636', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.027', 'AMMO3': '0.104', 'AMMO4': '0.133', 'weapon5': '0.276', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.636', 'weapon4': '0.658', 'WEAPON3': '0.750', 'HITCOUNT': '1.310', 'weapon3': '1.856', 'DAMAGECOUNT': '5.427', 'FRAGCOUNT': '13.000'} [2023-02-24 19:21:37,326][177155] DAMAGECOUNT value on done: 356926.0 [2023-02-24 19:21:37,327][177155] Sum rewards: 18.505, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.786', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'weapon4': '0.196', 'weapon5': '0.284', 'WEAPON5': '0.300', 'weapon2': '0.942', 'WEAPON3': '1.100', 'HITCOUNT': '1.640', 'weapon3': '2.184', 'DAMAGECOUNT': '6.186', 'FRAGCOUNT': '19.000'} [2023-02-24 19:21:38,175][177153] Updated weights for policy 0, policy_version 24230 (0.0008) [2023-02-24 19:21:41,114][177153] Updated weights for policy 0, policy_version 24240 (0.0008) [2023-02-24 19:21:41,376][177119] Fps is (10 sec: 13516.8, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 99287040. Throughput: 0: 3445.5. Samples: 24819676. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 19:21:41,376][177119] Avg episode reward: [(0, '21.722')] [2023-02-24 19:21:43,163][177170] DAMAGECOUNT value on done: 363676.0 [2023-02-24 19:21:43,163][177170] Sum rewards: 14.693, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.284', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.025', 'weapon7': '0.064', 'AMMO3': '0.065', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.125', 'weapon5': '0.126', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.774', 'weapon3': '1.188', 'weapon2': '1.204', 'HITCOUNT': '1.430', 'DAMAGECOUNT': '4.959', 'FRAGCOUNT': '11.000'} [2023-02-24 19:21:43,464][177170] DAMAGECOUNT value on done: 363763.0 [2023-02-24 19:21:43,465][177170] Sum rewards: 11.117, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.250', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.012', 'AMMO3': '0.050', 'WEAPON3': '0.350', 'WEAPON5': '0.400', 'HITCOUNT': '0.560', 'weapon5': '0.640', 'weapon2': '1.052', 'weapon3': '1.546', 'DAMAGECOUNT': '2.538', 'FRAGCOUNT': '8.000'} [2023-02-24 19:21:44,060][177153] Updated weights for policy 0, policy_version 24250 (0.0008) [2023-02-24 19:21:44,094][177170] DAMAGECOUNT value on done: 360374.0 [2023-02-24 19:21:44,095][177170] Sum rewards: 27.416, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.785', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO5': '0.020', 'weapon5': '0.160', 'AMMO3': '0.164', 'WEAPON5': '0.500', 'weapon2': '0.810', 'WEAPON3': '1.100', 'HITCOUNT': '1.650', 'weapon3': '2.716', 'DAMAGECOUNT': '7.386', 'FRAGCOUNT': '24.000'} [2023-02-24 19:21:44,406][177170] DAMAGECOUNT value on done: 364944.0 [2023-02-24 19:21:44,406][177170] Sum rewards: 19.485, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.554', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO5': '0.023', 'AMMO3': '0.163', 'weapon4': '0.198', 'WEAPON4': '0.200', 'weapon5': '0.268', 'WEAPON5': '0.600', 'weapon2': '0.724', 'WEAPON3': '1.050', 'HITCOUNT': '1.360', 'weapon3': '2.214', 'DAMAGECOUNT': '5.715', 'FRAGCOUNT': '20.000'} [2023-02-24 19:21:45,638][177156] DAMAGECOUNT value on done: 366728.0 [2023-02-24 19:21:45,638][177156] Sum rewards: 13.706, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'AMMO2': '0.023', 'AMMO3': '0.050', 'weapon5': '0.054', 'weapon7': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'weapon2': '0.178', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON3': '0.300', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'HEALTH': '0.335', 'weapon4': '0.522', 'weapon3': '0.764', 'HITCOUNT': '0.950', 'DAMAGECOUNT': '3.549', 'FRAGCOUNT': '10.000'} [2023-02-24 19:21:45,797][177156] DAMAGECOUNT value on done: 354921.0 [2023-02-24 19:21:45,798][177156] Sum rewards: 19.639, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.122', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'weapon7': '0.054', 'AMMO3': '0.066', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.176', 'WEAPON7': '0.200', 'weapon4': '0.268', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'weapon2': '1.016', 'HITCOUNT': '1.190', 'weapon3': '1.596', 'DAMAGECOUNT': '4.548', 'FRAGCOUNT': '14.000'} [2023-02-24 19:21:45,931][177158] DAMAGECOUNT value on done: 350689.0 [2023-02-24 19:21:45,931][177158] Sum rewards: 18.494, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.371', 'AMMO2': '0.012', 'AMMO5': '0.021', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'weapon4': '0.286', 'weapon5': '0.444', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'weapon2': '0.802', 'HITCOUNT': '1.380', 'weapon3': '2.038', 'DAMAGECOUNT': '5.799', 'FRAGCOUNT': '15.000'} [2023-02-24 19:21:45,952][177156] DAMAGECOUNT value on done: 374029.0 [2023-02-24 19:21:45,953][177156] Sum rewards: 22.632, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.499', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.020', 'AMMO3': '0.108', 'WEAPON5': '0.350', 'weapon5': '0.402', 'WEAPON3': '0.750', 'weapon2': '0.828', 'HITCOUNT': '1.520', 'weapon3': '2.350', 'DAMAGECOUNT': '5.574', 'FRAGCOUNT': '18.000'} [2023-02-24 19:21:46,122][177156] DAMAGECOUNT value on done: 360453.0 [2023-02-24 19:21:46,123][177156] Sum rewards: 25.794, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.499', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'weapon4': '0.302', 'weapon5': '0.322', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon2': '1.106', 'weapon3': '1.892', 'HITCOUNT': '1.970', 'DAMAGECOUNT': '7.275', 'FRAGCOUNT': '22.500'} [2023-02-24 19:21:46,247][177158] DAMAGECOUNT value on done: 359430.0 [2023-02-24 19:21:46,247][177158] Sum rewards: 14.920, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.562', 'AMMO2': '0.019', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'weapon4': '0.316', 'weapon5': '0.372', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'HITCOUNT': '1.130', 'weapon2': '1.168', 'weapon3': '1.682', 'DAMAGECOUNT': '4.722', 'FRAGCOUNT': '12.000'} [2023-02-24 19:21:46,376][177119] Fps is (10 sec: 13516.6, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 99356672. Throughput: 0: 3448.6. Samples: 24840370. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 19:21:46,376][177119] Avg episode reward: [(0, '21.402')] [2023-02-24 19:21:46,613][177158] DAMAGECOUNT value on done: 364459.0 [2023-02-24 19:21:46,613][177158] Sum rewards: 15.414, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.849', 'AMMO5': '0.025', 'AMMO2': '0.042', 'weapon7': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.132', 'AMMO4': '0.209', 'weapon5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.584', 'WEAPON5': '0.600', 'weapon4': '0.652', 'WEAPON3': '0.800', 'HITCOUNT': '1.230', 'weapon3': '1.826', 'DAMAGECOUNT': '5.247', 'FRAGCOUNT': '16.000'} [2023-02-24 19:21:46,912][177158] DAMAGECOUNT value on done: 367662.0 [2023-02-24 19:21:46,912][177158] Sum rewards: 16.170, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.356', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.025', 'AMMO3': '0.078', 'WEAPON4': '0.200', 'weapon4': '0.220', 'weapon5': '0.344', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon2': '0.912', 'HITCOUNT': '1.150', 'weapon3': '1.682', 'DAMAGECOUNT': '5.070', 'FRAGCOUNT': '12.000'} [2023-02-24 19:21:47,037][177153] Updated weights for policy 0, policy_version 24260 (0.0008) [2023-02-24 19:21:49,983][177153] Updated weights for policy 0, policy_version 24270 (0.0008) [2023-02-24 19:21:50,456][177172] DAMAGECOUNT value on done: 361176.0 [2023-02-24 19:21:50,457][177172] Sum rewards: 27.124, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.245', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.010', 'weapon5': '0.082', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.126', 'AMMO3': '0.129', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.264', 'WEAPON3': '0.750', 'weapon2': '1.092', 'HITCOUNT': '1.730', 'weapon3': '1.810', 'DAMAGECOUNT': '6.837', 'FRAGCOUNT': '23.000'} [2023-02-24 19:21:50,763][177172] DAMAGECOUNT value on done: 362257.0 [2023-02-24 19:21:50,764][177172] Sum rewards: 30.000, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.071', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'AMMO3': '0.116', 'AMMO4': '0.160', 'weapon5': '0.294', 'weapon4': '0.328', 'WEAPON4': '0.350', 'weapon2': '0.402', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'HITCOUNT': '1.940', 'weapon3': '2.168', 'DAMAGECOUNT': '8.091', 'FRAGCOUNT': '25.000'} [2023-02-24 19:21:51,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 99426304. Throughput: 0: 3450.1. Samples: 24850788. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 19:21:51,376][177119] Avg episode reward: [(0, '21.352')] [2023-02-24 19:21:51,755][177154] DAMAGECOUNT value on done: 363111.0 [2023-02-24 19:21:51,756][177154] Sum rewards: 7.948, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO2': '0.005', 'AMMO5': '0.007', 'HEALTH': '0.014', 'AMMO4': '0.025', 'AMMO3': '0.035', 'WEAPON4': '0.100', 'weapon7': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON3': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.246', 'weapon4': '0.254', 'HITCOUNT': '0.410', 'weapon2': '0.510', 'weapon3': '0.876', 'DAMAGECOUNT': '2.265', 'FRAGCOUNT': '4.500'} [2023-02-24 19:21:52,042][177154] DAMAGECOUNT value on done: 374138.0 [2023-02-24 19:21:52,042][177154] Sum rewards: 27.440, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.980', 'AMMO2': '0.013', 'AMMO5': '0.017', 'weapon4': '0.026', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.167', 'weapon5': '0.238', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'weapon2': '1.098', 'HITCOUNT': '2.150', 'weapon3': '2.348', 'DAMAGECOUNT': '8.598', 'FRAGCOUNT': '23.000'} [2023-02-24 19:21:52,257][177172] DAMAGECOUNT value on done: 372460.0 [2023-02-24 19:21:52,258][177172] Sum rewards: 18.619, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.764', 'ARMOR': '0.020', 'AMMO5': '0.024', 'AMMO2': '0.025', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.124', 'AMMO4': '0.125', 'weapon5': '0.206', 'WEAPON4': '0.250', 'weapon4': '0.336', 'WEAPON5': '0.550', 'weapon2': '0.720', 'WEAPON3': '0.800', 'HITCOUNT': '1.670', 'weapon3': '2.220', 'DAMAGECOUNT': '5.715', 'FRAGCOUNT': '16.000'} [2023-02-24 19:21:52,322][177154] DAMAGECOUNT value on done: 378737.0 [2023-02-24 19:21:52,323][177154] Sum rewards: 15.074, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.782', 'AMMO2': '0.012', 'AMMO5': '0.015', 'weapon7': '0.052', 'AMMO4': '0.060', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.232', 'WEAPON4': '0.300', 'weapon4': '0.368', 'weapon2': '0.370', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '1.300', 'weapon3': '2.140', 'DAMAGECOUNT': '5.364', 'FRAGCOUNT': '13.000'} [2023-02-24 19:21:52,564][177172] DAMAGECOUNT value on done: 367949.0 [2023-02-24 19:21:52,564][177172] Sum rewards: 30.055, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.190', 'AMMO2': '0.001', 'ARMOR': '0.004', 'AMMO4': '0.005', 'AMMO5': '0.007', 'weapon7': '0.024', 'AMMO3': '0.051', 'weapon5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'weapon4': '0.544', 'weapon2': '0.746', 'weapon3': '1.434', 'HITCOUNT': '1.610', 'DAMAGECOUNT': '6.618', 'FRAGCOUNT': '23.000'} [2023-02-24 19:21:52,625][177154] DAMAGECOUNT value on done: 374841.0 [2023-02-24 19:21:52,626][177154] Sum rewards: 19.693, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.811', 'AMMO5': '0.015', 'ARMOR': '0.024', 'AMMO2': '0.032', 'AMMO3': '0.127', 'weapon7': '0.138', 'AMMO4': '0.159', 'weapon5': '0.212', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.488', 'weapon4': '0.510', 'WEAPON3': '0.750', 'HITCOUNT': '1.560', 'weapon3': '2.214', 'DAMAGECOUNT': '5.535', 'FRAGCOUNT': '17.000'} [2023-02-24 19:21:52,799][177157] DAMAGECOUNT value on done: 376955.0 [2023-02-24 19:21:52,799][177157] Sum rewards: 18.174, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.080', 'ARMOR': '0.004', 'AMMO5': '0.030', 'AMMO2': '0.064', 'AMMO3': '0.119', 'weapon4': '0.160', 'AMMO4': '0.320', 'WEAPON4': '0.450', 'weapon5': '0.528', 'WEAPON3': '0.650', 'WEAPON5': '0.800', 'weapon2': '0.928', 'HITCOUNT': '1.140', 'weapon3': '1.616', 'DAMAGECOUNT': '5.445', 'FRAGCOUNT': '18.000'} [2023-02-24 19:21:52,907][177157] DAMAGECOUNT value on done: 360703.0 [2023-02-24 19:21:52,907][177157] Sum rewards: 25.258, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.110', 'AMMO2': '0.015', 'AMMO5': '0.028', 'AMMO4': '0.074', 'weapon4': '0.114', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'weapon5': '0.286', 'WEAPON5': '0.650', 'WEAPON3': '0.800', 'weapon2': '0.850', 'HITCOUNT': '1.620', 'weapon3': '2.452', 'DAMAGECOUNT': '6.903', 'FRAGCOUNT': '21.000'} [2023-02-24 19:21:52,973][177153] Updated weights for policy 0, policy_version 24280 (0.0008) [2023-02-24 19:21:53,105][177157] DAMAGECOUNT value on done: 360509.0 [2023-02-24 19:21:53,105][177157] Sum rewards: 22.345, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.876', 'AMMO2': '0.004', 'AMMO5': '0.017', 'AMMO4': '0.018', 'AMMO3': '0.163', 'weapon5': '0.252', 'WEAPON5': '0.350', 'weapon2': '0.814', 'WEAPON3': '0.950', 'HITCOUNT': '1.670', 'weapon3': '2.432', 'DAMAGECOUNT': '7.050', 'FRAGCOUNT': '18.500'} [2023-02-24 19:21:53,211][177157] DAMAGECOUNT value on done: 362783.0 [2023-02-24 19:21:53,211][177157] Sum rewards: 17.159, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.410', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon7': '0.058', 'weapon5': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.151', 'AMMO3': '0.156', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.390', 'weapon2': '0.592', 'WEAPON3': '0.900', 'HITCOUNT': '1.060', 'weapon3': '1.450', 'DAMAGECOUNT': '4.833', 'FRAGCOUNT': '17.000'} [2023-02-24 19:21:53,268][177171] DAMAGECOUNT value on done: 361294.0 [2023-02-24 19:21:53,268][177171] Sum rewards: 22.769, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.080', 'AMMO2': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'weapon4': '0.068', 'AMMO3': '0.076', 'weapon5': '0.168', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'HITCOUNT': '1.560', 'weapon3': '1.646', 'weapon2': '1.726', 'DAMAGECOUNT': '5.652', 'FRAGCOUNT': '18.000'} [2023-02-24 19:21:53,279][177171] DAMAGECOUNT value on done: 364011.0 [2023-02-24 19:21:53,280][177171] Sum rewards: 31.049, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.156', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.041', 'weapon5': '0.094', 'AMMO3': '0.124', 'AMMO4': '0.204', 'weapon2': '0.356', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.788', 'WEAPON3': '0.900', 'HITCOUNT': '2.170', 'weapon3': '2.336', 'DAMAGECOUNT': '7.914', 'FRAGCOUNT': '27.000'} [2023-02-24 19:21:53,575][177171] DAMAGECOUNT value on done: 360921.0 [2023-02-24 19:21:53,575][177171] Sum rewards: 24.608, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.630', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO3': '0.095', 'AMMO4': '0.117', 'WEAPON4': '0.200', 'weapon5': '0.226', 'WEAPON5': '0.250', 'weapon4': '0.256', 'WEAPON3': '0.600', 'weapon2': '1.108', 'HITCOUNT': '1.510', 'weapon3': '2.092', 'DAMAGECOUNT': '6.249', 'FRAGCOUNT': '20.000'} [2023-02-24 19:21:53,587][177171] DAMAGECOUNT value on done: 363941.0 [2023-02-24 19:21:53,587][177171] Sum rewards: 27.478, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.446', 'AMMO2': '0.013', 'AMMO5': '0.025', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'weapon4': '0.148', 'AMMO3': '0.160', 'weapon2': '0.268', 'weapon5': '0.376', 'WEAPON5': '0.550', 'WEAPON3': '0.950', 'HITCOUNT': '1.810', 'weapon3': '2.748', 'DAMAGECOUNT': '8.262', 'FRAGCOUNT': '23.000'} [2023-02-24 19:21:55,881][177155] DAMAGECOUNT value on done: 374318.0 [2023-02-24 19:21:55,882][177155] Sum rewards: 25.431, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.012', 'AMMO2': '0.003', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO4': '0.015', 'weapon7': '0.050', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.288', 'WEAPON3': '0.800', 'weapon2': '0.880', 'HITCOUNT': '1.630', 'weapon3': '1.764', 'DAMAGECOUNT': '7.470', 'FRAGCOUNT': '20.000'} [2023-02-24 19:21:55,932][177153] Updated weights for policy 0, policy_version 24290 (0.0008) [2023-02-24 19:21:56,187][177155] DAMAGECOUNT value on done: 379127.0 [2023-02-24 19:21:56,188][177155] Sum rewards: 24.943, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.508', 'AMMO5': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.085', 'AMMO4': '0.131', 'weapon5': '0.328', 'WEAPON4': '0.400', 'weapon4': '0.450', 'WEAPON3': '0.600', 'WEAPON5': '0.600', 'weapon2': '0.938', 'HITCOUNT': '1.560', 'weapon3': '1.700', 'DAMAGECOUNT': '6.363', 'FRAGCOUNT': '20.000'} [2023-02-24 19:21:56,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 99495936. Throughput: 0: 3447.5. Samples: 24871440. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 19:21:56,376][177119] Avg episode reward: [(0, '21.562')] [2023-02-24 19:21:56,482][177155] DAMAGECOUNT value on done: 374862.0 [2023-02-24 19:21:56,483][177155] Sum rewards: 23.098, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.680', 'AMMO2': '0.018', 'AMMO5': '0.025', 'WEAPON4': '0.050', 'AMMO4': '0.088', 'AMMO3': '0.118', 'weapon5': '0.242', 'weapon4': '0.288', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'weapon2': '0.958', 'HITCOUNT': '1.500', 'weapon3': '1.930', 'DAMAGECOUNT': '5.961', 'FRAGCOUNT': '18.000'} [2023-02-24 19:21:56,774][177155] DAMAGECOUNT value on done: 358168.0 [2023-02-24 19:21:56,775][177155] Sum rewards: 9.950, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.560', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.041', 'AMMO3': '0.087', 'weapon5': '0.108', 'weapon7': '0.110', 'WEAPON5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.532', 'WEAPON3': '0.600', 'weapon2': '0.814', 'HITCOUNT': '0.960', 'weapon3': '1.328', 'DAMAGECOUNT': '3.726', 'FRAGCOUNT': '8.000'} [2023-02-24 19:21:58,898][177153] Updated weights for policy 0, policy_version 24300 (0.0008) [2023-02-24 19:22:01,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13829.2). Total num frames: 99565568. Throughput: 0: 3447.0. Samples: 24892172. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 19:22:01,376][177119] Avg episode reward: [(0, '21.417')] [2023-02-24 19:22:01,856][177153] Updated weights for policy 0, policy_version 24310 (0.0008) [2023-02-24 19:22:02,630][177170] DAMAGECOUNT value on done: 365436.0 [2023-02-24 19:22:02,631][177170] Sum rewards: 16.161, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.300', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.043', 'AMMO3': '0.112', 'AMMO4': '0.215', 'weapon5': '0.238', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.614', 'weapon2': '0.734', 'WEAPON3': '0.750', 'HITCOUNT': '1.390', 'weapon3': '1.956', 'DAMAGECOUNT': '5.280', 'FRAGCOUNT': '18.000'} [2023-02-24 19:22:02,943][177170] DAMAGECOUNT value on done: 366211.0 [2023-02-24 19:22:02,943][177170] Sum rewards: 26.157, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.480', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.017', 'AMMO3': '0.134', 'weapon5': '0.366', 'WEAPON5': '0.450', 'weapon2': '0.844', 'WEAPON3': '0.900', 'HITCOUNT': '1.640', 'weapon3': '2.194', 'DAMAGECOUNT': '7.344', 'FRAGCOUNT': '22.000'} [2023-02-24 19:22:03,573][177170] DAMAGECOUNT value on done: 362598.0 [2023-02-24 19:22:03,574][177170] Sum rewards: 21.433, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.991', 'AMMO2': '0.010', 'AMMO5': '0.025', 'AMMO4': '0.049', 'AMMO3': '0.122', 'WEAPON4': '0.300', 'weapon5': '0.362', 'weapon4': '0.568', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'weapon2': '0.854', 'HITCOUNT': '1.380', 'weapon3': '1.732', 'DAMAGECOUNT': '6.672', 'FRAGCOUNT': '16.500'} [2023-02-24 19:22:03,870][177170] DAMAGECOUNT value on done: 366422.0 [2023-02-24 19:22:03,871][177170] Sum rewards: 18.008, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.240', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.029', 'weapon7': '0.050', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.186', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.256', 'WEAPON3': '0.550', 'HITCOUNT': '1.000', 'weapon2': '1.270', 'weapon3': '1.582', 'DAMAGECOUNT': '4.434', 'FRAGCOUNT': '14.000'} [2023-02-24 19:22:04,848][177153] Updated weights for policy 0, policy_version 24320 (0.0008) [2023-02-24 19:22:05,146][177156] DAMAGECOUNT value on done: 369571.0 [2023-02-24 19:22:05,146][177156] Sum rewards: 27.083, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.807', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.026', 'AMMO4': '0.132', 'AMMO3': '0.178', 'weapon5': '0.308', 'WEAPON4': '0.400', 'weapon2': '0.420', 'weapon4': '0.574', 'WEAPON5': '0.650', 'WEAPON3': '1.150', 'weapon3': '1.846', 'HITCOUNT': '1.900', 'DAMAGECOUNT': '8.529', 'FRAGCOUNT': '25.000'} [2023-02-24 19:22:05,310][177156] DAMAGECOUNT value on done: 356394.0 [2023-02-24 19:22:05,311][177156] Sum rewards: 16.998, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.352', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO3': '0.080', 'AMMO4': '0.188', 'WEAPON4': '0.300', 'weapon4': '0.334', 'weapon5': '0.348', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.940', 'weapon3': '1.024', 'weapon2': '1.054', 'DAMAGECOUNT': '4.419', 'FRAGCOUNT': '13.000'} [2023-02-24 19:22:05,401][177158] DAMAGECOUNT value on done: 351744.0 [2023-02-24 19:22:05,401][177158] Sum rewards: 8.262, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.820', 'AMMO5': '0.015', 'AMMO2': '0.022', 'AMMO3': '0.065', 'weapon5': '0.068', 'weapon7': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.110', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '0.450', 'weapon4': '0.776', 'weapon2': '0.818', 'HITCOUNT': '0.870', 'weapon3': '1.104', 'DAMAGECOUNT': '3.165', 'FRAGCOUNT': '9.000'} [2023-02-24 19:22:05,460][177156] DAMAGECOUNT value on done: 376408.0 [2023-02-24 19:22:05,460][177156] Sum rewards: 22.689, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.236', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO5': '0.022', 'AMMO4': '0.090', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.138', 'WEAPON4': '0.200', 'weapon5': '0.258', 'weapon4': '0.282', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'weapon2': '1.250', 'HITCOUNT': '1.680', 'weapon3': '1.736', 'DAMAGECOUNT': '7.137', 'FRAGCOUNT': '20.000'} [2023-02-24 19:22:05,619][177156] DAMAGECOUNT value on done: 361799.0 [2023-02-24 19:22:05,620][177156] Sum rewards: 10.948, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.107', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.032', 'AMMO3': '0.093', 'AMMO4': '0.158', 'weapon4': '0.318', 'WEAPON4': '0.350', 'weapon5': '0.374', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon2': '0.914', 'HITCOUNT': '1.060', 'weapon3': '1.892', 'DAMAGECOUNT': '4.038', 'FRAGCOUNT': '10.000'} [2023-02-24 19:22:05,701][177158] DAMAGECOUNT value on done: 361496.0 [2023-02-24 19:22:05,701][177158] Sum rewards: 19.948, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.507', 'ARMOR': '0.012', 'AMMO2': '0.027', 'AMMO5': '0.031', 'AMMO3': '0.133', 'AMMO4': '0.134', 'WEAPON4': '0.300', 'weapon5': '0.372', 'weapon4': '0.550', 'weapon2': '0.594', 'WEAPON5': '0.700', 'WEAPON3': '0.800', 'HITCOUNT': '1.490', 'weapon3': '1.864', 'DAMAGECOUNT': '6.198', 'FRAGCOUNT': '18.000'} [2023-02-24 19:22:06,078][177158] DAMAGECOUNT value on done: 366393.0 [2023-02-24 19:22:06,078][177158] Sum rewards: 19.768, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.398', 'AMMO2': '0.027', 'AMMO5': '0.027', 'AMMO4': '0.132', 'AMMO3': '0.142', 'weapon4': '0.190', 'WEAPON4': '0.300', 'weapon5': '0.542', 'weapon2': '0.572', 'WEAPON5': '0.650', 'WEAPON3': '0.900', 'HITCOUNT': '1.370', 'weapon3': '2.262', 'DAMAGECOUNT': '5.802', 'FRAGCOUNT': '18.000'} [2023-02-24 19:22:06,376][177119] Fps is (10 sec: 13926.4, 60 sec: 13858.2, 300 sec: 13829.2). Total num frames: 99635200. Throughput: 0: 3447.4. Samples: 24902526. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 19:22:06,376][177119] Avg episode reward: [(0, '20.924')] [2023-02-24 19:22:06,382][177158] DAMAGECOUNT value on done: 369616.0 [2023-02-24 19:22:06,383][177158] Sum rewards: 21.737, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.004', 'AMMO2': '0.000', 'AMMO4': '0.001', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO3': '0.098', 'weapon4': '0.126', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.216', 'WEAPON5': '0.250', 'WEAPON3': '0.700', 'weapon2': '1.038', 'HITCOUNT': '1.320', 'weapon3': '1.866', 'DAMAGECOUNT': '5.862', 'FRAGCOUNT': '18.000'} [2023-02-24 19:22:07,819][177153] Updated weights for policy 0, policy_version 24330 (0.0009) [2023-02-24 19:22:09,959][177172] DAMAGECOUNT value on done: 363212.0 [2023-02-24 19:22:09,959][177172] Sum rewards: 26.478, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.630', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.027', 'AMMO3': '0.153', 'weapon5': '0.318', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'weapon2': '0.938', 'HITCOUNT': '1.270', 'weapon3': '2.314', 'DAMAGECOUNT': '6.108', 'FRAGCOUNT': '23.000'} [2023-02-24 19:22:10,261][177172] DAMAGECOUNT value on done: 364096.0 [2023-02-24 19:22:10,262][177172] Sum rewards: 21.291, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.505', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.020', 'weapon7': '0.052', 'AMMO3': '0.094', 'AMMO4': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon5': '0.360', 'WEAPON5': '0.450', 'weapon4': '0.532', 'WEAPON3': '0.650', 'weapon2': '0.914', 'HITCOUNT': '1.330', 'weapon3': '1.722', 'DAMAGECOUNT': '5.517', 'FRAGCOUNT': '17.000'} [2023-02-24 19:22:10,785][177153] Updated weights for policy 0, policy_version 24340 (0.0008) [2023-02-24 19:22:11,210][177154] DAMAGECOUNT value on done: 365088.0 [2023-02-24 19:22:11,210][177154] Sum rewards: 17.085, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.164', 'AMMO5': '0.022', 'AMMO2': '0.039', 'AMMO3': '0.108', 'AMMO4': '0.193', 'weapon5': '0.306', 'WEAPON4': '0.450', 'WEAPON5': '0.650', 'weapon2': '0.712', 'WEAPON3': '0.750', 'weapon4': '0.932', 'weapon3': '1.356', 'HITCOUNT': '1.550', 'DAMAGECOUNT': '5.931', 'FRAGCOUNT': '15.000'} [2023-02-24 19:22:11,376][177119] Fps is (10 sec: 13926.6, 60 sec: 13858.2, 300 sec: 13829.2). Total num frames: 99704832. Throughput: 0: 3449.4. Samples: 24923248. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 19:22:11,376][177119] Avg episode reward: [(0, '20.992')] [2023-02-24 19:22:11,520][177154] DAMAGECOUNT value on done: 375893.0 [2023-02-24 19:22:11,520][177154] Sum rewards: 19.374, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.643', 'AMMO2': '0.013', 'AMMO5': '0.017', 'AMMO4': '0.067', 'AMMO3': '0.126', 'weapon4': '0.218', 'weapon5': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'weapon2': '0.860', 'WEAPON3': '0.900', 'HITCOUNT': '1.400', 'weapon3': '2.230', 'DAMAGECOUNT': '5.265', 'FRAGCOUNT': '18.000'} [2023-02-24 19:22:11,744][177172] DAMAGECOUNT value on done: 374318.0 [2023-02-24 19:22:11,744][177172] Sum rewards: 14.622, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.040', 'AMMO5': '0.023', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.154', 'weapon5': '0.438', 'weapon2': '0.456', 'WEAPON4': '0.500', 'weapon4': '0.598', 'WEAPON5': '0.650', 'WEAPON3': '1.100', 'HITCOUNT': '1.200', 'weapon3': '2.070', 'DAMAGECOUNT': '5.574', 'FRAGCOUNT': '16.000'} [2023-02-24 19:22:11,820][177154] DAMAGECOUNT value on done: 381549.0 [2023-02-24 19:22:11,821][177154] Sum rewards: 29.193, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.386', 'AMMO2': '0.019', 'AMMO5': '0.020', 'weapon4': '0.048', 'AMMO4': '0.095', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'weapon5': '0.332', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'weapon2': '0.854', 'HITCOUNT': '1.690', 'weapon3': '2.158', 'DAMAGECOUNT': '8.436', 'FRAGCOUNT': '25.000'} [2023-02-24 19:22:12,040][177172] DAMAGECOUNT value on done: 370614.0 [2023-02-24 19:22:12,041][177172] Sum rewards: 27.082, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.266', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.040', 'AMMO3': '0.122', 'AMMO4': '0.200', 'weapon5': '0.400', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.594', 'WEAPON3': '0.800', 'weapon2': '0.830', 'weapon3': '1.720', 'HITCOUNT': '1.860', 'DAMAGECOUNT': '7.995', 'FRAGCOUNT': '24.000'} [2023-02-24 19:22:12,130][177154] DAMAGECOUNT value on done: 376817.0 [2023-02-24 19:22:12,130][177154] Sum rewards: 25.322, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.942', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO5': '0.027', 'AMMO2': '0.040', 'AMMO3': '0.114', 'AMMO4': '0.197', 'weapon4': '0.366', 'weapon5': '0.384', 'WEAPON4': '0.400', 'weapon2': '0.544', 'WEAPON5': '0.650', 'WEAPON3': '0.700', 'HITCOUNT': '1.460', 'weapon3': '2.182', 'DAMAGECOUNT': '5.928', 'FRAGCOUNT': '23.000'} [2023-02-24 19:22:12,204][177157] DAMAGECOUNT value on done: 378856.0 [2023-02-24 19:22:12,205][177157] Sum rewards: 19.694, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.788', 'AMMO2': '0.012', 'AMMO5': '0.015', 'AMMO4': '0.059', 'AMMO3': '0.105', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.278', 'WEAPON4': '0.300', 'weapon5': '0.380', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'weapon2': '0.860', 'HITCOUNT': '1.250', 'weapon3': '1.920', 'DAMAGECOUNT': '5.703', 'FRAGCOUNT': '17.000'} [2023-02-24 19:22:12,331][177157] DAMAGECOUNT value on done: 362060.0 [2023-02-24 19:22:12,331][177157] Sum rewards: 12.499, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.955', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'weapon4': '0.038', 'AMMO4': '0.050', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'weapon5': '0.412', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon2': '0.974', 'HITCOUNT': '1.050', 'weapon3': '2.068', 'DAMAGECOUNT': '4.071', 'FRAGCOUNT': '9.500'} [2023-02-24 19:22:12,513][177157] DAMAGECOUNT value on done: 361944.0 [2023-02-24 19:22:12,515][177157] Sum rewards: 14.692, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.415', 'ARMOR': '0.008', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.061', 'AMMO3': '0.064', 'weapon5': '0.136', 'weapon2': '0.308', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.528', 'WEAPON3': '0.550', 'HITCOUNT': '0.910', 'weapon3': '1.492', 'DAMAGECOUNT': '4.305', 'FRAGCOUNT': '13.000'} [2023-02-24 19:22:12,635][177157] DAMAGECOUNT value on done: 364219.0 [2023-02-24 19:22:12,635][177157] Sum rewards: 13.003, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.650', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon7': '0.058', 'AMMO3': '0.077', 'AMMO4': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.162', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.642', 'HITCOUNT': '1.120', 'weapon2': '1.168', 'weapon3': '1.344', 'DAMAGECOUNT': '4.308', 'FRAGCOUNT': '12.000'} [2023-02-24 19:22:12,691][177171] DAMAGECOUNT value on done: 364193.0 [2023-02-24 19:22:12,692][177171] Sum rewards: 31.259, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.607', 'AMMO2': '0.007', 'AMMO5': '0.015', 'AMMO4': '0.037', 'WEAPON4': '0.100', 'AMMO3': '0.139', 'weapon4': '0.150', 'weapon5': '0.192', 'WEAPON5': '0.300', 'weapon2': '0.880', 'WEAPON3': '1.000', 'HITCOUNT': '2.090', 'weapon3': '2.508', 'DAMAGECOUNT': '8.697', 'FRAGCOUNT': '25.000'} [2023-02-24 19:22:12,703][177171] DAMAGECOUNT value on done: 366049.0 [2023-02-24 19:22:12,703][177171] Sum rewards: 22.770, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.285', 'AMMO2': '0.015', 'AMMO5': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.084', 'weapon4': '0.194', 'WEAPON4': '0.200', 'weapon5': '0.354', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon2': '0.848', 'HITCOUNT': '1.330', 'weapon3': '1.826', 'DAMAGECOUNT': '6.114', 'FRAGCOUNT': '17.000'} [2023-02-24 19:22:12,996][177171] DAMAGECOUNT value on done: 362383.0 [2023-02-24 19:22:12,996][177171] Sum rewards: 19.233, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.524', 'ARMOR': '0.004', 'AMMO5': '0.012', 'weapon7': '0.014', 'AMMO2': '0.037', 'AMMO3': '0.064', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.187', 'WEAPON4': '0.250', 'weapon5': '0.308', 'WEAPON5': '0.350', 'weapon4': '0.406', 'WEAPON3': '0.500', 'HITCOUNT': '1.100', 'weapon2': '1.106', 'weapon3': '1.482', 'DAMAGECOUNT': '4.386', 'FRAGCOUNT': '16.000'} [2023-02-24 19:22:13,007][177171] DAMAGECOUNT value on done: 366649.0 [2023-02-24 19:22:13,008][177171] Sum rewards: 21.569, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.666', 'ARMOR': '0.004', 'AMMO2': '0.018', 'AMMO5': '0.020', 'weapon7': '0.062', 'AMMO4': '0.090', 'AMMO3': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.280', 'WEAPON5': '0.500', 'weapon4': '0.568', 'weapon2': '0.586', 'WEAPON3': '0.750', 'HITCOUNT': '1.390', 'weapon3': '1.692', 'DAMAGECOUNT': '6.519', 'FRAGCOUNT': '18.000'} [2023-02-24 19:22:13,748][177153] Updated weights for policy 0, policy_version 24350 (0.0008) [2023-02-24 19:22:15,361][177155] DAMAGECOUNT value on done: 375638.0 [2023-02-24 19:22:15,361][177155] Sum rewards: 9.182, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.662', 'AMMO5': '0.017', 'AMMO2': '0.035', 'AMMO3': '0.145', 'AMMO4': '0.174', 'weapon5': '0.176', 'WEAPON4': '0.350', 'weapon4': '0.366', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '1.080', 'weapon2': '1.222', 'weapon3': '1.818', 'DAMAGECOUNT': '3.960', 'FRAGCOUNT': '12.000'} [2023-02-24 19:22:15,662][177155] DAMAGECOUNT value on done: 381408.0 [2023-02-24 19:22:15,662][177155] Sum rewards: 24.146, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.744', 'AMMO2': '0.011', 'AMMO5': '0.030', 'AMMO4': '0.052', 'AMMO3': '0.148', 'WEAPON4': '0.300', 'weapon5': '0.308', 'weapon4': '0.520', 'WEAPON5': '0.650', 'weapon2': '0.694', 'WEAPON3': '0.950', 'HITCOUNT': '1.690', 'weapon3': '1.944', 'DAMAGECOUNT': '6.843', 'FRAGCOUNT': '23.000'} [2023-02-24 19:22:15,959][177155] DAMAGECOUNT value on done: 376892.0 [2023-02-24 19:22:15,959][177155] Sum rewards: 19.361, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.300', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.124', 'weapon5': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.416', 'ARMOR': '0.500', 'weapon2': '0.684', 'WEAPON3': '0.850', 'HITCOUNT': '1.620', 'weapon3': '1.798', 'DAMAGECOUNT': '6.090', 'FRAGCOUNT': '17.000'} [2023-02-24 19:22:16,258][177155] DAMAGECOUNT value on done: 360234.0 [2023-02-24 19:22:16,259][177155] Sum rewards: 23.358, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.104', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.016', 'AMMO3': '0.132', 'weapon5': '0.356', 'WEAPON5': '0.400', 'weapon2': '0.556', 'WEAPON3': '0.950', 'HITCOUNT': '1.460', 'weapon3': '2.660', 'DAMAGECOUNT': '6.198', 'FRAGCOUNT': '20.000'} [2023-02-24 19:22:16,376][177119] Fps is (10 sec: 13516.7, 60 sec: 13789.9, 300 sec: 13815.3). Total num frames: 99770368. Throughput: 0: 3454.2. Samples: 24944074. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 19:22:16,376][177119] Avg episode reward: [(0, '20.805')] [2023-02-24 19:22:16,694][177153] Updated weights for policy 0, policy_version 24360 (0.0008) [2023-02-24 19:22:19,630][177153] Updated weights for policy 0, policy_version 24370 (0.0008) [2023-02-24 19:22:21,376][177119] Fps is (10 sec: 13516.3, 60 sec: 13789.8, 300 sec: 13829.2). Total num frames: 99840000. Throughput: 0: 3456.9. Samples: 24954488. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 19:22:21,377][177119] Avg episode reward: [(0, '20.805')] [2023-02-24 19:22:22,054][177170] DAMAGECOUNT value on done: 367430.0 [2023-02-24 19:22:22,055][177170] Sum rewards: 25.550, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.150', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.022', 'AMMO3': '0.088', 'weapon5': '0.504', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'weapon2': '1.142', 'HITCOUNT': '1.270', 'weapon3': '1.762', 'DAMAGECOUNT': '5.982', 'FRAGCOUNT': '20.000'} [2023-02-24 19:22:22,354][177170] DAMAGECOUNT value on done: 368348.0 [2023-02-24 19:22:22,354][177170] Sum rewards: 21.483, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.992', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'AMMO2': '0.025', 'AMMO3': '0.110', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'weapon5': '0.276', 'weapon4': '0.300', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon2': '0.836', 'HITCOUNT': '1.230', 'weapon3': '1.920', 'DAMAGECOUNT': '6.411', 'FRAGCOUNT': '18.000'} [2023-02-24 19:22:22,604][177153] Updated weights for policy 0, policy_version 24380 (0.0008) [2023-02-24 19:22:22,982][177170] DAMAGECOUNT value on done: 364388.0 [2023-02-24 19:22:22,983][177170] Sum rewards: 21.469, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.322', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.061', 'AMMO3': '0.084', 'WEAPON5': '0.150', 'weapon5': '0.222', 'WEAPON3': '0.550', 'HITCOUNT': '1.310', 'weapon3': '1.468', 'weapon2': '1.556', 'DAMAGECOUNT': '5.370', 'FRAGCOUNT': '17.000'} [2023-02-24 19:22:23,284][177170] DAMAGECOUNT value on done: 368024.0 [2023-02-24 19:22:23,284][177170] Sum rewards: 14.290, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.042', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.025', 'weapon7': '0.046', 'weapon4': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'weapon5': '0.260', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'weapon2': '0.984', 'HITCOUNT': '1.150', 'weapon3': '1.760', 'DAMAGECOUNT': '4.806', 'FRAGCOUNT': '14.000'} [2023-02-24 19:22:24,631][177156] DAMAGECOUNT value on done: 370898.0 [2023-02-24 19:22:24,631][177156] Sum rewards: 14.923, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.365', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.009', 'AMMO3': '0.073', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.202', 'ARMOR': '0.475', 'WEAPON3': '0.600', 'HITCOUNT': '0.910', 'weapon2': '1.448', 'weapon3': '1.474', 'DAMAGECOUNT': '3.981', 'FRAGCOUNT': '12.000'} [2023-02-24 19:22:24,806][177156] DAMAGECOUNT value on done: 358546.0 [2023-02-24 19:22:24,806][177156] Sum rewards: 21.837, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.654', 'AMMO2': '0.014', 'AMMO5': '0.022', 'AMMO4': '0.071', 'weapon5': '0.130', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'weapon4': '0.584', 'WEAPON3': '0.950', 'weapon2': '0.976', 'HITCOUNT': '1.670', 'weapon3': '1.870', 'DAMAGECOUNT': '6.456', 'FRAGCOUNT': '20.000'} [2023-02-24 19:22:24,838][177158] DAMAGECOUNT value on done: 353987.0 [2023-02-24 19:22:24,839][177158] Sum rewards: 23.641, reward structure: {'DEATHCOUNT': '-9.000', 'ARMOR': '0.004', 'AMMO5': '0.009', 'HEALTH': '0.024', 'AMMO2': '0.029', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.108', 'AMMO3': '0.112', 'AMMO4': '0.142', 'weapon5': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.700', 'weapon2': '1.338', 'HITCOUNT': '1.690', 'weapon3': '1.908', 'DAMAGECOUNT': '6.729', 'FRAGCOUNT': '19.000'} [2023-02-24 19:22:24,949][177156] DAMAGECOUNT value on done: 377900.0 [2023-02-24 19:22:24,949][177156] Sum rewards: 19.631, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.688', 'AMMO2': '0.005', 'AMMO5': '0.017', 'AMMO4': '0.023', 'weapon4': '0.036', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'weapon5': '0.228', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '1.080', 'weapon2': '1.142', 'weapon3': '1.806', 'DAMAGECOUNT': '4.476', 'FRAGCOUNT': '17.000'} [2023-02-24 19:22:25,119][177156] DAMAGECOUNT value on done: 363179.0 [2023-02-24 19:22:25,119][177156] Sum rewards: 14.374, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.158', 'AMMO2': '0.006', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.027', 'AMMO3': '0.107', 'weapon5': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.688', 'WEAPON3': '0.700', 'HITCOUNT': '1.090', 'weapon2': '1.126', 'weapon3': '1.630', 'DAMAGECOUNT': '4.029', 'FRAGCOUNT': '13.000'} [2023-02-24 19:22:25,143][177158] DAMAGECOUNT value on done: 363075.0 [2023-02-24 19:22:25,143][177158] Sum rewards: 15.225, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.400', 'AMMO2': '0.004', 'AMMO5': '0.012', 'AMMO4': '0.018', 'weapon5': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.102', 'weapon7': '0.154', 'WEAPON5': '0.250', 'weapon2': '0.572', 'WEAPON3': '0.650', 'HITCOUNT': '1.100', 'weapon3': '1.652', 'DAMAGECOUNT': '4.737', 'FRAGCOUNT': '12.000'} [2023-02-24 19:22:25,453][177158] DAMAGECOUNT value on done: 368492.0 [2023-02-24 19:22:25,453][177158] Sum rewards: 27.569, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.989', 'AMMO5': '0.024', 'AMMO2': '0.030', 'AMMO3': '0.095', 'AMMO4': '0.150', 'WEAPON4': '0.250', 'weapon5': '0.304', 'weapon4': '0.382', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'weapon2': '0.710', 'HITCOUNT': '1.510', 'weapon3': '2.306', 'DAMAGECOUNT': '6.297', 'FRAGCOUNT': '22.000'} [2023-02-24 19:22:25,617][177153] Updated weights for policy 0, policy_version 24390 (0.0007) [2023-02-24 19:22:25,752][177158] DAMAGECOUNT value on done: 371119.0 [2023-02-24 19:22:25,753][177158] Sum rewards: 16.700, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.951', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.030', 'AMMO3': '0.074', 'AMMO4': '0.147', 'weapon5': '0.244', 'WEAPON4': '0.250', 'weapon4': '0.328', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'weapon2': '1.106', 'HITCOUNT': '1.130', 'weapon3': '1.954', 'DAMAGECOUNT': '4.509', 'FRAGCOUNT': '13.000'} [2023-02-24 19:22:26,376][177119] Fps is (10 sec: 13926.5, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 99909632. Throughput: 0: 3454.0. Samples: 24975106. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 19:22:26,376][177119] Avg episode reward: [(0, '20.628')] [2023-02-24 19:22:28,601][177153] Updated weights for policy 0, policy_version 24400 (0.0008) [2023-02-24 19:22:29,365][177172] DAMAGECOUNT value on done: 365137.0 [2023-02-24 19:22:29,365][177172] Sum rewards: 18.689, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.366', 'ARMOR': '0.004', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'AMMO3': '0.138', 'AMMO4': '0.174', 'weapon5': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.520', 'weapon2': '0.556', 'WEAPON3': '0.850', 'HITCOUNT': '1.620', 'weapon3': '2.208', 'DAMAGECOUNT': '5.775', 'FRAGCOUNT': '16.000'} [2023-02-24 19:22:29,669][177172] DAMAGECOUNT value on done: 365674.0 [2023-02-24 19:22:29,669][177172] Sum rewards: 14.086, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.330', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO5': '0.015', 'weapon4': '0.044', 'weapon7': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.190', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'HITCOUNT': '1.060', 'weapon2': '1.184', 'weapon3': '1.990', 'DAMAGECOUNT': '4.734', 'FRAGCOUNT': '12.500'} [2023-02-24 19:22:30,685][177154] DAMAGECOUNT value on done: 366609.0 [2023-02-24 19:22:30,685][177154] Sum rewards: 18.030, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.336', 'AMMO2': '0.010', 'AMMO5': '0.024', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'AMMO3': '0.158', 'weapon5': '0.228', 'weapon4': '0.238', 'weapon2': '0.314', 'ARMOR': '0.451', 'WEAPON5': '0.550', 'WEAPON3': '0.950', 'HITCOUNT': '1.140', 'weapon3': '2.340', 'DAMAGECOUNT': '4.563', 'FRAGCOUNT': '17.000'} [2023-02-24 19:22:30,988][177154] DAMAGECOUNT value on done: 378003.0 [2023-02-24 19:22:30,989][177154] Sum rewards: 28.122, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.095', 'AMMO2': '0.003', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO4': '0.016', 'AMMO3': '0.066', 'weapon7': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.218', 'WEAPON5': '0.250', 'weapon4': '0.436', 'WEAPON3': '0.500', 'weapon2': '1.070', 'weapon3': '1.410', 'HITCOUNT': '1.440', 'DAMAGECOUNT': '6.330', 'FRAGCOUNT': '22.000'} [2023-02-24 19:22:31,141][177172] DAMAGECOUNT value on done: 375891.0 [2023-02-24 19:22:31,141][177172] Sum rewards: 16.339, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.150', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.012', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'weapon4': '0.108', 'weapon5': '0.374', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '1.130', 'weapon2': '1.240', 'weapon3': '1.578', 'DAMAGECOUNT': '4.719', 'FRAGCOUNT': '14.000'} [2023-02-24 19:22:31,279][177154] DAMAGECOUNT value on done: 382990.0 [2023-02-24 19:22:31,280][177154] Sum rewards: 14.889, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.556', 'ARMOR': '0.004', 'AMMO2': '0.015', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'weapon4': '0.222', 'weapon5': '0.358', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'HITCOUNT': '0.960', 'weapon2': '0.974', 'weapon3': '1.962', 'DAMAGECOUNT': '4.323', 'FRAGCOUNT': '14.000'} [2023-02-24 19:22:31,376][177119] Fps is (10 sec: 13926.7, 60 sec: 13789.9, 300 sec: 13829.2). Total num frames: 99979264. Throughput: 0: 3453.8. Samples: 24995792. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 19:22:31,376][177119] Avg episode reward: [(0, '20.290')] [2023-02-24 19:22:31,444][177172] DAMAGECOUNT value on done: 372645.0 [2023-02-24 19:22:31,445][177172] Sum rewards: 24.356, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.024', 'AMMO2': '0.001', 'AMMO4': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO3': '0.130', 'weapon5': '0.136', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'weapon2': '0.922', 'HITCOUNT': '1.460', 'weapon3': '2.356', 'DAMAGECOUNT': '6.093', 'FRAGCOUNT': '19.000'} [2023-02-24 19:22:31,569][177153] Updated weights for policy 0, policy_version 24410 (0.0008) [2023-02-24 19:22:31,588][177154] DAMAGECOUNT value on done: 378963.0 [2023-02-24 19:22:31,588][177154] Sum rewards: 26.948, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.218', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO3': '0.123', 'AMMO4': '0.165', 'weapon5': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.352', 'WEAPON3': '0.750', 'weapon2': '1.104', 'HITCOUNT': '1.490', 'weapon3': '1.976', 'DAMAGECOUNT': '6.438', 'FRAGCOUNT': '23.000'} [2023-02-24 19:22:31,674][177157] DAMAGECOUNT value on done: 380850.0 [2023-02-24 19:22:31,674][177157] Sum rewards: 18.042, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.515', 'AMMO5': '0.017', 'AMMO2': '0.026', 'AMMO3': '0.123', 'AMMO4': '0.129', 'weapon4': '0.198', 'WEAPON4': '0.250', 'weapon5': '0.324', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'weapon2': '0.876', 'HITCOUNT': '1.460', 'weapon3': '1.922', 'DAMAGECOUNT': '5.982', 'FRAGCOUNT': '16.000'} [2023-02-24 19:22:31,773][177157] DAMAGECOUNT value on done: 364182.0 [2023-02-24 19:22:31,773][177157] Sum rewards: 24.513, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.640', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.031', 'weapon4': '0.096', 'AMMO3': '0.108', 'WEAPON4': '0.200', 'weapon5': '0.230', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'weapon2': '1.076', 'HITCOUNT': '1.340', 'weapon3': '2.022', 'DAMAGECOUNT': '6.366', 'FRAGCOUNT': '22.000'} [2023-02-24 19:22:31,995][177157] DAMAGECOUNT value on done: 364005.0 [2023-02-24 19:22:31,995][177157] Sum rewards: 23.690, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.140', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon7': '0.074', 'AMMO3': '0.087', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.142', 'WEAPON7': '0.200', 'weapon5': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.328', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'weapon3': '1.276', 'weapon2': '1.402', 'HITCOUNT': '1.460', 'DAMAGECOUNT': '6.183', 'FRAGCOUNT': '20.000'} [2023-02-24 19:22:32,082][177157] DAMAGECOUNT value on done: 366431.0 [2023-02-24 19:22:32,083][177157] Sum rewards: 20.252, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.439', 'AMMO2': '0.002', 'ARMOR': '0.004', 'AMMO4': '0.008', 'AMMO5': '0.015', 'WEAPON4': '0.050', 'AMMO3': '0.168', 'weapon4': '0.198', 'weapon5': '0.314', 'WEAPON5': '0.500', 'weapon2': '0.700', 'WEAPON3': '1.150', 'HITCOUNT': '1.670', 'weapon3': '2.276', 'DAMAGECOUNT': '6.636', 'FRAGCOUNT': '18.000'} [2023-02-24 19:22:32,098][177171] DAMAGECOUNT value on done: 365235.0 [2023-02-24 19:22:32,098][177171] Sum rewards: 11.254, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.550', 'AMMO2': '0.008', 'AMMO5': '0.012', 'AMMO4': '0.038', 'AMMO3': '0.087', 'WEAPON4': '0.200', 'weapon4': '0.240', 'WEAPON5': '0.300', 'weapon5': '0.302', 'WEAPON3': '0.550', 'HITCOUNT': '0.850', 'weapon2': '1.146', 'weapon3': '1.694', 'DAMAGECOUNT': '3.126', 'FRAGCOUNT': '10.000'} [2023-02-24 19:22:32,109][177171] DAMAGECOUNT value on done: 367696.0 [2023-02-24 19:22:32,110][177171] Sum rewards: 19.172, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.640', 'ARMOR': '0.004', 'AMMO2': '0.008', 'weapon7': '0.008', 'AMMO5': '0.025', 'weapon4': '0.032', 'AMMO4': '0.039', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'weapon5': '0.260', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'HITCOUNT': '1.160', 'weapon2': '1.292', 'weapon3': '1.970', 'DAMAGECOUNT': '4.941', 'FRAGCOUNT': '16.000'} [2023-02-24 19:22:32,401][177171] DAMAGECOUNT value on done: 364335.0 [2023-02-24 19:22:32,402][177171] Sum rewards: 22.777, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.714', 'ARMOR': '0.004', 'AMMO2': '0.014', 'AMMO5': '0.017', 'AMMO4': '0.071', 'WEAPON4': '0.150', 'AMMO3': '0.158', 'weapon5': '0.308', 'weapon4': '0.416', 'WEAPON5': '0.450', 'weapon2': '0.482', 'WEAPON3': '0.850', 'HITCOUNT': '1.280', 'weapon3': '2.434', 'DAMAGECOUNT': '5.856', 'FRAGCOUNT': '20.000'} [2023-02-24 19:22:32,414][177171] DAMAGECOUNT value on done: 368824.0 [2023-02-24 19:22:32,415][177171] Sum rewards: 25.091, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.163', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'AMMO3': '0.080', 'weapon5': '0.146', 'AMMO4': '0.164', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.454', 'WEAPON3': '0.500', 'weapon2': '1.186', 'weapon3': '1.686', 'HITCOUNT': '1.700', 'DAMAGECOUNT': '6.525', 'FRAGCOUNT': '19.000'} [2023-02-24 19:22:33,345][177119] Component Batcher_0 stopped! [2023-02-24 19:22:33,345][177140] Stopping Batcher_0... [2023-02-24 19:22:33,346][177140] Loop batcher_evt_loop terminating... [2023-02-24 19:22:33,346][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000024416_100007936.pth... [2023-02-24 19:22:33,364][177155] Stopping RolloutWorker_w1... [2023-02-24 19:22:33,364][177119] Component RolloutWorker_w1 stopped! [2023-02-24 19:22:33,365][177155] Loop rollout_proc1_evt_loop terminating... [2023-02-24 19:22:33,365][177119] Component RolloutWorker_w0 stopped! [2023-02-24 19:22:33,365][177154] Stopping RolloutWorker_w0... [2023-02-24 19:22:33,366][177119] Component RolloutWorker_w6 stopped! [2023-02-24 19:22:33,365][177171] Stopping RolloutWorker_w6... [2023-02-24 19:22:33,366][177154] Loop rollout_proc0_evt_loop terminating... [2023-02-24 19:22:33,366][177171] Loop rollout_proc6_evt_loop terminating... [2023-02-24 19:22:33,366][177119] Component RolloutWorker_w7 stopped! [2023-02-24 19:22:33,366][177172] Stopping RolloutWorker_w7... [2023-02-24 19:22:33,366][177172] Loop rollout_proc7_evt_loop terminating... [2023-02-24 19:22:33,366][177153] Weights refcount: 2 0 [2023-02-24 19:22:33,367][177119] Component RolloutWorker_w5 stopped! [2023-02-24 19:22:33,367][177170] Stopping RolloutWorker_w5... [2023-02-24 19:22:33,367][177170] Loop rollout_proc5_evt_loop terminating... [2023-02-24 19:22:33,367][177119] Component RolloutWorker_w3 stopped! [2023-02-24 19:22:33,367][177157] Stopping RolloutWorker_w3... [2023-02-24 19:22:33,368][177157] Loop rollout_proc3_evt_loop terminating... [2023-02-24 19:22:33,368][177153] Stopping InferenceWorker_p0-w0... [2023-02-24 19:22:33,368][177119] Component InferenceWorker_p0-w0 stopped! [2023-02-24 19:22:33,368][177153] Loop inference_proc0-0_evt_loop terminating... [2023-02-24 19:22:33,369][177119] Component RolloutWorker_w4 stopped! [2023-02-24 19:22:33,369][177158] Stopping RolloutWorker_w4... [2023-02-24 19:22:33,370][177119] Component RolloutWorker_w2 stopped! [2023-02-24 19:22:33,370][177156] Stopping RolloutWorker_w2... [2023-02-24 19:22:33,370][177158] Loop rollout_proc4_evt_loop terminating... [2023-02-24 19:22:33,370][177156] Loop rollout_proc2_evt_loop terminating... [2023-02-24 19:22:33,412][177140] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000023683_97005568.pth [2023-02-24 19:22:33,423][177140] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000024416_100007936.pth... [2023-02-24 19:22:33,525][177140] Stopping LearnerWorker_p0... [2023-02-24 19:22:33,526][177140] Loop learner_proc0_evt_loop terminating... [2023-02-24 19:22:33,525][177119] Component LearnerWorker_p0 stopped! [2023-02-24 19:22:33,526][177119] Waiting for process learner_proc0 to stop... [2023-02-24 19:22:34,298][177119] Waiting for process inference_proc0-0 to join... [2023-02-24 19:22:34,298][177119] Waiting for process rollout_proc0 to join... [2023-02-24 19:22:34,298][177119] Waiting for process rollout_proc1 to join... [2023-02-24 19:22:34,298][177119] Waiting for process rollout_proc2 to join... [2023-02-24 19:22:34,299][177119] Waiting for process rollout_proc3 to join... [2023-02-24 19:22:34,299][177119] Waiting for process rollout_proc4 to join... [2023-02-24 19:22:34,299][177119] Waiting for process rollout_proc5 to join... [2023-02-24 19:22:34,299][177119] Waiting for process rollout_proc6 to join... [2023-02-24 19:22:34,299][177119] Waiting for process rollout_proc7 to join... [2023-02-24 19:22:34,299][177119] Batcher 0 profile tree view: batching: 352.6999, releasing_batches: 0.4732 [2023-02-24 19:22:34,299][177119] InferenceWorker_p0-w0 profile tree view: wait_policy: 0.0000 wait_policy_total: 68.0493 update_model: 80.9582 weight_update: 0.0008 one_step: 0.0035 handle_policy_step: 6711.8271 deserialize: 282.2897, stack: 33.8175, obs_to_device_normalize: 1744.1694, forward: 3429.6436, send_messages: 302.3419 prepare_outputs: 695.6905 to_cpu: 414.5288 [2023-02-24 19:22:34,299][177119] Learner 0 profile tree view: misc: 0.1143, prepare_batch: 172.5732 train: 711.7333 epoch_init: 0.0948, minibatch_init: 0.1314, losses_postprocess: 4.9963, kl_divergence: 15.6395, after_optimizer: 195.2784 calculate_losses: 306.5421 losses_init: 0.0570, forward_head: 18.3649, bptt_initial: 201.9567, tail: 23.5220, advantages_returns: 2.9629, losses: 36.1036 bptt: 20.0289 bptt_forward_core: 19.2148 update: 179.7901 clip: 21.9436 [2023-02-24 19:22:34,299][177119] RolloutWorker_w0 profile tree view: wait_for_trajectories: 3.2150, enqueue_policy_requests: 209.0925, env_step: 4763.3294, overhead: 230.9735, complete_rollouts: 5.8585 save_policy_outputs: 183.5441 split_output_tensors: 89.8629 [2023-02-24 19:22:34,300][177119] RolloutWorker_w7 profile tree view: wait_for_trajectories: 3.1087, enqueue_policy_requests: 207.9695, env_step: 4767.9186, overhead: 230.9251, complete_rollouts: 5.8591 save_policy_outputs: 182.2692 split_output_tensors: 89.2990 [2023-02-24 19:22:34,300][177119] Loop Runner_EvtLoop terminating... [2023-02-24 19:22:34,300][177119] Runner profile tree view: main_loop: 7176.3991 [2023-02-24 19:22:34,300][177119] Collected {0: 100007936}, FPS: 13935.7 [2023-02-24 20:24:46,714][213332] Saving configuration to /home/besa/source/rl/train_dir/default_experiment/config.json... [2023-02-24 20:24:46,715][213332] Rollout worker 0 uses device cpu [2023-02-24 20:24:46,715][213332] Rollout worker 1 uses device cpu [2023-02-24 20:24:46,715][213332] Rollout worker 2 uses device cpu [2023-02-24 20:24:46,715][213332] Rollout worker 3 uses device cpu [2023-02-24 20:24:46,715][213332] Rollout worker 4 uses device cpu [2023-02-24 20:24:46,715][213332] Rollout worker 5 uses device cpu [2023-02-24 20:24:46,715][213332] Rollout worker 6 uses device cpu [2023-02-24 20:24:46,715][213332] Rollout worker 7 uses device cpu [2023-02-24 20:24:46,779][213332] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2023-02-24 20:24:46,779][213332] InferenceWorker_p0-w0: min num requests: 2 [2023-02-24 20:24:46,795][213332] Starting all processes... [2023-02-24 20:24:46,795][213332] Starting process learner_proc0 [2023-02-24 20:24:47,428][213332] Starting all processes... [2023-02-24 20:24:47,431][213352] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2023-02-24 20:24:47,431][213352] Set environment var CUDA_VISIBLE_DEVICES to '0' (GPU indices [0]) for learning process 0 [2023-02-24 20:24:47,431][213332] Starting process inference_proc0-0 [2023-02-24 20:24:47,431][213332] Starting process rollout_proc0 [2023-02-24 20:24:47,433][213332] Starting process rollout_proc1 [2023-02-24 20:24:47,433][213332] Starting process rollout_proc2 [2023-02-24 20:24:47,441][213352] Num visible devices: 1 [2023-02-24 20:24:47,437][213332] Starting process rollout_proc3 [2023-02-24 20:24:47,439][213332] Starting process rollout_proc4 [2023-02-24 20:24:47,441][213332] Starting process rollout_proc5 [2023-02-24 20:24:47,443][213332] Starting process rollout_proc6 [2023-02-24 20:24:47,444][213332] Starting process rollout_proc7 [2023-02-24 20:24:47,481][213352] Starting seed is not provided [2023-02-24 20:24:47,481][213352] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2023-02-24 20:24:47,481][213352] Initializing actor-critic model on device cuda:0 [2023-02-24 20:24:47,482][213352] RunningMeanStd input shape: (23,) [2023-02-24 20:24:47,482][213352] RunningMeanStd input shape: (3, 72, 128) [2023-02-24 20:24:47,482][213352] RunningMeanStd input shape: (1,) [2023-02-24 20:24:47,498][213352] ConvEncoder: input_channels=3 [2023-02-24 20:24:47,633][213352] Conv encoder output size: 512 [2023-02-24 20:24:47,633][213352] Policy head output size: 512 [2023-02-24 20:24:47,647][213352] Created Actor Critic model with architecture: [2023-02-24 20:24:47,648][213352] ActorCriticSharedWeights( (obs_normalizer): ObservationNormalizer( (running_mean_std): RunningMeanStdDictInPlace( (running_mean_std): ModuleDict( (measurements): RunningMeanStdInPlace() (obs): RunningMeanStdInPlace() ) ) ) (returns_normalizer): RecursiveScriptModule(original_name=RunningMeanStdInPlace) (encoder): VizdoomEncoder( (basic_encoder): ConvEncoder( (enc): RecursiveScriptModule( original_name=ConvEncoderImpl (conv_head): RecursiveScriptModule( original_name=Sequential (0): RecursiveScriptModule(original_name=Conv2d) (1): RecursiveScriptModule(original_name=ELU) (2): RecursiveScriptModule(original_name=Conv2d) (3): RecursiveScriptModule(original_name=ELU) (4): RecursiveScriptModule(original_name=Conv2d) (5): RecursiveScriptModule(original_name=ELU) ) (mlp_layers): RecursiveScriptModule( original_name=Sequential (0): RecursiveScriptModule(original_name=Linear) (1): RecursiveScriptModule(original_name=ELU) ) ) ) ) (core): ModelCoreRNN( (core): GRU(512, 512) ) (decoder): MlpDecoder( (mlp): Identity() ) (critic_linear): Linear(in_features=512, out_features=1, bias=True) (action_parameterization): ActionParameterizationDefault( (distribution_linear): Linear(in_features=512, out_features=39, bias=True) ) ) [2023-02-24 20:24:48,553][213366] Worker 1 uses CPU cores [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] [2023-02-24 20:24:48,566][213365] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2023-02-24 20:24:48,567][213365] Set environment var CUDA_VISIBLE_DEVICES to '0' (GPU indices [0]) for inference process 0 [2023-02-24 20:24:48,586][213372] Worker 4 uses CPU cores [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] [2023-02-24 20:24:48,586][213368] Worker 2 uses CPU cores [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] [2023-02-24 20:24:48,586][213365] Num visible devices: 1 [2023-02-24 20:24:48,763][213367] Worker 0 uses CPU cores [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] [2023-02-24 20:24:48,785][213382] Worker 6 uses CPU cores [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] [2023-02-24 20:24:48,794][213369] Worker 3 uses CPU cores [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] [2023-02-24 20:24:48,796][213384] Worker 7 uses CPU cores [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] [2023-02-24 20:24:48,804][213383] Worker 5 uses CPU cores [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] [2023-02-24 20:24:49,449][213352] Using optimizer [2023-02-24 20:24:49,450][213352] Loading state from checkpoint /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000024416_100007936.pth... [2023-02-24 20:24:49,470][213352] Loading model from checkpoint [2023-02-24 20:24:49,472][213352] Loaded experiment state at self.train_step=24416, self.env_steps=100007936 [2023-02-24 20:24:49,472][213352] Initialized policy 0 weights for model version 24416 [2023-02-24 20:24:49,473][213352] LearnerWorker_p0 finished initialization! [2023-02-24 20:24:49,474][213352] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2023-02-24 20:24:49,890][213365] RunningMeanStd input shape: (23,) [2023-02-24 20:24:49,890][213365] RunningMeanStd input shape: (3, 72, 128) [2023-02-24 20:24:49,890][213365] RunningMeanStd input shape: (1,) [2023-02-24 20:24:49,898][213365] ConvEncoder: input_channels=3 [2023-02-24 20:24:49,952][213365] Conv encoder output size: 512 [2023-02-24 20:24:49,953][213365] Policy head output size: 512 [2023-02-24 20:24:50,243][213332] Fps is (10 sec: nan, 60 sec: nan, 300 sec: nan). Total num frames: 100007936. Throughput: 0: nan. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2023-02-24 20:24:50,281][213332] Inference worker 0-0 is ready! [2023-02-24 20:24:50,281][213332] All inference workers are ready! Signal rollout workers to start! [2023-02-24 20:24:50,319][213384] Doom resolution: 160x120, resize resolution: (128, 72) [2023-02-24 20:24:50,319][213369] Doom resolution: 160x120, resize resolution: (128, 72) [2023-02-24 20:24:50,320][213372] Doom resolution: 160x120, resize resolution: (128, 72) [2023-02-24 20:24:50,321][213369] Port 40600 is available [2023-02-24 20:24:50,321][213369] Using port 40600 [2023-02-24 20:24:50,321][213384] Port 41000 is available [2023-02-24 20:24:50,321][213384] Using port 41000 [2023-02-24 20:24:50,321][213372] Port 40700 is available [2023-02-24 20:24:50,321][213372] Using port 40700 [2023-02-24 20:24:50,325][213367] Doom resolution: 160x120, resize resolution: (128, 72) [2023-02-24 20:24:50,326][213366] Doom resolution: 160x120, resize resolution: (128, 72) [2023-02-24 20:24:50,328][213366] Port 40400 is available [2023-02-24 20:24:50,328][213366] Using port 40400 [2023-02-24 20:24:50,327][213367] Port 40300 is available [2023-02-24 20:24:50,328][213367] Using port 40300 [2023-02-24 20:24:50,329][213382] Doom resolution: 160x120, resize resolution: (128, 72) [2023-02-24 20:24:50,330][213368] Doom resolution: 160x120, resize resolution: (128, 72) [2023-02-24 20:24:50,330][213383] Doom resolution: 160x120, resize resolution: (128, 72) [2023-02-24 20:24:50,332][213383] Port 40800 is available [2023-02-24 20:24:50,332][213368] Port 40500 is available [2023-02-24 20:24:50,333][213383] Using port 40800 [2023-02-24 20:24:50,333][213368] Using port 40500 [2023-02-24 20:24:50,334][213382] Port 40900 is available [2023-02-24 20:24:50,336][213382] Using port 40900 [2023-02-24 20:24:50,356][213384] Port 41001 is available [2023-02-24 20:24:50,355][213369] Port 40601 is available [2023-02-24 20:24:50,356][213384] Using port 41001 [2023-02-24 20:24:50,356][213369] Using port 40601 [2023-02-24 20:24:50,357][213372] Port 40701 is available [2023-02-24 20:24:50,358][213372] Using port 40701 [2023-02-24 20:24:50,358][213369] Using port 40600 on host... [2023-02-24 20:24:50,358][213384] Using port 41000 on host... [2023-02-24 20:24:50,359][213372] Using port 40700 on host... [2023-02-24 20:24:50,364][213366] Port 40401 is available [2023-02-24 20:24:50,364][213366] Using port 40401 [2023-02-24 20:24:50,366][213366] Using port 40400 on host... [2023-02-24 20:24:50,372][213367] Port 40301 is available [2023-02-24 20:24:50,372][213367] Using port 40301 [2023-02-24 20:24:50,373][213383] Port 40801 is available [2023-02-24 20:24:50,373][213383] Using port 40801 [2023-02-24 20:24:50,373][213368] Port 40501 is available [2023-02-24 20:24:50,373][213368] Using port 40501 [2023-02-24 20:24:50,373][213367] Using port 40300 on host... [2023-02-24 20:24:50,374][213382] Port 40901 is available [2023-02-24 20:24:50,374][213383] Using port 40800 on host... [2023-02-24 20:24:50,375][213382] Using port 40901 [2023-02-24 20:24:50,375][213368] Using port 40500 on host... [2023-02-24 20:24:50,376][213382] Using port 40900 on host... [2023-02-24 20:24:50,525][213366] Initialized w:1 v:0 player:0 [2023-02-24 20:24:50,526][213366] Decorrelating experience for 0 frames... [2023-02-24 20:24:50,526][213366] Using port 40401 on host... [2023-02-24 20:24:50,527][213367] Initialized w:0 v:0 player:0 [2023-02-24 20:24:50,528][213367] Decorrelating experience for 0 frames... [2023-02-24 20:24:50,528][213367] Using port 40301 on host... [2023-02-24 20:24:50,546][213383] Initialized w:5 v:0 player:0 [2023-02-24 20:24:50,547][213383] Decorrelating experience for 0 frames... [2023-02-24 20:24:50,548][213383] Using port 40801 on host... [2023-02-24 20:24:50,550][213368] Initialized w:2 v:0 player:0 [2023-02-24 20:24:50,551][213368] Decorrelating experience for 0 frames... [2023-02-24 20:24:50,552][213384] Initialized w:7 v:0 player:0 [2023-02-24 20:24:50,552][213369] Initialized w:3 v:0 player:0 [2023-02-24 20:24:50,552][213368] Using port 40501 on host... [2023-02-24 20:24:50,553][213369] Decorrelating experience for 0 frames... [2023-02-24 20:24:50,553][213384] Decorrelating experience for 0 frames... [2023-02-24 20:24:50,554][213369] Using port 40601 on host... [2023-02-24 20:24:50,554][213384] Using port 41001 on host... [2023-02-24 20:24:50,580][213372] Initialized w:4 v:0 player:0 [2023-02-24 20:24:50,581][213372] Decorrelating experience for 0 frames... [2023-02-24 20:24:50,582][213372] Using port 40701 on host... [2023-02-24 20:24:50,600][213382] Initialized w:6 v:0 player:0 [2023-02-24 20:24:50,601][213382] Decorrelating experience for 0 frames... [2023-02-24 20:24:50,601][213382] Using port 40901 on host... [2023-02-24 20:24:50,696][213367] Initialized w:0 v:1 player:0 [2023-02-24 20:24:50,697][213367] Decorrelating experience for 32 frames... [2023-02-24 20:24:50,707][213368] Initialized w:2 v:1 player:0 [2023-02-24 20:24:50,708][213368] Decorrelating experience for 32 frames... [2023-02-24 20:24:50,714][213383] Initialized w:5 v:1 player:0 [2023-02-24 20:24:50,714][213383] Decorrelating experience for 32 frames... [2023-02-24 20:24:50,735][213372] Initialized w:4 v:1 player:0 [2023-02-24 20:24:50,736][213372] Decorrelating experience for 32 frames... [2023-02-24 20:24:50,739][213367] Port 40302 is available [2023-02-24 20:24:50,739][213367] Using port 40302 [2023-02-24 20:24:50,742][213366] Initialized w:1 v:1 player:0 [2023-02-24 20:24:50,743][213366] Decorrelating experience for 32 frames... [2023-02-24 20:24:50,753][213367] Port 40303 is available [2023-02-24 20:24:50,754][213367] Using port 40303 [2023-02-24 20:24:50,754][213368] Port 40502 is available [2023-02-24 20:24:50,754][213368] Using port 40502 [2023-02-24 20:24:50,755][213367] Using port 40302 on host... [2023-02-24 20:24:50,771][213368] Port 40503 is available [2023-02-24 20:24:50,772][213368] Using port 40503 [2023-02-24 20:24:50,773][213368] Using port 40502 on host... [2023-02-24 20:24:50,776][213383] Port 40802 is available [2023-02-24 20:24:50,777][213383] Using port 40802 [2023-02-24 20:24:50,777][213384] Initialized w:7 v:1 player:0 [2023-02-24 20:24:50,778][213384] Decorrelating experience for 32 frames... [2023-02-24 20:24:50,783][213369] Initialized w:3 v:1 player:0 [2023-02-24 20:24:50,785][213369] Decorrelating experience for 32 frames... [2023-02-24 20:24:50,792][213383] Port 40803 is available [2023-02-24 20:24:50,793][213383] Using port 40803 [2023-02-24 20:24:50,794][213383] Using port 40802 on host... [2023-02-24 20:24:50,798][213372] Port 40702 is available [2023-02-24 20:24:50,799][213372] Using port 40702 [2023-02-24 20:24:50,803][213366] Port 40402 is available [2023-02-24 20:24:50,803][213366] Using port 40402 [2023-02-24 20:24:50,813][213372] Port 40703 is available [2023-02-24 20:24:50,813][213372] Using port 40703 [2023-02-24 20:24:50,814][213372] Using port 40702 on host... [2023-02-24 20:24:50,816][213366] Port 40403 is available [2023-02-24 20:24:50,816][213366] Using port 40403 [2023-02-24 20:24:50,817][213366] Using port 40402 on host... [2023-02-24 20:24:50,831][213384] Port 41002 is available [2023-02-24 20:24:50,832][213384] Using port 41002 [2023-02-24 20:24:50,840][213382] Initialized w:6 v:1 player:0 [2023-02-24 20:24:50,842][213382] Decorrelating experience for 32 frames... [2023-02-24 20:24:50,844][213384] Port 41003 is available [2023-02-24 20:24:50,844][213384] Using port 41003 [2023-02-24 20:24:50,845][213384] Using port 41002 on host... [2023-02-24 20:24:50,850][213369] Port 40602 is available [2023-02-24 20:24:50,850][213369] Using port 40602 [2023-02-24 20:24:50,861][213369] Port 40603 is available [2023-02-24 20:24:50,861][213369] Using port 40603 [2023-02-24 20:24:50,862][213369] Using port 40602 on host... [2023-02-24 20:24:50,884][213382] Port 40902 is available [2023-02-24 20:24:50,884][213382] Using port 40902 [2023-02-24 20:24:50,893][213382] Port 40903 is available [2023-02-24 20:24:50,894][213382] Using port 40903 [2023-02-24 20:24:50,894][213382] Using port 40902 on host... [2023-02-24 20:24:50,960][213383] Initialized w:5 v:2 player:0 [2023-02-24 20:24:50,960][213383] Decorrelating experience for 64 frames... [2023-02-24 20:24:50,998][213367] Initialized w:0 v:2 player:0 [2023-02-24 20:24:50,999][213367] Decorrelating experience for 64 frames... [2023-02-24 20:24:51,010][213383] Using port 40803 on host... [2023-02-24 20:24:51,013][213368] Initialized w:2 v:2 player:0 [2023-02-24 20:24:51,014][213368] Decorrelating experience for 64 frames... [2023-02-24 20:24:51,020][213384] Initialized w:7 v:2 player:0 [2023-02-24 20:24:51,021][213384] Decorrelating experience for 64 frames... [2023-02-24 20:24:51,033][213372] Initialized w:4 v:2 player:0 [2023-02-24 20:24:51,034][213372] Decorrelating experience for 64 frames... [2023-02-24 20:24:51,034][213369] Initialized w:3 v:2 player:0 [2023-02-24 20:24:51,035][213369] Decorrelating experience for 64 frames... [2023-02-24 20:24:51,036][213366] Initialized w:1 v:2 player:0 [2023-02-24 20:24:51,036][213366] Decorrelating experience for 64 frames... [2023-02-24 20:24:51,066][213382] Initialized w:6 v:2 player:0 [2023-02-24 20:24:51,067][213382] Decorrelating experience for 64 frames... [2023-02-24 20:24:51,069][213367] Using port 40303 on host... [2023-02-24 20:24:51,078][213368] Using port 40503 on host... [2023-02-24 20:24:51,084][213384] Using port 41003 on host... [2023-02-24 20:24:51,095][213369] Using port 40603 on host... [2023-02-24 20:24:51,099][213372] Using port 40703 on host... [2023-02-24 20:24:51,099][213366] Using port 40403 on host... [2023-02-24 20:24:51,135][213382] Using port 40903 on host... [2023-02-24 20:24:51,200][213383] Initialized w:5 v:3 player:0 [2023-02-24 20:24:51,201][213383] Decorrelating experience for 96 frames... [2023-02-24 20:24:51,227][213367] Initialized w:0 v:3 player:0 [2023-02-24 20:24:51,228][213367] Decorrelating experience for 96 frames... [2023-02-24 20:24:51,272][213372] Initialized w:4 v:3 player:0 [2023-02-24 20:24:51,273][213372] Decorrelating experience for 96 frames... [2023-02-24 20:24:51,297][213368] Initialized w:2 v:3 player:0 [2023-02-24 20:24:51,297][213368] Decorrelating experience for 96 frames... [2023-02-24 20:24:51,305][213384] Initialized w:7 v:3 player:0 [2023-02-24 20:24:51,305][213384] Decorrelating experience for 96 frames... [2023-02-24 20:24:51,317][213382] Initialized w:6 v:3 player:0 [2023-02-24 20:24:51,317][213382] Decorrelating experience for 96 frames... [2023-02-24 20:24:51,326][213369] Initialized w:3 v:3 player:0 [2023-02-24 20:24:51,327][213369] Decorrelating experience for 96 frames... [2023-02-24 20:24:51,328][213366] Initialized w:1 v:3 player:0 [2023-02-24 20:24:51,329][213366] Decorrelating experience for 96 frames... [2023-02-24 20:24:52,235][213352] Signal inference workers to stop experience collection... [2023-02-24 20:24:52,241][213365] InferenceWorker_p0-w0: stopping experience collection [2023-02-24 20:24:52,995][213352] Signal inference workers to resume experience collection... [2023-02-24 20:24:52,995][213365] InferenceWorker_p0-w0: resuming experience collection [2023-02-24 20:24:55,243][213332] Fps is (10 sec: 6553.8, 60 sec: 6553.8, 300 sec: 6553.8). Total num frames: 100040704. Throughput: 0: 446.8. Samples: 2234. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-02-24 20:24:55,805][213365] Updated weights for policy 0, policy_version 24426 (0.0347) [2023-02-24 20:24:58,682][213365] Updated weights for policy 0, policy_version 24436 (0.0009) [2023-02-24 20:25:00,243][213332] Fps is (10 sec: 10240.1, 60 sec: 10240.1, 300 sec: 10240.1). Total num frames: 100110336. Throughput: 0: 2287.4. Samples: 22874. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-02-24 20:25:01,572][213365] Updated weights for policy 0, policy_version 24446 (0.0009) [2023-02-24 20:25:04,461][213365] Updated weights for policy 0, policy_version 24456 (0.0009) [2023-02-24 20:25:05,243][213332] Fps is (10 sec: 13926.4, 60 sec: 11468.9, 300 sec: 11468.9). Total num frames: 100179968. Throughput: 0: 2241.2. Samples: 33618. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-02-24 20:25:06,774][213332] Heartbeat connected on Batcher_0 [2023-02-24 20:25:06,781][213332] Heartbeat connected on RolloutWorker_w0 [2023-02-24 20:25:06,783][213332] Heartbeat connected on RolloutWorker_w1 [2023-02-24 20:25:06,785][213332] Heartbeat connected on RolloutWorker_w2 [2023-02-24 20:25:06,786][213332] Heartbeat connected on InferenceWorker_p0-w0 [2023-02-24 20:25:06,790][213332] Heartbeat connected on RolloutWorker_w4 [2023-02-24 20:25:06,792][213332] Heartbeat connected on LearnerWorker_p0 [2023-02-24 20:25:06,798][213332] Heartbeat connected on RolloutWorker_w7 [2023-02-24 20:25:06,798][213332] Heartbeat connected on RolloutWorker_w6 [2023-02-24 20:25:06,799][213332] Heartbeat connected on RolloutWorker_w5 [2023-02-24 20:25:06,800][213332] Heartbeat connected on RolloutWorker_w3 [2023-02-24 20:25:07,372][213365] Updated weights for policy 0, policy_version 24466 (0.0009) [2023-02-24 20:25:10,243][213332] Fps is (10 sec: 13926.5, 60 sec: 12083.3, 300 sec: 12083.3). Total num frames: 100249600. Throughput: 0: 2742.9. Samples: 54858. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 20:25:10,249][213365] Updated weights for policy 0, policy_version 24476 (0.0009) [2023-02-24 20:25:10,829][213384] DAMAGECOUNT value on done: 1191.0 [2023-02-24 20:25:10,829][213384] Sum rewards: 8.796, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.492', 'weapon7': '0.002', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.110', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.568', 'WEAPON3': '0.650', 'HITCOUNT': '0.870', 'weapon2': '1.208', 'weapon3': '1.492', 'DAMAGECOUNT': '3.573', 'FRAGCOUNT': '9.000'} [2023-02-24 20:25:10,847][213382] DAMAGECOUNT value on done: 996.0 [2023-02-24 20:25:10,847][213382] Sum rewards: 7.915, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.220', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO3': '0.066', 'AMMO4': '0.091', 'weapon7': '0.096', 'WEAPON5': '0.200', 'weapon5': '0.204', 'weapon4': '0.276', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON4': '0.300', 'weapon2': '0.352', 'WEAPON3': '0.400', 'WEAPON7': '0.400', 'HITCOUNT': '0.470', 'weapon3': '0.954', 'DAMAGECOUNT': '2.988', 'FRAGCOUNT': '7.000'} [2023-02-24 20:25:10,855][213372] DAMAGECOUNT value on done: 1091.0 [2023-02-24 20:25:10,856][213372] Sum rewards: 14.725, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.230', 'AMMO5': '0.010', 'AMMO2': '0.020', 'ARMOR': '0.040', 'weapon7': '0.054', 'AMMO3': '0.097', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.260', 'weapon4': '0.360', 'WEAPON3': '0.600', 'HITCOUNT': '0.650', 'weapon2': '1.348', 'weapon3': '1.474', 'DAMAGECOUNT': '3.273', 'FRAGCOUNT': '11.000'} [2023-02-24 20:25:10,886][213366] DAMAGECOUNT value on done: 945.0 [2023-02-24 20:25:10,886][213366] Sum rewards: 9.448, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.772', 'ARMOR': '0.032', 'AMMO5': '0.032', 'AMMO2': '0.037', 'weapon7': '0.056', 'AMMO3': '0.093', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.186', 'WEAPON7': '0.200', 'weapon5': '0.374', 'weapon2': '0.482', 'WEAPON4': '0.550', 'WEAPON3': '0.600', 'HITCOUNT': '0.660', 'weapon4': '0.672', 'WEAPON5': '0.850', 'weapon3': '1.320', 'DAMAGECOUNT': '2.835', 'FRAGCOUNT': '11.000'} [2023-02-24 20:25:10,893][213383] DAMAGECOUNT value on done: 1938.0 [2023-02-24 20:25:10,893][213383] Sum rewards: 18.463, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.215', 'AMMO5': '0.013', 'AMMO2': '0.015', 'weapon7': '0.046', 'AMMO4': '0.072', 'AMMO3': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.350', 'weapon4': '0.392', 'WEAPON3': '0.700', 'weapon2': '1.102', 'HITCOUNT': '1.310', 'weapon3': '1.684', 'DAMAGECOUNT': '5.814', 'FRAGCOUNT': '15.000'} [2023-02-24 20:25:10,901][213367] DAMAGECOUNT value on done: 2188.0 [2023-02-24 20:25:10,902][213367] Sum rewards: 25.224, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.326', 'AMMO2': '0.008', 'AMMO5': '0.019', 'AMMO4': '0.039', 'weapon7': '0.052', 'AMMO3': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.202', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.650', 'weapon2': '0.654', 'weapon4': '0.758', 'HITCOUNT': '1.320', 'weapon3': '1.394', 'DAMAGECOUNT': '6.264', 'FRAGCOUNT': '20.000'} [2023-02-24 20:25:10,937][213368] DAMAGECOUNT value on done: 2714.0 [2023-02-24 20:25:10,937][213368] Sum rewards: 25.648, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.762', 'weapon7': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.166', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.302', 'weapon2': '0.334', 'weapon4': '0.432', 'WEAPON4': '0.450', 'WEAPON5': '0.650', 'WEAPON3': '1.050', 'HITCOUNT': '1.740', 'weapon3': '2.342', 'DAMAGECOUNT': '8.142', 'FRAGCOUNT': '23.000'} [2023-02-24 20:25:10,948][213369] DAMAGECOUNT value on done: 1823.0 [2023-02-24 20:25:10,949][213369] Sum rewards: 15.428, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.460', 'AMMO5': '0.022', 'ARMOR': '0.036', 'AMMO2': '0.041', 'AMMO3': '0.135', 'AMMO4': '0.206', 'weapon5': '0.338', 'WEAPON4': '0.450', 'weapon4': '0.546', 'WEAPON5': '0.550', 'weapon2': '0.682', 'WEAPON3': '0.900', 'HITCOUNT': '1.030', 'weapon3': '1.732', 'DAMAGECOUNT': '5.469', 'FRAGCOUNT': '16.000'} [2023-02-24 20:25:11,131][213384] DAMAGECOUNT value on done: 706.0 [2023-02-24 20:25:11,132][213384] Sum rewards: 10.024, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.585', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.019', 'AMMO3': '0.030', 'WEAPON5': '0.100', 'weapon5': '0.102', 'weapon7': '0.184', 'WEAPON4': '0.200', 'WEAPON3': '0.250', 'AMMO6': '0.340', 'AMMO7': '0.340', 'WEAPON7': '0.500', 'weapon4': '0.504', 'HITCOUNT': '0.550', 'weapon2': '0.614', 'weapon3': '0.752', 'DAMAGECOUNT': '2.118', 'FRAGCOUNT': '7.000'} [2023-02-24 20:25:11,148][213382] DAMAGECOUNT value on done: 1820.0 [2023-02-24 20:25:11,149][213382] Sum rewards: 22.596, reward structure: {'DEATHCOUNT': '-5.250', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO5': '0.017', 'AMMO3': '0.060', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'weapon4': '0.278', 'weapon5': '0.302', 'HEALTH': '0.313', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.950', 'HITCOUNT': '1.200', 'weapon3': '1.358', 'DAMAGECOUNT': '5.460', 'FRAGCOUNT': '17.000'} [2023-02-24 20:25:11,151][213372] DAMAGECOUNT value on done: 1862.0 [2023-02-24 20:25:11,151][213372] Sum rewards: 25.577, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.173', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon7': '0.050', 'AMMO4': '0.070', 'AMMO3': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.204', 'WEAPON4': '0.250', 'weapon4': '0.386', 'WEAPON3': '0.550', 'weapon2': '1.078', 'HITCOUNT': '1.350', 'weapon3': '1.772', 'DAMAGECOUNT': '5.586', 'FRAGCOUNT': '22.000'} [2023-02-24 20:25:11,185][213366] DAMAGECOUNT value on done: 1749.0 [2023-02-24 20:25:11,185][213366] Sum rewards: 21.922, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.942', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.073', 'AMMO3': '0.097', 'weapon4': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon5': '0.376', 'WEAPON3': '0.700', 'weapon2': '1.076', 'HITCOUNT': '1.270', 'weapon3': '1.842', 'DAMAGECOUNT': '5.247', 'FRAGCOUNT': '20.000'} [2023-02-24 20:25:11,190][213383] DAMAGECOUNT value on done: 2381.0 [2023-02-24 20:25:11,191][213383] Sum rewards: 26.390, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.121', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.020', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.100', 'weapon5': '0.216', 'weapon4': '0.250', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon2': '0.934', 'HITCOUNT': '1.770', 'weapon3': '1.900', 'DAMAGECOUNT': '7.143', 'FRAGCOUNT': '20.000'} [2023-02-24 20:25:11,207][213367] DAMAGECOUNT value on done: 1419.0 [2023-02-24 20:25:11,207][213367] Sum rewards: 10.076, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.470', 'AMMO2': '0.032', 'ARMOR': '0.032', 'AMMO5': '0.035', 'AMMO3': '0.138', 'AMMO4': '0.159', 'WEAPON4': '0.350', 'weapon5': '0.420', 'weapon2': '0.452', 'weapon4': '0.486', 'HITCOUNT': '0.810', 'WEAPON5': '0.850', 'WEAPON3': '0.950', 'weapon3': '2.074', 'DAMAGECOUNT': '4.257', 'FRAGCOUNT': '11.000'} [2023-02-24 20:25:11,228][213368] DAMAGECOUNT value on done: 1474.0 [2023-02-24 20:25:11,228][213368] Sum rewards: 16.084, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.908', 'AMMO5': '0.005', 'AMMO2': '0.010', 'ARMOR': '0.036', 'weapon7': '0.046', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'AMMO3': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.156', 'WEAPON5': '0.200', 'weapon4': '0.276', 'WEAPON3': '0.700', 'weapon2': '0.764', 'HITCOUNT': '1.030', 'weapon3': '1.602', 'DAMAGECOUNT': '4.422', 'FRAGCOUNT': '14.000'} [2023-02-24 20:25:11,241][213369] DAMAGECOUNT value on done: 1413.0 [2023-02-24 20:25:11,241][213369] Sum rewards: 14.885, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.628', 'AMMO5': '0.022', 'AMMO2': '0.028', 'weapon7': '0.040', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.117', 'AMMO4': '0.139', 'weapon5': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.500', 'weapon4': '0.540', 'WEAPON3': '0.750', 'HITCOUNT': '0.920', 'weapon2': '0.952', 'weapon3': '1.692', 'DAMAGECOUNT': '4.239', 'FRAGCOUNT': '14.000'} [2023-02-24 20:25:11,430][213384] DAMAGECOUNT value on done: 2625.0 [2023-02-24 20:25:11,430][213384] Sum rewards: 23.713, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.114', 'AMMO5': '0.015', 'AMMO2': '0.054', 'AMMO3': '0.119', 'weapon5': '0.234', 'AMMO4': '0.272', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '0.750', 'weapon4': '0.824', 'weapon2': '0.846', 'weapon3': '1.648', 'HITCOUNT': '1.790', 'DAMAGECOUNT': '7.875', 'FRAGCOUNT': '20.000'} [2023-02-24 20:25:11,445][213382] DAMAGECOUNT value on done: 1335.0 [2023-02-24 20:25:11,445][213382] Sum rewards: 13.728, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.166', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO2': '0.023', 'ARMOR': '0.032', 'AMMO3': '0.090', 'weapon4': '0.112', 'AMMO4': '0.113', 'WEAPON4': '0.300', 'weapon5': '0.430', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'HITCOUNT': '0.720', 'weapon2': '1.126', 'weapon3': '1.502', 'DAMAGECOUNT': '4.005', 'FRAGCOUNT': '12.000'} [2023-02-24 20:25:11,452][213372] DAMAGECOUNT value on done: 1981.0 [2023-02-24 20:25:11,452][213372] Sum rewards: 24.072, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.760', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.026', 'weapon4': '0.078', 'AMMO3': '0.106', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'weapon5': '0.238', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '1.250', 'weapon2': '1.318', 'weapon3': '1.968', 'DAMAGECOUNT': '5.943', 'FRAGCOUNT': '20.000'} [2023-02-24 20:25:11,478][213366] DAMAGECOUNT value on done: 2687.0 [2023-02-24 20:25:11,479][213366] Sum rewards: 32.162, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.495', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO3': '0.118', 'AMMO4': '0.141', 'weapon5': '0.192', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.570', 'WEAPON3': '0.650', 'weapon2': '0.998', 'weapon3': '1.878', 'HITCOUNT': '2.110', 'DAMAGECOUNT': '8.061', 'FRAGCOUNT': '24.000'} [2023-02-24 20:25:11,497][213383] DAMAGECOUNT value on done: 2138.0 [2023-02-24 20:25:11,498][213383] Sum rewards: 21.126, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.281', 'AMMO5': '0.010', 'AMMO2': '0.013', 'ARMOR': '0.044', 'AMMO4': '0.063', 'AMMO3': '0.139', 'weapon4': '0.178', 'WEAPON4': '0.200', 'weapon5': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.950', 'weapon2': '1.302', 'HITCOUNT': '1.450', 'weapon3': '1.944', 'DAMAGECOUNT': '6.414', 'FRAGCOUNT': '20.000'} [2023-02-24 20:25:11,501][213367] DAMAGECOUNT value on done: 1718.0 [2023-02-24 20:25:11,501][213367] Sum rewards: 18.803, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.530', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'weapon4': '0.124', 'AMMO3': '0.145', 'weapon5': '0.318', 'WEAPON5': '0.600', 'weapon2': '0.608', 'WEAPON3': '0.850', 'HITCOUNT': '1.300', 'weapon3': '2.334', 'DAMAGECOUNT': '5.154', 'FRAGCOUNT': '17.000'} [2023-02-24 20:25:11,526][213369] DAMAGECOUNT value on done: 2013.0 [2023-02-24 20:25:11,527][213368] DAMAGECOUNT value on done: 2570.0 [2023-02-24 20:25:11,527][213369] Sum rewards: 20.837, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.580', 'AMMO5': '0.017', 'AMMO2': '0.032', 'ARMOR': '0.036', 'AMMO3': '0.139', 'AMMO4': '0.158', 'weapon5': '0.254', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.460', 'weapon2': '0.634', 'WEAPON3': '0.850', 'HITCOUNT': '1.610', 'weapon3': '2.038', 'DAMAGECOUNT': '6.039', 'FRAGCOUNT': '18.000'} [2023-02-24 20:25:11,527][213368] Sum rewards: 29.403, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.245', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon7': '0.050', 'AMMO3': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.122', 'WEAPON7': '0.200', 'weapon5': '0.306', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.482', 'WEAPON3': '0.500', 'weapon2': '0.850', 'weapon3': '1.250', 'HITCOUNT': '1.760', 'DAMAGECOUNT': '7.710', 'FRAGCOUNT': '23.000'} [2023-02-24 20:25:11,731][213384] DAMAGECOUNT value on done: 1173.0 [2023-02-24 20:25:11,731][213384] Sum rewards: 11.196, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.993', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'ARMOR': '0.004', 'AMMO5': '0.015', 'WEAPON4': '0.050', 'weapon4': '0.056', 'AMMO3': '0.092', 'weapon7': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.272', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.860', 'weapon2': '0.944', 'weapon3': '1.458', 'DAMAGECOUNT': '3.519', 'FRAGCOUNT': '11.000'} [2023-02-24 20:25:11,745][213382] DAMAGECOUNT value on done: 2952.0 [2023-02-24 20:25:11,745][213382] Sum rewards: 32.219, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.860', 'ARMOR': '0.004', 'AMMO2': '0.015', 'AMMO5': '0.022', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'weapon5': '0.202', 'weapon4': '0.246', 'WEAPON5': '0.450', 'weapon2': '0.748', 'WEAPON3': '1.100', 'HITCOUNT': '2.080', 'weapon3': '2.442', 'DAMAGECOUNT': '8.856', 'FRAGCOUNT': '27.000'} [2023-02-24 20:25:11,745][213372] DAMAGECOUNT value on done: 2293.0 [2023-02-24 20:25:11,746][213372] Sum rewards: 18.991, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.850', 'AMMO5': '0.024', 'AMMO2': '0.029', 'AMMO3': '0.133', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'weapon5': '0.390', 'WEAPON5': '0.550', 'weapon4': '0.598', 'WEAPON3': '0.800', 'weapon2': '0.856', 'HITCOUNT': '1.490', 'weapon3': '1.746', 'DAMAGECOUNT': '6.879', 'FRAGCOUNT': '15.000'} [2023-02-24 20:25:11,772][213366] DAMAGECOUNT value on done: 1452.0 [2023-02-24 20:25:11,773][213366] Sum rewards: 17.444, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.240', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.016', 'weapon7': '0.066', 'AMMO3': '0.077', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.306', 'weapon4': '0.346', 'WEAPON3': '0.550', 'HITCOUNT': '0.920', 'weapon2': '1.150', 'weapon3': '1.296', 'DAMAGECOUNT': '4.356', 'FRAGCOUNT': '14.000'} [2023-02-24 20:25:11,790][213367] DAMAGECOUNT value on done: 1896.0 [2023-02-24 20:25:11,791][213367] Sum rewards: 19.768, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.870', 'AMMO5': '0.017', 'AMMO2': '0.022', 'weapon7': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.122', 'weapon5': '0.186', 'weapon4': '0.262', 'WEAPON5': '0.400', 'weapon2': '0.728', 'WEAPON3': '0.800', 'HITCOUNT': '1.290', 'weapon3': '1.766', 'DAMAGECOUNT': '5.688', 'FRAGCOUNT': '17.000'} [2023-02-24 20:25:11,803][213383] DAMAGECOUNT value on done: 1315.0 [2023-02-24 20:25:11,804][213383] Sum rewards: 11.433, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.017', 'AMMO5': '0.016', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.175', 'weapon5': '0.198', 'WEAPON4': '0.200', 'weapon4': '0.216', 'WEAPON5': '0.350', 'weapon2': '0.608', 'HITCOUNT': '1.020', 'WEAPON3': '1.050', 'weapon3': '2.298', 'DAMAGECOUNT': '3.945', 'FRAGCOUNT': '12.000'} [2023-02-24 20:25:11,826][213368] DAMAGECOUNT value on done: 1802.0 [2023-02-24 20:25:11,827][213368] Sum rewards: 17.107, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.700', 'AMMO2': '0.005', 'AMMO5': '0.019', 'AMMO4': '0.027', 'weapon5': '0.110', 'AMMO3': '0.117', 'WEAPON4': '0.200', 'weapon4': '0.260', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'weapon2': '1.292', 'HITCOUNT': '1.420', 'weapon3': '1.950', 'DAMAGECOUNT': '5.406', 'FRAGCOUNT': '15.000'} [2023-02-24 20:25:11,830][213369] DAMAGECOUNT value on done: 2157.0 [2023-02-24 20:25:11,830][213369] Sum rewards: 21.933, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.612', 'AMMO5': '0.018', 'AMMO2': '0.022', 'weapon7': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'weapon4': '0.158', 'weapon5': '0.302', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon2': '1.280', 'HITCOUNT': '1.510', 'weapon3': '1.792', 'DAMAGECOUNT': '6.471', 'FRAGCOUNT': '18.000'} [2023-02-24 20:25:13,172][213365] Updated weights for policy 0, policy_version 24486 (0.0009) [2023-02-24 20:25:15,243][213332] Fps is (10 sec: 14336.0, 60 sec: 12615.7, 300 sec: 12615.7). Total num frames: 100323328. Throughput: 0: 3042.3. Samples: 76056. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 20:25:15,243][213332] Avg episode reward: [(0, '18.908')] [2023-02-24 20:25:16,076][213365] Updated weights for policy 0, policy_version 24496 (0.0009) [2023-02-24 20:25:18,984][213365] Updated weights for policy 0, policy_version 24506 (0.0009) [2023-02-24 20:25:19,583][213383] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 20:25:20,243][213332] Fps is (10 sec: 14335.9, 60 sec: 12834.2, 300 sec: 12834.2). Total num frames: 100392960. Throughput: 0: 2886.9. Samples: 86608. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 20:25:20,243][213332] Avg episode reward: [(0, '18.908')] [2023-02-24 20:25:21,697][213366] Large shaping reward 2.541 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.519, 173.0), ('weapon5', 0.002)] [2023-02-24 20:25:21,890][213365] Updated weights for policy 0, policy_version 24516 (0.0008) [2023-02-24 20:25:24,825][213365] Updated weights for policy 0, policy_version 24526 (0.0009) [2023-02-24 20:25:25,243][213332] Fps is (10 sec: 13926.5, 60 sec: 12990.2, 300 sec: 12990.2). Total num frames: 100462592. Throughput: 0: 3076.4. Samples: 107674. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 20:25:25,244][213332] Avg episode reward: [(0, '18.908')] [2023-02-24 20:25:27,754][213365] Updated weights for policy 0, policy_version 24536 (0.0009) [2023-02-24 20:25:28,037][213369] Large shaping reward 2.538 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.516, 172.0), ('weapon5', 0.002)] [2023-02-24 20:25:29,945][213367] DAMAGECOUNT value on done: 3569.0 [2023-02-24 20:25:29,946][213367] Sum rewards: 14.861, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.024', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.033', 'weapon7': '0.062', 'AMMO3': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'WEAPON4': '0.300', 'weapon5': '0.306', 'weapon2': '0.372', 'WEAPON3': '0.500', 'weapon4': '0.642', 'HITCOUNT': '1.020', 'weapon3': '1.536', 'DAMAGECOUNT': '4.143', 'FRAGCOUNT': '12.000'} [2023-02-24 20:25:29,968][213372] DAMAGECOUNT value on done: 4032.0 [2023-02-24 20:25:29,969][213372] Sum rewards: 26.906, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.360', 'AMMO5': '0.017', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.193', 'weapon5': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.406', 'weapon2': '0.652', 'WEAPON3': '1.150', 'HITCOUNT': '2.150', 'weapon3': '2.374', 'DAMAGECOUNT': '8.823', 'FRAGCOUNT': '25.000'} [2023-02-24 20:25:29,981][213366] DAMAGECOUNT value on done: 3272.0 [2023-02-24 20:25:29,982][213366] Sum rewards: 22.849, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.366', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.180', 'weapon5': '0.202', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.442', 'weapon4': '0.646', 'WEAPON3': '1.200', 'HITCOUNT': '1.780', 'weapon3': '2.324', 'DAMAGECOUNT': '6.981', 'FRAGCOUNT': '21.000'} [2023-02-24 20:25:29,987][213384] DAMAGECOUNT value on done: 2527.0 [2023-02-24 20:25:29,987][213384] Sum rewards: 15.805, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.450', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon7': '0.066', 'AMMO3': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.188', 'weapon5': '0.344', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.504', 'WEAPON3': '0.600', 'weapon2': '0.806', 'HITCOUNT': '1.090', 'weapon3': '1.510', 'DAMAGECOUNT': '4.008', 'FRAGCOUNT': '15.000'} [2023-02-24 20:25:29,999][213382] DAMAGECOUNT value on done: 4027.0 [2023-02-24 20:25:29,999][213382] Sum rewards: 28.682, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.944', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.114', 'AMMO4': '0.149', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.506', 'weapon2': '0.510', 'WEAPON3': '1.150', 'HITCOUNT': '2.370', 'weapon3': '2.542', 'DAMAGECOUNT': '9.093', 'FRAGCOUNT': '26.000'} [2023-02-24 20:25:30,063][213368] DAMAGECOUNT value on done: 4101.0 [2023-02-24 20:25:30,063][213368] Sum rewards: 14.101, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.265', 'ARMOR': '0.004', 'AMMO2': '0.012', 'AMMO5': '0.020', 'weapon7': '0.056', 'AMMO4': '0.061', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.226', 'WEAPON4': '0.350', 'weapon4': '0.482', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'weapon2': '0.808', 'HITCOUNT': '0.880', 'weapon3': '1.356', 'DAMAGECOUNT': '4.161', 'FRAGCOUNT': '13.000'} [2023-02-24 20:25:30,080][213383] DAMAGECOUNT value on done: 4518.0 [2023-02-24 20:25:30,081][213383] Sum rewards: 26.220, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.280', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO3': '0.099', 'AMMO4': '0.123', 'weapon5': '0.288', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.472', 'WEAPON3': '0.700', 'weapon2': '0.904', 'weapon3': '1.704', 'HITCOUNT': '1.750', 'DAMAGECOUNT': '7.725', 'FRAGCOUNT': '22.000'} [2023-02-24 20:25:30,133][213369] DAMAGECOUNT value on done: 4340.0 [2023-02-24 20:25:30,133][213369] Sum rewards: 20.731, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.074', 'AMMO5': '0.023', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.135', 'WEAPON4': '0.250', 'weapon5': '0.352', 'weapon4': '0.410', 'WEAPON5': '0.550', 'weapon2': '0.718', 'WEAPON3': '0.900', 'HITCOUNT': '1.790', 'weapon3': '2.008', 'DAMAGECOUNT': '7.521', 'FRAGCOUNT': '18.500'} [2023-02-24 20:25:30,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13107.2, 300 sec: 13107.2). Total num frames: 100532224. Throughput: 0: 3218.6. Samples: 128742. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 20:25:30,243][213332] Avg episode reward: [(0, '19.380')] [2023-02-24 20:25:30,246][213367] DAMAGECOUNT value on done: 3356.0 [2023-02-24 20:25:30,246][213367] Sum rewards: 18.675, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.240', 'AMMO5': '0.020', 'AMMO2': '0.020', 'weapon7': '0.064', 'AMMO3': '0.096', 'AMMO4': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.250', 'weapon5': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon2': '0.666', 'WEAPON3': '0.700', 'HITCOUNT': '1.300', 'weapon3': '1.556', 'DAMAGECOUNT': '5.811', 'FRAGCOUNT': '17.000'} [2023-02-24 20:25:30,273][213372] DAMAGECOUNT value on done: 4507.0 [2023-02-24 20:25:30,274][213372] Sum rewards: 28.893, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.372', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.015', 'weapon5': '0.146', 'AMMO3': '0.156', 'WEAPON5': '0.300', 'weapon2': '0.724', 'WEAPON3': '1.050', 'HITCOUNT': '1.970', 'weapon3': '2.736', 'DAMAGECOUNT': '7.935', 'FRAGCOUNT': '25.000'} [2023-02-24 20:25:30,275][213366] DAMAGECOUNT value on done: 4233.0 [2023-02-24 20:25:30,276][213366] Sum rewards: 25.145, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.460', 'AMMO2': '0.020', 'AMMO5': '0.024', 'AMMO4': '0.097', 'AMMO3': '0.192', 'weapon5': '0.196', 'WEAPON4': '0.300', 'weapon4': '0.402', 'weapon2': '0.454', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'HITCOUNT': '1.660', 'weapon3': '2.458', 'DAMAGECOUNT': '7.452', 'FRAGCOUNT': '26.000'} [2023-02-24 20:25:30,290][213384] DAMAGECOUNT value on done: 3327.0 [2023-02-24 20:25:30,290][213384] Sum rewards: 23.193, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.175', 'AMMO5': '0.015', 'AMMO2': '0.042', 'AMMO3': '0.153', 'AMMO4': '0.212', 'weapon5': '0.352', 'weapon2': '0.354', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.548', 'WEAPON3': '1.050', 'HITCOUNT': '1.910', 'weapon3': '2.218', 'DAMAGECOUNT': '7.863', 'FRAGCOUNT': '22.000'} [2023-02-24 20:25:30,293][213382] DAMAGECOUNT value on done: 3640.0 [2023-02-24 20:25:30,294][213382] Sum rewards: 26.592, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.616', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon7': '0.048', 'weapon5': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.121', 'AMMO4': '0.121', 'WEAPON4': '0.200', 'weapon4': '0.570', 'WEAPON3': '0.700', 'weapon2': '0.770', 'HITCOUNT': '1.400', 'weapon3': '1.820', 'DAMAGECOUNT': '5.460', 'FRAGCOUNT': '23.000'} [2023-02-24 20:25:30,354][213368] DAMAGECOUNT value on done: 4270.0 [2023-02-24 20:25:30,356][213368] Sum rewards: 24.396, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.688', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.021', 'AMMO2': '0.029', 'AMMO4': '0.143', 'AMMO3': '0.159', 'weapon5': '0.270', 'WEAPON4': '0.350', 'weapon4': '0.388', 'WEAPON5': '0.450', 'weapon2': '0.686', 'WEAPON3': '1.000', 'HITCOUNT': '1.700', 'weapon3': '2.236', 'DAMAGECOUNT': '8.388', 'FRAGCOUNT': '23.000'} [2023-02-24 20:25:30,379][213383] DAMAGECOUNT value on done: 4609.0 [2023-02-24 20:25:30,379][213383] Sum rewards: 23.943, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.544', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'ARMOR': '0.004', 'AMMO5': '0.027', 'weapon4': '0.054', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.398', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'weapon2': '0.880', 'HITCOUNT': '1.400', 'weapon3': '1.940', 'DAMAGECOUNT': '6.684', 'FRAGCOUNT': '20.000'} [2023-02-24 20:25:30,436][213369] DAMAGECOUNT value on done: 3966.0 [2023-02-24 20:25:30,436][213369] Sum rewards: 30.846, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.955', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'AMMO5': '0.028', 'weapon5': '0.132', 'AMMO3': '0.148', 'WEAPON5': '0.400', 'weapon2': '0.890', 'WEAPON3': '1.150', 'HITCOUNT': '1.820', 'weapon3': '2.626', 'DAMAGECOUNT': '7.659', 'FRAGCOUNT': '28.000'} [2023-02-24 20:25:30,542][213367] DAMAGECOUNT value on done: 3695.0 [2023-02-24 20:25:30,543][213367] Sum rewards: 21.297, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.316', 'ARMOR': '0.004', 'AMMO2': '0.013', 'AMMO5': '0.017', 'AMMO4': '0.063', 'AMMO3': '0.099', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.200', 'weapon5': '0.224', 'weapon4': '0.246', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'weapon2': '0.984', 'HITCOUNT': '1.590', 'weapon3': '1.992', 'DAMAGECOUNT': '5.931', 'FRAGCOUNT': '18.000'} [2023-02-24 20:25:30,572][213366] DAMAGECOUNT value on done: 4804.0 [2023-02-24 20:25:30,572][213366] Sum rewards: 26.671, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.901', 'AMMO2': '0.015', 'AMMO5': '0.017', 'AMMO4': '0.075', 'AMMO3': '0.083', 'WEAPON4': '0.200', 'weapon5': '0.204', 'WEAPON5': '0.450', 'weapon2': '0.490', 'WEAPON3': '0.600', 'weapon4': '0.674', 'HITCOUNT': '1.560', 'weapon3': '1.602', 'DAMAGECOUNT': '6.351', 'FRAGCOUNT': '22.000'} [2023-02-24 20:25:30,580][213372] DAMAGECOUNT value on done: 3340.0 [2023-02-24 20:25:30,580][213372] Sum rewards: 14.615, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.480', 'AMMO5': '0.020', 'AMMO2': '0.028', 'AMMO3': '0.105', 'AMMO4': '0.140', 'WEAPON4': '0.250', 'weapon5': '0.386', 'weapon4': '0.410', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.940', 'weapon2': '1.168', 'weapon3': '1.470', 'DAMAGECOUNT': '4.077', 'FRAGCOUNT': '12.500'} [2023-02-24 20:25:30,593][213384] DAMAGECOUNT value on done: 5068.0 [2023-02-24 20:25:30,593][213382] DAMAGECOUNT value on done: 2764.0 [2023-02-24 20:25:30,593][213384] Sum rewards: 22.729, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.230', 'WEAPON1': '0.020', 'AMMO5': '0.026', 'AMMO2': '0.026', 'AMMO3': '0.124', 'AMMO4': '0.131', 'weapon4': '0.278', 'WEAPON4': '0.350', 'weapon5': '0.406', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'weapon2': '0.818', 'HITCOUNT': '1.530', 'weapon3': '2.070', 'DAMAGECOUNT': '7.329', 'FRAGCOUNT': '20.000'} [2023-02-24 20:25:30,594][213382] Sum rewards: 12.198, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.270', 'AMMO5': '0.017', 'AMMO2': '0.018', 'weapon7': '0.048', 'AMMO3': '0.073', 'AMMO4': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.454', 'WEAPON3': '0.500', 'HITCOUNT': '0.990', 'weapon2': '1.106', 'weapon3': '1.344', 'DAMAGECOUNT': '4.287', 'FRAGCOUNT': '10.000'} [2023-02-24 20:25:30,649][213368] DAMAGECOUNT value on done: 5160.0 [2023-02-24 20:25:30,650][213368] Sum rewards: 23.451, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.960', 'AMMO5': '0.017', 'AMMO2': '0.022', 'AMMO4': '0.109', 'AMMO3': '0.184', 'weapon5': '0.212', 'WEAPON4': '0.250', 'weapon4': '0.348', 'WEAPON5': '0.400', 'weapon2': '0.492', 'WEAPON3': '1.150', 'HITCOUNT': '1.970', 'weapon3': '2.486', 'DAMAGECOUNT': '7.770', 'FRAGCOUNT': '20.500'} [2023-02-24 20:25:30,670][213383] DAMAGECOUNT value on done: 3309.0 [2023-02-24 20:25:30,671][213383] Sum rewards: 9.146, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.700', 'AMMO5': '0.022', 'AMMO2': '0.045', 'AMMO3': '0.107', 'AMMO4': '0.223', 'weapon4': '0.274', 'weapon5': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '0.750', 'weapon2': '1.142', 'weapon3': '1.872', 'DAMAGECOUNT': '3.513', 'FRAGCOUNT': '9.000'} [2023-02-24 20:25:30,711][213365] Updated weights for policy 0, policy_version 24546 (0.0009) [2023-02-24 20:25:30,738][213369] DAMAGECOUNT value on done: 3802.0 [2023-02-24 20:25:30,738][213369] Sum rewards: 20.816, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.891', 'AMMO2': '0.004', 'AMMO5': '0.016', 'AMMO4': '0.021', 'weapon7': '0.054', 'AMMO3': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.276', 'weapon4': '0.280', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'weapon2': '0.954', 'HITCOUNT': '1.100', 'weapon3': '1.642', 'DAMAGECOUNT': '5.367', 'FRAGCOUNT': '17.000'} [2023-02-24 20:25:30,830][213367] DAMAGECOUNT value on done: 4157.0 [2023-02-24 20:25:30,831][213367] Sum rewards: 15.422, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.376', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.046', 'AMMO3': '0.199', 'AMMO4': '0.231', 'weapon5': '0.250', 'WEAPON5': '0.450', 'weapon2': '0.522', 'WEAPON4': '0.550', 'weapon4': '0.572', 'WEAPON3': '1.050', 'HITCOUNT': '1.620', 'weapon3': '2.248', 'DAMAGECOUNT': '6.783', 'FRAGCOUNT': '18.000'} [2023-02-24 20:25:30,875][213366] DAMAGECOUNT value on done: 3566.0 [2023-02-24 20:25:30,875][213366] Sum rewards: 21.695, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.090', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.141', 'WEAPON4': '0.200', 'weapon4': '0.252', 'weapon5': '0.298', 'WEAPON5': '0.400', 'weapon2': '0.444', 'WEAPON3': '0.800', 'HITCOUNT': '1.500', 'weapon3': '2.504', 'DAMAGECOUNT': '6.342', 'FRAGCOUNT': '20.000'} [2023-02-24 20:25:30,878][213384] DAMAGECOUNT value on done: 3614.0 [2023-02-24 20:25:30,878][213384] Sum rewards: 23.985, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.806', 'ARMOR': '0.004', 'AMMO2': '0.017', 'AMMO5': '0.032', 'AMMO4': '0.084', 'AMMO3': '0.159', 'weapon4': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.364', 'weapon5': '0.402', 'WEAPON5': '0.700', 'WEAPON3': '1.000', 'HITCOUNT': '1.680', 'weapon3': '2.576', 'DAMAGECOUNT': '7.323', 'FRAGCOUNT': '22.000'} [2023-02-24 20:25:30,884][213372] DAMAGECOUNT value on done: 4440.0 [2023-02-24 20:25:30,884][213372] Sum rewards: 16.001, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.146', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.034', 'AMMO4': '0.172', 'AMMO3': '0.173', 'weapon5': '0.254', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'weapon4': '0.612', 'weapon2': '0.638', 'WEAPON3': '1.150', 'HITCOUNT': '1.540', 'weapon3': '2.058', 'DAMAGECOUNT': '6.441', 'FRAGCOUNT': '20.000'} [2023-02-24 20:25:30,900][213382] DAMAGECOUNT value on done: 4442.0 [2023-02-24 20:25:30,900][213382] Sum rewards: 16.104, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.810', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.119', 'AMMO4': '0.167', 'WEAPON4': '0.250', 'weapon5': '0.276', 'weapon4': '0.286', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '1.050', 'weapon3': '1.350', 'weapon2': '1.446', 'DAMAGECOUNT': '4.470', 'FRAGCOUNT': '15.000'} [2023-02-24 20:25:30,948][213368] DAMAGECOUNT value on done: 3921.0 [2023-02-24 20:25:30,948][213368] Sum rewards: 17.587, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.867', 'AMMO2': '0.021', 'AMMO5': '0.023', 'AMMO4': '0.104', 'AMMO3': '0.145', 'WEAPON4': '0.250', 'weapon5': '0.276', 'weapon4': '0.336', 'weapon2': '0.482', 'WEAPON5': '0.550', 'WEAPON3': '1.050', 'HITCOUNT': '1.680', 'weapon3': '2.430', 'DAMAGECOUNT': '6.357', 'FRAGCOUNT': '17.000'} [2023-02-24 20:25:30,963][213383] DAMAGECOUNT value on done: 3740.0 [2023-02-24 20:25:30,964][213383] Sum rewards: 26.631, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.572', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon7': '0.052', 'AMMO4': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.137', 'WEAPON7': '0.200', 'weapon5': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.332', 'weapon2': '0.784', 'WEAPON3': '1.000', 'HITCOUNT': '1.760', 'weapon3': '2.158', 'DAMAGECOUNT': '7.275', 'FRAGCOUNT': '23.000'} [2023-02-24 20:25:31,043][213369] DAMAGECOUNT value on done: 3294.0 [2023-02-24 20:25:31,043][213369] Sum rewards: 13.636, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.430', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon4': '0.034', 'AMMO3': '0.050', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'weapon5': '0.236', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'ARMOR': '0.545', 'HITCOUNT': '0.660', 'weapon2': '0.908', 'weapon3': '1.166', 'DAMAGECOUNT': '3.291', 'FRAGCOUNT': '10.000'} [2023-02-24 20:25:33,625][213365] Updated weights for policy 0, policy_version 24556 (0.0009) [2023-02-24 20:25:35,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13198.3, 300 sec: 13198.3). Total num frames: 100601856. Throughput: 0: 3093.3. Samples: 139200. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 20:25:35,243][213332] Avg episode reward: [(0, '19.982')] [2023-02-24 20:25:36,512][213365] Updated weights for policy 0, policy_version 24566 (0.0008) [2023-02-24 20:25:39,456][213365] Updated weights for policy 0, policy_version 24576 (0.0009) [2023-02-24 20:25:40,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13271.1, 300 sec: 13271.1). Total num frames: 100671488. Throughput: 0: 3514.5. Samples: 160388. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 20:25:40,243][213332] Avg episode reward: [(0, '19.982')] [2023-02-24 20:25:42,415][213365] Updated weights for policy 0, policy_version 24586 (0.0008) [2023-02-24 20:25:45,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13330.7, 300 sec: 13330.7). Total num frames: 100741120. Throughput: 0: 3520.9. Samples: 181314. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:25:45,243][213332] Avg episode reward: [(0, '19.982')] [2023-02-24 20:25:45,332][213365] Updated weights for policy 0, policy_version 24596 (0.0009) [2023-02-24 20:25:48,264][213365] Updated weights for policy 0, policy_version 24606 (0.0009) [2023-02-24 20:25:49,015][213382] Large shaping reward 2.542 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.51, 170.0), ('weapon7', 0.002)] [2023-02-24 20:25:49,138][213366] DAMAGECOUNT value on done: 5428.0 [2023-02-24 20:25:49,139][213366] Sum rewards: 19.811, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.924', 'AMMO5': '0.020', 'AMMO2': '0.034', 'AMMO3': '0.090', 'AMMO4': '0.170', 'weapon4': '0.190', 'WEAPON4': '0.400', 'weapon5': '0.460', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'weapon2': '1.068', 'HITCOUNT': '1.360', 'weapon3': '1.774', 'DAMAGECOUNT': '6.468', 'FRAGCOUNT': '18.000'} [2023-02-24 20:25:49,152][213367] DAMAGECOUNT value on done: 5430.0 [2023-02-24 20:25:49,153][213367] Sum rewards: 22.176, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.410', 'AMMO2': '0.023', 'AMMO5': '0.024', 'AMMO4': '0.116', 'AMMO3': '0.125', 'weapon4': '0.142', 'WEAPON4': '0.250', 'weapon5': '0.306', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon2': '1.216', 'HITCOUNT': '1.370', 'weapon3': '1.880', 'DAMAGECOUNT': '5.583', 'FRAGCOUNT': '20.000'} [2023-02-24 20:25:49,201][213384] DAMAGECOUNT value on done: 4912.0 [2023-02-24 20:25:49,201][213384] Sum rewards: 29.379, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.094', 'AMMO2': '0.013', 'AMMO5': '0.018', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'weapon4': '0.168', 'AMMO3': '0.169', 'weapon5': '0.432', 'WEAPON5': '0.450', 'weapon2': '0.568', 'WEAPON3': '1.000', 'HITCOUNT': '1.590', 'weapon3': '2.498', 'DAMAGECOUNT': '7.155', 'FRAGCOUNT': '26.000'} [2023-02-24 20:25:49,212][213372] DAMAGECOUNT value on done: 5786.0 [2023-02-24 20:25:49,213][213372] Sum rewards: 16.253, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.255', 'AMMO5': '0.029', 'AMMO2': '0.035', 'AMMO3': '0.125', 'AMMO4': '0.176', 'weapon5': '0.304', 'weapon2': '0.388', 'WEAPON4': '0.400', 'WEAPON5': '0.600', 'weapon4': '0.644', 'WEAPON3': '0.900', 'HITCOUNT': '1.240', 'weapon3': '2.154', 'DAMAGECOUNT': '5.262', 'FRAGCOUNT': '15.000'} [2023-02-24 20:25:49,221][213382] DAMAGECOUNT value on done: 6769.0 [2023-02-24 20:25:49,221][213382] Sum rewards: 30.569, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.168', 'AMMO2': '0.017', 'AMMO5': '0.022', 'AMMO4': '0.085', 'AMMO3': '0.098', 'WEAPON4': '0.350', 'weapon5': '0.382', 'WEAPON5': '0.600', 'weapon4': '0.608', 'weapon2': '0.636', 'WEAPON3': '0.700', 'HITCOUNT': '1.660', 'weapon3': '1.852', 'DAMAGECOUNT': '8.226', 'FRAGCOUNT': '24.000'} [2023-02-24 20:25:49,233][213383] DAMAGECOUNT value on done: 5594.0 [2023-02-24 20:25:49,233][213383] Sum rewards: 8.870, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.068', 'AMMO2': '0.019', 'AMMO5': '0.026', 'AMMO4': '0.097', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'weapon4': '0.212', 'weapon5': '0.406', 'WEAPON5': '0.700', 'HITCOUNT': '0.860', 'WEAPON3': '1.050', 'weapon2': '1.272', 'weapon3': '1.702', 'DAMAGECOUNT': '3.228', 'FRAGCOUNT': '10.000'} [2023-02-24 20:25:49,257][213368] DAMAGECOUNT value on done: 6395.0 [2023-02-24 20:25:49,258][213368] Sum rewards: 25.885, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.314', 'AMMO5': '0.022', 'AMMO2': '0.030', 'weapon4': '0.086', 'AMMO4': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'weapon5': '0.350', 'WEAPON5': '0.600', 'weapon2': '0.826', 'WEAPON3': '1.200', 'HITCOUNT': '1.580', 'weapon3': '2.398', 'DAMAGECOUNT': '6.882', 'FRAGCOUNT': '25.000'} [2023-02-24 20:25:49,344][213369] DAMAGECOUNT value on done: 6922.0 [2023-02-24 20:25:49,345][213369] Sum rewards: 32.381, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.628', 'AMMO5': '0.017', 'AMMO2': '0.020', 'AMMO4': '0.098', 'AMMO3': '0.112', 'WEAPON4': '0.250', 'weapon5': '0.262', 'WEAPON5': '0.450', 'weapon4': '0.476', 'weapon2': '0.512', 'WEAPON3': '0.750', 'HITCOUNT': '1.780', 'weapon3': '2.286', 'DAMAGECOUNT': '7.746', 'FRAGCOUNT': '25.000'} [2023-02-24 20:25:49,435][213366] DAMAGECOUNT value on done: 6506.0 [2023-02-24 20:25:49,435][213366] Sum rewards: 16.669, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.258', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon7': '0.056', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.149', 'AMMO3': '0.168', 'weapon4': '0.178', 'weapon5': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon2': '1.202', 'HITCOUNT': '1.280', 'weapon3': '1.712', 'DAMAGECOUNT': '6.819', 'FRAGCOUNT': '16.000'} [2023-02-24 20:25:49,454][213367] DAMAGECOUNT value on done: 6266.0 [2023-02-24 20:25:49,455][213367] Sum rewards: 26.253, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.320', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.187', 'weapon5': '0.262', 'weapon4': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.692', 'WEAPON3': '1.200', 'HITCOUNT': '1.980', 'weapon3': '2.372', 'DAMAGECOUNT': '8.730', 'FRAGCOUNT': '24.000'} [2023-02-24 20:25:49,497][213384] DAMAGECOUNT value on done: 5278.0 [2023-02-24 20:25:49,497][213384] Sum rewards: 22.448, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.117', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO5': '0.015', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.176', 'WEAPON7': '0.200', 'weapon5': '0.328', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'weapon2': '0.938', 'HITCOUNT': '1.270', 'weapon3': '1.510', 'DAMAGECOUNT': '5.853', 'FRAGCOUNT': '17.000'} [2023-02-24 20:25:49,503][213372] DAMAGECOUNT value on done: 7638.0 [2023-02-24 20:25:49,503][213372] Sum rewards: 31.073, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.819', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.042', 'AMMO3': '0.139', 'WEAPON4': '0.150', 'weapon4': '0.152', 'weapon5': '0.220', 'WEAPON5': '0.250', 'WEAPON3': '0.900', 'weapon2': '0.966', 'HITCOUNT': '2.060', 'weapon3': '2.354', 'DAMAGECOUNT': '9.393', 'FRAGCOUNT': '25.000'} [2023-02-24 20:25:49,518][213382] DAMAGECOUNT value on done: 6266.0 [2023-02-24 20:25:49,518][213382] Sum rewards: 25.728, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.224', 'AMMO5': '0.017', 'AMMO2': '0.022', 'weapon7': '0.048', 'AMMO4': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.161', 'WEAPON7': '0.200', 'weapon5': '0.236', 'WEAPON4': '0.350', 'weapon4': '0.358', 'WEAPON5': '0.400', 'weapon2': '0.576', 'WEAPON3': '0.950', 'HITCOUNT': '1.720', 'weapon3': '2.186', 'DAMAGECOUNT': '7.878', 'FRAGCOUNT': '22.000'} [2023-02-24 20:25:49,533][213383] DAMAGECOUNT value on done: 7118.0 [2023-02-24 20:25:49,533][213383] Sum rewards: 22.164, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.590', 'AMMO2': '0.021', 'AMMO5': '0.022', 'AMMO4': '0.107', 'AMMO3': '0.146', 'WEAPON4': '0.200', 'weapon5': '0.316', 'weapon4': '0.346', 'WEAPON5': '0.600', 'weapon2': '0.850', 'WEAPON3': '0.950', 'HITCOUNT': '1.450', 'weapon3': '1.968', 'DAMAGECOUNT': '7.527', 'FRAGCOUNT': '19.000'} [2023-02-24 20:25:49,546][213368] DAMAGECOUNT value on done: 6622.0 [2023-02-24 20:25:49,546][213368] Sum rewards: 17.202, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.142', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon5': '0.106', 'AMMO3': '0.119', 'AMMO4': '0.153', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.452', 'weapon2': '0.568', 'WEAPON3': '0.750', 'HITCOUNT': '1.650', 'weapon3': '1.994', 'DAMAGECOUNT': '7.056', 'FRAGCOUNT': '16.000'} [2023-02-24 20:25:49,643][213369] DAMAGECOUNT value on done: 6265.0 [2023-02-24 20:25:49,644][213369] Sum rewards: 16.306, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.352', 'ARMOR': '0.008', 'AMMO2': '0.018', 'AMMO5': '0.020', 'AMMO4': '0.090', 'AMMO3': '0.156', 'WEAPON4': '0.250', 'weapon4': '0.434', 'weapon5': '0.532', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'weapon2': '0.978', 'HITCOUNT': '1.320', 'weapon3': '1.604', 'DAMAGECOUNT': '6.897', 'FRAGCOUNT': '16.000'} [2023-02-24 20:25:49,724][213366] DAMAGECOUNT value on done: 6817.0 [2023-02-24 20:25:49,724][213366] Sum rewards: 23.284, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.440', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO3': '0.066', 'weapon7': '0.082', 'AMMO4': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.292', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'weapon4': '0.508', 'weapon2': '0.900', 'HITCOUNT': '1.290', 'weapon3': '1.488', 'DAMAGECOUNT': '6.039', 'FRAGCOUNT': '16.000'} [2023-02-24 20:25:49,748][213367] DAMAGECOUNT value on done: 6418.0 [2023-02-24 20:25:49,748][213367] Sum rewards: 24.745, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.034', 'ARMOR': '0.004', 'AMMO2': '0.015', 'AMMO5': '0.017', 'weapon7': '0.052', 'AMMO4': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.168', 'weapon5': '0.188', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.224', 'WEAPON5': '0.450', 'weapon2': '0.858', 'WEAPON3': '1.150', 'HITCOUNT': '1.960', 'weapon3': '2.312', 'DAMAGECOUNT': '8.169', 'FRAGCOUNT': '21.000'} [2023-02-24 20:25:49,797][213384] DAMAGECOUNT value on done: 7629.0 [2023-02-24 20:25:49,797][213384] Sum rewards: 29.103, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.314', 'ARMOR': '0.004', 'AMMO2': '0.025', 'AMMO5': '0.025', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.102', 'AMMO4': '0.124', 'weapon2': '0.244', 'weapon5': '0.338', 'WEAPON4': '0.350', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'weapon4': '0.722', 'HITCOUNT': '1.490', 'weapon3': '1.512', 'DAMAGECOUNT': '7.683', 'FRAGCOUNT': '23.000'} [2023-02-24 20:25:49,808][213372] DAMAGECOUNT value on done: 4578.0 [2023-02-24 20:25:49,808][213372] Sum rewards: 13.419, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.186', 'AMMO5': '0.021', 'AMMO2': '0.028', 'AMMO3': '0.118', 'AMMO4': '0.141', 'weapon4': '0.200', 'WEAPON4': '0.300', 'weapon5': '0.368', 'weapon2': '0.542', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'HITCOUNT': '0.930', 'weapon3': '2.142', 'DAMAGECOUNT': '3.714', 'FRAGCOUNT': '13.000'} [2023-02-24 20:25:49,819][213382] DAMAGECOUNT value on done: 5452.0 [2023-02-24 20:25:49,820][213382] Sum rewards: 29.143, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.292', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon5': '0.146', 'AMMO3': '0.163', 'AMMO4': '0.177', 'WEAPON5': '0.400', 'weapon4': '0.588', 'WEAPON4': '0.600', 'weapon2': '0.686', 'WEAPON3': '1.100', 'HITCOUNT': '2.190', 'weapon3': '2.264', 'DAMAGECOUNT': '8.064', 'FRAGCOUNT': '27.000'} [2023-02-24 20:25:49,832][213383] DAMAGECOUNT value on done: 5235.0 [2023-02-24 20:25:49,832][213383] Sum rewards: 22.243, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.161', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.035', 'AMMO3': '0.122', 'weapon5': '0.164', 'AMMO4': '0.176', 'weapon4': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'HITCOUNT': '1.330', 'weapon2': '1.540', 'weapon3': '1.736', 'DAMAGECOUNT': '5.778', 'FRAGCOUNT': '20.500'} [2023-02-24 20:25:49,838][213368] DAMAGECOUNT value on done: 7263.0 [2023-02-24 20:25:49,839][213368] Sum rewards: 24.938, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.130', 'AMMO5': '0.007', 'AMMO2': '0.033', 'AMMO3': '0.087', 'AMMO4': '0.165', 'weapon5': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'WEAPON3': '0.600', 'weapon4': '0.742', 'weapon2': '0.980', 'HITCOUNT': '1.720', 'weapon3': '1.738', 'DAMAGECOUNT': '6.309', 'FRAGCOUNT': '21.000'} [2023-02-24 20:25:49,926][213369] DAMAGECOUNT value on done: 6479.0 [2023-02-24 20:25:49,927][213369] Sum rewards: 31.331, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.324', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO5': '0.022', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'weapon5': '0.204', 'weapon4': '0.216', 'WEAPON5': '0.550', 'weapon2': '1.046', 'WEAPON3': '1.050', 'HITCOUNT': '1.990', 'weapon3': '2.224', 'DAMAGECOUNT': '8.031', 'FRAGCOUNT': '27.000'} [2023-02-24 20:25:50,030][213366] DAMAGECOUNT value on done: 5702.0 [2023-02-24 20:25:50,031][213366] Sum rewards: 25.371, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.053', 'AMMO5': '0.025', 'AMMO2': '0.037', 'AMMO3': '0.140', 'AMMO4': '0.187', 'WEAPON4': '0.200', 'weapon5': '0.312', 'weapon2': '0.342', 'weapon4': '0.524', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'HITCOUNT': '1.270', 'weapon3': '1.928', 'DAMAGECOUNT': '6.408', 'FRAGCOUNT': '21.000'} [2023-02-24 20:25:50,047][213367] DAMAGECOUNT value on done: 6420.0 [2023-02-24 20:25:50,048][213367] Sum rewards: 30.770, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.364', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO3': '0.050', 'weapon7': '0.054', 'AMMO4': '0.157', 'weapon5': '0.174', 'WEAPON5': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'weapon2': '0.344', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.400', 'weapon4': '0.758', 'weapon3': '1.046', 'HITCOUNT': '1.530', 'DAMAGECOUNT': '6.789', 'FRAGCOUNT': '23.000'} [2023-02-24 20:25:50,095][213384] DAMAGECOUNT value on done: 5646.0 [2023-02-24 20:25:50,096][213384] Sum rewards: 18.396, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.970', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.011', 'weapon7': '0.058', 'WEAPON4': '0.100', 'weapon4': '0.114', 'AMMO3': '0.146', 'weapon5': '0.170', 'WEAPON5': '0.300', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'WEAPON3': '0.950', 'weapon2': '1.104', 'HITCOUNT': '1.600', 'weapon3': '1.938', 'DAMAGECOUNT': '6.096', 'FRAGCOUNT': '15.000'} [2023-02-24 20:25:50,108][213372] DAMAGECOUNT value on done: 6367.0 [2023-02-24 20:25:50,108][213372] Sum rewards: 25.060, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.175', 'AMMO2': '0.011', 'AMMO5': '0.027', 'weapon7': '0.038', 'AMMO4': '0.054', 'AMMO3': '0.125', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.412', 'weapon2': '0.470', 'weapon5': '0.520', 'WEAPON5': '0.800', 'WEAPON3': '0.850', 'HITCOUNT': '1.290', 'weapon3': '1.886', 'DAMAGECOUNT': '5.781', 'FRAGCOUNT': '20.000'} [2023-02-24 20:25:50,119][213382] DAMAGECOUNT value on done: 6871.0 [2023-02-24 20:25:50,120][213382] Sum rewards: 16.843, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.142', 'AMMO2': '0.021', 'AMMO5': '0.032', 'AMMO4': '0.106', 'weapon4': '0.144', 'AMMO3': '0.196', 'weapon5': '0.284', 'WEAPON4': '0.300', 'weapon2': '0.674', 'WEAPON5': '0.750', 'WEAPON3': '1.150', 'HITCOUNT': '1.740', 'weapon3': '2.350', 'DAMAGECOUNT': '6.987', 'FRAGCOUNT': '18.000'} [2023-02-24 20:25:50,132][213383] DAMAGECOUNT value on done: 5950.0 [2023-02-24 20:25:50,132][213383] Sum rewards: 20.896, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.035', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.028', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.139', 'AMMO3': '0.155', 'weapon5': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.452', 'weapon2': '0.500', 'WEAPON3': '0.900', 'HITCOUNT': '1.550', 'weapon3': '1.710', 'DAMAGECOUNT': '6.630', 'FRAGCOUNT': '19.000'} [2023-02-24 20:25:50,144][213368] DAMAGECOUNT value on done: 6216.0 [2023-02-24 20:25:50,145][213368] Sum rewards: 21.413, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.110', 'AMMO2': '0.017', 'AMMO5': '0.024', 'AMMO4': '0.086', 'AMMO3': '0.151', 'WEAPON4': '0.350', 'weapon5': '0.406', 'weapon4': '0.458', 'weapon2': '0.562', 'WEAPON5': '0.600', 'WEAPON3': '0.900', 'HITCOUNT': '1.570', 'weapon3': '2.014', 'DAMAGECOUNT': '6.885', 'FRAGCOUNT': '19.000'} [2023-02-24 20:25:50,234][213369] DAMAGECOUNT value on done: 5737.0 [2023-02-24 20:25:50,234][213369] Sum rewards: 26.200, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.480', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO3': '0.095', 'AMMO4': '0.180', 'WEAPON5': '0.350', 'weapon5': '0.356', 'WEAPON4': '0.400', 'weapon4': '0.422', 'WEAPON3': '0.600', 'weapon2': '0.916', 'HITCOUNT': '1.640', 'weapon3': '1.836', 'DAMAGECOUNT': '7.329', 'FRAGCOUNT': '20.000'} [2023-02-24 20:25:50,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13380.3, 300 sec: 13380.3). Total num frames: 100810752. Throughput: 0: 3515.7. Samples: 191824. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:25:50,243][213332] Avg episode reward: [(0, '21.042')] [2023-02-24 20:25:51,183][213365] Updated weights for policy 0, policy_version 24616 (0.0009) [2023-02-24 20:25:54,086][213365] Updated weights for policy 0, policy_version 24626 (0.0009) [2023-02-24 20:25:55,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 13422.3). Total num frames: 100880384. Throughput: 0: 3511.8. Samples: 212888. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:25:55,243][213332] Avg episode reward: [(0, '21.096')] [2023-02-24 20:25:57,001][213365] Updated weights for policy 0, policy_version 24636 (0.0009) [2023-02-24 20:25:59,884][213365] Updated weights for policy 0, policy_version 24646 (0.0009) [2023-02-24 20:26:00,243][213332] Fps is (10 sec: 14336.0, 60 sec: 14062.9, 300 sec: 13516.8). Total num frames: 100954112. Throughput: 0: 3514.5. Samples: 234208. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:26:00,243][213332] Avg episode reward: [(0, '21.096')] [2023-02-24 20:26:02,805][213365] Updated weights for policy 0, policy_version 24656 (0.0009) [2023-02-24 20:26:02,894][213366] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 20:26:05,243][213332] Fps is (10 sec: 14335.8, 60 sec: 14062.9, 300 sec: 13544.1). Total num frames: 101023744. Throughput: 0: 3514.1. Samples: 244742. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:26:05,243][213332] Avg episode reward: [(0, '21.096')] [2023-02-24 20:26:05,700][213365] Updated weights for policy 0, policy_version 24666 (0.0009) [2023-02-24 20:26:08,141][213366] DAMAGECOUNT value on done: 6986.0 [2023-02-24 20:26:08,142][213366] Sum rewards: 9.451, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.185', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.028', 'weapon7': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.134', 'weapon5': '0.146', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.398', 'weapon2': '0.596', 'WEAPON3': '0.850', 'HITCOUNT': '0.990', 'weapon3': '1.544', 'DAMAGECOUNT': '4.413', 'FRAGCOUNT': '9.500'} [2023-02-24 20:26:08,194][213367] DAMAGECOUNT value on done: 5927.0 [2023-02-24 20:26:08,194][213367] Sum rewards: 1.806, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.715', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO3': '0.027', 'weapon7': '0.056', 'weapon5': '0.078', 'AMMO4': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'WEAPON3': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.286', 'HITCOUNT': '0.320', 'weapon3': '0.332', 'weapon2': '0.670', 'DAMAGECOUNT': '1.491', 'FRAGCOUNT': '2.000'} [2023-02-24 20:26:08,197][213372] DAMAGECOUNT value on done: 7626.0 [2023-02-24 20:26:08,197][213372] Sum rewards: 18.075, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.484', 'AMMO2': '0.025', 'AMMO5': '0.033', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.124', 'weapon5': '0.148', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'weapon4': '0.340', 'WEAPON5': '0.600', 'weapon2': '0.634', 'WEAPON3': '0.950', 'HITCOUNT': '1.200', 'weapon3': '2.276', 'DAMAGECOUNT': '5.520', 'FRAGCOUNT': '18.000'} [2023-02-24 20:26:08,228][213383] DAMAGECOUNT value on done: 6481.0 [2023-02-24 20:26:08,229][213383] Sum rewards: 11.604, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.930', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO3': '0.069', 'AMMO4': '0.115', 'weapon7': '0.226', 'WEAPON5': '0.300', 'AMMO6': '0.340', 'AMMO7': '0.340', 'weapon4': '0.340', 'weapon5': '0.340', 'WEAPON4': '0.450', 'WEAPON3': '0.450', 'WEAPON7': '0.500', 'HITCOUNT': '0.800', 'weapon3': '0.932', 'weapon2': '1.140', 'DAMAGECOUNT': '2.661', 'FRAGCOUNT': '8.000'} [2023-02-24 20:26:08,238][213384] DAMAGECOUNT value on done: 6444.0 [2023-02-24 20:26:08,238][213384] Sum rewards: 18.787, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.110', 'AMMO2': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.042', 'AMMO3': '0.117', 'WEAPON4': '0.200', 'weapon4': '0.234', 'weapon5': '0.330', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '1.060', 'weapon2': '1.270', 'weapon3': '1.758', 'DAMAGECOUNT': '4.596', 'FRAGCOUNT': '16.000'} [2023-02-24 20:26:08,259][213382] DAMAGECOUNT value on done: 8775.0 [2023-02-24 20:26:08,260][213382] Sum rewards: 18.731, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.310', 'AMMO2': '0.006', 'AMMO5': '0.013', 'AMMO4': '0.031', 'weapon7': '0.048', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.124', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.218', 'weapon5': '0.226', 'WEAPON5': '0.300', 'weapon2': '0.564', 'WEAPON3': '0.900', 'HITCOUNT': '1.420', 'weapon3': '2.032', 'DAMAGECOUNT': '6.018', 'FRAGCOUNT': '16.000'} [2023-02-24 20:26:08,323][213368] DAMAGECOUNT value on done: 8967.0 [2023-02-24 20:26:08,324][213368] Sum rewards: 29.192, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.424', 'AMMO5': '0.012', 'AMMO2': '0.017', 'weapon4': '0.028', 'AMMO4': '0.083', 'AMMO3': '0.157', 'weapon5': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'weapon2': '1.228', 'HITCOUNT': '1.930', 'weapon3': '2.226', 'DAMAGECOUNT': '7.716', 'FRAGCOUNT': '27.000'} [2023-02-24 20:26:08,407][213369] DAMAGECOUNT value on done: 8561.0 [2023-02-24 20:26:08,407][213369] Sum rewards: 20.608, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.425', 'AMMO2': '0.009', 'AMMO5': '0.012', 'AMMO4': '0.044', 'weapon7': '0.066', 'AMMO3': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.474', 'WEAPON3': '0.500', 'weapon2': '0.950', 'HITCOUNT': '1.300', 'weapon3': '1.452', 'DAMAGECOUNT': '4.917', 'FRAGCOUNT': '16.000'} [2023-02-24 20:26:08,466][213366] DAMAGECOUNT value on done: 8143.0 [2023-02-24 20:26:08,466][213366] Sum rewards: 18.004, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.627', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.029', 'weapon7': '0.046', 'AMMO3': '0.052', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.122', 'AMMO4': '0.147', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'WEAPON3': '0.350', 'weapon5': '0.428', 'WEAPON5': '0.450', 'weapon2': '0.858', 'HITCOUNT': '0.920', 'weapon3': '1.256', 'DAMAGECOUNT': '4.911', 'FRAGCOUNT': '15.000'} [2023-02-24 20:26:08,513][213372] DAMAGECOUNT value on done: 9133.0 [2023-02-24 20:26:08,513][213372] Sum rewards: 15.331, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.661', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO5': '0.022', 'AMMO3': '0.061', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'weapon4': '0.246', 'WEAPON5': '0.450', 'WEAPON3': '0.450', 'weapon5': '0.470', 'ARMOR': '0.472', 'HITCOUNT': '0.970', 'weapon2': '1.032', 'weapon3': '1.624', 'DAMAGECOUNT': '4.194', 'FRAGCOUNT': '11.000'} [2023-02-24 20:26:08,518][213367] DAMAGECOUNT value on done: 8335.0 [2023-02-24 20:26:08,519][213367] Sum rewards: 20.785, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.749', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO5': '0.029', 'weapon4': '0.072', 'AMMO4': '0.096', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon5': '0.260', 'WEAPON5': '0.550', 'weapon2': '0.758', 'HITCOUNT': '1.320', 'WEAPON3': '1.350', 'weapon3': '2.452', 'DAMAGECOUNT': '6.207', 'FRAGCOUNT': '23.000'} [2023-02-24 20:26:08,541][213383] DAMAGECOUNT value on done: 9476.0 [2023-02-24 20:26:08,542][213383] Sum rewards: 23.531, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.349', 'AMMO2': '0.014', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.071', 'AMMO3': '0.113', 'weapon5': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon4': '0.548', 'weapon2': '0.814', 'WEAPON3': '0.850', 'HITCOUNT': '1.830', 'weapon3': '1.892', 'DAMAGECOUNT': '7.074', 'FRAGCOUNT': '19.000'} [2023-02-24 20:26:08,550][213384] DAMAGECOUNT value on done: 7660.0 [2023-02-24 20:26:08,551][213384] Sum rewards: 18.620, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.362', 'ARMOR': '0.004', 'AMMO5': '0.018', 'weapon5': '0.038', 'AMMO2': '0.044', 'weapon7': '0.048', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO3': '0.205', 'AMMO4': '0.218', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.612', 'weapon2': '0.854', 'WEAPON3': '1.100', 'HITCOUNT': '1.650', 'weapon3': '2.056', 'DAMAGECOUNT': '6.846', 'FRAGCOUNT': '21.000'} [2023-02-24 20:26:08,564][213382] DAMAGECOUNT value on done: 8259.0 [2023-02-24 20:26:08,565][213382] Sum rewards: 18.170, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.424', 'WEAPON1': '0.020', 'AMMO5': '0.027', 'AMMO2': '0.046', 'AMMO3': '0.117', 'weapon5': '0.176', 'AMMO4': '0.231', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'weapon4': '0.570', 'weapon2': '0.700', 'WEAPON3': '0.800', 'HITCOUNT': '1.560', 'weapon3': '1.918', 'DAMAGECOUNT': '5.979', 'FRAGCOUNT': '17.000'} [2023-02-24 20:26:08,621][213365] Updated weights for policy 0, policy_version 24676 (0.0009) [2023-02-24 20:26:08,634][213368] DAMAGECOUNT value on done: 8175.0 [2023-02-24 20:26:08,634][213368] Sum rewards: 16.684, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.274', 'AMMO2': '0.004', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.022', 'AMMO3': '0.110', 'WEAPON4': '0.200', 'weapon5': '0.270', 'WEAPON5': '0.300', 'weapon4': '0.378', 'WEAPON3': '0.750', 'weapon2': '1.146', 'HITCOUNT': '1.170', 'weapon3': '1.666', 'DAMAGECOUNT': '4.659', 'FRAGCOUNT': '14.000'} [2023-02-24 20:26:08,715][213369] DAMAGECOUNT value on done: 8376.0 [2023-02-24 20:26:08,716][213369] Sum rewards: 20.325, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.528', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO4': '0.126', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'weapon5': '0.218', 'WEAPON5': '0.300', 'weapon4': '0.360', 'WEAPON3': '0.850', 'weapon2': '0.898', 'HITCOUNT': '1.090', 'weapon3': '2.026', 'DAMAGECOUNT': '6.333', 'FRAGCOUNT': '18.000'} [2023-02-24 20:26:08,722][213367] DAMAGECOUNT value on done: 7568.0 [2023-02-24 20:26:08,723][213367] Sum rewards: 10.169, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.866', 'AMMO5': '0.015', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.141', 'WEAPON4': '0.250', 'weapon5': '0.254', 'WEAPON5': '0.350', 'weapon4': '0.378', 'weapon2': '0.648', 'WEAPON3': '0.800', 'HITCOUNT': '0.920', 'weapon3': '1.966', 'DAMAGECOUNT': '3.450', 'FRAGCOUNT': '10.000'} [2023-02-24 20:26:08,764][213366] DAMAGECOUNT value on done: 8858.0 [2023-02-24 20:26:08,765][213366] Sum rewards: 22.485, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.236', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO5': '0.017', 'weapon4': '0.024', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.142', 'weapon5': '0.326', 'WEAPON5': '0.450', 'weapon2': '0.672', 'WEAPON3': '0.900', 'HITCOUNT': '1.330', 'weapon3': '2.536', 'DAMAGECOUNT': '6.123', 'FRAGCOUNT': '20.000'} [2023-02-24 20:26:08,811][213372] DAMAGECOUNT value on done: 6384.0 [2023-02-24 20:26:08,811][213372] Sum rewards: 21.587, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.486', 'AMMO2': '0.007', 'AMMO5': '0.012', 'AMMO4': '0.035', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'weapon4': '0.164', 'weapon5': '0.246', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'weapon2': '1.056', 'HITCOUNT': '1.260', 'weapon3': '1.864', 'DAMAGECOUNT': '5.418', 'FRAGCOUNT': '19.000'} [2023-02-24 20:26:08,834][213383] DAMAGECOUNT value on done: 8003.0 [2023-02-24 20:26:08,835][213383] Sum rewards: 30.945, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.972', 'AMMO2': '0.008', 'AMMO5': '0.017', 'AMMO4': '0.039', 'WEAPON4': '0.100', 'weapon4': '0.124', 'AMMO3': '0.158', 'weapon5': '0.184', 'WEAPON5': '0.400', 'weapon2': '0.590', 'WEAPON3': '1.150', 'HITCOUNT': '1.910', 'weapon3': '2.682', 'DAMAGECOUNT': '8.304', 'FRAGCOUNT': '27.000'} [2023-02-24 20:26:08,849][213384] DAMAGECOUNT value on done: 9788.0 [2023-02-24 20:26:08,850][213384] Sum rewards: 22.439, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.110', 'AMMO2': '0.014', 'AMMO5': '0.014', 'weapon4': '0.042', 'weapon7': '0.048', 'AMMO4': '0.071', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.154', 'AMMO3': '0.162', 'WEAPON5': '0.350', 'weapon2': '0.610', 'WEAPON3': '0.950', 'HITCOUNT': '1.450', 'weapon3': '2.056', 'DAMAGECOUNT': '6.477', 'FRAGCOUNT': '19.000'} [2023-02-24 20:26:08,859][213382] DAMAGECOUNT value on done: 6703.0 [2023-02-24 20:26:08,859][213382] Sum rewards: 12.234, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.538', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon4': '0.040', 'AMMO3': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon7': '0.124', 'weapon5': '0.148', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.810', 'weapon2': '1.074', 'weapon3': '1.256', 'DAMAGECOUNT': '3.723', 'FRAGCOUNT': '10.000'} [2023-02-24 20:26:08,939][213368] DAMAGECOUNT value on done: 8910.0 [2023-02-24 20:26:08,940][213368] Sum rewards: 15.016, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.768', 'AMMO2': '0.009', 'AMMO5': '0.012', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'weapon4': '0.142', 'AMMO3': '0.148', 'WEAPON5': '0.300', 'weapon5': '0.306', 'WEAPON3': '0.900', 'weapon2': '0.930', 'HITCOUNT': '1.050', 'weapon3': '2.150', 'DAMAGECOUNT': '4.941', 'FRAGCOUNT': '14.000'} [2023-02-24 20:26:09,022][213367] DAMAGECOUNT value on done: 8573.0 [2023-02-24 20:26:09,023][213367] Sum rewards: 25.740, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.720', 'AMMO2': '0.014', 'AMMO5': '0.015', 'weapon7': '0.052', 'AMMO4': '0.070', 'AMMO3': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon5': '0.438', 'weapon4': '0.478', 'weapon2': '0.500', 'WEAPON3': '0.700', 'HITCOUNT': '1.510', 'weapon3': '2.084', 'DAMAGECOUNT': '6.459', 'FRAGCOUNT': '19.000'} [2023-02-24 20:26:09,038][213369] DAMAGECOUNT value on done: 9020.0 [2023-02-24 20:26:09,039][213369] Sum rewards: 26.951, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.694', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'WEAPON4': '0.050', 'weapon4': '0.086', 'AMMO3': '0.149', 'weapon5': '0.456', 'WEAPON5': '0.600', 'weapon2': '0.628', 'WEAPON3': '1.000', 'HITCOUNT': '1.380', 'weapon3': '2.382', 'DAMAGECOUNT': '7.623', 'FRAGCOUNT': '22.500'} [2023-02-24 20:26:09,068][213366] DAMAGECOUNT value on done: 7427.0 [2023-02-24 20:26:09,068][213366] Sum rewards: 14.602, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.609', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO3': '0.117', 'AMMO4': '0.129', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.316', 'weapon4': '0.332', 'WEAPON3': '0.600', 'weapon2': '0.692', 'HITCOUNT': '1.450', 'weapon3': '2.102', 'DAMAGECOUNT': '5.175', 'FRAGCOUNT': '12.000'} [2023-02-24 20:26:09,101][213372] DAMAGECOUNT value on done: 7814.0 [2023-02-24 20:26:09,102][213372] Sum rewards: 15.023, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.453', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon7': '0.064', 'AMMO4': '0.065', 'weapon5': '0.096', 'AMMO3': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.456', 'weapon4': '0.508', 'WEAPON3': '0.700', 'weapon2': '0.860', 'HITCOUNT': '1.040', 'weapon3': '1.730', 'DAMAGECOUNT': '4.341', 'FRAGCOUNT': '13.000'} [2023-02-24 20:26:09,139][213383] DAMAGECOUNT value on done: 7562.0 [2023-02-24 20:26:09,139][213383] Sum rewards: 18.134, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.620', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO3': '0.074', 'weapon5': '0.372', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '1.050', 'weapon2': '1.056', 'weapon3': '1.890', 'DAMAGECOUNT': '4.773', 'FRAGCOUNT': '13.000'} [2023-02-24 20:26:09,144][213384] DAMAGECOUNT value on done: 8053.0 [2023-02-24 20:26:09,145][213382] DAMAGECOUNT value on done: 9260.0 [2023-02-24 20:26:09,145][213384] Sum rewards: 31.905, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.500', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.090', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.114', 'weapon5': '0.326', 'WEAPON4': '0.350', 'weapon4': '0.362', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'weapon2': '0.800', 'HITCOUNT': '1.640', 'weapon3': '2.048', 'DAMAGECOUNT': '7.221', 'FRAGCOUNT': '25.000'} [2023-02-24 20:26:09,145][213382] Sum rewards: 25.375, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.106', 'AMMO5': '0.014', 'AMMO2': '0.015', 'AMMO4': '0.077', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'weapon5': '0.214', 'weapon4': '0.228', 'WEAPON5': '0.350', 'WEAPON3': '0.950', 'weapon2': '1.180', 'HITCOUNT': '1.690', 'weapon3': '1.994', 'DAMAGECOUNT': '7.167', 'FRAGCOUNT': '23.000'} [2023-02-24 20:26:09,244][213368] DAMAGECOUNT value on done: 7592.0 [2023-02-24 20:26:09,244][213368] Sum rewards: 10.491, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.858', 'AMMO2': '0.032', 'AMMO5': '0.032', 'AMMO3': '0.120', 'AMMO4': '0.159', 'WEAPON4': '0.250', 'weapon5': '0.266', 'weapon2': '0.322', 'weapon4': '0.396', 'ARMOR': '0.400', 'WEAPON5': '0.750', 'WEAPON3': '0.850', 'HITCOUNT': '0.950', 'weapon3': '2.194', 'DAMAGECOUNT': '4.128', 'FRAGCOUNT': '10.500'} [2023-02-24 20:26:09,340][213369] DAMAGECOUNT value on done: 7306.0 [2023-02-24 20:26:09,340][213369] Sum rewards: 10.611, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.688', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon7': '0.070', 'weapon5': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.135', 'AMMO4': '0.168', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.546', 'weapon4': '0.664', 'WEAPON3': '0.900', 'HITCOUNT': '1.320', 'weapon3': '1.644', 'DAMAGECOUNT': '4.707', 'FRAGCOUNT': '10.000'} [2023-02-24 20:26:10,243][213332] Fps is (10 sec: 13926.5, 60 sec: 14062.9, 300 sec: 13568.0). Total num frames: 101093376. Throughput: 0: 3514.9. Samples: 265846. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:26:10,243][213332] Avg episode reward: [(0, '20.838')] [2023-02-24 20:26:11,552][213365] Updated weights for policy 0, policy_version 24686 (0.0009) [2023-02-24 20:26:14,510][213365] Updated weights for policy 0, policy_version 24696 (0.0009) [2023-02-24 20:26:15,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 13589.1). Total num frames: 101163008. Throughput: 0: 3511.4. Samples: 286754. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:26:15,243][213332] Avg episode reward: [(0, '20.838')] [2023-02-24 20:26:17,442][213365] Updated weights for policy 0, policy_version 24706 (0.0009) [2023-02-24 20:26:20,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 13607.9). Total num frames: 101232640. Throughput: 0: 3510.3. Samples: 297164. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:26:20,243][213332] Avg episode reward: [(0, '20.838')] [2023-02-24 20:26:20,363][213365] Updated weights for policy 0, policy_version 24716 (0.0009) [2023-02-24 20:26:23,292][213365] Updated weights for policy 0, policy_version 24726 (0.0009) [2023-02-24 20:26:25,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13624.6). Total num frames: 101302272. Throughput: 0: 3504.0. Samples: 318068. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:26:25,243][213332] Avg episode reward: [(0, '20.838')] [2023-02-24 20:26:26,235][213365] Updated weights for policy 0, policy_version 24736 (0.0009) [2023-02-24 20:26:27,485][213372] DAMAGECOUNT value on done: 9871.0 [2023-02-24 20:26:27,485][213367] DAMAGECOUNT value on done: 7781.0 [2023-02-24 20:26:27,485][213372] Sum rewards: 20.777, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.776', 'AMMO2': '0.007', 'AMMO5': '0.022', 'AMMO4': '0.036', 'AMMO3': '0.200', 'weapon5': '0.464', 'WEAPON5': '0.650', 'weapon2': '0.760', 'WEAPON3': '1.300', 'HITCOUNT': '1.520', 'weapon3': '2.358', 'DAMAGECOUNT': '6.735', 'FRAGCOUNT': '20.000'} [2023-02-24 20:26:27,485][213367] Sum rewards: 19.783, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.940', 'AMMO5': '0.017', 'AMMO2': '0.020', 'AMMO4': '0.102', 'weapon2': '0.154', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'weapon5': '0.266', 'WEAPON5': '0.450', 'weapon4': '0.516', 'WEAPON3': '1.100', 'HITCOUNT': '1.510', 'weapon3': '2.414', 'DAMAGECOUNT': '5.562', 'FRAGCOUNT': '19.000'} [2023-02-24 20:26:27,495][213366] DAMAGECOUNT value on done: 9101.0 [2023-02-24 20:26:27,495][213366] Sum rewards: 22.665, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.480', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO3': '0.141', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'weapon5': '0.222', 'WEAPON5': '0.300', 'weapon4': '0.552', 'weapon2': '0.622', 'WEAPON3': '0.850', 'HITCOUNT': '1.550', 'weapon3': '1.974', 'DAMAGECOUNT': '6.345', 'FRAGCOUNT': '20.000'} [2023-02-24 20:26:27,526][213383] DAMAGECOUNT value on done: 8841.0 [2023-02-24 20:26:27,526][213383] Sum rewards: 21.885, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.840', 'AMMO5': '0.017', 'AMMO2': '0.018', 'weapon7': '0.052', 'AMMO4': '0.087', 'AMMO3': '0.137', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.232', 'weapon4': '0.244', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.782', 'WEAPON3': '0.900', 'HITCOUNT': '1.510', 'weapon3': '1.776', 'DAMAGECOUNT': '7.080', 'FRAGCOUNT': '19.000'} [2023-02-24 20:26:27,543][213384] DAMAGECOUNT value on done: 8434.0 [2023-02-24 20:26:27,543][213384] Sum rewards: 18.829, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.098', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.022', 'AMMO4': '0.059', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'weapon2': '0.298', 'weapon4': '0.330', 'WEAPON5': '0.500', 'weapon5': '0.520', 'WEAPON3': '0.950', 'HITCOUNT': '1.430', 'weapon3': '2.264', 'DAMAGECOUNT': '5.970', 'FRAGCOUNT': '17.000'} [2023-02-24 20:26:27,556][213382] DAMAGECOUNT value on done: 11181.0 [2023-02-24 20:26:27,556][213382] Sum rewards: 21.254, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.717', 'AMMO2': '0.007', 'AMMO5': '0.030', 'AMMO4': '0.035', 'weapon5': '0.126', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'weapon2': '0.342', 'weapon4': '0.516', 'WEAPON5': '0.650', 'WEAPON3': '1.400', 'HITCOUNT': '1.950', 'weapon3': '2.454', 'DAMAGECOUNT': '7.218', 'FRAGCOUNT': '22.000'} [2023-02-24 20:26:27,649][213368] DAMAGECOUNT value on done: 11927.0 [2023-02-24 20:26:27,650][213368] Sum rewards: 26.812, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.343', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.031', 'AMMO3': '0.113', 'AMMO4': '0.155', 'weapon2': '0.358', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon5': '0.418', 'weapon4': '0.708', 'WEAPON3': '0.750', 'weapon3': '1.942', 'HITCOUNT': '1.970', 'DAMAGECOUNT': '8.880', 'FRAGCOUNT': '21.000'} [2023-02-24 20:26:27,679][213369] DAMAGECOUNT value on done: 10728.0 [2023-02-24 20:26:27,679][213369] Sum rewards: 22.898, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.020', 'AMMO2': '0.027', 'weapon4': '0.044', 'AMMO3': '0.108', 'weapon7': '0.108', 'AMMO4': '0.135', 'HEALTH': '0.146', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'weapon5': '0.262', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'weapon2': '0.860', 'HITCOUNT': '1.580', 'weapon3': '2.216', 'DAMAGECOUNT': '6.501', 'FRAGCOUNT': '18.000'} [2023-02-24 20:26:27,784][213372] DAMAGECOUNT value on done: 10467.0 [2023-02-24 20:26:27,785][213372] Sum rewards: 13.283, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.680', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.086', 'weapon4': '0.122', 'weapon5': '0.330', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'weapon2': '0.960', 'HITCOUNT': '0.990', 'weapon3': '1.504', 'DAMAGECOUNT': '4.002', 'FRAGCOUNT': '11.000'} [2023-02-24 20:26:27,790][213367] DAMAGECOUNT value on done: 10815.0 [2023-02-24 20:26:27,791][213367] Sum rewards: 17.114, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.587', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.173', 'weapon5': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.370', 'weapon4': '0.592', 'WEAPON3': '1.050', 'HITCOUNT': '1.900', 'weapon3': '2.506', 'DAMAGECOUNT': '7.440', 'FRAGCOUNT': '15.000'} [2023-02-24 20:26:27,796][213366] DAMAGECOUNT value on done: 9910.0 [2023-02-24 20:26:27,797][213366] Sum rewards: 14.662, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.162', 'AMMO2': '0.006', 'AMMO5': '0.014', 'AMMO4': '0.029', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'weapon5': '0.252', 'weapon4': '0.252', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'weapon2': '1.052', 'HITCOUNT': '1.270', 'weapon3': '1.896', 'DAMAGECOUNT': '5.301', 'FRAGCOUNT': '14.000'} [2023-02-24 20:26:27,820][213383] DAMAGECOUNT value on done: 10694.0 [2023-02-24 20:26:27,821][213383] Sum rewards: 15.501, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.630', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.012', 'AMMO3': '0.071', 'WEAPON4': '0.150', 'weapon4': '0.198', 'WEAPON5': '0.500', 'weapon5': '0.520', 'WEAPON3': '0.600', 'HITCOUNT': '0.910', 'weapon2': '1.264', 'weapon3': '1.554', 'DAMAGECOUNT': '3.609', 'FRAGCOUNT': '13.000'} [2023-02-24 20:26:27,840][213384] DAMAGECOUNT value on done: 9613.0 [2023-02-24 20:26:27,841][213384] Sum rewards: 16.582, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.310', 'AMMO2': '0.005', 'AMMO5': '0.016', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'weapon4': '0.162', 'AMMO3': '0.175', 'WEAPON5': '0.450', 'weapon5': '0.450', 'weapon2': '0.770', 'WEAPON3': '1.050', 'HITCOUNT': '1.500', 'weapon3': '2.128', 'DAMAGECOUNT': '5.859', 'FRAGCOUNT': '15.000'} [2023-02-24 20:26:27,860][213382] DAMAGECOUNT value on done: 10600.0 [2023-02-24 20:26:27,860][213382] Sum rewards: 21.175, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.910', 'ARMOR': '0.014', 'AMMO5': '0.024', 'AMMO2': '0.033', 'weapon5': '0.164', 'AMMO4': '0.166', 'AMMO3': '0.197', 'WEAPON4': '0.350', 'weapon4': '0.472', 'WEAPON5': '0.600', 'weapon2': '0.640', 'WEAPON3': '1.150', 'HITCOUNT': '1.620', 'weapon3': '2.382', 'DAMAGECOUNT': '7.023', 'FRAGCOUNT': '21.000'} [2023-02-24 20:26:27,958][213368] DAMAGECOUNT value on done: 10505.0 [2023-02-24 20:26:27,958][213368] Sum rewards: 20.328, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.738', 'AMMO2': '0.025', 'AMMO5': '0.027', 'AMMO4': '0.122', 'AMMO3': '0.174', 'weapon2': '0.192', 'weapon4': '0.280', 'WEAPON4': '0.300', 'weapon5': '0.328', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'HITCOUNT': '1.540', 'weapon3': '2.638', 'DAMAGECOUNT': '6.990', 'FRAGCOUNT': '19.000'} [2023-02-24 20:26:27,978][213369] DAMAGECOUNT value on done: 10822.0 [2023-02-24 20:26:27,979][213369] Sum rewards: 19.029, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.180', 'AMMO5': '0.022', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.182', 'weapon5': '0.342', 'weapon2': '0.366', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.590', 'WEAPON3': '1.050', 'HITCOUNT': '1.770', 'weapon3': '2.188', 'DAMAGECOUNT': '7.338', 'FRAGCOUNT': '19.000'} [2023-02-24 20:26:28,000][213367] DAMAGECOUNT value on done: 9707.0 [2023-02-24 20:26:28,000][213367] Sum rewards: 24.450, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.402', 'WEAPON1': '0.010', 'AMMO5': '0.021', 'AMMO2': '0.023', 'AMMO3': '0.064', 'AMMO4': '0.113', 'WEAPON4': '0.250', 'weapon4': '0.286', 'WEAPON5': '0.400', 'WEAPON3': '0.400', 'weapon5': '0.526', 'weapon2': '1.148', 'weapon3': '1.564', 'HITCOUNT': '1.630', 'DAMAGECOUNT': '6.417', 'FRAGCOUNT': '18.000'} [2023-02-24 20:26:28,082][213366] DAMAGECOUNT value on done: 11540.0 [2023-02-24 20:26:28,083][213366] Sum rewards: 30.097, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.080', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.046', 'weapon7': '0.056', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO4': '0.228', 'weapon5': '0.304', 'weapon2': '0.400', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '0.750', 'weapon4': '0.790', 'HITCOUNT': '1.920', 'weapon3': '2.004', 'DAMAGECOUNT': '8.046', 'FRAGCOUNT': '27.000'} [2023-02-24 20:26:28,083][213372] DAMAGECOUNT value on done: 8696.0 [2023-02-24 20:26:28,084][213372] Sum rewards: 19.288, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.282', 'WEAPON1': '0.010', 'AMMO5': '0.025', 'AMMO2': '0.042', 'AMMO3': '0.105', 'AMMO4': '0.208', 'WEAPON4': '0.350', 'weapon4': '0.352', 'weapon5': '0.366', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'weapon2': '0.730', 'HITCOUNT': '1.570', 'weapon3': '2.076', 'DAMAGECOUNT': '6.936', 'FRAGCOUNT': '17.500'} [2023-02-24 20:26:28,126][213383] DAMAGECOUNT value on done: 10331.0 [2023-02-24 20:26:28,127][213383] Sum rewards: 20.049, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.822', 'AMMO2': '0.019', 'AMMO5': '0.020', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'AMMO3': '0.207', 'weapon4': '0.226', 'weapon5': '0.252', 'WEAPON5': '0.500', 'weapon2': '0.766', 'WEAPON3': '1.250', 'HITCOUNT': '1.760', 'weapon3': '2.394', 'DAMAGECOUNT': '6.984', 'FRAGCOUNT': '20.000'} [2023-02-24 20:26:28,147][213384] DAMAGECOUNT value on done: 12173.0 [2023-02-24 20:26:28,147][213384] Sum rewards: 17.180, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.769', 'AMMO5': '0.022', 'AMMO2': '0.045', 'weapon7': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.161', 'weapon2': '0.222', 'AMMO4': '0.225', 'weapon5': '0.358', 'ARMOR': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.578', 'WEAPON5': '0.600', 'WEAPON3': '1.000', 'HITCOUNT': '1.430', 'weapon3': '2.086', 'DAMAGECOUNT': '7.155', 'FRAGCOUNT': '16.500'} [2023-02-24 20:26:28,167][213382] DAMAGECOUNT value on done: 8569.0 [2023-02-24 20:26:28,168][213382] Sum rewards: 15.009, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.011', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'AMMO5': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.125', 'WEAPON4': '0.350', 'weapon4': '0.352', 'weapon5': '0.460', 'weapon2': '0.494', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'HITCOUNT': '0.920', 'weapon3': '1.994', 'DAMAGECOUNT': '5.598', 'FRAGCOUNT': '14.000'} [2023-02-24 20:26:28,251][213368] DAMAGECOUNT value on done: 10911.0 [2023-02-24 20:26:28,252][213368] Sum rewards: 21.396, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.566', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.007', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.133', 'WEAPON5': '0.200', 'weapon5': '0.338', 'WEAPON3': '0.800', 'weapon2': '0.884', 'HITCOUNT': '1.380', 'weapon3': '2.168', 'DAMAGECOUNT': '6.003', 'FRAGCOUNT': '18.000'} [2023-02-24 20:26:28,303][213367] DAMAGECOUNT value on done: 10370.0 [2023-02-24 20:26:28,304][213367] Sum rewards: 22.055, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO3': '0.124', 'HEALTH': '0.130', 'AMMO4': '0.132', 'weapon7': '0.132', 'weapon5': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.522', 'weapon2': '0.556', 'WEAPON3': '0.700', 'HITCOUNT': '1.410', 'weapon3': '1.776', 'DAMAGECOUNT': '5.391', 'FRAGCOUNT': '19.000'} [2023-02-24 20:26:28,312][213369] DAMAGECOUNT value on done: 10839.0 [2023-02-24 20:26:28,312][213369] Sum rewards: 19.221, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.312', 'AMMO2': '0.013', 'AMMO5': '0.016', 'weapon4': '0.016', 'AMMO4': '0.065', 'AMMO3': '0.106', 'WEAPON4': '0.200', 'weapon5': '0.364', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.126', 'HITCOUNT': '1.240', 'weapon3': '2.130', 'DAMAGECOUNT': '5.457', 'FRAGCOUNT': '16.000'} [2023-02-24 20:26:28,382][213372] DAMAGECOUNT value on done: 10091.0 [2023-02-24 20:26:28,382][213372] Sum rewards: 17.583, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.237', 'AMMO5': '0.021', 'AMMO2': '0.028', 'AMMO4': '0.141', 'AMMO3': '0.236', 'weapon5': '0.260', 'weapon2': '0.404', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon4': '0.576', 'WEAPON3': '1.400', 'HITCOUNT': '1.950', 'weapon3': '2.222', 'DAMAGECOUNT': '6.831', 'FRAGCOUNT': '19.000'} [2023-02-24 20:26:28,388][213366] DAMAGECOUNT value on done: 8694.0 [2023-02-24 20:26:28,389][213366] Sum rewards: 11.792, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.960', 'AMMO2': '0.021', 'AMMO5': '0.023', 'AMMO3': '0.097', 'AMMO4': '0.102', 'weapon4': '0.242', 'weapon5': '0.336', 'WEAPON4': '0.350', 'ARMOR': '0.491', 'WEAPON5': '0.600', 'WEAPON3': '0.600', 'HITCOUNT': '0.810', 'weapon2': '0.966', 'weapon3': '1.812', 'DAMAGECOUNT': '3.801', 'FRAGCOUNT': '11.000'} [2023-02-24 20:26:28,420][213383] DAMAGECOUNT value on done: 10015.0 [2023-02-24 20:26:28,420][213383] Sum rewards: 23.172, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.352', 'AMMO2': '0.022', 'weapon4': '0.032', 'AMMO5': '0.034', 'AMMO4': '0.107', 'AMMO3': '0.110', 'WEAPON4': '0.250', 'weapon5': '0.552', 'weapon2': '0.630', 'WEAPON5': '0.750', 'WEAPON3': '0.750', 'HITCOUNT': '1.630', 'weapon3': '2.298', 'DAMAGECOUNT': '7.359', 'FRAGCOUNT': '19.000'} [2023-02-24 20:26:28,449][213384] DAMAGECOUNT value on done: 9619.0 [2023-02-24 20:26:28,450][213384] Sum rewards: 15.230, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.710', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.050', 'AMMO4': '0.070', 'weapon7': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.123', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.546', 'weapon2': '0.554', 'WEAPON3': '0.750', 'HITCOUNT': '1.210', 'weapon3': '1.342', 'DAMAGECOUNT': '4.698', 'FRAGCOUNT': '14.000'} [2023-02-24 20:26:28,473][213382] DAMAGECOUNT value on done: 11546.0 [2023-02-24 20:26:28,473][213382] Sum rewards: 24.732, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.042', 'WEAPON1': '0.010', 'weapon4': '0.020', 'AMMO2': '0.020', 'AMMO5': '0.027', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.168', 'weapon5': '0.390', 'WEAPON5': '0.700', 'weapon2': '0.742', 'WEAPON3': '1.100', 'HITCOUNT': '1.430', 'weapon3': '2.358', 'DAMAGECOUNT': '6.858', 'FRAGCOUNT': '24.000'} [2023-02-24 20:26:28,555][213368] DAMAGECOUNT value on done: 10757.0 [2023-02-24 20:26:28,555][213368] Sum rewards: 36.727, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.294', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO5': '0.017', 'weapon4': '0.078', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'weapon5': '0.330', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'weapon2': '0.998', 'HITCOUNT': '2.020', 'weapon3': '2.160', 'DAMAGECOUNT': '9.495', 'FRAGCOUNT': '28.000'} [2023-02-24 20:26:28,610][213369] DAMAGECOUNT value on done: 9157.0 [2023-02-24 20:26:28,611][213369] Sum rewards: 15.639, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.153', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.087', 'AMMO3': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.276', 'weapon5': '0.288', 'weapon2': '0.610', 'WEAPON3': '0.950', 'HITCOUNT': '1.510', 'weapon3': '2.400', 'DAMAGECOUNT': '5.553', 'FRAGCOUNT': '15.000'} [2023-02-24 20:26:29,089][213384] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 20:26:29,211][213365] Updated weights for policy 0, policy_version 24746 (0.0009) [2023-02-24 20:26:30,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 13639.7). Total num frames: 101371904. Throughput: 0: 3499.7. Samples: 338802. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:26:30,243][213332] Avg episode reward: [(0, '20.599')] [2023-02-24 20:26:32,122][213365] Updated weights for policy 0, policy_version 24756 (0.0009) [2023-02-24 20:26:33,216][213366] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.456, 152.0), ('HEALTH', -0.006, -2.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 20:26:35,050][213365] Updated weights for policy 0, policy_version 24766 (0.0009) [2023-02-24 20:26:35,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13653.3). Total num frames: 101441536. Throughput: 0: 3501.5. Samples: 349392. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:26:35,243][213332] Avg episode reward: [(0, '20.599')] [2023-02-24 20:26:37,996][213365] Updated weights for policy 0, policy_version 24776 (0.0009) [2023-02-24 20:26:40,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 13665.8). Total num frames: 101511168. Throughput: 0: 3498.5. Samples: 370320. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:26:40,243][213332] Avg episode reward: [(0, '20.599')] [2023-02-24 20:26:40,945][213365] Updated weights for policy 0, policy_version 24786 (0.0009) [2023-02-24 20:26:43,893][213365] Updated weights for policy 0, policy_version 24796 (0.0009) [2023-02-24 20:26:45,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 13677.1). Total num frames: 101580800. Throughput: 0: 3490.3. Samples: 391270. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:26:45,243][213332] Avg episode reward: [(0, '20.599')] [2023-02-24 20:26:45,247][213352] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000024800_101580800.pth... [2023-02-24 20:26:45,300][213352] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000024089_98668544.pth [2023-02-24 20:26:46,731][213367] DAMAGECOUNT value on done: 10504.0 [2023-02-24 20:26:46,731][213367] Sum rewards: 24.326, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.760', 'AMMO2': '0.014', 'AMMO5': '0.019', 'AMMO4': '0.071', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'weapon5': '0.234', 'weapon4': '0.390', 'WEAPON5': '0.400', 'weapon2': '0.874', 'WEAPON3': '1.100', 'HITCOUNT': '1.800', 'weapon3': '2.142', 'DAMAGECOUNT': '8.169', 'FRAGCOUNT': '22.000'} [2023-02-24 20:26:46,758][213372] DAMAGECOUNT value on done: 11602.0 [2023-02-24 20:26:46,758][213372] Sum rewards: 16.064, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.397', 'AMMO5': '0.017', 'AMMO2': '0.030', 'AMMO3': '0.135', 'AMMO4': '0.149', 'weapon5': '0.394', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon4': '0.554', 'WEAPON3': '0.900', 'weapon2': '0.940', 'HITCOUNT': '1.210', 'weapon3': '1.638', 'DAMAGECOUNT': '5.193', 'FRAGCOUNT': '16.000'} [2023-02-24 20:26:46,781][213383] DAMAGECOUNT value on done: 10629.0 [2023-02-24 20:26:46,781][213383] Sum rewards: 16.996, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.645', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.041', 'weapon7': '0.064', 'AMMO3': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO4': '0.204', 'weapon5': '0.232', 'weapon2': '0.368', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon4': '0.776', 'HITCOUNT': '1.260', 'weapon3': '1.802', 'DAMAGECOUNT': '5.364', 'FRAGCOUNT': '16.000'} [2023-02-24 20:26:46,799][213382] DAMAGECOUNT value on done: 12505.0 [2023-02-24 20:26:46,800][213382] Sum rewards: 14.835, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.504', 'AMMO5': '0.018', 'AMMO2': '0.026', 'weapon7': '0.048', 'AMMO3': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.129', 'WEAPON7': '0.200', 'weapon5': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon4': '0.680', 'HITCOUNT': '0.900', 'weapon2': '0.920', 'weapon3': '1.206', 'DAMAGECOUNT': '3.972', 'FRAGCOUNT': '13.000'} [2023-02-24 20:26:46,816][213366] DAMAGECOUNT value on done: 10959.0 [2023-02-24 20:26:46,816][213366] Sum rewards: 18.265, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.500', 'AMMO5': '0.017', 'AMMO2': '0.045', 'AMMO3': '0.119', 'AMMO4': '0.224', 'weapon5': '0.298', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.466', 'WEAPON4': '0.500', 'weapon2': '0.574', 'WEAPON3': '0.750', 'HITCOUNT': '1.350', 'weapon3': '1.748', 'DAMAGECOUNT': '5.574', 'FRAGCOUNT': '17.000'} [2023-02-24 20:26:46,836][213384] DAMAGECOUNT value on done: 11753.0 [2023-02-24 20:26:46,836][213384] Sum rewards: 32.840, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO2': '0.017', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'AMMO3': '0.158', 'HEALTH': '0.188', 'weapon4': '0.192', 'weapon5': '0.296', 'WEAPON5': '0.350', 'weapon2': '0.562', 'WEAPON3': '0.900', 'HITCOUNT': '2.070', 'weapon3': '2.626', 'DAMAGECOUNT': '9.957', 'FRAGCOUNT': '28.000'} [2023-02-24 20:26:46,844][213365] Updated weights for policy 0, policy_version 24806 (0.0009) [2023-02-24 20:26:46,961][213369] DAMAGECOUNT value on done: 12346.0 [2023-02-24 20:26:46,961][213369] Sum rewards: 17.358, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.636', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.015', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.124', 'WEAPON5': '0.500', 'weapon5': '0.528', 'WEAPON3': '0.750', 'HITCOUNT': '1.060', 'weapon2': '1.174', 'weapon3': '1.784', 'DAMAGECOUNT': '4.854', 'FRAGCOUNT': '14.000'} [2023-02-24 20:26:47,019][213368] DAMAGECOUNT value on done: 14430.0 [2023-02-24 20:26:47,019][213368] Sum rewards: 28.433, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.940', 'AMMO2': '0.015', 'AMMO5': '0.019', 'AMMO4': '0.076', 'AMMO3': '0.163', 'WEAPON4': '0.250', 'weapon2': '0.278', 'weapon5': '0.328', 'WEAPON5': '0.450', 'weapon4': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '1.690', 'weapon3': '2.494', 'DAMAGECOUNT': '7.509', 'FRAGCOUNT': '24.500'} [2023-02-24 20:26:47,041][213367] DAMAGECOUNT value on done: 14046.0 [2023-02-24 20:26:47,041][213367] Sum rewards: 27.200, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.708', 'AMMO5': '0.033', 'AMMO2': '0.034', 'AMMO4': '0.171', 'AMMO3': '0.177', 'weapon5': '0.298', 'WEAPON4': '0.350', 'weapon4': '0.502', 'weapon2': '0.726', 'WEAPON5': '0.750', 'WEAPON3': '1.150', 'weapon3': '2.064', 'HITCOUNT': '2.210', 'DAMAGECOUNT': '9.693', 'FRAGCOUNT': '25.000'} [2023-02-24 20:26:47,069][213372] DAMAGECOUNT value on done: 12745.0 [2023-02-24 20:26:47,069][213372] Sum rewards: 24.186, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.848', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.167', 'weapon4': '0.326', 'WEAPON4': '0.400', 'weapon5': '0.400', 'WEAPON5': '0.600', 'weapon2': '0.644', 'WEAPON3': '1.000', 'HITCOUNT': '1.540', 'weapon3': '2.192', 'DAMAGECOUNT': '6.834', 'FRAGCOUNT': '23.000'} [2023-02-24 20:26:47,081][213383] DAMAGECOUNT value on done: 12009.0 [2023-02-24 20:26:47,081][213383] Sum rewards: 14.414, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.040', 'weapon4': '0.016', 'AMMO5': '0.017', 'AMMO2': '0.019', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'weapon5': '0.218', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.950', 'weapon3': '1.362', 'weapon2': '1.428', 'DAMAGECOUNT': '3.945', 'FRAGCOUNT': '13.000'} [2023-02-24 20:26:47,107][213382] DAMAGECOUNT value on done: 12424.0 [2023-02-24 20:26:47,107][213382] Sum rewards: 13.217, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.471', 'AMMO5': '0.025', 'AMMO2': '0.058', 'AMMO3': '0.118', 'AMMO4': '0.292', 'weapon5': '0.348', 'WEAPON5': '0.550', 'weapon4': '0.626', 'WEAPON3': '0.750', 'WEAPON4': '0.750', 'weapon2': '0.786', 'HITCOUNT': '1.230', 'weapon3': '1.682', 'DAMAGECOUNT': '5.472', 'FRAGCOUNT': '15.000'} [2023-02-24 20:26:47,126][213366] DAMAGECOUNT value on done: 12706.0 [2023-02-24 20:26:47,126][213366] Sum rewards: 24.484, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.016', 'AMMO5': '0.019', 'AMMO2': '0.031', 'weapon7': '0.048', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.154', 'AMMO3': '0.160', 'WEAPON7': '0.200', 'weapon2': '0.302', 'weapon5': '0.368', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'weapon4': '0.664', 'WEAPON3': '1.000', 'HITCOUNT': '1.650', 'weapon3': '1.926', 'DAMAGECOUNT': '8.388', 'FRAGCOUNT': '20.500'} [2023-02-24 20:26:47,142][213384] DAMAGECOUNT value on done: 11815.0 [2023-02-24 20:26:47,143][213384] Sum rewards: 20.883, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.047', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.031', 'AMMO3': '0.102', 'AMMO4': '0.157', 'weapon4': '0.370', 'WEAPON4': '0.400', 'weapon5': '0.420', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'weapon2': '0.780', 'HITCOUNT': '1.670', 'weapon3': '1.972', 'DAMAGECOUNT': '6.606', 'FRAGCOUNT': '18.000'} [2023-02-24 20:26:47,228][213367] DAMAGECOUNT value on done: 11524.0 [2023-02-24 20:26:47,229][213367] Sum rewards: 13.416, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.766', 'AMMO5': '0.021', 'AMMO2': '0.039', 'weapon7': '0.064', 'AMMO3': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.195', 'WEAPON7': '0.200', 'weapon4': '0.242', 'weapon5': '0.380', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon2': '0.670', 'WEAPON3': '0.750', 'HITCOUNT': '1.030', 'weapon3': '1.480', 'DAMAGECOUNT': '5.451', 'FRAGCOUNT': '13.000'} [2023-02-24 20:26:47,271][213369] DAMAGECOUNT value on done: 13241.0 [2023-02-24 20:26:47,272][213369] Sum rewards: 20.560, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.994', 'AMMO5': '0.019', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'weapon4': '0.086', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'WEAPON5': '0.450', 'weapon5': '0.520', 'weapon2': '0.834', 'WEAPON3': '1.150', 'HITCOUNT': '1.590', 'weapon3': '2.058', 'DAMAGECOUNT': '7.257', 'FRAGCOUNT': '20.000'} [2023-02-24 20:26:47,337][213368] DAMAGECOUNT value on done: 13539.0 [2023-02-24 20:26:47,338][213368] Sum rewards: 34.664, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.014', 'AMMO2': '0.039', 'AMMO3': '0.144', 'AMMO4': '0.193', 'weapon4': '0.208', 'weapon5': '0.274', 'WEAPON4': '0.300', 'HEALTH': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'weapon2': '1.070', 'HITCOUNT': '2.090', 'weapon3': '2.130', 'DAMAGECOUNT': '9.102', 'FRAGCOUNT': '29.000'} [2023-02-24 20:26:47,375][213372] DAMAGECOUNT value on done: 10666.0 [2023-02-24 20:26:47,375][213372] Sum rewards: 19.434, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.912', 'AMMO2': '0.012', 'AMMO5': '0.034', 'AMMO4': '0.061', 'AMMO3': '0.158', 'weapon4': '0.184', 'WEAPON4': '0.200', 'weapon5': '0.516', 'weapon2': '0.554', 'WEAPON5': '0.850', 'WEAPON3': '1.000', 'HITCOUNT': '1.180', 'weapon3': '2.186', 'DAMAGECOUNT': '5.910', 'FRAGCOUNT': '19.000'} [2023-02-24 20:26:47,380][213383] DAMAGECOUNT value on done: 12622.0 [2023-02-24 20:26:47,381][213383] Sum rewards: 23.687, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.540', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.030', 'AMMO3': '0.143', 'AMMO4': '0.151', 'weapon5': '0.254', 'weapon4': '0.314', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.822', 'WEAPON3': '0.950', 'HITCOUNT': '1.780', 'weapon3': '2.234', 'DAMAGECOUNT': '6.873', 'FRAGCOUNT': '20.500'} [2023-02-24 20:26:47,401][213382] DAMAGECOUNT value on done: 10395.0 [2023-02-24 20:26:47,401][213382] Sum rewards: 15.609, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.762', 'AMMO2': '0.013', 'AMMO5': '0.025', 'WEAPON4': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.171', 'weapon4': '0.256', 'weapon5': '0.334', 'weapon2': '0.564', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'HITCOUNT': '1.340', 'weapon3': '2.376', 'DAMAGECOUNT': '5.478', 'FRAGCOUNT': '14.000'} [2023-02-24 20:26:47,413][213366] DAMAGECOUNT value on done: 13786.0 [2023-02-24 20:26:47,414][213366] Sum rewards: 25.164, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.867', 'AMMO2': '0.009', 'AMMO5': '0.023', 'AMMO4': '0.043', 'WEAPON4': '0.100', 'weapon4': '0.120', 'AMMO3': '0.140', 'weapon5': '0.528', 'WEAPON5': '0.600', 'weapon2': '0.678', 'WEAPON3': '0.900', 'HITCOUNT': '1.340', 'weapon3': '2.062', 'DAMAGECOUNT': '6.738', 'FRAGCOUNT': '22.000'} [2023-02-24 20:26:47,421][213384] DAMAGECOUNT value on done: 15354.0 [2023-02-24 20:26:47,422][213384] Sum rewards: 30.767, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.145', 'WEAPON1': '0.010', 'AMMO2': '0.030', 'AMMO5': '0.033', 'AMMO3': '0.147', 'AMMO4': '0.149', 'weapon2': '0.284', 'weapon4': '0.388', 'WEAPON4': '0.400', 'weapon5': '0.538', 'WEAPON5': '0.750', 'WEAPON3': '0.900', 'HITCOUNT': '1.930', 'weapon3': '2.310', 'DAMAGECOUNT': '9.543', 'FRAGCOUNT': '25.000'} [2023-02-24 20:26:47,530][213367] DAMAGECOUNT value on done: 12048.0 [2023-02-24 20:26:47,531][213367] Sum rewards: 20.690, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.620', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO3': '0.105', 'weapon4': '0.140', 'AMMO4': '0.187', 'WEAPON4': '0.200', 'weapon5': '0.376', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '1.210', 'weapon3': '1.562', 'weapon2': '1.592', 'DAMAGECOUNT': '5.034', 'FRAGCOUNT': '18.000'} [2023-02-24 20:26:47,579][213368] DAMAGECOUNT value on done: 14121.0 [2023-02-24 20:26:47,579][213368] Sum rewards: 38.458, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.712', 'AMMO5': '0.018', 'AMMO2': '0.023', 'AMMO4': '0.117', 'weapon5': '0.148', 'AMMO3': '0.176', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.464', 'WEAPON3': '1.150', 'HITCOUNT': '2.190', 'weapon3': '2.506', 'DAMAGECOUNT': '9.630', 'FRAGCOUNT': '34.000'} [2023-02-24 20:26:47,640][213369] DAMAGECOUNT value on done: 13682.0 [2023-02-24 20:26:47,641][213369] Sum rewards: 31.120, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.430', 'AMMO5': '0.020', 'AMMO2': '0.053', 'AMMO3': '0.113', 'AMMO4': '0.264', 'weapon4': '0.280', 'weapon5': '0.378', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'weapon2': '0.910', 'HITCOUNT': '1.690', 'weapon3': '2.012', 'DAMAGECOUNT': '8.529', 'FRAGCOUNT': '27.000'} [2023-02-24 20:26:47,679][213383] DAMAGECOUNT value on done: 12714.0 [2023-02-24 20:26:47,679][213383] Sum rewards: 23.827, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.310', 'AMMO5': '0.020', 'AMMO2': '0.027', 'AMMO4': '0.136', 'AMMO3': '0.180', 'weapon4': '0.204', 'WEAPON4': '0.300', 'weapon5': '0.366', 'weapon2': '0.498', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '1.860', 'weapon3': '2.548', 'DAMAGECOUNT': '8.097', 'FRAGCOUNT': '23.000'} [2023-02-24 20:26:47,686][213372] DAMAGECOUNT value on done: 12065.0 [2023-02-24 20:26:47,687][213372] Sum rewards: 20.030, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.377', 'ARMOR': '0.004', 'AMMO2': '0.020', 'AMMO5': '0.021', 'weapon7': '0.046', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.113', 'WEAPON4': '0.200', 'weapon5': '0.268', 'weapon4': '0.316', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon2': '1.142', 'HITCOUNT': '1.520', 'weapon3': '1.682', 'DAMAGECOUNT': '5.922', 'FRAGCOUNT': '16.000'} [2023-02-24 20:26:47,707][213382] DAMAGECOUNT value on done: 12883.0 [2023-02-24 20:26:47,707][213382] Sum rewards: 14.289, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.160', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon7': '0.034', 'AMMO4': '0.072', 'AMMO3': '0.090', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon5': '0.348', 'WEAPON3': '0.600', 'weapon4': '0.604', 'weapon2': '0.956', 'HITCOUNT': '1.030', 'weapon3': '1.530', 'DAMAGECOUNT': '4.011', 'FRAGCOUNT': '12.000'} [2023-02-24 20:26:47,722][213366] DAMAGECOUNT value on done: 11248.0 [2023-02-24 20:26:47,722][213366] Sum rewards: 26.047, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.395', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'weapon4': '0.128', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon5': '0.264', 'weapon2': '0.418', 'WEAPON3': '1.350', 'HITCOUNT': '1.890', 'weapon3': '2.826', 'DAMAGECOUNT': '7.662', 'FRAGCOUNT': '25.000'} [2023-02-24 20:26:47,729][213384] DAMAGECOUNT value on done: 12760.0 [2023-02-24 20:26:47,730][213384] Sum rewards: 31.784, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.252', 'AMMO2': '0.006', 'AMMO5': '0.021', 'AMMO4': '0.031', 'weapon4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.203', 'weapon2': '0.368', 'weapon5': '0.396', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '1.650', 'weapon3': '2.676', 'DAMAGECOUNT': '9.423', 'FRAGCOUNT': '27.000'} [2023-02-24 20:26:47,895][213368] DAMAGECOUNT value on done: 13187.0 [2023-02-24 20:26:47,895][213368] Sum rewards: 26.344, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.864', 'AMMO5': '0.017', 'AMMO2': '0.017', 'AMMO4': '0.086', 'AMMO3': '0.171', 'weapon5': '0.322', 'WEAPON5': '0.400', 'weapon2': '0.766', 'WEAPON3': '1.100', 'HITCOUNT': '1.610', 'weapon3': '2.428', 'DAMAGECOUNT': '7.290', 'FRAGCOUNT': '23.000'} [2023-02-24 20:26:47,958][213369] DAMAGECOUNT value on done: 11060.0 [2023-02-24 20:26:47,958][213369] Sum rewards: 22.751, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.346', 'AMMO5': '0.023', 'AMMO2': '0.028', 'AMMO3': '0.135', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'weapon4': '0.272', 'weapon5': '0.464', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon2': '0.916', 'HITCOUNT': '1.230', 'weapon3': '1.978', 'DAMAGECOUNT': '5.709', 'FRAGCOUNT': '19.000'} [2023-02-24 20:26:49,788][213365] Updated weights for policy 0, policy_version 24816 (0.0008) [2023-02-24 20:26:50,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13687.5). Total num frames: 101650432. Throughput: 0: 3486.4. Samples: 401630. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:26:50,243][213332] Avg episode reward: [(0, '20.571')] [2023-02-24 20:26:52,248][213367] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 20:26:52,651][213365] Updated weights for policy 0, policy_version 24826 (0.0009) [2023-02-24 20:26:55,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13697.0). Total num frames: 101720064. Throughput: 0: 3487.1. Samples: 422764. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:26:55,243][213332] Avg episode reward: [(0, '20.571')] [2023-02-24 20:26:55,560][213365] Updated weights for policy 0, policy_version 24836 (0.0009) [2023-02-24 20:26:56,707][213372] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 20:26:58,501][213365] Updated weights for policy 0, policy_version 24846 (0.0009) [2023-02-24 20:27:00,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13705.9). Total num frames: 101789696. Throughput: 0: 3489.3. Samples: 443774. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:27:00,243][213332] Avg episode reward: [(0, '20.571')] [2023-02-24 20:27:01,421][213365] Updated weights for policy 0, policy_version 24856 (0.0009) [2023-02-24 20:27:04,361][213365] Updated weights for policy 0, policy_version 24866 (0.0009) [2023-02-24 20:27:05,243][213332] Fps is (10 sec: 14335.5, 60 sec: 13994.6, 300 sec: 13744.3). Total num frames: 101863424. Throughput: 0: 3492.4. Samples: 454322. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 20:27:05,244][213332] Avg episode reward: [(0, '20.571')] [2023-02-24 20:27:05,924][213372] DAMAGECOUNT value on done: 14182.0 [2023-02-24 20:27:05,925][213382] DAMAGECOUNT value on done: 13526.0 [2023-02-24 20:27:05,925][213372] Sum rewards: 27.786, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.056', 'AMMO5': '0.017', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon4': '0.116', 'WEAPON4': '0.150', 'weapon5': '0.150', 'AMMO3': '0.174', 'WEAPON5': '0.350', 'weapon2': '0.606', 'WEAPON3': '1.150', 'HITCOUNT': '1.730', 'weapon3': '2.790', 'DAMAGECOUNT': '7.740', 'FRAGCOUNT': '26.000'} [2023-02-24 20:27:05,925][213382] Sum rewards: 12.169, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '0.000', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.029', 'AMMO3': '0.042', 'WEAPON4': '0.050', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.180', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'weapon4': '0.352', 'HITCOUNT': '0.450', 'weapon2': '0.816', 'weapon3': '1.268', 'DAMAGECOUNT': '3.063', 'FRAGCOUNT': '8.000'} [2023-02-24 20:27:05,930][213367] DAMAGECOUNT value on done: 12546.0 [2023-02-24 20:27:05,930][213367] Sum rewards: 26.627, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.980', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.055', 'AMMO3': '0.075', 'WEAPON5': '0.200', 'weapon5': '0.246', 'WEAPON4': '0.300', 'weapon4': '0.476', 'WEAPON3': '0.550', 'weapon2': '1.098', 'HITCOUNT': '1.690', 'weapon3': '1.772', 'DAMAGECOUNT': '6.126', 'FRAGCOUNT': '21.000'} [2023-02-24 20:27:05,975][213384] DAMAGECOUNT value on done: 14078.0 [2023-02-24 20:27:05,975][213384] Sum rewards: 25.108, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.920', 'AMMO5': '0.017', 'AMMO2': '0.018', 'AMMO3': '0.072', 'AMMO4': '0.089', 'weapon4': '0.288', 'WEAPON4': '0.350', 'weapon5': '0.448', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'weapon2': '0.808', 'HITCOUNT': '1.560', 'weapon3': '1.952', 'DAMAGECOUNT': '6.975', 'FRAGCOUNT': '20.000'} [2023-02-24 20:27:05,984][213383] DAMAGECOUNT value on done: 13023.0 [2023-02-24 20:27:05,985][213383] Sum rewards: 23.693, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.838', 'AMMO5': '0.020', 'AMMO2': '0.032', 'AMMO3': '0.160', 'AMMO4': '0.162', 'weapon5': '0.286', 'WEAPON4': '0.350', 'weapon4': '0.422', 'WEAPON5': '0.600', 'weapon2': '0.882', 'WEAPON3': '0.950', 'HITCOUNT': '1.600', 'weapon3': '1.884', 'DAMAGECOUNT': '7.182', 'FRAGCOUNT': '23.000'} [2023-02-24 20:27:06,023][213366] DAMAGECOUNT value on done: 12954.0 [2023-02-24 20:27:06,024][213366] Sum rewards: 24.692, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.005', 'AMMO2': '0.010', 'AMMO5': '0.011', 'weapon4': '0.020', 'AMMO4': '0.050', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.350', 'weapon5': '0.388', 'WEAPON3': '0.650', 'weapon2': '1.262', 'HITCOUNT': '1.470', 'weapon3': '2.054', 'DAMAGECOUNT': '5.985', 'FRAGCOUNT': '20.000'} [2023-02-24 20:27:06,123][213369] DAMAGECOUNT value on done: 14056.0 [2023-02-24 20:27:06,124][213369] Sum rewards: 11.572, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.370', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.149', 'weapon4': '0.218', 'WEAPON5': '0.250', 'weapon5': '0.250', 'ARMOR': '0.452', 'weapon2': '0.766', 'WEAPON3': '0.950', 'HITCOUNT': '1.290', 'weapon3': '2.052', 'DAMAGECOUNT': '5.130', 'FRAGCOUNT': '11.000'} [2023-02-24 20:27:06,231][213372] DAMAGECOUNT value on done: 15736.0 [2023-02-24 20:27:06,231][213382] DAMAGECOUNT value on done: 14089.0 [2023-02-24 20:27:06,231][213372] Sum rewards: 32.254, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.560', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.218', 'weapon4': '0.376', 'weapon2': '0.382', 'WEAPON3': '0.850', 'HITCOUNT': '2.130', 'weapon3': '2.242', 'DAMAGECOUNT': '8.973', 'FRAGCOUNT': '26.000'} [2023-02-24 20:27:06,231][213382] Sum rewards: 14.590, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.864', 'AMMO5': '0.017', 'AMMO2': '0.023', 'AMMO3': '0.104', 'AMMO4': '0.115', 'WEAPON4': '0.200', 'weapon4': '0.224', 'WEAPON5': '0.450', 'weapon5': '0.452', 'WEAPON3': '0.650', 'HITCOUNT': '0.990', 'weapon2': '1.304', 'weapon3': '1.430', 'DAMAGECOUNT': '4.995', 'FRAGCOUNT': '12.000'} [2023-02-24 20:27:06,236][213367] DAMAGECOUNT value on done: 15194.0 [2023-02-24 20:27:06,237][213367] Sum rewards: 9.077, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.380', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.045', 'AMMO3': '0.082', 'weapon4': '0.146', 'WEAPON4': '0.250', 'weapon5': '0.326', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '0.860', 'weapon2': '1.330', 'weapon3': '1.754', 'DAMAGECOUNT': '3.444', 'FRAGCOUNT': '8.000'} [2023-02-24 20:27:06,242][213368] DAMAGECOUNT value on done: 16207.0 [2023-02-24 20:27:06,242][213368] Sum rewards: 21.045, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.930', 'AMMO5': '0.015', 'AMMO2': '0.021', 'weapon7': '0.062', 'AMMO3': '0.081', 'AMMO4': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.318', 'weapon4': '0.330', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '1.000', 'weapon2': '1.162', 'weapon3': '1.808', 'DAMAGECOUNT': '5.331', 'FRAGCOUNT': '17.000'} [2023-02-24 20:27:06,286][213384] DAMAGECOUNT value on done: 13879.0 [2023-02-24 20:27:06,286][213384] Sum rewards: 19.707, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.875', 'AMMO5': '0.019', 'AMMO2': '0.023', 'AMMO4': '0.112', 'AMMO3': '0.128', 'WEAPON4': '0.300', 'weapon5': '0.468', 'WEAPON5': '0.500', 'weapon4': '0.554', 'weapon2': '0.568', 'WEAPON3': '0.800', 'HITCOUNT': '1.640', 'weapon3': '2.028', 'DAMAGECOUNT': '6.192', 'FRAGCOUNT': '17.000'} [2023-02-24 20:27:06,300][213383] DAMAGECOUNT value on done: 13880.0 [2023-02-24 20:27:06,300][213383] Sum rewards: 19.726, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.219', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.062', 'AMMO3': '0.119', 'WEAPON4': '0.200', 'weapon4': '0.222', 'weapon5': '0.244', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'weapon2': '1.002', 'HITCOUNT': '1.360', 'weapon3': '1.898', 'DAMAGECOUNT': '5.613', 'FRAGCOUNT': '18.000'} [2023-02-24 20:27:06,337][213366] DAMAGECOUNT value on done: 15268.0 [2023-02-24 20:27:06,338][213366] Sum rewards: 22.912, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.430', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO5': '0.027', 'AMMO3': '0.085', 'AMMO4': '0.111', 'weapon5': '0.374', 'WEAPON4': '0.400', 'weapon4': '0.406', 'WEAPON3': '0.550', 'WEAPON5': '0.750', 'weapon2': '1.218', 'weapon3': '1.302', 'HITCOUNT': '1.640', 'DAMAGECOUNT': '7.686', 'FRAGCOUNT': '18.000'} [2023-02-24 20:27:06,403][213367] DAMAGECOUNT value on done: 13906.0 [2023-02-24 20:27:06,403][213367] Sum rewards: 23.050, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '0.005', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO3': '0.110', 'AMMO4': '0.137', 'weapon5': '0.258', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.552', 'WEAPON3': '0.700', 'weapon2': '0.854', 'HITCOUNT': '1.860', 'weapon3': '2.040', 'DAMAGECOUNT': '7.146', 'FRAGCOUNT': '17.000'} [2023-02-24 20:27:06,431][213369] DAMAGECOUNT value on done: 15198.0 [2023-02-24 20:27:06,432][213369] Sum rewards: 20.088, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.288', 'AMMO2': '0.006', 'AMMO5': '0.016', 'AMMO4': '0.032', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'weapon4': '0.214', 'WEAPON5': '0.400', 'weapon5': '0.550', 'weapon2': '0.668', 'WEAPON3': '1.000', 'HITCOUNT': '1.180', 'weapon3': '2.088', 'DAMAGECOUNT': '5.871', 'FRAGCOUNT': '19.000'} [2023-02-24 20:27:06,529][213382] DAMAGECOUNT value on done: 12894.0 [2023-02-24 20:27:06,529][213382] Sum rewards: 27.907, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.983', 'AMMO2': '0.016', 'AMMO5': '0.020', 'AMMO4': '0.079', 'weapon4': '0.080', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.450', 'weapon5': '0.456', 'weapon2': '0.526', 'WEAPON3': '0.800', 'HITCOUNT': '1.720', 'weapon3': '2.476', 'DAMAGECOUNT': '7.497', 'FRAGCOUNT': '23.500'} [2023-02-24 20:27:06,530][213372] DAMAGECOUNT value on done: 12204.0 [2023-02-24 20:27:06,530][213372] Sum rewards: 16.464, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.560', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO3': '0.065', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'weapon4': '0.244', 'WEAPON5': '0.250', 'weapon5': '0.258', 'WEAPON3': '0.450', 'HITCOUNT': '1.030', 'weapon2': '1.106', 'weapon3': '1.488', 'DAMAGECOUNT': '4.614', 'FRAGCOUNT': '14.000'} [2023-02-24 20:27:06,542][213368] DAMAGECOUNT value on done: 15559.0 [2023-02-24 20:27:06,543][213368] Sum rewards: 17.366, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.496', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.143', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon5': '0.356', 'weapon4': '0.688', 'weapon2': '0.796', 'WEAPON3': '0.900', 'HITCOUNT': '1.730', 'weapon3': '1.732', 'DAMAGECOUNT': '5.700', 'FRAGCOUNT': '15.000'} [2023-02-24 20:27:06,589][213384] DAMAGECOUNT value on done: 17119.0 [2023-02-24 20:27:06,590][213384] Sum rewards: 18.564, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.960', 'AMMO2': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'weapon4': '0.040', 'AMMO4': '0.041', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'weapon5': '0.282', 'WEAPON5': '0.350', 'WEAPON3': '0.900', 'weapon2': '1.110', 'HITCOUNT': '1.140', 'weapon3': '1.828', 'DAMAGECOUNT': '5.295', 'FRAGCOUNT': '16.000'} [2023-02-24 20:27:06,601][213383] DAMAGECOUNT value on done: 13954.0 [2023-02-24 20:27:06,601][213383] Sum rewards: 20.505, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.460', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.013', 'AMMO3': '0.052', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'weapon5': '0.498', 'HITCOUNT': '0.820', 'weapon2': '1.120', 'weapon3': '1.662', 'DAMAGECOUNT': '3.996', 'FRAGCOUNT': '15.000'} [2023-02-24 20:27:06,620][213366] DAMAGECOUNT value on done: 16081.0 [2023-02-24 20:27:06,620][213366] Sum rewards: 25.622, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.096', 'AMMO5': '0.014', 'AMMO2': '0.020', 'AMMO4': '0.098', 'AMMO3': '0.123', 'weapon5': '0.130', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.464', 'WEAPON3': '0.800', 'weapon2': '0.814', 'HITCOUNT': '1.820', 'weapon3': '1.950', 'DAMAGECOUNT': '6.885', 'FRAGCOUNT': '22.000'} [2023-02-24 20:27:06,710][213367] DAMAGECOUNT value on done: 14126.0 [2023-02-24 20:27:06,710][213367] Sum rewards: 22.248, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.256', 'AMMO5': '0.019', 'AMMO2': '0.027', 'AMMO3': '0.116', 'AMMO4': '0.136', 'WEAPON4': '0.350', 'weapon4': '0.370', 'WEAPON5': '0.450', 'weapon5': '0.606', 'weapon2': '0.702', 'WEAPON3': '0.750', 'HITCOUNT': '1.650', 'weapon3': '1.844', 'DAMAGECOUNT': '6.234', 'FRAGCOUNT': '20.000'} [2023-02-24 20:27:06,770][213368] DAMAGECOUNT value on done: 16152.0 [2023-02-24 20:27:06,771][213368] Sum rewards: 26.257, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.300', 'AMMO5': '0.012', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.101', 'AMMO3': '0.102', 'weapon4': '0.164', 'WEAPON5': '0.250', 'weapon5': '0.388', 'WEAPON3': '0.600', 'HITCOUNT': '1.410', 'weapon2': '1.534', 'weapon3': '1.582', 'DAMAGECOUNT': '6.093', 'FRAGCOUNT': '21.000'} [2023-02-24 20:27:06,781][213369] DAMAGECOUNT value on done: 15404.0 [2023-02-24 20:27:06,782][213369] Sum rewards: 20.646, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.041', 'AMMO2': '0.003', 'AMMO4': '0.014', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'weapon4': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'weapon5': '0.388', 'WEAPON5': '0.650', 'WEAPON3': '0.850', 'weapon2': '0.978', 'HITCOUNT': '1.400', 'weapon3': '2.194', 'DAMAGECOUNT': '5.166', 'FRAGCOUNT': '19.000'} [2023-02-24 20:27:06,824][213382] DAMAGECOUNT value on done: 15556.0 [2023-02-24 20:27:06,825][213382] Sum rewards: 30.332, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.955', 'AMMO5': '0.019', 'AMMO2': '0.022', 'AMMO3': '0.102', 'AMMO4': '0.111', 'weapon5': '0.352', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.482', 'weapon4': '0.748', 'WEAPON3': '0.750', 'weapon3': '2.082', 'HITCOUNT': '2.200', 'DAMAGECOUNT': '8.019', 'FRAGCOUNT': '24.000'} [2023-02-24 20:27:06,834][213372] DAMAGECOUNT value on done: 14458.0 [2023-02-24 20:27:06,835][213372] Sum rewards: 29.907, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.415', 'AMMO5': '0.017', 'AMMO2': '0.019', 'weapon4': '0.070', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'AMMO3': '0.126', 'weapon5': '0.280', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'weapon2': '1.300', 'HITCOUNT': '1.610', 'weapon3': '2.028', 'DAMAGECOUNT': '7.179', 'FRAGCOUNT': '24.000'} [2023-02-24 20:27:06,882][213384] DAMAGECOUNT value on done: 14425.0 [2023-02-24 20:27:06,882][213384] Sum rewards: 21.813, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.120', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO3': '0.094', 'WEAPON5': '0.300', 'weapon5': '0.350', 'WEAPON3': '0.550', 'weapon2': '0.994', 'HITCOUNT': '1.110', 'weapon3': '1.774', 'DAMAGECOUNT': '4.995', 'FRAGCOUNT': '18.000'} [2023-02-24 20:27:06,906][213383] DAMAGECOUNT value on done: 14302.0 [2023-02-24 20:27:06,906][213383] Sum rewards: 17.372, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.500', 'AMMO2': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.041', 'AMMO3': '0.111', 'WEAPON4': '0.200', 'weapon4': '0.276', 'WEAPON5': '0.300', 'weapon5': '0.332', 'WEAPON3': '0.750', 'weapon2': '0.934', 'HITCOUNT': '1.060', 'weapon3': '1.826', 'DAMAGECOUNT': '4.764', 'FRAGCOUNT': '15.000'} [2023-02-24 20:27:06,918][213366] DAMAGECOUNT value on done: 13133.0 [2023-02-24 20:27:06,919][213366] Sum rewards: 22.821, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.440', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.021', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'weapon4': '0.394', 'weapon5': '0.488', 'WEAPON5': '0.600', 'weapon2': '0.670', 'WEAPON3': '1.000', 'HITCOUNT': '1.440', 'weapon3': '1.904', 'DAMAGECOUNT': '5.655', 'FRAGCOUNT': '21.000'} [2023-02-24 20:27:07,064][213368] DAMAGECOUNT value on done: 15842.0 [2023-02-24 20:27:07,064][213368] Sum rewards: 28.285, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.554', 'AMMO5': '0.017', 'AMMO2': '0.026', 'AMMO3': '0.091', 'AMMO4': '0.127', 'weapon5': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.606', 'WEAPON3': '0.650', 'weapon4': '0.726', 'weapon3': '1.880', 'HITCOUNT': '1.900', 'DAMAGECOUNT': '7.965', 'FRAGCOUNT': '22.000'} [2023-02-24 20:27:07,079][213369] DAMAGECOUNT value on done: 12687.0 [2023-02-24 20:27:07,080][213369] Sum rewards: 18.505, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.783', 'AMMO2': '0.004', 'AMMO5': '0.015', 'AMMO4': '0.018', 'AMMO3': '0.072', 'WEAPON4': '0.150', 'weapon4': '0.228', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'weapon5': '0.544', 'weapon2': '0.900', 'HITCOUNT': '1.090', 'weapon3': '1.486', 'DAMAGECOUNT': '4.881', 'FRAGCOUNT': '15.000'} [2023-02-24 20:27:07,311][213365] Updated weights for policy 0, policy_version 24876 (0.0009) [2023-02-24 20:27:10,192][213365] Updated weights for policy 0, policy_version 24886 (0.0009) [2023-02-24 20:27:10,243][213332] Fps is (10 sec: 14336.1, 60 sec: 13994.7, 300 sec: 13750.9). Total num frames: 101933056. Throughput: 0: 3492.7. Samples: 475238. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 20:27:10,243][213332] Avg episode reward: [(0, '21.554')] [2023-02-24 20:27:13,119][213365] Updated weights for policy 0, policy_version 24896 (0.0009) [2023-02-24 20:27:15,243][213332] Fps is (10 sec: 13927.0, 60 sec: 13994.7, 300 sec: 13756.9). Total num frames: 102002688. Throughput: 0: 3500.7. Samples: 496334. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 20:27:15,243][213332] Avg episode reward: [(0, '21.554')] [2023-02-24 20:27:16,049][213365] Updated weights for policy 0, policy_version 24906 (0.0009) [2023-02-24 20:27:18,998][213365] Updated weights for policy 0, policy_version 24916 (0.0009) [2023-02-24 20:27:20,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13994.6, 300 sec: 13762.6). Total num frames: 102072320. Throughput: 0: 3499.0. Samples: 506846. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 20:27:20,243][213332] Avg episode reward: [(0, '21.554')] [2023-02-24 20:27:21,926][213365] Updated weights for policy 0, policy_version 24926 (0.0009) [2023-02-24 20:27:24,889][213365] Updated weights for policy 0, policy_version 24936 (0.0009) [2023-02-24 20:27:25,153][213382] DAMAGECOUNT value on done: 16190.0 [2023-02-24 20:27:25,154][213382] Sum rewards: 33.412, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.120', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO4': '0.074', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'weapon4': '0.198', 'WEAPON5': '0.500', 'weapon2': '0.558', 'weapon5': '0.622', 'WEAPON3': '0.700', 'HITCOUNT': '1.710', 'weapon3': '2.108', 'DAMAGECOUNT': '7.989', 'FRAGCOUNT': '27.000'} [2023-02-24 20:27:25,167][213367] DAMAGECOUNT value on done: 14342.0 [2023-02-24 20:27:25,167][213367] Sum rewards: 16.817, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.748', 'AMMO2': '0.012', 'weapon4': '0.014', 'AMMO5': '0.015', 'WEAPON4': '0.050', 'weapon7': '0.054', 'AMMO4': '0.059', 'AMMO3': '0.093', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.450', 'weapon5': '0.572', 'WEAPON3': '0.650', 'HITCOUNT': '0.880', 'weapon2': '1.040', 'weapon3': '1.848', 'DAMAGECOUNT': '5.388', 'FRAGCOUNT': '12.000'} [2023-02-24 20:27:25,187][213372] DAMAGECOUNT value on done: 16935.0 [2023-02-24 20:27:25,188][213372] Sum rewards: 26.031, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.506', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.028', 'AMMO3': '0.128', 'AMMO4': '0.141', 'weapon5': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.720', 'WEAPON3': '0.750', 'weapon2': '0.806', 'weapon3': '1.622', 'HITCOUNT': '1.940', 'DAMAGECOUNT': '8.259', 'FRAGCOUNT': '20.000'} [2023-02-24 20:27:25,191][213384] DAMAGECOUNT value on done: 16230.0 [2023-02-24 20:27:25,191][213384] Sum rewards: 24.875, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.602', 'AMMO2': '0.012', 'AMMO5': '0.012', 'weapon4': '0.054', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'WEAPON5': '0.400', 'weapon5': '0.618', 'WEAPON3': '0.750', 'weapon2': '0.794', 'HITCOUNT': '1.450', 'weapon3': '1.934', 'DAMAGECOUNT': '6.426', 'FRAGCOUNT': '21.000'} [2023-02-24 20:27:25,233][213383] DAMAGECOUNT value on done: 15081.0 [2023-02-24 20:27:25,234][213383] Sum rewards: 23.725, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.018', 'AMMO5': '0.022', 'AMMO4': '0.091', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'weapon4': '0.214', 'HEALTH': '0.356', 'weapon2': '0.366', 'WEAPON5': '0.500', 'weapon5': '0.506', 'WEAPON3': '0.600', 'HITCOUNT': '1.440', 'weapon3': '2.434', 'DAMAGECOUNT': '6.174', 'FRAGCOUNT': '19.000'} [2023-02-24 20:27:25,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 13767.9). Total num frames: 102141952. Throughput: 0: 3499.2. Samples: 527784. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:27:25,243][213332] Avg episode reward: [(0, '21.821')] [2023-02-24 20:27:25,247][213352] Saving new best policy, reward=21.821! [2023-02-24 20:27:25,253][213366] DAMAGECOUNT value on done: 15356.0 [2023-02-24 20:27:25,253][213366] Sum rewards: 22.319, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.052', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'WEAPON5': '0.250', 'weapon5': '0.260', 'weapon2': '0.590', 'WEAPON3': '1.150', 'HITCOUNT': '1.800', 'weapon3': '2.564', 'DAMAGECOUNT': '7.206', 'FRAGCOUNT': '22.000'} [2023-02-24 20:27:25,394][213369] DAMAGECOUNT value on done: 16739.0 [2023-02-24 20:27:25,394][213369] Sum rewards: 32.107, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.048', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO3': '0.150', 'AMMO4': '0.179', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon5': '0.306', 'weapon4': '0.348', 'WEAPON3': '0.950', 'weapon2': '1.022', 'HITCOUNT': '2.000', 'weapon3': '2.002', 'DAMAGECOUNT': '8.049', 'FRAGCOUNT': '28.000'} [2023-02-24 20:27:25,472][213382] DAMAGECOUNT value on done: 16137.0 [2023-02-24 20:27:25,472][213382] Sum rewards: 25.459, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.454', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO4': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'weapon2': '0.314', 'WEAPON5': '0.350', 'weapon5': '0.370', 'weapon4': '0.500', 'WEAPON3': '1.000', 'HITCOUNT': '1.350', 'weapon3': '2.054', 'DAMAGECOUNT': '6.144', 'FRAGCOUNT': '23.000'} [2023-02-24 20:27:25,487][213367] DAMAGECOUNT value on done: 18325.0 [2023-02-24 20:27:25,487][213367] Sum rewards: 30.699, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.266', 'AMMO5': '0.022', 'AMMO2': '0.037', 'AMMO3': '0.134', 'weapon5': '0.156', 'AMMO4': '0.183', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.450', 'weapon2': '0.466', 'WEAPON4': '0.550', 'weapon4': '0.784', 'WEAPON3': '1.000', 'weapon3': '2.190', 'HITCOUNT': '2.250', 'DAMAGECOUNT': '9.393', 'FRAGCOUNT': '26.000'} [2023-02-24 20:27:25,489][213368] DAMAGECOUNT value on done: 17279.0 [2023-02-24 20:27:25,489][213368] Sum rewards: 11.189, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.905', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.049', 'weapon7': '0.132', 'AMMO4': '0.172', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.250', 'weapon5': '0.254', 'WEAPON3': '0.300', 'WEAPON7': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.654', 'weapon2': '0.812', 'weapon3': '0.910', 'HITCOUNT': '0.970', 'DAMAGECOUNT': '3.216', 'FRAGCOUNT': '9.000'} [2023-02-24 20:27:25,503][213372] DAMAGECOUNT value on done: 17953.0 [2023-02-24 20:27:25,503][213372] Sum rewards: 18.888, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.190', 'AMMO5': '0.016', 'AMMO2': '0.034', 'AMMO4': '0.171', 'AMMO3': '0.177', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.280', 'WEAPON5': '0.350', 'weapon4': '0.442', 'WEAPON4': '0.450', 'weapon2': '0.450', 'WEAPON3': '1.000', 'HITCOUNT': '1.730', 'weapon3': '2.476', 'DAMAGECOUNT': '6.651', 'FRAGCOUNT': '18.000'} [2023-02-24 20:27:25,506][213384] DAMAGECOUNT value on done: 15038.0 [2023-02-24 20:27:25,507][213384] Sum rewards: 12.315, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.022', 'AMMO2': '0.032', 'AMMO3': '0.081', 'weapon7': '0.104', 'WEAPON4': '0.150', 'AMMO4': '0.158', 'weapon5': '0.196', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.398', 'WEAPON5': '0.450', 'WEAPON3': '0.450', 'HEALTH': '0.663', 'HITCOUNT': '0.990', 'weapon3': '1.198', 'weapon2': '1.706', 'DAMAGECOUNT': '3.477', 'FRAGCOUNT': '9.000'} [2023-02-24 20:27:25,553][213383] DAMAGECOUNT value on done: 16424.0 [2023-02-24 20:27:25,554][213383] Sum rewards: 26.018, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.328', 'AMMO2': '0.009', 'AMMO5': '0.015', 'AMMO4': '0.043', 'weapon4': '0.046', 'AMMO3': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.400', 'weapon5': '0.484', 'weapon2': '0.834', 'WEAPON3': '0.850', 'HITCOUNT': '1.530', 'weapon3': '2.232', 'DAMAGECOUNT': '7.632', 'FRAGCOUNT': '22.000'} [2023-02-24 20:27:25,573][213366] DAMAGECOUNT value on done: 17693.0 [2023-02-24 20:27:25,573][213366] Sum rewards: 27.066, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.504', 'AMMO5': '0.012', 'AMMO2': '0.017', 'weapon4': '0.080', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'weapon5': '0.246', 'WEAPON5': '0.300', 'weapon2': '0.878', 'WEAPON3': '0.900', 'HITCOUNT': '1.550', 'weapon3': '2.426', 'DAMAGECOUNT': '7.275', 'FRAGCOUNT': '24.000'} [2023-02-24 20:27:25,659][213367] DAMAGECOUNT value on done: 15225.0 [2023-02-24 20:27:25,659][213367] Sum rewards: 14.070, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO3': '0.075', 'AMMO4': '0.100', 'HEALTH': '0.129', 'WEAPON4': '0.200', 'weapon4': '0.264', 'WEAPON5': '0.300', 'weapon5': '0.388', 'WEAPON3': '0.450', 'weapon2': '0.578', 'HITCOUNT': '0.880', 'weapon3': '1.716', 'DAMAGECOUNT': '3.957', 'FRAGCOUNT': '11.000'} [2023-02-24 20:27:25,696][213369] DAMAGECOUNT value on done: 17201.0 [2023-02-24 20:27:25,697][213369] Sum rewards: 14.698, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.316', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.145', 'AMMO4': '0.148', 'weapon4': '0.164', 'WEAPON4': '0.300', 'weapon5': '0.406', 'WEAPON5': '0.550', 'weapon2': '0.860', 'WEAPON3': '0.900', 'HITCOUNT': '1.590', 'weapon3': '2.128', 'DAMAGECOUNT': '6.009', 'FRAGCOUNT': '14.000'} [2023-02-24 20:27:25,761][213382] DAMAGECOUNT value on done: 14310.0 [2023-02-24 20:27:25,761][213382] Sum rewards: 20.337, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.680', 'AMMO5': '0.012', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO3': '0.070', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'weapon4': '0.250', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'weapon5': '0.562', 'HITCOUNT': '0.970', 'weapon2': '1.016', 'weapon3': '1.484', 'DAMAGECOUNT': '4.248', 'FRAGCOUNT': '15.000'} [2023-02-24 20:27:25,791][213368] DAMAGECOUNT value on done: 18123.0 [2023-02-24 20:27:25,792][213368] Sum rewards: 24.258, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.170', 'AMMO5': '0.025', 'AMMO2': '0.029', 'AMMO3': '0.106', 'AMMO4': '0.144', 'weapon5': '0.276', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'weapon2': '0.696', 'weapon4': '0.734', 'WEAPON3': '0.750', 'weapon3': '1.746', 'HITCOUNT': '1.880', 'DAMAGECOUNT': '7.692', 'FRAGCOUNT': '21.000'} [2023-02-24 20:27:25,801][213372] DAMAGECOUNT value on done: 15003.0 [2023-02-24 20:27:25,801][213372] Sum rewards: 26.812, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.590', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'AMMO5': '0.030', 'AMMO4': '0.099', 'weapon4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.156', 'weapon5': '0.278', 'WEAPON5': '0.650', 'weapon2': '0.690', 'WEAPON3': '0.950', 'HITCOUNT': '1.950', 'weapon3': '2.410', 'DAMAGECOUNT': '8.397', 'FRAGCOUNT': '22.000'} [2023-02-24 20:27:25,801][213384] DAMAGECOUNT value on done: 19171.0 [2023-02-24 20:27:25,802][213384] Sum rewards: 15.652, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.690', 'AMMO2': '0.015', 'AMMO5': '0.021', 'weapon4': '0.054', 'AMMO4': '0.073', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'weapon5': '0.474', 'WEAPON5': '0.600', 'weapon2': '0.764', 'WEAPON3': '1.050', 'HITCOUNT': '1.320', 'weapon3': '2.202', 'DAMAGECOUNT': '6.156', 'FRAGCOUNT': '15.000'} [2023-02-24 20:27:25,847][213383] DAMAGECOUNT value on done: 16085.0 [2023-02-24 20:27:25,847][213383] Sum rewards: 19.800, reward structure: {'DEATHCOUNT': '-7.500', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'HEALTH': '0.038', 'AMMO2': '0.044', 'AMMO3': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.210', 'AMMO4': '0.219', 'weapon5': '0.300', 'weapon4': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.880', 'weapon2': '1.010', 'weapon3': '1.414', 'DAMAGECOUNT': '5.193', 'FRAGCOUNT': '16.000'} [2023-02-24 20:27:25,865][213366] DAMAGECOUNT value on done: 17594.0 [2023-02-24 20:27:25,865][213366] Sum rewards: 18.635, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.613', 'AMMO5': '0.023', 'AMMO2': '0.027', 'AMMO3': '0.078', 'AMMO4': '0.136', 'WEAPON4': '0.400', 'weapon5': '0.534', 'WEAPON3': '0.550', 'weapon4': '0.576', 'WEAPON5': '0.600', 'weapon2': '0.726', 'HITCOUNT': '1.170', 'weapon3': '1.638', 'DAMAGECOUNT': '4.539', 'FRAGCOUNT': '16.000'} [2023-02-24 20:27:25,966][213367] DAMAGECOUNT value on done: 15972.0 [2023-02-24 20:27:25,967][213367] Sum rewards: 17.416, reward structure: {'DEATHCOUNT': '-9.750', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.019', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'AMMO3': '0.134', 'HEALTH': '0.164', 'weapon4': '0.166', 'weapon2': '0.340', 'WEAPON5': '0.350', 'weapon5': '0.574', 'WEAPON3': '0.800', 'HITCOUNT': '1.450', 'weapon3': '2.412', 'DAMAGECOUNT': '5.538', 'FRAGCOUNT': '15.000'} [2023-02-24 20:27:26,010][213368] DAMAGECOUNT value on done: 17933.0 [2023-02-24 20:27:26,011][213368] Sum rewards: 16.160, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.016', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.034', 'AMMO2': '0.036', 'AMMO3': '0.132', 'AMMO4': '0.178', 'weapon4': '0.242', 'weapon5': '0.296', 'WEAPON4': '0.300', 'weapon2': '0.572', 'WEAPON5': '0.700', 'WEAPON3': '0.700', 'HITCOUNT': '1.270', 'weapon3': '2.358', 'DAMAGECOUNT': '5.343', 'FRAGCOUNT': '16.000'} [2023-02-24 20:27:26,061][213382] DAMAGECOUNT value on done: 17477.0 [2023-02-24 20:27:26,061][213382] Sum rewards: 19.905, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.196', 'AMMO2': '0.002', 'AMMO4': '0.007', 'AMMO5': '0.015', 'AMMO3': '0.092', 'WEAPON4': '0.200', 'weapon4': '0.244', 'weapon5': '0.336', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon2': '0.814', 'HITCOUNT': '1.540', 'weapon3': '1.738', 'DAMAGECOUNT': '5.763', 'FRAGCOUNT': '16.000'} [2023-02-24 20:27:26,085][213369] DAMAGECOUNT value on done: 17487.0 [2023-02-24 20:27:26,085][213369] Sum rewards: 20.108, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.775', 'ARMOR': '0.004', 'AMMO2': '0.012', 'AMMO5': '0.015', 'AMMO4': '0.057', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'weapon4': '0.266', 'WEAPON5': '0.500', 'weapon2': '0.500', 'weapon5': '0.618', 'WEAPON3': '1.000', 'HITCOUNT': '1.270', 'weapon3': '2.028', 'DAMAGECOUNT': '6.249', 'FRAGCOUNT': '18.000'} [2023-02-24 20:27:26,095][213372] DAMAGECOUNT value on done: 16277.0 [2023-02-24 20:27:26,095][213372] Sum rewards: 27.661, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.880', 'AMMO2': '0.001', 'AMMO4': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO3': '0.090', 'weapon5': '0.396', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'weapon2': '1.070', 'HITCOUNT': '1.430', 'weapon3': '2.160', 'DAMAGECOUNT': '5.457', 'FRAGCOUNT': '22.000'} [2023-02-24 20:27:26,104][213384] DAMAGECOUNT value on done: 17108.0 [2023-02-24 20:27:26,105][213384] Sum rewards: 18.125, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.870', 'AMMO5': '0.022', 'AMMO2': '0.043', 'weapon7': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.144', 'WEAPON7': '0.200', 'AMMO4': '0.216', 'weapon5': '0.314', 'WEAPON4': '0.550', 'weapon4': '0.662', 'WEAPON5': '0.700', 'weapon2': '0.800', 'WEAPON3': '0.900', 'weapon3': '1.734', 'HITCOUNT': '1.840', 'DAMAGECOUNT': '8.049', 'FRAGCOUNT': '18.000'} [2023-02-24 20:27:26,154][213383] DAMAGECOUNT value on done: 16574.0 [2023-02-24 20:27:26,155][213383] Sum rewards: 20.538, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.116', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO5': '0.019', 'AMMO4': '0.081', 'AMMO3': '0.161', 'weapon5': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.418', 'WEAPON5': '0.450', 'weapon2': '0.724', 'WEAPON3': '0.950', 'HITCOUNT': '1.820', 'weapon3': '2.044', 'DAMAGECOUNT': '6.816', 'FRAGCOUNT': '19.000'} [2023-02-24 20:27:26,163][213366] DAMAGECOUNT value on done: 14703.0 [2023-02-24 20:27:26,163][213366] Sum rewards: 16.483, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.510', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.018', 'AMMO3': '0.080', 'AMMO4': '0.091', 'WEAPON4': '0.200', 'weapon4': '0.294', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon5': '0.576', 'weapon2': '0.904', 'HITCOUNT': '1.200', 'weapon3': '1.692', 'DAMAGECOUNT': '4.710', 'FRAGCOUNT': '13.000'} [2023-02-24 20:27:26,307][213368] DAMAGECOUNT value on done: 18160.0 [2023-02-24 20:27:26,307][213368] Sum rewards: 23.830, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.420', 'AMMO5': '0.016', 'AMMO2': '0.019', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'AMMO3': '0.150', 'weapon4': '0.246', 'weapon5': '0.356', 'WEAPON5': '0.500', 'weapon2': '0.598', 'WEAPON3': '1.100', 'HITCOUNT': '1.420', 'weapon3': '2.446', 'DAMAGECOUNT': '6.954', 'FRAGCOUNT': '22.000'} [2023-02-24 20:27:26,375][213369] DAMAGECOUNT value on done: 14468.0 [2023-02-24 20:27:26,375][213369] Sum rewards: 20.077, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.380', 'AMMO2': '0.003', 'AMMO5': '0.014', 'AMMO4': '0.017', 'weapon7': '0.058', 'AMMO3': '0.079', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'weapon4': '0.406', 'weapon5': '0.418', 'WEAPON3': '0.550', 'weapon2': '0.922', 'HITCOUNT': '1.080', 'weapon3': '1.526', 'DAMAGECOUNT': '5.343', 'FRAGCOUNT': '16.000'} [2023-02-24 20:27:27,868][213365] Updated weights for policy 0, policy_version 24946 (0.0009) [2023-02-24 20:27:30,243][213332] Fps is (10 sec: 13926.0, 60 sec: 13994.6, 300 sec: 13772.8). Total num frames: 102211584. Throughput: 0: 3496.7. Samples: 548622. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:27:30,244][213332] Avg episode reward: [(0, '22.087')] [2023-02-24 20:27:30,244][213352] Saving new best policy, reward=22.087! [2023-02-24 20:27:30,766][213365] Updated weights for policy 0, policy_version 24956 (0.0008) [2023-02-24 20:27:33,653][213365] Updated weights for policy 0, policy_version 24966 (0.0009) [2023-02-24 20:27:35,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13777.5). Total num frames: 102281216. Throughput: 0: 3500.7. Samples: 559160. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:27:35,243][213332] Avg episode reward: [(0, '22.087')] [2023-02-24 20:27:36,596][213365] Updated weights for policy 0, policy_version 24976 (0.0009) [2023-02-24 20:27:36,729][213384] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 20:27:39,544][213365] Updated weights for policy 0, policy_version 24986 (0.0009) [2023-02-24 20:27:40,243][213332] Fps is (10 sec: 13926.9, 60 sec: 13994.7, 300 sec: 13781.8). Total num frames: 102350848. Throughput: 0: 3497.4. Samples: 580148. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:27:40,243][213332] Avg episode reward: [(0, '22.087')] [2023-02-24 20:27:42,452][213365] Updated weights for policy 0, policy_version 24996 (0.0009) [2023-02-24 20:27:44,353][213367] DAMAGECOUNT value on done: 16588.0 [2023-02-24 20:27:44,353][213367] Sum rewards: 21.427, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.922', 'AMMO2': '0.011', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.153', 'weapon4': '0.266', 'weapon5': '0.272', 'WEAPON5': '0.350', 'WEAPON3': '0.900', 'weapon2': '0.910', 'HITCOUNT': '1.780', 'weapon3': '2.098', 'DAMAGECOUNT': '6.738', 'FRAGCOUNT': '17.000'} [2023-02-24 20:27:44,367][213382] DAMAGECOUNT value on done: 18058.0 [2023-02-24 20:27:44,368][213382] Sum rewards: 19.993, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.962', 'ARMOR': '0.004', 'AMMO5': '0.027', 'AMMO2': '0.042', 'AMMO3': '0.088', 'AMMO4': '0.211', 'weapon4': '0.214', 'WEAPON4': '0.400', 'weapon5': '0.408', 'WEAPON3': '0.500', 'WEAPON5': '0.600', 'weapon2': '1.232', 'HITCOUNT': '1.380', 'weapon3': '1.494', 'DAMAGECOUNT': '5.604', 'FRAGCOUNT': '17.000'} [2023-02-24 20:27:44,390][213372] DAMAGECOUNT value on done: 18554.0 [2023-02-24 20:27:44,391][213372] Sum rewards: 17.192, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.580', 'AMMO5': '0.017', 'AMMO2': '0.030', 'AMMO3': '0.103', 'AMMO4': '0.151', 'weapon4': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.500', 'weapon5': '0.526', 'WEAPON3': '0.600', 'weapon2': '0.918', 'HITCOUNT': '1.270', 'weapon3': '1.866', 'DAMAGECOUNT': '4.857', 'FRAGCOUNT': '14.000'} [2023-02-24 20:27:44,418][213383] DAMAGECOUNT value on done: 17926.0 [2023-02-24 20:27:44,418][213383] Sum rewards: 32.706, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.114', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.162', 'WEAPON4': '0.250', 'weapon4': '0.346', 'weapon5': '0.392', 'WEAPON5': '0.450', 'weapon2': '0.508', 'WEAPON3': '1.000', 'HITCOUNT': '1.860', 'weapon3': '2.390', 'DAMAGECOUNT': '8.535', 'FRAGCOUNT': '29.000'} [2023-02-24 20:27:44,427][213366] DAMAGECOUNT value on done: 17283.0 [2023-02-24 20:27:44,427][213366] Sum rewards: 18.452, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.670', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.020', 'WEAPON4': '0.100', 'weapon4': '0.126', 'AMMO3': '0.163', 'WEAPON5': '0.500', 'weapon2': '0.610', 'weapon5': '0.664', 'WEAPON3': '0.950', 'HITCOUNT': '1.260', 'weapon3': '1.940', 'DAMAGECOUNT': '5.781', 'FRAGCOUNT': '17.000'} [2023-02-24 20:27:44,448][213384] DAMAGECOUNT value on done: 18360.0 [2023-02-24 20:27:44,449][213384] Sum rewards: 19.266, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.576', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.106', 'AMMO3': '0.139', 'WEAPON5': '0.150', 'AMMO4': '0.208', 'WEAPON4': '0.350', 'weapon4': '0.524', 'WEAPON3': '0.850', 'weapon2': '0.866', 'HITCOUNT': '1.830', 'weapon3': '2.128', 'DAMAGECOUNT': '6.390', 'FRAGCOUNT': '16.000'} [2023-02-24 20:27:44,630][213369] DAMAGECOUNT value on done: 18718.0 [2023-02-24 20:27:44,631][213369] Sum rewards: 18.659, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.180', 'AMMO2': '0.012', 'AMMO5': '0.021', 'AMMO4': '0.058', 'AMMO3': '0.139', 'weapon4': '0.154', 'WEAPON4': '0.200', 'weapon2': '0.546', 'WEAPON5': '0.550', 'weapon5': '0.646', 'WEAPON3': '1.000', 'HITCOUNT': '1.350', 'weapon3': '2.226', 'DAMAGECOUNT': '5.937', 'FRAGCOUNT': '17.000'} [2023-02-24 20:27:44,658][213367] DAMAGECOUNT value on done: 21200.0 [2023-02-24 20:27:44,658][213367] Sum rewards: 25.889, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.428', 'AMMO2': '0.029', 'AMMO5': '0.032', 'AMMO4': '0.146', 'AMMO3': '0.207', 'weapon4': '0.284', 'WEAPON4': '0.350', 'weapon5': '0.538', 'weapon2': '0.544', 'WEAPON5': '0.800', 'WEAPON3': '1.250', 'HITCOUNT': '1.860', 'weapon3': '2.178', 'DAMAGECOUNT': '8.598', 'FRAGCOUNT': '25.000'} [2023-02-24 20:27:44,673][213382] DAMAGECOUNT value on done: 19601.0 [2023-02-24 20:27:44,673][213382] Sum rewards: 35.374, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.322', 'ARMOR': '0.004', 'AMMO2': '0.015', 'AMMO5': '0.015', 'AMMO4': '0.072', 'WEAPON4': '0.150', 'weapon4': '0.162', 'AMMO3': '0.172', 'weapon5': '0.314', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON3': '1.050', 'HITCOUNT': '2.340', 'weapon3': '2.764', 'DAMAGECOUNT': '10.392', 'FRAGCOUNT': '29.000'} [2023-02-24 20:27:44,680][213368] DAMAGECOUNT value on done: 19700.0 [2023-02-24 20:27:44,681][213368] Sum rewards: 17.845, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.482', 'AMMO5': '0.019', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.190', 'WEAPON4': '0.300', 'weapon4': '0.304', 'weapon5': '0.392', 'WEAPON5': '0.450', 'weapon2': '0.642', 'WEAPON3': '1.150', 'HITCOUNT': '1.690', 'weapon3': '2.260', 'DAMAGECOUNT': '7.263', 'FRAGCOUNT': '18.000'} [2023-02-24 20:27:44,695][213372] DAMAGECOUNT value on done: 19889.0 [2023-02-24 20:27:44,695][213372] Sum rewards: 19.478, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.816', 'AMMO2': '0.021', 'AMMO5': '0.035', 'AMMO4': '0.103', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'weapon4': '0.240', 'weapon5': '0.590', 'weapon2': '0.706', 'WEAPON5': '0.750', 'WEAPON3': '0.900', 'HITCOUNT': '1.320', 'weapon3': '1.964', 'DAMAGECOUNT': '5.808', 'FRAGCOUNT': '18.000'} [2023-02-24 20:27:44,720][213383] DAMAGECOUNT value on done: 18761.0 [2023-02-24 20:27:44,721][213383] Sum rewards: 23.761, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.667', 'ARMOR': '0.004', 'AMMO2': '0.011', 'AMMO5': '0.016', 'AMMO4': '0.054', 'AMMO3': '0.190', 'weapon5': '0.264', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.528', 'weapon2': '0.878', 'WEAPON3': '1.250', 'HITCOUNT': '1.670', 'weapon3': '1.952', 'DAMAGECOUNT': '7.011', 'FRAGCOUNT': '23.000'} [2023-02-24 20:27:44,730][213366] DAMAGECOUNT value on done: 20678.0 [2023-02-24 20:27:44,730][213366] Sum rewards: 40.800, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.437', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.125', 'AMMO4': '0.143', 'weapon5': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.374', 'WEAPON3': '0.750', 'weapon4': '1.172', 'weapon3': '1.826', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '8.955', 'FRAGCOUNT': '32.000'} [2023-02-24 20:27:44,747][213384] DAMAGECOUNT value on done: 17072.0 [2023-02-24 20:27:44,748][213384] Sum rewards: 13.138, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.920', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.023', 'AMMO4': '0.112', 'AMMO3': '0.169', 'weapon4': '0.176', 'WEAPON4': '0.300', 'weapon2': '0.518', 'weapon5': '0.524', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'HITCOUNT': '1.360', 'weapon3': '2.282', 'DAMAGECOUNT': '6.102', 'FRAGCOUNT': '12.500'} [2023-02-24 20:27:44,829][213367] DAMAGECOUNT value on done: 16583.0 [2023-02-24 20:27:44,830][213367] Sum rewards: 15.815, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.253', 'AMMO2': '0.011', 'AMMO5': '0.012', 'weapon7': '0.048', 'AMMO4': '0.055', 'AMMO3': '0.063', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.232', 'WEAPON5': '0.300', 'weapon4': '0.318', 'WEAPON3': '0.400', 'weapon2': '0.706', 'HITCOUNT': '0.860', 'weapon3': '1.598', 'DAMAGECOUNT': '4.074', 'FRAGCOUNT': '12.000'} [2023-02-24 20:27:44,929][213369] DAMAGECOUNT value on done: 19278.0 [2023-02-24 20:27:44,930][213369] Sum rewards: 24.063, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.702', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.016', 'AMMO3': '0.130', 'WEAPON5': '0.400', 'weapon5': '0.448', 'weapon2': '0.632', 'WEAPON3': '0.750', 'HITCOUNT': '1.450', 'weapon3': '2.458', 'DAMAGECOUNT': '6.231', 'FRAGCOUNT': '19.000'} [2023-02-24 20:27:44,976][213382] DAMAGECOUNT value on done: 17148.0 [2023-02-24 20:27:44,977][213382] Sum rewards: 36.284, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.138', 'AMMO2': '0.008', 'weapon4': '0.012', 'AMMO5': '0.028', 'WEAPON1': '0.040', 'AMMO4': '0.041', 'WEAPON4': '0.100', 'AMMO3': '0.170', 'weapon2': '0.358', 'weapon5': '0.582', 'WEAPON5': '0.700', 'WEAPON3': '1.000', 'HITCOUNT': '1.890', 'weapon3': '2.478', 'DAMAGECOUNT': '8.514', 'FRAGCOUNT': '32.000'} [2023-02-24 20:27:44,980][213368] DAMAGECOUNT value on done: 19511.0 [2023-02-24 20:27:44,980][213368] Sum rewards: 9.984, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.580', 'AMMO2': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.038', 'AMMO3': '0.125', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.256', 'WEAPON5': '0.300', 'weapon5': '0.526', 'WEAPON3': '0.900', 'weapon2': '0.946', 'HITCOUNT': '1.060', 'weapon3': '1.706', 'DAMAGECOUNT': '4.119', 'FRAGCOUNT': '10.000'} [2023-02-24 20:27:44,999][213372] DAMAGECOUNT value on done: 16828.0 [2023-02-24 20:27:44,999][213372] Sum rewards: 20.341, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.190', 'AMMO2': '0.018', 'AMMO5': '0.019', 'AMMO4': '0.090', 'AMMO3': '0.128', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon5': '0.402', 'weapon4': '0.430', 'weapon2': '0.694', 'WEAPON3': '0.750', 'HITCOUNT': '1.410', 'weapon3': '1.714', 'DAMAGECOUNT': '5.475', 'FRAGCOUNT': '17.000'} [2023-02-24 20:27:45,020][213366] DAMAGECOUNT value on done: 19459.0 [2023-02-24 20:27:45,020][213366] Sum rewards: 20.470, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.082', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.054', 'AMMO3': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.348', 'weapon5': '0.376', 'weapon2': '0.636', 'WEAPON3': '0.800', 'HITCOUNT': '1.630', 'weapon3': '2.206', 'DAMAGECOUNT': '5.595', 'FRAGCOUNT': '16.000'} [2023-02-24 20:27:45,027][213383] DAMAGECOUNT value on done: 17741.0 [2023-02-24 20:27:45,028][213383] Sum rewards: 16.287, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.480', 'AMMO2': '0.006', 'AMMO5': '0.014', 'AMMO4': '0.030', 'weapon4': '0.142', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'weapon5': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.990', 'WEAPON3': '1.000', 'HITCOUNT': '1.230', 'weapon3': '2.124', 'DAMAGECOUNT': '4.923', 'FRAGCOUNT': '17.000'} [2023-02-24 20:27:45,045][213384] DAMAGECOUNT value on done: 21574.0 [2023-02-24 20:27:45,045][213384] Sum rewards: 22.948, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.548', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO3': '0.138', 'AMMO4': '0.182', 'weapon4': '0.230', 'WEAPON4': '0.350', 'weapon5': '0.404', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'weapon2': '1.000', 'HITCOUNT': '1.590', 'weapon3': '1.936', 'DAMAGECOUNT': '7.011', 'FRAGCOUNT': '20.000'} [2023-02-24 20:27:45,122][213367] DAMAGECOUNT value on done: 16770.0 [2023-02-24 20:27:45,122][213367] Sum rewards: 11.869, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.556', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.098', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'weapon2': '0.552', 'HITCOUNT': '0.570', 'weapon5': '0.824', 'weapon3': '1.906', 'DAMAGECOUNT': '2.394', 'FRAGCOUNT': '9.000'} [2023-02-24 20:27:45,204][213368] DAMAGECOUNT value on done: 20102.0 [2023-02-24 20:27:45,205][213368] Sum rewards: 24.896, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.565', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.150', 'weapon2': '0.248', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon5': '0.488', 'weapon4': '0.504', 'WEAPON3': '0.950', 'HITCOUNT': '1.570', 'weapon3': '2.116', 'DAMAGECOUNT': '6.507', 'FRAGCOUNT': '22.000'} [2023-02-24 20:27:45,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13786.0). Total num frames: 102420480. Throughput: 0: 3496.4. Samples: 601112. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:27:45,243][213332] Avg episode reward: [(0, '22.224')] [2023-02-24 20:27:45,246][213352] Saving new best policy, reward=22.224! [2023-02-24 20:27:45,291][213382] DAMAGECOUNT value on done: 20281.0 [2023-02-24 20:27:45,292][213382] Sum rewards: 29.296, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.458', 'AMMO5': '0.022', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.220', 'weapon4': '0.236', 'WEAPON4': '0.350', 'weapon5': '0.382', 'weapon2': '0.402', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '2.090', 'weapon3': '2.486', 'DAMAGECOUNT': '8.412', 'FRAGCOUNT': '28.000'} [2023-02-24 20:27:45,315][213372] DAMAGECOUNT value on done: 18151.0 [2023-02-24 20:27:45,316][213372] Sum rewards: 25.524, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.095', 'AMMO5': '0.019', 'AMMO2': '0.035', 'AMMO3': '0.062', 'weapon4': '0.158', 'AMMO4': '0.177', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'WEAPON5': '0.500', 'weapon5': '0.642', 'weapon2': '1.024', 'HITCOUNT': '1.260', 'weapon3': '1.780', 'DAMAGECOUNT': '5.262', 'FRAGCOUNT': '21.000'} [2023-02-24 20:27:45,332][213369] DAMAGECOUNT value on done: 20264.0 [2023-02-24 20:27:45,332][213369] Sum rewards: 22.593, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.455', 'AMMO5': '0.024', 'AMMO2': '0.044', 'AMMO3': '0.195', 'AMMO4': '0.221', 'weapon5': '0.316', 'weapon4': '0.394', 'weapon2': '0.428', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'HITCOUNT': '2.210', 'weapon3': '2.434', 'DAMAGECOUNT': '8.331', 'FRAGCOUNT': '20.000'} [2023-02-24 20:27:45,336][213366] DAMAGECOUNT value on done: 16077.0 [2023-02-24 20:27:45,337][213366] Sum rewards: 13.884, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.470', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO3': '0.108', 'AMMO4': '0.158', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon5': '0.336', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'weapon4': '0.798', 'weapon2': '0.812', 'HITCOUNT': '0.920', 'weapon3': '1.308', 'DAMAGECOUNT': '4.122', 'FRAGCOUNT': '11.000'} [2023-02-24 20:27:45,343][213383] DAMAGECOUNT value on done: 17867.0 [2023-02-24 20:27:45,343][213383] Sum rewards: 16.627, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.218', 'weapon4': '0.002', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.027', 'WEAPON4': '0.050', 'AMMO3': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'weapon5': '0.222', 'WEAPON3': '0.450', 'HITCOUNT': '0.870', 'weapon2': '1.308', 'weapon3': '1.958', 'DAMAGECOUNT': '3.879', 'FRAGCOUNT': '13.000'} [2023-02-24 20:27:45,362][213384] DAMAGECOUNT value on done: 19196.0 [2023-02-24 20:27:45,363][213384] Sum rewards: 17.387, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.658', 'AMMO5': '0.020', 'AMMO2': '0.027', 'AMMO3': '0.113', 'AMMO4': '0.135', 'weapon2': '0.280', 'weapon4': '0.396', 'WEAPON4': '0.400', 'weapon5': '0.436', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '1.390', 'weapon3': '1.934', 'DAMAGECOUNT': '6.264', 'FRAGCOUNT': '14.000'} [2023-02-24 20:27:45,424][213365] Updated weights for policy 0, policy_version 25006 (0.0009) [2023-02-24 20:27:45,544][213368] DAMAGECOUNT value on done: 21191.0 [2023-02-24 20:27:45,545][213368] Sum rewards: 29.893, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.575', 'AMMO2': '0.022', 'AMMO5': '0.026', 'WEAPON1': '0.030', 'AMMO4': '0.108', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'weapon2': '0.286', 'weapon4': '0.296', 'weapon5': '0.500', 'WEAPON5': '0.650', 'WEAPON3': '1.050', 'HITCOUNT': '1.960', 'weapon3': '2.530', 'DAMAGECOUNT': '9.093', 'FRAGCOUNT': '25.000'} [2023-02-24 20:27:45,627][213369] DAMAGECOUNT value on done: 16984.0 [2023-02-24 20:27:45,628][213369] Sum rewards: 25.426, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.366', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.171', 'weapon4': '0.216', 'WEAPON5': '0.350', 'weapon5': '0.426', 'weapon2': '0.520', 'WEAPON3': '1.050', 'HITCOUNT': '1.820', 'weapon3': '2.482', 'DAMAGECOUNT': '7.548', 'FRAGCOUNT': '23.000'} [2023-02-24 20:27:48,308][213365] Updated weights for policy 0, policy_version 25016 (0.0009) [2023-02-24 20:27:50,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13789.9). Total num frames: 102490112. Throughput: 0: 3493.8. Samples: 611542. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:27:50,243][213332] Avg episode reward: [(0, '21.987')] [2023-02-24 20:27:51,230][213365] Updated weights for policy 0, policy_version 25026 (0.0009) [2023-02-24 20:27:52,274][213382] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 20:27:52,893][213384] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 20:27:54,191][213365] Updated weights for policy 0, policy_version 25036 (0.0009) [2023-02-24 20:27:55,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13793.6). Total num frames: 102559744. Throughput: 0: 3496.2. Samples: 632568. Policy #0 lag: (min: 0.0, avg: 0.8, max: 1.0) [2023-02-24 20:27:55,243][213332] Avg episode reward: [(0, '21.987')] [2023-02-24 20:27:57,088][213365] Updated weights for policy 0, policy_version 25046 (0.0009) [2023-02-24 20:28:00,041][213365] Updated weights for policy 0, policy_version 25056 (0.0009) [2023-02-24 20:28:00,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 13797.1). Total num frames: 102629376. Throughput: 0: 3493.2. Samples: 653530. Policy #0 lag: (min: 0.0, avg: 0.8, max: 1.0) [2023-02-24 20:28:00,243][213332] Avg episode reward: [(0, '21.987')] [2023-02-24 20:28:02,976][213365] Updated weights for policy 0, policy_version 25066 (0.0009) [2023-02-24 20:28:03,468][213367] DAMAGECOUNT value on done: 18064.0 [2023-02-24 20:28:03,469][213367] Sum rewards: 16.787, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.242', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.019', 'weapon7': '0.050', 'weapon2': '0.076', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.280', 'WEAPON5': '0.500', 'weapon4': '0.538', 'WEAPON3': '0.600', 'HITCOUNT': '0.970', 'weapon3': '1.190', 'DAMAGECOUNT': '4.428', 'FRAGCOUNT': '14.000'} [2023-02-24 20:28:03,612][213382] DAMAGECOUNT value on done: 19864.0 [2023-02-24 20:28:03,612][213382] Sum rewards: 15.519, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.120', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO5': '0.019', 'weapon4': '0.078', 'AMMO4': '0.079', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.500', 'weapon2': '0.632', 'weapon5': '0.724', 'WEAPON3': '0.900', 'HITCOUNT': '1.250', 'weapon3': '2.152', 'DAMAGECOUNT': '5.418', 'FRAGCOUNT': '15.000'} [2023-02-24 20:28:03,617][213366] DAMAGECOUNT value on done: 19136.0 [2023-02-24 20:28:03,618][213366] Sum rewards: 20.879, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.454', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'WEAPON4': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.174', 'weapon4': '0.216', 'WEAPON5': '0.350', 'weapon5': '0.362', 'weapon2': '0.486', 'WEAPON3': '1.050', 'HITCOUNT': '1.520', 'weapon3': '2.496', 'DAMAGECOUNT': '5.559', 'FRAGCOUNT': '20.000'} [2023-02-24 20:28:03,661][213383] DAMAGECOUNT value on done: 20775.0 [2023-02-24 20:28:03,662][213383] Sum rewards: 26.850, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.452', 'ARMOR': '0.004', 'weapon7': '0.016', 'AMMO5': '0.030', 'AMMO2': '0.058', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.108', 'AMMO4': '0.292', 'weapon2': '0.334', 'WEAPON3': '0.650', 'WEAPON5': '0.700', 'WEAPON4': '0.800', 'weapon5': '0.874', 'weapon4': '1.018', 'weapon3': '1.220', 'HITCOUNT': '1.600', 'DAMAGECOUNT': '8.547', 'FRAGCOUNT': '23.000'} [2023-02-24 20:28:03,669][213372] DAMAGECOUNT value on done: 20039.0 [2023-02-24 20:28:03,669][213372] Sum rewards: 19.384, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.458', 'ARMOR': '0.004', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.044', 'AMMO3': '0.090', 'AMMO4': '0.222', 'weapon4': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'weapon5': '0.616', 'weapon2': '0.900', 'HITCOUNT': '1.130', 'weapon3': '1.720', 'DAMAGECOUNT': '4.455', 'FRAGCOUNT': '16.000'} [2023-02-24 20:28:03,722][213384] DAMAGECOUNT value on done: 20862.0 [2023-02-24 20:28:03,723][213384] Sum rewards: 29.087, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.100', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.118', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon5': '0.312', 'weapon4': '0.362', 'weapon2': '0.628', 'WEAPON3': '0.800', 'HITCOUNT': '1.770', 'weapon3': '2.312', 'DAMAGECOUNT': '7.506', 'FRAGCOUNT': '24.000'} [2023-02-24 20:28:03,775][213367] DAMAGECOUNT value on done: 22999.0 [2023-02-24 20:28:03,775][213367] Sum rewards: 16.880, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.058', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.134', 'weapon4': '0.138', 'WEAPON5': '0.350', 'weapon5': '0.546', 'WEAPON3': '0.800', 'weapon2': '1.024', 'HITCOUNT': '1.050', 'weapon3': '1.580', 'DAMAGECOUNT': '5.397', 'FRAGCOUNT': '15.000'} [2023-02-24 20:28:03,916][213369] DAMAGECOUNT value on done: 20857.0 [2023-02-24 20:28:03,916][213369] Sum rewards: 22.388, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.524', 'AMMO5': '0.032', 'AMMO2': '0.040', 'AMMO3': '0.133', 'AMMO4': '0.201', 'weapon4': '0.214', 'weapon2': '0.458', 'weapon5': '0.466', 'WEAPON4': '0.500', 'WEAPON5': '0.800', 'WEAPON3': '0.800', 'HITCOUNT': '1.650', 'weapon3': '2.450', 'DAMAGECOUNT': '6.417', 'FRAGCOUNT': '21.000'} [2023-02-24 20:28:03,919][213382] DAMAGECOUNT value on done: 20835.0 [2023-02-24 20:28:03,920][213382] Sum rewards: 14.115, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.540', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO3': '0.072', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'weapon5': '0.818', 'weapon2': '0.862', 'HITCOUNT': '1.070', 'weapon3': '1.814', 'DAMAGECOUNT': '3.702', 'FRAGCOUNT': '10.000'} [2023-02-24 20:28:03,923][213366] DAMAGECOUNT value on done: 23003.0 [2023-02-24 20:28:03,924][213366] Sum rewards: 26.270, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.442', 'ARMOR': '0.004', 'AMMO2': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.023', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'weapon4': '0.248', 'weapon2': '0.424', 'weapon5': '0.506', 'WEAPON3': '1.100', 'HITCOUNT': '1.770', 'weapon3': '2.370', 'DAMAGECOUNT': '6.975', 'FRAGCOUNT': '23.000'} [2023-02-24 20:28:03,938][213368] DAMAGECOUNT value on done: 21602.0 [2023-02-24 20:28:03,939][213368] Sum rewards: 16.064, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.424', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'AMMO5': '0.035', 'AMMO4': '0.129', 'AMMO3': '0.146', 'WEAPON4': '0.250', 'weapon2': '0.350', 'weapon4': '0.350', 'ARMOR': '0.404', 'weapon5': '0.512', 'WEAPON5': '0.750', 'WEAPON3': '0.950', 'HITCOUNT': '1.280', 'weapon3': '2.090', 'DAMAGECOUNT': '5.706', 'FRAGCOUNT': '15.000'} [2023-02-24 20:28:03,961][213367] DAMAGECOUNT value on done: 18915.0 [2023-02-24 20:28:03,962][213367] Sum rewards: 24.926, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.259', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO3': '0.074', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'weapon4': '0.304', 'weapon5': '0.406', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'weapon2': '0.844', 'HITCOUNT': '1.770', 'weapon3': '1.938', 'DAMAGECOUNT': '6.996', 'FRAGCOUNT': '18.500'} [2023-02-24 20:28:03,978][213383] DAMAGECOUNT value on done: 21927.0 [2023-02-24 20:28:03,979][213383] Sum rewards: 35.661, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.234', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.041', 'AMMO3': '0.182', 'AMMO4': '0.207', 'weapon5': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.424', 'weapon2': '0.668', 'WEAPON3': '1.100', 'HITCOUNT': '2.180', 'weapon3': '2.392', 'DAMAGECOUNT': '9.498', 'FRAGCOUNT': '33.000'} [2023-02-24 20:28:03,984][213372] DAMAGECOUNT value on done: 23102.0 [2023-02-24 20:28:03,985][213372] Sum rewards: 30.201, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.055', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.042', 'AMMO3': '0.172', 'AMMO4': '0.211', 'weapon5': '0.250', 'weapon2': '0.314', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.772', 'WEAPON3': '1.050', 'HITCOUNT': '2.060', 'weapon3': '2.310', 'DAMAGECOUNT': '9.639', 'FRAGCOUNT': '28.000'} [2023-02-24 20:28:04,050][213384] DAMAGECOUNT value on done: 18715.0 [2023-02-24 20:28:04,050][213384] Sum rewards: 17.352, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.488', 'AMMO2': '0.003', 'AMMO5': '0.013', 'AMMO4': '0.016', 'WEAPON1': '0.030', 'AMMO3': '0.111', 'weapon5': '0.226', 'WEAPON5': '0.250', 'WEAPON3': '0.700', 'weapon2': '1.036', 'HITCOUNT': '1.220', 'weapon3': '2.306', 'DAMAGECOUNT': '4.929', 'FRAGCOUNT': '13.000'} [2023-02-24 20:28:04,222][213369] DAMAGECOUNT value on done: 21866.0 [2023-02-24 20:28:04,222][213369] Sum rewards: 27.284, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.210', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'AMMO3': '0.117', 'AMMO4': '0.135', 'WEAPON4': '0.250', 'weapon4': '0.250', 'WEAPON5': '0.400', 'weapon5': '0.490', 'weapon2': '0.622', 'WEAPON3': '0.800', 'HITCOUNT': '1.300', 'weapon3': '2.304', 'DAMAGECOUNT': '7.764', 'FRAGCOUNT': '23.000'} [2023-02-24 20:28:04,236][213366] DAMAGECOUNT value on done: 21540.0 [2023-02-24 20:28:04,236][213366] Sum rewards: 23.057, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.104', 'AMMO5': '0.018', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.100', 'weapon4': '0.172', 'AMMO3': '0.178', 'weapon2': '0.332', 'WEAPON5': '0.400', 'weapon5': '0.632', 'WEAPON3': '1.100', 'HITCOUNT': '1.550', 'weapon3': '2.366', 'DAMAGECOUNT': '6.243', 'FRAGCOUNT': '21.000'} [2023-02-24 20:28:04,241][213382] DAMAGECOUNT value on done: 19517.0 [2023-02-24 20:28:04,242][213382] Sum rewards: 20.270, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.835', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.023', 'weapon4': '0.028', 'AMMO4': '0.113', 'AMMO3': '0.144', 'WEAPON4': '0.200', 'weapon5': '0.308', 'WEAPON5': '0.450', 'WEAPON3': '0.900', 'weapon2': '1.104', 'HITCOUNT': '1.350', 'weapon3': '2.098', 'DAMAGECOUNT': '7.107', 'FRAGCOUNT': '18.000'} [2023-02-24 20:28:04,243][213368] DAMAGECOUNT value on done: 22272.0 [2023-02-24 20:28:04,244][213368] Sum rewards: 30.736, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.464', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.015', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'weapon4': '0.068', 'AMMO3': '0.152', 'WEAPON5': '0.300', 'weapon5': '0.376', 'weapon2': '0.788', 'WEAPON3': '0.950', 'HITCOUNT': '1.740', 'weapon3': '2.402', 'DAMAGECOUNT': '8.283', 'FRAGCOUNT': '25.000'} [2023-02-24 20:28:04,270][213367] DAMAGECOUNT value on done: 18315.0 [2023-02-24 20:28:04,271][213367] Sum rewards: 17.908, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.779', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.084', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'weapon2': '0.880', 'weapon5': '0.884', 'HITCOUNT': '0.970', 'weapon3': '1.564', 'DAMAGECOUNT': '4.635', 'FRAGCOUNT': '14.000'} [2023-02-24 20:28:04,274][213383] DAMAGECOUNT value on done: 19659.0 [2023-02-24 20:28:04,275][213383] Sum rewards: 20.633, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.044', 'AMMO5': '0.019', 'AMMO2': '0.031', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'weapon4': '0.128', 'AMMO4': '0.154', 'weapon2': '0.420', 'WEAPON5': '0.550', 'weapon5': '0.576', 'WEAPON3': '0.800', 'HITCOUNT': '1.220', 'weapon3': '2.264', 'DAMAGECOUNT': '5.754', 'FRAGCOUNT': '17.000'} [2023-02-24 20:28:04,287][213372] DAMAGECOUNT value on done: 19256.0 [2023-02-24 20:28:04,288][213372] Sum rewards: 30.352, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.355', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO5': '0.019', 'AMMO3': '0.079', 'AMMO4': '0.090', 'weapon4': '0.174', 'WEAPON4': '0.200', 'weapon5': '0.254', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon2': '1.240', 'HITCOUNT': '1.450', 'weapon3': '1.638', 'DAMAGECOUNT': '7.284', 'FRAGCOUNT': '24.000'} [2023-02-24 20:28:04,349][213384] DAMAGECOUNT value on done: 24776.0 [2023-02-24 20:28:04,349][213384] Sum rewards: 26.932, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.660', 'AMMO5': '0.016', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon2': '0.232', 'AMMO3': '0.296', 'weapon5': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.590', 'WEAPON3': '1.750', 'HITCOUNT': '2.260', 'weapon3': '2.448', 'DAMAGECOUNT': '9.525', 'FRAGCOUNT': '28.000'} [2023-02-24 20:28:04,459][213368] DAMAGECOUNT value on done: 22008.0 [2023-02-24 20:28:04,460][213368] Sum rewards: 15.895, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.475', 'AMMO5': '0.021', 'AMMO2': '0.041', 'weapon4': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'AMMO4': '0.203', 'weapon5': '0.346', 'WEAPON5': '0.450', 'weapon2': '0.648', 'WEAPON3': '1.150', 'HITCOUNT': '1.330', 'weapon3': '2.514', 'DAMAGECOUNT': '5.718', 'FRAGCOUNT': '16.000'} [2023-02-24 20:28:04,536][213366] DAMAGECOUNT value on done: 17168.0 [2023-02-24 20:28:04,537][213366] Sum rewards: 13.535, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.118', 'AMMO5': '0.006', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'weapon4': '0.026', 'AMMO4': '0.048', 'weapon7': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.476', 'WEAPON3': '0.550', 'HITCOUNT': '0.840', 'weapon2': '0.878', 'weapon3': '1.880', 'DAMAGECOUNT': '3.273', 'FRAGCOUNT': '10.000'} [2023-02-24 20:28:04,545][213382] DAMAGECOUNT value on done: 22770.0 [2023-02-24 20:28:04,545][213382] Sum rewards: 28.520, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.530', 'AMMO2': '0.007', 'AMMO5': '0.028', 'AMMO4': '0.034', 'WEAPON4': '0.100', 'weapon4': '0.108', 'AMMO3': '0.155', 'weapon5': '0.304', 'WEAPON5': '0.550', 'WEAPON3': '0.950', 'weapon2': '0.972', 'HITCOUNT': '1.740', 'weapon3': '2.328', 'DAMAGECOUNT': '7.275', 'FRAGCOUNT': '26.000'} [2023-02-24 20:28:04,572][213383] DAMAGECOUNT value on done: 19482.0 [2023-02-24 20:28:04,573][213383] Sum rewards: 20.566, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '0.004', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'AMMO3': '0.104', 'AMMO4': '0.180', 'weapon5': '0.188', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.374', 'WEAPON3': '0.600', 'HITCOUNT': '1.170', 'weapon2': '1.184', 'weapon3': '1.648', 'DAMAGECOUNT': '4.845', 'FRAGCOUNT': '17.000'} [2023-02-24 20:28:04,579][213369] DAMAGECOUNT value on done: 21199.0 [2023-02-24 20:28:04,580][213369] Sum rewards: 10.096, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.054', 'AMMO2': '0.010', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.050', 'AMMO3': '0.113', 'WEAPON5': '0.350', 'weapon2': '0.448', 'ARMOR': '0.500', 'weapon5': '0.596', 'HITCOUNT': '0.690', 'WEAPON3': '0.750', 'weapon3': '1.802', 'DAMAGECOUNT': '2.805', 'FRAGCOUNT': '9.000'} [2023-02-24 20:28:04,587][213372] DAMAGECOUNT value on done: 20826.0 [2023-02-24 20:28:04,588][213372] Sum rewards: 28.596, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.758', 'AMMO2': '0.017', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.084', 'AMMO3': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.402', 'WEAPON5': '0.450', 'weapon5': '0.452', 'weapon2': '0.532', 'WEAPON3': '0.850', 'HITCOUNT': '1.590', 'weapon3': '2.124', 'DAMAGECOUNT': '8.025', 'FRAGCOUNT': '22.000'} [2023-02-24 20:28:04,652][213384] DAMAGECOUNT value on done: 21236.0 [2023-02-24 20:28:04,652][213384] Sum rewards: 22.707, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'weapon7': '0.050', 'HEALTH': '0.094', 'AMMO3': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.208', 'weapon4': '0.392', 'WEAPON3': '0.550', 'weapon2': '0.676', 'weapon3': '1.324', 'HITCOUNT': '1.380', 'DAMAGECOUNT': '6.120', 'FRAGCOUNT': '17.000'} [2023-02-24 20:28:04,752][213368] DAMAGECOUNT value on done: 23470.0 [2023-02-24 20:28:04,753][213368] Sum rewards: 24.626, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.462', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.021', 'weapon5': '0.094', 'AMMO4': '0.106', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.350', 'weapon2': '0.830', 'WEAPON3': '1.250', 'HITCOUNT': '1.830', 'weapon3': '2.470', 'DAMAGECOUNT': '6.837', 'FRAGCOUNT': '23.000'} [2023-02-24 20:28:04,878][213369] DAMAGECOUNT value on done: 17876.0 [2023-02-24 20:28:04,878][213369] Sum rewards: 9.729, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.837', 'AMMO5': '0.014', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon4': '0.028', 'AMMO4': '0.076', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.450', 'weapon5': '0.504', 'WEAPON3': '0.550', 'HITCOUNT': '0.590', 'weapon2': '1.208', 'weapon3': '1.506', 'DAMAGECOUNT': '2.676', 'FRAGCOUNT': '8.000'} [2023-02-24 20:28:05,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13926.5, 300 sec: 13800.4). Total num frames: 102699008. Throughput: 0: 3493.0. Samples: 664032. Policy #0 lag: (min: 0.0, avg: 0.8, max: 1.0) [2023-02-24 20:28:05,243][213332] Avg episode reward: [(0, '21.838')] [2023-02-24 20:28:05,946][213365] Updated weights for policy 0, policy_version 25076 (0.0009) [2023-02-24 20:28:08,874][213365] Updated weights for policy 0, policy_version 25086 (0.0009) [2023-02-24 20:28:10,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13803.5). Total num frames: 102768640. Throughput: 0: 3491.6. Samples: 684906. Policy #0 lag: (min: 0.0, avg: 0.8, max: 1.0) [2023-02-24 20:28:10,243][213332] Avg episode reward: [(0, '21.838')] [2023-02-24 20:28:11,806][213365] Updated weights for policy 0, policy_version 25096 (0.0009) [2023-02-24 20:28:14,733][213365] Updated weights for policy 0, policy_version 25106 (0.0009) [2023-02-24 20:28:15,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13806.5). Total num frames: 102838272. Throughput: 0: 3494.7. Samples: 705882. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:28:15,244][213332] Avg episode reward: [(0, '21.838')] [2023-02-24 20:28:17,683][213365] Updated weights for policy 0, policy_version 25116 (0.0009) [2023-02-24 20:28:19,845][213372] Large shaping reward 2.584 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0)] [2023-02-24 20:28:20,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13809.4). Total num frames: 102907904. Throughput: 0: 3493.2. Samples: 716356. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:28:20,243][213332] Avg episode reward: [(0, '21.838')] [2023-02-24 20:28:20,624][213365] Updated weights for policy 0, policy_version 25126 (0.0009) [2023-02-24 20:28:22,710][213367] DAMAGECOUNT value on done: 19844.0 [2023-02-24 20:28:22,710][213367] Sum rewards: 20.142, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.330', 'AMMO2': '0.011', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.053', 'AMMO3': '0.120', 'WEAPON4': '0.250', 'weapon4': '0.350', 'weapon2': '0.406', 'WEAPON5': '0.500', 'weapon5': '0.506', 'WEAPON3': '0.800', 'HITCOUNT': '0.940', 'weapon3': '1.908', 'DAMAGECOUNT': '5.340', 'FRAGCOUNT': '17.000'} [2023-02-24 20:28:22,898][213383] DAMAGECOUNT value on done: 22674.0 [2023-02-24 20:28:22,899][213383] Sum rewards: 18.711, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.392', 'AMMO2': '0.008', 'AMMO5': '0.017', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'AMMO3': '0.181', 'weapon4': '0.202', 'weapon5': '0.310', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon2': '1.128', 'HITCOUNT': '1.450', 'weapon3': '2.020', 'DAMAGECOUNT': '5.697', 'FRAGCOUNT': '18.000'} [2023-02-24 20:28:22,931][213366] DAMAGECOUNT value on done: 21153.0 [2023-02-24 20:28:22,932][213366] Sum rewards: 16.862, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.140', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.028', 'AMMO3': '0.127', 'AMMO4': '0.139', 'WEAPON4': '0.250', 'weapon5': '0.302', 'weapon4': '0.414', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'weapon2': '1.144', 'HITCOUNT': '1.320', 'weapon3': '1.736', 'DAMAGECOUNT': '6.012', 'FRAGCOUNT': '15.000'} [2023-02-24 20:28:22,932][213382] DAMAGECOUNT value on done: 21524.0 [2023-02-24 20:28:22,932][213382] Sum rewards: 16.312, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.246', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'weapon4': '0.108', 'AMMO3': '0.154', 'WEAPON5': '0.200', 'weapon5': '0.302', 'ARMOR': '0.500', 'weapon2': '0.652', 'WEAPON3': '0.850', 'HITCOUNT': '1.260', 'weapon3': '2.452', 'DAMAGECOUNT': '4.980', 'FRAGCOUNT': '14.000'} [2023-02-24 20:28:22,938][213372] DAMAGECOUNT value on done: 21824.0 [2023-02-24 20:28:22,939][213372] Sum rewards: 19.016, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.310', 'AMMO2': '0.003', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.015', 'WEAPON4': '0.100', 'AMMO3': '0.144', 'weapon4': '0.150', 'weapon5': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.794', 'WEAPON3': '0.950', 'HITCOUNT': '1.210', 'weapon3': '2.368', 'DAMAGECOUNT': '5.355', 'FRAGCOUNT': '17.000'} [2023-02-24 20:28:23,013][213367] DAMAGECOUNT value on done: 25346.0 [2023-02-24 20:28:23,013][213367] Sum rewards: 19.153, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.540', 'AMMO2': '0.018', 'AMMO5': '0.019', 'weapon4': '0.034', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'weapon5': '0.304', 'WEAPON5': '0.400', 'weapon2': '0.468', 'WEAPON3': '1.200', 'HITCOUNT': '1.750', 'weapon3': '2.786', 'DAMAGECOUNT': '7.041', 'FRAGCOUNT': '19.000'} [2023-02-24 20:28:23,047][213384] DAMAGECOUNT value on done: 23377.0 [2023-02-24 20:28:23,047][213384] Sum rewards: 21.809, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.828', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'AMMO5': '0.041', 'AMMO4': '0.168', 'weapon4': '0.204', 'AMMO3': '0.223', 'weapon5': '0.428', 'WEAPON4': '0.450', 'weapon2': '0.470', 'WEAPON5': '1.050', 'WEAPON3': '1.400', 'HITCOUNT': '1.480', 'weapon3': '2.374', 'DAMAGECOUNT': '7.545', 'FRAGCOUNT': '24.000'} [2023-02-24 20:28:23,196][213383] DAMAGECOUNT value on done: 23980.0 [2023-02-24 20:28:23,196][213383] Sum rewards: 15.402, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.192', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.035', 'AMMO3': '0.149', 'AMMO4': '0.174', 'WEAPON4': '0.400', 'weapon2': '0.472', 'weapon5': '0.486', 'weapon4': '0.568', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'HITCOUNT': '1.300', 'weapon3': '2.024', 'DAMAGECOUNT': '6.159', 'FRAGCOUNT': '14.000'} [2023-02-24 20:28:23,215][213369] DAMAGECOUNT value on done: 22673.0 [2023-02-24 20:28:23,215][213369] Sum rewards: 16.558, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.840', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.008', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.120', 'AMMO3': '0.169', 'WEAPON5': '0.250', 'weapon5': '0.452', 'weapon2': '0.678', 'WEAPON3': '0.900', 'HITCOUNT': '1.220', 'weapon3': '2.324', 'DAMAGECOUNT': '5.448', 'FRAGCOUNT': '14.000'} [2023-02-24 20:28:23,233][213367] DAMAGECOUNT value on done: 21312.0 [2023-02-24 20:28:23,233][213367] Sum rewards: 25.114, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.196', 'AMMO2': '0.010', 'AMMO5': '0.025', 'AMMO4': '0.049', 'weapon7': '0.054', 'weapon4': '0.064', 'AMMO3': '0.095', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.434', 'WEAPON5': '0.600', 'WEAPON3': '0.600', 'weapon2': '0.962', 'HITCOUNT': '1.390', 'weapon3': '1.776', 'DAMAGECOUNT': '7.161', 'FRAGCOUNT': '20.000'} [2023-02-24 20:28:23,235][213366] DAMAGECOUNT value on done: 24070.0 [2023-02-24 20:28:23,236][213366] Sum rewards: 13.156, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.094', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.089', 'AMMO3': '0.091', 'weapon4': '0.116', 'WEAPON5': '0.250', 'weapon5': '0.454', 'WEAPON3': '0.550', 'HITCOUNT': '0.750', 'weapon2': '0.958', 'weapon3': '1.940', 'DAMAGECOUNT': '3.201', 'FRAGCOUNT': '10.000'} [2023-02-24 20:28:23,238][213382] DAMAGECOUNT value on done: 23109.0 [2023-02-24 20:28:23,238][213382] Sum rewards: 25.301, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.195', 'AMMO5': '0.016', 'AMMO2': '0.024', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'weapon4': '0.246', 'WEAPON5': '0.400', 'weapon5': '0.442', 'weapon2': '0.696', 'WEAPON3': '0.950', 'HITCOUNT': '1.520', 'weapon3': '2.076', 'DAMAGECOUNT': '6.822', 'FRAGCOUNT': '23.000'} [2023-02-24 20:28:23,243][213372] DAMAGECOUNT value on done: 25245.0 [2023-02-24 20:28:23,244][213372] Sum rewards: 20.578, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.474', 'AMMO5': '0.019', 'AMMO2': '0.048', 'AMMO3': '0.121', 'weapon5': '0.224', 'AMMO4': '0.240', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.546', 'WEAPON3': '0.800', 'weapon2': '0.892', 'HITCOUNT': '1.590', 'weapon3': '2.042', 'DAMAGECOUNT': '6.429', 'FRAGCOUNT': '18.000'} [2023-02-24 20:28:23,252][213368] DAMAGECOUNT value on done: 23817.0 [2023-02-24 20:28:23,253][213368] Sum rewards: 25.273, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.086', 'AMMO5': '0.017', 'AMMO2': '0.020', 'AMMO4': '0.098', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.110', 'weapon5': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'weapon2': '0.900', 'HITCOUNT': '1.650', 'weapon3': '2.218', 'DAMAGECOUNT': '6.645', 'FRAGCOUNT': '19.000'} [2023-02-24 20:28:23,352][213384] DAMAGECOUNT value on done: 20003.0 [2023-02-24 20:28:23,353][213384] Sum rewards: 14.376, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.591', 'AMMO2': '0.006', 'AMMO5': '0.013', 'AMMO4': '0.027', 'AMMO3': '0.082', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon5': '0.270', 'weapon4': '0.410', 'WEAPON3': '0.600', 'weapon2': '1.072', 'HITCOUNT': '1.210', 'weapon3': '1.662', 'DAMAGECOUNT': '3.864', 'FRAGCOUNT': '13.000'} [2023-02-24 20:28:23,512][213383] DAMAGECOUNT value on done: 21310.0 [2023-02-24 20:28:23,512][213383] Sum rewards: 19.438, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.780', 'AMMO5': '0.013', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'weapon5': '0.410', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'HITCOUNT': '1.160', 'weapon2': '1.348', 'weapon3': '1.638', 'DAMAGECOUNT': '4.953', 'FRAGCOUNT': '16.000'} [2023-02-24 20:28:23,525][213369] DAMAGECOUNT value on done: 24195.0 [2023-02-24 20:28:23,526][213369] Sum rewards: 26.381, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.920', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'AMMO4': '0.123', 'AMMO3': '0.128', 'WEAPON5': '0.200', 'weapon4': '0.230', 'weapon5': '0.444', 'weapon2': '0.558', 'WEAPON3': '0.800', 'HITCOUNT': '1.410', 'weapon3': '2.068', 'DAMAGECOUNT': '6.987', 'FRAGCOUNT': '21.000'} [2023-02-24 20:28:23,528][213367] DAMAGECOUNT value on done: 20013.0 [2023-02-24 20:28:23,528][213367] Sum rewards: 17.046, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.594', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.115', 'AMMO4': '0.124', 'weapon5': '0.308', 'WEAPON4': '0.400', 'ARMOR': '0.456', 'WEAPON5': '0.500', 'weapon4': '0.602', 'WEAPON3': '0.700', 'weapon2': '0.748', 'HITCOUNT': '1.150', 'weapon3': '1.628', 'DAMAGECOUNT': '5.094', 'FRAGCOUNT': '15.000'} [2023-02-24 20:28:23,537][213366] DAMAGECOUNT value on done: 23534.0 [2023-02-24 20:28:23,537][213366] Sum rewards: 24.734, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.832', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.098', 'AMMO3': '0.110', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon5': '0.426', 'weapon2': '0.530', 'WEAPON3': '0.650', 'weapon4': '0.654', 'HITCOUNT': '1.500', 'weapon3': '1.830', 'DAMAGECOUNT': '5.982', 'FRAGCOUNT': '20.000'} [2023-02-24 20:28:23,548][213382] DAMAGECOUNT value on done: 21644.0 [2023-02-24 20:28:23,549][213382] Sum rewards: 22.509, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.622', 'AMMO5': '0.018', 'AMMO2': '0.024', 'AMMO3': '0.117', 'AMMO4': '0.122', 'WEAPON4': '0.250', 'weapon4': '0.312', 'weapon5': '0.432', 'WEAPON5': '0.500', 'weapon2': '0.636', 'WEAPON3': '0.850', 'HITCOUNT': '1.620', 'weapon3': '2.118', 'DAMAGECOUNT': '6.381', 'FRAGCOUNT': '19.000'} [2023-02-24 20:28:23,552][213368] DAMAGECOUNT value on done: 24232.0 [2023-02-24 20:28:23,553][213368] Sum rewards: 14.261, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.887', 'AMMO2': '0.013', 'AMMO5': '0.027', 'AMMO4': '0.066', 'weapon4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.208', 'weapon5': '0.276', 'weapon2': '0.444', 'WEAPON5': '0.650', 'WEAPON3': '1.200', 'HITCOUNT': '1.610', 'weapon3': '2.758', 'DAMAGECOUNT': '5.880', 'FRAGCOUNT': '16.000'} [2023-02-24 20:28:23,558][213372] DAMAGECOUNT value on done: 21698.0 [2023-02-24 20:28:23,558][213372] Sum rewards: 27.597, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.830', 'AMMO5': '0.019', 'AMMO2': '0.020', 'weapon4': '0.070', 'AMMO4': '0.097', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'weapon5': '0.722', 'weapon2': '0.910', 'HITCOUNT': '1.150', 'weapon3': '1.564', 'DAMAGECOUNT': '7.326', 'FRAGCOUNT': '22.000'} [2023-02-24 20:28:23,596][213365] Updated weights for policy 0, policy_version 25136 (0.0009) [2023-02-24 20:28:23,662][213384] DAMAGECOUNT value on done: 27025.0 [2023-02-24 20:28:23,663][213384] Sum rewards: 26.037, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.715', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.032', 'AMMO3': '0.128', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'weapon4': '0.362', 'weapon5': '0.390', 'weapon2': '0.414', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'HITCOUNT': '1.440', 'weapon3': '2.352', 'DAMAGECOUNT': '6.747', 'FRAGCOUNT': '23.000'} [2023-02-24 20:28:23,743][213368] DAMAGECOUNT value on done: 23535.0 [2023-02-24 20:28:23,743][213368] Sum rewards: 13.448, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.335', 'AMMO2': '0.007', 'weapon4': '0.014', 'WEAPON1': '0.030', 'AMMO4': '0.036', 'AMMO5': '0.039', 'WEAPON4': '0.100', 'AMMO3': '0.162', 'weapon5': '0.418', 'WEAPON5': '0.800', 'weapon2': '0.818', 'WEAPON3': '1.050', 'HITCOUNT': '1.160', 'weapon3': '2.318', 'DAMAGECOUNT': '4.581', 'FRAGCOUNT': '14.000'} [2023-02-24 20:28:23,811][213383] DAMAGECOUNT value on done: 21356.0 [2023-02-24 20:28:23,811][213383] Sum rewards: 16.899, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.890', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.050', 'AMMO4': '0.110', 'WEAPON4': '0.350', 'WEAPON3': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.464', 'weapon5': '0.546', 'weapon2': '0.684', 'HITCOUNT': '1.240', 'weapon3': '1.614', 'DAMAGECOUNT': '5.622', 'FRAGCOUNT': '13.000'} [2023-02-24 20:28:23,853][213366] DAMAGECOUNT value on done: 19239.0 [2023-02-24 20:28:23,853][213366] Sum rewards: 21.773, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.330', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO5': '0.015', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'weapon4': '0.178', 'weapon5': '0.424', 'WEAPON5': '0.450', 'weapon2': '0.722', 'WEAPON3': '1.150', 'HITCOUNT': '1.360', 'weapon3': '2.002', 'DAMAGECOUNT': '6.213', 'FRAGCOUNT': '21.000'} [2023-02-24 20:28:23,853][213382] DAMAGECOUNT value on done: 24638.0 [2023-02-24 20:28:23,854][213382] Sum rewards: 16.337, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.829', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'weapon4': '0.178', 'WEAPON5': '0.300', 'weapon5': '0.456', 'WEAPON3': '0.800', 'weapon2': '0.820', 'HITCOUNT': '1.290', 'weapon3': '2.042', 'DAMAGECOUNT': '5.604', 'FRAGCOUNT': '15.000'} [2023-02-24 20:28:23,864][213372] DAMAGECOUNT value on done: 22703.0 [2023-02-24 20:28:23,864][213372] Sum rewards: 17.440, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.725', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.029', 'weapon7': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.127', 'AMMO4': '0.146', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.278', 'weapon2': '0.328', 'WEAPON4': '0.400', 'weapon4': '0.602', 'WEAPON3': '0.800', 'HITCOUNT': '1.300', 'weapon3': '1.790', 'DAMAGECOUNT': '5.631', 'FRAGCOUNT': '16.000'} [2023-02-24 20:28:23,899][213369] DAMAGECOUNT value on done: 22976.0 [2023-02-24 20:28:23,900][213369] Sum rewards: 15.039, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.310', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.027', 'WEAPON4': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.139', 'weapon4': '0.208', 'weapon5': '0.372', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'weapon2': '0.844', 'HITCOUNT': '1.190', 'weapon3': '2.024', 'DAMAGECOUNT': '5.331', 'FRAGCOUNT': '12.000'} [2023-02-24 20:28:23,968][213384] DAMAGECOUNT value on done: 23071.0 [2023-02-24 20:28:23,968][213384] Sum rewards: 20.899, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.810', 'AMMO2': '0.024', 'AMMO5': '0.024', 'AMMO3': '0.116', 'AMMO4': '0.119', 'WEAPON4': '0.250', 'weapon4': '0.266', 'weapon5': '0.388', 'WEAPON5': '0.550', 'weapon2': '0.562', 'WEAPON3': '0.750', 'HITCOUNT': '1.420', 'weapon3': '2.234', 'DAMAGECOUNT': '5.505', 'FRAGCOUNT': '17.000'} [2023-02-24 20:28:24,037][213368] DAMAGECOUNT value on done: 25941.0 [2023-02-24 20:28:24,038][213368] Sum rewards: 32.734, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.575', 'AMMO2': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.048', 'weapon7': '0.052', 'AMMO3': '0.079', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.350', 'weapon4': '0.354', 'weapon5': '0.422', 'WEAPON3': '0.550', 'weapon2': '0.576', 'HITCOUNT': '1.680', 'weapon3': '1.862', 'DAMAGECOUNT': '7.413', 'FRAGCOUNT': '24.000'} [2023-02-24 20:28:24,195][213369] DAMAGECOUNT value on done: 20596.0 [2023-02-24 20:28:24,195][213369] Sum rewards: 28.685, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.670', 'AMMO2': '0.015', 'AMMO5': '0.017', 'weapon7': '0.074', 'AMMO4': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon2': '0.112', 'AMMO3': '0.144', 'weapon5': '0.340', 'weapon4': '0.396', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '1.860', 'weapon3': '2.460', 'DAMAGECOUNT': '8.160', 'FRAGCOUNT': '23.000'} [2023-02-24 20:28:25,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13812.1). Total num frames: 102977536. Throughput: 0: 3488.2. Samples: 737116. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:28:25,243][213332] Avg episode reward: [(0, '21.413')] [2023-02-24 20:28:26,468][213365] Updated weights for policy 0, policy_version 25146 (0.0009) [2023-02-24 20:28:29,389][213365] Updated weights for policy 0, policy_version 25156 (0.0009) [2023-02-24 20:28:30,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13926.5, 300 sec: 13814.7). Total num frames: 103047168. Throughput: 0: 3490.0. Samples: 758164. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:28:30,243][213332] Avg episode reward: [(0, '21.413')] [2023-02-24 20:28:32,343][213365] Updated weights for policy 0, policy_version 25166 (0.0009) [2023-02-24 20:28:35,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13817.2). Total num frames: 103116800. Throughput: 0: 3490.6. Samples: 768620. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:28:35,243][213332] Avg episode reward: [(0, '21.413')] [2023-02-24 20:28:35,280][213365] Updated weights for policy 0, policy_version 25176 (0.0009) [2023-02-24 20:28:38,239][213365] Updated weights for policy 0, policy_version 25186 (0.0009) [2023-02-24 20:28:40,128][213372] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 20:28:40,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13819.6). Total num frames: 103186432. Throughput: 0: 3487.1. Samples: 789486. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:28:40,243][213332] Avg episode reward: [(0, '21.413')] [2023-02-24 20:28:40,591][213384] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 20:28:41,154][213365] Updated weights for policy 0, policy_version 25196 (0.0009) [2023-02-24 20:28:41,947][213367] DAMAGECOUNT value on done: 21735.0 [2023-02-24 20:28:41,948][213367] Sum rewards: 21.075, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.889', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO3': '0.081', 'AMMO4': '0.089', 'WEAPON4': '0.250', 'weapon5': '0.304', 'WEAPON5': '0.400', 'weapon4': '0.404', 'weapon2': '0.436', 'WEAPON3': '0.600', 'HITCOUNT': '1.340', 'weapon3': '2.330', 'DAMAGECOUNT': '5.673', 'FRAGCOUNT': '16.000'} [2023-02-24 20:28:42,111][213383] DAMAGECOUNT value on done: 25215.0 [2023-02-24 20:28:42,112][213383] Sum rewards: 32.741, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.121', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.073', 'AMMO3': '0.139', 'weapon5': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.418', 'WEAPON3': '0.750', 'weapon2': '0.808', 'HITCOUNT': '1.930', 'weapon3': '2.118', 'DAMAGECOUNT': '7.623', 'FRAGCOUNT': '28.000'} [2023-02-24 20:28:42,136][213372] DAMAGECOUNT value on done: 22914.0 [2023-02-24 20:28:42,136][213372] Sum rewards: 8.447, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-3.000', 'ARMOR': '0.004', 'AMMO5': '0.034', 'WEAPON1': '0.040', 'AMMO2': '0.049', 'weapon7': '0.054', 'AMMO3': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO4': '0.245', 'weapon5': '0.306', 'weapon4': '0.528', 'WEAPON4': '0.550', 'HITCOUNT': '0.650', 'weapon2': '0.670', 'WEAPON3': '0.700', 'WEAPON5': '0.850', 'weapon3': '1.198', 'DAMAGECOUNT': '3.270', 'FRAGCOUNT': '10.000'} [2023-02-24 20:28:42,213][213366] DAMAGECOUNT value on done: 23143.0 [2023-02-24 20:28:42,213][213366] Sum rewards: 24.263, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.224', 'ARMOR': '0.004', 'AMMO2': '0.005', 'AMMO5': '0.015', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'weapon4': '0.076', 'AMMO3': '0.110', 'weapon5': '0.346', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'weapon2': '0.994', 'HITCOUNT': '1.420', 'weapon3': '2.270', 'DAMAGECOUNT': '5.970', 'FRAGCOUNT': '19.000'} [2023-02-24 20:28:42,251][213367] DAMAGECOUNT value on done: 27087.0 [2023-02-24 20:28:42,252][213367] Sum rewards: 19.928, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.095', 'ARMOR': '0.004', 'AMMO5': '0.028', 'AMMO2': '0.042', 'weapon4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.136', 'AMMO4': '0.209', 'weapon2': '0.310', 'weapon5': '0.522', 'WEAPON5': '0.650', 'WEAPON3': '0.850', 'HITCOUNT': '1.250', 'weapon3': '2.632', 'DAMAGECOUNT': '5.223', 'FRAGCOUNT': '18.000'} [2023-02-24 20:28:42,267][213382] DAMAGECOUNT value on done: 24024.0 [2023-02-24 20:28:42,267][213382] Sum rewards: 24.048, reward structure: {'DEATHCOUNT': '-11.250', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.021', 'AMMO4': '0.103', 'HEALTH': '0.160', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'weapon5': '0.344', 'weapon4': '0.390', 'WEAPON5': '0.400', 'weapon2': '0.742', 'WEAPON3': '0.750', 'HITCOUNT': '1.800', 'weapon3': '2.204', 'DAMAGECOUNT': '7.500', 'FRAGCOUNT': '20.500'} [2023-02-24 20:28:42,318][213384] DAMAGECOUNT value on done: 25473.0 [2023-02-24 20:28:42,319][213384] Sum rewards: 22.883, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.415', 'AMMO2': '0.011', 'AMMO5': '0.012', 'AMMO4': '0.056', 'weapon4': '0.090', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'weapon5': '0.372', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'weapon2': '1.000', 'HITCOUNT': '1.420', 'weapon3': '2.056', 'DAMAGECOUNT': '6.288', 'FRAGCOUNT': '19.000'} [2023-02-24 20:28:42,414][213383] DAMAGECOUNT value on done: 26752.0 [2023-02-24 20:28:42,415][213383] Sum rewards: 28.691, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.392', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.043', 'AMMO3': '0.076', 'weapon7': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO4': '0.217', 'WEAPON5': '0.350', 'weapon5': '0.354', 'WEAPON3': '0.500', 'weapon4': '0.504', 'WEAPON4': '0.550', 'weapon2': '0.576', 'HITCOUNT': '1.660', 'weapon3': '1.908', 'DAMAGECOUNT': '8.310', 'FRAGCOUNT': '22.000'} [2023-02-24 20:28:42,433][213372] DAMAGECOUNT value on done: 27158.0 [2023-02-24 20:28:42,433][213372] Sum rewards: 22.241, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.120', 'AMMO2': '0.004', 'ARMOR': '0.004', 'AMMO4': '0.019', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'weapon4': '0.054', 'AMMO3': '0.066', 'WEAPON4': '0.100', 'weapon5': '0.376', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'weapon2': '0.982', 'HITCOUNT': '1.300', 'weapon3': '1.878', 'DAMAGECOUNT': '5.739', 'FRAGCOUNT': '17.000'} [2023-02-24 20:28:42,490][213369] DAMAGECOUNT value on done: 24561.0 [2023-02-24 20:28:42,490][213369] Sum rewards: 17.051, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.017', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.082', 'weapon4': '0.122', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'WEAPON5': '0.450', 'weapon2': '0.508', 'weapon5': '0.508', 'HEALTH': '0.644', 'WEAPON3': '0.700', 'HITCOUNT': '1.250', 'weapon3': '2.288', 'DAMAGECOUNT': '5.664', 'FRAGCOUNT': '13.500'} [2023-02-24 20:28:42,513][213367] DAMAGECOUNT value on done: 23256.0 [2023-02-24 20:28:42,513][213367] Sum rewards: 17.942, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.728', 'AMMO5': '0.015', 'AMMO2': '0.025', 'weapon4': '0.082', 'AMMO3': '0.104', 'AMMO4': '0.125', 'WEAPON4': '0.200', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'weapon5': '0.658', 'weapon2': '0.982', 'HITCOUNT': '1.160', 'weapon3': '1.836', 'DAMAGECOUNT': '5.832', 'FRAGCOUNT': '14.000'} [2023-02-24 20:28:42,517][213366] DAMAGECOUNT value on done: 26362.0 [2023-02-24 20:28:42,517][213366] Sum rewards: 25.759, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.302', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.025', 'AMMO3': '0.084', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'weapon4': '0.300', 'weapon5': '0.356', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'weapon2': '0.802', 'HITCOUNT': '1.510', 'weapon3': '1.956', 'DAMAGECOUNT': '6.876', 'FRAGCOUNT': '19.500'} [2023-02-24 20:28:42,569][213382] DAMAGECOUNT value on done: 25124.0 [2023-02-24 20:28:42,569][213382] Sum rewards: 22.333, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.362', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO5': '0.025', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.134', 'weapon4': '0.202', 'WEAPON5': '0.450', 'weapon5': '0.488', 'weapon2': '0.734', 'WEAPON3': '0.750', 'HITCOUNT': '1.520', 'weapon3': '2.136', 'DAMAGECOUNT': '6.045', 'FRAGCOUNT': '19.000'} [2023-02-24 20:28:42,602][213368] DAMAGECOUNT value on done: 25427.0 [2023-02-24 20:28:42,602][213368] Sum rewards: 16.714, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.315', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.100', 'AMMO3': '0.108', 'weapon4': '0.110', 'WEAPON5': '0.500', 'weapon5': '0.512', 'WEAPON3': '0.700', 'HITCOUNT': '1.000', 'weapon2': '1.124', 'weapon3': '1.778', 'DAMAGECOUNT': '4.830', 'FRAGCOUNT': '12.000'} [2023-02-24 20:28:42,618][213384] DAMAGECOUNT value on done: 22360.0 [2023-02-24 20:28:42,619][213384] Sum rewards: 26.887, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.500', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.033', 'AMMO3': '0.066', 'AMMO4': '0.163', 'WEAPON4': '0.250', 'weapon4': '0.320', 'WEAPON3': '0.450', 'weapon5': '0.472', 'WEAPON5': '0.500', 'weapon2': '0.866', 'HITCOUNT': '1.320', 'weapon3': '1.842', 'DAMAGECOUNT': '7.071', 'FRAGCOUNT': '20.000'} [2023-02-24 20:28:42,746][213372] DAMAGECOUNT value on done: 24358.0 [2023-02-24 20:28:42,746][213372] Sum rewards: 27.717, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.124', 'AMMO2': '0.010', 'AMMO5': '0.013', 'AMMO4': '0.051', 'AMMO3': '0.088', 'WEAPON4': '0.150', 'weapon4': '0.184', 'WEAPON5': '0.300', 'weapon5': '0.462', 'WEAPON3': '0.550', 'weapon2': '1.240', 'HITCOUNT': '1.600', 'weapon3': '1.712', 'DAMAGECOUNT': '7.980', 'FRAGCOUNT': '21.000'} [2023-02-24 20:28:42,781][213383] DAMAGECOUNT value on done: 22920.0 [2023-02-24 20:28:42,781][213383] Sum rewards: 14.577, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.706', 'AMMO2': '0.002', 'ARMOR': '0.004', 'AMMO4': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'weapon4': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'weapon5': '0.412', 'WEAPON5': '0.450', 'weapon2': '0.706', 'WEAPON3': '0.900', 'HITCOUNT': '0.990', 'weapon3': '1.890', 'DAMAGECOUNT': '4.830', 'FRAGCOUNT': '14.000'} [2023-02-24 20:28:42,788][213369] DAMAGECOUNT value on done: 26207.0 [2023-02-24 20:28:42,788][213369] Sum rewards: 22.705, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.983', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.047', 'AMMO3': '0.091', 'AMMO4': '0.234', 'weapon4': '0.360', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon5': '0.580', 'WEAPON3': '0.600', 'weapon2': '0.812', 'HITCOUNT': '1.370', 'weapon3': '1.734', 'DAMAGECOUNT': '6.036', 'FRAGCOUNT': '20.000'} [2023-02-24 20:28:42,808][213366] DAMAGECOUNT value on done: 25883.0 [2023-02-24 20:28:42,808][213366] Sum rewards: 25.512, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.422', 'AMMO5': '0.012', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'AMMO4': '0.071', 'AMMO3': '0.121', 'WEAPON4': '0.250', 'weapon4': '0.266', 'WEAPON5': '0.350', 'weapon5': '0.470', 'weapon2': '0.706', 'WEAPON3': '0.850', 'HITCOUNT': '1.570', 'weapon3': '2.154', 'DAMAGECOUNT': '7.047', 'FRAGCOUNT': '22.000'} [2023-02-24 20:28:42,813][213367] DAMAGECOUNT value on done: 21773.0 [2023-02-24 20:28:42,813][213367] Sum rewards: 15.130, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.889', 'AMMO5': '0.020', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.168', 'weapon2': '0.284', 'weapon5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.460', 'WEAPON5': '0.500', 'weapon4': '0.640', 'WEAPON3': '1.000', 'HITCOUNT': '1.260', 'weapon3': '2.068', 'DAMAGECOUNT': '5.280', 'FRAGCOUNT': '15.000'} [2023-02-24 20:28:42,860][213382] DAMAGECOUNT value on done: 24903.0 [2023-02-24 20:28:42,861][213382] Sum rewards: 27.835, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.780', 'AMMO2': '0.016', 'AMMO5': '0.025', 'AMMO4': '0.078', 'weapon4': '0.126', 'AMMO3': '0.159', 'WEAPON4': '0.250', 'weapon5': '0.442', 'WEAPON5': '0.700', 'weapon2': '0.848', 'WEAPON3': '1.100', 'HITCOUNT': '1.850', 'weapon3': '2.244', 'DAMAGECOUNT': '9.777', 'FRAGCOUNT': '24.000'} [2023-02-24 20:28:42,902][213384] DAMAGECOUNT value on done: 29219.0 [2023-02-24 20:28:42,902][213384] Sum rewards: 20.298, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.803', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'AMMO3': '0.165', 'weapon5': '0.418', 'WEAPON5': '0.500', 'weapon2': '0.620', 'WEAPON3': '1.150', 'HITCOUNT': '1.480', 'weapon3': '2.436', 'DAMAGECOUNT': '6.582', 'FRAGCOUNT': '19.500'} [2023-02-24 20:28:42,907][213368] DAMAGECOUNT value on done: 26030.0 [2023-02-24 20:28:42,908][213368] Sum rewards: 18.706, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '0.000', 'AMMO2': '0.019', 'AMMO5': '0.020', 'AMMO3': '0.089', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'weapon4': '0.230', 'WEAPON5': '0.250', 'weapon5': '0.414', 'WEAPON3': '0.550', 'weapon2': '0.882', 'HITCOUNT': '1.380', 'weapon3': '1.982', 'DAMAGECOUNT': '5.394', 'FRAGCOUNT': '12.500'} [2023-02-24 20:28:43,053][213372] DAMAGECOUNT value on done: 25482.0 [2023-02-24 20:28:43,054][213372] Sum rewards: 26.576, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.351', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.154', 'WEAPON4': '0.250', 'weapon2': '0.370', 'weapon4': '0.390', 'WEAPON5': '0.450', 'weapon5': '0.450', 'WEAPON3': '0.950', 'HITCOUNT': '1.840', 'weapon3': '2.318', 'DAMAGECOUNT': '8.337', 'FRAGCOUNT': '23.500'} [2023-02-24 20:28:43,088][213383] DAMAGECOUNT value on done: 23051.0 [2023-02-24 20:28:43,089][213383] Sum rewards: 23.542, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.070', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO3': '0.061', 'WEAPON4': '0.150', 'AMMO4': '0.193', 'weapon4': '0.222', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'weapon5': '0.438', 'weapon2': '1.150', 'HITCOUNT': '1.200', 'weapon3': '1.862', 'DAMAGECOUNT': '5.085', 'FRAGCOUNT': '17.000'} [2023-02-24 20:28:43,109][213366] DAMAGECOUNT value on done: 20219.0 [2023-02-24 20:28:43,110][213366] Sum rewards: 7.726, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.740', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO5': '0.017', 'AMMO4': '0.075', 'AMMO3': '0.080', 'weapon5': '0.172', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'ARMOR': '0.466', 'weapon4': '0.488', 'WEAPON3': '0.550', 'weapon2': '0.598', 'HITCOUNT': '0.900', 'weapon3': '1.654', 'DAMAGECOUNT': '2.940', 'FRAGCOUNT': '6.000'} [2023-02-24 20:28:43,117][213368] DAMAGECOUNT value on done: 26268.0 [2023-02-24 20:28:43,117][213368] Sum rewards: 20.906, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.015', 'AMMO5': '0.021', 'AMMO2': '0.035', 'AMMO4': '0.175', 'AMMO3': '0.186', 'weapon4': '0.212', 'weapon5': '0.380', 'WEAPON4': '0.450', 'WEAPON5': '0.650', 'weapon2': '0.726', 'WEAPON3': '1.150', 'HITCOUNT': '1.970', 'weapon3': '2.266', 'DAMAGECOUNT': '8.199', 'FRAGCOUNT': '21.000'} [2023-02-24 20:28:43,130][213369] DAMAGECOUNT value on done: 25117.0 [2023-02-24 20:28:43,131][213369] Sum rewards: 20.678, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.472', 'AMMO2': '0.019', 'AMMO5': '0.023', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'weapon4': '0.142', 'AMMO3': '0.153', 'weapon5': '0.446', 'weapon2': '0.458', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'HITCOUNT': '1.340', 'weapon3': '2.504', 'DAMAGECOUNT': '6.423', 'FRAGCOUNT': '19.500'} [2023-02-24 20:28:43,155][213382] DAMAGECOUNT value on done: 26210.0 [2023-02-24 20:28:43,155][213382] Sum rewards: 18.843, reward structure: {'DEATHCOUNT': '-6.750', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.020', 'HEALTH': '0.025', 'AMMO3': '0.088', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.138', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'weapon5': '0.796', 'weapon2': '0.988', 'HITCOUNT': '1.090', 'weapon3': '1.658', 'DAMAGECOUNT': '4.716', 'FRAGCOUNT': '15.000'} [2023-02-24 20:28:43,203][213384] DAMAGECOUNT value on done: 24899.0 [2023-02-24 20:28:43,204][213384] Sum rewards: 24.331, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.445', 'AMMO5': '0.026', 'AMMO2': '0.040', 'AMMO3': '0.115', 'AMMO4': '0.202', 'WEAPON5': '0.450', 'weapon5': '0.468', 'weapon2': '0.478', 'WEAPON4': '0.600', 'weapon4': '0.632', 'WEAPON3': '0.750', 'HITCOUNT': '1.500', 'weapon3': '2.030', 'DAMAGECOUNT': '5.484', 'FRAGCOUNT': '22.000'} [2023-02-24 20:28:43,418][213368] DAMAGECOUNT value on done: 27740.0 [2023-02-24 20:28:43,418][213368] Sum rewards: 19.931, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.550', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'weapon4': '0.302', 'weapon5': '0.308', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'weapon2': '0.936', 'HITCOUNT': '1.420', 'weapon3': '1.964', 'DAMAGECOUNT': '5.397', 'FRAGCOUNT': '16.000'} [2023-02-24 20:28:43,441][213369] DAMAGECOUNT value on done: 22754.0 [2023-02-24 20:28:43,442][213369] Sum rewards: 24.646, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.995', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO5': '0.024', 'AMMO4': '0.036', 'AMMO3': '0.158', 'WEAPON4': '0.250', 'weapon5': '0.308', 'WEAPON5': '0.400', 'weapon4': '0.438', 'weapon2': '0.794', 'WEAPON3': '1.050', 'HITCOUNT': '1.570', 'weapon3': '2.128', 'DAMAGECOUNT': '6.474', 'FRAGCOUNT': '22.000'} [2023-02-24 20:28:44,117][213365] Updated weights for policy 0, policy_version 25206 (0.0009) [2023-02-24 20:28:45,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13821.8). Total num frames: 103256064. Throughput: 0: 3483.4. Samples: 810284. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:28:45,243][213332] Avg episode reward: [(0, '21.328')] [2023-02-24 20:28:45,272][213352] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000025210_103260160.pth... [2023-02-24 20:28:45,332][213352] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000024416_100007936.pth [2023-02-24 20:28:47,032][213365] Updated weights for policy 0, policy_version 25216 (0.0009) [2023-02-24 20:28:49,947][213365] Updated weights for policy 0, policy_version 25226 (0.0009) [2023-02-24 20:28:50,243][213332] Fps is (10 sec: 14336.1, 60 sec: 13994.7, 300 sec: 13841.1). Total num frames: 103329792. Throughput: 0: 3484.2. Samples: 820822. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:28:50,243][213332] Avg episode reward: [(0, '21.328')] [2023-02-24 20:28:52,861][213365] Updated weights for policy 0, policy_version 25236 (0.0009) [2023-02-24 20:28:55,243][213332] Fps is (10 sec: 14336.0, 60 sec: 13994.7, 300 sec: 13842.8). Total num frames: 103399424. Throughput: 0: 3487.8. Samples: 841856. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:28:55,243][213332] Avg episode reward: [(0, '21.328')] [2023-02-24 20:28:55,832][213365] Updated weights for policy 0, policy_version 25246 (0.0009) [2023-02-24 20:28:58,762][213365] Updated weights for policy 0, policy_version 25256 (0.0009) [2023-02-24 20:29:00,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13994.7, 300 sec: 13844.5). Total num frames: 103469056. Throughput: 0: 3485.6. Samples: 862734. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:29:00,243][213332] Avg episode reward: [(0, '21.328')] [2023-02-24 20:29:01,165][213367] DAMAGECOUNT value on done: 23923.0 [2023-02-24 20:29:01,165][213367] Sum rewards: 21.909, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.538', 'AMMO5': '0.019', 'AMMO2': '0.029', 'AMMO3': '0.140', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'weapon5': '0.218', 'weapon4': '0.308', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'weapon2': '0.952', 'HITCOUNT': '1.570', 'weapon3': '2.050', 'DAMAGECOUNT': '6.564', 'FRAGCOUNT': '19.500'} [2023-02-24 20:29:01,419][213383] DAMAGECOUNT value on done: 27671.0 [2023-02-24 20:29:01,420][213372] DAMAGECOUNT value on done: 24572.0 [2023-02-24 20:29:01,420][213372] Sum rewards: 18.174, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.065', 'AMMO2': '0.024', 'AMMO5': '0.027', 'AMMO3': '0.089', 'AMMO4': '0.120', 'weapon5': '0.486', 'WEAPON4': '0.500', 'WEAPON3': '0.550', 'weapon4': '0.692', 'WEAPON5': '0.750', 'weapon2': '0.754', 'HITCOUNT': '1.300', 'weapon3': '1.472', 'DAMAGECOUNT': '4.974', 'FRAGCOUNT': '15.000'} [2023-02-24 20:29:01,420][213383] Sum rewards: 21.052, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.026', 'AMMO5': '0.021', 'AMMO2': '0.033', 'AMMO3': '0.106', 'AMMO4': '0.164', 'weapon5': '0.406', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.596', 'WEAPON3': '0.750', 'weapon2': '1.138', 'weapon3': '1.396', 'HITCOUNT': '1.850', 'DAMAGECOUNT': '7.368', 'FRAGCOUNT': '19.000'} [2023-02-24 20:29:01,467][213367] DAMAGECOUNT value on done: 29562.0 [2023-02-24 20:29:01,467][213367] Sum rewards: 27.645, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.868', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO3': '0.086', 'AMMO4': '0.161', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon5': '0.434', 'weapon4': '0.468', 'WEAPON3': '0.600', 'weapon2': '0.944', 'weapon3': '1.570', 'HITCOUNT': '1.820', 'DAMAGECOUNT': '7.425', 'FRAGCOUNT': '21.000'} [2023-02-24 20:29:01,507][213382] DAMAGECOUNT value on done: 25947.0 [2023-02-24 20:29:01,507][213382] Sum rewards: 20.526, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.808', 'ARMOR': '0.008', 'AMMO2': '0.015', 'AMMO5': '0.022', 'AMMO4': '0.076', 'AMMO3': '0.093', 'WEAPON4': '0.350', 'weapon4': '0.410', 'weapon5': '0.508', 'WEAPON3': '0.600', 'WEAPON5': '0.600', 'weapon2': '0.756', 'HITCOUNT': '1.260', 'weapon3': '1.866', 'DAMAGECOUNT': '5.769', 'FRAGCOUNT': '16.500'} [2023-02-24 20:29:01,523][213384] DAMAGECOUNT value on done: 27372.0 [2023-02-24 20:29:01,523][213384] Sum rewards: 21.997, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.280', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.010', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'weapon4': '0.204', 'weapon5': '0.244', 'WEAPON5': '0.250', 'WEAPON3': '0.700', 'weapon2': '1.258', 'HITCOUNT': '1.420', 'weapon3': '1.768', 'DAMAGECOUNT': '5.697', 'FRAGCOUNT': '19.000'} [2023-02-24 20:29:01,550][213366] DAMAGECOUNT value on done: 25369.0 [2023-02-24 20:29:01,551][213366] Sum rewards: 25.988, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.190', 'AMMO5': '0.023', 'AMMO2': '0.036', 'weapon5': '0.134', 'AMMO3': '0.151', 'weapon4': '0.168', 'AMMO4': '0.180', 'WEAPON4': '0.300', 'WEAPON5': '0.500', 'weapon2': '0.604', 'WEAPON3': '0.950', 'HITCOUNT': '1.730', 'weapon3': '2.810', 'DAMAGECOUNT': '6.591', 'FRAGCOUNT': '25.000'} [2023-02-24 20:29:01,717][213383] DAMAGECOUNT value on done: 28434.0 [2023-02-24 20:29:01,718][213383] Sum rewards: 15.535, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.282', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.115', 'WEAPON5': '0.350', 'weapon5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.530', 'WEAPON3': '0.650', 'weapon2': '0.952', 'HITCOUNT': '1.290', 'weapon3': '1.494', 'DAMAGECOUNT': '5.046', 'FRAGCOUNT': '13.000'} [2023-02-24 20:29:01,729][213372] DAMAGECOUNT value on done: 28228.0 [2023-02-24 20:29:01,729][213372] Sum rewards: 13.333, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'weapon5': '0.156', 'weapon4': '0.344', 'HEALTH': '0.416', 'WEAPON3': '0.450', 'HITCOUNT': '0.910', 'weapon2': '1.116', 'weapon3': '1.490', 'DAMAGECOUNT': '3.210', 'FRAGCOUNT': '10.000'} [2023-02-24 20:29:01,736][213365] Updated weights for policy 0, policy_version 25266 (0.0009) [2023-02-24 20:29:01,749][213367] DAMAGECOUNT value on done: 25106.0 [2023-02-24 20:29:01,749][213367] Sum rewards: 24.651, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.204', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.018', 'AMMO3': '0.054', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'weapon4': '0.178', 'WEAPON3': '0.300', 'WEAPON5': '0.450', 'weapon5': '0.492', 'weapon2': '0.842', 'HITCOUNT': '1.010', 'weapon3': '1.454', 'DAMAGECOUNT': '5.550', 'FRAGCOUNT': '18.000'} [2023-02-24 20:29:01,814][213382] DAMAGECOUNT value on done: 27701.0 [2023-02-24 20:29:01,815][213382] Sum rewards: 23.074, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.040', 'AMMO5': '0.022', 'AMMO2': '0.037', 'AMMO3': '0.159', 'AMMO4': '0.186', 'weapon4': '0.188', 'weapon5': '0.272', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'weapon2': '0.718', 'WEAPON3': '1.050', 'HITCOUNT': '1.820', 'weapon3': '2.080', 'DAMAGECOUNT': '7.731', 'FRAGCOUNT': '25.000'} [2023-02-24 20:29:01,828][213384] DAMAGECOUNT value on done: 24423.0 [2023-02-24 20:29:01,829][213384] Sum rewards: 23.597, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.014', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.029', 'AMMO3': '0.117', 'weapon4': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.450', 'weapon5': '0.536', 'WEAPON3': '0.750', 'weapon2': '0.878', 'HITCOUNT': '1.330', 'weapon3': '1.940', 'DAMAGECOUNT': '6.189', 'FRAGCOUNT': '19.000'} [2023-02-24 20:29:01,858][213366] DAMAGECOUNT value on done: 29518.0 [2023-02-24 20:29:01,858][213366] Sum rewards: 29.862, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.435', 'AMMO5': '0.013', 'AMMO2': '0.026', 'AMMO4': '0.132', 'AMMO3': '0.177', 'weapon2': '0.278', 'WEAPON5': '0.300', 'weapon5': '0.324', 'WEAPON4': '0.350', 'weapon4': '0.402', 'WEAPON3': '1.150', 'HITCOUNT': '2.500', 'weapon3': '2.676', 'DAMAGECOUNT': '9.468', 'FRAGCOUNT': '28.000'} [2023-02-24 20:29:01,889][213369] DAMAGECOUNT value on done: 26244.0 [2023-02-24 20:29:01,889][213369] Sum rewards: 13.361, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.026', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.159', 'weapon5': '0.160', 'AMMO3': '0.161', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.552', 'weapon4': '0.644', 'WEAPON3': '1.000', 'HITCOUNT': '1.430', 'weapon3': '2.086', 'DAMAGECOUNT': '5.049', 'FRAGCOUNT': '15.000'} [2023-02-24 20:29:01,924][213368] DAMAGECOUNT value on done: 28410.0 [2023-02-24 20:29:01,924][213368] Sum rewards: 33.693, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.542', 'ARMOR': '0.004', 'AMMO2': '0.020', 'AMMO5': '0.025', 'WEAPON1': '0.040', 'AMMO4': '0.101', 'AMMO3': '0.144', 'WEAPON4': '0.300', 'weapon5': '0.392', 'weapon4': '0.402', 'weapon2': '0.440', 'WEAPON5': '0.650', 'WEAPON3': '0.950', 'HITCOUNT': '1.970', 'weapon3': '2.348', 'DAMAGECOUNT': '8.949', 'FRAGCOUNT': '29.000'} [2023-02-24 20:29:02,052][213367] DAMAGECOUNT value on done: 22978.0 [2023-02-24 20:29:02,052][213367] Sum rewards: 12.772, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.380', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.045', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.100', 'weapon5': '0.268', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.770', 'weapon2': '0.970', 'weapon3': '1.512', 'DAMAGECOUNT': '3.420', 'FRAGCOUNT': '11.000'} [2023-02-24 20:29:02,065][213372] DAMAGECOUNT value on done: 26339.0 [2023-02-24 20:29:02,065][213372] Sum rewards: 19.191, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.810', 'AMMO2': '0.014', 'AMMO5': '0.018', 'AMMO4': '0.070', 'AMMO3': '0.131', 'WEAPON4': '0.300', 'weapon4': '0.326', 'weapon5': '0.360', 'WEAPON5': '0.500', 'weapon2': '0.560', 'WEAPON3': '0.850', 'HITCOUNT': '1.550', 'weapon3': '2.378', 'DAMAGECOUNT': '5.943', 'FRAGCOUNT': '16.000'} [2023-02-24 20:29:02,092][213383] DAMAGECOUNT value on done: 25505.0 [2023-02-24 20:29:02,093][213383] Sum rewards: 24.085, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.783', 'AMMO5': '0.013', 'AMMO2': '0.020', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'AMMO3': '0.167', 'weapon4': '0.220', 'weapon5': '0.332', 'WEAPON5': '0.350', 'weapon2': '0.402', 'WEAPON3': '1.100', 'HITCOUNT': '1.890', 'weapon3': '2.672', 'DAMAGECOUNT': '7.755', 'FRAGCOUNT': '22.000'} [2023-02-24 20:29:02,125][213382] DAMAGECOUNT value on done: 27454.0 [2023-02-24 20:29:02,126][213382] Sum rewards: 29.265, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.525', 'AMMO2': '0.022', 'AMMO5': '0.024', 'weapon4': '0.046', 'AMMO3': '0.091', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'weapon5': '0.502', 'WEAPON5': '0.550', 'weapon2': '0.638', 'WEAPON3': '0.650', 'HITCOUNT': '1.520', 'weapon3': '2.332', 'DAMAGECOUNT': '7.653', 'FRAGCOUNT': '23.000'} [2023-02-24 20:29:02,139][213384] DAMAGECOUNT value on done: 30420.0 [2023-02-24 20:29:02,140][213384] Sum rewards: 11.220, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.280', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'weapon4': '0.296', 'weapon5': '0.324', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'HITCOUNT': '0.750', 'weapon2': '0.884', 'weapon3': '1.636', 'DAMAGECOUNT': '3.603', 'FRAGCOUNT': '11.000'} [2023-02-24 20:29:02,152][213366] DAMAGECOUNT value on done: 28609.0 [2023-02-24 20:29:02,152][213366] Sum rewards: 33.313, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.714', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'AMMO5': '0.022', 'AMMO4': '0.098', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'weapon4': '0.204', 'weapon5': '0.218', 'WEAPON5': '0.500', 'weapon2': '0.636', 'WEAPON3': '1.050', 'HITCOUNT': '1.630', 'weapon3': '2.604', 'DAMAGECOUNT': '8.178', 'FRAGCOUNT': '30.000'} [2023-02-24 20:29:02,197][213369] DAMAGECOUNT value on done: 29668.0 [2023-02-24 20:29:02,197][213369] Sum rewards: 41.281, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.522', 'ARMOR': '0.004', 'AMMO5': '0.033', 'AMMO2': '0.050', 'AMMO3': '0.129', 'AMMO4': '0.250', 'weapon5': '0.428', 'weapon2': '0.486', 'WEAPON4': '0.500', 'weapon4': '0.628', 'WEAPON5': '0.750', 'WEAPON3': '0.800', 'weapon3': '2.002', 'HITCOUNT': '2.110', 'DAMAGECOUNT': '10.383', 'FRAGCOUNT': '34.000'} [2023-02-24 20:29:02,233][213368] DAMAGECOUNT value on done: 27915.0 [2023-02-24 20:29:02,234][213368] Sum rewards: 17.654, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.906', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'weapon4': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.140', 'weapon5': '0.404', 'WEAPON5': '0.450', 'weapon2': '0.840', 'WEAPON3': '0.900', 'HITCOUNT': '1.270', 'weapon3': '2.290', 'DAMAGECOUNT': '5.655', 'FRAGCOUNT': '15.500'} [2023-02-24 20:29:02,371][213372] DAMAGECOUNT value on done: 27874.0 [2023-02-24 20:29:02,371][213372] Sum rewards: 24.373, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.277', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.111', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.382', 'weapon5': '0.388', 'weapon2': '0.548', 'WEAPON3': '0.800', 'HITCOUNT': '1.700', 'weapon3': '2.318', 'DAMAGECOUNT': '7.170', 'FRAGCOUNT': '19.000'} [2023-02-24 20:29:02,384][213383] DAMAGECOUNT value on done: 25659.0 [2023-02-24 20:29:02,385][213383] Sum rewards: 26.620, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.220', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'weapon7': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.138', 'AMMO4': '0.150', 'AMMO3': '0.178', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON4': '0.350', 'weapon4': '0.878', 'WEAPON3': '1.000', 'weapon3': '1.830', 'HITCOUNT': '1.900', 'DAMAGECOUNT': '7.824', 'FRAGCOUNT': '22.000'} [2023-02-24 20:29:02,426][213382] DAMAGECOUNT value on done: 28521.0 [2023-02-24 20:29:02,426][213382] Sum rewards: 24.769, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.772', 'AMMO5': '0.023', 'AMMO2': '0.042', 'AMMO3': '0.130', 'AMMO4': '0.210', 'weapon5': '0.464', 'WEAPON4': '0.500', 'WEAPON5': '0.650', 'weapon2': '0.660', 'weapon4': '0.698', 'WEAPON3': '0.750', 'weapon3': '1.560', 'HITCOUNT': '1.920', 'DAMAGECOUNT': '6.933', 'FRAGCOUNT': '21.000'} [2023-02-24 20:29:02,446][213384] DAMAGECOUNT value on done: 26094.0 [2023-02-24 20:29:02,447][213366] DAMAGECOUNT value on done: 21931.0 [2023-02-24 20:29:02,447][213384] Sum rewards: 14.333, reward structure: {'DEATHCOUNT': '-3.750', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO3': '0.067', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.208', 'WEAPON5': '0.250', 'WEAPON3': '0.300', 'HEALTH': '0.398', 'weapon5': '0.462', 'HITCOUNT': '0.810', 'weapon2': '1.362', 'weapon3': '1.424', 'DAMAGECOUNT': '3.585', 'FRAGCOUNT': '9.000'} [2023-02-24 20:29:02,447][213366] Sum rewards: 13.187, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.290', 'WEAPON1': '0.020', 'AMMO5': '0.027', 'AMMO2': '0.058', 'AMMO3': '0.159', 'AMMO4': '0.288', 'weapon2': '0.436', 'weapon4': '0.486', 'WEAPON4': '0.550', 'weapon5': '0.792', 'WEAPON5': '0.850', 'WEAPON3': '1.000', 'HITCOUNT': '1.280', 'weapon3': '1.644', 'DAMAGECOUNT': '5.136', 'FRAGCOUNT': '15.000'} [2023-02-24 20:29:02,457][213368] DAMAGECOUNT value on done: 28972.0 [2023-02-24 20:29:02,458][213368] Sum rewards: 29.191, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.388', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.123', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.292', 'weapon2': '0.394', 'weapon5': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '1.700', 'weapon3': '2.516', 'DAMAGECOUNT': '8.112', 'FRAGCOUNT': '23.000'} [2023-02-24 20:29:02,523][213369] DAMAGECOUNT value on done: 27293.0 [2023-02-24 20:29:02,523][213369] Sum rewards: 21.093, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.561', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.023', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'weapon5': '0.376', 'weapon4': '0.440', 'WEAPON5': '0.550', 'weapon2': '0.706', 'WEAPON3': '0.850', 'HITCOUNT': '1.650', 'weapon3': '2.070', 'DAMAGECOUNT': '6.528', 'FRAGCOUNT': '17.000'} [2023-02-24 20:29:02,741][213368] DAMAGECOUNT value on done: 30160.0 [2023-02-24 20:29:02,741][213368] Sum rewards: 21.279, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.896', 'AMMO5': '0.022', 'AMMO2': '0.033', 'AMMO3': '0.151', 'AMMO4': '0.165', 'WEAPON4': '0.300', 'weapon2': '0.418', 'weapon5': '0.436', 'WEAPON5': '0.600', 'weapon4': '0.732', 'WEAPON3': '0.950', 'HITCOUNT': '1.530', 'weapon3': '1.828', 'DAMAGECOUNT': '7.260', 'FRAGCOUNT': '20.000'} [2023-02-24 20:29:02,827][213369] DAMAGECOUNT value on done: 25410.0 [2023-02-24 20:29:02,827][213369] Sum rewards: 26.945, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.090', 'AMMO4': '0.113', 'HEALTH': '0.261', 'WEAPON4': '0.300', 'weapon2': '0.390', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'weapon4': '0.560', 'weapon5': '0.630', 'HITCOUNT': '1.850', 'weapon3': '1.940', 'DAMAGECOUNT': '7.968', 'FRAGCOUNT': '20.000'} [2023-02-24 20:29:04,703][213365] Updated weights for policy 0, policy_version 25276 (0.0009) [2023-02-24 20:29:05,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13926.4, 300 sec: 13830.0). Total num frames: 103534592. Throughput: 0: 3481.2. Samples: 873008. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:29:05,243][213332] Avg episode reward: [(0, '21.503')] [2023-02-24 20:29:07,621][213365] Updated weights for policy 0, policy_version 25286 (0.0009) [2023-02-24 20:29:08,973][213372] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-24 20:29:10,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13926.4, 300 sec: 13831.9). Total num frames: 103604224. Throughput: 0: 3484.5. Samples: 893916. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:29:10,243][213332] Avg episode reward: [(0, '21.503')] [2023-02-24 20:29:10,548][213365] Updated weights for policy 0, policy_version 25296 (0.0009) [2023-02-24 20:29:13,475][213365] Updated weights for policy 0, policy_version 25306 (0.0009) [2023-02-24 20:29:15,243][213332] Fps is (10 sec: 14336.0, 60 sec: 13994.7, 300 sec: 13849.1). Total num frames: 103677952. Throughput: 0: 3482.0. Samples: 914856. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:29:15,244][213332] Avg episode reward: [(0, '21.503')] [2023-02-24 20:29:16,391][213365] Updated weights for policy 0, policy_version 25316 (0.0009) [2023-02-24 20:29:19,345][213365] Updated weights for policy 0, policy_version 25326 (0.0009) [2023-02-24 20:29:20,243][213332] Fps is (10 sec: 14335.8, 60 sec: 13994.7, 300 sec: 13850.6). Total num frames: 103747584. Throughput: 0: 3481.3. Samples: 925280. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:29:20,243][213332] Avg episode reward: [(0, '21.503')] [2023-02-24 20:29:20,415][213367] DAMAGECOUNT value on done: 25197.0 [2023-02-24 20:29:20,415][213367] Sum rewards: 15.182, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.820', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO4': '0.070', 'weapon7': '0.080', 'AMMO3': '0.108', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.274', 'WEAPON5': '0.450', 'weapon5': '0.468', 'weapon4': '0.610', 'WEAPON3': '0.650', 'HITCOUNT': '0.930', 'weapon3': '1.964', 'DAMAGECOUNT': '3.822', 'FRAGCOUNT': '14.000'} [2023-02-24 20:29:20,655][213383] DAMAGECOUNT value on done: 29454.0 [2023-02-24 20:29:20,656][213383] Sum rewards: 15.212, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.130', 'ARMOR': '0.004', 'AMMO5': '0.030', 'AMMO2': '0.031', 'AMMO3': '0.133', 'AMMO4': '0.155', 'WEAPON4': '0.400', 'weapon4': '0.406', 'weapon5': '0.458', 'WEAPON5': '0.700', 'WEAPON3': '0.800', 'weapon2': '0.924', 'HITCOUNT': '1.250', 'weapon3': '1.702', 'DAMAGECOUNT': '5.349', 'FRAGCOUNT': '16.000'} [2023-02-24 20:29:20,717][213372] DAMAGECOUNT value on done: 26615.0 [2023-02-24 20:29:20,717][213372] Sum rewards: 20.630, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.245', 'AMMO2': '0.009', 'AMMO5': '0.025', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'weapon4': '0.112', 'AMMO3': '0.113', 'WEAPON5': '0.600', 'weapon5': '0.650', 'WEAPON3': '0.750', 'weapon2': '0.842', 'HITCOUNT': '1.290', 'weapon3': '1.762', 'DAMAGECOUNT': '6.129', 'FRAGCOUNT': '17.000'} [2023-02-24 20:29:20,724][213367] DAMAGECOUNT value on done: 32043.0 [2023-02-24 20:29:20,724][213367] Sum rewards: 23.093, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.357', 'AMMO2': '0.009', 'AMMO5': '0.020', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'weapon4': '0.120', 'AMMO3': '0.146', 'WEAPON5': '0.450', 'weapon2': '0.474', 'weapon5': '0.500', 'WEAPON3': '0.950', 'HITCOUNT': '1.520', 'weapon3': '2.422', 'DAMAGECOUNT': '7.443', 'FRAGCOUNT': '20.000'} [2023-02-24 20:29:20,758][213382] DAMAGECOUNT value on done: 28140.0 [2023-02-24 20:29:20,758][213382] Sum rewards: 27.333, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.251', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon7': '0.048', 'AMMO3': '0.062', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.191', 'WEAPON7': '0.200', 'weapon5': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '0.400', 'weapon2': '0.654', 'weapon4': '0.784', 'weapon3': '1.394', 'HITCOUNT': '1.630', 'DAMAGECOUNT': '6.579', 'FRAGCOUNT': '19.000'} [2023-02-24 20:29:20,881][213384] DAMAGECOUNT value on done: 29653.0 [2023-02-24 20:29:20,881][213384] Sum rewards: 23.699, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.114', 'ARMOR': '0.004', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'AMMO4': '0.089', 'AMMO3': '0.131', 'WEAPON4': '0.250', 'weapon4': '0.386', 'weapon5': '0.434', 'WEAPON5': '0.550', 'weapon2': '0.700', 'WEAPON3': '0.800', 'HITCOUNT': '1.430', 'weapon3': '2.018', 'DAMAGECOUNT': '6.708', 'FRAGCOUNT': '21.000'} [2023-02-24 20:29:20,900][213366] DAMAGECOUNT value on done: 27964.0 [2023-02-24 20:29:20,900][213366] Sum rewards: 27.716, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.765', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon5': '0.272', 'weapon4': '0.332', 'weapon2': '0.448', 'WEAPON3': '1.050', 'HITCOUNT': '1.860', 'weapon3': '2.448', 'DAMAGECOUNT': '7.785', 'FRAGCOUNT': '25.000'} [2023-02-24 20:29:20,964][213383] DAMAGECOUNT value on done: 30948.0 [2023-02-24 20:29:20,964][213383] Sum rewards: 23.861, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.380', 'AMMO5': '0.035', 'AMMO2': '0.042', 'AMMO3': '0.139', 'AMMO4': '0.209', 'weapon2': '0.404', 'weapon4': '0.408', 'WEAPON4': '0.500', 'weapon5': '0.672', 'WEAPON3': '0.900', 'WEAPON5': '0.900', 'HITCOUNT': '1.530', 'weapon3': '1.960', 'DAMAGECOUNT': '7.542', 'FRAGCOUNT': '23.000'} [2023-02-24 20:29:21,002][213367] DAMAGECOUNT value on done: 27050.0 [2023-02-24 20:29:21,002][213367] Sum rewards: 21.343, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.731', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.108', 'WEAPON5': '0.300', 'weapon5': '0.480', 'WEAPON3': '0.750', 'weapon2': '0.884', 'HITCOUNT': '1.260', 'weapon3': '2.208', 'DAMAGECOUNT': '5.802', 'FRAGCOUNT': '17.000'} [2023-02-24 20:29:21,029][213372] DAMAGECOUNT value on done: 29970.0 [2023-02-24 20:29:21,029][213372] Sum rewards: 17.137, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.019', 'AMMO2': '0.034', 'weapon7': '0.062', 'AMMO3': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.171', 'weapon5': '0.198', 'WEAPON4': '0.200', 'HEALTH': '0.240', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.564', 'weapon2': '1.140', 'HITCOUNT': '1.190', 'weapon3': '1.358', 'DAMAGECOUNT': '5.226', 'FRAGCOUNT': '13.000'} [2023-02-24 20:29:21,068][213382] DAMAGECOUNT value on done: 29371.0 [2023-02-24 20:29:21,069][213382] Sum rewards: 14.270, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.244', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.021', 'AMMO4': '0.102', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon5': '0.352', 'weapon2': '0.386', 'weapon4': '0.526', 'WEAPON3': '1.000', 'HITCOUNT': '1.410', 'weapon3': '2.250', 'DAMAGECOUNT': '5.010', 'FRAGCOUNT': '15.000'} [2023-02-24 20:29:21,184][213384] DAMAGECOUNT value on done: 26668.0 [2023-02-24 20:29:21,185][213384] Sum rewards: 16.739, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.110', 'AMMO2': '0.002', 'AMMO5': '0.010', 'AMMO4': '0.011', 'weapon4': '0.018', 'WEAPON4': '0.050', 'AMMO3': '0.179', 'WEAPON5': '0.300', 'weapon5': '0.400', 'weapon2': '0.714', 'WEAPON3': '1.250', 'HITCOUNT': '1.550', 'weapon3': '2.380', 'DAMAGECOUNT': '6.735', 'FRAGCOUNT': '16.000'} [2023-02-24 20:29:21,207][213366] DAMAGECOUNT value on done: 32057.0 [2023-02-24 20:29:21,208][213366] Sum rewards: 28.870, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.590', 'AMMO2': '0.012', 'AMMO5': '0.029', 'WEAPON1': '0.030', 'AMMO4': '0.058', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.151', 'weapon5': '0.558', 'weapon2': '0.586', 'WEAPON5': '0.850', 'WEAPON3': '1.000', 'HITCOUNT': '1.450', 'weapon3': '2.226', 'DAMAGECOUNT': '7.572', 'FRAGCOUNT': '25.000'} [2023-02-24 20:29:21,212][213368] DAMAGECOUNT value on done: 30331.0 [2023-02-24 20:29:21,212][213368] Sum rewards: 23.285, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.880', 'AMMO2': '0.007', 'AMMO5': '0.015', 'weapon4': '0.016', 'AMMO4': '0.035', 'AMMO3': '0.064', 'WEAPON4': '0.100', 'WEAPON3': '0.450', 'WEAPON5': '0.500', 'weapon5': '0.506', 'HITCOUNT': '1.040', 'weapon2': '1.316', 'weapon3': '1.602', 'DAMAGECOUNT': '5.763', 'FRAGCOUNT': '18.000'} [2023-02-24 20:29:21,269][213369] DAMAGECOUNT value on done: 28514.0 [2023-02-24 20:29:21,270][213369] Sum rewards: 22.961, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.381', 'AMMO2': '0.008', 'AMMO5': '0.014', 'AMMO4': '0.038', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.126', 'WEAPON5': '0.450', 'weapon5': '0.534', 'weapon2': '0.688', 'WEAPON3': '0.950', 'HITCOUNT': '1.540', 'weapon3': '2.240', 'DAMAGECOUNT': '6.810', 'FRAGCOUNT': '20.000'} [2023-02-24 20:29:21,306][213367] DAMAGECOUNT value on done: 25189.0 [2023-02-24 20:29:21,307][213367] Sum rewards: 29.800, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.022', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.021', 'AMMO4': '0.107', 'AMMO3': '0.150', 'weapon4': '0.154', 'WEAPON4': '0.200', 'weapon5': '0.298', 'WEAPON5': '0.450', 'weapon2': '0.588', 'WEAPON3': '1.000', 'HITCOUNT': '1.620', 'weapon3': '2.574', 'DAMAGECOUNT': '6.633', 'FRAGCOUNT': '27.000'} [2023-02-24 20:29:21,351][213372] DAMAGECOUNT value on done: 28241.0 [2023-02-24 20:29:21,351][213372] Sum rewards: 22.815, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.762', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.023', 'weapon7': '0.048', 'AMMO3': '0.060', 'AMMO4': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.432', 'WEAPON3': '0.450', 'weapon2': '0.750', 'HITCOUNT': '1.160', 'weapon3': '1.270', 'DAMAGECOUNT': '5.361', 'FRAGCOUNT': '20.000'} [2023-02-24 20:29:21,357][213383] DAMAGECOUNT value on done: 26999.0 [2023-02-24 20:29:21,357][213383] Sum rewards: 18.228, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.150', 'AMMO2': '0.010', 'AMMO5': '0.016', 'AMMO4': '0.048', 'AMMO3': '0.078', 'WEAPON5': '0.450', 'WEAPON3': '0.450', 'weapon5': '0.700', 'HITCOUNT': '0.830', 'weapon2': '0.902', 'weapon3': '1.662', 'DAMAGECOUNT': '4.482', 'FRAGCOUNT': '14.000'} [2023-02-24 20:29:21,374][213382] DAMAGECOUNT value on done: 29122.0 [2023-02-24 20:29:21,374][213382] Sum rewards: 22.609, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.610', 'AMMO5': '0.017', 'AMMO2': '0.021', 'AMMO3': '0.083', 'AMMO4': '0.105', 'WEAPON4': '0.350', 'weapon4': '0.478', 'WEAPON3': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.622', 'weapon5': '0.642', 'HITCOUNT': '1.060', 'weapon3': '1.586', 'DAMAGECOUNT': '5.004', 'FRAGCOUNT': '19.000'} [2023-02-24 20:29:21,489][213384] DAMAGECOUNT value on done: 32018.0 [2023-02-24 20:29:21,489][213384] Sum rewards: 15.353, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.489', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO5': '0.028', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.054', 'AMMO3': '0.148', 'weapon2': '0.374', 'WEAPON5': '0.550', 'weapon5': '0.626', 'WEAPON3': '0.850', 'HITCOUNT': '1.020', 'weapon3': '2.280', 'DAMAGECOUNT': '4.794', 'FRAGCOUNT': '14.000'} [2023-02-24 20:29:21,499][213366] DAMAGECOUNT value on done: 31214.0 [2023-02-24 20:29:21,499][213366] Sum rewards: 34.484, reward structure: {'DEATHCOUNT': '-7.500', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.032', 'AMMO3': '0.096', 'AMMO4': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'HEALTH': '0.380', 'weapon4': '0.410', 'WEAPON3': '0.550', 'weapon5': '0.572', 'weapon2': '0.628', 'weapon3': '1.906', 'HITCOUNT': '1.910', 'DAMAGECOUNT': '7.815', 'FRAGCOUNT': '27.000'} [2023-02-24 20:29:21,515][213368] DAMAGECOUNT value on done: 30197.0 [2023-02-24 20:29:21,516][213368] Sum rewards: 24.260, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.200', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.028', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.133', 'AMMO4': '0.137', 'weapon4': '0.270', 'WEAPON4': '0.350', 'weapon5': '0.460', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'weapon2': '0.968', 'HITCOUNT': '1.300', 'weapon3': '1.794', 'DAMAGECOUNT': '6.846', 'FRAGCOUNT': '22.000'} [2023-02-24 20:29:21,577][213369] DAMAGECOUNT value on done: 31921.0 [2023-02-24 20:29:21,577][213369] Sum rewards: 23.745, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.609', 'AMMO2': '0.007', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.035', 'weapon5': '0.102', 'AMMO3': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.186', 'WEAPON5': '0.300', 'WEAPON3': '0.800', 'weapon2': '1.042', 'HITCOUNT': '1.560', 'weapon3': '2.000', 'DAMAGECOUNT': '6.759', 'FRAGCOUNT': '21.000'} [2023-02-24 20:29:21,655][213372] DAMAGECOUNT value on done: 29311.0 [2023-02-24 20:29:21,656][213372] Sum rewards: 18.721, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.192', 'AMMO2': '0.013', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.074', 'weapon4': '0.252', 'WEAPON5': '0.450', 'weapon5': '0.450', 'WEAPON3': '0.550', 'weapon2': '0.830', 'HITCOUNT': '0.950', 'weapon3': '1.900', 'DAMAGECOUNT': '4.311', 'FRAGCOUNT': '16.000'} [2023-02-24 20:29:21,668][213383] DAMAGECOUNT value on done: 27055.0 [2023-02-24 20:29:21,669][213383] Sum rewards: 17.298, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.174', 'weapon7': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'AMMO3': '0.083', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.163', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.308', 'weapon4': '0.468', 'WEAPON3': '0.500', 'weapon2': '1.022', 'HITCOUNT': '1.060', 'weapon3': '1.666', 'DAMAGECOUNT': '4.188', 'FRAGCOUNT': '14.000'} [2023-02-24 20:29:21,676][213382] DAMAGECOUNT value on done: 30057.0 [2023-02-24 20:29:21,677][213382] Sum rewards: 16.707, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.532', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO4': '0.056', 'AMMO3': '0.091', 'WEAPON4': '0.150', 'weapon4': '0.222', 'weapon5': '0.540', 'WEAPON3': '0.550', 'WEAPON5': '0.600', 'HITCOUNT': '1.060', 'weapon2': '1.284', 'weapon3': '1.524', 'DAMAGECOUNT': '4.608', 'FRAGCOUNT': '14.000'} [2023-02-24 20:29:21,729][213368] DAMAGECOUNT value on done: 30757.0 [2023-02-24 20:29:21,729][213368] Sum rewards: 18.455, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.420', 'AMMO2': '0.006', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.031', 'weapon7': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.143', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.278', 'weapon5': '0.328', 'WEAPON5': '0.500', 'weapon2': '0.558', 'WEAPON3': '0.950', 'HITCOUNT': '1.270', 'weapon3': '1.966', 'DAMAGECOUNT': '5.355', 'FRAGCOUNT': '17.000'} [2023-02-24 20:29:21,799][213384] DAMAGECOUNT value on done: 27999.0 [2023-02-24 20:29:21,799][213384] Sum rewards: 16.069, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.560', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon7': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.132', 'AMMO4': '0.161', 'weapon5': '0.314', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.646', 'weapon2': '0.782', 'WEAPON3': '0.800', 'HITCOUNT': '1.260', 'weapon3': '1.404', 'DAMAGECOUNT': '5.715', 'FRAGCOUNT': '15.000'} [2023-02-24 20:29:21,807][213366] DAMAGECOUNT value on done: 24191.0 [2023-02-24 20:29:21,807][213366] Sum rewards: 23.225, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.986', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.033', 'AMMO3': '0.148', 'AMMO4': '0.162', 'WEAPON4': '0.200', 'weapon2': '0.352', 'weapon4': '0.358', 'weapon5': '0.512', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'HITCOUNT': '1.480', 'weapon3': '2.344', 'DAMAGECOUNT': '6.780', 'FRAGCOUNT': '21.000'} [2023-02-24 20:29:21,915][213369] DAMAGECOUNT value on done: 30208.0 [2023-02-24 20:29:21,915][213369] Sum rewards: 29.794, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.450', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO3': '0.199', 'weapon2': '0.238', 'WEAPON5': '0.450', 'weapon5': '0.492', 'WEAPON3': '1.350', 'HITCOUNT': '2.140', 'weapon3': '2.862', 'DAMAGECOUNT': '8.745', 'FRAGCOUNT': '27.000'} [2023-02-24 20:29:22,033][213368] DAMAGECOUNT value on done: 32198.0 [2023-02-24 20:29:22,034][213368] Sum rewards: 16.649, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.632', 'AMMO5': '0.014', 'AMMO2': '0.015', 'ARMOR': '0.044', 'AMMO4': '0.077', 'AMMO3': '0.157', 'weapon4': '0.258', 'weapon5': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.812', 'WEAPON3': '1.000', 'HITCOUNT': '1.270', 'weapon3': '2.102', 'DAMAGECOUNT': '6.114', 'FRAGCOUNT': '16.000'} [2023-02-24 20:29:22,217][213369] DAMAGECOUNT value on done: 27215.0 [2023-02-24 20:29:22,217][213369] Sum rewards: 18.223, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.910', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.010', 'AMMO3': '0.127', 'WEAPON5': '0.300', 'weapon5': '0.314', 'weapon2': '0.924', 'WEAPON3': '0.950', 'HITCOUNT': '1.320', 'weapon3': '2.314', 'DAMAGECOUNT': '5.415', 'FRAGCOUNT': '16.000'} [2023-02-24 20:29:22,352][213365] Updated weights for policy 0, policy_version 25336 (0.0009) [2023-02-24 20:29:25,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13926.4, 300 sec: 13837.0). Total num frames: 103813120. Throughput: 0: 3478.8. Samples: 946034. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:29:25,243][213332] Avg episode reward: [(0, '22.007')] [2023-02-24 20:29:25,285][213365] Updated weights for policy 0, policy_version 25346 (0.0009) [2023-02-24 20:29:28,222][213365] Updated weights for policy 0, policy_version 25356 (0.0009) [2023-02-24 20:29:30,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13926.4, 300 sec: 13838.6). Total num frames: 103882752. Throughput: 0: 3482.3. Samples: 966986. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:29:30,243][213332] Avg episode reward: [(0, '22.007')] [2023-02-24 20:29:31,157][213365] Updated weights for policy 0, policy_version 25366 (0.0009) [2023-02-24 20:29:34,199][213365] Updated weights for policy 0, policy_version 25376 (0.0009) [2023-02-24 20:29:35,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13840.2). Total num frames: 103952384. Throughput: 0: 3480.0. Samples: 977422. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:29:35,243][213332] Avg episode reward: [(0, '22.007')] [2023-02-24 20:29:37,164][213365] Updated weights for policy 0, policy_version 25386 (0.0009) [2023-02-24 20:29:39,846][213367] DAMAGECOUNT value on done: 28147.0 [2023-02-24 20:29:39,847][213367] Sum rewards: 33.966, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.015', 'AMMO2': '0.026', 'HEALTH': '0.102', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'weapon4': '0.208', 'weapon5': '0.298', 'WEAPON5': '0.300', 'weapon2': '0.596', 'WEAPON3': '0.900', 'HITCOUNT': '2.170', 'weapon3': '2.558', 'DAMAGECOUNT': '8.850', 'FRAGCOUNT': '28.000'} [2023-02-24 20:29:40,076][213365] Updated weights for policy 0, policy_version 25396 (0.0009) [2023-02-24 20:29:40,129][213383] DAMAGECOUNT value on done: 32291.0 [2023-02-24 20:29:40,129][213383] Sum rewards: 30.868, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.615', 'AMMO2': '0.012', 'AMMO5': '0.019', 'weapon4': '0.020', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.155', 'WEAPON5': '0.550', 'weapon5': '0.632', 'weapon2': '0.676', 'WEAPON3': '0.950', 'HITCOUNT': '1.710', 'weapon3': '2.088', 'DAMAGECOUNT': '8.511', 'FRAGCOUNT': '26.000'} [2023-02-24 20:29:40,144][213367] DAMAGECOUNT value on done: 34200.0 [2023-02-24 20:29:40,145][213367] Sum rewards: 19.888, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.882', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.034', 'weapon7': '0.096', 'AMMO3': '0.133', 'AMMO4': '0.169', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'weapon5': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.466', 'WEAPON3': '0.750', 'weapon2': '0.758', 'HITCOUNT': '1.390', 'weapon3': '1.686', 'DAMAGECOUNT': '6.471', 'FRAGCOUNT': '17.000'} [2023-02-24 20:29:40,227][213372] DAMAGECOUNT value on done: 28582.0 [2023-02-24 20:29:40,228][213372] Sum rewards: 23.406, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.140', 'AMMO5': '0.018', 'AMMO2': '0.030', 'AMMO3': '0.112', 'AMMO4': '0.150', 'weapon5': '0.260', 'weapon2': '0.278', 'WEAPON5': '0.350', 'ARMOR': '0.493', 'WEAPON4': '0.500', 'WEAPON3': '0.700', 'weapon4': '0.744', 'HITCOUNT': '1.570', 'weapon3': '1.690', 'DAMAGECOUNT': '5.901', 'FRAGCOUNT': '20.000'} [2023-02-24 20:29:40,229][213382] DAMAGECOUNT value on done: 30216.0 [2023-02-24 20:29:40,230][213382] Sum rewards: 17.236, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.736', 'AMMO2': '0.006', 'AMMO5': '0.020', 'AMMO4': '0.029', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon4': '0.260', 'weapon5': '0.328', 'ARMOR': '0.468', 'WEAPON5': '0.500', 'weapon2': '1.008', 'WEAPON3': '1.300', 'HITCOUNT': '1.330', 'weapon3': '2.038', 'DAMAGECOUNT': '6.228', 'FRAGCOUNT': '18.000'} [2023-02-24 20:29:40,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13841.7). Total num frames: 104022016. Throughput: 0: 3469.1. Samples: 997966. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:29:40,243][213332] Avg episode reward: [(0, '22.077')] [2023-02-24 20:29:40,266][213366] DAMAGECOUNT value on done: 30969.0 [2023-02-24 20:29:40,266][213366] Sum rewards: 36.689, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.587', 'AMMO2': '0.006', 'AMMO5': '0.018', 'AMMO4': '0.027', 'AMMO3': '0.082', 'weapon5': '0.444', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon2': '0.770', 'HITCOUNT': '1.790', 'weapon3': '2.324', 'DAMAGECOUNT': '9.015', 'FRAGCOUNT': '27.000'} [2023-02-24 20:29:40,357][213367] DAMAGECOUNT value on done: 29261.0 [2023-02-24 20:29:40,358][213367] Sum rewards: 25.744, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.726', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon7': '0.048', 'AMMO4': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.130', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.250', 'weapon5': '0.254', 'weapon4': '0.598', 'WEAPON3': '0.800', 'HITCOUNT': '1.700', 'weapon3': '1.770', 'DAMAGECOUNT': '6.633', 'FRAGCOUNT': '23.000'} [2023-02-24 20:29:40,380][213384] DAMAGECOUNT value on done: 32320.0 [2023-02-24 20:29:40,381][213384] Sum rewards: 30.079, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.030', 'AMMO2': '0.008', 'AMMO5': '0.009', 'AMMO4': '0.042', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.330', 'weapon4': '0.380', 'weapon2': '0.756', 'WEAPON3': '1.150', 'HITCOUNT': '1.810', 'weapon3': '2.250', 'DAMAGECOUNT': '8.001', 'FRAGCOUNT': '28.000'} [2023-02-24 20:29:40,435][213383] DAMAGECOUNT value on done: 33908.0 [2023-02-24 20:29:40,435][213383] Sum rewards: 34.160, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.249', 'AMMO5': '0.022', 'AMMO2': '0.025', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'weapon5': '0.174', 'AMMO3': '0.186', 'weapon4': '0.318', 'WEAPON5': '0.450', 'weapon2': '0.534', 'WEAPON3': '1.100', 'HITCOUNT': '2.120', 'weapon3': '2.576', 'DAMAGECOUNT': '8.880', 'FRAGCOUNT': '30.000'} [2023-02-24 20:29:40,530][213372] DAMAGECOUNT value on done: 32171.0 [2023-02-24 20:29:40,530][213372] Sum rewards: 16.536, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.754', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO5': '0.024', 'AMMO4': '0.074', 'AMMO3': '0.174', 'WEAPON4': '0.300', 'weapon5': '0.382', 'weapon4': '0.440', 'WEAPON5': '0.500', 'weapon2': '0.532', 'WEAPON3': '1.050', 'HITCOUNT': '1.560', 'weapon3': '2.126', 'DAMAGECOUNT': '6.603', 'FRAGCOUNT': '18.000'} [2023-02-24 20:29:40,538][213382] DAMAGECOUNT value on done: 31799.0 [2023-02-24 20:29:40,539][213382] Sum rewards: 29.634, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.150', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO2': '0.039', 'AMMO3': '0.064', 'AMMO4': '0.197', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.452', 'weapon4': '0.458', 'weapon5': '0.470', 'WEAPON5': '0.550', 'weapon2': '0.730', 'HITCOUNT': '1.370', 'weapon3': '1.774', 'DAMAGECOUNT': '7.284', 'FRAGCOUNT': '24.000'} [2023-02-24 20:29:40,572][213366] DAMAGECOUNT value on done: 33663.0 [2023-02-24 20:29:40,573][213366] Sum rewards: 19.267, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.132', 'AMMO2': '0.009', 'AMMO5': '0.020', 'AMMO4': '0.044', 'AMMO3': '0.068', 'WEAPON4': '0.300', 'weapon4': '0.318', 'WEAPON3': '0.500', 'WEAPON5': '0.600', 'weapon5': '0.614', 'weapon2': '0.954', 'HITCOUNT': '1.120', 'weapon3': '1.784', 'DAMAGECOUNT': '4.818', 'FRAGCOUNT': '16.000'} [2023-02-24 20:29:40,579][213368] DAMAGECOUNT value on done: 32364.0 [2023-02-24 20:29:40,580][213368] Sum rewards: 18.134, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.720', 'AMMO2': '0.013', 'AMMO5': '0.020', 'AMMO4': '0.065', 'WEAPON4': '0.150', 'weapon4': '0.190', 'AMMO3': '0.195', 'WEAPON5': '0.500', 'weapon2': '0.506', 'weapon5': '0.546', 'WEAPON3': '1.150', 'HITCOUNT': '1.440', 'weapon3': '2.230', 'DAMAGECOUNT': '6.099', 'FRAGCOUNT': '18.000'} [2023-02-24 20:29:40,664][213367] DAMAGECOUNT value on done: 27656.0 [2023-02-24 20:29:40,665][213367] Sum rewards: 27.446, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.355', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.132', 'AMMO3': '0.178', 'WEAPON4': '0.300', 'weapon2': '0.314', 'WEAPON5': '0.350', 'weapon5': '0.362', 'weapon4': '0.570', 'WEAPON3': '1.100', 'HITCOUNT': '1.700', 'weapon3': '2.358', 'DAMAGECOUNT': '7.401', 'FRAGCOUNT': '26.000'} [2023-02-24 20:29:40,685][213384] DAMAGECOUNT value on done: 28800.0 [2023-02-24 20:29:40,685][213384] Sum rewards: 27.966, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.224', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.029', 'AMMO3': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.300', 'weapon4': '0.306', 'weapon5': '0.346', 'WEAPON3': '0.500', 'weapon2': '1.194', 'HITCOUNT': '1.550', 'weapon3': '1.632', 'DAMAGECOUNT': '6.396', 'FRAGCOUNT': '21.000'} [2023-02-24 20:29:40,726][213369] DAMAGECOUNT value on done: 31626.0 [2023-02-24 20:29:40,727][213369] Sum rewards: 31.343, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.137', 'AMMO5': '0.022', 'AMMO2': '0.031', 'AMMO4': '0.155', 'AMMO3': '0.163', 'weapon4': '0.330', 'weapon5': '0.342', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.550', 'WEAPON3': '0.950', 'HITCOUNT': '2.220', 'weapon3': '2.330', 'DAMAGECOUNT': '9.336', 'FRAGCOUNT': '28.000'} [2023-02-24 20:29:40,830][213383] DAMAGECOUNT value on done: 29698.0 [2023-02-24 20:29:40,831][213383] Sum rewards: 27.411, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.254', 'AMMO2': '0.033', 'AMMO5': '0.034', 'AMMO3': '0.145', 'AMMO4': '0.166', 'WEAPON4': '0.250', 'weapon2': '0.492', 'weapon4': '0.518', 'weapon5': '0.524', 'WEAPON5': '0.700', 'WEAPON3': '1.000', 'HITCOUNT': '1.710', 'weapon3': '1.996', 'DAMAGECOUNT': '8.097', 'FRAGCOUNT': '26.000'} [2023-02-24 20:29:40,836][213372] DAMAGECOUNT value on done: 30562.0 [2023-02-24 20:29:40,836][213372] Sum rewards: 24.425, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.230', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'AMMO3': '0.100', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.254', 'WEAPON5': '0.300', 'weapon5': '0.580', 'WEAPON3': '0.600', 'weapon2': '0.622', 'HITCOUNT': '1.710', 'weapon3': '1.972', 'DAMAGECOUNT': '6.963', 'FRAGCOUNT': '19.500'} [2023-02-24 20:29:40,839][213382] DAMAGECOUNT value on done: 32402.0 [2023-02-24 20:29:40,840][213382] Sum rewards: 32.704, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.125', 'AMMO5': '0.019', 'AMMO2': '0.039', 'AMMO4': '0.193', 'AMMO3': '0.194', 'weapon2': '0.314', 'weapon4': '0.342', 'WEAPON4': '0.400', 'weapon5': '0.402', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.190', 'weapon3': '2.446', 'DAMAGECOUNT': '9.840', 'FRAGCOUNT': '32.000'} [2023-02-24 20:29:40,868][213366] DAMAGECOUNT value on done: 33798.0 [2023-02-24 20:29:40,869][213366] Sum rewards: 28.337, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.772', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.018', 'weapon4': '0.060', 'weapon7': '0.080', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.145', 'WEAPON7': '0.200', 'weapon5': '0.262', 'WEAPON5': '0.300', 'weapon2': '0.918', 'WEAPON3': '0.950', 'HITCOUNT': '1.450', 'weapon3': '2.120', 'DAMAGECOUNT': '7.752', 'FRAGCOUNT': '23.000'} [2023-02-24 20:29:40,880][213368] DAMAGECOUNT value on done: 32449.0 [2023-02-24 20:29:40,880][213368] Sum rewards: 21.728, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.356', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO5': '0.024', 'AMMO4': '0.081', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon5': '0.306', 'weapon4': '0.418', 'WEAPON5': '0.500', 'weapon2': '0.738', 'WEAPON3': '1.050', 'HITCOUNT': '1.630', 'weapon3': '2.170', 'DAMAGECOUNT': '6.756', 'FRAGCOUNT': '19.500'} [2023-02-24 20:29:40,996][213384] DAMAGECOUNT value on done: 34853.0 [2023-02-24 20:29:40,996][213384] Sum rewards: 23.376, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.548', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.110', 'AMMO4': '0.163', 'AMMO3': '0.174', 'WEAPON4': '0.300', 'weapon5': '0.382', 'WEAPON5': '0.400', 'weapon2': '0.474', 'WEAPON3': '1.100', 'HITCOUNT': '1.700', 'weapon3': '2.558', 'DAMAGECOUNT': '8.505', 'FRAGCOUNT': '22.500'} [2023-02-24 20:29:41,042][213369] DAMAGECOUNT value on done: 34622.0 [2023-02-24 20:29:41,042][213369] Sum rewards: 26.152, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.671', 'AMMO5': '0.017', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.166', 'weapon4': '0.262', 'WEAPON4': '0.300', 'weapon5': '0.472', 'WEAPON5': '0.500', 'weapon2': '0.820', 'WEAPON3': '1.000', 'HITCOUNT': '1.710', 'weapon3': '2.062', 'DAMAGECOUNT': '8.103', 'FRAGCOUNT': '22.000'} [2023-02-24 20:29:41,109][213368] DAMAGECOUNT value on done: 32272.0 [2023-02-24 20:29:41,109][213368] Sum rewards: 17.641, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.424', 'AMMO2': '0.016', 'AMMO5': '0.017', 'AMMO4': '0.080', 'AMMO3': '0.114', 'weapon5': '0.384', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon2': '0.972', 'HITCOUNT': '0.990', 'weapon3': '2.106', 'DAMAGECOUNT': '4.335', 'FRAGCOUNT': '14.000'} [2023-02-24 20:29:41,130][213383] DAMAGECOUNT value on done: 29181.0 [2023-02-24 20:29:41,130][213383] Sum rewards: 24.320, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.669', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.106', 'weapon4': '0.252', 'weapon2': '0.356', 'WEAPON5': '0.400', 'weapon5': '0.490', 'WEAPON3': '0.650', 'HITCOUNT': '1.230', 'weapon3': '2.230', 'DAMAGECOUNT': '6.378', 'FRAGCOUNT': '18.000'} [2023-02-24 20:29:41,152][213372] DAMAGECOUNT value on done: 32141.0 [2023-02-24 20:29:41,152][213372] Sum rewards: 32.431, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.425', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.110', 'WEAPON4': '0.300', 'weapon4': '0.482', 'weapon5': '0.498', 'weapon2': '0.574', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'weapon3': '1.814', 'HITCOUNT': '1.930', 'DAMAGECOUNT': '8.490', 'FRAGCOUNT': '25.000'} [2023-02-24 20:29:41,154][213382] DAMAGECOUNT value on done: 32282.0 [2023-02-24 20:29:41,155][213382] Sum rewards: 26.498, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.625', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO3': '0.172', 'weapon5': '0.270', 'WEAPON5': '0.400', 'weapon2': '0.744', 'WEAPON3': '1.150', 'HITCOUNT': '1.630', 'weapon3': '2.596', 'DAMAGECOUNT': '6.675', 'FRAGCOUNT': '25.000'} [2023-02-24 20:29:41,181][213366] DAMAGECOUNT value on done: 26771.0 [2023-02-24 20:29:41,182][213366] Sum rewards: 28.533, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.360', 'AMMO2': '0.012', 'AMMO5': '0.012', 'AMMO4': '0.062', 'AMMO3': '0.090', 'WEAPON4': '0.250', 'weapon4': '0.344', 'WEAPON5': '0.400', 'weapon5': '0.460', 'WEAPON3': '0.550', 'weapon2': '0.688', 'HITCOUNT': '1.580', 'weapon3': '1.954', 'DAMAGECOUNT': '7.740', 'FRAGCOUNT': '23.000'} [2023-02-24 20:29:41,286][213384] DAMAGECOUNT value on done: 30156.0 [2023-02-24 20:29:41,286][213384] Sum rewards: 22.946, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.858', 'AMMO2': '0.016', 'AMMO5': '0.022', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.133', 'weapon4': '0.160', 'weapon5': '0.406', 'WEAPON5': '0.450', 'weapon2': '0.604', 'WEAPON3': '0.850', 'HITCOUNT': '1.240', 'weapon3': '2.274', 'DAMAGECOUNT': '6.471', 'FRAGCOUNT': '20.000'} [2023-02-24 20:29:41,385][213369] DAMAGECOUNT value on done: 32222.0 [2023-02-24 20:29:41,386][213369] Sum rewards: 21.845, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.289', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO5': '0.017', 'AMMO4': '0.033', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'weapon5': '0.264', 'WEAPON5': '0.450', 'weapon4': '0.524', 'WEAPON3': '0.700', 'weapon2': '0.756', 'HITCOUNT': '1.590', 'weapon3': '1.996', 'DAMAGECOUNT': '6.042', 'FRAGCOUNT': '18.000'} [2023-02-24 20:29:41,406][213368] DAMAGECOUNT value on done: 34134.0 [2023-02-24 20:29:41,407][213368] Sum rewards: 15.792, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.582', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon7': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.130', 'AMMO3': '0.132', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'WEAPON4': '0.350', 'weapon4': '0.600', 'weapon2': '0.648', 'WEAPON3': '0.900', 'HITCOUNT': '1.510', 'weapon3': '1.746', 'DAMAGECOUNT': '5.793', 'FRAGCOUNT': '16.000'} [2023-02-24 20:29:41,689][213369] DAMAGECOUNT value on done: 30110.0 [2023-02-24 20:29:41,690][213369] Sum rewards: 31.970, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.795', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO3': '0.121', 'AMMO4': '0.146', 'weapon2': '0.184', 'weapon5': '0.304', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.778', 'WEAPON3': '0.900', 'HITCOUNT': '2.070', 'weapon3': '2.236', 'DAMAGECOUNT': '8.685', 'FRAGCOUNT': '25.000'} [2023-02-24 20:29:42,108][213367] Large shaping reward 2.619 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0)] [2023-02-24 20:29:43,065][213365] Updated weights for policy 0, policy_version 25406 (0.0009) [2023-02-24 20:29:45,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13843.1). Total num frames: 104091648. Throughput: 0: 3465.3. Samples: 1018674. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:29:45,243][213332] Avg episode reward: [(0, '23.290')] [2023-02-24 20:29:45,247][213352] Saving new best policy, reward=23.290! [2023-02-24 20:29:45,999][213365] Updated weights for policy 0, policy_version 25416 (0.0009) [2023-02-24 20:29:48,940][213365] Updated weights for policy 0, policy_version 25426 (0.0009) [2023-02-24 20:29:50,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13968.1). Total num frames: 104161280. Throughput: 0: 3469.1. Samples: 1029118. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:29:50,243][213332] Avg episode reward: [(0, '23.290')] [2023-02-24 20:29:51,919][213365] Updated weights for policy 0, policy_version 25436 (0.0009) [2023-02-24 20:29:54,879][213365] Updated weights for policy 0, policy_version 25446 (0.0009) [2023-02-24 20:29:55,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13968.1). Total num frames: 104230912. Throughput: 0: 3467.2. Samples: 1049942. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:29:55,243][213332] Avg episode reward: [(0, '23.290')] [2023-02-24 20:29:56,098][213384] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 20:29:57,840][213365] Updated weights for policy 0, policy_version 25456 (0.0009) [2023-02-24 20:29:59,128][213367] DAMAGECOUNT value on done: 30931.0 [2023-02-24 20:29:59,128][213367] Sum rewards: 30.129, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.149', 'AMMO2': '0.001', 'ARMOR': '0.004', 'AMMO4': '0.005', 'AMMO5': '0.020', 'weapon7': '0.022', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.332', 'weapon4': '0.334', 'WEAPON5': '0.450', 'weapon2': '0.494', 'WEAPON3': '0.950', 'HITCOUNT': '1.830', 'weapon3': '2.074', 'DAMAGECOUNT': '8.352', 'FRAGCOUNT': '26.000'} [2023-02-24 20:29:59,422][213367] DAMAGECOUNT value on done: 36517.0 [2023-02-24 20:29:59,423][213367] Sum rewards: 24.267, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.975', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.021', 'weapon7': '0.048', 'AMMO4': '0.105', 'AMMO3': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.520', 'WEAPON3': '0.650', 'weapon2': '1.036', 'HITCOUNT': '1.290', 'weapon3': '1.696', 'DAMAGECOUNT': '6.576', 'FRAGCOUNT': '20.000'} [2023-02-24 20:29:59,484][213383] DAMAGECOUNT value on done: 34259.0 [2023-02-24 20:29:59,485][213383] Sum rewards: 25.484, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.907', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.078', 'AMMO3': '0.085', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.260', 'weapon2': '0.422', 'WEAPON3': '0.550', 'weapon5': '0.730', 'HITCOUNT': '1.220', 'weapon3': '1.946', 'DAMAGECOUNT': '5.904', 'FRAGCOUNT': '20.000'} [2023-02-24 20:29:59,539][213382] DAMAGECOUNT value on done: 32095.0 [2023-02-24 20:29:59,540][213382] Sum rewards: 10.434, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.850', 'AMMO2': '0.021', 'AMMO5': '0.022', 'AMMO4': '0.104', 'AMMO3': '0.132', 'WEAPON4': '0.250', 'weapon4': '0.268', 'weapon5': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'weapon2': '0.832', 'HITCOUNT': '1.390', 'weapon3': '2.028', 'DAMAGECOUNT': '5.637', 'FRAGCOUNT': '10.000'} [2023-02-24 20:29:59,600][213372] DAMAGECOUNT value on done: 30335.0 [2023-02-24 20:29:59,601][213372] Sum rewards: 16.690, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.822', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'AMMO3': '0.132', 'weapon5': '0.142', 'AMMO4': '0.176', 'weapon2': '0.384', 'WEAPON4': '0.400', 'weapon4': '0.702', 'WEAPON3': '0.750', 'HITCOUNT': '1.400', 'weapon3': '1.764', 'DAMAGECOUNT': '5.259', 'FRAGCOUNT': '16.000'} [2023-02-24 20:29:59,652][213367] DAMAGECOUNT value on done: 31303.0 [2023-02-24 20:29:59,652][213367] Sum rewards: 21.416, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.700', 'AMMO5': '0.017', 'AMMO2': '0.026', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'AMMO4': '0.128', 'weapon4': '0.248', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'weapon5': '0.710', 'weapon2': '0.752', 'HITCOUNT': '1.200', 'weapon3': '1.682', 'DAMAGECOUNT': '6.126', 'FRAGCOUNT': '16.000'} [2023-02-24 20:29:59,700][213366] DAMAGECOUNT value on done: 33765.0 [2023-02-24 20:29:59,701][213366] Sum rewards: 24.277, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.403', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.042', 'AMMO3': '0.142', 'AMMO4': '0.210', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.514', 'weapon5': '0.624', 'weapon4': '0.768', 'WEAPON3': '0.800', 'weapon3': '1.628', 'HITCOUNT': '1.940', 'DAMAGECOUNT': '8.388', 'FRAGCOUNT': '22.500'} [2023-02-24 20:29:59,761][213384] DAMAGECOUNT value on done: 34671.0 [2023-02-24 20:29:59,761][213384] Sum rewards: 23.619, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.018', 'AMMO3': '0.143', 'HEALTH': '0.344', 'WEAPON5': '0.400', 'weapon5': '0.448', 'weapon2': '0.528', 'WEAPON3': '0.800', 'HITCOUNT': '1.770', 'weapon3': '2.610', 'DAMAGECOUNT': '7.053', 'FRAGCOUNT': '18.500'} [2023-02-24 20:29:59,796][213383] DAMAGECOUNT value on done: 36325.0 [2023-02-24 20:29:59,797][213383] Sum rewards: 26.792, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.847', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO2': '0.049', 'AMMO3': '0.106', 'AMMO4': '0.245', 'WEAPON4': '0.250', 'weapon4': '0.492', 'WEAPON5': '0.600', 'weapon5': '0.604', 'WEAPON3': '0.650', 'weapon2': '0.876', 'HITCOUNT': '1.460', 'weapon3': '1.510', 'DAMAGECOUNT': '7.251', 'FRAGCOUNT': '21.000'} [2023-02-24 20:29:59,843][213382] DAMAGECOUNT value on done: 33547.0 [2023-02-24 20:29:59,843][213382] Sum rewards: 12.608, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.630', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO3': '0.085', 'AMMO4': '0.203', 'weapon5': '0.306', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'WEAPON4': '0.550', 'weapon4': '0.612', 'HITCOUNT': '1.380', 'weapon3': '1.388', 'weapon2': '1.414', 'DAMAGECOUNT': '5.244', 'FRAGCOUNT': '12.500'} [2023-02-24 20:29:59,889][213372] DAMAGECOUNT value on done: 33942.0 [2023-02-24 20:29:59,889][213372] Sum rewards: 15.509, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.546', 'AMMO2': '0.015', 'AMMO5': '0.017', 'AMMO4': '0.075', 'weapon4': '0.078', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'weapon5': '0.340', 'WEAPON5': '0.400', 'weapon2': '0.886', 'WEAPON3': '0.950', 'HITCOUNT': '1.360', 'weapon3': '2.068', 'DAMAGECOUNT': '5.313', 'FRAGCOUNT': '15.000'} [2023-02-24 20:29:59,958][213367] DAMAGECOUNT value on done: 29795.0 [2023-02-24 20:29:59,959][213367] Sum rewards: 19.201, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.659', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.034', 'AMMO3': '0.148', 'AMMO4': '0.170', 'weapon2': '0.184', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.382', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon5': '0.522', 'WEAPON3': '0.950', 'HITCOUNT': '1.460', 'weapon3': '2.318', 'DAMAGECOUNT': '6.372', 'FRAGCOUNT': '19.000'} [2023-02-24 20:29:59,995][213368] DAMAGECOUNT value on done: 34924.0 [2023-02-24 20:29:59,996][213368] Sum rewards: 23.952, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.084', 'AMMO5': '0.026', 'AMMO2': '0.049', 'AMMO3': '0.128', 'weapon4': '0.194', 'AMMO4': '0.246', 'WEAPON4': '0.450', 'weapon5': '0.604', 'WEAPON5': '0.650', 'WEAPON3': '0.750', 'weapon2': '0.800', 'HITCOUNT': '1.310', 'weapon3': '1.898', 'DAMAGECOUNT': '7.680', 'FRAGCOUNT': '23.000'} [2023-02-24 20:29:59,998][213366] DAMAGECOUNT value on done: 35387.0 [2023-02-24 20:29:59,999][213366] Sum rewards: 17.013, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.672', 'ARMOR': '0.004', 'AMMO2': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.052', 'weapon7': '0.054', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.278', 'WEAPON5': '0.350', 'weapon4': '0.534', 'WEAPON3': '0.800', 'weapon2': '0.908', 'HITCOUNT': '1.200', 'weapon3': '1.794', 'DAMAGECOUNT': '5.172', 'FRAGCOUNT': '15.000'} [2023-02-24 20:30:00,067][213384] DAMAGECOUNT value on done: 31376.0 [2023-02-24 20:30:00,067][213384] Sum rewards: 25.940, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.246', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO5': '0.020', 'AMMO4': '0.083', 'AMMO3': '0.130', 'weapon4': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.500', 'weapon5': '0.586', 'weapon2': '0.590', 'WEAPON3': '0.750', 'HITCOUNT': '1.690', 'weapon3': '2.222', 'DAMAGECOUNT': '7.728', 'FRAGCOUNT': '22.000'} [2023-02-24 20:30:00,156][213369] DAMAGECOUNT value on done: 33665.0 [2023-02-24 20:30:00,157][213369] Sum rewards: 19.226, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.042', 'AMMO5': '0.019', 'AMMO2': '0.025', 'AMMO3': '0.095', 'AMMO4': '0.124', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.262', 'weapon5': '0.292', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon2': '0.998', 'HITCOUNT': '1.400', 'weapon3': '1.786', 'DAMAGECOUNT': '6.117', 'FRAGCOUNT': '16.000'} [2023-02-24 20:30:00,167][213382] DAMAGECOUNT value on done: 34423.0 [2023-02-24 20:30:00,169][213382] Sum rewards: 18.073, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.400', 'ARMOR': '0.004', 'AMMO2': '0.011', 'AMMO5': '0.012', 'weapon7': '0.048', 'AMMO4': '0.056', 'AMMO3': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.212', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.520', 'WEAPON3': '0.600', 'HITCOUNT': '1.200', 'weapon3': '1.246', 'DAMAGECOUNT': '6.063', 'FRAGCOUNT': '15.000'} [2023-02-24 20:30:00,199][213372] DAMAGECOUNT value on done: 33032.0 [2023-02-24 20:30:00,200][213372] Sum rewards: 27.452, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.296', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.092', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.108', 'WEAPON5': '0.350', 'weapon5': '0.434', 'WEAPON3': '0.700', 'weapon2': '1.086', 'HITCOUNT': '1.820', 'weapon3': '2.008', 'DAMAGECOUNT': '7.410', 'FRAGCOUNT': '22.000'} [2023-02-24 20:30:00,210][213383] DAMAGECOUNT value on done: 31700.0 [2023-02-24 20:30:00,210][213383] Sum rewards: 16.532, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.980', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'weapon4': '0.032', 'AMMO4': '0.086', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'weapon5': '0.402', 'WEAPON5': '0.650', 'weapon2': '0.920', 'WEAPON3': '1.150', 'HITCOUNT': '1.350', 'weapon3': '2.170', 'DAMAGECOUNT': '6.006', 'FRAGCOUNT': '19.000'} [2023-02-24 20:30:00,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13968.1). Total num frames: 104300544. Throughput: 0: 3465.6. Samples: 1070806. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:30:00,243][213332] Avg episode reward: [(0, '23.054')] [2023-02-24 20:30:00,291][213366] DAMAGECOUNT value on done: 36375.0 [2023-02-24 20:30:00,291][213366] Sum rewards: 25.232, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.572', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO5': '0.018', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.112', 'AMMO3': '0.151', 'weapon5': '0.428', 'WEAPON5': '0.450', 'weapon2': '0.520', 'WEAPON3': '1.000', 'HITCOUNT': '1.900', 'weapon3': '2.404', 'DAMAGECOUNT': '7.731', 'FRAGCOUNT': '21.000'} [2023-02-24 20:30:00,297][213368] DAMAGECOUNT value on done: 34952.0 [2023-02-24 20:30:00,298][213368] Sum rewards: 25.146, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.380', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon7': '0.048', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.123', 'AMMO4': '0.128', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.334', 'weapon4': '0.368', 'weapon2': '0.438', 'WEAPON3': '0.800', 'HITCOUNT': '1.610', 'weapon3': '2.360', 'DAMAGECOUNT': '7.089', 'FRAGCOUNT': '22.000'} [2023-02-24 20:30:00,368][213384] DAMAGECOUNT value on done: 37993.0 [2023-02-24 20:30:00,368][213384] Sum rewards: 34.180, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.060', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'weapon4': '0.024', 'WEAPON4': '0.050', 'AMMO3': '0.159', 'WEAPON5': '0.450', 'weapon5': '0.572', 'weapon2': '0.596', 'WEAPON3': '1.100', 'HITCOUNT': '2.260', 'weapon3': '2.338', 'DAMAGECOUNT': '9.420', 'FRAGCOUNT': '29.000'} [2023-02-24 20:30:00,452][213369] DAMAGECOUNT value on done: 36701.0 [2023-02-24 20:30:00,452][213369] Sum rewards: 19.291, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.372', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.027', 'AMMO3': '0.075', 'AMMO4': '0.135', 'weapon4': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon5': '0.588', 'weapon2': '0.774', 'HITCOUNT': '1.290', 'weapon3': '1.886', 'DAMAGECOUNT': '5.817', 'FRAGCOUNT': '16.000'} [2023-02-24 20:30:00,469][213382] DAMAGECOUNT value on done: 35440.0 [2023-02-24 20:30:00,469][213382] Sum rewards: 30.979, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.410', 'ARMOR': '0.004', 'AMMO2': '0.019', 'AMMO5': '0.020', 'AMMO4': '0.093', 'AMMO3': '0.159', 'WEAPON4': '0.300', 'weapon2': '0.404', 'weapon4': '0.412', 'weapon5': '0.434', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'HITCOUNT': '2.050', 'weapon3': '2.370', 'DAMAGECOUNT': '9.474', 'FRAGCOUNT': '28.000'} [2023-02-24 20:30:00,503][213372] DAMAGECOUNT value on done: 34764.0 [2023-02-24 20:30:00,503][213383] DAMAGECOUNT value on done: 31666.0 [2023-02-24 20:30:00,504][213383] Sum rewards: 27.896, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.585', 'AMMO5': '0.010', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.051', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.140', 'WEAPON5': '0.300', 'weapon5': '0.416', 'weapon2': '0.640', 'WEAPON3': '0.950', 'HITCOUNT': '1.820', 'weapon3': '2.486', 'DAMAGECOUNT': '7.455', 'FRAGCOUNT': '24.000'} [2023-02-24 20:30:00,504][213372] Sum rewards: 26.246, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.856', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.040', 'AMMO3': '0.139', 'AMMO4': '0.201', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon5': '0.524', 'weapon2': '0.528', 'weapon4': '0.560', 'WEAPON3': '0.850', 'HITCOUNT': '1.710', 'weapon3': '1.756', 'DAMAGECOUNT': '7.869', 'FRAGCOUNT': '24.000'} [2023-02-24 20:30:00,516][213368] DAMAGECOUNT value on done: 34007.0 [2023-02-24 20:30:00,517][213368] Sum rewards: 19.807, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.920', 'AMMO2': '0.011', 'AMMO5': '0.023', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'weapon4': '0.116', 'AMMO3': '0.139', 'weapon2': '0.496', 'WEAPON5': '0.600', 'weapon5': '0.744', 'WEAPON3': '0.950', 'HITCOUNT': '1.320', 'weapon3': '2.216', 'DAMAGECOUNT': '5.205', 'FRAGCOUNT': '18.000'} [2023-02-24 20:30:00,596][213366] DAMAGECOUNT value on done: 29586.0 [2023-02-24 20:30:00,597][213366] Sum rewards: 24.782, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.128', 'AMMO5': '0.021', 'AMMO2': '0.037', 'weapon4': '0.058', 'AMMO3': '0.129', 'AMMO4': '0.187', 'WEAPON4': '0.200', 'weapon5': '0.324', 'WEAPON5': '0.550', 'weapon2': '0.670', 'WEAPON3': '0.900', 'HITCOUNT': '1.780', 'weapon3': '2.608', 'DAMAGECOUNT': '8.445', 'FRAGCOUNT': '22.000'} [2023-02-24 20:30:00,667][213384] DAMAGECOUNT value on done: 32859.0 [2023-02-24 20:30:00,668][213384] Sum rewards: 30.473, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.820', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.032', 'AMMO3': '0.122', 'AMMO4': '0.160', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.230', 'weapon5': '0.276', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '0.800', 'weapon2': '1.002', 'HITCOUNT': '2.080', 'weapon3': '2.110', 'DAMAGECOUNT': '8.109', 'FRAGCOUNT': '25.000'} [2023-02-24 20:30:00,765][213369] DAMAGECOUNT value on done: 34285.0 [2023-02-24 20:30:00,766][213369] Sum rewards: 20.967, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-3.085', 'AMMO2': '0.006', 'AMMO5': '0.020', 'AMMO4': '0.029', 'AMMO3': '0.134', 'WEAPON4': '0.200', 'weapon4': '0.290', 'weapon5': '0.472', 'WEAPON5': '0.550', 'weapon2': '0.638', 'WEAPON3': '0.900', 'HITCOUNT': '1.530', 'weapon3': '2.094', 'DAMAGECOUNT': '6.189', 'FRAGCOUNT': '20.000'} [2023-02-24 20:30:00,802][213365] Updated weights for policy 0, policy_version 25466 (0.0008) [2023-02-24 20:30:00,827][213368] DAMAGECOUNT value on done: 36692.0 [2023-02-24 20:30:00,828][213368] Sum rewards: 26.827, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.470', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO3': '0.129', 'AMMO4': '0.142', 'WEAPON4': '0.250', 'weapon5': '0.256', 'WEAPON5': '0.300', 'weapon4': '0.484', 'WEAPON3': '0.800', 'weapon2': '0.872', 'HITCOUNT': '1.900', 'weapon3': '1.946', 'DAMAGECOUNT': '7.674', 'FRAGCOUNT': '21.000'} [2023-02-24 20:30:01,069][213369] DAMAGECOUNT value on done: 31885.0 [2023-02-24 20:30:01,069][213369] Sum rewards: 17.378, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.809', 'AMMO2': '0.010', 'weapon4': '0.018', 'AMMO5': '0.023', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.145', 'weapon2': '0.470', 'weapon5': '0.518', 'WEAPON5': '0.600', 'WEAPON3': '0.900', 'HITCOUNT': '1.220', 'weapon3': '2.560', 'DAMAGECOUNT': '5.325', 'FRAGCOUNT': '16.000'} [2023-02-24 20:30:03,690][213365] Updated weights for policy 0, policy_version 25476 (0.0009) [2023-02-24 20:30:05,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13968.0). Total num frames: 104370176. Throughput: 0: 3463.5. Samples: 1081136. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:30:05,243][213332] Avg episode reward: [(0, '23.426')] [2023-02-24 20:30:05,246][213352] Saving new best policy, reward=23.426! [2023-02-24 20:30:06,653][213365] Updated weights for policy 0, policy_version 25486 (0.0009) [2023-02-24 20:30:09,615][213365] Updated weights for policy 0, policy_version 25496 (0.0009) [2023-02-24 20:30:10,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 104439808. Throughput: 0: 3467.1. Samples: 1102052. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:30:10,243][213332] Avg episode reward: [(0, '23.426')] [2023-02-24 20:30:12,567][213365] Updated weights for policy 0, policy_version 25506 (0.0009) [2023-02-24 20:30:15,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13954.2). Total num frames: 104509440. Throughput: 0: 3464.0. Samples: 1122868. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:30:15,243][213332] Avg episode reward: [(0, '23.426')] [2023-02-24 20:30:15,521][213365] Updated weights for policy 0, policy_version 25516 (0.0009) [2023-02-24 20:30:18,408][213367] DAMAGECOUNT value on done: 32296.0 [2023-02-24 20:30:18,409][213367] Sum rewards: 18.891, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.685', 'AMMO2': '0.006', 'AMMO5': '0.014', 'AMMO4': '0.028', 'weapon7': '0.046', 'AMMO3': '0.053', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.282', 'WEAPON3': '0.300', 'weapon2': '0.562', 'weapon4': '0.690', 'HITCOUNT': '0.850', 'weapon3': '1.260', 'DAMAGECOUNT': '4.095', 'FRAGCOUNT': '15.000'} [2023-02-24 20:30:18,451][213365] Updated weights for policy 0, policy_version 25526 (0.0009) [2023-02-24 20:30:18,704][213367] DAMAGECOUNT value on done: 39343.0 [2023-02-24 20:30:18,705][213367] Sum rewards: 23.964, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.204', 'AMMO5': '0.024', 'AMMO2': '0.033', 'AMMO4': '0.164', 'weapon2': '0.172', 'weapon4': '0.188', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'weapon5': '0.428', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'HITCOUNT': '1.960', 'weapon3': '2.778', 'DAMAGECOUNT': '8.478', 'FRAGCOUNT': '24.000'} [2023-02-24 20:30:18,854][213383] DAMAGECOUNT value on done: 36922.0 [2023-02-24 20:30:18,855][213383] Sum rewards: 29.673, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.288', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.145', 'WEAPON4': '0.200', 'weapon5': '0.220', 'weapon4': '0.328', 'WEAPON5': '0.400', 'WEAPON3': '0.950', 'weapon2': '1.036', 'HITCOUNT': '1.850', 'weapon3': '2.178', 'DAMAGECOUNT': '7.989', 'FRAGCOUNT': '26.000'} [2023-02-24 20:30:18,886][213372] DAMAGECOUNT value on done: 32840.0 [2023-02-24 20:30:18,886][213372] Sum rewards: 32.027, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.437', 'AMMO2': '0.006', 'AMMO5': '0.019', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'AMMO3': '0.116', 'weapon4': '0.174', 'weapon2': '0.340', 'WEAPON5': '0.500', 'weapon5': '0.594', 'WEAPON3': '0.750', 'HITCOUNT': '1.670', 'weapon3': '2.452', 'DAMAGECOUNT': '7.515', 'FRAGCOUNT': '25.000'} [2023-02-24 20:30:18,920][213382] DAMAGECOUNT value on done: 34490.0 [2023-02-24 20:30:18,921][213382] Sum rewards: 25.473, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.678', 'AMMO2': '0.009', 'AMMO5': '0.016', 'AMMO4': '0.044', 'AMMO3': '0.110', 'WEAPON4': '0.200', 'weapon4': '0.394', 'WEAPON5': '0.400', 'weapon5': '0.502', 'WEAPON3': '0.750', 'weapon2': '0.940', 'HITCOUNT': '1.740', 'weapon3': '1.860', 'DAMAGECOUNT': '7.185', 'FRAGCOUNT': '22.000'} [2023-02-24 20:30:18,923][213367] DAMAGECOUNT value on done: 33682.0 [2023-02-24 20:30:18,923][213367] Sum rewards: 25.874, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.930', 'AMMO5': '0.022', 'AMMO2': '0.027', 'weapon4': '0.028', 'AMMO3': '0.095', 'AMMO4': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.600', 'weapon2': '0.628', 'weapon5': '0.632', 'WEAPON3': '0.700', 'HITCOUNT': '1.420', 'weapon3': '2.172', 'DAMAGECOUNT': '6.897', 'FRAGCOUNT': '21.000'} [2023-02-24 20:30:18,972][213366] DAMAGECOUNT value on done: 35790.0 [2023-02-24 20:30:18,973][213366] Sum rewards: 16.390, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.976', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.097', 'AMMO3': '0.209', 'weapon5': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.512', 'weapon4': '0.650', 'WEAPON3': '1.200', 'HITCOUNT': '1.470', 'weapon3': '1.888', 'DAMAGECOUNT': '6.075', 'FRAGCOUNT': '20.000'} [2023-02-24 20:30:19,156][213384] DAMAGECOUNT value on done: 36961.0 [2023-02-24 20:30:19,156][213384] Sum rewards: 24.254, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.510', 'AMMO2': '0.007', 'AMMO5': '0.024', 'AMMO4': '0.036', 'weapon4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.177', 'weapon2': '0.278', 'weapon5': '0.520', 'WEAPON5': '0.650', 'WEAPON3': '1.200', 'HITCOUNT': '1.610', 'weapon3': '2.716', 'DAMAGECOUNT': '6.870', 'FRAGCOUNT': '23.000'} [2023-02-24 20:30:19,158][213383] DAMAGECOUNT value on done: 39130.0 [2023-02-24 20:30:19,158][213383] Sum rewards: 31.795, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.302', 'AMMO2': '0.022', 'AMMO5': '0.022', 'WEAPON4': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.121', 'weapon4': '0.214', 'weapon5': '0.336', 'WEAPON5': '0.450', 'weapon2': '0.654', 'WEAPON3': '0.750', 'HITCOUNT': '1.790', 'weapon3': '2.392', 'DAMAGECOUNT': '8.388', 'FRAGCOUNT': '25.000'} [2023-02-24 20:30:19,181][213372] DAMAGECOUNT value on done: 35827.0 [2023-02-24 20:30:19,182][213372] Sum rewards: 20.629, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.629', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon5': '0.330', 'ARMOR': '0.452', 'weapon4': '0.472', 'weapon2': '0.516', 'WEAPON3': '0.750', 'HITCOUNT': '1.310', 'weapon3': '2.152', 'DAMAGECOUNT': '5.655', 'FRAGCOUNT': '18.000'} [2023-02-24 20:30:19,221][213367] DAMAGECOUNT value on done: 31516.0 [2023-02-24 20:30:19,222][213367] Sum rewards: 17.266, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.864', 'AMMO5': '0.013', 'AMMO2': '0.022', 'weapon4': '0.044', 'WEAPON4': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.130', 'WEAPON5': '0.350', 'weapon5': '0.366', 'WEAPON3': '0.800', 'weapon2': '0.810', 'HITCOUNT': '1.220', 'weapon3': '2.252', 'DAMAGECOUNT': '5.163', 'FRAGCOUNT': '15.000'} [2023-02-24 20:30:19,224][213382] DAMAGECOUNT value on done: 35806.0 [2023-02-24 20:30:19,224][213382] Sum rewards: 26.184, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.842', 'AMMO2': '0.008', 'AMMO5': '0.014', 'AMMO4': '0.041', 'AMMO3': '0.063', 'weapon4': '0.064', 'weapon7': '0.080', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'weapon5': '0.488', 'WEAPON3': '0.550', 'weapon2': '1.242', 'HITCOUNT': '1.480', 'weapon3': '1.778', 'DAMAGECOUNT': '6.777', 'FRAGCOUNT': '18.000'} [2023-02-24 20:30:19,277][213366] DAMAGECOUNT value on done: 37327.0 [2023-02-24 20:30:19,277][213366] Sum rewards: 23.502, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.930', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.015', 'weapon4': '0.040', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'WEAPON5': '0.400', 'weapon5': '0.574', 'WEAPON3': '0.700', 'weapon2': '1.074', 'HITCOUNT': '1.390', 'weapon3': '1.872', 'DAMAGECOUNT': '5.820', 'FRAGCOUNT': '19.000'} [2023-02-24 20:30:19,330][213368] DAMAGECOUNT value on done: 36173.0 [2023-02-24 20:30:19,331][213368] Sum rewards: 16.164, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.558', 'AMMO5': '0.010', 'weapon7': '0.016', 'AMMO2': '0.039', 'AMMO3': '0.070', 'AMMO4': '0.195', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'weapon4': '0.460', 'weapon5': '0.474', 'HITCOUNT': '0.820', 'weapon2': '1.110', 'weapon3': '1.430', 'DAMAGECOUNT': '3.747', 'FRAGCOUNT': '12.000'} [2023-02-24 20:30:19,454][213384] DAMAGECOUNT value on done: 33859.0 [2023-02-24 20:30:19,454][213384] Sum rewards: 22.015, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.582', 'ARMOR': '0.004', 'AMMO5': '0.029', 'weapon7': '0.046', 'AMMO2': '0.051', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.175', 'AMMO4': '0.257', 'weapon5': '0.324', 'weapon4': '0.346', 'weapon2': '0.438', 'WEAPON4': '0.550', 'WEAPON5': '0.700', 'WEAPON3': '1.000', 'HITCOUNT': '1.530', 'weapon3': '2.398', 'DAMAGECOUNT': '7.449', 'FRAGCOUNT': '23.000'} [2023-02-24 20:30:19,498][213372] DAMAGECOUNT value on done: 35141.0 [2023-02-24 20:30:19,498][213372] Sum rewards: 21.123, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.532', 'AMMO5': '0.030', 'AMMO2': '0.043', 'AMMO3': '0.074', 'weapon4': '0.152', 'AMMO4': '0.216', 'WEAPON4': '0.400', 'WEAPON3': '0.500', 'weapon5': '0.526', 'WEAPON5': '0.750', 'weapon2': '0.828', 'HITCOUNT': '1.290', 'weapon3': '2.018', 'DAMAGECOUNT': '6.327', 'FRAGCOUNT': '17.000'} [2023-02-24 20:30:19,535][213382] DAMAGECOUNT value on done: 36463.0 [2023-02-24 20:30:19,535][213382] Sum rewards: 15.001, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.779', 'AMMO5': '0.017', 'AMMO2': '0.040', 'AMMO3': '0.128', 'AMMO4': '0.202', 'weapon4': '0.306', 'weapon5': '0.338', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'weapon2': '0.888', 'HITCOUNT': '1.440', 'weapon3': '1.850', 'DAMAGECOUNT': '6.120', 'FRAGCOUNT': '13.500'} [2023-02-24 20:30:19,560][213383] DAMAGECOUNT value on done: 34667.0 [2023-02-24 20:30:19,561][213383] Sum rewards: 24.564, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.155', 'AMMO5': '0.023', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.151', 'WEAPON4': '0.350', 'weapon4': '0.402', 'weapon2': '0.444', 'weapon5': '0.464', 'WEAPON5': '0.600', 'WEAPON3': '1.000', 'HITCOUNT': '2.000', 'weapon3': '2.240', 'DAMAGECOUNT': '8.901', 'FRAGCOUNT': '22.000'} [2023-02-24 20:30:19,561][213369] DAMAGECOUNT value on done: 34812.0 [2023-02-24 20:30:19,561][213369] Sum rewards: 11.127, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.275', 'AMMO2': '0.009', 'AMMO5': '0.020', 'AMMO4': '0.043', 'WEAPON4': '0.100', 'AMMO3': '0.128', 'weapon4': '0.208', 'weapon5': '0.388', 'WEAPON5': '0.550', 'weapon2': '0.564', 'HITCOUNT': '0.780', 'WEAPON3': '0.800', 'weapon3': '2.370', 'DAMAGECOUNT': '3.441', 'FRAGCOUNT': '12.000'} [2023-02-24 20:30:19,575][213366] DAMAGECOUNT value on done: 38740.0 [2023-02-24 20:30:19,576][213366] Sum rewards: 27.210, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.265', 'AMMO2': '0.028', 'AMMO5': '0.031', 'AMMO3': '0.131', 'AMMO4': '0.138', 'WEAPON4': '0.300', 'weapon4': '0.308', 'weapon5': '0.470', 'weapon2': '0.538', 'WEAPON5': '0.750', 'WEAPON3': '0.850', 'HITCOUNT': '1.460', 'weapon3': '2.376', 'DAMAGECOUNT': '7.095', 'FRAGCOUNT': '23.000'} [2023-02-24 20:30:19,629][213368] DAMAGECOUNT value on done: 37814.0 [2023-02-24 20:30:19,630][213368] Sum rewards: 31.650, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.718', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'weapon4': '0.052', 'AMMO3': '0.141', 'WEAPON5': '0.200', 'weapon5': '0.422', 'WEAPON3': '0.900', 'weapon2': '0.944', 'HITCOUNT': '1.790', 'weapon3': '2.210', 'DAMAGECOUNT': '8.586', 'FRAGCOUNT': '26.000'} [2023-02-24 20:30:19,756][213384] DAMAGECOUNT value on done: 40480.0 [2023-02-24 20:30:19,756][213384] Sum rewards: 20.098, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.280', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon5': '0.226', 'AMMO3': '0.240', 'WEAPON4': '0.400', 'weapon4': '0.464', 'WEAPON5': '0.600', 'weapon2': '0.694', 'WEAPON3': '1.450', 'HITCOUNT': '1.920', 'weapon3': '2.214', 'DAMAGECOUNT': '7.461', 'FRAGCOUNT': '24.000'} [2023-02-24 20:30:19,801][213372] DAMAGECOUNT value on done: 36827.0 [2023-02-24 20:30:19,802][213372] Sum rewards: 14.419, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.548', 'AMMO2': '0.016', 'AMMO5': '0.023', 'weapon4': '0.048', 'AMMO4': '0.081', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon5': '0.416', 'weapon2': '0.426', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'HITCOUNT': '1.490', 'weapon3': '2.634', 'DAMAGECOUNT': '6.189', 'FRAGCOUNT': '17.000'} [2023-02-24 20:30:19,836][213368] DAMAGECOUNT value on done: 36064.0 [2023-02-24 20:30:19,837][213368] Sum rewards: 20.762, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.427', 'ARMOR': '0.008', 'AMMO5': '0.027', 'AMMO2': '0.028', 'AMMO4': '0.141', 'AMMO3': '0.144', 'WEAPON4': '0.300', 'weapon4': '0.470', 'weapon2': '0.542', 'weapon5': '0.546', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'HITCOUNT': '1.490', 'weapon3': '2.022', 'DAMAGECOUNT': '6.171', 'FRAGCOUNT': '17.000'} [2023-02-24 20:30:19,839][213382] DAMAGECOUNT value on done: 37497.0 [2023-02-24 20:30:19,840][213382] Sum rewards: 21.795, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.080', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon7': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.218', 'WEAPON5': '0.300', 'weapon2': '0.386', 'weapon4': '0.566', 'WEAPON3': '0.750', 'HITCOUNT': '1.380', 'weapon3': '1.962', 'DAMAGECOUNT': '6.171', 'FRAGCOUNT': '17.000'} [2023-02-24 20:30:19,862][213383] DAMAGECOUNT value on done: 33509.0 [2023-02-24 20:30:19,862][213383] Sum rewards: 19.570, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.463', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.020', 'weapon7': '0.060', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.133', 'weapon5': '0.162', 'WEAPON7': '0.200', 'weapon4': '0.380', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'weapon2': '0.880', 'HITCOUNT': '1.280', 'weapon3': '2.024', 'DAMAGECOUNT': '5.529', 'FRAGCOUNT': '17.000'} [2023-02-24 20:30:19,867][213369] DAMAGECOUNT value on done: 39261.0 [2023-02-24 20:30:19,868][213369] Sum rewards: 19.092, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.780', 'AMMO5': '0.019', 'AMMO2': '0.035', 'AMMO4': '0.176', 'AMMO3': '0.183', 'weapon5': '0.260', 'WEAPON4': '0.300', 'weapon4': '0.344', 'WEAPON5': '0.500', 'weapon2': '0.744', 'WEAPON3': '1.050', 'HITCOUNT': '1.870', 'weapon3': '2.210', 'DAMAGECOUNT': '7.680', 'FRAGCOUNT': '18.000'} [2023-02-24 20:30:19,879][213366] DAMAGECOUNT value on done: 31256.0 [2023-02-24 20:30:19,880][213366] Sum rewards: 17.282, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.460', 'AMMO5': '0.019', 'AMMO2': '0.040', 'AMMO3': '0.082', 'weapon4': '0.170', 'AMMO4': '0.200', 'WEAPON4': '0.300', 'weapon5': '0.340', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon2': '1.048', 'HITCOUNT': '1.370', 'weapon3': '1.712', 'DAMAGECOUNT': '5.010', 'FRAGCOUNT': '14.000'} [2023-02-24 20:30:20,053][213384] DAMAGECOUNT value on done: 35276.0 [2023-02-24 20:30:20,053][213384] Sum rewards: 23.129, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.228', 'AMMO2': '0.020', 'AMMO5': '0.021', 'ARMOR': '0.024', 'AMMO4': '0.100', 'AMMO3': '0.172', 'WEAPON4': '0.300', 'weapon5': '0.338', 'weapon2': '0.382', 'weapon4': '0.436', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'HITCOUNT': '1.770', 'weapon3': '2.392', 'DAMAGECOUNT': '7.251', 'FRAGCOUNT': '21.000'} [2023-02-24 20:30:20,138][213368] DAMAGECOUNT value on done: 39140.0 [2023-02-24 20:30:20,138][213368] Sum rewards: 26.231, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.529', 'AMMO2': '0.015', 'AMMO5': '0.017', 'AMMO4': '0.076', 'weapon4': '0.108', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon5': '0.336', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon2': '1.294', 'HITCOUNT': '1.560', 'weapon3': '1.902', 'DAMAGECOUNT': '7.329', 'FRAGCOUNT': '24.000'} [2023-02-24 20:30:20,175][213369] DAMAGECOUNT value on done: 37129.0 [2023-02-24 20:30:20,176][213369] Sum rewards: 29.588, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.460', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.024', 'WEAPON4': '0.100', 'weapon5': '0.138', 'AMMO3': '0.154', 'weapon4': '0.174', 'WEAPON5': '0.250', 'weapon2': '0.758', 'WEAPON3': '1.000', 'HITCOUNT': '2.040', 'weapon3': '2.628', 'DAMAGECOUNT': '8.517', 'FRAGCOUNT': '25.000'} [2023-02-24 20:30:20,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13789.9, 300 sec: 13940.3). Total num frames: 104574976. Throughput: 0: 3464.1. Samples: 1133306. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:30:20,243][213332] Avg episode reward: [(0, '23.570')] [2023-02-24 20:30:20,244][213352] Saving new best policy, reward=23.570! [2023-02-24 20:30:20,486][213369] DAMAGECOUNT value on done: 33850.0 [2023-02-24 20:30:20,487][213369] Sum rewards: 23.300, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.861', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.023', 'AMMO3': '0.083', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.474', 'weapon5': '0.504', 'WEAPON3': '0.550', 'weapon2': '0.720', 'HITCOUNT': '1.320', 'weapon3': '1.780', 'DAMAGECOUNT': '5.889', 'FRAGCOUNT': '19.000'} [2023-02-24 20:30:21,417][213365] Updated weights for policy 0, policy_version 25536 (0.0009) [2023-02-24 20:30:24,356][213365] Updated weights for policy 0, policy_version 25546 (0.0009) [2023-02-24 20:30:25,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 104648704. Throughput: 0: 3470.7. Samples: 1154146. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:30:25,243][213332] Avg episode reward: [(0, '23.642')] [2023-02-24 20:30:25,247][213352] Saving new best policy, reward=23.642! [2023-02-24 20:30:27,307][213365] Updated weights for policy 0, policy_version 25556 (0.0009) [2023-02-24 20:30:30,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13940.3). Total num frames: 104714240. Throughput: 0: 3473.5. Samples: 1174980. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:30:30,243][213332] Avg episode reward: [(0, '23.642')] [2023-02-24 20:30:30,266][213365] Updated weights for policy 0, policy_version 25566 (0.0009) [2023-02-24 20:30:33,193][213365] Updated weights for policy 0, policy_version 25576 (0.0009) [2023-02-24 20:30:35,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13954.2). Total num frames: 104787968. Throughput: 0: 3476.0. Samples: 1185536. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:30:35,243][213332] Avg episode reward: [(0, '23.642')] [2023-02-24 20:30:36,125][213365] Updated weights for policy 0, policy_version 25586 (0.0009) [2023-02-24 20:30:37,683][213367] DAMAGECOUNT value on done: 34702.0 [2023-02-24 20:30:37,683][213367] Sum rewards: 25.379, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.820', 'AMMO2': '0.009', 'AMMO5': '0.022', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'weapon4': '0.198', 'weapon5': '0.524', 'WEAPON5': '0.600', 'WEAPON3': '0.650', 'weapon2': '0.780', 'HITCOUNT': '1.620', 'weapon3': '2.082', 'DAMAGECOUNT': '7.218', 'FRAGCOUNT': '19.000'} [2023-02-24 20:30:37,976][213367] DAMAGECOUNT value on done: 40842.0 [2023-02-24 20:30:37,977][213367] Sum rewards: 16.738, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.500', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO3': '0.099', 'AMMO4': '0.134', 'WEAPON4': '0.250', 'weapon4': '0.378', 'WEAPON5': '0.400', 'weapon2': '0.404', 'weapon5': '0.434', 'WEAPON3': '0.600', 'HITCOUNT': '1.070', 'weapon3': '2.180', 'DAMAGECOUNT': '4.497', 'FRAGCOUNT': '15.000'} [2023-02-24 20:30:38,064][213372] DAMAGECOUNT value on done: 35244.0 [2023-02-24 20:30:38,064][213372] Sum rewards: 24.593, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.750', 'AMMO5': '0.012', 'AMMO2': '0.056', 'AMMO3': '0.105', 'weapon5': '0.224', 'WEAPON5': '0.250', 'AMMO4': '0.278', 'WEAPON4': '0.400', 'weapon4': '0.626', 'WEAPON3': '0.700', 'weapon2': '0.806', 'HITCOUNT': '1.800', 'weapon3': '1.874', 'DAMAGECOUNT': '7.212', 'FRAGCOUNT': '20.000'} [2023-02-24 20:30:38,107][213383] DAMAGECOUNT value on done: 39216.0 [2023-02-24 20:30:38,108][213383] Sum rewards: 24.175, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.670', 'AMMO2': '0.010', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.052', 'weapon7': '0.062', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.252', 'WEAPON5': '0.450', 'weapon4': '0.678', 'WEAPON3': '0.750', 'weapon2': '0.852', 'HITCOUNT': '1.460', 'weapon3': '1.556', 'DAMAGECOUNT': '6.882', 'FRAGCOUNT': '21.000'} [2023-02-24 20:30:38,248][213366] DAMAGECOUNT value on done: 38427.0 [2023-02-24 20:30:38,249][213366] Sum rewards: 28.581, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.466', 'AMMO5': '0.025', 'AMMO2': '0.034', 'AMMO3': '0.092', 'weapon4': '0.158', 'AMMO4': '0.167', 'WEAPON4': '0.250', 'weapon2': '0.402', 'weapon5': '0.514', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'HITCOUNT': '1.800', 'weapon3': '2.394', 'DAMAGECOUNT': '7.911', 'FRAGCOUNT': '24.000'} [2023-02-24 20:30:38,251][213382] DAMAGECOUNT value on done: 36491.0 [2023-02-24 20:30:38,251][213367] DAMAGECOUNT value on done: 36357.0 [2023-02-24 20:30:38,251][213382] Sum rewards: 17.545, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.386', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.020', 'weapon7': '0.048', 'AMMO4': '0.097', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.148', 'weapon5': '0.182', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.676', 'WEAPON3': '0.750', 'weapon4': '0.772', 'HITCOUNT': '1.400', 'weapon3': '1.774', 'DAMAGECOUNT': '6.003', 'FRAGCOUNT': '15.000'} [2023-02-24 20:30:38,251][213367] Sum rewards: 20.002, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.022', 'AMMO5': '0.020', 'AMMO2': '0.038', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.126', 'AMMO3': '0.129', 'AMMO4': '0.189', 'WEAPON7': '0.200', 'weapon5': '0.310', 'weapon4': '0.340', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'weapon2': '0.888', 'HITCOUNT': '1.530', 'weapon3': '1.838', 'DAMAGECOUNT': '8.025', 'FRAGCOUNT': '19.000'} [2023-02-24 20:30:38,373][213372] DAMAGECOUNT value on done: 36368.0 [2023-02-24 20:30:38,373][213372] Sum rewards: 2.438, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.394', 'ARMOR': '0.008', 'AMMO2': '0.009', 'AMMO5': '0.009', 'AMMO3': '0.034', 'AMMO4': '0.042', 'weapon7': '0.052', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.166', 'WEAPON5': '0.200', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.298', 'weapon3': '0.384', 'HITCOUNT': '0.420', 'weapon2': '0.546', 'DAMAGECOUNT': '1.623', 'FRAGCOUNT': '2.000'} [2023-02-24 20:30:38,415][213383] DAMAGECOUNT value on done: 41147.0 [2023-02-24 20:30:38,415][213383] Sum rewards: 11.951, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.776', 'AMMO5': '0.022', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.161', 'weapon4': '0.282', 'WEAPON4': '0.400', 'weapon5': '0.484', 'weapon2': '0.570', 'WEAPON5': '0.700', 'WEAPON3': '1.050', 'HITCOUNT': '1.160', 'weapon3': '2.172', 'DAMAGECOUNT': '6.051', 'FRAGCOUNT': '13.500'} [2023-02-24 20:30:38,544][213384] DAMAGECOUNT value on done: 39692.0 [2023-02-24 20:30:38,544][213384] Sum rewards: 24.151, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.160', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'WEAPON5': '0.300', 'weapon5': '0.372', 'weapon2': '0.818', 'WEAPON3': '1.050', 'HITCOUNT': '1.670', 'weapon3': '2.300', 'DAMAGECOUNT': '8.193', 'FRAGCOUNT': '21.000'} [2023-02-24 20:30:38,551][213367] DAMAGECOUNT value on done: 34487.0 [2023-02-24 20:30:38,551][213367] Sum rewards: 33.324, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.385', 'AMMO5': '0.019', 'AMMO2': '0.035', 'AMMO3': '0.118', 'AMMO4': '0.174', 'weapon5': '0.388', 'WEAPON4': '0.400', 'weapon4': '0.426', 'WEAPON5': '0.450', 'weapon2': '0.710', 'WEAPON3': '0.800', 'HITCOUNT': '1.990', 'weapon3': '2.036', 'DAMAGECOUNT': '8.913', 'FRAGCOUNT': '28.000'} [2023-02-24 20:30:38,552][213366] DAMAGECOUNT value on done: 40517.0 [2023-02-24 20:30:38,553][213366] Sum rewards: 31.801, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.775', 'AMMO2': '0.017', 'AMMO5': '0.018', 'AMMO4': '0.082', 'weapon4': '0.128', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'weapon5': '0.254', 'weapon2': '0.346', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.240', 'weapon3': '2.890', 'DAMAGECOUNT': '9.570', 'FRAGCOUNT': '31.000'} [2023-02-24 20:30:38,554][213382] DAMAGECOUNT value on done: 38050.0 [2023-02-24 20:30:38,555][213382] Sum rewards: 27.335, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.522', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO3': '0.113', 'AMMO4': '0.180', 'weapon5': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.568', 'WEAPON3': '0.700', 'weapon2': '1.158', 'weapon3': '1.636', 'HITCOUNT': '1.640', 'DAMAGECOUNT': '6.732', 'FRAGCOUNT': '25.000'} [2023-02-24 20:30:38,638][213368] DAMAGECOUNT value on done: 38407.0 [2023-02-24 20:30:38,638][213368] Sum rewards: 22.786, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.020', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.043', 'weapon5': '0.104', 'AMMO3': '0.144', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.414', 'WEAPON3': '0.900', 'weapon2': '0.926', 'HITCOUNT': '1.560', 'weapon3': '2.094', 'DAMAGECOUNT': '6.702', 'FRAGCOUNT': '21.000'} [2023-02-24 20:30:38,706][213372] DAMAGECOUNT value on done: 37796.0 [2023-02-24 20:30:38,706][213372] Sum rewards: 26.024, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.948', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.040', 'AMMO3': '0.130', 'weapon5': '0.156', 'AMMO4': '0.199', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon2': '0.580', 'weapon4': '0.620', 'WEAPON3': '0.850', 'HITCOUNT': '1.710', 'weapon3': '2.294', 'DAMAGECOUNT': '7.965', 'FRAGCOUNT': '22.000'} [2023-02-24 20:30:38,844][213384] DAMAGECOUNT value on done: 35875.0 [2023-02-24 20:30:38,845][213384] Sum rewards: 23.071, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.156', 'AMMO5': '0.038', 'AMMO2': '0.043', 'AMMO3': '0.113', 'AMMO4': '0.216', 'weapon4': '0.316', 'weapon5': '0.440', 'WEAPON4': '0.500', 'weapon2': '0.606', 'WEAPON3': '0.750', 'WEAPON5': '0.850', 'HITCOUNT': '1.590', 'weapon3': '2.216', 'DAMAGECOUNT': '6.048', 'FRAGCOUNT': '22.000'} [2023-02-24 20:30:38,853][213382] DAMAGECOUNT value on done: 37538.0 [2023-02-24 20:30:38,853][213382] Sum rewards: 13.308, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.203', 'AMMO5': '0.015', 'AMMO2': '0.018', 'AMMO3': '0.062', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'weapon4': '0.100', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'weapon5': '0.536', 'HITCOUNT': '0.870', 'weapon2': '1.070', 'weapon3': '1.876', 'DAMAGECOUNT': '3.225', 'FRAGCOUNT': '10.000'} [2023-02-24 20:30:38,856][213366] DAMAGECOUNT value on done: 41505.0 [2023-02-24 20:30:38,856][213366] Sum rewards: 30.225, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.944', 'AMMO2': '0.013', 'AMMO5': '0.020', 'AMMO4': '0.067', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'weapon4': '0.166', 'weapon5': '0.486', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'weapon2': '1.018', 'HITCOUNT': '1.660', 'weapon3': '2.010', 'DAMAGECOUNT': '8.295', 'FRAGCOUNT': '25.000'} [2023-02-24 20:30:38,868][213383] DAMAGECOUNT value on done: 36651.0 [2023-02-24 20:30:38,868][213383] Sum rewards: 13.566, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.228', 'AMMO5': '0.025', 'AMMO2': '0.042', 'AMMO3': '0.157', 'AMMO4': '0.212', 'weapon5': '0.254', 'ARMOR': '0.400', 'weapon2': '0.406', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon4': '0.626', 'WEAPON3': '1.000', 'HITCOUNT': '1.410', 'weapon3': '2.260', 'DAMAGECOUNT': '5.952', 'FRAGCOUNT': '16.000'} [2023-02-24 20:30:38,889][213369] DAMAGECOUNT value on done: 36638.0 [2023-02-24 20:30:38,889][213369] Sum rewards: 21.732, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.009', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'weapon4': '0.108', 'AMMO3': '0.151', 'WEAPON5': '0.450', 'weapon5': '0.522', 'weapon2': '0.698', 'WEAPON3': '1.000', 'HITCOUNT': '1.260', 'weapon3': '2.246', 'DAMAGECOUNT': '5.478', 'FRAGCOUNT': '20.000'} [2023-02-24 20:30:38,944][213368] DAMAGECOUNT value on done: 40358.0 [2023-02-24 20:30:38,944][213368] Sum rewards: 32.389, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.770', 'AMMO5': '0.013', 'AMMO2': '0.018', 'AMMO3': '0.079', 'AMMO4': '0.089', 'weapon4': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'weapon5': '0.422', 'WEAPON3': '0.550', 'weapon2': '0.988', 'HITCOUNT': '1.570', 'weapon3': '2.000', 'DAMAGECOUNT': '7.632', 'FRAGCOUNT': '25.000'} [2023-02-24 20:30:39,016][213372] DAMAGECOUNT value on done: 38887.0 [2023-02-24 20:30:39,017][213372] Sum rewards: 20.690, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.794', 'AMMO5': '0.017', 'AMMO2': '0.024', 'WEAPON4': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.120', 'weapon4': '0.168', 'weapon5': '0.228', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'weapon2': '1.076', 'HITCOUNT': '1.620', 'weapon3': '2.184', 'DAMAGECOUNT': '6.180', 'FRAGCOUNT': '16.000'} [2023-02-24 20:30:39,107][213365] Updated weights for policy 0, policy_version 25596 (0.0009) [2023-02-24 20:30:39,126][213384] DAMAGECOUNT value on done: 41603.0 [2023-02-24 20:30:39,127][213384] Sum rewards: 8.177, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.230', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.033', 'AMMO3': '0.092', 'weapon7': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.166', 'WEAPON7': '0.200', 'weapon5': '0.342', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '0.550', 'weapon2': '0.622', 'weapon4': '0.754', 'HITCOUNT': '0.820', 'weapon3': '1.342', 'DAMAGECOUNT': '3.369', 'FRAGCOUNT': '8.000'} [2023-02-24 20:30:39,147][213382] DAMAGECOUNT value on done: 40027.0 [2023-02-24 20:30:39,148][213382] Sum rewards: 22.922, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.260', 'AMMO2': '0.012', 'AMMO5': '0.018', 'AMMO4': '0.061', 'AMMO3': '0.139', 'weapon4': '0.280', 'WEAPON4': '0.300', 'weapon5': '0.396', 'WEAPON5': '0.500', 'weapon2': '0.844', 'WEAPON3': '0.950', 'HITCOUNT': '1.720', 'weapon3': '2.122', 'DAMAGECOUNT': '7.590', 'FRAGCOUNT': '20.000'} [2023-02-24 20:30:39,157][213366] DAMAGECOUNT value on done: 32832.0 [2023-02-24 20:30:39,158][213366] Sum rewards: 10.905, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.316', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO3': '0.062', 'AMMO4': '0.165', 'weapon4': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'weapon5': '0.412', 'weapon2': '0.890', 'weapon3': '0.996', 'HITCOUNT': '1.040', 'DAMAGECOUNT': '4.728', 'FRAGCOUNT': '10.000'} [2023-02-24 20:30:39,164][213368] DAMAGECOUNT value on done: 37733.0 [2023-02-24 20:30:39,164][213368] Sum rewards: 17.720, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.934', 'AMMO5': '0.008', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon7': '0.080', 'weapon4': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.132', 'WEAPON5': '0.300', 'weapon5': '0.378', 'weapon2': '0.740', 'WEAPON3': '0.900', 'HITCOUNT': '1.260', 'weapon3': '2.318', 'DAMAGECOUNT': '4.962', 'FRAGCOUNT': '17.000'} [2023-02-24 20:30:39,177][213383] DAMAGECOUNT value on done: 36894.0 [2023-02-24 20:30:39,178][213383] Sum rewards: 32.715, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.520', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.017', 'weapon4': '0.082', 'AMMO4': '0.087', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon5': '0.384', 'WEAPON5': '0.400', 'weapon2': '0.606', 'WEAPON3': '1.200', 'HITCOUNT': '2.110', 'weapon3': '2.530', 'DAMAGECOUNT': '10.155', 'FRAGCOUNT': '30.000'} [2023-02-24 20:30:39,189][213369] DAMAGECOUNT value on done: 41713.0 [2023-02-24 20:30:39,189][213369] Sum rewards: 24.155, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.532', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.025', 'AMMO3': '0.190', 'weapon5': '0.288', 'WEAPON5': '0.300', 'weapon2': '0.724', 'WEAPON3': '1.200', 'HITCOUNT': '1.460', 'weapon3': '2.628', 'DAMAGECOUNT': '7.356', 'FRAGCOUNT': '22.000'} [2023-02-24 20:30:39,425][213384] DAMAGECOUNT value on done: 37464.0 [2023-02-24 20:30:39,426][213384] Sum rewards: 21.021, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.465', 'AMMO2': '0.011', 'AMMO5': '0.023', 'AMMO4': '0.056', 'AMMO3': '0.117', 'weapon5': '0.290', 'weapon4': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'weapon2': '0.802', 'HITCOUNT': '1.470', 'weapon3': '2.260', 'DAMAGECOUNT': '6.459', 'FRAGCOUNT': '19.000'} [2023-02-24 20:30:39,471][213368] DAMAGECOUNT value on done: 41484.0 [2023-02-24 20:30:39,472][213368] Sum rewards: 24.428, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.303', 'AMMO2': '0.004', 'AMMO5': '0.017', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'weapon4': '0.086', 'AMMO3': '0.148', 'WEAPON5': '0.400', 'weapon5': '0.502', 'weapon2': '0.538', 'WEAPON3': '0.950', 'HITCOUNT': '1.590', 'weapon3': '2.392', 'DAMAGECOUNT': '7.032', 'FRAGCOUNT': '21.000'} [2023-02-24 20:30:39,495][213369] DAMAGECOUNT value on done: 39554.0 [2023-02-24 20:30:39,495][213369] Sum rewards: 25.827, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.702', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.174', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.444', 'weapon5': '0.472', 'weapon4': '0.496', 'WEAPON3': '0.950', 'HITCOUNT': '1.850', 'weapon3': '2.178', 'DAMAGECOUNT': '7.275', 'FRAGCOUNT': '23.000'} [2023-02-24 20:30:39,789][213369] DAMAGECOUNT value on done: 35049.0 [2023-02-24 20:30:39,789][213369] Sum rewards: 14.534, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO3': '0.087', 'AMMO4': '0.183', 'WEAPON4': '0.250', 'weapon2': '0.370', 'HEALTH': '0.392', 'WEAPON5': '0.400', 'weapon5': '0.432', 'WEAPON3': '0.450', 'weapon4': '0.528', 'HITCOUNT': '0.900', 'weapon3': '1.656', 'DAMAGECOUNT': '3.582', 'FRAGCOUNT': '12.000'} [2023-02-24 20:30:40,243][213332] Fps is (10 sec: 13926.6, 60 sec: 13858.2, 300 sec: 13940.3). Total num frames: 104853504. Throughput: 0: 3477.8. Samples: 1206442. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:30:40,243][213332] Avg episode reward: [(0, '22.346')] [2023-02-24 20:30:42,006][213365] Updated weights for policy 0, policy_version 25606 (0.0009) [2023-02-24 20:30:44,952][213365] Updated weights for policy 0, policy_version 25616 (0.0009) [2023-02-24 20:30:45,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13858.1, 300 sec: 13940.3). Total num frames: 104923136. Throughput: 0: 3479.9. Samples: 1227400. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:30:45,244][213332] Avg episode reward: [(0, '22.346')] [2023-02-24 20:30:45,256][213352] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000025617_104927232.pth... [2023-02-24 20:30:45,316][213352] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000024800_101580800.pth [2023-02-24 20:30:47,899][213365] Updated weights for policy 0, policy_version 25626 (0.0009) [2023-02-24 20:30:50,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.2, 300 sec: 13940.3). Total num frames: 104992768. Throughput: 0: 3480.5. Samples: 1237756. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:30:50,243][213332] Avg episode reward: [(0, '22.346')] [2023-02-24 20:30:50,835][213365] Updated weights for policy 0, policy_version 25636 (0.0009) [2023-02-24 20:30:53,773][213365] Updated weights for policy 0, policy_version 25646 (0.0009) [2023-02-24 20:30:55,243][213332] Fps is (10 sec: 13926.6, 60 sec: 13858.2, 300 sec: 13926.4). Total num frames: 105062400. Throughput: 0: 3479.0. Samples: 1258606. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:30:55,243][213332] Avg episode reward: [(0, '22.346')] [2023-02-24 20:30:56,730][213365] Updated weights for policy 0, policy_version 25656 (0.0008) [2023-02-24 20:30:56,956][213367] DAMAGECOUNT value on done: 37958.0 [2023-02-24 20:30:56,956][213367] Sum rewards: 36.618, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.070', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO3': '0.128', 'AMMO4': '0.149', 'weapon4': '0.222', 'weapon5': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.618', 'WEAPON3': '0.800', 'HITCOUNT': '2.100', 'weapon3': '2.472', 'DAMAGECOUNT': '9.768', 'FRAGCOUNT': '31.000'} [2023-02-24 20:30:57,279][213367] DAMAGECOUNT value on done: 42696.0 [2023-02-24 20:30:57,280][213367] Sum rewards: 18.224, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.710', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.113', 'weapon4': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'weapon5': '0.536', 'WEAPON3': '0.700', 'weapon2': '0.736', 'HITCOUNT': '0.890', 'weapon3': '1.986', 'DAMAGECOUNT': '5.562', 'FRAGCOUNT': '16.000'} [2023-02-24 20:30:57,433][213383] DAMAGECOUNT value on done: 41362.0 [2023-02-24 20:30:57,434][213383] Sum rewards: 22.715, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.387', 'AMMO2': '0.015', 'AMMO5': '0.016', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'AMMO3': '0.134', 'weapon4': '0.150', 'weapon2': '0.170', 'weapon5': '0.384', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '1.580', 'weapon3': '2.790', 'DAMAGECOUNT': '6.438', 'FRAGCOUNT': '19.000'} [2023-02-24 20:30:57,448][213372] DAMAGECOUNT value on done: 38229.0 [2023-02-24 20:30:57,449][213372] Sum rewards: 29.752, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.955', 'AMMO2': '0.016', 'AMMO5': '0.021', 'AMMO4': '0.078', 'weapon4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.155', 'weapon5': '0.378', 'WEAPON5': '0.550', 'weapon2': '0.810', 'WEAPON3': '0.900', 'HITCOUNT': '1.800', 'weapon3': '2.274', 'DAMAGECOUNT': '8.955', 'FRAGCOUNT': '25.000'} [2023-02-24 20:30:57,545][213382] DAMAGECOUNT value on done: 39244.0 [2023-02-24 20:30:57,546][213382] Sum rewards: 27.669, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.117', 'AMMO2': '0.005', 'AMMO5': '0.015', 'AMMO4': '0.023', 'AMMO3': '0.078', 'WEAPON4': '0.200', 'weapon5': '0.256', 'weapon4': '0.330', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'weapon2': '1.172', 'weapon3': '1.608', 'HITCOUNT': '1.890', 'DAMAGECOUNT': '8.259', 'FRAGCOUNT': '20.000'} [2023-02-24 20:30:57,572][213367] DAMAGECOUNT value on done: 37927.0 [2023-02-24 20:30:57,573][213367] Sum rewards: 21.832, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.799', 'AMMO2': '0.011', 'AMMO5': '0.012', 'AMMO4': '0.053', 'weapon4': '0.054', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'weapon5': '0.282', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '1.060', 'weapon2': '1.270', 'weapon3': '2.006', 'DAMAGECOUNT': '4.710', 'FRAGCOUNT': '16.000'} [2023-02-24 20:30:57,605][213366] DAMAGECOUNT value on done: 39898.0 [2023-02-24 20:30:57,605][213366] Sum rewards: 11.023, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.806', 'AMMO2': '0.019', 'AMMO5': '0.023', 'AMMO4': '0.093', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'weapon4': '0.166', 'weapon5': '0.332', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'weapon2': '0.872', 'HITCOUNT': '1.230', 'weapon3': '2.256', 'DAMAGECOUNT': '4.413', 'FRAGCOUNT': '10.000'} [2023-02-24 20:30:57,741][213383] DAMAGECOUNT value on done: 43411.0 [2023-02-24 20:30:57,742][213383] Sum rewards: 21.692, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.200', 'AMMO2': '0.027', 'AMMO5': '0.031', 'weapon4': '0.124', 'AMMO3': '0.128', 'AMMO4': '0.133', 'WEAPON4': '0.300', 'weapon5': '0.518', 'weapon2': '0.546', 'WEAPON5': '0.800', 'WEAPON3': '0.900', 'HITCOUNT': '1.330', 'weapon3': '2.264', 'DAMAGECOUNT': '6.792', 'FRAGCOUNT': '19.000'} [2023-02-24 20:30:57,754][213372] DAMAGECOUNT value on done: 39691.0 [2023-02-24 20:30:57,754][213372] Sum rewards: 35.074, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.345', 'AMMO5': '0.017', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'weapon5': '0.160', 'AMMO3': '0.196', 'weapon2': '0.238', 'WEAPON5': '0.400', 'weapon4': '0.458', 'WEAPON3': '1.350', 'HITCOUNT': '2.570', 'weapon3': '2.802', 'DAMAGECOUNT': '9.969', 'FRAGCOUNT': '31.000'} [2023-02-24 20:30:57,851][213382] DAMAGECOUNT value on done: 40420.0 [2023-02-24 20:30:57,852][213382] Sum rewards: 31.433, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon7': '0.058', 'AMMO3': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'weapon5': '0.186', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'weapon4': '0.476', 'weapon2': '0.652', 'HEALTH': '1.336', 'HITCOUNT': '1.600', 'weapon3': '1.914', 'DAMAGECOUNT': '7.110', 'FRAGCOUNT': '25.000'} [2023-02-24 20:30:57,862][213384] DAMAGECOUNT value on done: 42009.0 [2023-02-24 20:30:57,863][213384] Sum rewards: 25.640, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.509', 'AMMO5': '0.011', 'AMMO2': '0.020', 'weapon7': '0.060', 'AMMO4': '0.097', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.147', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.268', 'weapon2': '0.384', 'WEAPON3': '0.800', 'weapon4': '1.026', 'HITCOUNT': '1.520', 'weapon3': '1.674', 'DAMAGECOUNT': '6.951', 'FRAGCOUNT': '22.000'} [2023-02-24 20:30:57,880][213367] DAMAGECOUNT value on done: 37281.0 [2023-02-24 20:30:57,880][213367] Sum rewards: 27.265, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.130', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO3': '0.087', 'AMMO4': '0.163', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.486', 'WEAPON3': '0.550', 'weapon4': '0.910', 'weapon3': '1.836', 'HITCOUNT': '1.950', 'DAMAGECOUNT': '8.382', 'FRAGCOUNT': '19.000'} [2023-02-24 20:30:57,915][213366] DAMAGECOUNT value on done: 42616.0 [2023-02-24 20:30:57,916][213366] Sum rewards: 23.707, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.382', 'AMMO5': '0.010', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.071', 'weapon4': '0.090', 'AMMO3': '0.119', 'WEAPON5': '0.250', 'weapon5': '0.320', 'WEAPON3': '0.700', 'weapon2': '1.384', 'HITCOUNT': '1.530', 'weapon3': '1.754', 'DAMAGECOUNT': '6.297', 'FRAGCOUNT': '19.000'} [2023-02-24 20:30:57,973][213368] DAMAGECOUNT value on done: 38447.0 [2023-02-24 20:30:58,084][213372] DAMAGECOUNT value on done: 39993.0 [2023-02-24 20:30:58,084][213372] Sum rewards: 23.227, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.126', 'AMMO5': '0.023', 'AMMO2': '0.033', 'AMMO3': '0.160', 'weapon4': '0.162', 'AMMO4': '0.164', 'WEAPON4': '0.300', 'weapon5': '0.594', 'WEAPON5': '0.600', 'weapon2': '0.748', 'WEAPON3': '1.000', 'HITCOUNT': '1.460', 'weapon3': '2.018', 'DAMAGECOUNT': '6.591', 'FRAGCOUNT': '22.000'} [2023-02-24 20:30:58,143][213382] DAMAGECOUNT value on done: 39057.0 [2023-02-24 20:30:58,143][213382] Sum rewards: 12.674, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.750', 'weapon4': '0.012', 'AMMO2': '0.015', 'AMMO5': '0.021', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'weapon5': '0.448', 'WEAPON5': '0.600', 'WEAPON3': '0.850', 'weapon2': '0.944', 'HITCOUNT': '1.100', 'weapon3': '2.080', 'DAMAGECOUNT': '4.557', 'FRAGCOUNT': '11.000'} [2023-02-24 20:30:58,168][213384] DAMAGECOUNT value on done: 38047.0 [2023-02-24 20:30:58,169][213384] Sum rewards: 21.562, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.426', 'AMMO2': '0.007', 'AMMO5': '0.015', 'AMMO4': '0.035', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'weapon5': '0.168', 'WEAPON5': '0.300', 'weapon4': '0.328', 'weapon2': '0.554', 'WEAPON3': '1.000', 'HITCOUNT': '1.760', 'weapon3': '2.256', 'DAMAGECOUNT': '6.516', 'FRAGCOUNT': '22.000'} [2023-02-24 20:30:58,170][213369] DAMAGECOUNT value on done: 38763.0 [2023-02-24 20:30:58,171][213369] Sum rewards: 24.612, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.842', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.079', 'AMMO3': '0.094', 'WEAPON4': '0.150', 'weapon4': '0.344', 'WEAPON5': '0.350', 'weapon5': '0.362', 'WEAPON3': '0.600', 'weapon2': '0.868', 'HITCOUNT': '1.210', 'weapon3': '1.962', 'DAMAGECOUNT': '6.375', 'FRAGCOUNT': '19.000'} [2023-02-24 20:30:58,177][213383] DAMAGECOUNT value on done: 38516.0 [2023-02-24 20:30:58,177][213383] Sum rewards: 16.271, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.714', 'ARMOR': '0.004', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.106', 'AMMO4': '0.132', 'WEAPON4': '0.250', 'weapon5': '0.330', 'WEAPON5': '0.450', 'weapon4': '0.664', 'WEAPON3': '0.700', 'weapon2': '0.922', 'HITCOUNT': '1.010', 'weapon3': '1.454', 'DAMAGECOUNT': '5.550', 'FRAGCOUNT': '14.000'} [2023-02-24 20:30:58,203][213366] DAMAGECOUNT value on done: 45376.0 [2023-02-24 20:30:58,204][213366] Sum rewards: 42.985, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.280', 'AMMO5': '0.029', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.194', 'WEAPON4': '0.400', 'weapon4': '0.456', 'weapon5': '0.472', 'weapon2': '0.536', 'WEAPON5': '0.750', 'WEAPON3': '1.200', 'weapon3': '2.050', 'HITCOUNT': '2.140', 'DAMAGECOUNT': '11.613', 'FRAGCOUNT': '38.000'} [2023-02-24 20:30:58,280][213368] DAMAGECOUNT value on done: 42884.0 [2023-02-24 20:30:58,281][213368] Sum rewards: 23.243, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.288', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.153', 'weapon5': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.268', 'weapon2': '0.628', 'WEAPON3': '0.900', 'HITCOUNT': '1.710', 'weapon3': '2.574', 'DAMAGECOUNT': '7.578', 'FRAGCOUNT': '21.000'} [2023-02-24 20:30:58,379][213372] DAMAGECOUNT value on done: 41557.0 [2023-02-24 20:30:58,380][213372] Sum rewards: 24.953, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.122', 'AMMO5': '0.022', 'AMMO2': '0.047', 'AMMO3': '0.144', 'AMMO4': '0.234', 'weapon4': '0.326', 'WEAPON4': '0.350', 'weapon2': '0.554', 'weapon5': '0.560', 'WEAPON5': '0.650', 'WEAPON3': '0.900', 'HITCOUNT': '1.700', 'weapon3': '2.078', 'DAMAGECOUNT': '8.010', 'FRAGCOUNT': '22.000'} [2023-02-24 20:30:58,448][213382] DAMAGECOUNT value on done: 41557.0 [2023-02-24 20:30:58,448][213382] Sum rewards: 12.695, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.335', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.013', 'WEAPON4': '0.100', 'weapon4': '0.116', 'AMMO3': '0.117', 'WEAPON5': '0.400', 'weapon5': '0.430', 'WEAPON3': '0.650', 'weapon2': '1.120', 'HITCOUNT': '1.310', 'weapon3': '1.944', 'DAMAGECOUNT': '4.590', 'FRAGCOUNT': '10.000'} [2023-02-24 20:30:58,466][213384] DAMAGECOUNT value on done: 42784.0 [2023-02-24 20:30:58,466][213384] Sum rewards: 13.734, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.198', 'AMMO5': '0.015', 'weapon4': '0.020', 'AMMO2': '0.033', 'weapon7': '0.054', 'AMMO3': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.146', 'WEAPON4': '0.150', 'AMMO4': '0.166', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.870', 'weapon3': '1.452', 'weapon2': '2.040', 'DAMAGECOUNT': '3.543', 'FRAGCOUNT': '11.000'} [2023-02-24 20:30:58,477][213369] DAMAGECOUNT value on done: 43718.0 [2023-02-24 20:30:58,477][213369] Sum rewards: 21.271, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.910', 'AMMO5': '0.019', 'AMMO2': '0.019', 'weapon7': '0.052', 'AMMO4': '0.097', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.129', 'weapon5': '0.184', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'weapon4': '0.874', 'weapon2': '0.894', 'weapon3': '1.498', 'HITCOUNT': '1.660', 'DAMAGECOUNT': '6.015', 'FRAGCOUNT': '18.000'} [2023-02-24 20:30:58,481][213383] DAMAGECOUNT value on done: 38677.0 [2023-02-24 20:30:58,481][213383] Sum rewards: 22.972, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.328', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO3': '0.097', 'WEAPON5': '0.550', 'weapon5': '0.586', 'WEAPON3': '0.650', 'weapon2': '0.902', 'HITCOUNT': '1.170', 'weapon3': '1.990', 'DAMAGECOUNT': '5.349', 'FRAGCOUNT': '18.000'} [2023-02-24 20:30:58,485][213368] DAMAGECOUNT value on done: 40206.0 [2023-02-24 20:30:58,486][213368] Sum rewards: 24.193, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.438', 'AMMO2': '0.006', 'AMMO5': '0.026', 'AMMO4': '0.031', 'AMMO3': '0.138', 'weapon5': '0.424', 'weapon2': '0.544', 'WEAPON5': '0.700', 'WEAPON3': '0.950', 'HITCOUNT': '1.540', 'weapon3': '2.612', 'DAMAGECOUNT': '6.909', 'FRAGCOUNT': '20.000'} [2023-02-24 20:30:58,496][213366] DAMAGECOUNT value on done: 35041.0 [2023-02-24 20:30:58,497][213366] Sum rewards: 24.857, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.852', 'AMMO2': '0.002', 'AMMO4': '0.012', 'AMMO5': '0.016', 'AMMO3': '0.159', 'weapon5': '0.340', 'WEAPON5': '0.450', 'weapon2': '0.656', 'WEAPON3': '1.000', 'HITCOUNT': '1.610', 'weapon3': '2.586', 'DAMAGECOUNT': '6.627', 'FRAGCOUNT': '22.000'} [2023-02-24 20:30:58,765][213384] DAMAGECOUNT value on done: 39073.0 [2023-02-24 20:30:58,766][213384] Sum rewards: 20.562, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.685', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO5': '0.011', 'AMMO4': '0.047', 'AMMO3': '0.093', 'weapon5': '0.256', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '0.600', 'weapon4': '0.840', 'weapon2': '0.944', 'HITCOUNT': '1.300', 'weapon3': '1.616', 'DAMAGECOUNT': '4.827', 'FRAGCOUNT': '16.000'} [2023-02-24 20:30:58,781][213368] DAMAGECOUNT value on done: 44586.0 [2023-02-24 20:30:58,781][213368] Sum rewards: 29.320, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.975', 'AMMO5': '0.016', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.173', 'WEAPON4': '0.250', 'weapon5': '0.406', 'WEAPON5': '0.450', 'weapon2': '0.482', 'weapon4': '0.630', 'WEAPON3': '1.100', 'HITCOUNT': '1.930', 'weapon3': '2.116', 'DAMAGECOUNT': '9.306', 'FRAGCOUNT': '25.500'} [2023-02-24 20:30:58,789][213369] DAMAGECOUNT value on done: 43087.0 [2023-02-24 20:30:58,789][213369] Sum rewards: 40.371, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.530', 'AMMO2': '0.012', 'AMMO5': '0.013', 'AMMO4': '0.057', 'weapon7': '0.064', 'AMMO3': '0.095', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon5': '0.350', 'weapon2': '0.622', 'WEAPON3': '0.650', 'weapon4': '0.898', 'weapon3': '1.746', 'HITCOUNT': '2.200', 'DAMAGECOUNT': '10.554', 'FRAGCOUNT': '31.000'} [2023-02-24 20:30:59,082][213369] DAMAGECOUNT value on done: 36781.0 [2023-02-24 20:30:59,083][213369] Sum rewards: 12.029, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.718', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.033', 'AMMO3': '0.142', 'AMMO4': '0.163', 'WEAPON4': '0.300', 'weapon4': '0.428', 'weapon5': '0.484', 'WEAPON5': '0.550', 'weapon2': '0.736', 'WEAPON3': '0.850', 'HITCOUNT': '1.110', 'weapon3': '1.980', 'DAMAGECOUNT': '5.196', 'FRAGCOUNT': '13.000'} [2023-02-24 20:30:59,746][213365] Updated weights for policy 0, policy_version 25666 (0.0009) [2023-02-24 20:31:00,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13926.4). Total num frames: 105132032. Throughput: 0: 3477.5. Samples: 1279354. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:31:00,243][213332] Avg episode reward: [(0, '22.552')] [2023-02-24 20:31:02,633][213365] Updated weights for policy 0, policy_version 25676 (0.0008) [2023-02-24 20:31:05,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13858.2, 300 sec: 13926.4). Total num frames: 105201664. Throughput: 0: 3479.9. Samples: 1289900. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:31:05,243][213332] Avg episode reward: [(0, '22.552')] [2023-02-24 20:31:05,566][213365] Updated weights for policy 0, policy_version 25686 (0.0009) [2023-02-24 20:31:08,524][213365] Updated weights for policy 0, policy_version 25696 (0.0009) [2023-02-24 20:31:10,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13926.4). Total num frames: 105271296. Throughput: 0: 3479.0. Samples: 1310700. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:31:10,244][213332] Avg episode reward: [(0, '22.552')] [2023-02-24 20:31:11,477][213365] Updated weights for policy 0, policy_version 25706 (0.0009) [2023-02-24 20:31:14,429][213365] Updated weights for policy 0, policy_version 25716 (0.0009) [2023-02-24 20:31:15,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13926.4). Total num frames: 105340928. Throughput: 0: 3478.1. Samples: 1331496. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:31:15,243][213332] Avg episode reward: [(0, '22.552')] [2023-02-24 20:31:16,363][213367] DAMAGECOUNT value on done: 40581.0 [2023-02-24 20:31:16,364][213367] Sum rewards: 26.905, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.875', 'AMMO5': '0.017', 'AMMO2': '0.025', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.134', 'WEAPON4': '0.200', 'weapon5': '0.336', 'WEAPON5': '0.500', 'weapon4': '0.724', 'weapon2': '0.834', 'WEAPON3': '0.900', 'weapon3': '1.702', 'HITCOUNT': '1.810', 'DAMAGECOUNT': '7.869', 'FRAGCOUNT': '23.000'} [2023-02-24 20:31:16,663][213367] DAMAGECOUNT value on done: 44850.0 [2023-02-24 20:31:16,663][213367] Sum rewards: 20.361, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.605', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO3': '0.116', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'weapon4': '0.390', 'WEAPON5': '0.400', 'weapon5': '0.420', 'weapon2': '0.488', 'WEAPON3': '0.800', 'HITCOUNT': '1.640', 'weapon3': '2.192', 'DAMAGECOUNT': '6.462', 'FRAGCOUNT': '17.000'} [2023-02-24 20:31:16,792][213372] DAMAGECOUNT value on done: 40214.0 [2023-02-24 20:31:16,792][213372] Sum rewards: 23.275, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.750', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon7': '0.056', 'AMMO3': '0.085', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO4': '0.208', 'weapon5': '0.382', 'WEAPON5': '0.450', 'WEAPON3': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.812', 'weapon4': '0.930', 'HITCOUNT': '1.290', 'weapon3': '1.396', 'DAMAGECOUNT': '5.955', 'FRAGCOUNT': '20.000'} [2023-02-24 20:31:16,808][213383] DAMAGECOUNT value on done: 43892.0 [2023-02-24 20:31:16,808][213383] Sum rewards: 27.545, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.410', 'ARMOR': '0.004', 'AMMO2': '0.012', 'AMMO5': '0.022', 'AMMO4': '0.060', 'weapon4': '0.170', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon5': '0.312', 'weapon2': '0.496', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'HITCOUNT': '1.770', 'weapon3': '2.432', 'DAMAGECOUNT': '7.590', 'FRAGCOUNT': '26.000'} [2023-02-24 20:31:16,887][213366] DAMAGECOUNT value on done: 41667.0 [2023-02-24 20:31:16,888][213366] Sum rewards: 17.487, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.371', 'AMMO5': '0.005', 'AMMO2': '0.046', 'AMMO3': '0.110', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO4': '0.231', 'WEAPON4': '0.550', 'weapon2': '0.622', 'WEAPON3': '0.650', 'weapon4': '1.106', 'HITCOUNT': '1.530', 'weapon3': '1.684', 'DAMAGECOUNT': '5.307', 'FRAGCOUNT': '18.000'} [2023-02-24 20:31:16,955][213382] DAMAGECOUNT value on done: 40691.0 [2023-02-24 20:31:16,955][213382] Sum rewards: 13.220, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.330', 'AMMO5': '0.019', 'AMMO2': '0.021', 'AMMO3': '0.040', 'AMMO4': '0.107', 'WEAPON3': '0.350', 'weapon5': '0.396', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'weapon4': '0.700', 'weapon2': '1.048', 'HITCOUNT': '1.240', 'weapon3': '1.338', 'DAMAGECOUNT': '4.341', 'FRAGCOUNT': '10.000'} [2023-02-24 20:31:16,973][213367] DAMAGECOUNT value on done: 40773.0 [2023-02-24 20:31:16,973][213367] Sum rewards: 32.762, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.078', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO4': '0.042', 'AMMO3': '0.145', 'weapon5': '0.416', 'weapon2': '0.418', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'HITCOUNT': '1.910', 'weapon3': '2.772', 'DAMAGECOUNT': '8.538', 'FRAGCOUNT': '27.000'} [2023-02-24 20:31:17,090][213372] DAMAGECOUNT value on done: 42736.0 [2023-02-24 20:31:17,090][213372] Sum rewards: 34.163, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.015', 'AMMO5': '0.015', 'AMMO2': '0.016', 'AMMO3': '0.068', 'AMMO4': '0.081', 'weapon2': '0.400', 'WEAPON4': '0.450', 'weapon5': '0.492', 'WEAPON3': '0.600', 'WEAPON5': '0.600', 'weapon4': '0.740', 'weapon3': '1.640', 'HITCOUNT': '1.940', 'DAMAGECOUNT': '9.135', 'FRAGCOUNT': '26.000'} [2023-02-24 20:31:17,113][213383] DAMAGECOUNT value on done: 46137.0 [2023-02-24 20:31:17,113][213383] Sum rewards: 32.063, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.422', 'AMMO5': '0.008', 'AMMO2': '0.035', 'AMMO3': '0.116', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO4': '0.174', 'WEAPON4': '0.250', 'weapon2': '0.558', 'WEAPON3': '0.750', 'weapon4': '0.768', 'HITCOUNT': '2.100', 'weapon3': '2.274', 'DAMAGECOUNT': '8.178', 'FRAGCOUNT': '26.000'} [2023-02-24 20:31:17,155][213384] DAMAGECOUNT value on done: 43523.0 [2023-02-24 20:31:17,156][213384] Sum rewards: 18.711, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'HEALTH': '0.080', 'AMMO3': '0.095', 'WEAPON5': '0.250', 'weapon5': '0.498', 'WEAPON3': '0.500', 'HITCOUNT': '0.840', 'weapon3': '1.424', 'weapon2': '1.674', 'DAMAGECOUNT': '4.542', 'FRAGCOUNT': '14.000'} [2023-02-24 20:31:17,185][213366] DAMAGECOUNT value on done: 44872.0 [2023-02-24 20:31:17,186][213366] Sum rewards: 21.405, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.142', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'AMMO3': '0.067', 'AMMO4': '0.192', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'WEAPON3': '0.500', 'weapon5': '0.518', 'weapon2': '0.728', 'weapon4': '0.856', 'weapon3': '1.072', 'HITCOUNT': '1.670', 'DAMAGECOUNT': '6.768', 'FRAGCOUNT': '16.000'} [2023-02-24 20:31:17,261][213382] DAMAGECOUNT value on done: 42713.0 [2023-02-24 20:31:17,262][213382] Sum rewards: 23.801, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.770', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.025', 'AMMO4': '0.122', 'AMMO3': '0.141', 'weapon4': '0.252', 'WEAPON4': '0.300', 'weapon5': '0.378', 'WEAPON5': '0.600', 'weapon2': '0.894', 'WEAPON3': '0.900', 'HITCOUNT': '1.590', 'weapon3': '1.966', 'DAMAGECOUNT': '6.879', 'FRAGCOUNT': '22.000'} [2023-02-24 20:31:17,282][213367] DAMAGECOUNT value on done: 39538.0 [2023-02-24 20:31:17,283][213367] Sum rewards: 26.354, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.936', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.090', 'AMMO3': '0.110', 'weapon4': '0.188', 'weapon5': '0.326', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'weapon2': '0.934', 'HITCOUNT': '1.560', 'weapon3': '2.310', 'DAMAGECOUNT': '6.771', 'FRAGCOUNT': '22.000'} [2023-02-24 20:31:17,313][213368] DAMAGECOUNT value on done: 40228.0 [2023-02-24 20:31:17,314][213368] Sum rewards: 16.744, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.820', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.156', 'WEAPON5': '0.350', 'weapon5': '0.474', 'weapon2': '0.774', 'WEAPON3': '1.000', 'HITCOUNT': '1.340', 'weapon3': '2.288', 'DAMAGECOUNT': '5.343', 'FRAGCOUNT': '15.000'} [2023-02-24 20:31:17,361][213365] Updated weights for policy 0, policy_version 25726 (0.0009) [2023-02-24 20:31:17,413][213372] DAMAGECOUNT value on done: 42673.0 [2023-02-24 20:31:17,413][213372] Sum rewards: 25.905, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.003', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon7': '0.050', 'AMMO4': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.298', 'weapon4': '0.534', 'weapon2': '0.652', 'WEAPON3': '1.100', 'HITCOUNT': '1.690', 'weapon3': '2.080', 'DAMAGECOUNT': '8.040', 'FRAGCOUNT': '25.000'} [2023-02-24 20:31:17,457][213384] DAMAGECOUNT value on done: 40227.0 [2023-02-24 20:31:17,457][213384] Sum rewards: 25.074, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.870', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.118', 'WEAPON4': '0.250', 'weapon4': '0.292', 'weapon2': '0.322', 'WEAPON5': '0.350', 'weapon5': '0.596', 'WEAPON3': '0.750', 'HITCOUNT': '1.750', 'weapon3': '2.320', 'DAMAGECOUNT': '6.540', 'FRAGCOUNT': '23.000'} [2023-02-24 20:31:17,497][213366] DAMAGECOUNT value on done: 47386.0 [2023-02-24 20:31:17,498][213366] Sum rewards: 13.886, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.564', 'AMMO5': '0.021', 'AMMO2': '0.028', 'AMMO4': '0.141', 'AMMO3': '0.158', 'weapon4': '0.308', 'weapon5': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.550', 'WEAPON3': '0.950', 'weapon2': '1.108', 'HITCOUNT': '1.510', 'weapon3': '1.964', 'DAMAGECOUNT': '6.030', 'FRAGCOUNT': '15.000'} [2023-02-24 20:31:17,550][213383] DAMAGECOUNT value on done: 42582.0 [2023-02-24 20:31:17,550][213383] Sum rewards: 37.386, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.386', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.052', 'weapon5': '0.124', 'WEAPON4': '0.150', 'weapon4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.272', 'weapon2': '0.576', 'WEAPON3': '1.650', 'weapon3': '2.696', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.198', 'FRAGCOUNT': '36.000'} [2023-02-24 20:31:17,558][213382] DAMAGECOUNT value on done: 41659.0 [2023-02-24 20:31:17,558][213382] Sum rewards: 24.890, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.173', 'ARMOR': '0.008', 'AMMO5': '0.026', 'AMMO2': '0.043', 'AMMO3': '0.126', 'weapon2': '0.212', 'AMMO4': '0.216', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon5': '0.502', 'weapon4': '0.720', 'WEAPON3': '0.800', 'HITCOUNT': '1.940', 'weapon3': '2.014', 'DAMAGECOUNT': '7.806', 'FRAGCOUNT': '22.000'} [2023-02-24 20:31:17,599][213369] DAMAGECOUNT value on done: 41134.0 [2023-02-24 20:31:17,599][213369] Sum rewards: 28.816, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.872', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'weapon5': '0.298', 'WEAPON4': '0.350', 'weapon2': '0.612', 'weapon4': '0.898', 'WEAPON3': '1.000', 'weapon3': '1.888', 'HITCOUNT': '2.030', 'DAMAGECOUNT': '7.113', 'FRAGCOUNT': '25.000'} [2023-02-24 20:31:17,615][213368] DAMAGECOUNT value on done: 45761.0 [2023-02-24 20:31:17,615][213368] Sum rewards: 27.392, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.412', 'AMMO5': '0.025', 'AMMO2': '0.046', 'AMMO3': '0.133', 'AMMO4': '0.229', 'weapon5': '0.338', 'WEAPON5': '0.600', 'WEAPON4': '0.600', 'weapon4': '0.604', 'weapon2': '0.774', 'WEAPON3': '0.800', 'HITCOUNT': '1.880', 'weapon3': '1.894', 'DAMAGECOUNT': '8.631', 'FRAGCOUNT': '25.000'} [2023-02-24 20:31:17,717][213372] DAMAGECOUNT value on done: 43528.0 [2023-02-24 20:31:17,717][213372] Sum rewards: 20.989, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.862', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO3': '0.082', 'AMMO4': '0.162', 'weapon4': '0.222', 'WEAPON4': '0.250', 'weapon5': '0.440', 'WEAPON5': '0.450', 'weapon2': '0.552', 'WEAPON3': '0.600', 'HITCOUNT': '1.280', 'weapon3': '2.352', 'DAMAGECOUNT': '5.913', 'FRAGCOUNT': '17.000'} [2023-02-24 20:31:17,769][213384] DAMAGECOUNT value on done: 44259.0 [2023-02-24 20:31:17,770][213384] Sum rewards: 10.814, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.320', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.018', 'AMMO3': '0.020', 'AMMO4': '0.088', 'WEAPON3': '0.150', 'weapon7': '0.176', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon5': '0.298', 'WEAPON5': '0.350', 'WEAPON7': '0.400', 'weapon2': '0.434', 'WEAPON4': '0.500', 'weapon3': '0.566', 'HITCOUNT': '0.730', 'weapon4': '0.984', 'DAMAGECOUNT': '4.425', 'FRAGCOUNT': '7.000'} [2023-02-24 20:31:17,797][213366] DAMAGECOUNT value on done: 37405.0 [2023-02-24 20:31:17,797][213366] Sum rewards: 25.675, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.588', 'AMMO2': '0.013', 'AMMO5': '0.015', 'ARMOR': '0.016', 'WEAPON4': '0.050', 'weapon4': '0.060', 'AMMO4': '0.063', 'AMMO3': '0.158', 'WEAPON5': '0.400', 'weapon2': '0.420', 'weapon5': '0.474', 'WEAPON3': '0.950', 'HITCOUNT': '1.690', 'weapon3': '2.612', 'DAMAGECOUNT': '7.092', 'FRAGCOUNT': '22.000'} [2023-02-24 20:31:17,831][213368] DAMAGECOUNT value on done: 43267.0 [2023-02-24 20:31:17,832][213368] Sum rewards: 34.187, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.010', 'AMMO5': '0.020', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.119', 'WEAPON4': '0.400', 'weapon2': '0.480', 'weapon4': '0.492', 'WEAPON5': '0.550', 'weapon5': '0.576', 'WEAPON3': '0.750', 'weapon3': '2.010', 'HITCOUNT': '2.230', 'DAMAGECOUNT': '9.183', 'FRAGCOUNT': '29.000'} [2023-02-24 20:31:17,854][213383] DAMAGECOUNT value on done: 39157.0 [2023-02-24 20:31:17,855][213383] Sum rewards: 4.925, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.532', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon7': '0.060', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.142', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon2': '0.286', 'HITCOUNT': '0.340', 'weapon4': '0.372', 'WEAPON3': '0.450', 'weapon3': '1.042', 'DAMAGECOUNT': '1.440', 'FRAGCOUNT': '5.000'} [2023-02-24 20:31:17,863][213382] DAMAGECOUNT value on done: 43703.0 [2023-02-24 20:31:17,864][213382] Sum rewards: 20.536, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.033', 'AMMO2': '0.014', 'AMMO5': '0.022', 'weapon7': '0.068', 'AMMO4': '0.069', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.152', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.354', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.766', 'WEAPON3': '1.050', 'HITCOUNT': '1.570', 'weapon3': '2.172', 'DAMAGECOUNT': '6.438', 'FRAGCOUNT': '19.500'} [2023-02-24 20:31:17,899][213369] DAMAGECOUNT value on done: 46350.0 [2023-02-24 20:31:17,900][213369] Sum rewards: 28.880, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.550', 'ARMOR': '0.004', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon7': '0.046', 'AMMO3': '0.068', 'AMMO4': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon5': '0.474', 'WEAPON3': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.678', 'weapon4': '0.998', 'weapon3': '1.456', 'HITCOUNT': '1.610', 'DAMAGECOUNT': '7.896', 'FRAGCOUNT': '22.000'} [2023-02-24 20:31:18,088][213384] DAMAGECOUNT value on done: 41430.0 [2023-02-24 20:31:18,089][213384] Sum rewards: 24.027, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.405', 'AMMO2': '0.004', 'AMMO5': '0.015', 'AMMO4': '0.019', 'WEAPON4': '0.100', 'AMMO3': '0.145', 'weapon4': '0.272', 'weapon5': '0.292', 'WEAPON5': '0.350', 'weapon2': '0.798', 'WEAPON3': '0.850', 'HITCOUNT': '1.680', 'weapon3': '2.336', 'DAMAGECOUNT': '7.071', 'FRAGCOUNT': '21.000'} [2023-02-24 20:31:18,160][213368] DAMAGECOUNT value on done: 46349.0 [2023-02-24 20:31:18,160][213368] Sum rewards: 19.135, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.862', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.139', 'AMMO4': '0.139', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.256', 'weapon2': '0.508', 'weapon4': '0.526', 'WEAPON3': '0.750', 'HITCOUNT': '1.080', 'weapon3': '1.498', 'DAMAGECOUNT': '5.289', 'FRAGCOUNT': '18.000'} [2023-02-24 20:31:18,222][213369] DAMAGECOUNT value on done: 45761.0 [2023-02-24 20:31:18,223][213369] Sum rewards: 25.747, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.972', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO3': '0.159', 'AMMO4': '0.193', 'weapon4': '0.208', 'weapon5': '0.228', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '0.950', 'weapon2': '1.084', 'HITCOUNT': '1.820', 'weapon3': '2.054', 'DAMAGECOUNT': '8.022', 'FRAGCOUNT': '24.000'} [2023-02-24 20:31:18,511][213369] DAMAGECOUNT value on done: 38498.0 [2023-02-24 20:31:18,511][213369] Sum rewards: 18.484, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.496', 'AMMO5': '0.008', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.089', 'AMMO3': '0.101', 'weapon4': '0.230', 'WEAPON5': '0.300', 'weapon5': '0.362', 'WEAPON3': '0.750', 'HITCOUNT': '1.240', 'weapon2': '1.324', 'weapon3': '1.836', 'DAMAGECOUNT': '5.151', 'FRAGCOUNT': '14.500'} [2023-02-24 20:31:20,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 105410560. Throughput: 0: 3475.4. Samples: 1341928. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:31:20,243][213332] Avg episode reward: [(0, '22.933')] [2023-02-24 20:31:20,320][213365] Updated weights for policy 0, policy_version 25736 (0.0009) [2023-02-24 20:31:23,258][213365] Updated weights for policy 0, policy_version 25746 (0.0009) [2023-02-24 20:31:24,683][213382] Large shaping reward 2.505 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.483, 161.0), ('weapon7', 0.002)] [2023-02-24 20:31:25,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13926.4). Total num frames: 105480192. Throughput: 0: 3472.8. Samples: 1362718. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:31:25,243][213332] Avg episode reward: [(0, '22.933')] [2023-02-24 20:31:26,220][213365] Updated weights for policy 0, policy_version 25756 (0.0009) [2023-02-24 20:31:29,193][213365] Updated weights for policy 0, policy_version 25766 (0.0009) [2023-02-24 20:31:30,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 105549824. Throughput: 0: 3469.4. Samples: 1383524. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:31:30,243][213332] Avg episode reward: [(0, '22.933')] [2023-02-24 20:31:32,126][213365] Updated weights for policy 0, policy_version 25776 (0.0009) [2023-02-24 20:31:35,065][213365] Updated weights for policy 0, policy_version 25786 (0.0008) [2023-02-24 20:31:35,243][213332] Fps is (10 sec: 13926.2, 60 sec: 13858.1, 300 sec: 13926.4). Total num frames: 105619456. Throughput: 0: 3471.2. Samples: 1393960. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:31:35,244][213332] Avg episode reward: [(0, '22.933')] [2023-02-24 20:31:35,739][213367] DAMAGECOUNT value on done: 42616.0 [2023-02-24 20:31:35,740][213367] Sum rewards: 20.287, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.711', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.037', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'weapon5': '0.286', 'WEAPON5': '0.300', 'weapon4': '0.406', 'weapon2': '0.648', 'WEAPON3': '0.800', 'HITCOUNT': '1.320', 'weapon3': '2.194', 'DAMAGECOUNT': '6.105', 'FRAGCOUNT': '18.000'} [2023-02-24 20:31:36,038][213367] DAMAGECOUNT value on done: 46948.0 [2023-02-24 20:31:36,038][213367] Sum rewards: 17.967, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.110', 'ARMOR': '0.004', 'AMMO5': '0.027', 'AMMO2': '0.038', 'weapon7': '0.100', 'AMMO3': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.188', 'WEAPON7': '0.200', 'weapon5': '0.226', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'weapon2': '0.706', 'WEAPON3': '0.750', 'weapon3': '1.142', 'weapon4': '1.168', 'HITCOUNT': '1.480', 'DAMAGECOUNT': '6.294', 'FRAGCOUNT': '17.000'} [2023-02-24 20:31:36,131][213372] DAMAGECOUNT value on done: 43183.0 [2023-02-24 20:31:36,132][213372] Sum rewards: 32.319, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.256', 'AMMO2': '0.020', 'AMMO5': '0.030', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'weapon4': '0.114', 'AMMO3': '0.143', 'weapon2': '0.304', 'weapon5': '0.586', 'WEAPON5': '0.750', 'WEAPON3': '1.050', 'HITCOUNT': '1.680', 'weapon3': '2.540', 'DAMAGECOUNT': '8.907', 'FRAGCOUNT': '28.000'} [2023-02-24 20:31:36,151][213383] DAMAGECOUNT value on done: 45796.0 [2023-02-24 20:31:36,152][213383] Sum rewards: 16.643, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.385', 'AMMO2': '0.009', 'AMMO5': '0.020', 'weapon7': '0.046', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.158', 'WEAPON7': '0.200', 'weapon2': '0.310', 'weapon5': '0.316', 'WEAPON5': '0.450', 'weapon4': '0.522', 'WEAPON3': '1.050', 'HITCOUNT': '1.330', 'weapon3': '2.288', 'DAMAGECOUNT': '5.442', 'FRAGCOUNT': '17.000'} [2023-02-24 20:31:36,295][213366] DAMAGECOUNT value on done: 44601.0 [2023-02-24 20:31:36,295][213366] Sum rewards: 30.243, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.188', 'weapon7': '0.006', 'AMMO5': '0.025', 'AMMO2': '0.034', 'AMMO3': '0.123', 'AMMO4': '0.171', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.324', 'WEAPON4': '0.350', 'weapon2': '0.356', 'weapon5': '0.364', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'HITCOUNT': '1.710', 'weapon3': '2.416', 'DAMAGECOUNT': '8.802', 'FRAGCOUNT': '26.000'} [2023-02-24 20:31:36,341][213367] DAMAGECOUNT value on done: 42792.0 [2023-02-24 20:31:36,342][213367] Sum rewards: 16.428, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.829', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.020', 'AMMO4': '0.098', 'AMMO3': '0.139', 'WEAPON4': '0.200', 'weapon5': '0.312', 'weapon4': '0.320', 'WEAPON5': '0.400', 'weapon2': '0.744', 'WEAPON3': '0.850', 'HITCOUNT': '1.390', 'weapon3': '2.200', 'DAMAGECOUNT': '6.057', 'FRAGCOUNT': '15.000'} [2023-02-24 20:31:36,406][213382] DAMAGECOUNT value on done: 43815.0 [2023-02-24 20:31:36,407][213382] Sum rewards: 27.881, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.318', 'AMMO5': '0.011', 'AMMO2': '0.053', 'AMMO3': '0.137', 'weapon5': '0.206', 'WEAPON5': '0.250', 'AMMO4': '0.263', 'weapon2': '0.268', 'ARMOR': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon4': '1.002', 'weapon3': '2.176', 'HITCOUNT': '2.360', 'DAMAGECOUNT': '9.372', 'FRAGCOUNT': '25.000'} [2023-02-24 20:31:36,438][213372] DAMAGECOUNT value on done: 44031.0 [2023-02-24 20:31:36,438][213372] Sum rewards: 10.726, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.827', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.014', 'weapon7': '0.052', 'AMMO4': '0.070', 'AMMO3': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.222', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON4': '0.400', 'WEAPON3': '0.700', 'weapon4': '0.874', 'HITCOUNT': '1.010', 'weapon3': '1.404', 'DAMAGECOUNT': '3.885', 'FRAGCOUNT': '11.000'} [2023-02-24 20:31:36,453][213383] DAMAGECOUNT value on done: 48552.0 [2023-02-24 20:31:36,453][213383] Sum rewards: 25.779, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.352', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.030', 'AMMO3': '0.105', 'AMMO4': '0.147', 'weapon4': '0.330', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon5': '0.510', 'WEAPON3': '0.650', 'weapon2': '0.904', 'HITCOUNT': '1.590', 'weapon3': '1.842', 'DAMAGECOUNT': '7.245', 'FRAGCOUNT': '22.000'} [2023-02-24 20:31:36,537][213384] DAMAGECOUNT value on done: 45707.0 [2023-02-24 20:31:36,537][213384] Sum rewards: 20.082, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.820', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon7': '0.074', 'AMMO3': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO4': '0.227', 'WEAPON5': '0.250', 'weapon5': '0.302', 'weapon2': '0.420', 'WEAPON4': '0.450', 'WEAPON3': '0.600', 'weapon3': '1.118', 'weapon4': '1.282', 'HITCOUNT': '1.780', 'DAMAGECOUNT': '6.552', 'FRAGCOUNT': '17.000'} [2023-02-24 20:31:36,601][213366] DAMAGECOUNT value on done: 46812.0 [2023-02-24 20:31:36,601][213366] Sum rewards: 21.596, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.447', 'AMMO2': '0.013', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'weapon4': '0.040', 'AMMO4': '0.064', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.450', 'weapon5': '0.488', 'WEAPON3': '0.650', 'HITCOUNT': '1.190', 'weapon2': '1.214', 'weapon3': '1.886', 'DAMAGECOUNT': '5.820', 'FRAGCOUNT': '17.000'} [2023-02-24 20:31:36,652][213367] DAMAGECOUNT value on done: 42371.0 [2023-02-24 20:31:36,653][213367] Sum rewards: 30.039, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.350', 'AMMO5': '0.016', 'AMMO2': '0.024', 'AMMO3': '0.107', 'AMMO4': '0.117', 'WEAPON4': '0.300', 'weapon5': '0.390', 'WEAPON5': '0.400', 'weapon2': '0.460', 'weapon4': '0.680', 'WEAPON3': '0.700', 'HITCOUNT': '2.040', 'weapon3': '2.076', 'DAMAGECOUNT': '8.079', 'FRAGCOUNT': '25.000'} [2023-02-24 20:31:36,721][213382] DAMAGECOUNT value on done: 45358.0 [2023-02-24 20:31:36,721][213382] Sum rewards: 20.511, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.180', 'AMMO5': '0.021', 'AMMO2': '0.039', 'weapon7': '0.070', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.154', 'weapon5': '0.172', 'AMMO4': '0.195', 'weapon2': '0.278', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.618', 'WEAPON3': '0.850', 'HITCOUNT': '1.560', 'weapon3': '2.552', 'DAMAGECOUNT': '7.932', 'FRAGCOUNT': '18.000'} [2023-02-24 20:31:36,773][213372] DAMAGECOUNT value on done: 44465.0 [2023-02-24 20:31:36,774][213372] Sum rewards: 17.813, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.436', 'AMMO2': '0.007', 'AMMO5': '0.015', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'weapon4': '0.132', 'AMMO3': '0.155', 'WEAPON5': '0.400', 'weapon2': '0.478', 'weapon5': '0.480', 'WEAPON3': '1.000', 'HITCOUNT': '1.180', 'weapon3': '2.442', 'DAMAGECOUNT': '5.376', 'FRAGCOUNT': '16.500'} [2023-02-24 20:31:36,782][213368] DAMAGECOUNT value on done: 42238.0 [2023-02-24 20:31:36,783][213368] Sum rewards: 26.204, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.540', 'AMMO5': '0.016', 'AMMO2': '0.024', 'AMMO3': '0.110', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'weapon4': '0.250', 'WEAPON5': '0.550', 'weapon5': '0.584', 'weapon2': '0.740', 'WEAPON3': '0.800', 'HITCOUNT': '1.170', 'weapon3': '1.948', 'DAMAGECOUNT': '6.030', 'FRAGCOUNT': '22.000'} [2023-02-24 20:31:36,856][213384] DAMAGECOUNT value on done: 42294.0 [2023-02-24 20:31:36,856][213384] Sum rewards: 19.082, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.607', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO4': '0.026', 'AMMO3': '0.118', 'WEAPON4': '0.300', 'weapon2': '0.380', 'weapon5': '0.442', 'WEAPON5': '0.550', 'weapon4': '0.666', 'WEAPON3': '0.850', 'HITCOUNT': '1.560', 'weapon3': '2.048', 'DAMAGECOUNT': '6.201', 'FRAGCOUNT': '16.000'} [2023-02-24 20:31:36,915][213366] DAMAGECOUNT value on done: 49572.0 [2023-02-24 20:31:36,916][213366] Sum rewards: 24.007, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.014', 'AMMO2': '0.031', 'AMMO3': '0.152', 'AMMO4': '0.155', 'WEAPON4': '0.250', 'weapon2': '0.330', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon5': '0.404', 'WEAPON3': '0.800', 'weapon4': '0.848', 'HEALTH': '0.938', 'HITCOUNT': '1.630', 'weapon3': '1.946', 'DAMAGECOUNT': '6.258', 'FRAGCOUNT': '20.000'} [2023-02-24 20:31:36,944][213383] DAMAGECOUNT value on done: 44463.0 [2023-02-24 20:31:36,945][213383] Sum rewards: 20.584, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.238', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO3': '0.097', 'WEAPON5': '0.250', 'weapon5': '0.486', 'WEAPON3': '0.650', 'weapon2': '1.246', 'HITCOUNT': '1.280', 'weapon3': '1.886', 'DAMAGECOUNT': '5.643', 'FRAGCOUNT': '17.000'} [2023-02-24 20:31:37,007][213369] DAMAGECOUNT value on done: 43418.0 [2023-02-24 20:31:37,007][213369] Sum rewards: 19.177, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.752', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.139', 'weapon5': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.444', 'WEAPON3': '0.650', 'weapon2': '0.754', 'HITCOUNT': '1.550', 'weapon3': '2.298', 'DAMAGECOUNT': '6.852', 'FRAGCOUNT': '17.000'} [2023-02-24 20:31:37,028][213382] DAMAGECOUNT value on done: 43924.0 [2023-02-24 20:31:37,029][213382] Sum rewards: 28.572, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.186', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO4': '0.077', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'weapon5': '0.504', 'weapon4': '0.520', 'weapon2': '0.712', 'WEAPON3': '0.800', 'HITCOUNT': '1.500', 'weapon3': '1.714', 'DAMAGECOUNT': '6.795', 'FRAGCOUNT': '25.000'} [2023-02-24 20:31:37,078][213372] DAMAGECOUNT value on done: 46424.0 [2023-02-24 20:31:37,079][213372] Sum rewards: 27.878, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.020', 'ARMOR': '0.008', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.046', 'AMMO3': '0.153', 'AMMO4': '0.230', 'weapon4': '0.356', 'weapon5': '0.372', 'WEAPON5': '0.400', 'weapon2': '0.426', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'HITCOUNT': '1.830', 'weapon3': '2.402', 'DAMAGECOUNT': '8.688', 'FRAGCOUNT': '27.000'} [2023-02-24 20:31:37,087][213368] DAMAGECOUNT value on done: 47743.0 [2023-02-24 20:31:37,088][213368] Sum rewards: 14.656, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.084', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.030', 'AMMO4': '0.147', 'AMMO3': '0.172', 'weapon5': '0.294', 'weapon4': '0.296', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon2': '0.426', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'HITCOUNT': '1.460', 'weapon3': '2.542', 'DAMAGECOUNT': '5.946', 'FRAGCOUNT': '16.500'} [2023-02-24 20:31:37,175][213384] DAMAGECOUNT value on done: 46510.0 [2023-02-24 20:31:37,175][213384] Sum rewards: 22.673, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.278', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.150', 'weapon4': '0.192', 'weapon2': '0.204', 'WEAPON5': '0.550', 'weapon5': '0.640', 'WEAPON3': '0.950', 'HITCOUNT': '1.470', 'weapon3': '2.398', 'DAMAGECOUNT': '6.753', 'FRAGCOUNT': '19.500'} [2023-02-24 20:31:37,219][213366] DAMAGECOUNT value on done: 40301.0 [2023-02-24 20:31:37,220][213366] Sum rewards: 27.121, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.584', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.026', 'WEAPON1': '0.040', 'AMMO4': '0.128', 'AMMO3': '0.138', 'weapon4': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.404', 'weapon5': '0.412', 'WEAPON5': '0.650', 'WEAPON3': '1.000', 'HITCOUNT': '1.880', 'weapon3': '2.590', 'DAMAGECOUNT': '8.688', 'FRAGCOUNT': '23.000'} [2023-02-24 20:31:37,241][213383] DAMAGECOUNT value on done: 41216.0 [2023-02-24 20:31:37,241][213383] Sum rewards: 23.101, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.127', 'AMMO4': '0.199', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon5': '0.334', 'HEALTH': '0.362', 'weapon2': '0.434', 'weapon4': '0.636', 'WEAPON3': '0.700', 'HITCOUNT': '1.500', 'weapon3': '2.234', 'DAMAGECOUNT': '6.177', 'FRAGCOUNT': '20.000'} [2023-02-24 20:31:37,306][213368] DAMAGECOUNT value on done: 45346.0 [2023-02-24 20:31:37,306][213368] Sum rewards: 23.207, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.292', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'WEAPON5': '0.200', 'weapon5': '0.378', 'WEAPON3': '0.800', 'weapon2': '0.934', 'HITCOUNT': '1.550', 'weapon3': '2.248', 'DAMAGECOUNT': '6.237', 'FRAGCOUNT': '20.000'} [2023-02-24 20:31:37,310][213369] DAMAGECOUNT value on done: 48689.0 [2023-02-24 20:31:37,311][213369] Sum rewards: 21.636, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.250', 'AMMO5': '0.026', 'AMMO2': '0.041', 'AMMO3': '0.120', 'AMMO4': '0.207', 'WEAPON4': '0.500', 'weapon4': '0.520', 'weapon5': '0.560', 'weapon2': '0.702', 'WEAPON3': '0.750', 'WEAPON5': '0.800', 'HITCOUNT': '1.490', 'weapon3': '1.652', 'DAMAGECOUNT': '7.017', 'FRAGCOUNT': '20.000'} [2023-02-24 20:31:37,341][213382] DAMAGECOUNT value on done: 45899.0 [2023-02-24 20:31:37,342][213382] Sum rewards: 22.838, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.571', 'AMMO2': '0.015', 'AMMO5': '0.018', 'AMMO4': '0.073', 'AMMO3': '0.085', 'WEAPON4': '0.250', 'weapon5': '0.326', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.534', 'weapon2': '1.186', 'HITCOUNT': '1.570', 'weapon3': '1.614', 'DAMAGECOUNT': '6.588', 'FRAGCOUNT': '17.000'} [2023-02-24 20:31:37,478][213384] DAMAGECOUNT value on done: 44773.0 [2023-02-24 20:31:37,479][213384] Sum rewards: 30.940, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.474', 'AMMO5': '0.030', 'AMMO2': '0.038', 'AMMO3': '0.155', 'AMMO4': '0.190', 'weapon4': '0.276', 'WEAPON4': '0.300', 'weapon5': '0.448', 'weapon2': '0.546', 'WEAPON5': '0.650', 'WEAPON3': '1.000', 'HITCOUNT': '2.180', 'weapon3': '2.322', 'DAMAGECOUNT': '10.029', 'FRAGCOUNT': '27.000'} [2023-02-24 20:31:37,597][213368] DAMAGECOUNT value on done: 49734.0 [2023-02-24 20:31:37,598][213368] Sum rewards: 36.647, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.546', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.130', 'AMMO3': '0.148', 'AMMO4': '0.202', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.504', 'weapon4': '0.828', 'WEAPON3': '0.900', 'weapon3': '2.118', 'HITCOUNT': '2.400', 'DAMAGECOUNT': '10.155', 'FRAGCOUNT': '31.000'} [2023-02-24 20:31:37,616][213369] DAMAGECOUNT value on done: 48180.0 [2023-02-24 20:31:37,616][213369] Sum rewards: 18.900, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.699', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.029', 'AMMO4': '0.144', 'AMMO3': '0.196', 'weapon5': '0.212', 'WEAPON4': '0.300', 'weapon2': '0.444', 'WEAPON5': '0.500', 'weapon4': '0.584', 'WEAPON3': '1.150', 'HITCOUNT': '1.350', 'weapon3': '2.300', 'DAMAGECOUNT': '7.116', 'FRAGCOUNT': '19.000'} [2023-02-24 20:31:37,918][213369] DAMAGECOUNT value on done: 40918.0 [2023-02-24 20:31:37,919][213369] Sum rewards: 27.334, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.010', 'AMMO2': '0.024', 'WEAPON4': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.132', 'weapon5': '0.146', 'WEAPON5': '0.300', 'HEALTH': '0.353', 'weapon4': '0.428', 'WEAPON3': '0.750', 'weapon2': '1.108', 'HITCOUNT': '1.810', 'weapon3': '2.042', 'DAMAGECOUNT': '7.260', 'FRAGCOUNT': '21.000'} [2023-02-24 20:31:38,070][213365] Updated weights for policy 0, policy_version 25796 (0.0009) [2023-02-24 20:31:40,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 105689088. Throughput: 0: 3466.8. Samples: 1414614. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:31:40,243][213332] Avg episode reward: [(0, '23.255')] [2023-02-24 20:31:40,979][213365] Updated weights for policy 0, policy_version 25806 (0.0009) [2023-02-24 20:31:43,904][213365] Updated weights for policy 0, policy_version 25816 (0.0009) [2023-02-24 20:31:45,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 105758720. Throughput: 0: 3472.7. Samples: 1435628. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:31:45,243][213332] Avg episode reward: [(0, '23.255')] [2023-02-24 20:31:46,861][213365] Updated weights for policy 0, policy_version 25826 (0.0009) [2023-02-24 20:31:49,828][213365] Updated weights for policy 0, policy_version 25836 (0.0010) [2023-02-24 20:31:50,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 105828352. Throughput: 0: 3468.7. Samples: 1445992. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:31:50,243][213332] Avg episode reward: [(0, '23.255')] [2023-02-24 20:31:52,799][213365] Updated weights for policy 0, policy_version 25846 (0.0009) [2023-02-24 20:31:54,762][213383] Large shaping reward 2.508 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.486, 162.0), ('weapon5', 0.002)] [2023-02-24 20:31:55,086][213367] DAMAGECOUNT value on done: 44858.0 [2023-02-24 20:31:55,086][213367] Sum rewards: 15.207, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.960', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO5': '0.027', 'AMMO4': '0.062', 'weapon4': '0.066', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'weapon5': '0.438', 'WEAPON5': '0.650', 'weapon2': '0.672', 'WEAPON3': '1.150', 'HITCOUNT': '1.590', 'weapon3': '2.310', 'DAMAGECOUNT': '6.546', 'FRAGCOUNT': '15.500'} [2023-02-24 20:31:55,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13926.4). Total num frames: 105897984. Throughput: 0: 3469.6. Samples: 1466830. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:31:55,243][213332] Avg episode reward: [(0, '23.197')] [2023-02-24 20:31:55,387][213367] DAMAGECOUNT value on done: 48923.0 [2023-02-24 20:31:55,388][213367] Sum rewards: 15.757, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.170', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.024', 'weapon4': '0.110', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'WEAPON5': '0.550', 'weapon5': '0.746', 'weapon2': '0.762', 'WEAPON3': '0.950', 'HITCOUNT': '1.020', 'weapon3': '1.868', 'DAMAGECOUNT': '5.925', 'FRAGCOUNT': '15.000'} [2023-02-24 20:31:55,390][213372] DAMAGECOUNT value on done: 45847.0 [2023-02-24 20:31:55,391][213372] Sum rewards: 26.728, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.444', 'AMMO5': '0.020', 'AMMO2': '0.037', 'AMMO3': '0.099', 'AMMO4': '0.186', 'WEAPON4': '0.350', 'weapon2': '0.412', 'weapon4': '0.470', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'weapon5': '0.762', 'HITCOUNT': '1.670', 'weapon3': '1.924', 'DAMAGECOUNT': '7.992', 'FRAGCOUNT': '22.000'} [2023-02-24 20:31:55,493][213383] DAMAGECOUNT value on done: 48096.0 [2023-02-24 20:31:55,493][213383] Sum rewards: 21.106, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.178', 'AMMO5': '0.021', 'AMMO2': '0.053', 'AMMO3': '0.150', 'AMMO4': '0.265', 'WEAPON4': '0.350', 'weapon4': '0.412', 'weapon5': '0.540', 'WEAPON5': '0.550', 'weapon2': '0.740', 'WEAPON3': '1.000', 'HITCOUNT': '1.350', 'weapon3': '1.952', 'DAMAGECOUNT': '6.900', 'FRAGCOUNT': '21.000'} [2023-02-24 20:31:55,682][213367] DAMAGECOUNT value on done: 45485.0 [2023-02-24 20:31:55,682][213367] Sum rewards: 25.624, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.220', 'AMMO2': '0.019', 'AMMO5': '0.023', 'AMMO4': '0.092', 'weapon4': '0.126', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon5': '0.428', 'WEAPON5': '0.550', 'weapon2': '0.572', 'WEAPON3': '1.050', 'HITCOUNT': '1.940', 'weapon3': '2.582', 'DAMAGECOUNT': '8.079', 'FRAGCOUNT': '23.000'} [2023-02-24 20:31:55,687][213366] DAMAGECOUNT value on done: 46954.0 [2023-02-24 20:31:55,687][213366] Sum rewards: 26.560, reward structure: {'DEATHCOUNT': '-9.750', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO3': '0.089', 'AMMO4': '0.169', 'HEALTH': '0.294', 'WEAPON5': '0.300', 'weapon5': '0.348', 'WEAPON4': '0.350', 'WEAPON3': '0.550', 'weapon4': '0.680', 'weapon2': '1.044', 'weapon3': '1.560', 'HITCOUNT': '1.810', 'DAMAGECOUNT': '7.059', 'FRAGCOUNT': '22.000'} [2023-02-24 20:31:55,692][213372] DAMAGECOUNT value on done: 46611.0 [2023-02-24 20:31:55,692][213372] Sum rewards: 25.665, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.272', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.032', 'AMMO4': '0.162', 'AMMO3': '0.199', 'weapon4': '0.210', 'WEAPON4': '0.300', 'weapon5': '0.302', 'weapon2': '0.502', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'HITCOUNT': '1.790', 'weapon3': '2.622', 'DAMAGECOUNT': '7.740', 'FRAGCOUNT': '25.000'} [2023-02-24 20:31:55,753][213365] Updated weights for policy 0, policy_version 25856 (0.0009) [2023-02-24 20:31:55,795][213382] DAMAGECOUNT value on done: 45176.0 [2023-02-24 20:31:55,795][213382] Sum rewards: 13.777, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.080', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.097', 'AMMO3': '0.101', 'weapon7': '0.140', 'WEAPON5': '0.150', 'weapon5': '0.196', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'weapon2': '0.470', 'WEAPON3': '0.600', 'weapon4': '0.706', 'HITCOUNT': '0.880', 'weapon3': '0.920', 'DAMAGECOUNT': '4.083', 'FRAGCOUNT': '13.000'} [2023-02-24 20:31:55,795][213383] DAMAGECOUNT value on done: 51102.0 [2023-02-24 20:31:55,796][213383] Sum rewards: 23.744, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.008', 'WEAPON1': '0.010', 'AMMO5': '0.028', 'AMMO2': '0.035', 'weapon4': '0.058', 'AMMO3': '0.113', 'AMMO4': '0.174', 'WEAPON4': '0.300', 'weapon2': '0.628', 'WEAPON3': '0.700', 'WEAPON5': '0.700', 'weapon5': '0.790', 'HITCOUNT': '1.250', 'weapon3': '2.066', 'DAMAGECOUNT': '7.650', 'FRAGCOUNT': '21.000'} [2023-02-24 20:31:55,930][213384] DAMAGECOUNT value on done: 48011.0 [2023-02-24 20:31:55,930][213384] Sum rewards: 23.855, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.970', 'AMMO5': '0.024', 'AMMO2': '0.028', 'AMMO3': '0.136', 'AMMO4': '0.138', 'weapon2': '0.300', 'WEAPON4': '0.350', 'weapon5': '0.616', 'weapon4': '0.650', 'WEAPON5': '0.700', 'WEAPON3': '0.850', 'HITCOUNT': '1.450', 'weapon3': '1.966', 'DAMAGECOUNT': '6.867', 'FRAGCOUNT': '23.000'} [2023-02-24 20:31:55,989][213367] DAMAGECOUNT value on done: 44586.0 [2023-02-24 20:31:55,990][213367] Sum rewards: 22.922, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.525', 'weapon4': '0.006', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'AMMO3': '0.162', 'WEAPON5': '0.300', 'weapon5': '0.426', 'WEAPON3': '0.950', 'weapon2': '0.974', 'HITCOUNT': '1.360', 'weapon3': '2.244', 'DAMAGECOUNT': '6.645', 'FRAGCOUNT': '21.000'} [2023-02-24 20:31:56,000][213366] DAMAGECOUNT value on done: 49245.0 [2023-02-24 20:31:56,000][213366] Sum rewards: 22.872, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.502', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO2': '0.033', 'weapon4': '0.142', 'AMMO3': '0.147', 'AMMO4': '0.163', 'WEAPON4': '0.200', 'weapon2': '0.540', 'WEAPON5': '0.600', 'weapon5': '0.682', 'WEAPON3': '0.850', 'HITCOUNT': '1.410', 'weapon3': '2.262', 'DAMAGECOUNT': '7.299', 'FRAGCOUNT': '20.500'} [2023-02-24 20:31:56,032][213372] DAMAGECOUNT value on done: 46944.0 [2023-02-24 20:31:56,033][213372] Sum rewards: 22.542, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.935', 'AMMO5': '0.014', 'AMMO2': '0.060', 'AMMO3': '0.152', 'weapon2': '0.228', 'AMMO4': '0.298', 'WEAPON5': '0.350', 'ARMOR': '0.404', 'weapon5': '0.468', 'WEAPON4': '0.600', 'weapon4': '0.838', 'WEAPON3': '0.900', 'HITCOUNT': '1.700', 'weapon3': '2.028', 'DAMAGECOUNT': '7.437', 'FRAGCOUNT': '23.000'} [2023-02-24 20:31:56,105][213382] DAMAGECOUNT value on done: 49225.0 [2023-02-24 20:31:56,106][213382] Sum rewards: 39.781, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.018', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.022', 'WEAPON4': '0.150', 'AMMO3': '0.237', 'weapon2': '0.238', 'weapon5': '0.248', 'WEAPON5': '0.250', 'weapon4': '0.298', 'WEAPON3': '1.350', 'HITCOUNT': '2.590', 'weapon3': '2.788', 'DAMAGECOUNT': '11.601', 'FRAGCOUNT': '36.000'} [2023-02-24 20:31:56,141][213368] DAMAGECOUNT value on done: 44204.0 [2023-02-24 20:31:56,142][213368] Sum rewards: 17.966, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.780', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'AMMO3': '0.127', 'AMMO4': '0.159', 'weapon5': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.576', 'weapon2': '0.586', 'WEAPON3': '0.800', 'HITCOUNT': '1.500', 'weapon3': '2.272', 'DAMAGECOUNT': '5.898', 'FRAGCOUNT': '18.000'} [2023-02-24 20:31:56,246][213384] DAMAGECOUNT value on done: 44810.0 [2023-02-24 20:31:56,246][213384] Sum rewards: 19.904, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.108', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.142', 'AMMO3': '0.154', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.290', 'weapon4': '0.410', 'weapon2': '0.874', 'WEAPON3': '1.000', 'HITCOUNT': '1.560', 'weapon3': '2.098', 'DAMAGECOUNT': '7.548', 'FRAGCOUNT': '18.000'} [2023-02-24 20:31:56,256][213383] DAMAGECOUNT value on done: 46205.0 [2023-02-24 20:31:56,256][213383] Sum rewards: 18.818, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.154', 'AMMO5': '0.015', 'AMMO2': '0.026', 'weapon4': '0.110', 'AMMO4': '0.128', 'AMMO3': '0.141', 'WEAPON4': '0.200', 'WEAPON5': '0.450', 'weapon5': '0.572', 'weapon2': '0.650', 'WEAPON3': '0.900', 'HITCOUNT': '1.210', 'weapon3': '2.344', 'DAMAGECOUNT': '5.226', 'FRAGCOUNT': '18.000'} [2023-02-24 20:31:56,298][213366] DAMAGECOUNT value on done: 52204.0 [2023-02-24 20:31:56,298][213366] Sum rewards: 24.460, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.410', 'AMMO2': '0.004', 'AMMO5': '0.013', 'AMMO4': '0.020', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon5': '0.262', 'WEAPON5': '0.350', 'weapon2': '0.380', 'weapon4': '0.590', 'WEAPON3': '1.250', 'HITCOUNT': '1.850', 'weapon3': '2.300', 'DAMAGECOUNT': '7.896', 'FRAGCOUNT': '22.000'} [2023-02-24 20:31:56,321][213372] DAMAGECOUNT value on done: 47827.0 [2023-02-24 20:31:56,321][213372] Sum rewards: 17.271, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.320', 'WEAPON1': '0.010', 'AMMO5': '0.024', 'AMMO2': '0.027', 'weapon7': '0.054', 'AMMO3': '0.055', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.132', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'weapon4': '0.426', 'weapon5': '0.440', 'WEAPON5': '0.600', 'HITCOUNT': '0.830', 'weapon3': '1.324', 'weapon2': '1.370', 'DAMAGECOUNT': '4.209', 'FRAGCOUNT': '14.000'} [2023-02-24 20:31:56,406][213369] DAMAGECOUNT value on done: 46090.0 [2023-02-24 20:31:56,406][213369] Sum rewards: 23.649, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.896', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.041', 'AMMO3': '0.163', 'AMMO4': '0.204', 'weapon5': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.442', 'weapon2': '0.584', 'WEAPON3': '1.050', 'HITCOUNT': '1.770', 'weapon3': '2.376', 'DAMAGECOUNT': '8.016', 'FRAGCOUNT': '22.000'} [2023-02-24 20:31:56,414][213382] DAMAGECOUNT value on done: 46860.0 [2023-02-24 20:31:56,415][213382] Sum rewards: 31.544, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.062', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.050', 'AMMO3': '0.172', 'AMMO4': '0.251', 'weapon2': '0.328', 'weapon5': '0.336', 'WEAPON5': '0.350', 'WEAPON4': '0.600', 'weapon4': '0.824', 'WEAPON3': '0.900', 'HITCOUNT': '2.090', 'weapon3': '2.126', 'DAMAGECOUNT': '8.808', 'FRAGCOUNT': '30.000'} [2023-02-24 20:31:56,447][213368] DAMAGECOUNT value on done: 50139.0 [2023-02-24 20:31:56,447][213368] Sum rewards: 27.948, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.370', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon7': '0.056', 'AMMO3': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.137', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon5': '0.362', 'weapon4': '0.362', 'WEAPON3': '0.700', 'weapon2': '0.910', 'HITCOUNT': '1.370', 'weapon3': '2.028', 'DAMAGECOUNT': '7.188', 'FRAGCOUNT': '24.000'} [2023-02-24 20:31:56,555][213383] DAMAGECOUNT value on done: 43220.0 [2023-02-24 20:31:56,555][213383] Sum rewards: 20.306, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.215', 'AMMO2': '0.010', 'AMMO5': '0.016', 'AMMO4': '0.048', 'weapon7': '0.096', 'AMMO3': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.400', 'weapon4': '0.604', 'WEAPON3': '0.700', 'weapon2': '0.726', 'HITCOUNT': '1.250', 'weapon3': '2.042', 'DAMAGECOUNT': '6.012', 'FRAGCOUNT': '17.000'} [2023-02-24 20:31:56,568][213384] DAMAGECOUNT value on done: 48868.0 [2023-02-24 20:31:56,568][213384] Sum rewards: 31.576, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.394', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.091', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'weapon5': '0.614', 'weapon2': '0.694', 'HITCOUNT': '1.490', 'weapon3': '2.238', 'DAMAGECOUNT': '7.074', 'FRAGCOUNT': '24.000'} [2023-02-24 20:31:56,600][213366] DAMAGECOUNT value on done: 43326.0 [2023-02-24 20:31:56,601][213366] Sum rewards: 31.653, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.160', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.027', 'AMMO3': '0.094', 'AMMO4': '0.134', 'WEAPON4': '0.350', 'weapon5': '0.490', 'weapon4': '0.510', 'weapon2': '0.548', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'HITCOUNT': '1.580', 'weapon3': '2.078', 'DAMAGECOUNT': '9.075', 'FRAGCOUNT': '25.000'} [2023-02-24 20:31:56,662][213368] DAMAGECOUNT value on done: 47447.0 [2023-02-24 20:31:56,663][213368] Sum rewards: 13.088, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.558', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.053', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon4': '0.222', 'WEAPON5': '0.300', 'weapon5': '0.364', 'weapon2': '0.504', 'WEAPON3': '1.150', 'HITCOUNT': '1.350', 'weapon3': '2.454', 'DAMAGECOUNT': '6.303', 'FRAGCOUNT': '15.000'} [2023-02-24 20:31:56,703][213369] DAMAGECOUNT value on done: 51004.0 [2023-02-24 20:31:56,704][213369] Sum rewards: 28.637, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.864', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO5': '0.022', 'AMMO4': '0.083', 'AMMO3': '0.094', 'WEAPON4': '0.250', 'WEAPON5': '0.500', 'weapon4': '0.516', 'weapon5': '0.532', 'weapon2': '0.598', 'WEAPON3': '0.650', 'HITCOUNT': '1.590', 'weapon3': '1.946', 'DAMAGECOUNT': '6.945', 'FRAGCOUNT': '24.000'} [2023-02-24 20:31:56,710][213382] DAMAGECOUNT value on done: 48245.0 [2023-02-24 20:31:56,710][213382] Sum rewards: 20.777, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.616', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO3': '0.162', 'AMMO4': '0.171', 'weapon5': '0.188', 'weapon2': '0.322', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.572', 'WEAPON3': '0.900', 'HITCOUNT': '1.620', 'weapon3': '2.516', 'DAMAGECOUNT': '7.038', 'FRAGCOUNT': '20.000'} [2023-02-24 20:31:56,871][213384] DAMAGECOUNT value on done: 47038.0 [2023-02-24 20:31:56,871][213384] Sum rewards: 18.163, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.144', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'weapon7': '0.062', 'AMMO4': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.175', 'weapon5': '0.336', 'weapon4': '0.352', 'weapon2': '0.430', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'HITCOUNT': '1.560', 'weapon3': '2.122', 'DAMAGECOUNT': '6.795', 'FRAGCOUNT': '16.000'} [2023-02-24 20:31:56,967][213368] DAMAGECOUNT value on done: 51437.0 [2023-02-24 20:31:56,968][213368] Sum rewards: 17.570, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.007', 'AMMO5': '0.016', 'HEALTH': '0.022', 'AMMO4': '0.032', 'WEAPON4': '0.100', 'weapon7': '0.106', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.190', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'weapon5': '0.400', 'WEAPON3': '0.650', 'weapon2': '0.780', 'HITCOUNT': '0.990', 'weapon3': '2.018', 'DAMAGECOUNT': '5.109', 'FRAGCOUNT': '13.000'} [2023-02-24 20:31:57,005][213369] DAMAGECOUNT value on done: 51066.0 [2023-02-24 20:31:57,005][213369] Sum rewards: 27.323, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.504', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.034', 'AMMO4': '0.171', 'AMMO3': '0.238', 'weapon4': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.252', 'weapon5': '0.340', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.070', 'weapon3': '2.744', 'DAMAGECOUNT': '8.658', 'FRAGCOUNT': '27.000'} [2023-02-24 20:31:57,295][213369] DAMAGECOUNT value on done: 42758.0 [2023-02-24 20:31:57,295][213369] Sum rewards: 16.367, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.752', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon7': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.145', 'AMMO3': '0.154', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.338', 'WEAPON5': '0.400', 'weapon5': '0.486', 'weapon2': '0.636', 'WEAPON3': '0.950', 'HITCOUNT': '1.240', 'weapon3': '2.136', 'DAMAGECOUNT': '5.520', 'FRAGCOUNT': '15.000'} [2023-02-24 20:31:58,731][213365] Updated weights for policy 0, policy_version 25866 (0.0009) [2023-02-24 20:32:00,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13912.5). Total num frames: 105967616. Throughput: 0: 3468.4. Samples: 1487572. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:32:00,244][213332] Avg episode reward: [(0, '23.299')] [2023-02-24 20:32:01,673][213365] Updated weights for policy 0, policy_version 25876 (0.0010) [2023-02-24 20:32:04,647][213365] Updated weights for policy 0, policy_version 25886 (0.0008) [2023-02-24 20:32:05,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13912.5). Total num frames: 106037248. Throughput: 0: 3468.9. Samples: 1498030. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:32:05,243][213332] Avg episode reward: [(0, '23.299')] [2023-02-24 20:32:07,625][213365] Updated weights for policy 0, policy_version 25896 (0.0009) [2023-02-24 20:32:10,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13858.1, 300 sec: 13898.6). Total num frames: 106102784. Throughput: 0: 3466.6. Samples: 1518716. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:32:10,243][213332] Avg episode reward: [(0, '23.299')] [2023-02-24 20:32:10,561][213365] Updated weights for policy 0, policy_version 25906 (0.0009) [2023-02-24 20:32:13,513][213365] Updated weights for policy 0, policy_version 25916 (0.0009) [2023-02-24 20:32:14,538][213367] DAMAGECOUNT value on done: 47958.0 [2023-02-24 20:32:14,538][213367] Sum rewards: 25.700, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.330', 'AMMO5': '0.014', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon4': '0.230', 'WEAPON4': '0.250', 'AMMO3': '0.278', 'weapon5': '0.278', 'WEAPON5': '0.400', 'weapon2': '0.510', 'WEAPON3': '1.550', 'HITCOUNT': '2.140', 'weapon3': '2.650', 'DAMAGECOUNT': '9.300', 'FRAGCOUNT': '26.000'} [2023-02-24 20:32:14,822][213372] DAMAGECOUNT value on done: 48725.0 [2023-02-24 20:32:14,823][213372] Sum rewards: 28.838, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.840', 'AMMO2': '0.007', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO4': '0.036', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'weapon5': '0.360', 'weapon4': '0.422', 'weapon2': '0.442', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.140', 'weapon3': '2.324', 'DAMAGECOUNT': '8.634', 'FRAGCOUNT': '27.000'} [2023-02-24 20:32:14,832][213367] DAMAGECOUNT value on done: 50886.0 [2023-02-24 20:32:14,832][213367] Sum rewards: 17.678, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.171', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'weapon5': '0.280', 'weapon4': '0.332', 'WEAPON5': '0.400', 'weapon2': '0.482', 'WEAPON3': '1.150', 'HITCOUNT': '1.490', 'weapon3': '2.594', 'DAMAGECOUNT': '5.889', 'FRAGCOUNT': '18.000'} [2023-02-24 20:32:14,849][213383] DAMAGECOUNT value on done: 49551.0 [2023-02-24 20:32:14,850][213383] Sum rewards: 16.466, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.670', 'AMMO5': '0.014', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'weapon7': '0.070', 'AMMO4': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.117', 'weapon2': '0.248', 'weapon5': '0.302', 'WEAPON5': '0.400', 'weapon4': '0.514', 'WEAPON3': '0.800', 'HITCOUNT': '0.890', 'weapon3': '1.702', 'DAMAGECOUNT': '4.365', 'FRAGCOUNT': '15.000'} [2023-02-24 20:32:15,087][213366] DAMAGECOUNT value on done: 49836.0 [2023-02-24 20:32:15,087][213366] Sum rewards: 29.790, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.432', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon7': '0.046', 'AMMO3': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.144', 'weapon5': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.626', 'WEAPON3': '0.700', 'weapon2': '0.726', 'HITCOUNT': '1.800', 'weapon3': '1.902', 'DAMAGECOUNT': '8.646', 'FRAGCOUNT': '25.000'} [2023-02-24 20:32:15,121][213372] DAMAGECOUNT value on done: 48847.0 [2023-02-24 20:32:15,122][213372] Sum rewards: 20.724, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.260', 'AMMO2': '0.022', 'AMMO5': '0.023', 'AMMO4': '0.107', 'AMMO3': '0.134', 'weapon2': '0.152', 'WEAPON4': '0.200', 'weapon5': '0.428', 'weapon4': '0.470', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'HITCOUNT': '1.550', 'weapon3': '2.290', 'DAMAGECOUNT': '6.708', 'FRAGCOUNT': '18.000'} [2023-02-24 20:32:15,131][213382] DAMAGECOUNT value on done: 47124.0 [2023-02-24 20:32:15,132][213382] Sum rewards: 20.891, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.990', 'ARMOR': '0.004', 'AMMO5': '0.027', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'weapon4': '0.042', 'AMMO3': '0.079', 'WEAPON4': '0.150', 'AMMO4': '0.160', 'WEAPON3': '0.550', 'weapon5': '0.634', 'WEAPON5': '0.650', 'weapon2': '1.246', 'HITCOUNT': '1.290', 'weapon3': '1.642', 'DAMAGECOUNT': '5.844', 'FRAGCOUNT': '15.500'} [2023-02-24 20:32:15,141][213367] DAMAGECOUNT value on done: 48064.0 [2023-02-24 20:32:15,141][213367] Sum rewards: 26.230, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.439', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon7': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.157', 'AMMO3': '0.157', 'WEAPON7': '0.200', 'weapon5': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.606', 'weapon4': '0.908', 'WEAPON3': '0.950', 'weapon3': '1.646', 'HITCOUNT': '1.720', 'DAMAGECOUNT': '7.737', 'FRAGCOUNT': '25.000'} [2023-02-24 20:32:15,157][213383] DAMAGECOUNT value on done: 53356.0 [2023-02-24 20:32:15,158][213383] Sum rewards: 27.721, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.250', 'AMMO2': '0.013', 'AMMO5': '0.024', 'weapon7': '0.048', 'AMMO4': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'weapon4': '0.198', 'WEAPON7': '0.200', 'weapon5': '0.548', 'WEAPON5': '0.600', 'weapon2': '0.688', 'WEAPON3': '0.700', 'HITCOUNT': '1.430', 'weapon3': '2.180', 'DAMAGECOUNT': '6.762', 'FRAGCOUNT': '24.000'} [2023-02-24 20:32:15,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13858.2, 300 sec: 13898.6). Total num frames: 106172416. Throughput: 0: 3467.1. Samples: 1539544. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:32:15,243][213332] Avg episode reward: [(0, '23.260')] [2023-02-24 20:32:15,394][213384] DAMAGECOUNT value on done: 49713.0 [2023-02-24 20:32:15,395][213384] Sum rewards: 17.491, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.370', 'AMMO2': '0.006', 'AMMO5': '0.020', 'AMMO4': '0.028', 'AMMO3': '0.103', 'WEAPON4': '0.150', 'weapon4': '0.272', 'weapon2': '0.424', 'weapon5': '0.576', 'WEAPON5': '0.600', 'WEAPON3': '0.650', 'HITCOUNT': '1.160', 'weapon3': '2.266', 'DAMAGECOUNT': '5.106', 'FRAGCOUNT': '14.000'} [2023-02-24 20:32:15,395][213366] DAMAGECOUNT value on done: 52131.0 [2023-02-24 20:32:15,395][213366] Sum rewards: 29.620, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.755', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO4': '0.095', 'weapon4': '0.128', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'weapon5': '0.276', 'WEAPON5': '0.550', 'weapon2': '0.676', 'WEAPON3': '1.200', 'HITCOUNT': '1.700', 'weapon3': '2.594', 'DAMAGECOUNT': '8.658', 'FRAGCOUNT': '28.000'} [2023-02-24 20:32:15,421][213372] DAMAGECOUNT value on done: 48705.0 [2023-02-24 20:32:15,421][213372] Sum rewards: 20.191, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.354', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO3': '0.100', 'WEAPON5': '0.300', 'weapon5': '0.472', 'WEAPON3': '0.650', 'HITCOUNT': '1.010', 'weapon2': '1.020', 'weapon3': '1.722', 'DAMAGECOUNT': '5.283', 'FRAGCOUNT': '16.000'} [2023-02-24 20:32:15,429][213382] DAMAGECOUNT value on done: 51653.0 [2023-02-24 20:32:15,429][213382] Sum rewards: 21.819, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.412', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon7': '0.090', 'AMMO4': '0.130', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'AMMO6': '0.260', 'AMMO7': '0.260', 'weapon5': '0.292', 'WEAPON7': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.538', 'weapon4': '0.564', 'WEAPON3': '1.000', 'HITCOUNT': '1.740', 'weapon3': '2.056', 'DAMAGECOUNT': '7.284', 'FRAGCOUNT': '20.000'} [2023-02-24 20:32:15,446][213367] DAMAGECOUNT value on done: 46627.0 [2023-02-24 20:32:15,446][213367] Sum rewards: 20.885, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.510', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.024', 'weapon4': '0.040', 'AMMO4': '0.120', 'AMMO3': '0.142', 'WEAPON4': '0.200', 'weapon5': '0.396', 'WEAPON5': '0.500', 'weapon2': '0.690', 'WEAPON3': '0.800', 'HITCOUNT': '1.600', 'weapon3': '2.482', 'DAMAGECOUNT': '6.123', 'FRAGCOUNT': '18.000'} [2023-02-24 20:32:15,513][213368] DAMAGECOUNT value on done: 46650.0 [2023-02-24 20:32:15,513][213368] Sum rewards: 25.741, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.334', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO3': '0.146', 'weapon5': '0.176', 'weapon2': '0.190', 'AMMO4': '0.193', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.860', 'WEAPON3': '0.900', 'HITCOUNT': '1.860', 'weapon3': '2.510', 'DAMAGECOUNT': '7.338', 'FRAGCOUNT': '24.000'} [2023-02-24 20:32:15,670][213383] DAMAGECOUNT value on done: 48028.0 [2023-02-24 20:32:15,671][213383] Sum rewards: 18.488, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.380', 'AMMO2': '0.009', 'AMMO5': '0.025', 'AMMO4': '0.047', 'AMMO3': '0.120', 'WEAPON4': '0.200', 'weapon4': '0.258', 'weapon5': '0.486', 'WEAPON5': '0.550', 'weapon2': '0.650', 'WEAPON3': '0.700', 'HITCOUNT': '1.350', 'weapon3': '2.004', 'DAMAGECOUNT': '5.469', 'FRAGCOUNT': '17.000'} [2023-02-24 20:32:15,688][213366] DAMAGECOUNT value on done: 54086.0 [2023-02-24 20:32:15,688][213366] Sum rewards: 17.822, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.542', 'AMMO5': '0.017', 'AMMO2': '0.028', 'weapon4': '0.064', 'AMMO3': '0.093', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'weapon5': '0.360', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '1.050', 'weapon3': '1.410', 'weapon2': '1.808', 'DAMAGECOUNT': '5.646', 'FRAGCOUNT': '14.000'} [2023-02-24 20:32:15,703][213384] DAMAGECOUNT value on done: 46248.0 [2023-02-24 20:32:15,704][213384] Sum rewards: 13.331, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.332', 'AMMO2': '0.012', 'AMMO5': '0.018', 'weapon7': '0.048', 'AMMO4': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.500', 'weapon5': '0.568', 'weapon4': '0.582', 'weapon2': '0.690', 'WEAPON3': '0.800', 'HITCOUNT': '0.970', 'weapon3': '1.628', 'DAMAGECOUNT': '4.314', 'FRAGCOUNT': '12.000'} [2023-02-24 20:32:15,725][213372] DAMAGECOUNT value on done: 49886.0 [2023-02-24 20:32:15,726][213372] Sum rewards: 21.364, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.601', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO3': '0.081', 'AMMO4': '0.099', 'weapon5': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.550', 'weapon4': '0.858', 'weapon3': '1.160', 'HITCOUNT': '1.290', 'weapon2': '1.326', 'DAMAGECOUNT': '6.177', 'FRAGCOUNT': '18.000'} [2023-02-24 20:32:15,730][213382] DAMAGECOUNT value on done: 49059.0 [2023-02-24 20:32:15,731][213382] Sum rewards: 21.207, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.314', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.017', 'WEAPON4': '0.050', 'weapon4': '0.086', 'AMMO3': '0.157', 'WEAPON5': '0.350', 'weapon5': '0.516', 'weapon2': '0.648', 'WEAPON3': '1.000', 'HITCOUNT': '1.460', 'weapon3': '2.364', 'DAMAGECOUNT': '6.597', 'FRAGCOUNT': '19.000'} [2023-02-24 20:32:15,772][213369] DAMAGECOUNT value on done: 48970.0 [2023-02-24 20:32:15,773][213369] Sum rewards: 22.265, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.740', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.036', 'AMMO4': '0.180', 'AMMO3': '0.196', 'weapon5': '0.296', 'weapon4': '0.396', 'weapon2': '0.408', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.050', 'weapon3': '2.530', 'DAMAGECOUNT': '8.640', 'FRAGCOUNT': '24.000'} [2023-02-24 20:32:15,815][213368] DAMAGECOUNT value on done: 52251.0 [2023-02-24 20:32:15,816][213368] Sum rewards: 18.006, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.990', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.033', 'AMMO4': '0.164', 'WEAPON4': '0.200', 'AMMO3': '0.247', 'weapon4': '0.352', 'weapon5': '0.522', 'weapon2': '0.548', 'WEAPON5': '0.650', 'WEAPON3': '1.500', 'HITCOUNT': '1.690', 'weapon3': '2.212', 'DAMAGECOUNT': '6.336', 'FRAGCOUNT': '21.000'} [2023-02-24 20:32:15,976][213383] DAMAGECOUNT value on done: 45394.0 [2023-02-24 20:32:15,977][213383] Sum rewards: 22.535, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.690', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.028', 'AMMO3': '0.141', 'AMMO4': '0.141', 'weapon5': '0.300', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.550', 'WEAPON3': '0.950', 'weapon4': '1.004', 'HITCOUNT': '1.310', 'weapon3': '2.050', 'DAMAGECOUNT': '6.522', 'FRAGCOUNT': '22.000'} [2023-02-24 20:32:15,995][213366] DAMAGECOUNT value on done: 46123.0 [2023-02-24 20:32:15,995][213366] Sum rewards: 21.016, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.700', 'WEAPON1': '0.010', 'AMMO5': '0.021', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.179', 'WEAPON4': '0.300', 'weapon5': '0.360', 'weapon4': '0.468', 'weapon2': '0.490', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'HITCOUNT': '1.730', 'weapon3': '2.340', 'DAMAGECOUNT': '8.391', 'FRAGCOUNT': '18.000'} [2023-02-24 20:32:16,016][213384] DAMAGECOUNT value on done: 50466.0 [2023-02-24 20:32:16,017][213384] Sum rewards: 19.137, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.710', 'AMMO5': '0.014', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon4': '0.082', 'AMMO3': '0.083', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.350', 'weapon5': '0.376', 'WEAPON3': '0.550', 'weapon2': '1.176', 'HITCOUNT': '1.210', 'weapon3': '1.938', 'DAMAGECOUNT': '4.794', 'FRAGCOUNT': '15.000'} [2023-02-24 20:32:16,039][213368] DAMAGECOUNT value on done: 49548.0 [2023-02-24 20:32:16,039][213368] Sum rewards: 20.346, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.340', 'AMMO2': '0.011', 'AMMO5': '0.012', 'AMMO4': '0.057', 'AMMO3': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.334', 'weapon5': '0.484', 'weapon2': '0.514', 'WEAPON3': '0.750', 'HITCOUNT': '1.620', 'weapon3': '2.328', 'DAMAGECOUNT': '6.201', 'FRAGCOUNT': '17.000'} [2023-02-24 20:32:16,041][213382] DAMAGECOUNT value on done: 50315.0 [2023-02-24 20:32:16,041][213382] Sum rewards: 18.611, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.309', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon7': '0.016', 'AMMO4': '0.068', 'AMMO3': '0.076', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.760', 'weapon2': '0.994', 'HITCOUNT': '1.460', 'weapon3': '1.468', 'DAMAGECOUNT': '6.210', 'FRAGCOUNT': '15.000'} [2023-02-24 20:32:16,084][213369] DAMAGECOUNT value on done: 54057.0 [2023-02-24 20:32:16,084][213369] Sum rewards: 31.372, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.941', 'AMMO2': '0.006', 'AMMO5': '0.017', 'AMMO4': '0.027', 'WEAPON4': '0.100', 'AMMO3': '0.158', 'weapon4': '0.202', 'weapon5': '0.328', 'WEAPON5': '0.450', 'weapon2': '0.750', 'WEAPON3': '0.950', 'HITCOUNT': '2.020', 'weapon3': '2.396', 'DAMAGECOUNT': '9.159', 'FRAGCOUNT': '27.000'} [2023-02-24 20:32:16,314][213384] DAMAGECOUNT value on done: 49249.0 [2023-02-24 20:32:16,315][213384] Sum rewards: 19.326, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.437', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.149', 'weapon4': '0.172', 'WEAPON4': '0.350', 'weapon5': '0.446', 'WEAPON5': '0.500', 'weapon2': '0.784', 'WEAPON3': '1.050', 'HITCOUNT': '1.740', 'weapon3': '2.250', 'DAMAGECOUNT': '6.633', 'FRAGCOUNT': '21.000'} [2023-02-24 20:32:16,338][213368] DAMAGECOUNT value on done: 53493.0 [2023-02-24 20:32:16,338][213368] Sum rewards: 21.909, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.504', 'AMMO2': '0.015', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.072', 'AMMO3': '0.118', 'WEAPON4': '0.250', 'weapon5': '0.350', 'weapon2': '0.396', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'weapon4': '0.844', 'HITCOUNT': '1.310', 'weapon3': '2.106', 'DAMAGECOUNT': '6.165', 'FRAGCOUNT': '19.500'} [2023-02-24 20:32:16,397][213369] DAMAGECOUNT value on done: 53168.0 [2023-02-24 20:32:16,398][213369] Sum rewards: 20.701, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.226', 'AMMO5': '0.020', 'AMMO2': '0.034', 'AMMO4': '0.170', 'AMMO3': '0.170', 'weapon2': '0.170', 'WEAPON4': '0.250', 'weapon5': '0.466', 'WEAPON5': '0.550', 'weapon4': '0.656', 'WEAPON3': '1.050', 'HITCOUNT': '1.350', 'weapon3': '1.984', 'DAMAGECOUNT': '6.306', 'FRAGCOUNT': '21.000'} [2023-02-24 20:32:16,519][213365] Updated weights for policy 0, policy_version 25926 (0.0009) [2023-02-24 20:32:16,702][213369] DAMAGECOUNT value on done: 45153.0 [2023-02-24 20:32:16,702][213369] Sum rewards: 24.967, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.148', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.026', 'AMMO3': '0.103', 'AMMO4': '0.132', 'weapon5': '0.422', 'weapon2': '0.424', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'weapon4': '0.728', 'WEAPON3': '0.800', 'HITCOUNT': '1.520', 'weapon3': '2.102', 'DAMAGECOUNT': '7.185', 'FRAGCOUNT': '24.000'} [2023-02-24 20:32:19,424][213365] Updated weights for policy 0, policy_version 25936 (0.0009) [2023-02-24 20:32:20,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13858.2, 300 sec: 13898.6). Total num frames: 106242048. Throughput: 0: 3464.8. Samples: 1549876. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:32:20,243][213332] Avg episode reward: [(0, '22.656')] [2023-02-24 20:32:21,715][213384] Large shaping reward 2.526 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.096, -32.0), ('weapon5', 0.002)] [2023-02-24 20:32:22,349][213365] Updated weights for policy 0, policy_version 25946 (0.0009) [2023-02-24 20:32:24,860][213367] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 20:32:25,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13898.6). Total num frames: 106311680. Throughput: 0: 3470.9. Samples: 1570806. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:32:25,243][213332] Avg episode reward: [(0, '22.656')] [2023-02-24 20:32:25,317][213365] Updated weights for policy 0, policy_version 25956 (0.0009) [2023-02-24 20:32:28,295][213365] Updated weights for policy 0, policy_version 25966 (0.0009) [2023-02-24 20:32:30,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13898.6). Total num frames: 106381312. Throughput: 0: 3465.3. Samples: 1591568. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:32:30,243][213332] Avg episode reward: [(0, '22.656')] [2023-02-24 20:32:31,225][213365] Updated weights for policy 0, policy_version 25976 (0.0009) [2023-02-24 20:32:33,860][213367] DAMAGECOUNT value on done: 50648.0 [2023-02-24 20:32:33,860][213367] Sum rewards: 21.724, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.432', 'AMMO5': '0.018', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.146', 'WEAPON4': '0.300', 'weapon5': '0.350', 'weapon4': '0.414', 'WEAPON5': '0.450', 'weapon2': '0.472', 'WEAPON3': '0.950', 'HITCOUNT': '1.840', 'weapon3': '2.284', 'DAMAGECOUNT': '8.070', 'FRAGCOUNT': '20.000'} [2023-02-24 20:32:34,141][213372] DAMAGECOUNT value on done: 51638.0 [2023-02-24 20:32:34,141][213372] Sum rewards: 31.632, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.150', 'AMMO2': '0.009', 'AMMO5': '0.015', 'AMMO4': '0.043', 'weapon4': '0.094', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'weapon5': '0.426', 'WEAPON5': '0.450', 'weapon2': '0.666', 'WEAPON3': '0.700', 'HITCOUNT': '1.860', 'weapon3': '2.454', 'DAMAGECOUNT': '8.319', 'FRAGCOUNT': '25.000'} [2023-02-24 20:32:34,159][213367] DAMAGECOUNT value on done: 52496.0 [2023-02-24 20:32:34,159][213367] Sum rewards: 17.253, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.120', 'AMMO2': '0.010', 'AMMO5': '0.011', 'AMMO4': '0.049', 'AMMO3': '0.075', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'weapon5': '0.490', 'HITCOUNT': '1.070', 'weapon3': '1.330', 'weapon2': '2.008', 'DAMAGECOUNT': '4.830', 'FRAGCOUNT': '12.000'} [2023-02-24 20:32:34,176][213365] Updated weights for policy 0, policy_version 25986 (0.0009) [2023-02-24 20:32:34,242][213383] DAMAGECOUNT value on done: 51569.0 [2023-02-24 20:32:34,243][213383] Sum rewards: 14.819, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.310', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon4': '0.176', 'AMMO3': '0.183', 'weapon5': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'weapon2': '1.014', 'WEAPON3': '1.100', 'HITCOUNT': '1.510', 'weapon3': '2.350', 'DAMAGECOUNT': '6.054', 'FRAGCOUNT': '15.000'} [2023-02-24 20:32:34,449][213367] DAMAGECOUNT value on done: 49735.0 [2023-02-24 20:32:34,449][213367] Sum rewards: 21.790, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.816', 'AMMO5': '0.013', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.078', 'AMMO3': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.400', 'weapon4': '0.412', 'WEAPON3': '0.500', 'weapon5': '0.518', 'HITCOUNT': '1.110', 'weapon2': '1.124', 'weapon3': '1.674', 'DAMAGECOUNT': '5.013', 'FRAGCOUNT': '16.000'} [2023-02-24 20:32:34,449][213372] DAMAGECOUNT value on done: 51466.0 [2023-02-24 20:32:34,449][213372] Sum rewards: 26.661, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.043', 'AMMO5': '0.007', 'AMMO2': '0.032', 'AMMO3': '0.108', 'AMMO4': '0.161', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.380', 'weapon5': '0.402', 'WEAPON3': '0.700', 'weapon2': '0.990', 'HITCOUNT': '1.870', 'weapon3': '1.946', 'DAMAGECOUNT': '7.857', 'FRAGCOUNT': '21.000'} [2023-02-24 20:32:34,476][213366] DAMAGECOUNT value on done: 52734.0 [2023-02-24 20:32:34,476][213366] Sum rewards: 30.833, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.095', 'AMMO5': '0.010', 'weapon7': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.106', 'weapon5': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.742', 'WEAPON3': '0.750', 'weapon4': '0.898', 'weapon3': '1.902', 'HITCOUNT': '2.000', 'DAMAGECOUNT': '8.694', 'FRAGCOUNT': '27.000'} [2023-02-24 20:32:34,500][213382] DAMAGECOUNT value on done: 49964.0 [2023-02-24 20:32:34,500][213382] Sum rewards: 31.505, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.934', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO2': '0.028', 'AMMO3': '0.138', 'AMMO4': '0.141', 'WEAPON4': '0.350', 'weapon4': '0.406', 'weapon5': '0.518', 'WEAPON5': '0.600', 'WEAPON3': '0.850', 'weapon2': '0.908', 'weapon3': '1.658', 'HITCOUNT': '1.780', 'DAMAGECOUNT': '8.520', 'FRAGCOUNT': '28.000'} [2023-02-24 20:32:34,552][213383] DAMAGECOUNT value on done: 55647.0 [2023-02-24 20:32:34,553][213383] Sum rewards: 27.675, reward structure: {'DEATHCOUNT': '-9.000', 'ARMOR': '0.004', 'AMMO5': '0.010', 'HEALTH': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.135', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.446', 'weapon4': '0.478', 'weapon5': '0.592', 'WEAPON3': '0.700', 'HITCOUNT': '1.610', 'weapon3': '2.144', 'DAMAGECOUNT': '6.873', 'FRAGCOUNT': '23.000'} [2023-02-24 20:32:34,740][213372] DAMAGECOUNT value on done: 51635.0 [2023-02-24 20:32:34,741][213372] Sum rewards: 31.789, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.463', 'AMMO5': '0.017', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.124', 'WEAPON4': '0.200', 'weapon2': '0.316', 'weapon4': '0.404', 'WEAPON5': '0.450', 'weapon5': '0.512', 'WEAPON3': '0.750', 'HITCOUNT': '1.890', 'weapon3': '2.406', 'DAMAGECOUNT': '8.790', 'FRAGCOUNT': '26.000'} [2023-02-24 20:32:34,742][213367] DAMAGECOUNT value on done: 48585.0 [2023-02-24 20:32:34,742][213367] Sum rewards: 18.600, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.484', 'AMMO2': '0.021', 'AMMO5': '0.028', 'AMMO3': '0.098', 'AMMO4': '0.104', 'WEAPON4': '0.450', 'weapon2': '0.478', 'weapon5': '0.510', 'WEAPON3': '0.600', 'WEAPON5': '0.650', 'weapon4': '0.694', 'HITCOUNT': '1.220', 'weapon3': '1.608', 'DAMAGECOUNT': '5.874', 'FRAGCOUNT': '19.000'} [2023-02-24 20:32:34,764][213366] DAMAGECOUNT value on done: 54629.0 [2023-02-24 20:32:34,764][213366] Sum rewards: 25.492, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.301', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.087', 'AMMO3': '0.119', 'weapon4': '0.120', 'WEAPON4': '0.200', 'weapon2': '0.498', 'WEAPON5': '0.600', 'weapon5': '0.652', 'WEAPON3': '0.900', 'HITCOUNT': '1.690', 'weapon3': '2.378', 'DAMAGECOUNT': '7.494', 'FRAGCOUNT': '22.000'} [2023-02-24 20:32:34,806][213382] DAMAGECOUNT value on done: 53995.0 [2023-02-24 20:32:34,807][213382] Sum rewards: 27.496, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.304', 'ARMOR': '0.008', 'AMMO5': '0.024', 'AMMO2': '0.029', 'AMMO3': '0.082', 'AMMO4': '0.147', 'WEAPON4': '0.250', 'weapon4': '0.376', 'WEAPON3': '0.500', 'weapon2': '0.548', 'WEAPON5': '0.600', 'weapon5': '0.652', 'HITCOUNT': '1.470', 'weapon3': '2.088', 'DAMAGECOUNT': '7.026', 'FRAGCOUNT': '23.000'} [2023-02-24 20:32:34,808][213384] DAMAGECOUNT value on done: 52037.0 [2023-02-24 20:32:34,809][213384] Sum rewards: 25.463, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.316', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.033', 'AMMO3': '0.070', 'AMMO4': '0.162', 'WEAPON4': '0.300', 'WEAPON5': '0.500', 'WEAPON3': '0.500', 'weapon5': '0.558', 'weapon2': '0.726', 'weapon4': '0.884', 'weapon3': '1.586', 'HITCOUNT': '1.960', 'DAMAGECOUNT': '6.972', 'FRAGCOUNT': '20.000'} [2023-02-24 20:32:34,863][213368] DAMAGECOUNT value on done: 48818.0 [2023-02-24 20:32:34,864][213368] Sum rewards: 27.090, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.410', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.063', 'AMMO3': '0.083', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.276', 'weapon4': '0.396', 'WEAPON3': '0.450', 'weapon2': '0.702', 'HITCOUNT': '1.730', 'weapon3': '2.322', 'DAMAGECOUNT': '6.504', 'FRAGCOUNT': '22.000'} [2023-02-24 20:32:35,044][213372] DAMAGECOUNT value on done: 52589.0 [2023-02-24 20:32:35,044][213372] Sum rewards: 30.972, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.147', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'AMMO2': '0.029', 'AMMO3': '0.117', 'AMMO4': '0.146', 'weapon5': '0.160', 'WEAPON4': '0.300', 'weapon4': '0.436', 'WEAPON5': '0.500', 'weapon2': '0.804', 'WEAPON3': '0.850', 'HITCOUNT': '1.930', 'weapon3': '2.220', 'DAMAGECOUNT': '8.079', 'FRAGCOUNT': '28.000'} [2023-02-24 20:32:35,064][213366] DAMAGECOUNT value on done: 55392.0 [2023-02-24 20:32:35,065][213366] Sum rewards: 17.218, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.632', 'ARMOR': '0.004', 'AMMO2': '0.016', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.079', 'weapon4': '0.088', 'AMMO3': '0.089', 'weapon5': '0.516', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'weapon2': '0.936', 'HITCOUNT': '0.990', 'weapon3': '2.126', 'DAMAGECOUNT': '3.918', 'FRAGCOUNT': '14.000'} [2023-02-24 20:32:35,100][213383] DAMAGECOUNT value on done: 50254.0 [2023-02-24 20:32:35,101][213383] Sum rewards: 26.343, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.370', 'AMMO2': '0.012', 'weapon4': '0.012', 'AMMO5': '0.012', 'AMMO3': '0.050', 'AMMO4': '0.057', 'weapon7': '0.062', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'weapon5': '0.432', 'HITCOUNT': '0.930', 'weapon2': '1.008', 'weapon3': '1.926', 'DAMAGECOUNT': '6.471', 'FRAGCOUNT': '19.000'} [2023-02-24 20:32:35,110][213382] DAMAGECOUNT value on done: 50844.0 [2023-02-24 20:32:35,110][213382] Sum rewards: 17.733, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.350', 'ARMOR': '0.013', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon7': '0.046', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.111', 'AMMO4': '0.147', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon5': '0.440', 'weapon2': '0.526', 'weapon4': '0.632', 'WEAPON3': '0.750', 'HITCOUNT': '1.330', 'weapon3': '1.338', 'DAMAGECOUNT': '5.355', 'FRAGCOUNT': '18.000'} [2023-02-24 20:32:35,112][213384] DAMAGECOUNT value on done: 48480.0 [2023-02-24 20:32:35,113][213384] Sum rewards: 23.478, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.708', 'AMMO5': '0.020', 'AMMO2': '0.027', 'AMMO3': '0.130', 'AMMO4': '0.136', 'WEAPON4': '0.350', 'weapon5': '0.352', 'weapon2': '0.406', 'weapon4': '0.494', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'HITCOUNT': '1.490', 'weapon3': '2.464', 'DAMAGECOUNT': '6.666', 'FRAGCOUNT': '21.000'} [2023-02-24 20:32:35,166][213368] DAMAGECOUNT value on done: 54310.0 [2023-02-24 20:32:35,167][213368] Sum rewards: 21.910, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.011', 'AMMO5': '0.017', 'AMMO4': '0.057', 'HEALTH': '0.082', 'AMMO3': '0.105', 'WEAPON4': '0.150', 'weapon5': '0.338', 'WEAPON5': '0.400', 'weapon4': '0.442', 'weapon2': '0.470', 'WEAPON3': '0.600', 'HITCOUNT': '1.400', 'weapon3': '2.160', 'DAMAGECOUNT': '6.177', 'FRAGCOUNT': '17.000'} [2023-02-24 20:32:35,171][213369] DAMAGECOUNT value on done: 51827.0 [2023-02-24 20:32:35,171][213369] Sum rewards: 28.562, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.259', 'AMMO5': '0.013', 'AMMO2': '0.028', 'AMMO4': '0.142', 'AMMO3': '0.157', 'WEAPON4': '0.300', 'weapon4': '0.346', 'WEAPON5': '0.350', 'weapon5': '0.408', 'weapon2': '0.478', 'WEAPON3': '0.900', 'HITCOUNT': '2.010', 'weapon3': '2.368', 'DAMAGECOUNT': '8.571', 'FRAGCOUNT': '25.000'} [2023-02-24 20:32:35,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13858.2, 300 sec: 13898.6). Total num frames: 106450944. Throughput: 0: 3467.6. Samples: 1602032. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:32:35,243][213332] Avg episode reward: [(0, '23.261')] [2023-02-24 20:32:35,371][213366] DAMAGECOUNT value on done: 48138.0 [2023-02-24 20:32:35,371][213366] Sum rewards: 21.150, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.851', 'ARMOR': '0.004', 'AMMO2': '0.014', 'AMMO5': '0.021', 'AMMO4': '0.070', 'AMMO3': '0.144', 'weapon4': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.550', 'weapon2': '0.586', 'weapon5': '0.872', 'WEAPON3': '0.900', 'HITCOUNT': '1.280', 'weapon3': '1.768', 'DAMAGECOUNT': '6.045', 'FRAGCOUNT': '20.000'} [2023-02-24 20:32:35,389][213368] DAMAGECOUNT value on done: 52097.0 [2023-02-24 20:32:35,389][213368] Sum rewards: 19.516, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.902', 'AMMO2': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'weapon4': '0.060', 'AMMO3': '0.169', 'WEAPON5': '0.250', 'weapon5': '0.320', 'weapon2': '0.684', 'WEAPON3': '1.150', 'HITCOUNT': '1.680', 'weapon3': '2.588', 'DAMAGECOUNT': '7.647', 'FRAGCOUNT': '19.000'} [2023-02-24 20:32:35,397][213383] DAMAGECOUNT value on done: 47840.0 [2023-02-24 20:32:35,398][213383] Sum rewards: 34.340, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.115', 'WEAPON5': '0.250', 'weapon4': '0.376', 'WEAPON3': '0.500', 'weapon5': '0.544', 'HEALTH': '0.595', 'weapon2': '0.842', 'HITCOUNT': '1.590', 'weapon3': '1.964', 'DAMAGECOUNT': '7.338', 'FRAGCOUNT': '26.000'} [2023-02-24 20:32:35,408][213384] DAMAGECOUNT value on done: 53543.0 [2023-02-24 20:32:35,409][213384] Sum rewards: 25.942, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.781', 'ARMOR': '0.008', 'AMMO5': '0.021', 'AMMO2': '0.038', 'AMMO3': '0.149', 'AMMO4': '0.192', 'weapon5': '0.356', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon2': '0.474', 'WEAPON3': '0.900', 'weapon4': '1.038', 'weapon3': '1.766', 'HITCOUNT': '1.890', 'DAMAGECOUNT': '8.991', 'FRAGCOUNT': '23.000'} [2023-02-24 20:32:35,410][213382] DAMAGECOUNT value on done: 52952.0 [2023-02-24 20:32:35,410][213382] Sum rewards: 30.508, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.260', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'AMMO5': '0.024', 'AMMO3': '0.114', 'AMMO4': '0.120', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon5': '0.360', 'weapon4': '0.464', 'WEAPON3': '0.700', 'weapon2': '1.088', 'HITCOUNT': '1.770', 'weapon3': '1.778', 'DAMAGECOUNT': '7.911', 'FRAGCOUNT': '25.000'} [2023-02-24 20:32:35,477][213369] DAMAGECOUNT value on done: 56996.0 [2023-02-24 20:32:35,477][213369] Sum rewards: 29.169, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.966', 'AMMO5': '0.015', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'weapon4': '0.110', 'AMMO3': '0.154', 'WEAPON5': '0.350', 'weapon5': '0.492', 'weapon2': '0.620', 'WEAPON3': '0.950', 'HITCOUNT': '1.740', 'weapon3': '2.428', 'DAMAGECOUNT': '8.817', 'FRAGCOUNT': '24.000'} [2023-02-24 20:32:35,691][213368] DAMAGECOUNT value on done: 56764.0 [2023-02-24 20:32:35,692][213368] Sum rewards: 31.712, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.680', 'ARMOR': '0.004', 'AMMO2': '0.020', 'AMMO5': '0.020', 'AMMO4': '0.098', 'weapon4': '0.192', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon2': '0.310', 'WEAPON5': '0.450', 'weapon5': '0.510', 'WEAPON3': '1.350', 'HITCOUNT': '2.040', 'weapon3': '2.674', 'DAMAGECOUNT': '9.813', 'FRAGCOUNT': '30.000'} [2023-02-24 20:32:35,707][213384] DAMAGECOUNT value on done: 52650.0 [2023-02-24 20:32:35,708][213384] Sum rewards: 28.333, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.602', 'ARMOR': '0.004', 'AMMO2': '0.024', 'AMMO5': '0.041', 'AMMO4': '0.118', 'AMMO3': '0.225', 'weapon2': '0.276', 'WEAPON4': '0.450', 'weapon5': '0.488', 'weapon4': '0.598', 'WEAPON5': '0.850', 'WEAPON3': '1.300', 'HITCOUNT': '2.130', 'weapon3': '2.228', 'DAMAGECOUNT': '10.203', 'FRAGCOUNT': '27.000'} [2023-02-24 20:32:35,783][213369] DAMAGECOUNT value on done: 55699.0 [2023-02-24 20:32:35,784][213369] Sum rewards: 28.161, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.634', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.112', 'AMMO4': '0.132', 'AMMO3': '0.162', 'WEAPON4': '0.250', 'weapon5': '0.262', 'WEAPON5': '0.300', 'weapon2': '0.724', 'WEAPON3': '1.000', 'HITCOUNT': '1.780', 'weapon3': '2.682', 'DAMAGECOUNT': '7.593', 'FRAGCOUNT': '26.000'} [2023-02-24 20:32:36,079][213369] DAMAGECOUNT value on done: 46484.0 [2023-02-24 20:32:36,080][213369] Sum rewards: 16.061, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.446', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.032', 'AMMO3': '0.050', 'AMMO4': '0.161', 'WEAPON3': '0.250', 'WEAPON4': '0.350', 'weapon5': '0.412', 'WEAPON5': '0.450', 'weapon4': '0.546', 'HITCOUNT': '0.970', 'weapon2': '1.042', 'weapon3': '1.474', 'DAMAGECOUNT': '3.993', 'FRAGCOUNT': '12.000'} [2023-02-24 20:32:37,165][213365] Updated weights for policy 0, policy_version 25996 (0.0009) [2023-02-24 20:32:40,107][213365] Updated weights for policy 0, policy_version 26006 (0.0009) [2023-02-24 20:32:40,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13898.6). Total num frames: 106520576. Throughput: 0: 3466.2. Samples: 1622810. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:32:40,243][213332] Avg episode reward: [(0, '23.601')] [2023-02-24 20:32:43,051][213365] Updated weights for policy 0, policy_version 26016 (0.0009) [2023-02-24 20:32:45,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13898.6). Total num frames: 106590208. Throughput: 0: 3466.3. Samples: 1643556. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:32:45,243][213332] Avg episode reward: [(0, '23.601')] [2023-02-24 20:32:45,247][213352] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000026023_106590208.pth... [2023-02-24 20:32:45,308][213352] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000025210_103260160.pth [2023-02-24 20:32:46,045][213365] Updated weights for policy 0, policy_version 26026 (0.0009) [2023-02-24 20:32:49,036][213365] Updated weights for policy 0, policy_version 26036 (0.0009) [2023-02-24 20:32:50,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13898.6). Total num frames: 106659840. Throughput: 0: 3461.6. Samples: 1653800. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:32:50,243][213332] Avg episode reward: [(0, '23.601')] [2023-02-24 20:32:51,998][213365] Updated weights for policy 0, policy_version 26046 (0.0009) [2023-02-24 20:32:53,328][213367] DAMAGECOUNT value on done: 52862.0 [2023-02-24 20:32:53,328][213367] Sum rewards: 26.167, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.730', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.024', 'AMMO3': '0.122', 'WEAPON5': '0.200', 'weapon5': '0.332', 'weapon2': '0.726', 'WEAPON3': '0.750', 'HITCOUNT': '1.410', 'weapon3': '2.428', 'DAMAGECOUNT': '6.642', 'FRAGCOUNT': '21.000'} [2023-02-24 20:32:53,623][213367] DAMAGECOUNT value on done: 54713.0 [2023-02-24 20:32:53,623][213367] Sum rewards: 21.293, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.640', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'AMMO5': '0.012', 'WEAPON1': '0.040', 'AMMO3': '0.133', 'WEAPON5': '0.450', 'weapon5': '0.540', 'WEAPON3': '0.950', 'weapon2': '0.966', 'HITCOUNT': '1.540', 'weapon3': '2.200', 'DAMAGECOUNT': '6.651', 'FRAGCOUNT': '18.000'} [2023-02-24 20:32:53,630][213372] DAMAGECOUNT value on done: 54323.0 [2023-02-24 20:32:53,630][213372] Sum rewards: 30.498, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.298', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.028', 'AMMO3': '0.122', 'AMMO4': '0.142', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon5': '0.488', 'weapon2': '0.512', 'WEAPON3': '0.700', 'weapon4': '0.720', 'weapon3': '1.786', 'HITCOUNT': '1.920', 'DAMAGECOUNT': '8.055', 'FRAGCOUNT': '26.000'} [2023-02-24 20:32:53,704][213383] DAMAGECOUNT value on done: 53590.0 [2023-02-24 20:32:53,704][213383] Sum rewards: 23.153, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.177', 'AMMO5': '0.015', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'AMMO3': '0.081', 'AMMO4': '0.119', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon5': '0.446', 'WEAPON3': '0.500', 'weapon2': '0.620', 'weapon4': '1.028', 'weapon3': '1.444', 'HITCOUNT': '1.510', 'DAMAGECOUNT': '6.063', 'FRAGCOUNT': '18.000'} [2023-02-24 20:32:53,907][213366] DAMAGECOUNT value on done: 55894.0 [2023-02-24 20:32:53,907][213366] Sum rewards: 35.695, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.400', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.037', 'AMMO3': '0.109', 'AMMO4': '0.187', 'WEAPON4': '0.350', 'weapon4': '0.388', 'WEAPON5': '0.450', 'weapon5': '0.462', 'WEAPON3': '0.700', 'weapon2': '0.804', 'weapon3': '1.968', 'HITCOUNT': '2.130', 'DAMAGECOUNT': '9.480', 'FRAGCOUNT': '29.000'} [2023-02-24 20:32:53,925][213367] DAMAGECOUNT value on done: 51773.0 [2023-02-24 20:32:53,926][213367] Sum rewards: 27.215, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.175', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO5': '0.015', 'AMMO3': '0.093', 'WEAPON5': '0.450', 'weapon5': '0.490', 'WEAPON3': '0.700', 'weapon2': '0.970', 'HITCOUNT': '1.460', 'weapon3': '2.336', 'DAMAGECOUNT': '6.114', 'FRAGCOUNT': '21.000'} [2023-02-24 20:32:53,934][213382] DAMAGECOUNT value on done: 52382.0 [2023-02-24 20:32:53,935][213382] Sum rewards: 25.978, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.456', 'AMMO2': '0.019', 'AMMO5': '0.020', 'weapon4': '0.070', 'AMMO4': '0.096', 'AMMO3': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.500', 'weapon5': '0.534', 'weapon2': '0.796', 'WEAPON3': '0.900', 'HITCOUNT': '1.370', 'weapon3': '2.290', 'DAMAGECOUNT': '7.254', 'FRAGCOUNT': '23.000'} [2023-02-24 20:32:53,935][213372] DAMAGECOUNT value on done: 53270.0 [2023-02-24 20:32:53,935][213372] Sum rewards: 16.786, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.678', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.073', 'AMMO4': '0.149', 'WEAPON4': '0.350', 'weapon5': '0.424', 'WEAPON5': '0.450', 'weapon2': '0.504', 'WEAPON3': '0.550', 'weapon4': '0.750', 'HITCOUNT': '1.320', 'weapon3': '1.664', 'DAMAGECOUNT': '5.412', 'FRAGCOUNT': '14.000'} [2023-02-24 20:32:54,008][213383] DAMAGECOUNT value on done: 58802.0 [2023-02-24 20:32:54,008][213383] Sum rewards: 35.431, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.245', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.013', 'weapon7': '0.048', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.191', 'weapon5': '0.192', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.892', 'WEAPON3': '1.300', 'HITCOUNT': '1.950', 'weapon3': '2.622', 'DAMAGECOUNT': '9.465', 'FRAGCOUNT': '31.000'} [2023-02-24 20:32:54,215][213366] DAMAGECOUNT value on done: 56708.0 [2023-02-24 20:32:54,215][213366] Sum rewards: 19.863, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.040', 'AMMO5': '0.013', 'AMMO2': '0.015', 'WEAPON1': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.128', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.364', 'weapon2': '0.542', 'weapon5': '0.664', 'WEAPON3': '0.750', 'HITCOUNT': '1.380', 'weapon3': '1.862', 'DAMAGECOUNT': '6.207', 'FRAGCOUNT': '18.000'} [2023-02-24 20:32:54,220][213367] DAMAGECOUNT value on done: 51490.0 [2023-02-24 20:32:54,221][213367] Sum rewards: 32.307, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.104', 'AMMO2': '0.010', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.051', 'AMMO3': '0.120', 'weapon5': '0.318', 'WEAPON5': '0.350', 'weapon2': '0.838', 'WEAPON3': '0.850', 'HITCOUNT': '2.040', 'weapon3': '2.586', 'DAMAGECOUNT': '8.715', 'FRAGCOUNT': '25.000'} [2023-02-24 20:32:54,227][213384] DAMAGECOUNT value on done: 55008.0 [2023-02-24 20:32:54,228][213384] Sum rewards: 23.682, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.550', 'AMMO5': '0.032', 'AMMO2': '0.060', 'AMMO3': '0.143', 'weapon2': '0.282', 'AMMO4': '0.298', 'weapon5': '0.448', 'WEAPON4': '0.650', 'WEAPON5': '0.850', 'WEAPON3': '0.950', 'weapon4': '1.086', 'weapon3': '1.750', 'HITCOUNT': '2.020', 'DAMAGECOUNT': '8.913', 'FRAGCOUNT': '23.000'} [2023-02-24 20:32:54,231][213372] DAMAGECOUNT value on done: 53187.0 [2023-02-24 20:32:54,231][213372] Sum rewards: 14.660, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.902', 'AMMO5': '0.014', 'AMMO2': '0.060', 'AMMO3': '0.082', 'AMMO4': '0.302', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '0.500', 'weapon2': '0.610', 'weapon4': '0.646', 'weapon5': '0.742', 'HITCOUNT': '0.940', 'weapon3': '1.458', 'DAMAGECOUNT': '4.656', 'FRAGCOUNT': '13.000'} [2023-02-24 20:32:54,245][213382] DAMAGECOUNT value on done: 56675.0 [2023-02-24 20:32:54,245][213382] Sum rewards: 33.448, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.752', 'ARMOR': '0.004', 'AMMO2': '0.012', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.058', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'weapon4': '0.248', 'WEAPON5': '0.350', 'weapon5': '0.428', 'weapon2': '0.674', 'WEAPON3': '0.850', 'HITCOUNT': '1.690', 'weapon3': '2.210', 'DAMAGECOUNT': '8.040', 'FRAGCOUNT': '29.000'} [2023-02-24 20:32:54,288][213368] DAMAGECOUNT value on done: 51393.0 [2023-02-24 20:32:54,289][213368] Sum rewards: 27.339, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.685', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO4': '0.057', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'weapon4': '0.252', 'weapon5': '0.426', 'weapon2': '0.480', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'HITCOUNT': '1.650', 'weapon3': '2.494', 'DAMAGECOUNT': '7.725', 'FRAGCOUNT': '23.000'} [2023-02-24 20:32:54,523][213384] DAMAGECOUNT value on done: 50522.0 [2023-02-24 20:32:54,524][213384] Sum rewards: 18.593, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.940', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO2': '0.040', 'AMMO3': '0.089', 'AMMO4': '0.200', 'weapon4': '0.392', 'WEAPON4': '0.450', 'WEAPON3': '0.550', 'weapon5': '0.586', 'weapon2': '0.632', 'WEAPON5': '0.650', 'HITCOUNT': '1.040', 'weapon3': '1.980', 'DAMAGECOUNT': '6.126', 'FRAGCOUNT': '16.000'} [2023-02-24 20:32:54,535][213372] DAMAGECOUNT value on done: 54439.0 [2023-02-24 20:32:54,536][213372] Sum rewards: 16.204, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.694', 'AMMO5': '0.013', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO3': '0.069', 'AMMO4': '0.091', 'weapon4': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon5': '0.548', 'WEAPON3': '0.550', 'weapon2': '0.618', 'HITCOUNT': '1.290', 'weapon3': '2.236', 'DAMAGECOUNT': '5.550', 'FRAGCOUNT': '12.000'} [2023-02-24 20:32:54,542][213366] DAMAGECOUNT value on done: 58157.0 [2023-02-24 20:32:54,543][213366] Sum rewards: 31.693, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.622', 'AMMO5': '0.018', 'AMMO2': '0.031', 'AMMO3': '0.096', 'AMMO4': '0.153', 'WEAPON4': '0.450', 'weapon4': '0.490', 'WEAPON5': '0.600', 'weapon5': '0.600', 'weapon2': '0.626', 'WEAPON3': '0.650', 'HITCOUNT': '1.860', 'weapon3': '1.946', 'DAMAGECOUNT': '8.295', 'FRAGCOUNT': '27.000'} [2023-02-24 20:32:54,548][213382] DAMAGECOUNT value on done: 52979.0 [2023-02-24 20:32:54,549][213382] Sum rewards: 24.882, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.740', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO5': '0.015', 'AMMO4': '0.063', 'AMMO3': '0.090', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon5': '0.672', 'weapon2': '0.864', 'HITCOUNT': '1.280', 'weapon3': '2.160', 'DAMAGECOUNT': '6.405', 'FRAGCOUNT': '19.000'} [2023-02-24 20:32:54,562][213383] DAMAGECOUNT value on done: 52728.0 [2023-02-24 20:32:54,562][213383] Sum rewards: 21.658, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.699', 'AMMO5': '0.022', 'AMMO2': '0.027', 'AMMO4': '0.132', 'AMMO3': '0.148', 'weapon4': '0.230', 'WEAPON4': '0.250', 'weapon5': '0.520', 'WEAPON5': '0.550', 'weapon2': '0.698', 'WEAPON3': '0.950', 'HITCOUNT': '1.690', 'weapon3': '2.230', 'DAMAGECOUNT': '7.410', 'FRAGCOUNT': '19.000'} [2023-02-24 20:32:54,589][213368] DAMAGECOUNT value on done: 56101.0 [2023-02-24 20:32:54,590][213368] Sum rewards: 25.217, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.245', 'AMMO2': '0.012', 'weapon4': '0.016', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.113', 'WEAPON5': '0.450', 'weapon5': '0.640', 'WEAPON3': '0.700', 'weapon2': '0.996', 'HITCOUNT': '1.120', 'weapon3': '1.916', 'DAMAGECOUNT': '5.373', 'FRAGCOUNT': '21.000'} [2023-02-24 20:32:54,634][213369] DAMAGECOUNT value on done: 53915.0 [2023-02-24 20:32:54,635][213369] Sum rewards: 21.810, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.160', 'AMMO2': '0.004', 'WEAPON1': '0.020', 'AMMO4': '0.021', 'AMMO5': '0.034', 'WEAPON4': '0.100', 'weapon4': '0.106', 'AMMO3': '0.181', 'weapon2': '0.288', 'weapon5': '0.574', 'WEAPON5': '0.800', 'WEAPON3': '1.200', 'HITCOUNT': '1.500', 'weapon3': '2.628', 'DAMAGECOUNT': '6.264', 'FRAGCOUNT': '21.000'} [2023-02-24 20:32:54,840][213368] DAMAGECOUNT value on done: 54608.0 [2023-02-24 20:32:54,840][213384] DAMAGECOUNT value on done: 56410.0 [2023-02-24 20:32:54,840][213368] Sum rewards: 22.005, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.112', 'ARMOR': '0.004', 'AMMO2': '0.037', 'AMMO5': '0.042', 'AMMO3': '0.183', 'AMMO4': '0.184', 'weapon5': '0.366', 'WEAPON4': '0.450', 'weapon2': '0.526', 'weapon4': '0.584', 'WEAPON5': '1.000', 'WEAPON3': '1.150', 'HITCOUNT': '1.890', 'weapon3': '2.168', 'DAMAGECOUNT': '7.533', 'FRAGCOUNT': '22.500'} [2023-02-24 20:32:54,841][213384] Sum rewards: 23.013, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.962', 'AMMO5': '0.028', 'AMMO2': '0.051', 'AMMO3': '0.177', 'AMMO4': '0.254', 'weapon4': '0.376', 'weapon5': '0.500', 'weapon2': '0.532', 'WEAPON4': '0.550', 'WEAPON5': '0.700', 'WEAPON3': '1.000', 'HITCOUNT': '1.820', 'weapon3': '2.136', 'DAMAGECOUNT': '8.601', 'FRAGCOUNT': '24.000'} [2023-02-24 20:32:54,842][213382] DAMAGECOUNT value on done: 55477.0 [2023-02-24 20:32:54,842][213382] Sum rewards: 28.778, reward structure: {'DEATHCOUNT': '-9.750', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.028', 'HEALTH': '0.074', 'WEAPON4': '0.100', 'AMMO4': '0.137', 'AMMO3': '0.140', 'WEAPON5': '0.350', 'weapon2': '0.382', 'weapon5': '0.386', 'weapon4': '0.596', 'WEAPON3': '0.800', 'HITCOUNT': '1.810', 'weapon3': '2.126', 'DAMAGECOUNT': '7.575', 'FRAGCOUNT': '24.000'} [2023-02-24 20:32:54,847][213366] DAMAGECOUNT value on done: 50173.0 [2023-02-24 20:32:54,848][213366] Sum rewards: 21.833, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.946', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'AMMO3': '0.086', 'AMMO4': '0.086', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.508', 'weapon5': '0.512', 'WEAPON3': '0.550', 'weapon4': '0.560', 'HITCOUNT': '1.250', 'weapon3': '2.008', 'DAMAGECOUNT': '6.105', 'FRAGCOUNT': '18.000'} [2023-02-24 20:32:54,869][213383] DAMAGECOUNT value on done: 50773.0 [2023-02-24 20:32:54,869][213383] Sum rewards: 26.076, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.326', 'AMMO5': '0.028', 'AMMO2': '0.065', 'AMMO3': '0.142', 'AMMO4': '0.327', 'weapon5': '0.462', 'WEAPON4': '0.600', 'WEAPON5': '0.700', 'weapon4': '0.708', 'weapon2': '0.862', 'WEAPON3': '0.950', 'weapon3': '1.558', 'HITCOUNT': '1.700', 'DAMAGECOUNT': '8.799', 'FRAGCOUNT': '26.000'} [2023-02-24 20:32:54,938][213369] DAMAGECOUNT value on done: 58961.0 [2023-02-24 20:32:54,939][213369] Sum rewards: 24.546, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.797', 'AMMO2': '0.020', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'AMMO4': '0.099', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'weapon4': '0.304', 'WEAPON5': '0.450', 'weapon5': '0.634', 'WEAPON3': '0.650', 'weapon2': '0.682', 'HITCOUNT': '1.360', 'weapon3': '1.740', 'DAMAGECOUNT': '5.895', 'FRAGCOUNT': '20.000'} [2023-02-24 20:32:54,995][213365] Updated weights for policy 0, policy_version 26056 (0.0009) [2023-02-24 20:32:55,146][213368] DAMAGECOUNT value on done: 58219.0 [2023-02-24 20:32:55,146][213368] Sum rewards: 16.675, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.335', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO5': '0.022', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.145', 'weapon2': '0.340', 'weapon4': '0.444', 'WEAPON5': '0.500', 'weapon5': '0.568', 'WEAPON3': '0.850', 'HITCOUNT': '0.940', 'weapon3': '2.216', 'DAMAGECOUNT': '4.365', 'FRAGCOUNT': '15.000'} [2023-02-24 20:32:55,150][213384] DAMAGECOUNT value on done: 54520.0 [2023-02-24 20:32:55,150][213384] Sum rewards: 20.155, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.305', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.016', 'weapon4': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.104', 'WEAPON5': '0.450', 'weapon5': '0.550', 'weapon2': '0.730', 'WEAPON3': '0.750', 'HITCOUNT': '1.330', 'weapon3': '2.348', 'DAMAGECOUNT': '5.610', 'FRAGCOUNT': '17.000'} [2023-02-24 20:32:55,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13789.9, 300 sec: 13884.7). Total num frames: 106725376. Throughput: 0: 3463.3. Samples: 1674564. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:32:55,244][213332] Avg episode reward: [(0, '23.786')] [2023-02-24 20:32:55,248][213352] Saving new best policy, reward=23.786! [2023-02-24 20:32:55,253][213369] DAMAGECOUNT value on done: 57865.0 [2023-02-24 20:32:55,253][213369] Sum rewards: 23.823, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.750', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.108', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'weapon4': '0.328', 'WEAPON5': '0.450', 'weapon2': '0.514', 'WEAPON3': '0.600', 'weapon5': '0.636', 'HITCOUNT': '1.390', 'weapon3': '1.916', 'DAMAGECOUNT': '6.498', 'FRAGCOUNT': '20.000'} [2023-02-24 20:32:55,555][213369] DAMAGECOUNT value on done: 49679.0 [2023-02-24 20:32:55,555][213369] Sum rewards: 33.042, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.639', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon5': '0.150', 'AMMO3': '0.160', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.364', 'weapon2': '0.562', 'WEAPON3': '0.900', 'HITCOUNT': '2.250', 'weapon3': '2.624', 'DAMAGECOUNT': '9.585', 'FRAGCOUNT': '29.000'} [2023-02-24 20:32:57,933][213365] Updated weights for policy 0, policy_version 26066 (0.0009) [2023-02-24 20:33:00,243][213332] Fps is (10 sec: 13516.1, 60 sec: 13789.8, 300 sec: 13884.7). Total num frames: 106795008. Throughput: 0: 3457.4. Samples: 1695130. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:33:00,245][213332] Avg episode reward: [(0, '23.861')] [2023-02-24 20:33:00,246][213352] Saving new best policy, reward=23.861! [2023-02-24 20:33:00,919][213365] Updated weights for policy 0, policy_version 26076 (0.0009) [2023-02-24 20:33:03,916][213365] Updated weights for policy 0, policy_version 26086 (0.0009) [2023-02-24 20:33:05,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13789.8, 300 sec: 13884.7). Total num frames: 106864640. Throughput: 0: 3451.8. Samples: 1705206. Policy #0 lag: (min: 0.0, avg: 0.9, max: 1.0) [2023-02-24 20:33:05,243][213332] Avg episode reward: [(0, '23.861')] [2023-02-24 20:33:06,858][213365] Updated weights for policy 0, policy_version 26096 (0.0009) [2023-02-24 20:33:09,871][213384] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 20:33:09,872][213365] Updated weights for policy 0, policy_version 26106 (0.0010) [2023-02-24 20:33:10,243][213332] Fps is (10 sec: 13927.1, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 106934272. Throughput: 0: 3445.6. Samples: 1725856. Policy #0 lag: (min: 0.0, avg: 0.9, max: 1.0) [2023-02-24 20:33:10,243][213332] Avg episode reward: [(0, '23.861')] [2023-02-24 20:33:12,870][213365] Updated weights for policy 0, policy_version 26116 (0.0009) [2023-02-24 20:33:13,069][213367] DAMAGECOUNT value on done: 55866.0 [2023-02-24 20:33:13,070][213367] Sum rewards: 33.562, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.122', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO5': '0.028', 'AMMO2': '0.042', 'AMMO3': '0.115', 'AMMO4': '0.208', 'WEAPON4': '0.400', 'weapon4': '0.522', 'weapon2': '0.606', 'WEAPON5': '0.750', 'WEAPON3': '0.750', 'weapon5': '0.772', 'weapon3': '1.594', 'HITCOUNT': '1.610', 'DAMAGECOUNT': '9.012', 'FRAGCOUNT': '29.000'} [2023-02-24 20:33:13,295][213372] DAMAGECOUNT value on done: 56297.0 [2023-02-24 20:33:13,296][213372] Sum rewards: 22.922, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.387', 'ARMOR': '0.004', 'AMMO2': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.025', 'AMMO3': '0.104', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.420', 'weapon5': '0.616', 'WEAPON3': '0.650', 'weapon2': '0.836', 'weapon3': '1.620', 'HITCOUNT': '1.680', 'DAMAGECOUNT': '5.922', 'FRAGCOUNT': '18.000'} [2023-02-24 20:33:13,368][213367] DAMAGECOUNT value on done: 58216.0 [2023-02-24 20:33:13,369][213367] Sum rewards: 39.204, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.012', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.159', 'WEAPON4': '0.250', 'weapon2': '0.368', 'weapon5': '0.400', 'weapon4': '0.480', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'HITCOUNT': '2.280', 'weapon3': '2.338', 'DAMAGECOUNT': '10.509', 'FRAGCOUNT': '33.000'} [2023-02-24 20:33:13,388][213383] DAMAGECOUNT value on done: 55273.0 [2023-02-24 20:33:13,388][213383] Sum rewards: 19.907, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.674', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.024', 'weapon4': '0.076', 'AMMO3': '0.101', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon5': '0.728', 'weapon2': '0.978', 'HITCOUNT': '1.190', 'weapon3': '1.786', 'DAMAGECOUNT': '5.049', 'FRAGCOUNT': '16.000'} [2023-02-24 20:33:13,487][213366] DAMAGECOUNT value on done: 57555.0 [2023-02-24 20:33:13,488][213366] Sum rewards: 13.203, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.739', 'AMMO2': '0.012', 'AMMO5': '0.019', 'AMMO4': '0.061', 'AMMO3': '0.100', 'weapon2': '0.330', 'WEAPON4': '0.350', 'weapon5': '0.396', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'weapon4': '1.076', 'HITCOUNT': '1.400', 'weapon3': '1.414', 'DAMAGECOUNT': '4.833', 'FRAGCOUNT': '12.000'} [2023-02-24 20:33:13,597][213372] DAMAGECOUNT value on done: 55615.0 [2023-02-24 20:33:13,598][213372] Sum rewards: 28.085, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.165', 'AMMO2': '0.010', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.050', 'AMMO3': '0.113', 'WEAPON5': '0.400', 'weapon5': '0.584', 'weapon2': '0.612', 'WEAPON3': '0.750', 'HITCOUNT': '1.370', 'weapon3': '2.280', 'DAMAGECOUNT': '7.035', 'FRAGCOUNT': '22.000'} [2023-02-24 20:33:13,661][213382] DAMAGECOUNT value on done: 55194.0 [2023-02-24 20:33:13,662][213382] Sum rewards: 33.973, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.040', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.074', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon5': '0.418', 'WEAPON3': '0.500', 'weapon2': '0.550', 'weapon4': '0.982', 'weapon3': '1.616', 'HITCOUNT': '2.180', 'DAMAGECOUNT': '8.436', 'FRAGCOUNT': '27.000'} [2023-02-24 20:33:13,677][213367] DAMAGECOUNT value on done: 54340.0 [2023-02-24 20:33:13,678][213367] Sum rewards: 22.920, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.091', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.042', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'weapon4': '0.174', 'WEAPON5': '0.200', 'weapon5': '0.264', 'WEAPON3': '1.000', 'weapon2': '1.104', 'HITCOUNT': '1.800', 'weapon3': '2.148', 'DAMAGECOUNT': '7.701', 'FRAGCOUNT': '20.000'} [2023-02-24 20:33:13,699][213383] DAMAGECOUNT value on done: 61502.0 [2023-02-24 20:33:13,700][213383] Sum rewards: 26.816, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.097', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'weapon4': '0.128', 'AMMO3': '0.137', 'weapon2': '0.174', 'WEAPON5': '0.350', 'weapon5': '0.752', 'WEAPON3': '0.850', 'HITCOUNT': '1.690', 'weapon3': '2.630', 'DAMAGECOUNT': '8.100', 'FRAGCOUNT': '22.000'} [2023-02-24 20:33:13,805][213366] DAMAGECOUNT value on done: 59063.0 [2023-02-24 20:33:13,805][213366] Sum rewards: 20.546, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.730', 'ARMOR': '0.008', 'AMMO2': '0.016', 'AMMO5': '0.021', 'AMMO4': '0.077', 'AMMO3': '0.155', 'weapon4': '0.246', 'WEAPON4': '0.300', 'weapon5': '0.396', 'WEAPON5': '0.600', 'weapon2': '0.838', 'WEAPON3': '1.050', 'HITCOUNT': '1.500', 'weapon3': '2.254', 'DAMAGECOUNT': '7.065', 'FRAGCOUNT': '20.000'} [2023-02-24 20:33:13,908][213372] DAMAGECOUNT value on done: 55990.0 [2023-02-24 20:33:13,909][213372] Sum rewards: 28.632, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.866', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.195', 'weapon2': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.482', 'WEAPON5': '0.650', 'weapon5': '0.666', 'WEAPON3': '1.100', 'HITCOUNT': '1.750', 'weapon3': '2.054', 'DAMAGECOUNT': '8.409', 'FRAGCOUNT': '27.000'} [2023-02-24 20:33:13,938][213384] DAMAGECOUNT value on done: 57012.0 [2023-02-24 20:33:13,939][213384] Sum rewards: 22.204, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.228', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.018', 'weapon4': '0.058', 'AMMO3': '0.091', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'weapon5': '0.812', 'weapon2': '0.940', 'HITCOUNT': '1.370', 'weapon3': '1.816', 'DAMAGECOUNT': '6.012', 'FRAGCOUNT': '17.000'} [2023-02-24 20:33:13,963][213382] DAMAGECOUNT value on done: 58618.0 [2023-02-24 20:33:13,964][213382] Sum rewards: 21.288, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.130', 'AMMO2': '0.014', 'AMMO5': '0.024', 'WEAPON4': '0.050', 'AMMO4': '0.070', 'AMMO3': '0.141', 'weapon5': '0.378', 'weapon4': '0.498', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'weapon2': '0.898', 'HITCOUNT': '1.500', 'weapon3': '1.866', 'DAMAGECOUNT': '5.829', 'FRAGCOUNT': '18.000'} [2023-02-24 20:33:13,984][213367] DAMAGECOUNT value on done: 54168.0 [2023-02-24 20:33:13,984][213367] Sum rewards: 26.548, reward structure: {'DEATHCOUNT': '-12.750', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.038', 'HEALTH': '0.048', 'weapon4': '0.128', 'AMMO3': '0.158', 'AMMO4': '0.189', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon5': '0.488', 'weapon2': '0.640', 'WEAPON3': '0.850', 'HITCOUNT': '1.660', 'weapon3': '2.350', 'DAMAGECOUNT': '8.028', 'FRAGCOUNT': '24.000'} [2023-02-24 20:33:14,003][213368] DAMAGECOUNT value on done: 54015.0 [2023-02-24 20:33:14,003][213368] Sum rewards: 27.793, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.416', 'AMMO5': '0.013', 'AMMO2': '0.027', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'AMMO4': '0.134', 'weapon4': '0.262', 'WEAPON5': '0.300', 'weapon5': '0.306', 'weapon2': '0.632', 'WEAPON3': '0.750', 'HITCOUNT': '1.750', 'weapon3': '2.234', 'DAMAGECOUNT': '7.821', 'FRAGCOUNT': '22.000'} [2023-02-24 20:33:14,180][213366] DAMAGECOUNT value on done: 59189.0 [2023-02-24 20:33:14,181][213366] Sum rewards: 14.374, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon7': '0.056', 'HEALTH': '0.070', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon2': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.484', 'WEAPON3': '0.500', 'HITCOUNT': '0.800', 'weapon3': '1.348', 'DAMAGECOUNT': '3.096', 'FRAGCOUNT': '13.000'} [2023-02-24 20:33:14,209][213372] DAMAGECOUNT value on done: 56370.0 [2023-02-24 20:33:14,209][213372] Sum rewards: 23.587, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.165', 'AMMO2': '0.012', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'weapon4': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.350', 'weapon5': '0.508', 'WEAPON3': '0.600', 'weapon2': '1.086', 'HITCOUNT': '1.200', 'weapon3': '1.892', 'DAMAGECOUNT': '5.763', 'FRAGCOUNT': '19.000'} [2023-02-24 20:33:14,247][213384] DAMAGECOUNT value on done: 52315.0 [2023-02-24 20:33:14,247][213384] Sum rewards: 14.880, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.659', 'AMMO2': '0.022', 'AMMO5': '0.028', 'AMMO4': '0.111', 'AMMO3': '0.131', 'weapon5': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.500', 'weapon4': '0.622', 'weapon2': '0.732', 'WEAPON3': '0.800', 'HITCOUNT': '1.420', 'weapon3': '2.052', 'DAMAGECOUNT': '5.379', 'FRAGCOUNT': '14.000'} [2023-02-24 20:33:14,250][213383] DAMAGECOUNT value on done: 54303.0 [2023-02-24 20:33:14,251][213383] Sum rewards: 17.142, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.865', 'AMMO2': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.051', 'AMMO3': '0.134', 'weapon4': '0.144', 'WEAPON4': '0.200', 'weapon5': '0.318', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'weapon2': '1.080', 'HITCOUNT': '1.140', 'weapon3': '1.992', 'DAMAGECOUNT': '4.725', 'FRAGCOUNT': '17.000'} [2023-02-24 20:33:14,257][213382] DAMAGECOUNT value on done: 55425.0 [2023-02-24 20:33:14,258][213382] Sum rewards: 31.525, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.017', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.055', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'weapon4': '0.106', 'WEAPON5': '0.350', 'weapon5': '0.388', 'WEAPON3': '0.700', 'weapon2': '0.922', 'HITCOUNT': '1.900', 'weapon3': '2.292', 'DAMAGECOUNT': '7.338', 'FRAGCOUNT': '25.000'} [2023-02-24 20:33:14,278][213369] DAMAGECOUNT value on done: 56408.0 [2023-02-24 20:33:14,279][213369] Sum rewards: 20.244, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.418', 'WEAPON1': '0.010', 'AMMO5': '0.024', 'AMMO2': '0.047', 'AMMO3': '0.150', 'AMMO4': '0.234', 'weapon4': '0.524', 'weapon5': '0.544', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'weapon2': '0.656', 'WEAPON3': '0.900', 'weapon3': '1.804', 'HITCOUNT': '1.890', 'DAMAGECOUNT': '7.479', 'FRAGCOUNT': '20.000'} [2023-02-24 20:33:14,304][213368] DAMAGECOUNT value on done: 58080.0 [2023-02-24 20:33:14,304][213368] Sum rewards: 24.743, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.249', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.023', 'WEAPON1': '0.030', 'AMMO3': '0.092', 'WEAPON5': '0.250', 'weapon5': '0.346', 'WEAPON3': '0.550', 'weapon2': '0.940', 'HITCOUNT': '1.010', 'weapon3': '2.046', 'DAMAGECOUNT': '5.937', 'FRAGCOUNT': '19.000'} [2023-02-24 20:33:14,487][213366] DAMAGECOUNT value on done: 52382.0 [2023-02-24 20:33:14,487][213366] Sum rewards: 22.237, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.624', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'AMMO3': '0.140', 'weapon5': '0.264', 'WEAPON5': '0.300', 'weapon2': '0.390', 'weapon4': '0.590', 'WEAPON3': '0.850', 'HITCOUNT': '1.550', 'weapon3': '2.158', 'DAMAGECOUNT': '6.627', 'FRAGCOUNT': '18.000'} [2023-02-24 20:33:14,545][213384] DAMAGECOUNT value on done: 59626.0 [2023-02-24 20:33:14,545][213384] Sum rewards: 30.796, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.424', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'AMMO5': '0.024', 'AMMO4': '0.111', 'AMMO3': '0.191', 'weapon5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.432', 'WEAPON5': '0.550', 'weapon4': '0.592', 'WEAPON3': '1.250', 'HITCOUNT': '2.070', 'weapon3': '2.320', 'DAMAGECOUNT': '9.498', 'FRAGCOUNT': '29.000'} [2023-02-24 20:33:14,551][213383] DAMAGECOUNT value on done: 53087.0 [2023-02-24 20:33:14,551][213383] Sum rewards: 21.633, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.727', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.023', 'AMMO3': '0.113', 'AMMO4': '0.113', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.368', 'weapon5': '0.456', 'weapon4': '0.598', 'WEAPON3': '0.650', 'HITCOUNT': '1.640', 'weapon3': '1.834', 'DAMAGECOUNT': '6.942', 'FRAGCOUNT': '18.000'} [2023-02-24 20:33:14,563][213382] DAMAGECOUNT value on done: 57222.0 [2023-02-24 20:33:14,563][213382] Sum rewards: 19.043, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.948', 'AMMO5': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.075', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'weapon4': '0.310', 'WEAPON5': '0.400', 'weapon5': '0.684', 'WEAPON3': '0.700', 'weapon2': '0.726', 'HITCOUNT': '1.300', 'weapon3': '1.762', 'DAMAGECOUNT': '5.235', 'FRAGCOUNT': '16.000'} [2023-02-24 20:33:14,577][213369] DAMAGECOUNT value on done: 61895.0 [2023-02-24 20:33:14,578][213369] Sum rewards: 26.338, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.030', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.038', 'AMMO3': '0.151', 'weapon4': '0.196', 'WEAPON4': '0.200', 'weapon5': '0.366', 'WEAPON5': '0.450', 'weapon2': '0.760', 'WEAPON3': '1.000', 'HITCOUNT': '1.850', 'weapon3': '2.282', 'DAMAGECOUNT': '8.802', 'FRAGCOUNT': '22.000'} [2023-02-24 20:33:14,594][213368] DAMAGECOUNT value on done: 57117.0 [2023-02-24 20:33:14,594][213368] Sum rewards: 27.156, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.079', 'ARMOR': '0.004', 'AMMO2': '0.012', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.060', 'AMMO3': '0.094', 'WEAPON4': '0.250', 'weapon4': '0.468', 'weapon5': '0.474', 'weapon2': '0.538', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '1.550', 'weapon3': '1.826', 'DAMAGECOUNT': '7.470', 'FRAGCOUNT': '21.000'} [2023-02-24 20:33:14,845][213384] DAMAGECOUNT value on done: 56221.0 [2023-02-24 20:33:14,845][213384] Sum rewards: 16.854, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.040', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.014', 'weapon4': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.142', 'weapon5': '0.324', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'weapon2': '1.158', 'HITCOUNT': '1.410', 'weapon3': '2.140', 'DAMAGECOUNT': '5.103', 'FRAGCOUNT': '16.000'} [2023-02-24 20:33:14,884][213369] DAMAGECOUNT value on done: 59592.0 [2023-02-24 20:33:14,885][213369] Sum rewards: 14.110, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.874', 'AMMO5': '0.019', 'AMMO2': '0.028', 'weapon7': '0.062', 'AMMO3': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.138', 'WEAPON7': '0.200', 'weapon5': '0.210', 'weapon2': '0.366', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '0.600', 'weapon3': '1.002', 'weapon4': '1.266', 'HITCOUNT': '1.310', 'DAMAGECOUNT': '5.181', 'FRAGCOUNT': '14.000'} [2023-02-24 20:33:14,894][213368] DAMAGECOUNT value on done: 60907.0 [2023-02-24 20:33:14,894][213368] Sum rewards: 25.653, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.422', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.097', 'AMMO3': '0.141', 'WEAPON4': '0.350', 'weapon5': '0.388', 'WEAPON5': '0.400', 'weapon4': '0.514', 'WEAPON3': '0.950', 'weapon2': '0.978', 'weapon3': '1.780', 'HITCOUNT': '1.880', 'DAMAGECOUNT': '8.064', 'FRAGCOUNT': '23.000'} [2023-02-24 20:33:15,185][213369] DAMAGECOUNT value on done: 51664.0 [2023-02-24 20:33:15,185][213369] Sum rewards: 20.884, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.275', 'AMMO5': '0.020', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'AMMO3': '0.074', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'weapon4': '0.298', 'WEAPON3': '0.450', 'WEAPON5': '0.500', 'weapon5': '0.558', 'weapon2': '1.126', 'HITCOUNT': '1.280', 'weapon3': '1.534', 'DAMAGECOUNT': '5.955', 'FRAGCOUNT': '15.000'} [2023-02-24 20:33:15,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13789.8, 300 sec: 13870.9). Total num frames: 106999808. Throughput: 0: 3436.8. Samples: 1746222. Policy #0 lag: (min: 0.0, avg: 0.9, max: 1.0) [2023-02-24 20:33:15,243][213332] Avg episode reward: [(0, '24.502')] [2023-02-24 20:33:15,281][213352] Saving new best policy, reward=24.502! [2023-02-24 20:33:15,885][213365] Updated weights for policy 0, policy_version 26126 (0.0009) [2023-02-24 20:33:18,878][213365] Updated weights for policy 0, policy_version 26136 (0.0009) [2023-02-24 20:33:20,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13789.9, 300 sec: 13870.9). Total num frames: 107069440. Throughput: 0: 3434.3. Samples: 1756574. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 20:33:20,243][213332] Avg episode reward: [(0, '24.502')] [2023-02-24 20:33:21,873][213365] Updated weights for policy 0, policy_version 26146 (0.0009) [2023-02-24 20:33:24,893][213365] Updated weights for policy 0, policy_version 26156 (0.0009) [2023-02-24 20:33:25,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13870.9). Total num frames: 107139072. Throughput: 0: 3428.0. Samples: 1777072. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 20:33:25,243][213332] Avg episode reward: [(0, '24.502')] [2023-02-24 20:33:27,934][213365] Updated weights for policy 0, policy_version 26166 (0.0010) [2023-02-24 20:33:30,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13721.6, 300 sec: 13857.0). Total num frames: 107204608. Throughput: 0: 3416.8. Samples: 1797314. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 20:33:30,243][213332] Avg episode reward: [(0, '24.502')] [2023-02-24 20:33:30,966][213365] Updated weights for policy 0, policy_version 26176 (0.0009) [2023-02-24 20:33:32,754][213367] DAMAGECOUNT value on done: 58627.0 [2023-02-24 20:33:32,754][213367] Sum rewards: 28.498, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.772', 'AMMO2': '0.013', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'weapon5': '0.280', 'weapon4': '0.318', 'WEAPON5': '0.500', 'weapon2': '0.628', 'WEAPON3': '1.200', 'HITCOUNT': '1.980', 'weapon3': '2.368', 'DAMAGECOUNT': '8.283', 'FRAGCOUNT': '27.000'} [2023-02-24 20:33:33,133][213372] DAMAGECOUNT value on done: 58331.0 [2023-02-24 20:33:33,134][213372] Sum rewards: 15.593, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.970', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO2': '0.026', 'AMMO3': '0.089', 'AMMO4': '0.129', 'weapon4': '0.152', 'WEAPON4': '0.250', 'WEAPON5': '0.550', 'weapon5': '0.558', 'WEAPON3': '0.650', 'weapon2': '0.906', 'HITCOUNT': '1.410', 'weapon3': '1.950', 'DAMAGECOUNT': '6.102', 'FRAGCOUNT': '13.000'} [2023-02-24 20:33:33,176][213367] DAMAGECOUNT value on done: 59768.0 [2023-02-24 20:33:33,177][213367] Sum rewards: 21.893, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.628', 'AMMO5': '0.015', 'AMMO2': '0.022', 'WEAPON1': '0.050', 'AMMO3': '0.065', 'AMMO4': '0.107', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon5': '0.444', 'WEAPON3': '0.450', 'weapon4': '0.500', 'weapon2': '0.936', 'HITCOUNT': '1.220', 'weapon3': '1.656', 'DAMAGECOUNT': '4.656', 'FRAGCOUNT': '17.000'} [2023-02-24 20:33:33,241][213383] DAMAGECOUNT value on done: 58155.0 [2023-02-24 20:33:33,242][213383] Sum rewards: 24.087, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.633', 'ARMOR': '0.004', 'AMMO2': '0.020', 'AMMO5': '0.026', 'WEAPON1': '0.030', 'AMMO4': '0.097', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'weapon4': '0.226', 'weapon2': '0.334', 'weapon5': '0.450', 'WEAPON5': '0.650', 'WEAPON3': '1.200', 'HITCOUNT': '1.650', 'weapon3': '2.510', 'DAMAGECOUNT': '8.646', 'FRAGCOUNT': '22.500'} [2023-02-24 20:33:33,495][213366] DAMAGECOUNT value on done: 60848.0 [2023-02-24 20:33:33,495][213366] Sum rewards: 32.110, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.706', 'AMMO5': '0.025', 'AMMO2': '0.031', 'AMMO3': '0.152', 'AMMO4': '0.153', 'weapon4': '0.162', 'WEAPON4': '0.250', 'weapon2': '0.688', 'WEAPON5': '0.700', 'weapon5': '0.756', 'WEAPON3': '0.950', 'HITCOUNT': '1.710', 'weapon3': '1.860', 'DAMAGECOUNT': '9.879', 'FRAGCOUNT': '27.000'} [2023-02-24 20:33:33,532][213372] DAMAGECOUNT value on done: 57327.0 [2023-02-24 20:33:33,533][213372] Sum rewards: 16.079, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.327', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO3': '0.103', 'weapon5': '0.116', 'AMMO4': '0.142', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.600', 'weapon4': '0.780', 'weapon2': '1.116', 'HITCOUNT': '1.370', 'weapon3': '1.700', 'DAMAGECOUNT': '5.136', 'FRAGCOUNT': '13.000'} [2023-02-24 20:33:33,558][213367] DAMAGECOUNT value on done: 56614.0 [2023-02-24 20:33:33,558][213367] Sum rewards: 26.810, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.752', 'AMMO5': '0.014', 'AMMO2': '0.017', 'AMMO3': '0.082', 'AMMO4': '0.085', 'WEAPON4': '0.200', 'weapon4': '0.344', 'weapon5': '0.358', 'WEAPON5': '0.400', 'weapon2': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '1.680', 'weapon3': '2.310', 'DAMAGECOUNT': '6.822', 'FRAGCOUNT': '21.000'} [2023-02-24 20:33:33,635][213383] DAMAGECOUNT value on done: 63601.0 [2023-02-24 20:33:33,636][213383] Sum rewards: 22.822, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.874', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.100', 'AMMO4': '0.117', 'WEAPON4': '0.200', 'weapon4': '0.304', 'weapon5': '0.516', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'weapon2': '0.992', 'HITCOUNT': '1.380', 'weapon3': '1.526', 'DAMAGECOUNT': '6.297', 'FRAGCOUNT': '18.000'} [2023-02-24 20:33:33,661][213382] DAMAGECOUNT value on done: 58034.0 [2023-02-24 20:33:33,662][213382] Sum rewards: 29.745, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.724', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO2': '0.047', 'AMMO3': '0.071', 'AMMO4': '0.233', 'WEAPON3': '0.500', 'weapon2': '0.530', 'WEAPON4': '0.600', 'weapon5': '0.614', 'WEAPON5': '0.650', 'weapon4': '1.008', 'weapon3': '1.300', 'HITCOUNT': '1.850', 'DAMAGECOUNT': '8.520', 'FRAGCOUNT': '26.000'} [2023-02-24 20:33:33,836][213366] DAMAGECOUNT value on done: 61691.0 [2023-02-24 20:33:33,837][213366] Sum rewards: 30.708, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.128', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO5': '0.020', 'AMMO4': '0.078', 'AMMO3': '0.106', 'WEAPON4': '0.300', 'weapon5': '0.542', 'WEAPON5': '0.550', 'weapon2': '0.610', 'weapon4': '0.632', 'WEAPON3': '0.700', 'HITCOUNT': '1.630', 'weapon3': '1.758', 'DAMAGECOUNT': '7.884', 'FRAGCOUNT': '26.000'} [2023-02-24 20:33:33,875][213372] DAMAGECOUNT value on done: 58760.0 [2023-02-24 20:33:33,876][213372] Sum rewards: 23.500, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.240', 'AMMO2': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.050', 'AMMO3': '0.168', 'weapon2': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon5': '0.472', 'weapon4': '0.488', 'WEAPON3': '1.050', 'HITCOUNT': '2.020', 'weapon3': '2.266', 'DAMAGECOUNT': '8.310', 'FRAGCOUNT': '22.000'} [2023-02-24 20:33:33,925][213367] DAMAGECOUNT value on done: 55874.0 [2023-02-24 20:33:33,926][213367] Sum rewards: 18.630, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.320', 'WEAPON1': '0.010', 'weapon4': '0.012', 'AMMO2': '0.019', 'AMMO5': '0.019', 'WEAPON4': '0.050', 'AMMO3': '0.082', 'AMMO4': '0.097', 'weapon5': '0.484', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '1.000', 'weapon2': '1.076', 'weapon3': '1.932', 'DAMAGECOUNT': '5.118', 'FRAGCOUNT': '14.000'} [2023-02-24 20:33:33,985][213368] DAMAGECOUNT value on done: 55450.0 [2023-02-24 20:33:33,985][213368] Sum rewards: 16.560, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.280', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'weapon4': '0.032', 'WEAPON4': '0.050', 'AMMO4': '0.089', 'AMMO3': '0.118', 'WEAPON5': '0.200', 'weapon5': '0.526', 'WEAPON3': '0.600', 'weapon2': '0.698', 'HITCOUNT': '0.800', 'weapon3': '2.384', 'DAMAGECOUNT': '4.305', 'FRAGCOUNT': '13.000'} [2023-02-24 20:33:34,004][213384] DAMAGECOUNT value on done: 58841.0 [2023-02-24 20:33:34,004][213384] Sum rewards: 21.055, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.657', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.021', 'AMMO3': '0.079', 'AMMO4': '0.107', 'weapon5': '0.198', 'WEAPON4': '0.350', 'weapon4': '0.388', 'WEAPON5': '0.450', 'WEAPON3': '0.450', 'HITCOUNT': '1.220', 'weapon2': '1.280', 'weapon3': '1.904', 'DAMAGECOUNT': '5.487', 'FRAGCOUNT': '18.000'} [2023-02-24 20:33:34,047][213382] DAMAGECOUNT value on done: 61471.0 [2023-02-24 20:33:34,047][213382] Sum rewards: 26.016, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.060', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon4': '0.276', 'weapon2': '0.342', 'weapon5': '0.406', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '1.830', 'weapon3': '2.566', 'DAMAGECOUNT': '8.559', 'FRAGCOUNT': '24.500'} [2023-02-24 20:33:34,224][213372] DAMAGECOUNT value on done: 58590.0 [2023-02-24 20:33:34,225][213372] Sum rewards: 22.716, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.703', 'ARMOR': '0.004', 'AMMO2': '0.010', 'AMMO5': '0.012', 'weapon4': '0.026', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'AMMO3': '0.100', 'WEAPON5': '0.400', 'weapon5': '0.494', 'WEAPON3': '0.650', 'weapon2': '1.198', 'HITCOUNT': '1.260', 'weapon3': '2.006', 'DAMAGECOUNT': '6.660', 'FRAGCOUNT': '18.000'} [2023-02-24 20:33:34,259][213369] DAMAGECOUNT value on done: 58174.0 [2023-02-24 20:33:34,259][213369] Sum rewards: 17.935, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.538', 'AMMO2': '0.024', 'AMMO5': '0.028', 'AMMO3': '0.116', 'AMMO4': '0.119', 'weapon4': '0.168', 'WEAPON4': '0.200', 'weapon5': '0.278', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '1.190', 'weapon2': '1.214', 'weapon3': '1.668', 'DAMAGECOUNT': '5.268', 'FRAGCOUNT': '16.000'} [2023-02-24 20:33:34,278][213383] DAMAGECOUNT value on done: 56359.0 [2023-02-24 20:33:34,279][213383] Sum rewards: 23.910, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.910', 'AMMO2': '0.004', 'AMMO5': '0.013', 'AMMO4': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.068', 'WEAPON4': '0.150', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'weapon2': '0.560', 'weapon4': '0.616', 'weapon5': '0.664', 'HITCOUNT': '1.260', 'weapon3': '1.628', 'DAMAGECOUNT': '6.168', 'FRAGCOUNT': '18.000'} [2023-02-24 20:33:34,290][213366] DAMAGECOUNT value on done: 62432.0 [2023-02-24 20:33:34,291][213366] Sum rewards: 32.543, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.633', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO3': '0.126', 'AMMO4': '0.126', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon5': '0.458', 'weapon4': '0.478', 'weapon2': '0.776', 'WEAPON3': '0.800', 'weapon3': '1.854', 'HITCOUNT': '1.980', 'DAMAGECOUNT': '9.729', 'FRAGCOUNT': '29.000'} [2023-02-24 20:33:34,292][213365] Updated weights for policy 0, policy_version 26186 (0.0010) [2023-02-24 20:33:34,301][213368] DAMAGECOUNT value on done: 59790.0 [2023-02-24 20:33:34,301][213368] Sum rewards: 23.267, reward structure: {'DEATHCOUNT': '-6.000', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.020', 'AMMO3': '0.051', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'HEALTH': '0.224', 'WEAPON3': '0.300', 'WEAPON5': '0.300', 'weapon5': '0.414', 'weapon4': '0.562', 'weapon2': '0.694', 'HITCOUNT': '1.340', 'weapon3': '1.956', 'DAMAGECOUNT': '5.130', 'FRAGCOUNT': '18.000'} [2023-02-24 20:33:34,313][213384] DAMAGECOUNT value on done: 54979.0 [2023-02-24 20:33:34,314][213384] Sum rewards: 31.206, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.564', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.015', 'WEAPON1': '0.040', 'AMMO3': '0.080', 'weapon4': '0.108', 'WEAPON4': '0.150', 'weapon5': '0.274', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'weapon2': '1.476', 'HITCOUNT': '1.780', 'weapon3': '1.842', 'DAMAGECOUNT': '7.992', 'FRAGCOUNT': '24.000'} [2023-02-24 20:33:34,367][213382] DAMAGECOUNT value on done: 57611.0 [2023-02-24 20:33:34,367][213382] Sum rewards: 21.621, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.410', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.024', 'WEAPON4': '0.050', 'AMMO4': '0.060', 'weapon4': '0.130', 'AMMO3': '0.173', 'weapon5': '0.260', 'WEAPON5': '0.500', 'weapon2': '0.930', 'WEAPON3': '0.950', 'HITCOUNT': '1.580', 'weapon3': '2.294', 'DAMAGECOUNT': '6.558', 'FRAGCOUNT': '19.000'} [2023-02-24 20:33:34,571][213369] DAMAGECOUNT value on done: 64064.0 [2023-02-24 20:33:34,572][213369] Sum rewards: 21.687, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.404', 'AMMO2': '0.015', 'AMMO5': '0.032', 'WEAPON4': '0.050', 'AMMO4': '0.074', 'weapon2': '0.184', 'weapon4': '0.194', 'AMMO3': '0.207', 'weapon5': '0.510', 'WEAPON5': '0.800', 'WEAPON3': '1.300', 'HITCOUNT': '1.640', 'weapon3': '2.578', 'DAMAGECOUNT': '6.507', 'FRAGCOUNT': '22.000'} [2023-02-24 20:33:34,577][213383] DAMAGECOUNT value on done: 54812.0 [2023-02-24 20:33:34,578][213383] Sum rewards: 16.598, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.000', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.012', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'weapon4': '0.226', 'WEAPON5': '0.300', 'weapon5': '0.338', 'WEAPON3': '0.700', 'weapon2': '1.208', 'HITCOUNT': '1.290', 'weapon3': '1.870', 'DAMAGECOUNT': '5.175', 'FRAGCOUNT': '14.500'} [2023-02-24 20:33:34,596][213368] DAMAGECOUNT value on done: 59462.0 [2023-02-24 20:33:34,596][213368] Sum rewards: 22.245, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.682', 'ARMOR': '0.004', 'AMMO2': '0.015', 'AMMO5': '0.020', 'weapon4': '0.036', 'AMMO4': '0.073', 'AMMO3': '0.091', 'WEAPON4': '0.150', 'weapon2': '0.582', 'WEAPON5': '0.600', 'weapon5': '0.664', 'WEAPON3': '0.700', 'HITCOUNT': '1.370', 'weapon3': '2.336', 'DAMAGECOUNT': '7.035', 'FRAGCOUNT': '17.000'} [2023-02-24 20:33:34,598][213366] DAMAGECOUNT value on done: 54887.0 [2023-02-24 20:33:34,599][213366] Sum rewards: 23.318, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.167', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.062', 'AMMO3': '0.150', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.292', 'weapon4': '0.394', 'WEAPON3': '0.850', 'weapon2': '0.926', 'HITCOUNT': '1.780', 'weapon3': '1.970', 'DAMAGECOUNT': '7.515', 'FRAGCOUNT': '21.000'} [2023-02-24 20:33:34,628][213384] DAMAGECOUNT value on done: 62366.0 [2023-02-24 20:33:34,629][213384] Sum rewards: 28.257, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.200', 'WEAPON1': '0.010', 'AMMO5': '0.027', 'AMMO2': '0.028', 'AMMO3': '0.122', 'AMMO4': '0.139', 'weapon5': '0.336', 'WEAPON4': '0.450', 'weapon4': '0.508', 'weapon2': '0.576', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'weapon3': '2.040', 'HITCOUNT': '2.100', 'DAMAGECOUNT': '8.220', 'FRAGCOUNT': '25.000'} [2023-02-24 20:33:34,669][213382] DAMAGECOUNT value on done: 59165.0 [2023-02-24 20:33:34,670][213382] Sum rewards: 23.961, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.594', 'AMMO2': '0.011', 'AMMO5': '0.016', 'WEAPON1': '0.030', 'AMMO4': '0.052', 'AMMO3': '0.082', 'WEAPON4': '0.200', 'weapon4': '0.252', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'weapon5': '0.662', 'weapon2': '1.178', 'weapon3': '1.492', 'HITCOUNT': '1.650', 'DAMAGECOUNT': '5.829', 'FRAGCOUNT': '19.000'} [2023-02-24 20:33:34,867][213369] DAMAGECOUNT value on done: 62607.0 [2023-02-24 20:33:34,867][213369] Sum rewards: 28.286, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.458', 'AMMO2': '0.018', 'AMMO5': '0.024', 'AMMO4': '0.092', 'AMMO3': '0.152', 'weapon5': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon4': '0.536', 'weapon2': '0.694', 'WEAPON3': '0.900', 'HITCOUNT': '2.050', 'weapon3': '2.114', 'DAMAGECOUNT': '9.045', 'FRAGCOUNT': '25.000'} [2023-02-24 20:33:34,888][213368] DAMAGECOUNT value on done: 63476.0 [2023-02-24 20:33:34,888][213368] Sum rewards: 30.811, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.639', 'AMMO2': '0.007', 'weapon4': '0.008', 'AMMO5': '0.025', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'AMMO3': '0.154', 'weapon5': '0.506', 'WEAPON5': '0.550', 'weapon2': '0.578', 'WEAPON3': '0.950', 'HITCOUNT': '1.860', 'weapon3': '2.520', 'DAMAGECOUNT': '7.707', 'FRAGCOUNT': '26.500'} [2023-02-24 20:33:34,921][213384] DAMAGECOUNT value on done: 57773.0 [2023-02-24 20:33:34,921][213384] Sum rewards: 19.068, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.785', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO3': '0.036', 'WEAPON4': '0.100', 'WEAPON3': '0.250', 'WEAPON5': '0.450', 'weapon5': '0.460', 'weapon4': '0.626', 'weapon3': '0.922', 'HITCOUNT': '0.930', 'weapon2': '1.402', 'DAMAGECOUNT': '4.656', 'FRAGCOUNT': '13.000'} [2023-02-24 20:33:35,121][213382] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 20:33:35,163][213369] DAMAGECOUNT value on done: 52760.0 [2023-02-24 20:33:35,164][213369] Sum rewards: 12.814, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.480', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.018', 'AMMO3': '0.050', 'weapon7': '0.050', 'AMMO4': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '0.300', 'weapon4': '0.634', 'HITCOUNT': '0.730', 'weapon2': '0.732', 'weapon3': '0.740', 'DAMAGECOUNT': '3.288', 'FRAGCOUNT': '10.000'} [2023-02-24 20:33:35,243][213332] Fps is (10 sec: 13107.3, 60 sec: 13653.3, 300 sec: 13843.1). Total num frames: 107270144. Throughput: 0: 3417.5. Samples: 1807586. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 20:33:35,243][213332] Avg episode reward: [(0, '24.109')] [2023-02-24 20:33:35,381][213383] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 20:33:37,264][213365] Updated weights for policy 0, policy_version 26196 (0.0009) [2023-02-24 20:33:40,209][213365] Updated weights for policy 0, policy_version 26206 (0.0009) [2023-02-24 20:33:40,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13653.3, 300 sec: 13843.1). Total num frames: 107339776. Throughput: 0: 3391.8. Samples: 1827194. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:33:40,243][213332] Avg episode reward: [(0, '24.109')] [2023-02-24 20:33:43,144][213365] Updated weights for policy 0, policy_version 26216 (0.0009) [2023-02-24 20:33:45,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13653.3, 300 sec: 13829.2). Total num frames: 107409408. Throughput: 0: 3396.6. Samples: 1847974. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:33:45,243][213332] Avg episode reward: [(0, '24.109')] [2023-02-24 20:33:46,069][213365] Updated weights for policy 0, policy_version 26226 (0.0009) [2023-02-24 20:33:49,024][213365] Updated weights for policy 0, policy_version 26236 (0.0009) [2023-02-24 20:33:50,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13653.3, 300 sec: 13829.2). Total num frames: 107479040. Throughput: 0: 3403.3. Samples: 1858354. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:33:50,243][213332] Avg episode reward: [(0, '24.109')] [2023-02-24 20:33:52,008][213365] Updated weights for policy 0, policy_version 26246 (0.0009) [2023-02-24 20:33:52,473][213367] DAMAGECOUNT value on done: 61034.0 [2023-02-24 20:33:52,474][213367] Sum rewards: 27.588, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.122', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.028', 'AMMO3': '0.089', 'AMMO4': '0.140', 'WEAPON4': '0.250', 'WEAPON5': '0.500', 'weapon4': '0.506', 'weapon5': '0.512', 'WEAPON3': '0.600', 'weapon2': '0.652', 'HITCOUNT': '1.780', 'weapon3': '1.898', 'DAMAGECOUNT': '7.221', 'FRAGCOUNT': '22.000'} [2023-02-24 20:33:52,770][213367] DAMAGECOUNT value on done: 61692.0 [2023-02-24 20:33:52,770][213367] Sum rewards: 18.734, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.878', 'WEAPON1': '0.010', 'AMMO5': '0.025', 'AMMO2': '0.036', 'AMMO3': '0.120', 'AMMO4': '0.178', 'WEAPON4': '0.300', 'weapon4': '0.386', 'weapon5': '0.568', 'WEAPON5': '0.650', 'WEAPON3': '0.700', 'weapon2': '0.960', 'HITCOUNT': '1.240', 'weapon3': '1.666', 'DAMAGECOUNT': '5.772', 'FRAGCOUNT': '16.000'} [2023-02-24 20:33:52,793][213372] DAMAGECOUNT value on done: 59744.0 [2023-02-24 20:33:52,793][213372] Sum rewards: 18.485, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.082', 'ARMOR': '0.004', 'AMMO2': '0.011', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'AMMO4': '0.053', 'WEAPON4': '0.200', 'weapon4': '0.280', 'WEAPON3': '0.300', 'WEAPON5': '0.350', 'weapon5': '0.504', 'weapon2': '0.642', 'HITCOUNT': '1.150', 'weapon3': '2.266', 'DAMAGECOUNT': '4.224', 'FRAGCOUNT': '13.000'} [2023-02-24 20:33:52,913][213383] DAMAGECOUNT value on done: 60687.0 [2023-02-24 20:33:52,913][213383] Sum rewards: 21.362, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.552', 'AMMO5': '0.014', 'AMMO2': '0.017', 'WEAPON1': '0.040', 'AMMO4': '0.083', 'AMMO3': '0.174', 'WEAPON4': '0.300', 'weapon2': '0.314', 'WEAPON5': '0.450', 'weapon4': '0.456', 'weapon5': '0.820', 'WEAPON3': '1.050', 'HITCOUNT': '1.490', 'weapon3': '1.860', 'DAMAGECOUNT': '7.596', 'FRAGCOUNT': '19.000'} [2023-02-24 20:33:53,017][213366] DAMAGECOUNT value on done: 62940.0 [2023-02-24 20:33:53,018][213366] Sum rewards: 24.616, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.400', 'AMMO5': '0.016', 'AMMO2': '0.022', 'WEAPON1': '0.040', 'AMMO3': '0.074', 'AMMO4': '0.112', 'WEAPON4': '0.200', 'weapon4': '0.280', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon2': '0.646', 'weapon5': '0.664', 'HITCOUNT': '1.450', 'weapon3': '1.984', 'DAMAGECOUNT': '6.276', 'FRAGCOUNT': '20.000'} [2023-02-24 20:33:53,078][213367] DAMAGECOUNT value on done: 59052.0 [2023-02-24 20:33:53,079][213367] Sum rewards: 26.022, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.108', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO3': '0.100', 'weapon4': '0.142', 'AMMO4': '0.217', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.480', 'WEAPON3': '0.550', 'weapon5': '0.940', 'HITCOUNT': '1.570', 'weapon3': '1.946', 'DAMAGECOUNT': '7.314', 'FRAGCOUNT': '21.000'} [2023-02-24 20:33:53,095][213372] DAMAGECOUNT value on done: 59355.0 [2023-02-24 20:33:53,095][213372] Sum rewards: 22.601, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.470', 'AMMO2': '0.007', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'AMMO3': '0.109', 'weapon4': '0.154', 'WEAPON5': '0.400', 'weapon5': '0.402', 'WEAPON3': '0.700', 'weapon2': '0.906', 'HITCOUNT': '1.560', 'weapon3': '2.120', 'DAMAGECOUNT': '6.084', 'FRAGCOUNT': '18.000'} [2023-02-24 20:33:53,202][213382] DAMAGECOUNT value on done: 60046.0 [2023-02-24 20:33:53,202][213382] Sum rewards: 22.048, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.590', 'AMMO5': '0.017', 'AMMO2': '0.024', 'WEAPON1': '0.060', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.101', 'AMMO4': '0.119', 'weapon4': '0.256', 'WEAPON4': '0.300', 'weapon2': '0.382', 'WEAPON5': '0.550', 'weapon5': '0.654', 'WEAPON3': '0.750', 'HITCOUNT': '1.300', 'weapon3': '2.288', 'DAMAGECOUNT': '6.036', 'FRAGCOUNT': '19.500'} [2023-02-24 20:33:53,204][213383] DAMAGECOUNT value on done: 64879.0 [2023-02-24 20:33:53,204][213383] Sum rewards: 13.247, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.545', 'AMMO2': '0.003', 'ARMOR': '0.004', 'AMMO4': '0.012', 'AMMO5': '0.013', 'WEAPON1': '0.040', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'weapon4': '0.176', 'WEAPON5': '0.450', 'weapon5': '0.470', 'WEAPON3': '0.550', 'weapon2': '0.936', 'HITCOUNT': '1.020', 'weapon3': '2.106', 'DAMAGECOUNT': '3.834', 'FRAGCOUNT': '9.500'} [2023-02-24 20:33:53,318][213366] DAMAGECOUNT value on done: 63469.0 [2023-02-24 20:33:53,319][213366] Sum rewards: 19.427, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.530', 'AMMO2': '0.014', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.068', 'AMMO3': '0.095', 'WEAPON4': '0.150', 'WEAPON5': '0.400', 'weapon4': '0.452', 'weapon5': '0.526', 'WEAPON3': '0.550', 'weapon2': '0.986', 'HITCOUNT': '1.290', 'weapon3': '1.294', 'DAMAGECOUNT': '5.334', 'FRAGCOUNT': '14.000'} [2023-02-24 20:33:53,373][213367] DAMAGECOUNT value on done: 57846.0 [2023-02-24 20:33:53,373][213367] Sum rewards: 24.689, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.190', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon7': '0.046', 'WEAPON4': '0.050', 'weapon4': '0.074', 'AMMO4': '0.094', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.100', 'AMMO3': '0.128', 'WEAPON5': '0.150', 'weapon2': '0.618', 'WEAPON3': '0.750', 'HITCOUNT': '1.440', 'weapon3': '2.936', 'DAMAGECOUNT': '5.916', 'FRAGCOUNT': '20.000'} [2023-02-24 20:33:53,392][213372] DAMAGECOUNT value on done: 60881.0 [2023-02-24 20:33:53,393][213372] Sum rewards: 22.033, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.160', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'ARMOR': '0.016', 'AMMO5': '0.022', 'AMMO4': '0.064', 'AMMO3': '0.166', 'weapon2': '0.364', 'WEAPON5': '0.500', 'weapon5': '0.632', 'WEAPON3': '0.950', 'HITCOUNT': '1.280', 'weapon3': '2.564', 'DAMAGECOUNT': '6.363', 'FRAGCOUNT': '19.000'} [2023-02-24 20:33:53,410][213368] DAMAGECOUNT value on done: 57818.0 [2023-02-24 20:33:53,411][213368] Sum rewards: 19.980, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.508', 'AMMO2': '0.028', 'AMMO5': '0.029', 'AMMO3': '0.139', 'AMMO4': '0.140', 'WEAPON4': '0.250', 'weapon2': '0.314', 'weapon4': '0.452', 'weapon5': '0.536', 'WEAPON5': '0.750', 'WEAPON3': '0.850', 'HITCOUNT': '1.450', 'weapon3': '2.186', 'DAMAGECOUNT': '6.864', 'FRAGCOUNT': '18.000'} [2023-02-24 20:33:53,481][213382] DAMAGECOUNT value on done: 64526.0 [2023-02-24 20:33:53,482][213382] Sum rewards: 23.266, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.090', 'AMMO5': '0.017', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.143', 'weapon5': '0.246', 'WEAPON4': '0.300', 'weapon4': '0.430', 'WEAPON5': '0.450', 'weapon2': '0.714', 'WEAPON3': '0.900', 'weapon3': '2.166', 'HITCOUNT': '2.180', 'DAMAGECOUNT': '9.165', 'FRAGCOUNT': '19.500'} [2023-02-24 20:33:53,550][213384] DAMAGECOUNT value on done: 60616.0 [2023-02-24 20:33:53,550][213384] Sum rewards: 22.590, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.286', 'AMMO5': '0.010', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'AMMO3': '0.119', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'weapon4': '0.218', 'WEAPON5': '0.250', 'weapon5': '0.580', 'WEAPON3': '0.750', 'weapon2': '0.960', 'HITCOUNT': '1.190', 'weapon3': '1.626', 'DAMAGECOUNT': '5.325', 'FRAGCOUNT': '20.000'} [2023-02-24 20:33:53,696][213366] DAMAGECOUNT value on done: 64987.0 [2023-02-24 20:33:53,696][213366] Sum rewards: 28.523, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.472', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.022', 'WEAPON1': '0.050', 'AMMO3': '0.094', 'AMMO4': '0.110', 'weapon5': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.464', 'WEAPON3': '0.650', 'weapon4': '1.166', 'weapon3': '1.622', 'HITCOUNT': '1.990', 'DAMAGECOUNT': '7.665', 'FRAGCOUNT': '22.000'} [2023-02-24 20:33:53,710][213372] DAMAGECOUNT value on done: 61083.0 [2023-02-24 20:33:53,710][213372] Sum rewards: 27.796, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.027', 'AMMO2': '0.019', 'AMMO5': '0.025', 'WEAPON1': '0.040', 'AMMO4': '0.096', 'AMMO3': '0.131', 'WEAPON4': '0.250', 'weapon4': '0.338', 'weapon2': '0.400', 'WEAPON5': '0.650', 'weapon5': '0.704', 'WEAPON3': '0.850', 'HITCOUNT': '1.750', 'weapon3': '2.090', 'DAMAGECOUNT': '7.479', 'FRAGCOUNT': '24.000'} [2023-02-24 20:33:53,730][213368] DAMAGECOUNT value on done: 62125.0 [2023-02-24 20:33:53,731][213368] Sum rewards: 27.055, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.119', 'AMMO5': '0.013', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.086', 'AMMO3': '0.103', 'WEAPON5': '0.350', 'weapon2': '0.436', 'WEAPON3': '0.750', 'weapon5': '0.782', 'HITCOUNT': '1.360', 'weapon3': '2.252', 'DAMAGECOUNT': '7.005', 'FRAGCOUNT': '21.000'} [2023-02-24 20:33:53,765][213369] DAMAGECOUNT value on done: 60755.0 [2023-02-24 20:33:53,765][213369] Sum rewards: 22.014, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.980', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.034', 'AMMO3': '0.132', 'AMMO4': '0.171', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.522', 'weapon5': '0.596', 'weapon2': '0.736', 'WEAPON3': '0.750', 'weapon3': '1.712', 'HITCOUNT': '1.770', 'DAMAGECOUNT': '7.728', 'FRAGCOUNT': '20.000'} [2023-02-24 20:33:53,769][213383] DAMAGECOUNT value on done: 58412.0 [2023-02-24 20:33:53,769][213383] Sum rewards: 21.678, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.986', 'ARMOR': '0.004', 'AMMO2': '0.018', 'AMMO5': '0.029', 'WEAPON1': '0.040', 'AMMO3': '0.086', 'AMMO4': '0.089', 'weapon4': '0.280', 'WEAPON4': '0.300', 'weapon2': '0.566', 'WEAPON3': '0.600', 'weapon5': '0.798', 'WEAPON5': '0.800', 'HITCOUNT': '1.100', 'weapon3': '1.844', 'DAMAGECOUNT': '5.859', 'FRAGCOUNT': '18.000'} [2023-02-24 20:33:53,803][213382] DAMAGECOUNT value on done: 60122.0 [2023-02-24 20:33:53,803][213382] Sum rewards: 24.073, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.848', 'AMMO2': '0.011', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.244', 'WEAPON5': '0.500', 'weapon5': '0.544', 'WEAPON3': '0.700', 'weapon2': '0.752', 'HITCOUNT': '1.540', 'weapon3': '2.040', 'DAMAGECOUNT': '7.533', 'FRAGCOUNT': '17.500'} [2023-02-24 20:33:53,868][213384] DAMAGECOUNT value on done: 56670.0 [2023-02-24 20:33:53,869][213384] Sum rewards: 17.822, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.180', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO3': '0.129', 'WEAPON4': '0.200', 'weapon4': '0.464', 'WEAPON5': '0.550', 'weapon2': '0.648', 'WEAPON3': '0.750', 'weapon5': '0.864', 'HITCOUNT': '1.100', 'weapon3': '1.184', 'DAMAGECOUNT': '4.836', 'FRAGCOUNT': '16.000'} [2023-02-24 20:33:54,009][213366] DAMAGECOUNT value on done: 57451.0 [2023-02-24 20:33:54,010][213366] Sum rewards: 32.298, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.422', 'AMMO5': '0.010', 'AMMO2': '0.026', 'WEAPON1': '0.040', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'weapon4': '0.208', 'WEAPON5': '0.250', 'weapon5': '0.320', 'WEAPON3': '0.900', 'weapon2': '0.926', 'HITCOUNT': '1.690', 'weapon3': '1.978', 'DAMAGECOUNT': '7.692', 'FRAGCOUNT': '28.000'} [2023-02-24 20:33:54,032][213368] DAMAGECOUNT value on done: 61795.0 [2023-02-24 20:33:54,032][213368] Sum rewards: 22.907, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.192', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.038', 'WEAPON1': '0.040', 'AMMO3': '0.090', 'AMMO4': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.450', 'weapon2': '0.602', 'weapon4': '0.608', 'WEAPON3': '0.650', 'weapon5': '0.650', 'HITCOUNT': '1.470', 'weapon3': '1.592', 'DAMAGECOUNT': '6.999', 'FRAGCOUNT': '18.000'} [2023-02-24 20:33:54,070][213369] DAMAGECOUNT value on done: 66325.0 [2023-02-24 20:33:54,071][213369] Sum rewards: 22.699, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.710', 'AMMO5': '0.022', 'AMMO2': '0.037', 'WEAPON1': '0.050', 'AMMO3': '0.127', 'AMMO4': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.450', 'weapon4': '0.464', 'weapon2': '0.638', 'weapon5': '0.718', 'WEAPON3': '0.750', 'weapon3': '1.552', 'HITCOUNT': '1.680', 'DAMAGECOUNT': '6.783', 'FRAGCOUNT': '18.000'} [2023-02-24 20:33:54,073][213383] DAMAGECOUNT value on done: 57267.0 [2023-02-24 20:33:54,073][213383] Sum rewards: 17.863, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.805', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'AMMO2': '0.026', 'weapon4': '0.078', 'weapon7': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.130', 'AMMO3': '0.147', 'WEAPON4': '0.250', 'weapon2': '0.534', 'WEAPON5': '0.700', 'weapon5': '0.748', 'WEAPON3': '0.900', 'HITCOUNT': '1.350', 'weapon3': '2.008', 'DAMAGECOUNT': '7.365', 'FRAGCOUNT': '15.500'} [2023-02-24 20:33:54,104][213382] DAMAGECOUNT value on done: 61368.0 [2023-02-24 20:33:54,104][213382] Sum rewards: 28.165, reward structure: {'DEATHCOUNT': '-6.750', 'ARMOR': '0.004', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO2': '0.034', 'AMMO3': '0.066', 'AMMO4': '0.170', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'HEALTH': '0.390', 'weapon5': '0.472', 'weapon2': '0.594', 'weapon4': '0.750', 'HITCOUNT': '1.550', 'weapon3': '1.854', 'DAMAGECOUNT': '6.588', 'FRAGCOUNT': '21.500'} [2023-02-24 20:33:54,160][213384] DAMAGECOUNT value on done: 64094.0 [2023-02-24 20:33:54,161][213384] Sum rewards: 21.887, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.015', 'AMMO5': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.073', 'AMMO3': '0.085', 'HEALTH': '0.155', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'weapon2': '0.530', 'weapon5': '0.600', 'weapon4': '0.798', 'HITCOUNT': '1.250', 'weapon3': '1.532', 'DAMAGECOUNT': '5.184', 'FRAGCOUNT': '16.000'} [2023-02-24 20:33:54,324][213368] DAMAGECOUNT value on done: 64775.0 [2023-02-24 20:33:54,324][213368] Sum rewards: 12.586, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.146', 'AMMO2': '0.006', 'weapon4': '0.010', 'WEAPON1': '0.010', 'AMMO5': '0.023', 'AMMO4': '0.032', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'WEAPON5': '0.550', 'weapon5': '0.648', 'WEAPON3': '0.700', 'HITCOUNT': '0.700', 'weapon2': '0.856', 'weapon3': '1.832', 'DAMAGECOUNT': '3.897', 'FRAGCOUNT': '11.000'} [2023-02-24 20:33:54,377][213369] DAMAGECOUNT value on done: 64757.0 [2023-02-24 20:33:54,378][213369] Sum rewards: 21.415, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.042', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'weapon4': '0.060', 'AMMO3': '0.178', 'weapon2': '0.418', 'WEAPON5': '0.550', 'weapon5': '0.602', 'WEAPON3': '1.050', 'HITCOUNT': '1.430', 'weapon3': '2.556', 'DAMAGECOUNT': '6.450', 'FRAGCOUNT': '19.500'} [2023-02-24 20:33:54,457][213384] DAMAGECOUNT value on done: 59769.0 [2023-02-24 20:33:54,457][213384] Sum rewards: 18.382, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.675', 'AMMO2': '0.009', 'AMMO5': '0.025', 'WEAPON1': '0.040', 'AMMO4': '0.045', 'AMMO3': '0.222', 'weapon2': '0.304', 'WEAPON5': '0.600', 'weapon5': '0.716', 'WEAPON3': '1.350', 'HITCOUNT': '1.440', 'weapon3': '2.568', 'DAMAGECOUNT': '5.988', 'FRAGCOUNT': '19.000'} [2023-02-24 20:33:54,670][213369] DAMAGECOUNT value on done: 54436.0 [2023-02-24 20:33:54,671][213369] Sum rewards: 18.407, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.352', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.039', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.112', 'AMMO4': '0.192', 'WEAPON4': '0.250', 'weapon5': '0.330', 'WEAPON5': '0.400', 'weapon4': '0.566', 'WEAPON3': '0.600', 'weapon2': '0.998', 'HITCOUNT': '1.030', 'weapon3': '1.328', 'DAMAGECOUNT': '5.028', 'FRAGCOUNT': '16.000'} [2023-02-24 20:33:55,023][213365] Updated weights for policy 0, policy_version 26256 (0.0008) [2023-02-24 20:33:55,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13653.3, 300 sec: 13815.3). Total num frames: 107544576. Throughput: 0: 3402.3. Samples: 1878958. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 20:33:55,243][213332] Avg episode reward: [(0, '23.191')] [2023-02-24 20:33:58,089][213365] Updated weights for policy 0, policy_version 26266 (0.0009) [2023-02-24 20:34:00,243][213332] Fps is (10 sec: 13107.2, 60 sec: 13585.2, 300 sec: 13815.3). Total num frames: 107610112. Throughput: 0: 3389.2. Samples: 1898736. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 20:34:00,243][213332] Avg episode reward: [(0, '23.191')] [2023-02-24 20:34:01,258][213365] Updated weights for policy 0, policy_version 26276 (0.0009) [2023-02-24 20:34:04,256][213365] Updated weights for policy 0, policy_version 26286 (0.0009) [2023-02-24 20:34:05,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13815.3). Total num frames: 107679744. Throughput: 0: 3386.7. Samples: 1908974. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 20:34:05,243][213332] Avg episode reward: [(0, '23.191')] [2023-02-24 20:34:07,223][213365] Updated weights for policy 0, policy_version 26296 (0.0009) [2023-02-24 20:34:10,165][213365] Updated weights for policy 0, policy_version 26306 (0.0009) [2023-02-24 20:34:10,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13585.1, 300 sec: 13801.4). Total num frames: 107749376. Throughput: 0: 3388.9. Samples: 1929570. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 20:34:10,243][213332] Avg episode reward: [(0, '23.191')] [2023-02-24 20:34:12,330][213367] DAMAGECOUNT value on done: 63783.0 [2023-02-24 20:34:12,330][213367] Sum rewards: 22.497, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.134', 'AMMO5': '0.020', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.159', 'weapon4': '0.276', 'WEAPON4': '0.400', 'weapon5': '0.420', 'weapon2': '0.426', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'HITCOUNT': '1.510', 'weapon3': '2.488', 'DAMAGECOUNT': '8.247', 'FRAGCOUNT': '21.000'} [2023-02-24 20:34:12,542][213372] DAMAGECOUNT value on done: 62045.0 [2023-02-24 20:34:12,543][213372] Sum rewards: 22.790, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.848', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.030', 'AMMO3': '0.113', 'AMMO4': '0.149', 'weapon2': '0.184', 'weapon4': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'weapon5': '0.972', 'HITCOUNT': '1.500', 'weapon3': '2.170', 'DAMAGECOUNT': '6.903', 'FRAGCOUNT': '19.000'} [2023-02-24 20:34:12,643][213367] DAMAGECOUNT value on done: 64085.0 [2023-02-24 20:34:12,644][213367] Sum rewards: 27.838, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.040', 'AMMO5': '0.028', 'WEAPON1': '0.030', 'AMMO2': '0.034', 'AMMO3': '0.128', 'AMMO4': '0.169', 'weapon2': '0.256', 'WEAPON4': '0.300', 'weapon5': '0.404', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'weapon4': '1.226', 'weapon3': '1.684', 'HITCOUNT': '1.840', 'DAMAGECOUNT': '7.179', 'FRAGCOUNT': '24.000'} [2023-02-24 20:34:12,674][213383] DAMAGECOUNT value on done: 63415.0 [2023-02-24 20:34:12,675][213383] Sum rewards: 26.367, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.885', 'ARMOR': '0.004', 'AMMO2': '0.016', 'AMMO5': '0.019', 'WEAPON1': '0.050', 'AMMO4': '0.079', 'AMMO3': '0.159', 'WEAPON4': '0.250', 'weapon4': '0.310', 'weapon5': '0.420', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'weapon2': '1.086', 'weapon3': '1.754', 'HITCOUNT': '1.770', 'DAMAGECOUNT': '8.184', 'FRAGCOUNT': '24.000'} [2023-02-24 20:34:12,845][213372] DAMAGECOUNT value on done: 61454.0 [2023-02-24 20:34:12,845][213372] Sum rewards: 19.170, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.905', 'WEAPON1': '0.020', 'AMMO5': '0.026', 'AMMO2': '0.035', 'AMMO3': '0.137', 'AMMO4': '0.175', 'weapon2': '0.358', 'ARMOR': '0.460', 'WEAPON4': '0.550', 'weapon5': '0.608', 'weapon4': '0.622', 'WEAPON5': '0.700', 'WEAPON3': '0.850', 'HITCOUNT': '1.360', 'weapon3': '1.876', 'DAMAGECOUNT': '6.297', 'FRAGCOUNT': '20.000'} [2023-02-24 20:34:12,897][213366] DAMAGECOUNT value on done: 65170.0 [2023-02-24 20:34:12,898][213366] Sum rewards: 28.932, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.150', 'AMMO2': '0.013', 'AMMO5': '0.024', 'WEAPON1': '0.060', 'AMMO4': '0.064', 'AMMO3': '0.096', 'weapon4': '0.136', 'WEAPON4': '0.200', 'WEAPON3': '0.600', 'WEAPON5': '0.700', 'weapon5': '0.740', 'weapon2': '0.848', 'HITCOUNT': '1.380', 'weapon3': '1.780', 'DAMAGECOUNT': '6.690', 'FRAGCOUNT': '25.000'} [2023-02-24 20:34:12,958][213367] DAMAGECOUNT value on done: 61148.0 [2023-02-24 20:34:12,958][213367] Sum rewards: 23.822, reward structure: {'DEATHCOUNT': '-9.750', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO2': '0.023', 'WEAPON4': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.129', 'weapon4': '0.322', 'WEAPON5': '0.450', 'weapon5': '0.514', 'WEAPON3': '0.700', 'HEALTH': '0.720', 'weapon2': '0.948', 'HITCOUNT': '1.400', 'weapon3': '1.822', 'DAMAGECOUNT': '6.288', 'FRAGCOUNT': '20.000'} [2023-02-24 20:34:12,982][213382] DAMAGECOUNT value on done: 61994.0 [2023-02-24 20:34:12,982][213382] Sum rewards: 28.449, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.455', 'AMMO2': '0.001', 'AMMO4': '0.005', 'WEAPON1': '0.010', 'AMMO5': '0.026', 'AMMO3': '0.121', 'weapon2': '0.246', 'weapon5': '0.438', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'HITCOUNT': '1.510', 'weapon3': '2.902', 'DAMAGECOUNT': '5.844', 'FRAGCOUNT': '24.000'} [2023-02-24 20:34:12,986][213383] DAMAGECOUNT value on done: 67821.0 [2023-02-24 20:34:12,986][213383] Sum rewards: 27.939, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.396', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.027', 'WEAPON1': '0.040', 'AMMO4': '0.135', 'AMMO3': '0.158', 'WEAPON4': '0.250', 'weapon4': '0.252', 'weapon2': '0.264', 'weapon5': '0.484', 'WEAPON5': '0.700', 'WEAPON3': '1.050', 'HITCOUNT': '1.740', 'weapon3': '2.630', 'DAMAGECOUNT': '8.826', 'FRAGCOUNT': '25.000'} [2023-02-24 20:34:13,156][213365] Updated weights for policy 0, policy_version 26316 (0.0009) [2023-02-24 20:34:13,164][213372] DAMAGECOUNT value on done: 63487.0 [2023-02-24 20:34:13,165][213372] Sum rewards: 25.945, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.732', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon7': '0.062', 'AMMO3': '0.077', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.166', 'WEAPON7': '0.200', 'weapon2': '0.306', 'weapon5': '0.310', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '0.500', 'weapon4': '1.298', 'weapon3': '1.402', 'HITCOUNT': '1.840', 'DAMAGECOUNT': '7.623', 'FRAGCOUNT': '21.000'} [2023-02-24 20:34:13,204][213366] DAMAGECOUNT value on done: 66100.0 [2023-02-24 20:34:13,205][213366] Sum rewards: 22.677, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.169', 'AMMO2': '0.011', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.053', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'weapon5': '0.236', 'WEAPON5': '0.450', 'weapon4': '0.478', 'weapon2': '0.486', 'WEAPON3': '1.100', 'HITCOUNT': '2.080', 'weapon3': '2.444', 'DAMAGECOUNT': '7.893', 'FRAGCOUNT': '22.000'} [2023-02-24 20:34:13,270][213367] DAMAGECOUNT value on done: 60778.0 [2023-02-24 20:34:13,271][213367] Sum rewards: 32.804, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.750', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO5': '0.016', 'AMMO4': '0.041', 'WEAPON4': '0.100', 'AMMO3': '0.176', 'weapon4': '0.202', 'weapon2': '0.350', 'WEAPON5': '0.400', 'weapon5': '0.618', 'WEAPON3': '1.000', 'HITCOUNT': '1.820', 'weapon3': '2.522', 'DAMAGECOUNT': '8.796', 'FRAGCOUNT': '28.000'} [2023-02-24 20:34:13,283][213382] DAMAGECOUNT value on done: 67120.0 [2023-02-24 20:34:13,283][213382] Sum rewards: 33.145, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.098', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.112', 'AMMO4': '0.113', 'weapon4': '0.128', 'WEAPON4': '0.150', 'weapon5': '0.338', 'WEAPON5': '0.400', 'weapon2': '0.640', 'WEAPON3': '0.750', 'HITCOUNT': '1.770', 'weapon3': '2.502', 'DAMAGECOUNT': '7.782', 'FRAGCOUNT': '27.000'} [2023-02-24 20:34:13,306][213368] DAMAGECOUNT value on done: 59769.0 [2023-02-24 20:34:13,306][213368] Sum rewards: 16.932, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.770', 'AMMO5': '0.023', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'AMMO4': '0.142', 'AMMO3': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.270', 'weapon4': '0.392', 'WEAPON5': '0.550', 'weapon5': '0.594', 'WEAPON3': '0.900', 'HITCOUNT': '1.430', 'weapon3': '2.346', 'DAMAGECOUNT': '5.847', 'FRAGCOUNT': '17.000'} [2023-02-24 20:34:13,374][213384] DAMAGECOUNT value on done: 62840.0 [2023-02-24 20:34:13,375][213384] Sum rewards: 25.725, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.665', 'AMMO2': '0.006', 'AMMO5': '0.018', 'AMMO4': '0.029', 'AMMO3': '0.129', 'WEAPON5': '0.500', 'weapon2': '0.524', 'weapon5': '0.772', 'WEAPON3': '0.850', 'HITCOUNT': '1.350', 'weapon3': '2.290', 'DAMAGECOUNT': '6.672', 'FRAGCOUNT': '21.000'} [2023-02-24 20:34:13,464][213372] DAMAGECOUNT value on done: 62240.0 [2023-02-24 20:34:13,465][213372] Sum rewards: 8.570, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.645', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'weapon4': '0.016', 'AMMO5': '0.021', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.166', 'WEAPON5': '0.400', 'weapon5': '0.528', 'HITCOUNT': '0.590', 'weapon2': '0.660', 'WEAPON3': '0.800', 'weapon3': '1.472', 'DAMAGECOUNT': '3.441', 'FRAGCOUNT': '10.000'} [2023-02-24 20:34:13,501][213369] DAMAGECOUNT value on done: 62435.0 [2023-02-24 20:34:13,502][213369] Sum rewards: 18.085, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.090', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon7': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.102', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'weapon4': '0.368', 'weapon2': '0.496', 'weapon5': '0.504', 'WEAPON3': '0.600', 'HITCOUNT': '0.750', 'weapon3': '1.316', 'DAMAGECOUNT': '5.040', 'FRAGCOUNT': '15.000'} [2023-02-24 20:34:13,548][213383] DAMAGECOUNT value on done: 60829.0 [2023-02-24 20:34:13,548][213383] Sum rewards: 23.353, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.950', 'ARMOR': '0.008', 'AMMO5': '0.011', 'WEAPON1': '0.030', 'AMMO2': '0.034', 'AMMO3': '0.129', 'AMMO4': '0.170', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon5': '0.304', 'weapon2': '0.360', 'WEAPON3': '0.750', 'weapon4': '1.278', 'HITCOUNT': '1.400', 'weapon3': '1.728', 'DAMAGECOUNT': '7.251', 'FRAGCOUNT': '20.000'} [2023-02-24 20:34:13,559][213366] DAMAGECOUNT value on done: 67165.0 [2023-02-24 20:34:13,560][213366] Sum rewards: 24.242, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.315', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO3': '0.064', 'AMMO4': '0.123', 'weapon2': '0.258', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'WEAPON4': '0.400', 'weapon5': '0.478', 'weapon4': '1.102', 'HITCOUNT': '1.700', 'weapon3': '1.700', 'DAMAGECOUNT': '6.534', 'FRAGCOUNT': '19.000'} [2023-02-24 20:34:13,580][213382] DAMAGECOUNT value on done: 62987.0 [2023-02-24 20:34:13,581][213382] Sum rewards: 30.470, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.635', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO3': '0.101', 'WEAPON5': '0.300', 'weapon5': '0.500', 'WEAPON3': '0.800', 'weapon2': '0.836', 'HITCOUNT': '1.850', 'weapon3': '2.130', 'DAMAGECOUNT': '8.595', 'FRAGCOUNT': '23.000'} [2023-02-24 20:34:13,611][213368] DAMAGECOUNT value on done: 64519.0 [2023-02-24 20:34:13,612][213368] Sum rewards: 23.662, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.691', 'WEAPON1': '0.020', 'AMMO5': '0.027', 'AMMO2': '0.033', 'AMMO3': '0.105', 'AMMO4': '0.164', 'WEAPON4': '0.450', 'weapon5': '0.458', 'WEAPON3': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.600', 'weapon2': '1.074', 'weapon3': '1.360', 'HITCOUNT': '1.530', 'DAMAGECOUNT': '7.182', 'FRAGCOUNT': '21.000'} [2023-02-24 20:34:13,673][213384] DAMAGECOUNT value on done: 58405.0 [2023-02-24 20:34:13,674][213384] Sum rewards: 18.006, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.924', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.032', 'AMMO3': '0.089', 'AMMO4': '0.161', 'weapon4': '0.168', 'WEAPON4': '0.200', 'weapon5': '0.456', 'WEAPON3': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.886', 'HITCOUNT': '0.960', 'weapon3': '2.124', 'DAMAGECOUNT': '4.725', 'FRAGCOUNT': '14.000'} [2023-02-24 20:34:13,801][213369] DAMAGECOUNT value on done: 68148.0 [2023-02-24 20:34:13,802][213369] Sum rewards: 21.215, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.620', 'ARMOR': '0.004', 'weapon7': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.130', 'AMMO4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.304', 'WEAPON5': '0.450', 'weapon2': '0.458', 'weapon5': '0.594', 'WEAPON3': '0.800', 'HITCOUNT': '1.260', 'weapon3': '2.288', 'DAMAGECOUNT': '5.469', 'FRAGCOUNT': '19.000'} [2023-02-24 20:34:13,860][213383] DAMAGECOUNT value on done: 58933.0 [2023-02-24 20:34:13,861][213383] Sum rewards: 21.570, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.811', 'AMMO5': '0.024', 'AMMO2': '0.026', 'weapon7': '0.050', 'AMMO3': '0.061', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.128', 'weapon2': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon5': '0.586', 'HITCOUNT': '1.040', 'weapon3': '1.182', 'weapon4': '1.196', 'DAMAGECOUNT': '4.998', 'FRAGCOUNT': '18.000'} [2023-02-24 20:34:13,867][213366] DAMAGECOUNT value on done: 60756.0 [2023-02-24 20:34:13,867][213366] Sum rewards: 31.431, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.770', 'AMMO2': '0.014', 'AMMO5': '0.026', 'WEAPON1': '0.030', 'AMMO4': '0.067', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon4': '0.222', 'weapon2': '0.390', 'weapon5': '0.446', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'HITCOUNT': '2.350', 'weapon3': '2.552', 'DAMAGECOUNT': '9.915', 'FRAGCOUNT': '28.000'} [2023-02-24 20:34:13,881][213382] DAMAGECOUNT value on done: 63333.0 [2023-02-24 20:34:13,882][213382] Sum rewards: 23.351, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.340', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO3': '0.085', 'WEAPON4': '0.150', 'AMMO4': '0.196', 'WEAPON5': '0.300', 'weapon4': '0.450', 'weapon5': '0.484', 'WEAPON3': '0.550', 'weapon2': '0.992', 'HITCOUNT': '1.430', 'weapon3': '1.858', 'DAMAGECOUNT': '5.895', 'FRAGCOUNT': '18.000'} [2023-02-24 20:34:13,908][213368] DAMAGECOUNT value on done: 64444.0 [2023-02-24 20:34:13,909][213368] Sum rewards: 22.083, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.615', 'ARMOR': '0.004', 'AMMO2': '0.020', 'AMMO5': '0.025', 'AMMO4': '0.102', 'AMMO3': '0.180', 'WEAPON4': '0.350', 'weapon2': '0.414', 'weapon4': '0.550', 'WEAPON5': '0.600', 'weapon5': '0.614', 'WEAPON3': '1.000', 'HITCOUNT': '1.670', 'weapon3': '1.972', 'DAMAGECOUNT': '7.947', 'FRAGCOUNT': '22.000'} [2023-02-24 20:34:13,978][213384] DAMAGECOUNT value on done: 66657.0 [2023-02-24 20:34:13,978][213384] Sum rewards: 24.327, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.120', 'ARMOR': '0.012', 'AMMO5': '0.023', 'AMMO2': '0.044', 'AMMO3': '0.105', 'AMMO4': '0.221', 'WEAPON4': '0.550', 'weapon2': '0.616', 'weapon5': '0.630', 'WEAPON5': '0.700', 'weapon4': '0.742', 'WEAPON3': '0.750', 'HITCOUNT': '1.530', 'weapon3': '1.584', 'DAMAGECOUNT': '7.689', 'FRAGCOUNT': '22.000'} [2023-02-24 20:34:14,107][213369] DAMAGECOUNT value on done: 65853.0 [2023-02-24 20:34:14,107][213369] Sum rewards: 12.464, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.903', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'weapon4': '0.024', 'AMMO2': '0.037', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.187', 'WEAPON5': '0.550', 'weapon5': '0.560', 'WEAPON3': '0.600', 'HITCOUNT': '0.810', 'weapon2': '1.506', 'weapon3': '1.576', 'DAMAGECOUNT': '3.288', 'FRAGCOUNT': '10.000'} [2023-02-24 20:34:14,216][213368] DAMAGECOUNT value on done: 66412.0 [2023-02-24 20:34:14,216][213368] Sum rewards: 15.931, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.962', 'AMMO2': '0.008', 'AMMO5': '0.016', 'WEAPON1': '0.040', 'AMMO4': '0.041', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'weapon4': '0.188', 'weapon2': '0.444', 'WEAPON5': '0.450', 'weapon5': '0.486', 'WEAPON3': '1.100', 'HITCOUNT': '1.230', 'weapon3': '2.408', 'DAMAGECOUNT': '4.911', 'FRAGCOUNT': '17.000'} [2023-02-24 20:34:14,286][213384] DAMAGECOUNT value on done: 62845.0 [2023-02-24 20:34:14,287][213384] Sum rewards: 33.362, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.487', 'AMMO2': '0.011', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.052', 'AMMO3': '0.128', 'weapon4': '0.166', 'WEAPON4': '0.200', 'weapon5': '0.436', 'WEAPON5': '0.450', 'weapon2': '0.500', 'WEAPON3': '0.850', 'HITCOUNT': '2.090', 'weapon3': '2.452', 'DAMAGECOUNT': '9.228', 'FRAGCOUNT': '28.000'} [2023-02-24 20:34:14,425][213369] DAMAGECOUNT value on done: 57084.0 [2023-02-24 20:34:14,425][213369] Sum rewards: 27.533, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.306', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.152', 'weapon5': '0.262', 'weapon4': '0.302', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.572', 'WEAPON3': '0.850', 'HITCOUNT': '1.900', 'weapon3': '2.426', 'DAMAGECOUNT': '7.944', 'FRAGCOUNT': '25.000'} [2023-02-24 20:34:15,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13653.3, 300 sec: 13801.4). Total num frames: 107819008. Throughput: 0: 3396.1. Samples: 1950138. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:34:15,243][213332] Avg episode reward: [(0, '23.088')] [2023-02-24 20:34:16,141][213365] Updated weights for policy 0, policy_version 26326 (0.0009) [2023-02-24 20:34:19,061][213365] Updated weights for policy 0, policy_version 26336 (0.0008) [2023-02-24 20:34:20,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13653.3, 300 sec: 13815.3). Total num frames: 107888640. Throughput: 0: 3399.3. Samples: 1960556. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:34:20,243][213332] Avg episode reward: [(0, '23.088')] [2023-02-24 20:34:21,998][213365] Updated weights for policy 0, policy_version 26346 (0.0009) [2023-02-24 20:34:24,932][213365] Updated weights for policy 0, policy_version 26356 (0.0009) [2023-02-24 20:34:25,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13653.3, 300 sec: 13815.3). Total num frames: 107958272. Throughput: 0: 3427.7. Samples: 1981440. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:34:25,243][213332] Avg episode reward: [(0, '23.088')] [2023-02-24 20:34:27,973][213365] Updated weights for policy 0, policy_version 26366 (0.0009) [2023-02-24 20:34:30,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13653.3, 300 sec: 13801.4). Total num frames: 108023808. Throughput: 0: 3421.5. Samples: 2001940. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:34:30,243][213332] Avg episode reward: [(0, '23.088')] [2023-02-24 20:34:30,985][213365] Updated weights for policy 0, policy_version 26376 (0.0009) [2023-02-24 20:34:31,875][213367] DAMAGECOUNT value on done: 65274.0 [2023-02-24 20:34:31,875][213367] Sum rewards: 20.348, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.440', 'ARMOR': '0.005', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'AMMO3': '0.042', 'AMMO4': '0.138', 'WEAPON4': '0.250', 'weapon4': '0.278', 'WEAPON3': '0.300', 'WEAPON5': '0.300', 'weapon5': '0.594', 'weapon2': '0.996', 'HITCOUNT': '1.060', 'weapon3': '1.794', 'DAMAGECOUNT': '4.473', 'FRAGCOUNT': '15.000'} [2023-02-24 20:34:32,017][213372] DAMAGECOUNT value on done: 63471.0 [2023-02-24 20:34:32,018][213372] Sum rewards: 19.030, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO3': '0.080', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'WEAPON3': '0.400', 'weapon4': '0.406', 'HEALTH': '0.592', 'weapon5': '0.772', 'weapon2': '0.784', 'HITCOUNT': '0.980', 'weapon3': '1.628', 'DAMAGECOUNT': '4.278', 'FRAGCOUNT': '14.000'} [2023-02-24 20:34:32,176][213383] DAMAGECOUNT value on done: 65746.0 [2023-02-24 20:34:32,176][213383] Sum rewards: 20.762, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.382', 'AMMO5': '0.014', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.182', 'weapon2': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon5': '0.360', 'weapon4': '0.516', 'WEAPON3': '1.150', 'HITCOUNT': '1.720', 'weapon3': '2.492', 'DAMAGECOUNT': '6.993', 'FRAGCOUNT': '20.000'} [2023-02-24 20:34:32,180][213367] DAMAGECOUNT value on done: 65813.0 [2023-02-24 20:34:32,181][213367] Sum rewards: 15.884, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.125', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.015', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'weapon4': '0.238', 'WEAPON5': '0.250', 'weapon2': '0.330', 'weapon5': '0.554', 'WEAPON3': '0.750', 'HITCOUNT': '0.970', 'weapon3': '2.466', 'DAMAGECOUNT': '5.184', 'FRAGCOUNT': '14.000'} [2023-02-24 20:34:32,327][213372] DAMAGECOUNT value on done: 64661.0 [2023-02-24 20:34:32,328][213372] Sum rewards: 35.717, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.122', 'AMMO5': '0.019', 'WEAPON1': '0.040', 'AMMO2': '0.040', 'weapon4': '0.162', 'AMMO3': '0.166', 'AMMO4': '0.202', 'weapon2': '0.302', 'weapon5': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'HITCOUNT': '2.130', 'weapon3': '2.774', 'DAMAGECOUNT': '9.621', 'FRAGCOUNT': '32.000'} [2023-02-24 20:34:32,405][213366] DAMAGECOUNT value on done: 67409.0 [2023-02-24 20:34:32,405][213366] Sum rewards: 19.000, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.247', 'AMMO2': '0.018', 'weapon4': '0.020', 'AMMO5': '0.020', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.164', 'WEAPON5': '0.450', 'weapon5': '0.550', 'weapon2': '0.610', 'WEAPON3': '1.000', 'HITCOUNT': '1.530', 'weapon3': '2.480', 'DAMAGECOUNT': '6.717', 'FRAGCOUNT': '17.000'} [2023-02-24 20:34:32,441][213382] DAMAGECOUNT value on done: 63686.0 [2023-02-24 20:34:32,441][213382] Sum rewards: 22.894, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.290', 'AMMO5': '0.006', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'weapon7': '0.040', 'AMMO4': '0.060', 'weapon4': '0.074', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.496', 'WEAPON3': '0.600', 'HITCOUNT': '1.100', 'weapon2': '1.210', 'weapon3': '1.834', 'DAMAGECOUNT': '5.076', 'FRAGCOUNT': '18.000'} [2023-02-24 20:34:32,485][213367] DAMAGECOUNT value on done: 63938.0 [2023-02-24 20:34:32,485][213367] Sum rewards: 29.286, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.540', 'AMMO2': '0.018', 'AMMO5': '0.032', 'AMMO4': '0.091', 'AMMO3': '0.200', 'weapon2': '0.214', 'WEAPON4': '0.250', 'weapon4': '0.294', 'weapon5': '0.478', 'WEAPON5': '0.850', 'WEAPON3': '1.250', 'HITCOUNT': '1.890', 'weapon3': '2.638', 'DAMAGECOUNT': '8.370', 'FRAGCOUNT': '28.000'} [2023-02-24 20:34:32,486][213383] DAMAGECOUNT value on done: 69624.0 [2023-02-24 20:34:32,487][213383] Sum rewards: 21.994, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-2.015', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.052', 'weapon5': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.400', 'weapon4': '0.718', 'HITCOUNT': '1.250', 'weapon3': '1.296', 'weapon2': '1.366', 'DAMAGECOUNT': '5.409', 'FRAGCOUNT': '17.000'} [2023-02-24 20:34:32,669][213372] DAMAGECOUNT value on done: 65436.0 [2023-02-24 20:34:32,670][213372] Sum rewards: 21.460, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.012', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'HEALTH': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.096', 'weapon4': '0.214', 'WEAPON5': '0.350', 'weapon5': '0.388', 'WEAPON3': '0.650', 'weapon2': '0.776', 'HITCOUNT': '1.350', 'weapon3': '1.814', 'DAMAGECOUNT': '5.847', 'FRAGCOUNT': '16.500'} [2023-02-24 20:34:32,705][213366] DAMAGECOUNT value on done: 68697.0 [2023-02-24 20:34:32,705][213366] Sum rewards: 25.269, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.351', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'AMMO5': '0.026', 'AMMO4': '0.114', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon4': '0.294', 'weapon2': '0.450', 'weapon5': '0.562', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'HITCOUNT': '1.580', 'weapon3': '2.178', 'DAMAGECOUNT': '7.791', 'FRAGCOUNT': '25.000'} [2023-02-24 20:34:32,735][213382] DAMAGECOUNT value on done: 69104.0 [2023-02-24 20:34:32,735][213382] Sum rewards: 19.670, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.402', 'AMMO2': '0.006', 'AMMO5': '0.017', 'AMMO4': '0.029', 'AMMO3': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.308', 'weapon5': '0.458', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon2': '0.818', 'HITCOUNT': '1.110', 'weapon3': '2.044', 'DAMAGECOUNT': '5.952', 'FRAGCOUNT': '17.000'} [2023-02-24 20:34:32,790][213367] DAMAGECOUNT value on done: 62925.0 [2023-02-24 20:34:32,790][213367] Sum rewards: 25.329, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.851', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO5': '0.023', 'AMMO4': '0.077', 'AMMO3': '0.113', 'weapon4': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.290', 'weapon5': '0.592', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'HITCOUNT': '1.340', 'weapon3': '2.330', 'DAMAGECOUNT': '6.441', 'FRAGCOUNT': '20.000'} [2023-02-24 20:34:32,791][213368] DAMAGECOUNT value on done: 61544.0 [2023-02-24 20:34:32,792][213368] Sum rewards: 24.317, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.471', 'AMMO2': '0.005', 'AMMO5': '0.019', 'AMMO4': '0.026', 'WEAPON1': '0.040', 'AMMO3': '0.106', 'WEAPON5': '0.450', 'weapon5': '0.626', 'WEAPON3': '0.650', 'weapon2': '0.794', 'HITCOUNT': '1.330', 'weapon3': '2.166', 'DAMAGECOUNT': '5.325', 'FRAGCOUNT': '20.000'} [2023-02-24 20:34:32,938][213384] DAMAGECOUNT value on done: 65613.0 [2023-02-24 20:34:32,939][213384] Sum rewards: 27.483, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.660', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.028', 'AMMO4': '0.137', 'AMMO3': '0.167', 'WEAPON4': '0.300', 'weapon2': '0.424', 'weapon5': '0.442', 'WEAPON5': '0.500', 'weapon4': '0.584', 'WEAPON3': '0.950', 'HITCOUNT': '1.910', 'weapon3': '2.100', 'DAMAGECOUNT': '8.319', 'FRAGCOUNT': '24.500'} [2023-02-24 20:34:32,973][213372] DAMAGECOUNT value on done: 64521.0 [2023-02-24 20:34:32,973][213372] Sum rewards: 25.091, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.845', 'AMMO2': '0.012', 'AMMO5': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.117', 'weapon2': '0.264', 'weapon4': '0.348', 'WEAPON5': '0.350', 'weapon5': '0.488', 'WEAPON3': '0.750', 'HITCOUNT': '1.640', 'weapon3': '2.504', 'DAMAGECOUNT': '6.843', 'FRAGCOUNT': '20.000'} [2023-02-24 20:34:33,006][213369] DAMAGECOUNT value on done: 64626.0 [2023-02-24 20:34:33,007][213369] Sum rewards: 26.646, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.611', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'WEAPON4': '0.150', 'WEAPON3': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.550', 'weapon5': '0.702', 'weapon2': '0.926', 'weapon3': '1.408', 'HITCOUNT': '1.510', 'DAMAGECOUNT': '6.573', 'FRAGCOUNT': '19.000'} [2023-02-24 20:34:33,021][213382] DAMAGECOUNT value on done: 65011.0 [2023-02-24 20:34:33,022][213382] Sum rewards: 21.093, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.778', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.029', 'weapon4': '0.058', 'AMMO3': '0.099', 'AMMO4': '0.146', 'WEAPON4': '0.250', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'weapon5': '0.698', 'weapon2': '0.712', 'HITCOUNT': '1.210', 'weapon3': '1.864', 'DAMAGECOUNT': '6.072', 'FRAGCOUNT': '18.000'} [2023-02-24 20:34:33,037][213383] DAMAGECOUNT value on done: 62650.0 [2023-02-24 20:34:33,037][213383] Sum rewards: 15.806, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.275', 'AMMO2': '0.015', 'AMMO5': '0.018', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'AMMO3': '0.145', 'weapon4': '0.238', 'WEAPON5': '0.300', 'weapon2': '0.306', 'weapon5': '0.504', 'WEAPON3': '0.900', 'HITCOUNT': '1.280', 'weapon3': '2.486', 'DAMAGECOUNT': '5.463', 'FRAGCOUNT': '15.000'} [2023-02-24 20:34:33,085][213366] DAMAGECOUNT value on done: 68935.0 [2023-02-24 20:34:33,085][213366] Sum rewards: 21.134, reward structure: {'DEATHCOUNT': '-5.250', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO5': '0.022', 'AMMO3': '0.067', 'AMMO4': '0.105', 'HEALTH': '0.184', 'WEAPON4': '0.200', 'weapon4': '0.236', 'WEAPON3': '0.400', 'WEAPON5': '0.550', 'weapon2': '0.618', 'weapon5': '0.804', 'HITCOUNT': '1.070', 'weapon3': '1.776', 'DAMAGECOUNT': '5.310', 'FRAGCOUNT': '15.000'} [2023-02-24 20:34:33,087][213368] DAMAGECOUNT value on done: 67508.0 [2023-02-24 20:34:33,087][213368] Sum rewards: 27.768, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.899', 'AMMO5': '0.026', 'AMMO2': '0.033', 'AMMO4': '0.167', 'WEAPON4': '0.200', 'AMMO3': '0.259', 'weapon2': '0.280', 'weapon4': '0.334', 'weapon5': '0.370', 'WEAPON5': '0.650', 'WEAPON3': '1.550', 'HITCOUNT': '2.090', 'weapon3': '2.490', 'DAMAGECOUNT': '8.967', 'FRAGCOUNT': '29.000'} [2023-02-24 20:34:33,238][213384] DAMAGECOUNT value on done: 60473.0 [2023-02-24 20:34:33,239][213384] Sum rewards: 25.396, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.556', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO4': '0.032', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'weapon5': '0.276', 'weapon4': '0.316', 'weapon2': '0.384', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '1.400', 'weapon3': '2.794', 'DAMAGECOUNT': '6.204', 'FRAGCOUNT': '20.000'} [2023-02-24 20:34:33,311][213382] DAMAGECOUNT value on done: 65133.0 [2023-02-24 20:34:33,311][213369] DAMAGECOUNT value on done: 70700.0 [2023-02-24 20:34:33,312][213369] Sum rewards: 26.626, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.674', 'AMMO2': '0.022', 'AMMO5': '0.024', 'WEAPON1': '0.030', 'AMMO4': '0.109', 'AMMO3': '0.136', 'WEAPON4': '0.350', 'weapon2': '0.448', 'ARMOR': '0.455', 'weapon5': '0.486', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'weapon4': '0.868', 'weapon3': '1.726', 'HITCOUNT': '1.840', 'DAMAGECOUNT': '7.656', 'FRAGCOUNT': '24.000'} [2023-02-24 20:34:33,312][213382] Sum rewards: 21.183, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.786', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO3': '0.044', 'weapon7': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.142', 'WEAPON3': '0.300', 'weapon5': '0.390', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.826', 'weapon4': '0.896', 'HITCOUNT': '1.160', 'weapon3': '1.546', 'DAMAGECOUNT': '5.400', 'FRAGCOUNT': '16.000'} [2023-02-24 20:34:33,339][213383] DAMAGECOUNT value on done: 61112.0 [2023-02-24 20:34:33,340][213383] Sum rewards: 25.011, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.950', 'AMMO5': '0.016', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO3': '0.070', 'AMMO4': '0.089', 'WEAPON4': '0.350', 'weapon5': '0.430', 'WEAPON3': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.880', 'weapon3': '1.046', 'weapon4': '1.154', 'HITCOUNT': '1.650', 'DAMAGECOUNT': '6.537', 'FRAGCOUNT': '22.000'} [2023-02-24 20:34:33,381][213366] DAMAGECOUNT value on done: 63148.0 [2023-02-24 20:34:33,381][213366] Sum rewards: 18.943, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.662', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.039', 'AMMO3': '0.115', 'AMMO4': '0.197', 'WEAPON4': '0.400', 'weapon2': '0.436', 'weapon5': '0.486', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'weapon4': '0.938', 'weapon3': '1.394', 'HITCOUNT': '1.500', 'DAMAGECOUNT': '7.176', 'FRAGCOUNT': '16.500'} [2023-02-24 20:34:33,388][213368] DAMAGECOUNT value on done: 66478.0 [2023-02-24 20:34:33,388][213368] Sum rewards: 23.907, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.918', 'AMMO2': '0.012', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.059', 'weapon4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'WEAPON5': '0.400', 'weapon5': '0.580', 'weapon2': '0.680', 'WEAPON3': '0.700', 'HITCOUNT': '1.360', 'weapon3': '2.350', 'DAMAGECOUNT': '6.102', 'FRAGCOUNT': '19.000'} [2023-02-24 20:34:33,521][213384] DAMAGECOUNT value on done: 69467.0 [2023-02-24 20:34:33,521][213384] Sum rewards: 27.270, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.032', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.028', 'AMMO3': '0.133', 'AMMO4': '0.139', 'WEAPON4': '0.250', 'weapon5': '0.296', 'weapon4': '0.488', 'WEAPON5': '0.500', 'weapon2': '0.562', 'WEAPON3': '0.850', 'HITCOUNT': '1.750', 'weapon3': '2.348', 'DAMAGECOUNT': '8.430', 'FRAGCOUNT': '23.000'} [2023-02-24 20:34:33,611][213369] DAMAGECOUNT value on done: 67975.0 [2023-02-24 20:34:33,612][213369] Sum rewards: 20.351, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.669', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO5': '0.021', 'WEAPON4': '0.050', 'AMMO4': '0.103', 'AMMO3': '0.129', 'weapon4': '0.264', 'weapon5': '0.360', 'WEAPON5': '0.550', 'weapon2': '0.760', 'WEAPON3': '0.900', 'HITCOUNT': '1.510', 'weapon3': '2.212', 'DAMAGECOUNT': '6.366', 'FRAGCOUNT': '17.000'} [2023-02-24 20:34:33,679][213368] DAMAGECOUNT value on done: 68122.0 [2023-02-24 20:34:33,679][213368] Sum rewards: 16.277, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.240', 'ARMOR': '0.004', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.041', 'weapon7': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.129', 'WEAPON7': '0.200', 'AMMO4': '0.208', 'weapon4': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon5': '0.510', 'WEAPON3': '0.700', 'weapon2': '0.860', 'HITCOUNT': '1.190', 'weapon3': '1.794', 'DAMAGECOUNT': '5.130', 'FRAGCOUNT': '16.000'} [2023-02-24 20:34:33,832][213384] DAMAGECOUNT value on done: 65634.0 [2023-02-24 20:34:33,832][213384] Sum rewards: 28.287, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.997', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.031', 'AMMO4': '0.039', 'weapon4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.169', 'weapon2': '0.302', 'weapon5': '0.586', 'WEAPON5': '0.700', 'WEAPON3': '1.100', 'HITCOUNT': '1.720', 'weapon3': '2.580', 'DAMAGECOUNT': '8.367', 'FRAGCOUNT': '25.000'} [2023-02-24 20:34:33,906][213369] DAMAGECOUNT value on done: 58441.0 [2023-02-24 20:34:33,906][213369] Sum rewards: 18.320, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.900', 'AMMO5': '0.020', 'AMMO2': '0.027', 'AMMO3': '0.076', 'AMMO4': '0.132', 'WEAPON4': '0.250', 'weapon4': '0.268', 'WEAPON3': '0.450', 'WEAPON5': '0.500', 'weapon5': '0.654', 'weapon2': '0.770', 'HITCOUNT': '1.100', 'weapon3': '1.902', 'DAMAGECOUNT': '4.071', 'FRAGCOUNT': '15.000'} [2023-02-24 20:34:33,969][213365] Updated weights for policy 0, policy_version 26386 (0.0009) [2023-02-24 20:34:35,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13721.6, 300 sec: 13801.4). Total num frames: 108093440. Throughput: 0: 3419.8. Samples: 2012244. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:34:35,243][213332] Avg episode reward: [(0, '23.055')] [2023-02-24 20:34:36,907][213365] Updated weights for policy 0, policy_version 26396 (0.0009) [2023-02-24 20:34:39,821][213365] Updated weights for policy 0, policy_version 26406 (0.0009) [2023-02-24 20:34:40,243][213332] Fps is (10 sec: 13926.6, 60 sec: 13721.6, 300 sec: 13801.4). Total num frames: 108163072. Throughput: 0: 3428.5. Samples: 2033238. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:34:40,243][213332] Avg episode reward: [(0, '23.055')] [2023-02-24 20:34:42,765][213365] Updated weights for policy 0, policy_version 26416 (0.0009) [2023-02-24 20:34:45,243][213332] Fps is (10 sec: 13926.2, 60 sec: 13721.6, 300 sec: 13801.4). Total num frames: 108232704. Throughput: 0: 3451.4. Samples: 2054048. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:34:45,244][213332] Avg episode reward: [(0, '23.055')] [2023-02-24 20:34:45,248][213352] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000026424_108232704.pth... [2023-02-24 20:34:45,305][213352] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000025617_104927232.pth [2023-02-24 20:34:45,788][213365] Updated weights for policy 0, policy_version 26426 (0.0009) [2023-02-24 20:34:48,768][213365] Updated weights for policy 0, policy_version 26436 (0.0009) [2023-02-24 20:34:50,245][213332] Fps is (10 sec: 13104.1, 60 sec: 13584.5, 300 sec: 13773.6). Total num frames: 108294144. Throughput: 0: 3452.1. Samples: 2064328. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:34:50,246][213332] Avg episode reward: [(0, '23.055')] [2023-02-24 20:34:52,014][213367] DAMAGECOUNT value on done: 66893.0 [2023-02-24 20:34:52,015][213367] Sum rewards: 15.730, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.795', 'AMMO5': '0.015', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'AMMO3': '0.062', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'weapon5': '0.358', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.792', 'HITCOUNT': '0.970', 'weapon2': '1.044', 'weapon3': '1.496', 'DAMAGECOUNT': '4.857', 'FRAGCOUNT': '11.000'} [2023-02-24 20:34:52,165][213372] DAMAGECOUNT value on done: 65475.0 [2023-02-24 20:34:52,166][213372] Sum rewards: 20.347, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.036', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.137', 'WEAPON4': '0.250', 'weapon4': '0.330', 'weapon5': '0.372', 'WEAPON5': '0.450', 'weapon2': '0.818', 'WEAPON3': '0.900', 'HITCOUNT': '1.550', 'weapon3': '2.142', 'DAMAGECOUNT': '6.012', 'FRAGCOUNT': '19.000'} [2023-02-24 20:34:52,312][213383] DAMAGECOUNT value on done: 68219.0 [2023-02-24 20:34:52,313][213383] Sum rewards: 25.096, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.036', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.031', 'AMMO4': '0.157', 'AMMO3': '0.165', 'weapon4': '0.282', 'WEAPON4': '0.350', 'weapon2': '0.372', 'WEAPON5': '0.400', 'weapon5': '0.434', 'WEAPON3': '1.000', 'HITCOUNT': '1.710', 'weapon3': '2.564', 'DAMAGECOUNT': '7.134', 'FRAGCOUNT': '23.000'} [2023-02-24 20:34:52,331][213367] DAMAGECOUNT value on done: 67888.0 [2023-02-24 20:34:52,331][213367] Sum rewards: 20.293, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.532', 'AMMO2': '0.004', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'weapon4': '0.120', 'AMMO3': '0.180', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon5': '0.434', 'weapon2': '0.606', 'WEAPON3': '1.100', 'HITCOUNT': '1.320', 'weapon3': '2.482', 'DAMAGECOUNT': '6.225', 'FRAGCOUNT': '19.000'} [2023-02-24 20:34:52,457][213365] Updated weights for policy 0, policy_version 26446 (0.0009) [2023-02-24 20:34:52,488][213372] DAMAGECOUNT value on done: 67432.0 [2023-02-24 20:34:52,488][213372] Sum rewards: 27.849, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.204', 'ARMOR': '0.004', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.145', 'WEAPON4': '0.250', 'weapon4': '0.316', 'weapon2': '0.414', 'weapon5': '0.420', 'WEAPON5': '0.450', 'WEAPON3': '0.900', 'HITCOUNT': '1.610', 'weapon3': '2.318', 'DAMAGECOUNT': '8.313', 'FRAGCOUNT': '24.000'} [2023-02-24 20:34:52,650][213366] DAMAGECOUNT value on done: 69511.0 [2023-02-24 20:34:52,650][213366] Sum rewards: 19.286, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.660', 'AMMO5': '0.023', 'AMMO2': '0.047', 'AMMO3': '0.130', 'weapon2': '0.166', 'AMMO4': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.500', 'weapon5': '0.508', 'WEAPON3': '0.750', 'weapon4': '1.256', 'weapon3': '1.422', 'HITCOUNT': '1.440', 'DAMAGECOUNT': '6.216', 'FRAGCOUNT': '16.000'} [2023-02-24 20:34:52,683][213383] DAMAGECOUNT value on done: 71801.0 [2023-02-24 20:34:52,683][213383] Sum rewards: 24.641, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.253', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.076', 'AMMO4': '0.103', 'weapon2': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon5': '0.542', 'HITCOUNT': '1.320', 'weapon4': '1.370', 'weapon3': '1.514', 'DAMAGECOUNT': '6.531', 'FRAGCOUNT': '19.000'} [2023-02-24 20:34:52,691][213382] DAMAGECOUNT value on done: 66124.0 [2023-02-24 20:34:52,692][213382] Sum rewards: 19.671, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.840', 'WEAPON1': '0.010', 'AMMO5': '0.026', 'AMMO2': '0.052', 'AMMO3': '0.141', 'AMMO4': '0.260', 'weapon5': '0.380', 'WEAPON4': '0.400', 'weapon4': '0.506', 'WEAPON5': '0.550', 'weapon2': '0.568', 'WEAPON3': '0.900', 'HITCOUNT': '1.510', 'weapon3': '2.144', 'DAMAGECOUNT': '7.314', 'FRAGCOUNT': '18.000'} [2023-02-24 20:34:52,715][213367] DAMAGECOUNT value on done: 66115.0 [2023-02-24 20:34:52,715][213367] Sum rewards: 26.635, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.132', 'AMMO2': '0.015', 'AMMO5': '0.024', 'AMMO4': '0.074', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'weapon5': '0.422', 'weapon4': '0.510', 'weapon2': '0.586', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'HITCOUNT': '1.480', 'weapon3': '2.074', 'DAMAGECOUNT': '6.531', 'FRAGCOUNT': '22.000'} [2023-02-24 20:34:53,019][213372] DAMAGECOUNT value on done: 67800.0 [2023-02-24 20:34:53,020][213372] Sum rewards: 26.195, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.098', 'ARMOR': '0.004', 'AMMO2': '0.014', 'AMMO5': '0.020', 'AMMO4': '0.069', 'AMMO3': '0.138', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.458', 'WEAPON3': '0.850', 'weapon2': '0.900', 'HITCOUNT': '1.720', 'weapon3': '1.866', 'DAMAGECOUNT': '7.092', 'FRAGCOUNT': '24.000'} [2023-02-24 20:34:53,025][213366] DAMAGECOUNT value on done: 71247.0 [2023-02-24 20:34:53,025][213366] Sum rewards: 21.375, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.990', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'AMMO5': '0.035', 'AMMO2': '0.055', 'AMMO3': '0.187', 'AMMO4': '0.274', 'weapon2': '0.350', 'weapon5': '0.496', 'weapon4': '0.556', 'WEAPON4': '0.600', 'WEAPON5': '0.800', 'WEAPON3': '1.150', 'HITCOUNT': '1.770', 'weapon3': '2.164', 'DAMAGECOUNT': '7.650', 'FRAGCOUNT': '24.000'} [2023-02-24 20:34:53,032][213368] DAMAGECOUNT value on done: 63431.0 [2023-02-24 20:34:53,033][213368] Sum rewards: 17.289, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.966', 'AMMO2': '0.013', 'AMMO5': '0.022', 'AMMO4': '0.066', 'AMMO3': '0.090', 'weapon4': '0.152', 'WEAPON4': '0.200', 'weapon2': '0.378', 'weapon5': '0.552', 'WEAPON3': '0.600', 'WEAPON5': '0.650', 'HITCOUNT': '1.150', 'weapon3': '2.470', 'DAMAGECOUNT': '5.661', 'FRAGCOUNT': '13.000'} [2023-02-24 20:34:53,077][213382] DAMAGECOUNT value on done: 71589.0 [2023-02-24 20:34:53,078][213382] Sum rewards: 26.134, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.858', 'AMMO2': '0.012', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.061', 'AMMO3': '0.124', 'WEAPON4': '0.200', 'weapon5': '0.206', 'WEAPON5': '0.400', 'weapon4': '0.490', 'WEAPON3': '0.700', 'weapon2': '0.848', 'HITCOUNT': '1.820', 'weapon3': '1.886', 'DAMAGECOUNT': '7.455', 'FRAGCOUNT': '21.000'} [2023-02-24 20:34:53,099][213367] DAMAGECOUNT value on done: 65620.0 [2023-02-24 20:34:53,099][213367] Sum rewards: 27.413, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.396', 'AMMO5': '0.019', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.149', 'weapon2': '0.186', 'WEAPON4': '0.250', 'weapon5': '0.418', 'weapon4': '0.480', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'HITCOUNT': '1.860', 'weapon3': '2.426', 'DAMAGECOUNT': '8.085', 'FRAGCOUNT': '24.000'} [2023-02-24 20:34:53,306][213384] DAMAGECOUNT value on done: 67359.0 [2023-02-24 20:34:53,306][213384] Sum rewards: 17.645, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.463', 'AMMO5': '0.017', 'AMMO2': '0.031', 'AMMO3': '0.096', 'AMMO4': '0.157', 'weapon2': '0.242', 'WEAPON4': '0.250', 'weapon4': '0.402', 'weapon5': '0.476', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '1.180', 'weapon3': '2.368', 'DAMAGECOUNT': '5.238', 'FRAGCOUNT': '15.000'} [2023-02-24 20:34:53,310][213369] DAMAGECOUNT value on done: 66936.0 [2023-02-24 20:34:53,310][213369] Sum rewards: 24.982, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.290', 'AMMO5': '0.019', 'AMMO2': '0.029', 'AMMO3': '0.129', 'AMMO4': '0.144', 'WEAPON4': '0.250', 'weapon2': '0.394', 'weapon5': '0.398', 'WEAPON5': '0.450', 'weapon4': '0.774', 'WEAPON3': '0.850', 'HITCOUNT': '1.840', 'weapon3': '2.064', 'DAMAGECOUNT': '6.930', 'FRAGCOUNT': '21.000'} [2023-02-24 20:34:53,361][213383] DAMAGECOUNT value on done: 64779.0 [2023-02-24 20:34:53,362][213383] Sum rewards: 21.910, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.590', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.020', 'AMMO3': '0.090', 'AMMO4': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.122', 'weapon5': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'weapon2': '0.712', 'weapon4': '1.024', 'weapon3': '1.614', 'HITCOUNT': '1.690', 'DAMAGECOUNT': '6.387', 'FRAGCOUNT': '18.000'} [2023-02-24 20:34:53,369][213372] DAMAGECOUNT value on done: 67404.0 [2023-02-24 20:34:53,370][213372] Sum rewards: 29.505, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.692', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.039', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'weapon4': '0.188', 'WEAPON5': '0.500', 'weapon5': '0.558', 'weapon2': '0.654', 'WEAPON3': '0.800', 'HITCOUNT': '1.630', 'weapon3': '2.186', 'DAMAGECOUNT': '8.649', 'FRAGCOUNT': '24.000'} [2023-02-24 20:34:53,378][213368] DAMAGECOUNT value on done: 69966.0 [2023-02-24 20:34:53,379][213368] Sum rewards: 24.387, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.360', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon7': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.131', 'weapon5': '0.170', 'WEAPON5': '0.250', 'weapon2': '0.566', 'weapon4': '0.606', 'WEAPON3': '0.950', 'HITCOUNT': '1.700', 'weapon3': '2.398', 'DAMAGECOUNT': '7.374', 'FRAGCOUNT': '20.000'} [2023-02-24 20:34:53,430][213382] DAMAGECOUNT value on done: 67486.0 [2023-02-24 20:34:53,431][213382] Sum rewards: 23.325, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.862', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'weapon4': '0.290', 'WEAPON5': '0.400', 'weapon5': '0.434', 'WEAPON3': '0.700', 'weapon2': '0.830', 'weapon3': '1.770', 'HITCOUNT': '1.880', 'DAMAGECOUNT': '7.425', 'FRAGCOUNT': '18.000'} [2023-02-24 20:34:53,458][213366] DAMAGECOUNT value on done: 71240.0 [2023-02-24 20:34:53,458][213366] Sum rewards: 25.533, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.357', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.093', 'AMMO4': '0.097', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon5': '0.278', 'WEAPON3': '0.500', 'weapon4': '0.558', 'weapon2': '1.026', 'HITCOUNT': '1.700', 'weapon3': '1.776', 'DAMAGECOUNT': '6.915', 'FRAGCOUNT': '20.000'} [2023-02-24 20:34:53,660][213384] DAMAGECOUNT value on done: 62442.0 [2023-02-24 20:34:53,660][213384] Sum rewards: 22.669, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.600', 'ARMOR': '0.004', 'AMMO2': '0.012', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.061', 'AMMO3': '0.072', 'weapon5': '0.278', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.718', 'weapon2': '1.048', 'HITCOUNT': '1.370', 'weapon3': '1.462', 'DAMAGECOUNT': '5.907', 'FRAGCOUNT': '18.000'} [2023-02-24 20:34:53,664][213369] DAMAGECOUNT value on done: 72699.0 [2023-02-24 20:34:53,665][213369] Sum rewards: 22.159, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.941', 'ARMOR': '0.004', 'AMMO2': '0.023', 'AMMO5': '0.033', 'WEAPON4': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.131', 'weapon2': '0.238', 'weapon5': '0.418', 'weapon4': '0.534', 'WEAPON5': '0.700', 'WEAPON3': '0.850', 'HITCOUNT': '1.210', 'weapon3': '2.296', 'DAMAGECOUNT': '5.697', 'FRAGCOUNT': '19.000'} [2023-02-24 20:34:53,696][213383] DAMAGECOUNT value on done: 63816.0 [2023-02-24 20:34:53,697][213383] Sum rewards: 26.884, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.740', 'AMMO2': '0.002', 'AMMO4': '0.012', 'AMMO5': '0.017', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.144', 'weapon4': '0.314', 'weapon5': '0.362', 'WEAPON5': '0.550', 'weapon2': '0.948', 'WEAPON3': '0.950', 'HITCOUNT': '1.790', 'weapon3': '2.082', 'DAMAGECOUNT': '8.112', 'FRAGCOUNT': '23.000'} [2023-02-24 20:34:53,711][213368] DAMAGECOUNT value on done: 68934.0 [2023-02-24 20:34:53,712][213368] Sum rewards: 26.464, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.897', 'ARMOR': '0.008', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO4': '0.068', 'AMMO3': '0.125', 'weapon4': '0.162', 'WEAPON4': '0.200', 'weapon5': '0.494', 'WEAPON5': '0.600', 'WEAPON3': '0.850', 'weapon2': '0.916', 'HITCOUNT': '1.540', 'weapon3': '1.974', 'DAMAGECOUNT': '7.368', 'FRAGCOUNT': '23.000'} [2023-02-24 20:34:53,774][213382] DAMAGECOUNT value on done: 68037.0 [2023-02-24 20:34:53,775][213382] Sum rewards: 26.794, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.600', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO5': '0.026', 'WEAPON4': '0.050', 'AMMO4': '0.068', 'weapon4': '0.084', 'AMMO3': '0.208', 'weapon2': '0.316', 'weapon5': '0.594', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'HITCOUNT': '1.920', 'weapon3': '2.632', 'DAMAGECOUNT': '8.712', 'FRAGCOUNT': '25.500'} [2023-02-24 20:34:53,787][213366] DAMAGECOUNT value on done: 65315.0 [2023-02-24 20:34:53,787][213366] Sum rewards: 17.117, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.826', 'WEAPON1': '0.010', 'AMMO5': '0.026', 'AMMO2': '0.054', 'AMMO3': '0.071', 'AMMO4': '0.269', 'weapon4': '0.396', 'WEAPON4': '0.450', 'WEAPON3': '0.450', 'weapon2': '0.686', 'weapon5': '0.790', 'WEAPON5': '0.800', 'HITCOUNT': '1.230', 'weapon3': '1.460', 'DAMAGECOUNT': '6.501', 'FRAGCOUNT': '14.000'} [2023-02-24 20:34:53,969][213384] DAMAGECOUNT value on done: 72541.0 [2023-02-24 20:34:53,970][213384] Sum rewards: 34.478, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.125', 'AMMO2': '0.003', 'AMMO5': '0.008', 'AMMO4': '0.014', 'WEAPON1': '0.030', 'AMMO3': '0.123', 'WEAPON5': '0.250', 'weapon5': '0.328', 'WEAPON3': '0.800', 'weapon2': '0.986', 'HITCOUNT': '1.970', 'weapon3': '2.404', 'DAMAGECOUNT': '8.937', 'FRAGCOUNT': '28.000'} [2023-02-24 20:34:54,002][213369] DAMAGECOUNT value on done: 69171.0 [2023-02-24 20:34:54,002][213369] Sum rewards: 15.573, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.441', 'AMMO5': '0.021', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'AMMO3': '0.088', 'AMMO4': '0.110', 'WEAPON4': '0.200', 'weapon4': '0.358', 'weapon5': '0.444', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'HITCOUNT': '0.890', 'weapon2': '1.222', 'weapon3': '1.640', 'DAMAGECOUNT': '3.588', 'FRAGCOUNT': '14.000'} [2023-02-24 20:34:54,041][213368] DAMAGECOUNT value on done: 70335.0 [2023-02-24 20:34:54,042][213368] Sum rewards: 25.317, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.277', 'ARMOR': '0.004', 'AMMO5': '0.035', 'AMMO2': '0.036', 'WEAPON1': '0.040', 'AMMO3': '0.103', 'AMMO4': '0.182', 'weapon4': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.454', 'weapon5': '0.532', 'WEAPON3': '0.700', 'WEAPON5': '0.750', 'HITCOUNT': '1.570', 'weapon3': '2.338', 'DAMAGECOUNT': '6.639', 'FRAGCOUNT': '21.000'} [2023-02-24 20:34:54,306][213384] DAMAGECOUNT value on done: 69028.0 [2023-02-24 20:34:54,306][213384] Sum rewards: 36.240, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.078', 'AMMO2': '0.007', 'AMMO5': '0.012', 'AMMO4': '0.036', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'weapon5': '0.254', 'weapon2': '0.336', 'WEAPON5': '0.350', 'weapon4': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.250', 'weapon3': '2.726', 'DAMAGECOUNT': '10.182', 'FRAGCOUNT': '35.000'} [2023-02-24 20:34:54,351][213369] DAMAGECOUNT value on done: 60457.0 [2023-02-24 20:34:54,351][213369] Sum rewards: 22.050, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.020', 'WEAPON4': '0.050', 'WEAPON1': '0.060', 'HEALTH': '0.073', 'weapon4': '0.078', 'AMMO3': '0.115', 'weapon5': '0.326', 'WEAPON5': '0.500', 'weapon2': '0.548', 'WEAPON3': '0.750', 'HITCOUNT': '1.560', 'weapon3': '2.664', 'DAMAGECOUNT': '6.048', 'FRAGCOUNT': '17.500'} [2023-02-24 20:34:55,243][213332] Fps is (10 sec: 12288.2, 60 sec: 13516.8, 300 sec: 13745.9). Total num frames: 108355584. Throughput: 0: 3380.9. Samples: 2081712. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:34:55,243][213332] Avg episode reward: [(0, '23.340')] [2023-02-24 20:34:55,875][213365] Updated weights for policy 0, policy_version 26456 (0.0010) [2023-02-24 20:34:59,161][213365] Updated weights for policy 0, policy_version 26466 (0.0009) [2023-02-24 20:35:00,243][213332] Fps is (10 sec: 12290.8, 60 sec: 13448.5, 300 sec: 13718.1). Total num frames: 108417024. Throughput: 0: 3338.2. Samples: 2100356. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:35:00,243][213332] Avg episode reward: [(0, '23.340')] [2023-02-24 20:35:02,557][213365] Updated weights for policy 0, policy_version 26476 (0.0010) [2023-02-24 20:35:04,582][213369] Large shaping reward -2.534 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 20:35:05,243][213332] Fps is (10 sec: 12288.0, 60 sec: 13312.0, 300 sec: 13690.4). Total num frames: 108478464. Throughput: 0: 3308.0. Samples: 2109416. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:35:05,243][213332] Avg episode reward: [(0, '23.340')] [2023-02-24 20:35:05,788][213365] Updated weights for policy 0, policy_version 26486 (0.0009) [2023-02-24 20:35:09,087][213365] Updated weights for policy 0, policy_version 26496 (0.0010) [2023-02-24 20:35:10,243][213332] Fps is (10 sec: 12288.1, 60 sec: 13175.5, 300 sec: 13662.6). Total num frames: 108539904. Throughput: 0: 3259.7. Samples: 2128126. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:35:10,243][213332] Avg episode reward: [(0, '23.340')] [2023-02-24 20:35:12,091][213365] Updated weights for policy 0, policy_version 26506 (0.0009) [2023-02-24 20:35:12,788][213369] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 20:35:13,270][213367] DAMAGECOUNT value on done: 69203.0 [2023-02-24 20:35:13,271][213367] Sum rewards: 26.715, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.015', 'AMMO2': '0.022', 'WEAPON1': '0.030', 'HEALTH': '0.048', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'AMMO4': '0.109', 'weapon5': '0.354', 'WEAPON5': '0.400', 'weapon2': '0.414', 'WEAPON3': '0.600', 'weapon4': '0.652', 'HITCOUNT': '1.560', 'weapon3': '1.888', 'DAMAGECOUNT': '6.930', 'FRAGCOUNT': '21.000'} [2023-02-24 20:35:13,441][213372] DAMAGECOUNT value on done: 68155.0 [2023-02-24 20:35:13,441][213372] Sum rewards: 23.687, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.596', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'weapon5': '0.202', 'weapon4': '0.270', 'WEAPON5': '0.400', 'weapon2': '0.784', 'WEAPON3': '1.100', 'HITCOUNT': '1.850', 'weapon3': '2.392', 'DAMAGECOUNT': '8.040', 'FRAGCOUNT': '22.000'} [2023-02-24 20:35:13,583][213367] DAMAGECOUNT value on done: 70823.0 [2023-02-24 20:35:13,583][213367] Sum rewards: 24.707, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.946', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'AMMO5': '0.026', 'AMMO4': '0.119', 'AMMO3': '0.135', 'WEAPON4': '0.250', 'weapon4': '0.384', 'weapon5': '0.528', 'weapon2': '0.662', 'WEAPON5': '0.750', 'WEAPON3': '0.900', 'HITCOUNT': '1.500', 'weapon3': '2.060', 'DAMAGECOUNT': '8.805', 'FRAGCOUNT': '21.000'} [2023-02-24 20:35:13,660][213383] DAMAGECOUNT value on done: 71220.0 [2023-02-24 20:35:13,661][213383] Sum rewards: 33.537, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.605', 'AMMO5': '0.020', 'AMMO2': '0.020', 'AMMO4': '0.102', 'AMMO3': '0.108', 'weapon2': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.600', 'weapon5': '0.648', 'weapon4': '0.736', 'WEAPON3': '0.750', 'HITCOUNT': '1.780', 'weapon3': '1.934', 'DAMAGECOUNT': '8.988', 'FRAGCOUNT': '28.000'} [2023-02-24 20:35:13,769][213372] DAMAGECOUNT value on done: 70225.0 [2023-02-24 20:35:13,769][213372] Sum rewards: 29.424, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.420', 'WEAPON1': '0.010', 'AMMO5': '0.023', 'AMMO2': '0.056', 'AMMO3': '0.110', 'AMMO4': '0.280', 'weapon5': '0.334', 'ARMOR': '0.400', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon2': '0.674', 'WEAPON3': '0.700', 'weapon4': '0.828', 'weapon3': '1.570', 'HITCOUNT': '1.680', 'DAMAGECOUNT': '8.379', 'FRAGCOUNT': '26.000'} [2023-02-24 20:35:13,908][213367] DAMAGECOUNT value on done: 68474.0 [2023-02-24 20:35:13,908][213367] Sum rewards: 24.368, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.450', 'ARMOR': '0.004', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.060', 'AMMO4': '0.108', 'weapon4': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.450', 'weapon5': '0.494', 'WEAPON3': '0.500', 'weapon2': '1.104', 'HITCOUNT': '1.430', 'weapon3': '1.898', 'DAMAGECOUNT': '7.077', 'FRAGCOUNT': '18.000'} [2023-02-24 20:35:13,933][213382] DAMAGECOUNT value on done: 68743.0 [2023-02-24 20:35:13,934][213382] Sum rewards: 27.666, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.658', 'ARMOR': '0.004', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO5': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.186', 'weapon5': '0.356', 'WEAPON5': '0.500', 'weapon2': '0.558', 'WEAPON3': '1.200', 'HITCOUNT': '1.970', 'weapon3': '2.728', 'DAMAGECOUNT': '7.857', 'FRAGCOUNT': '26.000'} [2023-02-24 20:35:13,943][213366] DAMAGECOUNT value on done: 72126.0 [2023-02-24 20:35:13,943][213366] Sum rewards: 22.490, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.452', 'ARMOR': '0.004', 'AMMO5': '0.029', 'AMMO2': '0.036', 'AMMO3': '0.156', 'AMMO4': '0.181', 'WEAPON4': '0.350', 'weapon2': '0.350', 'weapon5': '0.426', 'weapon4': '0.492', 'WEAPON5': '0.650', 'WEAPON3': '0.900', 'HITCOUNT': '1.930', 'weapon3': '2.342', 'DAMAGECOUNT': '7.845', 'FRAGCOUNT': '21.000'} [2023-02-24 20:35:13,965][213383] DAMAGECOUNT value on done: 74057.0 [2023-02-24 20:35:13,965][213383] Sum rewards: 21.964, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.616', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'AMMO5': '0.027', 'AMMO4': '0.119', 'AMMO3': '0.120', 'weapon2': '0.326', 'WEAPON4': '0.350', 'weapon5': '0.552', 'WEAPON5': '0.650', 'weapon4': '0.650', 'WEAPON3': '0.700', 'HITCOUNT': '1.410', 'weapon3': '1.874', 'DAMAGECOUNT': '6.768', 'FRAGCOUNT': '19.000'} [2023-02-24 20:35:14,192][213372] DAMAGECOUNT value on done: 70904.0 [2023-02-24 20:35:14,193][213372] Sum rewards: 31.677, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.560', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.126', 'WEAPON4': '0.250', 'weapon5': '0.302', 'weapon4': '0.354', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'weapon2': '0.894', 'HITCOUNT': '1.880', 'weapon3': '1.990', 'DAMAGECOUNT': '9.312', 'FRAGCOUNT': '25.000'} [2023-02-24 20:35:14,214][213367] DAMAGECOUNT value on done: 67862.0 [2023-02-24 20:35:14,214][213367] Sum rewards: 20.723, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.026', 'AMMO2': '0.030', 'WEAPON1': '0.030', 'HEALTH': '0.096', 'AMMO3': '0.113', 'AMMO4': '0.148', 'WEAPON4': '0.350', 'weapon5': '0.492', 'weapon2': '0.518', 'WEAPON5': '0.650', 'WEAPON3': '0.650', 'weapon4': '0.830', 'HITCOUNT': '1.560', 'weapon3': '1.754', 'DAMAGECOUNT': '6.726', 'FRAGCOUNT': '18.000'} [2023-02-24 20:35:14,221][213368] DAMAGECOUNT value on done: 65239.0 [2023-02-24 20:35:14,222][213368] Sum rewards: 21.692, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.346', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.118', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'weapon5': '0.256', 'WEAPON5': '0.350', 'weapon4': '0.488', 'WEAPON3': '0.700', 'weapon2': '0.924', 'HITCOUNT': '1.380', 'weapon3': '2.020', 'DAMAGECOUNT': '5.424', 'FRAGCOUNT': '19.000'} [2023-02-24 20:35:14,225][213382] DAMAGECOUNT value on done: 73731.0 [2023-02-24 20:35:14,226][213382] Sum rewards: 25.206, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.746', 'ARMOR': '0.008', 'AMMO2': '0.019', 'AMMO5': '0.025', 'WEAPON1': '0.030', 'AMMO4': '0.095', 'AMMO3': '0.119', 'WEAPON4': '0.200', 'weapon4': '0.220', 'weapon2': '0.436', 'weapon5': '0.488', 'WEAPON5': '0.650', 'WEAPON3': '0.700', 'HITCOUNT': '1.390', 'weapon3': '2.396', 'DAMAGECOUNT': '6.426', 'FRAGCOUNT': '21.000'} [2023-02-24 20:35:14,237][213366] DAMAGECOUNT value on done: 73947.0 [2023-02-24 20:35:14,237][213366] Sum rewards: 24.398, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.000', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.170', 'weapon5': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.292', 'WEAPON5': '0.400', 'weapon2': '0.966', 'WEAPON3': '1.050', 'HITCOUNT': '1.880', 'weapon3': '2.186', 'DAMAGECOUNT': '8.100', 'FRAGCOUNT': '22.000'} [2023-02-24 20:35:14,402][213369] DAMAGECOUNT value on done: 69056.0 [2023-02-24 20:35:14,403][213369] Sum rewards: 20.254, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.328', 'AMMO2': '0.027', 'AMMO5': '0.027', 'AMMO3': '0.124', 'AMMO4': '0.137', 'weapon2': '0.242', 'WEAPON4': '0.350', 'weapon4': '0.446', 'weapon5': '0.572', 'WEAPON5': '0.750', 'WEAPON3': '0.800', 'HITCOUNT': '1.400', 'weapon3': '2.096', 'DAMAGECOUNT': '6.360', 'FRAGCOUNT': '19.000'} [2023-02-24 20:35:14,493][213372] DAMAGECOUNT value on done: 69501.0 [2023-02-24 20:35:14,493][213372] Sum rewards: 22.033, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.050', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.100', 'AMMO4': '0.129', 'weapon4': '0.256', 'WEAPON5': '0.400', 'weapon5': '0.512', 'weapon2': '0.518', 'WEAPON3': '0.600', 'HITCOUNT': '1.360', 'weapon3': '2.306', 'DAMAGECOUNT': '6.291', 'FRAGCOUNT': '17.000'} [2023-02-24 20:35:14,494][213384] DAMAGECOUNT value on done: 69952.0 [2023-02-24 20:35:14,495][213384] Sum rewards: 24.563, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.250', 'AMMO5': '0.030', 'AMMO2': '0.034', 'AMMO3': '0.139', 'AMMO4': '0.169', 'weapon2': '0.350', 'WEAPON4': '0.400', 'weapon5': '0.474', 'weapon4': '0.524', 'WEAPON5': '0.800', 'WEAPON3': '0.850', 'HITCOUNT': '1.760', 'weapon3': '2.254', 'DAMAGECOUNT': '7.779', 'FRAGCOUNT': '22.500'} [2023-02-24 20:35:14,527][213368] DAMAGECOUNT value on done: 72081.0 [2023-02-24 20:35:14,528][213368] Sum rewards: 21.051, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.362', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.038', 'AMMO3': '0.092', 'AMMO4': '0.188', 'weapon5': '0.228', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '0.500', 'weapon4': '0.996', 'weapon2': '1.062', 'weapon3': '1.286', 'HITCOUNT': '1.750', 'DAMAGECOUNT': '6.345', 'FRAGCOUNT': '18.000'} [2023-02-24 20:35:14,533][213383] DAMAGECOUNT value on done: 67442.0 [2023-02-24 20:35:14,534][213383] Sum rewards: 24.810, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.660', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.037', 'AMMO3': '0.183', 'AMMO4': '0.187', 'weapon5': '0.278', 'WEAPON4': '0.400', 'weapon2': '0.450', 'WEAPON5': '0.550', 'weapon4': '0.840', 'WEAPON3': '1.000', 'weapon3': '1.840', 'HITCOUNT': '1.930', 'DAMAGECOUNT': '7.989', 'FRAGCOUNT': '24.000'} [2023-02-24 20:35:14,540][213382] DAMAGECOUNT value on done: 68988.0 [2023-02-24 20:35:14,541][213382] Sum rewards: 18.685, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.185', 'AMMO2': '0.016', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.079', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'weapon4': '0.352', 'weapon5': '0.360', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'weapon2': '0.954', 'HITCOUNT': '0.990', 'weapon3': '1.980', 'DAMAGECOUNT': '4.506', 'FRAGCOUNT': '13.000'} [2023-02-24 20:35:14,596][213366] DAMAGECOUNT value on done: 73151.0 [2023-02-24 20:35:14,596][213366] Sum rewards: 25.396, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.134', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.062', 'weapon4': '0.086', 'AMMO3': '0.125', 'weapon5': '0.426', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'HITCOUNT': '1.150', 'weapon2': '1.216', 'weapon3': '1.928', 'DAMAGECOUNT': '5.733', 'FRAGCOUNT': '21.000'} [2023-02-24 20:35:14,706][213369] DAMAGECOUNT value on done: 75646.0 [2023-02-24 20:35:14,706][213369] Sum rewards: 29.676, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.286', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.032', 'AMMO3': '0.101', 'AMMO4': '0.162', 'WEAPON4': '0.200', 'weapon5': '0.316', 'WEAPON5': '0.450', 'weapon4': '0.560', 'WEAPON3': '0.700', 'weapon2': '0.726', 'HITCOUNT': '1.860', 'weapon3': '2.032', 'DAMAGECOUNT': '8.802', 'FRAGCOUNT': '23.000'} [2023-02-24 20:35:14,797][213384] DAMAGECOUNT value on done: 64023.0 [2023-02-24 20:35:14,797][213384] Sum rewards: 14.374, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.989', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.013', 'WEAPON1': '0.030', 'AMMO3': '0.082', 'WEAPON4': '0.200', 'weapon5': '0.314', 'WEAPON5': '0.400', 'weapon4': '0.502', 'WEAPON3': '0.600', 'weapon2': '0.758', 'HITCOUNT': '1.270', 'weapon3': '1.936', 'DAMAGECOUNT': '4.743', 'FRAGCOUNT': '12.000'} [2023-02-24 20:35:14,818][213368] DAMAGECOUNT value on done: 72160.0 [2023-02-24 20:35:14,818][213368] Sum rewards: 32.935, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.645', 'ARMOR': '0.004', 'AMMO2': '0.018', 'AMMO5': '0.022', 'AMMO4': '0.090', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'weapon5': '0.316', 'weapon2': '0.380', 'weapon4': '0.408', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'HITCOUNT': '2.140', 'weapon3': '2.594', 'DAMAGECOUNT': '9.678', 'FRAGCOUNT': '28.000'} [2023-02-24 20:35:14,838][213383] DAMAGECOUNT value on done: 65077.0 [2023-02-24 20:35:14,839][213383] Sum rewards: 16.690, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.656', 'AMMO2': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.058', 'AMMO3': '0.090', 'WEAPON5': '0.500', 'weapon5': '0.566', 'WEAPON3': '0.650', 'weapon2': '0.840', 'HITCOUNT': '0.890', 'weapon3': '2.162', 'DAMAGECOUNT': '3.783', 'FRAGCOUNT': '13.000'} [2023-02-24 20:35:14,839][213382] DAMAGECOUNT value on done: 70332.0 [2023-02-24 20:35:14,840][213382] Sum rewards: 21.898, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.318', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.040', 'AMMO3': '0.116', 'weapon5': '0.146', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'weapon2': '0.624', 'WEAPON3': '0.700', 'WEAPON4': '0.700', 'weapon4': '1.358', 'weapon3': '1.370', 'HITCOUNT': '1.860', 'DAMAGECOUNT': '6.885', 'FRAGCOUNT': '21.000'} [2023-02-24 20:35:14,896][213366] DAMAGECOUNT value on done: 67804.0 [2023-02-24 20:35:14,896][213366] Sum rewards: 28.302, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.436', 'AMMO2': '0.019', 'AMMO5': '0.025', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'weapon4': '0.418', 'weapon5': '0.420', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'weapon2': '0.710', 'HITCOUNT': '1.630', 'weapon3': '1.986', 'DAMAGECOUNT': '7.467', 'FRAGCOUNT': '22.000'} [2023-02-24 20:35:15,044][213384] DAMAGECOUNT value on done: 74322.0 [2023-02-24 20:35:15,044][213384] Sum rewards: 13.876, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.930', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.116', 'AMMO4': '0.131', 'WEAPON4': '0.250', 'weapon5': '0.402', 'weapon4': '0.428', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'weapon2': '0.938', 'HITCOUNT': '1.340', 'weapon3': '1.844', 'DAMAGECOUNT': '5.343', 'FRAGCOUNT': '12.000'} [2023-02-24 20:35:15,063][213369] DAMAGECOUNT value on done: 71095.0 [2023-02-24 20:35:15,064][213369] Sum rewards: 19.227, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.755', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.023', 'AMMO3': '0.112', 'AMMO4': '0.114', 'weapon4': '0.284', 'WEAPON4': '0.350', 'weapon5': '0.392', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'weapon2': '0.960', 'HITCOUNT': '1.330', 'weapon3': '2.070', 'DAMAGECOUNT': '5.772', 'FRAGCOUNT': '19.000'} [2023-02-24 20:35:15,109][213365] Updated weights for policy 0, policy_version 26516 (0.0009) [2023-02-24 20:35:15,116][213368] DAMAGECOUNT value on done: 72221.0 [2023-02-24 20:35:15,116][213368] Sum rewards: 20.887, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.710', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.031', 'AMMO3': '0.072', 'weapon7': '0.140', 'AMMO4': '0.154', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON4': '0.350', 'weapon2': '0.398', 'WEAPON7': '0.400', 'WEAPON3': '0.450', 'WEAPON5': '0.550', 'weapon5': '0.588', 'weapon4': '0.692', 'HITCOUNT': '1.200', 'weapon3': '1.750', 'DAMAGECOUNT': '5.658', 'FRAGCOUNT': '16.000'} [2023-02-24 20:35:15,243][213332] Fps is (10 sec: 13107.2, 60 sec: 13175.5, 300 sec: 13676.5). Total num frames: 108609536. Throughput: 0: 3255.6. Samples: 2148440. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:35:15,243][213332] Avg episode reward: [(0, '23.472')] [2023-02-24 20:35:15,347][213384] DAMAGECOUNT value on done: 71554.0 [2023-02-24 20:35:15,347][213384] Sum rewards: 29.139, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.590', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon5': '0.334', 'weapon4': '0.432', 'weapon2': '0.676', 'WEAPON3': '0.800', 'HITCOUNT': '1.720', 'weapon3': '2.188', 'DAMAGECOUNT': '7.578', 'FRAGCOUNT': '25.000'} [2023-02-24 20:35:15,356][213369] DAMAGECOUNT value on done: 62638.0 [2023-02-24 20:35:15,356][213369] Sum rewards: 23.496, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.112', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.021', 'WEAPON1': '0.030', 'AMMO3': '0.120', 'weapon2': '0.242', 'WEAPON5': '0.500', 'weapon5': '0.692', 'WEAPON3': '0.700', 'HITCOUNT': '1.330', 'weapon3': '2.670', 'DAMAGECOUNT': '6.543', 'FRAGCOUNT': '17.500'} [2023-02-24 20:35:18,061][213365] Updated weights for policy 0, policy_version 26526 (0.0009) [2023-02-24 20:35:20,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13175.5, 300 sec: 13662.6). Total num frames: 108679168. Throughput: 0: 3258.7. Samples: 2158886. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:35:20,243][213332] Avg episode reward: [(0, '23.534')] [2023-02-24 20:35:20,975][213365] Updated weights for policy 0, policy_version 26536 (0.0009) [2023-02-24 20:35:23,937][213365] Updated weights for policy 0, policy_version 26546 (0.0009) [2023-02-24 20:35:25,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13175.5, 300 sec: 13676.5). Total num frames: 108748800. Throughput: 0: 3256.1. Samples: 2179764. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:35:25,243][213332] Avg episode reward: [(0, '23.534')] [2023-02-24 20:35:26,868][213365] Updated weights for policy 0, policy_version 26556 (0.0009) [2023-02-24 20:35:29,783][213365] Updated weights for policy 0, policy_version 26566 (0.0009) [2023-02-24 20:35:30,083][213366] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-24 20:35:30,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13243.7, 300 sec: 13662.6). Total num frames: 108818432. Throughput: 0: 3257.3. Samples: 2200624. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:35:30,243][213332] Avg episode reward: [(0, '23.534')] [2023-02-24 20:35:32,710][213367] DAMAGECOUNT value on done: 71266.0 [2023-02-24 20:35:32,711][213367] Sum rewards: 23.016, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.328', 'AMMO2': '0.008', 'AMMO5': '0.018', 'AMMO4': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'weapon4': '0.178', 'WEAPON5': '0.400', 'weapon5': '0.474', 'weapon2': '0.564', 'WEAPON3': '0.700', 'HITCOUNT': '1.220', 'weapon3': '2.580', 'DAMAGECOUNT': '6.189', 'FRAGCOUNT': '19.000'} [2023-02-24 20:35:32,738][213372] DAMAGECOUNT value on done: 70897.0 [2023-02-24 20:35:32,738][213372] Sum rewards: 28.808, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.282', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO5': '0.034', 'AMMO2': '0.035', 'weapon7': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.134', 'weapon5': '0.164', 'AMMO4': '0.175', 'weapon2': '0.268', 'WEAPON4': '0.350', 'weapon4': '0.488', 'WEAPON5': '0.700', 'WEAPON3': '0.900', 'HITCOUNT': '1.930', 'weapon3': '2.518', 'DAMAGECOUNT': '8.226', 'FRAGCOUNT': '25.000'} [2023-02-24 20:35:32,753][213365] Updated weights for policy 0, policy_version 26576 (0.0009) [2023-02-24 20:35:33,008][213367] DAMAGECOUNT value on done: 73732.0 [2023-02-24 20:35:33,009][213367] Sum rewards: 27.076, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.420', 'AMMO5': '0.015', 'AMMO2': '0.047', 'AMMO3': '0.108', 'AMMO4': '0.234', 'weapon5': '0.376', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon2': '0.690', 'WEAPON4': '0.700', 'weapon4': '1.260', 'weapon3': '1.308', 'HITCOUNT': '1.830', 'DAMAGECOUNT': '8.727', 'FRAGCOUNT': '23.000'} [2023-02-24 20:35:33,038][213372] DAMAGECOUNT value on done: 72492.0 [2023-02-24 20:35:33,038][213372] Sum rewards: 20.240, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.346', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'AMMO5': '0.022', 'AMMO4': '0.109', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'weapon4': '0.204', 'weapon2': '0.482', 'WEAPON5': '0.500', 'weapon5': '0.546', 'WEAPON3': '0.750', 'HITCOUNT': '1.510', 'weapon3': '2.358', 'DAMAGECOUNT': '6.801', 'FRAGCOUNT': '16.000'} [2023-02-24 20:35:33,039][213383] DAMAGECOUNT value on done: 73152.0 [2023-02-24 20:35:33,040][213383] Sum rewards: 14.960, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.525', 'AMMO2': '0.004', 'AMMO4': '0.018', 'AMMO5': '0.018', 'WEAPON1': '0.030', 'AMMO3': '0.199', 'weapon5': '0.306', 'weapon2': '0.348', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '1.550', 'weapon3': '2.916', 'DAMAGECOUNT': '5.796', 'FRAGCOUNT': '15.000'} [2023-02-24 20:35:33,178][213369] Large shaping reward 2.529 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0)] [2023-02-24 20:35:33,225][213366] DAMAGECOUNT value on done: 73886.0 [2023-02-24 20:35:33,225][213366] Sum rewards: 19.837, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.436', 'AMMO2': '0.006', 'AMMO5': '0.017', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'AMMO3': '0.075', 'weapon4': '0.100', 'weapon5': '0.462', 'WEAPON3': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.932', 'HITCOUNT': '1.110', 'weapon3': '1.856', 'DAMAGECOUNT': '5.133', 'FRAGCOUNT': '14.000'} [2023-02-24 20:35:33,326][213367] DAMAGECOUNT value on done: 70248.0 [2023-02-24 20:35:33,326][213367] Sum rewards: 19.834, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.995', 'AMMO5': '0.019', 'AMMO2': '0.025', 'AMMO3': '0.066', 'AMMO4': '0.123', 'WEAPON4': '0.300', 'weapon5': '0.446', 'WEAPON3': '0.450', 'weapon4': '0.460', 'WEAPON5': '0.500', 'HITCOUNT': '1.090', 'weapon2': '1.248', 'weapon3': '1.530', 'DAMAGECOUNT': '5.322', 'FRAGCOUNT': '16.000'} [2023-02-24 20:35:33,330][213382] DAMAGECOUNT value on done: 71433.0 [2023-02-24 20:35:33,331][213382] Sum rewards: 25.668, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.300', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.043', 'AMMO3': '0.126', 'AMMO4': '0.215', 'weapon2': '0.422', 'weapon5': '0.434', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '0.800', 'weapon4': '0.952', 'weapon3': '1.700', 'HITCOUNT': '2.000', 'DAMAGECOUNT': '7.650', 'FRAGCOUNT': '25.000'} [2023-02-24 20:35:33,342][213383] DAMAGECOUNT value on done: 76767.0 [2023-02-24 20:35:33,343][213383] Sum rewards: 26.782, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.348', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.037', 'AMMO3': '0.126', 'AMMO4': '0.185', 'weapon5': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon4': '0.572', 'WEAPON3': '0.850', 'weapon2': '0.920', 'weapon3': '1.876', 'HITCOUNT': '2.010', 'DAMAGECOUNT': '8.130', 'FRAGCOUNT': '23.000'} [2023-02-24 20:35:33,490][213372] DAMAGECOUNT value on done: 72946.0 [2023-02-24 20:35:33,490][213372] Sum rewards: 20.035, reward structure: {'DEATHCOUNT': '-9.750', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'AMMO3': '0.126', 'weapon4': '0.180', 'WEAPON5': '0.250', 'HEALTH': '0.254', 'weapon5': '0.510', 'WEAPON3': '0.700', 'weapon2': '0.892', 'HITCOUNT': '1.440', 'weapon3': '2.084', 'DAMAGECOUNT': '6.126', 'FRAGCOUNT': '17.000'} [2023-02-24 20:35:33,525][213366] DAMAGECOUNT value on done: 75780.0 [2023-02-24 20:35:33,526][213366] Sum rewards: 22.498, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.610', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO3': '0.071', 'AMMO4': '0.119', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon5': '0.556', 'weapon2': '1.040', 'HITCOUNT': '1.360', 'weapon3': '2.226', 'DAMAGECOUNT': '5.499', 'FRAGCOUNT': '15.000'} [2023-02-24 20:35:33,616][213382] DAMAGECOUNT value on done: 75996.0 [2023-02-24 20:35:33,617][213382] Sum rewards: 22.080, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.969', 'AMMO2': '0.017', 'AMMO5': '0.026', 'AMMO4': '0.084', 'AMMO3': '0.161', 'weapon4': '0.178', 'WEAPON4': '0.200', 'weapon5': '0.426', 'weapon2': '0.494', 'WEAPON5': '0.650', 'WEAPON3': '1.100', 'HITCOUNT': '1.460', 'weapon3': '2.458', 'DAMAGECOUNT': '6.795', 'FRAGCOUNT': '22.000'} [2023-02-24 20:35:33,620][213367] DAMAGECOUNT value on done: 70377.0 [2023-02-24 20:35:33,621][213367] Sum rewards: 26.350, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.882', 'AMMO2': '0.008', 'AMMO5': '0.018', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'AMMO3': '0.167', 'weapon4': '0.234', 'weapon2': '0.286', 'WEAPON5': '0.450', 'weapon5': '0.486', 'WEAPON3': '1.000', 'HITCOUNT': '1.820', 'weapon3': '2.630', 'DAMAGECOUNT': '7.545', 'FRAGCOUNT': '23.000'} [2023-02-24 20:35:33,667][213368] DAMAGECOUNT value on done: 67830.0 [2023-02-24 20:35:33,667][213368] Sum rewards: 22.632, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.012', 'ARMOR': '0.004', 'AMMO5': '0.030', 'AMMO2': '0.050', 'AMMO3': '0.188', 'AMMO4': '0.252', 'weapon5': '0.426', 'weapon4': '0.472', 'WEAPON4': '0.550', 'weapon2': '0.552', 'WEAPON5': '0.750', 'WEAPON3': '1.100', 'HITCOUNT': '1.610', 'weapon3': '2.136', 'DAMAGECOUNT': '7.773', 'FRAGCOUNT': '24.000'} [2023-02-24 20:35:33,705][213369] DAMAGECOUNT value on done: 71233.0 [2023-02-24 20:35:33,705][213369] Sum rewards: 17.119, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.345', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO5': '0.030', 'AMMO2': '0.096', 'AMMO3': '0.112', 'weapon2': '0.246', 'AMMO4': '0.480', 'WEAPON3': '0.650', 'WEAPON4': '0.700', 'WEAPON5': '0.850', 'weapon4': '0.854', 'weapon5': '0.878', 'HITCOUNT': '1.160', 'weapon3': '1.602', 'DAMAGECOUNT': '6.531', 'FRAGCOUNT': '17.000'} [2023-02-24 20:35:33,791][213372] DAMAGECOUNT value on done: 71154.0 [2023-02-24 20:35:33,792][213372] Sum rewards: 19.742, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.442', 'AMMO2': '0.004', 'ARMOR': '0.004', 'AMMO4': '0.018', 'AMMO5': '0.021', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.212', 'WEAPON5': '0.400', 'weapon5': '0.420', 'WEAPON3': '0.500', 'weapon2': '1.226', 'HITCOUNT': '1.310', 'weapon3': '1.670', 'DAMAGECOUNT': '4.959', 'FRAGCOUNT': '16.000'} [2023-02-24 20:35:33,853][213384] DAMAGECOUNT value on done: 72331.0 [2023-02-24 20:35:33,854][213384] Sum rewards: 29.187, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.568', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.040', 'AMMO3': '0.054', 'weapon7': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.199', 'weapon2': '0.308', 'weapon5': '0.316', 'WEAPON3': '0.350', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon3': '1.194', 'HITCOUNT': '1.530', 'weapon4': '1.718', 'DAMAGECOUNT': '7.137', 'FRAGCOUNT': '23.000'} [2023-02-24 20:35:33,885][213366] DAMAGECOUNT value on done: 74602.0 [2023-02-24 20:35:33,886][213366] Sum rewards: 19.236, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.576', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.017', 'weapon7': '0.070', 'AMMO3': '0.079', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.326', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON3': '0.500', 'weapon5': '0.722', 'HITCOUNT': '0.890', 'weapon3': '1.964', 'DAMAGECOUNT': '4.353', 'FRAGCOUNT': '15.000'} [2023-02-24 20:35:33,898][213383] DAMAGECOUNT value on done: 69017.0 [2023-02-24 20:35:33,899][213383] Sum rewards: 16.446, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.906', 'ARMOR': '0.004', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO4': '0.091', 'AMMO3': '0.105', 'WEAPON4': '0.350', 'weapon5': '0.354', 'WEAPON5': '0.600', 'weapon2': '0.604', 'WEAPON3': '0.700', 'weapon4': '1.036', 'HITCOUNT': '1.400', 'weapon3': '1.574', 'DAMAGECOUNT': '4.725', 'FRAGCOUNT': '15.000'} [2023-02-24 20:35:33,934][213382] DAMAGECOUNT value on done: 71233.0 [2023-02-24 20:35:33,934][213382] Sum rewards: 23.491, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.225', 'AMMO2': '0.010', 'AMMO5': '0.022', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.124', 'weapon2': '0.180', 'weapon5': '0.472', 'WEAPON5': '0.600', 'weapon4': '0.644', 'WEAPON3': '0.800', 'HITCOUNT': '1.320', 'weapon3': '2.210', 'DAMAGECOUNT': '6.735', 'FRAGCOUNT': '19.000'} [2023-02-24 20:35:33,969][213368] DAMAGECOUNT value on done: 74634.0 [2023-02-24 20:35:33,969][213368] Sum rewards: 26.302, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.907', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.037', 'AMMO3': '0.136', 'AMMO4': '0.186', 'WEAPON4': '0.350', 'weapon5': '0.412', 'WEAPON5': '0.550', 'weapon4': '0.666', 'weapon2': '0.774', 'WEAPON3': '0.850', 'HITCOUNT': '1.490', 'weapon3': '1.816', 'DAMAGECOUNT': '7.659', 'FRAGCOUNT': '25.000'} [2023-02-24 20:35:33,999][213369] DAMAGECOUNT value on done: 77938.0 [2023-02-24 20:35:34,000][213369] Sum rewards: 27.433, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.712', 'AMMO2': '0.001', 'ARMOR': '0.004', 'AMMO4': '0.005', 'AMMO5': '0.026', 'AMMO3': '0.104', 'WEAPON4': '0.200', 'weapon5': '0.430', 'weapon2': '0.490', 'WEAPON3': '0.700', 'WEAPON5': '0.700', 'weapon4': '0.898', 'HITCOUNT': '1.600', 'weapon3': '1.860', 'DAMAGECOUNT': '6.876', 'FRAGCOUNT': '22.000'} [2023-02-24 20:35:34,166][213384] DAMAGECOUNT value on done: 66127.0 [2023-02-24 20:35:34,166][213384] Sum rewards: 20.314, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.340', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.013', 'WEAPON1': '0.030', 'AMMO3': '0.140', 'weapon2': '0.280', 'WEAPON5': '0.450', 'weapon5': '0.562', 'WEAPON3': '0.900', 'HITCOUNT': '1.590', 'weapon3': '2.868', 'DAMAGECOUNT': '6.312', 'FRAGCOUNT': '16.000'} [2023-02-24 20:35:34,200][213366] DAMAGECOUNT value on done: 70200.0 [2023-02-24 20:35:34,201][213366] Sum rewards: 22.056, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.064', 'ARMOR': '0.004', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.040', 'AMMO3': '0.128', 'AMMO4': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.394', 'weapon2': '0.426', 'weapon5': '0.494', 'WEAPON3': '0.800', 'HITCOUNT': '1.700', 'weapon3': '1.916', 'DAMAGECOUNT': '7.188', 'FRAGCOUNT': '19.000'} [2023-02-24 20:35:34,206][213383] DAMAGECOUNT value on done: 67360.0 [2023-02-24 20:35:34,206][213383] Sum rewards: 28.209, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.006', 'AMMO5': '0.010', 'weapon4': '0.024', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.087', 'HEALTH': '0.143', 'weapon5': '0.290', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'weapon2': '1.168', 'HITCOUNT': '1.430', 'weapon3': '2.270', 'DAMAGECOUNT': '6.849', 'FRAGCOUNT': '21.000'} [2023-02-24 20:35:34,244][213382] DAMAGECOUNT value on done: 72506.0 [2023-02-24 20:35:34,245][213382] Sum rewards: 19.882, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.680', 'ARMOR': '0.004', 'AMMO2': '0.025', 'AMMO5': '0.032', 'AMMO4': '0.124', 'AMMO3': '0.147', 'weapon5': '0.256', 'weapon4': '0.346', 'WEAPON4': '0.400', 'weapon2': '0.752', 'WEAPON5': '0.800', 'WEAPON3': '0.850', 'HITCOUNT': '1.510', 'weapon3': '2.044', 'DAMAGECOUNT': '6.522', 'FRAGCOUNT': '20.000'} [2023-02-24 20:35:34,271][213368] DAMAGECOUNT value on done: 74732.0 [2023-02-24 20:35:34,272][213368] Sum rewards: 28.825, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.215', 'AMMO2': '0.007', 'AMMO5': '0.022', 'AMMO4': '0.034', 'AMMO3': '0.105', 'weapon4': '0.124', 'WEAPON4': '0.150', 'weapon5': '0.426', 'WEAPON5': '0.650', 'WEAPON3': '0.700', 'weapon2': '1.238', 'HITCOUNT': '1.560', 'weapon3': '1.898', 'DAMAGECOUNT': '7.626', 'FRAGCOUNT': '23.000'} [2023-02-24 20:35:34,431][213369] DAMAGECOUNT value on done: 73851.0 [2023-02-24 20:35:34,432][213369] Sum rewards: 29.719, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.446', 'AMMO5': '0.021', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.154', 'WEAPON4': '0.250', 'weapon5': '0.280', 'weapon2': '0.440', 'WEAPON5': '0.500', 'weapon4': '0.700', 'WEAPON3': '0.900', 'HITCOUNT': '1.890', 'weapon3': '2.124', 'DAMAGECOUNT': '8.268', 'FRAGCOUNT': '26.000'} [2023-02-24 20:35:34,452][213384] DAMAGECOUNT value on done: 76202.0 [2023-02-24 20:35:34,452][213384] Sum rewards: 20.801, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.165', 'AMMO2': '0.006', 'AMMO5': '0.018', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.099', 'weapon4': '0.226', 'weapon5': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'weapon2': '0.860', 'HITCOUNT': '1.310', 'weapon3': '2.074', 'DAMAGECOUNT': '5.640', 'FRAGCOUNT': '16.000'} [2023-02-24 20:35:34,567][213368] DAMAGECOUNT value on done: 75110.0 [2023-02-24 20:35:34,567][213368] Sum rewards: 27.097, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.312', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.018', 'AMMO4': '0.087', 'AMMO3': '0.152', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.410', 'weapon5': '0.448', 'weapon2': '0.672', 'WEAPON3': '0.800', 'HITCOUNT': '1.740', 'weapon3': '2.040', 'DAMAGECOUNT': '8.667', 'FRAGCOUNT': '23.000'} [2023-02-24 20:35:34,734][213369] DAMAGECOUNT value on done: 64402.0 [2023-02-24 20:35:34,735][213369] Sum rewards: 22.638, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.526', 'AMMO5': '0.017', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'AMMO3': '0.075', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'weapon4': '0.242', 'WEAPON5': '0.450', 'WEAPON3': '0.450', 'weapon5': '0.452', 'weapon2': '1.330', 'HITCOUNT': '1.380', 'weapon3': '1.628', 'DAMAGECOUNT': '5.292', 'FRAGCOUNT': '17.500'} [2023-02-24 20:35:34,746][213384] DAMAGECOUNT value on done: 74743.0 [2023-02-24 20:35:34,747][213384] Sum rewards: 27.983, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.092', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.032', 'AMMO3': '0.109', 'AMMO4': '0.161', 'weapon5': '0.306', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.548', 'WEAPON3': '0.600', 'weapon2': '0.682', 'HITCOUNT': '2.120', 'weapon3': '2.128', 'DAMAGECOUNT': '9.567', 'FRAGCOUNT': '23.000'} [2023-02-24 20:35:35,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13243.7, 300 sec: 13676.5). Total num frames: 108888064. Throughput: 0: 3259.1. Samples: 2210978. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:35:35,243][213332] Avg episode reward: [(0, '23.561')] [2023-02-24 20:35:35,696][213365] Updated weights for policy 0, policy_version 26586 (0.0009) [2023-02-24 20:35:38,642][213365] Updated weights for policy 0, policy_version 26596 (0.0009) [2023-02-24 20:35:40,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13243.7, 300 sec: 13676.5). Total num frames: 108957696. Throughput: 0: 3337.6. Samples: 2231904. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:35:40,243][213332] Avg episode reward: [(0, '23.561')] [2023-02-24 20:35:41,580][213365] Updated weights for policy 0, policy_version 26606 (0.0009) [2023-02-24 20:35:44,538][213365] Updated weights for policy 0, policy_version 26616 (0.0009) [2023-02-24 20:35:45,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13243.8, 300 sec: 13676.5). Total num frames: 109027328. Throughput: 0: 3384.8. Samples: 2252672. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:35:45,243][213332] Avg episode reward: [(0, '23.561')] [2023-02-24 20:35:47,503][213365] Updated weights for policy 0, policy_version 26626 (0.0009) [2023-02-24 20:35:50,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13380.8, 300 sec: 13676.5). Total num frames: 109096960. Throughput: 0: 3413.4. Samples: 2263018. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:35:50,243][213332] Avg episode reward: [(0, '23.561')] [2023-02-24 20:35:50,456][213365] Updated weights for policy 0, policy_version 26636 (0.0009) [2023-02-24 20:35:52,039][213367] DAMAGECOUNT value on done: 73766.0 [2023-02-24 20:35:52,040][213367] Sum rewards: 30.980, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.434', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO5': '0.018', 'AMMO3': '0.064', 'WEAPON4': '0.100', 'weapon4': '0.192', 'WEAPON3': '0.400', 'WEAPON5': '0.500', 'weapon5': '0.648', 'weapon2': '0.776', 'HITCOUNT': '1.640', 'weapon3': '2.062', 'DAMAGECOUNT': '7.500', 'FRAGCOUNT': '22.000'} [2023-02-24 20:35:52,062][213372] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 20:35:52,130][213372] DAMAGECOUNT value on done: 74915.0 [2023-02-24 20:35:52,130][213372] Sum rewards: 42.398, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.473', 'AMMO2': '0.016', 'AMMO5': '0.017', 'AMMO4': '0.081', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'weapon4': '0.150', 'WEAPON5': '0.400', 'weapon5': '0.538', 'weapon2': '0.720', 'WEAPON3': '0.800', 'HITCOUNT': '2.200', 'weapon3': '2.312', 'DAMAGECOUNT': '11.856', 'FRAGCOUNT': '34.000'} [2023-02-24 20:35:52,338][213367] DAMAGECOUNT value on done: 75486.0 [2023-02-24 20:35:52,339][213367] Sum rewards: 17.990, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.611', 'AMMO5': '0.012', 'AMMO2': '0.058', 'AMMO3': '0.070', 'weapon5': '0.268', 'AMMO4': '0.290', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.614', 'weapon4': '1.134', 'HITCOUNT': '1.220', 'weapon3': '1.272', 'DAMAGECOUNT': '5.262', 'FRAGCOUNT': '15.000'} [2023-02-24 20:35:52,428][213383] DAMAGECOUNT value on done: 75774.0 [2023-02-24 20:35:52,428][213383] Sum rewards: 22.463, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.440', 'ARMOR': '0.004', 'AMMO5': '0.035', 'AMMO2': '0.061', 'AMMO3': '0.130', 'AMMO4': '0.307', 'weapon5': '0.494', 'WEAPON4': '0.600', 'weapon4': '0.602', 'WEAPON3': '0.700', 'WEAPON5': '0.800', 'weapon2': '1.194', 'weapon3': '1.360', 'HITCOUNT': '1.500', 'DAMAGECOUNT': '7.866', 'FRAGCOUNT': '20.000'} [2023-02-24 20:35:52,430][213372] DAMAGECOUNT value on done: 74465.0 [2023-02-24 20:35:52,431][213372] Sum rewards: 19.898, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.545', 'AMMO5': '0.019', 'AMMO2': '0.024', 'AMMO3': '0.117', 'AMMO4': '0.120', 'weapon5': '0.410', 'weapon2': '0.426', 'WEAPON4': '0.450', 'weapon4': '0.582', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'HITCOUNT': '1.550', 'weapon3': '2.226', 'DAMAGECOUNT': '5.919', 'FRAGCOUNT': '19.000'} [2023-02-24 20:35:52,571][213366] DAMAGECOUNT value on done: 75533.0 [2023-02-24 20:35:52,572][213366] Sum rewards: 19.473, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.711', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.020', 'AMMO3': '0.109', 'weapon2': '0.384', 'WEAPON5': '0.550', 'weapon5': '0.554', 'WEAPON3': '0.700', 'HITCOUNT': '0.960', 'weapon3': '2.726', 'DAMAGECOUNT': '4.941', 'FRAGCOUNT': '16.000'} [2023-02-24 20:35:52,647][213367] DAMAGECOUNT value on done: 72201.0 [2023-02-24 20:35:52,647][213367] Sum rewards: 24.089, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.481', 'AMMO2': '0.011', 'AMMO5': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'weapon4': '0.104', 'AMMO3': '0.139', 'WEAPON5': '0.400', 'weapon5': '0.580', 'weapon2': '0.704', 'WEAPON3': '0.800', 'HITCOUNT': '1.100', 'weapon3': '2.004', 'DAMAGECOUNT': '5.859', 'FRAGCOUNT': '21.000'} [2023-02-24 20:35:52,724][213382] DAMAGECOUNT value on done: 73532.0 [2023-02-24 20:35:52,724][213382] Sum rewards: 19.914, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.715', 'AMMO5': '0.028', 'AMMO2': '0.036', 'AMMO3': '0.129', 'AMMO4': '0.182', 'WEAPON4': '0.300', 'weapon5': '0.530', 'weapon4': '0.548', 'WEAPON3': '0.650', 'WEAPON5': '0.700', 'weapon2': '0.860', 'weapon3': '1.308', 'HITCOUNT': '1.310', 'DAMAGECOUNT': '6.297', 'FRAGCOUNT': '19.000'} [2023-02-24 20:35:52,734][213383] DAMAGECOUNT value on done: 78729.0 [2023-02-24 20:35:52,734][213383] Sum rewards: 18.291, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.550', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'AMMO5': '0.022', 'weapon4': '0.078', 'AMMO4': '0.098', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'weapon5': '0.508', 'WEAPON5': '0.550', 'weapon2': '0.676', 'WEAPON3': '0.900', 'HITCOUNT': '1.350', 'weapon3': '2.444', 'DAMAGECOUNT': '5.886', 'FRAGCOUNT': '16.000'} [2023-02-24 20:35:52,883][213366] DAMAGECOUNT value on done: 77543.0 [2023-02-24 20:35:52,884][213366] Sum rewards: 15.302, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.816', 'AMMO2': '0.008', 'AMMO5': '0.023', 'AMMO4': '0.038', 'weapon4': '0.038', 'WEAPON4': '0.050', 'AMMO3': '0.128', 'weapon5': '0.374', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'weapon2': '0.892', 'HITCOUNT': '1.040', 'weapon3': '2.388', 'DAMAGECOUNT': '5.289', 'FRAGCOUNT': '12.000'} [2023-02-24 20:35:52,932][213372] DAMAGECOUNT value on done: 75343.0 [2023-02-24 20:35:52,932][213372] Sum rewards: 22.312, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.110', 'AMMO5': '0.021', 'AMMO2': '0.033', 'AMMO4': '0.166', 'AMMO3': '0.172', 'weapon2': '0.296', 'weapon4': '0.402', 'weapon5': '0.426', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'ARMOR': '0.474', 'WEAPON3': '1.050', 'HITCOUNT': '1.550', 'weapon3': '2.240', 'DAMAGECOUNT': '7.191', 'FRAGCOUNT': '23.000'} [2023-02-24 20:35:52,946][213368] DAMAGECOUNT value on done: 69752.0 [2023-02-24 20:35:52,947][213368] Sum rewards: 23.617, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.645', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.010', 'AMMO3': '0.087', 'WEAPON5': '0.400', 'weapon5': '0.548', 'weapon2': '0.644', 'WEAPON3': '0.650', 'HITCOUNT': '1.130', 'weapon3': '2.558', 'DAMAGECOUNT': '5.766', 'FRAGCOUNT': '18.000'} [2023-02-24 20:35:52,964][213367] DAMAGECOUNT value on done: 72667.0 [2023-02-24 20:35:52,965][213367] Sum rewards: 25.279, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.717', 'AMMO5': '0.015', 'AMMO2': '0.026', 'weapon7': '0.052', 'AMMO3': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.130', 'weapon4': '0.162', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.450', 'weapon5': '0.450', 'weapon2': '0.690', 'WEAPON3': '0.800', 'HITCOUNT': '1.510', 'weapon3': '2.332', 'DAMAGECOUNT': '6.870', 'FRAGCOUNT': '21.000'} [2023-02-24 20:35:53,042][213382] DAMAGECOUNT value on done: 78807.0 [2023-02-24 20:35:53,042][213382] Sum rewards: 27.348, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.920', 'AMMO2': '0.012', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.057', 'AMMO3': '0.116', 'WEAPON4': '0.200', 'weapon4': '0.342', 'ARMOR': '0.400', 'weapon5': '0.496', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'weapon2': '0.944', 'weapon3': '1.858', 'HITCOUNT': '1.970', 'DAMAGECOUNT': '8.433', 'FRAGCOUNT': '22.000'} [2023-02-24 20:35:53,044][213369] DAMAGECOUNT value on done: 73697.0 [2023-02-24 20:35:53,044][213369] Sum rewards: 29.542, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.039', 'AMMO5': '0.018', 'AMMO2': '0.022', 'AMMO3': '0.105', 'AMMO4': '0.112', 'WEAPON4': '0.300', 'weapon2': '0.396', 'weapon5': '0.454', 'weapon4': '0.462', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'HITCOUNT': '1.750', 'weapon3': '2.370', 'DAMAGECOUNT': '7.392', 'FRAGCOUNT': '26.000'} [2023-02-24 20:35:53,234][213372] DAMAGECOUNT value on done: 74067.0 [2023-02-24 20:35:53,235][213372] Sum rewards: 29.189, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.302', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.030', 'AMMO3': '0.109', 'AMMO4': '0.149', 'WEAPON4': '0.250', 'weapon5': '0.384', 'WEAPON5': '0.450', 'weapon4': '0.600', 'weapon2': '0.740', 'WEAPON3': '0.750', 'weapon3': '1.998', 'HITCOUNT': '2.270', 'DAMAGECOUNT': '8.739', 'FRAGCOUNT': '23.000'} [2023-02-24 20:35:53,251][213366] DAMAGECOUNT value on done: 77107.0 [2023-02-24 20:35:53,252][213366] Sum rewards: 31.767, reward structure: {'DEATHCOUNT': '-9.750', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO5': '0.029', 'AMMO3': '0.117', 'AMMO4': '0.118', 'WEAPON4': '0.200', 'weapon4': '0.338', 'weapon2': '0.394', 'weapon5': '0.526', 'HEALTH': '0.624', 'WEAPON5': '0.700', 'WEAPON3': '0.700', 'HITCOUNT': '1.910', 'weapon3': '2.302', 'DAMAGECOUNT': '7.515', 'FRAGCOUNT': '26.000'} [2023-02-24 20:35:53,253][213368] DAMAGECOUNT value on done: 76975.0 [2023-02-24 20:35:53,254][213368] Sum rewards: 23.495, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.376', 'ARMOR': '0.004', 'AMMO5': '0.036', 'AMMO2': '0.040', 'AMMO3': '0.060', 'AMMO4': '0.201', 'WEAPON3': '0.450', 'weapon4': '0.458', 'WEAPON4': '0.500', 'weapon5': '0.644', 'WEAPON5': '0.800', 'weapon2': '0.814', 'HITCOUNT': '1.470', 'weapon3': '1.620', 'DAMAGECOUNT': '7.023', 'FRAGCOUNT': '19.000'} [2023-02-24 20:35:53,274][213384] DAMAGECOUNT value on done: 74876.0 [2023-02-24 20:35:53,275][213384] Sum rewards: 20.094, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.840', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO5': '0.019', 'AMMO4': '0.094', 'weapon5': '0.136', 'weapon4': '0.164', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'WEAPON5': '0.400', 'weapon2': '0.526', 'WEAPON3': '1.250', 'HITCOUNT': '1.890', 'weapon3': '2.886', 'DAMAGECOUNT': '7.635', 'FRAGCOUNT': '20.000'} [2023-02-24 20:35:53,306][213383] DAMAGECOUNT value on done: 72046.0 [2023-02-24 20:35:53,307][213383] Sum rewards: 26.447, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.780', 'AMMO2': '0.017', 'AMMO5': '0.025', 'AMMO4': '0.083', 'AMMO3': '0.185', 'weapon2': '0.338', 'WEAPON4': '0.350', 'weapon4': '0.404', 'weapon5': '0.404', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'HITCOUNT': '1.820', 'weapon3': '2.514', 'DAMAGECOUNT': '9.087', 'FRAGCOUNT': '25.000'} [2023-02-24 20:35:53,351][213369] DAMAGECOUNT value on done: 80482.0 [2023-02-24 20:35:53,352][213369] Sum rewards: 25.531, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.630', 'AMMO2': '0.016', 'AMMO5': '0.019', 'AMMO4': '0.081', 'weapon4': '0.176', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon5': '0.308', 'WEAPON5': '0.500', 'weapon2': '0.712', 'WEAPON3': '1.200', 'HITCOUNT': '1.560', 'weapon3': '2.558', 'DAMAGECOUNT': '7.632', 'FRAGCOUNT': '25.000'} [2023-02-24 20:35:53,353][213382] DAMAGECOUNT value on done: 73911.0 [2023-02-24 20:35:53,353][213382] Sum rewards: 28.148, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.345', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.034', 'weapon4': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.149', 'weapon5': '0.280', 'WEAPON5': '0.400', 'weapon2': '0.454', 'WEAPON3': '0.900', 'HITCOUNT': '1.900', 'weapon3': '2.968', 'DAMAGECOUNT': '8.034', 'FRAGCOUNT': '23.000'} [2023-02-24 20:35:53,465][213365] Updated weights for policy 0, policy_version 26646 (0.0009) [2023-02-24 20:35:53,547][213368] DAMAGECOUNT value on done: 76478.0 [2023-02-24 20:35:53,547][213368] Sum rewards: 24.729, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.014', 'AMMO5': '0.017', 'AMMO4': '0.072', 'AMMO3': '0.089', 'HEALTH': '0.092', 'WEAPON4': '0.200', 'weapon5': '0.342', 'WEAPON5': '0.350', 'weapon4': '0.350', 'WEAPON3': '0.500', 'weapon2': '1.236', 'HITCOUNT': '1.280', 'weapon3': '1.698', 'DAMAGECOUNT': '5.238', 'FRAGCOUNT': '20.000'} [2023-02-24 20:35:53,554][213366] DAMAGECOUNT value on done: 72503.0 [2023-02-24 20:35:53,554][213366] Sum rewards: 22.531, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.815', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.033', 'WEAPON4': '0.150', 'AMMO4': '0.165', 'AMMO3': '0.182', 'weapon2': '0.318', 'weapon5': '0.454', 'WEAPON5': '0.600', 'weapon4': '0.766', 'WEAPON3': '1.200', 'HITCOUNT': '1.700', 'weapon3': '2.086', 'DAMAGECOUNT': '6.909', 'FRAGCOUNT': '22.000'} [2023-02-24 20:35:53,577][213384] DAMAGECOUNT value on done: 68297.0 [2023-02-24 20:35:53,577][213384] Sum rewards: 19.225, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.418', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'AMMO3': '0.089', 'AMMO4': '0.137', 'weapon4': '0.236', 'WEAPON4': '0.300', 'weapon5': '0.520', 'WEAPON5': '0.650', 'weapon2': '0.690', 'WEAPON3': '0.700', 'HITCOUNT': '1.650', 'weapon3': '2.094', 'DAMAGECOUNT': '6.510', 'FRAGCOUNT': '17.000'} [2023-02-24 20:35:53,609][213383] DAMAGECOUNT value on done: 69331.0 [2023-02-24 20:35:53,609][213383] Sum rewards: 19.606, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.220', 'AMMO5': '0.021', 'AMMO2': '0.036', 'AMMO3': '0.124', 'AMMO4': '0.178', 'weapon4': '0.188', 'WEAPON4': '0.200', 'weapon5': '0.546', 'WEAPON5': '0.550', 'weapon2': '0.748', 'WEAPON3': '0.800', 'HITCOUNT': '1.380', 'weapon3': '2.142', 'DAMAGECOUNT': '5.913', 'FRAGCOUNT': '17.000'} [2023-02-24 20:35:53,647][213382] DAMAGECOUNT value on done: 75096.0 [2023-02-24 20:35:53,648][213382] Sum rewards: 31.156, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.621', 'AMMO5': '0.017', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.106', 'weapon4': '0.122', 'WEAPON4': '0.200', 'weapon5': '0.374', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'weapon2': '0.712', 'HITCOUNT': '1.700', 'weapon3': '2.466', 'DAMAGECOUNT': '7.770', 'FRAGCOUNT': '26.000'} [2023-02-24 20:35:53,808][213369] DAMAGECOUNT value on done: 76121.0 [2023-02-24 20:35:53,808][213369] Sum rewards: 24.929, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.404', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.016', 'WEAPON4': '0.100', 'AMMO3': '0.158', 'weapon2': '0.248', 'weapon4': '0.252', 'weapon5': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'HITCOUNT': '1.640', 'weapon3': '2.772', 'DAMAGECOUNT': '6.810', 'FRAGCOUNT': '23.000'} [2023-02-24 20:35:53,845][213368] DAMAGECOUNT value on done: 76524.0 [2023-02-24 20:35:53,846][213368] Sum rewards: 7.905, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.789', 'ARMOR': '0.004', 'AMMO5': '0.030', 'AMMO2': '0.039', 'AMMO3': '0.161', 'AMMO4': '0.194', 'weapon2': '0.304', 'weapon5': '0.338', 'WEAPON4': '0.350', 'WEAPON5': '0.700', 'weapon4': '0.866', 'WEAPON3': '0.950', 'HITCOUNT': '1.000', 'weapon3': '2.016', 'DAMAGECOUNT': '4.242', 'FRAGCOUNT': '11.000'} [2023-02-24 20:35:53,859][213384] DAMAGECOUNT value on done: 78564.0 [2023-02-24 20:35:53,859][213384] Sum rewards: 17.668, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.640', 'AMMO2': '0.014', 'AMMO5': '0.017', 'AMMO4': '0.069', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon5': '0.278', 'weapon4': '0.306', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon2': '1.258', 'HITCOUNT': '1.600', 'weapon3': '1.754', 'DAMAGECOUNT': '7.086', 'FRAGCOUNT': '17.000'} [2023-02-24 20:35:54,101][213369] DAMAGECOUNT value on done: 66423.0 [2023-02-24 20:35:54,102][213369] Sum rewards: 21.938, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.222', 'AMMO5': '0.016', 'AMMO2': '0.025', 'AMMO3': '0.079', 'AMMO4': '0.124', 'weapon2': '0.176', 'WEAPON4': '0.450', 'ARMOR': '0.456', 'weapon5': '0.468', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'weapon4': '0.996', 'HITCOUNT': '1.440', 'weapon3': '1.966', 'DAMAGECOUNT': '6.063', 'FRAGCOUNT': '19.000'} [2023-02-24 20:35:54,152][213384] DAMAGECOUNT value on done: 77571.0 [2023-02-24 20:35:54,153][213384] Sum rewards: 26.199, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.310', 'AMMO5': '0.025', 'AMMO2': '0.032', 'AMMO3': '0.116', 'AMMO4': '0.157', 'WEAPON4': '0.250', 'weapon5': '0.310', 'weapon4': '0.320', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'weapon2': '1.274', 'weapon3': '1.540', 'HITCOUNT': '1.850', 'DAMAGECOUNT': '8.484', 'FRAGCOUNT': '20.000'} [2023-02-24 20:35:55,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13516.8, 300 sec: 13676.5). Total num frames: 109166592. Throughput: 0: 3457.6. Samples: 2283718. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:35:55,243][213332] Avg episode reward: [(0, '23.705')] [2023-02-24 20:35:56,405][213365] Updated weights for policy 0, policy_version 26656 (0.0009) [2023-02-24 20:35:59,358][213365] Updated weights for policy 0, policy_version 26666 (0.0009) [2023-02-24 20:36:00,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13653.3, 300 sec: 13676.5). Total num frames: 109236224. Throughput: 0: 3471.9. Samples: 2304676. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:36:00,243][213332] Avg episode reward: [(0, '23.705')] [2023-02-24 20:36:02,292][213365] Updated weights for policy 0, policy_version 26676 (0.0009) [2023-02-24 20:36:05,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13789.9, 300 sec: 13676.5). Total num frames: 109305856. Throughput: 0: 3470.7. Samples: 2315068. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:36:05,243][213332] Avg episode reward: [(0, '23.705')] [2023-02-24 20:36:05,244][213365] Updated weights for policy 0, policy_version 26686 (0.0009) [2023-02-24 20:36:05,907][213366] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 20:36:08,202][213365] Updated weights for policy 0, policy_version 26696 (0.0009) [2023-02-24 20:36:10,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13858.1, 300 sec: 13662.6). Total num frames: 109371392. Throughput: 0: 3469.4. Samples: 2335886. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:36:10,243][213332] Avg episode reward: [(0, '23.705')] [2023-02-24 20:36:11,148][213365] Updated weights for policy 0, policy_version 26706 (0.0009) [2023-02-24 20:36:11,392][213367] DAMAGECOUNT value on done: 76054.0 [2023-02-24 20:36:11,393][213367] Sum rewards: 26.123, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.541', 'AMMO2': '0.015', 'AMMO5': '0.019', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.142', 'weapon4': '0.268', 'weapon2': '0.380', 'weapon5': '0.542', 'WEAPON5': '0.550', 'WEAPON3': '0.950', 'HITCOUNT': '1.560', 'weapon3': '2.474', 'DAMAGECOUNT': '6.588', 'FRAGCOUNT': '23.000'} [2023-02-24 20:36:11,487][213372] DAMAGECOUNT value on done: 77562.0 [2023-02-24 20:36:11,488][213372] Sum rewards: 25.020, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.870', 'AMMO5': '0.017', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'weapon4': '0.198', 'weapon2': '0.402', 'WEAPON5': '0.450', 'weapon5': '0.554', 'WEAPON3': '0.700', 'HITCOUNT': '2.010', 'weapon3': '2.504', 'DAMAGECOUNT': '7.941', 'FRAGCOUNT': '19.000'} [2023-02-24 20:36:11,702][213367] DAMAGECOUNT value on done: 78022.0 [2023-02-24 20:36:11,703][213367] Sum rewards: 29.721, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.205', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.022', 'AMMO3': '0.131', 'WEAPON5': '0.150', 'weapon5': '0.354', 'WEAPON3': '0.800', 'weapon2': '0.920', 'HITCOUNT': '1.900', 'weapon3': '2.294', 'DAMAGECOUNT': '7.593', 'FRAGCOUNT': '24.000'} [2023-02-24 20:36:11,789][213372] DAMAGECOUNT value on done: 77164.0 [2023-02-24 20:36:11,789][213372] Sum rewards: 25.248, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.675', 'AMMO5': '0.019', 'AMMO2': '0.032', 'AMMO3': '0.144', 'AMMO4': '0.158', 'WEAPON4': '0.250', 'weapon2': '0.372', 'weapon5': '0.456', 'WEAPON5': '0.500', 'weapon4': '0.588', 'WEAPON3': '0.900', 'HITCOUNT': '1.840', 'weapon3': '2.208', 'DAMAGECOUNT': '7.956', 'FRAGCOUNT': '22.000'} [2023-02-24 20:36:11,794][213383] DAMAGECOUNT value on done: 77715.0 [2023-02-24 20:36:11,795][213383] Sum rewards: 21.680, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.564', 'AMMO2': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'weapon4': '0.070', 'AMMO3': '0.105', 'WEAPON5': '0.350', 'weapon5': '0.648', 'WEAPON3': '0.700', 'HITCOUNT': '1.240', 'weapon2': '1.424', 'weapon3': '1.528', 'DAMAGECOUNT': '5.823', 'FRAGCOUNT': '18.000'} [2023-02-24 20:36:11,948][213366] DAMAGECOUNT value on done: 78191.0 [2023-02-24 20:36:11,949][213366] Sum rewards: 23.257, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.130', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO2': '0.036', 'AMMO3': '0.157', 'AMMO4': '0.180', 'WEAPON4': '0.250', 'weapon4': '0.264', 'weapon5': '0.424', 'weapon2': '0.536', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'HITCOUNT': '1.540', 'weapon3': '2.332', 'DAMAGECOUNT': '7.974', 'FRAGCOUNT': '21.000'} [2023-02-24 20:36:12,007][213367] DAMAGECOUNT value on done: 74780.0 [2023-02-24 20:36:12,007][213367] Sum rewards: 28.336, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.884', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.027', 'AMMO3': '0.119', 'AMMO4': '0.135', 'WEAPON4': '0.400', 'weapon5': '0.404', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'weapon2': '0.714', 'weapon4': '0.938', 'weapon3': '1.430', 'HITCOUNT': '1.720', 'DAMAGECOUNT': '7.737', 'FRAGCOUNT': '25.000'} [2023-02-24 20:36:12,067][213382] DAMAGECOUNT value on done: 75078.0 [2023-02-24 20:36:12,067][213382] Sum rewards: 19.076, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.231', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.065', 'WEAPON5': '0.300', 'weapon5': '0.384', 'WEAPON3': '0.450', 'HITCOUNT': '1.140', 'weapon2': '1.572', 'weapon3': '1.760', 'DAMAGECOUNT': '4.623', 'FRAGCOUNT': '15.000'} [2023-02-24 20:36:12,097][213383] DAMAGECOUNT value on done: 81231.0 [2023-02-24 20:36:12,097][213383] Sum rewards: 21.558, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.480', 'WEAPON1': '0.010', 'AMMO5': '0.026', 'AMMO2': '0.041', 'AMMO3': '0.134', 'AMMO4': '0.204', 'weapon5': '0.442', 'WEAPON4': '0.450', 'WEAPON5': '0.600', 'weapon4': '0.628', 'WEAPON3': '0.750', 'weapon2': '0.916', 'HITCOUNT': '1.500', 'weapon3': '1.580', 'DAMAGECOUNT': '7.506', 'FRAGCOUNT': '21.000'} [2023-02-24 20:36:12,258][213366] DAMAGECOUNT value on done: 80417.0 [2023-02-24 20:36:12,259][213366] Sum rewards: 24.159, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.659', 'AMMO2': '0.009', 'AMMO5': '0.025', 'AMMO4': '0.043', 'WEAPON4': '0.100', 'weapon4': '0.136', 'AMMO3': '0.208', 'weapon2': '0.266', 'weapon5': '0.344', 'WEAPON5': '0.650', 'WEAPON3': '1.400', 'HITCOUNT': '1.900', 'weapon3': '2.864', 'DAMAGECOUNT': '8.622', 'FRAGCOUNT': '23.000'} [2023-02-24 20:36:12,298][213372] DAMAGECOUNT value on done: 78523.0 [2023-02-24 20:36:12,298][213372] Sum rewards: 33.589, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.178', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.012', 'AMMO3': '0.155', 'weapon5': '0.234', 'WEAPON5': '0.300', 'weapon2': '0.812', 'WEAPON3': '1.000', 'HITCOUNT': '2.030', 'weapon3': '2.702', 'DAMAGECOUNT': '9.540', 'FRAGCOUNT': '27.000'} [2023-02-24 20:36:12,299][213367] DAMAGECOUNT value on done: 74291.0 [2023-02-24 20:36:12,299][213367] Sum rewards: 20.741, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.902', 'AMMO5': '0.011', 'AMMO2': '0.011', 'AMMO3': '0.040', 'AMMO4': '0.056', 'weapon7': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.222', 'WEAPON3': '0.300', 'WEAPON5': '0.350', 'weapon5': '0.500', 'weapon2': '0.762', 'HITCOUNT': '1.070', 'weapon3': '1.444', 'DAMAGECOUNT': '4.872', 'FRAGCOUNT': '15.000'} [2023-02-24 20:36:12,341][213368] DAMAGECOUNT value on done: 72668.0 [2023-02-24 20:36:12,342][213368] Sum rewards: 29.600, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.495', 'AMMO5': '0.017', 'AMMO2': '0.051', 'AMMO3': '0.132', 'weapon5': '0.230', 'WEAPON4': '0.250', 'AMMO4': '0.254', 'weapon2': '0.282', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'weapon4': '0.840', 'HITCOUNT': '2.190', 'weapon3': '2.350', 'DAMAGECOUNT': '8.748', 'FRAGCOUNT': '24.000'} [2023-02-24 20:36:12,378][213382] DAMAGECOUNT value on done: 80945.0 [2023-02-24 20:36:12,378][213382] Sum rewards: 20.051, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.774', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.061', 'weapon7': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.142', 'weapon5': '0.212', 'AMMO4': '0.305', 'WEAPON5': '0.400', 'weapon2': '0.464', 'WEAPON4': '0.600', 'WEAPON3': '0.850', 'weapon4': '1.036', 'HITCOUNT': '1.710', 'weapon3': '1.710', 'DAMAGECOUNT': '6.414', 'FRAGCOUNT': '21.000'} [2023-02-24 20:36:12,430][213369] DAMAGECOUNT value on done: 76315.0 [2023-02-24 20:36:12,430][213369] Sum rewards: 33.875, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.552', 'AMMO2': '0.004', 'AMMO4': '0.018', 'AMMO5': '0.024', 'WEAPON4': '0.100', 'AMMO3': '0.129', 'weapon4': '0.204', 'weapon5': '0.398', 'WEAPON5': '0.650', 'weapon2': '0.710', 'WEAPON3': '0.850', 'HITCOUNT': '1.690', 'weapon3': '2.296', 'DAMAGECOUNT': '7.854', 'FRAGCOUNT': '28.000'} [2023-02-24 20:36:12,607][213372] DAMAGECOUNT value on done: 76853.0 [2023-02-24 20:36:12,607][213372] Sum rewards: 25.000, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.150', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.139', 'WEAPON4': '0.200', 'weapon2': '0.224', 'weapon4': '0.288', 'WEAPON5': '0.500', 'weapon5': '0.518', 'WEAPON3': '0.900', 'HITCOUNT': '1.740', 'weapon3': '2.606', 'DAMAGECOUNT': '8.358', 'FRAGCOUNT': '21.000'} [2023-02-24 20:36:12,624][213366] DAMAGECOUNT value on done: 79293.0 [2023-02-24 20:36:12,624][213366] Sum rewards: 20.656, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.660', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO5': '0.032', 'weapon4': '0.082', 'AMMO4': '0.125', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'weapon2': '0.598', 'weapon5': '0.680', 'WEAPON5': '0.850', 'WEAPON3': '1.000', 'HITCOUNT': '1.580', 'weapon3': '2.164', 'DAMAGECOUNT': '6.558', 'FRAGCOUNT': '19.000'} [2023-02-24 20:36:12,649][213368] DAMAGECOUNT value on done: 79156.0 [2023-02-24 20:36:12,650][213368] Sum rewards: 24.492, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.486', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.028', 'AMMO3': '0.076', 'AMMO4': '0.140', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon5': '0.460', 'WEAPON3': '0.550', 'weapon4': '0.742', 'weapon2': '0.984', 'weapon3': '1.468', 'HITCOUNT': '1.720', 'DAMAGECOUNT': '6.543', 'FRAGCOUNT': '20.000'} [2023-02-24 20:36:12,658][213384] DAMAGECOUNT value on done: 76426.0 [2023-02-24 20:36:12,658][213384] Sum rewards: 21.201, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.964', 'AMMO2': '0.005', 'AMMO5': '0.016', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'weapon5': '0.448', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon4': '0.620', 'weapon2': '0.660', 'HITCOUNT': '1.020', 'weapon3': '1.902', 'DAMAGECOUNT': '4.650', 'FRAGCOUNT': '17.000'} [2023-02-24 20:36:12,671][213383] DAMAGECOUNT value on done: 74649.0 [2023-02-24 20:36:12,671][213383] Sum rewards: 27.237, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.698', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO2': '0.040', 'AMMO3': '0.116', 'AMMO4': '0.199', 'WEAPON4': '0.300', 'weapon5': '0.310', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon4': '0.776', 'weapon2': '0.896', 'weapon3': '1.624', 'HITCOUNT': '2.020', 'DAMAGECOUNT': '7.809', 'FRAGCOUNT': '23.000'} [2023-02-24 20:36:12,683][213382] DAMAGECOUNT value on done: 76339.0 [2023-02-24 20:36:12,683][213382] Sum rewards: 21.659, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.375', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.025', 'weapon4': '0.068', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'AMMO3': '0.154', 'weapon5': '0.336', 'WEAPON5': '0.600', 'weapon2': '0.618', 'WEAPON3': '1.000', 'HITCOUNT': '1.490', 'weapon3': '2.654', 'DAMAGECOUNT': '7.284', 'FRAGCOUNT': '18.500'} [2023-02-24 20:36:12,724][213369] DAMAGECOUNT value on done: 82311.0 [2023-02-24 20:36:12,725][213369] Sum rewards: 23.493, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.498', 'AMMO2': '0.013', 'AMMO5': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'weapon4': '0.102', 'AMMO3': '0.131', 'WEAPON5': '0.300', 'weapon5': '0.458', 'WEAPON3': '0.750', 'weapon2': '0.938', 'HITCOUNT': '1.240', 'weapon3': '1.944', 'DAMAGECOUNT': '5.487', 'FRAGCOUNT': '20.000'} [2023-02-24 20:36:12,923][213366] DAMAGECOUNT value on done: 75225.0 [2023-02-24 20:36:12,924][213366] Sum rewards: 29.485, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.092', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'WEAPON4': '0.050', 'AMMO4': '0.090', 'AMMO3': '0.146', 'weapon4': '0.244', 'weapon5': '0.308', 'weapon2': '0.330', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'HITCOUNT': '2.010', 'weapon3': '2.724', 'DAMAGECOUNT': '8.166', 'FRAGCOUNT': '24.000'} [2023-02-24 20:36:12,929][213368] DAMAGECOUNT value on done: 79089.0 [2023-02-24 20:36:12,930][213368] Sum rewards: 30.970, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.902', 'AMMO2': '0.009', 'AMMO5': '0.017', 'AMMO4': '0.042', 'weapon4': '0.084', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'weapon5': '0.370', 'WEAPON5': '0.500', 'weapon2': '0.664', 'WEAPON3': '0.700', 'HITCOUNT': '1.610', 'weapon3': '2.594', 'DAMAGECOUNT': '7.833', 'FRAGCOUNT': '24.000'} [2023-02-24 20:36:12,957][213384] DAMAGECOUNT value on done: 71365.0 [2023-02-24 20:36:12,958][213384] Sum rewards: 21.588, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.190', 'AMMO5': '0.032', 'AMMO2': '0.060', 'AMMO3': '0.179', 'weapon2': '0.288', 'AMMO4': '0.299', 'weapon5': '0.426', 'WEAPON4': '0.550', 'weapon4': '0.742', 'WEAPON5': '0.900', 'WEAPON3': '1.100', 'HITCOUNT': '1.630', 'weapon3': '2.118', 'DAMAGECOUNT': '9.204', 'FRAGCOUNT': '22.000'} [2023-02-24 20:36:12,967][213383] DAMAGECOUNT value on done: 71793.0 [2023-02-24 20:36:12,968][213383] Sum rewards: 27.827, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.840', 'AMMO5': '0.022', 'AMMO2': '0.023', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'AMMO4': '0.114', 'weapon5': '0.412', 'WEAPON5': '0.550', 'WEAPON3': '0.550', 'weapon2': '0.708', 'weapon4': '0.792', 'weapon3': '1.474', 'HITCOUNT': '1.710', 'DAMAGECOUNT': '7.386', 'FRAGCOUNT': '20.000'} [2023-02-24 20:36:12,977][213382] DAMAGECOUNT value on done: 78094.0 [2023-02-24 20:36:12,977][213382] Sum rewards: 22.697, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.116', 'AMMO5': '0.025', 'AMMO2': '0.051', 'AMMO3': '0.145', 'AMMO4': '0.256', 'WEAPON4': '0.350', 'weapon2': '0.410', 'weapon5': '0.446', 'WEAPON5': '0.550', 'weapon4': '0.694', 'WEAPON3': '0.850', 'weapon3': '1.892', 'HITCOUNT': '1.900', 'DAMAGECOUNT': '8.994', 'FRAGCOUNT': '19.000'} [2023-02-24 20:36:13,200][213369] DAMAGECOUNT value on done: 78317.0 [2023-02-24 20:36:13,200][213369] Sum rewards: 22.716, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.994', 'AMMO2': '0.014', 'AMMO5': '0.016', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.138', 'weapon4': '0.156', 'weapon5': '0.206', 'WEAPON5': '0.350', 'weapon2': '0.612', 'WEAPON3': '1.000', 'HITCOUNT': '1.740', 'weapon3': '2.722', 'DAMAGECOUNT': '6.588', 'FRAGCOUNT': '20.000'} [2023-02-24 20:36:13,221][213368] DAMAGECOUNT value on done: 79148.0 [2023-02-24 20:36:13,222][213368] Sum rewards: 30.381, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.064', 'AMMO2': '0.015', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.073', 'AMMO3': '0.146', 'weapon4': '0.210', 'weapon5': '0.272', 'weapon2': '0.382', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '2.040', 'weapon3': '2.818', 'DAMAGECOUNT': '7.872', 'FRAGCOUNT': '25.000'} [2023-02-24 20:36:13,227][213384] DAMAGECOUNT value on done: 80515.0 [2023-02-24 20:36:13,227][213384] Sum rewards: 16.025, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.719', 'AMMO2': '0.018', 'AMMO5': '0.025', 'WEAPON1': '0.030', 'weapon4': '0.058', 'AMMO4': '0.088', 'AMMO3': '0.130', 'WEAPON4': '0.200', 'weapon2': '0.578', 'WEAPON5': '0.650', 'weapon5': '0.736', 'WEAPON3': '0.800', 'HITCOUNT': '1.200', 'weapon3': '2.128', 'DAMAGECOUNT': '5.853', 'FRAGCOUNT': '15.000'} [2023-02-24 20:36:13,506][213369] DAMAGECOUNT value on done: 68141.0 [2023-02-24 20:36:13,506][213369] Sum rewards: 17.349, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.635', 'AMMO2': '0.013', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO4': '0.063', 'AMMO3': '0.083', 'weapon4': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.500', 'weapon5': '0.594', 'WEAPON3': '0.600', 'weapon2': '0.874', 'HITCOUNT': '1.480', 'weapon3': '1.904', 'DAMAGECOUNT': '5.154', 'FRAGCOUNT': '14.000'} [2023-02-24 20:36:13,538][213384] DAMAGECOUNT value on done: 79969.0 [2023-02-24 20:36:13,538][213384] Sum rewards: 18.846, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.130', 'AMMO5': '0.024', 'AMMO2': '0.056', 'AMMO3': '0.205', 'AMMO4': '0.280', 'weapon5': '0.378', 'WEAPON4': '0.450', 'weapon2': '0.452', 'WEAPON5': '0.550', 'weapon4': '0.742', 'WEAPON3': '1.250', 'HITCOUNT': '1.840', 'weapon3': '2.054', 'DAMAGECOUNT': '7.194', 'FRAGCOUNT': '22.000'} [2023-02-24 20:36:14,114][213365] Updated weights for policy 0, policy_version 26716 (0.0009) [2023-02-24 20:36:15,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13858.2, 300 sec: 13662.6). Total num frames: 109441024. Throughput: 0: 3466.6. Samples: 2356622. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:36:15,243][213332] Avg episode reward: [(0, '23.822')] [2023-02-24 20:36:16,994][213365] Updated weights for policy 0, policy_version 26726 (0.0009) [2023-02-24 20:36:19,935][213365] Updated weights for policy 0, policy_version 26736 (0.0009) [2023-02-24 20:36:20,243][213332] Fps is (10 sec: 14336.0, 60 sec: 13926.4, 300 sec: 13676.5). Total num frames: 109514752. Throughput: 0: 3470.6. Samples: 2367154. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:36:20,243][213332] Avg episode reward: [(0, '23.822')] [2023-02-24 20:36:22,873][213365] Updated weights for policy 0, policy_version 26746 (0.0009) [2023-02-24 20:36:25,243][213332] Fps is (10 sec: 14335.9, 60 sec: 13926.4, 300 sec: 13676.5). Total num frames: 109584384. Throughput: 0: 3469.6. Samples: 2388036. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:36:25,243][213332] Avg episode reward: [(0, '23.822')] [2023-02-24 20:36:25,820][213365] Updated weights for policy 0, policy_version 26756 (0.0009) [2023-02-24 20:36:28,802][213365] Updated weights for policy 0, policy_version 26766 (0.0009) [2023-02-24 20:36:30,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13858.1, 300 sec: 13662.6). Total num frames: 109649920. Throughput: 0: 3470.8. Samples: 2408860. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:36:30,243][213332] Avg episode reward: [(0, '23.822')] [2023-02-24 20:36:30,827][213367] DAMAGECOUNT value on done: 77874.0 [2023-02-24 20:36:30,828][213367] Sum rewards: 17.039, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.840', 'AMMO5': '0.021', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'AMMO3': '0.083', 'weapon4': '0.142', 'AMMO4': '0.160', 'WEAPON4': '0.200', 'weapon2': '0.586', 'WEAPON3': '0.600', 'WEAPON5': '0.600', 'weapon5': '0.646', 'HITCOUNT': '1.050', 'weapon3': '2.270', 'DAMAGECOUNT': '5.460', 'FRAGCOUNT': '13.000'} [2023-02-24 20:36:30,935][213372] DAMAGECOUNT value on done: 79176.0 [2023-02-24 20:36:30,935][213372] Sum rewards: 15.782, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.635', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.028', 'AMMO3': '0.076', 'AMMO4': '0.138', 'weapon5': '0.302', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'WEAPON5': '0.550', 'weapon4': '0.604', 'weapon2': '1.010', 'HITCOUNT': '1.080', 'weapon3': '1.458', 'DAMAGECOUNT': '4.842', 'FRAGCOUNT': '14.000'} [2023-02-24 20:36:31,146][213367] DAMAGECOUNT value on done: 80345.0 [2023-02-24 20:36:31,147][213367] Sum rewards: 22.509, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.768', 'AMMO5': '0.021', 'AMMO2': '0.036', 'AMMO3': '0.100', 'AMMO4': '0.180', 'WEAPON4': '0.350', 'weapon5': '0.406', 'WEAPON5': '0.500', 'weapon4': '0.576', 'WEAPON3': '0.600', 'weapon2': '0.772', 'HITCOUNT': '1.720', 'weapon3': '1.796', 'DAMAGECOUNT': '6.969', 'FRAGCOUNT': '19.000'} [2023-02-24 20:36:31,243][213372] DAMAGECOUNT value on done: 79645.0 [2023-02-24 20:36:31,244][213372] Sum rewards: 22.724, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.881', 'AMMO5': '0.021', 'AMMO2': '0.042', 'AMMO3': '0.089', 'AMMO4': '0.208', 'weapon5': '0.376', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '0.550', 'weapon2': '0.800', 'weapon4': '0.828', 'weapon3': '1.448', 'HITCOUNT': '1.800', 'DAMAGECOUNT': '7.443', 'FRAGCOUNT': '19.000'} [2023-02-24 20:36:31,279][213383] DAMAGECOUNT value on done: 80347.0 [2023-02-24 20:36:31,280][213383] Sum rewards: 24.139, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.589', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.163', 'weapon5': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.450', 'weapon2': '0.810', 'WEAPON3': '1.000', 'HITCOUNT': '2.100', 'weapon3': '2.168', 'DAMAGECOUNT': '7.896', 'FRAGCOUNT': '23.000'} [2023-02-24 20:36:31,381][213366] DAMAGECOUNT value on done: 80169.0 [2023-02-24 20:36:31,382][213366] Sum rewards: 29.900, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.955', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.010', 'AMMO3': '0.080', 'weapon5': '0.374', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '1.160', 'weapon2': '1.244', 'weapon3': '1.906', 'DAMAGECOUNT': '5.934', 'FRAGCOUNT': '23.000'} [2023-02-24 20:36:31,453][213367] DAMAGECOUNT value on done: 77855.0 [2023-02-24 20:36:31,453][213367] Sum rewards: 29.172, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.726', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.029', 'AMMO4': '0.046', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'weapon4': '0.292', 'weapon5': '0.366', 'weapon2': '0.576', 'WEAPON5': '0.750', 'WEAPON3': '1.100', 'HITCOUNT': '2.030', 'weapon3': '2.358', 'DAMAGECOUNT': '9.225', 'FRAGCOUNT': '26.000'} [2023-02-24 20:36:31,540][213382] DAMAGECOUNT value on done: 77418.0 [2023-02-24 20:36:31,541][213382] Sum rewards: 24.861, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.196', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.047', 'AMMO3': '0.128', 'weapon5': '0.206', 'AMMO4': '0.233', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.616', 'WEAPON3': '0.750', 'weapon2': '0.988', 'weapon3': '1.788', 'HITCOUNT': '1.960', 'DAMAGECOUNT': '7.020', 'FRAGCOUNT': '23.500'} [2023-02-24 20:36:31,590][213383] DAMAGECOUNT value on done: 83237.0 [2023-02-24 20:36:31,590][213383] Sum rewards: 28.068, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.003', 'AMMO5': '0.015', 'AMMO4': '0.017', 'AMMO3': '0.052', 'HEALTH': '0.185', 'weapon5': '0.348', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'HITCOUNT': '1.000', 'weapon2': '1.736', 'weapon3': '1.744', 'DAMAGECOUNT': '6.018', 'FRAGCOUNT': '20.000'} [2023-02-24 20:36:31,686][213366] DAMAGECOUNT value on done: 83322.0 [2023-02-24 20:36:31,686][213366] Sum rewards: 33.483, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.780', 'AMMO2': '0.017', 'AMMO5': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'weapon4': '0.292', 'WEAPON5': '0.400', 'weapon5': '0.444', 'weapon2': '0.510', 'WEAPON3': '0.900', 'HITCOUNT': '1.910', 'weapon3': '2.426', 'DAMAGECOUNT': '8.715', 'FRAGCOUNT': '28.000'} [2023-02-24 20:36:31,746][213368] DAMAGECOUNT value on done: 74959.0 [2023-02-24 20:36:31,746][213368] Sum rewards: 20.624, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.709', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon7': '0.082', 'AMMO3': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.174', 'WEAPON7': '0.200', 'AMMO4': '0.236', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON4': '0.600', 'WEAPON3': '0.600', 'weapon4': '0.996', 'HITCOUNT': '1.800', 'weapon3': '1.848', 'DAMAGECOUNT': '6.873', 'FRAGCOUNT': '19.000'} [2023-02-24 20:36:31,755][213367] DAMAGECOUNT value on done: 76277.0 [2023-02-24 20:36:31,755][213367] Sum rewards: 19.928, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.032', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO2': '0.023', 'AMMO3': '0.112', 'AMMO4': '0.114', 'weapon4': '0.168', 'WEAPON4': '0.300', 'weapon5': '0.512', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'weapon2': '1.120', 'HITCOUNT': '1.230', 'weapon3': '1.782', 'DAMAGECOUNT': '5.958', 'FRAGCOUNT': '19.000'} [2023-02-24 20:36:31,756][213372] DAMAGECOUNT value on done: 81336.0 [2023-02-24 20:36:31,757][213372] Sum rewards: 29.567, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.936', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO4': '0.127', 'AMMO3': '0.146', 'WEAPON4': '0.250', 'weapon5': '0.380', 'WEAPON5': '0.450', 'weapon4': '0.518', 'weapon2': '0.588', 'WEAPON3': '0.900', 'HITCOUNT': '1.940', 'weapon3': '2.220', 'DAMAGECOUNT': '8.439', 'FRAGCOUNT': '25.000'} [2023-02-24 20:36:31,800][213369] DAMAGECOUNT value on done: 78927.0 [2023-02-24 20:36:31,800][213369] Sum rewards: 32.518, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.542', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.085', 'AMMO3': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon5': '0.386', 'weapon4': '0.494', 'weapon2': '0.520', 'WEAPON3': '0.600', 'HITCOUNT': '1.860', 'weapon3': '2.388', 'DAMAGECOUNT': '7.836', 'FRAGCOUNT': '25.000'} [2023-02-24 20:36:31,839][213382] DAMAGECOUNT value on done: 83134.0 [2023-02-24 20:36:31,839][213382] Sum rewards: 18.798, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.072', 'AMMO5': '0.021', 'AMMO2': '0.047', 'AMMO3': '0.137', 'AMMO4': '0.235', 'weapon4': '0.478', 'WEAPON4': '0.500', 'weapon5': '0.500', 'WEAPON5': '0.550', 'weapon2': '0.680', 'WEAPON3': '0.850', 'HITCOUNT': '1.450', 'weapon3': '1.854', 'DAMAGECOUNT': '6.567', 'FRAGCOUNT': '19.000'} [2023-02-24 20:36:31,887][213365] Updated weights for policy 0, policy_version 26776 (0.0009) [2023-02-24 20:36:32,058][213366] DAMAGECOUNT value on done: 81265.0 [2023-02-24 20:36:32,058][213366] Sum rewards: 19.666, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.688', 'AMMO5': '0.022', 'AMMO2': '0.034', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'weapon4': '0.160', 'AMMO4': '0.167', 'weapon5': '0.520', 'WEAPON5': '0.650', 'WEAPON3': '0.700', 'weapon2': '0.982', 'HITCOUNT': '1.440', 'weapon3': '2.006', 'DAMAGECOUNT': '5.916', 'FRAGCOUNT': '16.000'} [2023-02-24 20:36:32,062][213368] DAMAGECOUNT value on done: 81213.0 [2023-02-24 20:36:32,062][213368] Sum rewards: 16.860, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.045', 'AMMO2': '0.015', 'AMMO5': '0.023', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.164', 'weapon5': '0.384', 'weapon4': '0.416', 'WEAPON5': '0.550', 'weapon2': '0.686', 'WEAPON3': '1.050', 'HITCOUNT': '1.320', 'weapon3': '2.202', 'DAMAGECOUNT': '6.171', 'FRAGCOUNT': '17.000'} [2023-02-24 20:36:32,071][213372] DAMAGECOUNT value on done: 79162.0 [2023-02-24 20:36:32,071][213372] Sum rewards: 27.595, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.892', 'AMMO5': '0.016', 'AMMO2': '0.045', 'AMMO3': '0.148', 'AMMO4': '0.225', 'WEAPON4': '0.250', 'weapon5': '0.258', 'weapon4': '0.264', 'WEAPON5': '0.400', 'weapon2': '0.606', 'WEAPON3': '0.900', 'HITCOUNT': '1.610', 'weapon3': '2.588', 'DAMAGECOUNT': '6.927', 'FRAGCOUNT': '24.000'} [2023-02-24 20:36:32,105][213384] DAMAGECOUNT value on done: 78858.0 [2023-02-24 20:36:32,105][213384] Sum rewards: 19.445, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.761', 'AMMO5': '0.015', 'AMMO2': '0.017', 'weapon7': '0.048', 'AMMO4': '0.087', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.123', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.252', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON3': '0.800', 'weapon4': '0.806', 'HITCOUNT': '1.150', 'weapon3': '2.024', 'DAMAGECOUNT': '5.496', 'FRAGCOUNT': '18.000'} [2023-02-24 20:36:32,109][213369] DAMAGECOUNT value on done: 84826.0 [2023-02-24 20:36:32,109][213369] Sum rewards: 20.349, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.797', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO3': '0.145', 'AMMO4': '0.185', 'weapon5': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.492', 'weapon4': '0.656', 'WEAPON3': '0.900', 'HITCOUNT': '1.810', 'weapon3': '2.074', 'DAMAGECOUNT': '7.545', 'FRAGCOUNT': '20.000'} [2023-02-24 20:36:32,146][213383] DAMAGECOUNT value on done: 77135.0 [2023-02-24 20:36:32,147][213383] Sum rewards: 19.749, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.450', 'AMMO5': '0.022', 'AMMO2': '0.040', 'weapon7': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.126', 'AMMO3': '0.131', 'AMMO4': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.444', 'WEAPON5': '0.550', 'WEAPON4': '0.700', 'WEAPON3': '0.850', 'weapon4': '0.912', 'HITCOUNT': '1.930', 'weapon3': '2.096', 'DAMAGECOUNT': '7.458', 'FRAGCOUNT': '19.000'} [2023-02-24 20:36:32,163][213382] DAMAGECOUNT value on done: 78506.0 [2023-02-24 20:36:32,163][213382] Sum rewards: 22.700, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.865', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO2': '0.031', 'AMMO3': '0.110', 'AMMO4': '0.156', 'weapon4': '0.294', 'WEAPON4': '0.400', 'weapon2': '0.654', 'weapon5': '0.666', 'WEAPON3': '0.700', 'WEAPON5': '0.700', 'HITCOUNT': '1.220', 'weapon3': '1.834', 'DAMAGECOUNT': '6.501', 'FRAGCOUNT': '21.000'} [2023-02-24 20:36:32,351][213368] DAMAGECOUNT value on done: 81371.0 [2023-02-24 20:36:32,352][213368] Sum rewards: 27.874, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.368', 'AMMO2': '0.014', 'AMMO5': '0.027', 'AMMO4': '0.068', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'weapon4': '0.260', 'weapon5': '0.334', 'ARMOR': '0.400', 'weapon2': '0.460', 'WEAPON5': '0.650', 'WEAPON3': '0.900', 'HITCOUNT': '1.640', 'weapon3': '2.610', 'DAMAGECOUNT': '6.846', 'FRAGCOUNT': '23.000'} [2023-02-24 20:36:32,355][213366] DAMAGECOUNT value on done: 78030.0 [2023-02-24 20:36:32,356][213366] Sum rewards: 26.680, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.802', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon7': '0.054', 'weapon5': '0.078', 'AMMO4': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.266', 'weapon2': '0.934', 'WEAPON3': '1.100', 'HITCOUNT': '1.930', 'weapon3': '2.310', 'DAMAGECOUNT': '8.415', 'FRAGCOUNT': '24.000'} [2023-02-24 20:36:32,407][213384] DAMAGECOUNT value on done: 73653.0 [2023-02-24 20:36:32,407][213384] Sum rewards: 25.114, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.964', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON1': '0.030', 'AMMO5': '0.031', 'AMMO3': '0.137', 'WEAPON4': '0.200', 'weapon4': '0.250', 'weapon5': '0.384', 'WEAPON5': '0.750', 'weapon2': '0.804', 'WEAPON3': '0.900', 'HITCOUNT': '1.500', 'weapon3': '2.192', 'DAMAGECOUNT': '6.864', 'FRAGCOUNT': '22.000'} [2023-02-24 20:36:32,439][213383] DAMAGECOUNT value on done: 74619.0 [2023-02-24 20:36:32,440][213383] Sum rewards: 26.093, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.134', 'AMMO5': '0.035', 'AMMO2': '0.045', 'AMMO3': '0.169', 'AMMO4': '0.222', 'weapon2': '0.352', 'weapon5': '0.430', 'WEAPON4': '0.450', 'weapon4': '0.594', 'WEAPON5': '0.900', 'WEAPON3': '1.100', 'HITCOUNT': '1.580', 'weapon3': '2.122', 'DAMAGECOUNT': '8.478', 'FRAGCOUNT': '27.000'} [2023-02-24 20:36:32,456][213382] DAMAGECOUNT value on done: 80476.0 [2023-02-24 20:36:32,457][213382] Sum rewards: 25.146, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.462', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'weapon4': '0.070', 'AMMO3': '0.160', 'weapon5': '0.322', 'WEAPON5': '0.500', 'weapon2': '0.546', 'WEAPON3': '1.050', 'HITCOUNT': '1.760', 'weapon3': '2.688', 'DAMAGECOUNT': '7.146', 'FRAGCOUNT': '22.000'} [2023-02-24 20:36:32,614][213369] DAMAGECOUNT value on done: 79793.0 [2023-02-24 20:36:32,615][213369] Sum rewards: 19.316, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.137', 'AMMO5': '0.018', 'AMMO2': '0.033', 'AMMO3': '0.081', 'WEAPON4': '0.150', 'AMMO4': '0.164', 'weapon4': '0.316', 'weapon2': '0.536', 'WEAPON5': '0.550', 'weapon5': '0.586', 'WEAPON3': '0.600', 'HITCOUNT': '0.990', 'weapon3': '2.268', 'DAMAGECOUNT': '4.161', 'FRAGCOUNT': '16.000'} [2023-02-24 20:36:32,653][213368] DAMAGECOUNT value on done: 81680.0 [2023-02-24 20:36:32,654][213368] Sum rewards: 26.353, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.000', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO5': '0.026', 'AMMO4': '0.073', 'weapon4': '0.134', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'weapon5': '0.388', 'weapon2': '0.492', 'WEAPON5': '0.600', 'WEAPON3': '0.850', 'HITCOUNT': '1.760', 'weapon3': '2.618', 'DAMAGECOUNT': '7.596', 'FRAGCOUNT': '23.000'} [2023-02-24 20:36:32,685][213384] DAMAGECOUNT value on done: 82881.0 [2023-02-24 20:36:32,685][213384] Sum rewards: 26.368, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.628', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO5': '0.019', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'AMMO3': '0.146', 'weapon4': '0.216', 'WEAPON5': '0.400', 'weapon5': '0.410', 'weapon2': '0.812', 'WEAPON3': '0.850', 'HITCOUNT': '1.640', 'weapon3': '2.184', 'DAMAGECOUNT': '7.098', 'FRAGCOUNT': '22.000'} [2023-02-24 20:36:32,918][213369] DAMAGECOUNT value on done: 70216.0 [2023-02-24 20:36:32,918][213369] Sum rewards: 21.818, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.306', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.129', 'weapon2': '0.322', 'weapon5': '0.326', 'WEAPON4': '0.350', 'ARMOR': '0.408', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'weapon4': '0.812', 'HITCOUNT': '1.460', 'weapon3': '2.110', 'DAMAGECOUNT': '6.225', 'FRAGCOUNT': '20.000'} [2023-02-24 20:36:32,986][213384] DAMAGECOUNT value on done: 82359.0 [2023-02-24 20:36:32,986][213384] Sum rewards: 19.393, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.253', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'weapon5': '0.238', 'WEAPON4': '0.250', 'weapon4': '0.320', 'weapon2': '0.502', 'WEAPON3': '1.050', 'HITCOUNT': '1.740', 'weapon3': '2.598', 'DAMAGECOUNT': '7.170', 'FRAGCOUNT': '19.000'} [2023-02-24 20:36:34,343][213368] Large shaping reward 2.523 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.501, 167.0), ('weapon5', 0.002)] [2023-02-24 20:36:34,854][213365] Updated weights for policy 0, policy_version 26786 (0.0009) [2023-02-24 20:36:35,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13858.1, 300 sec: 13662.6). Total num frames: 109719552. Throughput: 0: 3460.6. Samples: 2418746. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:36:35,244][213332] Avg episode reward: [(0, '24.013')] [2023-02-24 20:36:38,046][213365] Updated weights for policy 0, policy_version 26796 (0.0009) [2023-02-24 20:36:40,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13789.9, 300 sec: 13648.7). Total num frames: 109785088. Throughput: 0: 3444.1. Samples: 2438704. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:36:40,243][213332] Avg episode reward: [(0, '24.013')] [2023-02-24 20:36:41,155][213365] Updated weights for policy 0, policy_version 26806 (0.0009) [2023-02-24 20:36:44,714][213365] Updated weights for policy 0, policy_version 26816 (0.0009) [2023-02-24 20:36:45,243][213332] Fps is (10 sec: 12288.0, 60 sec: 13585.1, 300 sec: 13607.0). Total num frames: 109842432. Throughput: 0: 3380.1. Samples: 2456782. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:36:45,243][213332] Avg episode reward: [(0, '24.013')] [2023-02-24 20:36:45,247][213352] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000026817_109842432.pth... [2023-02-24 20:36:45,309][213352] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000026023_106590208.pth [2023-02-24 20:36:45,747][213384] Large shaping reward 2.629 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.597, 199.0), ('weapon5', 0.002)] [2023-02-24 20:36:46,297][213367] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0)] [2023-02-24 20:36:47,837][213365] Updated weights for policy 0, policy_version 26826 (0.0009) [2023-02-24 20:36:50,243][213332] Fps is (10 sec: 12288.0, 60 sec: 13516.8, 300 sec: 13593.2). Total num frames: 109907968. Throughput: 0: 3365.8. Samples: 2466528. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 20:36:50,243][213332] Avg episode reward: [(0, '24.013')] [2023-02-24 20:36:50,957][213365] Updated weights for policy 0, policy_version 26836 (0.0009) [2023-02-24 20:36:51,583][213367] DAMAGECOUNT value on done: 80532.0 [2023-02-24 20:36:51,583][213367] Sum rewards: 26.799, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.895', 'AMMO2': '0.012', 'AMMO5': '0.024', 'AMMO4': '0.058', 'weapon4': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'weapon5': '0.328', 'WEAPON5': '0.600', 'weapon2': '0.760', 'WEAPON3': '1.050', 'HITCOUNT': '1.770', 'weapon3': '2.458', 'DAMAGECOUNT': '7.974', 'FRAGCOUNT': '24.500'} [2023-02-24 20:36:51,793][213372] DAMAGECOUNT value on done: 81587.0 [2023-02-24 20:36:51,794][213372] Sum rewards: 26.554, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.672', 'AMMO2': '0.009', 'AMMO5': '0.011', 'weapon4': '0.020', 'AMMO4': '0.042', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'weapon5': '0.312', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '1.630', 'weapon2': '1.700', 'weapon3': '1.778', 'DAMAGECOUNT': '7.233', 'FRAGCOUNT': '21.000'} [2023-02-24 20:36:51,889][213367] DAMAGECOUNT value on done: 81728.0 [2023-02-24 20:36:51,890][213367] Sum rewards: 11.896, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.235', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO3': '0.073', 'AMMO4': '0.074', 'weapon5': '0.122', 'weapon2': '0.144', 'weapon7': '0.218', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON7': '0.400', 'WEAPON3': '0.400', 'weapon3': '0.732', 'HITCOUNT': '0.840', 'weapon4': '1.468', 'DAMAGECOUNT': '4.149', 'FRAGCOUNT': '10.000'} [2023-02-24 20:36:52,098][213372] DAMAGECOUNT value on done: 81363.0 [2023-02-24 20:36:52,098][213372] Sum rewards: 16.184, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.085', 'AMMO2': '0.012', 'AMMO5': '0.012', 'weapon4': '0.056', 'AMMO4': '0.059', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'weapon5': '0.254', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '1.260', 'weapon3': '1.496', 'weapon2': '1.890', 'DAMAGECOUNT': '5.154', 'FRAGCOUNT': '12.000'} [2023-02-24 20:36:52,187][213367] DAMAGECOUNT value on done: 80254.0 [2023-02-24 20:36:52,187][213367] Sum rewards: 24.539, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.408', 'AMMO2': '0.018', 'AMMO5': '0.025', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon4': '0.200', 'weapon5': '0.382', 'weapon2': '0.476', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'HITCOUNT': '1.590', 'weapon3': '2.594', 'DAMAGECOUNT': '7.197', 'FRAGCOUNT': '22.000'} [2023-02-24 20:36:52,238][213383] DAMAGECOUNT value on done: 83098.0 [2023-02-24 20:36:52,239][213383] Sum rewards: 21.464, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.786', 'AMMO5': '0.022', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.201', 'weapon4': '0.204', 'WEAPON4': '0.250', 'weapon5': '0.322', 'WEAPON5': '0.500', 'weapon2': '0.720', 'WEAPON3': '1.150', 'HITCOUNT': '1.880', 'weapon3': '2.360', 'DAMAGECOUNT': '8.253', 'FRAGCOUNT': '20.000'} [2023-02-24 20:36:52,356][213366] DAMAGECOUNT value on done: 82543.0 [2023-02-24 20:36:52,356][213366] Sum rewards: 21.082, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.468', 'AMMO2': '0.005', 'AMMO5': '0.017', 'AMMO4': '0.025', 'AMMO3': '0.220', 'weapon5': '0.228', 'WEAPON5': '0.350', 'weapon2': '0.490', 'WEAPON3': '1.250', 'HITCOUNT': '1.580', 'weapon3': '2.512', 'DAMAGECOUNT': '7.122', 'FRAGCOUNT': '20.000'} [2023-02-24 20:36:52,481][213367] DAMAGECOUNT value on done: 78598.0 [2023-02-24 20:36:52,482][213367] Sum rewards: 23.549, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.682', 'AMMO5': '0.024', 'AMMO2': '0.041', 'AMMO3': '0.129', 'weapon5': '0.140', 'AMMO4': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon2': '0.800', 'weapon4': '0.888', 'HITCOUNT': '1.760', 'weapon3': '1.980', 'DAMAGECOUNT': '6.963', 'FRAGCOUNT': '21.000'} [2023-02-24 20:36:52,499][213382] DAMAGECOUNT value on done: 79475.0 [2023-02-24 20:36:52,499][213382] Sum rewards: 23.054, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.740', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'AMMO3': '0.116', 'AMMO4': '0.159', 'WEAPON4': '0.300', 'weapon5': '0.304', 'WEAPON5': '0.400', 'weapon4': '0.646', 'WEAPON3': '0.650', 'weapon2': '0.954', 'HITCOUNT': '1.530', 'weapon3': '1.752', 'DAMAGECOUNT': '6.156', 'FRAGCOUNT': '19.000'} [2023-02-24 20:36:52,543][213383] DAMAGECOUNT value on done: 85530.0 [2023-02-24 20:36:52,543][213383] Sum rewards: 24.680, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.495', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.079', 'AMMO4': '0.126', 'weapon4': '0.218', 'WEAPON4': '0.300', 'weapon5': '0.442', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'weapon2': '1.046', 'HITCOUNT': '1.610', 'weapon3': '1.962', 'DAMAGECOUNT': '6.879', 'FRAGCOUNT': '20.000'} [2023-02-24 20:36:52,600][213368] DAMAGECOUNT value on done: 78464.0 [2023-02-24 20:36:52,601][213368] Sum rewards: 32.217, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.505', 'ARMOR': '0.004', 'AMMO5': '0.042', 'AMMO2': '0.077', 'AMMO3': '0.100', 'weapon4': '0.250', 'AMMO4': '0.386', 'weapon5': '0.486', 'weapon2': '0.584', 'WEAPON4': '0.650', 'WEAPON3': '0.750', 'WEAPON5': '1.050', 'HITCOUNT': '1.630', 'weapon3': '2.198', 'DAMAGECOUNT': '10.515', 'FRAGCOUNT': '28.000'} [2023-02-24 20:36:52,618][213372] DAMAGECOUNT value on done: 85085.0 [2023-02-24 20:36:52,618][213372] Sum rewards: 41.515, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.705', 'AMMO5': '0.021', 'AMMO2': '0.038', 'AMMO3': '0.155', 'AMMO4': '0.189', 'weapon5': '0.240', 'weapon2': '0.338', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.506', 'WEAPON3': '0.950', 'HITCOUNT': '2.440', 'weapon3': '2.596', 'DAMAGECOUNT': '11.247', 'FRAGCOUNT': '37.000'} [2023-02-24 20:36:52,665][213366] DAMAGECOUNT value on done: 85781.0 [2023-02-24 20:36:52,666][213366] Sum rewards: 24.592, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.372', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.128', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.544', 'weapon4': '0.690', 'WEAPON3': '1.050', 'HITCOUNT': '1.800', 'weapon3': '2.346', 'DAMAGECOUNT': '7.377', 'FRAGCOUNT': '21.000'} [2023-02-24 20:36:52,736][213369] DAMAGECOUNT value on done: 81610.0 [2023-02-24 20:36:52,737][213369] Sum rewards: 26.434, reward structure: {'DEATHCOUNT': '-12.000', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.144', 'HEALTH': '0.180', 'WEAPON4': '0.250', 'weapon5': '0.312', 'weapon4': '0.372', 'weapon2': '0.384', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'HITCOUNT': '1.720', 'weapon3': '2.542', 'DAMAGECOUNT': '8.049', 'FRAGCOUNT': '23.000'} [2023-02-24 20:36:52,817][213382] DAMAGECOUNT value on done: 85710.0 [2023-02-24 20:36:52,818][213382] Sum rewards: 25.523, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.300', 'AMMO5': '0.017', 'AMMO2': '0.038', 'AMMO3': '0.116', 'AMMO4': '0.191', 'weapon5': '0.274', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.656', 'weapon4': '0.678', 'WEAPON3': '0.700', 'HITCOUNT': '1.990', 'weapon3': '2.084', 'DAMAGECOUNT': '7.728', 'FRAGCOUNT': '22.000'} [2023-02-24 20:36:52,929][213368] DAMAGECOUNT value on done: 83343.0 [2023-02-24 20:36:52,929][213368] Sum rewards: 24.705, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.805', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'weapon7': '0.056', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.122', 'weapon5': '0.126', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.354', 'weapon4': '0.644', 'WEAPON3': '0.750', 'HITCOUNT': '1.520', 'weapon3': '2.002', 'DAMAGECOUNT': '6.390', 'FRAGCOUNT': '21.000'} [2023-02-24 20:36:52,944][213372] DAMAGECOUNT value on done: 81159.0 [2023-02-24 20:36:52,944][213372] Sum rewards: 21.468, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.278', 'AMMO5': '0.019', 'AMMO2': '0.035', 'AMMO3': '0.081', 'weapon4': '0.120', 'AMMO4': '0.175', 'WEAPON4': '0.250', 'weapon5': '0.376', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon2': '1.004', 'HITCOUNT': '1.210', 'weapon3': '1.984', 'DAMAGECOUNT': '5.991', 'FRAGCOUNT': '18.000'} [2023-02-24 20:36:53,015][213384] DAMAGECOUNT value on done: 81768.0 [2023-02-24 20:36:53,015][213384] Sum rewards: 23.338, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.788', 'AMMO2': '0.012', 'AMMO5': '0.022', 'WEAPON4': '0.050', 'AMMO4': '0.060', 'weapon4': '0.110', 'AMMO3': '0.223', 'weapon5': '0.230', 'WEAPON5': '0.500', 'weapon2': '0.518', 'WEAPON3': '1.400', 'HITCOUNT': '2.090', 'weapon3': '2.680', 'DAMAGECOUNT': '8.730', 'FRAGCOUNT': '23.000'} [2023-02-24 20:36:53,043][213366] DAMAGECOUNT value on done: 83235.0 [2023-02-24 20:36:53,044][213366] Sum rewards: 22.647, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.218', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.078', 'AMMO3': '0.091', 'WEAPON4': '0.150', 'weapon5': '0.182', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'weapon4': '0.620', 'weapon2': '0.864', 'HITCOUNT': '1.340', 'weapon3': '1.464', 'DAMAGECOUNT': '5.700', 'FRAGCOUNT': '19.000'} [2023-02-24 20:36:53,062][213369] DAMAGECOUNT value on done: 86171.0 [2023-02-24 20:36:53,063][213369] Sum rewards: 18.297, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.695', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO3': '0.067', 'AMMO4': '0.139', 'WEAPON4': '0.200', 'weapon4': '0.272', 'WEAPON5': '0.350', 'weapon5': '0.430', 'WEAPON3': '0.450', 'weapon2': '0.814', 'HITCOUNT': '1.000', 'weapon3': '2.192', 'DAMAGECOUNT': '4.035', 'FRAGCOUNT': '15.000'} [2023-02-24 20:36:53,119][213383] DAMAGECOUNT value on done: 79335.0 [2023-02-24 20:36:53,119][213383] Sum rewards: 25.788, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.185', 'AMMO2': '0.011', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'AMMO4': '0.053', 'AMMO3': '0.133', 'weapon5': '0.336', 'WEAPON5': '0.500', 'weapon2': '0.510', 'WEAPON3': '0.800', 'HITCOUNT': '1.510', 'weapon3': '2.788', 'DAMAGECOUNT': '6.522', 'FRAGCOUNT': '21.000'} [2023-02-24 20:36:53,138][213382] DAMAGECOUNT value on done: 80853.0 [2023-02-24 20:36:53,139][213382] Sum rewards: 27.912, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.220', 'AMMO5': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.084', 'AMMO4': '0.119', 'WEAPON4': '0.250', 'weapon4': '0.318', 'weapon5': '0.320', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'weapon2': '0.874', 'HITCOUNT': '1.570', 'weapon3': '2.212', 'DAMAGECOUNT': '7.041', 'FRAGCOUNT': '21.000'} [2023-02-24 20:36:53,214][213368] DAMAGECOUNT value on done: 83226.0 [2023-02-24 20:36:53,214][213368] Sum rewards: 22.692, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.615', 'AMMO2': '0.016', 'AMMO5': '0.018', 'AMMO3': '0.070', 'AMMO4': '0.078', 'WEAPON4': '0.300', 'weapon5': '0.420', 'WEAPON5': '0.550', 'WEAPON3': '0.550', 'weapon4': '0.574', 'weapon2': '1.010', 'HITCOUNT': '1.330', 'weapon3': '1.576', 'DAMAGECOUNT': '5.565', 'FRAGCOUNT': '19.000'} [2023-02-24 20:36:53,319][213384] DAMAGECOUNT value on done: 75860.0 [2023-02-24 20:36:53,320][213384] Sum rewards: 22.412, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.840', 'ARMOR': '0.004', 'AMMO2': '0.012', 'AMMO5': '0.014', 'AMMO4': '0.059', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.117', 'weapon7': '0.128', 'WEAPON4': '0.250', 'weapon5': '0.270', 'weapon2': '0.378', 'WEAPON5': '0.450', 'weapon4': '0.764', 'WEAPON3': '0.800', 'HITCOUNT': '1.380', 'weapon3': '1.592', 'DAMAGECOUNT': '6.234', 'FRAGCOUNT': '19.000'} [2023-02-24 20:36:53,348][213366] DAMAGECOUNT value on done: 80107.0 [2023-02-24 20:36:53,349][213366] Sum rewards: 24.553, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '0.002', 'AMMO2': '0.023', 'AMMO5': '0.026', 'AMMO3': '0.106', 'AMMO4': '0.113', 'WEAPON4': '0.200', 'weapon4': '0.358', 'weapon5': '0.466', 'WEAPON3': '0.600', 'WEAPON5': '0.600', 'weapon2': '0.760', 'HITCOUNT': '1.300', 'weapon3': '2.018', 'DAMAGECOUNT': '6.231', 'FRAGCOUNT': '20.000'} [2023-02-24 20:36:53,409][213383] DAMAGECOUNT value on done: 76821.0 [2023-02-24 20:36:53,410][213383] Sum rewards: 22.480, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.152', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO5': '0.031', 'weapon4': '0.058', 'AMMO4': '0.125', 'AMMO3': '0.151', 'WEAPON4': '0.250', 'weapon5': '0.378', 'weapon2': '0.396', 'WEAPON5': '0.750', 'WEAPON3': '1.000', 'HITCOUNT': '1.570', 'weapon3': '2.768', 'DAMAGECOUNT': '6.606', 'FRAGCOUNT': '21.000'} [2023-02-24 20:36:53,436][213382] DAMAGECOUNT value on done: 82731.0 [2023-02-24 20:36:53,436][213382] Sum rewards: 22.934, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.904', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon7': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.134', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.228', 'weapon4': '0.236', 'WEAPON5': '0.250', 'weapon2': '0.508', 'WEAPON3': '1.150', 'HITCOUNT': '1.540', 'weapon3': '2.592', 'DAMAGECOUNT': '6.765', 'FRAGCOUNT': '22.000'} [2023-02-24 20:36:53,516][213368] DAMAGECOUNT value on done: 84004.0 [2023-02-24 20:36:53,516][213368] Sum rewards: 25.364, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.405', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO3': '0.080', 'AMMO4': '0.170', 'weapon5': '0.212', 'weapon2': '0.282', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.475', 'WEAPON3': '0.500', 'weapon4': '1.114', 'weapon3': '1.726', 'HITCOUNT': '1.790', 'DAMAGECOUNT': '6.972', 'FRAGCOUNT': '20.000'} [2023-02-24 20:36:53,564][213369] DAMAGECOUNT value on done: 82026.0 [2023-02-24 20:36:53,565][213369] Sum rewards: 23.935, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.840', 'AMMO2': '0.007', 'AMMO5': '0.017', 'AMMO4': '0.034', 'AMMO3': '0.086', 'weapon5': '0.276', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '0.550', 'weapon2': '0.780', 'weapon4': '1.206', 'weapon3': '1.206', 'HITCOUNT': '1.720', 'DAMAGECOUNT': '6.693', 'FRAGCOUNT': '19.000'} [2023-02-24 20:36:53,619][213384] DAMAGECOUNT value on done: 84499.0 [2023-02-24 20:36:53,620][213384] Sum rewards: 14.081, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.336', 'AMMO2': '0.012', 'AMMO5': '0.017', 'AMMO4': '0.058', 'weapon7': '0.066', 'weapon4': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'WEAPON7': '0.200', 'weapon5': '0.262', 'WEAPON5': '0.450', 'weapon2': '0.956', 'HITCOUNT': '1.060', 'WEAPON3': '1.100', 'weapon3': '2.246', 'DAMAGECOUNT': '4.854', 'FRAGCOUNT': '15.000'} [2023-02-24 20:36:53,995][213369] DAMAGECOUNT value on done: 72468.0 [2023-02-24 20:36:53,996][213369] Sum rewards: 23.821, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.734', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.012', 'AMMO4': '0.062', 'AMMO3': '0.079', 'WEAPON4': '0.150', 'weapon5': '0.204', 'WEAPON5': '0.350', 'WEAPON3': '0.500', 'weapon4': '0.500', 'weapon2': '1.442', 'HITCOUNT': '1.610', 'weapon3': '1.624', 'DAMAGECOUNT': '6.756', 'FRAGCOUNT': '18.000'} [2023-02-24 20:36:54,057][213384] DAMAGECOUNT value on done: 84341.0 [2023-02-24 20:36:54,058][213384] Sum rewards: 14.846, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.154', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.041', 'AMMO3': '0.175', 'AMMO4': '0.204', 'weapon5': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.510', 'weapon2': '0.578', 'WEAPON3': '1.000', 'HITCOUNT': '1.450', 'weapon3': '2.238', 'DAMAGECOUNT': '5.946', 'FRAGCOUNT': '16.000'} [2023-02-24 20:36:54,072][213382] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0)] [2023-02-24 20:36:54,163][213365] Updated weights for policy 0, policy_version 26846 (0.0009) [2023-02-24 20:36:55,243][213332] Fps is (10 sec: 12697.5, 60 sec: 13380.3, 300 sec: 13565.4). Total num frames: 109969408. Throughput: 0: 3341.6. Samples: 2486256. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 20:36:55,243][213332] Avg episode reward: [(0, '23.684')] [2023-02-24 20:36:57,738][213365] Updated weights for policy 0, policy_version 26856 (0.0013) [2023-02-24 20:37:00,243][213332] Fps is (10 sec: 12288.0, 60 sec: 13243.7, 300 sec: 13537.6). Total num frames: 110030848. Throughput: 0: 3279.5. Samples: 2504200. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 20:37:00,243][213332] Avg episode reward: [(0, '23.684')] [2023-02-24 20:37:00,327][213372] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 20:37:00,882][213365] Updated weights for policy 0, policy_version 26866 (0.0009) [2023-02-24 20:37:03,945][213365] Updated weights for policy 0, policy_version 26876 (0.0009) [2023-02-24 20:37:05,243][213332] Fps is (10 sec: 13107.2, 60 sec: 13243.7, 300 sec: 13551.5). Total num frames: 110100480. Throughput: 0: 3264.9. Samples: 2514074. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 20:37:05,243][213332] Avg episode reward: [(0, '23.684')] [2023-02-24 20:37:07,001][213365] Updated weights for policy 0, policy_version 26886 (0.0009) [2023-02-24 20:37:10,039][213365] Updated weights for policy 0, policy_version 26896 (0.0009) [2023-02-24 20:37:10,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13243.7, 300 sec: 13537.6). Total num frames: 110166016. Throughput: 0: 3248.4. Samples: 2534214. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:37:10,244][213332] Avg episode reward: [(0, '23.684')] [2023-02-24 20:37:12,259][213367] DAMAGECOUNT value on done: 82231.0 [2023-02-24 20:37:12,259][213367] Sum rewards: 9.197, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.462', 'AMMO5': '0.022', 'AMMO2': '0.053', 'AMMO3': '0.132', 'AMMO4': '0.264', 'weapon5': '0.284', 'WEAPON5': '0.500', 'weapon2': '0.580', 'WEAPON4': '0.650', 'WEAPON3': '0.750', 'HITCOUNT': '1.130', 'weapon4': '1.148', 'weapon3': '1.548', 'DAMAGECOUNT': '5.097', 'FRAGCOUNT': '13.000'} [2023-02-24 20:37:12,527][213372] DAMAGECOUNT value on done: 84170.0 [2023-02-24 20:37:12,528][213372] Sum rewards: 30.251, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.019', 'AMMO5': '0.017', 'AMMO2': '0.029', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'AMMO4': '0.145', 'weapon5': '0.232', 'WEAPON5': '0.350', 'weapon4': '0.382', 'WEAPON3': '0.800', 'weapon2': '0.890', 'HITCOUNT': '1.700', 'weapon3': '2.264', 'DAMAGECOUNT': '7.749', 'FRAGCOUNT': '24.000'} [2023-02-24 20:37:12,560][213367] DAMAGECOUNT value on done: 84704.0 [2023-02-24 20:37:12,561][213367] Sum rewards: 22.119, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.519', 'AMMO5': '0.022', 'AMMO2': '0.030', 'AMMO4': '0.149', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'weapon5': '0.306', 'weapon4': '0.352', 'WEAPON5': '0.500', 'weapon2': '0.884', 'WEAPON3': '1.150', 'HITCOUNT': '1.900', 'weapon3': '2.170', 'DAMAGECOUNT': '8.928', 'FRAGCOUNT': '22.500'} [2023-02-24 20:37:12,825][213372] DAMAGECOUNT value on done: 84038.0 [2023-02-24 20:37:12,826][213372] Sum rewards: 28.680, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.365', 'AMMO5': '0.021', 'AMMO2': '0.032', 'WEAPON1': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.158', 'AMMO3': '0.189', 'weapon4': '0.276', 'weapon5': '0.336', 'weapon2': '0.380', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '1.580', 'weapon3': '2.472', 'DAMAGECOUNT': '8.001', 'FRAGCOUNT': '26.000'} [2023-02-24 20:37:12,847][213367] DAMAGECOUNT value on done: 82743.0 [2023-02-24 20:37:12,848][213367] Sum rewards: 28.574, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.239', 'AMMO2': '0.002', 'AMMO4': '0.008', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO3': '0.120', 'WEAPON4': '0.200', 'weapon4': '0.362', 'weapon5': '0.420', 'weapon2': '0.464', 'WEAPON5': '0.650', 'WEAPON3': '0.850', 'HITCOUNT': '1.530', 'weapon3': '2.312', 'DAMAGECOUNT': '7.353', 'FRAGCOUNT': '24.000'} [2023-02-24 20:37:12,955][213383] DAMAGECOUNT value on done: 85289.0 [2023-02-24 20:37:12,955][213383] Sum rewards: 20.621, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.330', 'AMMO5': '0.023', 'AMMO2': '0.024', 'WEAPON4': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.160', 'weapon5': '0.294', 'weapon2': '0.498', 'weapon4': '0.608', 'WEAPON5': '0.650', 'WEAPON3': '1.050', 'HITCOUNT': '1.310', 'weapon3': '2.292', 'DAMAGECOUNT': '6.573', 'FRAGCOUNT': '19.000'} [2023-02-24 20:37:12,976][213366] DAMAGECOUNT value on done: 84497.0 [2023-02-24 20:37:12,976][213366] Sum rewards: 23.546, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.825', 'AMMO5': '0.022', 'AMMO2': '0.033', 'weapon7': '0.070', 'AMMO3': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.165', 'WEAPON4': '0.300', 'weapon5': '0.328', 'weapon2': '0.546', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'weapon4': '0.826', 'HITCOUNT': '1.230', 'weapon3': '1.894', 'DAMAGECOUNT': '5.862', 'FRAGCOUNT': '20.000'} [2023-02-24 20:37:13,059][213365] Updated weights for policy 0, policy_version 26906 (0.0009) [2023-02-24 20:37:13,142][213367] DAMAGECOUNT value on done: 82086.0 [2023-02-24 20:37:13,143][213367] Sum rewards: 41.277, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.680', 'AMMO2': '0.012', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.146', 'weapon5': '0.204', 'weapon4': '0.224', 'WEAPON5': '0.400', 'weapon2': '0.496', 'WEAPON3': '1.000', 'HITCOUNT': '2.370', 'weapon3': '2.700', 'DAMAGECOUNT': '10.464', 'FRAGCOUNT': '33.000'} [2023-02-24 20:37:13,226][213382] DAMAGECOUNT value on done: 81791.0 [2023-02-24 20:37:13,226][213382] Sum rewards: 30.444, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.288', 'AMMO2': '0.013', 'AMMO5': '0.015', 'AMMO4': '0.063', 'AMMO3': '0.103', 'WEAPON4': '0.150', 'weapon4': '0.330', 'weapon5': '0.388', 'ARMOR': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'weapon2': '0.818', 'HITCOUNT': '1.270', 'weapon3': '1.742', 'DAMAGECOUNT': '6.939', 'FRAGCOUNT': '25.000'} [2023-02-24 20:37:13,261][213383] DAMAGECOUNT value on done: 88286.0 [2023-02-24 20:37:13,261][213383] Sum rewards: 26.319, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.437', 'AMMO2': '0.009', 'AMMO5': '0.023', 'AMMO4': '0.045', 'AMMO3': '0.201', 'weapon5': '0.320', 'weapon2': '0.454', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'HITCOUNT': '1.760', 'weapon3': '2.826', 'DAMAGECOUNT': '8.268', 'FRAGCOUNT': '24.000'} [2023-02-24 20:37:13,271][213366] DAMAGECOUNT value on done: 88631.0 [2023-02-24 20:37:13,272][213366] Sum rewards: 23.716, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.076', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon5': '0.144', 'AMMO3': '0.165', 'AMMO4': '0.248', 'WEAPON5': '0.400', 'weapon2': '0.404', 'WEAPON4': '0.550', 'weapon4': '0.626', 'WEAPON3': '1.000', 'HITCOUNT': '1.940', 'weapon3': '2.448', 'DAMAGECOUNT': '8.550', 'FRAGCOUNT': '25.000'} [2023-02-24 20:37:13,299][213368] DAMAGECOUNT value on done: 80752.0 [2023-02-24 20:37:13,300][213368] Sum rewards: 21.748, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.922', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.042', 'AMMO3': '0.108', 'AMMO4': '0.208', 'WEAPON4': '0.350', 'weapon2': '0.368', 'weapon5': '0.382', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'weapon4': '0.712', 'HITCOUNT': '1.500', 'weapon3': '1.996', 'DAMAGECOUNT': '6.864', 'FRAGCOUNT': '18.000'} [2023-02-24 20:37:13,338][213372] DAMAGECOUNT value on done: 87172.0 [2023-02-24 20:37:13,339][213372] Sum rewards: 26.438, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.980', 'AMMO2': '0.011', 'AMMO5': '0.016', 'weapon7': '0.052', 'AMMO4': '0.053', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'weapon5': '0.226', 'weapon4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.638', 'WEAPON3': '0.750', 'HITCOUNT': '1.280', 'weapon3': '2.424', 'DAMAGECOUNT': '6.261', 'FRAGCOUNT': '22.000'} [2023-02-24 20:37:13,460][213369] DAMAGECOUNT value on done: 84144.0 [2023-02-24 20:37:13,461][213369] Sum rewards: 23.845, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.631', 'AMMO2': '0.022', 'AMMO5': '0.024', 'AMMO4': '0.112', 'weapon4': '0.142', 'AMMO3': '0.143', 'WEAPON4': '0.200', 'weapon5': '0.266', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'weapon2': '0.868', 'HITCOUNT': '1.690', 'weapon3': '2.306', 'DAMAGECOUNT': '7.602', 'FRAGCOUNT': '21.000'} [2023-02-24 20:37:13,521][213382] DAMAGECOUNT value on done: 87887.0 [2023-02-24 20:37:13,521][213382] Sum rewards: 18.848, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.698', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.043', 'AMMO3': '0.132', 'AMMO4': '0.214', 'weapon4': '0.296', 'WEAPON4': '0.400', 'weapon5': '0.468', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon2': '0.860', 'HITCOUNT': '1.460', 'weapon3': '1.860', 'DAMAGECOUNT': '6.531', 'FRAGCOUNT': '18.000'} [2023-02-24 20:37:13,603][213368] DAMAGECOUNT value on done: 86107.0 [2023-02-24 20:37:13,604][213368] Sum rewards: 31.130, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.713', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.116', 'WEAPON4': '0.200', 'weapon5': '0.286', 'WEAPON5': '0.350', 'weapon4': '0.442', 'weapon2': '0.626', 'WEAPON3': '0.750', 'HITCOUNT': '2.020', 'weapon3': '2.436', 'DAMAGECOUNT': '8.292', 'FRAGCOUNT': '26.000'} [2023-02-24 20:37:13,636][213372] DAMAGECOUNT value on done: 83124.0 [2023-02-24 20:37:13,637][213372] Sum rewards: 16.781, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.164', 'AMMO5': '0.022', 'AMMO2': '0.049', 'AMMO3': '0.102', 'AMMO4': '0.243', 'weapon2': '0.376', 'weapon5': '0.384', 'WEAPON4': '0.550', 'weapon4': '0.610', 'WEAPON5': '0.650', 'WEAPON3': '0.700', 'HITCOUNT': '1.200', 'weapon3': '2.164', 'DAMAGECOUNT': '5.895', 'FRAGCOUNT': '15.000'} [2023-02-24 20:37:13,639][213366] DAMAGECOUNT value on done: 85628.0 [2023-02-24 20:37:13,640][213366] Sum rewards: 26.470, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.411', 'AMMO5': '0.014', 'AMMO2': '0.037', 'AMMO3': '0.085', 'AMMO4': '0.184', 'weapon5': '0.256', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.760', 'weapon2': '0.870', 'weapon3': '1.726', 'HITCOUNT': '1.820', 'DAMAGECOUNT': '7.179', 'FRAGCOUNT': '21.000'} [2023-02-24 20:37:13,701][213384] DAMAGECOUNT value on done: 84499.0 [2023-02-24 20:37:13,701][213384] Sum rewards: 25.103, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.938', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO4': '0.149', 'AMMO3': '0.163', 'weapon4': '0.204', 'weapon5': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.534', 'WEAPON3': '0.950', 'HITCOUNT': '1.800', 'weapon3': '2.666', 'DAMAGECOUNT': '8.193', 'FRAGCOUNT': '23.000'} [2023-02-24 20:37:13,765][213383] DAMAGECOUNT value on done: 81294.0 [2023-02-24 20:37:13,765][213383] Sum rewards: 20.219, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.370', 'AMMO5': '0.017', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.110', 'weapon5': '0.240', 'WEAPON4': '0.250', 'weapon4': '0.352', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'weapon2': '0.868', 'HITCOUNT': '1.550', 'weapon3': '2.100', 'DAMAGECOUNT': '5.877', 'FRAGCOUNT': '18.000'} [2023-02-24 20:37:13,775][213369] DAMAGECOUNT value on done: 88900.0 [2023-02-24 20:37:13,776][213369] Sum rewards: 26.600, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.308', 'AMMO2': '0.012', 'AMMO5': '0.015', 'AMMO3': '0.060', 'AMMO4': '0.061', 'WEAPON4': '0.200', 'weapon4': '0.310', 'weapon5': '0.430', 'WEAPON3': '0.500', 'WEAPON5': '0.550', 'weapon2': '0.848', 'HITCOUNT': '1.500', 'weapon3': '2.072', 'DAMAGECOUNT': '7.599', 'FRAGCOUNT': '19.000'} [2023-02-24 20:37:13,843][213382] DAMAGECOUNT value on done: 82929.0 [2023-02-24 20:37:13,843][213382] Sum rewards: 21.386, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.493', 'AMMO2': '0.018', 'AMMO5': '0.023', 'AMMO4': '0.090', 'AMMO3': '0.151', 'WEAPON4': '0.250', 'weapon5': '0.366', 'weapon2': '0.446', 'WEAPON5': '0.650', 'weapon4': '0.820', 'WEAPON3': '0.950', 'HITCOUNT': '1.610', 'weapon3': '2.026', 'DAMAGECOUNT': '6.228', 'FRAGCOUNT': '21.500'} [2023-02-24 20:37:13,903][213368] DAMAGECOUNT value on done: 86138.0 [2023-02-24 20:37:13,903][213368] Sum rewards: 34.879, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.280', 'AMMO2': '0.014', 'AMMO5': '0.017', 'AMMO4': '0.068', 'AMMO3': '0.078', 'WEAPON4': '0.200', 'weapon5': '0.298', 'weapon4': '0.360', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon2': '1.256', 'HITCOUNT': '1.660', 'weapon3': '1.772', 'DAMAGECOUNT': '8.736', 'FRAGCOUNT': '28.000'} [2023-02-24 20:37:13,930][213366] DAMAGECOUNT value on done: 82732.0 [2023-02-24 20:37:13,931][213366] Sum rewards: 28.841, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.777', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO3': '0.148', 'AMMO4': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.222', 'WEAPON5': '0.350', 'weapon5': '0.380', 'weapon2': '0.522', 'WEAPON3': '0.900', 'HITCOUNT': '1.810', 'weapon3': '2.494', 'DAMAGECOUNT': '7.875', 'FRAGCOUNT': '25.000'} [2023-02-24 20:37:13,995][213384] DAMAGECOUNT value on done: 78167.0 [2023-02-24 20:37:13,996][213384] Sum rewards: 20.349, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.580', 'AMMO5': '0.026', 'AMMO2': '0.032', 'AMMO3': '0.099', 'AMMO4': '0.162', 'WEAPON4': '0.300', 'weapon2': '0.388', 'weapon5': '0.404', 'weapon4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '0.700', 'HITCOUNT': '1.440', 'weapon3': '2.206', 'DAMAGECOUNT': '6.921', 'FRAGCOUNT': '17.000'} [2023-02-24 20:37:14,063][213383] DAMAGECOUNT value on done: 79248.0 [2023-02-24 20:37:14,063][213383] Sum rewards: 25.556, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.790', 'AMMO2': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.048', 'AMMO3': '0.110', 'WEAPON4': '0.200', 'weapon5': '0.308', 'weapon2': '0.366', 'WEAPON5': '0.400', 'weapon4': '0.692', 'WEAPON3': '0.750', 'HITCOUNT': '1.740', 'weapon3': '1.928', 'DAMAGECOUNT': '7.281', 'FRAGCOUNT': '20.000'} [2023-02-24 20:37:14,139][213382] DAMAGECOUNT value on done: 84685.0 [2023-02-24 20:37:14,139][213382] Sum rewards: 23.000, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.440', 'AMMO5': '0.014', 'AMMO2': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.149', 'WEAPON5': '0.350', 'weapon5': '0.386', 'weapon2': '0.568', 'WEAPON3': '0.850', 'HITCOUNT': '1.330', 'weapon3': '2.842', 'DAMAGECOUNT': '5.862', 'FRAGCOUNT': '20.000'} [2023-02-24 20:37:14,202][213368] DAMAGECOUNT value on done: 85729.0 [2023-02-24 20:37:14,203][213368] Sum rewards: 16.282, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.110', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'WEAPON4': '0.100', 'weapon4': '0.112', 'AMMO3': '0.152', 'weapon5': '0.290', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'weapon2': '1.168', 'HITCOUNT': '1.300', 'weapon3': '1.936', 'DAMAGECOUNT': '5.175', 'FRAGCOUNT': '15.000'} [2023-02-24 20:37:14,279][213369] DAMAGECOUNT value on done: 84881.0 [2023-02-24 20:37:14,279][213384] DAMAGECOUNT value on done: 87139.0 [2023-02-24 20:37:14,279][213369] Sum rewards: 27.138, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.550', 'AMMO2': '0.023', 'AMMO5': '0.026', 'weapon4': '0.100', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon5': '0.298', 'weapon2': '0.550', 'WEAPON5': '0.700', 'WEAPON3': '1.400', 'HITCOUNT': '2.080', 'weapon3': '2.664', 'DAMAGECOUNT': '8.565', 'FRAGCOUNT': '28.000'} [2023-02-24 20:37:14,279][213384] Sum rewards: 24.230, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.753', 'WEAPON1': '0.010', 'AMMO5': '0.030', 'AMMO2': '0.035', 'AMMO3': '0.136', 'AMMO4': '0.176', 'weapon4': '0.324', 'weapon5': '0.326', 'WEAPON4': '0.350', 'weapon2': '0.562', 'WEAPON5': '0.750', 'WEAPON3': '0.850', 'HITCOUNT': '1.580', 'weapon3': '2.434', 'DAMAGECOUNT': '7.920', 'FRAGCOUNT': '21.000'} [2023-02-24 20:37:14,566][213384] DAMAGECOUNT value on done: 86655.0 [2023-02-24 20:37:14,566][213384] Sum rewards: 26.033, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.475', 'AMMO2': '0.019', 'AMMO5': '0.022', 'AMMO4': '0.096', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'weapon5': '0.308', 'weapon4': '0.322', 'ARMOR': '0.461', 'WEAPON5': '0.550', 'weapon2': '0.592', 'WEAPON3': '0.850', 'HITCOUNT': '1.550', 'weapon3': '2.010', 'DAMAGECOUNT': '6.942', 'FRAGCOUNT': '22.500'} [2023-02-24 20:37:14,578][213369] DAMAGECOUNT value on done: 75082.0 [2023-02-24 20:37:14,579][213369] Sum rewards: 19.902, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.506', 'AMMO5': '0.019', 'AMMO2': '0.019', 'AMMO4': '0.095', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon4': '0.286', 'weapon5': '0.298', 'weapon2': '0.300', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '1.760', 'weapon3': '2.762', 'DAMAGECOUNT': '7.842', 'FRAGCOUNT': '21.000'} [2023-02-24 20:37:15,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13243.7, 300 sec: 13537.6). Total num frames: 110235648. Throughput: 0: 3237.9. Samples: 2554566. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:37:15,243][213332] Avg episode reward: [(0, '23.831')] [2023-02-24 20:37:16,015][213365] Updated weights for policy 0, policy_version 26916 (0.0009) [2023-02-24 20:37:18,930][213365] Updated weights for policy 0, policy_version 26926 (0.0009) [2023-02-24 20:37:20,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13175.5, 300 sec: 13537.6). Total num frames: 110305280. Throughput: 0: 3252.4. Samples: 2565106. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:37:20,243][213332] Avg episode reward: [(0, '23.831')] [2023-02-24 20:37:21,914][213365] Updated weights for policy 0, policy_version 26936 (0.0009) [2023-02-24 20:37:24,155][213372] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 20:37:24,905][213365] Updated weights for policy 0, policy_version 26946 (0.0009) [2023-02-24 20:37:25,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13175.5, 300 sec: 13537.6). Total num frames: 110374912. Throughput: 0: 3267.8. Samples: 2585754. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 20:37:25,243][213332] Avg episode reward: [(0, '23.831')] [2023-02-24 20:37:27,069][213367] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 20:37:27,874][213365] Updated weights for policy 0, policy_version 26956 (0.0009) [2023-02-24 20:37:30,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13175.5, 300 sec: 13523.7). Total num frames: 110440448. Throughput: 0: 3326.1. Samples: 2606458. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 20:37:30,243][213332] Avg episode reward: [(0, '23.831')] [2023-02-24 20:37:30,836][213365] Updated weights for policy 0, policy_version 26966 (0.0009) [2023-02-24 20:37:31,738][213367] DAMAGECOUNT value on done: 83993.0 [2023-02-24 20:37:31,738][213367] Sum rewards: 16.389, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.019', 'AMMO2': '0.060', 'AMMO3': '0.080', 'HEALTH': '0.208', 'AMMO4': '0.301', 'weapon5': '0.328', 'WEAPON5': '0.400', 'WEAPON3': '0.400', 'WEAPON4': '0.550', 'weapon2': '0.924', 'weapon4': '0.958', 'weapon3': '1.284', 'HITCOUNT': '1.340', 'DAMAGECOUNT': '5.286', 'FRAGCOUNT': '14.000'} [2023-02-24 20:37:32,040][213367] DAMAGECOUNT value on done: 87796.0 [2023-02-24 20:37:32,040][213367] Sum rewards: 34.212, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.896', 'AMMO5': '0.010', 'AMMO2': '0.030', 'WEAPON4': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.171', 'weapon5': '0.234', 'WEAPON5': '0.250', 'weapon2': '0.420', 'weapon4': '0.542', 'WEAPON3': '1.050', 'HITCOUNT': '2.260', 'weapon3': '2.564', 'DAMAGECOUNT': '9.276', 'FRAGCOUNT': '30.000'} [2023-02-24 20:37:32,065][213372] DAMAGECOUNT value on done: 86733.0 [2023-02-24 20:37:32,065][213372] Sum rewards: 28.722, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.007', 'ARMOR': '0.004', 'AMMO2': '0.020', 'AMMO5': '0.023', 'AMMO3': '0.087', 'AMMO4': '0.098', 'WEAPON4': '0.250', 'weapon4': '0.366', 'weapon5': '0.430', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'weapon2': '0.692', 'HITCOUNT': '1.600', 'weapon3': '2.020', 'DAMAGECOUNT': '7.689', 'FRAGCOUNT': '25.000'} [2023-02-24 20:37:32,334][213367] DAMAGECOUNT value on done: 84125.0 [2023-02-24 20:37:32,334][213367] Sum rewards: 14.124, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.216', 'AMMO2': '0.011', 'AMMO5': '0.015', 'AMMO4': '0.053', 'AMMO3': '0.086', 'weapon4': '0.190', 'WEAPON4': '0.250', 'weapon5': '0.278', 'WEAPON5': '0.300', 'ARMOR': '0.481', 'WEAPON3': '0.600', 'weapon2': '0.938', 'HITCOUNT': '0.940', 'weapon3': '2.052', 'DAMAGECOUNT': '4.146', 'FRAGCOUNT': '12.500'} [2023-02-24 20:37:32,374][213372] DAMAGECOUNT value on done: 85986.0 [2023-02-24 20:37:32,374][213372] Sum rewards: 18.017, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.326', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO3': '0.167', 'AMMO4': '0.189', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.302', 'weapon5': '0.324', 'weapon2': '0.688', 'WEAPON3': '0.950', 'HITCOUNT': '1.410', 'weapon3': '2.316', 'DAMAGECOUNT': '5.844', 'FRAGCOUNT': '19.000'} [2023-02-24 20:37:32,451][213366] DAMAGECOUNT value on done: 86665.0 [2023-02-24 20:37:32,451][213366] Sum rewards: 22.465, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.620', 'AMMO5': '0.023', 'AMMO2': '0.042', 'WEAPON4': '0.150', 'AMMO3': '0.156', 'AMMO4': '0.211', 'weapon5': '0.288', 'weapon4': '0.298', 'WEAPON5': '0.550', 'weapon2': '0.744', 'WEAPON3': '1.000', 'HITCOUNT': '1.390', 'weapon3': '2.228', 'DAMAGECOUNT': '6.504', 'FRAGCOUNT': '21.000'} [2023-02-24 20:37:32,478][213383] DAMAGECOUNT value on done: 87943.0 [2023-02-24 20:37:32,479][213383] Sum rewards: 29.766, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.734', 'AMMO5': '0.018', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.138', 'weapon5': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'weapon2': '0.530', 'weapon4': '0.594', 'ARMOR': '0.804', 'WEAPON3': '0.950', 'HITCOUNT': '1.740', 'weapon3': '2.198', 'DAMAGECOUNT': '7.962', 'FRAGCOUNT': '26.000'} [2023-02-24 20:37:32,654][213367] DAMAGECOUNT value on done: 84801.0 [2023-02-24 20:37:32,655][213367] Sum rewards: 27.729, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.442', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO3': '0.107', 'AMMO4': '0.148', 'weapon5': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.608', 'WEAPON3': '0.750', 'weapon2': '1.046', 'HITCOUNT': '1.720', 'weapon3': '1.726', 'DAMAGECOUNT': '8.145', 'FRAGCOUNT': '25.000'} [2023-02-24 20:37:32,712][213382] DAMAGECOUNT value on done: 83859.0 [2023-02-24 20:37:32,713][213382] Sum rewards: 19.454, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.722', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO3': '0.068', 'AMMO4': '0.138', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'WEAPON5': '0.450', 'weapon5': '0.454', 'weapon4': '0.652', 'weapon2': '0.902', 'weapon3': '1.646', 'HITCOUNT': '1.660', 'DAMAGECOUNT': '6.159', 'FRAGCOUNT': '14.000'} [2023-02-24 20:37:32,767][213366] DAMAGECOUNT value on done: 91029.0 [2023-02-24 20:37:32,767][213366] Sum rewards: 27.561, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.019', 'HEALTH': '0.032', 'AMMO2': '0.054', 'AMMO3': '0.099', 'AMMO4': '0.269', 'weapon5': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.500', 'WEAPON3': '0.550', 'weapon2': '1.002', 'HITCOUNT': '1.710', 'weapon3': '1.772', 'DAMAGECOUNT': '7.194', 'FRAGCOUNT': '23.000'} [2023-02-24 20:37:32,797][213383] DAMAGECOUNT value on done: 90043.0 [2023-02-24 20:37:32,798][213383] Sum rewards: 20.827, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.016', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.079', 'AMMO3': '0.099', 'HEALTH': '0.126', 'weapon4': '0.276', 'WEAPON5': '0.400', 'weapon5': '0.428', 'WEAPON3': '0.600', 'weapon2': '0.620', 'HITCOUNT': '1.340', 'weapon3': '2.234', 'DAMAGECOUNT': '5.271', 'FRAGCOUNT': '16.000'} [2023-02-24 20:37:32,810][213368] DAMAGECOUNT value on done: 83515.0 [2023-02-24 20:37:32,811][213368] Sum rewards: 30.387, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.850', 'AMMO5': '0.014', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'weapon5': '0.342', 'WEAPON5': '0.400', 'weapon4': '0.484', 'weapon2': '0.850', 'WEAPON3': '0.900', 'HITCOUNT': '1.770', 'weapon3': '1.826', 'DAMAGECOUNT': '8.289', 'FRAGCOUNT': '26.000'} [2023-02-24 20:37:32,893][213372] DAMAGECOUNT value on done: 89608.0 [2023-02-24 20:37:32,893][213372] Sum rewards: 21.441, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.374', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.041', 'AMMO3': '0.099', 'AMMO4': '0.207', 'weapon5': '0.298', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'WEAPON4': '0.650', 'weapon2': '0.654', 'weapon4': '1.034', 'weapon3': '1.408', 'HITCOUNT': '1.690', 'DAMAGECOUNT': '7.308', 'FRAGCOUNT': '21.000'} [2023-02-24 20:37:33,005][213369] DAMAGECOUNT value on done: 87081.0 [2023-02-24 20:37:33,005][213369] Sum rewards: 25.239, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.668', 'ARMOR': '0.008', 'WEAPON1': '0.030', 'AMMO5': '0.038', 'AMMO2': '0.039', 'AMMO3': '0.143', 'AMMO4': '0.196', 'weapon2': '0.226', 'WEAPON4': '0.550', 'weapon5': '0.722', 'weapon4': '0.766', 'WEAPON3': '0.850', 'WEAPON5': '0.900', 'HITCOUNT': '1.810', 'weapon3': '1.826', 'DAMAGECOUNT': '8.802', 'FRAGCOUNT': '22.000'} [2023-02-24 20:37:33,012][213382] DAMAGECOUNT value on done: 90638.0 [2023-02-24 20:37:33,012][213382] Sum rewards: 28.756, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.826', 'AMMO5': '0.019', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.143', 'weapon4': '0.166', 'WEAPON4': '0.250', 'weapon5': '0.288', 'WEAPON5': '0.500', 'weapon2': '0.706', 'WEAPON3': '0.900', 'HITCOUNT': '1.940', 'weapon3': '2.546', 'DAMAGECOUNT': '8.253', 'FRAGCOUNT': '25.000'} [2023-02-24 20:37:33,110][213366] DAMAGECOUNT value on done: 87242.0 [2023-02-24 20:37:33,111][213366] Sum rewards: 14.904, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.860', 'AMMO5': '0.027', 'AMMO2': '0.030', 'weapon4': '0.044', 'AMMO3': '0.105', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'weapon5': '0.350', 'WEAPON5': '0.650', 'WEAPON3': '0.700', 'weapon2': '0.822', 'HITCOUNT': '1.230', 'weapon3': '2.362', 'DAMAGECOUNT': '4.842', 'FRAGCOUNT': '12.500'} [2023-02-24 20:37:33,115][213368] DAMAGECOUNT value on done: 89089.0 [2023-02-24 20:37:33,116][213368] Sum rewards: 27.418, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.715', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.184', 'weapon5': '0.282', 'WEAPON4': '0.300', 'weapon4': '0.432', 'WEAPON5': '0.450', 'weapon2': '0.836', 'WEAPON3': '1.200', 'weapon3': '2.124', 'HITCOUNT': '2.240', 'DAMAGECOUNT': '8.946', 'FRAGCOUNT': '26.000'} [2023-02-24 20:37:33,193][213372] DAMAGECOUNT value on done: 85919.0 [2023-02-24 20:37:33,193][213372] Sum rewards: 27.458, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.440', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'WEAPON4': '0.050', 'AMMO4': '0.115', 'weapon4': '0.152', 'weapon5': '0.172', 'AMMO3': '0.224', 'WEAPON5': '0.400', 'ARMOR': '0.400', 'weapon2': '0.416', 'WEAPON3': '1.500', 'HITCOUNT': '1.820', 'weapon3': '2.956', 'DAMAGECOUNT': '8.385', 'FRAGCOUNT': '27.000'} [2023-02-24 20:37:33,266][213384] DAMAGECOUNT value on done: 86105.0 [2023-02-24 20:37:33,266][213384] Sum rewards: 21.072, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.091', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.081', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'weapon5': '0.182', 'WEAPON5': '0.400', 'weapon4': '0.476', 'WEAPON3': '0.550', 'weapon2': '0.930', 'HITCOUNT': '1.420', 'weapon3': '1.746', 'DAMAGECOUNT': '4.818', 'FRAGCOUNT': '17.000'} [2023-02-24 20:37:33,289][213383] DAMAGECOUNT value on done: 83393.0 [2023-02-24 20:37:33,290][213383] Sum rewards: 25.382, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.025', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO3': '0.053', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'WEAPON3': '0.350', 'WEAPON5': '0.350', 'weapon5': '0.434', 'weapon4': '0.476', 'weapon2': '1.076', 'HITCOUNT': '1.530', 'weapon3': '1.688', 'DAMAGECOUNT': '6.297', 'FRAGCOUNT': '18.000'} [2023-02-24 20:37:33,307][213369] DAMAGECOUNT value on done: 91117.0 [2023-02-24 20:37:33,307][213369] Sum rewards: 19.897, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.942', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.082', 'AMMO4': '0.152', 'weapon5': '0.288', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.472', 'WEAPON3': '0.650', 'weapon4': '0.784', 'HITCOUNT': '1.600', 'weapon3': '1.756', 'DAMAGECOUNT': '6.651', 'FRAGCOUNT': '17.500'} [2023-02-24 20:37:33,318][213382] DAMAGECOUNT value on done: 85163.0 [2023-02-24 20:37:33,319][213382] Sum rewards: 27.396, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.518', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.156', 'weapon5': '0.222', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.418', 'weapon2': '0.916', 'WEAPON3': '0.950', 'HITCOUNT': '1.700', 'weapon3': '2.074', 'DAMAGECOUNT': '6.702', 'FRAGCOUNT': '27.000'} [2023-02-24 20:37:33,406][213368] DAMAGECOUNT value on done: 88484.0 [2023-02-24 20:37:33,407][213368] Sum rewards: 22.050, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.538', 'AMMO2': '0.019', 'AMMO5': '0.034', 'AMMO4': '0.093', 'AMMO3': '0.134', 'WEAPON4': '0.250', 'weapon5': '0.332', 'weapon2': '0.402', 'WEAPON5': '0.750', 'weapon4': '0.776', 'WEAPON3': '0.850', 'HITCOUNT': '1.420', 'weapon3': '1.990', 'DAMAGECOUNT': '7.038', 'FRAGCOUNT': '20.000'} [2023-02-24 20:37:33,414][213366] DAMAGECOUNT value on done: 85543.0 [2023-02-24 20:37:33,414][213366] Sum rewards: 28.329, reward structure: {'DEATHCOUNT': '-9.000', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO3': '0.071', 'AMMO4': '0.215', 'weapon5': '0.324', 'WEAPON4': '0.400', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'HEALTH': '0.408', 'weapon4': '0.600', 'weapon2': '0.626', 'HITCOUNT': '1.760', 'weapon3': '2.118', 'DAMAGECOUNT': '8.433', 'FRAGCOUNT': '21.500'} [2023-02-24 20:37:33,562][213384] DAMAGECOUNT value on done: 80295.0 [2023-02-24 20:37:33,563][213384] Sum rewards: 20.237, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.158', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.022', 'AMMO3': '0.201', 'weapon5': '0.382', 'weapon2': '0.546', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'HITCOUNT': '1.450', 'weapon3': '2.564', 'DAMAGECOUNT': '6.369', 'FRAGCOUNT': '21.000'} [2023-02-24 20:37:33,592][213383] DAMAGECOUNT value on done: 81070.0 [2023-02-24 20:37:33,593][213383] Sum rewards: 16.416, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.870', 'AMMO2': '0.015', 'AMMO5': '0.018', 'WEAPON1': '0.060', 'AMMO4': '0.072', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'weapon4': '0.232', 'weapon5': '0.356', 'WEAPON5': '0.500', 'weapon2': '0.792', 'WEAPON3': '1.050', 'HITCOUNT': '1.350', 'weapon3': '2.270', 'DAMAGECOUNT': '5.466', 'FRAGCOUNT': '18.000'} [2023-02-24 20:37:33,612][213382] DAMAGECOUNT value on done: 86235.0 [2023-02-24 20:37:33,612][213382] Sum rewards: 16.963, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.084', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'weapon4': '0.206', 'WEAPON5': '0.300', 'weapon5': '0.344', 'WEAPON3': '0.600', 'weapon2': '1.144', 'HITCOUNT': '1.170', 'weapon3': '2.008', 'DAMAGECOUNT': '4.650', 'FRAGCOUNT': '14.000'} [2023-02-24 20:37:33,710][213368] DAMAGECOUNT value on done: 88376.0 [2023-02-24 20:37:33,710][213368] Sum rewards: 25.138, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.448', 'AMMO2': '0.024', 'AMMO5': '0.028', 'AMMO4': '0.121', 'AMMO3': '0.125', 'weapon4': '0.168', 'WEAPON4': '0.250', 'weapon5': '0.450', 'weapon2': '0.564', 'WEAPON5': '0.700', 'WEAPON3': '0.800', 'HITCOUNT': '1.550', 'weapon3': '2.364', 'DAMAGECOUNT': '7.941', 'FRAGCOUNT': '20.500'} [2023-02-24 20:37:33,806][213369] DAMAGECOUNT value on done: 87274.0 [2023-02-24 20:37:33,806][213369] Sum rewards: 25.093, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.606', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'weapon5': '0.320', 'weapon4': '0.394', 'weapon2': '0.658', 'WEAPON3': '0.900', 'HITCOUNT': '1.780', 'weapon3': '2.286', 'DAMAGECOUNT': '7.179', 'FRAGCOUNT': '23.000'} [2023-02-24 20:37:33,846][213384] DAMAGECOUNT value on done: 90217.0 [2023-02-24 20:37:33,847][213384] Sum rewards: 37.445, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.093', 'AMMO5': '0.015', 'AMMO2': '0.016', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'WEAPON5': '0.350', 'weapon4': '0.422', 'weapon2': '0.450', 'weapon5': '0.494', 'WEAPON3': '0.650', 'HITCOUNT': '1.850', 'weapon3': '2.274', 'DAMAGECOUNT': '9.234', 'FRAGCOUNT': '29.000'} [2023-02-24 20:37:33,848][213365] Updated weights for policy 0, policy_version 26976 (0.0009) [2023-02-24 20:37:34,105][213369] DAMAGECOUNT value on done: 78631.0 [2023-02-24 20:37:34,106][213369] Sum rewards: 37.856, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.514', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.038', 'weapon4': '0.122', 'AMMO3': '0.153', 'AMMO4': '0.192', 'weapon5': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.570', 'WEAPON3': '0.900', 'HITCOUNT': '2.040', 'weapon3': '2.714', 'DAMAGECOUNT': '10.647', 'FRAGCOUNT': '32.000'} [2023-02-24 20:37:34,143][213384] DAMAGECOUNT value on done: 88774.0 [2023-02-24 20:37:34,144][213384] Sum rewards: 19.081, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.920', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO5': '0.017', 'AMMO4': '0.065', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'weapon5': '0.366', 'WEAPON5': '0.400', 'weapon4': '0.430', 'weapon2': '0.502', 'WEAPON3': '0.700', 'HITCOUNT': '1.490', 'weapon3': '2.370', 'DAMAGECOUNT': '6.357', 'FRAGCOUNT': '16.000'} [2023-02-24 20:37:35,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13175.5, 300 sec: 13523.7). Total num frames: 110510080. Throughput: 0: 3337.2. Samples: 2616704. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 20:37:35,243][213332] Avg episode reward: [(0, '24.120')] [2023-02-24 20:37:36,786][213365] Updated weights for policy 0, policy_version 26986 (0.0009) [2023-02-24 20:37:39,720][213365] Updated weights for policy 0, policy_version 26996 (0.0009) [2023-02-24 20:37:40,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13243.7, 300 sec: 13523.7). Total num frames: 110579712. Throughput: 0: 3360.6. Samples: 2637482. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 20:37:40,243][213332] Avg episode reward: [(0, '24.120')] [2023-02-24 20:37:42,751][213365] Updated weights for policy 0, policy_version 27006 (0.0009) [2023-02-24 20:37:45,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13448.5, 300 sec: 13523.7). Total num frames: 110649344. Throughput: 0: 3415.1. Samples: 2657878. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 20:37:45,243][213332] Avg episode reward: [(0, '24.120')] [2023-02-24 20:37:45,735][213365] Updated weights for policy 0, policy_version 27016 (0.0009) [2023-02-24 20:37:48,695][213365] Updated weights for policy 0, policy_version 27026 (0.0009) [2023-02-24 20:37:50,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13516.8, 300 sec: 13537.6). Total num frames: 110718976. Throughput: 0: 3427.3. Samples: 2668302. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 20:37:50,243][213332] Avg episode reward: [(0, '24.120')] [2023-02-24 20:37:51,134][213367] DAMAGECOUNT value on done: 86698.0 [2023-02-24 20:37:51,135][213367] Sum rewards: 26.512, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.032', 'AMMO5': '0.014', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.083', 'AMMO3': '0.107', 'WEAPON5': '0.300', 'weapon5': '0.362', 'WEAPON4': '0.400', 'ARMOR': '0.458', 'weapon2': '0.558', 'weapon4': '0.626', 'WEAPON3': '0.700', 'weapon3': '1.804', 'HITCOUNT': '1.980', 'DAMAGECOUNT': '8.115', 'FRAGCOUNT': '22.000'} [2023-02-24 20:37:51,445][213367] DAMAGECOUNT value on done: 89792.0 [2023-02-24 20:37:51,446][213367] Sum rewards: 23.294, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.230', 'AMMO2': '0.004', 'AMMO4': '0.017', 'AMMO5': '0.019', 'WEAPON4': '0.050', 'weapon4': '0.064', 'AMMO3': '0.142', 'weapon5': '0.316', 'weapon2': '0.508', 'WEAPON5': '0.600', 'WEAPON3': '1.000', 'HITCOUNT': '1.330', 'weapon3': '2.736', 'DAMAGECOUNT': '5.988', 'FRAGCOUNT': '21.000'} [2023-02-24 20:37:51,508][213372] DAMAGECOUNT value on done: 89138.0 [2023-02-24 20:37:51,508][213372] Sum rewards: 26.696, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.727', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO3': '0.086', 'AMMO4': '0.143', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon5': '0.370', 'weapon4': '0.542', 'WEAPON3': '0.600', 'weapon2': '0.684', 'HITCOUNT': '1.680', 'weapon3': '2.108', 'DAMAGECOUNT': '7.215', 'FRAGCOUNT': '23.000'} [2023-02-24 20:37:51,674][213365] Updated weights for policy 0, policy_version 27036 (0.0008) [2023-02-24 20:37:51,755][213367] DAMAGECOUNT value on done: 86209.0 [2023-02-24 20:37:51,756][213367] Sum rewards: 21.072, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.402', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.107', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'weapon4': '0.240', 'WEAPON5': '0.350', 'weapon5': '0.562', 'WEAPON3': '0.750', 'weapon2': '1.258', 'HITCOUNT': '1.560', 'weapon3': '1.572', 'DAMAGECOUNT': '6.252', 'FRAGCOUNT': '17.000'} [2023-02-24 20:37:51,819][213372] DAMAGECOUNT value on done: 89023.0 [2023-02-24 20:37:51,820][213372] Sum rewards: 34.356, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.196', 'AMMO2': '0.006', 'AMMO5': '0.013', 'AMMO4': '0.030', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon5': '0.124', 'AMMO3': '0.129', 'weapon4': '0.190', 'WEAPON5': '0.300', 'weapon2': '0.542', 'WEAPON3': '0.850', 'HITCOUNT': '2.320', 'weapon3': '2.858', 'DAMAGECOUNT': '9.111', 'FRAGCOUNT': '27.000'} [2023-02-24 20:37:51,917][213366] DAMAGECOUNT value on done: 89196.0 [2023-02-24 20:37:51,918][213366] Sum rewards: 23.569, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.583', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.019', 'AMMO4': '0.094', 'AMMO3': '0.155', 'weapon5': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.436', 'weapon2': '0.816', 'WEAPON3': '0.850', 'HITCOUNT': '1.720', 'weapon3': '1.996', 'DAMAGECOUNT': '7.593', 'FRAGCOUNT': '23.000'} [2023-02-24 20:37:52,005][213383] DAMAGECOUNT value on done: 90465.0 [2023-02-24 20:37:52,006][213383] Sum rewards: 28.301, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.148', 'AMMO2': '0.016', 'AMMO5': '0.027', 'AMMO4': '0.078', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'weapon4': '0.172', 'weapon5': '0.374', 'WEAPON5': '0.700', 'weapon2': '0.750', 'WEAPON3': '0.950', 'HITCOUNT': '1.880', 'weapon3': '2.386', 'DAMAGECOUNT': '7.566', 'FRAGCOUNT': '24.000'} [2023-02-24 20:37:52,051][213367] DAMAGECOUNT value on done: 87058.0 [2023-02-24 20:37:52,052][213367] Sum rewards: 25.199, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.810', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.033', 'AMMO3': '0.122', 'AMMO4': '0.163', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.320', 'weapon2': '0.612', 'WEAPON3': '0.700', 'weapon4': '0.718', 'HITCOUNT': '1.810', 'weapon3': '2.040', 'DAMAGECOUNT': '6.771', 'FRAGCOUNT': '22.000'} [2023-02-24 20:37:52,176][213382] DAMAGECOUNT value on done: 85548.0 [2023-02-24 20:37:52,177][213382] Sum rewards: 17.179, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.214', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO3': '0.105', 'AMMO4': '0.155', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon5': '0.308', 'weapon4': '0.512', 'WEAPON3': '0.550', 'weapon2': '1.258', 'HITCOUNT': '1.410', 'weapon3': '1.636', 'DAMAGECOUNT': '5.067', 'FRAGCOUNT': '15.000'} [2023-02-24 20:37:52,241][213366] DAMAGECOUNT value on done: 93810.0 [2023-02-24 20:37:52,242][213366] Sum rewards: 22.273, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.760', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.145', 'weapon2': '0.220', 'weapon5': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.910', 'WEAPON3': '0.950', 'HITCOUNT': '2.040', 'weapon3': '2.188', 'DAMAGECOUNT': '8.343', 'FRAGCOUNT': '20.000'} [2023-02-24 20:37:52,309][213383] DAMAGECOUNT value on done: 92563.0 [2023-02-24 20:37:52,310][213383] Sum rewards: 18.743, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.516', 'AMMO5': '0.028', 'AMMO2': '0.033', 'AMMO4': '0.164', 'AMMO3': '0.166', 'weapon5': '0.226', 'weapon2': '0.394', 'WEAPON4': '0.400', 'weapon4': '0.512', 'WEAPON5': '0.600', 'WEAPON3': '1.000', 'HITCOUNT': '1.950', 'weapon3': '2.476', 'DAMAGECOUNT': '7.560', 'FRAGCOUNT': '19.000'} [2023-02-24 20:37:52,329][213368] DAMAGECOUNT value on done: 86323.0 [2023-02-24 20:37:52,329][213368] Sum rewards: 26.292, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.990', 'AMMO2': '0.006', 'AMMO5': '0.021', 'AMMO4': '0.029', 'WEAPON4': '0.100', 'weapon4': '0.102', 'AMMO3': '0.164', 'weapon5': '0.488', 'WEAPON5': '0.550', 'weapon2': '0.640', 'WEAPON3': '1.050', 'HITCOUNT': '1.810', 'weapon3': '2.398', 'DAMAGECOUNT': '8.424', 'FRAGCOUNT': '24.500'} [2023-02-24 20:37:52,337][213372] DAMAGECOUNT value on done: 90672.0 [2023-02-24 20:37:52,337][213372] Sum rewards: 11.103, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.415', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.030', 'WEAPON1': '0.040', 'AMMO3': '0.095', 'weapon4': '0.134', 'AMMO4': '0.152', 'WEAPON4': '0.300', 'weapon5': '0.372', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.780', 'weapon2': '0.972', 'weapon3': '2.028', 'DAMAGECOUNT': '3.192', 'FRAGCOUNT': '11.000'} [2023-02-24 20:37:52,479][213382] DAMAGECOUNT value on done: 92136.0 [2023-02-24 20:37:52,479][213382] Sum rewards: 16.522, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.400', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.086', 'WEAPON4': '0.250', 'weapon5': '0.422', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon4': '0.712', 'weapon2': '1.108', 'weapon3': '1.234', 'HITCOUNT': '1.250', 'DAMAGECOUNT': '4.494', 'FRAGCOUNT': '15.500'} [2023-02-24 20:37:52,506][213369] DAMAGECOUNT value on done: 89550.0 [2023-02-24 20:37:52,507][213369] Sum rewards: 29.504, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.176', 'ARMOR': '0.008', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon5': '0.108', 'AMMO4': '0.126', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.442', 'weapon2': '0.622', 'WEAPON3': '1.050', 'HITCOUNT': '1.970', 'weapon3': '2.542', 'DAMAGECOUNT': '7.407', 'FRAGCOUNT': '29.000'} [2023-02-24 20:37:52,571][213366] DAMAGECOUNT value on done: 89874.0 [2023-02-24 20:37:52,572][213366] Sum rewards: 29.277, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.540', 'AMMO2': '0.015', 'AMMO5': '0.018', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'weapon5': '0.256', 'weapon4': '0.340', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'weapon2': '0.742', 'HITCOUNT': '2.060', 'weapon3': '2.362', 'DAMAGECOUNT': '7.896', 'FRAGCOUNT': '23.000'} [2023-02-24 20:37:52,631][213368] DAMAGECOUNT value on done: 91641.0 [2023-02-24 20:37:52,632][213368] Sum rewards: 22.401, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.494', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO4': '0.038', 'WEAPON4': '0.100', 'AMMO3': '0.135', 'weapon4': '0.184', 'WEAPON5': '0.450', 'weapon5': '0.498', 'weapon2': '0.660', 'WEAPON3': '0.800', 'HITCOUNT': '1.530', 'weapon3': '2.308', 'DAMAGECOUNT': '7.641', 'FRAGCOUNT': '19.000'} [2023-02-24 20:37:52,635][213372] DAMAGECOUNT value on done: 88610.0 [2023-02-24 20:37:52,635][213372] Sum rewards: 24.048, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.280', 'ARMOR': '0.004', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.132', 'AMMO4': '0.143', 'weapon5': '0.224', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.570', 'weapon4': '0.578', 'WEAPON3': '0.900', 'HITCOUNT': '1.840', 'weapon3': '2.354', 'DAMAGECOUNT': '8.073', 'FRAGCOUNT': '22.000'} [2023-02-24 20:37:52,779][213384] DAMAGECOUNT value on done: 88862.0 [2023-02-24 20:37:52,779][213384] Sum rewards: 23.956, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.115', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon5': '0.132', 'AMMO3': '0.160', 'AMMO4': '0.186', 'WEAPON5': '0.300', 'weapon2': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '0.900', 'weapon4': '0.922', 'HITCOUNT': '1.780', 'weapon3': '1.818', 'DAMAGECOUNT': '8.271', 'FRAGCOUNT': '24.000'} [2023-02-24 20:37:52,784][213383] DAMAGECOUNT value on done: 86149.0 [2023-02-24 20:37:52,785][213383] Sum rewards: 24.733, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.495', 'AMMO2': '0.028', 'AMMO5': '0.029', 'weapon4': '0.110', 'AMMO3': '0.126', 'AMMO4': '0.141', 'WEAPON4': '0.350', 'weapon5': '0.434', 'weapon2': '0.576', 'WEAPON3': '0.850', 'WEAPON5': '0.850', 'HITCOUNT': '1.410', 'weapon3': '2.586', 'DAMAGECOUNT': '8.238', 'FRAGCOUNT': '22.000'} [2023-02-24 20:37:52,796][213382] DAMAGECOUNT value on done: 86866.0 [2023-02-24 20:37:52,797][213382] Sum rewards: 22.661, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO3': '0.050', 'HEALTH': '0.094', 'WEAPON5': '0.250', 'weapon5': '0.326', 'WEAPON3': '0.350', 'HITCOUNT': '1.070', 'weapon2': '1.534', 'weapon3': '1.848', 'DAMAGECOUNT': '5.109', 'FRAGCOUNT': '15.000'} [2023-02-24 20:37:52,806][213369] DAMAGECOUNT value on done: 93207.0 [2023-02-24 20:37:52,807][213369] Sum rewards: 24.237, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.050', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.124', 'WEAPON4': '0.250', 'weapon4': '0.266', 'WEAPON5': '0.300', 'weapon5': '0.310', 'WEAPON3': '0.800', 'weapon2': '0.870', 'HITCOUNT': '1.480', 'weapon3': '2.280', 'DAMAGECOUNT': '6.195', 'FRAGCOUNT': '22.000'} [2023-02-24 20:37:52,878][213366] DAMAGECOUNT value on done: 87809.0 [2023-02-24 20:37:52,879][213366] Sum rewards: 30.768, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.919', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.015', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'weapon4': '0.230', 'WEAPON5': '0.350', 'weapon2': '0.402', 'weapon5': '0.474', 'WEAPON3': '0.700', 'HITCOUNT': '1.700', 'weapon3': '2.534', 'DAMAGECOUNT': '6.798', 'FRAGCOUNT': '25.000'} [2023-02-24 20:37:52,939][213368] DAMAGECOUNT value on done: 91294.0 [2023-02-24 20:37:52,940][213368] Sum rewards: 36.020, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.739', 'AMMO5': '0.018', 'AMMO2': '0.024', 'AMMO4': '0.117', 'AMMO3': '0.134', 'WEAPON4': '0.200', 'weapon4': '0.226', 'weapon5': '0.390', 'WEAPON5': '0.400', 'weapon2': '0.492', 'WEAPON3': '0.750', 'HITCOUNT': '1.880', 'weapon3': '2.448', 'DAMAGECOUNT': '8.430', 'FRAGCOUNT': '31.000'} [2023-02-24 20:37:53,098][213384] DAMAGECOUNT value on done: 83461.0 [2023-02-24 20:37:53,098][213384] Sum rewards: 36.464, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.032', 'AMMO2': '0.009', 'AMMO5': '0.014', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'weapon4': '0.090', 'AMMO3': '0.158', 'weapon2': '0.266', 'weapon5': '0.286', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '2.120', 'weapon3': '3.060', 'DAMAGECOUNT': '9.498', 'FRAGCOUNT': '29.500'} [2023-02-24 20:37:53,103][213383] DAMAGECOUNT value on done: 82937.0 [2023-02-24 20:37:53,104][213383] Sum rewards: 19.780, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.008', 'AMMO5': '0.017', 'AMMO2': '0.021', 'AMMO4': '0.107', 'AMMO3': '0.115', 'weapon5': '0.194', 'WEAPON4': '0.200', 'weapon4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'weapon2': '1.200', 'HITCOUNT': '1.320', 'weapon3': '1.812', 'DAMAGECOUNT': '5.601', 'FRAGCOUNT': '17.000'} [2023-02-24 20:37:53,121][213382] DAMAGECOUNT value on done: 89040.0 [2023-02-24 20:37:53,121][213382] Sum rewards: 33.444, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.425', 'AMMO5': '0.013', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.111', 'WEAPON4': '0.150', 'weapon4': '0.168', 'weapon5': '0.332', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'weapon2': '0.798', 'HITCOUNT': '1.920', 'weapon3': '2.248', 'DAMAGECOUNT': '8.415', 'FRAGCOUNT': '27.000'} [2023-02-24 20:37:53,256][213368] DAMAGECOUNT value on done: 91118.0 [2023-02-24 20:37:53,257][213368] Sum rewards: 29.959, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.340', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'AMMO3': '0.100', 'AMMO4': '0.133', 'weapon5': '0.274', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon4': '0.916', 'HITCOUNT': '1.870', 'weapon3': '2.068', 'DAMAGECOUNT': '8.226', 'FRAGCOUNT': '24.000'} [2023-02-24 20:37:53,297][213369] DAMAGECOUNT value on done: 89207.0 [2023-02-24 20:37:53,298][213369] Sum rewards: 19.203, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.198', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO5': '0.019', 'weapon4': '0.076', 'AMMO4': '0.092', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'weapon5': '0.412', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'weapon2': '1.202', 'HITCOUNT': '1.350', 'weapon3': '2.012', 'DAMAGECOUNT': '5.799', 'FRAGCOUNT': '17.000'} [2023-02-24 20:37:53,379][213384] DAMAGECOUNT value on done: 93241.0 [2023-02-24 20:37:53,379][213384] Sum rewards: 29.943, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.436', 'AMMO5': '0.029', 'AMMO2': '0.052', 'AMMO3': '0.098', 'AMMO4': '0.259', 'weapon2': '0.374', 'WEAPON4': '0.550', 'WEAPON3': '0.550', 'weapon5': '0.584', 'weapon4': '0.682', 'WEAPON5': '0.800', 'HITCOUNT': '1.710', 'weapon3': '1.868', 'DAMAGECOUNT': '9.072', 'FRAGCOUNT': '26.000'} [2023-02-24 20:37:53,596][213369] DAMAGECOUNT value on done: 80820.0 [2023-02-24 20:37:53,597][213369] Sum rewards: 26.235, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.332', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO3': '0.051', 'AMMO4': '0.077', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.350', 'weapon5': '0.396', 'weapon2': '0.574', 'weapon4': '0.724', 'weapon3': '1.548', 'HITCOUNT': '1.750', 'DAMAGECOUNT': '6.567', 'FRAGCOUNT': '20.000'} [2023-02-24 20:37:53,685][213384] DAMAGECOUNT value on done: 89487.0 [2023-02-24 20:37:53,685][213384] Sum rewards: 10.501, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'AMMO3': '0.020', 'AMMO2': '0.043', 'WEAPON5': '0.050', 'weapon5': '0.070', 'WEAPON3': '0.100', 'AMMO4': '0.216', 'WEAPON4': '0.250', 'weapon4': '0.420', 'HEALTH': '0.474', 'ARMOR': '0.480', 'HITCOUNT': '0.580', 'weapon3': '0.648', 'weapon2': '1.758', 'DAMAGECOUNT': '2.139', 'FRAGCOUNT': '7.000'} [2023-02-24 20:37:54,670][213365] Updated weights for policy 0, policy_version 27046 (0.0009) [2023-02-24 20:37:55,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13523.8). Total num frames: 110784512. Throughput: 0: 3437.8. Samples: 2688914. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 20:37:55,243][213332] Avg episode reward: [(0, '24.377')] [2023-02-24 20:37:57,633][213365] Updated weights for policy 0, policy_version 27056 (0.0009) [2023-02-24 20:37:58,791][213367] Large shaping reward 2.584 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.552, 184.0), ('weapon5', 0.002)] [2023-02-24 20:38:00,243][213332] Fps is (10 sec: 13516.6, 60 sec: 13721.6, 300 sec: 13523.7). Total num frames: 110854144. Throughput: 0: 3447.5. Samples: 2709704. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 20:38:00,244][213332] Avg episode reward: [(0, '24.377')] [2023-02-24 20:38:00,585][213365] Updated weights for policy 0, policy_version 27066 (0.0008) [2023-02-24 20:38:03,541][213365] Updated weights for policy 0, policy_version 27076 (0.0009) [2023-02-24 20:38:04,943][213366] Large shaping reward 2.534 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.108, -36.0), ('weapon5', 0.002)] [2023-02-24 20:38:05,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13721.6, 300 sec: 13523.7). Total num frames: 110923776. Throughput: 0: 3445.5. Samples: 2720152. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:38:05,244][213332] Avg episode reward: [(0, '24.377')] [2023-02-24 20:38:06,606][213365] Updated weights for policy 0, policy_version 27086 (0.0009) [2023-02-24 20:38:09,580][213382] Large shaping reward 2.556 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.534, 178.0), ('weapon5', 0.002)] [2023-02-24 20:38:09,637][213365] Updated weights for policy 0, policy_version 27096 (0.0009) [2023-02-24 20:38:10,243][213332] Fps is (10 sec: 13926.7, 60 sec: 13789.9, 300 sec: 13537.6). Total num frames: 110993408. Throughput: 0: 3437.3. Samples: 2740434. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:38:10,243][213332] Avg episode reward: [(0, '24.377')] [2023-02-24 20:38:10,716][213367] DAMAGECOUNT value on done: 88714.0 [2023-02-24 20:38:10,716][213367] Sum rewards: 21.966, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.302', 'AMMO5': '0.020', 'AMMO2': '0.053', 'AMMO3': '0.125', 'AMMO4': '0.263', 'weapon2': '0.326', 'ARMOR': '0.404', 'weapon5': '0.424', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'weapon4': '1.040', 'HITCOUNT': '1.080', 'weapon3': '1.644', 'DAMAGECOUNT': '5.988', 'FRAGCOUNT': '19.000'} [2023-02-24 20:38:11,020][213367] DAMAGECOUNT value on done: 92599.0 [2023-02-24 20:38:11,020][213367] Sum rewards: 30.741, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.156', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO4': '0.109', 'AMMO3': '0.168', 'weapon4': '0.216', 'WEAPON4': '0.250', 'weapon5': '0.322', 'WEAPON5': '0.400', 'weapon2': '0.824', 'WEAPON3': '1.000', 'HITCOUNT': '1.770', 'weapon3': '2.360', 'DAMAGECOUNT': '8.421', 'FRAGCOUNT': '28.000'} [2023-02-24 20:38:11,146][213372] DAMAGECOUNT value on done: 92159.0 [2023-02-24 20:38:11,147][213372] Sum rewards: 31.606, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.410', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.028', 'AMMO4': '0.137', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'weapon4': '0.240', 'weapon5': '0.348', 'WEAPON5': '0.450', 'weapon2': '0.788', 'WEAPON3': '0.850', 'HITCOUNT': '2.020', 'weapon3': '2.214', 'DAMAGECOUNT': '9.063', 'FRAGCOUNT': '27.500'} [2023-02-24 20:38:11,323][213367] DAMAGECOUNT value on done: 88538.0 [2023-02-24 20:38:11,323][213367] Sum rewards: 26.733, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.638', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.087', 'AMMO4': '0.105', 'weapon4': '0.156', 'WEAPON4': '0.200', 'weapon5': '0.292', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'weapon2': '1.042', 'HITCOUNT': '1.720', 'weapon3': '2.226', 'DAMAGECOUNT': '6.987', 'FRAGCOUNT': '22.000'} [2023-02-24 20:38:11,456][213372] DAMAGECOUNT value on done: 91689.0 [2023-02-24 20:38:11,456][213372] Sum rewards: 25.846, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.538', 'AMMO2': '0.012', 'AMMO5': '0.022', 'AMMO4': '0.059', 'weapon4': '0.076', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'weapon5': '0.382', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'weapon2': '0.922', 'HITCOUNT': '1.550', 'weapon3': '2.226', 'DAMAGECOUNT': '7.998', 'FRAGCOUNT': '23.000'} [2023-02-24 20:38:11,522][213366] DAMAGECOUNT value on done: 90541.0 [2023-02-24 20:38:11,523][213366] Sum rewards: 12.589, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.709', 'AMMO2': '0.001', 'AMMO4': '0.003', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'WEAPON4': '0.050', 'AMMO3': '0.097', 'weapon5': '0.356', 'WEAPON5': '0.400', 'weapon4': '0.540', 'WEAPON3': '0.650', 'weapon2': '0.698', 'HITCOUNT': '0.810', 'weapon3': '1.886', 'DAMAGECOUNT': '4.035', 'FRAGCOUNT': '9.000'} [2023-02-24 20:38:11,643][213367] DAMAGECOUNT value on done: 90588.0 [2023-02-24 20:38:11,644][213367] Sum rewards: 36.493, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.107', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.037', 'AMMO3': '0.098', 'AMMO4': '0.183', 'weapon5': '0.338', 'WEAPON4': '0.450', 'weapon2': '0.536', 'WEAPON3': '0.600', 'WEAPON5': '0.650', 'weapon4': '0.928', 'weapon3': '1.752', 'HITCOUNT': '2.190', 'DAMAGECOUNT': '10.560', 'FRAGCOUNT': '29.000'} [2023-02-24 20:38:11,729][213383] DAMAGECOUNT value on done: 92057.0 [2023-02-24 20:38:11,730][213383] Sum rewards: 19.662, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.576', 'AMMO5': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.099', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'weapon5': '0.308', 'weapon4': '0.374', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'weapon2': '0.936', 'HITCOUNT': '1.270', 'weapon3': '1.612', 'DAMAGECOUNT': '4.776', 'FRAGCOUNT': '17.000'} [2023-02-24 20:38:11,736][213382] DAMAGECOUNT value on done: 88204.0 [2023-02-24 20:38:11,736][213382] Sum rewards: 28.195, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.136', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.038', 'AMMO3': '0.092', 'AMMO4': '0.192', 'WEAPON4': '0.350', 'weapon4': '0.356', 'weapon5': '0.420', 'WEAPON3': '0.550', 'WEAPON5': '0.600', 'weapon2': '0.748', 'HITCOUNT': '1.660', 'weapon3': '2.082', 'DAMAGECOUNT': '7.968', 'FRAGCOUNT': '23.000'} [2023-02-24 20:38:11,833][213366] DAMAGECOUNT value on done: 96660.0 [2023-02-24 20:38:11,834][213366] Sum rewards: 33.458, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.217', 'AMMO2': '0.013', 'AMMO5': '0.016', 'AMMO4': '0.066', 'AMMO3': '0.099', 'WEAPON4': '0.200', 'weapon5': '0.366', 'weapon2': '0.404', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'weapon4': '0.718', 'HITCOUNT': '1.760', 'weapon3': '1.882', 'DAMAGECOUNT': '8.550', 'FRAGCOUNT': '26.000'} [2023-02-24 20:38:11,983][213372] DAMAGECOUNT value on done: 93127.0 [2023-02-24 20:38:11,983][213372] Sum rewards: 27.106, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.522', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO3': '0.116', 'AMMO4': '0.129', 'weapon2': '0.196', 'WEAPON4': '0.250', 'weapon4': '0.430', 'WEAPON5': '0.450', 'weapon5': '0.460', 'WEAPON3': '0.650', 'HITCOUNT': '1.600', 'weapon3': '2.182', 'DAMAGECOUNT': '7.365', 'FRAGCOUNT': '22.000'} [2023-02-24 20:38:11,991][213368] DAMAGECOUNT value on done: 88680.0 [2023-02-24 20:38:11,991][213368] Sum rewards: 19.761, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.334', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO5': '0.028', 'AMMO4': '0.086', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon5': '0.286', 'weapon4': '0.382', 'weapon2': '0.512', 'WEAPON5': '0.700', 'WEAPON3': '1.200', 'HITCOUNT': '1.640', 'weapon3': '2.460', 'DAMAGECOUNT': '7.071', 'FRAGCOUNT': '20.000'} [2023-02-24 20:38:12,033][213383] DAMAGECOUNT value on done: 95143.0 [2023-02-24 20:38:12,033][213383] Sum rewards: 21.725, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.002', 'AMMO5': '0.017', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.131', 'weapon4': '0.186', 'weapon5': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'weapon2': '1.016', 'HITCOUNT': '1.940', 'weapon3': '2.308', 'DAMAGECOUNT': '7.740', 'FRAGCOUNT': '19.000'} [2023-02-24 20:38:12,044][213382] DAMAGECOUNT value on done: 94020.0 [2023-02-24 20:38:12,044][213382] Sum rewards: 16.711, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.804', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.034', 'AMMO3': '0.059', 'AMMO4': '0.170', 'weapon4': '0.382', 'weapon5': '0.404', 'WEAPON3': '0.450', 'WEAPON4': '0.500', 'WEAPON5': '0.750', 'HITCOUNT': '1.250', 'weapon2': '1.336', 'weapon3': '1.500', 'DAMAGECOUNT': '5.652', 'FRAGCOUNT': '15.000'} [2023-02-24 20:38:12,207][213366] DAMAGECOUNT value on done: 92385.0 [2023-02-24 20:38:12,207][213366] Sum rewards: 25.788, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.002', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.145', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.254', 'weapon4': '0.392', 'WEAPON3': '0.850', 'weapon2': '1.070', 'HITCOUNT': '1.760', 'weapon3': '2.040', 'DAMAGECOUNT': '7.533', 'FRAGCOUNT': '22.000'} [2023-02-24 20:38:12,274][213369] DAMAGECOUNT value on done: 92616.0 [2023-02-24 20:38:12,274][213369] Sum rewards: 31.072, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.760', 'AMMO2': '0.009', 'AMMO5': '0.015', 'AMMO4': '0.046', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'weapon4': '0.296', 'weapon5': '0.314', 'WEAPON5': '0.450', 'weapon2': '0.856', 'WEAPON3': '0.900', 'HITCOUNT': '2.000', 'weapon3': '2.164', 'DAMAGECOUNT': '9.198', 'FRAGCOUNT': '26.000'} [2023-02-24 20:38:12,299][213372] DAMAGECOUNT value on done: 91026.0 [2023-02-24 20:38:12,300][213372] Sum rewards: 24.606, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.030', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.107', 'AMMO3': '0.131', 'weapon5': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.572', 'weapon2': '0.630', 'WEAPON3': '0.850', 'HITCOUNT': '1.860', 'weapon3': '2.142', 'DAMAGECOUNT': '7.248', 'FRAGCOUNT': '22.000'} [2023-02-24 20:38:12,313][213368] DAMAGECOUNT value on done: 93581.0 [2023-02-24 20:38:12,314][213368] Sum rewards: 21.076, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.818', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.017', 'WEAPON4': '0.100', 'weapon4': '0.100', 'AMMO3': '0.131', 'weapon5': '0.360', 'WEAPON5': '0.550', 'weapon2': '0.616', 'WEAPON3': '0.900', 'HITCOUNT': '1.360', 'weapon3': '2.190', 'DAMAGECOUNT': '5.820', 'FRAGCOUNT': '19.000'} [2023-02-24 20:38:12,374][213382] DAMAGECOUNT value on done: 89334.0 [2023-02-24 20:38:12,374][213382] Sum rewards: 24.537, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.720', 'AMMO5': '0.021', 'AMMO2': '0.046', 'AMMO3': '0.117', 'AMMO4': '0.232', 'WEAPON4': '0.350', 'weapon5': '0.440', 'WEAPON5': '0.500', 'weapon4': '0.572', 'WEAPON3': '0.700', 'weapon2': '0.890', 'HITCOUNT': '1.510', 'weapon3': '1.724', 'DAMAGECOUNT': '7.404', 'FRAGCOUNT': '22.000'} [2023-02-24 20:38:12,508][213384] DAMAGECOUNT value on done: 92158.0 [2023-02-24 20:38:12,508][213384] Sum rewards: 35.527, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.296', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO5': '0.020', 'AMMO4': '0.037', 'weapon4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.158', 'weapon5': '0.348', 'WEAPON5': '0.550', 'weapon2': '0.684', 'WEAPON3': '1.100', 'HITCOUNT': '1.950', 'weapon3': '2.308', 'DAMAGECOUNT': '9.888', 'FRAGCOUNT': '31.000'} [2023-02-24 20:38:12,531][213366] DAMAGECOUNT value on done: 90743.0 [2023-02-24 20:38:12,531][213366] Sum rewards: 25.481, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.663', 'AMMO2': '0.020', 'AMMO5': '0.024', 'AMMO4': '0.098', 'AMMO3': '0.123', 'WEAPON4': '0.250', 'weapon5': '0.292', 'WEAPON5': '0.600', 'weapon2': '0.600', 'weapon4': '0.740', 'WEAPON3': '0.850', 'weapon3': '1.986', 'HITCOUNT': '2.130', 'DAMAGECOUNT': '8.181', 'FRAGCOUNT': '21.000'} [2023-02-24 20:38:12,551][213383] DAMAGECOUNT value on done: 89455.0 [2023-02-24 20:38:12,551][213383] Sum rewards: 37.219, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.605', 'AMMO2': '0.012', 'AMMO5': '0.022', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'AMMO3': '0.151', 'weapon4': '0.208', 'weapon5': '0.346', 'weapon2': '0.434', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'HITCOUNT': '2.080', 'weapon3': '2.696', 'DAMAGECOUNT': '9.918', 'FRAGCOUNT': '31.000'} [2023-02-24 20:38:12,588][213369] DAMAGECOUNT value on done: 95561.0 [2023-02-24 20:38:12,589][213369] Sum rewards: 25.460, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.375', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon7': '0.068', 'AMMO3': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.197', 'WEAPON7': '0.200', 'weapon5': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'weapon4': '0.712', 'weapon2': '1.252', 'weapon3': '1.456', 'HITCOUNT': '1.700', 'DAMAGECOUNT': '7.062', 'FRAGCOUNT': '21.000'} [2023-02-24 20:38:12,618][213368] DAMAGECOUNT value on done: 93840.0 [2023-02-24 20:38:12,619][213368] Sum rewards: 31.950, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.301', 'AMMO5': '0.013', 'AMMO2': '0.016', 'AMMO4': '0.080', 'AMMO3': '0.133', 'weapon5': '0.416', 'weapon2': '0.474', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'HITCOUNT': '1.580', 'weapon3': '2.700', 'DAMAGECOUNT': '7.638', 'FRAGCOUNT': '27.000'} [2023-02-24 20:38:12,674][213382] DAMAGECOUNT value on done: 91543.0 [2023-02-24 20:38:12,674][213382] Sum rewards: 28.361, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.110', 'AMMO5': '0.024', 'AMMO2': '0.030', 'AMMO3': '0.097', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'weapon5': '0.352', 'weapon4': '0.354', 'ARMOR': '0.404', 'weapon2': '0.468', 'WEAPON5': '0.650', 'WEAPON3': '0.700', 'HITCOUNT': '1.600', 'weapon3': '2.184', 'DAMAGECOUNT': '7.509', 'FRAGCOUNT': '23.000'} [2023-02-24 20:38:12,703][213365] Updated weights for policy 0, policy_version 27106 (0.0009) [2023-02-24 20:38:12,829][213384] DAMAGECOUNT value on done: 86035.0 [2023-02-24 20:38:12,829][213384] Sum rewards: 29.389, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.870', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.021', 'AMMO3': '0.141', 'weapon5': '0.326', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'weapon2': '0.936', 'HITCOUNT': '1.670', 'weapon3': '2.300', 'DAMAGECOUNT': '7.722', 'FRAGCOUNT': '24.000'} [2023-02-24 20:38:12,861][213383] DAMAGECOUNT value on done: 85658.0 [2023-02-24 20:38:12,862][213383] Sum rewards: 26.719, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.492', 'ARMOR': '0.004', 'AMMO2': '0.015', 'AMMO5': '0.018', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'AMMO3': '0.156', 'weapon5': '0.282', 'weapon2': '0.320', 'WEAPON5': '0.450', 'weapon4': '0.538', 'WEAPON3': '1.050', 'HITCOUNT': '1.970', 'weapon3': '2.570', 'DAMAGECOUNT': '8.163', 'FRAGCOUNT': '23.000'} [2023-02-24 20:38:12,919][213368] DAMAGECOUNT value on done: 93803.0 [2023-02-24 20:38:12,920][213368] Sum rewards: 25.438, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.990', 'ARMOR': '0.004', 'AMMO5': '0.028', 'AMMO2': '0.042', 'AMMO3': '0.165', 'AMMO4': '0.211', 'weapon5': '0.374', 'weapon2': '0.442', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'weapon4': '0.800', 'WEAPON3': '1.050', 'weapon3': '1.866', 'HITCOUNT': '1.890', 'DAMAGECOUNT': '8.055', 'FRAGCOUNT': '25.000'} [2023-02-24 20:38:13,056][213369] DAMAGECOUNT value on done: 92052.0 [2023-02-24 20:38:13,057][213369] Sum rewards: 29.518, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.266', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.109', 'WEAPON4': '0.250', 'weapon5': '0.284', 'WEAPON5': '0.400', 'weapon4': '0.404', 'WEAPON3': '0.750', 'weapon2': '1.094', 'weapon3': '1.796', 'HITCOUNT': '2.010', 'DAMAGECOUNT': '8.535', 'FRAGCOUNT': '24.000'} [2023-02-24 20:38:13,117][213384] DAMAGECOUNT value on done: 95494.0 [2023-02-24 20:38:13,117][213384] Sum rewards: 27.093, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.990', 'AMMO5': '0.022', 'AMMO2': '0.032', 'AMMO3': '0.108', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'weapon5': '0.296', 'weapon4': '0.360', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'weapon2': '1.004', 'HITCOUNT': '1.610', 'weapon3': '1.884', 'DAMAGECOUNT': '6.759', 'FRAGCOUNT': '22.000'} [2023-02-24 20:38:13,361][213369] DAMAGECOUNT value on done: 83664.0 [2023-02-24 20:38:13,362][213369] Sum rewards: 30.409, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.155', 'AMMO2': '0.014', 'AMMO5': '0.015', 'AMMO4': '0.069', 'AMMO3': '0.148', 'WEAPON4': '0.250', 'weapon4': '0.272', 'weapon5': '0.280', 'WEAPON5': '0.500', 'weapon2': '0.584', 'WEAPON3': '1.000', 'HITCOUNT': '1.930', 'weapon3': '2.470', 'DAMAGECOUNT': '8.532', 'FRAGCOUNT': '27.000'} [2023-02-24 20:38:13,421][213384] DAMAGECOUNT value on done: 92654.0 [2023-02-24 20:38:13,422][213384] Sum rewards: 27.261, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.478', 'AMMO2': '0.010', 'AMMO5': '0.027', 'AMMO4': '0.050', 'WEAPON4': '0.200', 'weapon4': '0.210', 'AMMO3': '0.229', 'weapon5': '0.262', 'weapon2': '0.472', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'HITCOUNT': '2.100', 'weapon3': '2.678', 'DAMAGECOUNT': '9.501', 'FRAGCOUNT': '27.000'} [2023-02-24 20:38:15,243][213332] Fps is (10 sec: 13107.3, 60 sec: 13653.3, 300 sec: 13509.9). Total num frames: 111054848. Throughput: 0: 3424.4. Samples: 2760556. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:38:15,243][213332] Avg episode reward: [(0, '25.283')] [2023-02-24 20:38:15,269][213352] Saving new best policy, reward=25.283! [2023-02-24 20:38:16,227][213365] Updated weights for policy 0, policy_version 27116 (0.0009) [2023-02-24 20:38:19,351][213365] Updated weights for policy 0, policy_version 27126 (0.0009) [2023-02-24 20:38:20,243][213332] Fps is (10 sec: 12287.7, 60 sec: 13516.7, 300 sec: 13482.1). Total num frames: 111116288. Throughput: 0: 3380.5. Samples: 2768826. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:38:20,244][213332] Avg episode reward: [(0, '25.283')] [2023-02-24 20:38:22,452][213365] Updated weights for policy 0, policy_version 27136 (0.0009) [2023-02-24 20:38:25,243][213332] Fps is (10 sec: 13107.2, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 111185920. Throughput: 0: 3362.4. Samples: 2788790. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:38:25,243][213332] Avg episode reward: [(0, '25.283')] [2023-02-24 20:38:25,503][213365] Updated weights for policy 0, policy_version 27146 (0.0009) [2023-02-24 20:38:28,525][213365] Updated weights for policy 0, policy_version 27156 (0.0009) [2023-02-24 20:38:30,243][213332] Fps is (10 sec: 13517.2, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 111251456. Throughput: 0: 3357.9. Samples: 2808984. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:38:30,243][213332] Avg episode reward: [(0, '25.283')] [2023-02-24 20:38:31,330][213367] DAMAGECOUNT value on done: 92433.0 [2023-02-24 20:38:31,330][213367] Sum rewards: 39.282, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.090', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.032', 'AMMO3': '0.154', 'AMMO4': '0.160', 'weapon4': '0.264', 'weapon5': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon2': '0.626', 'WEAPON3': '0.900', 'HITCOUNT': '2.410', 'weapon3': '2.466', 'DAMAGECOUNT': '11.157', 'FRAGCOUNT': '33.000'} [2023-02-24 20:38:31,549][213365] Updated weights for policy 0, policy_version 27166 (0.0009) [2023-02-24 20:38:31,632][213367] DAMAGECOUNT value on done: 95027.0 [2023-02-24 20:38:31,632][213367] Sum rewards: 29.183, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.898', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO3': '0.131', 'weapon5': '0.134', 'AMMO4': '0.144', 'weapon4': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.800', 'weapon2': '0.972', 'HITCOUNT': '1.920', 'weapon3': '2.400', 'DAMAGECOUNT': '7.284', 'FRAGCOUNT': '26.000'} [2023-02-24 20:38:31,676][213372] DAMAGECOUNT value on done: 93945.0 [2023-02-24 20:38:31,676][213372] Sum rewards: 19.686, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.287', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.016', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon7': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.131', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'weapon4': '0.542', 'WEAPON3': '0.750', 'weapon2': '0.758', 'HITCOUNT': '1.560', 'weapon3': '1.848', 'DAMAGECOUNT': '5.358', 'FRAGCOUNT': '18.000'} [2023-02-24 20:38:31,930][213367] DAMAGECOUNT value on done: 91349.0 [2023-02-24 20:38:31,930][213367] Sum rewards: 28.593, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.580', 'AMMO5': '0.020', 'AMMO2': '0.041', 'AMMO3': '0.134', 'AMMO4': '0.203', 'weapon5': '0.356', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.594', 'WEAPON3': '0.800', 'weapon2': '1.012', 'weapon3': '1.570', 'HITCOUNT': '1.910', 'DAMAGECOUNT': '8.433', 'FRAGCOUNT': '27.000'} [2023-02-24 20:38:31,978][213372] DAMAGECOUNT value on done: 94169.0 [2023-02-24 20:38:31,978][213372] Sum rewards: 26.785, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.210', 'AMMO5': '0.016', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'weapon5': '0.380', 'WEAPON5': '0.400', 'weapon2': '0.402', 'weapon4': '0.446', 'WEAPON3': '0.800', 'HITCOUNT': '1.720', 'weapon3': '2.242', 'DAMAGECOUNT': '7.440', 'FRAGCOUNT': '22.000'} [2023-02-24 20:38:32,047][213366] DAMAGECOUNT value on done: 92545.0 [2023-02-24 20:38:32,047][213366] Sum rewards: 24.472, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.480', 'AMMO2': '0.021', 'AMMO5': '0.028', 'AMMO4': '0.106', 'AMMO3': '0.125', 'weapon4': '0.148', 'WEAPON4': '0.150', 'weapon5': '0.274', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'weapon2': '1.040', 'HITCOUNT': '1.430', 'weapon3': '2.118', 'DAMAGECOUNT': '6.012', 'FRAGCOUNT': '22.000'} [2023-02-24 20:38:32,242][213367] DAMAGECOUNT value on done: 92578.0 [2023-02-24 20:38:32,243][213367] Sum rewards: 20.410, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.931', 'AMMO2': '0.025', 'AMMO5': '0.026', 'AMMO4': '0.123', 'AMMO3': '0.128', 'weapon4': '0.218', 'WEAPON4': '0.250', 'weapon5': '0.356', 'WEAPON5': '0.700', 'WEAPON3': '0.850', 'weapon2': '0.970', 'HITCOUNT': '1.570', 'weapon3': '2.154', 'DAMAGECOUNT': '5.970', 'FRAGCOUNT': '18.000'} [2023-02-24 20:38:32,261][213383] DAMAGECOUNT value on done: 93956.0 [2023-02-24 20:38:32,261][213383] Sum rewards: 15.104, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.239', 'ARMOR': '0.004', 'AMMO5': '0.027', 'AMMO2': '0.040', 'weapon7': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.155', 'weapon2': '0.166', 'AMMO4': '0.197', 'WEAPON4': '0.350', 'weapon5': '0.438', 'WEAPON5': '0.800', 'weapon4': '0.940', 'WEAPON3': '0.950', 'HITCOUNT': '1.220', 'weapon3': '1.924', 'DAMAGECOUNT': '5.487', 'FRAGCOUNT': '14.000'} [2023-02-24 20:38:32,298][213382] DAMAGECOUNT value on done: 90231.0 [2023-02-24 20:38:32,299][213382] Sum rewards: 22.610, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.746', 'AMMO2': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.038', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'WEAPON5': '0.350', 'weapon5': '0.362', 'WEAPON3': '0.800', 'weapon2': '0.806', 'HITCOUNT': '1.430', 'weapon3': '2.374', 'DAMAGECOUNT': '6.081', 'FRAGCOUNT': '20.000'} [2023-02-24 20:38:32,372][213366] DAMAGECOUNT value on done: 98608.0 [2023-02-24 20:38:32,373][213366] Sum rewards: 18.193, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.044', 'AMMO2': '0.001', 'AMMO4': '0.006', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'WEAPON4': '0.100', 'AMMO3': '0.154', 'weapon5': '0.242', 'weapon4': '0.266', 'WEAPON5': '0.350', 'weapon2': '0.404', 'ARMOR': '0.435', 'WEAPON3': '0.950', 'HITCOUNT': '1.140', 'weapon3': '2.568', 'DAMAGECOUNT': '5.844', 'FRAGCOUNT': '16.000'} [2023-02-24 20:38:32,528][213372] DAMAGECOUNT value on done: 95853.0 [2023-02-24 20:38:32,528][213372] Sum rewards: 32.722, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.145', 'AMMO2': '0.012', 'AMMO5': '0.017', 'AMMO4': '0.058', 'AMMO3': '0.141', 'weapon5': '0.294', 'WEAPON5': '0.400', 'weapon2': '0.492', 'WEAPON3': '0.900', 'HITCOUNT': '1.850', 'weapon3': '2.774', 'DAMAGECOUNT': '8.178', 'FRAGCOUNT': '27.000'} [2023-02-24 20:38:32,570][213383] DAMAGECOUNT value on done: 97549.0 [2023-02-24 20:38:32,570][213383] Sum rewards: 25.788, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.476', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO4': '0.085', 'AMMO3': '0.134', 'weapon5': '0.228', 'WEAPON4': '0.300', 'weapon2': '0.326', 'WEAPON5': '0.450', 'weapon4': '0.608', 'WEAPON3': '0.850', 'HITCOUNT': '1.980', 'weapon3': '2.526', 'DAMAGECOUNT': '7.218', 'FRAGCOUNT': '23.000'} [2023-02-24 20:38:32,607][213382] DAMAGECOUNT value on done: 96389.0 [2023-02-24 20:38:32,607][213382] Sum rewards: 25.633, reward structure: {'DEATHCOUNT': '-10.500', 'ARMOR': '0.004', 'AMMO5': '0.014', 'HEALTH': '0.016', 'AMMO2': '0.054', 'AMMO3': '0.073', 'weapon5': '0.224', 'AMMO4': '0.269', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.602', 'weapon2': '0.788', 'HITCOUNT': '1.700', 'weapon3': '1.982', 'DAMAGECOUNT': '7.107', 'FRAGCOUNT': '22.000'} [2023-02-24 20:38:32,700][213368] DAMAGECOUNT value on done: 91533.0 [2023-02-24 20:38:32,701][213368] Sum rewards: 26.073, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.445', 'AMMO5': '0.020', 'AMMO2': '0.036', 'AMMO3': '0.156', 'AMMO4': '0.179', 'weapon4': '0.328', 'weapon5': '0.346', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon2': '0.698', 'WEAPON3': '0.950', 'HITCOUNT': '1.810', 'weapon3': '2.136', 'DAMAGECOUNT': '8.559', 'FRAGCOUNT': '25.000'} [2023-02-24 20:38:32,736][213366] DAMAGECOUNT value on done: 95383.0 [2023-02-24 20:38:32,737][213366] Sum rewards: 27.663, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.666', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.027', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.152', 'weapon2': '0.156', 'weapon5': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon4': '0.882', 'WEAPON3': '0.900', 'HITCOUNT': '2.100', 'weapon3': '2.250', 'DAMAGECOUNT': '8.994', 'FRAGCOUNT': '24.000'} [2023-02-24 20:38:32,839][213372] DAMAGECOUNT value on done: 92548.0 [2023-02-24 20:38:32,840][213372] Sum rewards: 13.450, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.400', 'AMMO5': '0.017', 'AMMO2': '0.018', 'AMMO3': '0.087', 'AMMO4': '0.092', 'weapon5': '0.208', 'WEAPON4': '0.350', 'weapon4': '0.374', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon2': '1.004', 'HITCOUNT': '1.360', 'weapon3': '1.824', 'DAMAGECOUNT': '4.566', 'FRAGCOUNT': '13.000'} [2023-02-24 20:38:32,840][213369] DAMAGECOUNT value on done: 95403.0 [2023-02-24 20:38:32,841][213369] Sum rewards: 29.605, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.906', 'AMMO5': '0.022', 'AMMO2': '0.031', 'AMMO3': '0.149', 'AMMO4': '0.154', 'weapon4': '0.214', 'weapon5': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.460', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'HITCOUNT': '1.750', 'weapon3': '2.722', 'DAMAGECOUNT': '8.361', 'FRAGCOUNT': '26.000'} [2023-02-24 20:38:32,923][213382] DAMAGECOUNT value on done: 91483.0 [2023-02-24 20:38:32,924][213382] Sum rewards: 22.624, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.280', 'AMMO2': '0.009', 'AMMO5': '0.012', 'AMMO4': '0.046', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'weapon5': '0.204', 'weapon4': '0.268', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'weapon2': '1.078', 'HITCOUNT': '1.620', 'weapon3': '2.062', 'DAMAGECOUNT': '6.447', 'FRAGCOUNT': '19.000'} [2023-02-24 20:38:33,015][213368] DAMAGECOUNT value on done: 96135.0 [2023-02-24 20:38:33,016][213368] Sum rewards: 27.893, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.049', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.025', 'AMMO3': '0.080', 'AMMO4': '0.122', 'WEAPON4': '0.300', 'weapon5': '0.382', 'weapon4': '0.388', 'WEAPON5': '0.500', 'WEAPON3': '0.500', 'weapon2': '0.716', 'HITCOUNT': '1.580', 'weapon3': '1.914', 'DAMAGECOUNT': '7.662', 'FRAGCOUNT': '22.000'} [2023-02-24 20:38:33,041][213366] DAMAGECOUNT value on done: 93449.0 [2023-02-24 20:38:33,042][213366] Sum rewards: 25.628, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.042', 'AMMO2': '0.024', 'AMMO5': '0.025', 'AMMO4': '0.122', 'weapon2': '0.178', 'AMMO3': '0.189', 'weapon5': '0.220', 'weapon4': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'HITCOUNT': '2.110', 'weapon3': '3.000', 'DAMAGECOUNT': '8.118', 'FRAGCOUNT': '25.000'} [2023-02-24 20:38:33,093][213383] DAMAGECOUNT value on done: 92125.0 [2023-02-24 20:38:33,094][213383] Sum rewards: 24.838, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.926', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.014', 'weapon5': '0.178', 'AMMO3': '0.203', 'WEAPON5': '0.400', 'weapon2': '0.512', 'WEAPON3': '1.350', 'HITCOUNT': '2.070', 'weapon3': '3.040', 'DAMAGECOUNT': '8.010', 'FRAGCOUNT': '24.000'} [2023-02-24 20:38:33,123][213384] DAMAGECOUNT value on done: 94479.0 [2023-02-24 20:38:33,124][213384] Sum rewards: 21.283, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.700', 'AMMO5': '0.026', 'AMMO2': '0.040', 'AMMO3': '0.187', 'AMMO4': '0.199', 'WEAPON4': '0.300', 'weapon2': '0.324', 'weapon5': '0.334', 'WEAPON5': '0.600', 'weapon4': '0.682', 'WEAPON3': '1.100', 'HITCOUNT': '1.510', 'weapon3': '2.218', 'DAMAGECOUNT': '6.963', 'FRAGCOUNT': '22.000'} [2023-02-24 20:38:33,147][213369] DAMAGECOUNT value on done: 98128.0 [2023-02-24 20:38:33,148][213369] Sum rewards: 24.877, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.618', 'AMMO5': '0.022', 'AMMO2': '0.044', 'AMMO3': '0.126', 'AMMO4': '0.222', 'weapon5': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.508', 'WEAPON3': '0.750', 'weapon4': '0.934', 'weapon3': '1.706', 'HITCOUNT': '1.740', 'DAMAGECOUNT': '7.701', 'FRAGCOUNT': '22.000'} [2023-02-24 20:38:33,224][213382] DAMAGECOUNT value on done: 94873.0 [2023-02-24 20:38:33,224][213382] Sum rewards: 27.184, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.660', 'AMMO5': '0.017', 'AMMO2': '0.032', 'weapon7': '0.046', 'AMMO3': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.159', 'weapon5': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.494', 'WEAPON3': '0.600', 'weapon4': '0.950', 'weapon3': '1.350', 'HITCOUNT': '2.100', 'DAMAGECOUNT': '8.190', 'FRAGCOUNT': '21.000'} [2023-02-24 20:38:33,306][213368] DAMAGECOUNT value on done: 96416.0 [2023-02-24 20:38:33,307][213368] Sum rewards: 28.163, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.990', 'AMMO5': '0.019', 'AMMO2': '0.047', 'AMMO3': '0.089', 'weapon5': '0.234', 'AMMO4': '0.237', 'WEAPON5': '0.600', 'WEAPON4': '0.600', 'WEAPON3': '0.650', 'weapon2': '0.814', 'weapon4': '1.070', 'weapon3': '1.534', 'HITCOUNT': '2.030', 'DAMAGECOUNT': '7.728', 'FRAGCOUNT': '26.000'} [2023-02-24 20:38:33,400][213383] DAMAGECOUNT value on done: 87700.0 [2023-02-24 20:38:33,401][213383] Sum rewards: 18.611, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.530', 'AMMO5': '0.019', 'AMMO2': '0.020', 'weapon4': '0.050', 'AMMO4': '0.098', 'AMMO3': '0.112', 'WEAPON4': '0.250', 'weapon5': '0.410', 'WEAPON5': '0.600', 'weapon2': '0.624', 'WEAPON3': '0.850', 'HITCOUNT': '1.180', 'weapon3': '2.532', 'DAMAGECOUNT': '5.646', 'FRAGCOUNT': '17.000'} [2023-02-24 20:38:33,431][213384] DAMAGECOUNT value on done: 88155.0 [2023-02-24 20:38:33,432][213384] Sum rewards: 22.636, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.010', 'AMMO5': '0.012', 'weapon4': '0.034', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.100', 'weapon5': '0.246', 'WEAPON5': '0.300', 'HEALTH': '0.330', 'WEAPON3': '0.600', 'weapon2': '1.008', 'HITCOUNT': '1.690', 'weapon3': '2.348', 'DAMAGECOUNT': '6.360', 'FRAGCOUNT': '17.000'} [2023-02-24 20:38:33,594][213369] DAMAGECOUNT value on done: 94114.0 [2023-02-24 20:38:33,595][213369] Sum rewards: 18.564, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.384', 'ARMOR': '0.004', 'AMMO2': '0.017', 'AMMO5': '0.020', 'AMMO4': '0.086', 'AMMO3': '0.137', 'weapon5': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.500', 'weapon4': '0.632', 'weapon2': '0.734', 'WEAPON3': '0.750', 'HITCOUNT': '1.310', 'weapon3': '2.004', 'DAMAGECOUNT': '6.186', 'FRAGCOUNT': '16.000'} [2023-02-24 20:38:33,607][213368] DAMAGECOUNT value on done: 96663.0 [2023-02-24 20:38:33,607][213368] Sum rewards: 29.715, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.049', 'AMMO2': '0.016', 'AMMO5': '0.017', 'AMMO4': '0.081', 'AMMO3': '0.108', 'weapon4': '0.114', 'WEAPON4': '0.200', 'weapon5': '0.316', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'weapon2': '1.012', 'HITCOUNT': '1.970', 'weapon3': '2.250', 'DAMAGECOUNT': '8.580', 'FRAGCOUNT': '24.000'} [2023-02-24 20:38:33,711][213384] DAMAGECOUNT value on done: 97655.0 [2023-02-24 20:38:33,712][213384] Sum rewards: 23.230, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.650', 'AMMO5': '0.025', 'AMMO2': '0.041', 'AMMO3': '0.129', 'AMMO4': '0.205', 'weapon5': '0.244', 'weapon2': '0.456', 'WEAPON4': '0.550', 'weapon4': '0.640', 'WEAPON5': '0.700', 'WEAPON3': '0.850', 'HITCOUNT': '1.650', 'weapon3': '2.156', 'DAMAGECOUNT': '6.483', 'FRAGCOUNT': '23.000'} [2023-02-24 20:38:33,901][213369] DAMAGECOUNT value on done: 85987.0 [2023-02-24 20:38:33,902][213369] Sum rewards: 27.420, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.100', 'AMMO5': '0.017', 'AMMO2': '0.034', 'AMMO3': '0.103', 'AMMO4': '0.169', 'weapon5': '0.268', 'WEAPON4': '0.300', 'weapon4': '0.324', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon2': '0.882', 'HITCOUNT': '1.750', 'weapon3': '2.204', 'DAMAGECOUNT': '6.969', 'FRAGCOUNT': '25.000'} [2023-02-24 20:38:34,011][213384] DAMAGECOUNT value on done: 95337.0 [2023-02-24 20:38:34,012][213384] Sum rewards: 23.991, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.604', 'AMMO5': '0.023', 'AMMO2': '0.040', 'AMMO3': '0.105', 'AMMO4': '0.201', 'weapon5': '0.348', 'weapon2': '0.454', 'WEAPON4': '0.500', 'WEAPON5': '0.650', 'WEAPON3': '0.750', 'weapon4': '0.750', 'HITCOUNT': '1.550', 'weapon3': '1.924', 'DAMAGECOUNT': '8.049', 'FRAGCOUNT': '21.000'} [2023-02-24 20:38:34,596][213365] Updated weights for policy 0, policy_version 27176 (0.0009) [2023-02-24 20:38:35,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 111321088. Throughput: 0: 3352.7. Samples: 2819172. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:38:35,243][213332] Avg episode reward: [(0, '25.651')] [2023-02-24 20:38:35,247][213352] Saving new best policy, reward=25.651! [2023-02-24 20:38:37,603][213365] Updated weights for policy 0, policy_version 27186 (0.0009) [2023-02-24 20:38:40,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 111386624. Throughput: 0: 3346.8. Samples: 2839518. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:38:40,243][213332] Avg episode reward: [(0, '25.651')] [2023-02-24 20:38:40,628][213365] Updated weights for policy 0, policy_version 27196 (0.0009) [2023-02-24 20:38:43,649][213365] Updated weights for policy 0, policy_version 27206 (0.0009) [2023-02-24 20:38:45,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 111456256. Throughput: 0: 3338.2. Samples: 2859922. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:38:45,243][213332] Avg episode reward: [(0, '25.651')] [2023-02-24 20:38:45,248][213352] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000027211_111456256.pth... [2023-02-24 20:38:45,307][213352] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000026424_108232704.pth [2023-02-24 20:38:46,666][213365] Updated weights for policy 0, policy_version 27216 (0.0009) [2023-02-24 20:38:49,698][213365] Updated weights for policy 0, policy_version 27226 (0.0009) [2023-02-24 20:38:50,243][213332] Fps is (10 sec: 13516.6, 60 sec: 13380.2, 300 sec: 13482.1). Total num frames: 111521792. Throughput: 0: 3332.0. Samples: 2870094. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:38:50,244][213332] Avg episode reward: [(0, '25.651')] [2023-02-24 20:38:51,126][213367] DAMAGECOUNT value on done: 95012.0 [2023-02-24 20:38:51,127][213367] Sum rewards: 26.671, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.108', 'AMMO2': '0.011', 'AMMO5': '0.026', 'AMMO4': '0.057', 'AMMO3': '0.129', 'WEAPON4': '0.250', 'weapon5': '0.358', 'weapon4': '0.470', 'weapon2': '0.634', 'WEAPON5': '0.650', 'WEAPON3': '0.900', 'HITCOUNT': '1.820', 'weapon3': '2.236', 'DAMAGECOUNT': '7.737', 'FRAGCOUNT': '24.000'} [2023-02-24 20:38:51,419][213372] DAMAGECOUNT value on done: 96051.0 [2023-02-24 20:38:51,419][213372] Sum rewards: 18.861, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.135', 'AMMO2': '0.004', 'AMMO5': '0.017', 'AMMO4': '0.018', 'WEAPON4': '0.100', 'AMMO3': '0.126', 'weapon4': '0.180', 'weapon5': '0.266', 'WEAPON5': '0.400', 'weapon2': '0.828', 'WEAPON3': '0.850', 'HITCOUNT': '1.630', 'weapon3': '2.508', 'DAMAGECOUNT': '6.318', 'FRAGCOUNT': '16.000'} [2023-02-24 20:38:51,432][213367] DAMAGECOUNT value on done: 98258.0 [2023-02-24 20:38:51,433][213367] Sum rewards: 33.751, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.030', 'ARMOR': '0.004', 'AMMO2': '0.014', 'AMMO5': '0.018', 'AMMO4': '0.068', 'AMMO3': '0.176', 'weapon2': '0.292', 'WEAPON4': '0.300', 'weapon5': '0.376', 'WEAPON5': '0.550', 'weapon4': '0.614', 'WEAPON3': '1.050', 'HITCOUNT': '2.240', 'weapon3': '2.386', 'DAMAGECOUNT': '9.693', 'FRAGCOUNT': '30.000'} [2023-02-24 20:38:51,724][213366] DAMAGECOUNT value on done: 94799.0 [2023-02-24 20:38:51,725][213366] Sum rewards: 19.383, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.803', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.050', 'AMMO3': '0.141', 'AMMO4': '0.250', 'weapon5': '0.360', 'WEAPON4': '0.450', 'weapon4': '0.458', 'WEAPON5': '0.650', 'weapon2': '0.746', 'WEAPON3': '0.800', 'HITCOUNT': '1.550', 'weapon3': '1.940', 'DAMAGECOUNT': '6.762', 'FRAGCOUNT': '18.000'} [2023-02-24 20:38:51,725][213372] DAMAGECOUNT value on done: 97038.0 [2023-02-24 20:38:51,725][213372] Sum rewards: 34.989, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.690', 'AMMO5': '0.022', 'AMMO2': '0.041', 'AMMO3': '0.108', 'AMMO4': '0.207', 'weapon5': '0.282', 'WEAPON4': '0.450', 'WEAPON5': '0.600', 'weapon2': '0.666', 'weapon4': '0.668', 'WEAPON3': '0.700', 'weapon3': '2.008', 'HITCOUNT': '2.070', 'DAMAGECOUNT': '8.607', 'FRAGCOUNT': '30.000'} [2023-02-24 20:38:51,735][213367] DAMAGECOUNT value on done: 94555.0 [2023-02-24 20:38:51,736][213367] Sum rewards: 33.432, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.486', 'AMMO5': '0.018', 'AMMO2': '0.055', 'AMMO3': '0.159', 'AMMO4': '0.274', 'weapon5': '0.448', 'WEAPON4': '0.500', 'weapon2': '0.534', 'WEAPON5': '0.550', 'weapon4': '0.692', 'WEAPON3': '0.950', 'weapon3': '1.930', 'HITCOUNT': '1.940', 'DAMAGECOUNT': '9.618', 'FRAGCOUNT': '30.000'} [2023-02-24 20:38:52,030][213366] DAMAGECOUNT value on done: 101166.0 [2023-02-24 20:38:52,031][213366] Sum rewards: 26.476, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.813', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO3': '0.103', 'AMMO4': '0.111', 'weapon5': '0.214', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.506', 'WEAPON3': '0.600', 'weapon4': '0.684', 'weapon3': '1.822', 'HITCOUNT': '1.890', 'DAMAGECOUNT': '7.674', 'FRAGCOUNT': '22.000'} [2023-02-24 20:38:52,047][213367] DAMAGECOUNT value on done: 95274.0 [2023-02-24 20:38:52,048][213367] Sum rewards: 25.617, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.214', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.183', 'weapon5': '0.198', 'WEAPON5': '0.250', 'weapon4': '0.458', 'weapon2': '0.660', 'WEAPON3': '1.000', 'HITCOUNT': '1.750', 'weapon3': '2.330', 'DAMAGECOUNT': '8.073', 'FRAGCOUNT': '22.000'} [2023-02-24 20:38:52,056][213382] DAMAGECOUNT value on done: 92607.0 [2023-02-24 20:38:52,057][213382] Sum rewards: 25.693, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.995', 'AMMO2': '0.022', 'AMMO5': '0.025', 'AMMO3': '0.086', 'AMMO4': '0.111', 'weapon4': '0.150', 'WEAPON4': '0.250', 'weapon5': '0.370', 'WEAPON3': '0.550', 'WEAPON5': '0.600', 'weapon2': '0.980', 'HITCOUNT': '1.540', 'weapon3': '2.126', 'DAMAGECOUNT': '7.128', 'FRAGCOUNT': '21.000'} [2023-02-24 20:38:52,116][213383] DAMAGECOUNT value on done: 96631.0 [2023-02-24 20:38:52,117][213383] Sum rewards: 26.615, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.310', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.021', 'AMMO4': '0.102', 'AMMO3': '0.141', 'WEAPON4': '0.300', 'weapon5': '0.302', 'weapon4': '0.352', 'weapon2': '0.440', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'HITCOUNT': '1.870', 'weapon3': '2.500', 'DAMAGECOUNT': '8.025', 'FRAGCOUNT': '23.000'} [2023-02-24 20:38:52,333][213372] DAMAGECOUNT value on done: 98312.0 [2023-02-24 20:38:52,333][213372] Sum rewards: 28.342, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.068', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.029', 'AMMO3': '0.118', 'AMMO4': '0.146', 'weapon5': '0.216', 'WEAPON4': '0.250', 'weapon4': '0.574', 'WEAPON5': '0.600', 'weapon2': '0.600', 'WEAPON3': '0.800', 'HITCOUNT': '1.570', 'weapon3': '2.106', 'DAMAGECOUNT': '7.374', 'FRAGCOUNT': '24.000'} [2023-02-24 20:38:52,355][213382] DAMAGECOUNT value on done: 98598.0 [2023-02-24 20:38:52,356][213382] Sum rewards: 21.132, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.256', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO3': '0.113', 'AMMO4': '0.126', 'weapon5': '0.174', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.588', 'WEAPON3': '0.750', 'weapon2': '0.934', 'HITCOUNT': '1.610', 'weapon3': '1.928', 'DAMAGECOUNT': '6.627', 'FRAGCOUNT': '20.000'} [2023-02-24 20:38:52,408][213366] DAMAGECOUNT value on done: 97726.0 [2023-02-24 20:38:52,409][213366] Sum rewards: 28.087, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.402', 'AMMO5': '0.015', 'AMMO2': '0.060', 'AMMO3': '0.090', 'weapon5': '0.212', 'WEAPON4': '0.250', 'AMMO4': '0.299', 'WEAPON5': '0.350', 'weapon4': '0.514', 'WEAPON3': '0.550', 'weapon2': '1.148', 'HITCOUNT': '1.610', 'weapon3': '1.862', 'DAMAGECOUNT': '7.029', 'FRAGCOUNT': '22.000'} [2023-02-24 20:38:52,419][213383] DAMAGECOUNT value on done: 100035.0 [2023-02-24 20:38:52,419][213383] Sum rewards: 27.304, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.282', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO3': '0.097', 'AMMO4': '0.122', 'weapon5': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'weapon2': '0.688', 'weapon4': '1.094', 'weapon3': '1.696', 'HITCOUNT': '2.210', 'DAMAGECOUNT': '7.458', 'FRAGCOUNT': '21.000'} [2023-02-24 20:38:52,445][213368] DAMAGECOUNT value on done: 94095.0 [2023-02-24 20:38:52,445][213368] Sum rewards: 30.497, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.125', 'AMMO2': '0.011', 'AMMO5': '0.020', 'AMMO4': '0.053', 'AMMO3': '0.104', 'WEAPON4': '0.200', 'weapon4': '0.248', 'weapon2': '0.362', 'weapon5': '0.486', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'HITCOUNT': '1.820', 'weapon3': '2.482', 'DAMAGECOUNT': '7.686', 'FRAGCOUNT': '26.000'} [2023-02-24 20:38:52,615][213369] DAMAGECOUNT value on done: 98443.0 [2023-02-24 20:38:52,616][213369] Sum rewards: 31.964, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.888', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'weapon4': '0.086', 'AMMO4': '0.106', 'AMMO3': '0.147', 'WEAPON5': '0.150', 'weapon5': '0.256', 'ARMOR': '0.504', 'WEAPON3': '0.850', 'weapon2': '0.906', 'HITCOUNT': '2.080', 'weapon3': '2.568', 'DAMAGECOUNT': '9.120', 'FRAGCOUNT': '25.000'} [2023-02-24 20:38:52,626][213372] DAMAGECOUNT value on done: 95130.0 [2023-02-24 20:38:52,627][213372] Sum rewards: 28.896, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.224', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.097', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'weapon4': '0.316', 'WEAPON5': '0.350', 'weapon5': '0.384', 'WEAPON3': '0.600', 'weapon2': '0.648', 'HITCOUNT': '1.760', 'weapon3': '2.396', 'DAMAGECOUNT': '7.746', 'FRAGCOUNT': '22.000'} [2023-02-24 20:38:52,660][213382] DAMAGECOUNT value on done: 93742.0 [2023-02-24 20:38:52,660][213382] Sum rewards: 23.357, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.600', 'ARMOR': '0.004', 'AMMO2': '0.021', 'AMMO5': '0.026', 'AMMO4': '0.105', 'weapon4': '0.110', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon5': '0.302', 'WEAPON5': '0.650', 'weapon2': '0.812', 'WEAPON3': '1.100', 'HITCOUNT': '1.770', 'weapon3': '2.412', 'DAMAGECOUNT': '6.777', 'FRAGCOUNT': '22.000'} [2023-02-24 20:38:52,713][213366] DAMAGECOUNT value on done: 96087.0 [2023-02-24 20:38:52,714][213366] Sum rewards: 27.006, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.184', 'AMMO2': '0.005', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.025', 'WEAPON4': '0.100', 'AMMO3': '0.157', 'weapon4': '0.208', 'weapon5': '0.380', 'WEAPON5': '0.400', 'weapon2': '0.544', 'WEAPON3': '0.950', 'HITCOUNT': '1.550', 'weapon3': '2.420', 'DAMAGECOUNT': '7.914', 'FRAGCOUNT': '23.000'} [2023-02-24 20:38:52,717][213365] Updated weights for policy 0, policy_version 27236 (0.0010) [2023-02-24 20:38:52,757][213368] DAMAGECOUNT value on done: 98530.0 [2023-02-24 20:38:52,757][213368] Sum rewards: 22.848, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.550', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO3': '0.114', 'WEAPON4': '0.300', 'weapon5': '0.304', 'weapon4': '0.466', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon2': '1.184', 'weapon3': '1.708', 'HITCOUNT': '1.840', 'DAMAGECOUNT': '7.185', 'FRAGCOUNT': '20.000'} [2023-02-24 20:38:52,934][213369] DAMAGECOUNT value on done: 100867.0 [2023-02-24 20:38:52,935][213369] Sum rewards: 26.255, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.788', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO5': '0.019', 'AMMO4': '0.091', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'weapon5': '0.278', 'weapon4': '0.302', 'weapon2': '0.388', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'HITCOUNT': '2.000', 'weapon3': '2.744', 'DAMAGECOUNT': '8.217', 'FRAGCOUNT': '25.000'} [2023-02-24 20:38:52,945][213384] DAMAGECOUNT value on done: 97581.0 [2023-02-24 20:38:52,946][213384] Sum rewards: 33.882, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.610', 'AMMO5': '0.022', 'AMMO2': '0.035', 'AMMO3': '0.081', 'AMMO4': '0.172', 'weapon5': '0.368', 'WEAPON4': '0.500', 'WEAPON3': '0.500', 'weapon4': '0.594', 'WEAPON5': '0.600', 'weapon2': '0.720', 'weapon3': '1.914', 'HITCOUNT': '1.930', 'DAMAGECOUNT': '9.306', 'FRAGCOUNT': '27.000'} [2023-02-24 20:38:52,954][213383] DAMAGECOUNT value on done: 95491.0 [2023-02-24 20:38:52,954][213383] Sum rewards: 34.996, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.280', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.050', 'AMMO3': '0.148', 'AMMO4': '0.252', 'weapon5': '0.254', 'weapon2': '0.448', 'weapon4': '0.490', 'WEAPON4': '0.500', 'WEAPON5': '0.650', 'WEAPON3': '1.000', 'weapon3': '2.388', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '10.098', 'FRAGCOUNT': '32.000'} [2023-02-24 20:38:52,979][213382] DAMAGECOUNT value on done: 97370.0 [2023-02-24 20:38:52,980][213382] Sum rewards: 25.698, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.534', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.026', 'AMMO3': '0.084', 'AMMO4': '0.130', 'weapon5': '0.342', 'WEAPON4': '0.350', 'weapon4': '0.388', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon2': '0.848', 'HITCOUNT': '1.740', 'weapon3': '1.762', 'DAMAGECOUNT': '7.491', 'FRAGCOUNT': '22.000'} [2023-02-24 20:38:53,047][213368] DAMAGECOUNT value on done: 99316.0 [2023-02-24 20:38:53,047][213368] Sum rewards: 29.958, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.778', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.028', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'weapon4': '0.152', 'AMMO3': '0.154', 'weapon5': '0.264', 'WEAPON5': '0.500', 'weapon2': '0.654', 'WEAPON3': '1.000', 'HITCOUNT': '1.810', 'weapon3': '2.662', 'DAMAGECOUNT': '8.700', 'FRAGCOUNT': '26.000'} [2023-02-24 20:38:53,255][213384] DAMAGECOUNT value on done: 89984.0 [2023-02-24 20:38:53,255][213384] Sum rewards: 19.229, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.280', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO2': '0.025', 'AMMO3': '0.087', 'AMMO4': '0.127', 'WEAPON4': '0.300', 'weapon5': '0.346', 'weapon4': '0.448', 'WEAPON3': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.906', 'HITCOUNT': '1.440', 'weapon3': '1.948', 'DAMAGECOUNT': '5.487', 'FRAGCOUNT': '15.000'} [2023-02-24 20:38:53,258][213383] DAMAGECOUNT value on done: 89359.0 [2023-02-24 20:38:53,259][213383] Sum rewards: 16.835, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.665', 'AMMO2': '0.006', 'AMMO5': '0.018', 'AMMO4': '0.030', 'AMMO3': '0.085', 'weapon4': '0.160', 'WEAPON4': '0.200', 'weapon5': '0.272', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'weapon2': '0.798', 'HITCOUNT': '1.280', 'weapon3': '2.284', 'DAMAGECOUNT': '4.917', 'FRAGCOUNT': '14.000'} [2023-02-24 20:38:53,351][213368] DAMAGECOUNT value on done: 99480.0 [2023-02-24 20:38:53,351][213368] Sum rewards: 30.443, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.290', 'AMMO5': '0.005', 'AMMO2': '0.031', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO4': '0.153', 'weapon2': '0.316', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'weapon4': '1.004', 'HITCOUNT': '1.970', 'weapon3': '2.204', 'DAMAGECOUNT': '8.451', 'FRAGCOUNT': '28.000'} [2023-02-24 20:38:53,369][213369] DAMAGECOUNT value on done: 97122.0 [2023-02-24 20:38:53,370][213369] Sum rewards: 30.859, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.546', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'AMMO3': '0.125', 'weapon4': '0.316', 'weapon5': '0.346', 'WEAPON5': '0.600', 'weapon2': '0.720', 'WEAPON3': '0.850', 'HITCOUNT': '1.990', 'weapon3': '2.240', 'DAMAGECOUNT': '9.024', 'FRAGCOUNT': '25.000'} [2023-02-24 20:38:53,454][213384] DAMAGECOUNT value on done: 100539.0 [2023-02-24 20:38:53,455][213384] Sum rewards: 31.448, reward structure: {'DEATHCOUNT': '-10.500', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.016', 'weapon4': '0.018', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'AMMO3': '0.155', 'HEALTH': '0.219', 'weapon5': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.728', 'WEAPON3': '0.850', 'HITCOUNT': '1.760', 'weapon3': '2.652', 'DAMAGECOUNT': '8.652', 'FRAGCOUNT': '26.000'} [2023-02-24 20:38:53,668][213369] DAMAGECOUNT value on done: 88649.0 [2023-02-24 20:38:53,668][213369] Sum rewards: 29.165, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.804', 'AMMO2': '0.024', 'AMMO5': '0.026', 'AMMO4': '0.119', 'AMMO3': '0.136', 'weapon4': '0.138', 'WEAPON4': '0.150', 'weapon5': '0.358', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'weapon2': '0.968', 'HITCOUNT': '1.600', 'weapon3': '2.164', 'DAMAGECOUNT': '7.986', 'FRAGCOUNT': '24.000'} [2023-02-24 20:38:53,745][213384] DAMAGECOUNT value on done: 98009.0 [2023-02-24 20:38:53,746][213384] Sum rewards: 29.026, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.304', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.030', 'AMMO3': '0.071', 'AMMO4': '0.152', 'WEAPON4': '0.350', 'weapon5': '0.396', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'weapon2': '0.494', 'weapon4': '1.036', 'weapon3': '1.634', 'HITCOUNT': '1.780', 'DAMAGECOUNT': '8.016', 'FRAGCOUNT': '23.500'} [2023-02-24 20:38:55,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 111591424. Throughput: 0: 3335.2. Samples: 2890518. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:38:55,243][213332] Avg episode reward: [(0, '26.160')] [2023-02-24 20:38:55,246][213352] Saving new best policy, reward=26.160! [2023-02-24 20:38:55,736][213365] Updated weights for policy 0, policy_version 27246 (0.0009) [2023-02-24 20:38:58,431][213384] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 20:38:58,722][213365] Updated weights for policy 0, policy_version 27256 (0.0009) [2023-02-24 20:39:00,243][213332] Fps is (10 sec: 13926.6, 60 sec: 13448.6, 300 sec: 13496.0). Total num frames: 111661056. Throughput: 0: 3343.4. Samples: 2911010. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:39:00,243][213332] Avg episode reward: [(0, '26.160')] [2023-02-24 20:39:01,692][213365] Updated weights for policy 0, policy_version 27266 (0.0009) [2023-02-24 20:39:04,683][213365] Updated weights for policy 0, policy_version 27276 (0.0009) [2023-02-24 20:39:05,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13482.1). Total num frames: 111726592. Throughput: 0: 3387.8. Samples: 2921276. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:39:05,243][213332] Avg episode reward: [(0, '26.160')] [2023-02-24 20:39:07,700][213365] Updated weights for policy 0, policy_version 27286 (0.0009) [2023-02-24 20:39:08,456][213384] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 20:39:10,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13482.1). Total num frames: 111796224. Throughput: 0: 3400.6. Samples: 2941816. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:39:10,243][213332] Avg episode reward: [(0, '26.160')] [2023-02-24 20:39:10,697][213365] Updated weights for policy 0, policy_version 27296 (0.0009) [2023-02-24 20:39:10,811][213367] DAMAGECOUNT value on done: 96724.0 [2023-02-24 20:39:10,812][213367] Sum rewards: 13.225, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.585', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.028', 'weapon4': '0.092', 'AMMO3': '0.118', 'AMMO4': '0.141', 'WEAPON4': '0.200', 'weapon5': '0.316', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'weapon2': '0.924', 'HITCOUNT': '1.230', 'weapon3': '2.390', 'DAMAGECOUNT': '5.136', 'FRAGCOUNT': '12.000'} [2023-02-24 20:39:11,111][213372] DAMAGECOUNT value on done: 99374.0 [2023-02-24 20:39:11,111][213372] Sum rewards: 34.973, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.588', 'ARMOR': '0.008', 'AMMO5': '0.035', 'AMMO2': '0.042', 'AMMO3': '0.137', 'AMMO4': '0.211', 'weapon4': '0.392', 'weapon5': '0.468', 'WEAPON4': '0.550', 'weapon2': '0.626', 'WEAPON5': '0.750', 'WEAPON3': '0.900', 'HITCOUNT': '1.870', 'weapon3': '2.102', 'DAMAGECOUNT': '9.969', 'FRAGCOUNT': '32.000'} [2023-02-24 20:39:11,122][213367] DAMAGECOUNT value on done: 101001.0 [2023-02-24 20:39:11,122][213367] Sum rewards: 28.348, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.640', 'ARMOR': '0.004', 'AMMO2': '0.010', 'AMMO5': '0.022', 'AMMO4': '0.051', 'AMMO3': '0.107', 'WEAPON4': '0.350', 'weapon5': '0.418', 'weapon2': '0.586', 'weapon4': '0.674', 'WEAPON5': '0.750', 'WEAPON3': '0.800', 'HITCOUNT': '1.700', 'weapon3': '1.786', 'DAMAGECOUNT': '8.229', 'FRAGCOUNT': '23.000'} [2023-02-24 20:39:11,425][213372] DAMAGECOUNT value on done: 99997.0 [2023-02-24 20:39:11,425][213372] Sum rewards: 31.619, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.828', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO3': '0.139', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'weapon5': '0.262', 'weapon4': '0.284', 'WEAPON5': '0.300', 'weapon2': '0.884', 'WEAPON3': '0.950', 'HITCOUNT': '1.870', 'weapon3': '2.294', 'DAMAGECOUNT': '8.877', 'FRAGCOUNT': '27.000'} [2023-02-24 20:39:11,432][213367] DAMAGECOUNT value on done: 97193.0 [2023-02-24 20:39:11,433][213367] Sum rewards: 23.750, reward structure: {'DEATHCOUNT': '-10.500', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO2': '0.026', 'HEALTH': '0.115', 'AMMO4': '0.129', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'weapon4': '0.204', 'weapon5': '0.352', 'WEAPON5': '0.550', 'weapon2': '0.722', 'WEAPON3': '0.750', 'HITCOUNT': '1.800', 'weapon3': '2.312', 'DAMAGECOUNT': '7.914', 'FRAGCOUNT': '19.000'} [2023-02-24 20:39:11,445][213366] DAMAGECOUNT value on done: 96997.0 [2023-02-24 20:39:11,445][213366] Sum rewards: 23.294, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.413', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.016', 'AMMO4': '0.078', 'AMMO3': '0.090', 'WEAPON4': '0.150', 'weapon4': '0.398', 'weapon5': '0.418', 'WEAPON5': '0.500', 'weapon2': '0.544', 'WEAPON3': '0.650', 'HITCOUNT': '1.460', 'weapon3': '2.290', 'DAMAGECOUNT': '6.594', 'FRAGCOUNT': '18.000'} [2023-02-24 20:39:11,746][213367] DAMAGECOUNT value on done: 96849.0 [2023-02-24 20:39:11,746][213367] Sum rewards: 21.952, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.560', 'AMMO2': '0.006', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'AMMO3': '0.059', 'WEAPON4': '0.100', 'weapon5': '0.314', 'WEAPON3': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.548', 'weapon2': '0.770', 'HITCOUNT': '1.120', 'weapon3': '1.708', 'DAMAGECOUNT': '4.725', 'FRAGCOUNT': '16.000'} [2023-02-24 20:39:11,752][213366] DAMAGECOUNT value on done: 103992.0 [2023-02-24 20:39:11,753][213366] Sum rewards: 24.954, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.038', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.145', 'WEAPON4': '0.200', 'weapon5': '0.274', 'weapon4': '0.390', 'WEAPON5': '0.400', 'weapon2': '0.784', 'WEAPON3': '0.950', 'weapon3': '2.102', 'HITCOUNT': '2.110', 'DAMAGECOUNT': '8.478', 'FRAGCOUNT': '23.000'} [2023-02-24 20:39:11,756][213382] DAMAGECOUNT value on done: 95905.0 [2023-02-24 20:39:11,757][213382] Sum rewards: 37.379, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.898', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.014', 'AMMO4': '0.059', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'weapon5': '0.168', 'WEAPON5': '0.300', 'weapon4': '0.328', 'weapon2': '0.808', 'WEAPON3': '1.100', 'HITCOUNT': '2.360', 'weapon3': '2.398', 'DAMAGECOUNT': '9.654', 'FRAGCOUNT': '33.000'} [2023-02-24 20:39:11,760][213383] DAMAGECOUNT value on done: 98793.0 [2023-02-24 20:39:11,761][213383] Sum rewards: 21.141, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.280', 'ARMOR': '0.005', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon5': '0.154', 'AMMO3': '0.175', 'AMMO4': '0.196', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.496', 'weapon2': '0.724', 'WEAPON3': '1.050', 'HITCOUNT': '1.740', 'weapon3': '1.990', 'DAMAGECOUNT': '6.486', 'FRAGCOUNT': '23.000'} [2023-02-24 20:39:12,030][213372] DAMAGECOUNT value on done: 100514.0 [2023-02-24 20:39:12,030][213372] Sum rewards: 26.744, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.945', 'AMMO5': '0.017', 'AMMO2': '0.033', 'AMMO3': '0.095', 'AMMO4': '0.163', 'WEAPON4': '0.250', 'ARMOR': '0.427', 'weapon4': '0.460', 'weapon5': '0.470', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'weapon2': '0.696', 'HITCOUNT': '1.490', 'weapon3': '2.032', 'DAMAGECOUNT': '6.606', 'FRAGCOUNT': '22.000'} [2023-02-24 20:39:12,063][213382] DAMAGECOUNT value on done: 100152.0 [2023-02-24 20:39:12,063][213383] DAMAGECOUNT value on done: 102186.0 [2023-02-24 20:39:12,063][213383] Sum rewards: 23.633, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.466', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.032', 'AMMO3': '0.113', 'AMMO4': '0.160', 'weapon5': '0.238', 'weapon4': '0.432', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'weapon2': '1.048', 'HITCOUNT': '1.480', 'weapon3': '1.916', 'DAMAGECOUNT': '6.453', 'FRAGCOUNT': '22.000'} [2023-02-24 20:39:12,063][213382] Sum rewards: 19.343, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.730', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.019', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'weapon4': '0.126', 'weapon5': '0.146', 'WEAPON5': '0.200', 'WEAPON3': '0.800', 'weapon2': '0.950', 'HITCOUNT': '1.150', 'weapon3': '2.314', 'DAMAGECOUNT': '4.662', 'FRAGCOUNT': '18.000'} [2023-02-24 20:39:12,107][213366] DAMAGECOUNT value on done: 100524.0 [2023-02-24 20:39:12,108][213366] Sum rewards: 25.585, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.910', 'AMMO5': '0.016', 'AMMO2': '0.035', 'AMMO3': '0.135', 'AMMO4': '0.177', 'weapon5': '0.328', 'ARMOR': '0.445', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.704', 'weapon2': '0.768', 'WEAPON3': '0.800', 'weapon3': '1.632', 'HITCOUNT': '2.010', 'DAMAGECOUNT': '8.394', 'FRAGCOUNT': '23.000'} [2023-02-24 20:39:12,136][213368] DAMAGECOUNT value on done: 96157.0 [2023-02-24 20:39:12,137][213368] Sum rewards: 22.670, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.345', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.009', 'weapon7': '0.048', 'AMMO3': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.648', 'WEAPON3': '0.650', 'weapon4': '0.904', 'HITCOUNT': '1.610', 'weapon3': '1.622', 'DAMAGECOUNT': '6.186', 'FRAGCOUNT': '18.000'} [2023-02-24 20:39:12,328][213372] DAMAGECOUNT value on done: 97642.0 [2023-02-24 20:39:12,328][213372] Sum rewards: 26.005, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.908', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.142', 'weapon4': '0.162', 'WEAPON5': '0.350', 'weapon5': '0.350', 'weapon2': '0.890', 'WEAPON3': '0.900', 'HITCOUNT': '1.620', 'weapon3': '2.264', 'DAMAGECOUNT': '7.536', 'FRAGCOUNT': '23.000'} [2023-02-24 20:39:12,332][213369] DAMAGECOUNT value on done: 101284.0 [2023-02-24 20:39:12,332][213369] Sum rewards: 29.172, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.630', 'AMMO5': '0.022', 'AMMO2': '0.039', 'weapon4': '0.100', 'AMMO3': '0.155', 'AMMO4': '0.196', 'weapon5': '0.288', 'WEAPON4': '0.400', 'WEAPON5': '0.650', 'weapon2': '0.656', 'WEAPON3': '0.950', 'HITCOUNT': '1.980', 'weapon3': '2.592', 'DAMAGECOUNT': '8.523', 'FRAGCOUNT': '27.000'} [2023-02-24 20:39:12,377][213382] DAMAGECOUNT value on done: 95754.0 [2023-02-24 20:39:12,377][213382] Sum rewards: 17.611, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.550', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.037', 'AMMO3': '0.117', 'AMMO4': '0.183', 'weapon5': '0.242', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.602', 'WEAPON3': '0.700', 'weapon2': '1.046', 'HITCOUNT': '1.470', 'weapon3': '1.754', 'DAMAGECOUNT': '6.036', 'FRAGCOUNT': '16.000'} [2023-02-24 20:39:12,413][213366] DAMAGECOUNT value on done: 98770.0 [2023-02-24 20:39:12,413][213366] Sum rewards: 27.191, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.860', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.143', 'weapon4': '0.246', 'WEAPON4': '0.250', 'weapon5': '0.294', 'WEAPON5': '0.300', 'weapon2': '0.826', 'WEAPON3': '0.950', 'HITCOUNT': '2.050', 'weapon3': '2.364', 'DAMAGECOUNT': '8.049', 'FRAGCOUNT': '24.000'} [2023-02-24 20:39:12,443][213368] DAMAGECOUNT value on done: 101069.0 [2023-02-24 20:39:12,443][213368] Sum rewards: 29.118, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.420', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.107', 'AMMO4': '0.170', 'weapon5': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.424', 'WEAPON3': '0.650', 'weapon2': '1.026', 'HITCOUNT': '1.850', 'weapon3': '2.010', 'DAMAGECOUNT': '7.617', 'FRAGCOUNT': '27.000'} [2023-02-24 20:39:12,624][213384] DAMAGECOUNT value on done: 99604.0 [2023-02-24 20:39:12,625][213384] Sum rewards: 16.126, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.330', 'AMMO2': '0.009', 'AMMO5': '0.022', 'AMMO4': '0.047', 'AMMO3': '0.100', 'WEAPON4': '0.300', 'weapon5': '0.336', 'weapon4': '0.446', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'weapon2': '1.072', 'HITCOUNT': '1.500', 'weapon3': '1.654', 'DAMAGECOUNT': '6.069', 'FRAGCOUNT': '13.000'} [2023-02-24 20:39:12,627][213383] DAMAGECOUNT value on done: 97583.0 [2023-02-24 20:39:12,627][213383] Sum rewards: 23.043, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.118', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.026', 'weapon7': '0.078', 'AMMO3': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'weapon5': '0.308', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.660', 'weapon2': '0.848', 'HITCOUNT': '1.420', 'weapon3': '1.464', 'DAMAGECOUNT': '6.276', 'FRAGCOUNT': '16.500'} [2023-02-24 20:39:12,639][213369] DAMAGECOUNT value on done: 102691.0 [2023-02-24 20:39:12,640][213369] Sum rewards: 23.107, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.480', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'AMMO3': '0.079', 'AMMO4': '0.137', 'WEAPON4': '0.250', 'weapon5': '0.370', 'weapon2': '0.456', 'WEAPON5': '0.550', 'WEAPON3': '0.550', 'weapon4': '0.816', 'HITCOUNT': '1.130', 'weapon3': '1.940', 'DAMAGECOUNT': '5.472', 'FRAGCOUNT': '18.000'} [2023-02-24 20:39:12,687][213382] DAMAGECOUNT value on done: 98997.0 [2023-02-24 20:39:12,687][213382] Sum rewards: 21.738, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.430', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.012', 'AMMO3': '0.050', 'WEAPON4': '0.100', 'weapon5': '0.190', 'weapon4': '0.276', 'WEAPON5': '0.400', 'WEAPON3': '0.500', 'weapon2': '0.802', 'HITCOUNT': '1.230', 'weapon3': '1.732', 'DAMAGECOUNT': '4.881', 'FRAGCOUNT': '16.000'} [2023-02-24 20:39:12,742][213368] DAMAGECOUNT value on done: 101707.0 [2023-02-24 20:39:12,742][213368] Sum rewards: 25.263, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.374', 'ARMOR': '0.004', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'AMMO3': '0.134', 'AMMO4': '0.161', 'weapon5': '0.214', 'weapon4': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'weapon2': '1.162', 'HITCOUNT': '1.630', 'weapon3': '1.990', 'DAMAGECOUNT': '7.173', 'FRAGCOUNT': '23.000'} [2023-02-24 20:39:12,917][213383] DAMAGECOUNT value on done: 91494.0 [2023-02-24 20:39:12,918][213383] Sum rewards: 25.943, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.044', 'AMMO2': '0.009', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.042', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'weapon5': '0.254', 'weapon4': '0.296', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'weapon2': '0.676', 'HITCOUNT': '1.570', 'weapon3': '2.434', 'DAMAGECOUNT': '6.405', 'FRAGCOUNT': '22.000'} [2023-02-24 20:39:12,943][213384] DAMAGECOUNT value on done: 91909.0 [2023-02-24 20:39:12,943][213384] Sum rewards: 25.703, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.760', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.115', 'WEAPON5': '0.350', 'weapon5': '0.360', 'WEAPON3': '0.750', 'weapon2': '0.866', 'HITCOUNT': '1.430', 'weapon3': '2.442', 'DAMAGECOUNT': '5.775', 'FRAGCOUNT': '21.000'} [2023-02-24 20:39:13,039][213369] DAMAGECOUNT value on done: 99705.0 [2023-02-24 20:39:13,040][213369] Sum rewards: 26.764, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.261', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.034', 'AMMO3': '0.087', 'AMMO4': '0.168', 'weapon5': '0.380', 'WEAPON4': '0.450', 'WEAPON3': '0.500', 'WEAPON5': '0.550', 'weapon4': '0.554', 'weapon2': '0.696', 'HITCOUNT': '1.660', 'weapon3': '1.918', 'DAMAGECOUNT': '7.749', 'FRAGCOUNT': '22.000'} [2023-02-24 20:39:13,047][213368] DAMAGECOUNT value on done: 101156.0 [2023-02-24 20:39:13,048][213368] Sum rewards: 22.399, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.026', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'AMMO4': '0.130', 'WEAPON5': '0.200', 'weapon5': '0.226', 'HEALTH': '0.275', 'weapon4': '0.368', 'WEAPON3': '0.400', 'weapon2': '0.824', 'HITCOUNT': '1.280', 'weapon3': '2.216', 'DAMAGECOUNT': '5.028', 'FRAGCOUNT': '15.000'} [2023-02-24 20:39:13,130][213384] DAMAGECOUNT value on done: 103100.0 [2023-02-24 20:39:13,131][213384] Sum rewards: 21.064, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.490', 'AMMO5': '0.035', 'AMMO2': '0.052', 'AMMO3': '0.136', 'AMMO4': '0.258', 'WEAPON4': '0.300', 'weapon5': '0.494', 'weapon4': '0.616', 'weapon2': '0.654', 'WEAPON3': '0.850', 'WEAPON5': '0.850', 'HITCOUNT': '1.470', 'weapon3': '1.650', 'DAMAGECOUNT': '7.188', 'FRAGCOUNT': '20.000'} [2023-02-24 20:39:13,352][213369] DAMAGECOUNT value on done: 90836.0 [2023-02-24 20:39:13,353][213369] Sum rewards: 23.013, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.135', 'ARMOR': '0.004', 'AMMO2': '0.010', 'AMMO5': '0.022', 'AMMO4': '0.047', 'AMMO3': '0.110', 'weapon5': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'weapon2': '0.562', 'WEAPON3': '0.800', 'weapon4': '0.920', 'weapon3': '1.856', 'HITCOUNT': '1.880', 'DAMAGECOUNT': '6.426', 'FRAGCOUNT': '20.000'} [2023-02-24 20:39:13,440][213384] DAMAGECOUNT value on done: 100045.0 [2023-02-24 20:39:13,441][213384] Sum rewards: 22.005, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.810', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO2': '0.033', 'AMMO3': '0.083', 'AMMO4': '0.163', 'WEAPON4': '0.350', 'weapon4': '0.356', 'weapon5': '0.480', 'WEAPON3': '0.600', 'WEAPON5': '0.650', 'weapon2': '0.808', 'HITCOUNT': '1.270', 'weapon3': '1.866', 'DAMAGECOUNT': '6.108', 'FRAGCOUNT': '18.500'} [2023-02-24 20:39:13,725][213365] Updated weights for policy 0, policy_version 27306 (0.0008) [2023-02-24 20:39:15,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13516.8, 300 sec: 13482.1). Total num frames: 111865856. Throughput: 0: 3405.2. Samples: 2962220. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:39:15,243][213332] Avg episode reward: [(0, '25.688')] [2023-02-24 20:39:16,679][213365] Updated weights for policy 0, policy_version 27316 (0.0009) [2023-02-24 20:39:19,659][213365] Updated weights for policy 0, policy_version 27326 (0.0009) [2023-02-24 20:39:20,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13468.2). Total num frames: 111931392. Throughput: 0: 3408.4. Samples: 2972550. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:39:20,243][213332] Avg episode reward: [(0, '25.688')] [2023-02-24 20:39:22,650][213365] Updated weights for policy 0, policy_version 27336 (0.0009) [2023-02-24 20:39:25,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13585.1, 300 sec: 13482.1). Total num frames: 112001024. Throughput: 0: 3412.4. Samples: 2993078. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:39:25,243][213332] Avg episode reward: [(0, '25.688')] [2023-02-24 20:39:25,668][213365] Updated weights for policy 0, policy_version 27346 (0.0009) [2023-02-24 20:39:27,295][213366] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-24 20:39:28,654][213365] Updated weights for policy 0, policy_version 27356 (0.0009) [2023-02-24 20:39:30,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13653.3, 300 sec: 13482.1). Total num frames: 112070656. Throughput: 0: 3416.0. Samples: 3013644. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:39:30,243][213332] Avg episode reward: [(0, '25.688')] [2023-02-24 20:39:30,569][213367] DAMAGECOUNT value on done: 98834.0 [2023-02-24 20:39:30,570][213367] Sum rewards: 23.369, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.676', 'ARMOR': '0.005', 'AMMO2': '0.014', 'AMMO5': '0.015', 'AMMO4': '0.067', 'AMMO3': '0.102', 'WEAPON4': '0.300', 'weapon5': '0.332', 'weapon4': '0.332', 'WEAPON5': '0.450', 'weapon2': '0.602', 'WEAPON3': '0.650', 'HITCOUNT': '1.520', 'weapon3': '2.326', 'DAMAGECOUNT': '6.330', 'FRAGCOUNT': '21.000'} [2023-02-24 20:39:30,864][213372] DAMAGECOUNT value on done: 100883.0 [2023-02-24 20:39:30,864][213372] Sum rewards: 14.973, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.070', 'AMMO2': '0.015', 'AMMO5': '0.015', 'AMMO4': '0.073', 'AMMO3': '0.131', 'WEAPON4': '0.200', 'weapon4': '0.294', 'weapon5': '0.406', 'WEAPON5': '0.500', 'weapon2': '0.544', 'WEAPON3': '0.900', 'HITCOUNT': '1.070', 'weapon3': '2.368', 'DAMAGECOUNT': '4.527', 'FRAGCOUNT': '15.000'} [2023-02-24 20:39:30,871][213367] DAMAGECOUNT value on done: 103587.0 [2023-02-24 20:39:30,871][213367] Sum rewards: 25.836, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.688', 'AMMO2': '0.008', 'AMMO5': '0.020', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'weapon4': '0.060', 'AMMO3': '0.161', 'weapon5': '0.242', 'WEAPON5': '0.450', 'weapon2': '0.486', 'WEAPON3': '1.000', 'HITCOUNT': '1.830', 'weapon3': '2.922', 'DAMAGECOUNT': '7.758', 'FRAGCOUNT': '22.000'} [2023-02-24 20:39:31,119][213366] DAMAGECOUNT value on done: 99879.0 [2023-02-24 20:39:31,119][213366] Sum rewards: 25.395, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.993', 'AMMO2': '0.026', 'AMMO5': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.217', 'weapon5': '0.222', 'weapon2': '0.272', 'WEAPON4': '0.350', 'weapon4': '0.452', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'HITCOUNT': '1.930', 'weapon3': '2.720', 'DAMAGECOUNT': '8.394', 'FRAGCOUNT': '27.000'} [2023-02-24 20:39:31,166][213372] DAMAGECOUNT value on done: 103161.0 [2023-02-24 20:39:31,166][213372] Sum rewards: 24.780, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.778', 'ARMOR': '0.004', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'AMMO5': '0.034', 'AMMO4': '0.099', 'AMMO3': '0.231', 'weapon4': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.312', 'weapon5': '0.328', 'WEAPON5': '0.650', 'WEAPON3': '1.400', 'HITCOUNT': '1.920', 'weapon3': '2.736', 'DAMAGECOUNT': '9.492', 'FRAGCOUNT': '25.500'} [2023-02-24 20:39:31,171][213367] DAMAGECOUNT value on done: 99931.0 [2023-02-24 20:39:31,171][213367] Sum rewards: 27.163, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.970', 'AMMO5': '0.012', 'AMMO2': '0.014', 'WEAPON1': '0.040', 'AMMO4': '0.067', 'AMMO3': '0.123', 'weapon5': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.666', 'weapon2': '0.818', 'WEAPON3': '0.850', 'HITCOUNT': '1.900', 'weapon3': '1.976', 'DAMAGECOUNT': '8.184', 'FRAGCOUNT': '24.000'} [2023-02-24 20:39:31,427][213366] DAMAGECOUNT value on done: 106079.0 [2023-02-24 20:39:31,428][213366] Sum rewards: 26.717, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.862', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO3': '0.084', 'AMMO4': '0.116', 'weapon5': '0.226', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.386', 'WEAPON3': '0.500', 'weapon2': '0.674', 'HITCOUNT': '1.660', 'weapon3': '1.768', 'DAMAGECOUNT': '6.261', 'FRAGCOUNT': '22.000'} [2023-02-24 20:39:31,443][213382] DAMAGECOUNT value on done: 97792.0 [2023-02-24 20:39:31,444][213382] Sum rewards: 26.465, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.018', 'weapon4': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'WEAPON5': '0.250', 'HEALTH': '0.258', 'weapon5': '0.278', 'WEAPON3': '0.450', 'HITCOUNT': '1.200', 'weapon2': '1.438', 'weapon3': '2.002', 'DAMAGECOUNT': '5.661', 'FRAGCOUNT': '20.000'} [2023-02-24 20:39:31,476][213367] DAMAGECOUNT value on done: 99040.0 [2023-02-24 20:39:31,477][213367] Sum rewards: 17.973, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.104', 'AMMO5': '0.017', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.140', 'WEAPON4': '0.200', 'weapon5': '0.212', 'weapon4': '0.246', 'WEAPON5': '0.400', 'ARMOR': '0.404', 'weapon2': '0.734', 'WEAPON3': '0.900', 'HITCOUNT': '1.500', 'weapon3': '2.352', 'DAMAGECOUNT': '6.573', 'FRAGCOUNT': '16.500'} [2023-02-24 20:39:31,480][213383] DAMAGECOUNT value on done: 101091.0 [2023-02-24 20:39:31,480][213383] Sum rewards: 24.168, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.579', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.079', 'AMMO3': '0.104', 'weapon5': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.322', 'WEAPON3': '0.700', 'weapon2': '1.256', 'HITCOUNT': '1.630', 'weapon3': '1.970', 'DAMAGECOUNT': '6.894', 'FRAGCOUNT': '21.000'} [2023-02-24 20:39:31,744][213365] Updated weights for policy 0, policy_version 27366 (0.0009) [2023-02-24 20:39:31,748][213382] DAMAGECOUNT value on done: 101439.0 [2023-02-24 20:39:31,748][213382] Sum rewards: 14.406, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.050', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon7': '0.048', 'AMMO3': '0.063', 'AMMO4': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.234', 'weapon4': '0.276', 'WEAPON3': '0.350', 'HITCOUNT': '0.980', 'weapon2': '0.996', 'weapon3': '1.974', 'DAMAGECOUNT': '3.861', 'FRAGCOUNT': '10.000'} [2023-02-24 20:39:31,777][213372] DAMAGECOUNT value on done: 102901.0 [2023-02-24 20:39:31,778][213372] Sum rewards: 23.256, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.442', 'AMMO2': '0.026', 'AMMO5': '0.028', 'AMMO4': '0.131', 'AMMO3': '0.153', 'WEAPON4': '0.350', 'weapon5': '0.370', 'weapon4': '0.394', 'WEAPON5': '0.700', 'weapon2': '0.844', 'WEAPON3': '0.900', 'HITCOUNT': '1.550', 'weapon3': '1.840', 'DAMAGECOUNT': '7.161', 'FRAGCOUNT': '23.000'} [2023-02-24 20:39:31,780][213366] DAMAGECOUNT value on done: 103318.0 [2023-02-24 20:39:31,780][213366] Sum rewards: 32.903, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.611', 'AMMO2': '0.005', 'AMMO5': '0.011', 'AMMO4': '0.026', 'AMMO3': '0.113', 'weapon5': '0.196', 'WEAPON5': '0.250', 'WEAPON3': '0.750', 'weapon2': '1.102', 'HITCOUNT': '2.060', 'weapon3': '2.368', 'DAMAGECOUNT': '8.382', 'FRAGCOUNT': '25.000'} [2023-02-24 20:39:31,792][213383] DAMAGECOUNT value on done: 104795.0 [2023-02-24 20:39:31,792][213383] Sum rewards: 29.480, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.953', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'weapon4': '0.060', 'AMMO3': '0.138', 'weapon5': '0.230', 'WEAPON5': '0.450', 'weapon2': '0.628', 'WEAPON3': '0.850', 'HITCOUNT': '1.670', 'weapon3': '2.702', 'DAMAGECOUNT': '7.827', 'FRAGCOUNT': '24.000'} [2023-02-24 20:39:31,832][213368] DAMAGECOUNT value on done: 98348.0 [2023-02-24 20:39:31,832][213368] Sum rewards: 22.737, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.135', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.024', 'weapon5': '0.088', 'AMMO4': '0.117', 'AMMO3': '0.149', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.456', 'weapon2': '0.552', 'WEAPON3': '1.050', 'HITCOUNT': '1.660', 'weapon3': '2.630', 'DAMAGECOUNT': '6.573', 'FRAGCOUNT': '23.000'} [2023-02-24 20:39:32,064][213382] DAMAGECOUNT value on done: 97833.0 [2023-02-24 20:39:32,065][213382] Sum rewards: 21.395, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.695', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO2': '0.034', 'weapon5': '0.136', 'AMMO3': '0.170', 'AMMO4': '0.170', 'WEAPON4': '0.300', 'weapon2': '0.464', 'ARMOR': '0.485', 'WEAPON5': '0.500', 'weapon4': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '1.610', 'weapon3': '2.344', 'DAMAGECOUNT': '6.237', 'FRAGCOUNT': '22.000'} [2023-02-24 20:39:32,068][213369] DAMAGECOUNT value on done: 103190.0 [2023-02-24 20:39:32,069][213369] Sum rewards: 18.329, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.778', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon7': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.109', 'weapon5': '0.138', 'AMMO3': '0.140', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.610', 'WEAPON3': '0.800', 'weapon2': '1.066', 'HITCOUNT': '1.520', 'weapon3': '1.764', 'DAMAGECOUNT': '5.718', 'FRAGCOUNT': '17.000'} [2023-02-24 20:39:32,085][213372] DAMAGECOUNT value on done: 99919.0 [2023-02-24 20:39:32,086][213372] Sum rewards: 16.455, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.079', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.051', 'AMMO3': '0.174', 'weapon5': '0.222', 'AMMO4': '0.254', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.578', 'weapon4': '0.690', 'WEAPON3': '1.050', 'HITCOUNT': '1.690', 'weapon3': '2.056', 'DAMAGECOUNT': '6.831', 'FRAGCOUNT': '18.000'} [2023-02-24 20:39:32,092][213366] DAMAGECOUNT value on done: 100450.0 [2023-02-24 20:39:32,093][213366] Sum rewards: 21.598, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.940', 'AMMO2': '0.015', 'AMMO5': '0.016', 'AMMO4': '0.076', 'AMMO3': '0.097', 'weapon4': '0.144', 'WEAPON4': '0.200', 'weapon5': '0.354', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon2': '0.834', 'HITCOUNT': '1.090', 'weapon3': '2.122', 'DAMAGECOUNT': '5.040', 'FRAGCOUNT': '19.000'} [2023-02-24 20:39:32,139][213368] DAMAGECOUNT value on done: 103097.0 [2023-02-24 20:39:32,140][213368] Sum rewards: 20.141, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.502', 'WEAPON1': '0.010', 'AMMO5': '0.025', 'AMMO2': '0.032', 'AMMO3': '0.148', 'AMMO4': '0.161', 'WEAPON4': '0.300', 'weapon5': '0.338', 'weapon4': '0.396', 'WEAPON5': '0.650', 'weapon2': '0.664', 'WEAPON3': '0.900', 'HITCOUNT': '1.170', 'weapon3': '2.030', 'DAMAGECOUNT': '6.069', 'FRAGCOUNT': '18.000'} [2023-02-24 20:39:32,373][213382] DAMAGECOUNT value on done: 101684.0 [2023-02-24 20:39:32,373][213382] Sum rewards: 25.817, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.974', 'AMMO2': '0.014', 'AMMO5': '0.016', 'weapon4': '0.070', 'AMMO4': '0.071', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'weapon5': '0.328', 'WEAPON5': '0.450', 'weapon2': '0.696', 'WEAPON3': '0.800', 'HITCOUNT': '1.540', 'weapon3': '2.470', 'DAMAGECOUNT': '8.058', 'FRAGCOUNT': '21.000'} [2023-02-24 20:39:32,377][213369] DAMAGECOUNT value on done: 105212.0 [2023-02-24 20:39:32,377][213369] Sum rewards: 29.343, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.950', 'AMMO5': '0.019', 'WEAPON1': '0.030', 'AMMO2': '0.034', 'weapon7': '0.058', 'AMMO3': '0.089', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.169', 'weapon2': '0.222', 'WEAPON4': '0.300', 'weapon5': '0.330', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'weapon4': '0.646', 'HITCOUNT': '1.770', 'weapon3': '2.112', 'DAMAGECOUNT': '7.563', 'FRAGCOUNT': '23.000'} [2023-02-24 20:39:32,408][213383] DAMAGECOUNT value on done: 100712.0 [2023-02-24 20:39:32,408][213383] Sum rewards: 32.728, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.006', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO5': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'weapon4': '0.240', 'weapon5': '0.252', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'weapon2': '0.922', 'weapon3': '1.958', 'HITCOUNT': '2.060', 'DAMAGECOUNT': '9.387', 'FRAGCOUNT': '27.000'} [2023-02-24 20:39:32,417][213384] DAMAGECOUNT value on done: 102224.0 [2023-02-24 20:39:32,418][213384] Sum rewards: 27.533, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.476', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO5': '0.020', 'AMMO4': '0.070', 'AMMO3': '0.139', 'WEAPON4': '0.250', 'weapon4': '0.282', 'weapon5': '0.342', 'WEAPON5': '0.550', 'weapon2': '0.582', 'WEAPON3': '0.900', 'HITCOUNT': '2.020', 'weapon3': '2.470', 'DAMAGECOUNT': '7.860', 'FRAGCOUNT': '24.000'} [2023-02-24 20:39:32,436][213368] DAMAGECOUNT value on done: 103561.0 [2023-02-24 20:39:32,437][213368] Sum rewards: 18.309, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.201', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.075', 'AMMO4': '0.112', 'weapon5': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.449', 'WEAPON3': '0.450', 'weapon4': '0.616', 'weapon2': '0.658', 'HITCOUNT': '1.190', 'weapon3': '1.998', 'DAMAGECOUNT': '5.547', 'FRAGCOUNT': '14.000'} [2023-02-24 20:39:32,716][213383] DAMAGECOUNT value on done: 94260.0 [2023-02-24 20:39:32,716][213383] Sum rewards: 31.708, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.752', 'AMMO5': '0.026', 'AMMO2': '0.034', 'weapon7': '0.038', 'AMMO3': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.172', 'weapon4': '0.226', 'WEAPON4': '0.350', 'weapon5': '0.378', 'WEAPON3': '0.650', 'WEAPON5': '0.700', 'weapon2': '0.928', 'HITCOUNT': '1.930', 'weapon3': '2.080', 'DAMAGECOUNT': '8.298', 'FRAGCOUNT': '27.000'} [2023-02-24 20:39:32,721][213384] DAMAGECOUNT value on done: 94157.0 [2023-02-24 20:39:32,721][213384] Sum rewards: 18.668, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.170', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.042', 'weapon7': '0.060', 'AMMO3': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO4': '0.209', 'weapon5': '0.314', 'weapon4': '0.402', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '0.750', 'weapon2': '0.868', 'HITCOUNT': '1.230', 'weapon3': '1.916', 'DAMAGECOUNT': '6.264', 'FRAGCOUNT': '19.000'} [2023-02-24 20:39:32,733][213368] DAMAGECOUNT value on done: 103684.0 [2023-02-24 20:39:32,733][213368] Sum rewards: 27.437, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.875', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.106', 'weapon5': '0.194', 'weapon4': '0.254', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'weapon2': '1.306', 'HITCOUNT': '1.760', 'weapon3': '2.006', 'DAMAGECOUNT': '7.584', 'FRAGCOUNT': '22.000'} [2023-02-24 20:39:32,737][213369] DAMAGECOUNT value on done: 101827.0 [2023-02-24 20:39:32,738][213369] Sum rewards: 23.699, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.462', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.030', 'weapon7': '0.072', 'AMMO3': '0.077', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'weapon5': '0.282', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon4': '0.654', 'weapon2': '0.988', 'HITCOUNT': '1.290', 'weapon3': '1.528', 'DAMAGECOUNT': '6.366', 'FRAGCOUNT': '18.000'} [2023-02-24 20:39:32,895][213384] DAMAGECOUNT value on done: 105406.0 [2023-02-24 20:39:32,895][213384] Sum rewards: 23.033, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.198', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.016', 'AMMO4': '0.081', 'AMMO3': '0.083', 'WEAPON4': '0.150', 'weapon4': '0.164', 'WEAPON5': '0.350', 'weapon5': '0.478', 'WEAPON3': '0.550', 'weapon2': '1.166', 'HITCOUNT': '1.540', 'weapon3': '1.960', 'DAMAGECOUNT': '6.918', 'FRAGCOUNT': '16.500'} [2023-02-24 20:39:33,044][213369] DAMAGECOUNT value on done: 92320.0 [2023-02-24 20:39:33,044][213369] Sum rewards: 16.677, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.924', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.045', 'weapon7': '0.056', 'WEAPON1': '0.060', 'AMMO3': '0.065', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.170', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.450', 'weapon4': '0.674', 'weapon2': '0.952', 'HITCOUNT': '1.000', 'weapon3': '1.668', 'DAMAGECOUNT': '4.452', 'FRAGCOUNT': '13.000'} [2023-02-24 20:39:33,205][213384] DAMAGECOUNT value on done: 102721.0 [2023-02-24 20:39:33,206][213384] Sum rewards: 25.397, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.555', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.033', 'AMMO3': '0.146', 'AMMO4': '0.167', 'WEAPON4': '0.200', 'weapon5': '0.298', 'weapon4': '0.302', 'WEAPON5': '0.450', 'weapon2': '0.596', 'WEAPON3': '0.950', 'HITCOUNT': '1.830', 'weapon3': '2.424', 'DAMAGECOUNT': '8.028', 'FRAGCOUNT': '22.000'} [2023-02-24 20:39:34,848][213365] Updated weights for policy 0, policy_version 27376 (0.0009) [2023-02-24 20:39:35,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13468.2). Total num frames: 112136192. Throughput: 0: 3410.2. Samples: 3023554. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:39:35,243][213332] Avg episode reward: [(0, '25.248')] [2023-02-24 20:39:35,248][213369] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 20:39:37,946][213365] Updated weights for policy 0, policy_version 27386 (0.0009) [2023-02-24 20:39:40,243][213332] Fps is (10 sec: 13107.2, 60 sec: 13585.1, 300 sec: 13454.3). Total num frames: 112201728. Throughput: 0: 3394.0. Samples: 3043246. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:39:40,243][213332] Avg episode reward: [(0, '25.248')] [2023-02-24 20:39:40,971][213365] Updated weights for policy 0, policy_version 27396 (0.0009) [2023-02-24 20:39:43,945][213365] Updated weights for policy 0, policy_version 27406 (0.0009) [2023-02-24 20:39:44,297][213369] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 20:39:45,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13482.2). Total num frames: 112271360. Throughput: 0: 3395.0. Samples: 3063786. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:39:45,243][213332] Avg episode reward: [(0, '25.248')] [2023-02-24 20:39:46,939][213365] Updated weights for policy 0, policy_version 27416 (0.0009) [2023-02-24 20:39:48,460][213383] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 20:39:48,929][213384] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 20:39:49,910][213365] Updated weights for policy 0, policy_version 27426 (0.0009) [2023-02-24 20:39:50,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13653.4, 300 sec: 13509.9). Total num frames: 112340992. Throughput: 0: 3395.0. Samples: 3074052. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:39:50,243][213332] Avg episode reward: [(0, '25.248')] [2023-02-24 20:39:50,390][213367] DAMAGECOUNT value on done: 102095.0 [2023-02-24 20:39:50,391][213367] Sum rewards: 28.326, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.976', 'AMMO5': '0.026', 'AMMO2': '0.037', 'AMMO4': '0.186', 'AMMO3': '0.221', 'weapon5': '0.316', 'weapon2': '0.366', 'WEAPON4': '0.450', 'weapon4': '0.552', 'WEAPON5': '0.650', 'WEAPON3': '1.250', 'HITCOUNT': '2.100', 'weapon3': '2.344', 'DAMAGECOUNT': '9.303', 'FRAGCOUNT': '29.000'} [2023-02-24 20:39:50,708][213367] DAMAGECOUNT value on done: 105243.0 [2023-02-24 20:39:50,709][213367] Sum rewards: 16.286, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.090', 'ARMOR': '0.004', 'AMMO2': '0.010', 'AMMO5': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.049', 'AMMO3': '0.136', 'weapon4': '0.144', 'WEAPON4': '0.150', 'weapon5': '0.386', 'WEAPON5': '0.400', 'weapon2': '0.806', 'WEAPON3': '0.850', 'HITCOUNT': '1.170', 'weapon3': '2.258', 'DAMAGECOUNT': '4.968', 'FRAGCOUNT': '15.000'} [2023-02-24 20:39:50,741][213372] DAMAGECOUNT value on done: 103450.0 [2023-02-24 20:39:50,741][213372] Sum rewards: 29.801, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.524', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.022', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'weapon4': '0.354', 'weapon5': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'weapon2': '0.712', 'HITCOUNT': '1.600', 'weapon3': '2.192', 'DAMAGECOUNT': '7.701', 'FRAGCOUNT': '24.000'} [2023-02-24 20:39:51,035][213366] DAMAGECOUNT value on done: 102084.0 [2023-02-24 20:39:51,035][213366] Sum rewards: 22.733, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.060', 'AMMO2': '0.005', 'AMMO4': '0.022', 'AMMO5': '0.024', 'AMMO3': '0.117', 'WEAPON4': '0.200', 'weapon4': '0.272', 'weapon5': '0.390', 'weapon2': '0.604', 'WEAPON5': '0.700', 'WEAPON3': '0.800', 'HITCOUNT': '1.210', 'weapon3': '2.334', 'DAMAGECOUNT': '6.615', 'FRAGCOUNT': '19.000'} [2023-02-24 20:39:51,040][213367] DAMAGECOUNT value on done: 102954.0 [2023-02-24 20:39:51,040][213367] Sum rewards: 32.913, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.925', 'AMMO5': '0.025', 'AMMO2': '0.047', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.113', 'AMMO4': '0.236', 'weapon5': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'weapon4': '0.750', 'weapon2': '0.828', 'weapon3': '1.730', 'HITCOUNT': '2.370', 'DAMAGECOUNT': '9.069', 'FRAGCOUNT': '27.000'} [2023-02-24 20:39:51,053][213372] DAMAGECOUNT value on done: 105782.0 [2023-02-24 20:39:51,053][213372] Sum rewards: 28.838, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.168', 'AMMO2': '0.006', 'AMMO5': '0.026', 'AMMO4': '0.029', 'weapon7': '0.060', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.137', 'WEAPON7': '0.200', 'weapon4': '0.284', 'weapon5': '0.312', 'WEAPON5': '0.600', 'weapon2': '0.650', 'WEAPON3': '0.850', 'HITCOUNT': '1.620', 'weapon3': '2.278', 'DAMAGECOUNT': '7.863', 'FRAGCOUNT': '23.000'} [2023-02-24 20:39:51,332][213367] DAMAGECOUNT value on done: 101133.0 [2023-02-24 20:39:51,332][213367] Sum rewards: 24.755, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.272', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.043', 'AMMO3': '0.050', 'AMMO4': '0.217', 'weapon5': '0.326', 'WEAPON3': '0.350', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon4': '0.524', 'weapon2': '0.798', 'HITCOUNT': '1.450', 'weapon3': '1.866', 'DAMAGECOUNT': '6.279', 'FRAGCOUNT': '19.000'} [2023-02-24 20:39:51,333][213366] DAMAGECOUNT value on done: 109429.0 [2023-02-24 20:39:51,333][213366] Sum rewards: 25.572, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.562', 'AMMO2': '0.026', 'AMMO5': '0.029', 'AMMO4': '0.132', 'AMMO3': '0.233', 'weapon5': '0.274', 'WEAPON4': '0.350', 'weapon4': '0.352', 'WEAPON5': '0.700', 'weapon2': '0.706', 'WEAPON3': '1.350', 'HITCOUNT': '1.920', 'weapon3': '2.378', 'DAMAGECOUNT': '9.933', 'FRAGCOUNT': '25.000'} [2023-02-24 20:39:51,376][213382] DAMAGECOUNT value on done: 100386.0 [2023-02-24 20:39:51,377][213382] Sum rewards: 19.448, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.048', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.021', 'AMMO2': '0.029', 'AMMO4': '0.147', 'AMMO3': '0.172', 'weapon4': '0.176', 'WEAPON4': '0.350', 'weapon5': '0.416', 'WEAPON5': '0.550', 'weapon2': '0.552', 'WEAPON3': '1.050', 'HITCOUNT': '1.840', 'weapon3': '2.396', 'DAMAGECOUNT': '7.782', 'FRAGCOUNT': '18.000'} [2023-02-24 20:39:51,430][213383] DAMAGECOUNT value on done: 104200.0 [2023-02-24 20:39:51,430][213383] Sum rewards: 36.627, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.943', 'AMMO2': '0.024', 'AMMO5': '0.032', 'AMMO4': '0.119', 'AMMO3': '0.131', 'weapon2': '0.342', 'WEAPON4': '0.350', 'weapon5': '0.390', 'weapon4': '0.522', 'WEAPON5': '0.750', 'WEAPON3': '0.800', 'HITCOUNT': '2.030', 'weapon3': '2.368', 'DAMAGECOUNT': '8.961', 'FRAGCOUNT': '32.000'} [2023-02-24 20:39:51,632][213366] DAMAGECOUNT value on done: 105932.0 [2023-02-24 20:39:51,633][213366] Sum rewards: 22.034, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.924', 'AMMO5': '0.022', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.214', 'weapon5': '0.278', 'WEAPON4': '0.300', 'weapon4': '0.320', 'weapon2': '0.470', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '1.560', 'weapon3': '2.576', 'DAMAGECOUNT': '7.842', 'FRAGCOUNT': '24.000'} [2023-02-24 20:39:51,651][213368] DAMAGECOUNT value on done: 100592.0 [2023-02-24 20:39:51,652][213368] Sum rewards: 20.538, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.298', 'ARMOR': '0.008', 'AMMO5': '0.028', 'AMMO2': '0.034', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.140', 'weapon7': '0.160', 'AMMO4': '0.172', 'weapon5': '0.194', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.532', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'weapon2': '1.022', 'HITCOUNT': '1.520', 'weapon3': '1.616', 'DAMAGECOUNT': '6.720', 'FRAGCOUNT': '18.000'} [2023-02-24 20:39:51,656][213372] DAMAGECOUNT value on done: 105192.0 [2023-02-24 20:39:51,657][213372] Sum rewards: 28.470, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.235', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.066', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'AMMO4': '0.121', 'weapon5': '0.210', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'weapon2': '1.430', 'HITCOUNT': '1.530', 'weapon3': '1.896', 'DAMAGECOUNT': '6.873', 'FRAGCOUNT': '23.000'} [2023-02-24 20:39:51,685][213382] DAMAGECOUNT value on done: 103508.0 [2023-02-24 20:39:51,685][213382] Sum rewards: 25.437, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.499', 'AMMO2': '0.005', 'AMMO5': '0.013', 'AMMO4': '0.026', 'AMMO3': '0.113', 'weapon5': '0.308', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'weapon2': '0.726', 'HITCOUNT': '1.500', 'weapon3': '2.688', 'DAMAGECOUNT': '6.207', 'FRAGCOUNT': '20.000'} [2023-02-24 20:39:51,735][213383] DAMAGECOUNT value on done: 108346.0 [2023-02-24 20:39:51,736][213383] Sum rewards: 32.658, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.165', 'AMMO5': '0.017', 'AMMO2': '0.024', 'AMMO4': '0.121', 'AMMO3': '0.133', 'weapon5': '0.304', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.508', 'weapon2': '0.512', 'WEAPON3': '0.900', 'weapon3': '2.290', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '10.653', 'FRAGCOUNT': '28.000'} [2023-02-24 20:39:51,940][213366] DAMAGECOUNT value on done: 102490.0 [2023-02-24 20:39:51,941][213366] Sum rewards: 21.812, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.096', 'AMMO5': '0.014', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.104', 'weapon5': '0.170', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.380', 'ARMOR': '0.468', 'weapon4': '0.598', 'WEAPON3': '0.600', 'HITCOUNT': '1.540', 'weapon3': '1.930', 'DAMAGECOUNT': '6.120', 'FRAGCOUNT': '20.000'} [2023-02-24 20:39:51,959][213372] DAMAGECOUNT value on done: 101809.0 [2023-02-24 20:39:51,959][213372] Sum rewards: 19.015, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.192', 'AMMO5': '0.010', 'AMMO2': '0.023', 'WEAPON4': '0.050', 'AMMO4': '0.113', 'AMMO3': '0.126', 'weapon4': '0.172', 'weapon5': '0.226', 'WEAPON5': '0.300', 'WEAPON3': '0.900', 'weapon2': '0.906', 'HITCOUNT': '1.540', 'weapon3': '2.420', 'DAMAGECOUNT': '5.670', 'FRAGCOUNT': '16.000'} [2023-02-24 20:39:51,968][213368] DAMAGECOUNT value on done: 104629.0 [2023-02-24 20:39:51,968][213368] Sum rewards: 14.777, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.392', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'weapon2': '0.536', 'WEAPON3': '0.650', 'weapon4': '0.752', 'HITCOUNT': '0.970', 'weapon3': '1.656', 'DAMAGECOUNT': '4.596', 'FRAGCOUNT': '12.000'} [2023-02-24 20:39:51,980][213369] DAMAGECOUNT value on done: 106172.0 [2023-02-24 20:39:51,981][213369] Sum rewards: 36.846, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.396', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.009', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'weapon5': '0.308', 'weapon2': '0.522', 'WEAPON3': '1.000', 'HITCOUNT': '1.990', 'weapon3': '2.924', 'DAMAGECOUNT': '8.619', 'FRAGCOUNT': '32.000'} [2023-02-24 20:39:51,995][213382] DAMAGECOUNT value on done: 100331.0 [2023-02-24 20:39:51,996][213382] Sum rewards: 21.087, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.874', 'ARMOR': '0.005', 'AMMO5': '0.020', 'AMMO2': '0.040', 'AMMO3': '0.156', 'AMMO4': '0.200', 'weapon5': '0.314', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.688', 'weapon4': '0.702', 'WEAPON3': '0.900', 'weapon3': '1.892', 'HITCOUNT': '1.900', 'DAMAGECOUNT': '7.494', 'FRAGCOUNT': '21.000'} [2023-02-24 20:39:52,265][213368] DAMAGECOUNT value on done: 105903.0 [2023-02-24 20:39:52,266][213368] Sum rewards: 24.759, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.518', 'AMMO5': '0.020', 'AMMO2': '0.032', 'AMMO3': '0.084', 'AMMO4': '0.160', 'weapon4': '0.286', 'weapon5': '0.344', 'WEAPON4': '0.400', 'weapon2': '0.476', 'WEAPON3': '0.500', 'WEAPON5': '0.600', 'HITCOUNT': '1.360', 'weapon3': '1.488', 'DAMAGECOUNT': '7.026', 'FRAGCOUNT': '21.000'} [2023-02-24 20:39:52,268][213384] DAMAGECOUNT value on done: 104093.0 [2023-02-24 20:39:52,269][213384] Sum rewards: 20.904, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.400', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.028', 'weapon4': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon5': '0.256', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'HITCOUNT': '1.290', 'weapon2': '1.326', 'weapon3': '2.140', 'DAMAGECOUNT': '5.532', 'FRAGCOUNT': '17.000'} [2023-02-24 20:39:52,287][213382] DAMAGECOUNT value on done: 103410.0 [2023-02-24 20:39:52,288][213382] Sum rewards: 20.240, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.230', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.025', 'AMMO3': '0.095', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'weapon5': '0.250', 'weapon4': '0.308', 'WEAPON5': '0.400', 'WEAPON3': '0.550', 'weapon2': '0.998', 'HITCOUNT': '1.280', 'weapon3': '1.536', 'DAMAGECOUNT': '5.178', 'FRAGCOUNT': '17.000'} [2023-02-24 20:39:52,294][213369] DAMAGECOUNT value on done: 107589.0 [2023-02-24 20:39:52,295][213369] Sum rewards: 21.044, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.710', 'AMMO2': '0.021', 'AMMO5': '0.028', 'AMMO3': '0.098', 'AMMO4': '0.106', 'WEAPON4': '0.350', 'weapon5': '0.440', 'weapon4': '0.536', 'weapon2': '0.686', 'WEAPON3': '0.700', 'WEAPON5': '0.750', 'HITCOUNT': '1.610', 'weapon3': '2.074', 'DAMAGECOUNT': '7.104', 'FRAGCOUNT': '18.000'} [2023-02-24 20:39:52,320][213383] DAMAGECOUNT value on done: 103199.0 [2023-02-24 20:39:52,320][213383] Sum rewards: 25.768, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.030', 'AMMO2': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'AMMO3': '0.148', 'weapon5': '0.234', 'weapon4': '0.234', 'WEAPON5': '0.400', 'weapon2': '0.944', 'WEAPON3': '1.000', 'HITCOUNT': '1.960', 'weapon3': '2.246', 'DAMAGECOUNT': '7.461', 'FRAGCOUNT': '22.000'} [2023-02-24 20:39:52,573][213368] DAMAGECOUNT value on done: 106378.0 [2023-02-24 20:39:52,573][213368] Sum rewards: 20.715, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.814', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon4': '0.176', 'AMMO3': '0.214', 'weapon5': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.736', 'WEAPON3': '1.300', 'HITCOUNT': '1.650', 'weapon3': '2.046', 'DAMAGECOUNT': '8.082', 'FRAGCOUNT': '24.000'} [2023-02-24 20:39:52,576][213384] DAMAGECOUNT value on done: 97794.0 [2023-02-24 20:39:52,576][213384] Sum rewards: 39.287, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.574', 'AMMO5': '0.005', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.124', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.214', 'AMMO3': '0.217', 'weapon2': '0.802', 'WEAPON3': '1.400', 'weapon3': '2.578', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '10.911', 'FRAGCOUNT': '36.000'} [2023-02-24 20:39:52,618][213383] DAMAGECOUNT value on done: 95677.0 [2023-02-24 20:39:52,618][213383] Sum rewards: 11.930, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.340', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.048', 'weapon7': '0.086', 'AMMO4': '0.117', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon5': '0.250', 'WEAPON3': '0.350', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.896', 'weapon2': '0.942', 'HITCOUNT': '1.080', 'weapon3': '1.216', 'DAMAGECOUNT': '4.251', 'FRAGCOUNT': '10.000'} [2023-02-24 20:39:52,665][213369] DAMAGECOUNT value on done: 104425.0 [2023-02-24 20:39:52,665][213369] Sum rewards: 25.407, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.738', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO3': '0.106', 'AMMO4': '0.191', 'weapon5': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.534', 'WEAPON3': '0.700', 'weapon2': '1.070', 'HITCOUNT': '1.650', 'weapon3': '1.846', 'DAMAGECOUNT': '7.794', 'FRAGCOUNT': '21.000'} [2023-02-24 20:39:52,783][213384] DAMAGECOUNT value on done: 107616.0 [2023-02-24 20:39:52,784][213384] Sum rewards: 22.433, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.656', 'AMMO5': '0.019', 'AMMO2': '0.025', 'weapon7': '0.082', 'AMMO3': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.125', 'WEAPON7': '0.200', 'weapon5': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.534', 'weapon4': '0.572', 'WEAPON3': '0.750', 'HITCOUNT': '1.660', 'weapon3': '2.144', 'DAMAGECOUNT': '6.630', 'FRAGCOUNT': '19.000'} [2023-02-24 20:39:52,950][213365] Updated weights for policy 0, policy_version 27436 (0.0009) [2023-02-24 20:39:52,985][213369] DAMAGECOUNT value on done: 94618.0 [2023-02-24 20:39:52,985][213369] Sum rewards: 27.645, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.790', 'AMMO5': '0.014', 'AMMO2': '0.022', 'AMMO4': '0.112', 'AMMO3': '0.116', 'weapon4': '0.160', 'WEAPON4': '0.200', 'weapon5': '0.318', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'weapon2': '1.068', 'HITCOUNT': '1.820', 'weapon3': '2.110', 'DAMAGECOUNT': '6.894', 'FRAGCOUNT': '23.000'} [2023-02-24 20:39:53,090][213384] DAMAGECOUNT value on done: 104689.0 [2023-02-24 20:39:53,091][213384] Sum rewards: 16.500, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.917', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO2': '0.034', 'AMMO4': '0.170', 'AMMO3': '0.196', 'weapon4': '0.240', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon5': '0.412', 'weapon2': '0.480', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '1.600', 'weapon3': '2.486', 'DAMAGECOUNT': '5.904', 'FRAGCOUNT': '19.500'} [2023-02-24 20:39:55,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13523.7). Total num frames: 112406528. Throughput: 0: 3392.0. Samples: 3094458. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:39:55,243][213332] Avg episode reward: [(0, '24.469')] [2023-02-24 20:39:55,900][213365] Updated weights for policy 0, policy_version 27446 (0.0009) [2023-02-24 20:39:58,884][213365] Updated weights for policy 0, policy_version 27456 (0.0010) [2023-02-24 20:40:00,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13585.1, 300 sec: 13551.5). Total num frames: 112476160. Throughput: 0: 3396.2. Samples: 3115050. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:40:00,243][213332] Avg episode reward: [(0, '24.469')] [2023-02-24 20:40:01,891][213365] Updated weights for policy 0, policy_version 27466 (0.0009) [2023-02-24 20:40:01,931][213369] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 20:40:04,878][213365] Updated weights for policy 0, policy_version 27476 (0.0009) [2023-02-24 20:40:05,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13653.3, 300 sec: 13579.3). Total num frames: 112545792. Throughput: 0: 3394.4. Samples: 3125300. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:40:05,243][213332] Avg episode reward: [(0, '24.469')] [2023-02-24 20:40:07,877][213365] Updated weights for policy 0, policy_version 27486 (0.0009) [2023-02-24 20:40:10,005][213367] DAMAGECOUNT value on done: 104316.0 [2023-02-24 20:40:10,006][213367] Sum rewards: 25.386, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.017', 'AMMO2': '0.027', 'weapon4': '0.102', 'AMMO3': '0.106', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'weapon5': '0.348', 'WEAPON5': '0.350', 'HEALTH': '0.546', 'WEAPON3': '0.550', 'weapon2': '1.036', 'HITCOUNT': '1.390', 'weapon3': '2.216', 'DAMAGECOUNT': '6.663', 'FRAGCOUNT': '20.000'} [2023-02-24 20:40:10,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 112611328. Throughput: 0: 3393.7. Samples: 3145796. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:40:10,243][213332] Avg episode reward: [(0, '24.414')] [2023-02-24 20:40:10,314][213367] DAMAGECOUNT value on done: 107546.0 [2023-02-24 20:40:10,315][213367] Sum rewards: 25.272, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.796', 'AMMO5': '0.030', 'AMMO2': '0.032', 'AMMO4': '0.157', 'AMMO3': '0.166', 'weapon5': '0.178', 'WEAPON4': '0.200', 'weapon2': '0.506', 'WEAPON5': '0.550', 'weapon4': '0.558', 'WEAPON3': '0.950', 'HITCOUNT': '1.930', 'weapon3': '2.402', 'DAMAGECOUNT': '6.909', 'FRAGCOUNT': '22.000'} [2023-02-24 20:40:10,425][213372] DAMAGECOUNT value on done: 106185.0 [2023-02-24 20:40:10,425][213372] Sum rewards: 25.749, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.675', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'weapon4': '0.230', 'weapon2': '0.238', 'weapon5': '0.266', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'HITCOUNT': '1.940', 'weapon3': '3.008', 'DAMAGECOUNT': '8.205', 'FRAGCOUNT': '20.000'} [2023-02-24 20:40:10,661][213366] DAMAGECOUNT value on done: 104360.0 [2023-02-24 20:40:10,661][213367] DAMAGECOUNT value on done: 106564.0 [2023-02-24 20:40:10,661][213366] Sum rewards: 24.237, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.104', 'ARMOR': '0.004', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO4': '0.072', 'AMMO3': '0.124', 'WEAPON4': '0.200', 'weapon5': '0.260', 'WEAPON5': '0.400', 'weapon4': '0.580', 'weapon2': '0.654', 'WEAPON3': '0.750', 'HITCOUNT': '1.500', 'weapon3': '2.164', 'DAMAGECOUNT': '6.828', 'FRAGCOUNT': '20.000'} [2023-02-24 20:40:10,661][213367] Sum rewards: 37.363, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.694', 'AMMO5': '0.025', 'AMMO2': '0.036', 'AMMO3': '0.103', 'AMMO4': '0.180', 'WEAPON4': '0.250', 'weapon4': '0.310', 'weapon5': '0.390', 'WEAPON5': '0.650', 'WEAPON3': '0.650', 'weapon2': '0.894', 'HITCOUNT': '1.840', 'weapon3': '1.974', 'DAMAGECOUNT': '10.755', 'FRAGCOUNT': '29.000'} [2023-02-24 20:40:10,725][213372] DAMAGECOUNT value on done: 108368.0 [2023-02-24 20:40:10,725][213372] Sum rewards: 25.658, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.765', 'AMMO5': '0.023', 'AMMO2': '0.048', 'AMMO3': '0.140', 'AMMO4': '0.238', 'weapon4': '0.362', 'WEAPON4': '0.400', 'weapon5': '0.424', 'weapon2': '0.538', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'HITCOUNT': '1.870', 'weapon3': '2.322', 'DAMAGECOUNT': '7.758', 'FRAGCOUNT': '24.000'} [2023-02-24 20:40:10,861][213365] Updated weights for policy 0, policy_version 27496 (0.0009) [2023-02-24 20:40:10,965][213367] DAMAGECOUNT value on done: 103733.0 [2023-02-24 20:40:10,966][213367] Sum rewards: 25.061, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.035', 'AMMO2': '0.015', 'AMMO5': '0.017', 'AMMO4': '0.073', 'weapon5': '0.098', 'AMMO3': '0.164', 'WEAPON4': '0.300', 'weapon2': '0.334', 'WEAPON5': '0.350', 'weapon4': '0.580', 'WEAPON3': '1.050', 'HITCOUNT': '1.900', 'weapon3': '2.664', 'DAMAGECOUNT': '7.800', 'FRAGCOUNT': '24.500'} [2023-02-24 20:40:10,968][213366] DAMAGECOUNT value on done: 111845.0 [2023-02-24 20:40:10,968][213366] Sum rewards: 28.253, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.784', 'AMMO2': '0.018', 'AMMO5': '0.020', 'AMMO4': '0.090', 'AMMO3': '0.112', 'WEAPON4': '0.150', 'weapon4': '0.222', 'weapon5': '0.244', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'weapon2': '0.712', 'HITCOUNT': '1.700', 'weapon3': '2.620', 'DAMAGECOUNT': '7.248', 'FRAGCOUNT': '23.000'} [2023-02-24 20:40:11,026][213382] DAMAGECOUNT value on done: 101871.0 [2023-02-24 20:40:11,027][213382] Sum rewards: 17.617, reward structure: {'DEATHCOUNT': '-4.500', 'weapon4': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.025', 'HEALTH': '0.050', 'AMMO3': '0.062', 'WEAPON4': '0.100', 'AMMO4': '0.123', 'WEAPON5': '0.250', 'weapon5': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '1.000', 'weapon2': '1.622', 'weapon3': '1.764', 'DAMAGECOUNT': '4.455', 'FRAGCOUNT': '12.000'} [2023-02-24 20:40:11,051][213383] DAMAGECOUNT value on done: 106097.0 [2023-02-24 20:40:11,051][213383] Sum rewards: 17.938, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.810', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.012', 'AMMO3': '0.123', 'weapon5': '0.166', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'weapon2': '1.052', 'HITCOUNT': '1.350', 'weapon3': '2.448', 'DAMAGECOUNT': '5.691', 'FRAGCOUNT': '15.000'} [2023-02-24 20:40:11,278][213366] DAMAGECOUNT value on done: 108521.0 [2023-02-24 20:40:11,279][213366] Sum rewards: 26.057, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.495', 'AMMO5': '0.022', 'AMMO2': '0.031', 'AMMO3': '0.110', 'AMMO4': '0.156', 'WEAPON4': '0.350', 'weapon5': '0.424', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'weapon4': '0.734', 'weapon2': '0.796', 'weapon3': '1.674', 'HITCOUNT': '1.690', 'DAMAGECOUNT': '7.764', 'FRAGCOUNT': '23.000'} [2023-02-24 20:40:11,331][213372] DAMAGECOUNT value on done: 107116.0 [2023-02-24 20:40:11,332][213372] Sum rewards: 23.228, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.668', 'AMMO5': '0.008', 'AMMO2': '0.029', 'AMMO3': '0.109', 'AMMO4': '0.144', 'weapon5': '0.204', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.700', 'weapon4': '0.846', 'weapon2': '0.922', 'weapon3': '1.462', 'HITCOUNT': '1.550', 'DAMAGECOUNT': '5.772', 'FRAGCOUNT': '20.000'} [2023-02-24 20:40:11,337][213382] DAMAGECOUNT value on done: 106558.0 [2023-02-24 20:40:11,338][213382] Sum rewards: 27.277, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.510', 'ARMOR': '0.004', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'AMMO3': '0.147', 'AMMO4': '0.160', 'weapon4': '0.180', 'WEAPON4': '0.250', 'weapon5': '0.412', 'WEAPON5': '0.600', 'weapon2': '0.718', 'WEAPON3': '0.950', 'HITCOUNT': '1.800', 'weapon3': '2.182', 'DAMAGECOUNT': '8.565', 'FRAGCOUNT': '25.000'} [2023-02-24 20:40:11,357][213383] DAMAGECOUNT value on done: 110208.0 [2023-02-24 20:40:11,357][213383] Sum rewards: 21.347, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.743', 'AMMO5': '0.010', 'weapon4': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'AMMO3': '0.150', 'weapon5': '0.160', 'WEAPON5': '0.250', 'WEAPON3': '0.950', 'weapon2': '1.088', 'HITCOUNT': '1.210', 'weapon3': '2.462', 'DAMAGECOUNT': '5.586', 'FRAGCOUNT': '20.000'} [2023-02-24 20:40:11,413][213368] DAMAGECOUNT value on done: 102876.0 [2023-02-24 20:40:11,414][213368] Sum rewards: 26.048, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.875', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO5': '0.022', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'weapon4': '0.286', 'weapon5': '0.310', 'weapon2': '0.426', 'WEAPON5': '0.600', 'WEAPON3': '0.900', 'HITCOUNT': '1.600', 'weapon3': '2.628', 'DAMAGECOUNT': '6.852', 'FRAGCOUNT': '23.000'} [2023-02-24 20:40:11,594][213366] DAMAGECOUNT value on done: 104369.0 [2023-02-24 20:40:11,594][213366] Sum rewards: 19.268, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.640', 'AMMO2': '0.017', 'AMMO5': '0.019', 'weapon4': '0.032', 'AMMO4': '0.085', 'AMMO3': '0.144', 'WEAPON4': '0.200', 'weapon2': '0.468', 'weapon5': '0.518', 'WEAPON5': '0.600', 'WEAPON3': '0.900', 'HITCOUNT': '1.360', 'weapon3': '2.678', 'DAMAGECOUNT': '5.637', 'FRAGCOUNT': '18.000'} [2023-02-24 20:40:11,637][213372] DAMAGECOUNT value on done: 103857.0 [2023-02-24 20:40:11,638][213372] Sum rewards: 18.899, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.816', 'AMMO2': '0.009', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.044', 'AMMO3': '0.147', 'weapon5': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.552', 'WEAPON3': '0.800', 'weapon2': '0.838', 'HITCOUNT': '1.570', 'weapon3': '2.120', 'DAMAGECOUNT': '6.144', 'FRAGCOUNT': '18.000'} [2023-02-24 20:40:11,649][213382] DAMAGECOUNT value on done: 102661.0 [2023-02-24 20:40:11,649][213382] Sum rewards: 19.283, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.508', 'AMMO5': '0.019', 'AMMO2': '0.039', 'AMMO4': '0.197', 'AMMO3': '0.215', 'weapon5': '0.302', 'WEAPON4': '0.350', 'weapon2': '0.368', 'weapon4': '0.442', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '1.720', 'weapon3': '2.548', 'DAMAGECOUNT': '6.990', 'FRAGCOUNT': '22.000'} [2023-02-24 20:40:11,701][213369] DAMAGECOUNT value on done: 109451.0 [2023-02-24 20:40:11,702][213369] Sum rewards: 30.377, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.899', 'AMMO5': '0.026', 'AMMO2': '0.036', 'AMMO4': '0.177', 'AMMO3': '0.190', 'weapon5': '0.322', 'WEAPON4': '0.350', 'weapon2': '0.374', 'weapon4': '0.568', 'WEAPON5': '0.750', 'WEAPON3': '1.200', 'HITCOUNT': '2.070', 'weapon3': '2.376', 'DAMAGECOUNT': '9.837', 'FRAGCOUNT': '27.000'} [2023-02-24 20:40:11,719][213368] DAMAGECOUNT value on done: 107344.0 [2023-02-24 20:40:11,720][213368] Sum rewards: 27.367, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.455', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.154', 'weapon5': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.316', 'WEAPON5': '0.450', 'weapon4': '0.558', 'WEAPON3': '0.950', 'HITCOUNT': '1.830', 'weapon3': '2.528', 'DAMAGECOUNT': '8.145', 'FRAGCOUNT': '23.000'} [2023-02-24 20:40:11,944][213384] DAMAGECOUNT value on done: 107391.0 [2023-02-24 20:40:11,945][213384] Sum rewards: 34.509, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.830', 'AMMO2': '0.016', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.078', 'AMMO3': '0.176', 'weapon5': '0.298', 'WEAPON4': '0.300', 'weapon4': '0.330', 'WEAPON5': '0.450', 'weapon2': '0.700', 'WEAPON3': '1.200', 'weapon3': '2.300', 'HITCOUNT': '2.310', 'DAMAGECOUNT': '9.894', 'FRAGCOUNT': '32.000'} [2023-02-24 20:40:11,946][213382] DAMAGECOUNT value on done: 105168.0 [2023-02-24 20:40:11,947][213382] Sum rewards: 17.358, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'weapon4': '0.084', 'AMMO3': '0.096', 'HEALTH': '0.207', 'weapon5': '0.264', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon2': '1.232', 'HITCOUNT': '1.370', 'weapon3': '2.146', 'DAMAGECOUNT': '5.274', 'FRAGCOUNT': '13.000'} [2023-02-24 20:40:11,957][213383] DAMAGECOUNT value on done: 105258.0 [2023-02-24 20:40:11,958][213383] Sum rewards: 24.729, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.255', 'AMMO2': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.050', 'AMMO3': '0.073', 'weapon4': '0.106', 'WEAPON4': '0.150', 'weapon5': '0.260', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'weapon2': '0.908', 'HITCOUNT': '1.370', 'weapon3': '2.194', 'DAMAGECOUNT': '6.048', 'FRAGCOUNT': '19.000'} [2023-02-24 20:40:11,997][213369] DAMAGECOUNT value on done: 111012.0 [2023-02-24 20:40:11,998][213369] Sum rewards: 36.053, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.655', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO2': '0.028', 'AMMO3': '0.130', 'AMMO4': '0.138', 'WEAPON4': '0.200', 'weapon4': '0.278', 'weapon5': '0.526', 'WEAPON5': '0.600', 'weapon2': '0.752', 'WEAPON3': '0.850', 'HITCOUNT': '1.920', 'weapon3': '2.064', 'DAMAGECOUNT': '10.179', 'FRAGCOUNT': '29.000'} [2023-02-24 20:40:12,008][213368] DAMAGECOUNT value on done: 108413.0 [2023-02-24 20:40:12,009][213368] Sum rewards: 30.347, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.541', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.125', 'weapon4': '0.136', 'WEAPON4': '0.150', 'weapon5': '0.212', 'WEAPON5': '0.250', 'WEAPON3': '0.750', 'weapon2': '1.046', 'HITCOUNT': '1.700', 'weapon3': '2.328', 'DAMAGECOUNT': '7.530', 'FRAGCOUNT': '25.000'} [2023-02-24 20:40:12,251][213384] DAMAGECOUNT value on done: 99744.0 [2023-02-24 20:40:12,251][213383] DAMAGECOUNT value on done: 98473.0 [2023-02-24 20:40:12,251][213383] Sum rewards: 30.488, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.050', 'AMMO2': '0.015', 'AMMO5': '0.024', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'weapon4': '0.116', 'AMMO3': '0.182', 'weapon5': '0.322', 'WEAPON5': '0.550', 'weapon2': '0.754', 'WEAPON3': '1.050', 'HITCOUNT': '1.830', 'weapon3': '2.380', 'DAMAGECOUNT': '8.388', 'FRAGCOUNT': '27.000'} [2023-02-24 20:40:12,251][213384] Sum rewards: 19.660, reward structure: {'DEATHCOUNT': '-9.000', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.028', 'AMMO3': '0.093', 'HEALTH': '0.137', 'AMMO4': '0.142', 'weapon5': '0.238', 'WEAPON4': '0.300', 'weapon4': '0.362', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon2': '0.768', 'HITCOUNT': '1.380', 'weapon3': '2.332', 'DAMAGECOUNT': '5.850', 'FRAGCOUNT': '16.000'} [2023-02-24 20:40:12,310][213368] DAMAGECOUNT value on done: 108494.0 [2023-02-24 20:40:12,310][213368] Sum rewards: 23.237, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.140', 'AMMO2': '0.011', 'AMMO5': '0.028', 'AMMO4': '0.054', 'AMMO3': '0.098', 'WEAPON4': '0.200', 'weapon5': '0.400', 'weapon4': '0.452', 'WEAPON3': '0.650', 'weapon2': '0.742', 'WEAPON5': '0.750', 'HITCOUNT': '1.460', 'weapon3': '1.934', 'DAMAGECOUNT': '6.348', 'FRAGCOUNT': '18.000'} [2023-02-24 20:40:12,360][213369] DAMAGECOUNT value on done: 107427.0 [2023-02-24 20:40:12,361][213369] Sum rewards: 28.474, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.649', 'AMMO5': '0.018', 'AMMO2': '0.038', 'AMMO3': '0.141', 'AMMO4': '0.191', 'weapon5': '0.310', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON5': '0.450', 'weapon4': '0.548', 'WEAPON3': '0.900', 'HITCOUNT': '2.150', 'weapon3': '2.400', 'DAMAGECOUNT': '9.006', 'FRAGCOUNT': '25.000'} [2023-02-24 20:40:12,439][213384] DAMAGECOUNT value on done: 110440.0 [2023-02-24 20:40:12,439][213384] Sum rewards: 28.931, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.800', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.047', 'AMMO3': '0.123', 'AMMO4': '0.233', 'weapon5': '0.332', 'WEAPON4': '0.400', 'weapon4': '0.426', 'WEAPON5': '0.650', 'weapon2': '0.768', 'WEAPON3': '0.800', 'HITCOUNT': '1.920', 'weapon3': '2.014', 'DAMAGECOUNT': '8.472', 'FRAGCOUNT': '25.000'} [2023-02-24 20:40:12,654][213369] DAMAGECOUNT value on done: 97940.0 [2023-02-24 20:40:12,654][213369] Sum rewards: 37.600, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.810', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'weapon5': '0.238', 'WEAPON5': '0.350', 'weapon4': '0.406', 'weapon2': '0.772', 'WEAPON3': '0.850', 'weapon3': '1.950', 'HITCOUNT': '2.240', 'DAMAGECOUNT': '9.966', 'FRAGCOUNT': '31.000'} [2023-02-24 20:40:12,735][213384] DAMAGECOUNT value on done: 108200.0 [2023-02-24 20:40:12,736][213384] Sum rewards: 39.704, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.610', 'AMMO5': '0.018', 'AMMO2': '0.037', 'AMMO3': '0.120', 'AMMO4': '0.184', 'weapon5': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.534', 'WEAPON3': '0.750', 'weapon2': '0.808', 'weapon3': '1.994', 'HITCOUNT': '2.210', 'DAMAGECOUNT': '10.533', 'FRAGCOUNT': '32.000'} [2023-02-24 20:40:13,863][213365] Updated weights for policy 0, policy_version 27506 (0.0009) [2023-02-24 20:40:15,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 112680960. Throughput: 0: 3393.3. Samples: 3166344. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:40:15,243][213332] Avg episode reward: [(0, '24.738')] [2023-02-24 20:40:16,804][213365] Updated weights for policy 0, policy_version 27516 (0.0009) [2023-02-24 20:40:19,792][213365] Updated weights for policy 0, policy_version 27526 (0.0009) [2023-02-24 20:40:20,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13653.3, 300 sec: 13565.4). Total num frames: 112750592. Throughput: 0: 3403.2. Samples: 3176698. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:40:20,244][213332] Avg episode reward: [(0, '24.738')] [2023-02-24 20:40:22,795][213365] Updated weights for policy 0, policy_version 27536 (0.0009) [2023-02-24 20:40:25,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13653.3, 300 sec: 13565.4). Total num frames: 112820224. Throughput: 0: 3423.7. Samples: 3197314. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:40:25,243][213332] Avg episode reward: [(0, '24.738')] [2023-02-24 20:40:25,794][213365] Updated weights for policy 0, policy_version 27546 (0.0008) [2023-02-24 20:40:28,800][213365] Updated weights for policy 0, policy_version 27556 (0.0009) [2023-02-24 20:40:29,629][213367] DAMAGECOUNT value on done: 107413.0 [2023-02-24 20:40:29,630][213367] Sum rewards: 40.035, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.846', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.051', 'AMMO3': '0.082', 'weapon4': '0.180', 'AMMO4': '0.257', 'weapon5': '0.374', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.550', 'weapon2': '0.798', 'HITCOUNT': '2.010', 'weapon3': '2.368', 'DAMAGECOUNT': '9.291', 'FRAGCOUNT': '33.000'} [2023-02-24 20:40:29,944][213367] DAMAGECOUNT value on done: 110746.0 [2023-02-24 20:40:29,944][213367] Sum rewards: 35.285, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.878', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.016', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'weapon5': '0.178', 'AMMO3': '0.193', 'weapon4': '0.216', 'WEAPON5': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.200', 'HITCOUNT': '2.360', 'weapon3': '2.926', 'DAMAGECOUNT': '9.600', 'FRAGCOUNT': '32.000'} [2023-02-24 20:40:29,966][213372] DAMAGECOUNT value on done: 108566.0 [2023-02-24 20:40:29,967][213372] Sum rewards: 21.291, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.240', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.044', 'AMMO3': '0.066', 'AMMO4': '0.218', 'WEAPON3': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.494', 'weapon5': '0.672', 'WEAPON5': '0.750', 'weapon2': '0.890', 'weapon3': '1.306', 'HITCOUNT': '1.370', 'DAMAGECOUNT': '7.143', 'FRAGCOUNT': '15.500'} [2023-02-24 20:40:30,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13551.5). Total num frames: 112885760. Throughput: 0: 3422.8. Samples: 3217810. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:40:30,243][213332] Avg episode reward: [(0, '25.039')] [2023-02-24 20:40:30,273][213372] DAMAGECOUNT value on done: 109996.0 [2023-02-24 20:40:30,274][213372] Sum rewards: 12.820, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.537', 'AMMO5': '0.020', 'AMMO2': '0.028', 'AMMO3': '0.064', 'AMMO4': '0.141', 'WEAPON4': '0.350', 'weapon4': '0.448', 'WEAPON5': '0.450', 'WEAPON3': '0.450', 'weapon5': '0.532', 'weapon2': '0.636', 'HITCOUNT': '1.070', 'weapon3': '1.548', 'DAMAGECOUNT': '4.869', 'FRAGCOUNT': '11.000'} [2023-02-24 20:40:30,326][213367] DAMAGECOUNT value on done: 109780.0 [2023-02-24 20:40:30,327][213367] Sum rewards: 33.526, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.540', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.157', 'weapon5': '0.172', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.366', 'weapon4': '0.448', 'WEAPON3': '1.000', 'HITCOUNT': '1.990', 'weapon3': '2.688', 'DAMAGECOUNT': '9.648', 'FRAGCOUNT': '29.000'} [2023-02-24 20:40:30,349][213366] DAMAGECOUNT value on done: 107021.0 [2023-02-24 20:40:30,350][213366] Sum rewards: 25.553, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.557', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.042', 'AMMO3': '0.090', 'AMMO4': '0.209', 'weapon5': '0.246', 'weapon4': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon2': '0.914', 'HITCOUNT': '1.690', 'weapon3': '2.124', 'DAMAGECOUNT': '7.983', 'FRAGCOUNT': '21.000'} [2023-02-24 20:40:30,628][213367] DAMAGECOUNT value on done: 107128.0 [2023-02-24 20:40:30,629][213367] Sum rewards: 38.573, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.702', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.030', 'AMMO3': '0.104', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.532', 'WEAPON3': '0.700', 'weapon2': '0.756', 'weapon3': '2.388', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '10.185', 'FRAGCOUNT': '29.000'} [2023-02-24 20:40:30,650][213383] DAMAGECOUNT value on done: 108160.0 [2023-02-24 20:40:30,650][213383] Sum rewards: 24.787, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.205', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'AMMO5': '0.009', 'AMMO3': '0.126', 'weapon5': '0.230', 'WEAPON5': '0.300', 'WEAPON3': '0.900', 'weapon2': '1.056', 'HITCOUNT': '1.600', 'weapon3': '2.390', 'DAMAGECOUNT': '6.189', 'FRAGCOUNT': '21.000'} [2023-02-24 20:40:30,651][213382] DAMAGECOUNT value on done: 104242.0 [2023-02-24 20:40:30,651][213382] Sum rewards: 25.157, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.772', 'AMMO5': '0.016', 'AMMO2': '0.028', 'AMMO3': '0.100', 'AMMO4': '0.139', 'weapon5': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.550', 'weapon2': '0.550', 'weapon4': '0.680', 'WEAPON3': '0.700', 'weapon3': '1.808', 'HITCOUNT': '1.810', 'DAMAGECOUNT': '7.113', 'FRAGCOUNT': '21.000'} [2023-02-24 20:40:30,656][213366] DAMAGECOUNT value on done: 114747.0 [2023-02-24 20:40:30,657][213366] Sum rewards: 33.286, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.330', 'AMMO2': '0.010', 'AMMO5': '0.016', 'AMMO4': '0.049', 'AMMO3': '0.109', 'WEAPON4': '0.250', 'weapon5': '0.252', 'WEAPON5': '0.400', 'weapon4': '0.456', 'WEAPON3': '0.800', 'weapon2': '0.898', 'HITCOUNT': '1.770', 'weapon3': '2.150', 'DAMAGECOUNT': '8.706', 'FRAGCOUNT': '28.000'} [2023-02-24 20:40:30,880][213372] DAMAGECOUNT value on done: 109623.0 [2023-02-24 20:40:30,880][213372] Sum rewards: 29.901, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.342', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO3': '0.066', 'AMMO4': '0.079', 'weapon5': '0.316', 'WEAPON5': '0.350', 'WEAPON3': '0.450', 'weapon2': '0.522', 'weapon4': '0.760', 'HITCOUNT': '1.730', 'weapon3': '2.110', 'DAMAGECOUNT': '7.521', 'FRAGCOUNT': '20.000'} [2023-02-24 20:40:30,953][213382] DAMAGECOUNT value on done: 109091.0 [2023-02-24 20:40:30,953][213382] Sum rewards: 24.314, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.932', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.024', 'WEAPON4': '0.100', 'weapon5': '0.168', 'AMMO3': '0.173', 'weapon4': '0.280', 'WEAPON5': '0.400', 'weapon2': '0.408', 'WEAPON3': '1.150', 'HITCOUNT': '2.070', 'weapon3': '2.844', 'DAMAGECOUNT': '7.599', 'FRAGCOUNT': '23.000'} [2023-02-24 20:40:30,961][213366] DAMAGECOUNT value on done: 112032.0 [2023-02-24 20:40:30,961][213366] Sum rewards: 37.141, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.488', 'AMMO5': '0.013', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO3': '0.161', 'weapon5': '0.250', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.422', 'weapon4': '0.426', 'WEAPON3': '1.000', 'HITCOUNT': '2.400', 'weapon3': '2.492', 'DAMAGECOUNT': '10.533', 'FRAGCOUNT': '33.000'} [2023-02-24 20:40:30,965][213383] DAMAGECOUNT value on done: 112985.0 [2023-02-24 20:40:30,965][213383] Sum rewards: 20.800, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.032', 'AMMO5': '0.022', 'AMMO2': '0.042', 'weapon4': '0.166', 'AMMO3': '0.207', 'AMMO4': '0.210', 'weapon5': '0.380', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon2': '0.616', 'WEAPON3': '1.250', 'HITCOUNT': '1.670', 'weapon3': '2.438', 'DAMAGECOUNT': '8.331', 'FRAGCOUNT': '24.000'} [2023-02-24 20:40:31,040][213368] DAMAGECOUNT value on done: 106193.0 [2023-02-24 20:40:31,040][213368] Sum rewards: 27.621, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.280', 'AMMO5': '0.026', 'WEAPON1': '0.040', 'AMMO2': '0.051', 'AMMO3': '0.172', 'weapon5': '0.212', 'AMMO4': '0.257', 'weapon2': '0.340', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'weapon4': '0.652', 'WEAPON3': '1.000', 'weapon3': '2.210', 'HITCOUNT': '2.390', 'DAMAGECOUNT': '9.951', 'FRAGCOUNT': '25.500'} [2023-02-24 20:40:31,180][213372] DAMAGECOUNT value on done: 106942.0 [2023-02-24 20:40:31,180][213372] Sum rewards: 35.990, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.990', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.014', 'weapon7': '0.054', 'AMMO3': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.126', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.662', 'weapon2': '0.710', 'WEAPON3': '0.800', 'weapon3': '2.300', 'HITCOUNT': '2.360', 'DAMAGECOUNT': '9.255', 'FRAGCOUNT': '29.000'} [2023-02-24 20:40:31,256][213382] DAMAGECOUNT value on done: 104919.0 [2023-02-24 20:40:31,257][213382] Sum rewards: 27.596, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.245', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.157', 'weapon5': '0.342', 'WEAPON5': '0.350', 'weapon2': '0.452', 'WEAPON3': '0.950', 'HITCOUNT': '1.710', 'weapon3': '2.964', 'DAMAGECOUNT': '6.774', 'FRAGCOUNT': '24.000'} [2023-02-24 20:40:31,267][213366] DAMAGECOUNT value on done: 106926.0 [2023-02-24 20:40:31,268][213366] Sum rewards: 25.902, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.483', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.116', 'AMMO3': '0.149', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon5': '0.318', 'weapon2': '0.370', 'weapon4': '0.616', 'WEAPON3': '0.850', 'HITCOUNT': '1.550', 'weapon3': '1.912', 'DAMAGECOUNT': '7.671', 'FRAGCOUNT': '23.000'} [2023-02-24 20:40:31,342][213369] DAMAGECOUNT value on done: 112270.0 [2023-02-24 20:40:31,342][213369] Sum rewards: 29.876, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.601', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO3': '0.124', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.350', 'weapon4': '0.370', 'weapon5': '0.378', 'weapon2': '0.452', 'WEAPON3': '0.750', 'HITCOUNT': '1.830', 'weapon3': '2.454', 'DAMAGECOUNT': '8.457', 'FRAGCOUNT': '24.000'} [2023-02-24 20:40:31,345][213368] DAMAGECOUNT value on done: 109511.0 [2023-02-24 20:40:31,346][213368] Sum rewards: 22.810, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.170', 'AMMO2': '0.004', 'weapon4': '0.014', 'AMMO5': '0.015', 'AMMO4': '0.020', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'weapon5': '0.274', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'weapon2': '0.892', 'HITCOUNT': '1.370', 'weapon3': '2.600', 'DAMAGECOUNT': '6.501', 'FRAGCOUNT': '17.000'} [2023-02-24 20:40:31,545][213383] DAMAGECOUNT value on done: 108035.0 [2023-02-24 20:40:31,546][213383] Sum rewards: 22.377, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.234', 'AMMO2': '0.019', 'AMMO5': '0.020', 'AMMO4': '0.096', 'AMMO3': '0.163', 'weapon2': '0.208', 'weapon4': '0.246', 'WEAPON4': '0.250', 'weapon5': '0.424', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'HITCOUNT': '1.900', 'weapon3': '2.754', 'DAMAGECOUNT': '8.331', 'FRAGCOUNT': '19.000'} [2023-02-24 20:40:31,567][213382] DAMAGECOUNT value on done: 107084.0 [2023-02-24 20:40:31,567][213382] Sum rewards: 20.722, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.500', 'AMMO2': '0.009', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'AMMO3': '0.067', 'WEAPON4': '0.300', 'weapon4': '0.368', 'WEAPON3': '0.450', 'weapon5': '0.528', 'WEAPON5': '0.650', 'weapon2': '0.874', 'HITCOUNT': '1.020', 'weapon3': '1.874', 'DAMAGECOUNT': '5.748', 'FRAGCOUNT': '17.000'} [2023-02-24 20:40:31,569][213384] DAMAGECOUNT value on done: 109946.0 [2023-02-24 20:40:31,569][213384] Sum rewards: 26.444, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.479', 'AMMO2': '0.019', 'AMMO5': '0.026', 'AMMO4': '0.092', 'AMMO3': '0.155', 'weapon4': '0.162', 'WEAPON4': '0.300', 'weapon5': '0.318', 'WEAPON5': '0.800', 'weapon2': '0.826', 'WEAPON3': '1.000', 'HITCOUNT': '1.650', 'weapon3': '2.410', 'DAMAGECOUNT': '7.665', 'FRAGCOUNT': '24.000'} [2023-02-24 20:40:31,640][213368] DAMAGECOUNT value on done: 111690.0 [2023-02-24 20:40:31,640][213368] Sum rewards: 30.927, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.728', 'ARMOR': '0.004', 'AMMO2': '0.018', 'AMMO5': '0.019', 'AMMO4': '0.091', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon5': '0.226', 'weapon4': '0.406', 'WEAPON5': '0.500', 'weapon2': '0.862', 'WEAPON3': '1.200', 'weapon3': '2.250', 'HITCOUNT': '2.350', 'DAMAGECOUNT': '9.831', 'FRAGCOUNT': '28.000'} [2023-02-24 20:40:31,650][213369] DAMAGECOUNT value on done: 112522.0 [2023-02-24 20:40:31,650][213369] Sum rewards: 17.154, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.330', 'AMMO2': '0.015', 'AMMO5': '0.021', 'AMMO4': '0.076', 'AMMO3': '0.083', 'WEAPON4': '0.350', 'weapon5': '0.354', 'weapon2': '0.424', 'ARMOR': '0.498', 'WEAPON3': '0.550', 'WEAPON5': '0.600', 'weapon4': '0.916', 'HITCOUNT': '1.080', 'weapon3': '1.986', 'DAMAGECOUNT': '4.530', 'FRAGCOUNT': '14.500'} [2023-02-24 20:40:31,826][213365] Updated weights for policy 0, policy_version 27566 (0.0009) [2023-02-24 20:40:31,848][213383] DAMAGECOUNT value on done: 100311.0 [2023-02-24 20:40:31,849][213383] Sum rewards: 17.728, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.062', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.138', 'WEAPON4': '0.250', 'weapon5': '0.350', 'weapon2': '0.440', 'WEAPON5': '0.500', 'weapon4': '0.714', 'WEAPON3': '0.850', 'HITCOUNT': '1.150', 'weapon3': '2.274', 'DAMAGECOUNT': '5.493', 'FRAGCOUNT': '18.000'} [2023-02-24 20:40:31,871][213384] DAMAGECOUNT value on done: 102023.0 [2023-02-24 20:40:31,871][213384] Sum rewards: 24.156, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.206', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'AMMO3': '0.098', 'weapon4': '0.124', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.214', 'WEAPON3': '0.550', 'weapon2': '1.174', 'HITCOUNT': '1.630', 'weapon3': '1.994', 'DAMAGECOUNT': '6.807', 'FRAGCOUNT': '18.000'} [2023-02-24 20:40:31,947][213368] DAMAGECOUNT value on done: 110115.0 [2023-02-24 20:40:31,948][213368] Sum rewards: 21.547, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.210', 'AMMO5': '0.012', 'ARMOR': '0.020', 'AMMO2': '0.037', 'AMMO3': '0.104', 'AMMO4': '0.186', 'weapon5': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.358', 'WEAPON3': '0.600', 'weapon4': '0.836', 'HITCOUNT': '1.230', 'weapon3': '1.950', 'DAMAGECOUNT': '4.863', 'FRAGCOUNT': '20.000'} [2023-02-24 20:40:32,013][213369] DAMAGECOUNT value on done: 110726.0 [2023-02-24 20:40:32,014][213369] Sum rewards: 26.794, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.024', 'AMMO5': '0.019', 'AMMO2': '0.045', 'AMMO3': '0.182', 'AMMO4': '0.223', 'weapon5': '0.282', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.634', 'weapon2': '0.726', 'WEAPON3': '1.050', 'weapon3': '2.000', 'HITCOUNT': '2.140', 'DAMAGECOUNT': '9.867', 'FRAGCOUNT': '26.500'} [2023-02-24 20:40:32,051][213384] DAMAGECOUNT value on done: 112380.0 [2023-02-24 20:40:32,051][213384] Sum rewards: 18.992, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.220', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.019', 'AMMO3': '0.087', 'AMMO4': '0.092', 'weapon5': '0.384', 'weapon2': '0.542', 'WEAPON3': '0.550', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon3': '1.196', 'weapon4': '1.306', 'HITCOUNT': '1.590', 'DAMAGECOUNT': '5.820', 'FRAGCOUNT': '16.000'} [2023-02-24 20:40:32,311][213369] DAMAGECOUNT value on done: 101046.0 [2023-02-24 20:40:32,312][213369] Sum rewards: 32.604, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.688', 'AMMO5': '0.015', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO3': '0.155', 'weapon4': '0.196', 'WEAPON4': '0.200', 'weapon5': '0.222', 'WEAPON5': '0.400', 'weapon2': '0.760', 'WEAPON3': '0.950', 'HITCOUNT': '1.890', 'weapon3': '2.554', 'DAMAGECOUNT': '9.318', 'FRAGCOUNT': '27.000'} [2023-02-24 20:40:32,350][213384] DAMAGECOUNT value on done: 110825.0 [2023-02-24 20:40:32,350][213384] Sum rewards: 20.796, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.626', 'AMMO2': '0.013', 'AMMO5': '0.030', 'AMMO4': '0.066', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon4': '0.274', 'weapon2': '0.346', 'weapon5': '0.438', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'HITCOUNT': '1.620', 'weapon3': '2.604', 'DAMAGECOUNT': '7.875', 'FRAGCOUNT': '19.000'} [2023-02-24 20:40:34,763][213365] Updated weights for policy 0, policy_version 27576 (0.0009) [2023-02-24 20:40:35,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13653.3, 300 sec: 13551.5). Total num frames: 112955392. Throughput: 0: 3419.5. Samples: 3227930. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:40:35,243][213332] Avg episode reward: [(0, '25.687')] [2023-02-24 20:40:37,729][213365] Updated weights for policy 0, policy_version 27586 (0.0009) [2023-02-24 20:40:40,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13721.6, 300 sec: 13551.5). Total num frames: 113025024. Throughput: 0: 3427.7. Samples: 3248706. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:40:40,243][213332] Avg episode reward: [(0, '25.687')] [2023-02-24 20:40:40,701][213365] Updated weights for policy 0, policy_version 27596 (0.0009) [2023-02-24 20:40:43,643][213365] Updated weights for policy 0, policy_version 27606 (0.0009) [2023-02-24 20:40:45,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13721.6, 300 sec: 13551.5). Total num frames: 113094656. Throughput: 0: 3430.4. Samples: 3269420. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:40:45,243][213332] Avg episode reward: [(0, '25.687')] [2023-02-24 20:40:45,247][213352] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000027611_113094656.pth... [2023-02-24 20:40:45,307][213352] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000026817_109842432.pth [2023-02-24 20:40:46,672][213365] Updated weights for policy 0, policy_version 27616 (0.0009) [2023-02-24 20:40:49,224][213367] DAMAGECOUNT value on done: 109242.0 [2023-02-24 20:40:49,224][213367] Sum rewards: 23.125, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.740', 'AMMO2': '0.005', 'AMMO5': '0.012', 'weapon4': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'AMMO3': '0.116', 'weapon5': '0.274', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'weapon2': '1.044', 'HITCOUNT': '1.230', 'weapon3': '2.334', 'DAMAGECOUNT': '5.487', 'FRAGCOUNT': '19.000'} [2023-02-24 20:40:49,512][213372] DAMAGECOUNT value on done: 110869.0 [2023-02-24 20:40:49,513][213372] Sum rewards: 24.049, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.492', 'AMMO5': '0.017', 'AMMO2': '0.051', 'AMMO3': '0.110', 'AMMO4': '0.257', 'weapon5': '0.308', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.532', 'WEAPON3': '0.700', 'weapon4': '0.770', 'HITCOUNT': '1.740', 'weapon3': '2.096', 'DAMAGECOUNT': '6.909', 'FRAGCOUNT': '21.000'} [2023-02-24 20:40:49,528][213367] DAMAGECOUNT value on done: 113552.0 [2023-02-24 20:40:49,529][213367] Sum rewards: 35.867, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.717', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO5': '0.024', 'WEAPON4': '0.050', 'AMMO4': '0.102', 'weapon4': '0.142', 'AMMO3': '0.143', 'weapon2': '0.200', 'weapon5': '0.512', 'WEAPON5': '0.550', 'WEAPON3': '0.950', 'HITCOUNT': '1.810', 'weapon3': '2.892', 'DAMAGECOUNT': '8.418', 'FRAGCOUNT': '30.000'} [2023-02-24 20:40:49,661][213365] Updated weights for policy 0, policy_version 27626 (0.0009) [2023-02-24 20:40:49,811][213366] DAMAGECOUNT value on done: 108540.0 [2023-02-24 20:40:49,811][213366] Sum rewards: 16.252, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.060', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.061', 'AMMO3': '0.108', 'WEAPON4': '0.250', 'weapon5': '0.252', 'WEAPON5': '0.350', 'weapon4': '0.502', 'WEAPON3': '0.700', 'weapon2': '0.978', 'HITCOUNT': '1.240', 'weapon3': '2.056', 'DAMAGECOUNT': '4.542', 'FRAGCOUNT': '13.000'} [2023-02-24 20:40:49,814][213372] DAMAGECOUNT value on done: 112454.0 [2023-02-24 20:40:49,814][213372] Sum rewards: 25.544, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.821', 'ARMOR': '0.004', 'AMMO2': '0.014', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.071', 'AMMO3': '0.086', 'WEAPON4': '0.350', 'weapon5': '0.460', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'weapon4': '0.708', 'weapon2': '0.772', 'weapon3': '1.746', 'HITCOUNT': '2.090', 'DAMAGECOUNT': '7.374', 'FRAGCOUNT': '20.000'} [2023-02-24 20:40:49,831][213367] DAMAGECOUNT value on done: 111838.0 [2023-02-24 20:40:49,831][213367] Sum rewards: 23.600, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.030', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon4': '0.070', 'AMMO3': '0.083', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'weapon5': '0.234', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '1.420', 'weapon2': '1.610', 'weapon3': '1.820', 'DAMAGECOUNT': '6.174', 'FRAGCOUNT': '18.000'} [2023-02-24 20:40:50,117][213366] DAMAGECOUNT value on done: 116897.0 [2023-02-24 20:40:50,117][213366] Sum rewards: 18.449, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.682', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.123', 'weapon7': '0.140', 'weapon5': '0.156', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.392', 'weapon2': '0.652', 'WEAPON3': '1.100', 'HITCOUNT': '1.360', 'weapon3': '2.364', 'DAMAGECOUNT': '6.450', 'FRAGCOUNT': '19.000'} [2023-02-24 20:40:50,135][213367] DAMAGECOUNT value on done: 109408.0 [2023-02-24 20:40:50,135][213367] Sum rewards: 24.523, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.160', 'AMMO5': '0.019', 'AMMO2': '0.031', 'AMMO4': '0.155', 'AMMO3': '0.161', 'weapon4': '0.190', 'WEAPON4': '0.250', 'weapon5': '0.366', 'WEAPON5': '0.450', 'weapon2': '0.540', 'WEAPON3': '0.900', 'HITCOUNT': '1.450', 'weapon3': '2.580', 'DAMAGECOUNT': '6.840', 'FRAGCOUNT': '23.000'} [2023-02-24 20:40:50,176][213383] DAMAGECOUNT value on done: 109749.0 [2023-02-24 20:40:50,176][213383] Sum rewards: 19.426, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.134', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.084', 'AMMO4': '0.151', 'WEAPON4': '0.250', 'weapon4': '0.370', 'WEAPON5': '0.450', 'weapon5': '0.472', 'WEAPON3': '0.550', 'weapon2': '0.846', 'HITCOUNT': '1.050', 'weapon3': '2.006', 'DAMAGECOUNT': '4.767', 'FRAGCOUNT': '17.000'} [2023-02-24 20:40:50,196][213382] DAMAGECOUNT value on done: 106608.0 [2023-02-24 20:40:50,197][213382] Sum rewards: 27.229, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.735', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO3': '0.106', 'AMMO4': '0.160', 'weapon5': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.584', 'weapon4': '0.644', 'WEAPON3': '0.650', 'HITCOUNT': '1.800', 'weapon3': '2.202', 'DAMAGECOUNT': '7.098', 'FRAGCOUNT': '22.000'} [2023-02-24 20:40:50,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13653.3, 300 sec: 13537.6). Total num frames: 113160192. Throughput: 0: 3430.0. Samples: 3279650. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:40:50,243][213332] Avg episode reward: [(0, '25.591')] [2023-02-24 20:40:50,358][213372] DAMAGECOUNT value on done: 112578.0 [2023-02-24 20:40:50,358][213372] Sum rewards: 34.496, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.522', 'ARMOR': '0.004', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'weapon4': '0.098', 'AMMO3': '0.144', 'weapon5': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.680', 'WEAPON3': '1.000', 'HITCOUNT': '2.380', 'weapon3': '2.758', 'DAMAGECOUNT': '8.865', 'FRAGCOUNT': '30.000'} [2023-02-24 20:40:50,413][213366] DAMAGECOUNT value on done: 114559.0 [2023-02-24 20:40:50,413][213366] Sum rewards: 32.362, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.836', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.022', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'weapon4': '0.348', 'weapon5': '0.356', 'WEAPON5': '0.400', 'weapon2': '0.600', 'WEAPON3': '1.000', 'HITCOUNT': '1.890', 'weapon3': '2.308', 'DAMAGECOUNT': '7.581', 'FRAGCOUNT': '29.000'} [2023-02-24 20:40:50,485][213383] DAMAGECOUNT value on done: 115607.0 [2023-02-24 20:40:50,485][213383] Sum rewards: 29.216, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.264', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.142', 'weapon4': '0.200', 'WEAPON4': '0.300', 'weapon5': '0.378', 'WEAPON5': '0.450', 'weapon2': '0.856', 'WEAPON3': '0.900', 'HITCOUNT': '1.650', 'weapon3': '2.300', 'DAMAGECOUNT': '7.866', 'FRAGCOUNT': '26.000'} [2023-02-24 20:40:50,499][213382] DAMAGECOUNT value on done: 111613.0 [2023-02-24 20:40:50,500][213382] Sum rewards: 24.351, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.591', 'AMMO2': '0.018', 'AMMO5': '0.019', 'AMMO4': '0.090', 'weapon4': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'weapon5': '0.266', 'weapon2': '0.310', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '1.540', 'weapon3': '3.008', 'DAMAGECOUNT': '7.566', 'FRAGCOUNT': '24.000'} [2023-02-24 20:40:50,585][213368] DAMAGECOUNT value on done: 108470.0 [2023-02-24 20:40:50,586][213368] Sum rewards: 22.842, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.857', 'AMMO5': '0.015', 'AMMO2': '0.025', 'WEAPON1': '0.030', 'AMMO3': '0.118', 'AMMO4': '0.122', 'WEAPON4': '0.200', 'weapon5': '0.210', 'WEAPON5': '0.350', 'weapon2': '0.382', 'weapon4': '0.616', 'WEAPON3': '0.850', 'HITCOUNT': '1.580', 'weapon3': '2.370', 'DAMAGECOUNT': '6.831', 'FRAGCOUNT': '20.000'} [2023-02-24 20:40:50,672][213372] DAMAGECOUNT value on done: 109416.0 [2023-02-24 20:40:50,673][213372] Sum rewards: 30.274, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.415', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'WEAPON4': '0.200', 'weapon5': '0.200', 'weapon4': '0.324', 'WEAPON3': '0.800', 'weapon2': '1.098', 'HITCOUNT': '1.770', 'weapon3': '2.032', 'DAMAGECOUNT': '7.422', 'FRAGCOUNT': '25.000'} [2023-02-24 20:40:50,723][213366] DAMAGECOUNT value on done: 109651.0 [2023-02-24 20:40:50,723][213366] Sum rewards: 33.562, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.630', 'AMMO5': '0.008', 'AMMO2': '0.029', 'AMMO3': '0.127', 'AMMO4': '0.147', 'weapon5': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.706', 'WEAPON3': '0.800', 'weapon2': '1.150', 'weapon3': '1.726', 'HITCOUNT': '1.950', 'DAMAGECOUNT': '8.175', 'FRAGCOUNT': '27.000'} [2023-02-24 20:40:50,807][213382] DAMAGECOUNT value on done: 107226.0 [2023-02-24 20:40:50,807][213382] Sum rewards: 25.952, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.507', 'AMMO5': '0.014', 'AMMO2': '0.016', 'AMMO4': '0.077', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon5': '0.212', 'weapon4': '0.282', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'weapon2': '1.188', 'HITCOUNT': '1.540', 'weapon3': '1.816', 'DAMAGECOUNT': '6.921', 'FRAGCOUNT': '20.000'} [2023-02-24 20:40:50,888][213368] DAMAGECOUNT value on done: 111363.0 [2023-02-24 20:40:50,888][213368] Sum rewards: 20.578, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.285', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO5': '0.020', 'AMMO4': '0.084', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'weapon4': '0.250', 'weapon5': '0.292', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon2': '0.848', 'HITCOUNT': '1.370', 'weapon3': '2.052', 'DAMAGECOUNT': '5.556', 'FRAGCOUNT': '18.000'} [2023-02-24 20:40:50,935][213369] DAMAGECOUNT value on done: 114488.0 [2023-02-24 20:40:50,935][213369] Sum rewards: 23.550, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.128', 'AMMO2': '0.017', 'AMMO5': '0.035', 'AMMO4': '0.085', 'AMMO3': '0.117', 'WEAPON4': '0.300', 'weapon5': '0.462', 'weapon2': '0.472', 'weapon4': '0.486', 'WEAPON3': '0.800', 'WEAPON5': '0.850', 'HITCOUNT': '1.600', 'weapon3': '2.300', 'DAMAGECOUNT': '6.654', 'FRAGCOUNT': '22.000'} [2023-02-24 20:40:51,062][213384] DAMAGECOUNT value on done: 112619.0 [2023-02-24 20:40:51,063][213384] Sum rewards: 24.958, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.324', 'AMMO5': '0.015', 'AMMO2': '0.023', 'AMMO3': '0.117', 'AMMO4': '0.117', 'WEAPON4': '0.250', 'weapon5': '0.264', 'weapon4': '0.320', 'WEAPON5': '0.350', 'weapon2': '0.524', 'WEAPON3': '0.850', 'HITCOUNT': '1.610', 'weapon3': '2.588', 'DAMAGECOUNT': '8.004', 'FRAGCOUNT': '21.000'} [2023-02-24 20:40:51,084][213383] DAMAGECOUNT value on done: 110174.0 [2023-02-24 20:40:51,084][213383] Sum rewards: 20.258, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.490', 'AMMO5': '0.005', 'AMMO2': '0.037', 'AMMO3': '0.105', 'weapon5': '0.136', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.450', 'WEAPON3': '0.650', 'weapon2': '0.838', 'weapon4': '1.044', 'HITCOUNT': '1.630', 'weapon3': '1.800', 'DAMAGECOUNT': '6.417', 'FRAGCOUNT': '18.000'} [2023-02-24 20:40:51,114][213382] DAMAGECOUNT value on done: 109191.0 [2023-02-24 20:40:51,115][213382] Sum rewards: 21.104, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.754', 'ARMOR': '0.004', 'AMMO2': '0.017', 'AMMO5': '0.022', 'AMMO4': '0.083', 'AMMO3': '0.086', 'WEAPON4': '0.300', 'weapon5': '0.398', 'weapon4': '0.432', 'weapon2': '0.446', 'WEAPON5': '0.550', 'WEAPON3': '0.550', 'HITCOUNT': '1.660', 'weapon3': '2.238', 'DAMAGECOUNT': '6.321', 'FRAGCOUNT': '17.000'} [2023-02-24 20:40:51,179][213368] DAMAGECOUNT value on done: 114280.0 [2023-02-24 20:40:51,179][213368] Sum rewards: 30.375, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.128', 'AMMO5': '0.015', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.157', 'weapon5': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.410', 'weapon2': '0.816', 'WEAPON3': '1.000', 'HITCOUNT': '1.920', 'weapon3': '2.372', 'DAMAGECOUNT': '7.770', 'FRAGCOUNT': '29.000'} [2023-02-24 20:40:51,228][213369] DAMAGECOUNT value on done: 114981.0 [2023-02-24 20:40:51,228][213369] Sum rewards: 22.680, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.488', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.029', 'AMMO3': '0.125', 'AMMO4': '0.146', 'WEAPON4': '0.350', 'weapon2': '0.488', 'weapon5': '0.538', 'weapon4': '0.622', 'WEAPON5': '0.650', 'WEAPON3': '0.850', 'HITCOUNT': '1.650', 'weapon3': '2.066', 'DAMAGECOUNT': '7.377', 'FRAGCOUNT': '20.000'} [2023-02-24 20:40:51,370][213384] DAMAGECOUNT value on done: 105073.0 [2023-02-24 20:40:51,371][213384] Sum rewards: 29.964, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.363', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.082', 'AMMO3': '0.138', 'weapon5': '0.144', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.456', 'weapon2': '0.730', 'WEAPON3': '0.850', 'HITCOUNT': '2.390', 'weapon3': '2.402', 'DAMAGECOUNT': '9.150', 'FRAGCOUNT': '25.000'} [2023-02-24 20:40:51,391][213383] DAMAGECOUNT value on done: 103250.0 [2023-02-24 20:40:51,391][213383] Sum rewards: 30.669, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.046', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.058', 'AMMO3': '0.097', 'AMMO4': '0.289', 'weapon5': '0.314', 'WEAPON5': '0.450', 'weapon2': '0.514', 'WEAPON3': '0.700', 'WEAPON4': '0.700', 'weapon4': '0.954', 'weapon3': '1.952', 'HITCOUNT': '2.100', 'DAMAGECOUNT': '8.817', 'FRAGCOUNT': '27.000'} [2023-02-24 20:40:51,483][213368] DAMAGECOUNT value on done: 111708.0 [2023-02-24 20:40:51,483][213368] Sum rewards: 15.793, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.486', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO5': '0.012', 'AMMO4': '0.045', 'AMMO3': '0.118', 'WEAPON4': '0.250', 'weapon5': '0.376', 'WEAPON5': '0.400', 'weapon4': '0.436', 'weapon2': '0.616', 'WEAPON3': '0.800', 'HITCOUNT': '1.250', 'weapon3': '2.184', 'DAMAGECOUNT': '4.779', 'FRAGCOUNT': '15.000'} [2023-02-24 20:40:51,556][213384] DAMAGECOUNT value on done: 113585.0 [2023-02-24 20:40:51,556][213384] Sum rewards: 14.251, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.210', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.040', 'AMMO4': '0.045', 'AMMO3': '0.047', 'weapon7': '0.054', 'weapon5': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'HITCOUNT': '0.780', 'weapon4': '0.932', 'weapon2': '1.104', 'weapon3': '1.432', 'DAMAGECOUNT': '3.615', 'FRAGCOUNT': '9.000'} [2023-02-24 20:40:51,572][213369] DAMAGECOUNT value on done: 114538.0 [2023-02-24 20:40:51,573][213369] Sum rewards: 38.147, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.306', 'AMMO2': '0.006', 'AMMO5': '0.008', 'AMMO4': '0.028', 'weapon4': '0.094', 'WEAPON4': '0.100', 'weapon5': '0.158', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.500', 'HITCOUNT': '2.640', 'weapon3': '3.202', 'DAMAGECOUNT': '11.436', 'FRAGCOUNT': '34.000'} [2023-02-24 20:40:51,852][213384] DAMAGECOUNT value on done: 114408.0 [2023-02-24 20:40:51,853][213384] Sum rewards: 40.694, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.010', 'AMMO2': '0.030', 'HEALTH': '0.056', 'AMMO3': '0.123', 'weapon5': '0.144', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'weapon4': '0.242', 'WEAPON5': '0.250', 'weapon2': '0.674', 'WEAPON3': '0.750', 'HITCOUNT': '2.270', 'weapon3': '2.544', 'DAMAGECOUNT': '10.749', 'FRAGCOUNT': '33.000'} [2023-02-24 20:40:51,878][213369] DAMAGECOUNT value on done: 103458.0 [2023-02-24 20:40:51,878][213369] Sum rewards: 24.325, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.626', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.022', 'WEAPON4': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.116', 'weapon4': '0.116', 'weapon5': '0.236', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'weapon2': '0.990', 'HITCOUNT': '1.870', 'weapon3': '2.490', 'DAMAGECOUNT': '7.236', 'FRAGCOUNT': '19.000'} [2023-02-24 20:40:52,641][213365] Updated weights for policy 0, policy_version 27636 (0.0008) [2023-02-24 20:40:55,243][213332] Fps is (10 sec: 13516.5, 60 sec: 13721.6, 300 sec: 13537.6). Total num frames: 113229824. Throughput: 0: 3432.6. Samples: 3300262. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:40:55,244][213332] Avg episode reward: [(0, '26.157')] [2023-02-24 20:40:55,584][213365] Updated weights for policy 0, policy_version 27646 (0.0009) [2023-02-24 20:40:58,564][213365] Updated weights for policy 0, policy_version 27656 (0.0009) [2023-02-24 20:41:00,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13721.6, 300 sec: 13537.6). Total num frames: 113299456. Throughput: 0: 3434.6. Samples: 3320900. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:41:00,243][213332] Avg episode reward: [(0, '26.157')] [2023-02-24 20:41:01,578][213365] Updated weights for policy 0, policy_version 27666 (0.0009) [2023-02-24 20:41:04,572][213365] Updated weights for policy 0, policy_version 27676 (0.0009) [2023-02-24 20:41:05,243][213332] Fps is (10 sec: 13926.6, 60 sec: 13721.6, 300 sec: 13551.5). Total num frames: 113369088. Throughput: 0: 3432.5. Samples: 3331162. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:41:05,243][213332] Avg episode reward: [(0, '26.157')] [2023-02-24 20:41:06,484][213368] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 20:41:07,553][213365] Updated weights for policy 0, policy_version 27686 (0.0009) [2023-02-24 20:41:08,832][213367] DAMAGECOUNT value on done: 111999.0 [2023-02-24 20:41:08,833][213367] Sum rewards: 31.456, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.500', 'AMMO2': '0.013', 'AMMO5': '0.017', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'weapon4': '0.110', 'AMMO3': '0.113', 'weapon5': '0.412', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'weapon2': '0.754', 'HITCOUNT': '1.750', 'weapon3': '2.452', 'DAMAGECOUNT': '8.271', 'FRAGCOUNT': '25.000'} [2023-02-24 20:41:09,138][213367] DAMAGECOUNT value on done: 114777.0 [2023-02-24 20:41:09,139][213367] Sum rewards: 13.797, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.630', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.018', 'AMMO3': '0.071', 'AMMO4': '0.091', 'weapon4': '0.214', 'WEAPON4': '0.250', 'weapon5': '0.328', 'WEAPON3': '0.500', 'WEAPON5': '0.550', 'weapon2': '0.814', 'HITCOUNT': '0.970', 'weapon3': '1.924', 'DAMAGECOUNT': '3.675', 'FRAGCOUNT': '12.000'} [2023-02-24 20:41:09,140][213372] DAMAGECOUNT value on done: 113271.0 [2023-02-24 20:41:09,141][213372] Sum rewards: 25.960, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.100', 'AMMO2': '0.019', 'AMMO5': '0.022', 'AMMO4': '0.093', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'weapon5': '0.214', 'weapon4': '0.226', 'WEAPON5': '0.500', 'weapon2': '0.664', 'WEAPON3': '0.850', 'HITCOUNT': '1.830', 'weapon3': '2.644', 'DAMAGECOUNT': '7.206', 'FRAGCOUNT': '22.000'} [2023-02-24 20:41:09,454][213372] DAMAGECOUNT value on done: 114528.0 [2023-02-24 20:41:09,454][213372] Sum rewards: 17.487, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.034', 'AMMO2': '0.017', 'AMMO5': '0.024', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'weapon4': '0.274', 'weapon5': '0.412', 'WEAPON5': '0.600', 'WEAPON3': '0.850', 'weapon2': '1.048', 'HITCOUNT': '1.270', 'weapon3': '1.666', 'DAMAGECOUNT': '6.222', 'FRAGCOUNT': '15.500'} [2023-02-24 20:41:09,456][213367] DAMAGECOUNT value on done: 113726.0 [2023-02-24 20:41:09,456][213367] Sum rewards: 19.977, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.015', 'AMMO5': '0.020', 'WEAPON1': '0.040', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'weapon4': '0.164', 'weapon5': '0.362', 'HEALTH': '0.390', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'weapon2': '0.748', 'HITCOUNT': '1.420', 'weapon3': '2.010', 'DAMAGECOUNT': '5.664', 'FRAGCOUNT': '16.000'} [2023-02-24 20:41:09,468][213366] DAMAGECOUNT value on done: 110840.0 [2023-02-24 20:41:09,468][213366] Sum rewards: 21.883, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.057', 'AMMO3': '0.105', 'WEAPON4': '0.150', 'HEALTH': '0.178', 'weapon5': '0.288', 'WEAPON5': '0.300', 'weapon4': '0.572', 'WEAPON3': '0.600', 'weapon2': '1.150', 'HITCOUNT': '1.340', 'weapon3': '1.720', 'DAMAGECOUNT': '6.891', 'FRAGCOUNT': '16.000'} [2023-02-24 20:41:09,764][213367] DAMAGECOUNT value on done: 111699.0 [2023-02-24 20:41:09,764][213367] Sum rewards: 19.287, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.932', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.150', 'weapon4': '0.242', 'WEAPON4': '0.350', 'weapon5': '0.410', 'WEAPON5': '0.700', 'weapon2': '0.782', 'WEAPON3': '0.950', 'HITCOUNT': '1.620', 'weapon3': '2.186', 'DAMAGECOUNT': '6.873', 'FRAGCOUNT': '18.000'} [2023-02-24 20:41:09,774][213366] DAMAGECOUNT value on done: 118983.0 [2023-02-24 20:41:09,774][213366] Sum rewards: 22.064, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.730', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.038', 'AMMO3': '0.095', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.144', 'AMMO4': '0.190', 'WEAPON7': '0.200', 'weapon5': '0.202', 'weapon2': '0.420', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'WEAPON4': '0.650', 'weapon4': '1.210', 'HITCOUNT': '1.760', 'weapon3': '1.766', 'DAMAGECOUNT': '6.258', 'FRAGCOUNT': '21.000'} [2023-02-24 20:41:09,848][213382] DAMAGECOUNT value on done: 109862.0 [2023-02-24 20:41:09,848][213382] Sum rewards: 38.078, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.302', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO3': '0.149', 'weapon5': '0.160', 'AMMO4': '0.172', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon4': '0.474', 'WEAPON3': '0.900', 'weapon2': '0.984', 'weapon3': '2.132', 'HITCOUNT': '2.150', 'DAMAGECOUNT': '9.762', 'FRAGCOUNT': '32.000'} [2023-02-24 20:41:09,880][213383] DAMAGECOUNT value on done: 112158.0 [2023-02-24 20:41:09,880][213383] Sum rewards: 26.293, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.792', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.030', 'AMMO3': '0.102', 'AMMO4': '0.152', 'WEAPON4': '0.350', 'weapon5': '0.402', 'WEAPON5': '0.500', 'weapon4': '0.608', 'WEAPON3': '0.650', 'weapon2': '1.050', 'HITCOUNT': '1.610', 'weapon3': '1.634', 'DAMAGECOUNT': '7.227', 'FRAGCOUNT': '22.000'} [2023-02-24 20:41:09,986][213372] DAMAGECOUNT value on done: 114693.0 [2023-02-24 20:41:09,986][213372] Sum rewards: 32.540, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.700', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'weapon4': '0.044', 'WEAPON4': '0.050', 'AMMO3': '0.105', 'weapon5': '0.224', 'WEAPON5': '0.250', 'weapon2': '0.744', 'WEAPON3': '0.750', 'HITCOUNT': '1.700', 'weapon3': '2.524', 'DAMAGECOUNT': '6.345', 'FRAGCOUNT': '28.000'} [2023-02-24 20:41:10,079][213366] DAMAGECOUNT value on done: 117173.0 [2023-02-24 20:41:10,080][213366] Sum rewards: 29.868, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.730', 'weapon7': '0.006', 'AMMO5': '0.014', 'AMMO2': '0.049', 'AMMO3': '0.096', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.243', 'WEAPON4': '0.350', 'weapon5': '0.388', 'WEAPON5': '0.450', 'weapon2': '0.468', 'weapon4': '0.584', 'WEAPON3': '0.650', 'HITCOUNT': '1.660', 'weapon3': '1.948', 'DAMAGECOUNT': '7.842', 'FRAGCOUNT': '26.000'} [2023-02-24 20:41:10,150][213382] DAMAGECOUNT value on done: 114978.0 [2023-02-24 20:41:10,150][213382] Sum rewards: 39.589, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.828', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon7': '0.054', 'weapon4': '0.092', 'WEAPON4': '0.100', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.276', 'weapon2': '0.622', 'WEAPON3': '1.200', 'HITCOUNT': '2.400', 'weapon3': '2.582', 'DAMAGECOUNT': '10.095', 'FRAGCOUNT': '35.000'} [2023-02-24 20:41:10,183][213368] DAMAGECOUNT value on done: 111202.0 [2023-02-24 20:41:10,184][213368] Sum rewards: 31.292, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.250', 'AMMO2': '0.017', 'AMMO5': '0.020', 'AMMO4': '0.086', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'weapon4': '0.254', 'weapon5': '0.436', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'weapon2': '0.810', 'HITCOUNT': '1.400', 'weapon3': '2.138', 'DAMAGECOUNT': '8.193', 'FRAGCOUNT': '23.000'} [2023-02-24 20:41:10,192][213383] DAMAGECOUNT value on done: 118328.0 [2023-02-24 20:41:10,192][213383] Sum rewards: 28.582, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.781', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO3': '0.130', 'AMMO4': '0.165', 'weapon5': '0.230', 'weapon4': '0.394', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.608', 'WEAPON3': '0.900', 'HITCOUNT': '2.140', 'weapon3': '2.488', 'DAMAGECOUNT': '8.163', 'FRAGCOUNT': '27.000'} [2023-02-24 20:41:10,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13721.6, 300 sec: 13537.6). Total num frames: 113434624. Throughput: 0: 3429.2. Samples: 3351630. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:41:10,243][213332] Avg episode reward: [(0, '26.433')] [2023-02-24 20:41:10,262][213352] Saving new best policy, reward=26.433! [2023-02-24 20:41:10,302][213372] DAMAGECOUNT value on done: 112008.0 [2023-02-24 20:41:10,303][213372] Sum rewards: 25.018, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.660', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon7': '0.076', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.122', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.234', 'WEAPON4': '0.300', 'WEAPON3': '0.700', 'weapon4': '0.770', 'weapon2': '0.830', 'weapon3': '1.726', 'HITCOUNT': '1.860', 'DAMAGECOUNT': '7.776', 'FRAGCOUNT': '21.000'} [2023-02-24 20:41:10,394][213366] DAMAGECOUNT value on done: 112847.0 [2023-02-24 20:41:10,395][213366] Sum rewards: 30.301, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.216', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'AMMO3': '0.210', 'weapon5': '0.268', 'weapon4': '0.296', 'WEAPON5': '0.350', 'weapon2': '0.454', 'WEAPON3': '1.250', 'HITCOUNT': '2.130', 'weapon3': '2.648', 'DAMAGECOUNT': '9.588', 'FRAGCOUNT': '27.000'} [2023-02-24 20:41:10,464][213382] DAMAGECOUNT value on done: 108905.0 [2023-02-24 20:41:10,465][213382] Sum rewards: 14.635, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.376', 'WEAPON1': '0.010', 'AMMO5': '0.026', 'AMMO2': '0.039', 'weapon4': '0.052', 'AMMO3': '0.139', 'AMMO4': '0.194', 'WEAPON4': '0.200', 'weapon5': '0.298', 'WEAPON5': '0.650', 'WEAPON3': '0.800', 'weapon2': '0.808', 'HITCOUNT': '1.260', 'weapon3': '2.498', 'DAMAGECOUNT': '5.037', 'FRAGCOUNT': '13.000'} [2023-02-24 20:41:10,500][213369] DAMAGECOUNT value on done: 116421.0 [2023-02-24 20:41:10,501][213369] Sum rewards: 21.859, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.980', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.045', 'weapon4': '0.136', 'AMMO3': '0.142', 'WEAPON4': '0.200', 'AMMO4': '0.224', 'weapon5': '0.368', 'WEAPON5': '0.550', 'weapon2': '0.580', 'WEAPON3': '0.900', 'HITCOUNT': '1.270', 'weapon3': '2.590', 'DAMAGECOUNT': '5.799', 'FRAGCOUNT': '20.000'} [2023-02-24 20:41:10,502][213368] DAMAGECOUNT value on done: 113562.0 [2023-02-24 20:41:10,502][213368] Sum rewards: 22.541, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.176', 'AMMO5': '0.017', 'AMMO2': '0.039', 'AMMO3': '0.113', 'AMMO4': '0.195', 'weapon5': '0.298', 'WEAPON4': '0.400', 'weapon4': '0.434', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon2': '0.804', 'HITCOUNT': '1.570', 'weapon3': '1.990', 'DAMAGECOUNT': '6.357', 'FRAGCOUNT': '20.000'} [2023-02-24 20:41:10,581][213365] Updated weights for policy 0, policy_version 27696 (0.0009) [2023-02-24 20:41:10,729][213384] DAMAGECOUNT value on done: 115098.0 [2023-02-24 20:41:10,729][213384] Sum rewards: 30.646, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.845', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.078', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'weapon5': '0.222', 'WEAPON5': '0.350', 'weapon4': '0.462', 'WEAPON3': '0.650', 'weapon2': '0.808', 'HITCOUNT': '2.110', 'weapon3': '2.138', 'DAMAGECOUNT': '7.437', 'FRAGCOUNT': '23.000'} [2023-02-24 20:41:10,760][213382] DAMAGECOUNT value on done: 112755.0 [2023-02-24 20:41:10,761][213382] Sum rewards: 42.937, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.496', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.080', 'weapon2': '0.144', 'WEAPON5': '0.150', 'weapon5': '0.154', 'AMMO3': '0.230', 'WEAPON3': '1.400', 'HITCOUNT': '2.330', 'weapon3': '3.388', 'DAMAGECOUNT': '10.692', 'FRAGCOUNT': '40.000'} [2023-02-24 20:41:10,784][213383] DAMAGECOUNT value on done: 113220.0 [2023-02-24 20:41:10,785][213383] Sum rewards: 31.637, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.020', 'AMMO2': '0.008', 'AMMO5': '0.011', 'AMMO4': '0.039', 'AMMO3': '0.162', 'weapon5': '0.228', 'WEAPON5': '0.350', 'weapon2': '0.524', 'WEAPON3': '1.100', 'HITCOUNT': '2.070', 'weapon3': '3.026', 'DAMAGECOUNT': '9.138', 'FRAGCOUNT': '26.000'} [2023-02-24 20:41:10,789][213368] DAMAGECOUNT value on done: 116155.0 [2023-02-24 20:41:10,790][213368] Sum rewards: 16.276, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.190', 'AMMO5': '0.020', 'AMMO2': '0.054', 'AMMO3': '0.146', 'WEAPON4': '0.200', 'weapon4': '0.212', 'weapon5': '0.250', 'AMMO4': '0.269', 'WEAPON5': '0.500', 'weapon2': '0.766', 'WEAPON3': '0.850', 'HITCOUNT': '1.410', 'weapon3': '2.414', 'DAMAGECOUNT': '5.625', 'FRAGCOUNT': '14.500'} [2023-02-24 20:41:10,805][213369] DAMAGECOUNT value on done: 117196.0 [2023-02-24 20:41:10,805][213369] Sum rewards: 18.686, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.610', 'AMMO5': '0.011', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.147', 'weapon5': '0.258', 'WEAPON5': '0.400', 'weapon2': '0.794', 'WEAPON3': '1.000', 'HITCOUNT': '1.490', 'weapon3': '2.588', 'DAMAGECOUNT': '6.645', 'FRAGCOUNT': '16.000'} [2023-02-24 20:41:11,033][213384] DAMAGECOUNT value on done: 107523.0 [2023-02-24 20:41:11,034][213384] Sum rewards: 27.773, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.935', 'AMMO5': '0.014', 'WEAPON1': '0.030', 'AMMO2': '0.030', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'AMMO4': '0.151', 'weapon4': '0.250', 'weapon5': '0.306', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon2': '0.792', 'HITCOUNT': '1.740', 'weapon3': '2.248', 'DAMAGECOUNT': '7.350', 'FRAGCOUNT': '22.000'} [2023-02-24 20:41:11,087][213383] DAMAGECOUNT value on done: 106369.0 [2023-02-24 20:41:11,088][213383] Sum rewards: 33.770, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.014', 'AMMO5': '0.016', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'weapon4': '0.126', 'AMMO3': '0.138', 'HEALTH': '0.166', 'weapon5': '0.382', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'weapon2': '1.026', 'HITCOUNT': '1.950', 'weapon3': '2.176', 'DAMAGECOUNT': '9.357', 'FRAGCOUNT': '26.000'} [2023-02-24 20:41:11,092][213368] DAMAGECOUNT value on done: 113948.0 [2023-02-24 20:41:11,093][213368] Sum rewards: 26.456, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.370', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.029', 'AMMO3': '0.115', 'WEAPON4': '0.150', 'weapon5': '0.268', 'WEAPON5': '0.300', 'weapon4': '0.306', 'WEAPON3': '0.750', 'weapon2': '0.846', 'HITCOUNT': '1.480', 'weapon3': '2.346', 'DAMAGECOUNT': '6.720', 'FRAGCOUNT': '22.000'} [2023-02-24 20:41:11,177][213369] DAMAGECOUNT value on done: 117531.0 [2023-02-24 20:41:11,177][213369] Sum rewards: 35.000, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.567', 'AMMO5': '0.020', 'AMMO2': '0.036', 'AMMO3': '0.093', 'AMMO4': '0.179', 'WEAPON4': '0.200', 'weapon5': '0.258', 'weapon4': '0.326', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon2': '0.614', 'HITCOUNT': '2.010', 'weapon3': '2.502', 'DAMAGECOUNT': '8.979', 'FRAGCOUNT': '26.000'} [2023-02-24 20:41:11,228][213384] DAMAGECOUNT value on done: 115515.0 [2023-02-24 20:41:11,229][213384] Sum rewards: 23.011, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.290', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.021', 'weapon4': '0.060', 'AMMO3': '0.100', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'weapon5': '0.426', 'WEAPON5': '0.600', 'WEAPON3': '0.650', 'weapon2': '0.984', 'HITCOUNT': '1.300', 'weapon3': '2.080', 'DAMAGECOUNT': '5.790', 'FRAGCOUNT': '21.000'} [2023-02-24 20:41:11,489][213369] DAMAGECOUNT value on done: 105147.0 [2023-02-24 20:41:11,489][213369] Sum rewards: 19.859, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.780', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.035', 'AMMO3': '0.132', 'AMMO4': '0.177', 'weapon5': '0.188', 'WEAPON4': '0.350', 'weapon4': '0.418', 'WEAPON5': '0.450', 'weapon2': '0.610', 'WEAPON3': '0.800', 'HITCOUNT': '1.420', 'weapon3': '2.464', 'DAMAGECOUNT': '5.067', 'FRAGCOUNT': '20.000'} [2023-02-24 20:41:11,540][213384] DAMAGECOUNT value on done: 117676.0 [2023-02-24 20:41:11,541][213384] Sum rewards: 38.471, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.496', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'weapon4': '0.268', 'weapon5': '0.390', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'weapon2': '1.000', 'weapon3': '2.060', 'HITCOUNT': '2.130', 'DAMAGECOUNT': '9.804', 'FRAGCOUNT': '30.000'} [2023-02-24 20:41:13,591][213365] Updated weights for policy 0, policy_version 27706 (0.0009) [2023-02-24 20:41:15,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13721.6, 300 sec: 13523.7). Total num frames: 113504256. Throughput: 0: 3428.1. Samples: 3372074. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:41:15,243][213332] Avg episode reward: [(0, '26.727')] [2023-02-24 20:41:15,246][213352] Saving new best policy, reward=26.727! [2023-02-24 20:41:16,573][213365] Updated weights for policy 0, policy_version 27716 (0.0009) [2023-02-24 20:41:19,517][213383] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 20:41:19,559][213365] Updated weights for policy 0, policy_version 27726 (0.0008) [2023-02-24 20:41:20,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13721.6, 300 sec: 13523.7). Total num frames: 113573888. Throughput: 0: 3431.3. Samples: 3382340. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:41:20,243][213332] Avg episode reward: [(0, '26.727')] [2023-02-24 20:41:22,551][213365] Updated weights for policy 0, policy_version 27736 (0.0009) [2023-02-24 20:41:25,243][213332] Fps is (10 sec: 13926.2, 60 sec: 13721.6, 300 sec: 13537.6). Total num frames: 113643520. Throughput: 0: 3426.2. Samples: 3402886. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:41:25,243][213332] Avg episode reward: [(0, '26.727')] [2023-02-24 20:41:25,535][213365] Updated weights for policy 0, policy_version 27746 (0.0009) [2023-02-24 20:41:27,386][213366] Large shaping reward 2.577 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.045, -15.0), ('weapon5', 0.002)] [2023-02-24 20:41:28,539][213367] DAMAGECOUNT value on done: 114864.0 [2023-02-24 20:41:28,539][213367] Sum rewards: 29.941, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.567', 'AMMO5': '0.018', 'AMMO2': '0.022', 'weapon7': '0.088', 'AMMO4': '0.108', 'AMMO3': '0.153', 'WEAPON4': '0.250', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'weapon4': '0.402', 'weapon5': '0.428', 'WEAPON5': '0.450', 'weapon2': '0.454', 'WEAPON3': '0.950', 'HITCOUNT': '1.720', 'weapon3': '2.330', 'DAMAGECOUNT': '8.595', 'FRAGCOUNT': '25.000'} [2023-02-24 20:41:28,599][213365] Updated weights for policy 0, policy_version 27756 (0.0010) [2023-02-24 20:41:28,824][213372] DAMAGECOUNT value on done: 115938.0 [2023-02-24 20:41:28,825][213372] Sum rewards: 30.910, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.530', 'AMMO5': '0.017', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO3': '0.110', 'WEAPON4': '0.250', 'weapon5': '0.316', 'WEAPON5': '0.450', 'weapon2': '0.656', 'weapon4': '0.674', 'WEAPON3': '0.700', 'HITCOUNT': '2.050', 'weapon3': '2.084', 'DAMAGECOUNT': '8.001', 'FRAGCOUNT': '25.000'} [2023-02-24 20:41:28,849][213367] DAMAGECOUNT value on done: 117657.0 [2023-02-24 20:41:28,850][213367] Sum rewards: 33.011, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.136', 'weapon7': '0.144', 'weapon5': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'HEALTH': '0.368', 'weapon4': '0.522', 'weapon2': '0.724', 'WEAPON3': '0.750', 'HITCOUNT': '1.750', 'weapon3': '2.026', 'DAMAGECOUNT': '8.640', 'FRAGCOUNT': '28.000'} [2023-02-24 20:41:29,134][213372] DAMAGECOUNT value on done: 115396.0 [2023-02-24 20:41:29,135][213372] Sum rewards: 8.151, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.039', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.031', 'AMMO3': '0.107', 'AMMO4': '0.153', 'weapon5': '0.160', 'WEAPON4': '0.200', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON7': '0.400', 'weapon7': '0.434', 'WEAPON5': '0.450', 'HITCOUNT': '0.630', 'WEAPON3': '0.650', 'weapon2': '0.660', 'weapon3': '1.256', 'weapon4': '1.294', 'DAMAGECOUNT': '2.604', 'FRAGCOUNT': '7.000'} [2023-02-24 20:41:29,148][213367] DAMAGECOUNT value on done: 115372.0 [2023-02-24 20:41:29,149][213367] Sum rewards: 21.796, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.990', 'AMMO5': '0.017', 'AMMO2': '0.020', 'AMMO3': '0.050', 'AMMO4': '0.102', 'weapon5': '0.286', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'weapon4': '0.446', 'WEAPON5': '0.450', 'weapon2': '1.128', 'HITCOUNT': '1.240', 'weapon3': '1.708', 'DAMAGECOUNT': '4.938', 'FRAGCOUNT': '17.000'} [2023-02-24 20:41:29,154][213366] DAMAGECOUNT value on done: 113679.0 [2023-02-24 20:41:29,154][213366] Sum rewards: 22.725, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.570', 'ARMOR': '0.004', 'AMMO2': '0.025', 'AMMO5': '0.026', 'weapon7': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.125', 'weapon5': '0.180', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon4': '0.232', 'weapon2': '0.492', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '1.850', 'weapon3': '2.712', 'DAMAGECOUNT': '8.517', 'FRAGCOUNT': '22.000'} [2023-02-24 20:41:29,459][213367] DAMAGECOUNT value on done: 113229.0 [2023-02-24 20:41:29,459][213367] Sum rewards: 16.328, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.270', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon7': '0.110', 'AMMO3': '0.122', 'WEAPON4': '0.200', 'weapon4': '0.262', 'AMMO6': '0.320', 'AMMO7': '0.320', 'weapon5': '0.384', 'WEAPON7': '0.400', 'weapon2': '0.530', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'HITCOUNT': '0.990', 'weapon3': '2.384', 'DAMAGECOUNT': '4.590', 'FRAGCOUNT': '14.000'} [2023-02-24 20:41:29,463][213366] DAMAGECOUNT value on done: 121404.0 [2023-02-24 20:41:29,464][213366] Sum rewards: 23.083, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.695', 'AMMO5': '0.028', 'AMMO2': '0.051', 'AMMO3': '0.089', 'AMMO4': '0.256', 'weapon4': '0.390', 'WEAPON4': '0.550', 'weapon5': '0.590', 'WEAPON3': '0.600', 'WEAPON5': '0.750', 'weapon2': '1.168', 'HITCOUNT': '1.400', 'weapon3': '1.572', 'DAMAGECOUNT': '7.083', 'FRAGCOUNT': '20.000'} [2023-02-24 20:41:29,577][213382] DAMAGECOUNT value on done: 112809.0 [2023-02-24 20:41:29,577][213382] Sum rewards: 27.545, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.736', 'AMMO5': '0.022', 'AMMO2': '0.050', 'AMMO3': '0.149', 'AMMO4': '0.249', 'weapon2': '0.288', 'weapon5': '0.416', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.000', 'weapon4': '1.036', 'weapon3': '1.880', 'HITCOUNT': '2.200', 'DAMAGECOUNT': '8.841', 'FRAGCOUNT': '25.000'} [2023-02-24 20:41:29,616][213383] DAMAGECOUNT value on done: 115489.0 [2023-02-24 20:41:29,617][213383] Sum rewards: 26.432, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.298', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.050', 'AMMO3': '0.186', 'AMMO4': '0.251', 'weapon2': '0.274', 'weapon5': '0.372', 'WEAPON4': '0.650', 'weapon4': '0.668', 'WEAPON5': '0.800', 'WEAPON3': '1.100', 'HITCOUNT': '2.030', 'weapon3': '2.326', 'DAMAGECOUNT': '9.993', 'FRAGCOUNT': '26.000'} [2023-02-24 20:41:29,639][213372] DAMAGECOUNT value on done: 116521.0 [2023-02-24 20:41:29,640][213372] Sum rewards: 23.468, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.650', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.026', 'AMMO3': '0.071', 'weapon7': '0.118', 'weapon5': '0.124', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.500', 'weapon2': '0.876', 'weapon3': '1.230', 'weapon4': '1.268', 'HITCOUNT': '1.330', 'DAMAGECOUNT': '5.484', 'FRAGCOUNT': '18.000'} [2023-02-24 20:41:29,785][213366] DAMAGECOUNT value on done: 120458.0 [2023-02-24 20:41:29,785][213366] Sum rewards: 31.306, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.410', 'ARMOR': '0.004', 'AMMO5': '0.026', 'AMMO2': '0.044', 'AMMO3': '0.152', 'weapon2': '0.164', 'AMMO4': '0.221', 'weapon5': '0.358', 'WEAPON4': '0.550', 'WEAPON5': '0.700', 'weapon4': '0.824', 'WEAPON3': '0.950', 'weapon3': '2.278', 'HITCOUNT': '2.340', 'DAMAGECOUNT': '9.855', 'FRAGCOUNT': '28.000'} [2023-02-24 20:41:29,837][213368] DAMAGECOUNT value on done: 112632.0 [2023-02-24 20:41:29,837][213368] Sum rewards: 21.661, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.445', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO5': '0.010', 'weapon4': '0.016', 'AMMO4': '0.035', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'weapon5': '0.286', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '1.040', 'weapon2': '1.412', 'weapon3': '2.080', 'DAMAGECOUNT': '4.290', 'FRAGCOUNT': '18.000'} [2023-02-24 20:41:29,887][213382] DAMAGECOUNT value on done: 117180.0 [2023-02-24 20:41:29,887][213382] Sum rewards: 23.653, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.269', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO3': '0.111', 'AMMO4': '0.126', 'weapon5': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.562', 'weapon4': '0.652', 'WEAPON3': '0.700', 'HITCOUNT': '1.620', 'weapon3': '2.250', 'DAMAGECOUNT': '6.606', 'FRAGCOUNT': '21.000'} [2023-02-24 20:41:29,938][213383] DAMAGECOUNT value on done: 121441.0 [2023-02-24 20:41:29,938][213383] Sum rewards: 29.640, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.675', 'AMMO5': '0.027', 'AMMO2': '0.064', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.157', 'weapon2': '0.228', 'weapon5': '0.276', 'AMMO4': '0.319', 'WEAPON4': '0.650', 'WEAPON5': '0.700', 'WEAPON3': '1.000', 'weapon4': '1.116', 'HITCOUNT': '1.980', 'weapon3': '2.068', 'DAMAGECOUNT': '9.180', 'FRAGCOUNT': '27.000'} [2023-02-24 20:41:29,962][213372] DAMAGECOUNT value on done: 114649.0 [2023-02-24 20:41:29,963][213372] Sum rewards: 27.243, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.553', 'AMMO2': '0.013', 'AMMO5': '0.018', 'AMMO4': '0.066', 'AMMO3': '0.112', 'WEAPON4': '0.200', 'weapon4': '0.300', 'weapon5': '0.360', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon2': '0.664', 'HITCOUNT': '1.500', 'weapon3': '2.040', 'DAMAGECOUNT': '7.923', 'FRAGCOUNT': '21.000'} [2023-02-24 20:41:30,108][213366] DAMAGECOUNT value on done: 116003.0 [2023-02-24 20:41:30,108][213366] Sum rewards: 32.830, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.813', 'AMMO5': '0.016', 'AMMO2': '0.039', 'AMMO3': '0.136', 'AMMO4': '0.192', 'weapon2': '0.244', 'weapon5': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.848', 'WEAPON3': '0.850', 'HITCOUNT': '1.980', 'weapon3': '2.022', 'DAMAGECOUNT': '9.468', 'FRAGCOUNT': '28.000'} [2023-02-24 20:41:30,175][213368] DAMAGECOUNT value on done: 116182.0 [2023-02-24 20:41:30,176][213368] Sum rewards: 25.413, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.521', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.054', 'AMMO3': '0.160', 'AMMO4': '0.270', 'weapon5': '0.376', 'weapon2': '0.564', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'weapon4': '0.708', 'WEAPON3': '1.000', 'HITCOUNT': '1.880', 'weapon3': '1.988', 'DAMAGECOUNT': '7.860', 'FRAGCOUNT': '27.000'} [2023-02-24 20:41:30,220][213382] DAMAGECOUNT value on done: 111325.0 [2023-02-24 20:41:30,220][213382] Sum rewards: 22.467, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.000', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.130', 'WEAPON5': '0.250', 'weapon5': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.578', 'weapon4': '0.764', 'WEAPON3': '0.800', 'HITCOUNT': '1.850', 'weapon3': '2.112', 'DAMAGECOUNT': '7.260', 'FRAGCOUNT': '19.000'} [2023-02-24 20:41:30,238][213369] DAMAGECOUNT value on done: 118717.0 [2023-02-24 20:41:30,239][213369] Sum rewards: 18.513, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.428', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.045', 'AMMO3': '0.127', 'AMMO4': '0.223', 'weapon5': '0.318', 'weapon4': '0.392', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'weapon2': '1.020', 'HITCOUNT': '1.470', 'weapon3': '1.872', 'DAMAGECOUNT': '6.888', 'FRAGCOUNT': '17.000'} [2023-02-24 20:41:30,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13721.6, 300 sec: 13523.7). Total num frames: 113709056. Throughput: 0: 3417.6. Samples: 3423210. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:41:30,243][213332] Avg episode reward: [(0, '25.855')] [2023-02-24 20:41:30,483][213384] DAMAGECOUNT value on done: 118229.0 [2023-02-24 20:41:30,484][213384] Sum rewards: 34.611, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.807', 'AMMO2': '0.006', 'AMMO5': '0.013', 'AMMO4': '0.030', 'AMMO3': '0.134', 'weapon5': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.622', 'weapon4': '0.792', 'WEAPON3': '0.800', 'weapon3': '2.176', 'HITCOUNT': '2.330', 'DAMAGECOUNT': '9.393', 'FRAGCOUNT': '29.000'} [2023-02-24 20:41:30,492][213368] DAMAGECOUNT value on done: 118370.0 [2023-02-24 20:41:30,492][213368] Sum rewards: 30.712, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.370', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO3': '0.098', 'AMMO4': '0.109', 'weapon5': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.436', 'WEAPON3': '0.700', 'weapon4': '0.886', 'HITCOUNT': '1.680', 'weapon3': '2.224', 'DAMAGECOUNT': '6.645', 'FRAGCOUNT': '26.000'} [2023-02-24 20:41:30,536][213382] DAMAGECOUNT value on done: 115115.0 [2023-02-24 20:41:30,537][213382] Sum rewards: 27.502, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.205', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon7': '0.072', 'AMMO3': '0.080', 'AMMO4': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.226', 'weapon4': '0.242', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'weapon2': '0.680', 'HITCOUNT': '1.310', 'weapon3': '2.448', 'DAMAGECOUNT': '7.074', 'FRAGCOUNT': '21.000'} [2023-02-24 20:41:30,546][213369] DAMAGECOUNT value on done: 119649.0 [2023-02-24 20:41:30,546][213369] Sum rewards: 26.238, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.085', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'weapon5': '0.074', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.166', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.650', 'weapon4': '0.924', 'weapon2': '1.010', 'weapon3': '1.520', 'HITCOUNT': '1.810', 'DAMAGECOUNT': '7.359', 'FRAGCOUNT': '20.000'} [2023-02-24 20:41:30,559][213383] DAMAGECOUNT value on done: 115621.0 [2023-02-24 20:41:30,559][213383] Sum rewards: 23.184, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.968', 'AMMO5': '0.019', 'AMMO2': '0.043', 'AMMO3': '0.132', 'AMMO4': '0.215', 'weapon5': '0.304', 'WEAPON4': '0.400', 'weapon2': '0.418', 'WEAPON5': '0.550', 'weapon4': '0.664', 'WEAPON3': '0.850', 'HITCOUNT': '1.540', 'weapon3': '2.314', 'DAMAGECOUNT': '7.203', 'FRAGCOUNT': '21.000'} [2023-02-24 20:41:30,792][213384] DAMAGECOUNT value on done: 109362.0 [2023-02-24 20:41:30,792][213384] Sum rewards: 24.377, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.490', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.043', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.334', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'weapon4': '0.414', 'weapon2': '0.966', 'HITCOUNT': '1.450', 'weapon3': '2.024', 'DAMAGECOUNT': '5.517', 'FRAGCOUNT': '17.000'} [2023-02-24 20:41:30,800][213368] DAMAGECOUNT value on done: 116477.0 [2023-02-24 20:41:30,801][213368] Sum rewards: 25.850, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.690', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.081', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.104', 'weapon5': '0.184', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'weapon2': '0.994', 'HITCOUNT': '1.800', 'weapon3': '2.570', 'DAMAGECOUNT': '7.587', 'FRAGCOUNT': '19.000'} [2023-02-24 20:41:30,863][213383] DAMAGECOUNT value on done: 108032.0 [2023-02-24 20:41:30,864][213383] Sum rewards: 16.501, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.182', 'AMMO2': '0.017', 'AMMO5': '0.021', 'AMMO4': '0.085', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'weapon4': '0.262', 'weapon5': '0.370', 'WEAPON5': '0.650', 'WEAPON3': '0.650', 'weapon2': '1.000', 'HITCOUNT': '1.180', 'weapon3': '1.700', 'DAMAGECOUNT': '4.989', 'FRAGCOUNT': '14.000'} [2023-02-24 20:41:30,901][213369] DAMAGECOUNT value on done: 120485.0 [2023-02-24 20:41:30,902][213369] Sum rewards: 31.496, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.259', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO3': '0.125', 'AMMO4': '0.158', 'WEAPON5': '0.250', 'weapon5': '0.314', 'weapon4': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '0.750', 'weapon2': '0.846', 'HITCOUNT': '1.930', 'weapon3': '2.224', 'DAMAGECOUNT': '8.862', 'FRAGCOUNT': '27.000'} [2023-02-24 20:41:30,966][213384] DAMAGECOUNT value on done: 118405.0 [2023-02-24 20:41:30,966][213384] Sum rewards: 29.120, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.748', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon4': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon2': '0.216', 'WEAPON5': '0.350', 'weapon5': '0.372', 'WEAPON3': '1.100', 'HITCOUNT': '1.960', 'weapon3': '2.892', 'DAMAGECOUNT': '8.670', 'FRAGCOUNT': '26.000'} [2023-02-24 20:41:31,210][213369] DAMAGECOUNT value on done: 107535.0 [2023-02-24 20:41:31,210][213369] Sum rewards: 28.982, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.045', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon7': '0.054', 'AMMO3': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.173', 'WEAPON4': '0.200', 'weapon5': '0.242', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'weapon2': '0.638', 'weapon4': '1.008', 'HITCOUNT': '1.590', 'weapon3': '1.760', 'DAMAGECOUNT': '7.164', 'FRAGCOUNT': '23.000'} [2023-02-24 20:41:31,266][213384] DAMAGECOUNT value on done: 120733.0 [2023-02-24 20:41:31,266][213384] Sum rewards: 38.414, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.410', 'ARMOR': '0.004', 'AMMO2': '0.014', 'AMMO5': '0.015', 'AMMO4': '0.068', 'AMMO3': '0.108', 'weapon4': '0.114', 'WEAPON4': '0.200', 'weapon5': '0.370', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'weapon2': '0.906', 'HITCOUNT': '1.800', 'weapon3': '2.304', 'DAMAGECOUNT': '9.171', 'FRAGCOUNT': '31.000'} [2023-02-24 20:41:31,664][213365] Updated weights for policy 0, policy_version 27766 (0.0009) [2023-02-24 20:41:34,636][213365] Updated weights for policy 0, policy_version 27776 (0.0010) [2023-02-24 20:41:35,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13721.6, 300 sec: 13537.6). Total num frames: 113778688. Throughput: 0: 3413.6. Samples: 3433262. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:41:35,243][213332] Avg episode reward: [(0, '26.178')] [2023-02-24 20:41:37,634][213365] Updated weights for policy 0, policy_version 27786 (0.0009) [2023-02-24 20:41:40,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13653.3, 300 sec: 13565.4). Total num frames: 113844224. Throughput: 0: 3412.8. Samples: 3453836. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:41:40,243][213332] Avg episode reward: [(0, '26.178')] [2023-02-24 20:41:40,624][213365] Updated weights for policy 0, policy_version 27796 (0.0009) [2023-02-24 20:41:43,598][213365] Updated weights for policy 0, policy_version 27806 (0.0009) [2023-02-24 20:41:45,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13653.3, 300 sec: 13579.3). Total num frames: 113913856. Throughput: 0: 3411.0. Samples: 3474396. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:41:45,243][213332] Avg episode reward: [(0, '26.178')] [2023-02-24 20:41:46,629][213365] Updated weights for policy 0, policy_version 27816 (0.0009) [2023-02-24 20:41:48,918][213367] DAMAGECOUNT value on done: 117594.0 [2023-02-24 20:41:48,919][213367] Sum rewards: 27.493, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.259', 'ARMOR': '0.004', 'AMMO2': '0.027', 'AMMO5': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.162', 'weapon4': '0.194', 'WEAPON4': '0.300', 'weapon5': '0.374', 'weapon2': '0.470', 'WEAPON5': '0.750', 'WEAPON3': '0.950', 'HITCOUNT': '1.780', 'weapon3': '2.638', 'DAMAGECOUNT': '8.190', 'FRAGCOUNT': '25.000'} [2023-02-24 20:41:49,210][213372] DAMAGECOUNT value on done: 117851.0 [2023-02-24 20:41:49,210][213372] Sum rewards: 22.170, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.662', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO3': '0.030', 'AMMO2': '0.046', 'AMMO4': '0.231', 'WEAPON3': '0.250', 'weapon5': '0.332', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.732', 'weapon4': '1.018', 'weapon3': '1.184', 'HITCOUNT': '1.450', 'DAMAGECOUNT': '5.739', 'FRAGCOUNT': '17.000'} [2023-02-24 20:41:49,243][213367] DAMAGECOUNT value on done: 120450.0 [2023-02-24 20:41:49,244][213367] Sum rewards: 27.499, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.578', 'AMMO2': '0.011', 'AMMO5': '0.023', 'AMMO4': '0.053', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.126', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.354', 'weapon2': '0.366', 'weapon5': '0.416', 'WEAPON5': '0.550', 'WEAPON3': '1.050', 'HITCOUNT': '1.850', 'weapon3': '2.328', 'DAMAGECOUNT': '8.379', 'FRAGCOUNT': '24.000'} [2023-02-24 20:41:49,512][213366] DAMAGECOUNT value on done: 115592.0 [2023-02-24 20:41:49,512][213366] Sum rewards: 25.997, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.762', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO3': '0.086', 'weapon5': '0.304', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '1.300', 'weapon2': '1.404', 'weapon3': '1.944', 'DAMAGECOUNT': '5.739', 'FRAGCOUNT': '21.000'} [2023-02-24 20:41:49,529][213372] DAMAGECOUNT value on done: 117692.0 [2023-02-24 20:41:49,529][213372] Sum rewards: 20.837, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.854', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.108', 'AMMO3': '0.133', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.474', 'WEAPON3': '0.800', 'weapon2': '1.212', 'HITCOUNT': '1.610', 'weapon3': '1.938', 'DAMAGECOUNT': '6.888', 'FRAGCOUNT': '17.000'} [2023-02-24 20:41:49,558][213367] DAMAGECOUNT value on done: 118046.0 [2023-02-24 20:41:49,558][213367] Sum rewards: 27.077, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.003', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'weapon5': '0.216', 'weapon4': '0.318', 'WEAPON5': '0.350', 'weapon2': '0.768', 'WEAPON3': '0.950', 'HITCOUNT': '2.110', 'weapon3': '2.412', 'DAMAGECOUNT': '7.992', 'FRAGCOUNT': '23.000'} [2023-02-24 20:41:49,818][213366] DAMAGECOUNT value on done: 124214.0 [2023-02-24 20:41:49,818][213366] Sum rewards: 36.059, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.729', 'AMMO5': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.121', 'WEAPON4': '0.250', 'weapon2': '0.256', 'weapon5': '0.280', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'weapon4': '0.854', 'HITCOUNT': '2.030', 'weapon3': '2.222', 'DAMAGECOUNT': '8.430', 'FRAGCOUNT': '30.000'} [2023-02-24 20:41:49,861][213367] DAMAGECOUNT value on done: 116474.0 [2023-02-24 20:41:49,862][213367] Sum rewards: 28.154, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.342', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.184', 'weapon5': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.510', 'weapon2': '0.708', 'WEAPON3': '1.050', 'HITCOUNT': '2.220', 'weapon3': '2.236', 'DAMAGECOUNT': '9.735', 'FRAGCOUNT': '24.500'} [2023-02-24 20:41:49,971][213382] DAMAGECOUNT value on done: 114763.0 [2023-02-24 20:41:49,972][213382] Sum rewards: 19.893, reward structure: {'DEATHCOUNT': '-6.750', 'WEAPON1': '0.010', 'HEALTH': '0.014', 'AMMO5': '0.025', 'AMMO2': '0.025', 'AMMO3': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'weapon7': '0.186', 'weapon4': '0.198', 'WEAPON7': '0.200', 'weapon5': '0.392', 'WEAPON3': '0.500', 'WEAPON5': '0.550', 'HITCOUNT': '1.110', 'weapon2': '1.298', 'weapon3': '1.676', 'DAMAGECOUNT': '5.862', 'FRAGCOUNT': '14.000'} [2023-02-24 20:41:49,982][213383] DAMAGECOUNT value on done: 118669.0 [2023-02-24 20:41:49,983][213383] Sum rewards: 28.842, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.810', 'AMMO2': '0.024', 'AMMO5': '0.028', 'AMMO4': '0.120', 'AMMO3': '0.248', 'weapon5': '0.386', 'WEAPON4': '0.400', 'weapon2': '0.494', 'weapon4': '0.708', 'WEAPON5': '0.800', 'WEAPON3': '1.550', 'weapon3': '2.074', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '9.540', 'FRAGCOUNT': '30.000'} [2023-02-24 20:41:50,011][213372] DAMAGECOUNT value on done: 119388.0 [2023-02-24 20:41:50,012][213372] Sum rewards: 25.522, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.648', 'AMMO5': '0.021', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.145', 'WEAPON4': '0.200', 'weapon4': '0.290', 'WEAPON5': '0.500', 'weapon5': '0.516', 'WEAPON3': '0.900', 'weapon2': '0.910', 'HITCOUNT': '1.930', 'weapon3': '1.994', 'DAMAGECOUNT': '8.601', 'FRAGCOUNT': '23.000'} [2023-02-24 20:41:50,136][213366] DAMAGECOUNT value on done: 122781.0 [2023-02-24 20:41:50,137][213366] Sum rewards: 20.716, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.146', 'weapon7': '0.006', 'AMMO5': '0.017', 'AMMO2': '0.021', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.122', 'WEAPON4': '0.250', 'weapon5': '0.326', 'weapon4': '0.376', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon2': '0.954', 'HITCOUNT': '1.710', 'weapon3': '1.904', 'DAMAGECOUNT': '6.969', 'FRAGCOUNT': '18.000'} [2023-02-24 20:41:50,243][213332] Fps is (10 sec: 12697.7, 60 sec: 13516.8, 300 sec: 13565.4). Total num frames: 113971200. Throughput: 0: 3400.1. Samples: 3484166. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:41:50,243][213332] Avg episode reward: [(0, '26.375')] [2023-02-24 20:41:50,256][213365] Updated weights for policy 0, policy_version 27826 (0.0009) [2023-02-24 20:41:50,282][213368] DAMAGECOUNT value on done: 115096.0 [2023-02-24 20:41:50,283][213368] Sum rewards: 22.381, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.900', 'AMMO2': '0.014', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.068', 'AMMO4': '0.071', 'WEAPON4': '0.250', 'weapon5': '0.336', 'WEAPON3': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.654', 'weapon2': '0.838', 'HITCOUNT': '1.430', 'weapon3': '1.562', 'DAMAGECOUNT': '7.371', 'FRAGCOUNT': '16.500'} [2023-02-24 20:41:50,288][213382] DAMAGECOUNT value on done: 120368.0 [2023-02-24 20:41:50,289][213382] Sum rewards: 34.204, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.118', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.153', 'weapon5': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.366', 'weapon2': '0.516', 'WEAPON3': '1.000', 'HITCOUNT': '2.120', 'weapon3': '2.628', 'DAMAGECOUNT': '9.564', 'FRAGCOUNT': '31.000'} [2023-02-24 20:41:50,297][213383] DAMAGECOUNT value on done: 124208.0 [2023-02-24 20:41:50,297][213383] Sum rewards: 29.337, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.074', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.015', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'weapon4': '0.224', 'weapon5': '0.254', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'weapon2': '1.138', 'HITCOUNT': '1.760', 'weapon3': '2.152', 'DAMAGECOUNT': '8.301', 'FRAGCOUNT': '22.000'} [2023-02-24 20:41:50,332][213372] DAMAGECOUNT value on done: 117980.0 [2023-02-24 20:41:50,332][213372] Sum rewards: 31.523, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.389', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.098', 'AMMO4': '0.133', 'weapon2': '0.148', 'AMMO3': '0.171', 'WEAPON4': '0.300', 'weapon5': '0.338', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.000', 'weapon3': '3.138', 'DAMAGECOUNT': '9.993', 'FRAGCOUNT': '28.000'} [2023-02-24 20:41:50,461][213366] DAMAGECOUNT value on done: 119444.0 [2023-02-24 20:41:50,462][213366] Sum rewards: 38.932, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.512', 'ARMOR': '0.004', 'AMMO2': '0.021', 'AMMO5': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.162', 'WEAPON4': '0.250', 'weapon4': '0.294', 'weapon5': '0.394', 'WEAPON5': '0.450', 'weapon2': '0.588', 'WEAPON3': '1.050', 'weapon3': '2.382', 'HITCOUNT': '2.400', 'DAMAGECOUNT': '10.323', 'FRAGCOUNT': '34.000'} [2023-02-24 20:41:50,527][213369] DAMAGECOUNT value on done: 121181.0 [2023-02-24 20:41:50,528][213369] Sum rewards: 29.787, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.945', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'AMMO3': '0.129', 'weapon4': '0.270', 'WEAPON5': '0.300', 'weapon5': '0.360', 'weapon2': '0.488', 'WEAPON3': '0.850', 'HITCOUNT': '1.600', 'weapon3': '2.662', 'DAMAGECOUNT': '7.392', 'FRAGCOUNT': '25.000'} [2023-02-24 20:41:50,604][213382] DAMAGECOUNT value on done: 113952.0 [2023-02-24 20:41:50,605][213382] Sum rewards: 28.988, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.254', 'AMMO2': '0.017', 'AMMO5': '0.017', 'AMMO4': '0.086', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'weapon4': '0.240', 'weapon5': '0.390', 'WEAPON5': '0.400', 'weapon2': '0.580', 'WEAPON3': '0.800', 'HITCOUNT': '1.570', 'weapon3': '2.468', 'DAMAGECOUNT': '7.881', 'FRAGCOUNT': '25.000'} [2023-02-24 20:41:50,608][213368] DAMAGECOUNT value on done: 119091.0 [2023-02-24 20:41:50,608][213368] Sum rewards: 33.406, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.550', 'AMMO5': '0.008', 'AMMO2': '0.030', 'AMMO3': '0.105', 'AMMO4': '0.148', 'weapon4': '0.162', 'weapon5': '0.250', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '0.700', 'weapon2': '1.250', 'weapon3': '2.096', 'HITCOUNT': '2.130', 'DAMAGECOUNT': '8.727', 'FRAGCOUNT': '27.000'} [2023-02-24 20:41:50,813][213384] DAMAGECOUNT value on done: 120367.0 [2023-02-24 20:41:50,813][213384] Sum rewards: 22.816, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.545', 'AMMO2': '0.009', 'AMMO5': '0.015', 'AMMO4': '0.045', 'weapon4': '0.050', 'AMMO3': '0.115', 'WEAPON4': '0.150', 'weapon5': '0.468', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon2': '1.194', 'HITCOUNT': '1.270', 'weapon3': '1.880', 'DAMAGECOUNT': '6.414', 'FRAGCOUNT': '19.000'} [2023-02-24 20:41:50,841][213369] DAMAGECOUNT value on done: 121867.0 [2023-02-24 20:41:50,841][213369] Sum rewards: 28.049, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.260', 'AMMO5': '0.015', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'AMMO4': '0.094', 'AMMO3': '0.103', 'weapon4': '0.292', 'weapon5': '0.318', 'WEAPON5': '0.350', 'weapon2': '0.452', 'WEAPON3': '0.700', 'HITCOUNT': '1.480', 'weapon3': '2.782', 'DAMAGECOUNT': '6.654', 'FRAGCOUNT': '22.000'} [2023-02-24 20:41:50,913][213368] DAMAGECOUNT value on done: 120981.0 [2023-02-24 20:41:50,914][213368] Sum rewards: 25.848, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.969', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.159', 'weapon2': '0.272', 'WEAPON4': '0.350', 'weapon5': '0.438', 'WEAPON5': '0.500', 'weapon4': '0.652', 'WEAPON3': '0.900', 'HITCOUNT': '1.750', 'weapon3': '2.266', 'DAMAGECOUNT': '7.833', 'FRAGCOUNT': '22.000'} [2023-02-24 20:41:50,931][213382] DAMAGECOUNT value on done: 118461.0 [2023-02-24 20:41:50,931][213382] Sum rewards: 35.669, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.296', 'ARMOR': '0.004', 'AMMO2': '0.013', 'AMMO5': '0.015', 'AMMO4': '0.064', 'WEAPON4': '0.150', 'AMMO3': '0.205', 'weapon2': '0.252', 'weapon4': '0.304', 'weapon5': '0.334', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.070', 'weapon3': '2.866', 'DAMAGECOUNT': '10.038', 'FRAGCOUNT': '32.000'} [2023-02-24 20:41:50,932][213383] DAMAGECOUNT value on done: 118709.0 [2023-02-24 20:41:50,933][213383] Sum rewards: 29.791, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.521', 'ARMOR': '0.004', 'AMMO5': '0.027', 'AMMO2': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.138', 'weapon7': '0.160', 'AMMO4': '0.239', 'weapon5': '0.280', 'WEAPON4': '0.500', 'weapon2': '0.528', 'weapon4': '0.558', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'HITCOUNT': '2.030', 'weapon3': '2.086', 'DAMAGECOUNT': '9.264', 'FRAGCOUNT': '27.000'} [2023-02-24 20:41:51,128][213384] DAMAGECOUNT value on done: 111255.0 [2023-02-24 20:41:51,128][213384] Sum rewards: 20.196, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.614', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO5': '0.014', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'weapon7': '0.076', 'AMMO3': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.158', 'weapon5': '0.378', 'WEAPON5': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '1.030', 'weapon2': '1.238', 'weapon3': '1.756', 'DAMAGECOUNT': '5.679', 'FRAGCOUNT': '15.000'} [2023-02-24 20:41:51,227][213369] DAMAGECOUNT value on done: 123069.0 [2023-02-24 20:41:51,228][213369] Sum rewards: 29.407, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.339', 'AMMO5': '0.014', 'WEAPON1': '0.030', 'AMMO2': '0.047', 'AMMO3': '0.072', 'AMMO4': '0.233', 'WEAPON4': '0.250', 'weapon5': '0.266', 'WEAPON5': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.452', 'weapon2': '0.746', 'HITCOUNT': '1.530', 'weapon3': '2.254', 'DAMAGECOUNT': '7.752', 'FRAGCOUNT': '22.000'} [2023-02-24 20:41:51,234][213368] DAMAGECOUNT value on done: 117790.0 [2023-02-24 20:41:51,235][213368] Sum rewards: 12.121, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.698', 'AMMO5': '0.013', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.106', 'WEAPON4': '0.150', 'weapon7': '0.230', 'weapon5': '0.234', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'weapon4': '0.686', 'HITCOUNT': '0.910', 'weapon3': '0.946', 'weapon2': '1.690', 'DAMAGECOUNT': '3.939', 'FRAGCOUNT': '11.000'} [2023-02-24 20:41:51,257][213383] DAMAGECOUNT value on done: 110892.0 [2023-02-24 20:41:51,258][213383] Sum rewards: 21.313, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.705', 'ARMOR': '0.004', 'AMMO5': '0.043', 'AMMO2': '0.054', 'AMMO3': '0.120', 'AMMO4': '0.270', 'weapon2': '0.308', 'weapon5': '0.478', 'WEAPON4': '0.500', 'weapon4': '0.576', 'WEAPON3': '0.800', 'WEAPON5': '1.100', 'HITCOUNT': '1.930', 'weapon3': '2.254', 'DAMAGECOUNT': '8.580', 'FRAGCOUNT': '19.000'} [2023-02-24 20:41:51,329][213384] DAMAGECOUNT value on done: 121269.0 [2023-02-24 20:41:51,330][213384] Sum rewards: 24.574, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.185', 'AMMO5': '0.018', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.174', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'weapon4': '0.356', 'WEAPON5': '0.450', 'weapon2': '0.832', 'WEAPON3': '1.400', 'HITCOUNT': '1.780', 'weapon3': '2.326', 'DAMAGECOUNT': '8.592', 'FRAGCOUNT': '24.500'} [2023-02-24 20:41:51,531][213369] DAMAGECOUNT value on done: 108696.0 [2023-02-24 20:41:51,531][213369] Sum rewards: 16.520, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.078', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.097', 'WEAPON5': '0.200', 'weapon5': '0.232', 'WEAPON3': '0.550', 'HITCOUNT': '0.940', 'weapon2': '1.188', 'weapon3': '2.090', 'DAMAGECOUNT': '3.483', 'FRAGCOUNT': '13.000'} [2023-02-24 20:41:51,636][213384] DAMAGECOUNT value on done: 122941.0 [2023-02-24 20:41:51,636][213384] Sum rewards: 23.633, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.930', 'AMMO5': '0.018', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.139', 'weapon4': '0.276', 'WEAPON4': '0.300', 'weapon5': '0.378', 'WEAPON5': '0.550', 'weapon2': '0.558', 'WEAPON3': '0.950', 'HITCOUNT': '1.330', 'weapon3': '2.528', 'DAMAGECOUNT': '6.624', 'FRAGCOUNT': '21.000'} [2023-02-24 20:41:53,362][213365] Updated weights for policy 0, policy_version 27836 (0.0009) [2023-02-24 20:41:55,243][213332] Fps is (10 sec: 12697.6, 60 sec: 13516.8, 300 sec: 13593.2). Total num frames: 114040832. Throughput: 0: 3352.8. Samples: 3502504. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:41:55,244][213332] Avg episode reward: [(0, '26.563')] [2023-02-24 20:41:56,440][213365] Updated weights for policy 0, policy_version 27846 (0.0009) [2023-02-24 20:41:57,143][213366] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-24 20:41:57,699][213368] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-24 20:41:59,492][213365] Updated weights for policy 0, policy_version 27856 (0.0009) [2023-02-24 20:42:00,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13579.3). Total num frames: 114106368. Throughput: 0: 3343.2. Samples: 3522516. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:42:00,243][213332] Avg episode reward: [(0, '26.563')] [2023-02-24 20:42:02,819][213365] Updated weights for policy 0, policy_version 27866 (0.0010) [2023-02-24 20:42:05,243][213332] Fps is (10 sec: 12288.0, 60 sec: 13243.7, 300 sec: 13551.5). Total num frames: 114163712. Throughput: 0: 3321.6. Samples: 3531814. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:42:05,243][213332] Avg episode reward: [(0, '26.563')] [2023-02-24 20:42:06,271][213365] Updated weights for policy 0, policy_version 27876 (0.0009) [2023-02-24 20:42:09,651][213365] Updated weights for policy 0, policy_version 27886 (0.0010) [2023-02-24 20:42:10,083][213367] DAMAGECOUNT value on done: 120305.0 [2023-02-24 20:42:10,084][213367] Sum rewards: 31.517, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.090', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO3': '0.073', 'AMMO4': '0.167', 'WEAPON3': '0.400', 'weapon2': '0.450', 'weapon4': '0.470', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon5': '0.620', 'HITCOUNT': '1.510', 'weapon3': '2.186', 'DAMAGECOUNT': '8.133', 'FRAGCOUNT': '26.000'} [2023-02-24 20:42:10,243][213332] Fps is (10 sec: 11878.3, 60 sec: 13175.5, 300 sec: 13523.7). Total num frames: 114225152. Throughput: 0: 3263.3. Samples: 3549736. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:42:10,243][213332] Avg episode reward: [(0, '26.736')] [2023-02-24 20:42:10,244][213352] Saving new best policy, reward=26.736! [2023-02-24 20:42:10,439][213367] DAMAGECOUNT value on done: 122280.0 [2023-02-24 20:42:10,439][213367] Sum rewards: 19.985, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.655', 'AMMO5': '0.015', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.070', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'weapon4': '0.274', 'WEAPON3': '0.450', 'WEAPON5': '0.450', 'weapon5': '0.530', 'HITCOUNT': '1.020', 'weapon2': '1.020', 'weapon3': '1.804', 'DAMAGECOUNT': '5.490', 'FRAGCOUNT': '14.500'} [2023-02-24 20:42:10,512][213372] DAMAGECOUNT value on done: 121131.0 [2023-02-24 20:42:10,512][213372] Sum rewards: 32.378, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.061', 'AMMO2': '0.017', 'AMMO5': '0.017', 'AMMO4': '0.085', 'weapon5': '0.176', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.478', 'weapon2': '0.506', 'WEAPON3': '1.250', 'HITCOUNT': '2.410', 'weapon3': '2.606', 'DAMAGECOUNT': '9.840', 'FRAGCOUNT': '29.000'} [2023-02-24 20:42:10,717][213366] DAMAGECOUNT value on done: 118023.0 [2023-02-24 20:42:10,718][213366] Sum rewards: 25.024, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.209', 'AMMO5': '0.005', 'AMMO2': '0.024', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.106', 'weapon7': '0.110', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon5': '0.236', 'weapon4': '0.566', 'weapon2': '0.602', 'WEAPON3': '0.650', 'HITCOUNT': '1.610', 'weapon3': '2.300', 'DAMAGECOUNT': '7.257', 'FRAGCOUNT': '20.000'} [2023-02-24 20:42:10,763][213367] DAMAGECOUNT value on done: 121384.0 [2023-02-24 20:42:10,763][213367] Sum rewards: 34.504, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.575', 'AMMO2': '0.013', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.064', 'WEAPON4': '0.150', 'weapon5': '0.158', 'AMMO3': '0.181', 'weapon4': '0.192', 'WEAPON5': '0.350', 'weapon2': '0.652', 'WEAPON3': '1.200', 'HITCOUNT': '2.410', 'weapon3': '2.662', 'DAMAGECOUNT': '10.014', 'FRAGCOUNT': '31.000'} [2023-02-24 20:42:10,836][213372] DAMAGECOUNT value on done: 121024.0 [2023-02-24 20:42:10,837][213372] Sum rewards: 35.519, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.976', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon4': '0.036', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'weapon2': '0.348', 'WEAPON5': '0.350', 'weapon5': '0.554', 'WEAPON3': '1.300', 'HITCOUNT': '2.060', 'weapon3': '2.778', 'DAMAGECOUNT': '9.996', 'FRAGCOUNT': '33.000'} [2023-02-24 20:42:11,041][213366] DAMAGECOUNT value on done: 127103.0 [2023-02-24 20:42:11,041][213366] Sum rewards: 33.455, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.345', 'AMMO5': '0.016', 'AMMO2': '0.052', 'AMMO3': '0.078', 'AMMO4': '0.258', 'weapon5': '0.352', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon4': '0.532', 'weapon2': '1.070', 'weapon3': '1.574', 'HITCOUNT': '1.800', 'DAMAGECOUNT': '8.667', 'FRAGCOUNT': '28.000'} [2023-02-24 20:42:11,073][213367] DAMAGECOUNT value on done: 118461.0 [2023-02-24 20:42:11,073][213367] Sum rewards: 21.045, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.162', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.020', 'WEAPON4': '0.100', 'weapon2': '0.136', 'AMMO3': '0.170', 'weapon4': '0.226', 'weapon5': '0.496', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'HITCOUNT': '1.500', 'weapon3': '2.868', 'DAMAGECOUNT': '5.961', 'FRAGCOUNT': '19.000'} [2023-02-24 20:42:11,185][213382] DAMAGECOUNT value on done: 116813.0 [2023-02-24 20:42:11,185][213382] Sum rewards: 26.058, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.468', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.027', 'weapon7': '0.086', 'AMMO3': '0.087', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.135', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.344', 'weapon5': '0.384', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon4': '0.618', 'HITCOUNT': '1.250', 'weapon3': '2.228', 'DAMAGECOUNT': '6.150', 'FRAGCOUNT': '21.000'} [2023-02-24 20:42:11,251][213383] DAMAGECOUNT value on done: 121810.0 [2023-02-24 20:42:11,252][213383] Sum rewards: 31.249, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.745', 'AMMO2': '0.005', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.142', 'weapon4': '0.158', 'weapon5': '0.402', 'WEAPON5': '0.450', 'weapon2': '0.640', 'WEAPON3': '0.900', 'HITCOUNT': '2.230', 'weapon3': '2.530', 'DAMAGECOUNT': '9.423', 'FRAGCOUNT': '24.000'} [2023-02-24 20:42:11,379][213372] DAMAGECOUNT value on done: 121612.0 [2023-02-24 20:42:11,380][213372] Sum rewards: 25.591, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.924', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO3': '0.106', 'AMMO4': '0.157', 'weapon5': '0.172', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.404', 'WEAPON3': '0.650', 'weapon2': '0.774', 'HITCOUNT': '1.720', 'weapon3': '2.266', 'DAMAGECOUNT': '6.672', 'FRAGCOUNT': '22.000'} [2023-02-24 20:42:11,428][213366] DAMAGECOUNT value on done: 125090.0 [2023-02-24 20:42:11,429][213366] Sum rewards: 22.526, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.182', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.014', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.130', 'AMMO3': '0.173', 'weapon5': '0.302', 'WEAPON5': '0.450', 'weapon2': '0.820', 'WEAPON3': '1.100', 'HITCOUNT': '1.810', 'weapon3': '2.406', 'DAMAGECOUNT': '6.927', 'FRAGCOUNT': '21.000'} [2023-02-24 20:42:11,564][213368] DAMAGECOUNT value on done: 117811.0 [2023-02-24 20:42:11,564][213368] Sum rewards: 27.903, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.924', 'AMMO2': '0.009', 'AMMO5': '0.013', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'weapon4': '0.100', 'AMMO3': '0.171', 'WEAPON5': '0.300', 'weapon5': '0.388', 'weapon2': '0.908', 'WEAPON3': '1.100', 'HITCOUNT': '1.720', 'weapon3': '2.380', 'DAMAGECOUNT': '8.145', 'FRAGCOUNT': '25.000'} [2023-02-24 20:42:11,568][213382] DAMAGECOUNT value on done: 123872.0 [2023-02-24 20:42:11,569][213382] Sum rewards: 29.881, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.770', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO2': '0.057', 'AMMO3': '0.199', 'weapon2': '0.276', 'AMMO4': '0.286', 'weapon4': '0.286', 'weapon5': '0.372', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'HITCOUNT': '2.350', 'weapon3': '2.710', 'DAMAGECOUNT': '10.512', 'FRAGCOUNT': '29.000'} [2023-02-24 20:42:11,640][213383] DAMAGECOUNT value on done: 126600.0 [2023-02-24 20:42:11,640][213383] Sum rewards: 24.328, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.468', 'AMMO5': '0.015', 'AMMO2': '0.059', 'AMMO3': '0.159', 'weapon2': '0.212', 'AMMO4': '0.293', 'weapon5': '0.346', 'WEAPON5': '0.400', 'weapon4': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '0.900', 'HITCOUNT': '1.870', 'weapon3': '2.666', 'DAMAGECOUNT': '7.176', 'FRAGCOUNT': '25.000'} [2023-02-24 20:42:11,740][213372] DAMAGECOUNT value on done: 120582.0 [2023-02-24 20:42:11,740][213372] Sum rewards: 26.387, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.502', 'AMMO2': '0.013', 'AMMO5': '0.026', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.166', 'weapon4': '0.262', 'weapon5': '0.320', 'WEAPON5': '0.550', 'weapon2': '0.656', 'WEAPON3': '1.050', 'HITCOUNT': '1.960', 'weapon3': '2.416', 'DAMAGECOUNT': '7.806', 'FRAGCOUNT': '23.000'} [2023-02-24 20:42:11,769][213366] DAMAGECOUNT value on done: 121075.0 [2023-02-24 20:42:11,769][213366] Sum rewards: 24.118, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.096', 'ARMOR': '0.004', 'AMMO2': '0.011', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.055', 'AMMO3': '0.059', 'WEAPON4': '0.100', 'weapon4': '0.186', 'weapon5': '0.344', 'WEAPON3': '0.350', 'WEAPON5': '0.400', 'HITCOUNT': '1.170', 'weapon3': '1.248', 'weapon2': '1.858', 'DAMAGECOUNT': '4.893', 'FRAGCOUNT': '18.000'} [2023-02-24 20:42:11,805][213369] DAMAGECOUNT value on done: 124038.0 [2023-02-24 20:42:11,806][213369] Sum rewards: 27.959, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.540', 'AMMO5': '0.015', 'AMMO2': '0.016', 'weapon4': '0.018', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.080', 'AMMO3': '0.200', 'weapon5': '0.310', 'weapon2': '0.384', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '1.710', 'weapon3': '2.966', 'DAMAGECOUNT': '8.571', 'FRAGCOUNT': '25.000'} [2023-02-24 20:42:11,888][213368] DAMAGECOUNT value on done: 121347.0 [2023-02-24 20:42:11,888][213368] Sum rewards: 24.202, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.696', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO4': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.120', 'AMMO3': '0.132', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.278', 'weapon5': '0.370', 'weapon2': '0.462', 'WEAPON3': '0.850', 'HITCOUNT': '1.630', 'weapon3': '2.486', 'DAMAGECOUNT': '6.717', 'FRAGCOUNT': '20.000'} [2023-02-24 20:42:11,895][213382] DAMAGECOUNT value on done: 116725.0 [2023-02-24 20:42:11,896][213382] Sum rewards: 30.489, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.392', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'AMMO5': '0.026', 'AMMO4': '0.124', 'AMMO3': '0.138', 'weapon4': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.270', 'weapon5': '0.302', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'HITCOUNT': '1.860', 'weapon3': '2.944', 'DAMAGECOUNT': '8.319', 'FRAGCOUNT': '25.000'} [2023-02-24 20:42:12,132][213369] DAMAGECOUNT value on done: 123677.0 [2023-02-24 20:42:12,132][213369] Sum rewards: 19.319, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.966', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'weapon4': '0.058', 'AMMO3': '0.166', 'WEAPON5': '0.250', 'weapon5': '0.292', 'weapon2': '0.296', 'WEAPON3': '1.000', 'HITCOUNT': '1.360', 'weapon3': '3.060', 'DAMAGECOUNT': '5.430', 'FRAGCOUNT': '18.000'} [2023-02-24 20:42:12,135][213384] DAMAGECOUNT value on done: 122669.0 [2023-02-24 20:42:12,135][213384] Sum rewards: 22.602, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.738', 'ARMOR': '0.004', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO4': '0.087', 'AMMO3': '0.134', 'weapon4': '0.184', 'WEAPON4': '0.200', 'weapon5': '0.386', 'WEAPON5': '0.650', 'weapon2': '0.704', 'WEAPON3': '0.900', 'HITCOUNT': '1.470', 'weapon3': '2.402', 'DAMAGECOUNT': '6.906', 'FRAGCOUNT': '20.000'} [2023-02-24 20:42:12,213][213368] DAMAGECOUNT value on done: 123662.0 [2023-02-24 20:42:12,214][213368] Sum rewards: 29.324, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.285', 'AMMO2': '0.008', 'AMMO5': '0.025', 'AMMO4': '0.038', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.152', 'weapon5': '0.474', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon2': '1.314', 'HITCOUNT': '1.630', 'weapon3': '1.740', 'DAMAGECOUNT': '7.932', 'FRAGCOUNT': '24.000'} [2023-02-24 20:42:12,229][213382] DAMAGECOUNT value on done: 121108.0 [2023-02-24 20:42:12,230][213382] Sum rewards: 28.452, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.780', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'AMMO3': '0.163', 'weapon2': '0.298', 'weapon5': '0.464', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'HITCOUNT': '1.410', 'weapon3': '3.022', 'DAMAGECOUNT': '7.941', 'FRAGCOUNT': '25.000'} [2023-02-24 20:42:12,277][213383] DAMAGECOUNT value on done: 120930.0 [2023-02-24 20:42:12,278][213383] Sum rewards: 20.760, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.328', 'AMMO2': '0.020', 'AMMO5': '0.022', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.114', 'AMMO3': '0.153', 'weapon2': '0.256', 'weapon5': '0.522', 'WEAPON5': '0.650', 'WEAPON3': '0.950', 'HITCOUNT': '1.460', 'weapon3': '2.830', 'DAMAGECOUNT': '6.663', 'FRAGCOUNT': '18.000'} [2023-02-24 20:42:12,476][213384] DAMAGECOUNT value on done: 112907.0 [2023-02-24 20:42:12,477][213384] Sum rewards: 17.146, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.910', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'weapon7': '0.064', 'AMMO3': '0.089', 'AMMO4': '0.089', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.350', 'weapon4': '0.380', 'weapon5': '0.490', 'WEAPON3': '0.500', 'HITCOUNT': '0.820', 'weapon2': '0.842', 'weapon3': '1.718', 'DAMAGECOUNT': '4.956', 'FRAGCOUNT': '14.000'} [2023-02-24 20:42:12,530][213369] DAMAGECOUNT value on done: 126074.0 [2023-02-24 20:42:12,531][213369] Sum rewards: 34.391, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.370', 'AMMO5': '0.019', 'AMMO2': '0.023', 'AMMO3': '0.111', 'AMMO4': '0.117', 'weapon5': '0.376', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon4': '0.554', 'weapon2': '0.672', 'WEAPON3': '0.750', 'HITCOUNT': '2.170', 'weapon3': '2.204', 'DAMAGECOUNT': '9.015', 'FRAGCOUNT': '31.000'} [2023-02-24 20:42:12,547][213368] DAMAGECOUNT value on done: 119911.0 [2023-02-24 20:42:12,547][213368] Sum rewards: 21.803, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.791', 'AMMO5': '0.022', 'AMMO2': '0.051', 'AMMO3': '0.053', 'AMMO4': '0.256', 'WEAPON3': '0.400', 'WEAPON4': '0.500', 'weapon5': '0.566', 'WEAPON5': '0.650', 'weapon4': '0.702', 'weapon2': '1.106', 'weapon3': '1.334', 'HITCOUNT': '1.340', 'DAMAGECOUNT': '6.363', 'FRAGCOUNT': '19.000'} [2023-02-24 20:42:12,607][213383] DAMAGECOUNT value on done: 113584.0 [2023-02-24 20:42:12,607][213383] Sum rewards: 32.353, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.820', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO3': '0.110', 'AMMO4': '0.147', 'weapon5': '0.294', 'weapon2': '0.314', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.612', 'WEAPON3': '0.700', 'HITCOUNT': '2.120', 'weapon3': '2.558', 'DAMAGECOUNT': '8.076', 'FRAGCOUNT': '28.000'} [2023-02-24 20:42:12,668][213384] DAMAGECOUNT value on done: 123824.0 [2023-02-24 20:42:12,668][213384] Sum rewards: 29.203, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.006', 'AMMO5': '0.017', 'AMMO2': '0.028', 'WEAPON1': '0.030', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.142', 'weapon4': '0.198', 'WEAPON4': '0.250', 'weapon7': '0.272', 'weapon5': '0.318', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'weapon2': '0.952', 'HITCOUNT': '1.600', 'weapon3': '1.978', 'DAMAGECOUNT': '7.665', 'FRAGCOUNT': '25.000'} [2023-02-24 20:42:12,875][213369] DAMAGECOUNT value on done: 110522.0 [2023-02-24 20:42:12,875][213369] Sum rewards: 17.307, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.986', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.070', 'AMMO4': '0.171', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon5': '0.420', 'WEAPON3': '0.450', 'weapon4': '0.788', 'weapon2': '1.236', 'weapon3': '1.356', 'HITCOUNT': '1.430', 'DAMAGECOUNT': '5.478', 'FRAGCOUNT': '13.000'} [2023-02-24 20:42:13,026][213384] DAMAGECOUNT value on done: 125233.0 [2023-02-24 20:42:13,027][213384] Sum rewards: 28.696, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.730', 'AMMO2': '0.012', 'AMMO5': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.117', 'WEAPON5': '0.350', 'weapon2': '0.412', 'weapon5': '0.446', 'weapon4': '0.540', 'WEAPON3': '0.700', 'HITCOUNT': '1.480', 'weapon3': '2.370', 'DAMAGECOUNT': '6.876', 'FRAGCOUNT': '22.000'} [2023-02-24 20:42:13,099][213365] Updated weights for policy 0, policy_version 27896 (0.0011) [2023-02-24 20:42:15,243][213332] Fps is (10 sec: 12288.0, 60 sec: 13038.9, 300 sec: 13496.0). Total num frames: 114286592. Throughput: 0: 3216.2. Samples: 3567940. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:42:15,243][213332] Avg episode reward: [(0, '26.537')] [2023-02-24 20:42:16,393][213365] Updated weights for policy 0, policy_version 27906 (0.0009) [2023-02-24 20:42:19,496][213365] Updated weights for policy 0, policy_version 27916 (0.0009) [2023-02-24 20:42:20,243][213332] Fps is (10 sec: 12697.7, 60 sec: 12970.7, 300 sec: 13482.1). Total num frames: 114352128. Throughput: 0: 3202.1. Samples: 3577354. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:42:20,243][213332] Avg episode reward: [(0, '26.537')] [2023-02-24 20:42:22,536][213365] Updated weights for policy 0, policy_version 27926 (0.0009) [2023-02-24 20:42:25,243][213332] Fps is (10 sec: 13516.9, 60 sec: 12970.7, 300 sec: 13496.0). Total num frames: 114421760. Throughput: 0: 3194.8. Samples: 3597600. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:42:25,243][213332] Avg episode reward: [(0, '26.537')] [2023-02-24 20:42:25,536][213365] Updated weights for policy 0, policy_version 27936 (0.0009) [2023-02-24 20:42:28,551][213365] Updated weights for policy 0, policy_version 27946 (0.0008) [2023-02-24 20:42:30,243][213332] Fps is (10 sec: 13516.8, 60 sec: 12970.7, 300 sec: 13482.1). Total num frames: 114487296. Throughput: 0: 3190.9. Samples: 3617988. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:42:30,243][213332] Avg episode reward: [(0, '26.537')] [2023-02-24 20:42:30,578][213367] DAMAGECOUNT value on done: 123104.0 [2023-02-24 20:42:30,578][213367] Sum rewards: 31.370, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.052', 'AMMO2': '0.016', 'AMMO5': '0.019', 'weapon4': '0.022', 'WEAPON1': '0.030', 'AMMO4': '0.079', 'AMMO3': '0.118', 'WEAPON4': '0.200', 'weapon5': '0.290', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon2': '0.868', 'HITCOUNT': '1.640', 'weapon3': '2.528', 'DAMAGECOUNT': '8.361', 'FRAGCOUNT': '26.000'} [2023-02-24 20:42:30,898][213367] DAMAGECOUNT value on done: 124566.0 [2023-02-24 20:42:30,898][213367] Sum rewards: 23.410, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.133', 'AMMO2': '0.013', 'AMMO5': '0.015', 'weapon7': '0.052', 'AMMO4': '0.067', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.316', 'WEAPON5': '0.350', 'weapon4': '0.442', 'WEAPON3': '0.600', 'weapon2': '0.700', 'HITCOUNT': '1.270', 'weapon3': '2.220', 'DAMAGECOUNT': '6.858', 'FRAGCOUNT': '17.500'} [2023-02-24 20:42:30,996][213372] DAMAGECOUNT value on done: 123528.0 [2023-02-24 20:42:30,996][213372] Sum rewards: 23.239, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.194', 'AMMO5': '0.012', 'AMMO2': '0.040', 'AMMO3': '0.119', 'AMMO4': '0.198', 'weapon5': '0.256', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.556', 'WEAPON3': '0.800', 'weapon2': '0.978', 'HITCOUNT': '1.940', 'weapon3': '1.992', 'DAMAGECOUNT': '7.191', 'FRAGCOUNT': '21.000'} [2023-02-24 20:42:31,190][213366] DAMAGECOUNT value on done: 119819.0 [2023-02-24 20:42:31,191][213366] Sum rewards: 22.736, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.065', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.031', 'WEAPON1': '0.040', 'AMMO3': '0.089', 'weapon4': '0.168', 'WEAPON4': '0.200', 'weapon5': '0.342', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.060', 'HITCOUNT': '1.310', 'weapon3': '2.106', 'DAMAGECOUNT': '5.388', 'FRAGCOUNT': '19.000'} [2023-02-24 20:42:31,220][213367] DAMAGECOUNT value on done: 123744.0 [2023-02-24 20:42:31,220][213367] Sum rewards: 24.223, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.955', 'AMMO2': '0.002', 'ARMOR': '0.004', 'AMMO4': '0.009', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'weapon4': '0.214', 'WEAPON5': '0.400', 'weapon5': '0.418', 'weapon2': '0.698', 'WEAPON3': '0.700', 'HITCOUNT': '1.580', 'weapon3': '2.330', 'DAMAGECOUNT': '7.080', 'FRAGCOUNT': '19.000'} [2023-02-24 20:42:31,293][213372] DAMAGECOUNT value on done: 124247.0 [2023-02-24 20:42:31,294][213372] Sum rewards: 34.437, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.600', 'AMMO5': '0.018', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'weapon2': '0.240', 'weapon4': '0.388', 'weapon5': '0.404', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.260', 'weapon3': '2.722', 'DAMAGECOUNT': '9.669', 'FRAGCOUNT': '31.000'} [2023-02-24 20:42:31,495][213366] DAMAGECOUNT value on done: 130292.0 [2023-02-24 20:42:31,495][213366] Sum rewards: 25.329, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.480', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.083', 'weapon4': '0.138', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.294', 'weapon2': '0.648', 'WEAPON3': '1.200', 'HITCOUNT': '2.070', 'weapon3': '2.672', 'DAMAGECOUNT': '9.567', 'FRAGCOUNT': '24.000'} [2023-02-24 20:42:31,528][213367] DAMAGECOUNT value on done: 121468.0 [2023-02-24 20:42:31,529][213367] Sum rewards: 25.686, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.287', 'AMMO5': '0.029', 'AMMO2': '0.047', 'AMMO3': '0.128', 'AMMO4': '0.236', 'weapon2': '0.344', 'WEAPON4': '0.400', 'weapon5': '0.410', 'weapon4': '0.576', 'WEAPON5': '0.800', 'WEAPON3': '0.850', 'HITCOUNT': '1.950', 'weapon3': '2.190', 'DAMAGECOUNT': '9.012', 'FRAGCOUNT': '22.000'} [2023-02-24 20:42:31,575][213365] Updated weights for policy 0, policy_version 27956 (0.0009) [2023-02-24 20:42:31,658][213382] DAMAGECOUNT value on done: 118647.0 [2023-02-24 20:42:31,658][213382] Sum rewards: 21.822, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.961', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.033', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'weapon5': '0.152', 'WEAPON3': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.904', 'weapon3': '0.966', 'weapon4': '1.058', 'HITCOUNT': '1.450', 'DAMAGECOUNT': '5.496', 'FRAGCOUNT': '17.000'} [2023-02-24 20:42:31,733][213383] DAMAGECOUNT value on done: 123705.0 [2023-02-24 20:42:31,734][213383] Sum rewards: 20.414, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.425', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.017', 'AMMO5': '0.019', 'AMMO3': '0.108', 'weapon5': '0.432', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon2': '0.886', 'HITCOUNT': '1.290', 'weapon3': '2.088', 'DAMAGECOUNT': '5.685', 'FRAGCOUNT': '16.000'} [2023-02-24 20:42:31,764][213372] DAMAGECOUNT value on done: 124273.0 [2023-02-24 20:42:31,764][213372] Sum rewards: 32.246, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.065', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon7': '0.086', 'AMMO3': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon2': '0.274', 'WEAPON5': '0.300', 'weapon5': '0.326', 'WEAPON4': '0.350', 'WEAPON3': '0.550', 'weapon4': '0.824', 'HITCOUNT': '1.490', 'weapon3': '1.770', 'DAMAGECOUNT': '7.983', 'FRAGCOUNT': '27.000'} [2023-02-24 20:42:31,859][213366] DAMAGECOUNT value on done: 127322.0 [2023-02-24 20:42:31,860][213366] Sum rewards: 24.663, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.240', 'AMMO5': '0.012', 'AMMO2': '0.013', 'weapon4': '0.038', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.101', 'WEAPON5': '0.300', 'weapon5': '0.458', 'WEAPON3': '0.600', 'weapon2': '0.792', 'HITCOUNT': '1.400', 'weapon3': '2.464', 'DAMAGECOUNT': '6.570', 'FRAGCOUNT': '18.000'} [2023-02-24 20:42:32,022][213382] DAMAGECOUNT value on done: 126052.0 [2023-02-24 20:42:32,024][213382] Sum rewards: 25.433, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.261', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'weapon4': '0.108', 'WEAPON5': '0.200', 'weapon5': '0.238', 'WEAPON3': '0.600', 'weapon2': '0.912', 'HITCOUNT': '1.610', 'weapon3': '2.520', 'DAMAGECOUNT': '6.540', 'FRAGCOUNT': '19.000'} [2023-02-24 20:42:32,072][213368] DAMAGECOUNT value on done: 119115.0 [2023-02-24 20:42:32,073][213368] Sum rewards: 19.126, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.502', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.067', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'weapon5': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.426', 'HITCOUNT': '1.030', 'weapon2': '1.034', 'weapon3': '2.052', 'DAMAGECOUNT': '3.912', 'FRAGCOUNT': '15.000'} [2023-02-24 20:42:32,113][213383] DAMAGECOUNT value on done: 128641.0 [2023-02-24 20:42:32,114][213383] Sum rewards: 24.460, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.432', 'AMMO5': '0.010', 'AMMO2': '0.021', 'WEAPON1': '0.040', 'AMMO3': '0.082', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'weapon5': '0.344', 'WEAPON5': '0.350', 'weapon4': '0.380', 'weapon2': '0.498', 'WEAPON3': '0.550', 'HITCOUNT': '1.420', 'weapon3': '2.520', 'DAMAGECOUNT': '6.123', 'FRAGCOUNT': '19.000'} [2023-02-24 20:42:32,124][213372] DAMAGECOUNT value on done: 123004.0 [2023-02-24 20:42:32,124][213372] Sum rewards: 19.148, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.854', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'AMMO5': '0.035', 'AMMO4': '0.160', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'weapon5': '0.368', 'weapon4': '0.388', 'weapon2': '0.522', 'WEAPON5': '0.650', 'WEAPON3': '1.200', 'HITCOUNT': '1.660', 'weapon3': '2.264', 'DAMAGECOUNT': '7.266', 'FRAGCOUNT': '19.000'} [2023-02-24 20:42:32,227][213366] DAMAGECOUNT value on done: 124490.0 [2023-02-24 20:42:32,228][213366] Sum rewards: 33.255, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.315', 'AMMO5': '0.015', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.188', 'weapon2': '0.196', 'WEAPON4': '0.300', 'weapon4': '0.354', 'weapon5': '0.390', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.020', 'weapon3': '2.726', 'DAMAGECOUNT': '10.245', 'FRAGCOUNT': '30.000'} [2023-02-24 20:42:32,300][213369] DAMAGECOUNT value on done: 126502.0 [2023-02-24 20:42:32,301][213369] Sum rewards: 25.210, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.065', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO4': '0.132', 'AMMO3': '0.139', 'weapon4': '0.158', 'WEAPON4': '0.300', 'weapon5': '0.382', 'WEAPON5': '0.450', 'weapon2': '0.592', 'WEAPON3': '0.900', 'HITCOUNT': '1.750', 'weapon3': '2.518', 'DAMAGECOUNT': '7.392', 'FRAGCOUNT': '23.000'} [2023-02-24 20:42:32,371][213382] DAMAGECOUNT value on done: 118668.0 [2023-02-24 20:42:32,372][213382] Sum rewards: 10.257, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.480', 'AMMO2': '0.013', 'AMMO5': '0.023', 'ARMOR': '0.024', 'AMMO4': '0.066', 'weapon4': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.225', 'weapon5': '0.350', 'WEAPON5': '0.550', 'weapon2': '0.632', 'HITCOUNT': '1.250', 'WEAPON3': '1.300', 'weapon3': '2.176', 'DAMAGECOUNT': '5.829', 'FRAGCOUNT': '13.500'} [2023-02-24 20:42:32,419][213368] DAMAGECOUNT value on done: 123767.0 [2023-02-24 20:42:32,420][213368] Sum rewards: 27.140, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.570', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO2': '0.026', 'AMMO3': '0.083', 'AMMO4': '0.129', 'weapon5': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'weapon4': '0.746', 'weapon2': '0.776', 'HITCOUNT': '1.570', 'weapon3': '1.956', 'DAMAGECOUNT': '7.260', 'FRAGCOUNT': '23.000'} [2023-02-24 20:42:32,589][213384] DAMAGECOUNT value on done: 124647.0 [2023-02-24 20:42:32,589][213384] Sum rewards: 21.484, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.750', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO3': '0.104', 'AMMO4': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon5': '0.388', 'WEAPON3': '0.600', 'weapon4': '0.650', 'weapon2': '0.752', 'HITCOUNT': '1.380', 'weapon3': '1.898', 'DAMAGECOUNT': '5.874', 'FRAGCOUNT': '18.000'} [2023-02-24 20:42:32,625][213369] DAMAGECOUNT value on done: 126960.0 [2023-02-24 20:42:32,626][213369] Sum rewards: 30.215, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.490', 'AMMO5': '0.013', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.146', 'WEAPON4': '0.300', 'weapon4': '0.388', 'weapon2': '0.398', 'WEAPON5': '0.400', 'weapon5': '0.442', 'WEAPON3': '0.950', 'HITCOUNT': '2.060', 'weapon3': '2.430', 'DAMAGECOUNT': '9.849', 'FRAGCOUNT': '25.000'} [2023-02-24 20:42:32,697][213382] DAMAGECOUNT value on done: 123080.0 [2023-02-24 20:42:32,698][213382] Sum rewards: 21.242, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.342', 'AMMO5': '0.010', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'AMMO3': '0.094', 'AMMO4': '0.117', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.348', 'weapon5': '0.364', 'WEAPON3': '0.600', 'weapon2': '0.720', 'HITCOUNT': '1.550', 'weapon3': '2.312', 'DAMAGECOUNT': '5.916', 'FRAGCOUNT': '17.500'} [2023-02-24 20:42:32,731][213368] DAMAGECOUNT value on done: 126567.0 [2023-02-24 20:42:32,731][213368] Sum rewards: 33.922, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.044', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO3': '0.122', 'AMMO4': '0.180', 'weapon2': '0.350', 'WEAPON5': '0.450', 'weapon5': '0.466', 'WEAPON4': '0.500', 'WEAPON3': '0.700', 'weapon4': '0.872', 'HITCOUNT': '1.800', 'weapon3': '2.006', 'DAMAGECOUNT': '8.715', 'FRAGCOUNT': '30.000'} [2023-02-24 20:42:32,754][213383] DAMAGECOUNT value on done: 124134.0 [2023-02-24 20:42:32,754][213383] Sum rewards: 38.319, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.982', 'AMMO2': '0.022', 'AMMO5': '0.024', 'AMMO4': '0.108', 'AMMO3': '0.135', 'weapon2': '0.146', 'WEAPON4': '0.300', 'weapon5': '0.412', 'weapon4': '0.448', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'HITCOUNT': '2.250', 'weapon3': '2.694', 'DAMAGECOUNT': '9.612', 'FRAGCOUNT': '33.000'} [2023-02-24 20:42:32,928][213384] DAMAGECOUNT value on done: 115210.0 [2023-02-24 20:42:32,928][213384] Sum rewards: 21.964, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.895', 'AMMO2': '0.006', 'ARMOR': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.031', 'WEAPON4': '0.100', 'AMMO3': '0.143', 'weapon4': '0.178', 'weapon5': '0.270', 'WEAPON5': '0.300', 'weapon2': '0.770', 'WEAPON3': '0.900', 'HITCOUNT': '1.750', 'weapon3': '2.464', 'DAMAGECOUNT': '6.909', 'FRAGCOUNT': '18.000'} [2023-02-24 20:42:32,998][213369] DAMAGECOUNT value on done: 128298.0 [2023-02-24 20:42:32,999][213369] Sum rewards: 17.492, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.389', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.034', 'AMMO4': '0.170', 'AMMO3': '0.177', 'weapon5': '0.354', 'weapon4': '0.384', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'weapon2': '0.586', 'WEAPON3': '1.000', 'HITCOUNT': '1.660', 'weapon3': '2.366', 'DAMAGECOUNT': '6.672', 'FRAGCOUNT': '17.500'} [2023-02-24 20:42:33,054][213368] DAMAGECOUNT value on done: 122353.0 [2023-02-24 20:42:33,055][213368] Sum rewards: 20.388, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.036', 'AMMO5': '0.021', 'AMMO2': '0.033', 'AMMO4': '0.165', 'AMMO3': '0.182', 'weapon2': '0.288', 'weapon5': '0.294', 'WEAPON4': '0.450', 'weapon4': '0.472', 'WEAPON5': '0.550', 'WEAPON3': '1.050', 'HITCOUNT': '1.530', 'weapon3': '2.562', 'DAMAGECOUNT': '7.326', 'FRAGCOUNT': '21.000'} [2023-02-24 20:42:33,056][213384] DAMAGECOUNT value on done: 126561.0 [2023-02-24 20:42:33,056][213384] Sum rewards: 27.301, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.471', 'AMMO2': '0.017', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'weapon4': '0.068', 'AMMO4': '0.087', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'weapon2': '0.330', 'WEAPON5': '0.450', 'weapon5': '0.514', 'WEAPON3': '0.800', 'HITCOUNT': '1.850', 'weapon3': '2.860', 'DAMAGECOUNT': '8.211', 'FRAGCOUNT': '22.000'} [2023-02-24 20:42:33,074][213383] DAMAGECOUNT value on done: 117361.0 [2023-02-24 20:42:33,074][213383] Sum rewards: 35.816, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.052', 'AMMO5': '0.023', 'AMMO2': '0.053', 'AMMO3': '0.159', 'AMMO4': '0.267', 'weapon2': '0.378', 'weapon5': '0.480', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'weapon4': '0.712', 'WEAPON3': '1.000', 'weapon3': '2.044', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '11.331', 'FRAGCOUNT': '33.000'} [2023-02-24 20:42:33,315][213369] DAMAGECOUNT value on done: 112071.0 [2023-02-24 20:42:33,316][213369] Sum rewards: 23.504, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.200', 'WEAPON1': '0.010', 'weapon4': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.028', 'AMMO3': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.138', 'WEAPON3': '0.350', 'WEAPON5': '0.400', 'weapon5': '0.438', 'weapon2': '0.918', 'HITCOUNT': '1.050', 'weapon3': '2.300', 'DAMAGECOUNT': '4.647', 'FRAGCOUNT': '17.000'} [2023-02-24 20:42:33,367][213384] DAMAGECOUNT value on done: 127493.0 [2023-02-24 20:42:33,368][213384] Sum rewards: 28.001, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'AMMO2': '0.017', 'HEALTH': '0.034', 'WEAPON4': '0.050', 'AMMO4': '0.083', 'AMMO3': '0.099', 'weapon4': '0.150', 'WEAPON5': '0.250', 'weapon5': '0.386', 'weapon2': '0.590', 'WEAPON3': '0.600', 'HITCOUNT': '1.390', 'weapon3': '2.562', 'DAMAGECOUNT': '6.780', 'FRAGCOUNT': '21.000'} [2023-02-24 20:42:34,762][213365] Updated weights for policy 0, policy_version 27966 (0.0009) [2023-02-24 20:42:35,243][213332] Fps is (10 sec: 13107.1, 60 sec: 12902.4, 300 sec: 13468.2). Total num frames: 114552832. Throughput: 0: 3186.7. Samples: 3627566. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 20:42:35,243][213332] Avg episode reward: [(0, '26.455')] [2023-02-24 20:42:37,921][213365] Updated weights for policy 0, policy_version 27976 (0.0009) [2023-02-24 20:42:40,243][213332] Fps is (10 sec: 13107.1, 60 sec: 12902.4, 300 sec: 13454.3). Total num frames: 114618368. Throughput: 0: 3215.6. Samples: 3647204. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 20:42:40,243][213332] Avg episode reward: [(0, '26.455')] [2023-02-24 20:42:41,014][213365] Updated weights for policy 0, policy_version 27986 (0.0009) [2023-02-24 20:42:44,521][213365] Updated weights for policy 0, policy_version 27996 (0.0009) [2023-02-24 20:42:45,243][213332] Fps is (10 sec: 12697.5, 60 sec: 12765.8, 300 sec: 13426.5). Total num frames: 114679808. Throughput: 0: 3182.8. Samples: 3665744. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 20:42:45,243][213332] Avg episode reward: [(0, '26.455')] [2023-02-24 20:42:45,247][213352] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000027998_114679808.pth... [2023-02-24 20:42:45,311][213352] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000027211_111456256.pth [2023-02-24 20:42:47,636][213365] Updated weights for policy 0, policy_version 28006 (0.0009) [2023-02-24 20:42:50,243][213332] Fps is (10 sec: 12697.7, 60 sec: 12902.4, 300 sec: 13426.6). Total num frames: 114745344. Throughput: 0: 3194.6. Samples: 3675572. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 20:42:50,243][213332] Avg episode reward: [(0, '26.455')] [2023-02-24 20:42:50,750][213365] Updated weights for policy 0, policy_version 28016 (0.0009) [2023-02-24 20:42:51,668][213367] DAMAGECOUNT value on done: 125612.0 [2023-02-24 20:42:51,669][213367] Sum rewards: 29.864, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.525', 'AMMO5': '0.015', 'AMMO2': '0.015', 'AMMO4': '0.076', 'AMMO3': '0.112', 'WEAPON4': '0.200', 'weapon5': '0.242', 'weapon4': '0.356', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'weapon2': '0.956', 'HITCOUNT': '1.770', 'weapon3': '2.056', 'DAMAGECOUNT': '7.491', 'FRAGCOUNT': '25.000'} [2023-02-24 20:42:52,199][213367] DAMAGECOUNT value on done: 127622.0 [2023-02-24 20:42:52,200][213367] Sum rewards: 32.370, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.050', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.042', 'AMMO3': '0.110', 'AMMO4': '0.209', 'weapon5': '0.292', 'weapon2': '0.574', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '0.750', 'weapon4': '0.908', 'weapon3': '1.730', 'HITCOUNT': '2.310', 'DAMAGECOUNT': '9.168', 'FRAGCOUNT': '30.000'} [2023-02-24 20:42:52,247][213372] DAMAGECOUNT value on done: 126108.0 [2023-02-24 20:42:52,248][213372] Sum rewards: 18.326, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.308', 'AMMO5': '0.022', 'AMMO2': '0.047', 'AMMO3': '0.129', 'AMMO4': '0.237', 'weapon5': '0.288', 'WEAPON5': '0.500', 'weapon2': '0.504', 'WEAPON4': '0.550', 'WEAPON3': '0.750', 'weapon4': '0.844', 'HITCOUNT': '1.750', 'weapon3': '2.022', 'DAMAGECOUNT': '7.740', 'FRAGCOUNT': '17.000'} [2023-02-24 20:42:52,599][213366] DAMAGECOUNT value on done: 121508.0 [2023-02-24 20:42:52,599][213366] Sum rewards: 21.095, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.174', 'ARMOR': '0.004', 'AMMO5': '0.012', 'weapon4': '0.014', 'AMMO2': '0.019', 'AMMO3': '0.060', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'weapon5': '0.308', 'WEAPON5': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.990', 'weapon3': '1.416', 'weapon2': '1.886', 'DAMAGECOUNT': '5.067', 'FRAGCOUNT': '15.000'} [2023-02-24 20:42:52,746][213367] DAMAGECOUNT value on done: 127082.0 [2023-02-24 20:42:52,747][213367] Sum rewards: 35.306, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.710', 'AMMO5': '0.022', 'AMMO2': '0.035', 'AMMO3': '0.117', 'AMMO4': '0.175', 'weapon4': '0.282', 'WEAPON4': '0.300', 'weapon5': '0.398', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon2': '0.784', 'HITCOUNT': '1.930', 'weapon3': '2.242', 'DAMAGECOUNT': '9.930', 'FRAGCOUNT': '29.000'} [2023-02-24 20:42:52,777][213372] DAMAGECOUNT value on done: 126942.0 [2023-02-24 20:42:52,778][213372] Sum rewards: 31.506, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.300', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.010', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON6': '0.100', 'weapon6': '0.110', 'AMMO3': '0.161', 'weapon5': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.566', 'WEAPON3': '1.150', 'HITCOUNT': '1.860', 'weapon3': '2.810', 'DAMAGECOUNT': '8.085', 'FRAGCOUNT': '28.000'} [2023-02-24 20:42:53,014][213366] DAMAGECOUNT value on done: 133225.0 [2023-02-24 20:42:53,015][213366] Sum rewards: 27.287, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.120', 'AMMO5': '0.022', 'AMMO2': '0.045', 'AMMO3': '0.126', 'AMMO4': '0.226', 'weapon5': '0.366', 'weapon2': '0.516', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon4': '0.662', 'WEAPON3': '0.750', 'HITCOUNT': '1.730', 'weapon3': '2.014', 'DAMAGECOUNT': '8.799', 'FRAGCOUNT': '25.000'} [2023-02-24 20:42:53,164][213367] DAMAGECOUNT value on done: 124268.0 [2023-02-24 20:42:53,164][213367] Sum rewards: 28.409, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.328', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.046', 'AMMO3': '0.166', 'AMMO4': '0.229', 'weapon5': '0.246', 'weapon2': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.500', 'weapon4': '0.500', 'WEAPON3': '1.050', 'HITCOUNT': '1.860', 'weapon3': '2.634', 'DAMAGECOUNT': '8.400', 'FRAGCOUNT': '27.000'} [2023-02-24 20:42:53,306][213382] DAMAGECOUNT value on done: 120807.0 [2023-02-24 20:42:53,306][213382] Sum rewards: 17.371, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.938', 'AMMO2': '0.014', 'AMMO5': '0.017', 'AMMO4': '0.068', 'AMMO3': '0.190', 'weapon2': '0.238', 'WEAPON4': '0.300', 'weapon5': '0.362', 'WEAPON5': '0.500', 'weapon4': '0.644', 'WEAPON3': '1.100', 'HITCOUNT': '1.630', 'weapon3': '2.516', 'DAMAGECOUNT': '6.480', 'FRAGCOUNT': '18.000'} [2023-02-24 20:42:53,333][213372] DAMAGECOUNT value on done: 127070.0 [2023-02-24 20:42:53,334][213372] Sum rewards: 29.891, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.105', 'AMMO5': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.162', 'weapon4': '0.180', 'WEAPON4': '0.250', 'weapon5': '0.324', 'WEAPON5': '0.550', 'weapon2': '0.684', 'WEAPON3': '1.050', 'HITCOUNT': '1.790', 'weapon3': '2.470', 'DAMAGECOUNT': '8.391', 'FRAGCOUNT': '28.000'} [2023-02-24 20:42:53,338][213366] DAMAGECOUNT value on done: 130239.0 [2023-02-24 20:42:53,339][213366] Sum rewards: 30.762, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.344', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.048', 'AMMO3': '0.146', 'weapon5': '0.224', 'AMMO4': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.520', 'weapon4': '0.658', 'WEAPON3': '0.800', 'HITCOUNT': '1.880', 'weapon3': '2.070', 'DAMAGECOUNT': '8.751', 'FRAGCOUNT': '27.000'} [2023-02-24 20:42:53,413][213383] DAMAGECOUNT value on done: 126652.0 [2023-02-24 20:42:53,413][213383] Sum rewards: 34.504, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.015', 'AMMO5': '0.016', 'AMMO2': '0.032', 'AMMO3': '0.137', 'AMMO4': '0.162', 'weapon4': '0.204', 'WEAPON4': '0.250', 'weapon5': '0.342', 'WEAPON5': '0.450', 'weapon2': '0.588', 'WEAPON3': '0.900', 'HITCOUNT': '1.890', 'weapon3': '2.502', 'DAMAGECOUNT': '8.796', 'FRAGCOUNT': '30.000'} [2023-02-24 20:42:53,606][213382] DAMAGECOUNT value on done: 128516.0 [2023-02-24 20:42:53,607][213382] Sum rewards: 17.704, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.676', 'ARMOR': '0.020', 'AMMO5': '0.020', 'AMMO2': '0.072', 'AMMO3': '0.129', 'weapon5': '0.224', 'AMMO4': '0.359', 'WEAPON5': '0.450', 'weapon2': '0.576', 'WEAPON3': '0.850', 'WEAPON4': '0.850', 'weapon4': '0.910', 'HITCOUNT': '1.670', 'weapon3': '1.858', 'DAMAGECOUNT': '7.392', 'FRAGCOUNT': '20.000'} [2023-02-24 20:42:53,621][213368] DAMAGECOUNT value on done: 121535.0 [2023-02-24 20:42:53,621][213368] Sum rewards: 21.785, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.899', 'AMMO2': '0.013', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.065', 'weapon4': '0.110', 'AMMO3': '0.135', 'WEAPON4': '0.200', 'weapon5': '0.264', 'WEAPON5': '0.400', 'weapon2': '0.700', 'WEAPON3': '0.950', 'HITCOUNT': '1.750', 'weapon3': '2.552', 'DAMAGECOUNT': '7.260', 'FRAGCOUNT': '19.000'} [2023-02-24 20:42:53,632][213372] DAMAGECOUNT value on done: 125665.0 [2023-02-24 20:42:53,633][213372] Sum rewards: 28.548, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.134', 'AMMO4': '0.138', 'weapon5': '0.276', 'weapon2': '0.322', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'HEALTH': '0.672', 'WEAPON3': '0.700', 'weapon4': '1.060', 'weapon3': '1.856', 'HITCOUNT': '2.190', 'DAMAGECOUNT': '7.983', 'FRAGCOUNT': '24.000'} [2023-02-24 20:42:53,639][213366] DAMAGECOUNT value on done: 127483.0 [2023-02-24 20:42:53,639][213366] Sum rewards: 29.787, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.166', 'AMMO2': '0.014', 'AMMO5': '0.027', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'weapon4': '0.182', 'AMMO3': '0.212', 'weapon5': '0.350', 'weapon2': '0.368', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'HITCOUNT': '1.830', 'weapon3': '2.622', 'DAMAGECOUNT': '8.979', 'FRAGCOUNT': '28.000'} [2023-02-24 20:42:53,705][213383] DAMAGECOUNT value on done: 132167.0 [2023-02-24 20:42:53,706][213383] Sum rewards: 28.530, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.953', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.020', 'AMMO4': '0.099', 'AMMO3': '0.164', 'WEAPON4': '0.300', 'weapon5': '0.300', 'weapon2': '0.376', 'WEAPON5': '0.400', 'weapon4': '0.676', 'WEAPON3': '1.050', 'weapon3': '2.238', 'HITCOUNT': '2.260', 'DAMAGECOUNT': '10.578', 'FRAGCOUNT': '24.000'} [2023-02-24 20:42:53,803][213369] DAMAGECOUNT value on done: 129542.0 [2023-02-24 20:42:53,804][213369] Sum rewards: 29.962, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.824', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'WEAPON5': '0.250', 'weapon5': '0.250', 'weapon4': '0.402', 'weapon2': '0.512', 'WEAPON3': '1.000', 'HITCOUNT': '1.960', 'weapon3': '2.596', 'DAMAGECOUNT': '9.120', 'FRAGCOUNT': '27.000'} [2023-02-24 20:42:53,911][213382] DAMAGECOUNT value on done: 121590.0 [2023-02-24 20:42:53,911][213382] Sum rewards: 31.935, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.472', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.034', 'AMMO3': '0.100', 'weapon5': '0.136', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.594', 'WEAPON3': '0.650', 'weapon4': '0.650', 'HITCOUNT': '2.140', 'weapon3': '2.408', 'DAMAGECOUNT': '8.766', 'FRAGCOUNT': '26.000'} [2023-02-24 20:42:53,923][213368] DAMAGECOUNT value on done: 126953.0 [2023-02-24 20:42:53,924][213368] Sum rewards: 33.116, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.430', 'AMMO5': '0.017', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon4': '0.154', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'weapon5': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.996', 'WEAPON3': '1.050', 'weapon3': '2.078', 'HITCOUNT': '2.090', 'DAMAGECOUNT': '9.558', 'FRAGCOUNT': '30.000'} [2023-02-24 20:42:54,101][213384] DAMAGECOUNT value on done: 127548.0 [2023-02-24 20:42:54,102][213384] Sum rewards: 25.257, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.710', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.177', 'weapon5': '0.194', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.404', 'weapon2': '0.464', 'WEAPON3': '1.200', 'HITCOUNT': '1.850', 'weapon3': '2.642', 'DAMAGECOUNT': '8.688', 'FRAGCOUNT': '25.000'} [2023-02-24 20:42:54,117][213369] DAMAGECOUNT value on done: 129310.0 [2023-02-24 20:42:54,118][213369] Sum rewards: 29.480, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.393', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO3': '0.110', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'weapon5': '0.154', 'WEAPON5': '0.250', 'weapon4': '0.420', 'WEAPON3': '0.700', 'weapon2': '0.750', 'HITCOUNT': '1.870', 'weapon3': '2.476', 'DAMAGECOUNT': '7.050', 'FRAGCOUNT': '24.000'} [2023-02-24 20:42:54,227][213382] DAMAGECOUNT value on done: 126164.0 [2023-02-24 20:42:54,228][213382] Sum rewards: 34.996, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.972', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO4': '0.191', 'AMMO3': '0.192', 'weapon5': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.404', 'weapon2': '0.452', 'WEAPON3': '1.100', 'HITCOUNT': '2.320', 'weapon3': '2.568', 'DAMAGECOUNT': '9.252', 'FRAGCOUNT': '33.000'} [2023-02-24 20:42:54,229][213368] DAMAGECOUNT value on done: 129411.0 [2023-02-24 20:42:54,229][213368] Sum rewards: 30.206, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.828', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.062', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon5': '0.254', 'weapon4': '0.262', 'weapon2': '0.498', 'WEAPON3': '1.200', 'HITCOUNT': '2.030', 'weapon3': '2.686', 'DAMAGECOUNT': '8.532', 'FRAGCOUNT': '28.000'} [2023-02-24 20:42:54,322][213383] DAMAGECOUNT value on done: 127050.0 [2023-02-24 20:42:54,322][213383] Sum rewards: 26.366, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.520', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.056', 'AMMO3': '0.129', 'AMMO4': '0.279', 'weapon5': '0.410', 'weapon2': '0.564', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '0.850', 'weapon4': '0.954', 'weapon3': '1.670', 'HITCOUNT': '2.060', 'DAMAGECOUNT': '8.736', 'FRAGCOUNT': '26.000'} [2023-02-24 20:42:54,427][213384] DAMAGECOUNT value on done: 117797.0 [2023-02-24 20:42:54,428][213384] Sum rewards: 28.978, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.134', 'AMMO5': '0.022', 'AMMO2': '0.027', 'AMMO4': '0.136', 'AMMO3': '0.171', 'weapon5': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.358', 'weapon4': '0.526', 'WEAPON5': '0.550', 'WEAPON3': '0.950', 'HITCOUNT': '1.870', 'weapon3': '2.526', 'DAMAGECOUNT': '7.761', 'FRAGCOUNT': '26.000'} [2023-02-24 20:42:54,496][213369] DAMAGECOUNT value on done: 130648.0 [2023-02-24 20:42:54,497][213369] Sum rewards: 21.834, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.962', 'AMMO2': '0.005', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.025', 'weapon5': '0.210', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.778', 'WEAPON3': '1.300', 'HITCOUNT': '1.580', 'weapon3': '2.602', 'DAMAGECOUNT': '7.050', 'FRAGCOUNT': '21.000'} [2023-02-24 20:42:54,545][213368] DAMAGECOUNT value on done: 125259.0 [2023-02-24 20:42:54,545][213368] Sum rewards: 29.652, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.642', 'AMMO2': '0.017', 'AMMO5': '0.017', 'AMMO4': '0.086', 'weapon4': '0.136', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'weapon5': '0.312', 'weapon2': '0.398', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '2.200', 'weapon3': '2.762', 'DAMAGECOUNT': '8.718', 'FRAGCOUNT': '26.000'} [2023-02-24 20:42:54,547][213365] Updated weights for policy 0, policy_version 28026 (0.0009) [2023-02-24 20:42:54,585][213384] DAMAGECOUNT value on done: 129045.0 [2023-02-24 20:42:54,586][213384] Sum rewards: 27.180, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.990', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO3': '0.124', 'weapon4': '0.138', 'AMMO4': '0.190', 'WEAPON4': '0.300', 'weapon5': '0.368', 'WEAPON5': '0.550', 'weapon2': '0.570', 'WEAPON3': '0.850', 'HITCOUNT': '1.740', 'weapon3': '2.584', 'DAMAGECOUNT': '7.452', 'FRAGCOUNT': '24.000'} [2023-02-24 20:42:54,641][213383] DAMAGECOUNT value on done: 119850.0 [2023-02-24 20:42:54,641][213383] Sum rewards: 21.148, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.737', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.150', 'AMMO4': '0.186', 'weapon5': '0.384', 'WEAPON5': '0.450', 'weapon2': '0.650', 'WEAPON3': '1.000', 'HITCOUNT': '1.560', 'weapon3': '2.552', 'DAMAGECOUNT': '7.467', 'FRAGCOUNT': '18.000'} [2023-02-24 20:42:54,813][213369] DAMAGECOUNT value on done: 114894.0 [2023-02-24 20:42:54,814][213369] Sum rewards: 26.885, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.638', 'AMMO5': '0.025', 'AMMO2': '0.037', 'AMMO4': '0.188', 'AMMO3': '0.198', 'weapon2': '0.224', 'weapon4': '0.326', 'WEAPON4': '0.400', 'weapon5': '0.574', 'WEAPON5': '0.700', 'WEAPON3': '1.200', 'HITCOUNT': '1.770', 'weapon3': '2.412', 'DAMAGECOUNT': '8.469', 'FRAGCOUNT': '28.000'} [2023-02-24 20:42:54,857][213366] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 20:42:54,900][213384] DAMAGECOUNT value on done: 131483.0 [2023-02-24 20:42:54,901][213384] Sum rewards: 45.032, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.830', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.066', 'weapon4': '0.092', 'AMMO4': '0.143', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.942', 'WEAPON3': '0.950', 'weapon3': '2.688', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '11.970', 'FRAGCOUNT': '37.000'} [2023-02-24 20:42:55,243][213332] Fps is (10 sec: 12288.1, 60 sec: 12697.6, 300 sec: 13384.9). Total num frames: 114802688. Throughput: 0: 3184.4. Samples: 3693036. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 20:42:55,243][213332] Avg episode reward: [(0, '26.598')] [2023-02-24 20:42:57,560][213365] Updated weights for policy 0, policy_version 28036 (0.0009) [2023-02-24 20:43:00,243][213332] Fps is (10 sec: 12288.0, 60 sec: 12697.6, 300 sec: 13371.0). Total num frames: 114868224. Throughput: 0: 3227.3. Samples: 3713168. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 20:43:00,243][213332] Avg episode reward: [(0, '26.598')] [2023-02-24 20:43:00,618][213365] Updated weights for policy 0, policy_version 28046 (0.0009) [2023-02-24 20:43:03,672][213365] Updated weights for policy 0, policy_version 28056 (0.0008) [2023-02-24 20:43:05,243][213332] Fps is (10 sec: 13516.7, 60 sec: 12902.4, 300 sec: 13371.0). Total num frames: 114937856. Throughput: 0: 3245.2. Samples: 3723390. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 20:43:05,243][213332] Avg episode reward: [(0, '26.598')] [2023-02-24 20:43:06,658][213365] Updated weights for policy 0, policy_version 28066 (0.0009) [2023-02-24 20:43:09,631][213367] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 20:43:09,757][213365] Updated weights for policy 0, policy_version 28076 (0.0009) [2023-02-24 20:43:10,243][213332] Fps is (10 sec: 13516.7, 60 sec: 12970.7, 300 sec: 13384.9). Total num frames: 115003392. Throughput: 0: 3243.3. Samples: 3743548. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 20:43:10,243][213332] Avg episode reward: [(0, '26.598')] [2023-02-24 20:43:12,142][213367] DAMAGECOUNT value on done: 128216.0 [2023-02-24 20:43:12,142][213367] Sum rewards: 23.414, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.304', 'ARMOR': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO4': '0.087', 'weapon4': '0.120', 'AMMO3': '0.132', 'WEAPON4': '0.200', 'weapon2': '0.452', 'WEAPON5': '0.550', 'weapon5': '0.652', 'WEAPON3': '0.850', 'HITCOUNT': '1.370', 'weapon3': '2.300', 'DAMAGECOUNT': '7.692', 'FRAGCOUNT': '20.000'} [2023-02-24 20:43:12,452][213367] DAMAGECOUNT value on done: 129852.0 [2023-02-24 20:43:12,453][213367] Sum rewards: 21.078, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.544', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'weapon4': '0.074', 'weapon5': '0.120', 'AMMO4': '0.128', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.652', 'WEAPON3': '1.000', 'HITCOUNT': '1.490', 'weapon3': '2.812', 'DAMAGECOUNT': '6.690', 'FRAGCOUNT': '21.000'} [2023-02-24 20:43:12,518][213372] DAMAGECOUNT value on done: 129286.0 [2023-02-24 20:43:12,519][213372] Sum rewards: 37.317, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.421', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon4': '0.240', 'weapon2': '0.594', 'WEAPON3': '1.050', 'HITCOUNT': '2.560', 'weapon3': '2.774', 'DAMAGECOUNT': '9.534', 'FRAGCOUNT': '33.000'} [2023-02-24 20:43:12,646][213366] DAMAGECOUNT value on done: 124253.0 [2023-02-24 20:43:12,646][213366] Sum rewards: 28.992, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.748', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO3': '0.148', 'AMMO4': '0.187', 'weapon4': '0.236', 'weapon5': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.614', 'WEAPON3': '0.950', 'HITCOUNT': '1.860', 'weapon3': '2.558', 'DAMAGECOUNT': '8.235', 'FRAGCOUNT': '27.000'} [2023-02-24 20:43:12,758][213365] Updated weights for policy 0, policy_version 28086 (0.0009) [2023-02-24 20:43:12,772][213367] DAMAGECOUNT value on done: 130147.0 [2023-02-24 20:43:12,772][213367] Sum rewards: 33.001, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.676', 'WEAPON1': '0.010', 'AMMO5': '0.035', 'AMMO2': '0.063', 'AMMO3': '0.139', 'AMMO4': '0.313', 'weapon4': '0.382', 'WEAPON4': '0.400', 'weapon5': '0.540', 'weapon2': '0.840', 'WEAPON3': '0.900', 'WEAPON5': '0.950', 'HITCOUNT': '1.630', 'weapon3': '1.780', 'DAMAGECOUNT': '9.195', 'FRAGCOUNT': '29.000'} [2023-02-24 20:43:12,846][213372] DAMAGECOUNT value on done: 129698.0 [2023-02-24 20:43:12,846][213372] Sum rewards: 23.594, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.280', 'AMMO5': '0.020', 'AMMO2': '0.041', 'weapon4': '0.130', 'AMMO3': '0.191', 'AMMO4': '0.205', 'weapon5': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon2': '0.554', 'WEAPON3': '1.200', 'HITCOUNT': '1.740', 'weapon3': '2.608', 'DAMAGECOUNT': '8.268', 'FRAGCOUNT': '24.000'} [2023-02-24 20:43:12,978][213366] DAMAGECOUNT value on done: 135625.0 [2023-02-24 20:43:12,979][213366] Sum rewards: 19.626, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.411', 'AMMO5': '0.026', 'AMMO2': '0.040', 'AMMO3': '0.190', 'AMMO4': '0.202', 'weapon5': '0.260', 'weapon4': '0.338', 'WEAPON4': '0.450', 'WEAPON5': '0.650', 'weapon2': '0.758', 'WEAPON3': '1.200', 'HITCOUNT': '1.530', 'weapon3': '2.192', 'DAMAGECOUNT': '7.200', 'FRAGCOUNT': '21.500'} [2023-02-24 20:43:13,096][213367] DAMAGECOUNT value on done: 126516.0 [2023-02-24 20:43:13,096][213367] Sum rewards: 21.023, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.720', 'AMMO5': '0.017', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.141', 'weapon4': '0.160', 'WEAPON4': '0.350', 'weapon5': '0.422', 'WEAPON5': '0.550', 'weapon2': '0.716', 'WEAPON3': '0.850', 'HITCOUNT': '1.290', 'weapon3': '2.340', 'DAMAGECOUNT': '6.744', 'FRAGCOUNT': '21.000'} [2023-02-24 20:43:13,271][213366] DAMAGECOUNT value on done: 132291.0 [2023-02-24 20:43:13,272][213366] Sum rewards: 26.554, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.038', 'ARMOR': '0.005', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.040', 'weapon4': '0.092', 'AMMO3': '0.096', 'AMMO4': '0.199', 'weapon5': '0.360', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon2': '1.162', 'HITCOUNT': '1.430', 'weapon3': '2.064', 'DAMAGECOUNT': '6.156', 'FRAGCOUNT': '24.000'} [2023-02-24 20:43:13,356][213382] DAMAGECOUNT value on done: 124059.0 [2023-02-24 20:43:13,356][213382] Sum rewards: 33.128, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.986', 'AMMO5': '0.024', 'AMMO2': '0.034', 'AMMO3': '0.152', 'AMMO4': '0.172', 'weapon5': '0.246', 'WEAPON4': '0.350', 'weapon4': '0.484', 'WEAPON5': '0.550', 'weapon2': '0.620', 'WEAPON3': '1.050', 'weapon3': '2.196', 'HITCOUNT': '2.230', 'DAMAGECOUNT': '9.756', 'FRAGCOUNT': '30.000'} [2023-02-24 20:43:13,361][213372] DAMAGECOUNT value on done: 130224.0 [2023-02-24 20:43:13,361][213372] Sum rewards: 27.869, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.417', 'AMMO5': '0.007', 'AMMO2': '0.031', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'weapon4': '0.268', 'weapon2': '0.662', 'WEAPON3': '1.100', 'HITCOUNT': '2.400', 'weapon3': '2.856', 'DAMAGECOUNT': '9.462', 'FRAGCOUNT': '25.000'} [2023-02-24 20:43:13,396][213383] DAMAGECOUNT value on done: 129592.0 [2023-02-24 20:43:13,397][213383] Sum rewards: 24.773, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.290', 'AMMO5': '0.023', 'AMMO2': '0.035', 'AMMO4': '0.174', 'AMMO3': '0.197', 'weapon5': '0.280', 'weapon2': '0.288', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon4': '0.582', 'WEAPON3': '1.250', 'HITCOUNT': '2.260', 'weapon3': '2.504', 'DAMAGECOUNT': '8.820', 'FRAGCOUNT': '25.000'} [2023-02-24 20:43:13,595][213366] DAMAGECOUNT value on done: 129334.0 [2023-02-24 20:43:13,596][213366] Sum rewards: 23.457, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.510', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'weapon4': '0.038', 'AMMO4': '0.056', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'weapon5': '0.320', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'weapon2': '0.944', 'HITCOUNT': '1.440', 'weapon3': '2.374', 'DAMAGECOUNT': '5.553', 'FRAGCOUNT': '22.000'} [2023-02-24 20:43:13,655][213368] DAMAGECOUNT value on done: 124519.0 [2023-02-24 20:43:13,656][213368] Sum rewards: 37.079, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.861', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.070', 'AMMO3': '0.123', 'weapon5': '0.136', 'WEAPON5': '0.150', 'weapon4': '0.164', 'weapon2': '0.840', 'WEAPON3': '0.850', 'HITCOUNT': '2.190', 'weapon3': '2.646', 'DAMAGECOUNT': '8.952', 'FRAGCOUNT': '30.000'} [2023-02-24 20:43:13,688][213382] DAMAGECOUNT value on done: 131089.0 [2023-02-24 20:43:13,689][213382] Sum rewards: 24.830, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.418', 'AMMO2': '0.005', 'AMMO5': '0.010', 'weapon4': '0.014', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'AMMO3': '0.189', 'weapon5': '0.234', 'WEAPON5': '0.300', 'weapon2': '0.796', 'WEAPON3': '1.150', 'HITCOUNT': '1.450', 'weapon3': '2.558', 'DAMAGECOUNT': '7.719', 'FRAGCOUNT': '23.000'} [2023-02-24 20:43:13,692][213372] DAMAGECOUNT value on done: 128343.0 [2023-02-24 20:43:13,693][213372] Sum rewards: 27.991, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.717', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.037', 'AMMO3': '0.133', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO4': '0.185', 'weapon5': '0.212', 'weapon4': '0.450', 'WEAPON3': '0.850', 'weapon2': '0.872', 'HITCOUNT': '1.980', 'weapon3': '2.144', 'DAMAGECOUNT': '8.034', 'FRAGCOUNT': '24.000'} [2023-02-24 20:43:13,718][213383] DAMAGECOUNT value on done: 134137.0 [2023-02-24 20:43:13,719][213383] Sum rewards: 25.957, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.467', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO3': '0.044', 'AMMO4': '0.086', 'weapon7': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.122', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.594', 'weapon3': '0.944', 'weapon2': '1.104', 'HITCOUNT': '1.390', 'DAMAGECOUNT': '5.910', 'FRAGCOUNT': '21.000'} [2023-02-24 20:43:13,898][213369] DAMAGECOUNT value on done: 132619.0 [2023-02-24 20:43:13,898][213369] Sum rewards: 31.498, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.890', 'AMMO5': '0.022', 'AMMO2': '0.030', 'AMMO3': '0.123', 'AMMO4': '0.149', 'WEAPON4': '0.400', 'weapon5': '0.452', 'weapon2': '0.472', 'WEAPON5': '0.500', 'weapon4': '0.746', 'WEAPON3': '0.750', 'weapon3': '1.872', 'HITCOUNT': '1.890', 'DAMAGECOUNT': '9.231', 'FRAGCOUNT': '27.000'} [2023-02-24 20:43:13,981][213368] DAMAGECOUNT value on done: 129621.0 [2023-02-24 20:43:13,982][213368] Sum rewards: 24.158, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.230', 'WEAPON1': '0.010', 'AMMO5': '0.023', 'AMMO2': '0.028', 'weapon4': '0.044', 'AMMO4': '0.137', 'weapon5': '0.208', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.500', 'weapon2': '0.620', 'WEAPON3': '1.350', 'HITCOUNT': '1.790', 'weapon3': '2.704', 'DAMAGECOUNT': '8.004', 'FRAGCOUNT': '25.000'} [2023-02-24 20:43:14,007][213382] DAMAGECOUNT value on done: 123773.0 [2023-02-24 20:43:14,008][213382] Sum rewards: 17.318, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.298', 'AMMO5': '0.013', 'AMMO2': '0.050', 'AMMO3': '0.179', 'weapon5': '0.222', 'AMMO4': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.488', 'weapon2': '0.554', 'WEAPON4': '0.650', 'WEAPON3': '1.000', 'HITCOUNT': '1.660', 'weapon3': '2.350', 'DAMAGECOUNT': '6.549', 'FRAGCOUNT': '21.000'} [2023-02-24 20:43:14,137][213384] DAMAGECOUNT value on done: 130662.0 [2023-02-24 20:43:14,137][213384] Sum rewards: 29.976, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.598', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.152', 'WEAPON5': '0.250', 'weapon5': '0.254', 'WEAPON4': '0.300', 'weapon2': '0.334', 'weapon4': '0.756', 'WEAPON3': '0.950', 'weapon3': '1.932', 'HITCOUNT': '2.230', 'DAMAGECOUNT': '9.342', 'FRAGCOUNT': '27.000'} [2023-02-24 20:43:14,208][213369] DAMAGECOUNT value on done: 132303.0 [2023-02-24 20:43:14,208][213369] Sum rewards: 29.197, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.326', 'AMMO5': '0.018', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon5': '0.228', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'weapon4': '0.316', 'WEAPON5': '0.450', 'weapon2': '0.666', 'WEAPON3': '1.250', 'HITCOUNT': '2.000', 'weapon3': '2.504', 'DAMAGECOUNT': '8.979', 'FRAGCOUNT': '28.000'} [2023-02-24 20:43:14,297][213368] DAMAGECOUNT value on done: 131936.0 [2023-02-24 20:43:14,297][213368] Sum rewards: 25.437, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.825', 'AMMO2': '0.011', 'AMMO5': '0.015', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'AMMO3': '0.136', 'weapon4': '0.156', 'weapon5': '0.210', 'WEAPON5': '0.350', 'weapon2': '0.878', 'WEAPON3': '0.900', 'HITCOUNT': '1.870', 'weapon3': '2.504', 'DAMAGECOUNT': '7.575', 'FRAGCOUNT': '22.000'} [2023-02-24 20:43:14,313][213382] DAMAGECOUNT value on done: 129305.0 [2023-02-24 20:43:14,314][213382] Sum rewards: 32.642, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.761', 'AMMO2': '0.014', 'AMMO5': '0.022', 'AMMO4': '0.069', 'AMMO3': '0.144', 'weapon5': '0.364', 'WEAPON4': '0.400', 'weapon4': '0.642', 'WEAPON5': '0.650', 'weapon2': '0.664', 'WEAPON3': '0.800', 'weapon3': '1.970', 'HITCOUNT': '1.990', 'DAMAGECOUNT': '9.423', 'FRAGCOUNT': '30.000'} [2023-02-24 20:43:14,359][213383] DAMAGECOUNT value on done: 130133.0 [2023-02-24 20:43:14,359][213383] Sum rewards: 24.403, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.544', 'AMMO5': '0.020', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.233', 'weapon5': '0.290', 'WEAPON4': '0.300', 'weapon4': '0.374', 'weapon2': '0.432', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.100', 'weapon3': '2.486', 'DAMAGECOUNT': '9.249', 'FRAGCOUNT': '25.000'} [2023-02-24 20:43:14,446][213384] DAMAGECOUNT value on done: 120823.0 [2023-02-24 20:43:14,447][213384] Sum rewards: 24.274, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.232', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon5': '0.162', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.276', 'weapon2': '0.652', 'WEAPON3': '1.350', 'HITCOUNT': '2.120', 'weapon3': '2.594', 'DAMAGECOUNT': '9.078', 'FRAGCOUNT': '22.500'} [2023-02-24 20:43:14,574][213369] DAMAGECOUNT value on done: 133408.0 [2023-02-24 20:43:14,574][213369] Sum rewards: 29.092, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.662', 'WEAPON1': '0.010', 'AMMO5': '0.025', 'AMMO2': '0.047', 'AMMO3': '0.108', 'AMMO4': '0.236', 'weapon4': '0.408', 'weapon5': '0.460', 'weapon2': '0.462', 'WEAPON4': '0.500', 'WEAPON5': '0.650', 'WEAPON3': '0.650', 'HITCOUNT': '1.840', 'weapon3': '2.078', 'DAMAGECOUNT': '8.280', 'FRAGCOUNT': '26.000'} [2023-02-24 20:43:14,589][213384] DAMAGECOUNT value on done: 131739.0 [2023-02-24 20:43:14,589][213384] Sum rewards: 27.029, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.238', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.157', 'weapon5': '0.166', 'weapon4': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.768', 'WEAPON3': '1.000', 'HITCOUNT': '1.850', 'weapon3': '2.592', 'DAMAGECOUNT': '7.722', 'FRAGCOUNT': '26.000'} [2023-02-24 20:43:14,619][213368] DAMAGECOUNT value on done: 127735.0 [2023-02-24 20:43:14,619][213368] Sum rewards: 22.008, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.375', 'AMMO2': '0.012', 'AMMO5': '0.016', 'AMMO4': '0.062', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon4': '0.224', 'weapon5': '0.398', 'WEAPON5': '0.450', 'weapon2': '0.694', 'WEAPON3': '1.100', 'HITCOUNT': '1.480', 'weapon3': '2.230', 'DAMAGECOUNT': '7.392', 'FRAGCOUNT': '22.000'} [2023-02-24 20:43:14,679][213383] DAMAGECOUNT value on done: 122727.0 [2023-02-24 20:43:14,680][213383] Sum rewards: 32.415, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.686', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.167', 'AMMO4': '0.192', 'weapon5': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.378', 'weapon4': '0.734', 'WEAPON3': '1.050', 'HITCOUNT': '2.060', 'weapon3': '2.282', 'DAMAGECOUNT': '8.631', 'FRAGCOUNT': '29.000'} [2023-02-24 20:43:14,887][213369] DAMAGECOUNT value on done: 117604.0 [2023-02-24 20:43:14,887][213369] Sum rewards: 28.760, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.910', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.118', 'weapon5': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.542', 'weapon2': '0.570', 'WEAPON3': '0.700', 'HITCOUNT': '2.110', 'weapon3': '2.452', 'DAMAGECOUNT': '8.130', 'FRAGCOUNT': '24.000'} [2023-02-24 20:43:14,906][213384] DAMAGECOUNT value on done: 134301.0 [2023-02-24 20:43:14,907][213384] Sum rewards: 24.233, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.626', 'AMMO5': '0.015', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon4': '0.168', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'weapon2': '0.352', 'weapon5': '0.354', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '1.990', 'weapon3': '2.734', 'DAMAGECOUNT': '8.454', 'FRAGCOUNT': '22.500'} [2023-02-24 20:43:15,243][213332] Fps is (10 sec: 13106.9, 60 sec: 13038.9, 300 sec: 13398.8). Total num frames: 115068928. Throughput: 0: 3232.6. Samples: 3763456. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 20:43:15,244][213332] Avg episode reward: [(0, '26.880')] [2023-02-24 20:43:15,247][213352] Saving new best policy, reward=26.880! [2023-02-24 20:43:15,907][213365] Updated weights for policy 0, policy_version 28096 (0.0009) [2023-02-24 20:43:18,987][213365] Updated weights for policy 0, policy_version 28106 (0.0009) [2023-02-24 20:43:20,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13107.2, 300 sec: 13398.8). Total num frames: 115138560. Throughput: 0: 3244.8. Samples: 3773584. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 20:43:20,243][213332] Avg episode reward: [(0, '26.880')] [2023-02-24 20:43:22,038][213365] Updated weights for policy 0, policy_version 28116 (0.0009) [2023-02-24 20:43:25,133][213365] Updated weights for policy 0, policy_version 28126 (0.0009) [2023-02-24 20:43:25,243][213332] Fps is (10 sec: 13517.1, 60 sec: 13038.9, 300 sec: 13398.8). Total num frames: 115204096. Throughput: 0: 3251.8. Samples: 3793536. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 20:43:25,243][213332] Avg episode reward: [(0, '26.880')] [2023-02-24 20:43:28,138][213365] Updated weights for policy 0, policy_version 28136 (0.0009) [2023-02-24 20:43:30,243][213332] Fps is (10 sec: 13107.2, 60 sec: 13038.9, 300 sec: 13384.9). Total num frames: 115269632. Throughput: 0: 3287.2. Samples: 3813668. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 20:43:30,243][213332] Avg episode reward: [(0, '26.880')] [2023-02-24 20:43:31,145][213365] Updated weights for policy 0, policy_version 28146 (0.0009) [2023-02-24 20:43:32,237][213367] DAMAGECOUNT value on done: 130958.0 [2023-02-24 20:43:32,238][213367] Sum rewards: 22.404, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.372', 'AMMO5': '0.017', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon4': '0.230', 'AMMO3': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.394', 'weapon5': '0.402', 'WEAPON3': '1.200', 'HITCOUNT': '1.810', 'weapon3': '2.624', 'DAMAGECOUNT': '8.226', 'FRAGCOUNT': '25.000'} [2023-02-24 20:43:32,548][213367] DAMAGECOUNT value on done: 131389.0 [2023-02-24 20:43:32,548][213367] Sum rewards: 15.834, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.335', 'AMMO5': '0.017', 'AMMO2': '0.023', 'AMMO3': '0.040', 'AMMO4': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.130', 'WEAPON7': '0.200', 'weapon5': '0.296', 'WEAPON3': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.520', 'HITCOUNT': '0.820', 'weapon3': '0.860', 'weapon2': '1.014', 'DAMAGECOUNT': '4.596', 'FRAGCOUNT': '13.000'} [2023-02-24 20:43:32,635][213372] DAMAGECOUNT value on done: 132219.0 [2023-02-24 20:43:32,636][213372] Sum rewards: 31.557, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.574', 'AMMO5': '0.019', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.162', 'weapon5': '0.168', 'weapon4': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.734', 'WEAPON3': '0.950', 'HITCOUNT': '2.130', 'weapon3': '2.492', 'DAMAGECOUNT': '8.799', 'FRAGCOUNT': '29.000'} [2023-02-24 20:43:32,760][213366] DAMAGECOUNT value on done: 126753.0 [2023-02-24 20:43:32,760][213366] Sum rewards: 25.105, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.604', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon7': '0.052', 'weapon5': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'weapon2': '0.384', 'weapon4': '0.588', 'WEAPON3': '1.350', 'HITCOUNT': '2.060', 'weapon3': '2.522', 'DAMAGECOUNT': '7.500', 'FRAGCOUNT': '25.000'} [2023-02-24 20:43:32,865][213367] DAMAGECOUNT value on done: 133251.0 [2023-02-24 20:43:32,865][213367] Sum rewards: 30.308, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.017', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'weapon7': '0.046', 'AMMO4': '0.069', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.162', 'AMMO3': '0.175', 'WEAPON5': '0.250', 'weapon4': '0.526', 'weapon2': '1.016', 'WEAPON3': '1.100', 'weapon3': '1.888', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '9.312', 'FRAGCOUNT': '27.000'} [2023-02-24 20:43:32,953][213372] DAMAGECOUNT value on done: 132840.0 [2023-02-24 20:43:32,953][213372] Sum rewards: 32.748, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.080', 'AMMO5': '0.012', 'AMMO2': '0.017', 'weapon7': '0.018', 'AMMO4': '0.085', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.188', 'AMMO3': '0.205', 'weapon4': '0.324', 'WEAPON5': '0.350', 'weapon2': '0.356', 'WEAPON3': '1.350', 'HITCOUNT': '2.200', 'weapon3': '2.846', 'DAMAGECOUNT': '9.426', 'FRAGCOUNT': '30.000'} [2023-02-24 20:43:33,076][213366] DAMAGECOUNT value on done: 138673.0 [2023-02-24 20:43:33,076][213366] Sum rewards: 32.361, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.750', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'WEAPON5': '0.250', 'weapon5': '0.330', 'weapon4': '0.370', 'weapon2': '0.584', 'WEAPON3': '0.850', 'HITCOUNT': '1.990', 'weapon3': '2.232', 'DAMAGECOUNT': '9.144', 'FRAGCOUNT': '26.000'} [2023-02-24 20:43:33,178][213367] DAMAGECOUNT value on done: 129774.0 [2023-02-24 20:43:33,178][213367] Sum rewards: 33.017, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.385', 'AMMO5': '0.020', 'AMMO2': '0.050', 'AMMO3': '0.123', 'AMMO4': '0.249', 'weapon5': '0.356', 'WEAPON5': '0.500', 'weapon2': '0.532', 'WEAPON4': '0.650', 'weapon4': '0.708', 'WEAPON3': '0.750', 'weapon3': '2.050', 'HITCOUNT': '2.140', 'DAMAGECOUNT': '9.774', 'FRAGCOUNT': '30.000'} [2023-02-24 20:43:33,360][213366] DAMAGECOUNT value on done: 135249.0 [2023-02-24 20:43:33,361][213366] Sum rewards: 24.614, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.638', 'AMMO5': '0.021', 'AMMO2': '0.062', 'AMMO3': '0.197', 'AMMO4': '0.309', 'weapon5': '0.358', 'weapon2': '0.360', 'weapon4': '0.502', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'HITCOUNT': '2.020', 'weapon3': '2.398', 'DAMAGECOUNT': '8.874', 'FRAGCOUNT': '27.000'} [2023-02-24 20:43:33,425][213372] DAMAGECOUNT value on done: 132638.0 [2023-02-24 20:43:33,425][213372] Sum rewards: 21.575, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.871', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.143', 'weapon5': '0.284', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.686', 'weapon2': '0.814', 'WEAPON3': '0.900', 'weapon3': '1.786', 'HITCOUNT': '1.830', 'DAMAGECOUNT': '7.242', 'FRAGCOUNT': '20.000'} [2023-02-24 20:43:33,439][213382] DAMAGECOUNT value on done: 126929.0 [2023-02-24 20:43:33,439][213382] Sum rewards: 29.711, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.887', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO3': '0.161', 'AMMO4': '0.164', 'WEAPON5': '0.250', 'weapon4': '0.258', 'weapon5': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.600', 'WEAPON3': '0.900', 'HITCOUNT': '2.030', 'weapon3': '2.514', 'DAMAGECOUNT': '8.610', 'FRAGCOUNT': '28.000'} [2023-02-24 20:43:33,549][213383] DAMAGECOUNT value on done: 132037.0 [2023-02-24 20:43:33,550][213383] Sum rewards: 21.768, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.900', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.055', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.159', 'weapon5': '0.194', 'AMMO4': '0.277', 'weapon2': '0.478', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.746', 'WEAPON3': '1.000', 'HITCOUNT': '1.940', 'weapon3': '2.044', 'DAMAGECOUNT': '7.335', 'FRAGCOUNT': '24.000'} [2023-02-24 20:43:33,672][213366] DAMAGECOUNT value on done: 131956.0 [2023-02-24 20:43:33,672][213366] Sum rewards: 17.535, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.056', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.071', 'AMMO3': '0.211', 'weapon5': '0.314', 'AMMO4': '0.354', 'weapon2': '0.434', 'WEAPON5': '0.550', 'weapon4': '0.718', 'WEAPON4': '0.800', 'WEAPON3': '1.200', 'weapon3': '2.006', 'HITCOUNT': '2.040', 'DAMAGECOUNT': '7.866', 'FRAGCOUNT': '22.000'} [2023-02-24 20:43:33,684][213368] DAMAGECOUNT value on done: 126774.0 [2023-02-24 20:43:33,684][213368] Sum rewards: 19.546, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.894', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.027', 'weapon7': '0.054', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.123', 'AMMO4': '0.132', 'WEAPON7': '0.200', 'weapon2': '0.306', 'weapon5': '0.370', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.650', 'weapon4': '0.928', 'HITCOUNT': '1.440', 'weapon3': '1.586', 'DAMAGECOUNT': '6.765', 'FRAGCOUNT': '18.000'} [2023-02-24 20:43:33,746][213372] DAMAGECOUNT value on done: 129826.0 [2023-02-24 20:43:33,746][213372] Sum rewards: 14.512, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.340', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO3': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.128', 'AMMO4': '0.157', 'WEAPON7': '0.200', 'weapon5': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.406', 'weapon4': '0.428', 'WEAPON3': '0.600', 'HITCOUNT': '1.070', 'weapon3': '1.922', 'DAMAGECOUNT': '4.449', 'FRAGCOUNT': '14.000'} [2023-02-24 20:43:33,749][213382] DAMAGECOUNT value on done: 133329.0 [2023-02-24 20:43:33,749][213382] Sum rewards: 22.838, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.042', 'ARMOR': '0.004', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'weapon7': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.135', 'weapon2': '0.160', 'WEAPON5': '0.200', 'weapon5': '0.224', 'WEAPON4': '0.400', 'WEAPON3': '0.800', 'weapon4': '0.968', 'weapon3': '1.620', 'HITCOUNT': '1.620', 'DAMAGECOUNT': '6.720', 'FRAGCOUNT': '21.000'} [2023-02-24 20:43:33,876][213383] DAMAGECOUNT value on done: 137103.0 [2023-02-24 20:43:33,877][213383] Sum rewards: 31.469, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.358', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.158', 'AMMO4': '0.175', 'weapon5': '0.224', 'weapon2': '0.252', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.666', 'WEAPON3': '1.000', 'HITCOUNT': '1.900', 'weapon3': '2.004', 'DAMAGECOUNT': '8.898', 'FRAGCOUNT': '28.500'} [2023-02-24 20:43:33,986][213369] DAMAGECOUNT value on done: 135007.0 [2023-02-24 20:43:33,987][213369] Sum rewards: 25.868, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.987', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.149', 'weapon5': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.476', 'weapon2': '0.834', 'WEAPON3': '0.950', 'HITCOUNT': '1.760', 'weapon3': '2.154', 'DAMAGECOUNT': '7.164', 'FRAGCOUNT': '23.000'} [2023-02-24 20:43:34,031][213368] DAMAGECOUNT value on done: 132265.0 [2023-02-24 20:43:34,031][213368] Sum rewards: 25.087, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.548', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.106', 'AMMO3': '0.123', 'AMMO4': '0.164', 'weapon5': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'weapon2': '0.920', 'HITCOUNT': '1.740', 'weapon3': '2.260', 'DAMAGECOUNT': '7.932', 'FRAGCOUNT': '22.000'} [2023-02-24 20:43:34,091][213382] DAMAGECOUNT value on done: 126564.0 [2023-02-24 20:43:34,092][213382] Sum rewards: 31.453, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.235', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon7': '0.052', 'AMMO4': '0.073', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.119', 'weapon5': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.226', 'WEAPON4': '0.250', 'weapon4': '0.726', 'WEAPON3': '0.850', 'weapon3': '1.628', 'HITCOUNT': '2.180', 'DAMAGECOUNT': '8.373', 'FRAGCOUNT': '26.000'} [2023-02-24 20:43:34,221][213384] DAMAGECOUNT value on done: 133021.0 [2023-02-24 20:43:34,221][213384] Sum rewards: 27.145, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.840', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.014', 'WEAPON4': '0.050', 'weapon5': '0.166', 'AMMO3': '0.168', 'weapon4': '0.246', 'WEAPON5': '0.250', 'weapon2': '0.660', 'WEAPON3': '1.050', 'HITCOUNT': '1.710', 'weapon3': '2.584', 'DAMAGECOUNT': '7.077', 'FRAGCOUNT': '24.500'} [2023-02-24 20:43:34,275][213365] Updated weights for policy 0, policy_version 28156 (0.0009) [2023-02-24 20:43:34,315][213369] DAMAGECOUNT value on done: 134362.0 [2023-02-24 20:43:34,316][213369] Sum rewards: 16.228, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.895', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.338', 'weapon4': '0.344', 'WEAPON3': '1.300', 'HITCOUNT': '1.700', 'weapon3': '2.540', 'DAMAGECOUNT': '6.177', 'FRAGCOUNT': '17.500'} [2023-02-24 20:43:34,335][213368] DAMAGECOUNT value on done: 134542.0 [2023-02-24 20:43:34,336][213368] Sum rewards: 18.253, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.638', 'AMMO5': '0.025', 'AMMO2': '0.070', 'AMMO3': '0.145', 'weapon5': '0.268', 'weapon2': '0.310', 'AMMO4': '0.352', 'ARMOR': '0.412', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'WEAPON4': '0.850', 'weapon4': '1.078', 'HITCOUNT': '1.630', 'weapon3': '1.632', 'DAMAGECOUNT': '7.818', 'FRAGCOUNT': '20.500'} [2023-02-24 20:43:34,414][213382] DAMAGECOUNT value on done: 132298.0 [2023-02-24 20:43:34,415][213382] Sum rewards: 26.488, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.844', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.102', 'weapon5': '0.194', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.312', 'WEAPON5': '0.350', 'weapon2': '0.648', 'WEAPON3': '1.250', 'HITCOUNT': '1.980', 'weapon3': '2.400', 'DAMAGECOUNT': '8.979', 'FRAGCOUNT': '27.000'} [2023-02-24 20:43:34,512][213383] DAMAGECOUNT value on done: 133643.0 [2023-02-24 20:43:34,512][213383] Sum rewards: 38.093, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.507', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.024', 'weapon4': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.152', 'AMMO3': '0.170', 'weapon2': '0.358', 'WEAPON3': '1.050', 'HITCOUNT': '2.200', 'weapon3': '3.170', 'DAMAGECOUNT': '10.530', 'FRAGCOUNT': '32.000'} [2023-02-24 20:43:34,531][213384] DAMAGECOUNT value on done: 123451.0 [2023-02-24 20:43:34,532][213384] Sum rewards: 29.163, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.660', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.013', 'weapon7': '0.050', 'AMMO4': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'weapon5': '0.218', 'WEAPON4': '0.250', 'weapon4': '0.490', 'weapon2': '0.630', 'WEAPON3': '0.950', 'HITCOUNT': '1.800', 'weapon3': '2.306', 'DAMAGECOUNT': '7.884', 'FRAGCOUNT': '26.000'} [2023-02-24 20:43:34,646][213368] DAMAGECOUNT value on done: 130999.0 [2023-02-24 20:43:34,647][213368] Sum rewards: 36.770, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.280', 'weapon4': '0.002', 'AMMO5': '0.011', 'AMMO2': '0.013', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.176', 'weapon5': '0.226', 'WEAPON5': '0.350', 'weapon2': '0.568', 'WEAPON3': '1.050', 'HITCOUNT': '2.100', 'weapon3': '2.848', 'DAMAGECOUNT': '9.792', 'FRAGCOUNT': '32.000'} [2023-02-24 20:43:34,689][213369] DAMAGECOUNT value on done: 136312.0 [2023-02-24 20:43:34,689][213369] Sum rewards: 26.072, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.780', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO3': '0.129', 'AMMO4': '0.129', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon5': '0.480', 'weapon4': '0.668', 'weapon2': '0.676', 'WEAPON3': '0.750', 'weapon3': '1.822', 'HITCOUNT': '2.060', 'DAMAGECOUNT': '8.697', 'FRAGCOUNT': '25.000'} [2023-02-24 20:43:34,691][213384] DAMAGECOUNT value on done: 135149.0 [2023-02-24 20:43:34,691][213384] Sum rewards: 35.704, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.361', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.138', 'weapon2': '0.246', 'weapon5': '0.276', 'WEAPON5': '0.450', 'WEAPON4': '0.700', 'WEAPON3': '0.900', 'weapon4': '1.160', 'weapon3': '1.866', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '10.230', 'FRAGCOUNT': '34.000'} [2023-02-24 20:43:34,821][213383] DAMAGECOUNT value on done: 125989.0 [2023-02-24 20:43:34,822][213383] Sum rewards: 34.726, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.929', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.038', 'AMMO3': '0.099', 'AMMO4': '0.192', 'weapon5': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '0.650', 'weapon2': '0.754', 'weapon4': '0.864', 'weapon3': '1.818', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '9.786', 'FRAGCOUNT': '28.500'} [2023-02-24 20:43:34,990][213384] DAMAGECOUNT value on done: 137196.0 [2023-02-24 20:43:34,991][213384] Sum rewards: 28.978, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.042', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'weapon4': '0.018', 'AMMO5': '0.024', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'AMMO3': '0.190', 'weapon5': '0.394', 'weapon2': '0.548', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'HITCOUNT': '1.800', 'weapon3': '2.656', 'DAMAGECOUNT': '8.685', 'FRAGCOUNT': '27.500'} [2023-02-24 20:43:34,995][213369] DAMAGECOUNT value on done: 121424.0 [2023-02-24 20:43:34,996][213369] Sum rewards: 39.986, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.705', 'AMMO2': '0.009', 'AMMO5': '0.012', 'weapon4': '0.044', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'weapon5': '0.264', 'weapon2': '0.304', 'WEAPON3': '1.450', 'HITCOUNT': '2.720', 'weapon3': '3.058', 'DAMAGECOUNT': '11.460', 'FRAGCOUNT': '37.000'} [2023-02-24 20:43:35,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13107.2, 300 sec: 13398.8). Total num frames: 115339264. Throughput: 0: 3296.2. Samples: 3823902. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 20:43:35,243][213332] Avg episode reward: [(0, '27.487')] [2023-02-24 20:43:35,247][213352] Saving new best policy, reward=27.487! [2023-02-24 20:43:37,257][213365] Updated weights for policy 0, policy_version 28166 (0.0009) [2023-02-24 20:43:37,904][213366] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 20:43:40,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13107.2, 300 sec: 13384.9). Total num frames: 115404800. Throughput: 0: 3354.0. Samples: 3843964. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 20:43:40,243][213332] Avg episode reward: [(0, '27.487')] [2023-02-24 20:43:40,323][213365] Updated weights for policy 0, policy_version 28176 (0.0009) [2023-02-24 20:43:43,368][213365] Updated weights for policy 0, policy_version 28186 (0.0009) [2023-02-24 20:43:44,955][213382] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 20:43:45,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13243.8, 300 sec: 13398.8). Total num frames: 115474432. Throughput: 0: 3353.8. Samples: 3864090. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 20:43:45,243][213332] Avg episode reward: [(0, '27.487')] [2023-02-24 20:43:46,385][213365] Updated weights for policy 0, policy_version 28196 (0.0008) [2023-02-24 20:43:49,500][213365] Updated weights for policy 0, policy_version 28206 (0.0009) [2023-02-24 20:43:50,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13243.7, 300 sec: 13384.9). Total num frames: 115539968. Throughput: 0: 3355.1. Samples: 3874368. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:43:50,243][213332] Avg episode reward: [(0, '27.487')] [2023-02-24 20:43:52,222][213367] DAMAGECOUNT value on done: 133646.0 [2023-02-24 20:43:52,222][213367] Sum rewards: 28.542, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.810', 'AMMO5': '0.014', 'AMMO2': '0.021', 'weapon7': '0.070', 'AMMO4': '0.107', 'AMMO3': '0.136', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.302', 'weapon4': '0.398', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'weapon2': '1.042', 'HITCOUNT': '1.830', 'weapon3': '1.898', 'DAMAGECOUNT': '8.064', 'FRAGCOUNT': '25.000'} [2023-02-24 20:43:52,491][213365] Updated weights for policy 0, policy_version 28216 (0.0009) [2023-02-24 20:43:52,541][213367] DAMAGECOUNT value on done: 134461.0 [2023-02-24 20:43:52,542][213367] Sum rewards: 27.491, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.315', 'AMMO5': '0.010', 'AMMO2': '0.043', 'AMMO3': '0.123', 'AMMO4': '0.216', 'WEAPON5': '0.250', 'weapon5': '0.362', 'weapon2': '0.368', 'WEAPON4': '0.550', 'WEAPON3': '0.800', 'weapon4': '1.058', 'weapon3': '1.930', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '9.216', 'FRAGCOUNT': '25.000'} [2023-02-24 20:43:52,583][213372] DAMAGECOUNT value on done: 134822.0 [2023-02-24 20:43:52,584][213372] Sum rewards: 28.218, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.657', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'AMMO3': '0.103', 'AMMO4': '0.174', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.330', 'weapon5': '0.332', 'WEAPON3': '0.750', 'weapon2': '0.828', 'HITCOUNT': '1.600', 'weapon3': '1.782', 'DAMAGECOUNT': '7.809', 'FRAGCOUNT': '26.000'} [2023-02-24 20:43:52,747][213366] DAMAGECOUNT value on done: 129447.0 [2023-02-24 20:43:52,748][213366] Sum rewards: 29.706, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.132', 'ARMOR': '0.004', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'AMMO3': '0.115', 'weapon5': '0.130', 'AMMO4': '0.173', 'WEAPON5': '0.300', 'weapon4': '0.392', 'WEAPON4': '0.450', 'weapon2': '0.660', 'WEAPON3': '0.800', 'HITCOUNT': '2.070', 'weapon3': '2.094', 'DAMAGECOUNT': '8.082', 'FRAGCOUNT': '27.000'} [2023-02-24 20:43:52,875][213367] DAMAGECOUNT value on done: 135727.0 [2023-02-24 20:43:52,876][213367] Sum rewards: 21.045, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.618', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.160', 'weapon5': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.488', 'weapon2': '0.928', 'WEAPON3': '1.000', 'HITCOUNT': '1.710', 'weapon3': '2.198', 'DAMAGECOUNT': '7.428', 'FRAGCOUNT': '20.000'} [2023-02-24 20:43:52,902][213372] DAMAGECOUNT value on done: 136301.0 [2023-02-24 20:43:52,902][213372] Sum rewards: 39.896, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.050', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.072', 'AMMO3': '0.116', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.400', 'weapon2': '0.606', 'WEAPON3': '0.750', 'weapon3': '2.426', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '10.383', 'FRAGCOUNT': '31.000'} [2023-02-24 20:43:53,068][213366] DAMAGECOUNT value on done: 142224.0 [2023-02-24 20:43:53,069][213366] Sum rewards: 34.907, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.811', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.050', 'AMMO3': '0.127', 'AMMO4': '0.249', 'weapon5': '0.300', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.820', 'WEAPON3': '0.850', 'weapon2': '0.878', 'weapon3': '1.566', 'HITCOUNT': '2.400', 'DAMAGECOUNT': '10.653', 'FRAGCOUNT': '30.500'} [2023-02-24 20:43:53,190][213367] DAMAGECOUNT value on done: 131464.0 [2023-02-24 20:43:53,191][213367] Sum rewards: 12.017, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.205', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon7': '0.056', 'AMMO3': '0.093', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.140', 'AMMO4': '0.199', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.370', 'WEAPON4': '0.550', 'WEAPON3': '0.700', 'weapon4': '0.768', 'HITCOUNT': '0.990', 'weapon3': '1.296', 'DAMAGECOUNT': '5.070', 'FRAGCOUNT': '14.000'} [2023-02-24 20:43:53,356][213366] DAMAGECOUNT value on done: 138147.0 [2023-02-24 20:43:53,356][213366] Sum rewards: 31.057, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.858', 'AMMO5': '0.007', 'AMMO2': '0.030', 'AMMO3': '0.143', 'AMMO4': '0.147', 'WEAPON5': '0.200', 'weapon5': '0.206', 'WEAPON4': '0.250', 'weapon4': '0.476', 'weapon2': '0.842', 'WEAPON3': '0.900', 'HITCOUNT': '2.050', 'weapon3': '2.220', 'DAMAGECOUNT': '8.694', 'FRAGCOUNT': '27.000'} [2023-02-24 20:43:53,357][213372] DAMAGECOUNT value on done: 135048.0 [2023-02-24 20:43:53,358][213372] Sum rewards: 23.447, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.380', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon7': '0.052', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.140', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.682', 'WEAPON3': '0.700', 'weapon2': '0.786', 'weapon3': '1.916', 'HITCOUNT': '1.940', 'DAMAGECOUNT': '7.230', 'FRAGCOUNT': '20.000'} [2023-02-24 20:43:53,416][213382] DAMAGECOUNT value on done: 129839.0 [2023-02-24 20:43:53,417][213382] Sum rewards: 26.546, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.480', 'AMMO2': '0.011', 'AMMO5': '0.020', 'AMMO4': '0.053', 'weapon4': '0.070', 'weapon5': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'WEAPON5': '0.400', 'weapon2': '1.004', 'WEAPON3': '1.200', 'HITCOUNT': '2.020', 'weapon3': '2.338', 'DAMAGECOUNT': '8.730', 'FRAGCOUNT': '25.500'} [2023-02-24 20:43:53,540][213383] DAMAGECOUNT value on done: 134955.0 [2023-02-24 20:43:53,540][213383] Sum rewards: 29.216, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.888', 'AMMO2': '0.009', 'weapon4': '0.010', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'weapon2': '0.146', 'AMMO3': '0.232', 'weapon5': '0.262', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.330', 'weapon3': '3.078', 'DAMAGECOUNT': '8.754', 'FRAGCOUNT': '28.500'} [2023-02-24 20:43:53,581][213368] DAMAGECOUNT value on done: 130262.0 [2023-02-24 20:43:53,581][213368] Sum rewards: 32.769, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.952', 'AMMO5': '0.026', 'WEAPON1': '0.030', 'AMMO2': '0.060', 'AMMO3': '0.173', 'weapon2': '0.252', 'weapon4': '0.262', 'AMMO4': '0.298', 'weapon5': '0.462', 'WEAPON4': '0.500', 'WEAPON5': '0.650', 'WEAPON3': '1.050', 'HITCOUNT': '2.070', 'weapon3': '2.630', 'DAMAGECOUNT': '10.008', 'FRAGCOUNT': '30.500'} [2023-02-24 20:43:53,671][213366] DAMAGECOUNT value on done: 134311.0 [2023-02-24 20:43:53,672][213366] Sum rewards: 18.682, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.805', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.050', 'AMMO3': '0.115', 'weapon5': '0.222', 'AMMO4': '0.252', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon2': '0.622', 'WEAPON3': '0.650', 'weapon4': '1.076', 'weapon3': '1.628', 'HITCOUNT': '1.890', 'DAMAGECOUNT': '7.065', 'FRAGCOUNT': '17.000'} [2023-02-24 20:43:53,674][213372] DAMAGECOUNT value on done: 132247.0 [2023-02-24 20:43:53,675][213372] Sum rewards: 27.614, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.996', 'AMMO2': '0.017', 'AMMO5': '0.023', 'AMMO4': '0.083', 'AMMO3': '0.118', 'weapon5': '0.316', 'WEAPON4': '0.350', 'weapon4': '0.352', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'weapon2': '0.864', 'HITCOUNT': '1.630', 'weapon3': '2.044', 'DAMAGECOUNT': '7.263', 'FRAGCOUNT': '25.000'} [2023-02-24 20:43:53,738][213382] DAMAGECOUNT value on done: 136425.0 [2023-02-24 20:43:53,738][213382] Sum rewards: 27.584, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.828', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.138', 'AMMO3': '0.161', 'WEAPON5': '0.200', 'weapon5': '0.202', 'WEAPON4': '0.350', 'weapon4': '0.358', 'weapon2': '0.474', 'WEAPON3': '1.000', 'HITCOUNT': '1.940', 'weapon3': '2.760', 'DAMAGECOUNT': '9.288', 'FRAGCOUNT': '25.000'} [2023-02-24 20:43:53,850][213383] DAMAGECOUNT value on done: 140399.0 [2023-02-24 20:43:53,851][213383] Sum rewards: 38.835, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.086', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.108', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.176', 'WEAPON3': '0.800', 'weapon2': '1.118', 'HITCOUNT': '2.130', 'weapon3': '2.186', 'DAMAGECOUNT': '9.858', 'FRAGCOUNT': '31.000'} [2023-02-24 20:43:53,902][213368] DAMAGECOUNT value on done: 135043.0 [2023-02-24 20:43:53,902][213368] Sum rewards: 29.425, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.280', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon7': '0.048', 'weapon5': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'weapon2': '0.504', 'weapon4': '0.618', 'WEAPON3': '1.000', 'HITCOUNT': '1.870', 'weapon3': '1.938', 'DAMAGECOUNT': '8.334', 'FRAGCOUNT': '26.000'} [2023-02-24 20:43:53,941][213369] DAMAGECOUNT value on done: 137928.0 [2023-02-24 20:43:53,941][213369] Sum rewards: 35.975, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.570', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.148', 'WEAPON5': '0.250', 'weapon5': '0.336', 'WEAPON4': '0.400', 'weapon2': '0.512', 'weapon4': '0.696', 'WEAPON3': '0.850', 'weapon3': '1.968', 'HITCOUNT': '2.190', 'DAMAGECOUNT': '8.763', 'FRAGCOUNT': '33.000'} [2023-02-24 20:43:54,045][213382] DAMAGECOUNT value on done: 129475.0 [2023-02-24 20:43:54,046][213382] Sum rewards: 26.534, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.568', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'weapon4': '0.090', 'AMMO4': '0.178', 'weapon5': '0.200', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.488', 'WEAPON3': '1.350', 'HITCOUNT': '1.760', 'weapon3': '2.764', 'DAMAGECOUNT': '8.733', 'FRAGCOUNT': '27.500'} [2023-02-24 20:43:54,197][213368] DAMAGECOUNT value on done: 137319.0 [2023-02-24 20:43:54,198][213368] Sum rewards: 38.129, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.016', 'weapon4': '0.032', 'AMMO2': '0.036', 'WEAPON1': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'AMMO4': '0.182', 'weapon5': '0.338', 'WEAPON5': '0.450', 'HEALTH': '0.554', 'WEAPON3': '0.600', 'weapon2': '1.030', 'HITCOUNT': '1.690', 'weapon3': '2.122', 'DAMAGECOUNT': '8.331', 'FRAGCOUNT': '30.000'} [2023-02-24 20:43:54,253][213384] DAMAGECOUNT value on done: 135938.0 [2023-02-24 20:43:54,253][213384] Sum rewards: 32.453, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.124', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.104', 'AMMO3': '0.119', 'AMMO4': '0.122', 'weapon5': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.698', 'WEAPON3': '0.750', 'HITCOUNT': '2.050', 'weapon3': '2.716', 'DAMAGECOUNT': '8.751', 'FRAGCOUNT': '27.000'} [2023-02-24 20:43:54,254][213369] DAMAGECOUNT value on done: 137916.0 [2023-02-24 20:43:54,255][213369] Sum rewards: 35.707, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.452', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.052', 'weapon7': '0.086', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.167', 'AMMO4': '0.262', 'weapon5': '0.266', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.640', 'weapon4': '0.988', 'WEAPON3': '1.050', 'weapon3': '1.534', 'HITCOUNT': '2.180', 'DAMAGECOUNT': '10.662', 'FRAGCOUNT': '31.000'} [2023-02-24 20:43:54,359][213382] DAMAGECOUNT value on done: 134687.0 [2023-02-24 20:43:54,360][213382] Sum rewards: 19.873, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.822', 'AMMO5': '0.023', 'AMMO2': '0.037', 'WEAPON1': '0.040', 'AMMO3': '0.167', 'AMMO4': '0.186', 'weapon5': '0.384', 'weapon4': '0.414', 'WEAPON4': '0.450', 'WEAPON5': '0.600', 'weapon2': '0.854', 'WEAPON3': '1.000', 'HITCOUNT': '1.570', 'weapon3': '1.802', 'DAMAGECOUNT': '7.167', 'FRAGCOUNT': '20.500'} [2023-02-24 20:43:54,470][213383] DAMAGECOUNT value on done: 135629.0 [2023-02-24 20:43:54,470][213383] Sum rewards: 23.122, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.401', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'weapon4': '0.068', 'AMMO4': '0.090', 'AMMO3': '0.099', 'weapon5': '0.294', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'weapon2': '1.272', 'HITCOUNT': '1.500', 'weapon3': '2.156', 'DAMAGECOUNT': '5.913', 'FRAGCOUNT': '19.500'} [2023-02-24 20:43:54,515][213368] DAMAGECOUNT value on done: 131502.0 [2023-02-24 20:43:54,516][213368] Sum rewards: 5.912, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.092', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.003', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'weapon2': '0.026', 'AMMO3': '0.030', 'WEAPON5': '0.050', 'weapon7': '0.052', 'weapon5': '0.098', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON3': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.300', 'weapon3': '0.320', 'weapon4': '0.412', 'DAMAGECOUNT': '1.509', 'FRAGCOUNT': '4.000'} [2023-02-24 20:43:54,581][213384] DAMAGECOUNT value on done: 126335.0 [2023-02-24 20:43:54,582][213384] Sum rewards: 30.174, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.590', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.106', 'AMMO3': '0.129', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.352', 'ARMOR': '0.456', 'weapon2': '0.638', 'WEAPON3': '0.950', 'HITCOUNT': '1.980', 'weapon3': '2.726', 'DAMAGECOUNT': '8.652', 'FRAGCOUNT': '26.000'} [2023-02-24 20:43:54,626][213369] DAMAGECOUNT value on done: 139248.0 [2023-02-24 20:43:54,627][213369] Sum rewards: 26.338, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.024', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.051', 'AMMO3': '0.189', 'AMMO4': '0.255', 'weapon4': '0.278', 'weapon5': '0.376', 'WEAPON4': '0.450', 'weapon2': '0.578', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'HITCOUNT': '1.910', 'weapon3': '2.434', 'DAMAGECOUNT': '8.808', 'FRAGCOUNT': '27.000'} [2023-02-24 20:43:54,747][213384] DAMAGECOUNT value on done: 137870.0 [2023-02-24 20:43:54,747][213384] Sum rewards: 21.238, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.654', 'WEAPON1': '0.010', 'weapon4': '0.014', 'AMMO5': '0.015', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.222', 'weapon5': '0.252', 'WEAPON5': '0.350', 'weapon2': '0.790', 'WEAPON3': '1.400', 'HITCOUNT': '1.830', 'weapon3': '2.626', 'DAMAGECOUNT': '8.154', 'FRAGCOUNT': '23.000'} [2023-02-24 20:43:54,783][213383] DAMAGECOUNT value on done: 128176.0 [2023-02-24 20:43:54,784][213383] Sum rewards: 24.981, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.443', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO3': '0.104', 'weapon5': '0.130', 'AMMO4': '0.206', 'weapon4': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'weapon2': '1.252', 'HITCOUNT': '1.610', 'weapon3': '1.884', 'DAMAGECOUNT': '6.561', 'FRAGCOUNT': '22.000'} [2023-02-24 20:43:54,937][213369] DAMAGECOUNT value on done: 124260.0 [2023-02-24 20:43:54,938][213369] Sum rewards: 30.264, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.485', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon4': '0.072', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'weapon5': '0.110', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.558', 'WEAPON3': '1.200', 'HITCOUNT': '1.900', 'weapon3': '2.958', 'DAMAGECOUNT': '8.508', 'FRAGCOUNT': '27.000'} [2023-02-24 20:43:55,046][213384] DAMAGECOUNT value on done: 140092.0 [2023-02-24 20:43:55,047][213384] Sum rewards: 26.672, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.244', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'weapon5': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.224', 'weapon2': '0.550', 'WEAPON3': '1.400', 'HITCOUNT': '2.060', 'weapon3': '2.878', 'DAMAGECOUNT': '8.688', 'FRAGCOUNT': '26.000'} [2023-02-24 20:43:55,243][213332] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13371.0). Total num frames: 115605504. Throughput: 0: 3353.2. Samples: 3894444. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:43:55,244][213332] Avg episode reward: [(0, '27.337')] [2023-02-24 20:43:55,616][213365] Updated weights for policy 0, policy_version 28226 (0.0008) [2023-02-24 20:43:58,626][213365] Updated weights for policy 0, policy_version 28236 (0.0009) [2023-02-24 20:44:00,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 115675136. Throughput: 0: 3357.8. Samples: 3914558. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:44:00,243][213332] Avg episode reward: [(0, '27.337')] [2023-02-24 20:44:01,621][213365] Updated weights for policy 0, policy_version 28246 (0.0009) [2023-02-24 20:44:03,926][213384] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 20:44:04,735][213365] Updated weights for policy 0, policy_version 28256 (0.0009) [2023-02-24 20:44:05,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13371.0). Total num frames: 115740672. Throughput: 0: 3362.7. Samples: 3924904. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 20:44:05,243][213332] Avg episode reward: [(0, '27.337')] [2023-02-24 20:44:07,727][213365] Updated weights for policy 0, policy_version 28266 (0.0009) [2023-02-24 20:44:10,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13371.0). Total num frames: 115810304. Throughput: 0: 3364.6. Samples: 3944942. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 20:44:10,243][213332] Avg episode reward: [(0, '27.337')] [2023-02-24 20:44:10,807][213365] Updated weights for policy 0, policy_version 28276 (0.0009) [2023-02-24 20:44:12,302][213367] DAMAGECOUNT value on done: 136635.0 [2023-02-24 20:44:12,303][213367] Sum rewards: 32.294, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.187', 'ARMOR': '0.004', 'AMMO2': '0.014', 'AMMO5': '0.015', 'weapon5': '0.028', 'WEAPON4': '0.050', 'AMMO4': '0.070', 'AMMO3': '0.131', 'WEAPON5': '0.150', 'weapon4': '0.156', 'WEAPON3': '0.850', 'weapon2': '1.062', 'HITCOUNT': '2.420', 'weapon3': '2.564', 'DAMAGECOUNT': '8.967', 'FRAGCOUNT': '25.000'} [2023-02-24 20:44:12,620][213372] DAMAGECOUNT value on done: 137795.0 [2023-02-24 20:44:12,620][213372] Sum rewards: 32.965, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.902', 'AMMO5': '0.011', 'AMMO2': '0.019', 'weapon4': '0.058', 'AMMO4': '0.094', 'weapon5': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'WEAPON5': '0.250', 'weapon2': '0.866', 'WEAPON3': '1.000', 'HITCOUNT': '2.270', 'weapon3': '2.668', 'DAMAGECOUNT': '8.688', 'FRAGCOUNT': '30.500'} [2023-02-24 20:44:12,635][213367] DAMAGECOUNT value on done: 137734.0 [2023-02-24 20:44:12,636][213367] Sum rewards: 35.559, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.380', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.176', 'AMMO3': '0.195', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.416', 'weapon2': '0.764', 'WEAPON3': '1.300', 'HITCOUNT': '2.270', 'weapon3': '2.372', 'DAMAGECOUNT': '9.819', 'FRAGCOUNT': '35.000'} [2023-02-24 20:44:12,821][213366] DAMAGECOUNT value on done: 132330.0 [2023-02-24 20:44:12,821][213366] Sum rewards: 31.648, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.820', 'ARMOR': '0.004', 'AMMO5': '0.033', 'AMMO2': '0.042', 'AMMO3': '0.149', 'weapon5': '0.170', 'AMMO4': '0.212', 'weapon4': '0.300', 'WEAPON4': '0.450', 'WEAPON5': '0.650', 'WEAPON3': '0.900', 'weapon2': '0.922', 'HITCOUNT': '2.200', 'weapon3': '2.286', 'DAMAGECOUNT': '8.649', 'FRAGCOUNT': '30.000'} [2023-02-24 20:44:12,931][213372] DAMAGECOUNT value on done: 138364.0 [2023-02-24 20:44:12,932][213372] Sum rewards: 15.744, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.535', 'AMMO2': '0.005', 'AMMO5': '0.017', 'AMMO4': '0.023', 'weapon4': '0.176', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon5': '0.296', 'WEAPON5': '0.550', 'weapon2': '0.946', 'WEAPON3': '1.150', 'HITCOUNT': '1.630', 'weapon3': '2.162', 'DAMAGECOUNT': '6.189', 'FRAGCOUNT': '17.500'} [2023-02-24 20:44:12,954][213367] DAMAGECOUNT value on done: 138518.0 [2023-02-24 20:44:12,954][213367] Sum rewards: 30.414, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.046', 'weapon5': '0.004', 'AMMO2': '0.011', 'AMMO5': '0.015', 'AMMO4': '0.054', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'weapon4': '0.168', 'WEAPON5': '0.300', 'weapon2': '0.602', 'WEAPON3': '1.150', 'HITCOUNT': '1.970', 'weapon3': '3.012', 'DAMAGECOUNT': '8.373', 'FRAGCOUNT': '28.000'} [2023-02-24 20:44:13,144][213366] DAMAGECOUNT value on done: 144733.0 [2023-02-24 20:44:13,144][213366] Sum rewards: 26.610, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.246', 'ARMOR': '0.004', 'AMMO2': '0.014', 'AMMO5': '0.017', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.161', 'weapon4': '0.200', 'weapon5': '0.270', 'WEAPON5': '0.350', 'weapon2': '0.392', 'WEAPON3': '1.050', 'HITCOUNT': '1.870', 'weapon3': '2.832', 'DAMAGECOUNT': '7.527', 'FRAGCOUNT': '25.000'} [2023-02-24 20:44:13,272][213367] DAMAGECOUNT value on done: 133950.0 [2023-02-24 20:44:13,273][213367] Sum rewards: 18.333, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.960', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'AMMO5': '0.022', 'AMMO4': '0.109', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'weapon5': '0.284', 'weapon4': '0.308', 'weapon2': '0.468', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '1.750', 'weapon3': '2.584', 'DAMAGECOUNT': '7.458', 'FRAGCOUNT': '20.000'} [2023-02-24 20:44:13,391][213382] DAMAGECOUNT value on done: 132906.0 [2023-02-24 20:44:13,391][213382] Sum rewards: 23.341, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.214', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon4': '0.162', 'AMMO3': '0.178', 'weapon5': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.900', 'WEAPON3': '1.150', 'HITCOUNT': '1.790', 'weapon3': '2.386', 'DAMAGECOUNT': '9.201', 'FRAGCOUNT': '21.500'} [2023-02-24 20:44:13,407][213372] DAMAGECOUNT value on done: 137615.0 [2023-02-24 20:44:13,408][213372] Sum rewards: 28.045, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.584', 'AMMO2': '0.009', 'weapon4': '0.010', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'AMMO3': '0.159', 'weapon5': '0.214', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon2': '1.200', 'HITCOUNT': '1.720', 'weapon3': '2.286', 'DAMAGECOUNT': '7.701', 'FRAGCOUNT': '26.000'} [2023-02-24 20:44:13,436][213366] DAMAGECOUNT value on done: 141115.0 [2023-02-24 20:44:13,436][213366] Sum rewards: 28.445, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.635', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'weapon5': '0.116', 'AMMO3': '0.179', 'WEAPON5': '0.250', 'weapon4': '0.362', 'weapon2': '0.634', 'WEAPON3': '1.250', 'HITCOUNT': '1.940', 'weapon3': '2.574', 'DAMAGECOUNT': '8.904', 'FRAGCOUNT': '26.000'} [2023-02-24 20:44:13,531][213383] DAMAGECOUNT value on done: 137248.0 [2023-02-24 20:44:13,532][213383] Sum rewards: 27.393, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.656', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.120', 'WEAPON5': '0.150', 'weapon5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.344', 'weapon2': '0.764', 'WEAPON3': '0.800', 'HITCOUNT': '1.670', 'weapon3': '2.324', 'DAMAGECOUNT': '6.879', 'FRAGCOUNT': '25.000'} [2023-02-24 20:44:13,558][213368] DAMAGECOUNT value on done: 132550.0 [2023-02-24 20:44:13,559][213368] Sum rewards: 30.355, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.132', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.012', 'AMMO4': '0.054', 'AMMO3': '0.114', 'WEAPON5': '0.300', 'weapon5': '0.304', 'WEAPON3': '0.650', 'weapon2': '1.308', 'HITCOUNT': '1.740', 'weapon3': '2.120', 'DAMAGECOUNT': '6.864', 'FRAGCOUNT': '24.500'} [2023-02-24 20:44:13,713][213382] DAMAGECOUNT value on done: 137591.0 [2023-02-24 20:44:13,714][213382] Sum rewards: 10.689, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.817', 'AMMO5': '0.012', 'weapon4': '0.022', 'AMMO2': '0.031', 'WEAPON4': '0.050', 'AMMO3': '0.130', 'AMMO4': '0.152', 'WEAPON5': '0.350', 'weapon5': '0.426', 'HITCOUNT': '0.700', 'WEAPON3': '0.800', 'weapon3': '1.460', 'weapon2': '1.624', 'DAMAGECOUNT': '3.498', 'FRAGCOUNT': '10.500'} [2023-02-24 20:44:13,733][213372] DAMAGECOUNT value on done: 135086.0 [2023-02-24 20:44:13,734][213372] Sum rewards: 30.832, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.353', 'AMMO2': '0.015', 'AMMO5': '0.017', 'AMMO4': '0.076', 'weapon4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.157', 'weapon5': '0.286', 'weapon2': '0.402', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'HITCOUNT': '2.150', 'weapon3': '2.844', 'DAMAGECOUNT': '8.517', 'FRAGCOUNT': '27.000'} [2023-02-24 20:44:13,758][213366] DAMAGECOUNT value on done: 137446.0 [2023-02-24 20:44:13,759][213366] Sum rewards: 29.903, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.030', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.030', 'AMMO4': '0.150', 'AMMO3': '0.183', 'weapon5': '0.206', 'WEAPON4': '0.300', 'weapon2': '0.328', 'WEAPON5': '0.350', 'weapon4': '0.604', 'WEAPON3': '1.150', 'HITCOUNT': '2.260', 'weapon3': '2.446', 'DAMAGECOUNT': '9.405', 'FRAGCOUNT': '28.500'} [2023-02-24 20:44:13,842][213383] DAMAGECOUNT value on done: 142860.0 [2023-02-24 20:44:13,842][213383] Sum rewards: 23.078, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.550', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'WEAPON4': '0.100', 'weapon4': '0.142', 'AMMO4': '0.171', 'AMMO3': '0.191', 'WEAPON5': '0.300', 'weapon5': '0.306', 'weapon2': '0.672', 'WEAPON3': '1.250', 'HITCOUNT': '1.710', 'weapon3': '2.582', 'DAMAGECOUNT': '7.383', 'FRAGCOUNT': '22.000'} [2023-02-24 20:44:13,879][213368] DAMAGECOUNT value on done: 137914.0 [2023-02-24 20:44:13,879][213368] Sum rewards: 29.228, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.817', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.042', 'AMMO3': '0.152', 'AMMO4': '0.209', 'WEAPON4': '0.250', 'weapon4': '0.332', 'weapon5': '0.464', 'WEAPON5': '0.500', 'weapon2': '0.624', 'WEAPON3': '1.000', 'HITCOUNT': '2.060', 'weapon3': '2.260', 'DAMAGECOUNT': '8.613', 'FRAGCOUNT': '26.500'} [2023-02-24 20:44:13,898][213365] Updated weights for policy 0, policy_version 28286 (0.0009) [2023-02-24 20:44:13,944][213369] DAMAGECOUNT value on done: 140818.0 [2023-02-24 20:44:13,944][213369] Sum rewards: 29.586, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.906', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO5': '0.025', 'AMMO4': '0.093', 'weapon4': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'weapon5': '0.228', 'WEAPON5': '0.400', 'weapon2': '0.748', 'WEAPON3': '1.350', 'HITCOUNT': '1.940', 'weapon3': '2.408', 'DAMAGECOUNT': '8.670', 'FRAGCOUNT': '28.000'} [2023-02-24 20:44:14,034][213382] DAMAGECOUNT value on done: 133692.0 [2023-02-24 20:44:14,035][213382] Sum rewards: 43.738, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.948', 'ARMOR': '0.008', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.158', 'AMMO4': '0.176', 'weapon5': '0.334', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.476', 'WEAPON3': '0.950', 'weapon4': '1.046', 'weapon3': '1.718', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '12.651', 'FRAGCOUNT': '37.000'} [2023-02-24 20:44:14,176][213368] DAMAGECOUNT value on done: 139846.0 [2023-02-24 20:44:14,177][213368] Sum rewards: 33.701, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.625', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'weapon4': '0.068', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'weapon5': '0.162', 'WEAPON5': '0.200', 'WEAPON3': '0.700', 'weapon2': '1.382', 'HITCOUNT': '1.780', 'weapon3': '2.132', 'DAMAGECOUNT': '7.581', 'FRAGCOUNT': '29.000'} [2023-02-24 20:44:14,258][213369] DAMAGECOUNT value on done: 140714.0 [2023-02-24 20:44:14,259][213369] Sum rewards: 30.726, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.015', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon7': '0.056', 'AMMO3': '0.073', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.127', 'WEAPON5': '0.250', 'weapon2': '0.298', 'weapon5': '0.342', 'WEAPON4': '0.450', 'WEAPON3': '0.500', 'weapon4': '1.328', 'weapon3': '1.514', 'HITCOUNT': '2.070', 'DAMAGECOUNT': '8.394', 'FRAGCOUNT': '25.000'} [2023-02-24 20:44:14,293][213384] DAMAGECOUNT value on done: 138954.0 [2023-02-24 20:44:14,293][213384] Sum rewards: 24.420, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.174', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.034', 'weapon7': '0.052', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.169', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.202', 'AMMO3': '0.247', 'weapon4': '0.296', 'WEAPON5': '0.400', 'weapon2': '0.922', 'WEAPON3': '1.350', 'HITCOUNT': '2.010', 'weapon3': '2.188', 'DAMAGECOUNT': '9.048', 'FRAGCOUNT': '27.000'} [2023-02-24 20:44:14,344][213382] DAMAGECOUNT value on done: 137934.0 [2023-02-24 20:44:14,345][213382] Sum rewards: 34.660, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.276', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.162', 'AMMO3': '0.183', 'weapon5': '0.266', 'weapon2': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.538', 'WEAPON3': '1.100', 'HITCOUNT': '2.200', 'weapon3': '2.550', 'DAMAGECOUNT': '9.741', 'FRAGCOUNT': '31.000'} [2023-02-24 20:44:14,458][213383] DAMAGECOUNT value on done: 138384.0 [2023-02-24 20:44:14,458][213383] Sum rewards: 30.124, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.715', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'weapon5': '0.100', 'weapon4': '0.130', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon2': '0.590', 'WEAPON3': '1.250', 'HITCOUNT': '2.030', 'weapon3': '2.942', 'DAMAGECOUNT': '8.265', 'FRAGCOUNT': '28.500'} [2023-02-24 20:44:14,495][213368] DAMAGECOUNT value on done: 133730.0 [2023-02-24 20:44:14,496][213368] Sum rewards: 17.687, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.015', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.102', 'weapon5': '0.192', 'WEAPON4': '0.200', 'weapon4': '0.230', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.450', 'HITCOUNT': '1.640', 'weapon3': '2.844', 'DAMAGECOUNT': '6.684', 'FRAGCOUNT': '22.000'} [2023-02-24 20:44:14,604][213384] DAMAGECOUNT value on done: 128546.0 [2023-02-24 20:44:14,604][213384] Sum rewards: 25.602, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.250', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.007', 'ARMOR': '0.008', 'AMMO3': '0.087', 'weapon5': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.506', 'WEAPON3': '0.700', 'weapon2': '1.002', 'HITCOUNT': '1.680', 'weapon3': '2.128', 'DAMAGECOUNT': '6.633', 'FRAGCOUNT': '22.000'} [2023-02-24 20:44:14,627][213369] DAMAGECOUNT value on done: 141980.0 [2023-02-24 20:44:14,628][213369] Sum rewards: 33.392, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.010', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.124', 'weapon5': '0.134', 'weapon4': '0.174', 'WEAPON3': '0.800', 'weapon2': '0.960', 'HITCOUNT': '1.990', 'weapon3': '2.482', 'DAMAGECOUNT': '8.196', 'FRAGCOUNT': '28.000'} [2023-02-24 20:44:14,749][213384] DAMAGECOUNT value on done: 140762.0 [2023-02-24 20:44:14,750][213384] Sum rewards: 24.799, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.028', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.051', 'AMMO3': '0.173', 'AMMO4': '0.253', 'weapon5': '0.336', 'weapon2': '0.544', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon4': '0.618', 'WEAPON3': '1.000', 'weapon3': '1.948', 'HITCOUNT': '2.050', 'DAMAGECOUNT': '8.676', 'FRAGCOUNT': '25.000'} [2023-02-24 20:44:14,771][213383] DAMAGECOUNT value on done: 130094.0 [2023-02-24 20:44:14,772][213383] Sum rewards: 20.040, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.766', 'AMMO5': '0.015', 'AMMO2': '0.021', 'weapon7': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.135', 'weapon5': '0.152', 'WEAPON4': '0.200', 'weapon4': '0.330', 'WEAPON5': '0.400', 'weapon2': '0.532', 'WEAPON3': '0.850', 'HITCOUNT': '1.370', 'weapon3': '1.816', 'DAMAGECOUNT': '5.754', 'FRAGCOUNT': '18.500'} [2023-02-24 20:44:14,934][213369] DAMAGECOUNT value on done: 126425.0 [2023-02-24 20:44:14,934][213369] Sum rewards: 26.647, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.109', 'WEAPON5': '0.150', 'weapon5': '0.246', 'weapon4': '0.276', 'weapon2': '0.594', 'WEAPON3': '0.600', 'HEALTH': '0.644', 'HITCOUNT': '1.620', 'weapon3': '2.520', 'DAMAGECOUNT': '6.495', 'FRAGCOUNT': '20.000'} [2023-02-24 20:44:15,050][213384] DAMAGECOUNT value on done: 142920.0 [2023-02-24 20:44:15,050][213384] Sum rewards: 27.479, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.395', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.168', 'AMMO3': '0.178', 'AMMO4': '0.201', 'WEAPON5': '0.400', 'weapon4': '0.434', 'WEAPON4': '0.450', 'weapon2': '0.758', 'WEAPON3': '1.150', 'HITCOUNT': '1.820', 'weapon3': '2.334', 'DAMAGECOUNT': '8.424', 'FRAGCOUNT': '28.000'} [2023-02-24 20:44:15,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13371.0). Total num frames: 115875840. Throughput: 0: 3358.8. Samples: 3964812. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 20:44:15,243][213332] Avg episode reward: [(0, '27.462')] [2023-02-24 20:44:16,893][213365] Updated weights for policy 0, policy_version 28296 (0.0009) [2023-02-24 20:44:19,984][213365] Updated weights for policy 0, policy_version 28306 (0.0009) [2023-02-24 20:44:20,243][213332] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13357.1). Total num frames: 115941376. Throughput: 0: 3361.6. Samples: 3975176. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 20:44:20,243][213332] Avg episode reward: [(0, '27.462')] [2023-02-24 20:44:22,984][213365] Updated weights for policy 0, policy_version 28316 (0.0009) [2023-02-24 20:44:25,243][213332] Fps is (10 sec: 13516.6, 60 sec: 13448.5, 300 sec: 13357.1). Total num frames: 116011008. Throughput: 0: 3362.1. Samples: 3995258. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 20:44:25,243][213332] Avg episode reward: [(0, '27.462')] [2023-02-24 20:44:26,072][213365] Updated weights for policy 0, policy_version 28326 (0.0009) [2023-02-24 20:44:29,182][213365] Updated weights for policy 0, policy_version 28336 (0.0009) [2023-02-24 20:44:30,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13357.1). Total num frames: 116076544. Throughput: 0: 3358.3. Samples: 4015214. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 20:44:30,243][213332] Avg episode reward: [(0, '27.462')] [2023-02-24 20:44:32,246][213365] Updated weights for policy 0, policy_version 28346 (0.0009) [2023-02-24 20:44:32,363][213367] DAMAGECOUNT value on done: 140145.0 [2023-02-24 20:44:32,364][213367] Sum rewards: 39.239, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.785', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.005', 'weapon4': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO3': '0.180', 'weapon2': '0.510', 'WEAPON3': '1.300', 'HITCOUNT': '2.380', 'weapon3': '3.088', 'DAMAGECOUNT': '10.530', 'FRAGCOUNT': '35.000'} [2023-02-24 20:44:32,675][213367] DAMAGECOUNT value on done: 140845.0 [2023-02-24 20:44:32,675][213367] Sum rewards: 28.479, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.805', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.018', 'weapon5': '0.114', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.320', 'weapon4': '0.772', 'WEAPON3': '1.150', 'HITCOUNT': '2.140', 'weapon3': '2.298', 'DAMAGECOUNT': '9.333', 'FRAGCOUNT': '28.000'} [2023-02-24 20:44:32,680][213372] DAMAGECOUNT value on done: 141128.0 [2023-02-24 20:44:32,681][213372] Sum rewards: 28.095, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.940', 'AMMO5': '0.017', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.076', 'AMMO4': '0.093', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.406', 'weapon4': '0.424', 'WEAPON3': '1.350', 'HITCOUNT': '2.430', 'weapon3': '2.762', 'DAMAGECOUNT': '9.999', 'FRAGCOUNT': '28.000'} [2023-02-24 20:44:32,988][213366] DAMAGECOUNT value on done: 135576.0 [2023-02-24 20:44:32,989][213366] Sum rewards: 27.219, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.918', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.165', 'AMMO3': '0.185', 'weapon2': '0.298', 'weapon5': '0.326', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon4': '1.104', 'weapon3': '1.954', 'HITCOUNT': '2.320', 'DAMAGECOUNT': '9.738', 'FRAGCOUNT': '27.000'} [2023-02-24 20:44:32,990][213372] DAMAGECOUNT value on done: 141587.0 [2023-02-24 20:44:32,991][213372] Sum rewards: 29.191, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.770', 'ARMOR': '0.004', 'AMMO5': '0.027', 'AMMO2': '0.061', 'AMMO3': '0.198', 'weapon4': '0.274', 'AMMO4': '0.304', 'weapon2': '0.314', 'weapon5': '0.446', 'WEAPON4': '0.500', 'WEAPON5': '0.850', 'WEAPON3': '1.250', 'HITCOUNT': '1.980', 'weapon3': '2.430', 'DAMAGECOUNT': '9.573', 'FRAGCOUNT': '29.000'} [2023-02-24 20:44:33,004][213367] DAMAGECOUNT value on done: 142020.0 [2023-02-24 20:44:33,005][213367] Sum rewards: 34.241, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.269', 'AMMO5': '0.026', 'AMMO2': '0.062', 'AMMO3': '0.154', 'weapon2': '0.288', 'AMMO4': '0.308', 'weapon5': '0.556', 'WEAPON4': '0.600', 'weapon4': '0.660', 'WEAPON5': '0.700', 'WEAPON3': '0.950', 'weapon3': '1.970', 'HITCOUNT': '2.340', 'DAMAGECOUNT': '10.146', 'FRAGCOUNT': '32.000'} [2023-02-24 20:44:33,309][213366] DAMAGECOUNT value on done: 147997.0 [2023-02-24 20:44:33,310][213366] Sum rewards: 31.051, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.290', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.039', 'AMMO3': '0.130', 'AMMO4': '0.192', 'weapon5': '0.408', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon2': '0.604', 'weapon4': '0.612', 'WEAPON3': '0.950', 'weapon3': '2.034', 'HITCOUNT': '2.210', 'DAMAGECOUNT': '9.792', 'FRAGCOUNT': '29.000'} [2023-02-24 20:44:33,318][213367] DAMAGECOUNT value on done: 136763.0 [2023-02-24 20:44:33,319][213367] Sum rewards: 30.304, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.660', 'AMMO5': '0.014', 'AMMO2': '0.029', 'AMMO3': '0.143', 'AMMO4': '0.146', 'weapon5': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.354', 'WEAPON3': '0.850', 'weapon2': '0.972', 'weapon3': '2.244', 'HITCOUNT': '2.270', 'DAMAGECOUNT': '8.439', 'FRAGCOUNT': '26.000'} [2023-02-24 20:44:33,323][213382] DAMAGECOUNT value on done: 134526.0 [2023-02-24 20:44:33,324][213382] Sum rewards: 15.644, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.696', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon7': '0.050', 'AMMO4': '0.077', 'weapon5': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.136', 'weapon2': '0.146', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.676', 'WEAPON3': '0.800', 'HITCOUNT': '1.100', 'weapon3': '1.572', 'DAMAGECOUNT': '4.860', 'FRAGCOUNT': '15.000'} [2023-02-24 20:44:33,435][213372] DAMAGECOUNT value on done: 140694.0 [2023-02-24 20:44:33,436][213372] Sum rewards: 27.994, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.880', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.564', 'weapon4': '0.596', 'WEAPON3': '1.300', 'HITCOUNT': '2.060', 'weapon3': '2.490', 'DAMAGECOUNT': '9.237', 'FRAGCOUNT': '28.000'} [2023-02-24 20:44:33,583][213366] DAMAGECOUNT value on done: 143722.0 [2023-02-24 20:44:33,584][213366] Sum rewards: 25.542, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.483', 'AMMO5': '0.004', 'AMMO2': '0.004', 'AMMO4': '0.021', 'weapon5': '0.028', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon7': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.193', 'WEAPON7': '0.200', 'weapon4': '0.324', 'weapon2': '0.836', 'WEAPON3': '1.250', 'HITCOUNT': '1.950', 'weapon3': '2.338', 'DAMAGECOUNT': '7.821', 'FRAGCOUNT': '24.500'} [2023-02-24 20:44:33,596][213383] DAMAGECOUNT value on done: 140693.0 [2023-02-24 20:44:33,597][213383] Sum rewards: 41.681, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.944', 'ARMOR': '0.004', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.128', 'AMMO4': '0.128', 'WEAPON4': '0.250', 'weapon5': '0.378', 'WEAPON5': '0.550', 'weapon4': '0.572', 'weapon2': '0.674', 'WEAPON3': '0.950', 'weapon3': '1.992', 'HITCOUNT': '2.350', 'DAMAGECOUNT': '10.335', 'FRAGCOUNT': '36.000'} [2023-02-24 20:44:33,641][213382] DAMAGECOUNT value on done: 140925.0 [2023-02-24 20:44:33,642][213382] Sum rewards: 31.317, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.195', 'AMMO2': '0.011', 'AMMO5': '0.024', 'AMMO4': '0.057', 'weapon4': '0.128', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon5': '0.264', 'WEAPON5': '0.500', 'weapon2': '0.870', 'WEAPON3': '1.300', 'HITCOUNT': '2.140', 'weapon3': '2.414', 'DAMAGECOUNT': '9.897', 'FRAGCOUNT': '30.000'} [2023-02-24 20:44:33,697][213368] DAMAGECOUNT value on done: 135230.0 [2023-02-24 20:44:33,697][213368] Sum rewards: 28.467, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.156', 'AMMO5': '0.013', 'AMMO2': '0.038', 'AMMO3': '0.145', 'AMMO4': '0.190', 'weapon5': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.536', 'weapon4': '0.650', 'WEAPON3': '0.950', 'weapon3': '2.030', 'HITCOUNT': '2.030', 'DAMAGECOUNT': '8.040', 'FRAGCOUNT': '26.000'} [2023-02-24 20:44:33,754][213372] DAMAGECOUNT value on done: 137361.0 [2023-02-24 20:44:33,755][213372] Sum rewards: 21.017, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.430', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.088', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'WEAPON4': '0.350', 'weapon4': '0.408', 'weapon2': '0.542', 'WEAPON3': '1.400', 'HITCOUNT': '1.830', 'weapon3': '2.642', 'DAMAGECOUNT': '6.825', 'FRAGCOUNT': '24.000'} [2023-02-24 20:44:33,907][213366] DAMAGECOUNT value on done: 141090.0 [2023-02-24 20:44:33,908][213366] Sum rewards: 37.386, reward structure: {'DEATHCOUNT': '-14.250', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.046', 'weapon7': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.102', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'AMMO4': '0.228', 'weapon2': '0.268', 'WEAPON4': '0.300', 'HEALTH': '0.432', 'weapon4': '0.834', 'WEAPON3': '0.950', 'weapon3': '2.390', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '10.932', 'FRAGCOUNT': '32.000'} [2023-02-24 20:44:33,921][213383] DAMAGECOUNT value on done: 145896.0 [2023-02-24 20:44:33,922][213383] Sum rewards: 33.981, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.510', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.024', 'weapon5': '0.116', 'AMMO4': '0.118', 'AMMO3': '0.137', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.454', 'weapon2': '0.482', 'WEAPON3': '0.950', 'HITCOUNT': '1.960', 'weapon3': '2.668', 'DAMAGECOUNT': '9.108', 'FRAGCOUNT': '30.000'} [2023-02-24 20:44:33,966][213382] DAMAGECOUNT value on done: 135454.0 [2023-02-24 20:44:33,967][213382] Sum rewards: 23.712, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.928', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.038', 'weapon7': '0.048', 'weapon5': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.125', 'WEAPON5': '0.150', 'AMMO4': '0.190', 'WEAPON4': '0.300', 'weapon2': '0.498', 'weapon4': '0.666', 'WEAPON3': '0.750', 'HITCOUNT': '1.370', 'weapon3': '1.818', 'DAMAGECOUNT': '5.286', 'FRAGCOUNT': '22.000'} [2023-02-24 20:44:34,021][213369] DAMAGECOUNT value on done: 143714.0 [2023-02-24 20:44:34,021][213369] Sum rewards: 26.974, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.878', 'ARMOR': '0.004', 'AMMO2': '0.012', 'AMMO5': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon4': '0.234', 'weapon5': '0.244', 'WEAPON5': '0.250', 'weapon2': '0.766', 'WEAPON3': '1.100', 'HITCOUNT': '2.260', 'weapon3': '2.346', 'DAMAGECOUNT': '8.688', 'FRAGCOUNT': '26.000'} [2023-02-24 20:44:34,028][213368] DAMAGECOUNT value on done: 141202.0 [2023-02-24 20:44:34,028][213368] Sum rewards: 31.313, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.756', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.058', 'weapon4': '0.130', 'AMMO3': '0.197', 'weapon2': '0.506', 'WEAPON3': '1.150', 'HITCOUNT': '2.480', 'weapon3': '3.030', 'DAMAGECOUNT': '9.864', 'FRAGCOUNT': '28.000'} [2023-02-24 20:44:34,283][213382] DAMAGECOUNT value on done: 140148.0 [2023-02-24 20:44:34,283][213382] Sum rewards: 15.918, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.215', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.039', 'weapon4': '0.090', 'weapon5': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'weapon2': '0.514', 'WEAPON3': '1.200', 'HITCOUNT': '1.690', 'weapon3': '3.036', 'DAMAGECOUNT': '6.642', 'FRAGCOUNT': '17.000'} [2023-02-24 20:44:34,317][213384] DAMAGECOUNT value on done: 141681.0 [2023-02-24 20:44:34,317][213384] Sum rewards: 26.956, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.718', 'AMMO5': '0.018', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.198', 'weapon5': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.324', 'weapon4': '0.364', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '1.930', 'weapon3': '2.774', 'DAMAGECOUNT': '8.181', 'FRAGCOUNT': '26.000'} [2023-02-24 20:44:34,338][213368] DAMAGECOUNT value on done: 142188.0 [2023-02-24 20:44:34,339][213368] Sum rewards: 23.109, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.805', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.045', 'AMMO3': '0.135', 'weapon5': '0.146', 'AMMO4': '0.226', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.584', 'WEAPON3': '0.850', 'weapon2': '0.870', 'HITCOUNT': '1.840', 'weapon3': '2.124', 'DAMAGECOUNT': '7.026', 'FRAGCOUNT': '23.000'} [2023-02-24 20:44:34,347][213369] DAMAGECOUNT value on done: 143522.0 [2023-02-24 20:44:34,348][213369] Sum rewards: 30.397, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.205', 'AMMO5': '0.015', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.144', 'weapon5': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.432', 'weapon2': '0.714', 'WEAPON3': '1.000', 'HITCOUNT': '2.070', 'weapon3': '2.266', 'DAMAGECOUNT': '8.424', 'FRAGCOUNT': '28.000'} [2023-02-24 20:44:34,526][213383] DAMAGECOUNT value on done: 140985.0 [2023-02-24 20:44:34,527][213383] Sum rewards: 24.786, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.267', 'AMMO5': '0.005', 'AMMO2': '0.040', 'AMMO3': '0.099', 'weapon5': '0.104', 'AMMO4': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.402', 'WEAPON3': '0.750', 'weapon2': '0.944', 'HITCOUNT': '1.880', 'weapon3': '2.278', 'DAMAGECOUNT': '7.803', 'FRAGCOUNT': '21.000'} [2023-02-24 20:44:34,628][213384] DAMAGECOUNT value on done: 131850.0 [2023-02-24 20:44:34,628][213384] Sum rewards: 34.006, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.418', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.077', 'WEAPON5': '0.150', 'weapon5': '0.174', 'AMMO3': '0.182', 'WEAPON4': '0.300', 'weapon2': '0.514', 'weapon4': '0.676', 'WEAPON3': '1.100', 'HITCOUNT': '2.400', 'weapon3': '2.418', 'DAMAGECOUNT': '9.912', 'FRAGCOUNT': '31.000'} [2023-02-24 20:44:34,657][213368] DAMAGECOUNT value on done: 135879.0 [2023-02-24 20:44:34,658][213368] Sum rewards: 22.886, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.229', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO3': '0.087', 'AMMO4': '0.179', 'WEAPON4': '0.200', 'weapon5': '0.220', 'WEAPON5': '0.300', 'weapon4': '0.404', 'WEAPON3': '0.550', 'weapon2': '1.040', 'HITCOUNT': '1.510', 'weapon3': '1.632', 'DAMAGECOUNT': '6.447', 'FRAGCOUNT': '18.000'} [2023-02-24 20:44:34,728][213369] DAMAGECOUNT value on done: 144435.0 [2023-02-24 20:44:34,728][213369] Sum rewards: 29.820, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.638', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.043', 'AMMO3': '0.172', 'AMMO4': '0.215', 'weapon5': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.488', 'weapon2': '0.706', 'WEAPON3': '1.050', 'HITCOUNT': '1.840', 'weapon3': '2.028', 'DAMAGECOUNT': '7.365', 'FRAGCOUNT': '30.000'} [2023-02-24 20:44:34,794][213384] DAMAGECOUNT value on done: 143654.0 [2023-02-24 20:44:34,795][213384] Sum rewards: 30.462, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.945', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO3': '0.156', 'AMMO4': '0.201', 'weapon5': '0.348', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.512', 'weapon4': '0.560', 'WEAPON3': '1.000', 'HITCOUNT': '2.010', 'weapon3': '2.270', 'DAMAGECOUNT': '8.646', 'FRAGCOUNT': '29.000'} [2023-02-24 20:44:34,832][213383] DAMAGECOUNT value on done: 133955.0 [2023-02-24 20:44:34,832][213383] Sum rewards: 41.774, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.662', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon4': '0.250', 'weapon2': '0.398', 'WEAPON3': '1.250', 'HITCOUNT': '2.710', 'weapon3': '2.972', 'DAMAGECOUNT': '11.583', 'FRAGCOUNT': '37.000'} [2023-02-24 20:44:35,028][213369] DAMAGECOUNT value on done: 129492.0 [2023-02-24 20:44:35,029][213369] Sum rewards: 25.497, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.495', 'AMMO5': '0.019', 'AMMO2': '0.035', 'weapon5': '0.156', 'AMMO4': '0.177', 'AMMO3': '0.225', 'WEAPON5': '0.400', 'weapon2': '0.406', 'weapon4': '0.410', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '2.170', 'weapon3': '2.642', 'DAMAGECOUNT': '9.201', 'FRAGCOUNT': '27.000'} [2023-02-24 20:44:35,090][213384] DAMAGECOUNT value on done: 144857.0 [2023-02-24 20:44:35,090][213384] Sum rewards: 16.796, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.772', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon7': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.130', 'AMMO3': '0.146', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.360', 'weapon4': '0.924', 'WEAPON3': '0.950', 'HITCOUNT': '1.350', 'weapon3': '1.482', 'DAMAGECOUNT': '5.811', 'FRAGCOUNT': '17.000'} [2023-02-24 20:44:35,243][213332] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13357.1). Total num frames: 116142080. Throughput: 0: 3353.6. Samples: 4025280. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 20:44:35,243][213332] Avg episode reward: [(0, '28.265')] [2023-02-24 20:44:35,247][213352] Saving new best policy, reward=28.265! [2023-02-24 20:44:35,358][213365] Updated weights for policy 0, policy_version 28356 (0.0009) [2023-02-24 20:44:35,651][213384] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 20:44:38,371][213365] Updated weights for policy 0, policy_version 28366 (0.0009) [2023-02-24 20:44:40,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13357.1). Total num frames: 116211712. Throughput: 0: 3352.4. Samples: 4045304. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 20:44:40,243][213332] Avg episode reward: [(0, '28.265')] [2023-02-24 20:44:41,409][213365] Updated weights for policy 0, policy_version 28376 (0.0009) [2023-02-24 20:44:44,530][213365] Updated weights for policy 0, policy_version 28386 (0.0009) [2023-02-24 20:44:45,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13380.2, 300 sec: 13343.2). Total num frames: 116277248. Throughput: 0: 3349.2. Samples: 4065274. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:44:45,243][213332] Avg episode reward: [(0, '28.265')] [2023-02-24 20:44:45,247][213352] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000028388_116277248.pth... [2023-02-24 20:44:45,304][213352] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000027611_113094656.pth [2023-02-24 20:44:47,558][213365] Updated weights for policy 0, policy_version 28396 (0.0009) [2023-02-24 20:44:50,243][213332] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13343.2). Total num frames: 116342784. Throughput: 0: 3343.3. Samples: 4075354. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:44:50,243][213332] Avg episode reward: [(0, '28.265')] [2023-02-24 20:44:50,653][213365] Updated weights for policy 0, policy_version 28406 (0.0009) [2023-02-24 20:44:51,515][213384] Large shaping reward -2.548 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('weapon5', 0.002)] [2023-02-24 20:44:52,512][213367] DAMAGECOUNT value on done: 143252.0 [2023-02-24 20:44:52,513][213367] Sum rewards: 27.819, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.973', 'AMMO5': '0.024', 'AMMO2': '0.029', 'weapon4': '0.056', 'AMMO4': '0.145', 'AMMO3': '0.197', 'WEAPON4': '0.300', 'weapon5': '0.400', 'weapon2': '0.474', 'WEAPON5': '0.650', 'WEAPON3': '1.150', 'HITCOUNT': '1.800', 'weapon3': '2.746', 'DAMAGECOUNT': '9.321', 'FRAGCOUNT': '26.000'} [2023-02-24 20:44:52,816][213372] DAMAGECOUNT value on done: 144512.0 [2023-02-24 20:44:52,816][213372] Sum rewards: 34.594, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.400', 'AMMO5': '0.026', 'AMMO2': '0.040', 'AMMO3': '0.142', 'AMMO4': '0.200', 'weapon5': '0.324', 'weapon4': '0.386', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'weapon2': '0.734', 'WEAPON3': '0.950', 'HITCOUNT': '2.190', 'weapon3': '2.200', 'DAMAGECOUNT': '10.152', 'FRAGCOUNT': '32.000'} [2023-02-24 20:44:52,848][213367] DAMAGECOUNT value on done: 144124.0 [2023-02-24 20:44:52,849][213367] Sum rewards: 32.503, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.522', 'AMMO5': '0.018', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.170', 'weapon4': '0.190', 'WEAPON4': '0.250', 'weapon5': '0.332', 'WEAPON5': '0.350', 'weapon2': '0.592', 'WEAPON3': '0.950', 'HITCOUNT': '2.250', 'weapon3': '2.464', 'DAMAGECOUNT': '9.837', 'FRAGCOUNT': '29.000'} [2023-02-24 20:44:53,140][213372] DAMAGECOUNT value on done: 145563.0 [2023-02-24 20:44:53,140][213372] Sum rewards: 39.841, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.078', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.161', 'weapon5': '0.294', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.456', 'weapon4': '0.506', 'WEAPON3': '1.100', 'weapon3': '2.364', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '11.928', 'FRAGCOUNT': '36.000'} [2023-02-24 20:44:53,155][213366] DAMAGECOUNT value on done: 138514.0 [2023-02-24 20:44:53,155][213366] Sum rewards: 28.171, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.170', 'AMMO5': '0.014', 'AMMO2': '0.034', 'AMMO4': '0.171', 'AMMO3': '0.205', 'weapon5': '0.206', 'WEAPON5': '0.350', 'weapon2': '0.414', 'WEAPON4': '0.450', 'ARMOR': '0.453', 'weapon4': '1.044', 'WEAPON3': '1.200', 'weapon3': '1.836', 'HITCOUNT': '2.150', 'DAMAGECOUNT': '8.814', 'FRAGCOUNT': '28.000'} [2023-02-24 20:44:53,176][213367] DAMAGECOUNT value on done: 145438.0 [2023-02-24 20:44:53,177][213367] Sum rewards: 35.725, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.779', 'AMMO5': '0.015', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon4': '0.174', 'weapon5': '0.196', 'AMMO3': '0.198', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.364', 'WEAPON3': '1.300', 'HITCOUNT': '2.440', 'weapon3': '2.972', 'DAMAGECOUNT': '10.224', 'FRAGCOUNT': '34.000'} [2023-02-24 20:44:53,470][213366] DAMAGECOUNT value on done: 151473.0 [2023-02-24 20:44:53,471][213366] Sum rewards: 35.257, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.500', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.136', 'weapon5': '0.152', 'weapon4': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.680', 'WEAPON3': '1.000', 'HITCOUNT': '2.310', 'weapon3': '2.624', 'DAMAGECOUNT': '10.428', 'FRAGCOUNT': '30.000'} [2023-02-24 20:44:53,481][213382] DAMAGECOUNT value on done: 137089.0 [2023-02-24 20:44:53,482][213382] Sum rewards: 28.065, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.226', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon5': '0.202', 'weapon4': '0.224', 'WEAPON5': '0.350', 'weapon2': '0.844', 'WEAPON3': '1.000', 'HITCOUNT': '1.760', 'weapon3': '2.430', 'DAMAGECOUNT': '7.689', 'FRAGCOUNT': '27.000'} [2023-02-24 20:44:53,499][213367] DAMAGECOUNT value on done: 139707.0 [2023-02-24 20:44:53,499][213367] Sum rewards: 28.533, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.830', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.031', 'weapon4': '0.140', 'AMMO3': '0.154', 'AMMO4': '0.154', 'weapon5': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon2': '0.718', 'WEAPON3': '1.000', 'HITCOUNT': '2.110', 'weapon3': '2.636', 'DAMAGECOUNT': '8.832', 'FRAGCOUNT': '25.500'} [2023-02-24 20:44:53,596][213372] DAMAGECOUNT value on done: 143390.0 [2023-02-24 20:44:53,596][213372] Sum rewards: 23.060, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.521', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.044', 'weapon7': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'WEAPON7': '0.200', 'weapon2': '0.230', 'weapon4': '0.592', 'WEAPON3': '1.300', 'HITCOUNT': '1.770', 'weapon3': '2.638', 'DAMAGECOUNT': '8.088', 'FRAGCOUNT': '22.500'} [2023-02-24 20:44:53,739][213366] DAMAGECOUNT value on done: 147004.0 [2023-02-24 20:44:53,740][213366] Sum rewards: 29.533, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.731', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.045', 'AMMO3': '0.162', 'AMMO4': '0.224', 'weapon5': '0.266', 'WEAPON5': '0.500', 'weapon2': '0.512', 'WEAPON4': '0.550', 'weapon4': '0.932', 'WEAPON3': '0.950', 'weapon3': '1.914', 'HITCOUNT': '2.360', 'DAMAGECOUNT': '9.327', 'FRAGCOUNT': '27.000'} [2023-02-24 20:44:53,752][213365] Updated weights for policy 0, policy_version 28416 (0.0009) [2023-02-24 20:44:53,774][213383] DAMAGECOUNT value on done: 143250.0 [2023-02-24 20:44:53,775][213383] Sum rewards: 24.527, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.038', 'ARMOR': '0.008', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.070', 'AMMO3': '0.091', 'weapon5': '0.248', 'WEAPON5': '0.350', 'AMMO4': '0.352', 'WEAPON4': '0.550', 'WEAPON3': '0.600', 'weapon4': '0.898', 'weapon3': '1.204', 'weapon2': '1.390', 'HITCOUNT': '1.600', 'DAMAGECOUNT': '7.671', 'FRAGCOUNT': '21.000'} [2023-02-24 20:44:53,801][213382] DAMAGECOUNT value on done: 144702.0 [2023-02-24 20:44:53,802][213382] Sum rewards: 40.560, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.620', 'AMMO2': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.049', 'AMMO3': '0.173', 'weapon5': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.298', 'weapon2': '0.308', 'WEAPON3': '1.000', 'HITCOUNT': '2.470', 'weapon3': '2.938', 'DAMAGECOUNT': '11.331', 'FRAGCOUNT': '34.000'} [2023-02-24 20:44:53,914][213372] DAMAGECOUNT value on done: 140356.0 [2023-02-24 20:44:53,914][213372] Sum rewards: 34.400, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.121', 'AMMO5': '0.017', 'AMMO2': '0.018', 'weapon4': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.088', 'AMMO3': '0.165', 'weapon5': '0.168', 'WEAPON5': '0.350', 'weapon2': '0.622', 'WEAPON3': '1.150', 'HITCOUNT': '2.190', 'weapon3': '2.950', 'DAMAGECOUNT': '8.985', 'FRAGCOUNT': '31.000'} [2023-02-24 20:44:53,928][213368] DAMAGECOUNT value on done: 138610.0 [2023-02-24 20:44:53,928][213368] Sum rewards: 36.479, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.965', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.042', 'AMMO3': '0.157', 'weapon5': '0.160', 'AMMO4': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.646', 'weapon4': '0.876', 'WEAPON3': '1.100', 'weapon3': '1.876', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '10.140', 'FRAGCOUNT': '33.000'} [2023-02-24 20:44:54,054][213366] DAMAGECOUNT value on done: 143805.0 [2023-02-24 20:44:54,055][213366] Sum rewards: 28.429, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.230', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.020', 'ARMOR': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'weapon4': '0.240', 'weapon2': '0.646', 'WEAPON3': '1.100', 'HITCOUNT': '2.050', 'weapon3': '2.872', 'DAMAGECOUNT': '8.145', 'FRAGCOUNT': '26.000'} [2023-02-24 20:44:54,093][213383] DAMAGECOUNT value on done: 148455.0 [2023-02-24 20:44:54,094][213383] Sum rewards: 24.587, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.913', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.032', 'AMMO3': '0.097', 'WEAPON4': '0.200', 'weapon5': '0.230', 'WEAPON5': '0.250', 'weapon4': '0.604', 'WEAPON3': '0.650', 'weapon2': '1.252', 'weapon3': '1.694', 'HITCOUNT': '2.030', 'DAMAGECOUNT': '7.677', 'FRAGCOUNT': '19.000'} [2023-02-24 20:44:54,121][213382] DAMAGECOUNT value on done: 139084.0 [2023-02-24 20:44:54,122][213382] Sum rewards: 27.311, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-3.658', 'AMMO5': '0.009', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon5': '0.164', 'WEAPON5': '0.250', 'weapon2': '0.252', 'AMMO3': '0.305', 'WEAPON4': '0.500', 'weapon4': '0.900', 'WEAPON3': '1.750', 'weapon3': '2.288', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '10.890', 'FRAGCOUNT': '31.000'} [2023-02-24 20:44:54,202][213369] DAMAGECOUNT value on done: 146479.0 [2023-02-24 20:44:54,203][213369] Sum rewards: 28.600, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.444', 'AMMO5': '0.012', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.180', 'weapon5': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.322', 'weapon2': '0.574', 'WEAPON3': '1.150', 'HITCOUNT': '2.000', 'weapon3': '2.406', 'DAMAGECOUNT': '8.295', 'FRAGCOUNT': '28.000'} [2023-02-24 20:44:54,250][213368] DAMAGECOUNT value on done: 144368.0 [2023-02-24 20:44:54,251][213368] Sum rewards: 33.797, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.440', 'AMMO2': '0.015', 'AMMO5': '0.020', 'AMMO4': '0.073', 'weapon5': '0.154', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.436', 'weapon2': '0.866', 'WEAPON3': '1.050', 'HITCOUNT': '2.330', 'weapon3': '2.360', 'DAMAGECOUNT': '9.498', 'FRAGCOUNT': '30.000'} [2023-02-24 20:44:54,441][213382] DAMAGECOUNT value on done: 143080.0 [2023-02-24 20:44:54,442][213382] Sum rewards: 37.789, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.020', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.139', 'WEAPON5': '0.150', 'weapon4': '0.150', 'WEAPON4': '0.300', 'WEAPON3': '0.800', 'weapon2': '1.236', 'HITCOUNT': '2.200', 'weapon3': '2.274', 'DAMAGECOUNT': '8.796', 'FRAGCOUNT': '33.000'} [2023-02-24 20:44:54,491][213384] DAMAGECOUNT value on done: 144795.0 [2023-02-24 20:44:54,491][213384] Sum rewards: 27.819, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.554', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.130', 'AMMO4': '0.174', 'AMMO3': '0.182', 'weapon4': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.700', 'WEAPON3': '1.250', 'HITCOUNT': '2.090', 'weapon3': '2.646', 'DAMAGECOUNT': '9.342', 'FRAGCOUNT': '27.000'} [2023-02-24 20:44:54,535][213369] DAMAGECOUNT value on done: 146132.0 [2023-02-24 20:44:54,535][213369] Sum rewards: 21.050, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.340', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon2': '0.196', 'AMMO3': '0.221', 'WEAPON4': '0.350', 'weapon5': '0.380', 'WEAPON5': '0.500', 'weapon4': '0.614', 'WEAPON3': '1.250', 'HITCOUNT': '1.700', 'weapon3': '2.346', 'DAMAGECOUNT': '7.695', 'FRAGCOUNT': '23.000'} [2023-02-24 20:44:54,557][213383] DAMAGECOUNT value on done: 144301.0 [2023-02-24 20:44:54,558][213383] Sum rewards: 32.313, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.621', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.043', 'AMMO3': '0.124', 'AMMO4': '0.214', 'weapon5': '0.282', 'WEAPON5': '0.500', 'weapon2': '0.534', 'WEAPON4': '0.750', 'WEAPON3': '0.800', 'weapon4': '1.244', 'weapon3': '1.640', 'HITCOUNT': '2.130', 'DAMAGECOUNT': '9.903', 'FRAGCOUNT': '31.000'} [2023-02-24 20:44:54,567][213368] DAMAGECOUNT value on done: 145860.0 [2023-02-24 20:44:54,567][213368] Sum rewards: 37.274, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.960', 'ARMOR': '0.004', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.134', 'AMMO4': '0.149', 'weapon5': '0.188', 'WEAPON5': '0.350', 'weapon2': '0.378', 'WEAPON4': '0.400', 'weapon4': '0.710', 'WEAPON3': '0.950', 'weapon3': '2.330', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '11.016', 'FRAGCOUNT': '32.000'} [2023-02-24 20:44:54,820][213384] DAMAGECOUNT value on done: 134545.0 [2023-02-24 20:44:54,821][213384] Sum rewards: 28.296, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.444', 'AMMO2': '0.006', 'AMMO5': '0.008', 'AMMO4': '0.029', 'AMMO3': '0.152', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.218', 'weapon2': '0.356', 'weapon4': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '1.820', 'weapon3': '2.716', 'DAMAGECOUNT': '8.085', 'FRAGCOUNT': '25.000'} [2023-02-24 20:44:54,879][213383] DAMAGECOUNT value on done: 137006.0 [2023-02-24 20:44:54,879][213383] Sum rewards: 31.672, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.440', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.100', 'WEAPON4': '0.200', 'weapon5': '0.330', 'weapon4': '0.396', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'weapon2': '0.810', 'HITCOUNT': '1.920', 'weapon3': '2.208', 'DAMAGECOUNT': '9.153', 'FRAGCOUNT': '25.000'} [2023-02-24 20:44:54,887][213368] DAMAGECOUNT value on done: 139854.0 [2023-02-24 20:44:54,888][213368] Sum rewards: 44.617, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.456', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'weapon4': '0.176', 'AMMO3': '0.182', 'weapon5': '0.262', 'WEAPON5': '0.350', 'weapon2': '0.514', 'WEAPON3': '1.200', 'HITCOUNT': '2.630', 'weapon3': '2.758', 'DAMAGECOUNT': '11.925', 'FRAGCOUNT': '39.000'} [2023-02-24 20:44:54,909][213369] DAMAGECOUNT value on done: 147339.0 [2023-02-24 20:44:54,909][213369] Sum rewards: 26.623, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.080', 'ARMOR': '0.004', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.025', 'weapon5': '0.108', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.286', 'weapon2': '0.700', 'WEAPON3': '1.250', 'HITCOUNT': '2.350', 'weapon3': '2.678', 'DAMAGECOUNT': '8.712', 'FRAGCOUNT': '25.000'} [2023-02-24 20:44:54,965][213384] DAMAGECOUNT value on done: 147193.0 [2023-02-24 20:44:54,965][213384] Sum rewards: 26.361, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.660', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.036', 'AMMO4': '0.178', 'AMMO3': '0.214', 'weapon4': '0.218', 'weapon5': '0.338', 'WEAPON4': '0.350', 'weapon2': '0.380', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '1.960', 'weapon3': '2.644', 'DAMAGECOUNT': '10.617', 'FRAGCOUNT': '24.500'} [2023-02-24 20:44:55,210][213369] DAMAGECOUNT value on done: 132386.0 [2023-02-24 20:44:55,210][213369] Sum rewards: 26.300, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.156', 'AMMO2': '0.014', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.072', 'weapon4': '0.094', 'weapon5': '0.190', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'WEAPON5': '0.450', 'weapon2': '0.940', 'WEAPON3': '1.200', 'HITCOUNT': '1.920', 'weapon3': '2.452', 'DAMAGECOUNT': '8.682', 'FRAGCOUNT': '27.000'} [2023-02-24 20:44:55,243][213332] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13329.4). Total num frames: 116408320. Throughput: 0: 3340.0. Samples: 4095242. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:44:55,244][213332] Avg episode reward: [(0, '28.941')] [2023-02-24 20:44:55,249][213352] Saving new best policy, reward=28.941! [2023-02-24 20:44:55,266][213384] DAMAGECOUNT value on done: 147641.0 [2023-02-24 20:44:55,267][213384] Sum rewards: 33.397, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.680', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.163', 'WEAPON4': '0.250', 'weapon4': '0.264', 'weapon5': '0.266', 'WEAPON5': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.000', 'HITCOUNT': '2.070', 'weapon3': '2.712', 'DAMAGECOUNT': '8.202', 'FRAGCOUNT': '31.000'} [2023-02-24 20:44:56,764][213365] Updated weights for policy 0, policy_version 28426 (0.0009) [2023-02-24 20:44:59,891][213365] Updated weights for policy 0, policy_version 28436 (0.0009) [2023-02-24 20:45:00,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13329.4). Total num frames: 116477952. Throughput: 0: 3342.1. Samples: 4115206. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:45:00,243][213332] Avg episode reward: [(0, '29.012')] [2023-02-24 20:45:00,244][213352] Saving new best policy, reward=29.012! [2023-02-24 20:45:02,922][213365] Updated weights for policy 0, policy_version 28446 (0.0009) [2023-02-24 20:45:05,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13329.4). Total num frames: 116543488. Throughput: 0: 3337.9. Samples: 4125382. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:45:05,243][213332] Avg episode reward: [(0, '29.012')] [2023-02-24 20:45:06,006][213365] Updated weights for policy 0, policy_version 28456 (0.0009) [2023-02-24 20:45:09,097][213365] Updated weights for policy 0, policy_version 28466 (0.0010) [2023-02-24 20:45:09,472][213382] Large shaping reward -2.506 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0)] [2023-02-24 20:45:10,243][213332] Fps is (10 sec: 13107.3, 60 sec: 13312.0, 300 sec: 13315.5). Total num frames: 116609024. Throughput: 0: 3335.4. Samples: 4145352. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:45:10,243][213332] Avg episode reward: [(0, '29.012')] [2023-02-24 20:45:12,154][213365] Updated weights for policy 0, policy_version 28476 (0.0009) [2023-02-24 20:45:12,668][213367] DAMAGECOUNT value on done: 145590.0 [2023-02-24 20:45:12,668][213367] Sum rewards: 24.611, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.882', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.041', 'AMMO3': '0.108', 'weapon5': '0.122', 'WEAPON5': '0.200', 'AMMO4': '0.204', 'WEAPON4': '0.350', 'WEAPON3': '0.650', 'weapon4': '0.738', 'weapon2': '0.832', 'weapon3': '1.952', 'HITCOUNT': '2.020', 'DAMAGECOUNT': '7.014', 'FRAGCOUNT': '21.000'} [2023-02-24 20:45:12,982][213367] DAMAGECOUNT value on done: 147365.0 [2023-02-24 20:45:12,982][213367] Sum rewards: 23.662, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.062', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.018', 'weapon7': '0.058', 'AMMO4': '0.087', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.172', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon2': '0.334', 'weapon4': '0.546', 'WEAPON3': '1.250', 'weapon3': '2.400', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '9.723', 'FRAGCOUNT': '21.000'} [2023-02-24 20:45:12,984][213372] DAMAGECOUNT value on done: 147610.0 [2023-02-24 20:45:12,984][213372] Sum rewards: 22.624, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.082', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon5': '0.166', 'AMMO3': '0.179', 'WEAPON5': '0.250', 'WEAPON4': '0.550', 'weapon4': '0.680', 'weapon2': '0.716', 'WEAPON3': '1.150', 'weapon3': '2.170', 'HITCOUNT': '2.340', 'DAMAGECOUNT': '9.294', 'FRAGCOUNT': '23.000'} [2023-02-24 20:45:13,299][213367] DAMAGECOUNT value on done: 148148.0 [2023-02-24 20:45:13,299][213367] Sum rewards: 24.802, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.326', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.126', 'AMMO3': '0.201', 'AMMO4': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.374', 'ARMOR': '0.449', 'WEAPON4': '0.500', 'weapon4': '0.832', 'WEAPON3': '1.150', 'HITCOUNT': '2.090', 'weapon3': '2.132', 'DAMAGECOUNT': '8.010', 'FRAGCOUNT': '25.000'} [2023-02-24 20:45:13,310][213372] DAMAGECOUNT value on done: 148166.0 [2023-02-24 20:45:13,311][213372] Sum rewards: 27.450, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.159', 'AMMO5': '0.014', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.150', 'weapon5': '0.238', 'WEAPON4': '0.250', 'weapon4': '0.308', 'WEAPON5': '0.350', 'weapon2': '0.822', 'WEAPON3': '1.000', 'HITCOUNT': '1.880', 'weapon3': '2.276', 'DAMAGECOUNT': '7.395', 'FRAGCOUNT': '26.000'} [2023-02-24 20:45:13,349][213366] DAMAGECOUNT value on done: 141329.0 [2023-02-24 20:45:13,350][213366] Sum rewards: 29.496, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.920', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.108', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.554', 'weapon4': '0.608', 'WEAPON3': '1.100', 'HITCOUNT': '2.190', 'weapon3': '2.452', 'DAMAGECOUNT': '8.445', 'FRAGCOUNT': '28.000'} [2023-02-24 20:45:13,599][213382] DAMAGECOUNT value on done: 140242.0 [2023-02-24 20:45:13,599][213382] Sum rewards: 29.969, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.190', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.058', 'AMMO3': '0.128', 'weapon5': '0.180', 'AMMO4': '0.289', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '0.700', 'weapon4': '0.722', 'weapon2': '0.850', 'weapon3': '1.956', 'HITCOUNT': '2.140', 'DAMAGECOUNT': '9.459', 'FRAGCOUNT': '27.000'} [2023-02-24 20:45:13,630][213367] DAMAGECOUNT value on done: 142990.0 [2023-02-24 20:45:13,630][213367] Sum rewards: 33.956, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.489', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'weapon5': '0.118', 'AMMO3': '0.176', 'WEAPON4': '0.400', 'weapon2': '0.412', 'weapon4': '0.840', 'WEAPON3': '1.000', 'weapon3': '2.326', 'HITCOUNT': '2.350', 'DAMAGECOUNT': '9.849', 'FRAGCOUNT': '32.000'} [2023-02-24 20:45:13,666][213366] DAMAGECOUNT value on done: 154509.0 [2023-02-24 20:45:13,667][213366] Sum rewards: 27.501, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.572', 'ARMOR': '0.012', 'AMMO5': '0.014', 'AMMO2': '0.046', 'AMMO3': '0.202', 'AMMO4': '0.229', 'weapon5': '0.246', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.460', 'weapon2': '0.624', 'WEAPON3': '1.250', 'HITCOUNT': '2.030', 'weapon3': '2.352', 'DAMAGECOUNT': '9.108', 'FRAGCOUNT': '29.000'} [2023-02-24 20:45:13,722][213372] DAMAGECOUNT value on done: 146860.0 [2023-02-24 20:45:13,723][213372] Sum rewards: 38.823, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.661', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.044', 'AMMO3': '0.118', 'weapon5': '0.150', 'AMMO4': '0.219', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon2': '0.642', 'WEAPON3': '0.800', 'weapon4': '0.812', 'weapon3': '1.890', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '10.410', 'FRAGCOUNT': '33.000'} [2023-02-24 20:45:13,920][213382] DAMAGECOUNT value on done: 148552.0 [2023-02-24 20:45:13,921][213382] Sum rewards: 32.685, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.754', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon4': '0.126', 'AMMO4': '0.192', 'AMMO3': '0.193', 'weapon2': '0.312', 'WEAPON4': '0.350', 'weapon5': '0.416', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.310', 'weapon3': '2.734', 'DAMAGECOUNT': '11.550', 'FRAGCOUNT': '31.000'} [2023-02-24 20:45:13,937][213366] DAMAGECOUNT value on done: 150537.0 [2023-02-24 20:45:13,937][213366] Sum rewards: 41.893, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.059', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.141', 'AMMO3': '0.151', 'weapon5': '0.210', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.500', 'weapon2': '0.672', 'WEAPON3': '0.900', 'weapon3': '2.328', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '10.599', 'FRAGCOUNT': '37.000'} [2023-02-24 20:45:13,978][213383] DAMAGECOUNT value on done: 146675.0 [2023-02-24 20:45:13,979][213383] Sum rewards: 35.979, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.311', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'weapon5': '0.126', 'AMMO4': '0.168', 'AMMO3': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.550', 'weapon2': '0.752', 'WEAPON3': '1.250', 'weapon3': '2.276', 'HITCOUNT': '2.400', 'DAMAGECOUNT': '10.275', 'FRAGCOUNT': '34.000'} [2023-02-24 20:45:14,008][213368] DAMAGECOUNT value on done: 141509.0 [2023-02-24 20:45:14,009][213368] Sum rewards: 30.758, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.515', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO3': '0.130', 'AMMO4': '0.179', 'WEAPON4': '0.300', 'weapon5': '0.320', 'WEAPON5': '0.350', 'weapon4': '0.514', 'WEAPON3': '0.750', 'weapon2': '0.942', 'weapon3': '1.968', 'HITCOUNT': '2.070', 'DAMAGECOUNT': '8.697', 'FRAGCOUNT': '27.000'} [2023-02-24 20:45:14,035][213372] DAMAGECOUNT value on done: 143290.0 [2023-02-24 20:45:14,035][213372] Sum rewards: 24.857, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.317', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'WEAPON4': '0.300', 'weapon4': '0.450', 'weapon2': '0.624', 'WEAPON3': '1.050', 'HITCOUNT': '2.310', 'weapon3': '2.552', 'DAMAGECOUNT': '8.802', 'FRAGCOUNT': '23.000'} [2023-02-24 20:45:14,231][213382] DAMAGECOUNT value on done: 141714.0 [2023-02-24 20:45:14,231][213382] Sum rewards: 26.175, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.636', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.112', 'AMMO3': '0.129', 'weapon5': '0.176', 'WEAPON5': '0.250', 'weapon4': '0.316', 'WEAPON4': '0.350', 'WEAPON3': '0.850', 'weapon2': '0.870', 'HITCOUNT': '1.550', 'weapon3': '1.788', 'DAMAGECOUNT': '7.890', 'FRAGCOUNT': '24.000'} [2023-02-24 20:45:14,248][213366] DAMAGECOUNT value on done: 147099.0 [2023-02-24 20:45:14,249][213366] Sum rewards: 30.303, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.191', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon5': '0.106', 'AMMO3': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.592', 'weapon4': '0.720', 'WEAPON3': '0.750', 'weapon3': '2.004', 'HITCOUNT': '2.310', 'DAMAGECOUNT': '9.882', 'FRAGCOUNT': '24.000'} [2023-02-24 20:45:14,296][213383] DAMAGECOUNT value on done: 150694.0 [2023-02-24 20:45:14,297][213383] Sum rewards: 24.398, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.220', 'AMMO5': '0.013', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'weapon5': '0.256', 'WEAPON5': '0.350', 'weapon4': '0.546', 'weapon2': '0.990', 'WEAPON3': '1.000', 'HITCOUNT': '1.780', 'weapon3': '1.822', 'DAMAGECOUNT': '6.717', 'FRAGCOUNT': '24.000'} [2023-02-24 20:45:14,331][213368] DAMAGECOUNT value on done: 148025.0 [2023-02-24 20:45:14,332][213368] Sum rewards: 33.804, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.840', 'AMMO2': '0.013', 'AMMO5': '0.016', 'AMMO4': '0.062', 'weapon5': '0.086', 'AMMO3': '0.180', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.706', 'weapon4': '0.768', 'WEAPON3': '1.150', 'weapon3': '2.202', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '10.971', 'FRAGCOUNT': '30.000'} [2023-02-24 20:45:14,351][213369] DAMAGECOUNT value on done: 149688.0 [2023-02-24 20:45:14,352][213369] Sum rewards: 30.571, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.131', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.059', 'AMMO3': '0.117', 'AMMO4': '0.293', 'weapon2': '0.364', 'weapon5': '0.420', 'WEAPON5': '0.700', 'WEAPON4': '0.700', 'WEAPON3': '0.700', 'weapon4': '0.986', 'weapon3': '1.858', 'HITCOUNT': '2.100', 'DAMAGECOUNT': '9.627', 'FRAGCOUNT': '28.000'} [2023-02-24 20:45:14,553][213382] DAMAGECOUNT value on done: 146410.0 [2023-02-24 20:45:14,553][213382] Sum rewards: 34.529, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.908', 'AMMO5': '0.028', 'AMMO2': '0.046', 'AMMO3': '0.127', 'AMMO4': '0.232', 'weapon5': '0.296', 'weapon2': '0.496', 'WEAPON4': '0.500', 'WEAPON5': '0.700', 'WEAPON3': '0.800', 'weapon4': '1.008', 'weapon3': '1.818', 'HITCOUNT': '2.220', 'DAMAGECOUNT': '9.915', 'FRAGCOUNT': '30.000'} [2023-02-24 20:45:14,633][213368] DAMAGECOUNT value on done: 149561.0 [2023-02-24 20:45:14,633][213368] Sum rewards: 35.477, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.160', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.041', 'AMMO3': '0.179', 'AMMO4': '0.207', 'weapon5': '0.318', 'weapon4': '0.324', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.406', 'WEAPON3': '1.050', 'HITCOUNT': '2.280', 'weapon3': '2.604', 'DAMAGECOUNT': '10.908', 'FRAGCOUNT': '32.500'} [2023-02-24 20:45:14,641][213384] Large shaping reward -2.534 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 20:45:14,652][213384] DAMAGECOUNT value on done: 148168.0 [2023-02-24 20:45:14,652][213384] Sum rewards: 27.754, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.350', 'AMMO5': '0.008', 'AMMO2': '0.029', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'weapon5': '0.192', 'WEAPON5': '0.250', 'weapon4': '0.352', 'weapon2': '0.520', 'WEAPON3': '1.150', 'HITCOUNT': '2.400', 'weapon3': '2.612', 'DAMAGECOUNT': '10.119', 'FRAGCOUNT': '24.500'} [2023-02-24 20:45:14,657][213369] DAMAGECOUNT value on done: 149009.0 [2023-02-24 20:45:14,657][213369] Sum rewards: 27.190, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.024', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO4': '0.152', 'AMMO3': '0.172', 'weapon2': '0.316', 'WEAPON4': '0.400', 'weapon4': '0.912', 'WEAPON3': '1.150', 'HITCOUNT': '2.080', 'weapon3': '2.234', 'DAMAGECOUNT': '8.631', 'FRAGCOUNT': '26.000'} [2023-02-24 20:45:14,745][213383] DAMAGECOUNT value on done: 146898.0 [2023-02-24 20:45:14,746][213383] Sum rewards: 24.613, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.833', 'AMMO5': '0.015', 'AMMO2': '0.052', 'AMMO3': '0.098', 'AMMO4': '0.261', 'weapon5': '0.338', 'WEAPON5': '0.400', 'weapon4': '0.552', 'WEAPON3': '0.650', 'WEAPON4': '0.650', 'weapon2': '0.946', 'HITCOUNT': '1.800', 'weapon3': '1.892', 'DAMAGECOUNT': '7.791', 'FRAGCOUNT': '23.000'} [2023-02-24 20:45:14,938][213368] DAMAGECOUNT value on done: 142411.0 [2023-02-24 20:45:14,939][213368] Sum rewards: 20.294, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.684', 'AMMO5': '0.025', 'AMMO2': '0.056', 'AMMO3': '0.120', 'AMMO4': '0.278', 'weapon5': '0.446', 'weapon4': '0.454', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon2': '0.656', 'WEAPON3': '0.700', 'HITCOUNT': '1.730', 'weapon3': '2.142', 'DAMAGECOUNT': '7.671', 'FRAGCOUNT': '20.000'} [2023-02-24 20:45:14,963][213384] DAMAGECOUNT value on done: 137768.0 [2023-02-24 20:45:14,964][213384] Sum rewards: 27.386, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.397', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.179', 'AMMO3': '0.182', 'weapon2': '0.332', 'WEAPON4': '0.350', 'weapon4': '0.990', 'WEAPON3': '1.200', 'weapon3': '2.276', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '9.669', 'FRAGCOUNT': '26.000'} [2023-02-24 20:45:15,014][213369] DAMAGECOUNT value on done: 150139.0 [2023-02-24 20:45:15,014][213369] Sum rewards: 21.991, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.724', 'AMMO5': '0.016', 'AMMO2': '0.035', 'AMMO4': '0.173', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon4': '0.272', 'weapon5': '0.298', 'WEAPON5': '0.450', 'weapon2': '0.696', 'WEAPON3': '1.350', 'HITCOUNT': '1.960', 'weapon3': '2.350', 'DAMAGECOUNT': '8.400', 'FRAGCOUNT': '23.000'} [2023-02-24 20:45:15,048][213383] DAMAGECOUNT value on done: 139907.0 [2023-02-24 20:45:15,049][213383] Sum rewards: 30.668, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.077', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO5': '0.017', 'AMMO4': '0.039', 'WEAPON4': '0.150', 'AMMO3': '0.171', 'weapon4': '0.214', 'weapon5': '0.314', 'WEAPON5': '0.400', 'weapon2': '0.650', 'WEAPON3': '1.000', 'HITCOUNT': '2.100', 'weapon3': '2.474', 'DAMAGECOUNT': '8.703', 'FRAGCOUNT': '28.000'} [2023-02-24 20:45:15,107][213384] DAMAGECOUNT value on done: 150044.0 [2023-02-24 20:45:15,108][213384] Sum rewards: 27.311, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.360', 'AMMO5': '0.011', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.102', 'weapon2': '0.124', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.304', 'ARMOR': '0.442', 'WEAPON3': '1.150', 'HITCOUNT': '2.150', 'weapon3': '3.112', 'DAMAGECOUNT': '8.553', 'FRAGCOUNT': '24.000'} [2023-02-24 20:45:15,243][213332] Fps is (10 sec: 13106.9, 60 sec: 13311.9, 300 sec: 13301.6). Total num frames: 116674560. Throughput: 0: 3333.0. Samples: 4165202. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:45:15,244][213332] Avg episode reward: [(0, '29.400')] [2023-02-24 20:45:15,287][213352] Saving new best policy, reward=29.400! [2023-02-24 20:45:15,289][213365] Updated weights for policy 0, policy_version 28486 (0.0010) [2023-02-24 20:45:15,324][213369] DAMAGECOUNT value on done: 134915.0 [2023-02-24 20:45:15,325][213369] Sum rewards: 23.393, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.637', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon5': '0.190', 'weapon2': '0.430', 'WEAPON3': '1.150', 'HITCOUNT': '1.940', 'weapon3': '2.966', 'DAMAGECOUNT': '7.587', 'FRAGCOUNT': '22.000'} [2023-02-24 20:45:15,439][213384] DAMAGECOUNT value on done: 151093.0 [2023-02-24 20:45:15,440][213384] Sum rewards: 41.435, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.302', 'AMMO2': '0.002', 'AMMO5': '0.006', 'AMMO4': '0.011', 'weapon5': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'weapon4': '0.252', 'weapon2': '0.618', 'WEAPON3': '1.100', 'HITCOUNT': '2.280', 'weapon3': '2.794', 'DAMAGECOUNT': '10.356', 'FRAGCOUNT': '36.000'} [2023-02-24 20:45:18,317][213365] Updated weights for policy 0, policy_version 28496 (0.0009) [2023-02-24 20:45:20,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13301.6). Total num frames: 116744192. Throughput: 0: 3335.7. Samples: 4175386. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:45:20,243][213332] Avg episode reward: [(0, '29.459')] [2023-02-24 20:45:20,244][213352] Saving new best policy, reward=29.459! [2023-02-24 20:45:21,355][213365] Updated weights for policy 0, policy_version 28506 (0.0009) [2023-02-24 20:45:24,422][213365] Updated weights for policy 0, policy_version 28516 (0.0009) [2023-02-24 20:45:25,243][213332] Fps is (10 sec: 13517.1, 60 sec: 13312.0, 300 sec: 13301.6). Total num frames: 116809728. Throughput: 0: 3335.4. Samples: 4195396. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:45:25,243][213332] Avg episode reward: [(0, '29.459')] [2023-02-24 20:45:27,294][213369] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 20:45:27,433][213365] Updated weights for policy 0, policy_version 28526 (0.0009) [2023-02-24 20:45:29,876][213372] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 20:45:30,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13301.6). Total num frames: 116879360. Throughput: 0: 3337.2. Samples: 4215450. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:45:30,243][213332] Avg episode reward: [(0, '29.459')] [2023-02-24 20:45:30,523][213365] Updated weights for policy 0, policy_version 28536 (0.0009) [2023-02-24 20:45:32,787][213367] DAMAGECOUNT value on done: 148606.0 [2023-02-24 20:45:32,787][213367] Sum rewards: 28.010, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.902', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.034', 'AMMO4': '0.171', 'AMMO3': '0.195', 'weapon5': '0.308', 'weapon4': '0.368', 'WEAPON4': '0.400', 'weapon2': '0.434', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '1.900', 'weapon3': '2.530', 'DAMAGECOUNT': '9.048', 'FRAGCOUNT': '28.000'} [2023-02-24 20:45:33,103][213367] DAMAGECOUNT value on done: 150455.0 [2023-02-24 20:45:33,103][213367] Sum rewards: 30.937, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.008', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'AMMO4': '0.211', 'WEAPON4': '0.450', 'ARMOR': '0.455', 'weapon2': '0.664', 'WEAPON3': '0.850', 'weapon4': '1.096', 'weapon3': '1.790', 'HITCOUNT': '2.350', 'DAMAGECOUNT': '9.240', 'FRAGCOUNT': '28.000'} [2023-02-24 20:45:33,121][213372] DAMAGECOUNT value on done: 151522.0 [2023-02-24 20:45:33,121][213372] Sum rewards: 42.463, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.095', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.094', 'AMMO4': '0.131', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.490', 'weapon2': '0.682', 'WEAPON3': '1.150', 'weapon3': '2.512', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '11.736', 'FRAGCOUNT': '38.000'} [2023-02-24 20:45:33,371][213366] DAMAGECOUNT value on done: 144322.0 [2023-02-24 20:45:33,371][213366] Sum rewards: 30.663, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.110', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.152', 'AMMO3': '0.160', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.620', 'weapon4': '0.778', 'WEAPON3': '1.000', 'HITCOUNT': '2.170', 'weapon3': '2.176', 'DAMAGECOUNT': '8.979', 'FRAGCOUNT': '28.000'} [2023-02-24 20:45:33,409][213367] DAMAGECOUNT value on done: 151936.0 [2023-02-24 20:45:33,410][213367] Sum rewards: 41.024, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.026', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.044', 'AMMO3': '0.114', 'AMMO4': '0.218', 'weapon2': '0.228', 'weapon5': '0.496', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '0.700', 'weapon4': '0.820', 'weapon3': '2.072', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '11.364', 'FRAGCOUNT': '36.000'} [2023-02-24 20:45:33,439][213372] DAMAGECOUNT value on done: 151741.0 [2023-02-24 20:45:33,440][213372] Sum rewards: 26.791, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.567', 'ARMOR': '0.012', 'AMMO5': '0.016', 'AMMO2': '0.033', 'AMMO3': '0.145', 'AMMO4': '0.164', 'weapon5': '0.266', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.450', 'weapon4': '0.692', 'WEAPON3': '0.950', 'weapon3': '1.914', 'HITCOUNT': '2.190', 'DAMAGECOUNT': '10.626', 'FRAGCOUNT': '23.000'} [2023-02-24 20:45:33,578][213365] Updated weights for policy 0, policy_version 28546 (0.0009) [2023-02-24 20:45:33,687][213366] DAMAGECOUNT value on done: 157594.0 [2023-02-24 20:45:33,688][213366] Sum rewards: 35.326, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.416', 'AMMO5': '0.019', 'AMMO2': '0.045', 'AMMO3': '0.105', 'AMMO4': '0.223', 'WEAPON4': '0.300', 'weapon5': '0.338', 'WEAPON5': '0.450', 'weapon4': '0.674', 'weapon2': '0.690', 'WEAPON3': '0.800', 'weapon3': '2.012', 'HITCOUNT': '2.330', 'DAMAGECOUNT': '9.255', 'FRAGCOUNT': '30.000'} [2023-02-24 20:45:33,698][213382] DAMAGECOUNT value on done: 143470.0 [2023-02-24 20:45:33,699][213382] Sum rewards: 32.296, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.168', 'AMMO5': '0.019', 'AMMO2': '0.043', 'AMMO3': '0.177', 'AMMO4': '0.216', 'weapon5': '0.276', 'weapon4': '0.372', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'weapon2': '0.702', 'WEAPON3': '1.050', 'HITCOUNT': '2.260', 'weapon3': '2.314', 'DAMAGECOUNT': '9.684', 'FRAGCOUNT': '29.000'} [2023-02-24 20:45:33,727][213367] DAMAGECOUNT value on done: 146832.0 [2023-02-24 20:45:33,727][213367] Sum rewards: 39.557, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.442', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.168', 'WEAPON5': '0.300', 'weapon5': '0.310', 'WEAPON4': '0.400', 'weapon4': '0.572', 'weapon2': '0.636', 'WEAPON3': '1.000', 'weapon3': '2.190', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '11.526', 'FRAGCOUNT': '34.000'} [2023-02-24 20:45:33,820][213372] DAMAGECOUNT value on done: 149370.0 [2023-02-24 20:45:33,820][213372] Sum rewards: 27.427, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.446', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO5': '0.012', 'AMMO4': '0.042', 'AMMO3': '0.124', 'WEAPON4': '0.250', 'weapon5': '0.298', 'WEAPON5': '0.400', 'weapon4': '0.554', 'WEAPON3': '0.800', 'weapon2': '0.934', 'weapon3': '1.336', 'HITCOUNT': '1.580', 'DAMAGECOUNT': '7.530', 'FRAGCOUNT': '24.000'} [2023-02-24 20:45:33,958][213366] DAMAGECOUNT value on done: 154002.0 [2023-02-24 20:45:33,958][213366] Sum rewards: 37.396, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.990', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.199', 'weapon5': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.308', 'weapon2': '0.356', 'WEAPON3': '1.400', 'HITCOUNT': '2.520', 'weapon3': '2.720', 'DAMAGECOUNT': '10.395', 'FRAGCOUNT': '36.000'} [2023-02-24 20:45:34,026][213382] DAMAGECOUNT value on done: 151765.0 [2023-02-24 20:45:34,027][213382] Sum rewards: 27.209, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.180', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.033', 'AMMO3': '0.148', 'AMMO4': '0.167', 'weapon5': '0.318', 'weapon2': '0.402', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '0.900', 'weapon4': '1.006', 'weapon3': '1.892', 'HITCOUNT': '2.220', 'DAMAGECOUNT': '9.381', 'FRAGCOUNT': '26.000'} [2023-02-24 20:45:34,118][213383] DAMAGECOUNT value on done: 150161.0 [2023-02-24 20:45:34,119][213383] Sum rewards: 36.947, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.983', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.066', 'AMMO3': '0.114', 'AMMO4': '0.332', 'weapon5': '0.360', 'WEAPON5': '0.600', 'weapon2': '0.734', 'weapon4': '0.764', 'WEAPON4': '0.800', 'WEAPON3': '0.850', 'weapon3': '1.828', 'HITCOUNT': '2.250', 'DAMAGECOUNT': '10.458', 'FRAGCOUNT': '35.000'} [2023-02-24 20:45:34,140][213368] DAMAGECOUNT value on done: 144707.0 [2023-02-24 20:45:34,141][213368] Sum rewards: 35.572, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.582', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.112', 'AMMO3': '0.114', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'WEAPON4': '0.450', 'weapon4': '0.670', 'WEAPON3': '0.800', 'weapon2': '0.960', 'weapon3': '2.068', 'HITCOUNT': '2.320', 'DAMAGECOUNT': '9.594', 'FRAGCOUNT': '31.000'} [2023-02-24 20:45:34,148][213372] DAMAGECOUNT value on done: 146747.0 [2023-02-24 20:45:34,148][213372] Sum rewards: 34.873, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.092', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon4': '0.174', 'AMMO3': '0.178', 'AMMO4': '0.231', 'weapon5': '0.330', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.790', 'WEAPON3': '1.000', 'HITCOUNT': '2.180', 'weapon3': '2.348', 'DAMAGECOUNT': '10.371', 'FRAGCOUNT': '31.000'} [2023-02-24 20:45:34,281][213366] DAMAGECOUNT value on done: 150180.0 [2023-02-24 20:45:34,281][213366] Sum rewards: 26.141, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.109', 'AMMO5': '0.014', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.154', 'weapon5': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.452', 'weapon2': '0.586', 'WEAPON3': '0.950', 'HITCOUNT': '1.910', 'weapon3': '2.358', 'DAMAGECOUNT': '9.243', 'FRAGCOUNT': '22.000'} [2023-02-24 20:45:34,349][213369] DAMAGECOUNT value on done: 152367.0 [2023-02-24 20:45:34,349][213369] Sum rewards: 23.090, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.824', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.144', 'AMMO3': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon2': '0.492', 'weapon4': '0.650', 'WEAPON3': '0.900', 'HITCOUNT': '2.250', 'weapon3': '2.464', 'DAMAGECOUNT': '8.037', 'FRAGCOUNT': '21.000'} [2023-02-24 20:45:34,356][213382] DAMAGECOUNT value on done: 144302.0 [2023-02-24 20:45:34,357][213382] Sum rewards: 19.729, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.904', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.033', 'AMMO4': '0.165', 'AMMO3': '0.199', 'weapon5': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.458', 'weapon4': '0.768', 'WEAPON3': '1.200', 'HITCOUNT': '1.670', 'weapon3': '1.938', 'DAMAGECOUNT': '7.764', 'FRAGCOUNT': '20.000'} [2023-02-24 20:45:34,441][213383] DAMAGECOUNT value on done: 153632.0 [2023-02-24 20:45:34,441][213383] Sum rewards: 29.300, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.065', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'weapon4': '0.074', 'WEAPON4': '0.100', 'weapon5': '0.194', 'AMMO3': '0.226', 'WEAPON5': '0.300', 'weapon2': '0.900', 'WEAPON3': '1.450', 'HITCOUNT': '1.990', 'weapon3': '2.518', 'DAMAGECOUNT': '8.814', 'FRAGCOUNT': '29.000'} [2023-02-24 20:45:34,466][213368] DAMAGECOUNT value on done: 151252.0 [2023-02-24 20:45:34,466][213368] Sum rewards: 32.037, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.724', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO3': '0.140', 'AMMO4': '0.159', 'weapon5': '0.276', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.484', 'weapon4': '0.838', 'WEAPON3': '0.900', 'weapon3': '1.898', 'HITCOUNT': '2.240', 'DAMAGECOUNT': '9.681', 'FRAGCOUNT': '26.000'} [2023-02-24 20:45:34,666][213369] DAMAGECOUNT value on done: 152057.0 [2023-02-24 20:45:34,667][213369] Sum rewards: 30.705, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.894', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.033', 'AMMO3': '0.099', 'weapon4': '0.136', 'AMMO4': '0.167', 'WEAPON4': '0.200', 'weapon5': '0.272', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'weapon2': '1.514', 'weapon3': '1.862', 'HITCOUNT': '1.950', 'DAMAGECOUNT': '9.144', 'FRAGCOUNT': '25.000'} [2023-02-24 20:45:34,675][213382] DAMAGECOUNT value on done: 149400.0 [2023-02-24 20:45:34,675][213382] Sum rewards: 34.751, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO3': '0.070', 'HEALTH': '0.158', 'AMMO4': '0.225', 'weapon5': '0.348', 'WEAPON3': '0.400', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.516', 'weapon4': '0.782', 'HITCOUNT': '1.860', 'weapon3': '1.962', 'DAMAGECOUNT': '8.970', 'FRAGCOUNT': '29.000'} [2023-02-24 20:45:34,752][213384] DAMAGECOUNT value on done: 151267.0 [2023-02-24 20:45:34,753][213384] Sum rewards: 36.346, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.040', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.014', 'WEAPON4': '0.050', 'weapon4': '0.112', 'weapon5': '0.160', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'weapon2': '0.352', 'WEAPON3': '1.050', 'HITCOUNT': '2.130', 'weapon3': '3.100', 'DAMAGECOUNT': '9.297', 'FRAGCOUNT': '32.000'} [2023-02-24 20:45:34,777][213368] DAMAGECOUNT value on done: 153238.0 [2023-02-24 20:45:34,778][213368] Sum rewards: 29.531, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.035', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.140', 'AMMO4': '0.200', 'AMMO3': '0.219', 'weapon2': '0.256', 'weapon4': '0.318', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '2.500', 'weapon3': '3.000', 'DAMAGECOUNT': '11.031', 'FRAGCOUNT': '30.000'} [2023-02-24 20:45:34,870][213383] DAMAGECOUNT value on done: 149878.0 [2023-02-24 20:45:34,871][213383] Sum rewards: 30.381, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.007', 'weapon7': '0.014', 'AMMO2': '0.026', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.122', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'weapon4': '0.448', 'weapon2': '0.674', 'HEALTH': '0.684', 'WEAPON3': '0.850', 'HITCOUNT': '1.940', 'weapon3': '2.498', 'DAMAGECOUNT': '8.937', 'FRAGCOUNT': '26.000'} [2023-02-24 20:45:35,022][213369] DAMAGECOUNT value on done: 153267.0 [2023-02-24 20:45:35,022][213369] Sum rewards: 35.990, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.292', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.031', 'AMMO3': '0.130', 'AMMO4': '0.155', 'weapon5': '0.316', 'WEAPON5': '0.400', 'weapon2': '0.442', 'WEAPON4': '0.500', 'WEAPON3': '0.800', 'weapon4': '0.820', 'weapon3': '1.978', 'HITCOUNT': '2.050', 'DAMAGECOUNT': '9.384', 'FRAGCOUNT': '33.000'} [2023-02-24 20:45:35,056][213384] DAMAGECOUNT value on done: 140673.0 [2023-02-24 20:45:35,057][213384] Sum rewards: 28.425, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.940', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.137', 'weapon5': '0.180', 'AMMO3': '0.181', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.652', 'weapon2': '0.864', 'WEAPON3': '1.100', 'HITCOUNT': '1.730', 'weapon3': '1.918', 'DAMAGECOUNT': '8.709', 'FRAGCOUNT': '26.000'} [2023-02-24 20:45:35,078][213368] DAMAGECOUNT value on done: 145312.0 [2023-02-24 20:45:35,078][213368] Sum rewards: 29.028, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.376', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.066', 'AMMO4': '0.074', 'weapon5': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.178', 'WEAPON5': '0.250', 'weapon2': '0.568', 'WEAPON3': '1.200', 'HITCOUNT': '2.040', 'weapon3': '3.038', 'DAMAGECOUNT': '8.703', 'FRAGCOUNT': '27.000'} [2023-02-24 20:45:35,178][213383] DAMAGECOUNT value on done: 143027.0 [2023-02-24 20:45:35,179][213383] Sum rewards: 33.786, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.059', 'AMMO3': '0.076', 'weapon5': '0.138', 'WEAPON5': '0.250', 'HEALTH': '0.281', 'AMMO4': '0.294', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'weapon2': '0.522', 'weapon4': '0.882', 'weapon3': '1.928', 'HITCOUNT': '2.130', 'DAMAGECOUNT': '9.360', 'FRAGCOUNT': '26.000'} [2023-02-24 20:45:35,210][213384] DAMAGECOUNT value on done: 153886.0 [2023-02-24 20:45:35,210][213384] Sum rewards: 27.381, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.592', 'AMMO5': '0.017', 'AMMO2': '0.053', 'AMMO3': '0.204', 'AMMO4': '0.264', 'weapon5': '0.278', 'weapon4': '0.410', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon2': '0.708', 'WEAPON3': '1.200', 'weapon3': '2.242', 'HITCOUNT': '2.270', 'DAMAGECOUNT': '11.526', 'FRAGCOUNT': '26.000'} [2023-02-24 20:45:35,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13287.7). Total num frames: 116944896. Throughput: 0: 3339.2. Samples: 4225616. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:45:35,243][213332] Avg episode reward: [(0, '30.520')] [2023-02-24 20:45:35,247][213352] Saving new best policy, reward=30.520! [2023-02-24 20:45:35,335][213369] DAMAGECOUNT value on done: 138394.0 [2023-02-24 20:45:35,336][213369] Sum rewards: 35.521, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.953', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.045', 'AMMO3': '0.132', 'AMMO4': '0.227', 'weapon5': '0.250', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon4': '0.558', 'weapon2': '0.614', 'WEAPON3': '0.850', 'weapon3': '2.226', 'HITCOUNT': '2.250', 'DAMAGECOUNT': '10.401', 'FRAGCOUNT': '31.000'} [2023-02-24 20:45:35,523][213384] DAMAGECOUNT value on done: 154602.0 [2023-02-24 20:45:35,524][213384] Sum rewards: 37.237, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.392', 'AMMO5': '0.019', 'weapon4': '0.020', 'AMMO2': '0.022', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'weapon5': '0.210', 'AMMO3': '0.234', 'WEAPON5': '0.500', 'weapon2': '0.772', 'WEAPON3': '1.450', 'HITCOUNT': '2.190', 'weapon3': '2.674', 'DAMAGECOUNT': '10.527', 'FRAGCOUNT': '35.000'} [2023-02-24 20:45:36,630][213365] Updated weights for policy 0, policy_version 28556 (0.0009) [2023-02-24 20:45:39,750][213365] Updated weights for policy 0, policy_version 28566 (0.0009) [2023-02-24 20:45:40,243][213332] Fps is (10 sec: 13107.2, 60 sec: 13312.0, 300 sec: 13273.8). Total num frames: 117010432. Throughput: 0: 3341.6. Samples: 4245614. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:45:40,243][213332] Avg episode reward: [(0, '30.721')] [2023-02-24 20:45:40,244][213352] Saving new best policy, reward=30.721! [2023-02-24 20:45:42,788][213365] Updated weights for policy 0, policy_version 28576 (0.0009) [2023-02-24 20:45:45,243][213332] Fps is (10 sec: 13107.3, 60 sec: 13312.0, 300 sec: 13273.8). Total num frames: 117075968. Throughput: 0: 3340.7. Samples: 4265536. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:45:45,243][213332] Avg episode reward: [(0, '30.721')] [2023-02-24 20:45:45,855][213365] Updated weights for policy 0, policy_version 28586 (0.0009) [2023-02-24 20:45:48,940][213365] Updated weights for policy 0, policy_version 28596 (0.0009) [2023-02-24 20:45:50,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13273.8). Total num frames: 117145600. Throughput: 0: 3339.7. Samples: 4275670. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:45:50,243][213332] Avg episode reward: [(0, '30.721')] [2023-02-24 20:45:50,486][213382] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 20:45:51,917][213365] Updated weights for policy 0, policy_version 28606 (0.0009) [2023-02-24 20:45:52,857][213367] DAMAGECOUNT value on done: 150721.0 [2023-02-24 20:45:52,857][213367] Sum rewards: 13.239, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.846', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon7': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.163', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'weapon5': '0.266', 'WEAPON5': '0.300', 'weapon4': '0.490', 'weapon2': '0.822', 'WEAPON3': '1.100', 'HITCOUNT': '1.690', 'weapon3': '1.816', 'DAMAGECOUNT': '6.345', 'FRAGCOUNT': '14.000'} [2023-02-24 20:45:53,176][213367] DAMAGECOUNT value on done: 154154.0 [2023-02-24 20:45:53,176][213367] Sum rewards: 36.994, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.160', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.024', 'AMMO3': '0.117', 'weapon5': '0.158', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.602', 'WEAPON3': '0.700', 'weapon2': '0.882', 'weapon3': '2.102', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '11.097', 'FRAGCOUNT': '29.000'} [2023-02-24 20:45:53,230][213372] DAMAGECOUNT value on done: 154395.0 [2023-02-24 20:45:53,231][213372] Sum rewards: 26.727, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.114', 'AMMO5': '0.011', 'AMMO2': '0.036', 'AMMO4': '0.178', 'AMMO3': '0.196', 'weapon5': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.484', 'weapon2': '0.610', 'WEAPON3': '1.150', 'HITCOUNT': '1.850', 'weapon3': '2.260', 'DAMAGECOUNT': '8.619', 'FRAGCOUNT': '26.000'} [2023-02-24 20:45:53,490][213367] DAMAGECOUNT value on done: 154659.0 [2023-02-24 20:45:53,490][213367] Sum rewards: 24.812, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.495', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.044', 'AMMO3': '0.180', 'weapon4': '0.204', 'weapon5': '0.210', 'AMMO4': '0.220', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.872', 'WEAPON3': '1.100', 'HITCOUNT': '2.010', 'weapon3': '2.426', 'DAMAGECOUNT': '8.169', 'FRAGCOUNT': '26.000'} [2023-02-24 20:45:53,526][213366] DAMAGECOUNT value on done: 148357.0 [2023-02-24 20:45:53,527][213366] Sum rewards: 42.256, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.510', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.146', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.388', 'weapon4': '0.464', 'WEAPON3': '1.400', 'weapon3': '2.726', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.105', 'FRAGCOUNT': '39.000'} [2023-02-24 20:45:53,550][213372] DAMAGECOUNT value on done: 155472.0 [2023-02-24 20:45:53,551][213372] Sum rewards: 40.656, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.265', 'AMMO5': '0.010', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'AMMO3': '0.164', 'AMMO4': '0.182', 'weapon5': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.630', 'weapon4': '0.818', 'WEAPON3': '1.050', 'weapon3': '1.942', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '11.193', 'FRAGCOUNT': '36.000'} [2023-02-24 20:45:53,764][213382] DAMAGECOUNT value on done: 146216.0 [2023-02-24 20:45:53,765][213382] Sum rewards: 21.063, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.950', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.067', 'AMMO3': '0.086', 'AMMO4': '0.335', 'weapon2': '0.338', 'weapon5': '0.392', 'WEAPON3': '0.500', 'WEAPON5': '0.650', 'WEAPON4': '0.800', 'weapon3': '1.140', 'weapon4': '1.648', 'HITCOUNT': '2.040', 'DAMAGECOUNT': '8.238', 'FRAGCOUNT': '18.500'} [2023-02-24 20:45:53,794][213367] DAMAGECOUNT value on done: 150203.0 [2023-02-24 20:45:53,795][213367] Sum rewards: 32.440, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.108', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon4': '0.142', 'WEAPON4': '0.200', 'weapon2': '0.220', 'weapon5': '0.222', 'AMMO3': '0.233', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '2.320', 'weapon3': '3.062', 'DAMAGECOUNT': '10.113', 'FRAGCOUNT': '32.000'} [2023-02-24 20:45:53,848][213366] DAMAGECOUNT value on done: 160453.0 [2023-02-24 20:45:53,849][213366] Sum rewards: 33.667, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.552', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.067', 'AMMO3': '0.117', 'weapon4': '0.140', 'WEAPON4': '0.150', 'weapon5': '0.252', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'weapon2': '1.184', 'HITCOUNT': '1.770', 'weapon3': '2.086', 'DAMAGECOUNT': '8.577', 'FRAGCOUNT': '27.000'} [2023-02-24 20:45:53,934][213372] DAMAGECOUNT value on done: 151928.0 [2023-02-24 20:45:53,934][213372] Sum rewards: 24.867, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.404', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.164', 'weapon5': '0.196', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.546', 'weapon2': '0.804', 'WEAPON3': '1.100', 'HITCOUNT': '2.010', 'weapon3': '2.164', 'DAMAGECOUNT': '7.674', 'FRAGCOUNT': '23.000'} [2023-02-24 20:45:54,076][213366] DAMAGECOUNT value on done: 156411.0 [2023-02-24 20:45:54,077][213366] Sum rewards: 21.990, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.902', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.195', 'weapon5': '0.198', 'weapon4': '0.216', 'WEAPON5': '0.250', 'ARMOR': '0.457', 'weapon2': '0.644', 'WEAPON3': '1.200', 'HITCOUNT': '1.960', 'weapon3': '2.630', 'DAMAGECOUNT': '7.227', 'FRAGCOUNT': '21.000'} [2023-02-24 20:45:54,087][213382] DAMAGECOUNT value on done: 154806.0 [2023-02-24 20:45:54,087][213382] Sum rewards: 26.621, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.828', 'AMMO5': '0.018', 'AMMO2': '0.020', 'weapon5': '0.076', 'AMMO4': '0.101', 'AMMO3': '0.150', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon4': '0.584', 'weapon2': '0.794', 'WEAPON3': '0.950', 'weapon3': '2.302', 'HITCOUNT': '2.330', 'DAMAGECOUNT': '9.123', 'FRAGCOUNT': '24.000'} [2023-02-24 20:45:54,228][213383] DAMAGECOUNT value on done: 152878.0 [2023-02-24 20:45:54,229][213383] Sum rewards: 29.978, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'weapon4': '0.618', 'HEALTH': '0.640', 'weapon2': '0.668', 'WEAPON3': '0.850', 'HITCOUNT': '2.010', 'weapon3': '2.432', 'DAMAGECOUNT': '8.151', 'FRAGCOUNT': '26.000'} [2023-02-24 20:45:54,248][213372] DAMAGECOUNT value on done: 149645.0 [2023-02-24 20:45:54,248][213372] Sum rewards: 26.325, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.947', 'ARMOR': '0.008', 'AMMO5': '0.023', 'AMMO2': '0.056', 'AMMO3': '0.115', 'AMMO4': '0.278', 'weapon5': '0.388', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'weapon4': '0.724', 'weapon2': '0.748', 'WEAPON4': '0.750', 'weapon3': '1.688', 'HITCOUNT': '1.850', 'DAMAGECOUNT': '8.694', 'FRAGCOUNT': '26.000'} [2023-02-24 20:45:54,272][213368] DAMAGECOUNT value on done: 147580.0 [2023-02-24 20:45:54,272][213368] Sum rewards: 25.309, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.620', 'AMMO5': '0.017', 'AMMO2': '0.036', 'AMMO3': '0.130', 'weapon5': '0.136', 'AMMO4': '0.180', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.464', 'WEAPON3': '0.850', 'weapon4': '0.864', 'weapon3': '1.972', 'HITCOUNT': '2.260', 'DAMAGECOUNT': '8.619', 'FRAGCOUNT': '23.000'} [2023-02-24 20:45:54,369][213382] DAMAGECOUNT value on done: 146628.0 [2023-02-24 20:45:54,369][213382] Sum rewards: 24.746, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.087', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.110', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.266', 'weapon2': '0.700', 'WEAPON3': '1.000', 'HITCOUNT': '1.590', 'weapon3': '2.294', 'DAMAGECOUNT': '6.978', 'FRAGCOUNT': '23.000'} [2023-02-24 20:45:54,404][213366] DAMAGECOUNT value on done: 153061.0 [2023-02-24 20:45:54,405][213366] Sum rewards: 24.921, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.774', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.090', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon4': '0.298', 'weapon2': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.160', 'weapon3': '2.924', 'DAMAGECOUNT': '8.643', 'FRAGCOUNT': '26.000'} [2023-02-24 20:45:54,466][213369] DAMAGECOUNT value on done: 155654.0 [2023-02-24 20:45:54,467][213369] Sum rewards: 35.569, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.822', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.190', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.440', 'weapon2': '0.740', 'WEAPON3': '1.250', 'weapon3': '2.328', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '9.861', 'FRAGCOUNT': '32.000'} [2023-02-24 20:45:54,556][213383] DAMAGECOUNT value on done: 156428.0 [2023-02-24 20:45:54,557][213383] Sum rewards: 23.263, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.909', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.049', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon5': '0.214', 'AMMO4': '0.246', 'WEAPON4': '0.450', 'weapon4': '0.640', 'weapon2': '0.714', 'WEAPON3': '1.200', 'weapon3': '1.976', 'HITCOUNT': '1.990', 'DAMAGECOUNT': '8.343', 'FRAGCOUNT': '25.000'} [2023-02-24 20:45:54,592][213368] DAMAGECOUNT value on done: 154315.0 [2023-02-24 20:45:54,592][213368] Sum rewards: 33.543, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.857', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.122', 'weapon5': '0.148', 'AMMO4': '0.189', 'WEAPON5': '0.300', 'weapon4': '0.348', 'WEAPON4': '0.350', 'WEAPON3': '0.750', 'weapon2': '0.920', 'HITCOUNT': '2.250', 'weapon3': '2.280', 'DAMAGECOUNT': '9.189', 'FRAGCOUNT': '28.000'} [2023-02-24 20:45:54,677][213382] DAMAGECOUNT value on done: 152392.0 [2023-02-24 20:45:54,678][213382] Sum rewards: 31.076, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.564', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO3': '0.103', 'AMMO4': '0.186', 'weapon5': '0.226', 'weapon2': '0.392', 'WEAPON5': '0.400', 'WEAPON4': '0.650', 'WEAPON3': '0.650', 'weapon4': '1.050', 'weapon3': '1.714', 'HITCOUNT': '1.990', 'DAMAGECOUNT': '8.976', 'FRAGCOUNT': '26.000'} [2023-02-24 20:45:54,787][213369] DAMAGECOUNT value on done: 154776.0 [2023-02-24 20:45:54,788][213369] Sum rewards: 26.793, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.398', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO3': '0.134', 'weapon5': '0.154', 'WEAPON4': '0.250', 'weapon4': '0.256', 'WEAPON5': '0.300', 'WEAPON3': '0.800', 'weapon2': '0.852', 'HITCOUNT': '1.870', 'weapon3': '2.522', 'DAMAGECOUNT': '8.157', 'FRAGCOUNT': '23.000'} [2023-02-24 20:45:54,891][213368] DAMAGECOUNT value on done: 156108.0 [2023-02-24 20:45:54,891][213368] Sum rewards: 24.275, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.570', 'AMMO5': '0.005', 'AMMO2': '0.051', 'weapon5': '0.106', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'AMMO4': '0.253', 'weapon2': '0.304', 'ARMOR': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.900', 'WEAPON3': '1.050', 'weapon3': '2.200', 'HITCOUNT': '2.300', 'DAMAGECOUNT': '8.610', 'FRAGCOUNT': '24.000'} [2023-02-24 20:45:54,909][213384] DAMAGECOUNT value on done: 154450.0 [2023-02-24 20:45:54,909][213384] Sum rewards: 33.027, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.424', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.076', 'AMMO4': '0.127', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.362', 'weapon2': '0.680', 'WEAPON3': '1.050', 'HITCOUNT': '2.260', 'weapon3': '2.516', 'DAMAGECOUNT': '9.549', 'FRAGCOUNT': '30.000'} [2023-02-24 20:45:54,991][213383] DAMAGECOUNT value on done: 152838.0 [2023-02-24 20:45:54,991][213383] Sum rewards: 31.950, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.690', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.094', 'AMMO3': '0.148', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.350', 'weapon4': '0.436', 'WEAPON3': '1.000', 'HITCOUNT': '2.350', 'weapon3': '2.772', 'DAMAGECOUNT': '8.880', 'FRAGCOUNT': '29.000'} [2023-02-24 20:45:55,077][213365] Updated weights for policy 0, policy_version 28616 (0.0009) [2023-02-24 20:45:55,152][213369] DAMAGECOUNT value on done: 155968.0 [2023-02-24 20:45:55,152][213369] Sum rewards: 30.150, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.930', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.035', 'weapon4': '0.092', 'weapon5': '0.100', 'AMMO3': '0.129', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.900', 'weapon2': '1.310', 'HITCOUNT': '1.860', 'weapon3': '1.884', 'DAMAGECOUNT': '7.803', 'FRAGCOUNT': '28.000'} [2023-02-24 20:45:55,195][213368] DAMAGECOUNT value on done: 147423.0 [2023-02-24 20:45:55,196][213368] Sum rewards: 20.561, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.200', 'AMMO5': '0.010', 'AMMO2': '0.042', 'AMMO3': '0.109', 'weapon5': '0.150', 'AMMO4': '0.209', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'ARMOR': '0.404', 'weapon4': '0.512', 'weapon2': '0.672', 'WEAPON3': '0.700', 'HITCOUNT': '1.500', 'weapon3': '1.970', 'DAMAGECOUNT': '6.333', 'FRAGCOUNT': '19.000'} [2023-02-24 20:45:55,235][213384] DAMAGECOUNT value on done: 143633.0 [2023-02-24 20:45:55,236][213384] Sum rewards: 26.344, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.950', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon5': '0.114', 'AMMO3': '0.201', 'AMMO4': '0.207', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.476', 'weapon2': '0.616', 'WEAPON3': '1.250', 'HITCOUNT': '2.030', 'weapon3': '2.560', 'DAMAGECOUNT': '8.880', 'FRAGCOUNT': '27.000'} [2023-02-24 20:45:55,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13259.9). Total num frames: 117211136. Throughput: 0: 3341.2. Samples: 4295704. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:45:55,243][213332] Avg episode reward: [(0, '30.159')] [2023-02-24 20:45:55,298][213383] DAMAGECOUNT value on done: 145679.0 [2023-02-24 20:45:55,299][213383] Sum rewards: 22.353, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.935', 'AMMO5': '0.017', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'AMMO4': '0.118', 'AMMO3': '0.173', 'weapon5': '0.356', 'WEAPON4': '0.450', 'weapon2': '0.506', 'WEAPON5': '0.550', 'weapon4': '0.588', 'WEAPON3': '1.100', 'HITCOUNT': '1.770', 'weapon3': '2.140', 'DAMAGECOUNT': '7.956', 'FRAGCOUNT': '23.000'} [2023-02-24 20:45:55,428][213384] DAMAGECOUNT value on done: 157409.0 [2023-02-24 20:45:55,428][213384] Sum rewards: 35.085, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.813', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.021', 'weapon5': '0.054', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.408', 'weapon4': '0.452', 'WEAPON3': '1.300', 'HITCOUNT': '2.530', 'weapon3': '2.830', 'DAMAGECOUNT': '10.569', 'FRAGCOUNT': '33.000'} [2023-02-24 20:45:55,456][213369] DAMAGECOUNT value on done: 141591.0 [2023-02-24 20:45:55,457][213369] Sum rewards: 35.646, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.912', 'ARMOR': '0.008', 'AMMO5': '0.021', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.167', 'weapon4': '0.242', 'WEAPON4': '0.250', 'weapon5': '0.426', 'WEAPON5': '0.500', 'weapon2': '0.506', 'WEAPON3': '1.000', 'HITCOUNT': '1.970', 'weapon3': '2.478', 'DAMAGECOUNT': '9.591', 'FRAGCOUNT': '32.000'} [2023-02-24 20:45:55,724][213384] DAMAGECOUNT value on done: 157456.0 [2023-02-24 20:45:55,725][213384] Sum rewards: 28.440, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.305', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO3': '0.124', 'weapon5': '0.142', 'AMMO4': '0.175', 'WEAPON5': '0.300', 'ARMOR': '0.412', 'weapon2': '0.442', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'weapon4': '1.134', 'weapon3': '1.746', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '8.562', 'FRAGCOUNT': '25.000'} [2023-02-24 20:45:58,075][213365] Updated weights for policy 0, policy_version 28626 (0.0009) [2023-02-24 20:46:00,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13259.9). Total num frames: 117280768. Throughput: 0: 3344.9. Samples: 4315720. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:46:00,243][213332] Avg episode reward: [(0, '29.896')] [2023-02-24 20:46:01,121][213365] Updated weights for policy 0, policy_version 28636 (0.0009) [2023-02-24 20:46:04,235][213365] Updated weights for policy 0, policy_version 28646 (0.0009) [2023-02-24 20:46:05,020][213383] Large shaping reward 2.613 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.582, 194.0), ('AMMO2', -0.0001, -1.0), ('AMMO4', -0.0005, -1.0), ('weapon4', 0.002)] [2023-02-24 20:46:05,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13259.9). Total num frames: 117346304. Throughput: 0: 3344.6. Samples: 4325892. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:46:05,243][213332] Avg episode reward: [(0, '29.896')] [2023-02-24 20:46:07,252][213365] Updated weights for policy 0, policy_version 28656 (0.0009) [2023-02-24 20:46:10,243][213332] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13246.0). Total num frames: 117411840. Throughput: 0: 3342.6. Samples: 4345812. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:46:10,243][213332] Avg episode reward: [(0, '29.896')] [2023-02-24 20:46:10,353][213365] Updated weights for policy 0, policy_version 28666 (0.0009) [2023-02-24 20:46:12,930][213367] DAMAGECOUNT value on done: 153907.0 [2023-02-24 20:46:12,930][213367] Sum rewards: 32.289, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.548', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.074', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'weapon4': '0.206', 'weapon2': '0.774', 'WEAPON3': '1.150', 'HITCOUNT': '2.410', 'weapon3': '2.640', 'DAMAGECOUNT': '9.558', 'FRAGCOUNT': '30.000'} [2023-02-24 20:46:13,251][213367] DAMAGECOUNT value on done: 156574.0 [2023-02-24 20:46:13,251][213367] Sum rewards: 24.362, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.800', 'AMMO5': '0.008', 'AMMO2': '0.038', 'AMMO3': '0.122', 'weapon5': '0.162', 'AMMO4': '0.191', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.452', 'WEAPON3': '0.750', 'weapon2': '1.260', 'weapon3': '1.758', 'HITCOUNT': '1.810', 'DAMAGECOUNT': '7.260', 'FRAGCOUNT': '23.000'} [2023-02-24 20:46:13,323][213372] DAMAGECOUNT value on done: 157549.0 [2023-02-24 20:46:13,324][213372] Sum rewards: 33.356, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.639', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.127', 'AMMO4': '0.175', 'weapon5': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.646', 'WEAPON3': '0.800', 'weapon2': '0.990', 'weapon3': '1.720', 'HITCOUNT': '2.180', 'DAMAGECOUNT': '9.462', 'FRAGCOUNT': '30.000'} [2023-02-24 20:46:13,431][213365] Updated weights for policy 0, policy_version 28676 (0.0010) [2023-02-24 20:46:13,620][213367] DAMAGECOUNT value on done: 157280.0 [2023-02-24 20:46:13,621][213367] Sum rewards: 24.644, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.806', 'AMMO5': '0.005', 'weapon5': '0.034', 'AMMO2': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.225', 'AMMO4': '0.242', 'WEAPON4': '0.500', 'weapon4': '0.520', 'weapon2': '0.658', 'WEAPON3': '1.400', 'HITCOUNT': '2.080', 'weapon3': '2.524', 'DAMAGECOUNT': '7.863', 'FRAGCOUNT': '28.000'} [2023-02-24 20:46:13,661][213372] DAMAGECOUNT value on done: 158346.0 [2023-02-24 20:46:13,661][213372] Sum rewards: 25.543, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.974', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.052', 'weapon7': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'AMMO4': '0.166', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.508', 'WEAPON3': '0.950', 'weapon4': '1.026', 'weapon3': '2.022', 'HITCOUNT': '2.140', 'DAMAGECOUNT': '8.622', 'FRAGCOUNT': '24.000'} [2023-02-24 20:46:13,679][213366] DAMAGECOUNT value on done: 151560.0 [2023-02-24 20:46:13,680][213366] Sum rewards: 33.620, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.990', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.012', 'AMMO4': '0.062', 'weapon5': '0.118', 'AMMO3': '0.129', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.256', 'WEAPON3': '0.850', 'weapon2': '0.992', 'HITCOUNT': '2.400', 'weapon3': '2.466', 'DAMAGECOUNT': '9.609', 'FRAGCOUNT': '27.000'} [2023-02-24 20:46:13,952][213367] DAMAGECOUNT value on done: 153325.0 [2023-02-24 20:46:13,953][213367] Sum rewards: 34.623, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.754', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.074', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'AMMO4': '0.197', 'WEAPON4': '0.400', 'weapon4': '0.610', 'weapon2': '0.918', 'WEAPON3': '1.000', 'weapon3': '2.052', 'HITCOUNT': '2.150', 'DAMAGECOUNT': '9.366', 'FRAGCOUNT': '32.000'} [2023-02-24 20:46:13,974][213382] DAMAGECOUNT value on done: 149709.0 [2023-02-24 20:46:13,974][213382] Sum rewards: 32.192, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.883', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.096', 'weapon4': '0.108', 'AMMO4': '0.129', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.858', 'WEAPON3': '1.150', 'HITCOUNT': '2.420', 'weapon3': '2.732', 'DAMAGECOUNT': '10.479', 'FRAGCOUNT': '29.000'} [2023-02-24 20:46:14,010][213366] DAMAGECOUNT value on done: 163106.0 [2023-02-24 20:46:14,011][213366] Sum rewards: 22.587, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.530', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.046', 'weapon5': '0.132', 'AMMO3': '0.133', 'WEAPON5': '0.200', 'AMMO4': '0.228', 'WEAPON4': '0.350', 'weapon2': '0.712', 'weapon4': '0.746', 'WEAPON3': '0.750', 'HITCOUNT': '2.000', 'weapon3': '2.098', 'DAMAGECOUNT': '7.959', 'FRAGCOUNT': '19.000'} [2023-02-24 20:46:14,059][213372] DAMAGECOUNT value on done: 154893.0 [2023-02-24 20:46:14,059][213372] Sum rewards: 26.560, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.132', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.048', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'AMMO4': '0.239', 'weapon4': '0.280', 'weapon5': '0.304', 'WEAPON5': '0.400', 'weapon2': '0.804', 'WEAPON3': '0.900', 'HITCOUNT': '1.890', 'weapon3': '2.342', 'DAMAGECOUNT': '8.895', 'FRAGCOUNT': '24.000'} [2023-02-24 20:46:14,267][213366] DAMAGECOUNT value on done: 159254.0 [2023-02-24 20:46:14,268][213366] Sum rewards: 29.541, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.702', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.014', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'weapon5': '0.170', 'WEAPON3': '0.950', 'weapon2': '1.094', 'HITCOUNT': '2.130', 'weapon3': '2.502', 'DAMAGECOUNT': '8.529', 'FRAGCOUNT': '25.000'} [2023-02-24 20:46:14,298][213382] DAMAGECOUNT value on done: 157704.0 [2023-02-24 20:46:14,299][213382] Sum rewards: 24.570, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.607', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.067', 'weapon5': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.259', 'weapon2': '0.292', 'weapon4': '0.366', 'WEAPON3': '1.650', 'HITCOUNT': '2.340', 'weapon3': '2.916', 'DAMAGECOUNT': '8.694', 'FRAGCOUNT': '26.000'} [2023-02-24 20:46:14,364][213372] DAMAGECOUNT value on done: 153143.0 [2023-02-24 20:46:14,364][213368] DAMAGECOUNT value on done: 150657.0 [2023-02-24 20:46:14,364][213372] Sum rewards: 31.421, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.288', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon4': '0.168', 'AMMO3': '0.179', 'weapon5': '0.180', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.660', 'WEAPON3': '1.200', 'HITCOUNT': '2.500', 'weapon3': '2.684', 'DAMAGECOUNT': '10.479', 'FRAGCOUNT': '29.000'} [2023-02-24 20:46:14,365][213368] Sum rewards: 25.215, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.385', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.178', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.300', 'weapon2': '0.830', 'WEAPON3': '1.400', 'HITCOUNT': '2.150', 'weapon3': '2.294', 'DAMAGECOUNT': '9.231', 'FRAGCOUNT': '26.000'} [2023-02-24 20:46:14,424][213383] DAMAGECOUNT value on done: 155722.0 [2023-02-24 20:46:14,425][213383] Sum rewards: 32.879, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.415', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon7': '0.050', 'weapon5': '0.060', 'AMMO4': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.121', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.700', 'weapon4': '0.762', 'weapon2': '0.952', 'weapon3': '1.904', 'HITCOUNT': '2.230', 'DAMAGECOUNT': '8.532', 'FRAGCOUNT': '26.000'} [2023-02-24 20:46:14,533][213369] DAMAGECOUNT value on done: 158594.0 [2023-02-24 20:46:14,533][213369] Sum rewards: 31.909, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.345', 'AMMO2': '0.007', 'AMMO5': '0.007', 'weapon4': '0.026', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.708', 'WEAPON3': '1.400', 'HITCOUNT': '2.170', 'weapon3': '2.860', 'DAMAGECOUNT': '8.820', 'FRAGCOUNT': '30.000'} [2023-02-24 20:46:14,560][213382] DAMAGECOUNT value on done: 150192.0 [2023-02-24 20:46:14,560][213382] Sum rewards: 34.896, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.055', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.174', 'WEAPON4': '0.300', 'weapon4': '0.438', 'weapon2': '0.440', 'WEAPON3': '1.150', 'HITCOUNT': '2.700', 'weapon3': '2.938', 'DAMAGECOUNT': '10.692', 'FRAGCOUNT': '31.000'} [2023-02-24 20:46:14,591][213366] DAMAGECOUNT value on done: 156384.0 [2023-02-24 20:46:14,592][213366] Sum rewards: 30.844, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.375', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.094', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon4': '0.236', 'WEAPON5': '0.250', 'weapon2': '0.870', 'WEAPON3': '1.200', 'HITCOUNT': '2.350', 'weapon3': '2.520', 'DAMAGECOUNT': '9.969', 'FRAGCOUNT': '28.000'} [2023-02-24 20:46:14,678][213368] DAMAGECOUNT value on done: 157243.0 [2023-02-24 20:46:14,678][213368] Sum rewards: 36.641, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.113', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO3': '0.126', 'AMMO4': '0.166', 'weapon5': '0.242', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.356', 'WEAPON3': '0.800', 'weapon2': '0.892', 'HITCOUNT': '1.980', 'weapon3': '2.214', 'DAMAGECOUNT': '8.784', 'FRAGCOUNT': '32.000'} [2023-02-24 20:46:14,748][213383] DAMAGECOUNT value on done: 160017.0 [2023-02-24 20:46:14,748][213383] Sum rewards: 34.224, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.999', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.072', 'AMMO4': '0.081', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'weapon4': '0.254', 'weapon2': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.390', 'weapon3': '2.956', 'DAMAGECOUNT': '10.767', 'FRAGCOUNT': '31.000'} [2023-02-24 20:46:14,852][213369] DAMAGECOUNT value on done: 156838.0 [2023-02-24 20:46:14,853][213369] Sum rewards: 21.586, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.890', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO4': '0.057', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.207', 'weapon2': '1.016', 'WEAPON3': '1.100', 'HITCOUNT': '1.680', 'weapon3': '2.544', 'DAMAGECOUNT': '6.186', 'FRAGCOUNT': '20.000'} [2023-02-24 20:46:14,880][213382] DAMAGECOUNT value on done: 155640.0 [2023-02-24 20:46:14,880][213382] Sum rewards: 30.961, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.337', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.104', 'AMMO3': '0.147', 'AMMO4': '0.191', 'WEAPON5': '0.300', 'weapon2': '0.476', 'WEAPON4': '0.600', 'WEAPON3': '0.850', 'weapon4': '1.034', 'weapon3': '2.124', 'HITCOUNT': '2.180', 'DAMAGECOUNT': '9.744', 'FRAGCOUNT': '29.000'} [2023-02-24 20:46:14,973][213368] DAMAGECOUNT value on done: 159441.0 [2023-02-24 20:46:14,974][213368] Sum rewards: 32.967, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.111', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.160', 'weapon5': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.552', 'weapon2': '0.596', 'WEAPON3': '1.000', 'HITCOUNT': '2.300', 'weapon3': '2.368', 'DAMAGECOUNT': '9.999', 'FRAGCOUNT': '29.000'} [2023-02-24 20:46:15,039][213384] DAMAGECOUNT value on done: 157271.0 [2023-02-24 20:46:15,040][213384] Sum rewards: 27.482, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.812', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon7': '0.124', 'AMMO3': '0.140', 'AMMO4': '0.182', 'weapon5': '0.216', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON7': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.850', 'weapon4': '1.096', 'HITCOUNT': '1.610', 'weapon3': '1.928', 'DAMAGECOUNT': '7.563', 'FRAGCOUNT': '24.000'} [2023-02-24 20:46:15,198][213383] DAMAGECOUNT value on done: 156451.0 [2023-02-24 20:46:15,198][213383] Sum rewards: 40.368, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.444', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO3': '0.163', 'AMMO4': '0.185', 'weapon5': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.378', 'weapon2': '0.776', 'WEAPON3': '1.100', 'HITCOUNT': '2.200', 'weapon3': '2.256', 'DAMAGECOUNT': '10.839', 'FRAGCOUNT': '36.000'} [2023-02-24 20:46:15,207][213369] DAMAGECOUNT value on done: 158292.0 [2023-02-24 20:46:15,207][213369] Sum rewards: 18.698, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.695', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.045', 'AMMO3': '0.118', 'AMMO4': '0.223', 'WEAPON5': '0.350', 'weapon5': '0.406', 'WEAPON4': '0.450', 'weapon2': '0.706', 'WEAPON3': '0.750', 'weapon4': '0.760', 'HITCOUNT': '1.690', 'weapon3': '1.906', 'DAMAGECOUNT': '6.972', 'FRAGCOUNT': '18.000'} [2023-02-24 20:46:15,243][213332] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13232.2). Total num frames: 117477376. Throughput: 0: 3338.8. Samples: 4365698. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:46:15,243][213332] Avg episode reward: [(0, '29.866')] [2023-02-24 20:46:15,272][213368] DAMAGECOUNT value on done: 151370.0 [2023-02-24 20:46:15,272][213368] Sum rewards: 43.082, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.328', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.090', 'AMMO3': '0.130', 'WEAPON5': '0.150', 'AMMO4': '0.198', 'WEAPON4': '0.350', 'weapon2': '0.606', 'WEAPON3': '0.800', 'weapon4': '0.862', 'weapon3': '2.128', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '11.841', 'FRAGCOUNT': '35.000'} [2023-02-24 20:46:15,339][213384] DAMAGECOUNT value on done: 146810.0 [2023-02-24 20:46:15,340][213384] Sum rewards: 34.453, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.802', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.045', 'weapon5': '0.140', 'AMMO3': '0.165', 'AMMO4': '0.227', 'weapon2': '0.456', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.656', 'WEAPON3': '1.050', 'HITCOUNT': '2.230', 'weapon3': '2.376', 'DAMAGECOUNT': '9.531', 'FRAGCOUNT': '35.000'} [2023-02-24 20:46:15,492][213383] DAMAGECOUNT value on done: 148618.0 [2023-02-24 20:46:15,492][213383] Sum rewards: 24.748, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.470', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.156', 'AMMO3': '0.157', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.668', 'weapon2': '0.808', 'WEAPON3': '0.950', 'weapon3': '1.834', 'HITCOUNT': '1.990', 'DAMAGECOUNT': '8.817', 'FRAGCOUNT': '25.000'} [2023-02-24 20:46:15,506][213369] DAMAGECOUNT value on done: 145046.0 [2023-02-24 20:46:15,507][213369] Sum rewards: 33.458, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.170', 'ARMOR': '0.008', 'AMMO2': '0.027', 'weapon7': '0.038', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.136', 'WEAPON4': '0.200', 'weapon4': '0.216', 'AMMO3': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.650', 'HITCOUNT': '2.450', 'weapon3': '3.172', 'DAMAGECOUNT': '10.365', 'FRAGCOUNT': '34.000'} [2023-02-24 20:46:15,517][213384] DAMAGECOUNT value on done: 160239.0 [2023-02-24 20:46:15,517][213384] Sum rewards: 27.413, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.873', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.140', 'AMMO3': '0.171', 'weapon4': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.996', 'WEAPON3': '1.100', 'HITCOUNT': '1.880', 'weapon3': '2.388', 'DAMAGECOUNT': '8.490', 'FRAGCOUNT': '27.000'} [2023-02-24 20:46:15,826][213384] DAMAGECOUNT value on done: 159918.0 [2023-02-24 20:46:15,827][213384] Sum rewards: 24.061, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.232', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.042', 'AMMO3': '0.114', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.211', 'weapon5': '0.286', 'weapon4': '0.362', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'weapon2': '1.416', 'weapon3': '1.586', 'HITCOUNT': '1.720', 'DAMAGECOUNT': '7.386', 'FRAGCOUNT': '22.000'} [2023-02-24 20:46:16,519][213365] Updated weights for policy 0, policy_version 28686 (0.0009) [2023-02-24 20:46:19,591][213365] Updated weights for policy 0, policy_version 28696 (0.0009) [2023-02-24 20:46:20,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13232.2). Total num frames: 117547008. Throughput: 0: 3339.2. Samples: 4375878. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:46:20,243][213332] Avg episode reward: [(0, '30.246')] [2023-02-24 20:46:22,583][213365] Updated weights for policy 0, policy_version 28706 (0.0008) [2023-02-24 20:46:25,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13232.2). Total num frames: 117612544. Throughput: 0: 3343.6. Samples: 4396074. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:46:25,243][213332] Avg episode reward: [(0, '30.246')] [2023-02-24 20:46:25,645][213365] Updated weights for policy 0, policy_version 28716 (0.0009) [2023-02-24 20:46:28,728][213365] Updated weights for policy 0, policy_version 28726 (0.0009) [2023-02-24 20:46:30,243][213332] Fps is (10 sec: 13107.2, 60 sec: 13312.0, 300 sec: 13218.3). Total num frames: 117678080. Throughput: 0: 3346.0. Samples: 4416108. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:46:30,243][213332] Avg episode reward: [(0, '30.246')] [2023-02-24 20:46:30,362][213366] Large shaping reward 2.618 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.588, 196.0)] [2023-02-24 20:46:31,754][213365] Updated weights for policy 0, policy_version 28736 (0.0009) [2023-02-24 20:46:32,957][213367] DAMAGECOUNT value on done: 157527.0 [2023-02-24 20:46:32,958][213367] Sum rewards: 35.716, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.798', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.032', 'weapon5': '0.118', 'AMMO3': '0.148', 'WEAPON5': '0.200', 'weapon2': '0.346', 'WEAPON4': '0.350', 'ARMOR': '0.452', 'weapon4': '0.832', 'WEAPON3': '0.950', 'weapon3': '2.242', 'HITCOUNT': '2.450', 'DAMAGECOUNT': '10.860', 'FRAGCOUNT': '29.000'} [2023-02-24 20:46:33,270][213367] DAMAGECOUNT value on done: 159610.0 [2023-02-24 20:46:33,270][213367] Sum rewards: 31.461, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.968', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.120', 'AMMO3': '0.133', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'WEAPON4': '0.350', 'weapon2': '0.742', 'WEAPON3': '0.850', 'weapon4': '0.908', 'weapon3': '1.934', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '9.108', 'FRAGCOUNT': '29.000'} [2023-02-24 20:46:33,363][213372] DAMAGECOUNT value on done: 161300.0 [2023-02-24 20:46:33,364][213372] Sum rewards: 43.041, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.138', 'AMMO5': '0.011', 'AMMO2': '0.020', 'AMMO4': '0.099', 'AMMO3': '0.181', 'weapon5': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.550', 'weapon4': '0.654', 'WEAPON3': '0.950', 'weapon3': '2.152', 'HITCOUNT': '2.370', 'DAMAGECOUNT': '11.253', 'FRAGCOUNT': '37.000'} [2023-02-24 20:46:33,674][213367] DAMAGECOUNT value on done: 160475.0 [2023-02-24 20:46:33,675][213367] Sum rewards: 25.941, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.059', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'AMMO3': '0.235', 'WEAPON4': '0.350', 'weapon2': '0.546', 'weapon4': '0.670', 'WEAPON3': '1.350', 'weapon3': '2.482', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '9.285', 'FRAGCOUNT': '26.000'} [2023-02-24 20:46:33,676][213372] DAMAGECOUNT value on done: 162175.0 [2023-02-24 20:46:33,676][213372] Sum rewards: 44.713, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.914', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'weapon5': '0.174', 'WEAPON4': '0.250', 'weapon4': '0.344', 'weapon2': '0.578', 'WEAPON3': '0.950', 'weapon3': '2.612', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '11.487', 'FRAGCOUNT': '38.000'} [2023-02-24 20:46:33,760][213366] DAMAGECOUNT value on done: 154644.0 [2023-02-24 20:46:33,760][213366] Sum rewards: 30.592, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.098', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.054', 'AMMO3': '0.138', 'WEAPON5': '0.200', 'AMMO4': '0.204', 'WEAPON4': '0.400', 'weapon4': '0.640', 'WEAPON3': '0.950', 'weapon2': '0.956', 'weapon3': '2.210', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '8.859', 'FRAGCOUNT': '27.000'} [2023-02-24 20:46:33,997][213367] DAMAGECOUNT value on done: 156747.0 [2023-02-24 20:46:33,998][213367] Sum rewards: 38.121, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.370', 'AMMO5': '0.017', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon5': '0.212', 'AMMO3': '0.213', 'weapon4': '0.246', 'weapon2': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'HITCOUNT': '2.340', 'weapon3': '2.892', 'DAMAGECOUNT': '10.266', 'FRAGCOUNT': '39.000'} [2023-02-24 20:46:34,029][213382] DAMAGECOUNT value on done: 153326.0 [2023-02-24 20:46:34,030][213382] Sum rewards: 36.330, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.239', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.102', 'AMMO4': '0.140', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.272', 'weapon2': '0.688', 'WEAPON3': '1.150', 'HITCOUNT': '2.310', 'weapon3': '2.648', 'DAMAGECOUNT': '10.845', 'FRAGCOUNT': '33.000'} [2023-02-24 20:46:34,052][213372] DAMAGECOUNT value on done: 158382.0 [2023-02-24 20:46:34,053][213372] Sum rewards: 37.297, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.231', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.175', 'AMMO4': '0.186', 'WEAPON4': '0.200', 'weapon4': '0.408', 'weapon2': '0.550', 'WEAPON3': '1.100', 'HITCOUNT': '2.520', 'weapon3': '2.684', 'DAMAGECOUNT': '10.467', 'FRAGCOUNT': '32.000'} [2023-02-24 20:46:34,085][213366] DAMAGECOUNT value on done: 167250.0 [2023-02-24 20:46:34,086][213366] Sum rewards: 39.846, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.021', 'AMMO5': '0.022', 'AMMO2': '0.063', 'AMMO3': '0.183', 'AMMO4': '0.315', 'weapon2': '0.346', 'weapon5': '0.366', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon4': '0.608', 'WEAPON3': '1.100', 'weapon3': '2.242', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '12.432', 'FRAGCOUNT': '37.000'} [2023-02-24 20:46:34,352][213382] DAMAGECOUNT value on done: 160768.0 [2023-02-24 20:46:34,352][213382] Sum rewards: 29.449, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.207', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.054', 'weapon5': '0.120', 'AMMO3': '0.148', 'AMMO4': '0.270', 'weapon4': '0.282', 'WEAPON5': '0.350', 'WEAPON4': '0.600', 'WEAPON3': '0.950', 'weapon2': '1.000', 'HITCOUNT': '2.140', 'weapon3': '2.280', 'DAMAGECOUNT': '9.192', 'FRAGCOUNT': '30.000'} [2023-02-24 20:46:34,354][213366] DAMAGECOUNT value on done: 162734.0 [2023-02-24 20:46:34,354][213366] Sum rewards: 35.447, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.330', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon5': '0.034', 'AMMO3': '0.152', 'AMMO4': '0.167', 'WEAPON5': '0.200', 'weapon4': '0.314', 'WEAPON4': '0.400', 'weapon2': '0.692', 'WEAPON3': '1.000', 'HITCOUNT': '2.590', 'weapon3': '2.732', 'DAMAGECOUNT': '10.440', 'FRAGCOUNT': '31.000'} [2023-02-24 20:46:34,375][213372] DAMAGECOUNT value on done: 155440.0 [2023-02-24 20:46:34,375][213372] Sum rewards: 23.218, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.716', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.031', 'AMMO3': '0.086', 'AMMO4': '0.153', 'weapon5': '0.262', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '0.550', 'weapon2': '0.718', 'weapon4': '1.096', 'weapon3': '1.194', 'HITCOUNT': '1.730', 'DAMAGECOUNT': '6.891', 'FRAGCOUNT': '21.000'} [2023-02-24 20:46:34,384][213368] DAMAGECOUNT value on done: 154500.0 [2023-02-24 20:46:34,384][213368] Sum rewards: 31.848, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.178', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO2': '0.052', 'AMMO3': '0.176', 'weapon4': '0.184', 'AMMO4': '0.262', 'weapon5': '0.266', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon2': '0.932', 'WEAPON3': '1.050', 'weapon3': '1.894', 'HITCOUNT': '2.090', 'DAMAGECOUNT': '11.529', 'FRAGCOUNT': '31.000'} [2023-02-24 20:46:34,397][213383] DAMAGECOUNT value on done: 158355.0 [2023-02-24 20:46:34,397][213383] Sum rewards: 24.732, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.138', 'AMMO5': '0.011', 'AMMO2': '0.058', 'AMMO3': '0.111', 'weapon5': '0.224', 'AMMO4': '0.290', 'WEAPON5': '0.400', 'ARMOR': '0.455', 'weapon2': '0.572', 'WEAPON4': '0.650', 'WEAPON3': '0.700', 'weapon4': '0.852', 'weapon3': '1.680', 'HITCOUNT': '1.720', 'DAMAGECOUNT': '7.896', 'FRAGCOUNT': '24.000'} [2023-02-24 20:46:34,615][213369] DAMAGECOUNT value on done: 161799.0 [2023-02-24 20:46:34,615][213369] Sum rewards: 29.539, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.938', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon2': '0.224', 'AMMO3': '0.265', 'weapon4': '0.320', 'WEAPON3': '1.700', 'HITCOUNT': '2.330', 'weapon3': '3.128', 'DAMAGECOUNT': '9.615', 'FRAGCOUNT': '31.000'} [2023-02-24 20:46:34,620][213382] DAMAGECOUNT value on done: 154004.0 [2023-02-24 20:46:34,620][213382] Sum rewards: 36.126, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.649', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.104', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.358', 'weapon2': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.520', 'weapon3': '2.578', 'DAMAGECOUNT': '11.436', 'FRAGCOUNT': '31.000'} [2023-02-24 20:46:34,676][213366] DAMAGECOUNT value on done: 159574.0 [2023-02-24 20:46:34,676][213366] Sum rewards: 36.570, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.840', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.046', 'AMMO4': '0.097', 'AMMO3': '0.139', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.264', 'weapon2': '0.990', 'WEAPON3': '1.000', 'HITCOUNT': '2.260', 'weapon3': '2.426', 'DAMAGECOUNT': '9.561', 'FRAGCOUNT': '31.000'} [2023-02-24 20:46:34,702][213368] DAMAGECOUNT value on done: 160629.0 [2023-02-24 20:46:34,702][213368] Sum rewards: 38.328, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.628', 'AMMO5': '0.015', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.078', 'AMMO3': '0.159', 'weapon5': '0.256', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.544', 'weapon2': '0.682', 'WEAPON3': '1.050', 'weapon3': '2.168', 'HITCOUNT': '2.310', 'DAMAGECOUNT': '10.158', 'FRAGCOUNT': '37.000'} [2023-02-24 20:46:34,715][213383] DAMAGECOUNT value on done: 162044.0 [2023-02-24 20:46:34,716][213383] Sum rewards: 21.623, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.741', 'AMMO2': '0.020', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'ARMOR': '0.404', 'weapon4': '0.560', 'WEAPON3': '0.700', 'weapon2': '1.276', 'HITCOUNT': '1.740', 'weapon3': '1.776', 'DAMAGECOUNT': '6.081', 'FRAGCOUNT': '17.000'} [2023-02-24 20:46:34,906][213365] Updated weights for policy 0, policy_version 28746 (0.0009) [2023-02-24 20:46:34,925][213369] DAMAGECOUNT value on done: 159875.0 [2023-02-24 20:46:34,926][213369] Sum rewards: 33.024, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.092', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.051', 'AMMO3': '0.134', 'weapon5': '0.242', 'AMMO4': '0.253', 'weapon2': '0.276', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '0.700', 'weapon4': '0.846', 'HITCOUNT': '2.150', 'weapon3': '2.328', 'DAMAGECOUNT': '9.111', 'FRAGCOUNT': '28.000'} [2023-02-24 20:46:34,940][213382] DAMAGECOUNT value on done: 159033.0 [2023-02-24 20:46:34,941][213382] Sum rewards: 29.012, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.940', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO3': '0.185', 'WEAPON4': '0.350', 'weapon2': '0.698', 'weapon4': '0.746', 'WEAPON3': '1.150', 'weapon3': '2.194', 'HITCOUNT': '2.370', 'DAMAGECOUNT': '10.179', 'FRAGCOUNT': '27.000'} [2023-02-24 20:46:34,998][213368] DAMAGECOUNT value on done: 162572.0 [2023-02-24 20:46:34,999][213368] Sum rewards: 31.827, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.384', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon5': '0.124', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon4': '0.398', 'weapon2': '0.496', 'WEAPON3': '1.300', 'HITCOUNT': '2.220', 'weapon3': '2.736', 'DAMAGECOUNT': '9.393', 'FRAGCOUNT': '31.000'} [2023-02-24 20:46:35,015][213384] DAMAGECOUNT value on done: 160001.0 [2023-02-24 20:46:35,015][213384] Sum rewards: 25.573, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.440', 'AMMO2': '0.003', 'AMMO4': '0.012', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'weapon5': '0.080', 'weapon4': '0.110', 'AMMO3': '0.247', 'WEAPON5': '0.400', 'weapon2': '0.674', 'WEAPON3': '1.500', 'HITCOUNT': '1.930', 'weapon3': '2.800', 'DAMAGECOUNT': '8.190', 'FRAGCOUNT': '27.000'} [2023-02-24 20:46:35,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13232.2). Total num frames: 117747712. Throughput: 0: 3347.4. Samples: 4426302. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:46:35,243][213332] Avg episode reward: [(0, '30.543')] [2023-02-24 20:46:35,246][213383] DAMAGECOUNT value on done: 159696.0 [2023-02-24 20:46:35,247][213383] Sum rewards: 37.560, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.660', 'AMMO2': '0.031', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'weapon4': '0.370', 'weapon2': '0.606', 'WEAPON3': '1.400', 'HITCOUNT': '2.530', 'weapon3': '2.716', 'DAMAGECOUNT': '9.735', 'FRAGCOUNT': '37.000'} [2023-02-24 20:46:35,272][213369] DAMAGECOUNT value on done: 161222.0 [2023-02-24 20:46:35,273][213369] Sum rewards: 35.820, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.474', 'AMMO5': '0.003', 'ARMOR': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'weapon4': '0.292', 'WEAPON3': '0.900', 'weapon2': '1.048', 'HITCOUNT': '2.200', 'weapon3': '2.256', 'DAMAGECOUNT': '8.790', 'FRAGCOUNT': '31.000'} [2023-02-24 20:46:35,298][213368] DAMAGECOUNT value on done: 155320.0 [2023-02-24 20:46:35,299][213368] Sum rewards: 37.584, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.110', 'AMMO5': '0.021', 'AMMO2': '0.045', 'weapon5': '0.138', 'AMMO3': '0.147', 'AMMO4': '0.223', 'weapon2': '0.464', 'WEAPON5': '0.500', 'ARMOR': '0.500', 'WEAPON4': '0.650', 'weapon4': '0.650', 'WEAPON3': '0.950', 'weapon3': '2.336', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '11.850', 'FRAGCOUNT': '32.000'} [2023-02-24 20:46:35,311][213384] DAMAGECOUNT value on done: 150813.0 [2023-02-24 20:46:35,311][213384] Sum rewards: 37.901, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.885', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO3': '0.113', 'AMMO4': '0.149', 'weapon5': '0.256', 'weapon2': '0.354', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '0.750', 'weapon3': '1.446', 'weapon4': '1.514', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.009', 'FRAGCOUNT': '33.000'} [2023-02-24 20:46:35,532][213384] DAMAGECOUNT value on done: 163783.0 [2023-02-24 20:46:35,533][213384] Sum rewards: 34.600, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.698', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON4': '0.150', 'weapon5': '0.158', 'AMMO3': '0.160', 'weapon4': '0.248', 'WEAPON5': '0.250', 'weapon2': '0.584', 'WEAPON3': '1.000', 'HITCOUNT': '2.270', 'weapon3': '2.784', 'DAMAGECOUNT': '10.632', 'FRAGCOUNT': '29.000'} [2023-02-24 20:46:35,546][213383] DAMAGECOUNT value on done: 151975.0 [2023-02-24 20:46:35,547][213383] Sum rewards: 33.787, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.357', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.040', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon2': '0.284', 'weapon4': '0.444', 'WEAPON3': '1.100', 'HITCOUNT': '2.200', 'weapon3': '2.862', 'DAMAGECOUNT': '10.071', 'FRAGCOUNT': '30.000'} [2023-02-24 20:46:35,567][213369] DAMAGECOUNT value on done: 148095.0 [2023-02-24 20:46:35,567][213369] Sum rewards: 35.851, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.833', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.106', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.478', 'weapon4': '0.664', 'WEAPON3': '1.150', 'weapon3': '2.348', 'HITCOUNT': '2.400', 'DAMAGECOUNT': '9.147', 'FRAGCOUNT': '32.000'} [2023-02-24 20:46:35,837][213384] DAMAGECOUNT value on done: 162824.0 [2023-02-24 20:46:35,838][213384] Sum rewards: 18.871, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.290', 'AMMO5': '0.005', 'AMMO2': '0.044', 'weapon5': '0.048', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'AMMO4': '0.222', 'WEAPON4': '0.350', 'weapon2': '0.574', 'weapon4': '0.822', 'WEAPON3': '1.350', 'weapon3': '2.184', 'HITCOUNT': '2.240', 'DAMAGECOUNT': '8.718', 'FRAGCOUNT': '21.000'} [2023-02-24 20:46:37,895][213365] Updated weights for policy 0, policy_version 28756 (0.0009) [2023-02-24 20:46:40,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13218.3). Total num frames: 117813248. Throughput: 0: 3347.1. Samples: 4446322. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:46:40,243][213332] Avg episode reward: [(0, '30.712')] [2023-02-24 20:46:40,960][213365] Updated weights for policy 0, policy_version 28766 (0.0009) [2023-02-24 20:46:44,035][213365] Updated weights for policy 0, policy_version 28776 (0.0009) [2023-02-24 20:46:45,243][213332] Fps is (10 sec: 13107.4, 60 sec: 13380.3, 300 sec: 13246.0). Total num frames: 117878784. Throughput: 0: 3348.0. Samples: 4466378. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:46:45,243][213332] Avg episode reward: [(0, '30.712')] [2023-02-24 20:46:45,253][213352] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000028780_117882880.pth... [2023-02-24 20:46:45,311][213352] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000027998_114679808.pth [2023-02-24 20:46:47,045][213365] Updated weights for policy 0, policy_version 28786 (0.0008) [2023-02-24 20:46:50,147][213365] Updated weights for policy 0, policy_version 28796 (0.0008) [2023-02-24 20:46:50,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13246.0). Total num frames: 117948416. Throughput: 0: 3348.4. Samples: 4476572. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:46:50,243][213332] Avg episode reward: [(0, '30.712')] [2023-02-24 20:46:52,951][213367] DAMAGECOUNT value on done: 160829.0 [2023-02-24 20:46:52,952][213367] Sum rewards: 37.533, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.493', 'AMMO2': '0.019', 'weapon7': '0.082', 'AMMO4': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.163', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.420', 'weapon4': '0.824', 'WEAPON3': '1.000', 'weapon2': '1.032', 'weapon3': '1.886', 'HITCOUNT': '2.360', 'DAMAGECOUNT': '9.906', 'FRAGCOUNT': '31.000'} [2023-02-24 20:46:53,171][213365] Updated weights for policy 0, policy_version 28806 (0.0009) [2023-02-24 20:46:53,278][213367] DAMAGECOUNT value on done: 162064.0 [2023-02-24 20:46:53,279][213367] Sum rewards: 20.395, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.560', 'AMMO5': '0.011', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.130', 'WEAPON4': '0.250', 'weapon4': '0.254', 'WEAPON5': '0.300', 'weapon5': '0.412', 'WEAPON3': '0.900', 'weapon2': '1.278', 'HITCOUNT': '1.560', 'weapon3': '1.666', 'DAMAGECOUNT': '7.362', 'FRAGCOUNT': '18.500'} [2023-02-24 20:46:53,425][213372] DAMAGECOUNT value on done: 164415.0 [2023-02-24 20:46:53,426][213372] Sum rewards: 26.035, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.520', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.082', 'AMMO3': '0.149', 'AMMO4': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.700', 'weapon4': '0.740', 'weapon2': '0.978', 'WEAPON3': '1.000', 'weapon3': '1.942', 'HITCOUNT': '2.330', 'DAMAGECOUNT': '9.345', 'FRAGCOUNT': '26.000'} [2023-02-24 20:46:53,676][213367] DAMAGECOUNT value on done: 163799.0 [2023-02-24 20:46:53,676][213367] Sum rewards: 35.588, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.031', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.015', 'AMMO4': '0.072', 'weapon5': '0.182', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.434', 'weapon4': '0.518', 'WEAPON3': '1.200', 'HITCOUNT': '2.300', 'weapon3': '2.662', 'DAMAGECOUNT': '9.972', 'FRAGCOUNT': '33.000'} [2023-02-24 20:46:53,717][213366] DAMAGECOUNT value on done: 157806.0 [2023-02-24 20:46:53,717][213366] Sum rewards: 32.346, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.816', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon4': '0.116', 'weapon5': '0.184', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.554', 'WEAPON3': '1.250', 'HITCOUNT': '2.230', 'weapon3': '2.848', 'DAMAGECOUNT': '9.486', 'FRAGCOUNT': '31.000'} [2023-02-24 20:46:53,742][213372] DAMAGECOUNT value on done: 165481.0 [2023-02-24 20:46:53,742][213372] Sum rewards: 32.674, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.975', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon5': '0.100', 'AMMO4': '0.133', 'weapon4': '0.200', 'AMMO3': '0.218', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.504', 'WEAPON3': '1.350', 'HITCOUNT': '2.350', 'weapon3': '2.934', 'DAMAGECOUNT': '9.918', 'FRAGCOUNT': '32.000'} [2023-02-24 20:46:54,006][213367] DAMAGECOUNT value on done: 160278.0 [2023-02-24 20:46:54,006][213367] Sum rewards: 35.004, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.740', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.166', 'AMMO4': '0.181', 'WEAPON4': '0.400', 'weapon2': '0.638', 'weapon4': '0.786', 'WEAPON3': '1.050', 'weapon3': '2.238', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '10.593', 'FRAGCOUNT': '31.000'} [2023-02-24 20:46:54,041][213366] DAMAGECOUNT value on done: 169307.0 [2023-02-24 20:46:54,042][213366] Sum rewards: 23.626, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.296', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.031', 'weapon7': '0.048', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO3': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.155', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'WEAPON3': '0.500', 'weapon4': '0.778', 'weapon3': '1.316', 'weapon2': '1.384', 'HITCOUNT': '1.530', 'DAMAGECOUNT': '6.171', 'FRAGCOUNT': '20.000'} [2023-02-24 20:46:54,090][213372] DAMAGECOUNT value on done: 162114.0 [2023-02-24 20:46:54,091][213372] Sum rewards: 38.026, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.130', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.148', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.171', 'weapon2': '0.316', 'WEAPON4': '0.450', 'weapon4': '0.946', 'WEAPON3': '1.100', 'weapon3': '2.312', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '11.196', 'FRAGCOUNT': '35.000'} [2023-02-24 20:46:54,103][213382] DAMAGECOUNT value on done: 156603.0 [2023-02-24 20:46:54,103][213382] Sum rewards: 33.627, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.070', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.154', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.488', 'weapon2': '0.650', 'WEAPON3': '1.100', 'HITCOUNT': '2.450', 'weapon3': '2.460', 'DAMAGECOUNT': '9.831', 'FRAGCOUNT': '31.000'} [2023-02-24 20:46:54,354][213366] DAMAGECOUNT value on done: 165678.0 [2023-02-24 20:46:54,355][213366] Sum rewards: 31.593, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.550', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon7': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.113', 'AMMO4': '0.156', 'weapon5': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'WEAPON3': '0.750', 'weapon2': '0.760', 'weapon4': '0.768', 'weapon3': '1.918', 'HITCOUNT': '2.170', 'DAMAGECOUNT': '8.832', 'FRAGCOUNT': '28.500'} [2023-02-24 20:46:54,357][213383] DAMAGECOUNT value on done: 161522.0 [2023-02-24 20:46:54,357][213383] Sum rewards: 31.394, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.704', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.037', 'AMMO3': '0.158', 'AMMO4': '0.185', 'weapon4': '0.202', 'WEAPON4': '0.300', 'weapon5': '0.310', 'WEAPON5': '0.400', 'weapon2': '0.706', 'WEAPON3': '0.950', 'HITCOUNT': '2.190', 'weapon3': '2.390', 'DAMAGECOUNT': '9.501', 'FRAGCOUNT': '29.000'} [2023-02-24 20:46:54,400][213372] DAMAGECOUNT value on done: 157951.0 [2023-02-24 20:46:54,401][213372] Sum rewards: 26.469, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.122', 'AMMO2': '0.002', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO4': '0.008', 'WEAPON5': '0.050', 'weapon5': '0.058', 'weapon4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.135', 'WEAPON3': '0.950', 'weapon2': '1.170', 'HITCOUNT': '1.860', 'weapon3': '2.392', 'DAMAGECOUNT': '7.533', 'FRAGCOUNT': '23.000'} [2023-02-24 20:46:54,411][213382] DAMAGECOUNT value on done: 163771.0 [2023-02-24 20:46:54,411][213382] Sum rewards: 31.468, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.735', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon7': '0.048', 'weapon5': '0.066', 'AMMO3': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.147', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.634', 'weapon2': '1.006', 'weapon3': '1.686', 'HITCOUNT': '2.200', 'DAMAGECOUNT': '9.009', 'FRAGCOUNT': '25.000'} [2023-02-24 20:46:54,501][213368] DAMAGECOUNT value on done: 157516.0 [2023-02-24 20:46:54,502][213368] Sum rewards: 31.647, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.674', 'AMMO5': '0.020', 'AMMO2': '0.048', 'weapon7': '0.064', 'weapon5': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.161', 'WEAPON7': '0.200', 'AMMO4': '0.242', 'WEAPON5': '0.350', 'weapon4': '0.496', 'WEAPON4': '0.550', 'weapon2': '0.640', 'WEAPON3': '0.950', 'HITCOUNT': '2.180', 'weapon3': '2.276', 'DAMAGECOUNT': '9.048', 'FRAGCOUNT': '30.000'} [2023-02-24 20:46:54,654][213369] DAMAGECOUNT value on done: 164944.0 [2023-02-24 20:46:54,655][213369] Sum rewards: 29.150, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.755', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.404', 'weapon2': '0.638', 'WEAPON3': '1.250', 'HITCOUNT': '2.250', 'weapon3': '2.682', 'DAMAGECOUNT': '9.435', 'FRAGCOUNT': '28.000'} [2023-02-24 20:46:54,675][213366] DAMAGECOUNT value on done: 162809.0 [2023-02-24 20:46:54,675][213366] Sum rewards: 38.697, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.445', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.058', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon2': '0.512', 'weapon4': '0.546', 'WEAPON3': '1.100', 'HITCOUNT': '2.600', 'weapon3': '2.698', 'DAMAGECOUNT': '9.705', 'FRAGCOUNT': '35.000'} [2023-02-24 20:46:54,678][213383] DAMAGECOUNT value on done: 164511.0 [2023-02-24 20:46:54,679][213383] Sum rewards: 25.343, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.000', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO3': '0.137', 'AMMO4': '0.183', 'weapon5': '0.286', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon2': '0.640', 'WEAPON3': '0.850', 'weapon4': '0.924', 'weapon3': '1.570', 'HITCOUNT': '1.700', 'DAMAGECOUNT': '7.401', 'FRAGCOUNT': '23.000'} [2023-02-24 20:46:54,692][213382] DAMAGECOUNT value on done: 157545.0 [2023-02-24 20:46:54,693][213382] Sum rewards: 37.431, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.763', 'AMMO5': '0.004', 'AMMO2': '0.004', 'AMMO4': '0.022', 'weapon5': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon4': '0.236', 'weapon2': '0.980', 'WEAPON3': '1.150', 'weapon3': '2.430', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '10.623', 'FRAGCOUNT': '32.000'} [2023-02-24 20:46:54,815][213368] DAMAGECOUNT value on done: 164292.0 [2023-02-24 20:46:54,815][213368] Sum rewards: 32.758, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.914', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.046', 'weapon5': '0.134', 'AMMO3': '0.204', 'AMMO4': '0.228', 'weapon4': '0.248', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '2.560', 'weapon3': '2.690', 'DAMAGECOUNT': '10.989', 'FRAGCOUNT': '33.000'} [2023-02-24 20:46:54,966][213369] DAMAGECOUNT value on done: 163252.0 [2023-02-24 20:46:54,967][213369] Sum rewards: 28.984, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.598', 'AMMO5': '0.023', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.168', 'AMMO3': '0.231', 'WEAPON4': '0.400', 'weapon4': '0.406', 'WEAPON5': '0.550', 'weapon2': '0.718', 'WEAPON3': '1.450', 'HITCOUNT': '2.080', 'weapon3': '2.262', 'DAMAGECOUNT': '10.131', 'FRAGCOUNT': '30.500'} [2023-02-24 20:46:54,996][213382] DAMAGECOUNT value on done: 161988.0 [2023-02-24 20:46:54,997][213382] Sum rewards: 32.955, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.150', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.098', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon4': '0.444', 'weapon2': '0.968', 'WEAPON3': '1.200', 'HITCOUNT': '2.050', 'weapon3': '2.234', 'DAMAGECOUNT': '8.865', 'FRAGCOUNT': '32.000'} [2023-02-24 20:46:55,069][213384] DAMAGECOUNT value on done: 163299.0 [2023-02-24 20:46:55,070][213384] Sum rewards: 28.591, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.169', 'AMMO5': '0.007', 'AMMO2': '0.038', 'AMMO3': '0.111', 'weapon5': '0.144', 'AMMO4': '0.190', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON4': '0.650', 'WEAPON3': '0.800', 'weapon4': '0.826', 'HITCOUNT': '2.200', 'weapon3': '2.232', 'DAMAGECOUNT': '9.894', 'FRAGCOUNT': '26.000'} [2023-02-24 20:46:55,113][213368] DAMAGECOUNT value on done: 165542.0 [2023-02-24 20:46:55,114][213368] Sum rewards: 34.307, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.440', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.104', 'AMMO3': '0.148', 'weapon4': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.604', 'WEAPON3': '1.100', 'HITCOUNT': '2.190', 'weapon3': '2.770', 'DAMAGECOUNT': '8.910', 'FRAGCOUNT': '32.000'} [2023-02-24 20:46:55,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13246.0). Total num frames: 118013952. Throughput: 0: 3350.7. Samples: 4496592. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:46:55,243][213332] Avg episode reward: [(0, '31.239')] [2023-02-24 20:46:55,247][213352] Saving new best policy, reward=31.239! [2023-02-24 20:46:55,256][213383] DAMAGECOUNT value on done: 163185.0 [2023-02-24 20:46:55,257][213383] Sum rewards: 28.369, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.179', 'AMMO5': '0.023', 'AMMO2': '0.046', 'AMMO3': '0.226', 'AMMO4': '0.231', 'weapon2': '0.258', 'weapon4': '0.360', 'weapon5': '0.378', 'WEAPON4': '0.450', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'HITCOUNT': '2.240', 'weapon3': '2.418', 'DAMAGECOUNT': '10.467', 'FRAGCOUNT': '27.500'} [2023-02-24 20:46:55,301][213369] DAMAGECOUNT value on done: 164769.0 [2023-02-24 20:46:55,302][213369] Sum rewards: 35.312, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.060', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.080', 'AMMO3': '0.178', 'AMMO4': '0.227', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.372', 'weapon4': '0.552', 'WEAPON3': '1.050', 'HITCOUNT': '2.610', 'weapon3': '2.754', 'DAMAGECOUNT': '10.641', 'FRAGCOUNT': '32.000'} [2023-02-24 20:46:55,402][213384] DAMAGECOUNT value on done: 153789.0 [2023-02-24 20:46:55,402][213384] Sum rewards: 23.416, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.876', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.124', 'AMMO4': '0.125', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.524', 'weapon4': '0.840', 'WEAPON3': '1.050', 'weapon3': '2.268', 'HITCOUNT': '2.310', 'DAMAGECOUNT': '8.928', 'FRAGCOUNT': '24.000'} [2023-02-24 20:46:55,428][213368] DAMAGECOUNT value on done: 158194.0 [2023-02-24 20:46:55,429][213368] Sum rewards: 30.699, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.950', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.019', 'weapon5': '0.028', 'WEAPON5': '0.050', 'weapon7': '0.068', 'AMMO4': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon4': '0.490', 'weapon2': '0.644', 'WEAPON3': '1.100', 'HITCOUNT': '2.070', 'weapon3': '2.540', 'DAMAGECOUNT': '8.622', 'FRAGCOUNT': '29.000'} [2023-02-24 20:46:55,573][213383] DAMAGECOUNT value on done: 155651.0 [2023-02-24 20:46:55,574][213383] Sum rewards: 40.985, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.517', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.022', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'weapon5': '0.116', 'WEAPON4': '0.300', 'weapon2': '0.666', 'weapon4': '0.668', 'WEAPON3': '0.750', 'weapon3': '2.166', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '11.028', 'FRAGCOUNT': '33.000'} [2023-02-24 20:46:55,602][213369] DAMAGECOUNT value on done: 151395.0 [2023-02-24 20:46:55,603][213369] Sum rewards: 35.148, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.552', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.072', 'AMMO3': '0.148', 'WEAPON4': '0.200', 'weapon5': '0.226', 'WEAPON5': '0.250', 'weapon4': '0.352', 'weapon2': '0.854', 'WEAPON3': '1.050', 'weapon3': '2.300', 'HITCOUNT': '2.320', 'DAMAGECOUNT': '9.900', 'FRAGCOUNT': '31.000'} [2023-02-24 20:46:55,642][213384] DAMAGECOUNT value on done: 167587.0 [2023-02-24 20:46:55,642][213384] Sum rewards: 35.081, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.390', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.067', 'weapon5': '0.080', 'weapon4': '0.130', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon2': '0.774', 'WEAPON3': '1.450', 'HITCOUNT': '2.670', 'weapon3': '2.738', 'DAMAGECOUNT': '11.412', 'FRAGCOUNT': '34.000'} [2023-02-24 20:46:55,929][213384] DAMAGECOUNT value on done: 165986.0 [2023-02-24 20:46:55,930][213384] Sum rewards: 32.081, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.462', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'weapon5': '0.110', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'weapon4': '0.254', 'WEAPON3': '1.000', 'weapon2': '1.114', 'weapon3': '2.270', 'HITCOUNT': '2.320', 'DAMAGECOUNT': '9.486', 'FRAGCOUNT': '27.000'} [2023-02-24 20:46:56,258][213365] Updated weights for policy 0, policy_version 28816 (0.0009) [2023-02-24 20:46:59,338][213365] Updated weights for policy 0, policy_version 28826 (0.0009) [2023-02-24 20:47:00,243][213332] Fps is (10 sec: 13107.3, 60 sec: 13312.0, 300 sec: 13273.8). Total num frames: 118079488. Throughput: 0: 3353.2. Samples: 4516590. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:47:00,243][213332] Avg episode reward: [(0, '31.608')] [2023-02-24 20:47:00,249][213352] Saving new best policy, reward=31.608! [2023-02-24 20:47:02,363][213365] Updated weights for policy 0, policy_version 28836 (0.0009) [2023-02-24 20:47:05,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13301.6). Total num frames: 118149120. Throughput: 0: 3352.8. Samples: 4526752. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:47:05,243][213332] Avg episode reward: [(0, '31.608')] [2023-02-24 20:47:05,421][213365] Updated weights for policy 0, policy_version 28846 (0.0008) [2023-02-24 20:47:08,453][213365] Updated weights for policy 0, policy_version 28856 (0.0009) [2023-02-24 20:47:10,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13315.5). Total num frames: 118214656. Throughput: 0: 3349.5. Samples: 4546800. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:47:10,243][213332] Avg episode reward: [(0, '31.608')] [2023-02-24 20:47:11,454][213365] Updated weights for policy 0, policy_version 28866 (0.0009) [2023-02-24 20:47:12,983][213367] DAMAGECOUNT value on done: 163576.0 [2023-02-24 20:47:12,983][213367] Sum rewards: 26.254, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.570', 'AMMO5': '0.004', 'AMMO2': '0.016', 'weapon5': '0.038', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'weapon4': '0.160', 'WEAPON3': '0.900', 'weapon2': '1.338', 'weapon3': '2.046', 'HITCOUNT': '2.110', 'DAMAGECOUNT': '8.241', 'FRAGCOUNT': '23.000'} [2023-02-24 20:47:13,284][213367] DAMAGECOUNT value on done: 165885.0 [2023-02-24 20:47:13,285][213367] Sum rewards: 39.095, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.830', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO3': '0.158', 'AMMO4': '0.200', 'weapon4': '0.288', 'weapon5': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.994', 'WEAPON3': '1.050', 'weapon3': '2.116', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '11.463', 'FRAGCOUNT': '33.000'} [2023-02-24 20:47:13,514][213372] DAMAGECOUNT value on done: 167325.0 [2023-02-24 20:47:13,514][213372] Sum rewards: 31.711, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.946', 'AMMO5': '0.009', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.136', 'weapon4': '0.168', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.832', 'WEAPON3': '1.050', 'HITCOUNT': '1.950', 'weapon3': '2.636', 'DAMAGECOUNT': '8.730', 'FRAGCOUNT': '30.000'} [2023-02-24 20:47:13,691][213367] DAMAGECOUNT value on done: 167181.0 [2023-02-24 20:47:13,692][213367] Sum rewards: 32.210, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.179', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO4': '0.150', 'weapon4': '0.172', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'weapon2': '0.710', 'WEAPON3': '1.150', 'HITCOUNT': '2.240', 'weapon3': '2.782', 'DAMAGECOUNT': '10.146', 'FRAGCOUNT': '29.500'} [2023-02-24 20:47:13,756][213366] DAMAGECOUNT value on done: 160847.0 [2023-02-24 20:47:13,756][213366] Sum rewards: 32.172, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.015', 'HEALTH': '0.043', 'AMMO2': '0.053', 'AMMO3': '0.089', 'weapon5': '0.214', 'AMMO4': '0.266', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.756', 'weapon2': '0.844', 'weapon3': '1.798', 'HITCOUNT': '2.220', 'DAMAGECOUNT': '9.123', 'FRAGCOUNT': '26.000'} [2023-02-24 20:47:13,839][213372] DAMAGECOUNT value on done: 169099.0 [2023-02-24 20:47:13,840][213372] Sum rewards: 35.298, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.280', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon5': '0.154', 'AMMO4': '0.209', 'AMMO3': '0.220', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON4': '0.400', 'weapon4': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.590', 'weapon3': '2.758', 'DAMAGECOUNT': '10.854', 'FRAGCOUNT': '35.000'} [2023-02-24 20:47:14,004][213384] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 20:47:14,015][213367] DAMAGECOUNT value on done: 163763.0 [2023-02-24 20:47:14,016][213367] Sum rewards: 37.357, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.074', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.114', 'AMMO4': '0.144', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon4': '0.232', 'WEAPON4': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.250', 'HITCOUNT': '2.590', 'weapon3': '2.896', 'DAMAGECOUNT': '10.455', 'FRAGCOUNT': '36.000'} [2023-02-24 20:47:14,080][213366] DAMAGECOUNT value on done: 172749.0 [2023-02-24 20:47:14,081][213366] Sum rewards: 33.627, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.096', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.145', 'weapon4': '0.164', 'WEAPON4': '0.200', 'weapon5': '0.232', 'WEAPON5': '0.250', 'weapon2': '0.798', 'WEAPON3': '0.950', 'HITCOUNT': '1.950', 'weapon3': '2.596', 'DAMAGECOUNT': '10.320', 'FRAGCOUNT': '29.000'} [2023-02-24 20:47:14,164][213372] DAMAGECOUNT value on done: 164772.0 [2023-02-24 20:47:14,165][213372] Sum rewards: 27.093, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.159', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.145', 'WEAPON4': '0.350', 'weapon4': '0.686', 'weapon2': '0.852', 'WEAPON3': '0.900', 'HITCOUNT': '1.820', 'weapon3': '1.998', 'DAMAGECOUNT': '7.974', 'FRAGCOUNT': '23.000'} [2023-02-24 20:47:14,173][213382] DAMAGECOUNT value on done: 160249.0 [2023-02-24 20:47:14,174][213382] Sum rewards: 32.877, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.812', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.121', 'AMMO3': '0.147', 'weapon5': '0.150', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.314', 'weapon2': '0.750', 'WEAPON3': '1.000', 'weapon3': '2.554', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '10.938', 'FRAGCOUNT': '27.500'} [2023-02-24 20:47:14,378][213366] DAMAGECOUNT value on done: 169067.0 [2023-02-24 20:47:14,378][213366] Sum rewards: 40.104, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.470', 'AMMO5': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.115', 'weapon4': '0.164', 'weapon5': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'weapon2': '0.962', 'weapon3': '2.504', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '10.167', 'FRAGCOUNT': '35.000'} [2023-02-24 20:47:14,454][213383] DAMAGECOUNT value on done: 165704.0 [2023-02-24 20:47:14,455][213383] Sum rewards: 47.967, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.198', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon5': '0.052', 'AMMO4': '0.055', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'weapon4': '0.242', 'weapon2': '0.554', 'WEAPON3': '1.500', 'weapon3': '2.904', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '12.546', 'FRAGCOUNT': '43.000'} [2023-02-24 20:47:14,483][213372] DAMAGECOUNT value on done: 160782.0 [2023-02-24 20:47:14,484][213372] Sum rewards: 32.318, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.858', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.148', 'AMMO4': '0.162', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon5': '0.308', 'weapon2': '0.800', 'WEAPON3': '1.000', 'HITCOUNT': '2.010', 'weapon3': '2.484', 'DAMAGECOUNT': '8.493', 'FRAGCOUNT': '29.000'} [2023-02-24 20:47:14,487][213382] DAMAGECOUNT value on done: 166694.0 [2023-02-24 20:47:14,487][213382] Sum rewards: 33.361, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.843', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.113', 'weapon4': '0.182', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon2': '0.366', 'WEAPON3': '1.250', 'HITCOUNT': '2.050', 'weapon3': '3.192', 'DAMAGECOUNT': '8.769', 'FRAGCOUNT': '33.000'} [2023-02-24 20:47:14,590][213365] Updated weights for policy 0, policy_version 28876 (0.0009) [2023-02-24 20:47:14,616][213368] DAMAGECOUNT value on done: 161244.0 [2023-02-24 20:47:14,617][213368] Sum rewards: 37.706, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.174', 'AMMO5': '0.032', 'AMMO2': '0.060', 'AMMO3': '0.187', 'AMMO4': '0.300', 'weapon5': '0.356', 'weapon2': '0.634', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'weapon4': '0.816', 'WEAPON3': '1.100', 'weapon3': '1.820', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '11.184', 'FRAGCOUNT': '37.000'} [2023-02-24 20:47:14,693][213366] DAMAGECOUNT value on done: 166327.0 [2023-02-24 20:47:14,693][213366] Sum rewards: 35.918, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.200', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon5': '0.086', 'AMMO3': '0.236', 'AMMO4': '0.259', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.472', 'weapon4': '0.648', 'WEAPON3': '1.400', 'weapon3': '2.512', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '10.554', 'FRAGCOUNT': '35.000'} [2023-02-24 20:47:14,777][213383] DAMAGECOUNT value on done: 167692.0 [2023-02-24 20:47:14,777][213383] Sum rewards: 28.836, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.830', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.042', 'weapon5': '0.062', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.364', 'WEAPON3': '0.950', 'weapon2': '0.974', 'weapon3': '2.168', 'HITCOUNT': '2.200', 'DAMAGECOUNT': '9.543', 'FRAGCOUNT': '25.000'} [2023-02-24 20:47:14,782][213369] DAMAGECOUNT value on done: 169341.0 [2023-02-24 20:47:14,782][213369] Sum rewards: 48.966, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.745', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.112', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.460', 'weapon4': '0.772', 'WEAPON3': '1.250', 'weapon3': '2.340', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.191', 'FRAGCOUNT': '43.000'} [2023-02-24 20:47:14,785][213382] DAMAGECOUNT value on done: 160721.0 [2023-02-24 20:47:14,785][213382] Sum rewards: 30.215, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.783', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon5': '0.134', 'AMMO4': '0.139', 'AMMO3': '0.148', 'weapon4': '0.336', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'weapon2': '1.020', 'weapon3': '2.320', 'HITCOUNT': '2.330', 'DAMAGECOUNT': '9.528', 'FRAGCOUNT': '28.000'} [2023-02-24 20:47:14,925][213368] DAMAGECOUNT value on done: 167442.0 [2023-02-24 20:47:14,925][213368] Sum rewards: 33.610, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.436', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.137', 'AMMO4': '0.143', 'WEAPON4': '0.350', 'weapon4': '0.520', 'weapon2': '0.634', 'WEAPON3': '1.000', 'HITCOUNT': '2.500', 'weapon3': '2.634', 'DAMAGECOUNT': '9.450', 'FRAGCOUNT': '29.000'} [2023-02-24 20:47:15,079][213369] DAMAGECOUNT value on done: 166757.0 [2023-02-24 20:47:15,080][213369] Sum rewards: 36.656, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.250', 'AMMO5': '0.009', 'AMMO2': '0.015', 'AMMO4': '0.073', 'AMMO3': '0.145', 'weapon5': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.334', 'weapon2': '0.808', 'WEAPON3': '0.950', 'HITCOUNT': '2.280', 'weapon3': '2.462', 'DAMAGECOUNT': '10.515', 'FRAGCOUNT': '31.000'} [2023-02-24 20:47:15,084][213382] DAMAGECOUNT value on done: 165659.0 [2023-02-24 20:47:15,085][213382] Sum rewards: 37.556, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.372', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'AMMO3': '0.233', 'weapon4': '0.250', 'weapon2': '0.624', 'WEAPON3': '1.350', 'HITCOUNT': '2.740', 'weapon3': '2.878', 'DAMAGECOUNT': '11.013', 'FRAGCOUNT': '35.000'} [2023-02-24 20:47:15,127][213384] DAMAGECOUNT value on done: 167061.0 [2023-02-24 20:47:15,128][213384] Sum rewards: 33.585, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.744', 'ARMOR': '0.012', 'AMMO5': '0.016', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon2': '0.204', 'AMMO3': '0.208', 'weapon5': '0.268', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.910', 'WEAPON3': '1.300', 'weapon3': '2.234', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '11.286', 'FRAGCOUNT': '33.000'} [2023-02-24 20:47:15,213][213368] DAMAGECOUNT value on done: 169612.0 [2023-02-24 20:47:15,214][213368] Sum rewards: 40.561, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.975', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'AMMO4': '0.211', 'WEAPON4': '0.300', 'weapon2': '0.412', 'weapon4': '0.416', 'WEAPON3': '1.300', 'weapon3': '2.830', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.210', 'FRAGCOUNT': '36.000'} [2023-02-24 20:47:15,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13329.4). Total num frames: 118284288. Throughput: 0: 3347.9. Samples: 4566764. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:47:15,243][213332] Avg episode reward: [(0, '32.824')] [2023-02-24 20:47:15,246][213352] Saving new best policy, reward=32.824! [2023-02-24 20:47:15,378][213383] DAMAGECOUNT value on done: 166169.0 [2023-02-24 20:47:15,378][213383] Sum rewards: 23.098, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.600', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.048', 'AMMO3': '0.177', 'weapon5': '0.224', 'AMMO4': '0.242', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON4': '0.600', 'weapon4': '0.832', 'WEAPON3': '1.100', 'weapon3': '2.192', 'HITCOUNT': '2.390', 'DAMAGECOUNT': '8.952', 'FRAGCOUNT': '24.000'} [2023-02-24 20:47:15,388][213369] DAMAGECOUNT value on done: 168161.0 [2023-02-24 20:47:15,389][213369] Sum rewards: 36.335, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.165', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.030', 'AMMO3': '0.129', 'weapon5': '0.150', 'AMMO4': '0.151', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.518', 'WEAPON3': '0.850', 'weapon4': '0.886', 'weapon3': '2.136', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '10.074', 'FRAGCOUNT': '31.000'} [2023-02-24 20:47:15,443][213384] DAMAGECOUNT value on done: 156600.0 [2023-02-24 20:47:15,444][213384] Sum rewards: 25.409, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.043', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'AMMO3': '0.146', 'WEAPON4': '0.200', 'weapon4': '0.530', 'weapon2': '0.902', 'WEAPON3': '1.000', 'HITCOUNT': '1.890', 'weapon3': '2.264', 'DAMAGECOUNT': '8.433', 'FRAGCOUNT': '23.000'} [2023-02-24 20:47:15,531][213368] DAMAGECOUNT value on done: 161489.0 [2023-02-24 20:47:15,531][213368] Sum rewards: 36.492, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.472', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.060', 'weapon5': '0.086', 'AMMO3': '0.137', 'AMMO4': '0.299', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.580', 'WEAPON3': '0.950', 'weapon2': '1.064', 'weapon3': '2.024', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '9.885', 'FRAGCOUNT': '34.000'} [2023-02-24 20:47:15,682][213383] DAMAGECOUNT value on done: 158698.0 [2023-02-24 20:47:15,683][213383] Sum rewards: 30.292, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.308', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.159', 'weapon5': '0.204', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.642', 'weapon4': '0.950', 'WEAPON3': '1.000', 'weapon3': '1.794', 'HITCOUNT': '2.350', 'DAMAGECOUNT': '9.141', 'FRAGCOUNT': '28.000'} [2023-02-24 20:47:15,685][213369] DAMAGECOUNT value on done: 155026.0 [2023-02-24 20:47:15,686][213369] Sum rewards: 31.048, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.445', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.209', 'weapon5': '0.214', 'WEAPON4': '0.350', 'weapon2': '0.374', 'WEAPON5': '0.400', 'weapon4': '0.412', 'WEAPON3': '1.300', 'HITCOUNT': '2.320', 'weapon3': '2.628', 'DAMAGECOUNT': '10.890', 'FRAGCOUNT': '29.500'} [2023-02-24 20:47:15,704][213384] DAMAGECOUNT value on done: 170653.0 [2023-02-24 20:47:15,705][213384] Sum rewards: 30.042, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.398', 'AMMO2': '0.012', 'AMMO5': '0.014', 'AMMO4': '0.057', 'AMMO3': '0.163', 'weapon5': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.438', 'weapon2': '0.510', 'WEAPON3': '1.000', 'HITCOUNT': '2.260', 'weapon3': '2.554', 'DAMAGECOUNT': '9.198', 'FRAGCOUNT': '26.500'} [2023-02-24 20:47:16,003][213384] DAMAGECOUNT value on done: 169168.0 [2023-02-24 20:47:16,004][213384] Sum rewards: 30.285, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.062', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.045', 'AMMO3': '0.113', 'weapon5': '0.150', 'AMMO4': '0.224', 'WEAPON5': '0.350', 'WEAPON4': '0.650', 'weapon2': '0.656', 'WEAPON3': '0.700', 'weapon4': '1.206', 'weapon3': '1.336', 'HITCOUNT': '2.350', 'DAMAGECOUNT': '9.546', 'FRAGCOUNT': '27.000'} [2023-02-24 20:47:17,593][213365] Updated weights for policy 0, policy_version 28886 (0.0009) [2023-02-24 20:47:20,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13315.5). Total num frames: 118349824. Throughput: 0: 3346.9. Samples: 4576914. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:47:20,243][213332] Avg episode reward: [(0, '32.758')] [2023-02-24 20:47:20,643][213365] Updated weights for policy 0, policy_version 28896 (0.0009) [2023-02-24 20:47:21,571][213382] Large shaping reward 2.520 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.498, 166.0), ('weapon5', 0.002)] [2023-02-24 20:47:23,665][213365] Updated weights for policy 0, policy_version 28906 (0.0009) [2023-02-24 20:47:25,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13329.4). Total num frames: 118419456. Throughput: 0: 3351.2. Samples: 4597124. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:47:25,243][213332] Avg episode reward: [(0, '32.758')] [2023-02-24 20:47:25,856][213382] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 20:47:26,698][213365] Updated weights for policy 0, policy_version 28916 (0.0009) [2023-02-24 20:47:29,844][213365] Updated weights for policy 0, policy_version 28926 (0.0009) [2023-02-24 20:47:30,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13329.4). Total num frames: 118484992. Throughput: 0: 3347.5. Samples: 4617016. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:47:30,243][213332] Avg episode reward: [(0, '32.758')] [2023-02-24 20:47:32,882][213365] Updated weights for policy 0, policy_version 28936 (0.0009) [2023-02-24 20:47:33,094][213367] DAMAGECOUNT value on done: 166393.0 [2023-02-24 20:47:33,095][213367] Sum rewards: 27.319, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.331', 'ARMOR': '0.012', 'AMMO5': '0.016', 'AMMO2': '0.037', 'weapon5': '0.162', 'AMMO4': '0.187', 'AMMO3': '0.235', 'weapon4': '0.368', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon2': '0.884', 'WEAPON3': '1.350', 'HITCOUNT': '2.040', 'weapon3': '2.258', 'DAMAGECOUNT': '8.451', 'FRAGCOUNT': '30.000'} [2023-02-24 20:47:33,414][213367] DAMAGECOUNT value on done: 169419.0 [2023-02-24 20:47:33,414][213367] Sum rewards: 35.577, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.658', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.137', 'weapon5': '0.144', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.506', 'WEAPON3': '0.850', 'weapon4': '1.038', 'weapon3': '2.062', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '10.602', 'FRAGCOUNT': '29.000'} [2023-02-24 20:47:33,633][213372] DAMAGECOUNT value on done: 169900.0 [2023-02-24 20:47:33,633][213372] Sum rewards: 26.756, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.945', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.090', 'weapon7': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.167', 'WEAPON7': '0.200', 'weapon2': '0.852', 'WEAPON3': '1.150', 'HITCOUNT': '1.870', 'weapon3': '2.658', 'DAMAGECOUNT': '7.725', 'FRAGCOUNT': '24.000'} [2023-02-24 20:47:33,835][213367] DAMAGECOUNT value on done: 171313.0 [2023-02-24 20:47:33,835][213367] Sum rewards: 42.072, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.250', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.060', 'AMMO3': '0.140', 'AMMO4': '0.298', 'weapon5': '0.312', 'WEAPON5': '0.450', 'weapon2': '0.542', 'WEAPON4': '0.650', 'weapon4': '0.756', 'WEAPON3': '0.850', 'weapon3': '2.062', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.396', 'FRAGCOUNT': '35.500'} [2023-02-24 20:47:33,858][213366] DAMAGECOUNT value on done: 164320.0 [2023-02-24 20:47:33,859][213366] Sum rewards: 31.511, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.778', 'ARMOR': '0.008', 'AMMO5': '0.030', 'AMMO2': '0.067', 'AMMO3': '0.145', 'AMMO4': '0.336', 'weapon5': '0.398', 'weapon2': '0.428', 'WEAPON5': '0.650', 'WEAPON4': '0.850', 'weapon4': '0.866', 'WEAPON3': '1.000', 'weapon3': '1.732', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '10.419', 'FRAGCOUNT': '32.000'} [2023-02-24 20:47:33,949][213372] DAMAGECOUNT value on done: 173028.0 [2023-02-24 20:47:33,950][213372] Sum rewards: 41.673, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.748', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.170', 'weapon5': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.378', 'weapon2': '0.586', 'WEAPON3': '1.050', 'weapon3': '2.462', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '11.787', 'FRAGCOUNT': '36.000'} [2023-02-24 20:47:34,141][213367] DAMAGECOUNT value on done: 167455.0 [2023-02-24 20:47:34,142][213367] Sum rewards: 34.019, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.004', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'weapon2': '0.412', 'weapon4': '0.582', 'WEAPON3': '1.100', 'HITCOUNT': '2.360', 'weapon3': '2.610', 'DAMAGECOUNT': '10.881', 'FRAGCOUNT': '29.000'} [2023-02-24 20:47:34,172][213366] DAMAGECOUNT value on done: 175479.0 [2023-02-24 20:47:34,173][213366] Sum rewards: 26.352, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.470', 'AMMO2': '0.005', 'AMMO5': '0.006', 'AMMO4': '0.022', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.176', 'AMMO3': '0.229', 'weapon2': '0.984', 'WEAPON3': '1.450', 'HITCOUNT': '2.160', 'weapon3': '2.538', 'DAMAGECOUNT': '8.190', 'FRAGCOUNT': '27.000'} [2023-02-24 20:47:34,276][213372] DAMAGECOUNT value on done: 168043.0 [2023-02-24 20:47:34,277][213372] Sum rewards: 33.612, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.278', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO4': '0.183', 'weapon5': '0.216', 'AMMO3': '0.238', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.660', 'WEAPON3': '1.400', 'HITCOUNT': '2.400', 'weapon3': '2.522', 'DAMAGECOUNT': '9.792', 'FRAGCOUNT': '34.000'} [2023-02-24 20:47:34,330][213382] DAMAGECOUNT value on done: 163650.0 [2023-02-24 20:47:34,331][213382] Sum rewards: 35.021, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.800', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO3': '0.125', 'AMMO4': '0.131', 'weapon5': '0.308', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.548', 'weapon2': '0.716', 'WEAPON3': '0.800', 'weapon3': '2.166', 'HITCOUNT': '2.290', 'DAMAGECOUNT': '10.131', 'FRAGCOUNT': '29.000'} [2023-02-24 20:47:34,424][213366] DAMAGECOUNT value on done: 172268.0 [2023-02-24 20:47:34,425][213366] Sum rewards: 34.159, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.333', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.071', 'AMMO3': '0.119', 'weapon5': '0.322', 'AMMO4': '0.355', 'WEAPON5': '0.450', 'weapon2': '0.460', 'WEAPON4': '0.650', 'WEAPON3': '0.700', 'weapon4': '1.130', 'weapon3': '1.606', 'HITCOUNT': '2.000', 'DAMAGECOUNT': '9.603', 'FRAGCOUNT': '30.000'} [2023-02-24 20:47:34,526][213383] DAMAGECOUNT value on done: 168816.0 [2023-02-24 20:47:34,527][213383] Sum rewards: 31.472, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.434', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.080', 'AMMO3': '0.106', 'WEAPON5': '0.200', 'AMMO4': '0.227', 'WEAPON4': '0.450', 'WEAPON3': '0.600', 'weapon2': '0.672', 'weapon4': '0.734', 'weapon3': '2.268', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '9.336', 'FRAGCOUNT': '26.000'} [2023-02-24 20:47:34,601][213372] DAMAGECOUNT value on done: 164287.0 [2023-02-24 20:47:34,602][213372] Sum rewards: 35.557, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.575', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon4': '0.154', 'weapon5': '0.180', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.848', 'WEAPON3': '1.150', 'weapon3': '2.352', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '10.515', 'FRAGCOUNT': '32.000'} [2023-02-24 20:47:34,638][213368] DAMAGECOUNT value on done: 164664.0 [2023-02-24 20:47:34,638][213368] Sum rewards: 32.362, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.320', 'AMMO5': '0.017', 'AMMO2': '0.048', 'AMMO3': '0.179', 'weapon5': '0.212', 'AMMO4': '0.240', 'WEAPON5': '0.300', 'weapon2': '0.338', 'WEAPON4': '0.650', 'weapon4': '0.688', 'WEAPON3': '1.050', 'weapon3': '2.420', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '10.260', 'FRAGCOUNT': '33.000'} [2023-02-24 20:47:34,654][213382] DAMAGECOUNT value on done: 170296.0 [2023-02-24 20:47:34,654][213382] Sum rewards: 42.899, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.700', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.013', 'AMMO3': '0.192', 'weapon5': '0.282', 'WEAPON5': '0.350', 'weapon2': '0.512', 'WEAPON3': '1.250', 'HITCOUNT': '2.520', 'weapon3': '2.946', 'DAMAGECOUNT': '10.806', 'FRAGCOUNT': '37.000'} [2023-02-24 20:47:34,748][213366] DAMAGECOUNT value on done: 171049.0 [2023-02-24 20:47:34,749][213366] Sum rewards: 49.435, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.998', 'AMMO5': '0.021', 'AMMO2': '0.072', 'AMMO3': '0.144', 'weapon5': '0.318', 'AMMO4': '0.358', 'ARMOR': '0.412', 'weapon2': '0.430', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '0.900', 'weapon4': '0.954', 'weapon3': '1.842', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '13.941', 'FRAGCOUNT': '43.000'} [2023-02-24 20:47:34,852][213383] DAMAGECOUNT value on done: 171150.0 [2023-02-24 20:47:34,853][213383] Sum rewards: 32.687, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.890', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.049', 'AMMO3': '0.185', 'AMMO4': '0.245', 'weapon2': '0.258', 'weapon5': '0.390', 'weapon4': '0.430', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'HITCOUNT': '2.290', 'weapon3': '2.480', 'DAMAGECOUNT': '10.374', 'FRAGCOUNT': '31.500'} [2023-02-24 20:47:34,891][213369] DAMAGECOUNT value on done: 173250.0 [2023-02-24 20:47:34,892][213369] Sum rewards: 40.014, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.660', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.098', 'AMMO3': '0.181', 'AMMO4': '0.198', 'WEAPON5': '0.200', 'weapon2': '0.334', 'WEAPON4': '0.550', 'weapon4': '0.774', 'WEAPON3': '1.050', 'weapon3': '2.464', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '11.727', 'FRAGCOUNT': '37.000'} [2023-02-24 20:47:34,926][213383] Large shaping reward 2.544 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.522, 174.0), ('weapon5', 0.002)] [2023-02-24 20:47:34,947][213368] DAMAGECOUNT value on done: 170160.0 [2023-02-24 20:47:34,948][213368] Sum rewards: 30.142, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.340', 'ARMOR': '0.004', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'AMMO3': '0.091', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'weapon5': '0.174', 'WEAPON4': '0.350', 'WEAPON3': '0.600', 'weapon4': '0.634', 'weapon2': '0.952', 'weapon3': '1.448', 'HITCOUNT': '1.990', 'DAMAGECOUNT': '8.154', 'FRAGCOUNT': '25.000'} [2023-02-24 20:47:34,948][213382] DAMAGECOUNT value on done: 163711.0 [2023-02-24 20:47:34,949][213382] Sum rewards: 30.710, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.456', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.170', 'AMMO3': '0.267', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.336', 'weapon4': '0.474', 'WEAPON3': '1.700', 'HITCOUNT': '2.320', 'weapon3': '2.658', 'DAMAGECOUNT': '8.970', 'FRAGCOUNT': '34.000'} [2023-02-24 20:47:35,200][213369] DAMAGECOUNT value on done: 170040.0 [2023-02-24 20:47:35,201][213369] Sum rewards: 31.814, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.710', 'AMMO5': '0.010', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO4': '0.135', 'AMMO3': '0.152', 'WEAPON4': '0.350', 'weapon2': '0.510', 'WEAPON3': '1.050', 'weapon4': '1.292', 'weapon3': '1.816', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '9.849', 'FRAGCOUNT': '28.000'} [2023-02-24 20:47:35,243][213332] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13329.4). Total num frames: 118550528. Throughput: 0: 3346.8. Samples: 4627180. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:47:35,243][213332] Avg episode reward: [(0, '33.179')] [2023-02-24 20:47:35,246][213368] DAMAGECOUNT value on done: 173737.0 [2023-02-24 20:47:35,247][213368] Sum rewards: 36.245, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.871', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.045', 'AMMO3': '0.158', 'AMMO4': '0.227', 'weapon5': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon2': '0.534', 'weapon4': '0.814', 'WEAPON3': '0.950', 'weapon3': '2.128', 'HITCOUNT': '2.400', 'DAMAGECOUNT': '12.357', 'FRAGCOUNT': '31.000'} [2023-02-24 20:47:35,247][213352] Saving new best policy, reward=33.179! [2023-02-24 20:47:35,254][213382] DAMAGECOUNT value on done: 169713.0 [2023-02-24 20:47:35,255][213382] Sum rewards: 38.214, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.895', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon4': '0.120', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon5': '0.236', 'WEAPON5': '0.250', 'weapon2': '0.446', 'WEAPON3': '1.250', 'HITCOUNT': '2.530', 'weapon3': '2.838', 'DAMAGECOUNT': '12.162', 'FRAGCOUNT': '34.000'} [2023-02-24 20:47:35,311][213384] DAMAGECOUNT value on done: 169913.0 [2023-02-24 20:47:35,312][213384] Sum rewards: 31.038, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.296', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon5': '0.090', 'AMMO3': '0.135', 'AMMO4': '0.275', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '0.700', 'weapon2': '0.866', 'weapon4': '0.974', 'weapon3': '1.846', 'HITCOUNT': '2.370', 'DAMAGECOUNT': '8.556', 'FRAGCOUNT': '28.000'} [2023-02-24 20:47:35,465][213383] DAMAGECOUNT value on done: 169529.0 [2023-02-24 20:47:35,466][213383] Sum rewards: 38.382, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.022', 'AMMO5': '0.010', 'AMMO2': '0.045', 'AMMO3': '0.100', 'weapon5': '0.126', 'AMMO4': '0.225', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '0.550', 'weapon4': '0.588', 'weapon2': '0.986', 'weapon3': '2.064', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '10.080', 'FRAGCOUNT': '30.000'} [2023-02-24 20:47:35,507][213369] DAMAGECOUNT value on done: 171404.0 [2023-02-24 20:47:35,508][213369] Sum rewards: 36.376, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.963', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON5': '0.050', 'weapon5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.128', 'AMMO3': '0.152', 'WEAPON3': '1.000', 'weapon2': '1.082', 'weapon3': '2.586', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '9.729', 'FRAGCOUNT': '31.000'} [2023-02-24 20:47:35,561][213368] DAMAGECOUNT value on done: 165124.0 [2023-02-24 20:47:35,562][213368] Sum rewards: 35.383, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.197', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.152', 'weapon2': '0.178', 'AMMO3': '0.271', 'WEAPON3': '1.650', 'HITCOUNT': '2.510', 'weapon3': '3.252', 'DAMAGECOUNT': '10.905', 'FRAGCOUNT': '34.000'} [2023-02-24 20:47:35,620][213384] DAMAGECOUNT value on done: 159780.0 [2023-02-24 20:47:35,620][213384] Sum rewards: 34.797, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.824', 'AMMO2': '0.015', 'AMMO5': '0.015', 'AMMO4': '0.073', 'weapon4': '0.130', 'weapon5': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.220', 'WEAPON5': '0.350', 'weapon2': '0.704', 'WEAPON3': '1.400', 'HITCOUNT': '2.390', 'weapon3': '2.744', 'DAMAGECOUNT': '9.540', 'FRAGCOUNT': '34.000'} [2023-02-24 20:47:35,767][213383] DAMAGECOUNT value on done: 162198.0 [2023-02-24 20:47:35,767][213383] Sum rewards: 37.051, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.644', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon5': '0.118', 'AMMO4': '0.119', 'AMMO3': '0.192', 'weapon4': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.282', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '2.580', 'weapon3': '3.156', 'DAMAGECOUNT': '10.500', 'FRAGCOUNT': '34.000'} [2023-02-24 20:47:35,816][213369] DAMAGECOUNT value on done: 157953.0 [2023-02-24 20:47:35,817][213369] Sum rewards: 19.432, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.911', 'AMMO5': '0.016', 'AMMO2': '0.041', 'AMMO4': '0.204', 'AMMO3': '0.212', 'weapon5': '0.326', 'WEAPON5': '0.350', 'weapon4': '0.494', 'WEAPON4': '0.550', 'weapon2': '0.916', 'WEAPON3': '1.250', 'weapon3': '1.982', 'HITCOUNT': '2.220', 'DAMAGECOUNT': '8.781', 'FRAGCOUNT': '23.000'} [2023-02-24 20:47:35,880][213384] DAMAGECOUNT value on done: 173859.0 [2023-02-24 20:47:35,881][213384] Sum rewards: 26.181, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.164', 'AMMO5': '0.021', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon2': '0.184', 'AMMO3': '0.207', 'weapon5': '0.386', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'weapon4': '0.670', 'WEAPON3': '1.200', 'weapon3': '1.894', 'HITCOUNT': '2.030', 'DAMAGECOUNT': '9.618', 'FRAGCOUNT': '26.000'} [2023-02-24 20:47:36,003][213365] Updated weights for policy 0, policy_version 28946 (0.0009) [2023-02-24 20:47:36,184][213384] DAMAGECOUNT value on done: 173207.0 [2023-02-24 20:47:36,184][213384] Sum rewards: 35.990, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.963', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.058', 'AMMO4': '0.112', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'weapon4': '0.446', 'WEAPON4': '0.450', 'weapon2': '0.680', 'WEAPON3': '1.250', 'weapon3': '2.580', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.117', 'FRAGCOUNT': '33.000'} [2023-02-24 20:47:39,068][213365] Updated weights for policy 0, policy_version 28956 (0.0009) [2023-02-24 20:47:40,243][213332] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13343.2). Total num frames: 118616064. Throughput: 0: 3343.5. Samples: 4647050. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:47:40,243][213332] Avg episode reward: [(0, '33.222')] [2023-02-24 20:47:40,244][213352] Saving new best policy, reward=33.222! [2023-02-24 20:47:42,107][213365] Updated weights for policy 0, policy_version 28966 (0.0009) [2023-02-24 20:47:45,204][213365] Updated weights for policy 0, policy_version 28976 (0.0009) [2023-02-24 20:47:45,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13357.1). Total num frames: 118685696. Throughput: 0: 3341.8. Samples: 4666970. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:47:45,243][213332] Avg episode reward: [(0, '33.222')] [2023-02-24 20:47:47,792][213366] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 20:47:48,236][213365] Updated weights for policy 0, policy_version 28986 (0.0008) [2023-02-24 20:47:50,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 118751232. Throughput: 0: 3343.1. Samples: 4677192. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:47:50,243][213332] Avg episode reward: [(0, '33.222')] [2023-02-24 20:47:51,020][213382] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 20:47:51,294][213365] Updated weights for policy 0, policy_version 28996 (0.0010) [2023-02-24 20:47:53,226][213367] DAMAGECOUNT value on done: 169831.0 [2023-02-24 20:47:53,226][213367] Sum rewards: 34.573, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.064', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon5': '0.128', 'AMMO3': '0.176', 'AMMO4': '0.212', 'WEAPON5': '0.350', 'weapon4': '0.370', 'WEAPON4': '0.500', 'weapon2': '0.898', 'WEAPON3': '1.050', 'weapon3': '2.334', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '10.314', 'FRAGCOUNT': '32.000'} [2023-02-24 20:47:53,545][213367] DAMAGECOUNT value on done: 172086.0 [2023-02-24 20:47:53,545][213367] Sum rewards: 24.969, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.412', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO3': '0.149', 'AMMO4': '0.173', 'weapon5': '0.236', 'WEAPON5': '0.300', 'weapon4': '0.368', 'WEAPON4': '0.400', 'weapon2': '0.784', 'WEAPON3': '0.900', 'HITCOUNT': '1.830', 'weapon3': '2.192', 'DAMAGECOUNT': '8.001', 'FRAGCOUNT': '23.000'} [2023-02-24 20:47:53,695][213372] DAMAGECOUNT value on done: 172841.0 [2023-02-24 20:47:53,696][213372] Sum rewards: 27.392, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.397', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.160', 'weapon5': '0.242', 'WEAPON5': '0.300', 'weapon2': '0.496', 'WEAPON4': '0.500', 'weapon4': '0.648', 'WEAPON3': '0.950', 'HITCOUNT': '2.130', 'weapon3': '2.334', 'DAMAGECOUNT': '8.823', 'FRAGCOUNT': '27.000'} [2023-02-24 20:47:53,945][213367] DAMAGECOUNT value on done: 174978.0 [2023-02-24 20:47:53,945][213367] Sum rewards: 37.834, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.244', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.114', 'AMMO3': '0.267', 'weapon2': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.750', 'WEAPON3': '1.550', 'weapon3': '2.478', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '10.995', 'FRAGCOUNT': '36.000'} [2023-02-24 20:47:54,005][213366] DAMAGECOUNT value on done: 167861.0 [2023-02-24 20:47:54,005][213366] Sum rewards: 38.116, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.613', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.070', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'WEAPON4': '0.350', 'weapon2': '0.434', 'weapon4': '0.798', 'WEAPON3': '1.200', 'weapon3': '2.458', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '10.623', 'FRAGCOUNT': '35.000'} [2023-02-24 20:47:54,021][213372] DAMAGECOUNT value on done: 176271.0 [2023-02-24 20:47:54,022][213372] Sum rewards: 37.777, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.762', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'AMMO3': '0.183', 'weapon2': '0.340', 'WEAPON4': '0.400', 'weapon4': '0.982', 'WEAPON3': '1.150', 'weapon3': '2.178', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '9.729', 'FRAGCOUNT': '35.000'} [2023-02-24 20:47:54,262][213367] DAMAGECOUNT value on done: 171516.0 [2023-02-24 20:47:54,262][213367] Sum rewards: 46.896, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.308', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.136', 'weapon5': '0.164', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.386', 'weapon2': '0.708', 'WEAPON3': '0.950', 'weapon3': '2.420', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.183', 'FRAGCOUNT': '39.000'} [2023-02-24 20:47:54,319][213366] DAMAGECOUNT value on done: 179058.0 [2023-02-24 20:47:54,319][213366] Sum rewards: 33.619, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.419', 'AMMO5': '0.024', 'AMMO2': '0.052', 'AMMO3': '0.126', 'AMMO4': '0.262', 'weapon2': '0.486', 'weapon5': '0.486', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon4': '0.654', 'WEAPON3': '0.750', 'weapon3': '1.840', 'HITCOUNT': '2.100', 'DAMAGECOUNT': '10.557', 'FRAGCOUNT': '30.000'} [2023-02-24 20:47:54,341][213372] DAMAGECOUNT value on done: 172074.0 [2023-02-24 20:47:54,342][213372] Sum rewards: 41.571, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.216', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.110', 'AMMO4': '0.159', 'weapon4': '0.178', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.596', 'WEAPON3': '1.250', 'HITCOUNT': '2.770', 'weapon3': '2.786', 'DAMAGECOUNT': '12.093', 'FRAGCOUNT': '38.000'} [2023-02-24 20:47:54,404][213365] Updated weights for policy 0, policy_version 29006 (0.0009) [2023-02-24 20:47:54,540][213382] DAMAGECOUNT value on done: 166985.0 [2023-02-24 20:47:54,540][213382] Sum rewards: 32.017, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.677', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.062', 'weapon5': '0.092', 'AMMO3': '0.156', 'WEAPON5': '0.250', 'AMMO4': '0.309', 'weapon2': '0.754', 'WEAPON4': '0.850', 'weapon4': '0.934', 'WEAPON3': '1.000', 'weapon3': '1.894', 'HITCOUNT': '2.370', 'DAMAGECOUNT': '10.005', 'FRAGCOUNT': '31.000'} [2023-02-24 20:47:54,545][213366] DAMAGECOUNT value on done: 175783.0 [2023-02-24 20:47:54,545][213366] Sum rewards: 38.352, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.449', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.032', 'AMMO3': '0.146', 'AMMO4': '0.162', 'weapon5': '0.330', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.640', 'weapon4': '0.772', 'WEAPON3': '0.900', 'weapon3': '1.932', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '10.545', 'FRAGCOUNT': '33.000'} [2023-02-24 20:47:54,653][213383] DAMAGECOUNT value on done: 171683.0 [2023-02-24 20:47:54,654][213383] Sum rewards: 26.805, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.519', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.040', 'AMMO3': '0.194', 'AMMO4': '0.200', 'weapon5': '0.280', 'weapon4': '0.312', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.586', 'WEAPON3': '1.250', 'HITCOUNT': '1.990', 'weapon3': '2.502', 'DAMAGECOUNT': '8.601', 'FRAGCOUNT': '29.000'} [2023-02-24 20:47:54,669][213372] DAMAGECOUNT value on done: 167367.0 [2023-02-24 20:47:54,670][213372] Sum rewards: 26.047, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.340', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.028', 'AMMO4': '0.142', 'AMMO3': '0.143', 'weapon5': '0.282', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.684', 'weapon4': '0.718', 'WEAPON3': '0.950', 'weapon3': '1.918', 'HITCOUNT': '2.310', 'DAMAGECOUNT': '9.240', 'FRAGCOUNT': '23.000'} [2023-02-24 20:47:54,855][213368] DAMAGECOUNT value on done: 168164.0 [2023-02-24 20:47:54,855][213368] Sum rewards: 32.660, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.280', 'AMMO5': '0.004', 'AMMO2': '0.033', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.166', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon4': '0.290', 'weapon2': '0.570', 'WEAPON3': '1.350', 'HITCOUNT': '2.580', 'weapon3': '2.874', 'DAMAGECOUNT': '10.500', 'FRAGCOUNT': '31.000'} [2023-02-24 20:47:54,859][213382] DAMAGECOUNT value on done: 173787.0 [2023-02-24 20:47:54,859][213382] Sum rewards: 38.871, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.462', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.062', 'AMMO4': '0.087', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'weapon4': '0.340', 'weapon2': '0.680', 'WEAPON3': '1.250', 'HITCOUNT': '2.440', 'weapon3': '2.630', 'DAMAGECOUNT': '10.473', 'FRAGCOUNT': '37.000'} [2023-02-24 20:47:54,863][213366] DAMAGECOUNT value on done: 174103.0 [2023-02-24 20:47:54,863][213366] Sum rewards: 25.689, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.514', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.040', 'AMMO3': '0.179', 'AMMO4': '0.201', 'weapon5': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.384', 'WEAPON4': '0.500', 'weapon4': '0.830', 'WEAPON3': '0.950', 'weapon3': '2.214', 'HITCOUNT': '2.250', 'DAMAGECOUNT': '9.162', 'FRAGCOUNT': '24.000'} [2023-02-24 20:47:54,966][213383] DAMAGECOUNT value on done: 174568.0 [2023-02-24 20:47:54,967][213383] Sum rewards: 32.762, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.599', 'AMMO5': '0.005', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon4': '0.252', 'weapon2': '0.866', 'WEAPON3': '1.050', 'HITCOUNT': '2.350', 'weapon3': '2.528', 'DAMAGECOUNT': '10.254', 'FRAGCOUNT': '28.000'} [2023-02-24 20:47:55,073][213369] DAMAGECOUNT value on done: 177085.0 [2023-02-24 20:47:55,073][213369] Sum rewards: 44.535, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.136', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.202', 'weapon4': '0.228', 'weapon2': '0.610', 'WEAPON3': '0.750', 'HITCOUNT': '2.730', 'weapon3': '2.774', 'DAMAGECOUNT': '11.505', 'FRAGCOUNT': '35.000'} [2023-02-24 20:47:55,148][213382] DAMAGECOUNT value on done: 167139.0 [2023-02-24 20:47:55,149][213382] Sum rewards: 36.456, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO3': '0.169', 'AMMO4': '0.172', 'weapon5': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HEALTH': '0.360', 'weapon2': '0.564', 'weapon4': '0.610', 'WEAPON3': '0.900', 'weapon3': '2.336', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '10.284', 'FRAGCOUNT': '32.000'} [2023-02-24 20:47:55,159][213368] DAMAGECOUNT value on done: 174720.0 [2023-02-24 20:47:55,160][213368] Sum rewards: 44.435, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.205', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon2': '0.178', 'AMMO3': '0.202', 'WEAPON5': '0.300', 'weapon5': '0.318', 'WEAPON4': '0.350', 'weapon4': '0.564', 'WEAPON3': '1.250', 'weapon3': '2.664', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.620', 'FRAGCOUNT': '39.000'} [2023-02-24 20:47:55,243][213332] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 118816768. Throughput: 0: 3340.3. Samples: 4697116. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:47:55,243][213332] Avg episode reward: [(0, '34.038')] [2023-02-24 20:47:55,247][213352] Saving new best policy, reward=34.038! [2023-02-24 20:47:55,409][213369] DAMAGECOUNT value on done: 174157.0 [2023-02-24 20:47:55,410][213369] Sum rewards: 42.057, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.855', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.184', 'weapon5': '0.278', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON4': '0.350', 'weapon4': '0.484', 'WEAPON3': '1.200', 'HITCOUNT': '2.170', 'weapon3': '2.642', 'DAMAGECOUNT': '12.321', 'FRAGCOUNT': '37.000'} [2023-02-24 20:47:55,454][213384] DAMAGECOUNT value on done: 173616.0 [2023-02-24 20:47:55,454][213384] Sum rewards: 35.959, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.551', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon7': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.180', 'AMMO3': '0.185', 'WEAPON7': '0.200', 'weapon5': '0.210', 'WEAPON5': '0.300', 'weapon2': '0.390', 'WEAPON4': '0.500', 'weapon4': '0.776', 'WEAPON3': '1.050', 'weapon3': '2.154', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '11.109', 'FRAGCOUNT': '32.000'} [2023-02-24 20:47:55,483][213382] DAMAGECOUNT value on done: 173239.0 [2023-02-24 20:47:55,483][213382] Sum rewards: 43.314, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.234', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'weapon5': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'weapon4': '0.400', 'weapon2': '0.694', 'WEAPON3': '1.100', 'weapon3': '2.552', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '10.578', 'FRAGCOUNT': '38.000'} [2023-02-24 20:47:55,490][213368] DAMAGECOUNT value on done: 176930.0 [2023-02-24 20:47:55,491][213368] Sum rewards: 31.304, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.920', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.060', 'AMMO3': '0.114', 'weapon5': '0.158', 'AMMO4': '0.299', 'WEAPON5': '0.300', 'weapon2': '0.622', 'WEAPON4': '0.700', 'WEAPON3': '0.800', 'weapon4': '1.022', 'weapon3': '1.852', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '9.579', 'FRAGCOUNT': '28.000'} [2023-02-24 20:47:55,600][213383] DAMAGECOUNT value on done: 173019.0 [2023-02-24 20:47:55,601][213383] Sum rewards: 35.556, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.651', 'AMMO5': '0.014', 'AMMO2': '0.043', 'AMMO3': '0.137', 'AMMO4': '0.213', 'weapon5': '0.254', 'weapon2': '0.264', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.826', 'WEAPON3': '0.850', 'weapon3': '2.326', 'HITCOUNT': '2.360', 'DAMAGECOUNT': '10.470', 'FRAGCOUNT': '32.000'} [2023-02-24 20:47:55,709][213369] DAMAGECOUNT value on done: 175143.0 [2023-02-24 20:47:55,709][213369] Sum rewards: 37.553, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.249', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.134', 'AMMO3': '0.164', 'AMMO4': '0.188', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.472', 'weapon4': '0.770', 'WEAPON3': '1.000', 'weapon3': '2.368', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '11.217', 'FRAGCOUNT': '32.500'} [2023-02-24 20:47:55,761][213384] DAMAGECOUNT value on done: 163158.0 [2023-02-24 20:47:55,761][213384] Sum rewards: 29.841, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.950', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.054', 'AMMO3': '0.163', 'weapon5': '0.246', 'AMMO4': '0.271', 'WEAPON5': '0.350', 'WEAPON4': '0.600', 'weapon2': '0.660', 'weapon4': '0.756', 'WEAPON3': '1.050', 'weapon3': '1.966', 'HITCOUNT': '2.270', 'DAMAGECOUNT': '10.134', 'FRAGCOUNT': '29.000'} [2023-02-24 20:47:55,796][213368] DAMAGECOUNT value on done: 168601.0 [2023-02-24 20:47:55,796][213368] Sum rewards: 31.968, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.850', 'AMMO5': '0.020', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.180', 'AMMO3': '0.220', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.458', 'weapon4': '0.958', 'WEAPON3': '1.300', 'weapon3': '2.026', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '10.431', 'FRAGCOUNT': '32.000'} [2023-02-24 20:47:55,892][213383] DAMAGECOUNT value on done: 165618.0 [2023-02-24 20:47:55,892][213383] Sum rewards: 36.989, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.764', 'ARMOR': '0.009', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.184', 'AMMO4': '0.187', 'AMMO3': '0.208', 'weapon2': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.448', 'WEAPON3': '1.200', 'HITCOUNT': '2.680', 'weapon3': '2.780', 'DAMAGECOUNT': '10.260', 'FRAGCOUNT': '36.000'} [2023-02-24 20:47:56,010][213369] DAMAGECOUNT value on done: 161989.0 [2023-02-24 20:47:56,010][213369] Sum rewards: 38.209, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.090', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.129', 'weapon5': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.288', 'WEAPON3': '0.850', 'weapon2': '0.854', 'HITCOUNT': '2.230', 'weapon3': '2.438', 'DAMAGECOUNT': '11.865', 'FRAGCOUNT': '29.000'} [2023-02-24 20:47:56,021][213384] DAMAGECOUNT value on done: 177457.0 [2023-02-24 20:47:56,021][213384] Sum rewards: 37.660, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.051', 'AMMO2': '0.004', 'AMMO4': '0.020', 'WEAPON4': '0.100', 'AMMO3': '0.183', 'weapon4': '0.236', 'weapon2': '0.520', 'WEAPON3': '1.150', 'HITCOUNT': '2.640', 'weapon3': '3.064', 'DAMAGECOUNT': '10.794', 'FRAGCOUNT': '32.000'} [2023-02-24 20:47:56,320][213384] DAMAGECOUNT value on done: 176779.0 [2023-02-24 20:47:56,320][213384] Sum rewards: 34.570, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.369', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'AMMO3': '0.184', 'AMMO4': '0.192', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon5': '0.414', 'weapon2': '0.438', 'weapon4': '0.608', 'WEAPON3': '1.050', 'weapon3': '2.184', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '10.716', 'FRAGCOUNT': '31.000'} [2023-02-24 20:47:56,376][213383] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-24 20:47:57,435][213365] Updated weights for policy 0, policy_version 29016 (0.0009) [2023-02-24 20:48:00,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 118886400. Throughput: 0: 3339.9. Samples: 4717058. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:48:00,243][213332] Avg episode reward: [(0, '34.620')] [2023-02-24 20:48:00,244][213352] Saving new best policy, reward=34.620! [2023-02-24 20:48:00,499][213365] Updated weights for policy 0, policy_version 29026 (0.0009) [2023-02-24 20:48:01,982][213382] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 20:48:03,544][213365] Updated weights for policy 0, policy_version 29036 (0.0010) [2023-02-24 20:48:05,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 118951936. Throughput: 0: 3340.5. Samples: 4727236. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:48:05,243][213332] Avg episode reward: [(0, '34.620')] [2023-02-24 20:48:06,501][213367] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-24 20:48:06,563][213365] Updated weights for policy 0, policy_version 29046 (0.0009) [2023-02-24 20:48:08,906][213366] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 20:48:09,660][213365] Updated weights for policy 0, policy_version 29056 (0.0009) [2023-02-24 20:48:10,243][213332] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 119017472. Throughput: 0: 3338.6. Samples: 4747360. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 20:48:10,243][213332] Avg episode reward: [(0, '34.620')] [2023-02-24 20:48:12,693][213365] Updated weights for policy 0, policy_version 29066 (0.0009) [2023-02-24 20:48:13,247][213367] DAMAGECOUNT value on done: 173410.0 [2023-02-24 20:48:13,247][213367] Sum rewards: 35.541, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.575', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.164', 'AMMO3': '0.176', 'weapon4': '0.182', 'weapon5': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '1.022', 'WEAPON3': '1.050', 'weapon3': '2.322', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '10.737', 'FRAGCOUNT': '31.000'} [2023-02-24 20:48:13,568][213367] DAMAGECOUNT value on done: 174453.0 [2023-02-24 20:48:13,568][213367] Sum rewards: 24.032, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.442', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon7': '0.074', 'weapon5': '0.098', 'AMMO3': '0.173', 'AMMO4': '0.243', 'WEAPON5': '0.250', 'weapon2': '0.290', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.934', 'WEAPON3': '1.000', 'HITCOUNT': '1.410', 'weapon3': '2.224', 'DAMAGECOUNT': '7.065', 'FRAGCOUNT': '24.000'} [2023-02-24 20:48:13,802][213372] DAMAGECOUNT value on done: 176106.0 [2023-02-24 20:48:13,803][213372] Sum rewards: 31.264, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.830', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'WEAPON5': '0.050', 'weapon5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.164', 'weapon4': '0.220', 'weapon2': '0.906', 'WEAPON3': '1.150', 'HITCOUNT': '2.310', 'weapon3': '2.646', 'DAMAGECOUNT': '9.735', 'FRAGCOUNT': '27.000'} [2023-02-24 20:48:13,992][213367] DAMAGECOUNT value on done: 178698.0 [2023-02-24 20:48:13,992][213367] Sum rewards: 43.164, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.069', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.183', 'weapon2': '0.254', 'weapon4': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.750', 'weapon3': '3.126', 'DAMAGECOUNT': '11.160', 'FRAGCOUNT': '37.000'} [2023-02-24 20:48:14,040][213366] DAMAGECOUNT value on done: 171229.0 [2023-02-24 20:48:14,040][213366] Sum rewards: 31.708, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.385', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.108', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'weapon4': '0.312', 'weapon2': '0.842', 'WEAPON3': '1.300', 'HITCOUNT': '2.320', 'weapon3': '2.530', 'DAMAGECOUNT': '10.104', 'FRAGCOUNT': '30.000'} [2023-02-24 20:48:14,125][213372] DAMAGECOUNT value on done: 180027.0 [2023-02-24 20:48:14,126][213372] Sum rewards: 33.452, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.092', 'AMMO5': '0.016', 'AMMO2': '0.053', 'AMMO3': '0.118', 'AMMO4': '0.267', 'weapon2': '0.326', 'weapon5': '0.352', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'WEAPON4': '0.700', 'weapon4': '1.286', 'weapon3': '1.758', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '11.268', 'FRAGCOUNT': '30.000'} [2023-02-24 20:48:14,311][213367] DAMAGECOUNT value on done: 174397.0 [2023-02-24 20:48:14,311][213367] Sum rewards: 29.518, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.980', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.025', 'AMMO3': '0.090', 'AMMO4': '0.127', 'weapon5': '0.262', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '0.600', 'weapon2': '0.744', 'weapon4': '0.934', 'weapon3': '1.672', 'HITCOUNT': '1.830', 'DAMAGECOUNT': '8.643', 'FRAGCOUNT': '26.000'} [2023-02-24 20:48:14,356][213366] DAMAGECOUNT value on done: 181829.0 [2023-02-24 20:48:14,356][213366] Sum rewards: 30.321, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.780', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.051', 'weapon7': '0.102', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.256', 'weapon2': '0.276', 'WEAPON4': '0.700', 'WEAPON3': '0.950', 'weapon3': '1.546', 'weapon4': '1.592', 'HITCOUNT': '2.020', 'DAMAGECOUNT': '8.313', 'FRAGCOUNT': '29.000'} [2023-02-24 20:48:14,441][213372] DAMAGECOUNT value on done: 175363.0 [2023-02-24 20:48:14,441][213372] Sum rewards: 34.008, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.724', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.100', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.324', 'weapon2': '0.336', 'WEAPON3': '1.300', 'HITCOUNT': '2.370', 'weapon3': '2.912', 'DAMAGECOUNT': '9.867', 'FRAGCOUNT': '33.000'} [2023-02-24 20:48:14,563][213366] DAMAGECOUNT value on done: 178934.0 [2023-02-24 20:48:14,564][213366] Sum rewards: 32.509, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.948', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon5': '0.062', 'AMMO4': '0.166', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.502', 'weapon4': '0.648', 'WEAPON3': '1.300', 'HITCOUNT': '2.260', 'weapon3': '2.478', 'DAMAGECOUNT': '9.423', 'FRAGCOUNT': '31.000'} [2023-02-24 20:48:14,619][213382] DAMAGECOUNT value on done: 170185.0 [2023-02-24 20:48:14,619][213382] Sum rewards: 33.361, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.580', 'AMMO5': '0.014', 'ARMOR': '0.016', 'AMMO2': '0.053', 'AMMO3': '0.209', 'weapon5': '0.210', 'weapon2': '0.232', 'AMMO4': '0.264', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.888', 'WEAPON3': '1.250', 'weapon3': '2.354', 'HITCOUNT': '2.400', 'DAMAGECOUNT': '9.600', 'FRAGCOUNT': '31.000'} [2023-02-24 20:48:14,701][213383] DAMAGECOUNT value on done: 174717.0 [2023-02-24 20:48:14,702][213383] Sum rewards: 32.768, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.894', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.177', 'weapon5': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.386', 'weapon2': '0.526', 'WEAPON3': '1.150', 'HITCOUNT': '1.970', 'weapon3': '2.602', 'DAMAGECOUNT': '9.102', 'FRAGCOUNT': '30.000'} [2023-02-24 20:48:14,755][213372] DAMAGECOUNT value on done: 170636.0 [2023-02-24 20:48:14,755][213372] Sum rewards: 37.980, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.338', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.008', 'WEAPON4': '0.050', 'weapon4': '0.106', 'AMMO3': '0.143', 'WEAPON5': '0.150', 'weapon5': '0.186', 'weapon2': '0.586', 'WEAPON3': '0.950', 'HITCOUNT': '2.190', 'weapon3': '2.882', 'DAMAGECOUNT': '9.807', 'FRAGCOUNT': '32.000'} [2023-02-24 20:48:14,865][213368] DAMAGECOUNT value on done: 171609.0 [2023-02-24 20:48:14,865][213368] Sum rewards: 39.023, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.570', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'WEAPON4': '0.100', 'AMMO3': '0.182', 'weapon4': '0.404', 'weapon2': '0.906', 'WEAPON3': '1.200', 'weapon3': '2.478', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '10.335', 'FRAGCOUNT': '34.000'} [2023-02-24 20:48:14,873][213366] DAMAGECOUNT value on done: 177488.0 [2023-02-24 20:48:14,873][213366] Sum rewards: 32.555, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.820', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon4': '0.154', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'weapon5': '0.234', 'WEAPON4': '0.300', 'weapon2': '0.634', 'WEAPON3': '1.100', 'HITCOUNT': '2.420', 'weapon3': '2.584', 'DAMAGECOUNT': '10.155', 'FRAGCOUNT': '29.000'} [2023-02-24 20:48:14,928][213382] DAMAGECOUNT value on done: 177023.0 [2023-02-24 20:48:14,929][213382] Sum rewards: 35.385, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.367', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.107', 'AMMO4': '0.183', 'weapon2': '0.346', 'WEAPON4': '0.600', 'WEAPON3': '0.750', 'weapon4': '1.114', 'weapon3': '1.874', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '9.708', 'FRAGCOUNT': '31.000'} [2023-02-24 20:48:15,010][213383] DAMAGECOUNT value on done: 177342.0 [2023-02-24 20:48:15,010][213383] Sum rewards: 27.039, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.000', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.042', 'AMMO3': '0.150', 'weapon5': '0.178', 'AMMO4': '0.209', 'WEAPON5': '0.350', 'weapon2': '0.434', 'WEAPON4': '0.600', 'weapon4': '0.792', 'WEAPON3': '0.850', 'HITCOUNT': '1.970', 'weapon3': '2.374', 'DAMAGECOUNT': '8.322', 'FRAGCOUNT': '27.000'} [2023-02-24 20:48:15,151][213369] DAMAGECOUNT value on done: 180977.0 [2023-02-24 20:48:15,152][213369] Sum rewards: 33.858, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.530', 'AMMO5': '0.015', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.144', 'WEAPON4': '0.200', 'AMMO3': '0.279', 'weapon2': '0.294', 'WEAPON5': '0.300', 'weapon4': '0.512', 'WEAPON3': '1.600', 'weapon3': '2.736', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '11.676', 'FRAGCOUNT': '33.000'} [2023-02-24 20:48:15,169][213368] DAMAGECOUNT value on done: 178138.0 [2023-02-24 20:48:15,169][213368] Sum rewards: 34.913, reward structure: {'DEATHCOUNT': '-15.750', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon7': '0.054', 'HEALTH': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO3': '0.205', 'AMMO4': '0.206', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON4': '0.400', 'weapon5': '0.438', 'weapon4': '0.732', 'WEAPON3': '1.100', 'weapon3': '1.930', 'HITCOUNT': '2.100', 'DAMAGECOUNT': '10.254', 'FRAGCOUNT': '32.000'} [2023-02-24 20:48:15,208][213382] DAMAGECOUNT value on done: 170469.0 [2023-02-24 20:48:15,209][213382] Sum rewards: 35.577, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.695', 'AMMO5': '0.015', 'weapon4': '0.018', 'AMMO2': '0.022', 'WEAPON4': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.154', 'WEAPON5': '0.200', 'weapon5': '0.268', 'weapon2': '0.570', 'WEAPON3': '1.050', 'HITCOUNT': '2.360', 'weapon3': '2.914', 'DAMAGECOUNT': '9.990', 'FRAGCOUNT': '30.000'} [2023-02-24 20:48:15,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 119087104. Throughput: 0: 3340.9. Samples: 4767356. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 20:48:15,243][213332] Avg episode reward: [(0, '34.316')] [2023-02-24 20:48:15,454][213369] DAMAGECOUNT value on done: 177219.0 [2023-02-24 20:48:15,454][213369] Sum rewards: 30.397, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.356', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.007', 'WEAPON1': '0.020', 'WEAPON5': '0.100', 'weapon5': '0.126', 'AMMO3': '0.204', 'weapon2': '0.894', 'WEAPON3': '1.300', 'HITCOUNT': '2.360', 'weapon3': '2.802', 'DAMAGECOUNT': '9.186', 'FRAGCOUNT': '27.000'} [2023-02-24 20:48:15,455][213368] DAMAGECOUNT value on done: 179894.0 [2023-02-24 20:48:15,456][213368] Sum rewards: 28.191, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.682', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.148', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'weapon2': '0.556', 'weapon4': '0.846', 'WEAPON3': '1.150', 'HITCOUNT': '2.210', 'weapon3': '2.240', 'DAMAGECOUNT': '8.892', 'FRAGCOUNT': '26.000'} [2023-02-24 20:48:15,486][213384] DAMAGECOUNT value on done: 177034.0 [2023-02-24 20:48:15,486][213384] Sum rewards: 37.668, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.364', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO3': '0.086', 'AMMO4': '0.169', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon5': '0.416', 'weapon2': '0.518', 'weapon4': '0.518', 'WEAPON3': '0.550', 'weapon3': '2.254', 'HITCOUNT': '2.260', 'DAMAGECOUNT': '10.254', 'FRAGCOUNT': '30.000'} [2023-02-24 20:48:15,511][213382] DAMAGECOUNT value on done: 176691.0 [2023-02-24 20:48:15,511][213382] Sum rewards: 33.212, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.745', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon4': '0.090', 'weapon5': '0.108', 'AMMO4': '0.165', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.672', 'WEAPON3': '1.100', 'HITCOUNT': '2.360', 'weapon3': '2.886', 'DAMAGECOUNT': '10.356', 'FRAGCOUNT': '30.000'} [2023-02-24 20:48:15,603][213383] DAMAGECOUNT value on done: 176308.0 [2023-02-24 20:48:15,603][213383] Sum rewards: 29.808, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.754', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.048', 'AMMO3': '0.159', 'AMMO4': '0.240', 'WEAPON4': '0.450', 'weapon2': '0.488', 'weapon5': '0.492', 'WEAPON5': '0.500', 'weapon4': '0.624', 'WEAPON3': '1.000', 'HITCOUNT': '1.970', 'weapon3': '2.022', 'DAMAGECOUNT': '9.789', 'FRAGCOUNT': '28.000'} [2023-02-24 20:48:15,743][213368] DAMAGECOUNT value on done: 170804.0 [2023-02-24 20:48:15,743][213368] Sum rewards: 22.434, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.305', 'AMMO5': '0.019', 'AMMO2': '0.024', 'weapon7': '0.078', 'AMMO3': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.122', 'WEAPON7': '0.200', 'weapon5': '0.304', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon4': '0.694', 'weapon2': '0.918', 'weapon3': '1.586', 'HITCOUNT': '1.630', 'DAMAGECOUNT': '6.609', 'FRAGCOUNT': '20.000'} [2023-02-24 20:48:15,744][213369] DAMAGECOUNT value on done: 178410.0 [2023-02-24 20:48:15,745][213369] Sum rewards: 34.435, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.871', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon4': '0.038', 'weapon5': '0.076', 'AMMO4': '0.120', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.740', 'WEAPON3': '1.300', 'HITCOUNT': '2.200', 'weapon3': '2.908', 'DAMAGECOUNT': '9.801', 'FRAGCOUNT': '31.500'} [2023-02-24 20:48:15,769][213365] Updated weights for policy 0, policy_version 29076 (0.0009) [2023-02-24 20:48:15,786][213384] DAMAGECOUNT value on done: 165527.0 [2023-02-24 20:48:15,786][213384] Sum rewards: 23.938, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.430', 'AMMO5': '0.010', 'ARMOR': '0.025', 'AMMO2': '0.037', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.154', 'AMMO3': '0.172', 'AMMO4': '0.185', 'WEAPON7': '0.200', 'weapon5': '0.222', 'WEAPON5': '0.350', 'weapon2': '0.384', 'WEAPON4': '0.500', 'weapon4': '0.934', 'WEAPON3': '1.050', 'HITCOUNT': '1.470', 'weapon3': '1.828', 'DAMAGECOUNT': '7.107', 'FRAGCOUNT': '25.000'} [2023-02-24 20:48:15,905][213383] DAMAGECOUNT value on done: 168950.0 [2023-02-24 20:48:15,906][213383] Sum rewards: 31.646, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.192', 'AMMO2': '0.007', 'AMMO5': '0.022', 'AMMO4': '0.037', 'WEAPON4': '0.100', 'weapon5': '0.106', 'AMMO3': '0.269', 'WEAPON5': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.550', 'HITCOUNT': '2.550', 'weapon3': '3.160', 'DAMAGECOUNT': '9.996', 'FRAGCOUNT': '31.000'} [2023-02-24 20:48:16,019][213384] DAMAGECOUNT value on done: 180777.0 [2023-02-24 20:48:16,019][213384] Sum rewards: 30.608, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.265', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.052', 'AMMO3': '0.112', 'AMMO4': '0.259', 'weapon2': '0.350', 'WEAPON5': '0.500', 'weapon5': '0.504', 'weapon4': '0.614', 'WEAPON4': '0.700', 'WEAPON3': '0.850', 'HITCOUNT': '1.950', 'weapon3': '1.998', 'DAMAGECOUNT': '9.960', 'FRAGCOUNT': '28.000'} [2023-02-24 20:48:16,056][213369] DAMAGECOUNT value on done: 165796.0 [2023-02-24 20:48:16,057][213369] Sum rewards: 45.621, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.672', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.070', 'AMMO3': '0.132', 'weapon5': '0.250', 'weapon2': '0.344', 'AMMO4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'WEAPON4': '0.900', 'weapon4': '1.156', 'weapon3': '1.844', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '11.421', 'FRAGCOUNT': '43.000'} [2023-02-24 20:48:16,326][213384] DAMAGECOUNT value on done: 180221.0 [2023-02-24 20:48:16,327][213384] Sum rewards: 34.870, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.695', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon7': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.159', 'AMMO4': '0.275', 'weapon5': '0.302', 'WEAPON4': '0.400', 'ARMOR': '0.404', 'WEAPON5': '0.450', 'weapon4': '0.626', 'weapon2': '0.714', 'WEAPON3': '0.950', 'weapon3': '1.892', 'HITCOUNT': '2.100', 'DAMAGECOUNT': '10.326', 'FRAGCOUNT': '31.000'} [2023-02-24 20:48:18,790][213365] Updated weights for policy 0, policy_version 29086 (0.0009) [2023-02-24 20:48:20,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 119152640. Throughput: 0: 3341.6. Samples: 4777550. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 20:48:20,243][213332] Avg episode reward: [(0, '34.031')] [2023-02-24 20:48:21,795][213365] Updated weights for policy 0, policy_version 29096 (0.0009) [2023-02-24 20:48:24,918][213365] Updated weights for policy 0, policy_version 29106 (0.0009) [2023-02-24 20:48:25,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 119222272. Throughput: 0: 3349.8. Samples: 4797792. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 20:48:25,243][213332] Avg episode reward: [(0, '34.031')] [2023-02-24 20:48:27,903][213365] Updated weights for policy 0, policy_version 29116 (0.0009) [2023-02-24 20:48:30,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 119287808. Throughput: 0: 3351.8. Samples: 4817802. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 20:48:30,243][213332] Avg episode reward: [(0, '34.031')] [2023-02-24 20:48:30,937][213365] Updated weights for policy 0, policy_version 29126 (0.0009) [2023-02-24 20:48:33,251][213367] DAMAGECOUNT value on done: 176845.0 [2023-02-24 20:48:33,251][213367] Sum rewards: 37.296, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.745', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon5': '0.080', 'AMMO4': '0.132', 'AMMO3': '0.173', 'weapon2': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.800', 'WEAPON3': '1.100', 'weapon3': '2.628', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '10.284', 'FRAGCOUNT': '34.000'} [2023-02-24 20:48:33,578][213367] DAMAGECOUNT value on done: 178034.0 [2023-02-24 20:48:33,578][213367] Sum rewards: 35.939, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.356', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.126', 'AMMO4': '0.151', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'weapon4': '0.308', 'WEAPON4': '0.350', 'weapon2': '0.538', 'WEAPON3': '1.400', 'HITCOUNT': '2.410', 'weapon3': '2.742', 'DAMAGECOUNT': '10.743', 'FRAGCOUNT': '34.000'} [2023-02-24 20:48:33,805][213372] DAMAGECOUNT value on done: 179405.0 [2023-02-24 20:48:33,806][213372] Sum rewards: 30.183, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.530', 'AMMO5': '0.009', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.175', 'weapon5': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.380', 'weapon2': '0.792', 'WEAPON3': '1.100', 'HITCOUNT': '2.050', 'weapon3': '2.328', 'DAMAGECOUNT': '9.897', 'FRAGCOUNT': '27.000'} [2023-02-24 20:48:33,977][213367] DAMAGECOUNT value on done: 182370.0 [2023-02-24 20:48:33,978][213367] Sum rewards: 41.938, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.820', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.042', 'AMMO3': '0.136', 'AMMO4': '0.210', 'weapon4': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.316', 'weapon2': '0.566', 'WEAPON3': '0.850', 'HITCOUNT': '2.490', 'weapon3': '2.626', 'DAMAGECOUNT': '11.016', 'FRAGCOUNT': '35.000'} [2023-02-24 20:48:34,045][213365] Updated weights for policy 0, policy_version 29136 (0.0009) [2023-02-24 20:48:34,115][213366] DAMAGECOUNT value on done: 174672.0 [2023-02-24 20:48:34,116][213366] Sum rewards: 38.628, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.436', 'AMMO5': '0.017', 'AMMO2': '0.044', 'AMMO3': '0.189', 'weapon5': '0.208', 'AMMO4': '0.219', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.500', 'weapon2': '0.758', 'WEAPON3': '1.050', 'weapon3': '2.260', 'HITCOUNT': '2.340', 'DAMAGECOUNT': '10.329', 'FRAGCOUNT': '35.000'} [2023-02-24 20:48:34,121][213372] DAMAGECOUNT value on done: 183298.0 [2023-02-24 20:48:34,121][213372] Sum rewards: 32.753, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.450', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.060', 'WEAPON5': '0.150', 'weapon5': '0.152', 'AMMO3': '0.154', 'AMMO4': '0.298', 'WEAPON4': '0.550', 'weapon4': '0.672', 'weapon2': '0.734', 'WEAPON3': '0.900', 'HITCOUNT': '2.040', 'weapon3': '2.170', 'DAMAGECOUNT': '9.813', 'FRAGCOUNT': '30.000'} [2023-02-24 20:48:34,293][213367] DAMAGECOUNT value on done: 177240.0 [2023-02-24 20:48:34,293][213367] Sum rewards: 33.111, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.455', 'AMMO5': '0.006', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon7': '0.076', 'weapon5': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'weapon4': '0.232', 'weapon2': '0.424', 'WEAPON3': '1.000', 'HITCOUNT': '2.100', 'weapon3': '2.960', 'DAMAGECOUNT': '8.529', 'FRAGCOUNT': '29.500'} [2023-02-24 20:48:34,427][213366] DAMAGECOUNT value on done: 185224.0 [2023-02-24 20:48:34,427][213366] Sum rewards: 33.914, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.866', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.039', 'AMMO4': '0.196', 'AMMO3': '0.198', 'weapon5': '0.242', 'weapon2': '0.258', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.864', 'WEAPON3': '1.200', 'weapon3': '2.322', 'HITCOUNT': '2.450', 'DAMAGECOUNT': '10.185', 'FRAGCOUNT': '32.000'} [2023-02-24 20:48:34,441][213372] DAMAGECOUNT value on done: 178021.0 [2023-02-24 20:48:34,441][213372] Sum rewards: 26.076, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.785', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.150', 'weapon5': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.604', 'WEAPON3': '0.900', 'weapon4': '1.218', 'weapon3': '1.658', 'HITCOUNT': '1.880', 'DAMAGECOUNT': '7.974', 'FRAGCOUNT': '23.000'} [2023-02-24 20:48:34,560][213382] DAMAGECOUNT value on done: 172906.0 [2023-02-24 20:48:34,560][213382] Sum rewards: 25.670, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.997', 'AMMO5': '0.007', 'AMMO2': '0.037', 'AMMO3': '0.134', 'WEAPON5': '0.150', 'AMMO4': '0.182', 'weapon5': '0.280', 'WEAPON4': '0.350', 'weapon2': '0.376', 'ARMOR': '0.462', 'WEAPON3': '0.800', 'weapon4': '0.828', 'HITCOUNT': '2.150', 'weapon3': '2.248', 'DAMAGECOUNT': '8.163', 'FRAGCOUNT': '22.500'} [2023-02-24 20:48:34,620][213366] DAMAGECOUNT value on done: 182697.0 [2023-02-24 20:48:34,621][213366] Sum rewards: 41.832, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.005', 'AMMO2': '0.041', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO3': '0.168', 'AMMO4': '0.206', 'WEAPON4': '0.300', 'ARMOR': '0.404', 'HEALTH': '0.472', 'weapon2': '0.572', 'weapon4': '0.754', 'WEAPON3': '0.900', 'weapon3': '2.340', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '11.289', 'FRAGCOUNT': '36.000'} [2023-02-24 20:48:34,752][213383] DAMAGECOUNT value on done: 178704.0 [2023-02-24 20:48:34,753][213383] Sum rewards: 42.913, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.272', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.051', 'AMMO3': '0.121', 'AMMO4': '0.254', 'WEAPON5': '0.300', 'weapon5': '0.344', 'weapon2': '0.346', 'WEAPON4': '0.650', 'WEAPON3': '0.650', 'weapon4': '1.100', 'weapon3': '1.912', 'HITCOUNT': '2.230', 'DAMAGECOUNT': '11.961', 'FRAGCOUNT': '36.000'} [2023-02-24 20:48:34,754][213372] DAMAGECOUNT value on done: 173782.0 [2023-02-24 20:48:34,755][213372] Sum rewards: 31.466, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.690', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.016', 'weapon4': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.215', 'weapon2': '0.512', 'WEAPON3': '1.350', 'HITCOUNT': '2.170', 'weapon3': '3.218', 'DAMAGECOUNT': '9.438', 'FRAGCOUNT': '29.000'} [2023-02-24 20:48:34,875][213382] DAMAGECOUNT value on done: 179810.0 [2023-02-24 20:48:34,876][213382] Sum rewards: 30.537, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.510', 'AMMO5': '0.004', 'weapon5': '0.028', 'AMMO2': '0.037', 'weapon7': '0.094', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.133', 'AMMO4': '0.185', 'WEAPON7': '0.200', 'WEAPON4': '0.450', 'weapon2': '0.480', 'ARMOR': '0.500', 'WEAPON3': '0.800', 'weapon4': '0.938', 'HITCOUNT': '2.210', 'weapon3': '2.288', 'DAMAGECOUNT': '8.361', 'FRAGCOUNT': '27.000'} [2023-02-24 20:48:34,897][213368] DAMAGECOUNT value on done: 173759.0 [2023-02-24 20:48:34,898][213368] Sum rewards: 20.765, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.139', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon5': '0.128', 'AMMO3': '0.202', 'AMMO4': '0.251', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.674', 'weapon2': '0.700', 'WEAPON3': '1.150', 'HITCOUNT': '1.740', 'weapon3': '2.116', 'DAMAGECOUNT': '6.375', 'FRAGCOUNT': '23.000'} [2023-02-24 20:48:34,932][213366] DAMAGECOUNT value on done: 181276.0 [2023-02-24 20:48:34,932][213366] Sum rewards: 34.961, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.112', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.156', 'AMMO3': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.448', 'weapon2': '0.816', 'WEAPON3': '1.250', 'weapon3': '2.430', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '11.364', 'FRAGCOUNT': '33.000'} [2023-02-24 20:48:35,052][213383] DAMAGECOUNT value on done: 180893.0 [2023-02-24 20:48:35,052][213383] Sum rewards: 28.688, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.518', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.042', 'AMMO3': '0.146', 'AMMO4': '0.212', 'weapon2': '0.338', 'weapon5': '0.444', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '0.800', 'weapon4': '0.876', 'weapon3': '1.982', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '10.482', 'FRAGCOUNT': '25.500'} [2023-02-24 20:48:35,158][213382] DAMAGECOUNT value on done: 173732.0 [2023-02-24 20:48:35,158][213382] Sum rewards: 32.486, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.688', 'AMMO5': '0.008', 'weapon7': '0.018', 'weapon5': '0.046', 'AMMO2': '0.047', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.233', 'AMMO3': '0.265', 'weapon2': '0.362', 'WEAPON4': '0.400', 'ARMOR': '0.404', 'weapon4': '0.692', 'WEAPON3': '1.500', 'HITCOUNT': '2.410', 'weapon3': '2.530', 'DAMAGECOUNT': '9.789', 'FRAGCOUNT': '33.000'} [2023-02-24 20:48:35,176][213369] DAMAGECOUNT value on done: 184639.0 [2023-02-24 20:48:35,176][213369] Sum rewards: 41.499, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.055', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'weapon5': '0.192', 'WEAPON4': '0.250', 'weapon4': '0.316', 'weapon2': '0.516', 'WEAPON3': '0.950', 'HITCOUNT': '2.580', 'weapon3': '2.790', 'DAMAGECOUNT': '10.986', 'FRAGCOUNT': '36.000'} [2023-02-24 20:48:35,202][213368] DAMAGECOUNT value on done: 180970.0 [2023-02-24 20:48:35,202][213368] Sum rewards: 26.586, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.838', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.082', 'AMMO3': '0.160', 'AMMO4': '0.195', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.796', 'WEAPON3': '0.950', 'weapon2': '0.990', 'weapon3': '1.684', 'HITCOUNT': '1.920', 'DAMAGECOUNT': '8.496', 'FRAGCOUNT': '26.000'} [2023-02-24 20:48:35,243][213332] Fps is (10 sec: 13107.0, 60 sec: 13380.2, 300 sec: 13384.9). Total num frames: 119353344. Throughput: 0: 3352.6. Samples: 4828058. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 20:48:35,244][213332] Avg episode reward: [(0, '33.889')] [2023-02-24 20:48:35,462][213382] DAMAGECOUNT value on done: 180109.0 [2023-02-24 20:48:35,463][213382] Sum rewards: 30.327, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.456', 'AMMO5': '0.010', 'AMMO2': '0.041', 'AMMO3': '0.144', 'weapon5': '0.170', 'WEAPON5': '0.200', 'AMMO4': '0.206', 'WEAPON4': '0.400', 'weapon2': '0.462', 'WEAPON3': '0.900', 'weapon4': '0.954', 'weapon3': '2.072', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '10.254', 'FRAGCOUNT': '27.000'} [2023-02-24 20:48:35,479][213369] DAMAGECOUNT value on done: 180157.0 [2023-02-24 20:48:35,480][213369] Sum rewards: 32.254, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.292', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.057', 'AMMO3': '0.126', 'AMMO4': '0.286', 'weapon5': '0.346', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.614', 'WEAPON3': '0.650', 'weapon2': '0.682', 'weapon3': '1.888', 'HITCOUNT': '2.160', 'DAMAGECOUNT': '8.814', 'FRAGCOUNT': '31.000'} [2023-02-24 20:48:35,485][213384] DAMAGECOUNT value on done: 180872.0 [2023-02-24 20:48:35,485][213384] Sum rewards: 39.264, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.760', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.036', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.180', 'AMMO3': '0.193', 'weapon2': '0.380', 'WEAPON4': '0.400', 'weapon4': '0.528', 'WEAPON3': '1.200', 'weapon3': '2.838', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '11.514', 'FRAGCOUNT': '35.000'} [2023-02-24 20:48:35,490][213368] DAMAGECOUNT value on done: 182984.0 [2023-02-24 20:48:35,490][213368] Sum rewards: 26.298, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.634', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.122', 'AMMO3': '0.179', 'AMMO4': '0.232', 'WEAPON5': '0.250', 'weapon2': '0.352', 'WEAPON4': '0.450', 'weapon4': '0.454', 'WEAPON3': '1.050', 'HITCOUNT': '1.930', 'weapon3': '2.882', 'DAMAGECOUNT': '8.970', 'FRAGCOUNT': '26.000'} [2023-02-24 20:48:35,659][213383] DAMAGECOUNT value on done: 180022.0 [2023-02-24 20:48:35,660][213383] Sum rewards: 38.941, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.245', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.180', 'AMMO3': '0.200', 'AMMO4': '0.223', 'weapon4': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '2.390', 'weapon3': '2.908', 'DAMAGECOUNT': '11.142', 'FRAGCOUNT': '35.000'} [2023-02-24 20:48:35,781][213369] DAMAGECOUNT value on done: 181835.0 [2023-02-24 20:48:35,781][213369] Sum rewards: 38.643, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.941', 'AMMO5': '0.010', 'AMMO2': '0.051', 'AMMO3': '0.129', 'WEAPON5': '0.150', 'weapon5': '0.226', 'AMMO4': '0.257', 'weapon2': '0.294', 'WEAPON4': '0.500', 'WEAPON3': '0.800', 'weapon4': '1.008', 'weapon3': '2.154', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '10.275', 'FRAGCOUNT': '34.000'} [2023-02-24 20:48:35,785][213384] DAMAGECOUNT value on done: 168933.0 [2023-02-24 20:48:35,786][213384] Sum rewards: 30.300, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.648', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.120', 'weapon5': '0.272', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '0.700', 'weapon4': '0.720', 'weapon2': '0.864', 'weapon3': '1.722', 'HITCOUNT': '2.120', 'DAMAGECOUNT': '10.218', 'FRAGCOUNT': '27.000'} [2023-02-24 20:48:35,788][213368] DAMAGECOUNT value on done: 174097.0 [2023-02-24 20:48:35,788][213368] Sum rewards: 32.894, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.205', 'AMMO5': '0.017', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.178', 'WEAPON5': '0.250', 'weapon5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.436', 'weapon4': '0.584', 'WEAPON3': '1.100', 'HITCOUNT': '2.410', 'weapon3': '2.446', 'DAMAGECOUNT': '9.879', 'FRAGCOUNT': '32.000'} [2023-02-24 20:48:35,960][213383] DAMAGECOUNT value on done: 172121.0 [2023-02-24 20:48:35,960][213383] Sum rewards: 28.430, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.348', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.045', 'AMMO3': '0.152', 'weapon2': '0.212', 'AMMO4': '0.225', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon5': '0.712', 'weapon4': '0.762', 'WEAPON3': '0.950', 'HITCOUNT': '1.860', 'weapon3': '1.880', 'DAMAGECOUNT': '9.513', 'FRAGCOUNT': '25.500'} [2023-02-24 20:48:36,037][213384] DAMAGECOUNT value on done: 183983.0 [2023-02-24 20:48:36,038][213384] Sum rewards: 34.859, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.173', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.043', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'AMMO4': '0.215', 'weapon2': '0.234', 'WEAPON4': '0.600', 'WEAPON3': '0.600', 'weapon4': '1.624', 'weapon3': '1.840', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '9.618', 'FRAGCOUNT': '29.000'} [2023-02-24 20:48:36,082][213369] DAMAGECOUNT value on done: 169273.0 [2023-02-24 20:48:36,083][213369] Sum rewards: 37.384, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.110', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon5': '0.138', 'AMMO3': '0.151', 'AMMO4': '0.168', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.354', 'weapon2': '0.524', 'WEAPON3': '0.950', 'HITCOUNT': '2.250', 'weapon3': '2.780', 'DAMAGECOUNT': '10.431', 'FRAGCOUNT': '33.000'} [2023-02-24 20:48:36,342][213384] DAMAGECOUNT value on done: 183679.0 [2023-02-24 20:48:36,342][213384] Sum rewards: 34.400, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.640', 'AMMO2': '0.010', 'AMMO5': '0.013', 'AMMO4': '0.052', 'AMMO3': '0.160', 'weapon5': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.364', 'WEAPON3': '0.900', 'weapon2': '1.054', 'weapon3': '2.094', 'HITCOUNT': '2.320', 'DAMAGECOUNT': '10.374', 'FRAGCOUNT': '29.000'} [2023-02-24 20:48:37,060][213365] Updated weights for policy 0, policy_version 29146 (0.0009) [2023-02-24 20:48:40,115][213365] Updated weights for policy 0, policy_version 29156 (0.0010) [2023-02-24 20:48:40,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13384.9). Total num frames: 119422976. Throughput: 0: 3353.5. Samples: 4848024. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 20:48:40,243][213332] Avg episode reward: [(0, '33.771')] [2023-02-24 20:48:42,295][213382] Large shaping reward 2.593 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.039, -13.0), ('weapon5', 0.002)] [2023-02-24 20:48:43,150][213365] Updated weights for policy 0, policy_version 29166 (0.0009) [2023-02-24 20:48:45,243][213332] Fps is (10 sec: 13517.0, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 119488512. Throughput: 0: 3356.7. Samples: 4868110. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 20:48:45,243][213332] Avg episode reward: [(0, '33.771')] [2023-02-24 20:48:45,247][213352] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000029172_119488512.pth... [2023-02-24 20:48:45,309][213352] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000028388_116277248.pth [2023-02-24 20:48:46,236][213365] Updated weights for policy 0, policy_version 29176 (0.0009) [2023-02-24 20:48:47,639][213384] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 20:48:49,310][213365] Updated weights for policy 0, policy_version 29186 (0.0009) [2023-02-24 20:48:49,966][213366] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 20:48:50,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 119558144. Throughput: 0: 3355.5. Samples: 4878234. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 20:48:50,243][213332] Avg episode reward: [(0, '33.771')] [2023-02-24 20:48:52,317][213365] Updated weights for policy 0, policy_version 29196 (0.0009) [2023-02-24 20:48:53,298][213367] DAMAGECOUNT value on done: 180532.0 [2023-02-24 20:48:53,299][213367] Sum rewards: 40.865, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.410', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO3': '0.123', 'weapon5': '0.192', 'AMMO4': '0.195', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.494', 'weapon2': '0.524', 'WEAPON3': '0.800', 'weapon3': '2.414', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '11.061', 'FRAGCOUNT': '35.000'} [2023-02-24 20:48:53,609][213367] DAMAGECOUNT value on done: 181574.0 [2023-02-24 20:48:53,609][213367] Sum rewards: 30.034, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.886', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.038', 'AMMO4': '0.057', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.264', 'weapon2': '0.470', 'WEAPON3': '1.600', 'HITCOUNT': '2.410', 'weapon3': '3.118', 'DAMAGECOUNT': '10.620', 'FRAGCOUNT': '29.000'} [2023-02-24 20:48:53,781][213372] DAMAGECOUNT value on done: 182201.0 [2023-02-24 20:48:53,782][213372] Sum rewards: 32.543, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.035', 'AMMO5': '0.004', 'AMMO2': '0.032', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'AMMO4': '0.158', 'WEAPON4': '0.450', 'weapon2': '0.548', 'weapon4': '0.682', 'WEAPON3': '0.850', 'HITCOUNT': '2.170', 'weapon3': '2.462', 'DAMAGECOUNT': '8.388', 'FRAGCOUNT': '28.000'} [2023-02-24 20:48:54,008][213367] DAMAGECOUNT value on done: 185161.0 [2023-02-24 20:48:54,009][213367] Sum rewards: 27.814, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.267', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.082', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'weapon2': '0.180', 'AMMO3': '0.210', 'weapon4': '0.390', 'WEAPON3': '1.250', 'HITCOUNT': '1.910', 'weapon3': '3.158', 'DAMAGECOUNT': '8.373', 'FRAGCOUNT': '26.000'} [2023-02-24 20:48:54,098][213372] DAMAGECOUNT value on done: 186259.0 [2023-02-24 20:48:54,098][213372] Sum rewards: 34.032, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.310', 'AMMO5': '0.005', 'AMMO2': '0.023', 'AMMO3': '0.083', 'AMMO4': '0.114', 'weapon5': '0.122', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.552', 'WEAPON3': '0.600', 'weapon2': '1.036', 'weapon3': '2.144', 'HITCOUNT': '2.230', 'DAMAGECOUNT': '8.883', 'FRAGCOUNT': '28.000'} [2023-02-24 20:48:54,133][213366] DAMAGECOUNT value on done: 177764.0 [2023-02-24 20:48:54,133][213366] Sum rewards: 35.236, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.150', 'AMMO5': '0.010', 'AMMO2': '0.066', 'AMMO3': '0.100', 'weapon5': '0.142', 'WEAPON5': '0.250', 'AMMO4': '0.328', 'WEAPON4': '0.550', 'WEAPON3': '0.650', 'weapon2': '0.776', 'weapon4': '1.078', 'weapon3': '1.720', 'HITCOUNT': '2.190', 'DAMAGECOUNT': '9.276', 'FRAGCOUNT': '32.000'} [2023-02-24 20:48:54,326][213367] DAMAGECOUNT value on done: 181135.0 [2023-02-24 20:48:54,327][213367] Sum rewards: 40.169, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.645', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.122', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon4': '0.308', 'WEAPON4': '0.400', 'weapon2': '0.936', 'WEAPON3': '1.250', 'weapon3': '2.366', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '11.685', 'FRAGCOUNT': '36.500'} [2023-02-24 20:48:54,421][213372] DAMAGECOUNT value on done: 181076.0 [2023-02-24 20:48:54,421][213372] Sum rewards: 30.344, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.215', 'weapon5': '0.002', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.110', 'AMMO3': '0.207', 'weapon2': '0.258', 'WEAPON4': '0.300', 'weapon4': '0.442', 'WEAPON3': '1.450', 'HITCOUNT': '2.210', 'weapon3': '3.082', 'DAMAGECOUNT': '9.165', 'FRAGCOUNT': '30.000'} [2023-02-24 20:48:54,452][213366] DAMAGECOUNT value on done: 189068.0 [2023-02-24 20:48:54,453][213366] Sum rewards: 38.405, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.254', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon5': '0.166', 'AMMO3': '0.180', 'AMMO4': '0.220', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.488', 'weapon4': '0.904', 'WEAPON3': '0.950', 'weapon3': '2.198', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '11.532', 'FRAGCOUNT': '33.000'} [2023-02-24 20:48:54,647][213382] DAMAGECOUNT value on done: 176429.0 [2023-02-24 20:48:54,647][213382] Sum rewards: 40.725, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.202', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.031', 'AMMO3': '0.145', 'AMMO4': '0.156', 'weapon5': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.536', 'weapon2': '0.784', 'WEAPON3': '0.950', 'weapon3': '2.014', 'HITCOUNT': '2.230', 'DAMAGECOUNT': '10.569', 'FRAGCOUNT': '36.000'} [2023-02-24 20:48:54,658][213366] DAMAGECOUNT value on done: 185789.0 [2023-02-24 20:48:54,659][213366] Sum rewards: 28.392, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.236', 'AMMO5': '0.015', 'AMMO2': '0.047', 'AMMO3': '0.187', 'AMMO4': '0.235', 'weapon5': '0.274', 'WEAPON5': '0.450', 'weapon4': '0.546', 'WEAPON4': '0.550', 'weapon2': '0.934', 'WEAPON3': '1.050', 'weapon3': '1.924', 'HITCOUNT': '2.140', 'DAMAGECOUNT': '9.276', 'FRAGCOUNT': '28.000'} [2023-02-24 20:48:54,742][213372] DAMAGECOUNT value on done: 177443.0 [2023-02-24 20:48:54,742][213372] Sum rewards: 36.223, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.115', 'AMMO5': '0.017', 'AMMO2': '0.038', 'AMMO3': '0.109', 'AMMO4': '0.192', 'weapon5': '0.304', 'weapon2': '0.378', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.536', 'WEAPON3': '0.850', 'weapon3': '2.390', 'HITCOUNT': '2.390', 'DAMAGECOUNT': '10.983', 'FRAGCOUNT': '30.500'} [2023-02-24 20:48:54,842][213383] DAMAGECOUNT value on done: 181580.0 [2023-02-24 20:48:54,842][213383] Sum rewards: 27.256, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.680', 'AMMO2': '0.024', 'AMMO4': '0.119', 'WEAPON4': '0.250', 'AMMO3': '0.253', 'weapon2': '0.400', 'weapon4': '0.494', 'WEAPON3': '1.500', 'HITCOUNT': '2.370', 'weapon3': '2.898', 'DAMAGECOUNT': '8.628', 'FRAGCOUNT': '28.000'} [2023-02-24 20:48:54,940][213368] DAMAGECOUNT value on done: 176919.0 [2023-02-24 20:48:54,940][213368] Sum rewards: 34.268, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.955', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.048', 'AMMO3': '0.088', 'AMMO4': '0.238', 'WEAPON5': '0.250', 'weapon5': '0.306', 'WEAPON4': '0.450', 'WEAPON3': '0.550', 'weapon4': '0.712', 'weapon2': '0.962', 'weapon3': '1.812', 'HITCOUNT': '2.060', 'DAMAGECOUNT': '9.480', 'FRAGCOUNT': '28.000'} [2023-02-24 20:48:54,951][213382] DAMAGECOUNT value on done: 182368.0 [2023-02-24 20:48:54,952][213382] Sum rewards: 30.712, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.600', 'ARMOR': '0.004', 'AMMO2': '0.012', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'AMMO3': '0.171', 'weapon4': '0.290', 'weapon2': '0.712', 'WEAPON3': '1.000', 'HITCOUNT': '1.990', 'weapon3': '2.800', 'DAMAGECOUNT': '7.674', 'FRAGCOUNT': '27.000'} [2023-02-24 20:48:54,964][213366] DAMAGECOUNT value on done: 184287.0 [2023-02-24 20:48:54,964][213366] Sum rewards: 28.290, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.368', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.108', 'weapon4': '0.214', 'AMMO3': '0.233', 'AMMO4': '0.233', 'WEAPON5': '0.300', 'weapon2': '0.436', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '1.930', 'weapon3': '2.904', 'DAMAGECOUNT': '9.033', 'FRAGCOUNT': '33.000'} [2023-02-24 20:48:55,150][213383] DAMAGECOUNT value on done: 184158.0 [2023-02-24 20:48:55,150][213383] Sum rewards: 32.262, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.040', 'AMMO5': '0.005', 'AMMO2': '0.054', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'AMMO4': '0.269', 'WEAPON4': '0.500', 'weapon2': '0.754', 'weapon4': '0.788', 'WEAPON3': '1.150', 'weapon3': '2.116', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '9.795', 'FRAGCOUNT': '31.000'} [2023-02-24 20:48:55,232][213382] DAMAGECOUNT value on done: 176848.0 [2023-02-24 20:48:55,233][213382] Sum rewards: 34.524, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.400', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'AMMO3': '0.153', 'WEAPON4': '0.300', 'weapon4': '0.674', 'weapon2': '0.846', 'WEAPON3': '0.950', 'weapon3': '2.008', 'HITCOUNT': '2.240', 'DAMAGECOUNT': '9.123', 'FRAGCOUNT': '32.000'} [2023-02-24 20:48:55,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 119623680. Throughput: 0: 3353.9. Samples: 4898286. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 20:48:55,243][213332] Avg episode reward: [(0, '33.819')] [2023-02-24 20:48:55,247][213368] DAMAGECOUNT value on done: 183765.0 [2023-02-24 20:48:55,247][213368] Sum rewards: 26.910, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.780', 'ARMOR': '0.005', 'AMMO5': '0.009', 'AMMO2': '0.048', 'weapon5': '0.070', 'AMMO3': '0.104', 'WEAPON5': '0.150', 'AMMO4': '0.241', 'WEAPON3': '0.550', 'weapon2': '0.634', 'WEAPON4': '0.750', 'weapon3': '1.414', 'weapon4': '1.450', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '8.385', 'FRAGCOUNT': '25.000'} [2023-02-24 20:48:55,250][213369] DAMAGECOUNT value on done: 188099.0 [2023-02-24 20:48:55,251][213369] Sum rewards: 33.227, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.615', 'AMMO2': '0.015', 'AMMO5': '0.015', 'AMMO4': '0.073', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.257', 'weapon4': '0.270', 'weapon2': '0.600', 'WEAPON3': '1.650', 'HITCOUNT': '2.430', 'weapon3': '2.764', 'DAMAGECOUNT': '10.380', 'FRAGCOUNT': '33.000'} [2023-02-24 20:48:55,434][213365] Updated weights for policy 0, policy_version 29206 (0.0009) [2023-02-24 20:48:55,527][213382] DAMAGECOUNT value on done: 183624.0 [2023-02-24 20:48:55,528][213382] Sum rewards: 42.441, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.902', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON5': '0.050', 'weapon5': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.155', 'weapon4': '0.412', 'weapon2': '1.042', 'WEAPON3': '1.100', 'weapon3': '2.358', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '10.545', 'FRAGCOUNT': '37.000'} [2023-02-24 20:48:55,537][213384] DAMAGECOUNT value on done: 185434.0 [2023-02-24 20:48:55,538][213384] Sum rewards: 44.036, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.450', 'AMMO5': '0.011', 'AMMO2': '0.051', 'weapon5': '0.166', 'AMMO3': '0.245', 'AMMO4': '0.256', 'weapon4': '0.286', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.450', 'weapon3': '2.826', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.527', 'FRAGCOUNT': '41.000'} [2023-02-24 20:48:55,541][213368] DAMAGECOUNT value on done: 186150.0 [2023-02-24 20:48:55,541][213368] Sum rewards: 33.151, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.174', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.062', 'weapon5': '0.070', 'AMMO3': '0.221', 'WEAPON5': '0.300', 'AMMO4': '0.308', 'weapon4': '0.394', 'WEAPON4': '0.500', 'weapon2': '0.510', 'WEAPON3': '1.350', 'HITCOUNT': '2.450', 'weapon3': '2.646', 'DAMAGECOUNT': '9.498', 'FRAGCOUNT': '34.500'} [2023-02-24 20:48:55,542][213369] DAMAGECOUNT value on done: 183629.0 [2023-02-24 20:48:55,542][213369] Sum rewards: 35.277, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.105', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.088', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.226', 'AMMO3': '0.239', 'weapon2': '0.514', 'WEAPON3': '1.500', 'HITCOUNT': '2.460', 'weapon3': '2.950', 'DAMAGECOUNT': '10.416', 'FRAGCOUNT': '33.000'} [2023-02-24 20:48:55,743][213383] DAMAGECOUNT value on done: 182297.0 [2023-02-24 20:48:55,744][213383] Sum rewards: 23.748, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.432', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.112', 'AMMO4': '0.131', 'weapon5': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.432', 'WEAPON3': '0.650', 'weapon2': '0.816', 'HITCOUNT': '1.740', 'weapon3': '2.322', 'DAMAGECOUNT': '6.825', 'FRAGCOUNT': '20.000'} [2023-02-24 20:48:55,830][213368] DAMAGECOUNT value on done: 177618.0 [2023-02-24 20:48:55,830][213368] Sum rewards: 39.661, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.244', 'AMMO2': '0.016', 'AMMO4': '0.078', 'AMMO3': '0.146', 'weapon2': '0.936', 'WEAPON3': '1.000', 'HITCOUNT': '2.230', 'weapon3': '2.936', 'DAMAGECOUNT': '10.563', 'FRAGCOUNT': '32.000'} [2023-02-24 20:48:55,834][213384] DAMAGECOUNT value on done: 171828.0 [2023-02-24 20:48:55,834][213384] Sum rewards: 24.513, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.484', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.169', 'AMMO3': '0.192', 'WEAPON4': '0.350', 'weapon2': '0.562', 'weapon4': '0.866', 'WEAPON3': '1.200', 'HITCOUNT': '2.230', 'weapon3': '2.280', 'DAMAGECOUNT': '8.685', 'FRAGCOUNT': '26.000'} [2023-02-24 20:48:55,838][213369] DAMAGECOUNT value on done: 184366.0 [2023-02-24 20:48:55,838][213369] Sum rewards: 24.444, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.464', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.074', 'AMMO3': '0.111', 'AMMO4': '0.169', 'weapon2': '0.230', 'WEAPON4': '0.500', 'WEAPON3': '0.650', 'weapon4': '1.416', 'weapon3': '1.630', 'HITCOUNT': '1.940', 'DAMAGECOUNT': '7.593', 'FRAGCOUNT': '22.000'} [2023-02-24 20:48:56,048][213383] DAMAGECOUNT value on done: 175850.0 [2023-02-24 20:48:56,048][213383] Sum rewards: 32.452, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.207', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.170', 'AMMO4': '0.191', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.201', 'WEAPON5': '0.300', 'weapon4': '0.440', 'WEAPON4': '0.500', 'weapon2': '0.568', 'WEAPON3': '1.200', 'HITCOUNT': '2.450', 'weapon3': '2.554', 'DAMAGECOUNT': '11.187', 'FRAGCOUNT': '31.500'} [2023-02-24 20:48:56,092][213384] DAMAGECOUNT value on done: 186769.0 [2023-02-24 20:48:56,093][213384] Sum rewards: 37.156, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.512', 'AMMO5': '0.005', 'weapon5': '0.026', 'AMMO2': '0.049', 'WEAPON5': '0.100', 'AMMO3': '0.125', 'AMMO4': '0.242', 'WEAPON4': '0.450', 'WEAPON3': '0.750', 'weapon4': '0.810', 'weapon2': '0.870', 'weapon3': '2.004', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '8.358', 'FRAGCOUNT': '33.000'} [2023-02-24 20:48:56,138][213369] DAMAGECOUNT value on done: 172675.0 [2023-02-24 20:48:56,139][213369] Sum rewards: 34.356, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.092', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.047', 'AMMO3': '0.161', 'AMMO4': '0.233', 'WEAPON5': '0.250', 'weapon5': '0.310', 'weapon4': '0.412', 'WEAPON4': '0.500', 'weapon2': '0.698', 'WEAPON3': '1.000', 'weapon3': '2.292', 'HITCOUNT': '2.340', 'DAMAGECOUNT': '10.191', 'FRAGCOUNT': '33.000'} [2023-02-24 20:48:56,384][213384] DAMAGECOUNT value on done: 187537.0 [2023-02-24 20:48:56,384][213384] Sum rewards: 41.206, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.279', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.110', 'AMMO4': '0.113', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.204', 'weapon2': '0.322', 'WEAPON3': '0.900', 'HITCOUNT': '2.590', 'weapon3': '3.194', 'DAMAGECOUNT': '11.574', 'FRAGCOUNT': '32.500'} [2023-02-24 20:48:58,464][213365] Updated weights for policy 0, policy_version 29216 (0.0009) [2023-02-24 20:49:00,243][213332] Fps is (10 sec: 13107.1, 60 sec: 13380.2, 300 sec: 13384.9). Total num frames: 119689216. Throughput: 0: 3358.2. Samples: 4918474. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 20:49:00,244][213332] Avg episode reward: [(0, '33.441')] [2023-02-24 20:49:01,463][213365] Updated weights for policy 0, policy_version 29226 (0.0009) [2023-02-24 20:49:04,538][213365] Updated weights for policy 0, policy_version 29236 (0.0009) [2023-02-24 20:49:05,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 119758848. Throughput: 0: 3359.7. Samples: 4928736. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 20:49:05,243][213332] Avg episode reward: [(0, '33.441')] [2023-02-24 20:49:07,522][213365] Updated weights for policy 0, policy_version 29246 (0.0009) [2023-02-24 20:49:10,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 119824384. Throughput: 0: 3358.0. Samples: 4948904. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 20:49:10,243][213332] Avg episode reward: [(0, '33.441')] [2023-02-24 20:49:10,597][213365] Updated weights for policy 0, policy_version 29256 (0.0009) [2023-02-24 20:49:12,955][213383] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 20:49:13,232][213367] DAMAGECOUNT value on done: 184057.0 [2023-02-24 20:49:13,233][213367] Sum rewards: 35.843, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'weapon5': '0.130', 'AMMO3': '0.162', 'AMMO4': '0.162', 'WEAPON4': '0.200', 'HEALTH': '0.397', 'weapon2': '0.458', 'weapon4': '0.640', 'WEAPON3': '0.900', 'HITCOUNT': '2.460', 'weapon3': '2.620', 'DAMAGECOUNT': '10.575', 'FRAGCOUNT': '29.000'} [2023-02-24 20:49:13,555][213367] DAMAGECOUNT value on done: 185359.0 [2023-02-24 20:49:13,555][213367] Sum rewards: 42.040, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.640', 'AMMO5': '0.013', 'AMMO2': '0.018', 'AMMO4': '0.092', 'AMMO3': '0.140', 'weapon5': '0.236', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON4': '0.300', 'weapon4': '0.710', 'WEAPON3': '0.800', 'HITCOUNT': '2.200', 'weapon3': '2.532', 'DAMAGECOUNT': '11.355', 'FRAGCOUNT': '35.000'} [2023-02-24 20:49:13,654][213365] Updated weights for policy 0, policy_version 29266 (0.0009) [2023-02-24 20:49:13,765][213372] DAMAGECOUNT value on done: 185717.0 [2023-02-24 20:49:13,765][213372] Sum rewards: 31.327, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.005', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.074', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'weapon5': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'weapon2': '0.276', 'WEAPON3': '1.350', 'HITCOUNT': '2.410', 'weapon3': '3.248', 'DAMAGECOUNT': '10.548', 'FRAGCOUNT': '31.000'} [2023-02-24 20:49:13,977][213367] DAMAGECOUNT value on done: 188589.0 [2023-02-24 20:49:13,977][213367] Sum rewards: 38.158, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.095', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'weapon5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.592', 'WEAPON3': '0.800', 'weapon2': '0.872', 'weapon3': '2.134', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '10.284', 'FRAGCOUNT': '32.000'} [2023-02-24 20:49:14,036][213366] DAMAGECOUNT value on done: 181034.0 [2023-02-24 20:49:14,037][213366] Sum rewards: 38.486, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.830', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.024', 'AMMO4': '0.049', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.392', 'weapon2': '0.744', 'WEAPON3': '1.100', 'weapon3': '2.462', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '9.810', 'FRAGCOUNT': '33.000'} [2023-02-24 20:49:14,093][213372] DAMAGECOUNT value on done: 189632.0 [2023-02-24 20:49:14,094][213372] Sum rewards: 27.303, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.410', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon5': '0.158', 'AMMO3': '0.181', 'AMMO4': '0.208', 'WEAPON5': '0.300', 'weapon2': '0.462', 'WEAPON4': '0.550', 'weapon4': '0.756', 'WEAPON3': '1.200', 'weapon3': '2.336', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '10.119', 'FRAGCOUNT': '27.000'} [2023-02-24 20:49:14,302][213367] DAMAGECOUNT value on done: 184110.0 [2023-02-24 20:49:14,303][213367] Sum rewards: 31.427, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.330', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'AMMO3': '0.196', 'weapon2': '0.340', 'WEAPON4': '0.400', 'weapon4': '0.838', 'WEAPON3': '1.150', 'HITCOUNT': '2.290', 'weapon3': '2.486', 'DAMAGECOUNT': '8.925', 'FRAGCOUNT': '31.000'} [2023-02-24 20:49:14,351][213366] DAMAGECOUNT value on done: 192309.0 [2023-02-24 20:49:14,352][213366] Sum rewards: 31.391, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.620', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.144', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.412', 'weapon4': '0.468', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '2.410', 'weapon3': '2.738', 'DAMAGECOUNT': '9.723', 'FRAGCOUNT': '31.000'} [2023-02-24 20:49:14,415][213372] DAMAGECOUNT value on done: 184898.0 [2023-02-24 20:49:14,415][213372] Sum rewards: 37.001, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.051', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.160', 'AMMO4': '0.213', 'weapon2': '0.214', 'AMMO3': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.598', 'WEAPON3': '1.450', 'weapon3': '2.730', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '11.466', 'FRAGCOUNT': '36.000'} [2023-02-24 20:49:14,522][213366] DAMAGECOUNT value on done: 188729.0 [2023-02-24 20:49:14,523][213366] Sum rewards: 28.753, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.474', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.116', 'weapon4': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.804', 'WEAPON3': '1.250', 'HITCOUNT': '2.180', 'weapon3': '2.694', 'DAMAGECOUNT': '8.820', 'FRAGCOUNT': '27.000'} [2023-02-24 20:49:14,573][213382] DAMAGECOUNT value on done: 179459.0 [2023-02-24 20:49:14,573][213382] Sum rewards: 35.240, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.350', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.136', 'AMMO3': '0.164', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon4': '0.510', 'weapon2': '0.544', 'WEAPON3': '1.000', 'HITCOUNT': '2.250', 'weapon3': '2.602', 'DAMAGECOUNT': '9.090', 'FRAGCOUNT': '32.000'} [2023-02-24 20:49:14,720][213372] DAMAGECOUNT value on done: 181048.0 [2023-02-24 20:49:14,721][213372] Sum rewards: 35.497, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.045', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.158', 'AMMO3': '0.228', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.390', 'weapon4': '0.458', 'WEAPON3': '1.400', 'HITCOUNT': '2.540', 'weapon3': '2.724', 'DAMAGECOUNT': '10.815', 'FRAGCOUNT': '34.000'} [2023-02-24 20:49:14,789][213383] DAMAGECOUNT value on done: 184759.0 [2023-02-24 20:49:14,790][213383] Sum rewards: 33.410, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.342', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.065', 'weapon5': '0.090', 'AMMO3': '0.179', 'AMMO4': '0.323', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.546', 'weapon2': '0.608', 'WEAPON3': '1.100', 'HITCOUNT': '2.190', 'weapon3': '2.444', 'DAMAGECOUNT': '9.537', 'FRAGCOUNT': '32.000'} [2023-02-24 20:49:14,831][213366] DAMAGECOUNT value on done: 187004.0 [2023-02-24 20:49:14,831][213366] Sum rewards: 28.156, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.182', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.033', 'AMMO3': '0.159', 'AMMO4': '0.163', 'weapon5': '0.186', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.718', 'weapon2': '0.726', 'WEAPON3': '0.950', 'weapon3': '1.954', 'HITCOUNT': '2.030', 'DAMAGECOUNT': '8.106', 'FRAGCOUNT': '26.000'} [2023-02-24 20:49:14,873][213382] DAMAGECOUNT value on done: 185658.0 [2023-02-24 20:49:14,874][213382] Sum rewards: 35.813, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.165', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.037', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.126', 'weapon4': '0.138', 'AMMO3': '0.177', 'weapon2': '0.914', 'WEAPON3': '1.100', 'HITCOUNT': '2.090', 'weapon3': '2.666', 'DAMAGECOUNT': '9.870', 'FRAGCOUNT': '31.000'} [2023-02-24 20:49:14,912][213368] DAMAGECOUNT value on done: 179329.0 [2023-02-24 20:49:14,912][213368] Sum rewards: 24.065, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.540', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.058', 'WEAPON5': '0.100', 'weapon5': '0.122', 'AMMO3': '0.180', 'weapon2': '0.238', 'AMMO4': '0.288', 'WEAPON4': '0.650', 'WEAPON3': '1.000', 'weapon4': '1.486', 'HITCOUNT': '1.590', 'weapon3': '1.654', 'DAMAGECOUNT': '7.230', 'FRAGCOUNT': '24.500'} [2023-02-24 20:49:15,088][213383] DAMAGECOUNT value on done: 187166.0 [2023-02-24 20:49:15,089][213383] Sum rewards: 28.552, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.244', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'weapon4': '0.292', 'weapon2': '0.382', 'WEAPON3': '1.100', 'HITCOUNT': '2.000', 'weapon3': '3.064', 'DAMAGECOUNT': '8.844', 'FRAGCOUNT': '27.000'} [2023-02-24 20:49:15,140][213382] DAMAGECOUNT value on done: 179641.0 [2023-02-24 20:49:15,141][213382] Sum rewards: 30.174, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.310', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.092', 'AMMO3': '0.145', 'WEAPON5': '0.150', 'AMMO4': '0.184', 'WEAPON4': '0.350', 'weapon4': '0.366', 'WEAPON3': '0.800', 'weapon2': '1.016', 'HITCOUNT': '2.150', 'weapon3': '2.306', 'DAMAGECOUNT': '8.379', 'FRAGCOUNT': '28.000'} [2023-02-24 20:49:15,204][213369] DAMAGECOUNT value on done: 191303.0 [2023-02-24 20:49:15,204][213369] Sum rewards: 37.114, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.155', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'WEAPON4': '0.300', 'weapon2': '0.342', 'weapon4': '0.692', 'WEAPON3': '1.150', 'HITCOUNT': '2.440', 'weapon3': '2.626', 'DAMAGECOUNT': '9.612', 'FRAGCOUNT': '35.000'} [2023-02-24 20:49:15,215][213368] DAMAGECOUNT value on done: 187136.0 [2023-02-24 20:49:15,215][213368] Sum rewards: 34.125, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.246', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.053', 'AMMO3': '0.200', 'weapon5': '0.202', 'AMMO4': '0.265', 'WEAPON5': '0.350', 'weapon2': '0.476', 'WEAPON4': '0.600', 'weapon4': '0.872', 'WEAPON3': '1.150', 'HITCOUNT': '2.130', 'weapon3': '2.186', 'DAMAGECOUNT': '10.113', 'FRAGCOUNT': '32.000'} [2023-02-24 20:49:15,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 119894016. Throughput: 0: 3357.8. Samples: 4968904. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 20:49:15,243][213332] Avg episode reward: [(0, '33.240')] [2023-02-24 20:49:15,445][213382] DAMAGECOUNT value on done: 187212.0 [2023-02-24 20:49:15,446][213382] Sum rewards: 35.986, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.735', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.062', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'AMMO3': '0.178', 'weapon2': '0.196', 'WEAPON4': '0.250', 'weapon4': '0.574', 'WEAPON3': '1.100', 'HITCOUNT': '2.320', 'weapon3': '2.870', 'DAMAGECOUNT': '10.719', 'FRAGCOUNT': '32.000'} [2023-02-24 20:49:15,499][213369] DAMAGECOUNT value on done: 186347.0 [2023-02-24 20:49:15,500][213369] Sum rewards: 31.041, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.422', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.040', 'AMMO3': '0.163', 'AMMO4': '0.202', 'weapon5': '0.206', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.432', 'weapon2': '0.512', 'WEAPON3': '1.000', 'HITCOUNT': '1.880', 'weapon3': '2.600', 'DAMAGECOUNT': '8.154', 'FRAGCOUNT': '30.000'} [2023-02-24 20:49:15,507][213368] DAMAGECOUNT value on done: 189492.0 [2023-02-24 20:49:15,507][213368] Sum rewards: 35.310, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.260', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon4': '0.086', 'WEAPON4': '0.100', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'weapon2': '0.610', 'WEAPON3': '1.400', 'HITCOUNT': '2.350', 'weapon3': '2.948', 'DAMAGECOUNT': '10.026', 'FRAGCOUNT': '33.000'} [2023-02-24 20:49:15,523][213384] DAMAGECOUNT value on done: 188659.0 [2023-02-24 20:49:15,523][213384] Sum rewards: 34.410, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.180', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.098', 'AMMO3': '0.123', 'AMMO4': '0.186', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon2': '0.650', 'WEAPON3': '0.700', 'weapon4': '0.892', 'weapon3': '1.978', 'HITCOUNT': '2.240', 'DAMAGECOUNT': '9.675', 'FRAGCOUNT': '31.000'} [2023-02-24 20:49:15,688][213383] DAMAGECOUNT value on done: 185362.0 [2023-02-24 20:49:15,689][213383] Sum rewards: 31.807, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.950', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.178', 'AMMO3': '0.187', 'WEAPON4': '0.350', 'weapon4': '0.470', 'weapon2': '0.546', 'WEAPON3': '1.100', 'HITCOUNT': '2.230', 'weapon3': '2.696', 'DAMAGECOUNT': '9.195', 'FRAGCOUNT': '30.000'} [2023-02-24 20:49:15,797][213369] DAMAGECOUNT value on done: 187798.0 [2023-02-24 20:49:15,797][213369] Sum rewards: 40.096, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.545', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.108', 'AMMO3': '0.143', 'WEAPON5': '0.150', 'weapon2': '0.194', 'WEAPON4': '0.350', 'weapon4': '0.526', 'WEAPON3': '1.000', 'HITCOUNT': '2.320', 'weapon3': '2.928', 'DAMAGECOUNT': '10.296', 'FRAGCOUNT': '35.000'} [2023-02-24 20:49:15,806][213368] DAMAGECOUNT value on done: 180976.0 [2023-02-24 20:49:15,807][213368] Sum rewards: 37.938, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.470', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO4': '0.167', 'AMMO3': '0.176', 'WEAPON5': '0.350', 'weapon5': '0.354', 'weapon2': '0.376', 'WEAPON4': '0.450', 'weapon4': '0.488', 'WEAPON3': '1.150', 'HITCOUNT': '2.040', 'weapon3': '2.480', 'DAMAGECOUNT': '10.074', 'FRAGCOUNT': '35.000'} [2023-02-24 20:49:15,831][213384] DAMAGECOUNT value on done: 175264.0 [2023-02-24 20:49:15,831][213384] Sum rewards: 34.639, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.347', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.048', 'AMMO3': '0.147', 'AMMO4': '0.239', 'weapon5': '0.280', 'weapon2': '0.296', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.618', 'WEAPON3': '0.850', 'HITCOUNT': '2.360', 'weapon3': '2.460', 'DAMAGECOUNT': '10.308', 'FRAGCOUNT': '31.000'} [2023-02-24 20:49:15,988][213383] DAMAGECOUNT value on done: 179215.0 [2023-02-24 20:49:15,989][213383] Sum rewards: 34.058, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.908', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.048', 'AMMO3': '0.170', 'AMMO4': '0.239', 'weapon5': '0.268', 'weapon4': '0.414', 'WEAPON5': '0.450', 'weapon2': '0.468', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'HITCOUNT': '2.100', 'weapon3': '2.508', 'DAMAGECOUNT': '9.675', 'FRAGCOUNT': '33.000'} [2023-02-24 20:49:16,077][213384] DAMAGECOUNT value on done: 189819.0 [2023-02-24 20:49:16,077][213384] Sum rewards: 33.633, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.100', 'AMMO5': '0.006', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.099', 'WEAPON5': '0.150', 'weapon5': '0.178', 'WEAPON4': '0.250', 'weapon4': '0.654', 'WEAPON3': '0.700', 'weapon2': '1.028', 'weapon3': '1.848', 'HITCOUNT': '2.120', 'DAMAGECOUNT': '9.105', 'FRAGCOUNT': '26.000'} [2023-02-24 20:49:16,097][213369] DAMAGECOUNT value on done: 175699.0 [2023-02-24 20:49:16,098][213369] Sum rewards: 31.412, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.400', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.078', 'AMMO4': '0.082', 'AMMO3': '0.177', 'WEAPON4': '0.300', 'weapon4': '0.480', 'weapon2': '0.694', 'WEAPON3': '1.150', 'HITCOUNT': '2.170', 'weapon3': '2.540', 'DAMAGECOUNT': '9.072', 'FRAGCOUNT': '29.000'} [2023-02-24 20:49:16,366][213384] DAMAGECOUNT value on done: 190732.0 [2023-02-24 20:49:16,367][213384] Sum rewards: 33.085, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.697', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.037', 'weapon5': '0.064', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon4': '0.300', 'weapon2': '0.470', 'WEAPON3': '1.350', 'HITCOUNT': '2.170', 'weapon3': '2.974', 'DAMAGECOUNT': '9.585', 'FRAGCOUNT': '31.000'} [2023-02-24 20:49:16,685][213365] Updated weights for policy 0, policy_version 29276 (0.0009) [2023-02-24 20:49:19,766][213365] Updated weights for policy 0, policy_version 29286 (0.0009) [2023-02-24 20:49:20,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13384.9). Total num frames: 119959552. Throughput: 0: 3358.6. Samples: 4979192. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 20:49:20,243][213332] Avg episode reward: [(0, '33.659')] [2023-02-24 20:49:22,765][213365] Updated weights for policy 0, policy_version 29296 (0.0009) [2023-02-24 20:49:25,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 120029184. Throughput: 0: 3364.5. Samples: 4999428. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 20:49:25,243][213332] Avg episode reward: [(0, '33.659')] [2023-02-24 20:49:25,804][213365] Updated weights for policy 0, policy_version 29306 (0.0009) [2023-02-24 20:49:28,854][213365] Updated weights for policy 0, policy_version 29316 (0.0009) [2023-02-24 20:49:30,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 120094720. Throughput: 0: 3365.9. Samples: 5019574. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 20:49:30,243][213332] Avg episode reward: [(0, '33.659')] [2023-02-24 20:49:31,862][213365] Updated weights for policy 0, policy_version 29326 (0.0009) [2023-02-24 20:49:33,203][213367] DAMAGECOUNT value on done: 187320.0 [2023-02-24 20:49:33,204][213367] Sum rewards: 33.303, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.780', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO3': '0.156', 'AMMO4': '0.161', 'weapon5': '0.194', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.534', 'weapon2': '0.796', 'WEAPON3': '1.050', 'weapon3': '2.188', 'HITCOUNT': '2.270', 'DAMAGECOUNT': '9.789', 'FRAGCOUNT': '31.000'} [2023-02-24 20:49:33,527][213367] DAMAGECOUNT value on done: 188295.0 [2023-02-24 20:49:33,527][213367] Sum rewards: 28.242, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.690', 'AMMO5': '0.015', 'AMMO2': '0.044', 'AMMO3': '0.171', 'AMMO4': '0.218', 'weapon5': '0.232', 'WEAPON5': '0.350', 'ARMOR': '0.464', 'WEAPON4': '0.500', 'weapon4': '0.548', 'weapon2': '0.860', 'WEAPON3': '1.050', 'HITCOUNT': '1.920', 'weapon3': '2.002', 'DAMAGECOUNT': '8.808', 'FRAGCOUNT': '28.000'} [2023-02-24 20:49:33,700][213372] DAMAGECOUNT value on done: 189077.0 [2023-02-24 20:49:33,700][213372] Sum rewards: 35.441, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.330', 'AMMO5': '0.016', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon5': '0.166', 'AMMO3': '0.172', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.744', 'WEAPON3': '1.050', 'HITCOUNT': '2.330', 'weapon3': '2.456', 'DAMAGECOUNT': '10.080', 'FRAGCOUNT': '33.000'} [2023-02-24 20:49:33,931][213367] DAMAGECOUNT value on done: 192087.0 [2023-02-24 20:49:33,931][213367] Sum rewards: 37.872, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.782', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'weapon5': '0.162', 'AMMO3': '0.190', 'WEAPON5': '0.250', 'weapon2': '0.290', 'weapon4': '0.622', 'WEAPON3': '1.150', 'HITCOUNT': '2.370', 'weapon3': '2.598', 'DAMAGECOUNT': '10.494', 'FRAGCOUNT': '33.000'} [2023-02-24 20:49:34,008][213366] DAMAGECOUNT value on done: 183835.0 [2023-02-24 20:49:34,008][213366] Sum rewards: 26.366, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.845', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.054', 'AMMO3': '0.147', 'weapon5': '0.252', 'AMMO4': '0.272', 'weapon2': '0.446', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '0.850', 'weapon3': '1.288', 'weapon4': '1.436', 'HITCOUNT': '2.290', 'DAMAGECOUNT': '8.403', 'FRAGCOUNT': '23.000'} [2023-02-24 20:49:34,023][213372] DAMAGECOUNT value on done: 193101.0 [2023-02-24 20:49:34,024][213372] Sum rewards: 35.517, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.894', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.041', 'AMMO3': '0.152', 'weapon4': '0.202', 'AMMO4': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon5': '0.366', 'weapon2': '0.634', 'WEAPON3': '0.950', 'HITCOUNT': '2.140', 'weapon3': '2.438', 'DAMAGECOUNT': '10.365', 'FRAGCOUNT': '31.000'} [2023-02-24 20:49:34,255][213367] DAMAGECOUNT value on done: 187216.0 [2023-02-24 20:49:34,255][213367] Sum rewards: 30.262, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.630', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO3': '0.161', 'AMMO4': '0.163', 'weapon2': '0.224', 'weapon5': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.964', 'WEAPON3': '1.000', 'weapon3': '2.188', 'HITCOUNT': '2.360', 'DAMAGECOUNT': '9.318', 'FRAGCOUNT': '26.000'} [2023-02-24 20:49:34,328][213366] DAMAGECOUNT value on done: 195551.0 [2023-02-24 20:49:34,330][213366] Sum rewards: 35.381, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.570', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.033', 'AMMO3': '0.118', 'AMMO4': '0.163', 'weapon5': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.364', 'weapon2': '0.736', 'WEAPON3': '0.800', 'HITCOUNT': '1.950', 'weapon3': '2.458', 'DAMAGECOUNT': '9.726', 'FRAGCOUNT': '28.000'} [2023-02-24 20:49:34,343][213372] DAMAGECOUNT value on done: 187589.0 [2023-02-24 20:49:34,344][213372] Sum rewards: 24.358, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.738', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.162', 'weapon5': '0.220', 'AMMO4': '0.226', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON4': '0.550', 'WEAPON3': '1.000', 'weapon4': '1.038', 'weapon3': '1.650', 'HITCOUNT': '1.870', 'DAMAGECOUNT': '8.073', 'FRAGCOUNT': '24.000'} [2023-02-24 20:49:34,525][213366] DAMAGECOUNT value on done: 191652.0 [2023-02-24 20:49:34,526][213366] Sum rewards: 31.270, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.633', 'AMMO5': '0.012', 'AMMO2': '0.059', 'AMMO3': '0.129', 'weapon5': '0.186', 'AMMO4': '0.297', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'ARMOR': '0.456', 'weapon4': '0.500', 'weapon2': '0.672', 'WEAPON3': '0.800', 'weapon3': '2.122', 'HITCOUNT': '2.150', 'DAMAGECOUNT': '8.769', 'FRAGCOUNT': '28.000'} [2023-02-24 20:49:34,554][213382] DAMAGECOUNT value on done: 183170.0 [2023-02-24 20:49:34,554][213382] Sum rewards: 37.576, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.702', 'AMMO5': '0.018', 'AMMO2': '0.025', 'weapon4': '0.026', 'AMMO4': '0.125', 'weapon5': '0.126', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon2': '0.202', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.230', 'weapon3': '3.312', 'DAMAGECOUNT': '11.133', 'FRAGCOUNT': '32.000'} [2023-02-24 20:49:34,670][213372] DAMAGECOUNT value on done: 182393.0 [2023-02-24 20:49:34,670][213372] Sum rewards: 12.743, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.760', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.066', 'AMMO3': '0.079', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.344', 'ARMOR': '0.500', 'weapon2': '0.518', 'WEAPON3': '0.550', 'HITCOUNT': '1.000', 'weapon3': '1.596', 'DAMAGECOUNT': '4.035', 'FRAGCOUNT': '11.000'} [2023-02-24 20:49:34,801][213383] DAMAGECOUNT value on done: 188356.0 [2023-02-24 20:49:34,801][213383] Sum rewards: 34.024, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.928', 'AMMO2': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.050', 'weapon5': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'weapon4': '0.260', 'weapon2': '0.696', 'WEAPON3': '1.100', 'HITCOUNT': '2.430', 'weapon3': '2.622', 'DAMAGECOUNT': '10.791', 'FRAGCOUNT': '29.000'} [2023-02-24 20:49:34,843][213368] DAMAGECOUNT value on done: 182765.0 [2023-02-24 20:49:34,844][213368] Sum rewards: 43.918, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.260', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO3': '0.127', 'AMMO4': '0.143', 'weapon5': '0.172', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.550', 'WEAPON3': '0.750', 'weapon4': '0.972', 'weapon3': '1.986', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '10.308', 'FRAGCOUNT': '35.000'} [2023-02-24 20:49:34,855][213366] DAMAGECOUNT value on done: 190456.0 [2023-02-24 20:49:34,856][213366] Sum rewards: 38.775, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.206', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.033', 'AMMO3': '0.119', 'weapon5': '0.142', 'AMMO4': '0.165', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.700', 'weapon4': '0.700', 'weapon2': '0.726', 'weapon3': '2.126', 'HITCOUNT': '2.400', 'DAMAGECOUNT': '10.356', 'FRAGCOUNT': '30.000'} [2023-02-24 20:49:34,873][213382] DAMAGECOUNT value on done: 188350.0 [2023-02-24 20:49:34,873][213382] Sum rewards: 28.414, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.185', 'AMMO5': '0.005', 'AMMO2': '0.038', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO3': '0.173', 'AMMO4': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.472', 'weapon2': '0.650', 'WEAPON3': '1.100', 'HITCOUNT': '1.970', 'weapon3': '2.522', 'DAMAGECOUNT': '8.076', 'FRAGCOUNT': '26.000'} [2023-02-24 20:49:35,004][213365] Updated weights for policy 0, policy_version 29336 (0.0009) [2023-02-24 20:49:35,106][213383] DAMAGECOUNT value on done: 190466.0 [2023-02-24 20:49:35,107][213383] Sum rewards: 36.012, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.622', 'AMMO2': '0.004', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.017', 'weapon5': '0.066', 'weapon7': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.270', 'weapon4': '0.790', 'WEAPON3': '1.050', 'HITCOUNT': '2.230', 'weapon3': '2.520', 'DAMAGECOUNT': '9.600', 'FRAGCOUNT': '31.500'} [2023-02-24 20:49:35,149][213368] DAMAGECOUNT value on done: 190348.0 [2023-02-24 20:49:35,150][213368] Sum rewards: 36.897, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.373', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.062', 'AMMO3': '0.118', 'weapon5': '0.174', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.430', 'weapon2': '0.846', 'WEAPON3': '0.850', 'HITCOUNT': '2.230', 'weapon3': '2.296', 'DAMAGECOUNT': '9.636', 'FRAGCOUNT': '31.000'} [2023-02-24 20:49:35,150][213382] DAMAGECOUNT value on done: 183329.0 [2023-02-24 20:49:35,150][213382] Sum rewards: 31.434, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.010', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.059', 'AMMO3': '0.145', 'AMMO4': '0.295', 'weapon5': '0.330', 'WEAPON5': '0.400', 'weapon2': '0.480', 'weapon4': '0.588', 'WEAPON4': '0.700', 'WEAPON3': '0.900', 'weapon3': '2.274', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '11.064', 'FRAGCOUNT': '29.000'} [2023-02-24 20:49:35,213][213369] DAMAGECOUNT value on done: 193733.0 [2023-02-24 20:49:35,213][213369] Sum rewards: 27.848, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.074', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.043', 'AMMO3': '0.131', 'weapon5': '0.146', 'WEAPON5': '0.200', 'AMMO4': '0.213', 'WEAPON4': '0.450', 'weapon4': '0.748', 'WEAPON3': '0.750', 'weapon2': '0.870', 'weapon3': '1.718', 'HITCOUNT': '2.100', 'DAMAGECOUNT': '7.290', 'FRAGCOUNT': '24.000'} [2023-02-24 20:49:35,243][213332] Fps is (10 sec: 13107.2, 60 sec: 13448.6, 300 sec: 13384.9). Total num frames: 120160256. Throughput: 0: 3367.2. Samples: 5029758. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 20:49:35,243][213332] Avg episode reward: [(0, '33.309')] [2023-02-24 20:49:35,439][213368] DAMAGECOUNT value on done: 192622.0 [2023-02-24 20:49:35,440][213368] Sum rewards: 29.401, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.141', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.052', 'AMMO3': '0.159', 'weapon5': '0.166', 'WEAPON5': '0.250', 'AMMO4': '0.259', 'WEAPON4': '0.450', 'weapon4': '0.574', 'weapon2': '0.694', 'WEAPON3': '1.000', 'HITCOUNT': '2.210', 'weapon3': '2.324', 'DAMAGECOUNT': '9.390', 'FRAGCOUNT': '26.000'} [2023-02-24 20:49:35,446][213382] DAMAGECOUNT value on done: 190783.0 [2023-02-24 20:49:35,446][213382] Sum rewards: 28.070, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.056', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.035', 'AMMO4': '0.177', 'AMMO3': '0.190', 'weapon5': '0.210', 'weapon2': '0.264', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon4': '1.202', 'weapon3': '2.046', 'HITCOUNT': '2.150', 'DAMAGECOUNT': '10.428', 'FRAGCOUNT': '26.500'} [2023-02-24 20:49:35,511][213369] DAMAGECOUNT value on done: 188694.0 [2023-02-24 20:49:35,512][213369] Sum rewards: 27.042, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.480', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.019', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'WEAPON4': '0.150', 'weapon4': '0.480', 'WEAPON3': '0.750', 'weapon2': '0.782', 'HITCOUNT': '1.900', 'weapon3': '2.334', 'DAMAGECOUNT': '7.041', 'FRAGCOUNT': '23.000'} [2023-02-24 20:49:35,515][213384] DAMAGECOUNT value on done: 191488.0 [2023-02-24 20:49:35,516][213384] Sum rewards: 30.860, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.126', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.038', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'AMMO4': '0.189', 'WEAPON4': '0.350', 'weapon2': '0.520', 'weapon4': '0.642', 'WEAPON3': '0.950', 'HITCOUNT': '2.010', 'weapon3': '2.408', 'DAMAGECOUNT': '8.487', 'FRAGCOUNT': '28.000'} [2023-02-24 20:49:35,696][213383] DAMAGECOUNT value on done: 188233.0 [2023-02-24 20:49:35,696][213383] Sum rewards: 23.031, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.031', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.068', 'AMMO3': '0.102', 'weapon5': '0.190', 'AMMO4': '0.341', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'WEAPON4': '0.800', 'weapon2': '0.960', 'weapon3': '1.270', 'weapon4': '1.402', 'HITCOUNT': '1.850', 'DAMAGECOUNT': '8.613', 'FRAGCOUNT': '19.000'} [2023-02-24 20:49:35,739][213368] DAMAGECOUNT value on done: 184817.0 [2023-02-24 20:49:35,740][213368] Sum rewards: 43.101, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.968', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.074', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.202', 'weapon2': '0.854', 'WEAPON3': '1.000', 'weapon3': '2.628', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '11.523', 'FRAGCOUNT': '35.000'} [2023-02-24 20:49:35,818][213369] DAMAGECOUNT value on done: 191019.0 [2023-02-24 20:49:35,819][213369] Sum rewards: 31.230, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.836', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.194', 'AMMO3': '0.204', 'weapon4': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.596', 'WEAPON3': '1.250', 'HITCOUNT': '2.000', 'weapon3': '2.686', 'DAMAGECOUNT': '9.663', 'FRAGCOUNT': '30.000'} [2023-02-24 20:49:35,819][213384] DAMAGECOUNT value on done: 178605.0 [2023-02-24 20:49:35,819][213384] Sum rewards: 35.431, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.145', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.038', 'AMMO3': '0.170', 'AMMO4': '0.192', 'WEAPON4': '0.350', 'weapon5': '0.374', 'WEAPON5': '0.400', 'weapon2': '0.482', 'weapon4': '0.784', 'WEAPON3': '0.950', 'weapon3': '1.982', 'HITCOUNT': '2.310', 'DAMAGECOUNT': '10.023', 'FRAGCOUNT': '31.000'} [2023-02-24 20:49:35,989][213383] DAMAGECOUNT value on done: 182378.0 [2023-02-24 20:49:35,989][213383] Sum rewards: 30.975, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.060', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO3': '0.168', 'AMMO4': '0.227', 'weapon5': '0.262', 'weapon2': '0.390', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.526', 'WEAPON3': '1.050', 'HITCOUNT': '2.200', 'weapon3': '2.508', 'DAMAGECOUNT': '9.489', 'FRAGCOUNT': '29.500'} [2023-02-24 20:49:36,072][213384] DAMAGECOUNT value on done: 192649.0 [2023-02-24 20:49:36,072][213384] Sum rewards: 32.439, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.090', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.037', 'AMMO3': '0.149', 'weapon5': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.280', 'weapon2': '0.944', 'WEAPON3': '0.950', 'HITCOUNT': '2.110', 'weapon3': '2.168', 'DAMAGECOUNT': '8.490', 'FRAGCOUNT': '30.000'} [2023-02-24 20:49:36,118][213369] DAMAGECOUNT value on done: 178759.0 [2023-02-24 20:49:36,118][213369] Sum rewards: 30.313, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.730', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'weapon2': '0.512', 'weapon4': '0.526', 'WEAPON3': '1.250', 'HITCOUNT': '2.220', 'weapon3': '2.746', 'DAMAGECOUNT': '9.180', 'FRAGCOUNT': '28.000'} [2023-02-24 20:49:36,370][213384] DAMAGECOUNT value on done: 193085.0 [2023-02-24 20:49:36,371][213384] Sum rewards: 21.700, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.540', 'AMMO5': '0.016', 'AMMO2': '0.053', 'AMMO3': '0.165', 'weapon5': '0.246', 'AMMO4': '0.263', 'WEAPON5': '0.350', 'ARMOR': '0.500', 'weapon2': '0.502', 'WEAPON4': '0.600', 'weapon4': '0.652', 'WEAPON3': '0.950', 'HITCOUNT': '1.740', 'weapon3': '2.144', 'DAMAGECOUNT': '7.059', 'FRAGCOUNT': '21.500'} [2023-02-24 20:49:38,033][213365] Updated weights for policy 0, policy_version 29346 (0.0009) [2023-02-24 20:49:40,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 120229888. Throughput: 0: 3366.0. Samples: 5049756. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 20:49:40,243][213332] Avg episode reward: [(0, '32.963')] [2023-02-24 20:49:41,062][213365] Updated weights for policy 0, policy_version 29356 (0.0009) [2023-02-24 20:49:44,165][213365] Updated weights for policy 0, policy_version 29366 (0.0009) [2023-02-24 20:49:45,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13398.8). Total num frames: 120295424. Throughput: 0: 3362.7. Samples: 5069796. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 20:49:45,243][213332] Avg episode reward: [(0, '32.963')] [2023-02-24 20:49:47,198][213365] Updated weights for policy 0, policy_version 29376 (0.0009) [2023-02-24 20:49:50,243][213332] Fps is (10 sec: 13107.0, 60 sec: 13380.2, 300 sec: 13398.8). Total num frames: 120360960. Throughput: 0: 3359.8. Samples: 5079926. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:49:50,244][213332] Avg episode reward: [(0, '32.963')] [2023-02-24 20:49:50,289][213365] Updated weights for policy 0, policy_version 29386 (0.0009) [2023-02-24 20:49:53,233][213367] DAMAGECOUNT value on done: 190279.0 [2023-02-24 20:49:53,233][213367] Sum rewards: 28.816, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.991', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.138', 'AMMO3': '0.184', 'AMMO4': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.512', 'weapon4': '0.858', 'WEAPON3': '1.150', 'HITCOUNT': '2.160', 'weapon3': '2.200', 'DAMAGECOUNT': '8.877', 'FRAGCOUNT': '28.000'} [2023-02-24 20:49:53,326][213365] Updated weights for policy 0, policy_version 29396 (0.0009) [2023-02-24 20:49:53,548][213367] DAMAGECOUNT value on done: 191707.0 [2023-02-24 20:49:53,549][213367] Sum rewards: 34.237, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.561', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.062', 'AMMO3': '0.146', 'weapon5': '0.216', 'weapon2': '0.246', 'AMMO4': '0.309', 'WEAPON5': '0.400', 'weapon4': '0.552', 'WEAPON4': '0.600', 'WEAPON3': '0.850', 'HITCOUNT': '1.960', 'weapon3': '2.706', 'DAMAGECOUNT': '10.236', 'FRAGCOUNT': '31.000'} [2023-02-24 20:49:53,788][213372] DAMAGECOUNT value on done: 192221.0 [2023-02-24 20:49:53,788][213372] Sum rewards: 28.995, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.112', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.060', 'weapon5': '0.126', 'AMMO3': '0.199', 'AMMO4': '0.298', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON4': '0.650', 'weapon4': '1.066', 'WEAPON3': '1.200', 'weapon3': '1.914', 'HITCOUNT': '2.220', 'DAMAGECOUNT': '9.432', 'FRAGCOUNT': '30.000'} [2023-02-24 20:49:53,958][213367] DAMAGECOUNT value on done: 195918.0 [2023-02-24 20:49:53,958][213367] Sum rewards: 26.806, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.298', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.037', 'weapon4': '0.070', 'weapon5': '0.070', 'AMMO4': '0.187', 'AMMO3': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.944', 'WEAPON3': '1.300', 'HITCOUNT': '2.470', 'weapon3': '2.650', 'DAMAGECOUNT': '11.193', 'FRAGCOUNT': '26.000'} [2023-02-24 20:49:54,096][213372] DAMAGECOUNT value on done: 196190.0 [2023-02-24 20:49:54,097][213372] Sum rewards: 32.571, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.872', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon5': '0.138', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.432', 'weapon2': '0.936', 'WEAPON3': '1.000', 'weapon3': '2.204', 'HITCOUNT': '2.250', 'DAMAGECOUNT': '9.267', 'FRAGCOUNT': '28.500'} [2023-02-24 20:49:54,107][213366] DAMAGECOUNT value on done: 188005.0 [2023-02-24 20:49:54,107][213366] Sum rewards: 42.908, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.745', 'ARMOR': '0.004', 'AMMO2': '0.017', 'AMMO5': '0.020', 'AMMO4': '0.083', 'weapon5': '0.148', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.360', 'weapon4': '0.546', 'WEAPON3': '1.250', 'weapon3': '2.614', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.510', 'FRAGCOUNT': '38.000'} [2023-02-24 20:49:54,281][213367] DAMAGECOUNT value on done: 190682.0 [2023-02-24 20:49:54,282][213367] Sum rewards: 38.002, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.192', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.086', 'AMMO4': '0.111', 'AMMO3': '0.142', 'weapon4': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.736', 'WEAPON3': '0.850', 'HITCOUNT': '2.310', 'weapon3': '2.732', 'DAMAGECOUNT': '10.398', 'FRAGCOUNT': '31.500'} [2023-02-24 20:49:54,403][213372] DAMAGECOUNT value on done: 190609.0 [2023-02-24 20:49:54,404][213372] Sum rewards: 31.857, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.232', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.043', 'AMMO3': '0.098', 'weapon5': '0.110', 'AMMO4': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'WEAPON3': '0.600', 'weapon4': '0.946', 'weapon2': '1.088', 'weapon3': '1.696', 'HITCOUNT': '2.220', 'DAMAGECOUNT': '9.060', 'FRAGCOUNT': '26.000'} [2023-02-24 20:49:54,427][213366] DAMAGECOUNT value on done: 198887.0 [2023-02-24 20:49:54,427][213366] Sum rewards: 32.248, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.740', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.048', 'AMMO3': '0.089', 'AMMO4': '0.237', 'weapon5': '0.254', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '0.650', 'weapon2': '0.658', 'weapon4': '0.980', 'weapon3': '1.748', 'HITCOUNT': '2.050', 'DAMAGECOUNT': '10.008', 'FRAGCOUNT': '27.000'} [2023-02-24 20:49:54,610][213382] DAMAGECOUNT value on done: 186482.0 [2023-02-24 20:49:54,610][213366] DAMAGECOUNT value on done: 195100.0 [2023-02-24 20:49:54,610][213366] Sum rewards: 35.679, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.920', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon2': '0.154', 'AMMO3': '0.247', 'weapon4': '0.366', 'WEAPON3': '1.500', 'HITCOUNT': '2.520', 'weapon3': '3.172', 'DAMAGECOUNT': '10.344', 'FRAGCOUNT': '34.000'} [2023-02-24 20:49:54,611][213382] Sum rewards: 43.455, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.025', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.183', 'weapon4': '0.332', 'weapon2': '0.460', 'WEAPON3': '1.200', 'HITCOUNT': '2.420', 'weapon3': '2.876', 'DAMAGECOUNT': '9.936', 'FRAGCOUNT': '39.000'} [2023-02-24 20:49:54,724][213372] DAMAGECOUNT value on done: 185211.0 [2023-02-24 20:49:54,724][213372] Sum rewards: 31.939, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.130', 'AMMO5': '0.006', 'AMMO2': '0.049', 'AMMO3': '0.143', 'WEAPON5': '0.150', 'weapon5': '0.166', 'AMMO4': '0.246', 'weapon2': '0.570', 'WEAPON4': '0.650', 'WEAPON3': '0.800', 'weapon4': '1.000', 'weapon3': '1.664', 'HITCOUNT': '2.170', 'DAMAGECOUNT': '8.454', 'FRAGCOUNT': '29.000'} [2023-02-24 20:49:54,781][213383] DAMAGECOUNT value on done: 192366.0 [2023-02-24 20:49:54,781][213383] Sum rewards: 48.391, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.345', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.005', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.135', 'weapon2': '0.710', 'WEAPON3': '0.900', 'HITCOUNT': '2.640', 'weapon3': '3.122', 'DAMAGECOUNT': '12.030', 'FRAGCOUNT': '39.000'} [2023-02-24 20:49:54,832][213368] DAMAGECOUNT value on done: 185968.0 [2023-02-24 20:49:54,833][213368] Sum rewards: 37.425, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.055', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO3': '0.138', 'AMMO4': '0.147', 'WEAPON4': '0.250', 'weapon4': '0.260', 'WEAPON3': '0.850', 'weapon2': '0.986', 'HITCOUNT': '2.330', 'weapon3': '2.574', 'DAMAGECOUNT': '9.609', 'FRAGCOUNT': '31.000'} [2023-02-24 20:49:54,915][213366] DAMAGECOUNT value on done: 193419.0 [2023-02-24 20:49:54,916][213366] Sum rewards: 35.218, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.040', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.082', 'AMMO3': '0.173', 'weapon4': '0.184', 'weapon2': '0.698', 'WEAPON3': '1.050', 'HITCOUNT': '2.040', 'weapon3': '2.996', 'DAMAGECOUNT': '8.469', 'FRAGCOUNT': '31.000'} [2023-02-24 20:49:54,924][213382] DAMAGECOUNT value on done: 191303.0 [2023-02-24 20:49:54,925][213382] Sum rewards: 27.748, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.365', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO3': '0.144', 'weapon5': '0.148', 'AMMO4': '0.164', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.456', 'weapon4': '0.742', 'WEAPON3': '1.000', 'HITCOUNT': '2.140', 'weapon3': '2.464', 'DAMAGECOUNT': '8.859', 'FRAGCOUNT': '26.000'} [2023-02-24 20:49:55,078][213383] DAMAGECOUNT value on done: 194518.0 [2023-02-24 20:49:55,078][213383] Sum rewards: 40.931, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.191', 'AMMO5': '0.014', 'AMMO2': '0.024', 'AMMO4': '0.117', 'AMMO3': '0.161', 'weapon5': '0.234', 'weapon2': '0.244', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.534', 'WEAPON3': '0.950', 'HITCOUNT': '2.400', 'weapon3': '2.500', 'DAMAGECOUNT': '12.144', 'FRAGCOUNT': '34.000'} [2023-02-24 20:49:55,126][213368] DAMAGECOUNT value on done: 193567.0 [2023-02-24 20:49:55,127][213368] Sum rewards: 34.267, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.650', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon5': '0.068', 'AMMO4': '0.074', 'AMMO3': '0.179', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.426', 'weapon2': '0.668', 'WEAPON3': '1.050', 'HITCOUNT': '2.390', 'weapon3': '2.630', 'DAMAGECOUNT': '9.657', 'FRAGCOUNT': '31.000'} [2023-02-24 20:49:55,205][213382] DAMAGECOUNT value on done: 186410.0 [2023-02-24 20:49:55,205][213382] Sum rewards: 39.546, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.847', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.068', 'AMMO3': '0.118', 'WEAPON5': '0.150', 'weapon4': '0.150', 'AMMO4': '0.170', 'WEAPON4': '0.250', 'WEAPON3': '0.700', 'weapon2': '1.066', 'weapon3': '2.266', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '9.132', 'FRAGCOUNT': '33.000'} [2023-02-24 20:49:55,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 120430592. Throughput: 0: 3358.1. Samples: 5100020. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:49:55,243][213332] Avg episode reward: [(0, '33.252')] [2023-02-24 20:49:55,249][213369] DAMAGECOUNT value on done: 197016.0 [2023-02-24 20:49:55,250][213369] Sum rewards: 30.844, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.768', 'AMMO5': '0.019', 'AMMO2': '0.035', 'AMMO3': '0.170', 'AMMO4': '0.175', 'weapon5': '0.278', 'weapon2': '0.336', 'ARMOR': '0.413', 'WEAPON5': '0.550', 'WEAPON4': '0.550', 'weapon4': '0.746', 'WEAPON3': '1.000', 'weapon3': '1.906', 'HITCOUNT': '2.210', 'DAMAGECOUNT': '9.723', 'FRAGCOUNT': '26.500'} [2023-02-24 20:49:55,421][213368] DAMAGECOUNT value on done: 195952.0 [2023-02-24 20:49:55,422][213368] Sum rewards: 32.916, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.275', 'AMMO5': '0.005', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.098', 'AMMO4': '0.153', 'AMMO3': '0.196', 'weapon4': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.832', 'WEAPON3': '1.150', 'HITCOUNT': '2.360', 'weapon3': '2.608', 'DAMAGECOUNT': '9.990', 'FRAGCOUNT': '30.000'} [2023-02-24 20:49:55,507][213382] DAMAGECOUNT value on done: 194315.0 [2023-02-24 20:49:55,508][213382] Sum rewards: 36.702, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.052', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'AMMO4': '0.213', 'WEAPON4': '0.350', 'weapon4': '0.510', 'weapon2': '0.526', 'WEAPON3': '1.050', 'weapon3': '2.428', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '10.596', 'FRAGCOUNT': '33.500'} [2023-02-24 20:49:55,550][213369] DAMAGECOUNT value on done: 192166.0 [2023-02-24 20:49:55,550][213369] Sum rewards: 35.065, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.090', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.010', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.160', 'weapon5': '0.162', 'AMMO3': '0.181', 'weapon2': '0.852', 'WEAPON3': '1.200', 'HITCOUNT': '2.260', 'weapon3': '2.606', 'DAMAGECOUNT': '10.416', 'FRAGCOUNT': '32.000'} [2023-02-24 20:49:55,571][213384] DAMAGECOUNT value on done: 194759.0 [2023-02-24 20:49:55,571][213384] Sum rewards: 32.558, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.988', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON4': '0.150', 'AMMO3': '0.184', 'weapon5': '0.224', 'WEAPON5': '0.300', 'weapon4': '0.386', 'weapon2': '0.458', 'WEAPON3': '1.200', 'HITCOUNT': '2.400', 'weapon3': '2.584', 'DAMAGECOUNT': '9.813', 'FRAGCOUNT': '28.000'} [2023-02-24 20:49:55,666][213383] DAMAGECOUNT value on done: 191358.0 [2023-02-24 20:49:55,667][213383] Sum rewards: 34.683, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.200', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.017', 'weapon4': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'weapon5': '0.180', 'AMMO3': '0.231', 'weapon2': '0.486', 'WEAPON3': '1.450', 'HITCOUNT': '2.330', 'weapon3': '3.088', 'DAMAGECOUNT': '9.375', 'FRAGCOUNT': '33.000'} [2023-02-24 20:49:55,711][213368] DAMAGECOUNT value on done: 188492.0 [2023-02-24 20:49:55,712][213368] Sum rewards: 38.858, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.436', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.152', 'AMMO3': '0.196', 'weapon5': '0.242', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON4': '0.350', 'weapon4': '0.430', 'WEAPON3': '1.150', 'HITCOUNT': '2.360', 'weapon3': '2.720', 'DAMAGECOUNT': '11.025', 'FRAGCOUNT': '36.000'} [2023-02-24 20:49:55,847][213369] DAMAGECOUNT value on done: 193822.0 [2023-02-24 20:49:55,848][213369] Sum rewards: 34.995, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.230', 'ARMOR': '0.004', 'AMMO5': '0.009', 'weapon5': '0.040', 'AMMO2': '0.041', 'AMMO3': '0.115', 'WEAPON5': '0.200', 'AMMO4': '0.204', 'WEAPON4': '0.500', 'WEAPON3': '0.700', 'weapon2': '0.818', 'weapon4': '0.900', 'weapon3': '1.906', 'HITCOUNT': '2.130', 'DAMAGECOUNT': '8.409', 'FRAGCOUNT': '30.000'} [2023-02-24 20:49:55,870][213384] DAMAGECOUNT value on done: 181979.0 [2023-02-24 20:49:55,870][213384] Sum rewards: 31.566, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.910', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.172', 'weapon5': '0.198', 'WEAPON5': '0.200', 'weapon2': '0.304', 'WEAPON4': '0.400', 'weapon4': '0.806', 'WEAPON3': '1.050', 'weapon3': '2.424', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '10.122', 'FRAGCOUNT': '27.000'} [2023-02-24 20:49:55,966][213383] DAMAGECOUNT value on done: 186193.0 [2023-02-24 20:49:55,966][213383] Sum rewards: 44.867, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.480', 'AMMO5': '0.003', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.151', 'AMMO3': '0.152', 'weapon4': '0.166', 'WEAPON4': '0.200', 'weapon2': '0.846', 'WEAPON3': '0.950', 'HITCOUNT': '2.550', 'weapon3': '2.804', 'DAMAGECOUNT': '11.445', 'FRAGCOUNT': '39.000'} [2023-02-24 20:49:56,126][213384] DAMAGECOUNT value on done: 195653.0 [2023-02-24 20:49:56,127][213384] Sum rewards: 33.245, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.270', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.070', 'weapon5': '0.076', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon2': '0.566', 'WEAPON3': '1.200', 'HITCOUNT': '2.310', 'weapon3': '3.108', 'DAMAGECOUNT': '9.012', 'FRAGCOUNT': '32.000'} [2023-02-24 20:49:56,148][213369] DAMAGECOUNT value on done: 182057.0 [2023-02-24 20:49:56,149][213369] Sum rewards: 38.760, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.576', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO3': '0.132', 'AMMO4': '0.191', 'WEAPON5': '0.200', 'weapon5': '0.222', 'WEAPON4': '0.350', 'weapon4': '0.696', 'weapon2': '0.712', 'WEAPON3': '0.800', 'weapon3': '1.930', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '9.894', 'FRAGCOUNT': '33.000'} [2023-02-24 20:49:56,375][213365] Updated weights for policy 0, policy_version 29406 (0.0009) [2023-02-24 20:49:56,425][213384] DAMAGECOUNT value on done: 196471.0 [2023-02-24 20:49:56,425][213384] Sum rewards: 26.933, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.310', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.148', 'AMMO4': '0.167', 'weapon5': '0.172', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'weapon2': '0.286', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '2.520', 'weapon3': '3.096', 'DAMAGECOUNT': '10.158', 'FRAGCOUNT': '27.000'} [2023-02-24 20:49:59,432][213365] Updated weights for policy 0, policy_version 29416 (0.0009) [2023-02-24 20:50:00,243][213332] Fps is (10 sec: 13517.1, 60 sec: 13448.6, 300 sec: 13398.8). Total num frames: 120496128. Throughput: 0: 3362.5. Samples: 5120218. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:50:00,243][213332] Avg episode reward: [(0, '33.547')] [2023-02-24 20:50:02,423][213365] Updated weights for policy 0, policy_version 29426 (0.0009) [2023-02-24 20:50:05,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 120565760. Throughput: 0: 3361.1. Samples: 5130442. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:50:05,243][213332] Avg episode reward: [(0, '33.547')] [2023-02-24 20:50:05,511][213365] Updated weights for policy 0, policy_version 29436 (0.0008) [2023-02-24 20:50:08,549][213365] Updated weights for policy 0, policy_version 29446 (0.0009) [2023-02-24 20:50:10,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 120631296. Throughput: 0: 3356.2. Samples: 5150458. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:50:10,243][213332] Avg episode reward: [(0, '33.547')] [2023-02-24 20:50:11,579][213365] Updated weights for policy 0, policy_version 29456 (0.0009) [2023-02-24 20:50:13,242][213367] DAMAGECOUNT value on done: 193313.0 [2023-02-24 20:50:13,243][213367] Sum rewards: 34.230, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.848', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon4': '0.330', 'weapon2': '0.456', 'WEAPON3': '1.050', 'HITCOUNT': '2.260', 'weapon3': '2.994', 'DAMAGECOUNT': '9.102', 'FRAGCOUNT': '31.000'} [2023-02-24 20:50:13,553][213367] DAMAGECOUNT value on done: 194536.0 [2023-02-24 20:50:13,554][213367] Sum rewards: 33.050, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.855', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.039', 'AMMO3': '0.162', 'AMMO4': '0.197', 'weapon5': '0.346', 'weapon2': '0.358', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.724', 'WEAPON3': '1.000', 'HITCOUNT': '2.020', 'weapon3': '2.068', 'DAMAGECOUNT': '8.412', 'FRAGCOUNT': '29.000'} [2023-02-24 20:50:13,785][213372] DAMAGECOUNT value on done: 195449.0 [2023-02-24 20:50:13,787][213372] Sum rewards: 32.619, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.252', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.184', 'weapon4': '0.252', 'WEAPON4': '0.350', 'weapon2': '0.600', 'WEAPON3': '1.100', 'HITCOUNT': '2.150', 'weapon3': '2.844', 'DAMAGECOUNT': '9.684', 'FRAGCOUNT': '29.000'} [2023-02-24 20:50:13,954][213367] DAMAGECOUNT value on done: 199802.0 [2023-02-24 20:50:13,955][213367] Sum rewards: 42.669, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.586', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.116', 'AMMO3': '0.158', 'AMMO4': '0.204', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.552', 'weapon4': '0.588', 'WEAPON3': '1.100', 'weapon3': '2.402', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '11.652', 'FRAGCOUNT': '37.000'} [2023-02-24 20:50:14,059][213366] DAMAGECOUNT value on done: 191326.0 [2023-02-24 20:50:14,060][213366] Sum rewards: 33.201, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.218', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'weapon4': '0.198', 'AMMO3': '0.249', 'weapon2': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '2.420', 'weapon3': '3.114', 'DAMAGECOUNT': '9.918', 'FRAGCOUNT': '33.000'} [2023-02-24 20:50:14,100][213372] DAMAGECOUNT value on done: 199564.0 [2023-02-24 20:50:14,100][213372] Sum rewards: 36.359, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.740', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.029', 'AMMO3': '0.129', 'weapon5': '0.142', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.450', 'weapon2': '0.602', 'weapon4': '0.762', 'WEAPON3': '0.800', 'weapon3': '2.124', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '10.122', 'FRAGCOUNT': '32.000'} [2023-02-24 20:50:14,267][213367] DAMAGECOUNT value on done: 195157.0 [2023-02-24 20:50:14,267][213367] Sum rewards: 46.023, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.700', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'weapon5': '0.210', 'AMMO3': '0.219', 'weapon2': '0.224', 'WEAPON4': '0.300', 'weapon4': '0.546', 'WEAPON3': '1.400', 'weapon3': '2.776', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.425', 'FRAGCOUNT': '42.000'} [2023-02-24 20:50:14,373][213366] DAMAGECOUNT value on done: 202052.0 [2023-02-24 20:50:14,374][213366] Sum rewards: 35.653, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.116', 'AMMO5': '0.003', 'ARMOR': '0.005', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon7': '0.056', 'weapon5': '0.062', 'AMMO3': '0.115', 'AMMO4': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.402', 'WEAPON3': '0.650', 'weapon4': '0.918', 'HITCOUNT': '2.260', 'weapon3': '2.370', 'DAMAGECOUNT': '9.495', 'FRAGCOUNT': '29.000'} [2023-02-24 20:50:14,419][213372] DAMAGECOUNT value on done: 193556.0 [2023-02-24 20:50:14,420][213372] Sum rewards: 28.960, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.816', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO3': '0.107', 'weapon5': '0.132', 'AMMO4': '0.163', 'WEAPON5': '0.200', 'WEAPON4': '0.500', 'WEAPON3': '0.650', 'weapon4': '0.832', 'weapon2': '0.940', 'weapon3': '1.886', 'HITCOUNT': '2.220', 'DAMAGECOUNT': '8.841', 'FRAGCOUNT': '26.000'} [2023-02-24 20:50:14,533][213366] DAMAGECOUNT value on done: 198472.0 [2023-02-24 20:50:14,534][213366] Sum rewards: 31.926, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.970', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.039', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.126', 'WEAPON4': '0.300', 'weapon4': '0.548', 'weapon2': '0.844', 'WEAPON3': '0.850', 'weapon3': '2.392', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '10.116', 'FRAGCOUNT': '27.000'} [2023-02-24 20:50:14,598][213382] DAMAGECOUNT value on done: 189894.0 [2023-02-24 20:50:14,598][213382] Sum rewards: 36.807, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.623', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.046', 'weapon5': '0.064', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'weapon2': '0.220', 'AMMO4': '0.229', 'WEAPON4': '0.500', 'weapon4': '1.056', 'WEAPON3': '1.100', 'weapon3': '2.434', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '10.236', 'FRAGCOUNT': '33.000'} [2023-02-24 20:50:14,699][213365] Updated weights for policy 0, policy_version 29466 (0.0010) [2023-02-24 20:50:14,749][213372] DAMAGECOUNT value on done: 188443.0 [2023-02-24 20:50:14,750][213372] Sum rewards: 38.433, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.264', 'AMMO5': '0.010', 'ARMOR': '0.017', 'AMMO2': '0.040', 'weapon5': '0.114', 'AMMO3': '0.150', 'AMMO4': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.518', 'weapon4': '0.714', 'WEAPON3': '1.000', 'HITCOUNT': '2.250', 'weapon3': '2.440', 'DAMAGECOUNT': '9.696', 'FRAGCOUNT': '35.000'} [2023-02-24 20:50:14,767][213383] DAMAGECOUNT value on done: 196016.0 [2023-02-24 20:50:14,767][213383] Sum rewards: 39.636, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.365', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon5': '0.108', 'AMMO4': '0.197', 'AMMO3': '0.226', 'weapon4': '0.248', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.540', 'weapon3': '3.132', 'DAMAGECOUNT': '10.950', 'FRAGCOUNT': '38.000'} [2023-02-24 20:50:14,817][213368] DAMAGECOUNT value on done: 189541.0 [2023-02-24 20:50:14,817][213368] Sum rewards: 39.614, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.515', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'weapon2': '0.436', 'weapon4': '0.730', 'WEAPON3': '1.050', 'weapon3': '2.360', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '10.719', 'FRAGCOUNT': '36.000'} [2023-02-24 20:50:14,855][213366] DAMAGECOUNT value on done: 197053.0 [2023-02-24 20:50:14,855][213366] Sum rewards: 35.997, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.386', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon4': '0.302', 'weapon2': '0.406', 'WEAPON3': '1.050', 'HITCOUNT': '2.520', 'weapon3': '3.014', 'DAMAGECOUNT': '10.902', 'FRAGCOUNT': '32.000'} [2023-02-24 20:50:14,920][213382] DAMAGECOUNT value on done: 194577.0 [2023-02-24 20:50:14,920][213382] Sum rewards: 36.918, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.520', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.116', 'AMMO3': '0.175', 'weapon5': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.320', 'weapon2': '0.360', 'WEAPON3': '1.000', 'HITCOUNT': '2.210', 'weapon3': '2.886', 'DAMAGECOUNT': '9.822', 'FRAGCOUNT': '32.000'} [2023-02-24 20:50:15,067][213383] DAMAGECOUNT value on done: 197795.0 [2023-02-24 20:50:15,067][213383] Sum rewards: 30.062, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.596', 'AMMO5': '0.012', 'AMMO2': '0.045', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'weapon5': '0.200', 'AMMO4': '0.227', 'WEAPON4': '0.400', 'weapon2': '0.522', 'WEAPON3': '0.900', 'weapon4': '1.004', 'weapon3': '2.020', 'HITCOUNT': '2.140', 'DAMAGECOUNT': '9.831', 'FRAGCOUNT': '26.500'} [2023-02-24 20:50:15,113][213368] DAMAGECOUNT value on done: 196542.0 [2023-02-24 20:50:15,114][213368] Sum rewards: 33.028, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.096', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.109', 'AMMO3': '0.184', 'WEAPON4': '0.350', 'weapon4': '0.520', 'weapon2': '0.546', 'WEAPON3': '1.050', 'HITCOUNT': '2.060', 'weapon3': '2.552', 'DAMAGECOUNT': '8.925', 'FRAGCOUNT': '30.000'} [2023-02-24 20:50:15,204][213382] DAMAGECOUNT value on done: 189493.0 [2023-02-24 20:50:15,204][213382] Sum rewards: 27.238, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.820', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.142', 'weapon5': '0.150', 'AMMO3': '0.186', 'WEAPON5': '0.300', 'weapon4': '0.376', 'WEAPON4': '0.400', 'weapon2': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '2.120', 'weapon3': '2.746', 'DAMAGECOUNT': '9.249', 'FRAGCOUNT': '27.000'} [2023-02-24 20:50:15,243][213332] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 120696832. Throughput: 0: 3354.9. Samples: 5170544. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:50:15,244][213332] Avg episode reward: [(0, '33.722')] [2023-02-24 20:50:15,250][213369] DAMAGECOUNT value on done: 199729.0 [2023-02-24 20:50:15,250][213369] Sum rewards: 31.341, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.040', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.170', 'weapon4': '0.182', 'WEAPON4': '0.200', 'weapon2': '0.740', 'WEAPON3': '1.000', 'HITCOUNT': '1.880', 'weapon3': '2.534', 'DAMAGECOUNT': '8.139', 'FRAGCOUNT': '28.000'} [2023-02-24 20:50:15,408][213368] DAMAGECOUNT value on done: 199330.0 [2023-02-24 20:50:15,409][213368] Sum rewards: 36.216, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.782', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon5': '0.018', 'AMMO4': '0.065', 'WEAPON5': '0.100', 'AMMO3': '0.155', 'WEAPON4': '0.250', 'weapon4': '0.346', 'weapon2': '0.528', 'WEAPON3': '1.000', 'HITCOUNT': '2.650', 'weapon3': '2.978', 'DAMAGECOUNT': '10.134', 'FRAGCOUNT': '31.000'} [2023-02-24 20:50:15,502][213382] DAMAGECOUNT value on done: 197451.0 [2023-02-24 20:50:15,503][213382] Sum rewards: 32.348, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.404', 'AMMO5': '0.013', 'AMMO2': '0.022', 'weapon5': '0.072', 'AMMO4': '0.110', 'weapon4': '0.144', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.426', 'WEAPON3': '1.250', 'HITCOUNT': '2.340', 'weapon3': '3.126', 'DAMAGECOUNT': '9.408', 'FRAGCOUNT': '30.000'} [2023-02-24 20:50:15,551][213369] DAMAGECOUNT value on done: 196039.0 [2023-02-24 20:50:15,551][213369] Sum rewards: 40.388, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.042', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.049', 'AMMO3': '0.155', 'AMMO4': '0.247', 'weapon5': '0.258', 'WEAPON5': '0.350', 'weapon2': '0.406', 'WEAPON4': '0.500', 'weapon4': '0.518', 'WEAPON3': '1.000', 'HITCOUNT': '2.530', 'weapon3': '2.534', 'DAMAGECOUNT': '11.619', 'FRAGCOUNT': '36.500'} [2023-02-24 20:50:15,599][213384] DAMAGECOUNT value on done: 198115.0 [2023-02-24 20:50:15,599][213384] Sum rewards: 44.316, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.995', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.374', 'WEAPON3': '0.850', 'weapon2': '0.978', 'weapon3': '2.070', 'HITCOUNT': '2.190', 'DAMAGECOUNT': '10.068', 'FRAGCOUNT': '37.000'} [2023-02-24 20:50:15,657][213383] DAMAGECOUNT value on done: 194942.0 [2023-02-24 20:50:15,658][213383] Sum rewards: 45.589, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.095', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.003', 'weapon5': '0.044', 'weapon4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.155', 'weapon2': '0.686', 'WEAPON3': '1.050', 'HITCOUNT': '2.450', 'weapon3': '3.006', 'DAMAGECOUNT': '10.752', 'FRAGCOUNT': '39.000'} [2023-02-24 20:50:15,704][213368] DAMAGECOUNT value on done: 192027.0 [2023-02-24 20:50:15,705][213368] Sum rewards: 32.556, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.431', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.049', 'weapon5': '0.164', 'AMMO3': '0.219', 'weapon4': '0.230', 'AMMO4': '0.246', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.612', 'WEAPON3': '1.300', 'HITCOUNT': '2.240', 'weapon3': '2.696', 'DAMAGECOUNT': '10.605', 'FRAGCOUNT': '33.000'} [2023-02-24 20:50:15,875][213369] DAMAGECOUNT value on done: 196775.0 [2023-02-24 20:50:15,875][213369] Sum rewards: 27.911, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.848', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.096', 'AMMO4': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'WEAPON4': '0.350', 'weapon4': '0.656', 'weapon2': '0.778', 'WEAPON3': '1.250', 'HITCOUNT': '2.120', 'weapon3': '2.244', 'DAMAGECOUNT': '8.859', 'FRAGCOUNT': '28.000'} [2023-02-24 20:50:15,918][213384] DAMAGECOUNT value on done: 185752.0 [2023-02-24 20:50:15,919][213384] Sum rewards: 37.179, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.871', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon7': '0.054', 'weapon5': '0.056', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'AMMO4': '0.190', 'WEAPON7': '0.200', 'weapon2': '0.396', 'WEAPON4': '0.500', 'weapon4': '0.792', 'WEAPON3': '1.100', 'weapon3': '2.506', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '11.319', 'FRAGCOUNT': '34.000'} [2023-02-24 20:50:15,984][213383] DAMAGECOUNT value on done: 189686.0 [2023-02-24 20:50:15,985][213383] Sum rewards: 27.089, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.430', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.130', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.276', 'WEAPON4': '0.300', 'weapon4': '0.936', 'WEAPON3': '1.250', 'weapon3': '2.216', 'HITCOUNT': '2.370', 'DAMAGECOUNT': '10.479', 'FRAGCOUNT': '24.500'} [2023-02-24 20:50:16,126][213384] DAMAGECOUNT value on done: 198310.0 [2023-02-24 20:50:16,126][213384] Sum rewards: 20.506, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.916', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.066', 'weapon7': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.125', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.500', 'weapon2': '0.578', 'WEAPON3': '0.700', 'weapon4': '1.226', 'weapon3': '1.754', 'HITCOUNT': '2.160', 'DAMAGECOUNT': '7.971', 'FRAGCOUNT': '19.000'} [2023-02-24 20:50:16,170][213369] DAMAGECOUNT value on done: 185524.0 [2023-02-24 20:50:16,170][213369] Sum rewards: 35.270, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.822', 'weapon5': '0.002', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon4': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'weapon2': '0.480', 'WEAPON3': '1.400', 'HITCOUNT': '2.530', 'weapon3': '3.160', 'DAMAGECOUNT': '10.401', 'FRAGCOUNT': '35.000'} [2023-02-24 20:50:16,416][213384] DAMAGECOUNT value on done: 198718.0 [2023-02-24 20:50:16,417][213384] Sum rewards: 18.278, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.644', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.050', 'weapon7': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.144', 'WEAPON7': '0.200', 'AMMO4': '0.250', 'weapon2': '0.310', 'WEAPON4': '0.700', 'WEAPON3': '0.750', 'weapon4': '1.210', 'weapon3': '1.840', 'HITCOUNT': '1.930', 'DAMAGECOUNT': '6.741', 'FRAGCOUNT': '18.000'} [2023-02-24 20:50:17,442][213372] Large shaping reward 2.508 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.486, 162.0), ('weapon7', 0.002)] [2023-02-24 20:50:17,446][213384] Large shaping reward 2.514 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0)] [2023-02-24 20:50:17,699][213365] Updated weights for policy 0, policy_version 29476 (0.0008) [2023-02-24 20:50:20,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 120766464. Throughput: 0: 3354.3. Samples: 5180700. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:50:20,244][213332] Avg episode reward: [(0, '33.659')] [2023-02-24 20:50:20,737][213365] Updated weights for policy 0, policy_version 29486 (0.0009) [2023-02-24 20:50:23,779][213365] Updated weights for policy 0, policy_version 29496 (0.0009) [2023-02-24 20:50:25,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 120832000. Throughput: 0: 3360.2. Samples: 5200966. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:50:25,243][213332] Avg episode reward: [(0, '33.659')] [2023-02-24 20:50:26,794][213365] Updated weights for policy 0, policy_version 29506 (0.0009) [2023-02-24 20:50:27,917][213372] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 20:50:29,895][213365] Updated weights for policy 0, policy_version 29516 (0.0010) [2023-02-24 20:50:30,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 120901632. Throughput: 0: 3360.5. Samples: 5221018. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:50:30,243][213332] Avg episode reward: [(0, '33.659')] [2023-02-24 20:50:32,912][213365] Updated weights for policy 0, policy_version 29526 (0.0009) [2023-02-24 20:50:33,235][213367] DAMAGECOUNT value on done: 197010.0 [2023-02-24 20:50:33,235][213367] Sum rewards: 37.260, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.416', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'weapon5': '0.126', 'AMMO4': '0.142', 'AMMO3': '0.166', 'WEAPON4': '0.250', 'weapon4': '0.372', 'weapon2': '0.408', 'WEAPON3': '1.100', 'HITCOUNT': '2.500', 'weapon3': '2.888', 'DAMAGECOUNT': '11.091', 'FRAGCOUNT': '33.000'} [2023-02-24 20:50:33,560][213367] DAMAGECOUNT value on done: 197716.0 [2023-02-24 20:50:33,560][213367] Sum rewards: 39.492, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.083', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.068', 'weapon7': '0.068', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.166', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.538', 'weapon4': '0.676', 'WEAPON3': '0.700', 'HITCOUNT': '1.990', 'weapon3': '2.436', 'DAMAGECOUNT': '9.540', 'FRAGCOUNT': '33.000'} [2023-02-24 20:50:33,725][213372] DAMAGECOUNT value on done: 199681.0 [2023-02-24 20:50:33,725][213372] Sum rewards: 46.571, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.837', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.147', 'weapon5': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.496', 'weapon4': '0.552', 'WEAPON3': '0.900', 'weapon3': '2.500', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.651', 'FRAGCOUNT': '39.000'} [2023-02-24 20:50:33,970][213367] DAMAGECOUNT value on done: 203708.0 [2023-02-24 20:50:33,971][213367] Sum rewards: 45.712, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.916', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.174', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'weapon2': '0.288', 'WEAPON4': '0.300', 'weapon4': '0.364', 'WEAPON3': '1.050', 'HITCOUNT': '2.730', 'weapon3': '2.948', 'DAMAGECOUNT': '11.718', 'FRAGCOUNT': '40.000'} [2023-02-24 20:50:34,036][213372] DAMAGECOUNT value on done: 203014.0 [2023-02-24 20:50:34,036][213372] Sum rewards: 40.519, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.856', 'ARMOR': '0.004', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon2': '0.176', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'weapon4': '0.632', 'WEAPON3': '1.150', 'HITCOUNT': '2.470', 'weapon3': '3.012', 'DAMAGECOUNT': '10.350', 'FRAGCOUNT': '36.000'} [2023-02-24 20:50:34,075][213366] DAMAGECOUNT value on done: 194318.0 [2023-02-24 20:50:34,076][213366] Sum rewards: 36.475, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.174', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon7': '0.062', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.135', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.216', 'weapon2': '0.226', 'WEAPON4': '0.350', 'weapon4': '0.522', 'WEAPON3': '0.850', 'HITCOUNT': '2.090', 'weapon3': '2.698', 'DAMAGECOUNT': '8.976', 'FRAGCOUNT': '32.000'} [2023-02-24 20:50:34,294][213367] DAMAGECOUNT value on done: 198061.0 [2023-02-24 20:50:34,295][213367] Sum rewards: 29.782, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.724', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.041', 'AMMO3': '0.113', 'AMMO4': '0.203', 'weapon5': '0.260', 'WEAPON5': '0.350', 'weapon2': '0.384', 'WEAPON4': '0.600', 'WEAPON3': '0.600', 'weapon4': '1.310', 'weapon3': '1.466', 'HITCOUNT': '2.200', 'DAMAGECOUNT': '8.712', 'FRAGCOUNT': '27.000'} [2023-02-24 20:50:34,350][213372] DAMAGECOUNT value on done: 195985.0 [2023-02-24 20:50:34,351][213372] Sum rewards: 19.388, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.275', 'ARMOR': '0.008', 'AMMO5': '0.014', 'weapon7': '0.052', 'AMMO2': '0.054', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.162', 'weapon5': '0.180', 'WEAPON7': '0.200', 'AMMO4': '0.271', 'WEAPON5': '0.300', 'weapon2': '0.406', 'WEAPON4': '0.550', 'weapon4': '0.584', 'WEAPON3': '1.050', 'HITCOUNT': '1.580', 'weapon3': '2.474', 'DAMAGECOUNT': '7.287', 'FRAGCOUNT': '20.000'} [2023-02-24 20:50:34,392][213366] DAMAGECOUNT value on done: 205869.0 [2023-02-24 20:50:34,393][213366] Sum rewards: 39.465, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.782', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.044', 'weapon7': '0.064', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.139', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.208', 'AMMO4': '0.219', 'WEAPON4': '0.600', 'weapon2': '0.646', 'WEAPON3': '0.800', 'weapon4': '1.242', 'weapon3': '1.362', 'HITCOUNT': '2.300', 'DAMAGECOUNT': '11.451', 'FRAGCOUNT': '32.000'} [2023-02-24 20:50:34,523][213366] DAMAGECOUNT value on done: 201665.0 [2023-02-24 20:50:34,524][213366] Sum rewards: 33.981, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.036', 'AMMO5': '0.016', 'AMMO2': '0.036', 'AMMO3': '0.179', 'AMMO4': '0.179', 'weapon5': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.404', 'weapon2': '0.736', 'WEAPON3': '1.100', 'HITCOUNT': '1.920', 'weapon3': '2.324', 'DAMAGECOUNT': '9.579', 'FRAGCOUNT': '32.000'} [2023-02-24 20:50:34,616][213382] DAMAGECOUNT value on done: 193257.0 [2023-02-24 20:50:34,616][213382] Sum rewards: 41.904, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.005', 'AMMO2': '0.023', 'HEALTH': '0.040', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.114', 'AMMO3': '0.115', 'weapon4': '0.496', 'weapon2': '0.530', 'WEAPON3': '0.650', 'HITCOUNT': '2.150', 'weapon3': '2.638', 'DAMAGECOUNT': '10.089', 'FRAGCOUNT': '33.000'} [2023-02-24 20:50:34,670][213372] DAMAGECOUNT value on done: 191363.0 [2023-02-24 20:50:34,670][213372] Sum rewards: 32.266, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.707', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'AMMO4': '0.158', 'weapon7': '0.164', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon2': '0.242', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.700', 'weapon4': '1.238', 'weapon3': '1.882', 'HITCOUNT': '1.930', 'DAMAGECOUNT': '8.760', 'FRAGCOUNT': '27.000'} [2023-02-24 20:50:34,732][213383] DAMAGECOUNT value on done: 199117.0 [2023-02-24 20:50:34,733][213383] Sum rewards: 33.367, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.400', 'AMMO5': '0.006', 'weapon7': '0.028', 'AMMO2': '0.030', 'weapon5': '0.090', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.144', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'weapon2': '0.212', 'WEAPON4': '0.300', 'weapon4': '0.780', 'WEAPON3': '0.900', 'HITCOUNT': '2.210', 'weapon3': '2.416', 'DAMAGECOUNT': '9.303', 'FRAGCOUNT': '29.000'} [2023-02-24 20:50:34,832][213368] DAMAGECOUNT value on done: 193776.0 [2023-02-24 20:50:34,832][213368] Sum rewards: 37.944, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.336', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.046', 'AMMO3': '0.165', 'weapon5': '0.172', 'AMMO4': '0.232', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON4': '0.500', 'weapon4': '0.686', 'WEAPON3': '1.050', 'weapon3': '2.646', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.705', 'FRAGCOUNT': '33.000'} [2023-02-24 20:50:34,841][213366] DAMAGECOUNT value on done: 200421.0 [2023-02-24 20:50:34,841][213366] Sum rewards: 31.254, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.790', 'AMMO5': '0.010', 'AMMO2': '0.047', 'AMMO3': '0.139', 'AMMO4': '0.237', 'weapon5': '0.292', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.668', 'WEAPON3': '0.850', 'weapon4': '0.894', 'weapon3': '1.742', 'HITCOUNT': '2.260', 'DAMAGECOUNT': '10.104', 'FRAGCOUNT': '27.000'} [2023-02-24 20:50:34,933][213382] DAMAGECOUNT value on done: 198432.0 [2023-02-24 20:50:34,934][213382] Sum rewards: 40.716, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.748', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.064', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'weapon4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.227', 'weapon2': '0.418', 'WEAPON3': '1.400', 'HITCOUNT': '2.400', 'weapon3': '3.172', 'DAMAGECOUNT': '11.565', 'FRAGCOUNT': '38.000'} [2023-02-24 20:50:35,037][213383] DAMAGECOUNT value on done: 200528.0 [2023-02-24 20:50:35,038][213383] Sum rewards: 29.061, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.296', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON5': '0.150', 'weapon2': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon5': '0.240', 'weapon4': '0.254', 'WEAPON3': '1.250', 'HITCOUNT': '1.800', 'weapon3': '3.086', 'DAMAGECOUNT': '7.665', 'FRAGCOUNT': '29.000'} [2023-02-24 20:50:35,136][213368] DAMAGECOUNT value on done: 199515.0 [2023-02-24 20:50:35,137][213368] Sum rewards: 37.442, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.079', 'AMMO5': '0.005', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.250', 'weapon4': '0.358', 'WEAPON3': '0.900', 'weapon2': '0.946', 'HITCOUNT': '2.080', 'weapon3': '2.242', 'DAMAGECOUNT': '8.919', 'FRAGCOUNT': '32.000'} [2023-02-24 20:50:35,185][213369] DAMAGECOUNT value on done: 203289.0 [2023-02-24 20:50:35,185][213369] Sum rewards: 39.992, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.855', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon4': '0.068', 'WEAPON4': '0.150', 'weapon5': '0.172', 'AMMO4': '0.177', 'AMMO3': '0.212', 'WEAPON5': '0.350', 'weapon2': '0.640', 'WEAPON3': '1.200', 'HITCOUNT': '2.550', 'weapon3': '2.846', 'DAMAGECOUNT': '10.680', 'FRAGCOUNT': '36.000'} [2023-02-24 20:50:35,218][213382] DAMAGECOUNT value on done: 192469.0 [2023-02-24 20:50:35,219][213382] Sum rewards: 27.755, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.110', 'AMMO5': '0.004', 'weapon5': '0.034', 'AMMO2': '0.037', 'weapon7': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.160', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO4': '0.186', 'WEAPON7': '0.200', 'weapon2': '0.432', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon4': '1.180', 'weapon3': '1.974', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '8.928', 'FRAGCOUNT': '26.000'} [2023-02-24 20:50:35,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 120967168. Throughput: 0: 3363.6. Samples: 5231286. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:50:35,243][213332] Avg episode reward: [(0, '34.406')] [2023-02-24 20:50:35,426][213368] DAMAGECOUNT value on done: 202581.0 [2023-02-24 20:50:35,427][213368] Sum rewards: 27.447, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.390', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.086', 'AMMO3': '0.168', 'AMMO4': '0.197', 'WEAPON5': '0.250', 'weapon2': '0.386', 'WEAPON4': '0.400', 'weapon4': '0.842', 'WEAPON3': '1.050', 'weapon3': '2.434', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '9.753', 'FRAGCOUNT': '26.000'} [2023-02-24 20:50:35,489][213369] DAMAGECOUNT value on done: 199343.0 [2023-02-24 20:50:35,489][213369] Sum rewards: 42.509, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.306', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.122', 'WEAPON4': '0.250', 'weapon2': '0.508', 'WEAPON3': '0.750', 'weapon4': '1.012', 'weapon3': '2.096', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '9.912', 'FRAGCOUNT': '36.000'} [2023-02-24 20:50:35,521][213382] DAMAGECOUNT value on done: 201479.0 [2023-02-24 20:50:35,521][213382] Sum rewards: 45.363, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.187', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.096', 'AMMO4': '0.121', 'AMMO3': '0.132', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.402', 'weapon4': '0.678', 'WEAPON3': '0.800', 'weapon3': '2.428', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.084', 'FRAGCOUNT': '37.000'} [2023-02-24 20:50:35,619][213384] DAMAGECOUNT value on done: 201107.0 [2023-02-24 20:50:35,620][213384] Sum rewards: 32.042, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.067', 'WEAPON1': '0.010', 'AMMO5': '0.024', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon2': '0.174', 'AMMO3': '0.175', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'ARMOR': '0.467', 'weapon5': '0.584', 'weapon4': '0.750', 'WEAPON3': '1.050', 'HITCOUNT': '1.830', 'weapon3': '2.072', 'DAMAGECOUNT': '8.973', 'FRAGCOUNT': '29.000'} [2023-02-24 20:50:35,630][213383] DAMAGECOUNT value on done: 198573.0 [2023-02-24 20:50:35,630][213383] Sum rewards: 35.967, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.760', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.066', 'AMMO4': '0.153', 'weapon4': '0.166', 'WEAPON5': '0.250', 'AMMO3': '0.267', 'weapon2': '0.292', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'HITCOUNT': '2.430', 'weapon3': '3.216', 'DAMAGECOUNT': '10.893', 'FRAGCOUNT': '37.000'} [2023-02-24 20:50:35,728][213368] DAMAGECOUNT value on done: 195152.0 [2023-02-24 20:50:35,728][213368] Sum rewards: 27.909, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.288', 'ARMOR': '0.004', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.189', 'weapon5': '0.194', 'weapon2': '0.234', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.818', 'WEAPON3': '1.050', 'HITCOUNT': '2.180', 'weapon3': '2.356', 'DAMAGECOUNT': '9.375', 'FRAGCOUNT': '26.000'} [2023-02-24 20:50:35,787][213369] DAMAGECOUNT value on done: 199950.0 [2023-02-24 20:50:35,788][213369] Sum rewards: 36.163, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.090', 'ARMOR': '0.004', 'AMMO2': '0.013', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'weapon4': '0.154', 'AMMO3': '0.176', 'weapon2': '0.294', 'WEAPON3': '1.050', 'HITCOUNT': '2.220', 'weapon3': '3.400', 'DAMAGECOUNT': '9.525', 'FRAGCOUNT': '30.000'} [2023-02-24 20:50:35,917][213384] DAMAGECOUNT value on done: 189423.0 [2023-02-24 20:50:35,918][213384] Sum rewards: 43.794, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.319', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'AMMO4': '0.144', 'WEAPON4': '0.250', 'weapon2': '0.650', 'weapon4': '0.666', 'WEAPON3': '0.800', 'weapon3': '2.432', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '11.013', 'FRAGCOUNT': '36.000'} [2023-02-24 20:50:35,932][213383] DAMAGECOUNT value on done: 191313.0 [2023-02-24 20:50:35,932][213383] Sum rewards: 9.301, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.856', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO3': '0.064', 'AMMO4': '0.067', 'weapon7': '0.170', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.458', 'HITCOUNT': '0.540', 'weapon2': '0.870', 'weapon3': '1.044', 'DAMAGECOUNT': '3.081', 'FRAGCOUNT': '7.000'} [2023-02-24 20:50:35,995][213365] Updated weights for policy 0, policy_version 29536 (0.0008) [2023-02-24 20:50:36,081][213369] DAMAGECOUNT value on done: 188940.0 [2023-02-24 20:50:36,082][213369] Sum rewards: 36.604, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.612', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.034', 'AMMO3': '0.080', 'AMMO4': '0.169', 'weapon5': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '0.450', 'weapon2': '0.542', 'weapon4': '1.178', 'weapon3': '1.690', 'HITCOUNT': '2.300', 'DAMAGECOUNT': '10.224', 'FRAGCOUNT': '30.000'} [2023-02-24 20:50:36,122][213384] DAMAGECOUNT value on done: 202496.0 [2023-02-24 20:50:36,123][213384] Sum rewards: 39.363, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.666', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.084', 'weapon7': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'AMMO3': '0.202', 'weapon2': '0.244', 'weapon4': '0.460', 'WEAPON3': '1.250', 'HITCOUNT': '2.590', 'weapon3': '2.940', 'DAMAGECOUNT': '11.958', 'FRAGCOUNT': '34.000'} [2023-02-24 20:50:36,417][213384] DAMAGECOUNT value on done: 202623.0 [2023-02-24 20:50:36,417][213384] Sum rewards: 39.316, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.938', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.029', 'WEAPON4': '0.150', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'weapon4': '0.296', 'weapon5': '0.366', 'weapon2': '0.458', 'WEAPON3': '1.400', 'weapon3': '2.544', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '11.715', 'FRAGCOUNT': '35.000'} [2023-02-24 20:50:39,069][213365] Updated weights for policy 0, policy_version 29546 (0.0009) [2023-02-24 20:50:40,243][213332] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 121032704. Throughput: 0: 3360.8. Samples: 5251254. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:50:40,243][213332] Avg episode reward: [(0, '34.760')] [2023-02-24 20:50:40,244][213352] Saving new best policy, reward=34.760! [2023-02-24 20:50:42,083][213365] Updated weights for policy 0, policy_version 29556 (0.0008) [2023-02-24 20:50:45,191][213365] Updated weights for policy 0, policy_version 29566 (0.0009) [2023-02-24 20:50:45,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 121102336. Throughput: 0: 3357.7. Samples: 5271314. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 20:50:45,243][213332] Avg episode reward: [(0, '34.760')] [2023-02-24 20:50:45,247][213352] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000029566_121102336.pth... [2023-02-24 20:50:45,305][213352] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000028780_117882880.pth [2023-02-24 20:50:48,215][213365] Updated weights for policy 0, policy_version 29576 (0.0009) [2023-02-24 20:50:49,274][213367] Large shaping reward 2.544 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.522, 174.0), ('weapon5', 0.002)] [2023-02-24 20:50:50,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13412.7). Total num frames: 121167872. Throughput: 0: 3355.5. Samples: 5281438. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 20:50:50,243][213332] Avg episode reward: [(0, '34.760')] [2023-02-24 20:50:51,240][213365] Updated weights for policy 0, policy_version 29586 (0.0009) [2023-02-24 20:50:53,207][213367] DAMAGECOUNT value on done: 200743.0 [2023-02-24 20:50:53,208][213367] Sum rewards: 36.751, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.062', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.194', 'weapon5': '0.268', 'WEAPON4': '0.350', 'weapon2': '0.362', 'WEAPON5': '0.400', 'weapon4': '0.636', 'WEAPON3': '1.100', 'HITCOUNT': '2.440', 'weapon3': '2.442', 'DAMAGECOUNT': '11.199', 'FRAGCOUNT': '31.000'} [2023-02-24 20:50:53,521][213367] DAMAGECOUNT value on done: 200599.0 [2023-02-24 20:50:53,521][213367] Sum rewards: 36.610, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.223', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.127', 'weapon5': '0.178', 'AMMO4': '0.222', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.626', 'WEAPON3': '0.700', 'weapon2': '0.712', 'weapon3': '1.778', 'HITCOUNT': '2.000', 'DAMAGECOUNT': '8.649', 'FRAGCOUNT': '32.000'} [2023-02-24 20:50:53,836][213372] DAMAGECOUNT value on done: 203193.0 [2023-02-24 20:50:53,837][213372] Sum rewards: 33.620, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.785', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.038', 'AMMO4': '0.192', 'weapon5': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'WEAPON4': '0.350', 'weapon2': '0.372', 'weapon4': '0.810', 'WEAPON3': '1.350', 'HITCOUNT': '2.300', 'weapon3': '2.322', 'DAMAGECOUNT': '10.536', 'FRAGCOUNT': '34.000'} [2023-02-24 20:50:53,923][213367] DAMAGECOUNT value on done: 207263.0 [2023-02-24 20:50:53,924][213367] Sum rewards: 38.991, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.186', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.366', 'weapon4': '0.378', 'WEAPON3': '1.250', 'HITCOUNT': '2.350', 'weapon3': '2.952', 'DAMAGECOUNT': '10.665', 'FRAGCOUNT': '36.000'} [2023-02-24 20:50:54,141][213366] DAMAGECOUNT value on done: 197566.0 [2023-02-24 20:50:54,141][213366] Sum rewards: 27.713, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.944', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon2': '0.180', 'AMMO3': '0.241', 'weapon5': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.408', 'WEAPON3': '1.500', 'HITCOUNT': '2.300', 'weapon3': '2.844', 'DAMAGECOUNT': '9.744', 'FRAGCOUNT': '29.000'} [2023-02-24 20:50:54,152][213372] DAMAGECOUNT value on done: 206403.0 [2023-02-24 20:50:54,153][213372] Sum rewards: 30.973, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-0.178', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.048', 'weapon5': '0.094', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'AMMO4': '0.239', 'weapon2': '0.390', 'WEAPON4': '0.450', 'weapon4': '1.042', 'WEAPON3': '1.250', 'weapon3': '2.162', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '10.167', 'FRAGCOUNT': '31.000'} [2023-02-24 20:50:54,245][213367] DAMAGECOUNT value on done: 201075.0 [2023-02-24 20:50:54,245][213367] Sum rewards: 36.164, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.356', 'ARMOR': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO4': '0.123', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'weapon2': '0.202', 'weapon4': '0.564', 'WEAPON3': '0.950', 'HITCOUNT': '2.200', 'weapon3': '2.698', 'DAMAGECOUNT': '9.042', 'FRAGCOUNT': '31.000'} [2023-02-24 20:50:54,344][213365] Updated weights for policy 0, policy_version 29596 (0.0009) [2023-02-24 20:50:54,407][213372] DAMAGECOUNT value on done: 198704.0 [2023-02-24 20:50:54,408][213372] Sum rewards: 25.009, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.440', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.103', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'ARMOR': '0.448', 'weapon2': '0.534', 'weapon4': '0.548', 'WEAPON3': '0.950', 'HITCOUNT': '1.940', 'weapon3': '2.280', 'DAMAGECOUNT': '8.157', 'FRAGCOUNT': '23.000'} [2023-02-24 20:50:54,457][213366] DAMAGECOUNT value on done: 208841.0 [2023-02-24 20:50:54,457][213366] Sum rewards: 31.579, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.140', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.086', 'AMMO4': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon4': '0.310', 'weapon2': '0.666', 'WEAPON3': '1.200', 'HITCOUNT': '2.180', 'weapon3': '2.700', 'DAMAGECOUNT': '8.916', 'FRAGCOUNT': '30.000'} [2023-02-24 20:50:54,480][213366] DAMAGECOUNT value on done: 205085.0 [2023-02-24 20:50:54,480][213366] Sum rewards: 30.271, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.979', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON5': '0.050', 'weapon5': '0.068', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'weapon4': '0.204', 'weapon2': '0.760', 'WEAPON3': '1.200', 'HITCOUNT': '2.290', 'weapon3': '2.792', 'DAMAGECOUNT': '10.260', 'FRAGCOUNT': '27.000'} [2023-02-24 20:50:54,721][213372] DAMAGECOUNT value on done: 195505.0 [2023-02-24 20:50:54,722][213372] Sum rewards: 47.853, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.575', 'AMMO5': '0.009', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon5': '0.144', 'AMMO3': '0.183', 'weapon2': '0.184', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.522', 'WEAPON3': '1.200', 'weapon3': '2.878', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.426', 'FRAGCOUNT': '42.000'} [2023-02-24 20:50:54,732][213382] DAMAGECOUNT value on done: 197363.0 [2023-02-24 20:50:54,733][213382] Sum rewards: 42.109, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.940', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'weapon4': '0.224', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'weapon2': '0.454', 'WEAPON3': '1.500', 'HITCOUNT': '2.960', 'weapon3': '3.068', 'DAMAGECOUNT': '12.318', 'FRAGCOUNT': '41.000'} [2023-02-24 20:50:54,780][213383] DAMAGECOUNT value on done: 201161.0 [2023-02-24 20:50:54,781][213383] Sum rewards: 22.978, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.855', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon5': '0.094', 'AMMO3': '0.155', 'AMMO4': '0.159', 'weapon4': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.900', 'weapon2': '1.080', 'HITCOUNT': '1.620', 'weapon3': '2.380', 'DAMAGECOUNT': '6.132', 'FRAGCOUNT': '22.000'} [2023-02-24 20:50:54,797][213366] DAMAGECOUNT value on done: 204734.0 [2023-02-24 20:50:54,797][213366] Sum rewards: 42.262, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.664', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.098', 'AMMO4': '0.145', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon2': '0.278', 'weapon4': '0.432', 'WEAPON3': '1.300', 'weapon3': '2.868', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.939', 'FRAGCOUNT': '36.500'} [2023-02-24 20:50:54,824][213368] DAMAGECOUNT value on done: 197254.0 [2023-02-24 20:50:54,824][213368] Sum rewards: 39.144, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.230', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon7': '0.054', 'AMMO4': '0.081', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'AMMO3': '0.227', 'weapon4': '0.322', 'weapon2': '0.372', 'WEAPON3': '1.300', 'HITCOUNT': '2.480', 'weapon3': '3.032', 'DAMAGECOUNT': '10.224', 'FRAGCOUNT': '36.000'} [2023-02-24 20:50:55,046][213382] DAMAGECOUNT value on done: 201971.0 [2023-02-24 20:50:55,047][213382] Sum rewards: 38.027, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.235', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.068', 'AMMO3': '0.187', 'AMMO4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.202', 'WEAPON4': '0.350', 'weapon2': '0.470', 'WEAPON3': '1.100', 'HITCOUNT': '2.360', 'weapon3': '3.006', 'DAMAGECOUNT': '10.572', 'FRAGCOUNT': '35.000'} [2023-02-24 20:50:55,089][213383] DAMAGECOUNT value on done: 205230.0 [2023-02-24 20:50:55,089][213383] Sum rewards: 51.998, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.510', 'AMMO2': '0.002', 'ARMOR': '0.004', 'AMMO4': '0.012', 'AMMO5': '0.012', 'WEAPON4': '0.050', 'weapon4': '0.056', 'weapon5': '0.166', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'weapon2': '0.690', 'WEAPON3': '1.200', 'weapon3': '2.866', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.106', 'FRAGCOUNT': '43.000'} [2023-02-24 20:50:55,126][213368] DAMAGECOUNT value on done: 202846.0 [2023-02-24 20:50:55,127][213368] Sum rewards: 30.726, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.418', 'AMMO5': '0.014', 'AMMO2': '0.041', 'AMMO3': '0.192', 'AMMO4': '0.207', 'weapon5': '0.254', 'weapon4': '0.272', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.622', 'WEAPON3': '1.200', 'HITCOUNT': '2.150', 'weapon3': '2.548', 'DAMAGECOUNT': '9.993', 'FRAGCOUNT': '29.000'} [2023-02-24 20:50:55,200][213369] DAMAGECOUNT value on done: 206408.0 [2023-02-24 20:50:55,200][213369] Sum rewards: 31.714, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.004', 'AMMO5': '0.016', 'AMMO2': '0.025', 'AMMO4': '0.126', 'AMMO3': '0.149', 'WEAPON4': '0.250', 'weapon5': '0.256', 'WEAPON5': '0.400', 'weapon2': '0.418', 'weapon4': '0.494', 'WEAPON3': '0.850', 'HITCOUNT': '2.050', 'weapon3': '2.326', 'DAMAGECOUNT': '9.357', 'FRAGCOUNT': '28.000'} [2023-02-24 20:50:55,243][213332] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 121233408. Throughput: 0: 3359.4. Samples: 5301632. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 20:50:55,243][213332] Avg episode reward: [(0, '35.065')] [2023-02-24 20:50:55,282][213352] Saving new best policy, reward=35.065! [2023-02-24 20:50:55,356][213382] DAMAGECOUNT value on done: 195998.0 [2023-02-24 20:50:55,356][213382] Sum rewards: 35.256, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.796', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.044', 'AMMO3': '0.185', 'AMMO4': '0.218', 'weapon5': '0.260', 'weapon2': '0.438', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.572', 'WEAPON3': '1.100', 'weapon3': '2.304', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '10.587', 'FRAGCOUNT': '33.000'} [2023-02-24 20:50:55,439][213368] DAMAGECOUNT value on done: 206349.0 [2023-02-24 20:50:55,440][213368] Sum rewards: 38.254, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.010', 'AMMO5': '0.005', 'AMMO2': '0.030', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'weapon5': '0.158', 'weapon2': '0.192', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'weapon4': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '2.290', 'weapon3': '3.114', 'DAMAGECOUNT': '11.304', 'FRAGCOUNT': '35.000'} [2023-02-24 20:50:55,518][213369] DAMAGECOUNT value on done: 202821.0 [2023-02-24 20:50:55,519][213369] Sum rewards: 36.865, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.940', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.117', 'AMMO3': '0.142', 'weapon5': '0.158', 'WEAPON5': '0.200', 'weapon4': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.620', 'WEAPON3': '0.900', 'HITCOUNT': '2.210', 'weapon3': '2.778', 'DAMAGECOUNT': '10.434', 'FRAGCOUNT': '31.000'} [2023-02-24 20:50:55,657][213384] DAMAGECOUNT value on done: 205011.0 [2023-02-24 20:50:55,657][213384] Sum rewards: 50.856, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.154', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.120', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.388', 'weapon4': '0.394', 'WEAPON3': '1.000', 'HITCOUNT': '2.670', 'weapon3': '2.940', 'DAMAGECOUNT': '11.712', 'FRAGCOUNT': '43.500'} [2023-02-24 20:50:55,659][213382] DAMAGECOUNT value on done: 204941.0 [2023-02-24 20:50:55,659][213382] Sum rewards: 39.651, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.060', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon5': '0.206', 'weapon2': '0.464', 'weapon4': '0.634', 'WEAPON3': '1.100', 'weapon3': '2.436', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '10.386', 'FRAGCOUNT': '35.000'} [2023-02-24 20:50:55,700][213383] DAMAGECOUNT value on done: 201816.0 [2023-02-24 20:50:55,701][213383] Sum rewards: 31.086, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.292', 'AMMO2': '0.015', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.241', 'weapon2': '0.336', 'weapon4': '0.492', 'WEAPON3': '1.450', 'HITCOUNT': '2.640', 'weapon3': '2.798', 'DAMAGECOUNT': '9.729', 'FRAGCOUNT': '29.000'} [2023-02-24 20:50:55,742][213368] DAMAGECOUNT value on done: 198339.0 [2023-02-24 20:50:55,743][213368] Sum rewards: 32.672, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.102', 'ARMOR': '0.004', 'AMMO5': '0.004', 'AMMO2': '0.021', 'weapon5': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'weapon7': '0.156', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'AMMO3': '0.220', 'weapon4': '0.224', 'weapon2': '0.288', 'WEAPON3': '1.350', 'HITCOUNT': '2.250', 'weapon3': '2.906', 'DAMAGECOUNT': '9.561', 'FRAGCOUNT': '31.000'} [2023-02-24 20:50:55,817][213369] DAMAGECOUNT value on done: 204279.0 [2023-02-24 20:50:55,817][213369] Sum rewards: 48.343, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.344', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.136', 'AMMO3': '0.196', 'weapon5': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.356', 'weapon4': '0.486', 'WEAPON3': '1.200', 'weapon3': '2.702', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '12.987', 'FRAGCOUNT': '42.000'} [2023-02-24 20:50:55,950][213384] DAMAGECOUNT value on done: 193098.0 [2023-02-24 20:50:55,951][213384] Sum rewards: 32.705, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.831', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.112', 'AMMO4': '0.161', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.370', 'weapon4': '0.422', 'WEAPON3': '1.250', 'HITCOUNT': '2.110', 'weapon3': '2.438', 'DAMAGECOUNT': '11.025', 'FRAGCOUNT': '30.000'} [2023-02-24 20:50:55,999][213383] DAMAGECOUNT value on done: 194635.0 [2023-02-24 20:50:55,999][213383] Sum rewards: 27.991, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.050', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.072', 'WEAPON4': '0.150', 'weapon4': '0.152', 'weapon2': '0.206', 'weapon5': '0.230', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'WEAPON3': '1.500', 'HITCOUNT': '2.350', 'weapon3': '3.132', 'DAMAGECOUNT': '9.966', 'FRAGCOUNT': '27.000'} [2023-02-24 20:50:56,060][213384] DAMAGECOUNT value on done: 205789.0 [2023-02-24 20:50:56,061][213384] Sum rewards: 27.869, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.228', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.046', 'AMMO3': '0.146', 'WEAPON5': '0.150', 'weapon5': '0.170', 'AMMO4': '0.230', 'weapon2': '0.396', 'WEAPON4': '0.650', 'WEAPON3': '0.900', 'weapon4': '1.120', 'weapon3': '2.076', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '9.879', 'FRAGCOUNT': '26.000'} [2023-02-24 20:50:56,123][213369] DAMAGECOUNT value on done: 192432.0 [2023-02-24 20:50:56,124][213369] Sum rewards: 34.071, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.362', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon5': '0.078', 'AMMO4': '0.123', 'AMMO3': '0.232', 'weapon4': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.448', 'WEAPON3': '1.400', 'HITCOUNT': '2.370', 'weapon3': '2.974', 'DAMAGECOUNT': '10.476', 'FRAGCOUNT': '34.000'} [2023-02-24 20:50:56,352][213384] DAMAGECOUNT value on done: 205653.0 [2023-02-24 20:50:56,353][213384] Sum rewards: 29.159, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.246', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.059', 'weapon7': '0.086', 'AMMO3': '0.185', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'weapon2': '0.292', 'weapon5': '0.296', 'AMMO4': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon4': '1.156', 'weapon3': '1.608', 'HITCOUNT': '2.220', 'DAMAGECOUNT': '9.090', 'FRAGCOUNT': '30.000'} [2023-02-24 20:50:57,406][213365] Updated weights for policy 0, policy_version 29606 (0.0009) [2023-02-24 20:51:00,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 121303040. Throughput: 0: 3355.6. Samples: 5321548. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 20:51:00,243][213332] Avg episode reward: [(0, '35.206')] [2023-02-24 20:51:00,244][213352] Saving new best policy, reward=35.206! [2023-02-24 20:51:00,486][213365] Updated weights for policy 0, policy_version 29616 (0.0009) [2023-02-24 20:51:03,532][213365] Updated weights for policy 0, policy_version 29626 (0.0009) [2023-02-24 20:51:05,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 121368576. Throughput: 0: 3356.5. Samples: 5331742. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:51:05,243][213332] Avg episode reward: [(0, '35.206')] [2023-02-24 20:51:06,543][213365] Updated weights for policy 0, policy_version 29636 (0.0009) [2023-02-24 20:51:09,654][213365] Updated weights for policy 0, policy_version 29646 (0.0009) [2023-02-24 20:51:10,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13426.6). Total num frames: 121438208. Throughput: 0: 3354.3. Samples: 5351908. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:51:10,243][213332] Avg episode reward: [(0, '35.206')] [2023-02-24 20:51:12,647][213365] Updated weights for policy 0, policy_version 29656 (0.0009) [2023-02-24 20:51:12,949][213368] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 20:51:13,296][213367] DAMAGECOUNT value on done: 204313.0 [2023-02-24 20:51:13,297][213367] Sum rewards: 43.108, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.806', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.082', 'weapon5': '0.096', 'AMMO3': '0.175', 'WEAPON4': '0.350', 'weapon2': '0.452', 'weapon4': '0.828', 'WEAPON3': '1.100', 'weapon3': '2.388', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '10.710', 'FRAGCOUNT': '39.000'} [2023-02-24 20:51:13,619][213367] DAMAGECOUNT value on done: 204933.0 [2023-02-24 20:51:13,619][213367] Sum rewards: 52.767, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.880', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'weapon5': '0.188', 'weapon2': '0.202', 'AMMO3': '0.205', 'WEAPON4': '0.350', 'weapon4': '0.630', 'WEAPON3': '1.200', 'weapon3': '2.582', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.002', 'FRAGCOUNT': '48.000'} [2023-02-24 20:51:13,839][213372] DAMAGECOUNT value on done: 206306.0 [2023-02-24 20:51:13,839][213372] Sum rewards: 34.856, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.026', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon7': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.148', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'AMMO4': '0.225', 'weapon2': '0.268', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon4': '1.054', 'weapon3': '2.114', 'HITCOUNT': '2.220', 'DAMAGECOUNT': '9.339', 'FRAGCOUNT': '34.000'} [2023-02-24 20:51:14,026][213367] DAMAGECOUNT value on done: 210890.0 [2023-02-24 20:51:14,027][213367] Sum rewards: 45.199, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.534', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.030', 'AMMO3': '0.136', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'weapon5': '0.176', 'WEAPON4': '0.250', 'weapon4': '0.442', 'weapon2': '0.620', 'WEAPON3': '0.900', 'HITCOUNT': '2.430', 'weapon3': '2.554', 'DAMAGECOUNT': '10.881', 'FRAGCOUNT': '39.000'} [2023-02-24 20:51:14,156][213372] DAMAGECOUNT value on done: 210281.0 [2023-02-24 20:51:14,157][213372] Sum rewards: 35.312, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.920', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'WEAPON5': '0.100', 'weapon5': '0.232', 'weapon2': '0.248', 'AMMO3': '0.298', 'WEAPON3': '1.800', 'HITCOUNT': '2.530', 'weapon3': '3.250', 'DAMAGECOUNT': '11.634', 'FRAGCOUNT': '36.000'} [2023-02-24 20:51:14,171][213366] DAMAGECOUNT value on done: 201301.0 [2023-02-24 20:51:14,172][213366] Sum rewards: 41.157, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.618', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.096', 'weapon5': '0.100', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'weapon2': '0.588', 'WEAPON3': '1.300', 'HITCOUNT': '2.350', 'weapon3': '2.970', 'DAMAGECOUNT': '11.205', 'FRAGCOUNT': '39.000'} [2023-02-24 20:51:14,343][213367] DAMAGECOUNT value on done: 203412.0 [2023-02-24 20:51:14,344][213367] Sum rewards: 25.237, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.122', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon7': '0.074', 'AMMO3': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'weapon5': '0.294', 'WEAPON4': '0.350', 'weapon2': '0.408', 'WEAPON3': '0.450', 'weapon3': '1.110', 'weapon4': '1.432', 'HITCOUNT': '1.770', 'DAMAGECOUNT': '7.011', 'FRAGCOUNT': '20.000'} [2023-02-24 20:51:14,358][213372] DAMAGECOUNT value on done: 202313.0 [2023-02-24 20:51:14,358][213372] Sum rewards: 39.936, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.475', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.213', 'weapon5': '0.214', 'WEAPON5': '0.250', 'weapon4': '0.294', 'WEAPON4': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.300', 'HITCOUNT': '2.360', 'weapon3': '2.786', 'DAMAGECOUNT': '10.827', 'FRAGCOUNT': '39.000'} [2023-02-24 20:51:14,486][213366] DAMAGECOUNT value on done: 212375.0 [2023-02-24 20:51:14,486][213366] Sum rewards: 38.920, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon7': '0.046', 'AMMO3': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.108', 'HEALTH': '0.114', 'WEAPON5': '0.200', 'AMMO4': '0.209', 'weapon2': '0.468', 'WEAPON3': '0.500', 'WEAPON4': '0.550', 'weapon4': '1.058', 'weapon3': '2.068', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '10.602', 'FRAGCOUNT': '32.000'} [2023-02-24 20:51:14,501][213366] DAMAGECOUNT value on done: 208530.0 [2023-02-24 20:51:14,501][213366] Sum rewards: 36.734, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.640', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO3': '0.218', 'weapon2': '0.258', 'WEAPON3': '1.350', 'HITCOUNT': '2.370', 'weapon3': '3.606', 'DAMAGECOUNT': '10.335', 'FRAGCOUNT': '33.000'} [2023-02-24 20:51:14,672][213372] DAMAGECOUNT value on done: 199870.0 [2023-02-24 20:51:14,672][213372] Sum rewards: 47.824, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.650', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.084', 'weapon4': '0.100', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.630', 'WEAPON3': '1.250', 'HITCOUNT': '2.820', 'weapon3': '2.970', 'DAMAGECOUNT': '13.095', 'FRAGCOUNT': '42.000'} [2023-02-24 20:51:14,808][213366] DAMAGECOUNT value on done: 207310.0 [2023-02-24 20:51:14,809][213366] Sum rewards: 26.501, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.937', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.021', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'weapon2': '0.456', 'weapon4': '0.628', 'WEAPON3': '0.800', 'HITCOUNT': '1.760', 'weapon3': '2.188', 'DAMAGECOUNT': '7.728', 'FRAGCOUNT': '22.000'} [2023-02-24 20:51:14,821][213382] DAMAGECOUNT value on done: 200669.0 [2023-02-24 20:51:14,822][213382] Sum rewards: 27.718, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.640', 'AMMO5': '0.004', 'AMMO2': '0.017', 'weapon5': '0.054', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'AMMO3': '0.277', 'WEAPON4': '0.300', 'weapon4': '0.402', 'weapon2': '0.552', 'WEAPON3': '1.500', 'HITCOUNT': '2.350', 'weapon3': '2.802', 'DAMAGECOUNT': '9.918', 'FRAGCOUNT': '28.000'} [2023-02-24 20:51:14,827][213383] DAMAGECOUNT value on done: 204462.0 [2023-02-24 20:51:14,828][213383] Sum rewards: 33.782, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.400', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon7': '0.048', 'AMMO4': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO3': '0.205', 'weapon2': '0.208', 'weapon5': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '1.072', 'WEAPON3': '1.150', 'weapon3': '2.010', 'HITCOUNT': '2.370', 'DAMAGECOUNT': '9.903', 'FRAGCOUNT': '32.000'} [2023-02-24 20:51:14,929][213368] DAMAGECOUNT value on done: 201824.0 [2023-02-24 20:51:14,929][213368] Sum rewards: 40.970, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.840', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO4': '0.178', 'weapon2': '0.218', 'weapon4': '0.220', 'weapon5': '0.252', 'AMMO3': '0.284', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'HITCOUNT': '2.510', 'weapon3': '2.990', 'DAMAGECOUNT': '13.710', 'FRAGCOUNT': '40.000'} [2023-02-24 20:51:15,110][213382] DAMAGECOUNT value on done: 205487.0 [2023-02-24 20:51:15,110][213382] Sum rewards: 34.748, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.206', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon2': '0.174', 'AMMO4': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.242', 'AMMO3': '0.248', 'weapon4': '0.668', 'WEAPON3': '1.450', 'HITCOUNT': '2.360', 'weapon3': '2.632', 'DAMAGECOUNT': '10.548', 'FRAGCOUNT': '33.000'} [2023-02-24 20:51:15,124][213383] DAMAGECOUNT value on done: 206446.0 [2023-02-24 20:51:15,124][213383] Sum rewards: 15.419, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.064', 'weapon7': '0.064', 'AMMO4': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'weapon2': '0.188', 'HEALTH': '0.278', 'weapon4': '0.356', 'WEAPON3': '0.600', 'HITCOUNT': '0.970', 'weapon3': '2.044', 'DAMAGECOUNT': '3.648', 'FRAGCOUNT': '14.000'} [2023-02-24 20:51:15,218][213368] DAMAGECOUNT value on done: 206104.0 [2023-02-24 20:51:15,219][213368] Sum rewards: 30.710, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.635', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.041', 'weapon5': '0.142', 'AMMO3': '0.167', 'AMMO4': '0.202', 'WEAPON5': '0.400', 'weapon2': '0.442', 'WEAPON4': '0.450', 'weapon4': '0.524', 'WEAPON3': '1.100', 'HITCOUNT': '2.450', 'weapon3': '2.630', 'DAMAGECOUNT': '9.774', 'FRAGCOUNT': '28.500'} [2023-02-24 20:51:15,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 121503744. Throughput: 0: 3353.1. Samples: 5371906. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:51:15,243][213332] Avg episode reward: [(0, '35.185')] [2023-02-24 20:51:15,272][213369] DAMAGECOUNT value on done: 210033.0 [2023-02-24 20:51:15,273][213369] Sum rewards: 38.381, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.105', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.086', 'AMMO4': '0.090', 'AMMO3': '0.175', 'weapon4': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.214', 'WEAPON3': '1.100', 'HITCOUNT': '2.270', 'weapon3': '3.300', 'DAMAGECOUNT': '10.875', 'FRAGCOUNT': '33.000'} [2023-02-24 20:51:15,403][213382] DAMAGECOUNT value on done: 199168.0 [2023-02-24 20:51:15,404][213382] Sum rewards: 32.136, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.754', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.152', 'AMMO3': '0.177', 'AMMO4': '0.187', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.352', 'weapon2': '0.538', 'WEAPON3': '1.050', 'HITCOUNT': '2.120', 'weapon3': '2.724', 'DAMAGECOUNT': '9.495', 'FRAGCOUNT': '30.000'} [2023-02-24 20:51:15,513][213368] DAMAGECOUNT value on done: 209963.0 [2023-02-24 20:51:15,513][213368] Sum rewards: 33.058, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.705', 'AMMO5': '0.019', 'AMMO2': '0.056', 'weapon5': '0.154', 'AMMO3': '0.230', 'AMMO4': '0.280', 'weapon2': '0.282', 'WEAPON5': '0.400', 'WEAPON4': '0.750', 'weapon4': '0.876', 'WEAPON3': '1.400', 'weapon3': '2.294', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '10.842', 'FRAGCOUNT': '35.500'} [2023-02-24 20:51:15,550][213384] DAMAGECOUNT value on done: 208998.0 [2023-02-24 20:51:15,550][213384] Sum rewards: 40.521, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.305', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.050', 'weapon5': '0.100', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'AMMO4': '0.249', 'weapon2': '0.392', 'WEAPON4': '0.500', 'weapon4': '0.664', 'WEAPON3': '1.150', 'weapon3': '2.608', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '11.961', 'FRAGCOUNT': '37.000'} [2023-02-24 20:51:15,575][213369] DAMAGECOUNT value on done: 206318.0 [2023-02-24 20:51:15,576][213369] Sum rewards: 32.332, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.132', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.167', 'AMMO3': '0.187', 'WEAPON5': '0.250', 'weapon5': '0.320', 'weapon2': '0.338', 'WEAPON4': '0.350', 'weapon4': '0.638', 'WEAPON3': '1.150', 'weapon3': '2.386', 'HITCOUNT': '2.390', 'DAMAGECOUNT': '10.491', 'FRAGCOUNT': '30.000'} [2023-02-24 20:51:15,707][213383] DAMAGECOUNT value on done: 205038.0 [2023-02-24 20:51:15,708][213383] Sum rewards: 39.676, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.914', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.148', 'AMMO4': '0.156', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.370', 'weapon4': '0.552', 'WEAPON3': '1.350', 'HITCOUNT': '2.360', 'weapon3': '2.622', 'DAMAGECOUNT': '9.666', 'FRAGCOUNT': '38.000'} [2023-02-24 20:51:15,710][213382] DAMAGECOUNT value on done: 208119.0 [2023-02-24 20:51:15,710][213382] Sum rewards: 29.867, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.355', 'AMMO5': '0.007', 'AMMO2': '0.047', 'weapon5': '0.130', 'weapon4': '0.148', 'weapon2': '0.178', 'WEAPON5': '0.200', 'AMMO4': '0.236', 'AMMO3': '0.239', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.310', 'weapon3': '3.342', 'DAMAGECOUNT': '9.534', 'FRAGCOUNT': '31.000'} [2023-02-24 20:51:15,751][213365] Updated weights for policy 0, policy_version 29666 (0.0009) [2023-02-24 20:51:15,818][213368] DAMAGECOUNT value on done: 202049.0 [2023-02-24 20:51:15,818][213368] Sum rewards: 40.912, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.445', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'AMMO3': '0.183', 'weapon2': '0.212', 'WEAPON4': '0.350', 'weapon4': '0.352', 'WEAPON3': '1.050', 'HITCOUNT': '2.470', 'weapon3': '3.144', 'DAMAGECOUNT': '11.130', 'FRAGCOUNT': '38.000'} [2023-02-24 20:51:15,863][213384] DAMAGECOUNT value on done: 196227.0 [2023-02-24 20:51:15,863][213384] Sum rewards: 39.941, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.338', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon7': '0.046', 'WEAPON5': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.102', 'weapon5': '0.114', 'ARMOR': '0.400', 'weapon2': '0.548', 'WEAPON3': '0.600', 'HITCOUNT': '1.890', 'weapon3': '2.058', 'DAMAGECOUNT': '9.387', 'FRAGCOUNT': '30.000'} [2023-02-24 20:51:15,890][213369] DAMAGECOUNT value on done: 208754.0 [2023-02-24 20:51:15,891][213369] Sum rewards: 49.034, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.808', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.161', 'AMMO3': '0.191', 'weapon4': '0.246', 'WEAPON4': '0.300', 'weapon2': '0.648', 'WEAPON3': '1.100', 'weapon3': '2.844', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.425', 'FRAGCOUNT': '42.000'} [2023-02-24 20:51:16,003][213384] DAMAGECOUNT value on done: 209862.0 [2023-02-24 20:51:16,003][213384] Sum rewards: 41.521, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.052', 'AMMO5': '0.005', 'AMMO2': '0.050', 'WEAPON5': '0.150', 'weapon2': '0.180', 'weapon5': '0.186', 'AMMO3': '0.224', 'AMMO4': '0.252', 'WEAPON4': '0.400', 'weapon4': '0.528', 'WEAPON3': '1.300', 'HITCOUNT': '2.730', 'weapon3': '2.848', 'DAMAGECOUNT': '12.219', 'FRAGCOUNT': '39.000'} [2023-02-24 20:51:16,020][213383] DAMAGECOUNT value on done: 198290.0 [2023-02-24 20:51:16,021][213383] Sum rewards: 33.801, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.620', 'AMMO2': '0.012', 'AMMO4': '0.061', 'WEAPON4': '0.150', 'weapon4': '0.170', 'AMMO3': '0.264', 'weapon2': '0.470', 'WEAPON3': '1.650', 'HITCOUNT': '2.540', 'weapon3': '3.138', 'DAMAGECOUNT': '10.965', 'FRAGCOUNT': '33.000'} [2023-02-24 20:51:16,188][213369] DAMAGECOUNT value on done: 196355.0 [2023-02-24 20:51:16,189][213369] Sum rewards: 42.699, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.922', 'AMMO5': '0.020', 'AMMO2': '0.050', 'AMMO3': '0.184', 'AMMO4': '0.250', 'weapon2': '0.302', 'weapon5': '0.460', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'weapon4': '0.744', 'WEAPON3': '1.050', 'weapon3': '2.102', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '11.769', 'FRAGCOUNT': '39.000'} [2023-02-24 20:51:16,308][213384] DAMAGECOUNT value on done: 209425.0 [2023-02-24 20:51:16,308][213384] Sum rewards: 40.617, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.220', 'AMMO5': '0.007', 'AMMO2': '0.060', 'AMMO3': '0.145', 'weapon5': '0.166', 'WEAPON5': '0.200', 'AMMO4': '0.300', 'weapon2': '0.392', 'WEAPON4': '0.500', 'weapon4': '0.858', 'WEAPON3': '0.900', 'weapon3': '2.392', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '11.166', 'FRAGCOUNT': '36.000'} [2023-02-24 20:51:18,793][213365] Updated weights for policy 0, policy_version 29676 (0.0008) [2023-02-24 20:51:20,243][213332] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 121569280. Throughput: 0: 3351.5. Samples: 5382102. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:51:20,243][213332] Avg episode reward: [(0, '35.619')] [2023-02-24 20:51:20,244][213352] Saving new best policy, reward=35.619! [2023-02-24 20:51:21,819][213365] Updated weights for policy 0, policy_version 29686 (0.0009) [2023-02-24 20:51:24,911][213365] Updated weights for policy 0, policy_version 29696 (0.0009) [2023-02-24 20:51:25,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 121638912. Throughput: 0: 3354.9. Samples: 5402226. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:51:25,243][213332] Avg episode reward: [(0, '35.619')] [2023-02-24 20:51:27,909][213365] Updated weights for policy 0, policy_version 29706 (0.0009) [2023-02-24 20:51:30,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 121704448. Throughput: 0: 3356.8. Samples: 5422372. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:51:30,243][213332] Avg episode reward: [(0, '35.619')] [2023-02-24 20:51:30,965][213365] Updated weights for policy 0, policy_version 29716 (0.0009) [2023-02-24 20:51:33,250][213367] DAMAGECOUNT value on done: 208140.0 [2023-02-24 20:51:33,250][213367] Sum rewards: 40.551, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.668', 'AMMO5': '0.011', 'AMMO2': '0.038', 'AMMO3': '0.178', 'AMMO4': '0.192', 'weapon2': '0.262', 'weapon5': '0.328', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.556', 'WEAPON3': '1.100', 'HITCOUNT': '2.210', 'weapon3': '2.462', 'DAMAGECOUNT': '11.481', 'FRAGCOUNT': '36.000'} [2023-02-24 20:51:33,563][213367] DAMAGECOUNT value on done: 208308.0 [2023-02-24 20:51:33,564][213367] Sum rewards: 37.084, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.948', 'AMMO2': '0.004', 'AMMO5': '0.009', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'weapon7': '0.058', 'weapon4': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'weapon2': '0.324', 'WEAPON3': '1.400', 'HITCOUNT': '2.570', 'weapon3': '3.088', 'DAMAGECOUNT': '10.125', 'FRAGCOUNT': '34.000'} [2023-02-24 20:51:33,869][213372] DAMAGECOUNT value on done: 209716.0 [2023-02-24 20:51:33,869][213372] Sum rewards: 34.468, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.531', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.172', 'AMMO3': '0.173', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.450', 'weapon2': '0.514', 'weapon4': '0.922', 'WEAPON3': '1.100', 'weapon3': '2.140', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '10.230', 'FRAGCOUNT': '31.000'} [2023-02-24 20:51:33,936][213367] DAMAGECOUNT value on done: 213896.0 [2023-02-24 20:51:33,937][213367] Sum rewards: 35.896, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.515', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.067', 'AMMO3': '0.155', 'weapon2': '0.702', 'WEAPON3': '1.000', 'HITCOUNT': '2.200', 'weapon3': '3.250', 'DAMAGECOUNT': '9.018', 'FRAGCOUNT': '30.000'} [2023-02-24 20:51:34,012][213365] Updated weights for policy 0, policy_version 29726 (0.0009) [2023-02-24 20:51:34,167][213366] DAMAGECOUNT value on done: 205113.0 [2023-02-24 20:51:34,168][213366] Sum rewards: 38.659, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.860', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO3': '0.180', 'AMMO4': '0.191', 'weapon5': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON4': '0.350', 'weapon4': '0.514', 'WEAPON3': '1.100', 'HITCOUNT': '2.440', 'weapon3': '2.736', 'DAMAGECOUNT': '11.436', 'FRAGCOUNT': '35.000'} [2023-02-24 20:51:34,181][213372] DAMAGECOUNT value on done: 214667.0 [2023-02-24 20:51:34,181][213372] Sum rewards: 51.905, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.624', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO3': '0.134', 'weapon5': '0.140', 'AMMO4': '0.144', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.250', 'weapon4': '0.546', 'WEAPON3': '0.850', 'weapon3': '2.740', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.158', 'FRAGCOUNT': '41.000'} [2023-02-24 20:51:34,251][213367] DAMAGECOUNT value on done: 206904.0 [2023-02-24 20:51:34,252][213367] Sum rewards: 36.417, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.665', 'AMMO5': '0.006', 'AMMO2': '0.013', 'AMMO4': '0.065', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'weapon2': '0.234', 'weapon4': '0.294', 'weapon5': '0.404', 'WEAPON3': '0.950', 'HITCOUNT': '2.390', 'weapon3': '2.736', 'DAMAGECOUNT': '10.476', 'FRAGCOUNT': '29.000'} [2023-02-24 20:51:34,282][213372] DAMAGECOUNT value on done: 206007.0 [2023-02-24 20:51:34,283][213372] Sum rewards: 35.449, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.920', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.029', 'AMMO3': '0.135', 'AMMO4': '0.144', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon5': '0.636', 'weapon4': '0.756', 'WEAPON3': '0.800', 'weapon3': '1.844', 'HITCOUNT': '2.200', 'DAMAGECOUNT': '11.082', 'FRAGCOUNT': '29.500'} [2023-02-24 20:51:34,509][213366] DAMAGECOUNT value on done: 211705.0 [2023-02-24 20:51:34,510][213366] Sum rewards: 30.863, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.756', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.054', 'WEAPON5': '0.100', 'weapon4': '0.114', 'AMMO4': '0.118', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'WEAPON3': '0.850', 'weapon2': '0.968', 'HITCOUNT': '2.080', 'weapon3': '2.740', 'DAMAGECOUNT': '9.525', 'FRAGCOUNT': '26.000'} [2023-02-24 20:51:34,519][213366] DAMAGECOUNT value on done: 215420.0 [2023-02-24 20:51:34,519][213366] Sum rewards: 26.101, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.221', 'AMMO5': '0.005', 'AMMO2': '0.030', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'weapon5': '0.216', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'weapon2': '0.400', 'weapon4': '0.754', 'WEAPON3': '1.400', 'HITCOUNT': '2.190', 'weapon3': '2.400', 'DAMAGECOUNT': '9.135', 'FRAGCOUNT': '27.000'} [2023-02-24 20:51:34,633][213372] DAMAGECOUNT value on done: 202726.0 [2023-02-24 20:51:34,634][213372] Sum rewards: 29.868, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.236', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon5': '0.240', 'weapon2': '0.294', 'WEAPON4': '0.350', 'weapon4': '0.806', 'WEAPON3': '1.100', 'HITCOUNT': '2.110', 'weapon3': '2.410', 'DAMAGECOUNT': '8.568', 'FRAGCOUNT': '30.000'} [2023-02-24 20:51:34,801][213382] DAMAGECOUNT value on done: 204311.0 [2023-02-24 20:51:34,801][213382] Sum rewards: 30.522, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.138', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.030', 'AMMO4': '0.143', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.314', 'weapon4': '0.340', 'weapon2': '0.358', 'WEAPON3': '1.750', 'HITCOUNT': '2.790', 'weapon3': '3.022', 'DAMAGECOUNT': '10.926', 'FRAGCOUNT': '33.000'} [2023-02-24 20:51:34,818][213383] DAMAGECOUNT value on done: 207518.0 [2023-02-24 20:51:34,819][213383] Sum rewards: 35.272, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.460', 'AMMO5': '0.010', 'AMMO2': '0.047', 'AMMO3': '0.134', 'weapon5': '0.236', 'AMMO4': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.642', 'WEAPON3': '0.800', 'weapon4': '0.806', 'weapon3': '2.122', 'HITCOUNT': '2.180', 'DAMAGECOUNT': '9.168', 'FRAGCOUNT': '31.000'} [2023-02-24 20:51:34,829][213366] DAMAGECOUNT value on done: 211204.0 [2023-02-24 20:51:34,830][213366] Sum rewards: 38.702, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.345', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon5': '0.096', 'AMMO4': '0.161', 'AMMO3': '0.281', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.328', 'weapon2': '0.360', 'WEAPON3': '1.650', 'HITCOUNT': '2.610', 'weapon3': '2.978', 'DAMAGECOUNT': '11.682', 'FRAGCOUNT': '37.000'} [2023-02-24 20:51:34,875][213368] DAMAGECOUNT value on done: 205266.0 [2023-02-24 20:51:34,875][213368] Sum rewards: 35.783, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.465', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon7': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.151', 'AMMO4': '0.153', 'weapon2': '0.168', 'weapon5': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.488', 'WEAPON3': '0.950', 'HITCOUNT': '2.270', 'weapon3': '2.858', 'DAMAGECOUNT': '10.326', 'FRAGCOUNT': '30.000'} [2023-02-24 20:51:35,091][213382] DAMAGECOUNT value on done: 206726.0 [2023-02-24 20:51:35,091][213382] Sum rewards: 14.890, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon7': '0.052', 'AMMO3': '0.070', 'AMMO4': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HEALTH': '0.185', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'weapon2': '0.554', 'weapon4': '0.632', 'HITCOUNT': '0.950', 'weapon3': '1.276', 'DAMAGECOUNT': '3.717', 'FRAGCOUNT': '13.000'} [2023-02-24 20:51:35,127][213383] DAMAGECOUNT value on done: 209369.0 [2023-02-24 20:51:35,127][213383] Sum rewards: 28.307, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.805', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.171', 'WEAPON4': '0.250', 'weapon5': '0.284', 'WEAPON5': '0.400', 'weapon4': '0.448', 'weapon2': '0.454', 'WEAPON3': '1.000', 'HITCOUNT': '1.750', 'weapon3': '2.446', 'DAMAGECOUNT': '8.739', 'FRAGCOUNT': '26.000'} [2023-02-24 20:51:35,175][213368] DAMAGECOUNT value on done: 207747.0 [2023-02-24 20:51:35,176][213368] Sum rewards: 17.293, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.200', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.085', 'AMMO3': '0.087', 'weapon5': '0.108', 'weapon7': '0.120', 'WEAPON5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.372', 'WEAPON3': '0.500', 'weapon3': '0.866', 'HITCOUNT': '1.130', 'weapon4': '2.034', 'DAMAGECOUNT': '4.929', 'FRAGCOUNT': '13.000'} [2023-02-24 20:51:35,243][213332] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 121769984. Throughput: 0: 3359.6. Samples: 5432618. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:51:35,243][213332] Avg episode reward: [(0, '35.447')] [2023-02-24 20:51:35,283][213369] DAMAGECOUNT value on done: 212326.0 [2023-02-24 20:51:35,284][213369] Sum rewards: 23.599, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.364', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.019', 'weapon7': '0.048', 'AMMO4': '0.095', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.172', 'WEAPON7': '0.200', 'weapon5': '0.204', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.484', 'weapon4': '0.868', 'WEAPON3': '1.000', 'HITCOUNT': '1.590', 'weapon3': '1.888', 'DAMAGECOUNT': '6.879', 'FRAGCOUNT': '23.500'} [2023-02-24 20:51:35,396][213382] DAMAGECOUNT value on done: 202356.0 [2023-02-24 20:51:35,396][213382] Sum rewards: 29.751, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.014', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.069', 'AMMO3': '0.149', 'weapon2': '0.198', 'AMMO4': '0.346', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon5': '0.784', 'WEAPON3': '0.800', 'weapon4': '0.806', 'weapon3': '1.810', 'HITCOUNT': '2.060', 'DAMAGECOUNT': '9.564', 'FRAGCOUNT': '26.500'} [2023-02-24 20:51:35,464][213368] DAMAGECOUNT value on done: 213584.0 [2023-02-24 20:51:35,464][213368] Sum rewards: 40.465, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.094', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'weapon4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon5': '0.268', 'weapon2': '0.300', 'WEAPON3': '1.050', 'HITCOUNT': '2.320', 'weapon3': '3.046', 'DAMAGECOUNT': '10.761', 'FRAGCOUNT': '35.000'} [2023-02-24 20:51:35,553][213384] DAMAGECOUNT value on done: 213117.0 [2023-02-24 20:51:35,554][213384] Sum rewards: 47.586, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.303', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'weapon5': '0.150', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'weapon2': '0.374', 'weapon4': '0.380', 'WEAPON3': '1.000', 'HITCOUNT': '2.780', 'weapon3': '2.898', 'DAMAGECOUNT': '12.357', 'FRAGCOUNT': '40.000'} [2023-02-24 20:51:35,587][213369] DAMAGECOUNT value on done: 209138.0 [2023-02-24 20:51:35,588][213369] Sum rewards: 30.118, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'WEAPON5': '0.100', 'weapon4': '0.114', 'weapon5': '0.122', 'HEALTH': '0.128', 'AMMO3': '0.147', 'WEAPON3': '0.850', 'weapon2': '1.074', 'HITCOUNT': '2.100', 'weapon3': '2.400', 'DAMAGECOUNT': '8.460', 'FRAGCOUNT': '25.000'} [2023-02-24 20:51:35,696][213382] DAMAGECOUNT value on done: 211328.0 [2023-02-24 20:51:35,696][213382] Sum rewards: 37.283, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.566', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.135', 'weapon2': '0.176', 'AMMO3': '0.219', 'WEAPON4': '0.400', 'weapon4': '0.834', 'WEAPON3': '1.200', 'HITCOUNT': '2.210', 'weapon3': '2.666', 'DAMAGECOUNT': '9.627', 'FRAGCOUNT': '37.000'} [2023-02-24 20:51:35,715][213383] DAMAGECOUNT value on done: 208191.0 [2023-02-24 20:51:35,716][213383] Sum rewards: 32.931, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.810', 'AMMO2': '0.008', 'AMMO5': '0.011', 'AMMO4': '0.039', 'weapon4': '0.074', 'WEAPON4': '0.100', 'weapon2': '0.132', 'AMMO3': '0.197', 'weapon5': '0.286', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '2.220', 'weapon3': '3.332', 'DAMAGECOUNT': '8.991', 'FRAGCOUNT': '30.000'} [2023-02-24 20:51:35,764][213368] DAMAGECOUNT value on done: 204387.0 [2023-02-24 20:51:35,764][213368] Sum rewards: 22.136, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.590', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'weapon7': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.162', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.468', 'weapon4': '0.532', 'WEAPON3': '1.000', 'HITCOUNT': '1.540', 'weapon3': '2.272', 'DAMAGECOUNT': '7.014', 'FRAGCOUNT': '22.000'} [2023-02-24 20:51:35,847][213384] DAMAGECOUNT value on done: 198944.0 [2023-02-24 20:51:35,847][213384] Sum rewards: 24.018, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.600', 'AMMO5': '0.015', 'AMMO2': '0.052', 'AMMO3': '0.169', 'weapon2': '0.184', 'AMMO4': '0.261', 'weapon5': '0.392', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.770', 'WEAPON3': '0.950', 'HITCOUNT': '1.980', 'weapon3': '2.294', 'DAMAGECOUNT': '8.151', 'FRAGCOUNT': '23.000'} [2023-02-24 20:51:35,889][213369] DAMAGECOUNT value on done: 212171.0 [2023-02-24 20:51:35,890][213369] Sum rewards: 37.321, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.551', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.180', 'weapon5': '0.288', 'WEAPON5': '0.350', 'weapon2': '0.370', 'WEAPON4': '0.400', 'weapon4': '0.634', 'WEAPON3': '1.050', 'HITCOUNT': '2.320', 'weapon3': '2.366', 'DAMAGECOUNT': '10.251', 'FRAGCOUNT': '34.000'} [2023-02-24 20:51:36,008][213384] DAMAGECOUNT value on done: 213289.0 [2023-02-24 20:51:36,008][213384] Sum rewards: 35.642, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.808', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon2': '0.154', 'AMMO4': '0.170', 'weapon5': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon4': '0.398', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.410', 'weapon3': '3.010', 'DAMAGECOUNT': '10.281', 'FRAGCOUNT': '34.000'} [2023-02-24 20:51:36,015][213383] DAMAGECOUNT value on done: 201583.0 [2023-02-24 20:51:36,016][213383] Sum rewards: 36.181, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.370', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon2': '0.144', 'AMMO3': '0.177', 'AMMO4': '0.189', 'weapon5': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.398', 'WEAPON3': '1.050', 'HITCOUNT': '2.300', 'weapon3': '2.828', 'DAMAGECOUNT': '9.879', 'FRAGCOUNT': '33.000'} [2023-02-24 20:51:36,188][213369] DAMAGECOUNT value on done: 199409.0 [2023-02-24 20:51:36,188][213369] Sum rewards: 31.083, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.919', 'AMMO5': '0.020', 'AMMO2': '0.061', 'AMMO3': '0.118', 'weapon2': '0.252', 'AMMO4': '0.306', 'weapon5': '0.428', 'WEAPON5': '0.500', 'weapon4': '0.562', 'WEAPON4': '0.600', 'WEAPON3': '0.600', 'HITCOUNT': '2.010', 'weapon3': '2.382', 'DAMAGECOUNT': '9.162', 'FRAGCOUNT': '27.000'} [2023-02-24 20:51:36,300][213384] DAMAGECOUNT value on done: 213300.0 [2023-02-24 20:51:36,300][213384] Sum rewards: 41.070, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.640', 'ARMOR': '0.005', 'AMMO2': '0.010', 'AMMO5': '0.016', 'weapon4': '0.018', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'weapon2': '0.128', 'AMMO3': '0.234', 'WEAPON5': '0.350', 'weapon5': '0.524', 'WEAPON3': '1.300', 'HITCOUNT': '2.580', 'weapon3': '3.020', 'DAMAGECOUNT': '11.625', 'FRAGCOUNT': '36.000'} [2023-02-24 20:51:37,035][213365] Updated weights for policy 0, policy_version 29736 (0.0009) [2023-02-24 20:51:40,100][213365] Updated weights for policy 0, policy_version 29746 (0.0009) [2023-02-24 20:51:40,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 121839616. Throughput: 0: 3358.4. Samples: 5452758. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:51:40,243][213332] Avg episode reward: [(0, '35.165')] [2023-02-24 20:51:43,113][213365] Updated weights for policy 0, policy_version 29756 (0.0010) [2023-02-24 20:51:45,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 121905152. Throughput: 0: 3364.8. Samples: 5472966. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:51:45,243][213332] Avg episode reward: [(0, '35.165')] [2023-02-24 20:51:46,123][213365] Updated weights for policy 0, policy_version 29766 (0.0009) [2023-02-24 20:51:49,203][213365] Updated weights for policy 0, policy_version 29776 (0.0009) [2023-02-24 20:51:50,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 121974784. Throughput: 0: 3366.3. Samples: 5483224. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:51:50,243][213332] Avg episode reward: [(0, '35.165')] [2023-02-24 20:51:52,185][213365] Updated weights for policy 0, policy_version 29786 (0.0009) [2023-02-24 20:51:53,172][213367] DAMAGECOUNT value on done: 210511.0 [2023-02-24 20:51:53,172][213367] Sum rewards: 27.227, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.341', 'AMMO5': '0.004', 'AMMO2': '0.042', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.149', 'WEAPON4': '0.200', 'AMMO4': '0.212', 'ARMOR': '0.404', 'weapon4': '0.680', 'WEAPON3': '0.800', 'weapon2': '1.012', 'HITCOUNT': '1.640', 'weapon3': '1.914', 'DAMAGECOUNT': '7.113', 'FRAGCOUNT': '23.000'} [2023-02-24 20:51:53,492][213367] DAMAGECOUNT value on done: 210304.0 [2023-02-24 20:51:53,492][213367] Sum rewards: 18.264, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.040', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.032', 'weapon7': '0.054', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.360', 'weapon4': '0.596', 'WEAPON3': '0.700', 'HITCOUNT': '1.320', 'weapon3': '1.436', 'DAMAGECOUNT': '5.988', 'FRAGCOUNT': '17.000'} [2023-02-24 20:51:53,846][213372] DAMAGECOUNT value on done: 213721.0 [2023-02-24 20:51:53,847][213372] Sum rewards: 46.079, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.850', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon2': '0.172', 'weapon5': '0.190', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.300', 'WEAPON3': '1.100', 'HITCOUNT': '2.860', 'weapon3': '3.054', 'DAMAGECOUNT': '11.985', 'FRAGCOUNT': '40.000'} [2023-02-24 20:51:53,859][213367] DAMAGECOUNT value on done: 216804.0 [2023-02-24 20:51:53,859][213367] Sum rewards: 32.365, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.815', 'AMMO2': '0.013', 'AMMO5': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.062', 'weapon4': '0.190', 'AMMO3': '0.213', 'WEAPON5': '0.300', 'weapon2': '0.420', 'weapon5': '0.454', 'WEAPON3': '1.250', 'HITCOUNT': '2.060', 'weapon3': '2.696', 'DAMAGECOUNT': '8.709', 'FRAGCOUNT': '30.000'} [2023-02-24 20:51:54,166][213372] DAMAGECOUNT value on done: 217901.0 [2023-02-24 20:51:54,166][213372] Sum rewards: 35.257, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.196', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.030', 'weapon4': '0.146', 'AMMO4': '0.149', 'AMMO3': '0.194', 'weapon5': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'weapon2': '0.586', 'WEAPON3': '1.100', 'HITCOUNT': '2.330', 'weapon3': '2.748', 'DAMAGECOUNT': '9.702', 'FRAGCOUNT': '32.000'} [2023-02-24 20:51:54,167][213366] DAMAGECOUNT value on done: 208250.0 [2023-02-24 20:51:54,168][213366] Sum rewards: 33.558, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.149', 'ARMOR': '0.008', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.048', 'AMMO3': '0.087', 'AMMO4': '0.238', 'weapon5': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.330', 'WEAPON3': '0.550', 'weapon4': '0.774', 'weapon3': '2.004', 'HITCOUNT': '2.190', 'DAMAGECOUNT': '9.411', 'FRAGCOUNT': '27.000'} [2023-02-24 20:51:54,173][213367] DAMAGECOUNT value on done: 209410.0 [2023-02-24 20:51:54,173][213367] Sum rewards: 20.766, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.048', 'AMMO5': '0.007', 'AMMO2': '0.008', 'weapon4': '0.020', 'AMMO4': '0.039', 'weapon5': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.456', 'WEAPON3': '1.450', 'HITCOUNT': '1.920', 'weapon3': '3.294', 'DAMAGECOUNT': '7.518', 'FRAGCOUNT': '22.000'} [2023-02-24 20:51:54,245][213372] DAMAGECOUNT value on done: 209101.0 [2023-02-24 20:51:54,245][213372] Sum rewards: 37.443, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.962', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO3': '0.159', 'weapon2': '0.914', 'WEAPON3': '1.000', 'HITCOUNT': '2.310', 'weapon3': '2.488', 'DAMAGECOUNT': '9.282', 'FRAGCOUNT': '32.000'} [2023-02-24 20:51:54,481][213366] DAMAGECOUNT value on done: 214597.0 [2023-02-24 20:51:54,481][213366] Sum rewards: 31.759, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.580', 'AMMO5': '0.018', 'AMMO2': '0.038', 'AMMO3': '0.130', 'AMMO4': '0.192', 'weapon2': '0.288', 'weapon4': '0.294', 'weapon5': '0.380', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'HITCOUNT': '2.010', 'weapon3': '2.812', 'DAMAGECOUNT': '8.676', 'FRAGCOUNT': '28.000'} [2023-02-24 20:51:54,491][213366] DAMAGECOUNT value on done: 218574.0 [2023-02-24 20:51:54,491][213366] Sum rewards: 34.390, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.760', 'AMMO5': '0.008', 'AMMO2': '0.028', 'AMMO3': '0.092', 'AMMO4': '0.142', 'weapon5': '0.168', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.478', 'WEAPON3': '0.550', 'weapon4': '0.784', 'HITCOUNT': '2.390', 'weapon3': '2.398', 'DAMAGECOUNT': '9.462', 'FRAGCOUNT': '27.000'} [2023-02-24 20:51:54,565][213372] DAMAGECOUNT value on done: 205646.0 [2023-02-24 20:51:54,565][213372] Sum rewards: 32.821, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.785', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.010', 'weapon5': '0.040', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'weapon4': '0.322', 'weapon2': '0.694', 'WEAPON3': '1.150', 'HITCOUNT': '2.210', 'weapon3': '2.784', 'DAMAGECOUNT': '8.760', 'FRAGCOUNT': '29.000'} [2023-02-24 20:51:54,769][213368] DAMAGECOUNT value on done: 208506.0 [2023-02-24 20:51:54,769][213368] Sum rewards: 32.361, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.032', 'ARMOR': '0.004', 'AMMO5': '0.028', 'AMMO2': '0.049', 'AMMO3': '0.120', 'AMMO4': '0.244', 'weapon5': '0.300', 'weapon2': '0.312', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '0.750', 'weapon4': '0.834', 'weapon3': '2.142', 'HITCOUNT': '2.340', 'DAMAGECOUNT': '9.720', 'FRAGCOUNT': '29.000'} [2023-02-24 20:51:54,799][213366] DAMAGECOUNT value on done: 214904.0 [2023-02-24 20:51:54,800][213366] Sum rewards: 34.068, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.724', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO3': '0.194', 'AMMO4': '0.195', 'weapon5': '0.292', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.514', 'weapon4': '0.552', 'WEAPON3': '1.200', 'weapon3': '2.276', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '11.100', 'FRAGCOUNT': '31.000'} [2023-02-24 20:51:54,809][213382] DAMAGECOUNT value on done: 207658.0 [2023-02-24 20:51:54,809][213382] Sum rewards: 37.045, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.202', 'ARMOR': '0.012', 'AMMO5': '0.014', 'AMMO2': '0.026', 'weapon7': '0.074', 'weapon5': '0.086', 'weapon4': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.129', 'AMMO3': '0.155', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '0.950', 'weapon2': '1.012', 'HITCOUNT': '2.300', 'weapon3': '2.306', 'DAMAGECOUNT': '10.041', 'FRAGCOUNT': '33.000'} [2023-02-24 20:51:54,827][213383] DAMAGECOUNT value on done: 210943.0 [2023-02-24 20:51:54,827][213383] Sum rewards: 31.925, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.942', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.094', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon5': '0.258', 'WEAPON5': '0.300', 'weapon2': '0.434', 'weapon4': '0.470', 'WEAPON3': '1.100', 'HITCOUNT': '2.490', 'weapon3': '2.544', 'DAMAGECOUNT': '10.275', 'FRAGCOUNT': '29.000'} [2023-02-24 20:51:55,080][213368] DAMAGECOUNT value on done: 211297.0 [2023-02-24 20:51:55,080][213368] Sum rewards: 37.924, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.166', 'AMMO5': '0.013', 'weapon5': '0.024', 'AMMO2': '0.024', 'AMMO4': '0.121', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'weapon4': '0.320', 'weapon2': '0.330', 'WEAPON3': '1.250', 'HITCOUNT': '2.680', 'weapon3': '3.004', 'DAMAGECOUNT': '10.650', 'FRAGCOUNT': '35.000'} [2023-02-24 20:51:55,115][213382] DAMAGECOUNT value on done: 210678.0 [2023-02-24 20:51:55,116][213382] Sum rewards: 49.008, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.690', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.042', 'WEAPON5': '0.100', 'weapon5': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.172', 'weapon4': '0.250', 'weapon2': '0.354', 'WEAPON3': '1.000', 'HITCOUNT': '2.870', 'weapon3': '3.008', 'DAMAGECOUNT': '11.856', 'FRAGCOUNT': '41.000'} [2023-02-24 20:51:55,140][213383] DAMAGECOUNT value on done: 212190.0 [2023-02-24 20:51:55,141][213383] Sum rewards: 26.911, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.400', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon5': '0.292', 'WEAPON5': '0.300', 'weapon4': '0.316', 'weapon2': '0.696', 'WEAPON3': '1.050', 'HITCOUNT': '2.030', 'weapon3': '2.416', 'DAMAGECOUNT': '8.463', 'FRAGCOUNT': '23.000'} [2023-02-24 20:51:55,240][213369] DAMAGECOUNT value on done: 215496.0 [2023-02-24 20:51:55,241][213369] Sum rewards: 34.385, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.641', 'AMMO5': '0.025', 'AMMO2': '0.026', 'weapon4': '0.048', 'AMMO4': '0.131', 'AMMO3': '0.176', 'WEAPON4': '0.300', 'weapon5': '0.336', 'WEAPON5': '0.550', 'weapon2': '0.764', 'WEAPON3': '1.150', 'HITCOUNT': '2.270', 'weapon3': '2.490', 'DAMAGECOUNT': '9.510', 'FRAGCOUNT': '32.000'} [2023-02-24 20:51:55,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 122040320. Throughput: 0: 3363.5. Samples: 5503264. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:51:55,243][213332] Avg episode reward: [(0, '35.082')] [2023-02-24 20:51:55,325][213365] Updated weights for policy 0, policy_version 29796 (0.0009) [2023-02-24 20:51:55,381][213368] DAMAGECOUNT value on done: 214973.0 [2023-02-24 20:51:55,382][213368] Sum rewards: 10.263, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.495', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon7': '0.048', 'AMMO3': '0.075', 'AMMO4': '0.094', 'weapon5': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon2': '0.212', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'weapon4': '0.684', 'HITCOUNT': '0.840', 'weapon3': '0.866', 'DAMAGECOUNT': '4.167', 'FRAGCOUNT': '10.000'} [2023-02-24 20:51:55,419][213382] DAMAGECOUNT value on done: 206104.0 [2023-02-24 20:51:55,419][213382] Sum rewards: 41.222, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.633', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.096', 'AMMO4': '0.162', 'weapon5': '0.188', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'WEAPON5': '0.300', 'weapon2': '0.498', 'WEAPON3': '1.300', 'HITCOUNT': '2.410', 'weapon3': '2.960', 'DAMAGECOUNT': '11.244', 'FRAGCOUNT': '37.000'} [2023-02-24 20:51:55,499][213384] DAMAGECOUNT value on done: 217295.0 [2023-02-24 20:51:55,500][213384] Sum rewards: 46.480, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.970', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.191', 'weapon5': '0.222', 'weapon4': '0.272', 'weapon2': '0.546', 'WEAPON3': '1.200', 'weapon3': '2.724', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.534', 'FRAGCOUNT': '39.000'} [2023-02-24 20:51:55,546][213369] DAMAGECOUNT value on done: 212955.0 [2023-02-24 20:51:55,546][213369] Sum rewards: 31.381, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.832', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon7': '0.048', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.174', 'weapon2': '0.184', 'WEAPON7': '0.200', 'AMMO4': '0.237', 'weapon5': '0.252', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.544', 'WEAPON3': '1.050', 'HITCOUNT': '2.230', 'weapon3': '2.390', 'DAMAGECOUNT': '11.451', 'FRAGCOUNT': '27.500'} [2023-02-24 20:51:55,681][213368] DAMAGECOUNT value on done: 208063.0 [2023-02-24 20:51:55,682][213368] Sum rewards: 41.281, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.110', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO3': '0.149', 'weapon5': '0.190', 'AMMO4': '0.195', 'weapon2': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon4': '0.600', 'WEAPON3': '0.850', 'weapon3': '2.674', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '11.028', 'FRAGCOUNT': '36.000'} [2023-02-24 20:51:55,721][213382] DAMAGECOUNT value on done: 214815.0 [2023-02-24 20:51:55,721][213382] Sum rewards: 39.983, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.646', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.153', 'weapon5': '0.206', 'weapon2': '0.266', 'WEAPON4': '0.350', 'weapon4': '0.940', 'WEAPON3': '1.000', 'weapon3': '2.270', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '10.461', 'FRAGCOUNT': '36.000'} [2023-02-24 20:51:55,735][213383] DAMAGECOUNT value on done: 211683.0 [2023-02-24 20:51:55,736][213383] Sum rewards: 33.590, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.060', 'AMMO2': '0.004', 'AMMO5': '0.014', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'weapon4': '0.090', 'AMMO3': '0.159', 'weapon2': '0.288', 'WEAPON5': '0.350', 'weapon5': '0.424', 'WEAPON3': '0.950', 'HITCOUNT': '2.370', 'weapon3': '2.704', 'DAMAGECOUNT': '10.476', 'FRAGCOUNT': '26.500'} [2023-02-24 20:51:55,805][213384] DAMAGECOUNT value on done: 201721.0 [2023-02-24 20:51:55,806][213384] Sum rewards: 24.877, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.516', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon5': '0.122', 'AMMO4': '0.169', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.426', 'weapon4': '0.732', 'WEAPON3': '1.300', 'HITCOUNT': '1.980', 'weapon3': '2.346', 'DAMAGECOUNT': '8.304', 'FRAGCOUNT': '27.000'} [2023-02-24 20:51:55,845][213369] DAMAGECOUNT value on done: 215973.0 [2023-02-24 20:51:55,846][213369] Sum rewards: 31.763, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.870', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon5': '0.090', 'weapon4': '0.112', 'AMMO4': '0.131', 'AMMO3': '0.300', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.524', 'WEAPON3': '1.800', 'HITCOUNT': '2.530', 'weapon3': '2.998', 'DAMAGECOUNT': '11.259', 'FRAGCOUNT': '34.000'} [2023-02-24 20:51:55,988][213384] DAMAGECOUNT value on done: 216491.0 [2023-02-24 20:51:55,989][213384] Sum rewards: 26.863, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.360', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.154', 'AMMO4': '0.163', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.380', 'weapon2': '0.486', 'WEAPON3': '1.250', 'HITCOUNT': '2.360', 'weapon3': '2.718', 'DAMAGECOUNT': '9.606', 'FRAGCOUNT': '27.000'} [2023-02-24 20:51:56,035][213383] DAMAGECOUNT value on done: 204985.0 [2023-02-24 20:51:56,036][213383] Sum rewards: 34.525, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.817', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO3': '0.161', 'AMMO4': '0.168', 'WEAPON4': '0.300', 'weapon4': '0.330', 'WEAPON5': '0.350', 'weapon2': '0.356', 'weapon5': '0.374', 'WEAPON3': '1.000', 'HITCOUNT': '2.380', 'weapon3': '2.666', 'DAMAGECOUNT': '10.206', 'FRAGCOUNT': '30.000'} [2023-02-24 20:51:56,141][213369] DAMAGECOUNT value on done: 202763.0 [2023-02-24 20:51:56,141][213369] Sum rewards: 33.191, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.002', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.131', 'weapon5': '0.180', 'weapon4': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '0.750', 'weapon2': '1.002', 'weapon3': '2.158', 'HITCOUNT': '2.270', 'DAMAGECOUNT': '10.062', 'FRAGCOUNT': '28.000'} [2023-02-24 20:51:56,287][213384] DAMAGECOUNT value on done: 216508.0 [2023-02-24 20:51:56,288][213384] Sum rewards: 31.199, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.595', 'AMMO5': '0.011', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon4': '0.108', 'weapon5': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON3': '1.250', 'HITCOUNT': '2.290', 'weapon3': '3.244', 'DAMAGECOUNT': '9.264', 'FRAGCOUNT': '29.000'} [2023-02-24 20:51:58,326][213365] Updated weights for policy 0, policy_version 29806 (0.0009) [2023-02-24 20:52:00,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13426.6). Total num frames: 122109952. Throughput: 0: 3364.5. Samples: 5523310. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 20:52:00,243][213332] Avg episode reward: [(0, '34.319')] [2023-02-24 20:52:01,362][213365] Updated weights for policy 0, policy_version 29816 (0.0009) [2023-02-24 20:52:04,429][213365] Updated weights for policy 0, policy_version 29826 (0.0009) [2023-02-24 20:52:05,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 122175488. Throughput: 0: 3365.4. Samples: 5533544. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:52:05,244][213332] Avg episode reward: [(0, '34.319')] [2023-02-24 20:52:07,433][213365] Updated weights for policy 0, policy_version 29836 (0.0009) [2023-02-24 20:52:10,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13426.6). Total num frames: 122245120. Throughput: 0: 3365.2. Samples: 5553660. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:52:10,243][213332] Avg episode reward: [(0, '34.319')] [2023-02-24 20:52:10,480][213365] Updated weights for policy 0, policy_version 29846 (0.0009) [2023-02-24 20:52:13,204][213367] DAMAGECOUNT value on done: 213768.0 [2023-02-24 20:52:13,205][213367] Sum rewards: 32.013, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.050', 'AMMO5': '0.014', 'AMMO2': '0.043', 'AMMO3': '0.194', 'AMMO4': '0.216', 'weapon2': '0.254', 'weapon5': '0.356', 'WEAPON5': '0.400', 'weapon4': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.160', 'weapon3': '2.604', 'DAMAGECOUNT': '9.771', 'FRAGCOUNT': '31.000'} [2023-02-24 20:52:13,496][213365] Updated weights for policy 0, policy_version 29856 (0.0009) [2023-02-24 20:52:13,532][213367] DAMAGECOUNT value on done: 214981.0 [2023-02-24 20:52:13,533][213367] Sum rewards: 47.372, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.042', 'AMMO5': '0.016', 'AMMO2': '0.035', 'AMMO3': '0.167', 'AMMO4': '0.173', 'weapon2': '0.210', 'weapon5': '0.302', 'WEAPON4': '0.350', 'weapon4': '0.416', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.754', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.031', 'FRAGCOUNT': '40.000'} [2023-02-24 20:52:13,844][213372] DAMAGECOUNT value on done: 216666.0 [2023-02-24 20:52:13,845][213372] Sum rewards: 29.390, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.568', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO4': '0.149', 'AMMO3': '0.177', 'weapon4': '0.208', 'weapon5': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.620', 'WEAPON3': '1.050', 'HITCOUNT': '1.840', 'weapon3': '2.404', 'DAMAGECOUNT': '8.835', 'FRAGCOUNT': '29.000'} [2023-02-24 20:52:13,887][213367] DAMAGECOUNT value on done: 221351.0 [2023-02-24 20:52:13,887][213367] Sum rewards: 50.726, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.220', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.048', 'AMMO3': '0.190', 'AMMO4': '0.238', 'weapon5': '0.272', 'weapon2': '0.302', 'weapon4': '0.330', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.840', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.641', 'FRAGCOUNT': '46.000'} [2023-02-24 20:52:14,053][213366] DAMAGECOUNT value on done: 211812.0 [2023-02-24 20:52:14,054][213366] Sum rewards: 39.783, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.140', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon2': '0.192', 'WEAPON4': '0.250', 'AMMO3': '0.257', 'weapon4': '0.648', 'WEAPON3': '1.500', 'HITCOUNT': '2.620', 'weapon3': '2.932', 'DAMAGECOUNT': '10.686', 'FRAGCOUNT': '40.000'} [2023-02-24 20:52:14,160][213372] DAMAGECOUNT value on done: 221212.0 [2023-02-24 20:52:14,161][213372] Sum rewards: 32.183, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.810', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'weapon2': '0.224', 'WEAPON4': '0.250', 'AMMO3': '0.272', 'weapon4': '0.530', 'WEAPON3': '1.550', 'HITCOUNT': '2.430', 'weapon3': '2.856', 'DAMAGECOUNT': '9.933', 'FRAGCOUNT': '33.000'} [2023-02-24 20:52:14,189][213367] DAMAGECOUNT value on done: 212625.0 [2023-02-24 20:52:14,190][213367] Sum rewards: 32.938, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.010', 'AMMO2': '0.055', 'AMMO3': '0.090', 'weapon5': '0.122', 'HEALTH': '0.150', 'WEAPON5': '0.200', 'AMMO4': '0.274', 'WEAPON4': '0.350', 'WEAPON3': '0.550', 'weapon4': '0.926', 'weapon2': '0.988', 'weapon3': '1.718', 'HITCOUNT': '2.360', 'DAMAGECOUNT': '9.645', 'FRAGCOUNT': '26.000'} [2023-02-24 20:52:14,240][213372] DAMAGECOUNT value on done: 212478.0 [2023-02-24 20:52:14,240][213372] Sum rewards: 30.053, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.276', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.142', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'weapon2': '0.174', 'AMMO3': '0.197', 'WEAPON4': '0.300', 'weapon4': '0.630', 'WEAPON3': '1.150', 'HITCOUNT': '2.690', 'weapon3': '2.824', 'DAMAGECOUNT': '10.131', 'FRAGCOUNT': '27.000'} [2023-02-24 20:52:14,354][213366] DAMAGECOUNT value on done: 218404.0 [2023-02-24 20:52:14,355][213366] Sum rewards: 39.620, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.158', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.066', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.256', 'WEAPON4': '0.350', 'weapon4': '0.792', 'WEAPON3': '1.250', 'weapon3': '2.388', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '11.421', 'FRAGCOUNT': '37.000'} [2023-02-24 20:52:14,384][213366] DAMAGECOUNT value on done: 222036.0 [2023-02-24 20:52:14,384][213366] Sum rewards: 35.762, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.632', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.098', 'AMMO3': '0.168', 'weapon5': '0.196', 'weapon4': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.678', 'WEAPON3': '1.150', 'HITCOUNT': '2.330', 'weapon3': '2.634', 'DAMAGECOUNT': '10.386', 'FRAGCOUNT': '32.000'} [2023-02-24 20:52:14,551][213372] DAMAGECOUNT value on done: 209509.0 [2023-02-24 20:52:14,552][213372] Sum rewards: 35.573, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.390', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon4': '0.140', 'weapon5': '0.150', 'AMMO3': '0.176', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.770', 'WEAPON3': '1.150', 'HITCOUNT': '2.460', 'weapon3': '2.694', 'DAMAGECOUNT': '11.169', 'FRAGCOUNT': '33.000'} [2023-02-24 20:52:14,671][213366] DAMAGECOUNT value on done: 218327.0 [2023-02-24 20:52:14,672][213366] Sum rewards: 34.316, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.842', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.116', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon5': '0.232', 'weapon2': '0.274', 'weapon4': '0.514', 'WEAPON3': '1.300', 'HITCOUNT': '2.300', 'weapon3': '2.748', 'DAMAGECOUNT': '10.269', 'FRAGCOUNT': '32.000'} [2023-02-24 20:52:14,741][213368] DAMAGECOUNT value on done: 212045.0 [2023-02-24 20:52:14,742][213368] Sum rewards: 29.398, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.124', 'AMMO5': '0.022', 'AMMO2': '0.066', 'AMMO3': '0.168', 'weapon5': '0.206', 'AMMO4': '0.331', 'weapon2': '0.342', 'ARMOR': '0.442', 'WEAPON5': '0.500', 'WEAPON4': '0.900', 'WEAPON3': '1.000', 'weapon4': '1.218', 'weapon3': '1.694', 'HITCOUNT': '2.310', 'DAMAGECOUNT': '10.572', 'FRAGCOUNT': '30.000'} [2023-02-24 20:52:14,830][213383] DAMAGECOUNT value on done: 214387.0 [2023-02-24 20:52:14,830][213383] Sum rewards: 34.961, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.370', 'AMMO5': '0.011', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.190', 'AMMO3': '0.217', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.388', 'weapon4': '0.564', 'WEAPON3': '1.350', 'HITCOUNT': '2.400', 'weapon3': '2.614', 'DAMAGECOUNT': '10.332', 'FRAGCOUNT': '33.000'} [2023-02-24 20:52:14,834][213382] DAMAGECOUNT value on done: 211337.0 [2023-02-24 20:52:14,834][213382] Sum rewards: 35.360, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.594', 'AMMO5': '0.011', 'AMMO2': '0.031', 'AMMO4': '0.155', 'AMMO3': '0.180', 'weapon5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.358', 'WEAPON5': '0.400', 'weapon2': '0.482', 'WEAPON3': '1.100', 'HITCOUNT': '2.520', 'weapon3': '2.630', 'DAMAGECOUNT': '11.037', 'FRAGCOUNT': '31.000'} [2023-02-24 20:52:15,048][213368] DAMAGECOUNT value on done: 214870.0 [2023-02-24 20:52:15,049][213368] Sum rewards: 31.042, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.380', 'AMMO5': '0.006', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon4': '0.216', 'weapon2': '0.708', 'WEAPON3': '1.300', 'HITCOUNT': '2.470', 'weapon3': '2.676', 'DAMAGECOUNT': '10.719', 'FRAGCOUNT': '29.500'} [2023-02-24 20:52:15,134][213383] DAMAGECOUNT value on done: 216466.0 [2023-02-24 20:52:15,134][213383] Sum rewards: 42.680, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.215', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.160', 'weapon5': '0.244', 'weapon2': '0.298', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '0.900', 'weapon4': '1.038', 'weapon3': '2.156', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.759', 'FRAGCOUNT': '36.000'} [2023-02-24 20:52:15,137][213382] DAMAGECOUNT value on done: 214564.0 [2023-02-24 20:52:15,138][213382] Sum rewards: 40.114, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.600', 'AMMO5': '0.025', 'AMMO2': '0.060', 'AMMO3': '0.138', 'AMMO4': '0.300', 'weapon5': '0.330', 'weapon2': '0.448', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'weapon4': '0.772', 'WEAPON3': '0.850', 'weapon3': '2.112', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '11.658', 'FRAGCOUNT': '37.000'} [2023-02-24 20:52:15,212][213369] DAMAGECOUNT value on done: 219234.0 [2023-02-24 20:52:15,212][213369] Sum rewards: 40.180, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.934', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.026', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'weapon5': '0.192', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon2': '0.374', 'weapon4': '0.476', 'WEAPON3': '1.200', 'HITCOUNT': '2.400', 'weapon3': '2.736', 'DAMAGECOUNT': '11.214', 'FRAGCOUNT': '36.000'} [2023-02-24 20:52:15,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 122310656. Throughput: 0: 3363.5. Samples: 5573728. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:52:15,243][213332] Avg episode reward: [(0, '34.362')] [2023-02-24 20:52:15,357][213368] DAMAGECOUNT value on done: 219414.0 [2023-02-24 20:52:15,357][213368] Sum rewards: 48.833, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.690', 'AMMO5': '0.021', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon4': '0.180', 'AMMO3': '0.224', 'WEAPON4': '0.350', 'weapon2': '0.452', 'weapon5': '0.456', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.578', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '13.323', 'FRAGCOUNT': '45.000'} [2023-02-24 20:52:15,437][213382] DAMAGECOUNT value on done: 210144.0 [2023-02-24 20:52:15,437][213382] Sum rewards: 45.857, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.825', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.134', 'AMMO4': '0.152', 'AMMO3': '0.195', 'WEAPON5': '0.300', 'weapon4': '0.304', 'WEAPON4': '0.350', 'weapon2': '0.394', 'WEAPON3': '1.250', 'HITCOUNT': '2.780', 'weapon3': '2.910', 'DAMAGECOUNT': '12.120', 'FRAGCOUNT': '42.000'} [2023-02-24 20:52:15,519][213369] DAMAGECOUNT value on done: 216385.0 [2023-02-24 20:52:15,519][213369] Sum rewards: 35.084, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.062', 'weapon4': '0.090', 'HEALTH': '0.124', 'weapon5': '0.166', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'weapon2': '0.346', 'WEAPON3': '1.250', 'HITCOUNT': '2.400', 'weapon3': '3.058', 'DAMAGECOUNT': '10.290', 'FRAGCOUNT': '31.000'} [2023-02-24 20:52:15,544][213384] DAMAGECOUNT value on done: 220434.0 [2023-02-24 20:52:15,544][213384] Sum rewards: 31.313, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.174', 'AMMO5': '0.014', 'AMMO2': '0.021', 'AMMO4': '0.107', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'weapon4': '0.260', 'WEAPON5': '0.350', 'weapon5': '0.382', 'weapon2': '0.472', 'WEAPON3': '1.150', 'HITCOUNT': '2.190', 'weapon3': '2.440', 'DAMAGECOUNT': '9.417', 'FRAGCOUNT': '29.000'} [2023-02-24 20:52:15,668][213368] DAMAGECOUNT value on done: 211358.0 [2023-02-24 20:52:15,668][213368] Sum rewards: 29.091, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.998', 'AMMO5': '0.019', 'AMMO2': '0.048', 'weapon5': '0.172', 'AMMO3': '0.234', 'AMMO4': '0.242', 'weapon2': '0.314', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.678', 'WEAPON3': '1.350', 'HITCOUNT': '2.150', 'weapon3': '2.546', 'DAMAGECOUNT': '9.735', 'FRAGCOUNT': '30.000'} [2023-02-24 20:52:15,725][213383] DAMAGECOUNT value on done: 214933.0 [2023-02-24 20:52:15,726][213383] Sum rewards: 33.788, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.226', 'ARMOR': '0.004', 'AMMO2': '0.018', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'weapon4': '0.334', 'weapon2': '0.650', 'WEAPON3': '1.200', 'HITCOUNT': '2.530', 'weapon3': '2.850', 'DAMAGECOUNT': '9.750', 'FRAGCOUNT': '30.000'} [2023-02-24 20:52:15,747][213382] DAMAGECOUNT value on done: 217932.0 [2023-02-24 20:52:15,747][213382] Sum rewards: 38.041, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.480', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.109', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.216', 'weapon4': '0.384', 'weapon2': '0.550', 'WEAPON3': '0.950', 'HITCOUNT': '2.360', 'weapon3': '2.512', 'DAMAGECOUNT': '9.351', 'FRAGCOUNT': '33.000'} [2023-02-24 20:52:15,824][213369] DAMAGECOUNT value on done: 219864.0 [2023-02-24 20:52:15,825][213369] Sum rewards: 33.797, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.312', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.064', 'AMMO3': '0.165', 'weapon5': '0.304', 'AMMO4': '0.318', 'WEAPON5': '0.450', 'weapon2': '0.468', 'WEAPON4': '0.750', 'weapon4': '0.872', 'WEAPON3': '1.000', 'weapon3': '1.952', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '11.673', 'FRAGCOUNT': '33.000'} [2023-02-24 20:52:15,848][213384] DAMAGECOUNT value on done: 205519.0 [2023-02-24 20:52:15,849][213384] Sum rewards: 34.031, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.580', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.062', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.269', 'weapon4': '0.334', 'weapon2': '0.394', 'WEAPON3': '1.600', 'HITCOUNT': '2.600', 'weapon3': '2.848', 'DAMAGECOUNT': '11.394', 'FRAGCOUNT': '33.000'} [2023-02-24 20:52:16,029][213383] DAMAGECOUNT value on done: 209020.0 [2023-02-24 20:52:16,030][213383] Sum rewards: 44.021, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.648', 'ARMOR': '0.004', 'AMMO2': '0.017', 'AMMO5': '0.019', 'AMMO4': '0.083', 'AMMO3': '0.170', 'weapon5': '0.276', 'WEAPON4': '0.300', 'weapon4': '0.462', 'WEAPON5': '0.500', 'weapon2': '0.580', 'WEAPON3': '1.000', 'weapon3': '2.362', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.105', 'FRAGCOUNT': '37.000'} [2023-02-24 20:52:16,040][213384] DAMAGECOUNT value on done: 219941.0 [2023-02-24 20:52:16,040][213384] Sum rewards: 25.077, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.250', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.031', 'AMMO4': '0.156', 'AMMO3': '0.200', 'weapon5': '0.208', 'weapon2': '0.282', 'weapon4': '0.308', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.240', 'weapon3': '2.880', 'DAMAGECOUNT': '10.350', 'FRAGCOUNT': '25.000'} [2023-02-24 20:52:16,124][213369] DAMAGECOUNT value on done: 206148.0 [2023-02-24 20:52:16,125][213369] Sum rewards: 34.600, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.374', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO3': '0.160', 'AMMO4': '0.190', 'weapon5': '0.212', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'ARMOR': '0.454', 'weapon4': '0.576', 'weapon2': '0.690', 'WEAPON3': '1.000', 'weapon3': '2.054', 'HITCOUNT': '2.130', 'DAMAGECOUNT': '10.155', 'FRAGCOUNT': '32.000'} [2023-02-24 20:52:16,336][213384] DAMAGECOUNT value on done: 220554.0 [2023-02-24 20:52:16,337][213384] Sum rewards: 43.103, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.840', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon5': '0.256', 'weapon4': '0.472', 'weapon2': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.508', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.138', 'FRAGCOUNT': '39.000'} [2023-02-24 20:52:16,545][213365] Updated weights for policy 0, policy_version 29866 (0.0009) [2023-02-24 20:52:18,611][213384] Large shaping reward 2.626 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.006, -2.0), ('weapon5', 0.002)] [2023-02-24 20:52:19,653][213365] Updated weights for policy 0, policy_version 29876 (0.0010) [2023-02-24 20:52:20,243][213332] Fps is (10 sec: 13107.1, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 122376192. Throughput: 0: 3362.4. Samples: 5583926. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:52:20,243][213332] Avg episode reward: [(0, '34.561')] [2023-02-24 20:52:22,631][213365] Updated weights for policy 0, policy_version 29886 (0.0009) [2023-02-24 20:52:25,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 122445824. Throughput: 0: 3363.8. Samples: 5604128. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:52:25,244][213332] Avg episode reward: [(0, '34.561')] [2023-02-24 20:52:25,703][213372] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 20:52:25,705][213365] Updated weights for policy 0, policy_version 29896 (0.0009) [2023-02-24 20:52:28,781][213365] Updated weights for policy 0, policy_version 29906 (0.0009) [2023-02-24 20:52:30,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13426.6). Total num frames: 122511360. Throughput: 0: 3361.6. Samples: 5624236. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:52:30,243][213332] Avg episode reward: [(0, '34.561')] [2023-02-24 20:52:31,796][213365] Updated weights for policy 0, policy_version 29916 (0.0009) [2023-02-24 20:52:32,087][213368] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 20:52:33,160][213367] DAMAGECOUNT value on done: 216810.0 [2023-02-24 20:52:33,161][213367] Sum rewards: 30.110, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.990', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.086', 'AMMO3': '0.178', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.360', 'weapon2': '0.826', 'WEAPON3': '1.100', 'HITCOUNT': '2.180', 'weapon3': '2.510', 'DAMAGECOUNT': '9.126', 'FRAGCOUNT': '30.000'} [2023-02-24 20:52:33,475][213367] DAMAGECOUNT value on done: 218781.0 [2023-02-24 20:52:33,475][213367] Sum rewards: 46.372, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.240', 'AMMO5': '0.013', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon4': '0.124', 'weapon5': '0.134', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.502', 'WEAPON3': '1.150', 'HITCOUNT': '2.620', 'weapon3': '2.982', 'DAMAGECOUNT': '11.400', 'FRAGCOUNT': '42.000'} [2023-02-24 20:52:33,784][213372] DAMAGECOUNT value on done: 220507.0 [2023-02-24 20:52:33,785][213372] Sum rewards: 44.926, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.745', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'weapon4': '0.258', 'weapon2': '0.830', 'WEAPON3': '0.900', 'weapon3': '2.790', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '11.523', 'FRAGCOUNT': '37.000'} [2023-02-24 20:52:33,786][213367] DAMAGECOUNT value on done: 225087.0 [2023-02-24 20:52:33,787][213367] Sum rewards: 36.120, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.544', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon2': '0.186', 'weapon5': '0.210', 'AMMO3': '0.217', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '1.018', 'WEAPON3': '1.250', 'weapon3': '2.320', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '11.208', 'FRAGCOUNT': '34.000'} [2023-02-24 20:52:34,096][213367] DAMAGECOUNT value on done: 216638.0 [2023-02-24 20:52:34,096][213367] Sum rewards: 39.081, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.450', 'AMMO5': '0.018', 'AMMO2': '0.025', 'AMMO4': '0.127', 'AMMO3': '0.195', 'weapon4': '0.196', 'WEAPON4': '0.300', 'weapon5': '0.398', 'WEAPON5': '0.450', 'weapon2': '0.534', 'WEAPON3': '1.250', 'HITCOUNT': '2.270', 'weapon3': '2.478', 'DAMAGECOUNT': '12.039', 'FRAGCOUNT': '37.000'} [2023-02-24 20:52:34,102][213372] DAMAGECOUNT value on done: 224435.0 [2023-02-24 20:52:34,103][213372] Sum rewards: 33.702, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.800', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon7': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.116', 'weapon5': '0.226', 'AMMO4': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.672', 'WEAPON3': '0.700', 'weapon4': '0.700', 'weapon3': '1.942', 'HITCOUNT': '2.000', 'DAMAGECOUNT': '9.669', 'FRAGCOUNT': '29.000'} [2023-02-24 20:52:34,104][213366] DAMAGECOUNT value on done: 215565.0 [2023-02-24 20:52:34,104][213366] Sum rewards: 39.174, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.857', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.108', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.234', 'weapon4': '0.312', 'WEAPON3': '1.350', 'HITCOUNT': '2.450', 'weapon3': '3.100', 'DAMAGECOUNT': '11.259', 'FRAGCOUNT': '36.000'} [2023-02-24 20:52:34,166][213372] DAMAGECOUNT value on done: 216040.0 [2023-02-24 20:52:34,167][213372] Sum rewards: 37.120, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.676', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.050', 'AMMO3': '0.195', 'AMMO4': '0.250', 'weapon5': '0.256', 'weapon2': '0.336', 'weapon4': '0.358', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'HITCOUNT': '2.190', 'weapon3': '2.704', 'DAMAGECOUNT': '10.686', 'FRAGCOUNT': '37.000'} [2023-02-24 20:52:34,343][213366] DAMAGECOUNT value on done: 222204.0 [2023-02-24 20:52:34,343][213366] Sum rewards: 37.433, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.270', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.024', 'AMMO4': '0.122', 'AMMO3': '0.208', 'weapon5': '0.314', 'weapon2': '0.356', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.552', 'WEAPON3': '1.300', 'weapon3': '2.376', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '11.400', 'FRAGCOUNT': '35.000'} [2023-02-24 20:52:34,436][213366] DAMAGECOUNT value on done: 226123.0 [2023-02-24 20:52:34,437][213366] Sum rewards: 48.947, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.573', 'AMMO2': '0.008', 'AMMO5': '0.011', 'AMMO4': '0.041', 'weapon4': '0.042', 'WEAPON4': '0.100', 'AMMO3': '0.148', 'WEAPON5': '0.250', 'weapon2': '0.258', 'weapon5': '0.278', 'WEAPON3': '1.050', 'HITCOUNT': '2.500', 'weapon3': '3.072', 'DAMAGECOUNT': '12.261', 'FRAGCOUNT': '41.000'} [2023-02-24 20:52:34,482][213372] DAMAGECOUNT value on done: 213840.0 [2023-02-24 20:52:34,483][213372] Sum rewards: 45.201, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.415', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon5': '0.164', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.276', 'weapon4': '0.412', 'WEAPON3': '1.350', 'weapon3': '2.880', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '12.993', 'FRAGCOUNT': '40.000'} [2023-02-24 20:52:34,665][213366] DAMAGECOUNT value on done: 221881.0 [2023-02-24 20:52:34,666][213366] Sum rewards: 34.710, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.712', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.043', 'AMMO3': '0.159', 'weapon5': '0.180', 'AMMO4': '0.214', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.450', 'weapon4': '0.594', 'WEAPON3': '1.000', 'HITCOUNT': '2.420', 'weapon3': '2.484', 'DAMAGECOUNT': '10.662', 'FRAGCOUNT': '31.000'} [2023-02-24 20:52:34,724][213368] DAMAGECOUNT value on done: 215817.0 [2023-02-24 20:52:34,724][213368] Sum rewards: 40.630, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.374', 'AMMO5': '0.019', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.175', 'weapon5': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.470', 'weapon2': '0.612', 'WEAPON3': '1.100', 'weapon3': '2.328', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '11.316', 'FRAGCOUNT': '35.000'} [2023-02-24 20:52:34,769][213382] DAMAGECOUNT value on done: 215115.0 [2023-02-24 20:52:34,769][213382] Sum rewards: 41.039, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.245', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon5': '0.116', 'AMMO4': '0.186', 'AMMO3': '0.188', 'WEAPON5': '0.350', 'weapon2': '0.426', 'weapon4': '0.448', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'HITCOUNT': '2.480', 'weapon3': '2.732', 'DAMAGECOUNT': '11.307', 'FRAGCOUNT': '36.000'} [2023-02-24 20:52:34,782][213383] DAMAGECOUNT value on done: 218589.0 [2023-02-24 20:52:34,783][213383] Sum rewards: 44.201, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.820', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon5': '0.176', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'weapon2': '0.282', 'WEAPON4': '0.350', 'weapon4': '0.656', 'WEAPON3': '1.550', 'weapon3': '2.566', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.606', 'FRAGCOUNT': '42.500'} [2023-02-24 20:52:34,893][213365] Updated weights for policy 0, policy_version 29926 (0.0009) [2023-02-24 20:52:35,038][213368] DAMAGECOUNT value on done: 217851.0 [2023-02-24 20:52:35,038][213368] Sum rewards: 35.532, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.950', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.060', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'weapon4': '0.296', 'WEAPON3': '0.900', 'weapon2': '1.018', 'HITCOUNT': '2.070', 'weapon3': '2.448', 'DAMAGECOUNT': '8.943', 'FRAGCOUNT': '30.000'} [2023-02-24 20:52:35,080][213382] DAMAGECOUNT value on done: 218629.0 [2023-02-24 20:52:35,080][213382] Sum rewards: 42.881, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.247', 'AMMO5': '0.013', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.156', 'AMMO3': '0.228', 'weapon2': '0.336', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.470', 'WEAPON3': '1.350', 'weapon3': '2.750', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.195', 'FRAGCOUNT': '42.000'} [2023-02-24 20:52:35,092][213383] DAMAGECOUNT value on done: 220575.0 [2023-02-24 20:52:35,093][213383] Sum rewards: 38.030, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.526', 'AMMO5': '0.004', 'AMMO2': '0.012', 'weapon5': '0.044', 'AMMO4': '0.061', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.178', 'AMMO3': '0.204', 'weapon2': '0.618', 'WEAPON3': '1.200', 'HITCOUNT': '2.700', 'weapon3': '2.992', 'DAMAGECOUNT': '12.042', 'FRAGCOUNT': '32.000'} [2023-02-24 20:52:35,171][213369] DAMAGECOUNT value on done: 223158.0 [2023-02-24 20:52:35,172][213369] Sum rewards: 37.990, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.830', 'AMMO5': '0.017', 'AMMO2': '0.049', 'AMMO3': '0.116', 'AMMO4': '0.245', 'weapon5': '0.262', 'WEAPON5': '0.350', 'weapon2': '0.544', 'WEAPON4': '0.550', 'WEAPON3': '0.750', 'weapon4': '0.974', 'weapon3': '1.700', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '11.772', 'FRAGCOUNT': '33.000'} [2023-02-24 20:52:35,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13440.4). Total num frames: 122580992. Throughput: 0: 3360.8. Samples: 5634458. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:52:35,243][213332] Avg episode reward: [(0, '35.132')] [2023-02-24 20:52:35,349][213368] DAMAGECOUNT value on done: 222095.0 [2023-02-24 20:52:35,350][213368] Sum rewards: 20.166, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.900', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.022', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'ARMOR': '0.458', 'weapon2': '0.694', 'weapon4': '0.926', 'WEAPON3': '1.250', 'HITCOUNT': '1.880', 'weapon3': '2.078', 'DAMAGECOUNT': '7.827', 'FRAGCOUNT': '21.000'} [2023-02-24 20:52:35,385][213382] DAMAGECOUNT value on done: 213214.0 [2023-02-24 20:52:35,386][213382] Sum rewards: 34.127, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.780', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.009', 'weapon5': '0.114', 'WEAPON5': '0.200', 'AMMO3': '0.254', 'weapon2': '0.618', 'WEAPON3': '1.600', 'HITCOUNT': '2.190', 'weapon3': '2.990', 'DAMAGECOUNT': '9.210', 'FRAGCOUNT': '35.000'} [2023-02-24 20:52:35,481][213369] DAMAGECOUNT value on done: 220542.0 [2023-02-24 20:52:35,482][213369] Sum rewards: 47.707, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.863', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon4': '0.186', 'weapon5': '0.188', 'AMMO3': '0.214', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.650', 'weapon3': '2.930', 'DAMAGECOUNT': '12.471', 'FRAGCOUNT': '44.000'} [2023-02-24 20:52:35,587][213384] DAMAGECOUNT value on done: 224185.0 [2023-02-24 20:52:35,587][213384] Sum rewards: 30.926, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.721', 'AMMO5': '0.027', 'AMMO2': '0.040', 'AMMO4': '0.202', 'AMMO3': '0.230', 'weapon5': '0.306', 'weapon4': '0.412', 'weapon2': '0.452', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.300', 'HITCOUNT': '2.340', 'weapon3': '2.384', 'DAMAGECOUNT': '11.253', 'FRAGCOUNT': '33.000'} [2023-02-24 20:52:35,652][213368] DAMAGECOUNT value on done: 214956.0 [2023-02-24 20:52:35,652][213368] Sum rewards: 34.239, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.080', 'AMMO5': '0.022', 'AMMO2': '0.060', 'AMMO3': '0.158', 'AMMO4': '0.299', 'weapon4': '0.300', 'weapon5': '0.364', 'weapon2': '0.578', 'WEAPON5': '0.650', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'HITCOUNT': '2.250', 'weapon3': '2.394', 'DAMAGECOUNT': '10.794', 'FRAGCOUNT': '33.500'} [2023-02-24 20:52:35,680][213383] DAMAGECOUNT value on done: 218429.0 [2023-02-24 20:52:35,681][213383] Sum rewards: 35.103, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.945', 'AMMO5': '0.008', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'ARMOR': '0.020', 'weapon4': '0.022', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'weapon2': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon5': '0.360', 'WEAPON3': '1.500', 'HITCOUNT': '2.250', 'weapon3': '3.148', 'DAMAGECOUNT': '10.488', 'FRAGCOUNT': '33.000'} [2023-02-24 20:52:35,688][213382] DAMAGECOUNT value on done: 221561.0 [2023-02-24 20:52:35,689][213382] Sum rewards: 34.120, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.460', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.049', 'AMMO3': '0.213', 'weapon2': '0.230', 'AMMO4': '0.246', 'WEAPON5': '0.250', 'weapon5': '0.252', 'WEAPON4': '0.600', 'weapon4': '0.776', 'WEAPON3': '1.250', 'HITCOUNT': '2.350', 'weapon3': '2.462', 'DAMAGECOUNT': '10.887', 'FRAGCOUNT': '35.000'} [2023-02-24 20:52:35,765][213369] DAMAGECOUNT value on done: 223652.0 [2023-02-24 20:52:35,766][213369] Sum rewards: 43.869, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.774', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'weapon5': '0.168', 'WEAPON4': '0.200', 'weapon4': '0.226', 'weapon2': '0.618', 'WEAPON3': '0.950', 'HITCOUNT': '2.600', 'weapon3': '2.796', 'DAMAGECOUNT': '11.364', 'FRAGCOUNT': '38.000'} [2023-02-24 20:52:35,859][213382] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 20:52:35,889][213384] DAMAGECOUNT value on done: 208466.0 [2023-02-24 20:52:35,890][213384] Sum rewards: 24.485, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.875', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon5': '0.208', 'AMMO3': '0.216', 'AMMO4': '0.216', 'weapon2': '0.268', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.558', 'WEAPON3': '1.150', 'HITCOUNT': '2.010', 'weapon3': '2.678', 'DAMAGECOUNT': '8.841', 'FRAGCOUNT': '26.500'} [2023-02-24 20:52:35,974][213383] DAMAGECOUNT value on done: 213170.0 [2023-02-24 20:52:35,975][213383] Sum rewards: 46.247, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.219', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.165', 'AMMO3': '0.179', 'weapon5': '0.194', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.434', 'weapon4': '0.688', 'WEAPON3': '1.050', 'weapon3': '2.482', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '12.450', 'FRAGCOUNT': '40.000'} [2023-02-24 20:52:36,042][213384] DAMAGECOUNT value on done: 223658.0 [2023-02-24 20:52:36,043][213384] Sum rewards: 42.227, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.714', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.004', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'weapon2': '0.812', 'WEAPON3': '1.050', 'HITCOUNT': '2.580', 'weapon3': '2.788', 'DAMAGECOUNT': '11.121', 'FRAGCOUNT': '34.000'} [2023-02-24 20:52:36,058][213369] DAMAGECOUNT value on done: 209685.0 [2023-02-24 20:52:36,058][213369] Sum rewards: 38.682, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.886', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.100', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'weapon2': '0.344', 'WEAPON4': '0.350', 'weapon4': '0.702', 'WEAPON3': '1.000', 'HITCOUNT': '2.310', 'weapon3': '2.676', 'DAMAGECOUNT': '10.611', 'FRAGCOUNT': '34.000'} [2023-02-24 20:52:36,341][213384] DAMAGECOUNT value on done: 223761.0 [2023-02-24 20:52:36,342][213384] Sum rewards: 25.695, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.091', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.089', 'AMMO3': '0.126', 'weapon5': '0.436', 'AMMO4': '0.445', 'WEAPON5': '0.650', 'WEAPON3': '0.700', 'weapon2': '0.700', 'weapon4': '0.874', 'WEAPON4': '0.950', 'weapon3': '1.646', 'HITCOUNT': '2.100', 'DAMAGECOUNT': '9.540', 'FRAGCOUNT': '26.000'} [2023-02-24 20:52:37,899][213365] Updated weights for policy 0, policy_version 29936 (0.0009) [2023-02-24 20:52:38,578][213366] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 20:52:40,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 122646528. Throughput: 0: 3362.2. Samples: 5654564. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:52:40,243][213332] Avg episode reward: [(0, '35.850')] [2023-02-24 20:52:40,244][213352] Saving new best policy, reward=35.850! [2023-02-24 20:52:40,936][213365] Updated weights for policy 0, policy_version 29946 (0.0009) [2023-02-24 20:52:43,117][213384] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 20:52:43,979][213365] Updated weights for policy 0, policy_version 29956 (0.0010) [2023-02-24 20:52:45,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13440.4). Total num frames: 122716160. Throughput: 0: 3363.1. Samples: 5674652. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:52:45,243][213332] Avg episode reward: [(0, '35.850')] [2023-02-24 20:52:45,247][213352] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000029960_122716160.pth... [2023-02-24 20:52:45,309][213352] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000029172_119488512.pth [2023-02-24 20:52:46,997][213365] Updated weights for policy 0, policy_version 29966 (0.0009) [2023-02-24 20:52:50,101][213365] Updated weights for policy 0, policy_version 29976 (0.0009) [2023-02-24 20:52:50,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 122781696. Throughput: 0: 3362.6. Samples: 5684862. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:52:50,243][213332] Avg episode reward: [(0, '35.850')] [2023-02-24 20:52:53,109][213365] Updated weights for policy 0, policy_version 29986 (0.0009) [2023-02-24 20:52:53,231][213367] DAMAGECOUNT value on done: 219799.0 [2023-02-24 20:52:53,232][213367] Sum rewards: 31.895, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.910', 'AMMO5': '0.011', 'AMMO2': '0.028', 'AMMO3': '0.140', 'AMMO4': '0.140', 'weapon5': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.504', 'weapon4': '0.788', 'WEAPON3': '0.850', 'weapon3': '1.956', 'HITCOUNT': '2.250', 'DAMAGECOUNT': '8.967', 'FRAGCOUNT': '27.000'} [2023-02-24 20:52:53,551][213367] DAMAGECOUNT value on done: 221928.0 [2023-02-24 20:52:53,551][213367] Sum rewards: 31.452, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.592', 'AMMO5': '0.008', 'AMMO2': '0.056', 'AMMO3': '0.159', 'weapon5': '0.184', 'WEAPON5': '0.200', 'AMMO4': '0.280', 'weapon2': '0.554', 'WEAPON4': '0.600', 'weapon4': '0.762', 'WEAPON3': '0.850', 'weapon3': '2.270', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '9.441', 'FRAGCOUNT': '30.000'} [2023-02-24 20:52:53,767][213372] DAMAGECOUNT value on done: 224415.0 [2023-02-24 20:52:53,768][213372] Sum rewards: 37.089, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.846', 'AMMO5': '0.019', 'AMMO2': '0.075', 'weapon5': '0.246', 'AMMO3': '0.249', 'weapon2': '0.308', 'AMMO4': '0.376', 'ARMOR': '0.438', 'weapon4': '0.482', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '1.550', 'HITCOUNT': '2.390', 'weapon3': '2.628', 'DAMAGECOUNT': '11.724', 'FRAGCOUNT': '39.000'} [2023-02-24 20:52:53,871][213367] DAMAGECOUNT value on done: 228883.0 [2023-02-24 20:52:53,871][213367] Sum rewards: 39.682, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.784', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO4': '0.174', 'AMMO3': '0.192', 'weapon5': '0.216', 'weapon2': '0.332', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.828', 'WEAPON3': '1.050', 'weapon3': '2.176', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '11.388', 'FRAGCOUNT': '36.000'} [2023-02-24 20:52:54,088][213372] DAMAGECOUNT value on done: 227822.0 [2023-02-24 20:52:54,089][213372] Sum rewards: 37.511, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.918', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.176', 'weapon4': '0.290', 'WEAPON4': '0.300', 'weapon2': '0.470', 'WEAPON3': '1.000', 'HITCOUNT': '2.380', 'weapon3': '2.976', 'DAMAGECOUNT': '10.161', 'FRAGCOUNT': '33.000'} [2023-02-24 20:52:54,139][213366] DAMAGECOUNT value on done: 219683.0 [2023-02-24 20:52:54,139][213366] Sum rewards: 40.132, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.220', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.021', 'AMMO2': '0.043', 'weapon2': '0.200', 'AMMO4': '0.213', 'AMMO3': '0.242', 'weapon4': '0.322', 'weapon5': '0.364', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '2.700', 'weapon3': '2.728', 'DAMAGECOUNT': '12.354', 'FRAGCOUNT': '39.000'} [2023-02-24 20:52:54,148][213372] DAMAGECOUNT value on done: 219994.0 [2023-02-24 20:52:54,149][213372] Sum rewards: 44.018, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.864', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.067', 'weapon5': '0.112', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.364', 'weapon4': '0.898', 'WEAPON3': '0.950', 'weapon3': '2.400', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '11.862', 'FRAGCOUNT': '37.000'} [2023-02-24 20:52:54,177][213367] DAMAGECOUNT value on done: 221034.0 [2023-02-24 20:52:54,178][213367] Sum rewards: 44.853, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.702', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO4': '0.190', 'AMMO3': '0.212', 'weapon5': '0.260', 'weapon4': '0.348', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.598', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.188', 'FRAGCOUNT': '41.000'} [2023-02-24 20:52:54,349][213366] DAMAGECOUNT value on done: 225567.0 [2023-02-24 20:52:54,350][213366] Sum rewards: 28.888, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.655', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.056', 'AMMO3': '0.167', 'weapon5': '0.246', 'AMMO4': '0.279', 'WEAPON5': '0.400', 'weapon2': '0.472', 'WEAPON4': '0.600', 'WEAPON3': '0.950', 'weapon4': '1.126', 'weapon3': '1.846', 'HITCOUNT': '2.290', 'DAMAGECOUNT': '10.089', 'FRAGCOUNT': '27.000'} [2023-02-24 20:52:54,449][213366] DAMAGECOUNT value on done: 230193.0 [2023-02-24 20:52:54,450][213366] Sum rewards: 41.973, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.825', 'AMMO5': '0.020', 'AMMO2': '0.047', 'weapon5': '0.166', 'AMMO3': '0.203', 'AMMO4': '0.236', 'weapon2': '0.298', 'weapon4': '0.324', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.470', 'weapon3': '2.924', 'DAMAGECOUNT': '12.210', 'FRAGCOUNT': '40.000'} [2023-02-24 20:52:54,464][213372] DAMAGECOUNT value on done: 217438.0 [2023-02-24 20:52:54,464][213372] Sum rewards: 37.155, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.675', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon5': '0.158', 'AMMO4': '0.192', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.284', 'weapon4': '0.336', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.290', 'weapon3': '2.956', 'DAMAGECOUNT': '10.794', 'FRAGCOUNT': '33.000'} [2023-02-24 20:52:54,670][213366] DAMAGECOUNT value on done: 225140.0 [2023-02-24 20:52:54,671][213366] Sum rewards: 29.097, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.646', 'AMMO5': '0.012', 'AMMO2': '0.042', 'AMMO3': '0.174', 'AMMO4': '0.210', 'weapon5': '0.282', 'weapon4': '0.304', 'WEAPON5': '0.350', 'weapon2': '0.454', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.180', 'weapon3': '2.608', 'DAMAGECOUNT': '9.777', 'FRAGCOUNT': '28.000'} [2023-02-24 20:52:54,692][213368] DAMAGECOUNT value on done: 219099.0 [2023-02-24 20:52:54,692][213368] Sum rewards: 33.854, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.015', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'AMMO4': '0.135', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'weapon4': '0.296', 'weapon5': '0.326', 'WEAPON5': '0.350', 'weapon2': '0.586', 'HEALTH': '0.810', 'WEAPON3': '1.000', 'HITCOUNT': '2.110', 'weapon3': '2.382', 'DAMAGECOUNT': '9.846', 'FRAGCOUNT': '29.000'} [2023-02-24 20:52:54,782][213383] DAMAGECOUNT value on done: 221496.0 [2023-02-24 20:52:54,783][213383] Sum rewards: 30.245, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.506', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.132', 'AMMO3': '0.157', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.436', 'weapon4': '0.462', 'WEAPON3': '1.050', 'HITCOUNT': '1.860', 'weapon3': '2.784', 'DAMAGECOUNT': '8.721', 'FRAGCOUNT': '27.000'} [2023-02-24 20:52:54,841][213382] DAMAGECOUNT value on done: 218041.0 [2023-02-24 20:52:54,841][213382] Sum rewards: 30.490, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.562', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.032', 'AMMO3': '0.161', 'AMMO4': '0.161', 'weapon5': '0.234', 'WEAPON4': '0.350', 'weapon2': '0.378', 'WEAPON5': '0.400', 'WEAPON3': '0.950', 'weapon4': '1.146', 'weapon3': '1.710', 'HITCOUNT': '2.230', 'DAMAGECOUNT': '8.778', 'FRAGCOUNT': '29.000'} [2023-02-24 20:52:55,003][213368] DAMAGECOUNT value on done: 221199.0 [2023-02-24 20:52:55,003][213368] Sum rewards: 34.435, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.236', 'AMMO5': '0.014', 'AMMO2': '0.078', 'AMMO3': '0.099', 'weapon5': '0.166', 'WEAPON5': '0.300', 'AMMO4': '0.390', 'weapon2': '0.418', 'WEAPON3': '0.650', 'WEAPON4': '0.900', 'weapon4': '1.588', 'weapon3': '1.624', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '10.044', 'FRAGCOUNT': '32.000'} [2023-02-24 20:52:55,104][213383] DAMAGECOUNT value on done: 224011.0 [2023-02-24 20:52:55,105][213383] Sum rewards: 37.544, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.360', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.116', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'weapon2': '0.400', 'weapon4': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.430', 'weapon3': '2.844', 'DAMAGECOUNT': '10.308', 'FRAGCOUNT': '34.000'} [2023-02-24 20:52:55,133][213369] DAMAGECOUNT value on done: 226065.0 [2023-02-24 20:52:55,133][213369] Sum rewards: 26.522, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.722', 'AMMO5': '0.014', 'ARMOR': '0.040', 'AMMO2': '0.051', 'weapon5': '0.160', 'AMMO3': '0.224', 'AMMO4': '0.257', 'WEAPON5': '0.400', 'weapon2': '0.446', 'WEAPON4': '0.450', 'weapon4': '0.644', 'WEAPON3': '1.400', 'HITCOUNT': '2.000', 'weapon3': '2.436', 'DAMAGECOUNT': '8.721', 'FRAGCOUNT': '29.000'} [2023-02-24 20:52:55,172][213382] DAMAGECOUNT value on done: 222203.0 [2023-02-24 20:52:55,172][213382] Sum rewards: 41.107, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.710', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.040', 'AMMO3': '0.148', 'AMMO4': '0.201', 'weapon5': '0.228', 'weapon4': '0.356', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.554', 'WEAPON3': '0.900', 'HITCOUNT': '2.500', 'weapon3': '2.538', 'DAMAGECOUNT': '10.482', 'FRAGCOUNT': '38.000'} [2023-02-24 20:52:55,243][213332] Fps is (10 sec: 13107.3, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 122847232. Throughput: 0: 3363.0. Samples: 5704996. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:52:55,243][213332] Avg episode reward: [(0, '36.337')] [2023-02-24 20:52:55,247][213352] Saving new best policy, reward=36.337! [2023-02-24 20:52:55,366][213368] DAMAGECOUNT value on done: 226176.0 [2023-02-24 20:52:55,366][213368] Sum rewards: 41.973, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.194', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.086', 'AMMO4': '0.174', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.388', 'weapon2': '0.662', 'WEAPON3': '1.350', 'weapon3': '2.534', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.243', 'FRAGCOUNT': '39.000'} [2023-02-24 20:52:55,444][213369] DAMAGECOUNT value on done: 224243.0 [2023-02-24 20:52:55,445][213369] Sum rewards: 42.795, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.257', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON5': '0.150', 'weapon5': '0.156', 'AMMO3': '0.226', 'weapon2': '0.278', 'WEAPON4': '0.300', 'ARMOR': '0.396', 'weapon4': '0.520', 'WEAPON3': '1.350', 'HITCOUNT': '2.630', 'weapon3': '2.820', 'DAMAGECOUNT': '11.103', 'FRAGCOUNT': '40.000'} [2023-02-24 20:52:55,473][213382] DAMAGECOUNT value on done: 217184.0 [2023-02-24 20:52:55,474][213382] Sum rewards: 46.566, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon5': '0.210', 'weapon2': '0.322', 'HEALTH': '0.390', 'weapon4': '0.470', 'WEAPON3': '1.000', 'HITCOUNT': '2.600', 'weapon3': '2.770', 'DAMAGECOUNT': '11.910', 'FRAGCOUNT': '39.000'} [2023-02-24 20:52:55,554][213384] DAMAGECOUNT value on done: 227669.0 [2023-02-24 20:52:55,554][213384] Sum rewards: 35.049, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.281', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.164', 'weapon5': '0.220', 'weapon4': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.446', 'WEAPON3': '1.050', 'HITCOUNT': '2.470', 'weapon3': '2.848', 'DAMAGECOUNT': '10.452', 'FRAGCOUNT': '30.000'} [2023-02-24 20:52:55,668][213368] DAMAGECOUNT value on done: 218243.0 [2023-02-24 20:52:55,669][213368] Sum rewards: 37.325, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.195', 'AMMO2': '0.009', 'AMMO5': '0.011', 'AMMO4': '0.044', 'weapon5': '0.130', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.322', 'weapon2': '0.662', 'WEAPON3': '1.100', 'HITCOUNT': '2.360', 'weapon3': '2.592', 'DAMAGECOUNT': '9.861', 'FRAGCOUNT': '33.000'} [2023-02-24 20:52:55,711][213383] DAMAGECOUNT value on done: 221871.0 [2023-02-24 20:52:55,712][213383] Sum rewards: 32.765, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.650', 'AMMO5': '0.006', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.069', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon4': '0.232', 'weapon2': '0.690', 'WEAPON3': '1.150', 'HITCOUNT': '2.690', 'weapon3': '2.760', 'DAMAGECOUNT': '10.326', 'FRAGCOUNT': '28.000'} [2023-02-24 20:52:55,750][213369] DAMAGECOUNT value on done: 227745.0 [2023-02-24 20:52:55,750][213369] Sum rewards: 34.546, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.426', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.214', 'weapon5': '0.240', 'weapon4': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.594', 'WEAPON3': '1.350', 'weapon3': '2.586', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '12.279', 'FRAGCOUNT': '31.000'} [2023-02-24 20:52:55,770][213382] DAMAGECOUNT value on done: 224840.0 [2023-02-24 20:52:55,770][213382] Sum rewards: 25.448, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.106', 'AMMO5': '0.019', 'AMMO2': '0.050', 'AMMO4': '0.250', 'AMMO3': '0.251', 'weapon5': '0.318', 'weapon2': '0.340', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.526', 'WEAPON3': '1.400', 'weapon3': '2.282', 'HITCOUNT': '2.330', 'DAMAGECOUNT': '9.837', 'FRAGCOUNT': '27.000'} [2023-02-24 20:52:55,852][213384] DAMAGECOUNT value on done: 212003.0 [2023-02-24 20:52:55,853][213384] Sum rewards: 32.535, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.102', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.190', 'AMMO4': '0.228', 'AMMO3': '0.238', 'WEAPON5': '0.350', 'weapon2': '0.460', 'WEAPON4': '0.600', 'weapon4': '0.708', 'WEAPON3': '1.400', 'weapon3': '2.322', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '10.611', 'FRAGCOUNT': '34.000'} [2023-02-24 20:52:56,013][213383] DAMAGECOUNT value on done: 217532.0 [2023-02-24 20:52:56,013][213383] Sum rewards: 49.455, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.604', 'AMMO5': '0.016', 'AMMO2': '0.040', 'AMMO3': '0.144', 'AMMO4': '0.199', 'weapon5': '0.368', 'weapon4': '0.434', 'weapon2': '0.438', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'weapon3': '2.374', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '13.086', 'FRAGCOUNT': '43.000'} [2023-02-24 20:52:56,018][213384] DAMAGECOUNT value on done: 227034.0 [2023-02-24 20:52:56,019][213384] Sum rewards: 38.704, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.009', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.088', 'weapon5': '0.142', 'HEALTH': '0.143', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.252', 'weapon2': '0.386', 'WEAPON3': '1.000', 'HITCOUNT': '2.460', 'weapon3': '2.978', 'DAMAGECOUNT': '10.128', 'FRAGCOUNT': '34.000'} [2023-02-24 20:52:56,052][213369] DAMAGECOUNT value on done: 213051.0 [2023-02-24 20:52:56,052][213369] Sum rewards: 40.819, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.111', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.058', 'AMMO4': '0.080', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'weapon4': '0.400', 'weapon2': '0.588', 'WEAPON3': '1.000', 'HITCOUNT': '2.440', 'weapon3': '2.792', 'DAMAGECOUNT': '10.098', 'FRAGCOUNT': '36.000'} [2023-02-24 20:52:56,202][213365] Updated weights for policy 0, policy_version 29996 (0.0009) [2023-02-24 20:52:56,320][213384] DAMAGECOUNT value on done: 227607.0 [2023-02-24 20:52:56,321][213384] Sum rewards: 33.653, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.852', 'AMMO5': '0.026', 'AMMO2': '0.050', 'AMMO3': '0.203', 'weapon2': '0.218', 'AMMO4': '0.249', 'weapon4': '0.266', 'weapon5': '0.402', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.150', 'HITCOUNT': '2.310', 'weapon3': '2.688', 'DAMAGECOUNT': '11.493', 'FRAGCOUNT': '31.000'} [2023-02-24 20:52:59,256][213365] Updated weights for policy 0, policy_version 30006 (0.0009) [2023-02-24 20:53:00,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 122916864. Throughput: 0: 3360.4. Samples: 5724948. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 20:53:00,243][213332] Avg episode reward: [(0, '36.763')] [2023-02-24 20:53:00,244][213352] Saving new best policy, reward=36.763! [2023-02-24 20:53:02,271][213365] Updated weights for policy 0, policy_version 30016 (0.0009) [2023-02-24 20:53:05,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 122982400. Throughput: 0: 3360.6. Samples: 5735154. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 20:53:05,243][213332] Avg episode reward: [(0, '36.763')] [2023-02-24 20:53:05,359][213365] Updated weights for policy 0, policy_version 30026 (0.0009) [2023-02-24 20:53:08,386][213365] Updated weights for policy 0, policy_version 30036 (0.0009) [2023-02-24 20:53:10,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 123052032. Throughput: 0: 3359.2. Samples: 5755292. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 20:53:10,244][213332] Avg episode reward: [(0, '36.763')] [2023-02-24 20:53:11,398][213365] Updated weights for policy 0, policy_version 30046 (0.0008) [2023-02-24 20:53:13,167][213367] DAMAGECOUNT value on done: 222726.0 [2023-02-24 20:53:13,167][213367] Sum rewards: 28.735, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.610', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'weapon7': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.185', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.050', 'weapon4': '1.200', 'weapon3': '2.108', 'HITCOUNT': '2.220', 'DAMAGECOUNT': '8.781', 'FRAGCOUNT': '27.000'} [2023-02-24 20:53:13,489][213367] DAMAGECOUNT value on done: 225045.0 [2023-02-24 20:53:13,489][213367] Sum rewards: 34.514, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.010', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO3': '0.182', 'AMMO4': '0.195', 'weapon2': '0.230', 'weapon5': '0.248', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.520', 'WEAPON3': '1.100', 'HITCOUNT': '2.070', 'weapon3': '2.574', 'DAMAGECOUNT': '9.351', 'FRAGCOUNT': '32.000'} [2023-02-24 20:53:13,801][213367] DAMAGECOUNT value on done: 233108.0 [2023-02-24 20:53:13,801][213367] Sum rewards: 43.283, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.871', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.025', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'weapon5': '0.160', 'weapon4': '0.194', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.462', 'WEAPON3': '1.250', 'HITCOUNT': '2.670', 'weapon3': '2.962', 'DAMAGECOUNT': '12.675', 'FRAGCOUNT': '39.000'} [2023-02-24 20:53:13,820][213372] DAMAGECOUNT value on done: 228816.0 [2023-02-24 20:53:13,821][213372] Sum rewards: 44.436, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.650', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO4': '0.177', 'AMMO3': '0.192', 'weapon5': '0.378', 'weapon2': '0.382', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.616', 'WEAPON3': '1.100', 'weapon3': '2.220', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.203', 'FRAGCOUNT': '39.000'} [2023-02-24 20:53:14,107][213367] DAMAGECOUNT value on done: 225173.0 [2023-02-24 20:53:14,107][213367] Sum rewards: 37.271, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.456', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.057', 'AMMO3': '0.181', 'weapon5': '0.230', 'AMMO4': '0.284', 'WEAPON5': '0.350', 'weapon2': '0.494', 'WEAPON4': '0.750', 'weapon4': '0.924', 'WEAPON3': '1.150', 'weapon3': '2.012', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '12.417', 'FRAGCOUNT': '35.000'} [2023-02-24 20:53:14,135][213372] DAMAGECOUNT value on done: 230710.0 [2023-02-24 20:53:14,135][213372] Sum rewards: 28.328, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.365', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO3': '0.088', 'AMMO4': '0.119', 'WEAPON5': '0.250', 'weapon5': '0.262', 'WEAPON4': '0.400', 'weapon2': '0.496', 'WEAPON3': '0.600', 'weapon4': '0.762', 'HITCOUNT': '1.950', 'weapon3': '2.066', 'DAMAGECOUNT': '8.664', 'FRAGCOUNT': '23.000'} [2023-02-24 20:53:14,160][213366] DAMAGECOUNT value on done: 223288.0 [2023-02-24 20:53:14,161][213366] Sum rewards: 36.225, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.802', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.170', 'weapon5': '0.170', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.748', 'weapon2': '0.942', 'WEAPON3': '1.050', 'weapon3': '1.910', 'HITCOUNT': '2.210', 'DAMAGECOUNT': '10.815', 'FRAGCOUNT': '32.000'} [2023-02-24 20:53:14,193][213372] DAMAGECOUNT value on done: 223751.0 [2023-02-24 20:53:14,193][213372] Sum rewards: 42.998, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.325', 'ARMOR': '0.004', 'AMMO5': '0.011', 'weapon5': '0.030', 'AMMO2': '0.036', 'weapon4': '0.102', 'AMMO3': '0.118', 'AMMO4': '0.180', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.798', 'WEAPON3': '0.850', 'HITCOUNT': '2.680', 'weapon3': '2.892', 'DAMAGECOUNT': '11.271', 'FRAGCOUNT': '37.000'} [2023-02-24 20:53:14,367][213366] DAMAGECOUNT value on done: 228880.0 [2023-02-24 20:53:14,368][213366] Sum rewards: 31.197, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.055', 'AMMO5': '0.007', 'AMMO2': '0.056', 'weapon5': '0.172', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'AMMO4': '0.281', 'weapon2': '0.488', 'WEAPON4': '0.550', 'weapon4': '0.786', 'WEAPON3': '1.150', 'weapon3': '2.198', 'HITCOUNT': '2.230', 'DAMAGECOUNT': '9.939', 'FRAGCOUNT': '31.000'} [2023-02-24 20:53:14,476][213366] DAMAGECOUNT value on done: 233384.0 [2023-02-24 20:53:14,477][213366] Sum rewards: 25.129, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.588', 'AMMO5': '0.007', 'AMMO2': '0.054', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'AMMO4': '0.271', 'WEAPON4': '0.300', 'weapon2': '0.366', 'weapon4': '0.594', 'WEAPON3': '1.300', 'HITCOUNT': '2.110', 'weapon3': '2.538', 'DAMAGECOUNT': '9.468', 'FRAGCOUNT': '26.000'} [2023-02-24 20:53:14,508][213365] Updated weights for policy 0, policy_version 30056 (0.0009) [2023-02-24 20:53:14,510][213372] DAMAGECOUNT value on done: 220926.0 [2023-02-24 20:53:14,510][213372] Sum rewards: 30.238, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.943', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.184', 'weapon5': '0.238', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON4': '0.400', 'weapon4': '0.712', 'WEAPON3': '1.150', 'weapon3': '2.342', 'HITCOUNT': '2.400', 'DAMAGECOUNT': '10.464', 'FRAGCOUNT': '28.000'} [2023-02-24 20:53:14,681][213366] DAMAGECOUNT value on done: 228734.0 [2023-02-24 20:53:14,682][213366] Sum rewards: 44.309, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.430', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.044', 'AMMO4': '0.133', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.320', 'weapon2': '0.658', 'WEAPON3': '0.950', 'HITCOUNT': '2.480', 'weapon3': '2.768', 'DAMAGECOUNT': '10.782', 'FRAGCOUNT': '38.000'} [2023-02-24 20:53:14,737][213368] DAMAGECOUNT value on done: 223387.0 [2023-02-24 20:53:14,738][213368] Sum rewards: 53.615, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.830', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.122', 'AMMO4': '0.136', 'AMMO3': '0.182', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.310', 'weapon4': '0.626', 'WEAPON3': '1.200', 'weapon3': '2.658', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '12.864', 'FRAGCOUNT': '48.000'} [2023-02-24 20:53:14,853][213383] DAMAGECOUNT value on done: 224567.0 [2023-02-24 20:53:14,853][213383] Sum rewards: 30.692, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.090', 'AMMO5': '0.014', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.202', 'weapon2': '0.282', 'weapon5': '0.282', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.666', 'WEAPON3': '1.250', 'HITCOUNT': '2.060', 'weapon3': '2.514', 'DAMAGECOUNT': '9.213', 'FRAGCOUNT': '29.000'} [2023-02-24 20:53:14,885][213382] DAMAGECOUNT value on done: 222166.0 [2023-02-24 20:53:14,885][213382] Sum rewards: 39.490, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.530', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.137', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon5': '0.260', 'weapon4': '0.346', 'weapon2': '0.382', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.634', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.375', 'FRAGCOUNT': '38.000'} [2023-02-24 20:53:15,045][213368] DAMAGECOUNT value on done: 225084.0 [2023-02-24 20:53:15,046][213368] Sum rewards: 39.505, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.245', 'ARMOR': '0.004', 'AMMO5': '0.019', 'weapon7': '0.048', 'AMMO2': '0.051', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.183', 'WEAPON7': '0.200', 'AMMO4': '0.254', 'weapon5': '0.332', 'weapon2': '0.350', 'weapon4': '0.472', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.050', 'HITCOUNT': '2.340', 'weapon3': '2.452', 'DAMAGECOUNT': '11.655', 'FRAGCOUNT': '36.000'} [2023-02-24 20:53:15,122][213369] DAMAGECOUNT value on done: 229350.0 [2023-02-24 20:53:15,123][213369] Sum rewards: 31.836, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.301', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.143', 'AMMO3': '0.176', 'weapon5': '0.204', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.412', 'weapon2': '0.866', 'WEAPON3': '1.050', 'HITCOUNT': '2.060', 'weapon3': '2.282', 'DAMAGECOUNT': '9.855', 'FRAGCOUNT': '29.000'} [2023-02-24 20:53:15,160][213383] DAMAGECOUNT value on done: 227574.0 [2023-02-24 20:53:15,160][213383] Sum rewards: 33.308, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.562', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.054', 'AMMO3': '0.155', 'AMMO4': '0.268', 'weapon5': '0.354', 'weapon2': '0.452', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '0.900', 'weapon4': '1.014', 'weapon3': '1.894', 'HITCOUNT': '2.120', 'DAMAGECOUNT': '10.689', 'FRAGCOUNT': '31.000'} [2023-02-24 20:53:15,187][213382] DAMAGECOUNT value on done: 225307.0 [2023-02-24 20:53:15,188][213382] Sum rewards: 26.584, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.249', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.057', 'AMMO3': '0.147', 'AMMO4': '0.285', 'weapon5': '0.294', 'weapon2': '0.536', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '0.900', 'weapon4': '1.304', 'weapon3': '1.520', 'HITCOUNT': '2.200', 'DAMAGECOUNT': '9.312', 'FRAGCOUNT': '25.500'} [2023-02-24 20:53:15,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 123117568. Throughput: 0: 3358.4. Samples: 5775364. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 20:53:15,243][213332] Avg episode reward: [(0, '36.927')] [2023-02-24 20:53:15,247][213352] Saving new best policy, reward=36.927! [2023-02-24 20:53:15,353][213368] DAMAGECOUNT value on done: 229464.0 [2023-02-24 20:53:15,354][213368] Sum rewards: 31.716, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.500', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.073', 'AMMO3': '0.166', 'weapon5': '0.218', 'weapon2': '0.350', 'AMMO4': '0.364', 'WEAPON5': '0.400', 'WEAPON4': '0.850', 'weapon4': '0.928', 'WEAPON3': '0.950', 'weapon3': '2.092', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '9.864', 'FRAGCOUNT': '32.000'} [2023-02-24 20:53:15,444][213369] DAMAGECOUNT value on done: 227959.0 [2023-02-24 20:53:15,444][213369] Sum rewards: 31.055, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.286', 'AMMO5': '0.014', 'AMMO2': '0.036', 'AMMO4': '0.181', 'AMMO3': '0.219', 'weapon5': '0.254', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.338', 'weapon2': '0.546', 'WEAPON3': '1.300', 'HITCOUNT': '2.450', 'weapon3': '2.504', 'DAMAGECOUNT': '11.148', 'FRAGCOUNT': '29.500'} [2023-02-24 20:53:15,494][213382] DAMAGECOUNT value on done: 221082.0 [2023-02-24 20:53:15,495][213382] Sum rewards: 39.284, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.872', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon5': '0.100', 'weapon2': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'weapon4': '0.486', 'WEAPON3': '1.300', 'HITCOUNT': '2.580', 'weapon3': '3.042', 'DAMAGECOUNT': '11.694', 'FRAGCOUNT': '36.000'} [2023-02-24 20:53:15,591][213384] DAMAGECOUNT value on done: 231739.0 [2023-02-24 20:53:15,591][213384] Sum rewards: 45.746, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.105', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.144', 'AMMO4': '0.176', 'AMMO3': '0.199', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.320', 'weapon4': '0.328', 'WEAPON3': '1.150', 'HITCOUNT': '2.770', 'weapon3': '2.956', 'DAMAGECOUNT': '12.210', 'FRAGCOUNT': '41.000'} [2023-02-24 20:53:15,655][213368] DAMAGECOUNT value on done: 220393.0 [2023-02-24 20:53:15,656][213368] Sum rewards: 30.933, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.827', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.003', 'ARMOR': '0.004', 'weapon5': '0.012', 'weapon7': '0.048', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.292', 'WEAPON3': '0.400', 'weapon2': '1.232', 'HITCOUNT': '1.600', 'weapon3': '1.626', 'DAMAGECOUNT': '6.450', 'FRAGCOUNT': '24.000'} [2023-02-24 20:53:15,748][213369] DAMAGECOUNT value on done: 230504.0 [2023-02-24 20:53:15,748][213369] Sum rewards: 28.238, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.784', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.116', 'AMMO3': '0.135', 'weapon5': '0.208', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.518', 'WEAPON3': '0.800', 'weapon4': '1.392', 'weapon3': '1.576', 'HITCOUNT': '2.260', 'DAMAGECOUNT': '8.277', 'FRAGCOUNT': '26.000'} [2023-02-24 20:53:15,763][213383] DAMAGECOUNT value on done: 225454.0 [2023-02-24 20:53:15,764][213383] Sum rewards: 40.727, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.372', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon2': '0.116', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'weapon5': '0.224', 'weapon4': '0.504', 'WEAPON3': '1.100', 'HITCOUNT': '2.320', 'weapon3': '2.632', 'DAMAGECOUNT': '10.749', 'FRAGCOUNT': '35.000'} [2023-02-24 20:53:15,798][213382] DAMAGECOUNT value on done: 227926.0 [2023-02-24 20:53:15,799][213382] Sum rewards: 28.561, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.940', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.218', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon4': '0.270', 'WEAPON5': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.350', 'HITCOUNT': '2.320', 'weapon3': '2.720', 'DAMAGECOUNT': '9.258', 'FRAGCOUNT': '29.000'} [2023-02-24 20:53:15,887][213384] DAMAGECOUNT value on done: 216533.0 [2023-02-24 20:53:15,888][213384] Sum rewards: 52.343, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.722', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon5': '0.146', 'AMMO3': '0.172', 'weapon2': '0.232', 'AMMO4': '0.261', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.722', 'WEAPON3': '1.050', 'weapon3': '2.552', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.308', 'FRAGCOUNT': '47.000'} [2023-02-24 20:53:16,044][213369] DAMAGECOUNT value on done: 217441.0 [2023-02-24 20:53:16,044][213369] Sum rewards: 45.712, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.766', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.159', 'weapon5': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON4': '0.400', 'weapon4': '0.660', 'WEAPON3': '0.950', 'weapon3': '2.474', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.170', 'FRAGCOUNT': '39.000'} [2023-02-24 20:53:16,052][213384] DAMAGECOUNT value on done: 230829.0 [2023-02-24 20:53:16,052][213384] Sum rewards: 43.916, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.752', 'AMMO5': '0.013', 'AMMO2': '0.036', 'AMMO4': '0.178', 'AMMO3': '0.182', 'weapon5': '0.186', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON4': '0.400', 'ARMOR': '0.457', 'weapon4': '0.548', 'WEAPON3': '1.200', 'HITCOUNT': '2.510', 'weapon3': '2.620', 'DAMAGECOUNT': '11.385', 'FRAGCOUNT': '39.000'} [2023-02-24 20:53:16,061][213383] DAMAGECOUNT value on done: 220959.0 [2023-02-24 20:53:16,062][213383] Sum rewards: 41.141, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.095', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.120', 'AMMO3': '0.170', 'weapon4': '0.402', 'weapon2': '0.436', 'WEAPON3': '1.150', 'HITCOUNT': '2.510', 'weapon3': '2.888', 'DAMAGECOUNT': '10.281', 'FRAGCOUNT': '37.000'} [2023-02-24 20:53:16,349][213384] DAMAGECOUNT value on done: 230695.0 [2023-02-24 20:53:16,349][213384] Sum rewards: 29.430, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.002', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.048', 'AMMO4': '0.140', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.366', 'weapon4': '0.776', 'WEAPON3': '1.000', 'HITCOUNT': '2.290', 'weapon3': '2.594', 'DAMAGECOUNT': '9.264', 'FRAGCOUNT': '27.000'} [2023-02-24 20:53:17,508][213365] Updated weights for policy 0, policy_version 30066 (0.0009) [2023-02-24 20:53:19,772][213384] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 20:53:20,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13440.4). Total num frames: 123187200. Throughput: 0: 3357.5. Samples: 5785546. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 20:53:20,244][213332] Avg episode reward: [(0, '36.977')] [2023-02-24 20:53:20,244][213352] Saving new best policy, reward=36.977! [2023-02-24 20:53:20,543][213365] Updated weights for policy 0, policy_version 30076 (0.0009) [2023-02-24 20:53:23,576][213365] Updated weights for policy 0, policy_version 30086 (0.0009) [2023-02-24 20:53:25,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 123252736. Throughput: 0: 3358.6. Samples: 5805702. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 20:53:25,243][213332] Avg episode reward: [(0, '36.977')] [2023-02-24 20:53:26,643][213365] Updated weights for policy 0, policy_version 30096 (0.0010) [2023-02-24 20:53:28,465][213372] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200.0), ('weapon5', 0.002)] [2023-02-24 20:53:29,715][213365] Updated weights for policy 0, policy_version 30106 (0.0009) [2023-02-24 20:53:30,243][213332] Fps is (10 sec: 13107.2, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 123318272. Throughput: 0: 3358.9. Samples: 5825802. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 20:53:30,243][213332] Avg episode reward: [(0, '36.977')] [2023-02-24 20:53:32,721][213365] Updated weights for policy 0, policy_version 30116 (0.0009) [2023-02-24 20:53:33,122][213367] DAMAGECOUNT value on done: 227242.0 [2023-02-24 20:53:33,123][213367] Sum rewards: 52.279, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.410', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.104', 'AMMO4': '0.113', 'AMMO3': '0.173', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.366', 'weapon4': '0.394', 'WEAPON3': '1.100', 'weapon3': '2.848', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.548', 'FRAGCOUNT': '45.000'} [2023-02-24 20:53:33,431][213367] DAMAGECOUNT value on done: 229111.0 [2023-02-24 20:53:33,432][213367] Sum rewards: 43.207, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.793', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO4': '0.187', 'weapon5': '0.202', 'AMMO3': '0.217', 'weapon2': '0.336', 'weapon4': '0.408', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '2.670', 'weapon3': '2.766', 'DAMAGECOUNT': '12.153', 'FRAGCOUNT': '39.000'} [2023-02-24 20:53:33,743][213367] DAMAGECOUNT value on done: 236462.0 [2023-02-24 20:53:33,743][213367] Sum rewards: 34.060, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.840', 'AMMO5': '0.006', 'AMMO2': '0.037', 'weapon7': '0.094', 'AMMO3': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.124', 'AMMO4': '0.183', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.450', 'WEAPON3': '0.550', 'weapon4': '0.640', 'weapon2': '0.816', 'HITCOUNT': '1.680', 'weapon3': '1.770', 'DAMAGECOUNT': '8.562', 'FRAGCOUNT': '29.000'} [2023-02-24 20:53:33,888][213372] DAMAGECOUNT value on done: 233118.0 [2023-02-24 20:53:33,889][213372] Sum rewards: 46.061, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.042', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon4': '0.182', 'weapon2': '0.232', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon5': '0.252', 'WEAPON3': '1.450', 'HITCOUNT': '2.670', 'weapon3': '3.008', 'DAMAGECOUNT': '12.906', 'FRAGCOUNT': '43.000'} [2023-02-24 20:53:34,064][213367] DAMAGECOUNT value on done: 229235.0 [2023-02-24 20:53:34,064][213367] Sum rewards: 42.289, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.450', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.172', 'AMMO4': '0.193', 'AMMO3': '0.194', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON4': '0.400', 'weapon4': '0.600', 'WEAPON3': '1.100', 'HITCOUNT': '2.570', 'weapon3': '2.636', 'DAMAGECOUNT': '12.186', 'FRAGCOUNT': '38.000'} [2023-02-24 20:53:34,083][213366] DAMAGECOUNT value on done: 227753.0 [2023-02-24 20:53:34,083][213366] Sum rewards: 45.309, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.010', 'ARMOR': '0.004', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.033', 'weapon5': '0.152', 'AMMO4': '0.164', 'WEAPON5': '0.200', 'weapon2': '0.212', 'AMMO3': '0.257', 'WEAPON4': '0.350', 'weapon4': '0.444', 'WEAPON3': '1.500', 'weapon3': '2.778', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.395', 'FRAGCOUNT': '42.500'} [2023-02-24 20:53:34,206][213372] DAMAGECOUNT value on done: 234258.0 [2023-02-24 20:53:34,206][213372] Sum rewards: 38.558, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.920', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'AMMO4': '0.173', 'WEAPON4': '0.300', 'weapon4': '0.314', 'weapon2': '0.362', 'WEAPON3': '1.000', 'HITCOUNT': '2.450', 'weapon3': '3.002', 'DAMAGECOUNT': '10.644', 'FRAGCOUNT': '33.000'} [2023-02-24 20:53:34,259][213372] DAMAGECOUNT value on done: 227852.0 [2023-02-24 20:53:34,260][213372] Sum rewards: 41.981, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.142', 'AMMO5': '0.011', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.163', 'weapon2': '0.252', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon5': '0.370', 'weapon4': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.630', 'weapon3': '2.720', 'DAMAGECOUNT': '12.303', 'FRAGCOUNT': '37.000'} [2023-02-24 20:53:34,317][213366] DAMAGECOUNT value on done: 232195.0 [2023-02-24 20:53:34,317][213366] Sum rewards: 33.785, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.647', 'AMMO5': '0.016', 'AMMO2': '0.045', 'AMMO3': '0.141', 'AMMO4': '0.223', 'weapon5': '0.338', 'WEAPON5': '0.400', 'weapon2': '0.434', 'WEAPON4': '0.500', 'WEAPON3': '0.850', 'weapon4': '0.918', 'weapon3': '2.012', 'HITCOUNT': '2.140', 'DAMAGECOUNT': '9.915', 'FRAGCOUNT': '31.000'} [2023-02-24 20:53:34,421][213366] DAMAGECOUNT value on done: 236785.0 [2023-02-24 20:53:34,421][213366] Sum rewards: 29.901, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.188', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.124', 'AMMO3': '0.161', 'AMMO4': '0.164', 'WEAPON5': '0.200', 'weapon2': '0.268', 'WEAPON4': '0.400', 'weapon4': '0.490', 'WEAPON3': '1.000', 'HITCOUNT': '2.210', 'weapon3': '2.826', 'DAMAGECOUNT': '10.203', 'FRAGCOUNT': '27.500'} [2023-02-24 20:53:34,570][213372] DAMAGECOUNT value on done: 224789.0 [2023-02-24 20:53:34,570][213372] Sum rewards: 31.062, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.220', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.073', 'AMMO3': '0.154', 'weapon5': '0.226', 'AMMO4': '0.364', 'WEAPON5': '0.450', 'weapon2': '0.598', 'WEAPON4': '0.800', 'WEAPON3': '0.950', 'weapon4': '1.006', 'weapon3': '1.798', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '11.004', 'FRAGCOUNT': '30.000'} [2023-02-24 20:53:34,630][213366] DAMAGECOUNT value on done: 232558.0 [2023-02-24 20:53:34,630][213366] Sum rewards: 35.680, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.352', 'WEAPON1': '0.020', 'AMMO5': '0.028', 'AMMO2': '0.045', 'AMMO3': '0.177', 'AMMO4': '0.224', 'weapon5': '0.324', 'weapon2': '0.534', 'WEAPON4': '0.550', 'weapon4': '0.620', 'WEAPON5': '0.700', 'WEAPON3': '1.000', 'weapon3': '2.088', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '11.472', 'FRAGCOUNT': '32.000'} [2023-02-24 20:53:34,735][213368] DAMAGECOUNT value on done: 226317.0 [2023-02-24 20:53:34,735][213368] Sum rewards: 24.829, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.555', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.019', 'weapon5': '0.054', 'AMMO4': '0.093', 'WEAPON5': '0.250', 'AMMO3': '0.296', 'WEAPON4': '0.300', 'weapon2': '0.454', 'weapon4': '0.494', 'WEAPON3': '1.700', 'HITCOUNT': '2.010', 'weapon3': '2.658', 'DAMAGECOUNT': '8.790', 'FRAGCOUNT': '30.000'} [2023-02-24 20:53:34,869][213383] DAMAGECOUNT value on done: 228640.0 [2023-02-24 20:53:34,869][213383] Sum rewards: 43.694, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.740', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon5': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'weapon4': '0.542', 'weapon2': '0.580', 'WEAPON3': '1.150', 'weapon3': '2.622', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '12.219', 'FRAGCOUNT': '38.000'} [2023-02-24 20:53:34,964][213382] DAMAGECOUNT value on done: 226253.0 [2023-02-24 20:53:34,965][213382] Sum rewards: 40.838, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.006', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon5': '0.142', 'AMMO3': '0.224', 'weapon4': '0.230', 'AMMO4': '0.246', 'weapon2': '0.388', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.610', 'weapon3': '2.974', 'DAMAGECOUNT': '12.261', 'FRAGCOUNT': '38.000'} [2023-02-24 20:53:35,035][213368] DAMAGECOUNT value on done: 228688.0 [2023-02-24 20:53:35,035][213368] Sum rewards: 39.186, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.769', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.035', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'AMMO4': '0.175', 'weapon2': '0.188', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'weapon4': '1.190', 'weapon3': '2.068', 'HITCOUNT': '2.400', 'DAMAGECOUNT': '10.812', 'FRAGCOUNT': '35.000'} [2023-02-24 20:53:35,063][213369] DAMAGECOUNT value on done: 233024.0 [2023-02-24 20:53:35,064][213369] Sum rewards: 41.100, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.515', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.141', 'AMMO3': '0.146', 'WEAPON5': '0.200', 'weapon5': '0.268', 'WEAPON4': '0.350', 'weapon2': '0.492', 'WEAPON3': '0.850', 'weapon4': '1.048', 'weapon3': '1.922', 'HITCOUNT': '2.390', 'DAMAGECOUNT': '11.022', 'FRAGCOUNT': '35.000'} [2023-02-24 20:53:35,179][213383] DAMAGECOUNT value on done: 230662.0 [2023-02-24 20:53:35,179][213383] Sum rewards: 36.529, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.335', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO5': '0.009', 'weapon4': '0.042', 'AMMO4': '0.044', 'weapon5': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.138', 'WEAPON5': '0.200', 'weapon2': '0.850', 'WEAPON3': '0.900', 'HITCOUNT': '2.080', 'weapon3': '2.878', 'DAMAGECOUNT': '9.264', 'FRAGCOUNT': '31.000'} [2023-02-24 20:53:35,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 123387904. Throughput: 0: 3358.9. Samples: 5836014. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 20:53:35,243][213332] Avg episode reward: [(0, '36.966')] [2023-02-24 20:53:35,265][213382] DAMAGECOUNT value on done: 229691.0 [2023-02-24 20:53:35,265][213382] Sum rewards: 43.282, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.465', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.144', 'AMMO4': '0.164', 'AMMO3': '0.201', 'weapon2': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.546', 'WEAPON3': '1.300', 'weapon3': '2.848', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.152', 'FRAGCOUNT': '37.000'} [2023-02-24 20:53:35,335][213368] DAMAGECOUNT value on done: 232733.0 [2023-02-24 20:53:35,335][213368] Sum rewards: 26.787, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.108', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO2': '0.051', 'AMMO3': '0.213', 'AMMO4': '0.253', 'weapon5': '0.350', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.462', 'weapon4': '0.596', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'HITCOUNT': '2.150', 'weapon3': '2.200', 'DAMAGECOUNT': '9.327', 'FRAGCOUNT': '28.000'} [2023-02-24 20:53:35,358][213369] DAMAGECOUNT value on done: 231764.0 [2023-02-24 20:53:35,359][213369] Sum rewards: 47.125, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.200', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.016', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.156', 'weapon4': '0.388', 'weapon2': '0.436', 'WEAPON3': '0.900', 'HITCOUNT': '2.640', 'weapon3': '2.716', 'DAMAGECOUNT': '11.415', 'FRAGCOUNT': '39.000'} [2023-02-24 20:53:35,541][213384] DAMAGECOUNT value on done: 235656.0 [2023-02-24 20:53:35,542][213384] Sum rewards: 42.389, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.207', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.028', 'AMMO4': '0.142', 'AMMO3': '0.179', 'weapon5': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.476', 'weapon2': '0.660', 'WEAPON3': '1.100', 'weapon3': '2.382', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '11.751', 'FRAGCOUNT': '38.000'} [2023-02-24 20:53:35,555][213382] DAMAGECOUNT value on done: 224442.0 [2023-02-24 20:53:35,556][213382] Sum rewards: 38.047, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.103', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.043', 'AMMO3': '0.145', 'AMMO4': '0.213', 'weapon5': '0.244', 'WEAPON5': '0.300', 'weapon2': '0.436', 'WEAPON4': '0.550', 'weapon4': '0.678', 'WEAPON3': '1.000', 'weapon3': '2.116', 'HITCOUNT': '2.330', 'DAMAGECOUNT': '10.080', 'FRAGCOUNT': '35.000'} [2023-02-24 20:53:35,639][213368] DAMAGECOUNT value on done: 223763.0 [2023-02-24 20:53:35,640][213368] Sum rewards: 34.835, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.746', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.091', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'weapon2': '0.368', 'weapon4': '0.382', 'WEAPON3': '1.400', 'HITCOUNT': '2.660', 'weapon3': '2.964', 'DAMAGECOUNT': '10.110', 'FRAGCOUNT': '33.000'} [2023-02-24 20:53:35,650][213369] DAMAGECOUNT value on done: 234361.0 [2023-02-24 20:53:35,650][213369] Sum rewards: 38.426, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.365', 'AMMO5': '0.011', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon2': '0.132', 'weapon5': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'weapon4': '0.352', 'WEAPON3': '1.450', 'HITCOUNT': '2.540', 'weapon3': '3.042', 'DAMAGECOUNT': '11.571', 'FRAGCOUNT': '36.000'} [2023-02-24 20:53:35,767][213383] DAMAGECOUNT value on done: 229116.0 [2023-02-24 20:53:35,768][213383] Sum rewards: 39.984, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.645', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.097', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon5': '0.206', 'weapon2': '0.230', 'weapon4': '0.444', 'WEAPON3': '1.100', 'HITCOUNT': '2.360', 'weapon3': '2.910', 'DAMAGECOUNT': '10.986', 'FRAGCOUNT': '34.000'} [2023-02-24 20:53:35,796][213365] Updated weights for policy 0, policy_version 30126 (0.0010) [2023-02-24 20:53:35,842][213384] DAMAGECOUNT value on done: 219730.0 [2023-02-24 20:53:35,843][213384] Sum rewards: 36.903, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.266', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.074', 'weapon5': '0.116', 'AMMO3': '0.192', 'weapon2': '0.480', 'WEAPON3': '1.050', 'HITCOUNT': '2.120', 'weapon3': '3.148', 'DAMAGECOUNT': '9.591', 'FRAGCOUNT': '33.000'} [2023-02-24 20:53:35,857][213382] DAMAGECOUNT value on done: 231080.0 [2023-02-24 20:53:35,857][213382] Sum rewards: 28.312, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.855', 'AMMO5': '0.012', 'AMMO2': '0.063', 'AMMO3': '0.203', 'AMMO4': '0.313', 'weapon5': '0.322', 'weapon2': '0.354', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'weapon4': '0.782', 'WEAPON3': '1.150', 'weapon3': '2.226', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '9.462', 'FRAGCOUNT': '30.000'} [2023-02-24 20:53:35,947][213369] DAMAGECOUNT value on done: 220846.0 [2023-02-24 20:53:35,948][213369] Sum rewards: 37.547, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.103', 'AMMO5': '0.012', 'AMMO2': '0.040', 'AMMO3': '0.151', 'weapon5': '0.188', 'AMMO4': '0.201', 'weapon2': '0.220', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '0.850', 'weapon4': '0.852', 'weapon3': '2.200', 'HITCOUNT': '2.370', 'DAMAGECOUNT': '10.215', 'FRAGCOUNT': '32.500'} [2023-02-24 20:53:35,992][213384] DAMAGECOUNT value on done: 234813.0 [2023-02-24 20:53:35,993][213384] Sum rewards: 37.279, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.922', 'AMMO5': '0.017', 'AMMO2': '0.042', 'AMMO4': '0.210', 'AMMO3': '0.256', 'weapon5': '0.268', 'weapon2': '0.310', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.570', 'WEAPON3': '1.500', 'weapon3': '2.482', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '11.946', 'FRAGCOUNT': '38.000'} [2023-02-24 20:53:36,050][213383] DAMAGECOUNT value on done: 224467.0 [2023-02-24 20:53:36,051][213383] Sum rewards: 32.795, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.754', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.154', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.328', 'weapon2': '0.432', 'WEAPON3': '1.100', 'HITCOUNT': '2.330', 'weapon3': '2.786', 'DAMAGECOUNT': '10.524', 'FRAGCOUNT': '30.000'} [2023-02-24 20:53:36,293][213384] DAMAGECOUNT value on done: 235110.0 [2023-02-24 20:53:36,293][213384] Sum rewards: 48.861, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.066', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.127', 'AMMO3': '0.148', 'weapon5': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.636', 'weapon4': '0.710', 'WEAPON3': '0.900', 'weapon3': '2.290', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.245', 'FRAGCOUNT': '38.000'} [2023-02-24 20:53:38,804][213365] Updated weights for policy 0, policy_version 30136 (0.0009) [2023-02-24 20:53:40,243][213332] Fps is (10 sec: 13516.6, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 123453440. Throughput: 0: 3360.1. Samples: 5856200. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:53:40,243][213332] Avg episode reward: [(0, '37.258')] [2023-02-24 20:53:40,244][213352] Saving new best policy, reward=37.258! [2023-02-24 20:53:41,813][213365] Updated weights for policy 0, policy_version 30146 (0.0009) [2023-02-24 20:53:44,909][213365] Updated weights for policy 0, policy_version 30156 (0.0009) [2023-02-24 20:53:45,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 123523072. Throughput: 0: 3363.4. Samples: 5876302. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:53:45,243][213332] Avg episode reward: [(0, '37.258')] [2023-02-24 20:53:47,920][213365] Updated weights for policy 0, policy_version 30166 (0.0009) [2023-02-24 20:53:50,243][213332] Fps is (10 sec: 13517.0, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 123588608. Throughput: 0: 3364.0. Samples: 5886534. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:53:50,243][213332] Avg episode reward: [(0, '37.258')] [2023-02-24 20:53:50,985][213365] Updated weights for policy 0, policy_version 30176 (0.0009) [2023-02-24 20:53:53,061][213367] DAMAGECOUNT value on done: 230040.0 [2023-02-24 20:53:53,061][213367] Sum rewards: 31.937, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.119', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.033', 'AMMO3': '0.100', 'AMMO4': '0.167', 'weapon5': '0.194', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '0.600', 'weapon4': '0.634', 'weapon2': '0.800', 'HITCOUNT': '2.020', 'weapon3': '2.152', 'DAMAGECOUNT': '8.394', 'FRAGCOUNT': '26.000'} [2023-02-24 20:53:53,389][213367] DAMAGECOUNT value on done: 232779.0 [2023-02-24 20:53:53,389][213367] Sum rewards: 36.948, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.906', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.132', 'AMMO3': '0.169', 'AMMO4': '0.204', 'WEAPON5': '0.250', 'weapon4': '0.444', 'WEAPON4': '0.450', 'weapon2': '0.540', 'WEAPON3': '0.900', 'HITCOUNT': '2.570', 'weapon3': '2.640', 'DAMAGECOUNT': '11.004', 'FRAGCOUNT': '32.000'} [2023-02-24 20:53:53,722][213367] DAMAGECOUNT value on done: 239529.0 [2023-02-24 20:53:53,722][213372] DAMAGECOUNT value on done: 236527.0 [2023-02-24 20:53:53,723][213367] Sum rewards: 31.809, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.024', 'AMMO5': '0.017', 'AMMO2': '0.025', 'AMMO4': '0.126', 'AMMO3': '0.151', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon5': '0.452', 'weapon2': '0.564', 'weapon4': '0.628', 'WEAPON3': '1.000', 'weapon3': '2.008', 'HITCOUNT': '2.260', 'DAMAGECOUNT': '9.201', 'FRAGCOUNT': '28.000'} [2023-02-24 20:53:53,723][213372] Sum rewards: 36.222, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.512', 'AMMO5': '0.008', 'AMMO2': '0.043', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'AMMO4': '0.213', 'weapon2': '0.236', 'weapon5': '0.254', 'WEAPON4': '0.450', 'weapon4': '0.816', 'WEAPON3': '1.050', 'HITCOUNT': '2.360', 'weapon3': '2.442', 'DAMAGECOUNT': '10.227', 'FRAGCOUNT': '35.000'} [2023-02-24 20:53:54,031][213367] DAMAGECOUNT value on done: 232934.0 [2023-02-24 20:53:54,031][213367] Sum rewards: 35.637, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.764', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon2': '0.154', 'weapon5': '0.172', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.562', 'WEAPON3': '1.200', 'HITCOUNT': '2.460', 'weapon3': '2.646', 'DAMAGECOUNT': '11.097', 'FRAGCOUNT': '31.000'} [2023-02-24 20:53:54,033][213372] DAMAGECOUNT value on done: 238309.0 [2023-02-24 20:53:54,034][213372] Sum rewards: 41.140, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.563', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'weapon4': '0.082', 'weapon2': '0.112', 'AMMO3': '0.194', 'WEAPON3': '1.400', 'HITCOUNT': '2.730', 'weapon3': '3.702', 'DAMAGECOUNT': '12.153', 'FRAGCOUNT': '36.000'} [2023-02-24 20:53:54,076][213365] Updated weights for policy 0, policy_version 30186 (0.0009) [2023-02-24 20:53:54,088][213372] DAMAGECOUNT value on done: 231051.0 [2023-02-24 20:53:54,089][213372] Sum rewards: 29.325, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.995', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO4': '0.085', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'weapon4': '0.234', 'weapon2': '0.366', 'WEAPON3': '1.450', 'HITCOUNT': '2.210', 'weapon3': '3.074', 'DAMAGECOUNT': '9.582', 'FRAGCOUNT': '29.000'} [2023-02-24 20:53:54,095][213366] DAMAGECOUNT value on done: 232283.0 [2023-02-24 20:53:54,096][213366] Sum rewards: 46.404, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.633', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.216', 'AMMO3': '0.237', 'weapon2': '0.306', 'WEAPON4': '0.350', 'weapon4': '0.414', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.628', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.380', 'FRAGCOUNT': '43.000'} [2023-02-24 20:53:54,302][213366] DAMAGECOUNT value on done: 236465.0 [2023-02-24 20:53:54,303][213366] Sum rewards: 41.863, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.684', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO3': '0.159', 'AMMO4': '0.180', 'weapon5': '0.286', 'weapon2': '0.324', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '0.950', 'weapon4': '1.174', 'weapon3': '1.812', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.810', 'FRAGCOUNT': '38.000'} [2023-02-24 20:53:54,396][213372] DAMAGECOUNT value on done: 227865.0 [2023-02-24 20:53:54,397][213372] Sum rewards: 33.169, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.562', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'AMMO3': '0.154', 'AMMO4': '0.181', 'weapon2': '0.418', 'WEAPON4': '0.450', 'weapon4': '0.816', 'WEAPON3': '0.950', 'weapon3': '2.546', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '9.228', 'FRAGCOUNT': '30.000'} [2023-02-24 20:53:54,418][213366] DAMAGECOUNT value on done: 240718.0 [2023-02-24 20:53:54,418][213366] Sum rewards: 37.451, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.914', 'AMMO5': '0.020', 'AMMO2': '0.057', 'AMMO3': '0.160', 'weapon5': '0.278', 'AMMO4': '0.285', 'weapon2': '0.400', 'weapon4': '0.506', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.000', 'HITCOUNT': '2.440', 'weapon3': '2.470', 'DAMAGECOUNT': '11.799', 'FRAGCOUNT': '34.000'} [2023-02-24 20:53:54,622][213366] DAMAGECOUNT value on done: 236166.0 [2023-02-24 20:53:54,623][213366] Sum rewards: 39.566, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.938', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO3': '0.131', 'AMMO4': '0.160', 'weapon5': '0.266', 'weapon2': '0.286', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '0.750', 'weapon4': '0.890', 'weapon3': '2.346', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '10.824', 'FRAGCOUNT': '33.500'} [2023-02-24 20:53:54,673][213368] DAMAGECOUNT value on done: 230383.0 [2023-02-24 20:53:54,673][213368] Sum rewards: 41.884, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.685', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.062', 'AMMO4': '0.124', 'weapon5': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'weapon2': '0.238', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '2.580', 'weapon3': '3.118', 'DAMAGECOUNT': '12.198', 'FRAGCOUNT': '36.000'} [2023-02-24 20:53:54,924][213383] DAMAGECOUNT value on done: 232626.0 [2023-02-24 20:53:54,925][213383] Sum rewards: 43.588, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.318', 'AMMO5': '0.014', 'AMMO2': '0.017', 'weapon4': '0.028', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'AMMO3': '0.215', 'weapon5': '0.268', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.250', 'HITCOUNT': '2.730', 'weapon3': '3.022', 'DAMAGECOUNT': '11.958', 'FRAGCOUNT': '38.000'} [2023-02-24 20:53:54,957][213382] DAMAGECOUNT value on done: 230130.0 [2023-02-24 20:53:54,957][213382] Sum rewards: 41.002, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.198', 'AMMO5': '0.009', 'AMMO2': '0.017', 'AMMO4': '0.085', 'AMMO3': '0.159', 'weapon5': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.378', 'WEAPON3': '1.000', 'weapon4': '1.176', 'weapon3': '2.088', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '11.631', 'FRAGCOUNT': '36.000'} [2023-02-24 20:53:55,004][213368] DAMAGECOUNT value on done: 232131.0 [2023-02-24 20:53:55,004][213368] Sum rewards: 39.577, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.020', 'AMMO5': '0.005', 'AMMO2': '0.010', 'ARMOR': '0.012', 'AMMO4': '0.048', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon2': '0.530', 'weapon4': '0.576', 'WEAPON3': '1.250', 'weapon3': '2.610', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '10.329', 'FRAGCOUNT': '35.000'} [2023-02-24 20:53:55,027][213369] DAMAGECOUNT value on done: 236303.0 [2023-02-24 20:53:55,028][213369] Sum rewards: 37.191, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.790', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO3': '0.131', 'weapon5': '0.186', 'AMMO4': '0.226', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '0.750', 'weapon2': '0.776', 'weapon4': '1.234', 'weapon3': '1.540', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '9.837', 'FRAGCOUNT': '35.000'} [2023-02-24 20:53:55,229][213383] DAMAGECOUNT value on done: 234055.0 [2023-02-24 20:53:55,229][213383] Sum rewards: 30.753, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.430', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.035', 'AMMO4': '0.175', 'weapon4': '0.242', 'weapon5': '0.248', 'weapon2': '0.252', 'AMMO3': '0.286', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '2.140', 'weapon3': '2.756', 'DAMAGECOUNT': '10.179', 'FRAGCOUNT': '34.000'} [2023-02-24 20:53:55,243][213332] Fps is (10 sec: 13107.3, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 123654144. Throughput: 0: 3364.0. Samples: 5906670. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:53:55,243][213332] Avg episode reward: [(0, '37.406')] [2023-02-24 20:53:55,246][213352] Saving new best policy, reward=37.406! [2023-02-24 20:53:55,266][213382] DAMAGECOUNT value on done: 232957.0 [2023-02-24 20:53:55,267][213382] Sum rewards: 36.640, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.754', 'AMMO5': '0.020', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.184', 'AMMO3': '0.186', 'weapon4': '0.234', 'WEAPON4': '0.350', 'weapon2': '0.496', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.290', 'weapon3': '2.772', 'DAMAGECOUNT': '9.798', 'FRAGCOUNT': '33.000'} [2023-02-24 20:53:55,295][213368] DAMAGECOUNT value on done: 236159.0 [2023-02-24 20:53:55,297][213368] Sum rewards: 32.918, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.350', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon5': '0.128', 'weapon4': '0.154', 'AMMO4': '0.156', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.420', 'WEAPON3': '1.100', 'HITCOUNT': '2.470', 'weapon3': '3.050', 'DAMAGECOUNT': '10.278', 'FRAGCOUNT': '31.000'} [2023-02-24 20:53:55,333][213369] DAMAGECOUNT value on done: 234125.0 [2023-02-24 20:53:55,333][213369] Sum rewards: 23.910, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.414', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.116', 'AMMO4': '0.150', 'weapon2': '0.156', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.782', 'WEAPON3': '1.000', 'HITCOUNT': '1.720', 'weapon3': '1.960', 'DAMAGECOUNT': '7.083', 'FRAGCOUNT': '24.000'} [2023-02-24 20:53:55,480][213384] DAMAGECOUNT value on done: 238474.0 [2023-02-24 20:53:55,480][213384] Sum rewards: 29.809, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.146', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.046', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'WEAPON4': '0.250', 'weapon4': '0.430', 'weapon2': '0.726', 'WEAPON3': '0.950', 'HITCOUNT': '2.030', 'weapon3': '2.602', 'DAMAGECOUNT': '8.454', 'FRAGCOUNT': '27.000'} [2023-02-24 20:53:55,563][213382] DAMAGECOUNT value on done: 228359.0 [2023-02-24 20:53:55,564][213382] Sum rewards: 39.934, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.848', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.164', 'AMMO3': '0.175', 'weapon5': '0.254', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.386', 'ARMOR': '0.404', 'weapon4': '0.430', 'WEAPON3': '1.100', 'HITCOUNT': '2.320', 'weapon3': '2.602', 'DAMAGECOUNT': '11.751', 'FRAGCOUNT': '35.000'} [2023-02-24 20:53:55,616][213368] DAMAGECOUNT value on done: 226842.0 [2023-02-24 20:53:55,616][213368] Sum rewards: 32.314, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.577', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon5': '0.138', 'AMMO4': '0.188', 'AMMO3': '0.198', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.532', 'weapon4': '0.560', 'WEAPON3': '1.150', 'HITCOUNT': '2.320', 'weapon3': '2.464', 'DAMAGECOUNT': '9.237', 'FRAGCOUNT': '32.000'} [2023-02-24 20:53:55,639][213369] DAMAGECOUNT value on done: 237718.0 [2023-02-24 20:53:55,639][213369] Sum rewards: 36.422, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.095', 'AMMO5': '0.011', 'AMMO2': '0.018', 'weapon4': '0.036', 'AMMO4': '0.087', 'weapon5': '0.130', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.200', 'HITCOUNT': '2.430', 'weapon3': '3.146', 'DAMAGECOUNT': '10.071', 'FRAGCOUNT': '33.000'} [2023-02-24 20:53:55,774][213384] DAMAGECOUNT value on done: 223215.0 [2023-02-24 20:53:55,774][213384] Sum rewards: 33.297, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.936', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon5': '0.098', 'AMMO4': '0.167', 'AMMO3': '0.171', 'WEAPON5': '0.350', 'weapon4': '0.404', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'weapon2': '1.056', 'weapon3': '2.192', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '10.308', 'FRAGCOUNT': '30.000'} [2023-02-24 20:53:55,838][213383] DAMAGECOUNT value on done: 233486.0 [2023-02-24 20:53:55,838][213383] Sum rewards: 48.777, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.975', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'weapon5': '0.148', 'weapon4': '0.410', 'weapon2': '0.566', 'WEAPON3': '0.850', 'weapon3': '2.606', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.107', 'FRAGCOUNT': '40.000'} [2023-02-24 20:53:55,868][213382] DAMAGECOUNT value on done: 235599.0 [2023-02-24 20:53:55,869][213382] Sum rewards: 49.093, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.470', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon2': '0.142', 'weapon5': '0.166', 'AMMO3': '0.182', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.728', 'WEAPON3': '1.050', 'weapon3': '2.740', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.557', 'FRAGCOUNT': '40.000'} [2023-02-24 20:53:55,933][213369] DAMAGECOUNT value on done: 224083.0 [2023-02-24 20:53:55,933][213369] Sum rewards: 33.519, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.667', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon5': '0.078', 'AMMO4': '0.136', 'weapon4': '0.174', 'AMMO3': '0.218', 'weapon2': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '2.280', 'weapon3': '3.212', 'DAMAGECOUNT': '9.711', 'FRAGCOUNT': '33.000'} [2023-02-24 20:53:55,947][213384] DAMAGECOUNT value on done: 238109.0 [2023-02-24 20:53:55,947][213384] Sum rewards: 29.283, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.624', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.106', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'weapon4': '0.472', 'weapon2': '0.706', 'WEAPON3': '1.300', 'HITCOUNT': '2.340', 'weapon3': '2.442', 'DAMAGECOUNT': '9.888', 'FRAGCOUNT': '28.000'} [2023-02-24 20:53:56,136][213383] DAMAGECOUNT value on done: 228360.0 [2023-02-24 20:53:56,136][213383] Sum rewards: 39.166, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.226', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.038', 'AMMO4': '0.192', 'AMMO3': '0.225', 'weapon4': '0.284', 'weapon5': '0.286', 'weapon2': '0.378', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.320', 'weapon3': '2.718', 'DAMAGECOUNT': '11.280', 'FRAGCOUNT': '38.000'} [2023-02-24 20:53:56,249][213384] DAMAGECOUNT value on done: 238846.0 [2023-02-24 20:53:56,249][213384] Sum rewards: 39.776, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.020', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon5': '0.110', 'AMMO4': '0.194', 'AMMO3': '0.200', 'weapon4': '0.228', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.426', 'WEAPON3': '1.200', 'HITCOUNT': '2.470', 'weapon3': '3.008', 'DAMAGECOUNT': '11.208', 'FRAGCOUNT': '37.000'} [2023-02-24 20:53:57,126][213365] Updated weights for policy 0, policy_version 30196 (0.0009) [2023-02-24 20:54:00,180][213365] Updated weights for policy 0, policy_version 30206 (0.0008) [2023-02-24 20:54:00,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 123723776. Throughput: 0: 3361.9. Samples: 5926650. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:54:00,243][213332] Avg episode reward: [(0, '37.464')] [2023-02-24 20:54:00,244][213352] Saving new best policy, reward=37.464! [2023-02-24 20:54:03,215][213365] Updated weights for policy 0, policy_version 30216 (0.0009) [2023-02-24 20:54:05,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 123789312. Throughput: 0: 3363.8. Samples: 5936916. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:54:05,243][213332] Avg episode reward: [(0, '37.464')] [2023-02-24 20:54:06,263][213365] Updated weights for policy 0, policy_version 30226 (0.0009) [2023-02-24 20:54:09,353][213365] Updated weights for policy 0, policy_version 30236 (0.0009) [2023-02-24 20:54:10,208][213367] Large shaping reward 2.529 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.507, 169.0), ('weapon5', 0.002)] [2023-02-24 20:54:10,243][213332] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13426.6). Total num frames: 123854848. Throughput: 0: 3360.8. Samples: 5956940. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:54:10,244][213332] Avg episode reward: [(0, '37.464')] [2023-02-24 20:54:12,370][213365] Updated weights for policy 0, policy_version 30246 (0.0009) [2023-02-24 20:54:13,150][213367] DAMAGECOUNT value on done: 233433.0 [2023-02-24 20:54:13,150][213367] Sum rewards: 32.983, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.030', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO3': '0.136', 'weapon5': '0.162', 'AMMO4': '0.194', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.636', 'WEAPON3': '0.750', 'weapon4': '0.756', 'weapon3': '2.098', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '10.149', 'FRAGCOUNT': '30.000'} [2023-02-24 20:54:13,464][213367] DAMAGECOUNT value on done: 236622.0 [2023-02-24 20:54:13,465][213367] Sum rewards: 37.514, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.101', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon5': '0.088', 'AMMO3': '0.190', 'AMMO4': '0.245', 'WEAPON5': '0.300', 'weapon2': '0.434', 'WEAPON4': '0.550', 'weapon4': '0.900', 'WEAPON3': '1.150', 'weapon3': '2.286', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '11.529', 'FRAGCOUNT': '35.000'} [2023-02-24 20:54:13,779][213372] DAMAGECOUNT value on done: 239430.0 [2023-02-24 20:54:13,780][213372] Sum rewards: 31.680, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.282', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.068', 'AMMO4': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon2': '0.648', 'weapon4': '0.758', 'WEAPON3': '0.950', 'weapon3': '2.222', 'HITCOUNT': '2.230', 'DAMAGECOUNT': '8.709', 'FRAGCOUNT': '26.000'} [2023-02-24 20:54:13,785][213367] DAMAGECOUNT value on done: 242941.0 [2023-02-24 20:54:13,786][213367] Sum rewards: 39.367, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.890', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'AMMO3': '0.175', 'weapon2': '0.238', 'WEAPON4': '0.350', 'weapon4': '0.610', 'WEAPON3': '1.200', 'HITCOUNT': '2.440', 'weapon3': '2.808', 'DAMAGECOUNT': '10.236', 'FRAGCOUNT': '35.000'} [2023-02-24 20:54:14,095][213372] DAMAGECOUNT value on done: 241098.0 [2023-02-24 20:54:14,095][213372] Sum rewards: 29.800, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.260', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.058', 'weapon5': '0.142', 'AMMO3': '0.160', 'AMMO4': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.950', 'weapon2': '1.110', 'HITCOUNT': '1.920', 'weapon3': '2.330', 'DAMAGECOUNT': '8.367', 'FRAGCOUNT': '28.000'} [2023-02-24 20:54:14,101][213367] DAMAGECOUNT value on done: 236282.0 [2023-02-24 20:54:14,101][213367] Sum rewards: 31.861, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.490', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.076', 'weapon4': '0.186', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'weapon2': '0.310', 'WEAPON3': '1.350', 'HITCOUNT': '2.440', 'weapon3': '3.148', 'DAMAGECOUNT': '10.044', 'FRAGCOUNT': '32.000'} [2023-02-24 20:54:14,109][213372] DAMAGECOUNT value on done: 234453.0 [2023-02-24 20:54:14,109][213372] Sum rewards: 29.447, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.019', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.100', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.265', 'weapon4': '0.306', 'weapon2': '0.432', 'WEAPON3': '1.500', 'HITCOUNT': '2.490', 'weapon3': '2.868', 'DAMAGECOUNT': '10.206', 'FRAGCOUNT': '30.000'} [2023-02-24 20:54:14,150][213366] DAMAGECOUNT value on done: 235707.0 [2023-02-24 20:54:14,150][213366] Sum rewards: 31.999, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.228', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.062', 'AMMO3': '0.202', 'weapon5': '0.206', 'AMMO4': '0.311', 'weapon2': '0.314', 'WEAPON5': '0.450', 'weapon4': '0.486', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.490', 'weapon3': '2.710', 'DAMAGECOUNT': '10.272', 'FRAGCOUNT': '31.500'} [2023-02-24 20:54:14,368][213366] DAMAGECOUNT value on done: 240872.0 [2023-02-24 20:54:14,369][213366] Sum rewards: 49.109, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.990', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.109', 'AMMO3': '0.148', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.250', 'weapon5': '0.308', 'weapon4': '0.528', 'WEAPON3': '0.950', 'weapon3': '2.580', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '13.221', 'FRAGCOUNT': '40.000'} [2023-02-24 20:54:14,417][213372] DAMAGECOUNT value on done: 232093.0 [2023-02-24 20:54:14,418][213372] Sum rewards: 44.615, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.816', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.168', 'AMMO3': '0.236', 'weapon2': '0.250', 'weapon4': '0.330', 'WEAPON3': '1.450', 'HITCOUNT': '2.890', 'weapon3': '2.958', 'DAMAGECOUNT': '12.684', 'FRAGCOUNT': '40.000'} [2023-02-24 20:54:14,465][213366] DAMAGECOUNT value on done: 243973.0 [2023-02-24 20:54:14,465][213366] Sum rewards: 36.085, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.751', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.120', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'AMMO4': '0.224', 'weapon2': '0.288', 'weapon4': '0.380', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'HITCOUNT': '2.430', 'weapon3': '2.940', 'DAMAGECOUNT': '9.765', 'FRAGCOUNT': '34.000'} [2023-02-24 20:54:14,688][213366] DAMAGECOUNT value on done: 238573.0 [2023-02-24 20:54:14,689][213366] Sum rewards: 25.525, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.895', 'AMMO5': '0.014', 'AMMO2': '0.020', 'AMMO4': '0.102', 'AMMO3': '0.149', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon5': '0.526', 'weapon2': '0.554', 'weapon4': '0.686', 'WEAPON3': '0.850', 'HITCOUNT': '1.630', 'weapon3': '1.754', 'DAMAGECOUNT': '6.735', 'FRAGCOUNT': '24.000'} [2023-02-24 20:54:14,714][213368] DAMAGECOUNT value on done: 234420.0 [2023-02-24 20:54:14,715][213368] Sum rewards: 42.902, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.884', 'AMMO5': '0.010', 'AMMO2': '0.041', 'AMMO3': '0.206', 'AMMO4': '0.206', 'weapon5': '0.234', 'WEAPON5': '0.250', 'weapon2': '0.370', 'WEAPON4': '0.400', 'weapon4': '0.672', 'WEAPON3': '1.200', 'weapon3': '2.396', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '12.000', 'FRAGCOUNT': '39.000'} [2023-02-24 20:54:14,930][213382] DAMAGECOUNT value on done: 234679.0 [2023-02-24 20:54:14,931][213382] Sum rewards: 40.687, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.530', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.124', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'weapon2': '0.360', 'weapon4': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.822', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.647', 'FRAGCOUNT': '35.000'} [2023-02-24 20:54:14,975][213383] DAMAGECOUNT value on done: 236258.0 [2023-02-24 20:54:14,976][213383] Sum rewards: 36.515, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.352', 'AMMO5': '0.018', 'AMMO2': '0.039', 'AMMO4': '0.196', 'AMMO3': '0.200', 'weapon5': '0.220', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.498', 'weapon4': '0.512', 'WEAPON3': '1.250', 'weapon3': '2.408', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '10.896', 'FRAGCOUNT': '34.500'} [2023-02-24 20:54:15,011][213369] DAMAGECOUNT value on done: 240117.0 [2023-02-24 20:54:15,012][213369] Sum rewards: 45.156, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.076', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'weapon4': '0.226', 'weapon2': '0.822', 'WEAPON3': '1.050', 'HITCOUNT': '2.560', 'weapon3': '2.606', 'DAMAGECOUNT': '11.442', 'FRAGCOUNT': '38.000'} [2023-02-24 20:54:15,021][213368] DAMAGECOUNT value on done: 235195.0 [2023-02-24 20:54:15,022][213368] Sum rewards: 36.643, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.760', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.003', 'weapon4': '0.036', 'weapon5': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.141', 'WEAPON3': '0.950', 'weapon2': '0.956', 'HITCOUNT': '2.180', 'weapon3': '2.672', 'DAMAGECOUNT': '9.192', 'FRAGCOUNT': '31.000'} [2023-02-24 20:54:15,166][213372] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 20:54:15,230][213382] DAMAGECOUNT value on done: 237059.0 [2023-02-24 20:54:15,230][213382] Sum rewards: 41.869, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.378', 'AMMO5': '0.012', 'ARMOR': '0.036', 'AMMO2': '0.040', 'AMMO3': '0.169', 'AMMO4': '0.201', 'weapon5': '0.270', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.768', 'weapon4': '0.952', 'WEAPON3': '1.000', 'weapon3': '1.694', 'HITCOUNT': '2.260', 'DAMAGECOUNT': '12.294', 'FRAGCOUNT': '37.000'} [2023-02-24 20:54:15,243][213332] Fps is (10 sec: 13517.0, 60 sec: 13448.6, 300 sec: 13440.4). Total num frames: 123924480. Throughput: 0: 3360.0. Samples: 5977000. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:54:15,243][213332] Avg episode reward: [(0, '37.365')] [2023-02-24 20:54:15,273][213383] DAMAGECOUNT value on done: 237695.0 [2023-02-24 20:54:15,274][213383] Sum rewards: 31.850, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.365', 'AMMO5': '0.019', 'AMMO2': '0.038', 'weapon5': '0.072', 'AMMO4': '0.191', 'AMMO3': '0.230', 'weapon4': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.512', 'WEAPON3': '1.500', 'HITCOUNT': '2.460', 'weapon3': '2.932', 'DAMAGECOUNT': '10.920', 'FRAGCOUNT': '31.500'} [2023-02-24 20:54:15,318][213369] DAMAGECOUNT value on done: 238043.0 [2023-02-24 20:54:15,319][213369] Sum rewards: 43.400, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.700', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon4': '0.128', 'AMMO4': '0.138', 'weapon5': '0.210', 'AMMO3': '0.212', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.460', 'weapon3': '3.084', 'DAMAGECOUNT': '11.754', 'FRAGCOUNT': '41.000'} [2023-02-24 20:54:15,320][213368] DAMAGECOUNT value on done: 239827.0 [2023-02-24 20:54:15,321][213368] Sum rewards: 32.999, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.264', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.233', 'weapon5': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.450', 'weapon4': '0.470', 'WEAPON3': '1.350', 'weapon3': '2.442', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '11.004', 'FRAGCOUNT': '30.000'} [2023-02-24 20:54:15,446][213365] Updated weights for policy 0, policy_version 30256 (0.0009) [2023-02-24 20:54:15,468][213384] DAMAGECOUNT value on done: 241168.0 [2023-02-24 20:54:15,468][213384] Sum rewards: 30.181, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.939', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.062', 'AMMO4': '0.131', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'weapon4': '0.244', 'WEAPON4': '0.300', 'weapon2': '0.908', 'WEAPON3': '1.100', 'HITCOUNT': '2.030', 'weapon3': '2.596', 'DAMAGECOUNT': '8.082', 'FRAGCOUNT': '29.000'} [2023-02-24 20:54:15,529][213382] DAMAGECOUNT value on done: 231524.0 [2023-02-24 20:54:15,530][213382] Sum rewards: 32.518, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.310', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.023', 'weapon5': '0.118', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'weapon4': '0.322', 'weapon2': '0.718', 'WEAPON3': '1.400', 'weapon3': '2.244', 'HITCOUNT': '2.320', 'DAMAGECOUNT': '9.495', 'FRAGCOUNT': '32.000'} [2023-02-24 20:54:15,623][213368] DAMAGECOUNT value on done: 230221.0 [2023-02-24 20:54:15,624][213368] Sum rewards: 32.589, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.594', 'ARMOR': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.235', 'weapon4': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.418', 'WEAPON3': '1.450', 'HITCOUNT': '2.430', 'weapon3': '2.862', 'DAMAGECOUNT': '10.137', 'FRAGCOUNT': '34.000'} [2023-02-24 20:54:15,640][213369] DAMAGECOUNT value on done: 241018.0 [2023-02-24 20:54:15,641][213369] Sum rewards: 27.575, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.470', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO4': '0.186', 'AMMO3': '0.197', 'weapon5': '0.224', 'WEAPON5': '0.250', 'weapon4': '0.290', 'WEAPON4': '0.400', 'weapon2': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.090', 'weapon3': '2.760', 'DAMAGECOUNT': '9.900', 'FRAGCOUNT': '27.000'} [2023-02-24 20:54:15,772][213384] DAMAGECOUNT value on done: 228130.0 [2023-02-24 20:54:15,773][213384] Sum rewards: 50.196, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.806', 'AMMO5': '0.017', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon2': '0.196', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'weapon5': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.526', 'WEAPON3': '1.350', 'weapon3': '2.476', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.745', 'FRAGCOUNT': '44.000'} [2023-02-24 20:54:15,846][213382] DAMAGECOUNT value on done: 239331.0 [2023-02-24 20:54:15,846][213382] Sum rewards: 37.739, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.670', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.076', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'weapon4': '0.530', 'weapon2': '0.544', 'WEAPON3': '0.950', 'weapon3': '2.586', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '11.196', 'FRAGCOUNT': '32.000'} [2023-02-24 20:54:15,876][213383] DAMAGECOUNT value on done: 236436.0 [2023-02-24 20:54:15,877][213383] Sum rewards: 32.265, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.196', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'weapon5': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.318', 'weapon4': '0.662', 'WEAPON3': '0.950', 'HITCOUNT': '2.060', 'weapon3': '2.242', 'DAMAGECOUNT': '8.850', 'FRAGCOUNT': '29.000'} [2023-02-24 20:54:15,931][213369] DAMAGECOUNT value on done: 227981.0 [2023-02-24 20:54:15,932][213369] Sum rewards: 37.483, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.900', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon5': '0.128', 'AMMO4': '0.197', 'AMMO3': '0.206', 'weapon4': '0.310', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.522', 'WEAPON3': '1.350', 'HITCOUNT': '2.690', 'weapon3': '2.768', 'DAMAGECOUNT': '11.694', 'FRAGCOUNT': '34.000'} [2023-02-24 20:54:15,952][213384] DAMAGECOUNT value on done: 241309.0 [2023-02-24 20:54:15,953][213384] Sum rewards: 30.268, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.270', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'weapon5': '0.052', 'weapon2': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.276', 'WEAPON3': '1.700', 'HITCOUNT': '2.190', 'weapon3': '3.290', 'DAMAGECOUNT': '9.600', 'FRAGCOUNT': '31.000'} [2023-02-24 20:54:16,179][213383] DAMAGECOUNT value on done: 231661.0 [2023-02-24 20:54:16,180][213383] Sum rewards: 39.887, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.186', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.012', 'AMMO2': '0.014', 'weapon4': '0.042', 'AMMO4': '0.067', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.159', 'WEAPON3': '0.900', 'weapon2': '0.990', 'HITCOUNT': '2.450', 'weapon3': '2.822', 'DAMAGECOUNT': '9.903', 'FRAGCOUNT': '34.000'} [2023-02-24 20:54:16,244][213384] DAMAGECOUNT value on done: 242208.0 [2023-02-24 20:54:16,245][213384] Sum rewards: 39.134, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.852', 'ARMOR': '0.004', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.040', 'AMMO3': '0.144', 'weapon5': '0.152', 'AMMO4': '0.198', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.702', 'weapon2': '0.834', 'WEAPON3': '0.850', 'weapon3': '2.002', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '10.086', 'FRAGCOUNT': '33.000'} [2023-02-24 20:54:18,490][213365] Updated weights for policy 0, policy_version 30266 (0.0009) [2023-02-24 20:54:20,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13426.5). Total num frames: 123990016. Throughput: 0: 3359.2. Samples: 5987180. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:54:20,243][213332] Avg episode reward: [(0, '37.353')] [2023-02-24 20:54:21,472][213365] Updated weights for policy 0, policy_version 30276 (0.0008) [2023-02-24 20:54:24,541][213365] Updated weights for policy 0, policy_version 30286 (0.0009) [2023-02-24 20:54:25,243][213332] Fps is (10 sec: 13516.6, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 124059648. Throughput: 0: 3362.1. Samples: 6007496. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:54:25,243][213332] Avg episode reward: [(0, '37.353')] [2023-02-24 20:54:27,563][213365] Updated weights for policy 0, policy_version 30296 (0.0009) [2023-02-24 20:54:30,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 124125184. Throughput: 0: 3360.8. Samples: 6027540. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:54:30,243][213332] Avg episode reward: [(0, '37.353')] [2023-02-24 20:54:30,664][213365] Updated weights for policy 0, policy_version 30306 (0.0009) [2023-02-24 20:54:33,169][213367] DAMAGECOUNT value on done: 237899.0 [2023-02-24 20:54:33,170][213367] Sum rewards: 40.461, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.238', 'AMMO5': '0.008', 'ARMOR': '0.009', 'AMMO2': '0.034', 'AMMO4': '0.171', 'weapon5': '0.180', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'weapon4': '0.286', 'weapon2': '0.326', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.830', 'weapon3': '2.862', 'DAMAGECOUNT': '13.398', 'FRAGCOUNT': '39.000'} [2023-02-24 20:54:33,501][213367] DAMAGECOUNT value on done: 239946.0 [2023-02-24 20:54:33,501][213367] Sum rewards: 35.797, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.242', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.072', 'AMMO4': '0.106', 'AMMO3': '0.150', 'weapon2': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.500', 'weapon4': '0.774', 'WEAPON3': '1.000', 'HITCOUNT': '2.430', 'weapon3': '2.626', 'DAMAGECOUNT': '9.972', 'FRAGCOUNT': '33.000'} [2023-02-24 20:54:33,724][213365] Updated weights for policy 0, policy_version 30316 (0.0010) [2023-02-24 20:54:33,819][213372] DAMAGECOUNT value on done: 242959.0 [2023-02-24 20:54:33,819][213372] Sum rewards: 32.891, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.300', 'AMMO5': '0.005', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.137', 'weapon5': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.500', 'weapon4': '0.666', 'WEAPON3': '0.900', 'weapon2': '0.946', 'weapon3': '1.988', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '10.587', 'FRAGCOUNT': '29.000'} [2023-02-24 20:54:33,824][213367] DAMAGECOUNT value on done: 246524.0 [2023-02-24 20:54:33,824][213367] Sum rewards: 31.902, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.499', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.038', 'AMMO3': '0.185', 'AMMO4': '0.191', 'weapon5': '0.310', 'WEAPON5': '0.400', 'weapon2': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.700', 'WEAPON3': '1.050', 'weapon3': '1.952', 'HITCOUNT': '2.250', 'DAMAGECOUNT': '10.749', 'FRAGCOUNT': '31.000'} [2023-02-24 20:54:34,127][213372] DAMAGECOUNT value on done: 245217.0 [2023-02-24 20:54:34,127][213372] Sum rewards: 47.559, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.646', 'AMMO5': '0.014', 'AMMO2': '0.023', 'weapon5': '0.100', 'AMMO4': '0.116', 'weapon4': '0.186', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.596', 'WEAPON3': '1.200', 'HITCOUNT': '2.790', 'weapon3': '2.822', 'DAMAGECOUNT': '12.357', 'FRAGCOUNT': '41.000'} [2023-02-24 20:54:34,139][213372] DAMAGECOUNT value on done: 238045.0 [2023-02-24 20:54:34,140][213372] Sum rewards: 37.284, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.514', 'AMMO5': '0.011', 'AMMO2': '0.045', 'AMMO3': '0.199', 'AMMO4': '0.226', 'WEAPON5': '0.250', 'weapon5': '0.260', 'weapon2': '0.340', 'WEAPON4': '0.350', 'weapon4': '0.462', 'WEAPON3': '1.200', 'HITCOUNT': '2.190', 'weapon3': '2.738', 'DAMAGECOUNT': '10.776', 'FRAGCOUNT': '35.000'} [2023-02-24 20:54:34,140][213367] DAMAGECOUNT value on done: 241495.0 [2023-02-24 20:54:34,141][213367] Sum rewards: 60.949, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.110', 'AMMO5': '0.014', 'AMMO2': '0.039', 'AMMO3': '0.158', 'AMMO4': '0.195', 'weapon5': '0.256', 'weapon4': '0.298', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'weapon3': '2.780', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '51.000'} [2023-02-24 20:54:34,167][213366] DAMAGECOUNT value on done: 239847.0 [2023-02-24 20:54:34,168][213366] Sum rewards: 49.606, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.937', 'AMMO2': '0.003', 'AMMO4': '0.013', 'WEAPON1': '0.020', 'AMMO3': '0.233', 'weapon2': '0.340', 'WEAPON3': '1.450', 'HITCOUNT': '3.090', 'weapon3': '3.474', 'DAMAGECOUNT': '12.420', 'FRAGCOUNT': '44.000'} [2023-02-24 20:54:34,397][213366] DAMAGECOUNT value on done: 245741.0 [2023-02-24 20:54:34,397][213366] Sum rewards: 50.931, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.123', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.108', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'weapon2': '0.340', 'weapon4': '0.416', 'WEAPON3': '1.350', 'weapon3': '2.900', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.607', 'FRAGCOUNT': '45.000'} [2023-02-24 20:54:34,457][213372] DAMAGECOUNT value on done: 236238.0 [2023-02-24 20:54:34,458][213372] Sum rewards: 50.186, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.416', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.456', 'weapon4': '0.478', 'WEAPON3': '1.300', 'weapon3': '2.738', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.435', 'FRAGCOUNT': '46.000'} [2023-02-24 20:54:34,500][213366] DAMAGECOUNT value on done: 248479.0 [2023-02-24 20:54:34,501][213366] Sum rewards: 45.559, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.841', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.078', 'weapon5': '0.098', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.766', 'WEAPON3': '1.400', 'weapon3': '2.826', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.518', 'FRAGCOUNT': '40.000'} [2023-02-24 20:54:34,721][213366] DAMAGECOUNT value on done: 241150.0 [2023-02-24 20:54:34,721][213366] Sum rewards: 15.667, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.895', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.185', 'AMMO3': '0.242', 'WEAPON4': '0.350', 'weapon2': '0.452', 'weapon4': '0.648', 'WEAPON3': '1.400', 'HITCOUNT': '1.990', 'weapon3': '2.530', 'DAMAGECOUNT': '7.731', 'FRAGCOUNT': '18.500'} [2023-02-24 20:54:34,747][213368] DAMAGECOUNT value on done: 237087.0 [2023-02-24 20:54:34,748][213368] Sum rewards: 21.823, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.128', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO3': '0.118', 'AMMO4': '0.145', 'weapon5': '0.150', 'WEAPON5': '0.200', 'WEAPON4': '0.450', 'weapon2': '0.680', 'WEAPON3': '0.700', 'weapon4': '0.986', 'weapon3': '1.774', 'HITCOUNT': '1.960', 'DAMAGECOUNT': '8.001', 'FRAGCOUNT': '19.000'} [2023-02-24 20:54:34,934][213383] DAMAGECOUNT value on done: 239422.0 [2023-02-24 20:54:34,935][213383] Sum rewards: 32.420, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.485', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'weapon5': '0.094', 'AMMO3': '0.169', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'weapon4': '0.290', 'WEAPON4': '0.400', 'weapon2': '0.726', 'WEAPON3': '1.100', 'HITCOUNT': '2.310', 'weapon3': '2.628', 'DAMAGECOUNT': '9.492', 'FRAGCOUNT': '30.000'} [2023-02-24 20:54:35,002][213382] DAMAGECOUNT value on done: 238064.0 [2023-02-24 20:54:35,003][213382] Sum rewards: 32.745, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.588', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.032', 'AMMO3': '0.129', 'AMMO4': '0.162', 'weapon2': '0.340', 'weapon5': '0.346', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '0.800', 'weapon4': '1.080', 'weapon3': '1.898', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '10.155', 'FRAGCOUNT': '28.000'} [2023-02-24 20:54:35,050][213369] DAMAGECOUNT value on done: 243861.0 [2023-02-24 20:54:35,050][213369] Sum rewards: 41.854, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.392', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.009', 'weapon5': '0.080', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.286', 'WEAPON3': '1.400', 'HITCOUNT': '2.500', 'weapon3': '3.332', 'DAMAGECOUNT': '11.232', 'FRAGCOUNT': '37.000'} [2023-02-24 20:54:35,051][213368] DAMAGECOUNT value on done: 239256.0 [2023-02-24 20:54:35,052][213368] Sum rewards: 48.968, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.300', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.174', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon2': '0.238', 'WEAPON5': '0.250', 'weapon4': '0.316', 'WEAPON3': '1.150', 'HITCOUNT': '2.730', 'weapon3': '2.954', 'DAMAGECOUNT': '12.183', 'FRAGCOUNT': '44.000'} [2023-02-24 20:54:35,241][213383] DAMAGECOUNT value on done: 239644.0 [2023-02-24 20:54:35,242][213383] Sum rewards: 21.979, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.220', 'AMMO5': '0.004', 'ARMOR': '0.012', 'AMMO2': '0.027', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.135', 'weapon2': '0.590', 'WEAPON4': '0.600', 'WEAPON3': '0.650', 'weapon3': '1.270', 'weapon4': '1.452', 'HITCOUNT': '1.570', 'DAMAGECOUNT': '5.847', 'FRAGCOUNT': '20.000'} [2023-02-24 20:54:35,243][213332] Fps is (10 sec: 13107.2, 60 sec: 13380.2, 300 sec: 13426.5). Total num frames: 124190720. Throughput: 0: 3358.3. Samples: 6037656. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:54:35,243][213332] Avg episode reward: [(0, '37.527')] [2023-02-24 20:54:35,248][213352] Saving new best policy, reward=37.527! [2023-02-24 20:54:35,307][213382] DAMAGECOUNT value on done: 241274.0 [2023-02-24 20:54:35,307][213382] Sum rewards: 48.389, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.600', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.033', 'weapon5': '0.100', 'weapon2': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon4': '0.368', 'WEAPON3': '1.350', 'HITCOUNT': '2.930', 'weapon3': '3.018', 'DAMAGECOUNT': '12.645', 'FRAGCOUNT': '44.000'} [2023-02-24 20:54:35,392][213368] DAMAGECOUNT value on done: 244149.0 [2023-02-24 20:54:35,392][213368] Sum rewards: 46.946, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.130', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.126', 'weapon5': '0.150', 'weapon2': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.538', 'WEAPON3': '0.850', 'HITCOUNT': '2.740', 'weapon3': '2.758', 'DAMAGECOUNT': '12.945', 'FRAGCOUNT': '38.500'} [2023-02-24 20:54:35,399][213369] DAMAGECOUNT value on done: 241976.0 [2023-02-24 20:54:35,399][213369] Sum rewards: 38.807, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.505', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon4': '0.408', 'weapon2': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.640', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '11.799', 'FRAGCOUNT': '34.000'} [2023-02-24 20:54:35,486][213384] DAMAGECOUNT value on done: 244431.0 [2023-02-24 20:54:35,487][213384] Sum rewards: 29.317, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.336', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.065', 'AMMO3': '0.135', 'AMMO4': '0.325', 'weapon5': '0.330', 'weapon2': '0.520', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'weapon4': '0.844', 'WEAPON3': '0.850', 'weapon3': '1.808', 'HITCOUNT': '2.210', 'DAMAGECOUNT': '9.789', 'FRAGCOUNT': '27.000'} [2023-02-24 20:54:35,606][213382] DAMAGECOUNT value on done: 235630.0 [2023-02-24 20:54:35,607][213382] Sum rewards: 47.311, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.411', 'AMMO5': '0.014', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.166', 'AMMO3': '0.196', 'weapon4': '0.212', 'weapon2': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.500', 'weapon3': '3.094', 'DAMAGECOUNT': '12.318', 'FRAGCOUNT': '43.000'} [2023-02-24 20:54:35,684][213368] DAMAGECOUNT value on done: 233190.0 [2023-02-24 20:54:35,685][213368] Sum rewards: 32.906, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.834', 'AMMO5': '0.008', 'AMMO2': '0.029', 'AMMO4': '0.144', 'AMMO3': '0.196', 'weapon5': '0.212', 'weapon4': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.100', 'HITCOUNT': '1.880', 'weapon3': '2.658', 'DAMAGECOUNT': '8.907', 'FRAGCOUNT': '32.000'} [2023-02-24 20:54:35,704][213369] DAMAGECOUNT value on done: 244752.0 [2023-02-24 20:54:35,704][213369] Sum rewards: 41.870, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.906', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'weapon4': '0.124', 'AMMO3': '0.211', 'weapon2': '0.266', 'WEAPON3': '1.250', 'HITCOUNT': '2.560', 'weapon3': '3.392', 'DAMAGECOUNT': '11.202', 'FRAGCOUNT': '37.000'} [2023-02-24 20:54:35,792][213384] DAMAGECOUNT value on done: 231884.0 [2023-02-24 20:54:35,792][213384] Sum rewards: 48.089, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.505', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.106', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon4': '0.266', 'WEAPON5': '0.300', 'weapon2': '0.442', 'WEAPON3': '1.150', 'HITCOUNT': '2.610', 'weapon3': '2.980', 'DAMAGECOUNT': '11.262', 'FRAGCOUNT': '42.000'} [2023-02-24 20:54:35,841][213383] DAMAGECOUNT value on done: 240007.0 [2023-02-24 20:54:35,842][213383] Sum rewards: 45.573, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.498', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.056', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'weapon4': '0.492', 'weapon2': '0.612', 'WEAPON3': '0.950', 'weapon3': '2.648', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '10.713', 'FRAGCOUNT': '38.000'} [2023-02-24 20:54:35,903][213382] DAMAGECOUNT value on done: 243039.0 [2023-02-24 20:54:35,904][213382] Sum rewards: 41.759, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.516', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO4': '0.143', 'WEAPON4': '0.200', 'weapon4': '0.228', 'AMMO3': '0.237', 'weapon2': '0.628', 'WEAPON3': '1.350', 'HITCOUNT': '2.650', 'weapon3': '2.912', 'DAMAGECOUNT': '11.124', 'FRAGCOUNT': '38.000'} [2023-02-24 20:54:36,001][213369] DAMAGECOUNT value on done: 231694.0 [2023-02-24 20:54:36,002][213369] Sum rewards: 43.280, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.270', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon2': '0.184', 'AMMO3': '0.207', 'weapon5': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.432', 'WEAPON3': '1.250', 'HITCOUNT': '2.420', 'weapon3': '2.792', 'DAMAGECOUNT': '11.139', 'FRAGCOUNT': '40.000'} [2023-02-24 20:54:36,020][213384] DAMAGECOUNT value on done: 245277.0 [2023-02-24 20:54:36,020][213384] Sum rewards: 33.691, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.410', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.042', 'AMMO4': '0.208', 'AMMO3': '0.211', 'weapon5': '0.226', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.502', 'weapon4': '0.694', 'WEAPON3': '1.300', 'weapon3': '2.268', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '11.904', 'FRAGCOUNT': '30.000'} [2023-02-24 20:54:36,155][213383] DAMAGECOUNT value on done: 234711.0 [2023-02-24 20:54:36,156][213383] Sum rewards: 35.054, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.450', 'AMMO5': '0.009', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.161', 'weapon5': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.584', 'weapon2': '0.790', 'WEAPON3': '0.950', 'HITCOUNT': '2.100', 'weapon3': '2.220', 'DAMAGECOUNT': '9.150', 'FRAGCOUNT': '31.000'} [2023-02-24 20:54:36,323][213384] DAMAGECOUNT value on done: 245730.0 [2023-02-24 20:54:36,323][213384] Sum rewards: 35.681, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.015', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.044', 'weapon7': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.162', 'AMMO3': '0.177', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.222', 'weapon4': '0.430', 'WEAPON4': '0.450', 'weapon2': '0.468', 'WEAPON3': '1.100', 'HITCOUNT': '2.220', 'weapon3': '2.632', 'DAMAGECOUNT': '10.566', 'FRAGCOUNT': '33.000'} [2023-02-24 20:54:36,793][213365] Updated weights for policy 0, policy_version 30326 (0.0009) [2023-02-24 20:54:39,878][213365] Updated weights for policy 0, policy_version 30336 (0.0009) [2023-02-24 20:54:40,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13440.4). Total num frames: 124260352. Throughput: 0: 3353.7. Samples: 6057588. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:54:40,243][213332] Avg episode reward: [(0, '37.659')] [2023-02-24 20:54:40,244][213352] Saving new best policy, reward=37.659! [2023-02-24 20:54:42,884][213365] Updated weights for policy 0, policy_version 30346 (0.0009) [2023-02-24 20:54:45,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13440.4). Total num frames: 124325888. Throughput: 0: 3358.6. Samples: 6077788. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:54:45,243][213332] Avg episode reward: [(0, '37.659')] [2023-02-24 20:54:45,248][213352] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000030353_124325888.pth... [2023-02-24 20:54:45,307][213352] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000029566_121102336.pth [2023-02-24 20:54:45,940][213365] Updated weights for policy 0, policy_version 30356 (0.0009) [2023-02-24 20:54:49,005][213365] Updated weights for policy 0, policy_version 30366 (0.0010) [2023-02-24 20:54:50,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 124395520. Throughput: 0: 3356.9. Samples: 6087978. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:54:50,243][213332] Avg episode reward: [(0, '37.659')] [2023-02-24 20:54:51,974][213365] Updated weights for policy 0, policy_version 30376 (0.0009) [2023-02-24 20:54:53,150][213367] DAMAGECOUNT value on done: 241535.0 [2023-02-24 20:54:53,150][213367] Sum rewards: 37.232, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.576', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.060', 'AMMO4': '0.095', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.448', 'WEAPON3': '1.200', 'HITCOUNT': '2.560', 'weapon3': '3.072', 'DAMAGECOUNT': '10.908', 'FRAGCOUNT': '33.000'} [2023-02-24 20:54:53,477][213367] DAMAGECOUNT value on done: 244350.0 [2023-02-24 20:54:53,478][213367] Sum rewards: 45.339, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.670', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon2': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.206', 'weapon5': '0.214', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '2.870', 'weapon3': '3.038', 'DAMAGECOUNT': '13.212', 'FRAGCOUNT': '41.000'} [2023-02-24 20:54:53,755][213367] DAMAGECOUNT value on done: 250679.0 [2023-02-24 20:54:53,756][213367] Sum rewards: 43.351, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.317', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon4': '0.118', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.332', 'weapon2': '0.356', 'WEAPON3': '1.300', 'HITCOUNT': '2.580', 'weapon3': '2.932', 'DAMAGECOUNT': '12.450', 'FRAGCOUNT': '39.000'} [2023-02-24 20:54:53,829][213372] DAMAGECOUNT value on done: 247959.0 [2023-02-24 20:54:53,830][213372] Sum rewards: 41.763, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.456', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon2': '0.164', 'weapon5': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.297', 'weapon4': '0.502', 'WEAPON3': '1.800', 'weapon3': '2.808', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.853', 'FRAGCOUNT': '39.000'} [2023-02-24 20:54:54,059][213372] DAMAGECOUNT value on done: 239736.0 [2023-02-24 20:54:54,060][213372] Sum rewards: 16.895, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.500', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon5': '0.030', 'weapon7': '0.054', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.178', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.600', 'weapon2': '0.660', 'HITCOUNT': '1.120', 'weapon3': '1.128', 'DAMAGECOUNT': '4.683', 'FRAGCOUNT': '17.000'} [2023-02-24 20:54:54,070][213367] DAMAGECOUNT value on done: 245416.0 [2023-02-24 20:54:54,071][213367] Sum rewards: 52.901, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.661', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO3': '0.146', 'weapon2': '0.628', 'WEAPON3': '1.050', 'HITCOUNT': '2.720', 'weapon3': '3.254', 'DAMAGECOUNT': '11.763', 'FRAGCOUNT': '44.000'} [2023-02-24 20:54:54,155][213366] DAMAGECOUNT value on done: 244221.0 [2023-02-24 20:54:54,155][213366] Sum rewards: 52.309, reward structure: {'DEATHCOUNT': '-9.750', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.094', 'HEALTH': '0.097', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.158', 'weapon4': '0.522', 'weapon2': '0.668', 'WEAPON3': '0.700', 'weapon3': '2.394', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.122', 'FRAGCOUNT': '41.000'} [2023-02-24 20:54:54,156][213372] DAMAGECOUNT value on done: 249274.0 [2023-02-24 20:54:54,156][213372] Sum rewards: 42.038, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.092', 'AMMO5': '0.025', 'AMMO2': '0.027', 'weapon5': '0.118', 'AMMO4': '0.135', 'AMMO3': '0.235', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.418', 'weapon2': '0.748', 'WEAPON3': '1.400', 'weapon3': '2.302', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.171', 'FRAGCOUNT': '39.000'} [2023-02-24 20:54:54,365][213366] DAMAGECOUNT value on done: 249848.0 [2023-02-24 20:54:54,366][213366] Sum rewards: 49.539, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.465', 'AMMO5': '0.014', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon4': '0.142', 'AMMO3': '0.154', 'weapon5': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.548', 'WEAPON3': '1.000', 'HITCOUNT': '2.480', 'weapon3': '2.830', 'DAMAGECOUNT': '12.321', 'FRAGCOUNT': '42.000'} [2023-02-24 20:54:54,378][213372] DAMAGECOUNT value on done: 240579.0 [2023-02-24 20:54:54,379][213372] Sum rewards: 44.870, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.128', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'weapon4': '0.210', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'weapon2': '0.816', 'WEAPON3': '1.450', 'weapon3': '2.398', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.023', 'FRAGCOUNT': '42.000'} [2023-02-24 20:54:54,485][213366] DAMAGECOUNT value on done: 251722.0 [2023-02-24 20:54:54,485][213366] Sum rewards: 36.945, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.075', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.088', 'AMMO4': '0.099', 'AMMO3': '0.123', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.448', 'weapon2': '0.640', 'WEAPON3': '0.850', 'HITCOUNT': '2.330', 'weapon3': '2.684', 'DAMAGECOUNT': '9.729', 'FRAGCOUNT': '32.000'} [2023-02-24 20:54:54,688][213366] DAMAGECOUNT value on done: 244247.0 [2023-02-24 20:54:54,689][213366] Sum rewards: 32.352, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.375', 'AMMO5': '0.017', 'AMMO2': '0.045', 'AMMO3': '0.112', 'AMMO4': '0.224', 'weapon5': '0.258', 'WEAPON5': '0.400', 'weapon2': '0.412', 'WEAPON4': '0.600', 'WEAPON3': '0.650', 'weapon4': '1.100', 'weapon3': '1.738', 'HITCOUNT': '1.880', 'DAMAGECOUNT': '9.291', 'FRAGCOUNT': '29.000'} [2023-02-24 20:54:54,778][213368] DAMAGECOUNT value on done: 241638.0 [2023-02-24 20:54:54,778][213368] Sum rewards: 50.839, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.200', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.049', 'AMMO3': '0.184', 'weapon2': '0.230', 'AMMO4': '0.247', 'weapon5': '0.282', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.480', 'WEAPON3': '1.200', 'weapon3': '2.682', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.623', 'FRAGCOUNT': '43.000'} [2023-02-24 20:54:54,904][213383] DAMAGECOUNT value on done: 243268.0 [2023-02-24 20:54:54,904][213383] Sum rewards: 33.345, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.225', 'AMMO5': '0.017', 'AMMO2': '0.056', 'AMMO3': '0.191', 'weapon5': '0.218', 'AMMO4': '0.278', 'WEAPON5': '0.400', 'weapon2': '0.450', 'WEAPON4': '0.600', 'weapon4': '0.696', 'WEAPON3': '1.100', 'weapon3': '2.216', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '11.538', 'FRAGCOUNT': '31.000'} [2023-02-24 20:54:55,012][213369] DAMAGECOUNT value on done: 247902.0 [2023-02-24 20:54:55,012][213369] Sum rewards: 44.338, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.950', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'ARMOR': '0.036', 'weapon4': '0.140', 'AMMO4': '0.147', 'AMMO3': '0.206', 'weapon5': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.498', 'WEAPON3': '1.400', 'HITCOUNT': '2.620', 'weapon3': '2.746', 'DAMAGECOUNT': '12.123', 'FRAGCOUNT': '40.000'} [2023-02-24 20:54:55,056][213382] DAMAGECOUNT value on done: 242767.0 [2023-02-24 20:54:55,056][213382] Sum rewards: 49.010, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.190', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.061', 'AMMO3': '0.193', 'AMMO4': '0.307', 'weapon5': '0.334', 'weapon2': '0.378', 'weapon4': '0.386', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.556', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '14.109', 'FRAGCOUNT': '45.000'} [2023-02-24 20:54:55,084][213368] DAMAGECOUNT value on done: 242971.0 [2023-02-24 20:54:55,084][213368] Sum rewards: 42.118, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.345', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'weapon4': '0.682', 'weapon2': '0.808', 'WEAPON3': '0.950', 'weapon3': '2.322', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '11.145', 'FRAGCOUNT': '34.000'} [2023-02-24 20:54:55,092][213365] Updated weights for policy 0, policy_version 30386 (0.0009) [2023-02-24 20:54:55,209][213383] DAMAGECOUNT value on done: 242868.0 [2023-02-24 20:54:55,210][213383] Sum rewards: 31.182, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.416', 'AMMO5': '0.012', 'AMMO2': '0.061', 'weapon5': '0.172', 'AMMO3': '0.206', 'WEAPON5': '0.300', 'AMMO4': '0.304', 'WEAPON4': '0.600', 'weapon4': '0.668', 'weapon2': '0.702', 'WEAPON3': '1.150', 'weapon3': '2.110', 'HITCOUNT': '2.140', 'DAMAGECOUNT': '9.672', 'FRAGCOUNT': '32.500'} [2023-02-24 20:54:55,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 124461056. Throughput: 0: 3358.3. Samples: 6108064. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:54:55,243][213332] Avg episode reward: [(0, '38.289')] [2023-02-24 20:54:55,246][213352] Saving new best policy, reward=38.289! [2023-02-24 20:54:55,332][213369] DAMAGECOUNT value on done: 244795.0 [2023-02-24 20:54:55,333][213369] Sum rewards: 26.157, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.302', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.179', 'weapon5': '0.292', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.602', 'weapon4': '0.714', 'WEAPON3': '1.100', 'weapon3': '1.888', 'HITCOUNT': '1.920', 'DAMAGECOUNT': '8.457', 'FRAGCOUNT': '25.000'} [2023-02-24 20:54:55,385][213382] DAMAGECOUNT value on done: 245258.0 [2023-02-24 20:54:55,386][213382] Sum rewards: 45.714, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.742', 'AMMO5': '0.009', 'AMMO2': '0.011', 'AMMO4': '0.052', 'weapon4': '0.140', 'WEAPON4': '0.150', 'weapon5': '0.160', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.450', 'HITCOUNT': '2.630', 'weapon3': '3.100', 'DAMAGECOUNT': '11.952', 'FRAGCOUNT': '42.000'} [2023-02-24 20:54:55,387][213368] DAMAGECOUNT value on done: 246972.0 [2023-02-24 20:54:55,387][213368] Sum rewards: 24.460, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.420', 'AMMO5': '0.010', 'AMMO2': '0.056', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'weapon5': '0.260', 'AMMO4': '0.282', 'WEAPON4': '0.600', 'weapon4': '0.716', 'weapon2': '0.734', 'WEAPON3': '1.300', 'weapon3': '1.938', 'HITCOUNT': '2.290', 'DAMAGECOUNT': '8.469', 'FRAGCOUNT': '28.000'} [2023-02-24 20:54:55,532][213384] DAMAGECOUNT value on done: 247526.0 [2023-02-24 20:54:55,532][213384] Sum rewards: 30.898, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.273', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.150', 'weapon5': '0.150', 'AMMO4': '0.184', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.392', 'WEAPON3': '1.250', 'HITCOUNT': '1.860', 'weapon3': '2.994', 'DAMAGECOUNT': '9.285', 'FRAGCOUNT': '31.000'} [2023-02-24 20:54:55,626][213369] DAMAGECOUNT value on done: 248380.0 [2023-02-24 20:54:55,626][213369] Sum rewards: 35.915, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.590', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.036', 'weapon7': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.171', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.576', 'weapon2': '0.648', 'WEAPON3': '1.150', 'weapon3': '2.226', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '10.884', 'FRAGCOUNT': '33.000'} [2023-02-24 20:54:55,679][213368] DAMAGECOUNT value on done: 236487.0 [2023-02-24 20:54:55,679][213368] Sum rewards: 33.580, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.873', 'AMMO2': '0.019', 'weapon7': '0.074', 'AMMO4': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.165', 'WEAPON4': '0.250', 'weapon2': '0.360', 'weapon4': '0.644', 'WEAPON3': '1.050', 'HITCOUNT': '2.450', 'weapon3': '2.654', 'DAMAGECOUNT': '9.891', 'FRAGCOUNT': '28.000'} [2023-02-24 20:54:55,701][213382] DAMAGECOUNT value on done: 239534.0 [2023-02-24 20:54:55,701][213382] Sum rewards: 33.793, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.780', 'AMMO5': '0.010', 'weapon5': '0.024', 'AMMO2': '0.032', 'AMMO4': '0.160', 'WEAPON5': '0.200', 'weapon2': '0.262', 'AMMO3': '0.273', 'weapon4': '0.378', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'HITCOUNT': '2.950', 'weapon3': '3.022', 'DAMAGECOUNT': '11.712', 'FRAGCOUNT': '34.500'} [2023-02-24 20:54:55,814][213383] DAMAGECOUNT value on done: 243726.0 [2023-02-24 20:54:55,815][213383] Sum rewards: 40.618, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.420', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'weapon5': '0.168', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.280', 'weapon4': '0.410', 'WEAPON3': '1.350', 'HITCOUNT': '2.500', 'weapon3': '2.630', 'DAMAGECOUNT': '11.157', 'FRAGCOUNT': '38.000'} [2023-02-24 20:54:55,835][213384] DAMAGECOUNT value on done: 235464.0 [2023-02-24 20:54:55,836][213384] Sum rewards: 43.343, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.672', 'AMMO5': '0.003', 'AMMO2': '0.003', 'ARMOR': '0.004', 'AMMO4': '0.013', 'weapon4': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.104', 'AMMO3': '0.223', 'weapon2': '0.482', 'WEAPON3': '1.450', 'HITCOUNT': '2.390', 'weapon3': '3.238', 'DAMAGECOUNT': '10.740', 'FRAGCOUNT': '40.000'} [2023-02-24 20:54:55,932][213369] DAMAGECOUNT value on done: 234795.0 [2023-02-24 20:54:55,932][213369] Sum rewards: 31.089, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.032', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon4': '0.074', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'AMMO3': '0.230', 'weapon2': '0.616', 'WEAPON3': '1.300', 'HITCOUNT': '2.190', 'weapon3': '3.076', 'DAMAGECOUNT': '9.303', 'FRAGCOUNT': '30.000'} [2023-02-24 20:54:55,999][213382] DAMAGECOUNT value on done: 248007.0 [2023-02-24 20:54:55,999][213382] Sum rewards: 56.512, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.192', 'AMMO5': '0.011', 'AMMO2': '0.035', 'AMMO4': '0.173', 'AMMO3': '0.201', 'weapon2': '0.248', 'weapon5': '0.268', 'weapon4': '0.280', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.924', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.904', 'FRAGCOUNT': '50.000'} [2023-02-24 20:54:56,057][213384] DAMAGECOUNT value on done: 249283.0 [2023-02-24 20:54:56,057][213384] Sum rewards: 48.082, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.800', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'AMMO3': '0.178', 'weapon2': '0.918', 'WEAPON3': '1.250', 'weapon3': '2.888', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.018', 'FRAGCOUNT': '42.000'} [2023-02-24 20:54:56,116][213383] DAMAGECOUNT value on done: 236961.0 [2023-02-24 20:54:56,116][213383] Sum rewards: 24.075, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.782', 'AMMO5': '0.004', 'ARMOR': '0.004', 'AMMO2': '0.019', 'weapon5': '0.046', 'weapon7': '0.048', 'AMMO4': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'weapon4': '0.410', 'weapon2': '0.520', 'WEAPON3': '0.750', 'HITCOUNT': '1.540', 'weapon3': '1.996', 'DAMAGECOUNT': '6.750', 'FRAGCOUNT': '21.000'} [2023-02-24 20:54:56,358][213384] DAMAGECOUNT value on done: 249527.0 [2023-02-24 20:54:56,358][213384] Sum rewards: 42.504, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.372', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.242', 'WEAPON4': '0.250', 'weapon4': '0.790', 'WEAPON3': '1.300', 'weapon3': '2.548', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '11.391', 'FRAGCOUNT': '40.000'} [2023-02-24 20:54:58,108][213365] Updated weights for policy 0, policy_version 30396 (0.0009) [2023-02-24 20:55:00,243][213332] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13426.6). Total num frames: 124526592. Throughput: 0: 3358.9. Samples: 6128152. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:55:00,243][213332] Avg episode reward: [(0, '38.340')] [2023-02-24 20:55:00,269][213352] Saving new best policy, reward=38.340! [2023-02-24 20:55:01,198][213365] Updated weights for policy 0, policy_version 30406 (0.0009) [2023-02-24 20:55:04,261][213365] Updated weights for policy 0, policy_version 30416 (0.0009) [2023-02-24 20:55:05,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 124596224. Throughput: 0: 3357.0. Samples: 6138246. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:55:05,243][213332] Avg episode reward: [(0, '38.340')] [2023-02-24 20:55:06,011][213369] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 20:55:07,253][213365] Updated weights for policy 0, policy_version 30426 (0.0009) [2023-02-24 20:55:10,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 124661760. Throughput: 0: 3352.5. Samples: 6158358. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:55:10,243][213332] Avg episode reward: [(0, '38.340')] [2023-02-24 20:55:10,340][213365] Updated weights for policy 0, policy_version 30436 (0.0009) [2023-02-24 20:55:13,166][213367] DAMAGECOUNT value on done: 244762.0 [2023-02-24 20:55:13,167][213367] Sum rewards: 36.392, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.250', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.022', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.164', 'weapon2': '0.372', 'WEAPON3': '1.050', 'HITCOUNT': '2.130', 'weapon3': '3.460', 'DAMAGECOUNT': '9.681', 'FRAGCOUNT': '31.000'} [2023-02-24 20:55:13,366][213365] Updated weights for policy 0, policy_version 30446 (0.0009) [2023-02-24 20:55:13,496][213367] DAMAGECOUNT value on done: 248143.0 [2023-02-24 20:55:13,497][213367] Sum rewards: 45.402, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.514', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.252', 'weapon4': '0.288', 'weapon2': '0.644', 'WEAPON3': '1.500', 'weapon3': '2.784', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '11.379', 'FRAGCOUNT': '43.000'} [2023-02-24 20:55:13,798][213367] DAMAGECOUNT value on done: 254436.0 [2023-02-24 20:55:13,798][213367] Sum rewards: 35.328, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.290', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.020', 'weapon5': '0.032', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'WEAPON4': '0.400', 'weapon4': '0.662', 'weapon2': '0.726', 'WEAPON3': '1.150', 'weapon3': '2.366', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '11.271', 'FRAGCOUNT': '34.000'} [2023-02-24 20:55:13,859][213372] DAMAGECOUNT value on done: 250732.0 [2023-02-24 20:55:13,860][213372] Sum rewards: 25.488, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.080', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO4': '0.183', 'AMMO3': '0.209', 'weapon5': '0.296', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON4': '0.450', 'weapon4': '0.754', 'WEAPON3': '1.150', 'weapon3': '2.164', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '8.319', 'FRAGCOUNT': '26.000'} [2023-02-24 20:55:14,098][213372] DAMAGECOUNT value on done: 243710.0 [2023-02-24 20:55:14,098][213372] Sum rewards: 44.672, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.410', 'AMMO5': '0.016', 'AMMO2': '0.053', 'AMMO3': '0.181', 'weapon5': '0.210', 'AMMO4': '0.267', 'WEAPON5': '0.350', 'weapon2': '0.476', 'weapon4': '0.498', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.438', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '11.922', 'FRAGCOUNT': '39.000'} [2023-02-24 20:55:14,118][213367] DAMAGECOUNT value on done: 249213.0 [2023-02-24 20:55:14,118][213367] Sum rewards: 32.663, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.424', 'AMMO5': '0.012', 'AMMO2': '0.055', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.209', 'AMMO4': '0.277', 'weapon5': '0.284', 'WEAPON5': '0.450', 'weapon2': '0.456', 'WEAPON4': '0.550', 'weapon4': '0.630', 'WEAPON3': '1.200', 'HITCOUNT': '2.210', 'weapon3': '2.312', 'DAMAGECOUNT': '11.391', 'FRAGCOUNT': '32.000'} [2023-02-24 20:55:14,170][213366] DAMAGECOUNT value on done: 247089.0 [2023-02-24 20:55:14,170][213366] Sum rewards: 30.550, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.120', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.058', 'weapon5': '0.104', 'AMMO4': '0.158', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.700', 'WEAPON3': '1.200', 'HITCOUNT': '2.000', 'weapon3': '2.918', 'DAMAGECOUNT': '8.559', 'FRAGCOUNT': '30.000'} [2023-02-24 20:55:14,184][213372] DAMAGECOUNT value on done: 253540.0 [2023-02-24 20:55:14,185][213372] Sum rewards: 50.750, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.412', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'weapon5': '0.212', 'AMMO3': '0.214', 'weapon2': '0.418', 'WEAPON3': '1.250', 'HITCOUNT': '2.900', 'weapon3': '3.020', 'DAMAGECOUNT': '12.798', 'FRAGCOUNT': '43.000'} [2023-02-24 20:55:14,392][213366] DAMAGECOUNT value on done: 252229.0 [2023-02-24 20:55:14,392][213366] Sum rewards: 27.608, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.146', 'AMMO2': '0.024', 'ARMOR': '0.032', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.104', 'AMMO4': '0.117', 'WEAPON4': '0.200', 'weapon4': '0.570', 'WEAPON3': '0.600', 'weapon2': '1.038', 'weapon3': '1.734', 'HITCOUNT': '1.840', 'DAMAGECOUNT': '7.143', 'FRAGCOUNT': '23.000'} [2023-02-24 20:55:14,431][213372] DAMAGECOUNT value on done: 244428.0 [2023-02-24 20:55:14,431][213372] Sum rewards: 47.941, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.710', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.112', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.258', 'weapon2': '0.458', 'WEAPON3': '1.050', 'HITCOUNT': '2.740', 'weapon3': '2.842', 'DAMAGECOUNT': '11.547', 'FRAGCOUNT': '42.000'} [2023-02-24 20:55:14,503][213366] DAMAGECOUNT value on done: 255143.0 [2023-02-24 20:55:14,503][213366] Sum rewards: 33.348, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.208', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.128', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'weapon4': '0.432', 'weapon2': '0.618', 'WEAPON3': '1.250', 'HITCOUNT': '2.350', 'weapon3': '2.626', 'DAMAGECOUNT': '10.263', 'FRAGCOUNT': '32.000'} [2023-02-24 20:55:14,726][213366] DAMAGECOUNT value on done: 248424.0 [2023-02-24 20:55:14,726][213366] Sum rewards: 46.400, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.442', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.108', 'WEAPON4': '0.200', 'AMMO4': '0.217', 'AMMO3': '0.232', 'weapon4': '0.296', 'WEAPON5': '0.300', 'weapon2': '0.482', 'WEAPON3': '1.300', 'HITCOUNT': '2.610', 'weapon3': '2.756', 'DAMAGECOUNT': '12.531', 'FRAGCOUNT': '41.000'} [2023-02-24 20:55:14,804][213368] DAMAGECOUNT value on done: 245375.0 [2023-02-24 20:55:14,805][213368] Sum rewards: 36.024, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.884', 'AMMO5': '0.015', 'AMMO2': '0.054', 'AMMO3': '0.159', 'AMMO4': '0.271', 'weapon5': '0.340', 'weapon2': '0.386', 'WEAPON5': '0.400', 'weapon4': '0.614', 'WEAPON4': '0.650', 'WEAPON3': '0.950', 'weapon3': '2.298', 'HITCOUNT': '2.310', 'DAMAGECOUNT': '11.211', 'FRAGCOUNT': '34.000'} [2023-02-24 20:55:14,857][213383] DAMAGECOUNT value on done: 246449.0 [2023-02-24 20:55:14,857][213383] Sum rewards: 40.094, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.425', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO3': '0.177', 'weapon2': '0.372', 'WEAPON3': '1.050', 'HITCOUNT': '2.380', 'weapon3': '3.492', 'DAMAGECOUNT': '9.543', 'FRAGCOUNT': '35.000'} [2023-02-24 20:55:15,095][213382] DAMAGECOUNT value on done: 246108.0 [2023-02-24 20:55:15,095][213369] DAMAGECOUNT value on done: 252009.0 [2023-02-24 20:55:15,095][213382] Sum rewards: 35.729, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.420', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.022', 'AMMO4': '0.089', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon4': '0.466', 'weapon2': '0.482', 'WEAPON3': '1.100', 'HITCOUNT': '2.260', 'weapon3': '2.826', 'DAMAGECOUNT': '10.023', 'FRAGCOUNT': '33.500'} [2023-02-24 20:55:15,095][213369] Sum rewards: 36.511, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.638', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.037', 'weapon5': '0.174', 'AMMO3': '0.179', 'AMMO4': '0.183', 'weapon4': '0.228', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.556', 'WEAPON3': '1.050', 'HITCOUNT': '2.650', 'weapon3': '2.698', 'DAMAGECOUNT': '12.321', 'FRAGCOUNT': '33.000'} [2023-02-24 20:55:15,104][213368] DAMAGECOUNT value on done: 246941.0 [2023-02-24 20:55:15,105][213368] Sum rewards: 43.556, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.414', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon5': '0.060', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon4': '0.276', 'weapon2': '0.318', 'WEAPON3': '1.300', 'HITCOUNT': '2.560', 'weapon3': '3.112', 'DAMAGECOUNT': '11.910', 'FRAGCOUNT': '39.000'} [2023-02-24 20:55:15,157][213383] DAMAGECOUNT value on done: 246692.0 [2023-02-24 20:55:15,157][213383] Sum rewards: 40.152, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.550', 'AMMO5': '0.007', 'AMMO2': '0.020', 'ARMOR': '0.032', 'AMMO4': '0.102', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon4': '0.252', 'weapon2': '0.522', 'WEAPON3': '1.150', 'weapon3': '2.844', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '11.472', 'FRAGCOUNT': '35.000'} [2023-02-24 20:55:15,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 124731392. Throughput: 0: 3353.5. Samples: 6178448. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:55:15,243][213332] Avg episode reward: [(0, '38.772')] [2023-02-24 20:55:15,246][213352] Saving new best policy, reward=38.772! [2023-02-24 20:55:15,408][213382] DAMAGECOUNT value on done: 248603.0 [2023-02-24 20:55:15,408][213382] Sum rewards: 35.521, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.895', 'ARMOR': '0.004', 'weapon6': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.098', 'WEAPON6': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.158', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'weapon2': '0.508', 'WEAPON3': '1.050', 'HITCOUNT': '2.370', 'weapon3': '2.792', 'DAMAGECOUNT': '10.035', 'FRAGCOUNT': '30.000'} [2023-02-24 20:55:15,410][213369] DAMAGECOUNT value on done: 248779.0 [2023-02-24 20:55:15,410][213369] Sum rewards: 38.034, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.154', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.093', 'WEAPON4': '0.200', 'weapon5': '0.220', 'WEAPON5': '0.250', 'weapon2': '0.252', 'weapon4': '0.252', 'AMMO3': '0.289', 'WEAPON3': '1.700', 'HITCOUNT': '2.510', 'weapon3': '2.938', 'DAMAGECOUNT': '11.952', 'FRAGCOUNT': '37.000'} [2023-02-24 20:55:15,412][213368] DAMAGECOUNT value on done: 250574.0 [2023-02-24 20:55:15,413][213368] Sum rewards: 38.875, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.375', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.036', 'AMMO4': '0.070', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.251', 'weapon2': '0.644', 'WEAPON3': '1.550', 'HITCOUNT': '2.500', 'weapon3': '3.036', 'DAMAGECOUNT': '10.806', 'FRAGCOUNT': '38.500'} [2023-02-24 20:55:15,592][213384] DAMAGECOUNT value on done: 251102.0 [2023-02-24 20:55:15,592][213384] Sum rewards: 42.401, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.010', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon7': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.130', 'weapon5': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.350', 'weapon2': '0.556', 'WEAPON3': '1.100', 'HITCOUNT': '2.370', 'weapon3': '2.620', 'DAMAGECOUNT': '10.728', 'FRAGCOUNT': '38.000'} [2023-02-24 20:55:15,710][213369] DAMAGECOUNT value on done: 251752.0 [2023-02-24 20:55:15,711][213369] Sum rewards: 36.793, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.670', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon7': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.144', 'AMMO3': '0.162', 'WEAPON7': '0.200', 'weapon5': '0.206', 'WEAPON5': '0.300', 'weapon4': '0.352', 'weapon2': '0.390', 'WEAPON4': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '1.970', 'weapon3': '2.468', 'DAMAGECOUNT': '10.116', 'FRAGCOUNT': '32.500'} [2023-02-24 20:55:15,712][213368] DAMAGECOUNT value on done: 240449.0 [2023-02-24 20:55:15,712][213368] Sum rewards: 33.333, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.860', 'AMMO5': '0.017', 'AMMO2': '0.032', 'weapon4': '0.144', 'AMMO4': '0.162', 'weapon5': '0.180', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'weapon2': '0.382', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.380', 'weapon3': '2.930', 'DAMAGECOUNT': '11.886', 'FRAGCOUNT': '33.000'} [2023-02-24 20:55:15,716][213382] DAMAGECOUNT value on done: 243543.0 [2023-02-24 20:55:15,717][213382] Sum rewards: 41.550, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.917', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.195', 'weapon5': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.320', 'weapon2': '0.352', 'WEAPON3': '1.300', 'weapon3': '2.772', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.027', 'FRAGCOUNT': '37.000'} [2023-02-24 20:55:15,771][213383] DAMAGECOUNT value on done: 248274.0 [2023-02-24 20:55:15,772][213383] Sum rewards: 41.130, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.494', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.049', 'weapon5': '0.102', 'WEAPON5': '0.200', 'AMMO4': '0.247', 'AMMO3': '0.278', 'weapon4': '0.326', 'weapon2': '0.446', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.810', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.434', 'FRAGCOUNT': '41.000'} [2023-02-24 20:55:15,883][213384] DAMAGECOUNT value on done: 239050.0 [2023-02-24 20:55:15,884][213384] Sum rewards: 32.823, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.110', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.163', 'AMMO3': '0.241', 'weapon5': '0.296', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON4': '0.350', 'weapon4': '0.548', 'WEAPON3': '1.400', 'weapon3': '2.292', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '10.758', 'FRAGCOUNT': '33.000'} [2023-02-24 20:55:16,009][213369] DAMAGECOUNT value on done: 238411.0 [2023-02-24 20:55:16,009][213369] Sum rewards: 32.841, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-1.436', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.060', 'AMMO3': '0.215', 'weapon5': '0.224', 'AMMO4': '0.298', 'WEAPON5': '0.300', 'weapon2': '0.346', 'weapon4': '0.564', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.498', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '10.848', 'FRAGCOUNT': '34.000'} [2023-02-24 20:55:16,018][213382] DAMAGECOUNT value on done: 251564.0 [2023-02-24 20:55:16,019][213382] Sum rewards: 24.633, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.892', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon5': '0.130', 'AMMO4': '0.200', 'AMMO3': '0.284', 'WEAPON5': '0.300', 'weapon2': '0.444', 'WEAPON4': '0.550', 'weapon4': '0.740', 'WEAPON3': '1.550', 'weapon3': '2.312', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '10.671', 'FRAGCOUNT': '28.000'} [2023-02-24 20:55:16,086][213383] DAMAGECOUNT value on done: 240444.0 [2023-02-24 20:55:16,086][213383] Sum rewards: 44.254, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.397', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO3': '0.090', 'AMMO4': '0.096', 'weapon2': '0.110', 'WEAPON5': '0.250', 'weapon5': '0.342', 'WEAPON4': '0.350', 'WEAPON3': '0.600', 'weapon4': '0.954', 'weapon3': '2.036', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '10.449', 'FRAGCOUNT': '36.000'} [2023-02-24 20:55:16,094][213384] DAMAGECOUNT value on done: 253307.0 [2023-02-24 20:55:16,095][213384] Sum rewards: 42.873, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.255', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.090', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.240', 'weapon4': '0.348', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.590', 'weapon3': '3.064', 'DAMAGECOUNT': '12.072', 'FRAGCOUNT': '41.000'} [2023-02-24 20:55:16,393][213384] DAMAGECOUNT value on done: 253881.0 [2023-02-24 20:55:16,394][213384] Sum rewards: 42.087, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.930', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.180', 'AMMO3': '0.191', 'WEAPON5': '0.300', 'weapon2': '0.422', 'WEAPON4': '0.450', 'weapon4': '0.604', 'WEAPON3': '1.200', 'weapon3': '2.524', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.642', 'FRAGCOUNT': '38.000'} [2023-02-24 20:55:16,412][213365] Updated weights for policy 0, policy_version 30456 (0.0008) [2023-02-24 20:55:19,490][213365] Updated weights for policy 0, policy_version 30466 (0.0009) [2023-02-24 20:55:20,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 124796928. Throughput: 0: 3355.3. Samples: 6188644. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:55:20,243][213332] Avg episode reward: [(0, '38.929')] [2023-02-24 20:55:20,244][213352] Saving new best policy, reward=38.929! [2023-02-24 20:55:22,512][213365] Updated weights for policy 0, policy_version 30476 (0.0009) [2023-02-24 20:55:25,243][213332] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13426.6). Total num frames: 124862464. Throughput: 0: 3358.1. Samples: 6208702. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:55:25,244][213332] Avg episode reward: [(0, '38.929')] [2023-02-24 20:55:25,610][213365] Updated weights for policy 0, policy_version 30486 (0.0009) [2023-02-24 20:55:28,667][213365] Updated weights for policy 0, policy_version 30496 (0.0009) [2023-02-24 20:55:30,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 124932096. Throughput: 0: 3355.0. Samples: 6228762. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:55:30,243][213332] Avg episode reward: [(0, '38.929')] [2023-02-24 20:55:31,672][213365] Updated weights for policy 0, policy_version 30506 (0.0008) [2023-02-24 20:55:32,786][213366] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('ARMOR', -0.001, -1.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 20:55:33,259][213367] DAMAGECOUNT value on done: 249526.0 [2023-02-24 20:55:33,259][213367] Sum rewards: 51.654, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.914', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.088', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.280', 'AMMO3': '0.300', 'weapon4': '0.434', 'WEAPON3': '1.800', 'weapon3': '2.882', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.292', 'FRAGCOUNT': '49.000'} [2023-02-24 20:55:33,572][213367] DAMAGECOUNT value on done: 253117.0 [2023-02-24 20:55:33,572][213367] Sum rewards: 46.157, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.849', 'AMMO5': '0.030', 'AMMO2': '0.044', 'weapon4': '0.098', 'weapon2': '0.186', 'AMMO4': '0.222', 'weapon5': '0.252', 'AMMO3': '0.258', 'WEAPON4': '0.450', 'WEAPON5': '0.750', 'WEAPON3': '1.600', 'HITCOUNT': '2.930', 'weapon3': '3.014', 'DAMAGECOUNT': '14.922', 'FRAGCOUNT': '44.000'} [2023-02-24 20:55:33,879][213372] DAMAGECOUNT value on done: 255115.0 [2023-02-24 20:55:33,879][213372] Sum rewards: 44.257, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.052', 'AMMO5': '0.007', 'AMMO2': '0.063', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon2': '0.268', 'AMMO4': '0.316', 'WEAPON4': '0.750', 'weapon4': '0.772', 'WEAPON3': '1.300', 'weapon3': '2.584', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.149', 'FRAGCOUNT': '43.000'} [2023-02-24 20:55:33,888][213367] DAMAGECOUNT value on done: 257691.0 [2023-02-24 20:55:33,889][213367] Sum rewards: 35.329, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.931', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.128', 'AMMO4': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.348', 'weapon4': '0.526', 'WEAPON3': '1.300', 'HITCOUNT': '2.280', 'weapon3': '2.730', 'DAMAGECOUNT': '9.534', 'FRAGCOUNT': '33.000'} [2023-02-24 20:55:34,110][213372] DAMAGECOUNT value on done: 247709.0 [2023-02-24 20:55:34,110][213372] Sum rewards: 44.026, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.688', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.057', 'weapon5': '0.106', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon4': '0.424', 'weapon2': '0.448', 'WEAPON3': '1.300', 'weapon3': '2.796', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '11.997', 'FRAGCOUNT': '40.000'} [2023-02-24 20:55:34,224][213372] DAMAGECOUNT value on done: 256802.0 [2023-02-24 20:55:34,225][213367] DAMAGECOUNT value on done: 252301.0 [2023-02-24 20:55:34,225][213372] Sum rewards: 33.258, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.720', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.072', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'weapon2': '0.506', 'weapon4': '0.574', 'WEAPON3': '1.250', 'HITCOUNT': '2.320', 'weapon3': '2.660', 'DAMAGECOUNT': '9.786', 'FRAGCOUNT': '30.000'} [2023-02-24 20:55:34,225][213367] Sum rewards: 38.130, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.646', 'AMMO2': '0.026', 'WEAPON4': '0.050', 'AMMO4': '0.130', 'AMMO3': '0.223', 'weapon4': '0.276', 'ARMOR': '0.400', 'weapon2': '0.618', 'WEAPON3': '1.350', 'HITCOUNT': '2.290', 'weapon3': '2.898', 'DAMAGECOUNT': '9.264', 'FRAGCOUNT': '35.000'} [2023-02-24 20:55:34,281][213366] DAMAGECOUNT value on done: 250501.0 [2023-02-24 20:55:34,282][213366] Sum rewards: 39.772, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.530', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.117', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon5': '0.220', 'weapon4': '0.462', 'WEAPON3': '0.800', 'weapon2': '0.994', 'weapon3': '2.060', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '10.236', 'FRAGCOUNT': '33.000'} [2023-02-24 20:55:34,439][213372] DAMAGECOUNT value on done: 247698.0 [2023-02-24 20:55:34,440][213372] Sum rewards: 38.174, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.280', 'AMMO2': '0.003', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.015', 'weapon4': '0.020', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'weapon2': '1.182', 'WEAPON3': '1.200', 'HITCOUNT': '2.460', 'weapon3': '2.618', 'DAMAGECOUNT': '9.810', 'FRAGCOUNT': '34.000'} [2023-02-24 20:55:34,522][213366] DAMAGECOUNT value on done: 256431.0 [2023-02-24 20:55:34,523][213366] Sum rewards: 40.594, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.360', 'AMMO5': '0.004', 'AMMO2': '0.024', 'weapon5': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'weapon4': '0.176', 'AMMO3': '0.291', 'WEAPON4': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.650', 'HITCOUNT': '2.870', 'weapon3': '3.216', 'DAMAGECOUNT': '12.606', 'FRAGCOUNT': '40.000'} [2023-02-24 20:55:34,598][213366] DAMAGECOUNT value on done: 259786.0 [2023-02-24 20:55:34,598][213366] Sum rewards: 48.553, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.946', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.166', 'AMMO3': '0.167', 'WEAPON5': '0.250', 'weapon4': '0.276', 'WEAPON4': '0.300', 'weapon2': '0.506', 'WEAPON3': '1.000', 'weapon3': '2.750', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '13.929', 'FRAGCOUNT': '39.500'} [2023-02-24 20:55:34,791][213368] DAMAGECOUNT value on done: 248635.0 [2023-02-24 20:55:34,791][213368] Sum rewards: 35.370, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.559', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'weapon5': '0.104', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'weapon2': '0.332', 'weapon4': '0.352', 'WEAPON3': '1.400', 'HITCOUNT': '2.340', 'weapon3': '2.988', 'DAMAGECOUNT': '9.780', 'FRAGCOUNT': '34.000'} [2023-02-24 20:55:34,799][213365] Updated weights for policy 0, policy_version 30516 (0.0009) [2023-02-24 20:55:34,847][213366] DAMAGECOUNT value on done: 253063.0 [2023-02-24 20:55:34,847][213366] Sum rewards: 48.037, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.180', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.210', 'weapon5': '0.262', 'weapon2': '0.278', 'weapon4': '0.326', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.794', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.917', 'FRAGCOUNT': '43.000'} [2023-02-24 20:55:34,894][213383] DAMAGECOUNT value on done: 250029.0 [2023-02-24 20:55:34,894][213383] Sum rewards: 39.518, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.519', 'AMMO5': '0.009', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon4': '0.034', 'weapon5': '0.060', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.273', 'weapon2': '0.576', 'WEAPON3': '1.600', 'HITCOUNT': '2.410', 'weapon3': '2.980', 'DAMAGECOUNT': '10.113', 'FRAGCOUNT': '40.000'} [2023-02-24 20:55:35,090][213368] DAMAGECOUNT value on done: 250123.0 [2023-02-24 20:55:35,091][213368] Sum rewards: 37.489, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.940', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon7': '0.076', 'AMMO4': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.157', 'WEAPON7': '0.200', 'weapon5': '0.204', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.422', 'weapon2': '0.472', 'WEAPON3': '0.950', 'HITCOUNT': '2.200', 'weapon3': '2.258', 'DAMAGECOUNT': '9.546', 'FRAGCOUNT': '34.000'} [2023-02-24 20:55:35,115][213382] DAMAGECOUNT value on done: 250440.0 [2023-02-24 20:55:35,115][213382] Sum rewards: 41.627, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.298', 'AMMO5': '0.014', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.192', 'AMMO3': '0.214', 'WEAPON5': '0.300', 'weapon4': '0.328', 'WEAPON4': '0.350', 'weapon2': '0.610', 'WEAPON3': '1.300', 'weapon3': '2.534', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '12.996', 'FRAGCOUNT': '39.000'} [2023-02-24 20:55:35,190][213369] DAMAGECOUNT value on done: 256003.0 [2023-02-24 20:55:35,190][213369] Sum rewards: 49.312, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.703', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.053', 'WEAPON5': '0.100', 'weapon5': '0.128', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon4': '0.284', 'weapon2': '0.318', 'WEAPON3': '1.100', 'HITCOUNT': '2.620', 'weapon3': '3.042', 'DAMAGECOUNT': '11.982', 'FRAGCOUNT': '43.000'} [2023-02-24 20:55:35,192][213383] DAMAGECOUNT value on done: 250030.0 [2023-02-24 20:55:35,192][213383] Sum rewards: 30.751, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.240', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon2': '0.210', 'AMMO4': '0.219', 'weapon5': '0.248', 'AMMO3': '0.256', 'weapon4': '0.394', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.280', 'weapon3': '2.806', 'DAMAGECOUNT': '10.014', 'FRAGCOUNT': '33.000'} [2023-02-24 20:55:35,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 124997632. Throughput: 0: 3356.2. Samples: 6239008. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:55:35,243][213332] Avg episode reward: [(0, '39.351')] [2023-02-24 20:55:35,247][213352] Saving new best policy, reward=39.351! [2023-02-24 20:55:35,369][213368] DAMAGECOUNT value on done: 253293.0 [2023-02-24 20:55:35,369][213368] Sum rewards: 19.118, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.845', 'AMMO5': '0.020', 'weapon7': '0.048', 'AMMO2': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.233', 'weapon2': '0.250', 'AMMO4': '0.282', 'weapon5': '0.310', 'WEAPON5': '0.450', 'WEAPON4': '0.750', 'weapon4': '1.078', 'WEAPON3': '1.350', 'HITCOUNT': '1.730', 'weapon3': '1.948', 'DAMAGECOUNT': '8.157', 'FRAGCOUNT': '24.000'} [2023-02-24 20:55:35,438][213382] DAMAGECOUNT value on done: 251238.0 [2023-02-24 20:55:35,439][213382] Sum rewards: 33.475, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.270', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon7': '0.074', 'AMMO4': '0.085', 'AMMO3': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon2': '0.154', 'weapon5': '0.180', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.550', 'weapon4': '0.610', 'weapon3': '1.856', 'HITCOUNT': '1.880', 'DAMAGECOUNT': '7.905', 'FRAGCOUNT': '27.000'} [2023-02-24 20:55:35,507][213369] DAMAGECOUNT value on done: 252785.0 [2023-02-24 20:55:35,508][213369] Sum rewards: 42.147, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.508', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.170', 'AMMO3': '0.211', 'AMMO4': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON4': '0.350', 'weapon4': '0.384', 'WEAPON3': '1.250', 'HITCOUNT': '2.590', 'weapon3': '2.884', 'DAMAGECOUNT': '12.018', 'FRAGCOUNT': '38.000'} [2023-02-24 20:55:35,575][213384] DAMAGECOUNT value on done: 254922.0 [2023-02-24 20:55:35,576][213384] Sum rewards: 39.153, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.310', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.133', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.162', 'AMMO3': '0.234', 'weapon2': '0.408', 'weapon4': '0.486', 'WEAPON3': '1.350', 'HITCOUNT': '2.480', 'weapon3': '2.662', 'DAMAGECOUNT': '11.460', 'FRAGCOUNT': '35.000'} [2023-02-24 20:55:35,670][213368] DAMAGECOUNT value on done: 244918.0 [2023-02-24 20:55:35,671][213368] Sum rewards: 42.961, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.153', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.112', 'AMMO4': '0.128', 'AMMO3': '0.183', 'weapon5': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.486', 'WEAPON3': '1.150', 'HITCOUNT': '2.810', 'weapon3': '3.002', 'DAMAGECOUNT': '13.407', 'FRAGCOUNT': '36.500'} [2023-02-24 20:55:35,740][213382] DAMAGECOUNT value on done: 247192.0 [2023-02-24 20:55:35,740][213382] Sum rewards: 39.406, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.315', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.096', 'AMMO4': '0.128', 'AMMO3': '0.161', 'WEAPON5': '0.200', 'weapon2': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.636', 'WEAPON3': '1.050', 'weapon3': '2.740', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '10.947', 'FRAGCOUNT': '35.000'} [2023-02-24 20:55:35,803][213383] DAMAGECOUNT value on done: 251540.0 [2023-02-24 20:55:35,803][213383] Sum rewards: 33.547, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.830', 'AMMO5': '0.013', 'AMMO2': '0.065', 'weapon5': '0.076', 'AMMO3': '0.199', 'WEAPON5': '0.300', 'AMMO4': '0.323', 'weapon2': '0.512', 'weapon4': '0.588', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'HITCOUNT': '2.470', 'weapon3': '2.532', 'DAMAGECOUNT': '9.798', 'FRAGCOUNT': '32.000'} [2023-02-24 20:55:35,809][213369] DAMAGECOUNT value on done: 255957.0 [2023-02-24 20:55:35,809][213369] Sum rewards: 39.819, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.658', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.041', 'AMMO4': '0.203', 'weapon2': '0.226', 'AMMO3': '0.257', 'weapon4': '0.282', 'weapon5': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '2.730', 'weapon3': '2.806', 'DAMAGECOUNT': '12.615', 'FRAGCOUNT': '38.000'} [2023-02-24 20:55:35,880][213384] DAMAGECOUNT value on done: 243071.0 [2023-02-24 20:55:35,881][213384] Sum rewards: 44.922, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.832', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.098', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.402', 'WEAPON4': '0.450', 'ARMOR': '0.460', 'weapon4': '1.054', 'WEAPON3': '1.250', 'weapon3': '2.144', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.063', 'FRAGCOUNT': '43.000'} [2023-02-24 20:55:36,043][213382] DAMAGECOUNT value on done: 256574.0 [2023-02-24 20:55:36,043][213382] Sum rewards: 58.672, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.960', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.162', 'AMMO3': '0.224', 'weapon2': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.358', 'WEAPON3': '1.350', 'weapon3': '2.994', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.030', 'FRAGCOUNT': '51.000'} [2023-02-24 20:55:36,103][213383] DAMAGECOUNT value on done: 243802.0 [2023-02-24 20:55:36,104][213383] Sum rewards: 37.579, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.819', 'AMMO5': '0.007', 'AMMO2': '0.035', 'AMMO3': '0.160', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'weapon5': '0.210', 'WEAPON4': '0.350', 'weapon4': '0.470', 'weapon2': '0.626', 'WEAPON3': '1.100', 'HITCOUNT': '2.260', 'weapon3': '2.480', 'DAMAGECOUNT': '10.074', 'FRAGCOUNT': '35.000'} [2023-02-24 20:55:36,104][213384] DAMAGECOUNT value on done: 256396.0 [2023-02-24 20:55:36,104][213384] Sum rewards: 28.014, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.270', 'ARMOR': '0.004', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'AMMO4': '0.172', 'weapon2': '0.218', 'weapon5': '0.230', 'AMMO3': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.374', 'WEAPON3': '1.800', 'HITCOUNT': '2.380', 'weapon3': '2.824', 'DAMAGECOUNT': '9.267', 'FRAGCOUNT': '32.000'} [2023-02-24 20:55:36,126][213369] DAMAGECOUNT value on done: 242316.0 [2023-02-24 20:55:36,126][213369] Sum rewards: 41.917, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.990', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.046', 'AMMO3': '0.151', 'weapon5': '0.208', 'AMMO4': '0.229', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.508', 'weapon4': '0.558', 'WEAPON3': '1.000', 'HITCOUNT': '2.350', 'weapon3': '2.478', 'DAMAGECOUNT': '11.715', 'FRAGCOUNT': '36.000'} [2023-02-24 20:55:36,396][213384] DAMAGECOUNT value on done: 257088.0 [2023-02-24 20:55:36,397][213384] Sum rewards: 23.803, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.230', 'AMMO5': '0.021', 'AMMO2': '0.058', 'weapon5': '0.190', 'weapon4': '0.222', 'AMMO3': '0.271', 'AMMO4': '0.291', 'weapon2': '0.386', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'HITCOUNT': '2.270', 'weapon3': '2.802', 'DAMAGECOUNT': '9.621', 'FRAGCOUNT': '28.000'} [2023-02-24 20:55:37,473][213368] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 20:55:37,823][213365] Updated weights for policy 0, policy_version 30526 (0.0008) [2023-02-24 20:55:40,243][213332] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13426.5). Total num frames: 125063168. Throughput: 0: 3354.6. Samples: 6259020. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:55:40,243][213332] Avg episode reward: [(0, '38.931')] [2023-02-24 20:55:40,851][213365] Updated weights for policy 0, policy_version 30536 (0.0009) [2023-02-24 20:55:43,891][213365] Updated weights for policy 0, policy_version 30546 (0.0009) [2023-02-24 20:55:44,327][213384] Large shaping reward 2.592 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('weapon5', 0.002)] [2023-02-24 20:55:44,536][213382] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 20:55:45,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 125132800. Throughput: 0: 3356.4. Samples: 6279192. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:55:45,243][213332] Avg episode reward: [(0, '38.931')] [2023-02-24 20:55:46,880][213365] Updated weights for policy 0, policy_version 30556 (0.0009) [2023-02-24 20:55:49,213][213367] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 20:55:50,003][213365] Updated weights for policy 0, policy_version 30566 (0.0009) [2023-02-24 20:55:50,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13440.4). Total num frames: 125198336. Throughput: 0: 3361.1. Samples: 6289496. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:55:50,243][213332] Avg episode reward: [(0, '38.931')] [2023-02-24 20:55:53,002][213365] Updated weights for policy 0, policy_version 30576 (0.0009) [2023-02-24 20:55:53,183][213367] DAMAGECOUNT value on done: 254043.0 [2023-02-24 20:55:53,183][213367] Sum rewards: 45.503, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.965', 'AMMO5': '0.016', 'AMMO2': '0.045', 'AMMO3': '0.149', 'AMMO4': '0.226', 'weapon5': '0.288', 'weapon2': '0.366', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.726', 'WEAPON3': '0.900', 'weapon3': '2.320', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.551', 'FRAGCOUNT': '37.000'} [2023-02-24 20:55:53,489][213367] DAMAGECOUNT value on done: 256903.0 [2023-02-24 20:55:53,489][213367] Sum rewards: 41.410, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.238', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO3': '0.108', 'AMMO4': '0.119', 'weapon2': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon5': '0.320', 'weapon4': '0.740', 'WEAPON3': '0.750', 'weapon3': '2.152', 'HITCOUNT': '2.330', 'DAMAGECOUNT': '11.358', 'FRAGCOUNT': '33.000'} [2023-02-24 20:55:53,832][213367] DAMAGECOUNT value on done: 261702.0 [2023-02-24 20:55:53,832][213367] Sum rewards: 41.030, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.160', 'ARMOR': '0.004', 'AMMO5': '0.027', 'AMMO2': '0.066', 'AMMO3': '0.215', 'weapon2': '0.252', 'weapon5': '0.286', 'AMMO4': '0.329', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'weapon4': '0.768', 'WEAPON3': '1.250', 'weapon3': '2.380', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '12.033', 'FRAGCOUNT': '40.000'} [2023-02-24 20:55:53,928][213372] DAMAGECOUNT value on done: 258936.0 [2023-02-24 20:55:53,928][213372] Sum rewards: 45.666, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.052', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.016', 'AMMO4': '0.081', 'WEAPON4': '0.200', 'weapon5': '0.218', 'AMMO3': '0.260', 'weapon4': '0.286', 'WEAPON5': '0.300', 'weapon2': '0.714', 'WEAPON3': '1.500', 'HITCOUNT': '2.430', 'weapon3': '2.486', 'DAMAGECOUNT': '11.463', 'FRAGCOUNT': '43.000'} [2023-02-24 20:55:54,141][213372] DAMAGECOUNT value on done: 252145.0 [2023-02-24 20:55:54,142][213372] Sum rewards: 46.186, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.102', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.033', 'AMMO4': '0.163', 'AMMO3': '0.215', 'weapon5': '0.344', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.422', 'WEAPON3': '1.150', 'weapon3': '2.528', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '13.308', 'FRAGCOUNT': '41.000'} [2023-02-24 20:55:54,150][213367] DAMAGECOUNT value on done: 256297.0 [2023-02-24 20:55:54,151][213367] Sum rewards: 42.136, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.540', 'AMMO5': '0.017', 'AMMO2': '0.026', 'weapon5': '0.058', 'AMMO4': '0.130', 'AMMO3': '0.200', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.424', 'weapon2': '0.638', 'WEAPON3': '1.200', 'HITCOUNT': '2.570', 'weapon3': '2.624', 'DAMAGECOUNT': '11.988', 'FRAGCOUNT': '39.000'} [2023-02-24 20:55:54,183][213366] DAMAGECOUNT value on done: 253786.0 [2023-02-24 20:55:54,183][213366] Sum rewards: 30.123, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.346', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.132', 'AMMO4': '0.216', 'weapon2': '0.242', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon4': '0.336', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'HITCOUNT': '1.970', 'weapon3': '2.960', 'DAMAGECOUNT': '9.495', 'FRAGCOUNT': '32.000'} [2023-02-24 20:55:54,256][213372] DAMAGECOUNT value on done: 261237.0 [2023-02-24 20:55:54,256][213372] Sum rewards: 44.741, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-1.890', 'ARMOR': '0.004', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.049', 'weapon5': '0.176', 'AMMO3': '0.223', 'AMMO4': '0.246', 'WEAPON5': '0.300', 'WEAPON4': '0.550', 'weapon2': '0.578', 'weapon4': '1.000', 'WEAPON3': '1.300', 'weapon3': '1.884', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.305', 'FRAGCOUNT': '43.500'} [2023-02-24 20:55:54,459][213366] DAMAGECOUNT value on done: 260241.0 [2023-02-24 20:55:54,459][213366] Sum rewards: 35.338, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.014', 'AMMO5': '0.005', 'AMMO2': '0.037', 'WEAPON5': '0.100', 'weapon5': '0.124', 'AMMO4': '0.185', 'weapon2': '0.200', 'AMMO3': '0.257', 'WEAPON4': '0.400', 'weapon4': '0.700', 'WEAPON3': '1.550', 'HITCOUNT': '2.670', 'weapon3': '2.694', 'DAMAGECOUNT': '11.430', 'FRAGCOUNT': '36.000'} [2023-02-24 20:55:54,460][213372] DAMAGECOUNT value on done: 251261.0 [2023-02-24 20:55:54,460][213372] Sum rewards: 36.760, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.902', 'AMMO5': '0.030', 'AMMO2': '0.046', 'AMMO3': '0.193', 'AMMO4': '0.230', 'weapon5': '0.260', 'WEAPON4': '0.450', 'weapon2': '0.456', 'weapon4': '0.482', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.456', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '10.689', 'FRAGCOUNT': '35.000'} [2023-02-24 20:55:54,508][213366] DAMAGECOUNT value on done: 263871.0 [2023-02-24 20:55:54,509][213366] Sum rewards: 46.645, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.700', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.067', 'weapon5': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'weapon4': '0.256', 'weapon2': '0.888', 'WEAPON3': '1.050', 'weapon3': '2.578', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '12.255', 'FRAGCOUNT': '40.000'} [2023-02-24 20:55:54,746][213368] DAMAGECOUNT value on done: 252083.0 [2023-02-24 20:55:54,746][213368] Sum rewards: 37.331, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.925', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon7': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.162', 'weapon5': '0.162', 'AMMO4': '0.172', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON4': '0.350', 'weapon4': '0.834', 'WEAPON3': '0.950', 'weapon3': '1.998', 'HITCOUNT': '2.340', 'DAMAGECOUNT': '10.344', 'FRAGCOUNT': '33.000'} [2023-02-24 20:55:54,797][213366] DAMAGECOUNT value on done: 256918.0 [2023-02-24 20:55:54,798][213366] Sum rewards: 40.073, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.850', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.022', 'AMMO4': '0.112', 'WEAPON4': '0.200', 'weapon5': '0.218', 'AMMO3': '0.245', 'weapon4': '0.288', 'WEAPON5': '0.400', 'weapon2': '0.484', 'WEAPON3': '1.450', 'HITCOUNT': '2.470', 'weapon3': '2.702', 'DAMAGECOUNT': '11.559', 'FRAGCOUNT': '37.000'} [2023-02-24 20:55:54,830][213383] DAMAGECOUNT value on done: 254270.0 [2023-02-24 20:55:54,830][213383] Sum rewards: 40.631, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.080', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.090', 'AMMO3': '0.196', 'AMMO4': '0.248', 'WEAPON5': '0.250', 'weapon4': '0.318', 'WEAPON4': '0.550', 'weapon2': '0.642', 'WEAPON3': '1.250', 'weapon3': '2.614', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.723', 'FRAGCOUNT': '38.500'} [2023-02-24 20:55:55,053][213368] DAMAGECOUNT value on done: 254528.0 [2023-02-24 20:55:55,054][213368] Sum rewards: 46.571, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.562', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.098', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'weapon4': '0.336', 'weapon2': '0.484', 'WEAPON3': '1.400', 'HITCOUNT': '2.690', 'weapon3': '2.826', 'DAMAGECOUNT': '13.215', 'FRAGCOUNT': '43.000'} [2023-02-24 20:55:55,077][213382] DAMAGECOUNT value on done: 255215.0 [2023-02-24 20:55:55,077][213382] Sum rewards: 54.647, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.414', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon5': '0.152', 'AMMO3': '0.156', 'AMMO4': '0.244', 'weapon2': '0.302', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.538', 'WEAPON3': '0.950', 'weapon3': '2.760', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.325', 'FRAGCOUNT': '47.000'} [2023-02-24 20:55:55,132][213383] DAMAGECOUNT value on done: 252736.0 [2023-02-24 20:55:55,133][213383] Sum rewards: 27.823, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.924', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.054', 'AMMO3': '0.184', 'weapon5': '0.206', 'AMMO4': '0.269', 'WEAPON5': '0.350', 'weapon4': '0.418', 'WEAPON4': '0.500', 'weapon2': '0.566', 'WEAPON3': '1.000', 'HITCOUNT': '1.930', 'weapon3': '2.388', 'DAMAGECOUNT': '8.118', 'FRAGCOUNT': '27.000'} [2023-02-24 20:55:55,157][213369] DAMAGECOUNT value on done: 259175.0 [2023-02-24 20:55:55,157][213369] Sum rewards: 36.176, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.490', 'AMMO5': '0.010', 'AMMO2': '0.041', 'AMMO3': '0.130', 'AMMO4': '0.207', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON4': '0.350', 'weapon5': '0.470', 'weapon4': '0.800', 'WEAPON3': '0.850', 'weapon3': '2.086', 'HITCOUNT': '2.330', 'DAMAGECOUNT': '9.516', 'FRAGCOUNT': '30.000'} [2023-02-24 20:55:55,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 125267968. Throughput: 0: 3360.9. Samples: 6309600. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:55:55,243][213332] Avg episode reward: [(0, '39.045')] [2023-02-24 20:55:55,304][213368] DAMAGECOUNT value on done: 257606.0 [2023-02-24 20:55:55,304][213368] Sum rewards: 49.640, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.691', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.161', 'weapon2': '0.192', 'AMMO3': '0.230', 'weapon5': '0.238', 'WEAPON5': '0.450', 'ARMOR': '0.471', 'WEAPON4': '0.550', 'weapon4': '0.772', 'WEAPON3': '1.300', 'weapon3': '2.406', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '12.936', 'FRAGCOUNT': '45.000'} [2023-02-24 20:55:55,378][213382] DAMAGECOUNT value on done: 254591.0 [2023-02-24 20:55:55,379][213382] Sum rewards: 36.156, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.034', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.072', 'AMMO4': '0.082', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.456', 'ARMOR': '0.496', 'weapon4': '0.654', 'WEAPON3': '1.050', 'HITCOUNT': '2.210', 'weapon3': '2.228', 'DAMAGECOUNT': '9.759', 'FRAGCOUNT': '32.000'} [2023-02-24 20:55:55,460][213369] DAMAGECOUNT value on done: 257108.0 [2023-02-24 20:55:55,461][213369] Sum rewards: 46.867, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.450', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.262', 'weapon4': '0.658', 'WEAPON3': '1.200', 'weapon3': '2.736', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.969', 'FRAGCOUNT': '41.000'} [2023-02-24 20:55:55,496][213384] DAMAGECOUNT value on done: 259452.0 [2023-02-24 20:55:55,496][213384] Sum rewards: 50.383, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.685', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.051', 'AMMO3': '0.183', 'weapon5': '0.202', 'weapon2': '0.250', 'AMMO4': '0.255', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.654', 'WEAPON3': '1.100', 'weapon3': '2.584', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '13.590', 'FRAGCOUNT': '44.000'} [2023-02-24 20:55:55,606][213368] DAMAGECOUNT value on done: 248439.0 [2023-02-24 20:55:55,606][213368] Sum rewards: 32.233, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.092', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.144', 'AMMO3': '0.191', 'AMMO4': '0.233', 'WEAPON5': '0.300', 'weapon2': '0.422', 'WEAPON4': '0.450', 'weapon4': '0.790', 'WEAPON3': '1.050', 'HITCOUNT': '2.300', 'weapon3': '2.334', 'DAMAGECOUNT': '10.548', 'FRAGCOUNT': '31.000'} [2023-02-24 20:55:55,674][213382] DAMAGECOUNT value on done: 250508.0 [2023-02-24 20:55:55,674][213382] Sum rewards: 27.213, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.516', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.050', 'AMMO4': '0.067', 'weapon4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.306', 'weapon2': '0.610', 'WEAPON3': '1.800', 'HITCOUNT': '2.340', 'weapon3': '2.996', 'DAMAGECOUNT': '9.948', 'FRAGCOUNT': '31.000'} [2023-02-24 20:55:55,727][213383] DAMAGECOUNT value on done: 254932.0 [2023-02-24 20:55:55,728][213383] Sum rewards: 36.061, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.447', 'ARMOR': '0.004', 'AMMO2': '0.015', 'AMMO5': '0.022', 'AMMO4': '0.076', 'AMMO3': '0.156', 'weapon5': '0.190', 'weapon2': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'weapon4': '1.090', 'weapon3': '2.112', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '10.176', 'FRAGCOUNT': '32.000'} [2023-02-24 20:55:55,760][213369] DAMAGECOUNT value on done: 259555.0 [2023-02-24 20:55:55,761][213369] Sum rewards: 36.809, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.080', 'AMMO5': '0.016', 'AMMO2': '0.032', 'weapon5': '0.102', 'AMMO4': '0.160', 'AMMO3': '0.227', 'WEAPON5': '0.350', 'weapon4': '0.374', 'WEAPON4': '0.400', 'weapon2': '0.470', 'WEAPON3': '1.350', 'HITCOUNT': '2.360', 'weapon3': '2.754', 'DAMAGECOUNT': '10.794', 'FRAGCOUNT': '37.000'} [2023-02-24 20:55:55,796][213384] DAMAGECOUNT value on done: 246617.0 [2023-02-24 20:55:55,797][213384] Sum rewards: 36.188, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.680', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon5': '0.162', 'AMMO3': '0.209', 'AMMO4': '0.228', 'weapon2': '0.284', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.502', 'WEAPON3': '1.300', 'HITCOUNT': '2.180', 'weapon3': '2.694', 'DAMAGECOUNT': '10.638', 'FRAGCOUNT': '35.000'} [2023-02-24 20:55:55,971][213382] DAMAGECOUNT value on done: 260487.0 [2023-02-24 20:55:55,971][213382] Sum rewards: 42.019, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.375', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.076', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'weapon4': '0.208', 'WEAPON4': '0.250', 'AMMO3': '0.256', 'weapon2': '0.380', 'WEAPON3': '1.500', 'HITCOUNT': '2.640', 'weapon3': '3.060', 'DAMAGECOUNT': '11.739', 'FRAGCOUNT': '40.500'} [2023-02-24 20:55:55,999][213384] DAMAGECOUNT value on done: 260305.0 [2023-02-24 20:55:56,000][213384] Sum rewards: 46.010, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.040', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.158', 'WEAPON5': '0.200', 'weapon5': '0.208', 'AMMO3': '0.215', 'WEAPON4': '0.350', 'weapon2': '0.382', 'weapon4': '0.542', 'WEAPON3': '1.200', 'HITCOUNT': '2.490', 'weapon3': '2.532', 'DAMAGECOUNT': '11.727', 'FRAGCOUNT': '42.000'} [2023-02-24 20:55:56,043][213383] DAMAGECOUNT value on done: 247724.0 [2023-02-24 20:55:56,044][213383] Sum rewards: 43.542, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.385', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon5': '0.072', 'AMMO4': '0.105', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'weapon4': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.634', 'WEAPON3': '1.200', 'HITCOUNT': '2.630', 'weapon3': '2.882', 'DAMAGECOUNT': '11.766', 'FRAGCOUNT': '40.000'} [2023-02-24 20:55:56,060][213369] DAMAGECOUNT value on done: 247660.0 [2023-02-24 20:55:56,060][213369] Sum rewards: 63.086, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.037', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.016', 'weapon5': '0.044', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'weapon4': '0.312', 'weapon2': '0.472', 'WEAPON3': '1.250', 'weapon3': '3.008', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.032', 'FRAGCOUNT': '52.000'} [2023-02-24 20:55:56,063][213365] Updated weights for policy 0, policy_version 30586 (0.0009) [2023-02-24 20:55:56,295][213384] DAMAGECOUNT value on done: 260324.0 [2023-02-24 20:55:56,295][213384] Sum rewards: 31.385, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.070', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.045', 'AMMO3': '0.134', 'weapon5': '0.212', 'AMMO4': '0.226', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon4': '0.632', 'WEAPON3': '0.850', 'weapon2': '0.898', 'weapon3': '2.000', 'HITCOUNT': '2.310', 'DAMAGECOUNT': '9.708', 'FRAGCOUNT': '29.000'} [2023-02-24 20:55:59,061][213365] Updated weights for policy 0, policy_version 30596 (0.0008) [2023-02-24 20:56:00,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13440.4). Total num frames: 125333504. Throughput: 0: 3362.8. Samples: 6329774. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:56:00,243][213332] Avg episode reward: [(0, '39.699')] [2023-02-24 20:56:00,277][213352] Saving new best policy, reward=39.699! [2023-02-24 20:56:02,070][213365] Updated weights for policy 0, policy_version 30606 (0.0009) [2023-02-24 20:56:05,202][213365] Updated weights for policy 0, policy_version 30616 (0.0009) [2023-02-24 20:56:05,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 125403136. Throughput: 0: 3363.4. Samples: 6339996. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:56:05,243][213332] Avg episode reward: [(0, '39.699')] [2023-02-24 20:56:08,217][213365] Updated weights for policy 0, policy_version 30626 (0.0009) [2023-02-24 20:56:10,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 125468672. Throughput: 0: 3362.8. Samples: 6360028. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:56:10,243][213332] Avg episode reward: [(0, '39.699')] [2023-02-24 20:56:11,252][213365] Updated weights for policy 0, policy_version 30636 (0.0009) [2023-02-24 20:56:12,689][213372] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.546, 182.0)] [2023-02-24 20:56:13,145][213367] DAMAGECOUNT value on done: 257818.0 [2023-02-24 20:56:13,146][213367] Sum rewards: 37.538, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.436', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.102', 'AMMO4': '0.161', 'WEAPON5': '0.200', 'AMMO3': '0.259', 'weapon2': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.354', 'WEAPON3': '1.500', 'HITCOUNT': '2.470', 'weapon3': '2.906', 'DAMAGECOUNT': '11.325', 'FRAGCOUNT': '38.000'} [2023-02-24 20:56:13,466][213367] DAMAGECOUNT value on done: 260386.0 [2023-02-24 20:56:13,467][213367] Sum rewards: 37.984, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.460', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.102', 'weapon5': '0.102', 'AMMO4': '0.154', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.326', 'WEAPON3': '0.900', 'HITCOUNT': '2.220', 'weapon3': '3.244', 'DAMAGECOUNT': '10.449', 'FRAGCOUNT': '33.000'} [2023-02-24 20:56:13,795][213367] DAMAGECOUNT value on done: 265037.0 [2023-02-24 20:56:13,796][213367] Sum rewards: 33.556, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.685', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.031', 'ARMOR': '0.035', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon4': '0.668', 'weapon2': '0.744', 'WEAPON3': '1.300', 'weapon3': '2.128', 'HITCOUNT': '2.290', 'DAMAGECOUNT': '10.005', 'FRAGCOUNT': '32.000'} [2023-02-24 20:56:13,906][213372] DAMAGECOUNT value on done: 263416.0 [2023-02-24 20:56:13,906][213372] Sum rewards: 50.093, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.037', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'weapon4': '0.264', 'weapon2': '0.442', 'WEAPON3': '1.400', 'HITCOUNT': '2.920', 'weapon3': '2.928', 'DAMAGECOUNT': '13.440', 'FRAGCOUNT': '45.000'} [2023-02-24 20:56:14,105][213367] DAMAGECOUNT value on done: 260434.0 [2023-02-24 20:56:14,106][213367] Sum rewards: 44.832, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.292', 'AMMO5': '0.004', 'ARMOR': '0.004', 'AMMO2': '0.027', 'weapon5': '0.062', 'WEAPON5': '0.100', 'weapon4': '0.102', 'AMMO4': '0.136', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon2': '0.592', 'WEAPON3': '1.100', 'HITCOUNT': '2.850', 'weapon3': '3.104', 'DAMAGECOUNT': '12.411', 'FRAGCOUNT': '39.000'} [2023-02-24 20:56:14,142][213372] DAMAGECOUNT value on done: 255419.0 [2023-02-24 20:56:14,143][213372] Sum rewards: 32.834, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.052', 'AMMO5': '0.029', 'AMMO2': '0.057', 'AMMO3': '0.094', 'AMMO4': '0.287', 'weapon5': '0.292', 'WEAPON3': '0.550', 'weapon2': '0.652', 'WEAPON5': '0.750', 'WEAPON4': '0.800', 'weapon4': '1.092', 'weapon3': '1.520', 'HITCOUNT': '2.190', 'DAMAGECOUNT': '9.822', 'FRAGCOUNT': '31.000'} [2023-02-24 20:56:14,161][213366] DAMAGECOUNT value on done: 257589.0 [2023-02-24 20:56:14,161][213366] Sum rewards: 41.647, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.770', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon5': '0.086', 'AMMO3': '0.159', 'AMMO4': '0.231', 'WEAPON5': '0.250', 'weapon2': '0.360', 'WEAPON4': '0.550', 'weapon4': '0.626', 'WEAPON3': '1.000', 'HITCOUNT': '2.460', 'weapon3': '2.728', 'DAMAGECOUNT': '11.409', 'FRAGCOUNT': '38.000'} [2023-02-24 20:56:14,229][213372] DAMAGECOUNT value on done: 265335.0 [2023-02-24 20:56:14,230][213372] Sum rewards: 45.461, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.296', 'AMMO2': '0.003', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.013', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'weapon5': '0.198', 'WEAPON5': '0.200', 'weapon4': '0.314', 'weapon2': '0.470', 'WEAPON3': '1.150', 'HITCOUNT': '2.610', 'weapon3': '2.716', 'DAMAGECOUNT': '12.237', 'FRAGCOUNT': '41.000'} [2023-02-24 20:56:14,360][213365] Updated weights for policy 0, policy_version 30646 (0.0010) [2023-02-24 20:56:14,440][213366] DAMAGECOUNT value on done: 263545.0 [2023-02-24 20:56:14,441][213366] Sum rewards: 35.689, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.350', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.125', 'weapon4': '0.184', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'weapon2': '0.638', 'WEAPON3': '1.250', 'HITCOUNT': '2.500', 'weapon3': '2.886', 'DAMAGECOUNT': '9.912', 'FRAGCOUNT': '34.000'} [2023-02-24 20:56:14,464][213372] DAMAGECOUNT value on done: 256029.0 [2023-02-24 20:56:14,465][213372] Sum rewards: 50.129, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.293', 'AMMO5': '0.007', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.152', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'weapon4': '0.270', 'WEAPON4': '0.350', 'weapon2': '0.678', 'WEAPON3': '1.300', 'weapon3': '2.650', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '14.304', 'FRAGCOUNT': '45.000'} [2023-02-24 20:56:14,481][213366] DAMAGECOUNT value on done: 268461.0 [2023-02-24 20:56:14,482][213366] Sum rewards: 49.523, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.235', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.104', 'AMMO4': '0.158', 'weapon4': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.128', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '13.770', 'FRAGCOUNT': '44.500'} [2023-02-24 20:56:14,754][213366] DAMAGECOUNT value on done: 259755.0 [2023-02-24 20:56:14,754][213366] Sum rewards: 24.117, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.945', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.136', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'weapon4': '0.516', 'weapon2': '0.998', 'WEAPON3': '1.200', 'HITCOUNT': '1.940', 'weapon3': '2.140', 'DAMAGECOUNT': '8.511', 'FRAGCOUNT': '25.000'} [2023-02-24 20:56:14,756][213368] DAMAGECOUNT value on done: 256005.0 [2023-02-24 20:56:14,757][213368] Sum rewards: 42.282, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.310', 'AMMO5': '0.016', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.151', 'weapon5': '0.208', 'weapon4': '0.268', 'WEAPON4': '0.350', 'weapon2': '0.378', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'HITCOUNT': '2.370', 'weapon3': '2.760', 'DAMAGECOUNT': '11.766', 'FRAGCOUNT': '36.500'} [2023-02-24 20:56:14,839][213383] DAMAGECOUNT value on done: 258132.0 [2023-02-24 20:56:14,840][213383] Sum rewards: 38.120, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.225', 'AMMO5': '0.007', 'AMMO2': '0.031', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.214', 'weapon5': '0.218', 'weapon2': '0.400', 'weapon4': '0.708', 'WEAPON3': '1.300', 'weapon3': '2.418', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '11.586', 'FRAGCOUNT': '33.000'} [2023-02-24 20:56:15,052][213382] DAMAGECOUNT value on done: 259167.0 [2023-02-24 20:56:15,053][213382] Sum rewards: 44.921, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.082', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.177', 'weapon5': '0.186', 'AMMO4': '0.203', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.372', 'weapon4': '0.980', 'WEAPON3': '1.100', 'weapon3': '1.968', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '11.856', 'FRAGCOUNT': '40.000'} [2023-02-24 20:56:15,063][213368] DAMAGECOUNT value on done: 258581.0 [2023-02-24 20:56:15,064][213368] Sum rewards: 37.995, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.564', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon4': '0.160', 'weapon5': '0.198', 'WEAPON4': '0.250', 'AMMO3': '0.252', 'weapon2': '0.266', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '2.540', 'weapon3': '3.072', 'DAMAGECOUNT': '12.159', 'FRAGCOUNT': '36.000'} [2023-02-24 20:56:15,140][213383] DAMAGECOUNT value on done: 257114.0 [2023-02-24 20:56:15,141][213383] Sum rewards: 46.751, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.080', 'AMMO5': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon4': '0.060', 'WEAPON4': '0.150', 'weapon5': '0.150', 'WEAPON5': '0.250', 'AMMO3': '0.309', 'weapon2': '0.440', 'WEAPON3': '1.850', 'HITCOUNT': '2.750', 'weapon3': '2.920', 'DAMAGECOUNT': '13.134', 'FRAGCOUNT': '46.000'} [2023-02-24 20:56:15,142][213369] DAMAGECOUNT value on done: 262933.0 [2023-02-24 20:56:15,142][213369] Sum rewards: 30.748, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.440', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon5': '0.126', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'weapon2': '0.334', 'weapon4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.300', 'weapon3': '2.928', 'DAMAGECOUNT': '11.274', 'FRAGCOUNT': '30.000'} [2023-02-24 20:56:15,243][213332] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13440.4). Total num frames: 125534208. Throughput: 0: 3363.4. Samples: 6380114. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:56:15,243][213332] Avg episode reward: [(0, '39.902')] [2023-02-24 20:56:15,254][213352] Saving new best policy, reward=39.902! [2023-02-24 20:56:15,328][213368] DAMAGECOUNT value on done: 261552.0 [2023-02-24 20:56:15,329][213368] Sum rewards: 42.009, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.910', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon5': '0.074', 'AMMO4': '0.117', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'weapon4': '0.298', 'WEAPON4': '0.300', 'weapon2': '0.780', 'WEAPON3': '1.350', 'weapon3': '2.580', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '11.838', 'FRAGCOUNT': '40.000'} [2023-02-24 20:56:15,372][213382] DAMAGECOUNT value on done: 258706.0 [2023-02-24 20:56:15,373][213382] Sum rewards: 46.728, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.345', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'weapon4': '0.088', 'AMMO3': '0.209', 'weapon2': '0.616', 'WEAPON3': '1.350', 'HITCOUNT': '2.960', 'weapon3': '3.146', 'DAMAGECOUNT': '12.345', 'FRAGCOUNT': '41.000'} [2023-02-24 20:56:15,460][213384] DAMAGECOUNT value on done: 263725.0 [2023-02-24 20:56:15,461][213384] Sum rewards: 44.169, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.710', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon5': '0.052', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'weapon4': '0.278', 'WEAPON4': '0.300', 'weapon2': '0.704', 'WEAPON3': '1.400', 'weapon3': '2.672', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.819', 'FRAGCOUNT': '41.000'} [2023-02-24 20:56:15,467][213369] DAMAGECOUNT value on done: 261750.0 [2023-02-24 20:56:15,468][213369] Sum rewards: 55.321, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.580', 'AMMO5': '0.007', 'AMMO2': '0.036', 'AMMO3': '0.166', 'AMMO4': '0.178', 'weapon5': '0.192', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.446', 'weapon2': '0.460', 'WEAPON3': '1.050', 'weapon3': '2.570', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.926', 'FRAGCOUNT': '47.000'} [2023-02-24 20:56:15,633][213368] DAMAGECOUNT value on done: 252322.0 [2023-02-24 20:56:15,634][213368] Sum rewards: 39.034, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.503', 'AMMO5': '0.021', 'AMMO2': '0.051', 'AMMO3': '0.160', 'weapon5': '0.236', 'AMMO4': '0.254', 'weapon4': '0.472', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon2': '0.690', 'WEAPON3': '1.050', 'weapon3': '2.254', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '11.649', 'FRAGCOUNT': '36.000'} [2023-02-24 20:56:15,666][213382] DAMAGECOUNT value on done: 254479.0 [2023-02-24 20:56:15,666][213382] Sum rewards: 31.627, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.979', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon5': '0.142', 'weapon2': '0.244', 'AMMO3': '0.255', 'AMMO4': '0.256', 'weapon4': '0.320', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.600', 'HITCOUNT': '2.880', 'weapon3': '2.928', 'DAMAGECOUNT': '11.913', 'FRAGCOUNT': '33.000'} [2023-02-24 20:56:15,759][213384] DAMAGECOUNT value on done: 250469.0 [2023-02-24 20:56:15,760][213384] Sum rewards: 41.941, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.650', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon4': '0.314', 'weapon2': '0.366', 'WEAPON3': '1.300', 'HITCOUNT': '2.590', 'weapon3': '2.988', 'DAMAGECOUNT': '11.556', 'FRAGCOUNT': '39.000'} [2023-02-24 20:56:15,760][213383] DAMAGECOUNT value on done: 259015.0 [2023-02-24 20:56:15,761][213383] Sum rewards: 44.295, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.495', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.112', 'AMMO4': '0.120', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'WEAPON4': '0.350', 'weapon2': '0.476', 'weapon4': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.456', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '12.249', 'FRAGCOUNT': '39.000'} [2023-02-24 20:56:15,763][213369] DAMAGECOUNT value on done: 264078.0 [2023-02-24 20:56:15,764][213369] Sum rewards: 49.447, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.380', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.196', 'weapon5': '0.214', 'weapon2': '0.234', 'WEAPON4': '0.350', 'weapon4': '0.352', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.930', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.569', 'FRAGCOUNT': '43.500'} [2023-02-24 20:56:15,959][213382] DAMAGECOUNT value on done: 264141.0 [2023-02-24 20:56:15,960][213382] Sum rewards: 37.933, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.218', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon4': '0.120', 'weapon5': '0.126', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.510', 'WEAPON3': '1.200', 'HITCOUNT': '2.520', 'weapon3': '2.920', 'DAMAGECOUNT': '10.917', 'FRAGCOUNT': '35.000'} [2023-02-24 20:56:15,981][213384] DAMAGECOUNT value on done: 263967.0 [2023-02-24 20:56:15,982][213384] Sum rewards: 34.916, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.228', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO3': '0.152', 'AMMO4': '0.182', 'weapon5': '0.248', 'WEAPON4': '0.350', 'weapon4': '0.378', 'WEAPON5': '0.400', 'weapon2': '0.422', 'WEAPON3': '0.950', 'HITCOUNT': '2.320', 'weapon3': '2.702', 'DAMAGECOUNT': '10.986', 'FRAGCOUNT': '29.000'} [2023-02-24 20:56:16,053][213369] DAMAGECOUNT value on done: 251283.0 [2023-02-24 20:56:16,053][213369] Sum rewards: 40.846, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.098', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'WEAPON4': '0.300', 'weapon2': '0.376', 'weapon4': '0.602', 'WEAPON3': '0.950', 'HITCOUNT': '2.680', 'weapon3': '2.686', 'DAMAGECOUNT': '10.629', 'FRAGCOUNT': '36.000'} [2023-02-24 20:56:16,055][213383] DAMAGECOUNT value on done: 252376.0 [2023-02-24 20:56:16,056][213383] Sum rewards: 47.325, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.862', 'AMMO5': '0.015', 'ARMOR': '0.024', 'AMMO2': '0.035', 'AMMO3': '0.124', 'AMMO4': '0.173', 'weapon5': '0.238', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.616', 'WEAPON3': '0.750', 'weapon4': '0.782', 'weapon3': '1.834', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '13.956', 'FRAGCOUNT': '38.000'} [2023-02-24 20:56:16,278][213384] DAMAGECOUNT value on done: 264374.0 [2023-02-24 20:56:16,278][213384] Sum rewards: 42.657, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.947', 'ARMOR': '0.004', 'AMMO2': '0.005', 'AMMO4': '0.024', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'weapon4': '0.462', 'weapon2': '0.610', 'WEAPON3': '1.200', 'weapon3': '2.690', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '12.150', 'FRAGCOUNT': '39.000'} [2023-02-24 20:56:17,344][213365] Updated weights for policy 0, policy_version 30656 (0.0009) [2023-02-24 20:56:20,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 125603840. Throughput: 0: 3363.0. Samples: 6390342. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:56:20,243][213332] Avg episode reward: [(0, '40.592')] [2023-02-24 20:56:20,244][213352] Saving new best policy, reward=40.592! [2023-02-24 20:56:20,420][213365] Updated weights for policy 0, policy_version 30666 (0.0009) [2023-02-24 20:56:23,431][213365] Updated weights for policy 0, policy_version 30676 (0.0009) [2023-02-24 20:56:25,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 125669376. Throughput: 0: 3367.0. Samples: 6410534. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:56:25,243][213332] Avg episode reward: [(0, '40.592')] [2023-02-24 20:56:25,770][213369] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 20:56:26,432][213365] Updated weights for policy 0, policy_version 30686 (0.0009) [2023-02-24 20:56:29,529][213365] Updated weights for policy 0, policy_version 30696 (0.0009) [2023-02-24 20:56:30,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 125739008. Throughput: 0: 3366.9. Samples: 6430702. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:56:30,243][213332] Avg episode reward: [(0, '40.592')] [2023-02-24 20:56:32,527][213365] Updated weights for policy 0, policy_version 30706 (0.0009) [2023-02-24 20:56:33,076][213367] DAMAGECOUNT value on done: 261718.0 [2023-02-24 20:56:33,076][213367] Sum rewards: 39.678, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.688', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.068', 'AMMO4': '0.082', 'weapon4': '0.102', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.273', 'weapon2': '0.284', 'WEAPON3': '1.600', 'HITCOUNT': '2.820', 'weapon3': '3.310', 'DAMAGECOUNT': '11.700', 'FRAGCOUNT': '39.000'} [2023-02-24 20:56:33,388][213367] DAMAGECOUNT value on done: 264005.0 [2023-02-24 20:56:33,388][213367] Sum rewards: 30.574, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.200', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.066', 'AMMO4': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.253', 'weapon4': '0.290', 'WEAPON4': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.600', 'HITCOUNT': '2.500', 'weapon3': '3.068', 'DAMAGECOUNT': '10.857', 'FRAGCOUNT': '31.000'} [2023-02-24 20:56:33,749][213367] DAMAGECOUNT value on done: 269112.0 [2023-02-24 20:56:33,750][213367] Sum rewards: 47.138, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.582', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'weapon2': '0.184', 'weapon5': '0.336', 'WEAPON3': '1.050', 'HITCOUNT': '2.710', 'weapon3': '3.150', 'DAMAGECOUNT': '12.225', 'FRAGCOUNT': '39.000'} [2023-02-24 20:56:33,796][213372] DAMAGECOUNT value on done: 267573.0 [2023-02-24 20:56:33,797][213372] Sum rewards: 46.367, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.980', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon4': '0.136', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'weapon2': '0.286', 'WEAPON3': '1.100', 'HITCOUNT': '2.660', 'weapon3': '3.460', 'DAMAGECOUNT': '12.471', 'FRAGCOUNT': '39.000'} [2023-02-24 20:56:34,027][213372] DAMAGECOUNT value on done: 259745.0 [2023-02-24 20:56:34,028][213372] Sum rewards: 45.310, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.395', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.112', 'weapon5': '0.116', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.520', 'weapon4': '0.590', 'WEAPON3': '1.100', 'weapon3': '2.580', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.978', 'FRAGCOUNT': '38.000'} [2023-02-24 20:56:34,062][213367] DAMAGECOUNT value on done: 263651.0 [2023-02-24 20:56:34,062][213367] Sum rewards: 28.863, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.379', 'AMMO5': '0.014', 'weapon7': '0.054', 'AMMO2': '0.067', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.184', 'weapon5': '0.262', 'AMMO4': '0.335', 'WEAPON5': '0.400', 'weapon2': '0.676', 'WEAPON4': '0.750', 'WEAPON3': '1.000', 'weapon4': '1.128', 'weapon3': '1.370', 'HITCOUNT': '2.050', 'DAMAGECOUNT': '9.651', 'FRAGCOUNT': '31.000'} [2023-02-24 20:56:34,106][213366] DAMAGECOUNT value on done: 260276.0 [2023-02-24 20:56:34,107][213366] Sum rewards: 24.617, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.547', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon7': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.123', 'weapon5': '0.152', 'WEAPON7': '0.200', 'AMMO4': '0.231', 'WEAPON5': '0.300', 'weapon2': '0.384', 'WEAPON4': '0.600', 'WEAPON3': '0.700', 'weapon4': '0.898', 'weapon3': '1.246', 'HITCOUNT': '1.650', 'DAMAGECOUNT': '7.560', 'FRAGCOUNT': '24.000'} [2023-02-24 20:56:34,126][213372] DAMAGECOUNT value on done: 269675.0 [2023-02-24 20:56:34,127][213372] Sum rewards: 40.092, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.963', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.060', 'AMMO3': '0.208', 'weapon4': '0.240', 'AMMO4': '0.302', 'weapon2': '0.356', 'weapon5': '0.378', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.300', 'HITCOUNT': '2.290', 'weapon3': '2.670', 'DAMAGECOUNT': '13.020', 'FRAGCOUNT': '37.000'} [2023-02-24 20:56:34,377][213372] DAMAGECOUNT value on done: 259261.0 [2023-02-24 20:56:34,378][213372] Sum rewards: 39.056, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.361', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon5': '0.138', 'AMMO3': '0.150', 'AMMO4': '0.193', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON4': '0.350', 'weapon4': '0.672', 'WEAPON3': '0.900', 'HITCOUNT': '2.440', 'weapon3': '2.696', 'DAMAGECOUNT': '9.696', 'FRAGCOUNT': '34.500'} [2023-02-24 20:56:34,419][213366] DAMAGECOUNT value on done: 267256.0 [2023-02-24 20:56:34,419][213366] Sum rewards: 29.309, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.504', 'AMMO5': '0.028', 'AMMO2': '0.063', 'AMMO3': '0.196', 'AMMO4': '0.316', 'weapon2': '0.340', 'weapon5': '0.450', 'WEAPON5': '0.700', 'WEAPON4': '0.750', 'weapon4': '1.032', 'WEAPON3': '1.100', 'weapon3': '1.784', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '11.133', 'FRAGCOUNT': '28.000'} [2023-02-24 20:56:34,439][213366] DAMAGECOUNT value on done: 272041.0 [2023-02-24 20:56:34,439][213366] Sum rewards: 40.052, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.433', 'AMMO5': '0.004', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'weapon7': '0.054', 'AMMO4': '0.063', 'weapon5': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'weapon2': '0.352', 'weapon4': '0.398', 'WEAPON3': '1.100', 'HITCOUNT': '2.300', 'weapon3': '2.750', 'DAMAGECOUNT': '10.740', 'FRAGCOUNT': '33.500'} [2023-02-24 20:56:34,716][213368] DAMAGECOUNT value on done: 259370.0 [2023-02-24 20:56:34,717][213368] Sum rewards: 31.943, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.184', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.202', 'AMMO3': '0.236', 'weapon5': '0.280', 'weapon4': '0.452', 'WEAPON3': '1.350', 'HITCOUNT': '2.070', 'weapon3': '2.790', 'DAMAGECOUNT': '10.095', 'FRAGCOUNT': '31.000'} [2023-02-24 20:56:34,744][213366] DAMAGECOUNT value on done: 263251.0 [2023-02-24 20:56:34,744][213366] Sum rewards: 37.811, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.915', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon4': '0.054', 'AMMO4': '0.076', 'weapon5': '0.162', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.552', 'WEAPON3': '1.250', 'HITCOUNT': '2.510', 'weapon3': '3.032', 'DAMAGECOUNT': '10.488', 'FRAGCOUNT': '34.000'} [2023-02-24 20:56:34,752][213383] DAMAGECOUNT value on done: 262679.0 [2023-02-24 20:56:34,752][213383] Sum rewards: 53.774, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.655', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon2': '0.206', 'weapon4': '0.294', 'WEAPON3': '1.150', 'HITCOUNT': '3.010', 'weapon3': '3.298', 'DAMAGECOUNT': '13.551', 'FRAGCOUNT': '46.000'} [2023-02-24 20:56:34,973][213382] DAMAGECOUNT value on done: 262799.0 [2023-02-24 20:56:34,974][213382] Sum rewards: 35.556, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.907', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.039', 'AMMO4': '0.194', 'AMMO3': '0.206', 'weapon5': '0.216', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.430', 'weapon4': '0.482', 'WEAPON3': '1.200', 'HITCOUNT': '2.260', 'weapon3': '2.520', 'DAMAGECOUNT': '10.896', 'FRAGCOUNT': '34.000'} [2023-02-24 20:56:35,020][213368] DAMAGECOUNT value on done: 262052.0 [2023-02-24 20:56:35,020][213368] Sum rewards: 31.029, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.730', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.224', 'weapon5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon4': '0.496', 'WEAPON3': '1.200', 'HITCOUNT': '2.380', 'weapon3': '2.734', 'DAMAGECOUNT': '10.413', 'FRAGCOUNT': '28.500'} [2023-02-24 20:56:35,055][213383] DAMAGECOUNT value on done: 261144.0 [2023-02-24 20:56:35,056][213383] Sum rewards: 39.028, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.752', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon5': '0.148', 'AMMO4': '0.240', 'weapon2': '0.270', 'AMMO3': '0.297', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.576', 'WEAPON3': '1.700', 'weapon3': '2.656', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.090', 'FRAGCOUNT': '40.000'} [2023-02-24 20:56:35,057][213369] DAMAGECOUNT value on done: 266487.0 [2023-02-24 20:56:35,058][213369] Sum rewards: 33.904, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.464', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon5': '0.150', 'AMMO4': '0.203', 'AMMO3': '0.215', 'WEAPON5': '0.350', 'weapon2': '0.394', 'WEAPON4': '0.450', 'weapon4': '0.646', 'WEAPON3': '1.200', 'HITCOUNT': '2.010', 'weapon3': '2.524', 'DAMAGECOUNT': '10.662', 'FRAGCOUNT': '32.500'} [2023-02-24 20:56:35,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 125804544. Throughput: 0: 3364.9. Samples: 6440918. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:56:35,243][213332] Avg episode reward: [(0, '39.967')] [2023-02-24 20:56:35,246][213368] DAMAGECOUNT value on done: 265677.0 [2023-02-24 20:56:35,247][213368] Sum rewards: 42.882, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.723', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.165', 'weapon4': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.326', 'weapon5': '0.376', 'WEAPON3': '1.000', 'HITCOUNT': '2.460', 'weapon3': '2.744', 'DAMAGECOUNT': '12.375', 'FRAGCOUNT': '37.000'} [2023-02-24 20:56:35,276][213382] DAMAGECOUNT value on done: 263319.0 [2023-02-24 20:56:35,277][213382] Sum rewards: 51.046, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.797', 'AMMO5': '0.014', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.132', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon2': '0.236', 'WEAPON5': '0.350', 'weapon4': '0.736', 'WEAPON3': '1.300', 'weapon3': '2.472', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.524', 'FRAGCOUNT': '44.000'} [2023-02-24 20:56:35,355][213369] DAMAGECOUNT value on done: 264855.0 [2023-02-24 20:56:35,355][213369] Sum rewards: 23.377, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.170', 'AMMO5': '0.010', 'AMMO2': '0.065', 'weapon5': '0.170', 'AMMO3': '0.205', 'AMMO4': '0.324', 'WEAPON5': '0.350', 'weapon2': '0.502', 'WEAPON4': '0.850', 'weapon4': '1.036', 'WEAPON3': '1.100', 'weapon3': '1.910', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '9.315', 'FRAGCOUNT': '27.000'} [2023-02-24 20:56:35,395][213384] DAMAGECOUNT value on done: 267672.0 [2023-02-24 20:56:35,396][213384] Sum rewards: 45.179, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.521', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'weapon7': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.182', 'WEAPON7': '0.200', 'weapon2': '0.204', 'WEAPON4': '0.250', 'weapon4': '0.492', 'WEAPON3': '1.100', 'weapon3': '2.692', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '11.841', 'FRAGCOUNT': '40.000'} [2023-02-24 20:56:35,539][213368] DAMAGECOUNT value on done: 255866.0 [2023-02-24 20:56:35,540][213368] Sum rewards: 30.133, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.075', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.084', 'WEAPON5': '0.150', 'weapon4': '0.182', 'weapon2': '0.184', 'WEAPON4': '0.200', 'AMMO3': '0.309', 'WEAPON3': '1.750', 'HITCOUNT': '2.340', 'weapon3': '3.274', 'DAMAGECOUNT': '10.632', 'FRAGCOUNT': '31.000'} [2023-02-24 20:56:35,572][213382] DAMAGECOUNT value on done: 258105.0 [2023-02-24 20:56:35,573][213382] Sum rewards: 38.913, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.653', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.163', 'weapon5': '0.164', 'weapon2': '0.234', 'weapon4': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.610', 'weapon3': '2.962', 'DAMAGECOUNT': '10.878', 'FRAGCOUNT': '35.000'} [2023-02-24 20:56:35,604][213365] Updated weights for policy 0, policy_version 30716 (0.0009) [2023-02-24 20:56:35,630][213383] DAMAGECOUNT value on done: 262561.0 [2023-02-24 20:56:35,630][213383] Sum rewards: 36.666, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.812', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon5': '0.044', 'AMMO4': '0.104', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.464', 'weapon2': '0.602', 'WEAPON3': '1.250', 'HITCOUNT': '2.440', 'weapon3': '2.652', 'DAMAGECOUNT': '10.638', 'FRAGCOUNT': '34.000'} [2023-02-24 20:56:35,640][213369] DAMAGECOUNT value on done: 267878.0 [2023-02-24 20:56:35,641][213369] Sum rewards: 36.960, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.300', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.034', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO3': '0.274', 'weapon2': '0.532', 'WEAPON3': '1.550', 'HITCOUNT': '2.510', 'weapon3': '3.090', 'DAMAGECOUNT': '11.400', 'FRAGCOUNT': '35.000'} [2023-02-24 20:56:35,699][213384] DAMAGECOUNT value on done: 254277.0 [2023-02-24 20:56:35,699][213384] Sum rewards: 36.376, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.554', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon5': '0.084', 'AMMO4': '0.216', 'weapon4': '0.218', 'AMMO3': '0.273', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.466', 'WEAPON3': '1.600', 'HITCOUNT': '2.680', 'weapon3': '2.942', 'DAMAGECOUNT': '11.394', 'FRAGCOUNT': '38.000'} [2023-02-24 20:56:35,862][213382] DAMAGECOUNT value on done: 268203.0 [2023-02-24 20:56:35,863][213382] Sum rewards: 46.085, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.040', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon5': '0.070', 'AMMO3': '0.141', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'WEAPON4': '0.400', 'weapon2': '0.560', 'weapon4': '0.626', 'WEAPON3': '0.900', 'weapon3': '2.514', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.186', 'FRAGCOUNT': '40.000'} [2023-02-24 20:56:35,924][213384] DAMAGECOUNT value on done: 267381.0 [2023-02-24 20:56:35,924][213384] Sum rewards: 29.890, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.816', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon5': '0.158', 'AMMO3': '0.220', 'AMMO4': '0.238', 'weapon4': '0.316', 'weapon2': '0.366', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.310', 'weapon3': '2.790', 'DAMAGECOUNT': '10.242', 'FRAGCOUNT': '30.500'} [2023-02-24 20:56:35,933][213383] DAMAGECOUNT value on done: 256849.0 [2023-02-24 20:56:35,934][213383] Sum rewards: 45.224, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.447', 'AMMO5': '0.006', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.132', 'weapon4': '0.176', 'weapon2': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '2.820', 'weapon3': '3.246', 'DAMAGECOUNT': '13.395', 'FRAGCOUNT': '42.000'} [2023-02-24 20:56:35,946][213369] DAMAGECOUNT value on done: 254869.0 [2023-02-24 20:56:35,947][213369] Sum rewards: 33.603, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.928', 'AMMO5': '0.025', 'AMMO2': '0.044', 'AMMO3': '0.209', 'AMMO4': '0.219', 'weapon5': '0.304', 'weapon4': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.486', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'HITCOUNT': '2.160', 'weapon3': '2.426', 'DAMAGECOUNT': '10.758', 'FRAGCOUNT': '32.000'} [2023-02-24 20:56:36,221][213384] DAMAGECOUNT value on done: 268700.0 [2023-02-24 20:56:36,222][213384] Sum rewards: 49.354, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.516', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon7': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.140', 'AMMO3': '0.161', 'WEAPON7': '0.200', 'AMMO4': '0.202', 'weapon2': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.650', 'WEAPON3': '1.000', 'weapon4': '1.216', 'weapon3': '2.026', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.978', 'FRAGCOUNT': '44.000'} [2023-02-24 20:56:36,417][213382] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 20:56:38,609][213365] Updated weights for policy 0, policy_version 30726 (0.0009) [2023-02-24 20:56:40,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13454.3). Total num frames: 125874176. Throughput: 0: 3369.1. Samples: 6461208. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:56:40,243][213332] Avg episode reward: [(0, '39.900')] [2023-02-24 20:56:41,603][213365] Updated weights for policy 0, policy_version 30736 (0.0009) [2023-02-24 20:56:44,551][213366] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 20:56:44,646][213365] Updated weights for policy 0, policy_version 30746 (0.0009) [2023-02-24 20:56:45,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13516.8, 300 sec: 13454.3). Total num frames: 125943808. Throughput: 0: 3372.1. Samples: 6481520. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:56:45,243][213332] Avg episode reward: [(0, '39.900')] [2023-02-24 20:56:45,247][213352] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000030748_125943808.pth... [2023-02-24 20:56:45,306][213352] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000029960_122716160.pth [2023-02-24 20:56:47,657][213365] Updated weights for policy 0, policy_version 30756 (0.0009) [2023-02-24 20:56:50,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13454.3). Total num frames: 126009344. Throughput: 0: 3370.8. Samples: 6491682. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:56:50,243][213332] Avg episode reward: [(0, '39.900')] [2023-02-24 20:56:50,715][213365] Updated weights for policy 0, policy_version 30766 (0.0009) [2023-02-24 20:56:53,001][213367] DAMAGECOUNT value on done: 266776.0 [2023-02-24 20:56:53,002][213367] Sum rewards: 51.806, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.710', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon5': '0.204', 'weapon4': '0.216', 'AMMO4': '0.228', 'AMMO3': '0.234', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.744', 'WEAPON3': '1.400', 'weapon3': '2.484', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.174', 'FRAGCOUNT': '48.000'} [2023-02-24 20:56:53,310][213367] DAMAGECOUNT value on done: 267766.0 [2023-02-24 20:56:53,310][213367] Sum rewards: 40.269, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.748', 'AMMO5': '0.022', 'AMMO2': '0.043', 'AMMO3': '0.146', 'AMMO4': '0.214', 'weapon2': '0.230', 'weapon5': '0.342', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.604', 'WEAPON3': '0.950', 'HITCOUNT': '2.380', 'weapon3': '2.502', 'DAMAGECOUNT': '11.283', 'FRAGCOUNT': '36.500'} [2023-02-24 20:56:53,607][213372] DAMAGECOUNT value on done: 270855.0 [2023-02-24 20:56:53,607][213372] Sum rewards: 39.913, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.800', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.016', 'weapon4': '0.016', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.123', 'weapon5': '0.144', 'WEAPON5': '0.150', 'WEAPON3': '0.750', 'weapon2': '1.062', 'HITCOUNT': '2.130', 'weapon3': '2.654', 'DAMAGECOUNT': '9.840', 'FRAGCOUNT': '32.000'} [2023-02-24 20:56:53,668][213367] DAMAGECOUNT value on done: 272763.0 [2023-02-24 20:56:53,669][213367] Sum rewards: 32.407, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.740', 'weapon5': '0.002', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.144', 'WEAPON5': '0.200', 'weapon2': '0.216', 'AMMO3': '0.281', 'WEAPON4': '0.400', 'weapon4': '0.544', 'WEAPON3': '1.700', 'HITCOUNT': '2.470', 'weapon3': '2.944', 'DAMAGECOUNT': '10.953', 'FRAGCOUNT': '35.000'} [2023-02-24 20:56:53,767][213365] Updated weights for policy 0, policy_version 30776 (0.0009) [2023-02-24 20:56:53,907][213372] DAMAGECOUNT value on done: 263827.0 [2023-02-24 20:56:53,907][213372] Sum rewards: 45.590, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.892', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon5': '0.096', 'AMMO3': '0.194', 'weapon4': '0.240', 'AMMO4': '0.272', 'weapon2': '0.290', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.760', 'weapon3': '3.112', 'DAMAGECOUNT': '12.246', 'FRAGCOUNT': '42.000'} [2023-02-24 20:56:53,926][213372] DAMAGECOUNT value on done: 272409.0 [2023-02-24 20:56:53,926][213372] Sum rewards: 27.498, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.369', 'AMMO5': '0.022', 'AMMO2': '0.042', 'AMMO3': '0.154', 'AMMO4': '0.210', 'weapon5': '0.238', 'weapon2': '0.416', 'WEAPON5': '0.500', 'weapon4': '0.592', 'WEAPON4': '0.600', 'WEAPON3': '0.900', 'HITCOUNT': '2.070', 'weapon3': '2.420', 'DAMAGECOUNT': '8.202', 'FRAGCOUNT': '27.000'} [2023-02-24 20:56:53,985][213367] DAMAGECOUNT value on done: 267138.0 [2023-02-24 20:56:53,985][213367] Sum rewards: 40.872, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.420', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon5': '0.076', 'AMMO3': '0.145', 'AMMO4': '0.246', 'WEAPON5': '0.350', 'weapon2': '0.362', 'WEAPON4': '0.500', 'WEAPON3': '0.800', 'weapon4': '0.874', 'weapon3': '2.374', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '10.461', 'FRAGCOUNT': '36.000'} [2023-02-24 20:56:54,026][213366] DAMAGECOUNT value on done: 263588.0 [2023-02-24 20:56:54,027][213366] Sum rewards: 33.959, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.922', 'ARMOR': '0.004', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO5': '0.026', 'AMMO4': '0.097', 'AMMO3': '0.192', 'weapon5': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.278', 'WEAPON5': '0.650', 'weapon4': '0.732', 'WEAPON3': '1.100', 'HITCOUNT': '2.150', 'weapon3': '2.198', 'DAMAGECOUNT': '9.936', 'FRAGCOUNT': '30.000'} [2023-02-24 20:56:54,230][213372] DAMAGECOUNT value on done: 263015.0 [2023-02-24 20:56:54,231][213372] Sum rewards: 44.183, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.020', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.036', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'weapon2': '0.302', 'WEAPON3': '1.200', 'HITCOUNT': '2.570', 'weapon3': '3.372', 'DAMAGECOUNT': '11.250', 'FRAGCOUNT': '38.000'} [2023-02-24 20:56:54,328][213366] DAMAGECOUNT value on done: 272096.0 [2023-02-24 20:56:54,329][213366] Sum rewards: 52.913, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.640', 'AMMO5': '0.020', 'AMMO2': '0.041', 'weapon5': '0.136', 'AMMO4': '0.205', 'AMMO3': '0.208', 'weapon2': '0.226', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.730', 'WEAPON3': '1.300', 'weapon3': '2.570', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.496', 'FRAGCOUNT': '46.000'} [2023-02-24 20:56:54,348][213366] DAMAGECOUNT value on done: 275600.0 [2023-02-24 20:56:54,348][213366] Sum rewards: 42.553, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.007', 'AMMO2': '0.039', 'HEALTH': '0.060', 'weapon5': '0.134', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'AMMO4': '0.195', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON3': '0.750', 'weapon4': '1.090', 'weapon3': '2.026', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '10.677', 'FRAGCOUNT': '36.000'} [2023-02-24 20:56:54,424][213383] DAMAGECOUNT value on done: 266713.0 [2023-02-24 20:56:54,424][213383] Sum rewards: 41.555, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.532', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.152', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'weapon4': '0.254', 'WEAPON4': '0.350', 'weapon2': '0.802', 'WEAPON3': '1.050', 'weapon3': '2.324', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '12.102', 'FRAGCOUNT': '35.000'} [2023-02-24 20:56:54,656][213366] DAMAGECOUNT value on done: 267583.0 [2023-02-24 20:56:54,656][213366] Sum rewards: 45.873, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.705', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon5': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.248', 'WEAPON4': '0.300', 'weapon4': '0.486', 'WEAPON3': '1.300', 'weapon3': '2.720', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '12.996', 'FRAGCOUNT': '41.000'} [2023-02-24 20:56:54,660][213368] DAMAGECOUNT value on done: 262946.0 [2023-02-24 20:56:54,661][213368] Sum rewards: 27.956, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.554', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.044', 'weapon7': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.183', 'AMMO4': '0.221', 'weapon5': '0.296', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.456', 'weapon4': '0.720', 'WEAPON3': '1.000', 'weapon3': '1.758', 'HITCOUNT': '1.840', 'DAMAGECOUNT': '9.528', 'FRAGCOUNT': '27.000'} [2023-02-24 20:56:54,730][213383] DAMAGECOUNT value on done: 261178.0 [2023-02-24 20:56:54,890][213382] DAMAGECOUNT value on done: 266448.0 [2023-02-24 20:56:54,890][213382] Sum rewards: 36.491, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.988', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.082', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'WEAPON4': '0.300', 'weapon4': '0.608', 'weapon2': '0.612', 'WEAPON3': '1.200', 'weapon3': '2.362', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '10.947', 'FRAGCOUNT': '32.000'} [2023-02-24 20:56:54,969][213369] DAMAGECOUNT value on done: 269996.0 [2023-02-24 20:56:54,969][213369] Sum rewards: 42.261, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.854', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.167', 'weapon5': '0.178', 'AMMO3': '0.189', 'weapon2': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.768', 'WEAPON3': '1.150', 'HITCOUNT': '2.420', 'weapon3': '2.474', 'DAMAGECOUNT': '10.527', 'FRAGCOUNT': '38.000'} [2023-02-24 20:56:54,990][213368] DAMAGECOUNT value on done: 265518.0 [2023-02-24 20:56:54,991][213368] Sum rewards: 38.139, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.780', 'AMMO5': '0.005', 'ARMOR': '0.028', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'AMMO3': '0.167', 'AMMO4': '0.180', 'WEAPON4': '0.300', 'weapon2': '0.514', 'weapon4': '0.564', 'WEAPON3': '1.100', 'HITCOUNT': '2.720', 'weapon3': '2.806', 'DAMAGECOUNT': '10.398', 'FRAGCOUNT': '33.000'} [2023-02-24 20:56:55,189][213382] DAMAGECOUNT value on done: 266919.0 [2023-02-24 20:56:55,190][213382] Sum rewards: 37.017, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.570', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'weapon5': '0.036', 'AMMO4': '0.063', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.232', 'weapon4': '0.352', 'weapon2': '0.536', 'WEAPON3': '1.400', 'HITCOUNT': '2.510', 'weapon3': '2.768', 'DAMAGECOUNT': '10.800', 'FRAGCOUNT': '34.000'} [2023-02-24 20:56:55,232][213368] DAMAGECOUNT value on done: 269058.0 [2023-02-24 20:56:55,233][213368] Sum rewards: 35.428, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.120', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon7': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'weapon5': '0.172', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'weapon2': '0.264', 'weapon4': '0.606', 'WEAPON3': '1.300', 'HITCOUNT': '2.180', 'weapon3': '2.470', 'DAMAGECOUNT': '10.143', 'FRAGCOUNT': '34.000'} [2023-02-24 20:56:55,243][213332] Fps is (10 sec: 13107.2, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 126074880. Throughput: 0: 3374.3. Samples: 6511870. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:56:55,243][213332] Avg episode reward: [(0, '39.418')] [2023-02-24 20:56:55,275][213369] DAMAGECOUNT value on done: 268201.0 [2023-02-24 20:56:55,276][213369] Sum rewards: 37.296, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.448', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.021', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.278', 'weapon4': '0.330', 'weapon2': '0.456', 'WEAPON3': '1.550', 'HITCOUNT': '2.540', 'weapon3': '2.930', 'DAMAGECOUNT': '10.038', 'FRAGCOUNT': '37.000'} [2023-02-24 20:56:55,314][213384] DAMAGECOUNT value on done: 272095.0 [2023-02-24 20:56:55,314][213384] Sum rewards: 50.380, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.530', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'weapon5': '0.150', 'AMMO3': '0.186', 'WEAPON5': '0.250', 'weapon4': '0.392', 'weapon2': '0.426', 'WEAPON3': '1.200', 'weapon3': '2.812', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.269', 'FRAGCOUNT': '43.000'} [2023-02-24 20:56:55,324][213383] DAMAGECOUNT value on done: 266237.0 [2023-02-24 20:56:55,324][213383] Sum rewards: 30.878, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.692', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.043', 'AMMO3': '0.185', 'weapon5': '0.198', 'AMMO4': '0.214', 'WEAPON5': '0.300', 'weapon4': '0.312', 'WEAPON4': '0.500', 'weapon2': '0.618', 'WEAPON3': '1.050', 'weapon3': '2.530', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '11.028', 'FRAGCOUNT': '31.000'} [2023-02-24 20:56:55,493][213382] DAMAGECOUNT value on done: 261412.0 [2023-02-24 20:56:55,494][213382] Sum rewards: 33.529, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.694', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.126', 'AMMO4': '0.166', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'weapon2': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.716', 'WEAPON3': '1.000', 'HITCOUNT': '2.370', 'weapon3': '2.596', 'DAMAGECOUNT': '9.921', 'FRAGCOUNT': '30.500'} [2023-02-24 20:56:55,527][213368] DAMAGECOUNT value on done: 259380.0 [2023-02-24 20:56:55,528][213368] Sum rewards: 34.445, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.306', 'AMMO5': '0.019', 'AMMO2': '0.033', 'weapon4': '0.150', 'AMMO4': '0.165', 'AMMO3': '0.181', 'weapon5': '0.208', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.886', 'WEAPON3': '1.050', 'HITCOUNT': '2.240', 'weapon3': '2.476', 'DAMAGECOUNT': '10.542', 'FRAGCOUNT': '32.000'} [2023-02-24 20:56:55,572][213369] DAMAGECOUNT value on done: 272053.0 [2023-02-24 20:56:55,573][213369] Sum rewards: 44.240, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.214', 'AMMO5': '0.004', 'AMMO2': '0.012', 'weapon5': '0.026', 'AMMO4': '0.058', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon2': '0.244', 'AMMO3': '0.245', 'weapon4': '0.308', 'WEAPON3': '1.400', 'HITCOUNT': '2.820', 'weapon3': '3.262', 'DAMAGECOUNT': '12.525', 'FRAGCOUNT': '41.000'} [2023-02-24 20:56:55,617][213384] DAMAGECOUNT value on done: 257604.0 [2023-02-24 20:56:55,618][213384] Sum rewards: 37.521, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.135', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'weapon4': '0.354', 'weapon2': '0.632', 'WEAPON3': '0.900', 'HITCOUNT': '2.260', 'weapon3': '2.770', 'DAMAGECOUNT': '9.981', 'FRAGCOUNT': '33.000'} [2023-02-24 20:56:55,626][213383] DAMAGECOUNT value on done: 260475.0 [2023-02-24 20:56:55,627][213383] Sum rewards: 38.190, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.208', 'AMMO2': '0.014', 'AMMO5': '0.017', 'AMMO4': '0.070', 'weapon5': '0.076', 'weapon4': '0.122', 'WEAPON4': '0.200', 'AMMO3': '0.302', 'WEAPON5': '0.400', 'weapon2': '0.416', 'WEAPON3': '1.800', 'HITCOUNT': '2.530', 'weapon3': '3.072', 'DAMAGECOUNT': '10.878', 'FRAGCOUNT': '39.000'} [2023-02-24 20:56:55,790][213382] DAMAGECOUNT value on done: 272537.0 [2023-02-24 20:56:55,790][213382] Sum rewards: 49.841, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.152', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'weapon4': '0.104', 'weapon2': '0.224', 'AMMO3': '0.235', 'WEAPON3': '1.450', 'HITCOUNT': '2.870', 'weapon3': '3.506', 'DAMAGECOUNT': '13.002', 'FRAGCOUNT': '44.000'} [2023-02-24 20:56:55,819][213384] DAMAGECOUNT value on done: 271333.0 [2023-02-24 20:56:55,819][213384] Sum rewards: 39.641, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.628', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.108', 'WEAPON5': '0.250', 'AMMO3': '0.272', 'weapon2': '0.314', 'WEAPON4': '0.400', 'weapon4': '0.636', 'WEAPON3': '1.550', 'weapon3': '2.608', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '11.856', 'FRAGCOUNT': '39.000'} [2023-02-24 20:56:55,862][213369] DAMAGECOUNT value on done: 258226.0 [2023-02-24 20:56:55,863][213369] Sum rewards: 36.228, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.140', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon7': '0.056', 'AMMO3': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO4': '0.203', 'weapon5': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.454', 'WEAPON3': '0.650', 'weapon2': '0.944', 'weapon3': '1.810', 'HITCOUNT': '2.020', 'DAMAGECOUNT': '10.071', 'FRAGCOUNT': '31.000'} [2023-02-24 20:56:56,117][213384] DAMAGECOUNT value on done: 271442.0 [2023-02-24 20:56:56,117][213384] Sum rewards: 29.329, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.980', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon7': '0.036', 'AMMO4': '0.103', 'weapon5': '0.130', 'AMMO3': '0.179', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.868', 'WEAPON3': '1.050', 'HITCOUNT': '1.950', 'weapon3': '2.324', 'DAMAGECOUNT': '8.226', 'FRAGCOUNT': '28.000'} [2023-02-24 20:56:56,787][213365] Updated weights for policy 0, policy_version 30786 (0.0009) [2023-02-24 20:56:59,871][213365] Updated weights for policy 0, policy_version 30796 (0.0009) [2023-02-24 20:57:00,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13454.3). Total num frames: 126144512. Throughput: 0: 3374.6. Samples: 6531972. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:57:00,243][213332] Avg episode reward: [(0, '39.458')] [2023-02-24 20:57:02,872][213365] Updated weights for policy 0, policy_version 30806 (0.0009) [2023-02-24 20:57:05,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 126210048. Throughput: 0: 3375.6. Samples: 6542246. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:57:05,243][213332] Avg episode reward: [(0, '39.458')] [2023-02-24 20:57:05,943][213365] Updated weights for policy 0, policy_version 30816 (0.0009) [2023-02-24 20:57:09,010][213365] Updated weights for policy 0, policy_version 30826 (0.0009) [2023-02-24 20:57:10,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13454.3). Total num frames: 126279680. Throughput: 0: 3373.2. Samples: 6562330. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:57:10,243][213332] Avg episode reward: [(0, '39.458')] [2023-02-24 20:57:12,028][213365] Updated weights for policy 0, policy_version 30836 (0.0009) [2023-02-24 20:57:13,012][213367] DAMAGECOUNT value on done: 270593.0 [2023-02-24 20:57:13,013][213367] Sum rewards: 45.259, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.265', 'AMMO5': '0.023', 'AMMO2': '0.042', 'weapon5': '0.146', 'AMMO4': '0.212', 'weapon2': '0.228', 'AMMO3': '0.233', 'weapon4': '0.392', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'HITCOUNT': '2.650', 'weapon3': '2.846', 'DAMAGECOUNT': '11.451', 'FRAGCOUNT': '45.000'} [2023-02-24 20:57:13,318][213367] DAMAGECOUNT value on done: 271133.0 [2023-02-24 20:57:13,318][213367] Sum rewards: 33.754, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.556', 'ARMOR': '0.008', 'AMMO2': '0.014', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.072', 'weapon5': '0.158', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.312', 'weapon4': '0.714', 'WEAPON3': '1.200', 'HITCOUNT': '2.180', 'weapon3': '2.270', 'DAMAGECOUNT': '10.101', 'FRAGCOUNT': '32.000'} [2023-02-24 20:57:13,641][213367] DAMAGECOUNT value on done: 276551.0 [2023-02-24 20:57:13,641][213367] Sum rewards: 37.044, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.726', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.027', 'weapon7': '0.072', 'weapon5': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.133', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.264', 'WEAPON4': '0.350', 'weapon4': '0.526', 'WEAPON3': '1.100', 'HITCOUNT': '2.460', 'weapon3': '2.776', 'DAMAGECOUNT': '11.364', 'FRAGCOUNT': '33.500'} [2023-02-24 20:57:13,651][213372] DAMAGECOUNT value on done: 274239.0 [2023-02-24 20:57:13,652][213372] Sum rewards: 31.017, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.153', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon7': '0.006', 'AMMO2': '0.027', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.133', 'weapon2': '0.188', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'weapon4': '0.686', 'WEAPON3': '1.350', 'HITCOUNT': '2.410', 'weapon3': '2.824', 'DAMAGECOUNT': '10.152', 'FRAGCOUNT': '30.000'} [2023-02-24 20:57:13,961][213367] DAMAGECOUNT value on done: 271646.0 [2023-02-24 20:57:13,961][213367] Sum rewards: 42.603, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.122', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.028', 'weapon2': '0.246', 'AMMO3': '0.289', 'WEAPON3': '1.700', 'HITCOUNT': '2.920', 'weapon3': '3.502', 'DAMAGECOUNT': '13.524', 'FRAGCOUNT': '39.000'} [2023-02-24 20:57:13,968][213372] DAMAGECOUNT value on done: 268128.0 [2023-02-24 20:57:13,969][213372] Sum rewards: 48.365, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.340', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.330', 'weapon2': '0.678', 'WEAPON3': '1.300', 'weapon3': '2.612', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '12.858', 'FRAGCOUNT': '42.000'} [2023-02-24 20:57:13,980][213372] DAMAGECOUNT value on done: 276349.0 [2023-02-24 20:57:13,980][213372] Sum rewards: 48.044, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.121', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.026', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.179', 'weapon4': '0.238', 'weapon2': '0.392', 'WEAPON3': '1.100', 'HITCOUNT': '2.810', 'weapon3': '2.944', 'DAMAGECOUNT': '11.820', 'FRAGCOUNT': '40.000'} [2023-02-24 20:57:14,092][213366] DAMAGECOUNT value on done: 266890.0 [2023-02-24 20:57:14,092][213366] Sum rewards: 28.825, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.172', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon5': '0.148', 'AMMO3': '0.198', 'AMMO4': '0.235', 'WEAPON5': '0.350', 'weapon2': '0.384', 'WEAPON4': '0.500', 'weapon4': '0.846', 'WEAPON3': '1.150', 'weapon3': '2.302', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '9.906', 'FRAGCOUNT': '29.000'} [2023-02-24 20:57:14,293][213372] DAMAGECOUNT value on done: 267168.0 [2023-02-24 20:57:14,294][213372] Sum rewards: 52.989, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.870', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.192', 'weapon2': '0.294', 'WEAPON3': '1.350', 'HITCOUNT': '2.870', 'weapon3': '3.488', 'DAMAGECOUNT': '12.459', 'FRAGCOUNT': '47.000'} [2023-02-24 20:57:14,301][213383] DAMAGECOUNT value on done: 270683.0 [2023-02-24 20:57:14,302][213383] Sum rewards: 45.066, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.834', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.167', 'AMMO3': '0.171', 'weapon5': '0.174', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.462', 'weapon2': '0.618', 'WEAPON3': '1.100', 'weapon3': '2.528', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '11.910', 'FRAGCOUNT': '40.000'} [2023-02-24 20:57:14,390][213366] DAMAGECOUNT value on done: 276262.0 [2023-02-24 20:57:14,390][213366] Sum rewards: 37.501, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.152', 'AMMO5': '0.007', 'AMMO2': '0.055', 'weapon5': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'AMMO4': '0.276', 'weapon2': '0.302', 'WEAPON4': '0.600', 'weapon4': '0.890', 'WEAPON3': '1.200', 'weapon3': '2.392', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.498', 'FRAGCOUNT': '38.000'} [2023-02-24 20:57:14,412][213366] DAMAGECOUNT value on done: 278607.0 [2023-02-24 20:57:14,412][213366] Sum rewards: 25.481, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.710', 'AMMO5': '0.019', 'AMMO2': '0.041', 'AMMO3': '0.202', 'AMMO4': '0.204', 'weapon5': '0.234', 'weapon2': '0.438', 'WEAPON5': '0.450', 'weapon4': '0.498', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.070', 'weapon3': '2.408', 'DAMAGECOUNT': '8.427', 'FRAGCOUNT': '27.000'} [2023-02-24 20:57:14,621][213383] DAMAGECOUNT value on done: 265411.0 [2023-02-24 20:57:14,622][213383] Sum rewards: 44.629, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.577', 'AMMO5': '0.012', 'AMMO2': '0.045', 'AMMO3': '0.162', 'weapon5': '0.178', 'AMMO4': '0.224', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.480', 'weapon4': '0.702', 'WEAPON3': '1.000', 'weapon3': '2.334', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.699', 'FRAGCOUNT': '39.000'} [2023-02-24 20:57:14,686][213368] DAMAGECOUNT value on done: 266692.0 [2023-02-24 20:57:14,686][213368] Sum rewards: 37.175, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.102', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.092', 'AMMO4': '0.121', 'weapon2': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'AMMO3': '0.253', 'weapon4': '0.492', 'WEAPON3': '1.450', 'HITCOUNT': '2.510', 'weapon3': '2.874', 'DAMAGECOUNT': '11.238', 'FRAGCOUNT': '36.000'} [2023-02-24 20:57:14,706][213366] DAMAGECOUNT value on done: 271969.0 [2023-02-24 20:57:14,707][213366] Sum rewards: 41.373, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.250', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.050', 'AMMO4': '0.072', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'weapon2': '0.254', 'WEAPON4': '0.350', 'weapon4': '0.846', 'WEAPON3': '1.350', 'weapon3': '2.466', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.158', 'FRAGCOUNT': '39.000'} [2023-02-24 20:57:14,885][213382] DAMAGECOUNT value on done: 270713.0 [2023-02-24 20:57:14,885][213382] Sum rewards: 46.672, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.790', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.032', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon2': '0.294', 'weapon4': '0.616', 'WEAPON3': '1.350', 'weapon3': '2.816', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '12.795', 'FRAGCOUNT': '42.000'} [2023-02-24 20:57:14,986][213369] DAMAGECOUNT value on done: 273515.0 [2023-02-24 20:57:14,987][213369] Sum rewards: 28.590, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.489', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon7': '0.050', 'weapon5': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'AMMO4': '0.205', 'AMMO3': '0.219', 'weapon2': '0.314', 'WEAPON4': '0.550', 'weapon4': '0.824', 'WEAPON3': '1.300', 'HITCOUNT': '2.220', 'weapon3': '2.316', 'DAMAGECOUNT': '10.557', 'FRAGCOUNT': '30.000'} [2023-02-24 20:57:14,990][213368] DAMAGECOUNT value on done: 269885.0 [2023-02-24 20:57:14,991][213368] Sum rewards: 41.638, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.953', 'AMMO5': '0.031', 'AMMO2': '0.054', 'weapon2': '0.214', 'AMMO3': '0.236', 'weapon5': '0.264', 'AMMO4': '0.270', 'weapon4': '0.512', 'WEAPON4': '0.600', 'WEAPON5': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.508', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '13.101', 'FRAGCOUNT': '40.000'} [2023-02-24 20:57:15,141][213365] Updated weights for policy 0, policy_version 30846 (0.0010) [2023-02-24 20:57:15,183][213382] DAMAGECOUNT value on done: 270555.0 [2023-02-24 20:57:15,184][213382] Sum rewards: 36.496, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.550', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.066', 'WEAPON5': '0.200', 'weapon4': '0.200', 'AMMO4': '0.201', 'AMMO3': '0.234', 'WEAPON4': '0.400', 'weapon2': '0.410', 'WEAPON3': '1.350', 'HITCOUNT': '2.750', 'weapon3': '3.028', 'DAMAGECOUNT': '10.908', 'FRAGCOUNT': '35.000'} [2023-02-24 20:57:15,202][213383] DAMAGECOUNT value on done: 268846.0 [2023-02-24 20:57:15,203][213383] Sum rewards: 21.512, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.647', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.074', 'AMMO4': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.466', 'ARMOR': '0.489', 'WEAPON4': '0.550', 'weapon4': '0.992', 'WEAPON3': '1.300', 'HITCOUNT': '2.010', 'weapon3': '2.050', 'DAMAGECOUNT': '7.827', 'FRAGCOUNT': '24.000'} [2023-02-24 20:57:15,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13454.3). Total num frames: 126345216. Throughput: 0: 3369.2. Samples: 6582316. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:57:15,243][213332] Avg episode reward: [(0, '38.891')] [2023-02-24 20:57:15,247][213368] DAMAGECOUNT value on done: 272430.0 [2023-02-24 20:57:15,247][213368] Sum rewards: 38.396, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.766', 'ARMOR': '0.004', 'AMMO5': '0.015', 'weapon7': '0.050', 'AMMO2': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.122', 'AMMO3': '0.133', 'AMMO4': '0.271', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'weapon4': '1.010', 'weapon3': '2.076', 'HITCOUNT': '2.300', 'DAMAGECOUNT': '10.116', 'FRAGCOUNT': '33.500'} [2023-02-24 20:57:15,294][213369] DAMAGECOUNT value on done: 271996.0 [2023-02-24 20:57:15,295][213369] Sum rewards: 41.009, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.644', 'ARMOR': '0.004', 'AMMO5': '0.007', 'weapon5': '0.026', 'AMMO2': '0.030', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'weapon2': '0.460', 'weapon4': '0.680', 'WEAPON3': '1.150', 'weapon3': '2.582', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '11.385', 'FRAGCOUNT': '37.000'} [2023-02-24 20:57:15,318][213384] DAMAGECOUNT value on done: 276357.0 [2023-02-24 20:57:15,318][213384] Sum rewards: 45.244, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.164', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'AMMO4': '0.049', 'weapon5': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.120', 'AMMO3': '0.246', 'WEAPON3': '1.450', 'HITCOUNT': '2.980', 'weapon3': '3.628', 'DAMAGECOUNT': '12.393', 'FRAGCOUNT': '41.000'} [2023-02-24 20:57:15,481][213382] DAMAGECOUNT value on done: 264736.0 [2023-02-24 20:57:15,482][213382] Sum rewards: 36.431, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.780', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon5': '0.174', 'AMMO3': '0.179', 'weapon4': '0.206', 'AMMO4': '0.215', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.622', 'WEAPON3': '1.100', 'HITCOUNT': '2.460', 'weapon3': '2.722', 'DAMAGECOUNT': '9.972', 'FRAGCOUNT': '34.000'} [2023-02-24 20:57:15,514][213383] DAMAGECOUNT value on done: 264311.0 [2023-02-24 20:57:15,514][213383] Sum rewards: 44.457, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.462', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.140', 'weapon5': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.590', 'weapon4': '0.748', 'WEAPON3': '0.850', 'weapon3': '2.224', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '11.508', 'FRAGCOUNT': '37.000'} [2023-02-24 20:57:15,554][213368] DAMAGECOUNT value on done: 262981.0 [2023-02-24 20:57:15,555][213368] Sum rewards: 39.162, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.988', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.203', 'weapon5': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.262', 'weapon2': '0.272', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.260', 'weapon3': '2.894', 'DAMAGECOUNT': '10.803', 'FRAGCOUNT': '35.000'} [2023-02-24 20:57:15,609][213369] DAMAGECOUNT value on done: 276366.0 [2023-02-24 20:57:15,610][213369] Sum rewards: 43.764, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.349', 'AMMO2': '0.015', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'weapon2': '0.192', 'AMMO3': '0.228', 'weapon4': '0.252', 'WEAPON3': '1.400', 'HITCOUNT': '2.910', 'weapon3': '3.404', 'DAMAGECOUNT': '12.735', 'FRAGCOUNT': '39.000'} [2023-02-24 20:57:15,625][213384] DAMAGECOUNT value on done: 261023.0 [2023-02-24 20:57:15,626][213384] Sum rewards: 34.257, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.387', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.038', 'AMMO4': '0.189', 'weapon5': '0.196', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.540', 'weapon4': '0.784', 'WEAPON3': '1.250', 'weapon3': '2.170', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '10.257', 'FRAGCOUNT': '32.000'} [2023-02-24 20:57:15,790][213382] DAMAGECOUNT value on done: 277092.0 [2023-02-24 20:57:15,790][213382] Sum rewards: 52.116, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.872', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.124', 'AMMO3': '0.176', 'AMMO4': '0.194', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON4': '0.450', 'weapon4': '0.636', 'WEAPON3': '1.000', 'weapon3': '2.712', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.665', 'FRAGCOUNT': '45.000'} [2023-02-24 20:57:15,846][213384] DAMAGECOUNT value on done: 275239.0 [2023-02-24 20:57:15,846][213384] Sum rewards: 43.943, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.293', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon7': '0.080', 'AMMO4': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.388', 'weapon4': '0.732', 'WEAPON3': '0.950', 'weapon3': '2.354', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '11.718', 'FRAGCOUNT': '36.000'} [2023-02-24 20:57:15,899][213369] DAMAGECOUNT value on done: 262715.0 [2023-02-24 20:57:15,899][213369] Sum rewards: 44.505, reward structure: {'DEATHCOUNT': '-17.250', 'AMMO2': '0.010', 'HEALTH': '0.010', 'AMMO5': '0.014', 'weapon4': '0.028', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'weapon5': '0.110', 'weapon2': '0.176', 'AMMO3': '0.256', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '2.950', 'weapon3': '3.336', 'DAMAGECOUNT': '13.467', 'FRAGCOUNT': '39.500'} [2023-02-24 20:57:16,142][213384] DAMAGECOUNT value on done: 274878.0 [2023-02-24 20:57:16,142][213384] Sum rewards: 32.732, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.930', 'AMMO5': '0.027', 'AMMO2': '0.045', 'AMMO3': '0.140', 'AMMO4': '0.225', 'weapon5': '0.272', 'weapon4': '0.402', 'WEAPON4': '0.550', 'WEAPON5': '0.700', 'WEAPON3': '0.800', 'weapon2': '0.962', 'weapon3': '1.950', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '10.308', 'FRAGCOUNT': '30.000'} [2023-02-24 20:57:18,161][213365] Updated weights for policy 0, policy_version 30856 (0.0009) [2023-02-24 20:57:20,243][213332] Fps is (10 sec: 13107.2, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 126410752. Throughput: 0: 3369.1. Samples: 6592526. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:57:20,243][213332] Avg episode reward: [(0, '38.751')] [2023-02-24 20:57:21,181][213365] Updated weights for policy 0, policy_version 30866 (0.0009) [2023-02-24 20:57:24,273][213365] Updated weights for policy 0, policy_version 30876 (0.0010) [2023-02-24 20:57:25,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13454.3). Total num frames: 126480384. Throughput: 0: 3364.3. Samples: 6612600. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:57:25,243][213332] Avg episode reward: [(0, '38.751')] [2023-02-24 20:57:27,289][213365] Updated weights for policy 0, policy_version 30886 (0.0009) [2023-02-24 20:57:30,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13440.4). Total num frames: 126545920. Throughput: 0: 3356.3. Samples: 6632552. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:57:30,243][213332] Avg episode reward: [(0, '38.751')] [2023-02-24 20:57:30,363][213365] Updated weights for policy 0, policy_version 30896 (0.0009) [2023-02-24 20:57:33,022][213367] DAMAGECOUNT value on done: 274797.0 [2023-02-24 20:57:33,023][213367] Sum rewards: 48.456, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.234', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.162', 'weapon5': '0.204', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.284', 'weapon4': '0.466', 'WEAPON3': '0.900', 'HITCOUNT': '2.640', 'weapon3': '2.768', 'DAMAGECOUNT': '12.612', 'FRAGCOUNT': '40.000'} [2023-02-24 20:57:33,344][213367] DAMAGECOUNT value on done: 274604.0 [2023-02-24 20:57:33,345][213367] Sum rewards: 34.893, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.004', 'AMMO5': '0.003', 'weapon5': '0.042', 'AMMO2': '0.047', 'WEAPON5': '0.100', 'AMMO3': '0.165', 'AMMO4': '0.233', 'weapon2': '0.408', 'WEAPON4': '0.500', 'weapon4': '0.780', 'WEAPON3': '1.050', 'weapon3': '2.436', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '10.413', 'FRAGCOUNT': '32.000'} [2023-02-24 20:57:33,414][213365] Updated weights for policy 0, policy_version 30906 (0.0009) [2023-02-24 20:57:33,662][213367] DAMAGECOUNT value on done: 280353.0 [2023-02-24 20:57:33,662][213367] Sum rewards: 35.703, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.476', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.170', 'weapon5': '0.184', 'weapon4': '0.204', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.986', 'WEAPON3': '1.100', 'weapon3': '2.284', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '11.406', 'FRAGCOUNT': '32.000'} [2023-02-24 20:57:33,813][213372] DAMAGECOUNT value on done: 278232.0 [2023-02-24 20:57:33,813][213372] Sum rewards: 40.335, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.798', 'AMMO5': '0.022', 'AMMO2': '0.029', 'weapon4': '0.092', 'AMMO4': '0.145', 'AMMO3': '0.179', 'weapon5': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.500', 'weapon2': '0.684', 'WEAPON3': '1.000', 'HITCOUNT': '2.260', 'weapon3': '2.688', 'DAMAGECOUNT': '11.472', 'FRAGCOUNT': '36.000'} [2023-02-24 20:57:33,981][213367] DAMAGECOUNT value on done: 276171.0 [2023-02-24 20:57:33,981][213367] Sum rewards: 47.451, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.570', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.031', 'weapon4': '0.032', 'weapon5': '0.096', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'WEAPON5': '0.400', 'weapon2': '0.442', 'WEAPON3': '1.450', 'HITCOUNT': '2.750', 'weapon3': '3.140', 'DAMAGECOUNT': '13.575', 'FRAGCOUNT': '42.000'} [2023-02-24 20:57:34,133][213372] DAMAGECOUNT value on done: 271798.0 [2023-02-24 20:57:34,134][213372] Sum rewards: 38.886, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.111', 'AMMO5': '0.014', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.198', 'weapon5': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.302', 'WEAPON5': '0.350', 'weapon4': '0.482', 'WEAPON3': '1.250', 'HITCOUNT': '2.620', 'weapon3': '2.664', 'DAMAGECOUNT': '11.010', 'FRAGCOUNT': '35.000'} [2023-02-24 20:57:34,143][213372] DAMAGECOUNT value on done: 281030.0 [2023-02-24 20:57:34,144][213372] Sum rewards: 59.561, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.125', 'AMMO5': '0.003', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.092', 'WEAPON4': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.177', 'weapon2': '0.306', 'weapon4': '0.482', 'WEAPON3': '1.100', 'weapon3': '2.942', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.043', 'FRAGCOUNT': '50.000'} [2023-02-24 20:57:34,182][213366] DAMAGECOUNT value on done: 271345.0 [2023-02-24 20:57:34,182][213366] Sum rewards: 48.942, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.221', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.084', 'AMMO4': '0.088', 'weapon4': '0.102', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'weapon2': '0.650', 'WEAPON3': '1.150', 'HITCOUNT': '2.750', 'weapon3': '2.962', 'DAMAGECOUNT': '13.365', 'FRAGCOUNT': '42.000'} [2023-02-24 20:57:34,441][213383] DAMAGECOUNT value on done: 273726.0 [2023-02-24 20:57:34,441][213383] Sum rewards: 36.094, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.420', 'AMMO5': '0.013', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon4': '0.184', 'weapon5': '0.188', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.250', 'weapon3': '2.950', 'DAMAGECOUNT': '9.129', 'FRAGCOUNT': '34.000'} [2023-02-24 20:57:34,454][213372] DAMAGECOUNT value on done: 271110.0 [2023-02-24 20:57:34,454][213372] Sum rewards: 43.169, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.652', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.155', 'AMMO3': '0.175', 'weapon5': '0.182', 'weapon2': '0.212', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.866', 'WEAPON3': '1.050', 'weapon3': '2.518', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '11.826', 'FRAGCOUNT': '38.000'} [2023-02-24 20:57:34,475][213366] DAMAGECOUNT value on done: 280782.0 [2023-02-24 20:57:34,475][213366] Sum rewards: 53.804, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.620', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon5': '0.130', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.160', 'weapon2': '0.280', 'WEAPON3': '1.100', 'HITCOUNT': '2.960', 'weapon3': '3.224', 'DAMAGECOUNT': '13.560', 'FRAGCOUNT': '45.000'} [2023-02-24 20:57:34,496][213366] DAMAGECOUNT value on done: 282462.0 [2023-02-24 20:57:34,496][213366] Sum rewards: 47.627, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.338', 'AMMO5': '0.013', 'AMMO2': '0.038', 'AMMO3': '0.124', 'AMMO4': '0.192', 'weapon5': '0.288', 'weapon2': '0.320', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '0.700', 'weapon4': '1.222', 'weapon3': '1.842', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '11.565', 'FRAGCOUNT': '39.000'} [2023-02-24 20:57:34,730][213368] DAMAGECOUNT value on done: 270800.0 [2023-02-24 20:57:34,730][213368] Sum rewards: 41.947, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.070', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.064', 'AMMO4': '0.168', 'AMMO3': '0.202', 'weapon4': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.250', 'weapon3': '2.920', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.324', 'FRAGCOUNT': '37.000'} [2023-02-24 20:57:34,756][213383] DAMAGECOUNT value on done: 269931.0 [2023-02-24 20:57:34,756][213383] Sum rewards: 49.301, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.040', 'AMMO5': '0.016', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.171', 'weapon5': '0.236', 'weapon2': '0.302', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'weapon4': '1.034', 'weapon3': '1.912', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.560', 'FRAGCOUNT': '41.000'} [2023-02-24 20:57:34,802][213366] DAMAGECOUNT value on done: 275958.0 [2023-02-24 20:57:34,802][213366] Sum rewards: 41.933, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.441', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.072', 'AMMO3': '0.138', 'weapon5': '0.272', 'AMMO4': '0.359', 'WEAPON5': '0.550', 'weapon4': '0.576', 'WEAPON4': '0.700', 'weapon2': '0.804', 'WEAPON3': '0.850', 'weapon3': '2.018', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '11.967', 'FRAGCOUNT': '38.000'} [2023-02-24 20:57:34,914][213382] DAMAGECOUNT value on done: 273906.0 [2023-02-24 20:57:34,915][213382] Sum rewards: 33.902, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.798', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'weapon5': '0.080', 'weapon2': '0.124', 'weapon4': '0.184', 'AMMO3': '0.269', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '2.260', 'weapon3': '3.254', 'DAMAGECOUNT': '9.579', 'FRAGCOUNT': '33.000'} [2023-02-24 20:57:35,036][213368] DAMAGECOUNT value on done: 274164.0 [2023-02-24 20:57:35,037][213368] Sum rewards: 44.977, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.519', 'AMMO5': '0.017', 'AMMO2': '0.028', 'weapon5': '0.080', 'AMMO4': '0.141', 'weapon2': '0.244', 'AMMO3': '0.246', 'weapon4': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.890', 'weapon3': '3.088', 'DAMAGECOUNT': '12.837', 'FRAGCOUNT': '42.000'} [2023-02-24 20:57:35,104][213369] DAMAGECOUNT value on done: 277438.0 [2023-02-24 20:57:35,104][213369] Sum rewards: 51.376, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.808', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon5': '0.020', 'AMMO4': '0.046', 'weapon4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'weapon2': '0.848', 'WEAPON3': '1.050', 'weapon3': '2.800', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '11.769', 'FRAGCOUNT': '45.000'} [2023-02-24 20:57:35,211][213382] DAMAGECOUNT value on done: 274439.0 [2023-02-24 20:57:35,212][213382] Sum rewards: 40.925, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.856', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.150', 'weapon4': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'WEAPON3': '1.350', 'HITCOUNT': '2.610', 'weapon3': '3.346', 'DAMAGECOUNT': '11.652', 'FRAGCOUNT': '37.000'} [2023-02-24 20:57:35,243][213332] Fps is (10 sec: 13106.9, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 126611456. Throughput: 0: 3355.5. Samples: 6642678. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 20:57:35,244][213332] Avg episode reward: [(0, '39.785')] [2023-02-24 20:57:35,295][213368] DAMAGECOUNT value on done: 276358.0 [2023-02-24 20:57:35,296][213368] Sum rewards: 42.875, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.914', 'ARMOR': '0.008', 'AMMO5': '0.008', 'AMMO2': '0.036', 'AMMO3': '0.127', 'weapon5': '0.152', 'AMMO4': '0.179', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.538', 'WEAPON3': '0.750', 'weapon2': '0.884', 'weapon3': '2.072', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '11.784', 'FRAGCOUNT': '36.000'} [2023-02-24 20:57:35,337][213383] DAMAGECOUNT value on done: 272458.0 [2023-02-24 20:57:35,338][213383] Sum rewards: 38.933, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.707', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.190', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.370', 'weapon4': '0.882', 'WEAPON3': '1.150', 'weapon3': '2.418', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '10.836', 'FRAGCOUNT': '35.000'} [2023-02-24 20:57:35,406][213369] DAMAGECOUNT value on done: 275741.0 [2023-02-24 20:57:35,407][213369] Sum rewards: 38.150, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.335', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon4': '0.084', 'weapon5': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.592', 'WEAPON3': '1.350', 'HITCOUNT': '2.390', 'weapon3': '3.006', 'DAMAGECOUNT': '11.235', 'FRAGCOUNT': '37.000'} [2023-02-24 20:57:35,477][213384] DAMAGECOUNT value on done: 279385.0 [2023-02-24 20:57:35,478][213384] Sum rewards: 31.162, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.780', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.056', 'AMMO4': '0.060', 'weapon7': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon2': '0.384', 'weapon4': '0.716', 'WEAPON3': '0.850', 'HITCOUNT': '1.970', 'weapon3': '2.102', 'DAMAGECOUNT': '9.084', 'FRAGCOUNT': '25.000'} [2023-02-24 20:57:35,494][213382] DAMAGECOUNT value on done: 269036.0 [2023-02-24 20:57:35,495][213382] Sum rewards: 49.200, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.280', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon5': '0.072', 'weapon7': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'weapon4': '0.246', 'weapon2': '0.310', 'WEAPON3': '1.100', 'HITCOUNT': '2.830', 'weapon3': '3.110', 'DAMAGECOUNT': '12.900', 'FRAGCOUNT': '41.000'} [2023-02-24 20:57:35,590][213368] DAMAGECOUNT value on done: 266298.0 [2023-02-24 20:57:35,591][213368] Sum rewards: 32.834, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.450', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.127', 'AMMO3': '0.152', 'weapon5': '0.274', 'weapon2': '0.324', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.660', 'WEAPON3': '0.900', 'HITCOUNT': '2.180', 'weapon3': '2.428', 'DAMAGECOUNT': '9.951', 'FRAGCOUNT': '30.000'} [2023-02-24 20:57:35,637][213383] DAMAGECOUNT value on done: 267459.0 [2023-02-24 20:57:35,638][213383] Sum rewards: 28.655, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.166', 'AMMO5': '0.016', 'AMMO2': '0.060', 'AMMO3': '0.147', 'weapon5': '0.262', 'AMMO4': '0.298', 'ARMOR': '0.448', 'WEAPON5': '0.450', 'weapon2': '0.550', 'WEAPON4': '0.750', 'WEAPON3': '0.800', 'weapon4': '0.930', 'weapon3': '1.706', 'HITCOUNT': '1.960', 'DAMAGECOUNT': '9.444', 'FRAGCOUNT': '28.000'} [2023-02-24 20:57:35,708][213369] DAMAGECOUNT value on done: 279431.0 [2023-02-24 20:57:35,708][213369] Sum rewards: 33.214, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.146', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.028', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon2': '1.078', 'WEAPON3': '1.300', 'HITCOUNT': '2.280', 'weapon3': '2.656', 'DAMAGECOUNT': '9.195', 'FRAGCOUNT': '31.000'} [2023-02-24 20:57:35,779][213384] DAMAGECOUNT value on done: 265777.0 [2023-02-24 20:57:35,779][213384] Sum rewards: 56.523, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.190', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.007', 'weapon4': '0.018', 'WEAPON4': '0.050', 'weapon5': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon2': '0.528', 'WEAPON3': '1.350', 'weapon3': '3.184', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '14.262', 'FRAGCOUNT': '49.000'} [2023-02-24 20:57:35,797][213382] DAMAGECOUNT value on done: 280014.0 [2023-02-24 20:57:35,798][213382] Sum rewards: 30.803, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.390', 'AMMO5': '0.016', 'AMMO2': '0.052', 'AMMO3': '0.151', 'weapon5': '0.158', 'AMMO4': '0.260', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.574', 'weapon4': '0.658', 'WEAPON3': '0.850', 'HITCOUNT': '1.880', 'weapon3': '2.228', 'DAMAGECOUNT': '8.766', 'FRAGCOUNT': '29.000'} [2023-02-24 20:57:35,996][213384] DAMAGECOUNT value on done: 278814.0 [2023-02-24 20:57:35,997][213384] Sum rewards: 22.878, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.122', 'ARMOR': '0.004', 'AMMO5': '0.019', 'weapon7': '0.056', 'AMMO2': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.143', 'AMMO4': '0.332', 'weapon5': '0.358', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon2': '0.604', 'WEAPON3': '0.850', 'weapon4': '0.984', 'weapon3': '1.638', 'HITCOUNT': '2.020', 'DAMAGECOUNT': '10.725', 'FRAGCOUNT': '20.000'} [2023-02-24 20:57:36,009][213369] DAMAGECOUNT value on done: 266329.0 [2023-02-24 20:57:36,009][213369] Sum rewards: 33.837, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.791', 'AMMO2': '0.017', 'AMMO5': '0.020', 'AMMO4': '0.084', 'AMMO3': '0.169', 'WEAPON4': '0.300', 'weapon4': '0.320', 'weapon5': '0.408', 'weapon2': '0.452', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'HITCOUNT': '1.990', 'weapon3': '2.476', 'DAMAGECOUNT': '10.842', 'FRAGCOUNT': '30.500'} [2023-02-24 20:57:36,294][213384] DAMAGECOUNT value on done: 279141.0 [2023-02-24 20:57:36,294][213384] Sum rewards: 38.658, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.230', 'AMMO5': '0.022', 'AMMO2': '0.057', 'AMMO3': '0.223', 'weapon5': '0.260', 'AMMO4': '0.284', 'weapon2': '0.330', 'weapon4': '0.354', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '2.540', 'weapon3': '2.680', 'DAMAGECOUNT': '12.789', 'FRAGCOUNT': '37.000'} [2023-02-24 20:57:36,478][213365] Updated weights for policy 0, policy_version 30916 (0.0009) [2023-02-24 20:57:39,534][213365] Updated weights for policy 0, policy_version 30926 (0.0009) [2023-02-24 20:57:40,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 126681088. Throughput: 0: 3353.6. Samples: 6662782. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:57:40,243][213332] Avg episode reward: [(0, '39.646')] [2023-02-24 20:57:42,544][213365] Updated weights for policy 0, policy_version 30936 (0.0009) [2023-02-24 20:57:45,243][213332] Fps is (10 sec: 13517.0, 60 sec: 13380.3, 300 sec: 13440.4). Total num frames: 126746624. Throughput: 0: 3354.6. Samples: 6682930. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:57:45,243][213332] Avg episode reward: [(0, '39.646')] [2023-02-24 20:57:45,605][213365] Updated weights for policy 0, policy_version 30946 (0.0009) [2023-02-24 20:57:48,679][213365] Updated weights for policy 0, policy_version 30956 (0.0009) [2023-02-24 20:57:50,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 126816256. Throughput: 0: 3353.9. Samples: 6693172. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:57:50,243][213332] Avg episode reward: [(0, '39.646')] [2023-02-24 20:57:51,681][213365] Updated weights for policy 0, policy_version 30966 (0.0009) [2023-02-24 20:57:53,043][213367] DAMAGECOUNT value on done: 278358.0 [2023-02-24 20:57:53,044][213367] Sum rewards: 38.353, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.816', 'AMMO5': '0.019', 'AMMO2': '0.040', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon4': '0.182', 'AMMO4': '0.201', 'AMMO3': '0.210', 'weapon5': '0.276', 'weapon2': '0.374', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.270', 'weapon3': '2.814', 'DAMAGECOUNT': '10.683', 'FRAGCOUNT': '38.000'} [2023-02-24 20:57:53,356][213367] DAMAGECOUNT value on done: 277972.0 [2023-02-24 20:57:53,356][213367] Sum rewards: 35.229, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.951', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.058', 'WEAPON5': '0.100', 'weapon5': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'weapon4': '0.306', 'weapon2': '0.514', 'WEAPON3': '1.050', 'HITCOUNT': '2.230', 'weapon3': '2.838', 'DAMAGECOUNT': '10.104', 'FRAGCOUNT': '30.000'} [2023-02-24 20:57:53,671][213367] DAMAGECOUNT value on done: 283859.0 [2023-02-24 20:57:53,672][213367] Sum rewards: 33.315, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.420', 'weapon4': '0.010', 'AMMO2': '0.010', 'AMMO5': '0.011', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'weapon5': '0.116', 'AMMO3': '0.243', 'WEAPON5': '0.250', 'weapon2': '0.334', 'WEAPON3': '1.400', 'HITCOUNT': '2.420', 'weapon3': '3.270', 'DAMAGECOUNT': '10.518', 'FRAGCOUNT': '31.000'} [2023-02-24 20:57:53,843][213372] DAMAGECOUNT value on done: 282094.0 [2023-02-24 20:57:53,844][213372] Sum rewards: 32.818, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.550', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon5': '0.042', 'AMMO4': '0.119', 'weapon2': '0.180', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.314', 'AMMO3': '0.315', 'WEAPON3': '1.850', 'HITCOUNT': '2.720', 'weapon3': '3.152', 'DAMAGECOUNT': '11.586', 'FRAGCOUNT': '35.000'} [2023-02-24 20:57:53,993][213367] DAMAGECOUNT value on done: 281055.0 [2023-02-24 20:57:53,994][213367] Sum rewards: 51.847, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.990', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.030', 'AMMO4': '0.049', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.223', 'weapon2': '0.252', 'WEAPON3': '1.400', 'HITCOUNT': '3.000', 'weapon3': '3.464', 'DAMAGECOUNT': '14.652', 'FRAGCOUNT': '44.000'} [2023-02-24 20:57:54,152][213372] DAMAGECOUNT value on done: 275338.0 [2023-02-24 20:57:54,153][213372] Sum rewards: 42.320, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.680', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.056', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.129', 'weapon2': '0.282', 'WEAPON4': '0.350', 'WEAPON3': '0.750', 'weapon4': '0.794', 'weapon3': '2.670', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '10.620', 'FRAGCOUNT': '35.000'} [2023-02-24 20:57:54,161][213372] DAMAGECOUNT value on done: 284434.0 [2023-02-24 20:57:54,162][213372] Sum rewards: 35.468, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.074', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.090', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'WEAPON4': '0.300', 'weapon4': '0.580', 'weapon2': '0.770', 'WEAPON3': '0.950', 'weapon3': '2.128', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '10.212', 'FRAGCOUNT': '33.000'} [2023-02-24 20:57:54,168][213366] DAMAGECOUNT value on done: 274449.0 [2023-02-24 20:57:54,168][213366] Sum rewards: 37.879, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.520', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon7': '0.062', 'weapon5': '0.078', 'AMMO3': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon2': '0.132', 'WEAPON5': '0.150', 'AMMO4': '0.195', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'WEAPON3': '0.650', 'weapon4': '0.934', 'weapon3': '1.846', 'HITCOUNT': '2.300', 'DAMAGECOUNT': '9.312', 'FRAGCOUNT': '31.000'} [2023-02-24 20:57:54,381][213383] DAMAGECOUNT value on done: 277299.0 [2023-02-24 20:57:54,381][213383] Sum rewards: 39.868, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.379', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon7': '0.052', 'weapon5': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.152', 'WEAPON4': '0.250', 'weapon4': '0.472', 'weapon2': '0.594', 'WEAPON3': '0.900', 'HITCOUNT': '2.500', 'weapon3': '2.600', 'DAMAGECOUNT': '10.419', 'FRAGCOUNT': '34.000'} [2023-02-24 20:57:54,467][213366] DAMAGECOUNT value on done: 284455.0 [2023-02-24 20:57:54,467][213366] Sum rewards: 35.460, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.348', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO4': '0.168', 'AMMO3': '0.218', 'weapon5': '0.226', 'weapon4': '0.308', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.370', 'weapon3': '2.852', 'DAMAGECOUNT': '11.019', 'FRAGCOUNT': '34.000'} [2023-02-24 20:57:54,475][213372] DAMAGECOUNT value on done: 274781.0 [2023-02-24 20:57:54,476][213372] Sum rewards: 30.865, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.692', 'AMMO5': '0.020', 'AMMO2': '0.065', 'AMMO3': '0.229', 'weapon2': '0.270', 'weapon5': '0.274', 'AMMO4': '0.324', 'WEAPON5': '0.550', 'WEAPON4': '0.750', 'weapon4': '0.868', 'WEAPON3': '1.250', 'weapon3': '2.214', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '11.013', 'FRAGCOUNT': '32.000'} [2023-02-24 20:57:54,491][213366] DAMAGECOUNT value on done: 286572.0 [2023-02-24 20:57:54,492][213366] Sum rewards: 45.671, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.644', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO3': '0.181', 'AMMO4': '0.181', 'weapon2': '0.186', 'weapon5': '0.260', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.612', 'WEAPON3': '1.100', 'HITCOUNT': '2.550', 'weapon3': '2.666', 'DAMAGECOUNT': '12.330', 'FRAGCOUNT': '40.000'} [2023-02-24 20:57:54,702][213383] DAMAGECOUNT value on done: 273500.0 [2023-02-24 20:57:54,702][213383] Sum rewards: 35.691, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.764', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.065', 'AMMO3': '0.168', 'weapon2': '0.292', 'weapon5': '0.324', 'AMMO4': '0.325', 'WEAPON5': '0.550', 'weapon4': '0.574', 'WEAPON4': '0.600', 'WEAPON3': '0.950', 'HITCOUNT': '2.160', 'weapon3': '2.462', 'DAMAGECOUNT': '10.707', 'FRAGCOUNT': '34.000'} [2023-02-24 20:57:54,739][213368] DAMAGECOUNT value on done: 274708.0 [2023-02-24 20:57:54,740][213368] Sum rewards: 42.620, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.130', 'AMMO5': '0.009', 'weapon5': '0.010', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'weapon4': '0.424', 'weapon2': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.812', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '11.724', 'FRAGCOUNT': '37.000'} [2023-02-24 20:57:54,789][213366] DAMAGECOUNT value on done: 279533.0 [2023-02-24 20:57:54,789][213366] Sum rewards: 36.007, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.309', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.034', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'weapon4': '0.128', 'WEAPON5': '0.200', 'AMMO3': '0.258', 'weapon2': '0.620', 'WEAPON3': '1.450', 'HITCOUNT': '2.490', 'weapon3': '2.936', 'DAMAGECOUNT': '10.725', 'FRAGCOUNT': '35.000'} [2023-02-24 20:57:54,820][213365] Updated weights for policy 0, policy_version 30976 (0.0009) [2023-02-24 20:57:54,923][213382] DAMAGECOUNT value on done: 277229.0 [2023-02-24 20:57:54,924][213382] Sum rewards: 34.228, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.793', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.008', 'AMMO4': '0.038', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.151', 'WEAPON4': '0.300', 'ARMOR': '0.488', 'weapon2': '0.532', 'weapon4': '0.880', 'WEAPON3': '1.000', 'weapon3': '2.072', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '9.969', 'FRAGCOUNT': '30.000'} [2023-02-24 20:57:55,055][213368] DAMAGECOUNT value on done: 277963.0 [2023-02-24 20:57:55,056][213368] Sum rewards: 40.266, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.880', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.182', 'weapon2': '0.190', 'AMMO3': '0.245', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.540', 'WEAPON3': '1.500', 'HITCOUNT': '2.450', 'weapon3': '2.802', 'DAMAGECOUNT': '11.397', 'FRAGCOUNT': '39.000'} [2023-02-24 20:57:55,134][213369] DAMAGECOUNT value on done: 280943.0 [2023-02-24 20:57:55,134][213369] Sum rewards: 42.754, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.464', 'weapon7': '0.016', 'AMMO5': '0.017', 'AMMO2': '0.027', 'AMMO4': '0.137', 'weapon4': '0.160', 'AMMO3': '0.186', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.310', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.320', 'weapon3': '3.010', 'DAMAGECOUNT': '10.515', 'FRAGCOUNT': '37.000'} [2023-02-24 20:57:55,239][213382] DAMAGECOUNT value on done: 278470.0 [2023-02-24 20:57:55,239][213382] Sum rewards: 46.535, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.163', 'weapon5': '0.198', 'WEAPON4': '0.300', 'weapon2': '0.308', 'WEAPON5': '0.350', 'weapon4': '0.542', 'WEAPON3': '0.950', 'weapon3': '2.672', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.093', 'FRAGCOUNT': '41.000'} [2023-02-24 20:57:55,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 126881792. Throughput: 0: 3351.1. Samples: 6713130. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:57:55,243][213332] Avg episode reward: [(0, '39.299')] [2023-02-24 20:57:55,301][213383] DAMAGECOUNT value on done: 276530.0 [2023-02-24 20:57:55,301][213383] Sum rewards: 37.506, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.228', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon5': '0.124', 'AMMO4': '0.175', 'weapon2': '0.178', 'weapon4': '0.230', 'AMMO3': '0.249', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '2.620', 'weapon3': '3.188', 'DAMAGECOUNT': '12.216', 'FRAGCOUNT': '36.000'} [2023-02-24 20:57:55,316][213368] DAMAGECOUNT value on done: 279801.0 [2023-02-24 20:57:55,316][213368] Sum rewards: 35.132, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.029', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon2': '0.180', 'weapon5': '0.204', 'AMMO4': '0.207', 'AMMO3': '0.221', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.448', 'WEAPON3': '1.350', 'HITCOUNT': '2.360', 'weapon3': '2.804', 'DAMAGECOUNT': '10.329', 'FRAGCOUNT': '35.000'} [2023-02-24 20:57:55,438][213369] DAMAGECOUNT value on done: 280023.0 [2023-02-24 20:57:55,439][213369] Sum rewards: 42.145, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.148', 'ARMOR': '0.008', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon2': '0.170', 'AMMO3': '0.222', 'weapon5': '0.250', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.924', 'WEAPON3': '1.250', 'weapon3': '2.070', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.846', 'FRAGCOUNT': '37.000'} [2023-02-24 20:57:55,460][213382] DAMAGECOUNT value on done: 272699.0 [2023-02-24 20:57:55,461][213382] Sum rewards: 40.675, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.150', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.134', 'AMMO3': '0.176', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.450', 'weapon2': '0.524', 'WEAPON3': '1.150', 'HITCOUNT': '2.470', 'weapon3': '2.626', 'DAMAGECOUNT': '10.989', 'FRAGCOUNT': '35.000'} [2023-02-24 20:57:55,532][213384] DAMAGECOUNT value on done: 283260.0 [2023-02-24 20:57:55,533][213384] Sum rewards: 36.216, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.680', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.092', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'weapon2': '0.376', 'weapon4': '0.382', 'WEAPON3': '1.350', 'HITCOUNT': '2.670', 'weapon3': '2.870', 'DAMAGECOUNT': '11.625', 'FRAGCOUNT': '33.500'} [2023-02-24 20:57:55,602][213383] DAMAGECOUNT value on done: 271248.0 [2023-02-24 20:57:55,603][213383] Sum rewards: 34.337, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.030', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.184', 'AMMO4': '0.196', 'AMMO3': '0.197', 'weapon2': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.610', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '11.367', 'FRAGCOUNT': '31.000'} [2023-02-24 20:57:55,620][213368] DAMAGECOUNT value on done: 270168.0 [2023-02-24 20:57:55,620][213368] Sum rewards: 45.494, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.755', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.014', 'AMMO4': '0.064', 'AMMO3': '0.147', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.414', 'weapon2': '0.508', 'WEAPON3': '0.900', 'HITCOUNT': '2.720', 'weapon3': '2.752', 'DAMAGECOUNT': '11.610', 'FRAGCOUNT': '38.000'} [2023-02-24 20:57:55,742][213369] DAMAGECOUNT value on done: 284158.0 [2023-02-24 20:57:55,743][213369] Sum rewards: 51.391, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.042', 'AMMO5': '0.006', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.072', 'weapon4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon2': '0.266', 'WEAPON3': '1.250', 'HITCOUNT': '3.150', 'weapon3': '3.280', 'DAMAGECOUNT': '14.181', 'FRAGCOUNT': '43.000'} [2023-02-24 20:57:55,761][213382] DAMAGECOUNT value on done: 283405.0 [2023-02-24 20:57:55,762][213382] Sum rewards: 35.125, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.840', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.236', 'weapon2': '0.364', 'weapon4': '0.494', 'WEAPON3': '1.500', 'HITCOUNT': '2.270', 'weapon3': '2.808', 'DAMAGECOUNT': '10.173', 'FRAGCOUNT': '34.000'} [2023-02-24 20:57:55,838][213384] DAMAGECOUNT value on done: 268880.0 [2023-02-24 20:57:55,838][213384] Sum rewards: 29.624, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.493', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon7': '0.048', 'AMMO4': '0.091', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.148', 'AMMO3': '0.156', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.420', 'weapon4': '0.742', 'WEAPON3': '1.000', 'HITCOUNT': '2.020', 'weapon3': '2.116', 'DAMAGECOUNT': '9.309', 'FRAGCOUNT': '27.000'} [2023-02-24 20:57:56,022][213384] DAMAGECOUNT value on done: 282251.0 [2023-02-24 20:57:56,023][213384] Sum rewards: 36.933, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.806', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO4': '0.187', 'AMMO3': '0.229', 'WEAPON4': '0.350', 'weapon2': '0.472', 'weapon4': '0.508', 'WEAPON3': '1.300', 'HITCOUNT': '2.260', 'weapon3': '2.612', 'DAMAGECOUNT': '10.311', 'FRAGCOUNT': '36.000'} [2023-02-24 20:57:56,041][213369] DAMAGECOUNT value on done: 269865.0 [2023-02-24 20:57:56,041][213369] Sum rewards: 34.643, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.298', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.246', 'weapon4': '0.284', 'weapon2': '0.298', 'WEAPON3': '1.500', 'HITCOUNT': '2.550', 'weapon3': '3.168', 'DAMAGECOUNT': '10.608', 'FRAGCOUNT': '33.000'} [2023-02-24 20:57:56,323][213384] DAMAGECOUNT value on done: 282436.0 [2023-02-24 20:57:56,323][213384] Sum rewards: 37.333, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.430', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.064', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.240', 'weapon4': '0.412', 'WEAPON3': '1.350', 'HITCOUNT': '2.200', 'weapon3': '2.814', 'DAMAGECOUNT': '9.885', 'FRAGCOUNT': '35.000'} [2023-02-24 20:57:57,809][213365] Updated weights for policy 0, policy_version 30986 (0.0009) [2023-02-24 20:58:00,243][213332] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13440.4). Total num frames: 126947328. Throughput: 0: 3353.5. Samples: 6733226. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:58:00,243][213332] Avg episode reward: [(0, '39.758')] [2023-02-24 20:58:00,862][213365] Updated weights for policy 0, policy_version 30996 (0.0009) [2023-02-24 20:58:03,926][213365] Updated weights for policy 0, policy_version 31006 (0.0009) [2023-02-24 20:58:05,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 127016960. Throughput: 0: 3352.8. Samples: 6743402. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:58:05,243][213332] Avg episode reward: [(0, '39.758')] [2023-02-24 20:58:06,966][213365] Updated weights for policy 0, policy_version 31016 (0.0009) [2023-02-24 20:58:10,048][213365] Updated weights for policy 0, policy_version 31026 (0.0009) [2023-02-24 20:58:10,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13440.4). Total num frames: 127082496. Throughput: 0: 3351.0. Samples: 6763394. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:58:10,243][213332] Avg episode reward: [(0, '39.758')] [2023-02-24 20:58:13,062][213365] Updated weights for policy 0, policy_version 31036 (0.0009) [2023-02-24 20:58:13,082][213367] DAMAGECOUNT value on done: 281017.0 [2023-02-24 20:58:13,083][213367] Sum rewards: 23.184, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.689', 'AMMO5': '0.019', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.124', 'AMMO3': '0.187', 'weapon2': '0.246', 'weapon4': '0.338', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'ARMOR': '0.494', 'WEAPON3': '1.050', 'HITCOUNT': '1.620', 'weapon3': '2.374', 'DAMAGECOUNT': '7.977', 'FRAGCOUNT': '23.000'} [2023-02-24 20:58:13,415][213367] DAMAGECOUNT value on done: 281780.0 [2023-02-24 20:58:13,416][213367] Sum rewards: 36.731, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.144', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.041', 'weapon5': '0.166', 'AMMO4': '0.205', 'AMMO3': '0.215', 'weapon2': '0.264', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.490', 'WEAPON3': '1.200', 'HITCOUNT': '2.380', 'weapon3': '2.618', 'DAMAGECOUNT': '11.424', 'FRAGCOUNT': '34.000'} [2023-02-24 20:58:13,683][213367] DAMAGECOUNT value on done: 286848.0 [2023-02-24 20:58:13,683][213367] Sum rewards: 28.062, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.315', 'AMMO5': '0.022', 'AMMO2': '0.030', 'weapon4': '0.148', 'AMMO4': '0.149', 'weapon5': '0.198', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'weapon2': '0.732', 'WEAPON3': '1.200', 'HITCOUNT': '1.880', 'weapon3': '2.646', 'DAMAGECOUNT': '8.967', 'FRAGCOUNT': '29.000'} [2023-02-24 20:58:13,805][213372] DAMAGECOUNT value on done: 285773.0 [2023-02-24 20:58:13,806][213372] Sum rewards: 37.360, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.260', 'AMMO5': '0.010', 'AMMO2': '0.054', 'AMMO3': '0.154', 'WEAPON5': '0.250', 'AMMO4': '0.269', 'weapon5': '0.280', 'WEAPON4': '0.400', 'weapon2': '0.460', 'weapon4': '0.822', 'WEAPON3': '0.900', 'weapon3': '1.974', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '11.037', 'FRAGCOUNT': '33.000'} [2023-02-24 20:58:13,998][213367] DAMAGECOUNT value on done: 284735.0 [2023-02-24 20:58:13,999][213367] Sum rewards: 48.962, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.660', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.094', 'AMMO4': '0.131', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.336', 'weapon4': '0.336', 'WEAPON3': '1.100', 'HITCOUNT': '2.660', 'weapon3': '2.958', 'DAMAGECOUNT': '11.040', 'FRAGCOUNT': '44.000'} [2023-02-24 20:58:14,105][213366] DAMAGECOUNT value on done: 277523.0 [2023-02-24 20:58:14,105][213366] Sum rewards: 28.860, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.426', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon2': '0.208', 'AMMO3': '0.222', 'AMMO4': '0.229', 'weapon5': '0.242', 'WEAPON5': '0.350', 'WEAPON4': '0.600', 'weapon4': '0.978', 'WEAPON3': '1.300', 'weapon3': '2.264', 'HITCOUNT': '2.360', 'DAMAGECOUNT': '9.222', 'FRAGCOUNT': '29.000'} [2023-02-24 20:58:14,121][213372] DAMAGECOUNT value on done: 279107.0 [2023-02-24 20:58:14,121][213372] Sum rewards: 43.499, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.252', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon5': '0.112', 'AMMO4': '0.136', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.286', 'weapon2': '0.358', 'WEAPON3': '1.100', 'HITCOUNT': '2.460', 'weapon3': '2.994', 'DAMAGECOUNT': '11.307', 'FRAGCOUNT': '40.000'} [2023-02-24 20:58:14,130][213372] DAMAGECOUNT value on done: 288279.0 [2023-02-24 20:58:14,133][213372] Sum rewards: 40.458, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.080', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon5': '0.032', 'AMMO4': '0.148', 'AMMO3': '0.210', 'weapon2': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.544', 'WEAPON3': '1.400', 'HITCOUNT': '2.810', 'weapon3': '2.890', 'DAMAGECOUNT': '11.535', 'FRAGCOUNT': '38.000'} [2023-02-24 20:58:14,408][213366] DAMAGECOUNT value on done: 288165.0 [2023-02-24 20:58:14,409][213366] Sum rewards: 37.135, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.532', 'AMMO5': '0.013', 'WEAPON1': '0.030', 'AMMO2': '0.041', 'AMMO4': '0.203', 'AMMO3': '0.216', 'weapon2': '0.244', 'weapon5': '0.336', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.444', 'WEAPON3': '1.150', 'HITCOUNT': '2.280', 'weapon3': '2.580', 'DAMAGECOUNT': '11.130', 'FRAGCOUNT': '34.000'} [2023-02-24 20:58:14,427][213366] DAMAGECOUNT value on done: 289952.0 [2023-02-24 20:58:14,428][213366] Sum rewards: 33.885, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.842', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.050', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.167', 'WEAPON4': '0.350', 'weapon2': '0.404', 'weapon4': '0.490', 'WEAPON3': '0.950', 'weapon3': '2.406', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '10.140', 'FRAGCOUNT': '30.000'} [2023-02-24 20:58:14,437][213383] DAMAGECOUNT value on done: 281427.0 [2023-02-24 20:58:14,438][213383] Sum rewards: 50.972, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.006', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'weapon5': '0.082', 'weapon2': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.173', 'weapon4': '0.324', 'WEAPON3': '1.100', 'HITCOUNT': '2.770', 'weapon3': '3.324', 'DAMAGECOUNT': '12.384', 'FRAGCOUNT': '43.000'} [2023-02-24 20:58:14,447][213372] DAMAGECOUNT value on done: 278051.0 [2023-02-24 20:58:14,448][213372] Sum rewards: 40.516, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.985', 'AMMO5': '0.003', 'AMMO2': '0.003', 'weapon4': '0.010', 'AMMO4': '0.015', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.164', 'weapon2': '0.784', 'WEAPON3': '1.000', 'HITCOUNT': '2.240', 'weapon3': '2.820', 'DAMAGECOUNT': '9.810', 'FRAGCOUNT': '35.000'} [2023-02-24 20:58:14,732][213366] DAMAGECOUNT value on done: 283158.0 [2023-02-24 20:58:14,733][213366] Sum rewards: 38.487, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.072', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.054', 'weapon5': '0.088', 'AMMO4': '0.135', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.472', 'WEAPON3': '1.500', 'HITCOUNT': '2.540', 'weapon3': '3.110', 'DAMAGECOUNT': '10.875', 'FRAGCOUNT': '37.000'} [2023-02-24 20:58:14,764][213383] DAMAGECOUNT value on done: 278530.0 [2023-02-24 20:58:14,765][213383] Sum rewards: 55.391, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.585', 'AMMO5': '0.011', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.138', 'weapon2': '0.172', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.404', 'WEAPON3': '1.350', 'weapon3': '3.004', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.090', 'FRAGCOUNT': '48.000'} [2023-02-24 20:58:14,849][213368] DAMAGECOUNT value on done: 279490.0 [2023-02-24 20:58:14,849][213368] Sum rewards: 47.853, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.080', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.090', 'AMMO4': '0.092', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.269', 'weapon2': '0.280', 'weapon4': '0.328', 'WEAPON3': '1.600', 'HITCOUNT': '2.990', 'weapon3': '3.014', 'DAMAGECOUNT': '14.346', 'FRAGCOUNT': '44.000'} [2023-02-24 20:58:14,994][213382] DAMAGECOUNT value on done: 281591.0 [2023-02-24 20:58:14,995][213382] Sum rewards: 45.407, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.178', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.041', 'AMMO4': '0.206', 'weapon2': '0.214', 'weapon5': '0.260', 'AMMO3': '0.262', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.718', 'WEAPON3': '1.450', 'weapon3': '2.192', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.086', 'FRAGCOUNT': '44.000'} [2023-02-24 20:58:15,153][213368] DAMAGECOUNT value on done: 282283.0 [2023-02-24 20:58:15,154][213368] Sum rewards: 46.036, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.784', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon5': '0.218', 'AMMO3': '0.227', 'AMMO4': '0.242', 'weapon2': '0.382', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.652', 'WEAPON3': '1.300', 'weapon3': '2.410', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.960', 'FRAGCOUNT': '43.000'} [2023-02-24 20:58:15,226][213369] DAMAGECOUNT value on done: 284019.0 [2023-02-24 20:58:15,226][213369] Sum rewards: 32.797, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.755', 'AMMO5': '0.006', 'AMMO2': '0.040', 'AMMO3': '0.144', 'weapon5': '0.148', 'WEAPON5': '0.150', 'AMMO4': '0.198', 'WEAPON4': '0.500', 'weapon2': '0.822', 'WEAPON3': '0.900', 'weapon4': '1.082', 'weapon3': '1.694', 'HITCOUNT': '2.140', 'DAMAGECOUNT': '9.228', 'FRAGCOUNT': '31.000'} [2023-02-24 20:58:15,243][213332] Fps is (10 sec: 13517.0, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 127152128. Throughput: 0: 3354.3. Samples: 6783494. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:58:15,243][213332] Avg episode reward: [(0, '39.786')] [2023-02-24 20:58:15,294][213382] DAMAGECOUNT value on done: 282412.0 [2023-02-24 20:58:15,294][213382] Sum rewards: 43.864, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.025', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.026', 'weapon5': '0.064', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.386', 'WEAPON3': '1.300', 'HITCOUNT': '2.390', 'weapon3': '3.246', 'DAMAGECOUNT': '11.826', 'FRAGCOUNT': '40.000'} [2023-02-24 20:58:15,344][213383] DAMAGECOUNT value on done: 281093.0 [2023-02-24 20:58:15,345][213383] Sum rewards: 52.384, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.500', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.116', 'AMMO4': '0.137', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'weapon4': '0.220', 'WEAPON4': '0.300', 'weapon2': '0.536', 'WEAPON3': '1.200', 'weapon3': '2.872', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.689', 'FRAGCOUNT': '46.000'} [2023-02-24 20:58:15,413][213368] DAMAGECOUNT value on done: 283973.0 [2023-02-24 20:58:15,413][213368] Sum rewards: 48.107, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.175', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.033', 'AMMO3': '0.119', 'AMMO4': '0.163', 'weapon5': '0.270', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.448', 'weapon4': '0.622', 'WEAPON3': '0.750', 'weapon3': '2.418', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '12.516', 'FRAGCOUNT': '39.000'} [2023-02-24 20:58:15,502][213382] DAMAGECOUNT value on done: 276301.0 [2023-02-24 20:58:15,502][213382] Sum rewards: 41.552, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.030', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon5': '0.160', 'AMMO3': '0.194', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.390', 'weapon4': '0.510', 'WEAPON3': '1.150', 'weapon3': '2.576', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '10.791', 'FRAGCOUNT': '38.000'} [2023-02-24 20:58:15,526][213369] DAMAGECOUNT value on done: 283553.0 [2023-02-24 20:58:15,527][213369] Sum rewards: 41.751, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.277', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.032', 'AMMO3': '0.099', 'AMMO4': '0.161', 'WEAPON5': '0.300', 'weapon5': '0.304', 'WEAPON4': '0.350', 'WEAPON3': '0.600', 'weapon2': '0.762', 'weapon4': '1.102', 'weapon3': '1.604', 'HITCOUNT': '2.360', 'DAMAGECOUNT': '10.590', 'FRAGCOUNT': '33.000'} [2023-02-24 20:58:15,615][213384] DAMAGECOUNT value on done: 287555.0 [2023-02-24 20:58:15,615][213384] Sum rewards: 48.340, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.056', 'AMMO5': '0.017', 'AMMO2': '0.050', 'AMMO3': '0.184', 'AMMO4': '0.251', 'weapon5': '0.256', 'weapon4': '0.310', 'weapon2': '0.384', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'HITCOUNT': '2.630', 'weapon3': '2.728', 'DAMAGECOUNT': '12.885', 'FRAGCOUNT': '42.000'} [2023-02-24 20:58:15,645][213383] DAMAGECOUNT value on done: 276008.0 [2023-02-24 20:58:15,646][213383] Sum rewards: 50.642, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.414', 'AMMO5': '0.018', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.182', 'AMMO3': '0.237', 'WEAPON4': '0.350', 'weapon4': '0.370', 'WEAPON5': '0.450', 'weapon2': '0.484', 'WEAPON3': '1.400', 'weapon3': '2.594', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.280', 'FRAGCOUNT': '47.000'} [2023-02-24 20:58:15,715][213368] DAMAGECOUNT value on done: 273693.0 [2023-02-24 20:58:15,716][213368] Sum rewards: 34.601, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.850', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.172', 'AMMO4': '0.178', 'AMMO3': '0.212', 'weapon2': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.388', 'WEAPON3': '1.250', 'HITCOUNT': '2.170', 'weapon3': '2.794', 'DAMAGECOUNT': '10.575', 'FRAGCOUNT': '32.000'} [2023-02-24 20:58:15,799][213382] DAMAGECOUNT value on done: 287692.0 [2023-02-24 20:58:15,799][213382] Sum rewards: 43.055, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.896', 'AMMO5': '0.013', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon2': '0.232', 'AMMO3': '0.242', 'weapon5': '0.260', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.796', 'ARMOR': '0.856', 'WEAPON3': '1.400', 'weapon3': '2.270', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '12.861', 'FRAGCOUNT': '40.000'} [2023-02-24 20:58:15,820][213369] DAMAGECOUNT value on done: 288128.0 [2023-02-24 20:58:15,821][213369] Sum rewards: 41.790, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.004', 'AMMO5': '0.011', 'AMMO2': '0.046', 'AMMO3': '0.159', 'AMMO4': '0.230', 'weapon5': '0.248', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.560', 'weapon4': '0.746', 'WEAPON3': '0.950', 'weapon3': '2.154', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '11.910', 'FRAGCOUNT': '36.000'} [2023-02-24 20:58:15,910][213384] DAMAGECOUNT value on done: 273099.0 [2023-02-24 20:58:15,910][213384] Sum rewards: 52.479, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.326', 'AMMO5': '0.016', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.208', 'weapon5': '0.318', 'weapon2': '0.324', 'WEAPON4': '0.350', 'weapon4': '0.390', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.590', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '12.657', 'FRAGCOUNT': '49.000'} [2023-02-24 20:58:16,071][213384] DAMAGECOUNT value on done: 285962.0 [2023-02-24 20:58:16,072][213384] Sum rewards: 35.632, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.217', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.034', 'weapon5': '0.040', 'AMMO4': '0.061', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon2': '0.424', 'WEAPON3': '1.250', 'HITCOUNT': '2.530', 'weapon3': '3.362', 'DAMAGECOUNT': '11.133', 'FRAGCOUNT': '32.000'} [2023-02-24 20:58:16,113][213369] DAMAGECOUNT value on done: 273643.0 [2023-02-24 20:58:16,114][213369] Sum rewards: 40.564, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.650', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.092', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.258', 'weapon2': '0.730', 'WEAPON3': '1.300', 'HITCOUNT': '2.610', 'weapon3': '2.650', 'DAMAGECOUNT': '11.334', 'FRAGCOUNT': '37.000'} [2023-02-24 20:58:16,134][213365] Updated weights for policy 0, policy_version 31046 (0.0009) [2023-02-24 20:58:16,367][213384] DAMAGECOUNT value on done: 286098.0 [2023-02-24 20:58:16,368][213384] Sum rewards: 39.239, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.390', 'AMMO5': '0.017', 'AMMO2': '0.053', 'AMMO3': '0.084', 'AMMO4': '0.264', 'weapon5': '0.320', 'WEAPON5': '0.500', 'WEAPON3': '0.500', 'WEAPON4': '0.650', 'weapon2': '0.738', 'weapon4': '0.934', 'weapon3': '1.502', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '10.986', 'FRAGCOUNT': '32.000'} [2023-02-24 20:58:19,179][213365] Updated weights for policy 0, policy_version 31056 (0.0009) [2023-02-24 20:58:20,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 127217664. Throughput: 0: 3356.6. Samples: 6793726. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:58:20,243][213332] Avg episode reward: [(0, '40.536')] [2023-02-24 20:58:22,186][213365] Updated weights for policy 0, policy_version 31066 (0.0009) [2023-02-24 20:58:25,243][213332] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13440.4). Total num frames: 127283200. Throughput: 0: 3356.7. Samples: 6813832. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:58:25,243][213332] Avg episode reward: [(0, '40.536')] [2023-02-24 20:58:25,282][213365] Updated weights for policy 0, policy_version 31076 (0.0009) [2023-02-24 20:58:28,305][213365] Updated weights for policy 0, policy_version 31086 (0.0009) [2023-02-24 20:58:30,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 127352832. Throughput: 0: 3355.7. Samples: 6833938. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:58:30,243][213332] Avg episode reward: [(0, '40.536')] [2023-02-24 20:58:31,353][213365] Updated weights for policy 0, policy_version 31096 (0.0009) [2023-02-24 20:58:33,062][213367] DAMAGECOUNT value on done: 283741.0 [2023-02-24 20:58:33,062][213367] Sum rewards: 35.566, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.196', 'AMMO5': '0.009', 'AMMO2': '0.018', 'ARMOR': '0.040', 'AMMO4': '0.089', 'AMMO3': '0.110', 'weapon5': '0.112', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.526', 'WEAPON3': '0.650', 'weapon4': '0.664', 'HITCOUNT': '1.780', 'weapon3': '2.492', 'DAMAGECOUNT': '8.172', 'FRAGCOUNT': '29.000'} [2023-02-24 20:58:33,388][213367] DAMAGECOUNT value on done: 285833.0 [2023-02-24 20:58:33,389][213367] Sum rewards: 44.664, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.705', 'AMMO5': '0.006', 'AMMO2': '0.048', 'weapon5': '0.080', 'WEAPON5': '0.200', 'weapon2': '0.200', 'AMMO3': '0.217', 'AMMO4': '0.239', 'weapon4': '0.444', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.660', 'weapon3': '3.016', 'DAMAGECOUNT': '12.159', 'FRAGCOUNT': '42.000'} [2023-02-24 20:58:33,596][213367] DAMAGECOUNT value on done: 291083.0 [2023-02-24 20:58:33,597][213367] Sum rewards: 47.499, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.362', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.107', 'AMMO3': '0.188', 'weapon5': '0.214', 'weapon4': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.742', 'WEAPON3': '1.100', 'weapon3': '2.360', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '12.705', 'FRAGCOUNT': '43.000'} [2023-02-24 20:58:33,730][213372] DAMAGECOUNT value on done: 289629.0 [2023-02-24 20:58:33,730][213372] Sum rewards: 34.721, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.777', 'AMMO5': '0.014', 'AMMO2': '0.040', 'AMMO4': '0.198', 'AMMO3': '0.217', 'weapon5': '0.244', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON4': '0.450', 'weapon4': '0.856', 'WEAPON3': '1.250', 'weapon3': '2.144', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '11.568', 'FRAGCOUNT': '32.000'} [2023-02-24 20:58:33,905][213367] DAMAGECOUNT value on done: 288603.0 [2023-02-24 20:58:33,906][213367] Sum rewards: 44.032, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.650', 'ARMOR': '0.004', 'AMMO2': '0.011', 'AMMO5': '0.017', 'AMMO4': '0.056', 'weapon5': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.205', 'weapon4': '0.232', 'WEAPON5': '0.300', 'weapon2': '0.676', 'WEAPON3': '1.200', 'HITCOUNT': '2.620', 'weapon3': '2.736', 'DAMAGECOUNT': '11.604', 'FRAGCOUNT': '38.500'} [2023-02-24 20:58:34,052][213372] DAMAGECOUNT value on done: 282679.0 [2023-02-24 20:58:34,052][213372] Sum rewards: 38.392, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.132', 'AMMO4': '-0.023', 'AMMO2': '-0.004', 'AMMO5': '0.007', 'weapon5': '0.026', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'weapon4': '0.350', 'weapon2': '0.670', 'WEAPON3': '1.300', 'HITCOUNT': '2.540', 'weapon3': '2.710', 'DAMAGECOUNT': '10.716', 'FRAGCOUNT': '36.000'} [2023-02-24 20:58:34,061][213372] DAMAGECOUNT value on done: 292367.0 [2023-02-24 20:58:34,062][213372] Sum rewards: 41.045, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.776', 'AMMO5': '0.019', 'AMMO2': '0.041', 'AMMO3': '0.187', 'weapon5': '0.198', 'AMMO4': '0.203', 'weapon2': '0.352', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.618', 'WEAPON3': '1.100', 'HITCOUNT': '2.440', 'weapon3': '2.448', 'DAMAGECOUNT': '12.264', 'FRAGCOUNT': '38.000'} [2023-02-24 20:58:34,127][213366] DAMAGECOUNT value on done: 281905.0 [2023-02-24 20:58:34,127][213366] Sum rewards: 46.535, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.276', 'AMMO5': '0.003', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'weapon2': '0.174', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'weapon4': '0.342', 'WEAPON3': '1.600', 'HITCOUNT': '2.810', 'weapon3': '3.118', 'DAMAGECOUNT': '13.146', 'FRAGCOUNT': '45.000'} [2023-02-24 20:58:34,375][213372] DAMAGECOUNT value on done: 282440.0 [2023-02-24 20:58:34,376][213372] Sum rewards: 53.750, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.892', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.108', 'weapon5': '0.122', 'weapon4': '0.156', 'AMMO3': '0.194', 'weapon2': '0.496', 'WEAPON3': '1.200', 'HITCOUNT': '2.840', 'weapon3': '2.984', 'DAMAGECOUNT': '13.167', 'FRAGCOUNT': '46.000'} [2023-02-24 20:58:34,414][213366] DAMAGECOUNT value on done: 291671.0 [2023-02-24 20:58:34,414][213366] Sum rewards: 38.944, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.827', 'AMMO2': '0.017', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'AMMO3': '0.187', 'weapon2': '0.376', 'weapon4': '0.518', 'WEAPON3': '1.100', 'HITCOUNT': '2.600', 'weapon3': '3.018', 'DAMAGECOUNT': '10.518', 'FRAGCOUNT': '34.000'} [2023-02-24 20:58:34,429][213383] DAMAGECOUNT value on done: 284680.0 [2023-02-24 20:58:34,430][213383] Sum rewards: 34.685, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.727', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon5': '0.128', 'weapon4': '0.154', 'AMMO4': '0.155', 'weapon2': '0.184', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '2.090', 'weapon3': '3.270', 'DAMAGECOUNT': '9.759', 'FRAGCOUNT': '35.000'} [2023-02-24 20:58:34,442][213366] DAMAGECOUNT value on done: 293746.0 [2023-02-24 20:58:34,443][213366] Sum rewards: 40.886, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.749', 'AMMO5': '0.021', 'AMMO2': '0.068', 'AMMO3': '0.155', 'weapon5': '0.162', 'weapon2': '0.324', 'AMMO4': '0.339', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'weapon4': '0.740', 'WEAPON3': '0.950', 'HITCOUNT': '2.270', 'weapon3': '2.324', 'DAMAGECOUNT': '11.382', 'FRAGCOUNT': '38.000'} [2023-02-24 20:58:34,453][213365] Updated weights for policy 0, policy_version 31106 (0.0009) [2023-02-24 20:58:34,725][213366] DAMAGECOUNT value on done: 287570.0 [2023-02-24 20:58:34,725][213366] Sum rewards: 52.496, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.014', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'weapon2': '0.376', 'WEAPON4': '0.400', 'weapon4': '0.632', 'WEAPON3': '0.950', 'weapon3': '2.686', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.236', 'FRAGCOUNT': '46.000'} [2023-02-24 20:58:34,750][213383] DAMAGECOUNT value on done: 282800.0 [2023-02-24 20:58:34,751][213383] Sum rewards: 37.629, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.598', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.058', 'AMMO3': '0.234', 'weapon5': '0.234', 'weapon2': '0.268', 'AMMO4': '0.292', 'WEAPON5': '0.400', 'ARMOR': '0.449', 'weapon4': '0.578', 'WEAPON4': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.586', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.810', 'FRAGCOUNT': '37.000'} [2023-02-24 20:58:34,915][213368] DAMAGECOUNT value on done: 283195.0 [2023-02-24 20:58:34,915][213368] Sum rewards: 38.683, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.070', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.062', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon4': '0.346', 'weapon2': '0.630', 'WEAPON3': '1.300', 'HITCOUNT': '2.500', 'weapon3': '2.664', 'DAMAGECOUNT': '11.115', 'FRAGCOUNT': '35.000'} [2023-02-24 20:58:35,020][213382] DAMAGECOUNT value on done: 285826.0 [2023-02-24 20:58:35,020][213382] Sum rewards: 44.541, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.380', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon5': '0.110', 'AMMO4': '0.175', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'weapon2': '0.336', 'WEAPON4': '0.350', 'weapon4': '0.564', 'WEAPON3': '1.100', 'HITCOUNT': '2.640', 'weapon3': '2.760', 'DAMAGECOUNT': '12.705', 'FRAGCOUNT': '39.000'} [2023-02-24 20:58:35,157][213369] DAMAGECOUNT value on done: 288118.0 [2023-02-24 20:58:35,157][213369] Sum rewards: 50.200, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.244', 'AMMO5': '0.006', 'AMMO2': '0.010', 'weapon4': '0.012', 'AMMO4': '0.049', 'weapon5': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.152', 'WEAPON5': '0.200', 'weapon2': '0.562', 'WEAPON3': '0.950', 'HITCOUNT': '2.650', 'weapon3': '3.118', 'DAMAGECOUNT': '12.297', 'FRAGCOUNT': '41.000'} [2023-02-24 20:58:35,215][213368] DAMAGECOUNT value on done: 287250.0 [2023-02-24 20:58:35,215][213368] Sum rewards: 53.315, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.575', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon5': '0.090', 'AMMO3': '0.215', 'AMMO4': '0.238', 'weapon2': '0.248', 'WEAPON5': '0.250', 'weapon4': '0.398', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.976', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.901', 'FRAGCOUNT': '48.000'} [2023-02-24 20:58:35,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13440.4). Total num frames: 127418368. Throughput: 0: 3355.2. Samples: 6844156. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:58:35,243][213332] Avg episode reward: [(0, '40.318')] [2023-02-24 20:58:35,321][213382] DAMAGECOUNT value on done: 286922.0 [2023-02-24 20:58:35,321][213382] Sum rewards: 50.282, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.069', 'AMMO5': '0.026', 'AMMO2': '0.066', 'AMMO3': '0.154', 'weapon2': '0.284', 'AMMO4': '0.332', 'weapon5': '0.336', 'WEAPON5': '0.600', 'weapon4': '0.630', 'WEAPON4': '0.700', 'WEAPON3': '0.900', 'weapon3': '2.352', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '13.530', 'FRAGCOUNT': '46.000'} [2023-02-24 20:58:35,326][213383] DAMAGECOUNT value on done: 285674.0 [2023-02-24 20:58:35,326][213383] Sum rewards: 49.897, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.058', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.051', 'AMMO3': '0.214', 'AMMO4': '0.253', 'weapon5': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.658', 'WEAPON3': '1.250', 'weapon3': '2.396', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '13.743', 'FRAGCOUNT': '45.000'} [2023-02-24 20:58:35,458][213369] DAMAGECOUNT value on done: 286737.0 [2023-02-24 20:58:35,458][213369] Sum rewards: 36.184, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.624', 'AMMO5': '0.007', 'ARMOR': '0.012', 'weapon5': '0.014', 'AMMO2': '0.027', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.594', 'weapon4': '0.738', 'WEAPON3': '1.150', 'HITCOUNT': '2.280', 'weapon3': '2.498', 'DAMAGECOUNT': '9.552', 'FRAGCOUNT': '33.000'} [2023-02-24 20:58:35,471][213368] DAMAGECOUNT value on done: 287824.0 [2023-02-24 20:58:35,472][213368] Sum rewards: 35.981, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.840', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon5': '0.124', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.364', 'weapon2': '0.430', 'WEAPON3': '1.300', 'HITCOUNT': '2.640', 'weapon3': '2.744', 'DAMAGECOUNT': '11.553', 'FRAGCOUNT': '33.000'} [2023-02-24 20:58:35,537][213382] DAMAGECOUNT value on done: 279961.0 [2023-02-24 20:58:35,537][213382] Sum rewards: 34.401, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.588', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon5': '0.204', 'AMMO4': '0.248', 'AMMO3': '0.260', 'WEAPON5': '0.300', 'weapon2': '0.326', 'weapon4': '0.518', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'HITCOUNT': '2.360', 'weapon3': '2.532', 'DAMAGECOUNT': '10.980', 'FRAGCOUNT': '35.000'} [2023-02-24 20:58:35,549][213384] DAMAGECOUNT value on done: 291229.0 [2023-02-24 20:58:35,550][213384] Sum rewards: 40.580, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.822', 'ARMOR': '0.004', 'AMMO2': '0.015', 'AMMO5': '0.018', 'AMMO4': '0.075', 'weapon4': '0.116', 'weapon2': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.205', 'weapon5': '0.252', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.320', 'weapon3': '3.222', 'DAMAGECOUNT': '11.007', 'FRAGCOUNT': '36.000'} [2023-02-24 20:58:35,631][213383] DAMAGECOUNT value on done: 279299.0 [2023-02-24 20:58:35,632][213383] Sum rewards: 35.001, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.258', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon5': '0.066', 'weapon4': '0.070', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'weapon2': '0.292', 'WEAPON3': '1.400', 'HITCOUNT': '2.260', 'weapon3': '3.338', 'DAMAGECOUNT': '9.873', 'FRAGCOUNT': '35.000'} [2023-02-24 20:58:35,760][213369] DAMAGECOUNT value on done: 292425.0 [2023-02-24 20:58:35,760][213369] Sum rewards: 45.004, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.423', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.104', 'AMMO4': '0.110', 'weapon2': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon4': '0.262', 'WEAPON3': '1.450', 'HITCOUNT': '2.540', 'weapon3': '3.276', 'DAMAGECOUNT': '12.891', 'FRAGCOUNT': '41.000'} [2023-02-24 20:58:35,766][213368] DAMAGECOUNT value on done: 277277.0 [2023-02-24 20:58:35,766][213368] Sum rewards: 40.086, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.517', 'ARMOR': '0.004', 'AMMO2': '0.011', 'AMMO5': '0.012', 'weapon4': '0.038', 'AMMO4': '0.056', 'weapon5': '0.098', 'WEAPON4': '0.150', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'weapon2': '0.456', 'WEAPON3': '1.350', 'HITCOUNT': '2.510', 'weapon3': '3.196', 'DAMAGECOUNT': '10.752', 'FRAGCOUNT': '37.000'} [2023-02-24 20:58:35,837][213382] DAMAGECOUNT value on done: 291444.0 [2023-02-24 20:58:35,837][213382] Sum rewards: 44.943, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.062', 'AMMO5': '0.020', 'AMMO2': '0.028', 'weapon5': '0.098', 'weapon4': '0.106', 'AMMO4': '0.139', 'AMMO3': '0.172', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.576', 'WEAPON3': '1.200', 'HITCOUNT': '2.370', 'weapon3': '2.990', 'DAMAGECOUNT': '11.256', 'FRAGCOUNT': '41.000'} [2023-02-24 20:58:35,851][213384] DAMAGECOUNT value on done: 277195.0 [2023-02-24 20:58:35,852][213384] Sum rewards: 44.288, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.960', 'ARMOR': '0.009', 'AMMO5': '0.019', 'AMMO2': '0.058', 'AMMO3': '0.157', 'weapon2': '0.284', 'AMMO4': '0.289', 'weapon5': '0.290', 'WEAPON5': '0.550', 'weapon4': '0.662', 'WEAPON4': '0.750', 'WEAPON3': '1.000', 'weapon3': '2.412', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.288', 'FRAGCOUNT': '41.000'} [2023-02-24 20:58:36,037][213384] DAMAGECOUNT value on done: 290048.0 [2023-02-24 20:58:36,037][213384] Sum rewards: 43.872, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.670', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.164', 'AMMO3': '0.217', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.448', 'WEAPON3': '1.300', 'weapon3': '2.830', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.258', 'FRAGCOUNT': '40.000'} [2023-02-24 20:58:36,051][213369] DAMAGECOUNT value on done: 277089.0 [2023-02-24 20:58:36,051][213369] Sum rewards: 33.818, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.908', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.047', 'AMMO3': '0.216', 'AMMO4': '0.234', 'weapon4': '0.236', 'weapon5': '0.266', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.410', 'WEAPON3': '1.250', 'HITCOUNT': '2.040', 'weapon3': '2.760', 'DAMAGECOUNT': '10.338', 'FRAGCOUNT': '33.000'} [2023-02-24 20:58:36,328][213384] DAMAGECOUNT value on done: 289687.0 [2023-02-24 20:58:36,329][213384] Sum rewards: 35.576, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.880', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.396', 'weapon4': '0.432', 'WEAPON3': '1.150', 'weapon3': '2.274', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '10.767', 'FRAGCOUNT': '31.000'} [2023-02-24 20:58:37,419][213365] Updated weights for policy 0, policy_version 31116 (0.0009) [2023-02-24 20:58:40,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 127488000. Throughput: 0: 3358.6. Samples: 6864266. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:58:40,243][213332] Avg episode reward: [(0, '40.370')] [2023-02-24 20:58:40,502][213365] Updated weights for policy 0, policy_version 31126 (0.0009) [2023-02-24 20:58:43,143][213367] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 20:58:43,523][213365] Updated weights for policy 0, policy_version 31136 (0.0009) [2023-02-24 20:58:45,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 127553536. Throughput: 0: 3359.5. Samples: 6884404. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:58:45,243][213332] Avg episode reward: [(0, '40.370')] [2023-02-24 20:58:45,247][213352] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000031141_127553536.pth... [2023-02-24 20:58:45,306][213352] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000030353_124325888.pth [2023-02-24 20:58:46,566][213365] Updated weights for policy 0, policy_version 31146 (0.0009) [2023-02-24 20:58:49,666][213365] Updated weights for policy 0, policy_version 31156 (0.0010) [2023-02-24 20:58:49,776][213382] Large shaping reward 2.560 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.528, 176.0), ('weapon5', 0.002)] [2023-02-24 20:58:50,243][213332] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13440.4). Total num frames: 127619072. Throughput: 0: 3359.5. Samples: 6894578. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:58:50,243][213332] Avg episode reward: [(0, '40.370')] [2023-02-24 20:58:52,660][213365] Updated weights for policy 0, policy_version 31166 (0.0009) [2023-02-24 20:58:53,038][213367] DAMAGECOUNT value on done: 286499.0 [2023-02-24 20:58:53,038][213367] Sum rewards: 28.660, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.472', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.016', 'weapon7': '0.048', 'weapon5': '0.048', 'AMMO4': '0.081', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.484', 'weapon4': '0.812', 'WEAPON3': '1.100', 'HITCOUNT': '2.000', 'weapon3': '2.382', 'DAMAGECOUNT': '8.274', 'FRAGCOUNT': '26.000'} [2023-02-24 20:58:53,345][213367] DAMAGECOUNT value on done: 289977.0 [2023-02-24 20:58:53,345][213367] Sum rewards: 41.170, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.764', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.118', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'weapon2': '0.210', 'AMMO3': '0.221', 'weapon4': '0.316', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.670', 'weapon3': '3.046', 'DAMAGECOUNT': '12.432', 'FRAGCOUNT': '39.000'} [2023-02-24 20:58:53,532][213367] DAMAGECOUNT value on done: 295276.0 [2023-02-24 20:58:53,533][213367] Sum rewards: 38.279, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.388', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.052', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.296', 'weapon4': '0.388', 'weapon2': '0.402', 'WEAPON3': '1.800', 'HITCOUNT': '2.840', 'weapon3': '2.912', 'DAMAGECOUNT': '12.579', 'FRAGCOUNT': '38.000'} [2023-02-24 20:58:53,686][213372] DAMAGECOUNT value on done: 293443.0 [2023-02-24 20:58:53,686][213372] Sum rewards: 43.941, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.438', 'AMMO5': '0.021', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon5': '0.188', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'weapon4': '0.340', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.558', 'WEAPON3': '1.450', 'HITCOUNT': '2.440', 'weapon3': '2.546', 'DAMAGECOUNT': '11.442', 'FRAGCOUNT': '43.000'} [2023-02-24 20:58:53,846][213367] DAMAGECOUNT value on done: 292073.0 [2023-02-24 20:58:53,847][213367] Sum rewards: 31.728, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.015', 'AMMO5': '0.005', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'weapon5': '0.122', 'AMMO4': '0.163', 'weapon2': '0.196', 'AMMO3': '0.204', 'WEAPON4': '0.450', 'weapon4': '0.890', 'WEAPON3': '1.200', 'HITCOUNT': '2.240', 'weapon3': '2.480', 'DAMAGECOUNT': '10.410', 'FRAGCOUNT': '31.000'} [2023-02-24 20:58:54,001][213372] DAMAGECOUNT value on done: 286519.0 [2023-02-24 20:58:54,002][213372] Sum rewards: 40.633, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.011', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.094', 'AMMO3': '0.162', 'weapon5': '0.166', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON4': '0.350', 'weapon4': '0.708', 'WEAPON3': '0.950', 'weapon3': '2.548', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '11.520', 'FRAGCOUNT': '34.000'} [2023-02-24 20:58:54,011][213372] DAMAGECOUNT value on done: 295905.0 [2023-02-24 20:58:54,012][213372] Sum rewards: 36.524, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.338', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon4': '0.282', 'weapon2': '0.426', 'WEAPON3': '1.250', 'HITCOUNT': '2.500', 'weapon3': '2.808', 'DAMAGECOUNT': '10.614', 'FRAGCOUNT': '34.000'} [2023-02-24 20:58:54,083][213366] DAMAGECOUNT value on done: 284725.0 [2023-02-24 20:58:54,084][213366] Sum rewards: 25.369, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.490', 'AMMO5': '0.010', 'AMMO2': '0.040', 'AMMO3': '0.126', 'weapon5': '0.148', 'AMMO4': '0.201', 'WEAPON5': '0.250', 'weapon2': '0.442', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'weapon4': '0.948', 'HITCOUNT': '1.970', 'weapon3': '2.100', 'DAMAGECOUNT': '8.373', 'FRAGCOUNT': '23.000'} [2023-02-24 20:58:54,329][213372] DAMAGECOUNT value on done: 285697.0 [2023-02-24 20:58:54,329][213372] Sum rewards: 33.632, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.435', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.042', 'AMMO4': '0.181', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'weapon4': '0.276', 'WEAPON4': '0.350', 'weapon2': '0.520', 'WEAPON3': '1.150', 'HITCOUNT': '2.360', 'weapon3': '2.980', 'DAMAGECOUNT': '9.771', 'FRAGCOUNT': '32.000'} [2023-02-24 20:58:54,393][213366] DAMAGECOUNT value on done: 295300.0 [2023-02-24 20:58:54,393][213366] Sum rewards: 37.097, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.119', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.156', 'AMMO3': '0.233', 'weapon4': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.378', 'WEAPON3': '1.350', 'HITCOUNT': '2.500', 'weapon3': '2.930', 'DAMAGECOUNT': '10.887', 'FRAGCOUNT': '37.000'} [2023-02-24 20:58:54,415][213366] DAMAGECOUNT value on done: 298211.0 [2023-02-24 20:58:54,416][213366] Sum rewards: 43.355, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.724', 'AMMO5': '0.015', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.186', 'WEAPON4': '0.200', 'weapon4': '0.208', 'weapon2': '0.218', 'AMMO3': '0.279', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'HITCOUNT': '2.660', 'weapon3': '3.034', 'DAMAGECOUNT': '13.395', 'FRAGCOUNT': '41.000'} [2023-02-24 20:58:54,447][213383] DAMAGECOUNT value on done: 287325.0 [2023-02-24 20:58:54,448][213383] Sum rewards: 26.421, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.767', 'ARMOR': '0.012', 'AMMO5': '0.023', 'AMMO2': '0.073', 'AMMO3': '0.126', 'weapon2': '0.290', 'weapon5': '0.334', 'AMMO4': '0.366', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'WEAPON4': '0.800', 'weapon4': '1.336', 'weapon3': '1.592', 'HITCOUNT': '2.050', 'DAMAGECOUNT': '7.935', 'FRAGCOUNT': '27.000'} [2023-02-24 20:58:54,732][213366] DAMAGECOUNT value on done: 290703.0 [2023-02-24 20:58:54,732][213366] Sum rewards: 31.794, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.960', 'AMMO5': '0.007', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.170', 'weapon5': '0.172', 'WEAPON5': '0.200', 'weapon2': '0.220', 'WEAPON4': '0.300', 'weapon4': '0.690', 'WEAPON3': '1.050', 'HITCOUNT': '2.110', 'weapon3': '2.508', 'DAMAGECOUNT': '9.399', 'FRAGCOUNT': '28.000'} [2023-02-24 20:58:54,781][213383] DAMAGECOUNT value on done: 287419.0 [2023-02-24 20:58:54,782][213383] Sum rewards: 49.478, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.804', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.124', 'weapon5': '0.182', 'AMMO4': '0.199', 'weapon2': '0.212', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.720', 'weapon3': '3.150', 'DAMAGECOUNT': '13.857', 'FRAGCOUNT': '45.000'} [2023-02-24 20:58:54,945][213368] DAMAGECOUNT value on done: 286873.0 [2023-02-24 20:58:54,946][213368] Sum rewards: 33.884, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.735', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.064', 'AMMO4': '0.129', 'weapon5': '0.144', 'WEAPON4': '0.250', 'AMMO3': '0.261', 'WEAPON5': '0.300', 'weapon2': '0.456', 'WEAPON3': '1.600', 'HITCOUNT': '2.520', 'weapon3': '3.074', 'DAMAGECOUNT': '11.034', 'FRAGCOUNT': '35.000'} [2023-02-24 20:58:55,026][213382] DAMAGECOUNT value on done: 289907.0 [2023-02-24 20:58:55,026][213382] Sum rewards: 41.143, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-5.112', 'AMMO2': '0.008', 'AMMO5': '0.012', 'AMMO4': '0.040', 'weapon5': '0.084', 'WEAPON4': '0.100', 'weapon4': '0.122', 'WEAPON5': '0.250', 'weapon2': '0.342', 'AMMO3': '0.357', 'WEAPON3': '2.150', 'HITCOUNT': '2.720', 'weapon3': '3.076', 'DAMAGECOUNT': '12.243', 'FRAGCOUNT': '45.000'} [2023-02-24 20:58:55,138][213369] DAMAGECOUNT value on done: 292398.0 [2023-02-24 20:58:55,138][213369] Sum rewards: 51.248, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.968', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.072', 'weapon4': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.456', 'WEAPON3': '1.100', 'HITCOUNT': '2.600', 'weapon3': '3.170', 'DAMAGECOUNT': '12.840', 'FRAGCOUNT': '44.000'} [2023-02-24 20:58:55,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 127688704. Throughput: 0: 3362.5. Samples: 6914708. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:58:55,243][213332] Avg episode reward: [(0, '40.504')] [2023-02-24 20:58:55,265][213368] DAMAGECOUNT value on done: 291813.0 [2023-02-24 20:58:55,266][213368] Sum rewards: 47.692, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.398', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon4': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon5': '0.228', 'weapon2': '0.326', 'WEAPON3': '1.250', 'HITCOUNT': '2.920', 'weapon3': '3.078', 'DAMAGECOUNT': '13.689', 'FRAGCOUNT': '41.000'} [2023-02-24 20:58:55,326][213382] DAMAGECOUNT value on done: 291138.0 [2023-02-24 20:58:55,327][213382] Sum rewards: 44.886, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.778', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.048', 'AMMO3': '0.190', 'AMMO4': '0.239', 'WEAPON5': '0.300', 'weapon5': '0.300', 'weapon2': '0.336', 'WEAPON4': '0.600', 'weapon4': '0.620', 'WEAPON3': '1.050', 'weapon3': '2.372', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '12.648', 'FRAGCOUNT': '42.000'} [2023-02-24 20:58:55,359][213383] DAMAGECOUNT value on done: 288583.0 [2023-02-24 20:58:55,359][213383] Sum rewards: 31.987, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.500', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.027', 'AMMO4': '0.137', 'WEAPON5': '0.200', 'weapon4': '0.200', 'weapon5': '0.204', 'AMMO3': '0.218', 'WEAPON4': '0.350', 'weapon2': '0.360', 'WEAPON3': '1.250', 'HITCOUNT': '1.970', 'weapon3': '2.830', 'DAMAGECOUNT': '8.727', 'FRAGCOUNT': '33.000'} [2023-02-24 20:58:55,448][213369] DAMAGECOUNT value on done: 290431.0 [2023-02-24 20:58:55,449][213369] Sum rewards: 38.409, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.138', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.114', 'AMMO3': '0.128', 'WEAPON5': '0.150', 'AMMO4': '0.189', 'WEAPON4': '0.200', 'weapon4': '0.468', 'weapon2': '0.768', 'WEAPON3': '0.850', 'weapon3': '2.364', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '11.082', 'FRAGCOUNT': '31.000'} [2023-02-24 20:58:55,500][213368] DAMAGECOUNT value on done: 292382.0 [2023-02-24 20:58:55,501][213368] Sum rewards: 45.602, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.503', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.023', 'weapon5': '0.060', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.240', 'AMMO3': '0.273', 'weapon2': '0.462', 'WEAPON3': '1.700', 'weapon3': '2.968', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.674', 'FRAGCOUNT': '42.000'} [2023-02-24 20:58:55,534][213384] DAMAGECOUNT value on done: 294609.0 [2023-02-24 20:58:55,535][213384] Sum rewards: 33.449, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.724', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon5': '0.110', 'AMMO4': '0.219', 'AMMO3': '0.229', 'weapon4': '0.240', 'weapon2': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.120', 'weapon3': '3.106', 'DAMAGECOUNT': '10.140', 'FRAGCOUNT': '33.000'} [2023-02-24 20:58:55,567][213382] DAMAGECOUNT value on done: 283670.0 [2023-02-24 20:58:55,567][213382] Sum rewards: 34.990, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.115', 'AMMO5': '0.009', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.214', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'weapon2': '0.292', 'WEAPON4': '0.350', 'weapon4': '0.390', 'WEAPON3': '1.450', 'HITCOUNT': '2.550', 'weapon3': '2.832', 'DAMAGECOUNT': '11.127', 'FRAGCOUNT': '34.000'} [2023-02-24 20:58:55,663][213383] DAMAGECOUNT value on done: 283143.0 [2023-02-24 20:58:55,664][213383] Sum rewards: 36.495, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.000', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.106', 'weapon2': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon4': '0.462', 'WEAPON3': '1.300', 'HITCOUNT': '2.420', 'weapon3': '3.016', 'DAMAGECOUNT': '11.532', 'FRAGCOUNT': '33.000'} [2023-02-24 20:58:55,751][213369] DAMAGECOUNT value on done: 295913.0 [2023-02-24 20:58:55,752][213369] Sum rewards: 40.455, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.453', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.090', 'AMMO4': '0.097', 'AMMO3': '0.129', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon2': '0.506', 'WEAPON3': '0.750', 'weapon4': '1.026', 'weapon3': '2.208', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '10.464', 'FRAGCOUNT': '33.000'} [2023-02-24 20:58:55,772][213365] Updated weights for policy 0, policy_version 31176 (0.0009) [2023-02-24 20:58:55,805][213368] DAMAGECOUNT value on done: 281360.0 [2023-02-24 20:58:55,805][213368] Sum rewards: 47.445, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.450', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.024', 'AMMO4': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'weapon4': '0.392', 'weapon2': '0.434', 'WEAPON3': '1.050', 'HITCOUNT': '2.840', 'weapon3': '2.954', 'DAMAGECOUNT': '12.249', 'FRAGCOUNT': '41.000'} [2023-02-24 20:58:55,840][213384] DAMAGECOUNT value on done: 280894.0 [2023-02-24 20:58:55,841][213384] Sum rewards: 35.736, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.931', 'AMMO5': '0.018', 'AMMO2': '0.043', 'AMMO3': '0.166', 'weapon5': '0.166', 'AMMO4': '0.217', 'weapon2': '0.356', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.590', 'WEAPON3': '1.050', 'weapon3': '2.644', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '11.097', 'FRAGCOUNT': '32.000'} [2023-02-24 20:58:55,868][213382] DAMAGECOUNT value on done: 295064.0 [2023-02-24 20:58:55,869][213382] Sum rewards: 35.965, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.570', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.157', 'weapon5': '0.164', 'weapon2': '0.208', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '0.850', 'weapon4': '0.918', 'weapon3': '2.080', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '10.854', 'FRAGCOUNT': '31.000'} [2023-02-24 20:58:56,006][213384] DAMAGECOUNT value on done: 294159.0 [2023-02-24 20:58:56,006][213384] Sum rewards: 38.374, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.045', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO4': '0.161', 'weapon5': '0.192', 'AMMO3': '0.217', 'weapon4': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.542', 'WEAPON3': '1.300', 'HITCOUNT': '2.650', 'weapon3': '2.740', 'DAMAGECOUNT': '12.333', 'FRAGCOUNT': '36.000'} [2023-02-24 20:58:56,047][213369] DAMAGECOUNT value on done: 280492.0 [2023-02-24 20:58:56,047][213369] Sum rewards: 38.384, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.290', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.078', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'weapon4': '0.108', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'WEAPON3': '0.950', 'weapon2': '1.002', 'HITCOUNT': '2.310', 'weapon3': '2.710', 'DAMAGECOUNT': '10.209', 'FRAGCOUNT': '33.000'} [2023-02-24 20:58:56,289][213384] DAMAGECOUNT value on done: 294485.0 [2023-02-24 20:58:56,290][213384] Sum rewards: 47.403, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.565', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.106', 'AMMO4': '0.158', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.446', 'weapon2': '0.602', 'WEAPON3': '1.050', 'weapon3': '2.558', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.394', 'FRAGCOUNT': '40.000'} [2023-02-24 20:58:58,792][213365] Updated weights for policy 0, policy_version 31186 (0.0009) [2023-02-24 20:59:00,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 127754240. Throughput: 0: 3363.6. Samples: 6934858. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:59:00,243][213332] Avg episode reward: [(0, '40.473')] [2023-02-24 20:59:01,791][213365] Updated weights for policy 0, policy_version 31196 (0.0009) [2023-02-24 20:59:04,909][213365] Updated weights for policy 0, policy_version 31206 (0.0009) [2023-02-24 20:59:05,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 127823872. Throughput: 0: 3362.9. Samples: 6945056. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:59:05,243][213332] Avg episode reward: [(0, '40.473')] [2023-02-24 20:59:07,921][213365] Updated weights for policy 0, policy_version 31216 (0.0009) [2023-02-24 20:59:10,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 127889408. Throughput: 0: 3359.6. Samples: 6965014. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:59:10,243][213332] Avg episode reward: [(0, '40.473')] [2023-02-24 20:59:11,015][213365] Updated weights for policy 0, policy_version 31226 (0.0009) [2023-02-24 20:59:13,006][213367] DAMAGECOUNT value on done: 290015.0 [2023-02-24 20:59:13,007][213367] Sum rewards: 31.704, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.930', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'weapon2': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.256', 'weapon4': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '2.510', 'weapon3': '3.228', 'DAMAGECOUNT': '10.548', 'FRAGCOUNT': '32.000'} [2023-02-24 20:59:13,329][213367] DAMAGECOUNT value on done: 293442.0 [2023-02-24 20:59:13,330][213367] Sum rewards: 39.379, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.810', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.166', 'AMMO3': '0.197', 'weapon4': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.482', 'WEAPON3': '1.200', 'HITCOUNT': '2.250', 'weapon3': '2.850', 'DAMAGECOUNT': '10.395', 'FRAGCOUNT': '37.000'} [2023-02-24 20:59:13,530][213367] DAMAGECOUNT value on done: 298654.0 [2023-02-24 20:59:13,530][213367] Sum rewards: 36.877, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.750', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon5': '0.016', 'AMMO4': '0.026', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.190', 'AMMO3': '0.208', 'weapon2': '0.856', 'WEAPON3': '1.300', 'HITCOUNT': '2.460', 'weapon3': '2.676', 'DAMAGECOUNT': '10.134', 'FRAGCOUNT': '35.000'} [2023-02-24 20:59:13,739][213372] DAMAGECOUNT value on done: 297005.0 [2023-02-24 20:59:13,739][213372] Sum rewards: 40.058, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.447', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.029', 'weapon5': '0.056', 'AMMO3': '0.141', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.400', 'weapon4': '0.608', 'weapon2': '0.788', 'WEAPON3': '0.900', 'weapon3': '2.328', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '10.686', 'FRAGCOUNT': '35.000'} [2023-02-24 20:59:13,856][213367] DAMAGECOUNT value on done: 296038.0 [2023-02-24 20:59:13,857][213367] Sum rewards: 43.359, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.688', 'AMMO5': '0.013', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon4': '0.134', 'weapon5': '0.180', 'AMMO3': '0.207', 'weapon2': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '2.450', 'weapon3': '3.156', 'DAMAGECOUNT': '11.895', 'FRAGCOUNT': '40.000'} [2023-02-24 20:59:14,039][213372] DAMAGECOUNT value on done: 289555.0 [2023-02-24 20:59:14,039][213372] Sum rewards: 30.488, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.266', 'AMMO5': '0.017', 'AMMO2': '0.032', 'weapon5': '0.154', 'AMMO4': '0.162', 'weapon2': '0.206', 'AMMO3': '0.218', 'weapon4': '0.272', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.130', 'weapon3': '3.054', 'DAMAGECOUNT': '9.108', 'FRAGCOUNT': '31.000'} [2023-02-24 20:59:14,072][213372] DAMAGECOUNT value on done: 299938.0 [2023-02-24 20:59:14,072][213372] Sum rewards: 38.491, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.060', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.160', 'weapon5': '0.206', 'AMMO3': '0.210', 'AMMO4': '0.225', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.434', 'WEAPON3': '1.300', 'HITCOUNT': '2.670', 'weapon3': '2.992', 'DAMAGECOUNT': '12.099', 'FRAGCOUNT': '35.500'} [2023-02-24 20:59:14,099][213365] Updated weights for policy 0, policy_version 31236 (0.0009) [2023-02-24 20:59:14,204][213366] DAMAGECOUNT value on done: 289072.0 [2023-02-24 20:59:14,205][213366] Sum rewards: 47.342, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.984', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.200', 'AMMO3': '0.272', 'weapon4': '0.274', 'WEAPON3': '1.650', 'HITCOUNT': '2.690', 'weapon3': '3.042', 'DAMAGECOUNT': '13.041', 'FRAGCOUNT': '45.000'} [2023-02-24 20:59:14,377][213372] DAMAGECOUNT value on done: 290070.0 [2023-02-24 20:59:14,378][213372] Sum rewards: 49.238, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.595', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.130', 'weapon4': '0.148', 'weapon2': '0.190', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'HITCOUNT': '2.690', 'weapon3': '3.234', 'DAMAGECOUNT': '13.119', 'FRAGCOUNT': '44.000'} [2023-02-24 20:59:14,498][213383] DAMAGECOUNT value on done: 290838.0 [2023-02-24 20:59:14,498][213383] Sum rewards: 29.193, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.585', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon2': '0.188', 'AMMO3': '0.230', 'weapon5': '0.310', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.530', 'WEAPON3': '1.350', 'HITCOUNT': '2.400', 'weapon3': '2.558', 'DAMAGECOUNT': '10.329', 'FRAGCOUNT': '30.000'} [2023-02-24 20:59:14,507][213366] DAMAGECOUNT value on done: 299064.0 [2023-02-24 20:59:14,507][213366] Sum rewards: 38.017, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.781', 'AMMO5': '0.017', 'AMMO2': '0.045', 'AMMO3': '0.170', 'weapon5': '0.198', 'AMMO4': '0.227', 'weapon2': '0.312', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.508', 'WEAPON3': '1.000', 'HITCOUNT': '2.460', 'weapon3': '2.668', 'DAMAGECOUNT': '11.292', 'FRAGCOUNT': '35.000'} [2023-02-24 20:59:14,527][213366] DAMAGECOUNT value on done: 302307.0 [2023-02-24 20:59:14,527][213366] Sum rewards: 48.230, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.273', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.126', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'WEAPON4': '0.300', 'weapon2': '0.538', 'weapon4': '0.548', 'WEAPON3': '1.050', 'weapon3': '2.542', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.288', 'FRAGCOUNT': '43.000'} [2023-02-24 20:59:14,814][213383] DAMAGECOUNT value on done: 291932.0 [2023-02-24 20:59:14,814][213383] Sum rewards: 48.786, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.695', 'AMMO5': '0.008', 'AMMO2': '0.052', 'AMMO3': '0.157', 'weapon5': '0.176', 'WEAPON5': '0.200', 'AMMO4': '0.262', 'weapon2': '0.276', 'WEAPON4': '0.350', 'weapon4': '0.896', 'WEAPON3': '1.000', 'weapon3': '2.434', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.539', 'FRAGCOUNT': '41.000'} [2023-02-24 20:59:14,822][213366] DAMAGECOUNT value on done: 293954.0 [2023-02-24 20:59:14,823][213366] Sum rewards: 37.620, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.355', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon5': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.292', 'weapon4': '0.476', 'WEAPON3': '1.400', 'HITCOUNT': '2.330', 'weapon3': '2.840', 'DAMAGECOUNT': '9.753', 'FRAGCOUNT': '35.000'} [2023-02-24 20:59:14,994][213382] DAMAGECOUNT value on done: 293275.0 [2023-02-24 20:59:14,994][213368] DAMAGECOUNT value on done: 290645.0 [2023-02-24 20:59:14,994][213382] Sum rewards: 25.760, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.362', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon5': '0.142', 'AMMO4': '0.213', 'weapon2': '0.252', 'AMMO3': '0.267', 'WEAPON5': '0.350', 'weapon4': '0.356', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '2.210', 'weapon3': '2.918', 'DAMAGECOUNT': '10.104', 'FRAGCOUNT': '29.000'} [2023-02-24 20:59:14,994][213368] Sum rewards: 43.460, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.873', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.118', 'AMMO4': '0.161', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'weapon2': '0.298', 'WEAPON4': '0.300', 'weapon4': '0.496', 'WEAPON3': '1.050', 'HITCOUNT': '2.560', 'weapon3': '2.874', 'DAMAGECOUNT': '11.316', 'FRAGCOUNT': '39.000'} [2023-02-24 20:59:15,189][213369] DAMAGECOUNT value on done: 296915.0 [2023-02-24 20:59:15,190][213369] Sum rewards: 45.933, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.522', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.046', 'weapon5': '0.066', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'weapon2': '0.522', 'WEAPON3': '1.050', 'HITCOUNT': '3.100', 'weapon3': '3.190', 'DAMAGECOUNT': '13.551', 'FRAGCOUNT': '37.000'} [2023-02-24 20:59:15,243][213332] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13440.4). Total num frames: 127954944. Throughput: 0: 3357.8. Samples: 6985038. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 20:59:15,243][213332] Avg episode reward: [(0, '40.945')] [2023-02-24 20:59:15,246][213352] Saving new best policy, reward=40.945! [2023-02-24 20:59:15,296][213382] DAMAGECOUNT value on done: 294708.0 [2023-02-24 20:59:15,296][213382] Sum rewards: 37.663, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.392', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.134', 'AMMO4': '0.160', 'weapon2': '0.220', 'AMMO3': '0.225', 'weapon5': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.210', 'weapon3': '2.916', 'DAMAGECOUNT': '10.545', 'FRAGCOUNT': '37.000'} [2023-02-24 20:59:15,320][213368] DAMAGECOUNT value on done: 296346.0 [2023-02-24 20:59:15,320][213368] Sum rewards: 43.770, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.505', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.176', 'AMMO4': '0.206', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'weapon2': '0.348', 'WEAPON4': '0.500', 'weapon4': '0.720', 'WEAPON3': '1.300', 'weapon3': '2.464', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.599', 'FRAGCOUNT': '40.000'} [2023-02-24 20:59:15,416][213383] DAMAGECOUNT value on done: 293069.0 [2023-02-24 20:59:15,417][213383] Sum rewards: 48.024, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.592', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.126', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'WEAPON4': '0.300', 'weapon2': '0.316', 'weapon4': '0.320', 'WEAPON3': '1.200', 'HITCOUNT': '2.860', 'weapon3': '3.024', 'DAMAGECOUNT': '13.458', 'FRAGCOUNT': '42.500'} [2023-02-24 20:59:15,512][213369] DAMAGECOUNT value on done: 294123.0 [2023-02-24 20:59:15,513][213369] Sum rewards: 42.697, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.410', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.032', 'AMMO4': '0.160', 'AMMO3': '0.170', 'weapon5': '0.198', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.512', 'weapon2': '0.586', 'WEAPON3': '1.100', 'weapon3': '2.426', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '11.073', 'FRAGCOUNT': '39.000'} [2023-02-24 20:59:15,525][213368] DAMAGECOUNT value on done: 295895.0 [2023-02-24 20:59:15,526][213368] Sum rewards: 39.408, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.900', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.159', 'AMMO3': '0.161', 'weapon2': '0.418', 'WEAPON4': '0.450', 'WEAPON3': '0.900', 'weapon4': '0.938', 'weapon3': '2.002', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '10.539', 'FRAGCOUNT': '35.000'} [2023-02-24 20:59:15,632][213382] DAMAGECOUNT value on done: 286826.0 [2023-02-24 20:59:15,633][213382] Sum rewards: 36.326, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.224', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon5': '0.136', 'AMMO3': '0.155', 'AMMO4': '0.201', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.494', 'weapon4': '0.536', 'WEAPON3': '1.000', 'HITCOUNT': '2.190', 'weapon3': '2.562', 'DAMAGECOUNT': '9.468', 'FRAGCOUNT': '33.000'} [2023-02-24 20:59:15,646][213384] DAMAGECOUNT value on done: 298783.0 [2023-02-24 20:59:15,646][213384] Sum rewards: 41.901, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.827', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.136', 'AMMO4': '0.168', 'weapon4': '0.220', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.450', 'HITCOUNT': '2.810', 'weapon3': '3.014', 'DAMAGECOUNT': '12.522', 'FRAGCOUNT': '39.000'} [2023-02-24 20:59:15,713][213383] DAMAGECOUNT value on done: 287132.0 [2023-02-24 20:59:15,713][213383] Sum rewards: 44.470, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.051', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.010', 'WEAPON5': '0.100', 'AMMO3': '0.232', 'weapon2': '0.534', 'WEAPON3': '1.450', 'HITCOUNT': '2.610', 'weapon3': '3.240', 'DAMAGECOUNT': '11.847', 'FRAGCOUNT': '40.000'} [2023-02-24 20:59:15,809][213369] DAMAGECOUNT value on done: 299117.0 [2023-02-24 20:59:15,809][213369] Sum rewards: 23.042, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.794', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.048', 'weapon5': '0.128', 'AMMO4': '0.240', 'AMMO3': '0.268', 'WEAPON5': '0.400', 'weapon2': '0.428', 'weapon4': '0.542', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'HITCOUNT': '2.050', 'weapon3': '2.608', 'DAMAGECOUNT': '8.850', 'FRAGCOUNT': '27.000'} [2023-02-24 20:59:15,824][213368] DAMAGECOUNT value on done: 285701.0 [2023-02-24 20:59:15,825][213368] Sum rewards: 50.664, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.645', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.178', 'weapon4': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON3': '1.200', 'HITCOUNT': '2.940', 'weapon3': '3.152', 'DAMAGECOUNT': '13.023', 'FRAGCOUNT': '43.000'} [2023-02-24 20:59:15,931][213382] DAMAGECOUNT value on done: 299337.0 [2023-02-24 20:59:15,932][213382] Sum rewards: 44.274, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.355', 'AMMO5': '0.021', 'AMMO2': '0.044', 'AMMO3': '0.217', 'AMMO4': '0.218', 'weapon2': '0.242', 'weapon5': '0.364', 'WEAPON4': '0.550', 'weapon4': '0.580', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.304', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '12.819', 'FRAGCOUNT': '42.000'} [2023-02-24 20:59:15,949][213384] DAMAGECOUNT value on done: 284520.0 [2023-02-24 20:59:15,949][213384] Sum rewards: 39.000, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.725', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.162', 'WEAPON4': '0.200', 'weapon2': '0.230', 'AMMO3': '0.261', 'WEAPON5': '0.300', 'weapon4': '0.340', 'WEAPON3': '1.500', 'HITCOUNT': '2.370', 'weapon3': '2.894', 'DAMAGECOUNT': '10.878', 'FRAGCOUNT': '39.000'} [2023-02-24 20:59:16,069][213384] DAMAGECOUNT value on done: 298859.0 [2023-02-24 20:59:16,070][213384] Sum rewards: 48.325, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.658', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon5': '0.082', 'AMMO4': '0.128', 'weapon4': '0.138', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.260', 'WEAPON3': '1.350', 'HITCOUNT': '3.000', 'weapon3': '3.226', 'DAMAGECOUNT': '13.770', 'FRAGCOUNT': '43.000'} [2023-02-24 20:59:16,111][213369] DAMAGECOUNT value on done: 284025.0 [2023-02-24 20:59:16,112][213369] Sum rewards: 41.168, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.171', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon7': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.139', 'AMMO3': '0.144', 'weapon5': '0.180', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.410', 'weapon4': '0.568', 'WEAPON3': '1.000', 'weapon3': '2.366', 'HITCOUNT': '2.450', 'DAMAGECOUNT': '10.599', 'FRAGCOUNT': '37.000'} [2023-02-24 20:59:16,370][213384] DAMAGECOUNT value on done: 299104.0 [2023-02-24 20:59:16,370][213384] Sum rewards: 48.510, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.080', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon2': '0.140', 'weapon5': '0.154', 'AMMO3': '0.207', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.372', 'WEAPON3': '1.300', 'HITCOUNT': '2.930', 'weapon3': '3.012', 'DAMAGECOUNT': '13.857', 'FRAGCOUNT': '42.000'} [2023-02-24 20:59:17,096][213365] Updated weights for policy 0, policy_version 31246 (0.0009) [2023-02-24 20:59:20,152][213365] Updated weights for policy 0, policy_version 31256 (0.0009) [2023-02-24 20:59:20,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 128024576. Throughput: 0: 3356.0. Samples: 6995178. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:59:20,243][213332] Avg episode reward: [(0, '40.502')] [2023-02-24 20:59:23,165][213365] Updated weights for policy 0, policy_version 31266 (0.0009) [2023-02-24 20:59:23,758][213369] Large shaping reward 2.536 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.525, 175.0), ('HEALTH', -0.021, -7.0), ('weapon5', 0.002)] [2023-02-24 20:59:25,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 128090112. Throughput: 0: 3358.8. Samples: 7015410. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:59:25,243][213332] Avg episode reward: [(0, '40.502')] [2023-02-24 20:59:26,193][213365] Updated weights for policy 0, policy_version 31276 (0.0010) [2023-02-24 20:59:29,254][213365] Updated weights for policy 0, policy_version 31286 (0.0009) [2023-02-24 20:59:30,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 128159744. Throughput: 0: 3357.2. Samples: 7035480. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:59:30,243][213332] Avg episode reward: [(0, '40.502')] [2023-02-24 20:59:32,239][213365] Updated weights for policy 0, policy_version 31296 (0.0009) [2023-02-24 20:59:32,970][213367] DAMAGECOUNT value on done: 293682.0 [2023-02-24 20:59:32,970][213367] Sum rewards: 35.140, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.823', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.047', 'AMMO3': '0.195', 'weapon5': '0.206', 'AMMO4': '0.235', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON4': '0.550', 'weapon4': '0.674', 'WEAPON3': '1.150', 'weapon3': '2.502', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '11.001', 'FRAGCOUNT': '33.000'} [2023-02-24 20:59:33,286][213367] DAMAGECOUNT value on done: 296609.0 [2023-02-24 20:59:33,286][213367] Sum rewards: 33.594, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.805', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'weapon4': '0.624', 'weapon2': '0.632', 'WEAPON3': '0.950', 'HITCOUNT': '2.420', 'weapon3': '2.448', 'DAMAGECOUNT': '9.501', 'FRAGCOUNT': '30.000'} [2023-02-24 20:59:33,492][213367] DAMAGECOUNT value on done: 301033.0 [2023-02-24 20:59:33,492][213367] Sum rewards: 25.390, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.222', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon7': '0.048', 'weapon5': '0.056', 'AMMO3': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.207', 'weapon2': '0.340', 'WEAPON4': '0.400', 'ARMOR': '0.404', 'WEAPON3': '0.500', 'weapon4': '1.112', 'HITCOUNT': '1.700', 'weapon3': '1.866', 'DAMAGECOUNT': '7.137', 'FRAGCOUNT': '21.000'} [2023-02-24 20:59:33,617][213372] DAMAGECOUNT value on done: 300244.0 [2023-02-24 20:59:33,617][213372] Sum rewards: 35.889, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.748', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'AMMO4': '0.145', 'weapon2': '0.440', 'WEAPON4': '0.450', 'ARMOR': '0.465', 'WEAPON3': '0.800', 'weapon4': '1.196', 'weapon3': '2.052', 'HITCOUNT': '2.290', 'DAMAGECOUNT': '9.717', 'FRAGCOUNT': '31.000'} [2023-02-24 20:59:33,818][213367] DAMAGECOUNT value on done: 300177.0 [2023-02-24 20:59:33,818][213367] Sum rewards: 46.060, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.518', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon5': '0.174', 'AMMO4': '0.185', 'weapon2': '0.206', 'AMMO3': '0.221', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.434', 'WEAPON3': '1.400', 'HITCOUNT': '2.520', 'weapon3': '2.918', 'DAMAGECOUNT': '12.417', 'FRAGCOUNT': '44.000'} [2023-02-24 20:59:33,937][213372] DAMAGECOUNT value on done: 303806.0 [2023-02-24 20:59:33,937][213372] Sum rewards: 39.732, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.880', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'weapon4': '0.130', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'weapon2': '0.320', 'WEAPON3': '1.400', 'HITCOUNT': '2.700', 'weapon3': '3.272', 'DAMAGECOUNT': '11.604', 'FRAGCOUNT': '38.000'} [2023-02-24 20:59:33,987][213372] DAMAGECOUNT value on done: 292549.0 [2023-02-24 20:59:33,988][213372] Sum rewards: 29.616, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.534', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.055', 'AMMO3': '0.119', 'weapon5': '0.274', 'AMMO4': '0.276', 'weapon2': '0.442', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '0.650', 'weapon4': '1.242', 'weapon3': '1.704', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '8.982', 'FRAGCOUNT': '26.000'} [2023-02-24 20:59:34,154][213366] DAMAGECOUNT value on done: 292769.0 [2023-02-24 20:59:34,154][213366] Sum rewards: 41.816, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.924', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.098', 'AMMO4': '0.147', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.434', 'weapon4': '0.660', 'WEAPON3': '1.200', 'HITCOUNT': '2.370', 'weapon3': '2.406', 'DAMAGECOUNT': '11.091', 'FRAGCOUNT': '39.000'} [2023-02-24 20:59:34,297][213372] DAMAGECOUNT value on done: 293511.0 [2023-02-24 20:59:34,298][213372] Sum rewards: 35.269, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.342', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.044', 'AMMO3': '0.166', 'AMMO4': '0.217', 'weapon2': '0.306', 'weapon5': '0.356', 'weapon4': '0.360', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'HITCOUNT': '2.480', 'weapon3': '2.688', 'DAMAGECOUNT': '10.323', 'FRAGCOUNT': '33.000'} [2023-02-24 20:59:34,453][213366] DAMAGECOUNT value on done: 303259.0 [2023-02-24 20:59:34,453][213366] Sum rewards: 51.963, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.605', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.024', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'weapon4': '0.254', 'weapon2': '0.788', 'WEAPON3': '0.850', 'weapon3': '2.758', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '12.585', 'FRAGCOUNT': '43.000'} [2023-02-24 20:59:34,475][213366] DAMAGECOUNT value on done: 306050.0 [2023-02-24 20:59:34,475][213366] Sum rewards: 45.782, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.854', 'AMMO2': '0.007', 'AMMO5': '0.016', 'AMMO4': '0.035', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon5': '0.306', 'weapon4': '0.310', 'WEAPON5': '0.400', 'weapon2': '0.554', 'WEAPON3': '1.000', 'weapon3': '2.510', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '11.214', 'FRAGCOUNT': '38.000'} [2023-02-24 20:59:34,561][213383] DAMAGECOUNT value on done: 294930.0 [2023-02-24 20:59:34,562][213383] Sum rewards: 34.569, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.271', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.194', 'AMMO3': '0.215', 'AMMO4': '0.232', 'weapon2': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.550', 'weapon4': '0.602', 'WEAPON3': '1.350', 'HITCOUNT': '2.420', 'weapon3': '2.630', 'DAMAGECOUNT': '12.276', 'FRAGCOUNT': '34.000'} [2023-02-24 20:59:34,776][213366] DAMAGECOUNT value on done: 297900.0 [2023-02-24 20:59:34,777][213366] Sum rewards: 40.273, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.989', 'AMMO5': '0.022', 'AMMO2': '0.034', 'AMMO4': '0.168', 'weapon2': '0.186', 'AMMO3': '0.199', 'weapon5': '0.390', 'WEAPON4': '0.450', 'weapon4': '0.568', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'HITCOUNT': '2.240', 'weapon3': '2.516', 'DAMAGECOUNT': '11.838', 'FRAGCOUNT': '38.000'} [2023-02-24 20:59:34,872][213383] DAMAGECOUNT value on done: 295929.0 [2023-02-24 20:59:34,873][213383] Sum rewards: 44.269, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.550', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.068', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon4': '0.304', 'weapon2': '0.446', 'WEAPON3': '0.900', 'HITCOUNT': '2.580', 'weapon3': '3.000', 'DAMAGECOUNT': '11.691', 'FRAGCOUNT': '38.000'} [2023-02-24 20:59:34,975][213368] DAMAGECOUNT value on done: 293727.0 [2023-02-24 20:59:34,975][213368] Sum rewards: 37.480, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.377', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.038', 'weapon5': '0.054', 'AMMO3': '0.153', 'AMMO4': '0.191', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.458', 'WEAPON3': '0.900', 'weapon2': '0.900', 'HITCOUNT': '2.120', 'weapon3': '2.320', 'DAMAGECOUNT': '9.246', 'FRAGCOUNT': '33.000'} [2023-02-24 20:59:34,982][213382] DAMAGECOUNT value on done: 297907.0 [2023-02-24 20:59:34,983][213382] Sum rewards: 55.640, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.870', 'AMMO2': '0.013', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'AMMO3': '0.235', 'weapon2': '0.356', 'weapon4': '0.364', 'WEAPON3': '1.350', 'HITCOUNT': '3.050', 'weapon3': '3.080', 'DAMAGECOUNT': '13.896', 'FRAGCOUNT': '49.000'} [2023-02-24 20:59:35,158][213369] DAMAGECOUNT value on done: 300212.0 [2023-02-24 20:59:35,159][213369] Sum rewards: 30.494, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.255', 'AMMO5': '0.022', 'AMMO2': '0.027', 'weapon4': '0.124', 'AMMO4': '0.137', 'AMMO3': '0.170', 'weapon5': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.420', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'HITCOUNT': '2.020', 'weapon3': '2.904', 'DAMAGECOUNT': '9.891', 'FRAGCOUNT': '26.000'} [2023-02-24 20:59:35,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 128225280. Throughput: 0: 3358.7. Samples: 7045718. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 20:59:35,243][213332] Avg episode reward: [(0, '39.921')] [2023-02-24 20:59:35,273][213368] DAMAGECOUNT value on done: 300225.0 [2023-02-24 20:59:35,274][213368] Sum rewards: 35.467, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.392', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.162', 'AMMO3': '0.243', 'weapon2': '0.288', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.482', 'WEAPON3': '1.400', 'HITCOUNT': '2.580', 'weapon3': '2.770', 'DAMAGECOUNT': '11.637', 'FRAGCOUNT': '34.000'} [2023-02-24 20:59:35,283][213382] DAMAGECOUNT value on done: 298451.0 [2023-02-24 20:59:35,283][213382] Sum rewards: 40.930, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.220', 'AMMO5': '0.018', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.144', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.426', 'WEAPON3': '1.250', 'HITCOUNT': '2.450', 'weapon3': '2.792', 'DAMAGECOUNT': '11.229', 'FRAGCOUNT': '37.000'} [2023-02-24 20:59:35,342][213365] Updated weights for policy 0, policy_version 31306 (0.0009) [2023-02-24 20:59:35,457][213383] DAMAGECOUNT value on done: 297256.0 [2023-02-24 20:59:35,458][213383] Sum rewards: 46.841, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.170', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.078', 'AMMO4': '0.135', 'AMMO3': '0.168', 'weapon2': '0.224', 'WEAPON4': '0.250', 'weapon4': '0.526', 'WEAPON3': '1.000', 'HITCOUNT': '2.990', 'weapon3': '2.996', 'DAMAGECOUNT': '12.561', 'FRAGCOUNT': '39.000'} [2023-02-24 20:59:35,460][213369] DAMAGECOUNT value on done: 297861.0 [2023-02-24 20:59:35,460][213369] Sum rewards: 34.511, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.760', 'AMMO5': '0.021', 'AMMO2': '0.049', 'AMMO3': '0.106', 'AMMO4': '0.245', 'weapon5': '0.316', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.700', 'WEAPON3': '0.750', 'weapon4': '1.194', 'weapon3': '1.476', 'HITCOUNT': '2.450', 'DAMAGECOUNT': '11.214', 'FRAGCOUNT': '28.000'} [2023-02-24 20:59:35,483][213368] DAMAGECOUNT value on done: 299792.0 [2023-02-24 20:59:35,483][213368] Sum rewards: 35.396, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.188', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon5': '0.164', 'AMMO4': '0.165', 'weapon2': '0.220', 'AMMO3': '0.233', 'weapon4': '0.416', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.760', 'weapon3': '2.878', 'DAMAGECOUNT': '11.691', 'FRAGCOUNT': '34.000'} [2023-02-24 20:59:35,593][213382] DAMAGECOUNT value on done: 290426.0 [2023-02-24 20:59:35,593][213382] Sum rewards: 42.551, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.816', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.110', 'WEAPON5': '0.150', 'weapon4': '0.150', 'weapon2': '0.178', 'WEAPON4': '0.250', 'AMMO3': '0.289', 'WEAPON3': '1.600', 'HITCOUNT': '2.440', 'weapon3': '3.258', 'DAMAGECOUNT': '10.800', 'FRAGCOUNT': '43.000'} [2023-02-24 20:59:35,625][213384] DAMAGECOUNT value on done: 302703.0 [2023-02-24 20:59:35,625][213384] Sum rewards: 41.012, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.750', 'AMMO2': '0.009', 'AMMO5': '0.012', 'AMMO4': '0.045', 'weapon5': '0.078', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'WEAPON5': '0.300', 'weapon2': '0.358', 'weapon4': '0.442', 'WEAPON3': '1.400', 'HITCOUNT': '2.600', 'weapon3': '2.828', 'DAMAGECOUNT': '11.748', 'FRAGCOUNT': '37.500'} [2023-02-24 20:59:35,755][213369] DAMAGECOUNT value on done: 302699.0 [2023-02-24 20:59:35,756][213369] Sum rewards: 32.240, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.946', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.047', 'AMMO3': '0.208', 'AMMO4': '0.235', 'weapon5': '0.264', 'weapon2': '0.394', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.756', 'WEAPON3': '1.200', 'HITCOUNT': '2.170', 'weapon3': '2.240', 'DAMAGECOUNT': '10.746', 'FRAGCOUNT': '33.000'} [2023-02-24 20:59:35,767][213383] DAMAGECOUNT value on done: 291129.0 [2023-02-24 20:59:35,768][213383] Sum rewards: 41.833, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.070', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.122', 'weapon4': '0.138', 'AMMO3': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '1.026', 'WEAPON3': '1.250', 'weapon3': '2.474', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '11.991', 'FRAGCOUNT': '38.000'} [2023-02-24 20:59:35,785][213368] DAMAGECOUNT value on done: 289132.0 [2023-02-24 20:59:35,785][213368] Sum rewards: 42.833, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.100', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.146', 'weapon5': '0.184', 'WEAPON5': '0.200', 'WEAPON3': '0.900', 'weapon2': '1.170', 'HITCOUNT': '2.390', 'weapon3': '2.396', 'DAMAGECOUNT': '10.293', 'FRAGCOUNT': '36.000'} [2023-02-24 20:59:35,908][213382] DAMAGECOUNT value on done: 303319.0 [2023-02-24 20:59:35,908][213382] Sum rewards: 42.673, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.362', 'AMMO5': '0.005', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.132', 'WEAPON5': '0.150', 'weapon2': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon4': '0.318', 'WEAPON3': '1.350', 'HITCOUNT': '2.410', 'weapon3': '3.144', 'DAMAGECOUNT': '11.946', 'FRAGCOUNT': '39.000'} [2023-02-24 20:59:35,921][213384] DAMAGECOUNT value on done: 288775.0 [2023-02-24 20:59:35,921][213384] Sum rewards: 35.477, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.363', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon5': '0.150', 'AMMO4': '0.225', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'weapon2': '0.348', 'WEAPON4': '0.450', 'weapon4': '0.628', 'WEAPON3': '1.500', 'weapon3': '2.562', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '12.765', 'FRAGCOUNT': '34.000'} [2023-02-24 20:59:36,049][213384] DAMAGECOUNT value on done: 302475.0 [2023-02-24 20:59:36,049][213384] Sum rewards: 33.849, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.619', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.046', 'AMMO3': '0.191', 'weapon5': '0.212', 'AMMO4': '0.230', 'weapon2': '0.336', 'weapon4': '0.372', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.420', 'weapon3': '2.740', 'DAMAGECOUNT': '10.848', 'FRAGCOUNT': '31.000'} [2023-02-24 20:59:36,062][213369] DAMAGECOUNT value on done: 288475.0 [2023-02-24 20:59:36,063][213369] Sum rewards: 49.100, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.855', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.046', 'AMMO3': '0.117', 'AMMO4': '0.232', 'weapon5': '0.274', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.502', 'weapon2': '0.514', 'WEAPON3': '0.800', 'weapon3': '2.368', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '13.335', 'FRAGCOUNT': '41.000'} [2023-02-24 20:59:36,348][213384] DAMAGECOUNT value on done: 303306.0 [2023-02-24 20:59:36,348][213384] Sum rewards: 40.489, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.054', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO4': '0.176', 'AMMO3': '0.177', 'WEAPON4': '0.300', 'weapon2': '0.338', 'weapon5': '0.368', 'WEAPON5': '0.450', 'weapon4': '0.476', 'WEAPON3': '1.100', 'weapon3': '2.462', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.606', 'FRAGCOUNT': '34.000'} [2023-02-24 20:59:38,378][213365] Updated weights for policy 0, policy_version 31316 (0.0009) [2023-02-24 20:59:40,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 128294912. Throughput: 0: 3359.1. Samples: 7065866. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 20:59:40,243][213332] Avg episode reward: [(0, '39.505')] [2023-02-24 20:59:41,366][213365] Updated weights for policy 0, policy_version 31326 (0.0009) [2023-02-24 20:59:44,457][213365] Updated weights for policy 0, policy_version 31336 (0.0009) [2023-02-24 20:59:45,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 128360448. Throughput: 0: 3360.8. Samples: 7086094. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 20:59:45,243][213332] Avg episode reward: [(0, '39.505')] [2023-02-24 20:59:47,456][213365] Updated weights for policy 0, policy_version 31346 (0.0009) [2023-02-24 20:59:50,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13454.3). Total num frames: 128430080. Throughput: 0: 3362.3. Samples: 7096360. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 20:59:50,243][213332] Avg episode reward: [(0, '39.505')] [2023-02-24 20:59:50,505][213365] Updated weights for policy 0, policy_version 31356 (0.0009) [2023-02-24 20:59:52,830][213367] DAMAGECOUNT value on done: 298328.0 [2023-02-24 20:59:52,830][213367] Sum rewards: 47.769, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.479', 'ARMOR': '0.004', 'AMMO2': '0.013', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.063', 'weapon5': '0.166', 'WEAPON4': '0.200', 'weapon2': '0.232', 'AMMO3': '0.305', 'WEAPON5': '0.450', 'weapon4': '0.462', 'WEAPON3': '1.750', 'weapon3': '2.826', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.938', 'FRAGCOUNT': '45.000'} [2023-02-24 20:59:53,145][213367] DAMAGECOUNT value on done: 299486.0 [2023-02-24 20:59:53,146][213367] Sum rewards: 23.083, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.170', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.052', 'AMMO3': '0.202', 'AMMO4': '0.262', 'weapon5': '0.296', 'weapon2': '0.318', 'weapon4': '0.384', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'HITCOUNT': '2.050', 'weapon3': '2.680', 'DAMAGECOUNT': '8.631', 'FRAGCOUNT': '24.000'} [2023-02-24 20:59:53,349][213367] DAMAGECOUNT value on done: 304961.0 [2023-02-24 20:59:53,349][213367] Sum rewards: 45.930, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.346', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon4': '0.052', 'weapon5': '0.056', 'AMMO4': '0.133', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'weapon2': '0.328', 'WEAPON3': '0.850', 'HITCOUNT': '2.530', 'weapon3': '3.444', 'DAMAGECOUNT': '11.754', 'FRAGCOUNT': '38.000'} [2023-02-24 20:59:53,448][213372] DAMAGECOUNT value on done: 303387.0 [2023-02-24 20:59:53,448][213372] Sum rewards: 31.385, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.840', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.038', 'AMMO4': '0.191', 'AMMO3': '0.212', 'weapon2': '0.220', 'weapon5': '0.258', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.988', 'WEAPON3': '1.250', 'weapon3': '2.138', 'HITCOUNT': '2.270', 'DAMAGECOUNT': '9.429', 'FRAGCOUNT': '32.000'} [2023-02-24 20:59:53,568][213365] Updated weights for policy 0, policy_version 31366 (0.0009) [2023-02-24 20:59:53,658][213367] DAMAGECOUNT value on done: 303456.0 [2023-02-24 20:59:53,659][213367] Sum rewards: 41.523, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.225', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon4': '0.102', 'weapon5': '0.150', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.398', 'WEAPON3': '1.100', 'HITCOUNT': '2.360', 'weapon3': '3.136', 'DAMAGECOUNT': '9.837', 'FRAGCOUNT': '37.000'} [2023-02-24 20:59:53,772][213372] DAMAGECOUNT value on done: 307478.0 [2023-02-24 20:59:53,773][213372] Sum rewards: 38.862, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.598', 'ARMOR': '0.004', 'AMMO2': '0.019', 'AMMO5': '0.020', 'weapon4': '0.070', 'AMMO4': '0.096', 'weapon5': '0.116', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'WEAPON5': '0.450', 'weapon2': '0.588', 'WEAPON3': '1.350', 'HITCOUNT': '2.370', 'weapon3': '2.930', 'DAMAGECOUNT': '11.016', 'FRAGCOUNT': '37.000'} [2023-02-24 20:59:53,846][213372] DAMAGECOUNT value on done: 296964.0 [2023-02-24 20:59:53,847][213372] Sum rewards: 46.414, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.894', 'AMMO2': '0.010', 'AMMO5': '0.011', 'weapon4': '0.030', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'weapon2': '0.132', 'weapon5': '0.192', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '2.630', 'weapon3': '3.392', 'DAMAGECOUNT': '13.245', 'FRAGCOUNT': '40.000'} [2023-02-24 20:59:53,998][213366] DAMAGECOUNT value on done: 296361.0 [2023-02-24 20:59:53,999][213366] Sum rewards: 42.847, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.222', 'AMMO5': '0.015', 'AMMO2': '0.015', 'weapon4': '0.064', 'AMMO4': '0.076', 'weapon5': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.189', 'WEAPON5': '0.300', 'weapon2': '0.558', 'WEAPON3': '1.100', 'HITCOUNT': '2.520', 'weapon3': '3.024', 'DAMAGECOUNT': '10.776', 'FRAGCOUNT': '38.000'} [2023-02-24 20:59:54,169][213372] DAMAGECOUNT value on done: 296646.0 [2023-02-24 20:59:54,169][213372] Sum rewards: 30.960, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.250', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.100', 'AMMO4': '0.187', 'AMMO3': '0.189', 'weapon5': '0.314', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.752', 'WEAPON3': '1.100', 'HITCOUNT': '2.020', 'weapon3': '2.534', 'DAMAGECOUNT': '9.405', 'FRAGCOUNT': '30.000'} [2023-02-24 20:59:54,300][213366] DAMAGECOUNT value on done: 307364.0 [2023-02-24 20:59:54,300][213366] Sum rewards: 43.469, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.972', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO3': '0.124', 'AMMO4': '0.155', 'WEAPON4': '0.300', 'weapon5': '0.318', 'WEAPON5': '0.350', 'weapon4': '0.460', 'weapon2': '0.586', 'WEAPON3': '0.850', 'weapon3': '2.302', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '12.315', 'FRAGCOUNT': '34.000'} [2023-02-24 20:59:54,320][213366] DAMAGECOUNT value on done: 309950.0 [2023-02-24 20:59:54,321][213366] Sum rewards: 39.693, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.575', 'AMMO5': '0.007', 'AMMO2': '0.056', 'weapon5': '0.060', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'AMMO4': '0.278', 'weapon2': '0.442', 'WEAPON4': '0.550', 'WEAPON3': '1.000', 'weapon4': '1.158', 'weapon3': '1.946', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '11.700', 'FRAGCOUNT': '36.000'} [2023-02-24 20:59:54,544][213383] DAMAGECOUNT value on done: 297456.0 [2023-02-24 20:59:54,545][213383] Sum rewards: 28.616, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.458', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.048', 'AMMO3': '0.120', 'AMMO4': '0.242', 'weapon5': '0.246', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.596', 'WEAPON3': '0.750', 'weapon4': '0.770', 'HITCOUNT': '1.680', 'weapon3': '2.064', 'DAMAGECOUNT': '7.578', 'FRAGCOUNT': '27.000'} [2023-02-24 20:59:54,627][213366] DAMAGECOUNT value on done: 301720.0 [2023-02-24 20:59:54,628][213366] Sum rewards: 45.941, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.294', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.030', 'AMMO4': '0.121', 'AMMO3': '0.142', 'WEAPON5': '0.200', 'weapon2': '0.374', 'WEAPON4': '0.400', 'weapon4': '0.556', 'WEAPON3': '0.950', 'weapon3': '2.684', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '11.460', 'FRAGCOUNT': '39.000'} [2023-02-24 20:59:54,861][213383] DAMAGECOUNT value on done: 299849.0 [2023-02-24 20:59:54,862][213383] Sum rewards: 36.850, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.426', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.159', 'AMMO3': '0.200', 'weapon4': '0.330', 'WEAPON4': '0.400', 'weapon2': '0.574', 'WEAPON3': '1.150', 'HITCOUNT': '2.470', 'weapon3': '2.746', 'DAMAGECOUNT': '11.760', 'FRAGCOUNT': '34.000'} [2023-02-24 20:59:54,898][213368] DAMAGECOUNT value on done: 296842.0 [2023-02-24 20:59:54,898][213368] Sum rewards: 32.620, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.672', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.167', 'AMMO3': '0.175', 'WEAPON5': '0.400', 'weapon5': '0.404', 'weapon4': '0.406', 'WEAPON4': '0.500', 'weapon2': '0.512', 'WEAPON3': '1.050', 'HITCOUNT': '2.160', 'weapon3': '2.370', 'DAMAGECOUNT': '9.345', 'FRAGCOUNT': '33.000'} [2023-02-24 20:59:54,982][213382] DAMAGECOUNT value on done: 301608.0 [2023-02-24 20:59:54,982][213382] Sum rewards: 41.857, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.838', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'weapon2': '0.424', 'weapon4': '0.532', 'WEAPON3': '1.250', 'HITCOUNT': '2.390', 'weapon3': '2.496', 'DAMAGECOUNT': '11.103', 'FRAGCOUNT': '39.000'} [2023-02-24 20:59:55,031][213369] DAMAGECOUNT value on done: 304900.0 [2023-02-24 20:59:55,031][213369] Sum rewards: 51.553, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.220', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.040', 'AMMO4': '0.055', 'weapon5': '0.070', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'weapon2': '0.468', 'WEAPON3': '1.500', 'HITCOUNT': '2.850', 'weapon3': '3.176', 'DAMAGECOUNT': '14.064', 'FRAGCOUNT': '47.000'} [2023-02-24 20:59:55,202][213368] DAMAGECOUNT value on done: 304279.0 [2023-02-24 20:59:55,202][213368] Sum rewards: 47.868, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.315', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.092', 'AMMO3': '0.169', 'weapon5': '0.172', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON4': '0.300', 'weapon4': '0.376', 'WEAPON3': '1.150', 'HITCOUNT': '2.670', 'weapon3': '2.798', 'DAMAGECOUNT': '12.162', 'FRAGCOUNT': '42.000'} [2023-02-24 20:59:55,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 128495616. Throughput: 0: 3366.5. Samples: 7116506. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 20:59:55,243][213332] Avg episode reward: [(0, '40.021')] [2023-02-24 20:59:55,286][213382] DAMAGECOUNT value on done: 302483.0 [2023-02-24 20:59:55,286][213382] Sum rewards: 40.529, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.402', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.156', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon5': '0.282', 'WEAPON5': '0.300', 'weapon2': '0.490', 'weapon4': '0.492', 'WEAPON3': '1.100', 'weapon3': '2.308', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '12.096', 'FRAGCOUNT': '35.000'} [2023-02-24 20:59:55,341][213369] DAMAGECOUNT value on done: 301238.0 [2023-02-24 20:59:55,341][213369] Sum rewards: 26.867, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.620', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.194', 'AMMO3': '0.257', 'weapon2': '0.280', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.840', 'WEAPON3': '1.550', 'weapon3': '2.346', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '10.131', 'FRAGCOUNT': '28.000'} [2023-02-24 20:59:55,377][213383] DAMAGECOUNT value on done: 300935.0 [2023-02-24 20:59:55,377][213383] Sum rewards: 40.916, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.718', 'AMMO5': '0.012', 'AMMO2': '0.045', 'AMMO3': '0.135', 'weapon5': '0.164', 'AMMO4': '0.226', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.574', 'weapon2': '0.644', 'WEAPON3': '0.850', 'weapon3': '2.326', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '11.037', 'FRAGCOUNT': '35.000'} [2023-02-24 20:59:55,398][213368] DAMAGECOUNT value on done: 303241.0 [2023-02-24 20:59:55,398][213368] Sum rewards: 33.181, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.738', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.111', 'AMMO3': '0.141', 'WEAPON4': '0.300', 'weapon2': '0.384', 'ARMOR': '0.463', 'weapon4': '0.732', 'WEAPON3': '0.900', 'weapon3': '2.084', 'HITCOUNT': '2.330', 'DAMAGECOUNT': '10.347', 'FRAGCOUNT': '28.000'} [2023-02-24 20:59:55,583][213382] DAMAGECOUNT value on done: 294306.0 [2023-02-24 20:59:55,583][213382] Sum rewards: 39.694, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.186', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon5': '0.134', 'AMMO4': '0.157', 'weapon2': '0.200', 'AMMO3': '0.281', 'WEAPON5': '0.350', 'weapon4': '0.364', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'HITCOUNT': '2.610', 'weapon3': '2.984', 'DAMAGECOUNT': '11.640', 'FRAGCOUNT': '41.000'} [2023-02-24 20:59:55,604][213384] DAMAGECOUNT value on done: 306585.0 [2023-02-24 20:59:55,604][213384] Sum rewards: 47.893, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.979', 'AMMO5': '0.012', 'AMMO2': '0.012', 'AMMO4': '0.062', 'weapon5': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.118', 'AMMO3': '0.152', 'WEAPON5': '0.200', 'weapon2': '0.704', 'WEAPON3': '0.950', 'HITCOUNT': '2.460', 'weapon3': '2.858', 'DAMAGECOUNT': '11.646', 'FRAGCOUNT': '40.000'} [2023-02-24 20:59:55,643][213369] DAMAGECOUNT value on done: 306130.0 [2023-02-24 20:59:55,644][213369] Sum rewards: 37.521, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.046', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO2': '0.049', 'AMMO3': '0.182', 'weapon5': '0.228', 'AMMO4': '0.245', 'weapon4': '0.346', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.460', 'WEAPON3': '1.200', 'HITCOUNT': '2.470', 'weapon3': '2.644', 'DAMAGECOUNT': '10.293', 'FRAGCOUNT': '35.000'} [2023-02-24 20:59:55,685][213383] DAMAGECOUNT value on done: 294609.0 [2023-02-24 20:59:55,686][213383] Sum rewards: 35.856, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.600', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.092', 'weapon5': '0.096', 'AMMO3': '0.132', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.306', 'WEAPON3': '0.800', 'weapon2': '0.864', 'weapon3': '2.508', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '10.440', 'FRAGCOUNT': '28.000'} [2023-02-24 20:59:55,696][213368] DAMAGECOUNT value on done: 292715.0 [2023-02-24 20:59:55,696][213368] Sum rewards: 38.647, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.648', 'AMMO5': '0.019', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.245', 'weapon2': '0.276', 'weapon5': '0.336', 'WEAPON4': '0.350', 'weapon4': '0.428', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '2.280', 'weapon3': '2.578', 'DAMAGECOUNT': '10.749', 'FRAGCOUNT': '36.000'} [2023-02-24 20:59:55,887][213382] DAMAGECOUNT value on done: 307247.0 [2023-02-24 20:59:55,887][213382] Sum rewards: 36.921, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.435', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon5': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon2': '0.244', 'WEAPON4': '0.300', 'weapon4': '0.518', 'WEAPON3': '1.250', 'weapon3': '2.756', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '11.784', 'FRAGCOUNT': '33.000'} [2023-02-24 20:59:55,896][213384] DAMAGECOUNT value on done: 292096.0 [2023-02-24 20:59:55,896][213384] Sum rewards: 35.696, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.488', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.104', 'AMMO4': '0.116', 'weapon5': '0.160', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.530', 'WEAPON3': '0.950', 'HITCOUNT': '2.200', 'weapon3': '3.008', 'DAMAGECOUNT': '9.963', 'FRAGCOUNT': '30.500'} [2023-02-24 20:59:55,943][213369] DAMAGECOUNT value on done: 292037.0 [2023-02-24 20:59:55,944][213369] Sum rewards: 38.926, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.200', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.014', 'WEAPON1': '0.040', 'AMMO4': '0.068', 'weapon4': '0.072', 'weapon5': '0.142', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.538', 'WEAPON3': '1.150', 'HITCOUNT': '2.310', 'weapon3': '2.968', 'DAMAGECOUNT': '10.686', 'FRAGCOUNT': '36.000'} [2023-02-24 20:59:56,073][213384] DAMAGECOUNT value on done: 305920.0 [2023-02-24 20:59:56,074][213384] Sum rewards: 43.018, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.576', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.155', 'weapon5': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.436', 'weapon4': '0.656', 'WEAPON3': '0.950', 'weapon3': '2.368', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '10.335', 'FRAGCOUNT': '38.000'} [2023-02-24 20:59:56,281][213383] Large shaping reward 2.514 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.483, 161.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 20:59:56,367][213384] DAMAGECOUNT value on done: 306830.0 [2023-02-24 20:59:56,368][213384] Sum rewards: 41.257, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.140', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.076', 'AMMO3': '0.128', 'AMMO4': '0.195', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.388', 'weapon2': '0.500', 'WEAPON3': '0.800', 'HITCOUNT': '2.490', 'weapon3': '2.786', 'DAMAGECOUNT': '10.572', 'FRAGCOUNT': '35.000'} [2023-02-24 20:59:56,615][213365] Updated weights for policy 0, policy_version 31376 (0.0009) [2023-02-24 20:59:59,676][213365] Updated weights for policy 0, policy_version 31386 (0.0009) [2023-02-24 21:00:00,243][213332] Fps is (10 sec: 13107.3, 60 sec: 13448.6, 300 sec: 13440.4). Total num frames: 128561152. Throughput: 0: 3370.5. Samples: 7136712. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:00:00,243][213332] Avg episode reward: [(0, '39.756')] [2023-02-24 21:00:02,691][213365] Updated weights for policy 0, policy_version 31396 (0.0009) [2023-02-24 21:00:02,877][213384] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 21:00:05,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 128630784. Throughput: 0: 3372.1. Samples: 7146922. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:00:05,243][213332] Avg episode reward: [(0, '39.756')] [2023-02-24 21:00:05,726][213365] Updated weights for policy 0, policy_version 31406 (0.0009) [2023-02-24 21:00:08,759][213365] Updated weights for policy 0, policy_version 31416 (0.0008) [2023-02-24 21:00:10,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13440.4). Total num frames: 128696320. Throughput: 0: 3371.7. Samples: 7167136. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:00:10,243][213332] Avg episode reward: [(0, '39.756')] [2023-02-24 21:00:10,886][213382] Large shaping reward -2.548 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('weapon5', 0.002)] [2023-02-24 21:00:11,744][213365] Updated weights for policy 0, policy_version 31426 (0.0009) [2023-02-24 21:00:12,713][213367] DAMAGECOUNT value on done: 301846.0 [2023-02-24 21:00:12,713][213367] Sum rewards: 33.836, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.918', 'AMMO5': '0.020', 'AMMO2': '0.038', 'AMMO4': '0.187', 'AMMO3': '0.215', 'weapon2': '0.300', 'weapon5': '0.322', 'weapon4': '0.496', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'HITCOUNT': '2.070', 'weapon3': '2.502', 'DAMAGECOUNT': '10.554', 'FRAGCOUNT': '31.000'} [2023-02-24 21:00:13,031][213367] DAMAGECOUNT value on done: 303285.0 [2023-02-24 21:00:13,032][213367] Sum rewards: 41.405, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.866', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'weapon5': '0.126', 'AMMO4': '0.161', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'weapon4': '0.296', 'WEAPON4': '0.350', 'weapon2': '0.446', 'WEAPON3': '1.100', 'HITCOUNT': '2.540', 'weapon3': '2.910', 'DAMAGECOUNT': '11.397', 'FRAGCOUNT': '37.000'} [2023-02-24 21:00:13,223][213367] DAMAGECOUNT value on done: 309017.0 [2023-02-24 21:00:13,223][213367] Sum rewards: 45.351, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.685', 'AMMO5': '0.003', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'weapon5': '0.130', 'AMMO3': '0.147', 'weapon2': '0.186', 'WEAPON4': '0.300', 'weapon4': '0.516', 'WEAPON3': '0.950', 'HITCOUNT': '2.760', 'weapon3': '2.922', 'DAMAGECOUNT': '12.168', 'FRAGCOUNT': '38.000'} [2023-02-24 21:00:13,366][213372] DAMAGECOUNT value on done: 306685.0 [2023-02-24 21:00:13,366][213372] Sum rewards: 30.903, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.794', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon4': '0.078', 'weapon5': '0.094', 'AMMO4': '0.112', 'WEAPON4': '0.200', 'weapon2': '0.240', 'WEAPON5': '0.250', 'AMMO3': '0.294', 'WEAPON3': '1.750', 'HITCOUNT': '2.250', 'weapon3': '3.246', 'DAMAGECOUNT': '9.894', 'FRAGCOUNT': '32.000'} [2023-02-24 21:00:13,534][213367] DAMAGECOUNT value on done: 307029.0 [2023-02-24 21:00:13,535][213367] Sum rewards: 40.160, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.728', 'AMMO2': '0.007', 'AMMO5': '0.021', 'AMMO4': '0.035', 'weapon5': '0.070', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'weapon2': '0.330', 'weapon4': '0.406', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.350', 'weapon3': '2.918', 'DAMAGECOUNT': '10.719', 'FRAGCOUNT': '36.000'} [2023-02-24 21:00:13,679][213372] DAMAGECOUNT value on done: 312021.0 [2023-02-24 21:00:13,680][213372] Sum rewards: 48.270, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.260', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.038', 'weapon5': '0.088', 'AMMO4': '0.192', 'WEAPON5': '0.200', 'weapon2': '0.202', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'weapon4': '0.502', 'WEAPON3': '1.300', 'HITCOUNT': '2.890', 'weapon3': '2.966', 'DAMAGECOUNT': '13.629', 'FRAGCOUNT': '43.000'} [2023-02-24 21:00:13,748][213372] DAMAGECOUNT value on done: 301424.0 [2023-02-24 21:00:13,749][213372] Sum rewards: 49.690, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.006', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon5': '0.068', 'AMMO4': '0.122', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'WEAPON4': '0.350', 'weapon2': '0.392', 'weapon4': '0.452', 'WEAPON3': '1.250', 'weapon3': '2.756', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.960', 'FRAGCOUNT': '45.000'} [2023-02-24 21:00:13,876][213366] DAMAGECOUNT value on done: 299629.0 [2023-02-24 21:00:13,876][213366] Sum rewards: 32.971, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.425', 'AMMO2': '0.012', 'AMMO5': '0.027', 'WEAPON1': '0.050', 'AMMO4': '0.060', 'weapon4': '0.116', 'WEAPON4': '0.150', 'weapon5': '0.206', 'AMMO3': '0.259', 'weapon2': '0.406', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'HITCOUNT': '2.030', 'weapon3': '2.726', 'DAMAGECOUNT': '9.804', 'FRAGCOUNT': '32.500'} [2023-02-24 21:00:14,065][213372] DAMAGECOUNT value on done: 299451.0 [2023-02-24 21:00:14,065][213372] Sum rewards: 22.918, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.870', 'AMMO5': '0.020', 'AMMO2': '0.023', 'WEAPON1': '0.050', 'weapon5': '0.088', 'AMMO4': '0.113', 'weapon4': '0.148', 'WEAPON4': '0.200', 'AMMO3': '0.289', 'weapon2': '0.308', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'HITCOUNT': '2.030', 'weapon3': '3.054', 'DAMAGECOUNT': '8.415', 'FRAGCOUNT': '27.000'} [2023-02-24 21:00:14,194][213366] DAMAGECOUNT value on done: 313737.0 [2023-02-24 21:00:14,195][213366] Sum rewards: 39.822, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.086', 'AMMO5': '0.022', 'AMMO2': '0.035', 'WEAPON1': '0.060', 'weapon5': '0.176', 'AMMO4': '0.176', 'weapon2': '0.208', 'AMMO3': '0.220', 'WEAPON4': '0.350', 'WEAPON5': '0.550', 'weapon4': '0.630', 'WEAPON3': '1.250', 'HITCOUNT': '2.300', 'weapon3': '2.584', 'DAMAGECOUNT': '11.346', 'FRAGCOUNT': '37.000'} [2023-02-24 21:00:14,213][213366] DAMAGECOUNT value on done: 310622.0 [2023-02-24 21:00:14,213][213366] Sum rewards: 32.234, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.640', 'AMMO2': '0.015', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.074', 'weapon5': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon2': '0.264', 'weapon4': '0.344', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.350', 'weapon3': '2.778', 'DAMAGECOUNT': '9.744', 'FRAGCOUNT': '30.500'} [2023-02-24 21:00:14,522][213366] DAMAGECOUNT value on done: 305922.0 [2023-02-24 21:00:14,522][213366] Sum rewards: 44.625, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.742', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.171', 'weapon5': '0.216', 'weapon4': '0.264', 'WEAPON4': '0.350', 'weapon2': '0.414', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.570', 'weapon3': '2.768', 'DAMAGECOUNT': '12.606', 'FRAGCOUNT': '38.000'} [2023-02-24 21:00:14,527][213383] DAMAGECOUNT value on done: 300955.0 [2023-02-24 21:00:14,528][213383] Sum rewards: 38.173, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.846', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon7': '0.064', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.146', 'AMMO4': '0.189', 'WEAPON7': '0.200', 'weapon5': '0.206', 'WEAPON5': '0.400', 'WEAPON4': '0.700', 'weapon2': '0.774', 'weapon4': '0.880', 'WEAPON3': '0.950', 'weapon3': '1.834', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '10.497', 'FRAGCOUNT': '36.000'} [2023-02-24 21:00:14,595][213369] Large shaping reward -2.522 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.273, -91.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 21:00:14,837][213382] DAMAGECOUNT value on done: 306266.0 [2023-02-24 21:00:14,837][213382] Sum rewards: 49.889, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.174', 'AMMO5': '0.010', 'AMMO2': '0.048', 'AMMO3': '0.192', 'weapon5': '0.194', 'AMMO4': '0.239', 'weapon2': '0.250', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.414', 'WEAPON3': '1.200', 'weapon3': '2.742', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.974', 'FRAGCOUNT': '42.000'} [2023-02-24 21:00:14,840][213368] DAMAGECOUNT value on done: 300939.0 [2023-02-24 21:00:14,840][213368] Sum rewards: 47.837, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.300', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.023', 'weapon5': '0.108', 'AMMO4': '0.114', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon4': '0.224', 'WEAPON5': '0.400', 'weapon2': '0.652', 'WEAPON3': '1.050', 'weapon3': '2.778', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.291', 'FRAGCOUNT': '41.000'} [2023-02-24 21:00:14,848][213383] DAMAGECOUNT value on done: 302834.0 [2023-02-24 21:00:14,849][213383] Sum rewards: 30.668, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.376', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.040', 'AMMO2': '0.046', 'weapon7': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'AMMO4': '0.230', 'WEAPON4': '0.500', 'WEAPON3': '0.650', 'weapon2': '0.884', 'weapon4': '1.080', 'weapon3': '1.608', 'HITCOUNT': '2.180', 'DAMAGECOUNT': '8.955', 'FRAGCOUNT': '27.000'} [2023-02-24 21:00:14,879][213365] Updated weights for policy 0, policy_version 31436 (0.0009) [2023-02-24 21:00:14,990][213369] DAMAGECOUNT value on done: 308618.0 [2023-02-24 21:00:14,990][213369] Sum rewards: 44.062, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.200', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'AMMO3': '0.126', 'AMMO4': '0.170', 'weapon4': '0.294', 'WEAPON4': '0.300', 'weapon5': '0.326', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'weapon2': '0.754', 'weapon3': '2.316', 'HITCOUNT': '2.450', 'DAMAGECOUNT': '11.154', 'FRAGCOUNT': '36.500'} [2023-02-24 21:00:15,144][213368] DAMAGECOUNT value on done: 308129.0 [2023-02-24 21:00:15,144][213382] DAMAGECOUNT value on done: 307381.0 [2023-02-24 21:00:15,145][213368] Sum rewards: 38.633, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.240', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.052', 'AMMO3': '0.175', 'weapon5': '0.220', 'AMMO4': '0.262', 'weapon2': '0.376', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.676', 'WEAPON3': '0.950', 'HITCOUNT': '2.260', 'weapon3': '2.372', 'DAMAGECOUNT': '11.550', 'FRAGCOUNT': '35.000'} [2023-02-24 21:00:15,145][213382] Sum rewards: 57.738, reward structure: {'DEATHCOUNT': '-12.000', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'weapon4': '0.262', 'HEALTH': '0.470', 'weapon2': '0.474', 'WEAPON3': '0.900', 'weapon3': '2.952', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.694', 'FRAGCOUNT': '46.000'} [2023-02-24 21:00:15,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13454.3). Total num frames: 128765952. Throughput: 0: 3372.7. Samples: 7187250. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:00:15,243][213332] Avg episode reward: [(0, '40.002')] [2023-02-24 21:00:15,306][213369] DAMAGECOUNT value on done: 305317.0 [2023-02-24 21:00:15,306][213369] Sum rewards: 38.774, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.440', 'AMMO2': '0.009', 'AMMO5': '0.020', 'AMMO4': '0.046', 'weapon5': '0.146', 'weapon2': '0.148', 'AMMO3': '0.224', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon4': '0.740', 'WEAPON3': '1.400', 'weapon3': '2.624', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.237', 'FRAGCOUNT': '36.000'} [2023-02-24 21:00:15,342][213383] DAMAGECOUNT value on done: 304690.0 [2023-02-24 21:00:15,343][213383] Sum rewards: 39.614, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.584', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.035', 'AMMO4': '0.175', 'AMMO3': '0.198', 'weapon2': '0.242', 'weapon5': '0.298', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.272', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '11.265', 'FRAGCOUNT': '37.000'} [2023-02-24 21:00:15,349][213368] DAMAGECOUNT value on done: 306608.0 [2023-02-24 21:00:15,349][213368] Sum rewards: 36.047, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.167', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'weapon5': '0.054', 'AMMO4': '0.071', 'WEAPON5': '0.150', 'weapon4': '0.182', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'weapon2': '0.752', 'WEAPON3': '1.400', 'HITCOUNT': '2.560', 'weapon3': '2.674', 'DAMAGECOUNT': '10.101', 'FRAGCOUNT': '35.000'} [2023-02-24 21:00:15,466][213382] DAMAGECOUNT value on done: 297522.0 [2023-02-24 21:00:15,466][213382] Sum rewards: 36.626, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.570', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.082', 'AMMO3': '0.187', 'weapon5': '0.192', 'weapon2': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.460', 'WEAPON3': '1.100', 'HITCOUNT': '2.280', 'weapon3': '2.722', 'DAMAGECOUNT': '9.648', 'FRAGCOUNT': '31.000'} [2023-02-24 21:00:15,514][213384] DAMAGECOUNT value on done: 310345.0 [2023-02-24 21:00:15,515][213384] Sum rewards: 39.836, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.902', 'AMMO2': '0.019', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO4': '0.095', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.150', 'WEAPON7': '0.200', 'weapon2': '0.246', 'WEAPON4': '0.250', 'weapon5': '0.374', 'weapon4': '0.420', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'HITCOUNT': '1.980', 'weapon3': '2.246', 'DAMAGECOUNT': '10.680', 'FRAGCOUNT': '33.000'} [2023-02-24 21:00:15,611][213369] DAMAGECOUNT value on done: 309574.0 [2023-02-24 21:00:15,612][213369] Sum rewards: 34.913, reward structure: {'DEATHCOUNT': '-12.000', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'HEALTH': '0.021', 'AMMO2': '0.030', 'AMMO3': '0.134', 'AMMO4': '0.151', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.294', 'weapon4': '0.400', 'weapon2': '0.760', 'WEAPON3': '0.800', 'weapon3': '2.224', 'HITCOUNT': '2.240', 'DAMAGECOUNT': '10.332', 'FRAGCOUNT': '29.000'} [2023-02-24 21:00:15,643][213383] DAMAGECOUNT value on done: 298167.0 [2023-02-24 21:00:15,644][213383] Sum rewards: 37.753, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.230', 'WEAPON1': '0.010', 'AMMO5': '0.030', 'AMMO2': '0.047', 'AMMO3': '0.195', 'AMMO4': '0.233', 'weapon5': '0.372', 'weapon4': '0.448', 'WEAPON4': '0.550', 'weapon2': '0.614', 'WEAPON5': '0.800', 'WEAPON3': '1.100', 'weapon3': '2.110', 'HITCOUNT': '2.300', 'DAMAGECOUNT': '10.674', 'FRAGCOUNT': '37.000'} [2023-02-24 21:00:15,646][213368] DAMAGECOUNT value on done: 297232.0 [2023-02-24 21:00:15,647][213368] Sum rewards: 48.375, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.120', 'WEAPON1': '0.020', 'AMMO5': '0.036', 'AMMO2': '0.038', 'AMMO3': '0.184', 'AMMO4': '0.189', 'weapon5': '0.288', 'WEAPON4': '0.400', 'weapon4': '0.410', 'weapon2': '0.476', 'WEAPON5': '0.800', 'WEAPON3': '1.150', 'weapon3': '2.442', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.551', 'FRAGCOUNT': '42.000'} [2023-02-24 21:00:15,758][213382] DAMAGECOUNT value on done: 309833.0 [2023-02-24 21:00:15,758][213382] Sum rewards: 26.650, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.362', 'AMMO5': '0.016', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'weapon5': '0.214', 'weapon4': '0.334', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon2': '0.612', 'WEAPON3': '0.950', 'HITCOUNT': '1.560', 'weapon3': '2.042', 'DAMAGECOUNT': '7.758', 'FRAGCOUNT': '23.500'} [2023-02-24 21:00:15,815][213384] DAMAGECOUNT value on done: 295353.0 [2023-02-24 21:00:15,816][213384] Sum rewards: 37.329, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.630', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon7': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.136', 'weapon5': '0.180', 'WEAPON7': '0.200', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.352', 'weapon4': '0.428', 'WEAPON3': '1.200', 'HITCOUNT': '2.080', 'weapon3': '2.502', 'DAMAGECOUNT': '9.771', 'FRAGCOUNT': '33.000'} [2023-02-24 21:00:15,906][213369] DAMAGECOUNT value on done: 295925.0 [2023-02-24 21:00:15,906][213369] Sum rewards: 39.131, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.160', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.059', 'AMMO3': '0.212', 'weapon5': '0.250', 'AMMO4': '0.297', 'weapon4': '0.386', 'WEAPON5': '0.400', 'weapon2': '0.434', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.290', 'weapon3': '2.506', 'DAMAGECOUNT': '11.634', 'FRAGCOUNT': '37.500'} [2023-02-24 21:00:16,001][213384] DAMAGECOUNT value on done: 309780.0 [2023-02-24 21:00:16,002][213384] Sum rewards: 41.643, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.440', 'WEAPON1': '0.010', 'AMMO5': '0.028', 'AMMO2': '0.051', 'AMMO3': '0.203', 'weapon5': '0.242', 'AMMO4': '0.256', 'weapon2': '0.354', 'weapon4': '0.420', 'WEAPON4': '0.550', 'WEAPON5': '0.700', 'WEAPON3': '1.350', 'HITCOUNT': '2.530', 'weapon3': '2.558', 'DAMAGECOUNT': '11.580', 'FRAGCOUNT': '41.000'} [2023-02-24 21:00:16,309][213384] DAMAGECOUNT value on done: 310822.0 [2023-02-24 21:00:16,310][213384] Sum rewards: 42.810, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.670', 'ARMOR': '0.004', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.049', 'AMMO3': '0.138', 'AMMO4': '0.247', 'weapon5': '0.278', 'WEAPON5': '0.400', 'weapon2': '0.448', 'WEAPON4': '0.500', 'weapon4': '0.566', 'WEAPON3': '0.850', 'weapon3': '2.314', 'HITCOUNT': '2.450', 'DAMAGECOUNT': '11.952', 'FRAGCOUNT': '38.000'} [2023-02-24 21:00:17,876][213365] Updated weights for policy 0, policy_version 31446 (0.0009) [2023-02-24 21:00:20,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 128831488. Throughput: 0: 3371.8. Samples: 7197450. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:00:20,243][213332] Avg episode reward: [(0, '39.580')] [2023-02-24 21:00:20,891][213365] Updated weights for policy 0, policy_version 31456 (0.0009) [2023-02-24 21:00:23,950][213365] Updated weights for policy 0, policy_version 31466 (0.0009) [2023-02-24 21:00:25,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13454.3). Total num frames: 128901120. Throughput: 0: 3376.2. Samples: 7217796. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 21:00:25,243][213332] Avg episode reward: [(0, '39.580')] [2023-02-24 21:00:26,934][213365] Updated weights for policy 0, policy_version 31476 (0.0009) [2023-02-24 21:00:30,023][213365] Updated weights for policy 0, policy_version 31486 (0.0010) [2023-02-24 21:00:30,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 128966656. Throughput: 0: 3374.6. Samples: 7237952. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 21:00:30,243][213332] Avg episode reward: [(0, '39.580')] [2023-02-24 21:00:32,016][213384] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 21:00:32,581][213367] DAMAGECOUNT value on done: 305217.0 [2023-02-24 21:00:32,581][213367] Sum rewards: 38.102, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.642', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.186', 'AMMO3': '0.196', 'weapon4': '0.342', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.376', 'WEAPON3': '1.200', 'HITCOUNT': '2.110', 'weapon3': '2.830', 'DAMAGECOUNT': '10.113', 'FRAGCOUNT': '36.000'} [2023-02-24 21:00:32,892][213367] DAMAGECOUNT value on done: 307247.0 [2023-02-24 21:00:32,892][213367] Sum rewards: 43.995, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.188', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.023', 'AMMO4': '0.117', 'AMMO3': '0.147', 'weapon5': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.552', 'weapon4': '0.560', 'WEAPON3': '0.850', 'weapon3': '2.346', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '11.886', 'FRAGCOUNT': '37.000'} [2023-02-24 21:00:33,035][213365] Updated weights for policy 0, policy_version 31496 (0.0009) [2023-02-24 21:00:33,127][213367] DAMAGECOUNT value on done: 312596.0 [2023-02-24 21:00:33,127][213367] Sum rewards: 34.256, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.106', 'AMMO5': '0.016', 'AMMO2': '0.037', 'weapon5': '0.172', 'weapon4': '0.180', 'AMMO3': '0.185', 'AMMO4': '0.186', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.888', 'WEAPON3': '1.000', 'HITCOUNT': '2.200', 'weapon3': '2.516', 'DAMAGECOUNT': '10.731', 'FRAGCOUNT': '30.000'} [2023-02-24 21:00:33,287][213372] DAMAGECOUNT value on done: 310604.0 [2023-02-24 21:00:33,288][213372] Sum rewards: 46.525, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.756', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.039', 'weapon5': '0.136', 'AMMO3': '0.152', 'AMMO4': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.358', 'weapon4': '0.522', 'WEAPON3': '0.850', 'HITCOUNT': '2.620', 'weapon3': '2.714', 'DAMAGECOUNT': '11.757', 'FRAGCOUNT': '40.000'} [2023-02-24 21:00:33,438][213367] DAMAGECOUNT value on done: 310265.0 [2023-02-24 21:00:33,439][213367] Sum rewards: 31.606, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.260', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.054', 'weapon5': '0.208', 'AMMO3': '0.225', 'AMMO4': '0.272', 'weapon4': '0.328', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.566', 'WEAPON3': '1.300', 'HITCOUNT': '2.220', 'weapon3': '2.366', 'DAMAGECOUNT': '9.708', 'FRAGCOUNT': '33.000'} [2023-02-24 21:00:33,620][213372] DAMAGECOUNT value on done: 315405.0 [2023-02-24 21:00:33,620][213372] Sum rewards: 42.009, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.359', 'AMMO5': '0.003', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.029', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.130', 'AMMO3': '0.177', 'weapon4': '0.210', 'weapon2': '0.432', 'WEAPON3': '1.150', 'HITCOUNT': '2.360', 'weapon3': '3.010', 'DAMAGECOUNT': '10.152', 'FRAGCOUNT': '37.000'} [2023-02-24 21:00:33,701][213372] DAMAGECOUNT value on done: 305734.0 [2023-02-24 21:00:33,702][213372] Sum rewards: 47.785, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.460', 'AMMO5': '0.015', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.144', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'weapon4': '0.306', 'WEAPON5': '0.350', 'weapon2': '0.410', 'WEAPON3': '1.100', 'HITCOUNT': '2.820', 'weapon3': '2.890', 'DAMAGECOUNT': '12.930', 'FRAGCOUNT': '42.000'} [2023-02-24 21:00:33,855][213366] DAMAGECOUNT value on done: 303186.0 [2023-02-24 21:00:33,856][213366] Sum rewards: 38.331, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.960', 'AMMO5': '0.016', 'AMMO2': '0.035', 'AMMO4': '0.177', 'weapon2': '0.208', 'AMMO3': '0.219', 'weapon5': '0.220', 'WEAPON4': '0.400', 'weapon4': '0.422', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.330', 'weapon3': '2.792', 'DAMAGECOUNT': '10.671', 'FRAGCOUNT': '37.000'} [2023-02-24 21:00:34,033][213372] DAMAGECOUNT value on done: 303222.0 [2023-02-24 21:00:34,033][213372] Sum rewards: 42.531, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.259', 'AMMO5': '0.024', 'AMMO2': '0.053', 'AMMO3': '0.195', 'AMMO4': '0.266', 'weapon4': '0.276', 'weapon5': '0.314', 'weapon2': '0.514', 'WEAPON5': '0.550', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'HITCOUNT': '2.090', 'weapon3': '2.544', 'DAMAGECOUNT': '11.313', 'FRAGCOUNT': '39.000'} [2023-02-24 21:00:34,170][213366] DAMAGECOUNT value on done: 313961.0 [2023-02-24 21:00:34,170][213366] Sum rewards: 40.544, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.276', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.088', 'AMMO4': '0.096', 'AMMO3': '0.150', 'weapon2': '0.194', 'WEAPON4': '0.250', 'ARMOR': '0.459', 'weapon4': '0.702', 'WEAPON3': '1.000', 'HITCOUNT': '2.390', 'weapon3': '2.652', 'DAMAGECOUNT': '10.017', 'FRAGCOUNT': '36.000'} [2023-02-24 21:00:34,181][213366] DAMAGECOUNT value on done: 317909.0 [2023-02-24 21:00:34,182][213366] Sum rewards: 36.785, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.294', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.036', 'weapon5': '0.102', 'AMMO4': '0.182', 'AMMO3': '0.230', 'weapon2': '0.332', 'weapon4': '0.336', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.900', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.516', 'FRAGCOUNT': '34.500'} [2023-02-24 21:00:34,497][213366] DAMAGECOUNT value on done: 310121.0 [2023-02-24 21:00:34,497][213366] Sum rewards: 45.509, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.550', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.030', 'AMMO4': '0.151', 'AMMO3': '0.188', 'weapon5': '0.216', 'WEAPON4': '0.250', 'weapon4': '0.276', 'weapon2': '0.284', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.810', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.597', 'FRAGCOUNT': '38.500'} [2023-02-24 21:00:34,543][213383] DAMAGECOUNT value on done: 305377.0 [2023-02-24 21:00:34,543][213383] Sum rewards: 57.087, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.642', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.137', 'weapon5': '0.150', 'AMMO3': '0.162', 'weapon4': '0.162', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.100', 'HITCOUNT': '2.930', 'weapon3': '3.030', 'DAMAGECOUNT': '13.266', 'FRAGCOUNT': '49.500'} [2023-02-24 21:00:34,771][213382] DAMAGECOUNT value on done: 310377.0 [2023-02-24 21:00:34,771][213382] Sum rewards: 46.021, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.517', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.025', 'AMMO4': '0.127', 'AMMO3': '0.201', 'weapon2': '0.210', 'weapon5': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.632', 'WEAPON3': '1.200', 'weapon3': '2.584', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.333', 'FRAGCOUNT': '42.000'} [2023-02-24 21:00:34,806][213368] DAMAGECOUNT value on done: 305311.0 [2023-02-24 21:00:34,806][213368] Sum rewards: 45.245, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.592', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO4': '0.031', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.260', 'weapon2': '0.556', 'WEAPON3': '1.550', 'HITCOUNT': '2.860', 'weapon3': '3.188', 'DAMAGECOUNT': '13.116', 'FRAGCOUNT': '41.000'} [2023-02-24 21:00:34,862][213383] DAMAGECOUNT value on done: 307047.0 [2023-02-24 21:00:34,862][213383] Sum rewards: 47.244, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.901', 'AMMO5': '0.018', 'AMMO2': '0.033', 'AMMO4': '0.164', 'AMMO3': '0.198', 'weapon5': '0.208', 'weapon2': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.386', 'WEAPON3': '1.250', 'HITCOUNT': '2.720', 'weapon3': '2.822', 'DAMAGECOUNT': '12.639', 'FRAGCOUNT': '41.500'} [2023-02-24 21:00:34,930][213369] DAMAGECOUNT value on done: 312524.0 [2023-02-24 21:00:34,931][213369] Sum rewards: 42.038, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.120', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.038', 'AMMO3': '0.109', 'weapon5': '0.166', 'AMMO4': '0.190', 'WEAPON5': '0.400', 'weapon4': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '0.750', 'weapon2': '0.782', 'weapon3': '2.304', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '11.718', 'FRAGCOUNT': '34.000'} [2023-02-24 21:00:35,073][213382] DAMAGECOUNT value on done: 311301.0 [2023-02-24 21:00:35,074][213382] Sum rewards: 46.088, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.762', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon5': '0.080', 'AMMO4': '0.141', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.400', 'weapon4': '0.476', 'WEAPON3': '1.200', 'weapon3': '2.816', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '11.760', 'FRAGCOUNT': '41.500'} [2023-02-24 21:00:35,112][213368] DAMAGECOUNT value on done: 312849.0 [2023-02-24 21:00:35,112][213368] Sum rewards: 43.663, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.440', 'AMMO5': '0.014', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.241', 'WEAPON5': '0.350', 'weapon4': '0.360', 'weapon2': '0.474', 'WEAPON3': '1.450', 'weapon3': '2.704', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.115', 'FRAGCOUNT': '39.000'} [2023-02-24 21:00:35,230][213369] DAMAGECOUNT value on done: 309045.0 [2023-02-24 21:00:35,230][213369] Sum rewards: 43.457, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.918', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.144', 'AMMO4': '0.152', 'AMMO3': '0.172', 'WEAPON5': '0.300', 'weapon4': '0.382', 'WEAPON4': '0.400', 'weapon2': '0.662', 'WEAPON3': '1.100', 'HITCOUNT': '2.360', 'weapon3': '2.472', 'DAMAGECOUNT': '11.184', 'FRAGCOUNT': '38.000'} [2023-02-24 21:00:35,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13468.2). Total num frames: 129036288. Throughput: 0: 3373.6. Samples: 7248172. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 21:00:35,243][213332] Avg episode reward: [(0, '40.074')] [2023-02-24 21:00:35,317][213368] DAMAGECOUNT value on done: 309737.0 [2023-02-24 21:00:35,317][213368] Sum rewards: 24.840, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.424', 'AMMO5': '0.020', 'AMMO2': '0.039', 'AMMO4': '0.197', 'weapon5': '0.246', 'AMMO3': '0.253', 'weapon2': '0.440', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon4': '0.586', 'WEAPON3': '1.400', 'weapon3': '2.386', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '9.387', 'FRAGCOUNT': '27.000'} [2023-02-24 21:00:35,379][213382] DAMAGECOUNT value on done: 301832.0 [2023-02-24 21:00:35,379][213382] Sum rewards: 43.595, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.988', 'AMMO5': '0.014', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.209', 'weapon5': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.424', 'weapon4': '0.458', 'WEAPON3': '1.250', 'HITCOUNT': '2.510', 'weapon3': '2.556', 'DAMAGECOUNT': '12.402', 'FRAGCOUNT': '39.000'} [2023-02-24 21:00:35,380][213383] DAMAGECOUNT value on done: 308324.0 [2023-02-24 21:00:35,381][213383] Sum rewards: 39.045, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.488', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon5': '0.036', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'WEAPON4': '0.350', 'weapon2': '0.366', 'weapon4': '0.896', 'WEAPON3': '1.250', 'weapon3': '2.506', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '10.902', 'FRAGCOUNT': '37.000'} [2023-02-24 21:00:35,429][213384] DAMAGECOUNT value on done: 313960.0 [2023-02-24 21:00:35,429][213384] Sum rewards: 42.379, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.298', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.037', 'weapon5': '0.040', 'AMMO3': '0.156', 'AMMO4': '0.183', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.418', 'weapon2': '0.462', 'WEAPON3': '0.900', 'HITCOUNT': '2.760', 'weapon3': '2.806', 'DAMAGECOUNT': '10.845', 'FRAGCOUNT': '37.000'} [2023-02-24 21:00:35,522][213369] DAMAGECOUNT value on done: 312618.0 [2023-02-24 21:00:35,523][213369] Sum rewards: 26.085, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.920', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon4': '0.078', 'AMMO4': '0.120', 'AMMO3': '0.165', 'weapon5': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.694', 'WEAPON3': '1.100', 'HITCOUNT': '1.810', 'weapon3': '2.688', 'DAMAGECOUNT': '9.132', 'FRAGCOUNT': '25.000'} [2023-02-24 21:00:35,620][213368] DAMAGECOUNT value on done: 300634.0 [2023-02-24 21:00:35,620][213368] Sum rewards: 34.739, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.410', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.144', 'weapon5': '0.172', 'AMMO4': '0.174', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.484', 'WEAPON3': '1.250', 'HITCOUNT': '2.480', 'weapon3': '2.942', 'DAMAGECOUNT': '10.206', 'FRAGCOUNT': '32.000'} [2023-02-24 21:00:35,677][213382] DAMAGECOUNT value on done: 313400.0 [2023-02-24 21:00:35,677][213383] DAMAGECOUNT value on done: 303339.0 [2023-02-24 21:00:35,677][213382] Sum rewards: 40.552, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.867', 'AMMO5': '0.013', 'AMMO2': '0.014', 'weapon5': '0.052', 'AMMO4': '0.068', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'WEAPON5': '0.250', 'weapon4': '0.294', 'WEAPON3': '0.950', 'weapon2': '0.990', 'weapon3': '2.506', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '10.701', 'FRAGCOUNT': '34.000'} [2023-02-24 21:00:35,677][213383] Sum rewards: 55.175, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.898', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.102', 'WEAPON5': '0.150', 'weapon2': '0.210', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'weapon4': '0.514', 'WEAPON3': '1.250', 'weapon3': '2.768', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.516', 'FRAGCOUNT': '48.000'} [2023-02-24 21:00:35,739][213384] DAMAGECOUNT value on done: 299260.0 [2023-02-24 21:00:35,739][213384] Sum rewards: 41.993, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.394', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.037', 'weapon5': '0.142', 'AMMO4': '0.184', 'AMMO3': '0.197', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.384', 'weapon4': '0.522', 'WEAPON3': '1.250', 'HITCOUNT': '2.570', 'weapon3': '2.660', 'DAMAGECOUNT': '11.721', 'FRAGCOUNT': '39.000'} [2023-02-24 21:00:35,822][213369] DAMAGECOUNT value on done: 299979.0 [2023-02-24 21:00:35,823][213369] Sum rewards: 45.253, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.450', 'AMMO5': '0.020', 'AMMO2': '0.030', 'AMMO4': '0.152', 'AMMO3': '0.199', 'weapon5': '0.200', 'weapon4': '0.328', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.520', 'weapon3': '2.772', 'DAMAGECOUNT': '12.162', 'FRAGCOUNT': '40.000'} [2023-02-24 21:00:35,960][213384] DAMAGECOUNT value on done: 313488.0 [2023-02-24 21:00:35,961][213384] Sum rewards: 33.678, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.574', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.152', 'AMMO4': '0.170', 'AMMO3': '0.171', 'WEAPON5': '0.250', 'weapon2': '0.376', 'WEAPON4': '0.450', 'weapon4': '0.654', 'WEAPON3': '1.100', 'HITCOUNT': '2.460', 'weapon3': '2.548', 'DAMAGECOUNT': '11.124', 'FRAGCOUNT': '31.000'} [2023-02-24 21:00:36,161][213365] Updated weights for policy 0, policy_version 31506 (0.0009) [2023-02-24 21:00:36,260][213384] DAMAGECOUNT value on done: 314840.0 [2023-02-24 21:00:36,261][213384] Sum rewards: 37.221, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.490', 'AMMO2': '0.014', 'weapon4': '0.016', 'AMMO5': '0.017', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'weapon5': '0.170', 'AMMO3': '0.191', 'WEAPON5': '0.400', 'weapon2': '1.040', 'WEAPON3': '1.150', 'HITCOUNT': '2.470', 'weapon3': '2.522', 'DAMAGECOUNT': '12.054', 'FRAGCOUNT': '32.000'} [2023-02-24 21:00:39,205][213365] Updated weights for policy 0, policy_version 31516 (0.0009) [2023-02-24 21:00:39,716][213368] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 21:00:40,243][213332] Fps is (10 sec: 13516.6, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 129101824. Throughput: 0: 3369.1. Samples: 7268116. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 21:00:40,243][213332] Avg episode reward: [(0, '40.051')] [2023-02-24 21:00:42,185][213365] Updated weights for policy 0, policy_version 31526 (0.0009) [2023-02-24 21:00:45,243][213332] Fps is (10 sec: 13107.2, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 129167360. Throughput: 0: 3369.6. Samples: 7288346. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:00:45,243][213332] Avg episode reward: [(0, '40.051')] [2023-02-24 21:00:45,254][213352] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000031536_129171456.pth... [2023-02-24 21:00:45,256][213365] Updated weights for policy 0, policy_version 31536 (0.0009) [2023-02-24 21:00:45,312][213352] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000030748_125943808.pth [2023-02-24 21:00:48,297][213365] Updated weights for policy 0, policy_version 31546 (0.0009) [2023-02-24 21:00:50,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 129236992. Throughput: 0: 3369.9. Samples: 7298568. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:00:50,244][213332] Avg episode reward: [(0, '40.051')] [2023-02-24 21:00:51,315][213365] Updated weights for policy 0, policy_version 31556 (0.0009) [2023-02-24 21:00:52,571][213367] DAMAGECOUNT value on done: 309075.0 [2023-02-24 21:00:52,572][213367] Sum rewards: 39.918, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.580', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.059', 'AMMO3': '0.189', 'weapon5': '0.190', 'weapon2': '0.242', 'AMMO4': '0.294', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.758', 'WEAPON3': '1.100', 'weapon3': '2.512', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '11.574', 'FRAGCOUNT': '37.000'} [2023-02-24 21:00:52,884][213367] DAMAGECOUNT value on done: 311161.0 [2023-02-24 21:00:52,884][213367] Sum rewards: 40.294, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.680', 'AMMO5': '0.020', 'AMMO2': '0.027', 'AMMO4': '0.137', 'weapon4': '0.178', 'weapon5': '0.252', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.290', 'weapon3': '2.820', 'DAMAGECOUNT': '11.742', 'FRAGCOUNT': '39.000'} [2023-02-24 21:00:53,080][213367] DAMAGECOUNT value on done: 315013.0 [2023-02-24 21:00:53,081][213367] Sum rewards: 27.611, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.246', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon7': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.111', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'weapon2': '0.660', 'weapon4': '0.726', 'WEAPON3': '0.950', 'HITCOUNT': '1.620', 'weapon3': '2.000', 'DAMAGECOUNT': '7.251', 'FRAGCOUNT': '25.000'} [2023-02-24 21:00:53,300][213372] DAMAGECOUNT value on done: 314325.0 [2023-02-24 21:00:53,300][213372] Sum rewards: 38.981, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.171', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.046', 'weapon4': '0.176', 'AMMO3': '0.190', 'weapon2': '0.192', 'AMMO4': '0.230', 'weapon5': '0.258', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '1.050', 'HITCOUNT': '2.430', 'weapon3': '2.940', 'DAMAGECOUNT': '11.163', 'FRAGCOUNT': '35.500'} [2023-02-24 21:00:53,387][213367] DAMAGECOUNT value on done: 314463.0 [2023-02-24 21:00:53,388][213367] Sum rewards: 45.009, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.078', 'AMMO2': '0.013', 'AMMO5': '0.014', 'AMMO4': '0.067', 'weapon4': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.209', 'weapon5': '0.268', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.350', 'HITCOUNT': '2.480', 'weapon3': '2.976', 'DAMAGECOUNT': '12.594', 'FRAGCOUNT': '39.000'} [2023-02-24 21:00:53,618][213372] DAMAGECOUNT value on done: 318757.0 [2023-02-24 21:00:53,618][213372] Sum rewards: 26.053, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.812', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.057', 'AMMO3': '0.224', 'weapon4': '0.272', 'AMMO4': '0.284', 'weapon2': '0.318', 'weapon5': '0.364', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '1.980', 'weapon3': '2.738', 'DAMAGECOUNT': '10.056', 'FRAGCOUNT': '27.500'} [2023-02-24 21:00:53,689][213372] DAMAGECOUNT value on done: 310225.0 [2023-02-24 21:00:53,690][213372] Sum rewards: 43.153, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.516', 'AMMO5': '0.012', 'AMMO2': '0.044', 'AMMO3': '0.173', 'weapon5': '0.210', 'AMMO4': '0.220', 'WEAPON5': '0.250', 'weapon2': '0.308', 'WEAPON4': '0.450', 'weapon4': '0.602', 'WEAPON3': '1.050', 'weapon3': '2.576', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.473', 'FRAGCOUNT': '38.000'} [2023-02-24 21:00:53,862][213366] DAMAGECOUNT value on done: 307716.0 [2023-02-24 21:00:53,863][213366] Sum rewards: 46.515, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.190', 'AMMO5': '0.029', 'AMMO2': '0.064', 'AMMO3': '0.195', 'weapon2': '0.234', 'AMMO4': '0.318', 'weapon5': '0.322', 'weapon4': '0.596', 'WEAPON5': '0.700', 'WEAPON4': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.346', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '13.590', 'FRAGCOUNT': '41.500'} [2023-02-24 21:00:54,002][213372] DAMAGECOUNT value on done: 306548.0 [2023-02-24 21:00:54,003][213372] Sum rewards: 39.408, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.442', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.052', 'AMMO3': '0.126', 'AMMO4': '0.261', 'weapon5': '0.312', 'weapon2': '0.348', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.746', 'WEAPON3': '0.750', 'weapon3': '2.176', 'HITCOUNT': '2.350', 'DAMAGECOUNT': '9.951', 'FRAGCOUNT': '34.000'} [2023-02-24 21:00:54,174][213366] DAMAGECOUNT value on done: 317546.0 [2023-02-24 21:00:54,175][213366] Sum rewards: 36.553, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.968', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.140', 'WEAPON4': '0.200', 'AMMO3': '0.265', 'weapon4': '0.272', 'WEAPON5': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.550', 'HITCOUNT': '2.370', 'weapon3': '2.972', 'DAMAGECOUNT': '10.755', 'FRAGCOUNT': '36.000'} [2023-02-24 21:00:54,185][213366] DAMAGECOUNT value on done: 321765.0 [2023-02-24 21:00:54,186][213366] Sum rewards: 43.227, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.594', 'AMMO2': '0.009', 'AMMO5': '0.012', 'AMMO4': '0.047', 'weapon5': '0.052', 'WEAPON4': '0.200', 'AMMO3': '0.232', 'weapon4': '0.238', 'WEAPON5': '0.300', 'weapon2': '0.618', 'WEAPON3': '1.450', 'HITCOUNT': '2.730', 'weapon3': '2.864', 'DAMAGECOUNT': '11.568', 'FRAGCOUNT': '40.000'} [2023-02-24 21:00:54,406][213365] Updated weights for policy 0, policy_version 31566 (0.0009) [2023-02-24 21:00:54,477][213383] DAMAGECOUNT value on done: 309376.0 [2023-02-24 21:00:54,478][213383] Sum rewards: 48.773, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.976', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.133', 'weapon2': '0.214', 'weapon4': '0.220', 'WEAPON5': '0.250', 'weapon5': '0.288', 'WEAPON4': '0.300', 'WEAPON3': '0.850', 'HITCOUNT': '2.550', 'weapon3': '3.044', 'DAMAGECOUNT': '11.997', 'FRAGCOUNT': '41.000'} [2023-02-24 21:00:54,509][213366] DAMAGECOUNT value on done: 313868.0 [2023-02-24 21:00:54,509][213366] Sum rewards: 35.894, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.622', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon5': '0.086', 'AMMO3': '0.185', 'AMMO4': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.592', 'weapon2': '0.612', 'WEAPON3': '1.000', 'weapon3': '2.342', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '11.172', 'FRAGCOUNT': '32.000'} [2023-02-24 21:00:54,746][213382] DAMAGECOUNT value on done: 314139.0 [2023-02-24 21:00:54,746][213382] Sum rewards: 38.671, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.280', 'WEAPON1': '0.010', 'AMMO5': '0.023', 'AMMO2': '0.035', 'weapon7': '0.070', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.173', 'AMMO3': '0.185', 'weapon5': '0.220', 'WEAPON4': '0.300', 'weapon2': '0.374', 'WEAPON5': '0.500', 'weapon4': '0.592', 'WEAPON3': '1.100', 'weapon3': '2.352', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '11.286', 'FRAGCOUNT': '33.500'} [2023-02-24 21:00:54,789][213383] DAMAGECOUNT value on done: 311355.0 [2023-02-24 21:00:54,789][213383] Sum rewards: 48.367, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.724', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'WEAPON4': '0.150', 'weapon4': '0.174', 'weapon2': '0.208', 'AMMO3': '0.313', 'WEAPON3': '1.750', 'HITCOUNT': '2.820', 'weapon3': '3.356', 'DAMAGECOUNT': '12.924', 'FRAGCOUNT': '47.000'} [2023-02-24 21:00:54,794][213368] DAMAGECOUNT value on done: 308838.0 [2023-02-24 21:00:54,794][213368] Sum rewards: 36.280, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.122', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.214', 'weapon4': '0.268', 'weapon2': '0.680', 'WEAPON3': '1.200', 'HITCOUNT': '2.270', 'weapon3': '2.670', 'DAMAGECOUNT': '10.581', 'FRAGCOUNT': '34.000'} [2023-02-24 21:00:54,896][213369] DAMAGECOUNT value on done: 316079.0 [2023-02-24 21:00:54,897][213369] Sum rewards: 42.237, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.338', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon5': '0.074', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'weapon2': '0.288', 'weapon4': '0.804', 'WEAPON3': '1.100', 'weapon3': '2.208', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '10.665', 'FRAGCOUNT': '37.000'} [2023-02-24 21:00:55,052][213382] DAMAGECOUNT value on done: 314643.0 [2023-02-24 21:00:55,053][213382] Sum rewards: 40.839, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.241', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon5': '0.126', 'AMMO3': '0.184', 'AMMO4': '0.248', 'WEAPON5': '0.300', 'weapon4': '0.400', 'WEAPON4': '0.450', 'weapon2': '1.008', 'WEAPON3': '1.100', 'weapon3': '2.164', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '10.026', 'FRAGCOUNT': '38.000'} [2023-02-24 21:00:55,098][213368] DAMAGECOUNT value on done: 316826.0 [2023-02-24 21:00:55,098][213368] Sum rewards: 39.041, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.185', 'ARMOR': '0.004', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO2': '0.041', 'WEAPON5': '0.150', 'AMMO4': '0.206', 'AMMO3': '0.254', 'weapon2': '0.294', 'WEAPON4': '0.550', 'weapon4': '0.916', 'WEAPON3': '1.450', 'weapon3': '2.434', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '11.931', 'FRAGCOUNT': '38.000'} [2023-02-24 21:00:55,196][213369] DAMAGECOUNT value on done: 312211.0 [2023-02-24 21:00:55,196][213369] Sum rewards: 34.508, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.356', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.019', 'weapon5': '0.022', 'AMMO4': '0.093', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon4': '0.406', 'weapon2': '0.492', 'WEAPON3': '1.250', 'HITCOUNT': '2.270', 'weapon3': '2.626', 'DAMAGECOUNT': '9.498', 'FRAGCOUNT': '33.000'} [2023-02-24 21:00:55,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 129302528. Throughput: 0: 3367.5. Samples: 7318676. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:00:55,243][213332] Avg episode reward: [(0, '40.197')] [2023-02-24 21:00:55,289][213368] DAMAGECOUNT value on done: 313521.0 [2023-02-24 21:00:55,290][213368] Sum rewards: 43.294, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.321', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.118', 'weapon5': '0.140', 'AMMO4': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.518', 'weapon4': '0.518', 'WEAPON3': '0.750', 'HITCOUNT': '2.560', 'weapon3': '2.568', 'DAMAGECOUNT': '11.352', 'FRAGCOUNT': '35.000'} [2023-02-24 21:00:55,347][213382] DAMAGECOUNT value on done: 305750.0 [2023-02-24 21:00:55,348][213382] Sum rewards: 42.606, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.470', 'AMMO2': '0.005', 'AMMO5': '0.014', 'AMMO4': '0.022', 'weapon5': '0.048', 'WEAPON4': '0.050', 'weapon4': '0.078', 'AMMO3': '0.239', 'weapon2': '0.242', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '2.690', 'weapon3': '3.384', 'DAMAGECOUNT': '11.754', 'FRAGCOUNT': '39.000'} [2023-02-24 21:00:55,350][213383] DAMAGECOUNT value on done: 311897.0 [2023-02-24 21:00:55,350][213383] Sum rewards: 42.927, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.322', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.036', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'weapon5': '0.170', 'weapon2': '0.176', 'weapon4': '0.190', 'WEAPON5': '0.250', 'WEAPON3': '0.950', 'HITCOUNT': '2.440', 'weapon3': '3.232', 'DAMAGECOUNT': '10.719', 'FRAGCOUNT': '36.000'} [2023-02-24 21:00:55,365][213384] DAMAGECOUNT value on done: 317305.0 [2023-02-24 21:00:55,365][213384] Sum rewards: 28.876, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.334', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.065', 'weapon5': '0.108', 'AMMO3': '0.198', 'WEAPON5': '0.250', 'weapon2': '0.284', 'AMMO4': '0.324', 'WEAPON4': '0.650', 'weapon4': '0.788', 'WEAPON3': '1.150', 'HITCOUNT': '2.380', 'weapon3': '2.508', 'DAMAGECOUNT': '9.735', 'FRAGCOUNT': '30.000'} [2023-02-24 21:00:55,499][213369] DAMAGECOUNT value on done: 315752.0 [2023-02-24 21:00:55,500][213369] Sum rewards: 33.892, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.410', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.029', 'weapon5': '0.134', 'AMMO4': '0.142', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'weapon2': '0.242', 'WEAPON4': '0.550', 'WEAPON3': '0.900', 'weapon4': '1.024', 'weapon3': '2.204', 'HITCOUNT': '2.300', 'DAMAGECOUNT': '9.402', 'FRAGCOUNT': '32.000'} [2023-02-24 21:00:55,604][213368] DAMAGECOUNT value on done: 305111.0 [2023-02-24 21:00:55,604][213368] Sum rewards: 50.409, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.172', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon2': '0.204', 'AMMO3': '0.211', 'weapon5': '0.214', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.592', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '13.266', 'FRAGCOUNT': '45.000'} [2023-02-24 21:00:55,652][213382] DAMAGECOUNT value on done: 317421.0 [2023-02-24 21:00:55,652][213382] Sum rewards: 48.379, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.297', 'ARMOR': '0.004', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'AMMO4': '0.132', 'AMMO3': '0.163', 'weapon5': '0.184', 'weapon2': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.642', 'WEAPON3': '1.000', 'weapon3': '2.634', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.063', 'FRAGCOUNT': '42.000'} [2023-02-24 21:00:55,659][213383] DAMAGECOUNT value on done: 306805.0 [2023-02-24 21:00:55,660][213383] Sum rewards: 30.342, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.900', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.130', 'AMMO3': '0.287', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.412', 'WEAPON3': '1.650', 'HITCOUNT': '2.400', 'weapon3': '2.764', 'DAMAGECOUNT': '10.398', 'FRAGCOUNT': '29.000'} [2023-02-24 21:00:55,664][213384] DAMAGECOUNT value on done: 302376.0 [2023-02-24 21:00:55,665][213384] Sum rewards: 33.316, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.475', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon5': '0.102', 'AMMO3': '0.145', 'AMMO4': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.456', 'weapon4': '0.636', 'WEAPON3': '0.850', 'HITCOUNT': '2.330', 'weapon3': '2.448', 'DAMAGECOUNT': '9.348', 'FRAGCOUNT': '30.000'} [2023-02-24 21:00:55,803][213369] DAMAGECOUNT value on done: 303496.0 [2023-02-24 21:00:55,804][213369] Sum rewards: 28.838, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.716', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.032', 'AMMO2': '0.079', 'AMMO3': '0.171', 'weapon4': '0.318', 'weapon2': '0.356', 'weapon5': '0.378', 'AMMO4': '0.395', 'WEAPON4': '0.700', 'WEAPON5': '0.800', 'WEAPON3': '1.100', 'HITCOUNT': '1.910', 'weapon3': '2.500', 'DAMAGECOUNT': '10.551', 'FRAGCOUNT': '29.500'} [2023-02-24 21:00:55,930][213384] DAMAGECOUNT value on done: 316697.0 [2023-02-24 21:00:55,931][213384] Sum rewards: 37.655, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.435', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon5': '0.132', 'AMMO3': '0.136', 'weapon4': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.536', 'WEAPON3': '0.800', 'HITCOUNT': '2.120', 'weapon3': '2.940', 'DAMAGECOUNT': '9.627', 'FRAGCOUNT': '31.500'} [2023-02-24 21:00:56,228][213384] DAMAGECOUNT value on done: 318045.0 [2023-02-24 21:00:56,229][213384] Sum rewards: 33.041, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.366', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'weapon4': '0.328', 'ARMOR': '0.400', 'weapon2': '0.528', 'WEAPON3': '1.400', 'HITCOUNT': '2.020', 'weapon3': '2.796', 'DAMAGECOUNT': '9.615', 'FRAGCOUNT': '32.000'} [2023-02-24 21:00:57,425][213365] Updated weights for policy 0, policy_version 31576 (0.0009) [2023-02-24 21:01:00,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13454.3). Total num frames: 129372160. Throughput: 0: 3368.2. Samples: 7338818. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:01:00,243][213332] Avg episode reward: [(0, '39.959')] [2023-02-24 21:01:00,472][213365] Updated weights for policy 0, policy_version 31586 (0.0008) [2023-02-24 21:01:02,950][213369] Large shaping reward 2.566 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.426, 142.0), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0)] [2023-02-24 21:01:03,509][213365] Updated weights for policy 0, policy_version 31596 (0.0009) [2023-02-24 21:01:05,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 129437696. Throughput: 0: 3369.9. Samples: 7349096. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:01:05,243][213332] Avg episode reward: [(0, '39.959')] [2023-02-24 21:01:06,480][213365] Updated weights for policy 0, policy_version 31606 (0.0009) [2023-02-24 21:01:09,606][213365] Updated weights for policy 0, policy_version 31616 (0.0009) [2023-02-24 21:01:10,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13468.2). Total num frames: 129507328. Throughput: 0: 3366.1. Samples: 7369270. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:01:10,244][213332] Avg episode reward: [(0, '39.959')] [2023-02-24 21:01:11,627][213368] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 21:01:12,538][213367] DAMAGECOUNT value on done: 312852.0 [2023-02-24 21:01:12,538][213367] Sum rewards: 34.250, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.770', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon5': '0.068', 'AMMO4': '0.211', 'AMMO3': '0.247', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.444', 'weapon4': '0.518', 'WEAPON3': '1.400', 'HITCOUNT': '2.350', 'weapon3': '2.694', 'DAMAGECOUNT': '11.331', 'FRAGCOUNT': '34.000'} [2023-02-24 21:01:12,614][213365] Updated weights for policy 0, policy_version 31626 (0.0009) [2023-02-24 21:01:12,846][213367] DAMAGECOUNT value on done: 314730.0 [2023-02-24 21:01:12,846][213367] Sum rewards: 36.748, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.794', 'AMMO5': '0.003', 'weapon4': '0.004', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'weapon5': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.229', 'weapon2': '0.538', 'WEAPON3': '1.500', 'HITCOUNT': '2.320', 'weapon3': '3.220', 'DAMAGECOUNT': '10.707', 'FRAGCOUNT': '36.000'} [2023-02-24 21:01:13,038][213367] DAMAGECOUNT value on done: 318213.0 [2023-02-24 21:01:13,038][213367] Sum rewards: 26.553, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.046', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.054', 'AMMO3': '0.158', 'weapon5': '0.184', 'AMMO4': '0.271', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon2': '0.578', 'WEAPON3': '0.900', 'weapon4': '0.940', 'weapon3': '1.912', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '9.600', 'FRAGCOUNT': '25.000'} [2023-02-24 21:01:13,169][213372] DAMAGECOUNT value on done: 317833.0 [2023-02-24 21:01:13,169][213372] Sum rewards: 41.621, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.942', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon7': '0.072', 'weapon5': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon4': '0.496', 'weapon2': '0.650', 'WEAPON3': '1.450', 'HITCOUNT': '2.390', 'weapon3': '2.458', 'DAMAGECOUNT': '10.524', 'FRAGCOUNT': '39.000'} [2023-02-24 21:01:13,353][213367] DAMAGECOUNT value on done: 318693.0 [2023-02-24 21:01:13,354][213367] Sum rewards: 47.169, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.411', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.058', 'AMMO4': '0.143', 'weapon4': '0.156', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.200', 'HITCOUNT': '2.790', 'weapon3': '3.134', 'DAMAGECOUNT': '12.690', 'FRAGCOUNT': '41.000'} [2023-02-24 21:01:13,480][213372] DAMAGECOUNT value on done: 322834.0 [2023-02-24 21:01:13,480][213372] Sum rewards: 46.308, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.032', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.126', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.248', 'weapon4': '0.378', 'WEAPON3': '1.000', 'HITCOUNT': '2.620', 'weapon3': '3.074', 'DAMAGECOUNT': '12.231', 'FRAGCOUNT': '39.000'} [2023-02-24 21:01:13,565][213372] DAMAGECOUNT value on done: 313148.0 [2023-02-24 21:01:13,565][213372] Sum rewards: 35.827, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.315', 'AMMO5': '0.004', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.062', 'WEAPON5': '0.100', 'weapon7': '0.102', 'AMMO3': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.430', 'weapon4': '0.626', 'WEAPON3': '0.750', 'HITCOUNT': '1.850', 'weapon3': '2.394', 'DAMAGECOUNT': '8.769', 'FRAGCOUNT': '28.000'} [2023-02-24 21:01:13,824][213366] DAMAGECOUNT value on done: 312226.0 [2023-02-24 21:01:13,825][213366] Sum rewards: 49.233, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.595', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.010', 'weapon5': '0.032', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.930', 'WEAPON3': '1.300', 'weapon3': '2.834', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.530', 'FRAGCOUNT': '43.000'} [2023-02-24 21:01:13,879][213372] DAMAGECOUNT value on done: 310937.0 [2023-02-24 21:01:13,880][213372] Sum rewards: 51.545, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.370', 'AMMO5': '0.012', 'AMMO2': '0.013', 'weapon4': '0.016', 'weapon5': '0.028', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'weapon2': '0.352', 'WEAPON3': '1.400', 'HITCOUNT': '2.900', 'weapon3': '3.362', 'DAMAGECOUNT': '13.167', 'FRAGCOUNT': '46.000'} [2023-02-24 21:01:14,121][213366] DAMAGECOUNT value on done: 321108.0 [2023-02-24 21:01:14,121][213366] Sum rewards: 40.277, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.190', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.100', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'WEAPON4': '0.250', 'weapon4': '0.490', 'weapon2': '0.592', 'WEAPON3': '1.100', 'HITCOUNT': '2.300', 'weapon3': '2.478', 'DAMAGECOUNT': '10.686', 'FRAGCOUNT': '36.000'} [2023-02-24 21:01:14,132][213366] DAMAGECOUNT value on done: 325482.0 [2023-02-24 21:01:14,133][213366] Sum rewards: 40.668, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.690', 'AMMO5': '0.013', 'AMMO2': '0.015', 'weapon5': '0.054', 'AMMO4': '0.076', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.330', 'weapon2': '0.754', 'WEAPON3': '1.100', 'HITCOUNT': '2.500', 'weapon3': '2.678', 'DAMAGECOUNT': '11.151', 'FRAGCOUNT': '35.000'} [2023-02-24 21:01:14,444][213366] DAMAGECOUNT value on done: 317658.0 [2023-02-24 21:01:14,444][213366] Sum rewards: 42.036, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.210', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'weapon2': '0.438', 'WEAPON4': '0.450', 'WEAPON3': '0.700', 'weapon4': '0.916', 'weapon3': '2.198', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '11.370', 'FRAGCOUNT': '35.000'} [2023-02-24 21:01:14,454][213383] DAMAGECOUNT value on done: 312825.0 [2023-02-24 21:01:14,454][213383] Sum rewards: 31.444, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.670', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon5': '0.110', 'WEAPON4': '0.200', 'weapon4': '0.232', 'AMMO3': '0.283', 'WEAPON5': '0.300', 'weapon2': '0.518', 'WEAPON3': '1.750', 'HITCOUNT': '2.340', 'weapon3': '2.814', 'DAMAGECOUNT': '10.212', 'FRAGCOUNT': '36.000'} [2023-02-24 21:01:14,633][213382] DAMAGECOUNT value on done: 317981.0 [2023-02-24 21:01:14,634][213382] Sum rewards: 42.728, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.810', 'AMMO5': '0.021', 'AMMO2': '0.038', 'weapon5': '0.136', 'AMMO4': '0.190', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.378', 'weapon4': '0.460', 'WEAPON3': '1.300', 'HITCOUNT': '2.660', 'weapon3': '2.784', 'DAMAGECOUNT': '11.526', 'FRAGCOUNT': '38.000'} [2023-02-24 21:01:14,759][213369] DAMAGECOUNT value on done: 320657.0 [2023-02-24 21:01:14,759][213369] Sum rewards: 48.397, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.846', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.150', 'weapon5': '0.160', 'AMMO4': '0.166', 'weapon2': '0.200', 'AMMO3': '0.241', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.780', 'weapon3': '3.216', 'DAMAGECOUNT': '13.734', 'FRAGCOUNT': '44.000'} [2023-02-24 21:01:14,780][213368] DAMAGECOUNT value on done: 313119.0 [2023-02-24 21:01:14,781][213368] Sum rewards: 49.509, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.822', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.210', 'AMMO3': '0.212', 'weapon2': '0.248', 'weapon4': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.690', 'weapon3': '2.972', 'DAMAGECOUNT': '12.543', 'FRAGCOUNT': '45.000'} [2023-02-24 21:01:14,782][213383] DAMAGECOUNT value on done: 316461.0 [2023-02-24 21:01:14,783][213383] Sum rewards: 54.729, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.502', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.156', 'weapon5': '0.252', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.660', 'WEAPON3': '1.050', 'weapon3': '2.490', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.318', 'FRAGCOUNT': '44.000'} [2023-02-24 21:01:14,942][213382] DAMAGECOUNT value on done: 318332.0 [2023-02-24 21:01:14,942][213382] Sum rewards: 36.589, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.752', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.054', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'weapon2': '0.222', 'AMMO3': '0.290', 'WEAPON4': '0.300', 'weapon4': '0.342', 'WEAPON3': '1.700', 'HITCOUNT': '2.420', 'weapon3': '3.152', 'DAMAGECOUNT': '11.067', 'FRAGCOUNT': '37.000'} [2023-02-24 21:01:15,080][213369] DAMAGECOUNT value on done: 315697.0 [2023-02-24 21:01:15,080][213369] Sum rewards: 35.046, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.372', 'AMMO5': '0.019', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon4': '0.124', 'AMMO3': '0.155', 'WEAPON4': '0.250', 'weapon5': '0.346', 'WEAPON5': '0.550', 'weapon2': '0.586', 'WEAPON3': '0.900', 'HITCOUNT': '2.210', 'weapon3': '2.684', 'DAMAGECOUNT': '10.458', 'FRAGCOUNT': '30.000'} [2023-02-24 21:01:15,082][213368] DAMAGECOUNT value on done: 320586.0 [2023-02-24 21:01:15,083][213368] Sum rewards: 34.106, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.904', 'AMMO5': '0.017', 'AMMO2': '0.023', 'weapon4': '0.072', 'AMMO4': '0.113', 'weapon5': '0.174', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'weapon2': '0.294', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.770', 'weapon3': '3.172', 'DAMAGECOUNT': '11.280', 'FRAGCOUNT': '29.500'} [2023-02-24 21:01:15,243][213332] Fps is (10 sec: 13517.0, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 129572864. Throughput: 0: 3363.4. Samples: 7389304. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:01:15,243][213332] Avg episode reward: [(0, '40.330')] [2023-02-24 21:01:15,272][213368] DAMAGECOUNT value on done: 316739.0 [2023-02-24 21:01:15,272][213368] Sum rewards: 35.769, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.507', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'weapon5': '0.136', 'AMMO3': '0.148', 'WEAPON4': '0.200', 'weapon4': '0.696', 'weapon2': '0.784', 'WEAPON3': '0.900', 'HITCOUNT': '2.060', 'weapon3': '2.250', 'DAMAGECOUNT': '9.654', 'FRAGCOUNT': '29.000'} [2023-02-24 21:01:15,306][213382] DAMAGECOUNT value on done: 309713.0 [2023-02-24 21:01:15,307][213382] Sum rewards: 44.761, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.220', 'AMMO5': '0.018', 'AMMO2': '0.052', 'AMMO3': '0.199', 'weapon5': '0.214', 'AMMO4': '0.259', 'weapon2': '0.268', 'WEAPON5': '0.450', 'weapon4': '0.478', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'HITCOUNT': '2.410', 'weapon3': '2.744', 'DAMAGECOUNT': '11.889', 'FRAGCOUNT': '42.000'} [2023-02-24 21:01:15,332][213383] DAMAGECOUNT value on done: 315316.0 [2023-02-24 21:01:15,333][213383] Sum rewards: 33.376, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.658', 'AMMO2': '0.003', 'ARMOR': '0.004', 'AMMO4': '0.014', 'AMMO5': '0.015', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'weapon5': '0.216', 'weapon4': '0.266', 'WEAPON5': '0.350', 'weapon2': '0.682', 'WEAPON3': '1.200', 'HITCOUNT': '2.320', 'weapon3': '2.618', 'DAMAGECOUNT': '10.257', 'FRAGCOUNT': '29.000'} [2023-02-24 21:01:15,344][213384] DAMAGECOUNT value on done: 321623.0 [2023-02-24 21:01:15,344][213384] Sum rewards: 39.210, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.866', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon4': '0.124', 'AMMO4': '0.129', 'weapon5': '0.150', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.466', 'WEAPON3': '1.500', 'HITCOUNT': '2.600', 'weapon3': '3.016', 'DAMAGECOUNT': '12.954', 'FRAGCOUNT': '36.000'} [2023-02-24 21:01:15,372][213369] DAMAGECOUNT value on done: 318974.0 [2023-02-24 21:01:15,372][213369] Sum rewards: 30.287, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.613', 'AMMO5': '0.007', 'weapon4': '0.010', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon5': '0.216', 'weapon2': '0.874', 'WEAPON3': '1.100', 'HITCOUNT': '2.120', 'weapon3': '2.700', 'DAMAGECOUNT': '9.666', 'FRAGCOUNT': '26.000'} [2023-02-24 21:01:15,572][213368] DAMAGECOUNT value on done: 308675.0 [2023-02-24 21:01:15,573][213368] Sum rewards: 45.044, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.110', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.054', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.476', 'weapon2': '0.748', 'WEAPON3': '0.750', 'HITCOUNT': '2.450', 'weapon3': '2.500', 'DAMAGECOUNT': '10.692', 'FRAGCOUNT': '36.000'} [2023-02-24 21:01:15,605][213382] DAMAGECOUNT value on done: 321316.0 [2023-02-24 21:01:15,605][213382] Sum rewards: 46.662, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.264', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.019', 'AMMO4': '0.094', 'AMMO3': '0.176', 'weapon2': '0.208', 'weapon5': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.568', 'WEAPON3': '1.050', 'HITCOUNT': '2.540', 'weapon3': '2.664', 'DAMAGECOUNT': '11.685', 'FRAGCOUNT': '40.000'} [2023-02-24 21:01:15,635][213383] DAMAGECOUNT value on done: 310746.0 [2023-02-24 21:01:15,635][213383] Sum rewards: 47.522, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.029', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.147', 'weapon4': '0.180', 'weapon5': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.594', 'WEAPON3': '1.000', 'HITCOUNT': '2.400', 'weapon3': '2.732', 'DAMAGECOUNT': '11.823', 'FRAGCOUNT': '41.000'} [2023-02-24 21:01:15,647][213384] DAMAGECOUNT value on done: 306135.0 [2023-02-24 21:01:15,647][213384] Sum rewards: 39.129, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.102', 'ARMOR': '0.004', 'AMMO5': '0.027', 'AMMO2': '0.042', 'AMMO3': '0.183', 'AMMO4': '0.211', 'weapon5': '0.252', 'weapon2': '0.316', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'weapon4': '0.708', 'WEAPON3': '1.050', 'weapon3': '2.380', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '11.277', 'FRAGCOUNT': '37.000'} [2023-02-24 21:01:15,660][213369] DAMAGECOUNT value on done: 307385.0 [2023-02-24 21:01:15,660][213369] Sum rewards: 43.634, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.023', 'ARMOR': '0.008', 'AMMO5': '0.023', 'AMMO2': '0.054', 'AMMO3': '0.144', 'weapon5': '0.192', 'AMMO4': '0.271', 'WEAPON5': '0.450', 'weapon4': '0.524', 'weapon2': '0.548', 'WEAPON4': '0.600', 'WEAPON3': '0.900', 'weapon3': '2.506', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '11.667', 'FRAGCOUNT': '37.000'} [2023-02-24 21:01:15,710][213365] Updated weights for policy 0, policy_version 31636 (0.0009) [2023-02-24 21:01:15,930][213384] DAMAGECOUNT value on done: 320894.0 [2023-02-24 21:01:15,931][213384] Sum rewards: 45.432, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.447', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.214', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon4': '0.496', 'WEAPON3': '1.400', 'HITCOUNT': '2.600', 'weapon3': '2.862', 'DAMAGECOUNT': '12.591', 'FRAGCOUNT': '41.000'} [2023-02-24 21:01:16,227][213384] DAMAGECOUNT value on done: 321585.0 [2023-02-24 21:01:16,228][213384] Sum rewards: 38.925, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.424', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.080', 'weapon4': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.518', 'WEAPON3': '1.300', 'HITCOUNT': '2.310', 'weapon3': '3.108', 'DAMAGECOUNT': '10.620', 'FRAGCOUNT': '35.000'} [2023-02-24 21:01:18,711][213365] Updated weights for policy 0, policy_version 31646 (0.0009) [2023-02-24 21:01:20,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13468.2). Total num frames: 129642496. Throughput: 0: 3364.7. Samples: 7399582. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:01:20,243][213332] Avg episode reward: [(0, '40.437')] [2023-02-24 21:01:21,686][213365] Updated weights for policy 0, policy_version 31656 (0.0009) [2023-02-24 21:01:24,812][213365] Updated weights for policy 0, policy_version 31666 (0.0009) [2023-02-24 21:01:25,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 129708032. Throughput: 0: 3372.3. Samples: 7419870. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:01:25,243][213332] Avg episode reward: [(0, '40.437')] [2023-02-24 21:01:27,834][213365] Updated weights for policy 0, policy_version 31676 (0.0009) [2023-02-24 21:01:30,243][213332] Fps is (10 sec: 13107.2, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 129773568. Throughput: 0: 3369.7. Samples: 7439982. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:01:30,243][213332] Avg episode reward: [(0, '40.437')] [2023-02-24 21:01:30,891][213365] Updated weights for policy 0, policy_version 31686 (0.0009) [2023-02-24 21:01:32,490][213367] DAMAGECOUNT value on done: 316882.0 [2023-02-24 21:01:32,491][213367] Sum rewards: 44.066, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.780', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'weapon5': '0.092', 'AMMO4': '0.138', 'AMMO3': '0.175', 'WEAPON5': '0.250', 'weapon4': '0.286', 'WEAPON4': '0.300', 'weapon2': '0.590', 'WEAPON3': '1.150', 'HITCOUNT': '2.680', 'weapon3': '2.798', 'DAMAGECOUNT': '12.090', 'FRAGCOUNT': '39.000'} [2023-02-24 21:01:32,806][213367] DAMAGECOUNT value on done: 318596.0 [2023-02-24 21:01:32,807][213367] Sum rewards: 35.067, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.686', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.138', 'WEAPON5': '0.200', 'AMMO4': '0.217', 'AMMO3': '0.220', 'WEAPON4': '0.350', 'weapon2': '0.386', 'weapon4': '0.668', 'WEAPON3': '1.350', 'weapon3': '2.532', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '11.598', 'FRAGCOUNT': '34.000'} [2023-02-24 21:01:32,985][213367] DAMAGECOUNT value on done: 321149.0 [2023-02-24 21:01:32,986][213367] Sum rewards: 32.344, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.742', 'weapon4': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.019', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'weapon2': '0.176', 'AMMO3': '0.177', 'weapon5': '0.198', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '2.150', 'weapon3': '3.392', 'DAMAGECOUNT': '8.808', 'FRAGCOUNT': '28.000'} [2023-02-24 21:01:33,114][213372] DAMAGECOUNT value on done: 322238.0 [2023-02-24 21:01:33,115][213372] Sum rewards: 44.857, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.070', 'AMMO5': '0.018', 'AMMO2': '0.035', 'AMMO3': '0.134', 'AMMO4': '0.177', 'weapon5': '0.310', 'WEAPON4': '0.500', 'weapon2': '0.546', 'WEAPON5': '0.550', 'weapon4': '0.600', 'WEAPON3': '0.850', 'weapon3': '2.182', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '13.215', 'FRAGCOUNT': '39.000'} [2023-02-24 21:01:33,292][213367] DAMAGECOUNT value on done: 321807.0 [2023-02-24 21:01:33,293][213367] Sum rewards: 33.024, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.979', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'weapon4': '0.326', 'weapon2': '0.392', 'WEAPON3': '1.350', 'HITCOUNT': '2.170', 'weapon3': '3.084', 'DAMAGECOUNT': '9.342', 'FRAGCOUNT': '32.000'} [2023-02-24 21:01:33,429][213372] DAMAGECOUNT value on done: 326653.0 [2023-02-24 21:01:33,430][213372] Sum rewards: 44.825, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.335', 'AMMO5': '0.017', 'AMMO2': '0.052', 'AMMO3': '0.127', 'weapon5': '0.136', 'AMMO4': '0.261', 'weapon2': '0.346', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.508', 'WEAPON3': '0.750', 'weapon3': '2.556', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '11.457', 'FRAGCOUNT': '37.000'} [2023-02-24 21:01:33,444][213372] DAMAGECOUNT value on done: 317742.0 [2023-02-24 21:01:33,445][213372] Sum rewards: 51.300, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.174', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.216', 'weapon4': '0.220', 'WEAPON4': '0.300', 'weapon2': '0.430', 'ARMOR': '0.481', 'WEAPON3': '1.350', 'weapon3': '3.070', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.782', 'FRAGCOUNT': '44.500'} [2023-02-24 21:01:33,741][213366] DAMAGECOUNT value on done: 316142.0 [2023-02-24 21:01:33,742][213366] Sum rewards: 38.868, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.150', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.009', 'AMMO4': '0.042', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.214', 'weapon2': '0.274', 'AMMO3': '0.278', 'WEAPON3': '1.700', 'HITCOUNT': '2.730', 'weapon3': '3.260', 'DAMAGECOUNT': '11.748', 'FRAGCOUNT': '38.000'} [2023-02-24 21:01:33,762][213372] DAMAGECOUNT value on done: 315207.0 [2023-02-24 21:01:33,762][213372] Sum rewards: 44.644, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.487', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.117', 'AMMO4': '0.126', 'weapon5': '0.154', 'WEAPON4': '0.250', 'weapon4': '0.328', 'WEAPON5': '0.350', 'weapon2': '0.648', 'WEAPON3': '0.700', 'weapon3': '2.652', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.810', 'FRAGCOUNT': '35.500'} [2023-02-24 21:01:33,972][213365] Updated weights for policy 0, policy_version 31696 (0.0009) [2023-02-24 21:01:34,030][213366] DAMAGECOUNT value on done: 324239.0 [2023-02-24 21:01:34,031][213366] Sum rewards: 35.380, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.948', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'AMMO3': '0.201', 'weapon4': '0.232', 'weapon2': '0.482', 'WEAPON3': '1.150', 'HITCOUNT': '2.250', 'weapon3': '3.034', 'DAMAGECOUNT': '9.393', 'FRAGCOUNT': '32.000'} [2023-02-24 21:01:34,062][213366] DAMAGECOUNT value on done: 328541.0 [2023-02-24 21:01:34,063][213366] Sum rewards: 31.497, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.643', 'AMMO5': '0.013', 'ARMOR': '0.024', 'AMMO2': '0.030', 'AMMO4': '0.147', 'AMMO3': '0.159', 'weapon5': '0.270', 'WEAPON5': '0.400', 'weapon2': '0.428', 'WEAPON4': '0.450', 'weapon4': '0.666', 'WEAPON3': '0.900', 'HITCOUNT': '2.210', 'weapon3': '2.266', 'DAMAGECOUNT': '9.177', 'FRAGCOUNT': '28.000'} [2023-02-24 21:01:34,351][213366] DAMAGECOUNT value on done: 320917.0 [2023-02-24 21:01:34,352][213366] Sum rewards: 30.262, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.579', 'AMMO5': '0.018', 'AMMO2': '0.059', 'weapon5': '0.136', 'AMMO3': '0.202', 'AMMO4': '0.295', 'weapon4': '0.364', 'WEAPON5': '0.400', 'weapon2': '0.408', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'HITCOUNT': '2.100', 'weapon3': '2.832', 'DAMAGECOUNT': '9.777', 'FRAGCOUNT': '28.000'} [2023-02-24 21:01:34,407][213383] DAMAGECOUNT value on done: 317454.0 [2023-02-24 21:01:34,407][213383] Sum rewards: 50.843, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.866', 'AMMO5': '0.020', 'AMMO2': '0.054', 'AMMO3': '0.156', 'weapon5': '0.192', 'AMMO4': '0.271', 'weapon2': '0.396', 'WEAPON5': '0.450', 'weapon4': '0.484', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.438', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.887', 'FRAGCOUNT': '44.000'} [2023-02-24 21:01:34,687][213382] DAMAGECOUNT value on done: 320537.0 [2023-02-24 21:01:34,688][213382] Sum rewards: 25.887, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.662', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO4': '0.183', 'weapon4': '0.206', 'weapon5': '0.206', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.300', 'HITCOUNT': '1.920', 'weapon3': '2.858', 'DAMAGECOUNT': '7.668', 'FRAGCOUNT': '27.000'} [2023-02-24 21:01:34,697][213368] DAMAGECOUNT value on done: 317056.0 [2023-02-24 21:01:34,698][213368] Sum rewards: 42.553, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.416', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.022', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.148', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'weapon4': '0.324', 'weapon2': '0.638', 'WEAPON3': '1.100', 'weapon3': '2.638', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '11.811', 'FRAGCOUNT': '39.000'} [2023-02-24 21:01:34,716][213369] DAMAGECOUNT value on done: 324466.0 [2023-02-24 21:01:34,716][213369] Sum rewards: 45.861, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.140', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'AMMO3': '0.175', 'ARMOR': '0.400', 'weapon2': '0.470', 'weapon4': '0.554', 'WEAPON3': '1.150', 'weapon3': '2.736', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '11.427', 'FRAGCOUNT': '39.000'} [2023-02-24 21:01:34,717][213383] DAMAGECOUNT value on done: 320377.0 [2023-02-24 21:01:34,717][213383] Sum rewards: 45.897, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.200', 'AMMO5': '0.011', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.104', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.284', 'weapon2': '0.858', 'WEAPON3': '1.000', 'weapon3': '2.576', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '11.748', 'FRAGCOUNT': '39.000'} [2023-02-24 21:01:34,998][213382] DAMAGECOUNT value on done: 321630.0 [2023-02-24 21:01:34,998][213382] Sum rewards: 35.194, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.420', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.006', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.160', 'weapon4': '0.258', 'weapon2': '0.430', 'WEAPON3': '1.000', 'HITCOUNT': '2.300', 'weapon3': '3.034', 'DAMAGECOUNT': '9.894', 'FRAGCOUNT': '29.000'} [2023-02-24 21:01:35,004][213368] DAMAGECOUNT value on done: 323687.0 [2023-02-24 21:01:35,005][213368] Sum rewards: 27.752, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.429', 'AMMO5': '0.014', 'AMMO2': '0.025', 'weapon5': '0.112', 'AMMO4': '0.124', 'weapon2': '0.220', 'WEAPON4': '0.250', 'AMMO3': '0.262', 'weapon4': '0.264', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '2.290', 'weapon3': '3.166', 'DAMAGECOUNT': '9.303', 'FRAGCOUNT': '29.000'} [2023-02-24 21:01:35,019][213369] DAMAGECOUNT value on done: 319341.0 [2023-02-24 21:01:35,019][213369] Sum rewards: 37.232, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.381', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.103', 'AMMO4': '0.150', 'weapon5': '0.254', 'WEAPON4': '0.300', 'weapon4': '0.328', 'WEAPON5': '0.400', 'WEAPON3': '0.700', 'weapon2': '0.976', 'HITCOUNT': '1.970', 'weapon3': '2.184', 'DAMAGECOUNT': '10.932', 'FRAGCOUNT': '30.000'} [2023-02-24 21:01:35,205][213368] DAMAGECOUNT value on done: 320864.0 [2023-02-24 21:01:35,205][213368] Sum rewards: 45.698, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.914', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO4': '0.137', 'weapon5': '0.158', 'weapon4': '0.186', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.404', 'WEAPON3': '1.150', 'HITCOUNT': '2.690', 'weapon3': '2.972', 'DAMAGECOUNT': '12.375', 'FRAGCOUNT': '40.000'} [2023-02-24 21:01:35,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 129843200. Throughput: 0: 3368.8. Samples: 7450166. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:01:35,243][213332] Avg episode reward: [(0, '39.803')] [2023-02-24 21:01:35,276][213384] DAMAGECOUNT value on done: 325420.0 [2023-02-24 21:01:35,277][213384] Sum rewards: 46.419, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.087', 'AMMO2': '0.007', 'AMMO5': '0.013', 'AMMO4': '0.034', 'weapon5': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.143', 'weapon4': '0.174', 'WEAPON5': '0.300', 'weapon2': '0.658', 'WEAPON3': '1.000', 'HITCOUNT': '2.430', 'weapon3': '2.914', 'DAMAGECOUNT': '11.391', 'FRAGCOUNT': '39.000'} [2023-02-24 21:01:35,286][213383] DAMAGECOUNT value on done: 318658.0 [2023-02-24 21:01:35,287][213383] Sum rewards: 35.360, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.684', 'ARMOR': '0.004', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.041', 'weapon5': '0.164', 'AMMO4': '0.203', 'AMMO3': '0.216', 'weapon2': '0.334', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.406', 'WEAPON3': '1.250', 'HITCOUNT': '2.360', 'weapon3': '2.784', 'DAMAGECOUNT': '9.948', 'FRAGCOUNT': '35.000'} [2023-02-24 21:01:35,296][213382] DAMAGECOUNT value on done: 313030.0 [2023-02-24 21:01:35,297][213382] Sum rewards: 37.381, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.061', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'weapon5': '0.022', 'AMMO2': '0.026', 'AMMO4': '0.132', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.278', 'weapon2': '0.334', 'WEAPON3': '1.450', 'HITCOUNT': '2.410', 'weapon3': '3.070', 'DAMAGECOUNT': '9.951', 'FRAGCOUNT': '37.000'} [2023-02-24 21:01:35,320][213369] DAMAGECOUNT value on done: 322281.0 [2023-02-24 21:01:35,321][213369] Sum rewards: 39.534, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.636', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon5': '0.112', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon4': '0.268', 'WEAPON5': '0.300', 'weapon2': '0.502', 'WEAPON3': '1.350', 'HITCOUNT': '2.220', 'weapon3': '2.876', 'DAMAGECOUNT': '9.921', 'FRAGCOUNT': '36.000'} [2023-02-24 21:01:35,509][213368] DAMAGECOUNT value on done: 312378.0 [2023-02-24 21:01:35,509][213368] Sum rewards: 37.664, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.020', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'weapon5': '0.084', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'ARMOR': '0.455', 'weapon2': '0.520', 'weapon4': '0.574', 'WEAPON3': '0.900', 'weapon3': '2.334', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '11.109', 'FRAGCOUNT': '30.000'} [2023-02-24 21:01:35,586][213384] DAMAGECOUNT value on done: 310325.0 [2023-02-24 21:01:35,587][213384] Sum rewards: 46.633, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.435', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'weapon5': '0.070', 'WEAPON5': '0.150', 'weapon4': '0.156', 'weapon2': '0.188', 'AMMO3': '0.208', 'WEAPON3': '1.300', 'HITCOUNT': '2.940', 'weapon3': '3.400', 'DAMAGECOUNT': '12.570', 'FRAGCOUNT': '39.000'} [2023-02-24 21:01:35,592][213383] DAMAGECOUNT value on done: 314645.0 [2023-02-24 21:01:35,593][213383] Sum rewards: 37.917, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.645', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon4': '0.070', 'weapon5': '0.096', 'AMMO4': '0.119', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.458', 'WEAPON3': '1.400', 'HITCOUNT': '2.720', 'weapon3': '3.106', 'DAMAGECOUNT': '11.697', 'FRAGCOUNT': '35.500'} [2023-02-24 21:01:35,598][213382] DAMAGECOUNT value on done: 324983.0 [2023-02-24 21:01:35,599][213382] Sum rewards: 39.208, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.255', 'AMMO5': '0.018', 'AMMO2': '0.021', 'weapon5': '0.082', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon4': '0.222', 'weapon2': '0.330', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.740', 'weapon3': '3.146', 'DAMAGECOUNT': '11.001', 'FRAGCOUNT': '36.000'} [2023-02-24 21:01:35,628][213369] DAMAGECOUNT value on done: 311843.0 [2023-02-24 21:01:35,628][213369] Sum rewards: 45.695, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.362', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.058', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon2': '0.300', 'weapon4': '0.434', 'WEAPON3': '1.400', 'HITCOUNT': '2.660', 'weapon3': '2.962', 'DAMAGECOUNT': '13.374', 'FRAGCOUNT': '41.000'} [2023-02-24 21:01:35,894][213384] DAMAGECOUNT value on done: 324476.0 [2023-02-24 21:01:35,895][213384] Sum rewards: 39.918, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.175', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.003', 'weapon4': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.150', 'weapon2': '0.542', 'WEAPON3': '1.100', 'HITCOUNT': '2.260', 'weapon3': '2.864', 'DAMAGECOUNT': '10.746', 'FRAGCOUNT': '34.000'} [2023-02-24 21:01:36,187][213384] DAMAGECOUNT value on done: 325722.0 [2023-02-24 21:01:36,188][213384] Sum rewards: 51.797, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.973', 'AMMO5': '0.005', 'ARMOR': '0.016', 'weapon5': '0.018', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon2': '0.366', 'weapon4': '0.494', 'WEAPON3': '1.300', 'weapon3': '2.838', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.411', 'FRAGCOUNT': '46.000'} [2023-02-24 21:01:36,964][213365] Updated weights for policy 0, policy_version 31706 (0.0009) [2023-02-24 21:01:40,032][213365] Updated weights for policy 0, policy_version 31716 (0.0009) [2023-02-24 21:01:40,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 129908736. Throughput: 0: 3369.2. Samples: 7470288. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:01:40,244][213332] Avg episode reward: [(0, '39.982')] [2023-02-24 21:01:43,033][213365] Updated weights for policy 0, policy_version 31726 (0.0009) [2023-02-24 21:01:45,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13454.3). Total num frames: 129978368. Throughput: 0: 3368.0. Samples: 7490378. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:01:45,243][213332] Avg episode reward: [(0, '39.982')] [2023-02-24 21:01:46,083][213365] Updated weights for policy 0, policy_version 31736 (0.0009) [2023-02-24 21:01:47,768][213369] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 21:01:49,157][213365] Updated weights for policy 0, policy_version 31746 (0.0009) [2023-02-24 21:01:50,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13454.3). Total num frames: 130043904. Throughput: 0: 3367.2. Samples: 7500620. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:01:50,243][213332] Avg episode reward: [(0, '39.982')] [2023-02-24 21:01:52,134][213365] Updated weights for policy 0, policy_version 31756 (0.0008) [2023-02-24 21:01:52,453][213367] DAMAGECOUNT value on done: 321596.0 [2023-02-24 21:01:52,454][213367] Sum rewards: 45.003, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.281', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO3': '0.167', 'AMMO4': '0.205', 'weapon5': '0.302', 'weapon2': '0.316', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.578', 'WEAPON3': '1.050', 'HITCOUNT': '2.400', 'weapon3': '2.494', 'DAMAGECOUNT': '14.112', 'FRAGCOUNT': '39.000'} [2023-02-24 21:01:52,772][213367] DAMAGECOUNT value on done: 322219.0 [2023-02-24 21:01:52,773][213367] Sum rewards: 34.185, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.220', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.100', 'AMMO4': '0.172', 'AMMO3': '0.200', 'weapon2': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.830', 'WEAPON3': '1.250', 'HITCOUNT': '2.450', 'weapon3': '2.628', 'DAMAGECOUNT': '10.869', 'FRAGCOUNT': '32.000'} [2023-02-24 21:01:52,897][213367] DAMAGECOUNT value on done: 325084.0 [2023-02-24 21:01:52,898][213367] Sum rewards: 43.411, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.556', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.029', 'weapon5': '0.062', 'weapon4': '0.066', 'AMMO4': '0.143', 'AMMO3': '0.188', 'weapon2': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.620', 'weapon3': '3.462', 'DAMAGECOUNT': '11.805', 'FRAGCOUNT': '39.000'} [2023-02-24 21:01:53,025][213372] DAMAGECOUNT value on done: 326485.0 [2023-02-24 21:01:53,025][213372] Sum rewards: 37.446, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.876', 'AMMO5': '0.014', 'AMMO2': '0.050', 'AMMO3': '0.190', 'weapon5': '0.222', 'AMMO4': '0.249', 'WEAPON5': '0.400', 'weapon2': '0.490', 'WEAPON4': '0.700', 'weapon4': '0.842', 'WEAPON3': '1.200', 'weapon3': '2.184', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.741', 'FRAGCOUNT': '33.500'} [2023-02-24 21:01:53,215][213367] DAMAGECOUNT value on done: 325543.0 [2023-02-24 21:01:53,215][213367] Sum rewards: 41.463, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.109', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon5': '0.126', 'AMMO4': '0.126', 'AMMO3': '0.192', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.378', 'weapon2': '0.884', 'WEAPON3': '1.100', 'weapon3': '2.260', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '11.208', 'FRAGCOUNT': '37.000'} [2023-02-24 21:01:53,328][213372] DAMAGECOUNT value on done: 330551.0 [2023-02-24 21:01:53,329][213372] Sum rewards: 42.228, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.020', 'AMMO5': '0.012', 'AMMO2': '0.044', 'AMMO3': '0.137', 'AMMO4': '0.217', 'weapon2': '0.234', 'weapon5': '0.320', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'weapon4': '0.892', 'weapon3': '2.228', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '11.694', 'FRAGCOUNT': '36.000'} [2023-02-24 21:01:53,345][213372] DAMAGECOUNT value on done: 321943.0 [2023-02-24 21:01:53,345][213372] Sum rewards: 45.744, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.600', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.048', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'AMMO3': '0.225', 'weapon4': '0.230', 'WEAPON4': '0.300', 'weapon2': '0.418', 'WEAPON3': '1.250', 'HITCOUNT': '2.840', 'weapon3': '3.076', 'DAMAGECOUNT': '12.603', 'FRAGCOUNT': '41.000'} [2023-02-24 21:01:53,662][213372] DAMAGECOUNT value on done: 318545.0 [2023-02-24 21:01:53,663][213372] Sum rewards: 42.250, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.877', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.120', 'AMMO3': '0.137', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.450', 'ARMOR': '0.455', 'weapon2': '0.494', 'WEAPON3': '0.850', 'HITCOUNT': '2.330', 'weapon3': '2.766', 'DAMAGECOUNT': '10.014', 'FRAGCOUNT': '35.500'} [2023-02-24 21:01:53,684][213366] DAMAGECOUNT value on done: 320036.0 [2023-02-24 21:01:53,685][213366] Sum rewards: 38.075, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.072', 'AMMO5': '0.028', 'ARMOR': '0.028', 'AMMO2': '0.032', 'weapon5': '0.148', 'AMMO4': '0.160', 'weapon4': '0.176', 'AMMO3': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.650', 'weapon2': '0.718', 'WEAPON3': '1.500', 'HITCOUNT': '2.300', 'weapon3': '2.634', 'DAMAGECOUNT': '11.682', 'FRAGCOUNT': '37.000'} [2023-02-24 21:01:53,936][213366] DAMAGECOUNT value on done: 328369.0 [2023-02-24 21:01:53,936][213366] Sum rewards: 42.293, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.395', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'AMMO3': '0.246', 'weapon4': '0.252', 'WEAPON4': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.400', 'HITCOUNT': '2.820', 'weapon3': '3.056', 'DAMAGECOUNT': '12.390', 'FRAGCOUNT': '40.000'} [2023-02-24 21:01:54,006][213366] DAMAGECOUNT value on done: 332501.0 [2023-02-24 21:01:54,006][213366] Sum rewards: 48.320, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.985', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'weapon4': '0.456', 'weapon2': '0.686', 'WEAPON3': '1.000', 'weapon3': '2.488', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '11.880', 'FRAGCOUNT': '42.000'} [2023-02-24 21:01:54,260][213366] DAMAGECOUNT value on done: 324567.0 [2023-02-24 21:01:54,260][213366] Sum rewards: 37.783, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.876', 'AMMO2': '0.012', 'AMMO5': '0.015', 'weapon4': '0.030', 'AMMO4': '0.059', 'WEAPON4': '0.150', 'weapon5': '0.184', 'AMMO3': '0.287', 'WEAPON5': '0.400', 'weapon2': '0.510', 'WEAPON3': '1.650', 'HITCOUNT': '2.510', 'weapon3': '2.902', 'DAMAGECOUNT': '10.950', 'FRAGCOUNT': '38.000'} [2023-02-24 21:01:54,273][213383] DAMAGECOUNT value on done: 320533.0 [2023-02-24 21:01:54,274][213383] Sum rewards: 30.400, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.103', 'AMMO5': '0.007', 'AMMO2': '0.061', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.146', 'AMMO3': '0.193', 'weapon2': '0.222', 'WEAPON5': '0.250', 'AMMO4': '0.306', 'ARMOR': '0.400', 'WEAPON4': '0.550', 'weapon4': '1.088', 'WEAPON3': '1.150', 'HITCOUNT': '1.910', 'weapon3': '2.182', 'DAMAGECOUNT': '9.237', 'FRAGCOUNT': '31.000'} [2023-02-24 21:01:54,610][213383] DAMAGECOUNT value on done: 323675.0 [2023-02-24 21:01:54,611][213383] Sum rewards: 29.842, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.095', 'AMMO5': '0.022', 'AMMO2': '0.033', 'weapon4': '0.136', 'AMMO4': '0.165', 'weapon5': '0.184', 'AMMO3': '0.207', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'weapon2': '0.624', 'WEAPON3': '1.250', 'HITCOUNT': '1.980', 'weapon3': '2.742', 'DAMAGECOUNT': '9.894', 'FRAGCOUNT': '29.000'} [2023-02-24 21:01:54,662][213382] DAMAGECOUNT value on done: 324314.0 [2023-02-24 21:01:54,662][213382] Sum rewards: 35.791, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.360', 'AMMO5': '0.027', 'AMMO2': '0.079', 'AMMO3': '0.191', 'weapon5': '0.216', 'weapon2': '0.354', 'AMMO4': '0.397', 'WEAPON5': '0.550', 'WEAPON4': '0.700', 'weapon4': '1.044', 'WEAPON3': '1.050', 'weapon3': '1.962', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '11.331', 'FRAGCOUNT': '34.000'} [2023-02-24 21:01:54,718][213369] DAMAGECOUNT value on done: 328294.0 [2023-02-24 21:01:54,718][213369] Sum rewards: 47.250, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.154', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.076', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon4': '0.294', 'weapon2': '0.574', 'WEAPON3': '1.050', 'weapon3': '2.646', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '11.484', 'FRAGCOUNT': '40.000'} [2023-02-24 21:01:54,741][213368] DAMAGECOUNT value on done: 320842.0 [2023-02-24 21:01:54,742][213368] Sum rewards: 37.015, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.236', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.093', 'WEAPON4': '0.200', 'weapon4': '0.202', 'AMMO3': '0.213', 'weapon5': '0.230', 'WEAPON5': '0.300', 'weapon2': '0.578', 'WEAPON3': '1.300', 'HITCOUNT': '2.320', 'weapon3': '2.672', 'DAMAGECOUNT': '11.358', 'FRAGCOUNT': '33.000'} [2023-02-24 21:01:54,964][213382] DAMAGECOUNT value on done: 325207.0 [2023-02-24 21:01:54,965][213382] Sum rewards: 38.793, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.226', 'ARMOR': '0.005', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.052', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'WEAPON4': '0.300', 'weapon4': '0.436', 'weapon2': '0.848', 'WEAPON3': '0.950', 'weapon3': '2.526', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '10.731', 'FRAGCOUNT': '34.000'} [2023-02-24 21:01:55,030][213369] DAMAGECOUNT value on done: 323342.0 [2023-02-24 21:01:55,030][213369] Sum rewards: 44.494, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.310', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.029', 'AMMO4': '0.144', 'AMMO3': '0.177', 'weapon5': '0.204', 'weapon4': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.404', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'HITCOUNT': '2.580', 'weapon3': '2.890', 'DAMAGECOUNT': '12.003', 'FRAGCOUNT': '38.000'} [2023-02-24 21:01:55,042][213368] DAMAGECOUNT value on done: 327545.0 [2023-02-24 21:01:55,042][213368] Sum rewards: 42.744, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.476', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.135', 'weapon5': '0.164', 'weapon4': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.496', 'WEAPON3': '0.850', 'HITCOUNT': '2.480', 'weapon3': '2.896', 'DAMAGECOUNT': '11.574', 'FRAGCOUNT': '35.000'} [2023-02-24 21:01:55,182][213383] DAMAGECOUNT value on done: 322073.0 [2023-02-24 21:01:55,182][213383] Sum rewards: 37.416, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.860', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.085', 'weapon4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON3': '1.100', 'weapon2': '1.274', 'HITCOUNT': '2.330', 'weapon3': '2.334', 'DAMAGECOUNT': '10.245', 'FRAGCOUNT': '33.500'} [2023-02-24 21:01:55,243][213332] Fps is (10 sec: 13107.2, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 130109440. Throughput: 0: 3367.3. Samples: 7520798. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:01:55,243][213332] Avg episode reward: [(0, '40.050')] [2023-02-24 21:01:55,261][213368] DAMAGECOUNT value on done: 325592.0 [2023-02-24 21:01:55,261][213368] Sum rewards: 55.571, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.319', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'WEAPON4': '0.250', 'weapon4': '0.296', 'weapon2': '0.404', 'WEAPON3': '1.050', 'HITCOUNT': '2.940', 'weapon3': '2.992', 'DAMAGECOUNT': '14.184', 'FRAGCOUNT': '47.000'} [2023-02-24 21:01:55,265][213382] DAMAGECOUNT value on done: 316530.0 [2023-02-24 21:01:55,265][213382] Sum rewards: 35.841, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.215', 'AMMO5': '0.022', 'AMMO2': '0.059', 'weapon5': '0.156', 'AMMO3': '0.169', 'AMMO4': '0.294', 'weapon2': '0.384', 'weapon4': '0.526', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'HITCOUNT': '2.340', 'weapon3': '2.606', 'DAMAGECOUNT': '10.500', 'FRAGCOUNT': '34.000'} [2023-02-24 21:01:55,274][213365] Updated weights for policy 0, policy_version 31766 (0.0009) [2023-02-24 21:01:55,304][213384] DAMAGECOUNT value on done: 329943.0 [2023-02-24 21:01:55,305][213384] Sum rewards: 51.278, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.836', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.170', 'AMMO4': '0.176', 'weapon2': '0.196', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.446', 'WEAPON3': '1.300', 'HITCOUNT': '2.720', 'weapon3': '2.932', 'DAMAGECOUNT': '13.569', 'FRAGCOUNT': '46.000'} [2023-02-24 21:01:55,333][213369] DAMAGECOUNT value on done: 325867.0 [2023-02-24 21:01:55,334][213369] Sum rewards: 36.509, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.290', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon5': '0.092', 'AMMO4': '0.194', 'AMMO3': '0.220', 'weapon4': '0.226', 'weapon2': '0.340', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.770', 'weapon3': '3.044', 'DAMAGECOUNT': '10.758', 'FRAGCOUNT': '37.000'} [2023-02-24 21:01:55,495][213383] DAMAGECOUNT value on done: 318012.0 [2023-02-24 21:01:55,495][213383] Sum rewards: 35.105, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.180', 'AMMO5': '0.011', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon4': '0.368', 'weapon2': '0.464', 'WEAPON3': '1.350', 'HITCOUNT': '2.370', 'weapon3': '2.810', 'DAMAGECOUNT': '10.101', 'FRAGCOUNT': '34.000'} [2023-02-24 21:01:55,555][213368] DAMAGECOUNT value on done: 316173.0 [2023-02-24 21:01:55,556][213368] Sum rewards: 36.749, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.870', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.034', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.212', 'AMMO3': '0.242', 'weapon2': '0.440', 'WEAPON3': '1.500', 'HITCOUNT': '2.610', 'weapon3': '3.102', 'DAMAGECOUNT': '11.385', 'FRAGCOUNT': '34.000'} [2023-02-24 21:01:55,564][213382] DAMAGECOUNT value on done: 328343.0 [2023-02-24 21:01:55,564][213382] Sum rewards: 37.536, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.380', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.015', 'ARMOR': '0.028', 'AMMO4': '0.060', 'weapon5': '0.112', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon4': '0.252', 'WEAPON5': '0.400', 'weapon2': '0.540', 'WEAPON3': '1.100', 'HITCOUNT': '2.300', 'weapon3': '2.876', 'DAMAGECOUNT': '10.080', 'FRAGCOUNT': '33.000'} [2023-02-24 21:01:55,605][213384] DAMAGECOUNT value on done: 314345.0 [2023-02-24 21:01:55,606][213384] Sum rewards: 45.333, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.738', 'AMMO5': '0.010', 'AMMO2': '0.040', 'AMMO3': '0.137', 'AMMO4': '0.202', 'weapon5': '0.204', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON4': '0.400', 'weapon4': '0.760', 'WEAPON3': '0.950', 'weapon3': '2.392', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.060', 'FRAGCOUNT': '37.000'} [2023-02-24 21:01:55,643][213369] DAMAGECOUNT value on done: 315209.0 [2023-02-24 21:01:55,644][213369] Sum rewards: 37.935, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.462', 'AMMO5': '0.003', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.138', 'weapon2': '0.186', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'ARMOR': '0.457', 'weapon4': '0.964', 'WEAPON3': '1.200', 'HITCOUNT': '2.430', 'weapon3': '2.530', 'DAMAGECOUNT': '10.098', 'FRAGCOUNT': '35.000'} [2023-02-24 21:01:55,913][213384] DAMAGECOUNT value on done: 328172.0 [2023-02-24 21:01:55,913][213384] Sum rewards: 39.292, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.480', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'weapon2': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.261', 'weapon4': '0.772', 'WEAPON3': '1.550', 'HITCOUNT': '2.470', 'weapon3': '2.768', 'DAMAGECOUNT': '11.088', 'FRAGCOUNT': '38.000'} [2023-02-24 21:01:56,201][213384] DAMAGECOUNT value on done: 329838.0 [2023-02-24 21:01:56,202][213384] Sum rewards: 42.126, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.470', 'AMMO2': '0.023', 'AMMO5': '0.024', 'AMMO4': '0.116', 'weapon2': '0.168', 'weapon5': '0.180', 'AMMO3': '0.251', 'WEAPON4': '0.400', 'weapon4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.550', 'weapon3': '2.746', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.348', 'FRAGCOUNT': '40.500'} [2023-02-24 21:01:58,249][213365] Updated weights for policy 0, policy_version 31776 (0.0009) [2023-02-24 21:02:00,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 130179072. Throughput: 0: 3368.0. Samples: 7540866. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:02:00,244][213332] Avg episode reward: [(0, '40.232')] [2023-02-24 21:02:01,277][213365] Updated weights for policy 0, policy_version 31786 (0.0008) [2023-02-24 21:02:04,347][213365] Updated weights for policy 0, policy_version 31796 (0.0009) [2023-02-24 21:02:05,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.6, 300 sec: 13440.4). Total num frames: 130244608. Throughput: 0: 3368.5. Samples: 7551166. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:02:05,243][213332] Avg episode reward: [(0, '40.232')] [2023-02-24 21:02:07,341][213365] Updated weights for policy 0, policy_version 31806 (0.0009) [2023-02-24 21:02:10,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 130314240. Throughput: 0: 3364.5. Samples: 7571274. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:02:10,243][213332] Avg episode reward: [(0, '40.232')] [2023-02-24 21:02:10,427][213365] Updated weights for policy 0, policy_version 31816 (0.0009) [2023-02-24 21:02:12,405][213367] DAMAGECOUNT value on done: 325968.0 [2023-02-24 21:02:12,406][213367] Sum rewards: 42.354, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-1.912', 'ARMOR': '0.004', 'AMMO5': '0.029', 'AMMO2': '0.054', 'AMMO4': '0.269', 'AMMO3': '0.270', 'weapon2': '0.276', 'weapon5': '0.292', 'weapon4': '0.436', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.500', 'HITCOUNT': '2.270', 'weapon3': '2.550', 'DAMAGECOUNT': '13.116', 'FRAGCOUNT': '43.000'} [2023-02-24 21:02:12,725][213367] DAMAGECOUNT value on done: 326760.0 [2023-02-24 21:02:12,726][213367] Sum rewards: 46.532, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.084', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'AMMO3': '0.204', 'weapon4': '0.286', 'WEAPON4': '0.350', 'weapon2': '0.610', 'WEAPON3': '1.350', 'weapon3': '2.804', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.623', 'FRAGCOUNT': '42.000'} [2023-02-24 21:02:12,869][213367] DAMAGECOUNT value on done: 329137.0 [2023-02-24 21:02:12,869][213367] Sum rewards: 41.614, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.424', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon5': '0.108', 'AMMO4': '0.131', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.274', 'weapon2': '0.352', 'WEAPON3': '1.350', 'HITCOUNT': '2.890', 'weapon3': '2.998', 'DAMAGECOUNT': '12.159', 'FRAGCOUNT': '39.000'} [2023-02-24 21:02:13,031][213372] DAMAGECOUNT value on done: 330463.0 [2023-02-24 21:02:13,031][213372] Sum rewards: 43.981, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.615', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.020', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.118', 'AMMO3': '0.205', 'weapon2': '0.614', 'WEAPON3': '1.200', 'HITCOUNT': '2.730', 'weapon3': '3.066', 'DAMAGECOUNT': '11.934', 'FRAGCOUNT': '39.000'} [2023-02-24 21:02:13,181][213367] DAMAGECOUNT value on done: 329831.0 [2023-02-24 21:02:13,182][213367] Sum rewards: 47.154, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.510', 'AMMO5': '0.012', 'AMMO2': '0.013', 'weapon5': '0.062', 'AMMO4': '0.064', 'WEAPON4': '0.150', 'weapon4': '0.162', 'AMMO3': '0.232', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON3': '1.350', 'HITCOUNT': '2.770', 'weapon3': '3.272', 'DAMAGECOUNT': '12.549', 'FRAGCOUNT': '41.000'} [2023-02-24 21:02:13,360][213372] DAMAGECOUNT value on done: 326430.0 [2023-02-24 21:02:13,361][213372] Sum rewards: 53.100, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.552', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.172', 'weapon5': '0.174', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON4': '0.350', 'weapon4': '0.652', 'WEAPON3': '1.000', 'weapon3': '2.580', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.461', 'FRAGCOUNT': '44.000'} [2023-02-24 21:02:13,369][213372] DAMAGECOUNT value on done: 334592.0 [2023-02-24 21:02:13,370][213372] Sum rewards: 43.238, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.017', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.144', 'AMMO3': '0.186', 'AMMO4': '0.216', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.414', 'weapon4': '0.530', 'WEAPON3': '1.100', 'weapon3': '2.492', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '12.123', 'FRAGCOUNT': '38.000'} [2023-02-24 21:02:13,452][213365] Updated weights for policy 0, policy_version 31826 (0.0009) [2023-02-24 21:02:13,593][213366] DAMAGECOUNT value on done: 324081.0 [2023-02-24 21:02:13,594][213366] Sum rewards: 44.911, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.565', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.029', 'AMMO2': '0.034', 'AMMO4': '0.172', 'weapon2': '0.190', 'AMMO3': '0.221', 'weapon5': '0.224', 'WEAPON4': '0.300', 'weapon4': '0.374', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'HITCOUNT': '2.470', 'weapon3': '2.864', 'DAMAGECOUNT': '12.135', 'FRAGCOUNT': '40.000'} [2023-02-24 21:02:13,683][213372] DAMAGECOUNT value on done: 321899.0 [2023-02-24 21:02:13,683][213372] Sum rewards: 38.308, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.070', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.068', 'AMMO3': '0.206', 'AMMO4': '0.206', 'WEAPON5': '0.250', 'weapon4': '0.272', 'WEAPON4': '0.400', 'weapon2': '0.422', 'WEAPON3': '1.200', 'HITCOUNT': '2.220', 'weapon3': '3.016', 'DAMAGECOUNT': '10.062', 'FRAGCOUNT': '37.000'} [2023-02-24 21:02:13,896][213366] DAMAGECOUNT value on done: 332073.0 [2023-02-24 21:02:13,897][213366] Sum rewards: 36.473, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.194', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.088', 'AMMO3': '0.155', 'AMMO4': '0.191', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.512', 'weapon2': '0.568', 'WEAPON3': '1.100', 'weapon3': '2.662', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '11.112', 'FRAGCOUNT': '32.000'} [2023-02-24 21:02:13,917][213366] DAMAGECOUNT value on done: 336861.0 [2023-02-24 21:02:13,918][213366] Sum rewards: 46.525, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.142', 'ARMOR': '0.008', 'AMMO5': '0.021', 'AMMO2': '0.032', 'AMMO4': '0.162', 'weapon5': '0.222', 'AMMO3': '0.228', 'weapon4': '0.228', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.350', 'HITCOUNT': '2.730', 'weapon3': '2.732', 'DAMAGECOUNT': '13.080', 'FRAGCOUNT': '44.000'} [2023-02-24 21:02:14,219][213366] DAMAGECOUNT value on done: 327351.0 [2023-02-24 21:02:14,220][213366] Sum rewards: 22.422, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.751', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon7': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.122', 'weapon4': '0.176', 'AMMO3': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.832', 'WEAPON3': '1.200', 'HITCOUNT': '1.880', 'weapon3': '2.374', 'DAMAGECOUNT': '8.352', 'FRAGCOUNT': '23.500'} [2023-02-24 21:02:14,246][213383] DAMAGECOUNT value on done: 324523.0 [2023-02-24 21:02:14,246][213383] Sum rewards: 40.728, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.102', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO4': '0.200', 'weapon2': '0.202', 'AMMO3': '0.204', 'WEAPON4': '0.400', 'weapon4': '0.534', 'WEAPON3': '1.200', 'weapon3': '2.898', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '11.970', 'FRAGCOUNT': '37.000'} [2023-02-24 21:02:14,561][213383] DAMAGECOUNT value on done: 327832.0 [2023-02-24 21:02:14,562][213383] Sum rewards: 46.344, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.320', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon2': '0.152', 'weapon5': '0.152', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.380', 'WEAPON3': '1.200', 'HITCOUNT': '2.600', 'weapon3': '3.046', 'DAMAGECOUNT': '12.111', 'FRAGCOUNT': '43.000'} [2023-02-24 21:02:14,572][213382] DAMAGECOUNT value on done: 329279.0 [2023-02-24 21:02:14,573][213382] Sum rewards: 53.508, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.578', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.156', 'weapon2': '0.230', 'WEAPON4': '0.250', 'AMMO3': '0.257', 'WEAPON5': '0.300', 'weapon4': '0.376', 'WEAPON3': '1.600', 'weapon3': '2.878', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.895', 'FRAGCOUNT': '49.000'} [2023-02-24 21:02:14,611][213369] DAMAGECOUNT value on done: 332171.0 [2023-02-24 21:02:14,611][213369] Sum rewards: 40.211, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.964', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon5': '0.164', 'AMMO3': '0.173', 'AMMO4': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.500', 'weapon2': '0.568', 'WEAPON3': '0.950', 'weapon3': '2.384', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '11.631', 'FRAGCOUNT': '36.000'} [2023-02-24 21:02:14,614][213368] DAMAGECOUNT value on done: 325007.0 [2023-02-24 21:02:14,615][213368] Sum rewards: 45.541, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.559', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.060', 'AMMO3': '0.144', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'weapon4': '0.170', 'WEAPON5': '0.200', 'weapon2': '0.530', 'WEAPON3': '0.900', 'HITCOUNT': '2.730', 'weapon3': '3.036', 'DAMAGECOUNT': '12.495', 'FRAGCOUNT': '36.000'} [2023-02-24 21:02:14,630][213372] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 21:02:14,879][213382] DAMAGECOUNT value on done: 328684.0 [2023-02-24 21:02:14,880][213382] Sum rewards: 40.289, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.312', 'ARMOR': '0.008', 'AMMO5': '0.026', 'AMMO2': '0.058', 'AMMO3': '0.092', 'weapon5': '0.258', 'AMMO4': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'weapon2': '0.678', 'weapon4': '0.706', 'weapon3': '2.036', 'HITCOUNT': '2.310', 'DAMAGECOUNT': '10.386', 'FRAGCOUNT': '32.000'} [2023-02-24 21:02:14,922][213369] DAMAGECOUNT value on done: 327042.0 [2023-02-24 21:02:14,922][213369] Sum rewards: 39.305, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.743', 'AMMO5': '0.016', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.166', 'AMMO3': '0.171', 'weapon2': '0.256', 'WEAPON4': '0.300', 'weapon4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '2.400', 'weapon3': '3.016', 'DAMAGECOUNT': '11.100', 'FRAGCOUNT': '34.500'} [2023-02-24 21:02:14,927][213368] DAMAGECOUNT value on done: 330222.0 [2023-02-24 21:02:14,927][213368] Sum rewards: 29.268, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.460', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'AMMO4': '0.207', 'weapon2': '0.288', 'WEAPON4': '0.400', 'weapon4': '0.840', 'WEAPON3': '1.000', 'HITCOUNT': '1.750', 'weapon3': '2.476', 'DAMAGECOUNT': '8.031', 'FRAGCOUNT': '27.000'} [2023-02-24 21:02:15,177][213368] DAMAGECOUNT value on done: 329286.0 [2023-02-24 21:02:15,177][213368] Sum rewards: 39.862, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.800', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon5': '0.144', 'AMMO3': '0.184', 'AMMO4': '0.191', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.530', 'weapon2': '0.582', 'WEAPON3': '1.050', 'weapon3': '2.326', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '11.082', 'FRAGCOUNT': '32.500'} [2023-02-24 21:02:15,186][213382] DAMAGECOUNT value on done: 320274.0 [2023-02-24 21:02:15,186][213383] DAMAGECOUNT value on done: 326352.0 [2023-02-24 21:02:15,187][213382] Sum rewards: 40.458, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.187', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO5': '0.019', 'AMMO2': '0.062', 'AMMO3': '0.126', 'weapon5': '0.178', 'weapon2': '0.248', 'AMMO4': '0.310', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'WEAPON4': '0.850', 'weapon4': '1.276', 'weapon3': '1.872', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '11.232', 'FRAGCOUNT': '36.000'} [2023-02-24 21:02:15,187][213383] Sum rewards: 45.479, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.900', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon4': '0.052', 'weapon5': '0.078', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'WEAPON3': '0.850', 'weapon2': '0.864', 'HITCOUNT': '2.540', 'weapon3': '2.748', 'DAMAGECOUNT': '12.837', 'FRAGCOUNT': '38.500'} [2023-02-24 21:02:15,224][213369] DAMAGECOUNT value on done: 329628.0 [2023-02-24 21:02:15,224][213369] Sum rewards: 46.121, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.910', 'AMMO5': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.076', 'AMMO3': '0.122', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.348', 'weapon2': '0.764', 'WEAPON3': '0.850', 'weapon3': '2.660', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '11.283', 'FRAGCOUNT': '39.000'} [2023-02-24 21:02:15,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 130379776. Throughput: 0: 3365.2. Samples: 7591414. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:02:15,243][213332] Avg episode reward: [(0, '40.793')] [2023-02-24 21:02:15,289][213384] DAMAGECOUNT value on done: 334163.0 [2023-02-24 21:02:15,289][213384] Sum rewards: 45.085, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.470', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.046', 'AMMO4': '0.107', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.524', 'weapon4': '0.762', 'WEAPON3': '1.050', 'weapon3': '2.448', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '12.660', 'FRAGCOUNT': '38.000'} [2023-02-24 21:02:15,481][213368] DAMAGECOUNT value on done: 320410.0 [2023-02-24 21:02:15,482][213368] Sum rewards: 35.253, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.994', 'AMMO5': '0.030', 'AMMO2': '0.041', 'AMMO4': '0.205', 'AMMO3': '0.242', 'weapon2': '0.376', 'weapon4': '0.490', 'WEAPON4': '0.500', 'weapon5': '0.574', 'WEAPON5': '0.700', 'WEAPON3': '1.350', 'HITCOUNT': '2.020', 'weapon3': '2.038', 'DAMAGECOUNT': '12.681', 'FRAGCOUNT': '32.000'} [2023-02-24 21:02:15,486][213383] DAMAGECOUNT value on done: 321307.0 [2023-02-24 21:02:15,487][213383] Sum rewards: 33.717, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.240', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon5': '0.098', 'AMMO3': '0.141', 'AMMO4': '0.208', 'weapon2': '0.364', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.642', 'WEAPON3': '0.900', 'HITCOUNT': '2.220', 'weapon3': '2.732', 'DAMAGECOUNT': '9.489', 'FRAGCOUNT': '31.000'} [2023-02-24 21:02:15,490][213382] DAMAGECOUNT value on done: 332442.0 [2023-02-24 21:02:15,491][213382] Sum rewards: 49.549, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.714', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.019', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'weapon4': '0.128', 'AMMO3': '0.178', 'weapon2': '0.326', 'WEAPON3': '1.100', 'HITCOUNT': '2.590', 'weapon3': '3.328', 'DAMAGECOUNT': '12.297', 'FRAGCOUNT': '42.000'} [2023-02-24 21:02:15,530][213369] DAMAGECOUNT value on done: 319241.0 [2023-02-24 21:02:15,530][213369] Sum rewards: 44.563, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.980', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.118', 'AMMO3': '0.151', 'AMMO4': '0.167', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.578', 'weapon4': '0.622', 'WEAPON3': '0.900', 'weapon3': '2.328', 'HITCOUNT': '2.340', 'DAMAGECOUNT': '12.096', 'FRAGCOUNT': '37.000'} [2023-02-24 21:02:15,591][213384] DAMAGECOUNT value on done: 318431.0 [2023-02-24 21:02:15,592][213384] Sum rewards: 43.675, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.632', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.057', 'AMMO3': '0.167', 'weapon5': '0.208', 'AMMO4': '0.283', 'WEAPON5': '0.450', 'weapon2': '0.466', 'WEAPON4': '0.550', 'weapon4': '0.618', 'WEAPON3': '0.900', 'weapon3': '2.336', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '12.258', 'FRAGCOUNT': '38.500'} [2023-02-24 21:02:15,894][213384] DAMAGECOUNT value on done: 331840.0 [2023-02-24 21:02:15,894][213384] Sum rewards: 36.864, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.491', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.124', 'AMMO3': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.432', 'weapon4': '0.510', 'WEAPON3': '1.200', 'HITCOUNT': '2.510', 'weapon3': '2.700', 'DAMAGECOUNT': '11.004', 'FRAGCOUNT': '34.000'} [2023-02-24 21:02:16,192][213384] DAMAGECOUNT value on done: 334495.0 [2023-02-24 21:02:16,193][213384] Sum rewards: 49.752, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.400', 'WEAPON1': '0.010', 'AMMO5': '0.023', 'AMMO2': '0.034', 'AMMO4': '0.172', 'AMMO3': '0.193', 'weapon5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.536', 'WEAPON5': '0.600', 'weapon2': '0.764', 'WEAPON3': '1.150', 'weapon3': '1.938', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '13.971', 'FRAGCOUNT': '43.000'} [2023-02-24 21:02:16,451][213365] Updated weights for policy 0, policy_version 31836 (0.0009) [2023-02-24 21:02:19,550][213365] Updated weights for policy 0, policy_version 31846 (0.0009) [2023-02-24 21:02:20,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 130449408. Throughput: 0: 3366.5. Samples: 7601660. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:02:20,243][213332] Avg episode reward: [(0, '40.951')] [2023-02-24 21:02:20,244][213352] Saving new best policy, reward=40.951! [2023-02-24 21:02:21,665][213367] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 21:02:22,533][213365] Updated weights for policy 0, policy_version 31856 (0.0009) [2023-02-24 21:02:25,243][213332] Fps is (10 sec: 13516.5, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 130514944. Throughput: 0: 3367.7. Samples: 7621834. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:02:25,244][213332] Avg episode reward: [(0, '40.951')] [2023-02-24 21:02:25,589][213365] Updated weights for policy 0, policy_version 31866 (0.0009) [2023-02-24 21:02:28,642][213365] Updated weights for policy 0, policy_version 31876 (0.0009) [2023-02-24 21:02:30,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13468.2). Total num frames: 130584576. Throughput: 0: 3366.8. Samples: 7641886. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:02:30,243][213332] Avg episode reward: [(0, '40.951')] [2023-02-24 21:02:31,648][213365] Updated weights for policy 0, policy_version 31886 (0.0009) [2023-02-24 21:02:32,349][213367] DAMAGECOUNT value on done: 329434.0 [2023-02-24 21:02:32,349][213367] Sum rewards: 31.512, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.422', 'AMMO5': '0.012', 'AMMO2': '0.016', 'weapon4': '0.022', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'weapon5': '0.120', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.408', 'WEAPON3': '1.300', 'HITCOUNT': '2.310', 'weapon3': '3.202', 'DAMAGECOUNT': '10.398', 'FRAGCOUNT': '29.000'} [2023-02-24 21:02:32,664][213367] DAMAGECOUNT value on done: 330154.0 [2023-02-24 21:02:32,664][213367] Sum rewards: 39.579, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.017', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.155', 'AMMO3': '0.160', 'weapon2': '0.204', 'weapon5': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.334', 'WEAPON3': '0.900', 'HITCOUNT': '2.380', 'weapon3': '2.906', 'DAMAGECOUNT': '10.182', 'FRAGCOUNT': '33.500'} [2023-02-24 21:02:32,787][213367] DAMAGECOUNT value on done: 332930.0 [2023-02-24 21:02:32,788][213367] Sum rewards: 40.064, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.672', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.125', 'weapon5': '0.258', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.638', 'WEAPON3': '0.800', 'weapon4': '0.894', 'weapon3': '1.882', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '11.109', 'FRAGCOUNT': '32.000'} [2023-02-24 21:02:32,987][213372] DAMAGECOUNT value on done: 335175.0 [2023-02-24 21:02:32,987][213372] Sum rewards: 52.737, reward structure: {'DEATHCOUNT': '-11.250', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.026', 'AMMO3': '0.125', 'AMMO4': '0.130', 'WEAPON4': '0.250', 'weapon5': '0.310', 'weapon2': '0.312', 'weapon4': '0.318', 'HEALTH': '0.333', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'HITCOUNT': '2.400', 'weapon3': '2.716', 'DAMAGECOUNT': '13.896', 'FRAGCOUNT': '42.000'} [2023-02-24 21:02:33,101][213367] DAMAGECOUNT value on done: 333318.0 [2023-02-24 21:02:33,101][213367] Sum rewards: 34.307, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.460', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.031', 'weapon4': '0.114', 'AMMO4': '0.154', 'weapon5': '0.168', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'weapon2': '0.496', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.280', 'weapon3': '2.922', 'DAMAGECOUNT': '10.221', 'FRAGCOUNT': '31.500'} [2023-02-24 21:02:33,291][213372] DAMAGECOUNT value on done: 330220.0 [2023-02-24 21:02:33,292][213372] Sum rewards: 46.723, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.085', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'weapon5': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.127', 'weapon2': '0.328', 'weapon4': '0.486', 'WEAPON3': '0.800', 'HITCOUNT': '2.610', 'weapon3': '2.704', 'DAMAGECOUNT': '11.325', 'FRAGCOUNT': '37.000'} [2023-02-24 21:02:33,301][213372] DAMAGECOUNT value on done: 339096.0 [2023-02-24 21:02:33,301][213372] Sum rewards: 45.692, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.480', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.033', 'AMMO4': '0.167', 'weapon2': '0.198', 'weapon4': '0.234', 'weapon5': '0.234', 'AMMO3': '0.259', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '2.510', 'weapon3': '2.952', 'DAMAGECOUNT': '13.512', 'FRAGCOUNT': '43.000'} [2023-02-24 21:02:33,546][213366] DAMAGECOUNT value on done: 328249.0 [2023-02-24 21:02:33,547][213366] Sum rewards: 46.002, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.152', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.012', 'weapon5': '0.036', 'AMMO4': '0.059', 'weapon4': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.372', 'WEAPON3': '1.250', 'HITCOUNT': '2.740', 'weapon3': '3.230', 'DAMAGECOUNT': '12.504', 'FRAGCOUNT': '40.000'} [2023-02-24 21:02:33,615][213372] DAMAGECOUNT value on done: 325680.0 [2023-02-24 21:02:33,615][213372] Sum rewards: 45.779, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.930', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.178', 'weapon2': '0.336', 'WEAPON3': '1.100', 'HITCOUNT': '2.680', 'weapon3': '3.484', 'DAMAGECOUNT': '11.343', 'FRAGCOUNT': '38.000'} [2023-02-24 21:02:33,852][213366] DAMAGECOUNT value on done: 335950.0 [2023-02-24 21:02:33,853][213366] Sum rewards: 41.759, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.400', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.014', 'AMMO4': '0.057', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'weapon4': '0.392', 'weapon2': '0.580', 'WEAPON3': '1.400', 'HITCOUNT': '2.720', 'weapon3': '2.816', 'DAMAGECOUNT': '11.631', 'FRAGCOUNT': '39.000'} [2023-02-24 21:02:33,874][213366] DAMAGECOUNT value on done: 340617.0 [2023-02-24 21:02:33,875][213366] Sum rewards: 44.082, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.074', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon5': '0.058', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'ARMOR': '0.440', 'weapon2': '0.496', 'weapon4': '0.730', 'WEAPON3': '1.000', 'weapon3': '2.506', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '11.268', 'FRAGCOUNT': '36.000'} [2023-02-24 21:02:34,174][213366] DAMAGECOUNT value on done: 329651.0 [2023-02-24 21:02:34,174][213366] Sum rewards: 16.421, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.414', 'AMMO5': '0.010', 'AMMO2': '0.057', 'AMMO3': '0.141', 'weapon5': '0.196', 'AMMO4': '0.283', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.554', 'WEAPON3': '0.800', 'weapon4': '0.884', 'weapon3': '1.650', 'HITCOUNT': '1.660', 'DAMAGECOUNT': '6.900', 'FRAGCOUNT': '17.000'} [2023-02-24 21:02:34,310][213383] DAMAGECOUNT value on done: 328027.0 [2023-02-24 21:02:34,311][213383] Sum rewards: 38.089, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.122', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.110', 'AMMO4': '0.155', 'AMMO3': '0.222', 'weapon2': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.928', 'WEAPON3': '1.250', 'weapon3': '2.416', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '10.512', 'FRAGCOUNT': '36.000'} [2023-02-24 21:02:34,591][213382] DAMAGECOUNT value on done: 332575.0 [2023-02-24 21:02:34,592][213382] Sum rewards: 33.280, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.900', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.084', 'AMMO4': '0.103', 'AMMO3': '0.175', 'weapon5': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'weapon2': '0.442', 'WEAPON3': '1.100', 'HITCOUNT': '1.980', 'weapon3': '2.602', 'DAMAGECOUNT': '9.888', 'FRAGCOUNT': '29.000'} [2023-02-24 21:02:34,594][213369] DAMAGECOUNT value on done: 336313.0 [2023-02-24 21:02:34,595][213369] Sum rewards: 48.182, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.992', 'AMMO5': '0.022', 'AMMO2': '0.039', 'AMMO4': '0.193', 'AMMO3': '0.195', 'weapon5': '0.210', 'weapon4': '0.226', 'WEAPON4': '0.400', 'weapon2': '0.408', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'HITCOUNT': '2.720', 'weapon3': '2.834', 'DAMAGECOUNT': '12.426', 'FRAGCOUNT': '43.000'} [2023-02-24 21:02:34,620][213383] DAMAGECOUNT value on done: 331756.0 [2023-02-24 21:02:34,620][213383] Sum rewards: 40.683, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.655', 'AMMO2': '0.015', 'AMMO5': '0.020', 'AMMO4': '0.073', 'weapon4': '0.090', 'weapon5': '0.092', 'WEAPON4': '0.150', 'weapon2': '0.216', 'AMMO3': '0.248', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '2.460', 'weapon3': '3.302', 'DAMAGECOUNT': '11.772', 'FRAGCOUNT': '38.000'} [2023-02-24 21:02:34,632][213368] DAMAGECOUNT value on done: 328655.0 [2023-02-24 21:02:34,633][213368] Sum rewards: 41.057, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.215', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.072', 'weapon2': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon4': '0.430', 'WEAPON3': '1.250', 'HITCOUNT': '2.720', 'weapon3': '3.136', 'DAMAGECOUNT': '10.899', 'FRAGCOUNT': '36.000'} [2023-02-24 21:02:34,776][213365] Updated weights for policy 0, policy_version 31896 (0.0009) [2023-02-24 21:02:34,900][213382] DAMAGECOUNT value on done: 332980.0 [2023-02-24 21:02:34,901][213382] Sum rewards: 51.775, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.082', 'HEALTH': '0.114', 'AMMO4': '0.135', 'AMMO3': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.492', 'weapon2': '0.658', 'WEAPON3': '0.800', 'weapon3': '2.554', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '12.888', 'FRAGCOUNT': '41.000'} [2023-02-24 21:02:34,902][213369] DAMAGECOUNT value on done: 330446.0 [2023-02-24 21:02:34,902][213369] Sum rewards: 34.071, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.935', 'AMMO2': '0.005', 'AMMO5': '0.014', 'AMMO4': '0.027', 'weapon5': '0.054', 'AMMO3': '0.297', 'WEAPON5': '0.300', 'weapon2': '0.570', 'WEAPON3': '1.550', 'HITCOUNT': '2.430', 'weapon3': '3.046', 'DAMAGECOUNT': '10.212', 'FRAGCOUNT': '33.000'} [2023-02-24 21:02:34,940][213368] DAMAGECOUNT value on done: 334143.0 [2023-02-24 21:02:34,941][213368] Sum rewards: 41.668, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.926', 'AMMO5': '0.015', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.287', 'WEAPON5': '0.300', 'weapon2': '0.464', 'weapon4': '0.464', 'WEAPON3': '1.700', 'weapon3': '2.572', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '11.763', 'FRAGCOUNT': '42.000'} [2023-02-24 21:02:35,191][213368] DAMAGECOUNT value on done: 333099.0 [2023-02-24 21:02:35,192][213368] Sum rewards: 43.969, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.408', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.064', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.190', 'WEAPON4': '0.300', 'weapon4': '0.346', 'WEAPON3': '1.150', 'weapon2': '1.192', 'weapon3': '2.094', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '11.439', 'FRAGCOUNT': '38.000'} [2023-02-24 21:02:35,193][213382] DAMAGECOUNT value on done: 323693.0 [2023-02-24 21:02:35,194][213382] Sum rewards: 36.920, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.340', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.148', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.580', 'weapon2': '0.648', 'WEAPON3': '1.200', 'weapon3': '2.284', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '10.257', 'FRAGCOUNT': '35.000'} [2023-02-24 21:02:35,200][213369] DAMAGECOUNT value on done: 333658.0 [2023-02-24 21:02:35,200][213369] Sum rewards: 43.791, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.280', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.066', 'WEAPON4': '0.150', 'weapon4': '0.220', 'AMMO3': '0.223', 'weapon2': '0.392', 'WEAPON3': '1.300', 'HITCOUNT': '2.650', 'weapon3': '3.102', 'DAMAGECOUNT': '12.090', 'FRAGCOUNT': '39.000'} [2023-02-24 21:02:35,229][213383] DAMAGECOUNT value on done: 330406.0 [2023-02-24 21:02:35,230][213383] Sum rewards: 46.598, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.792', 'AMMO5': '0.005', 'AMMO2': '0.009', 'ARMOR': '0.035', 'AMMO4': '0.044', 'weapon5': '0.056', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.192', 'AMMO3': '0.197', 'weapon2': '0.294', 'WEAPON3': '1.200', 'HITCOUNT': '2.680', 'weapon3': '3.266', 'DAMAGECOUNT': '12.162', 'FRAGCOUNT': '39.000'} [2023-02-24 21:02:35,243][213332] Fps is (10 sec: 13517.0, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 130650112. Throughput: 0: 3365.1. Samples: 7652052. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:02:35,243][213332] Avg episode reward: [(0, '41.354')] [2023-02-24 21:02:35,247][213352] Saving new best policy, reward=41.354! [2023-02-24 21:02:35,282][213384] DAMAGECOUNT value on done: 338122.0 [2023-02-24 21:02:35,283][213384] Sum rewards: 41.121, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.139', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.036', 'AMMO4': '0.179', 'weapon5': '0.210', 'AMMO3': '0.217', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.436', 'weapon4': '0.694', 'WEAPON3': '1.200', 'weapon3': '2.220', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '11.877', 'FRAGCOUNT': '39.000'} [2023-02-24 21:02:35,498][213382] DAMAGECOUNT value on done: 336155.0 [2023-02-24 21:02:35,498][213382] Sum rewards: 40.375, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.230', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.012', 'AMMO4': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.246', 'weapon2': '0.342', 'WEAPON3': '1.450', 'HITCOUNT': '2.520', 'weapon3': '3.474', 'DAMAGECOUNT': '11.139', 'FRAGCOUNT': '36.000'} [2023-02-24 21:02:35,507][213368] DAMAGECOUNT value on done: 324466.0 [2023-02-24 21:02:35,507][213368] Sum rewards: 43.287, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.120', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.140', 'AMMO4': '0.186', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.322', 'weapon4': '0.692', 'WEAPON3': '1.150', 'weapon3': '2.300', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '12.168', 'FRAGCOUNT': '38.000'} [2023-02-24 21:02:35,513][213369] DAMAGECOUNT value on done: 322442.0 [2023-02-24 21:02:35,513][213369] Sum rewards: 31.633, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.932', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.154', 'AMMO3': '0.190', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.402', 'weapon4': '0.452', 'WEAPON3': '1.200', 'HITCOUNT': '2.080', 'weapon3': '2.694', 'DAMAGECOUNT': '9.603', 'FRAGCOUNT': '29.500'} [2023-02-24 21:02:35,537][213383] DAMAGECOUNT value on done: 325201.0 [2023-02-24 21:02:35,538][213383] Sum rewards: 45.748, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.562', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon7': '0.080', 'weapon5': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.124', 'AMMO3': '0.137', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.480', 'WEAPON3': '0.850', 'weapon4': '1.066', 'weapon3': '2.010', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '11.682', 'FRAGCOUNT': '39.000'} [2023-02-24 21:02:35,586][213384] DAMAGECOUNT value on done: 322162.0 [2023-02-24 21:02:35,586][213384] Sum rewards: 42.725, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.836', 'AMMO5': '0.018', 'AMMO2': '0.041', 'AMMO3': '0.161', 'AMMO4': '0.207', 'weapon5': '0.250', 'weapon2': '0.476', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.604', 'WEAPON3': '1.000', 'weapon3': '2.260', 'HITCOUNT': '2.350', 'DAMAGECOUNT': '11.193', 'FRAGCOUNT': '37.000'} [2023-02-24 21:02:35,896][213384] DAMAGECOUNT value on done: 334044.0 [2023-02-24 21:02:35,897][213384] Sum rewards: 17.649, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.240', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.043', 'weapon5': '0.096', 'weapon7': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'AMMO4': '0.216', 'WEAPON4': '0.500', 'weapon2': '0.560', 'weapon4': '0.810', 'WEAPON3': '0.950', 'HITCOUNT': '1.630', 'weapon3': '1.944', 'DAMAGECOUNT': '6.612', 'FRAGCOUNT': '18.500'} [2023-02-24 21:02:36,198][213384] DAMAGECOUNT value on done: 338350.0 [2023-02-24 21:02:36,199][213384] Sum rewards: 37.917, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.990', 'AMMO5': '0.017', 'AMMO2': '0.024', 'weapon5': '0.096', 'AMMO4': '0.120', 'weapon4': '0.210', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.694', 'WEAPON3': '1.400', 'HITCOUNT': '2.590', 'weapon3': '2.688', 'DAMAGECOUNT': '11.145', 'FRAGCOUNT': '36.000'} [2023-02-24 21:02:37,757][213365] Updated weights for policy 0, policy_version 31906 (0.0008) [2023-02-24 21:02:40,243][213332] Fps is (10 sec: 13107.3, 60 sec: 13448.6, 300 sec: 13454.3). Total num frames: 130715648. Throughput: 0: 3364.0. Samples: 7672176. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:02:40,243][213332] Avg episode reward: [(0, '41.092')] [2023-02-24 21:02:40,835][213365] Updated weights for policy 0, policy_version 31916 (0.0009) [2023-02-24 21:02:43,862][213365] Updated weights for policy 0, policy_version 31926 (0.0009) [2023-02-24 21:02:45,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 130785280. Throughput: 0: 3364.8. Samples: 7692282. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:02:45,243][213332] Avg episode reward: [(0, '41.092')] [2023-02-24 21:02:45,247][213352] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000031930_130785280.pth... [2023-02-24 21:02:45,307][213352] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000031141_127553536.pth [2023-02-24 21:02:46,870][213365] Updated weights for policy 0, policy_version 31936 (0.0009) [2023-02-24 21:02:49,932][213365] Updated weights for policy 0, policy_version 31946 (0.0009) [2023-02-24 21:02:50,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13516.8, 300 sec: 13468.2). Total num frames: 130854912. Throughput: 0: 3362.6. Samples: 7702484. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:02:50,243][213332] Avg episode reward: [(0, '41.092')] [2023-02-24 21:02:52,315][213367] DAMAGECOUNT value on done: 333382.0 [2023-02-24 21:02:52,316][213367] Sum rewards: 49.091, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.880', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.181', 'weapon5': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.304', 'weapon2': '0.382', 'WEAPON3': '1.050', 'HITCOUNT': '2.750', 'weapon3': '2.858', 'DAMAGECOUNT': '11.844', 'FRAGCOUNT': '41.000'} [2023-02-24 21:02:52,640][213367] DAMAGECOUNT value on done: 334332.0 [2023-02-24 21:02:52,641][213367] Sum rewards: 45.464, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.872', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon5': '0.118', 'AMMO4': '0.139', 'AMMO3': '0.176', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.498', 'weapon4': '0.516', 'WEAPON3': '1.200', 'weapon3': '2.644', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.534', 'FRAGCOUNT': '42.000'} [2023-02-24 21:02:52,736][213367] DAMAGECOUNT value on done: 336022.0 [2023-02-24 21:02:52,736][213367] Sum rewards: 31.964, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.020', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.020', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'weapon4': '0.164', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'weapon2': '0.410', 'WEAPON3': '1.300', 'HITCOUNT': '2.310', 'weapon3': '3.132', 'DAMAGECOUNT': '9.276', 'FRAGCOUNT': '31.500'} [2023-02-24 21:02:52,890][213372] DAMAGECOUNT value on done: 339179.0 [2023-02-24 21:02:52,891][213372] Sum rewards: 44.424, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.830', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.078', 'AMMO4': '0.126', 'AMMO3': '0.183', 'weapon2': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.968', 'WEAPON3': '1.100', 'weapon3': '2.338', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.012', 'FRAGCOUNT': '38.000'} [2023-02-24 21:02:52,913][213365] Updated weights for policy 0, policy_version 31956 (0.0008) [2023-02-24 21:02:53,067][213367] DAMAGECOUNT value on done: 337170.0 [2023-02-24 21:02:53,067][213367] Sum rewards: 44.088, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.620', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'weapon2': '0.264', 'weapon4': '0.524', 'WEAPON3': '0.950', 'HITCOUNT': '2.740', 'weapon3': '2.876', 'DAMAGECOUNT': '11.556', 'FRAGCOUNT': '37.000'} [2023-02-24 21:02:53,188][213372] DAMAGECOUNT value on done: 334271.0 [2023-02-24 21:02:53,188][213372] Sum rewards: 40.182, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.420', 'AMMO5': '0.014', 'weapon5': '0.034', 'AMMO2': '0.053', 'AMMO3': '0.172', 'AMMO4': '0.263', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.534', 'weapon2': '0.574', 'WEAPON3': '1.050', 'weapon3': '2.560', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.048', 'FRAGCOUNT': '35.000'} [2023-02-24 21:02:53,197][213372] DAMAGECOUNT value on done: 342423.0 [2023-02-24 21:02:53,197][213372] Sum rewards: 37.538, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.130', 'AMMO5': '0.017', 'AMMO2': '0.019', 'weapon5': '0.074', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'weapon4': '0.290', 'WEAPON5': '0.300', 'weapon2': '0.924', 'WEAPON3': '1.250', 'weapon3': '2.266', 'HITCOUNT': '2.350', 'DAMAGECOUNT': '9.981', 'FRAGCOUNT': '34.000'} [2023-02-24 21:02:53,442][213366] DAMAGECOUNT value on done: 332115.0 [2023-02-24 21:02:53,442][213366] Sum rewards: 48.564, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.530', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.011', 'weapon5': '0.112', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.362', 'WEAPON3': '1.300', 'HITCOUNT': '3.050', 'weapon3': '3.224', 'DAMAGECOUNT': '11.598', 'FRAGCOUNT': '42.000'} [2023-02-24 21:02:53,504][213372] DAMAGECOUNT value on done: 328526.0 [2023-02-24 21:02:53,504][213372] Sum rewards: 32.167, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.604', 'AMMO5': '0.010', 'AMMO2': '0.022', 'ARMOR': '0.028', 'weapon7': '0.052', 'weapon5': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.109', 'WEAPON4': '0.150', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'weapon4': '0.328', 'weapon2': '0.810', 'WEAPON3': '1.100', 'HITCOUNT': '1.910', 'weapon3': '2.216', 'DAMAGECOUNT': '8.538', 'FRAGCOUNT': '29.000'} [2023-02-24 21:02:53,750][213366] DAMAGECOUNT value on done: 339060.0 [2023-02-24 21:02:53,751][213366] Sum rewards: 39.261, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.715', 'AMMO5': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon4': '0.140', 'AMMO3': '0.147', 'weapon5': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.500', 'weapon2': '0.676', 'WEAPON3': '0.950', 'HITCOUNT': '2.140', 'weapon3': '2.728', 'DAMAGECOUNT': '9.330', 'FRAGCOUNT': '35.000'} [2023-02-24 21:02:53,770][213366] DAMAGECOUNT value on done: 344753.0 [2023-02-24 21:02:53,771][213366] Sum rewards: 43.623, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.670', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon5': '0.140', 'AMMO3': '0.152', 'AMMO4': '0.222', 'WEAPON5': '0.350', 'weapon2': '0.362', 'WEAPON4': '0.500', 'weapon4': '0.504', 'WEAPON3': '0.950', 'weapon3': '2.630', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.408', 'FRAGCOUNT': '40.000'} [2023-02-24 21:02:54,081][213366] DAMAGECOUNT value on done: 334329.0 [2023-02-24 21:02:54,081][213366] Sum rewards: 54.114, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.880', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon4': '0.096', 'AMMO4': '0.109', 'weapon5': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'weapon2': '0.408', 'WEAPON3': '1.050', 'HITCOUNT': '2.940', 'weapon3': '3.194', 'DAMAGECOUNT': '14.034', 'FRAGCOUNT': '44.000'} [2023-02-24 21:02:54,332][213383] DAMAGECOUNT value on done: 332231.0 [2023-02-24 21:02:54,333][213383] Sum rewards: 40.853, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.448', 'AMMO2': '0.011', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'weapon4': '0.122', 'weapon5': '0.154', 'AMMO3': '0.260', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.600', 'HITCOUNT': '2.660', 'weapon3': '3.076', 'DAMAGECOUNT': '12.612', 'FRAGCOUNT': '37.000'} [2023-02-24 21:02:54,591][213382] DAMAGECOUNT value on done: 336677.0 [2023-02-24 21:02:54,591][213369] DAMAGECOUNT value on done: 340420.0 [2023-02-24 21:02:54,591][213382] Sum rewards: 40.583, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.762', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.207', 'weapon5': '0.248', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.712', 'WEAPON3': '1.200', 'weapon3': '2.358', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '12.306', 'FRAGCOUNT': '36.000'} [2023-02-24 21:02:54,591][213369] Sum rewards: 43.517, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.330', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.090', 'AMMO4': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'WEAPON4': '0.400', 'weapon2': '0.458', 'weapon4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.618', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.321', 'FRAGCOUNT': '40.500'} [2023-02-24 21:02:54,605][213368] DAMAGECOUNT value on done: 332448.0 [2023-02-24 21:02:54,606][213368] Sum rewards: 37.443, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.520', 'AMMO5': '0.020', 'ARMOR': '0.024', 'AMMO2': '0.044', 'weapon5': '0.078', 'weapon2': '0.202', 'AMMO4': '0.219', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon4': '0.570', 'WEAPON3': '1.350', 'HITCOUNT': '2.370', 'weapon3': '2.728', 'DAMAGECOUNT': '11.379', 'FRAGCOUNT': '35.000'} [2023-02-24 21:02:54,671][213383] DAMAGECOUNT value on done: 336377.0 [2023-02-24 21:02:54,672][213383] Sum rewards: 50.094, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.718', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO4': '0.157', 'weapon5': '0.218', 'AMMO3': '0.285', 'weapon4': '0.304', 'WEAPON5': '0.350', 'weapon2': '0.388', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '2.724', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.863', 'FRAGCOUNT': '48.500'} [2023-02-24 21:02:54,908][213382] DAMAGECOUNT value on done: 336868.0 [2023-02-24 21:02:54,908][213382] Sum rewards: 40.294, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.692', 'AMMO5': '0.024', 'WEAPON1': '0.030', 'AMMO2': '0.031', 'weapon5': '0.144', 'AMMO4': '0.153', 'AMMO3': '0.201', 'weapon4': '0.230', 'WEAPON4': '0.300', 'weapon2': '0.340', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'HITCOUNT': '2.570', 'weapon3': '2.998', 'DAMAGECOUNT': '11.664', 'FRAGCOUNT': '36.000'} [2023-02-24 21:02:54,914][213369] DAMAGECOUNT value on done: 333629.0 [2023-02-24 21:02:54,914][213369] Sum rewards: 33.289, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.705', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.030', 'AMMO3': '0.137', 'AMMO4': '0.152', 'weapon2': '0.198', 'WEAPON5': '0.400', 'weapon5': '0.426', 'WEAPON4': '0.600', 'WEAPON3': '0.800', 'weapon4': '1.056', 'weapon3': '1.890', 'HITCOUNT': '2.230', 'DAMAGECOUNT': '9.549', 'FRAGCOUNT': '31.000'} [2023-02-24 21:02:54,935][213368] DAMAGECOUNT value on done: 338067.0 [2023-02-24 21:02:54,936][213368] Sum rewards: 40.833, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.244', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon7': '0.046', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.134', 'AMMO3': '0.163', 'AMMO4': '0.172', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.438', 'weapon4': '0.468', 'WEAPON3': '0.950', 'HITCOUNT': '2.560', 'weapon3': '2.678', 'DAMAGECOUNT': '11.772', 'FRAGCOUNT': '35.000'} [2023-02-24 21:02:55,191][213368] DAMAGECOUNT value on done: 336592.0 [2023-02-24 21:02:55,192][213368] Sum rewards: 38.886, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.180', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.143', 'AMMO4': '0.159', 'WEAPON4': '0.400', 'weapon2': '0.460', 'weapon4': '0.648', 'WEAPON3': '0.850', 'HITCOUNT': '2.570', 'weapon3': '2.634', 'DAMAGECOUNT': '10.479', 'FRAGCOUNT': '32.000'} [2023-02-24 21:02:55,208][213382] DAMAGECOUNT value on done: 327570.0 [2023-02-24 21:02:55,208][213382] Sum rewards: 38.711, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.050', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.046', 'AMMO3': '0.175', 'weapon5': '0.200', 'weapon2': '0.220', 'AMMO4': '0.230', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.702', 'WEAPON3': '1.150', 'weapon3': '2.534', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '11.631', 'FRAGCOUNT': '36.000'} [2023-02-24 21:02:55,214][213369] DAMAGECOUNT value on done: 337171.0 [2023-02-24 21:02:55,215][213369] Sum rewards: 34.720, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.627', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.021', 'weapon4': '0.048', 'AMMO4': '0.103', 'weapon5': '0.162', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.476', 'WEAPON3': '1.350', 'HITCOUNT': '2.250', 'weapon3': '3.036', 'DAMAGECOUNT': '10.263', 'FRAGCOUNT': '33.000'} [2023-02-24 21:02:55,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13468.2). Total num frames: 130920448. Throughput: 0: 3364.0. Samples: 7722654. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:02:55,243][213332] Avg episode reward: [(0, '41.205')] [2023-02-24 21:02:55,297][213383] DAMAGECOUNT value on done: 334572.0 [2023-02-24 21:02:55,297][213383] Sum rewards: 47.522, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.627', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.058', 'AMMO3': '0.145', 'weapon5': '0.192', 'AMMO4': '0.288', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.542', 'weapon2': '0.648', 'WEAPON3': '0.850', 'weapon3': '2.350', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '12.498', 'FRAGCOUNT': '40.000'} [2023-02-24 21:02:55,305][213384] DAMAGECOUNT value on done: 341062.0 [2023-02-24 21:02:55,306][213384] Sum rewards: 26.258, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.488', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.039', 'weapon5': '0.118', 'AMMO3': '0.177', 'AMMO4': '0.195', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.408', 'weapon2': '0.432', 'weapon4': '0.646', 'WEAPON3': '1.100', 'HITCOUNT': '2.120', 'weapon3': '2.458', 'DAMAGECOUNT': '8.820', 'FRAGCOUNT': '25.000'} [2023-02-24 21:02:55,501][213382] DAMAGECOUNT value on done: 340159.0 [2023-02-24 21:02:55,501][213368] DAMAGECOUNT value on done: 328224.0 [2023-02-24 21:02:55,502][213382] Sum rewards: 44.287, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.136', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.132', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'AMMO4': '0.216', 'weapon2': '0.298', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'weapon4': '1.018', 'weapon3': '2.280', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.012', 'FRAGCOUNT': '39.000'} [2023-02-24 21:02:55,502][213368] Sum rewards: 35.746, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.282', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.075', 'AMMO3': '0.193', 'weapon5': '0.224', 'weapon2': '0.330', 'AMMO4': '0.374', 'WEAPON5': '0.500', 'weapon4': '0.508', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'HITCOUNT': '2.090', 'weapon3': '2.232', 'DAMAGECOUNT': '11.274', 'FRAGCOUNT': '33.500'} [2023-02-24 21:02:55,509][213369] DAMAGECOUNT value on done: 326219.0 [2023-02-24 21:02:55,510][213369] Sum rewards: 39.141, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.684', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon5': '0.128', 'AMMO3': '0.168', 'AMMO4': '0.230', 'weapon2': '0.328', 'WEAPON4': '0.350', 'weapon4': '0.376', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.500', 'weapon3': '2.840', 'DAMAGECOUNT': '11.331', 'FRAGCOUNT': '35.500'} [2023-02-24 21:02:55,594][213383] DAMAGECOUNT value on done: 329290.0 [2023-02-24 21:02:55,595][213383] Sum rewards: 46.017, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.070', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon5': '0.042', 'AMMO4': '0.117', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.426', 'weapon2': '0.484', 'WEAPON3': '1.200', 'weapon3': '2.852', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.267', 'FRAGCOUNT': '38.000'} [2023-02-24 21:02:55,603][213384] DAMAGECOUNT value on done: 326272.0 [2023-02-24 21:02:55,603][213384] Sum rewards: 46.594, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.564', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon2': '0.168', 'weapon5': '0.206', 'AMMO4': '0.218', 'AMMO3': '0.221', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.924', 'WEAPON3': '1.350', 'weapon3': '2.198', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.330', 'FRAGCOUNT': '43.000'} [2023-02-24 21:02:55,906][213384] DAMAGECOUNT value on done: 338717.0 [2023-02-24 21:02:55,907][213384] Sum rewards: 55.904, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.632', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO3': '0.131', 'AMMO4': '0.145', 'weapon5': '0.190', 'weapon4': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.546', 'WEAPON3': '0.850', 'weapon3': '2.774', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '13.908', 'FRAGCOUNT': '46.000'} [2023-02-24 21:02:56,006][213365] Updated weights for policy 0, policy_version 31966 (0.0009) [2023-02-24 21:02:56,203][213384] DAMAGECOUNT value on done: 342770.0 [2023-02-24 21:02:56,203][213384] Sum rewards: 48.395, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.420', 'AMMO5': '0.012', 'AMMO2': '0.018', 'weapon5': '0.056', 'AMMO4': '0.090', 'AMMO3': '0.166', 'weapon4': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.592', 'WEAPON3': '1.000', 'HITCOUNT': '2.810', 'weapon3': '2.936', 'DAMAGECOUNT': '13.260', 'FRAGCOUNT': '41.000'} [2023-02-24 21:02:59,036][213365] Updated weights for policy 0, policy_version 31976 (0.0009) [2023-02-24 21:03:00,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13468.2). Total num frames: 130990080. Throughput: 0: 3365.4. Samples: 7742858. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:03:00,243][213332] Avg episode reward: [(0, '41.416')] [2023-02-24 21:03:00,244][213352] Saving new best policy, reward=41.416! [2023-02-24 21:03:02,023][213365] Updated weights for policy 0, policy_version 31986 (0.0009) [2023-02-24 21:03:05,116][213365] Updated weights for policy 0, policy_version 31996 (0.0009) [2023-02-24 21:03:05,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13468.2). Total num frames: 131055616. Throughput: 0: 3365.7. Samples: 7753118. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 21:03:05,243][213332] Avg episode reward: [(0, '41.416')] [2023-02-24 21:03:08,139][213365] Updated weights for policy 0, policy_version 32006 (0.0009) [2023-02-24 21:03:10,243][213332] Fps is (10 sec: 13107.2, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 131121152. Throughput: 0: 3364.9. Samples: 7773256. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 21:03:10,243][213332] Avg episode reward: [(0, '41.416')] [2023-02-24 21:03:11,160][213365] Updated weights for policy 0, policy_version 32016 (0.0009) [2023-02-24 21:03:11,212][213366] Large shaping reward 2.547 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.525, 175.0), ('weapon5', 0.002)] [2023-02-24 21:03:12,204][213367] DAMAGECOUNT value on done: 337276.0 [2023-02-24 21:03:12,204][213367] Sum rewards: 46.290, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.910', 'AMMO5': '0.022', 'AMMO2': '0.042', 'AMMO3': '0.119', 'weapon2': '0.204', 'AMMO4': '0.210', 'weapon5': '0.242', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'ARMOR': '0.504', 'weapon4': '0.710', 'WEAPON3': '0.750', 'HITCOUNT': '2.330', 'weapon3': '2.434', 'DAMAGECOUNT': '11.682', 'FRAGCOUNT': '37.500'} [2023-02-24 21:03:12,513][213367] DAMAGECOUNT value on done: 338640.0 [2023-02-24 21:03:12,513][213367] Sum rewards: 46.322, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.846', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.132', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.280', 'WEAPON5': '0.300', 'weapon4': '0.368', 'WEAPON3': '1.450', 'weapon3': '2.940', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '12.924', 'FRAGCOUNT': '42.000'} [2023-02-24 21:03:12,608][213367] DAMAGECOUNT value on done: 339816.0 [2023-02-24 21:03:12,609][213367] Sum rewards: 39.615, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.530', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.048', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'weapon2': '0.158', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'weapon4': '0.612', 'WEAPON3': '1.150', 'HITCOUNT': '2.470', 'weapon3': '2.896', 'DAMAGECOUNT': '11.367', 'FRAGCOUNT': '35.000'} [2023-02-24 21:03:12,784][213372] DAMAGECOUNT value on done: 343270.0 [2023-02-24 21:03:12,784][213372] Sum rewards: 48.346, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.205', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO4': '0.043', 'weapon4': '0.122', 'weapon5': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'WEAPON5': '0.350', 'weapon2': '0.504', 'WEAPON3': '1.100', 'HITCOUNT': '2.690', 'weapon3': '2.966', 'DAMAGECOUNT': '12.273', 'FRAGCOUNT': '41.000'} [2023-02-24 21:03:12,918][213367] DAMAGECOUNT value on done: 340606.0 [2023-02-24 21:03:12,919][213367] Sum rewards: 40.202, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.620', 'AMMO5': '0.004', 'weapon5': '0.016', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.161', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'weapon2': '0.274', 'weapon4': '0.374', 'WEAPON3': '1.150', 'HITCOUNT': '2.430', 'weapon3': '3.030', 'DAMAGECOUNT': '10.308', 'FRAGCOUNT': '37.000'} [2023-02-24 21:03:13,114][213372] DAMAGECOUNT value on done: 338105.0 [2023-02-24 21:03:13,115][213372] Sum rewards: 42.137, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.876', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.118', 'AMMO4': '0.166', 'AMMO3': '0.192', 'weapon2': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'ARMOR': '0.462', 'weapon4': '0.464', 'WEAPON3': '1.150', 'HITCOUNT': '2.650', 'weapon3': '2.882', 'DAMAGECOUNT': '11.502', 'FRAGCOUNT': '36.000'} [2023-02-24 21:03:13,125][213372] DAMAGECOUNT value on done: 346311.0 [2023-02-24 21:03:13,126][213372] Sum rewards: 42.362, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.120', 'AMMO5': '0.005', 'AMMO2': '0.055', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.202', 'AMMO4': '0.276', 'weapon2': '0.386', 'weapon4': '0.390', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'HITCOUNT': '2.660', 'weapon3': '2.794', 'DAMAGECOUNT': '11.664', 'FRAGCOUNT': '40.000'} [2023-02-24 21:03:13,371][213366] DAMAGECOUNT value on done: 336066.0 [2023-02-24 21:03:13,372][213366] Sum rewards: 36.919, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.718', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon5': '0.140', 'AMMO4': '0.199', 'AMMO3': '0.256', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.424', 'WEAPON3': '1.500', 'HITCOUNT': '2.640', 'weapon3': '2.794', 'DAMAGECOUNT': '11.853', 'FRAGCOUNT': '36.000'} [2023-02-24 21:03:13,437][213372] DAMAGECOUNT value on done: 331755.0 [2023-02-24 21:03:13,437][213372] Sum rewards: 39.331, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.300', 'AMMO5': '0.010', 'AMMO2': '0.010', 'weapon5': '0.012', 'AMMO4': '0.050', 'weapon7': '0.052', 'weapon4': '0.072', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.914', 'WEAPON3': '1.000', 'HITCOUNT': '2.100', 'weapon3': '2.578', 'DAMAGECOUNT': '9.687', 'FRAGCOUNT': '34.000'} [2023-02-24 21:03:13,675][213366] DAMAGECOUNT value on done: 343279.0 [2023-02-24 21:03:13,675][213366] Sum rewards: 44.548, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.840', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.026', 'weapon5': '0.120', 'AMMO4': '0.127', 'AMMO3': '0.185', 'WEAPON4': '0.400', 'weapon4': '0.400', 'weapon2': '0.410', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.756', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.492', 'FRAGCOUNT': '39.500'} [2023-02-24 21:03:13,694][213366] DAMAGECOUNT value on done: 348849.0 [2023-02-24 21:03:13,694][213366] Sum rewards: 48.126, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.541', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon2': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.277', 'WEAPON4': '0.300', 'weapon4': '0.868', 'WEAPON3': '1.650', 'weapon3': '2.682', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.288', 'FRAGCOUNT': '46.000'} [2023-02-24 21:03:13,999][213366] DAMAGECOUNT value on done: 337158.0 [2023-02-24 21:03:13,999][213366] Sum rewards: 31.376, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.846', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.162', 'weapon2': '0.192', 'weapon5': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.392', 'WEAPON3': '1.000', 'HITCOUNT': '1.870', 'weapon3': '2.856', 'DAMAGECOUNT': '8.487', 'FRAGCOUNT': '27.000'} [2023-02-24 21:03:14,264][213365] Updated weights for policy 0, policy_version 32026 (0.0009) [2023-02-24 21:03:14,292][213383] DAMAGECOUNT value on done: 335685.0 [2023-02-24 21:03:14,293][213383] Sum rewards: 37.670, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.534', 'ARMOR': '0.004', 'AMMO2': '0.021', 'AMMO5': '0.022', 'AMMO4': '0.106', 'weapon5': '0.176', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon2': '0.254', 'WEAPON5': '0.450', 'weapon4': '0.588', 'WEAPON3': '1.200', 'HITCOUNT': '2.560', 'weapon3': '2.562', 'DAMAGECOUNT': '10.362', 'FRAGCOUNT': '34.000'} [2023-02-24 21:03:14,422][213382] DAMAGECOUNT value on done: 340358.0 [2023-02-24 21:03:14,422][213382] Sum rewards: 32.476, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.306', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.096', 'AMMO3': '0.209', 'AMMO4': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.346', 'WEAPON4': '0.600', 'weapon4': '0.840', 'WEAPON3': '1.200', 'weapon3': '2.408', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '11.043', 'FRAGCOUNT': '31.500'} [2023-02-24 21:03:14,481][213369] DAMAGECOUNT value on done: 344519.0 [2023-02-24 21:03:14,482][213369] Sum rewards: 47.548, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.835', 'ARMOR': '0.004', 'AMMO2': '0.012', 'AMMO5': '0.020', 'AMMO4': '0.059', 'weapon5': '0.076', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'weapon4': '0.226', 'WEAPON5': '0.300', 'weapon2': '0.452', 'WEAPON3': '1.050', 'HITCOUNT': '2.710', 'weapon3': '3.072', 'DAMAGECOUNT': '12.297', 'FRAGCOUNT': '40.000'} [2023-02-24 21:03:14,610][213383] DAMAGECOUNT value on done: 340171.0 [2023-02-24 21:03:14,611][213383] Sum rewards: 37.652, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.268', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.156', 'AMMO4': '0.161', 'weapon2': '0.212', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.682', 'WEAPON3': '1.450', 'weapon3': '2.478', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '11.382', 'FRAGCOUNT': '35.000'} [2023-02-24 21:03:14,624][213368] DAMAGECOUNT value on done: 336531.0 [2023-02-24 21:03:14,625][213368] Sum rewards: 46.504, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.786', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.184', 'weapon4': '0.472', 'weapon2': '0.528', 'WEAPON3': '1.250', 'HITCOUNT': '2.650', 'weapon3': '2.730', 'DAMAGECOUNT': '12.249', 'FRAGCOUNT': '41.000'} [2023-02-24 21:03:14,734][213382] DAMAGECOUNT value on done: 340872.0 [2023-02-24 21:03:14,735][213382] Sum rewards: 35.863, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.810', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.176', 'AMMO3': '0.274', 'weapon4': '0.372', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.550', 'WEAPON3': '1.650', 'weapon3': '2.344', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.012', 'FRAGCOUNT': '36.000'} [2023-02-24 21:03:14,792][213369] DAMAGECOUNT value on done: 337420.0 [2023-02-24 21:03:14,792][213369] Sum rewards: 37.291, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.790', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon5': '0.058', 'AMMO4': '0.066', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon2': '0.490', 'WEAPON3': '1.300', 'HITCOUNT': '2.520', 'weapon3': '3.162', 'DAMAGECOUNT': '11.373', 'FRAGCOUNT': '34.000'} [2023-02-24 21:03:14,931][213368] DAMAGECOUNT value on done: 342844.0 [2023-02-24 21:03:14,931][213368] Sum rewards: 47.464, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.520', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon5': '0.146', 'AMMO3': '0.191', 'weapon2': '0.228', 'AMMO4': '0.257', 'WEAPON5': '0.300', 'WEAPON4': '0.650', 'weapon4': '0.824', 'WEAPON3': '1.150', 'weapon3': '2.514', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.331', 'FRAGCOUNT': '42.000'} [2023-02-24 21:03:15,037][213382] DAMAGECOUNT value on done: 331607.0 [2023-02-24 21:03:15,038][213382] Sum rewards: 44.069, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.758', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon5': '0.026', 'weapon4': '0.058', 'AMMO4': '0.062', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.274', 'weapon2': '0.352', 'WEAPON3': '1.600', 'HITCOUNT': '2.700', 'weapon3': '3.272', 'DAMAGECOUNT': '12.111', 'FRAGCOUNT': '43.000'} [2023-02-24 21:03:15,102][213369] DAMAGECOUNT value on done: 341516.0 [2023-02-24 21:03:15,102][213369] Sum rewards: 55.846, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.830', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.056', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon2': '0.248', 'WEAPON4': '0.250', 'weapon4': '0.442', 'WEAPON3': '1.100', 'HITCOUNT': '2.740', 'weapon3': '3.086', 'DAMAGECOUNT': '13.035', 'FRAGCOUNT': '49.000'} [2023-02-24 21:03:15,214][213368] DAMAGECOUNT value on done: 340356.0 [2023-02-24 21:03:15,214][213368] Sum rewards: 41.439, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.799', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon2': '0.182', 'weapon5': '0.182', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.496', 'WEAPON3': '1.200', 'HITCOUNT': '2.540', 'weapon3': '2.856', 'DAMAGECOUNT': '11.292', 'FRAGCOUNT': '37.500'} [2023-02-24 21:03:15,240][213383] DAMAGECOUNT value on done: 338786.0 [2023-02-24 21:03:15,240][213383] Sum rewards: 50.910, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.179', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.032', 'WEAPON4': '0.050', 'weapon5': '0.052', 'AMMO4': '0.081', 'WEAPON5': '0.100', 'AMMO3': '0.241', 'weapon2': '0.274', 'WEAPON3': '1.350', 'HITCOUNT': '2.570', 'weapon3': '3.422', 'DAMAGECOUNT': '12.642', 'FRAGCOUNT': '46.000'} [2023-02-24 21:03:15,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13468.2). Total num frames: 131190784. Throughput: 0: 3365.8. Samples: 7793348. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 21:03:15,243][213332] Avg episode reward: [(0, '41.338')] [2023-02-24 21:03:15,295][213384] DAMAGECOUNT value on done: 344426.0 [2023-02-24 21:03:15,296][213384] Sum rewards: 34.995, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.870', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.142', 'AMMO3': '0.176', 'AMMO4': '0.184', 'WEAPON5': '0.250', 'weapon2': '0.466', 'WEAPON4': '0.500', 'weapon4': '0.602', 'WEAPON3': '1.000', 'HITCOUNT': '2.360', 'weapon3': '2.546', 'DAMAGECOUNT': '10.092', 'FRAGCOUNT': '33.000'} [2023-02-24 21:03:15,346][213382] DAMAGECOUNT value on done: 341449.0 [2023-02-24 21:03:15,346][213382] Sum rewards: 12.393, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.940', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon7': '0.048', 'AMMO4': '0.091', 'AMMO3': '0.093', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.134', 'weapon2': '0.182', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.706', 'HITCOUNT': '0.850', 'weapon3': '1.142', 'DAMAGECOUNT': '3.870', 'FRAGCOUNT': '13.000'} [2023-02-24 21:03:15,411][213369] DAMAGECOUNT value on done: 329193.0 [2023-02-24 21:03:15,412][213369] Sum rewards: 29.217, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.785', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon5': '0.120', 'AMMO4': '0.163', 'AMMO3': '0.205', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.352', 'weapon2': '0.568', 'WEAPON3': '1.250', 'HITCOUNT': '2.270', 'weapon3': '2.704', 'DAMAGECOUNT': '8.922', 'FRAGCOUNT': '29.000'} [2023-02-24 21:03:15,514][213368] DAMAGECOUNT value on done: 332414.0 [2023-02-24 21:03:15,514][213368] Sum rewards: 46.147, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.011', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.164', 'weapon5': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.368', 'weapon4': '0.708', 'WEAPON3': '0.950', 'weapon3': '2.492', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.570', 'FRAGCOUNT': '39.000'} [2023-02-24 21:03:15,538][213383] DAMAGECOUNT value on done: 332806.0 [2023-02-24 21:03:15,538][213383] Sum rewards: 36.343, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.712', 'AMMO5': '0.012', 'weapon5': '0.014', 'AMMO2': '0.018', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'weapon4': '0.434', 'weapon2': '0.620', 'WEAPON3': '1.300', 'HITCOUNT': '2.430', 'weapon3': '2.722', 'DAMAGECOUNT': '10.548', 'FRAGCOUNT': '35.000'} [2023-02-24 21:03:15,598][213384] DAMAGECOUNT value on done: 330452.0 [2023-02-24 21:03:15,599][213384] Sum rewards: 46.678, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.084', 'ARMOR': '0.004', 'AMMO2': '0.018', 'AMMO5': '0.019', 'AMMO4': '0.088', 'weapon5': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.278', 'AMMO3': '0.285', 'weapon4': '0.392', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'weapon3': '2.758', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.540', 'FRAGCOUNT': '46.000'} [2023-02-24 21:03:15,875][213384] DAMAGECOUNT value on done: 343263.0 [2023-02-24 21:03:15,876][213384] Sum rewards: 49.900, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.323', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon2': '0.210', 'AMMO3': '0.256', 'weapon4': '0.334', 'WEAPON3': '1.550', 'HITCOUNT': '2.970', 'weapon3': '3.146', 'DAMAGECOUNT': '13.638', 'FRAGCOUNT': '45.000'} [2023-02-24 21:03:16,171][213384] DAMAGECOUNT value on done: 346879.0 [2023-02-24 21:03:16,172][213384] Sum rewards: 45.742, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.730', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.014', 'WEAPON4': '0.050', 'weapon4': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.241', 'weapon2': '0.636', 'WEAPON3': '1.500', 'HITCOUNT': '2.690', 'weapon3': '3.006', 'DAMAGECOUNT': '12.327', 'FRAGCOUNT': '42.000'} [2023-02-24 21:03:17,267][213365] Updated weights for policy 0, policy_version 32036 (0.0009) [2023-02-24 21:03:20,243][213332] Fps is (10 sec: 13516.4, 60 sec: 13448.5, 300 sec: 13468.2). Total num frames: 131256320. Throughput: 0: 3367.6. Samples: 7803596. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 21:03:20,244][213332] Avg episode reward: [(0, '41.213')] [2023-02-24 21:03:20,289][213365] Updated weights for policy 0, policy_version 32046 (0.0009) [2023-02-24 21:03:23,268][213365] Updated weights for policy 0, policy_version 32056 (0.0009) [2023-02-24 21:03:25,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13468.2). Total num frames: 131325952. Throughput: 0: 3373.9. Samples: 7824000. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 21:03:25,243][213332] Avg episode reward: [(0, '41.213')] [2023-02-24 21:03:26,297][213365] Updated weights for policy 0, policy_version 32066 (0.0008) [2023-02-24 21:03:28,473][213369] Large shaping reward 2.614 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.582, 194.0), ('weapon7', 0.002)] [2023-02-24 21:03:29,334][213365] Updated weights for policy 0, policy_version 32076 (0.0009) [2023-02-24 21:03:30,243][213332] Fps is (10 sec: 13517.2, 60 sec: 13448.5, 300 sec: 13468.2). Total num frames: 131391488. Throughput: 0: 3379.2. Samples: 7844344. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:03:30,243][213332] Avg episode reward: [(0, '41.213')] [2023-02-24 21:03:32,070][213367] DAMAGECOUNT value on done: 339429.0 [2023-02-24 21:03:32,070][213367] Sum rewards: 20.141, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.429', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.056', 'AMMO3': '0.113', 'WEAPON5': '0.150', 'weapon7': '0.168', 'AMMO4': '0.180', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon2': '0.458', 'WEAPON4': '0.500', 'WEAPON3': '0.650', 'weapon4': '0.838', 'HITCOUNT': '1.150', 'weapon3': '1.170', 'DAMAGECOUNT': '6.099', 'FRAGCOUNT': '19.000'} [2023-02-24 21:03:32,362][213365] Updated weights for policy 0, policy_version 32086 (0.0009) [2023-02-24 21:03:32,380][213367] DAMAGECOUNT value on done: 343928.0 [2023-02-24 21:03:32,381][213367] Sum rewards: 44.925, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.419', 'AMMO2': '0.012', 'ARMOR': '0.016', 'AMMO4': '0.061', 'WEAPON4': '0.200', 'weapon4': '0.210', 'AMMO3': '0.213', 'weapon2': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.650', 'weapon3': '3.346', 'DAMAGECOUNT': '12.336', 'FRAGCOUNT': '40.000'} [2023-02-24 21:03:32,391][213367] DAMAGECOUNT value on done: 343244.0 [2023-02-24 21:03:32,391][213367] Sum rewards: 55.838, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.382', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.064', 'weapon5': '0.088', 'weapon4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'WEAPON5': '0.250', 'weapon2': '0.724', 'WEAPON3': '1.000', 'weapon3': '2.852', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.812', 'FRAGCOUNT': '47.000'} [2023-02-24 21:03:32,691][213372] DAMAGECOUNT value on done: 347797.0 [2023-02-24 21:03:32,692][213372] Sum rewards: 50.458, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.365', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon5': '0.132', 'AMMO3': '0.183', 'AMMO4': '0.246', 'weapon2': '0.256', 'WEAPON5': '0.300', 'weapon4': '0.404', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '2.860', 'weapon3': '2.940', 'DAMAGECOUNT': '13.581', 'FRAGCOUNT': '45.000'} [2023-02-24 21:03:32,698][213367] DAMAGECOUNT value on done: 344927.0 [2023-02-24 21:03:32,699][213367] Sum rewards: 49.287, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.230', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.238', 'weapon4': '0.332', 'weapon2': '0.542', 'WEAPON3': '1.350', 'weapon3': '2.878', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.963', 'FRAGCOUNT': '44.000'} [2023-02-24 21:03:32,958][213372] DAMAGECOUNT value on done: 341279.0 [2023-02-24 21:03:32,959][213372] Sum rewards: 34.690, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.923', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon5': '0.124', 'AMMO4': '0.125', 'AMMO3': '0.167', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.492', 'weapon4': '0.592', 'WEAPON3': '1.100', 'HITCOUNT': '2.410', 'weapon3': '2.588', 'DAMAGECOUNT': '9.522', 'FRAGCOUNT': '32.500'} [2023-02-24 21:03:33,012][213372] DAMAGECOUNT value on done: 348953.0 [2023-02-24 21:03:33,013][213372] Sum rewards: 22.838, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.206', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'WEAPON4': '0.200', 'weapon4': '0.238', 'weapon2': '0.278', 'AMMO3': '0.292', 'WEAPON3': '1.650', 'HITCOUNT': '1.990', 'weapon3': '3.188', 'DAMAGECOUNT': '7.926', 'FRAGCOUNT': '27.000'} [2023-02-24 21:03:33,235][213366] DAMAGECOUNT value on done: 339547.0 [2023-02-24 21:03:33,236][213366] Sum rewards: 41.818, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.370', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.055', 'AMMO3': '0.158', 'weapon5': '0.166', 'AMMO4': '0.273', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.500', 'weapon2': '0.722', 'WEAPON3': '0.950', 'weapon3': '2.320', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '10.443', 'FRAGCOUNT': '37.000'} [2023-02-24 21:03:33,278][213372] DAMAGECOUNT value on done: 336151.0 [2023-02-24 21:03:33,278][213372] Sum rewards: 46.381, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.022', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'ARMOR': '0.004', 'AMMO5': '0.005', 'WEAPON4': '0.050', 'weapon4': '0.096', 'AMMO3': '0.218', 'weapon2': '0.626', 'WEAPON3': '1.400', 'HITCOUNT': '2.770', 'weapon3': '3.044', 'DAMAGECOUNT': '12.948', 'FRAGCOUNT': '40.000'} [2023-02-24 21:03:33,543][213366] DAMAGECOUNT value on done: 347154.0 [2023-02-24 21:03:33,544][213366] Sum rewards: 37.874, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.224', 'AMMO5': '0.017', 'AMMO2': '0.018', 'weapon5': '0.076', 'AMMO4': '0.090', 'weapon4': '0.170', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'WEAPON5': '0.350', 'weapon2': '0.552', 'WEAPON3': '1.200', 'HITCOUNT': '2.620', 'weapon3': '2.974', 'DAMAGECOUNT': '11.625', 'FRAGCOUNT': '33.500'} [2023-02-24 21:03:33,568][213366] DAMAGECOUNT value on done: 353608.0 [2023-02-24 21:03:33,569][213366] Sum rewards: 56.222, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.980', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'AMMO3': '0.180', 'WEAPON4': '0.300', 'weapon2': '0.320', 'weapon4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.886', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.277', 'FRAGCOUNT': '47.000'} [2023-02-24 21:03:33,869][213366] DAMAGECOUNT value on done: 340859.0 [2023-02-24 21:03:33,869][213366] Sum rewards: 38.840, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.072', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO3': '0.158', 'weapon5': '0.176', 'AMMO4': '0.195', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.570', 'weapon4': '0.578', 'WEAPON3': '1.050', 'weapon3': '2.348', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '11.103', 'FRAGCOUNT': '33.000'} [2023-02-24 21:03:34,111][213383] DAMAGECOUNT value on done: 339889.0 [2023-02-24 21:03:34,112][213383] Sum rewards: 46.652, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.246', 'AMMO5': '0.017', 'AMMO2': '0.026', 'weapon5': '0.030', 'AMMO4': '0.128', 'weapon4': '0.186', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'weapon2': '0.298', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.810', 'weapon3': '3.204', 'DAMAGECOUNT': '12.612', 'FRAGCOUNT': '42.000'} [2023-02-24 21:03:34,250][213382] DAMAGECOUNT value on done: 343921.0 [2023-02-24 21:03:34,250][213382] Sum rewards: 37.829, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.720', 'ARMOR': '0.004', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'weapon2': '0.224', 'AMMO3': '0.242', 'WEAPON4': '0.400', 'weapon4': '0.860', 'WEAPON3': '1.400', 'HITCOUNT': '2.530', 'weapon3': '2.608', 'DAMAGECOUNT': '10.689', 'FRAGCOUNT': '37.000'} [2023-02-24 21:03:34,340][213369] DAMAGECOUNT value on done: 349460.0 [2023-02-24 21:03:34,341][213369] Sum rewards: 56.966, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.999', 'AMMO2': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.049', 'weapon5': '0.076', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.248', 'WEAPON5': '0.300', 'weapon4': '0.334', 'ARMOR': '0.458', 'WEAPON3': '1.150', 'HITCOUNT': '3.030', 'weapon3': '3.072', 'DAMAGECOUNT': '14.823', 'FRAGCOUNT': '49.000'} [2023-02-24 21:03:34,431][213383] DAMAGECOUNT value on done: 343840.0 [2023-02-24 21:03:34,431][213383] Sum rewards: 34.857, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.828', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO4': '0.187', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon2': '0.296', 'weapon4': '0.410', 'WEAPON3': '1.300', 'HITCOUNT': '2.590', 'weapon3': '2.850', 'DAMAGECOUNT': '11.007', 'FRAGCOUNT': '32.500'} [2023-02-24 21:03:34,454][213368] DAMAGECOUNT value on done: 341037.0 [2023-02-24 21:03:34,455][213368] Sum rewards: 43.755, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.720', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.035', 'AMMO4': '0.173', 'weapon2': '0.188', 'weapon5': '0.194', 'AMMO3': '0.214', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.568', 'WEAPON3': '1.300', 'weapon3': '2.712', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.518', 'FRAGCOUNT': '40.500'} [2023-02-24 21:03:34,565][213382] DAMAGECOUNT value on done: 344681.0 [2023-02-24 21:03:34,565][213382] Sum rewards: 42.244, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.752', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.035', 'AMMO4': '0.176', 'weapon2': '0.220', 'AMMO3': '0.227', 'weapon5': '0.304', 'WEAPON4': '0.400', 'weapon4': '0.532', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'HITCOUNT': '2.400', 'weapon3': '2.582', 'DAMAGECOUNT': '11.427', 'FRAGCOUNT': '39.000'} [2023-02-24 21:03:34,652][213369] DAMAGECOUNT value on done: 340886.0 [2023-02-24 21:03:34,653][213369] Sum rewards: 38.475, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.660', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.053', 'weapon5': '0.130', 'weapon7': '0.134', 'AMMO3': '0.155', 'AMMO6': '0.240', 'AMMO7': '0.240', 'AMMO4': '0.267', 'weapon2': '0.290', 'WEAPON7': '0.400', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'weapon4': '0.842', 'WEAPON3': '0.900', 'weapon3': '2.232', 'HITCOUNT': '2.330', 'DAMAGECOUNT': '10.398', 'FRAGCOUNT': '34.000'} [2023-02-24 21:03:34,772][213368] DAMAGECOUNT value on done: 346853.0 [2023-02-24 21:03:34,772][213368] Sum rewards: 49.529, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.910', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.134', 'AMMO3': '0.148', 'WEAPON5': '0.200', 'weapon2': '0.234', 'WEAPON4': '0.300', 'WEAPON3': '0.900', 'weapon4': '0.932', 'weapon3': '2.344', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '12.027', 'FRAGCOUNT': '42.000'} [2023-02-24 21:03:34,870][213382] DAMAGECOUNT value on done: 334945.0 [2023-02-24 21:03:34,870][213382] Sum rewards: 32.974, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.812', 'AMMO5': '0.023', 'AMMO2': '0.077', 'AMMO3': '0.130', 'weapon2': '0.224', 'weapon5': '0.278', 'AMMO4': '0.384', 'ARMOR': '0.408', 'WEAPON5': '0.650', 'WEAPON3': '0.850', 'WEAPON4': '0.900', 'weapon4': '1.036', 'weapon3': '1.892', 'HITCOUNT': '2.170', 'DAMAGECOUNT': '10.014', 'FRAGCOUNT': '31.000'} [2023-02-24 21:03:34,965][213369] DAMAGECOUNT value on done: 346022.0 [2023-02-24 21:03:34,965][213369] Sum rewards: 49.506, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.070', 'AMMO5': '0.015', 'AMMO2': '0.025', 'weapon5': '0.066', 'weapon4': '0.098', 'AMMO4': '0.125', 'WEAPON4': '0.250', 'AMMO3': '0.285', 'WEAPON5': '0.300', 'weapon2': '0.538', 'WEAPON3': '1.650', 'HITCOUNT': '2.950', 'weapon3': '3.006', 'DAMAGECOUNT': '13.518', 'FRAGCOUNT': '47.000'} [2023-02-24 21:03:35,032][213368] DAMAGECOUNT value on done: 344808.0 [2023-02-24 21:03:35,032][213368] Sum rewards: 53.089, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.915', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.016', 'AMMO4': '0.050', 'WEAPON5': '0.100', 'weapon2': '0.104', 'AMMO3': '0.268', 'WEAPON3': '1.550', 'HITCOUNT': '2.870', 'weapon3': '3.676', 'DAMAGECOUNT': '13.356', 'FRAGCOUNT': '48.000'} [2023-02-24 21:03:35,051][213383] DAMAGECOUNT value on done: 342799.0 [2023-02-24 21:03:35,052][213383] Sum rewards: 47.677, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.180', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.056', 'AMMO4': '0.061', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon4': '0.394', 'weapon2': '0.498', 'WEAPON3': '1.150', 'HITCOUNT': '2.660', 'weapon3': '2.822', 'DAMAGECOUNT': '12.039', 'FRAGCOUNT': '42.000'} [2023-02-24 21:03:35,169][213384] DAMAGECOUNT value on done: 348516.0 [2023-02-24 21:03:35,170][213384] Sum rewards: 45.284, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.990', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.192', 'AMMO3': '0.249', 'weapon2': '0.254', 'weapon4': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.430', 'weapon3': '2.852', 'DAMAGECOUNT': '11.970', 'FRAGCOUNT': '41.000'} [2023-02-24 21:03:35,170][213382] DAMAGECOUNT value on done: 342128.0 [2023-02-24 21:03:35,171][213382] Sum rewards: 9.812, reward structure: {'DEATHCOUNT': '-0.750', 'HEALTH': '-0.455', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO3': '0.010', 'weapon7': '0.078', 'WEAPON3': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon2': '0.226', 'HITCOUNT': '0.330', 'weapon3': '0.344', 'weapon4': '0.354', 'DAMAGECOUNT': '2.037', 'FRAGCOUNT': '7.000'} [2023-02-24 21:03:35,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13468.2). Total num frames: 131461120. Throughput: 0: 3378.6. Samples: 7854520. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:03:35,243][213332] Avg episode reward: [(0, '41.401')] [2023-02-24 21:03:35,275][213369] DAMAGECOUNT value on done: 332949.0 [2023-02-24 21:03:35,276][213369] Sum rewards: 38.977, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.416', 'AMMO5': '0.005', 'AMMO2': '0.045', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'AMMO4': '0.225', 'WEAPON4': '0.300', 'weapon2': '0.384', 'weapon4': '0.672', 'WEAPON3': '1.150', 'HITCOUNT': '2.550', 'weapon3': '2.696', 'DAMAGECOUNT': '11.268', 'FRAGCOUNT': '35.000'} [2023-02-24 21:03:35,332][213368] DAMAGECOUNT value on done: 336814.0 [2023-02-24 21:03:35,333][213368] Sum rewards: 46.870, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.269', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.059', 'AMMO3': '0.202', 'weapon5': '0.210', 'weapon2': '0.226', 'AMMO4': '0.295', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.662', 'WEAPON3': '1.150', 'weapon3': '2.508', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '13.200', 'FRAGCOUNT': '43.500'} [2023-02-24 21:03:35,353][213383] DAMAGECOUNT value on done: 337544.0 [2023-02-24 21:03:35,353][213383] Sum rewards: 52.815, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.235', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.118', 'weapon4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'AMMO4': '0.192', 'weapon2': '0.266', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.130', 'weapon3': '3.302', 'DAMAGECOUNT': '14.214', 'FRAGCOUNT': '47.000'} [2023-02-24 21:03:35,432][213365] Updated weights for policy 0, policy_version 32096 (0.0009) [2023-02-24 21:03:35,475][213384] DAMAGECOUNT value on done: 334394.0 [2023-02-24 21:03:35,476][213384] Sum rewards: 42.484, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.442', 'ARMOR': '0.004', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.102', 'weapon5': '0.104', 'AMMO3': '0.133', 'weapon2': '0.160', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '2.310', 'weapon3': '2.934', 'DAMAGECOUNT': '11.826', 'FRAGCOUNT': '35.000'} [2023-02-24 21:03:35,748][213384] DAMAGECOUNT value on done: 347963.0 [2023-02-24 21:03:35,748][213384] Sum rewards: 58.696, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.595', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.046', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.148', 'WEAPON4': '0.200', 'weapon4': '0.358', 'weapon2': '0.674', 'WEAPON3': '1.000', 'weapon3': '2.630', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '14.100', 'FRAGCOUNT': '50.000'} [2023-02-24 21:03:36,046][213384] DAMAGECOUNT value on done: 351433.0 [2023-02-24 21:03:36,047][213384] Sum rewards: 49.199, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.648', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.028', 'AMMO4': '0.069', 'weapon4': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.217', 'weapon2': '0.388', 'WEAPON3': '1.250', 'HITCOUNT': '2.830', 'weapon3': '3.308', 'DAMAGECOUNT': '13.662', 'FRAGCOUNT': '43.000'} [2023-02-24 21:03:38,438][213365] Updated weights for policy 0, policy_version 32106 (0.0009) [2023-02-24 21:03:40,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13468.2). Total num frames: 131526656. Throughput: 0: 3378.4. Samples: 7874680. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:03:40,243][213332] Avg episode reward: [(0, '41.823')] [2023-02-24 21:03:40,282][213352] Saving new best policy, reward=41.823! [2023-02-24 21:03:41,455][213365] Updated weights for policy 0, policy_version 32116 (0.0009) [2023-02-24 21:03:44,551][213365] Updated weights for policy 0, policy_version 32126 (0.0009) [2023-02-24 21:03:45,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13482.1). Total num frames: 131596288. Throughput: 0: 3376.2. Samples: 7894786. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:03:45,243][213332] Avg episode reward: [(0, '41.823')] [2023-02-24 21:03:47,562][213365] Updated weights for policy 0, policy_version 32136 (0.0009) [2023-02-24 21:03:48,732][213369] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 21:03:49,145][213366] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 21:03:50,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13468.2). Total num frames: 131661824. Throughput: 0: 3376.1. Samples: 7905044. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:03:50,243][213332] Avg episode reward: [(0, '41.823')] [2023-02-24 21:03:50,619][213365] Updated weights for policy 0, policy_version 32146 (0.0009) [2023-02-24 21:03:51,990][213367] DAMAGECOUNT value on done: 343666.0 [2023-02-24 21:03:51,991][213367] Sum rewards: 47.627, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.608', 'AMMO5': '0.003', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon5': '0.064', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'weapon2': '0.348', 'weapon4': '0.368', 'WEAPON3': '1.300', 'weapon3': '3.024', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '12.711', 'FRAGCOUNT': '42.000'} [2023-02-24 21:03:52,248][213367] DAMAGECOUNT value on done: 348298.0 [2023-02-24 21:03:52,248][213367] Sum rewards: 42.463, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.655', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.102', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.332', 'weapon4': '0.504', 'WEAPON3': '1.350', 'weapon3': '2.822', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.110', 'FRAGCOUNT': '38.000'} [2023-02-24 21:03:52,322][213367] DAMAGECOUNT value on done: 347237.0 [2023-02-24 21:03:52,322][213367] Sum rewards: 41.577, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.050', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.047', 'weapon5': '0.078', 'AMMO4': '0.233', 'AMMO3': '0.242', 'weapon2': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.656', 'WEAPON3': '1.400', 'weapon3': '2.674', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '11.979', 'FRAGCOUNT': '39.000'} [2023-02-24 21:03:52,565][213367] DAMAGECOUNT value on done: 348403.0 [2023-02-24 21:03:52,566][213367] Sum rewards: 32.453, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.250', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.080', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.282', 'WEAPON4': '0.450', 'weapon4': '0.700', 'WEAPON3': '1.200', 'weapon3': '2.390', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '10.428', 'FRAGCOUNT': '34.000'} [2023-02-24 21:03:52,622][213372] DAMAGECOUNT value on done: 351100.0 [2023-02-24 21:03:52,622][213372] Sum rewards: 35.373, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.726', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.062', 'AMMO4': '0.159', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.276', 'weapon2': '0.580', 'WEAPON3': '1.250', 'HITCOUNT': '2.340', 'weapon3': '2.836', 'DAMAGECOUNT': '9.909', 'FRAGCOUNT': '32.000'} [2023-02-24 21:03:52,875][213372] DAMAGECOUNT value on done: 344888.0 [2023-02-24 21:03:52,876][213372] Sum rewards: 42.002, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'AMMO2': '0.038', 'HEALTH': '0.064', 'AMMO3': '0.088', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.192', 'WEAPON4': '0.300', 'weapon2': '0.370', 'WEAPON3': '0.550', 'weapon4': '0.810', 'weapon3': '2.404', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '10.827', 'FRAGCOUNT': '34.000'} [2023-02-24 21:03:52,938][213372] DAMAGECOUNT value on done: 353171.0 [2023-02-24 21:03:52,938][213372] Sum rewards: 51.155, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.606', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.017', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'weapon5': '0.110', 'AMMO3': '0.201', 'WEAPON5': '0.300', 'weapon4': '0.374', 'weapon2': '0.560', 'WEAPON3': '1.250', 'weapon3': '2.700', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.654', 'FRAGCOUNT': '45.000'} [2023-02-24 21:03:53,191][213372] DAMAGECOUNT value on done: 340866.0 [2023-02-24 21:03:53,192][213372] Sum rewards: 57.817, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.818', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'weapon5': '0.060', 'weapon4': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.528', 'WEAPON3': '1.400', 'weapon3': '3.060', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.145', 'FRAGCOUNT': '51.000'} [2023-02-24 21:03:53,218][213366] DAMAGECOUNT value on done: 343692.0 [2023-02-24 21:03:53,219][213366] Sum rewards: 46.536, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.356', 'AMMO5': '0.018', 'AMMO2': '0.054', 'weapon5': '0.144', 'AMMO3': '0.196', 'AMMO4': '0.270', 'weapon2': '0.282', 'WEAPON5': '0.350', 'weapon4': '0.556', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.718', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.435', 'FRAGCOUNT': '42.000'} [2023-02-24 21:03:53,520][213366] DAMAGECOUNT value on done: 351048.0 [2023-02-24 21:03:53,520][213366] Sum rewards: 49.371, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.910', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon4': '0.372', 'weapon2': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.846', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '11.682', 'FRAGCOUNT': '44.000'} [2023-02-24 21:03:53,538][213366] DAMAGECOUNT value on done: 358198.0 [2023-02-24 21:03:53,539][213366] Sum rewards: 46.727, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.915', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.033', 'weapon5': '0.124', 'weapon4': '0.166', 'AMMO4': '0.167', 'AMMO3': '0.235', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '3.000', 'weapon3': '3.130', 'DAMAGECOUNT': '13.770', 'FRAGCOUNT': '41.500'} [2023-02-24 21:03:53,676][213365] Updated weights for policy 0, policy_version 32156 (0.0009) [2023-02-24 21:03:53,836][213366] DAMAGECOUNT value on done: 344437.0 [2023-02-24 21:03:53,837][213366] Sum rewards: 35.854, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.802', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.116', 'AMMO4': '0.127', 'weapon2': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.476', 'WEAPON3': '1.350', 'HITCOUNT': '2.270', 'weapon3': '2.952', 'DAMAGECOUNT': '10.734', 'FRAGCOUNT': '34.000'} [2023-02-24 21:03:54,113][213383] DAMAGECOUNT value on done: 343941.0 [2023-02-24 21:03:54,113][213383] Sum rewards: 43.538, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.047', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'weapon5': '0.072', 'AMMO4': '0.083', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon2': '0.284', 'weapon4': '0.682', 'WEAPON3': '1.100', 'weapon3': '2.636', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.156', 'FRAGCOUNT': '37.000'} [2023-02-24 21:03:54,172][213382] DAMAGECOUNT value on done: 347764.0 [2023-02-24 21:03:54,172][213382] Sum rewards: 39.483, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.102', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.102', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'weapon4': '0.330', 'WEAPON4': '0.450', 'weapon2': '0.704', 'WEAPON3': '0.950', 'HITCOUNT': '2.500', 'weapon3': '2.658', 'DAMAGECOUNT': '11.529', 'FRAGCOUNT': '36.000'} [2023-02-24 21:03:54,278][213369] DAMAGECOUNT value on done: 353872.0 [2023-02-24 21:03:54,279][213369] Sum rewards: 51.669, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.210', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon5': '0.040', 'AMMO4': '0.044', 'WEAPON4': '0.150', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'weapon4': '0.222', 'weapon2': '0.464', 'WEAPON3': '1.200', 'HITCOUNT': '3.030', 'weapon3': '3.072', 'DAMAGECOUNT': '13.236', 'FRAGCOUNT': '44.000'} [2023-02-24 21:03:54,376][213368] DAMAGECOUNT value on done: 344657.0 [2023-02-24 21:03:54,377][213368] Sum rewards: 44.037, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.300', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.080', 'AMMO3': '0.147', 'AMMO4': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.524', 'weapon4': '0.546', 'WEAPON3': '0.900', 'HITCOUNT': '2.350', 'weapon3': '2.688', 'DAMAGECOUNT': '10.860', 'FRAGCOUNT': '37.000'} [2023-02-24 21:03:54,429][213383] DAMAGECOUNT value on done: 347868.0 [2023-02-24 21:03:54,430][213383] Sum rewards: 48.480, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.040', 'AMMO5': '0.005', 'AMMO2': '0.045', 'weapon5': '0.140', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'AMMO4': '0.223', 'ARMOR': '0.442', 'WEAPON4': '0.450', 'weapon2': '0.504', 'weapon4': '0.614', 'WEAPON3': '1.050', 'weapon3': '2.452', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '12.084', 'FRAGCOUNT': '43.000'} [2023-02-24 21:03:54,506][213382] DAMAGECOUNT value on done: 348179.0 [2023-02-24 21:03:54,506][213382] Sum rewards: 37.184, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.980', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.060', 'weapon5': '0.150', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'weapon2': '0.284', 'AMMO4': '0.300', 'WEAPON4': '0.550', 'weapon4': '0.820', 'WEAPON3': '1.100', 'weapon3': '2.446', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '10.494', 'FRAGCOUNT': '37.000'} [2023-02-24 21:03:54,585][213369] DAMAGECOUNT value on done: 344689.0 [2023-02-24 21:03:54,586][213369] Sum rewards: 39.332, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.060', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon5': '0.060', 'weapon4': '0.088', 'AMMO4': '0.147', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.764', 'WEAPON3': '1.200', 'HITCOUNT': '2.340', 'weapon3': '2.894', 'DAMAGECOUNT': '11.409', 'FRAGCOUNT': '36.000'} [2023-02-24 21:03:54,676][213368] DAMAGECOUNT value on done: 351087.0 [2023-02-24 21:03:54,677][213368] Sum rewards: 46.676, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.960', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.244', 'weapon2': '0.336', 'weapon4': '0.384', 'WEAPON3': '1.500', 'HITCOUNT': '2.980', 'weapon3': '3.012', 'DAMAGECOUNT': '12.702', 'FRAGCOUNT': '43.000'} [2023-02-24 21:03:54,820][213382] DAMAGECOUNT value on done: 338776.0 [2023-02-24 21:03:54,821][213382] Sum rewards: 44.066, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.440', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.156', 'AMMO3': '0.180', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.404', 'weapon4': '0.816', 'WEAPON3': '1.100', 'weapon3': '2.370', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '11.493', 'FRAGCOUNT': '38.000'} [2023-02-24 21:03:54,898][213369] DAMAGECOUNT value on done: 350699.0 [2023-02-24 21:03:54,898][213369] Sum rewards: 54.644, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.817', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'AMMO4': '0.186', 'weapon2': '0.518', 'weapon4': '0.862', 'WEAPON3': '1.000', 'weapon3': '2.228', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.031', 'FRAGCOUNT': '44.000'} [2023-02-24 21:03:54,936][213368] DAMAGECOUNT value on done: 346839.0 [2023-02-24 21:03:54,936][213368] Sum rewards: 21.258, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.618', 'AMMO5': '0.017', 'AMMO2': '0.026', 'AMMO3': '0.124', 'AMMO4': '0.131', 'weapon4': '0.134', 'weapon5': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'weapon2': '0.858', 'HITCOUNT': '1.290', 'weapon3': '2.160', 'DAMAGECOUNT': '6.093', 'FRAGCOUNT': '19.000'} [2023-02-24 21:03:55,043][213383] DAMAGECOUNT value on done: 347509.0 [2023-02-24 21:03:55,043][213383] Sum rewards: 56.945, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.826', 'ARMOR': '0.004', 'AMMO2': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'weapon5': '0.110', 'weapon4': '0.142', 'weapon2': '0.158', 'WEAPON5': '0.300', 'AMMO3': '0.307', 'WEAPON3': '1.850', 'weapon3': '3.266', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.130', 'FRAGCOUNT': '54.000'} [2023-02-24 21:03:55,119][213382] DAMAGECOUNT value on done: 345614.0 [2023-02-24 21:03:55,119][213382] Sum rewards: 38.906, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.172', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.154', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'weapon2': '0.374', 'weapon4': '0.646', 'WEAPON3': '1.200', 'HITCOUNT': '2.410', 'weapon3': '2.690', 'DAMAGECOUNT': '10.458', 'FRAGCOUNT': '36.000'} [2023-02-24 21:03:55,138][213384] DAMAGECOUNT value on done: 353461.0 [2023-02-24 21:03:55,139][213384] Sum rewards: 51.857, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.814', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon2': '0.144', 'weapon5': '0.148', 'AMMO4': '0.173', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.504', 'WEAPON3': '1.250', 'weapon3': '2.934', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.835', 'FRAGCOUNT': '43.000'} [2023-02-24 21:03:55,202][213369] DAMAGECOUNT value on done: 336819.0 [2023-02-24 21:03:55,202][213369] Sum rewards: 43.171, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.010', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'ARMOR': '0.012', 'AMMO2': '0.050', 'weapon5': '0.086', 'AMMO3': '0.233', 'AMMO4': '0.252', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON4': '0.400', 'weapon4': '0.524', 'WEAPON3': '1.300', 'weapon3': '2.456', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '11.610', 'FRAGCOUNT': '40.000'} [2023-02-24 21:03:55,229][213368] DAMAGECOUNT value on done: 341071.0 [2023-02-24 21:03:55,229][213368] Sum rewards: 51.246, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.456', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'AMMO3': '0.176', 'WEAPON4': '0.350', 'weapon4': '0.412', 'weapon2': '0.498', 'WEAPON3': '1.200', 'weapon3': '2.796', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.771', 'FRAGCOUNT': '45.000'} [2023-02-24 21:03:55,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13482.1). Total num frames: 131731456. Throughput: 0: 3376.8. Samples: 7925214. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:03:55,243][213332] Avg episode reward: [(0, '42.825')] [2023-02-24 21:03:55,247][213352] Saving new best policy, reward=42.825! [2023-02-24 21:03:55,353][213383] DAMAGECOUNT value on done: 341554.0 [2023-02-24 21:03:55,354][213383] Sum rewards: 40.925, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.554', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.201', 'weapon4': '0.234', 'weapon2': '1.058', 'WEAPON3': '1.250', 'weapon3': '2.504', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '12.030', 'FRAGCOUNT': '36.000'} [2023-02-24 21:03:55,459][213384] DAMAGECOUNT value on done: 338363.0 [2023-02-24 21:03:55,460][213384] Sum rewards: 42.484, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.310', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.040', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.240', 'weapon4': '0.286', 'WEAPON3': '1.200', 'HITCOUNT': '2.740', 'weapon3': '3.198', 'DAMAGECOUNT': '11.907', 'FRAGCOUNT': '37.000'} [2023-02-24 21:03:55,736][213384] DAMAGECOUNT value on done: 352509.0 [2023-02-24 21:03:55,737][213384] Sum rewards: 45.525, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.982', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'weapon5': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.260', 'weapon4': '0.280', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.000', 'weapon3': '3.178', 'DAMAGECOUNT': '13.638', 'FRAGCOUNT': '38.500'} [2023-02-24 21:03:56,029][213384] DAMAGECOUNT value on done: 355460.0 [2023-02-24 21:03:56,030][213384] Sum rewards: 41.457, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.258', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.102', 'AMMO4': '0.136', 'weapon2': '0.170', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.592', 'WEAPON3': '1.300', 'HITCOUNT': '2.480', 'weapon3': '2.786', 'DAMAGECOUNT': '12.081', 'FRAGCOUNT': '39.000'} [2023-02-24 21:03:56,694][213365] Updated weights for policy 0, policy_version 32166 (0.0009) [2023-02-24 21:03:59,769][213365] Updated weights for policy 0, policy_version 32176 (0.0009) [2023-02-24 21:04:00,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13468.2). Total num frames: 131796992. Throughput: 0: 3377.9. Samples: 7945354. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:04:00,243][213332] Avg episode reward: [(0, '43.075')] [2023-02-24 21:04:00,244][213352] Saving new best policy, reward=43.075! [2023-02-24 21:04:02,786][213365] Updated weights for policy 0, policy_version 32186 (0.0009) [2023-02-24 21:04:05,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13482.1). Total num frames: 131866624. Throughput: 0: 3377.3. Samples: 7955572. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:04:05,243][213332] Avg episode reward: [(0, '43.075')] [2023-02-24 21:04:05,820][213365] Updated weights for policy 0, policy_version 32196 (0.0009) [2023-02-24 21:04:08,855][213365] Updated weights for policy 0, policy_version 32206 (0.0009) [2023-02-24 21:04:10,243][213332] Fps is (10 sec: 13516.6, 60 sec: 13516.8, 300 sec: 13482.1). Total num frames: 131932160. Throughput: 0: 3373.6. Samples: 7975814. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:04:10,243][213332] Avg episode reward: [(0, '43.075')] [2023-02-24 21:04:11,809][213365] Updated weights for policy 0, policy_version 32216 (0.0008) [2023-02-24 21:04:11,841][213367] DAMAGECOUNT value on done: 347324.0 [2023-02-24 21:04:11,841][213367] Sum rewards: 40.014, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.320', 'weapon5': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO3': '0.146', 'AMMO4': '0.160', 'weapon4': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'WEAPON3': '0.900', 'weapon2': '0.900', 'weapon3': '2.682', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '10.974', 'FRAGCOUNT': '34.000'} [2023-02-24 21:04:12,038][213367] DAMAGECOUNT value on done: 352721.0 [2023-02-24 21:04:12,038][213367] Sum rewards: 45.815, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.830', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.049', 'weapon5': '0.190', 'AMMO3': '0.205', 'AMMO4': '0.243', 'weapon2': '0.282', 'WEAPON4': '0.550', 'weapon4': '0.572', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.598', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '13.269', 'FRAGCOUNT': '42.000'} [2023-02-24 21:04:12,163][213367] DAMAGECOUNT value on done: 350955.0 [2023-02-24 21:04:12,163][213367] Sum rewards: 44.783, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.395', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.044', 'weapon4': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'weapon2': '0.372', 'WEAPON3': '1.100', 'HITCOUNT': '2.570', 'weapon3': '3.290', 'DAMAGECOUNT': '11.154', 'FRAGCOUNT': '39.000'} [2023-02-24 21:04:12,361][213367] DAMAGECOUNT value on done: 351739.0 [2023-02-24 21:04:12,361][213367] Sum rewards: 40.131, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.570', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO2': '0.019', 'AMMO4': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon4': '0.372', 'weapon2': '0.420', 'WEAPON3': '1.250', 'HITCOUNT': '2.630', 'weapon3': '3.008', 'DAMAGECOUNT': '10.008', 'FRAGCOUNT': '36.000'} [2023-02-24 21:04:12,579][213372] DAMAGECOUNT value on done: 355951.0 [2023-02-24 21:04:12,579][213372] Sum rewards: 51.102, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.122', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon5': '0.038', 'weapon4': '0.068', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.250', 'weapon2': '0.358', 'WEAPON3': '1.550', 'HITCOUNT': '3.220', 'weapon3': '3.266', 'DAMAGECOUNT': '14.553', 'FRAGCOUNT': '47.000'} [2023-02-24 21:04:12,807][213372] DAMAGECOUNT value on done: 348606.0 [2023-02-24 21:04:12,808][213372] Sum rewards: 42.209, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.704', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.124', 'AMMO4': '0.143', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon4': '0.316', 'weapon2': '0.440', 'WEAPON3': '1.500', 'HITCOUNT': '2.570', 'weapon3': '2.744', 'DAMAGECOUNT': '11.154', 'FRAGCOUNT': '41.000'} [2023-02-24 21:04:12,907][213372] DAMAGECOUNT value on done: 356476.0 [2023-02-24 21:04:12,908][213372] Sum rewards: 40.924, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.680', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.018', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'WEAPON3': '0.950', 'weapon2': '1.190', 'HITCOUNT': '2.180', 'weapon3': '2.512', 'DAMAGECOUNT': '9.915', 'FRAGCOUNT': '35.000'} [2023-02-24 21:04:13,129][213372] DAMAGECOUNT value on done: 344132.0 [2023-02-24 21:04:13,130][213372] Sum rewards: 30.216, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.400', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.120', 'AMMO4': '0.151', 'AMMO3': '0.180', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.680', 'weapon4': '0.792', 'WEAPON3': '1.050', 'weapon3': '2.074', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '9.798', 'FRAGCOUNT': '28.000'} [2023-02-24 21:04:13,209][213366] DAMAGECOUNT value on done: 347628.0 [2023-02-24 21:04:13,210][213366] Sum rewards: 40.330, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.050', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.128', 'AMMO3': '0.196', 'weapon2': '0.212', 'WEAPON4': '0.300', 'weapon4': '0.436', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.440', 'weapon3': '2.930', 'DAMAGECOUNT': '11.799', 'FRAGCOUNT': '36.500'} [2023-02-24 21:04:13,518][213366] DAMAGECOUNT value on done: 354495.0 [2023-02-24 21:04:13,518][213366] Sum rewards: 38.546, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.395', 'AMMO5': '0.018', 'AMMO2': '0.063', 'weapon5': '0.150', 'AMMO3': '0.202', 'weapon2': '0.300', 'AMMO4': '0.316', 'WEAPON5': '0.450', 'WEAPON4': '0.700', 'weapon4': '0.850', 'WEAPON3': '1.250', 'weapon3': '2.280', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '10.341', 'FRAGCOUNT': '39.000'} [2023-02-24 21:04:13,538][213366] DAMAGECOUNT value on done: 362318.0 [2023-02-24 21:04:13,538][213366] Sum rewards: 37.161, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.718', 'AMMO5': '0.018', 'AMMO2': '0.073', 'weapon5': '0.180', 'AMMO3': '0.199', 'AMMO4': '0.366', 'weapon4': '0.448', 'WEAPON5': '0.450', 'weapon2': '0.450', 'WEAPON4': '0.700', 'WEAPON3': '1.200', 'HITCOUNT': '2.570', 'weapon3': '2.614', 'DAMAGECOUNT': '12.360', 'FRAGCOUNT': '35.500'} [2023-02-24 21:04:13,835][213366] DAMAGECOUNT value on done: 347032.0 [2023-02-24 21:04:13,836][213366] Sum rewards: 23.005, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.075', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.126', 'WEAPON5': '0.200', 'weapon4': '0.220', 'AMMO3': '0.222', 'AMMO4': '0.244', 'WEAPON4': '0.450', 'weapon2': '0.742', 'WEAPON3': '1.250', 'HITCOUNT': '1.910', 'weapon3': '2.620', 'DAMAGECOUNT': '7.785', 'FRAGCOUNT': '24.000'} [2023-02-24 21:04:14,013][213382] DAMAGECOUNT value on done: 351341.0 [2023-02-24 21:04:14,014][213382] Sum rewards: 38.373, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.680', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.124', 'AMMO4': '0.141', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.260', 'weapon2': '0.590', 'WEAPON3': '1.200', 'HITCOUNT': '2.310', 'weapon3': '2.776', 'DAMAGECOUNT': '10.731', 'FRAGCOUNT': '34.000'} [2023-02-24 21:04:14,044][213383] DAMAGECOUNT value on done: 348177.0 [2023-02-24 21:04:14,044][213383] Sum rewards: 45.471, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.213', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'weapon2': '0.310', 'WEAPON4': '0.550', 'weapon4': '0.834', 'WEAPON3': '1.100', 'weapon3': '2.428', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.678', 'FRAGCOUNT': '40.000'} [2023-02-24 21:04:14,101][213369] DAMAGECOUNT value on done: 357178.0 [2023-02-24 21:04:14,102][213369] Sum rewards: 34.787, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.940', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.058', 'AMMO4': '0.158', 'WEAPON5': '0.200', 'weapon4': '0.202', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.350', 'HITCOUNT': '2.570', 'weapon3': '3.194', 'DAMAGECOUNT': '9.918', 'FRAGCOUNT': '34.000'} [2023-02-24 21:04:14,207][213368] DAMAGECOUNT value on done: 347853.0 [2023-02-24 21:04:14,208][213368] Sum rewards: 34.999, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.296', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.173', 'weapon2': '0.176', 'WEAPON4': '0.350', 'weapon4': '0.608', 'WEAPON3': '1.100', 'HITCOUNT': '2.140', 'weapon3': '2.920', 'DAMAGECOUNT': '9.588', 'FRAGCOUNT': '32.000'} [2023-02-24 21:04:14,327][213382] DAMAGECOUNT value on done: 352173.0 [2023-02-24 21:04:14,328][213382] Sum rewards: 45.411, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.290', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'WEAPON4': '0.350', 'weapon4': '0.366', 'weapon2': '0.592', 'WEAPON3': '1.000', 'HITCOUNT': '2.500', 'weapon3': '2.588', 'DAMAGECOUNT': '11.982', 'FRAGCOUNT': '39.000'} [2023-02-24 21:04:14,364][213383] DAMAGECOUNT value on done: 351051.0 [2023-02-24 21:04:14,364][213383] Sum rewards: 37.874, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.480', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.056', 'AMMO4': '0.121', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.310', 'weapon2': '0.702', 'WEAPON3': '1.250', 'HITCOUNT': '2.160', 'weapon3': '2.736', 'DAMAGECOUNT': '9.549', 'FRAGCOUNT': '35.000'} [2023-02-24 21:04:14,415][213369] DAMAGECOUNT value on done: 349249.0 [2023-02-24 21:04:14,416][213369] Sum rewards: 47.244, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.287', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.189', 'weapon5': '0.208', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.452', 'weapon4': '0.474', 'WEAPON3': '1.150', 'weapon3': '2.494', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.680', 'FRAGCOUNT': '40.500'} [2023-02-24 21:04:14,529][213368] DAMAGECOUNT value on done: 354851.0 [2023-02-24 21:04:14,530][213368] Sum rewards: 43.351, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.540', 'AMMO5': '0.007', 'AMMO2': '0.025', 'WEAPON4': '0.100', 'AMMO4': '0.127', 'weapon4': '0.128', 'weapon5': '0.146', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'WEAPON3': '0.950', 'weapon2': '1.082', 'weapon3': '2.424', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '11.292', 'FRAGCOUNT': '36.000'} [2023-02-24 21:04:14,668][213382] DAMAGECOUNT value on done: 342770.0 [2023-02-24 21:04:14,668][213382] Sum rewards: 40.696, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.136', 'AMMO5': '0.016', 'AMMO2': '0.025', 'weapon5': '0.048', 'AMMO4': '0.125', 'AMMO3': '0.211', 'weapon4': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.530', 'WEAPON3': '1.350', 'HITCOUNT': '2.730', 'weapon3': '2.886', 'DAMAGECOUNT': '11.982', 'FRAGCOUNT': '38.000'} [2023-02-24 21:04:14,728][213369] DAMAGECOUNT value on done: 354842.0 [2023-02-24 21:04:14,729][213369] Sum rewards: 45.369, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.426', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.200', 'weapon2': '0.236', 'WEAPON3': '1.200', 'HITCOUNT': '2.370', 'weapon3': '3.362', 'DAMAGECOUNT': '12.429', 'FRAGCOUNT': '39.000'} [2023-02-24 21:04:14,809][213368] DAMAGECOUNT value on done: 350041.0 [2023-02-24 21:04:14,810][213368] Sum rewards: 27.740, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.960', 'AMMO5': '0.012', 'AMMO2': '0.054', 'weapon5': '0.182', 'AMMO3': '0.187', 'AMMO4': '0.269', 'weapon2': '0.288', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.884', 'WEAPON3': '1.100', 'HITCOUNT': '2.100', 'weapon3': '2.218', 'DAMAGECOUNT': '9.606', 'FRAGCOUNT': '27.000'} [2023-02-24 21:04:14,928][213365] Updated weights for policy 0, policy_version 32226 (0.0009) [2023-02-24 21:04:14,986][213382] DAMAGECOUNT value on done: 349307.0 [2023-02-24 21:04:14,986][213382] Sum rewards: 40.353, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.202', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.014', 'weapon5': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.178', 'weapon4': '0.244', 'WEAPON5': '0.350', 'weapon2': '0.486', 'WEAPON3': '1.050', 'HITCOUNT': '2.480', 'weapon3': '3.010', 'DAMAGECOUNT': '11.079', 'FRAGCOUNT': '33.000'} [2023-02-24 21:04:14,993][213383] DAMAGECOUNT value on done: 351611.0 [2023-02-24 21:04:14,994][213383] Sum rewards: 44.419, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.436', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.036', 'weapon5': '0.040', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.218', 'AMMO3': '0.250', 'weapon2': '0.600', 'WEAPON3': '1.600', 'weapon3': '2.916', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '12.306', 'FRAGCOUNT': '43.000'} [2023-02-24 21:04:15,050][213369] DAMAGECOUNT value on done: 340023.0 [2023-02-24 21:04:15,051][213369] Sum rewards: 30.529, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.864', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.054', 'AMMO4': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'weapon4': '0.420', 'weapon2': '0.432', 'WEAPON3': '1.300', 'HITCOUNT': '2.280', 'weapon3': '2.854', 'DAMAGECOUNT': '9.612', 'FRAGCOUNT': '30.000'} [2023-02-24 21:04:15,091][213384] DAMAGECOUNT value on done: 357366.0 [2023-02-24 21:04:15,092][213384] Sum rewards: 44.496, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.791', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.171', 'AMMO4': '0.189', 'weapon5': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON4': '0.300', 'weapon4': '0.658', 'WEAPON3': '1.050', 'weapon3': '2.372', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '11.715', 'FRAGCOUNT': '39.000'} [2023-02-24 21:04:15,126][213368] DAMAGECOUNT value on done: 345371.0 [2023-02-24 21:04:15,126][213368] Sum rewards: 42.416, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.780', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.136', 'AMMO3': '0.182', 'AMMO4': '0.206', 'weapon2': '0.258', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.796', 'WEAPON3': '1.000', 'weapon3': '2.524', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.900', 'FRAGCOUNT': '38.000'} [2023-02-24 21:04:15,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13482.1). Total num frames: 132001792. Throughput: 0: 3370.6. Samples: 7996020. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:04:15,243][213332] Avg episode reward: [(0, '42.080')] [2023-02-24 21:04:15,287][213383] DAMAGECOUNT value on done: 345609.0 [2023-02-24 21:04:15,288][213383] Sum rewards: 38.958, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.128', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon5': '0.128', 'AMMO3': '0.213', 'AMMO4': '0.228', 'weapon4': '0.270', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.788', 'WEAPON3': '1.250', 'HITCOUNT': '2.350', 'weapon3': '2.504', 'DAMAGECOUNT': '11.745', 'FRAGCOUNT': '38.000'} [2023-02-24 21:04:15,393][213384] DAMAGECOUNT value on done: 341808.0 [2023-02-24 21:04:15,393][213384] Sum rewards: 45.420, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.995', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO3': '0.091', 'AMMO4': '0.098', 'weapon5': '0.102', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.532', 'WEAPON3': '0.750', 'weapon2': '0.922', 'weapon3': '2.210', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '10.335', 'FRAGCOUNT': '37.000'} [2023-02-24 21:04:15,668][213384] DAMAGECOUNT value on done: 356148.0 [2023-02-24 21:04:15,669][213384] Sum rewards: 44.081, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.226', 'AMMO5': '0.005', 'AMMO2': '0.046', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'weapon2': '0.216', 'AMMO4': '0.231', 'WEAPON4': '0.450', 'weapon4': '0.818', 'WEAPON3': '1.050', 'HITCOUNT': '2.590', 'weapon3': '2.608', 'DAMAGECOUNT': '10.917', 'FRAGCOUNT': '41.000'} [2023-02-24 21:04:15,965][213384] DAMAGECOUNT value on done: 359210.0 [2023-02-24 21:04:15,965][213384] Sum rewards: 36.571, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.692', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.072', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'AMMO4': '0.224', 'weapon2': '0.500', 'WEAPON4': '0.700', 'weapon4': '0.968', 'WEAPON3': '1.150', 'weapon3': '2.000', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '11.250', 'FRAGCOUNT': '35.000'} [2023-02-24 21:04:16,631][213382] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 21:04:17,892][213365] Updated weights for policy 0, policy_version 32236 (0.0009) [2023-02-24 21:04:20,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.9, 300 sec: 13482.1). Total num frames: 132067328. Throughput: 0: 3372.8. Samples: 8006294. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:04:20,243][213332] Avg episode reward: [(0, '42.503')] [2023-02-24 21:04:20,951][213365] Updated weights for policy 0, policy_version 32246 (0.0010) [2023-02-24 21:04:23,989][213365] Updated weights for policy 0, policy_version 32256 (0.0009) [2023-02-24 21:04:25,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13482.1). Total num frames: 132136960. Throughput: 0: 3375.1. Samples: 8026560. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:04:25,243][213332] Avg episode reward: [(0, '42.503')] [2023-02-24 21:04:26,975][213365] Updated weights for policy 0, policy_version 32266 (0.0009) [2023-02-24 21:04:30,053][213365] Updated weights for policy 0, policy_version 32276 (0.0009) [2023-02-24 21:04:30,243][213332] Fps is (10 sec: 13516.6, 60 sec: 13516.8, 300 sec: 13482.1). Total num frames: 132202496. Throughput: 0: 3378.5. Samples: 8046818. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:04:30,244][213332] Avg episode reward: [(0, '42.503')] [2023-02-24 21:04:31,665][213367] DAMAGECOUNT value on done: 351240.0 [2023-02-24 21:04:31,665][213367] Sum rewards: 41.905, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.818', 'AMMO5': '0.019', 'AMMO2': '0.054', 'AMMO3': '0.159', 'AMMO4': '0.270', 'weapon5': '0.292', 'WEAPON5': '0.400', 'weapon2': '0.410', 'WEAPON4': '0.550', 'weapon4': '0.836', 'WEAPON3': '0.900', 'weapon3': '2.054', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '11.748', 'FRAGCOUNT': '38.000'} [2023-02-24 21:04:31,874][213367] DAMAGECOUNT value on done: 356501.0 [2023-02-24 21:04:31,875][213367] Sum rewards: 36.894, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.186', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.108', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'AMMO4': '0.219', 'weapon2': '0.226', 'WEAPON4': '0.400', 'weapon4': '0.440', 'WEAPON3': '1.250', 'HITCOUNT': '2.470', 'weapon3': '2.662', 'DAMAGECOUNT': '11.340', 'FRAGCOUNT': '35.000'} [2023-02-24 21:04:31,977][213367] DAMAGECOUNT value on done: 355536.0 [2023-02-24 21:04:31,977][213367] Sum rewards: 52.845, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.036', 'AMMO5': '0.011', 'AMMO2': '0.042', 'AMMO3': '0.153', 'weapon2': '0.162', 'AMMO4': '0.211', 'weapon5': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.808', 'WEAPON3': '0.950', 'weapon3': '2.270', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.743', 'FRAGCOUNT': '43.000'} [2023-02-24 21:04:32,195][213367] DAMAGECOUNT value on done: 355567.0 [2023-02-24 21:04:32,196][213367] Sum rewards: 39.155, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.076', 'ARMOR': '0.004', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'AMMO4': '0.169', 'weapon5': '0.174', 'AMMO3': '0.226', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.466', 'weapon2': '0.516', 'WEAPON3': '1.350', 'weapon3': '2.424', 'HITCOUNT': '2.450', 'DAMAGECOUNT': '11.484', 'FRAGCOUNT': '37.000'} [2023-02-24 21:04:32,467][213372] DAMAGECOUNT value on done: 359447.0 [2023-02-24 21:04:32,467][213372] Sum rewards: 33.856, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.984', 'AMMO5': '0.010', 'AMMO2': '0.059', 'weapon5': '0.102', 'AMMO3': '0.235', 'weapon2': '0.254', 'AMMO4': '0.296', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON4': '0.850', 'weapon4': '1.158', 'WEAPON3': '1.350', 'weapon3': '2.168', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '10.488', 'FRAGCOUNT': '36.500'} [2023-02-24 21:04:32,755][213372] DAMAGECOUNT value on done: 352250.0 [2023-02-24 21:04:32,755][213372] Sum rewards: 33.249, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.830', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.048', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon4': '0.240', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.350', 'HITCOUNT': '2.560', 'weapon3': '3.116', 'DAMAGECOUNT': '10.932', 'FRAGCOUNT': '33.000'} [2023-02-24 21:04:32,794][213372] DAMAGECOUNT value on done: 361083.0 [2023-02-24 21:04:32,795][213372] Sum rewards: 51.309, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.752', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon5': '0.134', 'AMMO3': '0.168', 'AMMO4': '0.216', 'WEAPON5': '0.250', 'weapon4': '0.256', 'WEAPON4': '0.400', 'weapon2': '0.440', 'WEAPON3': '1.100', 'weapon3': '2.788', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.821', 'FRAGCOUNT': '45.000'} [2023-02-24 21:04:32,991][213383] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 21:04:33,063][213365] Updated weights for policy 0, policy_version 32286 (0.0009) [2023-02-24 21:04:33,074][213372] DAMAGECOUNT value on done: 348864.0 [2023-02-24 21:04:33,075][213372] Sum rewards: 55.737, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.415', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon5': '0.104', 'AMMO4': '0.107', 'AMMO3': '0.175', 'WEAPON5': '0.250', 'weapon4': '0.286', 'WEAPON4': '0.350', 'weapon2': '0.404', 'WEAPON3': '1.200', 'HITCOUNT': '2.870', 'weapon3': '2.928', 'DAMAGECOUNT': '14.196', 'FRAGCOUNT': '49.000'} [2023-02-24 21:04:33,094][213366] DAMAGECOUNT value on done: 351250.0 [2023-02-24 21:04:33,095][213366] Sum rewards: 39.774, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.839', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.152', 'AMMO3': '0.161', 'WEAPON5': '0.200', 'weapon4': '0.294', 'WEAPON4': '0.300', 'weapon2': '0.648', 'WEAPON3': '1.100', 'HITCOUNT': '2.480', 'weapon3': '2.498', 'DAMAGECOUNT': '10.866', 'FRAGCOUNT': '35.000'} [2023-02-24 21:04:33,400][213366] DAMAGECOUNT value on done: 358656.0 [2023-02-24 21:04:33,400][213366] Sum rewards: 41.594, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.848', 'AMMO2': '0.016', 'AMMO5': '0.023', 'AMMO4': '0.081', 'weapon5': '0.104', 'WEAPON4': '0.250', 'AMMO3': '0.260', 'weapon2': '0.260', 'weapon4': '0.264', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '3.010', 'weapon3': '3.040', 'DAMAGECOUNT': '12.483', 'FRAGCOUNT': '39.000'} [2023-02-24 21:04:33,421][213366] DAMAGECOUNT value on done: 366246.0 [2023-02-24 21:04:33,422][213366] Sum rewards: 46.642, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.681', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.122', 'WEAPON4': '0.300', 'weapon2': '0.338', 'weapon4': '0.666', 'WEAPON3': '0.850', 'weapon3': '2.606', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '11.784', 'FRAGCOUNT': '40.000'} [2023-02-24 21:04:33,730][213366] DAMAGECOUNT value on done: 350889.0 [2023-02-24 21:04:33,731][213366] Sum rewards: 39.379, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.356', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon5': '0.164', 'AMMO3': '0.172', 'AMMO4': '0.237', 'WEAPON5': '0.350', 'weapon2': '0.450', 'ARMOR': '0.451', 'weapon4': '0.538', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.562', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '11.571', 'FRAGCOUNT': '36.000'} [2023-02-24 21:04:33,922][213382] DAMAGECOUNT value on done: 355311.0 [2023-02-24 21:04:33,923][213382] Sum rewards: 41.362, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.794', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.088', 'AMMO3': '0.153', 'AMMO4': '0.209', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.604', 'weapon4': '0.618', 'WEAPON3': '1.000', 'weapon3': '2.464', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '11.760', 'FRAGCOUNT': '35.000'} [2023-02-24 21:04:33,934][213383] DAMAGECOUNT value on done: 351465.0 [2023-02-24 21:04:33,934][213383] Sum rewards: 31.669, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.392', 'ARMOR': '0.008', 'AMMO5': '0.028', 'AMMO2': '0.042', 'weapon7': '0.050', 'weapon5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.170', 'WEAPON7': '0.200', 'AMMO4': '0.212', 'WEAPON5': '0.500', 'weapon2': '0.576', 'WEAPON4': '0.600', 'WEAPON3': '1.000', 'weapon4': '1.120', 'weapon3': '1.830', 'HITCOUNT': '2.270', 'DAMAGECOUNT': '9.864', 'FRAGCOUNT': '31.000'} [2023-02-24 21:04:34,046][213369] DAMAGECOUNT value on done: 361748.0 [2023-02-24 21:04:34,046][213369] Sum rewards: 52.192, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.170', 'AMMO5': '0.019', 'AMMO2': '0.040', 'AMMO3': '0.135', 'weapon5': '0.192', 'AMMO4': '0.200', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.606', 'WEAPON3': '0.700', 'weapon2': '0.798', 'weapon3': '2.112', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.710', 'FRAGCOUNT': '42.000'} [2023-02-24 21:04:34,103][213368] DAMAGECOUNT value on done: 351978.0 [2023-02-24 21:04:34,103][213368] Sum rewards: 42.719, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.690', 'AMMO5': '0.022', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.158', 'AMMO3': '0.176', 'weapon2': '0.246', 'WEAPON4': '0.350', 'weapon4': '0.402', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'HITCOUNT': '2.700', 'weapon3': '2.862', 'DAMAGECOUNT': '12.291', 'FRAGCOUNT': '36.000'} [2023-02-24 21:04:34,242][213382] DAMAGECOUNT value on done: 355719.0 [2023-02-24 21:04:34,244][213382] Sum rewards: 31.667, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.900', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO4': '0.195', 'weapon5': '0.202', 'AMMO3': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.356', 'WEAPON4': '0.400', 'weapon2': '0.528', 'WEAPON3': '1.450', 'HITCOUNT': '2.390', 'weapon3': '2.556', 'DAMAGECOUNT': '10.638', 'FRAGCOUNT': '35.500'} [2023-02-24 21:04:34,251][213383] DAMAGECOUNT value on done: 354546.0 [2023-02-24 21:04:34,252][213383] Sum rewards: 37.319, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.928', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon7': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.152', 'AMMO3': '0.179', 'AMMO4': '0.225', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON4': '0.500', 'weapon4': '0.902', 'WEAPON3': '1.000', 'weapon3': '2.272', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '10.485', 'FRAGCOUNT': '34.000'} [2023-02-24 21:04:34,365][213369] DAMAGECOUNT value on done: 353094.0 [2023-02-24 21:04:34,365][213369] Sum rewards: 42.422, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.241', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon4': '0.260', 'weapon2': '0.472', 'WEAPON3': '1.100', 'HITCOUNT': '2.530', 'weapon3': '2.744', 'DAMAGECOUNT': '11.535', 'FRAGCOUNT': '37.000'} [2023-02-24 21:04:34,415][213368] DAMAGECOUNT value on done: 358399.0 [2023-02-24 21:04:34,415][213368] Sum rewards: 33.918, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.315', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon5': '0.146', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'weapon2': '0.556', 'WEAPON4': '0.600', 'weapon4': '0.750', 'WEAPON3': '1.050', 'weapon3': '2.262', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '10.644', 'FRAGCOUNT': '33.000'} [2023-02-24 21:04:34,582][213382] DAMAGECOUNT value on done: 346917.0 [2023-02-24 21:04:34,583][213382] Sum rewards: 42.575, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.440', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.132', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'weapon4': '0.262', 'weapon2': '0.338', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '2.870', 'weapon3': '3.016', 'DAMAGECOUNT': '12.441', 'FRAGCOUNT': '41.000'} [2023-02-24 21:04:34,679][213369] DAMAGECOUNT value on done: 358454.0 [2023-02-24 21:04:34,680][213369] Sum rewards: 37.571, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.490', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon5': '0.174', 'AMMO3': '0.232', 'WEAPON4': '0.350', 'weapon2': '0.436', 'weapon4': '0.448', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.644', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '10.836', 'FRAGCOUNT': '36.000'} [2023-02-24 21:04:34,688][213368] DAMAGECOUNT value on done: 353450.0 [2023-02-24 21:04:34,688][213368] Sum rewards: 35.852, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.500', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.030', 'AMMO2': '0.034', 'weapon4': '0.086', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'ARMOR': '0.455', 'weapon2': '0.496', 'WEAPON3': '1.150', 'HITCOUNT': '2.480', 'weapon3': '3.164', 'DAMAGECOUNT': '10.227', 'FRAGCOUNT': '32.000'} [2023-02-24 21:04:34,871][213383] DAMAGECOUNT value on done: 355530.0 [2023-02-24 21:04:34,871][213383] Sum rewards: 42.065, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.303', 'ARMOR': '0.004', 'AMMO5': '0.012', 'weapon7': '0.048', 'AMMO2': '0.054', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.136', 'AMMO3': '0.176', 'WEAPON7': '0.200', 'AMMO4': '0.269', 'WEAPON5': '0.300', 'weapon4': '0.352', 'WEAPON4': '0.400', 'weapon2': '0.560', 'WEAPON3': '1.100', 'HITCOUNT': '2.580', 'weapon3': '2.680', 'DAMAGECOUNT': '11.757', 'FRAGCOUNT': '37.000'} [2023-02-24 21:04:34,885][213382] DAMAGECOUNT value on done: 353616.0 [2023-02-24 21:04:34,885][213382] Sum rewards: 50.388, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.102', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.040', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'weapon5': '0.214', 'WEAPON5': '0.250', 'weapon4': '0.482', 'weapon2': '0.632', 'WEAPON3': '1.000', 'weapon3': '2.380', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.927', 'FRAGCOUNT': '41.000'} [2023-02-24 21:04:34,979][213384] DAMAGECOUNT value on done: 361610.0 [2023-02-24 21:04:34,979][213384] Sum rewards: 45.807, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.734', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.058', 'weapon4': '0.068', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon2': '0.754', 'WEAPON3': '1.100', 'HITCOUNT': '2.660', 'weapon3': '2.916', 'DAMAGECOUNT': '12.732', 'FRAGCOUNT': '40.000'} [2023-02-24 21:04:34,983][213369] DAMAGECOUNT value on done: 344534.0 [2023-02-24 21:04:34,983][213369] Sum rewards: 49.855, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.530', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.162', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON4': '0.400', 'weapon4': '0.532', 'WEAPON3': '1.250', 'weapon3': '2.578', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.533', 'FRAGCOUNT': '46.000'} [2023-02-24 21:04:34,997][213368] DAMAGECOUNT value on done: 349076.0 [2023-02-24 21:04:34,998][213368] Sum rewards: 44.136, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.655', 'AMMO5': '0.014', 'AMMO2': '0.023', 'AMMO3': '0.106', 'AMMO4': '0.113', 'weapon5': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.402', 'WEAPON3': '0.700', 'weapon2': '0.836', 'weapon3': '2.260', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '11.115', 'FRAGCOUNT': '36.000'} [2023-02-24 21:04:35,166][213383] DAMAGECOUNT value on done: 349432.0 [2023-02-24 21:04:35,167][213383] Sum rewards: 46.399, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.298', 'AMMO5': '0.016', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.205', 'weapon5': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.436', 'weapon2': '0.564', 'WEAPON3': '1.250', 'weapon3': '2.436', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '11.469', 'FRAGCOUNT': '42.000'} [2023-02-24 21:04:35,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13482.1). Total num frames: 132272128. Throughput: 0: 3376.7. Samples: 8056996. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:04:35,243][213332] Avg episode reward: [(0, '42.137')] [2023-02-24 21:04:35,275][213384] DAMAGECOUNT value on done: 345558.0 [2023-02-24 21:04:35,276][213384] Sum rewards: 42.966, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.750', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.150', 'AMMO4': '0.164', 'weapon2': '0.178', 'WEAPON4': '0.500', 'WEAPON3': '0.850', 'weapon4': '0.958', 'weapon3': '2.408', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '11.250', 'FRAGCOUNT': '38.000'} [2023-02-24 21:04:35,552][213384] DAMAGECOUNT value on done: 359718.0 [2023-02-24 21:04:35,552][213384] Sum rewards: 42.779, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.080', 'AMMO5': '0.017', 'AMMO2': '0.027', 'weapon5': '0.086', 'AMMO4': '0.135', 'AMMO3': '0.148', 'weapon2': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.630', 'WEAPON3': '0.950', 'HITCOUNT': '2.410', 'weapon3': '2.600', 'DAMAGECOUNT': '10.710', 'FRAGCOUNT': '35.000'} [2023-02-24 21:04:35,858][213384] DAMAGECOUNT value on done: 362848.0 [2023-02-24 21:04:35,859][213384] Sum rewards: 36.080, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.266', 'AMMO5': '0.020', 'AMMO2': '0.052', 'AMMO3': '0.165', 'AMMO4': '0.259', 'weapon5': '0.310', 'weapon4': '0.414', 'weapon2': '0.510', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'HITCOUNT': '2.300', 'weapon3': '2.402', 'DAMAGECOUNT': '10.914', 'FRAGCOUNT': '34.000'} [2023-02-24 21:04:36,111][213365] Updated weights for policy 0, policy_version 32296 (0.0009) [2023-02-24 21:04:39,148][213365] Updated weights for policy 0, policy_version 32306 (0.0010) [2023-02-24 21:04:40,243][213332] Fps is (10 sec: 13517.0, 60 sec: 13516.8, 300 sec: 13482.1). Total num frames: 132337664. Throughput: 0: 3376.7. Samples: 8077164. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:04:40,243][213332] Avg episode reward: [(0, '42.399')] [2023-02-24 21:04:42,143][213365] Updated weights for policy 0, policy_version 32316 (0.0009) [2023-02-24 21:04:45,236][213365] Updated weights for policy 0, policy_version 32326 (0.0010) [2023-02-24 21:04:45,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13482.1). Total num frames: 132407296. Throughput: 0: 3377.3. Samples: 8097334. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:04:45,243][213332] Avg episode reward: [(0, '42.399')] [2023-02-24 21:04:45,247][213352] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000032326_132407296.pth... [2023-02-24 21:04:45,306][213352] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000031536_129171456.pth [2023-02-24 21:04:48,279][213365] Updated weights for policy 0, policy_version 32336 (0.0009) [2023-02-24 21:04:50,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13482.1). Total num frames: 132472832. Throughput: 0: 3375.9. Samples: 8107486. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 21:04:50,243][213332] Avg episode reward: [(0, '42.399')] [2023-02-24 21:04:51,305][213365] Updated weights for policy 0, policy_version 32346 (0.0009) [2023-02-24 21:04:51,629][213367] DAMAGECOUNT value on done: 356233.0 [2023-02-24 21:04:51,630][213367] Sum rewards: 54.760, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.946', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon5': '0.106', 'AMMO4': '0.119', 'AMMO3': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.312', 'weapon4': '0.346', 'WEAPON3': '1.150', 'HITCOUNT': '2.970', 'weapon3': '2.974', 'DAMAGECOUNT': '14.979', 'FRAGCOUNT': '47.000'} [2023-02-24 21:04:51,826][213367] DAMAGECOUNT value on done: 360962.0 [2023-02-24 21:04:51,827][213367] Sum rewards: 54.271, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.582', 'AMMO5': '0.006', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.106', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.288', 'ARMOR': '0.400', 'weapon2': '0.552', 'WEAPON3': '1.250', 'weapon3': '2.890', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.383', 'FRAGCOUNT': '47.000'} [2023-02-24 21:04:51,948][213367] DAMAGECOUNT value on done: 359335.0 [2023-02-24 21:04:51,949][213367] Sum rewards: 39.660, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.210', 'AMMO5': '0.010', 'AMMO2': '0.043', 'AMMO3': '0.158', 'AMMO4': '0.215', 'weapon5': '0.236', 'WEAPON5': '0.350', 'weapon4': '0.398', 'WEAPON4': '0.400', 'weapon2': '0.600', 'WEAPON3': '1.000', 'HITCOUNT': '2.370', 'weapon3': '2.442', 'DAMAGECOUNT': '11.397', 'FRAGCOUNT': '35.000'} [2023-02-24 21:04:52,153][213367] DAMAGECOUNT value on done: 360189.0 [2023-02-24 21:04:52,153][213367] Sum rewards: 43.653, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.088', 'AMMO5': '0.021', 'AMMO2': '0.045', 'weapon5': '0.216', 'AMMO4': '0.225', 'AMMO3': '0.233', 'weapon4': '0.416', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.574', 'WEAPON3': '1.350', 'weapon3': '2.454', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '13.566', 'FRAGCOUNT': '41.000'} [2023-02-24 21:04:52,467][213372] DAMAGECOUNT value on done: 363838.0 [2023-02-24 21:04:52,468][213372] Sum rewards: 55.118, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.433', 'AMMO2': '0.007', 'AMMO5': '0.012', 'weapon5': '0.014', 'weapon4': '0.016', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'AMMO3': '0.180', 'WEAPON5': '0.250', 'weapon2': '0.546', 'WEAPON3': '1.100', 'HITCOUNT': '2.910', 'weapon3': '3.258', 'DAMAGECOUNT': '13.173', 'FRAGCOUNT': '47.000'} [2023-02-24 21:04:52,774][213372] DAMAGECOUNT value on done: 356334.0 [2023-02-24 21:04:52,775][213372] Sum rewards: 40.907, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.576', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.110', 'weapon4': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon2': '0.498', 'WEAPON3': '1.400', 'HITCOUNT': '2.980', 'weapon3': '3.050', 'DAMAGECOUNT': '12.252', 'FRAGCOUNT': '36.000'} [2023-02-24 21:04:52,800][213372] DAMAGECOUNT value on done: 366084.0 [2023-02-24 21:04:52,801][213372] Sum rewards: 56.057, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.674', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.157', 'AMMO3': '0.201', 'weapon5': '0.250', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.436', 'weapon4': '0.554', 'WEAPON3': '1.250', 'weapon3': '2.444', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.003', 'FRAGCOUNT': '48.000'} [2023-02-24 21:04:53,051][213366] DAMAGECOUNT value on done: 355912.0 [2023-02-24 21:04:53,051][213366] Sum rewards: 50.573, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.332', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.040', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'weapon4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.239', 'weapon2': '0.292', 'WEAPON3': '1.400', 'HITCOUNT': '3.140', 'weapon3': '3.344', 'DAMAGECOUNT': '13.986', 'FRAGCOUNT': '44.000'} [2023-02-24 21:04:53,098][213372] DAMAGECOUNT value on done: 352044.0 [2023-02-24 21:04:53,099][213372] Sum rewards: 31.986, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.516', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.049', 'AMMO3': '0.116', 'weapon5': '0.196', 'AMMO4': '0.247', 'weapon2': '0.336', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '0.650', 'weapon4': '1.208', 'weapon3': '1.540', 'HITCOUNT': '2.200', 'DAMAGECOUNT': '9.540', 'FRAGCOUNT': '27.000'} [2023-02-24 21:04:53,349][213366] DAMAGECOUNT value on done: 362659.0 [2023-02-24 21:04:53,349][213366] Sum rewards: 47.994, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.904', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.168', 'weapon4': '0.222', 'weapon2': '0.678', 'WEAPON3': '1.100', 'HITCOUNT': '2.700', 'weapon3': '2.786', 'DAMAGECOUNT': '12.009', 'FRAGCOUNT': '41.000'} [2023-02-24 21:04:53,369][213366] DAMAGECOUNT value on done: 370014.0 [2023-02-24 21:04:53,369][213366] Sum rewards: 41.145, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.530', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon5': '0.128', 'AMMO4': '0.143', 'AMMO3': '0.210', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.426', 'weapon2': '0.492', 'WEAPON3': '1.200', 'weapon3': '2.560', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '11.304', 'FRAGCOUNT': '38.000'} [2023-02-24 21:04:53,674][213366] DAMAGECOUNT value on done: 355158.0 [2023-02-24 21:04:53,674][213366] Sum rewards: 49.684, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.024', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'weapon5': '0.124', 'AMMO4': '0.135', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.310', 'weapon4': '0.498', 'WEAPON3': '1.350', 'weapon3': '2.772', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '12.807', 'FRAGCOUNT': '45.000'} [2023-02-24 21:04:53,899][213382] DAMAGECOUNT value on done: 359358.0 [2023-02-24 21:04:53,899][213382] Sum rewards: 36.488, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.830', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.100', 'AMMO4': '0.171', 'AMMO3': '0.256', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.438', 'weapon2': '0.514', 'WEAPON3': '1.500', 'weapon3': '2.500', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.141', 'FRAGCOUNT': '35.500'} [2023-02-24 21:04:53,915][213383] DAMAGECOUNT value on done: 356043.0 [2023-02-24 21:04:53,916][213383] Sum rewards: 62.460, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.350', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.064', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'AMMO4': '0.229', 'WEAPON5': '0.250', 'weapon4': '0.298', 'weapon2': '0.698', 'WEAPON3': '0.900', 'weapon3': '2.714', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.734', 'FRAGCOUNT': '51.000'} [2023-02-24 21:04:54,032][213369] DAMAGECOUNT value on done: 365074.0 [2023-02-24 21:04:54,033][213369] Sum rewards: 37.194, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.740', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.052', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon4': '0.476', 'weapon2': '0.868', 'WEAPON3': '1.100', 'weapon3': '2.262', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '9.978', 'FRAGCOUNT': '33.000'} [2023-02-24 21:04:54,140][213368] DAMAGECOUNT value on done: 354912.0 [2023-02-24 21:04:54,141][213368] Sum rewards: 25.707, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.134', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon5': '0.070', 'AMMO4': '0.172', 'AMMO3': '0.179', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.514', 'weapon4': '0.558', 'WEAPON3': '1.100', 'HITCOUNT': '2.300', 'weapon3': '2.596', 'DAMAGECOUNT': '8.802', 'FRAGCOUNT': '25.000'} [2023-02-24 21:04:54,219][213382] DAMAGECOUNT value on done: 360047.0 [2023-02-24 21:04:54,220][213382] Sum rewards: 51.754, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.137', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.020', 'weapon5': '0.100', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.320', 'weapon2': '0.424', 'WEAPON3': '1.150', 'HITCOUNT': '2.850', 'weapon3': '2.970', 'DAMAGECOUNT': '12.984', 'FRAGCOUNT': '44.000'} [2023-02-24 21:04:54,233][213383] DAMAGECOUNT value on done: 358673.0 [2023-02-24 21:04:54,234][213383] Sum rewards: 41.032, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.060', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.021', 'AMMO4': '0.102', 'weapon5': '0.118', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'weapon4': '0.326', 'WEAPON5': '0.350', 'weapon2': '0.654', 'WEAPON3': '1.450', 'weapon3': '2.632', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.381', 'FRAGCOUNT': '37.000'} [2023-02-24 21:04:54,354][213369] DAMAGECOUNT value on done: 357533.0 [2023-02-24 21:04:54,355][213369] Sum rewards: 47.664, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.175', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.082', 'weapon5': '0.100', 'AMMO4': '0.129', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.350', 'HITCOUNT': '2.860', 'weapon3': '3.192', 'DAMAGECOUNT': '13.317', 'FRAGCOUNT': '44.000'} [2023-02-24 21:04:54,436][213365] Updated weights for policy 0, policy_version 32356 (0.0009) [2023-02-24 21:04:54,465][213368] DAMAGECOUNT value on done: 362905.0 [2023-02-24 21:04:54,465][213368] Sum rewards: 45.188, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.390', 'AMMO5': '0.015', 'AMMO2': '0.027', 'weapon5': '0.104', 'weapon4': '0.120', 'AMMO4': '0.132', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'weapon2': '0.310', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.850', 'weapon3': '3.176', 'DAMAGECOUNT': '13.473', 'FRAGCOUNT': '40.000'} [2023-02-24 21:04:54,580][213382] DAMAGECOUNT value on done: 349998.0 [2023-02-24 21:04:54,580][213382] Sum rewards: 26.602, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.344', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.141', 'AMMO3': '0.210', 'WEAPON4': '0.400', 'weapon2': '0.600', 'weapon4': '0.952', 'WEAPON3': '1.200', 'weapon3': '2.214', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '9.243', 'FRAGCOUNT': '27.000'} [2023-02-24 21:04:54,670][213369] DAMAGECOUNT value on done: 362183.0 [2023-02-24 21:04:54,671][213369] Sum rewards: 39.908, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.572', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon5': '0.062', 'AMMO4': '0.182', 'AMMO3': '0.220', 'WEAPON5': '0.300', 'weapon4': '0.338', 'WEAPON4': '0.450', 'weapon2': '0.470', 'WEAPON3': '1.250', 'HITCOUNT': '2.620', 'weapon3': '2.850', 'DAMAGECOUNT': '11.187', 'FRAGCOUNT': '38.000'} [2023-02-24 21:04:54,725][213368] DAMAGECOUNT value on done: 357487.0 [2023-02-24 21:04:54,725][213368] Sum rewards: 39.867, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.080', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'weapon2': '0.334', 'weapon4': '0.480', 'WEAPON3': '1.350', 'HITCOUNT': '2.750', 'weapon3': '2.828', 'DAMAGECOUNT': '12.111', 'FRAGCOUNT': '37.000'} [2023-02-24 21:04:54,866][213383] DAMAGECOUNT value on done: 360499.0 [2023-02-24 21:04:54,866][213383] Sum rewards: 63.762, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.518', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon5': '0.068', 'AMMO4': '0.159', 'AMMO3': '0.194', 'weapon2': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.508', 'WEAPON3': '1.250', 'weapon3': '2.916', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.907', 'FRAGCOUNT': '57.000'} [2023-02-24 21:04:54,890][213382] DAMAGECOUNT value on done: 357957.0 [2023-02-24 21:04:54,890][213382] Sum rewards: 50.198, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.770', 'ARMOR': '0.004', 'AMMO2': '0.011', 'AMMO5': '0.015', 'AMMO4': '0.053', 'weapon5': '0.118', 'weapon4': '0.142', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'WEAPON5': '0.400', 'weapon2': '0.406', 'WEAPON3': '1.350', 'HITCOUNT': '2.920', 'weapon3': '3.114', 'DAMAGECOUNT': '13.023', 'FRAGCOUNT': '43.000'} [2023-02-24 21:04:54,936][213384] DAMAGECOUNT value on done: 365397.0 [2023-02-24 21:04:54,937][213384] Sum rewards: 44.795, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.350', 'ARMOR': '0.005', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon5': '0.120', 'AMMO4': '0.137', 'AMMO3': '0.174', 'weapon4': '0.332', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.374', 'WEAPON3': '0.950', 'HITCOUNT': '2.640', 'weapon3': '2.812', 'DAMAGECOUNT': '11.361', 'FRAGCOUNT': '39.000'} [2023-02-24 21:04:54,980][213369] DAMAGECOUNT value on done: 347510.0 [2023-02-24 21:04:54,981][213369] Sum rewards: 26.713, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.962', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.066', 'AMMO3': '0.187', 'AMMO4': '0.222', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon4': '1.392', 'weapon3': '1.854', 'HITCOUNT': '2.400', 'DAMAGECOUNT': '8.928', 'FRAGCOUNT': '27.000'} [2023-02-24 21:04:55,022][213368] DAMAGECOUNT value on done: 353171.0 [2023-02-24 21:04:55,023][213368] Sum rewards: 39.147, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.669', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.078', 'AMMO4': '0.139', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.340', 'WEAPON4': '0.600', 'weapon4': '0.830', 'WEAPON3': '1.350', 'weapon3': '2.460', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '12.285', 'FRAGCOUNT': '38.000'} [2023-02-24 21:04:55,175][213383] DAMAGECOUNT value on done: 354073.0 [2023-02-24 21:04:55,175][213383] Sum rewards: 49.076, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.094', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon5': '0.052', 'AMMO4': '0.104', 'AMMO3': '0.219', 'weapon2': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.562', 'WEAPON3': '1.400', 'weapon3': '2.820', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.923', 'FRAGCOUNT': '45.000'} [2023-02-24 21:04:55,234][213384] DAMAGECOUNT value on done: 349848.0 [2023-02-24 21:04:55,235][213384] Sum rewards: 51.890, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.940', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.052', 'weapon5': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.160', 'weapon2': '0.172', 'AMMO3': '0.228', 'WEAPON3': '1.300', 'HITCOUNT': '2.820', 'weapon3': '3.396', 'DAMAGECOUNT': '12.870', 'FRAGCOUNT': '45.000'} [2023-02-24 21:04:55,243][213332] Fps is (10 sec: 13107.2, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 132538368. Throughput: 0: 3371.5. Samples: 8127532. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 21:04:55,243][213332] Avg episode reward: [(0, '42.349')] [2023-02-24 21:04:55,509][213384] DAMAGECOUNT value on done: 363917.0 [2023-02-24 21:04:55,509][213384] Sum rewards: 46.500, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.706', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.128', 'weapon2': '0.172', 'AMMO3': '0.226', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.718', 'WEAPON3': '1.300', 'HITCOUNT': '2.590', 'weapon3': '2.662', 'DAMAGECOUNT': '12.597', 'FRAGCOUNT': '42.000'} [2023-02-24 21:04:55,813][213384] DAMAGECOUNT value on done: 366560.0 [2023-02-24 21:04:55,814][213384] Sum rewards: 36.588, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.418', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'weapon5': '0.078', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'weapon2': '0.542', 'weapon4': '0.558', 'WEAPON3': '1.350', 'weapon3': '2.622', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '11.136', 'FRAGCOUNT': '36.000'} [2023-02-24 21:04:57,432][213365] Updated weights for policy 0, policy_version 32366 (0.0009) [2023-02-24 21:05:00,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13482.1). Total num frames: 132608000. Throughput: 0: 3369.7. Samples: 8147658. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 21:05:00,243][213332] Avg episode reward: [(0, '42.236')] [2023-02-24 21:05:00,494][213365] Updated weights for policy 0, policy_version 32376 (0.0009) [2023-02-24 21:05:03,539][213365] Updated weights for policy 0, policy_version 32386 (0.0009) [2023-02-24 21:05:05,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 132673536. Throughput: 0: 3369.5. Samples: 8157920. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 21:05:05,243][213332] Avg episode reward: [(0, '42.236')] [2023-02-24 21:05:06,539][213365] Updated weights for policy 0, policy_version 32396 (0.0009) [2023-02-24 21:05:09,635][213365] Updated weights for policy 0, policy_version 32406 (0.0010) [2023-02-24 21:05:10,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13482.1). Total num frames: 132743168. Throughput: 0: 3366.6. Samples: 8178056. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 21:05:10,243][213332] Avg episode reward: [(0, '42.236')] [2023-02-24 21:05:11,562][213367] DAMAGECOUNT value on done: 360404.0 [2023-02-24 21:05:11,563][213367] Sum rewards: 36.936, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.710', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.232', 'AMMO3': '0.244', 'weapon2': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.512', 'WEAPON3': '1.300', 'weapon3': '2.578', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '12.513', 'FRAGCOUNT': '35.500'} [2023-02-24 21:05:11,775][213367] DAMAGECOUNT value on done: 365156.0 [2023-02-24 21:05:11,775][213367] Sum rewards: 45.243, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.663', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.066', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon2': '0.260', 'weapon4': '0.614', 'WEAPON3': '1.150', 'weapon3': '2.786', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.582', 'FRAGCOUNT': '37.000'} [2023-02-24 21:05:11,876][213367] DAMAGECOUNT value on done: 362994.0 [2023-02-24 21:05:11,876][213367] Sum rewards: 36.756, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.520', 'AMMO2': '0.008', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.038', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon4': '0.356', 'weapon2': '0.610', 'WEAPON3': '1.400', 'HITCOUNT': '2.510', 'weapon3': '2.724', 'DAMAGECOUNT': '10.977', 'FRAGCOUNT': '35.000'} [2023-02-24 21:05:12,097][213367] DAMAGECOUNT value on done: 364559.0 [2023-02-24 21:05:12,097][213367] Sum rewards: 49.881, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.510', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon5': '0.176', 'AMMO3': '0.180', 'AMMO4': '0.206', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.394', 'weapon4': '0.926', 'WEAPON3': '1.050', 'weapon3': '2.150', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.110', 'FRAGCOUNT': '43.000'} [2023-02-24 21:05:12,410][213372] DAMAGECOUNT value on done: 368342.0 [2023-02-24 21:05:12,411][213372] Sum rewards: 42.057, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.040', 'AMMO5': '0.018', 'AMMO2': '0.024', 'weapon4': '0.108', 'AMMO4': '0.117', 'weapon5': '0.150', 'weapon2': '0.174', 'WEAPON4': '0.250', 'AMMO3': '0.260', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '2.700', 'weapon3': '3.284', 'DAMAGECOUNT': '13.512', 'FRAGCOUNT': '39.000'} [2023-02-24 21:05:12,627][213365] Updated weights for policy 0, policy_version 32416 (0.0009) [2023-02-24 21:05:12,715][213372] DAMAGECOUNT value on done: 359824.0 [2023-02-24 21:05:12,716][213372] Sum rewards: 39.171, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.236', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.047', 'weapon5': '0.098', 'AMMO3': '0.173', 'AMMO4': '0.236', 'weapon2': '0.398', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.724', 'WEAPON3': '1.050', 'weapon3': '2.474', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '10.470', 'FRAGCOUNT': '37.000'} [2023-02-24 21:05:12,734][213372] DAMAGECOUNT value on done: 370401.0 [2023-02-24 21:05:12,734][213372] Sum rewards: 53.505, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.272', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.144', 'AMMO4': '0.150', 'weapon4': '0.234', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.450', 'weapon3': '2.882', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.951', 'FRAGCOUNT': '50.000'} [2023-02-24 21:05:12,998][213366] DAMAGECOUNT value on done: 359431.0 [2023-02-24 21:05:12,998][213366] Sum rewards: 37.704, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.066', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.094', 'weapon2': '0.154', 'AMMO4': '0.166', 'AMMO3': '0.180', 'WEAPON5': '0.300', 'weapon4': '0.340', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.270', 'weapon3': '3.212', 'DAMAGECOUNT': '10.557', 'FRAGCOUNT': '34.000'} [2023-02-24 21:05:13,044][213372] DAMAGECOUNT value on done: 356126.0 [2023-02-24 21:05:13,045][213372] Sum rewards: 44.191, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.478', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'weapon4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.270', 'weapon2': '0.318', 'WEAPON3': '1.650', 'HITCOUNT': '2.660', 'weapon3': '3.328', 'DAMAGECOUNT': '12.246', 'FRAGCOUNT': '43.000'} [2023-02-24 21:05:13,318][213366] DAMAGECOUNT value on done: 366374.0 [2023-02-24 21:05:13,319][213366] Sum rewards: 40.244, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.000', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.188', 'AMMO3': '0.232', 'weapon2': '0.292', 'WEAPON4': '0.400', 'weapon4': '0.540', 'WEAPON3': '1.400', 'HITCOUNT': '2.550', 'weapon3': '2.850', 'DAMAGECOUNT': '11.145', 'FRAGCOUNT': '40.000'} [2023-02-24 21:05:13,328][213366] DAMAGECOUNT value on done: 374454.0 [2023-02-24 21:05:13,329][213366] Sum rewards: 50.231, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.120', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'weapon4': '0.318', 'weapon2': '0.450', 'WEAPON3': '1.000', 'HITCOUNT': '2.900', 'weapon3': '3.044', 'DAMAGECOUNT': '13.320', 'FRAGCOUNT': '41.000'} [2023-02-24 21:05:13,642][213366] DAMAGECOUNT value on done: 358528.0 [2023-02-24 21:05:13,642][213366] Sum rewards: 39.813, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.300', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.246', 'weapon2': '0.540', 'WEAPON3': '0.900', 'HITCOUNT': '2.350', 'weapon3': '2.774', 'DAMAGECOUNT': '10.110', 'FRAGCOUNT': '34.000'} [2023-02-24 21:05:13,835][213383] DAMAGECOUNT value on done: 360357.0 [2023-02-24 21:05:13,836][213383] Sum rewards: 45.732, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.746', 'AMMO5': '0.017', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.172', 'AMMO3': '0.197', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.380', 'weapon4': '0.504', 'WEAPON3': '1.250', 'weapon3': '2.622', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.942', 'FRAGCOUNT': '41.000'} [2023-02-24 21:05:13,891][213382] DAMAGECOUNT value on done: 363308.0 [2023-02-24 21:05:13,891][213382] Sum rewards: 39.231, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.950', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.132', 'AMMO4': '0.147', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.358', 'weapon2': '0.370', 'WEAPON3': '1.550', 'HITCOUNT': '2.630', 'weapon3': '2.812', 'DAMAGECOUNT': '11.850', 'FRAGCOUNT': '39.000'} [2023-02-24 21:05:13,973][213369] DAMAGECOUNT value on done: 368689.0 [2023-02-24 21:05:13,973][213369] Sum rewards: 41.316, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.268', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'AMMO4': '0.156', 'AMMO3': '0.190', 'weapon2': '0.274', 'WEAPON4': '0.300', 'weapon4': '0.646', 'WEAPON3': '1.200', 'HITCOUNT': '2.640', 'weapon3': '2.738', 'DAMAGECOUNT': '10.845', 'FRAGCOUNT': '38.000'} [2023-02-24 21:05:14,080][213368] DAMAGECOUNT value on done: 359275.0 [2023-02-24 21:05:14,081][213368] Sum rewards: 50.956, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.832', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon5': '0.176', 'AMMO3': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.302', 'weapon2': '0.318', 'WEAPON3': '1.250', 'weapon3': '2.830', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.089', 'FRAGCOUNT': '45.000'} [2023-02-24 21:05:14,137][213383] DAMAGECOUNT value on done: 362116.0 [2023-02-24 21:05:14,138][213383] Sum rewards: 43.826, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.314', 'AMMO2': '0.007', 'AMMO5': '0.013', 'AMMO4': '0.034', 'weapon5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'WEAPON5': '0.300', 'weapon4': '0.352', 'weapon2': '0.536', 'WEAPON3': '1.050', 'HITCOUNT': '2.380', 'weapon3': '2.720', 'DAMAGECOUNT': '10.329', 'FRAGCOUNT': '39.000'} [2023-02-24 21:05:14,207][213382] DAMAGECOUNT value on done: 364073.0 [2023-02-24 21:05:14,208][213382] Sum rewards: 43.094, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.040', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.096', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'weapon2': '0.192', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'weapon4': '0.284', 'WEAPON3': '1.400', 'HITCOUNT': '2.700', 'weapon3': '3.164', 'DAMAGECOUNT': '12.078', 'FRAGCOUNT': '41.000'} [2023-02-24 21:05:14,292][213369] DAMAGECOUNT value on done: 361632.0 [2023-02-24 21:05:14,292][213369] Sum rewards: 48.714, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.614', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.098', 'AMMO3': '0.189', 'AMMO4': '0.191', 'WEAPON5': '0.200', 'weapon2': '0.454', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon4': '1.102', 'weapon3': '2.052', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.012', 'FRAGCOUNT': '43.000'} [2023-02-24 21:05:14,394][213368] DAMAGECOUNT value on done: 366067.0 [2023-02-24 21:05:14,395][213368] Sum rewards: 35.769, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.495', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.010', 'AMMO3': '0.097', 'weapon5': '0.100', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.380', 'WEAPON3': '0.700', 'weapon4': '0.930', 'weapon3': '2.024', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '9.486', 'FRAGCOUNT': '30.000'} [2023-02-24 21:05:14,551][213382] DAMAGECOUNT value on done: 353923.0 [2023-02-24 21:05:14,551][213382] Sum rewards: 43.264, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.795', 'AMMO5': '0.007', 'AMMO2': '0.050', 'AMMO3': '0.162', 'weapon5': '0.166', 'WEAPON5': '0.200', 'AMMO4': '0.252', 'weapon2': '0.276', 'WEAPON4': '0.650', 'WEAPON3': '0.900', 'weapon4': '1.162', 'weapon3': '2.008', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '11.775', 'FRAGCOUNT': '40.500'} [2023-02-24 21:05:14,603][213369] DAMAGECOUNT value on done: 365971.0 [2023-02-24 21:05:14,604][213369] Sum rewards: 42.768, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.400', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.195', 'weapon4': '0.260', 'weapon2': '0.556', 'WEAPON3': '1.150', 'HITCOUNT': '2.750', 'weapon3': '3.020', 'DAMAGECOUNT': '11.364', 'FRAGCOUNT': '35.000'} [2023-02-24 21:05:14,664][213368] DAMAGECOUNT value on done: 361702.0 [2023-02-24 21:05:14,665][213368] Sum rewards: 42.380, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.535', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon4': '0.016', 'weapon5': '0.016', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon2': '0.148', 'AMMO3': '0.238', 'WEAPON3': '1.450', 'HITCOUNT': '2.610', 'weapon3': '3.606', 'DAMAGECOUNT': '12.645', 'FRAGCOUNT': '38.000'} [2023-02-24 21:05:14,763][213383] DAMAGECOUNT value on done: 364059.0 [2023-02-24 21:05:14,764][213383] Sum rewards: 39.143, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.383', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.141', 'weapon5': '0.184', 'weapon2': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.574', 'WEAPON3': '0.800', 'HITCOUNT': '2.400', 'weapon3': '2.792', 'DAMAGECOUNT': '10.680', 'FRAGCOUNT': '33.000'} [2023-02-24 21:05:14,857][213382] DAMAGECOUNT value on done: 362010.0 [2023-02-24 21:05:14,857][213382] Sum rewards: 43.420, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.700', 'AMMO5': '0.003', 'weapon5': '0.020', 'AMMO2': '0.043', 'WEAPON5': '0.050', 'AMMO3': '0.189', 'AMMO4': '0.214', 'WEAPON4': '0.400', 'weapon2': '0.420', 'weapon4': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.592', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '12.159', 'FRAGCOUNT': '40.000'} [2023-02-24 21:05:14,893][213384] DAMAGECOUNT value on done: 369465.0 [2023-02-24 21:05:14,894][213384] Sum rewards: 41.416, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.268', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.075', 'AMMO3': '0.139', 'weapon5': '0.240', 'WEAPON5': '0.300', 'AMMO4': '0.375', 'weapon2': '0.402', 'WEAPON4': '0.850', 'WEAPON3': '0.850', 'weapon4': '1.202', 'weapon3': '1.642', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '12.204', 'FRAGCOUNT': '38.000'} [2023-02-24 21:05:14,917][213369] DAMAGECOUNT value on done: 351439.0 [2023-02-24 21:05:14,917][213369] Sum rewards: 43.251, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.457', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.134', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.346', 'weapon2': '0.446', 'WEAPON3': '1.150', 'HITCOUNT': '2.690', 'weapon3': '2.788', 'DAMAGECOUNT': '11.787', 'FRAGCOUNT': '38.000'} [2023-02-24 21:05:14,980][213368] DAMAGECOUNT value on done: 357400.0 [2023-02-24 21:05:14,981][213368] Sum rewards: 43.365, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.512', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.128', 'AMMO4': '0.128', 'weapon4': '0.196', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.514', 'WEAPON3': '1.350', 'HITCOUNT': '2.690', 'weapon3': '2.836', 'DAMAGECOUNT': '12.687', 'FRAGCOUNT': '39.000'} [2023-02-24 21:05:15,077][213383] DAMAGECOUNT value on done: 357794.0 [2023-02-24 21:05:15,077][213383] Sum rewards: 40.150, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.422', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.112', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.428', 'weapon2': '0.536', 'WEAPON3': '1.200', 'weapon3': '2.634', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '11.163', 'FRAGCOUNT': '35.000'} [2023-02-24 21:05:15,200][213384] DAMAGECOUNT value on done: 353927.0 [2023-02-24 21:05:15,200][213384] Sum rewards: 38.305, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-4.520', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.064', 'weapon4': '0.112', 'AMMO4': '0.214', 'WEAPON5': '0.250', 'AMMO3': '0.314', 'WEAPON4': '0.350', 'weapon2': '0.450', 'WEAPON3': '1.850', 'HITCOUNT': '2.560', 'weapon3': '3.086', 'DAMAGECOUNT': '12.021', 'FRAGCOUNT': '41.000'} [2023-02-24 21:05:15,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 132808704. Throughput: 0: 3363.7. Samples: 8198184. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:05:15,243][213332] Avg episode reward: [(0, '43.042')] [2023-02-24 21:05:15,486][213384] DAMAGECOUNT value on done: 366946.0 [2023-02-24 21:05:15,486][213384] Sum rewards: 38.458, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.710', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.039', 'AMMO3': '0.157', 'weapon5': '0.184', 'AMMO4': '0.196', 'WEAPON5': '0.300', 'weapon4': '0.322', 'WEAPON4': '0.350', 'weapon2': '0.814', 'WEAPON3': '1.000', 'HITCOUNT': '2.060', 'weapon3': '2.380', 'DAMAGECOUNT': '9.087', 'FRAGCOUNT': '33.000'} [2023-02-24 21:05:15,715][213365] Updated weights for policy 0, policy_version 32426 (0.0009) [2023-02-24 21:05:15,786][213384] DAMAGECOUNT value on done: 370851.0 [2023-02-24 21:05:15,787][213384] Sum rewards: 45.367, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.284', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.108', 'weapon4': '0.202', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'WEAPON5': '0.350', 'weapon2': '0.502', 'WEAPON3': '1.550', 'weapon3': '2.922', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '12.873', 'FRAGCOUNT': '43.000'} [2023-02-24 21:05:18,748][213365] Updated weights for policy 0, policy_version 32436 (0.0009) [2023-02-24 21:05:20,243][213332] Fps is (10 sec: 13107.3, 60 sec: 13448.6, 300 sec: 13468.2). Total num frames: 132874240. Throughput: 0: 3365.0. Samples: 8208422. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:05:20,243][213332] Avg episode reward: [(0, '43.011')] [2023-02-24 21:05:21,761][213365] Updated weights for policy 0, policy_version 32446 (0.0009) [2023-02-24 21:05:24,845][213365] Updated weights for policy 0, policy_version 32456 (0.0009) [2023-02-24 21:05:25,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 132943872. Throughput: 0: 3365.5. Samples: 8228612. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:05:25,243][213332] Avg episode reward: [(0, '43.011')] [2023-02-24 21:05:27,856][213365] Updated weights for policy 0, policy_version 32466 (0.0009) [2023-02-24 21:05:30,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.6, 300 sec: 13468.2). Total num frames: 133009408. Throughput: 0: 3368.1. Samples: 8248898. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:05:30,243][213332] Avg episode reward: [(0, '43.011')] [2023-02-24 21:05:30,872][213365] Updated weights for policy 0, policy_version 32476 (0.0009) [2023-02-24 21:05:31,373][213367] DAMAGECOUNT value on done: 364983.0 [2023-02-24 21:05:31,374][213367] Sum rewards: 49.848, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.340', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.058', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'AMMO3': '0.256', 'weapon4': '0.262', 'weapon2': '0.334', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '2.850', 'weapon3': '3.066', 'DAMAGECOUNT': '13.737', 'FRAGCOUNT': '49.000'} [2023-02-24 21:05:31,668][213367] DAMAGECOUNT value on done: 369738.0 [2023-02-24 21:05:31,668][213367] Sum rewards: 48.788, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.865', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.104', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'WEAPON4': '0.300', 'weapon2': '0.396', 'weapon4': '0.434', 'WEAPON3': '1.200', 'weapon3': '2.836', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.641', 'FRAGCOUNT': '42.000'} [2023-02-24 21:05:31,687][213367] DAMAGECOUNT value on done: 367405.0 [2023-02-24 21:05:31,687][213367] Sum rewards: 46.299, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.592', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.026', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'AMMO3': '0.199', 'WEAPON4': '0.350', 'weapon2': '0.508', 'weapon4': '0.614', 'WEAPON3': '1.250', 'weapon3': '2.604', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.233', 'FRAGCOUNT': '42.000'} [2023-02-24 21:05:31,979][213367] DAMAGECOUNT value on done: 368398.0 [2023-02-24 21:05:31,979][213367] Sum rewards: 40.293, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.568', 'ARMOR': '0.009', 'AMMO5': '0.013', 'AMMO2': '0.013', 'weapon5': '0.044', 'AMMO4': '0.063', 'WEAPON4': '0.200', 'weapon4': '0.238', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'weapon2': '0.404', 'WEAPON3': '1.500', 'HITCOUNT': '2.540', 'weapon3': '3.074', 'DAMAGECOUNT': '11.517', 'FRAGCOUNT': '37.000'} [2023-02-24 21:05:32,305][213372] DAMAGECOUNT value on done: 372276.0 [2023-02-24 21:05:32,305][213372] Sum rewards: 31.452, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.546', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.035', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'weapon4': '0.268', 'AMMO3': '0.277', 'weapon2': '0.326', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'HITCOUNT': '2.860', 'weapon3': '3.004', 'DAMAGECOUNT': '11.802', 'FRAGCOUNT': '32.500'} [2023-02-24 21:05:32,606][213372] DAMAGECOUNT value on done: 363188.0 [2023-02-24 21:05:32,606][213372] Sum rewards: 36.561, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.224', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.011', 'WEAPON4': '0.050', 'weapon4': '0.078', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon2': '0.422', 'WEAPON3': '1.300', 'HITCOUNT': '2.230', 'weapon3': '3.148', 'DAMAGECOUNT': '10.092', 'FRAGCOUNT': '33.000'} [2023-02-24 21:05:32,625][213372] DAMAGECOUNT value on done: 373416.0 [2023-02-24 21:05:32,625][213372] Sum rewards: 35.568, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.025', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon7': '0.060', 'AMMO4': '0.071', 'weapon5': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.151', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.434', 'weapon4': '0.838', 'WEAPON3': '0.900', 'HITCOUNT': '1.900', 'weapon3': '2.102', 'DAMAGECOUNT': '9.045', 'FRAGCOUNT': '32.000'} [2023-02-24 21:05:32,933][213372] DAMAGECOUNT value on done: 360887.0 [2023-02-24 21:05:32,934][213372] Sum rewards: 52.993, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.148', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon5': '0.118', 'AMMO4': '0.124', 'weapon2': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.290', 'WEAPON5': '0.300', 'weapon4': '0.310', 'WEAPON3': '1.750', 'HITCOUNT': '2.930', 'weapon3': '3.140', 'DAMAGECOUNT': '14.283', 'FRAGCOUNT': '49.000'} [2023-02-24 21:05:32,941][213366] DAMAGECOUNT value on done: 363119.0 [2023-02-24 21:05:32,942][213366] Sum rewards: 49.184, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.550', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.106', 'AMMO3': '0.131', 'weapon4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.750', 'weapon2': '1.074', 'HITCOUNT': '2.160', 'weapon3': '2.478', 'DAMAGECOUNT': '11.064', 'FRAGCOUNT': '41.000'} [2023-02-24 21:05:33,272][213366] DAMAGECOUNT value on done: 379164.0 [2023-02-24 21:05:33,273][213366] Sum rewards: 52.768, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.520', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.100', 'AMMO3': '0.155', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'weapon2': '0.308', 'WEAPON4': '0.450', 'weapon4': '0.576', 'WEAPON3': '0.950', 'weapon3': '2.788', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.130', 'FRAGCOUNT': '44.000'} [2023-02-24 21:05:33,286][213366] DAMAGECOUNT value on done: 369920.0 [2023-02-24 21:05:33,287][213366] Sum rewards: 42.889, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.282', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.110', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'weapon4': '0.200', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'weapon2': '0.506', 'WEAPON3': '1.300', 'HITCOUNT': '2.620', 'weapon3': '2.914', 'DAMAGECOUNT': '10.638', 'FRAGCOUNT': '41.000'} [2023-02-24 21:05:33,598][213366] DAMAGECOUNT value on done: 363211.0 [2023-02-24 21:05:33,598][213366] Sum rewards: 52.183, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.455', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.118', 'AMMO4': '0.168', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON4': '0.450', 'weapon4': '0.856', 'WEAPON3': '1.300', 'weapon3': '2.198', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.049', 'FRAGCOUNT': '48.000'} [2023-02-24 21:05:33,645][213383] DAMAGECOUNT value on done: 364126.0 [2023-02-24 21:05:33,645][213383] Sum rewards: 29.758, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-2.950', 'ARMOR': '0.004', 'AMMO5': '0.015', 'weapon7': '0.058', 'AMMO2': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.152', 'AMMO3': '0.251', 'AMMO4': '0.321', 'weapon2': '0.362', 'WEAPON5': '0.400', 'weapon4': '0.610', 'WEAPON4': '0.700', 'WEAPON3': '1.400', 'weapon3': '2.354', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '11.307', 'FRAGCOUNT': '33.000'} [2023-02-24 21:05:33,768][213382] DAMAGECOUNT value on done: 366454.0 [2023-02-24 21:05:33,769][213382] Sum rewards: 31.163, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.323', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon7': '0.048', 'AMMO3': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.179', 'WEAPON7': '0.200', 'weapon5': '0.290', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.570', 'weapon2': '0.614', 'WEAPON3': '0.700', 'weapon3': '2.068', 'HITCOUNT': '2.070', 'DAMAGECOUNT': '9.438', 'FRAGCOUNT': '28.500'} [2023-02-24 21:05:33,904][213369] DAMAGECOUNT value on done: 372367.0 [2023-02-24 21:05:33,905][213369] Sum rewards: 38.577, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.487', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.168', 'weapon5': '0.182', 'WEAPON4': '0.250', 'AMMO3': '0.271', 'WEAPON5': '0.350', 'weapon4': '0.376', 'weapon2': '0.480', 'WEAPON3': '1.550', 'HITCOUNT': '2.390', 'weapon3': '2.712', 'DAMAGECOUNT': '11.034', 'FRAGCOUNT': '38.000'} [2023-02-24 21:05:33,948][213365] Updated weights for policy 0, policy_version 32486 (0.0009) [2023-02-24 21:05:33,963][213383] DAMAGECOUNT value on done: 366719.0 [2023-02-24 21:05:33,964][213383] Sum rewards: 50.787, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.209', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.112', 'AMMO3': '0.184', 'weapon2': '0.188', 'AMMO4': '0.214', 'weapon4': '0.218', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.520', 'weapon3': '3.198', 'DAMAGECOUNT': '13.809', 'FRAGCOUNT': '44.000'} [2023-02-24 21:05:33,995][213368] DAMAGECOUNT value on done: 363555.0 [2023-02-24 21:05:33,996][213368] Sum rewards: 49.287, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.438', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.006', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.074', 'AMMO3': '0.216', 'weapon2': '0.676', 'WEAPON3': '1.400', 'HITCOUNT': '2.840', 'weapon3': '3.042', 'DAMAGECOUNT': '12.840', 'FRAGCOUNT': '44.000'} [2023-02-24 21:05:34,087][213382] DAMAGECOUNT value on done: 368624.0 [2023-02-24 21:05:34,087][213382] Sum rewards: 55.543, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.060', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'weapon4': '0.226', 'weapon2': '0.356', 'WEAPON3': '1.100', 'HITCOUNT': '2.700', 'weapon3': '3.108', 'DAMAGECOUNT': '13.653', 'FRAGCOUNT': '47.000'} [2023-02-24 21:05:34,229][213369] DAMAGECOUNT value on done: 365755.0 [2023-02-24 21:05:34,229][213369] Sum rewards: 44.710, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.070', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.040', 'AMMO4': '0.042', 'weapon5': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.150', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'weapon2': '0.458', 'WEAPON3': '1.350', 'HITCOUNT': '2.630', 'weapon3': '2.966', 'DAMAGECOUNT': '12.369', 'FRAGCOUNT': '41.000'} [2023-02-24 21:05:34,314][213368] DAMAGECOUNT value on done: 370542.0 [2023-02-24 21:05:34,315][213368] Sum rewards: 53.108, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.170', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.019', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'weapon4': '0.394', 'weapon2': '0.686', 'WEAPON3': '1.150', 'weapon3': '2.710', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.425', 'FRAGCOUNT': '46.000'} [2023-02-24 21:05:34,474][213382] DAMAGECOUNT value on done: 357828.0 [2023-02-24 21:05:34,474][213382] Sum rewards: 42.963, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.364', 'AMMO5': '0.018', 'AMMO2': '0.046', 'weapon5': '0.126', 'AMMO3': '0.194', 'AMMO4': '0.231', 'weapon2': '0.308', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.582', 'WEAPON3': '1.150', 'HITCOUNT': '2.530', 'weapon3': '2.726', 'DAMAGECOUNT': '11.715', 'FRAGCOUNT': '40.500'} [2023-02-24 21:05:34,541][213369] DAMAGECOUNT value on done: 369452.0 [2023-02-24 21:05:34,542][213369] Sum rewards: 31.771, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.918', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.052', 'AMMO4': '0.262', 'weapon5': '0.266', 'AMMO3': '0.280', 'weapon2': '0.292', 'WEAPON5': '0.600', 'weapon4': '0.620', 'WEAPON4': '0.700', 'WEAPON3': '1.550', 'HITCOUNT': '2.260', 'weapon3': '2.334', 'DAMAGECOUNT': '10.443', 'FRAGCOUNT': '34.000'} [2023-02-24 21:05:34,573][213368] DAMAGECOUNT value on done: 365258.0 [2023-02-24 21:05:34,574][213368] Sum rewards: 35.925, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.553', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.231', 'weapon2': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.908', 'WEAPON3': '1.300', 'weapon3': '2.464', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '10.668', 'FRAGCOUNT': '34.000'} [2023-02-24 21:05:34,579][213383] DAMAGECOUNT value on done: 367405.0 [2023-02-24 21:05:34,580][213383] Sum rewards: 39.092, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.372', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.056', 'AMMO4': '0.074', 'weapon4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.348', 'WEAPON3': '1.100', 'HITCOUNT': '2.520', 'weapon3': '3.204', 'DAMAGECOUNT': '10.038', 'FRAGCOUNT': '35.000'} [2023-02-24 21:05:34,796][213382] DAMAGECOUNT value on done: 366442.0 [2023-02-24 21:05:34,797][213382] Sum rewards: 50.055, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.980', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.010', 'AMMO4': '0.043', 'weapon7': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon2': '0.198', 'WEAPON7': '0.200', 'AMMO3': '0.232', 'weapon4': '0.292', 'WEAPON3': '1.450', 'HITCOUNT': '3.050', 'weapon3': '3.226', 'DAMAGECOUNT': '13.296', 'FRAGCOUNT': '44.000'} [2023-02-24 21:05:34,834][213384] DAMAGECOUNT value on done: 373187.0 [2023-02-24 21:05:34,834][213384] Sum rewards: 39.647, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.908', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.070', 'AMMO3': '0.178', 'AMMO4': '0.214', 'WEAPON5': '0.300', 'weapon2': '0.578', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'weapon4': '1.096', 'weapon3': '2.010', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '11.166', 'FRAGCOUNT': '38.000'} [2023-02-24 21:05:34,850][213369] DAMAGECOUNT value on done: 355732.0 [2023-02-24 21:05:34,850][213369] Sum rewards: 43.191, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.650', 'AMMO5': '0.021', 'AMMO2': '0.036', 'AMMO4': '0.179', 'weapon2': '0.186', 'AMMO3': '0.226', 'weapon5': '0.296', 'WEAPON4': '0.350', 'weapon4': '0.496', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.472', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '12.879', 'FRAGCOUNT': '40.000'} [2023-02-24 21:05:34,881][213368] DAMAGECOUNT value on done: 361065.0 [2023-02-24 21:05:34,882][213368] Sum rewards: 36.130, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.496', 'AMMO5': '0.017', 'AMMO2': '0.061', 'weapon5': '0.096', 'AMMO3': '0.194', 'AMMO4': '0.306', 'WEAPON5': '0.350', 'weapon2': '0.422', 'WEAPON4': '0.650', 'weapon4': '0.672', 'WEAPON3': '1.200', 'weapon3': '2.482', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '10.995', 'FRAGCOUNT': '35.000'} [2023-02-24 21:05:34,885][213383] DAMAGECOUNT value on done: 360982.0 [2023-02-24 21:05:34,886][213383] Sum rewards: 36.456, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.982', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.020', 'weapon5': '0.046', 'AMMO3': '0.145', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.478', 'weapon2': '0.714', 'WEAPON3': '0.850', 'HITCOUNT': '2.190', 'weapon3': '2.522', 'DAMAGECOUNT': '9.564', 'FRAGCOUNT': '31.000'} [2023-02-24 21:05:35,136][213384] DAMAGECOUNT value on done: 357959.0 [2023-02-24 21:05:35,136][213384] Sum rewards: 42.701, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.098', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.042', 'AMMO3': '0.179', 'AMMO4': '0.208', 'weapon2': '0.222', 'weapon5': '0.270', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.000', 'weapon4': '1.084', 'weapon3': '2.014', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '12.096', 'FRAGCOUNT': '39.000'} [2023-02-24 21:05:35,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 133079040. Throughput: 0: 3370.1. Samples: 8259142. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:05:35,243][213332] Avg episode reward: [(0, '43.459')] [2023-02-24 21:05:35,247][213352] Saving new best policy, reward=43.459! [2023-02-24 21:05:35,431][213384] DAMAGECOUNT value on done: 371247.0 [2023-02-24 21:05:35,431][213384] Sum rewards: 47.172, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-3.092', 'AMMO2': '0.009', 'AMMO5': '0.013', 'AMMO4': '0.047', 'AMMO3': '0.148', 'weapon5': '0.222', 'WEAPON4': '0.300', 'weapon4': '0.348', 'WEAPON5': '0.400', 'weapon2': '0.802', 'WEAPON3': '1.050', 'weapon3': '2.372', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '12.903', 'FRAGCOUNT': '38.000'} [2023-02-24 21:05:35,747][213384] DAMAGECOUNT value on done: 374706.0 [2023-02-24 21:05:35,748][213384] Sum rewards: 41.470, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.812', 'ARMOR': '0.004', 'AMMO2': '0.014', 'AMMO5': '0.020', 'AMMO4': '0.068', 'weapon5': '0.088', 'WEAPON4': '0.150', 'AMMO3': '0.237', 'WEAPON5': '0.300', 'weapon4': '0.304', 'weapon2': '0.464', 'WEAPON3': '1.550', 'HITCOUNT': '2.620', 'weapon3': '2.898', 'DAMAGECOUNT': '11.565', 'FRAGCOUNT': '39.000'} [2023-02-24 21:05:36,952][213365] Updated weights for policy 0, policy_version 32496 (0.0009) [2023-02-24 21:05:40,011][213365] Updated weights for policy 0, policy_version 32506 (0.0009) [2023-02-24 21:05:40,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 133144576. Throughput: 0: 3373.5. Samples: 8279338. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:05:40,243][213332] Avg episode reward: [(0, '43.406')] [2023-02-24 21:05:41,082][213369] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 21:05:43,006][213365] Updated weights for policy 0, policy_version 32516 (0.0009) [2023-02-24 21:05:45,047][213367] Large shaping reward 2.542 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.51, 170.0), ('weapon5', 0.002)] [2023-02-24 21:05:45,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 133214208. Throughput: 0: 3375.0. Samples: 8299532. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:05:45,244][213332] Avg episode reward: [(0, '43.406')] [2023-02-24 21:05:46,023][213365] Updated weights for policy 0, policy_version 32526 (0.0009) [2023-02-24 21:05:46,070][213382] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 21:05:49,089][213365] Updated weights for policy 0, policy_version 32536 (0.0009) [2023-02-24 21:05:50,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 133279744. Throughput: 0: 3374.5. Samples: 8309774. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:05:50,243][213332] Avg episode reward: [(0, '43.406')] [2023-02-24 21:05:51,332][213367] DAMAGECOUNT value on done: 368487.0 [2023-02-24 21:05:51,333][213367] Sum rewards: 42.511, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.427', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.128', 'AMMO4': '0.176', 'weapon5': '0.232', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.534', 'weapon4': '0.598', 'WEAPON3': '0.700', 'weapon3': '2.242', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '10.512', 'FRAGCOUNT': '34.500'} [2023-02-24 21:05:51,632][213367] DAMAGECOUNT value on done: 373959.0 [2023-02-24 21:05:51,632][213367] Sum rewards: 50.874, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.640', 'AMMO5': '0.017', 'AMMO2': '0.021', 'AMMO4': '0.102', 'weapon5': '0.152', 'AMMO3': '0.167', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.388', 'weapon4': '0.662', 'WEAPON3': '1.000', 'weapon3': '2.492', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.663', 'FRAGCOUNT': '43.000'} [2023-02-24 21:05:51,642][213367] DAMAGECOUNT value on done: 371519.0 [2023-02-24 21:05:51,643][213367] Sum rewards: 39.911, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.486', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.102', 'weapon2': '0.200', 'AMMO3': '0.207', 'AMMO4': '0.211', 'WEAPON5': '0.300', 'weapon4': '0.510', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'HITCOUNT': '2.640', 'weapon3': '2.876', 'DAMAGECOUNT': '12.342', 'FRAGCOUNT': '37.000'} [2023-02-24 21:05:51,939][213367] DAMAGECOUNT value on done: 372434.0 [2023-02-24 21:05:51,939][213367] Sum rewards: 48.695, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.342', 'AMMO5': '0.006', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.110', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.362', 'weapon4': '0.428', 'WEAPON3': '1.000', 'HITCOUNT': '2.750', 'weapon3': '2.898', 'DAMAGECOUNT': '12.102', 'FRAGCOUNT': '41.000'} [2023-02-24 21:05:52,102][213365] Updated weights for policy 0, policy_version 32546 (0.0009) [2023-02-24 21:05:52,281][213372] DAMAGECOUNT value on done: 376909.0 [2023-02-24 21:05:52,281][213372] Sum rewards: 45.305, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.087', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.102', 'weapon5': '0.154', 'weapon2': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.306', 'weapon4': '0.456', 'WEAPON3': '1.850', 'HITCOUNT': '2.710', 'weapon3': '2.796', 'DAMAGECOUNT': '13.899', 'FRAGCOUNT': '45.000'} [2023-02-24 21:05:52,601][213372] DAMAGECOUNT value on done: 377786.0 [2023-02-24 21:05:52,601][213372] Sum rewards: 53.763, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.367', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'weapon4': '0.538', 'weapon2': '0.572', 'WEAPON3': '1.000', 'weapon3': '2.736', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.110', 'FRAGCOUNT': '45.000'} [2023-02-24 21:05:52,613][213372] DAMAGECOUNT value on done: 367007.0 [2023-02-24 21:05:52,614][213372] Sum rewards: 44.033, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.060', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.100', 'weapon2': '0.120', 'AMMO4': '0.127', 'AMMO3': '0.160', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.494', 'WEAPON3': '1.050', 'HITCOUNT': '2.840', 'weapon3': '3.010', 'DAMAGECOUNT': '11.457', 'FRAGCOUNT': '39.000'} [2023-02-24 21:05:52,889][213366] DAMAGECOUNT value on done: 366563.0 [2023-02-24 21:05:52,889][213366] Sum rewards: 47.963, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.620', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.056', 'AMMO3': '0.145', 'AMMO4': '0.159', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.328', 'weapon4': '0.590', 'WEAPON3': '0.850', 'HITCOUNT': '2.370', 'weapon3': '2.812', 'DAMAGECOUNT': '10.332', 'FRAGCOUNT': '41.000'} [2023-02-24 21:05:52,930][213372] DAMAGECOUNT value on done: 365173.0 [2023-02-24 21:05:52,931][213372] Sum rewards: 46.386, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.170', 'AMMO2': '0.009', 'AMMO5': '0.012', 'weapon4': '0.016', 'AMMO4': '0.046', 'weapon5': '0.084', 'WEAPON4': '0.100', 'weapon2': '0.204', 'AMMO3': '0.258', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '2.810', 'weapon3': '3.458', 'DAMAGECOUNT': '12.858', 'FRAGCOUNT': '43.000'} [2023-02-24 21:05:53,206][213366] DAMAGECOUNT value on done: 383114.0 [2023-02-24 21:05:53,206][213366] Sum rewards: 43.660, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.790', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.047', 'weapon5': '0.072', 'AMMO3': '0.191', 'AMMO4': '0.234', 'weapon2': '0.316', 'weapon4': '0.330', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.620', 'weapon3': '2.966', 'DAMAGECOUNT': '11.850', 'FRAGCOUNT': '40.000'} [2023-02-24 21:05:53,219][213366] DAMAGECOUNT value on done: 374130.0 [2023-02-24 21:05:53,219][213366] Sum rewards: 49.215, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.662', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon5': '0.052', 'AMMO4': '0.083', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon4': '0.358', 'weapon2': '0.822', 'WEAPON3': '1.050', 'weapon3': '2.520', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '12.630', 'FRAGCOUNT': '41.000'} [2023-02-24 21:05:53,538][213383] DAMAGECOUNT value on done: 368460.0 [2023-02-24 21:05:53,538][213383] Sum rewards: 47.005, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.721', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.096', 'weapon5': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'weapon4': '0.200', 'weapon2': '0.322', 'WEAPON3': '1.100', 'HITCOUNT': '2.910', 'weapon3': '3.134', 'DAMAGECOUNT': '13.002', 'FRAGCOUNT': '39.000'} [2023-02-24 21:05:53,539][213366] DAMAGECOUNT value on done: 367198.0 [2023-02-24 21:05:53,540][213366] Sum rewards: 42.009, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.520', 'AMMO5': '0.017', 'AMMO2': '0.058', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.104', 'weapon5': '0.132', 'AMMO4': '0.290', 'weapon2': '0.322', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'weapon4': '1.000', 'weapon3': '2.102', 'HITCOUNT': '2.350', 'DAMAGECOUNT': '11.526', 'FRAGCOUNT': '33.000'} [2023-02-24 21:05:53,744][213382] DAMAGECOUNT value on done: 371830.0 [2023-02-24 21:05:53,745][213382] Sum rewards: 66.463, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.048', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.166', 'weapon2': '0.198', 'AMMO3': '0.206', 'WEAPON3': '1.150', 'HITCOUNT': '3.130', 'weapon3': '3.294', 'DAMAGECOUNT': '16.128', 'FRAGCOUNT': '56.000'} [2023-02-24 21:05:53,816][213369] DAMAGECOUNT value on done: 375540.0 [2023-02-24 21:05:53,817][213369] Sum rewards: 30.865, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.948', 'ARMOR': '0.004', 'AMMO5': '0.027', 'AMMO2': '0.071', 'weapon5': '0.150', 'AMMO3': '0.172', 'AMMO4': '0.355', 'weapon4': '0.514', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '0.900', 'weapon2': '0.928', 'weapon3': '2.062', 'HITCOUNT': '2.160', 'DAMAGECOUNT': '9.519', 'FRAGCOUNT': '31.000'} [2023-02-24 21:05:53,843][213383] DAMAGECOUNT value on done: 369779.0 [2023-02-24 21:05:53,843][213383] Sum rewards: 32.084, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.608', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.014', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.222', 'weapon2': '0.290', 'weapon4': '0.336', 'WEAPON3': '1.300', 'HITCOUNT': '2.100', 'weapon3': '3.166', 'DAMAGECOUNT': '9.180', 'FRAGCOUNT': '31.000'} [2023-02-24 21:05:53,922][213368] DAMAGECOUNT value on done: 367827.0 [2023-02-24 21:05:53,922][213368] Sum rewards: 43.737, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.030', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon5': '0.062', 'AMMO3': '0.138', 'AMMO4': '0.236', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON4': '0.550', 'weapon4': '0.746', 'WEAPON3': '0.750', 'weapon3': '2.654', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.816', 'FRAGCOUNT': '36.500'} [2023-02-24 21:05:54,062][213382] DAMAGECOUNT value on done: 372634.0 [2023-02-24 21:05:54,063][213382] Sum rewards: 46.301, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.470', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon4': '0.226', 'weapon2': '0.530', 'WEAPON3': '1.100', 'HITCOUNT': '2.660', 'weapon3': '3.024', 'DAMAGECOUNT': '12.030', 'FRAGCOUNT': '40.000'} [2023-02-24 21:05:54,131][213369] DAMAGECOUNT value on done: 369363.0 [2023-02-24 21:05:54,132][213369] Sum rewards: 41.715, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.640', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO4': '0.116', 'AMMO3': '0.130', 'WEAPON4': '0.350', 'weapon2': '0.654', 'weapon4': '0.828', 'WEAPON3': '0.850', 'weapon3': '2.012', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '10.824', 'FRAGCOUNT': '36.000'} [2023-02-24 21:05:54,237][213368] DAMAGECOUNT value on done: 375221.0 [2023-02-24 21:05:54,237][213368] Sum rewards: 54.363, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.770', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.012', 'weapon5': '0.044', 'AMMO4': '0.058', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.203', 'weapon2': '0.264', 'weapon4': '0.272', 'WEAPON3': '1.350', 'HITCOUNT': '2.960', 'weapon3': '3.176', 'DAMAGECOUNT': '14.037', 'FRAGCOUNT': '48.000'} [2023-02-24 21:05:54,449][213369] DAMAGECOUNT value on done: 372763.0 [2023-02-24 21:05:54,450][213369] Sum rewards: 30.369, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.946', 'AMMO5': '0.010', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.053', 'weapon5': '0.076', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'AMMO4': '0.267', 'WEAPON4': '0.650', 'weapon2': '0.666', 'weapon4': '0.780', 'WEAPON3': '1.200', 'weapon3': '2.094', 'HITCOUNT': '2.370', 'DAMAGECOUNT': '9.909', 'FRAGCOUNT': '30.000'} [2023-02-24 21:05:54,473][213383] DAMAGECOUNT value on done: 371184.0 [2023-02-24 21:05:54,474][213383] Sum rewards: 37.410, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.504', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.061', 'weapon5': '0.140', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'weapon2': '0.250', 'AMMO4': '0.306', 'WEAPON4': '0.550', 'weapon4': '0.742', 'WEAPON3': '1.400', 'weapon3': '2.560', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '11.337', 'FRAGCOUNT': '37.000'} [2023-02-24 21:05:54,482][213382] DAMAGECOUNT value on done: 361661.0 [2023-02-24 21:05:54,482][213382] Sum rewards: 38.609, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.351', 'AMMO2': '0.014', 'AMMO5': '0.016', 'AMMO4': '0.069', 'weapon5': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'weapon4': '0.348', 'WEAPON5': '0.350', 'weapon2': '0.734', 'WEAPON3': '1.250', 'weapon3': '2.580', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '11.499', 'FRAGCOUNT': '33.000'} [2023-02-24 21:05:54,496][213368] DAMAGECOUNT value on done: 368998.0 [2023-02-24 21:05:54,497][213368] Sum rewards: 45.448, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.156', 'ARMOR': '0.004', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'weapon2': '0.338', 'weapon4': '0.988', 'WEAPON3': '1.100', 'weapon3': '2.286', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '11.220', 'FRAGCOUNT': '39.000'} [2023-02-24 21:05:54,698][213384] DAMAGECOUNT value on done: 376965.0 [2023-02-24 21:05:54,699][213384] Sum rewards: 37.766, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.208', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.035', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.172', 'AMMO3': '0.181', 'WEAPON4': '0.350', 'weapon2': '0.490', 'weapon4': '0.546', 'WEAPON3': '1.050', 'HITCOUNT': '2.540', 'weapon3': '2.680', 'DAMAGECOUNT': '11.334', 'FRAGCOUNT': '36.000'} [2023-02-24 21:05:54,767][213369] DAMAGECOUNT value on done: 359392.0 [2023-02-24 21:05:54,767][213369] Sum rewards: 45.374, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.580', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'weapon4': '0.144', 'AMMO3': '0.232', 'weapon2': '0.518', 'WEAPON3': '1.400', 'HITCOUNT': '2.570', 'weapon3': '3.122', 'DAMAGECOUNT': '10.980', 'FRAGCOUNT': '42.000'} [2023-02-24 21:05:54,789][213383] DAMAGECOUNT value on done: 364527.0 [2023-02-24 21:05:54,790][213383] Sum rewards: 39.807, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.288', 'AMMO5': '0.007', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon4': '0.274', 'weapon2': '0.380', 'WEAPON3': '1.200', 'HITCOUNT': '2.550', 'weapon3': '3.092', 'DAMAGECOUNT': '10.635', 'FRAGCOUNT': '38.000'} [2023-02-24 21:05:54,795][213382] DAMAGECOUNT value on done: 370992.0 [2023-02-24 21:05:54,796][213382] Sum rewards: 51.952, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.980', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.026', 'weapon5': '0.070', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.272', 'weapon2': '0.318', 'WEAPON3': '1.550', 'HITCOUNT': '3.200', 'weapon3': '3.296', 'DAMAGECOUNT': '13.650', 'FRAGCOUNT': '47.000'} [2023-02-24 21:05:54,799][213368] DAMAGECOUNT value on done: 364568.0 [2023-02-24 21:05:54,800][213368] Sum rewards: 41.799, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.965', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'weapon4': '0.318', 'ARMOR': '0.450', 'WEAPON3': '0.950', 'weapon2': '1.188', 'weapon3': '2.106', 'HITCOUNT': '2.320', 'DAMAGECOUNT': '10.374', 'FRAGCOUNT': '36.000'} [2023-02-24 21:05:55,003][213384] DAMAGECOUNT value on done: 358064.0 [2023-02-24 21:05:55,003][213384] Sum rewards: 2.328, reward structure: {'DEATHCOUNT': '-0.750', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'AMMO3': '0.020', 'HITCOUNT': '0.060', 'HEALTH': '0.080', 'WEAPON3': '0.150', 'weapon3': '0.304', 'DAMAGECOUNT': '0.315', 'weapon2': '0.574', 'ARMOR': '0.600', 'FRAGCOUNT': '1.000'} [2023-02-24 21:05:55,208][213365] Updated weights for policy 0, policy_version 32556 (0.0010) [2023-02-24 21:05:55,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13482.1). Total num frames: 133349376. Throughput: 0: 3373.9. Samples: 8329880. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:05:55,243][213332] Avg episode reward: [(0, '42.816')] [2023-02-24 21:05:55,331][213384] DAMAGECOUNT value on done: 374709.0 [2023-02-24 21:05:55,332][213384] Sum rewards: 38.072, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.175', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'AMMO3': '0.164', 'WEAPON4': '0.250', 'weapon2': '0.486', 'weapon4': '0.492', 'WEAPON3': '1.050', 'HITCOUNT': '2.420', 'weapon3': '2.696', 'DAMAGECOUNT': '10.386', 'FRAGCOUNT': '34.000'} [2023-02-24 21:05:55,628][213384] DAMAGECOUNT value on done: 377939.0 [2023-02-24 21:05:55,628][213384] Sum rewards: 27.528, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.372', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.027', 'weapon5': '0.118', 'AMMO4': '0.133', 'weapon2': '0.224', 'AMMO3': '0.272', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '1.164', 'WEAPON3': '1.500', 'weapon3': '2.122', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '9.699', 'FRAGCOUNT': '31.000'} [2023-02-24 21:05:58,176][213365] Updated weights for policy 0, policy_version 32566 (0.0009) [2023-02-24 21:06:00,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 133414912. Throughput: 0: 3377.2. Samples: 8350158. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:06:00,243][213332] Avg episode reward: [(0, '42.814')] [2023-02-24 21:06:01,179][213365] Updated weights for policy 0, policy_version 32576 (0.0009) [2023-02-24 21:06:04,240][213365] Updated weights for policy 0, policy_version 32586 (0.0010) [2023-02-24 21:06:05,243][213332] Fps is (10 sec: 13516.5, 60 sec: 13516.7, 300 sec: 13482.1). Total num frames: 133484544. Throughput: 0: 3379.7. Samples: 8360510. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:06:05,244][213332] Avg episode reward: [(0, '42.814')] [2023-02-24 21:06:07,220][213365] Updated weights for policy 0, policy_version 32596 (0.0009) [2023-02-24 21:06:10,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 133550080. Throughput: 0: 3380.6. Samples: 8380740. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:06:10,243][213332] Avg episode reward: [(0, '42.814')] [2023-02-24 21:06:10,283][213365] Updated weights for policy 0, policy_version 32606 (0.0009) [2023-02-24 21:06:11,189][213367] DAMAGECOUNT value on done: 372801.0 [2023-02-24 21:06:11,189][213367] Sum rewards: 52.860, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.860', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon4': '0.090', 'weapon5': '0.118', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon2': '0.618', 'WEAPON3': '0.950', 'HITCOUNT': '2.890', 'weapon3': '2.976', 'DAMAGECOUNT': '12.942', 'FRAGCOUNT': '43.000'} [2023-02-24 21:06:11,435][213367] DAMAGECOUNT value on done: 377962.0 [2023-02-24 21:06:11,436][213367] Sum rewards: 44.249, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.442', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon7': '0.070', 'weapon5': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.173', 'AMMO3': '0.208', 'weapon2': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.964', 'WEAPON3': '1.200', 'weapon3': '2.336', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '12.009', 'FRAGCOUNT': '40.000'} [2023-02-24 21:06:11,501][213367] DAMAGECOUNT value on done: 376045.0 [2023-02-24 21:06:11,501][213367] Sum rewards: 55.911, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.890', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO3': '0.175', 'weapon2': '0.606', 'WEAPON3': '1.050', 'HITCOUNT': '2.860', 'weapon3': '3.122', 'DAMAGECOUNT': '13.578', 'FRAGCOUNT': '45.000'} [2023-02-24 21:06:11,747][213367] DAMAGECOUNT value on done: 376057.0 [2023-02-24 21:06:11,747][213367] Sum rewards: 38.921, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.922', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.053', 'AMMO3': '0.112', 'weapon5': '0.150', 'AMMO4': '0.266', 'WEAPON5': '0.350', 'weapon2': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '0.700', 'weapon4': '1.228', 'weapon3': '1.454', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '10.869', 'FRAGCOUNT': '34.000'} [2023-02-24 21:06:12,094][213372] DAMAGECOUNT value on done: 380940.0 [2023-02-24 21:06:12,094][213372] Sum rewards: 47.772, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.950', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.165', 'weapon4': '0.224', 'weapon2': '0.894', 'WEAPON3': '1.150', 'weapon3': '2.714', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.093', 'FRAGCOUNT': '41.000'} [2023-02-24 21:06:12,385][213372] DAMAGECOUNT value on done: 371204.0 [2023-02-24 21:06:12,385][213372] Sum rewards: 52.460, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.168', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.154', 'AMMO3': '0.209', 'weapon2': '0.394', 'WEAPON3': '1.200', 'HITCOUNT': '3.030', 'weapon3': '3.232', 'DAMAGECOUNT': '12.591', 'FRAGCOUNT': '46.000'} [2023-02-24 21:06:12,406][213372] DAMAGECOUNT value on done: 381970.0 [2023-02-24 21:06:12,407][213372] Sum rewards: 48.795, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.473', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.154', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.326', 'weapon2': '0.338', 'WEAPON3': '1.250', 'HITCOUNT': '2.660', 'weapon3': '2.914', 'DAMAGECOUNT': '12.552', 'FRAGCOUNT': '43.000'} [2023-02-24 21:06:12,696][213372] DAMAGECOUNT value on done: 368774.0 [2023-02-24 21:06:12,696][213372] Sum rewards: 27.694, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.590', 'weapon5': '0.014', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO4': '0.121', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'AMMO3': '0.337', 'weapon4': '0.410', 'weapon2': '0.578', 'WEAPON3': '1.900', 'HITCOUNT': '2.390', 'weapon3': '2.692', 'DAMAGECOUNT': '10.803', 'FRAGCOUNT': '31.000'} [2023-02-24 21:06:12,791][213366] DAMAGECOUNT value on done: 369833.0 [2023-02-24 21:06:12,791][213366] Sum rewards: 40.084, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.655', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO3': '0.134', 'AMMO4': '0.180', 'weapon5': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.426', 'WEAPON3': '0.850', 'weapon4': '0.898', 'weapon3': '2.200', 'HITCOUNT': '2.360', 'DAMAGECOUNT': '9.810', 'FRAGCOUNT': '35.000'} [2023-02-24 21:06:13,109][213366] DAMAGECOUNT value on done: 387369.0 [2023-02-24 21:06:13,109][213366] Sum rewards: 47.497, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.200', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.171', 'AMMO3': '0.182', 'weapon5': '0.182', 'weapon4': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.528', 'WEAPON3': '1.150', 'weapon3': '2.730', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.645', 'FRAGCOUNT': '41.000'} [2023-02-24 21:06:13,124][213366] DAMAGECOUNT value on done: 378980.0 [2023-02-24 21:06:13,124][213366] Sum rewards: 56.723, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.728', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.017', 'AMMO4': '0.086', 'AMMO3': '0.169', 'weapon5': '0.182', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.588', 'WEAPON3': '1.100', 'weapon3': '2.586', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.550', 'FRAGCOUNT': '48.000'} [2023-02-24 21:06:13,347][213365] Updated weights for policy 0, policy_version 32616 (0.0009) [2023-02-24 21:06:13,396][213383] DAMAGECOUNT value on done: 372185.0 [2023-02-24 21:06:13,396][213383] Sum rewards: 47.063, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.280', 'AMMO5': '0.013', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.112', 'AMMO3': '0.148', 'weapon2': '0.252', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.491', 'weapon4': '0.752', 'WEAPON3': '0.900', 'weapon3': '2.578', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '11.175', 'FRAGCOUNT': '39.000'} [2023-02-24 21:06:13,437][213366] DAMAGECOUNT value on done: 371265.0 [2023-02-24 21:06:13,438][213366] Sum rewards: 43.146, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.060', 'AMMO5': '0.020', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon5': '0.192', 'AMMO3': '0.209', 'weapon4': '0.380', 'WEAPON4': '0.450', 'weapon2': '0.454', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.500', 'weapon3': '2.554', 'DAMAGECOUNT': '12.201', 'FRAGCOUNT': '41.000'} [2023-02-24 21:06:13,666][213382] DAMAGECOUNT value on done: 376094.0 [2023-02-24 21:06:13,666][213382] Sum rewards: 49.165, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.540', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.235', 'weapon4': '0.308', 'weapon2': '0.700', 'WEAPON3': '1.400', 'HITCOUNT': '2.700', 'weapon3': '2.734', 'DAMAGECOUNT': '12.792', 'FRAGCOUNT': '44.000'} [2023-02-24 21:06:13,704][213383] DAMAGECOUNT value on done: 373738.0 [2023-02-24 21:06:13,704][213383] Sum rewards: 46.033, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.200', 'ARMOR': '0.016', 'AMMO5': '0.017', 'AMMO2': '0.047', 'AMMO3': '0.149', 'AMMO4': '0.234', 'weapon5': '0.262', 'weapon4': '0.290', 'weapon2': '0.472', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'HITCOUNT': '2.270', 'weapon3': '2.648', 'DAMAGECOUNT': '11.877', 'FRAGCOUNT': '40.000'} [2023-02-24 21:06:13,736][213369] DAMAGECOUNT value on done: 379998.0 [2023-02-24 21:06:13,736][213369] Sum rewards: 41.699, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.167', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.177', 'weapon2': '0.186', 'weapon5': '0.304', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.808', 'WEAPON3': '1.100', 'weapon3': '2.280', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '13.374', 'FRAGCOUNT': '37.000'} [2023-02-24 21:06:13,776][213368] DAMAGECOUNT value on done: 371453.0 [2023-02-24 21:06:13,777][213368] Sum rewards: 40.012, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.570', 'AMMO5': '0.007', 'AMMO2': '0.024', 'WEAPON4': '0.100', 'AMMO4': '0.119', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon4': '0.264', 'weapon2': '0.436', 'WEAPON3': '1.400', 'HITCOUNT': '2.490', 'weapon3': '2.858', 'DAMAGECOUNT': '10.878', 'FRAGCOUNT': '36.000'} [2023-02-24 21:06:13,985][213382] DAMAGECOUNT value on done: 376675.0 [2023-02-24 21:06:13,986][213382] Sum rewards: 49.253, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.795', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.034', 'AMMO3': '0.156', 'weapon5': '0.166', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.578', 'WEAPON3': '1.050', 'HITCOUNT': '2.600', 'weapon3': '2.704', 'DAMAGECOUNT': '12.123', 'FRAGCOUNT': '43.000'} [2023-02-24 21:06:14,056][213369] DAMAGECOUNT value on done: 373406.0 [2023-02-24 21:06:14,056][213369] Sum rewards: 43.832, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.316', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'weapon5': '0.136', 'AMMO3': '0.142', 'AMMO4': '0.166', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.512', 'weapon4': '0.702', 'WEAPON3': '0.900', 'weapon3': '2.258', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.129', 'FRAGCOUNT': '35.000'} [2023-02-24 21:06:14,092][213368] DAMAGECOUNT value on done: 377413.0 [2023-02-24 21:06:14,093][213368] Sum rewards: 21.197, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.496', 'AMMO2': '0.012', 'AMMO5': '0.015', 'AMMO4': '0.061', 'weapon5': '0.102', 'AMMO3': '0.106', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.650', 'weapon2': '0.700', 'weapon4': '0.792', 'ARMOR': '1.101', 'HITCOUNT': '1.480', 'weapon3': '1.698', 'DAMAGECOUNT': '6.576', 'FRAGCOUNT': '17.000'} [2023-02-24 21:06:14,342][213383] DAMAGECOUNT value on done: 375185.0 [2023-02-24 21:06:14,343][213383] Sum rewards: 40.349, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.289', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.114', 'AMMO4': '0.141', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'weapon4': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.300', 'HITCOUNT': '2.470', 'weapon3': '2.922', 'DAMAGECOUNT': '12.003', 'FRAGCOUNT': '37.000'} [2023-02-24 21:06:14,353][213382] DAMAGECOUNT value on done: 364966.0 [2023-02-24 21:06:14,353][213382] Sum rewards: 34.294, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.234', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.136', 'AMMO3': '0.183', 'weapon4': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.778', 'WEAPON3': '1.050', 'HITCOUNT': '2.290', 'weapon3': '2.488', 'DAMAGECOUNT': '9.915', 'FRAGCOUNT': '31.000'} [2023-02-24 21:06:14,356][213368] DAMAGECOUNT value on done: 372793.0 [2023-02-24 21:06:14,356][213368] Sum rewards: 41.644, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.470', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.058', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon2': '0.468', 'weapon4': '0.536', 'WEAPON3': '1.150', 'HITCOUNT': '2.560', 'weapon3': '2.736', 'DAMAGECOUNT': '11.385', 'FRAGCOUNT': '37.000'} [2023-02-24 21:06:14,375][213369] DAMAGECOUNT value on done: 376678.0 [2023-02-24 21:06:14,376][213369] Sum rewards: 42.449, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.907', 'ARMOR': '0.008', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.148', 'AMMO4': '0.195', 'AMMO3': '0.210', 'weapon2': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.496', 'WEAPON3': '1.200', 'HITCOUNT': '2.700', 'weapon3': '2.836', 'DAMAGECOUNT': '11.745', 'FRAGCOUNT': '38.000'} [2023-02-24 21:06:14,646][213384] DAMAGECOUNT value on done: 380790.0 [2023-02-24 21:06:14,647][213384] Sum rewards: 38.469, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.670', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.144', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.310', 'weapon4': '0.344', 'WEAPON3': '1.500', 'HITCOUNT': '2.420', 'weapon3': '2.968', 'DAMAGECOUNT': '11.475', 'FRAGCOUNT': '37.000'} [2023-02-24 21:06:14,652][213383] DAMAGECOUNT value on done: 367734.0 [2023-02-24 21:06:14,652][213383] Sum rewards: 28.827, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.412', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.046', 'AMMO4': '0.120', 'weapon5': '0.142', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'WEAPON5': '0.300', 'weapon2': '0.756', 'WEAPON3': '1.450', 'HITCOUNT': '2.250', 'weapon3': '2.828', 'DAMAGECOUNT': '9.621', 'FRAGCOUNT': '28.500'} [2023-02-24 21:06:14,664][213382] DAMAGECOUNT value on done: 374775.0 [2023-02-24 21:06:14,665][213382] Sum rewards: 38.631, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.940', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'weapon5': '0.036', 'AMMO4': '0.121', 'weapon4': '0.130', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon2': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.510', 'weapon3': '3.194', 'DAMAGECOUNT': '11.184', 'FRAGCOUNT': '37.000'} [2023-02-24 21:06:14,670][213368] DAMAGECOUNT value on done: 368147.0 [2023-02-24 21:06:14,671][213368] Sum rewards: 37.828, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.378', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.054', 'AMMO4': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'WEAPON4': '0.450', 'weapon2': '0.456', 'weapon4': '0.528', 'WEAPON3': '1.250', 'weapon3': '2.510', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '10.737', 'FRAGCOUNT': '36.000'} [2023-02-24 21:06:14,683][213369] DAMAGECOUNT value on done: 362710.0 [2023-02-24 21:06:14,683][213369] Sum rewards: 29.055, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.410', 'AMMO5': '0.006', 'AMMO2': '0.042', 'weapon5': '0.072', 'WEAPON5': '0.200', 'AMMO4': '0.211', 'AMMO3': '0.237', 'weapon4': '0.348', 'WEAPON4': '0.400', 'weapon2': '0.682', 'WEAPON3': '1.400', 'HITCOUNT': '2.520', 'weapon3': '2.642', 'DAMAGECOUNT': '9.954', 'FRAGCOUNT': '30.000'} [2023-02-24 21:06:14,962][213384] DAMAGECOUNT value on done: 361857.0 [2023-02-24 21:06:14,962][213384] Sum rewards: 42.331, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.000', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.141', 'AMMO3': '0.185', 'weapon5': '0.204', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.466', 'weapon4': '0.744', 'WEAPON3': '1.100', 'weapon3': '2.146', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '11.379', 'FRAGCOUNT': '37.000'} [2023-02-24 21:06:15,243][213332] Fps is (10 sec: 13517.1, 60 sec: 13516.8, 300 sec: 13482.1). Total num frames: 133619712. Throughput: 0: 3374.2. Samples: 8400736. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 21:06:15,243][213332] Avg episode reward: [(0, '42.488')] [2023-02-24 21:06:15,278][213384] DAMAGECOUNT value on done: 379060.0 [2023-02-24 21:06:15,278][213384] Sum rewards: 43.277, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.596', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'weapon2': '0.230', 'weapon4': '0.736', 'WEAPON3': '1.300', 'weapon3': '2.596', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '13.041', 'FRAGCOUNT': '37.000'} [2023-02-24 21:06:15,568][213384] DAMAGECOUNT value on done: 382530.0 [2023-02-24 21:06:15,569][213384] Sum rewards: 53.487, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.118', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.036', 'AMMO4': '0.182', 'weapon5': '0.186', 'AMMO3': '0.203', 'weapon2': '0.252', 'weapon4': '0.338', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.660', 'weapon3': '2.954', 'DAMAGECOUNT': '13.773', 'FRAGCOUNT': '48.000'} [2023-02-24 21:06:16,341][213365] Updated weights for policy 0, policy_version 32626 (0.0009) [2023-02-24 21:06:19,417][213365] Updated weights for policy 0, policy_version 32636 (0.0010) [2023-02-24 21:06:20,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13482.1). Total num frames: 133685248. Throughput: 0: 3375.5. Samples: 8411038. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 21:06:20,243][213332] Avg episode reward: [(0, '42.589')] [2023-02-24 21:06:22,408][213365] Updated weights for policy 0, policy_version 32646 (0.0009) [2023-02-24 21:06:25,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 133754880. Throughput: 0: 3375.6. Samples: 8431240. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 21:06:25,243][213332] Avg episode reward: [(0, '42.589')] [2023-02-24 21:06:25,486][213365] Updated weights for policy 0, policy_version 32656 (0.0009) [2023-02-24 21:06:28,518][213365] Updated weights for policy 0, policy_version 32666 (0.0010) [2023-02-24 21:06:29,600][213383] Large shaping reward 2.505 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.483, 161.0), ('weapon5', 0.002)] [2023-02-24 21:06:30,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13482.1). Total num frames: 133820416. Throughput: 0: 3375.0. Samples: 8451408. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-24 21:06:30,243][213332] Avg episode reward: [(0, '42.589')] [2023-02-24 21:06:31,117][213367] DAMAGECOUNT value on done: 376442.0 [2023-02-24 21:06:31,117][213367] Sum rewards: 38.657, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.589', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.034', 'AMMO3': '0.122', 'weapon5': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.320', 'WEAPON3': '0.850', 'weapon2': '1.070', 'HITCOUNT': '2.220', 'weapon3': '2.272', 'DAMAGECOUNT': '10.923', 'FRAGCOUNT': '33.000'} [2023-02-24 21:06:31,333][213367] DAMAGECOUNT value on done: 381834.0 [2023-02-24 21:06:31,334][213367] Sum rewards: 41.176, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.070', 'AMMO5': '0.017', 'AMMO2': '0.047', 'AMMO3': '0.150', 'weapon5': '0.176', 'AMMO4': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.426', 'weapon4': '0.550', 'WEAPON3': '0.950', 'weapon3': '2.550', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '11.616', 'FRAGCOUNT': '34.500'} [2023-02-24 21:06:31,433][213367] DAMAGECOUNT value on done: 379567.0 [2023-02-24 21:06:31,434][213367] Sum rewards: 31.929, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.510', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.015', 'weapon5': '0.048', 'AMMO4': '0.076', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.320', 'weapon4': '0.442', 'WEAPON3': '1.100', 'HITCOUNT': '2.440', 'weapon3': '2.990', 'DAMAGECOUNT': '10.566', 'FRAGCOUNT': '30.000'} [2023-02-24 21:06:31,537][213365] Updated weights for policy 0, policy_version 32676 (0.0009) [2023-02-24 21:06:31,648][213367] DAMAGECOUNT value on done: 380701.0 [2023-02-24 21:06:31,648][213367] Sum rewards: 51.115, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.945', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.210', 'AMMO3': '0.236', 'weapon2': '0.344', 'WEAPON3': '1.400', 'HITCOUNT': '3.040', 'weapon3': '3.234', 'DAMAGECOUNT': '13.932', 'FRAGCOUNT': '46.000'} [2023-02-24 21:06:32,036][213372] DAMAGECOUNT value on done: 385084.0 [2023-02-24 21:06:32,036][213372] Sum rewards: 46.283, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.485', 'AMMO5': '0.017', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.162', 'weapon5': '0.228', 'weapon2': '0.338', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.526', 'WEAPON3': '1.050', 'weapon3': '2.630', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.432', 'FRAGCOUNT': '41.000'} [2023-02-24 21:06:32,329][213372] DAMAGECOUNT value on done: 375205.0 [2023-02-24 21:06:32,330][213372] Sum rewards: 45.179, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.790', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.225', 'weapon2': '0.230', 'weapon5': '0.260', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.734', 'WEAPON3': '1.300', 'weapon3': '2.420', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '12.003', 'FRAGCOUNT': '42.000'} [2023-02-24 21:06:32,358][213372] DAMAGECOUNT value on done: 386530.0 [2023-02-24 21:06:32,359][213372] Sum rewards: 55.416, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.570', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.030', 'AMMO3': '0.129', 'AMMO4': '0.151', 'weapon5': '0.152', 'weapon2': '0.316', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.492', 'WEAPON3': '0.800', 'HITCOUNT': '2.660', 'weapon3': '2.704', 'DAMAGECOUNT': '13.680', 'FRAGCOUNT': '47.000'} [2023-02-24 21:06:32,655][213372] DAMAGECOUNT value on done: 373265.0 [2023-02-24 21:06:32,655][213372] Sum rewards: 49.588, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.412', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO5': '0.007', 'weapon4': '0.026', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon2': '0.262', 'WEAPON3': '1.100', 'HITCOUNT': '2.730', 'weapon3': '3.406', 'DAMAGECOUNT': '13.473', 'FRAGCOUNT': '42.000'} [2023-02-24 21:06:32,674][213366] DAMAGECOUNT value on done: 373352.0 [2023-02-24 21:06:32,674][213366] Sum rewards: 37.877, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.077', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.106', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'weapon4': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.466', 'WEAPON3': '0.950', 'HITCOUNT': '2.200', 'weapon3': '2.996', 'DAMAGECOUNT': '10.557', 'FRAGCOUNT': '34.000'} [2023-02-24 21:06:32,989][213366] DAMAGECOUNT value on done: 383890.0 [2023-02-24 21:06:32,990][213366] Sum rewards: 49.864, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.745', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.064', 'AMMO3': '0.181', 'weapon5': '0.270', 'weapon2': '0.312', 'AMMO4': '0.322', 'WEAPON5': '0.550', 'WEAPON4': '0.700', 'weapon4': '0.898', 'WEAPON3': '1.200', 'weapon3': '2.166', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.442', 'FRAGCOUNT': '46.000'} [2023-02-24 21:06:32,998][213366] DAMAGECOUNT value on done: 391498.0 [2023-02-24 21:06:32,999][213366] Sum rewards: 45.766, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.920', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.208', 'weapon2': '0.260', 'WEAPON4': '0.300', 'weapon4': '0.434', 'WEAPON3': '1.300', 'HITCOUNT': '2.920', 'weapon3': '3.122', 'DAMAGECOUNT': '12.387', 'FRAGCOUNT': '41.000'} [2023-02-24 21:06:33,296][213383] DAMAGECOUNT value on done: 375755.0 [2023-02-24 21:06:33,297][213383] Sum rewards: 39.850, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.570', 'AMMO5': '0.011', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.075', 'AMMO3': '0.127', 'weapon5': '0.222', 'weapon2': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.536', 'WEAPON3': '0.850', 'HITCOUNT': '2.460', 'weapon3': '2.760', 'DAMAGECOUNT': '10.710', 'FRAGCOUNT': '34.000'} [2023-02-24 21:06:33,307][213366] DAMAGECOUNT value on done: 375351.0 [2023-02-24 21:06:33,307][213366] Sum rewards: 41.260, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.705', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'weapon5': '0.162', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'weapon2': '0.548', 'weapon4': '0.560', 'WEAPON3': '1.400', 'weapon3': '2.448', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.258', 'FRAGCOUNT': '36.500'} [2023-02-24 21:06:33,616][213383] DAMAGECOUNT value on done: 377906.0 [2023-02-24 21:06:33,616][213383] Sum rewards: 41.505, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.575', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO4': '0.142', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon5': '0.332', 'WEAPON5': '0.350', 'weapon4': '0.444', 'weapon2': '0.544', 'WEAPON3': '1.150', 'weapon3': '2.146', 'HITCOUNT': '2.240', 'DAMAGECOUNT': '12.492', 'FRAGCOUNT': '37.000'} [2023-02-24 21:06:33,621][213382] DAMAGECOUNT value on done: 379806.0 [2023-02-24 21:06:33,621][213382] Sum rewards: 47.170, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.026', 'AMMO5': '0.005', 'weapon5': '0.022', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'AMMO3': '0.161', 'AMMO4': '0.168', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon2': '0.538', 'weapon4': '0.592', 'WEAPON3': '1.000', 'weapon3': '2.560', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '11.136', 'FRAGCOUNT': '42.000'} [2023-02-24 21:06:33,739][213369] DAMAGECOUNT value on done: 383143.0 [2023-02-24 21:06:33,740][213369] Sum rewards: 31.661, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.390', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.146', 'AMMO4': '0.154', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.498', 'weapon2': '0.746', 'WEAPON3': '0.900', 'weapon3': '2.050', 'HITCOUNT': '2.210', 'DAMAGECOUNT': '9.435', 'FRAGCOUNT': '28.000'} [2023-02-24 21:06:33,789][213368] DAMAGECOUNT value on done: 375810.0 [2023-02-24 21:06:33,790][213368] Sum rewards: 45.090, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.376', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.170', 'weapon5': '0.244', 'WEAPON4': '0.400', 'weapon2': '0.430', 'WEAPON5': '0.500', 'weapon4': '0.578', 'WEAPON3': '1.100', 'weapon3': '2.460', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '13.071', 'FRAGCOUNT': '40.000'} [2023-02-24 21:06:33,935][213382] DAMAGECOUNT value on done: 380188.0 [2023-02-24 21:06:33,935][213382] Sum rewards: 37.837, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.798', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.052', 'AMMO4': '0.057', 'WEAPON5': '0.100', 'AMMO3': '0.147', 'WEAPON4': '0.300', 'weapon4': '0.504', 'weapon2': '0.784', 'WEAPON3': '0.900', 'HITCOUNT': '2.300', 'weapon3': '2.438', 'DAMAGECOUNT': '10.539', 'FRAGCOUNT': '32.000'} [2023-02-24 21:06:34,039][213369] DAMAGECOUNT value on done: 378177.0 [2023-02-24 21:06:34,039][213369] Sum rewards: 52.095, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.696', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon4': '0.054', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'weapon2': '0.218', 'AMMO3': '0.300', 'WEAPON3': '1.800', 'HITCOUNT': '3.080', 'weapon3': '3.478', 'DAMAGECOUNT': '14.313', 'FRAGCOUNT': '50.000'} [2023-02-24 21:06:34,105][213368] DAMAGECOUNT value on done: 380501.0 [2023-02-24 21:06:34,105][213368] Sum rewards: 28.857, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.598', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon5': '0.066', 'AMMO3': '0.186', 'AMMO4': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.436', 'weapon2': '0.488', 'WEAPON3': '1.150', 'HITCOUNT': '2.070', 'weapon3': '2.340', 'DAMAGECOUNT': '9.264', 'FRAGCOUNT': '28.000'} [2023-02-24 21:06:34,247][213382] DAMAGECOUNT value on done: 368982.0 [2023-02-24 21:06:34,247][213382] Sum rewards: 42.810, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.390', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.044', 'weapon5': '0.046', 'AMMO4': '0.089', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.185', 'weapon2': '1.028', 'WEAPON3': '1.100', 'weapon3': '2.626', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.048', 'FRAGCOUNT': '36.000'} [2023-02-24 21:06:34,256][213383] DAMAGECOUNT value on done: 378480.0 [2023-02-24 21:06:34,257][213383] Sum rewards: 34.976, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.130', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.126', 'AMMO3': '0.151', 'AMMO4': '0.179', 'WEAPON5': '0.250', 'weapon2': '0.384', 'WEAPON4': '0.500', 'WEAPON3': '0.900', 'weapon4': '1.186', 'weapon3': '2.090', 'HITCOUNT': '2.160', 'DAMAGECOUNT': '9.885', 'FRAGCOUNT': '31.000'} [2023-02-24 21:06:34,347][213369] DAMAGECOUNT value on done: 380123.0 [2023-02-24 21:06:34,348][213369] Sum rewards: 33.695, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.740', 'AMMO5': '0.018', 'weapon5': '0.022', 'AMMO2': '0.034', 'AMMO4': '0.171', 'weapon2': '0.176', 'AMMO3': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.786', 'WEAPON3': '1.400', 'HITCOUNT': '2.450', 'weapon3': '2.754', 'DAMAGECOUNT': '10.290', 'FRAGCOUNT': '34.000'} [2023-02-24 21:06:34,372][213368] DAMAGECOUNT value on done: 376501.0 [2023-02-24 21:06:34,373][213368] Sum rewards: 39.942, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.946', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon5': '0.128', 'AMMO3': '0.171', 'AMMO4': '0.226', 'WEAPON5': '0.300', 'weapon2': '0.382', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.714', 'WEAPON3': '1.050', 'weapon3': '2.436', 'HITCOUNT': '2.450', 'DAMAGECOUNT': '11.124', 'FRAGCOUNT': '37.000'} [2023-02-24 21:06:34,559][213382] DAMAGECOUNT value on done: 378449.0 [2023-02-24 21:06:34,560][213382] Sum rewards: 45.144, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.188', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.126', 'AMMO3': '0.186', 'AMMO4': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.260', 'WEAPON4': '0.400', 'weapon4': '0.610', 'WEAPON3': '1.100', 'weapon3': '2.408', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '11.022', 'FRAGCOUNT': '40.000'} [2023-02-24 21:06:34,573][213383] DAMAGECOUNT value on done: 371820.0 [2023-02-24 21:06:34,573][213383] Sum rewards: 49.013, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.270', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.044', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'WEAPON4': '0.250', 'weapon4': '0.426', 'weapon2': '0.948', 'WEAPON3': '1.050', 'weapon3': '2.230', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '12.258', 'FRAGCOUNT': '42.000'} [2023-02-24 21:06:34,601][213384] DAMAGECOUNT value on done: 383831.0 [2023-02-24 21:06:34,602][213384] Sum rewards: 36.086, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.971', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON5': '0.150', 'weapon5': '0.154', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon2': '0.376', 'weapon4': '0.710', 'WEAPON3': '1.000', 'HITCOUNT': '2.290', 'weapon3': '2.510', 'DAMAGECOUNT': '9.123', 'FRAGCOUNT': '33.000'} [2023-02-24 21:06:34,636][213365] Updated weights for policy 0, policy_version 32686 (0.0009) [2023-02-24 21:06:34,662][213369] DAMAGECOUNT value on done: 367159.0 [2023-02-24 21:06:34,662][213369] Sum rewards: 43.761, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.259', 'AMMO5': '0.017', 'AMMO2': '0.034', 'weapon5': '0.148', 'AMMO4': '0.169', 'AMMO3': '0.176', 'WEAPON4': '0.350', 'weapon2': '0.376', 'WEAPON5': '0.400', 'weapon4': '0.528', 'WEAPON3': '1.100', 'weapon3': '2.634', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '13.347', 'FRAGCOUNT': '38.000'} [2023-02-24 21:06:34,680][213368] DAMAGECOUNT value on done: 372263.0 [2023-02-24 21:06:34,681][213368] Sum rewards: 41.638, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.674', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.096', 'AMMO4': '0.147', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.354', 'weapon4': '0.404', 'WEAPON3': '1.100', 'HITCOUNT': '2.710', 'weapon3': '2.884', 'DAMAGECOUNT': '12.348', 'FRAGCOUNT': '36.000'} [2023-02-24 21:06:34,921][213384] DAMAGECOUNT value on done: 365562.0 [2023-02-24 21:06:34,921][213384] Sum rewards: 33.078, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.696', 'AMMO5': '0.017', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.193', 'weapon5': '0.238', 'weapon2': '0.320', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon4': '0.712', 'WEAPON3': '1.150', 'weapon3': '2.228', 'HITCOUNT': '2.290', 'DAMAGECOUNT': '10.860', 'FRAGCOUNT': '32.000'} [2023-02-24 21:06:35,227][213384] DAMAGECOUNT value on done: 382932.0 [2023-02-24 21:06:35,227][213384] Sum rewards: 45.818, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.527', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.012', 'AMMO4': '0.028', 'WEAPON5': '0.100', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon4': '0.346', 'weapon2': '0.438', 'WEAPON3': '1.150', 'HITCOUNT': '2.630', 'weapon3': '3.028', 'DAMAGECOUNT': '11.484', 'FRAGCOUNT': '40.000'} [2023-02-24 21:06:35,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 133890048. Throughput: 0: 3373.9. Samples: 8461600. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:06:35,243][213332] Avg episode reward: [(0, '42.264')] [2023-02-24 21:06:35,527][213384] DAMAGECOUNT value on done: 386407.0 [2023-02-24 21:06:35,527][213384] Sum rewards: 38.339, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.710', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.143', 'AMMO3': '0.186', 'WEAPON5': '0.250', 'weapon5': '0.270', 'WEAPON4': '0.300', 'weapon2': '0.314', 'weapon4': '0.550', 'WEAPON3': '1.150', 'HITCOUNT': '2.420', 'weapon3': '2.542', 'DAMAGECOUNT': '11.631', 'FRAGCOUNT': '33.000'} [2023-02-24 21:06:37,582][213365] Updated weights for policy 0, policy_version 32696 (0.0010) [2023-02-24 21:06:40,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13482.1). Total num frames: 133955584. Throughput: 0: 3375.9. Samples: 8481794. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:06:40,243][213332] Avg episode reward: [(0, '42.286')] [2023-02-24 21:06:40,657][213365] Updated weights for policy 0, policy_version 32706 (0.0009) [2023-02-24 21:06:43,685][213365] Updated weights for policy 0, policy_version 32716 (0.0009) [2023-02-24 21:06:45,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 134025216. Throughput: 0: 3373.7. Samples: 8501976. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:06:45,243][213332] Avg episode reward: [(0, '42.286')] [2023-02-24 21:06:45,247][213352] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000032721_134025216.pth... [2023-02-24 21:06:45,304][213352] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000031930_130785280.pth [2023-02-24 21:06:45,787][213384] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 21:06:46,281][213367] Large shaping reward 2.530 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.51, 170.0)] [2023-02-24 21:06:46,713][213365] Updated weights for policy 0, policy_version 32726 (0.0009) [2023-02-24 21:06:49,790][213365] Updated weights for policy 0, policy_version 32736 (0.0009) [2023-02-24 21:06:50,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 134090752. Throughput: 0: 3371.6. Samples: 8512232. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:06:50,243][213332] Avg episode reward: [(0, '42.286')] [2023-02-24 21:06:51,085][213367] DAMAGECOUNT value on done: 381120.0 [2023-02-24 21:06:51,085][213367] Sum rewards: 53.045, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.437', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon5': '0.062', 'WEAPON5': '0.100', 'weapon4': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'weapon2': '0.800', 'WEAPON3': '1.050', 'weapon3': '2.814', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.034', 'FRAGCOUNT': '44.000'} [2023-02-24 21:06:51,253][213367] DAMAGECOUNT value on done: 385680.0 [2023-02-24 21:06:51,254][213367] Sum rewards: 41.520, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.840', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.138', 'weapon4': '0.180', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'weapon2': '0.226', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.300', 'weapon3': '3.196', 'DAMAGECOUNT': '11.538', 'FRAGCOUNT': '37.000'} [2023-02-24 21:06:51,385][213367] DAMAGECOUNT value on done: 383988.0 [2023-02-24 21:06:51,386][213367] Sum rewards: 48.992, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.640', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.156', 'weapon2': '0.184', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.462', 'WEAPON3': '1.300', 'HITCOUNT': '2.530', 'weapon3': '2.900', 'DAMAGECOUNT': '13.197', 'FRAGCOUNT': '44.000'} [2023-02-24 21:06:51,558][213367] DAMAGECOUNT value on done: 384459.0 [2023-02-24 21:06:51,558][213367] Sum rewards: 34.255, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.317', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.026', 'weapon5': '0.070', 'AMMO4': '0.132', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'weapon2': '0.306', 'weapon4': '0.618', 'WEAPON3': '1.300', 'HITCOUNT': '2.410', 'weapon3': '2.698', 'DAMAGECOUNT': '11.274', 'FRAGCOUNT': '32.000'} [2023-02-24 21:06:51,925][213372] DAMAGECOUNT value on done: 389059.0 [2023-02-24 21:06:51,925][213372] Sum rewards: 45.635, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.290', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon5': '0.090', 'AMMO4': '0.091', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.218', 'weapon2': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.550', 'weapon3': '2.970', 'DAMAGECOUNT': '11.925', 'FRAGCOUNT': '41.000'} [2023-02-24 21:06:52,226][213372] DAMAGECOUNT value on done: 378838.0 [2023-02-24 21:06:52,227][213372] Sum rewards: 39.893, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.552', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.102', 'AMMO3': '0.145', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.322', 'weapon4': '0.412', 'WEAPON3': '0.900', 'HITCOUNT': '2.410', 'weapon3': '2.988', 'DAMAGECOUNT': '10.899', 'FRAGCOUNT': '33.000'} [2023-02-24 21:06:52,263][213372] DAMAGECOUNT value on done: 391176.0 [2023-02-24 21:06:52,263][213372] Sum rewards: 55.432, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.357', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.116', 'weapon2': '0.122', 'AMMO3': '0.252', 'WEAPON3': '1.550', 'HITCOUNT': '2.760', 'weapon3': '3.562', 'DAMAGECOUNT': '13.938', 'FRAGCOUNT': '51.000'} [2023-02-24 21:06:52,560][213372] DAMAGECOUNT value on done: 377039.0 [2023-02-24 21:06:52,561][213372] Sum rewards: 43.937, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.375', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'weapon2': '0.566', 'WEAPON3': '1.250', 'HITCOUNT': '2.790', 'weapon3': '3.122', 'DAMAGECOUNT': '11.322', 'FRAGCOUNT': '40.000'} [2023-02-24 21:06:52,693][213366] DAMAGECOUNT value on done: 377507.0 [2023-02-24 21:06:52,693][213366] Sum rewards: 43.588, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.742', 'AMMO5': '0.007', 'ARMOR': '0.008', 'weapon5': '0.016', 'AMMO2': '0.041', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'AMMO4': '0.207', 'WEAPON4': '0.400', 'weapon4': '0.420', 'weapon2': '0.608', 'WEAPON3': '1.200', 'weapon3': '2.682', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.420', 'FRAGCOUNT': '40.000'} [2023-02-24 21:06:52,813][213365] Updated weights for policy 0, policy_version 32746 (0.0009) [2023-02-24 21:06:53,008][213366] DAMAGECOUNT value on done: 387975.0 [2023-02-24 21:06:53,009][213366] Sum rewards: 50.218, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.170', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon5': '0.158', 'weapon4': '0.160', 'weapon2': '0.216', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.670', 'weapon3': '3.092', 'DAMAGECOUNT': '12.255', 'FRAGCOUNT': '47.000'} [2023-02-24 21:06:53,018][213366] DAMAGECOUNT value on done: 396033.0 [2023-02-24 21:06:53,019][213366] Sum rewards: 50.461, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.578', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.182', 'weapon2': '0.234', 'AMMO3': '0.250', 'weapon4': '0.418', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.786', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.605', 'FRAGCOUNT': '48.000'} [2023-02-24 21:06:53,257][213383] DAMAGECOUNT value on done: 380194.0 [2023-02-24 21:06:53,258][213383] Sum rewards: 52.297, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.638', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.106', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.484', 'weapon4': '0.574', 'WEAPON3': '1.000', 'weapon3': '2.634', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '13.317', 'FRAGCOUNT': '45.000'} [2023-02-24 21:06:53,336][213366] DAMAGECOUNT value on done: 378996.0 [2023-02-24 21:06:53,337][213366] Sum rewards: 38.345, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.283', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.062', 'AMMO4': '0.208', 'AMMO3': '0.217', 'weapon2': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.526', 'WEAPON3': '1.300', 'HITCOUNT': '2.530', 'weapon3': '2.894', 'DAMAGECOUNT': '10.935', 'FRAGCOUNT': '36.000'} [2023-02-24 21:06:53,576][213382] DAMAGECOUNT value on done: 382805.0 [2023-02-24 21:06:53,577][213382] Sum rewards: 35.464, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.523', 'AMMO5': '0.016', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon2': '0.154', 'weapon5': '0.170', 'AMMO3': '0.185', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.372', 'WEAPON3': '1.100', 'HITCOUNT': '1.980', 'weapon3': '2.894', 'DAMAGECOUNT': '8.997', 'FRAGCOUNT': '33.000'} [2023-02-24 21:06:53,581][213383] DAMAGECOUNT value on done: 381787.0 [2023-02-24 21:06:53,581][213383] Sum rewards: 43.808, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.839', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO3': '0.140', 'AMMO4': '0.181', 'weapon5': '0.212', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.622', 'weapon2': '0.630', 'WEAPON3': '0.950', 'weapon3': '2.098', 'HITCOUNT': '2.370', 'DAMAGECOUNT': '11.643', 'FRAGCOUNT': '39.000'} [2023-02-24 21:06:53,638][213369] DAMAGECOUNT value on done: 386377.0 [2023-02-24 21:06:53,639][213369] Sum rewards: 32.469, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.074', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.029', 'weapon5': '0.088', 'AMMO4': '0.144', 'AMMO3': '0.164', 'WEAPON5': '0.350', 'weapon2': '0.438', 'WEAPON4': '0.450', 'weapon4': '0.838', 'WEAPON3': '1.000', 'HITCOUNT': '2.050', 'weapon3': '2.266', 'DAMAGECOUNT': '9.702', 'FRAGCOUNT': '30.000'} [2023-02-24 21:06:53,709][213368] DAMAGECOUNT value on done: 379238.0 [2023-02-24 21:06:53,709][213368] Sum rewards: 35.437, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.527', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.108', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'weapon4': '0.192', 'WEAPON4': '0.250', 'AMMO3': '0.301', 'weapon2': '0.330', 'WEAPON3': '1.700', 'HITCOUNT': '2.440', 'weapon3': '3.058', 'DAMAGECOUNT': '10.284', 'FRAGCOUNT': '38.500'} [2023-02-24 21:06:53,885][213382] DAMAGECOUNT value on done: 384530.0 [2023-02-24 21:06:53,885][213382] Sum rewards: 44.879, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.020', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.058', 'AMMO4': '0.111', 'WEAPON5': '0.200', 'weapon2': '0.284', 'AMMO3': '0.292', 'WEAPON4': '0.350', 'weapon4': '0.652', 'WEAPON3': '1.650', 'weapon3': '2.676', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.026', 'FRAGCOUNT': '42.000'} [2023-02-24 21:06:53,953][213369] DAMAGECOUNT value on done: 382352.0 [2023-02-24 21:06:53,954][213369] Sum rewards: 50.018, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.726', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon5': '0.018', 'AMMO4': '0.057', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon4': '0.326', 'weapon2': '0.346', 'WEAPON3': '1.100', 'HITCOUNT': '2.810', 'weapon3': '3.064', 'DAMAGECOUNT': '12.525', 'FRAGCOUNT': '42.000'} [2023-02-24 21:06:54,011][213368] DAMAGECOUNT value on done: 384707.0 [2023-02-24 21:06:54,011][213368] Sum rewards: 42.551, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.148', 'AMMO5': '0.020', 'AMMO2': '0.037', 'weapon5': '0.046', 'AMMO3': '0.187', 'AMMO4': '0.187', 'weapon4': '0.334', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.406', 'WEAPON3': '1.150', 'HITCOUNT': '2.760', 'weapon3': '2.904', 'DAMAGECOUNT': '12.618', 'FRAGCOUNT': '39.000'} [2023-02-24 21:06:54,195][213382] DAMAGECOUNT value on done: 373492.0 [2023-02-24 21:06:54,196][213382] Sum rewards: 44.016, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-3.718', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon5': '0.158', 'AMMO4': '0.213', 'weapon2': '0.232', 'AMMO3': '0.276', 'WEAPON5': '0.350', 'weapon4': '0.396', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'HITCOUNT': '2.760', 'weapon3': '2.912', 'DAMAGECOUNT': '13.530', 'FRAGCOUNT': '45.000'} [2023-02-24 21:06:54,204][213383] DAMAGECOUNT value on done: 382562.0 [2023-02-24 21:06:54,204][213383] Sum rewards: 50.258, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.509', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.156', 'weapon4': '0.246', 'weapon2': '0.318', 'WEAPON3': '1.100', 'HITCOUNT': '2.950', 'weapon3': '3.220', 'DAMAGECOUNT': '12.246', 'FRAGCOUNT': '42.000'} [2023-02-24 21:06:54,263][213368] DAMAGECOUNT value on done: 380402.0 [2023-02-24 21:06:54,264][213368] Sum rewards: 39.173, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.176', 'AMMO5': '0.019', 'AMMO2': '0.047', 'weapon5': '0.080', 'AMMO3': '0.202', 'AMMO4': '0.236', 'weapon2': '0.288', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.596', 'WEAPON3': '1.200', 'HITCOUNT': '2.510', 'weapon3': '2.766', 'DAMAGECOUNT': '11.604', 'FRAGCOUNT': '36.000'} [2023-02-24 21:06:54,267][213369] DAMAGECOUNT value on done: 382735.0 [2023-02-24 21:06:54,267][213369] Sum rewards: 24.737, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.542', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.054', 'AMMO3': '0.144', 'weapon2': '0.192', 'weapon5': '0.192', 'AMMO4': '0.269', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '0.850', 'weapon4': '1.006', 'HITCOUNT': '2.060', 'weapon3': '2.100', 'DAMAGECOUNT': '7.836', 'FRAGCOUNT': '22.500'} [2023-02-24 21:06:54,523][213382] DAMAGECOUNT value on done: 382341.0 [2023-02-24 21:06:54,524][213382] Sum rewards: 42.745, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.780', 'AMMO5': '0.015', 'AMMO2': '0.018', 'weapon5': '0.086', 'AMMO4': '0.091', 'weapon4': '0.126', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.250', 'HITCOUNT': '2.550', 'weapon3': '3.180', 'DAMAGECOUNT': '11.676', 'FRAGCOUNT': '38.000'} [2023-02-24 21:06:54,527][213383] DAMAGECOUNT value on done: 376235.0 [2023-02-24 21:06:54,527][213383] Sum rewards: 43.349, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.578', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon5': '0.178', 'WEAPON5': '0.200', 'weapon4': '0.226', 'AMMO3': '0.243', 'WEAPON4': '0.350', 'weapon2': '0.658', 'WEAPON3': '1.500', 'weapon3': '2.624', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '13.245', 'FRAGCOUNT': '42.000'} [2023-02-24 21:06:54,568][213384] DAMAGECOUNT value on done: 387765.0 [2023-02-24 21:06:54,568][213384] Sum rewards: 49.609, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.450', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.130', 'AMMO3': '0.147', 'AMMO4': '0.211', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.366', 'weapon4': '0.688', 'WEAPON3': '0.950', 'weapon3': '2.322', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '11.802', 'FRAGCOUNT': '43.000'} [2023-02-24 21:06:54,578][213368] DAMAGECOUNT value on done: 376455.0 [2023-02-24 21:06:54,579][213368] Sum rewards: 49.561, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.720', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.032', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.334', 'weapon4': '0.374', 'WEAPON3': '1.450', 'HITCOUNT': '2.730', 'weapon3': '2.946', 'DAMAGECOUNT': '12.576', 'FRAGCOUNT': '46.000'} [2023-02-24 21:06:54,596][213369] DAMAGECOUNT value on done: 371618.0 [2023-02-24 21:06:54,596][213369] Sum rewards: 49.689, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.614', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon2': '0.152', 'AMMO4': '0.175', 'weapon5': '0.176', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.558', 'WEAPON3': '1.250', 'weapon3': '2.752', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.377', 'FRAGCOUNT': '44.000'} [2023-02-24 21:06:54,883][213384] DAMAGECOUNT value on done: 369887.0 [2023-02-24 21:06:54,884][213384] Sum rewards: 45.263, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.351', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'AMMO3': '0.178', 'weapon5': '0.180', 'AMMO4': '0.181', 'weapon2': '0.362', 'WEAPON4': '0.400', 'weapon4': '0.424', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.708', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.975', 'FRAGCOUNT': '40.000'} [2023-02-24 21:06:55,192][213384] DAMAGECOUNT value on done: 386780.0 [2023-02-24 21:06:55,193][213384] Sum rewards: 42.089, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.830', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.110', 'AMMO4': '0.131', 'AMMO3': '0.186', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.368', 'weapon2': '0.566', 'WEAPON3': '1.050', 'weapon3': '2.718', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '11.544', 'FRAGCOUNT': '37.000'} [2023-02-24 21:06:55,243][213332] Fps is (10 sec: 13107.1, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 134156288. Throughput: 0: 3366.4. Samples: 8532226. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:06:55,243][213332] Avg episode reward: [(0, '42.319')] [2023-02-24 21:06:55,485][213384] DAMAGECOUNT value on done: 389286.0 [2023-02-24 21:06:55,485][213384] Sum rewards: 27.966, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.562', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon5': '0.084', 'AMMO4': '0.200', 'AMMO3': '0.218', 'weapon2': '0.296', 'WEAPON4': '0.300', 'weapon4': '0.308', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '1.870', 'weapon3': '2.850', 'DAMAGECOUNT': '8.637', 'FRAGCOUNT': '26.000'} [2023-02-24 21:06:55,735][213367] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 21:06:55,853][213365] Updated weights for policy 0, policy_version 32756 (0.0009) [2023-02-24 21:06:58,889][213365] Updated weights for policy 0, policy_version 32766 (0.0009) [2023-02-24 21:07:00,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 134225920. Throughput: 0: 3371.2. Samples: 8552438. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:07:00,243][213332] Avg episode reward: [(0, '42.079')] [2023-02-24 21:07:01,852][213365] Updated weights for policy 0, policy_version 32776 (0.0009) [2023-02-24 21:07:04,945][213365] Updated weights for policy 0, policy_version 32786 (0.0009) [2023-02-24 21:07:05,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13516.9, 300 sec: 13496.0). Total num frames: 134295552. Throughput: 0: 3372.2. Samples: 8562788. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:07:05,243][213332] Avg episode reward: [(0, '42.079')] [2023-02-24 21:07:07,948][213365] Updated weights for policy 0, policy_version 32796 (0.0009) [2023-02-24 21:07:09,374][213384] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 21:07:10,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 134361088. Throughput: 0: 3372.0. Samples: 8582978. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:07:10,243][213332] Avg episode reward: [(0, '42.079')] [2023-02-24 21:07:10,972][213367] DAMAGECOUNT value on done: 384622.0 [2023-02-24 21:07:10,972][213367] Sum rewards: 39.111, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.316', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon5': '0.154', 'AMMO3': '0.173', 'AMMO4': '0.185', 'WEAPON5': '0.350', 'weapon4': '0.390', 'WEAPON4': '0.400', 'weapon2': '0.470', 'WEAPON3': '1.050', 'HITCOUNT': '2.470', 'weapon3': '2.730', 'DAMAGECOUNT': '10.506', 'FRAGCOUNT': '36.000'} [2023-02-24 21:07:10,976][213365] Updated weights for policy 0, policy_version 32806 (0.0009) [2023-02-24 21:07:11,127][213367] DAMAGECOUNT value on done: 389985.0 [2023-02-24 21:07:11,128][213367] Sum rewards: 48.077, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.662', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.138', 'AMMO4': '0.163', 'AMMO3': '0.218', 'weapon2': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.376', 'WEAPON3': '1.300', 'HITCOUNT': '2.620', 'weapon3': '2.938', 'DAMAGECOUNT': '12.849', 'FRAGCOUNT': '44.000'} [2023-02-24 21:07:11,290][213367] DAMAGECOUNT value on done: 388147.0 [2023-02-24 21:07:11,290][213367] Sum rewards: 53.756, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.485', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.054', 'AMMO4': '0.089', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon4': '0.282', 'weapon2': '0.312', 'WEAPON3': '1.400', 'HITCOUNT': '2.860', 'weapon3': '3.058', 'DAMAGECOUNT': '12.477', 'FRAGCOUNT': '48.000'} [2023-02-24 21:07:11,439][213367] DAMAGECOUNT value on done: 387979.0 [2023-02-24 21:07:11,439][213367] Sum rewards: 36.745, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.860', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.036', 'weapon4': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon2': '0.346', 'WEAPON3': '1.300', 'HITCOUNT': '2.340', 'weapon3': '3.312', 'DAMAGECOUNT': '10.560', 'FRAGCOUNT': '35.000'} [2023-02-24 21:07:11,827][213372] DAMAGECOUNT value on done: 392838.0 [2023-02-24 21:07:11,828][213372] Sum rewards: 38.327, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.362', 'AMMO5': '0.003', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon2': '0.256', 'AMMO3': '0.260', 'WEAPON4': '0.350', 'weapon4': '0.420', 'WEAPON3': '1.550', 'HITCOUNT': '2.710', 'weapon3': '3.128', 'DAMAGECOUNT': '11.337', 'FRAGCOUNT': '38.000'} [2023-02-24 21:07:12,110][213372] DAMAGECOUNT value on done: 383727.0 [2023-02-24 21:07:12,111][213372] Sum rewards: 55.758, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.972', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.066', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.164', 'AMMO3': '0.195', 'weapon2': '0.402', 'WEAPON3': '1.200', 'HITCOUNT': '2.960', 'weapon3': '3.188', 'DAMAGECOUNT': '14.667', 'FRAGCOUNT': '48.000'} [2023-02-24 21:07:12,147][213372] DAMAGECOUNT value on done: 394579.0 [2023-02-24 21:07:12,148][213372] Sum rewards: 40.535, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.208', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon5': '0.094', 'AMMO4': '0.118', 'AMMO3': '0.155', 'WEAPON5': '0.200', 'weapon2': '0.308', 'WEAPON4': '0.450', 'weapon4': '0.944', 'WEAPON3': '0.950', 'weapon3': '2.350', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '10.209', 'FRAGCOUNT': '36.500'} [2023-02-24 21:07:12,425][213372] DAMAGECOUNT value on done: 380599.0 [2023-02-24 21:07:12,426][213372] Sum rewards: 41.466, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.732', 'AMMO5': '0.023', 'AMMO2': '0.048', 'weapon5': '0.110', 'AMMO3': '0.134', 'AMMO4': '0.240', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON4': '0.550', 'weapon4': '0.812', 'WEAPON3': '0.850', 'weapon3': '2.276', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '10.680', 'FRAGCOUNT': '36.000'} [2023-02-24 21:07:12,617][213366] DAMAGECOUNT value on done: 381687.0 [2023-02-24 21:07:12,617][213366] Sum rewards: 42.355, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-0.514', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.056', 'AMMO4': '0.209', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'weapon2': '0.276', 'WEAPON4': '0.350', 'weapon4': '0.438', 'WEAPON3': '1.400', 'HITCOUNT': '2.860', 'weapon3': '2.930', 'DAMAGECOUNT': '12.540', 'FRAGCOUNT': '40.000'} [2023-02-24 21:07:12,937][213366] DAMAGECOUNT value on done: 392372.0 [2023-02-24 21:07:12,938][213366] Sum rewards: 47.138, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.744', 'ARMOR': '0.008', 'AMMO5': '0.021', 'AMMO2': '0.049', 'weapon5': '0.060', 'AMMO3': '0.194', 'weapon2': '0.210', 'AMMO4': '0.245', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'weapon4': '1.090', 'WEAPON3': '1.150', 'weapon3': '2.334', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.191', 'FRAGCOUNT': '43.000'} [2023-02-24 21:07:12,948][213366] DAMAGECOUNT value on done: 399639.0 [2023-02-24 21:07:12,949][213366] Sum rewards: 37.232, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.236', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.116', 'AMMO3': '0.183', 'AMMO4': '0.217', 'WEAPON5': '0.300', 'weapon2': '0.302', 'weapon4': '0.502', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'HITCOUNT': '2.350', 'weapon3': '2.776', 'DAMAGECOUNT': '10.818', 'FRAGCOUNT': '35.000'} [2023-02-24 21:07:13,212][213383] DAMAGECOUNT value on done: 383124.0 [2023-02-24 21:07:13,212][213383] Sum rewards: 34.404, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.107', 'ARMOR': '0.004', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.221', 'weapon2': '0.244', 'WEAPON4': '0.300', 'weapon4': '0.968', 'WEAPON3': '1.250', 'HITCOUNT': '2.250', 'weapon3': '2.490', 'DAMAGECOUNT': '8.790', 'FRAGCOUNT': '34.000'} [2023-02-24 21:07:13,261][213366] DAMAGECOUNT value on done: 383582.0 [2023-02-24 21:07:13,262][213366] Sum rewards: 45.303, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.070', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.102', 'AMMO4': '0.195', 'WEAPON5': '0.200', 'weapon2': '0.248', 'AMMO3': '0.272', 'WEAPON4': '0.400', 'weapon4': '0.520', 'WEAPON3': '1.600', 'weapon3': '2.804', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.758', 'FRAGCOUNT': '44.000'} [2023-02-24 21:07:13,460][213382] DAMAGECOUNT value on done: 387135.0 [2023-02-24 21:07:13,460][213382] Sum rewards: 53.513, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.905', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.196', 'weapon2': '0.736', 'WEAPON3': '1.200', 'HITCOUNT': '2.730', 'weapon3': '3.052', 'DAMAGECOUNT': '12.990', 'FRAGCOUNT': '47.000'} [2023-02-24 21:07:13,533][213383] DAMAGECOUNT value on done: 386763.0 [2023-02-24 21:07:13,533][213383] Sum rewards: 54.817, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.512', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.068', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.172', 'AMMO4': '0.172', 'AMMO3': '0.221', 'weapon4': '0.238', 'WEAPON3': '1.300', 'HITCOUNT': '3.070', 'weapon3': '3.320', 'DAMAGECOUNT': '14.928', 'FRAGCOUNT': '46.000'} [2023-02-24 21:07:13,554][213369] DAMAGECOUNT value on done: 390249.0 [2023-02-24 21:07:13,555][213369] Sum rewards: 40.776, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.552', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'weapon5': '0.114', 'AMMO4': '0.191', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.578', 'weapon4': '0.736', 'WEAPON3': '1.200', 'weapon3': '2.218', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '11.616', 'FRAGCOUNT': '37.000'} [2023-02-24 21:07:13,607][213368] DAMAGECOUNT value on done: 382873.0 [2023-02-24 21:07:13,608][213368] Sum rewards: 41.380, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.841', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.168', 'AMMO3': '0.173', 'WEAPON4': '0.350', 'weapon4': '0.366', 'weapon2': '0.456', 'WEAPON3': '1.100', 'HITCOUNT': '2.540', 'weapon3': '3.014', 'DAMAGECOUNT': '10.905', 'FRAGCOUNT': '37.000'} [2023-02-24 21:07:13,779][213382] DAMAGECOUNT value on done: 389415.0 [2023-02-24 21:07:13,780][213382] Sum rewards: 53.837, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.969', 'AMMO5': '0.019', 'AMMO2': '0.035', 'AMMO3': '0.173', 'AMMO4': '0.175', 'weapon2': '0.186', 'weapon5': '0.202', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.574', 'WEAPON3': '1.050', 'weapon3': '2.706', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '14.655', 'FRAGCOUNT': '45.000'} [2023-02-24 21:07:13,871][213369] DAMAGECOUNT value on done: 386876.0 [2023-02-24 21:07:13,872][213369] Sum rewards: 47.975, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.869', 'AMMO2': '0.019', 'AMMO5': '0.024', 'weapon4': '0.050', 'AMMO4': '0.096', 'WEAPON4': '0.200', 'weapon2': '0.214', 'AMMO3': '0.221', 'weapon5': '0.224', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'HITCOUNT': '2.540', 'weapon3': '3.234', 'DAMAGECOUNT': '13.572', 'FRAGCOUNT': '42.000'} [2023-02-24 21:07:13,927][213368] DAMAGECOUNT value on done: 388695.0 [2023-02-24 21:07:13,927][213368] Sum rewards: 39.971, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.180', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.018', 'weapon5': '0.018', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.295', 'weapon2': '0.520', 'WEAPON3': '1.800', 'HITCOUNT': '2.670', 'weapon3': '3.238', 'DAMAGECOUNT': '11.964', 'FRAGCOUNT': '40.000'} [2023-02-24 21:07:14,013][213365] Updated weights for policy 0, policy_version 32816 (0.0009) [2023-02-24 21:07:14,095][213382] DAMAGECOUNT value on done: 376898.0 [2023-02-24 21:07:14,096][213382] Sum rewards: 34.564, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.607', 'AMMO5': '0.018', 'AMMO2': '0.035', 'weapon5': '0.076', 'AMMO4': '0.173', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'weapon4': '0.258', 'WEAPON5': '0.400', 'weapon2': '0.832', 'WEAPON3': '1.050', 'HITCOUNT': '2.330', 'weapon3': '2.600', 'DAMAGECOUNT': '10.218', 'FRAGCOUNT': '29.000'} [2023-02-24 21:07:14,174][213383] DAMAGECOUNT value on done: 386462.0 [2023-02-24 21:07:14,175][213383] Sum rewards: 42.359, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.649', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.106', 'AMMO4': '0.194', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON4': '0.400', 'weapon4': '0.604', 'WEAPON3': '1.300', 'HITCOUNT': '2.670', 'weapon3': '2.680', 'DAMAGECOUNT': '11.700', 'FRAGCOUNT': '40.000'} [2023-02-24 21:07:14,192][213369] DAMAGECOUNT value on done: 386620.0 [2023-02-24 21:07:14,193][213369] Sum rewards: 38.126, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.185', 'ARMOR': '0.004', 'AMMO5': '0.029', 'AMMO2': '0.042', 'weapon5': '0.140', 'AMMO3': '0.204', 'AMMO4': '0.207', 'weapon2': '0.378', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'weapon4': '0.658', 'WEAPON3': '1.200', 'weapon3': '2.454', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '11.655', 'FRAGCOUNT': '35.500'} [2023-02-24 21:07:14,195][213368] DAMAGECOUNT value on done: 385537.0 [2023-02-24 21:07:14,195][213368] Sum rewards: 55.047, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.067', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon5': '0.110', 'AMMO4': '0.125', 'weapon2': '0.170', 'weapon4': '0.174', 'AMMO3': '0.197', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'HITCOUNT': '2.920', 'weapon3': '3.276', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '47.000'} [2023-02-24 21:07:14,408][213382] DAMAGECOUNT value on done: 386148.0 [2023-02-24 21:07:14,408][213382] Sum rewards: 37.388, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.682', 'AMMO5': '0.020', 'AMMO2': '0.045', 'AMMO3': '0.144', 'weapon5': '0.170', 'AMMO4': '0.226', 'weapon2': '0.394', 'WEAPON5': '0.400', 'ARMOR': '0.408', 'WEAPON4': '0.550', 'WEAPON3': '0.850', 'weapon4': '1.074', 'weapon3': '1.998', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '11.421', 'FRAGCOUNT': '33.000'} [2023-02-24 21:07:14,481][213384] DAMAGECOUNT value on done: 391817.0 [2023-02-24 21:07:14,482][213384] Sum rewards: 44.448, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.105', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.158', 'AMMO4': '0.194', 'weapon2': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'weapon4': '0.658', 'WEAPON3': '1.200', 'HITCOUNT': '2.620', 'weapon3': '2.622', 'DAMAGECOUNT': '12.156', 'FRAGCOUNT': '41.000'} [2023-02-24 21:07:14,487][213383] DAMAGECOUNT value on done: 380343.0 [2023-02-24 21:07:14,487][213383] Sum rewards: 46.555, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.705', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon2': '0.192', 'WEAPON4': '0.200', 'AMMO4': '0.206', 'weapon4': '0.636', 'WEAPON3': '1.100', 'HITCOUNT': '2.730', 'weapon3': '2.900', 'DAMAGECOUNT': '12.324', 'FRAGCOUNT': '40.000'} [2023-02-24 21:07:14,492][213368] DAMAGECOUNT value on done: 380325.0 [2023-02-24 21:07:14,493][213368] Sum rewards: 43.402, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.639', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.024', 'AMMO4': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.212', 'weapon2': '0.506', 'WEAPON3': '1.100', 'HITCOUNT': '2.620', 'weapon3': '3.066', 'DAMAGECOUNT': '11.610', 'FRAGCOUNT': '37.000'} [2023-02-24 21:07:14,515][213369] DAMAGECOUNT value on done: 375850.0 [2023-02-24 21:07:14,516][213369] Sum rewards: 44.631, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.990', 'ARMOR': '0.004', 'AMMO5': '0.009', 'weapon5': '0.022', 'weapon4': '0.032', 'AMMO2': '0.038', 'AMMO4': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.520', 'WEAPON3': '1.450', 'HITCOUNT': '2.550', 'weapon3': '3.226', 'DAMAGECOUNT': '12.696', 'FRAGCOUNT': '42.000'} [2023-02-24 21:07:14,795][213384] DAMAGECOUNT value on done: 373680.0 [2023-02-24 21:07:14,796][213384] Sum rewards: 45.906, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.225', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON4': '0.100', 'weapon2': '0.118', 'AMMO3': '0.184', 'weapon4': '0.264', 'WEAPON3': '1.100', 'HITCOUNT': '2.810', 'weapon3': '3.396', 'DAMAGECOUNT': '11.379', 'FRAGCOUNT': '39.000'} [2023-02-24 21:07:15,122][213384] DAMAGECOUNT value on done: 390878.0 [2023-02-24 21:07:15,123][213384] Sum rewards: 44.386, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.378', 'ARMOR': '0.005', 'AMMO5': '0.020', 'AMMO2': '0.058', 'AMMO3': '0.123', 'weapon5': '0.130', 'AMMO4': '0.292', 'WEAPON5': '0.450', 'weapon2': '0.466', 'WEAPON4': '0.750', 'WEAPON3': '0.850', 'weapon4': '0.950', 'weapon3': '2.116', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.294', 'FRAGCOUNT': '39.000'} [2023-02-24 21:07:15,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 134430720. Throughput: 0: 3369.0. Samples: 8603014. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:07:15,243][213332] Avg episode reward: [(0, '43.084')] [2023-02-24 21:07:15,426][213384] DAMAGECOUNT value on done: 392777.0 [2023-02-24 21:07:15,427][213384] Sum rewards: 28.960, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.283', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon5': '0.138', 'AMMO4': '0.198', 'AMMO3': '0.281', 'weapon2': '0.292', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.498', 'WEAPON3': '1.550', 'HITCOUNT': '2.360', 'weapon3': '2.648', 'DAMAGECOUNT': '10.473', 'FRAGCOUNT': '30.000'} [2023-02-24 21:07:16,966][213365] Updated weights for policy 0, policy_version 32826 (0.0009) [2023-02-24 21:07:17,910][213382] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 21:07:20,032][213365] Updated weights for policy 0, policy_version 32836 (0.0009) [2023-02-24 21:07:20,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 134496256. Throughput: 0: 3372.0. Samples: 8613338. Policy #0 lag: (min: 0.0, avg: 0.4, max: 2.0) [2023-02-24 21:07:20,243][213332] Avg episode reward: [(0, '42.996')] [2023-02-24 21:07:23,010][213365] Updated weights for policy 0, policy_version 32846 (0.0009) [2023-02-24 21:07:25,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 134565888. Throughput: 0: 3374.8. Samples: 8633662. Policy #0 lag: (min: 0.0, avg: 0.4, max: 2.0) [2023-02-24 21:07:25,243][213332] Avg episode reward: [(0, '42.996')] [2023-02-24 21:07:26,052][213365] Updated weights for policy 0, policy_version 32856 (0.0009) [2023-02-24 21:07:29,123][213365] Updated weights for policy 0, policy_version 32866 (0.0009) [2023-02-24 21:07:30,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 134631424. Throughput: 0: 3375.5. Samples: 8653872. Policy #0 lag: (min: 0.0, avg: 0.4, max: 2.0) [2023-02-24 21:07:30,243][213332] Avg episode reward: [(0, '42.996')] [2023-02-24 21:07:30,877][213367] DAMAGECOUNT value on done: 387976.0 [2023-02-24 21:07:30,878][213367] Sum rewards: 34.027, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.338', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.028', 'weapon5': '0.130', 'AMMO4': '0.141', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.406', 'weapon2': '0.508', 'WEAPON3': '1.200', 'HITCOUNT': '2.280', 'weapon3': '2.676', 'DAMAGECOUNT': '10.062', 'FRAGCOUNT': '30.500'} [2023-02-24 21:07:31,041][213367] DAMAGECOUNT value on done: 394342.0 [2023-02-24 21:07:31,041][213367] Sum rewards: 44.427, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.793', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.046', 'AMMO3': '0.174', 'weapon2': '0.226', 'AMMO4': '0.232', 'weapon5': '0.316', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.644', 'WEAPON3': '1.000', 'HITCOUNT': '2.360', 'weapon3': '2.478', 'DAMAGECOUNT': '13.071', 'FRAGCOUNT': '37.500'} [2023-02-24 21:07:31,190][213367] DAMAGECOUNT value on done: 392032.0 [2023-02-24 21:07:31,191][213367] Sum rewards: 37.665, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.350', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon5': '0.100', 'AMMO3': '0.203', 'weapon2': '0.206', 'AMMO4': '0.221', 'WEAPON5': '0.350', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon4': '1.172', 'weapon3': '2.284', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '11.655', 'FRAGCOUNT': '35.000'} [2023-02-24 21:07:31,343][213367] DAMAGECOUNT value on done: 392331.0 [2023-02-24 21:07:31,344][213367] Sum rewards: 45.917, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.631', 'ARMOR': '0.004', 'AMMO2': '0.012', 'AMMO5': '0.015', 'AMMO4': '0.062', 'weapon5': '0.218', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'weapon4': '0.270', 'weapon2': '0.316', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.820', 'weapon3': '2.934', 'DAMAGECOUNT': '13.056', 'FRAGCOUNT': '41.500'} [2023-02-24 21:07:31,671][213372] DAMAGECOUNT value on done: 396755.0 [2023-02-24 21:07:31,671][213372] Sum rewards: 40.204, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.692', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon5': '0.110', 'AMMO3': '0.220', 'weapon2': '0.220', 'AMMO4': '0.247', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.838', 'WEAPON3': '1.350', 'HITCOUNT': '2.590', 'weapon3': '2.600', 'DAMAGECOUNT': '11.751', 'FRAGCOUNT': '38.000'} [2023-02-24 21:07:31,892][213372] DAMAGECOUNT value on done: 387303.0 [2023-02-24 21:07:31,893][213372] Sum rewards: 38.380, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.042', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.047', 'weapon7': '0.056', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.158', 'WEAPON7': '0.200', 'AMMO4': '0.235', 'weapon5': '0.290', 'weapon2': '0.472', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'weapon4': '1.028', 'weapon3': '1.758', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '10.728', 'FRAGCOUNT': '35.000'} [2023-02-24 21:07:31,993][213372] DAMAGECOUNT value on done: 398454.0 [2023-02-24 21:07:31,994][213372] Sum rewards: 43.499, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.111', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.035', 'AMMO3': '0.159', 'weapon5': '0.162', 'AMMO4': '0.175', 'weapon2': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.914', 'WEAPON3': '0.950', 'weapon3': '2.408', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '11.625', 'FRAGCOUNT': '38.000'} [2023-02-24 21:07:32,128][213365] Updated weights for policy 0, policy_version 32876 (0.0009) [2023-02-24 21:07:32,220][213372] DAMAGECOUNT value on done: 384674.0 [2023-02-24 21:07:32,220][213372] Sum rewards: 49.116, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.900', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon5': '0.108', 'AMMO3': '0.174', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.420', 'weapon2': '0.598', 'WEAPON3': '1.050', 'weapon3': '2.660', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.225', 'FRAGCOUNT': '43.000'} [2023-02-24 21:07:32,432][213366] DAMAGECOUNT value on done: 385251.0 [2023-02-24 21:07:32,432][213366] Sum rewards: 42.008, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.392', 'ARMOR': '0.004', 'AMMO2': '0.020', 'AMMO5': '0.023', 'AMMO4': '0.101', 'weapon5': '0.136', 'AMMO3': '0.198', 'weapon2': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon4': '0.784', 'WEAPON3': '1.150', 'weapon3': '2.456', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '10.662', 'FRAGCOUNT': '37.000'} [2023-02-24 21:07:32,732][213366] DAMAGECOUNT value on done: 396565.0 [2023-02-24 21:07:32,733][213366] Sum rewards: 46.306, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.712', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.054', 'AMMO4': '0.147', 'AMMO3': '0.196', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.316', 'weapon2': '0.344', 'WEAPON3': '1.150', 'HITCOUNT': '2.560', 'weapon3': '3.030', 'DAMAGECOUNT': '12.579', 'FRAGCOUNT': '42.000'} [2023-02-24 21:07:32,745][213366] DAMAGECOUNT value on done: 403315.0 [2023-02-24 21:07:32,745][213366] Sum rewards: 44.315, reward structure: {'DEATHCOUNT': '-12.750', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.090', 'WEAPON4': '0.150', 'weapon4': '0.154', 'AMMO3': '0.175', 'WEAPON5': '0.250', 'weapon2': '0.292', 'HEALTH': '0.340', 'WEAPON3': '1.000', 'HITCOUNT': '2.250', 'weapon3': '3.234', 'DAMAGECOUNT': '11.028', 'FRAGCOUNT': '38.000'} [2023-02-24 21:07:33,054][213366] DAMAGECOUNT value on done: 387323.0 [2023-02-24 21:07:33,055][213366] Sum rewards: 42.749, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.622', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.076', 'AMMO4': '0.110', 'AMMO3': '0.164', 'WEAPON4': '0.250', 'weapon4': '0.422', 'weapon2': '0.648', 'WEAPON3': '0.900', 'HITCOUNT': '2.570', 'weapon3': '2.684', 'DAMAGECOUNT': '11.223', 'FRAGCOUNT': '37.000'} [2023-02-24 21:07:33,111][213383] DAMAGECOUNT value on done: 387467.0 [2023-02-24 21:07:33,111][213383] Sum rewards: 50.741, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.075', 'weapon5': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.249', 'weapon2': '0.598', 'WEAPON3': '1.500', 'HITCOUNT': '2.860', 'weapon3': '3.048', 'DAMAGECOUNT': '13.029', 'FRAGCOUNT': '47.000'} [2023-02-24 21:07:33,309][213382] DAMAGECOUNT value on done: 391080.0 [2023-02-24 21:07:33,309][213382] Sum rewards: 43.824, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.274', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.028', 'weapon5': '0.120', 'AMMO4': '0.137', 'AMMO3': '0.230', 'weapon4': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON3': '1.450', 'HITCOUNT': '2.700', 'weapon3': '2.992', 'DAMAGECOUNT': '11.835', 'FRAGCOUNT': '42.000'} [2023-02-24 21:07:33,414][213369] DAMAGECOUNT value on done: 393746.0 [2023-02-24 21:07:33,414][213369] Sum rewards: 35.565, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.250', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'weapon7': '0.042', 'AMMO2': '0.048', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO3': '0.175', 'WEAPON7': '0.200', 'weapon5': '0.218', 'AMMO4': '0.238', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.536', 'weapon2': '0.600', 'WEAPON3': '0.950', 'HITCOUNT': '2.140', 'weapon3': '2.282', 'DAMAGECOUNT': '10.491', 'FRAGCOUNT': '32.000'} [2023-02-24 21:07:33,427][213383] DAMAGECOUNT value on done: 391798.0 [2023-02-24 21:07:33,427][213383] Sum rewards: 50.932, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.625', 'ARMOR': '0.004', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.049', 'weapon5': '0.164', 'AMMO4': '0.244', 'AMMO3': '0.272', 'weapon2': '0.338', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon4': '0.606', 'WEAPON3': '1.550', 'weapon3': '2.546', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '48.000'} [2023-02-24 21:07:33,508][213368] DAMAGECOUNT value on done: 386781.0 [2023-02-24 21:07:33,509][213368] Sum rewards: 38.404, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.352', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.069', 'weapon5': '0.222', 'AMMO3': '0.237', 'weapon4': '0.272', 'AMMO4': '0.343', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon2': '0.700', 'WEAPON3': '1.350', 'HITCOUNT': '2.250', 'weapon3': '2.460', 'DAMAGECOUNT': '11.679', 'FRAGCOUNT': '39.000'} [2023-02-24 21:07:33,627][213382] DAMAGECOUNT value on done: 392847.0 [2023-02-24 21:07:33,628][213382] Sum rewards: 30.757, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.984', 'AMMO5': '0.021', 'AMMO2': '0.035', 'weapon5': '0.130', 'AMMO4': '0.174', 'AMMO3': '0.197', 'weapon2': '0.426', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.658', 'WEAPON3': '1.150', 'weapon3': '2.368', 'HITCOUNT': '2.400', 'DAMAGECOUNT': '9.981', 'FRAGCOUNT': '30.000'} [2023-02-24 21:07:33,725][213369] DAMAGECOUNT value on done: 390660.0 [2023-02-24 21:07:33,725][213369] Sum rewards: 42.703, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.405', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.110', 'weapon4': '0.192', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.150', 'HITCOUNT': '2.490', 'weapon3': '3.128', 'DAMAGECOUNT': '11.352', 'FRAGCOUNT': '38.000'} [2023-02-24 21:07:33,831][213368] DAMAGECOUNT value on done: 392175.0 [2023-02-24 21:07:33,832][213368] Sum rewards: 37.177, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.652', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'AMMO4': '0.163', 'AMMO3': '0.186', 'weapon5': '0.224', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.500', 'weapon4': '0.912', 'WEAPON3': '1.050', 'weapon3': '1.994', 'HITCOUNT': '2.350', 'DAMAGECOUNT': '10.440', 'FRAGCOUNT': '33.000'} [2023-02-24 21:07:33,945][213382] DAMAGECOUNT value on done: 381261.0 [2023-02-24 21:07:33,945][213382] Sum rewards: 47.485, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.778', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.144', 'weapon2': '0.200', 'AMMO4': '0.202', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '1.126', 'WEAPON3': '1.200', 'weapon3': '2.226', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.077', 'FRAGCOUNT': '43.000'} [2023-02-24 21:07:34,042][213369] DAMAGECOUNT value on done: 390515.0 [2023-02-24 21:07:34,042][213369] Sum rewards: 38.945, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.340', 'AMMO5': '0.011', 'AMMO2': '0.037', 'AMMO4': '0.183', 'AMMO3': '0.192', 'weapon5': '0.252', 'weapon2': '0.344', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.472', 'WEAPON3': '1.100', 'HITCOUNT': '2.470', 'weapon3': '2.688', 'DAMAGECOUNT': '11.685', 'FRAGCOUNT': '36.000'} [2023-02-24 21:07:34,059][213383] DAMAGECOUNT value on done: 391028.0 [2023-02-24 21:07:34,059][213383] Sum rewards: 50.479, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.964', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.044', 'weapon5': '0.082', 'AMMO4': '0.098', 'weapon2': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.285', 'WEAPON3': '1.650', 'HITCOUNT': '3.000', 'weapon3': '3.492', 'DAMAGECOUNT': '13.698', 'FRAGCOUNT': '47.000'} [2023-02-24 21:07:34,097][213368] DAMAGECOUNT value on done: 389797.0 [2023-02-24 21:07:34,097][213368] Sum rewards: 49.070, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.202', 'AMMO5': '0.009', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'weapon5': '0.104', 'weapon4': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.370', 'WEAPON3': '1.300', 'HITCOUNT': '2.790', 'weapon3': '3.162', 'DAMAGECOUNT': '12.780', 'FRAGCOUNT': '42.500'} [2023-02-24 21:07:34,256][213382] DAMAGECOUNT value on done: 390078.0 [2023-02-24 21:07:34,256][213382] Sum rewards: 46.583, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.390', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.108', 'AMMO3': '0.140', 'weapon4': '0.150', 'AMMO4': '0.151', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.630', 'WEAPON3': '0.950', 'HITCOUNT': '2.430', 'weapon3': '2.934', 'DAMAGECOUNT': '11.790', 'FRAGCOUNT': '41.000'} [2023-02-24 21:07:34,325][213384] DAMAGECOUNT value on done: 395912.0 [2023-02-24 21:07:34,325][213384] Sum rewards: 47.185, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.915', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'AMMO3': '0.128', 'WEAPON4': '0.200', 'weapon4': '0.260', 'ARMOR': '0.457', 'weapon2': '0.802', 'WEAPON3': '0.850', 'HITCOUNT': '2.830', 'weapon3': '2.850', 'DAMAGECOUNT': '12.285', 'FRAGCOUNT': '38.000'} [2023-02-24 21:07:34,349][213369] DAMAGECOUNT value on done: 380524.0 [2023-02-24 21:07:34,349][213369] Sum rewards: 50.266, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.686', 'AMMO5': '0.011', 'AMMO2': '0.018', 'weapon4': '0.032', 'AMMO4': '0.088', 'weapon5': '0.104', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.250', 'HITCOUNT': '2.750', 'weapon3': '3.390', 'DAMAGECOUNT': '14.022', 'FRAGCOUNT': '43.000'} [2023-02-24 21:07:34,369][213383] DAMAGECOUNT value on done: 384378.0 [2023-02-24 21:07:34,369][213383] Sum rewards: 43.011, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.050', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.020', 'weapon5': '0.058', 'AMMO4': '0.099', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.350', 'weapon4': '0.492', 'WEAPON3': '1.150', 'HITCOUNT': '2.730', 'weapon3': '2.842', 'DAMAGECOUNT': '12.105', 'FRAGCOUNT': '38.000'} [2023-02-24 21:07:34,409][213368] DAMAGECOUNT value on done: 384371.0 [2023-02-24 21:07:34,409][213368] Sum rewards: 44.106, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.274', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.080', 'weapon4': '0.120', 'AMMO4': '0.128', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.852', 'WEAPON3': '1.150', 'HITCOUNT': '2.690', 'weapon3': '2.746', 'DAMAGECOUNT': '12.138', 'FRAGCOUNT': '39.000'} [2023-02-24 21:07:34,633][213384] DAMAGECOUNT value on done: 377990.0 [2023-02-24 21:07:34,633][213384] Sum rewards: 51.821, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.923', 'AMMO5': '0.019', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.096', 'weapon4': '0.096', 'AMMO3': '0.158', 'weapon5': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.500', 'weapon2': '0.746', 'WEAPON3': '1.000', 'HITCOUNT': '2.570', 'weapon3': '2.718', 'DAMAGECOUNT': '12.930', 'FRAGCOUNT': '43.000'} [2023-02-24 21:07:34,955][213384] DAMAGECOUNT value on done: 394823.0 [2023-02-24 21:07:34,956][213384] Sum rewards: 46.815, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.944', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.046', 'weapon4': '0.090', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.276', 'WEAPON3': '1.300', 'HITCOUNT': '2.660', 'weapon3': '3.418', 'DAMAGECOUNT': '11.820', 'FRAGCOUNT': '42.000'} [2023-02-24 21:07:35,217][213365] Updated weights for policy 0, policy_version 32886 (0.0009) [2023-02-24 21:07:35,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13509.9). Total num frames: 134701056. Throughput: 0: 3375.0. Samples: 8664108. Policy #0 lag: (min: 0.0, avg: 0.4, max: 2.0) [2023-02-24 21:07:35,243][213332] Avg episode reward: [(0, '43.461')] [2023-02-24 21:07:35,247][213352] Saving new best policy, reward=43.461! [2023-02-24 21:07:35,251][213384] DAMAGECOUNT value on done: 397035.0 [2023-02-24 21:07:35,252][213384] Sum rewards: 40.027, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.732', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO4': '0.183', 'AMMO3': '0.202', 'weapon5': '0.302', 'weapon2': '0.312', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.694', 'WEAPON3': '1.250', 'weapon3': '2.346', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '12.444', 'FRAGCOUNT': '36.500'} [2023-02-24 21:07:38,210][213365] Updated weights for policy 0, policy_version 32896 (0.0009) [2023-02-24 21:07:40,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 134766592. Throughput: 0: 3381.2. Samples: 8684382. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:07:40,243][213332] Avg episode reward: [(0, '43.423')] [2023-02-24 21:07:41,241][213365] Updated weights for policy 0, policy_version 32906 (0.0009) [2023-02-24 21:07:44,306][213365] Updated weights for policy 0, policy_version 32916 (0.0009) [2023-02-24 21:07:45,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 134836224. Throughput: 0: 3379.1. Samples: 8704496. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:07:45,243][213332] Avg episode reward: [(0, '43.423')] [2023-02-24 21:07:47,269][213365] Updated weights for policy 0, policy_version 32926 (0.0009) [2023-02-24 21:07:50,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 134901760. Throughput: 0: 3378.1. Samples: 8714804. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:07:50,244][213332] Avg episode reward: [(0, '43.423')] [2023-02-24 21:07:50,328][213365] Updated weights for policy 0, policy_version 32936 (0.0009) [2023-02-24 21:07:50,703][213367] DAMAGECOUNT value on done: 390918.0 [2023-02-24 21:07:50,704][213367] Sum rewards: 26.948, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.667', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'weapon5': '0.104', 'AMMO4': '0.156', 'AMMO3': '0.193', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.538', 'weapon4': '0.552', 'WEAPON3': '1.100', 'HITCOUNT': '2.100', 'weapon3': '2.580', 'DAMAGECOUNT': '8.826', 'FRAGCOUNT': '27.000'} [2023-02-24 21:07:50,824][213367] DAMAGECOUNT value on done: 397545.0 [2023-02-24 21:07:50,825][213367] Sum rewards: 30.645, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.175', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.148', 'AMMO4': '0.165', 'AMMO3': '0.169', 'WEAPON5': '0.250', 'weapon4': '0.256', 'WEAPON4': '0.400', 'weapon2': '0.628', 'WEAPON3': '1.100', 'HITCOUNT': '2.030', 'weapon3': '2.520', 'DAMAGECOUNT': '9.609', 'FRAGCOUNT': '30.000'} [2023-02-24 21:07:51,010][213367] DAMAGECOUNT value on done: 395773.0 [2023-02-24 21:07:51,011][213367] Sum rewards: 41.988, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.102', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.072', 'AMMO4': '0.109', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.246', 'weapon2': '0.490', 'WEAPON3': '1.050', 'HITCOUNT': '2.550', 'weapon3': '2.988', 'DAMAGECOUNT': '11.223', 'FRAGCOUNT': '39.500'} [2023-02-24 21:07:51,137][213367] DAMAGECOUNT value on done: 397010.0 [2023-02-24 21:07:51,138][213367] Sum rewards: 55.191, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO2': '0.008', 'AMMO4': '0.041', 'AMMO3': '0.177', 'HEALTH': '0.370', 'weapon2': '0.814', 'WEAPON3': '1.000', 'HITCOUNT': '2.940', 'weapon3': '3.054', 'DAMAGECOUNT': '14.037', 'FRAGCOUNT': '44.000'} [2023-02-24 21:07:51,558][213372] DAMAGECOUNT value on done: 400655.0 [2023-02-24 21:07:51,559][213372] Sum rewards: 43.175, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.862', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.040', 'weapon5': '0.118', 'AMMO3': '0.159', 'AMMO4': '0.202', 'weapon2': '0.334', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.566', 'WEAPON3': '1.100', 'weapon3': '2.690', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '11.700', 'FRAGCOUNT': '39.000'} [2023-02-24 21:07:51,759][213372] DAMAGECOUNT value on done: 390855.0 [2023-02-24 21:07:51,760][213372] Sum rewards: 37.430, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.620', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.042', 'AMMO3': '0.114', 'weapon5': '0.194', 'AMMO4': '0.209', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.498', 'weapon4': '0.512', 'WEAPON3': '0.750', 'weapon3': '2.320', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '10.656', 'FRAGCOUNT': '31.000'} [2023-02-24 21:07:51,867][213372] DAMAGECOUNT value on done: 402818.0 [2023-02-24 21:07:51,867][213372] Sum rewards: 41.266, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.524', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.038', 'weapon5': '0.170', 'AMMO4': '0.191', 'AMMO3': '0.202', 'weapon2': '0.276', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '1.046', 'WEAPON3': '1.200', 'weapon3': '2.206', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.062', 'FRAGCOUNT': '37.000'} [2023-02-24 21:07:52,076][213372] DAMAGECOUNT value on done: 388098.0 [2023-02-24 21:07:52,077][213372] Sum rewards: 36.935, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.462', 'AMMO5': '0.024', 'AMMO2': '0.044', 'weapon5': '0.174', 'AMMO4': '0.218', 'AMMO3': '0.223', 'weapon4': '0.272', 'weapon2': '0.448', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.190', 'weapon3': '2.782', 'DAMAGECOUNT': '10.272', 'FRAGCOUNT': '37.000'} [2023-02-24 21:07:52,300][213366] DAMAGECOUNT value on done: 388560.0 [2023-02-24 21:07:52,301][213366] Sum rewards: 38.955, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.832', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon4': '0.428', 'weapon2': '0.554', 'WEAPON3': '1.050', 'HITCOUNT': '2.400', 'weapon3': '2.794', 'DAMAGECOUNT': '9.927', 'FRAGCOUNT': '35.000'} [2023-02-24 21:07:52,619][213366] DAMAGECOUNT value on done: 400824.0 [2023-02-24 21:07:52,620][213366] Sum rewards: 45.268, reward structure: {'DEATHCOUNT': '-16.500', 'AMMO5': '0.012', 'AMMO2': '0.037', 'HEALTH': '0.152', 'AMMO4': '0.187', 'WEAPON5': '0.200', 'weapon2': '0.206', 'weapon5': '0.208', 'AMMO3': '0.218', 'WEAPON4': '0.350', 'weapon4': '0.562', 'WEAPON3': '1.150', 'weapon3': '2.758', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.777', 'FRAGCOUNT': '40.000'} [2023-02-24 21:07:52,628][213366] DAMAGECOUNT value on done: 407266.0 [2023-02-24 21:07:52,629][213366] Sum rewards: 37.629, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.598', 'ARMOR': '0.008', 'AMMO5': '0.035', 'AMMO2': '0.076', 'AMMO3': '0.183', 'weapon5': '0.250', 'AMMO4': '0.378', 'weapon2': '0.458', 'WEAPON5': '0.650', 'WEAPON4': '0.900', 'weapon4': '1.034', 'WEAPON3': '1.050', 'weapon3': '1.822', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '11.853', 'FRAGCOUNT': '36.500'} [2023-02-24 21:07:52,941][213366] DAMAGECOUNT value on done: 390929.0 [2023-02-24 21:07:52,942][213366] Sum rewards: 41.903, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.368', 'ARMOR': '0.008', 'AMMO2': '0.019', 'AMMO5': '0.022', 'AMMO4': '0.094', 'weapon5': '0.132', 'AMMO3': '0.172', 'weapon2': '0.306', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'weapon4': '0.782', 'WEAPON3': '1.050', 'HITCOUNT': '2.310', 'weapon3': '2.358', 'DAMAGECOUNT': '10.818', 'FRAGCOUNT': '38.000'} [2023-02-24 21:07:53,073][213383] DAMAGECOUNT value on done: 392057.0 [2023-02-24 21:07:53,074][213383] Sum rewards: 55.388, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.772', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'weapon5': '0.022', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'weapon2': '0.530', 'WEAPON3': '1.250', 'HITCOUNT': '3.130', 'weapon3': '3.220', 'DAMAGECOUNT': '13.770', 'FRAGCOUNT': '46.000'} [2023-02-24 21:07:53,207][213382] DAMAGECOUNT value on done: 394934.0 [2023-02-24 21:07:53,208][213382] Sum rewards: 43.123, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.350', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.182', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.304', 'weapon2': '0.362', 'WEAPON3': '1.200', 'HITCOUNT': '2.740', 'weapon3': '2.964', 'DAMAGECOUNT': '11.562', 'FRAGCOUNT': '38.000'} [2023-02-24 21:07:53,338][213369] DAMAGECOUNT value on done: 397937.0 [2023-02-24 21:07:53,339][213369] Sum rewards: 44.107, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.510', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.108', 'weapon7': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'AMMO3': '0.233', 'weapon2': '0.298', 'WEAPON4': '0.300', 'weapon4': '0.462', 'WEAPON3': '1.300', 'weapon3': '2.778', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.573', 'FRAGCOUNT': '39.500'} [2023-02-24 21:07:53,368][213365] Updated weights for policy 0, policy_version 32946 (0.0009) [2023-02-24 21:07:53,371][213368] DAMAGECOUNT value on done: 390793.0 [2023-02-24 21:07:53,372][213368] Sum rewards: 46.215, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.937', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.070', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.164', 'weapon4': '0.232', 'weapon2': '0.922', 'WEAPON3': '1.000', 'weapon3': '2.614', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.036', 'FRAGCOUNT': '39.000'} [2023-02-24 21:07:53,390][213383] DAMAGECOUNT value on done: 395542.0 [2023-02-24 21:07:53,391][213383] Sum rewards: 38.580, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.596', 'ARMOR': '0.012', 'AMMO5': '0.019', 'AMMO2': '0.042', 'weapon7': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.149', 'weapon5': '0.178', 'AMMO4': '0.211', 'WEAPON5': '0.500', 'weapon2': '0.520', 'WEAPON4': '0.550', 'WEAPON3': '0.850', 'weapon4': '0.854', 'weapon3': '2.080', 'HITCOUNT': '2.330', 'DAMAGECOUNT': '11.232', 'FRAGCOUNT': '34.500'} [2023-02-24 21:07:53,526][213382] DAMAGECOUNT value on done: 396404.0 [2023-02-24 21:07:53,527][213382] Sum rewards: 36.063, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.530', 'AMMO5': '0.014', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon5': '0.168', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.354', 'weapon2': '0.462', 'WEAPON3': '1.150', 'HITCOUNT': '2.310', 'weapon3': '2.748', 'DAMAGECOUNT': '10.671', 'FRAGCOUNT': '33.000'} [2023-02-24 21:07:53,655][213369] DAMAGECOUNT value on done: 394855.0 [2023-02-24 21:07:53,655][213369] Sum rewards: 41.369, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.427', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.294', 'weapon5': '0.304', 'weapon2': '0.346', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.330', 'weapon3': '2.714', 'DAMAGECOUNT': '12.585', 'FRAGCOUNT': '37.000'} [2023-02-24 21:07:53,686][213368] DAMAGECOUNT value on done: 396009.0 [2023-02-24 21:07:53,687][213368] Sum rewards: 45.971, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.497', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO4': '0.121', 'AMMO3': '0.148', 'weapon5': '0.176', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.390', 'weapon2': '0.406', 'WEAPON3': '1.000', 'HITCOUNT': '2.570', 'weapon3': '2.698', 'DAMAGECOUNT': '11.502', 'FRAGCOUNT': '40.000'} [2023-02-24 21:07:53,841][213382] DAMAGECOUNT value on done: 384843.0 [2023-02-24 21:07:53,841][213382] Sum rewards: 30.750, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.074', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO4': '0.197', 'AMMO3': '0.260', 'weapon2': '0.272', 'weapon5': '0.338', 'weapon4': '0.338', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '2.130', 'weapon3': '2.684', 'DAMAGECOUNT': '10.746', 'FRAGCOUNT': '31.000'} [2023-02-24 21:07:53,942][213368] DAMAGECOUNT value on done: 393158.0 [2023-02-24 21:07:53,942][213368] Sum rewards: 37.615, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.091', 'WEAPON1': '0.010', 'AMMO5': '0.027', 'AMMO2': '0.062', 'AMMO3': '0.133', 'weapon5': '0.156', 'weapon2': '0.288', 'AMMO4': '0.311', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon4': '1.078', 'weapon3': '1.938', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '10.083', 'FRAGCOUNT': '32.000'} [2023-02-24 21:07:53,959][213369] DAMAGECOUNT value on done: 394942.0 [2023-02-24 21:07:53,959][213369] Sum rewards: 46.405, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.705', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO4': '0.208', 'weapon2': '0.252', 'AMMO3': '0.257', 'WEAPON4': '0.350', 'weapon4': '0.692', 'WEAPON3': '1.500', 'weapon3': '2.658', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.281', 'FRAGCOUNT': '44.000'} [2023-02-24 21:07:54,025][213383] DAMAGECOUNT value on done: 395680.0 [2023-02-24 21:07:54,025][213383] Sum rewards: 54.762, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.910', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.100', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.256', 'WEAPON4': '0.350', 'weapon4': '0.464', 'WEAPON3': '1.250', 'weapon3': '2.970', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.956', 'FRAGCOUNT': '49.000'} [2023-02-24 21:07:54,159][213382] DAMAGECOUNT value on done: 393336.0 [2023-02-24 21:07:54,159][213382] Sum rewards: 32.312, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.588', 'AMMO5': '0.019', 'AMMO2': '0.073', 'AMMO3': '0.186', 'weapon5': '0.240', 'AMMO4': '0.364', 'WEAPON5': '0.400', 'weapon2': '0.464', 'WEAPON4': '0.600', 'weapon4': '0.780', 'WEAPON3': '1.100', 'HITCOUNT': '2.150', 'weapon3': '2.250', 'DAMAGECOUNT': '9.774', 'FRAGCOUNT': '32.000'} [2023-02-24 21:07:54,205][213384] DAMAGECOUNT value on done: 399943.0 [2023-02-24 21:07:54,205][213384] Sum rewards: 44.636, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.410', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.138', 'AMMO3': '0.194', 'weapon2': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.714', 'WEAPON3': '1.250', 'weapon3': '2.574', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.084', 'FRAGCOUNT': '39.000'} [2023-02-24 21:07:54,240][213368] DAMAGECOUNT value on done: 388902.0 [2023-02-24 21:07:54,240][213368] Sum rewards: 55.216, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.995', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.011', 'WEAPON1': '0.020', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO3': '0.159', 'weapon2': '0.326', 'WEAPON3': '1.150', 'HITCOUNT': '3.100', 'weapon3': '3.384', 'DAMAGECOUNT': '13.593', 'FRAGCOUNT': '45.000'} [2023-02-24 21:07:54,266][213369] DAMAGECOUNT value on done: 384503.0 [2023-02-24 21:07:54,267][213369] Sum rewards: 44.966, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.338', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.082', 'AMMO4': '0.139', 'AMMO3': '0.164', 'weapon2': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.638', 'WEAPON3': '0.950', 'weapon3': '2.594', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '11.937', 'FRAGCOUNT': '38.000'} [2023-02-24 21:07:54,338][213383] DAMAGECOUNT value on done: 388513.0 [2023-02-24 21:07:54,339][213383] Sum rewards: 45.150, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.400', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'weapon4': '0.062', 'weapon5': '0.080', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.306', 'WEAPON3': '1.300', 'HITCOUNT': '2.640', 'weapon3': '3.344', 'DAMAGECOUNT': '12.405', 'FRAGCOUNT': '40.000'} [2023-02-24 21:07:54,519][213384] DAMAGECOUNT value on done: 381790.0 [2023-02-24 21:07:54,520][213384] Sum rewards: 40.813, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.574', 'ARMOR': '0.012', 'AMMO5': '0.016', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.177', 'weapon5': '0.190', 'weapon2': '0.322', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.710', 'WEAPON3': '1.000', 'weapon3': '2.310', 'HITCOUNT': '2.360', 'DAMAGECOUNT': '11.400', 'FRAGCOUNT': '34.000'} [2023-02-24 21:07:54,844][213384] DAMAGECOUNT value on done: 398622.0 [2023-02-24 21:07:54,844][213384] Sum rewards: 44.294, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.310', 'AMMO5': '0.016', 'AMMO2': '0.018', 'weapon5': '0.084', 'AMMO4': '0.090', 'AMMO3': '0.139', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.322', 'weapon2': '0.654', 'WEAPON3': '0.950', 'HITCOUNT': '2.700', 'weapon3': '2.734', 'DAMAGECOUNT': '11.397', 'FRAGCOUNT': '37.500'} [2023-02-24 21:07:55,136][213384] DAMAGECOUNT value on done: 400381.0 [2023-02-24 21:07:55,137][213384] Sum rewards: 39.896, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.000', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.024', 'weapon5': '0.116', 'AMMO4': '0.122', 'weapon4': '0.136', 'weapon2': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.262', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '2.250', 'weapon3': '3.234', 'DAMAGECOUNT': '10.038', 'FRAGCOUNT': '40.000'} [2023-02-24 21:07:55,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13496.0). Total num frames: 134971392. Throughput: 0: 3378.6. Samples: 8735014. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:07:55,243][213332] Avg episode reward: [(0, '43.027')] [2023-02-24 21:07:56,387][213365] Updated weights for policy 0, policy_version 32956 (0.0009) [2023-02-24 21:07:59,442][213365] Updated weights for policy 0, policy_version 32966 (0.0009) [2023-02-24 21:08:00,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 135036928. Throughput: 0: 3383.0. Samples: 8755248. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 21:08:00,243][213332] Avg episode reward: [(0, '43.027')] [2023-02-24 21:08:02,422][213365] Updated weights for policy 0, policy_version 32976 (0.0009) [2023-02-24 21:08:05,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13509.9). Total num frames: 135106560. Throughput: 0: 3382.4. Samples: 8765548. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 21:08:05,243][213332] Avg episode reward: [(0, '43.027')] [2023-02-24 21:08:05,470][213365] Updated weights for policy 0, policy_version 32986 (0.0009) [2023-02-24 21:08:08,468][213365] Updated weights for policy 0, policy_version 32996 (0.0009) [2023-02-24 21:08:10,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 135172096. Throughput: 0: 3381.1. Samples: 8785810. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 21:08:10,244][213332] Avg episode reward: [(0, '43.027')] [2023-02-24 21:08:10,497][213367] DAMAGECOUNT value on done: 394962.0 [2023-02-24 21:08:10,497][213367] Sum rewards: 43.940, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.446', 'ARMOR': '0.004', 'AMMO5': '0.027', 'AMMO2': '0.068', 'AMMO3': '0.155', 'weapon2': '0.308', 'weapon5': '0.320', 'AMMO4': '0.340', 'WEAPON4': '0.650', 'WEAPON5': '0.700', 'weapon4': '0.776', 'WEAPON3': '1.000', 'weapon3': '2.226', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.132', 'FRAGCOUNT': '40.000'} [2023-02-24 21:08:10,638][213367] DAMAGECOUNT value on done: 401480.0 [2023-02-24 21:08:10,638][213367] Sum rewards: 39.921, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.717', 'ARMOR': '0.004', 'AMMO2': '0.015', 'AMMO5': '0.017', 'AMMO4': '0.075', 'weapon5': '0.192', 'WEAPON4': '0.250', 'AMMO3': '0.263', 'WEAPON5': '0.350', 'weapon4': '0.438', 'weapon2': '0.496', 'WEAPON3': '1.500', 'weapon3': '2.432', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '11.805', 'FRAGCOUNT': '38.000'} [2023-02-24 21:08:10,799][213367] DAMAGECOUNT value on done: 399600.0 [2023-02-24 21:08:10,800][213367] Sum rewards: 37.328, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.120', 'ARMOR': '0.008', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.176', 'AMMO3': '0.219', 'weapon2': '0.328', 'WEAPON4': '0.400', 'weapon4': '0.490', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '2.580', 'weapon3': '2.708', 'DAMAGECOUNT': '11.481', 'FRAGCOUNT': '35.000'} [2023-02-24 21:08:10,940][213367] DAMAGECOUNT value on done: 400539.0 [2023-02-24 21:08:10,941][213367] Sum rewards: 35.947, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.784', 'AMMO2': '0.014', 'AMMO5': '0.019', 'AMMO4': '0.068', 'WEAPON4': '0.150', 'weapon5': '0.158', 'AMMO3': '0.241', 'weapon4': '0.284', 'weapon2': '0.322', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '2.280', 'weapon3': '2.958', 'DAMAGECOUNT': '10.587', 'FRAGCOUNT': '34.000'} [2023-02-24 21:08:11,493][213365] Updated weights for policy 0, policy_version 33006 (0.0009) [2023-02-24 21:08:11,512][213372] DAMAGECOUNT value on done: 404567.0 [2023-02-24 21:08:11,512][213372] Sum rewards: 41.321, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.596', 'AMMO5': '0.020', 'AMMO2': '0.038', 'AMMO3': '0.170', 'weapon5': '0.172', 'AMMO4': '0.189', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.392', 'weapon4': '0.470', 'WEAPON3': '1.000', 'HITCOUNT': '2.660', 'weapon3': '2.720', 'DAMAGECOUNT': '11.736', 'FRAGCOUNT': '36.000'} [2023-02-24 21:08:11,692][213372] DAMAGECOUNT value on done: 395378.0 [2023-02-24 21:08:11,693][213372] Sum rewards: 50.385, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.540', 'AMMO5': '0.007', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.111', 'weapon2': '0.178', 'WEAPON4': '0.200', 'AMMO3': '0.329', 'weapon4': '0.516', 'WEAPON3': '1.850', 'HITCOUNT': '2.820', 'weapon3': '2.968', 'DAMAGECOUNT': '13.569', 'FRAGCOUNT': '49.000'} [2023-02-24 21:08:11,830][213372] DAMAGECOUNT value on done: 406785.0 [2023-02-24 21:08:11,831][213372] Sum rewards: 45.863, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.014', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO3': '0.172', 'AMMO4': '0.181', 'WEAPON5': '0.250', 'weapon5': '0.266', 'WEAPON4': '0.300', 'weapon2': '0.320', 'weapon4': '0.638', 'WEAPON3': '1.000', 'weapon3': '2.284', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '11.901', 'FRAGCOUNT': '40.000'} [2023-02-24 21:08:12,014][213372] DAMAGECOUNT value on done: 392132.0 [2023-02-24 21:08:12,015][213372] Sum rewards: 50.514, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.720', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon7': '0.082', 'weapon5': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.194', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.472', 'weapon4': '0.894', 'WEAPON3': '1.250', 'weapon3': '2.206', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.102', 'FRAGCOUNT': '45.000'} [2023-02-24 21:08:12,194][213366] DAMAGECOUNT value on done: 391966.0 [2023-02-24 21:08:12,194][213366] Sum rewards: 33.230, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.190', 'ARMOR': '0.008', 'AMMO5': '0.030', 'AMMO2': '0.071', 'AMMO3': '0.154', 'weapon5': '0.188', 'weapon2': '0.242', 'AMMO4': '0.355', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '0.850', 'weapon4': '1.422', 'weapon3': '1.752', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '10.218', 'FRAGCOUNT': '31.000'} [2023-02-24 21:08:12,502][213366] DAMAGECOUNT value on done: 404042.0 [2023-02-24 21:08:12,503][213366] Sum rewards: 31.330, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.838', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.204', 'AMMO3': '0.231', 'weapon4': '0.562', 'WEAPON3': '1.350', 'HITCOUNT': '2.200', 'weapon3': '2.894', 'DAMAGECOUNT': '9.654', 'FRAGCOUNT': '29.000'} [2023-02-24 21:08:12,512][213366] DAMAGECOUNT value on done: 411320.0 [2023-02-24 21:08:12,512][213366] Sum rewards: 47.516, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.174', 'AMMO5': '0.015', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.120', 'AMMO3': '0.139', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.668', 'WEAPON3': '0.800', 'weapon4': '0.818', 'weapon3': '2.010', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.162', 'FRAGCOUNT': '41.000'} [2023-02-24 21:08:12,825][213366] DAMAGECOUNT value on done: 395284.0 [2023-02-24 21:08:12,826][213366] Sum rewards: 48.667, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.290', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.134', 'weapon7': '0.168', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'AMMO3': '0.204', 'weapon2': '0.272', 'WEAPON4': '0.400', 'weapon4': '0.528', 'WEAPON3': '1.150', 'weapon3': '2.578', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.065', 'FRAGCOUNT': '41.000'} [2023-02-24 21:08:12,940][213383] DAMAGECOUNT value on done: 395737.0 [2023-02-24 21:08:12,941][213383] Sum rewards: 36.294, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.724', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.026', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.112', 'weapon5': '0.118', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'weapon2': '0.208', 'AMMO3': '0.243', 'WEAPON4': '0.350', 'weapon4': '0.620', 'WEAPON3': '1.400', 'HITCOUNT': '2.460', 'weapon3': '2.590', 'DAMAGECOUNT': '11.040', 'FRAGCOUNT': '34.000'} [2023-02-24 21:08:13,119][213369] DAMAGECOUNT value on done: 402341.0 [2023-02-24 21:08:13,120][213369] Sum rewards: 53.789, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.585', 'AMMO5': '0.017', 'AMMO2': '0.036', 'AMMO4': '0.180', 'AMMO3': '0.192', 'weapon5': '0.202', 'WEAPON4': '0.300', 'weapon2': '0.308', 'weapon4': '0.366', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.760', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.212', 'FRAGCOUNT': '47.000'} [2023-02-24 21:08:13,124][213382] DAMAGECOUNT value on done: 399262.0 [2023-02-24 21:08:13,124][213382] Sum rewards: 46.642, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.112', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.116', 'AMMO4': '0.151', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'weapon4': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.524', 'WEAPON3': '1.150', 'HITCOUNT': '2.670', 'weapon3': '2.844', 'DAMAGECOUNT': '12.984', 'FRAGCOUNT': '42.000'} [2023-02-24 21:08:13,253][213368] DAMAGECOUNT value on done: 394390.0 [2023-02-24 21:08:13,253][213368] Sum rewards: 36.922, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.720', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.170', 'weapon2': '0.216', 'AMMO4': '0.222', 'AMMO3': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.758', 'WEAPON3': '1.400', 'weapon3': '2.424', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '10.791', 'FRAGCOUNT': '36.000'} [2023-02-24 21:08:13,256][213383] DAMAGECOUNT value on done: 398422.0 [2023-02-24 21:08:13,257][213383] Sum rewards: 27.526, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.354', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.128', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon2': '0.226', 'weapon4': '0.468', 'WEAPON3': '1.050', 'HITCOUNT': '1.870', 'weapon3': '3.032', 'DAMAGECOUNT': '8.640', 'FRAGCOUNT': '26.000'} [2023-02-24 21:08:13,438][213369] DAMAGECOUNT value on done: 399440.0 [2023-02-24 21:08:13,439][213369] Sum rewards: 50.599, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.308', 'AMMO5': '0.019', 'AMMO2': '0.025', 'weapon5': '0.112', 'AMMO4': '0.123', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'weapon4': '0.322', 'WEAPON5': '0.400', 'weapon2': '0.414', 'WEAPON3': '1.350', 'weapon3': '2.908', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.755', 'FRAGCOUNT': '45.000'} [2023-02-24 21:08:13,447][213382] DAMAGECOUNT value on done: 400604.0 [2023-02-24 21:08:13,447][213382] Sum rewards: 49.583, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.188', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.106', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.220', 'WEAPON4': '0.350', 'weapon4': '0.612', 'WEAPON3': '1.200', 'weapon3': '2.836', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '12.378', 'FRAGCOUNT': '44.000'} [2023-02-24 21:08:13,573][213368] DAMAGECOUNT value on done: 398886.0 [2023-02-24 21:08:13,573][213368] Sum rewards: 27.983, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.125', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'weapon7': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.158', 'AMMO3': '0.181', 'weapon5': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'weapon2': '0.518', 'weapon4': '0.564', 'WEAPON3': '1.150', 'HITCOUNT': '2.030', 'weapon3': '2.372', 'DAMAGECOUNT': '8.631', 'FRAGCOUNT': '27.000'} [2023-02-24 21:08:13,752][213369] DAMAGECOUNT value on done: 399599.0 [2023-02-24 21:08:13,753][213369] Sum rewards: 54.100, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.405', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.142', 'AMMO3': '0.146', 'AMMO4': '0.167', 'weapon2': '0.228', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.536', 'WEAPON3': '0.850', 'HITCOUNT': '2.800', 'weapon3': '2.868', 'DAMAGECOUNT': '13.971', 'FRAGCOUNT': '45.000'} [2023-02-24 21:08:13,759][213382] DAMAGECOUNT value on done: 388035.0 [2023-02-24 21:08:13,759][213382] Sum rewards: 32.857, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.120', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.058', 'AMMO4': '0.146', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.348', 'weapon4': '0.596', 'WEAPON3': '1.100', 'HITCOUNT': '2.120', 'weapon3': '2.800', 'DAMAGECOUNT': '9.576', 'FRAGCOUNT': '30.000'} [2023-02-24 21:08:13,841][213368] DAMAGECOUNT value on done: 396754.0 [2023-02-24 21:08:13,842][213368] Sum rewards: 39.443, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.285', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon5': '0.146', 'weapon2': '0.154', 'AMMO3': '0.185', 'AMMO4': '0.225', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'ARMOR': '0.404', 'weapon4': '0.778', 'WEAPON3': '1.150', 'HITCOUNT': '2.350', 'weapon3': '2.476', 'DAMAGECOUNT': '10.548', 'FRAGCOUNT': '36.000'} [2023-02-24 21:08:13,929][213383] DAMAGECOUNT value on done: 399374.0 [2023-02-24 21:08:13,930][213383] Sum rewards: 43.406, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.815', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.160', 'AMMO3': '0.208', 'weapon4': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.584', 'WEAPON3': '1.300', 'HITCOUNT': '2.610', 'weapon3': '2.896', 'DAMAGECOUNT': '11.082', 'FRAGCOUNT': '41.000'} [2023-02-24 21:08:14,035][213384] DAMAGECOUNT value on done: 403653.0 [2023-02-24 21:08:14,036][213384] Sum rewards: 38.353, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.616', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.054', 'AMMO4': '0.086', 'AMMO3': '0.210', 'weapon5': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.712', 'WEAPON3': '1.250', 'HITCOUNT': '2.320', 'weapon3': '2.688', 'DAMAGECOUNT': '11.130', 'FRAGCOUNT': '35.000'} [2023-02-24 21:08:14,075][213369] DAMAGECOUNT value on done: 388676.0 [2023-02-24 21:08:14,075][213369] Sum rewards: 47.741, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.220', 'AMMO5': '0.017', 'AMMO2': '0.023', 'AMMO4': '0.112', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.226', 'weapon5': '0.232', 'weapon4': '0.334', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.850', 'weapon3': '2.908', 'DAMAGECOUNT': '12.519', 'FRAGCOUNT': '41.500'} [2023-02-24 21:08:14,080][213382] DAMAGECOUNT value on done: 397565.0 [2023-02-24 21:08:14,081][213382] Sum rewards: 47.606, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.525', 'AMMO5': '0.010', 'ARMOR': '0.032', 'AMMO2': '0.035', 'weapon5': '0.130', 'weapon4': '0.134', 'AMMO4': '0.177', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.448', 'WEAPON3': '1.150', 'HITCOUNT': '2.700', 'weapon3': '3.092', 'DAMAGECOUNT': '12.687', 'FRAGCOUNT': '43.000'} [2023-02-24 21:08:14,164][213368] DAMAGECOUNT value on done: 392255.0 [2023-02-24 21:08:14,165][213368] Sum rewards: 35.153, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.852', 'AMMO5': '0.019', 'AMMO2': '0.032', 'AMMO4': '0.160', 'AMMO3': '0.168', 'weapon5': '0.288', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon2': '0.518', 'weapon4': '0.576', 'WEAPON3': '0.950', 'HITCOUNT': '2.310', 'weapon3': '2.324', 'DAMAGECOUNT': '10.059', 'FRAGCOUNT': '32.000'} [2023-02-24 21:08:14,246][213383] DAMAGECOUNT value on done: 392276.0 [2023-02-24 21:08:14,247][213383] Sum rewards: 33.475, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.969', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.088', 'AMMO4': '0.108', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'weapon2': '0.450', 'weapon4': '0.530', 'WEAPON3': '1.400', 'HITCOUNT': '2.570', 'weapon3': '2.668', 'DAMAGECOUNT': '11.289', 'FRAGCOUNT': '33.000'} [2023-02-24 21:08:14,343][213384] DAMAGECOUNT value on done: 385517.0 [2023-02-24 21:08:14,343][213384] Sum rewards: 39.480, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.830', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.167', 'weapon5': '0.178', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.434', 'weapon4': '0.486', 'WEAPON3': '1.000', 'HITCOUNT': '2.170', 'weapon3': '2.636', 'DAMAGECOUNT': '11.181', 'FRAGCOUNT': '35.000'} [2023-02-24 21:08:14,621][213365] Updated weights for policy 0, policy_version 33016 (0.0009) [2023-02-24 21:08:14,675][213384] DAMAGECOUNT value on done: 401790.0 [2023-02-24 21:08:14,675][213384] Sum rewards: 36.645, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.047', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon7': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.144', 'weapon5': '0.146', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.450', 'weapon4': '0.478', 'WEAPON3': '0.950', 'weapon3': '2.188', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '9.504', 'FRAGCOUNT': '32.000'} [2023-02-24 21:08:14,977][213384] DAMAGECOUNT value on done: 404638.0 [2023-02-24 21:08:14,978][213384] Sum rewards: 45.538, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.544', 'AMMO5': '0.023', 'AMMO2': '0.030', 'weapon5': '0.124', 'AMMO4': '0.150', 'weapon4': '0.166', 'AMMO3': '0.197', 'weapon2': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.640', 'weapon3': '3.248', 'DAMAGECOUNT': '12.771', 'FRAGCOUNT': '40.000'} [2023-02-24 21:08:15,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13509.9). Total num frames: 135241728. Throughput: 0: 3378.2. Samples: 8805892. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 21:08:15,243][213332] Avg episode reward: [(0, '42.325')] [2023-02-24 21:08:17,612][213365] Updated weights for policy 0, policy_version 33026 (0.0009) [2023-02-24 21:08:20,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 135307264. Throughput: 0: 3379.4. Samples: 8816180. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 21:08:20,243][213332] Avg episode reward: [(0, '42.325')] [2023-02-24 21:08:20,661][213365] Updated weights for policy 0, policy_version 33036 (0.0009) [2023-02-24 21:08:23,722][213365] Updated weights for policy 0, policy_version 33046 (0.0009) [2023-02-24 21:08:25,243][213332] Fps is (10 sec: 13107.0, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 135372800. Throughput: 0: 3378.5. Samples: 8836416. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:08:25,244][213332] Avg episode reward: [(0, '42.325')] [2023-02-24 21:08:26,701][213365] Updated weights for policy 0, policy_version 33056 (0.0009) [2023-02-24 21:08:29,807][213365] Updated weights for policy 0, policy_version 33066 (0.0009) [2023-02-24 21:08:30,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 135442432. Throughput: 0: 3380.6. Samples: 8856624. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:08:30,243][213332] Avg episode reward: [(0, '42.325')] [2023-02-24 21:08:30,387][213367] DAMAGECOUNT value on done: 398973.0 [2023-02-24 21:08:30,387][213367] Sum rewards: 37.231, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.485', 'AMMO5': '0.019', 'AMMO2': '0.024', 'AMMO4': '0.121', 'AMMO3': '0.200', 'weapon4': '0.322', 'weapon5': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon2': '0.830', 'WEAPON3': '1.200', 'weapon3': '2.208', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '12.033', 'FRAGCOUNT': '35.000'} [2023-02-24 21:08:30,533][213367] DAMAGECOUNT value on done: 405003.0 [2023-02-24 21:08:30,533][213367] Sum rewards: 40.955, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.792', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.048', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'AMMO3': '0.186', 'weapon4': '0.228', 'WEAPON4': '0.350', 'weapon2': '0.554', 'WEAPON3': '1.150', 'HITCOUNT': '2.440', 'weapon3': '2.866', 'DAMAGECOUNT': '10.569', 'FRAGCOUNT': '39.000'} [2023-02-24 21:08:30,702][213367] DAMAGECOUNT value on done: 403065.0 [2023-02-24 21:08:30,703][213367] Sum rewards: 35.028, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.524', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon5': '0.080', 'AMMO3': '0.189', 'AMMO4': '0.222', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON4': '0.400', 'weapon4': '0.642', 'WEAPON3': '1.100', 'HITCOUNT': '2.440', 'weapon3': '2.566', 'DAMAGECOUNT': '10.395', 'FRAGCOUNT': '32.000'} [2023-02-24 21:08:30,843][213367] DAMAGECOUNT value on done: 405267.0 [2023-02-24 21:08:30,843][213367] Sum rewards: 50.554, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.043', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.120', 'AMMO4': '0.124', 'weapon5': '0.160', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.860', 'weapon3': '3.124', 'DAMAGECOUNT': '14.184', 'FRAGCOUNT': '44.000'} [2023-02-24 21:08:31,438][213372] DAMAGECOUNT value on done: 408727.0 [2023-02-24 21:08:31,439][213372] Sum rewards: 46.345, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.130', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO5': '0.011', 'AMMO4': '0.046', 'weapon5': '0.086', 'WEAPON4': '0.200', 'AMMO3': '0.246', 'weapon4': '0.248', 'WEAPON5': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.500', 'HITCOUNT': '2.530', 'weapon3': '2.958', 'DAMAGECOUNT': '11.907', 'FRAGCOUNT': '44.000'} [2023-02-24 21:08:31,647][213372] DAMAGECOUNT value on done: 399124.0 [2023-02-24 21:08:31,648][213372] Sum rewards: 43.209, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.280', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO3': '0.098', 'AMMO4': '0.157', 'weapon5': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '0.600', 'weapon2': '0.712', 'weapon4': '0.946', 'weapon3': '1.696', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '11.238', 'FRAGCOUNT': '35.000'} [2023-02-24 21:08:31,766][213372] DAMAGECOUNT value on done: 410564.0 [2023-02-24 21:08:31,767][213372] Sum rewards: 43.302, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.380', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.114', 'AMMO4': '0.121', 'AMMO3': '0.136', 'weapon2': '0.272', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.708', 'WEAPON3': '0.800', 'HITCOUNT': '2.680', 'weapon3': '2.730', 'DAMAGECOUNT': '11.337', 'FRAGCOUNT': '37.000'} [2023-02-24 21:08:31,969][213372] DAMAGECOUNT value on done: 396108.0 [2023-02-24 21:08:31,969][213372] Sum rewards: 42.645, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.732', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'weapon4': '0.040', 'weapon5': '0.092', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'weapon2': '0.670', 'WEAPON3': '1.500', 'HITCOUNT': '2.550', 'weapon3': '2.918', 'DAMAGECOUNT': '11.928', 'FRAGCOUNT': '40.000'} [2023-02-24 21:08:32,083][213366] DAMAGECOUNT value on done: 396709.0 [2023-02-24 21:08:32,083][213366] Sum rewards: 58.092, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.495', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.062', 'weapon5': '0.066', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon2': '0.382', 'WEAPON3': '1.050', 'HITCOUNT': '3.090', 'weapon3': '3.194', 'DAMAGECOUNT': '14.229', 'FRAGCOUNT': '48.000'} [2023-02-24 21:08:32,385][213366] DAMAGECOUNT value on done: 407973.0 [2023-02-24 21:08:32,386][213366] Sum rewards: 40.947, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.780', 'ARMOR': '0.004', 'AMMO5': '0.032', 'AMMO2': '0.041', 'AMMO4': '0.204', 'AMMO3': '0.227', 'weapon2': '0.270', 'weapon5': '0.276', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'weapon4': '0.866', 'WEAPON3': '1.400', 'weapon3': '2.104', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '11.793', 'FRAGCOUNT': '38.000'} [2023-02-24 21:08:32,395][213366] DAMAGECOUNT value on done: 415426.0 [2023-02-24 21:08:32,396][213366] Sum rewards: 43.863, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.210', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.102', 'AMMO3': '0.185', 'AMMO4': '0.197', 'weapon2': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.426', 'WEAPON3': '1.150', 'HITCOUNT': '2.400', 'weapon3': '3.036', 'DAMAGECOUNT': '12.078', 'FRAGCOUNT': '39.000'} [2023-02-24 21:08:32,704][213366] DAMAGECOUNT value on done: 398729.0 [2023-02-24 21:08:32,705][213366] Sum rewards: 27.847, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.548', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.055', 'AMMO3': '0.202', 'AMMO4': '0.277', 'weapon2': '0.308', 'weapon5': '0.384', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'weapon4': '0.666', 'WEAPON3': '1.250', 'HITCOUNT': '2.230', 'weapon3': '2.370', 'DAMAGECOUNT': '10.335', 'FRAGCOUNT': '28.000'} [2023-02-24 21:08:32,842][213365] Updated weights for policy 0, policy_version 33076 (0.0009) [2023-02-24 21:08:32,949][213383] DAMAGECOUNT value on done: 399727.0 [2023-02-24 21:08:32,950][213383] Sum rewards: 40.311, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.222', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'weapon2': '0.224', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'weapon4': '0.320', 'ARMOR': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '2.390', 'weapon3': '3.132', 'DAMAGECOUNT': '11.970', 'FRAGCOUNT': '38.000'} [2023-02-24 21:08:33,060][213369] DAMAGECOUNT value on done: 406486.0 [2023-02-24 21:08:33,060][213369] Sum rewards: 44.207, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.354', 'AMMO2': '0.017', 'AMMO5': '0.017', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'weapon2': '0.130', 'AMMO3': '0.169', 'weapon5': '0.214', 'WEAPON5': '0.250', 'weapon4': '0.728', 'WEAPON3': '1.050', 'HITCOUNT': '2.610', 'weapon3': '2.758', 'DAMAGECOUNT': '12.435', 'FRAGCOUNT': '35.500'} [2023-02-24 21:08:33,079][213382] DAMAGECOUNT value on done: 403620.0 [2023-02-24 21:08:33,080][213382] Sum rewards: 49.067, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.180', 'AMMO5': '0.012', 'AMMO2': '0.018', 'weapon4': '0.048', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'weapon5': '0.176', 'WEAPON5': '0.250', 'AMMO3': '0.276', 'weapon2': '0.430', 'WEAPON3': '1.600', 'HITCOUNT': '2.680', 'weapon3': '2.944', 'DAMAGECOUNT': '13.074', 'FRAGCOUNT': '46.000'} [2023-02-24 21:08:33,189][213368] DAMAGECOUNT value on done: 398928.0 [2023-02-24 21:08:33,190][213368] Sum rewards: 49.681, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.468', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.068', 'WEAPON4': '0.150', 'weapon2': '0.158', 'weapon4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.268', 'WEAPON3': '1.450', 'HITCOUNT': '2.870', 'weapon3': '3.372', 'DAMAGECOUNT': '13.614', 'FRAGCOUNT': '45.000'} [2023-02-24 21:08:33,258][213383] DAMAGECOUNT value on done: 402349.0 [2023-02-24 21:08:33,259][213383] Sum rewards: 40.494, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.882', 'ARMOR': '0.012', 'AMMO5': '0.020', 'AMMO2': '0.053', 'AMMO3': '0.173', 'weapon2': '0.218', 'weapon5': '0.256', 'AMMO4': '0.265', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.724', 'WEAPON3': '1.050', 'weapon3': '2.504', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '11.781', 'FRAGCOUNT': '35.000'} [2023-02-24 21:08:33,366][213369] DAMAGECOUNT value on done: 403515.0 [2023-02-24 21:08:33,366][213369] Sum rewards: 46.623, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.460', 'AMMO5': '0.017', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.120', 'AMMO3': '0.166', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.452', 'weapon2': '0.454', 'WEAPON3': '1.050', 'weapon3': '2.740', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.225', 'FRAGCOUNT': '40.000'} [2023-02-24 21:08:33,399][213382] DAMAGECOUNT value on done: 404492.0 [2023-02-24 21:08:33,400][213382] Sum rewards: 45.143, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.017', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.146', 'AMMO3': '0.158', 'HEALTH': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.396', 'WEAPON5': '0.400', 'weapon4': '0.806', 'WEAPON3': '0.900', 'weapon3': '2.336', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '11.664', 'FRAGCOUNT': '39.000'} [2023-02-24 21:08:33,510][213368] DAMAGECOUNT value on done: 403632.0 [2023-02-24 21:08:33,510][213368] Sum rewards: 55.396, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.369', 'AMMO5': '0.017', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.116', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.350', 'weapon4': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.840', 'weapon3': '2.846', 'DAMAGECOUNT': '14.238', 'FRAGCOUNT': '46.000'} [2023-02-24 21:08:33,682][213369] DAMAGECOUNT value on done: 403853.0 [2023-02-24 21:08:33,683][213369] Sum rewards: 48.707, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.480', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.052', 'weapon5': '0.066', 'AMMO4': '0.092', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'weapon2': '0.276', 'WEAPON3': '1.200', 'HITCOUNT': '2.560', 'weapon3': '3.406', 'DAMAGECOUNT': '12.762', 'FRAGCOUNT': '42.000'} [2023-02-24 21:08:33,716][213382] DAMAGECOUNT value on done: 391320.0 [2023-02-24 21:08:33,717][213382] Sum rewards: 34.139, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.020', 'AMMO5': '0.015', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.175', 'weapon5': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.310', 'WEAPON5': '0.400', 'weapon4': '0.768', 'WEAPON3': '1.050', 'HITCOUNT': '2.320', 'weapon3': '2.322', 'DAMAGECOUNT': '9.855', 'FRAGCOUNT': '31.000'} [2023-02-24 21:08:33,787][213368] DAMAGECOUNT value on done: 401151.0 [2023-02-24 21:08:33,787][213368] Sum rewards: 58.296, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.439', 'AMMO2': '0.007', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'weapon4': '0.074', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon2': '0.258', 'WEAPON3': '1.250', 'HITCOUNT': '3.020', 'weapon3': '3.388', 'DAMAGECOUNT': '13.191', 'FRAGCOUNT': '50.000'} [2023-02-24 21:08:33,909][213384] DAMAGECOUNT value on done: 408476.0 [2023-02-24 21:08:33,910][213384] Sum rewards: 59.634, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.898', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon4': '0.422', 'weapon2': '0.524', 'WEAPON3': '1.100', 'weapon3': '2.720', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.469', 'FRAGCOUNT': '51.000'} [2023-02-24 21:08:33,940][213383] DAMAGECOUNT value on done: 403819.0 [2023-02-24 21:08:33,940][213383] Sum rewards: 50.176, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.208', 'ARMOR': '0.004', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon5': '0.078', 'AMMO4': '0.102', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.312', 'weapon4': '0.460', 'WEAPON3': '1.100', 'weapon3': '2.890', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.335', 'FRAGCOUNT': '43.000'} [2023-02-24 21:08:33,994][213369] DAMAGECOUNT value on done: 393495.0 [2023-02-24 21:08:33,995][213369] Sum rewards: 45.862, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.868', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.051', 'AMMO3': '0.223', 'AMMO4': '0.255', 'weapon2': '0.320', 'weapon5': '0.324', 'weapon4': '0.384', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'HITCOUNT': '2.350', 'weapon3': '2.532', 'DAMAGECOUNT': '14.112', 'FRAGCOUNT': '42.000'} [2023-02-24 21:08:34,045][213382] DAMAGECOUNT value on done: 400969.0 [2023-02-24 21:08:34,046][213382] Sum rewards: 38.225, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.674', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.037', 'AMMO3': '0.146', 'AMMO4': '0.182', 'weapon5': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.488', 'weapon4': '0.846', 'WEAPON3': '0.850', 'weapon3': '2.110', 'HITCOUNT': '2.300', 'DAMAGECOUNT': '10.212', 'FRAGCOUNT': '33.000'} [2023-02-24 21:08:34,112][213368] DAMAGECOUNT value on done: 396635.0 [2023-02-24 21:08:34,113][213368] Sum rewards: 41.752, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.862', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.130', 'weapon2': '0.184', 'AMMO3': '0.237', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.728', 'WEAPON3': '1.400', 'weapon3': '2.600', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '13.134', 'FRAGCOUNT': '36.000'} [2023-02-24 21:08:34,233][213384] DAMAGECOUNT value on done: 388898.0 [2023-02-24 21:08:34,234][213384] Sum rewards: 39.754, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.700', 'AMMO5': '0.018', 'AMMO2': '0.035', 'weapon5': '0.138', 'AMMO3': '0.162', 'AMMO4': '0.174', 'WEAPON4': '0.300', 'weapon4': '0.332', 'WEAPON5': '0.400', 'weapon2': '0.758', 'WEAPON3': '1.000', 'HITCOUNT': '2.090', 'weapon3': '2.404', 'DAMAGECOUNT': '10.143', 'FRAGCOUNT': '34.000'} [2023-02-24 21:08:34,254][213383] DAMAGECOUNT value on done: 396102.0 [2023-02-24 21:08:34,254][213383] Sum rewards: 35.750, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.520', 'AMMO5': '0.022', 'AMMO2': '0.045', 'weapon2': '0.184', 'AMMO3': '0.208', 'AMMO4': '0.226', 'weapon5': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.550', 'weapon4': '0.950', 'WEAPON3': '1.150', 'weapon3': '2.170', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '11.478', 'FRAGCOUNT': '32.000'} [2023-02-24 21:08:34,361][213366] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 21:08:34,543][213384] DAMAGECOUNT value on done: 405161.0 [2023-02-24 21:08:34,544][213384] Sum rewards: 29.251, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.830', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO4': '0.189', 'AMMO3': '0.190', 'weapon5': '0.260', 'WEAPON5': '0.350', 'weapon2': '0.532', 'WEAPON4': '0.550', 'weapon4': '0.684', 'WEAPON3': '1.100', 'HITCOUNT': '2.020', 'weapon3': '2.290', 'DAMAGECOUNT': '10.113', 'FRAGCOUNT': '29.000'} [2023-02-24 21:08:34,858][213384] DAMAGECOUNT value on done: 409659.0 [2023-02-24 21:08:34,859][213384] Sum rewards: 64.364, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.031', 'HEALTH': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'weapon5': '0.160', 'WEAPON5': '0.200', 'weapon2': '0.222', 'weapon4': '0.312', 'WEAPON3': '0.900', 'weapon3': '3.088', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.063', 'FRAGCOUNT': '52.000'} [2023-02-24 21:08:35,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 135507968. Throughput: 0: 3376.5. Samples: 8866746. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:08:35,244][213332] Avg episode reward: [(0, '42.837')] [2023-02-24 21:08:35,899][213365] Updated weights for policy 0, policy_version 33086 (0.0009) [2023-02-24 21:08:38,924][213365] Updated weights for policy 0, policy_version 33096 (0.0009) [2023-02-24 21:08:40,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 135577600. Throughput: 0: 3378.3. Samples: 8887036. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:08:40,243][213332] Avg episode reward: [(0, '42.837')] [2023-02-24 21:08:41,882][213365] Updated weights for policy 0, policy_version 33106 (0.0009) [2023-02-24 21:08:44,885][213384] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 21:08:44,984][213365] Updated weights for policy 0, policy_version 33116 (0.0009) [2023-02-24 21:08:45,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 135643136. Throughput: 0: 3379.5. Samples: 8907326. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 21:08:45,243][213332] Avg episode reward: [(0, '42.837')] [2023-02-24 21:08:45,269][213352] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000033117_135647232.pth... [2023-02-24 21:08:45,330][213352] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000032326_132407296.pth [2023-02-24 21:08:47,976][213365] Updated weights for policy 0, policy_version 33126 (0.0009) [2023-02-24 21:08:50,207][213367] DAMAGECOUNT value on done: 402281.0 [2023-02-24 21:08:50,207][213367] Sum rewards: 30.961, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.361', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.030', 'weapon7': '0.058', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.148', 'WEAPON7': '0.200', 'AMMO3': '0.201', 'weapon5': '0.304', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.594', 'weapon4': '0.892', 'WEAPON3': '1.150', 'weapon3': '1.792', 'HITCOUNT': '2.360', 'DAMAGECOUNT': '9.924', 'FRAGCOUNT': '31.000'} [2023-02-24 21:08:50,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 135712768. Throughput: 0: 3378.9. Samples: 8917600. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 21:08:50,243][213332] Avg episode reward: [(0, '42.705')] [2023-02-24 21:08:50,409][213367] DAMAGECOUNT value on done: 408670.0 [2023-02-24 21:08:50,409][213367] Sum rewards: 39.336, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.815', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon7': '0.062', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.165', 'AMMO3': '0.197', 'WEAPON7': '0.200', 'weapon5': '0.222', 'weapon2': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.600', 'weapon4': '0.970', 'WEAPON3': '1.150', 'weapon3': '2.212', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '11.001', 'FRAGCOUNT': '37.000'} [2023-02-24 21:08:50,519][213367] DAMAGECOUNT value on done: 406127.0 [2023-02-24 21:08:50,520][213367] Sum rewards: 30.108, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.330', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO5': '0.015', 'AMMO4': '0.043', 'weapon5': '0.074', 'WEAPON4': '0.150', 'weapon4': '0.212', 'AMMO3': '0.239', 'WEAPON5': '0.300', 'weapon2': '0.702', 'WEAPON3': '1.350', 'HITCOUNT': '2.160', 'weapon3': '2.744', 'DAMAGECOUNT': '9.186', 'FRAGCOUNT': '30.000'} [2023-02-24 21:08:50,702][213367] DAMAGECOUNT value on done: 408623.0 [2023-02-24 21:08:50,702][213367] Sum rewards: 35.018, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.782', 'AMMO5': '0.009', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon4': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon5': '0.224', 'weapon2': '0.644', 'WEAPON3': '1.250', 'HITCOUNT': '2.130', 'weapon3': '2.714', 'DAMAGECOUNT': '10.068', 'FRAGCOUNT': '31.000'} [2023-02-24 21:08:51,009][213365] Updated weights for policy 0, policy_version 33136 (0.0009) [2023-02-24 21:08:51,376][213372] DAMAGECOUNT value on done: 411577.0 [2023-02-24 21:08:51,376][213372] Sum rewards: 30.435, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.996', 'AMMO5': '0.025', 'AMMO2': '0.051', 'AMMO3': '0.133', 'AMMO4': '0.256', 'weapon2': '0.400', 'weapon5': '0.598', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'weapon4': '1.086', 'weapon3': '1.592', 'HITCOUNT': '1.990', 'DAMAGECOUNT': '8.550', 'FRAGCOUNT': '28.500'} [2023-02-24 21:08:51,507][213372] DAMAGECOUNT value on done: 402918.0 [2023-02-24 21:08:51,508][213372] Sum rewards: 36.769, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.310', 'AMMO5': '0.019', 'AMMO2': '0.034', 'AMMO4': '0.170', 'AMMO3': '0.184', 'weapon4': '0.338', 'weapon5': '0.352', 'weapon2': '0.440', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.260', 'weapon3': '2.614', 'DAMAGECOUNT': '11.367', 'FRAGCOUNT': '33.000'} [2023-02-24 21:08:51,680][213372] DAMAGECOUNT value on done: 414208.0 [2023-02-24 21:08:51,680][213372] Sum rewards: 40.852, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.478', 'AMMO5': '0.017', 'AMMO2': '0.036', 'AMMO3': '0.142', 'AMMO4': '0.179', 'weapon2': '0.184', 'weapon5': '0.274', 'weapon4': '0.316', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.900', 'HITCOUNT': '2.260', 'weapon3': '2.990', 'DAMAGECOUNT': '10.932', 'FRAGCOUNT': '36.000'} [2023-02-24 21:08:51,813][213372] DAMAGECOUNT value on done: 400203.0 [2023-02-24 21:08:51,813][213372] Sum rewards: 49.211, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.621', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon2': '0.188', 'weapon4': '0.276', 'WEAPON3': '1.150', 'HITCOUNT': '2.780', 'weapon3': '3.008', 'DAMAGECOUNT': '12.285', 'FRAGCOUNT': '43.000'} [2023-02-24 21:08:51,943][213366] DAMAGECOUNT value on done: 400076.0 [2023-02-24 21:08:51,944][213366] Sum rewards: 38.370, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.510', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.034', 'WEAPON4': '0.050', 'weapon5': '0.058', 'AMMO4': '0.093', 'AMMO3': '0.122', 'WEAPON5': '0.150', 'WEAPON3': '0.850', 'weapon2': '1.084', 'HITCOUNT': '2.200', 'weapon3': '2.614', 'DAMAGECOUNT': '10.101', 'FRAGCOUNT': '30.000'} [2023-02-24 21:08:52,247][213366] DAMAGECOUNT value on done: 411384.0 [2023-02-24 21:08:52,247][213366] Sum rewards: 38.947, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.332', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.137', 'AMMO3': '0.157', 'weapon5': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.346', 'weapon2': '0.388', 'WEAPON3': '1.050', 'HITCOUNT': '2.440', 'weapon3': '2.746', 'DAMAGECOUNT': '10.233', 'FRAGCOUNT': '34.000'} [2023-02-24 21:08:52,257][213366] DAMAGECOUNT value on done: 418887.0 [2023-02-24 21:08:52,257][213366] Sum rewards: 37.698, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.030', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'weapon4': '0.136', 'AMMO3': '0.197', 'weapon2': '0.870', 'WEAPON3': '1.250', 'HITCOUNT': '2.160', 'weapon3': '2.880', 'DAMAGECOUNT': '10.383', 'FRAGCOUNT': '34.000'} [2023-02-24 21:08:52,574][213366] DAMAGECOUNT value on done: 402411.0 [2023-02-24 21:08:52,575][213366] Sum rewards: 38.058, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.695', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.038', 'weapon7': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.155', 'AMMO4': '0.188', 'WEAPON7': '0.200', 'weapon5': '0.316', 'weapon2': '0.366', 'weapon4': '0.436', 'WEAPON4': '0.500', 'WEAPON5': '0.650', 'WEAPON3': '0.900', 'HITCOUNT': '2.090', 'weapon3': '2.524', 'DAMAGECOUNT': '11.046', 'FRAGCOUNT': '31.500'} [2023-02-24 21:08:52,857][213369] DAMAGECOUNT value on done: 410065.0 [2023-02-24 21:08:52,857][213369] Sum rewards: 39.833, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.845', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.100', 'AMMO3': '0.203', 'weapon2': '0.544', 'WEAPON3': '1.200', 'HITCOUNT': '2.570', 'weapon3': '3.034', 'DAMAGECOUNT': '10.737', 'FRAGCOUNT': '35.000'} [2023-02-24 21:08:52,863][213383] DAMAGECOUNT value on done: 404089.0 [2023-02-24 21:08:52,864][213383] Sum rewards: 45.562, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.319', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.178', 'weapon5': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.304', 'weapon2': '0.404', 'WEAPON3': '1.150', 'HITCOUNT': '2.940', 'weapon3': '2.960', 'DAMAGECOUNT': '13.086', 'FRAGCOUNT': '38.000'} [2023-02-24 21:08:52,987][213382] DAMAGECOUNT value on done: 407427.0 [2023-02-24 21:08:52,988][213382] Sum rewards: 40.273, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.232', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.016', 'weapon5': '0.072', 'AMMO4': '0.077', 'weapon2': '0.172', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.522', 'WEAPON3': '1.050', 'HITCOUNT': '2.570', 'weapon3': '2.952', 'DAMAGECOUNT': '11.421', 'FRAGCOUNT': '34.500'} [2023-02-24 21:08:53,034][213368] DAMAGECOUNT value on done: 403425.0 [2023-02-24 21:08:53,035][213368] Sum rewards: 47.504, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.364', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.011', 'weapon5': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'weapon4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.315', 'weapon2': '0.434', 'WEAPON3': '1.850', 'HITCOUNT': '3.020', 'weapon3': '3.212', 'DAMAGECOUNT': '13.491', 'FRAGCOUNT': '47.000'} [2023-02-24 21:08:53,180][213369] DAMAGECOUNT value on done: 407846.0 [2023-02-24 21:08:53,181][213383] DAMAGECOUNT value on done: 406532.0 [2023-02-24 21:08:53,181][213369] Sum rewards: 54.036, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.249', 'AMMO5': '0.012', 'AMMO2': '0.038', 'ARMOR': '0.048', 'weapon5': '0.110', 'AMMO3': '0.128', 'AMMO4': '0.191', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.472', 'weapon4': '0.548', 'WEAPON3': '0.800', 'weapon3': '2.634', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '12.993', 'FRAGCOUNT': '44.000'} [2023-02-24 21:08:53,181][213383] Sum rewards: 50.832, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.800', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.009', 'weapon5': '0.028', 'weapon2': '0.132', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'WEAPON3': '1.450', 'HITCOUNT': '2.880', 'weapon3': '3.654', 'DAMAGECOUNT': '12.549', 'FRAGCOUNT': '45.000'} [2023-02-24 21:08:53,304][213382] DAMAGECOUNT value on done: 409180.0 [2023-02-24 21:08:53,305][213382] Sum rewards: 50.232, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.198', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.026', 'weapon5': '0.110', 'AMMO4': '0.132', 'AMMO3': '0.217', 'weapon2': '0.256', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.610', 'WEAPON3': '1.350', 'weapon3': '2.770', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.064', 'FRAGCOUNT': '44.000'} [2023-02-24 21:08:53,358][213368] DAMAGECOUNT value on done: 407717.0 [2023-02-24 21:08:53,358][213368] Sum rewards: 50.771, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.210', 'AMMO2': '0.003', 'ARMOR': '0.004', 'AMMO4': '0.013', 'WEAPON4': '0.100', 'AMMO3': '0.173', 'weapon2': '0.254', 'weapon4': '0.374', 'WEAPON3': '1.100', 'HITCOUNT': '2.740', 'weapon3': '3.230', 'DAMAGECOUNT': '12.240', 'FRAGCOUNT': '43.000'} [2023-02-24 21:08:53,496][213369] DAMAGECOUNT value on done: 407942.0 [2023-02-24 21:08:53,496][213369] Sum rewards: 48.133, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.012', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.102', 'AMMO3': '0.158', 'weapon5': '0.172', 'WEAPON5': '0.200', 'weapon4': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.624', 'WEAPON3': '1.050', 'weapon3': '2.744', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.267', 'FRAGCOUNT': '40.000'} [2023-02-24 21:08:53,619][213368] DAMAGECOUNT value on done: 404391.0 [2023-02-24 21:08:53,619][213368] Sum rewards: 35.862, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.600', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.058', 'AMMO4': '0.079', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'weapon4': '0.282', 'weapon2': '0.438', 'WEAPON3': '1.100', 'HITCOUNT': '2.410', 'weapon3': '3.022', 'DAMAGECOUNT': '9.720', 'FRAGCOUNT': '34.000'} [2023-02-24 21:08:53,620][213382] DAMAGECOUNT value on done: 395116.0 [2023-02-24 21:08:53,621][213382] Sum rewards: 35.790, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.740', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon7': '0.058', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.138', 'WEAPON7': '0.200', 'AMMO4': '0.208', 'AMMO3': '0.253', 'weapon2': '0.264', 'WEAPON5': '0.300', 'weapon4': '0.414', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '2.270', 'weapon3': '2.788', 'DAMAGECOUNT': '11.388', 'FRAGCOUNT': '36.000'} [2023-02-24 21:08:53,769][213384] DAMAGECOUNT value on done: 412081.0 [2023-02-24 21:08:53,769][213384] Sum rewards: 40.668, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.627', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.112', 'AMMO4': '0.176', 'AMMO3': '0.198', 'weapon2': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.459', 'weapon4': '0.890', 'WEAPON3': '1.150', 'weapon3': '2.278', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '10.815', 'FRAGCOUNT': '36.000'} [2023-02-24 21:08:53,811][213369] DAMAGECOUNT value on done: 396150.0 [2023-02-24 21:08:53,811][213369] Sum rewards: 27.632, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.152', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon7': '0.076', 'weapon5': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon4': '0.336', 'weapon2': '0.538', 'WEAPON3': '0.950', 'HITCOUNT': '1.960', 'weapon3': '2.642', 'DAMAGECOUNT': '7.965', 'FRAGCOUNT': '26.000'} [2023-02-24 21:08:53,826][213383] DAMAGECOUNT value on done: 408529.0 [2023-02-24 21:08:53,826][213383] Sum rewards: 48.124, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.800', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.124', 'AMMO4': '0.132', 'weapon4': '0.162', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.250', 'HITCOUNT': '2.860', 'weapon3': '3.070', 'DAMAGECOUNT': '14.130', 'FRAGCOUNT': '42.000'} [2023-02-24 21:08:53,938][213382] DAMAGECOUNT value on done: 404510.0 [2023-02-24 21:08:53,939][213382] Sum rewards: 39.315, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.686', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.160', 'weapon5': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.364', 'WEAPON3': '0.900', 'weapon4': '0.952', 'weapon3': '2.162', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '10.623', 'FRAGCOUNT': '35.000'} [2023-02-24 21:08:53,942][213368] DAMAGECOUNT value on done: 400923.0 [2023-02-24 21:08:53,942][213368] Sum rewards: 42.763, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.344', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.106', 'AMMO4': '0.145', 'weapon4': '0.148', 'AMMO3': '0.163', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.600', 'WEAPON3': '0.950', 'HITCOUNT': '2.650', 'weapon3': '2.940', 'DAMAGECOUNT': '12.864', 'FRAGCOUNT': '35.000'} [2023-02-24 21:08:54,025][213365] Updated weights for policy 0, policy_version 33146 (0.0009) [2023-02-24 21:08:54,083][213384] DAMAGECOUNT value on done: 392649.0 [2023-02-24 21:08:54,084][213384] Sum rewards: 35.757, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.125', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'weapon4': '0.058', 'weapon5': '0.078', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.380', 'WEAPON3': '1.400', 'HITCOUNT': '2.460', 'weapon3': '3.254', 'DAMAGECOUNT': '11.253', 'FRAGCOUNT': '32.000'} [2023-02-24 21:08:54,139][213383] DAMAGECOUNT value on done: 399778.0 [2023-02-24 21:08:54,139][213383] Sum rewards: 41.002, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.096', 'AMMO5': '0.016', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.155', 'weapon2': '0.206', 'weapon5': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.502', 'WEAPON3': '0.800', 'HITCOUNT': '2.210', 'weapon3': '2.796', 'DAMAGECOUNT': '11.028', 'FRAGCOUNT': '35.000'} [2023-02-24 21:08:54,405][213384] DAMAGECOUNT value on done: 409227.0 [2023-02-24 21:08:54,406][213384] Sum rewards: 43.530, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.420', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon5': '0.270', 'weapon4': '0.330', 'weapon2': '0.364', 'WEAPON3': '1.250', 'HITCOUNT': '2.450', 'weapon3': '2.828', 'DAMAGECOUNT': '12.123', 'FRAGCOUNT': '39.000'} [2023-02-24 21:08:54,720][213384] DAMAGECOUNT value on done: 412283.0 [2023-02-24 21:08:54,720][213384] Sum rewards: 27.054, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.861', 'AMMO5': '0.024', 'AMMO2': '0.056', 'AMMO3': '0.168', 'AMMO4': '0.279', 'weapon5': '0.304', 'weapon2': '0.512', 'WEAPON5': '0.550', 'WEAPON4': '0.550', 'weapon4': '0.678', 'WEAPON3': '1.050', 'HITCOUNT': '1.980', 'weapon3': '2.142', 'DAMAGECOUNT': '7.872', 'FRAGCOUNT': '28.000'} [2023-02-24 21:08:55,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13516.8, 300 sec: 13509.9). Total num frames: 135782400. Throughput: 0: 3376.1. Samples: 8937734. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 21:08:55,243][213332] Avg episode reward: [(0, '42.165')] [2023-02-24 21:08:57,001][213365] Updated weights for policy 0, policy_version 33156 (0.0009) [2023-02-24 21:09:00,083][213365] Updated weights for policy 0, policy_version 33166 (0.0009) [2023-02-24 21:09:00,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 135847936. Throughput: 0: 3379.5. Samples: 8957968. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-24 21:09:00,244][213332] Avg episode reward: [(0, '42.165')] [2023-02-24 21:09:03,114][213365] Updated weights for policy 0, policy_version 33176 (0.0009) [2023-02-24 21:09:05,243][213332] Fps is (10 sec: 13107.2, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 135913472. Throughput: 0: 3378.1. Samples: 8968194. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 21:09:05,243][213332] Avg episode reward: [(0, '42.165')] [2023-02-24 21:09:06,145][213365] Updated weights for policy 0, policy_version 33186 (0.0009) [2023-02-24 21:09:09,197][213365] Updated weights for policy 0, policy_version 33196 (0.0009) [2023-02-24 21:09:10,103][213367] DAMAGECOUNT value on done: 405853.0 [2023-02-24 21:09:10,103][213367] Sum rewards: 36.960, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.020', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.192', 'AMMO3': '0.202', 'weapon4': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.442', 'WEAPON3': '1.150', 'HITCOUNT': '2.340', 'weapon3': '2.860', 'DAMAGECOUNT': '10.716', 'FRAGCOUNT': '35.000'} [2023-02-24 21:09:10,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 135983104. Throughput: 0: 3376.7. Samples: 8988366. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 21:09:10,243][213332] Avg episode reward: [(0, '42.084')] [2023-02-24 21:09:10,282][213367] DAMAGECOUNT value on done: 412157.0 [2023-02-24 21:09:10,283][213367] Sum rewards: 36.978, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.530', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.073', 'AMMO3': '0.120', 'weapon5': '0.270', 'AMMO4': '0.367', 'weapon2': '0.432', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '0.700', 'weapon4': '0.920', 'weapon3': '1.998', 'HITCOUNT': '2.250', 'DAMAGECOUNT': '10.443', 'FRAGCOUNT': '33.000'} [2023-02-24 21:09:10,402][213367] DAMAGECOUNT value on done: 409892.0 [2023-02-24 21:09:10,402][213367] Sum rewards: 42.632, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.930', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.039', 'AMMO3': '0.158', 'AMMO4': '0.197', 'weapon5': '0.244', 'weapon2': '0.396', 'WEAPON4': '0.450', 'weapon4': '0.488', 'WEAPON5': '0.550', 'WEAPON3': '0.950', 'HITCOUNT': '2.230', 'weapon3': '2.534', 'DAMAGECOUNT': '11.295', 'FRAGCOUNT': '37.000'} [2023-02-24 21:09:10,578][213367] DAMAGECOUNT value on done: 413158.0 [2023-02-24 21:09:10,578][213367] Sum rewards: 52.629, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.098', 'AMMO5': '0.030', 'AMMO2': '0.054', 'AMMO3': '0.139', 'weapon5': '0.190', 'AMMO4': '0.272', 'weapon4': '0.384', 'weapon2': '0.476', 'WEAPON4': '0.500', 'WEAPON5': '0.650', 'WEAPON3': '0.800', 'HITCOUNT': '2.680', 'weapon3': '2.696', 'DAMAGECOUNT': '13.605', 'FRAGCOUNT': '44.000'} [2023-02-24 21:09:11,260][213372] DAMAGECOUNT value on done: 415194.0 [2023-02-24 21:09:11,261][213372] Sum rewards: 44.392, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.866', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.086', 'AMMO3': '0.117', 'AMMO4': '0.186', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.448', 'weapon2': '0.572', 'WEAPON3': '0.850', 'HITCOUNT': '2.620', 'weapon3': '2.680', 'DAMAGECOUNT': '10.851', 'FRAGCOUNT': '37.000'} [2023-02-24 21:09:11,408][213372] DAMAGECOUNT value on done: 407321.0 [2023-02-24 21:09:11,408][213372] Sum rewards: 46.387, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.558', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.040', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.240', 'weapon2': '0.250', 'WEAPON3': '1.500', 'HITCOUNT': '2.790', 'weapon3': '3.462', 'DAMAGECOUNT': '13.209', 'FRAGCOUNT': '42.000'} [2023-02-24 21:09:11,574][213372] DAMAGECOUNT value on done: 418363.0 [2023-02-24 21:09:11,575][213372] Sum rewards: 43.526, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.862', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon5': '0.122', 'AMMO4': '0.131', 'weapon4': '0.196', 'AMMO3': '0.204', 'weapon2': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.680', 'weapon3': '3.214', 'DAMAGECOUNT': '12.465', 'FRAGCOUNT': '40.000'} [2023-02-24 21:09:11,707][213372] DAMAGECOUNT value on done: 403859.0 [2023-02-24 21:09:11,708][213372] Sum rewards: 38.743, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.594', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.090', 'AMMO4': '0.121', 'AMMO3': '0.173', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.272', 'weapon2': '0.358', 'WEAPON3': '1.050', 'HITCOUNT': '2.720', 'weapon3': '3.050', 'DAMAGECOUNT': '10.968', 'FRAGCOUNT': '33.000'} [2023-02-24 21:09:11,902][213366] DAMAGECOUNT value on done: 403963.0 [2023-02-24 21:09:11,903][213366] Sum rewards: 41.254, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.016', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.108', 'AMMO4': '0.112', 'AMMO3': '0.133', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.470', 'weapon2': '0.686', 'WEAPON3': '0.800', 'HITCOUNT': '2.510', 'weapon3': '2.560', 'DAMAGECOUNT': '11.661', 'FRAGCOUNT': '34.000'} [2023-02-24 21:09:12,198][213365] Updated weights for policy 0, policy_version 33206 (0.0009) [2023-02-24 21:09:12,215][213366] DAMAGECOUNT value on done: 414973.0 [2023-02-24 21:09:12,215][213366] Sum rewards: 35.091, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.853', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.052', 'weapon5': '0.130', 'AMMO3': '0.150', 'AMMO4': '0.258', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.526', 'weapon4': '0.828', 'WEAPON3': '0.900', 'weapon3': '2.122', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '10.767', 'FRAGCOUNT': '31.000'} [2023-02-24 21:09:12,225][213366] DAMAGECOUNT value on done: 423394.0 [2023-02-24 21:09:12,226][213366] Sum rewards: 46.236, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.328', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.218', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'weapon4': '0.306', 'weapon2': '0.390', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.772', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.521', 'FRAGCOUNT': '43.000'} [2023-02-24 21:09:12,533][213366] DAMAGECOUNT value on done: 406464.0 [2023-02-24 21:09:12,533][213366] Sum rewards: 46.739, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.090', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'weapon2': '0.308', 'weapon4': '0.408', 'WEAPON3': '1.200', 'HITCOUNT': '2.960', 'weapon3': '3.010', 'DAMAGECOUNT': '12.159', 'FRAGCOUNT': '40.000'} [2023-02-24 21:09:12,781][213383] DAMAGECOUNT value on done: 407851.0 [2023-02-24 21:09:12,782][213383] Sum rewards: 42.100, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.950', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon2': '0.170', 'AMMO3': '0.197', 'weapon5': '0.268', 'weapon4': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.580', 'weapon3': '2.982', 'DAMAGECOUNT': '11.286', 'FRAGCOUNT': '39.000'} [2023-02-24 21:09:12,846][213369] DAMAGECOUNT value on done: 414807.0 [2023-02-24 21:09:12,847][213369] Sum rewards: 48.532, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.200', 'AMMO5': '0.010', 'weapon5': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.083', 'weapon4': '0.104', 'weapon2': '0.174', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.256', 'WEAPON3': '1.600', 'HITCOUNT': '3.110', 'weapon3': '3.470', 'DAMAGECOUNT': '14.226', 'FRAGCOUNT': '44.000'} [2023-02-24 21:09:12,909][213382] DAMAGECOUNT value on done: 411552.0 [2023-02-24 21:09:12,910][213382] Sum rewards: 46.227, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.167', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.136', 'AMMO4': '0.159', 'AMMO3': '0.168', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.408', 'weapon2': '0.552', 'WEAPON3': '0.950', 'weapon3': '2.454', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.375', 'FRAGCOUNT': '41.000'} [2023-02-24 21:09:12,951][213368] DAMAGECOUNT value on done: 406861.0 [2023-02-24 21:09:12,952][213368] Sum rewards: 40.876, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.374', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon7': '0.060', 'weapon5': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.168', 'AMMO3': '0.206', 'weapon2': '0.230', 'weapon4': '1.062', 'WEAPON3': '1.150', 'weapon3': '2.266', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '10.308', 'FRAGCOUNT': '35.000'} [2023-02-24 21:09:13,108][213383] DAMAGECOUNT value on done: 410990.0 [2023-02-24 21:09:13,109][213383] Sum rewards: 44.201, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.894', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.112', 'AMMO4': '0.128', 'WEAPON5': '0.200', 'weapon4': '0.242', 'AMMO3': '0.250', 'weapon2': '0.292', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '2.960', 'weapon3': '3.104', 'DAMAGECOUNT': '13.374', 'FRAGCOUNT': '40.000'} [2023-02-24 21:09:13,173][213369] DAMAGECOUNT value on done: 412011.0 [2023-02-24 21:09:13,173][213369] Sum rewards: 42.889, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.283', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.044', 'AMMO3': '0.156', 'weapon2': '0.214', 'AMMO4': '0.221', 'weapon5': '0.300', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'weapon4': '0.660', 'WEAPON3': '1.000', 'HITCOUNT': '2.510', 'weapon3': '2.552', 'DAMAGECOUNT': '12.495', 'FRAGCOUNT': '39.000'} [2023-02-24 21:09:13,243][213382] DAMAGECOUNT value on done: 412838.0 [2023-02-24 21:09:13,243][213382] Sum rewards: 40.638, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.070', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon4': '0.122', 'weapon5': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.225', 'weapon2': '0.268', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '2.300', 'weapon3': '3.236', 'DAMAGECOUNT': '10.956', 'FRAGCOUNT': '38.000'} [2023-02-24 21:09:13,266][213368] DAMAGECOUNT value on done: 411713.0 [2023-02-24 21:09:13,267][213368] Sum rewards: 49.858, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.627', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon5': '0.094', 'AMMO4': '0.127', 'AMMO3': '0.138', 'WEAPON4': '0.200', 'weapon2': '0.214', 'WEAPON5': '0.250', 'weapon4': '0.760', 'WEAPON3': '0.850', 'weapon3': '2.552', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '11.988', 'FRAGCOUNT': '41.000'} [2023-02-24 21:09:13,483][213369] DAMAGECOUNT value on done: 412762.0 [2023-02-24 21:09:13,484][213369] Sum rewards: 50.452, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-4.165', 'AMMO5': '0.016', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.189', 'weapon5': '0.286', 'weapon2': '0.322', 'WEAPON4': '0.400', 'weapon4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.670', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.415', 'FRAGCOUNT': '43.000'} [2023-02-24 21:09:13,525][213368] DAMAGECOUNT value on done: 408175.0 [2023-02-24 21:09:13,526][213368] Sum rewards: 35.882, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.760', 'AMMO5': '0.022', 'AMMO2': '0.046', 'weapon5': '0.230', 'AMMO4': '0.232', 'AMMO3': '0.243', 'weapon2': '0.314', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.870', 'WEAPON3': '1.450', 'weapon3': '2.212', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '11.352', 'FRAGCOUNT': '37.000'} [2023-02-24 21:09:13,563][213382] DAMAGECOUNT value on done: 399643.0 [2023-02-24 21:09:13,563][213382] Sum rewards: 53.446, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.064', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.030', 'weapon5': '0.044', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.213', 'weapon2': '0.220', 'WEAPON3': '1.300', 'HITCOUNT': '3.050', 'weapon3': '3.560', 'DAMAGECOUNT': '13.581', 'FRAGCOUNT': '46.000'} [2023-02-24 21:09:13,701][213384] DAMAGECOUNT value on done: 417617.0 [2023-02-24 21:09:13,702][213384] Sum rewards: 61.970, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.858', 'AMMO5': '0.009', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon4': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon5': '0.208', 'weapon2': '0.352', 'WEAPON3': '1.200', 'weapon3': '2.972', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '52.000'} [2023-02-24 21:09:13,761][213383] DAMAGECOUNT value on done: 412711.0 [2023-02-24 21:09:13,761][213383] Sum rewards: 45.922, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.410', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon5': '0.164', 'AMMO3': '0.210', 'weapon2': '0.326', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.406', 'WEAPON3': '1.200', 'weapon3': '2.844', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.546', 'FRAGCOUNT': '41.000'} [2023-02-24 21:09:13,798][213369] DAMAGECOUNT value on done: 399890.0 [2023-02-24 21:09:13,798][213369] Sum rewards: 35.415, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.406', 'ARMOR': '0.012', 'AMMO5': '0.018', 'weapon5': '0.026', 'AMMO2': '0.045', 'AMMO3': '0.206', 'AMMO4': '0.225', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON4': '0.600', 'weapon4': '0.780', 'WEAPON3': '1.150', 'weapon3': '2.616', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '11.220', 'FRAGCOUNT': '35.000'} [2023-02-24 21:09:13,856][213368] DAMAGECOUNT value on done: 404364.0 [2023-02-24 21:09:13,857][213368] Sum rewards: 35.023, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.758', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.018', 'AMMO4': '0.089', 'WEAPON4': '0.200', 'weapon4': '0.230', 'AMMO3': '0.253', 'weapon5': '0.254', 'WEAPON5': '0.350', 'weapon2': '0.662', 'WEAPON3': '1.400', 'weapon3': '2.610', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '10.323', 'FRAGCOUNT': '35.000'} [2023-02-24 21:09:13,879][213382] DAMAGECOUNT value on done: 407689.0 [2023-02-24 21:09:13,880][213382] Sum rewards: 35.099, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.960', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.047', 'weapon5': '0.136', 'AMMO3': '0.160', 'AMMO4': '0.232', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.486', 'weapon2': '0.644', 'WEAPON3': '0.950', 'HITCOUNT': '2.100', 'weapon3': '2.394', 'DAMAGECOUNT': '9.537', 'FRAGCOUNT': '33.000'} [2023-02-24 21:09:14,014][213384] DAMAGECOUNT value on done: 396490.0 [2023-02-24 21:09:14,014][213384] Sum rewards: 46.685, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.137', 'AMMO5': '0.014', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.137', 'weapon5': '0.218', 'weapon2': '0.344', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '0.750', 'weapon4': '0.862', 'weapon3': '2.304', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '11.523', 'FRAGCOUNT': '40.000'} [2023-02-24 21:09:14,066][213383] DAMAGECOUNT value on done: 404221.0 [2023-02-24 21:09:14,067][213383] Sum rewards: 49.510, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.850', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon7': '0.046', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.140', 'AMMO3': '0.142', 'AMMO4': '0.145', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.424', 'WEAPON3': '0.900', 'weapon4': '1.092', 'weapon3': '2.032', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '13.329', 'FRAGCOUNT': '40.000'} [2023-02-24 21:09:14,338][213384] DAMAGECOUNT value on done: 413110.0 [2023-02-24 21:09:14,339][213384] Sum rewards: 43.933, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.850', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.090', 'WEAPON5': '0.100', 'weapon4': '0.130', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon2': '0.678', 'WEAPON3': '1.300', 'HITCOUNT': '2.730', 'weapon3': '2.870', 'DAMAGECOUNT': '11.649', 'FRAGCOUNT': '40.000'} [2023-02-24 21:09:14,648][213384] DAMAGECOUNT value on done: 415950.0 [2023-02-24 21:09:14,649][213384] Sum rewards: 36.957, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.459', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon5': '0.130', 'AMMO4': '0.169', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.412', 'weapon2': '0.662', 'WEAPON3': '1.200', 'HITCOUNT': '2.460', 'weapon3': '2.482', 'DAMAGECOUNT': '11.001', 'FRAGCOUNT': '34.000'} [2023-02-24 21:09:15,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 136048640. Throughput: 0: 3374.1. Samples: 9008458. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 21:09:15,243][213332] Avg episode reward: [(0, '42.696')] [2023-02-24 21:09:15,272][213365] Updated weights for policy 0, policy_version 33216 (0.0009) [2023-02-24 21:09:18,283][213365] Updated weights for policy 0, policy_version 33226 (0.0009) [2023-02-24 21:09:20,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 136118272. Throughput: 0: 3377.6. Samples: 9018740. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 21:09:20,243][213332] Avg episode reward: [(0, '42.696')] [2023-02-24 21:09:20,940][213369] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 21:09:21,291][213365] Updated weights for policy 0, policy_version 33236 (0.0010) [2023-02-24 21:09:24,475][213365] Updated weights for policy 0, policy_version 33246 (0.0009) [2023-02-24 21:09:25,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 136183808. Throughput: 0: 3370.1. Samples: 9038690. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 21:09:25,243][213332] Avg episode reward: [(0, '42.696')] [2023-02-24 21:09:27,438][213365] Updated weights for policy 0, policy_version 33256 (0.0009) [2023-02-24 21:09:30,039][213367] DAMAGECOUNT value on done: 409429.0 [2023-02-24 21:09:30,039][213367] Sum rewards: 41.595, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.625', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.088', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.264', 'weapon2': '0.440', 'WEAPON3': '1.250', 'HITCOUNT': '2.730', 'weapon3': '2.960', 'DAMAGECOUNT': '10.728', 'FRAGCOUNT': '37.000'} [2023-02-24 21:09:30,240][213367] DAMAGECOUNT value on done: 416354.0 [2023-02-24 21:09:30,241][213367] Sum rewards: 43.997, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.929', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.066', 'weapon2': '0.196', 'AMMO3': '0.243', 'weapon5': '0.266', 'AMMO4': '0.330', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.810', 'WEAPON3': '1.400', 'weapon3': '2.232', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '12.591', 'FRAGCOUNT': '42.000'} [2023-02-24 21:09:30,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 136253440. Throughput: 0: 3367.3. Samples: 9058854. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 21:09:30,243][213332] Avg episode reward: [(0, '42.777')] [2023-02-24 21:09:30,356][213367] DAMAGECOUNT value on done: 413660.0 [2023-02-24 21:09:30,357][213367] Sum rewards: 43.682, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.425', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.041', 'weapon5': '0.070', 'AMMO3': '0.121', 'WEAPON5': '0.200', 'AMMO4': '0.204', 'WEAPON4': '0.350', 'weapon4': '0.618', 'weapon2': '0.640', 'WEAPON3': '0.700', 'weapon3': '2.544', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '11.304', 'FRAGCOUNT': '36.000'} [2023-02-24 21:09:30,508][213365] Updated weights for policy 0, policy_version 33266 (0.0009) [2023-02-24 21:09:30,549][213367] DAMAGECOUNT value on done: 417123.0 [2023-02-24 21:09:30,549][213367] Sum rewards: 30.462, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.824', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO4': '0.195', 'weapon5': '0.242', 'weapon2': '0.294', 'AMMO3': '0.309', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.590', 'WEAPON3': '1.750', 'HITCOUNT': '2.390', 'weapon3': '2.464', 'DAMAGECOUNT': '11.895', 'FRAGCOUNT': '32.000'} [2023-02-24 21:09:31,262][213372] DAMAGECOUNT value on done: 419476.0 [2023-02-24 21:09:31,263][213372] Sum rewards: 48.091, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.037', 'AMMO5': '0.015', 'AMMO2': '0.021', 'weapon5': '0.064', 'AMMO4': '0.103', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON4': '0.300', 'weapon4': '0.330', 'WEAPON3': '1.450', 'HITCOUNT': '2.930', 'weapon3': '3.074', 'DAMAGECOUNT': '12.846', 'FRAGCOUNT': '45.000'} [2023-02-24 21:09:31,290][213372] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 21:09:31,415][213372] DAMAGECOUNT value on done: 410951.0 [2023-02-24 21:09:31,415][213372] Sum rewards: 43.518, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.530', 'AMMO2': '0.006', 'AMMO5': '0.014', 'AMMO4': '0.032', 'weapon5': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.171', 'weapon4': '0.230', 'weapon2': '0.258', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'HITCOUNT': '2.310', 'weapon3': '3.296', 'DAMAGECOUNT': '10.890', 'FRAGCOUNT': '37.000'} [2023-02-24 21:09:31,577][213372] DAMAGECOUNT value on done: 422196.0 [2023-02-24 21:09:31,577][213372] Sum rewards: 39.857, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.718', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.062', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'weapon2': '0.164', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'weapon4': '0.556', 'WEAPON3': '1.400', 'HITCOUNT': '2.670', 'weapon3': '3.014', 'DAMAGECOUNT': '11.499', 'FRAGCOUNT': '36.500'} [2023-02-24 21:09:31,736][213372] DAMAGECOUNT value on done: 407958.0 [2023-02-24 21:09:31,736][213372] Sum rewards: 41.599, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.196', 'AMMO5': '0.013', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.205', 'weapon4': '0.208', 'weapon5': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.546', 'WEAPON3': '1.250', 'HITCOUNT': '2.560', 'weapon3': '2.718', 'DAMAGECOUNT': '12.297', 'FRAGCOUNT': '38.000'} [2023-02-24 21:09:31,910][213366] DAMAGECOUNT value on done: 408142.0 [2023-02-24 21:09:31,911][213366] Sum rewards: 48.970, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.292', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.086', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'weapon2': '0.262', 'WEAPON5': '0.350', 'weapon4': '0.390', 'WEAPON3': '1.150', 'HITCOUNT': '2.900', 'weapon3': '3.052', 'DAMAGECOUNT': '12.537', 'FRAGCOUNT': '42.000'} [2023-02-24 21:09:32,230][213366] DAMAGECOUNT value on done: 418081.0 [2023-02-24 21:09:32,231][213366] Sum rewards: 28.059, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.948', 'AMMO5': '0.017', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.106', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.290', 'weapon2': '0.848', 'WEAPON3': '1.250', 'HITCOUNT': '2.110', 'weapon3': '2.470', 'DAMAGECOUNT': '9.324', 'FRAGCOUNT': '27.000'} [2023-02-24 21:09:32,240][213366] DAMAGECOUNT value on done: 426982.0 [2023-02-24 21:09:32,240][213366] Sum rewards: 41.985, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.579', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'weapon5': '0.034', 'AMMO4': '0.051', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.434', 'WEAPON3': '0.850', 'weapon2': '0.860', 'weapon3': '2.504', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '10.764', 'FRAGCOUNT': '34.000'} [2023-02-24 21:09:32,552][213366] DAMAGECOUNT value on done: 411009.0 [2023-02-24 21:09:32,553][213366] Sum rewards: 50.339, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.290', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'ARMOR': '0.004', 'AMMO5': '0.007', 'weapon5': '0.012', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.208', 'AMMO3': '0.232', 'weapon2': '0.438', 'WEAPON3': '1.350', 'weapon3': '3.114', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.635', 'FRAGCOUNT': '44.500'} [2023-02-24 21:09:32,770][213369] DAMAGECOUNT value on done: 418402.0 [2023-02-24 21:09:32,771][213369] Sum rewards: 34.447, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.910', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.054', 'AMMO4': '0.094', 'WEAPON5': '0.200', 'AMMO3': '0.262', 'weapon4': '0.294', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '2.480', 'weapon3': '3.066', 'DAMAGECOUNT': '10.785', 'FRAGCOUNT': '34.000'} [2023-02-24 21:09:32,859][213383] DAMAGECOUNT value on done: 411663.0 [2023-02-24 21:09:32,859][213383] Sum rewards: 40.343, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.725', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.146', 'AMMO4': '0.177', 'AMMO3': '0.183', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.368', 'weapon2': '0.380', 'WEAPON3': '1.250', 'weapon3': '2.676', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '11.436', 'FRAGCOUNT': '37.500'} [2023-02-24 21:09:32,937][213368] DAMAGECOUNT value on done: 410102.0 [2023-02-24 21:09:32,937][213368] Sum rewards: 31.358, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.768', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.068', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'weapon2': '0.318', 'WEAPON4': '0.400', 'weapon4': '0.470', 'WEAPON3': '1.450', 'HITCOUNT': '2.490', 'weapon3': '2.910', 'DAMAGECOUNT': '9.723', 'FRAGCOUNT': '31.000'} [2023-02-24 21:09:32,991][213382] DAMAGECOUNT value on done: 415919.0 [2023-02-24 21:09:32,992][213382] Sum rewards: 55.528, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.485', 'AMMO5': '0.009', 'weapon5': '0.014', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon4': '0.088', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'weapon2': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '3.100', 'weapon3': '3.284', 'DAMAGECOUNT': '13.101', 'FRAGCOUNT': '50.000'} [2023-02-24 21:09:33,088][213369] DAMAGECOUNT value on done: 416407.0 [2023-02-24 21:09:33,089][213369] Sum rewards: 45.029, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.620', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.012', 'WEAPON4': '0.050', 'weapon4': '0.122', 'weapon5': '0.146', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.628', 'WEAPON3': '1.350', 'HITCOUNT': '2.810', 'weapon3': '2.882', 'DAMAGECOUNT': '13.188', 'FRAGCOUNT': '38.000'} [2023-02-24 21:09:33,179][213383] DAMAGECOUNT value on done: 415038.0 [2023-02-24 21:09:33,180][213383] Sum rewards: 40.209, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.872', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO3': '0.201', 'AMMO4': '0.204', 'weapon5': '0.232', 'weapon2': '0.282', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.514', 'WEAPON3': '1.200', 'weapon3': '2.614', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.144', 'FRAGCOUNT': '36.000'} [2023-02-24 21:09:33,246][213368] DAMAGECOUNT value on done: 415370.0 [2023-02-24 21:09:33,246][213368] Sum rewards: 40.187, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.724', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.087', 'AMMO3': '0.122', 'weapon5': '0.140', 'WEAPON5': '0.200', 'weapon4': '0.376', 'WEAPON4': '0.400', 'WEAPON3': '0.900', 'weapon2': '0.930', 'weapon3': '2.328', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '10.971', 'FRAGCOUNT': '35.000'} [2023-02-24 21:09:33,305][213382] DAMAGECOUNT value on done: 416567.0 [2023-02-24 21:09:33,305][213382] Sum rewards: 34.107, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.690', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'weapon4': '0.426', 'weapon2': '0.752', 'WEAPON3': '1.050', 'HITCOUNT': '2.430', 'weapon3': '2.494', 'DAMAGECOUNT': '11.157', 'FRAGCOUNT': '29.000'} [2023-02-24 21:09:33,404][213369] DAMAGECOUNT value on done: 416587.0 [2023-02-24 21:09:33,405][213369] Sum rewards: 38.037, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.832', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.043', 'AMMO3': '0.161', 'AMMO4': '0.213', 'weapon5': '0.240', 'weapon4': '0.290', 'weapon2': '0.408', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'HITCOUNT': '2.570', 'weapon3': '2.742', 'DAMAGECOUNT': '11.475', 'FRAGCOUNT': '34.000'} [2023-02-24 21:09:33,495][213368] DAMAGECOUNT value on done: 411104.0 [2023-02-24 21:09:33,497][213368] Sum rewards: 28.535, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.526', 'ARMOR': '0.004', 'AMMO5': '0.026', 'AMMO2': '0.048', 'weapon5': '0.138', 'AMMO3': '0.191', 'AMMO4': '0.241', 'weapon4': '0.426', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'weapon2': '0.658', 'WEAPON3': '1.100', 'HITCOUNT': '1.860', 'weapon3': '2.482', 'DAMAGECOUNT': '8.787', 'FRAGCOUNT': '29.000'} [2023-02-24 21:09:33,553][213365] Updated weights for policy 0, policy_version 33276 (0.0009) [2023-02-24 21:09:33,612][213382] DAMAGECOUNT value on done: 403265.0 [2023-02-24 21:09:33,613][213382] Sum rewards: 37.027, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.019', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.114', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.292', 'WEAPON4': '0.300', 'weapon4': '0.780', 'WEAPON3': '1.200', 'weapon3': '2.402', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '10.866', 'FRAGCOUNT': '34.000'} [2023-02-24 21:09:33,716][213384] DAMAGECOUNT value on done: 421238.0 [2023-02-24 21:09:33,717][213384] Sum rewards: 31.931, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.362', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon5': '0.142', 'AMMO3': '0.231', 'AMMO4': '0.267', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.872', 'WEAPON3': '1.500', 'weapon3': '2.408', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '10.863', 'FRAGCOUNT': '32.000'} [2023-02-24 21:09:33,722][213369] DAMAGECOUNT value on done: 403902.0 [2023-02-24 21:09:33,722][213369] Sum rewards: 36.254, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.573', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon7': '0.060', 'weapon5': '0.140', 'AMMO4': '0.145', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'weapon4': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.450', 'HITCOUNT': '2.560', 'weapon3': '2.922', 'DAMAGECOUNT': '12.036', 'FRAGCOUNT': '35.000'} [2023-02-24 21:09:33,815][213368] DAMAGECOUNT value on done: 408615.0 [2023-02-24 21:09:33,817][213368] Sum rewards: 49.825, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.730', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.134', 'AMMO4': '0.179', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.448', 'weapon2': '0.562', 'WEAPON3': '1.100', 'weapon3': '2.664', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.753', 'FRAGCOUNT': '43.000'} [2023-02-24 21:09:33,862][213383] DAMAGECOUNT value on done: 417129.0 [2023-02-24 21:09:33,863][213383] Sum rewards: 52.067, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.850', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'weapon5': '0.020', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.204', 'weapon2': '0.506', 'WEAPON3': '1.200', 'HITCOUNT': '3.060', 'weapon3': '3.192', 'DAMAGECOUNT': '13.254', 'FRAGCOUNT': '44.000'} [2023-02-24 21:09:33,952][213382] DAMAGECOUNT value on done: 412088.0 [2023-02-24 21:09:33,952][213382] Sum rewards: 45.221, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.790', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.102', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.356', 'WEAPON4': '0.400', 'weapon4': '0.516', 'WEAPON3': '1.250', 'weapon3': '2.790', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.197', 'FRAGCOUNT': '41.000'} [2023-02-24 21:09:34,033][213384] DAMAGECOUNT value on done: 400379.0 [2023-02-24 21:09:34,034][213384] Sum rewards: 38.138, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.166', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon5': '0.026', 'AMMO4': '0.057', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon4': '0.394', 'weapon2': '0.514', 'WEAPON3': '1.550', 'weapon3': '2.830', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '11.667', 'FRAGCOUNT': '36.500'} [2023-02-24 21:09:34,165][213383] DAMAGECOUNT value on done: 408132.0 [2023-02-24 21:09:34,166][213383] Sum rewards: 40.480, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.430', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.164', 'WEAPON5': '0.200', 'AMMO4': '0.233', 'AMMO3': '0.253', 'weapon2': '0.426', 'WEAPON4': '0.500', 'weapon4': '0.794', 'WEAPON3': '1.450', 'weapon3': '2.286', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '11.733', 'FRAGCOUNT': '40.000'} [2023-02-24 21:09:34,358][213384] DAMAGECOUNT value on done: 417115.0 [2023-02-24 21:09:34,358][213384] Sum rewards: 39.666, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.993', 'AMMO5': '0.017', 'AMMO2': '0.034', 'AMMO4': '0.168', 'AMMO3': '0.238', 'weapon5': '0.270', 'weapon2': '0.328', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.548', 'WEAPON3': '1.400', 'weapon3': '2.536', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '11.970', 'FRAGCOUNT': '38.000'} [2023-02-24 21:09:34,668][213384] DAMAGECOUNT value on done: 419521.0 [2023-02-24 21:09:34,669][213384] Sum rewards: 38.181, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.074', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.058', 'AMMO3': '0.163', 'weapon5': '0.240', 'AMMO4': '0.292', 'weapon2': '0.584', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'weapon4': '0.714', 'WEAPON3': '0.950', 'weapon3': '2.152', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '10.713', 'FRAGCOUNT': '35.000'} [2023-02-24 21:09:35,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 136318976. Throughput: 0: 3365.4. Samples: 9069042. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 21:09:35,243][213332] Avg episode reward: [(0, '41.555')] [2023-02-24 21:09:36,548][213365] Updated weights for policy 0, policy_version 33286 (0.0009) [2023-02-24 21:09:39,611][213365] Updated weights for policy 0, policy_version 33296 (0.0009) [2023-02-24 21:09:40,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 136388608. Throughput: 0: 3367.8. Samples: 9089286. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 21:09:40,243][213332] Avg episode reward: [(0, '41.555')] [2023-02-24 21:09:42,595][213365] Updated weights for policy 0, policy_version 33306 (0.0009) [2023-02-24 21:09:45,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 136454144. Throughput: 0: 3367.3. Samples: 9109498. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 21:09:45,243][213332] Avg episode reward: [(0, '41.555')] [2023-02-24 21:09:45,670][213365] Updated weights for policy 0, policy_version 33316 (0.0009) [2023-02-24 21:09:46,498][213366] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 21:09:48,709][213365] Updated weights for policy 0, policy_version 33326 (0.0009) [2023-02-24 21:09:49,941][213367] DAMAGECOUNT value on done: 412953.0 [2023-02-24 21:09:49,941][213367] Sum rewards: 35.243, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.452', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon5': '0.128', 'weapon4': '0.180', 'AMMO3': '0.223', 'AMMO4': '0.235', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.350', 'weapon3': '2.994', 'DAMAGECOUNT': '10.572', 'FRAGCOUNT': '33.000'} [2023-02-24 21:09:50,116][213367] DAMAGECOUNT value on done: 421204.0 [2023-02-24 21:09:50,117][213367] Sum rewards: 48.288, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.297', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.098', 'AMMO4': '0.117', 'weapon4': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon2': '0.574', 'WEAPON3': '1.450', 'weapon3': '2.918', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.550', 'FRAGCOUNT': '43.000'} [2023-02-24 21:09:50,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13509.9). Total num frames: 136523776. Throughput: 0: 3367.1. Samples: 9119714. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 21:09:50,243][213332] Avg episode reward: [(0, '41.635')] [2023-02-24 21:09:50,247][213367] DAMAGECOUNT value on done: 416084.0 [2023-02-24 21:09:50,248][213367] Sum rewards: 25.846, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.328', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon7': '0.072', 'weapon5': '0.080', 'AMMO4': '0.085', 'AMMO3': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.370', 'WEAPON3': '0.650', 'weapon4': '0.692', 'weapon3': '1.604', 'HITCOUNT': '1.770', 'DAMAGECOUNT': '7.272', 'FRAGCOUNT': '21.000'} [2023-02-24 21:09:50,429][213367] DAMAGECOUNT value on done: 420870.0 [2023-02-24 21:09:50,429][213367] Sum rewards: 42.235, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.492', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.053', 'weapon5': '0.210', 'AMMO3': '0.224', 'AMMO4': '0.267', 'WEAPON5': '0.350', 'weapon2': '0.442', 'weapon4': '0.554', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'HITCOUNT': '2.440', 'weapon3': '2.476', 'DAMAGECOUNT': '11.241', 'FRAGCOUNT': '39.000'} [2023-02-24 21:09:51,212][213372] DAMAGECOUNT value on done: 422894.0 [2023-02-24 21:09:51,212][213372] Sum rewards: 36.855, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.560', 'AMMO5': '0.013', 'ARMOR': '0.020', 'AMMO2': '0.053', 'AMMO3': '0.153', 'weapon5': '0.156', 'weapon2': '0.218', 'AMMO4': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '0.850', 'weapon4': '1.148', 'weapon3': '1.866', 'HITCOUNT': '2.370', 'DAMAGECOUNT': '10.254', 'FRAGCOUNT': '32.000'} [2023-02-24 21:09:51,341][213372] DAMAGECOUNT value on done: 414633.0 [2023-02-24 21:09:51,342][213372] Sum rewards: 39.197, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.662', 'AMMO5': '0.022', 'AMMO2': '0.044', 'AMMO3': '0.167', 'AMMO4': '0.218', 'weapon5': '0.252', 'WEAPON4': '0.500', 'weapon4': '0.508', 'WEAPON5': '0.600', 'weapon2': '0.776', 'WEAPON3': '1.000', 'weapon3': '2.126', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '11.046', 'FRAGCOUNT': '36.000'} [2023-02-24 21:09:51,515][213372] DAMAGECOUNT value on done: 425565.0 [2023-02-24 21:09:51,515][213372] Sum rewards: 34.313, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.582', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.065', 'AMMO3': '0.197', 'weapon5': '0.228', 'AMMO4': '0.327', 'WEAPON5': '0.350', 'weapon4': '0.428', 'WEAPON4': '0.450', 'weapon2': '0.584', 'WEAPON3': '1.150', 'HITCOUNT': '1.870', 'weapon3': '2.366', 'DAMAGECOUNT': '10.107', 'FRAGCOUNT': '32.000'} [2023-02-24 21:09:51,649][213372] DAMAGECOUNT value on done: 411592.0 [2023-02-24 21:09:51,650][213372] Sum rewards: 31.576, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.994', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.072', 'WEAPON5': '0.250', 'AMMO4': '0.252', 'AMMO3': '0.282', 'weapon2': '0.348', 'ARMOR': '0.400', 'WEAPON4': '0.600', 'weapon4': '0.866', 'WEAPON3': '1.700', 'weapon3': '2.262', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '10.902', 'FRAGCOUNT': '34.000'} [2023-02-24 21:09:51,720][213365] Updated weights for policy 0, policy_version 33336 (0.0009) [2023-02-24 21:09:51,940][213366] DAMAGECOUNT value on done: 412593.0 [2023-02-24 21:09:51,941][213366] Sum rewards: 48.951, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.295', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.161', 'WEAPON4': '0.250', 'weapon2': '0.314', 'weapon4': '0.508', 'WEAPON3': '1.100', 'weapon3': '2.896', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.353', 'FRAGCOUNT': '40.500'} [2023-02-24 21:09:52,248][213366] DAMAGECOUNT value on done: 422145.0 [2023-02-24 21:09:52,248][213366] Sum rewards: 41.084, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.408', 'AMMO5': '0.012', 'AMMO2': '0.064', 'weapon5': '0.174', 'AMMO3': '0.219', 'AMMO4': '0.319', 'weapon2': '0.344', 'WEAPON5': '0.350', 'weapon4': '0.426', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.802', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.192', 'FRAGCOUNT': '38.500'} [2023-02-24 21:09:52,258][213366] DAMAGECOUNT value on done: 431270.0 [2023-02-24 21:09:52,259][213366] Sum rewards: 54.338, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.504', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon4': '0.072', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.376', 'WEAPON3': '1.350', 'HITCOUNT': '2.740', 'weapon3': '3.254', 'DAMAGECOUNT': '12.864', 'FRAGCOUNT': '48.000'} [2023-02-24 21:09:52,581][213366] DAMAGECOUNT value on done: 415807.0 [2023-02-24 21:09:52,582][213366] Sum rewards: 50.078, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.700', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.144', 'AMMO3': '0.222', 'weapon2': '0.258', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.652', 'WEAPON3': '1.350', 'weapon3': '2.554', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.199', 'FRAGCOUNT': '46.000'} [2023-02-24 21:09:52,749][213369] DAMAGECOUNT value on done: 422631.0 [2023-02-24 21:09:52,749][213369] Sum rewards: 44.248, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.805', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'weapon5': '0.234', 'weapon2': '0.380', 'weapon4': '0.380', 'WEAPON3': '1.200', 'weapon3': '2.744', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.687', 'FRAGCOUNT': '37.000'} [2023-02-24 21:09:52,841][213383] DAMAGECOUNT value on done: 413707.0 [2023-02-24 21:09:52,842][213383] Sum rewards: 16.845, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.405', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.150', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'weapon2': '0.252', 'ARMOR': '0.480', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'weapon4': '1.104', 'HITCOUNT': '1.410', 'weapon3': '1.966', 'DAMAGECOUNT': '6.132', 'FRAGCOUNT': '17.000'} [2023-02-24 21:09:52,883][213368] DAMAGECOUNT value on done: 413955.0 [2023-02-24 21:09:52,884][213368] Sum rewards: 40.720, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.327', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.050', 'AMMO3': '0.168', 'weapon5': '0.178', 'AMMO4': '0.251', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.604', 'weapon2': '0.768', 'WEAPON3': '1.000', 'weapon3': '2.198', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '11.544', 'FRAGCOUNT': '37.500'} [2023-02-24 21:09:52,911][213382] DAMAGECOUNT value on done: 420105.0 [2023-02-24 21:09:52,911][213382] Sum rewards: 48.680, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.540', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.158', 'weapon4': '0.206', 'weapon2': '0.426', 'WEAPON3': '1.000', 'HITCOUNT': '2.980', 'weapon3': '3.140', 'DAMAGECOUNT': '12.558', 'FRAGCOUNT': '39.000'} [2023-02-24 21:09:53,067][213369] DAMAGECOUNT value on done: 420553.0 [2023-02-24 21:09:53,067][213369] Sum rewards: 40.227, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.319', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.029', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.145', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon4': '0.458', 'weapon2': '0.528', 'WEAPON3': '1.250', 'weapon3': '2.772', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.438', 'FRAGCOUNT': '37.000'} [2023-02-24 21:09:53,157][213383] DAMAGECOUNT value on done: 419491.0 [2023-02-24 21:09:53,157][213383] Sum rewards: 46.709, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.505', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.120', 'AMMO3': '0.194', 'weapon4': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.610', 'WEAPON3': '1.300', 'weapon3': '2.756', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.359', 'FRAGCOUNT': '42.000'} [2023-02-24 21:09:53,195][213368] DAMAGECOUNT value on done: 419099.0 [2023-02-24 21:09:53,196][213368] Sum rewards: 38.340, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.214', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.159', 'AMMO3': '0.189', 'WEAPON4': '0.400', 'weapon2': '0.500', 'weapon4': '0.614', 'WEAPON3': '1.100', 'weapon3': '2.350', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '11.187', 'FRAGCOUNT': '36.000'} [2023-02-24 21:09:53,217][213382] DAMAGECOUNT value on done: 420086.0 [2023-02-24 21:09:53,218][213382] Sum rewards: 42.232, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.738', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.112', 'AMMO3': '0.123', 'AMMO4': '0.135', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.626', 'WEAPON3': '0.750', 'weapon2': '1.188', 'weapon3': '1.832', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '10.557', 'FRAGCOUNT': '33.000'} [2023-02-24 21:09:53,374][213369] DAMAGECOUNT value on done: 420389.0 [2023-02-24 21:09:53,375][213369] Sum rewards: 35.056, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.822', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO4': '0.184', 'weapon5': '0.204', 'weapon2': '0.208', 'AMMO3': '0.281', 'WEAPON5': '0.300', 'WEAPON4': '0.600', 'weapon4': '1.080', 'WEAPON3': '1.650', 'weapon3': '2.186', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '11.406', 'FRAGCOUNT': '37.000'} [2023-02-24 21:09:53,449][213368] DAMAGECOUNT value on done: 414980.0 [2023-02-24 21:09:53,449][213368] Sum rewards: 36.209, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.253', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon5': '0.166', 'AMMO4': '0.174', 'AMMO3': '0.225', 'WEAPON5': '0.350', 'weapon2': '0.408', 'WEAPON4': '0.550', 'weapon4': '0.560', 'WEAPON3': '1.350', 'weapon3': '2.458', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '11.628', 'FRAGCOUNT': '37.000'} [2023-02-24 21:09:53,519][213382] DAMAGECOUNT value on done: 407079.0 [2023-02-24 21:09:53,519][213382] Sum rewards: 44.415, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.120', 'ARMOR': '0.004', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.123', 'AMMO4': '0.132', 'weapon4': '0.172', 'weapon5': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.628', 'WEAPON3': '0.800', 'HITCOUNT': '2.460', 'weapon3': '2.504', 'DAMAGECOUNT': '11.442', 'FRAGCOUNT': '37.000'} [2023-02-24 21:09:53,563][213384] DAMAGECOUNT value on done: 424496.0 [2023-02-24 21:09:53,564][213384] Sum rewards: 28.646, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.332', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.059', 'weapon5': '0.140', 'AMMO3': '0.147', 'WEAPON5': '0.200', 'AMMO4': '0.297', 'weapon2': '0.392', 'WEAPON4': '0.700', 'WEAPON3': '0.850', 'weapon4': '1.386', 'weapon3': '1.842', 'HITCOUNT': '2.170', 'DAMAGECOUNT': '9.774', 'FRAGCOUNT': '27.000'} [2023-02-24 21:09:53,686][213369] DAMAGECOUNT value on done: 407905.0 [2023-02-24 21:09:53,687][213369] Sum rewards: 41.172, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.821', 'AMMO5': '0.027', 'AMMO2': '0.046', 'AMMO3': '0.188', 'AMMO4': '0.231', 'weapon5': '0.386', 'WEAPON5': '0.600', 'weapon2': '0.616', 'WEAPON4': '0.650', 'weapon4': '0.772', 'WEAPON3': '1.100', 'weapon3': '1.898', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '12.009', 'FRAGCOUNT': '38.000'} [2023-02-24 21:09:53,761][213368] DAMAGECOUNT value on done: 412618.0 [2023-02-24 21:09:53,761][213368] Sum rewards: 41.394, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.648', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO3': '0.185', 'AMMO4': '0.198', 'weapon5': '0.246', 'weapon4': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.704', 'WEAPON3': '1.100', 'HITCOUNT': '2.510', 'weapon3': '2.516', 'DAMAGECOUNT': '12.009', 'FRAGCOUNT': '36.000'} [2023-02-24 21:09:53,812][213383] DAMAGECOUNT value on done: 421366.0 [2023-02-24 21:09:53,812][213383] Sum rewards: 45.308, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.163', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.060', 'AMMO3': '0.151', 'weapon5': '0.182', 'AMMO4': '0.299', 'WEAPON5': '0.350', 'weapon2': '0.428', 'WEAPON4': '0.450', 'weapon4': '0.496', 'WEAPON3': '0.950', 'weapon3': '2.634', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.711', 'FRAGCOUNT': '38.500'} [2023-02-24 21:09:53,835][213382] DAMAGECOUNT value on done: 416711.0 [2023-02-24 21:09:53,836][213382] Sum rewards: 54.310, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.765', 'AMMO5': '0.007', 'AMMO2': '0.035', 'AMMO3': '0.148', 'weapon5': '0.150', 'AMMO4': '0.174', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.452', 'weapon4': '0.894', 'WEAPON3': '0.950', 'weapon3': '2.286', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.869', 'FRAGCOUNT': '47.000'} [2023-02-24 21:09:53,878][213384] DAMAGECOUNT value on done: 404887.0 [2023-02-24 21:09:53,879][213384] Sum rewards: 54.111, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.780', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.005', 'weapon5': '0.016', 'WEAPON5': '0.100', 'weapon2': '0.150', 'AMMO3': '0.193', 'WEAPON3': '1.150', 'HITCOUNT': '3.050', 'weapon3': '3.700', 'DAMAGECOUNT': '13.524', 'FRAGCOUNT': '45.000'} [2023-02-24 21:09:54,130][213383] DAMAGECOUNT value on done: 412271.0 [2023-02-24 21:09:54,130][213383] Sum rewards: 47.684, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.812', 'AMMO5': '0.014', 'AMMO2': '0.026', 'weapon4': '0.058', 'weapon5': '0.104', 'AMMO4': '0.130', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.440', 'WEAPON3': '1.300', 'HITCOUNT': '2.590', 'weapon3': '3.154', 'DAMAGECOUNT': '12.417', 'FRAGCOUNT': '42.000'} [2023-02-24 21:09:54,190][213384] DAMAGECOUNT value on done: 419265.0 [2023-02-24 21:09:54,191][213384] Sum rewards: 17.941, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.330', 'AMMO5': '0.014', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.104', 'weapon7': '0.142', 'AMMO3': '0.156', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'weapon4': '0.832', 'weapon2': '0.868', 'WEAPON3': '0.950', 'HITCOUNT': '1.310', 'weapon3': '1.752', 'DAMAGECOUNT': '6.450', 'FRAGCOUNT': '19.000'} [2023-02-24 21:09:54,494][213384] DAMAGECOUNT value on done: 422176.0 [2023-02-24 21:09:54,495][213384] Sum rewards: 36.492, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.970', 'AMMO2': '0.002', 'AMMO4': '0.007', 'AMMO5': '0.013', 'weapon5': '0.014', 'AMMO3': '0.123', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.396', 'ARMOR': '0.469', 'WEAPON3': '0.850', 'weapon2': '0.938', 'HITCOUNT': '1.900', 'weapon3': '2.336', 'DAMAGECOUNT': '7.965', 'FRAGCOUNT': '32.000'} [2023-02-24 21:09:54,841][213365] Updated weights for policy 0, policy_version 33346 (0.0009) [2023-02-24 21:09:55,181][213383] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 21:09:55,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 136589312. Throughput: 0: 3363.4. Samples: 9139718. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 21:09:55,243][213332] Avg episode reward: [(0, '41.320')] [2023-02-24 21:09:57,800][213365] Updated weights for policy 0, policy_version 33356 (0.0009) [2023-02-24 21:10:00,243][213332] Fps is (10 sec: 13107.2, 60 sec: 13448.6, 300 sec: 13496.0). Total num frames: 136654848. Throughput: 0: 3368.3. Samples: 9160032. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 21:10:00,243][213332] Avg episode reward: [(0, '41.320')] [2023-02-24 21:10:00,868][213365] Updated weights for policy 0, policy_version 33366 (0.0008) [2023-02-24 21:10:03,922][213365] Updated weights for policy 0, policy_version 33376 (0.0009) [2023-02-24 21:10:05,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 136724480. Throughput: 0: 3366.9. Samples: 9170252. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-24 21:10:05,243][213332] Avg episode reward: [(0, '41.320')] [2023-02-24 21:10:06,898][213365] Updated weights for policy 0, policy_version 33386 (0.0008) [2023-02-24 21:10:09,877][213367] DAMAGECOUNT value on done: 417862.0 [2023-02-24 21:10:09,878][213367] Sum rewards: 48.243, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.228', 'AMMO5': '0.018', 'AMMO2': '0.029', 'weapon4': '0.114', 'AMMO4': '0.148', 'weapon5': '0.186', 'AMMO3': '0.269', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.614', 'WEAPON3': '1.650', 'weapon3': '2.716', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.727', 'FRAGCOUNT': '46.000'} [2023-02-24 21:10:09,993][213365] Updated weights for policy 0, policy_version 33396 (0.0009) [2023-02-24 21:10:10,071][213367] DAMAGECOUNT value on done: 425401.0 [2023-02-24 21:10:10,072][213367] Sum rewards: 47.290, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.698', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon5': '0.102', 'AMMO4': '0.160', 'AMMO3': '0.278', 'weapon2': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.338', 'ARMOR': '0.400', 'WEAPON3': '1.700', 'HITCOUNT': '2.800', 'weapon3': '3.024', 'DAMAGECOUNT': '12.495', 'FRAGCOUNT': '46.000'} [2023-02-24 21:10:10,183][213367] DAMAGECOUNT value on done: 419800.0 [2023-02-24 21:10:10,184][213367] Sum rewards: 36.248, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.438', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.084', 'AMMO4': '0.148', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'weapon4': '0.330', 'weapon2': '0.420', 'WEAPON3': '1.500', 'HITCOUNT': '2.310', 'weapon3': '2.896', 'DAMAGECOUNT': '11.148', 'FRAGCOUNT': '35.500'} [2023-02-24 21:10:10,243][213332] Fps is (10 sec: 13516.5, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 136790016. Throughput: 0: 3372.4. Samples: 9190448. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 21:10:10,244][213332] Avg episode reward: [(0, '41.435')] [2023-02-24 21:10:10,378][213367] DAMAGECOUNT value on done: 425179.0 [2023-02-24 21:10:10,378][213367] Sum rewards: 46.777, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.978', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.055', 'weapon5': '0.116', 'AMMO3': '0.215', 'AMMO4': '0.273', 'WEAPON5': '0.350', 'weapon2': '0.470', 'WEAPON4': '0.500', 'weapon4': '0.642', 'WEAPON3': '1.300', 'weapon3': '2.504', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.927', 'FRAGCOUNT': '44.000'} [2023-02-24 21:10:11,049][213372] DAMAGECOUNT value on done: 427429.0 [2023-02-24 21:10:11,049][213372] Sum rewards: 52.739, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.750', 'AMMO5': '0.005', 'AMMO2': '0.035', 'WEAPON5': '0.150', 'AMMO4': '0.174', 'AMMO3': '0.177', 'weapon2': '0.180', 'weapon5': '0.194', 'WEAPON4': '0.200', 'weapon4': '0.310', 'WEAPON3': '1.100', 'HITCOUNT': '3.040', 'weapon3': '3.068', 'DAMAGECOUNT': '13.605', 'FRAGCOUNT': '44.000'} [2023-02-24 21:10:11,147][213369] Large shaping reward 2.574 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.552, 184.0), ('weapon5', 0.002)] [2023-02-24 21:10:11,203][213372] DAMAGECOUNT value on done: 418927.0 [2023-02-24 21:10:11,204][213372] Sum rewards: 43.557, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.254', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.039', 'AMMO3': '0.188', 'AMMO4': '0.196', 'weapon5': '0.314', 'weapon2': '0.368', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon4': '0.772', 'WEAPON3': '1.100', 'weapon3': '2.156', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '12.882', 'FRAGCOUNT': '38.000'} [2023-02-24 21:10:11,362][213372] DAMAGECOUNT value on done: 428482.0 [2023-02-24 21:10:11,362][213372] Sum rewards: 25.846, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.826', 'AMMO5': '0.005', 'weapon5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO4': '0.154', 'AMMO3': '0.255', 'WEAPON4': '0.450', 'weapon4': '0.468', 'weapon2': '0.650', 'WEAPON3': '1.550', 'HITCOUNT': '2.090', 'weapon3': '2.400', 'DAMAGECOUNT': '8.751', 'FRAGCOUNT': '31.000'} [2023-02-24 21:10:11,512][213372] DAMAGECOUNT value on done: 415190.0 [2023-02-24 21:10:11,512][213372] Sum rewards: 38.591, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.672', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'WEAPON4': '0.250', 'weapon2': '0.390', 'weapon4': '0.600', 'WEAPON3': '0.800', 'HITCOUNT': '2.490', 'weapon3': '2.726', 'DAMAGECOUNT': '10.794', 'FRAGCOUNT': '32.000'} [2023-02-24 21:10:11,658][213367] Large shaping reward 3.642 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 21:10:11,803][213366] DAMAGECOUNT value on done: 416035.0 [2023-02-24 21:10:11,803][213366] Sum rewards: 41.003, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.016', 'AMMO2': '0.021', 'HEALTH': '0.042', 'AMMO4': '0.105', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon5': '0.406', 'weapon2': '0.434', 'weapon4': '0.462', 'WEAPON3': '0.900', 'HITCOUNT': '2.090', 'weapon3': '2.484', 'DAMAGECOUNT': '10.326', 'FRAGCOUNT': '35.000'} [2023-02-24 21:10:12,113][213366] DAMAGECOUNT value on done: 425565.0 [2023-02-24 21:10:12,113][213366] Sum rewards: 31.542, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.434', 'AMMO5': '0.019', 'AMMO2': '0.065', 'AMMO3': '0.133', 'AMMO4': '0.326', 'ARMOR': '0.460', 'weapon2': '0.512', 'WEAPON5': '0.550', 'weapon5': '0.554', 'WEAPON4': '0.750', 'WEAPON3': '0.800', 'weapon4': '0.826', 'weapon3': '1.744', 'HITCOUNT': '2.060', 'DAMAGECOUNT': '10.176', 'FRAGCOUNT': '29.000'} [2023-02-24 21:10:12,124][213366] DAMAGECOUNT value on done: 435405.0 [2023-02-24 21:10:12,124][213366] Sum rewards: 44.289, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.734', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.124', 'AMMO4': '0.160', 'weapon5': '0.224', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.460', 'weapon3': '2.974', 'DAMAGECOUNT': '12.405', 'FRAGCOUNT': '41.000'} [2023-02-24 21:10:12,440][213366] DAMAGECOUNT value on done: 419897.0 [2023-02-24 21:10:12,441][213366] Sum rewards: 49.684, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.474', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO5': '0.012', 'AMMO4': '0.035', 'weapon5': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'weapon4': '0.256', 'WEAPON5': '0.300', 'weapon2': '0.532', 'WEAPON3': '1.050', 'HITCOUNT': '2.720', 'weapon3': '2.782', 'DAMAGECOUNT': '12.270', 'FRAGCOUNT': '41.000'} [2023-02-24 21:10:12,695][213369] DAMAGECOUNT value on done: 426155.0 [2023-02-24 21:10:12,695][213369] Sum rewards: 32.939, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.630', 'ARMOR': '0.008', 'AMMO5': '0.021', 'AMMO2': '0.064', 'AMMO3': '0.140', 'AMMO4': '0.318', 'weapon5': '0.352', 'weapon2': '0.518', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'weapon4': '0.688', 'WEAPON3': '0.900', 'HITCOUNT': '2.070', 'weapon3': '2.168', 'DAMAGECOUNT': '10.572', 'FRAGCOUNT': '31.500'} [2023-02-24 21:10:12,776][213383] DAMAGECOUNT value on done: 417492.0 [2023-02-24 21:10:12,776][213383] Sum rewards: 44.330, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.320', 'AMMO5': '0.004', 'AMMO2': '0.017', 'weapon5': '0.040', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.170', 'AMMO3': '0.192', 'weapon4': '0.436', 'WEAPON3': '1.150', 'HITCOUNT': '2.480', 'weapon3': '3.224', 'DAMAGECOUNT': '11.355', 'FRAGCOUNT': '39.000'} [2023-02-24 21:10:12,790][213368] DAMAGECOUNT value on done: 417600.0 [2023-02-24 21:10:12,790][213368] Sum rewards: 38.450, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.246', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.023', 'weapon7': '0.048', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'weapon4': '0.188', 'AMMO3': '0.235', 'weapon2': '0.808', 'WEAPON3': '1.300', 'HITCOUNT': '2.240', 'weapon3': '2.720', 'DAMAGECOUNT': '10.695', 'FRAGCOUNT': '35.000'} [2023-02-24 21:10:12,810][213382] DAMAGECOUNT value on done: 424458.0 [2023-02-24 21:10:12,810][213382] Sum rewards: 42.213, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.725', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.044', 'AMMO4': '0.218', 'weapon2': '0.238', 'AMMO3': '0.250', 'weapon5': '0.270', 'WEAPON4': '0.450', 'weapon4': '0.512', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.632', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '13.059', 'FRAGCOUNT': '39.000'} [2023-02-24 21:10:12,984][213365] Updated weights for policy 0, policy_version 33406 (0.0009) [2023-02-24 21:10:13,018][213369] DAMAGECOUNT value on done: 424367.0 [2023-02-24 21:10:13,019][213369] Sum rewards: 40.162, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.258', 'AMMO5': '0.009', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.095', 'weapon5': '0.106', 'weapon2': '0.148', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.466', 'WEAPON3': '1.300', 'HITCOUNT': '2.640', 'weapon3': '2.916', 'DAMAGECOUNT': '11.442', 'FRAGCOUNT': '37.000'} [2023-02-24 21:10:13,100][213383] DAMAGECOUNT value on done: 423534.0 [2023-02-24 21:10:13,101][213383] Sum rewards: 39.485, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.462', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.178', 'weapon4': '0.200', 'AMMO4': '0.207', 'AMMO3': '0.233', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.378', 'WEAPON3': '1.400', 'HITCOUNT': '2.550', 'weapon3': '2.960', 'DAMAGECOUNT': '12.129', 'FRAGCOUNT': '39.000'} [2023-02-24 21:10:13,117][213368] DAMAGECOUNT value on done: 423333.0 [2023-02-24 21:10:13,117][213368] Sum rewards: 40.852, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.598', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.031', 'AMMO4': '0.155', 'AMMO3': '0.198', 'weapon5': '0.200', 'weapon2': '0.364', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.710', 'WEAPON3': '1.100', 'weapon3': '2.298', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '12.702', 'FRAGCOUNT': '37.500'} [2023-02-24 21:10:13,132][213382] DAMAGECOUNT value on done: 424604.0 [2023-02-24 21:10:13,133][213382] Sum rewards: 52.847, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.618', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.052', 'weapon4': '0.056', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'weapon2': '0.688', 'WEAPON3': '1.100', 'HITCOUNT': '2.960', 'weapon3': '2.974', 'DAMAGECOUNT': '13.554', 'FRAGCOUNT': '44.000'} [2023-02-24 21:10:13,339][213369] DAMAGECOUNT value on done: 425292.0 [2023-02-24 21:10:13,339][213369] Sum rewards: 54.507, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.792', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.102', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'weapon2': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.256', 'weapon4': '0.592', 'WEAPON3': '1.600', 'weapon3': '2.814', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.709', 'FRAGCOUNT': '50.000'} [2023-02-24 21:10:13,383][213368] DAMAGECOUNT value on done: 419055.0 [2023-02-24 21:10:13,383][213368] Sum rewards: 48.600, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.923', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'weapon4': '0.408', 'weapon2': '0.470', 'WEAPON3': '1.050', 'HITCOUNT': '2.890', 'weapon3': '2.912', 'DAMAGECOUNT': '12.225', 'FRAGCOUNT': '42.000'} [2023-02-24 21:10:13,445][213382] DAMAGECOUNT value on done: 410693.0 [2023-02-24 21:10:13,446][213382] Sum rewards: 35.365, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.950', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.039', 'AMMO3': '0.111', 'weapon5': '0.116', 'AMMO4': '0.195', 'WEAPON5': '0.250', 'weapon2': '0.408', 'WEAPON3': '0.700', 'WEAPON4': '0.750', 'weapon4': '1.298', 'weapon3': '1.850', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '10.827', 'FRAGCOUNT': '32.000'} [2023-02-24 21:10:13,518][213384] DAMAGECOUNT value on done: 428790.0 [2023-02-24 21:10:13,519][213384] Sum rewards: 48.963, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.770', 'AMMO5': '0.020', 'AMMO2': '0.038', 'AMMO3': '0.155', 'AMMO4': '0.189', 'weapon2': '0.232', 'weapon5': '0.328', 'weapon4': '0.392', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '0.950', 'HITCOUNT': '2.650', 'weapon3': '2.846', 'DAMAGECOUNT': '12.882', 'FRAGCOUNT': '42.000'} [2023-02-24 21:10:13,656][213369] DAMAGECOUNT value on done: 412357.0 [2023-02-24 21:10:13,656][213369] Sum rewards: 44.239, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.012', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.134', 'WEAPON5': '0.200', 'AMMO3': '0.268', 'weapon4': '0.272', 'WEAPON4': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.600', 'weapon3': '2.956', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.356', 'FRAGCOUNT': '42.000'} [2023-02-24 21:10:13,697][213368] DAMAGECOUNT value on done: 416674.0 [2023-02-24 21:10:13,697][213368] Sum rewards: 38.034, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.436', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon5': '0.066', 'AMMO3': '0.183', 'AMMO4': '0.245', 'WEAPON5': '0.350', 'weapon2': '0.442', 'WEAPON4': '0.600', 'weapon4': '0.974', 'WEAPON3': '1.050', 'weapon3': '2.154', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '12.168', 'FRAGCOUNT': '36.000'} [2023-02-24 21:10:13,742][213383] DAMAGECOUNT value on done: 425187.0 [2023-02-24 21:10:13,742][213383] Sum rewards: 34.302, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.100', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.168', 'AMMO3': '0.172', 'weapon4': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.936', 'WEAPON3': '1.100', 'HITCOUNT': '2.390', 'weapon3': '2.446', 'DAMAGECOUNT': '11.463', 'FRAGCOUNT': '32.000'} [2023-02-24 21:10:13,759][213382] DAMAGECOUNT value on done: 420862.0 [2023-02-24 21:10:13,760][213382] Sum rewards: 40.333, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.327', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.050', 'AMMO4': '0.162', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON4': '0.550', 'weapon4': '0.762', 'WEAPON3': '1.350', 'weapon3': '2.692', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.453', 'FRAGCOUNT': '38.000'} [2023-02-24 21:10:13,833][213384] DAMAGECOUNT value on done: 408860.0 [2023-02-24 21:10:13,833][213384] Sum rewards: 43.516, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.255', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon7': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.142', 'AMMO3': '0.197', 'WEAPON7': '0.200', 'AMMO4': '0.202', 'weapon2': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.418', 'WEAPON3': '1.200', 'HITCOUNT': '2.480', 'weapon3': '2.674', 'DAMAGECOUNT': '11.919', 'FRAGCOUNT': '40.000'} [2023-02-24 21:10:14,063][213383] DAMAGECOUNT value on done: 416434.0 [2023-02-24 21:10:14,063][213383] Sum rewards: 42.624, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.708', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO5': '0.027', 'AMMO2': '0.039', 'AMMO3': '0.168', 'AMMO4': '0.193', 'weapon4': '0.318', 'WEAPON4': '0.350', 'weapon5': '0.384', 'WEAPON5': '0.550', 'weapon2': '0.618', 'WEAPON3': '1.000', 'weapon3': '2.354', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '12.489', 'FRAGCOUNT': '38.000'} [2023-02-24 21:10:14,148][213384] DAMAGECOUNT value on done: 422686.0 [2023-02-24 21:10:14,149][213384] Sum rewards: 33.279, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.692', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.044', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'AMMO4': '0.218', 'weapon5': '0.244', 'WEAPON4': '0.300', 'weapon2': '0.576', 'weapon4': '0.898', 'WEAPON3': '1.100', 'weapon3': '2.044', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '10.263', 'FRAGCOUNT': '30.000'} [2023-02-24 21:10:14,451][213384] DAMAGECOUNT value on done: 425343.0 [2023-02-24 21:10:14,452][213384] Sum rewards: 32.790, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.136', 'AMMO5': '0.003', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon2': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.235', 'weapon4': '0.530', 'WEAPON3': '1.400', 'HITCOUNT': '2.130', 'weapon3': '3.004', 'DAMAGECOUNT': '9.501', 'FRAGCOUNT': '32.000'} [2023-02-24 21:10:15,131][213382] Large shaping reward -2.548 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('weapon5', 0.002)] [2023-02-24 21:10:15,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13509.9). Total num frames: 136859648. Throughput: 0: 3369.1. Samples: 9210462. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 21:10:15,243][213332] Avg episode reward: [(0, '40.982')] [2023-02-24 21:10:16,033][213365] Updated weights for policy 0, policy_version 33416 (0.0009) [2023-02-24 21:10:19,071][213365] Updated weights for policy 0, policy_version 33426 (0.0009) [2023-02-24 21:10:20,243][213332] Fps is (10 sec: 13517.0, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 136925184. Throughput: 0: 3371.5. Samples: 9220760. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 21:10:20,243][213332] Avg episode reward: [(0, '40.982')] [2023-02-24 21:10:22,105][213365] Updated weights for policy 0, policy_version 33436 (0.0009) [2023-02-24 21:10:22,724][213384] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 21:10:24,938][213372] Large shaping reward 3.291 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.24, 80.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 21:10:25,200][213365] Updated weights for policy 0, policy_version 33446 (0.0009) [2023-02-24 21:10:25,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13509.9). Total num frames: 136994816. Throughput: 0: 3369.3. Samples: 9240906. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 21:10:25,243][213332] Avg episode reward: [(0, '40.982')] [2023-02-24 21:10:28,183][213365] Updated weights for policy 0, policy_version 33456 (0.0009) [2023-02-24 21:10:29,863][213367] DAMAGECOUNT value on done: 421812.0 [2023-02-24 21:10:29,863][213367] Sum rewards: 44.733, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.400', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.099', 'AMMO3': '0.136', 'weapon5': '0.160', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.464', 'weapon2': '0.656', 'WEAPON3': '0.900', 'weapon3': '2.526', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '11.850', 'FRAGCOUNT': '39.000'} [2023-02-24 21:10:30,056][213367] DAMAGECOUNT value on done: 430162.0 [2023-02-24 21:10:30,056][213367] Sum rewards: 50.509, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.224', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.041', 'AMMO3': '0.167', 'AMMO4': '0.203', 'weapon5': '0.306', 'weapon4': '0.388', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.444', 'WEAPON3': '1.050', 'weapon3': '2.522', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '14.124', 'FRAGCOUNT': '44.000'} [2023-02-24 21:10:30,169][213367] DAMAGECOUNT value on done: 423989.0 [2023-02-24 21:10:30,169][213367] Sum rewards: 50.296, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.716', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.030', 'AMMO4': '0.150', 'AMMO3': '0.195', 'weapon5': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.436', 'weapon2': '0.530', 'WEAPON3': '1.200', 'weapon3': '2.506', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.567', 'FRAGCOUNT': '45.000'} [2023-02-24 21:10:30,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 137060352. Throughput: 0: 3370.9. Samples: 9261188. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 21:10:30,243][213332] Avg episode reward: [(0, '41.036')] [2023-02-24 21:10:30,369][213367] DAMAGECOUNT value on done: 429241.0 [2023-02-24 21:10:30,369][213367] Sum rewards: 44.370, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.796', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon5': '0.080', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon4': '0.400', 'weapon2': '0.566', 'WEAPON3': '1.300', 'weapon3': '2.666', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.186', 'FRAGCOUNT': '40.000'} [2023-02-24 21:10:30,976][213372] DAMAGECOUNT value on done: 431792.0 [2023-02-24 21:10:30,976][213372] Sum rewards: 44.457, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.520', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.042', 'AMMO3': '0.177', 'AMMO4': '0.212', 'weapon5': '0.222', 'weapon2': '0.362', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.734', 'WEAPON3': '1.100', 'weapon3': '2.324', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.083', 'FRAGCOUNT': '39.000'} [2023-02-24 21:10:31,104][213372] DAMAGECOUNT value on done: 423089.0 [2023-02-24 21:10:31,104][213372] Sum rewards: 50.555, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.266', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.074', 'weapon4': '0.092', 'AMMO4': '0.108', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.350', 'HITCOUNT': '2.760', 'weapon3': '3.352', 'DAMAGECOUNT': '12.486', 'FRAGCOUNT': '47.000'} [2023-02-24 21:10:31,221][213365] Updated weights for policy 0, policy_version 33466 (0.0009) [2023-02-24 21:10:31,268][213372] DAMAGECOUNT value on done: 432283.0 [2023-02-24 21:10:31,269][213372] Sum rewards: 36.866, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.548', 'ARMOR': '0.008', 'AMMO5': '0.023', 'AMMO2': '0.043', 'weapon5': '0.082', 'AMMO4': '0.216', 'AMMO3': '0.304', 'weapon4': '0.328', 'weapon2': '0.394', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.700', 'HITCOUNT': '2.400', 'weapon3': '2.862', 'DAMAGECOUNT': '11.403', 'FRAGCOUNT': '39.000'} [2023-02-24 21:10:31,398][213372] DAMAGECOUNT value on done: 419210.0 [2023-02-24 21:10:31,399][213372] Sum rewards: 49.473, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.810', 'AMMO2': '0.008', 'AMMO5': '0.011', 'AMMO4': '0.042', 'weapon5': '0.168', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.368', 'weapon4': '0.434', 'WEAPON3': '1.100', 'HITCOUNT': '2.600', 'weapon3': '2.868', 'DAMAGECOUNT': '12.060', 'FRAGCOUNT': '43.000'} [2023-02-24 21:10:31,729][213366] DAMAGECOUNT value on done: 419773.0 [2023-02-24 21:10:31,729][213366] Sum rewards: 36.941, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.239', 'AMMO5': '0.025', 'AMMO2': '0.039', 'AMMO3': '0.179', 'AMMO4': '0.194', 'weapon2': '0.342', 'weapon5': '0.414', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'weapon4': '0.732', 'WEAPON3': '1.050', 'weapon3': '2.100', 'HITCOUNT': '2.390', 'DAMAGECOUNT': '11.214', 'FRAGCOUNT': '36.000'} [2023-02-24 21:10:31,982][213368] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 21:10:32,037][213366] DAMAGECOUNT value on done: 428927.0 [2023-02-24 21:10:32,037][213366] Sum rewards: 33.184, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.240', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.020', 'weapon5': '0.062', 'AMMO4': '0.097', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.232', 'weapon2': '0.308', 'weapon4': '0.522', 'WEAPON3': '1.300', 'HITCOUNT': '2.330', 'weapon3': '2.852', 'DAMAGECOUNT': '10.086', 'FRAGCOUNT': '33.000'} [2023-02-24 21:10:32,047][213366] DAMAGECOUNT value on done: 439657.0 [2023-02-24 21:10:32,047][213366] Sum rewards: 47.159, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.029', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.137', 'AMMO3': '0.211', 'weapon5': '0.244', 'WEAPON5': '0.350', 'weapon4': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.502', 'WEAPON3': '1.200', 'weapon3': '2.660', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.756', 'FRAGCOUNT': '44.000'} [2023-02-24 21:10:32,351][213366] DAMAGECOUNT value on done: 423843.0 [2023-02-24 21:10:32,351][213366] Sum rewards: 47.213, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.600', 'AMMO5': '0.018', 'AMMO2': '0.062', 'AMMO3': '0.173', 'AMMO4': '0.310', 'weapon2': '0.362', 'weapon5': '0.380', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'weapon4': '0.662', 'WEAPON3': '1.050', 'weapon3': '2.148', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '11.838', 'FRAGCOUNT': '42.000'} [2023-02-24 21:10:32,603][213369] DAMAGECOUNT value on done: 430439.0 [2023-02-24 21:10:32,603][213369] Sum rewards: 43.235, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.224', 'AMMO5': '0.014', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon2': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.300', 'weapon5': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '2.750', 'weapon3': '3.022', 'DAMAGECOUNT': '12.852', 'FRAGCOUNT': '39.500'} [2023-02-24 21:10:32,706][213383] DAMAGECOUNT value on done: 422137.0 [2023-02-24 21:10:32,707][213383] Sum rewards: 50.615, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.141', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.048', 'AMMO3': '0.205', 'AMMO4': '0.242', 'weapon5': '0.292', 'weapon2': '0.350', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.872', 'WEAPON3': '1.350', 'weapon3': '2.166', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '13.935', 'FRAGCOUNT': '45.000'} [2023-02-24 21:10:32,743][213382] DAMAGECOUNT value on done: 428500.0 [2023-02-24 21:10:32,744][213382] Sum rewards: 50.751, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.062', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon7': '0.096', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.171', 'WEAPON4': '0.350', 'weapon2': '0.368', 'weapon4': '0.626', 'WEAPON3': '1.050', 'weapon3': '2.694', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.126', 'FRAGCOUNT': '46.000'} [2023-02-24 21:10:32,753][213368] DAMAGECOUNT value on done: 421486.0 [2023-02-24 21:10:32,753][213368] Sum rewards: 41.933, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.904', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.030', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.151', 'weapon2': '0.246', 'AMMO3': '0.293', 'WEAPON4': '0.300', 'weapon4': '0.400', 'WEAPON3': '1.650', 'HITCOUNT': '2.670', 'weapon3': '3.032', 'DAMAGECOUNT': '11.658', 'FRAGCOUNT': '42.000'} [2023-02-24 21:10:32,920][213369] DAMAGECOUNT value on done: 427592.0 [2023-02-24 21:10:32,921][213369] Sum rewards: 33.185, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.787', 'AMMO5': '0.010', 'AMMO2': '0.013', 'ARMOR': '0.020', 'AMMO4': '0.067', 'weapon5': '0.078', 'weapon7': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.123', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.334', 'weapon4': '0.830', 'WEAPON3': '0.900', 'HITCOUNT': '2.090', 'weapon3': '2.208', 'DAMAGECOUNT': '9.675', 'FRAGCOUNT': '26.000'} [2023-02-24 21:10:33,007][213383] DAMAGECOUNT value on done: 427690.0 [2023-02-24 21:10:33,008][213383] Sum rewards: 47.570, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.809', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon5': '0.104', 'AMMO4': '0.115', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.258', 'ARMOR': '0.400', 'weapon2': '0.600', 'WEAPON3': '1.300', 'HITCOUNT': '2.790', 'weapon3': '2.840', 'DAMAGECOUNT': '12.468', 'FRAGCOUNT': '42.000'} [2023-02-24 21:10:33,060][213382] DAMAGECOUNT value on done: 429042.0 [2023-02-24 21:10:33,061][213382] Sum rewards: 58.639, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.840', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.012', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'weapon4': '0.126', 'WEAPON4': '0.150', 'AMMO3': '0.219', 'weapon2': '0.230', 'WEAPON3': '1.250', 'HITCOUNT': '2.830', 'weapon3': '3.458', 'DAMAGECOUNT': '13.314', 'FRAGCOUNT': '52.000'} [2023-02-24 21:10:33,065][213368] DAMAGECOUNT value on done: 428261.0 [2023-02-24 21:10:33,066][213368] Sum rewards: 52.888, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.339', 'AMMO2': '0.005', 'AMMO5': '0.012', 'weapon4': '0.014', 'AMMO4': '0.024', 'weapon5': '0.028', 'WEAPON4': '0.050', 'weapon2': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'WEAPON3': '1.400', 'HITCOUNT': '3.040', 'weapon3': '3.614', 'DAMAGECOUNT': '14.784', 'FRAGCOUNT': '45.000'} [2023-02-24 21:10:33,234][213369] DAMAGECOUNT value on done: 428621.0 [2023-02-24 21:10:33,235][213369] Sum rewards: 35.212, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.816', 'AMMO5': '0.015', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.122', 'WEAPON4': '0.150', 'weapon2': '0.178', 'AMMO3': '0.200', 'weapon4': '0.236', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.240', 'weapon3': '3.230', 'DAMAGECOUNT': '9.987', 'FRAGCOUNT': '31.000'} [2023-02-24 21:10:33,330][213368] DAMAGECOUNT value on done: 422687.0 [2023-02-24 21:10:33,331][213368] Sum rewards: 36.435, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.217', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO4': '0.190', 'weapon5': '0.212', 'AMMO3': '0.224', 'weapon2': '0.262', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.684', 'WEAPON3': '1.250', 'weapon3': '2.508', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '10.851', 'FRAGCOUNT': '34.500'} [2023-02-24 21:10:33,380][213382] DAMAGECOUNT value on done: 415138.0 [2023-02-24 21:10:33,380][213382] Sum rewards: 48.875, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.658', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.140', 'AMMO4': '0.196', 'AMMO3': '0.272', 'WEAPON5': '0.300', 'weapon2': '0.346', 'weapon4': '0.380', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'HITCOUNT': '2.690', 'weapon3': '2.810', 'DAMAGECOUNT': '13.290', 'FRAGCOUNT': '47.000'} [2023-02-24 21:10:33,459][213384] DAMAGECOUNT value on done: 432585.0 [2023-02-24 21:10:33,460][213384] Sum rewards: 40.490, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.306', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'weapon5': '0.152', 'AMMO3': '0.171', 'WEAPON4': '0.300', 'weapon2': '0.428', 'weapon4': '0.792', 'WEAPON3': '1.000', 'weapon3': '2.222', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '11.385', 'FRAGCOUNT': '36.000'} [2023-02-24 21:10:33,550][213369] DAMAGECOUNT value on done: 416611.0 [2023-02-24 21:10:33,550][213369] Sum rewards: 45.153, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.330', 'AMMO5': '0.022', 'AMMO2': '0.024', 'AMMO4': '0.122', 'AMMO3': '0.218', 'weapon2': '0.222', 'weapon5': '0.222', 'WEAPON4': '0.300', 'weapon4': '0.326', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'HITCOUNT': '2.500', 'weapon3': '2.864', 'DAMAGECOUNT': '12.762', 'FRAGCOUNT': '42.000'} [2023-02-24 21:10:33,648][213368] DAMAGECOUNT value on done: 420748.0 [2023-02-24 21:10:33,648][213368] Sum rewards: 45.816, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.082', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.064', 'AMMO3': '0.133', 'weapon2': '0.206', 'weapon5': '0.244', 'AMMO4': '0.318', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '0.750', 'weapon4': '0.844', 'weapon3': '2.350', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.222', 'FRAGCOUNT': '40.000'} [2023-02-24 21:10:33,651][213383] DAMAGECOUNT value on done: 428682.0 [2023-02-24 21:10:33,651][213383] Sum rewards: 38.503, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.520', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.106', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.430', 'weapon4': '0.436', 'WEAPON3': '1.400', 'HITCOUNT': '2.490', 'weapon3': '2.796', 'DAMAGECOUNT': '10.485', 'FRAGCOUNT': '37.000'} [2023-02-24 21:10:33,693][213382] DAMAGECOUNT value on done: 424157.0 [2023-02-24 21:10:33,693][213382] Sum rewards: 32.694, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.730', 'AMMO5': '0.018', 'AMMO2': '0.037', 'weapon5': '0.126', 'AMMO4': '0.185', 'AMMO3': '0.237', 'weapon4': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.772', 'WEAPON3': '1.350', 'HITCOUNT': '2.370', 'weapon3': '2.380', 'DAMAGECOUNT': '9.885', 'FRAGCOUNT': '32.000'} [2023-02-24 21:10:33,798][213384] DAMAGECOUNT value on done: 413218.0 [2023-02-24 21:10:33,798][213384] Sum rewards: 54.038, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.711', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.098', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.358', 'WEAPON4': '0.400', 'weapon4': '0.544', 'WEAPON3': '1.300', 'weapon3': '2.728', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.074', 'FRAGCOUNT': '50.000'} [2023-02-24 21:10:33,980][213383] DAMAGECOUNT value on done: 420193.0 [2023-02-24 21:10:33,980][213383] Sum rewards: 41.432, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.720', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.018', 'AMMO4': '0.054', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'weapon4': '0.274', 'weapon2': '0.338', 'WEAPON3': '1.250', 'HITCOUNT': '2.790', 'weapon3': '3.192', 'DAMAGECOUNT': '11.277', 'FRAGCOUNT': '37.000'} [2023-02-24 21:10:34,124][213384] DAMAGECOUNT value on done: 427830.0 [2023-02-24 21:10:34,124][213384] Sum rewards: 58.659, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.635', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.052', 'AMMO3': '0.161', 'weapon5': '0.190', 'AMMO4': '0.261', 'WEAPON5': '0.400', 'weapon2': '0.434', 'weapon4': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.604', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.432', 'FRAGCOUNT': '50.000'} [2023-02-24 21:10:34,313][213365] Updated weights for policy 0, policy_version 33476 (0.0009) [2023-02-24 21:10:34,432][213384] DAMAGECOUNT value on done: 429210.0 [2023-02-24 21:10:34,432][213384] Sum rewards: 44.902, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.048', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.080', 'weapon5': '0.086', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon2': '0.544', 'WEAPON3': '1.000', 'HITCOUNT': '2.510', 'weapon3': '3.002', 'DAMAGECOUNT': '11.541', 'FRAGCOUNT': '39.000'} [2023-02-24 21:10:35,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13509.9). Total num frames: 137129984. Throughput: 0: 3370.1. Samples: 9271370. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 21:10:35,243][213332] Avg episode reward: [(0, '42.156')] [2023-02-24 21:10:37,267][213365] Updated weights for policy 0, policy_version 33486 (0.0009) [2023-02-24 21:10:40,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 137195520. Throughput: 0: 3373.5. Samples: 9291524. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 21:10:40,243][213332] Avg episode reward: [(0, '42.156')] [2023-02-24 21:10:40,324][213365] Updated weights for policy 0, policy_version 33496 (0.0009) [2023-02-24 21:10:43,340][213365] Updated weights for policy 0, policy_version 33506 (0.0009) [2023-02-24 21:10:45,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13509.9). Total num frames: 137265152. Throughput: 0: 3372.3. Samples: 9311786. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 21:10:45,243][213332] Avg episode reward: [(0, '42.156')] [2023-02-24 21:10:45,246][213352] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000033512_137265152.pth... [2023-02-24 21:10:45,304][213352] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000032721_134025216.pth [2023-02-24 21:10:46,370][213365] Updated weights for policy 0, policy_version 33516 (0.0009) [2023-02-24 21:10:49,417][213365] Updated weights for policy 0, policy_version 33526 (0.0009) [2023-02-24 21:10:49,752][213367] DAMAGECOUNT value on done: 425904.0 [2023-02-24 21:10:49,753][213367] Sum rewards: 43.656, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.860', 'AMMO5': '0.011', 'AMMO2': '0.020', 'AMMO4': '0.099', 'AMMO3': '0.192', 'weapon5': '0.244', 'WEAPON4': '0.250', 'weapon4': '0.296', 'weapon2': '0.348', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.450', 'weapon3': '2.830', 'DAMAGECOUNT': '12.126', 'FRAGCOUNT': '39.000'} [2023-02-24 21:10:49,929][213367] DAMAGECOUNT value on done: 433719.0 [2023-02-24 21:10:49,930][213367] Sum rewards: 34.457, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.358', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon5': '0.146', 'AMMO3': '0.206', 'AMMO4': '0.237', 'WEAPON5': '0.400', 'weapon2': '0.434', 'WEAPON4': '0.700', 'weapon4': '0.896', 'WEAPON3': '1.200', 'weapon3': '2.166', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '10.671', 'FRAGCOUNT': '36.000'} [2023-02-24 21:10:50,063][213367] DAMAGECOUNT value on done: 428308.0 [2023-02-24 21:10:50,063][213367] Sum rewards: 42.413, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.210', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon5': '0.128', 'AMMO4': '0.202', 'AMMO3': '0.227', 'weapon4': '0.288', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.416', 'WEAPON3': '1.350', 'HITCOUNT': '2.660', 'weapon3': '2.888', 'DAMAGECOUNT': '12.957', 'FRAGCOUNT': '40.000'} [2023-02-24 21:10:50,239][213367] DAMAGECOUNT value on done: 433675.0 [2023-02-24 21:10:50,240][213367] Sum rewards: 47.241, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.652', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'weapon4': '0.230', 'weapon2': '0.474', 'WEAPON3': '1.200', 'HITCOUNT': '2.810', 'weapon3': '3.102', 'DAMAGECOUNT': '13.302', 'FRAGCOUNT': '40.000'} [2023-02-24 21:10:50,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 137330688. Throughput: 0: 3371.6. Samples: 9321972. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 21:10:50,243][213332] Avg episode reward: [(0, '42.179')] [2023-02-24 21:10:50,923][213372] DAMAGECOUNT value on done: 436209.0 [2023-02-24 21:10:50,923][213372] Sum rewards: 50.132, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.572', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon5': '0.060', 'AMMO4': '0.138', 'AMMO3': '0.220', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON4': '0.450', 'weapon4': '0.594', 'WEAPON3': '1.400', 'weapon3': '2.774', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.251', 'FRAGCOUNT': '47.000'} [2023-02-24 21:10:51,054][213372] DAMAGECOUNT value on done: 426779.0 [2023-02-24 21:10:51,054][213372] Sum rewards: 40.512, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.482', 'AMMO5': '0.008', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon2': '0.174', 'AMMO3': '0.201', 'weapon5': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.752', 'WEAPON3': '1.200', 'HITCOUNT': '2.590', 'weapon3': '2.612', 'DAMAGECOUNT': '11.070', 'FRAGCOUNT': '37.000'} [2023-02-24 21:10:51,223][213372] DAMAGECOUNT value on done: 436776.0 [2023-02-24 21:10:51,223][213372] Sum rewards: 47.602, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.350', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'weapon4': '0.096', 'WEAPON4': '0.150', 'AMMO3': '0.249', 'weapon2': '0.614', 'WEAPON3': '1.550', 'HITCOUNT': '2.840', 'weapon3': '3.040', 'DAMAGECOUNT': '13.479', 'FRAGCOUNT': '43.000'} [2023-02-24 21:10:51,357][213372] DAMAGECOUNT value on done: 423648.0 [2023-02-24 21:10:51,358][213372] Sum rewards: 41.893, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.516', 'AMMO5': '0.016', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.160', 'AMMO3': '0.183', 'weapon4': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.972', 'WEAPON3': '1.150', 'weapon3': '2.308', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.314', 'FRAGCOUNT': '38.000'} [2023-02-24 21:10:51,566][213366] DAMAGECOUNT value on done: 424033.0 [2023-02-24 21:10:51,567][213366] Sum rewards: 45.975, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.063', 'AMMO5': '0.014', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.108', 'weapon2': '0.186', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.316', 'WEAPON3': '1.350', 'HITCOUNT': '2.740', 'weapon3': '3.150', 'DAMAGECOUNT': '12.780', 'FRAGCOUNT': '40.000'} [2023-02-24 21:10:51,862][213366] DAMAGECOUNT value on done: 433389.0 [2023-02-24 21:10:51,862][213366] Sum rewards: 51.716, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.096', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.219', 'weapon2': '0.294', 'weapon4': '0.382', 'WEAPON3': '1.450', 'HITCOUNT': '2.880', 'weapon3': '3.016', 'DAMAGECOUNT': '13.386', 'FRAGCOUNT': '46.000'} [2023-02-24 21:10:51,872][213366] DAMAGECOUNT value on done: 443497.0 [2023-02-24 21:10:51,872][213366] Sum rewards: 41.170, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.860', 'AMMO5': '0.017', 'AMMO2': '0.052', 'AMMO3': '0.126', 'weapon5': '0.180', 'AMMO4': '0.262', 'WEAPON5': '0.450', 'WEAPON4': '0.700', 'weapon2': '0.742', 'weapon4': '0.748', 'WEAPON3': '0.750', 'weapon3': '2.012', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '11.490', 'FRAGCOUNT': '35.000'} [2023-02-24 21:10:52,182][213366] DAMAGECOUNT value on done: 428389.0 [2023-02-24 21:10:52,183][213366] Sum rewards: 55.109, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.549', 'AMMO2': '0.011', 'AMMO5': '0.012', 'AMMO4': '0.053', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'weapon5': '0.182', 'weapon4': '0.256', 'weapon2': '0.308', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '2.940', 'weapon3': '3.048', 'DAMAGECOUNT': '13.638', 'FRAGCOUNT': '45.000'} [2023-02-24 21:10:52,427][213365] Updated weights for policy 0, policy_version 33536 (0.0009) [2023-02-24 21:10:52,606][213368] DAMAGECOUNT value on done: 425075.0 [2023-02-24 21:10:52,607][213368] Sum rewards: 33.837, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.453', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'weapon4': '0.172', 'WEAPON4': '0.200', 'weapon2': '0.210', 'AMMO3': '0.239', 'WEAPON3': '1.450', 'HITCOUNT': '2.500', 'weapon3': '3.344', 'DAMAGECOUNT': '10.767', 'FRAGCOUNT': '33.000'} [2023-02-24 21:10:52,609][213383] DAMAGECOUNT value on done: 425536.0 [2023-02-24 21:10:52,610][213383] Sum rewards: 37.025, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.944', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon5': '0.112', 'AMMO4': '0.141', 'AMMO3': '0.156', 'weapon4': '0.326', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.660', 'WEAPON3': '1.100', 'HITCOUNT': '2.360', 'weapon3': '2.570', 'DAMAGECOUNT': '10.197', 'FRAGCOUNT': '32.000'} [2023-02-24 21:10:52,614][213369] DAMAGECOUNT value on done: 434325.0 [2023-02-24 21:10:52,615][213369] Sum rewards: 37.706, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.371', 'AMMO2': '0.020', 'AMMO5': '0.022', 'AMMO4': '0.099', 'AMMO3': '0.188', 'weapon5': '0.242', 'WEAPON4': '0.300', 'weapon4': '0.432', 'WEAPON5': '0.600', 'weapon2': '0.626', 'WEAPON3': '1.050', 'weapon3': '2.460', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '11.658', 'FRAGCOUNT': '34.500'} [2023-02-24 21:10:52,629][213382] DAMAGECOUNT value on done: 432798.0 [2023-02-24 21:10:52,630][213382] Sum rewards: 50.350, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.649', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.038', 'AMMO4': '0.190', 'AMMO3': '0.196', 'weapon2': '0.206', 'weapon5': '0.214', 'weapon4': '0.414', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'HITCOUNT': '2.440', 'weapon3': '2.878', 'DAMAGECOUNT': '12.894', 'FRAGCOUNT': '44.000'} [2023-02-24 21:10:52,913][213368] DAMAGECOUNT value on done: 433050.0 [2023-02-24 21:10:52,913][213368] Sum rewards: 60.456, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.675', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon4': '0.526', 'weapon2': '0.574', 'WEAPON3': '1.250', 'weapon3': '2.612', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.367', 'FRAGCOUNT': '54.000'} [2023-02-24 21:10:52,919][213383] DAMAGECOUNT value on done: 431656.0 [2023-02-24 21:10:52,920][213383] Sum rewards: 43.027, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.622', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.023', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.115', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon4': '0.434', 'weapon2': '0.446', 'WEAPON3': '1.350', 'HITCOUNT': '2.690', 'weapon3': '2.886', 'DAMAGECOUNT': '11.898', 'FRAGCOUNT': '40.000'} [2023-02-24 21:10:52,929][213369] DAMAGECOUNT value on done: 432484.0 [2023-02-24 21:10:52,930][213369] Sum rewards: 48.159, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.400', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.047', 'weapon5': '0.164', 'AMMO3': '0.181', 'AMMO4': '0.237', 'weapon2': '0.260', 'WEAPON5': '0.550', 'WEAPON4': '0.900', 'WEAPON3': '1.150', 'weapon4': '1.432', 'weapon3': '1.846', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '42.000'} [2023-02-24 21:10:52,939][213382] DAMAGECOUNT value on done: 432723.0 [2023-02-24 21:10:52,939][213382] Sum rewards: 39.317, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.771', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.132', 'AMMO3': '0.156', 'weapon5': '0.156', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.420', 'weapon4': '0.686', 'WEAPON3': '0.900', 'HITCOUNT': '2.210', 'weapon3': '2.448', 'DAMAGECOUNT': '11.043', 'FRAGCOUNT': '34.000'} [2023-02-24 21:10:53,178][213368] DAMAGECOUNT value on done: 425180.0 [2023-02-24 21:10:53,179][213368] Sum rewards: 32.560, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.039', 'AMMO5': '0.007', 'weapon7': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.092', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon2': '0.506', 'WEAPON3': '1.000', 'HITCOUNT': '1.760', 'weapon3': '2.714', 'DAMAGECOUNT': '7.479', 'FRAGCOUNT': '30.000'} [2023-02-24 21:10:53,243][213369] DAMAGECOUNT value on done: 432833.0 [2023-02-24 21:10:53,244][213369] Sum rewards: 45.922, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.372', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.043', 'weapon5': '0.136', 'AMMO3': '0.194', 'AMMO4': '0.216', 'weapon4': '0.278', 'weapon2': '0.426', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.810', 'weapon3': '2.882', 'DAMAGECOUNT': '12.636', 'FRAGCOUNT': '40.000'} [2023-02-24 21:10:53,261][213382] DAMAGECOUNT value on done: 419759.0 [2023-02-24 21:10:53,262][213382] Sum rewards: 47.988, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.710', 'AMMO5': '0.020', 'AMMO2': '0.034', 'AMMO4': '0.167', 'weapon5': '0.230', 'AMMO3': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.352', 'weapon2': '0.354', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'HITCOUNT': '2.650', 'weapon3': '2.678', 'DAMAGECOUNT': '13.863', 'FRAGCOUNT': '46.000'} [2023-02-24 21:10:53,439][213384] DAMAGECOUNT value on done: 436532.0 [2023-02-24 21:10:53,439][213384] Sum rewards: 37.194, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.007', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.041', 'AMMO4': '0.204', 'AMMO3': '0.223', 'weapon5': '0.248', 'weapon2': '0.436', 'WEAPON4': '0.450', 'weapon4': '0.456', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.528', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '11.841', 'FRAGCOUNT': '33.500'} [2023-02-24 21:10:53,492][213368] DAMAGECOUNT value on done: 424694.0 [2023-02-24 21:10:53,493][213368] Sum rewards: 45.268, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.510', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.170', 'weapon5': '0.214', 'AMMO3': '0.227', 'weapon4': '0.272', 'WEAPON4': '0.400', 'weapon2': '0.428', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.600', 'weapon3': '2.782', 'DAMAGECOUNT': '11.838', 'FRAGCOUNT': '42.000'} [2023-02-24 21:10:53,554][213369] DAMAGECOUNT value on done: 420565.0 [2023-02-24 21:10:53,555][213369] Sum rewards: 43.885, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.445', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.048', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.236', 'AMMO3': '0.269', 'ARMOR': '0.452', 'weapon2': '0.456', 'WEAPON3': '1.600', 'HITCOUNT': '2.740', 'weapon3': '3.038', 'DAMAGECOUNT': '11.862', 'FRAGCOUNT': '42.000'} [2023-02-24 21:10:53,560][213382] DAMAGECOUNT value on done: 427838.0 [2023-02-24 21:10:53,561][213382] Sum rewards: 34.103, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.378', 'AMMO5': '0.014', 'AMMO2': '0.040', 'AMMO4': '0.201', 'AMMO3': '0.204', 'weapon5': '0.354', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.466', 'weapon2': '0.670', 'WEAPON3': '1.200', 'weapon3': '2.168', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '11.043', 'FRAGCOUNT': '32.500'} [2023-02-24 21:10:53,580][213383] DAMAGECOUNT value on done: 433889.0 [2023-02-24 21:10:53,581][213383] Sum rewards: 57.817, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.384', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.150', 'AMMO4': '0.164', 'AMMO3': '0.175', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.386', 'weapon2': '0.646', 'WEAPON3': '1.050', 'weapon3': '2.582', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.621', 'FRAGCOUNT': '48.000'} [2023-02-24 21:10:53,758][213384] DAMAGECOUNT value on done: 416988.0 [2023-02-24 21:10:53,759][213384] Sum rewards: 37.699, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.955', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.074', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'weapon4': '0.320', 'weapon2': '0.648', 'WEAPON3': '1.300', 'HITCOUNT': '2.450', 'weapon3': '2.748', 'DAMAGECOUNT': '11.310', 'FRAGCOUNT': '36.000'} [2023-02-24 21:10:53,891][213383] DAMAGECOUNT value on done: 424375.0 [2023-02-24 21:10:53,892][213383] Sum rewards: 44.667, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.615', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.072', 'AMMO4': '0.167', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.520', 'weapon2': '0.576', 'WEAPON3': '1.250', 'weapon3': '2.614', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.546', 'FRAGCOUNT': '41.000'} [2023-02-24 21:10:54,083][213384] DAMAGECOUNT value on done: 432271.0 [2023-02-24 21:10:54,084][213384] Sum rewards: 41.244, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.230', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.144', 'AMMO4': '0.147', 'WEAPON5': '0.200', 'AMMO3': '0.261', 'weapon2': '0.266', 'WEAPON4': '0.350', 'weapon4': '0.464', 'WEAPON3': '1.600', 'HITCOUNT': '2.600', 'weapon3': '2.832', 'DAMAGECOUNT': '13.323', 'FRAGCOUNT': '38.000'} [2023-02-24 21:10:54,388][213384] DAMAGECOUNT value on done: 433871.0 [2023-02-24 21:10:54,389][213384] Sum rewards: 45.630, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.806', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.162', 'AMMO4': '0.179', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'weapon2': '0.276', 'weapon4': '0.370', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.888', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.983', 'FRAGCOUNT': '42.500'} [2023-02-24 21:10:55,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13509.9). Total num frames: 137400320. Throughput: 0: 3371.9. Samples: 9342182. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 21:10:55,244][213332] Avg episode reward: [(0, '43.324')] [2023-02-24 21:10:55,487][213365] Updated weights for policy 0, policy_version 33546 (0.0009) [2023-02-24 21:10:58,500][213365] Updated weights for policy 0, policy_version 33556 (0.0009) [2023-02-24 21:11:00,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 137465856. Throughput: 0: 3378.4. Samples: 9362492. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 21:11:00,243][213332] Avg episode reward: [(0, '43.324')] [2023-02-24 21:11:01,517][213365] Updated weights for policy 0, policy_version 33566 (0.0009) [2023-02-24 21:11:04,567][213365] Updated weights for policy 0, policy_version 33576 (0.0009) [2023-02-24 21:11:05,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13509.9). Total num frames: 137535488. Throughput: 0: 3377.7. Samples: 9372758. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 21:11:05,243][213332] Avg episode reward: [(0, '43.324')] [2023-02-24 21:11:07,575][213365] Updated weights for policy 0, policy_version 33586 (0.0009) [2023-02-24 21:11:09,553][213367] DAMAGECOUNT value on done: 430386.0 [2023-02-24 21:11:09,554][213367] Sum rewards: 47.006, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.255', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'weapon4': '0.270', 'weapon2': '0.622', 'WEAPON3': '1.150', 'weapon3': '2.798', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.446', 'FRAGCOUNT': '40.000'} [2023-02-24 21:11:09,740][213367] DAMAGECOUNT value on done: 438041.0 [2023-02-24 21:11:09,740][213367] Sum rewards: 51.405, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.830', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.132', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'WEAPON4': '0.300', 'weapon4': '0.418', 'weapon2': '0.886', 'WEAPON3': '1.000', 'weapon3': '2.408', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '12.966', 'FRAGCOUNT': '44.000'} [2023-02-24 21:11:09,880][213367] DAMAGECOUNT value on done: 432346.0 [2023-02-24 21:11:09,881][213367] Sum rewards: 39.002, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.166', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.192', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.426', 'weapon4': '0.492', 'WEAPON3': '1.300', 'HITCOUNT': '2.560', 'weapon3': '2.592', 'DAMAGECOUNT': '12.114', 'FRAGCOUNT': '37.000'} [2023-02-24 21:11:10,056][213367] DAMAGECOUNT value on done: 437895.0 [2023-02-24 21:11:10,057][213367] Sum rewards: 50.426, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.600', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.124', 'AMMO4': '0.153', 'AMMO3': '0.179', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.400', 'weapon4': '0.528', 'WEAPON3': '1.050', 'weapon3': '2.722', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.660', 'FRAGCOUNT': '42.000'} [2023-02-24 21:11:10,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 137601024. Throughput: 0: 3378.1. Samples: 9392920. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 21:11:10,243][213332] Avg episode reward: [(0, '43.640')] [2023-02-24 21:11:10,244][213352] Saving new best policy, reward=43.640! [2023-02-24 21:11:10,640][213365] Updated weights for policy 0, policy_version 33596 (0.0009) [2023-02-24 21:11:10,813][213372] DAMAGECOUNT value on done: 441401.0 [2023-02-24 21:11:10,813][213372] Sum rewards: 59.818, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.740', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon4': '0.076', 'AMMO4': '0.180', 'AMMO3': '0.198', 'weapon5': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.420', 'WEAPON3': '1.250', 'weapon3': '3.010', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.576', 'FRAGCOUNT': '52.000'} [2023-02-24 21:11:10,971][213372] DAMAGECOUNT value on done: 430513.0 [2023-02-24 21:11:10,971][213372] Sum rewards: 46.492, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.932', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.128', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'weapon2': '0.338', 'WEAPON4': '0.350', 'weapon4': '0.648', 'WEAPON3': '0.950', 'weapon3': '2.388', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '11.202', 'FRAGCOUNT': '41.000'} [2023-02-24 21:11:11,145][213372] DAMAGECOUNT value on done: 440366.0 [2023-02-24 21:11:11,145][213372] Sum rewards: 35.199, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.770', 'AMMO2': '0.007', 'AMMO5': '0.009', 'weapon5': '0.022', 'AMMO4': '0.034', 'weapon4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.414', 'WEAPON3': '1.400', 'HITCOUNT': '2.380', 'weapon3': '3.204', 'DAMAGECOUNT': '10.770', 'FRAGCOUNT': '33.000'} [2023-02-24 21:11:11,295][213372] DAMAGECOUNT value on done: 427561.0 [2023-02-24 21:11:11,295][213372] Sum rewards: 32.761, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.712', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.044', 'AMMO4': '0.222', 'AMMO3': '0.265', 'weapon2': '0.324', 'weapon5': '0.326', 'weapon4': '0.448', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'HITCOUNT': '2.090', 'weapon3': '2.516', 'DAMAGECOUNT': '11.664', 'FRAGCOUNT': '33.000'} [2023-02-24 21:11:11,481][213366] DAMAGECOUNT value on done: 427860.0 [2023-02-24 21:11:11,481][213366] Sum rewards: 42.233, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.321', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.110', 'AMMO3': '0.178', 'AMMO4': '0.195', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.630', 'weapon4': '0.668', 'WEAPON3': '1.000', 'weapon3': '2.360', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '11.481', 'FRAGCOUNT': '38.000'} [2023-02-24 21:11:11,770][213366] DAMAGECOUNT value on done: 438876.0 [2023-02-24 21:11:11,770][213366] Sum rewards: 53.695, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.160', 'AMMO5': '0.019', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon5': '0.192', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.452', 'weapon4': '0.462', 'WEAPON3': '1.300', 'weapon3': '2.612', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '46.500'} [2023-02-24 21:11:11,780][213366] DAMAGECOUNT value on done: 448142.0 [2023-02-24 21:11:11,780][213366] Sum rewards: 53.100, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.636', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.042', 'weapon5': '0.094', 'AMMO4': '0.103', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'weapon2': '0.260', 'WEAPON3': '1.500', 'HITCOUNT': '3.030', 'weapon3': '3.398', 'DAMAGECOUNT': '13.890', 'FRAGCOUNT': '48.000'} [2023-02-24 21:11:12,088][213366] DAMAGECOUNT value on done: 432604.0 [2023-02-24 21:11:12,088][213366] Sum rewards: 48.957, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.282', 'AMMO5': '0.009', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'weapon4': '0.272', 'weapon2': '0.358', 'WEAPON3': '1.350', 'weapon3': '3.014', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '12.645', 'FRAGCOUNT': '44.000'} [2023-02-24 21:11:12,512][213383] DAMAGECOUNT value on done: 429632.0 [2023-02-24 21:11:12,512][213383] Sum rewards: 42.502, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.614', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon5': '0.182', 'AMMO3': '0.243', 'AMMO4': '0.256', 'WEAPON5': '0.350', 'weapon4': '0.362', 'weapon2': '0.374', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.540', 'weapon3': '2.850', 'DAMAGECOUNT': '12.288', 'FRAGCOUNT': '41.000'} [2023-02-24 21:11:12,515][213368] DAMAGECOUNT value on done: 429075.0 [2023-02-24 21:11:12,515][213368] Sum rewards: 33.198, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.396', 'AMMO5': '0.027', 'AMMO2': '0.044', 'weapon2': '0.194', 'AMMO4': '0.218', 'AMMO3': '0.265', 'weapon5': '0.304', 'WEAPON4': '0.350', 'weapon4': '0.594', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.188', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '12.000', 'FRAGCOUNT': '31.000'} [2023-02-24 21:11:12,558][213369] DAMAGECOUNT value on done: 438032.0 [2023-02-24 21:11:12,558][213369] Sum rewards: 38.488, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.420', 'AMMO5': '0.019', 'AMMO2': '0.038', 'AMMO3': '0.166', 'AMMO4': '0.188', 'weapon5': '0.426', 'weapon4': '0.474', 'WEAPON4': '0.500', 'weapon2': '0.596', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'HITCOUNT': '2.070', 'weapon3': '2.110', 'DAMAGECOUNT': '11.121', 'FRAGCOUNT': '34.500'} [2023-02-24 21:11:12,574][213382] DAMAGECOUNT value on done: 438020.0 [2023-02-24 21:11:12,575][213382] Sum rewards: 57.036, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.530', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon4': '0.122', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'weapon5': '0.202', 'WEAPON5': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.050', 'weapon3': '3.066', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.666', 'FRAGCOUNT': '46.000'} [2023-02-24 21:11:12,820][213383] DAMAGECOUNT value on done: 435785.0 [2023-02-24 21:11:12,821][213383] Sum rewards: 42.279, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.804', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.070', 'AMMO3': '0.177', 'weapon2': '0.236', 'weapon5': '0.332', 'AMMO4': '0.349', 'WEAPON5': '0.400', 'WEAPON4': '0.700', 'weapon4': '0.964', 'WEAPON3': '1.050', 'weapon3': '2.204', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '11.811', 'FRAGCOUNT': '39.000'} [2023-02-24 21:11:12,833][213368] DAMAGECOUNT value on done: 437574.0 [2023-02-24 21:11:12,833][213368] Sum rewards: 41.449, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.800', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'weapon4': '0.080', 'WEAPON4': '0.150', 'AMMO3': '0.285', 'weapon2': '0.496', 'WEAPON3': '1.750', 'HITCOUNT': '2.860', 'weapon3': '3.184', 'DAMAGECOUNT': '13.572', 'FRAGCOUNT': '40.000'} [2023-02-24 21:11:12,872][213369] DAMAGECOUNT value on done: 436901.0 [2023-02-24 21:11:12,872][213369] Sum rewards: 54.245, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.290', 'AMMO5': '0.006', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'weapon5': '0.068', 'weapon2': '0.138', 'WEAPON5': '0.150', 'weapon4': '0.230', 'AMMO3': '0.280', 'WEAPON3': '1.550', 'HITCOUNT': '3.160', 'weapon3': '3.340', 'DAMAGECOUNT': '13.251', 'FRAGCOUNT': '49.000'} [2023-02-24 21:11:12,893][213382] DAMAGECOUNT value on done: 436768.0 [2023-02-24 21:11:12,893][213382] Sum rewards: 38.810, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.474', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.110', 'AMMO4': '0.119', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon4': '0.358', 'weapon2': '0.382', 'WEAPON3': '1.300', 'HITCOUNT': '2.820', 'weapon3': '2.908', 'DAMAGECOUNT': '12.135', 'FRAGCOUNT': '36.000'} [2023-02-24 21:11:13,102][213368] DAMAGECOUNT value on done: 429181.0 [2023-02-24 21:11:13,103][213368] Sum rewards: 40.715, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.540', 'AMMO5': '0.019', 'AMMO2': '0.033', 'weapon4': '0.062', 'weapon5': '0.102', 'AMMO4': '0.162', 'AMMO3': '0.216', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.610', 'WEAPON3': '1.250', 'HITCOUNT': '2.400', 'weapon3': '2.948', 'DAMAGECOUNT': '12.003', 'FRAGCOUNT': '38.500'} [2023-02-24 21:11:13,191][213369] DAMAGECOUNT value on done: 436338.0 [2023-02-24 21:11:13,191][213369] Sum rewards: 40.845, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.536', 'AMMO2': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'weapon4': '0.138', 'weapon5': '0.148', 'AMMO3': '0.194', 'WEAPON5': '0.300', 'weapon2': '0.598', 'WEAPON3': '1.250', 'HITCOUNT': '2.280', 'weapon3': '2.788', 'DAMAGECOUNT': '10.515', 'FRAGCOUNT': '37.000'} [2023-02-24 21:11:13,215][213382] DAMAGECOUNT value on done: 424128.0 [2023-02-24 21:11:13,215][213382] Sum rewards: 48.530, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.038', 'AMMO5': '0.028', 'AMMO2': '0.030', 'WEAPON4': '0.150', 'AMMO4': '0.151', 'weapon5': '0.218', 'AMMO3': '0.220', 'weapon2': '0.514', 'WEAPON5': '0.550', 'weapon4': '0.752', 'WEAPON3': '1.250', 'weapon3': '2.138', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.107', 'FRAGCOUNT': '41.000'} [2023-02-24 21:11:13,408][213368] DAMAGECOUNT value on done: 428786.0 [2023-02-24 21:11:13,409][213368] Sum rewards: 47.194, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.620', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.112', 'AMMO4': '0.171', 'AMMO3': '0.181', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.486', 'weapon4': '0.646', 'WEAPON3': '1.000', 'weapon3': '2.560', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.276', 'FRAGCOUNT': '42.000'} [2023-02-24 21:11:13,410][213384] DAMAGECOUNT value on done: 439588.0 [2023-02-24 21:11:13,410][213384] Sum rewards: 29.086, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.048', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon5': '0.170', 'AMMO3': '0.211', 'WEAPON5': '0.300', 'weapon2': '0.358', 'WEAPON4': '0.400', 'weapon4': '0.692', 'WEAPON3': '1.250', 'HITCOUNT': '1.860', 'weapon3': '2.538', 'DAMAGECOUNT': '9.168', 'FRAGCOUNT': '29.000'} [2023-02-24 21:11:13,475][213383] DAMAGECOUNT value on done: 437836.0 [2023-02-24 21:11:13,475][213383] Sum rewards: 43.502, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.492', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.132', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'weapon4': '0.584', 'weapon2': '0.612', 'WEAPON3': '1.250', 'weapon3': '2.336', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '11.841', 'FRAGCOUNT': '39.000'} [2023-02-24 21:11:13,510][213369] DAMAGECOUNT value on done: 424432.0 [2023-02-24 21:11:13,510][213369] Sum rewards: 43.184, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.340', 'AMMO5': '0.024', 'AMMO2': '0.041', 'AMMO3': '0.112', 'AMMO4': '0.207', 'weapon5': '0.272', 'weapon2': '0.430', 'weapon4': '0.474', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'HITCOUNT': '2.310', 'weapon3': '2.552', 'DAMAGECOUNT': '11.301', 'FRAGCOUNT': '36.500'} [2023-02-24 21:11:13,532][213382] DAMAGECOUNT value on done: 432372.0 [2023-02-24 21:11:13,532][213382] Sum rewards: 50.784, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.290', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.051', 'weapon2': '0.206', 'AMMO3': '0.210', 'weapon5': '0.222', 'AMMO4': '0.255', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'weapon4': '0.832', 'WEAPON3': '1.250', 'weapon3': '2.290', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.602', 'FRAGCOUNT': '45.000'} [2023-02-24 21:11:13,735][213384] DAMAGECOUNT value on done: 421451.0 [2023-02-24 21:11:13,735][213384] Sum rewards: 42.862, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.305', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.100', 'weapon5': '0.182', 'AMMO4': '0.210', 'AMMO3': '0.245', 'weapon2': '0.382', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.520', 'weapon3': '3.074', 'DAMAGECOUNT': '13.389', 'FRAGCOUNT': '39.500'} [2023-02-24 21:11:13,743][213365] Updated weights for policy 0, policy_version 33606 (0.0009) [2023-02-24 21:11:13,796][213383] DAMAGECOUNT value on done: 428500.0 [2023-02-24 21:11:13,796][213383] Sum rewards: 44.763, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.750', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.162', 'AMMO3': '0.215', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.384', 'weapon2': '0.474', 'WEAPON3': '1.350', 'weapon3': '2.638', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.375', 'FRAGCOUNT': '42.000'} [2023-02-24 21:11:14,056][213384] DAMAGECOUNT value on done: 436159.0 [2023-02-24 21:11:14,057][213384] Sum rewards: 48.702, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.201', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.035', 'AMMO4': '0.175', 'AMMO3': '0.206', 'weapon5': '0.222', 'weapon2': '0.228', 'weapon4': '0.340', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.440', 'weapon3': '2.920', 'DAMAGECOUNT': '11.664', 'FRAGCOUNT': '44.000'} [2023-02-24 21:11:14,372][213384] DAMAGECOUNT value on done: 438326.0 [2023-02-24 21:11:14,372][213384] Sum rewards: 46.000, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.532', 'AMMO5': '0.004', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon4': '0.044', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'weapon2': '0.290', 'WEAPON3': '1.050', 'HITCOUNT': '2.860', 'weapon3': '3.434', 'DAMAGECOUNT': '13.365', 'FRAGCOUNT': '38.000'} [2023-02-24 21:11:15,243][213332] Fps is (10 sec: 13107.1, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 137666560. Throughput: 0: 3371.4. Samples: 9412902. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 21:11:15,243][213332] Avg episode reward: [(0, '44.290')] [2023-02-24 21:11:15,260][213352] Saving new best policy, reward=44.290! [2023-02-24 21:11:16,725][213365] Updated weights for policy 0, policy_version 33616 (0.0009) [2023-02-24 21:11:18,886][213368] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('ARMOR', -0.001, -1.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 21:11:19,822][213365] Updated weights for policy 0, policy_version 33626 (0.0009) [2023-02-24 21:11:20,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 137736192. Throughput: 0: 3373.4. Samples: 9423172. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 21:11:20,243][213332] Avg episode reward: [(0, '44.290')] [2023-02-24 21:11:22,824][213365] Updated weights for policy 0, policy_version 33636 (0.0009) [2023-02-24 21:11:25,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 137801728. Throughput: 0: 3374.6. Samples: 9443382. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 21:11:25,243][213332] Avg episode reward: [(0, '44.290')] [2023-02-24 21:11:25,874][213365] Updated weights for policy 0, policy_version 33646 (0.0009) [2023-02-24 21:11:28,951][213365] Updated weights for policy 0, policy_version 33656 (0.0009) [2023-02-24 21:11:29,635][213367] DAMAGECOUNT value on done: 433841.0 [2023-02-24 21:11:29,636][213367] Sum rewards: 37.147, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.926', 'AMMO2': '0.004', 'AMMO5': '0.012', 'AMMO4': '0.018', 'WEAPON4': '0.050', 'weapon4': '0.114', 'weapon5': '0.144', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.300', 'HITCOUNT': '2.360', 'weapon3': '3.176', 'DAMAGECOUNT': '10.365', 'FRAGCOUNT': '34.000'} [2023-02-24 21:11:29,794][213367] DAMAGECOUNT value on done: 441750.0 [2023-02-24 21:11:29,794][213367] Sum rewards: 42.650, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.173', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon5': '0.182', 'AMMO3': '0.186', 'weapon4': '0.244', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.430', 'WEAPON3': '1.150', 'HITCOUNT': '2.600', 'weapon3': '2.752', 'DAMAGECOUNT': '11.127', 'FRAGCOUNT': '38.000'} [2023-02-24 21:11:29,943][213372] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('HEALTH', -0.045, -15.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 21:11:29,955][213367] DAMAGECOUNT value on done: 436525.0 [2023-02-24 21:11:29,955][213367] Sum rewards: 43.522, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.508', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO4': '0.175', 'AMMO3': '0.194', 'weapon5': '0.220', 'weapon4': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.456', 'WEAPON3': '1.150', 'weapon3': '2.712', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.537', 'FRAGCOUNT': '38.000'} [2023-02-24 21:11:30,105][213367] DAMAGECOUNT value on done: 442322.0 [2023-02-24 21:11:30,106][213367] Sum rewards: 46.456, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.924', 'ARMOR': '0.004', 'AMMO2': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.051', 'weapon4': '0.076', 'weapon5': '0.080', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.750', 'WEAPON3': '1.250', 'weapon3': '2.848', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.281', 'FRAGCOUNT': '41.000'} [2023-02-24 21:11:30,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 137871360. Throughput: 0: 3369.4. Samples: 9463410. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 21:11:30,243][213332] Avg episode reward: [(0, '44.466')] [2023-02-24 21:11:30,244][213352] Saving new best policy, reward=44.466! [2023-02-24 21:11:30,824][213372] DAMAGECOUNT value on done: 446065.0 [2023-02-24 21:11:30,824][213372] Sum rewards: 55.855, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.500', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.104', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon4': '0.330', 'weapon2': '0.458', 'WEAPON3': '1.200', 'weapon3': '2.960', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '13.992', 'FRAGCOUNT': '48.000'} [2023-02-24 21:11:30,955][213372] DAMAGECOUNT value on done: 434714.0 [2023-02-24 21:11:30,955][213372] Sum rewards: 50.403, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.128', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.044', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon5': '0.230', 'WEAPON5': '0.250', 'weapon2': '0.314', 'weapon4': '0.318', 'WEAPON3': '1.150', 'HITCOUNT': '2.580', 'weapon3': '2.884', 'DAMAGECOUNT': '12.603', 'FRAGCOUNT': '43.000'} [2023-02-24 21:11:31,136][213372] DAMAGECOUNT value on done: 443910.0 [2023-02-24 21:11:31,137][213372] Sum rewards: 36.300, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.711', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.134', 'weapon2': '0.160', 'AMMO3': '0.225', 'AMMO4': '0.235', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.644', 'WEAPON3': '1.450', 'HITCOUNT': '2.350', 'weapon3': '2.724', 'DAMAGECOUNT': '10.632', 'FRAGCOUNT': '35.000'} [2023-02-24 21:11:31,269][213372] DAMAGECOUNT value on done: 432434.0 [2023-02-24 21:11:31,269][213372] Sum rewards: 49.220, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.254', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.096', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon4': '0.386', 'weapon2': '0.388', 'WEAPON3': '1.200', 'weapon3': '2.910', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.619', 'FRAGCOUNT': '42.000'} [2023-02-24 21:11:31,413][213366] DAMAGECOUNT value on done: 431365.0 [2023-02-24 21:11:31,413][213366] Sum rewards: 37.029, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.446', 'AMMO5': '0.011', 'AMMO2': '0.038', 'AMMO3': '0.143', 'AMMO4': '0.189', 'weapon5': '0.192', 'WEAPON5': '0.250', 'WEAPON4': '0.550', 'weapon2': '0.576', 'WEAPON3': '0.850', 'weapon4': '1.096', 'weapon3': '1.934', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '10.515', 'FRAGCOUNT': '32.000'} [2023-02-24 21:11:31,719][213366] DAMAGECOUNT value on done: 443138.0 [2023-02-24 21:11:31,720][213366] Sum rewards: 43.510, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.255', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.166', 'AMMO3': '0.174', 'weapon2': '0.206', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.730', 'WEAPON3': '1.050', 'weapon3': '2.706', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.786', 'FRAGCOUNT': '37.000'} [2023-02-24 21:11:31,730][213366] DAMAGECOUNT value on done: 452093.0 [2023-02-24 21:11:31,731][213366] Sum rewards: 44.118, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.333', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.206', 'AMMO3': '0.214', 'weapon4': '0.256', 'weapon2': '0.498', 'WEAPON3': '1.200', 'HITCOUNT': '2.400', 'weapon3': '2.792', 'DAMAGECOUNT': '11.853', 'FRAGCOUNT': '41.000'} [2023-02-24 21:11:31,957][213365] Updated weights for policy 0, policy_version 33666 (0.0009) [2023-02-24 21:11:32,045][213366] DAMAGECOUNT value on done: 436024.0 [2023-02-24 21:11:32,045][213366] Sum rewards: 35.214, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.890', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.003', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.090', 'weapon4': '0.126', 'AMMO3': '0.167', 'weapon2': '0.676', 'WEAPON3': '1.100', 'HITCOUNT': '2.360', 'weapon3': '2.970', 'DAMAGECOUNT': '10.260', 'FRAGCOUNT': '29.000'} [2023-02-24 21:11:32,489][213383] DAMAGECOUNT value on done: 433692.0 [2023-02-24 21:11:32,490][213383] Sum rewards: 45.976, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.402', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.144', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.376', 'weapon4': '0.828', 'WEAPON3': '1.050', 'weapon3': '2.446', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.180', 'FRAGCOUNT': '39.000'} [2023-02-24 21:11:32,517][213368] DAMAGECOUNT value on done: 433406.0 [2023-02-24 21:11:32,518][213368] Sum rewards: 49.542, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.637', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.062', 'WEAPON4': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'weapon5': '0.202', 'weapon2': '0.646', 'WEAPON3': '1.200', 'HITCOUNT': '2.750', 'weapon3': '2.836', 'DAMAGECOUNT': '12.993', 'FRAGCOUNT': '44.000'} [2023-02-24 21:11:32,545][213382] DAMAGECOUNT value on done: 441864.0 [2023-02-24 21:11:32,545][213382] Sum rewards: 51.181, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.818', 'AMMO2': '0.015', 'AMMO4': '0.073', 'AMMO3': '0.151', 'weapon2': '0.592', 'WEAPON3': '0.950', 'HITCOUNT': '2.440', 'weapon3': '3.246', 'DAMAGECOUNT': '11.532', 'FRAGCOUNT': '42.000'} [2023-02-24 21:11:32,549][213369] DAMAGECOUNT value on done: 442539.0 [2023-02-24 21:11:32,550][213369] Sum rewards: 54.171, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.472', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.173', 'weapon2': '0.316', 'WEAPON3': '1.150', 'HITCOUNT': '2.980', 'weapon3': '3.474', 'DAMAGECOUNT': '13.521', 'FRAGCOUNT': '45.000'} [2023-02-24 21:11:32,805][213383] DAMAGECOUNT value on done: 440136.0 [2023-02-24 21:11:32,805][213383] Sum rewards: 48.305, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.783', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon5': '0.152', 'AMMO3': '0.213', 'AMMO4': '0.224', 'WEAPON5': '0.350', 'weapon2': '0.382', 'weapon4': '0.478', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.642', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.053', 'FRAGCOUNT': '43.000'} [2023-02-24 21:11:32,854][213368] DAMAGECOUNT value on done: 441864.0 [2023-02-24 21:11:32,855][213368] Sum rewards: 49.541, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.364', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'weapon5': '0.176', 'AMMO3': '0.189', 'AMMO4': '0.194', 'WEAPON4': '0.250', 'weapon2': '0.348', 'weapon4': '0.474', 'WEAPON3': '1.100', 'weapon3': '2.686', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '12.870', 'FRAGCOUNT': '43.000'} [2023-02-24 21:11:32,858][213382] DAMAGECOUNT value on done: 439983.0 [2023-02-24 21:11:32,859][213382] Sum rewards: 37.252, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.974', 'AMMO2': '0.004', 'AMMO4': '0.022', 'weapon4': '0.028', 'WEAPON4': '0.100', 'AMMO3': '0.181', 'weapon2': '0.524', 'WEAPON3': '1.200', 'HITCOUNT': '2.180', 'weapon3': '3.342', 'DAMAGECOUNT': '9.645', 'FRAGCOUNT': '34.000'} [2023-02-24 21:11:32,862][213369] DAMAGECOUNT value on done: 440720.0 [2023-02-24 21:11:32,862][213369] Sum rewards: 40.690, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.690', 'AMMO2': '0.007', 'AMMO5': '0.009', 'AMMO4': '0.036', 'weapon5': '0.088', 'WEAPON4': '0.100', 'weapon4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.402', 'WEAPON3': '1.350', 'HITCOUNT': '2.670', 'weapon3': '3.190', 'DAMAGECOUNT': '11.457', 'FRAGCOUNT': '37.000'} [2023-02-24 21:11:33,108][213368] DAMAGECOUNT value on done: 434154.0 [2023-02-24 21:11:33,109][213368] Sum rewards: 48.165, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.057', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.034', 'weapon5': '0.068', 'AMMO4': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.442', 'WEAPON3': '1.400', 'HITCOUNT': '3.170', 'weapon3': '3.252', 'DAMAGECOUNT': '14.619', 'FRAGCOUNT': '41.000'} [2023-02-24 21:11:33,162][213382] DAMAGECOUNT value on done: 428384.0 [2023-02-24 21:11:33,163][213382] Sum rewards: 46.567, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.059', 'AMMO5': '0.017', 'AMMO2': '0.034', 'AMMO4': '0.170', 'AMMO3': '0.196', 'weapon5': '0.232', 'weapon2': '0.238', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.560', 'WEAPON3': '1.200', 'weapon3': '2.620', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.768', 'FRAGCOUNT': '42.000'} [2023-02-24 21:11:33,163][213369] DAMAGECOUNT value on done: 440062.0 [2023-02-24 21:11:33,163][213369] Sum rewards: 44.194, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.260', 'AMMO2': '0.003', 'AMMO5': '0.003', 'AMMO4': '0.014', 'weapon4': '0.022', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.232', 'weapon2': '0.798', 'WEAPON3': '1.450', 'HITCOUNT': '2.810', 'weapon3': '2.952', 'DAMAGECOUNT': '11.172', 'FRAGCOUNT': '42.000'} [2023-02-24 21:11:33,355][213384] DAMAGECOUNT value on done: 443502.0 [2023-02-24 21:11:33,356][213384] Sum rewards: 44.363, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.257', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.118', 'AMMO4': '0.190', 'weapon5': '0.230', 'weapon2': '0.252', 'WEAPON5': '0.350', 'WEAPON4': '0.650', 'WEAPON3': '0.700', 'weapon4': '1.080', 'weapon3': '1.994', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '11.742', 'FRAGCOUNT': '36.000'} [2023-02-24 21:11:33,411][213368] DAMAGECOUNT value on done: 432762.0 [2023-02-24 21:11:33,412][213368] Sum rewards: 44.644, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.784', 'ARMOR': '0.008', 'AMMO5': '0.031', 'AMMO2': '0.056', 'weapon5': '0.120', 'weapon4': '0.174', 'AMMO3': '0.186', 'AMMO4': '0.279', 'weapon2': '0.460', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.000', 'HITCOUNT': '2.540', 'weapon3': '2.996', 'DAMAGECOUNT': '11.928', 'FRAGCOUNT': '40.500'} [2023-02-24 21:11:33,460][213382] DAMAGECOUNT value on done: 436819.0 [2023-02-24 21:11:33,460][213382] Sum rewards: 57.164, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.325', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.010', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.050', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'weapon2': '0.194', 'weapon4': '0.480', 'WEAPON3': '0.850', 'HITCOUNT': '2.880', 'weapon3': '3.036', 'DAMAGECOUNT': '13.341', 'FRAGCOUNT': '46.000'} [2023-02-24 21:11:33,461][213383] DAMAGECOUNT value on done: 441860.0 [2023-02-24 21:11:33,462][213383] Sum rewards: 45.947, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.992', 'AMMO5': '0.015', 'ARMOR': '0.020', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.152', 'AMMO3': '0.247', 'weapon2': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.444', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '12.072', 'FRAGCOUNT': '43.000'} [2023-02-24 21:11:33,481][213369] DAMAGECOUNT value on done: 428598.0 [2023-02-24 21:11:33,481][213369] Sum rewards: 40.368, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.624', 'AMMO5': '0.014', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon4': '0.088', 'WEAPON4': '0.200', 'weapon5': '0.250', 'AMMO3': '0.268', 'WEAPON5': '0.400', 'weapon2': '0.940', 'WEAPON3': '1.600', 'weapon3': '2.434', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '12.498', 'FRAGCOUNT': '41.000'} [2023-02-24 21:11:33,671][213384] DAMAGECOUNT value on done: 425406.0 [2023-02-24 21:11:33,672][213384] Sum rewards: 47.322, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.340', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.140', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.262', 'weapon4': '0.818', 'WEAPON3': '1.100', 'weapon3': '2.494', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '11.865', 'FRAGCOUNT': '40.000'} [2023-02-24 21:11:33,786][213383] DAMAGECOUNT value on done: 432749.0 [2023-02-24 21:11:33,787][213383] Sum rewards: 51.570, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.820', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.018', 'AMMO4': '0.092', 'AMMO3': '0.125', 'weapon5': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.336', 'weapon4': '0.432', 'WEAPON3': '0.850', 'weapon3': '2.824', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.747', 'FRAGCOUNT': '42.000'} [2023-02-24 21:11:34,009][213384] DAMAGECOUNT value on done: 440142.0 [2023-02-24 21:11:34,010][213384] Sum rewards: 44.962, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.754', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'weapon5': '0.204', 'AMMO3': '0.214', 'weapon4': '0.232', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON3': '1.200', 'HITCOUNT': '2.410', 'weapon3': '2.944', 'DAMAGECOUNT': '11.949', 'FRAGCOUNT': '40.000'} [2023-02-24 21:11:34,323][213384] DAMAGECOUNT value on done: 441923.0 [2023-02-24 21:11:34,324][213384] Sum rewards: 36.871, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.020', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon2': '0.168', 'AMMO4': '0.190', 'weapon5': '0.200', 'AMMO3': '0.239', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.534', 'WEAPON3': '1.400', 'HITCOUNT': '2.510', 'weapon3': '2.704', 'DAMAGECOUNT': '10.791', 'FRAGCOUNT': '36.000'} [2023-02-24 21:11:35,038][213365] Updated weights for policy 0, policy_version 33676 (0.0009) [2023-02-24 21:11:35,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 137936896. Throughput: 0: 3368.2. Samples: 9473542. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 21:11:35,243][213332] Avg episode reward: [(0, '44.893')] [2023-02-24 21:11:35,250][213352] Saving new best policy, reward=44.893! [2023-02-24 21:11:38,057][213365] Updated weights for policy 0, policy_version 33686 (0.0009) [2023-02-24 21:11:40,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 138006528. Throughput: 0: 3368.2. Samples: 9493750. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 21:11:40,244][213332] Avg episode reward: [(0, '44.893')] [2023-02-24 21:11:41,076][213365] Updated weights for policy 0, policy_version 33696 (0.0009) [2023-02-24 21:11:44,167][213365] Updated weights for policy 0, policy_version 33706 (0.0009) [2023-02-24 21:11:45,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 138072064. Throughput: 0: 3362.2. Samples: 9513790. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 21:11:45,243][213332] Avg episode reward: [(0, '44.893')] [2023-02-24 21:11:47,161][213365] Updated weights for policy 0, policy_version 33716 (0.0009) [2023-02-24 21:11:49,628][213367] DAMAGECOUNT value on done: 437321.0 [2023-02-24 21:11:49,628][213367] Sum rewards: 48.208, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.121', 'AMMO3': '0.125', 'HEALTH': '0.207', 'WEAPON4': '0.250', 'weapon4': '0.416', 'weapon2': '0.438', 'WEAPON3': '0.800', 'HITCOUNT': '2.570', 'weapon3': '2.976', 'DAMAGECOUNT': '10.440', 'FRAGCOUNT': '41.000'} [2023-02-24 21:11:49,790][213367] DAMAGECOUNT value on done: 445749.0 [2023-02-24 21:11:49,791][213367] Sum rewards: 47.050, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.400', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.132', 'weapon5': '0.150', 'weapon4': '0.242', 'weapon2': '0.738', 'WEAPON3': '0.800', 'HITCOUNT': '2.650', 'weapon3': '2.728', 'DAMAGECOUNT': '11.697', 'FRAGCOUNT': '37.000'} [2023-02-24 21:11:49,952][213367] DAMAGECOUNT value on done: 441506.0 [2023-02-24 21:11:49,953][213367] Sum rewards: 46.171, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.660', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon4': '0.102', 'weapon5': '0.136', 'AMMO4': '0.183', 'AMMO3': '0.225', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.708', 'WEAPON3': '1.350', 'weapon3': '2.808', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.943', 'FRAGCOUNT': '42.000'} [2023-02-24 21:11:50,107][213367] DAMAGECOUNT value on done: 446818.0 [2023-02-24 21:11:50,107][213367] Sum rewards: 47.652, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.894', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.125', 'weapon5': '0.258', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.452', 'weapon2': '0.662', 'WEAPON3': '0.750', 'weapon3': '2.350', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '13.488', 'FRAGCOUNT': '38.000'} [2023-02-24 21:11:50,243][213332] Fps is (10 sec: 13107.3, 60 sec: 13448.6, 300 sec: 13496.0). Total num frames: 138137600. Throughput: 0: 3362.1. Samples: 9524052. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 21:11:50,243][213332] Avg episode reward: [(0, '44.793')] [2023-02-24 21:11:50,250][213365] Updated weights for policy 0, policy_version 33726 (0.0009) [2023-02-24 21:11:50,818][213372] DAMAGECOUNT value on done: 450771.0 [2023-02-24 21:11:50,819][213372] Sum rewards: 51.499, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.900', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.114', 'weapon2': '0.202', 'AMMO3': '0.204', 'weapon4': '0.232', 'WEAPON3': '1.250', 'HITCOUNT': '3.040', 'weapon3': '3.216', 'DAMAGECOUNT': '14.100', 'FRAGCOUNT': '44.000'} [2023-02-24 21:11:50,958][213372] DAMAGECOUNT value on done: 438081.0 [2023-02-24 21:11:50,958][213372] Sum rewards: 40.620, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.783', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.102', 'AMMO4': '0.122', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.438', 'weapon2': '0.616', 'WEAPON3': '1.150', 'weapon3': '2.648', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '10.101', 'FRAGCOUNT': '38.000'} [2023-02-24 21:11:51,125][213372] DAMAGECOUNT value on done: 447261.0 [2023-02-24 21:11:51,125][213372] Sum rewards: 32.043, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.950', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.161', 'weapon5': '0.162', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.554', 'weapon4': '0.594', 'WEAPON3': '1.000', 'HITCOUNT': '2.360', 'weapon3': '2.466', 'DAMAGECOUNT': '10.053', 'FRAGCOUNT': '28.500'} [2023-02-24 21:11:51,263][213372] DAMAGECOUNT value on done: 436470.0 [2023-02-24 21:11:51,264][213372] Sum rewards: 42.284, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.292', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.041', 'AMMO3': '0.144', 'weapon5': '0.190', 'AMMO4': '0.205', 'WEAPON5': '0.300', 'weapon4': '0.348', 'WEAPON4': '0.400', 'weapon2': '0.732', 'WEAPON3': '0.900', 'weapon3': '2.522', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '12.108', 'FRAGCOUNT': '35.000'} [2023-02-24 21:11:51,389][213366] DAMAGECOUNT value on done: 435222.0 [2023-02-24 21:11:51,389][213366] Sum rewards: 39.680, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.918', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.060', 'AMMO3': '0.178', 'AMMO4': '0.298', 'weapon5': '0.350', 'WEAPON5': '0.500', 'weapon2': '0.520', 'WEAPON4': '0.600', 'weapon4': '0.616', 'WEAPON3': '1.000', 'weapon3': '2.122', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '11.571', 'FRAGCOUNT': '37.000'} [2023-02-24 21:11:51,682][213366] DAMAGECOUNT value on done: 446434.0 [2023-02-24 21:11:51,682][213366] Sum rewards: 35.765, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.155', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'weapon2': '0.164', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.298', 'WEAPON3': '1.250', 'HITCOUNT': '2.190', 'weapon3': '3.258', 'DAMAGECOUNT': '9.858', 'FRAGCOUNT': '33.000'} [2023-02-24 21:11:51,691][213366] DAMAGECOUNT value on done: 456190.0 [2023-02-24 21:11:51,691][213366] Sum rewards: 38.434, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.430', 'AMMO5': '0.021', 'AMMO2': '0.042', 'AMMO3': '0.166', 'weapon5': '0.182', 'AMMO4': '0.210', 'WEAPON4': '0.350', 'weapon2': '0.396', 'WEAPON5': '0.500', 'weapon4': '0.530', 'WEAPON3': '1.050', 'HITCOUNT': '2.380', 'weapon3': '2.496', 'DAMAGECOUNT': '12.291', 'FRAGCOUNT': '33.000'} [2023-02-24 21:11:52,008][213366] DAMAGECOUNT value on done: 440225.0 [2023-02-24 21:11:52,009][213366] Sum rewards: 42.170, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.426', 'AMMO5': '0.020', 'AMMO2': '0.042', 'AMMO3': '0.156', 'AMMO4': '0.209', 'weapon5': '0.240', 'WEAPON5': '0.500', 'weapon2': '0.534', 'WEAPON4': '0.550', 'weapon4': '0.586', 'WEAPON3': '1.050', 'weapon3': '2.396', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.603', 'FRAGCOUNT': '37.500'} [2023-02-24 21:11:52,479][213368] DAMAGECOUNT value on done: 437013.0 [2023-02-24 21:11:52,480][213368] Sum rewards: 40.824, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.630', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'weapon5': '0.066', 'weapon4': '0.116', 'AMMO3': '0.128', 'WEAPON5': '0.200', 'WEAPON3': '0.900', 'weapon2': '1.006', 'HITCOUNT': '2.440', 'weapon3': '2.670', 'DAMAGECOUNT': '10.821', 'FRAGCOUNT': '33.000'} [2023-02-24 21:11:52,488][213383] DAMAGECOUNT value on done: 438587.0 [2023-02-24 21:11:52,489][213383] Sum rewards: 54.632, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.296', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'AMMO3': '0.245', 'weapon4': '0.276', 'weapon2': '0.602', 'WEAPON3': '1.450', 'weapon3': '2.796', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.685', 'FRAGCOUNT': '48.000'} [2023-02-24 21:11:52,507][213369] DAMAGECOUNT value on done: 446090.0 [2023-02-24 21:11:52,507][213369] Sum rewards: 44.175, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.775', 'AMMO2': '0.002', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO4': '0.009', 'WEAPON5': '0.050', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'weapon4': '0.512', 'weapon2': '0.546', 'WEAPON3': '1.000', 'HITCOUNT': '2.530', 'weapon3': '2.780', 'DAMAGECOUNT': '10.653', 'FRAGCOUNT': '38.000'} [2023-02-24 21:11:52,508][213382] DAMAGECOUNT value on done: 446100.0 [2023-02-24 21:11:52,508][213382] Sum rewards: 42.788, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.570', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon5': '0.154', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.277', 'weapon4': '0.306', 'weapon2': '0.380', 'WEAPON3': '1.700', 'weapon3': '2.856', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.708', 'FRAGCOUNT': '41.000'} [2023-02-24 21:11:52,799][213368] DAMAGECOUNT value on done: 445779.0 [2023-02-24 21:11:52,800][213368] Sum rewards: 39.230, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.140', 'AMMO5': '0.023', 'AMMO2': '0.034', 'weapon5': '0.114', 'AMMO4': '0.170', 'AMMO3': '0.178', 'weapon2': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon4': '0.596', 'WEAPON3': '1.100', 'HITCOUNT': '2.550', 'weapon3': '2.742', 'DAMAGECOUNT': '11.745', 'FRAGCOUNT': '33.000'} [2023-02-24 21:11:52,802][213383] DAMAGECOUNT value on done: 444221.0 [2023-02-24 21:11:52,803][213383] Sum rewards: 46.079, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.866', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.041', 'AMMO3': '0.166', 'AMMO4': '0.203', 'weapon2': '0.328', 'WEAPON4': '0.400', 'weapon5': '0.408', 'WEAPON5': '0.450', 'weapon4': '0.486', 'WEAPON3': '0.950', 'weapon3': '2.388', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '12.255', 'FRAGCOUNT': '39.000'} [2023-02-24 21:11:52,808][213382] DAMAGECOUNT value on done: 444441.0 [2023-02-24 21:11:52,808][213382] Sum rewards: 43.773, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.880', 'AMMO5': '0.016', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon2': '0.170', 'AMMO3': '0.187', 'weapon5': '0.280', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.420', 'WEAPON3': '1.100', 'HITCOUNT': '2.620', 'weapon3': '2.760', 'DAMAGECOUNT': '13.374', 'FRAGCOUNT': '38.000'} [2023-02-24 21:11:52,827][213369] DAMAGECOUNT value on done: 444572.0 [2023-02-24 21:11:52,827][213369] Sum rewards: 46.470, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.887', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.032', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.141', 'WEAPON4': '0.200', 'weapon4': '0.286', 'weapon2': '0.708', 'WEAPON3': '0.900', 'weapon3': '2.774', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '11.556', 'FRAGCOUNT': '39.000'} [2023-02-24 21:11:53,071][213368] DAMAGECOUNT value on done: 437386.0 [2023-02-24 21:11:53,072][213368] Sum rewards: 30.556, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.115', 'AMMO5': '0.010', 'AMMO2': '0.046', 'AMMO3': '0.159', 'weapon5': '0.194', 'AMMO4': '0.232', 'weapon2': '0.274', 'WEAPON5': '0.300', 'ARMOR': '0.455', 'WEAPON4': '0.550', 'weapon4': '0.728', 'WEAPON3': '1.000', 'weapon3': '1.976', 'HITCOUNT': '2.300', 'DAMAGECOUNT': '9.696', 'FRAGCOUNT': '30.000'} [2023-02-24 21:11:53,125][213382] DAMAGECOUNT value on done: 432339.0 [2023-02-24 21:11:53,126][213382] Sum rewards: 43.438, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.246', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.060', 'AMMO4': '0.126', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.310', 'weapon2': '0.684', 'WEAPON3': '0.900', 'HITCOUNT': '2.630', 'weapon3': '2.774', 'DAMAGECOUNT': '11.865', 'FRAGCOUNT': '35.000'} [2023-02-24 21:11:53,138][213369] DAMAGECOUNT value on done: 443856.0 [2023-02-24 21:11:53,139][213369] Sum rewards: 38.600, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.496', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.148', 'AMMO4': '0.168', 'WEAPON4': '0.200', 'weapon5': '0.216', 'WEAPON5': '0.300', 'weapon2': '0.414', 'weapon4': '0.748', 'WEAPON3': '0.850', 'HITCOUNT': '2.290', 'weapon3': '2.332', 'DAMAGECOUNT': '11.382', 'FRAGCOUNT': '32.000'} [2023-02-24 21:11:53,288][213365] Updated weights for policy 0, policy_version 33736 (0.0009) [2023-02-24 21:11:53,379][213384] DAMAGECOUNT value on done: 447595.0 [2023-02-24 21:11:53,380][213384] Sum rewards: 51.757, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.124', 'AMMO3': '0.141', 'HEALTH': '0.240', 'WEAPON4': '0.300', 'weapon4': '0.536', 'weapon2': '0.668', 'WEAPON3': '0.800', 'weapon3': '2.614', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.279', 'FRAGCOUNT': '44.000'} [2023-02-24 21:11:53,383][213368] DAMAGECOUNT value on done: 437647.0 [2023-02-24 21:11:53,383][213368] Sum rewards: 54.031, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.464', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.047', 'weapon5': '0.058', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.258', 'AMMO3': '0.267', 'weapon2': '0.338', 'WEAPON3': '1.600', 'weapon3': '3.070', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.655', 'FRAGCOUNT': '50.000'} [2023-02-24 21:11:53,435][213382] DAMAGECOUNT value on done: 440788.0 [2023-02-24 21:11:53,436][213382] Sum rewards: 36.656, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.310', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon5': '0.184', 'AMMO4': '0.217', 'AMMO3': '0.249', 'weapon2': '0.286', 'weapon4': '0.350', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '2.400', 'weapon3': '2.862', 'DAMAGECOUNT': '11.907', 'FRAGCOUNT': '37.000'} [2023-02-24 21:11:53,452][213383] DAMAGECOUNT value on done: 446022.0 [2023-02-24 21:11:53,452][213383] Sum rewards: 47.912, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.880', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon7': '0.070', 'weapon5': '0.104', 'AMMO4': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.124', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.510', 'weapon2': '0.660', 'WEAPON3': '0.850', 'weapon3': '2.446', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '12.486', 'FRAGCOUNT': '38.000'} [2023-02-24 21:11:53,458][213369] DAMAGECOUNT value on done: 432371.0 [2023-02-24 21:11:53,459][213369] Sum rewards: 44.700, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.806', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.034', 'weapon5': '0.086', 'AMMO4': '0.136', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.462', 'WEAPON3': '1.000', 'HITCOUNT': '2.670', 'weapon3': '3.146', 'DAMAGECOUNT': '11.319', 'FRAGCOUNT': '38.000'} [2023-02-24 21:11:53,698][213384] DAMAGECOUNT value on done: 428966.0 [2023-02-24 21:11:53,698][213384] Sum rewards: 40.731, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.889', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.084', 'AMMO3': '0.123', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.400', 'weapon2': '0.530', 'WEAPON3': '0.800', 'HITCOUNT': '2.350', 'weapon3': '2.800', 'DAMAGECOUNT': '10.680', 'FRAGCOUNT': '33.000'} [2023-02-24 21:11:53,767][213383] DAMAGECOUNT value on done: 436731.0 [2023-02-24 21:11:53,768][213383] Sum rewards: 38.817, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.960', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.142', 'AMMO3': '0.172', 'weapon5': '0.190', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.428', 'weapon2': '0.432', 'WEAPON3': '1.150', 'HITCOUNT': '2.640', 'weapon3': '2.778', 'DAMAGECOUNT': '11.856', 'FRAGCOUNT': '35.000'} [2023-02-24 21:11:54,021][213384] DAMAGECOUNT value on done: 443516.0 [2023-02-24 21:11:54,022][213384] Sum rewards: 37.745, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.035', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.152', 'AMMO3': '0.153', 'AMMO4': '0.219', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON4': '0.400', 'weapon4': '0.726', 'WEAPON3': '0.900', 'HITCOUNT': '2.320', 'weapon3': '2.360', 'DAMAGECOUNT': '10.122', 'FRAGCOUNT': '32.000'} [2023-02-24 21:11:54,345][213384] DAMAGECOUNT value on done: 445847.0 [2023-02-24 21:11:54,345][213384] Sum rewards: 38.205, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.122', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.016', 'weapon5': '0.048', 'AMMO4': '0.079', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.360', 'weapon4': '0.444', 'WEAPON3': '1.350', 'HITCOUNT': '2.810', 'weapon3': '2.910', 'DAMAGECOUNT': '11.772', 'FRAGCOUNT': '34.000'} [2023-02-24 21:11:55,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 138207232. Throughput: 0: 3359.7. Samples: 9544108. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 21:11:55,243][213332] Avg episode reward: [(0, '44.264')] [2023-02-24 21:11:56,313][213365] Updated weights for policy 0, policy_version 33746 (0.0009) [2023-02-24 21:11:56,460][213384] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 21:11:59,422][213365] Updated weights for policy 0, policy_version 33756 (0.0009) [2023-02-24 21:12:00,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 138272768. Throughput: 0: 3362.2. Samples: 9564202. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 21:12:00,243][213332] Avg episode reward: [(0, '44.264')] [2023-02-24 21:12:02,434][213365] Updated weights for policy 0, policy_version 33766 (0.0009) [2023-02-24 21:12:05,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 138342400. Throughput: 0: 3361.5. Samples: 9574438. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 21:12:05,243][213332] Avg episode reward: [(0, '44.264')] [2023-02-24 21:12:05,517][213365] Updated weights for policy 0, policy_version 33776 (0.0008) [2023-02-24 21:12:08,589][213365] Updated weights for policy 0, policy_version 33786 (0.0009) [2023-02-24 21:12:09,630][213367] DAMAGECOUNT value on done: 442062.0 [2023-02-24 21:12:09,631][213367] Sum rewards: 44.753, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.390', 'AMMO5': '0.023', 'AMMO2': '0.041', 'weapon4': '0.160', 'AMMO3': '0.187', 'AMMO4': '0.206', 'weapon5': '0.316', 'WEAPON4': '0.400', 'weapon2': '0.432', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'HITCOUNT': '2.610', 'weapon3': '2.744', 'DAMAGECOUNT': '14.223', 'FRAGCOUNT': '39.000'} [2023-02-24 21:12:09,795][213367] DAMAGECOUNT value on done: 448970.0 [2023-02-24 21:12:09,797][213367] Sum rewards: 42.057, reward structure: {'DEATHCOUNT': '-9.000', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.026', 'HEALTH': '0.074', 'AMMO3': '0.110', 'AMMO4': '0.128', 'WEAPON4': '0.200', 'weapon5': '0.262', 'WEAPON5': '0.350', 'weapon2': '0.510', 'weapon4': '0.548', 'WEAPON3': '0.650', 'HITCOUNT': '2.120', 'weapon3': '2.396', 'DAMAGECOUNT': '9.663', 'FRAGCOUNT': '34.000'} [2023-02-24 21:12:09,950][213367] DAMAGECOUNT value on done: 444611.0 [2023-02-24 21:12:09,951][213367] Sum rewards: 35.085, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.054', 'weapon5': '0.120', 'AMMO3': '0.131', 'HEALTH': '0.160', 'WEAPON5': '0.250', 'AMMO4': '0.268', 'WEAPON4': '0.350', 'weapon4': '0.662', 'WEAPON3': '0.700', 'weapon2': '0.920', 'weapon3': '1.860', 'HITCOUNT': '2.260', 'DAMAGECOUNT': '9.315', 'FRAGCOUNT': '30.000'} [2023-02-24 21:12:10,108][213367] DAMAGECOUNT value on done: 450921.0 [2023-02-24 21:12:10,109][213367] Sum rewards: 38.309, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.360', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.040', 'AMMO4': '0.200', 'weapon5': '0.200', 'AMMO3': '0.215', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.384', 'weapon2': '0.676', 'WEAPON3': '1.200', 'weapon3': '2.386', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.309', 'FRAGCOUNT': '35.000'} [2023-02-24 21:12:10,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 138407936. Throughput: 0: 3358.6. Samples: 9594518. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 21:12:10,243][213332] Avg episode reward: [(0, '44.174')] [2023-02-24 21:12:10,819][213372] DAMAGECOUNT value on done: 455392.0 [2023-02-24 21:12:10,819][213372] Sum rewards: 54.850, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.634', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.122', 'AMMO4': '0.135', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon4': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.150', 'HITCOUNT': '2.880', 'weapon3': '3.018', 'DAMAGECOUNT': '13.833', 'FRAGCOUNT': '48.000'} [2023-02-24 21:12:10,962][213372] DAMAGECOUNT value on done: 441526.0 [2023-02-24 21:12:10,962][213372] Sum rewards: 37.525, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.240', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.142', 'AMMO3': '0.162', 'AMMO4': '0.197', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.612', 'weapon2': '0.852', 'WEAPON3': '0.950', 'weapon3': '2.148', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '10.335', 'FRAGCOUNT': '33.000'} [2023-02-24 21:12:11,138][213372] DAMAGECOUNT value on done: 451536.0 [2023-02-24 21:12:11,139][213372] Sum rewards: 49.507, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.640', 'AMMO5': '0.008', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'WEAPON5': '0.250', 'weapon2': '0.262', 'weapon4': '0.266', 'weapon5': '0.294', 'WEAPON3': '0.850', 'HITCOUNT': '2.680', 'weapon3': '2.928', 'DAMAGECOUNT': '12.825', 'FRAGCOUNT': '40.000'} [2023-02-24 21:12:11,276][213372] DAMAGECOUNT value on done: 440420.0 [2023-02-24 21:12:11,276][213372] Sum rewards: 42.198, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.940', 'ARMOR': '0.004', 'AMMO2': '0.014', 'AMMO5': '0.016', 'AMMO4': '0.068', 'weapon5': '0.160', 'weapon2': '0.194', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon4': '0.372', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.540', 'weapon3': '3.018', 'DAMAGECOUNT': '11.805', 'FRAGCOUNT': '36.000'} [2023-02-24 21:12:11,435][213366] DAMAGECOUNT value on done: 438754.0 [2023-02-24 21:12:11,435][213366] Sum rewards: 37.839, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.365', 'AMMO5': '0.009', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon2': '0.154', 'weapon5': '0.164', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.294', 'WEAPON3': '1.200', 'HITCOUNT': '2.300', 'weapon3': '3.070', 'DAMAGECOUNT': '10.596', 'FRAGCOUNT': '33.000'} [2023-02-24 21:12:11,607][213365] Updated weights for policy 0, policy_version 33796 (0.0009) [2023-02-24 21:12:11,730][213366] DAMAGECOUNT value on done: 450304.0 [2023-02-24 21:12:11,730][213366] Sum rewards: 33.437, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.352', 'AMMO5': '0.007', 'AMMO2': '0.034', 'AMMO4': '0.168', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'weapon5': '0.210', 'WEAPON4': '0.350', 'weapon2': '0.504', 'weapon4': '0.630', 'WEAPON3': '1.100', 'HITCOUNT': '2.140', 'weapon3': '2.388', 'DAMAGECOUNT': '11.610', 'FRAGCOUNT': '31.000'} [2023-02-24 21:12:11,739][213366] DAMAGECOUNT value on done: 460421.0 [2023-02-24 21:12:11,740][213366] Sum rewards: 48.027, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.080', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.040', 'weapon4': '0.094', 'AMMO3': '0.160', 'weapon5': '0.198', 'AMMO4': '0.199', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'HITCOUNT': '2.640', 'weapon3': '3.232', 'DAMAGECOUNT': '12.693', 'FRAGCOUNT': '40.000'} [2023-02-24 21:12:12,049][213366] DAMAGECOUNT value on done: 444182.0 [2023-02-24 21:12:12,050][213366] Sum rewards: 44.583, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.872', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.102', 'weapon5': '0.132', 'AMMO3': '0.210', 'weapon4': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.570', 'WEAPON3': '1.300', 'HITCOUNT': '2.840', 'weapon3': '2.848', 'DAMAGECOUNT': '11.856', 'FRAGCOUNT': '41.000'} [2023-02-24 21:12:12,472][213368] DAMAGECOUNT value on done: 440589.0 [2023-02-24 21:12:12,473][213368] Sum rewards: 36.997, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.050', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.034', 'weapon5': '0.068', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon2': '0.484', 'WEAPON3': '1.400', 'HITCOUNT': '2.450', 'weapon3': '3.160', 'DAMAGECOUNT': '10.728', 'FRAGCOUNT': '35.000'} [2023-02-24 21:12:12,490][213383] DAMAGECOUNT value on done: 442466.0 [2023-02-24 21:12:12,490][213383] Sum rewards: 42.562, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.120', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO4': '0.186', 'AMMO3': '0.204', 'weapon5': '0.208', 'weapon2': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.510', 'WEAPON3': '1.300', 'HITCOUNT': '2.330', 'weapon3': '2.640', 'DAMAGECOUNT': '11.637', 'FRAGCOUNT': '39.000'} [2023-02-24 21:12:12,500][213382] DAMAGECOUNT value on done: 450068.0 [2023-02-24 21:12:12,500][213382] Sum rewards: 48.443, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.534', 'AMMO5': '0.019', 'AMMO2': '0.057', 'AMMO3': '0.106', 'AMMO4': '0.283', 'weapon5': '0.294', 'weapon2': '0.422', 'weapon4': '0.462', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'HITCOUNT': '2.500', 'weapon3': '2.530', 'DAMAGECOUNT': '11.904', 'FRAGCOUNT': '40.000'} [2023-02-24 21:12:12,582][213369] DAMAGECOUNT value on done: 449779.0 [2023-02-24 21:12:12,583][213369] Sum rewards: 40.916, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.130', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO3': '0.108', 'weapon5': '0.146', 'AMMO4': '0.181', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.350', 'WEAPON3': '0.650', 'weapon2': '1.048', 'weapon3': '2.180', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '11.067', 'FRAGCOUNT': '32.000'} [2023-02-24 21:12:12,788][213368] DAMAGECOUNT value on done: 449523.0 [2023-02-24 21:12:12,789][213368] Sum rewards: 40.738, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.332', 'AMMO5': '0.020', 'AMMO2': '0.035', 'AMMO3': '0.144', 'AMMO4': '0.173', 'weapon5': '0.256', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.518', 'WEAPON3': '0.800', 'weapon4': '0.864', 'weapon3': '2.008', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '11.232', 'FRAGCOUNT': '35.000'} [2023-02-24 21:12:12,798][213383] DAMAGECOUNT value on done: 447785.0 [2023-02-24 21:12:12,798][213383] Sum rewards: 38.813, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.115', 'AMMO2': '0.031', 'WEAPON4': '0.050', 'AMMO4': '0.155', 'AMMO3': '0.194', 'weapon4': '0.224', 'weapon2': '0.974', 'WEAPON3': '1.200', 'weapon3': '2.638', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '10.692', 'FRAGCOUNT': '34.000'} [2023-02-24 21:12:12,813][213382] DAMAGECOUNT value on done: 448715.0 [2023-02-24 21:12:12,814][213382] Sum rewards: 51.523, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.258', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon5': '0.154', 'AMMO4': '0.162', 'weapon4': '0.180', 'AMMO3': '0.202', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.150', 'HITCOUNT': '2.970', 'weapon3': '3.020', 'DAMAGECOUNT': '12.822', 'FRAGCOUNT': '46.000'} [2023-02-24 21:12:12,899][213369] DAMAGECOUNT value on done: 447873.0 [2023-02-24 21:12:12,899][213369] Sum rewards: 29.366, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.950', 'ARMOR': '0.008', 'AMMO5': '0.021', 'AMMO2': '0.036', 'AMMO4': '0.182', 'AMMO3': '0.186', 'weapon4': '0.276', 'weapon5': '0.390', 'weapon2': '0.442', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'HITCOUNT': '2.140', 'weapon3': '2.582', 'DAMAGECOUNT': '9.903', 'FRAGCOUNT': '29.000'} [2023-02-24 21:12:13,057][213368] DAMAGECOUNT value on done: 440372.0 [2023-02-24 21:12:13,058][213368] Sum rewards: 35.581, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.800', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon7': '0.054', 'AMMO4': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.158', 'weapon5': '0.190', 'WEAPON5': '0.250', 'weapon2': '0.362', 'weapon4': '0.456', 'WEAPON3': '0.950', 'HITCOUNT': '2.200', 'weapon3': '2.752', 'DAMAGECOUNT': '8.958', 'FRAGCOUNT': '30.000'} [2023-02-24 21:12:13,129][213382] DAMAGECOUNT value on done: 435851.0 [2023-02-24 21:12:13,130][213382] Sum rewards: 37.547, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.336', 'AMMO5': '0.019', 'AMMO2': '0.035', 'AMMO3': '0.169', 'AMMO4': '0.176', 'weapon5': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.426', 'weapon4': '0.482', 'WEAPON3': '1.000', 'HITCOUNT': '2.430', 'weapon3': '2.642', 'DAMAGECOUNT': '10.536', 'FRAGCOUNT': '33.500'} [2023-02-24 21:12:13,216][213369] DAMAGECOUNT value on done: 447243.0 [2023-02-24 21:12:13,217][213369] Sum rewards: 35.902, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.365', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO3': '0.149', 'AMMO4': '0.176', 'weapon4': '0.210', 'WEAPON4': '0.300', 'weapon5': '0.336', 'WEAPON5': '0.400', 'weapon2': '0.414', 'WEAPON3': '0.950', 'HITCOUNT': '2.450', 'weapon3': '2.670', 'DAMAGECOUNT': '10.161', 'FRAGCOUNT': '31.000'} [2023-02-24 21:12:13,389][213368] DAMAGECOUNT value on done: 440943.0 [2023-02-24 21:12:13,390][213368] Sum rewards: 35.895, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.777', 'AMMO5': '0.014', 'AMMO2': '0.018', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'weapon5': '0.164', 'AMMO3': '0.187', 'WEAPON5': '0.300', 'weapon2': '0.334', 'weapon4': '0.504', 'WEAPON3': '1.150', 'HITCOUNT': '2.150', 'weapon3': '2.724', 'DAMAGECOUNT': '9.888', 'FRAGCOUNT': '32.000'} [2023-02-24 21:12:13,447][213382] DAMAGECOUNT value on done: 444283.0 [2023-02-24 21:12:13,447][213382] Sum rewards: 42.749, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.395', 'AMMO5': '0.017', 'AMMO2': '0.038', 'AMMO3': '0.147', 'AMMO4': '0.188', 'weapon2': '0.230', 'weapon5': '0.372', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'weapon4': '0.946', 'weapon3': '2.030', 'HITCOUNT': '2.240', 'DAMAGECOUNT': '10.485', 'FRAGCOUNT': '37.000'} [2023-02-24 21:12:13,448][213384] DAMAGECOUNT value on done: 450958.0 [2023-02-24 21:12:13,448][213384] Sum rewards: 35.097, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.239', 'AMMO5': '0.007', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.036', 'weapon5': '0.058', 'WEAPON5': '0.150', 'AMMO4': '0.180', 'AMMO3': '0.185', 'weapon2': '0.256', 'weapon4': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.230', 'weapon3': '3.142', 'DAMAGECOUNT': '10.074', 'FRAGCOUNT': '32.000'} [2023-02-24 21:12:13,480][213383] DAMAGECOUNT value on done: 450144.0 [2023-02-24 21:12:13,480][213383] Sum rewards: 45.745, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.998', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO3': '0.192', 'AMMO4': '0.225', 'weapon5': '0.248', 'weapon2': '0.354', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.844', 'WEAPON3': '1.100', 'weapon3': '2.224', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '12.366', 'FRAGCOUNT': '41.000'} [2023-02-24 21:12:13,531][213369] DAMAGECOUNT value on done: 436243.0 [2023-02-24 21:12:13,531][213369] Sum rewards: 45.185, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.428', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.126', 'AMMO4': '0.143', 'AMMO3': '0.190', 'weapon2': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.418', 'WEAPON3': '1.150', 'HITCOUNT': '2.730', 'weapon3': '2.878', 'DAMAGECOUNT': '11.586', 'FRAGCOUNT': '40.000'} [2023-02-24 21:12:13,752][213384] DAMAGECOUNT value on done: 433107.0 [2023-02-24 21:12:13,752][213384] Sum rewards: 47.085, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.900', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.029', 'AMMO2': '0.050', 'AMMO3': '0.153', 'AMMO4': '0.250', 'weapon2': '0.264', 'weapon5': '0.312', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon4': '0.868', 'WEAPON3': '0.950', 'weapon3': '2.122', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '12.423', 'FRAGCOUNT': '40.500'} [2023-02-24 21:12:13,806][213383] DAMAGECOUNT value on done: 439963.0 [2023-02-24 21:12:13,807][213383] Sum rewards: 35.921, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.450', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO3': '0.139', 'AMMO4': '0.170', 'weapon5': '0.390', 'weapon4': '0.418', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.572', 'WEAPON3': '0.850', 'HITCOUNT': '1.830', 'weapon3': '1.856', 'DAMAGECOUNT': '9.696', 'FRAGCOUNT': '31.000'} [2023-02-24 21:12:14,053][213384] DAMAGECOUNT value on done: 447473.0 [2023-02-24 21:12:14,054][213384] Sum rewards: 44.843, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.960', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.088', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'AMMO4': '0.204', 'WEAPON4': '0.300', 'weapon2': '0.622', 'weapon4': '0.632', 'WEAPON3': '1.000', 'weapon3': '2.350', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '11.871', 'FRAGCOUNT': '37.500'} [2023-02-24 21:12:14,372][213384] DAMAGECOUNT value on done: 450010.0 [2023-02-24 21:12:14,372][213384] Sum rewards: 49.079, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.140', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO4': '0.165', 'AMMO3': '0.168', 'weapon5': '0.214', 'WEAPON4': '0.300', 'weapon2': '0.328', 'weapon4': '0.398', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.730', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.489', 'FRAGCOUNT': '41.500'} [2023-02-24 21:12:14,698][213365] Updated weights for policy 0, policy_version 33806 (0.0010) [2023-02-24 21:12:15,243][213332] Fps is (10 sec: 13106.9, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 138473472. Throughput: 0: 3358.1. Samples: 9614524. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 21:12:15,244][213332] Avg episode reward: [(0, '43.334')] [2023-02-24 21:12:17,695][213365] Updated weights for policy 0, policy_version 33816 (0.0008) [2023-02-24 21:12:20,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 138543104. Throughput: 0: 3359.8. Samples: 9624732. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 21:12:20,243][213332] Avg episode reward: [(0, '43.334')] [2023-02-24 21:12:20,761][213365] Updated weights for policy 0, policy_version 33826 (0.0009) [2023-02-24 21:12:23,806][213365] Updated weights for policy 0, policy_version 33836 (0.0009) [2023-02-24 21:12:24,071][213382] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 21:12:25,243][213332] Fps is (10 sec: 13517.0, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 138608640. Throughput: 0: 3357.1. Samples: 9644818. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 21:12:25,243][213332] Avg episode reward: [(0, '43.334')] [2023-02-24 21:12:26,819][213365] Updated weights for policy 0, policy_version 33846 (0.0009) [2023-02-24 21:12:26,936][213372] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 21:12:29,703][213367] DAMAGECOUNT value on done: 446020.0 [2023-02-24 21:12:29,703][213367] Sum rewards: 44.035, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.345', 'AMMO5': '0.006', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'weapon4': '0.060', 'weapon5': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'weapon2': '0.650', 'WEAPON3': '1.000', 'HITCOUNT': '2.650', 'weapon3': '3.024', 'DAMAGECOUNT': '11.859', 'FRAGCOUNT': '36.000'} [2023-02-24 21:12:29,867][213367] DAMAGECOUNT value on done: 453221.0 [2023-02-24 21:12:29,867][213367] Sum rewards: 46.949, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.780', 'AMMO2': '0.017', 'weapon4': '0.018', 'AMMO5': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.084', 'weapon5': '0.130', 'AMMO3': '0.263', 'weapon2': '0.356', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '2.920', 'weapon3': '3.220', 'DAMAGECOUNT': '12.753', 'FRAGCOUNT': '42.000'} [2023-02-24 21:12:29,959][213365] Updated weights for policy 0, policy_version 33856 (0.0009) [2023-02-24 21:12:30,023][213367] DAMAGECOUNT value on done: 448570.0 [2023-02-24 21:12:30,024][213367] Sum rewards: 52.098, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.540', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.019', 'AMMO4': '0.094', 'AMMO3': '0.141', 'weapon5': '0.192', 'WEAPON4': '0.200', 'weapon4': '0.282', 'WEAPON5': '0.350', 'weapon2': '0.560', 'WEAPON3': '0.950', 'HITCOUNT': '2.680', 'weapon3': '2.776', 'DAMAGECOUNT': '11.877', 'FRAGCOUNT': '44.000'} [2023-02-24 21:12:30,173][213367] DAMAGECOUNT value on done: 453844.0 [2023-02-24 21:12:30,173][213367] Sum rewards: 27.782, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.088', 'AMMO5': '0.022', 'AMMO2': '0.043', 'AMMO3': '0.143', 'weapon5': '0.210', 'AMMO4': '0.216', 'weapon2': '0.246', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '0.850', 'weapon4': '1.380', 'weapon3': '1.810', 'HITCOUNT': '1.980', 'DAMAGECOUNT': '8.769', 'FRAGCOUNT': '27.000'} [2023-02-24 21:12:30,243][213332] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13468.2). Total num frames: 138674176. Throughput: 0: 3357.6. Samples: 9664882. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 21:12:30,243][213332] Avg episode reward: [(0, '43.219')] [2023-02-24 21:12:30,874][213372] DAMAGECOUNT value on done: 459210.0 [2023-02-24 21:12:30,874][213372] Sum rewards: 41.190, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.498', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.104', 'weapon4': '0.116', 'AMMO3': '0.189', 'AMMO4': '0.193', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '2.530', 'weapon3': '3.302', 'DAMAGECOUNT': '11.454', 'FRAGCOUNT': '38.000'} [2023-02-24 21:12:31,007][213372] DAMAGECOUNT value on done: 444885.0 [2023-02-24 21:12:31,008][213372] Sum rewards: 37.282, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.775', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'WEAPON5': '0.150', 'weapon5': '0.158', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon4': '0.286', 'weapon2': '0.558', 'WEAPON3': '0.950', 'HITCOUNT': '2.440', 'weapon3': '2.738', 'DAMAGECOUNT': '10.077', 'FRAGCOUNT': '31.500'} [2023-02-24 21:12:31,179][213372] DAMAGECOUNT value on done: 456016.0 [2023-02-24 21:12:31,180][213372] Sum rewards: 40.965, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.152', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.063', 'AMMO3': '0.196', 'AMMO4': '0.317', 'weapon5': '0.326', 'weapon2': '0.472', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'weapon4': '0.764', 'WEAPON3': '1.100', 'weapon3': '1.950', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '13.341', 'FRAGCOUNT': '38.000'} [2023-02-24 21:12:31,313][213372] DAMAGECOUNT value on done: 444452.0 [2023-02-24 21:12:31,314][213372] Sum rewards: 50.780, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.045', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.081', 'AMMO3': '0.104', 'weapon5': '0.156', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.390', 'WEAPON3': '0.700', 'weapon2': '0.744', 'weapon3': '2.536', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '12.096', 'FRAGCOUNT': '40.000'} [2023-02-24 21:12:31,515][213366] DAMAGECOUNT value on done: 443705.0 [2023-02-24 21:12:31,515][213366] Sum rewards: 59.788, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.820', 'AMMO5': '0.023', 'AMMO2': '0.024', 'AMMO4': '0.122', 'AMMO3': '0.145', 'WEAPON4': '0.200', 'weapon2': '0.234', 'weapon4': '0.268', 'weapon5': '0.386', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'HITCOUNT': '2.730', 'weapon3': '2.768', 'DAMAGECOUNT': '14.808', 'FRAGCOUNT': '48.000'} [2023-02-24 21:12:31,569][213368] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 21:12:31,820][213366] DAMAGECOUNT value on done: 453531.0 [2023-02-24 21:12:31,821][213366] Sum rewards: 24.594, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.714', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.154', 'weapon5': '0.390', 'WEAPON4': '0.450', 'weapon4': '0.470', 'WEAPON5': '0.500', 'weapon2': '0.650', 'WEAPON3': '0.950', 'weapon3': '2.158', 'HITCOUNT': '2.210', 'DAMAGECOUNT': '9.681', 'FRAGCOUNT': '22.000'} [2023-02-24 21:12:31,830][213366] DAMAGECOUNT value on done: 464381.0 [2023-02-24 21:12:31,830][213366] Sum rewards: 38.695, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.848', 'AMMO5': '0.009', 'AMMO2': '0.048', 'AMMO3': '0.115', 'weapon5': '0.126', 'WEAPON5': '0.200', 'AMMO4': '0.240', 'WEAPON4': '0.650', 'WEAPON3': '0.700', 'weapon2': '0.702', 'weapon4': '0.970', 'weapon3': '1.932', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '11.880', 'FRAGCOUNT': '33.000'} [2023-02-24 21:12:32,145][213366] DAMAGECOUNT value on done: 448510.0 [2023-02-24 21:12:32,146][213366] Sum rewards: 42.906, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.078', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.045', 'AMMO3': '0.208', 'AMMO4': '0.224', 'weapon5': '0.254', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON4': '0.450', 'weapon4': '0.858', 'WEAPON3': '1.200', 'weapon3': '2.288', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.984', 'FRAGCOUNT': '40.000'} [2023-02-24 21:12:32,499][213368] DAMAGECOUNT value on done: 444644.0 [2023-02-24 21:12:32,500][213368] Sum rewards: 47.100, reward structure: {'DEATHCOUNT': '-11.250', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.122', 'HEALTH': '0.134', 'AMMO4': '0.141', 'AMMO3': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.230', 'weapon2': '0.574', 'WEAPON3': '0.850', 'HITCOUNT': '2.670', 'weapon3': '2.876', 'DAMAGECOUNT': '12.165', 'FRAGCOUNT': '38.000'} [2023-02-24 21:12:32,535][213369] DAMAGECOUNT value on done: 454073.0 [2023-02-24 21:12:32,535][213369] Sum rewards: 47.122, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.660', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.064', 'AMMO4': '0.091', 'weapon4': '0.112', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.212', 'AMMO3': '0.273', 'WEAPON3': '1.650', 'HITCOUNT': '3.000', 'weapon3': '3.322', 'DAMAGECOUNT': '12.882', 'FRAGCOUNT': '45.000'} [2023-02-24 21:12:32,545][213383] DAMAGECOUNT value on done: 445758.0 [2023-02-24 21:12:32,546][213383] Sum rewards: 34.545, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.740', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.013', 'AMMO4': '0.060', 'WEAPON4': '0.150', 'weapon4': '0.156', 'AMMO3': '0.179', 'weapon5': '0.266', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.150', 'HITCOUNT': '2.030', 'weapon3': '2.910', 'DAMAGECOUNT': '9.876', 'FRAGCOUNT': '30.000'} [2023-02-24 21:12:32,579][213382] DAMAGECOUNT value on done: 454406.0 [2023-02-24 21:12:32,579][213382] Sum rewards: 50.315, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.542', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.049', 'AMMO3': '0.137', 'AMMO4': '0.245', 'weapon5': '0.246', 'weapon2': '0.448', 'WEAPON5': '0.450', 'weapon4': '0.508', 'WEAPON4': '0.600', 'WEAPON3': '0.800', 'HITCOUNT': '2.470', 'weapon3': '2.494', 'DAMAGECOUNT': '12.888', 'FRAGCOUNT': '44.000'} [2023-02-24 21:12:32,810][213368] DAMAGECOUNT value on done: 453416.0 [2023-02-24 21:12:32,811][213368] Sum rewards: 45.850, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.120', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon5': '0.100', 'AMMO3': '0.154', 'AMMO4': '0.227', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.482', 'weapon2': '0.688', 'WEAPON3': '0.900', 'weapon3': '2.458', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '11.679', 'FRAGCOUNT': '38.000'} [2023-02-24 21:12:32,848][213369] DAMAGECOUNT value on done: 452077.0 [2023-02-24 21:12:32,849][213369] Sum rewards: 43.975, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.839', 'AMMO5': '0.015', 'AMMO2': '0.047', 'AMMO3': '0.141', 'weapon2': '0.232', 'AMMO4': '0.236', 'weapon5': '0.294', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.900', 'weapon4': '0.992', 'weapon3': '2.024', 'HITCOUNT': '2.450', 'DAMAGECOUNT': '12.582', 'FRAGCOUNT': '37.000'} [2023-02-24 21:12:32,863][213383] DAMAGECOUNT value on done: 452126.0 [2023-02-24 21:12:32,863][213383] Sum rewards: 47.283, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.249', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.056', 'AMMO3': '0.125', 'AMMO4': '0.281', 'weapon5': '0.398', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.520', 'weapon2': '0.678', 'WEAPON3': '0.750', 'weapon3': '2.126', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '13.023', 'FRAGCOUNT': '39.000'} [2023-02-24 21:12:32,901][213382] DAMAGECOUNT value on done: 452691.0 [2023-02-24 21:12:32,901][213382] Sum rewards: 48.139, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.280', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon5': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.075', 'weapon4': '0.116', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.266', 'WEAPON3': '1.200', 'HITCOUNT': '2.700', 'weapon3': '3.358', 'DAMAGECOUNT': '11.928', 'FRAGCOUNT': '41.000'} [2023-02-24 21:12:32,970][213365] Updated weights for policy 0, policy_version 33866 (0.0009) [2023-02-24 21:12:33,084][213368] DAMAGECOUNT value on done: 444302.0 [2023-02-24 21:12:33,084][213368] Sum rewards: 33.420, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.010', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon5': '0.062', 'weapon4': '0.112', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'AMMO3': '0.265', 'WEAPON5': '0.300', 'weapon2': '0.432', 'WEAPON3': '1.600', 'HITCOUNT': '2.620', 'weapon3': '3.134', 'DAMAGECOUNT': '11.790', 'FRAGCOUNT': '33.000'} [2023-02-24 21:12:33,168][213369] DAMAGECOUNT value on done: 451232.0 [2023-02-24 21:12:33,168][213369] Sum rewards: 45.741, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.873', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.036', 'AMMO3': '0.173', 'AMMO4': '0.179', 'weapon4': '0.182', 'weapon5': '0.184', 'WEAPON4': '0.350', 'weapon2': '0.552', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'HITCOUNT': '2.390', 'weapon3': '2.772', 'DAMAGECOUNT': '11.967', 'FRAGCOUNT': '39.000'} [2023-02-24 21:12:33,215][213382] DAMAGECOUNT value on done: 439304.0 [2023-02-24 21:12:33,215][213382] Sum rewards: 32.615, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.734', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.060', 'AMMO4': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'WEAPON4': '0.400', 'weapon2': '0.448', 'weapon4': '0.808', 'WEAPON3': '1.250', 'HITCOUNT': '2.450', 'weapon3': '2.466', 'DAMAGECOUNT': '10.359', 'FRAGCOUNT': '33.000'} [2023-02-24 21:12:33,356][213384] DAMAGECOUNT value on done: 454840.0 [2023-02-24 21:12:33,357][213384] Sum rewards: 48.031, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.086', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.024', 'weapon5': '0.082', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'weapon2': '0.544', 'WEAPON3': '1.100', 'HITCOUNT': '2.610', 'weapon3': '3.236', 'DAMAGECOUNT': '11.646', 'FRAGCOUNT': '40.000'} [2023-02-24 21:12:33,400][213368] DAMAGECOUNT value on done: 445010.0 [2023-02-24 21:12:33,401][213368] Sum rewards: 42.292, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.820', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon2': '0.188', 'AMMO3': '0.198', 'weapon5': '0.208', 'WEAPON4': '0.250', 'weapon4': '0.262', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.550', 'weapon3': '3.082', 'DAMAGECOUNT': '12.201', 'FRAGCOUNT': '37.000'} [2023-02-24 21:12:33,484][213369] DAMAGECOUNT value on done: 439724.0 [2023-02-24 21:12:33,485][213369] Sum rewards: 35.362, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.624', 'ARMOR': '0.008', 'AMMO5': '0.028', 'AMMO2': '0.053', 'AMMO3': '0.175', 'AMMO4': '0.266', 'weapon5': '0.334', 'weapon2': '0.428', 'weapon4': '0.456', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'HITCOUNT': '2.050', 'weapon3': '2.394', 'DAMAGECOUNT': '10.443', 'FRAGCOUNT': '33.000'} [2023-02-24 21:12:33,511][213383] DAMAGECOUNT value on done: 454873.0 [2023-02-24 21:12:33,512][213383] Sum rewards: 42.052, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.080', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon5': '0.238', 'AMMO3': '0.285', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.302', 'weapon4': '0.336', 'WEAPON3': '1.750', 'weapon3': '2.746', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '14.187', 'FRAGCOUNT': '40.000'} [2023-02-24 21:12:33,525][213382] DAMAGECOUNT value on done: 447967.0 [2023-02-24 21:12:33,526][213382] Sum rewards: 38.608, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.186', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon4': '0.086', 'weapon5': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'WEAPON5': '0.300', 'weapon2': '0.492', 'WEAPON3': '1.050', 'HITCOUNT': '2.630', 'weapon3': '3.120', 'DAMAGECOUNT': '11.052', 'FRAGCOUNT': '33.000'} [2023-02-24 21:12:33,673][213384] DAMAGECOUNT value on done: 436647.0 [2023-02-24 21:12:33,674][213384] Sum rewards: 34.910, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.663', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.050', 'AMMO3': '0.165', 'AMMO4': '0.250', 'weapon2': '0.300', 'weapon5': '0.394', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.770', 'WEAPON3': '1.000', 'weapon3': '2.094', 'HITCOUNT': '2.160', 'DAMAGECOUNT': '10.620', 'FRAGCOUNT': '33.000'} [2023-02-24 21:12:33,848][213383] DAMAGECOUNT value on done: 444083.0 [2023-02-24 21:12:33,848][213383] Sum rewards: 43.764, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.100', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.192', 'AMMO4': '0.194', 'WEAPON4': '0.200', 'weapon2': '0.404', 'weapon4': '0.566', 'WEAPON3': '1.050', 'weapon3': '2.554', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '12.360', 'FRAGCOUNT': '37.000'} [2023-02-24 21:12:34,008][213384] DAMAGECOUNT value on done: 450652.0 [2023-02-24 21:12:34,009][213384] Sum rewards: 35.031, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.150', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon7': '0.048', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.128', 'AMMO4': '0.155', 'AMMO3': '0.158', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.306', 'WEAPON4': '0.450', 'weapon4': '0.690', 'WEAPON3': '0.950', 'HITCOUNT': '2.180', 'weapon3': '2.596', 'DAMAGECOUNT': '9.537', 'FRAGCOUNT': '32.000'} [2023-02-24 21:12:34,319][213384] DAMAGECOUNT value on done: 451987.0 [2023-02-24 21:12:34,320][213384] Sum rewards: 17.027, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.164', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO3': '0.054', 'weapon7': '0.066', 'AMMO2': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.198', 'AMMO4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.350', 'weapon3': '0.598', 'WEAPON4': '0.750', 'weapon2': '0.818', 'weapon4': '0.828', 'HITCOUNT': '1.260', 'DAMAGECOUNT': '5.931', 'FRAGCOUNT': '17.000'} [2023-02-24 21:12:35,243][213332] Fps is (10 sec: 13517.0, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 138743808. Throughput: 0: 3356.4. Samples: 9675088. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 21:12:35,243][213332] Avg episode reward: [(0, '42.018')] [2023-02-24 21:12:36,011][213365] Updated weights for policy 0, policy_version 33876 (0.0009) [2023-02-24 21:12:39,081][213365] Updated weights for policy 0, policy_version 33886 (0.0009) [2023-02-24 21:12:40,243][213332] Fps is (10 sec: 13516.6, 60 sec: 13380.3, 300 sec: 13468.2). Total num frames: 138809344. Throughput: 0: 3357.5. Samples: 9695196. Policy #0 lag: (min: 0.0, avg: 0.4, max: 1.0) [2023-02-24 21:12:40,244][213332] Avg episode reward: [(0, '42.018')] [2023-02-24 21:12:42,068][213365] Updated weights for policy 0, policy_version 33896 (0.0009) [2023-02-24 21:12:45,170][213365] Updated weights for policy 0, policy_version 33906 (0.0009) [2023-02-24 21:12:45,243][213332] Fps is (10 sec: 13516.6, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 138878976. Throughput: 0: 3357.7. Samples: 9715300. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:12:45,243][213332] Avg episode reward: [(0, '42.018')] [2023-02-24 21:12:45,247][213352] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000033906_138878976.pth... [2023-02-24 21:12:45,303][213352] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000033117_135647232.pth [2023-02-24 21:12:48,207][213365] Updated weights for policy 0, policy_version 33916 (0.0009) [2023-02-24 21:12:49,667][213367] DAMAGECOUNT value on done: 449755.0 [2023-02-24 21:12:49,667][213367] Sum rewards: 43.687, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.010', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon5': '0.148', 'AMMO3': '0.159', 'AMMO4': '0.163', 'weapon4': '0.396', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.518', 'WEAPON3': '0.950', 'HITCOUNT': '2.400', 'weapon3': '2.660', 'DAMAGECOUNT': '11.205', 'FRAGCOUNT': '38.000'} [2023-02-24 21:12:49,843][213367] DAMAGECOUNT value on done: 456953.0 [2023-02-24 21:12:49,844][213367] Sum rewards: 37.654, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.976', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.114', 'AMMO3': '0.191', 'AMMO4': '0.196', 'WEAPON4': '0.250', 'weapon4': '0.346', 'WEAPON5': '0.400', 'weapon2': '0.756', 'WEAPON3': '1.050', 'HITCOUNT': '2.270', 'weapon3': '2.556', 'DAMAGECOUNT': '11.196', 'FRAGCOUNT': '32.000'} [2023-02-24 21:12:49,983][213367] DAMAGECOUNT value on done: 452877.0 [2023-02-24 21:12:49,983][213367] Sum rewards: 50.728, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.130', 'AMMO5': '0.004', 'AMMO2': '0.017', 'weapon5': '0.040', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'weapon4': '0.312', 'weapon2': '0.412', 'WEAPON3': '1.150', 'HITCOUNT': '2.780', 'weapon3': '3.046', 'DAMAGECOUNT': '12.921', 'FRAGCOUNT': '45.000'} [2023-02-24 21:12:50,147][213367] DAMAGECOUNT value on done: 457927.0 [2023-02-24 21:12:50,148][213367] Sum rewards: 46.374, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.894', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.100', 'weapon5': '0.130', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'WEAPON4': '0.250', 'weapon2': '0.362', 'WEAPON3': '1.000', 'HITCOUNT': '2.470', 'weapon3': '3.214', 'DAMAGECOUNT': '12.249', 'FRAGCOUNT': '39.000'} [2023-02-24 21:12:50,243][213332] Fps is (10 sec: 13517.0, 60 sec: 13448.5, 300 sec: 13468.2). Total num frames: 138944512. Throughput: 0: 3356.9. Samples: 9725500. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:12:50,243][213332] Avg episode reward: [(0, '41.995')] [2023-02-24 21:12:50,807][213372] DAMAGECOUNT value on done: 462810.0 [2023-02-24 21:12:50,807][213372] Sum rewards: 36.181, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.790', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.132', 'AMMO3': '0.134', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.480', 'weapon2': '0.728', 'WEAPON3': '0.800', 'weapon3': '2.330', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '10.800', 'FRAGCOUNT': '31.000'} [2023-02-24 21:12:50,898][213372] DAMAGECOUNT value on done: 448479.0 [2023-02-24 21:12:50,899][213372] Sum rewards: 42.299, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.074', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.214', 'weapon4': '0.478', 'weapon2': '0.614', 'WEAPON3': '0.800', 'HITCOUNT': '2.320', 'weapon3': '2.476', 'DAMAGECOUNT': '10.782', 'FRAGCOUNT': '34.500'} [2023-02-24 21:12:51,117][213372] DAMAGECOUNT value on done: 459904.0 [2023-02-24 21:12:51,118][213372] Sum rewards: 43.262, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.640', 'AMMO2': '0.006', 'AMMO5': '0.014', 'AMMO4': '0.030', 'weapon5': '0.084', 'weapon4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.192', 'weapon2': '0.326', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.440', 'weapon3': '3.300', 'DAMAGECOUNT': '11.664', 'FRAGCOUNT': '38.000'} [2023-02-24 21:12:51,212][213372] DAMAGECOUNT value on done: 449126.0 [2023-02-24 21:12:51,213][213372] Sum rewards: 53.711, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.830', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'weapon4': '0.128', 'weapon5': '0.134', 'WEAPON4': '0.150', 'weapon2': '0.170', 'AMMO3': '0.288', 'WEAPON3': '1.700', 'HITCOUNT': '2.990', 'weapon3': '3.260', 'DAMAGECOUNT': '13.767', 'FRAGCOUNT': '51.000'} [2023-02-24 21:12:51,253][213365] Updated weights for policy 0, policy_version 33926 (0.0009) [2023-02-24 21:12:51,516][213366] DAMAGECOUNT value on done: 447280.0 [2023-02-24 21:12:51,517][213366] Sum rewards: 33.398, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.892', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO4': '0.148', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'weapon5': '0.240', 'WEAPON5': '0.300', 'weapon4': '0.434', 'weapon2': '0.446', 'WEAPON3': '1.450', 'HITCOUNT': '2.300', 'weapon3': '2.510', 'DAMAGECOUNT': '10.725', 'FRAGCOUNT': '33.000'} [2023-02-24 21:12:51,813][213366] DAMAGECOUNT value on done: 457325.0 [2023-02-24 21:12:51,814][213366] Sum rewards: 43.863, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.764', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.050', 'AMMO4': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'WEAPON4': '0.300', 'weapon2': '0.384', 'weapon4': '0.576', 'WEAPON3': '1.000', 'HITCOUNT': '2.480', 'weapon3': '2.770', 'DAMAGECOUNT': '11.382', 'FRAGCOUNT': '39.000'} [2023-02-24 21:12:51,823][213366] DAMAGECOUNT value on done: 468861.0 [2023-02-24 21:12:51,823][213366] Sum rewards: 53.131, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.495', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.128', 'AMMO4': '0.163', 'AMMO3': '0.187', 'weapon2': '0.206', 'weapon4': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'HITCOUNT': '3.160', 'weapon3': '3.230', 'DAMAGECOUNT': '13.440', 'FRAGCOUNT': '45.500'} [2023-02-24 21:12:52,127][213366] DAMAGECOUNT value on done: 453857.0 [2023-02-24 21:12:52,128][213366] Sum rewards: 55.923, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.440', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.052', 'AMMO4': '0.095', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.262', 'weapon2': '0.478', 'WEAPON3': '1.600', 'weapon3': '3.102', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '49.000'} [2023-02-24 21:12:52,521][213368] DAMAGECOUNT value on done: 449287.0 [2023-02-24 21:12:52,521][213368] Sum rewards: 53.864, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.008', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon4': '0.142', 'weapon5': '0.154', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.480', 'WEAPON3': '1.100', 'weapon3': '2.942', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.929', 'FRAGCOUNT': '46.000'} [2023-02-24 21:12:52,568][213383] DAMAGECOUNT value on done: 449781.0 [2023-02-24 21:12:52,568][213383] Sum rewards: 37.311, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.356', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.048', 'AMMO3': '0.175', 'AMMO4': '0.240', 'weapon5': '0.350', 'weapon2': '0.506', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'weapon4': '0.690', 'WEAPON3': '1.050', 'weapon3': '2.060', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '12.069', 'FRAGCOUNT': '35.000'} [2023-02-24 21:12:52,578][213369] DAMAGECOUNT value on done: 458233.0 [2023-02-24 21:12:52,579][213369] Sum rewards: 43.128, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.156', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.100', 'AMMO4': '0.150', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'weapon2': '0.328', 'WEAPON4': '0.350', 'weapon4': '0.768', 'WEAPON3': '1.050', 'weapon3': '2.512', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '12.480', 'FRAGCOUNT': '36.000'} [2023-02-24 21:12:52,584][213382] DAMAGECOUNT value on done: 457633.0 [2023-02-24 21:12:52,585][213382] Sum rewards: 34.291, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.708', 'AMMO5': '0.020', 'AMMO2': '0.065', 'weapon7': '0.070', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.199', 'weapon5': '0.220', 'weapon2': '0.316', 'AMMO4': '0.326', 'WEAPON5': '0.500', 'weapon4': '0.548', 'WEAPON4': '0.700', 'WEAPON3': '1.100', 'HITCOUNT': '2.210', 'weapon3': '2.494', 'DAMAGECOUNT': '9.681', 'FRAGCOUNT': '33.000'} [2023-02-24 21:12:52,850][213368] DAMAGECOUNT value on done: 457460.0 [2023-02-24 21:12:52,851][213368] Sum rewards: 39.392, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.576', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.041', 'weapon5': '0.162', 'AMMO3': '0.173', 'AMMO4': '0.204', 'weapon2': '0.456', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.830', 'WEAPON3': '1.000', 'weapon3': '2.216', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.132', 'FRAGCOUNT': '35.000'} [2023-02-24 21:12:52,882][213383] DAMAGECOUNT value on done: 455934.0 [2023-02-24 21:12:52,882][213383] Sum rewards: 40.334, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.856', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.248', 'WEAPON4': '0.450', 'weapon2': '0.474', 'weapon4': '0.558', 'WEAPON3': '1.400', 'weapon3': '2.540', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '11.424', 'FRAGCOUNT': '38.000'} [2023-02-24 21:12:52,900][213369] DAMAGECOUNT value on done: 456609.0 [2023-02-24 21:12:52,901][213369] Sum rewards: 51.398, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.644', 'AMMO5': '0.017', 'AMMO2': '0.033', 'AMMO4': '0.167', 'AMMO3': '0.188', 'weapon5': '0.198', 'weapon4': '0.240', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.446', 'WEAPON3': '1.100', 'HITCOUNT': '2.480', 'weapon3': '2.776', 'DAMAGECOUNT': '13.596', 'FRAGCOUNT': '46.000'} [2023-02-24 21:12:52,910][213382] DAMAGECOUNT value on done: 456932.0 [2023-02-24 21:12:52,911][213382] Sum rewards: 49.024, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.150', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.144', 'weapon5': '0.146', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.302', 'WEAPON3': '0.900', 'weapon4': '0.956', 'weapon3': '2.380', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.723', 'FRAGCOUNT': '39.000'} [2023-02-24 21:12:53,120][213368] DAMAGECOUNT value on done: 448844.0 [2023-02-24 21:12:53,120][213368] Sum rewards: 55.834, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.130', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'weapon5': '0.272', 'weapon4': '0.274', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.000', 'HITCOUNT': '2.840', 'weapon3': '2.870', 'DAMAGECOUNT': '13.626', 'FRAGCOUNT': '47.000'} [2023-02-24 21:12:53,209][213369] DAMAGECOUNT value on done: 455175.0 [2023-02-24 21:12:53,210][213369] Sum rewards: 40.879, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.970', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.086', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'weapon2': '0.378', 'weapon4': '0.530', 'WEAPON3': '1.050', 'HITCOUNT': '2.610', 'weapon3': '2.788', 'DAMAGECOUNT': '11.829', 'FRAGCOUNT': '34.000'} [2023-02-24 21:12:53,210][213382] DAMAGECOUNT value on done: 443329.0 [2023-02-24 21:12:53,210][213382] Sum rewards: 44.749, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.210', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon7': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO3': '0.237', 'weapon2': '0.284', 'WEAPON4': '0.300', 'weapon4': '0.522', 'WEAPON3': '1.250', 'weapon3': '2.826', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '12.075', 'FRAGCOUNT': '42.000'} [2023-02-24 21:12:53,362][213384] DAMAGECOUNT value on done: 458847.0 [2023-02-24 21:12:53,363][213384] Sum rewards: 35.217, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.124', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon5': '0.092', 'AMMO4': '0.222', 'AMMO3': '0.246', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.620', 'weapon4': '0.770', 'WEAPON3': '1.350', 'weapon3': '2.198', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.021', 'FRAGCOUNT': '34.000'} [2023-02-24 21:12:53,442][213368] DAMAGECOUNT value on done: 448445.0 [2023-02-24 21:12:53,442][213368] Sum rewards: 38.680, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.132', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO4': '0.142', 'weapon5': '0.164', 'AMMO3': '0.197', 'weapon2': '0.262', 'weapon4': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.260', 'weapon3': '2.972', 'DAMAGECOUNT': '10.305', 'FRAGCOUNT': '36.000'} [2023-02-24 21:12:53,519][213369] DAMAGECOUNT value on done: 443984.0 [2023-02-24 21:12:53,519][213369] Sum rewards: 44.593, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.060', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon5': '0.096', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.178', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'weapon2': '0.794', 'WEAPON3': '1.150', 'weapon3': '2.752', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '12.780', 'FRAGCOUNT': '37.000'} [2023-02-24 21:12:53,529][213383] DAMAGECOUNT value on done: 458984.0 [2023-02-24 21:12:53,530][213383] Sum rewards: 46.894, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.279', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.060', 'AMMO4': '0.151', 'weapon4': '0.160', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.100', 'HITCOUNT': '2.810', 'weapon3': '3.226', 'DAMAGECOUNT': '12.333', 'FRAGCOUNT': '40.000'} [2023-02-24 21:12:53,532][213382] DAMAGECOUNT value on done: 451624.0 [2023-02-24 21:12:53,532][213382] Sum rewards: 37.134, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.856', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon7': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.142', 'weapon5': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'WEAPON4': '0.400', 'weapon2': '0.424', 'weapon4': '0.634', 'WEAPON3': '1.000', 'HITCOUNT': '2.200', 'weapon3': '2.332', 'DAMAGECOUNT': '10.971', 'FRAGCOUNT': '32.000'} [2023-02-24 21:12:53,674][213384] DAMAGECOUNT value on done: 440036.0 [2023-02-24 21:12:53,675][213384] Sum rewards: 30.451, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.378', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon7': '0.114', 'AMMO3': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO4': '0.233', 'weapon5': '0.350', 'weapon2': '0.434', 'WEAPON5': '0.450', 'WEAPON3': '0.700', 'WEAPON4': '0.800', 'weapon4': '1.344', 'weapon3': '1.496', 'HITCOUNT': '2.120', 'DAMAGECOUNT': '10.167', 'FRAGCOUNT': '29.000'} [2023-02-24 21:12:53,840][213383] DAMAGECOUNT value on done: 448477.0 [2023-02-24 21:12:53,840][213383] Sum rewards: 46.617, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.127', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.047', 'AMMO3': '0.186', 'weapon5': '0.218', 'AMMO4': '0.237', 'weapon2': '0.310', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.906', 'WEAPON3': '1.250', 'weapon3': '2.278', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.182', 'FRAGCOUNT': '40.000'} [2023-02-24 21:12:54,001][213384] DAMAGECOUNT value on done: 454156.0 [2023-02-24 21:12:54,002][213384] Sum rewards: 39.943, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.870', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.019', 'weapon5': '0.022', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'WEAPON7': '0.200', 'weapon2': '0.368', 'weapon4': '0.616', 'WEAPON3': '1.050', 'weapon3': '2.284', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '10.512', 'FRAGCOUNT': '34.000'} [2023-02-24 21:12:54,318][213384] DAMAGECOUNT value on done: 457033.0 [2023-02-24 21:12:54,318][213384] Sum rewards: 53.773, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.608', 'AMMO5': '0.007', 'weapon5': '0.032', 'AMMO2': '0.035', 'WEAPON5': '0.150', 'AMMO4': '0.177', 'AMMO3': '0.181', 'weapon4': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.526', 'WEAPON3': '1.050', 'weapon3': '3.024', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.138', 'FRAGCOUNT': '44.000'} [2023-02-24 21:12:54,324][213365] Updated weights for policy 0, policy_version 33936 (0.0009) [2023-02-24 21:12:55,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13482.1). Total num frames: 139014144. Throughput: 0: 3357.0. Samples: 9745584. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:12:55,243][213332] Avg episode reward: [(0, '42.076')] [2023-02-24 21:12:57,320][213365] Updated weights for policy 0, policy_version 33946 (0.0009) [2023-02-24 21:13:00,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13468.2). Total num frames: 139079680. Throughput: 0: 3358.6. Samples: 9765662. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:13:00,243][213332] Avg episode reward: [(0, '42.076')] [2023-02-24 21:13:00,405][213365] Updated weights for policy 0, policy_version 33956 (0.0009) [2023-02-24 21:13:03,443][213365] Updated weights for policy 0, policy_version 33966 (0.0009) [2023-02-24 21:13:05,243][213332] Fps is (10 sec: 13107.1, 60 sec: 13380.2, 300 sec: 13468.2). Total num frames: 139145216. Throughput: 0: 3359.7. Samples: 9775918. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 21:13:05,243][213332] Avg episode reward: [(0, '42.076')] [2023-02-24 21:13:06,451][213365] Updated weights for policy 0, policy_version 33976 (0.0009) [2023-02-24 21:13:09,583][213365] Updated weights for policy 0, policy_version 33986 (0.0009) [2023-02-24 21:13:09,763][213367] DAMAGECOUNT value on done: 453772.0 [2023-02-24 21:13:09,764][213367] Sum rewards: 41.978, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.924', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.074', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.288', 'WEAPON4': '0.300', 'weapon4': '0.542', 'WEAPON3': '1.400', 'HITCOUNT': '2.590', 'weapon3': '2.854', 'DAMAGECOUNT': '12.051', 'FRAGCOUNT': '39.000'} [2023-02-24 21:13:09,936][213367] DAMAGECOUNT value on done: 461071.0 [2023-02-24 21:13:09,936][213367] Sum rewards: 47.428, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.660', 'AMMO5': '0.015', 'AMMO2': '0.018', 'weapon5': '0.028', 'weapon4': '0.082', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'AMMO3': '0.205', 'WEAPON5': '0.300', 'weapon2': '0.466', 'WEAPON3': '1.250', 'HITCOUNT': '2.690', 'weapon3': '3.192', 'DAMAGECOUNT': '12.354', 'FRAGCOUNT': '41.000'} [2023-02-24 21:13:10,078][213367] DAMAGECOUNT value on done: 457015.0 [2023-02-24 21:13:10,079][213367] Sum rewards: 45.502, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.050', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.050', 'AMMO3': '0.166', 'weapon5': '0.210', 'AMMO4': '0.252', 'weapon2': '0.274', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.900', 'WEAPON3': '0.950', 'weapon3': '2.332', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '12.414', 'FRAGCOUNT': '39.000'} [2023-02-24 21:13:10,191][213366] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 21:13:10,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13468.2). Total num frames: 139214848. Throughput: 0: 3359.4. Samples: 9795990. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 21:13:10,243][213332] Avg episode reward: [(0, '42.252')] [2023-02-24 21:13:10,247][213367] DAMAGECOUNT value on done: 461873.0 [2023-02-24 21:13:10,248][213367] Sum rewards: 42.421, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.220', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.120', 'AMMO4': '0.144', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.324', 'weapon4': '0.440', 'WEAPON3': '1.300', 'HITCOUNT': '2.710', 'weapon3': '2.744', 'DAMAGECOUNT': '11.838', 'FRAGCOUNT': '39.000'} [2023-02-24 21:13:10,858][213372] DAMAGECOUNT value on done: 467202.0 [2023-02-24 21:13:10,858][213372] Sum rewards: 53.181, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.130', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.154', 'AMMO3': '0.189', 'AMMO4': '0.235', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.510', 'weapon4': '0.646', 'WEAPON3': '1.100', 'weapon3': '2.452', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.176', 'FRAGCOUNT': '46.000'} [2023-02-24 21:13:10,929][213372] DAMAGECOUNT value on done: 452003.0 [2023-02-24 21:13:10,929][213372] Sum rewards: 41.698, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.306', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.035', 'weapon5': '0.128', 'AMMO3': '0.175', 'AMMO4': '0.176', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON4': '0.300', 'weapon4': '0.628', 'WEAPON3': '1.050', 'HITCOUNT': '2.490', 'weapon3': '2.666', 'DAMAGECOUNT': '10.572', 'FRAGCOUNT': '37.000'} [2023-02-24 21:13:11,180][213372] DAMAGECOUNT value on done: 463983.0 [2023-02-24 21:13:11,181][213372] Sum rewards: 34.496, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.824', 'AMMO5': '0.016', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon5': '0.166', 'weapon4': '0.220', 'AMMO3': '0.237', 'weapon2': '0.336', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '2.650', 'weapon3': '2.960', 'DAMAGECOUNT': '12.237', 'FRAGCOUNT': '33.500'} [2023-02-24 21:13:11,255][213372] DAMAGECOUNT value on done: 452922.0 [2023-02-24 21:13:11,255][213372] Sum rewards: 43.660, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.000', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.116', 'AMMO3': '0.151', 'AMMO4': '0.198', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.466', 'weapon2': '0.596', 'WEAPON3': '0.850', 'weapon3': '2.376', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '11.388', 'FRAGCOUNT': '38.000'} [2023-02-24 21:13:11,569][213366] DAMAGECOUNT value on done: 450844.0 [2023-02-24 21:13:11,570][213366] Sum rewards: 44.916, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.170', 'AMMO5': '0.018', 'AMMO2': '0.040', 'weapon5': '0.072', 'AMMO3': '0.193', 'AMMO4': '0.198', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.638', 'WEAPON3': '1.200', 'HITCOUNT': '2.500', 'weapon3': '2.688', 'DAMAGECOUNT': '10.692', 'FRAGCOUNT': '42.000'} [2023-02-24 21:13:11,863][213366] DAMAGECOUNT value on done: 461552.0 [2023-02-24 21:13:11,863][213366] Sum rewards: 44.988, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.765', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.096', 'AMMO4': '0.103', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.490', 'weapon4': '0.702', 'WEAPON3': '0.950', 'weapon3': '2.520', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.681', 'FRAGCOUNT': '38.000'} [2023-02-24 21:13:11,873][213366] DAMAGECOUNT value on done: 472469.0 [2023-02-24 21:13:11,873][213366] Sum rewards: 32.515, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.492', 'AMMO5': '0.020', 'AMMO2': '0.030', 'AMMO4': '0.150', 'AMMO3': '0.195', 'weapon5': '0.202', 'weapon2': '0.422', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.522', 'WEAPON3': '1.200', 'HITCOUNT': '2.480', 'weapon3': '2.562', 'DAMAGECOUNT': '10.824', 'FRAGCOUNT': '32.000'} [2023-02-24 21:13:12,181][213366] DAMAGECOUNT value on done: 458428.0 [2023-02-24 21:13:12,182][213366] Sum rewards: 41.778, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.406', 'AMMO5': '0.005', 'AMMO2': '0.038', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO4': '0.190', 'AMMO3': '0.243', 'weapon2': '0.254', 'WEAPON4': '0.400', 'ARMOR': '0.404', 'weapon4': '0.562', 'WEAPON3': '1.450', 'weapon3': '2.818', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.713', 'FRAGCOUNT': '39.000'} [2023-02-24 21:13:12,508][213383] DAMAGECOUNT value on done: 453747.0 [2023-02-24 21:13:12,509][213383] Sum rewards: 46.752, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.449', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.110', 'WEAPON4': '0.150', 'weapon4': '0.156', 'weapon2': '0.206', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '2.460', 'weapon3': '3.278', 'DAMAGECOUNT': '11.898', 'FRAGCOUNT': '43.000'} [2023-02-24 21:13:12,535][213368] DAMAGECOUNT value on done: 452791.0 [2023-02-24 21:13:12,536][213368] Sum rewards: 42.806, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.405', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon7': '0.068', 'AMMO3': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.166', 'AMMO4': '0.194', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.418', 'weapon4': '0.662', 'WEAPON3': '0.700', 'weapon3': '2.360', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '10.512', 'FRAGCOUNT': '35.000'} [2023-02-24 21:13:12,577][213369] DAMAGECOUNT value on done: 463155.0 [2023-02-24 21:13:12,577][213369] Sum rewards: 64.648, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.215', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO3': '0.141', 'AMMO4': '0.156', 'WEAPON4': '0.200', 'weapon5': '0.236', 'weapon4': '0.282', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'weapon2': '0.862', 'weapon3': '2.298', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.766', 'FRAGCOUNT': '52.000'} [2023-02-24 21:13:12,596][213382] DAMAGECOUNT value on done: 461834.0 [2023-02-24 21:13:12,596][213382] Sum rewards: 41.834, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.205', 'AMMO5': '0.018', 'AMMO2': '0.030', 'weapon5': '0.124', 'AMMO4': '0.149', 'AMMO3': '0.259', 'weapon2': '0.332', 'weapon4': '0.382', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '2.710', 'weapon3': '2.782', 'DAMAGECOUNT': '12.603', 'FRAGCOUNT': '42.000'} [2023-02-24 21:13:12,615][213365] Updated weights for policy 0, policy_version 33996 (0.0009) [2023-02-24 21:13:12,827][213383] DAMAGECOUNT value on done: 459768.0 [2023-02-24 21:13:12,827][213383] Sum rewards: 49.095, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.056', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'weapon4': '0.190', 'weapon2': '0.682', 'WEAPON3': '0.800', 'HEALTH': '0.824', 'HITCOUNT': '2.650', 'weapon3': '2.900', 'DAMAGECOUNT': '11.502', 'FRAGCOUNT': '41.000'} [2023-02-24 21:13:12,848][213368] DAMAGECOUNT value on done: 461634.0 [2023-02-24 21:13:12,849][213368] Sum rewards: 41.484, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.710', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.066', 'AMMO4': '0.110', 'weapon4': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.476', 'WEAPON3': '1.350', 'HITCOUNT': '2.770', 'weapon3': '3.114', 'DAMAGECOUNT': '12.522', 'FRAGCOUNT': '36.500'} [2023-02-24 21:13:12,899][213369] DAMAGECOUNT value on done: 461427.0 [2023-02-24 21:13:12,900][213369] Sum rewards: 59.113, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.401', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.158', 'weapon5': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.416', 'weapon4': '0.508', 'WEAPON3': '1.000', 'weapon3': '2.642', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.454', 'FRAGCOUNT': '49.000'} [2023-02-24 21:13:12,913][213382] DAMAGECOUNT value on done: 460867.0 [2023-02-24 21:13:12,914][213382] Sum rewards: 51.110, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.050', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO3': '0.112', 'AMMO4': '0.131', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.202', 'weapon2': '0.360', 'weapon4': '0.622', 'WEAPON3': '0.750', 'weapon3': '2.544', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '11.805', 'FRAGCOUNT': '40.000'} [2023-02-24 21:13:13,117][213368] DAMAGECOUNT value on done: 452722.0 [2023-02-24 21:13:13,118][213368] Sum rewards: 41.557, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.262', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon5': '0.120', 'AMMO4': '0.171', 'AMMO3': '0.186', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.504', 'weapon2': '0.636', 'WEAPON3': '1.200', 'weapon3': '2.474', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '11.634', 'FRAGCOUNT': '40.000'} [2023-02-24 21:13:13,208][213369] DAMAGECOUNT value on done: 459143.0 [2023-02-24 21:13:13,209][213369] Sum rewards: 41.283, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.768', 'AMMO5': '0.022', 'AMMO2': '0.059', 'AMMO3': '0.136', 'weapon5': '0.290', 'AMMO4': '0.296', 'weapon4': '0.522', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'weapon2': '0.738', 'WEAPON3': '0.800', 'weapon3': '2.092', 'HITCOUNT': '2.270', 'DAMAGECOUNT': '11.826', 'FRAGCOUNT': '37.000'} [2023-02-24 21:13:13,227][213382] DAMAGECOUNT value on done: 446822.0 [2023-02-24 21:13:13,228][213382] Sum rewards: 39.500, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.376', 'AMMO5': '0.004', 'ARMOR': '0.004', 'AMMO2': '0.029', 'weapon5': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'weapon4': '0.366', 'weapon2': '0.514', 'WEAPON3': '1.000', 'HITCOUNT': '2.170', 'weapon3': '2.916', 'DAMAGECOUNT': '10.479', 'FRAGCOUNT': '34.000'} [2023-02-24 21:13:13,401][213384] DAMAGECOUNT value on done: 462299.0 [2023-02-24 21:13:13,401][213384] Sum rewards: 33.896, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.455', 'AMMO5': '0.019', 'AMMO2': '0.047', 'AMMO3': '0.146', 'weapon5': '0.152', 'AMMO4': '0.234', 'ARMOR': '0.460', 'WEAPON5': '0.500', 'weapon2': '0.592', 'WEAPON4': '0.600', 'weapon4': '0.634', 'WEAPON3': '0.950', 'HITCOUNT': '2.100', 'weapon3': '2.310', 'DAMAGECOUNT': '10.356', 'FRAGCOUNT': '31.000'} [2023-02-24 21:13:13,431][213368] DAMAGECOUNT value on done: 452640.0 [2023-02-24 21:13:13,431][213368] Sum rewards: 41.936, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.716', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.192', 'AMMO3': '0.195', 'weapon2': '0.446', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.644', 'WEAPON3': '1.200', 'weapon3': '2.394', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '12.585', 'FRAGCOUNT': '37.500'} [2023-02-24 21:13:13,473][213383] DAMAGECOUNT value on done: 463299.0 [2023-02-24 21:13:13,474][213383] Sum rewards: 45.059, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.747', 'AMMO5': '0.014', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon2': '0.146', 'AMMO3': '0.191', 'weapon5': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.580', 'WEAPON3': '1.300', 'HITCOUNT': '2.570', 'weapon3': '2.784', 'DAMAGECOUNT': '12.945', 'FRAGCOUNT': '39.000'} [2023-02-24 21:13:13,522][213369] DAMAGECOUNT value on done: 447606.0 [2023-02-24 21:13:13,523][213369] Sum rewards: 37.923, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.890', 'AMMO5': '0.022', 'AMMO2': '0.060', 'weapon5': '0.200', 'AMMO3': '0.221', 'AMMO4': '0.301', 'weapon2': '0.328', 'WEAPON4': '0.450', 'weapon4': '0.530', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'HITCOUNT': '2.200', 'weapon3': '2.434', 'DAMAGECOUNT': '10.866', 'FRAGCOUNT': '38.000'} [2023-02-24 21:13:13,548][213382] DAMAGECOUNT value on done: 455320.0 [2023-02-24 21:13:13,548][213382] Sum rewards: 40.201, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.626', 'WEAPON1': '0.010', 'AMMO5': '0.029', 'AMMO2': '0.045', 'AMMO3': '0.151', 'AMMO4': '0.224', 'weapon5': '0.270', 'weapon2': '0.614', 'WEAPON4': '0.700', 'WEAPON5': '0.750', 'weapon4': '0.810', 'WEAPON3': '0.900', 'weapon3': '1.886', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '11.088', 'FRAGCOUNT': '37.000'} [2023-02-24 21:13:13,719][213384] DAMAGECOUNT value on done: 445507.0 [2023-02-24 21:13:13,719][213384] Sum rewards: 63.649, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.910', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.088', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon4': '0.234', 'weapon2': '0.328', 'WEAPON3': '1.200', 'weapon3': '3.140', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '16.413', 'FRAGCOUNT': '53.000'} [2023-02-24 21:13:13,793][213383] DAMAGECOUNT value on done: 453791.0 [2023-02-24 21:13:13,794][213383] Sum rewards: 56.353, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.930', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO4': '0.162', 'AMMO3': '0.162', 'weapon5': '0.228', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.474', 'weapon4': '0.582', 'WEAPON3': '1.050', 'weapon3': '2.488', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '15.942', 'FRAGCOUNT': '46.500'} [2023-02-24 21:13:14,051][213384] DAMAGECOUNT value on done: 458704.0 [2023-02-24 21:13:14,051][213384] Sum rewards: 51.035, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.901', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON5': '0.100', 'weapon5': '0.104', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon2': '0.286', 'weapon4': '0.404', 'WEAPON3': '1.300', 'weapon3': '2.904', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.644', 'FRAGCOUNT': '45.000'} [2023-02-24 21:13:14,363][213384] DAMAGECOUNT value on done: 461224.0 [2023-02-24 21:13:14,364][213384] Sum rewards: 49.697, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.509', 'AMMO5': '0.007', 'AMMO2': '0.035', 'WEAPON5': '0.150', 'weapon5': '0.168', 'AMMO4': '0.176', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'weapon2': '0.426', 'weapon4': '0.606', 'WEAPON3': '1.050', 'weapon3': '2.458', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.573', 'FRAGCOUNT': '43.000'} [2023-02-24 21:13:15,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13468.2). Total num frames: 139280384. Throughput: 0: 3356.9. Samples: 9815944. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 21:13:15,243][213332] Avg episode reward: [(0, '43.544')] [2023-02-24 21:13:15,685][213365] Updated weights for policy 0, policy_version 34006 (0.0010) [2023-02-24 21:13:18,750][213365] Updated weights for policy 0, policy_version 34016 (0.0009) [2023-02-24 21:13:20,243][213332] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13468.2). Total num frames: 139345920. Throughput: 0: 3356.9. Samples: 9826148. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 21:13:20,243][213332] Avg episode reward: [(0, '43.544')] [2023-02-24 21:13:20,306][213368] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 21:13:21,758][213365] Updated weights for policy 0, policy_version 34026 (0.0009) [2023-02-24 21:13:24,918][213365] Updated weights for policy 0, policy_version 34036 (0.0009) [2023-02-24 21:13:25,243][213332] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13454.3). Total num frames: 139411456. Throughput: 0: 3356.3. Samples: 9846228. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 21:13:25,244][213332] Avg episode reward: [(0, '43.544')] [2023-02-24 21:13:28,095][213365] Updated weights for policy 0, policy_version 34046 (0.0009) [2023-02-24 21:13:30,037][213367] DAMAGECOUNT value on done: 457445.0 [2023-02-24 21:13:30,038][213367] Sum rewards: 42.354, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.974', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.147', 'AMMO3': '0.153', 'weapon5': '0.166', 'WEAPON5': '0.250', 'weapon2': '0.342', 'WEAPON4': '0.600', 'WEAPON3': '0.950', 'weapon4': '1.332', 'weapon3': '1.602', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '11.019', 'FRAGCOUNT': '38.000'} [2023-02-24 21:13:30,189][213367] DAMAGECOUNT value on done: 464315.0 [2023-02-24 21:13:30,190][213367] Sum rewards: 36.310, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.607', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.144', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.290', 'weapon2': '0.632', 'WEAPON3': '1.100', 'HITCOUNT': '2.120', 'weapon3': '2.208', 'DAMAGECOUNT': '9.732', 'FRAGCOUNT': '33.000'} [2023-02-24 21:13:30,243][213332] Fps is (10 sec: 13106.7, 60 sec: 13380.2, 300 sec: 13454.3). Total num frames: 139476992. Throughput: 0: 3341.1. Samples: 9865650. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 21:13:30,244][213332] Avg episode reward: [(0, '43.500')] [2023-02-24 21:13:30,351][213367] DAMAGECOUNT value on done: 460985.0 [2023-02-24 21:13:30,352][213367] Sum rewards: 38.470, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.607', 'AMMO5': '0.017', 'AMMO2': '0.035', 'AMMO4': '0.172', 'AMMO3': '0.175', 'weapon5': '0.186', 'WEAPON5': '0.400', 'weapon2': '0.488', 'WEAPON4': '0.500', 'weapon4': '0.586', 'WEAPON3': '1.050', 'weapon3': '2.440', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '11.388', 'FRAGCOUNT': '36.000'} [2023-02-24 21:13:30,504][213367] DAMAGECOUNT value on done: 466032.0 [2023-02-24 21:13:30,504][213367] Sum rewards: 44.817, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.506', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.207', 'weapon2': '0.226', 'WEAPON4': '0.300', 'weapon4': '0.676', 'WEAPON3': '1.200', 'HITCOUNT': '2.580', 'weapon3': '2.722', 'DAMAGECOUNT': '12.477', 'FRAGCOUNT': '39.000'} [2023-02-24 21:13:31,086][213372] DAMAGECOUNT value on done: 472141.0 [2023-02-24 21:13:31,087][213372] Sum rewards: 49.397, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.115', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon4': '0.200', 'AMMO3': '0.213', 'weapon5': '0.224', 'weapon2': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.890', 'weapon3': '2.996', 'DAMAGECOUNT': '14.811', 'FRAGCOUNT': '44.500'} [2023-02-24 21:13:31,158][213372] DAMAGECOUNT value on done: 456846.0 [2023-02-24 21:13:31,158][213372] Sum rewards: 54.263, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.135', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.110', 'AMMO3': '0.179', 'WEAPON4': '0.300', 'weapon2': '0.590', 'weapon4': '0.628', 'WEAPON3': '1.100', 'weapon3': '2.468', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.529', 'FRAGCOUNT': '44.500'} [2023-02-24 21:13:31,185][213365] Updated weights for policy 0, policy_version 34056 (0.0009) [2023-02-24 21:13:31,409][213372] DAMAGECOUNT value on done: 467463.0 [2023-02-24 21:13:31,410][213372] Sum rewards: 35.035, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.230', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon7': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.148', 'AMMO3': '0.197', 'WEAPON7': '0.200', 'AMMO4': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.678', 'weapon2': '0.704', 'WEAPON3': '1.050', 'weapon3': '2.040', 'HITCOUNT': '2.290', 'DAMAGECOUNT': '10.440', 'FRAGCOUNT': '33.000'} [2023-02-24 21:13:31,465][213372] DAMAGECOUNT value on done: 457174.0 [2023-02-24 21:13:31,465][213372] Sum rewards: 49.850, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.176', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon4': '0.322', 'weapon2': '0.576', 'WEAPON3': '1.150', 'HITCOUNT': '2.720', 'weapon3': '2.856', 'DAMAGECOUNT': '12.756', 'FRAGCOUNT': '43.000'} [2023-02-24 21:13:31,812][213366] DAMAGECOUNT value on done: 454805.0 [2023-02-24 21:13:31,812][213366] Sum rewards: 37.669, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.626', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon2': '0.150', 'weapon5': '0.156', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.688', 'WEAPON3': '1.100', 'HITCOUNT': '2.430', 'weapon3': '2.534', 'DAMAGECOUNT': '11.883', 'FRAGCOUNT': '32.000'} [2023-02-24 21:13:32,127][213366] DAMAGECOUNT value on done: 464777.0 [2023-02-24 21:13:32,127][213366] Sum rewards: 31.179, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.932', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon5': '0.094', 'AMMO4': '0.123', 'weapon4': '0.128', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.492', 'WEAPON3': '1.250', 'HITCOUNT': '2.250', 'weapon3': '3.036', 'DAMAGECOUNT': '9.675', 'FRAGCOUNT': '30.000'} [2023-02-24 21:13:32,136][213366] DAMAGECOUNT value on done: 476352.0 [2023-02-24 21:13:32,137][213366] Sum rewards: 46.482, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.329', 'AMMO2': '0.010', 'AMMO5': '0.021', 'AMMO4': '0.047', 'weapon4': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon5': '0.214', 'WEAPON5': '0.500', 'weapon2': '0.526', 'WEAPON3': '1.400', 'HITCOUNT': '2.620', 'weapon3': '2.736', 'DAMAGECOUNT': '11.649', 'FRAGCOUNT': '43.000'} [2023-02-24 21:13:32,452][213366] DAMAGECOUNT value on done: 463008.0 [2023-02-24 21:13:32,453][213366] Sum rewards: 46.933, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.525', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.044', 'AMMO3': '0.195', 'AMMO4': '0.220', 'weapon2': '0.264', 'weapon5': '0.300', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.638', 'WEAPON3': '1.200', 'weapon3': '2.504', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '13.740', 'FRAGCOUNT': '41.500'} [2023-02-24 21:13:32,774][213383] DAMAGECOUNT value on done: 458105.0 [2023-02-24 21:13:32,775][213383] Sum rewards: 51.327, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.534', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.114', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.254', 'weapon4': '0.464', 'WEAPON3': '1.250', 'weapon3': '2.824', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.074', 'FRAGCOUNT': '44.000'} [2023-02-24 21:13:32,779][213369] DAMAGECOUNT value on done: 466700.0 [2023-02-24 21:13:32,780][213369] Sum rewards: 38.422, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.148', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.056', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'weapon4': '0.322', 'weapon2': '0.868', 'WEAPON3': '1.000', 'HITCOUNT': '2.440', 'weapon3': '2.544', 'DAMAGECOUNT': '10.635', 'FRAGCOUNT': '33.000'} [2023-02-24 21:13:32,800][213368] DAMAGECOUNT value on done: 456557.0 [2023-02-24 21:13:32,801][213368] Sum rewards: 37.292, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.500', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.100', 'AMMO4': '0.111', 'weapon4': '0.144', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.200', 'HITCOUNT': '2.460', 'weapon3': '3.216', 'DAMAGECOUNT': '11.298', 'FRAGCOUNT': '33.000'} [2023-02-24 21:13:32,897][213382] DAMAGECOUNT value on done: 466008.0 [2023-02-24 21:13:32,898][213382] Sum rewards: 40.256, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.800', 'AMMO5': '0.023', 'AMMO2': '0.048', 'AMMO3': '0.216', 'AMMO4': '0.242', 'weapon5': '0.282', 'weapon2': '0.314', 'weapon4': '0.444', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.554', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '12.522', 'FRAGCOUNT': '38.000'} [2023-02-24 21:13:33,098][213383] DAMAGECOUNT value on done: 463670.0 [2023-02-24 21:13:33,099][213383] Sum rewards: 40.915, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.503', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.118', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.352', 'weapon4': '0.572', 'WEAPON3': '1.400', 'HITCOUNT': '2.630', 'weapon3': '2.672', 'DAMAGECOUNT': '11.706', 'FRAGCOUNT': '38.000'} [2023-02-24 21:13:33,105][213368] DAMAGECOUNT value on done: 466163.0 [2023-02-24 21:13:33,105][213369] DAMAGECOUNT value on done: 466116.0 [2023-02-24 21:13:33,105][213369] Sum rewards: 48.111, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.424', 'AMMO5': '0.020', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.245', 'weapon5': '0.294', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon4': '0.510', 'WEAPON3': '1.550', 'weapon3': '2.504', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.067', 'FRAGCOUNT': '45.000'} [2023-02-24 21:13:33,105][213368] Sum rewards: 45.400, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.830', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon5': '0.114', 'AMMO4': '0.157', 'AMMO3': '0.200', 'weapon4': '0.318', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.544', 'WEAPON3': '1.150', 'HITCOUNT': '2.780', 'weapon3': '2.784', 'DAMAGECOUNT': '13.587', 'FRAGCOUNT': '39.000'} [2023-02-24 21:13:33,224][213382] DAMAGECOUNT value on done: 465276.0 [2023-02-24 21:13:33,224][213382] Sum rewards: 48.016, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.776', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.182', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.270', 'weapon2': '0.484', 'WEAPON3': '1.300', 'weapon3': '2.792', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.227', 'FRAGCOUNT': '42.000'} [2023-02-24 21:13:33,367][213368] DAMAGECOUNT value on done: 456643.0 [2023-02-24 21:13:33,368][213368] Sum rewards: 34.088, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.644', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO4': '0.185', 'weapon2': '0.200', 'weapon5': '0.220', 'AMMO3': '0.229', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.896', 'WEAPON3': '1.250', 'weapon3': '2.246', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '11.763', 'FRAGCOUNT': '33.000'} [2023-02-24 21:13:33,422][213369] DAMAGECOUNT value on done: 462314.0 [2023-02-24 21:13:33,423][213369] Sum rewards: 32.242, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.211', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.140', 'AMMO3': '0.145', 'AMMO4': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.680', 'weapon2': '0.764', 'WEAPON3': '0.850', 'weapon3': '2.198', 'HITCOUNT': '2.210', 'DAMAGECOUNT': '9.513', 'FRAGCOUNT': '28.000'} [2023-02-24 21:13:33,547][213382] DAMAGECOUNT value on done: 451594.0 [2023-02-24 21:13:33,547][213382] Sum rewards: 54.135, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.013', 'ARMOR': '0.004', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon5': '0.084', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.238', 'weapon2': '0.296', 'weapon4': '0.360', 'WEAPON3': '1.500', 'HITCOUNT': '2.830', 'weapon3': '3.030', 'DAMAGECOUNT': '14.316', 'FRAGCOUNT': '49.000'} [2023-02-24 21:13:33,685][213368] DAMAGECOUNT value on done: 457436.0 [2023-02-24 21:13:33,685][213368] Sum rewards: 39.948, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.712', 'AMMO5': '0.019', 'AMMO2': '0.034', 'weapon4': '0.136', 'AMMO4': '0.170', 'AMMO3': '0.239', 'weapon5': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.418', 'WEAPON3': '1.350', 'HITCOUNT': '2.830', 'weapon3': '2.832', 'DAMAGECOUNT': '14.388', 'FRAGCOUNT': '37.000'} [2023-02-24 21:13:33,734][213384] DAMAGECOUNT value on done: 466501.0 [2023-02-24 21:13:33,734][213384] Sum rewards: 40.229, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.614', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.077', 'AMMO3': '0.221', 'weapon5': '0.228', 'weapon2': '0.378', 'AMMO4': '0.383', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.686', 'WEAPON3': '1.300', 'weapon3': '2.298', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '12.606', 'FRAGCOUNT': '36.000'} [2023-02-24 21:13:33,742][213369] DAMAGECOUNT value on done: 452259.0 [2023-02-24 21:13:33,742][213369] Sum rewards: 45.443, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.292', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.266', 'weapon2': '0.274', 'AMMO3': '0.285', 'WEAPON3': '1.700', 'weapon3': '3.018', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.374', 'FRAGCOUNT': '43.000'} [2023-02-24 21:13:33,762][213383] DAMAGECOUNT value on done: 466705.0 [2023-02-24 21:13:33,763][213383] Sum rewards: 30.099, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.618', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.042', 'AMMO3': '0.144', 'AMMO4': '0.212', 'weapon5': '0.212', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.636', 'WEAPON3': '0.800', 'weapon4': '0.848', 'weapon3': '1.930', 'HITCOUNT': '2.450', 'DAMAGECOUNT': '10.218', 'FRAGCOUNT': '28.000'} [2023-02-24 21:13:33,874][213382] DAMAGECOUNT value on done: 459052.0 [2023-02-24 21:13:33,874][213382] Sum rewards: 42.172, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.870', 'AMMO5': '0.016', 'AMMO2': '0.036', 'AMMO3': '0.147', 'weapon5': '0.166', 'AMMO4': '0.178', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.564', 'weapon4': '0.668', 'WEAPON3': '0.900', 'weapon3': '2.280', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '11.196', 'FRAGCOUNT': '38.000'} [2023-02-24 21:13:34,051][213384] DAMAGECOUNT value on done: 450006.0 [2023-02-24 21:13:34,051][213384] Sum rewards: 55.759, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.104', 'AMMO5': '0.007', 'AMMO2': '0.030', 'AMMO4': '0.147', 'weapon5': '0.154', 'AMMO3': '0.166', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.490', 'weapon2': '0.512', 'WEAPON3': '0.900', 'weapon3': '2.620', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.497', 'FRAGCOUNT': '48.000'} [2023-02-24 21:13:34,080][213383] DAMAGECOUNT value on done: 458498.0 [2023-02-24 21:13:34,080][213383] Sum rewards: 51.169, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.886', 'AMMO5': '0.013', 'AMMO2': '0.050', 'AMMO3': '0.137', 'weapon5': '0.184', 'AMMO4': '0.252', 'WEAPON5': '0.350', 'weapon2': '0.484', 'WEAPON4': '0.500', 'WEAPON3': '0.800', 'weapon4': '0.836', 'weapon3': '2.236', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.103', 'FRAGCOUNT': '41.000'} [2023-02-24 21:13:34,284][213365] Updated weights for policy 0, policy_version 34066 (0.0010) [2023-02-24 21:13:34,373][213384] DAMAGECOUNT value on done: 461807.0 [2023-02-24 21:13:34,373][213384] Sum rewards: 34.773, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.765', 'AMMO5': '0.017', 'AMMO2': '0.033', 'weapon5': '0.124', 'AMMO4': '0.163', 'AMMO3': '0.188', 'weapon4': '0.322', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.426', 'WEAPON3': '1.100', 'HITCOUNT': '2.320', 'weapon3': '2.736', 'DAMAGECOUNT': '9.309', 'FRAGCOUNT': '34.000'} [2023-02-24 21:13:34,678][213384] DAMAGECOUNT value on done: 465462.0 [2023-02-24 21:13:34,678][213384] Sum rewards: 54.067, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.930', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'weapon4': '0.156', 'AMMO3': '0.221', 'weapon2': '0.366', 'WEAPON3': '1.400', 'HITCOUNT': '2.920', 'weapon3': '3.236', 'DAMAGECOUNT': '12.714', 'FRAGCOUNT': '49.000'} [2023-02-24 21:13:35,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13454.3). Total num frames: 139546624. Throughput: 0: 3338.4. Samples: 9875726. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 21:13:35,243][213332] Avg episode reward: [(0, '43.646')] [2023-02-24 21:13:37,239][213365] Updated weights for policy 0, policy_version 34076 (0.0009) [2023-02-24 21:13:40,179][213365] Updated weights for policy 0, policy_version 34086 (0.0009) [2023-02-24 21:13:40,243][213332] Fps is (10 sec: 13926.9, 60 sec: 13448.6, 300 sec: 13468.2). Total num frames: 139616256. Throughput: 0: 3346.0. Samples: 9896156. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 21:13:40,243][213332] Avg episode reward: [(0, '43.646')] [2023-02-24 21:13:41,277][213366] Large shaping reward 2.605 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5730000000000001, 191.0), ('weapon5', 0.002)] [2023-02-24 21:13:43,115][213365] Updated weights for policy 0, policy_version 34096 (0.0009) [2023-02-24 21:13:45,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13448.6, 300 sec: 13468.2). Total num frames: 139685888. Throughput: 0: 3363.2. Samples: 9917008. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-24 21:13:45,243][213332] Avg episode reward: [(0, '43.646')] [2023-02-24 21:13:46,055][213365] Updated weights for policy 0, policy_version 34106 (0.0010) [2023-02-24 21:13:49,036][213365] Updated weights for policy 0, policy_version 34116 (0.0009) [2023-02-24 21:13:49,556][213367] DAMAGECOUNT value on done: 460176.0 [2023-02-24 21:13:49,557][213367] Sum rewards: 25.421, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.046', 'AMMO5': '0.013', 'AMMO2': '0.036', 'AMMO3': '0.157', 'AMMO4': '0.180', 'weapon5': '0.188', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'ARMOR': '0.408', 'weapon2': '0.410', 'weapon4': '0.712', 'WEAPON3': '0.950', 'HITCOUNT': '1.710', 'weapon3': '2.090', 'DAMAGECOUNT': '7.863', 'FRAGCOUNT': '24.000'} [2023-02-24 21:13:49,726][213367] DAMAGECOUNT value on done: 468884.0 [2023-02-24 21:13:49,727][213367] Sum rewards: 47.571, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.663', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.031', 'weapon5': '0.106', 'AMMO4': '0.153', 'weapon2': '0.208', 'AMMO3': '0.266', 'WEAPON5': '0.350', 'weapon4': '0.390', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.870', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.707', 'FRAGCOUNT': '46.000'} [2023-02-24 21:13:49,869][213367] DAMAGECOUNT value on done: 465161.0 [2023-02-24 21:13:49,870][213367] Sum rewards: 46.509, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.340', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.074', 'WEAPON4': '0.200', 'weapon4': '0.212', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'weapon2': '0.378', 'WEAPON3': '1.300', 'HITCOUNT': '3.010', 'weapon3': '3.088', 'DAMAGECOUNT': '12.528', 'FRAGCOUNT': '41.500'} [2023-02-24 21:13:50,037][213367] DAMAGECOUNT value on done: 470398.0 [2023-02-24 21:13:50,037][213367] Sum rewards: 52.959, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.795', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.140', 'weapon4': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.199', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '2.960', 'weapon3': '3.184', 'DAMAGECOUNT': '13.098', 'FRAGCOUNT': '47.000'} [2023-02-24 21:13:50,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13516.8, 300 sec: 13468.2). Total num frames: 139755520. Throughput: 0: 3366.4. Samples: 9927406. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:13:50,243][213332] Avg episode reward: [(0, '44.063')] [2023-02-24 21:13:50,581][213372] DAMAGECOUNT value on done: 475770.0 [2023-02-24 21:13:50,582][213372] Sum rewards: 44.386, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.176', 'AMMO2': '0.006', 'AMMO4': '0.028', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'weapon4': '0.494', 'WEAPON3': '0.850', 'weapon2': '0.940', 'weapon3': '2.412', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '10.887', 'FRAGCOUNT': '36.000'} [2023-02-24 21:13:50,634][213372] DAMAGECOUNT value on done: 460620.0 [2023-02-24 21:13:50,634][213372] Sum rewards: 41.398, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.300', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.104', 'AMMO4': '0.105', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.430', 'weapon2': '0.454', 'WEAPON3': '1.200', 'HITCOUNT': '2.520', 'weapon3': '2.850', 'DAMAGECOUNT': '11.322', 'FRAGCOUNT': '37.000'} [2023-02-24 21:13:50,688][213383] Large shaping reward 2.547 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.525, 175.0), ('weapon5', 0.002)] [2023-02-24 21:13:50,892][213372] DAMAGECOUNT value on done: 470664.0 [2023-02-24 21:13:50,893][213372] Sum rewards: 36.166, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.935', 'AMMO2': '0.003', 'AMMO4': '0.012', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'ARMOR': '0.455', 'weapon2': '0.488', 'weapon4': '0.558', 'WEAPON3': '1.100', 'HITCOUNT': '2.180', 'weapon3': '2.832', 'DAMAGECOUNT': '9.603', 'FRAGCOUNT': '32.000'} [2023-02-24 21:13:50,958][213372] DAMAGECOUNT value on done: 461287.0 [2023-02-24 21:13:50,958][213372] Sum rewards: 37.400, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.295', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.047', 'AMMO3': '0.216', 'weapon2': '0.222', 'weapon5': '0.224', 'AMMO4': '0.233', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.640', 'WEAPON3': '1.250', 'HITCOUNT': '2.600', 'weapon3': '2.604', 'DAMAGECOUNT': '12.339', 'FRAGCOUNT': '35.000'} [2023-02-24 21:13:51,291][213366] DAMAGECOUNT value on done: 458661.0 [2023-02-24 21:13:51,291][213366] Sum rewards: 45.987, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.588', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.058', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon2': '0.444', 'weapon4': '0.490', 'WEAPON3': '1.100', 'HITCOUNT': '2.640', 'weapon3': '2.850', 'DAMAGECOUNT': '11.568', 'FRAGCOUNT': '39.000'} [2023-02-24 21:13:51,590][213366] DAMAGECOUNT value on done: 469118.0 [2023-02-24 21:13:51,590][213366] Sum rewards: 41.099, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.390', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.232', 'AMMO3': '0.283', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.404', 'weapon4': '0.504', 'WEAPON3': '1.650', 'weapon3': '2.528', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '13.023', 'FRAGCOUNT': '40.500'} [2023-02-24 21:13:51,599][213366] DAMAGECOUNT value on done: 479871.0 [2023-02-24 21:13:51,600][213366] Sum rewards: 39.794, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.062', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.046', 'AMMO3': '0.158', 'AMMO4': '0.229', 'weapon5': '0.252', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.472', 'weapon4': '0.682', 'WEAPON3': '0.950', 'weapon3': '2.188', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '10.557', 'FRAGCOUNT': '35.000'} [2023-02-24 21:13:51,755][213366] Large shaping reward 2.603 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.018000000000000002, -6.0), ('ARMOR', -0.001, -1.0), ('weapon5', 0.002)] [2023-02-24 21:13:51,894][213366] DAMAGECOUNT value on done: 467062.0 [2023-02-24 21:13:51,894][213366] Sum rewards: 54.457, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.728', 'AMMO5': '0.017', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon5': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'WEAPON5': '0.350', 'weapon4': '0.372', 'weapon2': '0.480', 'WEAPON3': '1.100', 'HITCOUNT': '2.610', 'weapon3': '2.804', 'DAMAGECOUNT': '12.162', 'FRAGCOUNT': '47.000'} [2023-02-24 21:13:51,979][213365] Updated weights for policy 0, policy_version 34126 (0.0009) [2023-02-24 21:13:52,236][213369] DAMAGECOUNT value on done: 471025.0 [2023-02-24 21:13:52,237][213369] Sum rewards: 44.472, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.938', 'AMMO5': '0.014', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.188', 'AMMO3': '0.239', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.414', 'WEAPON3': '1.400', 'weapon3': '2.720', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.975', 'FRAGCOUNT': '41.000'} [2023-02-24 21:13:52,291][213368] DAMAGECOUNT value on done: 460827.0 [2023-02-24 21:13:52,291][213368] Sum rewards: 56.092, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.018', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.140', 'AMMO3': '0.149', 'weapon2': '0.470', 'WEAPON3': '0.800', 'HEALTH': '1.118', 'HITCOUNT': '2.690', 'weapon3': '3.186', 'DAMAGECOUNT': '12.810', 'FRAGCOUNT': '45.000'} [2023-02-24 21:13:52,298][213383] DAMAGECOUNT value on done: 462863.0 [2023-02-24 21:13:52,299][213383] Sum rewards: 45.533, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.197', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO2': '0.052', 'AMMO3': '0.222', 'weapon5': '0.228', 'weapon4': '0.250', 'AMMO4': '0.261', 'weapon2': '0.338', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.866', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.274', 'FRAGCOUNT': '42.000'} [2023-02-24 21:13:52,427][213382] DAMAGECOUNT value on done: 469954.0 [2023-02-24 21:13:52,428][213382] Sum rewards: 44.028, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.677', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.108', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'WEAPON4': '0.300', 'weapon2': '0.466', 'weapon4': '0.566', 'WEAPON3': '0.950', 'weapon3': '2.622', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '11.703', 'FRAGCOUNT': '37.000'} [2023-02-24 21:13:52,540][213369] DAMAGECOUNT value on done: 470081.0 [2023-02-24 21:13:52,541][213369] Sum rewards: 40.709, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.132', 'AMMO5': '0.011', 'AMMO2': '0.020', 'weapon4': '0.060', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.208', 'weapon5': '0.270', 'WEAPON5': '0.350', 'weapon2': '0.446', 'WEAPON3': '1.350', 'HITCOUNT': '2.480', 'weapon3': '3.000', 'DAMAGECOUNT': '11.895', 'FRAGCOUNT': '37.000'} [2023-02-24 21:13:52,600][213368] DAMAGECOUNT value on done: 469891.0 [2023-02-24 21:13:52,600][213368] Sum rewards: 40.017, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.546', 'AMMO5': '0.017', 'AMMO2': '0.045', 'AMMO3': '0.135', 'weapon2': '0.160', 'AMMO4': '0.227', 'weapon5': '0.352', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'weapon4': '1.330', 'weapon3': '1.592', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '11.184', 'FRAGCOUNT': '34.000'} [2023-02-24 21:13:52,609][213383] DAMAGECOUNT value on done: 467410.0 [2023-02-24 21:13:52,609][213383] Sum rewards: 42.972, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.505', 'ARMOR': '0.004', 'AMMO2': '0.018', 'AMMO5': '0.019', 'AMMO4': '0.088', 'weapon5': '0.198', 'WEAPON4': '0.200', 'weapon4': '0.224', 'AMMO3': '0.240', 'weapon2': '0.250', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.310', 'weapon3': '2.956', 'DAMAGECOUNT': '11.220', 'FRAGCOUNT': '39.000'} [2023-02-24 21:13:52,731][213382] DAMAGECOUNT value on done: 469377.0 [2023-02-24 21:13:52,731][213382] Sum rewards: 44.964, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.808', 'AMMO5': '0.017', 'AMMO2': '0.030', 'AMMO3': '0.130', 'AMMO4': '0.151', 'weapon5': '0.276', 'weapon2': '0.422', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'weapon4': '0.704', 'weapon3': '1.928', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '12.303', 'FRAGCOUNT': '37.000'} [2023-02-24 21:13:52,831][213369] DAMAGECOUNT value on done: 466564.0 [2023-02-24 21:13:52,832][213369] Sum rewards: 40.169, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.998', 'AMMO2': '0.018', 'AMMO5': '0.022', 'AMMO4': '0.089', 'AMMO3': '0.189', 'weapon5': '0.202', 'WEAPON4': '0.300', 'weapon4': '0.300', 'weapon2': '0.496', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'HITCOUNT': '2.560', 'weapon3': '2.690', 'DAMAGECOUNT': '12.750', 'FRAGCOUNT': '36.000'} [2023-02-24 21:13:52,839][213368] DAMAGECOUNT value on done: 459941.0 [2023-02-24 21:13:52,839][213368] Sum rewards: 37.613, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.370', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon7': '0.074', 'weapon5': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'weapon4': '0.494', 'weapon2': '0.590', 'WEAPON3': '1.150', 'HITCOUNT': '2.100', 'weapon3': '2.552', 'DAMAGECOUNT': '9.894', 'FRAGCOUNT': '34.000'} [2023-02-24 21:13:52,997][213382] DAMAGECOUNT value on done: 456286.0 [2023-02-24 21:13:52,998][213382] Sum rewards: 55.895, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.740', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.028', 'weapon5': '0.044', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon2': '0.388', 'WEAPON3': '1.350', 'HITCOUNT': '3.110', 'weapon3': '3.308', 'DAMAGECOUNT': '14.076', 'FRAGCOUNT': '47.000'} [2023-02-24 21:13:53,113][213384] DAMAGECOUNT value on done: 470295.0 [2023-02-24 21:13:53,114][213384] Sum rewards: 41.320, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.870', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.058', 'AMMO4': '0.118', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon5': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.250', 'HITCOUNT': '2.610', 'weapon3': '2.932', 'DAMAGECOUNT': '11.382', 'FRAGCOUNT': '37.000'} [2023-02-24 21:13:53,132][213369] DAMAGECOUNT value on done: 456100.0 [2023-02-24 21:13:53,132][213369] Sum rewards: 39.814, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.654', 'AMMO5': '0.008', 'AMMO2': '0.031', 'AMMO4': '0.157', 'weapon5': '0.178', 'AMMO3': '0.201', 'WEAPON5': '0.300', 'weapon4': '0.328', 'WEAPON4': '0.400', 'weapon2': '0.680', 'WEAPON3': '1.250', 'HITCOUNT': '2.320', 'weapon3': '2.592', 'DAMAGECOUNT': '11.523', 'FRAGCOUNT': '37.000'} [2023-02-24 21:13:53,145][213368] DAMAGECOUNT value on done: 460725.0 [2023-02-24 21:13:53,146][213368] Sum rewards: 33.629, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.580', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.051', 'AMMO3': '0.185', 'weapon2': '0.228', 'AMMO4': '0.254', 'weapon5': '0.270', 'WEAPON5': '0.400', 'weapon4': '0.674', 'WEAPON4': '0.700', 'WEAPON3': '1.200', 'HITCOUNT': '2.130', 'weapon3': '2.222', 'DAMAGECOUNT': '9.867', 'FRAGCOUNT': '35.000'} [2023-02-24 21:13:53,223][213383] DAMAGECOUNT value on done: 470856.0 [2023-02-24 21:13:53,223][213383] Sum rewards: 42.426, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.908', 'AMMO5': '0.020', 'AMMO2': '0.032', 'weapon4': '0.088', 'weapon5': '0.152', 'AMMO4': '0.159', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.352', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '2.640', 'weapon3': '3.132', 'DAMAGECOUNT': '12.453', 'FRAGCOUNT': '39.000'} [2023-02-24 21:13:53,290][213382] DAMAGECOUNT value on done: 463155.0 [2023-02-24 21:13:53,291][213382] Sum rewards: 46.356, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.552', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'WEAPON4': '0.350', 'weapon4': '0.410', 'weapon2': '0.426', 'WEAPON3': '1.100', 'weapon3': '2.714', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.309', 'FRAGCOUNT': '41.000'} [2023-02-24 21:13:53,414][213384] DAMAGECOUNT value on done: 454245.0 [2023-02-24 21:13:53,415][213384] Sum rewards: 43.529, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.260', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.048', 'AMMO3': '0.154', 'AMMO4': '0.242', 'weapon5': '0.278', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon4': '0.554', 'weapon2': '0.668', 'WEAPON3': '0.950', 'weapon3': '1.948', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '12.717', 'FRAGCOUNT': '38.000'} [2023-02-24 21:13:53,521][213383] DAMAGECOUNT value on done: 462482.0 [2023-02-24 21:13:53,521][213383] Sum rewards: 45.881, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.605', 'AMMO5': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.077', 'WEAPON5': '0.150', 'weapon5': '0.176', 'weapon2': '0.210', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon4': '0.428', 'WEAPON3': '1.300', 'HITCOUNT': '2.750', 'weapon3': '2.944', 'DAMAGECOUNT': '11.952', 'FRAGCOUNT': '42.000'} [2023-02-24 21:13:53,722][213384] DAMAGECOUNT value on done: 466388.0 [2023-02-24 21:13:53,723][213384] Sum rewards: 51.153, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.763', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.130', 'AMMO3': '0.152', 'AMMO4': '0.155', 'WEAPON5': '0.250', 'weapon2': '0.254', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '0.900', 'weapon4': '1.066', 'weapon3': '2.288', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.743', 'FRAGCOUNT': '41.000'} [2023-02-24 21:13:54,027][213384] DAMAGECOUNT value on done: 469675.0 [2023-02-24 21:13:54,027][213384] Sum rewards: 53.259, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.818', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.176', 'AMMO3': '0.188', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.530', 'WEAPON3': '1.050', 'HITCOUNT': '2.650', 'weapon3': '2.764', 'DAMAGECOUNT': '12.639', 'FRAGCOUNT': '45.000'} [2023-02-24 21:13:54,964][213365] Updated weights for policy 0, policy_version 34136 (0.0009) [2023-02-24 21:13:55,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13468.2). Total num frames: 139821056. Throughput: 0: 3380.7. Samples: 9948122. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:13:55,243][213332] Avg episode reward: [(0, '44.039')] [2023-02-24 21:13:57,887][213365] Updated weights for policy 0, policy_version 34146 (0.0009) [2023-02-24 21:14:00,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13482.1). Total num frames: 139890688. Throughput: 0: 3402.6. Samples: 9969062. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:14:00,244][213332] Avg episode reward: [(0, '44.039')] [2023-02-24 21:14:00,587][213384] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 21:14:00,839][213365] Updated weights for policy 0, policy_version 34156 (0.0009) [2023-02-24 21:14:03,805][213365] Updated weights for policy 0, policy_version 34166 (0.0010) [2023-02-24 21:14:05,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13585.1, 300 sec: 13482.1). Total num frames: 139960320. Throughput: 0: 3406.8. Samples: 9979454. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:14:05,243][213332] Avg episode reward: [(0, '44.039')] [2023-02-24 21:14:06,789][213365] Updated weights for policy 0, policy_version 34176 (0.0009) [2023-02-24 21:14:08,939][213367] DAMAGECOUNT value on done: 464366.0 [2023-02-24 21:14:08,939][213367] Sum rewards: 50.771, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.010', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.155', 'weapon4': '0.266', 'weapon2': '0.472', 'WEAPON3': '1.000', 'HITCOUNT': '2.790', 'weapon3': '3.028', 'DAMAGECOUNT': '12.570', 'FRAGCOUNT': '41.000'} [2023-02-24 21:14:09,102][213367] DAMAGECOUNT value on done: 472621.0 [2023-02-24 21:14:09,103][213367] Sum rewards: 42.688, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.630', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.163', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.312', 'weapon4': '0.476', 'WEAPON3': '1.150', 'HITCOUNT': '2.770', 'weapon3': '2.852', 'DAMAGECOUNT': '11.211', 'FRAGCOUNT': '38.000'} [2023-02-24 21:14:09,248][213367] DAMAGECOUNT value on done: 469195.0 [2023-02-24 21:14:09,249][213367] Sum rewards: 44.359, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.193', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO3': '0.177', 'weapon5': '0.182', 'AMMO4': '0.182', 'WEAPON5': '0.250', 'weapon2': '0.346', 'WEAPON4': '0.350', 'weapon4': '0.594', 'WEAPON3': '1.100', 'weapon3': '2.560', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '12.102', 'FRAGCOUNT': '40.000'} [2023-02-24 21:14:09,405][213367] DAMAGECOUNT value on done: 474796.0 [2023-02-24 21:14:09,406][213367] Sum rewards: 48.673, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.600', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon2': '0.254', 'WEAPON4': '0.350', 'weapon4': '0.434', 'WEAPON3': '1.050', 'weapon3': '2.802', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.194', 'FRAGCOUNT': '42.000'} [2023-02-24 21:14:09,758][213365] Updated weights for policy 0, policy_version 34186 (0.0009) [2023-02-24 21:14:09,980][213372] DAMAGECOUNT value on done: 479778.0 [2023-02-24 21:14:09,981][213372] Sum rewards: 44.548, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.397', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon7': '0.046', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.154', 'AMMO3': '0.185', 'AMMO4': '0.198', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.480', 'weapon2': '0.692', 'WEAPON3': '1.150', 'weapon3': '2.350', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '12.024', 'FRAGCOUNT': '41.000'} [2023-02-24 21:14:10,058][213372] DAMAGECOUNT value on done: 464859.0 [2023-02-24 21:14:10,059][213372] Sum rewards: 41.591, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.830', 'AMMO5': '0.018', 'AMMO2': '0.048', 'AMMO3': '0.188', 'AMMO4': '0.240', 'weapon2': '0.304', 'weapon5': '0.396', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon4': '0.742', 'WEAPON3': '1.150', 'weapon3': '2.218', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '12.717', 'FRAGCOUNT': '37.000'} [2023-02-24 21:14:10,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13585.1, 300 sec: 13496.0). Total num frames: 140029952. Throughput: 0: 3418.9. Samples: 10000080. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:14:10,243][213332] Avg episode reward: [(0, '44.163')] [2023-02-24 21:14:10,288][213372] DAMAGECOUNT value on done: 474371.0 [2023-02-24 21:14:10,289][213372] Sum rewards: 32.502, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.210', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon5': '0.190', 'AMMO3': '0.195', 'AMMO4': '0.270', 'weapon2': '0.336', 'weapon4': '0.460', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '1.200', 'HITCOUNT': '2.460', 'weapon3': '2.708', 'DAMAGECOUNT': '11.121', 'FRAGCOUNT': '33.000'} [2023-02-24 21:14:10,370][213372] DAMAGECOUNT value on done: 464947.0 [2023-02-24 21:14:10,371][213372] Sum rewards: 39.351, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.109', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon5': '0.106', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'AMMO4': '0.181', 'weapon4': '0.288', 'WEAPON5': '0.300', 'weapon2': '0.448', 'WEAPON3': '0.850', 'HITCOUNT': '2.440', 'weapon3': '2.770', 'DAMAGECOUNT': '10.980', 'FRAGCOUNT': '32.000'} [2023-02-24 21:14:10,676][213366] DAMAGECOUNT value on done: 463658.0 [2023-02-24 21:14:10,676][213366] Sum rewards: 52.083, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.890', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.178', 'weapon2': '0.190', 'weapon5': '0.252', 'weapon4': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.924', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.811', 'FRAGCOUNT': '44.000'} [2023-02-24 21:14:10,965][213366] DAMAGECOUNT value on done: 474243.0 [2023-02-24 21:14:10,966][213366] Sum rewards: 60.966, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.958', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.154', 'weapon4': '0.178', 'WEAPON5': '0.250', 'weapon2': '0.662', 'WEAPON3': '1.050', 'weapon3': '2.830', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '50.000'} [2023-02-24 21:14:10,985][213366] DAMAGECOUNT value on done: 483975.0 [2023-02-24 21:14:10,985][213366] Sum rewards: 42.272, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.524', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.057', 'AMMO3': '0.182', 'AMMO4': '0.285', 'weapon5': '0.368', 'WEAPON4': '0.500', 'weapon2': '0.520', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'weapon4': '1.074', 'weapon3': '1.474', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.312', 'FRAGCOUNT': '34.000'} [2023-02-24 21:14:11,273][213366] DAMAGECOUNT value on done: 470796.0 [2023-02-24 21:14:11,274][213366] Sum rewards: 44.288, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.254', 'AMMO5': '0.007', 'AMMO2': '0.036', 'WEAPON5': '0.150', 'AMMO4': '0.179', 'weapon5': '0.180', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.292', 'weapon4': '0.598', 'WEAPON3': '1.200', 'HITCOUNT': '2.570', 'weapon3': '2.670', 'DAMAGECOUNT': '11.202', 'FRAGCOUNT': '41.000'} [2023-02-24 21:14:11,621][213369] DAMAGECOUNT value on done: 475054.0 [2023-02-24 21:14:11,622][213369] Sum rewards: 42.566, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.520', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.096', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon2': '0.266', 'weapon4': '0.468', 'WEAPON3': '1.400', 'HITCOUNT': '2.640', 'weapon3': '2.876', 'DAMAGECOUNT': '12.087', 'FRAGCOUNT': '39.000'} [2023-02-24 21:14:11,713][213383] DAMAGECOUNT value on done: 466599.0 [2023-02-24 21:14:11,713][213383] Sum rewards: 32.969, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.789', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon5': '0.106', 'AMMO4': '0.210', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.474', 'weapon4': '0.536', 'WEAPON3': '1.500', 'weapon3': '2.568', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '11.208', 'FRAGCOUNT': '35.000'} [2023-02-24 21:14:11,717][213368] DAMAGECOUNT value on done: 464098.0 [2023-02-24 21:14:11,718][213368] Sum rewards: 34.454, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.780', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.052', 'weapon5': '0.108', 'AMMO4': '0.142', 'AMMO3': '0.178', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.502', 'WEAPON3': '1.150', 'HITCOUNT': '2.360', 'weapon3': '2.988', 'DAMAGECOUNT': '9.813', 'FRAGCOUNT': '32.000'} [2023-02-24 21:14:11,862][213382] DAMAGECOUNT value on done: 473856.0 [2023-02-24 21:14:11,863][213382] Sum rewards: 44.976, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.214', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon5': '0.136', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'weapon2': '0.340', 'WEAPON4': '0.400', 'weapon4': '0.678', 'WEAPON3': '1.050', 'weapon3': '2.374', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '11.706', 'FRAGCOUNT': '41.000'} [2023-02-24 21:14:11,930][213369] DAMAGECOUNT value on done: 473508.0 [2023-02-24 21:14:11,930][213369] Sum rewards: 38.752, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.485', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.154', 'AMMO3': '0.165', 'AMMO4': '0.177', 'WEAPON5': '0.300', 'weapon4': '0.348', 'WEAPON4': '0.350', 'weapon2': '0.572', 'WEAPON3': '0.950', 'HITCOUNT': '2.530', 'weapon3': '2.612', 'DAMAGECOUNT': '10.281', 'FRAGCOUNT': '35.000'} [2023-02-24 21:14:12,022][213383] DAMAGECOUNT value on done: 471348.0 [2023-02-24 21:14:12,022][213383] Sum rewards: 43.484, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.227', 'ARMOR': '0.004', 'AMMO5': '0.028', 'AMMO2': '0.036', 'AMMO4': '0.180', 'weapon2': '0.182', 'AMMO3': '0.194', 'weapon5': '0.270', 'WEAPON4': '0.450', 'weapon4': '0.450', 'WEAPON5': '0.750', 'WEAPON3': '1.250', 'HITCOUNT': '2.320', 'weapon3': '2.782', 'DAMAGECOUNT': '11.814', 'FRAGCOUNT': '41.000'} [2023-02-24 21:14:12,022][213368] DAMAGECOUNT value on done: 474396.0 [2023-02-24 21:14:12,023][213368] Sum rewards: 48.411, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.160', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.136', 'AMMO4': '0.143', 'AMMO3': '0.199', 'weapon2': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.550', 'weapon4': '1.046', 'WEAPON3': '1.150', 'weapon3': '2.250', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.260', 'FRAGCOUNT': '44.000'} [2023-02-24 21:14:12,166][213382] DAMAGECOUNT value on done: 474061.0 [2023-02-24 21:14:12,167][213382] Sum rewards: 53.845, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.068', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.078', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'weapon2': '0.332', 'WEAPON3': '1.400', 'HITCOUNT': '2.950', 'weapon3': '3.142', 'DAMAGECOUNT': '14.052', 'FRAGCOUNT': '48.000'} [2023-02-24 21:14:12,232][213369] DAMAGECOUNT value on done: 471794.0 [2023-02-24 21:14:12,233][213369] Sum rewards: 52.879, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.456', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.173', 'weapon2': '0.192', 'weapon5': '0.210', 'AMMO3': '0.217', 'WEAPON5': '0.400', 'weapon4': '0.408', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.900', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '47.000'} [2023-02-24 21:14:12,276][213368] DAMAGECOUNT value on done: 464883.0 [2023-02-24 21:14:12,277][213368] Sum rewards: 46.444, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.820', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon5': '0.146', 'weapon4': '0.180', 'weapon2': '0.200', 'AMMO4': '0.209', 'AMMO3': '0.236', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '2.990', 'weapon3': '3.174', 'DAMAGECOUNT': '14.523', 'FRAGCOUNT': '43.500'} [2023-02-24 21:14:12,470][213382] DAMAGECOUNT value on done: 460774.0 [2023-02-24 21:14:12,471][213382] Sum rewards: 51.134, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.822', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.224', 'weapon2': '0.244', 'WEAPON4': '0.300', 'weapon4': '0.690', 'WEAPON3': '0.950', 'weapon3': '2.582', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.464', 'FRAGCOUNT': '42.000'} [2023-02-24 21:14:12,536][213369] DAMAGECOUNT value on done: 459764.0 [2023-02-24 21:14:12,536][213369] Sum rewards: 38.294, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.954', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'weapon5': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.157', 'weapon4': '0.164', 'weapon2': '0.738', 'WEAPON3': '0.950', 'HITCOUNT': '2.360', 'weapon3': '2.644', 'DAMAGECOUNT': '10.992', 'FRAGCOUNT': '32.000'} [2023-02-24 21:14:12,564][213384] DAMAGECOUNT value on done: 473859.0 [2023-02-24 21:14:12,565][213384] Sum rewards: 44.329, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.620', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.025', 'AMMO4': '0.127', 'AMMO3': '0.163', 'weapon5': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.322', 'weapon2': '0.370', 'WEAPON3': '1.000', 'HITCOUNT': '2.480', 'weapon3': '2.884', 'DAMAGECOUNT': '10.692', 'FRAGCOUNT': '39.000'} [2023-02-24 21:14:12,580][213368] DAMAGECOUNT value on done: 464346.0 [2023-02-24 21:14:12,580][213368] Sum rewards: 43.009, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.965', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.138', 'AMMO3': '0.164', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.576', 'weapon4': '0.714', 'WEAPON3': '1.000', 'weapon3': '2.102', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '10.863', 'FRAGCOUNT': '39.000'} [2023-02-24 21:14:12,626][213383] DAMAGECOUNT value on done: 474985.0 [2023-02-24 21:14:12,626][213383] Sum rewards: 44.320, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.245', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.016', 'weapon5': '0.060', 'AMMO4': '0.077', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'weapon2': '0.236', 'WEAPON4': '0.250', 'weapon4': '0.602', 'WEAPON3': '1.050', 'weapon3': '2.846', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.387', 'FRAGCOUNT': '37.000'} [2023-02-24 21:14:12,731][213365] Updated weights for policy 0, policy_version 34196 (0.0009) [2023-02-24 21:14:12,765][213382] DAMAGECOUNT value on done: 466556.0 [2023-02-24 21:14:12,765][213382] Sum rewards: 41.697, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.694', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.080', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'weapon2': '0.642', 'WEAPON3': '1.250', 'HITCOUNT': '2.340', 'weapon3': '3.112', 'DAMAGECOUNT': '10.203', 'FRAGCOUNT': '38.000'} [2023-02-24 21:14:12,862][213384] DAMAGECOUNT value on done: 458165.0 [2023-02-24 21:14:12,863][213384] Sum rewards: 47.844, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.390', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.039', 'WEAPON4': '0.150', 'AMMO3': '0.204', 'weapon4': '0.220', 'weapon5': '0.242', 'WEAPON5': '0.350', 'weapon2': '0.636', 'WEAPON3': '1.250', 'HITCOUNT': '2.280', 'weapon3': '2.580', 'DAMAGECOUNT': '11.760', 'FRAGCOUNT': '43.000'} [2023-02-24 21:14:12,918][213383] DAMAGECOUNT value on done: 465623.0 [2023-02-24 21:14:12,918][213383] Sum rewards: 28.703, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.994', 'AMMO5': '0.003', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'weapon4': '0.314', 'weapon2': '0.620', 'WEAPON3': '1.350', 'HITCOUNT': '2.220', 'weapon3': '2.768', 'DAMAGECOUNT': '9.423', 'FRAGCOUNT': '29.000'} [2023-02-24 21:14:13,178][213384] DAMAGECOUNT value on done: 471424.0 [2023-02-24 21:14:13,178][213384] Sum rewards: 48.452, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.472', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'WEAPON5': '0.350', 'weapon2': '0.356', 'weapon4': '0.488', 'WEAPON3': '1.450', 'weapon3': '2.564', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.562', 'FRAGCOUNT': '43.000'} [2023-02-24 21:14:13,477][213384] DAMAGECOUNT value on done: 473900.0 [2023-02-24 21:14:13,477][213384] Sum rewards: 40.365, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.634', 'AMMO5': '0.021', 'AMMO2': '0.064', 'weapon5': '0.162', 'AMMO3': '0.197', 'AMMO4': '0.318', 'ARMOR': '0.400', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.582', 'weapon2': '0.776', 'WEAPON3': '1.150', 'weapon3': '2.194', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.675', 'FRAGCOUNT': '37.000'} [2023-02-24 21:14:15,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13653.4, 300 sec: 13496.0). Total num frames: 140099584. Throughput: 0: 3448.4. Samples: 10020826. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:14:15,243][213332] Avg episode reward: [(0, '44.114')] [2023-02-24 21:14:15,675][213365] Updated weights for policy 0, policy_version 34206 (0.0009) [2023-02-24 21:14:18,639][213365] Updated weights for policy 0, policy_version 34216 (0.0009) [2023-02-24 21:14:20,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13721.6, 300 sec: 13509.9). Total num frames: 140169216. Throughput: 0: 3455.5. Samples: 10031222. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:14:20,243][213332] Avg episode reward: [(0, '44.114')] [2023-02-24 21:14:21,645][213365] Updated weights for policy 0, policy_version 34226 (0.0009) [2023-02-24 21:14:24,605][213365] Updated weights for policy 0, policy_version 34236 (0.0009) [2023-02-24 21:14:25,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13509.9). Total num frames: 140238848. Throughput: 0: 3461.4. Samples: 10051918. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:14:25,243][213332] Avg episode reward: [(0, '44.114')] [2023-02-24 21:14:27,568][213365] Updated weights for policy 0, policy_version 34246 (0.0009) [2023-02-24 21:14:28,434][213367] DAMAGECOUNT value on done: 468688.0 [2023-02-24 21:14:28,435][213367] Sum rewards: 47.896, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.147', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.048', 'AMMO3': '0.152', 'weapon5': '0.174', 'AMMO4': '0.239', 'WEAPON5': '0.350', 'weapon2': '0.418', 'WEAPON4': '0.450', 'weapon4': '0.882', 'WEAPON3': '0.950', 'weapon3': '2.182', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.966', 'FRAGCOUNT': '41.000'} [2023-02-24 21:14:28,602][213367] DAMAGECOUNT value on done: 475916.0 [2023-02-24 21:14:28,603][213367] Sum rewards: 36.225, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.960', 'AMMO5': '0.005', 'weapon5': '0.024', 'AMMO2': '0.025', 'weapon4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.231', 'weapon2': '0.510', 'WEAPON3': '1.400', 'HITCOUNT': '2.270', 'weapon3': '3.184', 'DAMAGECOUNT': '9.885', 'FRAGCOUNT': '33.000'} [2023-02-24 21:14:28,755][213367] DAMAGECOUNT value on done: 473494.0 [2023-02-24 21:14:28,755][213367] Sum rewards: 39.305, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-1.942', 'AMMO5': '0.012', 'ARMOR': '0.024', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon5': '0.206', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'weapon4': '0.368', 'WEAPON4': '0.400', 'weapon2': '0.406', 'WEAPON3': '1.400', 'weapon3': '2.592', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.897', 'FRAGCOUNT': '39.000'} [2023-02-24 21:14:28,911][213367] DAMAGECOUNT value on done: 478206.0 [2023-02-24 21:14:28,911][213367] Sum rewards: 37.457, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.235', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon7': '0.074', 'AMMO4': '0.118', 'AMMO3': '0.136', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon5': '0.198', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.338', 'WEAPON4': '0.400', 'WEAPON3': '0.850', 'weapon4': '1.084', 'weapon3': '1.982', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '10.230', 'FRAGCOUNT': '32.500'} [2023-02-24 21:14:29,372][213372] DAMAGECOUNT value on done: 483449.0 [2023-02-24 21:14:29,372][213372] Sum rewards: 38.634, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.110', 'AMMO5': '0.014', 'AMMO2': '0.036', 'AMMO4': '0.181', 'weapon5': '0.202', 'AMMO3': '0.211', 'weapon4': '0.340', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.330', 'weapon3': '2.666', 'DAMAGECOUNT': '11.013', 'FRAGCOUNT': '37.000'} [2023-02-24 21:14:29,521][213372] DAMAGECOUNT value on done: 468760.0 [2023-02-24 21:14:29,521][213372] Sum rewards: 39.430, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.300', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.022', 'AMMO3': '0.081', 'AMMO4': '0.110', 'weapon5': '0.120', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.574', 'WEAPON3': '0.600', 'weapon2': '0.644', 'weapon3': '2.308', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '11.358', 'FRAGCOUNT': '30.000'} [2023-02-24 21:14:29,698][213372] DAMAGECOUNT value on done: 478427.0 [2023-02-24 21:14:29,699][213372] Sum rewards: 38.228, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.016', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'weapon4': '0.154', 'weapon5': '0.186', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.276', 'WEAPON3': '1.250', 'HITCOUNT': '2.800', 'weapon3': '3.136', 'DAMAGECOUNT': '12.168', 'FRAGCOUNT': '35.000'} [2023-02-24 21:14:29,840][213372] DAMAGECOUNT value on done: 468719.0 [2023-02-24 21:14:29,841][213372] Sum rewards: 45.074, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.406', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon5': '0.132', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon2': '1.026', 'WEAPON3': '1.300', 'HITCOUNT': '2.540', 'weapon3': '2.626', 'DAMAGECOUNT': '11.316', 'FRAGCOUNT': '39.000'} [2023-02-24 21:14:30,139][213366] DAMAGECOUNT value on done: 467729.0 [2023-02-24 21:14:30,140][213366] Sum rewards: 44.463, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.211', 'AMMO5': '0.021', 'AMMO2': '0.035', 'AMMO3': '0.170', 'AMMO4': '0.175', 'WEAPON4': '0.250', 'weapon5': '0.282', 'weapon2': '0.332', 'WEAPON5': '0.500', 'weapon4': '0.772', 'WEAPON3': '1.000', 'weapon3': '2.324', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '12.213', 'FRAGCOUNT': '37.000'} [2023-02-24 21:14:30,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13790.0, 300 sec: 13509.9). Total num frames: 140304384. Throughput: 0: 3458.1. Samples: 10072622. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:14:30,243][213332] Avg episode reward: [(0, '43.460')] [2023-02-24 21:14:30,437][213366] DAMAGECOUNT value on done: 478243.0 [2023-02-24 21:14:30,438][213366] Sum rewards: 43.821, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.060', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.157', 'weapon5': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.258', 'weapon4': '0.266', 'WEAPON3': '0.950', 'HITCOUNT': '2.570', 'weapon3': '3.102', 'DAMAGECOUNT': '12.000', 'FRAGCOUNT': '36.000'} [2023-02-24 21:14:30,446][213366] DAMAGECOUNT value on done: 488502.0 [2023-02-24 21:14:30,447][213366] Sum rewards: 52.507, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.882', 'AMMO5': '0.013', 'AMMO2': '0.046', 'AMMO3': '0.210', 'AMMO4': '0.230', 'weapon5': '0.234', 'weapon2': '0.316', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.524', 'WEAPON3': '1.350', 'weapon3': '2.564', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.581', 'FRAGCOUNT': '47.000'} [2023-02-24 21:14:30,551][213365] Updated weights for policy 0, policy_version 34256 (0.0010) [2023-02-24 21:14:30,746][213366] DAMAGECOUNT value on done: 475086.0 [2023-02-24 21:14:30,747][213366] Sum rewards: 43.983, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.200', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.110', 'AMMO4': '0.154', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'weapon2': '0.284', 'WEAPON4': '0.350', 'weapon4': '0.672', 'WEAPON3': '1.450', 'weapon3': '2.576', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '12.867', 'FRAGCOUNT': '41.000'} [2023-02-24 21:14:31,075][213369] DAMAGECOUNT value on done: 478384.0 [2023-02-24 21:14:31,075][213369] Sum rewards: 28.822, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.044', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.050', 'weapon5': '0.064', 'AMMO3': '0.179', 'AMMO4': '0.214', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.972', 'WEAPON3': '1.100', 'HITCOUNT': '2.360', 'weapon3': '2.730', 'DAMAGECOUNT': '9.990', 'FRAGCOUNT': '27.500'} [2023-02-24 21:14:31,152][213368] DAMAGECOUNT value on done: 467360.0 [2023-02-24 21:14:31,152][213368] Sum rewards: 33.981, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.442', 'AMMO5': '0.016', 'AMMO2': '0.051', 'AMMO3': '0.143', 'weapon5': '0.196', 'AMMO4': '0.257', 'WEAPON5': '0.450', 'weapon4': '0.524', 'WEAPON4': '0.550', 'weapon2': '0.614', 'WEAPON3': '0.800', 'HITCOUNT': '2.190', 'weapon3': '2.346', 'DAMAGECOUNT': '9.786', 'FRAGCOUNT': '31.000'} [2023-02-24 21:14:31,180][213383] DAMAGECOUNT value on done: 470427.0 [2023-02-24 21:14:31,181][213383] Sum rewards: 38.267, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.999', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO4': '0.150', 'AMMO3': '0.192', 'weapon5': '0.240', 'WEAPON4': '0.350', 'weapon2': '0.412', 'weapon4': '0.442', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.576', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '11.484', 'FRAGCOUNT': '35.000'} [2023-02-24 21:14:31,327][213382] DAMAGECOUNT value on done: 477525.0 [2023-02-24 21:14:31,328][213382] Sum rewards: 45.973, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.546', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.052', 'weapon7': '0.056', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.129', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.238', 'weapon2': '0.542', 'WEAPON3': '0.850', 'HITCOUNT': '2.250', 'weapon3': '2.592', 'DAMAGECOUNT': '11.007', 'FRAGCOUNT': '38.000'} [2023-02-24 21:14:31,368][213369] DAMAGECOUNT value on done: 477936.0 [2023-02-24 21:14:31,369][213369] Sum rewards: 45.730, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.804', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.044', 'AMMO3': '0.218', 'AMMO4': '0.218', 'weapon5': '0.242', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.478', 'weapon2': '0.528', 'WEAPON3': '1.300', 'weapon3': '2.456', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '13.284', 'FRAGCOUNT': '42.000'} [2023-02-24 21:14:31,453][213368] DAMAGECOUNT value on done: 477322.0 [2023-02-24 21:14:31,454][213368] Sum rewards: 37.001, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.903', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.064', 'weapon5': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'weapon2': '0.460', 'weapon4': '0.490', 'WEAPON3': '0.950', 'HITCOUNT': '2.030', 'weapon3': '2.700', 'DAMAGECOUNT': '8.778', 'FRAGCOUNT': '33.000'} [2023-02-24 21:14:31,481][213383] DAMAGECOUNT value on done: 474764.0 [2023-02-24 21:14:31,482][213383] Sum rewards: 29.160, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.642', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon5': '0.142', 'AMMO3': '0.236', 'AMMO4': '0.274', 'weapon2': '0.346', 'WEAPON5': '0.400', 'weapon4': '0.462', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'HITCOUNT': '2.470', 'weapon3': '2.648', 'DAMAGECOUNT': '10.248', 'FRAGCOUNT': '30.000'} [2023-02-24 21:14:31,634][213382] DAMAGECOUNT value on done: 477658.0 [2023-02-24 21:14:31,635][213382] Sum rewards: 40.113, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.269', 'AMMO2': '0.009', 'AMMO5': '0.012', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'weapon4': '0.142', 'weapon5': '0.174', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'weapon2': '0.396', 'WEAPON3': '1.400', 'HITCOUNT': '2.610', 'weapon3': '3.026', 'DAMAGECOUNT': '10.791', 'FRAGCOUNT': '36.000'} [2023-02-24 21:14:31,676][213369] DAMAGECOUNT value on done: 476270.0 [2023-02-24 21:14:31,677][213369] Sum rewards: 43.987, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.680', 'AMMO2': '0.005', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'weapon4': '0.092', 'weapon2': '0.146', 'AMMO3': '0.271', 'WEAPON3': '1.750', 'HITCOUNT': '3.070', 'weapon3': '3.582', 'DAMAGECOUNT': '13.428', 'FRAGCOUNT': '41.000'} [2023-02-24 21:14:31,698][213368] DAMAGECOUNT value on done: 468874.0 [2023-02-24 21:14:31,699][213368] Sum rewards: 42.087, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.982', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.146', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.380', 'weapon2': '0.842', 'WEAPON3': '1.050', 'weapon3': '2.454', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '11.973', 'FRAGCOUNT': '35.000'} [2023-02-24 21:14:31,924][213382] DAMAGECOUNT value on done: 464665.0 [2023-02-24 21:14:31,925][213382] Sum rewards: 46.676, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.046', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'WEAPON5': '0.200', 'weapon4': '0.380', 'weapon2': '0.742', 'WEAPON3': '1.000', 'HITCOUNT': '2.310', 'weapon3': '2.496', 'DAMAGECOUNT': '11.673', 'FRAGCOUNT': '40.000'} [2023-02-24 21:14:31,972][213369] DAMAGECOUNT value on done: 463515.0 [2023-02-24 21:14:31,973][213369] Sum rewards: 39.503, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.460', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.046', 'AMMO3': '0.157', 'AMMO4': '0.231', 'weapon2': '0.260', 'weapon5': '0.398', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon4': '0.832', 'WEAPON3': '0.950', 'weapon3': '2.158', 'HITCOUNT': '2.250', 'DAMAGECOUNT': '11.253', 'FRAGCOUNT': '35.000'} [2023-02-24 21:14:32,002][213368] DAMAGECOUNT value on done: 468523.0 [2023-02-24 21:14:32,002][213368] Sum rewards: 45.041, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.658', 'AMMO5': '0.012', 'AMMO2': '0.058', 'AMMO3': '0.115', 'weapon5': '0.220', 'AMMO4': '0.290', 'WEAPON5': '0.350', 'WEAPON4': '0.600', 'weapon2': '0.686', 'WEAPON3': '0.750', 'weapon4': '1.030', 'weapon3': '1.796', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '12.531', 'FRAGCOUNT': '38.000'} [2023-02-24 21:14:32,062][213384] DAMAGECOUNT value on done: 478598.0 [2023-02-24 21:14:32,062][213384] Sum rewards: 58.391, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.640', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon5': '0.046', 'WEAPON5': '0.100', 'weapon4': '0.102', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'weapon2': '0.684', 'WEAPON3': '1.000', 'weapon3': '2.794', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.217', 'FRAGCOUNT': '48.000'} [2023-02-24 21:14:32,113][213383] DAMAGECOUNT value on done: 478350.0 [2023-02-24 21:14:32,113][213383] Sum rewards: 41.746, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.785', 'ARMOR': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.121', 'AMMO4': '0.147', 'weapon5': '0.206', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '0.750', 'weapon4': '1.118', 'weapon3': '1.676', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '10.095', 'FRAGCOUNT': '37.000'} [2023-02-24 21:14:32,229][213382] DAMAGECOUNT value on done: 469874.0 [2023-02-24 21:14:32,230][213382] Sum rewards: 31.851, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.330', 'AMMO5': '0.018', 'AMMO2': '0.046', 'weapon4': '0.220', 'AMMO4': '0.229', 'AMMO3': '0.234', 'weapon5': '0.330', 'WEAPON4': '0.400', 'weapon2': '0.438', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'HITCOUNT': '2.230', 'weapon3': '2.682', 'DAMAGECOUNT': '9.954', 'FRAGCOUNT': '32.000'} [2023-02-24 21:14:32,364][213384] DAMAGECOUNT value on done: 462094.0 [2023-02-24 21:14:32,365][213384] Sum rewards: 37.430, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.575', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.037', 'weapon5': '0.114', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon4': '0.294', 'weapon2': '0.646', 'WEAPON3': '1.300', 'weapon3': '2.726', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '11.787', 'FRAGCOUNT': '34.000'} [2023-02-24 21:14:32,421][213383] DAMAGECOUNT value on done: 469865.0 [2023-02-24 21:14:32,421][213383] Sum rewards: 49.972, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.217', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.110', 'AMMO3': '0.186', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.400', 'weapon4': '0.682', 'WEAPON3': '1.100', 'weapon3': '2.488', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.726', 'FRAGCOUNT': '43.000'} [2023-02-24 21:14:32,676][213384] DAMAGECOUNT value on done: 475277.0 [2023-02-24 21:14:32,676][213384] Sum rewards: 36.761, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.835', 'AMMO5': '0.010', 'AMMO2': '0.048', 'AMMO3': '0.186', 'weapon5': '0.202', 'AMMO4': '0.241', 'weapon2': '0.260', 'WEAPON5': '0.300', 'weapon4': '0.482', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'HITCOUNT': '2.710', 'weapon3': '2.798', 'DAMAGECOUNT': '11.559', 'FRAGCOUNT': '35.000'} [2023-02-24 21:14:32,974][213384] DAMAGECOUNT value on done: 478036.0 [2023-02-24 21:14:32,975][213384] Sum rewards: 46.180, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.322', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.174', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.262', 'weapon4': '0.634', 'WEAPON3': '1.200', 'weapon3': '2.612', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.408', 'FRAGCOUNT': '40.000'} [2023-02-24 21:14:33,520][213365] Updated weights for policy 0, policy_version 34266 (0.0009) [2023-02-24 21:14:34,535][213367] Large shaping reward 2.589 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5670000000000001, 189.0), ('weapon5', 0.002)] [2023-02-24 21:14:35,243][213332] Fps is (10 sec: 13516.5, 60 sec: 13789.8, 300 sec: 13509.9). Total num frames: 140374016. Throughput: 0: 3455.6. Samples: 10082910. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:14:35,244][213332] Avg episode reward: [(0, '43.355')] [2023-02-24 21:14:36,492][213365] Updated weights for policy 0, policy_version 34276 (0.0009) [2023-02-24 21:14:39,439][213365] Updated weights for policy 0, policy_version 34286 (0.0009) [2023-02-24 21:14:40,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13523.7). Total num frames: 140443648. Throughput: 0: 3456.0. Samples: 10103644. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:14:40,243][213332] Avg episode reward: [(0, '43.355')] [2023-02-24 21:14:42,399][213365] Updated weights for policy 0, policy_version 34296 (0.0009) [2023-02-24 21:14:45,243][213332] Fps is (10 sec: 13926.7, 60 sec: 13789.9, 300 sec: 13523.7). Total num frames: 140513280. Throughput: 0: 3453.3. Samples: 10124462. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:14:45,243][213332] Avg episode reward: [(0, '43.355')] [2023-02-24 21:14:45,247][213352] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000034305_140513280.pth... [2023-02-24 21:14:45,304][213352] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000033512_137265152.pth [2023-02-24 21:14:45,384][213365] Updated weights for policy 0, policy_version 34306 (0.0009) [2023-02-24 21:14:47,889][213367] DAMAGECOUNT value on done: 472736.0 [2023-02-24 21:14:47,890][213367] Sum rewards: 43.168, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.108', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.022', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.128', 'AMMO3': '0.173', 'weapon4': '0.298', 'weapon2': '0.722', 'WEAPON3': '1.100', 'weapon3': '2.700', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.144', 'FRAGCOUNT': '36.000'} [2023-02-24 21:14:48,065][213367] DAMAGECOUNT value on done: 478946.0 [2023-02-24 21:14:48,066][213367] Sum rewards: 34.626, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.930', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon7': '0.066', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.170', 'WEAPON7': '0.200', 'weapon4': '0.308', 'weapon2': '0.396', 'WEAPON3': '1.050', 'HITCOUNT': '1.810', 'weapon3': '2.820', 'DAMAGECOUNT': '9.090', 'FRAGCOUNT': '30.000'} [2023-02-24 21:14:48,198][213367] DAMAGECOUNT value on done: 476136.0 [2023-02-24 21:14:48,198][213367] Sum rewards: 29.198, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.637', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon7': '0.074', 'AMMO3': '0.122', 'AMMO4': '0.195', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon5': '0.238', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.518', 'weapon4': '0.700', 'WEAPON3': '0.750', 'weapon3': '1.728', 'HITCOUNT': '1.790', 'DAMAGECOUNT': '7.926', 'FRAGCOUNT': '26.500'} [2023-02-24 21:14:48,357][213365] Updated weights for policy 0, policy_version 34316 (0.0009) [2023-02-24 21:14:48,373][213367] DAMAGECOUNT value on done: 482828.0 [2023-02-24 21:14:48,374][213367] Sum rewards: 50.871, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.432', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.047', 'AMMO3': '0.168', 'AMMO4': '0.233', 'weapon5': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.426', 'weapon4': '0.444', 'WEAPON3': '1.050', 'weapon3': '2.578', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.599', 'FRAGCOUNT': '45.000'} [2023-02-24 21:14:48,774][213372] DAMAGECOUNT value on done: 487596.0 [2023-02-24 21:14:48,775][213372] Sum rewards: 47.478, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.086', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO4': '0.181', 'AMMO3': '0.185', 'weapon5': '0.218', 'weapon2': '0.222', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.368', 'WEAPON3': '1.050', 'HITCOUNT': '2.500', 'weapon3': '2.948', 'DAMAGECOUNT': '12.441', 'FRAGCOUNT': '42.000'} [2023-02-24 21:14:49,037][213372] DAMAGECOUNT value on done: 471134.0 [2023-02-24 21:14:49,037][213372] Sum rewards: 23.598, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.074', 'ARMOR': '0.008', 'AMMO5': '0.031', 'AMMO2': '0.061', 'AMMO3': '0.149', 'AMMO4': '0.305', 'weapon5': '0.374', 'weapon4': '0.474', 'WEAPON4': '0.600', 'weapon2': '0.686', 'WEAPON5': '0.700', 'WEAPON3': '0.900', 'HITCOUNT': '1.630', 'weapon3': '2.132', 'DAMAGECOUNT': '7.122', 'FRAGCOUNT': '25.000'} [2023-02-24 21:14:49,061][213366] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 21:14:49,081][213372] DAMAGECOUNT value on done: 482932.0 [2023-02-24 21:14:49,081][213372] Sum rewards: 53.096, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.320', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.056', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.202', 'AMMO3': '0.255', 'WEAPON3': '1.550', 'HITCOUNT': '3.010', 'weapon3': '3.520', 'DAMAGECOUNT': '13.515', 'FRAGCOUNT': '48.000'} [2023-02-24 21:14:49,344][213372] DAMAGECOUNT value on done: 473260.0 [2023-02-24 21:14:49,344][213372] Sum rewards: 48.994, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.504', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'AMMO3': '0.204', 'weapon4': '0.284', 'weapon2': '0.630', 'WEAPON3': '1.150', 'weapon3': '2.872', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.623', 'FRAGCOUNT': '41.000'} [2023-02-24 21:14:49,631][213366] DAMAGECOUNT value on done: 470693.0 [2023-02-24 21:14:49,631][213366] Sum rewards: 34.094, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.964', 'AMMO5': '0.021', 'AMMO2': '0.049', 'AMMO3': '0.114', 'AMMO4': '0.243', 'weapon5': '0.340', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon2': '0.614', 'WEAPON3': '0.650', 'weapon4': '0.798', 'weapon3': '1.896', 'HITCOUNT': '2.140', 'DAMAGECOUNT': '8.892', 'FRAGCOUNT': '29.500'} [2023-02-24 21:14:49,929][213366] DAMAGECOUNT value on done: 481989.0 [2023-02-24 21:14:49,929][213366] Sum rewards: 37.892, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.698', 'AMMO5': '0.021', 'AMMO2': '0.038', 'weapon4': '0.120', 'weapon5': '0.154', 'AMMO4': '0.189', 'AMMO3': '0.223', 'weapon2': '0.244', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.470', 'weapon3': '3.194', 'DAMAGECOUNT': '11.238', 'FRAGCOUNT': '37.000'} [2023-02-24 21:14:49,938][213366] DAMAGECOUNT value on done: 492637.0 [2023-02-24 21:14:49,938][213366] Sum rewards: 51.828, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.995', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.139', 'WEAPON4': '0.350', 'weapon2': '0.394', 'weapon4': '0.472', 'WEAPON3': '0.850', 'weapon3': '2.914', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '12.405', 'FRAGCOUNT': '44.000'} [2023-02-24 21:14:50,239][213366] DAMAGECOUNT value on done: 479496.0 [2023-02-24 21:14:50,239][213366] Sum rewards: 46.243, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.772', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'AMMO3': '0.227', 'weapon2': '0.316', 'weapon4': '0.458', 'WEAPON3': '1.250', 'HITCOUNT': '2.830', 'weapon3': '2.970', 'DAMAGECOUNT': '12.765', 'FRAGCOUNT': '40.000'} [2023-02-24 21:14:50,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13537.6). Total num frames: 140582912. Throughput: 0: 3451.8. Samples: 10134784. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:14:50,243][213332] Avg episode reward: [(0, '43.001')] [2023-02-24 21:14:50,497][213369] DAMAGECOUNT value on done: 482082.0 [2023-02-24 21:14:50,497][213369] Sum rewards: 34.542, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.205', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.184', 'AMMO4': '0.195', 'AMMO3': '0.244', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.478', 'weapon4': '0.486', 'WEAPON3': '1.500', 'weapon3': '2.542', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '11.094', 'FRAGCOUNT': '35.000'} [2023-02-24 21:14:50,538][213368] DAMAGECOUNT value on done: 470664.0 [2023-02-24 21:14:50,539][213368] Sum rewards: 37.538, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.561', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.109', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO4': '0.184', 'WEAPON4': '0.350', 'weapon2': '0.406', 'WEAPON3': '0.800', 'weapon4': '0.904', 'weapon3': '1.902', 'HITCOUNT': '2.370', 'DAMAGECOUNT': '9.912', 'FRAGCOUNT': '32.000'} [2023-02-24 21:14:50,681][213383] DAMAGECOUNT value on done: 474329.0 [2023-02-24 21:14:50,681][213383] Sum rewards: 43.452, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.694', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.122', 'AMMO4': '0.127', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon2': '0.228', 'WEAPON4': '0.300', 'weapon4': '0.408', 'WEAPON3': '1.100', 'HITCOUNT': '2.730', 'weapon3': '3.022', 'DAMAGECOUNT': '11.676', 'FRAGCOUNT': '38.500'} [2023-02-24 21:14:50,766][213382] DAMAGECOUNT value on done: 481917.0 [2023-02-24 21:14:50,767][213382] Sum rewards: 55.430, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.074', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.066', 'AMMO4': '0.069', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.188', 'AMMO3': '0.194', 'ARMOR': '0.454', 'weapon2': '0.458', 'WEAPON3': '1.150', 'weapon3': '3.078', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.176', 'FRAGCOUNT': '47.000'} [2023-02-24 21:14:50,798][213369] DAMAGECOUNT value on done: 481218.0 [2023-02-24 21:14:50,798][213369] Sum rewards: 37.363, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.240', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'weapon4': '0.298', 'weapon2': '0.586', 'WEAPON3': '1.450', 'HITCOUNT': '2.450', 'weapon3': '2.886', 'DAMAGECOUNT': '9.846', 'FRAGCOUNT': '36.000'} [2023-02-24 21:14:50,843][213368] DAMAGECOUNT value on done: 480811.0 [2023-02-24 21:14:50,844][213368] Sum rewards: 37.395, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.120', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon5': '0.112', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'WEAPON5': '0.300', 'weapon2': '0.450', 'weapon4': '0.494', 'WEAPON3': '1.250', 'weapon3': '2.236', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '10.467', 'FRAGCOUNT': '34.000'} [2023-02-24 21:14:50,983][213383] DAMAGECOUNT value on done: 478180.0 [2023-02-24 21:14:50,983][213383] Sum rewards: 35.945, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.838', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.148', 'AMMO3': '0.154', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.326', 'weapon4': '0.672', 'WEAPON3': '0.950', 'weapon3': '2.178', 'HITCOUNT': '2.240', 'DAMAGECOUNT': '10.248', 'FRAGCOUNT': '30.000'} [2023-02-24 21:14:51,066][213382] DAMAGECOUNT value on done: 482283.0 [2023-02-24 21:14:51,067][213382] Sum rewards: 54.603, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.188', 'AMMO5': '0.004', 'AMMO2': '0.019', 'weapon5': '0.026', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon2': '0.242', 'weapon4': '0.302', 'ARMOR': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '3.010', 'weapon3': '3.294', 'DAMAGECOUNT': '13.875', 'FRAGCOUNT': '45.000'} [2023-02-24 21:14:51,101][213369] DAMAGECOUNT value on done: 478928.0 [2023-02-24 21:14:51,102][213369] Sum rewards: 31.507, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '0.001', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.058', 'weapon7': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.140', 'AMMO3': '0.145', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon2': '0.452', 'weapon4': '0.516', 'WEAPON3': '0.800', 'HITCOUNT': '1.880', 'weapon3': '2.640', 'DAMAGECOUNT': '7.968', 'FRAGCOUNT': '26.000'} [2023-02-24 21:14:51,118][213368] DAMAGECOUNT value on done: 473247.0 [2023-02-24 21:14:51,119][213368] Sum rewards: 46.030, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.440', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.124', 'AMMO3': '0.143', 'AMMO4': '0.170', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON4': '0.500', 'WEAPON3': '0.850', 'weapon4': '1.162', 'weapon3': '2.056', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.119', 'FRAGCOUNT': '37.000'} [2023-02-24 21:14:51,308][213365] Updated weights for policy 0, policy_version 34326 (0.0009) [2023-02-24 21:14:51,394][213382] DAMAGECOUNT value on done: 468507.0 [2023-02-24 21:14:51,395][213382] Sum rewards: 49.378, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.010', 'AMMO5': '0.005', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'weapon5': '0.060', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'AMMO3': '0.135', 'WEAPON4': '0.200', 'weapon4': '0.226', 'weapon2': '0.550', 'WEAPON3': '0.900', 'HITCOUNT': '2.580', 'weapon3': '3.002', 'DAMAGECOUNT': '11.526', 'FRAGCOUNT': '40.000'} [2023-02-24 21:14:51,405][213369] DAMAGECOUNT value on done: 466675.0 [2023-02-24 21:14:51,405][213369] Sum rewards: 27.256, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.382', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon5': '0.128', 'AMMO3': '0.142', 'AMMO4': '0.239', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'weapon2': '0.558', 'WEAPON4': '0.600', 'WEAPON3': '0.850', 'weapon4': '1.258', 'weapon3': '1.582', 'HITCOUNT': '2.340', 'DAMAGECOUNT': '9.480', 'FRAGCOUNT': '26.000'} [2023-02-24 21:14:51,419][213368] DAMAGECOUNT value on done: 471727.0 [2023-02-24 21:14:51,420][213368] Sum rewards: 33.805, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.340', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.007', 'weapon5': '0.022', 'AMMO4': '0.037', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'weapon4': '0.302', 'weapon2': '0.902', 'WEAPON3': '1.100', 'HITCOUNT': '2.470', 'weapon3': '2.566', 'DAMAGECOUNT': '9.612', 'FRAGCOUNT': '30.000'} [2023-02-24 21:14:51,478][213384] DAMAGECOUNT value on done: 482020.0 [2023-02-24 21:14:51,479][213384] Sum rewards: 34.296, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.814', 'AMMO5': '0.012', 'AMMO2': '0.051', 'AMMO3': '0.169', 'weapon5': '0.246', 'AMMO4': '0.254', 'WEAPON5': '0.400', 'weapon2': '0.468', 'WEAPON4': '0.600', 'weapon4': '0.606', 'WEAPON3': '1.000', 'HITCOUNT': '2.170', 'weapon3': '2.368', 'DAMAGECOUNT': '10.266', 'FRAGCOUNT': '35.000'} [2023-02-24 21:14:51,605][213383] DAMAGECOUNT value on done: 482668.0 [2023-02-24 21:14:51,606][213383] Sum rewards: 43.231, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.635', 'ARMOR': '0.008', 'AMMO5': '0.024', 'AMMO2': '0.045', 'AMMO3': '0.187', 'AMMO4': '0.227', 'weapon2': '0.242', 'weapon5': '0.358', 'weapon4': '0.628', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.402', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.954', 'FRAGCOUNT': '40.000'} [2023-02-24 21:14:51,691][213382] DAMAGECOUNT value on done: 474008.0 [2023-02-24 21:14:51,692][213382] Sum rewards: 45.386, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.625', 'weapon7': '0.002', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.041', 'weapon5': '0.052', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.205', 'weapon2': '0.292', 'WEAPON4': '0.600', 'weapon4': '0.690', 'WEAPON3': '1.200', 'weapon3': '2.722', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.402', 'FRAGCOUNT': '42.000'} [2023-02-24 21:14:51,785][213384] DAMAGECOUNT value on done: 466372.0 [2023-02-24 21:14:51,785][213384] Sum rewards: 45.579, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.977', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'weapon4': '0.216', 'weapon2': '0.512', 'WEAPON3': '1.150', 'HITCOUNT': '2.660', 'weapon3': '2.916', 'DAMAGECOUNT': '12.828', 'FRAGCOUNT': '39.000'} [2023-02-24 21:14:51,902][213383] DAMAGECOUNT value on done: 474441.0 [2023-02-24 21:14:51,902][213383] Sum rewards: 47.770, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.438', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.031', 'AMMO4': '0.152', 'AMMO3': '0.202', 'weapon2': '0.296', 'weapon5': '0.326', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '1.084', 'WEAPON3': '1.150', 'weapon3': '1.946', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.428', 'FRAGCOUNT': '44.000'} [2023-02-24 21:14:52,094][213384] DAMAGECOUNT value on done: 479224.0 [2023-02-24 21:14:52,094][213384] Sum rewards: 36.223, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-1.982', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.054', 'weapon2': '0.232', 'weapon5': '0.258', 'AMMO3': '0.261', 'AMMO4': '0.272', 'weapon4': '0.272', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '2.340', 'weapon3': '2.840', 'DAMAGECOUNT': '11.754', 'FRAGCOUNT': '37.000'} [2023-02-24 21:14:52,414][213384] DAMAGECOUNT value on done: 482604.0 [2023-02-24 21:14:52,414][213384] Sum rewards: 48.499, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.552', 'AMMO5': '0.010', 'AMMO2': '0.010', 'weapon4': '0.014', 'AMMO4': '0.048', 'weapon5': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.252', 'AMMO3': '0.265', 'WEAPON3': '1.600', 'HITCOUNT': '3.160', 'weapon3': '3.484', 'DAMAGECOUNT': '13.704', 'FRAGCOUNT': '44.000'} [2023-02-24 21:14:54,258][213365] Updated weights for policy 0, policy_version 34336 (0.0009) [2023-02-24 21:14:55,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13551.5). Total num frames: 140652544. Throughput: 0: 3453.0. Samples: 10155466. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:14:55,243][213332] Avg episode reward: [(0, '42.569')] [2023-02-24 21:14:57,197][213365] Updated weights for policy 0, policy_version 34346 (0.0009) [2023-02-24 21:15:00,158][213365] Updated weights for policy 0, policy_version 34356 (0.0009) [2023-02-24 21:15:00,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13858.2, 300 sec: 13551.5). Total num frames: 140722176. Throughput: 0: 3454.5. Samples: 10176280. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:15:00,243][213332] Avg episode reward: [(0, '42.569')] [2023-02-24 21:15:00,493][213367] Large shaping reward 2.504 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.453, 151.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 21:15:03,138][213365] Updated weights for policy 0, policy_version 34366 (0.0009) [2023-02-24 21:15:05,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13565.4). Total num frames: 140791808. Throughput: 0: 3454.2. Samples: 10186662. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:15:05,243][213332] Avg episode reward: [(0, '42.569')] [2023-02-24 21:15:06,102][213365] Updated weights for policy 0, policy_version 34376 (0.0009) [2023-02-24 21:15:07,310][213367] DAMAGECOUNT value on done: 476458.0 [2023-02-24 21:15:07,311][213367] Sum rewards: 40.018, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.252', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon5': '0.114', 'AMMO3': '0.197', 'AMMO4': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.456', 'weapon2': '0.560', 'WEAPON3': '1.100', 'weapon3': '2.594', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '11.166', 'FRAGCOUNT': '37.000'} [2023-02-24 21:15:07,467][213367] DAMAGECOUNT value on done: 482719.0 [2023-02-24 21:15:07,467][213367] Sum rewards: 40.905, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.254', 'AMMO5': '0.021', 'AMMO2': '0.052', 'AMMO3': '0.167', 'weapon4': '0.176', 'weapon5': '0.184', 'AMMO4': '0.258', 'weapon2': '0.422', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'HITCOUNT': '2.580', 'weapon3': '2.980', 'DAMAGECOUNT': '11.319', 'FRAGCOUNT': '37.000'} [2023-02-24 21:15:07,619][213367] DAMAGECOUNT value on done: 479403.0 [2023-02-24 21:15:07,619][213367] Sum rewards: 34.439, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.530', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.044', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'weapon4': '0.180', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'weapon2': '0.610', 'WEAPON3': '1.300', 'HITCOUNT': '2.160', 'weapon3': '2.982', 'DAMAGECOUNT': '9.801', 'FRAGCOUNT': '35.000'} [2023-02-24 21:15:07,783][213367] DAMAGECOUNT value on done: 487088.0 [2023-02-24 21:15:07,783][213367] Sum rewards: 41.726, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.035', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'weapon2': '0.184', 'AMMO3': '0.196', 'weapon4': '0.230', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '2.700', 'weapon3': '3.268', 'DAMAGECOUNT': '12.780', 'FRAGCOUNT': '37.000'} [2023-02-24 21:15:08,244][213372] DAMAGECOUNT value on done: 492000.0 [2023-02-24 21:15:08,244][213372] Sum rewards: 47.807, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.060', 'AMMO5': '0.005', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO4': '0.154', 'weapon4': '0.246', 'AMMO3': '0.257', 'WEAPON4': '0.350', 'weapon2': '0.446', 'WEAPON3': '1.500', 'HITCOUNT': '3.030', 'weapon3': '3.036', 'DAMAGECOUNT': '13.212', 'FRAGCOUNT': '45.000'} [2023-02-24 21:15:08,503][213372] DAMAGECOUNT value on done: 475266.0 [2023-02-24 21:15:08,504][213372] Sum rewards: 47.772, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.121', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.128', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.260', 'WEAPON4': '0.350', 'weapon4': '0.566', 'WEAPON3': '1.250', 'weapon3': '2.808', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.396', 'FRAGCOUNT': '43.000'} [2023-02-24 21:15:08,551][213372] DAMAGECOUNT value on done: 487069.0 [2023-02-24 21:15:08,551][213372] Sum rewards: 43.531, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.204', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.136', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'AMMO4': '0.223', 'weapon2': '0.402', 'WEAPON4': '0.450', 'weapon4': '0.742', 'WEAPON3': '1.200', 'weapon3': '2.514', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.411', 'FRAGCOUNT': '40.000'} [2023-02-24 21:15:08,822][213372] DAMAGECOUNT value on done: 477776.0 [2023-02-24 21:15:08,822][213372] Sum rewards: 44.088, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.421', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO4': '0.191', 'weapon2': '0.194', 'weapon5': '0.250', 'AMMO3': '0.270', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.692', 'WEAPON3': '1.500', 'weapon3': '2.542', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.548', 'FRAGCOUNT': '41.000'} [2023-02-24 21:15:09,044][213366] DAMAGECOUNT value on done: 473492.0 [2023-02-24 21:15:09,045][213366] Sum rewards: 33.638, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.030', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.050', 'AMMO4': '0.089', 'AMMO3': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.118', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.604', 'WEAPON3': '0.650', 'weapon4': '0.754', 'HITCOUNT': '2.000', 'weapon3': '2.080', 'DAMAGECOUNT': '8.397', 'FRAGCOUNT': '28.000'} [2023-02-24 21:15:09,091][213365] Updated weights for policy 0, policy_version 34386 (0.0008) [2023-02-24 21:15:09,337][213366] DAMAGECOUNT value on done: 496095.0 [2023-02-24 21:15:09,338][213366] Sum rewards: 37.141, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.774', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO3': '0.168', 'weapon5': '0.176', 'AMMO4': '0.182', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.532', 'weapon4': '0.656', 'WEAPON3': '1.100', 'weapon3': '2.192', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '10.374', 'FRAGCOUNT': '34.000'} [2023-02-24 21:15:09,351][213366] DAMAGECOUNT value on done: 486140.0 [2023-02-24 21:15:09,351][213366] Sum rewards: 43.201, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.296', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.144', 'AMMO3': '0.194', 'weapon5': '0.290', 'WEAPON5': '0.350', 'weapon2': '0.416', 'WEAPON4': '0.450', 'weapon4': '0.934', 'WEAPON3': '1.050', 'weapon3': '2.082', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.453', 'FRAGCOUNT': '39.000'} [2023-02-24 21:15:09,634][213366] DAMAGECOUNT value on done: 483904.0 [2023-02-24 21:15:09,635][213366] Sum rewards: 50.508, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.204', 'AMMO5': '0.024', 'AMMO2': '0.035', 'AMMO3': '0.132', 'AMMO4': '0.173', 'weapon5': '0.174', 'WEAPON4': '0.450', 'weapon2': '0.536', 'WEAPON5': '0.550', 'weapon4': '0.564', 'WEAPON3': '0.800', 'weapon3': '2.380', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '13.224', 'FRAGCOUNT': '42.000'} [2023-02-24 21:15:09,984][213369] DAMAGECOUNT value on done: 485684.0 [2023-02-24 21:15:09,984][213369] Sum rewards: 40.336, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.326', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.064', 'AMMO4': '0.082', 'weapon5': '0.106', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '1.000', 'weapon2': '1.244', 'HITCOUNT': '2.340', 'weapon3': '2.364', 'DAMAGECOUNT': '10.806', 'FRAGCOUNT': '35.000'} [2023-02-24 21:15:10,054][213368] DAMAGECOUNT value on done: 474536.0 [2023-02-24 21:15:10,054][213368] Sum rewards: 40.848, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.224', 'AMMO5': '0.024', 'AMMO2': '0.043', 'AMMO3': '0.200', 'AMMO4': '0.215', 'weapon5': '0.262', 'weapon2': '0.264', 'weapon4': '0.384', 'WEAPON4': '0.450', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'HITCOUNT': '2.270', 'weapon3': '2.744', 'DAMAGECOUNT': '11.616', 'FRAGCOUNT': '38.000'} [2023-02-24 21:15:10,147][213383] DAMAGECOUNT value on done: 478351.0 [2023-02-24 21:15:10,147][213383] Sum rewards: 48.845, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.670', 'AMMO2': '0.003', 'AMMO4': '0.014', 'WEAPON4': '0.100', 'AMMO3': '0.155', 'weapon4': '0.220', 'ARMOR': '0.451', 'weapon2': '0.702', 'WEAPON3': '0.900', 'weapon3': '2.824', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '12.066', 'FRAGCOUNT': '41.000'} [2023-02-24 21:15:10,243][213332] Fps is (10 sec: 13516.7, 60 sec: 13789.9, 300 sec: 13551.5). Total num frames: 140857344. Throughput: 0: 3453.0. Samples: 10207304. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:15:10,243][213332] Avg episode reward: [(0, '41.980')] [2023-02-24 21:15:10,256][213382] DAMAGECOUNT value on done: 486319.0 [2023-02-24 21:15:10,256][213382] Sum rewards: 47.514, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.142', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.028', 'weapon5': '0.132', 'AMMO4': '0.138', 'weapon2': '0.184', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.734', 'WEAPON3': '1.250', 'weapon3': '2.660', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.206', 'FRAGCOUNT': '42.000'} [2023-02-24 21:15:10,292][213369] DAMAGECOUNT value on done: 485984.0 [2023-02-24 21:15:10,293][213369] Sum rewards: 53.075, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.464', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.239', 'weapon2': '0.288', 'WEAPON3': '1.500', 'HITCOUNT': '3.080', 'weapon3': '3.478', 'DAMAGECOUNT': '14.298', 'FRAGCOUNT': '46.000'} [2023-02-24 21:15:10,346][213368] DAMAGECOUNT value on done: 484708.0 [2023-02-24 21:15:10,346][213368] Sum rewards: 43.544, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.370', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.052', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'weapon4': '0.278', 'weapon2': '0.410', 'WEAPON3': '1.150', 'HITCOUNT': '2.640', 'weapon3': '3.050', 'DAMAGECOUNT': '11.691', 'FRAGCOUNT': '37.000'} [2023-02-24 21:15:10,453][213383] DAMAGECOUNT value on done: 481484.0 [2023-02-24 21:15:10,454][213383] Sum rewards: 34.340, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.984', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.048', 'weapon7': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.126', 'AMMO3': '0.147', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.450', 'weapon4': '0.730', 'weapon2': '0.788', 'WEAPON3': '0.900', 'weapon3': '2.180', 'HITCOUNT': '2.370', 'DAMAGECOUNT': '9.912', 'FRAGCOUNT': '30.000'} [2023-02-24 21:15:10,552][213382] DAMAGECOUNT value on done: 484974.0 [2023-02-24 21:15:10,553][213382] Sum rewards: 31.289, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.200', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO3': '0.112', 'AMMO4': '0.143', 'weapon5': '0.164', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.416', 'WEAPON3': '0.750', 'weapon2': '0.860', 'HITCOUNT': '1.810', 'weapon3': '2.174', 'DAMAGECOUNT': '8.073', 'FRAGCOUNT': '28.000'} [2023-02-24 21:15:10,598][213369] DAMAGECOUNT value on done: 482203.0 [2023-02-24 21:15:10,599][213369] Sum rewards: 35.550, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.028', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.150', 'AMMO3': '0.168', 'WEAPON4': '0.250', 'weapon2': '0.274', 'weapon4': '0.422', 'WEAPON3': '0.950', 'HITCOUNT': '2.360', 'weapon3': '3.050', 'DAMAGECOUNT': '9.825', 'FRAGCOUNT': '31.000'} [2023-02-24 21:15:10,617][213368] DAMAGECOUNT value on done: 477393.0 [2023-02-24 21:15:10,618][213368] Sum rewards: 43.561, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.645', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.020', 'AMMO4': '0.067', 'weapon4': '0.110', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon2': '0.204', 'AMMO3': '0.223', 'WEAPON3': '1.300', 'HITCOUNT': '2.800', 'weapon3': '3.474', 'DAMAGECOUNT': '12.438', 'FRAGCOUNT': '38.500'} [2023-02-24 21:15:10,858][213382] DAMAGECOUNT value on done: 472491.0 [2023-02-24 21:15:10,858][213382] Sum rewards: 51.049, reward structure: {'DEATHCOUNT': '-13.500', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'WEAPON4': '0.250', 'HEALTH': '0.359', 'weapon2': '0.410', 'weapon4': '0.514', 'WEAPON3': '0.900', 'weapon3': '2.674', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '11.952', 'FRAGCOUNT': '44.000'} [2023-02-24 21:15:10,901][213369] DAMAGECOUNT value on done: 471021.0 [2023-02-24 21:15:10,902][213369] Sum rewards: 55.877, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.460', 'AMMO5': '0.008', 'AMMO2': '0.053', 'weapon5': '0.122', 'AMMO3': '0.151', 'WEAPON5': '0.250', 'AMMO4': '0.263', 'WEAPON4': '0.350', 'weapon4': '0.370', 'weapon2': '0.620', 'WEAPON3': '1.000', 'weapon3': '2.642', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '13.038', 'FRAGCOUNT': '48.000'} [2023-02-24 21:15:10,924][213368] DAMAGECOUNT value on done: 474521.0 [2023-02-24 21:15:10,924][213368] Sum rewards: 37.054, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.806', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.020', 'AMMO4': '0.102', 'AMMO3': '0.126', 'weapon5': '0.176', 'weapon4': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'weapon2': '0.580', 'WEAPON3': '0.750', 'HITCOUNT': '2.010', 'weapon3': '2.638', 'DAMAGECOUNT': '8.382', 'FRAGCOUNT': '32.000'} [2023-02-24 21:15:10,956][213384] DAMAGECOUNT value on done: 486858.0 [2023-02-24 21:15:10,956][213384] Sum rewards: 51.530, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.712', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO4': '0.164', 'weapon2': '0.182', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'weapon5': '0.308', 'weapon4': '0.374', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.790', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.376', 'FRAGCOUNT': '45.000'} [2023-02-24 21:15:11,077][213383] DAMAGECOUNT value on done: 486462.0 [2023-02-24 21:15:11,078][213383] Sum rewards: 37.326, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.772', 'ARMOR': '0.009', 'AMMO5': '0.017', 'AMMO2': '0.063', 'AMMO3': '0.187', 'AMMO4': '0.315', 'weapon5': '0.362', 'weapon2': '0.406', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon4': '0.784', 'WEAPON3': '1.150', 'weapon3': '1.962', 'HITCOUNT': '2.310', 'DAMAGECOUNT': '11.382', 'FRAGCOUNT': '35.000'} [2023-02-24 21:15:11,163][213382] DAMAGECOUNT value on done: 478614.0 [2023-02-24 21:15:11,164][213382] Sum rewards: 50.919, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.366', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.072', 'weapon5': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'weapon4': '0.438', 'weapon2': '0.496', 'WEAPON3': '1.450', 'weapon3': '2.728', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.638', 'FRAGCOUNT': '47.000'} [2023-02-24 21:15:11,255][213384] DAMAGECOUNT value on done: 470862.0 [2023-02-24 21:15:11,256][213384] Sum rewards: 49.299, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.222', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.070', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon4': '0.232', 'WEAPON4': '0.350', 'weapon2': '0.460', 'WEAPON3': '1.250', 'HITCOUNT': '2.910', 'weapon3': '3.012', 'DAMAGECOUNT': '13.470', 'FRAGCOUNT': '46.000'} [2023-02-24 21:15:11,381][213383] DAMAGECOUNT value on done: 478383.0 [2023-02-24 21:15:11,382][213383] Sum rewards: 46.597, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.442', 'ARMOR': '0.009', 'AMMO5': '0.020', 'AMMO2': '0.058', 'AMMO3': '0.148', 'weapon5': '0.266', 'AMMO4': '0.288', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon2': '0.462', 'weapon4': '0.566', 'WEAPON3': '0.950', 'weapon3': '2.326', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '11.826', 'FRAGCOUNT': '41.000'} [2023-02-24 21:15:11,564][213384] DAMAGECOUNT value on done: 482135.0 [2023-02-24 21:15:11,565][213384] Sum rewards: 28.912, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.390', 'AMMO5': '0.017', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.136', 'weapon5': '0.170', 'WEAPON4': '0.300', 'weapon4': '0.342', 'weapon2': '0.408', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'HITCOUNT': '2.110', 'weapon3': '2.874', 'DAMAGECOUNT': '8.733', 'FRAGCOUNT': '25.000'} [2023-02-24 21:15:11,867][213384] DAMAGECOUNT value on done: 486192.0 [2023-02-24 21:15:11,867][213384] Sum rewards: 39.092, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.845', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.122', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.260', 'weapon4': '0.764', 'WEAPON3': '0.900', 'weapon3': '2.618', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '10.764', 'FRAGCOUNT': '32.500'} [2023-02-24 21:15:12,036][213365] Updated weights for policy 0, policy_version 34396 (0.0009) [2023-02-24 21:15:15,000][213365] Updated weights for policy 0, policy_version 34406 (0.0009) [2023-02-24 21:15:15,243][213332] Fps is (10 sec: 13516.6, 60 sec: 13789.9, 300 sec: 13565.4). Total num frames: 140926976. Throughput: 0: 3454.5. Samples: 10228074. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:15:15,244][213332] Avg episode reward: [(0, '41.887')] [2023-02-24 21:15:17,981][213365] Updated weights for policy 0, policy_version 34416 (0.0009) [2023-02-24 21:15:20,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13565.4). Total num frames: 140996608. Throughput: 0: 3455.1. Samples: 10238390. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:15:20,243][213332] Avg episode reward: [(0, '41.887')] [2023-02-24 21:15:20,960][213365] Updated weights for policy 0, policy_version 34426 (0.0009) [2023-02-24 21:15:23,934][213365] Updated weights for policy 0, policy_version 34436 (0.0009) [2023-02-24 21:15:25,243][213332] Fps is (10 sec: 13926.6, 60 sec: 13789.9, 300 sec: 13579.3). Total num frames: 141066240. Throughput: 0: 3455.4. Samples: 10259136. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:15:25,243][213332] Avg episode reward: [(0, '41.887')] [2023-02-24 21:15:26,408][213372] Large shaping reward 2.578 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.054, -18.0), ('weapon5', 0.002)] [2023-02-24 21:15:26,509][213366] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 21:15:26,774][213367] DAMAGECOUNT value on done: 480424.0 [2023-02-24 21:15:26,775][213367] Sum rewards: 45.343, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.458', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.090', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'weapon2': '0.152', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon4': '0.394', 'WEAPON3': '1.200', 'HITCOUNT': '2.730', 'weapon3': '3.154', 'DAMAGECOUNT': '11.898', 'FRAGCOUNT': '40.000'} [2023-02-24 21:15:26,885][213365] Updated weights for policy 0, policy_version 34446 (0.0009) [2023-02-24 21:15:26,952][213367] DAMAGECOUNT value on done: 486860.0 [2023-02-24 21:15:26,952][213367] Sum rewards: 45.429, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.056', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.134', 'AMMO3': '0.146', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.264', 'weapon2': '0.654', 'WEAPON3': '0.900', 'weapon3': '2.700', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.423', 'FRAGCOUNT': '37.000'} [2023-02-24 21:15:27,085][213367] DAMAGECOUNT value on done: 483665.0 [2023-02-24 21:15:27,085][213367] Sum rewards: 46.057, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.528', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon5': '0.162', 'weapon4': '0.226', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.266', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.760', 'weapon3': '3.030', 'DAMAGECOUNT': '12.786', 'FRAGCOUNT': '42.000'} [2023-02-24 21:15:27,264][213367] DAMAGECOUNT value on done: 491151.0 [2023-02-24 21:15:27,265][213367] Sum rewards: 43.562, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.614', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.045', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.202', 'weapon2': '0.214', 'AMMO4': '0.223', 'WEAPON4': '0.500', 'weapon4': '0.688', 'WEAPON3': '1.150', 'HITCOUNT': '2.690', 'weapon3': '2.718', 'DAMAGECOUNT': '12.189', 'FRAGCOUNT': '39.000'} [2023-02-24 21:15:27,652][213372] DAMAGECOUNT value on done: 495324.0 [2023-02-24 21:15:27,653][213372] Sum rewards: 24.809, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-4.008', 'AMMO5': '0.022', 'AMMO2': '0.054', 'weapon4': '0.182', 'AMMO4': '0.271', 'AMMO3': '0.288', 'weapon5': '0.296', 'weapon2': '0.352', 'WEAPON4': '0.450', 'WEAPON5': '0.600', 'WEAPON3': '1.700', 'HITCOUNT': '2.290', 'weapon3': '2.840', 'DAMAGECOUNT': '9.972', 'FRAGCOUNT': '29.000'} [2023-02-24 21:15:27,950][213372] DAMAGECOUNT value on done: 479638.0 [2023-02-24 21:15:27,951][213372] Sum rewards: 48.424, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.345', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.132', 'AMMO3': '0.188', 'weapon2': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.562', 'WEAPON3': '1.200', 'HITCOUNT': '2.640', 'weapon3': '2.768', 'DAMAGECOUNT': '13.116', 'FRAGCOUNT': '43.000'} [2023-02-24 21:15:27,960][213372] DAMAGECOUNT value on done: 491613.0 [2023-02-24 21:15:27,961][213372] Sum rewards: 51.447, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.534', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.122', 'AMMO3': '0.209', 'weapon2': '0.644', 'WEAPON3': '1.350', 'weapon3': '2.920', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.578', 'FRAGCOUNT': '45.000'} [2023-02-24 21:15:28,253][213372] DAMAGECOUNT value on done: 482263.0 [2023-02-24 21:15:28,254][213372] Sum rewards: 47.618, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.448', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon4': '0.054', 'AMMO4': '0.071', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'weapon2': '0.366', 'WEAPON3': '1.150', 'HITCOUNT': '2.920', 'weapon3': '3.336', 'DAMAGECOUNT': '13.461', 'FRAGCOUNT': '40.000'} [2023-02-24 21:15:28,506][213366] DAMAGECOUNT value on done: 477058.0 [2023-02-24 21:15:28,507][213366] Sum rewards: 35.719, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.100', 'AMMO5': '0.016', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'weapon2': '0.194', 'weapon4': '0.394', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.250', 'weapon3': '2.930', 'DAMAGECOUNT': '10.698', 'FRAGCOUNT': '31.000'} [2023-02-24 21:15:28,807][213366] DAMAGECOUNT value on done: 499784.0 [2023-02-24 21:15:28,807][213366] Sum rewards: 34.341, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.724', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.044', 'weapon2': '0.174', 'AMMO3': '0.201', 'AMMO4': '0.222', 'WEAPON4': '0.350', 'weapon4': '0.498', 'weapon5': '0.512', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'HITCOUNT': '2.300', 'weapon3': '2.418', 'DAMAGECOUNT': '11.067', 'FRAGCOUNT': '31.000'} [2023-02-24 21:15:28,838][213366] DAMAGECOUNT value on done: 490485.0 [2023-02-24 21:15:28,838][213366] Sum rewards: 47.317, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.178', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.152', 'AMMO4': '0.171', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.480', 'weapon4': '0.536', 'WEAPON3': '1.200', 'weapon3': '2.518', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.035', 'FRAGCOUNT': '44.000'} [2023-02-24 21:15:29,138][213366] DAMAGECOUNT value on done: 487655.0 [2023-02-24 21:15:29,138][213366] Sum rewards: 32.222, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.786', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.152', 'AMMO3': '0.188', 'weapon5': '0.206', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.414', 'weapon4': '0.512', 'WEAPON3': '1.200', 'HITCOUNT': '2.440', 'weapon3': '2.448', 'DAMAGECOUNT': '11.253', 'FRAGCOUNT': '29.000'} [2023-02-24 21:15:29,443][213369] DAMAGECOUNT value on done: 488830.0 [2023-02-24 21:15:29,444][213369] Sum rewards: 35.149, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.900', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO4': '0.141', 'AMMO3': '0.183', 'weapon5': '0.184', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.450', 'weapon4': '0.490', 'WEAPON3': '1.050', 'HITCOUNT': '2.320', 'weapon3': '2.496', 'DAMAGECOUNT': '9.438', 'FRAGCOUNT': '33.000'} [2023-02-24 21:15:29,512][213368] DAMAGECOUNT value on done: 478093.0 [2023-02-24 21:15:29,513][213368] Sum rewards: 40.486, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.790', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.132', 'weapon4': '0.184', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.468', 'WEAPON3': '1.450', 'HITCOUNT': '2.630', 'weapon3': '2.978', 'DAMAGECOUNT': '10.671', 'FRAGCOUNT': '39.000'} [2023-02-24 21:15:29,601][213383] DAMAGECOUNT value on done: 482593.0 [2023-02-24 21:15:29,602][213383] Sum rewards: 51.004, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.342', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'AMMO3': '0.154', 'weapon4': '0.276', 'weapon2': '0.298', 'WEAPON3': '1.000', 'HITCOUNT': '2.920', 'weapon3': '3.098', 'DAMAGECOUNT': '12.726', 'FRAGCOUNT': '42.000'} [2023-02-24 21:15:29,742][213382] DAMAGECOUNT value on done: 489170.0 [2023-02-24 21:15:29,742][213382] Sum rewards: 29.097, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.265', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'weapon2': '0.276', 'weapon4': '0.386', 'weapon5': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.060', 'weapon3': '2.420', 'DAMAGECOUNT': '8.553', 'FRAGCOUNT': '27.000'} [2023-02-24 21:15:29,749][213369] DAMAGECOUNT value on done: 490724.0 [2023-02-24 21:15:29,750][213369] Sum rewards: 51.682, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.200', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.026', 'weapon4': '0.046', 'WEAPON4': '0.100', 'weapon5': '0.126', 'AMMO3': '0.244', 'WEAPON5': '0.300', 'weapon2': '0.468', 'WEAPON3': '1.550', 'HITCOUNT': '3.120', 'weapon3': '3.132', 'DAMAGECOUNT': '14.004', 'FRAGCOUNT': '46.000'} [2023-02-24 21:15:29,838][213368] DAMAGECOUNT value on done: 488527.0 [2023-02-24 21:15:29,839][213368] Sum rewards: 41.267, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.576', 'AMMO5': '0.019', 'AMMO2': '0.049', 'AMMO3': '0.162', 'AMMO4': '0.246', 'weapon2': '0.256', 'weapon5': '0.424', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.700', 'WEAPON3': '1.050', 'weapon3': '2.360', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '11.457', 'FRAGCOUNT': '37.000'} [2023-02-24 21:15:29,867][213365] Updated weights for policy 0, policy_version 34456 (0.0009) [2023-02-24 21:15:29,912][213383] DAMAGECOUNT value on done: 485535.0 [2023-02-24 21:15:29,912][213383] Sum rewards: 39.980, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.632', 'AMMO5': '0.017', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon2': '0.188', 'AMMO3': '0.229', 'weapon5': '0.242', 'weapon4': '0.318', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'HITCOUNT': '2.780', 'weapon3': '2.960', 'DAMAGECOUNT': '12.153', 'FRAGCOUNT': '37.000'} [2023-02-24 21:15:30,047][213382] DAMAGECOUNT value on done: 488514.0 [2023-02-24 21:15:30,047][213382] Sum rewards: 41.024, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.361', 'AMMO5': '0.017', 'AMMO2': '0.040', 'AMMO3': '0.168', 'AMMO4': '0.201', 'weapon5': '0.310', 'weapon4': '0.322', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.472', 'WEAPON3': '1.000', 'HITCOUNT': '2.320', 'weapon3': '2.564', 'DAMAGECOUNT': '10.620', 'FRAGCOUNT': '37.000'} [2023-02-24 21:15:30,056][213369] DAMAGECOUNT value on done: 485765.0 [2023-02-24 21:15:30,056][213369] Sum rewards: 39.585, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.734', 'AMMO5': '0.017', 'AMMO2': '0.045', 'AMMO3': '0.112', 'AMMO4': '0.224', 'weapon5': '0.264', 'weapon2': '0.318', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'weapon4': '0.944', 'weapon3': '1.918', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '10.686', 'FRAGCOUNT': '33.000'} [2023-02-24 21:15:30,099][213368] DAMAGECOUNT value on done: 481243.0 [2023-02-24 21:15:30,100][213368] Sum rewards: 45.434, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.976', 'AMMO2': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.022', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon4': '0.270', 'weapon2': '0.646', 'WEAPON3': '1.100', 'HITCOUNT': '2.720', 'weapon3': '2.746', 'DAMAGECOUNT': '11.550', 'FRAGCOUNT': '39.000'} [2023-02-24 21:15:30,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13579.3). Total num frames: 141135872. Throughput: 0: 3451.2. Samples: 10279764. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:15:30,243][213332] Avg episode reward: [(0, '42.035')] [2023-02-24 21:15:30,347][213382] DAMAGECOUNT value on done: 475541.0 [2023-02-24 21:15:30,347][213382] Sum rewards: 30.969, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.048', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.022', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'weapon2': '0.168', 'WEAPON4': '0.300', 'AMMO3': '0.313', 'weapon4': '0.324', 'WEAPON3': '1.750', 'HITCOUNT': '2.240', 'weapon3': '3.240', 'DAMAGECOUNT': '9.150', 'FRAGCOUNT': '34.000'} [2023-02-24 21:15:30,354][213369] DAMAGECOUNT value on done: 475230.0 [2023-02-24 21:15:30,354][213369] Sum rewards: 46.665, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.610', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.064', 'AMMO4': '0.073', 'weapon4': '0.142', 'AMMO3': '0.206', 'weapon2': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.130', 'weapon3': '3.266', 'DAMAGECOUNT': '12.627', 'FRAGCOUNT': '40.000'} [2023-02-24 21:15:30,401][213368] DAMAGECOUNT value on done: 478782.0 [2023-02-24 21:15:30,401][213368] Sum rewards: 48.895, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.264', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.092', 'weapon4': '0.128', 'WEAPON4': '0.150', 'AMMO4': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.312', 'WEAPON3': '1.300', 'HITCOUNT': '2.790', 'weapon3': '3.242', 'DAMAGECOUNT': '12.783', 'FRAGCOUNT': '43.000'} [2023-02-24 21:15:30,467][213384] DAMAGECOUNT value on done: 491214.0 [2023-02-24 21:15:30,467][213384] Sum rewards: 42.219, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.480', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.122', 'weapon2': '0.206', 'AMMO3': '0.227', 'AMMO4': '0.235', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.462', 'WEAPON3': '1.450', 'weapon3': '2.958', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.068', 'FRAGCOUNT': '39.000'} [2023-02-24 21:15:30,524][213383] DAMAGECOUNT value on done: 490386.0 [2023-02-24 21:15:30,524][213383] Sum rewards: 38.917, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.152', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.070', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'weapon2': '0.218', 'WEAPON4': '0.400', 'weapon4': '0.558', 'WEAPON3': '1.150', 'HITCOUNT': '2.750', 'weapon3': '2.774', 'DAMAGECOUNT': '11.772', 'FRAGCOUNT': '35.000'} [2023-02-24 21:15:30,646][213382] DAMAGECOUNT value on done: 482701.0 [2023-02-24 21:15:30,646][213382] Sum rewards: 39.338, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.704', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.110', 'AMMO4': '0.176', 'AMMO3': '0.249', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.462', 'weapon2': '0.472', 'WEAPON3': '1.500', 'weapon3': '2.658', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.261', 'FRAGCOUNT': '38.000'} [2023-02-24 21:15:30,767][213384] DAMAGECOUNT value on done: 475210.0 [2023-02-24 21:15:30,768][213384] Sum rewards: 48.093, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.946', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.033', 'AMMO3': '0.160', 'AMMO4': '0.168', 'weapon4': '0.268', 'weapon5': '0.280', 'weapon2': '0.396', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'HITCOUNT': '2.560', 'weapon3': '2.760', 'DAMAGECOUNT': '13.044', 'FRAGCOUNT': '42.000'} [2023-02-24 21:15:30,817][213383] DAMAGECOUNT value on done: 483304.0 [2023-02-24 21:15:30,817][213383] Sum rewards: 53.034, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.222', 'AMMO5': '0.004', 'ARMOR': '0.004', 'AMMO2': '0.021', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon2': '0.378', 'weapon4': '0.384', 'WEAPON3': '1.300', 'weapon3': '2.988', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '14.763', 'FRAGCOUNT': '46.000'} [2023-02-24 21:15:31,076][213384] DAMAGECOUNT value on done: 486103.0 [2023-02-24 21:15:31,077][213384] Sum rewards: 51.283, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.088', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.011', 'weapon5': '0.044', 'AMMO4': '0.057', 'weapon4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.124', 'weapon2': '0.778', 'WEAPON3': '0.850', 'HITCOUNT': '2.570', 'weapon3': '2.994', 'DAMAGECOUNT': '11.904', 'FRAGCOUNT': '41.000'} [2023-02-24 21:15:31,372][213384] DAMAGECOUNT value on done: 490835.0 [2023-02-24 21:15:31,373][213384] Sum rewards: 52.353, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.350', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.168', 'WEAPON4': '0.250', 'weapon5': '0.274', 'WEAPON5': '0.300', 'weapon4': '0.356', 'weapon2': '0.372', 'WEAPON3': '1.000', 'weapon3': '2.666', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.929', 'FRAGCOUNT': '43.000'} [2023-02-24 21:15:32,196][213372] Large shaping reward 2.511 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.489, 163.0), ('weapon5', 0.002)] [2023-02-24 21:15:32,801][213365] Updated weights for policy 0, policy_version 34466 (0.0009) [2023-02-24 21:15:35,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13858.2, 300 sec: 13593.2). Total num frames: 141205504. Throughput: 0: 3452.6. Samples: 10290152. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:15:35,243][213332] Avg episode reward: [(0, '42.368')] [2023-02-24 21:15:35,741][213365] Updated weights for policy 0, policy_version 34476 (0.0010) [2023-02-24 21:15:38,709][213365] Updated weights for policy 0, policy_version 34486 (0.0009) [2023-02-24 21:15:40,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13593.2). Total num frames: 141275136. Throughput: 0: 3453.0. Samples: 10310852. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:15:40,243][213332] Avg episode reward: [(0, '42.368')] [2023-02-24 21:15:41,664][213365] Updated weights for policy 0, policy_version 34496 (0.0009) [2023-02-24 21:15:44,630][213365] Updated weights for policy 0, policy_version 34506 (0.0009) [2023-02-24 21:15:45,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13607.0). Total num frames: 141344768. Throughput: 0: 3452.2. Samples: 10331628. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:15:45,243][213332] Avg episode reward: [(0, '42.368')] [2023-02-24 21:15:45,483][213383] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 21:15:46,160][213367] DAMAGECOUNT value on done: 484166.0 [2023-02-24 21:15:46,160][213367] Sum rewards: 44.205, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.016', 'AMMO5': '0.014', 'AMMO2': '0.019', 'ARMOR': '0.020', 'weapon4': '0.078', 'weapon5': '0.082', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'AMMO3': '0.245', 'WEAPON5': '0.300', 'weapon2': '0.530', 'WEAPON3': '1.450', 'HITCOUNT': '2.740', 'weapon3': '3.024', 'DAMAGECOUNT': '11.226', 'FRAGCOUNT': '41.000'} [2023-02-24 21:15:46,299][213367] DAMAGECOUNT value on done: 489942.0 [2023-02-24 21:15:46,299][213367] Sum rewards: 29.599, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.537', 'ARMOR': '0.004', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.044', 'AMMO3': '0.124', 'AMMO4': '0.220', 'weapon5': '0.342', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.554', 'WEAPON3': '0.800', 'weapon4': '0.880', 'weapon3': '1.902', 'HITCOUNT': '2.030', 'DAMAGECOUNT': '9.246', 'FRAGCOUNT': '26.000'} [2023-02-24 21:15:46,474][213367] DAMAGECOUNT value on done: 487470.0 [2023-02-24 21:15:46,474][213367] Sum rewards: 42.147, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.624', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.157', 'weapon5': '0.192', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.400', 'weapon4': '0.450', 'WEAPON3': '1.000', 'HITCOUNT': '2.410', 'weapon3': '2.680', 'DAMAGECOUNT': '11.415', 'FRAGCOUNT': '37.000'} [2023-02-24 21:15:46,599][213367] DAMAGECOUNT value on done: 495295.0 [2023-02-24 21:15:46,599][213367] Sum rewards: 40.982, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.700', 'AMMO5': '0.023', 'AMMO2': '0.061', 'AMMO3': '0.177', 'AMMO4': '0.306', 'weapon5': '0.380', 'weapon2': '0.394', 'weapon4': '0.476', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.000', 'weapon3': '2.242', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '12.432', 'FRAGCOUNT': '38.000'} [2023-02-24 21:15:47,038][213372] DAMAGECOUNT value on done: 498677.0 [2023-02-24 21:15:47,038][213372] Sum rewards: 30.907, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.600', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.048', 'AMMO4': '0.105', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.466', 'weapon2': '0.648', 'WEAPON3': '1.150', 'weapon3': '2.534', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '10.059', 'FRAGCOUNT': '28.000'} [2023-02-24 21:15:47,317][213372] DAMAGECOUNT value on done: 484105.0 [2023-02-24 21:15:47,317][213372] Sum rewards: 48.208, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.040', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.095', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon4': '0.262', 'weapon2': '0.346', 'WEAPON3': '1.350', 'HITCOUNT': '3.090', 'weapon3': '3.122', 'DAMAGECOUNT': '13.401', 'FRAGCOUNT': '43.000'} [2023-02-24 21:15:47,344][213372] DAMAGECOUNT value on done: 495471.0 [2023-02-24 21:15:47,344][213372] Sum rewards: 44.059, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.870', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.048', 'AMMO3': '0.179', 'AMMO4': '0.239', 'weapon2': '0.306', 'weapon5': '0.478', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'weapon4': '0.780', 'WEAPON3': '1.000', 'weapon3': '2.054', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '11.574', 'FRAGCOUNT': '39.000'} [2023-02-24 21:15:47,589][213365] Updated weights for policy 0, policy_version 34516 (0.0009) [2023-02-24 21:15:47,617][213372] DAMAGECOUNT value on done: 486278.0 [2023-02-24 21:15:47,618][213372] Sum rewards: 47.163, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.522', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.040', 'AMMO3': '0.179', 'AMMO4': '0.199', 'WEAPON5': '0.200', 'weapon5': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.448', 'weapon4': '0.554', 'WEAPON3': '1.150', 'HITCOUNT': '2.430', 'weapon3': '2.456', 'DAMAGECOUNT': '12.045', 'FRAGCOUNT': '42.000'} [2023-02-24 21:15:47,985][213366] DAMAGECOUNT value on done: 480214.0 [2023-02-24 21:15:47,985][213366] Sum rewards: 32.841, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.115', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.044', 'AMMO3': '0.112', 'AMMO4': '0.219', 'weapon5': '0.230', 'WEAPON5': '0.400', 'weapon2': '0.548', 'WEAPON4': '0.600', 'WEAPON3': '0.700', 'weapon4': '1.140', 'weapon3': '1.786', 'HITCOUNT': '1.940', 'DAMAGECOUNT': '9.468', 'FRAGCOUNT': '29.500'} [2023-02-24 21:15:48,288][213366] DAMAGECOUNT value on done: 504643.0 [2023-02-24 21:15:48,288][213366] Sum rewards: 52.957, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.122', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.190', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.340', 'weapon2': '0.416', 'WEAPON3': '1.350', 'weapon3': '2.732', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.562', 'FRAGCOUNT': '46.000'} [2023-02-24 21:15:48,303][213366] DAMAGECOUNT value on done: 494546.0 [2023-02-24 21:15:48,304][213366] Sum rewards: 44.406, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.620', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.014', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.214', 'weapon2': '0.216', 'AMMO3': '0.318', 'WEAPON3': '1.850', 'HITCOUNT': '2.880', 'weapon3': '3.228', 'DAMAGECOUNT': '12.183', 'FRAGCOUNT': '43.000'} [2023-02-24 21:15:48,387][213382] Large shaping reward 2.532 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.51, 170.0), ('weapon5', 0.002)] [2023-02-24 21:15:48,603][213366] DAMAGECOUNT value on done: 492536.0 [2023-02-24 21:15:48,603][213366] Sum rewards: 53.264, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.436', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.032', 'weapon5': '0.158', 'AMMO4': '0.159', 'AMMO3': '0.213', 'WEAPON5': '0.350', 'weapon4': '0.434', 'WEAPON4': '0.450', 'weapon2': '0.476', 'WEAPON3': '1.350', 'weapon3': '2.608', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.643', 'FRAGCOUNT': '48.000'} [2023-02-24 21:15:48,898][213369] DAMAGECOUNT value on done: 492808.0 [2023-02-24 21:15:48,898][213369] Sum rewards: 45.032, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.088', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.062', 'AMMO4': '0.081', 'WEAPON5': '0.100', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon4': '0.300', 'weapon2': '0.606', 'WEAPON3': '1.100', 'HITCOUNT': '2.730', 'weapon3': '2.802', 'DAMAGECOUNT': '11.934', 'FRAGCOUNT': '38.000'} [2023-02-24 21:15:49,001][213383] DAMAGECOUNT value on done: 486320.0 [2023-02-24 21:15:49,001][213383] Sum rewards: 41.057, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.062', 'ARMOR': '0.009', 'AMMO5': '0.019', 'AMMO2': '0.050', 'AMMO3': '0.162', 'weapon4': '0.192', 'AMMO4': '0.251', 'weapon5': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.452', 'WEAPON4': '0.550', 'WEAPON3': '1.000', 'HITCOUNT': '2.520', 'weapon3': '2.694', 'DAMAGECOUNT': '11.169', 'FRAGCOUNT': '38.000'} [2023-02-24 21:15:49,004][213368] DAMAGECOUNT value on done: 482078.0 [2023-02-24 21:15:49,004][213368] Sum rewards: 45.338, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.320', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon4': '0.016', 'AMMO4': '0.076', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.330', 'WEAPON3': '1.250', 'HITCOUNT': '2.800', 'weapon3': '3.356', 'DAMAGECOUNT': '11.955', 'FRAGCOUNT': '39.000'} [2023-02-24 21:15:49,169][213382] DAMAGECOUNT value on done: 493557.0 [2023-02-24 21:15:49,170][213382] Sum rewards: 41.183, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.070', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.048', 'AMMO3': '0.152', 'AMMO4': '0.241', 'weapon5': '0.268', 'weapon2': '0.592', 'WEAPON5': '0.600', 'weapon4': '0.684', 'WEAPON4': '0.700', 'WEAPON3': '0.900', 'weapon3': '2.086', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '13.161', 'FRAGCOUNT': '34.000'} [2023-02-24 21:15:49,198][213369] DAMAGECOUNT value on done: 494865.0 [2023-02-24 21:15:49,198][213369] Sum rewards: 42.832, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.584', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.046', 'AMMO3': '0.114', 'weapon5': '0.176', 'AMMO4': '0.228', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.482', 'weapon4': '0.576', 'WEAPON3': '0.750', 'weapon3': '2.328', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '12.423', 'FRAGCOUNT': '36.000'} [2023-02-24 21:15:49,302][213383] DAMAGECOUNT value on done: 488599.0 [2023-02-24 21:15:49,302][213368] DAMAGECOUNT value on done: 492188.0 [2023-02-24 21:15:49,302][213383] Sum rewards: 31.559, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.906', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO3': '0.125', 'AMMO4': '0.185', 'weapon5': '0.188', 'weapon4': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'weapon2': '1.164', 'HITCOUNT': '1.740', 'weapon3': '2.128', 'DAMAGECOUNT': '9.192', 'FRAGCOUNT': '28.000'} [2023-02-24 21:15:49,303][213368] Sum rewards: 43.226, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.950', 'AMMO5': '0.020', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.165', 'weapon2': '0.224', 'weapon5': '0.286', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon4': '0.620', 'WEAPON3': '1.050', 'HITCOUNT': '2.360', 'weapon3': '2.550', 'DAMAGECOUNT': '10.983', 'FRAGCOUNT': '40.000'} [2023-02-24 21:15:49,470][213382] DAMAGECOUNT value on done: 492497.0 [2023-02-24 21:15:49,470][213382] Sum rewards: 43.780, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.986', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.082', 'weapon5': '0.102', 'AMMO4': '0.120', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.646', 'WEAPON3': '1.300', 'HITCOUNT': '2.550', 'weapon3': '2.956', 'DAMAGECOUNT': '11.949', 'FRAGCOUNT': '41.000'} [2023-02-24 21:15:49,505][213369] DAMAGECOUNT value on done: 489680.0 [2023-02-24 21:15:49,506][213369] Sum rewards: 42.882, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.605', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.052', 'WEAPON4': '0.100', 'AMMO4': '0.145', 'weapon5': '0.208', 'AMMO3': '0.212', 'WEAPON5': '0.350', 'weapon2': '0.498', 'WEAPON3': '1.300', 'HITCOUNT': '2.560', 'weapon3': '3.028', 'DAMAGECOUNT': '11.745', 'FRAGCOUNT': '38.000'} [2023-02-24 21:15:49,572][213368] DAMAGECOUNT value on done: 484957.0 [2023-02-24 21:15:49,572][213368] Sum rewards: 39.586, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.156', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO2': '0.021', 'weapon5': '0.052', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.162', 'WEAPON5': '0.200', 'WEAPON3': '1.000', 'weapon2': '1.080', 'HITCOUNT': '2.450', 'weapon3': '2.658', 'DAMAGECOUNT': '11.142', 'FRAGCOUNT': '33.000'} [2023-02-24 21:15:49,773][213382] DAMAGECOUNT value on done: 479894.0 [2023-02-24 21:15:49,773][213382] Sum rewards: 51.746, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.812', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.044', 'AMMO3': '0.139', 'AMMO4': '0.220', 'weapon5': '0.236', 'weapon2': '0.256', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '0.850', 'weapon4': '0.924', 'weapon3': '2.102', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.891', 'FRAGCOUNT': '44.000'} [2023-02-24 21:15:49,803][213369] DAMAGECOUNT value on done: 479463.0 [2023-02-24 21:15:49,803][213369] Sum rewards: 44.527, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.022', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.027', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.223', 'WEAPON4': '0.350', 'weapon2': '0.544', 'weapon4': '0.632', 'WEAPON3': '1.350', 'weapon3': '2.560', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.699', 'FRAGCOUNT': '41.000'} [2023-02-24 21:15:49,878][213368] DAMAGECOUNT value on done: 482750.0 [2023-02-24 21:15:49,879][213368] Sum rewards: 36.326, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.172', 'ARMOR': '0.008', 'AMMO5': '0.026', 'AMMO2': '0.062', 'AMMO3': '0.167', 'weapon5': '0.232', 'AMMO4': '0.309', 'weapon2': '0.378', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'weapon4': '0.768', 'WEAPON3': '1.100', 'weapon3': '2.164', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '11.904', 'FRAGCOUNT': '35.000'} [2023-02-24 21:15:49,935][213383] DAMAGECOUNT value on done: 494519.0 [2023-02-24 21:15:49,935][213383] Sum rewards: 45.399, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.231', 'AMMO5': '0.019', 'AMMO2': '0.040', 'weapon5': '0.072', 'AMMO3': '0.198', 'AMMO4': '0.202', 'WEAPON4': '0.300', 'weapon2': '0.318', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon4': '0.608', 'WEAPON3': '1.200', 'weapon3': '2.586', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.246', 'FRAGCOUNT': '41.000'} [2023-02-24 21:15:49,942][213384] DAMAGECOUNT value on done: 495092.0 [2023-02-24 21:15:49,942][213384] Sum rewards: 39.243, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.610', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.035', 'AMMO4': '0.175', 'AMMO3': '0.187', 'weapon5': '0.218', 'weapon4': '0.432', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.534', 'WEAPON3': '1.100', 'weapon3': '2.544', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '11.154', 'FRAGCOUNT': '36.000'} [2023-02-24 21:15:50,074][213382] DAMAGECOUNT value on done: 486391.0 [2023-02-24 21:15:50,075][213382] Sum rewards: 46.575, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.150', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.160', 'weapon2': '0.646', 'WEAPON3': '1.100', 'HITCOUNT': '2.620', 'weapon3': '3.112', 'DAMAGECOUNT': '11.070', 'FRAGCOUNT': '40.000'} [2023-02-24 21:15:50,240][213383] DAMAGECOUNT value on done: 486312.0 [2023-02-24 21:15:50,241][213383] Sum rewards: 30.491, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.214', 'AMMO5': '0.014', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.161', 'weapon2': '0.258', 'WEAPON4': '0.300', 'weapon5': '0.328', 'WEAPON5': '0.400', 'ARMOR': '0.400', 'weapon4': '0.698', 'WEAPON3': '1.000', 'HITCOUNT': '2.090', 'weapon3': '2.134', 'DAMAGECOUNT': '9.024', 'FRAGCOUNT': '27.000'} [2023-02-24 21:15:50,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13789.9, 300 sec: 13593.2). Total num frames: 141410304. Throughput: 0: 3451.7. Samples: 10341990. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:15:50,243][213332] Avg episode reward: [(0, '42.659')] [2023-02-24 21:15:50,248][213384] DAMAGECOUNT value on done: 479136.0 [2023-02-24 21:15:50,248][213384] Sum rewards: 43.412, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.845', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.160', 'AMMO3': '0.179', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.450', 'weapon4': '0.648', 'WEAPON3': '1.000', 'weapon3': '2.482', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '11.778', 'FRAGCOUNT': '38.000'} [2023-02-24 21:15:50,564][213365] Updated weights for policy 0, policy_version 34526 (0.0009) [2023-02-24 21:15:50,573][213384] DAMAGECOUNT value on done: 489689.0 [2023-02-24 21:15:50,573][213384] Sum rewards: 33.488, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.022', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.040', 'AMMO3': '0.186', 'AMMO4': '0.199', 'weapon5': '0.206', 'weapon2': '0.266', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.816', 'WEAPON3': '1.100', 'weapon3': '2.350', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '10.758', 'FRAGCOUNT': '33.000'} [2023-02-24 21:15:50,866][213384] DAMAGECOUNT value on done: 495575.0 [2023-02-24 21:15:50,867][213384] Sum rewards: 48.010, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.502', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.157', 'AMMO3': '0.219', 'weapon5': '0.266', 'WEAPON5': '0.350', 'weapon2': '0.382', 'WEAPON4': '0.450', 'weapon4': '1.044', 'WEAPON3': '1.250', 'weapon3': '1.868', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.220', 'FRAGCOUNT': '43.000'} [2023-02-24 21:15:53,485][213365] Updated weights for policy 0, policy_version 34536 (0.0009) [2023-02-24 21:15:55,243][213332] Fps is (10 sec: 13517.0, 60 sec: 13789.8, 300 sec: 13607.1). Total num frames: 141479936. Throughput: 0: 3455.1. Samples: 10362786. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:15:55,243][213332] Avg episode reward: [(0, '42.646')] [2023-02-24 21:15:56,435][213365] Updated weights for policy 0, policy_version 34546 (0.0009) [2023-02-24 21:15:59,377][213365] Updated weights for policy 0, policy_version 34556 (0.0009) [2023-02-24 21:16:00,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13789.8, 300 sec: 13607.1). Total num frames: 141549568. Throughput: 0: 3458.5. Samples: 10383706. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 21:16:00,243][213332] Avg episode reward: [(0, '42.646')] [2023-02-24 21:16:02,331][213365] Updated weights for policy 0, policy_version 34566 (0.0010) [2023-02-24 21:16:05,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13789.8, 300 sec: 13620.9). Total num frames: 141619200. Throughput: 0: 3459.4. Samples: 10394064. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 21:16:05,244][213332] Avg episode reward: [(0, '42.646')] [2023-02-24 21:16:05,296][213365] Updated weights for policy 0, policy_version 34576 (0.0008) [2023-02-24 21:16:05,476][213367] DAMAGECOUNT value on done: 488325.0 [2023-02-24 21:16:05,477][213367] Sum rewards: 41.189, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.015', 'AMMO5': '0.009', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.140', 'AMMO3': '0.210', 'weapon4': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.530', 'WEAPON3': '1.250', 'HITCOUNT': '2.670', 'weapon3': '2.820', 'DAMAGECOUNT': '12.477', 'FRAGCOUNT': '35.000'} [2023-02-24 21:16:05,621][213367] DAMAGECOUNT value on done: 494222.0 [2023-02-24 21:16:05,621][213367] Sum rewards: 47.965, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.484', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.008', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.222', 'weapon2': '0.376', 'WEAPON3': '1.450', 'HITCOUNT': '2.760', 'weapon3': '3.422', 'DAMAGECOUNT': '12.840', 'FRAGCOUNT': '42.000'} [2023-02-24 21:16:05,777][213367] DAMAGECOUNT value on done: 491292.0 [2023-02-24 21:16:05,778][213367] Sum rewards: 46.460, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.861', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'weapon4': '0.376', 'weapon2': '0.420', 'WEAPON3': '1.150', 'HITCOUNT': '2.830', 'weapon3': '2.930', 'DAMAGECOUNT': '11.466', 'FRAGCOUNT': '41.000'} [2023-02-24 21:16:05,927][213367] DAMAGECOUNT value on done: 499523.0 [2023-02-24 21:16:05,928][213367] Sum rewards: 46.498, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.117', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon2': '0.382', 'WEAPON3': '1.200', 'HITCOUNT': '2.830', 'weapon3': '3.286', 'DAMAGECOUNT': '12.684', 'FRAGCOUNT': '38.000'} [2023-02-24 21:16:06,394][213372] DAMAGECOUNT value on done: 503298.0 [2023-02-24 21:16:06,394][213372] Sum rewards: 56.025, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.356', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.082', 'WEAPON5': '0.150', 'weapon2': '0.178', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.274', 'WEAPON3': '1.150', 'HITCOUNT': '3.140', 'weapon3': '3.328', 'DAMAGECOUNT': '13.863', 'FRAGCOUNT': '49.000'} [2023-02-24 21:16:06,673][213372] DAMAGECOUNT value on done: 487492.0 [2023-02-24 21:16:06,674][213372] Sum rewards: 38.801, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.170', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.012', 'weapon5': '0.056', 'AMMO4': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.132', 'WEAPON4': '0.200', 'weapon4': '0.328', 'weapon2': '0.798', 'WEAPON3': '0.850', 'HITCOUNT': '2.440', 'weapon3': '2.580', 'DAMAGECOUNT': '10.161', 'FRAGCOUNT': '32.000'} [2023-02-24 21:16:06,693][213372] DAMAGECOUNT value on done: 498552.0 [2023-02-24 21:16:06,694][213372] Sum rewards: 32.408, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.080', 'AMMO5': '0.015', 'AMMO2': '0.063', 'AMMO3': '0.083', 'weapon5': '0.278', 'AMMO4': '0.316', 'WEAPON5': '0.450', 'WEAPON3': '0.500', 'weapon2': '0.526', 'WEAPON4': '0.750', 'weapon3': '1.336', 'weapon4': '1.398', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '9.243', 'FRAGCOUNT': '30.000'} [2023-02-24 21:16:06,989][213372] DAMAGECOUNT value on done: 490954.0 [2023-02-24 21:16:06,990][213372] Sum rewards: 50.792, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.685', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'weapon4': '0.192', 'WEAPON4': '0.200', 'weapon2': '0.204', 'AMMO3': '0.283', 'WEAPON3': '1.650', 'HITCOUNT': '3.180', 'weapon3': '3.312', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '48.000'} [2023-02-24 21:16:07,378][213366] DAMAGECOUNT value on done: 483301.0 [2023-02-24 21:16:07,379][213366] Sum rewards: 33.557, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.752', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon5': '0.096', 'AMMO4': '0.137', 'weapon4': '0.170', 'AMMO3': '0.175', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.650', 'WEAPON3': '1.050', 'HITCOUNT': '2.130', 'weapon3': '2.746', 'DAMAGECOUNT': '9.261', 'FRAGCOUNT': '31.000'} [2023-02-24 21:16:07,676][213366] DAMAGECOUNT value on done: 508416.0 [2023-02-24 21:16:07,676][213366] Sum rewards: 41.048, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.342', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.069', 'AMMO3': '0.134', 'weapon5': '0.134', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.644', 'WEAPON3': '0.800', 'weapon2': '0.874', 'weapon3': '2.132', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '11.319', 'FRAGCOUNT': '33.500'} [2023-02-24 21:16:07,688][213366] DAMAGECOUNT value on done: 498439.0 [2023-02-24 21:16:07,688][213366] Sum rewards: 44.115, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.482', 'AMMO5': '0.011', 'AMMO2': '0.038', 'AMMO3': '0.182', 'AMMO4': '0.189', 'weapon5': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.612', 'weapon2': '0.750', 'WEAPON3': '1.100', 'weapon3': '2.130', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '11.679', 'FRAGCOUNT': '41.000'} [2023-02-24 21:16:07,984][213366] DAMAGECOUNT value on done: 496590.0 [2023-02-24 21:16:07,985][213366] Sum rewards: 40.625, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.732', 'ARMOR': '0.008', 'AMMO5': '0.021', 'AMMO2': '0.062', 'AMMO3': '0.181', 'weapon2': '0.208', 'AMMO4': '0.308', 'weapon5': '0.312', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon4': '1.006', 'WEAPON3': '1.050', 'weapon3': '2.124', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '12.147', 'FRAGCOUNT': '37.000'} [2023-02-24 21:16:08,220][213369] DAMAGECOUNT value on done: 496484.0 [2023-02-24 21:16:08,220][213369] Sum rewards: 41.813, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.012', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.022', 'WEAPON4': '0.100', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon4': '0.260', 'weapon2': '0.276', 'WEAPON3': '1.300', 'HITCOUNT': '2.620', 'weapon3': '3.220', 'DAMAGECOUNT': '11.028', 'FRAGCOUNT': '38.000'} [2023-02-24 21:16:08,259][213365] Updated weights for policy 0, policy_version 34586 (0.0009) [2023-02-24 21:16:08,354][213383] DAMAGECOUNT value on done: 489189.0 [2023-02-24 21:16:08,355][213383] Sum rewards: 30.565, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.626', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon7': '0.066', 'AMMO4': '0.096', 'AMMO3': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.142', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.404', 'WEAPON4': '0.450', 'WEAPON3': '0.750', 'weapon2': '0.850', 'weapon4': '0.940', 'weapon3': '1.718', 'HITCOUNT': '1.890', 'DAMAGECOUNT': '8.607', 'FRAGCOUNT': '26.000'} [2023-02-24 21:16:08,375][213368] DAMAGECOUNT value on done: 486611.0 [2023-02-24 21:16:08,375][213368] Sum rewards: 45.149, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.130', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon5': '0.080', 'AMMO4': '0.094', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.404', 'weapon2': '0.608', 'WEAPON3': '1.100', 'weapon3': '2.650', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.119', 'FRAGCOUNT': '40.000'} [2023-02-24 21:16:08,509][213369] DAMAGECOUNT value on done: 498288.0 [2023-02-24 21:16:08,509][213369] Sum rewards: 33.910, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.484', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.062', 'AMMO3': '0.242', 'weapon5': '0.254', 'AMMO4': '0.310', 'weapon2': '0.332', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.662', 'WEAPON3': '1.450', 'HITCOUNT': '2.320', 'weapon3': '2.368', 'DAMAGECOUNT': '10.269', 'FRAGCOUNT': '36.000'} [2023-02-24 21:16:08,574][213382] DAMAGECOUNT value on done: 498103.0 [2023-02-24 21:16:08,574][213382] Sum rewards: 47.819, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.120', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'weapon2': '0.308', 'weapon4': '0.352', 'WEAPON3': '1.300', 'HITCOUNT': '2.710', 'weapon3': '2.924', 'DAMAGECOUNT': '13.638', 'FRAGCOUNT': '44.000'} [2023-02-24 21:16:08,654][213383] DAMAGECOUNT value on done: 492438.0 [2023-02-24 21:16:08,655][213383] Sum rewards: 42.793, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.425', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.057', 'weapon4': '0.100', 'weapon5': '0.134', 'AMMO3': '0.168', 'AMMO4': '0.286', 'weapon2': '0.444', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'HITCOUNT': '2.590', 'weapon3': '3.094', 'DAMAGECOUNT': '11.517', 'FRAGCOUNT': '39.000'} [2023-02-24 21:16:08,670][213368] DAMAGECOUNT value on done: 496923.0 [2023-02-24 21:16:08,670][213368] Sum rewards: 52.169, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.747', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.047', 'weapon5': '0.172', 'AMMO3': '0.181', 'AMMO4': '0.237', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON4': '0.550', 'weapon4': '0.682', 'WEAPON3': '1.100', 'weapon3': '2.528', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.205', 'FRAGCOUNT': '47.000'} [2023-02-24 21:16:08,816][213369] DAMAGECOUNT value on done: 493176.0 [2023-02-24 21:16:08,816][213369] Sum rewards: 38.231, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.820', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.102', 'AMMO3': '0.136', 'weapon5': '0.154', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.302', 'weapon2': '0.778', 'WEAPON3': '0.900', 'HITCOUNT': '2.480', 'weapon3': '2.632', 'DAMAGECOUNT': '10.488', 'FRAGCOUNT': '32.000'} [2023-02-24 21:16:08,874][213382] DAMAGECOUNT value on done: 496379.0 [2023-02-24 21:16:08,874][213382] Sum rewards: 41.266, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.290', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.158', 'AMMO3': '0.219', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON4': '0.400', 'weapon4': '0.742', 'WEAPON3': '1.300', 'weapon3': '2.070', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '11.646', 'FRAGCOUNT': '39.000'} [2023-02-24 21:16:08,948][213368] DAMAGECOUNT value on done: 488363.0 [2023-02-24 21:16:08,949][213368] Sum rewards: 38.724, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.075', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO3': '0.120', 'AMMO4': '0.191', 'weapon5': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.434', 'weapon4': '0.618', 'WEAPON3': '0.800', 'weapon3': '2.356', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '10.218', 'FRAGCOUNT': '33.000'} [2023-02-24 21:16:09,129][213369] DAMAGECOUNT value on done: 483323.0 [2023-02-24 21:16:09,130][213369] Sum rewards: 42.479, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.307', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.019', 'weapon5': '0.076', 'AMMO4': '0.095', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'WEAPON4': '0.300', 'weapon2': '0.312', 'weapon4': '0.454', 'WEAPON3': '1.050', 'HITCOUNT': '2.510', 'weapon3': '2.806', 'DAMAGECOUNT': '11.580', 'FRAGCOUNT': '37.000'} [2023-02-24 21:16:09,191][213382] DAMAGECOUNT value on done: 484055.0 [2023-02-24 21:16:09,192][213382] Sum rewards: 43.427, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.625', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.156', 'AMMO4': '0.166', 'AMMO3': '0.187', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.556', 'WEAPON3': '1.150', 'HITCOUNT': '2.520', 'weapon3': '2.634', 'DAMAGECOUNT': '12.483', 'FRAGCOUNT': '40.000'} [2023-02-24 21:16:09,257][213368] DAMAGECOUNT value on done: 487942.0 [2023-02-24 21:16:09,257][213368] Sum rewards: 65.991, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.185', 'AMMO5': '0.004', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'weapon5': '0.056', 'weapon4': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.178', 'weapon2': '0.286', 'WEAPON3': '1.150', 'weapon3': '3.328', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.576', 'FRAGCOUNT': '55.000'} [2023-02-24 21:16:09,287][213383] DAMAGECOUNT value on done: 498055.0 [2023-02-24 21:16:09,288][213383] Sum rewards: 35.530, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.701', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon5': '0.122', 'AMMO4': '0.146', 'AMMO3': '0.229', 'weapon2': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.442', 'WEAPON3': '1.400', 'HITCOUNT': '2.510', 'weapon3': '2.836', 'DAMAGECOUNT': '10.608', 'FRAGCOUNT': '33.000'} [2023-02-24 21:16:09,357][213384] DAMAGECOUNT value on done: 499143.0 [2023-02-24 21:16:09,357][213384] Sum rewards: 44.327, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.406', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.140', 'AMMO4': '0.143', 'WEAPON4': '0.200', 'weapon4': '0.218', 'AMMO3': '0.243', 'WEAPON5': '0.250', 'weapon2': '0.444', 'WEAPON3': '1.450', 'HITCOUNT': '2.580', 'weapon3': '2.876', 'DAMAGECOUNT': '12.153', 'FRAGCOUNT': '41.000'} [2023-02-24 21:16:09,486][213382] DAMAGECOUNT value on done: 491130.0 [2023-02-24 21:16:09,486][213382] Sum rewards: 48.328, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.516', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon4': '0.158', 'weapon2': '0.174', 'weapon5': '0.176', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '2.860', 'weapon3': '3.218', 'DAMAGECOUNT': '14.217', 'FRAGCOUNT': '42.500'} [2023-02-24 21:16:09,585][213383] DAMAGECOUNT value on done: 490356.0 [2023-02-24 21:16:09,586][213383] Sum rewards: 41.839, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.300', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon5': '0.020', 'AMMO4': '0.083', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.458', 'weapon2': '0.646', 'WEAPON3': '1.150', 'weapon3': '2.544', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.132', 'FRAGCOUNT': '35.500'} [2023-02-24 21:16:09,656][213384] DAMAGECOUNT value on done: 482933.0 [2023-02-24 21:16:09,657][213384] Sum rewards: 39.906, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.994', 'AMMO5': '0.003', 'weapon5': '0.026', 'AMMO2': '0.039', 'WEAPON5': '0.050', 'AMMO4': '0.197', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'weapon4': '0.474', 'weapon2': '0.510', 'WEAPON3': '1.250', 'HITCOUNT': '2.650', 'weapon3': '2.802', 'DAMAGECOUNT': '11.391', 'FRAGCOUNT': '37.000'} [2023-02-24 21:16:09,991][213384] DAMAGECOUNT value on done: 493366.0 [2023-02-24 21:16:09,992][213384] Sum rewards: 40.412, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.788', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.051', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'weapon5': '0.190', 'WEAPON5': '0.200', 'weapon4': '0.326', 'weapon2': '0.554', 'WEAPON3': '1.200', 'HITCOUNT': '2.600', 'weapon3': '2.704', 'DAMAGECOUNT': '11.031', 'FRAGCOUNT': '35.000'} [2023-02-24 21:16:10,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13634.8). Total num frames: 141688832. Throughput: 0: 3460.8. Samples: 10414870. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 21:16:10,243][213332] Avg episode reward: [(0, '42.642')] [2023-02-24 21:16:10,293][213384] DAMAGECOUNT value on done: 499541.0 [2023-02-24 21:16:10,295][213384] Sum rewards: 48.657, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.470', 'ARMOR': '0.009', 'AMMO5': '0.012', 'weapon7': '0.042', 'AMMO2': '0.049', 'weapon5': '0.074', 'AMMO3': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO4': '0.246', 'WEAPON5': '0.300', 'WEAPON3': '0.500', 'WEAPON4': '0.600', 'weapon2': '0.712', 'weapon4': '0.914', 'weapon3': '1.822', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '11.898', 'FRAGCOUNT': '39.000'} [2023-02-24 21:16:11,250][213365] Updated weights for policy 0, policy_version 34596 (0.0009) [2023-02-24 21:16:14,191][213365] Updated weights for policy 0, policy_version 34606 (0.0010) [2023-02-24 21:16:15,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13634.8). Total num frames: 141758464. Throughput: 0: 3463.2. Samples: 10435606. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 21:16:15,243][213332] Avg episode reward: [(0, '42.619')] [2023-02-24 21:16:15,791][213368] Large shaping reward 3.231 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.18, 60.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 21:16:17,141][213365] Updated weights for policy 0, policy_version 34616 (0.0009) [2023-02-24 21:16:20,129][213365] Updated weights for policy 0, policy_version 34626 (0.0009) [2023-02-24 21:16:20,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13648.7). Total num frames: 141828096. Throughput: 0: 3464.1. Samples: 10446038. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 21:16:20,243][213332] Avg episode reward: [(0, '42.619')] [2023-02-24 21:16:23,079][213365] Updated weights for policy 0, policy_version 34636 (0.0009) [2023-02-24 21:16:24,893][213367] DAMAGECOUNT value on done: 492162.0 [2023-02-24 21:16:24,893][213367] Sum rewards: 44.384, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.515', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.166', 'AMMO3': '0.184', 'weapon4': '0.186', 'WEAPON4': '0.300', 'weapon2': '0.724', 'WEAPON3': '1.100', 'HITCOUNT': '2.610', 'weapon3': '2.656', 'DAMAGECOUNT': '11.511', 'FRAGCOUNT': '40.500'} [2023-02-24 21:16:25,027][213367] DAMAGECOUNT value on done: 497848.0 [2023-02-24 21:16:25,028][213367] Sum rewards: 42.113, reward structure: {'DEATHCOUNT': '-12.000', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.045', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'AMMO4': '0.225', 'HEALTH': '0.321', 'WEAPON4': '0.350', 'WEAPON3': '0.600', 'weapon2': '0.606', 'weapon4': '0.944', 'weapon3': '2.008', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '10.878', 'FRAGCOUNT': '35.000'} [2023-02-24 21:16:25,199][213367] DAMAGECOUNT value on done: 495472.0 [2023-02-24 21:16:25,199][213367] Sum rewards: 48.196, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.202', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.142', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon2': '0.274', 'weapon4': '0.546', 'WEAPON3': '1.200', 'weapon3': '2.794', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.540', 'FRAGCOUNT': '42.000'} [2023-02-24 21:16:25,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13648.7). Total num frames: 141897728. Throughput: 0: 3466.4. Samples: 10466840. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:16:25,243][213332] Avg episode reward: [(0, '42.718')] [2023-02-24 21:16:25,334][213367] DAMAGECOUNT value on done: 503769.0 [2023-02-24 21:16:25,334][213367] Sum rewards: 44.246, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.131', 'AMMO5': '0.004', 'ARMOR': '0.004', 'AMMO2': '0.019', 'weapon5': '0.040', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'AMMO3': '0.152', 'WEAPON4': '0.350', 'weapon2': '0.442', 'weapon4': '0.570', 'WEAPON3': '0.950', 'weapon3': '2.806', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.738', 'FRAGCOUNT': '38.000'} [2023-02-24 21:16:25,554][213383] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 21:16:25,893][213372] DAMAGECOUNT value on done: 508154.0 [2023-02-24 21:16:25,894][213372] Sum rewards: 55.089, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.299', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.062', 'AMMO4': '0.116', 'weapon4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.548', 'WEAPON3': '1.350', 'weapon3': '3.060', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.568', 'FRAGCOUNT': '48.000'} [2023-02-24 21:16:26,043][213365] Updated weights for policy 0, policy_version 34646 (0.0009) [2023-02-24 21:16:26,099][213372] DAMAGECOUNT value on done: 491137.0 [2023-02-24 21:16:26,100][213372] Sum rewards: 45.946, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.027', 'weapon7': '0.044', 'AMMO3': '0.106', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.294', 'HEALTH': '0.310', 'weapon2': '0.618', 'WEAPON3': '0.650', 'HITCOUNT': '2.570', 'weapon3': '2.838', 'DAMAGECOUNT': '10.935', 'FRAGCOUNT': '35.000'} [2023-02-24 21:16:26,209][213372] DAMAGECOUNT value on done: 502659.0 [2023-02-24 21:16:26,209][213372] Sum rewards: 42.175, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.425', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.055', 'AMMO3': '0.177', 'weapon2': '0.186', 'AMMO4': '0.277', 'weapon5': '0.318', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.762', 'WEAPON3': '1.100', 'weapon3': '2.364', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '12.321', 'FRAGCOUNT': '37.000'} [2023-02-24 21:16:26,417][213372] DAMAGECOUNT value on done: 495013.0 [2023-02-24 21:16:26,417][213372] Sum rewards: 41.309, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.345', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.132', 'AMMO4': '0.171', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.318', 'weapon4': '0.510', 'WEAPON3': '1.200', 'weapon3': '2.724', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.177', 'FRAGCOUNT': '37.000'} [2023-02-24 21:16:26,810][213366] DAMAGECOUNT value on done: 487577.0 [2023-02-24 21:16:26,810][213366] Sum rewards: 38.517, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-5.376', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'weapon2': '0.226', 'AMMO3': '0.342', 'WEAPON4': '0.350', 'weapon4': '0.414', 'WEAPON3': '2.050', 'HITCOUNT': '2.800', 'weapon3': '3.012', 'DAMAGECOUNT': '12.663', 'FRAGCOUNT': '42.000'} [2023-02-24 21:16:27,112][213366] DAMAGECOUNT value on done: 512891.0 [2023-02-24 21:16:27,113][213366] Sum rewards: 54.676, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.192', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.146', 'AMMO3': '0.148', 'weapon2': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.618', 'WEAPON3': '0.950', 'weapon3': '2.852', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.425', 'FRAGCOUNT': '45.000'} [2023-02-24 21:16:27,126][213366] DAMAGECOUNT value on done: 502164.0 [2023-02-24 21:16:27,126][213366] Sum rewards: 51.552, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.558', 'AMMO2': '0.003', 'AMMO4': '0.014', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'weapon2': '0.566', 'WEAPON3': '0.750', 'HITCOUNT': '2.780', 'weapon3': '3.280', 'DAMAGECOUNT': '11.175', 'FRAGCOUNT': '43.000'} [2023-02-24 21:16:27,424][213366] DAMAGECOUNT value on done: 500936.0 [2023-02-24 21:16:27,425][213366] Sum rewards: 47.274, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.900', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.106', 'AMMO4': '0.122', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.342', 'weapon4': '0.510', 'WEAPON3': '1.400', 'weapon3': '2.734', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.038', 'FRAGCOUNT': '44.000'} [2023-02-24 21:16:27,628][213369] DAMAGECOUNT value on done: 499887.0 [2023-02-24 21:16:27,629][213369] Sum rewards: 33.962, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.364', 'AMMO5': '0.012', 'ARMOR': '0.028', 'AMMO2': '0.037', 'weapon5': '0.110', 'AMMO4': '0.183', 'AMMO3': '0.228', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.508', 'weapon4': '0.556', 'WEAPON3': '1.250', 'HITCOUNT': '2.240', 'weapon3': '2.564', 'DAMAGECOUNT': '10.209', 'FRAGCOUNT': '31.000'} [2023-02-24 21:16:27,705][213383] DAMAGECOUNT value on done: 493227.0 [2023-02-24 21:16:27,705][213383] Sum rewards: 49.032, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.350', 'AMMO2': '0.001', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO4': '0.007', 'WEAPON5': '0.100', 'weapon7': '0.100', 'weapon5': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'WEAPON7': '0.200', 'weapon2': '0.364', 'weapon4': '0.534', 'WEAPON3': '1.100', 'weapon3': '2.578', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '12.114', 'FRAGCOUNT': '43.000'} [2023-02-24 21:16:27,743][213368] DAMAGECOUNT value on done: 490526.0 [2023-02-24 21:16:27,744][213368] Sum rewards: 42.729, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.894', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.024', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'AMMO3': '0.251', 'weapon2': '0.268', 'WEAPON4': '0.350', 'weapon4': '0.576', 'WEAPON3': '1.400', 'HITCOUNT': '2.830', 'weapon3': '2.904', 'DAMAGECOUNT': '11.745', 'FRAGCOUNT': '39.000'} [2023-02-24 21:16:27,926][213369] DAMAGECOUNT value on done: 501788.0 [2023-02-24 21:16:27,927][213369] Sum rewards: 34.846, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.210', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.054', 'weapon5': '0.118', 'AMMO3': '0.189', 'WEAPON5': '0.250', 'AMMO4': '0.268', 'weapon2': '0.380', 'WEAPON4': '0.600', 'weapon4': '0.842', 'WEAPON3': '1.050', 'weapon3': '2.188', 'HITCOUNT': '2.350', 'DAMAGECOUNT': '10.500', 'FRAGCOUNT': '34.000'} [2023-02-24 21:16:27,981][213382] DAMAGECOUNT value on done: 502090.0 [2023-02-24 21:16:27,981][213382] Sum rewards: 51.518, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.803', 'AMMO5': '0.004', 'AMMO2': '0.023', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'weapon2': '0.392', 'weapon4': '0.576', 'WEAPON3': '1.450', 'HITCOUNT': '2.800', 'weapon3': '2.802', 'DAMAGECOUNT': '11.961', 'FRAGCOUNT': '46.000'} [2023-02-24 21:16:28,014][213383] DAMAGECOUNT value on done: 496196.0 [2023-02-24 21:16:28,014][213383] Sum rewards: 44.654, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.240', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon5': '0.006', 'AMMO4': '0.025', 'weapon7': '0.048', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon2': '0.176', 'WEAPON7': '0.200', 'AMMO3': '0.207', 'weapon4': '0.418', 'WEAPON3': '1.150', 'HITCOUNT': '2.550', 'weapon3': '2.890', 'DAMAGECOUNT': '11.274', 'FRAGCOUNT': '39.000'} [2023-02-24 21:16:28,046][213368] DAMAGECOUNT value on done: 500291.0 [2023-02-24 21:16:28,046][213368] Sum rewards: 39.642, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.209', 'AMMO5': '0.009', 'ARMOR': '0.012', 'weapon5': '0.014', 'AMMO2': '0.018', 'AMMO4': '0.087', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.340', 'weapon2': '0.544', 'WEAPON3': '1.000', 'HITCOUNT': '2.340', 'weapon3': '2.754', 'DAMAGECOUNT': '10.104', 'FRAGCOUNT': '35.000'} [2023-02-24 21:16:28,217][213369] DAMAGECOUNT value on done: 497971.0 [2023-02-24 21:16:28,218][213369] Sum rewards: 52.445, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.792', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.008', 'WEAPON4': '0.050', 'weapon5': '0.064', 'weapon4': '0.082', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'weapon2': '0.368', 'WEAPON3': '1.400', 'HITCOUNT': '3.220', 'weapon3': '3.278', 'DAMAGECOUNT': '14.385', 'FRAGCOUNT': '46.000'} [2023-02-24 21:16:28,283][213382] DAMAGECOUNT value on done: 500284.0 [2023-02-24 21:16:28,284][213382] Sum rewards: 45.477, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.860', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.037', 'weapon5': '0.098', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.374', 'weapon2': '0.484', 'WEAPON3': '1.350', 'HITCOUNT': '2.480', 'weapon3': '2.814', 'DAMAGECOUNT': '11.715', 'FRAGCOUNT': '41.000'} [2023-02-24 21:16:28,315][213368] DAMAGECOUNT value on done: 492479.0 [2023-02-24 21:16:28,316][213368] Sum rewards: 46.413, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.820', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.023', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.162', 'AMMO3': '0.244', 'weapon2': '0.272', 'WEAPON3': '1.450', 'HITCOUNT': '3.000', 'weapon3': '3.332', 'DAMAGECOUNT': '12.348', 'FRAGCOUNT': '43.000'} [2023-02-24 21:16:28,511][213369] DAMAGECOUNT value on done: 487536.0 [2023-02-24 21:16:28,512][213369] Sum rewards: 48.114, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.426', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.138', 'AMMO4': '0.177', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.454', 'weapon2': '0.646', 'WEAPON3': '1.200', 'weapon3': '2.498', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.639', 'FRAGCOUNT': '44.000'} [2023-02-24 21:16:28,586][213382] DAMAGECOUNT value on done: 487381.0 [2023-02-24 21:16:28,586][213382] Sum rewards: 37.695, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.456', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.092', 'AMMO3': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.594', 'weapon4': '0.648', 'WEAPON3': '0.850', 'weapon3': '2.364', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '9.978', 'FRAGCOUNT': '32.000'} [2023-02-24 21:16:28,617][213368] DAMAGECOUNT value on done: 492176.0 [2023-02-24 21:16:28,618][213368] Sum rewards: 54.661, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.335', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'weapon4': '0.060', 'AMMO3': '0.193', 'weapon2': '0.518', 'WEAPON3': '1.200', 'HITCOUNT': '2.940', 'weapon3': '3.290', 'DAMAGECOUNT': '12.702', 'FRAGCOUNT': '47.000'} [2023-02-24 21:16:28,627][213383] DAMAGECOUNT value on done: 501998.0 [2023-02-24 21:16:28,628][213383] Sum rewards: 41.277, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.800', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.128', 'AMMO4': '0.156', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon4': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.348', 'WEAPON3': '1.150', 'HITCOUNT': '2.490', 'weapon3': '3.094', 'DAMAGECOUNT': '11.829', 'FRAGCOUNT': '37.000'} [2023-02-24 21:16:28,841][213384] DAMAGECOUNT value on done: 502901.0 [2023-02-24 21:16:28,842][213384] Sum rewards: 45.105, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.530', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.132', 'weapon4': '0.148', 'AMMO3': '0.252', 'weapon2': '0.452', 'WEAPON3': '1.550', 'HITCOUNT': '2.510', 'weapon3': '3.122', 'DAMAGECOUNT': '11.274', 'FRAGCOUNT': '43.000'} [2023-02-24 21:16:28,886][213382] DAMAGECOUNT value on done: 495458.0 [2023-02-24 21:16:28,886][213382] Sum rewards: 45.689, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.445', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.122', 'AMMO4': '0.131', 'weapon2': '0.186', 'AMMO3': '0.229', 'WEAPON5': '0.300', 'WEAPON4': '0.600', 'weapon4': '0.826', 'WEAPON3': '1.450', 'weapon3': '2.542', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.984', 'FRAGCOUNT': '42.000'} [2023-02-24 21:16:28,928][213383] DAMAGECOUNT value on done: 493997.0 [2023-02-24 21:16:28,929][213383] Sum rewards: 41.252, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.277', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.045', 'AMMO3': '0.135', 'AMMO4': '0.224', 'weapon5': '0.304', 'weapon4': '0.372', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.604', 'WEAPON3': '0.800', 'HITCOUNT': '2.400', 'weapon3': '2.446', 'DAMAGECOUNT': '10.923', 'FRAGCOUNT': '36.000'} [2023-02-24 21:16:29,002][213365] Updated weights for policy 0, policy_version 34656 (0.0009) [2023-02-24 21:16:29,137][213384] DAMAGECOUNT value on done: 487360.0 [2023-02-24 21:16:29,137][213384] Sum rewards: 53.218, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.326', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.052', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon4': '0.424', 'weapon2': '0.504', 'WEAPON3': '1.200', 'weapon3': '2.614', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.281', 'FRAGCOUNT': '44.000'} [2023-02-24 21:16:29,463][213384] DAMAGECOUNT value on done: 497044.0 [2023-02-24 21:16:29,464][213384] Sum rewards: 36.218, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.030', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon5': '0.176', 'AMMO3': '0.225', 'AMMO4': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.758', 'weapon2': '0.854', 'WEAPON3': '1.300', 'weapon3': '1.906', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '11.034', 'FRAGCOUNT': '35.000'} [2023-02-24 21:16:29,771][213384] DAMAGECOUNT value on done: 503094.0 [2023-02-24 21:16:29,771][213384] Sum rewards: 40.862, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.240', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon7': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.121', 'AMMO3': '0.175', 'weapon5': '0.188', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.280', 'ARMOR': '0.467', 'WEAPON4': '0.500', 'weapon4': '0.878', 'WEAPON3': '1.100', 'weapon3': '2.252', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '10.659', 'FRAGCOUNT': '37.000'} [2023-02-24 21:16:30,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13662.6). Total num frames: 141967360. Throughput: 0: 3464.2. Samples: 10487516. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:16:30,243][213332] Avg episode reward: [(0, '43.743')] [2023-02-24 21:16:30,940][213372] Large shaping reward 2.517 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.495, 165.0), ('weapon5', 0.002)] [2023-02-24 21:16:31,913][213365] Updated weights for policy 0, policy_version 34666 (0.0009) [2023-02-24 21:16:34,865][213365] Updated weights for policy 0, policy_version 34676 (0.0009) [2023-02-24 21:16:35,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13662.6). Total num frames: 142036992. Throughput: 0: 3466.7. Samples: 10497990. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:16:35,244][213332] Avg episode reward: [(0, '43.743')] [2023-02-24 21:16:37,848][213365] Updated weights for policy 0, policy_version 34686 (0.0009) [2023-02-24 21:16:40,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13789.9, 300 sec: 13662.6). Total num frames: 142102528. Throughput: 0: 3463.7. Samples: 10518654. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:16:40,243][213332] Avg episode reward: [(0, '43.743')] [2023-02-24 21:16:40,851][213365] Updated weights for policy 0, policy_version 34696 (0.0009) [2023-02-24 21:16:43,803][213365] Updated weights for policy 0, policy_version 34706 (0.0009) [2023-02-24 21:16:44,305][213367] DAMAGECOUNT value on done: 495972.0 [2023-02-24 21:16:44,306][213367] Sum rewards: 36.281, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.385', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.080', 'AMMO4': '0.134', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'weapon4': '0.368', 'WEAPON4': '0.400', 'weapon2': '0.492', 'WEAPON3': '1.100', 'HITCOUNT': '2.390', 'weapon3': '2.844', 'DAMAGECOUNT': '11.430', 'FRAGCOUNT': '33.000'} [2023-02-24 21:16:44,449][213367] DAMAGECOUNT value on done: 502196.0 [2023-02-24 21:16:44,450][213367] Sum rewards: 56.714, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.122', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'AMMO3': '0.224', 'weapon2': '0.224', 'weapon4': '0.344', 'WEAPON3': '1.300', 'HITCOUNT': '2.770', 'weapon3': '3.036', 'DAMAGECOUNT': '13.044', 'FRAGCOUNT': '50.000'} [2023-02-24 21:16:44,607][213367] DAMAGECOUNT value on done: 499257.0 [2023-02-24 21:16:44,607][213367] Sum rewards: 41.302, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.302', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.051', 'AMMO3': '0.198', 'weapon5': '0.208', 'AMMO4': '0.257', 'weapon2': '0.270', 'WEAPON5': '0.450', 'WEAPON4': '0.700', 'weapon4': '0.962', 'WEAPON3': '1.150', 'weapon3': '2.180', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '11.040', 'FRAGCOUNT': '40.000'} [2023-02-24 21:16:44,756][213367] DAMAGECOUNT value on done: 508008.0 [2023-02-24 21:16:44,757][213367] Sum rewards: 49.678, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.267', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.044', 'AMMO3': '0.212', 'AMMO4': '0.218', 'WEAPON5': '0.250', 'weapon5': '0.272', 'weapon2': '0.416', 'WEAPON4': '0.500', 'weapon4': '0.784', 'WEAPON3': '1.200', 'weapon3': '2.158', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '12.717', 'FRAGCOUNT': '47.000'} [2023-02-24 21:16:45,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13789.9, 300 sec: 13676.5). Total num frames: 142172160. Throughput: 0: 3460.1. Samples: 10539410. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:16:45,243][213332] Avg episode reward: [(0, '43.535')] [2023-02-24 21:16:45,282][213352] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000034711_142176256.pth... [2023-02-24 21:16:45,342][213352] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000033906_138878976.pth [2023-02-24 21:16:45,393][213372] DAMAGECOUNT value on done: 512379.0 [2023-02-24 21:16:45,393][213372] Sum rewards: 41.879, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.182', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon5': '0.146', 'AMMO3': '0.216', 'weapon2': '0.324', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.932', 'WEAPON3': '1.250', 'weapon3': '2.228', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.675', 'FRAGCOUNT': '39.000'} [2023-02-24 21:16:45,619][213372] DAMAGECOUNT value on done: 494262.0 [2023-02-24 21:16:45,620][213372] Sum rewards: 33.094, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.183', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.155', 'weapon4': '0.388', 'WEAPON4': '0.400', 'weapon2': '0.592', 'WEAPON3': '0.900', 'HITCOUNT': '2.210', 'weapon3': '2.668', 'DAMAGECOUNT': '9.375', 'FRAGCOUNT': '30.000'} [2023-02-24 21:16:45,700][213372] DAMAGECOUNT value on done: 507272.0 [2023-02-24 21:16:45,701][213372] Sum rewards: 48.939, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.006', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'weapon4': '0.204', 'WEAPON4': '0.250', 'AMMO3': '0.297', 'weapon2': '0.302', 'WEAPON3': '1.700', 'HITCOUNT': '2.860', 'weapon3': '3.212', 'DAMAGECOUNT': '13.839', 'FRAGCOUNT': '47.000'} [2023-02-24 21:16:45,932][213372] DAMAGECOUNT value on done: 499688.0 [2023-02-24 21:16:45,933][213372] Sum rewards: 44.551, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.226', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.170', 'weapon2': '0.172', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'WEAPON4': '0.400', 'weapon4': '0.864', 'WEAPON3': '1.100', 'weapon3': '2.478', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.025', 'FRAGCOUNT': '38.000'} [2023-02-24 21:16:46,247][213366] DAMAGECOUNT value on done: 491648.0 [2023-02-24 21:16:46,248][213366] Sum rewards: 42.299, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.110', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon7': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.123', 'weapon5': '0.172', 'AMMO4': '0.182', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.552', 'weapon4': '0.658', 'WEAPON3': '0.750', 'weapon3': '2.168', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '12.213', 'FRAGCOUNT': '34.000'} [2023-02-24 21:16:46,549][213366] DAMAGECOUNT value on done: 517272.0 [2023-02-24 21:16:46,550][213366] Sum rewards: 48.993, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.828', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.050', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.212', 'AMMO3': '0.219', 'weapon2': '0.474', 'WEAPON3': '1.300', 'HITCOUNT': '2.770', 'weapon3': '2.974', 'DAMAGECOUNT': '13.143', 'FRAGCOUNT': '46.500'} [2023-02-24 21:16:46,563][213366] DAMAGECOUNT value on done: 505111.0 [2023-02-24 21:16:46,564][213366] Sum rewards: 28.433, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.575', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.046', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.240', 'WEAPON4': '0.300', 'weapon4': '0.832', 'ARMOR': '0.897', 'WEAPON3': '1.250', 'HITCOUNT': '2.000', 'weapon3': '2.602', 'DAMAGECOUNT': '8.841', 'FRAGCOUNT': '27.000'} [2023-02-24 21:16:46,766][213365] Updated weights for policy 0, policy_version 34716 (0.0009) [2023-02-24 21:16:46,864][213366] DAMAGECOUNT value on done: 505207.0 [2023-02-24 21:16:46,864][213366] Sum rewards: 42.594, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.711', 'AMMO5': '0.021', 'AMMO2': '0.051', 'weapon7': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.220', 'weapon5': '0.224', 'weapon2': '0.240', 'AMMO4': '0.257', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'weapon4': '0.554', 'WEAPON3': '1.250', 'HITCOUNT': '2.500', 'weapon3': '2.530', 'DAMAGECOUNT': '12.813', 'FRAGCOUNT': '41.000'} [2023-02-24 21:16:47,056][213369] DAMAGECOUNT value on done: 503029.0 [2023-02-24 21:16:47,057][213369] Sum rewards: 31.616, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.070', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'weapon4': '0.152', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'HEALTH': '0.266', 'weapon2': '0.370', 'WEAPON3': '0.950', 'HITCOUNT': '2.280', 'weapon3': '3.204', 'DAMAGECOUNT': '9.126', 'FRAGCOUNT': '28.000'} [2023-02-24 21:16:47,165][213368] DAMAGECOUNT value on done: 494750.0 [2023-02-24 21:16:47,166][213368] Sum rewards: 42.537, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.875', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.029', 'weapon5': '0.126', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.350', 'weapon4': '0.472', 'WEAPON3': '1.400', 'weapon3': '2.764', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.672', 'FRAGCOUNT': '39.000'} [2023-02-24 21:16:47,198][213383] DAMAGECOUNT value on done: 497337.0 [2023-02-24 21:16:47,198][213383] Sum rewards: 45.972, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.483', 'AMMO2': '0.002', 'AMMO4': '0.010', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'weapon4': '0.392', 'weapon2': '0.574', 'WEAPON3': '1.050', 'weapon3': '2.770', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '12.330', 'FRAGCOUNT': '39.000'} [2023-02-24 21:16:47,345][213369] DAMAGECOUNT value on done: 505987.0 [2023-02-24 21:16:47,345][213369] Sum rewards: 47.242, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.381', 'AMMO5': '0.004', 'AMMO2': '0.020', 'weapon5': '0.030', 'weapon4': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'AMMO3': '0.210', 'weapon2': '0.732', 'WEAPON3': '1.350', 'HITCOUNT': '2.770', 'weapon3': '2.994', 'DAMAGECOUNT': '12.597', 'FRAGCOUNT': '42.000'} [2023-02-24 21:16:47,397][213382] DAMAGECOUNT value on done: 505963.0 [2023-02-24 21:16:47,398][213382] Sum rewards: 44.251, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.195', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.092', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon4': '0.276', 'weapon2': '0.520', 'WEAPON3': '1.250', 'HITCOUNT': '2.620', 'weapon3': '2.830', 'DAMAGECOUNT': '11.619', 'FRAGCOUNT': '40.000'} [2023-02-24 21:16:47,466][213368] DAMAGECOUNT value on done: 503963.0 [2023-02-24 21:16:47,467][213368] Sum rewards: 42.881, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.947', 'AMMO2': '0.013', 'AMMO4': '0.065', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon4': '0.312', 'weapon2': '0.720', 'WEAPON3': '1.300', 'HITCOUNT': '2.500', 'weapon3': '2.728', 'DAMAGECOUNT': '11.016', 'FRAGCOUNT': '40.000'} [2023-02-24 21:16:47,494][213383] DAMAGECOUNT value on done: 499864.0 [2023-02-24 21:16:47,495][213383] Sum rewards: 37.995, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.254', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.076', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'WEAPON4': '0.300', 'weapon4': '0.386', 'weapon2': '0.712', 'WEAPON3': '0.850', 'HITCOUNT': '2.410', 'weapon3': '2.502', 'DAMAGECOUNT': '11.004', 'FRAGCOUNT': '33.000'} [2023-02-24 21:16:47,549][213369] DAMAGECOUNT value on done: 501216.0 [2023-02-24 21:16:47,550][213369] Sum rewards: 32.388, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.895', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.150', 'AMMO4': '0.175', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'ARMOR': '0.456', 'weapon4': '0.470', 'weapon2': '0.716', 'WEAPON3': '1.400', 'HITCOUNT': '2.140', 'weapon3': '2.406', 'DAMAGECOUNT': '9.735', 'FRAGCOUNT': '32.500'} [2023-02-24 21:16:47,706][213382] DAMAGECOUNT value on done: 504263.0 [2023-02-24 21:16:47,706][213382] Sum rewards: 48.156, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.882', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.037', 'AMMO3': '0.181', 'weapon5': '0.182', 'AMMO4': '0.185', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon2': '0.590', 'weapon4': '0.798', 'WEAPON3': '1.050', 'weapon3': '2.146', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '11.937', 'FRAGCOUNT': '43.000'} [2023-02-24 21:16:47,742][213368] DAMAGECOUNT value on done: 496314.0 [2023-02-24 21:16:47,742][213368] Sum rewards: 46.063, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.882', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.143', 'weapon4': '0.182', 'weapon5': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.838', 'WEAPON3': '1.000', 'HITCOUNT': '2.450', 'weapon3': '2.544', 'DAMAGECOUNT': '11.505', 'FRAGCOUNT': '39.000'} [2023-02-24 21:16:47,849][213369] DAMAGECOUNT value on done: 490866.0 [2023-02-24 21:16:47,849][213369] Sum rewards: 27.822, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.422', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon2': '0.170', 'weapon5': '0.208', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.586', 'WEAPON3': '1.350', 'HITCOUNT': '1.930', 'weapon3': '2.732', 'DAMAGECOUNT': '9.990', 'FRAGCOUNT': '28.000'} [2023-02-24 21:16:47,998][213382] DAMAGECOUNT value on done: 492290.0 [2023-02-24 21:16:47,998][213382] Sum rewards: 55.654, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.198', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.060', 'AMMO4': '0.120', 'weapon5': '0.158', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.820', 'weapon3': '3.148', 'DAMAGECOUNT': '14.727', 'FRAGCOUNT': '50.000'} [2023-02-24 21:16:48,040][213368] DAMAGECOUNT value on done: 495397.0 [2023-02-24 21:16:48,041][213368] Sum rewards: 35.001, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.755', 'AMMO5': '0.013', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.132', 'weapon5': '0.248', 'WEAPON4': '0.350', 'weapon2': '0.398', 'WEAPON5': '0.400', 'weapon4': '0.564', 'WEAPON3': '0.750', 'HITCOUNT': '2.080', 'weapon3': '2.500', 'DAMAGECOUNT': '9.663', 'FRAGCOUNT': '29.000'} [2023-02-24 21:16:48,109][213383] DAMAGECOUNT value on done: 506408.0 [2023-02-24 21:16:48,109][213383] Sum rewards: 47.529, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.865', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.140', 'AMMO4': '0.152', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.336', 'weapon2': '0.396', 'WEAPON3': '1.150', 'HITCOUNT': '2.870', 'weapon3': '2.896', 'DAMAGECOUNT': '13.230', 'FRAGCOUNT': '41.000'} [2023-02-24 21:16:48,291][213382] DAMAGECOUNT value on done: 499035.0 [2023-02-24 21:16:48,291][213382] Sum rewards: 40.917, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.245', 'AMMO2': '0.025', 'AMMO4': '0.122', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'weapon4': '0.382', 'weapon2': '0.390', 'WEAPON3': '1.050', 'HITCOUNT': '2.590', 'weapon3': '2.990', 'DAMAGECOUNT': '10.731', 'FRAGCOUNT': '36.000'} [2023-02-24 21:16:48,336][213384] DAMAGECOUNT value on done: 507457.0 [2023-02-24 21:16:48,337][213384] Sum rewards: 53.898, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.957', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'WEAPON4': '0.100', 'AMMO4': '0.112', 'weapon5': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.288', 'weapon4': '0.404', 'WEAPON3': '1.250', 'weapon3': '2.928', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.668', 'FRAGCOUNT': '46.000'} [2023-02-24 21:16:48,409][213383] DAMAGECOUNT value on done: 498062.0 [2023-02-24 21:16:48,410][213383] Sum rewards: 39.341, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.769', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon7': '0.056', 'AMMO4': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.120', 'WEAPON7': '0.200', 'AMMO3': '0.248', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON4': '0.350', 'weapon4': '0.458', 'WEAPON3': '1.550', 'weapon3': '2.710', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.195', 'FRAGCOUNT': '37.000'} [2023-02-24 21:16:48,627][213384] DAMAGECOUNT value on done: 492165.0 [2023-02-24 21:16:48,627][213384] Sum rewards: 51.883, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.790', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.112', 'AMMO4': '0.190', 'weapon4': '0.244', 'WEAPON5': '0.250', 'AMMO3': '0.266', 'WEAPON4': '0.300', 'weapon2': '0.380', 'WEAPON3': '1.650', 'weapon3': '3.008', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.415', 'FRAGCOUNT': '49.000'} [2023-02-24 21:16:48,955][213384] DAMAGECOUNT value on done: 501396.0 [2023-02-24 21:16:48,955][213384] Sum rewards: 42.728, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.900', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.120', 'AMMO4': '0.232', 'AMMO3': '0.271', 'weapon4': '0.318', 'WEAPON5': '0.350', 'weapon2': '0.364', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'HITCOUNT': '2.700', 'weapon3': '2.900', 'DAMAGECOUNT': '13.056', 'FRAGCOUNT': '42.000'} [2023-02-24 21:16:49,249][213384] DAMAGECOUNT value on done: 506246.0 [2023-02-24 21:16:49,249][213384] Sum rewards: 36.532, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.470', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.063', 'AMMO3': '0.141', 'weapon5': '0.154', 'WEAPON5': '0.300', 'AMMO4': '0.314', 'weapon2': '0.434', 'WEAPON4': '0.650', 'weapon4': '0.812', 'WEAPON3': '0.900', 'HITCOUNT': '2.230', 'weapon3': '2.284', 'DAMAGECOUNT': '9.456', 'FRAGCOUNT': '34.000'} [2023-02-24 21:16:49,710][213365] Updated weights for policy 0, policy_version 34726 (0.0009) [2023-02-24 21:16:50,243][213332] Fps is (10 sec: 13926.2, 60 sec: 13858.1, 300 sec: 13676.5). Total num frames: 142241792. Throughput: 0: 3459.5. Samples: 10549742. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:16:50,243][213332] Avg episode reward: [(0, '43.437')] [2023-02-24 21:16:52,677][213365] Updated weights for policy 0, policy_version 34736 (0.0008) [2023-02-24 21:16:55,243][213332] Fps is (10 sec: 13926.6, 60 sec: 13858.2, 300 sec: 13690.4). Total num frames: 142311424. Throughput: 0: 3460.9. Samples: 10570608. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:16:55,243][213332] Avg episode reward: [(0, '43.437')] [2023-02-24 21:16:55,648][213365] Updated weights for policy 0, policy_version 34746 (0.0009) [2023-02-24 21:16:58,593][213365] Updated weights for policy 0, policy_version 34756 (0.0009) [2023-02-24 21:17:00,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13690.4). Total num frames: 142381056. Throughput: 0: 3460.8. Samples: 10591344. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:17:00,243][213332] Avg episode reward: [(0, '43.437')] [2023-02-24 21:17:01,540][213365] Updated weights for policy 0, policy_version 34766 (0.0009) [2023-02-24 21:17:03,669][213367] DAMAGECOUNT value on done: 500583.0 [2023-02-24 21:17:03,669][213367] Sum rewards: 53.089, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.746', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.130', 'AMMO4': '0.169', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'weapon4': '0.286', 'WEAPON4': '0.350', 'weapon2': '0.666', 'WEAPON3': '1.200', 'weapon3': '2.650', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.833', 'FRAGCOUNT': '47.000'} [2023-02-24 21:17:03,844][213367] DAMAGECOUNT value on done: 505794.0 [2023-02-24 21:17:03,845][213367] Sum rewards: 34.895, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.452', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.108', 'weapon4': '0.134', 'AMMO4': '0.183', 'AMMO3': '0.184', 'WEAPON5': '0.300', 'weapon2': '0.390', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.440', 'weapon3': '3.116', 'DAMAGECOUNT': '10.689', 'FRAGCOUNT': '33.000'} [2023-02-24 21:17:03,986][213367] DAMAGECOUNT value on done: 503192.0 [2023-02-24 21:17:03,986][213367] Sum rewards: 41.320, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.960', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.034', 'AMMO3': '0.147', 'AMMO4': '0.172', 'weapon5': '0.236', 'weapon4': '0.316', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'HITCOUNT': '2.530', 'weapon3': '2.836', 'DAMAGECOUNT': '11.805', 'FRAGCOUNT': '35.000'} [2023-02-24 21:17:04,151][213367] DAMAGECOUNT value on done: 512993.0 [2023-02-24 21:17:04,152][213367] Sum rewards: 52.723, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.270', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon5': '0.154', 'AMMO4': '0.168', 'AMMO3': '0.193', 'WEAPON5': '0.350', 'weapon4': '0.362', 'WEAPON4': '0.450', 'weapon2': '0.670', 'WEAPON3': '1.250', 'weapon3': '2.542', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.955', 'FRAGCOUNT': '46.000'} [2023-02-24 21:17:04,499][213365] Updated weights for policy 0, policy_version 34776 (0.0009) [2023-02-24 21:17:04,845][213372] DAMAGECOUNT value on done: 516228.0 [2023-02-24 21:17:04,845][213372] Sum rewards: 41.743, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.022', 'ARMOR': '0.004', 'AMMO2': '0.005', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.024', 'weapon5': '0.130', 'AMMO3': '0.154', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.400', 'weapon4': '0.628', 'WEAPON3': '1.050', 'weapon3': '2.554', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '11.547', 'FRAGCOUNT': '37.000'} [2023-02-24 21:17:05,072][213372] DAMAGECOUNT value on done: 498832.0 [2023-02-24 21:17:05,073][213372] Sum rewards: 46.027, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.848', 'ARMOR': '0.012', 'AMMO5': '0.021', 'AMMO2': '0.046', 'weapon5': '0.166', 'AMMO3': '0.197', 'AMMO4': '0.229', 'weapon2': '0.306', 'weapon4': '0.358', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.860', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.710', 'FRAGCOUNT': '42.000'} [2023-02-24 21:17:05,144][213372] DAMAGECOUNT value on done: 511094.0 [2023-02-24 21:17:05,144][213372] Sum rewards: 36.220, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.993', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon5': '0.170', 'AMMO3': '0.175', 'AMMO4': '0.217', 'weapon4': '0.382', 'weapon2': '0.436', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.440', 'weapon3': '2.758', 'DAMAGECOUNT': '11.466', 'FRAGCOUNT': '32.500'} [2023-02-24 21:17:05,243][213332] Fps is (10 sec: 13926.2, 60 sec: 13858.1, 300 sec: 13704.2). Total num frames: 142450688. Throughput: 0: 3460.3. Samples: 10601750. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:17:05,243][213332] Avg episode reward: [(0, '43.587')] [2023-02-24 21:17:05,377][213372] DAMAGECOUNT value on done: 504308.0 [2023-02-24 21:17:05,378][213372] Sum rewards: 50.063, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.222', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.172', 'AMMO4': '0.196', 'weapon4': '0.242', 'WEAPON5': '0.250', 'AMMO3': '0.263', 'weapon2': '0.318', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '2.950', 'weapon3': '2.980', 'DAMAGECOUNT': '13.860', 'FRAGCOUNT': '48.000'} [2023-02-24 21:17:05,602][213366] DAMAGECOUNT value on done: 494791.0 [2023-02-24 21:17:05,603][213366] Sum rewards: 40.431, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.260', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.117', 'weapon5': '0.160', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.458', 'weapon4': '0.728', 'WEAPON3': '0.750', 'weapon3': '2.016', 'HITCOUNT': '2.140', 'DAMAGECOUNT': '9.414', 'FRAGCOUNT': '32.000'} [2023-02-24 21:17:05,907][213366] DAMAGECOUNT value on done: 520633.0 [2023-02-24 21:17:05,908][213366] Sum rewards: 27.094, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.982', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.085', 'weapon7': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO3': '0.206', 'weapon5': '0.274', 'AMMO4': '0.424', 'weapon2': '0.460', 'WEAPON5': '0.550', 'weapon4': '0.826', 'WEAPON4': '0.900', 'WEAPON3': '1.150', 'weapon3': '1.892', 'HITCOUNT': '1.910', 'DAMAGECOUNT': '10.083', 'FRAGCOUNT': '29.500'} [2023-02-24 21:17:05,921][213366] DAMAGECOUNT value on done: 509621.0 [2023-02-24 21:17:05,922][213366] Sum rewards: 56.385, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.610', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.096', 'AMMO3': '0.153', 'AMMO4': '0.162', 'WEAPON5': '0.200', 'weapon2': '0.324', 'WEAPON4': '0.350', 'weapon4': '0.462', 'WEAPON3': '0.900', 'weapon3': '2.878', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.530', 'FRAGCOUNT': '47.000'} [2023-02-24 21:17:06,210][213366] DAMAGECOUNT value on done: 509688.0 [2023-02-24 21:17:06,211][213366] Sum rewards: 48.807, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.680', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '2.930', 'weapon3': '3.032', 'DAMAGECOUNT': '13.443', 'FRAGCOUNT': '42.000'} [2023-02-24 21:17:06,448][213369] DAMAGECOUNT value on done: 507032.0 [2023-02-24 21:17:06,448][213369] Sum rewards: 51.546, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.010', 'AMMO2': '0.022', 'HEALTH': '0.094', 'AMMO4': '0.110', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon5': '0.202', 'WEAPON5': '0.250', 'weapon4': '0.426', 'weapon2': '0.556', 'WEAPON3': '0.950', 'weapon3': '2.498', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.009', 'FRAGCOUNT': '44.000'} [2023-02-24 21:17:06,534][213368] DAMAGECOUNT value on done: 497945.0 [2023-02-24 21:17:06,534][213368] Sum rewards: 34.563, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.432', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon7': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.134', 'weapon5': '0.184', 'WEAPON7': '0.200', 'AMMO4': '0.211', 'WEAPON5': '0.350', 'weapon2': '0.452', 'WEAPON4': '0.500', 'weapon4': '0.772', 'WEAPON3': '0.850', 'weapon3': '2.184', 'HITCOUNT': '2.220', 'DAMAGECOUNT': '9.585', 'FRAGCOUNT': '31.500'} [2023-02-24 21:17:06,581][213383] DAMAGECOUNT value on done: 499947.0 [2023-02-24 21:17:06,582][213383] Sum rewards: 30.104, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.180', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.124', 'AMMO4': '0.141', 'AMMO3': '0.144', 'WEAPON4': '0.300', 'weapon2': '0.460', 'WEAPON3': '0.900', 'weapon4': '1.030', 'HITCOUNT': '1.970', 'weapon3': '2.034', 'DAMAGECOUNT': '7.830', 'FRAGCOUNT': '26.000'} [2023-02-24 21:17:06,730][213382] DAMAGECOUNT value on done: 509961.0 [2023-02-24 21:17:06,731][213382] Sum rewards: 43.249, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.250', 'AMMO2': '0.003', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.017', 'weapon4': '0.068', 'WEAPON4': '0.100', 'weapon5': '0.156', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'weapon2': '0.642', 'WEAPON3': '1.250', 'HITCOUNT': '2.740', 'weapon3': '2.880', 'DAMAGECOUNT': '11.994', 'FRAGCOUNT': '38.000'} [2023-02-24 21:17:06,755][213369] DAMAGECOUNT value on done: 510290.0 [2023-02-24 21:17:06,755][213369] Sum rewards: 52.324, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.962', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.014', 'AMMO4': '0.069', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'weapon5': '0.208', 'WEAPON5': '0.250', 'weapon4': '0.340', 'weapon2': '0.430', 'WEAPON3': '1.000', 'weapon3': '2.670', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.909', 'FRAGCOUNT': '43.000'} [2023-02-24 21:17:06,823][213368] DAMAGECOUNT value on done: 508997.0 [2023-02-24 21:17:06,824][213368] Sum rewards: 54.515, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.300', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.088', 'weapon4': '0.146', 'AMMO4': '0.163', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.404', 'WEAPON3': '1.450', 'weapon3': '3.050', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.057', 'FRAGCOUNT': '48.000'} [2023-02-24 21:17:06,876][213383] DAMAGECOUNT value on done: 503022.0 [2023-02-24 21:17:06,877][213383] Sum rewards: 34.259, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.126', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.120', 'AMMO4': '0.219', 'AMMO3': '0.230', 'weapon4': '0.252', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.916', 'WEAPON3': '1.250', 'HITCOUNT': '2.370', 'weapon3': '2.394', 'DAMAGECOUNT': '9.474', 'FRAGCOUNT': '32.000'} [2023-02-24 21:17:06,968][213369] DAMAGECOUNT value on done: 505596.0 [2023-02-24 21:17:06,969][213369] Sum rewards: 53.579, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.436', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.078', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.184', 'weapon4': '0.336', 'weapon2': '0.432', 'WEAPON3': '1.300', 'weapon3': '2.892', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.140', 'FRAGCOUNT': '47.000'} [2023-02-24 21:17:07,037][213382] DAMAGECOUNT value on done: 508331.0 [2023-02-24 21:17:07,037][213382] Sum rewards: 51.122, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.590', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.003', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.198', 'AMMO3': '0.203', 'weapon4': '0.224', 'WEAPON3': '1.250', 'HITCOUNT': '2.830', 'weapon3': '3.304', 'DAMAGECOUNT': '12.204', 'FRAGCOUNT': '45.000'} [2023-02-24 21:17:07,102][213368] DAMAGECOUNT value on done: 500099.0 [2023-02-24 21:17:07,102][213368] Sum rewards: 38.862, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.573', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.168', 'weapon4': '0.188', 'weapon2': '0.220', 'WEAPON4': '0.250', 'AMMO3': '0.270', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '2.280', 'weapon3': '3.120', 'DAMAGECOUNT': '11.355', 'FRAGCOUNT': '39.000'} [2023-02-24 21:17:07,273][213369] DAMAGECOUNT value on done: 495175.0 [2023-02-24 21:17:07,273][213369] Sum rewards: 50.369, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.363', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.128', 'AMMO4': '0.145', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'weapon4': '0.266', 'WEAPON4': '0.300', 'weapon2': '0.792', 'WEAPON3': '0.950', 'weapon3': '2.564', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.927', 'FRAGCOUNT': '43.000'} [2023-02-24 21:17:07,351][213382] DAMAGECOUNT value on done: 494865.0 [2023-02-24 21:17:07,352][213382] Sum rewards: 29.798, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.480', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.115', 'weapon5': '0.118', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.442', 'WEAPON3': '0.750', 'weapon2': '1.010', 'weapon3': '1.694', 'HITCOUNT': '1.880', 'DAMAGECOUNT': '7.725', 'FRAGCOUNT': '27.000'} [2023-02-24 21:17:07,404][213368] DAMAGECOUNT value on done: 499170.0 [2023-02-24 21:17:07,405][213368] Sum rewards: 42.791, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.865', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO5': '0.012', 'weapon4': '0.032', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'weapon5': '0.142', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'weapon2': '0.804', 'WEAPON3': '1.350', 'HITCOUNT': '2.410', 'weapon3': '2.776', 'DAMAGECOUNT': '11.319', 'FRAGCOUNT': '38.000'} [2023-02-24 21:17:07,471][213365] Updated weights for policy 0, policy_version 34786 (0.0010) [2023-02-24 21:17:07,509][213383] DAMAGECOUNT value on done: 510892.0 [2023-02-24 21:17:07,510][213383] Sum rewards: 46.196, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.502', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.059', 'weapon5': '0.142', 'AMMO3': '0.223', 'AMMO4': '0.295', 'WEAPON5': '0.400', 'weapon2': '0.486', 'weapon4': '0.494', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.442', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.452', 'FRAGCOUNT': '44.000'} [2023-02-24 21:17:07,658][213382] DAMAGECOUNT value on done: 503002.0 [2023-02-24 21:17:07,659][213382] Sum rewards: 43.218, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.022', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon5': '0.140', 'AMMO4': '0.175', 'AMMO3': '0.179', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.398', 'weapon2': '0.474', 'WEAPON3': '1.100', 'HITCOUNT': '2.360', 'weapon3': '2.614', 'DAMAGECOUNT': '11.901', 'FRAGCOUNT': '38.000'} [2023-02-24 21:17:07,767][213384] DAMAGECOUNT value on done: 511376.0 [2023-02-24 21:17:07,767][213384] Sum rewards: 49.989, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.578', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon2': '0.260', 'weapon4': '0.386', 'WEAPON3': '1.200', 'HITCOUNT': '2.770', 'weapon3': '3.002', 'DAMAGECOUNT': '11.757', 'FRAGCOUNT': '44.000'} [2023-02-24 21:17:07,813][213383] DAMAGECOUNT value on done: 502234.0 [2023-02-24 21:17:07,813][213383] Sum rewards: 46.911, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.952', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.023', 'weapon5': '0.100', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'weapon4': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'weapon2': '0.374', 'WEAPON3': '1.500', 'HITCOUNT': '2.740', 'weapon3': '3.104', 'DAMAGECOUNT': '12.516', 'FRAGCOUNT': '43.500'} [2023-02-24 21:17:08,057][213384] DAMAGECOUNT value on done: 496146.0 [2023-02-24 21:17:08,057][213384] Sum rewards: 41.428, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.745', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.042', 'weapon5': '0.198', 'AMMO4': '0.212', 'AMMO3': '0.229', 'weapon2': '0.254', 'weapon4': '0.382', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'HITCOUNT': '2.420', 'weapon3': '2.868', 'DAMAGECOUNT': '11.943', 'FRAGCOUNT': '39.000'} [2023-02-24 21:17:08,377][213384] DAMAGECOUNT value on done: 505354.0 [2023-02-24 21:17:08,378][213384] Sum rewards: 36.411, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.915', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.072', 'AMMO4': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.259', 'WEAPON4': '0.350', 'weapon4': '0.376', 'weapon2': '0.474', 'WEAPON3': '1.550', 'HITCOUNT': '2.620', 'weapon3': '2.854', 'DAMAGECOUNT': '11.874', 'FRAGCOUNT': '36.000'} [2023-02-24 21:17:08,680][213384] DAMAGECOUNT value on done: 510518.0 [2023-02-24 21:17:08,680][213384] Sum rewards: 38.274, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.294', 'AMMO5': '0.014', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon5': '0.206', 'weapon4': '0.250', 'AMMO3': '0.273', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'HITCOUNT': '2.500', 'weapon3': '2.854', 'DAMAGECOUNT': '12.816', 'FRAGCOUNT': '37.000'} [2023-02-24 21:17:10,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13718.1). Total num frames: 142520320. Throughput: 0: 3459.0. Samples: 10622496. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:17:10,243][213332] Avg episode reward: [(0, '43.746')] [2023-02-24 21:17:10,399][213365] Updated weights for policy 0, policy_version 34796 (0.0009) [2023-02-24 21:17:13,332][213365] Updated weights for policy 0, policy_version 34806 (0.0009) [2023-02-24 21:17:15,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13718.1). Total num frames: 142589952. Throughput: 0: 3461.1. Samples: 10643266. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:17:15,243][213332] Avg episode reward: [(0, '43.746')] [2023-02-24 21:17:16,322][213365] Updated weights for policy 0, policy_version 34816 (0.0009) [2023-02-24 21:17:19,257][213365] Updated weights for policy 0, policy_version 34826 (0.0009) [2023-02-24 21:17:20,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13732.0). Total num frames: 142659584. Throughput: 0: 3458.4. Samples: 10653620. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:17:20,243][213332] Avg episode reward: [(0, '43.746')] [2023-02-24 21:17:22,245][213365] Updated weights for policy 0, policy_version 34836 (0.0009) [2023-02-24 21:17:23,110][213367] DAMAGECOUNT value on done: 504720.0 [2023-02-24 21:17:23,110][213367] Sum rewards: 47.431, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.650', 'AMMO2': '0.022', 'AMMO4': '0.109', 'AMMO3': '0.175', 'weapon4': '0.238', 'WEAPON4': '0.300', 'weapon2': '0.812', 'WEAPON3': '1.200', 'weapon3': '2.764', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.411', 'FRAGCOUNT': '42.000'} [2023-02-24 21:17:23,285][213367] DAMAGECOUNT value on done: 509646.0 [2023-02-24 21:17:23,286][213367] Sum rewards: 41.582, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.666', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.030', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.136', 'AMMO4': '0.151', 'AMMO3': '0.189', 'weapon7': '0.196', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.276', 'WEAPON4': '0.500', 'weapon4': '0.732', 'WEAPON3': '1.150', 'weapon3': '2.206', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '11.556', 'FRAGCOUNT': '37.500'} [2023-02-24 21:17:23,424][213367] DAMAGECOUNT value on done: 507552.0 [2023-02-24 21:17:23,425][213367] Sum rewards: 51.754, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.764', 'AMMO5': '0.005', 'AMMO2': '0.061', 'weapon5': '0.116', 'AMMO3': '0.155', 'WEAPON5': '0.200', 'AMMO4': '0.303', 'WEAPON4': '0.500', 'weapon2': '0.646', 'weapon4': '0.656', 'WEAPON3': '0.950', 'weapon3': '2.336', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.080', 'FRAGCOUNT': '45.000'} [2023-02-24 21:17:23,610][213367] DAMAGECOUNT value on done: 516774.0 [2023-02-24 21:17:23,611][213367] Sum rewards: 36.098, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.314', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.058', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon2': '0.538', 'weapon4': '0.604', 'WEAPON3': '1.250', 'weapon3': '2.554', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '11.343', 'FRAGCOUNT': '33.000'} [2023-02-24 21:17:24,309][213372] DAMAGECOUNT value on done: 520386.0 [2023-02-24 21:17:24,310][213372] Sum rewards: 49.337, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.105', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.036', 'AMMO3': '0.145', 'weapon5': '0.176', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'weapon2': '0.226', 'WEAPON4': '0.350', 'weapon4': '0.714', 'WEAPON3': '0.850', 'weapon3': '2.522', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '12.474', 'FRAGCOUNT': '41.000'} [2023-02-24 21:17:24,350][213372] Large shaping reward 2.553 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5670000000000001, 189.0), ('HEALTH', -0.036000000000000004, -12.0), ('weapon5', 0.002)] [2023-02-24 21:17:24,533][213372] DAMAGECOUNT value on done: 503399.0 [2023-02-24 21:17:24,534][213372] Sum rewards: 49.971, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.930', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.062', 'AMMO3': '0.141', 'weapon5': '0.178', 'WEAPON5': '0.300', 'AMMO4': '0.310', 'weapon2': '0.466', 'WEAPON4': '0.600', 'WEAPON3': '0.800', 'weapon4': '1.046', 'weapon3': '2.018', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.701', 'FRAGCOUNT': '42.000'} [2023-02-24 21:17:24,622][213372] DAMAGECOUNT value on done: 515536.0 [2023-02-24 21:17:24,623][213372] Sum rewards: 45.077, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.562', 'ARMOR': '0.012', 'AMMO5': '0.021', 'AMMO2': '0.062', 'weapon2': '0.244', 'AMMO3': '0.259', 'AMMO4': '0.312', 'weapon5': '0.368', 'weapon4': '0.480', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.500', 'HITCOUNT': '2.430', 'weapon3': '2.524', 'DAMAGECOUNT': '13.326', 'FRAGCOUNT': '43.000'} [2023-02-24 21:17:24,843][213372] DAMAGECOUNT value on done: 508275.0 [2023-02-24 21:17:24,843][213372] Sum rewards: 47.775, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.804', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.534', 'WEAPON3': '1.300', 'HITCOUNT': '2.560', 'weapon3': '3.084', 'DAMAGECOUNT': '11.901', 'FRAGCOUNT': '41.000'} [2023-02-24 21:17:25,064][213366] DAMAGECOUNT value on done: 498372.0 [2023-02-24 21:17:25,065][213366] Sum rewards: 35.357, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.921', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.034', 'AMMO4': '0.172', 'weapon5': '0.178', 'weapon2': '0.202', 'AMMO3': '0.205', 'WEAPON5': '0.400', 'WEAPON4': '0.650', 'weapon4': '1.114', 'WEAPON3': '1.150', 'weapon3': '1.944', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '10.743', 'FRAGCOUNT': '32.000'} [2023-02-24 21:17:25,203][213365] Updated weights for policy 0, policy_version 34846 (0.0009) [2023-02-24 21:17:25,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13745.9). Total num frames: 142729216. Throughput: 0: 3460.8. Samples: 10674392. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:17:25,243][213332] Avg episode reward: [(0, '43.741')] [2023-02-24 21:17:25,366][213366] DAMAGECOUNT value on done: 525051.0 [2023-02-24 21:17:25,367][213366] Sum rewards: 47.927, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.863', 'AMMO5': '0.011', 'AMMO2': '0.019', 'weapon7': '0.062', 'AMMO4': '0.095', 'weapon4': '0.098', 'weapon5': '0.106', 'weapon2': '0.190', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.252', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '2.700', 'weapon3': '3.304', 'DAMAGECOUNT': '13.254', 'FRAGCOUNT': '44.000'} [2023-02-24 21:17:25,378][213366] DAMAGECOUNT value on done: 513102.0 [2023-02-24 21:17:25,378][213366] Sum rewards: 35.208, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.995', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.054', 'weapon5': '0.074', 'AMMO3': '0.150', 'WEAPON5': '0.250', 'AMMO4': '0.272', 'WEAPON4': '0.500', 'weapon4': '0.640', 'weapon2': '0.648', 'WEAPON3': '0.850', 'HITCOUNT': '2.400', 'weapon3': '2.442', 'DAMAGECOUNT': '10.410', 'FRAGCOUNT': '31.000'} [2023-02-24 21:17:25,692][213366] DAMAGECOUNT value on done: 513549.0 [2023-02-24 21:17:25,692][213366] Sum rewards: 39.365, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.490', 'ARMOR': '0.004', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.043', 'AMMO4': '0.216', 'weapon5': '0.218', 'AMMO3': '0.258', 'weapon4': '0.358', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.652', 'WEAPON3': '1.450', 'weapon3': '2.348', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '11.520', 'FRAGCOUNT': '40.000'} [2023-02-24 21:17:25,918][213369] DAMAGECOUNT value on done: 512067.0 [2023-02-24 21:17:25,918][213369] Sum rewards: 50.229, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.662', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.045', 'weapon5': '0.130', 'AMMO3': '0.204', 'AMMO4': '0.226', 'WEAPON5': '0.300', 'weapon4': '0.426', 'weapon2': '0.470', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.668', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '44.000'} [2023-02-24 21:17:25,975][213383] DAMAGECOUNT value on done: 504743.0 [2023-02-24 21:17:25,975][213383] Sum rewards: 54.846, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.268', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.184', 'weapon5': '0.252', 'weapon2': '0.306', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.624', 'WEAPON3': '1.100', 'weapon3': '2.504', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.388', 'FRAGCOUNT': '47.000'} [2023-02-24 21:17:25,987][213368] DAMAGECOUNT value on done: 502318.0 [2023-02-24 21:17:25,987][213368] Sum rewards: 50.581, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.446', 'AMMO5': '0.005', 'AMMO2': '0.043', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'AMMO4': '0.216', 'weapon2': '0.310', 'ARMOR': '0.404', 'WEAPON4': '0.650', 'WEAPON3': '1.000', 'weapon4': '1.128', 'weapon3': '2.156', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.119', 'FRAGCOUNT': '46.000'} [2023-02-24 21:17:26,169][213382] DAMAGECOUNT value on done: 514010.0 [2023-02-24 21:17:26,169][213382] Sum rewards: 44.062, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.464', 'AMMO5': '0.016', 'AMMO2': '0.043', 'AMMO3': '0.183', 'AMMO4': '0.213', 'weapon5': '0.254', 'weapon2': '0.374', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.606', 'WEAPON3': '1.000', 'weapon3': '2.400', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '12.147', 'FRAGCOUNT': '39.000'} [2023-02-24 21:17:26,221][213369] DAMAGECOUNT value on done: 513857.0 [2023-02-24 21:17:26,221][213369] Sum rewards: 38.148, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.552', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.172', 'weapon2': '0.196', 'AMMO4': '0.198', 'AMMO3': '0.228', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.994', 'WEAPON3': '1.300', 'weapon3': '2.234', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '10.701', 'FRAGCOUNT': '36.000'} [2023-02-24 21:17:26,279][213383] DAMAGECOUNT value on done: 507542.0 [2023-02-24 21:17:26,279][213383] Sum rewards: 50.274, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.522', 'ARMOR': '0.012', 'AMMO5': '0.016', 'AMMO2': '0.044', 'AMMO3': '0.127', 'weapon2': '0.210', 'AMMO4': '0.222', 'weapon5': '0.226', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '0.800', 'weapon4': '0.856', 'weapon3': '2.172', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '13.560', 'FRAGCOUNT': '42.000'} [2023-02-24 21:17:26,290][213368] DAMAGECOUNT value on done: 512626.0 [2023-02-24 21:17:26,291][213368] Sum rewards: 33.265, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.134', 'WEAPON1': '0.020', 'AMMO5': '0.028', 'AMMO2': '0.039', 'AMMO3': '0.151', 'AMMO4': '0.195', 'weapon2': '0.342', 'weapon5': '0.410', 'WEAPON4': '0.550', 'WEAPON5': '0.800', 'WEAPON3': '0.900', 'weapon4': '0.936', 'weapon3': '1.530', 'HITCOUNT': '2.360', 'DAMAGECOUNT': '10.887', 'FRAGCOUNT': '30.000'} [2023-02-24 21:17:26,427][213369] DAMAGECOUNT value on done: 509063.0 [2023-02-24 21:17:26,428][213369] Sum rewards: 38.564, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.409', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon7': '0.052', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.120', 'AMMO4': '0.121', 'WEAPON7': '0.200', 'AMMO3': '0.201', 'WEAPON4': '0.350', 'weapon2': '0.386', 'weapon4': '0.554', 'WEAPON3': '1.250', 'HITCOUNT': '2.300', 'weapon3': '2.668', 'DAMAGECOUNT': '10.401', 'FRAGCOUNT': '35.500'} [2023-02-24 21:17:26,469][213382] DAMAGECOUNT value on done: 512688.0 [2023-02-24 21:17:26,470][213382] Sum rewards: 49.192, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.940', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.040', 'weapon5': '0.054', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'AMMO4': '0.201', 'WEAPON4': '0.450', 'weapon4': '0.524', 'weapon2': '0.654', 'WEAPON3': '1.100', 'weapon3': '2.532', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.071', 'FRAGCOUNT': '44.000'} [2023-02-24 21:17:26,557][213368] DAMAGECOUNT value on done: 504836.0 [2023-02-24 21:17:26,557][213368] Sum rewards: 52.183, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.035', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.032', 'AMMO4': '0.059', 'weapon5': '0.064', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon2': '0.356', 'WEAPON3': '1.450', 'HITCOUNT': '2.920', 'weapon3': '3.322', 'DAMAGECOUNT': '14.211', 'FRAGCOUNT': '47.000'} [2023-02-24 21:17:26,727][213369] DAMAGECOUNT value on done: 499497.0 [2023-02-24 21:17:26,727][213369] Sum rewards: 54.296, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.870', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.037', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.193', 'weapon2': '0.720', 'WEAPON3': '1.200', 'HITCOUNT': '2.870', 'weapon3': '2.910', 'DAMAGECOUNT': '12.966', 'FRAGCOUNT': '47.000'} [2023-02-24 21:17:26,788][213382] DAMAGECOUNT value on done: 498683.0 [2023-02-24 21:17:26,789][213382] Sum rewards: 35.962, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.185', 'AMMO5': '0.016', 'AMMO2': '0.034', 'AMMO4': '0.171', 'AMMO3': '0.232', 'weapon2': '0.314', 'weapon5': '0.334', 'WEAPON5': '0.550', 'WEAPON4': '0.700', 'weapon4': '0.910', 'WEAPON3': '1.350', 'weapon3': '2.022', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '11.454', 'FRAGCOUNT': '36.000'} [2023-02-24 21:17:26,857][213368] DAMAGECOUNT value on done: 503694.0 [2023-02-24 21:17:26,858][213368] Sum rewards: 49.754, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.745', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.128', 'weapon4': '0.138', 'AMMO4': '0.146', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.300', 'weapon3': '3.170', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.497', 'FRAGCOUNT': '44.000'} [2023-02-24 21:17:26,908][213383] DAMAGECOUNT value on done: 514284.0 [2023-02-24 21:17:26,909][213383] Sum rewards: 36.044, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.284', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon5': '0.060', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'weapon4': '0.180', 'AMMO3': '0.234', 'WEAPON5': '0.250', 'weapon2': '0.408', 'WEAPON3': '1.350', 'HITCOUNT': '2.600', 'weapon3': '3.122', 'DAMAGECOUNT': '10.176', 'FRAGCOUNT': '33.000'} [2023-02-24 21:17:27,091][213382] DAMAGECOUNT value on done: 505979.0 [2023-02-24 21:17:27,092][213382] Sum rewards: 31.561, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.363', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.054', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'weapon4': '0.104', 'WEAPON4': '0.200', 'AMMO3': '0.249', 'weapon2': '0.410', 'WEAPON3': '1.450', 'HITCOUNT': '2.170', 'weapon3': '3.150', 'DAMAGECOUNT': '8.931', 'FRAGCOUNT': '32.000'} [2023-02-24 21:17:27,207][213383] DAMAGECOUNT value on done: 506564.0 [2023-02-24 21:17:27,207][213383] Sum rewards: 45.471, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.920', 'AMMO5': '0.014', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.102', 'weapon4': '0.184', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon2': '0.332', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.770', 'weapon3': '3.154', 'DAMAGECOUNT': '12.975', 'FRAGCOUNT': '40.000'} [2023-02-24 21:17:27,260][213384] DAMAGECOUNT value on done: 514184.0 [2023-02-24 21:17:27,260][213384] Sum rewards: 30.227, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.618', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.138', 'AMMO3': '0.177', 'AMMO4': '0.183', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.402', 'weapon4': '0.880', 'WEAPON3': '1.100', 'HITCOUNT': '2.000', 'weapon3': '2.192', 'DAMAGECOUNT': '8.424', 'FRAGCOUNT': '28.000'} [2023-02-24 21:17:27,562][213384] DAMAGECOUNT value on done: 500204.0 [2023-02-24 21:17:27,562][213384] Sum rewards: 41.263, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.062', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.169', 'AMMO3': '0.183', 'weapon5': '0.198', 'weapon2': '0.276', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.572', 'WEAPON3': '1.150', 'weapon3': '2.324', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '11.859', 'FRAGCOUNT': '37.000'} [2023-02-24 21:17:27,911][213384] DAMAGECOUNT value on done: 509614.0 [2023-02-24 21:17:27,912][213384] Sum rewards: 50.221, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.457', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.148', 'weapon5': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.370', 'weapon2': '0.492', 'WEAPON3': '1.000', 'HITCOUNT': '2.700', 'weapon3': '2.710', 'DAMAGECOUNT': '12.780', 'FRAGCOUNT': '42.500'} [2023-02-24 21:17:28,202][213365] Updated weights for policy 0, policy_version 34856 (0.0009) [2023-02-24 21:17:28,213][213384] DAMAGECOUNT value on done: 514387.0 [2023-02-24 21:17:28,213][213384] Sum rewards: 41.912, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.247', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon5': '0.188', 'AMMO3': '0.241', 'AMMO4': '0.252', 'ARMOR': '0.400', 'weapon2': '0.408', 'weapon4': '0.476', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.450', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '11.565', 'FRAGCOUNT': '42.000'} [2023-02-24 21:17:30,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13789.9, 300 sec: 13732.0). Total num frames: 142794752. Throughput: 0: 3458.6. Samples: 10695048. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:17:30,243][213332] Avg episode reward: [(0, '43.400')] [2023-02-24 21:17:31,128][213365] Updated weights for policy 0, policy_version 34866 (0.0009) [2023-02-24 21:17:34,072][213365] Updated weights for policy 0, policy_version 34876 (0.0009) [2023-02-24 21:17:34,389][213367] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('HEALTH', -0.015, -5.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 21:17:35,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13789.9, 300 sec: 13745.9). Total num frames: 142864384. Throughput: 0: 3461.3. Samples: 10705498. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:17:35,243][213332] Avg episode reward: [(0, '43.400')] [2023-02-24 21:17:37,051][213365] Updated weights for policy 0, policy_version 34886 (0.0009) [2023-02-24 21:17:40,032][213365] Updated weights for policy 0, policy_version 34896 (0.0009) [2023-02-24 21:17:40,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13745.9). Total num frames: 142934016. Throughput: 0: 3457.7. Samples: 10726206. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:17:40,243][213332] Avg episode reward: [(0, '43.400')] [2023-02-24 21:17:42,543][213367] DAMAGECOUNT value on done: 508350.0 [2023-02-24 21:17:42,544][213367] Sum rewards: 38.260, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.165', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.154', 'weapon2': '0.214', 'AMMO3': '0.232', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '2.510', 'weapon3': '2.728', 'DAMAGECOUNT': '10.890', 'FRAGCOUNT': '36.000'} [2023-02-24 21:17:42,723][213367] DAMAGECOUNT value on done: 513209.0 [2023-02-24 21:17:42,723][213367] Sum rewards: 42.238, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.630', 'AMMO5': '0.014', 'weapon7': '0.050', 'AMMO2': '0.053', 'weapon5': '0.116', 'AMMO3': '0.157', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.263', 'weapon2': '0.278', 'WEAPON4': '0.550', 'weapon4': '0.688', 'WEAPON3': '0.950', 'weapon3': '2.360', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '10.689', 'FRAGCOUNT': '38.000'} [2023-02-24 21:17:42,846][213367] DAMAGECOUNT value on done: 511226.0 [2023-02-24 21:17:42,847][213367] Sum rewards: 41.943, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.978', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.045', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.144', 'AMMO3': '0.169', 'weapon7': '0.188', 'AMMO4': '0.223', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.352', 'weapon2': '0.514', 'WEAPON3': '1.050', 'HITCOUNT': '2.390', 'weapon3': '2.556', 'DAMAGECOUNT': '11.022', 'FRAGCOUNT': '37.000'} [2023-02-24 21:17:42,977][213365] Updated weights for policy 0, policy_version 34906 (0.0009) [2023-02-24 21:17:43,026][213367] DAMAGECOUNT value on done: 520769.0 [2023-02-24 21:17:43,026][213367] Sum rewards: 43.938, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.804', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.090', 'weapon5': '0.098', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.478', 'WEAPON3': '1.250', 'HITCOUNT': '2.690', 'weapon3': '3.106', 'DAMAGECOUNT': '11.985', 'FRAGCOUNT': '40.000'} [2023-02-24 21:17:43,677][213372] DAMAGECOUNT value on done: 525400.0 [2023-02-24 21:17:43,678][213372] Sum rewards: 56.789, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.204', 'ARMOR': '0.004', 'AMMO2': '0.013', 'AMMO5': '0.015', 'weapon4': '0.050', 'AMMO4': '0.064', 'weapon5': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'weapon2': '0.408', 'WEAPON3': '1.200', 'HITCOUNT': '2.990', 'weapon3': '3.228', 'DAMAGECOUNT': '15.042', 'FRAGCOUNT': '48.000'} [2023-02-24 21:17:43,913][213372] DAMAGECOUNT value on done: 507206.0 [2023-02-24 21:17:43,913][213372] Sum rewards: 41.309, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.000', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.046', 'AMMO2': '0.053', 'WEAPON5': '0.100', 'AMMO3': '0.147', 'AMMO4': '0.265', 'WEAPON4': '0.400', 'weapon4': '0.448', 'weapon2': '0.680', 'WEAPON3': '0.900', 'HITCOUNT': '2.450', 'weapon3': '2.642', 'DAMAGECOUNT': '11.421', 'FRAGCOUNT': '35.000'} [2023-02-24 21:17:43,983][213372] DAMAGECOUNT value on done: 519297.0 [2023-02-24 21:17:43,984][213372] Sum rewards: 38.095, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.384', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.035', 'weapon5': '0.056', 'WEAPON5': '0.100', 'weapon4': '0.158', 'AMMO4': '0.176', 'WEAPON4': '0.200', 'weapon2': '0.204', 'AMMO3': '0.236', 'WEAPON3': '1.500', 'HITCOUNT': '2.390', 'weapon3': '3.384', 'DAMAGECOUNT': '11.283', 'FRAGCOUNT': '36.000'} [2023-02-24 21:17:44,218][213372] DAMAGECOUNT value on done: 512521.0 [2023-02-24 21:17:44,219][213372] Sum rewards: 44.590, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.587', 'AMMO5': '0.018', 'AMMO2': '0.046', 'weapon4': '0.124', 'weapon5': '0.186', 'AMMO4': '0.229', 'AMMO3': '0.266', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.624', 'WEAPON3': '1.500', 'HITCOUNT': '2.560', 'weapon3': '2.736', 'DAMAGECOUNT': '12.738', 'FRAGCOUNT': '44.000'} [2023-02-24 21:17:44,473][213366] DAMAGECOUNT value on done: 502052.0 [2023-02-24 21:17:44,473][213366] Sum rewards: 44.429, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.670', 'AMMO2': '0.009', 'AMMO5': '0.013', 'weapon5': '0.014', 'AMMO4': '0.044', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'weapon2': '0.252', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'weapon4': '1.156', 'weapon3': '2.160', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '11.040', 'FRAGCOUNT': '39.000'} [2023-02-24 21:17:44,773][213366] DAMAGECOUNT value on done: 529358.0 [2023-02-24 21:17:44,774][213366] Sum rewards: 53.439, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.236', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon4': '0.066', 'weapon5': '0.128', 'AMMO4': '0.154', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.676', 'WEAPON3': '1.200', 'HITCOUNT': '2.790', 'weapon3': '2.876', 'DAMAGECOUNT': '12.921', 'FRAGCOUNT': '48.000'} [2023-02-24 21:17:44,786][213366] DAMAGECOUNT value on done: 516512.0 [2023-02-24 21:17:44,787][213366] Sum rewards: 39.578, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.087', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO4': '0.042', 'WEAPON5': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'weapon7': '0.212', 'weapon4': '0.276', 'weapon2': '0.680', 'WEAPON3': '1.000', 'HITCOUNT': '2.590', 'weapon3': '2.734', 'DAMAGECOUNT': '10.230', 'FRAGCOUNT': '33.000'} [2023-02-24 21:17:45,081][213366] DAMAGECOUNT value on done: 517764.0 [2023-02-24 21:17:45,081][213366] Sum rewards: 45.241, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.061', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.074', 'AMMO3': '0.128', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'WEAPON4': '0.400', 'weapon2': '0.416', 'weapon4': '0.682', 'WEAPON3': '0.800', 'weapon3': '2.586', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.645', 'FRAGCOUNT': '37.500'} [2023-02-24 21:17:45,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13759.8). Total num frames: 143003648. Throughput: 0: 3460.9. Samples: 10747086. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:17:45,243][213332] Avg episode reward: [(0, '43.458')] [2023-02-24 21:17:45,340][213383] DAMAGECOUNT value on done: 508953.0 [2023-02-24 21:17:45,340][213383] Sum rewards: 43.614, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.550', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.158', 'AMMO3': '0.181', 'weapon4': '0.382', 'weapon2': '0.586', 'WEAPON3': '1.050', 'weapon3': '2.688', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.630', 'FRAGCOUNT': '36.000'} [2023-02-24 21:17:45,345][213369] DAMAGECOUNT value on done: 515398.0 [2023-02-24 21:17:45,345][213369] Sum rewards: 38.562, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.747', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.164', 'weapon5': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon2': '0.594', 'weapon4': '0.906', 'WEAPON3': '1.000', 'weapon3': '2.028', 'HITCOUNT': '2.200', 'DAMAGECOUNT': '9.993', 'FRAGCOUNT': '36.000'} [2023-02-24 21:17:45,358][213368] DAMAGECOUNT value on done: 506373.0 [2023-02-24 21:17:45,358][213368] Sum rewards: 41.637, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.456', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.035', 'weapon5': '0.144', 'AMMO4': '0.175', 'weapon4': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.288', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.580', 'weapon3': '3.120', 'DAMAGECOUNT': '12.165', 'FRAGCOUNT': '39.000'} [2023-02-24 21:17:45,549][213382] DAMAGECOUNT value on done: 518457.0 [2023-02-24 21:17:45,550][213382] Sum rewards: 49.341, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.028', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.050', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'weapon4': '0.440', 'weapon2': '0.578', 'WEAPON3': '1.300', 'weapon3': '2.732', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.341', 'FRAGCOUNT': '44.000'} [2023-02-24 21:17:45,637][213383] DAMAGECOUNT value on done: 511295.0 [2023-02-24 21:17:45,637][213383] Sum rewards: 43.868, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.031', 'AMMO3': '0.112', 'AMMO4': '0.156', 'weapon5': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HEALTH': '0.316', 'weapon4': '0.586', 'weapon2': '0.616', 'WEAPON3': '0.650', 'weapon3': '2.330', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '11.259', 'FRAGCOUNT': '36.000'} [2023-02-24 21:17:45,640][213369] DAMAGECOUNT value on done: 517670.0 [2023-02-24 21:17:45,641][213369] Sum rewards: 36.540, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.800', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon5': '0.094', 'weapon4': '0.098', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'AMMO3': '0.233', 'weapon2': '0.248', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '2.390', 'weapon3': '3.328', 'DAMAGECOUNT': '11.439', 'FRAGCOUNT': '34.500'} [2023-02-24 21:17:45,658][213368] DAMAGECOUNT value on done: 516106.0 [2023-02-24 21:17:45,659][213368] Sum rewards: 37.284, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.780', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon5': '0.132', 'AMMO4': '0.162', 'AMMO3': '0.220', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.418', 'WEAPON3': '1.300', 'HITCOUNT': '2.280', 'weapon3': '2.856', 'DAMAGECOUNT': '10.440', 'FRAGCOUNT': '36.000'} [2023-02-24 21:17:45,824][213369] DAMAGECOUNT value on done: 512488.0 [2023-02-24 21:17:45,824][213369] Sum rewards: 34.006, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.075', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.064', 'AMMO4': '0.153', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.388', 'weapon4': '0.702', 'WEAPON3': '1.400', 'HITCOUNT': '2.170', 'weapon3': '2.662', 'DAMAGECOUNT': '10.275', 'FRAGCOUNT': '32.000'} [2023-02-24 21:17:45,850][213382] DAMAGECOUNT value on done: 516004.0 [2023-02-24 21:17:45,851][213382] Sum rewards: 36.477, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.705', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.108', 'weapon2': '0.144', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.526', 'WEAPON3': '1.050', 'HITCOUNT': '2.140', 'weapon3': '2.846', 'DAMAGECOUNT': '9.948', 'FRAGCOUNT': '32.000'} [2023-02-24 21:17:45,914][213365] Updated weights for policy 0, policy_version 34916 (0.0009) [2023-02-24 21:17:45,923][213368] DAMAGECOUNT value on done: 509074.0 [2023-02-24 21:17:45,923][213368] Sum rewards: 43.838, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.766', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon4': '0.190', 'weapon2': '0.194', 'weapon5': '0.194', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '2.640', 'weapon3': '3.118', 'DAMAGECOUNT': '12.714', 'FRAGCOUNT': '40.000'} [2023-02-24 21:17:46,114][213369] DAMAGECOUNT value on done: 503334.0 [2023-02-24 21:17:46,115][213369] Sum rewards: 44.627, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.540', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon5': '0.116', 'AMMO3': '0.160', 'weapon4': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.666', 'WEAPON3': '1.000', 'HITCOUNT': '2.450', 'weapon3': '2.888', 'DAMAGECOUNT': '11.355', 'FRAGCOUNT': '38.000'} [2023-02-24 21:17:46,171][213382] DAMAGECOUNT value on done: 502869.0 [2023-02-24 21:17:46,171][213382] Sum rewards: 41.571, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.534', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon5': '0.206', 'AMMO3': '0.255', 'weapon2': '0.280', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.468', 'WEAPON3': '1.400', 'HITCOUNT': '2.450', 'weapon3': '2.782', 'DAMAGECOUNT': '12.558', 'FRAGCOUNT': '37.000'} [2023-02-24 21:17:46,211][213368] DAMAGECOUNT value on done: 508165.0 [2023-02-24 21:17:46,212][213368] Sum rewards: 51.336, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.974', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'weapon5': '0.102', 'weapon2': '0.194', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon4': '0.514', 'WEAPON3': '1.150', 'weapon3': '2.882', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.413', 'FRAGCOUNT': '44.000'} [2023-02-24 21:17:46,247][213383] DAMAGECOUNT value on done: 518475.0 [2023-02-24 21:17:46,247][213383] Sum rewards: 46.478, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.492', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon5': '0.112', 'AMMO4': '0.122', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.412', 'weapon4': '0.466', 'WEAPON3': '1.150', 'HITCOUNT': '2.660', 'weapon3': '2.750', 'DAMAGECOUNT': '12.573', 'FRAGCOUNT': '40.500'} [2023-02-24 21:17:46,469][213382] DAMAGECOUNT value on done: 510551.0 [2023-02-24 21:17:46,470][213382] Sum rewards: 45.599, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.148', 'AMMO5': '0.007', 'AMMO2': '0.058', 'weapon5': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon4': '0.232', 'AMMO4': '0.289', 'WEAPON4': '0.350', 'weapon2': '0.398', 'WEAPON3': '1.300', 'HITCOUNT': '2.570', 'weapon3': '2.974', 'DAMAGECOUNT': '13.716', 'FRAGCOUNT': '41.000'} [2023-02-24 21:17:46,552][213383] DAMAGECOUNT value on done: 510648.0 [2023-02-24 21:17:46,552][213383] Sum rewards: 38.790, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.924', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.043', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.161', 'weapon5': '0.180', 'weapon7': '0.200', 'AMMO4': '0.213', 'weapon2': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.000', 'weapon4': '1.130', 'weapon3': '1.718', 'HITCOUNT': '2.310', 'DAMAGECOUNT': '10.752', 'FRAGCOUNT': '33.000'} [2023-02-24 21:17:46,651][213384] DAMAGECOUNT value on done: 518728.0 [2023-02-24 21:17:46,652][213384] Sum rewards: 51.600, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.710', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.190', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon2': '0.222', 'WEAPON5': '0.300', 'weapon4': '0.308', 'WEAPON3': '1.100', 'HITCOUNT': '2.770', 'weapon3': '2.984', 'DAMAGECOUNT': '13.632', 'FRAGCOUNT': '43.000'} [2023-02-24 21:17:46,948][213384] DAMAGECOUNT value on done: 503672.0 [2023-02-24 21:17:46,948][213384] Sum rewards: 40.717, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.130', 'ARMOR': '0.004', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'weapon4': '0.328', 'weapon2': '0.486', 'WEAPON3': '0.950', 'HITCOUNT': '2.470', 'weapon3': '2.754', 'DAMAGECOUNT': '10.404', 'FRAGCOUNT': '34.000'} [2023-02-24 21:17:47,269][213384] DAMAGECOUNT value on done: 513710.0 [2023-02-24 21:17:47,269][213384] Sum rewards: 45.078, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.486', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.064', 'AMMO4': '0.117', 'weapon5': '0.146', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.384', 'WEAPON3': '1.050', 'HITCOUNT': '2.430', 'weapon3': '3.234', 'DAMAGECOUNT': '12.288', 'FRAGCOUNT': '39.000'} [2023-02-24 21:17:47,568][213384] DAMAGECOUNT value on done: 518453.0 [2023-02-24 21:17:47,569][213384] Sum rewards: 47.723, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.690', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.130', 'AMMO3': '0.135', 'AMMO4': '0.209', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.492', 'WEAPON3': '0.850', 'weapon4': '0.884', 'weapon3': '2.146', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.198', 'FRAGCOUNT': '39.000'} [2023-02-24 21:17:48,729][213382] Large shaping reward 2.538 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.516, 172.0), ('weapon5', 0.002)] [2023-02-24 21:17:48,846][213365] Updated weights for policy 0, policy_version 34926 (0.0009) [2023-02-24 21:17:50,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13858.2, 300 sec: 13759.8). Total num frames: 143073280. Throughput: 0: 3462.2. Samples: 10757548. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:17:50,243][213332] Avg episode reward: [(0, '43.623')] [2023-02-24 21:17:51,371][213368] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 21:17:51,772][213365] Updated weights for policy 0, policy_version 34936 (0.0009) [2023-02-24 21:17:54,722][213365] Updated weights for policy 0, policy_version 34946 (0.0009) [2023-02-24 21:17:55,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13773.7). Total num frames: 143142912. Throughput: 0: 3464.4. Samples: 10778394. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:17:55,243][213332] Avg episode reward: [(0, '43.623')] [2023-02-24 21:17:57,564][213384] Large shaping reward 2.613 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.591, 197.0), ('weapon5', 0.002)] [2023-02-24 21:17:57,671][213365] Updated weights for policy 0, policy_version 34956 (0.0009) [2023-02-24 21:18:00,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13787.6). Total num frames: 143212544. Throughput: 0: 3465.7. Samples: 10799224. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:18:00,243][213332] Avg episode reward: [(0, '43.623')] [2023-02-24 21:18:00,636][213365] Updated weights for policy 0, policy_version 34966 (0.0009) [2023-02-24 21:18:01,816][213367] DAMAGECOUNT value on done: 512133.0 [2023-02-24 21:18:01,817][213367] Sum rewards: 43.161, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.554', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO4': '0.183', 'weapon5': '0.184', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.256', 'weapon4': '0.774', 'WEAPON3': '1.050', 'HITCOUNT': '2.420', 'weapon3': '2.540', 'DAMAGECOUNT': '11.124', 'FRAGCOUNT': '38.000'} [2023-02-24 21:18:01,985][213367] DAMAGECOUNT value on done: 517646.0 [2023-02-24 21:18:01,986][213367] Sum rewards: 46.835, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.786', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.064', 'weapon5': '0.090', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon2': '0.554', 'WEAPON3': '1.050', 'HITCOUNT': '2.840', 'weapon3': '3.026', 'DAMAGECOUNT': '13.311', 'FRAGCOUNT': '38.000'} [2023-02-24 21:18:02,124][213367] DAMAGECOUNT value on done: 515325.0 [2023-02-24 21:18:02,125][213367] Sum rewards: 47.747, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.554', 'AMMO5': '0.008', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.076', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.254', 'weapon4': '0.310', 'ARMOR': '0.472', 'WEAPON3': '1.100', 'HITCOUNT': '2.770', 'weapon3': '3.120', 'DAMAGECOUNT': '12.297', 'FRAGCOUNT': '40.500'} [2023-02-24 21:18:02,291][213367] DAMAGECOUNT value on done: 524774.0 [2023-02-24 21:18:02,291][213367] Sum rewards: 43.560, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.540', 'AMMO5': '0.018', 'AMMO2': '0.028', 'weapon4': '0.086', 'AMMO4': '0.141', 'AMMO3': '0.175', 'weapon5': '0.274', 'WEAPON4': '0.300', 'weapon2': '0.374', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.430', 'weapon3': '3.058', 'DAMAGECOUNT': '12.015', 'FRAGCOUNT': '37.500'} [2023-02-24 21:18:02,991][213372] DAMAGECOUNT value on done: 529409.0 [2023-02-24 21:18:02,992][213372] Sum rewards: 44.686, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.300', 'AMMO2': '0.014', 'AMMO5': '0.020', 'AMMO4': '0.069', 'weapon5': '0.182', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.304', 'WEAPON5': '0.350', 'weapon4': '0.398', 'WEAPON3': '1.300', 'HITCOUNT': '2.480', 'weapon3': '2.628', 'DAMAGECOUNT': '12.027', 'FRAGCOUNT': '41.000'} [2023-02-24 21:18:03,216][213372] DAMAGECOUNT value on done: 511714.0 [2023-02-24 21:18:03,217][213372] Sum rewards: 47.245, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.523', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.032', 'AMMO4': '0.160', 'AMMO3': '0.193', 'weapon2': '0.256', 'weapon5': '0.346', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon4': '0.788', 'WEAPON3': '1.100', 'weapon3': '2.276', 'HITCOUNT': '2.320', 'DAMAGECOUNT': '13.524', 'FRAGCOUNT': '41.000'} [2023-02-24 21:18:03,303][213372] DAMAGECOUNT value on done: 523158.0 [2023-02-24 21:18:03,303][213372] Sum rewards: 44.266, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.826', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.018', 'AMMO4': '0.077', 'weapon4': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'weapon2': '0.818', 'WEAPON3': '1.000', 'HITCOUNT': '2.640', 'weapon3': '2.898', 'DAMAGECOUNT': '11.313', 'FRAGCOUNT': '37.000'} [2023-02-24 21:18:03,518][213372] DAMAGECOUNT value on done: 516874.0 [2023-02-24 21:18:03,519][213372] Sum rewards: 48.574, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.960', 'AMMO5': '0.009', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.086', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.358', 'weapon4': '0.584', 'WEAPON3': '1.400', 'weapon3': '2.658', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.059', 'FRAGCOUNT': '44.000'} [2023-02-24 21:18:03,577][213365] Updated weights for policy 0, policy_version 34976 (0.0009) [2023-02-24 21:18:03,806][213366] DAMAGECOUNT value on done: 507239.0 [2023-02-24 21:18:03,807][213366] Sum rewards: 60.204, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.190', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon5': '0.152', 'AMMO4': '0.156', 'weapon2': '0.160', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.314', 'WEAPON3': '1.600', 'weapon3': '3.122', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.561', 'FRAGCOUNT': '54.000'} [2023-02-24 21:18:04,101][213366] DAMAGECOUNT value on done: 533224.0 [2023-02-24 21:18:04,101][213366] Sum rewards: 46.446, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.552', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon5': '0.130', 'AMMO4': '0.173', 'AMMO3': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.398', 'weapon4': '0.620', 'WEAPON3': '1.200', 'weapon3': '2.616', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '11.178', 'FRAGCOUNT': '42.000'} [2023-02-24 21:18:04,117][213366] DAMAGECOUNT value on done: 520002.0 [2023-02-24 21:18:04,118][213366] Sum rewards: 35.031, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.465', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.084', 'weapon4': '0.182', 'AMMO4': '0.204', 'AMMO3': '0.266', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.632', 'WEAPON3': '1.550', 'HITCOUNT': '2.250', 'weapon3': '2.856', 'DAMAGECOUNT': '10.470', 'FRAGCOUNT': '36.000'} [2023-02-24 21:18:04,413][213366] DAMAGECOUNT value on done: 521932.0 [2023-02-24 21:18:04,414][213366] Sum rewards: 51.653, reward structure: {'DEATHCOUNT': '-13.500', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.018', 'weapon4': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'AMMO3': '0.191', 'HEALTH': '0.273', 'weapon2': '0.622', 'WEAPON3': '1.050', 'HITCOUNT': '3.030', 'weapon3': '3.172', 'DAMAGECOUNT': '12.504', 'FRAGCOUNT': '44.000'} [2023-02-24 21:18:04,656][213368] DAMAGECOUNT value on done: 511050.0 [2023-02-24 21:18:04,657][213368] Sum rewards: 51.729, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.968', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.090', 'weapon4': '0.098', 'AMMO4': '0.149', 'weapon2': '0.164', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '1.150', 'HITCOUNT': '2.910', 'weapon3': '3.482', 'DAMAGECOUNT': '13.731', 'FRAGCOUNT': '44.000'} [2023-02-24 21:18:04,683][213383] DAMAGECOUNT value on done: 513962.0 [2023-02-24 21:18:04,683][213383] Sum rewards: 61.090, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.356', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.050', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.210', 'weapon2': '0.222', 'WEAPON3': '1.250', 'HITCOUNT': '3.100', 'weapon3': '3.552', 'DAMAGECOUNT': '15.027', 'FRAGCOUNT': '51.500'} [2023-02-24 21:18:04,692][213369] DAMAGECOUNT value on done: 519379.0 [2023-02-24 21:18:04,692][213369] Sum rewards: 51.833, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.255', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.041', 'AMMO3': '0.173', 'AMMO4': '0.207', 'weapon4': '0.238', 'weapon5': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.454', 'WEAPON3': '1.000', 'HITCOUNT': '2.700', 'weapon3': '2.728', 'DAMAGECOUNT': '11.943', 'FRAGCOUNT': '46.000'} [2023-02-24 21:18:04,865][213382] DAMAGECOUNT value on done: 522544.0 [2023-02-24 21:18:04,865][213382] Sum rewards: 39.637, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.872', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.036', 'AMMO4': '0.084', 'weapon5': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.260', 'weapon2': '0.720', 'WEAPON3': '1.500', 'HITCOUNT': '2.500', 'weapon3': '2.856', 'DAMAGECOUNT': '12.261', 'FRAGCOUNT': '38.000'} [2023-02-24 21:18:04,957][213368] DAMAGECOUNT value on done: 520600.0 [2023-02-24 21:18:04,957][213368] Sum rewards: 49.799, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.429', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO4': '0.149', 'AMMO3': '0.171', 'weapon2': '0.184', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.408', 'weapon5': '0.432', 'WEAPON3': '1.100', 'HITCOUNT': '2.490', 'weapon3': '2.718', 'DAMAGECOUNT': '13.482', 'FRAGCOUNT': '43.000'} [2023-02-24 21:18:04,984][213383] DAMAGECOUNT value on done: 515269.0 [2023-02-24 21:18:04,985][213383] Sum rewards: 43.338, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.071', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'weapon2': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon5': '0.254', 'weapon4': '0.268', 'WEAPON3': '1.300', 'HITCOUNT': '2.430', 'weapon3': '3.092', 'DAMAGECOUNT': '11.922', 'FRAGCOUNT': '40.000'} [2023-02-24 21:18:04,995][213369] DAMAGECOUNT value on done: 521869.0 [2023-02-24 21:18:04,995][213369] Sum rewards: 42.988, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.340', 'AMMO5': '0.017', 'AMMO2': '0.027', 'weapon4': '0.050', 'AMMO4': '0.133', 'weapon5': '0.192', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.288', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.720', 'weapon3': '3.186', 'DAMAGECOUNT': '12.597', 'FRAGCOUNT': '38.000'} [2023-02-24 21:18:05,178][213382] DAMAGECOUNT value on done: 519466.0 [2023-02-24 21:18:05,178][213382] Sum rewards: 33.718, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.084', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.051', 'AMMO3': '0.173', 'weapon5': '0.188', 'AMMO4': '0.257', 'weapon2': '0.288', 'WEAPON5': '0.350', 'WEAPON4': '0.650', 'weapon4': '0.940', 'WEAPON3': '0.950', 'HITCOUNT': '2.250', 'weapon3': '2.302', 'DAMAGECOUNT': '10.386', 'FRAGCOUNT': '31.000'} [2023-02-24 21:18:05,197][213369] DAMAGECOUNT value on done: 516801.0 [2023-02-24 21:18:05,198][213369] Sum rewards: 53.874, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.192', 'AMMO5': '0.015', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.110', 'weapon2': '0.148', 'WEAPON4': '0.200', 'AMMO3': '0.254', 'WEAPON5': '0.350', 'weapon4': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.610', 'weapon3': '3.090', 'DAMAGECOUNT': '12.939', 'FRAGCOUNT': '48.500'} [2023-02-24 21:18:05,240][213368] DAMAGECOUNT value on done: 513714.0 [2023-02-24 21:18:05,240][213368] Sum rewards: 46.355, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.637', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO3': '0.119', 'AMMO4': '0.185', 'weapon5': '0.208', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.542', 'weapon4': '0.542', 'WEAPON3': '0.800', 'weapon3': '2.530', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '13.920', 'FRAGCOUNT': '38.000'} [2023-02-24 21:18:05,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13787.6). Total num frames: 143282176. Throughput: 0: 3467.8. Samples: 10809670. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:18:05,243][213332] Avg episode reward: [(0, '44.386')] [2023-02-24 21:18:05,491][213369] DAMAGECOUNT value on done: 507624.0 [2023-02-24 21:18:05,491][213369] Sum rewards: 43.887, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.126', 'WEAPON5': '0.150', 'AMMO4': '0.188', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'weapon2': '0.360', 'weapon4': '0.368', 'HEALTH': '0.800', 'WEAPON3': '1.050', 'HITCOUNT': '2.530', 'weapon3': '2.904', 'DAMAGECOUNT': '12.870', 'FRAGCOUNT': '37.000'} [2023-02-24 21:18:05,521][213382] DAMAGECOUNT value on done: 506313.0 [2023-02-24 21:18:05,522][213382] Sum rewards: 37.466, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.115', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.166', 'weapon2': '0.196', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'ARMOR': '0.462', 'weapon4': '0.872', 'WEAPON3': '1.100', 'HITCOUNT': '2.080', 'weapon3': '2.112', 'DAMAGECOUNT': '10.332', 'FRAGCOUNT': '33.000'} [2023-02-24 21:18:05,540][213368] DAMAGECOUNT value on done: 512821.0 [2023-02-24 21:18:05,541][213368] Sum rewards: 58.917, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.352', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.122', 'AMMO3': '0.161', 'weapon5': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.254', 'weapon4': '0.530', 'WEAPON3': '1.050', 'HITCOUNT': '2.710', 'weapon3': '2.792', 'DAMAGECOUNT': '13.896', 'FRAGCOUNT': '50.000'} [2023-02-24 21:18:05,612][213383] DAMAGECOUNT value on done: 522447.0 [2023-02-24 21:18:05,613][213383] Sum rewards: 45.910, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.130', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.052', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.253', 'weapon4': '0.350', 'weapon2': '0.436', 'WEAPON3': '1.500', 'HITCOUNT': '2.410', 'weapon3': '3.014', 'DAMAGECOUNT': '11.916', 'FRAGCOUNT': '43.000'} [2023-02-24 21:18:05,820][213382] DAMAGECOUNT value on done: 514009.0 [2023-02-24 21:18:05,821][213382] Sum rewards: 38.943, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.360', 'AMMO2': '0.002', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.010', 'weapon4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.204', 'weapon2': '0.682', 'WEAPON3': '1.250', 'HITCOUNT': '2.460', 'weapon3': '3.120', 'DAMAGECOUNT': '10.374', 'FRAGCOUNT': '35.000'} [2023-02-24 21:18:05,906][213383] DAMAGECOUNT value on done: 515627.0 [2023-02-24 21:18:05,906][213383] Sum rewards: 55.712, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.946', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon5': '0.166', 'weapon2': '0.190', 'AMMO4': '0.199', 'AMMO3': '0.259', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.672', 'WEAPON3': '1.550', 'weapon3': '2.690', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '14.928', 'FRAGCOUNT': '51.000'} [2023-02-24 21:18:06,008][213384] DAMAGECOUNT value on done: 523431.0 [2023-02-24 21:18:06,009][213384] Sum rewards: 56.999, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.408', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.068', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'weapon4': '0.168', 'WEAPON4': '0.200', 'weapon2': '0.250', 'WEAPON3': '1.050', 'HITCOUNT': '2.910', 'weapon3': '3.298', 'DAMAGECOUNT': '14.094', 'FRAGCOUNT': '50.000'} [2023-02-24 21:18:06,306][213384] DAMAGECOUNT value on done: 508290.0 [2023-02-24 21:18:06,306][213384] Sum rewards: 51.628, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.485', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon4': '0.102', 'weapon5': '0.164', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon2': '0.260', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '2.830', 'weapon3': '3.248', 'DAMAGECOUNT': '13.854', 'FRAGCOUNT': '45.500'} [2023-02-24 21:18:06,534][213365] Updated weights for policy 0, policy_version 34986 (0.0009) [2023-02-24 21:18:06,624][213384] DAMAGECOUNT value on done: 517504.0 [2023-02-24 21:18:06,625][213384] Sum rewards: 39.775, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.194', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.184', 'AMMO3': '0.196', 'AMMO4': '0.209', 'WEAPON5': '0.300', 'weapon4': '0.438', 'WEAPON4': '0.450', 'weapon2': '0.734', 'WEAPON3': '1.100', 'weapon3': '2.314', 'HITCOUNT': '2.360', 'DAMAGECOUNT': '11.382', 'FRAGCOUNT': '37.000'} [2023-02-24 21:18:06,921][213384] DAMAGECOUNT value on done: 522313.0 [2023-02-24 21:18:06,922][213384] Sum rewards: 40.916, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.158', 'weapon5': '0.210', 'weapon2': '0.252', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '0.800', 'weapon4': '0.830', 'HEALTH': '1.176', 'HITCOUNT': '2.430', 'weapon3': '2.444', 'DAMAGECOUNT': '11.580', 'FRAGCOUNT': '32.500'} [2023-02-24 21:18:09,442][213365] Updated weights for policy 0, policy_version 34996 (0.0009) [2023-02-24 21:18:10,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13801.4). Total num frames: 143351808. Throughput: 0: 3471.0. Samples: 10830588. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:18:10,243][213332] Avg episode reward: [(0, '44.604')] [2023-02-24 21:18:11,012][213367] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 21:18:12,390][213365] Updated weights for policy 0, policy_version 35006 (0.0009) [2023-02-24 21:18:15,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13815.3). Total num frames: 143421440. Throughput: 0: 3474.3. Samples: 10851390. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:18:15,243][213332] Avg episode reward: [(0, '44.604')] [2023-02-24 21:18:15,386][213365] Updated weights for policy 0, policy_version 35016 (0.0009) [2023-02-24 21:18:18,345][213365] Updated weights for policy 0, policy_version 35026 (0.0009) [2023-02-24 21:18:20,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13829.2). Total num frames: 143491072. Throughput: 0: 3473.1. Samples: 10861788. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:18:20,243][213332] Avg episode reward: [(0, '44.604')] [2023-02-24 21:18:21,082][213367] DAMAGECOUNT value on done: 516764.0 [2023-02-24 21:18:21,083][213367] Sum rewards: 43.697, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.684', 'ARMOR': '0.008', 'AMMO5': '0.025', 'AMMO2': '0.062', 'AMMO3': '0.186', 'AMMO4': '0.312', 'weapon5': '0.358', 'weapon2': '0.422', 'weapon4': '0.478', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.386', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.893', 'FRAGCOUNT': '39.500'} [2023-02-24 21:18:21,276][213365] Updated weights for policy 0, policy_version 35036 (0.0009) [2023-02-24 21:18:21,347][213367] DAMAGECOUNT value on done: 522803.0 [2023-02-24 21:18:21,347][213367] Sum rewards: 52.540, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.030', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO4': '0.182', 'weapon5': '0.220', 'AMMO3': '0.223', 'weapon2': '0.246', 'weapon4': '0.344', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.880', 'weapon3': '2.894', 'DAMAGECOUNT': '15.471', 'FRAGCOUNT': '44.000'} [2023-02-24 21:18:21,392][213367] DAMAGECOUNT value on done: 518785.0 [2023-02-24 21:18:21,393][213367] Sum rewards: 41.315, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.882', 'AMMO5': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.222', 'WEAPON4': '0.350', 'weapon4': '0.650', 'WEAPON3': '1.100', 'HITCOUNT': '2.150', 'weapon3': '2.818', 'DAMAGECOUNT': '10.380', 'FRAGCOUNT': '39.000'} [2023-02-24 21:18:21,659][213367] DAMAGECOUNT value on done: 528939.0 [2023-02-24 21:18:21,659][213367] Sum rewards: 46.382, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.924', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.184', 'weapon5': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.372', 'weapon4': '0.512', 'WEAPON3': '1.150', 'weapon3': '2.488', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.495', 'FRAGCOUNT': '40.500'} [2023-02-24 21:18:22,310][213372] DAMAGECOUNT value on done: 532633.0 [2023-02-24 21:18:22,310][213372] Sum rewards: 36.112, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.880', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.114', 'weapon2': '0.136', 'AMMO3': '0.158', 'AMMO4': '0.200', 'weapon4': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.000', 'HITCOUNT': '2.050', 'weapon3': '3.406', 'DAMAGECOUNT': '9.567', 'FRAGCOUNT': '32.500'} [2023-02-24 21:18:22,548][213372] DAMAGECOUNT value on done: 514965.0 [2023-02-24 21:18:22,548][213372] Sum rewards: 37.933, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'weapon5': '0.182', 'WEAPON4': '0.200', 'HEALTH': '0.336', 'weapon4': '0.340', 'ARMOR': '0.404', 'weapon2': '0.692', 'WEAPON3': '0.800', 'HITCOUNT': '2.070', 'weapon3': '2.430', 'DAMAGECOUNT': '9.753', 'FRAGCOUNT': '30.000'} [2023-02-24 21:18:22,620][213372] DAMAGECOUNT value on done: 526620.0 [2023-02-24 21:18:22,620][213372] Sum rewards: 33.374, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.450', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.114', 'weapon2': '0.144', 'AMMO3': '0.238', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.578', 'WEAPON3': '1.400', 'HITCOUNT': '2.010', 'weapon3': '2.754', 'DAMAGECOUNT': '10.386', 'FRAGCOUNT': '31.000'} [2023-02-24 21:18:22,853][213372] DAMAGECOUNT value on done: 521761.0 [2023-02-24 21:18:22,854][213372] Sum rewards: 51.701, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.683', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.136', 'AMMO4': '0.220', 'weapon2': '0.242', 'AMMO3': '0.253', 'weapon4': '0.278', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '2.930', 'weapon3': '3.104', 'DAMAGECOUNT': '14.661', 'FRAGCOUNT': '47.000'} [2023-02-24 21:18:23,166][213366] DAMAGECOUNT value on done: 512297.0 [2023-02-24 21:18:23,167][213366] Sum rewards: 51.703, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.654', 'AMMO5': '0.017', 'AMMO2': '0.061', 'AMMO3': '0.157', 'weapon5': '0.278', 'AMMO4': '0.304', 'WEAPON5': '0.450', 'weapon2': '0.572', 'weapon4': '0.596', 'WEAPON4': '0.650', 'WEAPON3': '0.950', 'weapon3': '2.208', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.174', 'FRAGCOUNT': '45.500'} [2023-02-24 21:18:23,464][213366] DAMAGECOUNT value on done: 537286.0 [2023-02-24 21:18:23,465][213366] Sum rewards: 43.005, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.146', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.038', 'weapon5': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon7': '0.168', 'weapon4': '0.172', 'AMMO4': '0.188', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'AMMO3': '0.216', 'weapon2': '0.530', 'WEAPON3': '1.350', 'HITCOUNT': '2.570', 'weapon3': '2.836', 'DAMAGECOUNT': '12.186', 'FRAGCOUNT': '40.000'} [2023-02-24 21:18:23,477][213366] DAMAGECOUNT value on done: 524797.0 [2023-02-24 21:18:23,478][213366] Sum rewards: 56.220, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.817', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.035', 'WEAPON5': '0.050', 'weapon4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.201', 'weapon2': '0.230', 'WEAPON3': '1.250', 'HITCOUNT': '2.900', 'weapon3': '3.546', 'DAMAGECOUNT': '14.385', 'FRAGCOUNT': '48.000'} [2023-02-24 21:18:23,788][213366] DAMAGECOUNT value on done: 526615.0 [2023-02-24 21:18:23,789][213366] Sum rewards: 54.379, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.902', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon5': '0.104', 'AMMO4': '0.206', 'AMMO3': '0.236', 'weapon2': '0.292', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.582', 'WEAPON3': '1.400', 'weapon3': '2.736', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.049', 'FRAGCOUNT': '48.000'} [2023-02-24 21:18:24,011][213383] DAMAGECOUNT value on done: 518678.0 [2023-02-24 21:18:24,011][213383] Sum rewards: 55.063, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.650', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.052', 'AMMO3': '0.156', 'weapon5': '0.186', 'weapon4': '0.250', 'AMMO4': '0.257', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.516', 'WEAPON3': '0.900', 'HITCOUNT': '2.670', 'weapon3': '2.762', 'DAMAGECOUNT': '14.148', 'FRAGCOUNT': '46.000'} [2023-02-24 21:18:24,056][213369] DAMAGECOUNT value on done: 523362.0 [2023-02-24 21:18:24,056][213369] Sum rewards: 46.472, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.760', 'AMMO5': '0.014', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.126', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.342', 'weapon4': '0.346', 'WEAPON3': '1.150', 'HITCOUNT': '2.510', 'weapon3': '2.898', 'DAMAGECOUNT': '11.949', 'FRAGCOUNT': '42.000'} [2023-02-24 21:18:24,104][213368] DAMAGECOUNT value on done: 514924.0 [2023-02-24 21:18:24,105][213368] Sum rewards: 36.109, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.264', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.074', 'weapon4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.315', 'weapon2': '0.354', 'WEAPON3': '1.850', 'HITCOUNT': '2.580', 'weapon3': '3.220', 'DAMAGECOUNT': '11.622', 'FRAGCOUNT': '37.000'} [2023-02-24 21:18:24,218][213382] DAMAGECOUNT value on done: 526106.0 [2023-02-24 21:18:24,219][213382] Sum rewards: 44.486, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.670', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.088', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'weapon2': '0.174', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'weapon4': '0.422', 'WEAPON3': '1.150', 'HITCOUNT': '2.340', 'weapon3': '3.094', 'DAMAGECOUNT': '10.686', 'FRAGCOUNT': '38.000'} [2023-02-24 21:18:24,243][213365] Updated weights for policy 0, policy_version 35046 (0.0009) [2023-02-24 21:18:24,309][213383] DAMAGECOUNT value on done: 519209.0 [2023-02-24 21:18:24,310][213383] Sum rewards: 39.590, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.810', 'weapon5': '0.012', 'AMMO5': '0.018', 'AMMO2': '0.032', 'WEAPON4': '0.100', 'AMMO4': '0.162', 'weapon4': '0.190', 'AMMO3': '0.280', 'WEAPON5': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.600', 'HITCOUNT': '2.540', 'weapon3': '3.172', 'DAMAGECOUNT': '11.820', 'FRAGCOUNT': '36.000'} [2023-02-24 21:18:24,354][213369] DAMAGECOUNT value on done: 526874.0 [2023-02-24 21:18:24,355][213369] Sum rewards: 55.278, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.446', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.021', 'weapon5': '0.044', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'WEAPON4': '0.400', 'weapon2': '0.482', 'weapon4': '0.644', 'WEAPON3': '1.050', 'weapon3': '2.578', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '48.000'} [2023-02-24 21:18:24,411][213368] DAMAGECOUNT value on done: 524908.0 [2023-02-24 21:18:24,411][213368] Sum rewards: 51.658, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.530', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.150', 'AMMO3': '0.167', 'WEAPON5': '0.250', 'weapon2': '0.332', 'WEAPON4': '0.450', 'weapon4': '0.584', 'WEAPON3': '1.100', 'HITCOUNT': '2.610', 'weapon3': '2.692', 'DAMAGECOUNT': '12.924', 'FRAGCOUNT': '45.000'} [2023-02-24 21:18:24,517][213382] DAMAGECOUNT value on done: 523151.0 [2023-02-24 21:18:24,517][213382] Sum rewards: 40.345, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.000', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.204', 'weapon2': '0.268', 'weapon4': '0.490', 'WEAPON3': '1.200', 'HITCOUNT': '2.330', 'weapon3': '3.006', 'DAMAGECOUNT': '11.055', 'FRAGCOUNT': '36.000'} [2023-02-24 21:18:24,615][213369] DAMAGECOUNT value on done: 520846.0 [2023-02-24 21:18:24,616][213369] Sum rewards: 40.734, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.570', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON5': '0.200', 'weapon5': '0.204', 'AMMO3': '0.222', 'weapon2': '0.272', 'WEAPON4': '0.300', 'weapon4': '0.532', 'WEAPON3': '1.250', 'weapon3': '2.602', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.135', 'FRAGCOUNT': '37.500'} [2023-02-24 21:18:24,679][213368] DAMAGECOUNT value on done: 518221.0 [2023-02-24 21:18:24,679][213368] Sum rewards: 51.648, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.016', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.054', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon4': '0.242', 'weapon2': '0.312', 'WEAPON3': '1.150', 'HITCOUNT': '3.110', 'weapon3': '3.184', 'DAMAGECOUNT': '13.521', 'FRAGCOUNT': '45.000'} [2023-02-24 21:18:24,872][213382] DAMAGECOUNT value on done: 510812.0 [2023-02-24 21:18:24,872][213382] Sum rewards: 52.704, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.825', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'weapon4': '0.242', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.500', 'HITCOUNT': '3.000', 'weapon3': '3.216', 'DAMAGECOUNT': '13.422', 'FRAGCOUNT': '50.000'} [2023-02-24 21:18:24,913][213369] DAMAGECOUNT value on done: 512681.0 [2023-02-24 21:18:24,914][213369] Sum rewards: 62.027, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.180', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.144', 'AMMO3': '0.153', 'AMMO4': '0.176', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.426', 'weapon4': '0.580', 'WEAPON3': '1.000', 'weapon3': '2.634', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '15.171', 'FRAGCOUNT': '51.000'} [2023-02-24 21:18:24,924][213383] DAMAGECOUNT value on done: 526914.0 [2023-02-24 21:18:24,924][213383] Sum rewards: 51.763, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.029', 'AMMO5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.029', 'weapon5': '0.088', 'AMMO4': '0.143', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'weapon2': '0.322', 'WEAPON4': '0.350', 'weapon4': '0.516', 'WEAPON3': '1.350', 'weapon3': '2.854', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.104', 'FRAGCOUNT': '48.000'} [2023-02-24 21:18:24,979][213368] DAMAGECOUNT value on done: 516837.0 [2023-02-24 21:18:24,980][213368] Sum rewards: 39.916, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.783', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.094', 'weapon5': '0.142', 'AMMO4': '0.148', 'weapon2': '0.250', 'AMMO3': '0.291', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'HITCOUNT': '2.440', 'weapon3': '3.196', 'DAMAGECOUNT': '12.048', 'FRAGCOUNT': '39.000'} [2023-02-24 21:18:25,168][213382] DAMAGECOUNT value on done: 519024.0 [2023-02-24 21:18:25,169][213382] Sum rewards: 51.888, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.966', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon2': '0.156', 'AMMO4': '0.163', 'AMMO3': '0.197', 'weapon5': '0.280', 'weapon4': '0.348', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.700', 'weapon3': '2.920', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '44.000'} [2023-02-24 21:18:25,214][213383] DAMAGECOUNT value on done: 519368.0 [2023-02-24 21:18:25,214][213383] Sum rewards: 41.858, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.380', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.124', 'AMMO3': '0.139', 'AMMO4': '0.159', 'WEAPON5': '0.250', 'weapon2': '0.258', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'weapon4': '0.950', 'HITCOUNT': '2.380', 'weapon3': '2.462', 'DAMAGECOUNT': '11.223', 'FRAGCOUNT': '36.000'} [2023-02-24 21:18:25,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 143560704. Throughput: 0: 3475.3. Samples: 10882594. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:18:25,243][213332] Avg episode reward: [(0, '45.288')] [2023-02-24 21:18:25,246][213352] Saving new best policy, reward=45.288! [2023-02-24 21:18:25,427][213384] DAMAGECOUNT value on done: 527564.0 [2023-02-24 21:18:25,427][213384] Sum rewards: 42.342, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.703', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.146', 'AMMO4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'weapon2': '0.312', 'WEAPON4': '0.400', 'weapon4': '0.548', 'WEAPON3': '1.400', 'weapon3': '2.674', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.399', 'FRAGCOUNT': '41.000'} [2023-02-24 21:18:25,719][213384] DAMAGECOUNT value on done: 512581.0 [2023-02-24 21:18:25,719][213384] Sum rewards: 49.527, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.237', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO3': '0.146', 'AMMO4': '0.164', 'weapon5': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.532', 'weapon4': '0.698', 'WEAPON3': '0.950', 'weapon3': '2.374', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '12.873', 'FRAGCOUNT': '39.500'} [2023-02-24 21:18:26,053][213384] DAMAGECOUNT value on done: 521370.0 [2023-02-24 21:18:26,053][213384] Sum rewards: 40.727, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.426', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.088', 'AMMO4': '0.164', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.302', 'WEAPON4': '0.550', 'weapon4': '0.858', 'WEAPON3': '1.400', 'weapon3': '2.410', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '11.598', 'FRAGCOUNT': '40.000'} [2023-02-24 21:18:26,355][213384] DAMAGECOUNT value on done: 526649.0 [2023-02-24 21:18:26,356][213384] Sum rewards: 48.153, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.919', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.112', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.230', 'weapon2': '0.366', 'WEAPON3': '1.050', 'HITCOUNT': '2.810', 'weapon3': '3.064', 'DAMAGECOUNT': '13.008', 'FRAGCOUNT': '40.000'} [2023-02-24 21:18:27,209][213365] Updated weights for policy 0, policy_version 35056 (0.0008) [2023-02-24 21:18:30,164][213365] Updated weights for policy 0, policy_version 35066 (0.0009) [2023-02-24 21:18:30,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13843.1). Total num frames: 143630336. Throughput: 0: 3474.0. Samples: 10903418. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:18:30,243][213332] Avg episode reward: [(0, '45.467')] [2023-02-24 21:18:30,244][213352] Saving new best policy, reward=45.467! [2023-02-24 21:18:33,063][213384] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-24 21:18:33,134][213365] Updated weights for policy 0, policy_version 35076 (0.0009) [2023-02-24 21:18:35,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13843.1). Total num frames: 143699968. Throughput: 0: 3471.0. Samples: 10913744. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:18:35,243][213332] Avg episode reward: [(0, '45.467')] [2023-02-24 21:18:36,093][213365] Updated weights for policy 0, policy_version 35086 (0.0009) [2023-02-24 21:18:39,050][213365] Updated weights for policy 0, policy_version 35096 (0.0009) [2023-02-24 21:18:40,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13843.1). Total num frames: 143769600. Throughput: 0: 3470.7. Samples: 10934574. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:18:40,243][213332] Avg episode reward: [(0, '45.467')] [2023-02-24 21:18:40,474][213367] DAMAGECOUNT value on done: 521732.0 [2023-02-24 21:18:40,474][213367] Sum rewards: 53.782, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.225', 'AMMO5': '0.014', 'AMMO2': '0.029', 'AMMO4': '0.144', 'AMMO3': '0.203', 'weapon2': '0.270', 'weapon5': '0.278', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.484', 'WEAPON3': '1.150', 'weapon3': '2.694', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.901', 'FRAGCOUNT': '47.000'} [2023-02-24 21:18:40,741][213367] DAMAGECOUNT value on done: 527349.0 [2023-02-24 21:18:40,742][213367] Sum rewards: 60.961, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.428', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.082', 'AMMO4': '0.147', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.452', 'weapon4': '0.646', 'WEAPON3': '1.000', 'weapon3': '2.566', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '13.593', 'FRAGCOUNT': '51.000'} [2023-02-24 21:18:40,766][213367] DAMAGECOUNT value on done: 523070.0 [2023-02-24 21:18:40,767][213367] Sum rewards: 47.906, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.511', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.046', 'AMMO3': '0.103', 'weapon2': '0.150', 'AMMO4': '0.228', 'weapon5': '0.282', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '0.700', 'weapon4': '1.410', 'weapon3': '1.896', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '12.855', 'FRAGCOUNT': '38.000'} [2023-02-24 21:18:41,045][213367] DAMAGECOUNT value on done: 533442.0 [2023-02-24 21:18:41,046][213367] Sum rewards: 50.530, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.284', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO4': '0.042', 'WEAPON5': '0.050', 'weapon5': '0.100', 'weapon2': '0.146', 'WEAPON4': '0.150', 'weapon4': '0.234', 'AMMO3': '0.278', 'WEAPON3': '1.600', 'HITCOUNT': '2.870', 'weapon3': '3.320', 'DAMAGECOUNT': '13.509', 'FRAGCOUNT': '47.000'} [2023-02-24 21:18:41,665][213372] DAMAGECOUNT value on done: 537262.0 [2023-02-24 21:18:41,666][213372] Sum rewards: 54.763, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.807', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon2': '0.150', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon4': '0.488', 'WEAPON3': '1.250', 'HITCOUNT': '3.050', 'weapon3': '3.158', 'DAMAGECOUNT': '13.887', 'FRAGCOUNT': '48.000'} [2023-02-24 21:18:41,930][213372] DAMAGECOUNT value on done: 519185.0 [2023-02-24 21:18:41,931][213372] Sum rewards: 47.820, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.840', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.106', 'weapon4': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.296', 'weapon2': '0.526', 'WEAPON3': '1.650', 'HITCOUNT': '2.570', 'weapon3': '2.932', 'DAMAGECOUNT': '12.660', 'FRAGCOUNT': '45.000'} [2023-02-24 21:18:41,980][213372] DAMAGECOUNT value on done: 530716.0 [2023-02-24 21:18:41,980][213372] Sum rewards: 38.997, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.345', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.046', 'AMMO3': '0.217', 'AMMO4': '0.227', 'weapon4': '0.280', 'weapon2': '0.284', 'weapon5': '0.292', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '2.260', 'weapon3': '2.826', 'DAMAGECOUNT': '12.288', 'FRAGCOUNT': '35.000'} [2023-02-24 21:18:42,019][213365] Updated weights for policy 0, policy_version 35106 (0.0009) [2023-02-24 21:18:42,254][213372] DAMAGECOUNT value on done: 526398.0 [2023-02-24 21:18:42,255][213372] Sum rewards: 46.162, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.795', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.042', 'AMMO3': '0.150', 'weapon2': '0.196', 'AMMO4': '0.209', 'weapon5': '0.238', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '0.850', 'weapon4': '1.144', 'weapon3': '1.904', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.797', 'FRAGCOUNT': '40.000'} [2023-02-24 21:18:42,548][213366] DAMAGECOUNT value on done: 515501.0 [2023-02-24 21:18:42,548][213366] Sum rewards: 33.303, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.336', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.046', 'weapon5': '0.076', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'AMMO4': '0.228', 'weapon2': '0.420', 'WEAPON4': '0.500', 'weapon4': '0.754', 'WEAPON3': '1.150', 'HITCOUNT': '2.120', 'weapon3': '2.352', 'DAMAGECOUNT': '9.582', 'FRAGCOUNT': '32.000'} [2023-02-24 21:18:42,848][213366] DAMAGECOUNT value on done: 529367.0 [2023-02-24 21:18:42,848][213366] Sum rewards: 44.317, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.060', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.169', 'weapon5': '0.188', 'weapon4': '0.222', 'AMMO3': '0.279', 'weapon2': '0.384', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '2.850', 'weapon3': '2.878', 'DAMAGECOUNT': '13.710', 'FRAGCOUNT': '43.000'} [2023-02-24 21:18:42,858][213366] DAMAGECOUNT value on done: 541757.0 [2023-02-24 21:18:42,858][213366] Sum rewards: 52.351, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.681', 'AMMO5': '0.013', 'AMMO2': '0.058', 'weapon5': '0.094', 'AMMO3': '0.170', 'AMMO4': '0.291', 'WEAPON5': '0.300', 'weapon2': '0.370', 'ARMOR': '0.404', 'weapon4': '0.546', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.702', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '13.413', 'FRAGCOUNT': '47.000'} [2023-02-24 21:18:43,156][213366] DAMAGECOUNT value on done: 531043.0 [2023-02-24 21:18:43,156][213366] Sum rewards: 50.291, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.030', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'weapon2': '0.304', 'weapon4': '0.344', 'WEAPON3': '1.050', 'HITCOUNT': '2.960', 'weapon3': '3.208', 'DAMAGECOUNT': '13.284', 'FRAGCOUNT': '43.000'} [2023-02-24 21:18:43,431][213383] DAMAGECOUNT value on done: 522574.0 [2023-02-24 21:18:43,431][213383] Sum rewards: 38.800, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.170', 'AMMO5': '0.005', 'AMMO2': '0.038', 'AMMO3': '0.132', 'weapon5': '0.144', 'WEAPON5': '0.150', 'AMMO4': '0.189', 'WEAPON4': '0.400', 'weapon2': '0.466', 'WEAPON3': '0.750', 'weapon4': '0.928', 'weapon3': '1.970', 'HITCOUNT': '2.360', 'DAMAGECOUNT': '11.688', 'FRAGCOUNT': '32.000'} [2023-02-24 21:18:43,433][213369] DAMAGECOUNT value on done: 527851.0 [2023-02-24 21:18:43,433][213369] Sum rewards: 53.173, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.271', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.032', 'AMMO3': '0.148', 'AMMO4': '0.159', 'weapon5': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.352', 'weapon2': '0.474', 'WEAPON3': '1.050', 'weapon3': '2.830', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.467', 'FRAGCOUNT': '44.000'} [2023-02-24 21:18:43,456][213368] DAMAGECOUNT value on done: 518870.0 [2023-02-24 21:18:43,457][213368] Sum rewards: 49.244, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.626', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.116', 'AMMO4': '0.122', 'AMMO3': '0.159', 'weapon4': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.736', 'WEAPON3': '1.000', 'HITCOUNT': '2.400', 'weapon3': '2.666', 'DAMAGECOUNT': '11.838', 'FRAGCOUNT': '43.000'} [2023-02-24 21:18:43,603][213382] DAMAGECOUNT value on done: 529537.0 [2023-02-24 21:18:43,603][213382] Sum rewards: 37.199, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.238', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.090', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'AMMO4': '0.223', 'WEAPON4': '0.350', 'weapon2': '0.582', 'weapon4': '0.634', 'WEAPON3': '1.050', 'weapon3': '2.464', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '10.293', 'FRAGCOUNT': '34.000'} [2023-02-24 21:18:43,727][213383] DAMAGECOUNT value on done: 524163.0 [2023-02-24 21:18:43,727][213383] Sum rewards: 49.292, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.510', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon5': '0.154', 'AMMO4': '0.220', 'weapon4': '0.228', 'AMMO3': '0.235', 'weapon2': '0.276', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.790', 'weapon3': '3.028', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '45.000'} [2023-02-24 21:18:43,735][213369] DAMAGECOUNT value on done: 531631.0 [2023-02-24 21:18:43,736][213369] Sum rewards: 48.809, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.690', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.037', 'AMMO4': '0.185', 'weapon2': '0.212', 'weapon5': '0.214', 'AMMO3': '0.225', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.574', 'WEAPON3': '1.350', 'weapon3': '2.706', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.271', 'FRAGCOUNT': '42.000'} [2023-02-24 21:18:43,756][213368] DAMAGECOUNT value on done: 529427.0 [2023-02-24 21:18:43,757][213368] Sum rewards: 49.823, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.565', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.169', 'WEAPON5': '0.200', 'weapon5': '0.200', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'weapon2': '0.488', 'weapon4': '0.628', 'WEAPON3': '1.300', 'weapon3': '2.408', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.557', 'FRAGCOUNT': '44.000'} [2023-02-24 21:18:43,903][213382] DAMAGECOUNT value on done: 526924.0 [2023-02-24 21:18:43,903][213382] Sum rewards: 39.870, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.946', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.147', 'weapon5': '0.158', 'AMMO3': '0.176', 'weapon2': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.730', 'WEAPON3': '1.050', 'HITCOUNT': '2.450', 'weapon3': '2.688', 'DAMAGECOUNT': '11.319', 'FRAGCOUNT': '34.000'} [2023-02-24 21:18:44,017][213368] DAMAGECOUNT value on done: 522400.0 [2023-02-24 21:18:44,018][213368] Sum rewards: 44.992, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.495', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.150', 'AMMO4': '0.170', 'AMMO3': '0.244', 'WEAPON5': '0.250', 'weapon4': '0.278', 'WEAPON4': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.780', 'weapon3': '2.886', 'DAMAGECOUNT': '12.537', 'FRAGCOUNT': '42.000'} [2023-02-24 21:18:44,041][213369] DAMAGECOUNT value on done: 525021.0 [2023-02-24 21:18:44,042][213369] Sum rewards: 49.445, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.545', 'AMMO5': '0.017', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.146', 'AMMO3': '0.178', 'weapon2': '0.308', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '1.032', 'WEAPON3': '1.050', 'weapon3': '2.160', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.525', 'FRAGCOUNT': '41.000'} [2023-02-24 21:18:44,314][213383] DAMAGECOUNT value on done: 531130.0 [2023-02-24 21:18:44,314][213383] Sum rewards: 51.286, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.567', 'AMMO2': '0.016', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.155', 'weapon4': '0.298', 'weapon2': '0.584', 'WEAPON3': '0.900', 'HITCOUNT': '2.810', 'weapon3': '3.014', 'DAMAGECOUNT': '12.648', 'FRAGCOUNT': '41.000'} [2023-02-24 21:18:44,315][213368] DAMAGECOUNT value on done: 520478.0 [2023-02-24 21:18:44,315][213368] Sum rewards: 42.243, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.002', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.068', 'AMMO4': '0.158', 'AMMO3': '0.172', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.570', 'weapon2': '0.626', 'WEAPON3': '1.000', 'weapon3': '2.482', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '10.923', 'FRAGCOUNT': '39.000'} [2023-02-24 21:18:44,331][213382] DAMAGECOUNT value on done: 515101.0 [2023-02-24 21:18:44,332][213382] Sum rewards: 42.782, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.020', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon4': '0.126', 'weapon5': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon2': '0.458', 'WEAPON3': '1.250', 'HITCOUNT': '2.470', 'weapon3': '2.988', 'DAMAGECOUNT': '12.867', 'FRAGCOUNT': '37.000'} [2023-02-24 21:18:44,356][213369] DAMAGECOUNT value on done: 517020.0 [2023-02-24 21:18:44,357][213369] Sum rewards: 50.441, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.570', 'AMMO5': '0.014', 'AMMO2': '0.038', 'AMMO3': '0.152', 'AMMO4': '0.190', 'weapon2': '0.196', 'weapon5': '0.232', 'WEAPON5': '0.400', 'weapon4': '0.472', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'HITCOUNT': '2.670', 'weapon3': '2.880', 'DAMAGECOUNT': '13.017', 'FRAGCOUNT': '44.000'} [2023-02-24 21:18:44,613][213383] DAMAGECOUNT value on done: 523573.0 [2023-02-24 21:18:44,614][213383] Sum rewards: 41.985, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.435', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.034', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.246', 'weapon4': '0.246', 'weapon2': '0.310', 'WEAPON3': '1.500', 'HITCOUNT': '2.820', 'weapon3': '3.210', 'DAMAGECOUNT': '12.615', 'FRAGCOUNT': '37.500'} [2023-02-24 21:18:44,633][213382] DAMAGECOUNT value on done: 523633.0 [2023-02-24 21:18:44,634][213382] Sum rewards: 50.560, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.995', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'WEAPON4': '0.300', 'weapon2': '0.448', 'weapon4': '0.542', 'WEAPON3': '1.150', 'weapon3': '2.774', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.827', 'FRAGCOUNT': '43.000'} [2023-02-24 21:18:44,747][213384] DAMAGECOUNT value on done: 530824.0 [2023-02-24 21:18:44,747][213384] Sum rewards: 31.322, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.796', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.060', 'weapon7': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'weapon4': '0.260', 'AMMO3': '0.264', 'weapon2': '0.312', 'WEAPON3': '1.500', 'HITCOUNT': '2.210', 'weapon3': '2.940', 'DAMAGECOUNT': '9.753', 'FRAGCOUNT': '30.000'} [2023-02-24 21:18:44,964][213365] Updated weights for policy 0, policy_version 35116 (0.0009) [2023-02-24 21:18:45,049][213384] DAMAGECOUNT value on done: 516135.0 [2023-02-24 21:18:45,049][213384] Sum rewards: 36.625, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.765', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.130', 'AMMO4': '0.172', 'AMMO3': '0.191', 'weapon2': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.502', 'WEAPON3': '1.200', 'HITCOUNT': '2.360', 'weapon3': '2.908', 'DAMAGECOUNT': '10.632', 'FRAGCOUNT': '34.000'} [2023-02-24 21:18:45,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13858.1, 300 sec: 13829.2). Total num frames: 143835136. Throughput: 0: 3469.0. Samples: 10955328. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:18:45,243][213332] Avg episode reward: [(0, '46.532')] [2023-02-24 21:18:45,256][213352] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000035117_143839232.pth... [2023-02-24 21:18:45,314][213352] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000034305_140513280.pth [2023-02-24 21:18:45,320][213352] Saving new best policy, reward=46.532! [2023-02-24 21:18:45,393][213384] DAMAGECOUNT value on done: 525373.0 [2023-02-24 21:18:45,393][213384] Sum rewards: 45.793, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.375', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon7': '0.054', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.129', 'weapon5': '0.146', 'WEAPON7': '0.200', 'AMMO4': '0.246', 'WEAPON5': '0.350', 'weapon2': '0.416', 'WEAPON4': '0.600', 'WEAPON3': '0.750', 'weapon4': '1.128', 'weapon3': '1.904', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.009', 'FRAGCOUNT': '37.500'} [2023-02-24 21:18:45,682][213384] DAMAGECOUNT value on done: 530706.0 [2023-02-24 21:18:45,683][213384] Sum rewards: 46.283, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.613', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.035', 'AMMO3': '0.151', 'weapon5': '0.166', 'AMMO4': '0.176', 'WEAPON5': '0.350', 'weapon2': '0.386', 'WEAPON4': '0.400', 'weapon4': '0.402', 'WEAPON3': '0.950', 'HITCOUNT': '2.570', 'weapon3': '2.870', 'DAMAGECOUNT': '12.171', 'FRAGCOUNT': '41.000'} [2023-02-24 21:18:47,941][213365] Updated weights for policy 0, policy_version 35126 (0.0009) [2023-02-24 21:18:48,600][213382] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 21:18:50,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 143904768. Throughput: 0: 3467.1. Samples: 10965688. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:18:50,243][213332] Avg episode reward: [(0, '46.608')] [2023-02-24 21:18:50,282][213352] Saving new best policy, reward=46.608! [2023-02-24 21:18:50,881][213365] Updated weights for policy 0, policy_version 35136 (0.0009) [2023-02-24 21:18:53,819][213365] Updated weights for policy 0, policy_version 35146 (0.0009) [2023-02-24 21:18:55,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 143974400. Throughput: 0: 3462.8. Samples: 10986414. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:18:55,243][213332] Avg episode reward: [(0, '46.608')] [2023-02-24 21:18:56,033][213367] Large shaping reward 2.502 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.48, 160.0), ('weapon5', 0.002)] [2023-02-24 21:18:56,789][213365] Updated weights for policy 0, policy_version 35156 (0.0009) [2023-02-24 21:18:59,746][213365] Updated weights for policy 0, policy_version 35166 (0.0009) [2023-02-24 21:18:59,865][213367] DAMAGECOUNT value on done: 525972.0 [2023-02-24 21:18:59,866][213367] Sum rewards: 45.168, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.570', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.068', 'AMMO4': '0.074', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.284', 'weapon4': '0.668', 'WEAPON3': '1.250', 'weapon3': '2.690', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.720', 'FRAGCOUNT': '40.000'} [2023-02-24 21:19:00,150][213367] DAMAGECOUNT value on done: 532055.0 [2023-02-24 21:19:00,150][213367] Sum rewards: 52.555, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.564', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.104', 'weapon2': '0.164', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'WEAPON4': '0.400', 'weapon4': '0.710', 'WEAPON3': '1.350', 'weapon3': '2.776', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.968', 'FRAGCOUNT': '46.000'} [2023-02-24 21:19:00,175][213367] DAMAGECOUNT value on done: 526020.0 [2023-02-24 21:19:00,175][213367] Sum rewards: 25.459, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.682', 'AMMO5': '0.010', 'AMMO2': '0.063', 'weapon5': '0.204', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'weapon2': '0.254', 'AMMO4': '0.314', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon4': '1.344', 'HITCOUNT': '1.650', 'weapon3': '1.792', 'DAMAGECOUNT': '8.805', 'FRAGCOUNT': '28.000'} [2023-02-24 21:19:00,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 144044032. Throughput: 0: 3462.4. Samples: 11007198. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:19:00,243][213332] Avg episode reward: [(0, '46.466')] [2023-02-24 21:19:00,452][213367] DAMAGECOUNT value on done: 536697.0 [2023-02-24 21:19:00,453][213367] Sum rewards: 32.678, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.730', 'AMMO5': '0.003', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'weapon4': '0.020', 'AMMO4': '0.026', 'weapon5': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.195', 'weapon2': '0.638', 'WEAPON3': '1.150', 'HITCOUNT': '2.300', 'weapon3': '3.156', 'DAMAGECOUNT': '9.765', 'FRAGCOUNT': '28.000'} [2023-02-24 21:19:01,140][213372] DAMAGECOUNT value on done: 541897.0 [2023-02-24 21:19:01,140][213372] Sum rewards: 48.824, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.660', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.042', 'AMMO4': '0.070', 'weapon5': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.264', 'weapon2': '0.512', 'WEAPON3': '1.650', 'HITCOUNT': '2.780', 'weapon3': '3.116', 'DAMAGECOUNT': '13.905', 'FRAGCOUNT': '46.000'} [2023-02-24 21:19:01,426][213372] DAMAGECOUNT value on done: 523709.0 [2023-02-24 21:19:01,427][213372] Sum rewards: 48.054, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.994', 'AMMO5': '0.022', 'AMMO2': '0.042', 'AMMO4': '0.209', 'weapon5': '0.222', 'AMMO3': '0.229', 'weapon4': '0.264', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.514', 'WEAPON3': '1.350', 'HITCOUNT': '2.560', 'weapon3': '2.664', 'DAMAGECOUNT': '13.572', 'FRAGCOUNT': '44.000'} [2023-02-24 21:19:01,446][213372] DAMAGECOUNT value on done: 534975.0 [2023-02-24 21:19:01,447][213372] Sum rewards: 43.723, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.782', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.202', 'AMMO3': '0.224', 'AMMO4': '0.230', 'weapon2': '0.276', 'WEAPON5': '0.350', 'weapon4': '0.402', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '2.630', 'weapon3': '2.812', 'DAMAGECOUNT': '12.717', 'FRAGCOUNT': '42.000'} [2023-02-24 21:19:01,738][213372] DAMAGECOUNT value on done: 530968.0 [2023-02-24 21:19:01,738][213372] Sum rewards: 43.391, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.290', 'AMMO5': '0.014', 'AMMO2': '0.057', 'weapon5': '0.206', 'AMMO3': '0.207', 'AMMO4': '0.285', 'weapon2': '0.296', 'WEAPON5': '0.400', 'WEAPON4': '0.700', 'weapon4': '0.970', 'WEAPON3': '1.250', 'weapon3': '2.226', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '13.680', 'FRAGCOUNT': '41.000'} [2023-02-24 21:19:02,001][213366] DAMAGECOUNT value on done: 519711.0 [2023-02-24 21:19:02,001][213366] Sum rewards: 46.903, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.388', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon5': '0.076', 'AMMO4': '0.077', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.267', 'weapon2': '0.314', 'weapon4': '0.572', 'WEAPON3': '1.500', 'weapon3': '2.700', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.630', 'FRAGCOUNT': '45.000'} [2023-02-24 21:19:02,301][213366] DAMAGECOUNT value on done: 533759.0 [2023-02-24 21:19:02,302][213366] Sum rewards: 46.729, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.245', 'AMMO5': '0.006', 'AMMO2': '0.040', 'weapon5': '0.092', 'AMMO3': '0.178', 'AMMO4': '0.198', 'WEAPON5': '0.200', 'weapon2': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.594', 'WEAPON3': '1.150', 'weapon3': '2.760', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.176', 'FRAGCOUNT': '42.000'} [2023-02-24 21:19:02,311][213366] DAMAGECOUNT value on done: 545260.0 [2023-02-24 21:19:02,312][213366] Sum rewards: 39.580, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.238', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.080', 'AMMO4': '0.085', 'weapon4': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.334', 'WEAPON3': '1.150', 'HITCOUNT': '2.390', 'weapon3': '3.186', 'DAMAGECOUNT': '10.335', 'FRAGCOUNT': '36.000'} [2023-02-24 21:19:02,612][213366] DAMAGECOUNT value on done: 535423.0 [2023-02-24 21:19:02,612][213366] Sum rewards: 51.596, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.422', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.021', 'weapon5': '0.042', 'WEAPON4': '0.050', 'weapon4': '0.074', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon2': '0.426', 'WEAPON3': '1.300', 'HITCOUNT': '2.900', 'weapon3': '3.176', 'DAMAGECOUNT': '13.140', 'FRAGCOUNT': '44.000'} [2023-02-24 21:19:02,708][213365] Updated weights for policy 0, policy_version 35176 (0.0009) [2023-02-24 21:19:02,814][213383] DAMAGECOUNT value on done: 527779.0 [2023-02-24 21:19:02,814][213383] Sum rewards: 61.963, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.795', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon4': '0.036', 'WEAPON4': '0.050', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon2': '0.336', 'WEAPON3': '1.100', 'HITCOUNT': '3.060', 'weapon3': '3.304', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '50.000'} [2023-02-24 21:19:02,833][213369] DAMAGECOUNT value on done: 532439.0 [2023-02-24 21:19:02,834][213369] Sum rewards: 48.823, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.497', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.126', 'AMMO3': '0.148', 'AMMO4': '0.221', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.596', 'weapon2': '0.712', 'WEAPON3': '0.900', 'weapon3': '2.322', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.764', 'FRAGCOUNT': '41.000'} [2023-02-24 21:19:02,889][213368] DAMAGECOUNT value on done: 523071.0 [2023-02-24 21:19:02,890][213368] Sum rewards: 46.416, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.462', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.194', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'weapon4': '0.450', 'weapon2': '0.594', 'WEAPON3': '1.150', 'weapon3': '2.600', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.603', 'FRAGCOUNT': '41.000'} [2023-02-24 21:19:03,095][213382] DAMAGECOUNT value on done: 533898.0 [2023-02-24 21:19:03,095][213382] Sum rewards: 38.916, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.230', 'AMMO5': '0.018', 'AMMO2': '0.063', 'AMMO3': '0.142', 'weapon5': '0.198', 'AMMO4': '0.317', 'WEAPON5': '0.550', 'weapon2': '0.708', 'WEAPON4': '0.750', 'WEAPON3': '0.850', 'weapon4': '1.020', 'weapon3': '1.726', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.083', 'FRAGCOUNT': '33.000'} [2023-02-24 21:19:03,127][213383] DAMAGECOUNT value on done: 528430.0 [2023-02-24 21:19:03,128][213383] Sum rewards: 50.870, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.774', 'AMMO2': '0.027', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'ARMOR': '0.404', 'weapon2': '0.488', 'weapon4': '0.708', 'WEAPON3': '1.250', 'weapon3': '2.344', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '12.801', 'FRAGCOUNT': '43.000'} [2023-02-24 21:19:03,136][213369] DAMAGECOUNT value on done: 535207.0 [2023-02-24 21:19:03,136][213369] Sum rewards: 36.046, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.810', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.058', 'weapon5': '0.072', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'AMMO4': '0.289', 'weapon2': '0.294', 'WEAPON4': '0.500', 'weapon4': '0.576', 'WEAPON3': '1.350', 'HITCOUNT': '2.520', 'weapon3': '2.834', 'DAMAGECOUNT': '10.728', 'FRAGCOUNT': '36.000'} [2023-02-24 21:19:03,189][213368] DAMAGECOUNT value on done: 534012.0 [2023-02-24 21:19:03,190][213368] Sum rewards: 50.980, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.492', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.096', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'weapon2': '0.200', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon4': '0.254', 'WEAPON3': '1.250', 'HITCOUNT': '2.720', 'weapon3': '3.190', 'DAMAGECOUNT': '13.755', 'FRAGCOUNT': '43.000'} [2023-02-24 21:19:03,396][213382] DAMAGECOUNT value on done: 530763.0 [2023-02-24 21:19:03,396][213382] Sum rewards: 43.718, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.943', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'weapon5': '0.130', 'weapon2': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.213', 'weapon4': '0.306', 'ARMOR': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.370', 'weapon3': '3.174', 'DAMAGECOUNT': '11.517', 'FRAGCOUNT': '39.000'} [2023-02-24 21:19:03,448][213369] DAMAGECOUNT value on done: 529238.0 [2023-02-24 21:19:03,449][213369] Sum rewards: 49.657, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.413', 'AMMO5': '0.016', 'AMMO2': '0.051', 'AMMO3': '0.192', 'weapon5': '0.238', 'AMMO4': '0.253', 'weapon4': '0.370', 'WEAPON5': '0.450', 'ARMOR': '0.486', 'WEAPON4': '0.550', 'weapon2': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.412', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.651', 'FRAGCOUNT': '43.000'} [2023-02-24 21:19:03,471][213368] DAMAGECOUNT value on done: 527019.0 [2023-02-24 21:19:03,471][213368] Sum rewards: 43.339, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.493', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon4': '0.114', 'WEAPON5': '0.150', 'weapon5': '0.166', 'weapon2': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.287', 'WEAPON3': '1.750', 'HITCOUNT': '2.930', 'weapon3': '3.326', 'DAMAGECOUNT': '13.857', 'FRAGCOUNT': '41.000'} [2023-02-24 21:19:03,738][213383] DAMAGECOUNT value on done: 534437.0 [2023-02-24 21:19:03,739][213383] Sum rewards: 32.374, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.764', 'AMMO5': '0.010', 'AMMO2': '0.054', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon7': '0.204', 'AMMO4': '0.269', 'WEAPON4': '0.450', 'weapon2': '0.570', 'weapon4': '0.684', 'WEAPON3': '0.950', 'weapon3': '2.172', 'HITCOUNT': '2.180', 'DAMAGECOUNT': '9.921', 'FRAGCOUNT': '30.500'} [2023-02-24 21:19:03,749][213369] DAMAGECOUNT value on done: 520629.0 [2023-02-24 21:19:03,749][213369] Sum rewards: 45.579, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.400', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.066', 'AMMO3': '0.144', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.488', 'weapon4': '0.496', 'WEAPON3': '0.850', 'HITCOUNT': '2.470', 'weapon3': '2.552', 'DAMAGECOUNT': '10.827', 'FRAGCOUNT': '38.000'} [2023-02-24 21:19:03,773][213368] DAMAGECOUNT value on done: 524167.0 [2023-02-24 21:19:03,774][213368] Sum rewards: 36.370, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.845', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO4': '0.185', 'AMMO3': '0.219', 'WEAPON4': '0.500', 'weapon2': '0.584', 'weapon4': '0.644', 'WEAPON3': '1.300', 'weapon3': '2.414', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '11.067', 'FRAGCOUNT': '36.000'} [2023-02-24 21:19:03,821][213382] DAMAGECOUNT value on done: 519414.0 [2023-02-24 21:19:03,822][213382] Sum rewards: 45.545, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.220', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon2': '0.210', 'AMMO3': '0.219', 'weapon5': '0.222', 'AMMO4': '0.238', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.732', 'WEAPON3': '1.250', 'weapon3': '2.510', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.909', 'FRAGCOUNT': '42.000'} [2023-02-24 21:19:04,035][213383] DAMAGECOUNT value on done: 528253.0 [2023-02-24 21:19:04,036][213383] Sum rewards: 49.987, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.290', 'ARMOR': '0.005', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon2': '0.190', 'AMMO3': '0.197', 'weapon5': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.380', 'WEAPON3': '1.150', 'HITCOUNT': '2.750', 'weapon3': '2.974', 'DAMAGECOUNT': '13.725', 'FRAGCOUNT': '44.000'} [2023-02-24 21:19:04,119][213382] DAMAGECOUNT value on done: 527631.0 [2023-02-24 21:19:04,119][213382] Sum rewards: 45.986, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.710', 'AMMO2': '0.003', 'AMMO4': '0.017', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon2': '0.236', 'ARMOR': '0.456', 'weapon4': '0.486', 'WEAPON3': '1.500', 'HITCOUNT': '2.770', 'weapon3': '3.050', 'DAMAGECOUNT': '11.994', 'FRAGCOUNT': '43.000'} [2023-02-24 21:19:04,224][213384] DAMAGECOUNT value on done: 534877.0 [2023-02-24 21:19:04,224][213384] Sum rewards: 44.790, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.650', 'AMMO5': '0.007', 'AMMO2': '0.035', 'AMMO4': '0.173', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.222', 'weapon2': '0.312', 'WEAPON4': '0.350', 'weapon4': '0.894', 'WEAPON3': '1.150', 'weapon3': '2.398', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.159', 'FRAGCOUNT': '39.000'} [2023-02-24 21:19:04,525][213384] DAMAGECOUNT value on done: 520236.0 [2023-02-24 21:19:04,525][213384] Sum rewards: 48.918, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.960', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.052', 'AMMO4': '0.058', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.434', 'WEAPON3': '1.000', 'weapon2': '1.024', 'weapon3': '2.344', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.303', 'FRAGCOUNT': '40.000'} [2023-02-24 21:19:04,860][213384] DAMAGECOUNT value on done: 529613.0 [2023-02-24 21:19:04,860][213384] Sum rewards: 45.801, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.760', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'weapon5': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.106', 'weapon2': '0.180', 'AMMO3': '0.273', 'WEAPON3': '1.700', 'HITCOUNT': '2.620', 'weapon3': '3.432', 'DAMAGECOUNT': '12.720', 'FRAGCOUNT': '43.000'} [2023-02-24 21:19:05,162][213384] DAMAGECOUNT value on done: 535876.0 [2023-02-24 21:19:05,163][213384] Sum rewards: 53.052, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.904', 'AMMO5': '0.014', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.180', 'AMMO3': '0.186', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.418', 'weapon4': '0.664', 'WEAPON3': '1.150', 'weapon3': '2.442', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '46.000'} [2023-02-24 21:19:05,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13858.2, 300 sec: 13843.1). Total num frames: 144113664. Throughput: 0: 3462.9. Samples: 11017618. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:19:05,243][213332] Avg episode reward: [(0, '46.049')] [2023-02-24 21:19:05,668][213365] Updated weights for policy 0, policy_version 35186 (0.0010) [2023-02-24 21:19:08,607][213365] Updated weights for policy 0, policy_version 35196 (0.0009) [2023-02-24 21:19:08,611][213367] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 21:19:10,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 144183296. Throughput: 0: 3461.6. Samples: 11038368. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:19:10,243][213332] Avg episode reward: [(0, '46.049')] [2023-02-24 21:19:11,562][213365] Updated weights for policy 0, policy_version 35206 (0.0009) [2023-02-24 21:19:14,526][213365] Updated weights for policy 0, policy_version 35216 (0.0009) [2023-02-24 21:19:15,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 144252928. Throughput: 0: 3460.4. Samples: 11059136. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:19:15,243][213332] Avg episode reward: [(0, '46.049')] [2023-02-24 21:19:17,512][213365] Updated weights for policy 0, policy_version 35226 (0.0009) [2023-02-24 21:19:19,319][213367] DAMAGECOUNT value on done: 529948.0 [2023-02-24 21:19:19,320][213367] Sum rewards: 43.788, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.413', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.156', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.334', 'weapon2': '0.508', 'WEAPON3': '1.050', 'HITCOUNT': '2.490', 'weapon3': '2.778', 'DAMAGECOUNT': '11.928', 'FRAGCOUNT': '38.000'} [2023-02-24 21:19:19,615][213367] DAMAGECOUNT value on done: 535498.0 [2023-02-24 21:19:19,615][213367] Sum rewards: 35.094, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.146', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.122', 'weapon5': '0.182', 'AMMO3': '0.200', 'weapon2': '0.290', 'WEAPON4': '0.300', 'weapon4': '0.390', 'ARMOR': '0.456', 'WEAPON3': '1.050', 'HITCOUNT': '2.170', 'weapon3': '2.674', 'DAMAGECOUNT': '10.329', 'FRAGCOUNT': '32.000'} [2023-02-24 21:19:19,625][213367] DAMAGECOUNT value on done: 529676.0 [2023-02-24 21:19:19,626][213367] Sum rewards: 46.122, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.850', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.216', 'weapon4': '0.236', 'weapon2': '0.418', 'WEAPON3': '1.300', 'HITCOUNT': '2.610', 'weapon3': '2.970', 'DAMAGECOUNT': '10.968', 'FRAGCOUNT': '41.000'} [2023-02-24 21:19:19,922][213367] DAMAGECOUNT value on done: 540287.0 [2023-02-24 21:19:19,922][213367] Sum rewards: 42.775, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.004', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.073', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'HEALTH': '0.203', 'weapon4': '0.244', 'WEAPON3': '0.650', 'weapon2': '1.084', 'weapon3': '2.372', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '10.770', 'FRAGCOUNT': '32.000'} [2023-02-24 21:19:20,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 144322560. Throughput: 0: 3461.7. Samples: 11069522. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:19:20,243][213332] Avg episode reward: [(0, '45.834')] [2023-02-24 21:19:20,449][213365] Updated weights for policy 0, policy_version 35236 (0.0009) [2023-02-24 21:19:20,479][213372] DAMAGECOUNT value on done: 546252.0 [2023-02-24 21:19:20,480][213372] Sum rewards: 49.267, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.192', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO4': '0.187', 'weapon2': '0.198', 'AMMO3': '0.284', 'WEAPON4': '0.350', 'weapon4': '0.658', 'WEAPON3': '1.600', 'weapon3': '2.810', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.065', 'FRAGCOUNT': '46.000'} [2023-02-24 21:19:20,786][213372] DAMAGECOUNT value on done: 527309.0 [2023-02-24 21:19:20,786][213372] Sum rewards: 39.378, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.470', 'AMMO2': '0.007', 'AMMO4': '0.035', 'WEAPON4': '0.100', 'AMMO3': '0.237', 'weapon4': '0.274', 'weapon2': '0.372', 'WEAPON3': '1.450', 'HITCOUNT': '2.710', 'weapon3': '3.112', 'DAMAGECOUNT': '10.800', 'FRAGCOUNT': '37.000'} [2023-02-24 21:19:20,796][213372] DAMAGECOUNT value on done: 538923.0 [2023-02-24 21:19:20,796][213372] Sum rewards: 41.081, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.814', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.226', 'weapon4': '0.284', 'weapon2': '0.336', 'WEAPON3': '1.350', 'HITCOUNT': '2.700', 'weapon3': '3.142', 'DAMAGECOUNT': '11.844', 'FRAGCOUNT': '37.000'} [2023-02-24 21:19:21,093][213372] DAMAGECOUNT value on done: 535008.0 [2023-02-24 21:19:21,093][213372] Sum rewards: 49.145, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.080', 'AMMO5': '0.004', 'weapon5': '0.018', 'AMMO2': '0.019', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'weapon4': '0.256', 'weapon2': '0.346', 'WEAPON3': '1.250', 'HITCOUNT': '2.690', 'weapon3': '3.202', 'DAMAGECOUNT': '12.120', 'FRAGCOUNT': '43.000'} [2023-02-24 21:19:21,411][213366] DAMAGECOUNT value on done: 524150.0 [2023-02-24 21:19:21,412][213366] Sum rewards: 53.229, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.338', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.076', 'AMMO3': '0.182', 'weapon2': '0.198', 'weapon5': '0.220', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.596', 'WEAPON3': '1.000', 'weapon3': '2.650', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '13.317', 'FRAGCOUNT': '47.000'} [2023-02-24 21:19:21,708][213366] DAMAGECOUNT value on done: 537326.0 [2023-02-24 21:19:21,708][213366] Sum rewards: 36.982, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.815', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.046', 'weapon4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.213', 'weapon2': '0.396', 'WEAPON3': '1.400', 'HITCOUNT': '2.400', 'weapon3': '3.360', 'DAMAGECOUNT': '10.701', 'FRAGCOUNT': '33.000'} [2023-02-24 21:19:21,717][213366] DAMAGECOUNT value on done: 549255.0 [2023-02-24 21:19:21,717][213366] Sum rewards: 47.118, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.296', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.118', 'AMMO4': '0.127', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.340', 'weapon2': '0.386', 'WEAPON3': '1.050', 'HITCOUNT': '2.730', 'weapon3': '2.958', 'DAMAGECOUNT': '11.985', 'FRAGCOUNT': '43.000'} [2023-02-24 21:19:22,016][213366] DAMAGECOUNT value on done: 539498.0 [2023-02-24 21:19:22,017][213366] Sum rewards: 39.397, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.760', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.151', 'AMMO3': '0.174', 'weapon5': '0.228', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.482', 'weapon2': '0.658', 'WEAPON3': '1.050', 'weapon3': '2.364', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '12.225', 'FRAGCOUNT': '34.000'} [2023-02-24 21:19:22,162][213383] DAMAGECOUNT value on done: 531738.0 [2023-02-24 21:19:22,162][213383] Sum rewards: 44.634, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.402', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.050', 'AMMO3': '0.159', 'weapon5': '0.194', 'AMMO4': '0.248', 'WEAPON5': '0.300', 'weapon2': '0.384', 'WEAPON4': '0.450', 'weapon4': '0.682', 'WEAPON3': '1.050', 'weapon3': '2.492', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '11.877', 'FRAGCOUNT': '40.000'} [2023-02-24 21:19:22,275][213369] DAMAGECOUNT value on done: 536770.0 [2023-02-24 21:19:22,276][213369] Sum rewards: 50.347, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.289', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.150', 'weapon5': '0.206', 'weapon2': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon4': '0.726', 'WEAPON3': '0.900', 'weapon3': '2.610', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.993', 'FRAGCOUNT': '42.000'} [2023-02-24 21:19:22,325][213368] DAMAGECOUNT value on done: 527497.0 [2023-02-24 21:19:22,325][213368] Sum rewards: 45.715, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.772', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.045', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO4': '0.226', 'weapon2': '0.244', 'AMMO3': '0.268', 'WEAPON4': '0.350', 'weapon4': '0.822', 'WEAPON3': '1.600', 'weapon3': '2.470', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '13.278', 'FRAGCOUNT': '43.000'} [2023-02-24 21:19:22,412][213382] DAMAGECOUNT value on done: 538107.0 [2023-02-24 21:19:22,413][213382] Sum rewards: 49.217, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.993', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon7': '0.052', 'AMMO4': '0.079', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.135', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.460', 'weapon4': '0.576', 'WEAPON3': '0.850', 'HITCOUNT': '2.410', 'weapon3': '2.670', 'DAMAGECOUNT': '12.627', 'FRAGCOUNT': '40.000'} [2023-02-24 21:19:22,468][213383] DAMAGECOUNT value on done: 532255.0 [2023-02-24 21:19:22,469][213383] Sum rewards: 46.886, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.920', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO4': '0.137', 'AMMO3': '0.153', 'WEAPON4': '0.350', 'weapon2': '0.388', 'weapon4': '0.604', 'WEAPON3': '1.000', 'weapon3': '2.778', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '11.400', 'FRAGCOUNT': '41.000'} [2023-02-24 21:19:22,579][213369] DAMAGECOUNT value on done: 539644.0 [2023-02-24 21:19:22,579][213369] Sum rewards: 40.852, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.426', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.044', 'weapon5': '0.088', 'AMMO3': '0.203', 'AMMO4': '0.222', 'WEAPON5': '0.350', 'weapon4': '0.410', 'WEAPON4': '0.450', 'weapon2': '0.574', 'WEAPON3': '1.200', 'weapon3': '2.648', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '13.311', 'FRAGCOUNT': '36.500'} [2023-02-24 21:19:22,627][213368] DAMAGECOUNT value on done: 538432.0 [2023-02-24 21:19:22,628][213368] Sum rewards: 46.392, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.952', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.152', 'weapon4': '0.260', 'AMMO3': '0.304', 'weapon2': '0.346', 'WEAPON3': '1.800', 'weapon3': '2.836', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.260', 'FRAGCOUNT': '46.000'} [2023-02-24 21:19:22,709][213382] DAMAGECOUNT value on done: 534759.0 [2023-02-24 21:19:22,709][213382] Sum rewards: 46.962, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.422', 'AMMO5': '0.009', 'ARMOR': '0.024', 'AMMO2': '0.044', 'weapon5': '0.114', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'AMMO4': '0.218', 'weapon2': '0.270', 'WEAPON4': '0.400', 'weapon4': '0.938', 'WEAPON3': '1.050', 'weapon3': '2.406', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '11.988', 'FRAGCOUNT': '40.000'} [2023-02-24 21:19:22,883][213369] DAMAGECOUNT value on done: 533573.0 [2023-02-24 21:19:22,883][213369] Sum rewards: 44.142, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.230', 'AMMO5': '0.017', 'AMMO2': '0.052', 'AMMO3': '0.181', 'AMMO4': '0.262', 'weapon5': '0.302', 'weapon2': '0.442', 'WEAPON5': '0.450', 'weapon4': '0.524', 'WEAPON4': '0.650', 'WEAPON3': '1.000', 'weapon3': '2.236', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '13.005', 'FRAGCOUNT': '39.500'} [2023-02-24 21:19:22,906][213368] DAMAGECOUNT value on done: 531319.0 [2023-02-24 21:19:22,906][213368] Sum rewards: 50.275, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.940', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO3': '0.202', 'weapon2': '0.412', 'WEAPON3': '1.350', 'HITCOUNT': '2.930', 'weapon3': '3.446', 'DAMAGECOUNT': '12.900', 'FRAGCOUNT': '43.000'} [2023-02-24 21:19:23,033][213384] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 21:19:23,148][213383] DAMAGECOUNT value on done: 538722.0 [2023-02-24 21:19:23,149][213383] Sum rewards: 48.393, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.523', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon5': '0.144', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'AMMO4': '0.219', 'WEAPON4': '0.350', 'weapon4': '0.522', 'weapon2': '0.538', 'WEAPON3': '1.000', 'weapon3': '2.572', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '12.855', 'FRAGCOUNT': '41.000'} [2023-02-24 21:19:23,156][213382] DAMAGECOUNT value on done: 523261.0 [2023-02-24 21:19:23,156][213382] Sum rewards: 50.467, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.272', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'weapon2': '0.190', 'weapon4': '0.346', 'ARMOR': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.480', 'weapon3': '2.750', 'DAMAGECOUNT': '11.541', 'FRAGCOUNT': '44.000'} [2023-02-24 21:19:23,179][213369] DAMAGECOUNT value on done: 524565.0 [2023-02-24 21:19:23,180][213369] Sum rewards: 42.118, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.892', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.048', 'weapon5': '0.112', 'WEAPON5': '0.200', 'weapon2': '0.202', 'AMMO4': '0.240', 'AMMO3': '0.273', 'WEAPON4': '0.350', 'weapon4': '0.924', 'WEAPON3': '1.650', 'weapon3': '2.330', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '11.808', 'FRAGCOUNT': '41.000'} [2023-02-24 21:19:23,197][213368] DAMAGECOUNT value on done: 527767.0 [2023-02-24 21:19:23,197][213368] Sum rewards: 36.459, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.481', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon7': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.134', 'weapon5': '0.194', 'WEAPON5': '0.200', 'AMMO4': '0.252', 'weapon2': '0.286', 'WEAPON4': '0.500', 'WEAPON3': '0.800', 'weapon4': '1.212', 'weapon3': '1.964', 'HITCOUNT': '2.400', 'DAMAGECOUNT': '10.800', 'FRAGCOUNT': '29.000'} [2023-02-24 21:19:23,411][213365] Updated weights for policy 0, policy_version 35246 (0.0009) [2023-02-24 21:19:23,446][213383] DAMAGECOUNT value on done: 531856.0 [2023-02-24 21:19:23,446][213383] Sum rewards: 34.521, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.016', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO4': '0.166', 'AMMO3': '0.189', 'weapon5': '0.228', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.414', 'weapon2': '0.762', 'WEAPON3': '1.200', 'HITCOUNT': '2.140', 'weapon3': '2.282', 'DAMAGECOUNT': '10.809', 'FRAGCOUNT': '31.000'} [2023-02-24 21:19:23,449][213372] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('ARMOR', -0.001, -1.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 21:19:23,458][213382] DAMAGECOUNT value on done: 531927.0 [2023-02-24 21:19:23,459][213382] Sum rewards: 48.569, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.374', 'AMMO5': '0.009', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.096', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'weapon4': '0.256', 'weapon2': '0.672', 'WEAPON3': '1.050', 'weapon3': '2.798', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.888', 'FRAGCOUNT': '40.000'} [2023-02-24 21:19:23,677][213384] DAMAGECOUNT value on done: 538406.0 [2023-02-24 21:19:23,677][213384] Sum rewards: 35.703, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.332', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.023', 'weapon4': '0.100', 'AMMO4': '0.113', 'weapon5': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'WEAPON5': '0.250', 'weapon2': '0.568', 'WEAPON3': '1.050', 'HITCOUNT': '2.180', 'weapon3': '2.950', 'DAMAGECOUNT': '10.587', 'FRAGCOUNT': '30.000'} [2023-02-24 21:19:23,970][213384] DAMAGECOUNT value on done: 524425.0 [2023-02-24 21:19:23,971][213384] Sum rewards: 40.589, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.982', 'ARMOR': '0.004', 'AMMO5': '0.004', 'AMMO2': '0.032', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.162', 'weapon2': '0.192', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'weapon4': '0.592', 'WEAPON3': '1.450', 'weapon3': '2.792', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.567', 'FRAGCOUNT': '38.000'} [2023-02-24 21:19:24,299][213384] DAMAGECOUNT value on done: 534798.0 [2023-02-24 21:19:24,299][213384] Sum rewards: 56.623, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.040', 'ARMOR': '0.005', 'AMMO2': '0.008', 'AMMO5': '0.012', 'weapon4': '0.022', 'AMMO4': '0.038', 'weapon5': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.230', 'WEAPON5': '0.250', 'weapon2': '0.308', 'WEAPON3': '1.550', 'weapon3': '3.378', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '49.000'} [2023-02-24 21:19:24,588][213384] DAMAGECOUNT value on done: 539595.0 [2023-02-24 21:19:24,588][213384] Sum rewards: 36.043, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.366', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO4': '0.162', 'AMMO3': '0.196', 'weapon5': '0.212', 'WEAPON5': '0.400', 'weapon2': '0.434', 'ARMOR': '0.463', 'WEAPON4': '0.500', 'weapon4': '0.760', 'WEAPON3': '1.150', 'weapon3': '2.188', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '11.157', 'FRAGCOUNT': '34.000'} [2023-02-24 21:19:25,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 144392192. Throughput: 0: 3460.3. Samples: 11090288. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:19:25,243][213332] Avg episode reward: [(0, '45.240')] [2023-02-24 21:19:26,379][213365] Updated weights for policy 0, policy_version 35256 (0.0009) [2023-02-24 21:19:26,937][213367] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.036000000000000004, -12.0), ('weapon5', 0.002)] [2023-02-24 21:19:29,350][213365] Updated weights for policy 0, policy_version 35266 (0.0008) [2023-02-24 21:19:30,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 144461824. Throughput: 0: 3461.0. Samples: 11111072. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:19:30,244][213332] Avg episode reward: [(0, '45.240')] [2023-02-24 21:19:32,309][213365] Updated weights for policy 0, policy_version 35276 (0.0009) [2023-02-24 21:19:35,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13789.9, 300 sec: 13843.1). Total num frames: 144527360. Throughput: 0: 3460.5. Samples: 11121412. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:19:35,243][213332] Avg episode reward: [(0, '45.240')] [2023-02-24 21:19:35,281][213365] Updated weights for policy 0, policy_version 35286 (0.0009) [2023-02-24 21:19:38,248][213365] Updated weights for policy 0, policy_version 35296 (0.0009) [2023-02-24 21:19:38,785][213367] DAMAGECOUNT value on done: 534659.0 [2023-02-24 21:19:38,786][213367] Sum rewards: 49.874, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.200', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.100', 'weapon4': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.252', 'weapon2': '0.356', 'WEAPON3': '1.400', 'HITCOUNT': '2.890', 'weapon3': '3.174', 'DAMAGECOUNT': '14.133', 'FRAGCOUNT': '44.000'} [2023-02-24 21:19:39,086][213367] DAMAGECOUNT value on done: 539872.0 [2023-02-24 21:19:39,087][213367] Sum rewards: 45.924, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.430', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.112', 'AMMO4': '0.146', 'AMMO3': '0.228', 'weapon2': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.422', 'WEAPON3': '1.400', 'HITCOUNT': '2.800', 'weapon3': '2.864', 'DAMAGECOUNT': '13.122', 'FRAGCOUNT': '43.000'} [2023-02-24 21:19:39,097][213367] DAMAGECOUNT value on done: 534328.0 [2023-02-24 21:19:39,097][213367] Sum rewards: 48.200, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.195', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.065', 'AMMO3': '0.169', 'weapon5': '0.244', 'weapon4': '0.310', 'AMMO4': '0.324', 'weapon2': '0.420', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'HITCOUNT': '2.640', 'weapon3': '2.726', 'DAMAGECOUNT': '13.473', 'FRAGCOUNT': '42.000'} [2023-02-24 21:19:39,388][213367] DAMAGECOUNT value on done: 544590.0 [2023-02-24 21:19:39,389][213367] Sum rewards: 43.571, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.340', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon5': '0.182', 'AMMO4': '0.195', 'AMMO3': '0.199', 'WEAPON5': '0.400', 'weapon2': '0.410', 'WEAPON4': '0.550', 'weapon4': '0.620', 'WEAPON3': '1.150', 'weapon3': '2.340', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '12.885', 'FRAGCOUNT': '40.000'} [2023-02-24 21:19:39,956][213372] DAMAGECOUNT value on done: 551048.0 [2023-02-24 21:19:39,956][213372] Sum rewards: 51.049, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.476', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.080', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon2': '0.330', 'WEAPON4': '0.450', 'weapon4': '0.460', 'WEAPON3': '1.450', 'weapon3': '2.884', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.388', 'FRAGCOUNT': '46.500'} [2023-02-24 21:19:40,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13789.9, 300 sec: 13843.1). Total num frames: 144596992. Throughput: 0: 3459.1. Samples: 11142072. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:19:40,243][213332] Avg episode reward: [(0, '45.281')] [2023-02-24 21:19:40,257][213372] DAMAGECOUNT value on done: 531628.0 [2023-02-24 21:19:40,257][213372] Sum rewards: 43.464, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.024', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO4': '0.184', 'weapon5': '0.238', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.456', 'weapon2': '0.476', 'WEAPON3': '1.350', 'weapon3': '2.534', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.957', 'FRAGCOUNT': '40.000'} [2023-02-24 21:19:40,267][213372] DAMAGECOUNT value on done: 542534.0 [2023-02-24 21:19:40,267][213372] Sum rewards: 40.195, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.180', 'AMMO5': '0.014', 'AMMO2': '0.060', 'weapon5': '0.158', 'AMMO3': '0.220', 'AMMO4': '0.299', 'WEAPON5': '0.350', 'weapon2': '0.368', 'WEAPON4': '0.600', 'weapon4': '0.824', 'WEAPON3': '1.150', 'weapon3': '2.358', 'HITCOUNT': '2.390', 'DAMAGECOUNT': '10.833', 'FRAGCOUNT': '39.000'} [2023-02-24 21:19:40,562][213372] DAMAGECOUNT value on done: 538319.0 [2023-02-24 21:19:40,563][213372] Sum rewards: 36.205, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.581', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.104', 'AMMO4': '0.115', 'AMMO3': '0.136', 'weapon5': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.950', 'weapon2': '1.050', 'HITCOUNT': '2.200', 'weapon3': '2.302', 'DAMAGECOUNT': '9.903', 'FRAGCOUNT': '31.000'} [2023-02-24 21:19:40,862][213366] DAMAGECOUNT value on done: 528857.0 [2023-02-24 21:19:40,863][213366] Sum rewards: 53.056, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.005', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.033', 'weapon5': '0.102', 'AMMO4': '0.165', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.328', 'WEAPON4': '0.500', 'weapon4': '0.728', 'WEAPON3': '1.300', 'weapon3': '2.606', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.121', 'FRAGCOUNT': '46.000'} [2023-02-24 21:19:40,892][213384] Large shaping reward 2.573 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.069, -23.0), ('weapon5', 0.002)] [2023-02-24 21:19:41,168][213366] DAMAGECOUNT value on done: 541839.0 [2023-02-24 21:19:41,169][213366] Sum rewards: 57.615, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.920', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.085', 'AMMO3': '0.163', 'weapon5': '0.182', 'WEAPON4': '0.200', 'weapon2': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.570', 'WEAPON3': '1.000', 'weapon3': '2.738', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.539', 'FRAGCOUNT': '48.000'} [2023-02-24 21:19:41,177][213366] DAMAGECOUNT value on done: 553440.0 [2023-02-24 21:19:41,178][213366] Sum rewards: 52.458, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.178', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon4': '0.098', 'weapon5': '0.124', 'AMMO3': '0.157', 'AMMO4': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.908', 'WEAPON3': '1.000', 'weapon3': '2.678', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.555', 'FRAGCOUNT': '44.000'} [2023-02-24 21:19:41,206][213365] Updated weights for policy 0, policy_version 35306 (0.0009) [2023-02-24 21:19:41,467][213366] DAMAGECOUNT value on done: 543636.0 [2023-02-24 21:19:41,468][213366] Sum rewards: 44.557, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.796', 'AMMO5': '0.009', 'ARMOR': '0.016', 'AMMO2': '0.031', 'weapon5': '0.076', 'AMMO4': '0.155', 'AMMO3': '0.159', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.350', 'weapon2': '0.712', 'WEAPON3': '0.900', 'weapon3': '2.590', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.414', 'FRAGCOUNT': '38.000'} [2023-02-24 21:19:41,592][213383] DAMAGECOUNT value on done: 535356.0 [2023-02-24 21:19:41,592][213383] Sum rewards: 44.307, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.639', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.026', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon2': '0.316', 'weapon4': '0.384', 'WEAPON3': '1.100', 'HITCOUNT': '2.460', 'weapon3': '2.990', 'DAMAGECOUNT': '10.854', 'FRAGCOUNT': '37.000'} [2023-02-24 21:19:41,730][213369] DAMAGECOUNT value on done: 540832.0 [2023-02-24 21:19:41,730][213369] Sum rewards: 38.189, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.080', 'AMMO5': '0.029', 'AMMO2': '0.051', 'AMMO3': '0.151', 'AMMO4': '0.257', 'weapon5': '0.386', 'weapon2': '0.446', 'WEAPON4': '0.650', 'WEAPON5': '0.800', 'WEAPON3': '0.850', 'weapon4': '0.982', 'weapon3': '1.728', 'HITCOUNT': '2.300', 'DAMAGECOUNT': '12.138', 'FRAGCOUNT': '33.000'} [2023-02-24 21:19:41,766][213368] DAMAGECOUNT value on done: 531351.0 [2023-02-24 21:19:41,767][213368] Sum rewards: 43.709, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.260', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.032', 'AMMO3': '0.158', 'AMMO4': '0.160', 'weapon5': '0.182', 'WEAPON5': '0.400', 'weapon2': '0.520', 'WEAPON4': '0.600', 'weapon4': '0.660', 'WEAPON3': '1.000', 'weapon3': '2.370', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '11.562', 'FRAGCOUNT': '40.000'} [2023-02-24 21:19:41,864][213382] DAMAGECOUNT value on done: 542428.0 [2023-02-24 21:19:41,864][213382] Sum rewards: 51.939, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.967', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.136', 'weapon5': '0.150', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.618', 'weapon2': '0.754', 'WEAPON3': '0.800', 'weapon3': '2.224', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.963', 'FRAGCOUNT': '43.000'} [2023-02-24 21:19:41,882][213383] DAMAGECOUNT value on done: 536117.0 [2023-02-24 21:19:41,883][213383] Sum rewards: 42.099, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.862', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon2': '0.152', 'AMMO3': '0.165', 'AMMO4': '0.180', 'weapon5': '0.184', 'weapon4': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.000', 'HITCOUNT': '2.320', 'weapon3': '3.208', 'DAMAGECOUNT': '11.586', 'FRAGCOUNT': '36.000'} [2023-02-24 21:19:42,031][213369] DAMAGECOUNT value on done: 544071.0 [2023-02-24 21:19:42,031][213369] Sum rewards: 51.889, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.812', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.040', 'AMMO3': '0.151', 'weapon5': '0.176', 'AMMO4': '0.198', 'WEAPON5': '0.300', 'WEAPON4': '0.550', 'weapon2': '0.606', 'weapon4': '0.766', 'WEAPON3': '0.850', 'weapon3': '2.240', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.236', 'FRAGCOUNT': '45.000'} [2023-02-24 21:19:42,068][213368] DAMAGECOUNT value on done: 541882.0 [2023-02-24 21:19:42,069][213368] Sum rewards: 44.048, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.079', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.024', 'weapon4': '0.084', 'WEAPON4': '0.100', 'weapon5': '0.114', 'AMMO3': '0.204', 'WEAPON5': '0.300', 'weapon2': '0.428', 'WEAPON3': '1.300', 'HITCOUNT': '2.310', 'weapon3': '3.146', 'DAMAGECOUNT': '10.350', 'FRAGCOUNT': '39.000'} [2023-02-24 21:19:42,172][213382] DAMAGECOUNT value on done: 539788.0 [2023-02-24 21:19:42,172][213382] Sum rewards: 57.839, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.090', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.132', 'WEAPON5': '0.200', 'AMMO4': '0.215', 'AMMO3': '0.218', 'weapon4': '0.264', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.102', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.087', 'FRAGCOUNT': '53.000'} [2023-02-24 21:19:42,324][213369] DAMAGECOUNT value on done: 538560.0 [2023-02-24 21:19:42,325][213369] Sum rewards: 54.641, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.554', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.032', 'weapon5': '0.148', 'AMMO4': '0.158', 'weapon2': '0.192', 'AMMO3': '0.209', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.512', 'WEAPON3': '1.250', 'weapon3': '2.850', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.961', 'FRAGCOUNT': '48.000'} [2023-02-24 21:19:42,340][213368] DAMAGECOUNT value on done: 535254.0 [2023-02-24 21:19:42,341][213368] Sum rewards: 42.889, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.209', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.012', 'AMMO4': '0.053', 'weapon4': '0.056', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.226', 'weapon2': '0.346', 'WEAPON3': '1.300', 'HITCOUNT': '2.680', 'weapon3': '3.404', 'DAMAGECOUNT': '11.805', 'FRAGCOUNT': '39.000'} [2023-02-24 21:19:42,610][213383] DAMAGECOUNT value on done: 542866.0 [2023-02-24 21:19:42,611][213383] Sum rewards: 44.802, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.240', 'AMMO5': '0.020', 'AMMO2': '0.039', 'weapon4': '0.082', 'weapon2': '0.144', 'AMMO4': '0.197', 'AMMO3': '0.202', 'weapon5': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.570', 'weapon3': '3.278', 'DAMAGECOUNT': '12.432', 'FRAGCOUNT': '40.000'} [2023-02-24 21:19:42,622][213382] DAMAGECOUNT value on done: 527181.0 [2023-02-24 21:19:42,622][213382] Sum rewards: 42.312, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.702', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.072', 'AMMO3': '0.185', 'weapon5': '0.228', 'weapon2': '0.284', 'WEAPON4': '0.300', 'weapon4': '0.360', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.310', 'weapon3': '2.780', 'DAMAGECOUNT': '11.760', 'FRAGCOUNT': '37.000'} [2023-02-24 21:19:42,622][213369] DAMAGECOUNT value on done: 529292.0 [2023-02-24 21:19:42,623][213369] Sum rewards: 53.339, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.853', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.118', 'AMMO3': '0.171', 'AMMO4': '0.189', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon4': '0.500', 'weapon2': '0.632', 'WEAPON3': '1.050', 'weapon3': '2.338', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.157', 'FRAGCOUNT': '45.000'} [2023-02-24 21:19:42,639][213368] DAMAGECOUNT value on done: 532224.0 [2023-02-24 21:19:42,641][213368] Sum rewards: 51.900, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.300', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon4': '0.128', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon2': '0.506', 'WEAPON3': '1.150', 'HITCOUNT': '3.140', 'weapon3': '3.180', 'DAMAGECOUNT': '13.371', 'FRAGCOUNT': '44.000'} [2023-02-24 21:19:42,908][213383] DAMAGECOUNT value on done: 535969.0 [2023-02-24 21:19:42,908][213383] Sum rewards: 49.042, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.142', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO3': '0.160', 'AMMO4': '0.165', 'weapon5': '0.210', 'weapon2': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon4': '0.986', 'weapon3': '2.250', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.339', 'FRAGCOUNT': '43.000'} [2023-02-24 21:19:42,927][213382] DAMAGECOUNT value on done: 536475.0 [2023-02-24 21:19:42,927][213382] Sum rewards: 48.218, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.462', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.151', 'AMMO4': '0.192', 'weapon5': '0.238', 'WEAPON5': '0.300', 'weapon4': '0.312', 'WEAPON4': '0.400', 'weapon2': '0.836', 'WEAPON3': '0.900', 'weapon3': '2.376', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.644', 'FRAGCOUNT': '41.000'} [2023-02-24 21:19:43,134][213384] DAMAGECOUNT value on done: 542904.0 [2023-02-24 21:19:43,134][213384] Sum rewards: 52.313, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.883', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'weapon2': '0.254', 'weapon4': '0.498', 'WEAPON3': '1.150', 'weapon3': '2.810', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.494', 'FRAGCOUNT': '44.000'} [2023-02-24 21:19:43,430][213384] DAMAGECOUNT value on done: 527903.0 [2023-02-24 21:19:43,430][213384] Sum rewards: 35.299, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.350', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.142', 'weapon4': '0.176', 'weapon5': '0.180', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.482', 'WEAPON3': '1.350', 'HITCOUNT': '2.120', 'weapon3': '2.896', 'DAMAGECOUNT': '10.434', 'FRAGCOUNT': '34.000'} [2023-02-24 21:19:43,758][213384] DAMAGECOUNT value on done: 539752.0 [2023-02-24 21:19:43,758][213384] Sum rewards: 51.413, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.342', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.112', 'weapon5': '0.134', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'weapon2': '0.254', 'weapon4': '0.434', 'WEAPON3': '1.600', 'weapon3': '2.858', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.817', 'FRAGCOUNT': '47.000'} [2023-02-24 21:19:44,064][213384] DAMAGECOUNT value on done: 543842.0 [2023-02-24 21:19:44,064][213384] Sum rewards: 42.960, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.140', 'AMMO5': '0.018', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.200', 'weapon5': '0.224', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.468', 'WEAPON3': '1.200', 'HITCOUNT': '2.210', 'weapon3': '2.640', 'DAMAGECOUNT': '12.180', 'FRAGCOUNT': '39.000'} [2023-02-24 21:19:44,203][213365] Updated weights for policy 0, policy_version 35316 (0.0009) [2023-02-24 21:19:45,243][213332] Fps is (10 sec: 13926.2, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 144666624. Throughput: 0: 3456.8. Samples: 11162752. Policy #0 lag: (min: 0.0, avg: 0.8, max: 1.0) [2023-02-24 21:19:45,243][213332] Avg episode reward: [(0, '45.314')] [2023-02-24 21:19:47,130][213365] Updated weights for policy 0, policy_version 35326 (0.0009) [2023-02-24 21:19:50,100][213365] Updated weights for policy 0, policy_version 35336 (0.0009) [2023-02-24 21:19:50,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 144736256. Throughput: 0: 3458.4. Samples: 11173244. Policy #0 lag: (min: 0.0, avg: 0.8, max: 1.0) [2023-02-24 21:19:50,244][213332] Avg episode reward: [(0, '45.314')] [2023-02-24 21:19:53,075][213365] Updated weights for policy 0, policy_version 35346 (0.0009) [2023-02-24 21:19:55,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 144805888. Throughput: 0: 3458.0. Samples: 11193980. Policy #0 lag: (min: 0.0, avg: 0.8, max: 1.0) [2023-02-24 21:19:55,243][213332] Avg episode reward: [(0, '45.314')] [2023-02-24 21:19:56,021][213365] Updated weights for policy 0, policy_version 35356 (0.0009) [2023-02-24 21:19:57,854][213384] Large shaping reward -2.506 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HITCOUNT', 0.01, 1.0), ('DAMAGECOUNT', 0.033, 11.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 21:19:58,160][213367] DAMAGECOUNT value on done: 539786.0 [2023-02-24 21:19:58,161][213367] Sum rewards: 58.009, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.889', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.046', 'AMMO4': '0.046', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.190', 'AMMO3': '0.228', 'weapon2': '0.428', 'WEAPON3': '1.300', 'HITCOUNT': '3.110', 'weapon3': '3.132', 'DAMAGECOUNT': '15.156', 'FRAGCOUNT': '50.000'} [2023-02-24 21:19:58,451][213367] DAMAGECOUNT value on done: 543653.0 [2023-02-24 21:19:58,451][213367] Sum rewards: 44.519, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.301', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.024', 'weapon5': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon4': '0.294', 'weapon2': '0.482', 'WEAPON3': '1.250', 'HITCOUNT': '2.630', 'weapon3': '2.962', 'DAMAGECOUNT': '11.343', 'FRAGCOUNT': '40.000'} [2023-02-24 21:19:58,470][213367] DAMAGECOUNT value on done: 539003.0 [2023-02-24 21:19:58,470][213367] Sum rewards: 52.677, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.866', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.186', 'AMMO3': '0.234', 'WEAPON5': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.450', 'HITCOUNT': '2.910', 'weapon3': '2.946', 'DAMAGECOUNT': '14.025', 'FRAGCOUNT': '47.000'} [2023-02-24 21:19:58,773][213367] DAMAGECOUNT value on done: 549166.0 [2023-02-24 21:19:58,773][213367] Sum rewards: 54.805, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.610', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.042', 'WEAPON5': '0.100', 'weapon4': '0.148', 'AMMO4': '0.150', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon2': '0.442', 'WEAPON3': '1.050', 'HITCOUNT': '3.020', 'weapon3': '3.078', 'DAMAGECOUNT': '13.728', 'FRAGCOUNT': '46.000'} [2023-02-24 21:19:58,981][213365] Updated weights for policy 0, policy_version 35366 (0.0009) [2023-02-24 21:19:59,397][213372] DAMAGECOUNT value on done: 555686.0 [2023-02-24 21:19:59,398][213372] Sum rewards: 56.093, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.936', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'weapon4': '0.394', 'weapon2': '0.706', 'WEAPON3': '1.100', 'weapon3': '2.694', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '13.914', 'FRAGCOUNT': '47.000'} [2023-02-24 21:19:59,698][213372] DAMAGECOUNT value on done: 536465.0 [2023-02-24 21:19:59,699][213372] Sum rewards: 53.652, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.534', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.027', 'weapon5': '0.098', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon4': '0.290', 'WEAPON4': '0.350', 'weapon2': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.896', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.511', 'FRAGCOUNT': '49.000'} [2023-02-24 21:19:59,708][213372] DAMAGECOUNT value on done: 546905.0 [2023-02-24 21:19:59,709][213372] Sum rewards: 46.723, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-5.040', 'AMMO5': '0.024', 'AMMO2': '0.046', 'weapon5': '0.142', 'weapon4': '0.204', 'AMMO4': '0.230', 'weapon2': '0.272', 'AMMO3': '0.283', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.750', 'HITCOUNT': '2.820', 'weapon3': '3.078', 'DAMAGECOUNT': '13.113', 'FRAGCOUNT': '49.000'} [2023-02-24 21:20:00,001][213372] DAMAGECOUNT value on done: 541042.0 [2023-02-24 21:20:00,002][213372] Sum rewards: 24.474, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.150', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.414', 'ARMOR': '0.507', 'weapon2': '0.708', 'WEAPON3': '1.150', 'HITCOUNT': '1.940', 'weapon3': '2.624', 'DAMAGECOUNT': '8.169', 'FRAGCOUNT': '24.000'} [2023-02-24 21:20:00,242][213366] DAMAGECOUNT value on done: 533254.0 [2023-02-24 21:20:00,243][213366] Sum rewards: 51.457, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.410', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.048', 'AMMO4': '0.061', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon2': '0.456', 'WEAPON3': '1.200', 'HITCOUNT': '2.900', 'weapon3': '3.212', 'DAMAGECOUNT': '13.131', 'FRAGCOUNT': '44.000'} [2023-02-24 21:20:00,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 144875520. Throughput: 0: 3458.1. Samples: 11214750. Policy #0 lag: (min: 0.0, avg: 0.8, max: 1.0) [2023-02-24 21:20:00,243][213332] Avg episode reward: [(0, '46.065')] [2023-02-24 21:20:00,542][213366] DAMAGECOUNT value on done: 546152.0 [2023-02-24 21:20:00,542][213366] Sum rewards: 55.755, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.632', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.100', 'AMMO3': '0.112', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'weapon4': '0.256', 'weapon2': '0.342', 'WEAPON4': '0.350', 'WEAPON3': '0.750', 'HITCOUNT': '2.930', 'weapon3': '3.052', 'DAMAGECOUNT': '12.939', 'FRAGCOUNT': '45.000'} [2023-02-24 21:20:00,552][213366] DAMAGECOUNT value on done: 557660.0 [2023-02-24 21:20:00,552][213366] Sum rewards: 45.592, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.185', 'AMMO5': '0.024', 'AMMO2': '0.042', 'weapon5': '0.188', 'AMMO4': '0.207', 'AMMO3': '0.251', 'weapon2': '0.358', 'weapon4': '0.368', 'WEAPON4': '0.450', 'WEAPON5': '0.600', 'WEAPON3': '1.550', 'HITCOUNT': '2.660', 'weapon3': '2.670', 'DAMAGECOUNT': '12.660', 'FRAGCOUNT': '42.000'} [2023-02-24 21:20:00,843][213366] DAMAGECOUNT value on done: 547284.0 [2023-02-24 21:20:00,844][213366] Sum rewards: 44.608, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.948', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.141', 'AMMO4': '0.181', 'weapon5': '0.200', 'weapon2': '0.256', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.808', 'WEAPON3': '0.900', 'weapon3': '2.090', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '10.944', 'FRAGCOUNT': '37.000'} [2023-02-24 21:20:00,922][213383] DAMAGECOUNT value on done: 539959.0 [2023-02-24 21:20:00,923][213383] Sum rewards: 49.629, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.452', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon5': '0.256', 'weapon4': '0.266', 'WEAPON5': '0.350', 'weapon2': '0.474', 'WEAPON3': '1.450', 'weapon3': '2.682', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.809', 'FRAGCOUNT': '43.500'} [2023-02-24 21:20:01,151][213369] DAMAGECOUNT value on done: 545025.0 [2023-02-24 21:20:01,151][213369] Sum rewards: 52.510, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.610', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.154', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'weapon2': '0.260', 'WEAPON4': '0.350', 'weapon4': '0.874', 'WEAPON3': '1.100', 'weapon3': '2.442', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.579', 'FRAGCOUNT': '45.000'} [2023-02-24 21:20:01,177][213368] DAMAGECOUNT value on done: 535442.0 [2023-02-24 21:20:01,177][213368] Sum rewards: 47.885, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.317', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.148', 'weapon4': '0.176', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.528', 'WEAPON3': '1.050', 'HITCOUNT': '2.650', 'weapon3': '2.916', 'DAMAGECOUNT': '12.273', 'FRAGCOUNT': '42.000'} [2023-02-24 21:20:01,218][213383] DAMAGECOUNT value on done: 540017.0 [2023-02-24 21:20:01,219][213383] Sum rewards: 44.990, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.186', 'AMMO5': '0.009', 'AMMO2': '0.015', 'weapon5': '0.070', 'AMMO4': '0.075', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon2': '0.208', 'AMMO3': '0.244', 'weapon4': '0.344', 'WEAPON3': '1.450', 'HITCOUNT': '2.560', 'weapon3': '3.072', 'DAMAGECOUNT': '11.700', 'FRAGCOUNT': '41.000'} [2023-02-24 21:20:01,292][213382] DAMAGECOUNT value on done: 546782.0 [2023-02-24 21:20:01,292][213382] Sum rewards: 41.982, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.770', 'AMMO5': '0.008', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.160', 'AMMO3': '0.219', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.452', 'weapon2': '0.646', 'WEAPON3': '1.250', 'weapon3': '2.492', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '13.017', 'FRAGCOUNT': '37.000'} [2023-02-24 21:20:01,450][213369] DAMAGECOUNT value on done: 548542.0 [2023-02-24 21:20:01,450][213369] Sum rewards: 54.317, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.992', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.054', 'AMMO4': '0.061', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'WEAPON3': '0.850', 'weapon2': '0.960', 'weapon3': '2.826', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.413', 'FRAGCOUNT': '42.000'} [2023-02-24 21:20:01,478][213368] DAMAGECOUNT value on done: 545493.0 [2023-02-24 21:20:01,478][213368] Sum rewards: 43.597, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.760', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.232', 'weapon2': '0.274', 'WEAPON4': '0.400', 'weapon4': '1.110', 'WEAPON3': '1.400', 'weapon3': '2.292', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '10.833', 'FRAGCOUNT': '41.000'} [2023-02-24 21:20:01,593][213382] DAMAGECOUNT value on done: 542972.0 [2023-02-24 21:20:01,593][213382] Sum rewards: 32.167, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.249', 'AMMO5': '0.017', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon5': '0.200', 'weapon4': '0.246', 'WEAPON5': '0.400', 'weapon2': '0.660', 'WEAPON3': '1.100', 'HITCOUNT': '2.100', 'weapon3': '2.634', 'DAMAGECOUNT': '9.552', 'FRAGCOUNT': '28.000'} [2023-02-24 21:20:01,749][213369] DAMAGECOUNT value on done: 542666.0 [2023-02-24 21:20:01,750][213369] Sum rewards: 40.090, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.562', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'AMMO3': '0.223', 'weapon2': '0.270', 'weapon4': '0.282', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '2.770', 'weapon3': '3.176', 'DAMAGECOUNT': '12.318', 'FRAGCOUNT': '36.000'} [2023-02-24 21:20:01,758][213368] DAMAGECOUNT value on done: 539103.0 [2023-02-24 21:20:01,759][213368] Sum rewards: 46.884, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.888', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.144', 'AMMO4': '0.190', 'AMMO3': '0.197', 'WEAPON5': '0.250', 'weapon2': '0.376', 'WEAPON4': '0.450', 'weapon4': '0.556', 'WEAPON3': '1.100', 'weapon3': '2.624', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '11.547', 'FRAGCOUNT': '42.000'} [2023-02-24 21:20:01,917][213365] Updated weights for policy 0, policy_version 35376 (0.0009) [2023-02-24 21:20:02,015][213383] DAMAGECOUNT value on done: 546487.0 [2023-02-24 21:20:02,016][213383] Sum rewards: 36.128, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.712', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon7': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.140', 'weapon5': '0.164', 'AMMO4': '0.169', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.294', 'WEAPON3': '0.850', 'weapon4': '0.980', 'weapon3': '1.802', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '10.863', 'FRAGCOUNT': '29.500'} [2023-02-24 21:20:02,051][213369] DAMAGECOUNT value on done: 532839.0 [2023-02-24 21:20:02,051][213369] Sum rewards: 43.034, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.907', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.011', 'AMMO4': '0.052', 'weapon5': '0.146', 'AMMO3': '0.176', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.418', 'weapon4': '0.524', 'WEAPON3': '1.100', 'HITCOUNT': '2.410', 'weapon3': '2.600', 'DAMAGECOUNT': '10.641', 'FRAGCOUNT': '40.000'} [2023-02-24 21:20:02,054][213382] DAMAGECOUNT value on done: 530866.0 [2023-02-24 21:20:02,055][213382] Sum rewards: 38.984, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.248', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.023', 'AMMO4': '0.116', 'WEAPON4': '0.200', 'weapon5': '0.220', 'AMMO3': '0.232', 'WEAPON5': '0.400', 'weapon4': '0.436', 'weapon2': '0.468', 'WEAPON3': '1.350', 'HITCOUNT': '2.420', 'weapon3': '2.540', 'DAMAGECOUNT': '11.055', 'FRAGCOUNT': '36.000'} [2023-02-24 21:20:02,057][213368] DAMAGECOUNT value on done: 537393.0 [2023-02-24 21:20:02,057][213368] Sum rewards: 55.695, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.511', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.040', 'AMMO3': '0.112', 'AMMO4': '0.197', 'weapon5': '0.214', 'weapon2': '0.442', 'WEAPON4': '0.600', 'weapon4': '0.634', 'WEAPON5': '0.650', 'WEAPON3': '0.750', 'weapon3': '2.362', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '46.000'} [2023-02-24 21:20:02,314][213383] DAMAGECOUNT value on done: 539902.0 [2023-02-24 21:20:02,314][213383] Sum rewards: 39.456, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.878', 'AMMO5': '0.013', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.172', 'weapon5': '0.254', 'weapon2': '0.368', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.914', 'WEAPON3': '1.000', 'weapon3': '2.216', 'HITCOUNT': '2.340', 'DAMAGECOUNT': '11.799', 'FRAGCOUNT': '34.000'} [2023-02-24 21:20:02,351][213382] DAMAGECOUNT value on done: 541137.0 [2023-02-24 21:20:02,351][213382] Sum rewards: 51.588, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.830', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.088', 'AMMO4': '0.148', 'AMMO3': '0.215', 'weapon2': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.334', 'WEAPON3': '1.350', 'HITCOUNT': '2.930', 'weapon3': '3.112', 'DAMAGECOUNT': '13.851', 'FRAGCOUNT': '45.000'} [2023-02-24 21:20:02,498][213384] DAMAGECOUNT value on done: 547403.0 [2023-02-24 21:20:02,498][213384] Sum rewards: 51.166, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.894', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.094', 'AMMO4': '0.134', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'weapon4': '0.244', 'WEAPON4': '0.300', 'weapon2': '0.542', 'WEAPON3': '1.050', 'HITCOUNT': '2.860', 'weapon3': '2.944', 'DAMAGECOUNT': '13.497', 'FRAGCOUNT': '43.000'} [2023-02-24 21:20:02,789][213384] DAMAGECOUNT value on done: 530874.0 [2023-02-24 21:20:02,790][213384] Sum rewards: 31.684, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.877', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.114', 'AMMO3': '0.154', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.346', 'weapon2': '0.684', 'WEAPON3': '1.000', 'HITCOUNT': '1.980', 'weapon3': '2.682', 'DAMAGECOUNT': '8.913', 'FRAGCOUNT': '29.000'} [2023-02-24 21:20:03,141][213384] DAMAGECOUNT value on done: 543248.0 [2023-02-24 21:20:03,142][213384] Sum rewards: 37.672, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.768', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.031', 'weapon4': '0.086', 'AMMO4': '0.154', 'AMMO3': '0.196', 'weapon5': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.500', 'weapon2': '0.820', 'WEAPON3': '1.150', 'HITCOUNT': '2.170', 'weapon3': '2.602', 'DAMAGECOUNT': '10.488', 'FRAGCOUNT': '33.500'} [2023-02-24 21:20:03,438][213384] DAMAGECOUNT value on done: 547855.0 [2023-02-24 21:20:03,438][213384] Sum rewards: 40.673, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.044', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.042', 'AMMO3': '0.181', 'AMMO4': '0.208', 'weapon5': '0.280', 'WEAPON5': '0.450', 'weapon2': '0.496', 'WEAPON4': '0.500', 'weapon4': '0.794', 'WEAPON3': '1.000', 'weapon3': '1.984', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '12.039', 'FRAGCOUNT': '37.000'} [2023-02-24 21:20:04,867][213365] Updated weights for policy 0, policy_version 35386 (0.0009) [2023-02-24 21:20:05,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 144945152. Throughput: 0: 3458.5. Samples: 11225156. Policy #0 lag: (min: 0.0, avg: 0.8, max: 1.0) [2023-02-24 21:20:05,243][213332] Avg episode reward: [(0, '45.887')] [2023-02-24 21:20:07,814][213365] Updated weights for policy 0, policy_version 35396 (0.0009) [2023-02-24 21:20:10,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 145014784. Throughput: 0: 3461.7. Samples: 11246066. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:20:10,243][213332] Avg episode reward: [(0, '45.887')] [2023-02-24 21:20:10,738][213365] Updated weights for policy 0, policy_version 35406 (0.0009) [2023-02-24 21:20:13,715][213365] Updated weights for policy 0, policy_version 35416 (0.0009) [2023-02-24 21:20:15,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 145084416. Throughput: 0: 3460.4. Samples: 11266788. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:20:15,243][213332] Avg episode reward: [(0, '45.887')] [2023-02-24 21:20:16,658][213365] Updated weights for policy 0, policy_version 35426 (0.0009) [2023-02-24 21:20:17,572][213367] DAMAGECOUNT value on done: 544176.0 [2023-02-24 21:20:17,573][213367] Sum rewards: 54.118, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.876', 'AMMO5': '0.006', 'AMMO2': '0.013', 'weapon5': '0.064', 'AMMO4': '0.064', 'weapon4': '0.142', 'AMMO3': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.870', 'WEAPON3': '0.950', 'HITCOUNT': '2.650', 'weapon3': '2.766', 'DAMAGECOUNT': '13.170', 'FRAGCOUNT': '45.000'} [2023-02-24 21:20:17,869][213367] DAMAGECOUNT value on done: 547133.0 [2023-02-24 21:20:17,869][213367] Sum rewards: 40.772, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.158', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.068', 'weapon4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon2': '0.640', 'WEAPON3': '1.050', 'HITCOUNT': '2.360', 'weapon3': '3.064', 'DAMAGECOUNT': '10.440', 'FRAGCOUNT': '35.000'} [2023-02-24 21:20:17,879][213367] DAMAGECOUNT value on done: 542716.0 [2023-02-24 21:20:17,879][213367] Sum rewards: 37.878, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.596', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon5': '0.022', 'WEAPON5': '0.050', 'AMMO3': '0.213', 'weapon2': '0.572', 'WEAPON3': '1.400', 'HITCOUNT': '2.570', 'weapon3': '3.266', 'DAMAGECOUNT': '11.139', 'FRAGCOUNT': '34.000'} [2023-02-24 21:20:18,175][213367] DAMAGECOUNT value on done: 552964.0 [2023-02-24 21:20:18,175][213367] Sum rewards: 39.125, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.464', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO3': '0.187', 'AMMO4': '0.213', 'weapon5': '0.342', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.460', 'weapon4': '0.828', 'WEAPON3': '1.000', 'weapon3': '2.064', 'HITCOUNT': '2.290', 'DAMAGECOUNT': '11.394', 'FRAGCOUNT': '35.000'} [2023-02-24 21:20:18,828][213372] DAMAGECOUNT value on done: 559862.0 [2023-02-24 21:20:18,828][213372] Sum rewards: 46.542, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.089', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon4': '0.108', 'AMMO4': '0.179', 'AMMO3': '0.199', 'weapon5': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.434', 'WEAPON3': '1.200', 'HITCOUNT': '2.570', 'weapon3': '3.004', 'DAMAGECOUNT': '12.528', 'FRAGCOUNT': '41.000'} [2023-02-24 21:20:19,126][213372] DAMAGECOUNT value on done: 540812.0 [2023-02-24 21:20:19,127][213372] Sum rewards: 41.112, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.660', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.430', 'weapon2': '0.532', 'WEAPON3': '1.250', 'HITCOUNT': '2.490', 'weapon3': '2.610', 'DAMAGECOUNT': '13.041', 'FRAGCOUNT': '37.000'} [2023-02-24 21:20:19,136][213372] DAMAGECOUNT value on done: 551601.0 [2023-02-24 21:20:19,137][213372] Sum rewards: 49.854, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.456', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon5': '0.076', 'AMMO3': '0.210', 'AMMO4': '0.223', 'weapon2': '0.226', 'weapon4': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '3.140', 'weapon3': '3.250', 'DAMAGECOUNT': '14.088', 'FRAGCOUNT': '44.500'} [2023-02-24 21:20:19,440][213372] DAMAGECOUNT value on done: 544512.0 [2023-02-24 21:20:19,441][213372] Sum rewards: 38.627, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.790', 'AMMO5': '0.022', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.167', 'weapon5': '0.188', 'weapon4': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.676', 'WEAPON3': '1.000', 'HITCOUNT': '2.340', 'weapon3': '2.650', 'DAMAGECOUNT': '9.990', 'FRAGCOUNT': '35.000'} [2023-02-24 21:20:19,613][213366] DAMAGECOUNT value on done: 537902.0 [2023-02-24 21:20:19,613][213366] Sum rewards: 52.518, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.850', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.170', 'AMMO3': '0.178', 'weapon2': '0.306', 'WEAPON4': '0.350', 'weapon4': '0.780', 'WEAPON3': '1.100', 'weapon3': '2.608', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '13.944', 'FRAGCOUNT': '45.000'} [2023-02-24 21:20:19,634][213365] Updated weights for policy 0, policy_version 35436 (0.0009) [2023-02-24 21:20:19,911][213366] DAMAGECOUNT value on done: 550722.0 [2023-02-24 21:20:19,911][213366] Sum rewards: 49.511, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.124', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.078', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.249', 'weapon2': '0.290', 'weapon4': '0.458', 'WEAPON3': '1.400', 'weapon3': '2.938', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.710', 'FRAGCOUNT': '43.000'} [2023-02-24 21:20:19,919][213366] DAMAGECOUNT value on done: 562055.0 [2023-02-24 21:20:19,920][213366] Sum rewards: 53.828, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.550', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.034', 'weapon5': '0.044', 'WEAPON4': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.223', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.300', 'HITCOUNT': '2.830', 'weapon3': '3.372', 'DAMAGECOUNT': '13.185', 'FRAGCOUNT': '47.000'} [2023-02-24 21:20:20,210][213366] DAMAGECOUNT value on done: 551499.0 [2023-02-24 21:20:20,210][213366] Sum rewards: 47.710, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.192', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.065', 'AMMO3': '0.173', 'weapon5': '0.314', 'AMMO4': '0.326', 'weapon2': '0.348', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon4': '0.610', 'WEAPON3': '1.050', 'weapon3': '2.442', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '12.645', 'FRAGCOUNT': '44.000'} [2023-02-24 21:20:20,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 145154048. Throughput: 0: 3460.6. Samples: 11277140. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:20:20,243][213332] Avg episode reward: [(0, '46.010')] [2023-02-24 21:20:20,326][213383] DAMAGECOUNT value on done: 544533.0 [2023-02-24 21:20:20,326][213383] Sum rewards: 50.223, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.941', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.048', 'weapon5': '0.160', 'AMMO3': '0.215', 'AMMO4': '0.238', 'weapon2': '0.354', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.570', 'WEAPON3': '1.300', 'weapon3': '2.622', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '13.722', 'FRAGCOUNT': '47.000'} [2023-02-24 21:20:20,514][213369] DAMAGECOUNT value on done: 549890.0 [2023-02-24 21:20:20,515][213369] Sum rewards: 52.640, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.284', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.146', 'AMMO3': '0.235', 'weapon2': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.434', 'WEAPON3': '1.350', 'weapon3': '2.844', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.595', 'FRAGCOUNT': '47.000'} [2023-02-24 21:20:20,571][213368] DAMAGECOUNT value on done: 540997.0 [2023-02-24 21:20:20,571][213368] Sum rewards: 65.348, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.190', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.048', 'weapon5': '0.110', 'AMMO4': '0.163', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'weapon2': '0.348', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.226', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '57.000'} [2023-02-24 21:20:20,623][213383] DAMAGECOUNT value on done: 544805.0 [2023-02-24 21:20:20,623][213383] Sum rewards: 54.878, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.718', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.158', 'AMMO4': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'WEAPON4': '0.350', 'weapon2': '0.362', 'weapon4': '0.546', 'WEAPON3': '1.200', 'weapon3': '2.686', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.364', 'FRAGCOUNT': '46.500'} [2023-02-24 21:20:20,650][213382] DAMAGECOUNT value on done: 551702.0 [2023-02-24 21:20:20,651][213382] Sum rewards: 53.963, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.604', 'AMMO5': '0.014', 'AMMO2': '0.028', 'weapon5': '0.132', 'AMMO4': '0.139', 'AMMO3': '0.226', 'weapon2': '0.234', 'WEAPON4': '0.250', 'weapon4': '0.284', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.090', 'weapon3': '3.110', 'DAMAGECOUNT': '14.760', 'FRAGCOUNT': '46.000'} [2023-02-24 21:20:20,813][213369] DAMAGECOUNT value on done: 552711.0 [2023-02-24 21:20:20,813][213369] Sum rewards: 48.431, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.930', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.046', 'weapon4': '0.060', 'AMMO3': '0.163', 'weapon5': '0.206', 'AMMO4': '0.229', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.648', 'WEAPON3': '1.000', 'HITCOUNT': '2.570', 'weapon3': '2.854', 'DAMAGECOUNT': '12.507', 'FRAGCOUNT': '42.000'} [2023-02-24 21:20:20,874][213368] DAMAGECOUNT value on done: 549023.0 [2023-02-24 21:20:20,874][213368] Sum rewards: 36.717, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.839', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'weapon4': '0.576', 'weapon2': '0.988', 'WEAPON3': '1.100', 'weapon3': '2.212', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '10.485', 'FRAGCOUNT': '33.000'} [2023-02-24 21:20:20,951][213382] DAMAGECOUNT value on done: 547832.0 [2023-02-24 21:20:20,951][213382] Sum rewards: 56.141, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.120', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.124', 'weapon4': '0.142', 'AMMO4': '0.194', 'AMMO3': '0.194', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.516', 'WEAPON3': '1.100', 'HITCOUNT': '2.960', 'weapon3': '3.004', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '48.000'} [2023-02-24 21:20:21,107][213369] DAMAGECOUNT value on done: 546574.0 [2023-02-24 21:20:21,108][213369] Sum rewards: 37.819, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.472', 'AMMO5': '0.005', 'AMMO2': '0.052', 'WEAPON5': '0.150', 'weapon5': '0.152', 'AMMO3': '0.248', 'AMMO4': '0.262', 'weapon2': '0.344', 'WEAPON4': '0.500', 'weapon4': '0.874', 'WEAPON3': '1.450', 'weapon3': '2.120', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '11.724', 'FRAGCOUNT': '38.000'} [2023-02-24 21:20:21,155][213368] DAMAGECOUNT value on done: 544041.0 [2023-02-24 21:20:21,155][213368] Sum rewards: 60.268, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.625', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.042', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'AMMO3': '0.179', 'weapon4': '0.268', 'WEAPON4': '0.350', 'weapon2': '0.484', 'WEAPON3': '1.150', 'weapon3': '2.936', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.814', 'FRAGCOUNT': '53.000'} [2023-02-24 21:20:21,420][213369] DAMAGECOUNT value on done: 537579.0 [2023-02-24 21:20:21,420][213369] Sum rewards: 56.184, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.596', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'weapon2': '0.142', 'AMMO3': '0.260', 'WEAPON3': '1.500', 'HITCOUNT': '3.210', 'weapon3': '3.700', 'DAMAGECOUNT': '14.220', 'FRAGCOUNT': '49.000'} [2023-02-24 21:20:21,433][213382] DAMAGECOUNT value on done: 535449.0 [2023-02-24 21:20:21,434][213382] Sum rewards: 56.434, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.335', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.033', 'weapon7': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.120', 'AMMO3': '0.130', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.554', 'weapon2': '0.694', 'WEAPON3': '0.850', 'weapon3': '2.350', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.749', 'FRAGCOUNT': '45.000'} [2023-02-24 21:20:21,439][213383] DAMAGECOUNT value on done: 550202.0 [2023-02-24 21:20:21,439][213383] Sum rewards: 45.626, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.720', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.136', 'AMMO3': '0.158', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.486', 'weapon4': '0.654', 'WEAPON3': '0.900', 'weapon3': '2.026', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '11.145', 'FRAGCOUNT': '39.000'} [2023-02-24 21:20:21,471][213368] DAMAGECOUNT value on done: 541636.0 [2023-02-24 21:20:21,472][213368] Sum rewards: 56.114, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.825', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.040', 'weapon5': '0.070', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon2': '0.154', 'AMMO3': '0.236', 'WEAPON3': '1.350', 'HITCOUNT': '2.710', 'weapon3': '3.532', 'DAMAGECOUNT': '12.729', 'FRAGCOUNT': '51.000'} [2023-02-24 21:20:21,733][213382] DAMAGECOUNT value on done: 544674.0 [2023-02-24 21:20:21,734][213382] Sum rewards: 38.892, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.422', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'AMMO3': '0.130', 'WEAPON4': '0.250', 'weapon4': '0.410', 'weapon2': '0.792', 'WEAPON3': '0.800', 'weapon3': '2.466', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '10.611', 'FRAGCOUNT': '31.500'} [2023-02-24 21:20:21,737][213383] DAMAGECOUNT value on done: 543645.0 [2023-02-24 21:20:21,738][213383] Sum rewards: 46.218, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.930', 'AMMO2': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.050', 'AMMO3': '0.134', 'weapon5': '0.180', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.718', 'WEAPON3': '0.850', 'weapon2': '0.988', 'weapon3': '1.866', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '11.229', 'FRAGCOUNT': '38.000'} [2023-02-24 21:20:21,855][213384] DAMAGECOUNT value on done: 551216.0 [2023-02-24 21:20:21,856][213384] Sum rewards: 39.563, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.308', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO3': '0.108', 'AMMO4': '0.185', 'weapon5': '0.214', 'weapon4': '0.372', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '0.750', 'weapon2': '0.950', 'weapon3': '2.052', 'HITCOUNT': '2.300', 'DAMAGECOUNT': '11.439', 'FRAGCOUNT': '33.000'} [2023-02-24 21:20:22,155][213384] DAMAGECOUNT value on done: 534977.0 [2023-02-24 21:20:22,156][213384] Sum rewards: 41.283, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.235', 'AMMO5': '0.015', 'AMMO2': '0.040', 'AMMO4': '0.199', 'weapon5': '0.228', 'AMMO3': '0.258', 'weapon2': '0.288', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.562', 'WEAPON3': '1.500', 'weapon3': '2.528', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '12.300', 'FRAGCOUNT': '41.000'} [2023-02-24 21:20:22,508][213384] DAMAGECOUNT value on done: 547279.0 [2023-02-24 21:20:22,509][213384] Sum rewards: 45.478, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.400', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon7': '0.070', 'AMMO4': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.155', 'weapon5': '0.180', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.444', 'weapon4': '0.710', 'WEAPON3': '1.000', 'weapon3': '2.380', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '12.093', 'FRAGCOUNT': '39.000'} [2023-02-24 21:20:22,574][213365] Updated weights for policy 0, policy_version 35446 (0.0009) [2023-02-24 21:20:22,815][213384] DAMAGECOUNT value on done: 552318.0 [2023-02-24 21:20:22,815][213384] Sum rewards: 51.775, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.800', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon2': '0.170', 'weapon5': '0.200', 'AMMO3': '0.223', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.660', 'WEAPON3': '1.200', 'weapon3': '2.700', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.389', 'FRAGCOUNT': '46.000'} [2023-02-24 21:20:25,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 145223680. Throughput: 0: 3464.2. Samples: 11297960. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:20:25,243][213332] Avg episode reward: [(0, '46.924')] [2023-02-24 21:20:25,247][213352] Saving new best policy, reward=46.924! [2023-02-24 21:20:25,509][213365] Updated weights for policy 0, policy_version 35456 (0.0009) [2023-02-24 21:20:28,442][213365] Updated weights for policy 0, policy_version 35466 (0.0009) [2023-02-24 21:20:30,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 145293312. Throughput: 0: 3469.5. Samples: 11318878. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:20:30,243][213332] Avg episode reward: [(0, '46.924')] [2023-02-24 21:20:31,184][213369] Large shaping reward 3.441 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.39, 130.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 21:20:31,373][213365] Updated weights for policy 0, policy_version 35476 (0.0009) [2023-02-24 21:20:33,893][213383] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 21:20:34,326][213365] Updated weights for policy 0, policy_version 35486 (0.0009) [2023-02-24 21:20:35,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13857.0). Total num frames: 145362944. Throughput: 0: 3467.6. Samples: 11329284. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:20:35,243][213332] Avg episode reward: [(0, '46.924')] [2023-02-24 21:20:36,873][213367] DAMAGECOUNT value on done: 548105.0 [2023-02-24 21:20:36,873][213367] Sum rewards: 43.570, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.646', 'AMMO5': '0.016', 'AMMO2': '0.062', 'AMMO3': '0.106', 'AMMO4': '0.308', 'weapon5': '0.374', 'weapon2': '0.406', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '0.650', 'weapon4': '0.746', 'weapon3': '2.160', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '11.787', 'FRAGCOUNT': '37.000'} [2023-02-24 21:20:37,171][213367] DAMAGECOUNT value on done: 550886.0 [2023-02-24 21:20:37,171][213367] Sum rewards: 42.583, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.014', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.013', 'weapon5': '0.046', 'weapon4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.216', 'weapon2': '0.490', 'WEAPON3': '1.300', 'HITCOUNT': '2.320', 'weapon3': '3.232', 'DAMAGECOUNT': '11.259', 'FRAGCOUNT': '39.000'} [2023-02-24 21:20:37,182][213367] DAMAGECOUNT value on done: 546295.0 [2023-02-24 21:20:37,183][213367] Sum rewards: 40.458, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.698', 'AMMO5': '0.017', 'AMMO2': '0.038', 'AMMO4': '0.191', 'AMMO3': '0.192', 'weapon5': '0.194', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON4': '0.400', 'weapon4': '0.586', 'WEAPON3': '1.150', 'HITCOUNT': '2.410', 'weapon3': '2.524', 'DAMAGECOUNT': '10.737', 'FRAGCOUNT': '37.000'} [2023-02-24 21:20:37,325][213365] Updated weights for policy 0, policy_version 35496 (0.0009) [2023-02-24 21:20:37,479][213367] DAMAGECOUNT value on done: 557224.0 [2023-02-24 21:20:37,479][213367] Sum rewards: 46.492, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.724', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.144', 'AMMO4': '0.147', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.416', 'weapon2': '0.562', 'WEAPON3': '1.150', 'weapon3': '2.662', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.780', 'FRAGCOUNT': '41.000'} [2023-02-24 21:20:38,161][213372] DAMAGECOUNT value on done: 564366.0 [2023-02-24 21:20:38,162][213372] Sum rewards: 44.784, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.120', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.297', 'WEAPON4': '0.300', 'weapon2': '0.474', 'weapon4': '0.482', 'WEAPON3': '1.800', 'weapon3': '2.710', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.512', 'FRAGCOUNT': '44.000'} [2023-02-24 21:20:38,457][213372] DAMAGECOUNT value on done: 545082.0 [2023-02-24 21:20:38,457][213372] Sum rewards: 48.334, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.772', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'AMMO4': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.402', 'weapon2': '0.740', 'WEAPON3': '1.000', 'weapon3': '2.514', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '12.765', 'FRAGCOUNT': '40.000'} [2023-02-24 21:20:38,467][213372] DAMAGECOUNT value on done: 555734.0 [2023-02-24 21:20:38,468][213372] Sum rewards: 43.914, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.920', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.096', 'weapon5': '0.110', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'AMMO3': '0.154', 'WEAPON5': '0.200', 'weapon2': '0.636', 'WEAPON3': '0.950', 'HITCOUNT': '2.530', 'weapon3': '2.964', 'DAMAGECOUNT': '12.399', 'FRAGCOUNT': '35.000'} [2023-02-24 21:20:38,757][213372] DAMAGECOUNT value on done: 548066.0 [2023-02-24 21:20:38,757][213372] Sum rewards: 36.409, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.160', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.114', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.256', 'weapon2': '0.474', 'weapon4': '0.518', 'WEAPON3': '1.500', 'weapon3': '2.652', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '10.662', 'FRAGCOUNT': '36.000'} [2023-02-24 21:20:39,015][213366] DAMAGECOUNT value on done: 543142.0 [2023-02-24 21:20:39,015][213366] Sum rewards: 55.589, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.040', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon5': '0.100', 'AMMO3': '0.166', 'AMMO4': '0.181', 'weapon2': '0.272', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.524', 'WEAPON3': '1.050', 'weapon3': '2.824', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '47.000'} [2023-02-24 21:20:39,312][213366] DAMAGECOUNT value on done: 554427.0 [2023-02-24 21:20:39,312][213366] Sum rewards: 36.582, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.518', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'WEAPON4': '0.200', 'AMMO3': '0.253', 'weapon4': '0.292', 'weapon2': '0.318', 'WEAPON3': '1.450', 'HITCOUNT': '2.640', 'weapon3': '3.128', 'DAMAGECOUNT': '11.115', 'FRAGCOUNT': '35.000'} [2023-02-24 21:20:39,321][213366] DAMAGECOUNT value on done: 566225.0 [2023-02-24 21:20:39,322][213366] Sum rewards: 48.818, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.080', 'AMMO5': '0.020', 'AMMO2': '0.047', 'weapon2': '0.206', 'AMMO3': '0.233', 'AMMO4': '0.234', 'weapon5': '0.296', 'weapon4': '0.450', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'HITCOUNT': '2.630', 'weapon3': '2.722', 'DAMAGECOUNT': '12.510', 'FRAGCOUNT': '46.000'} [2023-02-24 21:20:39,623][213366] DAMAGECOUNT value on done: 556156.0 [2023-02-24 21:20:39,624][213366] Sum rewards: 55.318, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.292', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.178', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.226', 'weapon4': '0.480', 'WEAPON3': '1.200', 'weapon3': '2.894', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.971', 'FRAGCOUNT': '46.000'} [2023-02-24 21:20:39,695][213383] DAMAGECOUNT value on done: 547988.0 [2023-02-24 21:20:39,696][213383] Sum rewards: 41.333, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.635', 'AMMO5': '0.020', 'AMMO2': '0.027', 'weapon5': '0.072', 'weapon7': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.135', 'AMMO3': '0.186', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.446', 'weapon4': '0.524', 'WEAPON3': '1.150', 'HITCOUNT': '2.200', 'weapon3': '2.668', 'DAMAGECOUNT': '10.365', 'FRAGCOUNT': '37.000'} [2023-02-24 21:20:39,910][213369] DAMAGECOUNT value on done: 553907.0 [2023-02-24 21:20:39,910][213369] Sum rewards: 34.080, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.674', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.039', 'weapon5': '0.166', 'AMMO3': '0.170', 'AMMO4': '0.194', 'weapon2': '0.218', 'WEAPON5': '0.350', 'weapon4': '0.436', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'HITCOUNT': '2.260', 'weapon3': '2.898', 'DAMAGECOUNT': '12.051', 'FRAGCOUNT': '29.000'} [2023-02-24 21:20:39,992][213383] DAMAGECOUNT value on done: 549966.0 [2023-02-24 21:20:39,992][213383] Sum rewards: 55.949, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.896', 'AMMO5': '0.011', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.169', 'weapon5': '0.176', 'WEAPON4': '0.200', 'weapon4': '0.262', 'WEAPON5': '0.300', 'weapon2': '0.540', 'WEAPON3': '1.150', 'weapon3': '2.838', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.483', 'FRAGCOUNT': '45.500'} [2023-02-24 21:20:40,003][213368] DAMAGECOUNT value on done: 544941.0 [2023-02-24 21:20:40,004][213368] Sum rewards: 42.588, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.610', 'AMMO5': '0.015', 'AMMO2': '0.060', 'AMMO3': '0.186', 'AMMO4': '0.299', 'weapon5': '0.316', 'WEAPON5': '0.400', 'weapon2': '0.518', 'WEAPON4': '0.550', 'weapon4': '0.566', 'WEAPON3': '1.100', 'weapon3': '2.276', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '11.742', 'FRAGCOUNT': '38.000'} [2023-02-24 21:20:40,046][213382] DAMAGECOUNT value on done: 556366.0 [2023-02-24 21:20:40,046][213382] Sum rewards: 52.757, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.170', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon2': '0.160', 'weapon5': '0.176', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.634', 'WEAPON3': '1.300', 'weapon3': '2.694', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.992', 'FRAGCOUNT': '46.000'} [2023-02-24 21:20:40,209][213369] DAMAGECOUNT value on done: 557202.0 [2023-02-24 21:20:40,209][213369] Sum rewards: 47.970, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.842', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO2': '0.036', 'WEAPON5': '0.150', 'AMMO4': '0.180', 'WEAPON4': '0.250', 'AMMO3': '0.252', 'weapon4': '0.268', 'weapon2': '0.470', 'WEAPON3': '1.450', 'HITCOUNT': '2.980', 'weapon3': '3.028', 'DAMAGECOUNT': '13.473', 'FRAGCOUNT': '43.000'} [2023-02-24 21:20:40,243][213332] Fps is (10 sec: 13516.5, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 145428480. Throughput: 0: 3466.7. Samples: 11349980. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:20:40,244][213332] Avg episode reward: [(0, '46.923')] [2023-02-24 21:20:40,288][213365] Updated weights for policy 0, policy_version 35506 (0.0009) [2023-02-24 21:20:40,292][213368] DAMAGECOUNT value on done: 553388.0 [2023-02-24 21:20:40,293][213368] Sum rewards: 50.272, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.013', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.072', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'weapon2': '0.198', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'weapon4': '0.424', 'WEAPON3': '1.250', 'HITCOUNT': '2.820', 'weapon3': '3.114', 'DAMAGECOUNT': '13.095', 'FRAGCOUNT': '44.000'} [2023-02-24 21:20:40,349][213382] DAMAGECOUNT value on done: 552309.0 [2023-02-24 21:20:40,350][213382] Sum rewards: 50.479, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.990', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.046', 'weapon5': '0.108', 'WEAPON5': '0.150', 'weapon2': '0.204', 'AMMO4': '0.231', 'AMMO3': '0.283', 'weapon4': '0.338', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'HITCOUNT': '2.750', 'weapon3': '3.068', 'DAMAGECOUNT': '13.431', 'FRAGCOUNT': '48.000'} [2023-02-24 21:20:40,507][213369] DAMAGECOUNT value on done: 550793.0 [2023-02-24 21:20:40,508][213369] Sum rewards: 46.417, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.175', 'AMMO5': '0.019', 'AMMO2': '0.048', 'AMMO3': '0.151', 'weapon5': '0.206', 'AMMO4': '0.242', 'WEAPON5': '0.450', 'weapon2': '0.460', 'weapon4': '0.506', 'WEAPON4': '0.550', 'WEAPON3': '0.950', 'weapon3': '2.442', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '12.297', 'FRAGCOUNT': '42.000'} [2023-02-24 21:20:40,567][213368] DAMAGECOUNT value on done: 548235.0 [2023-02-24 21:20:40,567][213368] Sum rewards: 47.590, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.742', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.106', 'AMMO4': '0.138', 'weapon2': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.259', 'WEAPON4': '0.350', 'weapon4': '0.412', 'WEAPON3': '1.550', 'HITCOUNT': '2.540', 'weapon3': '3.042', 'DAMAGECOUNT': '12.537', 'FRAGCOUNT': '45.500'} [2023-02-24 21:20:40,792][213383] DAMAGECOUNT value on done: 553872.0 [2023-02-24 21:20:40,792][213383] Sum rewards: 41.838, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.772', 'ARMOR': '0.008', 'AMMO5': '0.009', 'weapon5': '0.016', 'AMMO2': '0.018', 'AMMO4': '0.092', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.250', 'weapon4': '0.552', 'WEAPON3': '1.300', 'HITCOUNT': '2.490', 'weapon3': '3.018', 'DAMAGECOUNT': '11.010', 'FRAGCOUNT': '38.000'} [2023-02-24 21:20:40,800][213382] DAMAGECOUNT value on done: 539100.0 [2023-02-24 21:20:40,801][213382] Sum rewards: 43.178, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.672', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon5': '0.134', 'AMMO4': '0.136', 'AMMO3': '0.186', 'weapon4': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.250', 'HITCOUNT': '2.480', 'weapon3': '3.028', 'DAMAGECOUNT': '10.953', 'FRAGCOUNT': '40.000'} [2023-02-24 21:20:40,808][213369] DAMAGECOUNT value on done: 542091.0 [2023-02-24 21:20:40,809][213369] Sum rewards: 44.208, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.444', 'AMMO5': '0.010', 'AMMO2': '0.061', 'AMMO3': '0.180', 'weapon5': '0.192', 'WEAPON5': '0.300', 'AMMO4': '0.303', 'weapon2': '0.444', 'WEAPON4': '0.700', 'WEAPON3': '1.100', 'weapon4': '1.130', 'weapon3': '1.916', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.536', 'FRAGCOUNT': '39.500'} [2023-02-24 21:20:40,866][213368] DAMAGECOUNT value on done: 546151.0 [2023-02-24 21:20:40,867][213368] Sum rewards: 45.471, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.034', 'AMMO5': '0.021', 'AMMO2': '0.049', 'AMMO3': '0.158', 'AMMO4': '0.246', 'weapon5': '0.310', 'WEAPON5': '0.400', 'weapon2': '0.490', 'WEAPON4': '0.500', 'weapon4': '0.592', 'WEAPON3': '0.950', 'weapon3': '2.304', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '13.545', 'FRAGCOUNT': '37.000'} [2023-02-24 21:20:41,091][213383] DAMAGECOUNT value on done: 548381.0 [2023-02-24 21:20:41,092][213383] Sum rewards: 56.276, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.279', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.274', 'weapon4': '0.392', 'ARMOR': '0.453', 'WEAPON3': '1.350', 'weapon3': '3.074', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.208', 'FRAGCOUNT': '49.000'} [2023-02-24 21:20:41,097][213382] DAMAGECOUNT value on done: 548314.0 [2023-02-24 21:20:41,097][213382] Sum rewards: 37.776, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.330', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.094', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'WEAPON4': '0.300', 'weapon4': '0.324', 'weapon2': '0.470', 'WEAPON3': '0.950', 'HITCOUNT': '2.500', 'weapon3': '2.850', 'DAMAGECOUNT': '10.920', 'FRAGCOUNT': '33.000'} [2023-02-24 21:20:41,238][213384] DAMAGECOUNT value on done: 555177.0 [2023-02-24 21:20:41,238][213384] Sum rewards: 48.939, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.516', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.162', 'AMMO3': '0.222', 'weapon2': '0.374', 'WEAPON3': '1.450', 'HITCOUNT': '2.580', 'weapon3': '3.172', 'DAMAGECOUNT': '11.883', 'FRAGCOUNT': '44.000'} [2023-02-24 21:20:41,538][213384] DAMAGECOUNT value on done: 539235.0 [2023-02-24 21:20:41,538][213384] Sum rewards: 48.983, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.500', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.024', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.145', 'weapon2': '0.426', 'WEAPON4': '0.450', 'WEAPON3': '0.900', 'weapon4': '0.900', 'weapon3': '2.458', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.774', 'FRAGCOUNT': '42.000'} [2023-02-24 21:20:41,913][213384] DAMAGECOUNT value on done: 551133.0 [2023-02-24 21:20:41,914][213384] Sum rewards: 47.153, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.450', 'AMMO5': '0.021', 'AMMO2': '0.029', 'AMMO4': '0.147', 'AMMO3': '0.171', 'weapon5': '0.260', 'WEAPON4': '0.400', 'weapon2': '0.410', 'WEAPON5': '0.550', 'weapon4': '0.648', 'WEAPON3': '1.050', 'weapon3': '2.384', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '11.562', 'FRAGCOUNT': '42.000'} [2023-02-24 21:20:42,219][213384] DAMAGECOUNT value on done: 555372.0 [2023-02-24 21:20:42,219][213384] Sum rewards: 35.644, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.470', 'AMMO2': '0.020', 'weapon7': '0.086', 'AMMO3': '0.090', 'AMMO4': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'weapon2': '0.922', 'weapon4': '1.064', 'weapon3': '1.362', 'HITCOUNT': '2.070', 'DAMAGECOUNT': '9.162', 'FRAGCOUNT': '29.000'} [2023-02-24 21:20:43,230][213365] Updated weights for policy 0, policy_version 35516 (0.0009) [2023-02-24 21:20:45,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 145498112. Throughput: 0: 3470.6. Samples: 11370926. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:20:45,243][213332] Avg episode reward: [(0, '46.578')] [2023-02-24 21:20:45,267][213352] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000035523_145502208.pth... [2023-02-24 21:20:45,323][213352] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000034711_142176256.pth [2023-02-24 21:20:46,166][213365] Updated weights for policy 0, policy_version 35526 (0.0009) [2023-02-24 21:20:49,092][213365] Updated weights for policy 0, policy_version 35536 (0.0009) [2023-02-24 21:20:50,243][213332] Fps is (10 sec: 13926.7, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 145567744. Throughput: 0: 3471.1. Samples: 11381356. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:20:50,243][213332] Avg episode reward: [(0, '46.578')] [2023-02-24 21:20:52,057][213365] Updated weights for policy 0, policy_version 35546 (0.0009) [2023-02-24 21:20:55,030][213365] Updated weights for policy 0, policy_version 35556 (0.0009) [2023-02-24 21:20:55,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 145637376. Throughput: 0: 3467.6. Samples: 11402108. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:20:55,243][213332] Avg episode reward: [(0, '46.578')] [2023-02-24 21:20:56,248][213367] DAMAGECOUNT value on done: 552025.0 [2023-02-24 21:20:56,248][213367] Sum rewards: 41.081, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.323', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.044', 'AMMO3': '0.168', 'AMMO4': '0.219', 'weapon5': '0.252', 'WEAPON4': '0.350', 'weapon4': '0.364', 'WEAPON5': '0.450', 'weapon2': '0.732', 'WEAPON3': '1.000', 'weapon3': '2.412', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '11.730', 'FRAGCOUNT': '35.500'} [2023-02-24 21:20:56,407][213384] Large shaping reward 2.535 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.513, 171.0), ('weapon5', 0.002)] [2023-02-24 21:20:56,524][213367] DAMAGECOUNT value on done: 554625.0 [2023-02-24 21:20:56,524][213367] Sum rewards: 35.083, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.410', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.084', 'AMMO4': '0.178', 'AMMO3': '0.190', 'weapon4': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.864', 'WEAPON3': '1.150', 'HITCOUNT': '2.530', 'weapon3': '2.610', 'DAMAGECOUNT': '11.217', 'FRAGCOUNT': '32.000'} [2023-02-24 21:20:56,551][213367] DAMAGECOUNT value on done: 550412.0 [2023-02-24 21:20:56,551][213367] Sum rewards: 44.461, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.522', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.198', 'AMMO4': '0.207', 'weapon2': '0.306', 'weapon4': '0.330', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.730', 'weapon3': '3.102', 'DAMAGECOUNT': '12.351', 'FRAGCOUNT': '40.000'} [2023-02-24 21:20:56,827][213367] DAMAGECOUNT value on done: 561279.0 [2023-02-24 21:20:56,827][213367] Sum rewards: 44.072, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.784', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.169', 'weapon2': '0.236', 'weapon5': '0.236', 'AMMO3': '0.256', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.482', 'WEAPON3': '1.550', 'HITCOUNT': '2.750', 'weapon3': '2.762', 'DAMAGECOUNT': '12.165', 'FRAGCOUNT': '42.000'} [2023-02-24 21:20:57,524][213372] DAMAGECOUNT value on done: 569144.0 [2023-02-24 21:20:57,525][213372] Sum rewards: 57.319, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.373', 'AMMO2': '0.003', 'AMMO5': '0.009', 'AMMO4': '0.017', 'WEAPON4': '0.050', 'weapon4': '0.080', 'weapon5': '0.116', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.404', 'WEAPON3': '1.450', 'weapon3': '3.148', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.334', 'FRAGCOUNT': '50.000'} [2023-02-24 21:20:57,818][213372] DAMAGECOUNT value on done: 549682.0 [2023-02-24 21:20:57,818][213372] Sum rewards: 51.394, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.020', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.204', 'weapon5': '0.228', 'weapon2': '0.390', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon4': '0.532', 'WEAPON3': '1.200', 'weapon3': '2.580', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.785', 'FRAGCOUNT': '44.000'} [2023-02-24 21:20:57,828][213372] DAMAGECOUNT value on done: 558647.0 [2023-02-24 21:20:57,828][213372] Sum rewards: 33.360, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.142', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.116', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.270', 'WEAPON4': '0.350', 'weapon4': '0.576', 'WEAPON3': '1.250', 'HITCOUNT': '2.180', 'weapon3': '2.758', 'DAMAGECOUNT': '8.739', 'FRAGCOUNT': '33.000'} [2023-02-24 21:20:57,984][213365] Updated weights for policy 0, policy_version 35566 (0.0009) [2023-02-24 21:20:58,125][213372] DAMAGECOUNT value on done: 553085.0 [2023-02-24 21:20:58,126][213372] Sum rewards: 60.199, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.860', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.211', 'weapon2': '0.264', 'WEAPON3': '1.250', 'HITCOUNT': '3.260', 'weapon3': '3.600', 'DAMAGECOUNT': '15.057', 'FRAGCOUNT': '50.000'} [2023-02-24 21:20:58,378][213366] DAMAGECOUNT value on done: 546671.0 [2023-02-24 21:20:58,379][213366] Sum rewards: 35.862, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.970', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.070', 'AMMO3': '0.108', 'weapon5': '0.322', 'AMMO4': '0.351', 'WEAPON5': '0.600', 'weapon2': '0.604', 'weapon4': '0.636', 'WEAPON3': '0.750', 'WEAPON4': '0.800', 'weapon3': '2.056', 'HITCOUNT': '2.170', 'DAMAGECOUNT': '10.584', 'FRAGCOUNT': '33.000'} [2023-02-24 21:20:58,685][213366] DAMAGECOUNT value on done: 559007.0 [2023-02-24 21:20:58,686][213366] Sum rewards: 52.911, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.530', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.056', 'AMMO4': '0.175', 'AMMO3': '0.200', 'weapon2': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.734', 'WEAPON3': '1.350', 'weapon3': '2.756', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.740', 'FRAGCOUNT': '47.000'} [2023-02-24 21:20:58,696][213366] DAMAGECOUNT value on done: 570739.0 [2023-02-24 21:20:58,697][213366] Sum rewards: 48.029, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.522', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO4': '0.032', 'weapon5': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.172', 'weapon4': '0.316', 'weapon2': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.026', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.542', 'FRAGCOUNT': '39.000'} [2023-02-24 21:20:58,953][213369] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-24 21:20:58,993][213366] DAMAGECOUNT value on done: 560921.0 [2023-02-24 21:20:58,993][213366] Sum rewards: 56.212, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.160', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.016', 'weapon5': '0.068', 'AMMO4': '0.081', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.398', 'weapon4': '0.506', 'WEAPON3': '1.500', 'weapon3': '2.772', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.295', 'FRAGCOUNT': '51.000'} [2023-02-24 21:20:59,064][213383] DAMAGECOUNT value on done: 553317.0 [2023-02-24 21:20:59,065][213383] Sum rewards: 57.843, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.424', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO4': '0.186', 'weapon4': '0.208', 'weapon5': '0.224', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'weapon2': '0.360', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.936', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '52.000'} [2023-02-24 21:20:59,291][213369] DAMAGECOUNT value on done: 558643.0 [2023-02-24 21:20:59,291][213369] Sum rewards: 58.310, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.812', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.008', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.118', 'weapon2': '0.124', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon4': '0.690', 'WEAPON3': '1.250', 'weapon3': '2.842', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.208', 'FRAGCOUNT': '51.000'} [2023-02-24 21:20:59,366][213383] DAMAGECOUNT value on done: 553616.0 [2023-02-24 21:20:59,367][213383] Sum rewards: 37.784, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.112', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.017', 'weapon5': '0.064', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'WEAPON4': '0.400', 'weapon2': '0.498', 'weapon4': '0.768', 'WEAPON3': '1.150', 'weapon3': '2.338', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '10.950', 'FRAGCOUNT': '33.000'} [2023-02-24 21:20:59,368][213368] DAMAGECOUNT value on done: 549491.0 [2023-02-24 21:20:59,369][213368] Sum rewards: 54.662, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.080', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.090', 'AMMO3': '0.132', 'weapon4': '0.186', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'WEAPON4': '0.350', 'weapon2': '0.780', 'WEAPON3': '0.850', 'weapon3': '2.744', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.650', 'FRAGCOUNT': '45.500'} [2023-02-24 21:20:59,448][213382] DAMAGECOUNT value on done: 559346.0 [2023-02-24 21:20:59,449][213382] Sum rewards: 31.883, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.306', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.052', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'weapon5': '0.156', 'WEAPON4': '0.250', 'AMMO4': '0.260', 'weapon2': '0.742', 'WEAPON3': '0.850', 'weapon4': '1.178', 'weapon3': '1.398', 'HITCOUNT': '2.050', 'DAMAGECOUNT': '8.940', 'FRAGCOUNT': '28.000'} [2023-02-24 21:20:59,589][213369] DAMAGECOUNT value on done: 560738.0 [2023-02-24 21:20:59,589][213369] Sum rewards: 41.906, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.860', 'AMMO5': '0.016', 'AMMO2': '0.042', 'AMMO3': '0.117', 'AMMO4': '0.212', 'weapon5': '0.284', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '0.700', 'weapon4': '0.788', 'weapon2': '0.920', 'weapon3': '1.648', 'HITCOUNT': '2.260', 'DAMAGECOUNT': '10.578', 'FRAGCOUNT': '38.500'} [2023-02-24 21:20:59,661][213368] DAMAGECOUNT value on done: 557777.0 [2023-02-24 21:20:59,662][213368] Sum rewards: 44.280, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.067', 'AMMO5': '0.005', 'weapon5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.170', 'weapon2': '0.330', 'WEAPON4': '0.450', 'weapon4': '0.672', 'WEAPON3': '1.100', 'weapon3': '2.698', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.167', 'FRAGCOUNT': '38.000'} [2023-02-24 21:20:59,747][213382] DAMAGECOUNT value on done: 556732.0 [2023-02-24 21:20:59,747][213382] Sum rewards: 56.747, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.452', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon5': '0.100', 'AMMO4': '0.108', 'weapon4': '0.172', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'weapon2': '0.634', 'WEAPON3': '1.350', 'weapon3': '2.886', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.269', 'FRAGCOUNT': '52.000'} [2023-02-24 21:20:59,893][213369] DAMAGECOUNT value on done: 554322.0 [2023-02-24 21:20:59,893][213369] Sum rewards: 39.973, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.576', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'weapon5': '0.126', 'WEAPON4': '0.300', 'weapon4': '0.622', 'WEAPON3': '0.650', 'weapon2': '0.830', 'weapon3': '2.280', 'HITCOUNT': '2.340', 'DAMAGECOUNT': '10.587', 'FRAGCOUNT': '34.000'} [2023-02-24 21:20:59,940][213368] DAMAGECOUNT value on done: 552778.0 [2023-02-24 21:20:59,940][213368] Sum rewards: 52.033, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.794', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.183', 'weapon2': '0.194', 'AMMO3': '0.222', 'WEAPON4': '0.350', 'weapon4': '0.618', 'WEAPON3': '1.400', 'weapon3': '2.818', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.629', 'FRAGCOUNT': '48.000'} [2023-02-24 21:21:00,169][213383] DAMAGECOUNT value on done: 558191.0 [2023-02-24 21:21:00,169][213383] Sum rewards: 46.659, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.110', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.102', 'AMMO3': '0.180', 'AMMO4': '0.201', 'weapon4': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.500', 'WEAPON3': '1.050', 'HITCOUNT': '2.680', 'weapon3': '2.954', 'DAMAGECOUNT': '12.957', 'FRAGCOUNT': '40.500'} [2023-02-24 21:21:00,182][213369] DAMAGECOUNT value on done: 546358.0 [2023-02-24 21:21:00,183][213369] Sum rewards: 45.343, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.910', 'AMMO5': '0.021', 'AMMO2': '0.041', 'weapon2': '0.202', 'AMMO4': '0.206', 'weapon5': '0.220', 'weapon4': '0.222', 'AMMO3': '0.271', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'HITCOUNT': '2.570', 'weapon3': '2.998', 'DAMAGECOUNT': '12.801', 'FRAGCOUNT': '45.000'} [2023-02-24 21:21:00,195][213382] DAMAGECOUNT value on done: 542892.0 [2023-02-24 21:21:00,195][213382] Sum rewards: 40.416, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.985', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.100', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'weapon2': '0.214', 'weapon4': '0.752', 'WEAPON3': '1.050', 'HITCOUNT': '2.510', 'weapon3': '2.706', 'DAMAGECOUNT': '11.376', 'FRAGCOUNT': '34.000'} [2023-02-24 21:21:00,239][213368] DAMAGECOUNT value on done: 550564.0 [2023-02-24 21:21:00,240][213368] Sum rewards: 50.346, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.158', 'AMMO5': '0.014', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon4': '0.128', 'weapon5': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'WEAPON5': '0.300', 'weapon2': '0.548', 'WEAPON3': '1.050', 'HITCOUNT': '2.890', 'weapon3': '2.978', 'DAMAGECOUNT': '13.239', 'FRAGCOUNT': '42.500'} [2023-02-24 21:21:00,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 145707008. Throughput: 0: 3467.2. Samples: 11422814. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:21:00,243][213332] Avg episode reward: [(0, '46.481')] [2023-02-24 21:21:00,470][213383] DAMAGECOUNT value on done: 552977.0 [2023-02-24 21:21:00,470][213383] Sum rewards: 51.608, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.676', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.114', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon4': '0.282', 'weapon2': '0.482', 'WEAPON3': '1.250', 'weapon3': '2.882', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.788', 'FRAGCOUNT': '44.000'} [2023-02-24 21:21:00,502][213382] DAMAGECOUNT value on done: 553216.0 [2023-02-24 21:21:00,502][213382] Sum rewards: 49.173, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.269', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.184', 'WEAPON4': '0.200', 'weapon4': '0.200', 'AMMO3': '0.213', 'weapon2': '0.340', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.810', 'weapon3': '2.994', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '43.000'} [2023-02-24 21:21:00,618][213384] DAMAGECOUNT value on done: 559140.0 [2023-02-24 21:21:00,619][213384] Sum rewards: 47.996, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.766', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon5': '0.082', 'AMMO4': '0.120', 'AMMO3': '0.149', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.600', 'weapon4': '0.650', 'WEAPON3': '0.900', 'weapon3': '2.368', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '11.889', 'FRAGCOUNT': '41.000'} [2023-02-24 21:21:00,915][213384] DAMAGECOUNT value on done: 543446.0 [2023-02-24 21:21:00,916][213384] Sum rewards: 49.678, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.995', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO3': '0.161', 'weapon5': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.770', 'weapon4': '0.794', 'WEAPON3': '1.100', 'weapon3': '2.010', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.528', 'FRAGCOUNT': '43.000'} [2023-02-24 21:21:00,918][213365] Updated weights for policy 0, policy_version 35576 (0.0009) [2023-02-24 21:21:01,287][213384] DAMAGECOUNT value on done: 555145.0 [2023-02-24 21:21:01,287][213384] Sum rewards: 39.483, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.718', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.053', 'AMMO3': '0.127', 'AMMO4': '0.264', 'weapon5': '0.350', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.680', 'weapon2': '0.700', 'WEAPON3': '0.800', 'weapon3': '1.878', 'HITCOUNT': '2.370', 'DAMAGECOUNT': '12.006', 'FRAGCOUNT': '33.000'} [2023-02-24 21:21:01,576][213384] DAMAGECOUNT value on done: 560307.0 [2023-02-24 21:21:01,577][213384] Sum rewards: 54.169, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.774', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon5': '0.116', 'AMMO3': '0.209', 'weapon2': '0.218', 'AMMO4': '0.254', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.838', 'WEAPON3': '1.300', 'weapon3': '2.448', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.805', 'FRAGCOUNT': '47.000'} [2023-02-24 21:21:03,862][213365] Updated weights for policy 0, policy_version 35586 (0.0009) [2023-02-24 21:21:05,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 145776640. Throughput: 0: 3470.5. Samples: 11433314. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:21:05,244][213332] Avg episode reward: [(0, '46.788')] [2023-02-24 21:21:06,836][213365] Updated weights for policy 0, policy_version 35596 (0.0009) [2023-02-24 21:21:09,783][213365] Updated weights for policy 0, policy_version 35606 (0.0009) [2023-02-24 21:21:10,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 145846272. Throughput: 0: 3467.8. Samples: 11454010. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:21:10,243][213332] Avg episode reward: [(0, '46.788')] [2023-02-24 21:21:12,733][213365] Updated weights for policy 0, policy_version 35616 (0.0009) [2023-02-24 21:21:15,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.2, 300 sec: 13857.0). Total num frames: 145915904. Throughput: 0: 3467.1. Samples: 11474896. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:21:15,243][213332] Avg episode reward: [(0, '46.788')] [2023-02-24 21:21:15,601][213367] DAMAGECOUNT value on done: 556276.0 [2023-02-24 21:21:15,601][213367] Sum rewards: 55.186, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.463', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.102', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.372', 'weapon2': '0.378', 'WEAPON3': '1.250', 'weapon3': '2.930', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '12.753', 'FRAGCOUNT': '48.000'} [2023-02-24 21:21:15,681][213365] Updated weights for policy 0, policy_version 35626 (0.0009) [2023-02-24 21:21:15,875][213367] DAMAGECOUNT value on done: 559458.0 [2023-02-24 21:21:15,876][213367] Sum rewards: 50.381, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.115', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.165', 'weapon5': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON4': '0.300', 'weapon4': '0.512', 'WEAPON3': '1.050', 'weapon3': '2.580', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.499', 'FRAGCOUNT': '42.000'} [2023-02-24 21:21:15,906][213367] DAMAGECOUNT value on done: 554946.0 [2023-02-24 21:21:15,906][213367] Sum rewards: 47.626, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.428', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon4': '0.096', 'weapon5': '0.148', 'AMMO4': '0.160', 'WEAPON4': '0.250', 'AMMO3': '0.262', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.500', 'HITCOUNT': '2.700', 'weapon3': '3.174', 'DAMAGECOUNT': '13.602', 'FRAGCOUNT': '44.000'} [2023-02-24 21:21:16,190][213367] DAMAGECOUNT value on done: 565872.0 [2023-02-24 21:21:16,191][213367] Sum rewards: 53.904, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.066', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'weapon2': '0.338', 'weapon4': '0.486', 'WEAPON3': '1.400', 'weapon3': '2.760', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.554', 'FRAGCOUNT': '48.000'} [2023-02-24 21:21:16,850][213372] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 21:21:16,867][213372] DAMAGECOUNT value on done: 573391.0 [2023-02-24 21:21:16,868][213372] Sum rewards: 46.932, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.988', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.086', 'AMMO3': '0.167', 'weapon5': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.456', 'weapon2': '0.704', 'WEAPON3': '1.100', 'weapon3': '2.360', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.741', 'FRAGCOUNT': '39.000'} [2023-02-24 21:21:17,162][213372] DAMAGECOUNT value on done: 553684.0 [2023-02-24 21:21:17,162][213372] Sum rewards: 44.020, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.550', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.152', 'AMMO3': '0.203', 'AMMO4': '0.205', 'weapon2': '0.286', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.560', 'WEAPON3': '1.200', 'HITCOUNT': '2.560', 'weapon3': '2.742', 'DAMAGECOUNT': '12.006', 'FRAGCOUNT': '41.000'} [2023-02-24 21:21:17,171][213372] DAMAGECOUNT value on done: 563297.0 [2023-02-24 21:21:17,172][213372] Sum rewards: 53.213, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.106', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.198', 'weapon5': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.290', 'weapon4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.650', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '13.950', 'FRAGCOUNT': '46.000'} [2023-02-24 21:21:17,462][213372] DAMAGECOUNT value on done: 556489.0 [2023-02-24 21:21:17,463][213372] Sum rewards: 44.239, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.335', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.136', 'weapon5': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.548', 'weapon2': '0.582', 'WEAPON3': '0.750', 'HITCOUNT': '2.240', 'weapon3': '2.398', 'DAMAGECOUNT': '10.212', 'FRAGCOUNT': '36.000'} [2023-02-24 21:21:17,748][213366] DAMAGECOUNT value on done: 551239.0 [2023-02-24 21:21:17,749][213366] Sum rewards: 56.465, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.033', 'weapon5': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'HEALTH': '0.098', 'AMMO3': '0.180', 'weapon2': '0.270', 'WEAPON3': '1.050', 'HITCOUNT': '2.940', 'weapon3': '3.522', 'DAMAGECOUNT': '13.704', 'FRAGCOUNT': '46.500'} [2023-02-24 21:21:18,041][213366] DAMAGECOUNT value on done: 563452.0 [2023-02-24 21:21:18,041][213366] Sum rewards: 46.484, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.380', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.174', 'weapon2': '0.186', 'AMMO4': '0.192', 'AMMO3': '0.218', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.556', 'WEAPON3': '1.300', 'HITCOUNT': '2.640', 'weapon3': '2.808', 'DAMAGECOUNT': '13.335', 'FRAGCOUNT': '41.000'} [2023-02-24 21:21:18,049][213366] DAMAGECOUNT value on done: 574895.0 [2023-02-24 21:21:18,050][213366] Sum rewards: 44.596, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.846', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.120', 'AMMO3': '0.153', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.436', 'weapon4': '0.472', 'WEAPON3': '0.900', 'weapon3': '2.566', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '12.468', 'FRAGCOUNT': '37.000'} [2023-02-24 21:21:18,343][213366] DAMAGECOUNT value on done: 564321.0 [2023-02-24 21:21:18,343][213366] Sum rewards: 40.653, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.662', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.122', 'weapon5': '0.134', 'AMMO3': '0.159', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.264', 'weapon4': '0.410', 'WEAPON3': '0.950', 'HITCOUNT': '2.200', 'weapon3': '2.868', 'DAMAGECOUNT': '10.200', 'FRAGCOUNT': '35.000'} [2023-02-24 21:21:18,476][213383] DAMAGECOUNT value on done: 557243.0 [2023-02-24 21:21:18,477][213383] Sum rewards: 33.725, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.412', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.110', 'AMMO4': '0.126', 'AMMO3': '0.183', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.424', 'weapon2': '0.610', 'WEAPON3': '1.100', 'weapon3': '2.410', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '11.778', 'FRAGCOUNT': '29.500'} [2023-02-24 21:21:18,614][213365] Updated weights for policy 0, policy_version 35636 (0.0009) [2023-02-24 21:21:18,654][213369] DAMAGECOUNT value on done: 562648.0 [2023-02-24 21:21:18,654][213369] Sum rewards: 51.387, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.503', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon5': '0.114', 'AMMO3': '0.122', 'AMMO4': '0.181', 'weapon4': '0.230', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.778', 'WEAPON3': '0.800', 'weapon3': '2.628', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.015', 'FRAGCOUNT': '43.000'} [2023-02-24 21:21:18,698][213368] DAMAGECOUNT value on done: 554174.0 [2023-02-24 21:21:18,699][213368] Sum rewards: 49.226, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.920', 'ARMOR': '0.005', 'AMMO5': '0.022', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon2': '0.180', 'AMMO3': '0.250', 'weapon5': '0.258', 'WEAPON4': '0.300', 'weapon4': '0.426', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '2.660', 'weapon3': '2.764', 'DAMAGECOUNT': '13.995', 'FRAGCOUNT': '45.000'} [2023-02-24 21:21:18,778][213383] DAMAGECOUNT value on done: 557484.0 [2023-02-24 21:21:18,778][213383] Sum rewards: 41.480, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.480', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.126', 'AMMO4': '0.190', 'AMMO3': '0.191', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.508', 'weapon2': '0.544', 'WEAPON3': '1.150', 'weapon3': '2.418', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '11.604', 'FRAGCOUNT': '36.500'} [2023-02-24 21:21:18,803][213382] DAMAGECOUNT value on done: 562955.0 [2023-02-24 21:21:18,803][213382] Sum rewards: 36.998, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.594', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon4': '0.132', 'weapon5': '0.142', 'AMMO4': '0.160', 'AMMO3': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.488', 'WEAPON3': '1.200', 'HITCOUNT': '2.250', 'weapon3': '2.952', 'DAMAGECOUNT': '10.827', 'FRAGCOUNT': '34.000'} [2023-02-24 21:21:18,968][213369] DAMAGECOUNT value on done: 565161.0 [2023-02-24 21:21:18,968][213369] Sum rewards: 50.777, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.665', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO3': '0.127', 'AMMO4': '0.143', 'weapon5': '0.144', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.646', 'weapon2': '0.768', 'WEAPON3': '0.850', 'weapon3': '2.234', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.269', 'FRAGCOUNT': '40.000'} [2023-02-24 21:21:18,998][213368] DAMAGECOUNT value on done: 562707.0 [2023-02-24 21:21:18,999][213368] Sum rewards: 54.228, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.200', 'AMMO2': '0.012', 'AMMO5': '0.012', 'AMMO4': '0.058', 'weapon5': '0.122', 'weapon2': '0.144', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'WEAPON5': '0.300', 'weapon4': '0.316', 'WEAPON3': '1.400', 'weapon3': '3.168', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.790', 'FRAGCOUNT': '46.000'} [2023-02-24 21:21:19,104][213382] DAMAGECOUNT value on done: 560895.0 [2023-02-24 21:21:19,105][213382] Sum rewards: 42.814, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.104', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.035', 'AMMO3': '0.158', 'weapon5': '0.170', 'AMMO4': '0.172', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.402', 'weapon2': '0.458', 'WEAPON3': '1.000', 'weapon3': '2.724', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.489', 'FRAGCOUNT': '37.000'} [2023-02-24 21:21:19,268][213369] DAMAGECOUNT value on done: 559160.0 [2023-02-24 21:21:19,268][213369] Sum rewards: 55.524, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.672', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.104', 'AMMO4': '0.138', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.368', 'weapon4': '0.414', 'WEAPON3': '1.300', 'weapon3': '2.866', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.514', 'FRAGCOUNT': '47.500'} [2023-02-24 21:21:19,275][213368] DAMAGECOUNT value on done: 558111.0 [2023-02-24 21:21:19,276][213368] Sum rewards: 61.703, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.864', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon5': '0.050', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.174', 'AMMO3': '0.221', 'weapon2': '0.402', 'WEAPON3': '1.400', 'weapon3': '3.108', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '52.000'} [2023-02-24 21:21:19,559][213369] DAMAGECOUNT value on done: 550164.0 [2023-02-24 21:21:19,560][213369] Sum rewards: 44.599, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.773', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.185', 'weapon5': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.276', 'weapon4': '0.680', 'WEAPON3': '1.100', 'HITCOUNT': '2.510', 'weapon3': '2.548', 'DAMAGECOUNT': '11.418', 'FRAGCOUNT': '37.000'} [2023-02-24 21:21:19,567][213382] DAMAGECOUNT value on done: 547997.0 [2023-02-24 21:21:19,568][213382] Sum rewards: 61.183, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.656', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.022', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'weapon2': '0.714', 'WEAPON3': '1.250', 'weapon3': '3.022', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '50.000'} [2023-02-24 21:21:19,582][213368] DAMAGECOUNT value on done: 553700.0 [2023-02-24 21:21:19,583][213368] Sum rewards: 32.916, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.029', 'ARMOR': '0.008', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.049', 'AMMO3': '0.144', 'weapon5': '0.150', 'AMMO4': '0.244', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.590', 'weapon4': '0.776', 'WEAPON3': '0.850', 'weapon3': '1.970', 'HITCOUNT': '2.120', 'DAMAGECOUNT': '9.408', 'FRAGCOUNT': '28.000'} [2023-02-24 21:21:19,596][213383] DAMAGECOUNT value on done: 562982.0 [2023-02-24 21:21:19,597][213383] Sum rewards: 58.350, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.468', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.121', 'weapon5': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.472', 'weapon2': '0.500', 'WEAPON3': '0.800', 'weapon3': '2.626', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.373', 'FRAGCOUNT': '45.000'} [2023-02-24 21:21:19,859][213382] DAMAGECOUNT value on done: 557068.0 [2023-02-24 21:21:19,860][213382] Sum rewards: 43.697, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.920', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.026', 'weapon5': '0.052', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'WEAPON4': '0.400', 'weapon2': '0.472', 'weapon4': '0.486', 'WEAPON3': '1.000', 'HITCOUNT': '2.460', 'weapon3': '2.696', 'DAMAGECOUNT': '11.556', 'FRAGCOUNT': '37.000'} [2023-02-24 21:21:19,893][213383] DAMAGECOUNT value on done: 557409.0 [2023-02-24 21:21:19,894][213383] Sum rewards: 55.908, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.500', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.052', 'weapon4': '0.058', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.182', 'weapon2': '0.388', 'WEAPON3': '1.150', 'HITCOUNT': '2.890', 'weapon3': '3.366', 'DAMAGECOUNT': '13.296', 'FRAGCOUNT': '47.000'} [2023-02-24 21:21:19,956][213384] DAMAGECOUNT value on done: 562999.0 [2023-02-24 21:21:19,957][213384] Sum rewards: 41.367, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.150', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO3': '0.190', 'AMMO4': '0.225', 'weapon5': '0.226', 'weapon2': '0.272', 'WEAPON5': '0.450', 'WEAPON4': '0.750', 'weapon4': '1.074', 'WEAPON3': '1.150', 'weapon3': '2.188', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '11.577', 'FRAGCOUNT': '39.000'} [2023-02-24 21:21:20,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 145985536. Throughput: 0: 3467.1. Samples: 11485304. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:21:20,243][213332] Avg episode reward: [(0, '46.909')] [2023-02-24 21:21:20,259][213384] DAMAGECOUNT value on done: 547843.0 [2023-02-24 21:21:20,259][213384] Sum rewards: 49.180, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.946', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.104', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.294', 'WEAPON4': '0.300', 'weapon4': '0.326', 'WEAPON3': '1.350', 'HITCOUNT': '2.730', 'weapon3': '2.948', 'DAMAGECOUNT': '13.191', 'FRAGCOUNT': '45.000'} [2023-02-24 21:21:20,646][213384] DAMAGECOUNT value on done: 559431.0 [2023-02-24 21:21:20,647][213384] Sum rewards: 43.927, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.508', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.124', 'AMMO3': '0.204', 'weapon4': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.436', 'WEAPON3': '1.300', 'HITCOUNT': '2.870', 'weapon3': '2.942', 'DAMAGECOUNT': '12.858', 'FRAGCOUNT': '40.500'} [2023-02-24 21:21:20,942][213384] DAMAGECOUNT value on done: 564157.0 [2023-02-24 21:21:20,943][213384] Sum rewards: 46.337, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.467', 'AMMO5': '0.012', 'AMMO2': '0.048', 'AMMO3': '0.124', 'weapon5': '0.236', 'AMMO4': '0.240', 'WEAPON5': '0.350', 'weapon2': '0.424', 'WEAPON4': '0.450', 'weapon4': '0.540', 'WEAPON3': '0.850', 'HITCOUNT': '2.310', 'weapon3': '2.420', 'DAMAGECOUNT': '11.550', 'FRAGCOUNT': '39.000'} [2023-02-24 21:21:21,533][213365] Updated weights for policy 0, policy_version 35646 (0.0009) [2023-02-24 21:21:24,493][213365] Updated weights for policy 0, policy_version 35656 (0.0009) [2023-02-24 21:21:25,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 146055168. Throughput: 0: 3472.6. Samples: 11506248. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:21:25,243][213332] Avg episode reward: [(0, '46.892')] [2023-02-24 21:21:27,454][213365] Updated weights for policy 0, policy_version 35666 (0.0010) [2023-02-24 21:21:30,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 146124800. Throughput: 0: 3467.6. Samples: 11526966. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:21:30,243][213332] Avg episode reward: [(0, '46.892')] [2023-02-24 21:21:30,418][213365] Updated weights for policy 0, policy_version 35676 (0.0009) [2023-02-24 21:21:33,342][213366] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 21:21:33,369][213365] Updated weights for policy 0, policy_version 35686 (0.0009) [2023-02-24 21:21:34,987][213367] DAMAGECOUNT value on done: 561381.0 [2023-02-24 21:21:34,988][213367] Sum rewards: 60.500, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.294', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.140', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'weapon2': '0.244', 'WEAPON5': '0.250', 'weapon4': '0.458', 'WEAPON3': '1.250', 'weapon3': '2.898', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '51.000'} [2023-02-24 21:21:35,221][213367] DAMAGECOUNT value on done: 563311.0 [2023-02-24 21:21:35,222][213367] Sum rewards: 38.750, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.646', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.196', 'AMMO3': '0.206', 'AMMO4': '0.223', 'WEAPON5': '0.350', 'weapon4': '0.352', 'weapon2': '0.468', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '2.520', 'weapon3': '2.710', 'DAMAGECOUNT': '11.559', 'FRAGCOUNT': '37.500'} [2023-02-24 21:21:35,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 146194432. Throughput: 0: 3466.0. Samples: 11537328. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:21:35,243][213332] Avg episode reward: [(0, '47.076')] [2023-02-24 21:21:35,246][213352] Saving new best policy, reward=47.076! [2023-02-24 21:21:35,312][213367] DAMAGECOUNT value on done: 559032.0 [2023-02-24 21:21:35,313][213367] Sum rewards: 50.409, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.940', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.890', 'WEAPON3': '1.150', 'HITCOUNT': '2.760', 'weapon3': '2.762', 'DAMAGECOUNT': '12.258', 'FRAGCOUNT': '43.000'} [2023-02-24 21:21:35,555][213367] DAMAGECOUNT value on done: 570200.0 [2023-02-24 21:21:35,556][213367] Sum rewards: 50.407, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.655', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.147', 'weapon2': '0.170', 'WEAPON4': '0.300', 'weapon5': '0.306', 'WEAPON5': '0.350', 'weapon4': '0.618', 'WEAPON3': '0.900', 'weapon3': '2.720', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.984', 'FRAGCOUNT': '42.000'} [2023-02-24 21:21:36,208][213372] DAMAGECOUNT value on done: 577696.0 [2023-02-24 21:21:36,208][213372] Sum rewards: 50.871, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'weapon5': '0.112', 'AMMO3': '0.123', 'HEALTH': '0.176', 'WEAPON3': '0.800', 'weapon2': '0.844', 'weapon3': '2.676', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.915', 'FRAGCOUNT': '40.000'} [2023-02-24 21:21:36,358][213365] Updated weights for policy 0, policy_version 35696 (0.0009) [2023-02-24 21:21:36,501][213372] DAMAGECOUNT value on done: 557263.0 [2023-02-24 21:21:36,502][213372] Sum rewards: 39.890, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.665', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.110', 'AMMO3': '0.115', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.314', 'WEAPON3': '0.700', 'weapon2': '0.992', 'HITCOUNT': '2.380', 'weapon3': '2.432', 'DAMAGECOUNT': '10.737', 'FRAGCOUNT': '32.000'} [2023-02-24 21:21:36,510][213372] DAMAGECOUNT value on done: 568247.0 [2023-02-24 21:21:36,511][213372] Sum rewards: 53.367, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.120', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.094', 'AMMO4': '0.109', 'weapon4': '0.156', 'weapon2': '0.216', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '3.050', 'weapon3': '3.280', 'DAMAGECOUNT': '14.850', 'FRAGCOUNT': '48.000'} [2023-02-24 21:21:36,804][213372] DAMAGECOUNT value on done: 560481.0 [2023-02-24 21:21:36,805][213372] Sum rewards: 47.609, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.496', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.108', 'AMMO4': '0.140', 'weapon2': '0.154', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.760', 'WEAPON3': '1.100', 'HITCOUNT': '2.690', 'weapon3': '2.752', 'DAMAGECOUNT': '11.976', 'FRAGCOUNT': '42.000'} [2023-02-24 21:21:37,136][213366] DAMAGECOUNT value on done: 555634.0 [2023-02-24 21:21:37,136][213366] Sum rewards: 42.843, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.209', 'AMMO5': '0.018', 'AMMO2': '0.027', 'weapon5': '0.106', 'AMMO4': '0.134', 'AMMO3': '0.240', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.772', 'WEAPON3': '1.300', 'weapon3': '2.526', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.185', 'FRAGCOUNT': '39.000'} [2023-02-24 21:21:37,438][213366] DAMAGECOUNT value on done: 567899.0 [2023-02-24 21:21:37,439][213366] Sum rewards: 44.237, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.582', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.124', 'AMMO3': '0.204', 'weapon4': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.682', 'WEAPON3': '1.300', 'HITCOUNT': '2.740', 'weapon3': '2.758', 'DAMAGECOUNT': '13.341', 'FRAGCOUNT': '40.000'} [2023-02-24 21:21:37,447][213366] DAMAGECOUNT value on done: 579766.0 [2023-02-24 21:21:37,448][213366] Sum rewards: 55.493, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.550', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.074', 'AMMO4': '0.127', 'weapon5': '0.162', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.354', 'WEAPON3': '1.350', 'weapon3': '3.220', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.508', 'FRAGCOUNT': '48.000'} [2023-02-24 21:21:37,750][213366] DAMAGECOUNT value on done: 568715.0 [2023-02-24 21:21:37,750][213366] Sum rewards: 48.399, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.220', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon5': '0.160', 'AMMO4': '0.208', 'AMMO3': '0.211', 'weapon2': '0.248', 'weapon4': '0.316', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.974', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.182', 'FRAGCOUNT': '44.000'} [2023-02-24 21:21:37,892][213383] DAMAGECOUNT value on done: 561691.0 [2023-02-24 21:21:37,893][213383] Sum rewards: 47.087, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.614', 'ARMOR': '0.004', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.040', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.117', 'weapon7': '0.138', 'AMMO4': '0.198', 'weapon5': '0.228', 'weapon4': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.814', 'WEAPON3': '0.900', 'weapon3': '2.148', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '13.344', 'FRAGCOUNT': '39.000'} [2023-02-24 21:21:37,989][213369] DAMAGECOUNT value on done: 567149.0 [2023-02-24 21:21:37,990][213369] Sum rewards: 54.227, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.210', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.173', 'weapon5': '0.218', 'weapon4': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.428', 'WEAPON3': '1.100', 'weapon3': '2.810', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.503', 'FRAGCOUNT': '47.000'} [2023-02-24 21:21:38,191][213368] DAMAGECOUNT value on done: 558399.0 [2023-02-24 21:21:38,191][213368] Sum rewards: 46.953, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.174', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.174', 'AMMO3': '0.176', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.338', 'weapon4': '0.390', 'WEAPON3': '1.050', 'HITCOUNT': '2.450', 'weapon3': '2.900', 'DAMAGECOUNT': '12.675', 'FRAGCOUNT': '40.000'} [2023-02-24 21:21:38,194][213383] DAMAGECOUNT value on done: 561346.0 [2023-02-24 21:21:38,195][213383] Sum rewards: 40.825, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.624', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.046', 'AMMO3': '0.232', 'AMMO4': '0.232', 'weapon5': '0.278', 'weapon2': '0.288', 'weapon4': '0.480', 'WEAPON5': '0.600', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'HITCOUNT': '2.620', 'weapon3': '2.626', 'DAMAGECOUNT': '11.421', 'FRAGCOUNT': '40.000'} [2023-02-24 21:21:38,208][213382] DAMAGECOUNT value on done: 566585.0 [2023-02-24 21:21:38,208][213382] Sum rewards: 39.072, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.035', 'AMMO5': '0.009', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.148', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.376', 'weapon2': '0.684', 'WEAPON3': '1.250', 'weapon3': '2.558', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '10.890', 'FRAGCOUNT': '37.000'} [2023-02-24 21:21:38,295][213369] DAMAGECOUNT value on done: 569742.0 [2023-02-24 21:21:38,295][213369] Sum rewards: 50.139, reward structure: {'DEATHCOUNT': '-15.000', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon5': '0.150', 'AMMO3': '0.165', 'AMMO4': '0.227', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.432', 'weapon4': '0.462', 'WEAPON3': '0.900', 'HEALTH': '0.958', 'weapon3': '2.644', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '13.743', 'FRAGCOUNT': '42.000'} [2023-02-24 21:21:38,494][213368] DAMAGECOUNT value on done: 566487.0 [2023-02-24 21:21:38,494][213368] Sum rewards: 37.937, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.770', 'AMMO5': '0.018', 'AMMO2': '0.032', 'AMMO4': '0.161', 'weapon5': '0.184', 'AMMO3': '0.250', 'weapon4': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.388', 'WEAPON3': '1.500', 'HITCOUNT': '2.500', 'weapon3': '2.876', 'DAMAGECOUNT': '11.340', 'FRAGCOUNT': '37.000'} [2023-02-24 21:21:38,497][213382] DAMAGECOUNT value on done: 564364.0 [2023-02-24 21:21:38,498][213382] Sum rewards: 40.375, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.700', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon4': '0.128', 'weapon5': '0.150', 'AMMO3': '0.171', 'weapon2': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.050', 'HITCOUNT': '2.370', 'weapon3': '3.358', 'DAMAGECOUNT': '10.407', 'FRAGCOUNT': '35.000'} [2023-02-24 21:21:38,595][213369] DAMAGECOUNT value on done: 562622.0 [2023-02-24 21:21:38,596][213369] Sum rewards: 40.042, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.304', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon7': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.106', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.512', 'weapon4': '0.930', 'WEAPON3': '1.200', 'weapon3': '2.100', 'HITCOUNT': '2.240', 'DAMAGECOUNT': '10.386', 'FRAGCOUNT': '35.000'} [2023-02-24 21:21:38,779][213368] DAMAGECOUNT value on done: 561687.0 [2023-02-24 21:21:38,779][213368] Sum rewards: 41.903, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.005', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.153', 'weapon5': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.348', 'weapon2': '0.540', 'WEAPON3': '1.000', 'weapon3': '2.412', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '10.728', 'FRAGCOUNT': '36.000'} [2023-02-24 21:21:38,893][213369] DAMAGECOUNT value on done: 554974.0 [2023-02-24 21:21:38,893][213369] Sum rewards: 52.906, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.830', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.178', 'weapon2': '0.230', 'AMMO3': '0.262', 'WEAPON3': '1.500', 'HITCOUNT': '2.930', 'weapon3': '3.274', 'DAMAGECOUNT': '14.430', 'FRAGCOUNT': '48.000'} [2023-02-24 21:21:38,942][213382] DAMAGECOUNT value on done: 552729.0 [2023-02-24 21:21:38,942][213382] Sum rewards: 54.152, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.222', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.044', 'AMMO3': '0.185', 'AMMO4': '0.222', 'weapon5': '0.296', 'weapon2': '0.304', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon4': '0.732', 'WEAPON3': '1.000', 'weapon3': '2.304', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '14.196', 'FRAGCOUNT': '47.000'} [2023-02-24 21:21:39,007][213383] DAMAGECOUNT value on done: 566645.0 [2023-02-24 21:21:39,008][213383] Sum rewards: 47.554, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.920', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'weapon2': '0.326', 'WEAPON3': '0.850', 'weapon4': '1.092', 'weapon3': '2.284', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '10.989', 'FRAGCOUNT': '39.000'} [2023-02-24 21:21:39,079][213368] DAMAGECOUNT value on done: 558552.0 [2023-02-24 21:21:39,080][213368] Sum rewards: 58.423, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.893', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.163', 'weapon5': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.336', 'weapon4': '0.774', 'WEAPON3': '1.050', 'weapon3': '2.532', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.556', 'FRAGCOUNT': '49.000'} [2023-02-24 21:21:39,236][213382] DAMAGECOUNT value on done: 560973.0 [2023-02-24 21:21:39,236][213382] Sum rewards: 44.329, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.489', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.136', 'AMMO3': '0.139', 'weapon5': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.558', 'weapon4': '0.636', 'WEAPON3': '0.900', 'weapon3': '2.346', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '11.715', 'FRAGCOUNT': '38.000'} [2023-02-24 21:21:39,303][213383] DAMAGECOUNT value on done: 561203.0 [2023-02-24 21:21:39,303][213383] Sum rewards: 47.078, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.031', 'AMMO5': '0.015', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.110', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon4': '0.246', 'WEAPON5': '0.400', 'weapon2': '0.462', 'WEAPON3': '1.050', 'HITCOUNT': '2.750', 'weapon3': '2.968', 'DAMAGECOUNT': '11.382', 'FRAGCOUNT': '41.000'} [2023-02-24 21:21:39,306][213365] Updated weights for policy 0, policy_version 35706 (0.0009) [2023-02-24 21:21:39,369][213384] DAMAGECOUNT value on done: 566801.0 [2023-02-24 21:21:39,370][213384] Sum rewards: 37.247, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.394', 'AMMO5': '0.014', 'AMMO2': '0.040', 'AMMO4': '0.201', 'AMMO3': '0.211', 'weapon5': '0.252', 'weapon2': '0.258', 'weapon4': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.390', 'weapon3': '2.924', 'DAMAGECOUNT': '11.406', 'FRAGCOUNT': '34.500'} [2023-02-24 21:21:39,687][213384] DAMAGECOUNT value on done: 550940.0 [2023-02-24 21:21:39,687][213384] Sum rewards: 34.516, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.158', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.102', 'AMMO3': '0.113', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'WEAPON3': '0.700', 'weapon4': '0.788', 'weapon2': '0.936', 'weapon3': '1.768', 'HITCOUNT': '2.330', 'DAMAGECOUNT': '9.291', 'FRAGCOUNT': '28.000'} [2023-02-24 21:21:40,073][213384] DAMAGECOUNT value on done: 563767.0 [2023-02-24 21:21:40,073][213384] Sum rewards: 49.682, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.140', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.116', 'AMMO3': '0.160', 'weapon4': '0.216', 'weapon2': '0.566', 'WEAPON3': '1.000', 'HITCOUNT': '2.860', 'weapon3': '2.910', 'DAMAGECOUNT': '13.008', 'FRAGCOUNT': '40.000'} [2023-02-24 21:21:40,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13870.9). Total num frames: 146264064. Throughput: 0: 3465.5. Samples: 11558054. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 21:21:40,243][213332] Avg episode reward: [(0, '47.150')] [2023-02-24 21:21:40,244][213352] Saving new best policy, reward=47.150! [2023-02-24 21:21:40,385][213384] DAMAGECOUNT value on done: 568270.0 [2023-02-24 21:21:40,385][213384] Sum rewards: 45.071, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.868', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.056', 'AMMO3': '0.172', 'weapon5': '0.274', 'AMMO4': '0.282', 'weapon2': '0.528', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon4': '0.778', 'WEAPON3': '1.000', 'weapon3': '2.034', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '12.339', 'FRAGCOUNT': '40.000'} [2023-02-24 21:21:42,278][213365] Updated weights for policy 0, policy_version 35716 (0.0009) [2023-02-24 21:21:45,211][213365] Updated weights for policy 0, policy_version 35726 (0.0009) [2023-02-24 21:21:45,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13870.9). Total num frames: 146333696. Throughput: 0: 3467.4. Samples: 11578848. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 21:21:45,243][213332] Avg episode reward: [(0, '47.223')] [2023-02-24 21:21:45,246][213352] Saving new best policy, reward=47.223! [2023-02-24 21:21:48,179][213365] Updated weights for policy 0, policy_version 35736 (0.0009) [2023-02-24 21:21:50,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 146399232. Throughput: 0: 3464.2. Samples: 11589204. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 21:21:50,243][213332] Avg episode reward: [(0, '47.223')] [2023-02-24 21:21:51,134][213365] Updated weights for policy 0, policy_version 35746 (0.0009) [2023-02-24 21:21:52,229][213367] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 21:21:54,083][213365] Updated weights for policy 0, policy_version 35756 (0.0009) [2023-02-24 21:21:54,456][213367] DAMAGECOUNT value on done: 564991.0 [2023-02-24 21:21:54,456][213367] Sum rewards: 44.994, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.100', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'weapon4': '0.112', 'AMMO3': '0.156', 'weapon2': '0.640', 'WEAPON3': '1.050', 'HITCOUNT': '2.570', 'weapon3': '3.122', 'DAMAGECOUNT': '10.830', 'FRAGCOUNT': '38.000'} [2023-02-24 21:21:54,682][213367] DAMAGECOUNT value on done: 566861.0 [2023-02-24 21:21:54,682][213367] Sum rewards: 33.507, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.730', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.260', 'AMMO3': '0.284', 'weapon2': '0.622', 'WEAPON3': '1.650', 'HITCOUNT': '2.420', 'weapon3': '2.774', 'DAMAGECOUNT': '10.650', 'FRAGCOUNT': '33.000'} [2023-02-24 21:21:54,763][213367] DAMAGECOUNT value on done: 562412.0 [2023-02-24 21:21:54,763][213367] Sum rewards: 42.288, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.466', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.169', 'weapon5': '0.174', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.488', 'WEAPON3': '1.000', 'HITCOUNT': '2.120', 'weapon3': '2.772', 'DAMAGECOUNT': '10.140', 'FRAGCOUNT': '37.000'} [2023-02-24 21:21:54,986][213367] DAMAGECOUNT value on done: 574400.0 [2023-02-24 21:21:54,987][213367] Sum rewards: 42.871, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.136', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO4': '0.138', 'AMMO3': '0.230', 'weapon2': '0.252', 'weapon4': '0.288', 'WEAPON3': '1.450', 'HITCOUNT': '2.850', 'weapon3': '3.150', 'DAMAGECOUNT': '12.600', 'FRAGCOUNT': '38.000'} [2023-02-24 21:21:55,243][213332] Fps is (10 sec: 13516.5, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 146468864. Throughput: 0: 3466.9. Samples: 11610022. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 21:21:55,244][213332] Avg episode reward: [(0, '47.053')] [2023-02-24 21:21:55,594][213372] DAMAGECOUNT value on done: 581898.0 [2023-02-24 21:21:55,594][213372] Sum rewards: 47.935, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.126', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.138', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.230', 'weapon4': '0.574', 'WEAPON3': '1.100', 'HITCOUNT': '2.610', 'weapon3': '2.840', 'DAMAGECOUNT': '12.606', 'FRAGCOUNT': '41.000'} [2023-02-24 21:21:55,897][213372] DAMAGECOUNT value on done: 572352.0 [2023-02-24 21:21:55,897][213372] Sum rewards: 46.943, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.482', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon2': '0.204', 'weapon4': '0.538', 'WEAPON3': '1.150', 'HITCOUNT': '2.790', 'weapon3': '2.978', 'DAMAGECOUNT': '12.315', 'FRAGCOUNT': '41.000'} [2023-02-24 21:21:55,910][213372] DAMAGECOUNT value on done: 561198.0 [2023-02-24 21:21:55,910][213372] Sum rewards: 44.276, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.662', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'weapon5': '0.078', 'weapon4': '0.114', 'AMMO4': '0.165', 'AMMO3': '0.175', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.850', 'WEAPON3': '0.950', 'weapon3': '2.332', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '11.790', 'FRAGCOUNT': '40.000'} [2023-02-24 21:21:56,208][213372] DAMAGECOUNT value on done: 564266.0 [2023-02-24 21:21:56,209][213372] Sum rewards: 41.018, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.668', 'AMMO2': '0.010', 'AMMO5': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon5': '0.226', 'weapon4': '0.234', 'weapon2': '0.436', 'WEAPON3': '1.350', 'HITCOUNT': '2.340', 'weapon3': '2.860', 'DAMAGECOUNT': '11.355', 'FRAGCOUNT': '37.000'} [2023-02-24 21:21:56,564][213366] DAMAGECOUNT value on done: 559870.0 [2023-02-24 21:21:56,565][213366] Sum rewards: 48.032, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.306', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.034', 'weapon5': '0.150', 'AMMO4': '0.171', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.414', 'weapon4': '0.492', 'WEAPON3': '1.200', 'weapon3': '2.730', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.708', 'FRAGCOUNT': '43.000'} [2023-02-24 21:21:56,857][213366] DAMAGECOUNT value on done: 572127.0 [2023-02-24 21:21:56,858][213366] Sum rewards: 45.236, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.385', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.050', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'WEAPON4': '0.300', 'weapon2': '0.394', 'weapon4': '0.668', 'WEAPON3': '1.150', 'weapon3': '2.684', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.684', 'FRAGCOUNT': '39.000'} [2023-02-24 21:21:56,866][213366] DAMAGECOUNT value on done: 583593.0 [2023-02-24 21:21:56,867][213366] Sum rewards: 47.080, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.688', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.080', 'AMMO4': '0.091', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.258', 'WEAPON3': '0.900', 'weapon2': '1.028', 'weapon3': '2.488', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '11.481', 'FRAGCOUNT': '38.000'} [2023-02-24 21:21:57,052][213365] Updated weights for policy 0, policy_version 35766 (0.0009) [2023-02-24 21:21:57,162][213366] DAMAGECOUNT value on done: 574263.0 [2023-02-24 21:21:57,163][213366] Sum rewards: 71.242, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.906', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.128', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'weapon2': '0.328', 'weapon4': '0.388', 'WEAPON3': '1.100', 'weapon3': '3.032', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '59.000'} [2023-02-24 21:21:57,241][213383] DAMAGECOUNT value on done: 566167.0 [2023-02-24 21:21:57,241][213383] Sum rewards: 48.808, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.575', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.024', 'AMMO4': '0.067', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.212', 'weapon2': '0.330', 'weapon4': '0.502', 'WEAPON3': '1.300', 'HITCOUNT': '2.870', 'weapon3': '2.932', 'DAMAGECOUNT': '13.428', 'FRAGCOUNT': '42.000'} [2023-02-24 21:21:57,393][213369] DAMAGECOUNT value on done: 570567.0 [2023-02-24 21:21:57,394][213369] Sum rewards: 36.021, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.060', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.046', 'AMMO3': '0.185', 'AMMO4': '0.232', 'weapon5': '0.240', 'weapon2': '0.270', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon4': '0.688', 'WEAPON3': '1.150', 'HITCOUNT': '2.140', 'weapon3': '2.448', 'DAMAGECOUNT': '10.254', 'FRAGCOUNT': '33.000'} [2023-02-24 21:21:57,540][213383] DAMAGECOUNT value on done: 565932.0 [2023-02-24 21:21:57,541][213383] Sum rewards: 52.233, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.552', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.144', 'AMMO3': '0.190', 'weapon4': '0.270', 'weapon2': '0.288', 'WEAPON3': '1.150', 'HITCOUNT': '2.940', 'weapon3': '3.084', 'DAMAGECOUNT': '13.758', 'FRAGCOUNT': '43.000'} [2023-02-24 21:21:57,583][213382] DAMAGECOUNT value on done: 571429.0 [2023-02-24 21:21:57,584][213382] Sum rewards: 59.520, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.930', 'AMMO5': '0.019', 'AMMO2': '0.030', 'weapon5': '0.082', 'AMMO4': '0.148', 'AMMO3': '0.195', 'WEAPON4': '0.350', 'weapon2': '0.368', 'WEAPON5': '0.400', 'weapon4': '0.420', 'WEAPON3': '1.200', 'weapon3': '2.936', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '14.532', 'FRAGCOUNT': '50.000'} [2023-02-24 21:21:57,621][213368] DAMAGECOUNT value on done: 562426.0 [2023-02-24 21:21:57,621][213368] Sum rewards: 49.609, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.295', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon2': '0.194', 'weapon4': '0.392', 'WEAPON3': '1.150', 'HITCOUNT': '2.630', 'weapon3': '3.036', 'DAMAGECOUNT': '12.081', 'FRAGCOUNT': '42.000'} [2023-02-24 21:21:57,694][213369] DAMAGECOUNT value on done: 573104.0 [2023-02-24 21:21:57,694][213369] Sum rewards: 35.346, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.565', 'ARMOR': '0.012', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon5': '0.176', 'AMMO3': '0.190', 'AMMO4': '0.210', 'weapon2': '0.328', 'WEAPON5': '0.350', 'weapon4': '0.584', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'HITCOUNT': '2.360', 'weapon3': '2.656', 'DAMAGECOUNT': '10.086', 'FRAGCOUNT': '36.000'} [2023-02-24 21:21:57,888][213382] DAMAGECOUNT value on done: 567922.0 [2023-02-24 21:21:57,889][213382] Sum rewards: 41.042, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.590', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO3': '0.139', 'weapon5': '0.142', 'AMMO4': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.446', 'weapon2': '0.628', 'WEAPON3': '0.900', 'HITCOUNT': '2.540', 'weapon3': '2.570', 'DAMAGECOUNT': '10.674', 'FRAGCOUNT': '35.000'} [2023-02-24 21:21:57,924][213368] DAMAGECOUNT value on done: 569788.0 [2023-02-24 21:21:57,925][213368] Sum rewards: 34.577, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.002', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.023', 'weapon5': '0.108', 'weapon4': '0.112', 'AMMO4': '0.117', 'weapon2': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'WEAPON3': '1.250', 'HITCOUNT': '1.890', 'weapon3': '3.462', 'DAMAGECOUNT': '9.903', 'FRAGCOUNT': '31.000'} [2023-02-24 21:21:57,997][213369] DAMAGECOUNT value on done: 566677.0 [2023-02-24 21:21:57,997][213369] Sum rewards: 43.481, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.760', 'AMMO5': '0.009', 'AMMO2': '0.018', 'weapon4': '0.044', 'weapon5': '0.052', 'AMMO4': '0.088', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.255', 'weapon2': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '2.560', 'weapon3': '3.150', 'DAMAGECOUNT': '12.165', 'FRAGCOUNT': '40.500'} [2023-02-24 21:21:58,193][213368] DAMAGECOUNT value on done: 565902.0 [2023-02-24 21:21:58,193][213368] Sum rewards: 48.803, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.088', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.042', 'AMMO3': '0.138', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'WEAPON4': '0.300', 'weapon2': '0.350', 'ARMOR': '0.455', 'weapon4': '0.476', 'WEAPON3': '0.800', 'HITCOUNT': '2.890', 'weapon3': '2.956', 'DAMAGECOUNT': '12.645', 'FRAGCOUNT': '38.000'} [2023-02-24 21:21:58,301][213369] DAMAGECOUNT value on done: 556593.0 [2023-02-24 21:21:58,301][213369] Sum rewards: 16.868, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.555', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'AMMO4': '0.190', 'weapon2': '0.386', 'WEAPON4': '0.450', 'WEAPON3': '0.700', 'weapon4': '1.036', 'HITCOUNT': '1.220', 'weapon3': '1.740', 'DAMAGECOUNT': '4.857', 'FRAGCOUNT': '15.000'} [2023-02-24 21:21:58,356][213383] DAMAGECOUNT value on done: 570268.0 [2023-02-24 21:21:58,357][213383] Sum rewards: 47.546, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.068', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.024', 'weapon4': '0.026', 'WEAPON4': '0.100', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon2': '0.996', 'WEAPON3': '1.100', 'HITCOUNT': '2.570', 'weapon3': '2.822', 'DAMAGECOUNT': '10.746', 'FRAGCOUNT': '41.000'} [2023-02-24 21:21:58,358][213382] DAMAGECOUNT value on done: 556583.0 [2023-02-24 21:21:58,359][213382] Sum rewards: 39.064, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.095', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon5': '0.182', 'AMMO3': '0.184', 'weapon2': '0.194', 'AMMO4': '0.209', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.720', 'WEAPON3': '1.050', 'weapon3': '2.558', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '11.562', 'FRAGCOUNT': '35.000'} [2023-02-24 21:21:58,491][213368] DAMAGECOUNT value on done: 563032.0 [2023-02-24 21:21:58,492][213368] Sum rewards: 60.234, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.601', 'AMMO5': '0.014', 'AMMO2': '0.017', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'weapon5': '0.124', 'AMMO3': '0.164', 'WEAPON5': '0.300', 'weapon4': '0.338', 'weapon2': '0.372', 'WEAPON3': '1.050', 'HITCOUNT': '2.620', 'weapon3': '2.962', 'DAMAGECOUNT': '13.440', 'FRAGCOUNT': '50.000'} [2023-02-24 21:21:58,653][213383] DAMAGECOUNT value on done: 565972.0 [2023-02-24 21:21:58,654][213383] Sum rewards: 50.611, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.560', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.108', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'weapon4': '0.286', 'WEAPON4': '0.300', 'weapon2': '0.586', 'WEAPON3': '1.150', 'weapon3': '2.758', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.307', 'FRAGCOUNT': '43.000'} [2023-02-24 21:21:58,659][213382] DAMAGECOUNT value on done: 564676.0 [2023-02-24 21:21:58,659][213382] Sum rewards: 42.648, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.264', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'weapon2': '0.336', 'weapon4': '0.546', 'WEAPON3': '0.950', 'HITCOUNT': '2.630', 'weapon3': '2.824', 'DAMAGECOUNT': '11.109', 'FRAGCOUNT': '35.000'} [2023-02-24 21:21:58,800][213384] DAMAGECOUNT value on done: 570816.0 [2023-02-24 21:21:58,800][213384] Sum rewards: 53.596, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.360', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'ARMOR': '0.004', 'AMMO5': '0.007', 'weapon5': '0.018', 'WEAPON4': '0.100', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.248', 'weapon2': '0.362', 'WEAPON3': '0.950', 'HITCOUNT': '2.740', 'weapon3': '3.186', 'DAMAGECOUNT': '12.045', 'FRAGCOUNT': '44.000'} [2023-02-24 21:21:59,099][213384] DAMAGECOUNT value on done: 555773.0 [2023-02-24 21:21:59,099][213384] Sum rewards: 58.499, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.897', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.022', 'weapon5': '0.082', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'WEAPON4': '0.300', 'weapon2': '0.414', 'weapon4': '0.624', 'WEAPON3': '1.000', 'weapon3': '2.714', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '14.499', 'FRAGCOUNT': '48.500'} [2023-02-24 21:21:59,484][213384] DAMAGECOUNT value on done: 567754.0 [2023-02-24 21:21:59,485][213384] Sum rewards: 45.702, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.110', 'AMMO5': '0.003', 'weapon5': '0.018', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'AMMO3': '0.169', 'weapon4': '0.186', 'weapon2': '0.920', 'WEAPON3': '1.050', 'weapon3': '2.716', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '11.961', 'FRAGCOUNT': '38.000'} [2023-02-24 21:21:59,778][213384] DAMAGECOUNT value on done: 571378.0 [2023-02-24 21:21:59,779][213384] Sum rewards: 35.526, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.733', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.094', 'AMMO4': '0.124', 'weapon2': '0.158', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon4': '0.580', 'WEAPON3': '1.100', 'HITCOUNT': '1.910', 'weapon3': '2.914', 'DAMAGECOUNT': '9.324', 'FRAGCOUNT': '32.000'} [2023-02-24 21:22:00,004][213365] Updated weights for policy 0, policy_version 35776 (0.0010) [2023-02-24 21:22:00,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 146538496. Throughput: 0: 3465.0. Samples: 11630820. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 21:22:00,243][213332] Avg episode reward: [(0, '46.778')] [2023-02-24 21:22:02,974][213365] Updated weights for policy 0, policy_version 35786 (0.0009) [2023-02-24 21:22:05,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 146608128. Throughput: 0: 3465.2. Samples: 11641240. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 21:22:05,243][213332] Avg episode reward: [(0, '46.778')] [2023-02-24 21:22:05,945][213365] Updated weights for policy 0, policy_version 35796 (0.0009) [2023-02-24 21:22:08,891][213365] Updated weights for policy 0, policy_version 35806 (0.0009) [2023-02-24 21:22:10,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13858.2, 300 sec: 13857.0). Total num frames: 146677760. Throughput: 0: 3461.1. Samples: 11661998. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 21:22:10,243][213332] Avg episode reward: [(0, '46.778')] [2023-02-24 21:22:11,828][213365] Updated weights for policy 0, policy_version 35816 (0.0008) [2023-02-24 21:22:12,909][213368] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 21:22:13,849][213367] DAMAGECOUNT value on done: 569504.0 [2023-02-24 21:22:13,850][213367] Sum rewards: 49.269, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.878', 'AMMO2': '0.003', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.013', 'weapon5': '0.014', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.128', 'AMMO3': '0.195', 'weapon2': '0.434', 'WEAPON3': '1.250', 'HITCOUNT': '3.180', 'weapon3': '3.230', 'DAMAGECOUNT': '13.539', 'FRAGCOUNT': '41.000'} [2023-02-24 21:22:14,079][213367] DAMAGECOUNT value on done: 571288.0 [2023-02-24 21:22:14,079][213367] Sum rewards: 41.300, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.529', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.052', 'AMMO3': '0.164', 'AMMO4': '0.260', 'weapon5': '0.294', 'weapon4': '0.406', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.472', 'WEAPON3': '0.900', 'HITCOUNT': '2.320', 'weapon3': '2.504', 'DAMAGECOUNT': '13.281', 'FRAGCOUNT': '36.000'} [2023-02-24 21:22:14,156][213367] DAMAGECOUNT value on done: 567150.0 [2023-02-24 21:22:14,157][213367] Sum rewards: 46.462, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.644', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.022', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.112', 'AMMO3': '0.244', 'weapon2': '0.260', 'WEAPON4': '0.300', 'weapon4': '0.512', 'WEAPON3': '1.500', 'weapon3': '2.922', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.181', 'FRAGCOUNT': '43.000'} [2023-02-24 21:22:14,382][213367] DAMAGECOUNT value on done: 578790.0 [2023-02-24 21:22:14,382][213367] Sum rewards: 51.816, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.150', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.134', 'AMMO3': '0.162', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.384', 'weapon4': '0.530', 'WEAPON3': '1.000', 'weapon3': '2.698', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.170', 'FRAGCOUNT': '44.000'} [2023-02-24 21:22:14,812][213365] Updated weights for policy 0, policy_version 35826 (0.0009) [2023-02-24 21:22:14,992][213372] DAMAGECOUNT value on done: 586743.0 [2023-02-24 21:22:14,993][213372] Sum rewards: 53.676, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.301', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.112', 'weapon2': '0.126', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.398', 'WEAPON3': '1.150', 'HITCOUNT': '2.930', 'weapon3': '3.150', 'DAMAGECOUNT': '14.535', 'FRAGCOUNT': '46.000'} [2023-02-24 21:22:15,243][213332] Fps is (10 sec: 13926.6, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 146747392. Throughput: 0: 3463.4. Samples: 11682818. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 21:22:15,243][213332] Avg episode reward: [(0, '46.738')] [2023-02-24 21:22:15,272][213372] DAMAGECOUNT value on done: 566250.0 [2023-02-24 21:22:15,273][213372] Sum rewards: 58.801, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.520', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon5': '0.110', 'AMMO4': '0.111', 'AMMO3': '0.219', 'weapon2': '0.372', 'WEAPON3': '1.400', 'HITCOUNT': '3.170', 'weapon3': '3.358', 'DAMAGECOUNT': '15.156', 'FRAGCOUNT': '50.000'} [2023-02-24 21:22:15,291][213372] DAMAGECOUNT value on done: 576486.0 [2023-02-24 21:22:15,291][213372] Sum rewards: 47.237, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.194', 'AMMO5': '0.026', 'AMMO2': '0.032', 'weapon4': '0.078', 'AMMO4': '0.161', 'AMMO3': '0.203', 'weapon5': '0.308', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon2': '0.630', 'WEAPON3': '1.300', 'HITCOUNT': '2.710', 'weapon3': '2.730', 'DAMAGECOUNT': '12.402', 'FRAGCOUNT': '42.500'} [2023-02-24 21:22:15,574][213372] DAMAGECOUNT value on done: 568084.0 [2023-02-24 21:22:15,574][213372] Sum rewards: 45.158, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.802', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon5': '0.148', 'AMMO4': '0.155', 'AMMO3': '0.156', 'weapon2': '0.388', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.604', 'WEAPON3': '0.900', 'HITCOUNT': '2.490', 'weapon3': '2.560', 'DAMAGECOUNT': '11.454', 'FRAGCOUNT': '39.000'} [2023-02-24 21:22:15,628][213366] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 21:22:15,886][213366] DAMAGECOUNT value on done: 563875.0 [2023-02-24 21:22:15,887][213366] Sum rewards: 43.854, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.367', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.114', 'AMMO3': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.370', 'weapon4': '0.640', 'WEAPON3': '1.100', 'weapon3': '2.514', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.015', 'FRAGCOUNT': '39.000'} [2023-02-24 21:22:16,188][213366] DAMAGECOUNT value on done: 588111.0 [2023-02-24 21:22:16,188][213366] Sum rewards: 48.233, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.265', 'AMMO5': '0.014', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon2': '0.154', 'weapon4': '0.180', 'AMMO3': '0.212', 'weapon5': '0.212', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.870', 'weapon3': '3.180', 'DAMAGECOUNT': '13.497', 'FRAGCOUNT': '43.000'} [2023-02-24 21:22:16,201][213366] DAMAGECOUNT value on done: 576551.0 [2023-02-24 21:22:16,201][213366] Sum rewards: 57.136, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.760', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'weapon5': '0.194', 'WEAPON5': '0.200', 'weapon4': '0.362', 'weapon2': '0.578', 'WEAPON3': '1.000', 'weapon3': '2.640', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.272', 'FRAGCOUNT': '47.000'} [2023-02-24 21:22:16,497][213366] DAMAGECOUNT value on done: 578373.0 [2023-02-24 21:22:16,497][213366] Sum rewards: 46.993, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.684', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.052', 'AMMO3': '0.157', 'weapon5': '0.176', 'AMMO4': '0.262', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.782', 'WEAPON3': '0.950', 'weapon3': '2.516', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.330', 'FRAGCOUNT': '41.000'} [2023-02-24 21:22:16,523][213383] DAMAGECOUNT value on done: 570486.0 [2023-02-24 21:22:16,523][213383] Sum rewards: 43.961, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.790', 'AMMO5': '0.023', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.198', 'weapon5': '0.276', 'WEAPON4': '0.300', 'weapon2': '0.304', 'weapon4': '0.348', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.650', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.957', 'FRAGCOUNT': '39.000'} [2023-02-24 21:22:16,786][213369] DAMAGECOUNT value on done: 575055.0 [2023-02-24 21:22:16,786][213369] Sum rewards: 53.342, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.693', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO5': '0.014', 'AMMO4': '0.041', 'weapon4': '0.094', 'WEAPON4': '0.100', 'weapon5': '0.134', 'AMMO3': '0.206', 'WEAPON5': '0.300', 'weapon2': '0.444', 'WEAPON3': '1.300', 'HITCOUNT': '2.550', 'weapon3': '3.126', 'DAMAGECOUNT': '13.464', 'FRAGCOUNT': '46.000'} [2023-02-24 21:22:16,821][213383] DAMAGECOUNT value on done: 569477.0 [2023-02-24 21:22:16,822][213383] Sum rewards: 40.628, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.852', 'ARMOR': '0.004', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.037', 'AMMO3': '0.166', 'AMMO4': '0.186', 'weapon5': '0.206', 'WEAPON4': '0.350', 'weapon4': '0.410', 'weapon2': '0.444', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'HITCOUNT': '2.380', 'weapon3': '2.476', 'DAMAGECOUNT': '10.635', 'FRAGCOUNT': '34.000'} [2023-02-24 21:22:17,032][213368] DAMAGECOUNT value on done: 565139.0 [2023-02-24 21:22:17,033][213368] Sum rewards: 23.926, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.106', 'AMMO5': '0.019', 'AMMO2': '0.041', 'weapon5': '0.134', 'AMMO3': '0.138', 'AMMO4': '0.204', 'weapon2': '0.302', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '0.850', 'weapon4': '1.176', 'HITCOUNT': '1.810', 'weapon3': '1.934', 'DAMAGECOUNT': '8.124', 'FRAGCOUNT': '23.000'} [2023-02-24 21:22:17,037][213382] DAMAGECOUNT value on done: 575756.0 [2023-02-24 21:22:17,038][213382] Sum rewards: 49.012, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.936', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO3': '0.187', 'AMMO4': '0.227', 'weapon5': '0.228', 'WEAPON5': '0.400', 'weapon4': '0.414', 'weapon2': '0.444', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.632', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.981', 'FRAGCOUNT': '44.000'} [2023-02-24 21:22:17,096][213369] DAMAGECOUNT value on done: 577259.0 [2023-02-24 21:22:17,097][213369] Sum rewards: 43.598, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.227', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.162', 'AMMO4': '0.174', 'weapon2': '0.188', 'AMMO3': '0.191', 'WEAPON5': '0.300', 'weapon4': '0.364', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.470', 'weapon3': '3.010', 'DAMAGECOUNT': '12.465', 'FRAGCOUNT': '40.000'} [2023-02-24 21:22:17,337][213368] DAMAGECOUNT value on done: 573624.0 [2023-02-24 21:22:17,337][213368] Sum rewards: 43.008, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.162', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.048', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon2': '0.254', 'WEAPON4': '0.300', 'weapon4': '0.854', 'WEAPON3': '1.150', 'weapon3': '2.552', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '11.508', 'FRAGCOUNT': '39.000'} [2023-02-24 21:22:17,341][213382] DAMAGECOUNT value on done: 572557.0 [2023-02-24 21:22:17,341][213382] Sum rewards: 59.031, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.524', 'AMMO2': '0.011', 'AMMO5': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'weapon4': '0.088', 'AMMO3': '0.155', 'weapon5': '0.170', 'WEAPON5': '0.250', 'weapon2': '0.440', 'WEAPON3': '1.000', 'HITCOUNT': '2.870', 'weapon3': '3.050', 'DAMAGECOUNT': '13.905', 'FRAGCOUNT': '48.000'} [2023-02-24 21:22:17,400][213369] DAMAGECOUNT value on done: 571352.0 [2023-02-24 21:22:17,400][213369] Sum rewards: 46.138, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.992', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.038', 'weapon5': '0.144', 'AMMO4': '0.189', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'weapon4': '0.326', 'WEAPON4': '0.400', 'weapon2': '0.474', 'WEAPON3': '1.150', 'weapon3': '2.702', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '14.025', 'FRAGCOUNT': '38.000'} [2023-02-24 21:22:17,619][213368] DAMAGECOUNT value on done: 569650.0 [2023-02-24 21:22:17,620][213368] Sum rewards: 38.819, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.904', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.042', 'AMMO3': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.202', 'AMMO4': '0.209', 'weapon2': '0.332', 'WEAPON4': '0.500', 'weapon4': '0.840', 'WEAPON3': '0.950', 'weapon3': '2.272', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '11.244', 'FRAGCOUNT': '34.000'} [2023-02-24 21:22:17,668][213383] DAMAGECOUNT value on done: 572615.0 [2023-02-24 21:22:17,668][213383] Sum rewards: 25.013, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.929', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.109', 'AMMO3': '0.115', 'weapon5': '0.120', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.374', 'ARMOR': '0.452', 'WEAPON3': '0.800', 'weapon2': '0.938', 'HITCOUNT': '1.710', 'weapon3': '1.752', 'DAMAGECOUNT': '7.041', 'FRAGCOUNT': '22.000'} [2023-02-24 21:22:17,698][213369] DAMAGECOUNT value on done: 560870.0 [2023-02-24 21:22:17,699][213369] Sum rewards: 46.250, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.976', 'AMMO5': '0.020', 'AMMO2': '0.042', 'AMMO3': '0.201', 'AMMO4': '0.210', 'weapon5': '0.276', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.708', 'WEAPON3': '1.100', 'weapon3': '2.358', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '12.831', 'FRAGCOUNT': '40.000'} [2023-02-24 21:22:17,774][213365] Updated weights for policy 0, policy_version 35836 (0.0009) [2023-02-24 21:22:17,814][213382] DAMAGECOUNT value on done: 562182.0 [2023-02-24 21:22:17,814][213382] Sum rewards: 67.338, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.663', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon4': '0.138', 'weapon5': '0.164', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.390', 'WEAPON3': '1.050', 'weapon3': '3.048', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '56.000'} [2023-02-24 21:22:17,911][213368] DAMAGECOUNT value on done: 567441.0 [2023-02-24 21:22:17,912][213368] Sum rewards: 42.380, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.952', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon5': '0.176', 'AMMO3': '0.197', 'weapon2': '0.308', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'ARMOR': '0.404', 'weapon4': '0.520', 'WEAPON3': '1.200', 'HITCOUNT': '2.600', 'weapon3': '2.742', 'DAMAGECOUNT': '13.227', 'FRAGCOUNT': '38.000'} [2023-02-24 21:22:17,972][213383] DAMAGECOUNT value on done: 569799.0 [2023-02-24 21:22:17,972][213383] Sum rewards: 43.955, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.560', 'ARMOR': '0.004', 'AMMO5': '0.026', 'AMMO2': '0.046', 'AMMO3': '0.190', 'AMMO4': '0.231', 'weapon5': '0.314', 'weapon2': '0.354', 'WEAPON4': '0.500', 'weapon4': '0.522', 'WEAPON5': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.476', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '11.361', 'FRAGCOUNT': '41.000'} [2023-02-24 21:22:18,111][213382] DAMAGECOUNT value on done: 569518.0 [2023-02-24 21:22:18,111][213382] Sum rewards: 54.074, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.330', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon5': '0.052', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'weapon4': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.331', 'weapon2': '0.394', 'WEAPON3': '1.800', 'weapon3': '3.060', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.526', 'FRAGCOUNT': '52.000'} [2023-02-24 21:22:18,206][213384] DAMAGECOUNT value on done: 575723.0 [2023-02-24 21:22:18,207][213384] Sum rewards: 57.428, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.602', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.054', 'weapon5': '0.070', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'weapon2': '0.368', 'weapon4': '0.418', 'WEAPON3': '1.100', 'weapon3': '2.966', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.721', 'FRAGCOUNT': '46.000'} [2023-02-24 21:22:18,502][213384] DAMAGECOUNT value on done: 559615.0 [2023-02-24 21:22:18,503][213384] Sum rewards: 45.138, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.772', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'ARMOR': '0.404', 'weapon2': '0.504', 'weapon4': '0.610', 'WEAPON3': '1.000', 'weapon3': '2.580', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '11.526', 'FRAGCOUNT': '38.000'} [2023-02-24 21:22:18,883][213384] DAMAGECOUNT value on done: 571406.0 [2023-02-24 21:22:18,884][213384] Sum rewards: 41.280, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.980', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.072', 'AMMO4': '0.117', 'AMMO3': '0.151', 'WEAPON5': '0.200', 'weapon2': '0.380', 'WEAPON4': '0.400', 'weapon4': '0.426', 'WEAPON3': '0.950', 'HITCOUNT': '2.640', 'weapon3': '2.938', 'DAMAGECOUNT': '10.956', 'FRAGCOUNT': '36.000'} [2023-02-24 21:22:19,181][213384] DAMAGECOUNT value on done: 575114.0 [2023-02-24 21:22:19,182][213384] Sum rewards: 48.933, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.132', 'AMMO5': '0.011', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.138', 'weapon5': '0.162', 'WEAPON4': '0.200', 'weapon4': '0.276', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'weapon2': '0.824', 'weapon3': '2.646', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '11.208', 'FRAGCOUNT': '39.500'} [2023-02-24 21:22:20,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 146817024. Throughput: 0: 3462.6. Samples: 11693144. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-24 21:22:20,243][213332] Avg episode reward: [(0, '46.315')] [2023-02-24 21:22:20,717][213365] Updated weights for policy 0, policy_version 35846 (0.0009) [2023-02-24 21:22:23,665][213365] Updated weights for policy 0, policy_version 35856 (0.0008) [2023-02-24 21:22:25,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 146886656. Throughput: 0: 3465.6. Samples: 11714008. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:22:25,243][213332] Avg episode reward: [(0, '46.315')] [2023-02-24 21:22:26,607][213365] Updated weights for policy 0, policy_version 35866 (0.0009) [2023-02-24 21:22:29,580][213365] Updated weights for policy 0, policy_version 35876 (0.0009) [2023-02-24 21:22:30,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 146956288. Throughput: 0: 3466.3. Samples: 11734830. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:22:30,243][213332] Avg episode reward: [(0, '46.315')] [2023-02-24 21:22:32,536][213365] Updated weights for policy 0, policy_version 35886 (0.0009) [2023-02-24 21:22:33,208][213367] DAMAGECOUNT value on done: 574030.0 [2023-02-24 21:22:33,208][213367] Sum rewards: 52.632, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.705', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.174', 'AMMO3': '0.178', 'weapon5': '0.198', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.456', 'weapon2': '0.466', 'WEAPON3': '1.100', 'weapon3': '2.582', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.578', 'FRAGCOUNT': '45.000'} [2023-02-24 21:22:33,513][213367] DAMAGECOUNT value on done: 571921.0 [2023-02-24 21:22:33,514][213367] Sum rewards: 55.830, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.818', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.218', 'WEAPON4': '0.250', 'weapon4': '0.480', 'WEAPON3': '1.200', 'weapon3': '2.874', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.313', 'FRAGCOUNT': '48.000'} [2023-02-24 21:22:33,526][213367] DAMAGECOUNT value on done: 574747.0 [2023-02-24 21:22:33,527][213367] Sum rewards: 35.888, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.010', 'HEALTH': '0.030', 'AMMO2': '0.047', 'AMMO3': '0.134', 'weapon5': '0.196', 'AMMO4': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.452', 'weapon4': '0.740', 'WEAPON3': '0.800', 'weapon3': '1.826', 'HITCOUNT': '2.190', 'DAMAGECOUNT': '10.377', 'FRAGCOUNT': '31.000'} [2023-02-24 21:22:33,837][213367] DAMAGECOUNT value on done: 583610.0 [2023-02-24 21:22:33,838][213367] Sum rewards: 55.401, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.070', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon2': '0.604', 'WEAPON3': '1.200', 'weapon3': '3.100', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.460', 'FRAGCOUNT': '45.000'} [2023-02-24 21:22:34,414][213372] DAMAGECOUNT value on done: 591182.0 [2023-02-24 21:22:34,415][213372] Sum rewards: 47.977, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.690', 'AMMO5': '0.025', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon4': '0.194', 'weapon2': '0.214', 'AMMO3': '0.220', 'weapon5': '0.224', 'WEAPON4': '0.350', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'HITCOUNT': '2.820', 'weapon3': '3.054', 'DAMAGECOUNT': '13.317', 'FRAGCOUNT': '44.000'} [2023-02-24 21:22:34,678][213372] DAMAGECOUNT value on done: 571179.0 [2023-02-24 21:22:34,679][213372] Sum rewards: 57.622, reward structure: {'DEATHCOUNT': '-15.000', 'ARMOR': '0.004', 'HEALTH': '0.007', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon2': '0.150', 'weapon4': '0.152', 'AMMO3': '0.200', 'weapon5': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '2.970', 'weapon3': '3.232', 'DAMAGECOUNT': '14.787', 'FRAGCOUNT': '49.000'} [2023-02-24 21:22:34,726][213372] DAMAGECOUNT value on done: 580875.0 [2023-02-24 21:22:34,727][213372] Sum rewards: 47.064, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.040', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.110', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'weapon4': '0.388', 'weapon2': '0.616', 'WEAPON3': '1.000', 'weapon3': '2.534', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.167', 'FRAGCOUNT': '37.500'} [2023-02-24 21:22:34,997][213372] DAMAGECOUNT value on done: 571725.0 [2023-02-24 21:22:34,998][213372] Sum rewards: 35.367, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.829', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.074', 'WEAPON4': '0.100', 'weapon4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.786', 'WEAPON3': '1.200', 'HITCOUNT': '2.520', 'weapon3': '2.776', 'DAMAGECOUNT': '10.923', 'FRAGCOUNT': '31.000'} [2023-02-24 21:22:35,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 147025920. Throughput: 0: 3466.1. Samples: 11745178. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:22:35,243][213332] Avg episode reward: [(0, '46.384')] [2023-02-24 21:22:35,284][213366] DAMAGECOUNT value on done: 567735.0 [2023-02-24 21:22:35,285][213366] Sum rewards: 46.272, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.400', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'weapon4': '0.032', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.242', 'weapon2': '0.342', 'WEAPON3': '1.600', 'HITCOUNT': '2.840', 'weapon3': '3.408', 'DAMAGECOUNT': '11.580', 'FRAGCOUNT': '43.000'} [2023-02-24 21:22:35,515][213365] Updated weights for policy 0, policy_version 35896 (0.0009) [2023-02-24 21:22:35,578][213366] DAMAGECOUNT value on done: 581010.0 [2023-02-24 21:22:35,579][213366] Sum rewards: 47.018, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.540', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.132', 'AMMO3': '0.199', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.474', 'weapon4': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.560', 'weapon3': '2.654', 'DAMAGECOUNT': '13.377', 'FRAGCOUNT': '40.000'} [2023-02-24 21:22:35,597][213366] DAMAGECOUNT value on done: 593359.0 [2023-02-24 21:22:35,597][213366] Sum rewards: 61.589, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.518', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO4': '0.185', 'weapon5': '0.220', 'weapon2': '0.236', 'AMMO3': '0.247', 'weapon4': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '2.954', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.444', 'FRAGCOUNT': '55.000'} [2023-02-24 21:22:35,898][213366] DAMAGECOUNT value on done: 583677.0 [2023-02-24 21:22:35,899][213366] Sum rewards: 58.774, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.436', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.034', 'AMMO4': '0.110', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.266', 'weapon2': '0.512', 'WEAPON3': '1.650', 'weapon3': '3.072', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.912', 'FRAGCOUNT': '54.000'} [2023-02-24 21:22:35,959][213383] DAMAGECOUNT value on done: 575413.0 [2023-02-24 21:22:35,960][213383] Sum rewards: 51.358, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.343', 'ARMOR': '0.004', 'AMMO5': '0.028', 'AMMO2': '0.059', 'AMMO3': '0.178', 'weapon2': '0.284', 'AMMO4': '0.293', 'weapon5': '0.370', 'weapon4': '0.602', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.372', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '14.781', 'FRAGCOUNT': '46.000'} [2023-02-24 21:22:36,176][213369] DAMAGECOUNT value on done: 578941.0 [2023-02-24 21:22:36,176][213369] Sum rewards: 40.052, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.980', 'AMMO5': '0.014', 'AMMO2': '0.036', 'AMMO3': '0.156', 'AMMO4': '0.178', 'weapon5': '0.180', 'weapon4': '0.208', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'weapon2': '1.066', 'weapon3': '2.306', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '11.658', 'FRAGCOUNT': '34.000'} [2023-02-24 21:22:36,252][213383] DAMAGECOUNT value on done: 573448.0 [2023-02-24 21:22:36,253][213383] Sum rewards: 47.762, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.462', 'AMMO5': '0.016', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'weapon5': '0.254', 'weapon4': '0.308', 'WEAPON5': '0.350', 'weapon2': '0.668', 'WEAPON3': '1.000', 'weapon3': '2.532', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '11.757', 'FRAGCOUNT': '40.000'} [2023-02-24 21:22:36,321][213368] DAMAGECOUNT value on done: 569623.0 [2023-02-24 21:22:36,322][213368] Sum rewards: 44.221, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.758', 'AMMO5': '0.007', 'AMMO2': '0.018', 'ARMOR': '0.024', 'AMMO4': '0.087', 'weapon4': '0.106', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.273', 'weapon2': '0.674', 'WEAPON3': '1.600', 'HITCOUNT': '2.740', 'weapon3': '2.762', 'DAMAGECOUNT': '13.452', 'FRAGCOUNT': '42.000'} [2023-02-24 21:22:36,408][213382] DAMAGECOUNT value on done: 579941.0 [2023-02-24 21:22:36,409][213382] Sum rewards: 49.906, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.322', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.017', 'weapon5': '0.038', 'WEAPON4': '0.100', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'weapon4': '0.258', 'weapon2': '0.770', 'WEAPON3': '1.000', 'weapon3': '2.614', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.555', 'FRAGCOUNT': '42.000'} [2023-02-24 21:22:36,465][213369] DAMAGECOUNT value on done: 581711.0 [2023-02-24 21:22:36,465][213369] Sum rewards: 58.193, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.593', 'AMMO2': '0.013', 'AMMO5': '0.014', 'weapon4': '0.054', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'weapon5': '0.128', 'AMMO3': '0.187', 'WEAPON5': '0.250', 'weapon2': '0.464', 'WEAPON3': '1.200', 'HITCOUNT': '2.830', 'weapon3': '3.126', 'DAMAGECOUNT': '13.356', 'FRAGCOUNT': '50.000'} [2023-02-24 21:22:36,612][213368] DAMAGECOUNT value on done: 577299.0 [2023-02-24 21:22:36,613][213368] Sum rewards: 37.130, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.654', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.160', 'WEAPON4': '0.200', 'weapon4': '0.202', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.300', 'HITCOUNT': '2.420', 'weapon3': '3.044', 'DAMAGECOUNT': '11.025', 'FRAGCOUNT': '33.000'} [2023-02-24 21:22:36,705][213382] DAMAGECOUNT value on done: 577631.0 [2023-02-24 21:22:36,705][213382] Sum rewards: 47.275, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.930', 'AMMO5': '0.014', 'AMMO2': '0.049', 'AMMO3': '0.220', 'weapon5': '0.238', 'AMMO4': '0.243', 'weapon2': '0.256', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.886', 'WEAPON3': '1.350', 'weapon3': '2.306', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.222', 'FRAGCOUNT': '42.000'} [2023-02-24 21:22:36,782][213369] DAMAGECOUNT value on done: 576383.0 [2023-02-24 21:22:36,782][213369] Sum rewards: 53.005, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.008', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.072', 'weapon5': '0.162', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.362', 'weapon4': '0.554', 'WEAPON3': '1.100', 'weapon3': '2.554', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '15.093', 'FRAGCOUNT': '44.000'} [2023-02-24 21:22:36,894][213368] DAMAGECOUNT value on done: 573555.0 [2023-02-24 21:22:36,895][213368] Sum rewards: 42.633, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.365', 'AMMO5': '0.013', 'AMMO2': '0.018', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'weapon5': '0.176', 'AMMO3': '0.201', 'weapon2': '0.246', 'WEAPON5': '0.300', 'weapon4': '0.316', 'WEAPON3': '1.300', 'HITCOUNT': '2.730', 'weapon3': '2.990', 'DAMAGECOUNT': '11.715', 'FRAGCOUNT': '37.500'} [2023-02-24 21:22:37,078][213383] DAMAGECOUNT value on done: 577442.0 [2023-02-24 21:22:37,079][213383] Sum rewards: 53.101, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.309', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.170', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.574', 'weapon4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.312', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.481', 'FRAGCOUNT': '44.000'} [2023-02-24 21:22:37,079][213369] DAMAGECOUNT value on done: 565481.0 [2023-02-24 21:22:37,080][213369] Sum rewards: 49.521, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.536', 'AMMO5': '0.024', 'AMMO2': '0.043', 'AMMO3': '0.173', 'AMMO4': '0.216', 'weapon5': '0.292', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.506', 'weapon4': '0.518', 'WEAPON3': '1.050', 'weapon3': '2.402', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.833', 'FRAGCOUNT': '43.000'} [2023-02-24 21:22:37,155][213382] DAMAGECOUNT value on done: 567020.0 [2023-02-24 21:22:37,155][213382] Sum rewards: 55.258, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.180', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon5': '0.092', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon4': '0.202', 'weapon2': '0.506', 'WEAPON3': '1.150', 'HITCOUNT': '2.770', 'weapon3': '3.014', 'DAMAGECOUNT': '14.514', 'FRAGCOUNT': '47.000'} [2023-02-24 21:22:37,193][213368] DAMAGECOUNT value on done: 572557.0 [2023-02-24 21:22:37,194][213368] Sum rewards: 56.541, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.660', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.042', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon5': '0.178', 'WEAPON4': '0.200', 'weapon4': '0.438', 'weapon2': '0.460', 'WEAPON3': '1.000', 'weapon3': '2.524', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.348', 'FRAGCOUNT': '47.000'} [2023-02-24 21:22:37,367][213383] DAMAGECOUNT value on done: 574507.0 [2023-02-24 21:22:37,367][213383] Sum rewards: 55.792, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.362', 'AMMO5': '0.011', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon4': '0.130', 'weapon5': '0.140', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.200', 'HITCOUNT': '2.890', 'weapon3': '3.142', 'DAMAGECOUNT': '14.124', 'FRAGCOUNT': '48.000'} [2023-02-24 21:22:37,446][213382] DAMAGECOUNT value on done: 573796.0 [2023-02-24 21:22:37,446][213382] Sum rewards: 47.335, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.095', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.164', 'weapon5': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.280', 'weapon2': '0.610', 'WEAPON3': '1.000', 'weapon3': '2.638', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.834', 'FRAGCOUNT': '38.500'} [2023-02-24 21:22:37,547][213384] DAMAGECOUNT value on done: 579954.0 [2023-02-24 21:22:37,548][213384] Sum rewards: 46.742, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.195', 'AMMO2': '0.015', 'AMMO5': '0.016', 'AMMO4': '0.074', 'weapon4': '0.134', 'WEAPON4': '0.150', 'weapon5': '0.190', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'weapon2': '0.538', 'WEAPON3': '1.450', 'HITCOUNT': '2.560', 'weapon3': '2.888', 'DAMAGECOUNT': '12.693', 'FRAGCOUNT': '43.000'} [2023-02-24 21:22:37,841][213384] DAMAGECOUNT value on done: 563292.0 [2023-02-24 21:22:37,841][213384] Sum rewards: 44.555, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.248', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO3': '0.121', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon5': '0.252', 'weapon4': '0.470', 'weapon2': '0.708', 'WEAPON3': '0.750', 'weapon3': '2.256', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '11.031', 'FRAGCOUNT': '35.000'} [2023-02-24 21:22:38,267][213384] DAMAGECOUNT value on done: 575864.0 [2023-02-24 21:22:38,267][213384] Sum rewards: 54.978, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.431', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.013', 'weapon4': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.130', 'AMMO3': '0.179', 'weapon2': '0.534', 'WEAPON3': '1.150', 'HITCOUNT': '2.960', 'weapon3': '3.142', 'DAMAGECOUNT': '13.374', 'FRAGCOUNT': '46.000'} [2023-02-24 21:22:38,449][213365] Updated weights for policy 0, policy_version 35906 (0.0009) [2023-02-24 21:22:38,566][213384] DAMAGECOUNT value on done: 579140.0 [2023-02-24 21:22:38,566][213384] Sum rewards: 40.522, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.415', 'AMMO5': '0.006', 'AMMO2': '0.040', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'AMMO4': '0.198', 'weapon2': '0.256', 'WEAPON4': '0.550', 'weapon4': '0.928', 'WEAPON3': '1.000', 'weapon3': '2.562', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '11.823', 'FRAGCOUNT': '36.000'} [2023-02-24 21:22:40,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 147095552. Throughput: 0: 3467.0. Samples: 11766038. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:22:40,243][213332] Avg episode reward: [(0, '47.022')] [2023-02-24 21:22:41,390][213365] Updated weights for policy 0, policy_version 35916 (0.0009) [2023-02-24 21:22:44,338][213365] Updated weights for policy 0, policy_version 35926 (0.0009) [2023-02-24 21:22:45,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 147165184. Throughput: 0: 3468.6. Samples: 11786908. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:22:45,243][213332] Avg episode reward: [(0, '47.022')] [2023-02-24 21:22:45,247][213352] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000035929_147165184.pth... [2023-02-24 21:22:45,302][213352] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000035117_143839232.pth [2023-02-24 21:22:47,304][213365] Updated weights for policy 0, policy_version 35936 (0.0009) [2023-02-24 21:22:50,214][213365] Updated weights for policy 0, policy_version 35946 (0.0009) [2023-02-24 21:22:50,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13926.4, 300 sec: 13870.9). Total num frames: 147234816. Throughput: 0: 3466.4. Samples: 11797230. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:22:50,243][213332] Avg episode reward: [(0, '47.022')] [2023-02-24 21:22:52,546][213367] DAMAGECOUNT value on done: 578476.0 [2023-02-24 21:22:52,546][213367] Sum rewards: 47.259, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.369', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO4': '0.172', 'AMMO3': '0.175', 'weapon2': '0.332', 'weapon5': '0.370', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.442', 'WEAPON3': '1.000', 'weapon3': '2.506', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '13.338', 'FRAGCOUNT': '41.000'} [2023-02-24 21:22:52,849][213367] DAMAGECOUNT value on done: 577407.0 [2023-02-24 21:22:52,850][213367] Sum rewards: 62.801, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.329', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO3': '0.138', 'AMMO4': '0.156', 'weapon5': '0.194', 'WEAPON5': '0.300', 'weapon2': '0.340', 'weapon4': '0.364', 'WEAPON4': '0.400', 'WEAPON3': '0.850', 'weapon3': '2.880', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '50.000'} [2023-02-24 21:22:52,862][213367] DAMAGECOUNT value on done: 578604.0 [2023-02-24 21:22:52,862][213367] Sum rewards: 40.875, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.832', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon5': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'weapon4': '0.530', 'weapon2': '0.654', 'WEAPON3': '1.250', 'weapon3': '2.426', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '11.571', 'FRAGCOUNT': '37.000'} [2023-02-24 21:22:53,147][213365] Updated weights for policy 0, policy_version 35956 (0.0009) [2023-02-24 21:22:53,162][213367] DAMAGECOUNT value on done: 587282.0 [2023-02-24 21:22:53,163][213367] Sum rewards: 43.113, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.092', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon4': '0.342', 'weapon2': '0.458', 'WEAPON3': '1.000', 'HITCOUNT': '2.320', 'weapon3': '2.900', 'DAMAGECOUNT': '11.016', 'FRAGCOUNT': '38.000'} [2023-02-24 21:22:53,808][213372] DAMAGECOUNT value on done: 596537.0 [2023-02-24 21:22:53,808][213372] Sum rewards: 61.826, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.316', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO3': '0.183', 'AMMO4': '0.216', 'weapon5': '0.270', 'weapon4': '0.338', 'weapon2': '0.394', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.626', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.065', 'FRAGCOUNT': '53.000'} [2023-02-24 21:22:54,095][213372] DAMAGECOUNT value on done: 575964.0 [2023-02-24 21:22:54,095][213372] Sum rewards: 59.793, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.448', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.214', 'weapon2': '0.334', 'ARMOR': '0.400', 'weapon4': '0.528', 'WEAPON3': '1.350', 'weapon3': '2.736', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.355', 'FRAGCOUNT': '52.000'} [2023-02-24 21:22:54,115][213372] DAMAGECOUNT value on done: 584975.0 [2023-02-24 21:22:54,115][213372] Sum rewards: 48.539, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.740', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.094', 'AMMO3': '0.160', 'WEAPON4': '0.250', 'weapon2': '0.294', 'weapon4': '0.832', 'WEAPON3': '1.100', 'weapon3': '2.592', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.300', 'FRAGCOUNT': '42.000'} [2023-02-24 21:22:54,406][213372] DAMAGECOUNT value on done: 575963.0 [2023-02-24 21:22:54,406][213372] Sum rewards: 48.336, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.766', 'AMMO5': '0.017', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.242', 'weapon5': '0.242', 'weapon2': '0.252', 'WEAPON4': '0.300', 'weapon4': '0.322', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.910', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.714', 'FRAGCOUNT': '44.000'} [2023-02-24 21:22:54,647][213366] DAMAGECOUNT value on done: 572631.0 [2023-02-24 21:22:54,648][213366] Sum rewards: 50.150, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.947', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.150', 'AMMO3': '0.178', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.346', 'weapon4': '0.460', 'WEAPON3': '1.200', 'weapon3': '2.752', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.688', 'FRAGCOUNT': '43.000'} [2023-02-24 21:22:54,947][213366] DAMAGECOUNT value on done: 597875.0 [2023-02-24 21:22:54,948][213366] Sum rewards: 48.238, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.264', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.064', 'AMMO4': '0.070', 'weapon4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'weapon2': '0.308', 'WEAPON3': '1.400', 'HITCOUNT': '2.900', 'weapon3': '3.308', 'DAMAGECOUNT': '13.548', 'FRAGCOUNT': '43.000'} [2023-02-24 21:22:54,961][213366] DAMAGECOUNT value on done: 585488.0 [2023-02-24 21:22:54,961][213366] Sum rewards: 51.767, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.798', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon2': '0.160', 'AMMO3': '0.196', 'weapon5': '0.196', 'AMMO4': '0.206', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.710', 'WEAPON3': '1.200', 'weapon3': '2.690', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.434', 'FRAGCOUNT': '45.000'} [2023-02-24 21:22:55,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13870.9). Total num frames: 147304448. Throughput: 0: 3470.0. Samples: 11818148. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:22:55,243][213332] Avg episode reward: [(0, '47.955')] [2023-02-24 21:22:55,246][213352] Saving new best policy, reward=47.955! [2023-02-24 21:22:55,263][213366] DAMAGECOUNT value on done: 588531.0 [2023-02-24 21:22:55,264][213366] Sum rewards: 54.187, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.636', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.123', 'weapon5': '0.178', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.330', 'weapon4': '0.352', 'WEAPON3': '0.750', 'weapon3': '2.902', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.289', 'FRAGCOUNT': '42.500'} [2023-02-24 21:22:55,351][213383] DAMAGECOUNT value on done: 580172.0 [2023-02-24 21:22:55,352][213383] Sum rewards: 44.946, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.776', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.052', 'AMMO3': '0.170', 'AMMO4': '0.262', 'weapon5': '0.406', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.556', 'weapon2': '0.598', 'WEAPON3': '0.950', 'weapon3': '2.036', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '14.277', 'FRAGCOUNT': '38.500'} [2023-02-24 21:22:55,448][213369] DAMAGECOUNT value on done: 582759.0 [2023-02-24 21:22:55,448][213369] Sum rewards: 45.007, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.490', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.152', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'weapon4': '0.266', 'WEAPON5': '0.300', 'weapon2': '0.860', 'WEAPON3': '1.200', 'weapon3': '2.434', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '11.454', 'FRAGCOUNT': '41.000'} [2023-02-24 21:22:55,653][213383] DAMAGECOUNT value on done: 578365.0 [2023-02-24 21:22:55,653][213383] Sum rewards: 53.869, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.013', 'AMMO5': '0.016', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.188', 'weapon5': '0.264', 'WEAPON4': '0.300', 'weapon4': '0.322', 'WEAPON5': '0.400', 'weapon2': '0.448', 'WEAPON3': '1.250', 'weapon3': '2.722', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '14.751', 'FRAGCOUNT': '46.000'} [2023-02-24 21:22:55,689][213368] DAMAGECOUNT value on done: 574287.0 [2023-02-24 21:22:55,689][213368] Sum rewards: 59.131, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.358', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'AMMO3': '0.217', 'weapon2': '0.306', 'WEAPON3': '1.300', 'HITCOUNT': '3.130', 'weapon3': '3.544', 'DAMAGECOUNT': '13.992', 'FRAGCOUNT': '50.000'} [2023-02-24 21:22:55,725][213382] DAMAGECOUNT value on done: 584760.0 [2023-02-24 21:22:55,726][213382] Sum rewards: 62.222, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.034', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.108', 'AMMO3': '0.123', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.438', 'weapon2': '0.466', 'WEAPON3': '0.750', 'weapon3': '2.802', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.457', 'FRAGCOUNT': '50.000'} [2023-02-24 21:22:55,747][213369] DAMAGECOUNT value on done: 586185.0 [2023-02-24 21:22:55,747][213369] Sum rewards: 52.316, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.705', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.046', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.210', 'weapon2': '0.580', 'WEAPON3': '1.150', 'HITCOUNT': '2.900', 'weapon3': '3.158', 'DAMAGECOUNT': '13.422', 'FRAGCOUNT': '44.000'} [2023-02-24 21:22:55,986][213368] DAMAGECOUNT value on done: 581157.0 [2023-02-24 21:22:55,987][213368] Sum rewards: 43.870, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.464', 'AMMO2': '0.013', 'AMMO5': '0.015', 'AMMO4': '0.064', 'weapon5': '0.172', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.386', 'weapon4': '0.454', 'WEAPON3': '1.250', 'HITCOUNT': '2.690', 'weapon3': '2.766', 'DAMAGECOUNT': '11.574', 'FRAGCOUNT': '39.000'} [2023-02-24 21:22:56,023][213382] DAMAGECOUNT value on done: 581456.0 [2023-02-24 21:22:56,023][213382] Sum rewards: 40.141, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.910', 'AMMO2': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'weapon5': '0.116', 'weapon4': '0.162', 'AMMO3': '0.217', 'WEAPON5': '0.300', 'weapon2': '0.590', 'WEAPON3': '1.250', 'HITCOUNT': '2.480', 'weapon3': '2.830', 'DAMAGECOUNT': '11.430', 'FRAGCOUNT': '35.000'} [2023-02-24 21:22:56,072][213369] DAMAGECOUNT value on done: 580681.0 [2023-02-24 21:22:56,073][213369] Sum rewards: 41.635, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.391', 'AMMO5': '0.020', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon5': '0.250', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'weapon2': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.502', 'WEAPON3': '1.600', 'weapon3': '2.594', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.894', 'FRAGCOUNT': '38.000'} [2023-02-24 21:22:56,104][213365] Updated weights for policy 0, policy_version 35966 (0.0009) [2023-02-24 21:22:56,264][213368] DAMAGECOUNT value on done: 578527.0 [2023-02-24 21:22:56,265][213368] Sum rewards: 60.895, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.226', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.046', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon2': '0.202', 'AMMO3': '0.280', 'weapon4': '0.340', 'WEAPON3': '1.650', 'weapon3': '3.178', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.916', 'FRAGCOUNT': '56.000'} [2023-02-24 21:22:56,366][213369] DAMAGECOUNT value on done: 570102.0 [2023-02-24 21:22:56,367][213369] Sum rewards: 54.975, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.220', 'AMMO5': '0.017', 'AMMO2': '0.033', 'weapon5': '0.100', 'AMMO4': '0.166', 'AMMO3': '0.169', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.412', 'weapon4': '0.480', 'WEAPON3': '1.000', 'weapon3': '2.704', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.863', 'FRAGCOUNT': '47.000'} [2023-02-24 21:22:56,492][213383] DAMAGECOUNT value on done: 580796.0 [2023-02-24 21:22:56,492][213383] Sum rewards: 39.273, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.305', 'AMMO5': '0.014', 'AMMO2': '0.029', 'AMMO3': '0.127', 'AMMO4': '0.145', 'weapon5': '0.236', 'weapon2': '0.284', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '0.800', 'weapon4': '1.222', 'weapon3': '1.858', 'HITCOUNT': '2.100', 'DAMAGECOUNT': '10.062', 'FRAGCOUNT': '32.000'} [2023-02-24 21:22:56,494][213382] DAMAGECOUNT value on done: 571033.0 [2023-02-24 21:22:56,494][213382] Sum rewards: 47.883, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.664', 'AMMO5': '0.015', 'AMMO2': '0.020', 'AMMO4': '0.102', 'weapon5': '0.126', 'AMMO3': '0.167', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.526', 'weapon2': '0.624', 'WEAPON3': '1.000', 'weapon3': '2.388', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.039', 'FRAGCOUNT': '41.000'} [2023-02-24 21:22:56,568][213368] DAMAGECOUNT value on done: 575867.0 [2023-02-24 21:22:56,568][213368] Sum rewards: 33.140, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.019', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.144', 'AMMO4': '0.189', 'weapon5': '0.192', 'WEAPON7': '0.200', 'weapon7': '0.260', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON4': '0.500', 'weapon4': '0.836', 'WEAPON3': '0.950', 'weapon3': '1.886', 'HITCOUNT': '2.070', 'DAMAGECOUNT': '9.930', 'FRAGCOUNT': '29.000'} [2023-02-24 21:22:56,788][213382] DAMAGECOUNT value on done: 578327.0 [2023-02-24 21:22:56,788][213382] Sum rewards: 49.264, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.957', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon5': '0.102', 'weapon4': '0.122', 'AMMO4': '0.206', 'AMMO3': '0.240', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.740', 'weapon3': '3.178', 'DAMAGECOUNT': '13.593', 'FRAGCOUNT': '46.000'} [2023-02-24 21:22:56,793][213383] DAMAGECOUNT value on done: 578837.0 [2023-02-24 21:22:56,793][213383] Sum rewards: 44.324, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.191', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.134', 'AMMO4': '0.194', 'weapon2': '0.226', 'AMMO3': '0.247', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.844', 'WEAPON3': '1.450', 'weapon3': '2.464', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '12.990', 'FRAGCOUNT': '41.000'} [2023-02-24 21:22:56,872][213384] DAMAGECOUNT value on done: 584894.0 [2023-02-24 21:22:56,873][213384] Sum rewards: 56.295, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.472', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon5': '0.018', 'weapon4': '0.018', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.438', 'WEAPON3': '1.300', 'HITCOUNT': '3.120', 'weapon3': '3.346', 'DAMAGECOUNT': '14.820', 'FRAGCOUNT': '47.000'} [2023-02-24 21:22:57,173][213384] DAMAGECOUNT value on done: 568881.0 [2023-02-24 21:22:57,173][213384] Sum rewards: 62.239, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.400', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'weapon4': '0.310', 'weapon2': '0.442', 'WEAPON3': '1.600', 'weapon3': '2.802', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '56.000'} [2023-02-24 21:22:57,604][213384] DAMAGECOUNT value on done: 580475.0 [2023-02-24 21:22:57,605][213384] Sum rewards: 49.456, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.630', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.062', 'weapon4': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'weapon2': '0.686', 'WEAPON3': '0.950', 'weapon3': '2.900', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.833', 'FRAGCOUNT': '40.000'} [2023-02-24 21:22:57,910][213384] DAMAGECOUNT value on done: 582984.0 [2023-02-24 21:22:57,911][213384] Sum rewards: 40.119, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.605', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.137', 'AMMO3': '0.173', 'weapon5': '0.216', 'weapon2': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.666', 'WEAPON3': '1.100', 'weapon3': '2.610', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '11.532', 'FRAGCOUNT': '34.500'} [2023-02-24 21:22:59,040][213365] Updated weights for policy 0, policy_version 35976 (0.0009) [2023-02-24 21:23:00,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 13870.9). Total num frames: 147374080. Throughput: 0: 3470.2. Samples: 11838976. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:23:00,243][213332] Avg episode reward: [(0, '48.717')] [2023-02-24 21:23:00,244][213352] Saving new best policy, reward=48.717! [2023-02-24 21:23:02,021][213365] Updated weights for policy 0, policy_version 35986 (0.0009) [2023-02-24 21:23:04,953][213365] Updated weights for policy 0, policy_version 35996 (0.0009) [2023-02-24 21:23:05,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13926.4, 300 sec: 13870.9). Total num frames: 147443712. Throughput: 0: 3470.7. Samples: 11849324. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:23:05,244][213332] Avg episode reward: [(0, '48.717')] [2023-02-24 21:23:07,905][213365] Updated weights for policy 0, policy_version 36006 (0.0009) [2023-02-24 21:23:10,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 147509248. Throughput: 0: 3469.5. Samples: 11870136. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:23:10,243][213332] Avg episode reward: [(0, '48.717')] [2023-02-24 21:23:10,869][213365] Updated weights for policy 0, policy_version 36016 (0.0010) [2023-02-24 21:23:11,920][213367] DAMAGECOUNT value on done: 582512.0 [2023-02-24 21:23:11,921][213367] Sum rewards: 44.022, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.140', 'AMMO5': '0.011', 'AMMO2': '0.019', 'weapon4': '0.076', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'weapon5': '0.252', 'AMMO3': '0.294', 'WEAPON5': '0.300', 'weapon2': '0.712', 'WEAPON3': '1.700', 'HITCOUNT': '2.540', 'weapon3': '2.656', 'DAMAGECOUNT': '12.108', 'FRAGCOUNT': '42.000'} [2023-02-24 21:23:12,224][213367] DAMAGECOUNT value on done: 582351.0 [2023-02-24 21:23:12,225][213367] Sum rewards: 45.013, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.521', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.042', 'AMMO3': '0.162', 'AMMO4': '0.210', 'WEAPON5': '0.400', 'weapon2': '0.442', 'WEAPON4': '0.500', 'weapon5': '0.556', 'weapon4': '0.826', 'WEAPON3': '0.950', 'weapon3': '1.872', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '11.241', 'FRAGCOUNT': '41.000'} [2023-02-24 21:23:12,233][213367] DAMAGECOUNT value on done: 582382.0 [2023-02-24 21:23:12,234][213367] Sum rewards: 57.204, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.033', 'AMMO5': '0.014', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.160', 'weapon4': '0.178', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'weapon2': '0.258', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.790', 'weapon3': '3.180', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '50.000'} [2023-02-24 21:23:12,534][213367] DAMAGECOUNT value on done: 591104.0 [2023-02-24 21:23:12,535][213367] Sum rewards: 40.458, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.480', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.074', 'weapon5': '0.102', 'weapon4': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.310', 'WEAPON3': '1.400', 'HITCOUNT': '2.350', 'weapon3': '3.144', 'DAMAGECOUNT': '11.466', 'FRAGCOUNT': '37.000'} [2023-02-24 21:23:13,230][213372] DAMAGECOUNT value on done: 600945.0 [2023-02-24 21:23:13,231][213372] Sum rewards: 39.844, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.391', 'AMMO5': '0.017', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.242', 'AMMO3': '0.248', 'weapon4': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.558', 'WEAPON3': '1.400', 'weapon3': '2.550', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.224', 'FRAGCOUNT': '38.000'} [2023-02-24 21:23:13,515][213372] DAMAGECOUNT value on done: 579930.0 [2023-02-24 21:23:13,515][213372] Sum rewards: 48.797, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.046', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.066', 'weapon4': '0.066', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.204', 'weapon2': '0.376', 'WEAPON3': '1.250', 'HITCOUNT': '2.720', 'weapon3': '3.316', 'DAMAGECOUNT': '11.898', 'FRAGCOUNT': '44.000'} [2023-02-24 21:23:13,535][213372] DAMAGECOUNT value on done: 589316.0 [2023-02-24 21:23:13,535][213372] Sum rewards: 47.231, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.194', 'ARMOR': '0.004', 'AMMO5': '0.028', 'AMMO2': '0.047', 'AMMO3': '0.132', 'AMMO4': '0.235', 'weapon5': '0.452', 'weapon2': '0.528', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'weapon4': '0.720', 'WEAPON3': '0.800', 'weapon3': '1.996', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '13.023', 'FRAGCOUNT': '41.000'} [2023-02-24 21:23:13,818][213365] Updated weights for policy 0, policy_version 36026 (0.0009) [2023-02-24 21:23:13,823][213372] DAMAGECOUNT value on done: 580579.0 [2023-02-24 21:23:13,823][213372] Sum rewards: 44.209, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.305', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.172', 'weapon2': '0.228', 'weapon5': '0.240', 'weapon4': '0.256', 'AMMO3': '0.265', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.928', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.848', 'FRAGCOUNT': '43.000'} [2023-02-24 21:23:14,050][213366] DAMAGECOUNT value on done: 576918.0 [2023-02-24 21:23:14,050][213366] Sum rewards: 40.905, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.070', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon5': '0.040', 'AMMO4': '0.118', 'WEAPON4': '0.200', 'weapon2': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.274', 'weapon4': '0.354', 'WEAPON3': '1.600', 'HITCOUNT': '2.910', 'weapon3': '3.132', 'DAMAGECOUNT': '12.861', 'FRAGCOUNT': '39.000'} [2023-02-24 21:23:14,353][213366] DAMAGECOUNT value on done: 602255.0 [2023-02-24 21:23:14,353][213366] Sum rewards: 51.056, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.738', 'AMMO5': '0.007', 'AMMO2': '0.031', 'AMMO3': '0.132', 'AMMO4': '0.157', 'weapon5': '0.228', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.404', 'weapon2': '0.808', 'WEAPON3': '0.850', 'weapon3': '2.346', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.140', 'FRAGCOUNT': '41.000'} [2023-02-24 21:23:14,370][213366] DAMAGECOUNT value on done: 591135.0 [2023-02-24 21:23:14,371][213366] Sum rewards: 56.542, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.690', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.045', 'AMMO4': '0.224', 'AMMO3': '0.231', 'weapon5': '0.346', 'weapon2': '0.382', 'weapon4': '0.444', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.484', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '49.500'} [2023-02-24 21:23:14,680][213366] DAMAGECOUNT value on done: 593201.0 [2023-02-24 21:23:14,681][213366] Sum rewards: 50.447, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.834', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.033', 'AMMO4': '0.167', 'AMMO3': '0.198', 'weapon5': '0.294', 'weapon2': '0.412', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.656', 'WEAPON3': '1.250', 'weapon3': '2.324', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.010', 'FRAGCOUNT': '45.000'} [2023-02-24 21:23:14,750][213383] DAMAGECOUNT value on done: 584091.0 [2023-02-24 21:23:14,750][213383] Sum rewards: 47.443, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.956', 'ARMOR': '0.008', 'AMMO5': '0.026', 'AMMO2': '0.056', 'AMMO3': '0.065', 'AMMO4': '0.279', 'weapon2': '0.370', 'weapon5': '0.394', 'WEAPON3': '0.450', 'WEAPON4': '0.600', 'WEAPON5': '0.700', 'weapon4': '0.908', 'weapon3': '1.656', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '11.757', 'FRAGCOUNT': '37.000'} [2023-02-24 21:23:14,811][213369] DAMAGECOUNT value on done: 587897.0 [2023-02-24 21:23:14,811][213369] Sum rewards: 46.592, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.650', 'AMMO5': '0.016', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon4': '0.212', 'AMMO3': '0.248', 'weapon5': '0.282', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.896', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.174', 'FRAGCOUNT': '42.000'} [2023-02-24 21:23:15,048][213383] DAMAGECOUNT value on done: 583213.0 [2023-02-24 21:23:15,049][213383] Sum rewards: 57.950, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.985', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.038', 'weapon5': '0.084', 'AMMO4': '0.189', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.236', 'WEAPON4': '0.450', 'weapon4': '0.614', 'WEAPON3': '1.200', 'weapon3': '2.804', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.544', 'FRAGCOUNT': '51.000'} [2023-02-24 21:23:15,082][213382] DAMAGECOUNT value on done: 589268.0 [2023-02-24 21:23:15,082][213382] Sum rewards: 50.598, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.772', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.176', 'WEAPON4': '0.350', 'weapon5': '0.374', 'weapon2': '0.404', 'WEAPON5': '0.500', 'weapon4': '0.520', 'WEAPON3': '1.050', 'weapon3': '2.404', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '13.524', 'FRAGCOUNT': '43.000'} [2023-02-24 21:23:15,111][213368] DAMAGECOUNT value on done: 578443.0 [2023-02-24 21:23:15,112][213368] Sum rewards: 48.813, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.895', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.124', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.272', 'weapon2': '0.846', 'WEAPON3': '1.050', 'weapon3': '2.442', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '12.468', 'FRAGCOUNT': '43.000'} [2023-02-24 21:23:15,115][213369] DAMAGECOUNT value on done: 590026.0 [2023-02-24 21:23:15,116][213369] Sum rewards: 42.499, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.137', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.152', 'AMMO4': '0.168', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.374', 'weapon4': '0.422', 'WEAPON3': '1.300', 'HITCOUNT': '2.410', 'weapon3': '2.718', 'DAMAGECOUNT': '11.523', 'FRAGCOUNT': '39.000'} [2023-02-24 21:23:15,243][213332] Fps is (10 sec: 13516.5, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 147578880. Throughput: 0: 3468.6. Samples: 11890916. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:23:15,244][213332] Avg episode reward: [(0, '48.508')] [2023-02-24 21:23:15,387][213382] DAMAGECOUNT value on done: 585490.0 [2023-02-24 21:23:15,388][213382] Sum rewards: 42.294, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.265', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.064', 'AMMO4': '0.092', 'WEAPON5': '0.150', 'weapon2': '0.214', 'AMMO3': '0.242', 'WEAPON4': '0.350', 'weapon4': '0.478', 'WEAPON3': '1.450', 'weapon3': '2.670', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '12.102', 'FRAGCOUNT': '40.000'} [2023-02-24 21:23:15,413][213368] DAMAGECOUNT value on done: 585646.0 [2023-02-24 21:23:15,413][213368] Sum rewards: 48.634, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.338', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.086', 'AMMO3': '0.118', 'AMMO4': '0.129', 'weapon5': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.714', 'WEAPON3': '0.850', 'HITCOUNT': '2.510', 'weapon3': '2.770', 'DAMAGECOUNT': '13.467', 'FRAGCOUNT': '39.000'} [2023-02-24 21:23:15,482][213369] DAMAGECOUNT value on done: 585146.0 [2023-02-24 21:23:15,483][213369] Sum rewards: 44.829, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.580', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon5': '0.144', 'AMMO3': '0.190', 'AMMO4': '0.213', 'weapon2': '0.318', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.866', 'WEAPON3': '1.100', 'weapon3': '2.320', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.330', 'FRAGCOUNT': '40.000'} [2023-02-24 21:23:15,692][213368] DAMAGECOUNT value on done: 583695.0 [2023-02-24 21:23:15,692][213368] Sum rewards: 62.453, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.596', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'weapon4': '0.016', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'weapon2': '0.130', 'AMMO3': '0.179', 'weapon5': '0.226', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '3.290', 'weapon3': '3.420', 'DAMAGECOUNT': '15.357', 'FRAGCOUNT': '51.000'} [2023-02-24 21:23:15,785][213369] DAMAGECOUNT value on done: 574735.0 [2023-02-24 21:23:15,786][213369] Sum rewards: 59.792, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.195', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.042', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'weapon4': '0.130', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'weapon2': '0.550', 'WEAPON3': '1.400', 'HITCOUNT': '2.870', 'weapon3': '2.968', 'DAMAGECOUNT': '13.899', 'FRAGCOUNT': '54.000'} [2023-02-24 21:23:15,845][213382] DAMAGECOUNT value on done: 575824.0 [2023-02-24 21:23:15,846][213382] Sum rewards: 52.894, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.658', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.128', 'AMMO4': '0.185', 'weapon4': '0.194', 'AMMO3': '0.201', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.300', 'HITCOUNT': '2.890', 'weapon3': '3.104', 'DAMAGECOUNT': '14.373', 'FRAGCOUNT': '45.000'} [2023-02-24 21:23:15,887][213383] DAMAGECOUNT value on done: 585538.0 [2023-02-24 21:23:15,887][213383] Sum rewards: 53.455, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.025', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.039', 'AMMO4': '0.197', 'AMMO3': '0.219', 'weapon4': '0.224', 'weapon2': '0.246', 'weapon5': '0.378', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.826', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.226', 'FRAGCOUNT': '48.500'} [2023-02-24 21:23:15,989][213368] DAMAGECOUNT value on done: 580399.0 [2023-02-24 21:23:15,989][213368] Sum rewards: 49.192, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.880', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.034', 'weapon4': '0.074', 'WEAPON4': '0.100', 'weapon5': '0.132', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.748', 'WEAPON3': '1.250', 'weapon3': '2.838', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.596', 'FRAGCOUNT': '42.500'} [2023-02-24 21:23:16,145][213382] DAMAGECOUNT value on done: 581577.0 [2023-02-24 21:23:16,145][213382] Sum rewards: 32.386, reward structure: {'DEATHCOUNT': '-14.250', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon5': '0.120', 'AMMO3': '0.144', 'AMMO4': '0.236', 'WEAPON5': '0.250', 'HEALTH': '0.254', 'WEAPON4': '0.350', 'weapon4': '0.652', 'weapon2': '0.662', 'WEAPON3': '0.800', 'weapon3': '1.978', 'HITCOUNT': '2.370', 'DAMAGECOUNT': '9.750', 'FRAGCOUNT': '29.000'} [2023-02-24 21:23:16,195][213383] DAMAGECOUNT value on done: 583472.0 [2023-02-24 21:23:16,196][213383] Sum rewards: 48.679, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.750', 'AMMO5': '0.006', 'AMMO2': '0.012', 'weapon4': '0.014', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.184', 'weapon2': '0.246', 'AMMO3': '0.271', 'WEAPON3': '1.600', 'HITCOUNT': '2.810', 'weapon3': '3.324', 'DAMAGECOUNT': '13.905', 'FRAGCOUNT': '43.000'} [2023-02-24 21:23:16,320][213384] DAMAGECOUNT value on done: 588179.0 [2023-02-24 21:23:16,321][213384] Sum rewards: 35.057, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.626', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.032', 'AMMO4': '0.064', 'weapon4': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon2': '0.612', 'WEAPON3': '1.300', 'HITCOUNT': '2.390', 'weapon3': '3.058', 'DAMAGECOUNT': '9.855', 'FRAGCOUNT': '33.000'} [2023-02-24 21:23:16,629][213384] DAMAGECOUNT value on done: 573177.0 [2023-02-24 21:23:16,629][213384] Sum rewards: 52.845, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.754', 'AMMO2': '0.007', 'AMMO5': '0.008', 'AMMO4': '0.037', 'weapon5': '0.144', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.376', 'weapon4': '0.614', 'WEAPON3': '1.200', 'weapon3': '2.600', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '12.888', 'FRAGCOUNT': '46.000'} [2023-02-24 21:23:16,795][213365] Updated weights for policy 0, policy_version 36036 (0.0009) [2023-02-24 21:23:17,057][213384] DAMAGECOUNT value on done: 584996.0 [2023-02-24 21:23:17,058][213384] Sum rewards: 44.221, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.087', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.049', 'AMMO3': '0.223', 'AMMO4': '0.245', 'weapon2': '0.260', 'weapon4': '0.318', 'weapon5': '0.330', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'HITCOUNT': '2.620', 'weapon3': '2.774', 'DAMAGECOUNT': '13.563', 'FRAGCOUNT': '41.000'} [2023-02-24 21:23:17,369][213384] DAMAGECOUNT value on done: 587616.0 [2023-02-24 21:23:17,370][213384] Sum rewards: 52.421, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.774', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.040', 'AMMO3': '0.151', 'AMMO4': '0.201', 'weapon5': '0.282', 'weapon2': '0.430', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.928', 'WEAPON3': '0.950', 'weapon3': '1.978', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.890', 'FRAGCOUNT': '44.000'} [2023-02-24 21:23:19,751][213365] Updated weights for policy 0, policy_version 36046 (0.0009) [2023-02-24 21:23:20,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 147648512. Throughput: 0: 3469.3. Samples: 11901296. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:23:20,243][213332] Avg episode reward: [(0, '49.068')] [2023-02-24 21:23:20,244][213352] Saving new best policy, reward=49.068! [2023-02-24 21:23:22,290][213383] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-24 21:23:22,712][213365] Updated weights for policy 0, policy_version 36056 (0.0009) [2023-02-24 21:23:25,243][213332] Fps is (10 sec: 13926.6, 60 sec: 13858.2, 300 sec: 13857.0). Total num frames: 147718144. Throughput: 0: 3465.7. Samples: 11921994. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:23:25,243][213332] Avg episode reward: [(0, '49.068')] [2023-02-24 21:23:25,679][213365] Updated weights for policy 0, policy_version 36066 (0.0009) [2023-02-24 21:23:28,613][213365] Updated weights for policy 0, policy_version 36076 (0.0009) [2023-02-24 21:23:30,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 147787776. Throughput: 0: 3464.8. Samples: 11942822. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:23:30,243][213332] Avg episode reward: [(0, '49.068')] [2023-02-24 21:23:31,330][213367] DAMAGECOUNT value on done: 587138.0 [2023-02-24 21:23:31,331][213367] Sum rewards: 51.809, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.846', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.100', 'weapon4': '0.180', 'AMMO3': '0.192', 'AMMO4': '0.201', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.200', 'HITCOUNT': '2.730', 'weapon3': '3.210', 'DAMAGECOUNT': '13.878', 'FRAGCOUNT': '46.000'} [2023-02-24 21:23:31,547][213365] Updated weights for policy 0, policy_version 36086 (0.0009) [2023-02-24 21:23:31,556][213367] DAMAGECOUNT value on done: 586515.0 [2023-02-24 21:23:31,557][213367] Sum rewards: 49.331, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.172', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.058', 'AMMO3': '0.173', 'weapon2': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.910', 'weapon3': '3.012', 'DAMAGECOUNT': '12.492', 'FRAGCOUNT': '42.000'} [2023-02-24 21:23:31,636][213367] DAMAGECOUNT value on done: 586921.0 [2023-02-24 21:23:31,637][213367] Sum rewards: 54.925, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.649', 'AMMO2': '0.003', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.013', 'WEAPON4': '0.050', 'weapon4': '0.122', 'WEAPON5': '0.150', 'weapon5': '0.166', 'AMMO3': '0.181', 'weapon2': '0.410', 'WEAPON3': '1.200', 'HITCOUNT': '2.820', 'weapon3': '3.080', 'DAMAGECOUNT': '13.617', 'FRAGCOUNT': '46.000'} [2023-02-24 21:23:31,856][213367] DAMAGECOUNT value on done: 595231.0 [2023-02-24 21:23:31,856][213367] Sum rewards: 45.046, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.835', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.124', 'AMMO3': '0.192', 'weapon2': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.398', 'WEAPON3': '1.150', 'HITCOUNT': '2.490', 'weapon3': '2.996', 'DAMAGECOUNT': '12.381', 'FRAGCOUNT': '39.000'} [2023-02-24 21:23:32,600][213372] DAMAGECOUNT value on done: 605415.0 [2023-02-24 21:23:32,600][213372] Sum rewards: 50.512, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.524', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.030', 'AMMO3': '0.117', 'AMMO4': '0.151', 'weapon5': '0.204', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.388', 'WEAPON3': '0.800', 'weapon4': '0.808', 'weapon3': '2.160', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '13.410', 'FRAGCOUNT': '42.000'} [2023-02-24 21:23:32,894][213372] DAMAGECOUNT value on done: 585403.0 [2023-02-24 21:23:32,894][213372] Sum rewards: 57.356, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.980', 'AMMO5': '0.008', 'AMMO2': '0.031', 'AMMO4': '0.157', 'weapon5': '0.164', 'weapon2': '0.182', 'AMMO3': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.402', 'WEAPON3': '1.600', 'weapon3': '3.018', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '51.000'} [2023-02-24 21:23:32,911][213372] DAMAGECOUNT value on done: 593656.0 [2023-02-24 21:23:32,911][213372] Sum rewards: 50.235, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.936', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO3': '0.182', 'AMMO4': '0.195', 'weapon2': '0.204', 'weapon5': '0.390', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.584', 'WEAPON3': '1.100', 'weapon3': '2.532', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '13.020', 'FRAGCOUNT': '45.500'} [2023-02-24 21:23:33,221][213372] DAMAGECOUNT value on done: 585602.0 [2023-02-24 21:23:33,221][213372] Sum rewards: 49.926, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.292', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO4': '0.191', 'weapon5': '0.236', 'weapon4': '0.238', 'weapon2': '0.240', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.010', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.039', 'FRAGCOUNT': '45.000'} [2023-02-24 21:23:33,429][213366] DAMAGECOUNT value on done: 581456.0 [2023-02-24 21:23:33,430][213366] Sum rewards: 52.640, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.444', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.132', 'AMMO4': '0.149', 'weapon2': '0.208', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.010', 'weapon3': '3.350', 'DAMAGECOUNT': '13.614', 'FRAGCOUNT': '48.000'} [2023-02-24 21:23:33,732][213366] DAMAGECOUNT value on done: 606651.0 [2023-02-24 21:23:33,733][213366] Sum rewards: 42.287, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.320', 'AMMO5': '0.018', 'AMMO2': '0.038', 'AMMO3': '0.170', 'AMMO4': '0.189', 'weapon5': '0.278', 'weapon4': '0.344', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.410', 'WEAPON3': '1.000', 'HITCOUNT': '2.530', 'weapon3': '2.692', 'DAMAGECOUNT': '13.188', 'FRAGCOUNT': '37.000'} [2023-02-24 21:23:33,745][213366] DAMAGECOUNT value on done: 595352.0 [2023-02-24 21:23:33,746][213366] Sum rewards: 47.023, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.612', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.033', 'weapon4': '0.138', 'AMMO3': '0.160', 'AMMO4': '0.164', 'weapon2': '0.236', 'WEAPON4': '0.350', 'weapon5': '0.410', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'HITCOUNT': '2.340', 'weapon3': '2.898', 'DAMAGECOUNT': '12.078', 'FRAGCOUNT': '42.000'} [2023-02-24 21:23:34,044][213366] DAMAGECOUNT value on done: 596215.0 [2023-02-24 21:23:34,044][213366] Sum rewards: 29.057, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.832', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO3': '0.146', 'AMMO4': '0.156', 'weapon5': '0.180', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'ARMOR': '0.451', 'weapon4': '0.568', 'weapon2': '0.730', 'WEAPON3': '0.900', 'weapon3': '1.892', 'HITCOUNT': '2.130', 'DAMAGECOUNT': '9.042', 'FRAGCOUNT': '26.000'} [2023-02-24 21:23:34,203][213383] DAMAGECOUNT value on done: 589610.0 [2023-02-24 21:23:34,204][213383] Sum rewards: 62.814, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.416', 'AMMO5': '0.017', 'AMMO2': '0.033', 'weapon5': '0.118', 'AMMO4': '0.166', 'AMMO3': '0.186', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.506', 'weapon4': '0.558', 'WEAPON3': '1.200', 'weapon3': '2.578', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '53.000'} [2023-02-24 21:23:34,254][213369] DAMAGECOUNT value on done: 591797.0 [2023-02-24 21:23:34,254][213369] Sum rewards: 37.769, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.575', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon4': '0.166', 'weapon5': '0.180', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'WEAPON5': '0.300', 'weapon2': '0.456', 'WEAPON3': '1.350', 'HITCOUNT': '2.380', 'weapon3': '2.962', 'DAMAGECOUNT': '11.700', 'FRAGCOUNT': '34.500'} [2023-02-24 21:23:34,497][213383] DAMAGECOUNT value on done: 587901.0 [2023-02-24 21:23:34,497][213383] Sum rewards: 54.042, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.620', 'AMMO5': '0.015', 'AMMO2': '0.023', 'weapon4': '0.116', 'AMMO4': '0.116', 'AMMO3': '0.180', 'weapon2': '0.210', 'weapon5': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.940', 'weapon3': '3.188', 'DAMAGECOUNT': '14.031', 'FRAGCOUNT': '45.000'} [2023-02-24 21:23:34,523][213365] Updated weights for policy 0, policy_version 36096 (0.0009) [2023-02-24 21:23:34,526][213368] DAMAGECOUNT value on done: 582889.0 [2023-02-24 21:23:34,526][213368] Sum rewards: 45.864, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.080', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.170', 'AMMO4': '0.172', 'AMMO3': '0.240', 'WEAPON5': '0.300', 'weapon4': '0.322', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '2.818', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.338', 'FRAGCOUNT': '43.000'} [2023-02-24 21:23:34,535][213382] DAMAGECOUNT value on done: 594008.0 [2023-02-24 21:23:34,535][213382] Sum rewards: 48.907, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.748', 'AMMO5': '0.009', 'AMMO2': '0.047', 'weapon5': '0.068', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'AMMO4': '0.235', 'weapon2': '0.258', 'WEAPON4': '0.550', 'weapon4': '0.674', 'WEAPON3': '1.250', 'weapon3': '2.748', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.220', 'FRAGCOUNT': '45.000'} [2023-02-24 21:23:34,552][213369] DAMAGECOUNT value on done: 594781.0 [2023-02-24 21:23:34,552][213369] Sum rewards: 49.628, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.680', 'AMMO5': '0.016', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.164', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.410', 'weapon4': '0.526', 'WEAPON3': '1.250', 'weapon3': '2.598', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.265', 'FRAGCOUNT': '43.000'} [2023-02-24 21:23:34,827][213368] DAMAGECOUNT value on done: 590808.0 [2023-02-24 21:23:34,828][213368] Sum rewards: 61.074, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.630', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.144', 'AMMO3': '0.182', 'weapon2': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.536', 'WEAPON3': '1.150', 'weapon3': '2.828', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '51.000'} [2023-02-24 21:23:34,836][213382] DAMAGECOUNT value on done: 589875.0 [2023-02-24 21:23:34,836][213382] Sum rewards: 46.048, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.441', 'ARMOR': '0.004', 'AMMO5': '0.028', 'AMMO2': '0.037', 'AMMO3': '0.178', 'AMMO4': '0.184', 'weapon2': '0.286', 'weapon4': '0.396', 'weapon5': '0.400', 'WEAPON4': '0.450', 'WEAPON5': '0.650', 'WEAPON3': '1.050', 'HITCOUNT': '2.360', 'weapon3': '2.560', 'DAMAGECOUNT': '13.155', 'FRAGCOUNT': '40.500'} [2023-02-24 21:23:34,908][213369] DAMAGECOUNT value on done: 590213.0 [2023-02-24 21:23:34,909][213369] Sum rewards: 65.491, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.194', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON4': '0.100', 'weapon4': '0.130', 'AMMO3': '0.174', 'weapon2': '0.490', 'WEAPON3': '1.100', 'weapon3': '3.234', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.201', 'FRAGCOUNT': '54.000'} [2023-02-24 21:23:35,100][213368] DAMAGECOUNT value on done: 589110.0 [2023-02-24 21:23:35,101][213368] Sum rewards: 63.722, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.180', 'AMMO5': '0.005', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'weapon4': '0.264', 'weapon2': '0.266', 'WEAPON3': '1.400', 'weapon3': '3.070', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '55.000'} [2023-02-24 21:23:35,199][213369] DAMAGECOUNT value on done: 579043.0 [2023-02-24 21:23:35,200][213369] Sum rewards: 51.257, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.157', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.041', 'AMMO3': '0.127', 'weapon5': '0.150', 'AMMO4': '0.206', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON4': '0.400', 'WEAPON3': '0.850', 'weapon4': '0.858', 'weapon3': '2.400', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.924', 'FRAGCOUNT': '43.000'} [2023-02-24 21:23:35,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 147857408. Throughput: 0: 3467.5. Samples: 11953268. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:23:35,243][213332] Avg episode reward: [(0, '49.507')] [2023-02-24 21:23:35,247][213352] Saving new best policy, reward=49.507! [2023-02-24 21:23:35,302][213382] DAMAGECOUNT value on done: 580698.0 [2023-02-24 21:23:35,302][213382] Sum rewards: 51.558, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.442', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.018', 'weapon5': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.188', 'weapon2': '0.482', 'WEAPON3': '1.350', 'HITCOUNT': '3.000', 'weapon3': '3.130', 'DAMAGECOUNT': '14.622', 'FRAGCOUNT': '44.000'} [2023-02-24 21:23:35,342][213383] DAMAGECOUNT value on done: 590730.0 [2023-02-24 21:23:35,342][213383] Sum rewards: 48.366, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.041', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.053', 'AMMO3': '0.173', 'AMMO4': '0.264', 'weapon5': '0.302', 'WEAPON5': '0.450', 'weapon4': '0.468', 'weapon2': '0.554', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.430', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.576', 'FRAGCOUNT': '40.500'} [2023-02-24 21:23:35,420][213368] DAMAGECOUNT value on done: 585095.0 [2023-02-24 21:23:35,421][213368] Sum rewards: 52.113, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.456', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.164', 'AMMO3': '0.167', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.602', 'WEAPON3': '1.050', 'weapon3': '2.606', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.088', 'FRAGCOUNT': '45.000'} [2023-02-24 21:23:35,613][213382] DAMAGECOUNT value on done: 586184.0 [2023-02-24 21:23:35,613][213382] Sum rewards: 49.263, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.010', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.044', 'weapon5': '0.048', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.210', 'weapon4': '0.280', 'WEAPON3': '1.150', 'HITCOUNT': '2.870', 'weapon3': '3.256', 'DAMAGECOUNT': '13.821', 'FRAGCOUNT': '41.000'} [2023-02-24 21:23:35,641][213383] DAMAGECOUNT value on done: 587358.0 [2023-02-24 21:23:35,642][213383] Sum rewards: 47.019, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.702', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.036', 'weapon7': '0.106', 'AMMO3': '0.146', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon5': '0.172', 'weapon2': '0.174', 'AMMO4': '0.180', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '0.900', 'weapon4': '0.912', 'weapon3': '2.412', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '11.658', 'FRAGCOUNT': '39.000'} [2023-02-24 21:23:35,763][213384] DAMAGECOUNT value on done: 592511.0 [2023-02-24 21:23:35,764][213384] Sum rewards: 55.903, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.860', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.021', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.104', 'AMMO3': '0.160', 'weapon2': '0.374', 'WEAPON4': '0.400', 'weapon4': '0.826', 'WEAPON3': '0.950', 'weapon3': '2.480', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '12.996', 'FRAGCOUNT': '49.000'} [2023-02-24 21:23:36,063][213384] DAMAGECOUNT value on done: 578489.0 [2023-02-24 21:23:36,063][213384] Sum rewards: 58.010, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.440', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.043', 'AMMO3': '0.152', 'AMMO4': '0.214', 'weapon5': '0.258', 'weapon2': '0.394', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.482', 'WEAPON3': '1.000', 'weapon3': '2.532', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.936', 'FRAGCOUNT': '47.500'} [2023-02-24 21:23:36,450][213384] DAMAGECOUNT value on done: 588793.0 [2023-02-24 21:23:36,451][213384] Sum rewards: 42.361, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.310', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.167', 'weapon5': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.416', 'weapon2': '0.420', 'WEAPON3': '0.950', 'HITCOUNT': '2.330', 'weapon3': '2.544', 'DAMAGECOUNT': '11.391', 'FRAGCOUNT': '37.000'} [2023-02-24 21:23:36,755][213384] DAMAGECOUNT value on done: 591932.0 [2023-02-24 21:23:36,755][213384] Sum rewards: 44.998, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.872', 'AMMO5': '0.017', 'AMMO2': '0.036', 'AMMO4': '0.182', 'AMMO3': '0.206', 'weapon5': '0.278', 'weapon2': '0.318', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.406', 'WEAPON3': '1.250', 'weapon3': '2.668', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.948', 'FRAGCOUNT': '40.000'} [2023-02-24 21:23:37,543][213365] Updated weights for policy 0, policy_version 36106 (0.0009) [2023-02-24 21:23:40,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 147927040. Throughput: 0: 3461.4. Samples: 11973910. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:23:40,243][213332] Avg episode reward: [(0, '49.398')] [2023-02-24 21:23:40,494][213365] Updated weights for policy 0, policy_version 36116 (0.0009) [2023-02-24 21:23:43,446][213365] Updated weights for policy 0, policy_version 36126 (0.0009) [2023-02-24 21:23:45,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13870.9). Total num frames: 147996672. Throughput: 0: 3460.6. Samples: 11994704. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:23:45,243][213332] Avg episode reward: [(0, '49.398')] [2023-02-24 21:23:46,400][213365] Updated weights for policy 0, policy_version 36136 (0.0009) [2023-02-24 21:23:49,391][213365] Updated weights for policy 0, policy_version 36146 (0.0009) [2023-02-24 21:23:50,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13789.9, 300 sec: 13857.0). Total num frames: 148062208. Throughput: 0: 3461.8. Samples: 12005106. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:23:50,243][213332] Avg episode reward: [(0, '49.398')] [2023-02-24 21:23:50,791][213367] DAMAGECOUNT value on done: 591385.0 [2023-02-24 21:23:50,791][213367] Sum rewards: 48.358, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.687', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon5': '0.204', 'AMMO3': '0.213', 'AMMO4': '0.225', 'weapon2': '0.268', 'WEAPON5': '0.300', 'weapon4': '0.458', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.836', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.741', 'FRAGCOUNT': '45.000'} [2023-02-24 21:23:50,997][213367] DAMAGECOUNT value on done: 590316.0 [2023-02-24 21:23:50,998][213367] Sum rewards: 39.200, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.422', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.166', 'weapon4': '0.172', 'AMMO3': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.548', 'WEAPON3': '1.400', 'HITCOUNT': '2.660', 'weapon3': '2.832', 'DAMAGECOUNT': '11.403', 'FRAGCOUNT': '38.000'} [2023-02-24 21:23:51,107][213367] DAMAGECOUNT value on done: 590161.0 [2023-02-24 21:23:51,107][213367] Sum rewards: 32.988, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.236', 'AMMO5': '0.013', 'AMMO2': '0.042', 'AMMO3': '0.180', 'weapon5': '0.188', 'AMMO4': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon2': '0.428', 'weapon4': '0.500', 'WEAPON3': '1.050', 'HITCOUNT': '2.250', 'weapon3': '2.592', 'DAMAGECOUNT': '9.720', 'FRAGCOUNT': '28.000'} [2023-02-24 21:23:51,300][213367] DAMAGECOUNT value on done: 600320.0 [2023-02-24 21:23:51,300][213367] Sum rewards: 47.746, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.620', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.045', 'AMMO3': '0.180', 'weapon5': '0.184', 'AMMO4': '0.227', 'WEAPON5': '0.250', 'weapon2': '0.370', 'weapon4': '0.460', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.642', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.267', 'FRAGCOUNT': '41.500'} [2023-02-24 21:23:52,028][213372] DAMAGECOUNT value on done: 609978.0 [2023-02-24 21:23:52,029][213372] Sum rewards: 45.907, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.224', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon5': '0.172', 'weapon2': '0.224', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'AMMO4': '0.256', 'WEAPON4': '0.450', 'weapon4': '0.572', 'WEAPON3': '1.500', 'weapon3': '2.750', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.689', 'FRAGCOUNT': '43.000'} [2023-02-24 21:23:52,306][213372] DAMAGECOUNT value on done: 589604.0 [2023-02-24 21:23:52,307][213372] Sum rewards: 53.565, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.798', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon5': '0.142', 'AMMO3': '0.184', 'AMMO4': '0.217', 'WEAPON5': '0.350', 'weapon2': '0.426', 'WEAPON4': '0.500', 'weapon4': '0.680', 'WEAPON3': '1.150', 'weapon3': '2.470', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.603', 'FRAGCOUNT': '49.000'} [2023-02-24 21:23:52,329][213372] DAMAGECOUNT value on done: 598578.0 [2023-02-24 21:23:52,329][213372] Sum rewards: 55.853, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.230', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'weapon5': '0.228', 'WEAPON5': '0.250', 'weapon4': '0.276', 'weapon2': '0.612', 'WEAPON3': '1.100', 'weapon3': '2.616', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.766', 'FRAGCOUNT': '46.000'} [2023-02-24 21:23:52,338][213365] Updated weights for policy 0, policy_version 36156 (0.0009) [2023-02-24 21:23:52,614][213372] DAMAGECOUNT value on done: 588968.0 [2023-02-24 21:23:52,614][213372] Sum rewards: 38.864, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.136', 'AMMO5': '0.011', 'ARMOR': '0.024', 'AMMO2': '0.041', 'weapon4': '0.154', 'AMMO4': '0.208', 'AMMO3': '0.209', 'weapon5': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.200', 'HITCOUNT': '2.170', 'weapon3': '2.988', 'DAMAGECOUNT': '10.053', 'FRAGCOUNT': '37.000'} [2023-02-24 21:23:52,865][213366] DAMAGECOUNT value on done: 586276.0 [2023-02-24 21:23:52,865][213366] Sum rewards: 51.678, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.027', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.056', 'weapon5': '0.160', 'AMMO3': '0.206', 'AMMO4': '0.282', 'WEAPON5': '0.300', 'weapon2': '0.320', 'weapon4': '0.438', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.800', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.403', 'FRAGCOUNT': '48.000'} [2023-02-24 21:23:53,170][213366] DAMAGECOUNT value on done: 599316.0 [2023-02-24 21:23:53,170][213366] Sum rewards: 44.517, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.326', 'AMMO5': '0.012', 'ARMOR': '0.028', 'AMMO2': '0.045', 'weapon5': '0.174', 'AMMO3': '0.193', 'AMMO4': '0.223', 'weapon4': '0.254', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.494', 'WEAPON3': '1.150', 'HITCOUNT': '2.560', 'weapon3': '2.818', 'DAMAGECOUNT': '11.892', 'FRAGCOUNT': '40.500'} [2023-02-24 21:23:53,182][213366] DAMAGECOUNT value on done: 612079.0 [2023-02-24 21:23:53,182][213366] Sum rewards: 58.815, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.842', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon5': '0.174', 'weapon2': '0.190', 'AMMO3': '0.218', 'weapon4': '0.256', 'AMMO4': '0.258', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.110', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '53.000'} [2023-02-24 21:23:53,478][213366] DAMAGECOUNT value on done: 599845.0 [2023-02-24 21:23:53,479][213366] Sum rewards: 42.049, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.594', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.026', 'WEAPON5': '0.100', 'AMMO3': '0.211', 'weapon2': '0.886', 'WEAPON3': '1.250', 'HITCOUNT': '2.650', 'weapon3': '2.894', 'DAMAGECOUNT': '10.890', 'FRAGCOUNT': '36.000'} [2023-02-24 21:23:53,601][213383] DAMAGECOUNT value on done: 594431.0 [2023-02-24 21:23:53,601][213383] Sum rewards: 59.254, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.980', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.190', 'AMMO3': '0.204', 'AMMO4': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.364', 'weapon4': '0.664', 'WEAPON3': '1.200', 'weapon3': '2.318', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.463', 'FRAGCOUNT': '52.000'} [2023-02-24 21:23:53,767][213369] DAMAGECOUNT value on done: 596174.0 [2023-02-24 21:23:53,768][213369] Sum rewards: 50.021, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.235', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.150', 'weapon2': '0.160', 'weapon5': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.642', 'WEAPON3': '0.900', 'weapon3': '2.646', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.128', 'FRAGCOUNT': '40.000'} [2023-02-24 21:23:53,905][213383] DAMAGECOUNT value on done: 592036.0 [2023-02-24 21:23:53,905][213383] Sum rewards: 51.034, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.116', 'AMMO5': '0.017', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.132', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'weapon4': '0.212', 'WEAPON5': '0.400', 'weapon2': '0.556', 'WEAPON3': '1.050', 'weapon3': '2.900', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '12.405', 'FRAGCOUNT': '43.000'} [2023-02-24 21:23:53,957][213368] DAMAGECOUNT value on done: 586834.0 [2023-02-24 21:23:53,957][213368] Sum rewards: 46.473, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.632', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon4': '0.168', 'AMMO3': '0.229', 'weapon5': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.414', 'WEAPON3': '1.350', 'HITCOUNT': '2.690', 'weapon3': '2.912', 'DAMAGECOUNT': '11.835', 'FRAGCOUNT': '42.000'} [2023-02-24 21:23:53,965][213382] DAMAGECOUNT value on done: 599025.0 [2023-02-24 21:23:53,966][213382] Sum rewards: 59.910, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.069', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.048', 'AMMO4': '0.098', 'weapon5': '0.116', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.652', 'WEAPON3': '1.100', 'weapon3': '2.992', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.051', 'FRAGCOUNT': '51.000'} [2023-02-24 21:23:54,079][213369] DAMAGECOUNT value on done: 599255.0 [2023-02-24 21:23:54,080][213369] Sum rewards: 45.831, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.807', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.026', 'weapon4': '0.034', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.174', 'AMMO3': '0.252', 'WEAPON3': '1.550', 'HITCOUNT': '2.980', 'weapon3': '3.552', 'DAMAGECOUNT': '13.422', 'FRAGCOUNT': '42.000'} [2023-02-24 21:23:54,260][213368] DAMAGECOUNT value on done: 595171.0 [2023-02-24 21:23:54,261][213368] Sum rewards: 45.169, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.120', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon2': '0.194', 'AMMO3': '0.205', 'weapon5': '0.250', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.554', 'WEAPON3': '1.200', 'HITCOUNT': '2.590', 'weapon3': '2.782', 'DAMAGECOUNT': '13.089', 'FRAGCOUNT': '39.000'} [2023-02-24 21:23:54,267][213382] DAMAGECOUNT value on done: 594486.0 [2023-02-24 21:23:54,267][213382] Sum rewards: 54.280, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.655', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.033', 'weapon5': '0.124', 'AMMO3': '0.152', 'AMMO4': '0.167', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.518', 'weapon4': '0.736', 'WEAPON3': '1.050', 'weapon3': '2.356', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '13.833', 'FRAGCOUNT': '46.000'} [2023-02-24 21:23:54,380][213369] DAMAGECOUNT value on done: 594208.0 [2023-02-24 21:23:54,380][213369] Sum rewards: 48.093, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.028', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.118', 'AMMO3': '0.126', 'AMMO4': '0.156', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.390', 'WEAPON3': '0.750', 'weapon2': '0.884', 'weapon3': '2.432', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '11.985', 'FRAGCOUNT': '39.500'} [2023-02-24 21:23:54,542][213368] DAMAGECOUNT value on done: 592668.0 [2023-02-24 21:23:54,543][213368] Sum rewards: 37.318, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.290', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.046', 'AMMO4': '0.134', 'weapon4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.220', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '2.570', 'weapon3': '3.340', 'DAMAGECOUNT': '10.674', 'FRAGCOUNT': '37.000'} [2023-02-24 21:23:54,673][213369] DAMAGECOUNT value on done: 583086.0 [2023-02-24 21:23:54,673][213369] Sum rewards: 49.667, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.267', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.108', 'AMMO4': '0.158', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'weapon2': '0.262', 'weapon4': '0.348', 'WEAPON4': '0.350', 'WEAPON3': '1.000', 'HITCOUNT': '2.390', 'weapon3': '3.038', 'DAMAGECOUNT': '12.129', 'FRAGCOUNT': '42.000'} [2023-02-24 21:23:54,741][213382] DAMAGECOUNT value on done: 584759.0 [2023-02-24 21:23:54,742][213382] Sum rewards: 46.025, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.660', 'AMMO2': '0.009', 'AMMO5': '0.010', 'weapon4': '0.016', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'weapon5': '0.146', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.644', 'WEAPON3': '1.400', 'HITCOUNT': '2.670', 'weapon3': '3.000', 'DAMAGECOUNT': '11.730', 'FRAGCOUNT': '42.000'} [2023-02-24 21:23:54,749][213383] DAMAGECOUNT value on done: 594929.0 [2023-02-24 21:23:54,750][213383] Sum rewards: 47.271, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.450', 'AMMO5': '0.006', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon5': '0.130', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'weapon4': '0.458', 'weapon2': '0.498', 'WEAPON3': '1.350', 'weapon3': '2.702', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.597', 'FRAGCOUNT': '44.000'} [2023-02-24 21:23:54,846][213368] DAMAGECOUNT value on done: 590639.0 [2023-02-24 21:23:54,847][213368] Sum rewards: 56.939, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.723', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.049', 'AMMO3': '0.139', 'AMMO4': '0.246', 'weapon5': '0.292', 'weapon2': '0.328', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '0.850', 'weapon4': '0.892', 'weapon3': '2.184', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '47.000'} [2023-02-24 21:23:55,044][213383] DAMAGECOUNT value on done: 592554.0 [2023-02-24 21:23:55,045][213383] Sum rewards: 59.664, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.727', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.030', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon5': '0.186', 'weapon2': '0.270', 'WEAPON4': '0.350', 'weapon4': '0.632', 'WEAPON3': '1.100', 'weapon3': '2.552', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.588', 'FRAGCOUNT': '51.000'} [2023-02-24 21:23:55,046][213382] DAMAGECOUNT value on done: 591112.0 [2023-02-24 21:23:55,047][213382] Sum rewards: 55.387, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.800', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'weapon4': '0.118', 'weapon5': '0.124', 'WEAPON5': '0.150', 'weapon2': '0.198', 'AMMO3': '0.237', 'WEAPON3': '1.400', 'HITCOUNT': '2.930', 'weapon3': '3.332', 'DAMAGECOUNT': '14.784', 'FRAGCOUNT': '48.000'} [2023-02-24 21:23:55,210][213384] DAMAGECOUNT value on done: 596777.0 [2023-02-24 21:23:55,211][213384] Sum rewards: 41.155, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.998', 'AMMO5': '0.016', 'AMMO2': '0.039', 'AMMO3': '0.148', 'AMMO4': '0.197', 'weapon5': '0.298', 'WEAPON5': '0.450', 'weapon2': '0.584', 'WEAPON4': '0.700', 'WEAPON3': '0.800', 'weapon4': '1.134', 'weapon3': '1.708', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.798', 'FRAGCOUNT': '35.000'} [2023-02-24 21:23:55,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13789.9, 300 sec: 13857.0). Total num frames: 148131840. Throughput: 0: 3458.6. Samples: 12025774. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:23:55,243][213332] Avg episode reward: [(0, '49.030')] [2023-02-24 21:23:55,313][213365] Updated weights for policy 0, policy_version 36166 (0.0009) [2023-02-24 21:23:55,511][213384] DAMAGECOUNT value on done: 583221.0 [2023-02-24 21:23:55,511][213384] Sum rewards: 52.758, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.608', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.156', 'AMMO3': '0.167', 'AMMO4': '0.239', 'weapon2': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.600', 'weapon4': '0.804', 'WEAPON3': '1.000', 'weapon3': '2.478', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.196', 'FRAGCOUNT': '47.000'} [2023-02-24 21:23:55,924][213384] DAMAGECOUNT value on done: 593298.0 [2023-02-24 21:23:55,925][213384] Sum rewards: 52.009, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.290', 'AMMO5': '0.008', 'AMMO2': '0.046', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'AMMO4': '0.232', 'weapon2': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.606', 'WEAPON3': '1.000', 'weapon3': '2.806', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.515', 'FRAGCOUNT': '43.000'} [2023-02-24 21:23:56,235][213384] DAMAGECOUNT value on done: 596182.0 [2023-02-24 21:23:56,236][213384] Sum rewards: 45.788, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.365', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.050', 'weapon4': '0.064', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.246', 'weapon2': '0.546', 'WEAPON3': '1.500', 'HITCOUNT': '2.820', 'weapon3': '3.134', 'DAMAGECOUNT': '12.750', 'FRAGCOUNT': '42.000'} [2023-02-24 21:23:58,287][213365] Updated weights for policy 0, policy_version 36176 (0.0009) [2023-02-24 21:24:00,243][213332] Fps is (10 sec: 13926.2, 60 sec: 13789.9, 300 sec: 13857.0). Total num frames: 148201472. Throughput: 0: 3458.7. Samples: 12046558. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:24:00,243][213332] Avg episode reward: [(0, '49.268')] [2023-02-24 21:24:01,242][213365] Updated weights for policy 0, policy_version 36186 (0.0009) [2023-02-24 21:24:04,201][213365] Updated weights for policy 0, policy_version 36196 (0.0009) [2023-02-24 21:24:04,298][213367] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 21:24:05,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13789.8, 300 sec: 13857.0). Total num frames: 148271104. Throughput: 0: 3458.7. Samples: 12056936. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:24:05,244][213332] Avg episode reward: [(0, '49.268')] [2023-02-24 21:24:07,184][213365] Updated weights for policy 0, policy_version 36206 (0.0009) [2023-02-24 21:24:10,128][213365] Updated weights for policy 0, policy_version 36216 (0.0009) [2023-02-24 21:24:10,240][213367] DAMAGECOUNT value on done: 595274.0 [2023-02-24 21:24:10,240][213367] Sum rewards: 39.635, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.918', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.067', 'AMMO3': '0.190', 'AMMO4': '0.337', 'weapon5': '0.346', 'weapon2': '0.408', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon4': '0.936', 'WEAPON3': '1.150', 'weapon3': '1.746', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '11.667', 'FRAGCOUNT': '37.000'} [2023-02-24 21:24:10,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 148340736. Throughput: 0: 3460.1. Samples: 12077700. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:24:10,243][213332] Avg episode reward: [(0, '49.268')] [2023-02-24 21:24:10,343][213367] DAMAGECOUNT value on done: 595514.0 [2023-02-24 21:24:10,343][213367] Sum rewards: 65.736, reward structure: {'DEATHCOUNT': '-11.250', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO5': '0.015', 'AMMO4': '0.071', 'HEALTH': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.120', 'AMMO3': '0.145', 'weapon5': '0.272', 'WEAPON5': '0.350', 'weapon2': '0.682', 'WEAPON3': '0.850', 'weapon3': '2.654', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.573', 'FRAGCOUNT': '53.000'} [2023-02-24 21:24:10,549][213367] DAMAGECOUNT value on done: 594773.0 [2023-02-24 21:24:10,550][213367] Sum rewards: 45.390, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.310', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.043', 'AMMO3': '0.141', 'AMMO4': '0.216', 'weapon5': '0.340', 'weapon2': '0.454', 'WEAPON5': '0.500', 'weapon4': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '0.950', 'weapon3': '2.452', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '13.251', 'FRAGCOUNT': '38.500'} [2023-02-24 21:24:10,658][213367] DAMAGECOUNT value on done: 604204.0 [2023-02-24 21:24:10,659][213367] Sum rewards: 37.368, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.112', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon5': '0.150', 'AMMO3': '0.190', 'AMMO4': '0.267', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.530', 'weapon4': '0.736', 'WEAPON3': '1.100', 'weapon3': '2.312', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '11.652', 'FRAGCOUNT': '34.000'} [2023-02-24 21:24:11,454][213372] DAMAGECOUNT value on done: 614707.0 [2023-02-24 21:24:11,455][213372] Sum rewards: 43.324, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.350', 'AMMO5': '0.016', 'AMMO2': '0.039', 'AMMO4': '0.196', 'weapon2': '0.234', 'AMMO3': '0.257', 'weapon5': '0.296', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.786', 'WEAPON3': '1.500', 'weapon3': '2.312', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '14.187', 'FRAGCOUNT': '42.000'} [2023-02-24 21:24:11,755][213372] DAMAGECOUNT value on done: 593758.0 [2023-02-24 21:24:11,756][213372] Sum rewards: 47.877, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.270', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon2': '0.398', 'WEAPON3': '1.150', 'HITCOUNT': '2.720', 'weapon3': '3.190', 'DAMAGECOUNT': '12.462', 'FRAGCOUNT': '42.000'} [2023-02-24 21:24:11,764][213372] DAMAGECOUNT value on done: 602670.0 [2023-02-24 21:24:11,765][213372] Sum rewards: 44.179, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.284', 'AMMO5': '0.017', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon4': '0.172', 'AMMO3': '0.185', 'weapon5': '0.198', 'WEAPON4': '0.300', 'weapon2': '0.340', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '2.540', 'weapon3': '2.990', 'DAMAGECOUNT': '12.141', 'FRAGCOUNT': '39.000'} [2023-02-24 21:24:12,067][213372] DAMAGECOUNT value on done: 593752.0 [2023-02-24 21:24:12,067][213372] Sum rewards: 55.994, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.900', 'weapon5': '0.014', 'AMMO5': '0.015', 'AMMO2': '0.019', 'weapon4': '0.044', 'AMMO4': '0.093', 'WEAPON4': '0.200', 'AMMO3': '0.241', 'weapon2': '0.272', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.010', 'weapon3': '3.434', 'DAMAGECOUNT': '14.352', 'FRAGCOUNT': '50.000'} [2023-02-24 21:24:12,294][213366] DAMAGECOUNT value on done: 590271.0 [2023-02-24 21:24:12,294][213366] Sum rewards: 38.990, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.558', 'ARMOR': '0.008', 'AMMO5': '0.023', 'AMMO2': '0.069', 'weapon7': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.127', 'WEAPON7': '0.200', 'weapon2': '0.218', 'weapon5': '0.306', 'AMMO4': '0.346', 'WEAPON5': '0.600', 'WEAPON4': '0.750', 'WEAPON3': '0.800', 'weapon3': '1.484', 'weapon4': '1.556', 'HITCOUNT': '2.260', 'DAMAGECOUNT': '11.985', 'FRAGCOUNT': '34.000'} [2023-02-24 21:24:12,592][213366] DAMAGECOUNT value on done: 603971.0 [2023-02-24 21:24:12,592][213366] Sum rewards: 51.648, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.402', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO4': '0.179', 'AMMO3': '0.210', 'weapon5': '0.262', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON4': '0.450', 'weapon4': '0.480', 'WEAPON3': '1.250', 'HITCOUNT': '2.660', 'weapon3': '2.678', 'DAMAGECOUNT': '13.965', 'FRAGCOUNT': '47.000'} [2023-02-24 21:24:12,614][213366] DAMAGECOUNT value on done: 615661.0 [2023-02-24 21:24:12,614][213366] Sum rewards: 45.264, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.422', 'AMMO2': '0.001', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.005', 'weapon5': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.175', 'weapon4': '0.234', 'weapon2': '0.528', 'WEAPON3': '1.150', 'HITCOUNT': '2.360', 'weapon3': '3.052', 'DAMAGECOUNT': '10.746', 'FRAGCOUNT': '39.000'} [2023-02-24 21:24:12,921][213366] DAMAGECOUNT value on done: 604067.0 [2023-02-24 21:24:12,922][213366] Sum rewards: 49.239, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.788', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.156', 'AMMO3': '0.172', 'weapon2': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'weapon4': '1.134', 'weapon3': '2.282', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.666', 'FRAGCOUNT': '41.000'} [2023-02-24 21:24:13,023][213383] DAMAGECOUNT value on done: 600106.0 [2023-02-24 21:24:13,024][213383] Sum rewards: 69.230, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.939', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.150', 'AMMO3': '0.155', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.468', 'weapon2': '0.542', 'WEAPON3': '1.000', 'weapon3': '2.662', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '57.000'} [2023-02-24 21:24:13,092][213365] Updated weights for policy 0, policy_version 36226 (0.0009) [2023-02-24 21:24:13,205][213369] DAMAGECOUNT value on done: 601167.0 [2023-02-24 21:24:13,206][213369] Sum rewards: 60.582, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.883', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.136', 'AMMO4': '0.154', 'AMMO3': '0.181', 'weapon2': '0.232', 'weapon4': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.140', 'weapon3': '3.168', 'DAMAGECOUNT': '14.979', 'FRAGCOUNT': '51.000'} [2023-02-24 21:24:13,320][213383] DAMAGECOUNT value on done: 596103.0 [2023-02-24 21:24:13,321][213383] Sum rewards: 45.842, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.517', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.056', 'AMMO3': '0.177', 'weapon5': '0.192', 'AMMO4': '0.279', 'WEAPON5': '0.300', 'weapon2': '0.470', 'WEAPON4': '0.700', 'WEAPON3': '1.000', 'weapon4': '1.150', 'weapon3': '1.898', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '12.201', 'FRAGCOUNT': '43.000'} [2023-02-24 21:24:13,337][213382] DAMAGECOUNT value on done: 602826.0 [2023-02-24 21:24:13,338][213382] Sum rewards: 39.811, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.460', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.036', 'AMMO4': '0.178', 'weapon2': '0.198', 'AMMO3': '0.220', 'weapon5': '0.224', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.858', 'WEAPON3': '1.300', 'weapon3': '2.436', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '11.403', 'FRAGCOUNT': '37.000'} [2023-02-24 21:24:13,352][213368] DAMAGECOUNT value on done: 591641.0 [2023-02-24 21:24:13,353][213368] Sum rewards: 60.198, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.305', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.166', 'weapon5': '0.172', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.404', 'weapon4': '0.518', 'WEAPON3': '1.150', 'weapon3': '2.678', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.421', 'FRAGCOUNT': '52.000'} [2023-02-24 21:24:13,503][213369] DAMAGECOUNT value on done: 603652.0 [2023-02-24 21:24:13,503][213369] Sum rewards: 48.665, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.550', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.031', 'AMMO3': '0.150', 'weapon4': '0.150', 'AMMO4': '0.155', 'weapon5': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.422', 'WEAPON3': '1.100', 'HITCOUNT': '2.680', 'weapon3': '2.976', 'DAMAGECOUNT': '13.191', 'FRAGCOUNT': '40.000'} [2023-02-24 21:24:13,631][213382] DAMAGECOUNT value on done: 598544.0 [2023-02-24 21:24:13,632][213382] Sum rewards: 44.443, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.828', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.037', 'AMMO3': '0.164', 'AMMO4': '0.185', 'weapon5': '0.204', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.508', 'weapon2': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.430', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '12.174', 'FRAGCOUNT': '40.000'} [2023-02-24 21:24:13,638][213368] DAMAGECOUNT value on done: 599918.0 [2023-02-24 21:24:13,638][213368] Sum rewards: 61.087, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.124', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'weapon4': '0.158', 'AMMO4': '0.169', 'AMMO3': '0.242', 'weapon2': '0.246', 'WEAPON3': '1.550', 'HITCOUNT': '3.250', 'weapon3': '3.322', 'DAMAGECOUNT': '14.241', 'FRAGCOUNT': '55.000'} [2023-02-24 21:24:13,790][213369] DAMAGECOUNT value on done: 598750.0 [2023-02-24 21:24:13,790][213369] Sum rewards: 48.372, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.236', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.018', 'AMMO4': '0.027', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.170', 'AMMO3': '0.337', 'WEAPON3': '2.000', 'HITCOUNT': '2.750', 'weapon3': '3.534', 'DAMAGECOUNT': '13.626', 'FRAGCOUNT': '47.000'} [2023-02-24 21:24:13,915][213368] DAMAGECOUNT value on done: 596157.0 [2023-02-24 21:24:13,916][213368] Sum rewards: 42.806, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.330', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.106', 'weapon2': '0.118', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon4': '0.734', 'WEAPON3': '1.150', 'HITCOUNT': '2.350', 'weapon3': '2.758', 'DAMAGECOUNT': '10.467', 'FRAGCOUNT': '38.500'} [2023-02-24 21:24:14,092][213369] DAMAGECOUNT value on done: 587242.0 [2023-02-24 21:24:14,093][213369] Sum rewards: 47.562, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.217', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.122', 'AMMO3': '0.165', 'AMMO4': '0.191', 'weapon4': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.848', 'WEAPON3': '0.950', 'weapon3': '2.586', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.468', 'FRAGCOUNT': '40.500'} [2023-02-24 21:24:14,108][213382] DAMAGECOUNT value on done: 589401.0 [2023-02-24 21:24:14,108][213382] Sum rewards: 54.980, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.843', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.120', 'AMMO3': '0.165', 'AMMO4': '0.178', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.432', 'weapon2': '0.458', 'WEAPON3': '0.950', 'weapon3': '2.778', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.926', 'FRAGCOUNT': '45.000'} [2023-02-24 21:24:14,166][213383] DAMAGECOUNT value on done: 599182.0 [2023-02-24 21:24:14,166][213383] Sum rewards: 47.784, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon7': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.126', 'AMMO4': '0.162', 'AMMO3': '0.172', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HEALTH': '0.334', 'weapon2': '0.408', 'weapon4': '0.538', 'WEAPON3': '0.950', 'weapon3': '2.598', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.759', 'FRAGCOUNT': '41.000'} [2023-02-24 21:24:14,218][213368] DAMAGECOUNT value on done: 593369.0 [2023-02-24 21:24:14,219][213368] Sum rewards: 26.817, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.890', 'AMMO2': '0.019', 'AMMO4': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.154', 'weapon2': '0.454', 'weapon4': '0.710', 'WEAPON3': '0.950', 'HITCOUNT': '1.820', 'weapon3': '2.468', 'DAMAGECOUNT': '8.190', 'FRAGCOUNT': '23.000'} [2023-02-24 21:24:14,412][213382] DAMAGECOUNT value on done: 596054.0 [2023-02-24 21:24:14,413][213382] Sum rewards: 51.590, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.900', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon5': '0.102', 'weapon4': '0.188', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.444', 'WEAPON3': '1.350', 'HITCOUNT': '3.000', 'weapon3': '3.012', 'DAMAGECOUNT': '14.826', 'FRAGCOUNT': '45.000'} [2023-02-24 21:24:14,462][213383] DAMAGECOUNT value on done: 596460.0 [2023-02-24 21:24:14,463][213383] Sum rewards: 41.227, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.456', 'AMMO2': '0.052', 'AMMO3': '0.186', 'AMMO4': '0.259', 'WEAPON4': '0.400', 'ARMOR': '0.404', 'weapon2': '0.472', 'weapon4': '1.032', 'WEAPON3': '1.100', 'weapon3': '2.240', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '11.718', 'FRAGCOUNT': '36.000'} [2023-02-24 21:24:14,702][213384] DAMAGECOUNT value on done: 601510.0 [2023-02-24 21:24:14,702][213384] Sum rewards: 52.437, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.055', 'AMMO5': '0.020', 'AMMO2': '0.060', 'AMMO3': '0.178', 'weapon4': '0.294', 'AMMO4': '0.302', 'weapon2': '0.342', 'weapon5': '0.452', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.604', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.199', 'FRAGCOUNT': '47.500'} [2023-02-24 21:24:15,002][213384] DAMAGECOUNT value on done: 586712.0 [2023-02-24 21:24:15,003][213384] Sum rewards: 33.217, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.810', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.166', 'AMMO4': '0.230', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON4': '0.500', 'weapon4': '0.936', 'WEAPON3': '1.400', 'weapon3': '2.230', 'HITCOUNT': '2.260', 'DAMAGECOUNT': '10.428', 'FRAGCOUNT': '35.000'} [2023-02-24 21:24:15,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13858.2, 300 sec: 13857.0). Total num frames: 148410368. Throughput: 0: 3457.8. Samples: 12098424. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:24:15,243][213332] Avg episode reward: [(0, '48.868')] [2023-02-24 21:24:15,379][213384] DAMAGECOUNT value on done: 598179.0 [2023-02-24 21:24:15,379][213384] Sum rewards: 52.454, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.118', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.174', 'AMMO3': '0.191', 'weapon4': '0.510', 'weapon2': '0.578', 'WEAPON3': '1.200', 'weapon3': '2.538', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.643', 'FRAGCOUNT': '44.000'} [2023-02-24 21:24:15,680][213384] DAMAGECOUNT value on done: 601009.0 [2023-02-24 21:24:15,681][213384] Sum rewards: 56.379, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.679', 'AMMO5': '0.020', 'AMMO2': '0.041', 'AMMO4': '0.205', 'AMMO3': '0.209', 'weapon2': '0.232', 'weapon5': '0.250', 'weapon4': '0.382', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.828', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.481', 'FRAGCOUNT': '50.000'} [2023-02-24 21:24:16,037][213365] Updated weights for policy 0, policy_version 36236 (0.0009) [2023-02-24 21:24:18,992][213365] Updated weights for policy 0, policy_version 36246 (0.0009) [2023-02-24 21:24:20,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 148480000. Throughput: 0: 3457.2. Samples: 12108842. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:24:20,243][213332] Avg episode reward: [(0, '49.146')] [2023-02-24 21:24:21,969][213365] Updated weights for policy 0, policy_version 36256 (0.0009) [2023-02-24 21:24:24,944][213365] Updated weights for policy 0, policy_version 36266 (0.0009) [2023-02-24 21:24:25,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13789.9, 300 sec: 13843.1). Total num frames: 148545536. Throughput: 0: 3459.0. Samples: 12129566. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:24:25,243][213332] Avg episode reward: [(0, '49.146')] [2023-02-24 21:24:27,913][213365] Updated weights for policy 0, policy_version 36276 (0.0009) [2023-02-24 21:24:29,687][213367] DAMAGECOUNT value on done: 599664.0 [2023-02-24 21:24:29,687][213367] Sum rewards: 48.577, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.555', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO3': '0.178', 'AMMO4': '0.184', 'weapon5': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.412', 'weapon4': '0.580', 'weapon2': '0.640', 'WEAPON3': '1.050', 'weapon3': '2.250', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.170', 'FRAGCOUNT': '42.000'} [2023-02-24 21:24:29,767][213367] DAMAGECOUNT value on done: 599448.0 [2023-02-24 21:24:29,768][213367] Sum rewards: 38.023, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.292', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.098', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.416', 'WEAPON4': '0.450', 'weapon4': '0.946', 'WEAPON3': '1.100', 'weapon3': '2.328', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '11.802', 'FRAGCOUNT': '33.000'} [2023-02-24 21:24:29,992][213367] DAMAGECOUNT value on done: 599384.0 [2023-02-24 21:24:29,992][213367] Sum rewards: 49.993, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.971', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon5': '0.180', 'AMMO3': '0.229', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.366', 'weapon4': '0.386', 'WEAPON3': '1.300', 'weapon3': '2.728', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.833', 'FRAGCOUNT': '44.000'} [2023-02-24 21:24:30,072][213367] DAMAGECOUNT value on done: 608988.0 [2023-02-24 21:24:30,072][213367] Sum rewards: 51.045, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.984', 'AMMO5': '0.009', 'AMMO2': '0.014', 'AMMO4': '0.067', 'weapon4': '0.146', 'WEAPON4': '0.150', 'weapon5': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.332', 'WEAPON3': '1.300', 'HITCOUNT': '2.670', 'weapon3': '3.132', 'DAMAGECOUNT': '14.352', 'FRAGCOUNT': '45.000'} [2023-02-24 21:24:30,243][213332] Fps is (10 sec: 13516.9, 60 sec: 13789.9, 300 sec: 13857.0). Total num frames: 148615168. Throughput: 0: 3458.4. Samples: 12150330. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:24:30,243][213332] Avg episode reward: [(0, '49.177')] [2023-02-24 21:24:30,838][213365] Updated weights for policy 0, policy_version 36286 (0.0009) [2023-02-24 21:24:30,878][213372] DAMAGECOUNT value on done: 619260.0 [2023-02-24 21:24:30,878][213372] Sum rewards: 46.530, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.180', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.042', 'AMMO3': '0.167', 'AMMO4': '0.209', 'weapon4': '0.264', 'weapon5': '0.320', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.438', 'WEAPON3': '1.100', 'HITCOUNT': '2.570', 'weapon3': '2.674', 'DAMAGECOUNT': '13.659', 'FRAGCOUNT': '40.000'} [2023-02-24 21:24:31,178][213372] DAMAGECOUNT value on done: 606671.0 [2023-02-24 21:24:31,179][213372] Sum rewards: 44.412, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.007', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.028', 'AMMO4': '0.141', 'AMMO3': '0.186', 'weapon5': '0.232', 'WEAPON5': '0.350', 'weapon4': '0.370', 'WEAPON4': '0.400', 'weapon2': '0.540', 'WEAPON3': '1.150', 'weapon3': '2.598', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '12.003', 'FRAGCOUNT': '40.000'} [2023-02-24 21:24:31,191][213372] DAMAGECOUNT value on done: 598295.0 [2023-02-24 21:24:31,191][213372] Sum rewards: 54.386, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.305', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.038', 'AMMO4': '0.067', 'weapon5': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.165', 'weapon2': '0.560', 'WEAPON3': '1.050', 'HITCOUNT': '3.000', 'weapon3': '3.166', 'DAMAGECOUNT': '13.611', 'FRAGCOUNT': '45.000'} [2023-02-24 21:24:31,499][213372] DAMAGECOUNT value on done: 597132.0 [2023-02-24 21:24:31,499][213372] Sum rewards: 38.822, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.664', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.042', 'AMMO3': '0.083', 'AMMO4': '0.208', 'weapon5': '0.340', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON4': '0.450', 'WEAPON3': '0.500', 'weapon4': '0.946', 'weapon3': '1.976', 'HITCOUNT': '2.060', 'DAMAGECOUNT': '10.140', 'FRAGCOUNT': '32.500'} [2023-02-24 21:24:31,771][213366] DAMAGECOUNT value on done: 594337.0 [2023-02-24 21:24:31,771][213366] Sum rewards: 47.558, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.348', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.150', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.264', 'weapon4': '0.452', 'WEAPON3': '1.100', 'HITCOUNT': '2.730', 'weapon3': '2.954', 'DAMAGECOUNT': '12.198', 'FRAGCOUNT': '39.500'} [2023-02-24 21:24:32,073][213366] DAMAGECOUNT value on done: 608461.0 [2023-02-24 21:24:32,073][213366] Sum rewards: 56.274, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.795', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon5': '0.070', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'weapon2': '0.196', 'AMMO3': '0.206', 'weapon4': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.010', 'weapon3': '3.108', 'DAMAGECOUNT': '13.470', 'FRAGCOUNT': '51.000'} [2023-02-24 21:24:32,083][213366] DAMAGECOUNT value on done: 620220.0 [2023-02-24 21:24:32,083][213366] Sum rewards: 55.281, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.350', 'AMMO5': '0.009', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.154', 'AMMO3': '0.160', 'weapon4': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.538', 'WEAPON3': '1.050', 'HITCOUNT': '2.720', 'weapon3': '2.784', 'DAMAGECOUNT': '13.677', 'FRAGCOUNT': '47.000'} [2023-02-24 21:24:32,378][213366] DAMAGECOUNT value on done: 608055.0 [2023-02-24 21:24:32,379][213366] Sum rewards: 52.531, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.873', 'AMMO5': '0.017', 'AMMO2': '0.021', 'AMMO4': '0.102', 'weapon4': '0.108', 'AMMO3': '0.178', 'weapon5': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.388', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.680', 'weapon3': '3.056', 'DAMAGECOUNT': '11.964', 'FRAGCOUNT': '47.500'} [2023-02-24 21:24:32,475][213383] DAMAGECOUNT value on done: 605235.0 [2023-02-24 21:24:32,476][213383] Sum rewards: 56.731, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.750', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.006', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'weapon4': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.254', 'weapon2': '0.438', 'WEAPON3': '1.450', 'HITCOUNT': '3.130', 'weapon3': '3.202', 'DAMAGECOUNT': '15.387', 'FRAGCOUNT': '50.000'} [2023-02-24 21:24:32,618][213369] DAMAGECOUNT value on done: 604911.0 [2023-02-24 21:24:32,619][213369] Sum rewards: 35.450, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.996', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.148', 'weapon2': '0.220', 'AMMO3': '0.233', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '1.106', 'WEAPON3': '1.300', 'weapon3': '2.158', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '11.232', 'FRAGCOUNT': '34.000'} [2023-02-24 21:24:32,762][213368] DAMAGECOUNT value on done: 596074.0 [2023-02-24 21:24:32,762][213368] Sum rewards: 48.578, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.745', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.042', 'WEAPON5': '0.150', 'AMMO4': '0.177', 'AMMO3': '0.186', 'weapon2': '0.436', 'WEAPON4': '0.550', 'weapon4': '0.908', 'WEAPON3': '1.100', 'weapon3': '2.322', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.299', 'FRAGCOUNT': '44.000'} [2023-02-24 21:24:32,770][213383] DAMAGECOUNT value on done: 601100.0 [2023-02-24 21:24:32,770][213383] Sum rewards: 57.420, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.254', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.052', 'weapon4': '0.058', 'WEAPON4': '0.100', 'weapon5': '0.100', 'WEAPON5': '0.150', 'weapon2': '0.232', 'AMMO3': '0.233', 'WEAPON3': '1.450', 'HITCOUNT': '3.160', 'weapon3': '3.372', 'DAMAGECOUNT': '14.991', 'FRAGCOUNT': '50.000'} [2023-02-24 21:24:32,836][213382] DAMAGECOUNT value on done: 607500.0 [2023-02-24 21:24:32,837][213382] Sum rewards: 52.154, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.890', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.033', 'AMMO3': '0.164', 'AMMO4': '0.166', 'weapon5': '0.184', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.446', 'weapon4': '0.942', 'WEAPON3': '1.100', 'weapon3': '2.202', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.827', 'FRAGCOUNT': '45.000'} [2023-02-24 21:24:32,919][213369] DAMAGECOUNT value on done: 607591.0 [2023-02-24 21:24:32,919][213369] Sum rewards: 44.627, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.580', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.112', 'AMMO4': '0.122', 'AMMO3': '0.179', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.344', 'weapon2': '0.376', 'WEAPON3': '1.100', 'HITCOUNT': '2.460', 'weapon3': '2.862', 'DAMAGECOUNT': '11.817', 'FRAGCOUNT': '39.000'} [2023-02-24 21:24:33,066][213368] DAMAGECOUNT value on done: 604265.0 [2023-02-24 21:24:33,066][213368] Sum rewards: 49.670, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.274', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'weapon5': '0.088', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon2': '0.408', 'weapon4': '0.718', 'WEAPON3': '1.100', 'weapon3': '2.510', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.041', 'FRAGCOUNT': '42.000'} [2023-02-24 21:24:33,136][213382] DAMAGECOUNT value on done: 603052.0 [2023-02-24 21:24:33,137][213382] Sum rewards: 45.450, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.318', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.041', 'weapon5': '0.100', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'AMMO4': '0.205', 'WEAPON4': '0.350', 'weapon2': '0.554', 'weapon4': '0.714', 'WEAPON3': '1.050', 'weapon3': '2.382', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.524', 'FRAGCOUNT': '38.000'} [2023-02-24 21:24:33,199][213369] DAMAGECOUNT value on done: 602773.0 [2023-02-24 21:24:33,200][213369] Sum rewards: 48.841, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.853', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon5': '0.214', 'WEAPON5': '0.350', 'weapon4': '0.422', 'weapon2': '0.586', 'WEAPON3': '1.050', 'weapon3': '2.572', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '12.069', 'FRAGCOUNT': '43.000'} [2023-02-24 21:24:33,355][213368] DAMAGECOUNT value on done: 599479.0 [2023-02-24 21:24:33,355][213368] Sum rewards: 32.257, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.790', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.018', 'weapon5': '0.046', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'WEAPON4': '0.400', 'weapon4': '0.528', 'weapon2': '0.568', 'WEAPON3': '1.050', 'weapon3': '2.396', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '9.966', 'FRAGCOUNT': '30.000'} [2023-02-24 21:24:33,496][213369] DAMAGECOUNT value on done: 592110.0 [2023-02-24 21:24:33,496][213369] Sum rewards: 55.189, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.238', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON4': '0.200', 'weapon2': '0.210', 'weapon4': '0.264', 'AMMO3': '0.269', 'WEAPON3': '1.750', 'weapon3': '3.354', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '14.604', 'FRAGCOUNT': '51.000'} [2023-02-24 21:24:33,610][213382] DAMAGECOUNT value on done: 594497.0 [2023-02-24 21:24:33,610][213382] Sum rewards: 58.630, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.440', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon5': '0.066', 'AMMO4': '0.173', 'weapon4': '0.212', 'weapon2': '0.218', 'AMMO3': '0.219', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.270', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.288', 'FRAGCOUNT': '52.000'} [2023-02-24 21:24:33,619][213383] DAMAGECOUNT value on done: 603525.0 [2023-02-24 21:24:33,619][213383] Sum rewards: 52.902, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.235', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.149', 'AMMO3': '0.228', 'weapon2': '0.230', 'WEAPON4': '0.350', 'weapon4': '0.854', 'WEAPON3': '1.400', 'weapon3': '2.650', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.029', 'FRAGCOUNT': '48.000'} [2023-02-24 21:24:33,655][213368] DAMAGECOUNT value on done: 597680.0 [2023-02-24 21:24:33,655][213368] Sum rewards: 47.186, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.398', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.126', 'weapon4': '0.148', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.432', 'WEAPON3': '1.350', 'HITCOUNT': '2.800', 'weapon3': '3.078', 'DAMAGECOUNT': '12.933', 'FRAGCOUNT': '43.000'} [2023-02-24 21:24:33,807][213365] Updated weights for policy 0, policy_version 36296 (0.0009) [2023-02-24 21:24:33,909][213382] DAMAGECOUNT value on done: 600434.0 [2023-02-24 21:24:33,909][213382] Sum rewards: 51.737, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.144', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.118', 'weapon4': '0.130', 'WEAPON4': '0.150', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.638', 'WEAPON3': '1.200', 'HITCOUNT': '2.730', 'weapon3': '2.926', 'DAMAGECOUNT': '13.140', 'FRAGCOUNT': '44.000'} [2023-02-24 21:24:33,925][213383] DAMAGECOUNT value on done: 600198.0 [2023-02-24 21:24:33,925][213383] Sum rewards: 42.514, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.865', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon5': '0.086', 'AMMO4': '0.089', 'weapon4': '0.096', 'WEAPON4': '0.150', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'weapon2': '0.712', 'WEAPON3': '1.300', 'HITCOUNT': '2.410', 'weapon3': '2.840', 'DAMAGECOUNT': '11.214', 'FRAGCOUNT': '38.000'} [2023-02-24 21:24:34,160][213384] DAMAGECOUNT value on done: 605518.0 [2023-02-24 21:24:34,160][213384] Sum rewards: 42.929, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.816', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon5': '0.092', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'WEAPON4': '0.400', 'weapon2': '0.438', 'WEAPON3': '0.900', 'weapon4': '1.352', 'weapon3': '1.878', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '12.024', 'FRAGCOUNT': '36.500'} [2023-02-24 21:24:34,456][213384] DAMAGECOUNT value on done: 591616.0 [2023-02-24 21:24:34,457][213384] Sum rewards: 54.573, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.995', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.040', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.178', 'AMMO3': '0.202', 'weapon4': '0.244', 'WEAPON3': '1.200', 'HITCOUNT': '3.070', 'weapon3': '3.384', 'DAMAGECOUNT': '14.712', 'FRAGCOUNT': '45.000'} [2023-02-24 21:24:34,826][213384] DAMAGECOUNT value on done: 601827.0 [2023-02-24 21:24:34,826][213384] Sum rewards: 32.327, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.684', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'weapon5': '0.184', 'WEAPON4': '0.250', 'AMMO3': '0.297', 'weapon2': '0.392', 'weapon4': '0.632', 'WEAPON3': '1.650', 'weapon3': '2.450', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '10.944', 'FRAGCOUNT': '34.000'} [2023-02-24 21:24:35,126][213384] DAMAGECOUNT value on done: 604214.0 [2023-02-24 21:24:35,127][213384] Sum rewards: 30.573, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.825', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.048', 'weapon5': '0.060', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon2': '0.214', 'AMMO4': '0.237', 'WEAPON4': '0.650', 'weapon4': '0.860', 'WEAPON3': '1.200', 'HITCOUNT': '2.250', 'weapon3': '2.650', 'DAMAGECOUNT': '9.615', 'FRAGCOUNT': '31.000'} [2023-02-24 21:24:35,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13857.0). Total num frames: 148684800. Throughput: 0: 3456.4. Samples: 12160644. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:24:35,243][213332] Avg episode reward: [(0, '48.382')] [2023-02-24 21:24:36,714][213365] Updated weights for policy 0, policy_version 36306 (0.0008) [2023-02-24 21:24:39,668][213365] Updated weights for policy 0, policy_version 36316 (0.0009) [2023-02-24 21:24:40,243][213332] Fps is (10 sec: 13926.2, 60 sec: 13789.8, 300 sec: 13857.0). Total num frames: 148754432. Throughput: 0: 3458.7. Samples: 12181418. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:24:40,243][213332] Avg episode reward: [(0, '48.382')] [2023-02-24 21:24:42,607][213365] Updated weights for policy 0, policy_version 36326 (0.0009) [2023-02-24 21:24:45,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13789.9, 300 sec: 13857.0). Total num frames: 148824064. Throughput: 0: 3461.4. Samples: 12202322. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:24:45,243][213332] Avg episode reward: [(0, '48.382')] [2023-02-24 21:24:45,263][213352] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000036335_148828160.pth... [2023-02-24 21:24:45,316][213352] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000035523_145502208.pth [2023-02-24 21:24:45,576][213365] Updated weights for policy 0, policy_version 36336 (0.0009) [2023-02-24 21:24:48,537][213365] Updated weights for policy 0, policy_version 36346 (0.0009) [2023-02-24 21:24:49,128][213367] DAMAGECOUNT value on done: 603762.0 [2023-02-24 21:24:49,129][213367] Sum rewards: 46.173, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.343', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon5': '0.146', 'AMMO4': '0.162', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.304', 'weapon4': '0.616', 'WEAPON3': '1.350', 'HITCOUNT': '2.630', 'weapon3': '2.640', 'DAMAGECOUNT': '12.294', 'FRAGCOUNT': '43.000'} [2023-02-24 21:24:49,208][213367] DAMAGECOUNT value on done: 604371.0 [2023-02-24 21:24:49,209][213367] Sum rewards: 53.900, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.678', 'AMMO5': '0.018', 'AMMO2': '0.041', 'AMMO3': '0.172', 'AMMO4': '0.204', 'weapon2': '0.252', 'weapon5': '0.366', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.730', 'WEAPON3': '1.050', 'weapon3': '2.306', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.769', 'FRAGCOUNT': '46.000'} [2023-02-24 21:24:49,438][213367] DAMAGECOUNT value on done: 603358.0 [2023-02-24 21:24:49,439][213367] Sum rewards: 42.013, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.860', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.072', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'weapon2': '0.336', 'weapon4': '0.424', 'WEAPON3': '1.200', 'HITCOUNT': '2.630', 'weapon3': '2.958', 'DAMAGECOUNT': '11.922', 'FRAGCOUNT': '37.000'} [2023-02-24 21:24:49,519][213367] DAMAGECOUNT value on done: 613339.0 [2023-02-24 21:24:49,519][213367] Sum rewards: 46.003, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.595', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.052', 'AMMO4': '0.139', 'weapon5': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'weapon2': '0.422', 'WEAPON3': '1.550', 'HITCOUNT': '2.510', 'weapon3': '3.152', 'DAMAGECOUNT': '13.053', 'FRAGCOUNT': '43.500'} [2023-02-24 21:24:50,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 148893696. Throughput: 0: 3460.7. Samples: 12212668. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:24:50,243][213332] Avg episode reward: [(0, '48.250')] [2023-02-24 21:24:50,257][213372] DAMAGECOUNT value on done: 624452.0 [2023-02-24 21:24:50,257][213372] Sum rewards: 57.517, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.439', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.154', 'AMMO4': '0.180', 'AMMO3': '0.239', 'weapon4': '0.278', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.972', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.576', 'FRAGCOUNT': '52.000'} [2023-02-24 21:24:50,566][213372] DAMAGECOUNT value on done: 611196.0 [2023-02-24 21:24:50,567][213372] Sum rewards: 48.820, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.414', 'AMMO5': '0.018', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon4': '0.212', 'weapon5': '0.254', 'AMMO3': '0.260', 'WEAPON4': '0.350', 'weapon2': '0.358', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'HITCOUNT': '2.850', 'weapon3': '2.914', 'DAMAGECOUNT': '13.038', 'FRAGCOUNT': '48.000'} [2023-02-24 21:24:50,580][213372] DAMAGECOUNT value on done: 602553.0 [2023-02-24 21:24:50,580][213372] Sum rewards: 48.144, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.454', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.074', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.200', 'AMMO3': '0.218', 'weapon2': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.722', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.774', 'FRAGCOUNT': '42.000'} [2023-02-24 21:24:50,869][213372] DAMAGECOUNT value on done: 600852.0 [2023-02-24 21:24:50,869][213372] Sum rewards: 45.557, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.267', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO3': '0.125', 'AMMO4': '0.130', 'weapon5': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.334', 'ARMOR': '0.400', 'weapon4': '0.756', 'WEAPON3': '0.800', 'HITCOUNT': '2.400', 'weapon3': '2.442', 'DAMAGECOUNT': '11.160', 'FRAGCOUNT': '38.000'} [2023-02-24 21:24:51,151][213366] DAMAGECOUNT value on done: 598234.0 [2023-02-24 21:24:51,151][213366] Sum rewards: 47.418, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.614', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon5': '0.126', 'AMMO3': '0.216', 'weapon2': '0.438', 'weapon4': '0.464', 'WEAPON3': '1.400', 'HITCOUNT': '2.720', 'weapon3': '2.768', 'DAMAGECOUNT': '11.691', 'FRAGCOUNT': '42.000'} [2023-02-24 21:24:51,451][213366] DAMAGECOUNT value on done: 612396.0 [2023-02-24 21:24:51,451][213366] Sum rewards: 43.302, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.097', 'AMMO5': '0.013', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.154', 'weapon5': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.318', 'weapon4': '0.596', 'WEAPON3': '1.000', 'HITCOUNT': '2.460', 'weapon3': '2.684', 'DAMAGECOUNT': '11.805', 'FRAGCOUNT': '36.000'} [2023-02-24 21:24:51,460][213366] DAMAGECOUNT value on done: 624779.0 [2023-02-24 21:24:51,460][213366] Sum rewards: 57.126, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.280', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.007', 'weapon5': '0.026', 'WEAPON5': '0.150', 'weapon2': '0.186', 'AMMO3': '0.224', 'WEAPON3': '1.250', 'HITCOUNT': '2.800', 'weapon3': '3.580', 'DAMAGECOUNT': '13.677', 'FRAGCOUNT': '49.000'} [2023-02-24 21:24:51,495][213365] Updated weights for policy 0, policy_version 36356 (0.0009) [2023-02-24 21:24:51,765][213366] DAMAGECOUNT value on done: 612372.0 [2023-02-24 21:24:51,765][213366] Sum rewards: 42.321, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.374', 'AMMO5': '0.007', 'ARMOR': '0.032', 'AMMO2': '0.054', 'weapon5': '0.154', 'WEAPON5': '0.200', 'AMMO3': '0.264', 'AMMO4': '0.270', 'weapon2': '0.288', 'WEAPON4': '0.650', 'weapon4': '0.776', 'WEAPON3': '1.500', 'weapon3': '2.428', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '12.951', 'FRAGCOUNT': '42.000'} [2023-02-24 21:24:51,875][213383] DAMAGECOUNT value on done: 609197.0 [2023-02-24 21:24:51,875][213383] Sum rewards: 44.193, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.050', 'ARMOR': '0.004', 'AMMO2': '0.016', 'AMMO5': '0.017', 'AMMO4': '0.080', 'weapon5': '0.124', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon4': '0.322', 'WEAPON5': '0.350', 'weapon2': '0.504', 'WEAPON3': '1.400', 'HITCOUNT': '2.610', 'weapon3': '2.700', 'DAMAGECOUNT': '11.886', 'FRAGCOUNT': '41.000'} [2023-02-24 21:24:51,983][213369] DAMAGECOUNT value on done: 608712.0 [2023-02-24 21:24:51,983][213369] Sum rewards: 43.429, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.980', 'AMMO2': '0.018', 'AMMO5': '0.020', 'AMMO4': '0.089', 'weapon4': '0.160', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon5': '0.418', 'WEAPON5': '0.450', 'weapon2': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '2.290', 'weapon3': '2.580', 'DAMAGECOUNT': '11.403', 'FRAGCOUNT': '38.000'} [2023-02-24 21:24:52,174][213383] DAMAGECOUNT value on done: 604655.0 [2023-02-24 21:24:52,175][213383] Sum rewards: 38.567, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.200', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.154', 'AMMO3': '0.170', 'AMMO4': '0.213', 'WEAPON5': '0.300', 'weapon2': '0.310', 'weapon4': '0.442', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'HITCOUNT': '2.330', 'weapon3': '2.876', 'DAMAGECOUNT': '10.665', 'FRAGCOUNT': '33.000'} [2023-02-24 21:24:52,181][213368] DAMAGECOUNT value on done: 600631.0 [2023-02-24 21:24:52,182][213368] Sum rewards: 43.944, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.810', 'AMMO5': '0.008', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.097', 'weapon5': '0.100', 'weapon4': '0.122', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.303', 'weapon2': '0.314', 'WEAPON3': '1.750', 'HITCOUNT': '3.030', 'weapon3': '3.170', 'DAMAGECOUNT': '13.671', 'FRAGCOUNT': '44.000'} [2023-02-24 21:24:52,226][213382] DAMAGECOUNT value on done: 611213.0 [2023-02-24 21:24:52,226][213382] Sum rewards: 39.244, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.654', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon5': '0.076', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.242', 'AMMO3': '0.323', 'weapon4': '0.388', 'WEAPON3': '1.800', 'HITCOUNT': '2.320', 'weapon3': '2.872', 'DAMAGECOUNT': '11.139', 'FRAGCOUNT': '41.000'} [2023-02-24 21:24:52,289][213369] DAMAGECOUNT value on done: 611951.0 [2023-02-24 21:24:52,290][213369] Sum rewards: 53.626, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.360', 'AMMO2': '0.019', 'weapon4': '0.048', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.251', 'weapon2': '0.640', 'WEAPON3': '1.500', 'HITCOUNT': '2.860', 'weapon3': '3.144', 'DAMAGECOUNT': '13.080', 'FRAGCOUNT': '50.000'} [2023-02-24 21:24:52,484][213368] DAMAGECOUNT value on done: 608600.0 [2023-02-24 21:24:52,484][213368] Sum rewards: 49.447, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.670', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.110', 'weapon4': '0.168', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.250', 'HITCOUNT': '2.530', 'weapon3': '3.172', 'DAMAGECOUNT': '12.765', 'FRAGCOUNT': '43.000'} [2023-02-24 21:24:52,529][213382] DAMAGECOUNT value on done: 607060.0 [2023-02-24 21:24:52,529][213382] Sum rewards: 43.223, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.738', 'AMMO2': '0.012', 'AMMO5': '0.012', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'weapon5': '0.184', 'AMMO3': '0.238', 'weapon4': '0.244', 'WEAPON5': '0.250', 'weapon2': '0.462', 'WEAPON3': '1.450', 'HITCOUNT': '2.540', 'weapon3': '2.882', 'DAMAGECOUNT': '12.024', 'FRAGCOUNT': '39.000'} [2023-02-24 21:24:52,563][213369] DAMAGECOUNT value on done: 606640.0 [2023-02-24 21:24:52,563][213369] Sum rewards: 44.412, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.801', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.045', 'AMMO3': '0.176', 'AMMO4': '0.224', 'weapon2': '0.306', 'weapon5': '0.334', 'weapon4': '0.420', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.050', 'HITCOUNT': '2.470', 'weapon3': '2.558', 'DAMAGECOUNT': '11.601', 'FRAGCOUNT': '41.000'} [2023-02-24 21:24:52,769][213368] DAMAGECOUNT value on done: 603871.0 [2023-02-24 21:24:52,769][213368] Sum rewards: 50.095, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.865', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.032', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.158', 'AMMO3': '0.195', 'weapon2': '0.460', 'WEAPON4': '0.500', 'weapon4': '0.712', 'WEAPON3': '1.200', 'weapon3': '2.448', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.176', 'FRAGCOUNT': '47.000'} [2023-02-24 21:24:52,864][213369] DAMAGECOUNT value on done: 597316.0 [2023-02-24 21:24:52,864][213369] Sum rewards: 56.418, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.484', 'AMMO5': '0.025', 'AMMO2': '0.062', 'AMMO3': '0.166', 'weapon5': '0.270', 'weapon4': '0.302', 'AMMO4': '0.312', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon2': '0.624', 'WEAPON3': '1.050', 'weapon3': '2.492', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.618', 'FRAGCOUNT': '49.500'} [2023-02-24 21:24:52,997][213382] DAMAGECOUNT value on done: 599369.0 [2023-02-24 21:24:52,998][213382] Sum rewards: 52.862, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.692', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.060', 'AMMO4': '0.104', 'weapon5': '0.166', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON3': '1.100', 'HITCOUNT': '2.840', 'weapon3': '3.212', 'DAMAGECOUNT': '14.616', 'FRAGCOUNT': '44.000'} [2023-02-24 21:24:53,016][213383] DAMAGECOUNT value on done: 607934.0 [2023-02-24 21:24:53,017][213383] Sum rewards: 45.516, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.441', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.096', 'AMMO3': '0.172', 'AMMO4': '0.185', 'weapon2': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.538', 'WEAPON3': '1.000', 'weapon3': '2.602', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.227', 'FRAGCOUNT': '39.500'} [2023-02-24 21:24:53,067][213368] DAMAGECOUNT value on done: 601570.0 [2023-02-24 21:24:53,067][213368] Sum rewards: 47.943, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.048', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.048', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.158', 'weapon2': '0.300', 'ARMOR': '0.400', 'weapon4': '0.624', 'WEAPON3': '0.900', 'weapon3': '2.492', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '11.670', 'FRAGCOUNT': '39.000'} [2023-02-24 21:24:53,293][213382] DAMAGECOUNT value on done: 604406.0 [2023-02-24 21:24:53,293][213382] Sum rewards: 43.330, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.002', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.184', 'weapon2': '0.218', 'AMMO3': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.404', 'WEAPON3': '1.400', 'HITCOUNT': '2.540', 'weapon3': '2.870', 'DAMAGECOUNT': '11.916', 'FRAGCOUNT': '39.000'} [2023-02-24 21:24:53,312][213383] DAMAGECOUNT value on done: 603605.0 [2023-02-24 21:24:53,312][213383] Sum rewards: 39.521, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.515', 'ARMOR': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.012', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.156', 'weapon2': '0.482', 'WEAPON4': '0.500', 'WEAPON3': '0.850', 'weapon4': '0.926', 'weapon3': '2.386', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '10.221', 'FRAGCOUNT': '36.000'} [2023-02-24 21:24:53,558][213384] DAMAGECOUNT value on done: 609393.0 [2023-02-24 21:24:53,558][213384] Sum rewards: 36.246, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.684', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon5': '0.048', 'AMMO4': '0.145', 'AMMO3': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.392', 'weapon4': '0.730', 'WEAPON3': '1.550', 'weapon3': '2.498', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '11.625', 'FRAGCOUNT': '36.000'} [2023-02-24 21:24:53,866][213384] DAMAGECOUNT value on done: 596345.0 [2023-02-24 21:24:53,867][213384] Sum rewards: 54.901, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.230', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.184', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon4': '0.308', 'WEAPON5': '0.350', 'weapon2': '0.458', 'WEAPON3': '1.400', 'weapon3': '2.800', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.187', 'FRAGCOUNT': '47.000'} [2023-02-24 21:24:54,259][213384] DAMAGECOUNT value on done: 605525.0 [2023-02-24 21:24:54,259][213384] Sum rewards: 33.151, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.830', 'AMMO5': '0.027', 'AMMO2': '0.081', 'AMMO3': '0.158', 'weapon5': '0.250', 'AMMO4': '0.406', 'weapon4': '0.532', 'WEAPON5': '0.600', 'weapon2': '0.632', 'WEAPON4': '0.800', 'WEAPON3': '0.950', 'HITCOUNT': '2.220', 'weapon3': '2.230', 'DAMAGECOUNT': '11.094', 'FRAGCOUNT': '31.500'} [2023-02-24 21:24:54,490][213365] Updated weights for policy 0, policy_version 36366 (0.0009) [2023-02-24 21:24:54,553][213384] DAMAGECOUNT value on done: 608109.0 [2023-02-24 21:24:54,554][213384] Sum rewards: 41.817, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.398', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.038', 'AMMO3': '0.155', 'AMMO4': '0.189', 'weapon5': '0.276', 'weapon2': '0.368', 'WEAPON4': '0.450', 'weapon4': '0.480', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.572', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '11.685', 'FRAGCOUNT': '35.500'} [2023-02-24 21:24:55,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 148963328. Throughput: 0: 3459.9. Samples: 12233394. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:24:55,243][213332] Avg episode reward: [(0, '47.452')] [2023-02-24 21:24:57,429][213365] Updated weights for policy 0, policy_version 36376 (0.0009) [2023-02-24 21:24:59,522][213382] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-24 21:25:00,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13858.2, 300 sec: 13857.0). Total num frames: 149032960. Throughput: 0: 3460.4. Samples: 12254144. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:25:00,243][213332] Avg episode reward: [(0, '47.452')] [2023-02-24 21:25:00,362][213365] Updated weights for policy 0, policy_version 36386 (0.0009) [2023-02-24 21:25:03,318][213365] Updated weights for policy 0, policy_version 36396 (0.0009) [2023-02-24 21:25:04,936][213383] Large shaping reward -2.548 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('weapon5', 0.002)] [2023-02-24 21:25:05,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 149102592. Throughput: 0: 3460.1. Samples: 12264548. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:25:05,243][213332] Avg episode reward: [(0, '47.452')] [2023-02-24 21:25:06,248][213365] Updated weights for policy 0, policy_version 36406 (0.0009) [2023-02-24 21:25:08,561][213367] DAMAGECOUNT value on done: 607900.0 [2023-02-24 21:25:08,561][213367] Sum rewards: 43.087, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.965', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.036', 'AMMO3': '0.172', 'AMMO4': '0.182', 'weapon5': '0.226', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON4': '0.350', 'weapon4': '0.362', 'WEAPON3': '1.100', 'HITCOUNT': '2.660', 'weapon3': '2.662', 'DAMAGECOUNT': '12.414', 'FRAGCOUNT': '38.500'} [2023-02-24 21:25:08,664][213367] DAMAGECOUNT value on done: 609245.0 [2023-02-24 21:25:08,665][213367] Sum rewards: 50.114, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.361', 'WEAPON1': '0.010', 'AMMO5': '0.021', 'AMMO2': '0.055', 'AMMO3': '0.179', 'AMMO4': '0.275', 'weapon5': '0.278', 'weapon2': '0.420', 'WEAPON5': '0.550', 'weapon4': '0.644', 'WEAPON4': '0.700', 'WEAPON3': '1.050', 'weapon3': '2.270', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '14.403', 'FRAGCOUNT': '45.000'} [2023-02-24 21:25:08,877][213367] DAMAGECOUNT value on done: 607705.0 [2023-02-24 21:25:08,877][213367] Sum rewards: 51.670, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.015', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.031', 'AMMO3': '0.120', 'AMMO4': '0.152', 'weapon5': '0.172', 'weapon2': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.518', 'WEAPON3': '0.850', 'weapon3': '2.856', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.041', 'FRAGCOUNT': '42.500'} [2023-02-24 21:25:08,974][213367] DAMAGECOUNT value on done: 617144.0 [2023-02-24 21:25:08,974][213367] Sum rewards: 40.744, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.049', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'weapon4': '0.364', 'weapon2': '0.392', 'ARMOR': '0.453', 'WEAPON3': '1.250', 'HITCOUNT': '2.460', 'weapon3': '2.948', 'DAMAGECOUNT': '11.415', 'FRAGCOUNT': '35.500'} [2023-02-24 21:25:09,238][213365] Updated weights for policy 0, policy_version 36416 (0.0009) [2023-02-24 21:25:09,589][213372] DAMAGECOUNT value on done: 629475.0 [2023-02-24 21:25:09,589][213372] Sum rewards: 54.705, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.367', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.180', 'AMMO3': '0.197', 'AMMO4': '0.225', 'WEAPON5': '0.350', 'weapon4': '0.382', 'WEAPON4': '0.450', 'weapon2': '0.634', 'WEAPON3': '1.100', 'weapon3': '2.500', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.069', 'FRAGCOUNT': '46.000'} [2023-02-24 21:25:09,892][213372] DAMAGECOUNT value on done: 615932.0 [2023-02-24 21:25:09,893][213372] Sum rewards: 55.729, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.610', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.088', 'AMMO4': '0.089', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.422', 'weapon4': '0.538', 'WEAPON3': '0.850', 'weapon3': '2.408', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '14.208', 'FRAGCOUNT': '45.000'} [2023-02-24 21:25:09,932][213372] DAMAGECOUNT value on done: 606251.0 [2023-02-24 21:25:09,933][213372] Sum rewards: 44.921, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.185', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.118', 'AMMO3': '0.138', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.424', 'weapon2': '0.594', 'WEAPON3': '0.800', 'HITCOUNT': '2.680', 'weapon3': '2.690', 'DAMAGECOUNT': '11.094', 'FRAGCOUNT': '38.000'} [2023-02-24 21:25:10,229][213372] DAMAGECOUNT value on done: 604890.0 [2023-02-24 21:25:10,230][213372] Sum rewards: 42.974, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.700', 'AMMO5': '0.022', 'AMMO2': '0.034', 'AMMO4': '0.169', 'AMMO3': '0.249', 'weapon2': '0.254', 'weapon5': '0.264', 'weapon4': '0.404', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'HITCOUNT': '2.520', 'weapon3': '2.744', 'DAMAGECOUNT': '12.114', 'FRAGCOUNT': '41.000'} [2023-02-24 21:25:10,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 149172224. Throughput: 0: 3462.2. Samples: 12285366. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:25:10,243][213332] Avg episode reward: [(0, '47.493')] [2023-02-24 21:25:10,579][213366] DAMAGECOUNT value on done: 601694.0 [2023-02-24 21:25:10,579][213366] Sum rewards: 40.827, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.610', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO3': '0.153', 'weapon5': '0.186', 'AMMO4': '0.213', 'weapon4': '0.376', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.474', 'WEAPON3': '1.050', 'HITCOUNT': '2.480', 'weapon3': '2.714', 'DAMAGECOUNT': '10.380', 'FRAGCOUNT': '38.000'} [2023-02-24 21:25:10,889][213366] DAMAGECOUNT value on done: 617025.0 [2023-02-24 21:25:10,890][213366] Sum rewards: 52.665, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.137', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.184', 'weapon2': '0.220', 'WEAPON4': '0.300', 'weapon4': '0.664', 'WEAPON3': '1.150', 'weapon3': '2.834', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.887', 'FRAGCOUNT': '44.000'} [2023-02-24 21:25:10,899][213366] DAMAGECOUNT value on done: 628844.0 [2023-02-24 21:25:10,900][213366] Sum rewards: 39.754, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.800', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.042', 'AMMO3': '0.199', 'AMMO4': '0.208', 'weapon5': '0.264', 'weapon2': '0.276', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.708', 'WEAPON3': '1.150', 'weapon3': '2.418', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '12.195', 'FRAGCOUNT': '36.000'} [2023-02-24 21:25:11,197][213366] DAMAGECOUNT value on done: 616503.0 [2023-02-24 21:25:11,197][213366] Sum rewards: 37.259, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.974', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.028', 'weapon5': '0.110', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'AMMO3': '0.272', 'weapon2': '0.322', 'WEAPON4': '0.350', 'weapon4': '0.434', 'WEAPON3': '1.650', 'weapon3': '2.846', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '12.393', 'FRAGCOUNT': '35.000'} [2023-02-24 21:25:11,372][213383] DAMAGECOUNT value on done: 613261.0 [2023-02-24 21:25:11,373][213383] Sum rewards: 47.313, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.548', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.009', 'weapon5': '0.062', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.434', 'WEAPON3': '1.300', 'HITCOUNT': '2.690', 'weapon3': '3.290', 'DAMAGECOUNT': '12.192', 'FRAGCOUNT': '42.000'} [2023-02-24 21:25:11,456][213369] DAMAGECOUNT value on done: 613538.0 [2023-02-24 21:25:11,457][213369] Sum rewards: 57.274, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.942', 'AMMO2': '0.022', 'AMMO5': '0.028', 'AMMO4': '0.110', 'weapon2': '0.158', 'weapon5': '0.174', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon4': '0.266', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.950', 'weapon3': '3.170', 'DAMAGECOUNT': '14.478', 'FRAGCOUNT': '50.000'} [2023-02-24 21:25:11,644][213368] DAMAGECOUNT value on done: 604079.0 [2023-02-24 21:25:11,645][213368] Sum rewards: 37.807, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.220', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.184', 'WEAPON4': '0.250', 'AMMO3': '0.261', 'WEAPON5': '0.300', 'weapon4': '0.430', 'weapon2': '0.460', 'WEAPON3': '1.600', 'HITCOUNT': '2.160', 'weapon3': '2.690', 'DAMAGECOUNT': '10.344', 'FRAGCOUNT': '39.000'} [2023-02-24 21:25:11,667][213383] DAMAGECOUNT value on done: 609320.0 [2023-02-24 21:25:11,668][213383] Sum rewards: 44.257, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.243', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.090', 'AMMO4': '0.102', 'weapon2': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.297', 'weapon4': '0.552', 'WEAPON3': '1.750', 'weapon3': '2.902', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '13.995', 'FRAGCOUNT': '42.000'} [2023-02-24 21:25:11,671][213382] DAMAGECOUNT value on done: 615318.0 [2023-02-24 21:25:11,671][213382] Sum rewards: 45.958, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.770', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.070', 'weapon7': '0.074', 'AMMO4': '0.109', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.416', 'weapon4': '0.592', 'WEAPON3': '1.100', 'HITCOUNT': '2.500', 'weapon3': '2.640', 'DAMAGECOUNT': '11.862', 'FRAGCOUNT': '40.000'} [2023-02-24 21:25:11,755][213369] DAMAGECOUNT value on done: 615478.0 [2023-02-24 21:25:11,755][213369] Sum rewards: 34.638, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.595', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.027', 'weapon7': '0.076', 'weapon5': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.132', 'AMMO4': '0.137', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.334', 'WEAPON4': '0.600', 'WEAPON3': '0.850', 'weapon4': '1.186', 'weapon3': '1.904', 'HITCOUNT': '2.240', 'DAMAGECOUNT': '10.251', 'FRAGCOUNT': '31.000'} [2023-02-24 21:25:11,948][213368] DAMAGECOUNT value on done: 614049.0 [2023-02-24 21:25:11,948][213368] Sum rewards: 64.298, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.290', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.156', 'weapon2': '0.188', 'AMMO3': '0.217', 'WEAPON3': '1.350', 'HITCOUNT': '3.340', 'weapon3': '3.384', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '54.000'} [2023-02-24 21:25:11,976][213382] DAMAGECOUNT value on done: 610890.0 [2023-02-24 21:25:11,977][213382] Sum rewards: 45.501, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.615', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.098', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'weapon2': '0.336', 'WEAPON4': '0.350', 'weapon4': '0.444', 'WEAPON3': '1.350', 'HITCOUNT': '2.600', 'weapon3': '2.854', 'DAMAGECOUNT': '11.490', 'FRAGCOUNT': '42.000'} [2023-02-24 21:25:12,044][213369] DAMAGECOUNT value on done: 611503.0 [2023-02-24 21:25:12,044][213369] Sum rewards: 48.946, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.546', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.108', 'weapon4': '0.132', 'WEAPON5': '0.150', 'AMMO4': '0.178', 'WEAPON4': '0.250', 'weapon2': '0.250', 'AMMO3': '0.273', 'WEAPON3': '1.600', 'HITCOUNT': '2.940', 'weapon3': '3.190', 'DAMAGECOUNT': '14.376', 'FRAGCOUNT': '46.000'} [2023-02-24 21:25:12,215][213365] Updated weights for policy 0, policy_version 36426 (0.0009) [2023-02-24 21:25:12,234][213368] DAMAGECOUNT value on done: 608134.0 [2023-02-24 21:25:12,234][213368] Sum rewards: 39.840, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.029', 'AMMO5': '0.017', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon2': '0.194', 'AMMO3': '0.238', 'weapon5': '0.240', 'WEAPON4': '0.300', 'weapon4': '0.340', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.560', 'weapon3': '2.914', 'DAMAGECOUNT': '12.789', 'FRAGCOUNT': '37.500'} [2023-02-24 21:25:12,345][213369] DAMAGECOUNT value on done: 601730.0 [2023-02-24 21:25:12,345][213369] Sum rewards: 45.638, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.966', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.057', 'AMMO3': '0.114', 'weapon5': '0.170', 'AMMO4': '0.283', 'WEAPON5': '0.350', 'weapon4': '0.438', 'WEAPON4': '0.450', 'WEAPON3': '0.700', 'weapon2': '1.228', 'weapon3': '1.902', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '13.242', 'FRAGCOUNT': '37.000'} [2023-02-24 21:25:12,425][213382] DAMAGECOUNT value on done: 603766.0 [2023-02-24 21:25:12,426][213382] Sum rewards: 46.469, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.840', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon2': '0.138', 'weapon4': '0.188', 'AMMO3': '0.236', 'WEAPON3': '1.450', 'HITCOUNT': '2.730', 'weapon3': '3.436', 'DAMAGECOUNT': '12.873', 'FRAGCOUNT': '42.000'} [2023-02-24 21:25:12,507][213383] DAMAGECOUNT value on done: 612974.0 [2023-02-24 21:25:12,508][213383] Sum rewards: 53.379, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.040', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon5': '0.210', 'AMMO3': '0.220', 'weapon2': '0.224', 'weapon4': '0.232', 'AMMO4': '0.246', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'HITCOUNT': '2.920', 'weapon3': '3.078', 'DAMAGECOUNT': '15.120', 'FRAGCOUNT': '47.500'} [2023-02-24 21:25:12,525][213368] DAMAGECOUNT value on done: 605782.0 [2023-02-24 21:25:12,526][213368] Sum rewards: 48.143, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.258', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.186', 'AMMO3': '0.219', 'weapon4': '0.376', 'WEAPON4': '0.400', 'weapon2': '0.520', 'WEAPON3': '1.250', 'weapon3': '2.796', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.636', 'FRAGCOUNT': '43.000'} [2023-02-24 21:25:12,736][213382] DAMAGECOUNT value on done: 608905.0 [2023-02-24 21:25:12,736][213382] Sum rewards: 47.632, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.350', 'AMMO5': '0.019', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.210', 'AMMO3': '0.227', 'WEAPON4': '0.350', 'weapon2': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.496', 'WEAPON3': '1.400', 'weapon3': '2.644', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '13.497', 'FRAGCOUNT': '44.000'} [2023-02-24 21:25:12,810][213383] DAMAGECOUNT value on done: 607993.0 [2023-02-24 21:25:12,811][213383] Sum rewards: 47.336, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.291', 'AMMO5': '0.021', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.160', 'weapon2': '0.230', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.430', 'ARMOR': '0.477', 'WEAPON3': '1.450', 'HITCOUNT': '2.850', 'weapon3': '2.868', 'DAMAGECOUNT': '13.164', 'FRAGCOUNT': '42.000'} [2023-02-24 21:25:12,990][213384] DAMAGECOUNT value on done: 615049.0 [2023-02-24 21:25:12,990][213384] Sum rewards: 64.418, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.022', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'weapon4': '0.140', 'AMMO3': '0.273', 'weapon2': '0.306', 'WEAPON3': '1.500', 'weapon3': '3.248', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.968', 'FRAGCOUNT': '54.000'} [2023-02-24 21:25:13,291][213384] DAMAGECOUNT value on done: 600732.0 [2023-02-24 21:25:13,292][213384] Sum rewards: 46.198, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.120', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.050', 'AMMO4': '0.177', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon4': '0.302', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.820', 'weapon3': '2.966', 'DAMAGECOUNT': '13.161', 'FRAGCOUNT': '42.000'} [2023-02-24 21:25:13,681][213384] DAMAGECOUNT value on done: 609520.0 [2023-02-24 21:25:13,681][213384] Sum rewards: 37.439, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.730', 'AMMO5': '0.026', 'AMMO2': '0.061', 'AMMO3': '0.230', 'AMMO4': '0.306', 'weapon5': '0.336', 'weapon2': '0.592', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'weapon4': '0.686', 'WEAPON3': '1.250', 'weapon3': '2.056', 'HITCOUNT': '2.390', 'DAMAGECOUNT': '11.985', 'FRAGCOUNT': '37.000'} [2023-02-24 21:25:13,975][213384] DAMAGECOUNT value on done: 612077.0 [2023-02-24 21:25:13,976][213384] Sum rewards: 47.719, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.060', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.154', 'AMMO3': '0.178', 'WEAPON4': '0.300', 'weapon2': '0.384', 'weapon4': '0.846', 'WEAPON3': '1.050', 'weapon3': '2.546', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '11.859', 'FRAGCOUNT': '42.000'} [2023-02-24 21:25:15,166][213365] Updated weights for policy 0, policy_version 36436 (0.0009) [2023-02-24 21:25:15,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 149241856. Throughput: 0: 3458.7. Samples: 12305972. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:25:15,243][213332] Avg episode reward: [(0, '47.025')] [2023-02-24 21:25:18,119][213365] Updated weights for policy 0, policy_version 36446 (0.0008) [2023-02-24 21:25:20,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 149311488. Throughput: 0: 3461.2. Samples: 12316400. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:25:20,243][213332] Avg episode reward: [(0, '47.025')] [2023-02-24 21:25:21,076][213365] Updated weights for policy 0, policy_version 36456 (0.0009) [2023-02-24 21:25:22,257][213372] Large shaping reward 2.548 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.516, 172.0), ('weapon5', 0.002)] [2023-02-24 21:25:24,064][213365] Updated weights for policy 0, policy_version 36466 (0.0009) [2023-02-24 21:25:25,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 149377024. Throughput: 0: 3459.7. Samples: 12337106. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-24 21:25:25,243][213332] Avg episode reward: [(0, '47.025')] [2023-02-24 21:25:25,911][213366] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-24 21:25:27,052][213383] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 21:25:27,058][213365] Updated weights for policy 0, policy_version 36476 (0.0009) [2023-02-24 21:25:28,038][213367] DAMAGECOUNT value on done: 611740.0 [2023-02-24 21:25:28,038][213367] Sum rewards: 42.282, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.596', 'AMMO5': '0.019', 'AMMO2': '0.036', 'AMMO4': '0.180', 'AMMO3': '0.217', 'weapon4': '0.254', 'weapon2': '0.280', 'weapon5': '0.314', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.440', 'weapon3': '2.668', 'DAMAGECOUNT': '11.520', 'FRAGCOUNT': '39.500'} [2023-02-24 21:25:28,120][213367] DAMAGECOUNT value on done: 612916.0 [2023-02-24 21:25:28,120][213367] Sum rewards: 31.622, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.232', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon5': '0.086', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.428', 'weapon4': '0.580', 'WEAPON3': '1.550', 'HITCOUNT': '2.380', 'weapon3': '2.592', 'DAMAGECOUNT': '11.013', 'FRAGCOUNT': '32.500'} [2023-02-24 21:25:28,349][213367] DAMAGECOUNT value on done: 611738.0 [2023-02-24 21:25:28,349][213367] Sum rewards: 44.775, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.182', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.196', 'weapon2': '0.230', 'WEAPON4': '0.300', 'weapon5': '0.322', 'weapon4': '0.404', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.600', 'weapon3': '2.694', 'DAMAGECOUNT': '12.099', 'FRAGCOUNT': '41.000'} [2023-02-24 21:25:28,431][213367] DAMAGECOUNT value on done: 622272.0 [2023-02-24 21:25:28,432][213367] Sum rewards: 58.178, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.952', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.216', 'AMMO3': '0.248', 'weapon2': '0.254', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.720', 'WEAPON3': '1.500', 'weapon3': '2.474', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.384', 'FRAGCOUNT': '52.000'} [2023-02-24 21:25:29,041][213372] DAMAGECOUNT value on done: 633659.0 [2023-02-24 21:25:29,042][213372] Sum rewards: 45.960, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.912', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.050', 'AMMO3': '0.176', 'weapon5': '0.178', 'AMMO4': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.486', 'WEAPON4': '0.500', 'weapon2': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.506', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.552', 'FRAGCOUNT': '42.000'} [2023-02-24 21:25:29,344][213372] DAMAGECOUNT value on done: 620302.0 [2023-02-24 21:25:29,344][213372] Sum rewards: 47.674, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.765', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO3': '0.183', 'AMMO4': '0.203', 'weapon2': '0.268', 'weapon5': '0.268', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.526', 'WEAPON3': '1.150', 'weapon3': '2.540', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.110', 'FRAGCOUNT': '40.000'} [2023-02-24 21:25:29,392][213372] DAMAGECOUNT value on done: 611216.0 [2023-02-24 21:25:29,392][213372] Sum rewards: 58.655, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.672', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.052', 'AMMO3': '0.158', 'AMMO4': '0.259', 'weapon2': '0.298', 'weapon5': '0.300', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.544', 'WEAPON3': '1.000', 'weapon3': '2.476', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.895', 'FRAGCOUNT': '50.000'} [2023-02-24 21:25:29,698][213372] DAMAGECOUNT value on done: 609469.0 [2023-02-24 21:25:29,699][213372] Sum rewards: 46.483, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.624', 'AMMO5': '0.018', 'AMMO2': '0.031', 'AMMO4': '0.156', 'AMMO3': '0.184', 'weapon2': '0.228', 'weapon5': '0.282', 'WEAPON4': '0.350', 'weapon4': '0.498', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.730', 'weapon3': '2.742', 'DAMAGECOUNT': '13.737', 'FRAGCOUNT': '40.000'} [2023-02-24 21:25:29,996][213366] DAMAGECOUNT value on done: 606826.0 [2023-02-24 21:25:29,997][213366] Sum rewards: 51.998, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.794', 'AMMO5': '0.015', 'AMMO2': '0.051', 'AMMO3': '0.253', 'AMMO4': '0.256', 'weapon4': '0.302', 'weapon5': '0.324', 'weapon2': '0.402', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.592', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '47.500'} [2023-02-24 21:25:30,033][213365] Updated weights for policy 0, policy_version 36486 (0.0009) [2023-02-24 21:25:30,243][213332] Fps is (10 sec: 13516.8, 60 sec: 13858.1, 300 sec: 13843.1). Total num frames: 149446656. Throughput: 0: 3456.5. Samples: 12357864. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:25:30,243][213332] Avg episode reward: [(0, '47.015')] [2023-02-24 21:25:30,283][213366] DAMAGECOUNT value on done: 633290.0 [2023-02-24 21:25:30,284][213366] Sum rewards: 48.185, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.900', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.225', 'weapon4': '0.238', 'weapon2': '0.282', 'WEAPON4': '0.300', 'weapon5': '0.378', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'HITCOUNT': '2.620', 'weapon3': '2.824', 'DAMAGECOUNT': '13.338', 'FRAGCOUNT': '42.000'} [2023-02-24 21:25:30,296][213366] DAMAGECOUNT value on done: 621357.0 [2023-02-24 21:25:30,297][213366] Sum rewards: 43.782, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.677', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.202', 'weapon5': '0.236', 'WEAPON4': '0.450', 'weapon4': '0.462', 'WEAPON5': '0.550', 'weapon2': '0.630', 'WEAPON3': '1.200', 'weapon3': '2.414', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.858', 'FRAGCOUNT': '38.000'} [2023-02-24 21:25:30,583][213366] DAMAGECOUNT value on done: 621404.0 [2023-02-24 21:25:30,583][213366] Sum rewards: 55.570, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.790', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.167', 'weapon5': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.440', 'weapon2': '0.510', 'WEAPON3': '1.150', 'weapon3': '2.628', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.703', 'FRAGCOUNT': '46.500'} [2023-02-24 21:25:30,764][213383] DAMAGECOUNT value on done: 617608.0 [2023-02-24 21:25:30,765][213383] Sum rewards: 48.479, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.315', 'ARMOR': '0.004', 'AMMO2': '0.023', 'AMMO5': '0.023', 'AMMO4': '0.112', 'AMMO3': '0.209', 'weapon5': '0.288', 'WEAPON4': '0.450', 'weapon2': '0.474', 'WEAPON5': '0.600', 'weapon4': '0.744', 'WEAPON3': '1.300', 'weapon3': '2.096', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.041', 'FRAGCOUNT': '43.000'} [2023-02-24 21:25:30,879][213369] DAMAGECOUNT value on done: 618180.0 [2023-02-24 21:25:30,879][213369] Sum rewards: 51.849, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.197', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon5': '0.132', 'WEAPON4': '0.150', 'weapon4': '0.164', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.834', 'WEAPON3': '1.200', 'weapon3': '2.630', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.926', 'FRAGCOUNT': '45.000'} [2023-02-24 21:25:31,069][213383] DAMAGECOUNT value on done: 613711.0 [2023-02-24 21:25:31,069][213383] Sum rewards: 51.800, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.386', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.097', 'AMMO3': '0.178', 'weapon5': '0.248', 'weapon2': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.548', 'WEAPON3': '1.100', 'weapon3': '2.546', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.173', 'FRAGCOUNT': '45.000'} [2023-02-24 21:25:31,071][213368] DAMAGECOUNT value on done: 608583.0 [2023-02-24 21:25:31,071][213368] Sum rewards: 57.033, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.000', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.029', 'AMMO4': '0.143', 'AMMO3': '0.157', 'weapon2': '0.190', 'weapon5': '0.218', 'weapon4': '0.346', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'HITCOUNT': '2.810', 'weapon3': '2.994', 'DAMAGECOUNT': '13.512', 'FRAGCOUNT': '48.000'} [2023-02-24 21:25:31,156][213382] DAMAGECOUNT value on done: 620845.0 [2023-02-24 21:25:31,157][213382] Sum rewards: 57.256, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.436', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO4': '0.167', 'AMMO3': '0.195', 'weapon2': '0.262', 'weapon5': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.570', 'WEAPON3': '1.150', 'weapon3': '2.496', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.497', 'FRAGCOUNT': '49.000'} [2023-02-24 21:25:31,168][213369] DAMAGECOUNT value on done: 620497.0 [2023-02-24 21:25:31,169][213369] Sum rewards: 64.133, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.530', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO4': '0.166', 'AMMO3': '0.182', 'weapon5': '0.220', 'weapon4': '0.352', 'WEAPON4': '0.400', 'weapon2': '0.412', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.756', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.057', 'FRAGCOUNT': '56.000'} [2023-02-24 21:25:31,375][213368] DAMAGECOUNT value on done: 619033.0 [2023-02-24 21:25:31,376][213368] Sum rewards: 48.913, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.170', 'AMMO5': '0.011', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon4': '0.112', 'weapon5': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.276', 'WEAPON5': '0.300', 'weapon2': '0.406', 'WEAPON3': '1.600', 'HITCOUNT': '3.020', 'weapon3': '3.088', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '46.000'} [2023-02-24 21:25:31,478][213382] DAMAGECOUNT value on done: 615708.0 [2023-02-24 21:25:31,479][213382] Sum rewards: 52.503, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.006', 'AMMO5': '0.023', 'AMMO2': '0.069', 'AMMO3': '0.128', 'weapon2': '0.310', 'AMMO4': '0.343', 'weapon5': '0.424', 'WEAPON5': '0.650', 'weapon4': '0.702', 'WEAPON4': '0.750', 'WEAPON3': '0.850', 'weapon3': '2.186', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.064', 'FRAGCOUNT': '46.000'} [2023-02-24 21:25:31,496][213369] DAMAGECOUNT value on done: 615948.0 [2023-02-24 21:25:31,497][213369] Sum rewards: 47.337, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.125', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon4': '0.114', 'AMMO4': '0.150', 'weapon5': '0.166', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.350', 'HITCOUNT': '2.730', 'weapon3': '3.076', 'DAMAGECOUNT': '13.335', 'FRAGCOUNT': '43.000'} [2023-02-24 21:25:31,654][213368] DAMAGECOUNT value on done: 611590.0 [2023-02-24 21:25:31,655][213368] Sum rewards: 40.118, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.326', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.141', 'AMMO4': '0.167', 'WEAPON4': '0.250', 'weapon2': '0.684', 'weapon4': '0.688', 'WEAPON3': '0.800', 'HITCOUNT': '2.240', 'weapon3': '2.370', 'DAMAGECOUNT': '10.368', 'FRAGCOUNT': '34.000'} [2023-02-24 21:25:31,787][213369] DAMAGECOUNT value on done: 605595.0 [2023-02-24 21:25:31,787][213369] Sum rewards: 45.509, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.212', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.128', 'AMMO3': '0.144', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.534', 'weapon2': '0.662', 'WEAPON3': '0.950', 'weapon3': '2.358', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '11.595', 'FRAGCOUNT': '37.000'} [2023-02-24 21:25:31,855][213382] DAMAGECOUNT value on done: 608739.0 [2023-02-24 21:25:31,855][213382] Sum rewards: 47.194, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.648', 'AMMO5': '0.019', 'AMMO2': '0.068', 'AMMO3': '0.246', 'weapon2': '0.286', 'AMMO4': '0.341', 'weapon5': '0.344', 'weapon4': '0.528', 'WEAPON5': '0.600', 'WEAPON4': '0.750', 'WEAPON3': '1.550', 'weapon3': '2.450', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '45.000'} [2023-02-24 21:25:31,913][213383] DAMAGECOUNT value on done: 616897.0 [2023-02-24 21:25:31,913][213383] Sum rewards: 43.113, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.390', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.026', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.168', 'WEAPON4': '0.350', 'weapon4': '0.366', 'weapon2': '0.468', 'weapon5': '0.564', 'WEAPON5': '0.650', 'WEAPON3': '1.000', 'weapon3': '2.160', 'HITCOUNT': '2.290', 'DAMAGECOUNT': '11.769', 'FRAGCOUNT': '38.000'} [2023-02-24 21:25:31,954][213368] DAMAGECOUNT value on done: 609865.0 [2023-02-24 21:25:31,954][213368] Sum rewards: 47.404, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.904', 'AMMO2': '0.012', 'AMMO5': '0.014', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'weapon4': '0.126', 'weapon5': '0.132', 'AMMO3': '0.243', 'WEAPON5': '0.250', 'weapon2': '0.582', 'WEAPON3': '1.400', 'HITCOUNT': '2.810', 'weapon3': '2.828', 'DAMAGECOUNT': '12.249', 'FRAGCOUNT': '42.000'} [2023-02-24 21:25:32,149][213382] DAMAGECOUNT value on done: 613470.0 [2023-02-24 21:25:32,150][213382] Sum rewards: 53.702, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.386', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.100', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon4': '0.234', 'weapon2': '0.434', 'WEAPON3': '1.150', 'weapon3': '2.978', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.695', 'FRAGCOUNT': '46.000'} [2023-02-24 21:25:32,206][213383] DAMAGECOUNT value on done: 612125.0 [2023-02-24 21:25:32,207][213383] Sum rewards: 44.294, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.938', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.186', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'weapon2': '0.310', 'WEAPON5': '0.350', 'weapon4': '0.516', 'WEAPON3': '1.350', 'weapon3': '2.708', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.381', 'FRAGCOUNT': '40.000'} [2023-02-24 21:25:32,377][213384] DAMAGECOUNT value on done: 619838.0 [2023-02-24 21:25:32,378][213384] Sum rewards: 53.670, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.686', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.132', 'weapon5': '0.146', 'weapon4': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.608', 'WEAPON3': '0.850', 'weapon3': '2.734', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '14.367', 'FRAGCOUNT': '43.000'} [2023-02-24 21:25:32,663][213384] DAMAGECOUNT value on done: 604674.0 [2023-02-24 21:25:32,664][213384] Sum rewards: 46.267, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.690', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.179', 'AMMO3': '0.235', 'weapon5': '0.252', 'WEAPON5': '0.300', 'weapon2': '0.378', 'WEAPON4': '0.450', 'weapon4': '0.582', 'WEAPON3': '1.300', 'HITCOUNT': '2.390', 'weapon3': '2.404', 'DAMAGECOUNT': '11.826', 'FRAGCOUNT': '43.000'} [2023-02-24 21:25:32,968][213365] Updated weights for policy 0, policy_version 36496 (0.0009) [2023-02-24 21:25:33,040][213384] DAMAGECOUNT value on done: 613904.0 [2023-02-24 21:25:33,041][213384] Sum rewards: 51.039, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.344', 'AMMO5': '0.020', 'AMMO2': '0.036', 'weapon5': '0.170', 'AMMO4': '0.180', 'AMMO3': '0.213', 'weapon2': '0.240', 'WEAPON4': '0.350', 'weapon4': '0.404', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.850', 'weapon3': '2.968', 'DAMAGECOUNT': '13.152', 'FRAGCOUNT': '46.000'} [2023-02-24 21:25:33,339][213384] DAMAGECOUNT value on done: 616253.0 [2023-02-24 21:25:33,340][213384] Sum rewards: 50.839, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.794', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.030', 'weapon5': '0.060', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'weapon2': '0.812', 'WEAPON3': '1.150', 'HITCOUNT': '2.620', 'weapon3': '2.946', 'DAMAGECOUNT': '11.967', 'FRAGCOUNT': '44.000'} [2023-02-24 21:25:34,221][213383] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-24 21:25:35,243][213332] Fps is (10 sec: 13926.6, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 149516288. Throughput: 0: 3457.7. Samples: 12368264. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:25:35,243][213332] Avg episode reward: [(0, '47.229')] [2023-02-24 21:25:35,941][213365] Updated weights for policy 0, policy_version 36506 (0.0009) [2023-02-24 21:25:38,877][213365] Updated weights for policy 0, policy_version 36516 (0.0008) [2023-02-24 21:25:40,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 149585920. Throughput: 0: 3459.4. Samples: 12389068. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:25:40,243][213332] Avg episode reward: [(0, '47.229')] [2023-02-24 21:25:41,855][213365] Updated weights for policy 0, policy_version 36526 (0.0009) [2023-02-24 21:25:44,793][213365] Updated weights for policy 0, policy_version 36536 (0.0009) [2023-02-24 21:25:45,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 149655552. Throughput: 0: 3460.8. Samples: 12409880. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:25:45,243][213332] Avg episode reward: [(0, '47.229')] [2023-02-24 21:25:47,428][213367] DAMAGECOUNT value on done: 615608.0 [2023-02-24 21:25:47,428][213367] Sum rewards: 36.697, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.447', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.054', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'weapon4': '0.238', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.398', 'WEAPON3': '1.600', 'HITCOUNT': '2.620', 'weapon3': '3.100', 'DAMAGECOUNT': '11.604', 'FRAGCOUNT': '34.000'} [2023-02-24 21:25:47,509][213367] DAMAGECOUNT value on done: 616239.0 [2023-02-24 21:25:47,509][213367] Sum rewards: 34.128, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.582', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.042', 'AMMO3': '0.206', 'AMMO4': '0.208', 'weapon2': '0.220', 'weapon5': '0.312', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.768', 'WEAPON3': '1.200', 'HITCOUNT': '2.090', 'weapon3': '2.320', 'DAMAGECOUNT': '9.969', 'FRAGCOUNT': '34.000'} [2023-02-24 21:25:47,726][213365] Updated weights for policy 0, policy_version 36546 (0.0009) [2023-02-24 21:25:47,731][213367] DAMAGECOUNT value on done: 616579.0 [2023-02-24 21:25:47,731][213367] Sum rewards: 54.772, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.013', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.154', 'weapon5': '0.170', 'HEALTH': '0.181', 'WEAPON5': '0.350', 'weapon2': '0.728', 'WEAPON3': '0.850', 'weapon3': '2.578', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.523', 'FRAGCOUNT': '44.000'} [2023-02-24 21:25:47,819][213367] DAMAGECOUNT value on done: 627204.0 [2023-02-24 21:25:47,819][213367] Sum rewards: 47.139, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.585', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.028', 'AMMO2': '0.042', 'AMMO3': '0.196', 'AMMO4': '0.211', 'weapon2': '0.236', 'weapon5': '0.338', 'WEAPON4': '0.500', 'weapon4': '0.616', 'WEAPON5': '0.750', 'WEAPON3': '1.100', 'weapon3': '2.386', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '14.796', 'FRAGCOUNT': '40.500'} [2023-02-24 21:25:48,443][213372] DAMAGECOUNT value on done: 638220.0 [2023-02-24 21:25:48,444][213372] Sum rewards: 48.963, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.690', 'AMMO2': '0.009', 'AMMO5': '0.016', 'AMMO4': '0.044', 'WEAPON4': '0.200', 'weapon5': '0.232', 'AMMO3': '0.284', 'weapon4': '0.348', 'WEAPON5': '0.400', 'weapon2': '0.460', 'WEAPON3': '1.550', 'weapon3': '2.608', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.602', 'FRAGCOUNT': '46.000'} [2023-02-24 21:25:48,748][213372] DAMAGECOUNT value on done: 625513.0 [2023-02-24 21:25:48,749][213372] Sum rewards: 63.547, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.982', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.036', 'AMMO4': '0.178', 'AMMO3': '0.183', 'weapon5': '0.276', 'weapon2': '0.364', 'weapon4': '0.404', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.626', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '54.000'} [2023-02-24 21:25:48,829][213372] DAMAGECOUNT value on done: 615796.0 [2023-02-24 21:25:48,830][213372] Sum rewards: 51.901, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.523', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.120', 'AMMO3': '0.188', 'weapon2': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.680', 'WEAPON3': '1.150', 'weapon3': '2.712', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.740', 'FRAGCOUNT': '45.000'} [2023-02-24 21:25:49,129][213372] DAMAGECOUNT value on done: 613533.0 [2023-02-24 21:25:49,129][213372] Sum rewards: 45.207, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.094', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.052', 'AMMO3': '0.123', 'weapon5': '0.214', 'AMMO4': '0.259', 'WEAPON5': '0.450', 'weapon4': '0.480', 'WEAPON4': '0.500', 'weapon2': '0.646', 'WEAPON3': '0.800', 'weapon3': '2.394', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '12.192', 'FRAGCOUNT': '36.000'} [2023-02-24 21:25:49,352][213366] DAMAGECOUNT value on done: 611334.0 [2023-02-24 21:25:49,353][213366] Sum rewards: 48.032, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.380', 'AMMO2': '0.017', 'AMMO5': '0.023', 'AMMO4': '0.083', 'AMMO3': '0.214', 'weapon5': '0.244', 'weapon4': '0.292', 'WEAPON4': '0.300', 'weapon2': '0.438', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.686', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.104', 'FRAGCOUNT': '43.500'} [2023-02-24 21:25:49,654][213366] DAMAGECOUNT value on done: 638285.0 [2023-02-24 21:25:49,655][213366] Sum rewards: 53.102, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.745', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.196', 'AMMO3': '0.232', 'weapon2': '0.268', 'WEAPON3': '1.350', 'HITCOUNT': '3.120', 'weapon3': '3.230', 'DAMAGECOUNT': '14.985', 'FRAGCOUNT': '45.000'} [2023-02-24 21:25:49,688][213366] DAMAGECOUNT value on done: 625147.0 [2023-02-24 21:25:49,689][213366] Sum rewards: 41.004, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.007', 'AMMO5': '0.018', 'AMMO2': '0.044', 'AMMO3': '0.213', 'AMMO4': '0.222', 'weapon4': '0.312', 'weapon5': '0.378', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.518', 'WEAPON3': '1.200', 'HITCOUNT': '2.090', 'weapon3': '2.396', 'DAMAGECOUNT': '11.370', 'FRAGCOUNT': '38.000'} [2023-02-24 21:25:49,992][213366] DAMAGECOUNT value on done: 625549.0 [2023-02-24 21:25:49,992][213366] Sum rewards: 43.006, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.691', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'weapon2': '0.248', 'weapon4': '0.296', 'WEAPON3': '1.250', 'HITCOUNT': '2.790', 'weapon3': '3.114', 'DAMAGECOUNT': '12.435', 'FRAGCOUNT': '38.000'} [2023-02-24 21:25:50,147][213383] DAMAGECOUNT value on done: 621374.0 [2023-02-24 21:25:50,148][213383] Sum rewards: 40.521, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.560', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon4': '0.352', 'weapon2': '0.670', 'WEAPON3': '1.250', 'HITCOUNT': '2.500', 'weapon3': '2.672', 'DAMAGECOUNT': '11.298', 'FRAGCOUNT': '35.500'} [2023-02-24 21:25:50,243][213332] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 149725184. Throughput: 0: 3460.8. Samples: 12420284. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-24 21:25:50,243][213332] Avg episode reward: [(0, '47.349')] [2023-02-24 21:25:50,279][213369] DAMAGECOUNT value on done: 623609.0 [2023-02-24 21:25:50,280][213369] Sum rewards: 58.948, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.858', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.191', 'weapon5': '0.256', 'WEAPON4': '0.350', 'weapon4': '0.410', 'weapon2': '0.418', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.640', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '49.000'} [2023-02-24 21:25:50,435][213368] DAMAGECOUNT value on done: 612860.0 [2023-02-24 21:25:50,435][213368] Sum rewards: 40.103, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.682', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.066', 'weapon5': '0.144', 'AMMO3': '0.201', 'AMMO4': '0.330', 'weapon2': '0.410', 'WEAPON5': '0.450', 'weapon4': '0.624', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.486', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '12.591', 'FRAGCOUNT': '38.000'} [2023-02-24 21:25:50,448][213383] DAMAGECOUNT value on done: 617669.0 [2023-02-24 21:25:50,448][213383] Sum rewards: 44.164, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.006', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.174', 'weapon5': '0.182', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.750', 'weapon2': '0.902', 'WEAPON3': '1.150', 'weapon3': '1.952', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '11.874', 'FRAGCOUNT': '38.000'} [2023-02-24 21:25:50,577][213369] DAMAGECOUNT value on done: 624048.0 [2023-02-24 21:25:50,577][213369] Sum rewards: 35.904, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.600', 'AMMO2': '0.006', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO4': '0.028', 'weapon5': '0.078', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.268', 'weapon2': '0.286', 'weapon4': '0.472', 'WEAPON3': '1.650', 'HITCOUNT': '2.180', 'weapon3': '2.900', 'DAMAGECOUNT': '10.563', 'FRAGCOUNT': '35.000'} [2023-02-24 21:25:50,595][213382] DAMAGECOUNT value on done: 624858.0 [2023-02-24 21:25:50,595][213382] Sum rewards: 41.065, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.902', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.145', 'weapon5': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.452', 'WEAPON3': '0.900', 'weapon2': '0.978', 'weapon3': '1.826', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '12.039', 'FRAGCOUNT': '34.000'} [2023-02-24 21:25:50,719][213365] Updated weights for policy 0, policy_version 36556 (0.0009) [2023-02-24 21:25:50,730][213368] DAMAGECOUNT value on done: 622644.0 [2023-02-24 21:25:50,731][213368] Sum rewards: 37.075, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.810', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.474', 'weapon4': '0.480', 'WEAPON3': '1.150', 'HITCOUNT': '2.470', 'weapon3': '2.780', 'DAMAGECOUNT': '10.833', 'FRAGCOUNT': '33.000'} [2023-02-24 21:25:50,880][213369] DAMAGECOUNT value on done: 620887.0 [2023-02-24 21:25:50,881][213369] Sum rewards: 59.432, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.740', 'AMMO5': '0.017', 'AMMO2': '0.024', 'weapon4': '0.042', 'AMMO4': '0.119', 'weapon5': '0.166', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'WEAPON5': '0.450', 'weapon2': '0.496', 'WEAPON3': '1.250', 'HITCOUNT': '2.830', 'weapon3': '3.046', 'DAMAGECOUNT': '14.817', 'FRAGCOUNT': '51.000'} [2023-02-24 21:25:50,890][213382] DAMAGECOUNT value on done: 620084.0 [2023-02-24 21:25:50,890][213382] Sum rewards: 54.366, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.456', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.144', 'AMMO4': '0.153', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.354', 'weapon4': '0.428', 'WEAPON3': '1.150', 'weapon3': '2.816', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.128', 'FRAGCOUNT': '46.000'} [2023-02-24 21:25:50,997][213368] DAMAGECOUNT value on done: 615846.0 [2023-02-24 21:25:50,998][213368] Sum rewards: 43.035, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.000', 'AMMO5': '0.017', 'AMMO2': '0.033', 'AMMO4': '0.167', 'weapon2': '0.204', 'AMMO3': '0.223', 'weapon5': '0.272', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon4': '1.064', 'WEAPON3': '1.350', 'weapon3': '2.106', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.768', 'FRAGCOUNT': '40.000'} [2023-02-24 21:25:51,183][213369] DAMAGECOUNT value on done: 609360.0 [2023-02-24 21:25:51,183][213369] Sum rewards: 42.820, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.824', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.151', 'AMMO3': '0.168', 'weapon5': '0.206', 'weapon4': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.718', 'WEAPON3': '1.000', 'HITCOUNT': '2.290', 'weapon3': '2.454', 'DAMAGECOUNT': '11.295', 'FRAGCOUNT': '38.000'} [2023-02-24 21:25:51,250][213382] DAMAGECOUNT value on done: 612637.0 [2023-02-24 21:25:51,251][213382] Sum rewards: 43.717, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.420', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.014', 'AMMO4': '0.039', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'weapon2': '0.360', 'weapon4': '0.488', 'WEAPON3': '1.150', 'HITCOUNT': '2.570', 'weapon3': '2.666', 'DAMAGECOUNT': '11.694', 'FRAGCOUNT': '37.000'} [2023-02-24 21:25:51,281][213383] DAMAGECOUNT value on done: 621941.0 [2023-02-24 21:25:51,281][213383] Sum rewards: 50.874, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.516', 'AMMO5': '0.014', 'AMMO2': '0.028', 'weapon5': '0.074', 'AMMO4': '0.141', 'weapon4': '0.182', 'AMMO3': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON3': '1.550', 'weapon3': '3.032', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.132', 'FRAGCOUNT': '47.000'} [2023-02-24 21:25:51,290][213368] DAMAGECOUNT value on done: 614839.0 [2023-02-24 21:25:51,290][213368] Sum rewards: 58.110, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.130', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.092', 'AMMO4': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'weapon4': '0.292', 'weapon2': '0.604', 'WEAPON3': '1.150', 'weapon3': '2.800', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.922', 'FRAGCOUNT': '50.000'} [2023-02-24 21:25:51,547][213382] DAMAGECOUNT value on done: 617311.0 [2023-02-24 21:25:51,548][213382] Sum rewards: 40.558, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.000', 'ARMOR': '0.005', 'AMMO5': '0.019', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon5': '0.170', 'AMMO3': '0.180', 'WEAPON4': '0.400', 'weapon2': '0.428', 'WEAPON5': '0.450', 'weapon4': '0.916', 'WEAPON3': '1.150', 'weapon3': '2.214', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '11.523', 'FRAGCOUNT': '36.000'} [2023-02-24 21:25:51,584][213383] DAMAGECOUNT value on done: 615745.0 [2023-02-24 21:25:51,585][213383] Sum rewards: 39.887, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.174', 'AMMO5': '0.013', 'AMMO2': '0.028', 'AMMO3': '0.133', 'AMMO4': '0.140', 'weapon5': '0.192', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.580', 'weapon2': '0.610', 'WEAPON3': '0.750', 'weapon3': '2.424', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '10.860', 'FRAGCOUNT': '34.000'} [2023-02-24 21:25:51,746][213384] DAMAGECOUNT value on done: 624147.0 [2023-02-24 21:25:51,747][213384] Sum rewards: 46.766, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.452', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon5': '0.044', 'AMMO4': '0.046', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon2': '0.244', 'WEAPON4': '0.250', 'weapon4': '0.496', 'WEAPON3': '1.450', 'weapon3': '2.832', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '12.927', 'FRAGCOUNT': '42.000'} [2023-02-24 21:25:52,055][213384] DAMAGECOUNT value on done: 608314.0 [2023-02-24 21:25:52,056][213384] Sum rewards: 39.552, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.761', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon5': '0.120', 'AMMO4': '0.189', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'weapon4': '0.270', 'WEAPON4': '0.300', 'weapon2': '0.844', 'WEAPON3': '1.150', 'weapon3': '2.534', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '10.920', 'FRAGCOUNT': '36.000'} [2023-02-24 21:25:52,412][213384] DAMAGECOUNT value on done: 617117.0 [2023-02-24 21:25:52,413][213384] Sum rewards: 31.722, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.156', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO4': '0.137', 'AMMO3': '0.150', 'weapon5': '0.210', 'weapon2': '0.290', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.453', 'weapon4': '0.706', 'WEAPON3': '0.900', 'HITCOUNT': '2.160', 'weapon3': '2.350', 'DAMAGECOUNT': '9.279', 'FRAGCOUNT': '26.000'} [2023-02-24 21:25:52,717][213384] DAMAGECOUNT value on done: 620799.0 [2023-02-24 21:25:52,718][213384] Sum rewards: 51.890, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.218', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.046', 'AMMO3': '0.158', 'weapon2': '0.192', 'AMMO4': '0.232', 'weapon5': '0.294', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'weapon4': '0.770', 'WEAPON3': '1.000', 'weapon3': '2.412', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.638', 'FRAGCOUNT': '44.000'} [2023-02-24 21:25:53,678][213365] Updated weights for policy 0, policy_version 36566 (0.0009) [2023-02-24 21:25:55,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 149794816. Throughput: 0: 3460.4. Samples: 12441084. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:25:55,243][213332] Avg episode reward: [(0, '47.164')] [2023-02-24 21:25:56,626][213365] Updated weights for policy 0, policy_version 36576 (0.0009) [2023-02-24 21:25:59,577][213365] Updated weights for policy 0, policy_version 36586 (0.0009) [2023-02-24 21:26:00,243][213332] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 149864448. Throughput: 0: 3465.6. Samples: 12461922. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:26:00,243][213332] Avg episode reward: [(0, '47.164')] [2023-02-24 21:26:02,526][213365] Updated weights for policy 0, policy_version 36596 (0.0009) [2023-02-24 21:26:05,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 149934080. Throughput: 0: 3464.8. Samples: 12472318. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:26:05,243][213332] Avg episode reward: [(0, '47.164')] [2023-02-24 21:26:05,476][213365] Updated weights for policy 0, policy_version 36606 (0.0009) [2023-02-24 21:26:06,749][213367] DAMAGECOUNT value on done: 619415.0 [2023-02-24 21:26:06,749][213367] Sum rewards: 42.573, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.794', 'AMMO5': '0.011', 'AMMO2': '0.060', 'weapon5': '0.180', 'AMMO3': '0.181', 'weapon4': '0.262', 'AMMO4': '0.302', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.536', 'WEAPON3': '1.100', 'HITCOUNT': '2.470', 'weapon3': '2.750', 'DAMAGECOUNT': '11.214', 'FRAGCOUNT': '39.000'} [2023-02-24 21:26:06,828][213367] DAMAGECOUNT value on done: 620058.0 [2023-02-24 21:26:06,828][213367] Sum rewards: 42.748, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.058', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.040', 'AMMO3': '0.194', 'AMMO4': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.272', 'weapon2': '0.316', 'WEAPON4': '0.450', 'weapon4': '0.730', 'WEAPON3': '1.100', 'weapon3': '2.376', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '11.457', 'FRAGCOUNT': '38.000'} [2023-02-24 21:26:07,047][213367] DAMAGECOUNT value on done: 620553.0 [2023-02-24 21:26:07,048][213367] Sum rewards: 44.252, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.366', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.183', 'weapon5': '0.228', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.492', 'weapon2': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.382', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '11.922', 'FRAGCOUNT': '40.000'} [2023-02-24 21:26:07,127][213367] DAMAGECOUNT value on done: 631013.0 [2023-02-24 21:26:07,128][213367] Sum rewards: 40.347, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.105', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO4': '0.178', 'AMMO3': '0.241', 'weapon5': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.356', 'weapon2': '0.698', 'WEAPON3': '1.350', 'weapon3': '2.368', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '11.427', 'FRAGCOUNT': '39.000'} [2023-02-24 21:26:07,742][213372] DAMAGECOUNT value on done: 642810.0 [2023-02-24 21:26:07,742][213372] Sum rewards: 50.273, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.388', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'weapon5': '0.120', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'weapon2': '0.320', 'weapon4': '0.640', 'WEAPON3': '1.150', 'weapon3': '2.710', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.770', 'FRAGCOUNT': '42.000'} [2023-02-24 21:26:08,040][213372] DAMAGECOUNT value on done: 629711.0 [2023-02-24 21:26:08,041][213372] Sum rewards: 41.571, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.372', 'ARMOR': '0.012', 'AMMO5': '0.033', 'AMMO2': '0.056', 'weapon5': '0.106', 'AMMO3': '0.197', 'weapon4': '0.274', 'AMMO4': '0.279', 'weapon2': '0.430', 'WEAPON4': '0.600', 'WEAPON5': '0.700', 'WEAPON3': '1.300', 'HITCOUNT': '2.770', 'weapon3': '2.842', 'DAMAGECOUNT': '12.594', 'FRAGCOUNT': '40.000'} [2023-02-24 21:26:08,166][213372] DAMAGECOUNT value on done: 619739.0 [2023-02-24 21:26:08,166][213372] Sum rewards: 44.389, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.710', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO4': '0.121', 'AMMO3': '0.141', 'weapon5': '0.202', 'weapon2': '0.248', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.832', 'WEAPON3': '0.900', 'weapon3': '2.436', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '11.829', 'FRAGCOUNT': '38.000'} [2023-02-24 21:26:08,416][213365] Updated weights for policy 0, policy_version 36616 (0.0009) [2023-02-24 21:26:08,468][213372] DAMAGECOUNT value on done: 618049.0 [2023-02-24 21:26:08,469][213372] Sum rewards: 52.762, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.840', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.140', 'AMMO3': '0.152', 'AMMO4': '0.159', 'weapon5': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.614', 'WEAPON3': '0.900', 'HITCOUNT': '2.730', 'weapon3': '2.878', 'DAMAGECOUNT': '13.548', 'FRAGCOUNT': '43.000'} [2023-02-24 21:26:08,769][213366] DAMAGECOUNT value on done: 615095.0 [2023-02-24 21:26:08,769][213366] Sum rewards: 42.177, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.710', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.032', 'AMMO4': '0.103', 'weapon5': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'weapon2': '0.750', 'WEAPON3': '1.250', 'HITCOUNT': '2.440', 'weapon3': '2.764', 'DAMAGECOUNT': '11.283', 'FRAGCOUNT': '39.000'} [2023-02-24 21:26:09,064][213366] DAMAGECOUNT value on done: 629698.0 [2023-02-24 21:26:09,065][213366] Sum rewards: 45.435, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.950', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon4': '0.122', 'weapon5': '0.132', 'WEAPON4': '0.150', 'weapon2': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.268', 'WEAPON3': '1.550', 'HITCOUNT': '2.780', 'weapon3': '3.170', 'DAMAGECOUNT': '13.653', 'FRAGCOUNT': '42.000'} [2023-02-24 21:26:09,075][213366] DAMAGECOUNT value on done: 642780.0 [2023-02-24 21:26:09,075][213366] Sum rewards: 50.897, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.720', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.126', 'AMMO3': '0.185', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.444', 'weapon4': '0.652', 'WEAPON3': '1.100', 'weapon3': '2.484', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.485', 'FRAGCOUNT': '44.000'} [2023-02-24 21:26:09,364][213366] DAMAGECOUNT value on done: 629991.0 [2023-02-24 21:26:09,365][213366] Sum rewards: 48.095, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.924', 'AMMO5': '0.024', 'AMMO2': '0.036', 'AMMO4': '0.181', 'AMMO3': '0.227', 'weapon2': '0.228', 'weapon4': '0.290', 'weapon5': '0.294', 'WEAPON4': '0.450', 'WEAPON5': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.778', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.281', 'FRAGCOUNT': '44.000'} [2023-02-24 21:26:09,471][213383] DAMAGECOUNT value on done: 626382.0 [2023-02-24 21:26:09,472][213383] Sum rewards: 54.347, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.937', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.044', 'AMMO3': '0.149', 'AMMO4': '0.221', 'weapon5': '0.298', 'weapon2': '0.308', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon4': '0.688', 'WEAPON3': '0.900', 'weapon3': '2.344', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.003', 'FRAGCOUNT': '45.000'} [2023-02-24 21:26:09,653][213369] DAMAGECOUNT value on done: 627673.0 [2023-02-24 21:26:09,654][213369] Sum rewards: 44.976, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.550', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'AMMO4': '0.175', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon5': '0.302', 'weapon4': '0.314', 'WEAPON5': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.200', 'weapon3': '2.372', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.192', 'FRAGCOUNT': '38.000'} [2023-02-24 21:26:09,763][213368] DAMAGECOUNT value on done: 617319.0 [2023-02-24 21:26:09,763][213368] Sum rewards: 54.280, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.274', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.104', 'AMMO4': '0.116', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon2': '0.220', 'weapon4': '0.552', 'WEAPON3': '1.250', 'weapon3': '2.902', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.377', 'FRAGCOUNT': '46.000'} [2023-02-24 21:26:09,765][213383] DAMAGECOUNT value on done: 622344.0 [2023-02-24 21:26:09,766][213383] Sum rewards: 47.171, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.687', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.052', 'AMMO3': '0.199', 'AMMO4': '0.260', 'weapon5': '0.266', 'weapon2': '0.340', 'WEAPON5': '0.500', 'weapon4': '0.594', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.270', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '14.025', 'FRAGCOUNT': '42.000'} [2023-02-24 21:26:09,949][213369] DAMAGECOUNT value on done: 628176.0 [2023-02-24 21:26:09,950][213369] Sum rewards: 48.230, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.858', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO2': '0.033', 'AMMO3': '0.158', 'AMMO4': '0.163', 'weapon5': '0.330', 'weapon4': '0.338', 'weapon2': '0.394', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.514', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '12.384', 'FRAGCOUNT': '42.000'} [2023-02-24 21:26:09,951][213382] DAMAGECOUNT value on done: 628857.0 [2023-02-24 21:26:09,952][213382] Sum rewards: 46.218, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.893', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.041', 'AMMO3': '0.168', 'AMMO4': '0.205', 'weapon4': '0.226', 'weapon5': '0.380', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.630', 'WEAPON3': '1.050', 'weapon3': '2.204', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '11.757', 'FRAGCOUNT': '41.000'} [2023-02-24 21:26:10,063][213368] DAMAGECOUNT value on done: 626847.0 [2023-02-24 21:26:10,064][213368] Sum rewards: 46.301, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.342', 'ARMOR': '0.004', 'AMMO2': '0.016', 'AMMO5': '0.017', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'weapon5': '0.198', 'weapon2': '0.212', 'weapon4': '0.216', 'AMMO3': '0.264', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.710', 'weapon3': '3.066', 'DAMAGECOUNT': '12.609', 'FRAGCOUNT': '42.000'} [2023-02-24 21:26:10,243][213332] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13857.0). Total num frames: 150003712. Throughput: 0: 3469.1. Samples: 12493214. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-24 21:26:10,243][213332] Avg episode reward: [(0, '47.405')] [2023-02-24 21:26:10,248][213382] DAMAGECOUNT value on done: 624855.0 [2023-02-24 21:26:10,248][213382] Sum rewards: 54.416, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.834', 'AMMO5': '0.012', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon4': '0.150', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon5': '0.206', 'WEAPON5': '0.400', 'weapon2': '0.568', 'WEAPON3': '1.200', 'weapon3': '2.838', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.313', 'FRAGCOUNT': '46.000'} [2023-02-24 21:26:10,251][213369] DAMAGECOUNT value on done: 625868.0 [2023-02-24 21:26:10,251][213369] Sum rewards: 58.416, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.442', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon4': '0.178', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'weapon5': '0.346', 'WEAPON5': '0.400', 'weapon2': '0.444', 'WEAPON3': '1.300', 'weapon3': '2.670', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.943', 'FRAGCOUNT': '51.000'} [2023-02-24 21:26:10,343][213368] DAMAGECOUNT value on done: 619458.0 [2023-02-24 21:26:10,343][213368] Sum rewards: 42.687, reward structure: {'DEATHCOUNT': '-13.500', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO3': '0.141', 'AMMO4': '0.159', 'weapon5': '0.164', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'HEALTH': '0.383', 'weapon2': '0.448', 'weapon4': '0.746', 'WEAPON3': '0.800', 'weapon3': '2.404', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '10.836', 'FRAGCOUNT': '37.000'} [2023-02-24 21:26:10,476][213352] Stopping Batcher_0... [2023-02-24 21:26:10,476][213332] Component Batcher_0 stopped! [2023-02-24 21:26:10,476][213352] Loop batcher_evt_loop terminating... [2023-02-24 21:26:10,477][213352] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000036623_150007808.pth... [2023-02-24 21:26:10,495][213382] Stopping RolloutWorker_w6... [2023-02-24 21:26:10,495][213332] Component RolloutWorker_w6 stopped! [2023-02-24 21:26:10,496][213382] Loop rollout_proc6_evt_loop terminating... [2023-02-24 21:26:10,495][213367] Stopping RolloutWorker_w0... [2023-02-24 21:26:10,496][213332] Component RolloutWorker_w0 stopped! [2023-02-24 21:26:10,496][213367] Loop rollout_proc0_evt_loop terminating... [2023-02-24 21:26:10,497][213332] Component RolloutWorker_w2 stopped! [2023-02-24 21:26:10,497][213368] Stopping RolloutWorker_w2... [2023-02-24 21:26:10,498][213368] Loop rollout_proc2_evt_loop terminating... [2023-02-24 21:26:10,499][213332] Component RolloutWorker_w1 stopped! [2023-02-24 21:26:10,499][213366] Stopping RolloutWorker_w1... [2023-02-24 21:26:10,499][213332] Component RolloutWorker_w5 stopped! [2023-02-24 21:26:10,499][213383] Stopping RolloutWorker_w5... [2023-02-24 21:26:10,500][213366] Loop rollout_proc1_evt_loop terminating... [2023-02-24 21:26:10,500][213383] Loop rollout_proc5_evt_loop terminating... [2023-02-24 21:26:10,503][213365] Weights refcount: 2 0 [2023-02-24 21:26:10,505][213365] Stopping InferenceWorker_p0-w0... [2023-02-24 21:26:10,505][213384] Stopping RolloutWorker_w7... [2023-02-24 21:26:10,505][213365] Loop inference_proc0-0_evt_loop terminating... [2023-02-24 21:26:10,505][213384] Loop rollout_proc7_evt_loop terminating... [2023-02-24 21:26:10,505][213332] Component InferenceWorker_p0-w0 stopped! [2023-02-24 21:26:10,505][213332] Component RolloutWorker_w7 stopped! [2023-02-24 21:26:10,507][213332] Component RolloutWorker_w3 stopped! [2023-02-24 21:26:10,507][213369] Stopping RolloutWorker_w3... [2023-02-24 21:26:10,508][213369] Loop rollout_proc3_evt_loop terminating... [2023-02-24 21:26:10,508][213332] Component RolloutWorker_w4 stopped! [2023-02-24 21:26:10,508][213372] Stopping RolloutWorker_w4... [2023-02-24 21:26:10,508][213372] Loop rollout_proc4_evt_loop terminating... [2023-02-24 21:26:10,553][213352] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000035929_147165184.pth [2023-02-24 21:26:10,561][213352] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000036623_150007808.pth... [2023-02-24 21:26:10,665][213352] Stopping LearnerWorker_p0... [2023-02-24 21:26:10,666][213332] Component LearnerWorker_p0 stopped! [2023-02-24 21:26:10,666][213352] Loop learner_proc0_evt_loop terminating... [2023-02-24 21:26:10,666][213332] Waiting for process learner_proc0 to stop... [2023-02-24 21:26:11,480][213332] Waiting for process inference_proc0-0 to join... [2023-02-24 21:26:11,480][213332] Waiting for process rollout_proc0 to join... [2023-02-24 21:26:11,481][213332] Waiting for process rollout_proc1 to join... [2023-02-24 21:26:11,481][213332] Waiting for process rollout_proc2 to join... [2023-02-24 21:26:11,481][213332] Waiting for process rollout_proc3 to join... [2023-02-24 21:26:11,481][213332] Waiting for process rollout_proc4 to join... [2023-02-24 21:26:11,481][213332] Waiting for process rollout_proc5 to join... [2023-02-24 21:26:11,482][213332] Waiting for process rollout_proc6 to join... [2023-02-24 21:26:11,482][213332] Waiting for process rollout_proc7 to join... [2023-02-24 21:26:11,482][213332] Batcher 0 profile tree view: batching: 190.1614, releasing_batches: 0.2589 [2023-02-24 21:26:11,482][213332] InferenceWorker_p0-w0 profile tree view: wait_policy: 0.0000 wait_policy_total: 43.5355 update_model: 43.7452 weight_update: 0.0009 one_step: 0.0035 handle_policy_step: 3433.6315 deserialize: 145.8268, stack: 17.4966, obs_to_device_normalize: 904.0303, forward: 1733.8947, send_messages: 156.9022 prepare_outputs: 362.7372 to_cpu: 217.0457 [2023-02-24 21:26:11,482][213332] Learner 0 profile tree view: misc: 0.0747, prepare_batch: 88.7660 train: 388.9380 epoch_init: 0.0496, minibatch_init: 0.0741, losses_postprocess: 2.6492, kl_divergence: 8.1328, after_optimizer: 2.4440 calculate_losses: 155.3108 losses_init: 0.0300, forward_head: 9.5487, bptt_initial: 102.0424, tail: 11.9494, advantages_returns: 1.5255, losses: 18.2394 bptt: 10.1552 bptt_forward_core: 9.7488 update: 214.8589 clip: 10.9783 [2023-02-24 21:26:11,482][213332] RolloutWorker_w0 profile tree view: wait_for_trajectories: 1.5696, enqueue_policy_requests: 105.5710, env_step: 2509.7466, overhead: 117.3717, complete_rollouts: 3.0344 save_policy_outputs: 91.2973 split_output_tensors: 44.7772 [2023-02-24 21:26:11,482][213332] RolloutWorker_w7 profile tree view: wait_for_trajectories: 1.5813, enqueue_policy_requests: 104.4962, env_step: 2521.2655, overhead: 122.0065, complete_rollouts: 2.9412 save_policy_outputs: 92.5672 split_output_tensors: 44.8685 [2023-02-24 21:26:11,483][213332] Loop Runner_EvtLoop terminating... [2023-02-24 21:26:11,483][213332] Runner profile tree view: main_loop: 3684.6875 [2023-02-24 21:26:11,483][213332] Collected {0: 150007808}, FPS: 13569.6 [2023-02-25 13:11:21,531][36114] Saving configuration to /home/besa/source/rl/train_dir/default_experiment/config.json... [2023-02-25 13:11:21,532][36114] Rollout worker 0 uses device cpu [2023-02-25 13:11:21,532][36114] Rollout worker 1 uses device cpu [2023-02-25 13:11:21,532][36114] Rollout worker 2 uses device cpu [2023-02-25 13:11:21,532][36114] Rollout worker 3 uses device cpu [2023-02-25 13:11:21,532][36114] Rollout worker 4 uses device cpu [2023-02-25 13:11:21,532][36114] Rollout worker 5 uses device cpu [2023-02-25 13:11:21,533][36114] Rollout worker 6 uses device cpu [2023-02-25 13:11:21,533][36114] Rollout worker 7 uses device cpu [2023-02-25 13:11:21,601][36114] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2023-02-25 13:11:21,601][36114] InferenceWorker_p0-w0: min num requests: 2 [2023-02-25 13:11:21,619][36114] Starting all processes... [2023-02-25 13:11:21,619][36114] Starting process learner_proc0 [2023-02-25 13:11:22,335][36114] Starting all processes... [2023-02-25 13:11:22,338][36114] Starting process inference_proc0-0 [2023-02-25 13:11:22,338][36125] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2023-02-25 13:11:22,338][36114] Starting process rollout_proc0 [2023-02-25 13:11:22,338][36125] Set environment var CUDA_VISIBLE_DEVICES to '0' (GPU indices [0]) for learning process 0 [2023-02-25 13:11:22,338][36114] Starting process rollout_proc1 [2023-02-25 13:11:22,338][36114] Starting process rollout_proc2 [2023-02-25 13:11:22,349][36125] Num visible devices: 1 [2023-02-25 13:11:22,338][36114] Starting process rollout_proc3 [2023-02-25 13:11:22,338][36114] Starting process rollout_proc4 [2023-02-25 13:11:22,338][36114] Starting process rollout_proc5 [2023-02-25 13:11:22,338][36114] Starting process rollout_proc6 [2023-02-25 13:11:22,340][36114] Starting process rollout_proc7 [2023-02-25 13:11:22,406][36125] Starting seed is not provided [2023-02-25 13:11:22,407][36125] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2023-02-25 13:11:22,407][36125] Initializing actor-critic model on device cuda:0 [2023-02-25 13:11:22,408][36125] RunningMeanStd input shape: (23,) [2023-02-25 13:11:22,408][36125] RunningMeanStd input shape: (3, 72, 128) [2023-02-25 13:11:22,409][36125] RunningMeanStd input shape: (1,) [2023-02-25 13:11:22,428][36125] ConvEncoder: input_channels=3 [2023-02-25 13:11:22,568][36125] Conv encoder output size: 512 [2023-02-25 13:11:22,568][36125] Policy head output size: 512 [2023-02-25 13:11:22,584][36125] Created Actor Critic model with architecture: [2023-02-25 13:11:22,584][36125] ActorCriticSharedWeights( (obs_normalizer): ObservationNormalizer( (running_mean_std): RunningMeanStdDictInPlace( (running_mean_std): ModuleDict( (measurements): RunningMeanStdInPlace() (obs): RunningMeanStdInPlace() ) ) ) (returns_normalizer): RecursiveScriptModule(original_name=RunningMeanStdInPlace) (encoder): VizdoomEncoder( (basic_encoder): ConvEncoder( (enc): RecursiveScriptModule( original_name=ConvEncoderImpl (conv_head): RecursiveScriptModule( original_name=Sequential (0): RecursiveScriptModule(original_name=Conv2d) (1): RecursiveScriptModule(original_name=ELU) (2): RecursiveScriptModule(original_name=Conv2d) (3): RecursiveScriptModule(original_name=ELU) (4): RecursiveScriptModule(original_name=Conv2d) (5): RecursiveScriptModule(original_name=ELU) ) (mlp_layers): RecursiveScriptModule( original_name=Sequential (0): RecursiveScriptModule(original_name=Linear) (1): RecursiveScriptModule(original_name=ELU) ) ) ) ) (core): ModelCoreRNN( (core): GRU(512, 512) ) (decoder): MlpDecoder( (mlp): Identity() ) (critic_linear): Linear(in_features=512, out_features=1, bias=True) (action_parameterization): ActionParameterizationDefault( (distribution_linear): Linear(in_features=512, out_features=39, bias=True) ) ) [2023-02-25 13:11:23,608][36154] Worker 5 uses CPU cores [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] [2023-02-25 13:11:23,794][36139] Worker 0 uses CPU cores [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] [2023-02-25 13:11:23,801][36140] Worker 1 uses CPU cores [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] [2023-02-25 13:11:23,829][36138] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2023-02-25 13:11:23,829][36138] Set environment var CUDA_VISIBLE_DEVICES to '0' (GPU indices [0]) for inference process 0 [2023-02-25 13:11:23,846][36138] Num visible devices: 1 [2023-02-25 13:11:23,895][36142] Worker 3 uses CPU cores [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] [2023-02-25 13:11:23,897][36141] Worker 2 uses CPU cores [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] [2023-02-25 13:11:23,917][36156] Worker 6 uses CPU cores [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] [2023-02-25 13:11:23,934][36157] Worker 7 uses CPU cores [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] [2023-02-25 13:11:23,936][36155] Worker 4 uses CPU cores [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11] [2023-02-25 13:11:24,455][36125] Using optimizer [2023-02-25 13:11:24,455][36125] Loading state from checkpoint /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000036623_150007808.pth... [2023-02-25 13:11:24,476][36125] Loading model from checkpoint [2023-02-25 13:11:24,479][36125] Loaded experiment state at self.train_step=36623, self.env_steps=150007808 [2023-02-25 13:11:24,480][36125] Initialized policy 0 weights for model version 36623 [2023-02-25 13:11:24,481][36125] LearnerWorker_p0 finished initialization! [2023-02-25 13:11:24,481][36125] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2023-02-25 13:11:24,729][36114] Fps is (10 sec: nan, 60 sec: nan, 300 sec: nan). Total num frames: 150007808. Throughput: 0: nan. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2023-02-25 13:11:24,929][36138] RunningMeanStd input shape: (23,) [2023-02-25 13:11:24,929][36138] RunningMeanStd input shape: (3, 72, 128) [2023-02-25 13:11:24,929][36138] RunningMeanStd input shape: (1,) [2023-02-25 13:11:24,937][36138] ConvEncoder: input_channels=3 [2023-02-25 13:11:24,994][36138] Conv encoder output size: 512 [2023-02-25 13:11:24,994][36138] Policy head output size: 512 [2023-02-25 13:11:25,329][36114] Inference worker 0-0 is ready! [2023-02-25 13:11:25,329][36114] All inference workers are ready! Signal rollout workers to start! [2023-02-25 13:11:25,365][36157] Doom resolution: 160x120, resize resolution: (128, 72) [2023-02-25 13:11:25,366][36142] Doom resolution: 160x120, resize resolution: (128, 72) [2023-02-25 13:11:25,368][36157] Port 41000 is available [2023-02-25 13:11:25,368][36157] Using port 41000 [2023-02-25 13:11:25,368][36142] Port 40600 is available [2023-02-25 13:11:25,369][36142] Using port 40600 [2023-02-25 13:11:25,378][36141] Doom resolution: 160x120, resize resolution: (128, 72) [2023-02-25 13:11:25,378][36140] Doom resolution: 160x120, resize resolution: (128, 72) [2023-02-25 13:11:25,380][36155] Doom resolution: 160x120, resize resolution: (128, 72) [2023-02-25 13:11:25,380][36154] Doom resolution: 160x120, resize resolution: (128, 72) [2023-02-25 13:11:25,380][36140] Port 40400 is available [2023-02-25 13:11:25,380][36141] Port 40500 is available [2023-02-25 13:11:25,381][36140] Using port 40400 [2023-02-25 13:11:25,381][36141] Using port 40500 [2023-02-25 13:11:25,381][36139] Doom resolution: 160x120, resize resolution: (128, 72) [2023-02-25 13:11:25,381][36156] Doom resolution: 160x120, resize resolution: (128, 72) [2023-02-25 13:11:25,382][36154] Port 40800 is available [2023-02-25 13:11:25,382][36155] Port 40700 is available [2023-02-25 13:11:25,383][36154] Using port 40800 [2023-02-25 13:11:25,383][36155] Using port 40700 [2023-02-25 13:11:25,383][36156] Port 40900 is available [2023-02-25 13:11:25,383][36139] Port 40300 is available [2023-02-25 13:11:25,383][36156] Using port 40900 [2023-02-25 13:11:25,383][36139] Using port 40300 [2023-02-25 13:11:25,402][36157] Port 41001 is available [2023-02-25 13:11:25,402][36157] Using port 41001 [2023-02-25 13:11:25,404][36142] Port 40601 is available [2023-02-25 13:11:25,404][36142] Using port 40601 [2023-02-25 13:11:25,406][36157] Using port 41000 on host... [2023-02-25 13:11:25,408][36142] Using port 40600 on host... [2023-02-25 13:11:25,425][36155] Port 40701 is available [2023-02-25 13:11:25,425][36155] Using port 40701 [2023-02-25 13:11:25,426][36155] Using port 40700 on host... [2023-02-25 13:11:25,426][36154] Port 40801 is available [2023-02-25 13:11:25,426][36154] Using port 40801 [2023-02-25 13:11:25,428][36154] Using port 40800 on host... [2023-02-25 13:11:25,428][36140] Port 40401 is available [2023-02-25 13:11:25,428][36141] Port 40501 is available [2023-02-25 13:11:25,429][36140] Using port 40401 [2023-02-25 13:11:25,429][36141] Using port 40501 [2023-02-25 13:11:25,430][36139] Port 40301 is available [2023-02-25 13:11:25,430][36156] Port 40901 is available [2023-02-25 13:11:25,430][36156] Using port 40901 [2023-02-25 13:11:25,430][36139] Using port 40301 [2023-02-25 13:11:25,430][36141] Using port 40500 on host... [2023-02-25 13:11:25,430][36140] Using port 40400 on host... [2023-02-25 13:11:25,432][36156] Using port 40900 on host... [2023-02-25 13:11:25,432][36139] Using port 40300 on host... [2023-02-25 13:11:25,608][36139] Initialized w:0 v:0 player:0 [2023-02-25 13:11:25,609][36154] Initialized w:5 v:0 player:0 [2023-02-25 13:11:25,609][36141] Initialized w:2 v:0 player:0 [2023-02-25 13:11:25,609][36157] Initialized w:7 v:0 player:0 [2023-02-25 13:11:25,609][36139] Decorrelating experience for 0 frames... [2023-02-25 13:11:25,610][36154] Decorrelating experience for 0 frames... [2023-02-25 13:11:25,610][36157] Decorrelating experience for 0 frames... [2023-02-25 13:11:25,610][36141] Decorrelating experience for 0 frames... [2023-02-25 13:11:25,610][36154] Using port 40801 on host... [2023-02-25 13:11:25,610][36139] Using port 40301 on host... [2023-02-25 13:11:25,610][36157] Using port 41001 on host... [2023-02-25 13:11:25,611][36141] Using port 40501 on host... [2023-02-25 13:11:25,643][36155] Initialized w:4 v:0 player:0 [2023-02-25 13:11:25,644][36155] Decorrelating experience for 0 frames... [2023-02-25 13:11:25,644][36156] Initialized w:6 v:0 player:0 [2023-02-25 13:11:25,645][36155] Using port 40701 on host... [2023-02-25 13:11:25,645][36156] Decorrelating experience for 0 frames... [2023-02-25 13:11:25,645][36142] Initialized w:3 v:0 player:0 [2023-02-25 13:11:25,646][36156] Using port 40901 on host... [2023-02-25 13:11:25,646][36142] Decorrelating experience for 0 frames... [2023-02-25 13:11:25,646][36142] Using port 40601 on host... [2023-02-25 13:11:25,650][36140] Initialized w:1 v:0 player:0 [2023-02-25 13:11:25,651][36140] Decorrelating experience for 0 frames... [2023-02-25 13:11:25,652][36140] Using port 40401 on host... [2023-02-25 13:11:25,777][36157] Initialized w:7 v:1 player:0 [2023-02-25 13:11:25,778][36157] Decorrelating experience for 32 frames... [2023-02-25 13:11:25,801][36142] Initialized w:3 v:1 player:0 [2023-02-25 13:11:25,801][36142] Decorrelating experience for 32 frames... [2023-02-25 13:11:25,806][36140] Initialized w:1 v:1 player:0 [2023-02-25 13:11:25,807][36140] Decorrelating experience for 32 frames... [2023-02-25 13:11:25,820][36157] Port 41002 is available [2023-02-25 13:11:25,821][36157] Using port 41002 [2023-02-25 13:11:25,821][36155] Initialized w:4 v:1 player:0 [2023-02-25 13:11:25,821][36155] Decorrelating experience for 32 frames... [2023-02-25 13:11:25,834][36157] Port 41003 is available [2023-02-25 13:11:25,834][36157] Using port 41003 [2023-02-25 13:11:25,834][36154] Initialized w:5 v:1 player:0 [2023-02-25 13:11:25,835][36154] Decorrelating experience for 32 frames... [2023-02-25 13:11:25,835][36157] Using port 41002 on host... [2023-02-25 13:11:25,844][36139] Initialized w:0 v:1 player:0 [2023-02-25 13:11:25,844][36139] Decorrelating experience for 32 frames... [2023-02-25 13:11:25,849][36141] Initialized w:2 v:1 player:0 [2023-02-25 13:11:25,851][36141] Decorrelating experience for 32 frames... [2023-02-25 13:11:25,867][36142] Port 40602 is available [2023-02-25 13:11:25,868][36142] Using port 40602 [2023-02-25 13:11:25,872][36140] Port 40402 is available [2023-02-25 13:11:25,872][36140] Using port 40402 [2023-02-25 13:11:25,876][36156] Initialized w:6 v:1 player:0 [2023-02-25 13:11:25,877][36156] Decorrelating experience for 32 frames... [2023-02-25 13:11:25,882][36155] Port 40702 is available [2023-02-25 13:11:25,883][36155] Using port 40702 [2023-02-25 13:11:25,891][36142] Port 40603 is available [2023-02-25 13:11:25,892][36142] Using port 40603 [2023-02-25 13:11:25,894][36142] Using port 40602 on host... [2023-02-25 13:11:25,895][36140] Port 40403 is available [2023-02-25 13:11:25,895][36140] Using port 40403 [2023-02-25 13:11:25,897][36140] Using port 40402 on host... [2023-02-25 13:11:25,900][36155] Port 40703 is available [2023-02-25 13:11:25,901][36155] Using port 40703 [2023-02-25 13:11:25,902][36155] Using port 40702 on host... [2023-02-25 13:11:25,910][36154] Port 40802 is available [2023-02-25 13:11:25,910][36154] Using port 40802 [2023-02-25 13:11:25,928][36139] Port 40302 is available [2023-02-25 13:11:25,928][36139] Using port 40302 [2023-02-25 13:11:25,933][36154] Port 40803 is available [2023-02-25 13:11:25,933][36154] Using port 40803 [2023-02-25 13:11:25,934][36141] Port 40502 is available [2023-02-25 13:11:25,934][36141] Using port 40502 [2023-02-25 13:11:25,935][36154] Using port 40802 on host... [2023-02-25 13:11:25,941][36139] Port 40303 is available [2023-02-25 13:11:25,941][36139] Using port 40303 [2023-02-25 13:11:25,942][36139] Using port 40302 on host... [2023-02-25 13:11:25,949][36141] Port 40503 is available [2023-02-25 13:11:25,950][36141] Using port 40503 [2023-02-25 13:11:25,951][36141] Using port 40502 on host... [2023-02-25 13:11:25,958][36156] Port 40902 is available [2023-02-25 13:11:25,959][36156] Using port 40902 [2023-02-25 13:11:25,972][36156] Port 40903 is available [2023-02-25 13:11:25,973][36156] Using port 40903 [2023-02-25 13:11:25,974][36156] Using port 40902 on host... [2023-02-25 13:11:26,025][36157] Initialized w:7 v:2 player:0 [2023-02-25 13:11:26,026][36157] Decorrelating experience for 64 frames... [2023-02-25 13:11:26,086][36157] Using port 41003 on host... [2023-02-25 13:11:26,108][36142] Initialized w:3 v:2 player:0 [2023-02-25 13:11:26,109][36142] Decorrelating experience for 64 frames... [2023-02-25 13:11:26,109][36154] Initialized w:5 v:2 player:0 [2023-02-25 13:11:26,110][36154] Decorrelating experience for 64 frames... [2023-02-25 13:11:26,130][36140] Initialized w:1 v:2 player:0 [2023-02-25 13:11:26,130][36140] Decorrelating experience for 64 frames... [2023-02-25 13:11:26,130][36155] Initialized w:4 v:2 player:0 [2023-02-25 13:11:26,131][36155] Decorrelating experience for 64 frames... [2023-02-25 13:11:26,136][36141] Initialized w:2 v:2 player:0 [2023-02-25 13:11:26,136][36139] Initialized w:0 v:2 player:0 [2023-02-25 13:11:26,137][36141] Decorrelating experience for 64 frames... [2023-02-25 13:11:26,137][36139] Decorrelating experience for 64 frames... [2023-02-25 13:11:26,175][36154] Using port 40803 on host... [2023-02-25 13:11:26,179][36142] Using port 40603 on host... [2023-02-25 13:11:26,190][36156] Initialized w:6 v:2 player:0 [2023-02-25 13:11:26,191][36156] Decorrelating experience for 64 frames... [2023-02-25 13:11:26,197][36140] Using port 40403 on host... [2023-02-25 13:11:26,198][36155] Using port 40703 on host... [2023-02-25 13:11:26,205][36141] Using port 40503 on host... [2023-02-25 13:11:26,205][36139] Using port 40303 on host... [2023-02-25 13:11:26,255][36156] Using port 40903 on host... [2023-02-25 13:11:26,273][36157] Initialized w:7 v:3 player:0 [2023-02-25 13:11:26,274][36157] Decorrelating experience for 96 frames... [2023-02-25 13:11:26,363][36154] Initialized w:5 v:3 player:0 [2023-02-25 13:11:26,364][36154] Decorrelating experience for 96 frames... [2023-02-25 13:11:26,368][36141] Initialized w:2 v:3 player:0 [2023-02-25 13:11:26,369][36141] Decorrelating experience for 96 frames... [2023-02-25 13:11:26,373][36140] Initialized w:1 v:3 player:0 [2023-02-25 13:11:26,374][36140] Decorrelating experience for 96 frames... [2023-02-25 13:11:26,408][36142] Initialized w:3 v:3 player:0 [2023-02-25 13:11:26,410][36142] Decorrelating experience for 96 frames... [2023-02-25 13:11:26,419][36155] Initialized w:4 v:3 player:0 [2023-02-25 13:11:26,420][36155] Decorrelating experience for 96 frames... [2023-02-25 13:11:26,423][36139] Initialized w:0 v:3 player:0 [2023-02-25 13:11:26,423][36139] Decorrelating experience for 96 frames... [2023-02-25 13:11:26,452][36156] Initialized w:6 v:3 player:0 [2023-02-25 13:11:26,453][36156] Decorrelating experience for 96 frames... [2023-02-25 13:11:27,391][36125] Signal inference workers to stop experience collection... [2023-02-25 13:11:27,398][36138] InferenceWorker_p0-w0: stopping experience collection [2023-02-25 13:11:28,573][36125] Signal inference workers to resume experience collection... [2023-02-25 13:11:28,574][36138] InferenceWorker_p0-w0: resuming experience collection [2023-02-25 13:11:29,729][36114] Fps is (10 sec: 3276.9, 60 sec: 3276.9, 300 sec: 3276.9). Total num frames: 150024192. Throughput: 0: 444.0. Samples: 2220. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-02-25 13:11:31,643][36138] Updated weights for policy 0, policy_version 36633 (0.0360) [2023-02-25 13:11:34,729][36114] Fps is (10 sec: 7782.6, 60 sec: 7782.6, 300 sec: 7782.6). Total num frames: 150085632. Throughput: 0: 1922.2. Samples: 19222. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-02-25 13:11:34,881][36138] Updated weights for policy 0, policy_version 36643 (0.0009) [2023-02-25 13:11:38,197][36138] Updated weights for policy 0, policy_version 36653 (0.0010) [2023-02-25 13:11:39,729][36114] Fps is (10 sec: 12287.9, 60 sec: 9284.4, 300 sec: 9284.4). Total num frames: 150147072. Throughput: 0: 1900.4. Samples: 28506. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-02-25 13:11:41,404][36138] Updated weights for policy 0, policy_version 36663 (0.0009) [2023-02-25 13:11:41,597][36114] Heartbeat connected on Batcher_0 [2023-02-25 13:11:41,599][36114] Heartbeat connected on LearnerWorker_p0 [2023-02-25 13:11:41,606][36114] Heartbeat connected on InferenceWorker_p0-w0 [2023-02-25 13:11:41,608][36114] Heartbeat connected on RolloutWorker_w2 [2023-02-25 13:11:41,608][36114] Heartbeat connected on RolloutWorker_w1 [2023-02-25 13:11:41,608][36114] Heartbeat connected on RolloutWorker_w0 [2023-02-25 13:11:41,614][36114] Heartbeat connected on RolloutWorker_w3 [2023-02-25 13:11:41,615][36114] Heartbeat connected on RolloutWorker_w5 [2023-02-25 13:11:41,616][36114] Heartbeat connected on RolloutWorker_w4 [2023-02-25 13:11:41,619][36114] Heartbeat connected on RolloutWorker_w7 [2023-02-25 13:11:41,621][36114] Heartbeat connected on RolloutWorker_w6 [2023-02-25 13:11:44,601][36138] Updated weights for policy 0, policy_version 36673 (0.0009) [2023-02-25 13:11:44,729][36114] Fps is (10 sec: 12697.6, 60 sec: 10240.1, 300 sec: 10240.1). Total num frames: 150212608. Throughput: 0: 2377.3. Samples: 47546. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-02-25 13:11:47,856][36138] Updated weights for policy 0, policy_version 36683 (0.0009) [2023-02-25 13:11:48,341][36155] DAMAGECOUNT value on done: 3694.0 [2023-02-25 13:11:48,341][36155] Sum rewards: 42.096, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.417', 'AMMO5': '0.007', 'AMMO2': '0.030', 'ARMOR': '0.032', 'WEAPON5': '0.150', 'AMMO4': '0.150', 'weapon5': '0.152', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon2': '0.252', 'weapon4': '0.514', 'WEAPON3': '1.150', 'HITCOUNT': '2.570', 'weapon3': '2.732', 'DAMAGECOUNT': '11.082', 'FRAGCOUNT': '37.000'} [2023-02-25 13:11:48,504][36139] DAMAGECOUNT value on done: 4153.0 [2023-02-25 13:11:48,504][36139] Sum rewards: 40.952, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.659', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.064', 'AMMO4': '0.074', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.210', 'AMMO3': '0.251', 'weapon2': '0.352', 'WEAPON3': '1.400', 'HITCOUNT': '2.590', 'weapon3': '3.038', 'DAMAGECOUNT': '12.459', 'FRAGCOUNT': '37.000'} [2023-02-25 13:11:48,505][36141] DAMAGECOUNT value on done: 4795.0 [2023-02-25 13:11:48,505][36141] Sum rewards: 50.298, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.650', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.018', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.262', 'weapon2': '0.568', 'WEAPON3': '1.600', 'weapon3': '3.008', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.385', 'FRAGCOUNT': '44.000'} [2023-02-25 13:11:48,509][36154] DAMAGECOUNT value on done: 3976.0 [2023-02-25 13:11:48,510][36154] Sum rewards: 47.800, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.070', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.152', 'AMMO3': '0.162', 'AMMO4': '0.167', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.572', 'weapon2': '0.640', 'WEAPON3': '1.000', 'weapon3': '2.314', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '11.928', 'FRAGCOUNT': '43.000'} [2023-02-25 13:11:48,522][36156] DAMAGECOUNT value on done: 4032.0 [2023-02-25 13:11:48,523][36156] Sum rewards: 45.160, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.652', 'AMMO2': '0.011', 'AMMO5': '0.016', 'AMMO4': '0.054', 'weapon4': '0.120', 'weapon5': '0.148', 'WEAPON4': '0.150', 'weapon2': '0.216', 'AMMO3': '0.283', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'HITCOUNT': '2.550', 'weapon3': '3.118', 'DAMAGECOUNT': '12.096', 'FRAGCOUNT': '42.000'} [2023-02-25 13:11:48,529][36140] DAMAGECOUNT value on done: 3974.0 [2023-02-25 13:11:48,529][36140] Sum rewards: 51.458, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.374', 'AMMO2': '0.009', 'AMMO5': '0.009', 'ARMOR': '0.040', 'AMMO4': '0.047', 'weapon5': '0.096', 'AMMO3': '0.158', 'WEAPON5': '0.200', 'weapon2': '0.790', 'WEAPON3': '1.000', 'HITCOUNT': '2.750', 'weapon3': '2.810', 'DAMAGECOUNT': '11.922', 'FRAGCOUNT': '42.000'} [2023-02-25 13:11:48,632][36142] DAMAGECOUNT value on done: 3536.0 [2023-02-25 13:11:48,633][36142] Sum rewards: 41.209, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.576', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.036', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'AMMO4': '0.182', 'weapon4': '0.324', 'WEAPON4': '0.350', 'weapon2': '0.492', 'WEAPON3': '0.900', 'HITCOUNT': '2.240', 'weapon3': '2.694', 'DAMAGECOUNT': '10.608', 'FRAGCOUNT': '34.000'} [2023-02-25 13:11:48,665][36155] DAMAGECOUNT value on done: 4218.0 [2023-02-25 13:11:48,665][36155] Sum rewards: 47.510, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.738', 'AMMO5': '0.018', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.147', 'weapon5': '0.280', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.596', 'weapon4': '0.706', 'WEAPON3': '1.000', 'weapon3': '2.054', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '12.654', 'FRAGCOUNT': '39.000'} [2023-02-25 13:11:48,687][36157] DAMAGECOUNT value on done: 4576.0 [2023-02-25 13:11:48,688][36157] Sum rewards: 46.707, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.178', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.164', 'AMMO3': '0.210', 'weapon2': '0.624', 'WEAPON3': '1.250', 'weapon3': '2.674', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '13.728', 'FRAGCOUNT': '41.000'} [2023-02-25 13:11:48,814][36154] DAMAGECOUNT value on done: 3317.0 [2023-02-25 13:11:48,814][36154] Sum rewards: 39.978, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.160', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO3': '0.105', 'AMMO4': '0.128', 'weapon5': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.404', 'weapon4': '0.406', 'WEAPON3': '0.700', 'weapon2': '0.910', 'HITCOUNT': '1.910', 'weapon3': '2.000', 'DAMAGECOUNT': '9.951', 'FRAGCOUNT': '32.000'} [2023-02-25 13:11:48,820][36141] DAMAGECOUNT value on done: 4185.0 [2023-02-25 13:11:48,821][36141] Sum rewards: 45.629, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.692', 'AMMO5': '0.016', 'ARMOR': '0.036', 'AMMO2': '0.038', 'weapon5': '0.180', 'AMMO4': '0.190', 'AMMO3': '0.244', 'weapon4': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.428', 'WEAPON3': '1.350', 'weapon3': '2.608', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.027', 'FRAGCOUNT': '43.000'} [2023-02-25 13:11:48,840][36139] DAMAGECOUNT value on done: 4010.0 [2023-02-25 13:11:48,841][36139] Sum rewards: 44.107, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.680', 'AMMO5': '0.012', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO4': '0.097', 'weapon5': '0.146', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.454', 'weapon4': '0.612', 'WEAPON3': '1.150', 'weapon3': '2.446', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '12.030', 'FRAGCOUNT': '39.000'} [2023-02-25 13:11:48,854][36140] DAMAGECOUNT value on done: 4174.0 [2023-02-25 13:11:48,854][36140] Sum rewards: 47.181, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.538', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'weapon5': '0.096', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'AMMO3': '0.247', 'WEAPON5': '0.250', 'weapon2': '0.284', 'weapon4': '0.432', 'WEAPON3': '1.400', 'HITCOUNT': '2.580', 'weapon3': '2.872', 'DAMAGECOUNT': '12.522', 'FRAGCOUNT': '45.000'} [2023-02-25 13:11:48,868][36156] DAMAGECOUNT value on done: 4077.0 [2023-02-25 13:11:48,868][36156] Sum rewards: 52.118, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.348', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.030', 'AMMO4': '0.080', 'weapon5': '0.086', 'AMMO3': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.296', 'WEAPON3': '0.950', 'HITCOUNT': '2.750', 'weapon3': '3.286', 'DAMAGECOUNT': '12.231', 'FRAGCOUNT': '43.000'} [2023-02-25 13:11:48,963][36142] DAMAGECOUNT value on done: 4857.0 [2023-02-25 13:11:48,963][36142] Sum rewards: 47.715, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.652', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.216', 'weapon5': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.358', 'weapon2': '0.654', 'WEAPON3': '1.200', 'weapon3': '2.308', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.568', 'FRAGCOUNT': '41.000'} [2023-02-25 13:11:48,975][36155] DAMAGECOUNT value on done: 3696.0 [2023-02-25 13:11:48,975][36155] Sum rewards: 44.245, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.024', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.171', 'weapon2': '0.732', 'WEAPON3': '1.050', 'HITCOUNT': '2.420', 'weapon3': '2.954', 'DAMAGECOUNT': '11.088', 'FRAGCOUNT': '38.000'} [2023-02-25 13:11:49,018][36157] DAMAGECOUNT value on done: 3276.0 [2023-02-25 13:11:49,019][36157] Sum rewards: 34.988, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.045', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.084', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.468', 'WEAPON3': '1.300', 'HITCOUNT': '2.240', 'weapon3': '3.150', 'DAMAGECOUNT': '9.828', 'FRAGCOUNT': '33.000'} [2023-02-25 13:11:49,140][36154] DAMAGECOUNT value on done: 4063.0 [2023-02-25 13:11:49,140][36154] Sum rewards: 49.110, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.605', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.189', 'AMMO3': '0.203', 'WEAPON4': '0.350', 'weapon4': '0.392', 'weapon2': '0.410', 'ARMOR': '0.451', 'WEAPON3': '1.250', 'HITCOUNT': '2.500', 'weapon3': '2.796', 'DAMAGECOUNT': '12.189', 'FRAGCOUNT': '44.000'} [2023-02-25 13:11:49,143][36141] DAMAGECOUNT value on done: 4186.0 [2023-02-25 13:11:49,143][36141] Sum rewards: 48.583, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.922', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon5': '0.162', 'weapon2': '0.192', 'AMMO3': '0.237', 'weapon4': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '2.630', 'weapon3': '3.114', 'DAMAGECOUNT': '12.537', 'FRAGCOUNT': '45.000'} [2023-02-25 13:11:49,168][36139] DAMAGECOUNT value on done: 5160.0 [2023-02-25 13:11:49,168][36139] Sum rewards: 61.612, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.102', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.157', 'WEAPON5': '0.250', 'weapon4': '0.374', 'weapon2': '0.602', 'WEAPON3': '1.050', 'weapon3': '2.492', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.480', 'FRAGCOUNT': '51.000'} [2023-02-25 13:11:49,182][36140] DAMAGECOUNT value on done: 3038.0 [2023-02-25 13:11:49,183][36140] Sum rewards: 33.429, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.824', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon5': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'weapon2': '0.712', 'WEAPON3': '1.050', 'HITCOUNT': '1.970', 'weapon3': '2.848', 'DAMAGECOUNT': '9.114', 'FRAGCOUNT': '29.000'} [2023-02-25 13:11:49,184][36156] DAMAGECOUNT value on done: 4320.0 [2023-02-25 13:11:49,185][36156] Sum rewards: 48.930, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.190', 'AMMO5': '0.006', 'AMMO2': '0.028', 'ARMOR': '0.040', 'weapon5': '0.136', 'AMMO4': '0.139', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.214', 'weapon2': '0.342', 'WEAPON3': '1.150', 'HITCOUNT': '2.500', 'weapon3': '3.014', 'DAMAGECOUNT': '12.960', 'FRAGCOUNT': '41.000'} [2023-02-25 13:11:49,283][36142] DAMAGECOUNT value on done: 5083.0 [2023-02-25 13:11:49,283][36142] Sum rewards: 57.447, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.500', 'AMMO5': '0.005', 'AMMO2': '0.016', 'ARMOR': '0.020', 'AMMO4': '0.077', 'weapon5': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.226', 'weapon2': '0.252', 'AMMO3': '0.264', 'WEAPON3': '1.500', 'weapon3': '3.204', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.249', 'FRAGCOUNT': '51.000'} [2023-02-25 13:11:49,290][36155] DAMAGECOUNT value on done: 4670.0 [2023-02-25 13:11:49,291][36155] Sum rewards: 56.744, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.908', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'AMMO3': '0.206', 'weapon5': '0.208', 'weapon4': '0.208', 'WEAPON5': '0.400', 'weapon2': '0.570', 'WEAPON3': '1.250', 'weapon3': '2.734', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '14.010', 'FRAGCOUNT': '48.000'} [2023-02-25 13:11:49,349][36157] DAMAGECOUNT value on done: 5422.0 [2023-02-25 13:11:49,349][36157] Sum rewards: 61.649, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.182', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.108', 'AMMO4': '0.153', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon5': '0.264', 'weapon2': '0.322', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '2.930', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '51.000'} [2023-02-25 13:11:49,439][36154] DAMAGECOUNT value on done: 4023.0 [2023-02-25 13:11:49,440][36154] Sum rewards: 41.401, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.442', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.028', 'weapon5': '0.130', 'AMMO4': '0.141', 'AMMO3': '0.206', 'weapon4': '0.324', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon2': '0.528', 'WEAPON3': '1.350', 'HITCOUNT': '2.710', 'weapon3': '2.732', 'DAMAGECOUNT': '12.069', 'FRAGCOUNT': '38.000'} [2023-02-25 13:11:49,461][36141] DAMAGECOUNT value on done: 3731.0 [2023-02-25 13:11:49,461][36141] Sum rewards: 38.438, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.784', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.092', 'AMMO4': '0.142', 'AMMO3': '0.166', 'weapon4': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '1.000', 'weapon2': '1.084', 'weapon3': '2.376', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '11.193', 'FRAGCOUNT': '35.000'} [2023-02-25 13:11:49,490][36139] DAMAGECOUNT value on done: 3838.0 [2023-02-25 13:11:49,491][36156] DAMAGECOUNT value on done: 4622.0 [2023-02-25 13:11:49,491][36139] Sum rewards: 44.645, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.006', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.192', 'weapon5': '0.208', 'WEAPON4': '0.350', 'weapon4': '0.358', 'WEAPON5': '0.400', 'weapon2': '0.622', 'WEAPON3': '1.200', 'weapon3': '2.534', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '11.514', 'FRAGCOUNT': '40.000'} [2023-02-25 13:11:49,491][36156] Sum rewards: 57.898, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.690', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.136', 'AMMO3': '0.200', 'weapon4': '0.234', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.072', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '13.866', 'FRAGCOUNT': '50.000'} [2023-02-25 13:11:49,507][36140] DAMAGECOUNT value on done: 4392.0 [2023-02-25 13:11:49,508][36140] Sum rewards: 44.445, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.108', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO3': '0.174', 'AMMO4': '0.192', 'weapon5': '0.234', 'weapon2': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.660', 'WEAPON3': '1.000', 'weapon3': '2.526', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.176', 'FRAGCOUNT': '37.000'} [2023-02-25 13:11:49,596][36142] DAMAGECOUNT value on done: 3458.0 [2023-02-25 13:11:49,596][36142] Sum rewards: 39.232, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.372', 'AMMO2': '0.010', 'AMMO5': '0.016', 'weapon4': '0.036', 'WEAPON4': '0.050', 'AMMO4': '0.050', 'weapon5': '0.162', 'AMMO3': '0.201', 'WEAPON5': '0.400', 'weapon2': '1.042', 'WEAPON3': '1.200', 'HITCOUNT': '2.290', 'weapon3': '2.522', 'DAMAGECOUNT': '10.374', 'FRAGCOUNT': '36.000'} [2023-02-25 13:11:49,667][36157] DAMAGECOUNT value on done: 3801.0 [2023-02-25 13:11:49,668][36157] Sum rewards: 41.805, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.553', 'AMMO5': '0.017', 'AMMO2': '0.041', 'AMMO3': '0.140', 'weapon4': '0.172', 'AMMO4': '0.203', 'weapon5': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.704', 'WEAPON3': '0.900', 'HITCOUNT': '2.270', 'weapon3': '2.674', 'DAMAGECOUNT': '11.403', 'FRAGCOUNT': '36.000'} [2023-02-25 13:11:49,729][36114] Fps is (10 sec: 12697.6, 60 sec: 10649.7, 300 sec: 10649.7). Total num frames: 150274048. Throughput: 0: 2667.1. Samples: 66676. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-02-25 13:11:49,730][36114] Avg episode reward: [(0, '46.734')] [2023-02-25 13:11:51,025][36138] Updated weights for policy 0, policy_version 36693 (0.0010) [2023-02-25 13:11:54,210][36138] Updated weights for policy 0, policy_version 36703 (0.0009) [2023-02-25 13:11:54,729][36114] Fps is (10 sec: 12697.6, 60 sec: 11059.2, 300 sec: 11059.2). Total num frames: 150339584. Throughput: 0: 2547.5. Samples: 76426. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:11:54,730][36114] Avg episode reward: [(0, '46.734')] [2023-02-25 13:11:57,459][36138] Updated weights for policy 0, policy_version 36713 (0.0009) [2023-02-25 13:11:59,729][36114] Fps is (10 sec: 13107.1, 60 sec: 11351.8, 300 sec: 11351.8). Total num frames: 150405120. Throughput: 0: 2737.4. Samples: 95808. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:11:59,730][36114] Avg episode reward: [(0, '46.734')] [2023-02-25 13:12:00,627][36138] Updated weights for policy 0, policy_version 36723 (0.0009) [2023-02-25 13:12:04,120][36138] Updated weights for policy 0, policy_version 36733 (0.0009) [2023-02-25 13:12:04,729][36114] Fps is (10 sec: 12287.8, 60 sec: 11366.4, 300 sec: 11366.4). Total num frames: 150462464. Throughput: 0: 2852.0. Samples: 114082. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:12:04,730][36114] Avg episode reward: [(0, '46.734')] [2023-02-25 13:12:07,385][36138] Updated weights for policy 0, policy_version 36743 (0.0010) [2023-02-25 13:12:09,189][36154] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:12:09,533][36139] DAMAGECOUNT value on done: 8618.0 [2023-02-25 13:12:09,534][36139] Sum rewards: 51.381, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.270', 'AMMO5': '0.005', 'ARMOR': '0.009', 'AMMO2': '0.025', 'weapon4': '0.086', 'weapon5': '0.108', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.328', 'WEAPON3': '1.200', 'HITCOUNT': '2.860', 'weapon3': '3.258', 'DAMAGECOUNT': '13.395', 'FRAGCOUNT': '45.000'} [2023-02-25 13:12:09,592][36155] DAMAGECOUNT value on done: 7910.0 [2023-02-25 13:12:09,592][36155] Sum rewards: 45.110, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.481', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.110', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.350', 'weapon2': '0.696', 'WEAPON3': '1.100', 'weapon3': '2.588', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.648', 'FRAGCOUNT': '39.000'} [2023-02-25 13:12:09,612][36156] DAMAGECOUNT value on done: 9237.0 [2023-02-25 13:12:09,612][36156] Sum rewards: 58.088, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.690', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'weapon2': '0.216', 'AMMO3': '0.222', 'WEAPON3': '1.300', 'HITCOUNT': '3.040', 'weapon3': '3.636', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '49.000'} [2023-02-25 13:12:09,642][36140] DAMAGECOUNT value on done: 8483.0 [2023-02-25 13:12:09,643][36140] Sum rewards: 55.501, reward structure: {'DEATHCOUNT': '-14.250', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.044', 'AMMO3': '0.137', 'WEAPON5': '0.150', 'weapon5': '0.166', 'AMMO4': '0.218', 'WEAPON4': '0.400', 'weapon2': '0.646', 'weapon4': '0.670', 'WEAPON3': '0.750', 'HEALTH': '0.818', 'weapon3': '2.204', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.527', 'FRAGCOUNT': '47.000'} [2023-02-25 13:12:09,648][36141] DAMAGECOUNT value on done: 8971.0 [2023-02-25 13:12:09,648][36141] Sum rewards: 47.136, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.779', 'AMMO5': '0.014', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'weapon4': '0.222', 'AMMO3': '0.223', 'weapon5': '0.234', 'weapon2': '0.298', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.800', 'weapon3': '2.942', 'DAMAGECOUNT': '12.528', 'FRAGCOUNT': '40.500'} [2023-02-25 13:12:09,681][36154] DAMAGECOUNT value on done: 7915.0 [2023-02-25 13:12:09,682][36154] Sum rewards: 44.376, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.726', 'ARMOR': '0.004', 'AMMO5': '0.026', 'AMMO2': '0.050', 'AMMO3': '0.160', 'AMMO4': '0.249', 'weapon2': '0.314', 'weapon4': '0.356', 'weapon5': '0.490', 'WEAPON4': '0.500', 'WEAPON5': '0.650', 'WEAPON3': '1.050', 'HITCOUNT': '2.450', 'weapon3': '2.486', 'DAMAGECOUNT': '11.817', 'FRAGCOUNT': '39.000'} [2023-02-25 13:12:09,729][36114] Fps is (10 sec: 12288.0, 60 sec: 11559.9, 300 sec: 11559.9). Total num frames: 150528000. Throughput: 0: 2744.3. Samples: 123494. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:12:09,730][36114] Avg episode reward: [(0, '47.291')] [2023-02-25 13:12:09,782][36157] DAMAGECOUNT value on done: 9159.0 [2023-02-25 13:12:09,783][36157] Sum rewards: 50.930, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.998', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.112', 'weapon5': '0.154', 'AMMO4': '0.165', 'weapon2': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'WEAPON3': '1.550', 'HITCOUNT': '2.790', 'weapon3': '3.154', 'DAMAGECOUNT': '13.749', 'FRAGCOUNT': '47.000'} [2023-02-25 13:12:09,791][36142] DAMAGECOUNT value on done: 8597.0 [2023-02-25 13:12:09,792][36142] Sum rewards: 53.922, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.718', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO3': '0.159', 'AMMO4': '0.212', 'weapon5': '0.252', 'weapon2': '0.312', 'weapon4': '0.418', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.754', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.183', 'FRAGCOUNT': '45.500'} [2023-02-25 13:12:09,830][36139] DAMAGECOUNT value on done: 8470.0 [2023-02-25 13:12:09,830][36139] Sum rewards: 50.588, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.138', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.043', 'AMMO3': '0.127', 'weapon5': '0.170', 'WEAPON5': '0.200', 'AMMO4': '0.216', 'weapon2': '0.368', 'WEAPON4': '0.400', 'WEAPON3': '0.750', 'weapon4': '0.964', 'weapon3': '2.216', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.380', 'FRAGCOUNT': '41.000'} [2023-02-25 13:12:09,905][36155] DAMAGECOUNT value on done: 9057.0 [2023-02-25 13:12:09,906][36155] Sum rewards: 53.947, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.580', 'AMMO5': '0.024', 'AMMO2': '0.034', 'AMMO3': '0.167', 'AMMO4': '0.167', 'weapon5': '0.226', 'weapon4': '0.260', 'WEAPON4': '0.400', 'weapon2': '0.468', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.722', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '14.499', 'FRAGCOUNT': '45.000'} [2023-02-25 13:12:09,930][36156] DAMAGECOUNT value on done: 7862.0 [2023-02-25 13:12:09,930][36156] Sum rewards: 44.978, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.248', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon5': '0.018', 'AMMO4': '0.056', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'weapon4': '0.410', 'weapon2': '0.592', 'WEAPON3': '1.150', 'HITCOUNT': '2.810', 'weapon3': '2.840', 'DAMAGECOUNT': '11.355', 'FRAGCOUNT': '38.000'} [2023-02-25 13:12:09,959][36140] DAMAGECOUNT value on done: 8149.0 [2023-02-25 13:12:09,959][36140] Sum rewards: 46.608, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.930', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.102', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'WEAPON4': '0.300', 'weapon2': '0.362', 'weapon4': '0.626', 'WEAPON3': '1.050', 'weapon3': '2.502', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '11.925', 'FRAGCOUNT': '38.000'} [2023-02-25 13:12:09,960][36141] DAMAGECOUNT value on done: 8550.0 [2023-02-25 13:12:09,960][36141] Sum rewards: 56.782, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.453', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon4': '0.140', 'AMMO3': '0.167', 'weapon5': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.832', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.095', 'FRAGCOUNT': '50.000'} [2023-02-25 13:12:09,991][36154] DAMAGECOUNT value on done: 8518.0 [2023-02-25 13:12:09,992][36154] Sum rewards: 55.659, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.640', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.055', 'AMMO3': '0.185', 'AMMO4': '0.273', 'weapon2': '0.292', 'weapon5': '0.364', 'weapon4': '0.498', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.426', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.603', 'FRAGCOUNT': '49.000'} [2023-02-25 13:12:10,097][36142] DAMAGECOUNT value on done: 8734.0 [2023-02-25 13:12:10,098][36142] Sum rewards: 38.203, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.028', 'AMMO5': '0.020', 'AMMO2': '0.034', 'AMMO4': '0.171', 'AMMO3': '0.194', 'weapon2': '0.242', 'weapon5': '0.316', 'WEAPON4': '0.350', 'weapon4': '0.414', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'HITCOUNT': '2.490', 'weapon3': '2.618', 'DAMAGECOUNT': '11.631', 'FRAGCOUNT': '34.500'} [2023-02-25 13:12:10,101][36157] DAMAGECOUNT value on done: 7934.0 [2023-02-25 13:12:10,102][36157] Sum rewards: 52.558, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.102', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.136', 'AMMO4': '0.164', 'AMMO3': '0.185', 'weapon2': '0.204', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.828', 'WEAPON3': '1.050', 'weapon3': '2.576', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.974', 'FRAGCOUNT': '45.000'} [2023-02-25 13:12:10,141][36139] DAMAGECOUNT value on done: 9380.0 [2023-02-25 13:12:10,141][36139] Sum rewards: 46.775, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.840', 'AMMO2': '0.012', 'ARMOR': '0.012', 'AMMO4': '0.059', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'weapon2': '0.302', 'weapon4': '0.344', 'WEAPON3': '1.250', 'HITCOUNT': '2.740', 'weapon3': '3.150', 'DAMAGECOUNT': '12.660', 'FRAGCOUNT': '40.000'} [2023-02-25 13:12:10,159][36155] DAMAGECOUNT value on done: 7603.0 [2023-02-25 13:12:10,159][36155] Sum rewards: 40.289, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.814', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'AMMO4': '0.171', 'weapon4': '0.196', 'WEAPON4': '0.200', 'weapon5': '0.230', 'AMMO3': '0.265', 'WEAPON5': '0.400', 'weapon2': '0.408', 'WEAPON3': '1.550', 'HITCOUNT': '2.560', 'weapon3': '2.828', 'DAMAGECOUNT': '11.721', 'FRAGCOUNT': '39.500'} [2023-02-25 13:12:10,231][36156] DAMAGECOUNT value on done: 9014.0 [2023-02-25 13:12:10,232][36156] Sum rewards: 50.574, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.530', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.102', 'AMMO4': '0.123', 'AMMO3': '0.141', 'WEAPON5': '0.200', 'WEAPON4': '0.500', 'weapon2': '0.538', 'weapon4': '0.712', 'WEAPON3': '0.850', 'weapon3': '2.446', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.082', 'FRAGCOUNT': '41.000'} [2023-02-25 13:12:10,273][36141] DAMAGECOUNT value on done: 8659.0 [2023-02-25 13:12:10,273][36141] Sum rewards: 57.771, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.034', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO3': '0.185', 'AMMO4': '0.194', 'WEAPON5': '0.200', 'weapon5': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.374', 'weapon4': '0.622', 'WEAPON3': '1.050', 'weapon3': '2.496', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.419', 'FRAGCOUNT': '49.000'} [2023-02-25 13:12:10,276][36140] DAMAGECOUNT value on done: 7695.0 [2023-02-25 13:12:10,277][36140] Sum rewards: 54.743, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.001', 'AMMO2': '0.010', 'AMMO5': '0.015', 'ARMOR': '0.016', 'AMMO4': '0.052', 'WEAPON4': '0.150', 'weapon5': '0.164', 'weapon4': '0.176', 'AMMO3': '0.214', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.400', 'HITCOUNT': '2.830', 'weapon3': '3.030', 'DAMAGECOUNT': '13.971', 'FRAGCOUNT': '47.000'} [2023-02-25 13:12:10,291][36154] DAMAGECOUNT value on done: 9228.0 [2023-02-25 13:12:10,292][36154] Sum rewards: 56.561, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.507', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.090', 'AMMO4': '0.149', 'weapon5': '0.166', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.470', 'WEAPON3': '1.150', 'weapon3': '3.102', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '46.500'} [2023-02-25 13:12:10,400][36157] DAMAGECOUNT value on done: 9490.0 [2023-02-25 13:12:10,400][36157] Sum rewards: 51.597, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.781', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO2': '0.054', 'AMMO3': '0.126', 'AMMO4': '0.269', 'weapon5': '0.344', 'weapon4': '0.402', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.628', 'WEAPON3': '0.750', 'weapon3': '2.344', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '12.204', 'FRAGCOUNT': '43.000'} [2023-02-25 13:12:10,402][36138] Updated weights for policy 0, policy_version 36753 (0.0009) [2023-02-25 13:12:10,416][36142] DAMAGECOUNT value on done: 9549.0 [2023-02-25 13:12:10,416][36142] Sum rewards: 52.416, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.474', 'ARMOR': '0.008', 'AMMO5': '0.023', 'AMMO2': '0.040', 'AMMO3': '0.136', 'AMMO4': '0.200', 'weapon2': '0.232', 'weapon5': '0.418', 'WEAPON4': '0.450', 'weapon4': '0.486', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'HITCOUNT': '2.580', 'weapon3': '2.628', 'DAMAGECOUNT': '13.389', 'FRAGCOUNT': '44.000'} [2023-02-25 13:12:10,446][36139] DAMAGECOUNT value on done: 8577.0 [2023-02-25 13:12:10,447][36139] Sum rewards: 56.039, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.056', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.040', 'AMMO3': '0.167', 'AMMO4': '0.200', 'weapon5': '0.204', 'weapon2': '0.346', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.658', 'WEAPON3': '1.000', 'weapon3': '2.508', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.217', 'FRAGCOUNT': '48.000'} [2023-02-25 13:12:10,476][36155] DAMAGECOUNT value on done: 9377.0 [2023-02-25 13:12:10,476][36155] Sum rewards: 49.689, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.840', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.204', 'AMMO3': '0.261', 'weapon2': '0.488', 'WEAPON3': '1.650', 'HITCOUNT': '2.970', 'weapon3': '3.044', 'DAMAGECOUNT': '13.806', 'FRAGCOUNT': '45.000'} [2023-02-25 13:12:10,548][36156] DAMAGECOUNT value on done: 8176.0 [2023-02-25 13:12:10,548][36156] Sum rewards: 39.594, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.990', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.015', 'AMMO4': '0.056', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'weapon5': '0.284', 'weapon4': '0.292', 'WEAPON5': '0.350', 'weapon2': '0.502', 'WEAPON3': '1.250', 'HITCOUNT': '2.370', 'weapon3': '2.686', 'DAMAGECOUNT': '10.662', 'FRAGCOUNT': '35.000'} [2023-02-25 13:12:10,576][36141] DAMAGECOUNT value on done: 7944.0 [2023-02-25 13:12:10,577][36141] Sum rewards: 40.579, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.994', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.048', 'AMMO3': '0.205', 'AMMO4': '0.239', 'weapon5': '0.240', 'weapon2': '0.340', 'weapon4': '0.408', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.732', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.639', 'FRAGCOUNT': '38.000'} [2023-02-25 13:12:10,590][36140] DAMAGECOUNT value on done: 8888.0 [2023-02-25 13:12:10,591][36140] Sum rewards: 52.273, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.310', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.009', 'weapon5': '0.058', 'WEAPON5': '0.200', 'weapon2': '0.214', 'AMMO3': '0.238', 'WEAPON3': '1.500', 'HITCOUNT': '2.870', 'weapon3': '3.506', 'DAMAGECOUNT': '13.488', 'FRAGCOUNT': '46.000'} [2023-02-25 13:12:10,629][36154] DAMAGECOUNT value on done: 8108.0 [2023-02-25 13:12:10,630][36154] Sum rewards: 40.659, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.045', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.090', 'weapon2': '0.230', 'AMMO3': '0.231', 'AMMO4': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.650', 'weapon4': '0.708', 'WEAPON3': '1.400', 'weapon3': '2.702', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.255', 'FRAGCOUNT': '41.000'} [2023-02-25 13:12:10,716][36157] DAMAGECOUNT value on done: 7835.0 [2023-02-25 13:12:10,717][36157] Sum rewards: 44.872, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.165', 'AMMO5': '0.004', 'AMMO2': '0.013', 'weapon5': '0.042', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'weapon4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.218', 'weapon2': '0.540', 'WEAPON3': '1.400', 'HITCOUNT': '2.680', 'weapon3': '3.122', 'DAMAGECOUNT': '12.102', 'FRAGCOUNT': '40.000'} [2023-02-25 13:12:10,734][36142] DAMAGECOUNT value on done: 8311.0 [2023-02-25 13:12:10,735][36142] Sum rewards: 62.143, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.709', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.117', 'weapon2': '0.158', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'weapon4': '0.510', 'WEAPON3': '1.300', 'weapon3': '3.016', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '14.559', 'FRAGCOUNT': '54.000'} [2023-02-25 13:12:13,614][36138] Updated weights for policy 0, policy_version 36763 (0.0010) [2023-02-25 13:12:14,729][36114] Fps is (10 sec: 13107.4, 60 sec: 11714.6, 300 sec: 11714.6). Total num frames: 150593536. Throughput: 0: 3131.0. Samples: 143114. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:12:14,730][36114] Avg episode reward: [(0, '48.403')] [2023-02-25 13:12:16,726][36138] Updated weights for policy 0, policy_version 36773 (0.0009) [2023-02-25 13:12:19,729][36114] Fps is (10 sec: 13107.2, 60 sec: 11841.2, 300 sec: 11841.2). Total num frames: 150659072. Throughput: 0: 3182.5. Samples: 162436. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:12:19,730][36114] Avg episode reward: [(0, '48.403')] [2023-02-25 13:12:19,996][36138] Updated weights for policy 0, policy_version 36783 (0.0010) [2023-02-25 13:12:23,287][36138] Updated weights for policy 0, policy_version 36793 (0.0010) [2023-02-25 13:12:24,729][36114] Fps is (10 sec: 12697.6, 60 sec: 11878.4, 300 sec: 11878.4). Total num frames: 150720512. Throughput: 0: 3185.1. Samples: 171834. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:12:24,730][36114] Avg episode reward: [(0, '48.403')] [2023-02-25 13:12:26,451][36138] Updated weights for policy 0, policy_version 36803 (0.0010) [2023-02-25 13:12:29,695][36138] Updated weights for policy 0, policy_version 36813 (0.0009) [2023-02-25 13:12:29,729][36114] Fps is (10 sec: 12697.6, 60 sec: 12697.6, 300 sec: 11973.0). Total num frames: 150786048. Throughput: 0: 3195.2. Samples: 191332. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:12:29,730][36114] Avg episode reward: [(0, '48.403')] [2023-02-25 13:12:30,327][36155] DAMAGECOUNT value on done: 11323.0 [2023-02-25 13:12:30,328][36155] Sum rewards: 36.822, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.121', 'ARMOR': '0.004', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.044', 'AMMO3': '0.138', 'weapon5': '0.214', 'AMMO4': '0.218', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.506', 'WEAPON3': '0.850', 'weapon2': '0.888', 'weapon3': '2.128', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '10.239', 'FRAGCOUNT': '33.000'} [2023-02-25 13:12:30,488][36141] DAMAGECOUNT value on done: 12461.0 [2023-02-25 13:12:30,489][36141] Sum rewards: 29.767, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.758', 'ARMOR': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.035', 'weapon5': '0.080', 'AMMO4': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'WEAPON4': '0.450', 'weapon2': '0.458', 'weapon4': '0.824', 'WEAPON3': '1.400', 'weapon3': '2.326', 'HITCOUNT': '2.340', 'DAMAGECOUNT': '10.470', 'FRAGCOUNT': '30.000'} [2023-02-25 13:12:30,517][36156] DAMAGECOUNT value on done: 13718.0 [2023-02-25 13:12:30,519][36156] Sum rewards: 50.703, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.810', 'AMMO5': '0.004', 'AMMO2': '0.027', 'weapon5': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.162', 'WEAPON4': '0.250', 'weapon4': '0.370', 'weapon2': '0.388', 'WEAPON3': '1.050', 'HITCOUNT': '2.980', 'weapon3': '3.066', 'DAMAGECOUNT': '13.443', 'FRAGCOUNT': '41.000'} [2023-02-25 13:12:30,569][36154] DAMAGECOUNT value on done: 12131.0 [2023-02-25 13:12:30,569][36154] Sum rewards: 40.766, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.862', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.023', 'AMMO2': '0.063', 'AMMO3': '0.119', 'weapon5': '0.240', 'AMMO4': '0.313', 'weapon2': '0.368', 'WEAPON5': '0.550', 'weapon4': '0.656', 'WEAPON4': '0.700', 'WEAPON3': '0.750', 'weapon3': '2.464', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '12.648', 'FRAGCOUNT': '34.500'} [2023-02-25 13:12:30,572][36139] DAMAGECOUNT value on done: 12801.0 [2023-02-25 13:12:30,573][36139] Sum rewards: 46.466, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.671', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'weapon5': '0.096', 'WEAPON5': '0.100', 'weapon4': '0.112', 'AMMO3': '0.220', 'weapon2': '0.220', 'WEAPON3': '1.350', 'HITCOUNT': '2.760', 'weapon3': '3.390', 'DAMAGECOUNT': '12.549', 'FRAGCOUNT': '40.000'} [2023-02-25 13:12:30,590][36140] DAMAGECOUNT value on done: 12627.0 [2023-02-25 13:12:30,591][36140] Sum rewards: 45.872, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.544', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.060', 'AMMO4': '0.138', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'weapon4': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.822', 'WEAPON3': '1.100', 'weapon3': '2.564', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.432', 'FRAGCOUNT': '40.000'} [2023-02-25 13:12:30,646][36155] DAMAGECOUNT value on done: 13212.0 [2023-02-25 13:12:30,646][36155] Sum rewards: 40.917, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.914', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.033', 'AMMO4': '0.167', 'AMMO3': '0.190', 'weapon2': '0.196', 'weapon5': '0.240', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.548', 'WEAPON3': '1.000', 'weapon3': '2.724', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.465', 'FRAGCOUNT': '37.000'} [2023-02-25 13:12:30,809][36141] DAMAGECOUNT value on done: 12905.0 [2023-02-25 13:12:30,810][36141] Sum rewards: 49.523, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.940', 'AMMO5': '0.025', 'AMMO2': '0.038', 'AMMO3': '0.182', 'AMMO4': '0.192', 'weapon2': '0.286', 'WEAPON4': '0.400', 'weapon5': '0.438', 'WEAPON5': '0.500', 'weapon4': '0.708', 'WEAPON3': '1.150', 'weapon3': '2.278', 'HITCOUNT': '2.450', 'DAMAGECOUNT': '13.065', 'FRAGCOUNT': '45.000'} [2023-02-25 13:12:30,839][36156] DAMAGECOUNT value on done: 12893.0 [2023-02-25 13:12:30,840][36156] Sum rewards: 60.852, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.637', 'ARMOR': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.150', 'AMMO3': '0.182', 'weapon2': '0.292', 'WEAPON4': '0.300', 'weapon4': '0.566', 'WEAPON3': '1.150', 'weapon3': '2.766', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.093', 'FRAGCOUNT': '52.000'} [2023-02-25 13:12:30,877][36154] DAMAGECOUNT value on done: 12965.0 [2023-02-25 13:12:30,878][36154] Sum rewards: 51.315, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.150', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.148', 'weapon4': '0.158', 'AMMO3': '0.162', 'WEAPON5': '0.200', 'weapon2': '0.252', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'HITCOUNT': '2.930', 'weapon3': '3.254', 'DAMAGECOUNT': '13.341', 'FRAGCOUNT': '44.000'} [2023-02-25 13:12:30,878][36139] DAMAGECOUNT value on done: 13002.0 [2023-02-25 13:12:30,879][36139] Sum rewards: 50.718, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.047', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.040', 'AMMO4': '0.199', 'AMMO3': '0.204', 'weapon2': '0.386', 'weapon5': '0.422', 'WEAPON5': '0.600', 'WEAPON4': '0.600', 'weapon4': '0.716', 'WEAPON3': '1.250', 'weapon3': '2.096', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '13.479', 'FRAGCOUNT': '47.000'} [2023-02-25 13:12:30,889][36155] DAMAGECOUNT value on done: 12571.0 [2023-02-25 13:12:30,890][36155] Sum rewards: 57.924, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.045', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON4': '0.100', 'weapon5': '0.132', 'WEAPON5': '0.200', 'weapon4': '0.258', 'AMMO3': '0.262', 'weapon2': '0.438', 'WEAPON3': '1.650', 'weapon3': '2.950', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.904', 'FRAGCOUNT': '51.000'} [2023-02-25 13:12:30,892][36142] DAMAGECOUNT value on done: 12966.0 [2023-02-25 13:12:30,893][36142] Sum rewards: 43.858, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.458', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.032', 'AMMO4': '0.160', 'AMMO3': '0.168', 'weapon2': '0.188', 'weapon5': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.586', 'WEAPON3': '1.050', 'HITCOUNT': '2.590', 'weapon3': '2.662', 'DAMAGECOUNT': '13.107', 'FRAGCOUNT': '38.000'} [2023-02-25 13:12:30,896][36157] DAMAGECOUNT value on done: 13885.0 [2023-02-25 13:12:30,896][36157] Sum rewards: 60.093, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.769', 'AMMO5': '0.007', 'AMMO2': '0.042', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'weapon2': '0.154', 'weapon5': '0.176', 'AMMO4': '0.211', 'WEAPON4': '0.250', 'weapon4': '0.704', 'WEAPON3': '0.950', 'weapon3': '2.706', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.178', 'FRAGCOUNT': '50.000'} [2023-02-25 13:12:30,912][36140] DAMAGECOUNT value on done: 12476.0 [2023-02-25 13:12:30,912][36140] Sum rewards: 45.329, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.880', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO3': '0.153', 'AMMO4': '0.157', 'weapon5': '0.248', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.490', 'weapon4': '0.546', 'WEAPON3': '1.050', 'weapon3': '2.472', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.981', 'FRAGCOUNT': '38.500'} [2023-02-25 13:12:31,120][36141] DAMAGECOUNT value on done: 13717.0 [2023-02-25 13:12:31,121][36141] Sum rewards: 55.876, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.495', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'weapon4': '0.466', 'weapon2': '0.478', 'WEAPON3': '1.300', 'weapon3': '2.684', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.174', 'FRAGCOUNT': '47.000'} [2023-02-25 13:12:31,139][36156] DAMAGECOUNT value on done: 13052.0 [2023-02-25 13:12:31,139][36156] Sum rewards: 39.357, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.890', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.036', 'AMMO3': '0.145', 'AMMO4': '0.179', 'weapon4': '0.218', 'weapon5': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'weapon2': '0.896', 'weapon3': '2.248', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '12.114', 'FRAGCOUNT': '32.000'} [2023-02-25 13:12:31,150][36139] DAMAGECOUNT value on done: 14351.0 [2023-02-25 13:12:31,151][36139] Sum rewards: 52.055, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.472', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.052', 'AMMO3': '0.194', 'AMMO4': '0.260', 'weapon5': '0.296', 'weapon2': '0.382', 'weapon4': '0.400', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.542', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.913', 'FRAGCOUNT': '46.000'} [2023-02-25 13:12:31,172][36142] DAMAGECOUNT value on done: 14259.0 [2023-02-25 13:12:31,172][36142] Sum rewards: 66.307, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.990', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.176', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon2': '0.308', 'WEAPON5': '0.350', 'weapon4': '0.422', 'WEAPON3': '1.200', 'weapon3': '2.864', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '54.000'} [2023-02-25 13:12:31,183][36154] DAMAGECOUNT value on done: 13250.0 [2023-02-25 13:12:31,183][36154] Sum rewards: 39.634, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.244', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.059', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.136', 'AMMO3': '0.201', 'weapon4': '0.346', 'weapon2': '0.362', 'WEAPON3': '1.300', 'HITCOUNT': '2.290', 'weapon3': '2.946', 'DAMAGECOUNT': '11.766', 'FRAGCOUNT': '35.000'} [2023-02-25 13:12:31,189][36155] DAMAGECOUNT value on done: 13863.0 [2023-02-25 13:12:31,189][36157] DAMAGECOUNT value on done: 12525.0 [2023-02-25 13:12:31,189][36155] Sum rewards: 49.103, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.135', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon5': '0.154', 'AMMO3': '0.173', 'AMMO4': '0.243', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.468', 'weapon2': '0.608', 'WEAPON3': '1.100', 'weapon3': '2.516', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.458', 'FRAGCOUNT': '43.000'} [2023-02-25 13:12:31,189][36157] Sum rewards: 50.298, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.463', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.106', 'weapon4': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon2': '0.418', 'WEAPON3': '1.550', 'HITCOUNT': '2.960', 'weapon3': '3.112', 'DAMAGECOUNT': '13.773', 'FRAGCOUNT': '46.000'} [2023-02-25 13:12:31,210][36140] DAMAGECOUNT value on done: 12502.0 [2023-02-25 13:12:31,210][36140] Sum rewards: 64.654, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.261', 'AMMO2': '0.008', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.038', 'weapon4': '0.076', 'WEAPON4': '0.100', 'weapon2': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'WEAPON3': '1.200', 'HITCOUNT': '3.130', 'weapon3': '3.614', 'DAMAGECOUNT': '14.421', 'FRAGCOUNT': '54.000'} [2023-02-25 13:12:31,426][36141] DAMAGECOUNT value on done: 11984.0 [2023-02-25 13:12:31,426][36141] Sum rewards: 45.010, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.901', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon5': '0.198', 'weapon2': '0.200', 'AMMO3': '0.227', 'AMMO4': '0.244', 'weapon4': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.580', 'weapon3': '2.818', 'DAMAGECOUNT': '12.120', 'FRAGCOUNT': '42.000'} [2023-02-25 13:12:31,457][36156] DAMAGECOUNT value on done: 11576.0 [2023-02-25 13:12:31,458][36156] Sum rewards: 37.512, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.784', 'AMMO5': '0.009', 'AMMO2': '0.023', 'WEAPON4': '0.100', 'AMMO4': '0.117', 'weapon5': '0.132', 'AMMO3': '0.145', 'WEAPON5': '0.200', 'weapon4': '0.446', 'weapon2': '0.674', 'WEAPON3': '0.900', 'weapon3': '2.370', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '10.200', 'FRAGCOUNT': '31.000'} [2023-02-25 13:12:31,461][36139] DAMAGECOUNT value on done: 13577.0 [2023-02-25 13:12:31,461][36139] Sum rewards: 58.794, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.974', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.060', 'AMMO4': '0.080', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'WEAPON4': '0.300', 'weapon2': '0.374', 'weapon4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.818', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '48.000'} [2023-02-25 13:12:31,465][36157] DAMAGECOUNT value on done: 14994.0 [2023-02-25 13:12:31,466][36157] Sum rewards: 60.457, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.734', 'AMMO2': '0.016', 'AMMO5': '0.018', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'weapon4': '0.202', 'AMMO3': '0.208', 'weapon5': '0.230', 'weapon2': '0.396', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.810', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '50.000'} [2023-02-25 13:12:31,476][36154] DAMAGECOUNT value on done: 12613.0 [2023-02-25 13:12:31,476][36154] Sum rewards: 50.804, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.550', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.166', 'AMMO3': '0.189', 'weapon5': '0.206', 'weapon2': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.556', 'WEAPON3': '1.050', 'weapon3': '2.748', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.515', 'FRAGCOUNT': '43.000'} [2023-02-25 13:12:31,513][36142] DAMAGECOUNT value on done: 13955.0 [2023-02-25 13:12:31,513][36142] Sum rewards: 49.231, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.990', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'weapon2': '0.470', 'weapon4': '0.472', 'WEAPON3': '1.500', 'weapon3': '2.652', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.218', 'FRAGCOUNT': '45.000'} [2023-02-25 13:12:31,517][36140] DAMAGECOUNT value on done: 13020.0 [2023-02-25 13:12:31,517][36140] Sum rewards: 48.775, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.084', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.034', 'AMMO4': '0.052', 'weapon4': '0.058', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'weapon2': '0.530', 'WEAPON3': '1.100', 'HITCOUNT': '2.580', 'weapon3': '3.188', 'DAMAGECOUNT': '12.375', 'FRAGCOUNT': '43.000'} [2023-02-25 13:12:31,798][36157] DAMAGECOUNT value on done: 12978.0 [2023-02-25 13:12:31,798][36157] Sum rewards: 59.173, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.276', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.104', 'AMMO4': '0.152', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.324', 'weapon4': '0.372', 'WEAPON3': '1.100', 'weapon3': '2.996', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.429', 'FRAGCOUNT': '51.000'} [2023-02-25 13:12:31,812][36142] DAMAGECOUNT value on done: 13130.0 [2023-02-25 13:12:31,812][36142] Sum rewards: 55.822, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.704', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.084', 'weapon4': '0.116', 'AMMO4': '0.132', 'WEAPON4': '0.200', 'weapon2': '0.206', 'WEAPON5': '0.250', 'AMMO3': '0.285', 'WEAPON3': '1.650', 'HITCOUNT': '3.080', 'weapon3': '3.276', 'DAMAGECOUNT': '14.457', 'FRAGCOUNT': '52.000'} [2023-02-25 13:12:32,776][36138] Updated weights for policy 0, policy_version 36823 (0.0009) [2023-02-25 13:12:34,729][36114] Fps is (10 sec: 13107.3, 60 sec: 12765.9, 300 sec: 12054.0). Total num frames: 150851584. Throughput: 0: 3207.2. Samples: 210998. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:12:34,729][36114] Avg episode reward: [(0, '48.871')] [2023-02-25 13:12:35,756][36138] Updated weights for policy 0, policy_version 36833 (0.0010) [2023-02-25 13:12:38,884][36138] Updated weights for policy 0, policy_version 36843 (0.0010) [2023-02-25 13:12:39,729][36114] Fps is (10 sec: 13107.3, 60 sec: 12834.2, 300 sec: 12124.2). Total num frames: 150917120. Throughput: 0: 3215.9. Samples: 221142. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:12:39,729][36114] Avg episode reward: [(0, '48.871')] [2023-02-25 13:12:41,899][36138] Updated weights for policy 0, policy_version 36853 (0.0010) [2023-02-25 13:12:44,729][36114] Fps is (10 sec: 13107.1, 60 sec: 12834.1, 300 sec: 12185.6). Total num frames: 150982656. Throughput: 0: 3220.9. Samples: 240748. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:12:44,730][36114] Avg episode reward: [(0, '48.871')] [2023-02-25 13:12:45,309][36138] Updated weights for policy 0, policy_version 36863 (0.0009) [2023-02-25 13:12:48,454][36138] Updated weights for policy 0, policy_version 36873 (0.0010) [2023-02-25 13:12:49,729][36114] Fps is (10 sec: 13107.1, 60 sec: 12902.4, 300 sec: 12239.8). Total num frames: 151048192. Throughput: 0: 3237.3. Samples: 259760. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:12:49,730][36114] Avg episode reward: [(0, '48.871')] [2023-02-25 13:12:50,805][36155] DAMAGECOUNT value on done: 15263.0 [2023-02-25 13:12:50,805][36155] Sum rewards: 41.925, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.690', 'AMMO2': '0.004', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.018', 'WEAPON4': '0.100', 'weapon4': '0.112', 'weapon5': '0.158', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon2': '0.294', 'WEAPON3': '1.300', 'HITCOUNT': '2.440', 'weapon3': '3.216', 'DAMAGECOUNT': '11.820', 'FRAGCOUNT': '36.000'} [2023-02-25 13:12:51,061][36154] DAMAGECOUNT value on done: 16050.0 [2023-02-25 13:12:51,062][36154] Sum rewards: 40.151, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.637', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.178', 'AMMO3': '0.198', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON4': '0.350', 'weapon4': '0.622', 'WEAPON3': '1.250', 'HITCOUNT': '2.500', 'weapon3': '2.618', 'DAMAGECOUNT': '11.757', 'FRAGCOUNT': '36.000'} [2023-02-25 13:12:51,065][36156] DAMAGECOUNT value on done: 17760.0 [2023-02-25 13:12:51,065][36156] Sum rewards: 35.316, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.362', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon2': '0.200', 'AMMO3': '0.263', 'weapon4': '0.384', 'WEAPON3': '1.500', 'HITCOUNT': '2.410', 'weapon3': '3.098', 'DAMAGECOUNT': '12.126', 'FRAGCOUNT': '33.500'} [2023-02-25 13:12:51,102][36139] DAMAGECOUNT value on done: 16890.0 [2023-02-25 13:12:51,102][36139] Sum rewards: 47.238, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.078', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.156', 'AMMO4': '0.162', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.730', 'WEAPON3': '0.900', 'weapon2': '1.004', 'weapon3': '1.900', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.267', 'FRAGCOUNT': '41.000'} [2023-02-25 13:12:51,133][36155] DAMAGECOUNT value on done: 17886.0 [2023-02-25 13:12:51,134][36155] Sum rewards: 52.557, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.194', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.150', 'WEAPON5': '0.200', 'AMMO4': '0.214', 'AMMO3': '0.219', 'weapon2': '0.242', 'ARMOR': '0.404', 'WEAPON4': '0.450', 'weapon4': '0.908', 'WEAPON3': '1.200', 'weapon3': '2.392', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.022', 'FRAGCOUNT': '46.000'} [2023-02-25 13:12:51,169][36140] DAMAGECOUNT value on done: 17153.0 [2023-02-25 13:12:51,170][36140] Sum rewards: 53.501, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.980', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO3': '0.128', 'AMMO4': '0.162', 'weapon5': '0.224', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.588', 'weapon4': '0.642', 'WEAPON3': '0.800', 'weapon3': '2.254', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.578', 'FRAGCOUNT': '43.000'} [2023-02-25 13:12:51,270][36141] DAMAGECOUNT value on done: 16755.0 [2023-02-25 13:12:51,271][36141] Sum rewards: 46.103, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.510', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO3': '0.173', 'AMMO4': '0.207', 'WEAPON5': '0.350', 'weapon5': '0.402', 'WEAPON4': '0.500', 'weapon4': '0.526', 'weapon2': '0.638', 'WEAPON3': '1.050', 'weapon3': '2.134', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.882', 'FRAGCOUNT': '42.000'} [2023-02-25 13:12:51,379][36154] DAMAGECOUNT value on done: 17745.0 [2023-02-25 13:12:51,380][36154] Sum rewards: 54.102, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.883', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.138', 'weapon5': '0.140', 'WEAPON5': '0.200', 'weapon2': '0.306', 'WEAPON4': '0.350', 'weapon4': '0.448', 'WEAPON3': '0.850', 'weapon3': '2.870', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.340', 'FRAGCOUNT': '45.000'} [2023-02-25 13:12:51,383][36155] DAMAGECOUNT value on done: 16516.0 [2023-02-25 13:12:51,384][36155] Sum rewards: 46.533, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.768', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.022', 'AMMO4': '0.061', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'weapon4': '0.338', 'weapon2': '0.510', 'WEAPON3': '1.050', 'HITCOUNT': '2.730', 'weapon3': '2.836', 'DAMAGECOUNT': '11.835', 'FRAGCOUNT': '39.000'} [2023-02-25 13:12:51,393][36156] DAMAGECOUNT value on done: 17403.0 [2023-02-25 13:12:51,393][36156] Sum rewards: 52.771, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.608', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.043', 'AMMO3': '0.140', 'weapon5': '0.202', 'AMMO4': '0.215', 'WEAPON5': '0.250', 'weapon2': '0.372', 'weapon4': '0.528', 'WEAPON4': '0.550', 'WEAPON3': '0.850', 'weapon3': '2.642', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.530', 'FRAGCOUNT': '46.000'} [2023-02-25 13:12:51,426][36139] DAMAGECOUNT value on done: 16910.0 [2023-02-25 13:12:51,426][36139] Sum rewards: 41.906, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.750', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.142', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon4': '0.382', 'weapon2': '0.598', 'WEAPON3': '1.250', 'HITCOUNT': '2.440', 'weapon3': '2.552', 'DAMAGECOUNT': '11.724', 'FRAGCOUNT': '38.000'} [2023-02-25 13:12:51,472][36157] DAMAGECOUNT value on done: 18219.0 [2023-02-25 13:12:51,472][36157] Sum rewards: 45.890, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.780', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'AMMO3': '0.274', 'weapon2': '0.282', 'weapon4': '0.282', 'WEAPON3': '1.650', 'HITCOUNT': '2.950', 'weapon3': '3.186', 'DAMAGECOUNT': '13.002', 'FRAGCOUNT': '44.000'} [2023-02-25 13:12:51,497][36140] DAMAGECOUNT value on done: 17233.0 [2023-02-25 13:12:51,498][36140] Sum rewards: 54.465, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.562', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.060', 'AMMO4': '0.069', 'weapon4': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon2': '0.346', 'WEAPON3': '1.100', 'HITCOUNT': '3.010', 'weapon3': '3.260', 'DAMAGECOUNT': '14.271', 'FRAGCOUNT': '45.000'} [2023-02-25 13:12:51,513][36142] DAMAGECOUNT value on done: 17048.0 [2023-02-25 13:12:51,514][36142] Sum rewards: 51.302, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.935', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.004', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.116', 'weapon5': '0.136', 'AMMO3': '0.217', 'weapon2': '0.662', 'WEAPON3': '1.400', 'weapon3': '2.872', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '12.246', 'FRAGCOUNT': '46.000'} [2023-02-25 13:12:51,582][36138] Updated weights for policy 0, policy_version 36883 (0.0010) [2023-02-25 13:12:51,594][36141] DAMAGECOUNT value on done: 17590.0 [2023-02-25 13:12:51,595][36141] Sum rewards: 56.478, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.992', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.100', 'AMMO4': '0.153', 'AMMO3': '0.175', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON4': '0.400', 'weapon4': '0.508', 'WEAPON3': '1.200', 'weapon3': '2.882', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.055', 'FRAGCOUNT': '50.000'} [2023-02-25 13:12:51,659][36156] DAMAGECOUNT value on done: 17762.0 [2023-02-25 13:12:51,660][36156] Sum rewards: 53.041, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.914', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.052', 'AMMO3': '0.182', 'weapon2': '0.192', 'AMMO4': '0.258', 'weapon5': '0.306', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.778', 'WEAPON3': '1.150', 'weapon3': '2.440', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.121', 'FRAGCOUNT': '45.000'} [2023-02-25 13:12:51,678][36154] DAMAGECOUNT value on done: 18315.0 [2023-02-25 13:12:51,679][36154] Sum rewards: 50.273, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.544', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.057', 'AMMO3': '0.189', 'AMMO4': '0.285', 'weapon5': '0.288', 'weapon2': '0.296', 'WEAPON5': '0.500', 'WEAPON4': '0.800', 'weapon4': '0.802', 'WEAPON3': '1.200', 'weapon3': '2.278', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.835', 'FRAGCOUNT': '46.000'} [2023-02-25 13:12:51,706][36155] DAMAGECOUNT value on done: 18706.0 [2023-02-25 13:12:51,707][36155] Sum rewards: 55.176, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.502', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon5': '0.146', 'AMMO4': '0.221', 'AMMO3': '0.228', 'weapon4': '0.230', 'weapon2': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.028', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.529', 'FRAGCOUNT': '49.500'} [2023-02-25 13:12:51,758][36139] DAMAGECOUNT value on done: 19449.0 [2023-02-25 13:12:51,758][36139] Sum rewards: 58.472, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.530', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon5': '0.062', 'weapon4': '0.156', 'AMMO4': '0.171', 'AMMO3': '0.187', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.170', 'weapon3': '3.340', 'DAMAGECOUNT': '15.294', 'FRAGCOUNT': '50.000'} [2023-02-25 13:12:51,830][36157] DAMAGECOUNT value on done: 16420.0 [2023-02-25 13:12:51,830][36157] Sum rewards: 44.751, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.089', 'AMMO5': '0.020', 'AMMO2': '0.061', 'AMMO3': '0.164', 'weapon5': '0.250', 'AMMO4': '0.307', 'weapon2': '0.412', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.862', 'WEAPON3': '0.950', 'weapon3': '2.058', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '11.685', 'FRAGCOUNT': '40.000'} [2023-02-25 13:12:51,840][36140] DAMAGECOUNT value on done: 17712.0 [2023-02-25 13:12:51,840][36140] Sum rewards: 57.478, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.220', 'AMMO5': '0.009', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.142', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.344', 'weapon2': '0.426', 'WEAPON3': '1.100', 'weapon3': '2.898', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.630', 'FRAGCOUNT': '48.000'} [2023-02-25 13:12:51,864][36142] DAMAGECOUNT value on done: 18961.0 [2023-02-25 13:12:51,864][36142] Sum rewards: 52.277, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.430', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.126', 'weapon2': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.296', 'WEAPON3': '1.450', 'HITCOUNT': '2.800', 'weapon3': '3.260', 'DAMAGECOUNT': '14.106', 'FRAGCOUNT': '46.000'} [2023-02-25 13:12:51,936][36141] DAMAGECOUNT value on done: 18854.0 [2023-02-25 13:12:51,937][36141] Sum rewards: 52.108, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.997', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.086', 'weapon5': '0.110', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon2': '0.448', 'WEAPON3': '1.300', 'HITCOUNT': '3.120', 'weapon3': '3.178', 'DAMAGECOUNT': '15.393', 'FRAGCOUNT': '44.000'} [2023-02-25 13:12:51,999][36156] DAMAGECOUNT value on done: 15890.0 [2023-02-25 13:12:52,000][36156] Sum rewards: 45.562, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.580', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO4': '0.122', 'AMMO3': '0.210', 'weapon5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.360', 'WEAPON5': '0.400', 'weapon4': '0.476', 'WEAPON3': '1.250', 'weapon3': '2.552', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.942', 'FRAGCOUNT': '40.000'} [2023-02-25 13:12:52,001][36154] DAMAGECOUNT value on done: 17353.0 [2023-02-25 13:12:52,002][36154] Sum rewards: 51.212, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.062', 'AMMO5': '0.019', 'AMMO2': '0.052', 'AMMO3': '0.183', 'weapon2': '0.238', 'AMMO4': '0.262', 'weapon5': '0.344', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'weapon4': '0.900', 'WEAPON3': '1.050', 'weapon3': '2.158', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '14.217', 'FRAGCOUNT': '45.000'} [2023-02-25 13:12:52,062][36139] DAMAGECOUNT value on done: 17913.0 [2023-02-25 13:12:52,062][36139] Sum rewards: 43.989, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.650', 'AMMO5': '0.006', 'AMMO2': '0.053', 'weapon5': '0.074', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'weapon2': '0.262', 'AMMO4': '0.263', 'weapon4': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'HITCOUNT': '2.860', 'weapon3': '2.882', 'DAMAGECOUNT': '13.008', 'FRAGCOUNT': '40.500'} [2023-02-25 13:12:52,140][36157] DAMAGECOUNT value on done: 19622.0 [2023-02-25 13:12:52,140][36157] Sum rewards: 54.687, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.980', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.070', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon2': '0.240', 'WEAPON4': '0.300', 'weapon4': '0.508', 'WEAPON3': '1.200', 'weapon3': '2.952', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.884', 'FRAGCOUNT': '47.000'} [2023-02-25 13:12:52,151][36140] DAMAGECOUNT value on done: 17223.0 [2023-02-25 13:12:52,152][36140] Sum rewards: 46.738, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.116', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon5': '0.116', 'AMMO4': '0.184', 'AMMO3': '0.186', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.530', 'weapon2': '0.902', 'WEAPON3': '1.100', 'weapon3': '2.262', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '12.609', 'FRAGCOUNT': '41.000'} [2023-02-25 13:12:52,208][36142] DAMAGECOUNT value on done: 17985.0 [2023-02-25 13:12:52,208][36142] Sum rewards: 44.187, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.828', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'weapon7': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.102', 'weapon2': '0.142', 'weapon4': '0.170', 'AMMO3': '0.295', 'WEAPON3': '1.700', 'HITCOUNT': '2.670', 'weapon3': '3.266', 'DAMAGECOUNT': '12.090', 'FRAGCOUNT': '41.000'} [2023-02-25 13:12:52,237][36141] DAMAGECOUNT value on done: 16241.0 [2023-02-25 13:12:52,238][36141] Sum rewards: 46.396, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.200', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.055', 'AMMO3': '0.172', 'AMMO4': '0.275', 'weapon5': '0.332', 'WEAPON5': '0.500', 'weapon4': '0.510', 'weapon2': '0.566', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.252', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.771', 'FRAGCOUNT': '44.000'} [2023-02-25 13:12:52,461][36157] DAMAGECOUNT value on done: 16992.0 [2023-02-25 13:12:52,461][36157] Sum rewards: 41.797, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.574', 'AMMO2': '0.007', 'AMMO5': '0.012', 'AMMO4': '0.034', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon5': '0.176', 'WEAPON4': '0.200', 'weapon4': '0.446', 'weapon2': '0.552', 'WEAPON3': '1.150', 'weapon3': '2.668', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.042', 'FRAGCOUNT': '36.000'} [2023-02-25 13:12:52,496][36142] DAMAGECOUNT value on done: 18186.0 [2023-02-25 13:12:52,496][36142] Sum rewards: 55.815, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.780', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon2': '0.190', 'AMMO3': '0.195', 'weapon5': '0.198', 'WEAPON4': '0.200', 'weapon4': '0.246', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.820', 'weapon3': '3.150', 'DAMAGECOUNT': '14.913', 'FRAGCOUNT': '47.000'} [2023-02-25 13:12:54,729][36138] Updated weights for policy 0, policy_version 36893 (0.0009) [2023-02-25 13:12:54,730][36114] Fps is (10 sec: 13106.8, 60 sec: 12902.3, 300 sec: 12288.0). Total num frames: 151113728. Throughput: 0: 3241.4. Samples: 269358. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:12:54,730][36114] Avg episode reward: [(0, '49.405')] [2023-02-25 13:12:55,316][36142] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:12:57,849][36138] Updated weights for policy 0, policy_version 36903 (0.0009) [2023-02-25 13:12:59,729][36114] Fps is (10 sec: 13107.2, 60 sec: 12902.4, 300 sec: 12331.1). Total num frames: 151179264. Throughput: 0: 3245.4. Samples: 289158. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:12:59,730][36114] Avg episode reward: [(0, '49.405')] [2023-02-25 13:13:00,894][36138] Updated weights for policy 0, policy_version 36913 (0.0010) [2023-02-25 13:13:03,984][36138] Updated weights for policy 0, policy_version 36923 (0.0009) [2023-02-25 13:13:04,729][36114] Fps is (10 sec: 13107.7, 60 sec: 13039.0, 300 sec: 12369.9). Total num frames: 151244800. Throughput: 0: 3256.8. Samples: 308992. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:13:04,730][36114] Avg episode reward: [(0, '49.405')] [2023-02-25 13:13:07,214][36138] Updated weights for policy 0, policy_version 36933 (0.0009) [2023-02-25 13:13:09,729][36114] Fps is (10 sec: 12697.6, 60 sec: 12970.7, 300 sec: 12366.0). Total num frames: 151306240. Throughput: 0: 3259.7. Samples: 318520. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:13:09,730][36114] Avg episode reward: [(0, '49.405')] [2023-02-25 13:13:10,641][36138] Updated weights for policy 0, policy_version 36943 (0.0010) [2023-02-25 13:13:11,565][36155] DAMAGECOUNT value on done: 19832.0 [2023-02-25 13:13:11,566][36155] Sum rewards: 47.665, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.724', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.032', 'weapon5': '0.056', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.214', 'weapon2': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.750', 'weapon3': '3.388', 'DAMAGECOUNT': '13.617', 'FRAGCOUNT': '40.000'} [2023-02-25 13:13:11,856][36139] DAMAGECOUNT value on done: 21418.0 [2023-02-25 13:13:11,857][36139] Sum rewards: 53.823, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.622', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.088', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.422', 'weapon2': '0.456', 'WEAPON3': '0.950', 'HITCOUNT': '2.670', 'weapon3': '2.872', 'DAMAGECOUNT': '13.584', 'FRAGCOUNT': '45.000'} [2023-02-25 13:13:11,894][36155] DAMAGECOUNT value on done: 22353.0 [2023-02-25 13:13:11,894][36155] Sum rewards: 56.183, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.592', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.013', 'AMMO4': '0.064', 'WEAPON4': '0.150', 'AMMO3': '0.158', 'weapon4': '0.248', 'WEAPON5': '0.250', 'weapon5': '0.272', 'weapon2': '0.512', 'WEAPON3': '0.900', 'weapon3': '2.662', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.401', 'FRAGCOUNT': '45.000'} [2023-02-25 13:13:12,011][36154] DAMAGECOUNT value on done: 20425.0 [2023-02-25 13:13:12,012][36154] Sum rewards: 53.549, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.430', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.156', 'weapon2': '0.188', 'AMMO3': '0.267', 'WEAPON3': '1.500', 'HITCOUNT': '2.760', 'weapon3': '3.444', 'DAMAGECOUNT': '13.125', 'FRAGCOUNT': '48.000'} [2023-02-25 13:13:12,073][36156] DAMAGECOUNT value on done: 22500.0 [2023-02-25 13:13:12,073][36156] Sum rewards: 51.938, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.315', 'AMMO5': '0.017', 'AMMO2': '0.041', 'AMMO3': '0.204', 'AMMO4': '0.205', 'weapon5': '0.242', 'WEAPON4': '0.350', 'weapon2': '0.380', 'WEAPON5': '0.400', 'weapon4': '0.798', 'WEAPON3': '1.200', 'weapon3': '2.266', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.220', 'FRAGCOUNT': '44.000'} [2023-02-25 13:13:12,103][36140] DAMAGECOUNT value on done: 21674.0 [2023-02-25 13:13:12,103][36140] Sum rewards: 49.658, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.590', 'AMMO5': '0.009', 'AMMO2': '0.013', 'weapon4': '0.014', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'weapon5': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.268', 'WEAPON3': '1.400', 'HITCOUNT': '2.840', 'weapon3': '3.396', 'DAMAGECOUNT': '13.563', 'FRAGCOUNT': '44.000'} [2023-02-25 13:13:12,186][36155] DAMAGECOUNT value on done: 20466.0 [2023-02-25 13:13:12,186][36155] Sum rewards: 43.213, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.722', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon5': '0.196', 'AMMO3': '0.210', 'AMMO4': '0.211', 'WEAPON5': '0.400', 'weapon2': '0.424', 'WEAPON4': '0.450', 'weapon4': '0.632', 'WEAPON3': '1.200', 'weapon3': '2.392', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '11.850', 'FRAGCOUNT': '40.000'} [2023-02-25 13:13:12,195][36139] DAMAGECOUNT value on done: 21814.0 [2023-02-25 13:13:12,195][36139] Sum rewards: 61.933, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.715', 'AMMO5': '0.009', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon4': '0.060', 'weapon5': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'weapon2': '0.428', 'WEAPON3': '1.000', 'HITCOUNT': '3.040', 'weapon3': '3.280', 'DAMAGECOUNT': '14.712', 'FRAGCOUNT': '50.000'} [2023-02-25 13:13:12,252][36141] DAMAGECOUNT value on done: 20859.0 [2023-02-25 13:13:12,252][36141] Sum rewards: 46.474, reward structure: {'DEATHCOUNT': '-11.250', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.098', 'AMMO4': '0.143', 'AMMO3': '0.146', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.302', 'HEALTH': '0.374', 'weapon2': '0.466', 'WEAPON3': '0.800', 'HITCOUNT': '2.550', 'weapon3': '2.940', 'DAMAGECOUNT': '12.312', 'FRAGCOUNT': '37.000'} [2023-02-25 13:13:12,322][36154] DAMAGECOUNT value on done: 22129.0 [2023-02-25 13:13:12,322][36154] Sum rewards: 49.884, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.250', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon2': '0.310', 'weapon4': '0.734', 'WEAPON3': '1.250', 'weapon3': '2.468', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.152', 'FRAGCOUNT': '43.000'} [2023-02-25 13:13:12,348][36142] DAMAGECOUNT value on done: 21807.0 [2023-02-25 13:13:12,348][36142] Sum rewards: 54.726, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.904', 'ARMOR': '0.008', 'AMMO5': '0.023', 'AMMO2': '0.061', 'AMMO3': '0.132', 'AMMO4': '0.304', 'weapon5': '0.306', 'weapon2': '0.360', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.648', 'WEAPON3': '0.800', 'weapon3': '2.384', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '14.223', 'FRAGCOUNT': '46.000'} [2023-02-25 13:13:12,408][36156] DAMAGECOUNT value on done: 21748.0 [2023-02-25 13:13:12,409][36156] Sum rewards: 55.989, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.315', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.012', 'WEAPON4': '0.100', 'weapon5': '0.108', 'weapon4': '0.148', 'AMMO3': '0.152', 'WEAPON5': '0.300', 'weapon2': '0.670', 'WEAPON3': '0.950', 'HITCOUNT': '2.710', 'weapon3': '2.870', 'DAMAGECOUNT': '13.035', 'FRAGCOUNT': '46.000'} [2023-02-25 13:13:12,442][36140] DAMAGECOUNT value on done: 21480.0 [2023-02-25 13:13:12,443][36140] Sum rewards: 47.225, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.910', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.246', 'weapon4': '0.280', 'WEAPON5': '0.300', 'weapon2': '0.494', 'WEAPON3': '1.450', 'HITCOUNT': '2.830', 'weapon3': '2.854', 'DAMAGECOUNT': '12.741', 'FRAGCOUNT': '42.000'} [2023-02-25 13:13:12,457][36157] DAMAGECOUNT value on done: 21926.0 [2023-02-25 13:13:12,458][36157] Sum rewards: 37.475, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.776', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'weapon5': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.245', 'weapon4': '0.388', 'weapon2': '0.402', 'WEAPON3': '1.350', 'HITCOUNT': '2.420', 'weapon3': '2.822', 'DAMAGECOUNT': '11.121', 'FRAGCOUNT': '35.000'} [2023-02-25 13:13:12,496][36155] DAMAGECOUNT value on done: 22353.0 [2023-02-25 13:13:12,496][36155] Sum rewards: 42.345, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.144', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.062', 'AMMO3': '0.149', 'AMMO4': '0.185', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.480', 'weapon4': '0.818', 'WEAPON3': '0.950', 'weapon3': '2.452', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '10.941', 'FRAGCOUNT': '37.000'} [2023-02-25 13:13:12,571][36141] DAMAGECOUNT value on done: 22010.0 [2023-02-25 13:13:12,571][36141] Sum rewards: 46.709, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.206', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'weapon2': '0.154', 'weapon4': '0.214', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '2.650', 'weapon3': '3.244', 'DAMAGECOUNT': '13.260', 'FRAGCOUNT': '42.000'} [2023-02-25 13:13:12,613][36154] DAMAGECOUNT value on done: 23618.0 [2023-02-25 13:13:12,613][36154] Sum rewards: 66.060, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.470', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.016', 'AMMO4': '0.021', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.241', 'weapon2': '0.248', 'WEAPON3': '1.550', 'HITCOUNT': '3.180', 'weapon3': '3.464', 'DAMAGECOUNT': '15.909', 'FRAGCOUNT': '58.000'} [2023-02-25 13:13:12,620][36139] DAMAGECOUNT value on done: 24383.0 [2023-02-25 13:13:12,620][36139] Sum rewards: 56.959, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.346', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.028', 'AMMO3': '0.114', 'AMMO4': '0.142', 'weapon5': '0.208', 'weapon2': '0.238', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '0.700', 'weapon4': '1.040', 'weapon3': '2.234', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.622', 'FRAGCOUNT': '47.000'} [2023-02-25 13:13:12,664][36156] DAMAGECOUNT value on done: 21405.0 [2023-02-25 13:13:12,664][36156] Sum rewards: 37.975, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.645', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.137', 'WEAPON4': '0.300', 'weapon4': '0.578', 'weapon2': '0.728', 'WEAPON3': '0.900', 'weapon3': '2.262', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '10.929', 'FRAGCOUNT': '32.000'} [2023-02-25 13:13:12,676][36142] DAMAGECOUNT value on done: 23561.0 [2023-02-25 13:13:12,677][36142] Sum rewards: 49.835, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.170', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon5': '0.208', 'weapon4': '0.238', 'weapon2': '0.306', 'WEAPON3': '1.150', 'weapon3': '3.028', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.800', 'FRAGCOUNT': '42.000'} [2023-02-25 13:13:12,780][36140] DAMAGECOUNT value on done: 22790.0 [2023-02-25 13:13:12,781][36140] Sum rewards: 55.454, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.328', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.144', 'weapon2': '0.164', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'weapon4': '0.462', 'WEAPON3': '1.300', 'weapon3': '2.946', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '48.000'} [2023-02-25 13:13:12,783][36157] DAMAGECOUNT value on done: 20709.0 [2023-02-25 13:13:12,783][36157] Sum rewards: 47.478, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.764', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'weapon2': '0.180', 'AMMO3': '0.222', 'weapon4': '0.268', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '2.670', 'weapon3': '3.376', 'DAMAGECOUNT': '12.867', 'FRAGCOUNT': '43.000'} [2023-02-25 13:13:12,884][36141] DAMAGECOUNT value on done: 22615.0 [2023-02-25 13:13:12,884][36141] Sum rewards: 34.429, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.820', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.038', 'AMMO4': '0.189', 'AMMO3': '0.195', 'weapon2': '0.242', 'weapon5': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.418', 'WEAPON3': '1.200', 'HITCOUNT': '2.490', 'weapon3': '2.606', 'DAMAGECOUNT': '11.283', 'FRAGCOUNT': '31.500'} [2023-02-25 13:13:12,944][36139] DAMAGECOUNT value on done: 22797.0 [2023-02-25 13:13:12,944][36139] Sum rewards: 51.732, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.584', 'AMMO5': '0.016', 'AMMO2': '0.027', 'weapon4': '0.132', 'AMMO4': '0.135', 'AMMO3': '0.175', 'weapon5': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.454', 'WEAPON3': '1.050', 'weapon3': '2.970', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.145', 'FRAGCOUNT': '43.000'} [2023-02-25 13:13:12,945][36154] DAMAGECOUNT value on done: 22029.0 [2023-02-25 13:13:12,945][36154] Sum rewards: 51.295, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.470', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.130', 'weapon4': '0.156', 'weapon2': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.277', 'WEAPON3': '1.650', 'HITCOUNT': '2.950', 'weapon3': '3.246', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '48.000'} [2023-02-25 13:13:12,979][36156] DAMAGECOUNT value on done: 20764.0 [2023-02-25 13:13:12,979][36156] Sum rewards: 52.515, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.875', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO3': '0.157', 'weapon5': '0.196', 'AMMO4': '0.223', 'WEAPON5': '0.400', 'weapon2': '0.408', 'weapon4': '0.490', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.666', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '14.622', 'FRAGCOUNT': '44.500'} [2023-02-25 13:13:13,013][36142] DAMAGECOUNT value on done: 22495.0 [2023-02-25 13:13:13,014][36142] Sum rewards: 52.264, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.648', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.111', 'weapon2': '0.202', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'weapon4': '0.376', 'WEAPON3': '1.200', 'HITCOUNT': '2.750', 'weapon3': '3.124', 'DAMAGECOUNT': '13.500', 'FRAGCOUNT': '47.000'} [2023-02-25 13:13:13,096][36157] DAMAGECOUNT value on done: 23331.0 [2023-02-25 13:13:13,096][36157] Sum rewards: 40.276, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.036', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.043', 'AMMO3': '0.174', 'AMMO4': '0.214', 'weapon5': '0.228', 'weapon4': '0.416', 'WEAPON5': '0.450', 'weapon2': '0.468', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'HITCOUNT': '2.560', 'weapon3': '2.608', 'DAMAGECOUNT': '11.127', 'FRAGCOUNT': '36.000'} [2023-02-25 13:13:13,108][36140] DAMAGECOUNT value on done: 21803.0 [2023-02-25 13:13:13,108][36140] Sum rewards: 50.070, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.942', 'ARMOR': '0.012', 'AMMO5': '0.014', 'AMMO2': '0.052', 'weapon5': '0.184', 'AMMO3': '0.229', 'weapon2': '0.240', 'AMMO4': '0.259', 'WEAPON5': '0.400', 'WEAPON4': '0.700', 'weapon4': '0.862', 'WEAPON3': '1.350', 'weapon3': '2.384', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.515', 'FRAGCOUNT': '47.000'} [2023-02-25 13:13:13,208][36141] DAMAGECOUNT value on done: 20266.0 [2023-02-25 13:13:13,209][36141] Sum rewards: 41.135, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.741', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.116', 'AMMO4': '0.134', 'AMMO3': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.328', 'weapon2': '0.528', 'WEAPON3': '1.400', 'HITCOUNT': '2.680', 'weapon3': '2.792', 'DAMAGECOUNT': '12.075', 'FRAGCOUNT': '38.000'} [2023-02-25 13:13:13,352][36142] DAMAGECOUNT value on done: 23131.0 [2023-02-25 13:13:13,353][36142] Sum rewards: 54.218, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.572', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.186', 'weapon5': '0.192', 'weapon4': '0.226', 'WEAPON4': '0.250', 'weapon2': '0.286', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '2.860', 'weapon3': '3.032', 'DAMAGECOUNT': '14.835', 'FRAGCOUNT': '45.000'} [2023-02-25 13:13:13,419][36157] DAMAGECOUNT value on done: 21279.0 [2023-02-25 13:13:13,419][36157] Sum rewards: 48.067, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.005', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'AMMO4': '0.165', 'AMMO3': '0.209', 'weapon2': '0.242', 'weapon4': '0.302', 'weapon5': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.770', 'weapon3': '2.838', 'DAMAGECOUNT': '12.861', 'FRAGCOUNT': '44.000'} [2023-02-25 13:13:13,843][36138] Updated weights for policy 0, policy_version 36953 (0.0009) [2023-02-25 13:13:14,729][36114] Fps is (10 sec: 12288.1, 60 sec: 12902.4, 300 sec: 12362.5). Total num frames: 151367680. Throughput: 0: 3233.6. Samples: 336844. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:13:14,730][36114] Avg episode reward: [(0, '49.565')] [2023-02-25 13:13:14,730][36125] Saving new best policy, reward=49.565! [2023-02-25 13:13:16,971][36138] Updated weights for policy 0, policy_version 36963 (0.0010) [2023-02-25 13:13:19,729][36114] Fps is (10 sec: 13107.1, 60 sec: 12970.7, 300 sec: 12430.5). Total num frames: 151437312. Throughput: 0: 3237.2. Samples: 356674. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:13:19,730][36114] Avg episode reward: [(0, '49.565')] [2023-02-25 13:13:19,733][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000036972_151437312.pth... [2023-02-25 13:13:19,791][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000036335_148828160.pth [2023-02-25 13:13:20,034][36138] Updated weights for policy 0, policy_version 36973 (0.0009) [2023-02-25 13:13:23,261][36138] Updated weights for policy 0, policy_version 36983 (0.0010) [2023-02-25 13:13:24,729][36114] Fps is (10 sec: 13107.2, 60 sec: 12970.7, 300 sec: 12424.6). Total num frames: 151498752. Throughput: 0: 3227.2. Samples: 366366. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:13:24,730][36114] Avg episode reward: [(0, '49.565')] [2023-02-25 13:13:26,514][36138] Updated weights for policy 0, policy_version 36993 (0.0010) [2023-02-25 13:13:29,729][36114] Fps is (10 sec: 12287.8, 60 sec: 12902.4, 300 sec: 12419.1). Total num frames: 151560192. Throughput: 0: 3216.9. Samples: 385510. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:13:29,730][36114] Avg episode reward: [(0, '49.565')] [2023-02-25 13:13:29,791][36138] Updated weights for policy 0, policy_version 37003 (0.0010) [2023-02-25 13:13:32,557][36139] DAMAGECOUNT value on done: 26162.0 [2023-02-25 13:13:32,558][36139] Sum rewards: 52.806, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.485', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.282', 'weapon2': '0.344', 'WEAPON3': '1.650', 'HITCOUNT': '3.050', 'weapon3': '3.318', 'DAMAGECOUNT': '14.232', 'FRAGCOUNT': '48.000'} [2023-02-25 13:13:32,659][36155] DAMAGECOUNT value on done: 24063.0 [2023-02-25 13:13:32,659][36155] Sum rewards: 48.376, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.858', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.058', 'AMMO4': '0.155', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon4': '0.292', 'weapon2': '0.294', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.710', 'weapon3': '3.194', 'DAMAGECOUNT': '12.693', 'FRAGCOUNT': '44.000'} [2023-02-25 13:13:32,878][36139] DAMAGECOUNT value on done: 24873.0 [2023-02-25 13:13:32,878][36139] Sum rewards: 36.215, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.817', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.016', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO3': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.135', 'weapon7': '0.144', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.516', 'WEAPON3': '0.700', 'weapon4': '0.892', 'weapon3': '1.958', 'HITCOUNT': '2.310', 'DAMAGECOUNT': '9.177', 'FRAGCOUNT': '30.000'} [2023-02-25 13:13:32,981][36155] DAMAGECOUNT value on done: 26692.0 [2023-02-25 13:13:32,981][36155] Sum rewards: 52.218, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.860', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon2': '0.198', 'AMMO3': '0.203', 'weapon5': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.738', 'WEAPON3': '1.200', 'weapon3': '2.280', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '13.017', 'FRAGCOUNT': '46.000'} [2023-02-25 13:13:33,017][36138] Updated weights for policy 0, policy_version 37013 (0.0010) [2023-02-25 13:13:33,118][36155] DAMAGECOUNT value on done: 24831.0 [2023-02-25 13:13:33,118][36140] DAMAGECOUNT value on done: 25512.0 [2023-02-25 13:13:33,118][36155] Sum rewards: 49.331, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.202', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.086', 'WEAPON4': '0.150', 'AMMO3': '0.185', 'weapon2': '0.196', 'WEAPON5': '0.300', 'weapon4': '0.396', 'WEAPON3': '1.200', 'HITCOUNT': '2.990', 'weapon3': '3.086', 'DAMAGECOUNT': '13.095', 'FRAGCOUNT': '41.000'} [2023-02-25 13:13:33,118][36140] Sum rewards: 36.778, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.396', 'AMMO5': '0.017', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.144', 'AMMO3': '0.232', 'weapon4': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.402', 'WEAPON3': '1.350', 'HITCOUNT': '2.460', 'weapon3': '2.900', 'DAMAGECOUNT': '11.514', 'FRAGCOUNT': '34.000'} [2023-02-25 13:13:33,128][36154] DAMAGECOUNT value on done: 24590.0 [2023-02-25 13:13:33,129][36154] Sum rewards: 46.190, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.839', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'weapon5': '0.134', 'AMMO3': '0.178', 'weapon2': '0.254', 'WEAPON4': '0.300', 'weapon4': '0.642', 'WEAPON3': '1.050', 'weapon3': '2.800', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.495', 'FRAGCOUNT': '38.000'} [2023-02-25 13:13:33,185][36156] DAMAGECOUNT value on done: 27224.0 [2023-02-25 13:13:33,185][36156] Sum rewards: 55.164, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.877', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.132', 'AMMO3': '0.178', 'weapon2': '0.184', 'weapon5': '0.282', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.672', 'WEAPON3': '1.050', 'weapon3': '2.604', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '14.172', 'FRAGCOUNT': '47.000'} [2023-02-25 13:13:33,202][36157] DAMAGECOUNT value on done: 25953.0 [2023-02-25 13:13:33,202][36157] Sum rewards: 46.282, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.010', 'AMMO2': '0.016', 'HEALTH': '0.064', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'weapon5': '0.102', 'AMMO3': '0.162', 'WEAPON5': '0.200', 'weapon2': '0.270', 'ARMOR': '0.400', 'weapon4': '0.500', 'WEAPON3': '0.950', 'HITCOUNT': '2.760', 'weapon3': '2.838', 'DAMAGECOUNT': '12.081', 'FRAGCOUNT': '37.000'} [2023-02-25 13:13:33,304][36141] DAMAGECOUNT value on done: 25562.0 [2023-02-25 13:13:33,305][36141] Sum rewards: 53.390, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.650', 'ARMOR': '0.004', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.054', 'AMMO3': '0.178', 'weapon5': '0.204', 'AMMO4': '0.268', 'weapon2': '0.308', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '1.044', 'WEAPON3': '1.100', 'weapon3': '2.002', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.109', 'FRAGCOUNT': '47.000'} [2023-02-25 13:13:33,345][36142] DAMAGECOUNT value on done: 24928.0 [2023-02-25 13:13:33,345][36142] Sum rewards: 33.703, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.290', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.048', 'weapon7': '0.066', 'AMMO4': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.124', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'weapon2': '0.728', 'WEAPON3': '0.800', 'weapon4': '1.128', 'weapon3': '1.686', 'HITCOUNT': '2.180', 'DAMAGECOUNT': '9.363', 'FRAGCOUNT': '26.000'} [2023-02-25 13:13:33,348][36139] DAMAGECOUNT value on done: 28599.0 [2023-02-25 13:13:33,349][36139] Sum rewards: 43.056, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.375', 'AMMO5': '0.014', 'AMMO2': '0.053', 'AMMO3': '0.144', 'weapon5': '0.216', 'weapon2': '0.240', 'AMMO4': '0.265', 'WEAPON5': '0.400', 'WEAPON4': '0.700', 'WEAPON3': '0.850', 'weapon4': '0.992', 'weapon3': '2.288', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.648', 'FRAGCOUNT': '38.000'} [2023-02-25 13:13:33,447][36155] DAMAGECOUNT value on done: 26761.0 [2023-02-25 13:13:33,447][36155] Sum rewards: 47.182, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.277', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.040', 'weapon5': '0.186', 'AMMO3': '0.195', 'AMMO4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.404', 'WEAPON4': '0.450', 'weapon4': '0.642', 'WEAPON3': '1.100', 'weapon3': '2.478', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.224', 'FRAGCOUNT': '42.000'} [2023-02-25 13:13:33,448][36140] DAMAGECOUNT value on done: 25518.0 [2023-02-25 13:13:33,448][36140] Sum rewards: 48.481, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.468', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.066', 'AMMO4': '0.116', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon2': '0.202', 'WEAPON4': '0.250', 'weapon4': '0.282', 'WEAPON3': '1.150', 'HITCOUNT': '2.840', 'weapon3': '3.256', 'DAMAGECOUNT': '12.114', 'FRAGCOUNT': '42.000'} [2023-02-25 13:13:33,455][36154] DAMAGECOUNT value on done: 26665.0 [2023-02-25 13:13:33,456][36154] Sum rewards: 44.956, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.250', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon4': '0.136', 'weapon2': '0.198', 'weapon5': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.307', 'WEAPON3': '1.800', 'HITCOUNT': '2.690', 'weapon3': '3.126', 'DAMAGECOUNT': '13.608', 'FRAGCOUNT': '45.000'} [2023-02-25 13:13:33,520][36156] DAMAGECOUNT value on done: 26510.0 [2023-02-25 13:13:33,521][36156] Sum rewards: 54.999, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.750', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon4': '0.072', 'WEAPON4': '0.100', 'weapon5': '0.130', 'AMMO3': '0.141', 'WEAPON5': '0.150', 'weapon2': '0.716', 'WEAPON3': '0.950', 'weapon3': '2.936', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.286', 'FRAGCOUNT': '46.000'} [2023-02-25 13:13:33,550][36157] DAMAGECOUNT value on done: 25057.0 [2023-02-25 13:13:33,551][36157] Sum rewards: 45.456, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.026', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.132', 'AMMO3': '0.172', 'weapon5': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.336', 'weapon2': '0.432', 'WEAPON3': '1.100', 'HITCOUNT': '2.490', 'weapon3': '2.790', 'DAMAGECOUNT': '13.044', 'FRAGCOUNT': '39.000'} [2023-02-25 13:13:33,637][36141] DAMAGECOUNT value on done: 27409.0 [2023-02-25 13:13:33,638][36141] Sum rewards: 63.888, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.010', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.048', 'weapon5': '0.116', 'weapon4': '0.158', 'AMMO3': '0.159', 'AMMO4': '0.242', 'WEAPON5': '0.300', 'weapon2': '0.410', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'weapon3': '3.104', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.197', 'FRAGCOUNT': '54.000'} [2023-02-25 13:13:33,672][36142] DAMAGECOUNT value on done: 28301.0 [2023-02-25 13:13:33,672][36142] Sum rewards: 51.497, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.023', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.115', 'WEAPON4': '0.200', 'AMMO3': '0.265', 'weapon2': '0.420', 'weapon4': '0.480', 'WEAPON3': '1.600', 'weapon3': '2.834', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.220', 'FRAGCOUNT': '46.000'} [2023-02-25 13:13:33,696][36139] DAMAGECOUNT value on done: 26574.0 [2023-02-25 13:13:33,697][36139] Sum rewards: 38.267, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.756', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.029', 'ARMOR': '0.032', 'weapon5': '0.112', 'AMMO4': '0.145', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.526', 'weapon2': '0.764', 'WEAPON3': '1.150', 'weapon3': '2.300', 'HITCOUNT': '2.320', 'DAMAGECOUNT': '11.331', 'FRAGCOUNT': '34.000'} [2023-02-25 13:13:33,740][36154] DAMAGECOUNT value on done: 28284.0 [2023-02-25 13:13:33,740][36154] Sum rewards: 48.130, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.662', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.046', 'AMMO3': '0.151', 'AMMO4': '0.232', 'weapon5': '0.248', 'WEAPON5': '0.300', 'WEAPON4': '0.550', 'weapon2': '0.566', 'weapon4': '0.886', 'WEAPON3': '0.900', 'weapon3': '2.048', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.998', 'FRAGCOUNT': '39.500'} [2023-02-25 13:13:33,758][36156] DAMAGECOUNT value on done: 24925.0 [2023-02-25 13:13:33,759][36156] Sum rewards: 35.460, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.314', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon5': '0.164', 'AMMO3': '0.202', 'AMMO4': '0.210', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON4': '0.400', 'weapon4': '0.698', 'WEAPON3': '1.100', 'HITCOUNT': '2.290', 'weapon3': '2.450', 'DAMAGECOUNT': '10.560', 'FRAGCOUNT': '33.000'} [2023-02-25 13:13:33,784][36140] DAMAGECOUNT value on done: 27081.0 [2023-02-25 13:13:33,784][36140] Sum rewards: 43.139, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.103', 'weapon7': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.060', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.199', 'weapon5': '0.218', 'WEAPON5': '0.250', 'weapon2': '0.260', 'AMMO4': '0.300', 'weapon4': '0.422', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'HITCOUNT': '2.570', 'weapon3': '2.780', 'DAMAGECOUNT': '12.873', 'FRAGCOUNT': '40.000'} [2023-02-25 13:13:33,867][36157] DAMAGECOUNT value on done: 28240.0 [2023-02-25 13:13:33,868][36157] Sum rewards: 59.924, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.592', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.027', 'weapon5': '0.088', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'weapon2': '0.368', 'WEAPON4': '0.400', 'weapon4': '0.466', 'WEAPON3': '1.000', 'weapon3': '2.886', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.727', 'FRAGCOUNT': '52.000'} [2023-02-25 13:13:33,917][36141] DAMAGECOUNT value on done: 27460.0 [2023-02-25 13:13:33,918][36141] Sum rewards: 60.571, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.140', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'weapon4': '0.138', 'AMMO3': '0.190', 'weapon2': '0.540', 'WEAPON3': '1.150', 'weapon3': '3.120', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.535', 'FRAGCOUNT': '50.000'} [2023-02-25 13:13:33,964][36142] DAMAGECOUNT value on done: 26673.0 [2023-02-25 13:13:33,964][36142] Sum rewards: 51.454, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.725', 'AMMO5': '0.009', 'AMMO2': '0.052', 'weapon5': '0.094', 'AMMO3': '0.181', 'WEAPON5': '0.250', 'AMMO4': '0.260', 'weapon4': '0.442', 'WEAPON4': '0.450', 'weapon2': '0.570', 'WEAPON3': '1.100', 'weapon3': '2.656', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '12.534', 'FRAGCOUNT': '46.000'} [2023-02-25 13:13:34,056][36154] DAMAGECOUNT value on done: 26711.0 [2023-02-25 13:13:34,057][36154] Sum rewards: 44.555, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.910', 'AMMO5': '0.011', 'AMMO2': '0.061', 'weapon5': '0.194', 'AMMO3': '0.249', 'AMMO4': '0.304', 'weapon2': '0.314', 'WEAPON5': '0.400', 'WEAPON4': '0.650', 'weapon4': '0.792', 'WEAPON3': '1.450', 'weapon3': '2.324', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.046', 'FRAGCOUNT': '42.000'} [2023-02-25 13:13:34,088][36156] DAMAGECOUNT value on done: 25443.0 [2023-02-25 13:13:34,088][36156] Sum rewards: 53.965, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.010', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.132', 'AMMO3': '0.145', 'weapon5': '0.190', 'WEAPON4': '0.300', 'weapon2': '0.302', 'WEAPON5': '0.350', 'weapon4': '0.538', 'WEAPON3': '0.950', 'weapon3': '2.712', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.037', 'FRAGCOUNT': '44.500'} [2023-02-25 13:13:34,095][36140] DAMAGECOUNT value on done: 26579.0 [2023-02-25 13:13:34,096][36140] Sum rewards: 48.698, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.922', 'ARMOR': '0.004', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.023', 'WEAPON4': '0.150', 'weapon5': '0.156', 'AMMO3': '0.184', 'WEAPON5': '0.250', 'weapon4': '0.306', 'weapon2': '0.436', 'WEAPON3': '1.150', 'weapon3': '2.870', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.328', 'FRAGCOUNT': '39.000'} [2023-02-25 13:13:34,173][36157] DAMAGECOUNT value on done: 23024.0 [2023-02-25 13:13:34,174][36157] Sum rewards: 19.037, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.835', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.066', 'AMMO3': '0.073', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon7': '0.220', 'WEAPON4': '0.350', 'weapon2': '0.456', 'WEAPON3': '0.500', 'weapon3': '1.154', 'weapon4': '1.214', 'HITCOUNT': '1.360', 'DAMAGECOUNT': '5.235', 'FRAGCOUNT': '14.500'} [2023-02-25 13:13:34,223][36141] DAMAGECOUNT value on done: 23956.0 [2023-02-25 13:13:34,224][36141] Sum rewards: 31.261, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.124', 'AMMO5': '0.014', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.128', 'weapon2': '0.150', 'weapon7': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'AMMO3': '0.216', 'WEAPON5': '0.300', 'weapon4': '0.352', 'WEAPON3': '1.250', 'HITCOUNT': '2.280', 'weapon3': '2.876', 'DAMAGECOUNT': '10.170', 'FRAGCOUNT': '28.000'} [2023-02-25 13:13:34,287][36142] DAMAGECOUNT value on done: 26514.0 [2023-02-25 13:13:34,288][36142] Sum rewards: 41.018, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.930', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon7': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.044', 'weapon5': '0.090', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.580', 'weapon4': '0.588', 'WEAPON3': '0.950', 'weapon3': '2.170', 'HITCOUNT': '2.320', 'DAMAGECOUNT': '10.149', 'FRAGCOUNT': '36.000'} [2023-02-25 13:13:34,729][36114] Fps is (10 sec: 12697.6, 60 sec: 12902.4, 300 sec: 12445.6). Total num frames: 151625728. Throughput: 0: 3208.8. Samples: 404158. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:13:34,730][36114] Avg episode reward: [(0, '48.612')] [2023-02-25 13:13:36,143][36138] Updated weights for policy 0, policy_version 37023 (0.0009) [2023-02-25 13:13:39,257][36138] Updated weights for policy 0, policy_version 37033 (0.0009) [2023-02-25 13:13:39,729][36114] Fps is (10 sec: 13107.5, 60 sec: 12902.4, 300 sec: 12470.1). Total num frames: 151691264. Throughput: 0: 3219.0. Samples: 414212. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:13:39,730][36114] Avg episode reward: [(0, '48.612')] [2023-02-25 13:13:42,423][36138] Updated weights for policy 0, policy_version 37043 (0.0009) [2023-02-25 13:13:44,729][36114] Fps is (10 sec: 13107.1, 60 sec: 12902.4, 300 sec: 12492.8). Total num frames: 151756800. Throughput: 0: 3216.8. Samples: 433912. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:13:44,730][36114] Avg episode reward: [(0, '48.612')] [2023-02-25 13:13:45,561][36138] Updated weights for policy 0, policy_version 37053 (0.0010) [2023-02-25 13:13:47,819][36155] Large shaping reward 3.411 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.36, 120.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:13:48,796][36138] Updated weights for policy 0, policy_version 37063 (0.0010) [2023-02-25 13:13:49,729][36114] Fps is (10 sec: 12697.6, 60 sec: 12834.1, 300 sec: 12485.8). Total num frames: 151818240. Throughput: 0: 3201.0. Samples: 453038. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:13:49,730][36114] Avg episode reward: [(0, '48.612')] [2023-02-25 13:13:52,021][36138] Updated weights for policy 0, policy_version 37073 (0.0009) [2023-02-25 13:13:53,225][36139] DAMAGECOUNT value on done: 29948.0 [2023-02-25 13:13:53,226][36139] Sum rewards: 42.452, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.296', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.042', 'AMMO3': '0.167', 'weapon5': '0.198', 'AMMO4': '0.208', 'weapon2': '0.308', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'weapon4': '1.176', 'weapon3': '1.972', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '11.358', 'FRAGCOUNT': '36.000'} [2023-02-25 13:13:53,527][36155] DAMAGECOUNT value on done: 29646.0 [2023-02-25 13:13:53,528][36155] Sum rewards: 57.226, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.645', 'AMMO5': '0.021', 'AMMO2': '0.044', 'AMMO4': '0.220', 'AMMO3': '0.232', 'weapon2': '0.248', 'weapon4': '0.256', 'weapon5': '0.266', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.904', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '51.000'} [2023-02-25 13:13:53,645][36139] DAMAGECOUNT value on done: 29512.0 [2023-02-25 13:13:53,646][36139] Sum rewards: 58.563, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.251', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.027', 'weapon5': '0.048', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon2': '0.196', 'weapon4': '0.444', 'WEAPON3': '0.950', 'HITCOUNT': '2.930', 'weapon3': '3.120', 'DAMAGECOUNT': '13.917', 'FRAGCOUNT': '48.000'} [2023-02-25 13:13:53,869][36155] DAMAGECOUNT value on done: 31503.0 [2023-02-25 13:13:53,869][36154] DAMAGECOUNT value on done: 29448.0 [2023-02-25 13:13:53,870][36154] Sum rewards: 50.643, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.775', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon4': '0.228', 'weapon5': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.285', 'weapon2': '0.360', 'WEAPON3': '1.650', 'HITCOUNT': '2.830', 'weapon3': '2.834', 'DAMAGECOUNT': '14.574', 'FRAGCOUNT': '47.000'} [2023-02-25 13:13:53,870][36155] Sum rewards: 54.773, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.855', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon2': '0.170', 'weapon5': '0.206', 'AMMO3': '0.222', 'weapon4': '0.398', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.900', 'weapon3': '2.926', 'DAMAGECOUNT': '14.433', 'FRAGCOUNT': '50.000'} [2023-02-25 13:13:53,971][36155] DAMAGECOUNT value on done: 28981.0 [2023-02-25 13:13:53,971][36155] Sum rewards: 43.132, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.338', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO5': '0.026', 'AMMO2': '0.052', 'weapon5': '0.190', 'AMMO3': '0.214', 'AMMO4': '0.258', 'weapon2': '0.364', 'weapon4': '0.510', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.602', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.450', 'FRAGCOUNT': '42.000'} [2023-02-25 13:13:54,109][36139] DAMAGECOUNT value on done: 33088.0 [2023-02-25 13:13:54,109][36139] Sum rewards: 52.837, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.297', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.070', 'AMMO4': '0.087', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'weapon5': '0.220', 'WEAPON5': '0.250', 'weapon2': '0.454', 'WEAPON3': '0.950', 'HITCOUNT': '2.730', 'weapon3': '3.080', 'DAMAGECOUNT': '13.467', 'FRAGCOUNT': '43.000'} [2023-02-25 13:13:54,159][36157] DAMAGECOUNT value on done: 30952.0 [2023-02-25 13:13:54,159][36157] Sum rewards: 58.347, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.372', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon2': '0.140', 'weapon5': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.216', 'AMMO3': '0.243', 'WEAPON3': '1.450', 'HITCOUNT': '3.010', 'weapon3': '3.264', 'DAMAGECOUNT': '14.997', 'FRAGCOUNT': '51.000'} [2023-02-25 13:13:54,187][36140] DAMAGECOUNT value on done: 30449.0 [2023-02-25 13:13:54,188][36140] Sum rewards: 55.894, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.997', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.046', 'AMMO3': '0.157', 'AMMO4': '0.230', 'weapon5': '0.320', 'weapon4': '0.396', 'WEAPON4': '0.450', 'weapon2': '0.482', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.482', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '14.811', 'FRAGCOUNT': '47.000'} [2023-02-25 13:13:54,200][36154] DAMAGECOUNT value on done: 30418.0 [2023-02-25 13:13:54,201][36154] Sum rewards: 38.641, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.259', 'AMMO5': '0.011', 'AMMO2': '0.039', 'AMMO3': '0.163', 'weapon5': '0.190', 'AMMO4': '0.197', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.484', 'weapon2': '0.628', 'WEAPON3': '1.050', 'HITCOUNT': '2.380', 'weapon3': '2.498', 'DAMAGECOUNT': '11.259', 'FRAGCOUNT': '34.000'} [2023-02-25 13:13:54,238][36156] DAMAGECOUNT value on done: 31754.0 [2023-02-25 13:13:54,239][36156] Sum rewards: 51.101, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.910', 'ARMOR': '0.004', 'AMMO2': '0.035', 'AMMO4': '0.174', 'AMMO3': '0.180', 'weapon2': '0.206', 'WEAPON4': '0.300', 'weapon4': '0.538', 'WEAPON3': '1.150', 'weapon3': '3.084', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '13.590', 'FRAGCOUNT': '44.000'} [2023-02-25 13:13:54,271][36141] DAMAGECOUNT value on done: 30219.0 [2023-02-25 13:13:54,272][36141] Sum rewards: 47.721, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.932', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon5': '0.126', 'weapon2': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.254', 'weapon4': '0.278', 'WEAPON3': '1.450', 'HITCOUNT': '2.770', 'weapon3': '3.226', 'DAMAGECOUNT': '13.971', 'FRAGCOUNT': '42.000'} [2023-02-25 13:13:54,280][36142] DAMAGECOUNT value on done: 29276.0 [2023-02-25 13:13:54,281][36142] Sum rewards: 51.958, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.230', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'weapon5': '0.172', 'WEAPON4': '0.250', 'weapon2': '0.498', 'weapon4': '0.518', 'WEAPON3': '0.950', 'weapon3': '2.638', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.014', 'FRAGCOUNT': '43.000'} [2023-02-25 13:13:54,306][36155] DAMAGECOUNT value on done: 31928.0 [2023-02-25 13:13:54,306][36155] Sum rewards: 59.306, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.780', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.046', 'AMMO3': '0.182', 'weapon5': '0.202', 'weapon2': '0.208', 'AMMO4': '0.231', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.752', 'WEAPON3': '1.150', 'weapon3': '2.560', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.501', 'FRAGCOUNT': '50.000'} [2023-02-25 13:13:54,439][36139] DAMAGECOUNT value on done: 30919.0 [2023-02-25 13:13:54,439][36139] Sum rewards: 49.008, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.374', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.106', 'AMMO4': '0.131', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon4': '0.276', 'WEAPON4': '0.300', 'weapon2': '0.506', 'WEAPON3': '1.350', 'HITCOUNT': '2.630', 'weapon3': '2.822', 'DAMAGECOUNT': '13.035', 'FRAGCOUNT': '46.000'} [2023-02-25 13:13:54,491][36157] DAMAGECOUNT value on done: 29057.0 [2023-02-25 13:13:54,492][36157] Sum rewards: 43.585, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.113', 'ARMOR': '0.012', 'AMMO5': '0.018', 'AMMO2': '0.068', 'AMMO3': '0.176', 'weapon2': '0.216', 'weapon5': '0.326', 'AMMO4': '0.339', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'weapon4': '0.814', 'WEAPON3': '1.000', 'weapon3': '2.348', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '12.000', 'FRAGCOUNT': '39.000'} [2023-02-25 13:13:54,504][36154] DAMAGECOUNT value on done: 32590.0 [2023-02-25 13:13:54,505][36154] Sum rewards: 51.166, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.492', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon5': '0.172', 'weapon2': '0.180', 'AMMO3': '0.204', 'AMMO4': '0.238', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.702', 'WEAPON3': '1.200', 'weapon3': '2.556', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '12.918', 'FRAGCOUNT': '47.000'} [2023-02-25 13:13:54,512][36140] DAMAGECOUNT value on done: 29996.0 [2023-02-25 13:13:54,513][36140] Sum rewards: 49.914, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.385', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon5': '0.162', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.414', 'weapon2': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.638', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.434', 'FRAGCOUNT': '43.500'} [2023-02-25 13:13:54,574][36156] DAMAGECOUNT value on done: 31406.0 [2023-02-25 13:13:54,575][36156] Sum rewards: 59.676, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.474', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.036', 'AMMO3': '0.176', 'AMMO4': '0.181', 'weapon2': '0.190', 'weapon5': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.576', 'WEAPON3': '1.000', 'weapon3': '2.720', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.688', 'FRAGCOUNT': '51.000'} [2023-02-25 13:13:54,601][36142] DAMAGECOUNT value on done: 32568.0 [2023-02-25 13:13:54,602][36142] Sum rewards: 49.730, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.109', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.132', 'AMMO3': '0.150', 'AMMO4': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.406', 'weapon2': '0.554', 'WEAPON3': '0.850', 'HITCOUNT': '2.510', 'weapon3': '2.728', 'DAMAGECOUNT': '12.801', 'FRAGCOUNT': '41.000'} [2023-02-25 13:13:54,609][36141] DAMAGECOUNT value on done: 31739.0 [2023-02-25 13:13:54,610][36141] Sum rewards: 50.693, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.635', 'AMMO5': '0.007', 'AMMO2': '0.034', 'AMMO4': '0.172', 'weapon5': '0.180', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'weapon2': '0.238', 'WEAPON4': '0.350', 'weapon4': '0.588', 'WEAPON3': '1.050', 'HITCOUNT': '2.580', 'weapon3': '2.754', 'DAMAGECOUNT': '12.990', 'FRAGCOUNT': '45.000'} [2023-02-25 13:13:54,725][36156] DAMAGECOUNT value on done: 28448.0 [2023-02-25 13:13:54,725][36156] Sum rewards: 40.695, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.552', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon5': '0.054', 'AMMO4': '0.107', 'AMMO3': '0.139', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.449', 'weapon4': '0.598', 'weapon2': '0.900', 'WEAPON3': '0.950', 'weapon3': '2.212', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '10.569', 'FRAGCOUNT': '34.000'} [2023-02-25 13:13:54,729][36114] Fps is (10 sec: 12288.0, 60 sec: 12765.9, 300 sec: 12479.2). Total num frames: 151879680. Throughput: 0: 3200.4. Samples: 462538. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:13:54,730][36114] Avg episode reward: [(0, '49.010')] [2023-02-25 13:13:54,784][36157] DAMAGECOUNT value on done: 32842.0 [2023-02-25 13:13:54,784][36157] Sum rewards: 56.235, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.190', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.148', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'weapon4': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.000', 'weapon3': '2.988', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.806', 'FRAGCOUNT': '47.000'} [2023-02-25 13:13:54,825][36154] DAMAGECOUNT value on done: 30989.0 [2023-02-25 13:13:54,826][36154] Sum rewards: 42.643, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.318', 'ARMOR': '0.009', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon5': '0.146', 'AMMO3': '0.213', 'AMMO4': '0.242', 'weapon2': '0.358', 'weapon4': '0.378', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.570', 'weapon3': '2.878', 'DAMAGECOUNT': '12.654', 'FRAGCOUNT': '39.000'} [2023-02-25 13:13:54,830][36140] DAMAGECOUNT value on done: 31305.0 [2023-02-25 13:13:54,831][36140] Sum rewards: 45.714, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.190', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO4': '0.138', 'weapon4': '0.188', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.300', 'HITCOUNT': '2.710', 'weapon3': '3.048', 'DAMAGECOUNT': '12.672', 'FRAGCOUNT': '43.000'} [2023-02-25 13:13:54,898][36141] DAMAGECOUNT value on done: 32317.0 [2023-02-25 13:13:54,898][36141] Sum rewards: 58.161, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.238', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.058', 'weapon5': '0.114', 'weapon2': '0.198', 'AMMO3': '0.226', 'WEAPON3': '1.400', 'HITCOUNT': '3.070', 'weapon3': '3.384', 'DAMAGECOUNT': '14.571', 'FRAGCOUNT': '50.000'} [2023-02-25 13:13:54,912][36142] DAMAGECOUNT value on done: 30416.0 [2023-02-25 13:13:54,912][36142] Sum rewards: 41.201, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.594', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.036', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'weapon5': '0.156', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'weapon2': '0.722', 'WEAPON3': '1.100', 'HITCOUNT': '2.450', 'weapon3': '2.926', 'DAMAGECOUNT': '11.229', 'FRAGCOUNT': '35.500'} [2023-02-25 13:13:55,062][36156] DAMAGECOUNT value on done: 29324.0 [2023-02-25 13:13:55,062][36156] Sum rewards: 37.687, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.186', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.023', 'AMMO2': '0.052', 'AMMO3': '0.229', 'AMMO4': '0.261', 'weapon5': '0.408', 'weapon2': '0.478', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'weapon4': '0.682', 'WEAPON3': '1.250', 'weapon3': '2.042', 'HITCOUNT': '2.190', 'DAMAGECOUNT': '11.643', 'FRAGCOUNT': '35.500'} [2023-02-25 13:13:55,105][36157] DAMAGECOUNT value on done: 27537.0 [2023-02-25 13:13:55,105][36157] Sum rewards: 51.212, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.894', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.063', 'weapon5': '0.156', 'AMMO3': '0.161', 'WEAPON5': '0.300', 'AMMO4': '0.316', 'weapon4': '0.354', 'weapon2': '0.448', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.736', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '13.539', 'FRAGCOUNT': '45.000'} [2023-02-25 13:13:55,128][36140] DAMAGECOUNT value on done: 30480.0 [2023-02-25 13:13:55,129][36140] Sum rewards: 43.388, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.175', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.045', 'AMMO3': '0.104', 'AMMO4': '0.225', 'weapon5': '0.372', 'WEAPON5': '0.450', 'weapon2': '0.462', 'WEAPON4': '0.550', 'WEAPON3': '0.600', 'weapon4': '0.726', 'weapon3': '2.146', 'HITCOUNT': '2.400', 'DAMAGECOUNT': '11.703', 'FRAGCOUNT': '36.000'} [2023-02-25 13:13:55,220][36141] DAMAGECOUNT value on done: 28149.0 [2023-02-25 13:13:55,221][36141] Sum rewards: 51.832, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.297', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.171', 'weapon5': '0.214', 'weapon2': '0.350', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.474', 'WEAPON3': '1.000', 'HITCOUNT': '2.590', 'weapon3': '2.750', 'DAMAGECOUNT': '12.579', 'FRAGCOUNT': '44.000'} [2023-02-25 13:13:55,226][36142] DAMAGECOUNT value on done: 30552.0 [2023-02-25 13:13:55,227][36142] Sum rewards: 50.526, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.345', 'AMMO5': '0.011', 'AMMO2': '0.040', 'AMMO3': '0.149', 'weapon5': '0.196', 'AMMO4': '0.198', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.402', 'WEAPON3': '0.900', 'weapon4': '0.942', 'weapon3': '2.108', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.114', 'FRAGCOUNT': '44.000'} [2023-02-25 13:13:55,367][36138] Updated weights for policy 0, policy_version 37083 (0.0010) [2023-02-25 13:13:58,717][36138] Updated weights for policy 0, policy_version 37093 (0.0010) [2023-02-25 13:13:59,729][36114] Fps is (10 sec: 12697.6, 60 sec: 12765.9, 300 sec: 12499.4). Total num frames: 151945216. Throughput: 0: 3197.9. Samples: 480750. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:13:59,729][36114] Avg episode reward: [(0, '48.579')] [2023-02-25 13:14:01,894][36138] Updated weights for policy 0, policy_version 37103 (0.0011) [2023-02-25 13:14:04,729][36114] Fps is (10 sec: 12697.7, 60 sec: 12697.6, 300 sec: 12492.8). Total num frames: 152006656. Throughput: 0: 3168.4. Samples: 499252. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:14:04,729][36114] Avg episode reward: [(0, '48.579')] [2023-02-25 13:14:05,336][36138] Updated weights for policy 0, policy_version 37113 (0.0010) [2023-02-25 13:14:08,505][36138] Updated weights for policy 0, policy_version 37123 (0.0010) [2023-02-25 13:14:09,729][36114] Fps is (10 sec: 12288.1, 60 sec: 12697.6, 300 sec: 12486.6). Total num frames: 152068096. Throughput: 0: 3163.6. Samples: 508728. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:14:09,729][36114] Avg episode reward: [(0, '48.579')] [2023-02-25 13:14:11,632][36138] Updated weights for policy 0, policy_version 37133 (0.0009) [2023-02-25 13:14:14,599][36139] DAMAGECOUNT value on done: 34185.0 [2023-02-25 13:14:14,599][36139] Sum rewards: 51.402, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.538', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.036', 'AMMO3': '0.153', 'AMMO4': '0.180', 'weapon4': '0.224', 'weapon2': '0.278', 'weapon5': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'HITCOUNT': '2.460', 'weapon3': '2.768', 'DAMAGECOUNT': '12.711', 'FRAGCOUNT': '44.000'} [2023-02-25 13:14:14,729][36114] Fps is (10 sec: 12697.5, 60 sec: 12765.9, 300 sec: 12504.9). Total num frames: 152133632. Throughput: 0: 3173.6. Samples: 528320. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:14:14,730][36114] Avg episode reward: [(0, '48.651')] [2023-02-25 13:14:14,730][36155] DAMAGECOUNT value on done: 33177.0 [2023-02-25 13:14:14,730][36155] Sum rewards: 42.540, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.499', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO3': '0.098', 'AMMO4': '0.155', 'weapon5': '0.298', 'WEAPON5': '0.400', 'weapon2': '0.422', 'WEAPON4': '0.450', 'WEAPON3': '0.550', 'weapon4': '1.192', 'weapon3': '1.800', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '10.593', 'FRAGCOUNT': '35.000'} [2023-02-25 13:14:14,800][36138] Updated weights for policy 0, policy_version 37143 (0.0009) [2023-02-25 13:14:14,944][36139] DAMAGECOUNT value on done: 33543.0 [2023-02-25 13:14:14,944][36139] Sum rewards: 45.645, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.170', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.043', 'weapon5': '0.156', 'AMMO3': '0.160', 'AMMO4': '0.213', 'weapon4': '0.360', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.402', 'WEAPON3': '0.950', 'HITCOUNT': '2.510', 'weapon3': '2.850', 'DAMAGECOUNT': '12.093', 'FRAGCOUNT': '39.000'} [2023-02-25 13:14:15,088][36155] DAMAGECOUNT value on done: 36494.0 [2023-02-25 13:14:15,089][36155] Sum rewards: 50.086, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.531', 'AMMO5': '0.020', 'AMMO2': '0.032', 'weapon5': '0.146', 'AMMO4': '0.160', 'weapon4': '0.174', 'weapon2': '0.180', 'AMMO3': '0.307', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'HITCOUNT': '2.860', 'weapon3': '3.176', 'DAMAGECOUNT': '14.613', 'FRAGCOUNT': '48.000'} [2023-02-25 13:14:15,205][36155] DAMAGECOUNT value on done: 33383.0 [2023-02-25 13:14:15,205][36155] Sum rewards: 47.325, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.720', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.150', 'weapon4': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.286', 'weapon2': '0.564', 'WEAPON3': '0.900', 'weapon3': '2.684', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '13.206', 'FRAGCOUNT': '40.500'} [2023-02-25 13:14:15,329][36154] DAMAGECOUNT value on done: 33727.0 [2023-02-25 13:14:15,330][36154] Sum rewards: 47.594, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.163', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.059', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'weapon5': '0.200', 'weapon2': '0.216', 'weapon4': '0.488', 'WEAPON3': '1.150', 'HITCOUNT': '2.690', 'weapon3': '2.852', 'DAMAGECOUNT': '12.837', 'FRAGCOUNT': '40.500'} [2023-02-25 13:14:15,362][36140] DAMAGECOUNT value on done: 34232.0 [2023-02-25 13:14:15,363][36140] Sum rewards: 45.355, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.113', 'HEALTH': '0.142', 'AMMO3': '0.149', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.274', 'weapon4': '0.344', 'weapon2': '0.432', 'WEAPON3': '0.850', 'HITCOUNT': '2.210', 'weapon3': '2.756', 'DAMAGECOUNT': '11.349', 'FRAGCOUNT': '36.000'} [2023-02-25 13:14:15,411][36139] DAMAGECOUNT value on done: 38317.0 [2023-02-25 13:14:15,411][36139] Sum rewards: 62.254, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.645', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.046', 'WEAPON5': '0.100', 'weapon2': '0.124', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'weapon4': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.778', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.687', 'FRAGCOUNT': '51.000'} [2023-02-25 13:14:15,553][36155] DAMAGECOUNT value on done: 36034.0 [2023-02-25 13:14:15,553][36155] Sum rewards: 42.424, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.920', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.120', 'weapon2': '0.150', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.434', 'WEAPON3': '1.450', 'HITCOUNT': '2.580', 'weapon3': '3.062', 'DAMAGECOUNT': '12.318', 'FRAGCOUNT': '40.000'} [2023-02-25 13:14:15,639][36156] DAMAGECOUNT value on done: 36710.0 [2023-02-25 13:14:15,640][36156] Sum rewards: 54.216, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.690', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.074', 'AMMO4': '0.089', 'weapon5': '0.130', 'weapon2': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'WEAPON3': '1.500', 'HITCOUNT': '2.750', 'weapon3': '3.408', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '49.000'} [2023-02-25 13:14:15,650][36154] DAMAGECOUNT value on done: 34319.0 [2023-02-25 13:14:15,651][36154] Sum rewards: 49.474, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.366', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'weapon5': '0.228', 'weapon2': '0.238', 'weapon4': '0.336', 'WEAPON3': '1.150', 'HITCOUNT': '2.630', 'weapon3': '3.038', 'DAMAGECOUNT': '11.703', 'FRAGCOUNT': '43.000'} [2023-02-25 13:14:15,678][36140] DAMAGECOUNT value on done: 34468.0 [2023-02-25 13:14:15,678][36140] Sum rewards: 46.694, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.728', 'ARMOR': '0.012', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon5': '0.194', 'AMMO4': '0.223', 'AMMO3': '0.245', 'weapon2': '0.270', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.626', 'WEAPON3': '1.400', 'weapon3': '2.586', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.416', 'FRAGCOUNT': '44.000'} [2023-02-25 13:14:15,687][36142] DAMAGECOUNT value on done: 33039.0 [2023-02-25 13:14:15,688][36142] Sum rewards: 36.438, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.600', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.047', 'weapon5': '0.098', 'WEAPON5': '0.200', 'AMMO4': '0.234', 'AMMO3': '0.259', 'weapon2': '0.368', 'weapon4': '0.528', 'WEAPON4': '0.600', 'WEAPON3': '1.500', 'HITCOUNT': '2.670', 'weapon3': '2.734', 'DAMAGECOUNT': '11.289', 'FRAGCOUNT': '37.500'} [2023-02-25 13:14:15,693][36141] DAMAGECOUNT value on done: 34708.0 [2023-02-25 13:14:15,694][36141] Sum rewards: 44.888, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.514', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.110', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'weapon2': '0.306', 'weapon4': '0.464', 'WEAPON3': '1.300', 'HITCOUNT': '2.770', 'weapon3': '2.892', 'DAMAGECOUNT': '13.467', 'FRAGCOUNT': '41.000'} [2023-02-25 13:14:15,739][36139] DAMAGECOUNT value on done: 35505.0 [2023-02-25 13:14:15,739][36139] Sum rewards: 51.049, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.800', 'weapon7': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon5': '0.262', 'weapon2': '0.332', 'weapon4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.652', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.758', 'FRAGCOUNT': '44.500'} [2023-02-25 13:14:15,747][36157] DAMAGECOUNT value on done: 34928.0 [2023-02-25 13:14:15,747][36157] Sum rewards: 47.445, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.050', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'weapon5': '0.050', 'weapon2': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'weapon4': '0.296', 'WEAPON3': '1.350', 'HITCOUNT': '2.680', 'weapon3': '3.336', 'DAMAGECOUNT': '11.928', 'FRAGCOUNT': '42.000'} [2023-02-25 13:14:15,969][36154] DAMAGECOUNT value on done: 36349.0 [2023-02-25 13:14:15,970][36154] Sum rewards: 43.144, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.368', 'AMMO5': '0.012', 'AMMO2': '0.040', 'AMMO3': '0.178', 'AMMO4': '0.202', 'weapon5': '0.250', 'weapon4': '0.344', 'weapon2': '0.378', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'HITCOUNT': '2.230', 'weapon3': '2.700', 'DAMAGECOUNT': '11.277', 'FRAGCOUNT': '40.000'} [2023-02-25 13:14:15,970][36156] DAMAGECOUNT value on done: 37247.0 [2023-02-25 13:14:15,971][36156] Sum rewards: 64.325, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.013', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.059', 'AMMO3': '0.171', 'weapon5': '0.212', 'AMMO4': '0.297', 'weapon2': '0.334', 'weapon4': '0.358', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.776', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '55.000'} [2023-02-25 13:14:16,001][36140] DAMAGECOUNT value on done: 36329.0 [2023-02-25 13:14:16,002][36140] Sum rewards: 59.107, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.015', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.050', 'weapon5': '0.116', 'AMMO4': '0.119', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON3': '1.250', 'HITCOUNT': '2.990', 'weapon3': '3.300', 'DAMAGECOUNT': '15.072', 'FRAGCOUNT': '51.000'} [2023-02-25 13:14:16,035][36142] DAMAGECOUNT value on done: 37397.0 [2023-02-25 13:14:16,035][36142] Sum rewards: 47.740, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.939', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon5': '0.072', 'WEAPON5': '0.200', 'AMMO4': '0.203', 'AMMO3': '0.235', 'weapon2': '0.332', 'WEAPON4': '0.500', 'weapon4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.820', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.487', 'FRAGCOUNT': '44.500'} [2023-02-25 13:14:16,035][36141] DAMAGECOUNT value on done: 36258.0 [2023-02-25 13:14:16,037][36141] Sum rewards: 48.003, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.826', 'AMMO5': '0.021', 'AMMO2': '0.069', 'AMMO3': '0.176', 'weapon5': '0.198', 'weapon2': '0.282', 'AMMO4': '0.346', 'weapon4': '0.478', 'WEAPON5': '0.500', 'WEAPON4': '0.800', 'WEAPON3': '1.100', 'weapon3': '2.762', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '13.557', 'FRAGCOUNT': '45.000'} [2023-02-25 13:14:16,098][36157] DAMAGECOUNT value on done: 34022.0 [2023-02-25 13:14:16,099][36157] Sum rewards: 58.839, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.102', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.080', 'AMMO4': '0.205', 'AMMO3': '0.211', 'weapon4': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.428', 'WEAPON3': '1.250', 'weapon3': '2.976', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '52.000'} [2023-02-25 13:14:16,150][36156] DAMAGECOUNT value on done: 32994.0 [2023-02-25 13:14:16,151][36156] Sum rewards: 54.877, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.490', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.063', 'weapon7': '0.076', 'AMMO3': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon5': '0.216', 'AMMO4': '0.314', 'weapon2': '0.352', 'WEAPON5': '0.400', 'WEAPON4': '0.650', 'WEAPON3': '0.650', 'weapon4': '1.044', 'weapon3': '2.058', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.638', 'FRAGCOUNT': '46.000'} [2023-02-25 13:14:16,319][36154] DAMAGECOUNT value on done: 36071.0 [2023-02-25 13:14:16,319][36154] Sum rewards: 55.309, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.821', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.082', 'AMMO4': '0.127', 'weapon5': '0.196', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.426', 'WEAPON3': '1.200', 'weapon3': '3.054', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.246', 'FRAGCOUNT': '47.000'} [2023-02-25 13:14:16,333][36140] DAMAGECOUNT value on done: 33341.0 [2023-02-25 13:14:16,334][36140] Sum rewards: 29.764, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.272', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.030', 'weapon5': '0.124', 'AMMO4': '0.152', 'AMMO3': '0.183', 'weapon2': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.890', 'WEAPON3': '1.050', 'HITCOUNT': '1.810', 'weapon3': '2.310', 'DAMAGECOUNT': '8.583', 'FRAGCOUNT': '28.500'} [2023-02-25 13:14:16,354][36141] DAMAGECOUNT value on done: 37480.0 [2023-02-25 13:14:16,354][36141] Sum rewards: 59.409, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.578', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.162', 'weapon5': '0.166', 'weapon2': '0.178', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.712', 'WEAPON3': '0.950', 'weapon3': '2.640', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.489', 'FRAGCOUNT': '50.000'} [2023-02-25 13:14:16,372][36142] DAMAGECOUNT value on done: 35801.0 [2023-02-25 13:14:16,373][36142] Sum rewards: 65.563, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.729', 'ARMOR': '0.012', 'AMMO5': '0.023', 'AMMO2': '0.032', 'weapon5': '0.140', 'AMMO4': '0.158', 'AMMO3': '0.176', 'weapon4': '0.246', 'WEAPON4': '0.300', 'weapon2': '0.380', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.920', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.155', 'FRAGCOUNT': '54.500'} [2023-02-25 13:14:16,387][36157] DAMAGECOUNT value on done: 37603.0 [2023-02-25 13:14:16,387][36157] Sum rewards: 50.546, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.028', 'AMMO5': '0.011', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon4': '0.096', 'weapon5': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.284', 'weapon2': '0.420', 'WEAPON3': '1.650', 'HITCOUNT': '2.820', 'weapon3': '3.024', 'DAMAGECOUNT': '14.283', 'FRAGCOUNT': '47.500'} [2023-02-25 13:14:16,488][36156] DAMAGECOUNT value on done: 33994.0 [2023-02-25 13:14:16,488][36156] Sum rewards: 54.007, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.410', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.082', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'weapon2': '0.196', 'AMMO3': '0.230', 'weapon4': '0.290', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '2.810', 'weapon3': '3.190', 'DAMAGECOUNT': '13.695', 'FRAGCOUNT': '50.000'} [2023-02-25 13:14:16,704][36141] DAMAGECOUNT value on done: 32307.0 [2023-02-25 13:14:16,705][36141] Sum rewards: 42.751, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.178', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon2': '0.266', 'weapon4': '0.406', 'WEAPON3': '1.150', 'HITCOUNT': '2.830', 'weapon3': '2.868', 'DAMAGECOUNT': '12.474', 'FRAGCOUNT': '36.000'} [2023-02-25 13:14:16,709][36142] DAMAGECOUNT value on done: 33744.0 [2023-02-25 13:14:16,709][36142] Sum rewards: 35.790, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.856', 'ARMOR': '0.004', 'AMMO5': '0.028', 'AMMO2': '0.056', 'AMMO3': '0.197', 'weapon2': '0.202', 'AMMO4': '0.279', 'weapon5': '0.386', 'WEAPON4': '0.800', 'WEAPON5': '0.900', 'WEAPON3': '1.100', 'weapon4': '1.200', 'weapon3': '1.808', 'HITCOUNT': '2.110', 'DAMAGECOUNT': '9.576', 'FRAGCOUNT': '35.000'} [2023-02-25 13:14:16,727][36157] DAMAGECOUNT value on done: 32069.0 [2023-02-25 13:14:16,727][36157] Sum rewards: 47.150, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.810', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.157', 'weapon5': '0.178', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.428', 'weapon2': '0.502', 'WEAPON3': '1.300', 'weapon3': '2.600', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '13.596', 'FRAGCOUNT': '42.000'} [2023-02-25 13:14:18,164][36138] Updated weights for policy 0, policy_version 37153 (0.0010) [2023-02-25 13:14:19,730][36114] Fps is (10 sec: 12697.0, 60 sec: 12629.3, 300 sec: 12498.6). Total num frames: 152195072. Throughput: 0: 3172.1. Samples: 546902. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:14:19,730][36114] Avg episode reward: [(0, '48.558')] [2023-02-25 13:14:20,773][36141] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:14:21,399][36138] Updated weights for policy 0, policy_version 37163 (0.0009) [2023-02-25 13:14:24,544][36138] Updated weights for policy 0, policy_version 37173 (0.0009) [2023-02-25 13:14:24,729][36114] Fps is (10 sec: 12697.7, 60 sec: 12697.6, 300 sec: 12515.6). Total num frames: 152260608. Throughput: 0: 3159.5. Samples: 556388. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:14:24,729][36114] Avg episode reward: [(0, '48.558')] [2023-02-25 13:14:25,459][36139] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:14:27,683][36138] Updated weights for policy 0, policy_version 37183 (0.0010) [2023-02-25 13:14:29,729][36114] Fps is (10 sec: 13107.6, 60 sec: 12765.9, 300 sec: 12531.6). Total num frames: 152326144. Throughput: 0: 3161.9. Samples: 576196. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:14:29,730][36114] Avg episode reward: [(0, '48.558')] [2023-02-25 13:14:30,792][36138] Updated weights for policy 0, policy_version 37193 (0.0009) [2023-02-25 13:14:32,585][36155] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:14:33,911][36138] Updated weights for policy 0, policy_version 37203 (0.0010) [2023-02-25 13:14:34,388][36154] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 13:14:34,729][36114] Fps is (10 sec: 13107.2, 60 sec: 12765.9, 300 sec: 12546.7). Total num frames: 152391680. Throughput: 0: 3178.8. Samples: 596082. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:14:34,729][36114] Avg episode reward: [(0, '48.558')] [2023-02-25 13:14:35,309][36139] DAMAGECOUNT value on done: 38791.0 [2023-02-25 13:14:35,309][36139] Sum rewards: 51.124, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.264', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON5': '0.050', 'weapon5': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.204', 'weapon4': '0.236', 'weapon2': '0.506', 'WEAPON3': '1.100', 'HITCOUNT': '2.740', 'weapon3': '3.034', 'DAMAGECOUNT': '13.818', 'FRAGCOUNT': '43.000'} [2023-02-25 13:14:35,501][36155] DAMAGECOUNT value on done: 37482.0 [2023-02-25 13:14:35,502][36155] Sum rewards: 46.831, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.590', 'AMMO5': '0.009', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.162', 'weapon4': '0.176', 'WEAPON5': '0.200', 'weapon2': '0.202', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'HITCOUNT': '2.800', 'weapon3': '3.158', 'DAMAGECOUNT': '12.915', 'FRAGCOUNT': '42.000'} [2023-02-25 13:14:35,618][36139] DAMAGECOUNT value on done: 38590.0 [2023-02-25 13:14:35,619][36139] Sum rewards: 59.201, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.321', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.120', 'AMMO4': '0.135', 'weapon5': '0.202', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.438', 'WEAPON3': '1.350', 'weapon3': '2.996', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.141', 'FRAGCOUNT': '50.000'} [2023-02-25 13:14:35,810][36155] DAMAGECOUNT value on done: 40514.0 [2023-02-25 13:14:35,810][36155] Sum rewards: 46.025, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.875', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.018', 'WEAPON4': '0.050', 'weapon4': '0.064', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.214', 'weapon2': '0.356', 'WEAPON3': '1.350', 'HITCOUNT': '2.540', 'weapon3': '3.324', 'DAMAGECOUNT': '12.060', 'FRAGCOUNT': '40.500'} [2023-02-25 13:14:35,952][36154] DAMAGECOUNT value on done: 38720.0 [2023-02-25 13:14:35,953][36154] Sum rewards: 54.168, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.668', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.046', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'weapon2': '0.176', 'AMMO3': '0.252', 'WEAPON4': '0.350', 'weapon4': '0.442', 'WEAPON3': '1.500', 'weapon3': '3.104', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.979', 'FRAGCOUNT': '49.000'} [2023-02-25 13:14:35,970][36155] DAMAGECOUNT value on done: 37943.0 [2023-02-25 13:14:35,971][36155] Sum rewards: 56.726, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.238', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.082', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.170', 'AMMO3': '0.216', 'weapon4': '0.538', 'WEAPON3': '1.250', 'HITCOUNT': '2.890', 'weapon3': '2.960', 'DAMAGECOUNT': '13.680', 'FRAGCOUNT': '50.000'} [2023-02-25 13:14:35,985][36140] DAMAGECOUNT value on done: 38383.0 [2023-02-25 13:14:35,985][36140] Sum rewards: 49.253, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.592', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.146', 'AMMO3': '0.155', 'AMMO4': '0.197', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.402', 'weapon2': '0.538', 'WEAPON3': '0.850', 'HITCOUNT': '2.490', 'weapon3': '2.708', 'DAMAGECOUNT': '12.453', 'FRAGCOUNT': '42.000'} [2023-02-25 13:14:36,034][36139] DAMAGECOUNT value on done: 43318.0 [2023-02-25 13:14:36,034][36139] Sum rewards: 58.412, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.979', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.078', 'weapon4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.114', 'AMMO4': '0.125', 'AMMO3': '0.181', 'WEAPON3': '1.100', 'HITCOUNT': '2.860', 'weapon3': '3.608', 'DAMAGECOUNT': '15.003', 'FRAGCOUNT': '48.000'} [2023-02-25 13:14:36,274][36140] DAMAGECOUNT value on done: 39224.0 [2023-02-25 13:14:36,275][36140] Sum rewards: 53.725, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.232', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.144', 'AMMO3': '0.188', 'weapon2': '0.208', 'weapon5': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.454', 'WEAPON3': '1.000', 'weapon3': '2.830', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.214', 'FRAGCOUNT': '46.000'} [2023-02-25 13:14:36,276][36156] DAMAGECOUNT value on done: 41124.0 [2023-02-25 13:14:36,276][36156] Sum rewards: 49.167, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.510', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.042', 'AMMO3': '0.188', 'AMMO4': '0.211', 'weapon5': '0.234', 'weapon4': '0.400', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.640', 'WEAPON3': '1.150', 'weapon3': '2.476', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '13.242', 'FRAGCOUNT': '44.000'} [2023-02-25 13:14:36,288][36154] DAMAGECOUNT value on done: 38038.0 [2023-02-25 13:14:36,289][36154] Sum rewards: 35.074, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.494', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.031', 'weapon4': '0.096', 'AMMO4': '0.156', 'AMMO3': '0.198', 'weapon5': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.750', 'WEAPON3': '1.150', 'HITCOUNT': '2.180', 'weapon3': '2.570', 'DAMAGECOUNT': '11.157', 'FRAGCOUNT': '36.000'} [2023-02-25 13:14:36,292][36155] DAMAGECOUNT value on done: 40873.0 [2023-02-25 13:14:36,293][36155] Sum rewards: 50.917, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.437', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.052', 'AMMO3': '0.223', 'weapon2': '0.232', 'weapon5': '0.256', 'AMMO4': '0.261', 'weapon4': '0.370', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '2.660', 'weapon3': '2.854', 'DAMAGECOUNT': '14.517', 'FRAGCOUNT': '47.000'} [2023-02-25 13:14:36,327][36139] DAMAGECOUNT value on done: 39226.0 [2023-02-25 13:14:36,328][36139] Sum rewards: 40.463, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.834', 'AMMO5': '0.018', 'AMMO2': '0.040', 'weapon4': '0.130', 'weapon2': '0.148', 'AMMO3': '0.191', 'AMMO4': '0.199', 'weapon5': '0.264', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.200', 'weapon3': '3.244', 'DAMAGECOUNT': '11.163', 'FRAGCOUNT': '37.000'} [2023-02-25 13:14:36,430][36157] DAMAGECOUNT value on done: 39807.0 [2023-02-25 13:14:36,430][36157] Sum rewards: 62.958, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.373', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.159', 'weapon5': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.286', 'weapon2': '0.312', 'WEAPON3': '1.050', 'HITCOUNT': '2.820', 'weapon3': '2.954', 'DAMAGECOUNT': '14.637', 'FRAGCOUNT': '52.000'} [2023-02-25 13:14:36,473][36141] DAMAGECOUNT value on done: 39623.0 [2023-02-25 13:14:36,474][36141] Sum rewards: 51.142, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.624', 'ARMOR': '0.004', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon2': '0.244', 'AMMO3': '0.263', 'weapon5': '0.282', 'WEAPON5': '0.350', 'weapon4': '0.408', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.750', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.385', 'FRAGCOUNT': '46.500'} [2023-02-25 13:14:36,584][36140] DAMAGECOUNT value on done: 40530.0 [2023-02-25 13:14:36,585][36140] Sum rewards: 48.116, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.242', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.122', 'AMMO3': '0.181', 'weapon2': '0.244', 'WEAPON4': '0.250', 'weapon5': '0.268', 'WEAPON5': '0.300', 'weapon4': '0.522', 'WEAPON3': '1.050', 'HITCOUNT': '2.560', 'weapon3': '2.720', 'DAMAGECOUNT': '12.603', 'FRAGCOUNT': '41.000'} [2023-02-25 13:14:36,604][36156] DAMAGECOUNT value on done: 42100.0 [2023-02-25 13:14:36,605][36156] Sum rewards: 56.209, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.127', 'AMMO5': '0.020', 'AMMO2': '0.033', 'AMMO4': '0.167', 'AMMO3': '0.201', 'weapon2': '0.244', 'weapon5': '0.260', 'WEAPON4': '0.400', 'ARMOR': '0.457', 'WEAPON5': '0.500', 'weapon4': '0.748', 'WEAPON3': '1.100', 'weapon3': '2.466', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '14.559', 'FRAGCOUNT': '47.000'} [2023-02-25 13:14:36,618][36154] DAMAGECOUNT value on done: 39865.0 [2023-02-25 13:14:36,619][36154] Sum rewards: 43.861, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.600', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.067', 'weapon5': '0.070', 'weapon4': '0.074', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.688', 'WEAPON3': '0.800', 'HITCOUNT': '2.250', 'weapon3': '2.990', 'DAMAGECOUNT': '10.548', 'FRAGCOUNT': '37.000'} [2023-02-25 13:14:36,627][36142] DAMAGECOUNT value on done: 37957.0 [2023-02-25 13:14:36,628][36142] Sum rewards: 57.934, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.220', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.020', 'AMMO4': '0.034', 'weapon4': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.223', 'weapon2': '0.480', 'WEAPON3': '1.350', 'HITCOUNT': '3.050', 'weapon3': '3.246', 'DAMAGECOUNT': '14.754', 'FRAGCOUNT': '51.000'} [2023-02-25 13:14:36,756][36157] DAMAGECOUNT value on done: 38533.0 [2023-02-25 13:14:36,757][36157] Sum rewards: 51.990, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.898', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'AMMO3': '0.140', 'AMMO4': '0.168', 'weapon5': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.316', 'weapon4': '0.806', 'WEAPON3': '0.950', 'weapon3': '2.352', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.533', 'FRAGCOUNT': '43.000'} [2023-02-25 13:14:36,775][36156] DAMAGECOUNT value on done: 36992.0 [2023-02-25 13:14:36,775][36156] Sum rewards: 40.525, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.398', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon2': '0.120', 'weapon4': '0.164', 'weapon5': '0.180', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'HITCOUNT': '2.290', 'weapon3': '3.374', 'DAMAGECOUNT': '11.814', 'FRAGCOUNT': '34.000'} [2023-02-25 13:14:36,795][36141] DAMAGECOUNT value on done: 39837.0 [2023-02-25 13:14:36,796][36141] Sum rewards: 47.554, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.554', 'AMMO5': '0.006', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'weapon4': '0.150', 'weapon2': '0.190', 'WEAPON3': '0.950', 'HITCOUNT': '2.370', 'weapon3': '3.422', 'DAMAGECOUNT': '10.737', 'FRAGCOUNT': '39.000'} [2023-02-25 13:14:36,902][36140] DAMAGECOUNT value on done: 37757.0 [2023-02-25 13:14:36,903][36140] Sum rewards: 50.983, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.983', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon4': '0.118', 'weapon5': '0.150', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.708', 'WEAPON3': '1.250', 'HITCOUNT': '2.590', 'weapon3': '2.816', 'DAMAGECOUNT': '13.248', 'FRAGCOUNT': '45.000'} [2023-02-25 13:14:36,929][36154] DAMAGECOUNT value on done: 40575.0 [2023-02-25 13:14:36,929][36154] Sum rewards: 52.137, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.135', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.097', 'AMMO3': '0.137', 'weapon5': '0.186', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.472', 'weapon4': '0.516', 'WEAPON3': '0.850', 'weapon3': '2.624', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.512', 'FRAGCOUNT': '42.500'} [2023-02-25 13:14:36,954][36142] DAMAGECOUNT value on done: 42362.0 [2023-02-25 13:14:36,955][36142] Sum rewards: 55.883, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.460', 'AMMO5': '0.020', 'AMMO2': '0.024', 'weapon4': '0.050', 'AMMO4': '0.118', 'weapon5': '0.136', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.318', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.850', 'weapon3': '3.226', 'DAMAGECOUNT': '14.895', 'FRAGCOUNT': '48.000'} [2023-02-25 13:14:36,991][36138] Updated weights for policy 0, policy_version 37213 (0.0010) [2023-02-25 13:14:37,000][36157] DAMAGECOUNT value on done: 41094.0 [2023-02-25 13:14:37,000][36157] Sum rewards: 39.372, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.716', 'ARMOR': '0.008', 'AMMO5': '0.024', 'AMMO2': '0.040', 'AMMO3': '0.183', 'weapon2': '0.190', 'AMMO4': '0.198', 'WEAPON4': '0.350', 'weapon5': '0.410', 'WEAPON5': '0.450', 'weapon4': '0.906', 'WEAPON3': '1.000', 'weapon3': '2.176', 'HITCOUNT': '2.180', 'DAMAGECOUNT': '10.473', 'FRAGCOUNT': '35.000'} [2023-02-25 13:14:37,068][36156] DAMAGECOUNT value on done: 37804.0 [2023-02-25 13:14:37,069][36156] Sum rewards: 47.542, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.280', 'AMMO5': '0.016', 'AMMO2': '0.025', 'weapon4': '0.114', 'AMMO4': '0.124', 'weapon2': '0.144', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'weapon5': '0.260', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.320', 'weapon3': '3.268', 'DAMAGECOUNT': '11.430', 'FRAGCOUNT': '44.000'} [2023-02-25 13:14:37,100][36141] DAMAGECOUNT value on done: 41664.0 [2023-02-25 13:14:37,101][36141] Sum rewards: 50.039, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.192', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.122', 'AMMO3': '0.134', 'AMMO4': '0.163', 'weapon5': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.562', 'WEAPON3': '0.800', 'HITCOUNT': '2.660', 'weapon3': '2.744', 'DAMAGECOUNT': '12.552', 'FRAGCOUNT': '41.000'} [2023-02-25 13:14:37,269][36142] DAMAGECOUNT value on done: 39819.0 [2023-02-25 13:14:37,270][36142] Sum rewards: 38.577, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.690', 'AMMO5': '0.016', 'AMMO2': '0.037', 'weapon4': '0.082', 'AMMO4': '0.184', 'weapon5': '0.214', 'AMMO3': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.428', 'WEAPON3': '1.450', 'HITCOUNT': '2.330', 'weapon3': '3.016', 'DAMAGECOUNT': '12.054', 'FRAGCOUNT': '37.000'} [2023-02-25 13:14:37,304][36157] DAMAGECOUNT value on done: 36589.0 [2023-02-25 13:14:37,305][36157] Sum rewards: 45.893, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.151', 'AMMO5': '0.017', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon4': '0.112', 'WEAPON4': '0.200', 'weapon5': '0.214', 'AMMO3': '0.231', 'weapon2': '0.294', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.730', 'weapon3': '3.114', 'DAMAGECOUNT': '13.560', 'FRAGCOUNT': '40.500'} [2023-02-25 13:14:37,414][36141] DAMAGECOUNT value on done: 36692.0 [2023-02-25 13:14:37,414][36141] Sum rewards: 51.002, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.652', 'AMMO5': '0.019', 'AMMO2': '0.027', 'AMMO4': '0.137', 'weapon5': '0.152', 'weapon2': '0.160', 'AMMO3': '0.204', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.604', 'WEAPON3': '1.250', 'HITCOUNT': '2.680', 'weapon3': '2.816', 'DAMAGECOUNT': '13.155', 'FRAGCOUNT': '46.000'} [2023-02-25 13:14:37,578][36142] DAMAGECOUNT value on done: 38211.0 [2023-02-25 13:14:37,578][36142] Sum rewards: 48.227, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.538', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO4': '0.142', 'AMMO3': '0.205', 'weapon2': '0.252', 'WEAPON4': '0.400', 'weapon4': '0.418', 'WEAPON3': '1.300', 'weapon3': '2.700', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '13.401', 'FRAGCOUNT': '45.000'} [2023-02-25 13:14:39,729][36114] Fps is (10 sec: 13107.3, 60 sec: 12765.9, 300 sec: 12561.1). Total num frames: 152457216. Throughput: 0: 3185.3. Samples: 605876. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:14:39,729][36114] Avg episode reward: [(0, '49.079')] [2023-02-25 13:14:40,037][36138] Updated weights for policy 0, policy_version 37223 (0.0009) [2023-02-25 13:14:43,136][36138] Updated weights for policy 0, policy_version 37233 (0.0010) [2023-02-25 13:14:44,729][36114] Fps is (10 sec: 13516.7, 60 sec: 12834.1, 300 sec: 12595.2). Total num frames: 152526848. Throughput: 0: 3229.1. Samples: 626060. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:14:44,730][36114] Avg episode reward: [(0, '49.079')] [2023-02-25 13:14:46,179][36138] Updated weights for policy 0, policy_version 37243 (0.0009) [2023-02-25 13:14:49,247][36138] Updated weights for policy 0, policy_version 37253 (0.0010) [2023-02-25 13:14:49,725][36139] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:14:49,729][36114] Fps is (10 sec: 13516.8, 60 sec: 12902.4, 300 sec: 12607.7). Total num frames: 152592384. Throughput: 0: 3261.2. Samples: 646008. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:14:49,729][36114] Avg episode reward: [(0, '49.079')] [2023-02-25 13:14:52,325][36138] Updated weights for policy 0, policy_version 37263 (0.0010) [2023-02-25 13:14:53,291][36156] Large shaping reward 2.557 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.525, 175.0), ('weapon5', 0.002)] [2023-02-25 13:14:54,516][36142] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 13:14:54,729][36114] Fps is (10 sec: 13107.1, 60 sec: 12970.7, 300 sec: 12619.6). Total num frames: 152657920. Throughput: 0: 3272.5. Samples: 655992. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:14:54,730][36114] Avg episode reward: [(0, '49.079')] [2023-02-25 13:14:55,329][36139] DAMAGECOUNT value on done: 43179.0 [2023-02-25 13:14:55,330][36139] Sum rewards: 55.737, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.743', 'AMMO2': '0.010', 'AMMO5': '0.011', 'AMMO4': '0.049', 'AMMO3': '0.162', 'weapon5': '0.186', 'WEAPON4': '0.200', 'weapon4': '0.242', 'weapon2': '0.248', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'HITCOUNT': '2.960', 'weapon3': '3.148', 'DAMAGECOUNT': '13.164', 'FRAGCOUNT': '47.000'} [2023-02-25 13:14:55,454][36138] Updated weights for policy 0, policy_version 37273 (0.0009) [2023-02-25 13:14:55,520][36155] DAMAGECOUNT value on done: 41832.0 [2023-02-25 13:14:55,520][36155] Sum rewards: 49.219, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.384', 'ARMOR': '0.008', 'AMMO5': '0.027', 'AMMO2': '0.042', 'AMMO3': '0.142', 'AMMO4': '0.211', 'weapon5': '0.302', 'weapon4': '0.388', 'WEAPON4': '0.500', 'weapon2': '0.518', 'WEAPON5': '0.650', 'WEAPON3': '0.950', 'HITCOUNT': '2.380', 'weapon3': '2.434', 'DAMAGECOUNT': '13.050', 'FRAGCOUNT': '42.000'} [2023-02-25 13:14:55,640][36139] DAMAGECOUNT value on done: 43267.0 [2023-02-25 13:14:55,640][36139] Sum rewards: 51.985, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.082', 'ARMOR': '0.004', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.034', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.146', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon4': '0.314', 'weapon2': '0.456', 'WEAPON3': '1.300', 'HITCOUNT': '2.770', 'weapon3': '2.788', 'DAMAGECOUNT': '14.031', 'FRAGCOUNT': '46.000'} [2023-02-25 13:14:55,821][36155] DAMAGECOUNT value on done: 45601.0 [2023-02-25 13:14:55,821][36155] Sum rewards: 59.709, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.936', 'AMMO5': '0.003', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'weapon4': '0.012', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO3': '0.195', 'weapon2': '0.428', 'WEAPON3': '1.250', 'HITCOUNT': '3.200', 'weapon3': '3.342', 'DAMAGECOUNT': '15.261', 'FRAGCOUNT': '49.000'} [2023-02-25 13:14:56,020][36155] DAMAGECOUNT value on done: 42048.0 [2023-02-25 13:14:56,021][36155] Sum rewards: 43.076, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.237', 'AMMO5': '0.009', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.048', 'weapon5': '0.130', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.344', 'weapon4': '0.630', 'WEAPON3': '0.950', 'weapon3': '2.640', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '12.315', 'FRAGCOUNT': '36.000'} [2023-02-25 13:14:56,083][36139] DAMAGECOUNT value on done: 46952.0 [2023-02-25 13:14:56,083][36139] Sum rewards: 40.074, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.096', 'AMMO5': '0.018', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon2': '0.174', 'weapon5': '0.212', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.454', 'WEAPON3': '1.400', 'HITCOUNT': '2.280', 'weapon3': '2.738', 'DAMAGECOUNT': '10.902', 'FRAGCOUNT': '38.000'} [2023-02-25 13:14:56,119][36140] DAMAGECOUNT value on done: 42825.0 [2023-02-25 13:14:56,120][36140] Sum rewards: 51.582, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.999', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.144', 'weapon4': '0.174', 'AMMO4': '0.178', 'AMMO3': '0.194', 'weapon2': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '2.790', 'weapon3': '3.214', 'DAMAGECOUNT': '13.326', 'FRAGCOUNT': '45.000'} [2023-02-25 13:14:56,210][36154] DAMAGECOUNT value on done: 43354.0 [2023-02-25 13:14:56,210][36154] Sum rewards: 54.651, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.650', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon4': '0.116', 'weapon5': '0.162', 'WEAPON4': '0.200', 'weapon2': '0.232', 'AMMO3': '0.268', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '2.710', 'weapon3': '3.178', 'DAMAGECOUNT': '13.902', 'FRAGCOUNT': '51.000'} [2023-02-25 13:14:56,332][36155] DAMAGECOUNT value on done: 45029.0 [2023-02-25 13:14:56,333][36155] Sum rewards: 47.042, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.460', 'weapon5': '0.002', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.011', 'WEAPON5': '0.100', 'AMMO3': '0.238', 'weapon2': '0.388', 'WEAPON3': '1.450', 'HITCOUNT': '2.710', 'weapon3': '3.378', 'DAMAGECOUNT': '12.468', 'FRAGCOUNT': '43.000'} [2023-02-25 13:14:56,380][36156] DAMAGECOUNT value on done: 45223.0 [2023-02-25 13:14:56,381][36156] Sum rewards: 43.330, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.815', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.083', 'weapon5': '0.090', 'WEAPON5': '0.100', 'weapon4': '0.170', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.662', 'WEAPON3': '1.200', 'HITCOUNT': '2.670', 'weapon3': '2.868', 'DAMAGECOUNT': '12.297', 'FRAGCOUNT': '39.000'} [2023-02-25 13:14:56,397][36139] DAMAGECOUNT value on done: 42775.0 [2023-02-25 13:14:56,397][36139] Sum rewards: 44.706, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'HEALTH': '0.238', 'weapon5': '0.238', 'weapon4': '0.264', 'WEAPON3': '0.650', 'weapon2': '0.942', 'weapon3': '2.416', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '10.647', 'FRAGCOUNT': '34.500'} [2023-02-25 13:14:56,432][36140] DAMAGECOUNT value on done: 43740.0 [2023-02-25 13:14:56,433][36140] Sum rewards: 52.514, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.915', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.082', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'weapon5': '0.216', 'weapon2': '0.240', 'WEAPON5': '0.250', 'weapon4': '0.370', 'WEAPON3': '1.100', 'HITCOUNT': '2.540', 'weapon3': '2.986', 'DAMAGECOUNT': '13.548', 'FRAGCOUNT': '44.000'} [2023-02-25 13:14:56,540][36154] DAMAGECOUNT value on done: 42583.0 [2023-02-25 13:14:56,541][36154] Sum rewards: 51.919, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.953', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.122', 'AMMO3': '0.136', 'weapon5': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.420', 'weapon4': '0.686', 'WEAPON3': '0.900', 'weapon3': '2.432', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '13.635', 'FRAGCOUNT': '43.000'} [2023-02-25 13:14:56,683][36156] DAMAGECOUNT value on done: 46786.0 [2023-02-25 13:14:56,684][36156] Sum rewards: 52.238, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.165', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon4': '0.104', 'weapon5': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.243', 'weapon2': '0.258', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '2.580', 'weapon3': '3.286', 'DAMAGECOUNT': '13.815', 'FRAGCOUNT': '47.000'} [2023-02-25 13:14:56,745][36141] DAMAGECOUNT value on done: 43584.0 [2023-02-25 13:14:56,746][36141] Sum rewards: 42.979, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.632', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.040', 'AMMO3': '0.158', 'weapon5': '0.174', 'AMMO4': '0.200', 'weapon4': '0.344', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.616', 'WEAPON3': '0.900', 'HITCOUNT': '2.400', 'weapon3': '2.560', 'DAMAGECOUNT': '11.883', 'FRAGCOUNT': '37.000'} [2023-02-25 13:14:56,749][36140] DAMAGECOUNT value on done: 45161.0 [2023-02-25 13:14:56,749][36140] Sum rewards: 49.242, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.150', 'AMMO5': '0.009', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon5': '0.210', 'weapon4': '0.214', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '2.730', 'weapon3': '2.976', 'DAMAGECOUNT': '13.653', 'FRAGCOUNT': '46.000'} [2023-02-25 13:14:56,774][36157] DAMAGECOUNT value on done: 44508.0 [2023-02-25 13:14:56,774][36157] Sum rewards: 52.042, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.246', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.166', 'AMMO4': '0.188', 'WEAPON5': '0.350', 'weapon5': '0.368', 'WEAPON4': '0.400', 'weapon2': '0.536', 'weapon4': '0.718', 'WEAPON3': '0.900', 'weapon3': '2.024', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '14.103', 'FRAGCOUNT': '44.000'} [2023-02-25 13:14:56,818][36156] DAMAGECOUNT value on done: 41480.0 [2023-02-25 13:14:56,819][36156] Sum rewards: 49.712, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.764', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.120', 'AMMO4': '0.134', 'weapon2': '0.180', 'WEAPON4': '0.200', 'AMMO3': '0.268', 'WEAPON5': '0.350', 'weapon5': '0.396', 'WEAPON3': '1.600', 'HITCOUNT': '2.710', 'weapon3': '3.016', 'DAMAGECOUNT': '13.464', 'FRAGCOUNT': '46.000'} [2023-02-25 13:14:56,852][36154] DAMAGECOUNT value on done: 44916.0 [2023-02-25 13:14:56,853][36154] Sum rewards: 60.551, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.860', 'AMMO5': '0.016', 'AMMO2': '0.040', 'AMMO3': '0.174', 'weapon5': '0.174', 'AMMO4': '0.198', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.442', 'weapon2': '0.624', 'WEAPON3': '1.050', 'weapon3': '2.510', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.153', 'FRAGCOUNT': '53.000'} [2023-02-25 13:14:57,053][36141] DAMAGECOUNT value on done: 44654.0 [2023-02-25 13:14:57,053][36141] Sum rewards: 58.880, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.980', 'AMMO5': '0.021', 'AMMO2': '0.026', 'AMMO3': '0.096', 'AMMO4': '0.128', 'WEAPON4': '0.300', 'weapon4': '0.452', 'weapon5': '0.482', 'WEAPON5': '0.500', 'weapon2': '0.580', 'WEAPON3': '0.650', 'weapon3': '2.144', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '14.451', 'FRAGCOUNT': '47.000'} [2023-02-25 13:14:57,075][36140] DAMAGECOUNT value on done: 42269.0 [2023-02-25 13:14:57,076][36140] Sum rewards: 45.067, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.900', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.172', 'AMMO4': '0.179', 'AMMO3': '0.201', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.404', 'weapon4': '0.942', 'WEAPON3': '1.200', 'weapon3': '2.060', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.053', 'FRAGCOUNT': '41.000'} [2023-02-25 13:14:57,084][36142] DAMAGECOUNT value on done: 41727.0 [2023-02-25 13:14:57,084][36142] Sum rewards: 43.668, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.138', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.160', 'weapon2': '0.204', 'AMMO3': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.448', 'WEAPON3': '1.400', 'HITCOUNT': '2.370', 'weapon3': '2.954', 'DAMAGECOUNT': '11.139', 'FRAGCOUNT': '42.000'} [2023-02-25 13:14:57,097][36157] DAMAGECOUNT value on done: 42813.0 [2023-02-25 13:14:57,097][36157] Sum rewards: 46.922, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.669', 'AMMO5': '0.020', 'AMMO2': '0.044', 'AMMO3': '0.174', 'weapon5': '0.184', 'AMMO4': '0.219', 'weapon4': '0.256', 'WEAPON5': '0.350', 'weapon2': '0.428', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'HITCOUNT': '2.500', 'weapon3': '2.776', 'DAMAGECOUNT': '12.840', 'FRAGCOUNT': '41.500'} [2023-02-25 13:14:57,118][36156] DAMAGECOUNT value on done: 42395.0 [2023-02-25 13:14:57,118][36156] Sum rewards: 50.855, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.196', 'AMMO5': '0.022', 'AMMO2': '0.036', 'AMMO4': '0.182', 'weapon4': '0.194', 'AMMO3': '0.226', 'weapon5': '0.250', 'weapon2': '0.300', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.640', 'weapon3': '2.978', 'DAMAGECOUNT': '13.773', 'FRAGCOUNT': '46.000'} [2023-02-25 13:14:57,159][36154] DAMAGECOUNT value on done: 45233.0 [2023-02-25 13:14:57,159][36154] Sum rewards: 51.945, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.236', 'ARMOR': '0.004', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'AMMO4': '0.176', 'AMMO3': '0.244', 'weapon5': '0.286', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.520', 'WEAPON3': '1.400', 'weapon3': '2.536', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.974', 'FRAGCOUNT': '46.000'} [2023-02-25 13:14:57,272][36141] DAMAGECOUNT value on done: 45795.0 [2023-02-25 13:14:57,273][36141] Sum rewards: 46.626, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.320', 'AMMO5': '0.024', 'AMMO2': '0.040', 'AMMO3': '0.139', 'AMMO4': '0.200', 'weapon2': '0.234', 'weapon5': '0.238', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon4': '0.582', 'WEAPON3': '0.850', 'weapon3': '2.616', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.393', 'FRAGCOUNT': '39.000'} [2023-02-25 13:14:57,344][36157] DAMAGECOUNT value on done: 44603.0 [2023-02-25 13:14:57,344][36157] Sum rewards: 38.648, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.162', 'ARMOR': '0.004', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.176', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.338', 'weapon2': '0.894', 'WEAPON3': '1.150', 'HITCOUNT': '2.110', 'weapon3': '2.308', 'DAMAGECOUNT': '10.527', 'FRAGCOUNT': '35.000'} [2023-02-25 13:14:57,397][36142] DAMAGECOUNT value on done: 46087.0 [2023-02-25 13:14:57,398][36142] Sum rewards: 44.106, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.030', 'AMMO5': '0.018', 'AMMO2': '0.048', 'AMMO3': '0.192', 'AMMO4': '0.242', 'weapon5': '0.372', 'WEAPON5': '0.500', 'weapon2': '0.504', 'WEAPON4': '0.650', 'weapon4': '0.734', 'WEAPON3': '1.050', 'weapon3': '2.120', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '11.175', 'FRAGCOUNT': '41.000'} [2023-02-25 13:14:57,584][36141] DAMAGECOUNT value on done: 41308.0 [2023-02-25 13:14:57,584][36141] Sum rewards: 44.547, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.668', 'ARMOR': '0.004', 'AMMO5': '0.027', 'AMMO2': '0.068', 'AMMO3': '0.198', 'weapon2': '0.266', 'weapon5': '0.274', 'AMMO4': '0.342', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'weapon4': '1.112', 'WEAPON3': '1.150', 'weapon3': '1.916', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.848', 'FRAGCOUNT': '41.000'} [2023-02-25 13:14:57,660][36157] DAMAGECOUNT value on done: 42021.0 [2023-02-25 13:14:57,660][36157] Sum rewards: 59.392, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.340', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon4': '0.432', 'weapon2': '0.564', 'WEAPON3': '1.500', 'weapon3': '2.578', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.296', 'FRAGCOUNT': '51.500'} [2023-02-25 13:14:57,704][36142] DAMAGECOUNT value on done: 44499.0 [2023-02-25 13:14:57,704][36142] Sum rewards: 54.679, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.750', 'AMMO5': '0.017', 'AMMO2': '0.035', 'AMMO3': '0.160', 'AMMO4': '0.174', 'weapon2': '0.238', 'weapon5': '0.256', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.726', 'WEAPON3': '1.050', 'weapon3': '2.512', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.040', 'FRAGCOUNT': '47.000'} [2023-02-25 13:14:58,017][36142] DAMAGECOUNT value on done: 42818.0 [2023-02-25 13:14:58,018][36142] Sum rewards: 52.201, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.856', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.202', 'AMMO3': '0.226', 'weapon4': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.646', 'WEAPON3': '1.300', 'weapon3': '2.604', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '13.821', 'FRAGCOUNT': '48.000'} [2023-02-25 13:14:58,529][36138] Updated weights for policy 0, policy_version 37283 (0.0009) [2023-02-25 13:14:59,729][36114] Fps is (10 sec: 13107.1, 60 sec: 12970.7, 300 sec: 12630.9). Total num frames: 152723456. Throughput: 0: 3278.2. Samples: 675840. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:14:59,730][36114] Avg episode reward: [(0, '49.590')] [2023-02-25 13:14:59,733][36125] Saving new best policy, reward=49.590! [2023-02-25 13:15:01,635][36138] Updated weights for policy 0, policy_version 37293 (0.0010) [2023-02-25 13:15:04,723][36138] Updated weights for policy 0, policy_version 37303 (0.0010) [2023-02-25 13:15:04,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13107.2, 300 sec: 12660.4). Total num frames: 152793088. Throughput: 0: 3308.6. Samples: 695788. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:15:04,730][36114] Avg episode reward: [(0, '49.590')] [2023-02-25 13:15:07,841][36138] Updated weights for policy 0, policy_version 37313 (0.0009) [2023-02-25 13:15:09,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13175.4, 300 sec: 12670.3). Total num frames: 152858624. Throughput: 0: 3318.4. Samples: 705718. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:15:09,730][36114] Avg episode reward: [(0, '49.590')] [2023-02-25 13:15:10,945][36138] Updated weights for policy 0, policy_version 37323 (0.0009) [2023-02-25 13:15:14,051][36138] Updated weights for policy 0, policy_version 37333 (0.0009) [2023-02-25 13:15:14,729][36114] Fps is (10 sec: 13107.0, 60 sec: 13175.5, 300 sec: 12679.8). Total num frames: 152924160. Throughput: 0: 3319.6. Samples: 725576. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:15:14,730][36114] Avg episode reward: [(0, '49.590')] [2023-02-25 13:15:14,875][36157] Large shaping reward -2.526 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HITCOUNT', 0.01, 1.0), ('DAMAGECOUNT', 0.015, 5.0), ('HEALTH', -0.3, -100.0), ('ARMOR', -0.001, -1.0), ('AMMO5', -0.0005, -1.0)] [2023-02-25 13:15:15,487][36139] DAMAGECOUNT value on done: 47566.0 [2023-02-25 13:15:15,488][36139] Sum rewards: 48.592, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.062', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO4': '0.173', 'AMMO3': '0.179', 'weapon2': '0.218', 'weapon5': '0.248', 'WEAPON5': '0.350', 'weapon4': '0.434', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.710', 'weapon3': '2.832', 'DAMAGECOUNT': '13.161', 'FRAGCOUNT': '43.000'} [2023-02-25 13:15:15,653][36155] DAMAGECOUNT value on done: 46340.0 [2023-02-25 13:15:15,653][36155] Sum rewards: 48.873, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.710', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'weapon5': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'weapon2': '0.232', 'weapon4': '0.490', 'WEAPON3': '1.300', 'HITCOUNT': '2.540', 'weapon3': '2.870', 'DAMAGECOUNT': '13.509', 'FRAGCOUNT': '43.000'} [2023-02-25 13:15:15,790][36139] DAMAGECOUNT value on done: 48540.0 [2023-02-25 13:15:15,791][36139] Sum rewards: 64.200, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.090', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO4': '0.032', 'weapon5': '0.052', 'weapon4': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.240', 'weapon2': '0.296', 'WEAPON3': '1.350', 'HITCOUNT': '3.090', 'weapon3': '3.376', 'DAMAGECOUNT': '15.819', 'FRAGCOUNT': '55.000'} [2023-02-25 13:15:15,969][36155] DAMAGECOUNT value on done: 50064.0 [2023-02-25 13:15:15,970][36155] Sum rewards: 48.538, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.482', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon4': '0.118', 'weapon5': '0.216', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.302', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.520', 'weapon3': '3.050', 'DAMAGECOUNT': '13.389', 'FRAGCOUNT': '43.000'} [2023-02-25 13:15:16,189][36155] DAMAGECOUNT value on done: 46407.0 [2023-02-25 13:15:16,190][36155] Sum rewards: 49.423, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.483', 'AMMO5': '0.018', 'AMMO2': '0.031', 'AMMO3': '0.143', 'AMMO4': '0.155', 'weapon2': '0.308', 'weapon5': '0.360', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'WEAPON3': '0.850', 'weapon4': '0.938', 'weapon3': '2.126', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.077', 'FRAGCOUNT': '42.000'} [2023-02-25 13:15:16,194][36139] DAMAGECOUNT value on done: 50883.0 [2023-02-25 13:15:16,194][36139] Sum rewards: 49.923, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon5': '0.026', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.102', 'AMMO3': '0.131', 'HEALTH': '0.160', 'weapon2': '0.652', 'WEAPON3': '0.800', 'HITCOUNT': '2.640', 'weapon3': '2.972', 'DAMAGECOUNT': '11.793', 'FRAGCOUNT': '41.000'} [2023-02-25 13:15:16,469][36155] DAMAGECOUNT value on done: 48633.0 [2023-02-25 13:15:16,469][36155] Sum rewards: 37.270, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.666', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO2': '0.045', 'AMMO3': '0.148', 'AMMO4': '0.224', 'weapon2': '0.414', 'weapon5': '0.446', 'WEAPON4': '0.500', 'weapon4': '0.524', 'WEAPON5': '0.600', 'WEAPON3': '0.850', 'weapon3': '2.240', 'HITCOUNT': '2.340', 'DAMAGECOUNT': '10.812', 'FRAGCOUNT': '34.000'} [2023-02-25 13:15:16,516][36139] DAMAGECOUNT value on done: 46716.0 [2023-02-25 13:15:16,517][36139] Sum rewards: 43.928, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.480', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.120', 'weapon4': '0.166', 'AMMO3': '0.173', 'AMMO4': '0.185', 'weapon2': '0.252', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'HITCOUNT': '2.470', 'weapon3': '3.270', 'DAMAGECOUNT': '11.823', 'FRAGCOUNT': '38.500'} [2023-02-25 13:15:16,526][36140] DAMAGECOUNT value on done: 47843.0 [2023-02-25 13:15:16,526][36140] Sum rewards: 57.213, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.190', 'AMMO2': '0.012', 'AMMO5': '0.020', 'AMMO4': '0.057', 'weapon2': '0.110', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon5': '0.254', 'weapon4': '0.282', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.112', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.054', 'FRAGCOUNT': '46.500'} [2023-02-25 13:15:16,544][36154] DAMAGECOUNT value on done: 47244.0 [2023-02-25 13:15:16,544][36154] Sum rewards: 48.359, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.115', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon5': '0.132', 'AMMO3': '0.180', 'weapon2': '0.218', 'AMMO4': '0.256', 'WEAPON5': '0.350', 'weapon4': '0.428', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'HITCOUNT': '2.590', 'weapon3': '2.934', 'DAMAGECOUNT': '11.670', 'FRAGCOUNT': '45.000'} [2023-02-25 13:15:16,698][36156] DAMAGECOUNT value on done: 48995.0 [2023-02-25 13:15:16,699][36156] Sum rewards: 43.392, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.585', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.042', 'AMMO3': '0.104', 'weapon5': '0.180', 'AMMO4': '0.209', 'WEAPON5': '0.250', 'weapon2': '0.536', 'WEAPON4': '0.600', 'WEAPON3': '0.650', 'weapon4': '1.052', 'weapon3': '1.996', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '11.316', 'FRAGCOUNT': '36.000'} [2023-02-25 13:15:16,835][36140] DAMAGECOUNT value on done: 46710.0 [2023-02-25 13:15:16,836][36140] Sum rewards: 31.382, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.130', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.080', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'AMMO3': '0.153', 'WEAPON4': '0.350', 'weapon4': '0.490', 'ARMOR': '0.512', 'weapon2': '0.708', 'WEAPON3': '0.950', 'HITCOUNT': '2.020', 'weapon3': '2.120', 'DAMAGECOUNT': '8.910', 'FRAGCOUNT': '29.000'} [2023-02-25 13:15:16,879][36154] DAMAGECOUNT value on done: 46947.0 [2023-02-25 13:15:16,880][36154] Sum rewards: 49.907, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.830', 'AMMO5': '0.016', 'AMMO2': '0.030', 'AMMO4': '0.151', 'AMMO3': '0.181', 'weapon2': '0.222', 'WEAPON4': '0.300', 'weapon5': '0.364', 'weapon4': '0.380', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.540', 'weapon3': '2.770', 'DAMAGECOUNT': '12.732', 'FRAGCOUNT': '44.000'} [2023-02-25 13:15:17,016][36156] DAMAGECOUNT value on done: 51856.0 [2023-02-25 13:15:17,016][36156] Sum rewards: 60.711, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.890', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.081', 'weapon2': '0.204', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'weapon4': '0.498', 'WEAPON3': '1.300', 'weapon3': '3.026', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '53.000'} [2023-02-25 13:15:17,146][36156] DAMAGECOUNT value on done: 45781.0 [2023-02-25 13:15:17,146][36156] Sum rewards: 46.832, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.160', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.019', 'weapon5': '0.070', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.201', 'weapon2': '0.210', 'weapon4': '0.260', 'WEAPON3': '1.200', 'HITCOUNT': '2.810', 'weapon3': '3.216', 'DAMAGECOUNT': '12.903', 'FRAGCOUNT': '41.000'} [2023-02-25 13:15:17,149][36138] Updated weights for policy 0, policy_version 37343 (0.0009) [2023-02-25 13:15:17,166][36140] DAMAGECOUNT value on done: 49438.0 [2023-02-25 13:15:17,167][36140] Sum rewards: 43.635, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.168', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO5': '0.024', 'AMMO2': '0.056', 'weapon5': '0.220', 'AMMO3': '0.267', 'AMMO4': '0.278', 'weapon4': '0.296', 'weapon2': '0.402', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.706', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.831', 'FRAGCOUNT': '43.000'} [2023-02-25 13:15:17,178][36141] DAMAGECOUNT value on done: 48406.0 [2023-02-25 13:15:17,178][36141] Sum rewards: 55.336, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.593', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.158', 'AMMO3': '0.195', 'AMMO4': '0.201', 'weapon2': '0.286', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.572', 'WEAPON3': '1.200', 'weapon3': '2.690', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.466', 'FRAGCOUNT': '50.000'} [2023-02-25 13:15:17,196][36154] DAMAGECOUNT value on done: 50081.0 [2023-02-25 13:15:17,196][36154] Sum rewards: 62.241, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.600', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.154', 'AMMO3': '0.184', 'weapon2': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.388', 'WEAPON3': '1.150', 'weapon3': '2.990', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '52.000'} [2023-02-25 13:15:17,232][36157] DAMAGECOUNT value on done: 49103.0 [2023-02-25 13:15:17,233][36157] Sum rewards: 57.978, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.455', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.057', 'AMMO3': '0.070', 'weapon5': '0.270', 'AMMO4': '0.283', 'WEAPON3': '0.400', 'weapon2': '0.434', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '1.354', 'weapon3': '1.538', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '13.785', 'FRAGCOUNT': '47.000'} [2023-02-25 13:15:17,483][36156] DAMAGECOUNT value on done: 46581.0 [2023-02-25 13:15:17,483][36156] Sum rewards: 52.349, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.100', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.051', 'weapon5': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.250', 'weapon2': '0.276', 'WEAPON3': '1.450', 'HITCOUNT': '2.850', 'weapon3': '3.234', 'DAMAGECOUNT': '12.558', 'FRAGCOUNT': '49.000'} [2023-02-25 13:15:17,493][36142] DAMAGECOUNT value on done: 46894.0 [2023-02-25 13:15:17,494][36142] Sum rewards: 60.383, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.340', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon7': '0.058', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.130', 'AMMO4': '0.133', 'weapon4': '0.180', 'WEAPON7': '0.200', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.634', 'WEAPON3': '1.200', 'weapon3': '2.780', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.501', 'FRAGCOUNT': '51.000'} [2023-02-25 13:15:17,503][36141] DAMAGECOUNT value on done: 48768.0 [2023-02-25 13:15:17,504][36141] Sum rewards: 45.224, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.910', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.171', 'weapon5': '0.300', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.408', 'weapon2': '0.590', 'WEAPON3': '1.000', 'weapon3': '2.518', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '12.342', 'FRAGCOUNT': '40.000'} [2023-02-25 13:15:17,507][36140] DAMAGECOUNT value on done: 46871.0 [2023-02-25 13:15:17,507][36140] Sum rewards: 51.241, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.805', 'AMMO5': '0.017', 'AMMO2': '0.046', 'AMMO3': '0.127', 'AMMO4': '0.231', 'weapon5': '0.280', 'WEAPON5': '0.450', 'weapon4': '0.472', 'WEAPON4': '0.500', 'weapon2': '0.502', 'WEAPON3': '0.750', 'HITCOUNT': '2.380', 'weapon3': '2.484', 'DAMAGECOUNT': '13.806', 'FRAGCOUNT': '42.000'} [2023-02-25 13:15:17,526][36154] DAMAGECOUNT value on done: 50252.0 [2023-02-25 13:15:17,527][36154] Sum rewards: 62.709, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.260', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.096', 'AMMO4': '0.118', 'AMMO3': '0.208', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.348', 'weapon2': '0.670', 'WEAPON3': '1.250', 'weapon3': '2.684', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.057', 'FRAGCOUNT': '55.000'} [2023-02-25 13:15:17,544][36157] DAMAGECOUNT value on done: 46696.0 [2023-02-25 13:15:17,544][36157] Sum rewards: 46.961, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.488', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.084', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'AMMO4': '0.166', 'WEAPON5': '0.200', 'weapon4': '0.350', 'weapon2': '0.540', 'WEAPON3': '1.000', 'HITCOUNT': '2.530', 'weapon3': '2.822', 'DAMAGECOUNT': '11.649', 'FRAGCOUNT': '39.000'} [2023-02-25 13:15:17,646][36141] DAMAGECOUNT value on done: 49836.0 [2023-02-25 13:15:17,647][36141] Sum rewards: 43.139, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.010', 'AMMO2': '0.027', 'HEALTH': '0.124', 'AMMO4': '0.134', 'weapon5': '0.174', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'WEAPON5': '0.250', 'weapon4': '0.368', 'weapon2': '0.418', 'WEAPON3': '1.100', 'weapon3': '2.550', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.123', 'FRAGCOUNT': '37.000'} [2023-02-25 13:15:17,811][36142] DAMAGECOUNT value on done: 50578.0 [2023-02-25 13:15:17,812][36142] Sum rewards: 47.009, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.275', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.128', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.202', 'AMMO3': '0.284', 'weapon2': '0.302', 'WEAPON3': '1.650', 'HITCOUNT': '2.700', 'weapon3': '3.084', 'DAMAGECOUNT': '13.473', 'FRAGCOUNT': '46.000'} [2023-02-25 13:15:17,846][36157] DAMAGECOUNT value on done: 49573.0 [2023-02-25 13:15:17,847][36157] Sum rewards: 56.041, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.364', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.176', 'weapon2': '0.198', 'AMMO3': '0.237', 'weapon4': '0.270', 'WEAPON3': '1.350', 'HITCOUNT': '3.000', 'weapon3': '3.114', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '47.000'} [2023-02-25 13:15:17,973][36141] DAMAGECOUNT value on done: 45091.0 [2023-02-25 13:15:17,973][36141] Sum rewards: 43.320, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.580', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.158', 'weapon5': '0.208', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.364', 'weapon2': '0.502', 'WEAPON3': '0.950', 'HITCOUNT': '2.520', 'weapon3': '2.694', 'DAMAGECOUNT': '11.349', 'FRAGCOUNT': '38.000'} [2023-02-25 13:15:18,117][36142] DAMAGECOUNT value on done: 49741.0 [2023-02-25 13:15:18,118][36142] Sum rewards: 61.044, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.802', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.134', 'weapon2': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.261', 'weapon4': '0.318', 'WEAPON3': '1.600', 'weapon3': '3.108', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '54.000'} [2023-02-25 13:15:18,173][36157] DAMAGECOUNT value on done: 46238.0 [2023-02-25 13:15:18,173][36157] Sum rewards: 43.472, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.151', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.042', 'AMMO4': '0.068', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.160', 'AMMO3': '0.273', 'weapon2': '0.350', 'WEAPON3': '1.650', 'HITCOUNT': '2.410', 'weapon3': '3.200', 'DAMAGECOUNT': '12.651', 'FRAGCOUNT': '42.000'} [2023-02-25 13:15:18,440][36142] DAMAGECOUNT value on done: 47729.0 [2023-02-25 13:15:18,440][36142] Sum rewards: 50.758, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.700', 'AMMO5': '0.005', 'AMMO2': '0.047', 'weapon5': '0.098', 'WEAPON5': '0.150', 'weapon2': '0.198', 'AMMO4': '0.234', 'AMMO3': '0.285', 'weapon4': '0.458', 'WEAPON4': '0.500', 'WEAPON3': '1.750', 'weapon3': '2.920', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.493', 'FRAGCOUNT': '50.000'} [2023-02-25 13:15:18,961][36142] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('ARMOR', -0.001, -1.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 13:15:19,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13243.8, 300 sec: 12688.9). Total num frames: 152989696. Throughput: 0: 3312.1. Samples: 745128. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:15:19,730][36114] Avg episode reward: [(0, '49.720')] [2023-02-25 13:15:19,733][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000037351_152989696.pth... [2023-02-25 13:15:19,796][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000036623_150007808.pth [2023-02-25 13:15:19,799][36125] Saving new best policy, reward=49.720! [2023-02-25 13:15:20,262][36138] Updated weights for policy 0, policy_version 37353 (0.0010) [2023-02-25 13:15:23,424][36138] Updated weights for policy 0, policy_version 37363 (0.0010) [2023-02-25 13:15:24,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13243.7, 300 sec: 12697.6). Total num frames: 153055232. Throughput: 0: 3311.9. Samples: 754912. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:15:24,730][36114] Avg episode reward: [(0, '49.720')] [2023-02-25 13:15:26,363][36139] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:15:26,580][36138] Updated weights for policy 0, policy_version 37373 (0.0010) [2023-02-25 13:15:29,729][36114] Fps is (10 sec: 12697.6, 60 sec: 13175.5, 300 sec: 12689.2). Total num frames: 153116672. Throughput: 0: 3280.4. Samples: 773678. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:15:29,729][36114] Avg episode reward: [(0, '49.720')] [2023-02-25 13:15:29,925][36138] Updated weights for policy 0, policy_version 37383 (0.0010) [2023-02-25 13:15:33,091][36138] Updated weights for policy 0, policy_version 37393 (0.0010) [2023-02-25 13:15:34,729][36114] Fps is (10 sec: 12697.8, 60 sec: 13175.5, 300 sec: 12697.6). Total num frames: 153182208. Throughput: 0: 3270.6. Samples: 793186. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:15:34,729][36114] Avg episode reward: [(0, '49.720')] [2023-02-25 13:15:36,136][36155] DAMAGECOUNT value on done: 50886.0 [2023-02-25 13:15:36,137][36155] Sum rewards: 51.797, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.960', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon2': '0.188', 'AMMO3': '0.201', 'weapon5': '0.252', 'WEAPON4': '0.300', 'weapon4': '0.304', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.880', 'weapon3': '2.994', 'DAMAGECOUNT': '13.638', 'FRAGCOUNT': '44.000'} [2023-02-25 13:15:36,242][36138] Updated weights for policy 0, policy_version 37403 (0.0010) [2023-02-25 13:15:36,339][36139] DAMAGECOUNT value on done: 52701.0 [2023-02-25 13:15:36,340][36139] Sum rewards: 62.571, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.788', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'weapon5': '0.216', 'WEAPON4': '0.300', 'weapon2': '0.402', 'weapon4': '0.454', 'WEAPON3': '1.000', 'weapon3': '2.704', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '52.000'} [2023-02-25 13:15:36,450][36155] DAMAGECOUNT value on done: 54473.0 [2023-02-25 13:15:36,450][36155] Sum rewards: 60.231, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.530', 'AMMO5': '0.004', 'AMMO2': '0.007', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'weapon2': '0.382', 'weapon4': '0.398', 'WEAPON3': '0.950', 'HITCOUNT': '2.790', 'weapon3': '2.842', 'DAMAGECOUNT': '13.227', 'FRAGCOUNT': '49.000'} [2023-02-25 13:15:36,663][36139] DAMAGECOUNT value on done: 52970.0 [2023-02-25 13:15:36,664][36139] Sum rewards: 51.983, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.595', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.140', 'AMMO4': '0.158', 'weapon4': '0.218', 'AMMO3': '0.241', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.486', 'WEAPON3': '1.450', 'weapon3': '2.934', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.290', 'FRAGCOUNT': '48.000'} [2023-02-25 13:15:36,699][36155] DAMAGECOUNT value on done: 50873.0 [2023-02-25 13:15:36,700][36155] Sum rewards: 53.782, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.860', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'weapon5': '0.014', 'weapon4': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.235', 'weapon2': '0.274', 'WEAPON3': '1.450', 'HITCOUNT': '2.850', 'weapon3': '3.536', 'DAMAGECOUNT': '13.398', 'FRAGCOUNT': '48.000'} [2023-02-25 13:15:36,962][36139] DAMAGECOUNT value on done: 55218.0 [2023-02-25 13:15:36,962][36139] Sum rewards: 46.944, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.412', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon5': '0.186', 'AMMO3': '0.209', 'weapon4': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.300', 'HITCOUNT': '2.720', 'weapon3': '2.974', 'DAMAGECOUNT': '13.005', 'FRAGCOUNT': '44.000'} [2023-02-25 13:15:37,014][36155] DAMAGECOUNT value on done: 52963.0 [2023-02-25 13:15:37,015][36155] Sum rewards: 52.199, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.594', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon5': '0.168', 'AMMO3': '0.179', 'AMMO4': '0.263', 'WEAPON5': '0.300', 'weapon4': '0.422', 'WEAPON4': '0.500', 'weapon2': '0.552', 'WEAPON3': '1.150', 'weapon3': '2.492', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.990', 'FRAGCOUNT': '47.000'} [2023-02-25 13:15:37,263][36139] DAMAGECOUNT value on done: 50856.0 [2023-02-25 13:15:37,264][36139] Sum rewards: 50.182, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.371', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon5': '0.134', 'AMMO3': '0.179', 'weapon2': '0.214', 'AMMO4': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'weapon4': '1.292', 'weapon3': '2.052', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '12.420', 'FRAGCOUNT': '44.000'} [2023-02-25 13:15:37,471][36140] DAMAGECOUNT value on done: 52619.0 [2023-02-25 13:15:37,472][36140] Sum rewards: 50.264, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.495', 'ARMOR': '0.004', 'AMMO5': '0.028', 'AMMO2': '0.056', 'AMMO3': '0.181', 'weapon5': '0.192', 'weapon4': '0.234', 'AMMO4': '0.281', 'weapon2': '0.324', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'HITCOUNT': '2.760', 'weapon3': '2.932', 'DAMAGECOUNT': '14.217', 'FRAGCOUNT': '45.000'} [2023-02-25 13:15:37,528][36154] DAMAGECOUNT value on done: 51105.0 [2023-02-25 13:15:37,528][36154] Sum rewards: 39.299, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.180', 'AMMO5': '0.020', 'AMMO2': '0.060', 'weapon5': '0.192', 'AMMO3': '0.214', 'weapon2': '0.220', 'AMMO4': '0.300', 'WEAPON5': '0.500', 'weapon4': '0.570', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'HITCOUNT': '2.270', 'weapon3': '2.700', 'DAMAGECOUNT': '11.583', 'FRAGCOUNT': '39.000'} [2023-02-25 13:15:37,619][36156] DAMAGECOUNT value on done: 52385.0 [2023-02-25 13:15:37,620][36156] Sum rewards: 32.769, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.380', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.027', 'weapon5': '0.090', 'weapon7': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.528', 'weapon4': '0.856', 'WEAPON3': '0.950', 'weapon3': '2.082', 'HITCOUNT': '2.270', 'DAMAGECOUNT': '10.125', 'FRAGCOUNT': '29.000'} [2023-02-25 13:15:37,771][36140] DAMAGECOUNT value on done: 51044.0 [2023-02-25 13:15:37,772][36140] Sum rewards: 51.044, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.032', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.036', 'weapon5': '0.166', 'AMMO4': '0.178', 'AMMO3': '0.215', 'weapon2': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.474', 'WEAPON3': '1.300', 'weapon3': '2.742', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.780', 'FRAGCOUNT': '47.000'} [2023-02-25 13:15:37,841][36154] DAMAGECOUNT value on done: 51700.0 [2023-02-25 13:15:37,841][36154] Sum rewards: 57.639, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.209', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.146', 'WEAPON4': '0.150', 'weapon2': '0.166', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'weapon4': '0.358', 'WEAPON3': '1.400', 'HITCOUNT': '2.980', 'weapon3': '3.066', 'DAMAGECOUNT': '14.259', 'FRAGCOUNT': '51.000'} [2023-02-25 13:15:37,930][36156] DAMAGECOUNT value on done: 55893.0 [2023-02-25 13:15:37,931][36156] Sum rewards: 48.830, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.740', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.158', 'AMMO3': '0.169', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.438', 'weapon2': '0.490', 'WEAPON3': '1.150', 'weapon3': '2.714', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.111', 'FRAGCOUNT': '42.000'} [2023-02-25 13:15:37,932][36157] DAMAGECOUNT value on done: 53546.0 [2023-02-25 13:15:37,932][36157] Sum rewards: 46.924, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.757', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon5': '0.122', 'weapon4': '0.140', 'AMMO4': '0.203', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.460', 'WEAPON3': '1.350', 'weapon3': '2.894', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.329', 'FRAGCOUNT': '43.000'} [2023-02-25 13:15:38,016][36156] DAMAGECOUNT value on done: 50317.0 [2023-02-25 13:15:38,016][36156] Sum rewards: 54.353, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.568', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon2': '0.144', 'weapon5': '0.162', 'AMMO4': '0.192', 'AMMO3': '0.195', 'weapon4': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'HITCOUNT': '2.890', 'weapon3': '3.278', 'DAMAGECOUNT': '13.608', 'FRAGCOUNT': '47.000'} [2023-02-25 13:15:38,081][36140] DAMAGECOUNT value on done: 54199.0 [2023-02-25 13:15:38,082][36140] Sum rewards: 54.110, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.350', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon2': '0.212', 'weapon5': '0.212', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'weapon4': '0.316', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.954', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.283', 'FRAGCOUNT': '48.000'} [2023-02-25 13:15:38,144][36154] DAMAGECOUNT value on done: 55477.0 [2023-02-25 13:15:38,144][36154] Sum rewards: 63.565, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.420', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.056', 'AMMO3': '0.162', 'weapon5': '0.268', 'AMMO4': '0.279', 'weapon2': '0.282', 'weapon4': '0.336', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.768', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.188', 'FRAGCOUNT': '57.000'} [2023-02-25 13:15:38,234][36141] DAMAGECOUNT value on done: 52395.0 [2023-02-25 13:15:38,235][36141] Sum rewards: 48.502, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.472', 'AMMO5': '0.006', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon5': '0.094', 'AMMO4': '0.109', 'weapon4': '0.116', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.850', 'WEAPON3': '1.050', 'HITCOUNT': '2.650', 'weapon3': '2.714', 'DAMAGECOUNT': '11.967', 'FRAGCOUNT': '41.000'} [2023-02-25 13:15:38,237][36157] DAMAGECOUNT value on done: 50873.0 [2023-02-25 13:15:38,238][36157] Sum rewards: 40.377, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.337', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.042', 'AMMO3': '0.196', 'AMMO4': '0.208', 'weapon5': '0.238', 'weapon4': '0.252', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.480', 'WEAPON3': '1.200', 'HITCOUNT': '2.640', 'weapon3': '2.756', 'DAMAGECOUNT': '12.531', 'FRAGCOUNT': '37.000'} [2023-02-25 13:15:38,279][36142] DAMAGECOUNT value on done: 51230.0 [2023-02-25 13:15:38,280][36142] Sum rewards: 45.938, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.175', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.122', 'AMMO4': '0.124', 'weapon2': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.273', 'weapon4': '0.286', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '2.830', 'weapon3': '3.116', 'DAMAGECOUNT': '13.008', 'FRAGCOUNT': '45.000'} [2023-02-25 13:15:38,337][36156] DAMAGECOUNT value on done: 50996.0 [2023-02-25 13:15:38,337][36156] Sum rewards: 48.542, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.918', 'AMMO5': '0.021', 'AMMO2': '0.038', 'AMMO3': '0.146', 'AMMO4': '0.191', 'weapon5': '0.226', 'weapon2': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.460', 'WEAPON3': '1.000', 'HITCOUNT': '2.690', 'weapon3': '2.802', 'DAMAGECOUNT': '12.825', 'FRAGCOUNT': '41.000'} [2023-02-25 13:15:38,403][36140] DAMAGECOUNT value on done: 51496.0 [2023-02-25 13:15:38,404][36140] Sum rewards: 44.322, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.702', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.064', 'AMMO4': '0.145', 'weapon5': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.328', 'AMMO3': '0.334', 'WEAPON3': '1.900', 'HITCOUNT': '2.810', 'weapon3': '3.102', 'DAMAGECOUNT': '13.875', 'FRAGCOUNT': '43.500'} [2023-02-25 13:15:38,460][36154] DAMAGECOUNT value on done: 54440.0 [2023-02-25 13:15:38,460][36154] Sum rewards: 42.441, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.118', 'AMMO5': '0.007', 'AMMO2': '0.051', 'weapon5': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'AMMO4': '0.256', 'weapon2': '0.416', 'weapon4': '0.464', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.680', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.564', 'FRAGCOUNT': '41.000'} [2023-02-25 13:15:38,550][36157] DAMAGECOUNT value on done: 53171.0 [2023-02-25 13:15:38,551][36157] Sum rewards: 39.051, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.710', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.047', 'AMMO3': '0.135', 'weapon5': '0.224', 'AMMO4': '0.237', 'WEAPON5': '0.500', 'weapon2': '0.662', 'WEAPON4': '0.700', 'WEAPON3': '0.850', 'weapon4': '1.010', 'weapon3': '1.690', 'HITCOUNT': '2.390', 'DAMAGECOUNT': '10.794', 'FRAGCOUNT': '37.000'} [2023-02-25 13:15:38,557][36141] DAMAGECOUNT value on done: 53460.0 [2023-02-25 13:15:38,558][36141] Sum rewards: 54.492, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.614', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO3': '0.146', 'AMMO4': '0.168', 'weapon2': '0.204', 'weapon5': '0.222', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.682', 'WEAPON3': '0.900', 'weapon3': '2.650', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.076', 'FRAGCOUNT': '46.000'} [2023-02-25 13:15:38,604][36142] DAMAGECOUNT value on done: 55046.0 [2023-02-25 13:15:38,604][36142] Sum rewards: 58.438, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.190', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO3': '0.157', 'AMMO4': '0.158', 'weapon5': '0.182', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.582', 'weapon4': '0.662', 'WEAPON3': '0.900', 'weapon3': '2.326', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.404', 'FRAGCOUNT': '49.000'} [2023-02-25 13:15:38,720][36141] DAMAGECOUNT value on done: 54606.0 [2023-02-25 13:15:38,720][36141] Sum rewards: 51.603, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.566', 'AMMO5': '0.017', 'AMMO2': '0.039', 'AMMO4': '0.194', 'weapon5': '0.198', 'AMMO3': '0.235', 'weapon2': '0.272', 'WEAPON4': '0.300', 'weapon4': '0.374', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.860', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.310', 'FRAGCOUNT': '45.500'} [2023-02-25 13:15:38,893][36157] DAMAGECOUNT value on done: 49745.0 [2023-02-25 13:15:38,894][36157] Sum rewards: 35.570, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.372', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'weapon5': '0.164', 'AMMO4': '0.164', 'AMMO3': '0.220', 'WEAPON4': '0.400', 'weapon4': '0.476', 'WEAPON5': '0.500', 'weapon2': '0.580', 'WEAPON3': '1.200', 'HITCOUNT': '2.230', 'weapon3': '2.414', 'DAMAGECOUNT': '10.521', 'FRAGCOUNT': '33.000'} [2023-02-25 13:15:38,942][36142] DAMAGECOUNT value on done: 54129.0 [2023-02-25 13:15:38,943][36142] Sum rewards: 51.127, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.477', 'AMMO5': '0.015', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.146', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.404', 'weapon2': '0.678', 'WEAPON3': '1.250', 'weapon3': '2.556', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.164', 'FRAGCOUNT': '46.000'} [2023-02-25 13:15:39,058][36141] DAMAGECOUNT value on done: 49624.0 [2023-02-25 13:15:39,058][36141] Sum rewards: 52.166, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.302', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon5': '0.022', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'weapon4': '0.064', 'WEAPON5': '0.100', 'weapon2': '0.212', 'AMMO3': '0.256', 'WEAPON3': '1.500', 'HITCOUNT': '2.900', 'weapon3': '3.478', 'DAMAGECOUNT': '13.599', 'FRAGCOUNT': '47.000'} [2023-02-25 13:15:39,269][36142] DAMAGECOUNT value on done: 52236.0 [2023-02-25 13:15:39,269][36142] Sum rewards: 45.210, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.755', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.056', 'AMMO3': '0.167', 'weapon5': '0.236', 'AMMO4': '0.279', 'weapon4': '0.338', 'WEAPON5': '0.450', 'weapon2': '0.466', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.670', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.521', 'FRAGCOUNT': '40.500'} [2023-02-25 13:15:39,344][36138] Updated weights for policy 0, policy_version 37413 (0.0010) [2023-02-25 13:15:39,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13175.5, 300 sec: 12705.6). Total num frames: 153247744. Throughput: 0: 3267.3. Samples: 803020. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:15:39,729][36114] Avg episode reward: [(0, '49.712')] [2023-02-25 13:15:42,444][36138] Updated weights for policy 0, policy_version 37423 (0.0010) [2023-02-25 13:15:44,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13107.2, 300 sec: 12713.4). Total num frames: 153313280. Throughput: 0: 3264.6. Samples: 822748. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:15:44,730][36114] Avg episode reward: [(0, '49.712')] [2023-02-25 13:15:45,642][36138] Updated weights for policy 0, policy_version 37433 (0.0010) [2023-02-25 13:15:47,455][36154] Large shaping reward -2.503 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('weapon5', 0.002)] [2023-02-25 13:15:48,971][36138] Updated weights for policy 0, policy_version 37443 (0.0010) [2023-02-25 13:15:49,729][36114] Fps is (10 sec: 12697.4, 60 sec: 13038.9, 300 sec: 12705.3). Total num frames: 153374720. Throughput: 0: 3239.5. Samples: 841564. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:15:49,730][36114] Avg episode reward: [(0, '49.712')] [2023-02-25 13:15:50,964][36141] Large shaping reward -2.548 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('weapon5', 0.002)] [2023-02-25 13:15:52,269][36138] Updated weights for policy 0, policy_version 37453 (0.0010) [2023-02-25 13:15:54,729][36114] Fps is (10 sec: 12288.2, 60 sec: 12970.7, 300 sec: 12697.6). Total num frames: 153436160. Throughput: 0: 3221.1. Samples: 850666. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:15:54,729][36114] Avg episode reward: [(0, '49.712')] [2023-02-25 13:15:55,500][36138] Updated weights for policy 0, policy_version 37463 (0.0009) [2023-02-25 13:15:57,248][36155] DAMAGECOUNT value on done: 55591.0 [2023-02-25 13:15:57,248][36155] Sum rewards: 48.268, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.788', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon4': '0.124', 'WEAPON4': '0.150', 'weapon5': '0.150', 'weapon2': '0.198', 'WEAPON5': '0.250', 'AMMO3': '0.267', 'WEAPON3': '1.600', 'HITCOUNT': '2.630', 'weapon3': '3.280', 'DAMAGECOUNT': '14.052', 'FRAGCOUNT': '44.000'} [2023-02-25 13:15:57,569][36139] DAMAGECOUNT value on done: 56062.0 [2023-02-25 13:15:57,569][36139] Sum rewards: 36.884, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.662', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.118', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon4': '0.352', 'weapon2': '0.884', 'WEAPON3': '1.200', 'HITCOUNT': '2.160', 'weapon3': '2.474', 'DAMAGECOUNT': '10.083', 'FRAGCOUNT': '35.000'} [2023-02-25 13:15:57,585][36155] DAMAGECOUNT value on done: 58024.0 [2023-02-25 13:15:57,586][36155] Sum rewards: 36.784, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.960', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.064', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'weapon4': '0.246', 'weapon2': '0.372', 'WEAPON3': '1.100', 'HITCOUNT': '2.380', 'weapon3': '3.160', 'DAMAGECOUNT': '10.368', 'FRAGCOUNT': '31.500'} [2023-02-25 13:15:57,818][36155] DAMAGECOUNT value on done: 55765.0 [2023-02-25 13:15:57,818][36155] Sum rewards: 57.626, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.896', 'AMMO2': '0.016', 'weapon4': '0.018', 'AMMO5': '0.021', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'weapon5': '0.142', 'AMMO3': '0.273', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.550', 'HITCOUNT': '2.830', 'weapon3': '3.248', 'DAMAGECOUNT': '14.361', 'FRAGCOUNT': '52.000'} [2023-02-25 13:15:57,927][36139] DAMAGECOUNT value on done: 58029.0 [2023-02-25 13:15:57,927][36139] Sum rewards: 59.357, reward structure: {'DEATHCOUNT': '-10.500', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.149', 'weapon4': '0.150', 'HEALTH': '0.195', 'weapon2': '0.292', 'WEAPON3': '0.950', 'weapon3': '3.274', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.177', 'FRAGCOUNT': '46.000'} [2023-02-25 13:15:58,178][36155] DAMAGECOUNT value on done: 57219.0 [2023-02-25 13:15:58,178][36155] Sum rewards: 51.647, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.031', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.170', 'WEAPON4': '0.300', 'HEALTH': '0.310', 'weapon4': '0.340', 'weapon2': '0.440', 'WEAPON3': '0.900', 'HITCOUNT': '2.610', 'weapon3': '2.840', 'DAMAGECOUNT': '12.768', 'FRAGCOUNT': '44.000'} [2023-02-25 13:15:58,262][36139] DAMAGECOUNT value on done: 59608.0 [2023-02-25 13:15:58,262][36139] Sum rewards: 45.325, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.304', 'AMMO2': '0.004', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO4': '0.018', 'weapon5': '0.074', 'WEAPON4': '0.100', 'weapon2': '0.144', 'weapon4': '0.206', 'WEAPON5': '0.250', 'AMMO3': '0.307', 'WEAPON3': '1.800', 'HITCOUNT': '2.680', 'weapon3': '3.360', 'DAMAGECOUNT': '13.170', 'FRAGCOUNT': '43.000'} [2023-02-25 13:15:58,562][36139] DAMAGECOUNT value on done: 55094.0 [2023-02-25 13:15:58,562][36139] Sum rewards: 49.596, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.836', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon5': '0.158', 'AMMO3': '0.168', 'AMMO4': '0.194', 'weapon2': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.628', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.714', 'FRAGCOUNT': '42.000'} [2023-02-25 13:15:58,951][36156] DAMAGECOUNT value on done: 56225.0 [2023-02-25 13:15:58,952][36156] Sum rewards: 38.975, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.711', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.028', 'AMMO2': '0.037', 'AMMO4': '0.184', 'weapon5': '0.218', 'AMMO3': '0.219', 'weapon2': '0.236', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'weapon4': '0.626', 'WEAPON3': '1.200', 'HITCOUNT': '2.520', 'weapon3': '2.534', 'DAMAGECOUNT': '11.520', 'FRAGCOUNT': '36.000'} [2023-02-25 13:15:58,965][36138] Updated weights for policy 0, policy_version 37473 (0.0009) [2023-02-25 13:15:58,987][36154] DAMAGECOUNT value on done: 55402.0 [2023-02-25 13:15:58,987][36154] Sum rewards: 53.479, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.895', 'AMMO5': '0.017', 'AMMO2': '0.067', 'AMMO3': '0.153', 'weapon5': '0.238', 'AMMO4': '0.335', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'weapon2': '0.624', 'WEAPON3': '0.850', 'weapon4': '0.976', 'weapon3': '1.852', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.891', 'FRAGCOUNT': '47.000'} [2023-02-25 13:15:59,106][36140] DAMAGECOUNT value on done: 57791.0 [2023-02-25 13:15:59,106][36140] Sum rewards: 57.545, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.095', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.124', 'weapon4': '0.136', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'WEAPON5': '0.250', 'weapon2': '0.448', 'WEAPON3': '1.450', 'weapon3': '3.058', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.516', 'FRAGCOUNT': '51.000'} [2023-02-25 13:15:59,275][36156] DAMAGECOUNT value on done: 59741.0 [2023-02-25 13:15:59,276][36156] Sum rewards: 41.981, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.220', 'AMMO5': '0.017', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon4': '0.176', 'AMMO3': '0.215', 'weapon5': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.412', 'WEAPON3': '1.250', 'HITCOUNT': '2.310', 'weapon3': '2.900', 'DAMAGECOUNT': '11.544', 'FRAGCOUNT': '38.500'} [2023-02-25 13:15:59,326][36154] DAMAGECOUNT value on done: 55544.0 [2023-02-25 13:15:59,326][36154] Sum rewards: 39.967, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.030', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.023', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.187', 'weapon2': '0.342', 'WEAPON4': '0.400', 'weapon4': '0.582', 'WEAPON3': '1.100', 'HITCOUNT': '2.540', 'weapon3': '2.764', 'DAMAGECOUNT': '11.532', 'FRAGCOUNT': '35.000'} [2023-02-25 13:15:59,345][36156] DAMAGECOUNT value on done: 55552.0 [2023-02-25 13:15:59,345][36156] Sum rewards: 63.757, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.490', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon4': '0.092', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon2': '0.370', 'WEAPON3': '1.150', 'HITCOUNT': '3.020', 'weapon3': '3.250', 'DAMAGECOUNT': '15.705', 'FRAGCOUNT': '53.000'} [2023-02-25 13:15:59,442][36140] DAMAGECOUNT value on done: 56138.0 [2023-02-25 13:15:59,442][36140] Sum rewards: 62.192, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.514', 'AMMO5': '0.009', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'WEAPON5': '0.300', 'weapon4': '0.320', 'weapon2': '0.330', 'WEAPON3': '1.150', 'weapon3': '2.940', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.282', 'FRAGCOUNT': '53.000'} [2023-02-25 13:15:59,508][36157] DAMAGECOUNT value on done: 57247.0 [2023-02-25 13:15:59,508][36157] Sum rewards: 34.862, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.120', 'AMMO5': '0.013', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.236', 'WEAPON4': '0.250', 'AMMO3': '0.278', 'weapon4': '0.332', 'weapon2': '0.382', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '2.370', 'weapon3': '2.626', 'DAMAGECOUNT': '11.103', 'FRAGCOUNT': '35.500'} [2023-02-25 13:15:59,557][36154] DAMAGECOUNT value on done: 59533.0 [2023-02-25 13:15:59,558][36154] Sum rewards: 39.613, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.030', 'AMMO5': '0.018', 'AMMO2': '0.053', 'weapon5': '0.166', 'AMMO3': '0.194', 'AMMO4': '0.265', 'WEAPON5': '0.400', 'weapon4': '0.512', 'weapon2': '0.522', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'HITCOUNT': '2.540', 'weapon3': '2.554', 'DAMAGECOUNT': '12.168', 'FRAGCOUNT': '36.500'} [2023-02-25 13:15:59,648][36141] DAMAGECOUNT value on done: 56001.0 [2023-02-25 13:15:59,648][36141] Sum rewards: 39.981, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.222', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon5': '0.312', 'weapon2': '0.516', 'weapon4': '0.532', 'WEAPON3': '1.300', 'HITCOUNT': '2.400', 'weapon3': '2.424', 'DAMAGECOUNT': '10.818', 'FRAGCOUNT': '36.000'} [2023-02-25 13:15:59,664][36156] DAMAGECOUNT value on done: 55414.0 [2023-02-25 13:15:59,664][36156] Sum rewards: 54.180, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.280', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'weapon4': '0.134', 'AMMO3': '0.186', 'weapon2': '0.530', 'WEAPON3': '1.200', 'HITCOUNT': '3.000', 'weapon3': '3.158', 'DAMAGECOUNT': '13.224', 'FRAGCOUNT': '46.000'} [2023-02-25 13:15:59,688][36142] DAMAGECOUNT value on done: 54526.0 [2023-02-25 13:15:59,689][36142] Sum rewards: 39.716, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.165', 'AMMO5': '0.017', 'AMMO2': '0.029', 'AMMO4': '0.144', 'AMMO3': '0.179', 'weapon5': '0.324', 'weapon2': '0.446', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'weapon4': '1.006', 'weapon3': '1.698', 'HITCOUNT': '2.150', 'DAMAGECOUNT': '9.888', 'FRAGCOUNT': '36.000'} [2023-02-25 13:15:59,729][36114] Fps is (10 sec: 12288.0, 60 sec: 12902.4, 300 sec: 12690.2). Total num frames: 153497600. Throughput: 0: 3186.1. Samples: 868950. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:15:59,730][36114] Avg episode reward: [(0, '49.492')] [2023-02-25 13:15:59,739][36140] DAMAGECOUNT value on done: 58667.0 [2023-02-25 13:15:59,739][36140] Sum rewards: 50.011, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.617', 'AMMO5': '0.011', 'AMMO2': '0.035', 'AMMO4': '0.173', 'AMMO3': '0.183', 'weapon2': '0.194', 'weapon5': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.328', 'WEAPON3': '1.200', 'HITCOUNT': '2.750', 'weapon3': '3.054', 'DAMAGECOUNT': '13.404', 'FRAGCOUNT': '44.000'} [2023-02-25 13:15:59,825][36157] DAMAGECOUNT value on done: 55744.0 [2023-02-25 13:15:59,826][36157] Sum rewards: 54.580, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.550', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.158', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'weapon4': '0.464', 'weapon2': '0.476', 'WEAPON3': '1.050', 'weapon3': '2.782', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.610', 'FRAGCOUNT': '45.000'} [2023-02-25 13:15:59,862][36154] DAMAGECOUNT value on done: 58761.0 [2023-02-25 13:15:59,863][36154] Sum rewards: 51.551, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.732', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon2': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.201', 'weapon5': '0.240', 'weapon4': '0.298', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.650', 'weapon3': '2.906', 'DAMAGECOUNT': '12.963', 'FRAGCOUNT': '44.000'} [2023-02-25 13:15:59,965][36141] DAMAGECOUNT value on done: 56146.0 [2023-02-25 13:15:59,965][36141] Sum rewards: 27.075, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.988', 'AMMO5': '0.019', 'AMMO2': '0.031', 'weapon7': '0.054', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.148', 'AMMO4': '0.153', 'WEAPON7': '0.200', 'weapon5': '0.268', 'weapon2': '0.274', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '0.850', 'weapon4': '1.448', 'weapon3': '1.500', 'HITCOUNT': '1.920', 'DAMAGECOUNT': '8.058', 'FRAGCOUNT': '24.000'} [2023-02-25 13:16:00,011][36142] DAMAGECOUNT value on done: 59307.0 [2023-02-25 13:16:00,011][36142] Sum rewards: 44.318, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.196', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon2': '0.202', 'AMMO3': '0.204', 'weapon5': '0.240', 'AMMO4': '0.245', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon4': '1.034', 'WEAPON3': '1.300', 'weapon3': '2.216', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.783', 'FRAGCOUNT': '40.500'} [2023-02-25 13:16:00,060][36140] DAMAGECOUNT value on done: 56243.0 [2023-02-25 13:16:00,060][36140] Sum rewards: 57.463, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.258', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.130', 'AMMO3': '0.250', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.256', 'weapon4': '0.424', 'WEAPON3': '1.450', 'weapon3': '2.914', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.241', 'FRAGCOUNT': '52.000'} [2023-02-25 13:16:00,070][36141] DAMAGECOUNT value on done: 59229.0 [2023-02-25 13:16:00,070][36141] Sum rewards: 55.528, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.248', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON4': '0.100', 'AMMO3': '0.189', 'weapon4': '0.198', 'weapon2': '0.476', 'WEAPON3': '1.250', 'HITCOUNT': '3.050', 'weapon3': '3.110', 'DAMAGECOUNT': '13.869', 'FRAGCOUNT': '46.000'} [2023-02-25 13:16:00,148][36157] DAMAGECOUNT value on done: 57498.0 [2023-02-25 13:16:00,149][36157] Sum rewards: 48.593, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.417', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon5': '0.204', 'AMMO3': '0.249', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.382', 'weapon4': '0.398', 'WEAPON3': '1.450', 'weapon3': '2.736', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.981', 'FRAGCOUNT': '44.000'} [2023-02-25 13:16:00,337][36142] DAMAGECOUNT value on done: 57514.0 [2023-02-25 13:16:00,337][36142] Sum rewards: 35.921, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.132', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.044', 'AMMO3': '0.175', 'AMMO4': '0.220', 'WEAPON5': '0.250', 'weapon5': '0.264', 'weapon2': '0.488', 'WEAPON4': '0.500', 'weapon4': '0.672', 'WEAPON3': '1.050', 'HITCOUNT': '2.190', 'weapon3': '2.284', 'DAMAGECOUNT': '10.155', 'FRAGCOUNT': '34.000'} [2023-02-25 13:16:00,388][36141] DAMAGECOUNT value on done: 54139.0 [2023-02-25 13:16:00,388][36141] Sum rewards: 41.668, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.900', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon5': '0.174', 'AMMO3': '0.202', 'AMMO4': '0.229', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.428', 'weapon2': '0.548', 'WEAPON3': '1.300', 'weapon3': '2.602', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.545', 'FRAGCOUNT': '36.000'} [2023-02-25 13:16:00,471][36157] DAMAGECOUNT value on done: 53648.0 [2023-02-25 13:16:00,471][36157] Sum rewards: 39.137, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.380', 'AMMO5': '0.003', 'AMMO2': '0.045', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.208', 'AMMO4': '0.223', 'weapon4': '0.432', 'WEAPON4': '0.450', 'ARMOR': '0.466', 'weapon2': '0.682', 'WEAPON3': '1.250', 'HITCOUNT': '2.580', 'weapon3': '2.616', 'DAMAGECOUNT': '11.709', 'FRAGCOUNT': '35.000'} [2023-02-25 13:16:00,684][36142] DAMAGECOUNT value on done: 56400.0 [2023-02-25 13:16:00,684][36142] Sum rewards: 47.341, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.046', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.124', 'AMMO4': '0.157', 'AMMO3': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.354', 'weapon4': '0.438', 'WEAPON3': '1.550', 'weapon3': '2.836', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '12.492', 'FRAGCOUNT': '46.000'} [2023-02-25 13:16:02,175][36138] Updated weights for policy 0, policy_version 37483 (0.0010) [2023-02-25 13:16:04,262][36141] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:16:04,729][36114] Fps is (10 sec: 12287.9, 60 sec: 12765.9, 300 sec: 12683.0). Total num frames: 153559040. Throughput: 0: 3173.6. Samples: 887942. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:16:04,730][36114] Avg episode reward: [(0, '49.134')] [2023-02-25 13:16:05,442][36138] Updated weights for policy 0, policy_version 37493 (0.0010) [2023-02-25 13:16:08,453][36138] Updated weights for policy 0, policy_version 37503 (0.0009) [2023-02-25 13:16:09,729][36114] Fps is (10 sec: 13107.2, 60 sec: 12834.1, 300 sec: 12704.8). Total num frames: 153628672. Throughput: 0: 3181.2. Samples: 898064. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:16:09,730][36114] Avg episode reward: [(0, '49.134')] [2023-02-25 13:16:11,505][36138] Updated weights for policy 0, policy_version 37513 (0.0009) [2023-02-25 13:16:14,579][36138] Updated weights for policy 0, policy_version 37523 (0.0009) [2023-02-25 13:16:14,729][36114] Fps is (10 sec: 13516.6, 60 sec: 12834.1, 300 sec: 12711.7). Total num frames: 153694208. Throughput: 0: 3212.3. Samples: 918232. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:16:14,730][36114] Avg episode reward: [(0, '49.134')] [2023-02-25 13:16:17,525][36155] DAMAGECOUNT value on done: 59776.0 [2023-02-25 13:16:17,525][36155] Sum rewards: 48.273, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.333', 'weapon5': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO4': '0.149', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.302', 'weapon2': '0.560', 'WEAPON3': '1.200', 'HITCOUNT': '2.950', 'weapon3': '2.960', 'DAMAGECOUNT': '12.555', 'FRAGCOUNT': '42.000'} [2023-02-25 13:16:17,649][36138] Updated weights for policy 0, policy_version 37533 (0.0009) [2023-02-25 13:16:17,832][36155] DAMAGECOUNT value on done: 62486.0 [2023-02-25 13:16:17,833][36155] Sum rewards: 51.299, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.087', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.228', 'weapon4': '0.280', 'weapon2': '0.470', 'WEAPON3': '1.400', 'HITCOUNT': '2.840', 'weapon3': '2.992', 'DAMAGECOUNT': '13.386', 'FRAGCOUNT': '45.000'} [2023-02-25 13:16:18,084][36155] DAMAGECOUNT value on done: 60026.0 [2023-02-25 13:16:18,085][36155] Sum rewards: 55.003, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.046', 'WEAPON5': '0.050', 'HEALTH': '0.110', 'AMMO4': '0.120', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'weapon2': '0.462', 'weapon4': '0.528', 'WEAPON3': '0.850', 'HITCOUNT': '2.750', 'weapon3': '2.768', 'DAMAGECOUNT': '12.783', 'FRAGCOUNT': '45.000'} [2023-02-25 13:16:18,133][36139] DAMAGECOUNT value on done: 60832.0 [2023-02-25 13:16:18,134][36139] Sum rewards: 54.006, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.344', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.177', 'weapon2': '0.272', 'weapon5': '0.348', 'WEAPON4': '0.400', 'weapon4': '0.406', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.684', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.310', 'FRAGCOUNT': '45.500'} [2023-02-25 13:16:18,419][36155] DAMAGECOUNT value on done: 61394.0 [2023-02-25 13:16:18,419][36155] Sum rewards: 47.418, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.070', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.102', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon4': '0.312', 'weapon2': '0.654', 'WEAPON3': '1.350', 'HITCOUNT': '2.580', 'weapon3': '2.730', 'DAMAGECOUNT': '12.525', 'FRAGCOUNT': '42.000'} [2023-02-25 13:16:18,438][36139] DAMAGECOUNT value on done: 62825.0 [2023-02-25 13:16:18,439][36139] Sum rewards: 58.295, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.138', 'AMMO5': '0.015', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.174', 'weapon5': '0.232', 'WEAPON4': '0.300', 'weapon4': '0.332', 'WEAPON5': '0.400', 'weapon2': '0.690', 'WEAPON3': '1.100', 'weapon3': '2.502', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.388', 'FRAGCOUNT': '50.000'} [2023-02-25 13:16:18,759][36139] DAMAGECOUNT value on done: 64160.0 [2023-02-25 13:16:18,759][36139] Sum rewards: 51.970, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.130', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon4': '0.162', 'weapon5': '0.198', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.340', 'WEAPON3': '1.250', 'weapon3': '3.028', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.656', 'FRAGCOUNT': '45.500'} [2023-02-25 13:16:19,066][36139] DAMAGECOUNT value on done: 60059.0 [2023-02-25 13:16:19,066][36139] Sum rewards: 55.701, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.734', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.054', 'AMMO3': '0.167', 'weapon5': '0.216', 'AMMO4': '0.271', 'weapon2': '0.420', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '0.950', 'weapon4': '1.118', 'weapon3': '1.938', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.895', 'FRAGCOUNT': '48.000'} [2023-02-25 13:16:19,356][36156] DAMAGECOUNT value on done: 60902.0 [2023-02-25 13:16:19,356][36156] Sum rewards: 54.012, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.522', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.108', 'weapon5': '0.110', 'AMMO4': '0.148', 'weapon2': '0.178', 'WEAPON5': '0.250', 'AMMO3': '0.262', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '2.810', 'weapon3': '3.344', 'DAMAGECOUNT': '14.031', 'FRAGCOUNT': '50.500'} [2023-02-25 13:16:19,369][36154] DAMAGECOUNT value on done: 59983.0 [2023-02-25 13:16:19,369][36154] Sum rewards: 57.571, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.610', 'AMMO5': '0.017', 'AMMO2': '0.027', 'AMMO4': '0.132', 'weapon5': '0.142', 'AMMO3': '0.156', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.594', 'weapon2': '0.684', 'WEAPON3': '0.850', 'weapon3': '2.316', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.743', 'FRAGCOUNT': '48.000'} [2023-02-25 13:16:19,493][36140] DAMAGECOUNT value on done: 61385.0 [2023-02-25 13:16:19,494][36140] Sum rewards: 41.782, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.483', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.066', 'AMMO4': '0.134', 'AMMO3': '0.136', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.456', 'weapon4': '0.678', 'WEAPON3': '0.850', 'weapon3': '2.626', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '10.782', 'FRAGCOUNT': '34.000'} [2023-02-25 13:16:19,669][36156] DAMAGECOUNT value on done: 64089.0 [2023-02-25 13:16:19,670][36156] Sum rewards: 43.722, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.750', 'ARMOR': '0.016', 'AMMO5': '0.018', 'AMMO2': '0.056', 'AMMO3': '0.182', 'AMMO4': '0.278', 'weapon2': '0.278', 'weapon5': '0.302', 'WEAPON5': '0.550', 'weapon4': '0.694', 'WEAPON4': '0.750', 'WEAPON3': '1.100', 'weapon3': '2.384', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '13.044', 'FRAGCOUNT': '40.000'} [2023-02-25 13:16:19,682][36154] DAMAGECOUNT value on done: 60838.0 [2023-02-25 13:16:19,683][36154] Sum rewards: 61.424, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.314', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.044', 'AMMO4': '0.067', 'weapon4': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.250', 'weapon2': '0.426', 'WEAPON3': '1.600', 'weapon3': '3.182', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.882', 'FRAGCOUNT': '53.000'} [2023-02-25 13:16:19,697][36156] DAMAGECOUNT value on done: 59528.0 [2023-02-25 13:16:19,697][36156] Sum rewards: 40.058, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.841', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon5': '0.240', 'weapon2': '0.366', 'weapon4': '0.594', 'WEAPON3': '1.300', 'weapon3': '2.564', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '11.928', 'FRAGCOUNT': '35.000'} [2023-02-25 13:16:19,729][36114] Fps is (10 sec: 13107.2, 60 sec: 12834.1, 300 sec: 12718.4). Total num frames: 153759744. Throughput: 0: 3224.4. Samples: 938284. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:16:19,729][36114] Avg episode reward: [(0, '49.268')] [2023-02-25 13:16:19,844][36140] DAMAGECOUNT value on done: 60473.0 [2023-02-25 13:16:19,844][36140] Sum rewards: 45.544, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.870', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.154', 'AMMO3': '0.217', 'weapon2': '0.286', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.616', 'WEAPON3': '1.250', 'weapon3': '2.636', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '13.005', 'FRAGCOUNT': '40.500'} [2023-02-25 13:16:19,870][36157] DAMAGECOUNT value on done: 62063.0 [2023-02-25 13:16:19,871][36157] Sum rewards: 55.689, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.222', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.037', 'AMMO4': '0.186', 'weapon2': '0.212', 'AMMO3': '0.270', 'weapon5': '0.300', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon4': '0.722', 'WEAPON3': '1.500', 'weapon3': '2.352', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '14.448', 'FRAGCOUNT': '52.000'} [2023-02-25 13:16:19,907][36141] DAMAGECOUNT value on done: 59985.0 [2023-02-25 13:16:19,907][36141] Sum rewards: 38.698, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.418', 'ARMOR': '0.004', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.040', 'AMMO3': '0.116', 'AMMO4': '0.202', 'weapon4': '0.358', 'weapon5': '0.366', 'weapon2': '0.504', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'weapon3': '2.436', 'HITCOUNT': '2.450', 'DAMAGECOUNT': '11.952', 'FRAGCOUNT': '32.000'} [2023-02-25 13:16:19,918][36154] DAMAGECOUNT value on done: 63814.0 [2023-02-25 13:16:19,919][36154] Sum rewards: 46.214, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.235', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.134', 'AMMO4': '0.135', 'AMMO3': '0.197', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.370', 'weapon2': '0.436', 'WEAPON3': '1.300', 'weapon3': '2.812', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.843', 'FRAGCOUNT': '42.000'} [2023-02-25 13:16:20,022][36156] DAMAGECOUNT value on done: 60030.0 [2023-02-25 13:16:20,023][36156] Sum rewards: 50.084, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.941', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.130', 'weapon4': '0.174', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'AMMO4': '0.215', 'WEAPON4': '0.300', 'weapon2': '0.626', 'WEAPON3': '1.150', 'HITCOUNT': '2.820', 'weapon3': '2.830', 'DAMAGECOUNT': '13.848', 'FRAGCOUNT': '43.000'} [2023-02-25 13:16:20,073][36142] DAMAGECOUNT value on done: 58342.0 [2023-02-25 13:16:20,073][36142] Sum rewards: 38.742, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.798', 'AMMO5': '0.005', 'AMMO2': '0.036', 'WEAPON5': '0.150', 'weapon2': '0.170', 'weapon5': '0.180', 'AMMO4': '0.182', 'AMMO3': '0.244', 'WEAPON4': '0.350', 'weapon4': '0.622', 'WEAPON3': '1.400', 'HITCOUNT': '2.440', 'weapon3': '2.812', 'DAMAGECOUNT': '11.448', 'FRAGCOUNT': '37.000'} [2023-02-25 13:16:20,134][36140] DAMAGECOUNT value on done: 63628.0 [2023-02-25 13:16:20,134][36140] Sum rewards: 52.312, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.812', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon5': '0.106', 'AMMO4': '0.131', 'weapon4': '0.146', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.336', 'WEAPON3': '1.200', 'HITCOUNT': '2.830', 'weapon3': '3.150', 'DAMAGECOUNT': '14.523', 'FRAGCOUNT': '45.000'} [2023-02-25 13:16:20,188][36157] DAMAGECOUNT value on done: 59335.0 [2023-02-25 13:16:20,189][36157] Sum rewards: 36.461, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.868', 'AMMO5': '0.022', 'AMMO2': '0.067', 'AMMO3': '0.171', 'weapon5': '0.190', 'AMMO4': '0.337', 'weapon2': '0.340', 'WEAPON5': '0.400', 'WEAPON4': '0.750', 'WEAPON3': '0.950', 'weapon4': '1.052', 'weapon3': '2.086', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '10.773', 'FRAGCOUNT': '35.000'} [2023-02-25 13:16:20,206][36141] DAMAGECOUNT value on done: 60451.0 [2023-02-25 13:16:20,207][36141] Sum rewards: 52.467, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.330', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'AMMO3': '0.206', 'weapon2': '0.342', 'weapon4': '0.382', 'WEAPON3': '1.150', 'weapon3': '2.780', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.915', 'FRAGCOUNT': '46.000'} [2023-02-25 13:16:20,226][36154] DAMAGECOUNT value on done: 63868.0 [2023-02-25 13:16:20,226][36154] Sum rewards: 61.729, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.714', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.060', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.270', 'weapon4': '0.548', 'WEAPON3': '1.200', 'weapon3': '2.940', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.321', 'FRAGCOUNT': '52.000'} [2023-02-25 13:16:20,358][36141] DAMAGECOUNT value on done: 63576.0 [2023-02-25 13:16:20,359][36141] Sum rewards: 49.526, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.796', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO4': '0.022', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.144', 'AMMO3': '0.214', 'WEAPON3': '1.350', 'HITCOUNT': '2.470', 'weapon3': '3.664', 'DAMAGECOUNT': '13.041', 'FRAGCOUNT': '43.000'} [2023-02-25 13:16:20,378][36142] DAMAGECOUNT value on done: 63713.0 [2023-02-25 13:16:20,379][36142] Sum rewards: 49.680, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.284', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.036', 'weapon5': '0.058', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'weapon4': '0.316', 'weapon2': '0.514', 'WEAPON3': '1.350', 'weapon3': '2.814', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.218', 'FRAGCOUNT': '46.000'} [2023-02-25 13:16:20,442][36140] DAMAGECOUNT value on done: 60112.0 [2023-02-25 13:16:20,442][36140] Sum rewards: 43.520, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.252', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.138', 'AMMO4': '0.141', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon2': '0.218', 'WEAPON5': '0.250', 'weapon4': '0.354', 'WEAPON3': '1.250', 'HITCOUNT': '2.540', 'weapon3': '3.070', 'DAMAGECOUNT': '11.607', 'FRAGCOUNT': '39.000'} [2023-02-25 13:16:20,496][36157] DAMAGECOUNT value on done: 62989.0 [2023-02-25 13:16:20,497][36157] Sum rewards: 64.373, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.686', 'AMMO5': '0.009', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.148', 'weapon4': '0.188', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.428', 'WEAPON3': '1.300', 'weapon3': '2.986', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.473', 'FRAGCOUNT': '55.500'} [2023-02-25 13:16:20,682][36141] DAMAGECOUNT value on done: 58412.0 [2023-02-25 13:16:20,683][36141] Sum rewards: 51.553, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.476', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.110', 'AMMO4': '0.165', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.236', 'weapon4': '0.324', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.780', 'weapon3': '3.026', 'DAMAGECOUNT': '12.819', 'FRAGCOUNT': '47.000'} [2023-02-25 13:16:20,701][36138] Updated weights for policy 0, policy_version 37543 (0.0009) [2023-02-25 13:16:20,703][36142] DAMAGECOUNT value on done: 62295.0 [2023-02-25 13:16:20,704][36142] Sum rewards: 57.613, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.595', 'ARMOR': '0.004', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon5': '0.120', 'AMMO4': '0.138', 'weapon2': '0.226', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.526', 'WEAPON3': '1.450', 'weapon3': '2.850', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.343', 'FRAGCOUNT': '54.000'} [2023-02-25 13:16:20,801][36157] DAMAGECOUNT value on done: 58571.0 [2023-02-25 13:16:20,802][36157] Sum rewards: 60.196, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.607', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.126', 'AMMO4': '0.176', 'AMMO3': '0.184', 'weapon4': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.200', 'HITCOUNT': '3.110', 'weapon3': '3.120', 'DAMAGECOUNT': '14.454', 'FRAGCOUNT': '52.000'} [2023-02-25 13:16:21,004][36142] DAMAGECOUNT value on done: 60325.0 [2023-02-25 13:16:21,005][36142] Sum rewards: 45.625, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.310', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.066', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'weapon2': '0.432', 'weapon4': '0.516', 'WEAPON3': '1.050', 'HITCOUNT': '2.540', 'weapon3': '2.738', 'DAMAGECOUNT': '11.775', 'FRAGCOUNT': '38.000'} [2023-02-25 13:16:23,707][36138] Updated weights for policy 0, policy_version 37553 (0.0009) [2023-02-25 13:16:24,729][36114] Fps is (10 sec: 13516.9, 60 sec: 12902.4, 300 sec: 12898.9). Total num frames: 153829376. Throughput: 0: 3230.3. Samples: 948386. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:16:24,730][36114] Avg episode reward: [(0, '49.103')] [2023-02-25 13:16:25,858][36140] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:16:26,778][36138] Updated weights for policy 0, policy_version 37563 (0.0009) [2023-02-25 13:16:29,729][36114] Fps is (10 sec: 13516.7, 60 sec: 12970.7, 300 sec: 12912.8). Total num frames: 153894912. Throughput: 0: 3235.1. Samples: 968328. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:16:29,730][36114] Avg episode reward: [(0, '49.103')] [2023-02-25 13:16:29,832][36138] Updated weights for policy 0, policy_version 37573 (0.0010) [2023-02-25 13:16:33,045][36138] Updated weights for policy 0, policy_version 37583 (0.0009) [2023-02-25 13:16:34,729][36114] Fps is (10 sec: 13107.3, 60 sec: 12970.7, 300 sec: 12926.7). Total num frames: 153960448. Throughput: 0: 3252.5. Samples: 987928. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:16:34,730][36114] Avg episode reward: [(0, '49.103')] [2023-02-25 13:16:36,513][36138] Updated weights for policy 0, policy_version 37593 (0.0010) [2023-02-25 13:16:38,157][36155] DAMAGECOUNT value on done: 62897.0 [2023-02-25 13:16:38,158][36155] Sum rewards: 34.934, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.933', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon7': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.134', 'AMMO4': '0.145', 'AMMO3': '0.162', 'WEAPON7': '0.200', 'weapon2': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.892', 'WEAPON3': '0.950', 'weapon3': '2.126', 'HITCOUNT': '2.210', 'DAMAGECOUNT': '9.363', 'FRAGCOUNT': '32.000'} [2023-02-25 13:16:38,472][36155] DAMAGECOUNT value on done: 66646.0 [2023-02-25 13:16:38,472][36155] Sum rewards: 47.954, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.692', 'AMMO5': '0.003', 'AMMO2': '0.014', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon4': '0.272', 'weapon2': '0.640', 'WEAPON3': '1.100', 'HITCOUNT': '2.610', 'weapon3': '2.878', 'DAMAGECOUNT': '12.480', 'FRAGCOUNT': '42.000'} [2023-02-25 13:16:38,671][36155] DAMAGECOUNT value on done: 64085.0 [2023-02-25 13:16:38,671][36155] Sum rewards: 46.843, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.940', 'AMMO5': '0.014', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon5': '0.162', 'weapon4': '0.212', 'AMMO3': '0.213', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.550', 'weapon3': '3.020', 'DAMAGECOUNT': '12.177', 'FRAGCOUNT': '44.000'} [2023-02-25 13:16:38,720][36139] DAMAGECOUNT value on done: 65845.0 [2023-02-25 13:16:38,721][36139] Sum rewards: 55.033, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.023', 'AMMO5': '0.016', 'AMMO2': '0.049', 'AMMO3': '0.172', 'AMMO4': '0.243', 'weapon5': '0.324', 'weapon2': '0.406', 'WEAPON5': '0.500', 'weapon4': '0.566', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.390', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '49.000'} [2023-02-25 13:16:38,974][36155] DAMAGECOUNT value on done: 65174.0 [2023-02-25 13:16:38,974][36155] Sum rewards: 44.861, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.774', 'AMMO2': '0.005', 'AMMO4': '0.026', 'ARMOR': '0.036', 'AMMO3': '0.211', 'weapon2': '0.668', 'WEAPON3': '1.200', 'HITCOUNT': '2.360', 'weapon3': '2.788', 'DAMAGECOUNT': '11.340', 'FRAGCOUNT': '39.000'} [2023-02-25 13:16:39,038][36139] DAMAGECOUNT value on done: 67432.0 [2023-02-25 13:16:39,039][36139] Sum rewards: 50.619, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.472', 'AMMO5': '0.016', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.208', 'weapon2': '0.228', 'WEAPON4': '0.250', 'AMMO3': '0.252', 'weapon4': '0.316', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '2.820', 'weapon3': '2.980', 'DAMAGECOUNT': '13.821', 'FRAGCOUNT': '48.000'} [2023-02-25 13:16:39,338][36139] DAMAGECOUNT value on done: 69423.0 [2023-02-25 13:16:39,338][36139] Sum rewards: 61.954, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.445', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.099', 'AMMO3': '0.180', 'weapon2': '0.188', 'weapon5': '0.188', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.804', 'WEAPON3': '1.100', 'weapon3': '2.476', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '52.000'} [2023-02-25 13:16:39,632][36138] Updated weights for policy 0, policy_version 37603 (0.0010) [2023-02-25 13:16:39,677][36139] DAMAGECOUNT value on done: 64641.0 [2023-02-25 13:16:39,677][36139] Sum rewards: 49.525, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.695', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.054', 'AMMO4': '0.058', 'weapon4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon2': '0.366', 'WEAPON3': '1.450', 'HITCOUNT': '2.920', 'weapon3': '3.210', 'DAMAGECOUNT': '13.746', 'FRAGCOUNT': '44.000'} [2023-02-25 13:16:39,729][36114] Fps is (10 sec: 12697.6, 60 sec: 12902.4, 300 sec: 12912.8). Total num frames: 154021888. Throughput: 0: 3242.3. Samples: 996572. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:16:39,730][36114] Avg episode reward: [(0, '48.769')] [2023-02-25 13:16:40,304][36156] DAMAGECOUNT value on done: 65905.0 [2023-02-25 13:16:40,305][36156] Sum rewards: 54.313, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.196', 'AMMO2': '0.003', 'AMMO5': '0.009', 'AMMO4': '0.016', 'WEAPON4': '0.050', 'weapon4': '0.130', 'weapon5': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.432', 'WEAPON3': '1.250', 'HITCOUNT': '2.980', 'weapon3': '3.076', 'DAMAGECOUNT': '15.009', 'FRAGCOUNT': '45.500'} [2023-02-25 13:16:40,326][36154] DAMAGECOUNT value on done: 66060.0 [2023-02-25 13:16:40,326][36154] Sum rewards: 67.751, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.132', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.036', 'AMMO4': '0.179', 'AMMO3': '0.182', 'weapon5': '0.240', 'weapon4': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.388', 'WEAPON3': '1.150', 'weapon3': '2.812', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '56.500'} [2023-02-25 13:16:40,372][36140] DAMAGECOUNT value on done: 66249.0 [2023-02-25 13:16:40,372][36140] Sum rewards: 55.342, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.255', 'AMMO5': '0.016', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon4': '0.108', 'weapon5': '0.126', 'weapon2': '0.138', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '2.890', 'weapon3': '3.394', 'DAMAGECOUNT': '14.592', 'FRAGCOUNT': '50.000'} [2023-02-25 13:16:40,543][36157] DAMAGECOUNT value on done: 65409.0 [2023-02-25 13:16:40,544][36157] Sum rewards: 35.274, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.480', 'AMMO5': '0.016', 'AMMO2': '0.034', 'AMMO3': '0.150', 'AMMO4': '0.168', 'weapon5': '0.266', 'WEAPON5': '0.450', 'ARMOR': '0.451', 'WEAPON4': '0.500', 'weapon4': '0.678', 'weapon2': '0.802', 'WEAPON3': '0.950', 'weapon3': '1.980', 'HITCOUNT': '2.020', 'DAMAGECOUNT': '10.038', 'FRAGCOUNT': '32.000'} [2023-02-25 13:16:40,573][36141] DAMAGECOUNT value on done: 64612.0 [2023-02-25 13:16:40,574][36141] Sum rewards: 59.726, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.950', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.003', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.223', 'weapon2': '0.424', 'WEAPON3': '1.350', 'HITCOUNT': '3.010', 'weapon3': '3.352', 'DAMAGECOUNT': '13.881', 'FRAGCOUNT': '52.000'} [2023-02-25 13:16:40,619][36156] DAMAGECOUNT value on done: 68203.0 [2023-02-25 13:16:40,619][36156] Sum rewards: 45.696, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.852', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'weapon5': '0.074', 'weapon4': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.240', 'weapon2': '0.610', 'WEAPON3': '1.400', 'HITCOUNT': '2.770', 'weapon3': '3.028', 'DAMAGECOUNT': '12.312', 'FRAGCOUNT': '41.000'} [2023-02-25 13:16:40,634][36156] DAMAGECOUNT value on done: 63425.0 [2023-02-25 13:16:40,634][36156] Sum rewards: 42.967, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.301', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.014', 'AMMO4': '0.036', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon2': '0.434', 'WEAPON3': '1.150', 'HITCOUNT': '2.260', 'weapon3': '3.140', 'DAMAGECOUNT': '11.691', 'FRAGCOUNT': '37.000'} [2023-02-25 13:16:40,656][36154] DAMAGECOUNT value on done: 65552.0 [2023-02-25 13:16:40,656][36154] Sum rewards: 54.439, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.396', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'weapon5': '0.060', 'weapon4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.214', 'weapon2': '0.368', 'WEAPON3': '1.250', 'HITCOUNT': '2.930', 'weapon3': '3.208', 'DAMAGECOUNT': '14.142', 'FRAGCOUNT': '49.000'} [2023-02-25 13:16:40,696][36140] DAMAGECOUNT value on done: 65697.0 [2023-02-25 13:16:40,696][36140] Sum rewards: 61.635, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.376', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon4': '0.152', 'AMMO3': '0.175', 'AMMO4': '0.183', 'weapon2': '0.204', 'weapon5': '0.208', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.890', 'weapon3': '3.168', 'DAMAGECOUNT': '15.672', 'FRAGCOUNT': '52.000'} [2023-02-25 13:16:40,872][36154] DAMAGECOUNT value on done: 67658.0 [2023-02-25 13:16:40,872][36154] Sum rewards: 46.272, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.478', 'ARMOR': '0.008', 'AMMO2': '0.009', 'AMMO5': '0.014', 'AMMO4': '0.042', 'weapon5': '0.162', 'AMMO3': '0.165', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.640', 'weapon4': '0.646', 'WEAPON3': '0.950', 'weapon3': '2.322', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '11.532', 'FRAGCOUNT': '39.000'} [2023-02-25 13:16:40,889][36157] DAMAGECOUNT value on done: 63947.0 [2023-02-25 13:16:40,889][36157] Sum rewards: 53.504, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.051', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon2': '0.282', 'weapon4': '0.502', 'WEAPON3': '1.100', 'weapon3': '2.714', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '13.836', 'FRAGCOUNT': '47.500'} [2023-02-25 13:16:40,925][36141] DAMAGECOUNT value on done: 64781.0 [2023-02-25 13:16:40,926][36141] Sum rewards: 48.317, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.238', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.192', 'weapon2': '0.216', 'weapon4': '0.222', 'AMMO3': '0.234', 'WEAPON3': '1.400', 'HITCOUNT': '2.570', 'weapon3': '3.082', 'DAMAGECOUNT': '12.990', 'FRAGCOUNT': '44.000'} [2023-02-25 13:16:40,980][36156] DAMAGECOUNT value on done: 63932.0 [2023-02-25 13:16:40,981][36156] Sum rewards: 43.837, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.147', 'AMMO2': '0.011', 'AMMO4': '0.055', 'WEAPON4': '0.200', 'AMMO3': '0.244', 'weapon2': '0.364', 'weapon4': '0.386', 'WEAPON3': '1.400', 'HITCOUNT': '2.640', 'weapon3': '2.978', 'DAMAGECOUNT': '11.706', 'FRAGCOUNT': '41.000'} [2023-02-25 13:16:41,013][36140] DAMAGECOUNT value on done: 68871.0 [2023-02-25 13:16:41,013][36140] Sum rewards: 58.062, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.065', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.137', 'weapon2': '0.170', 'weapon5': '0.220', 'weapon4': '0.232', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '2.990', 'weapon3': '3.122', 'DAMAGECOUNT': '15.729', 'FRAGCOUNT': '51.000'} [2023-02-25 13:16:41,020][36142] DAMAGECOUNT value on done: 62350.0 [2023-02-25 13:16:41,020][36142] Sum rewards: 41.660, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.128', 'AMMO5': '0.008', 'AMMO2': '0.029', 'AMMO3': '0.119', 'weapon5': '0.132', 'AMMO4': '0.143', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'ARMOR': '0.490', 'weapon4': '0.558', 'weapon2': '0.624', 'WEAPON3': '0.650', 'HITCOUNT': '2.260', 'weapon3': '2.324', 'DAMAGECOUNT': '12.000', 'FRAGCOUNT': '35.500'} [2023-02-25 13:16:41,156][36141] DAMAGECOUNT value on done: 68500.0 [2023-02-25 13:16:41,157][36141] Sum rewards: 59.790, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.710', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.003', 'WEAPON5': '0.100', 'weapon2': '0.116', 'weapon5': '0.200', 'AMMO3': '0.251', 'WEAPON3': '1.600', 'HITCOUNT': '3.190', 'weapon3': '3.518', 'DAMAGECOUNT': '14.772', 'FRAGCOUNT': '53.000'} [2023-02-25 13:16:41,204][36154] DAMAGECOUNT value on done: 67045.0 [2023-02-25 13:16:41,204][36154] Sum rewards: 36.539, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.510', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.051', 'AMMO3': '0.142', 'weapon5': '0.174', 'AMMO4': '0.254', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.450', 'weapon2': '0.496', 'WEAPON3': '0.850', 'HITCOUNT': '2.320', 'weapon3': '2.504', 'DAMAGECOUNT': '9.531', 'FRAGCOUNT': '33.000'} [2023-02-25 13:16:41,218][36157] DAMAGECOUNT value on done: 67164.0 [2023-02-25 13:16:41,218][36157] Sum rewards: 46.602, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.400', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon4': '0.068', 'weapon2': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.252', 'weapon5': '0.258', 'WEAPON3': '1.500', 'HITCOUNT': '2.740', 'weapon3': '3.336', 'DAMAGECOUNT': '12.510', 'FRAGCOUNT': '42.000'} [2023-02-25 13:16:41,328][36140] DAMAGECOUNT value on done: 64754.0 [2023-02-25 13:16:41,328][36140] Sum rewards: 47.647, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.902', 'AMMO5': '0.017', 'AMMO2': '0.029', 'AMMO4': '0.144', 'AMMO3': '0.198', 'weapon5': '0.248', 'weapon2': '0.322', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.512', 'WEAPON3': '1.150', 'weapon3': '2.552', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '13.926', 'FRAGCOUNT': '41.000'} [2023-02-25 13:16:41,337][36142] DAMAGECOUNT value on done: 68033.0 [2023-02-25 13:16:41,338][36142] Sum rewards: 53.856, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.577', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.208', 'weapon4': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.418', 'WEAPON3': '1.300', 'HITCOUNT': '2.930', 'weapon3': '3.012', 'DAMAGECOUNT': '12.960', 'FRAGCOUNT': '48.000'} [2023-02-25 13:16:41,475][36141] DAMAGECOUNT value on done: 62393.0 [2023-02-25 13:16:41,475][36141] Sum rewards: 45.469, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.714', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'AMMO4': '0.174', 'WEAPON4': '0.300', 'weapon4': '0.346', 'weapon2': '0.364', 'WEAPON3': '0.950', 'HITCOUNT': '2.540', 'weapon3': '2.848', 'DAMAGECOUNT': '11.943', 'FRAGCOUNT': '39.000'} [2023-02-25 13:16:41,521][36157] DAMAGECOUNT value on done: 62331.0 [2023-02-25 13:16:41,521][36157] Sum rewards: 41.934, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.501', 'AMMO5': '0.014', 'AMMO2': '0.019', 'weapon5': '0.076', 'weapon4': '0.090', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'AMMO3': '0.245', 'WEAPON5': '0.300', 'weapon2': '0.592', 'WEAPON3': '1.450', 'HITCOUNT': '2.580', 'weapon3': '2.796', 'DAMAGECOUNT': '11.280', 'FRAGCOUNT': '39.000'} [2023-02-25 13:16:41,632][36142] DAMAGECOUNT value on done: 65799.0 [2023-02-25 13:16:41,633][36142] Sum rewards: 40.428, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.113', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.035', 'weapon5': '0.142', 'AMMO3': '0.167', 'AMMO4': '0.176', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON4': '0.500', 'weapon4': '0.780', 'WEAPON3': '0.950', 'HITCOUNT': '2.450', 'weapon3': '2.508', 'DAMAGECOUNT': '10.512', 'FRAGCOUNT': '37.000'} [2023-02-25 13:16:41,949][36142] DAMAGECOUNT value on done: 64800.0 [2023-02-25 13:16:41,949][36142] Sum rewards: 48.849, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.420', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.147', 'weapon5': '0.166', 'AMMO3': '0.215', 'weapon2': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.522', 'WEAPON3': '1.300', 'weapon3': '2.796', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.425', 'FRAGCOUNT': '44.000'} [2023-02-25 13:16:42,802][36138] Updated weights for policy 0, policy_version 37613 (0.0009) [2023-02-25 13:16:44,729][36114] Fps is (10 sec: 12697.6, 60 sec: 12902.4, 300 sec: 12926.7). Total num frames: 154087424. Throughput: 0: 3269.6. Samples: 1016084. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:16:44,730][36114] Avg episode reward: [(0, '48.912')] [2023-02-25 13:16:44,986][36155] Large shaping reward 3.402 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.35100000000000003, 117.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:16:45,804][36138] Updated weights for policy 0, policy_version 37623 (0.0009) [2023-02-25 13:16:48,815][36138] Updated weights for policy 0, policy_version 37633 (0.0009) [2023-02-25 13:16:49,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13038.9, 300 sec: 12940.6). Total num frames: 154157056. Throughput: 0: 3302.0. Samples: 1036530. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:16:49,730][36114] Avg episode reward: [(0, '48.912')] [2023-02-25 13:16:51,818][36138] Updated weights for policy 0, policy_version 37643 (0.0009) [2023-02-25 13:16:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13107.2, 300 sec: 12940.6). Total num frames: 154222592. Throughput: 0: 3304.9. Samples: 1046786. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:16:54,730][36114] Avg episode reward: [(0, '48.912')] [2023-02-25 13:16:54,764][36140] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 13:16:54,933][36138] Updated weights for policy 0, policy_version 37653 (0.0009) [2023-02-25 13:16:55,021][36141] Large shaping reward 2.530 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.51, 170.0)] [2023-02-25 13:16:58,032][36138] Updated weights for policy 0, policy_version 37663 (0.0009) [2023-02-25 13:16:58,283][36155] DAMAGECOUNT value on done: 67490.0 [2023-02-25 13:16:58,284][36155] Sum rewards: 53.929, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.182', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.036', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.179', 'weapon2': '0.200', 'AMMO3': '0.219', 'WEAPON4': '0.450', 'weapon4': '0.542', 'WEAPON3': '1.250', 'HITCOUNT': '2.810', 'weapon3': '2.986', 'DAMAGECOUNT': '13.779', 'FRAGCOUNT': '46.000'} [2023-02-25 13:16:58,578][36155] DAMAGECOUNT value on done: 70528.0 [2023-02-25 13:16:58,579][36155] Sum rewards: 42.342, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.850', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.202', 'weapon5': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.412', 'weapon4': '0.528', 'WEAPON3': '1.250', 'weapon3': '2.440', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '11.646', 'FRAGCOUNT': '39.000'} [2023-02-25 13:16:58,686][36139] DAMAGECOUNT value on done: 69918.0 [2023-02-25 13:16:58,686][36139] Sum rewards: 45.578, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.647', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.182', 'AMMO4': '0.190', 'AMMO3': '0.195', 'weapon2': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon4': '0.524', 'WEAPON3': '1.200', 'HITCOUNT': '2.650', 'weapon3': '2.766', 'DAMAGECOUNT': '12.219', 'FRAGCOUNT': '43.000'} [2023-02-25 13:16:58,787][36155] DAMAGECOUNT value on done: 68115.0 [2023-02-25 13:16:58,787][36155] Sum rewards: 42.348, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.574', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon5': '0.098', 'AMMO3': '0.147', 'AMMO4': '0.227', 'WEAPON5': '0.250', 'weapon4': '0.406', 'WEAPON4': '0.450', 'weapon2': '0.574', 'WEAPON3': '0.850', 'weapon3': '2.606', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '12.090', 'FRAGCOUNT': '37.500'} [2023-02-25 13:16:59,009][36139] DAMAGECOUNT value on done: 71807.0 [2023-02-25 13:16:59,010][36139] Sum rewards: 45.838, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.464', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'weapon5': '0.172', 'AMMO3': '0.196', 'WEAPON4': '0.350', 'weapon2': '0.534', 'weapon4': '0.632', 'WEAPON3': '1.100', 'weapon3': '2.330', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.125', 'FRAGCOUNT': '39.000'} [2023-02-25 13:16:59,102][36155] DAMAGECOUNT value on done: 69581.0 [2023-02-25 13:16:59,103][36155] Sum rewards: 57.695, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.762', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.231', 'weapon5': '0.242', 'WEAPON4': '0.300', 'weapon4': '0.340', 'WEAPON5': '0.450', 'weapon2': '0.670', 'WEAPON3': '1.350', 'weapon3': '2.406', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.221', 'FRAGCOUNT': '52.000'} [2023-02-25 13:16:59,328][36139] DAMAGECOUNT value on done: 74380.0 [2023-02-25 13:16:59,329][36139] Sum rewards: 53.694, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.800', 'ARMOR': '0.004', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'AMMO4': '0.132', 'weapon5': '0.136', 'AMMO3': '0.214', 'weapon4': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.464', 'WEAPON3': '1.350', 'weapon3': '2.888', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.871', 'FRAGCOUNT': '47.500'} [2023-02-25 13:16:59,647][36139] DAMAGECOUNT value on done: 68908.0 [2023-02-25 13:16:59,647][36139] Sum rewards: 51.957, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.640', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'weapon5': '0.056', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.472', 'weapon4': '0.524', 'WEAPON3': '1.250', 'HITCOUNT': '2.700', 'weapon3': '2.712', 'DAMAGECOUNT': '12.801', 'FRAGCOUNT': '46.000'} [2023-02-25 13:16:59,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13175.5, 300 sec: 12968.4). Total num frames: 154288128. Throughput: 0: 3298.5. Samples: 1066666. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:16:59,730][36114] Avg episode reward: [(0, '49.209')] [2023-02-25 13:17:00,186][36140] DAMAGECOUNT value on done: 70704.0 [2023-02-25 13:17:00,187][36140] Sum rewards: 44.258, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.158', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon5': '0.126', 'AMMO4': '0.201', 'AMMO3': '0.202', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.496', 'weapon2': '0.628', 'WEAPON3': '1.150', 'weapon3': '2.494', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.945', 'FRAGCOUNT': '40.000'} [2023-02-25 13:17:00,291][36154] DAMAGECOUNT value on done: 69643.0 [2023-02-25 13:17:00,291][36154] Sum rewards: 40.346, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.430', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.194', 'weapon5': '0.206', 'weapon2': '0.240', 'WEAPON5': '0.350', 'WEAPON4': '0.700', 'WEAPON3': '1.050', 'weapon4': '1.366', 'weapon3': '1.726', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '10.749', 'FRAGCOUNT': '39.000'} [2023-02-25 13:17:00,300][36156] DAMAGECOUNT value on done: 70388.0 [2023-02-25 13:17:00,301][36156] Sum rewards: 51.619, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.750', 'AMMO5': '0.021', 'AMMO2': '0.043', 'AMMO3': '0.137', 'AMMO4': '0.216', 'weapon5': '0.310', 'WEAPON4': '0.400', 'weapon2': '0.438', 'WEAPON5': '0.500', 'weapon4': '0.688', 'WEAPON3': '0.950', 'weapon3': '2.196', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.449', 'FRAGCOUNT': '44.000'} [2023-02-25 13:17:00,500][36140] DAMAGECOUNT value on done: 69739.0 [2023-02-25 13:17:00,500][36140] Sum rewards: 49.309, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.000', 'AMMO2': '0.009', 'AMMO5': '0.011', 'AMMO4': '0.045', 'weapon5': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.156', 'AMMO3': '0.158', 'WEAPON5': '0.300', 'weapon2': '0.506', 'WEAPON3': '0.950', 'HITCOUNT': '2.590', 'weapon3': '3.012', 'DAMAGECOUNT': '12.126', 'FRAGCOUNT': '40.000'} [2023-02-25 13:17:00,583][36154] DAMAGECOUNT value on done: 69342.0 [2023-02-25 13:17:00,584][36154] Sum rewards: 41.440, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.692', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.030', 'AMMO3': '0.149', 'AMMO4': '0.149', 'weapon5': '0.172', 'WEAPON5': '0.200', 'weapon2': '0.292', 'WEAPON4': '0.300', 'weapon4': '0.410', 'WEAPON3': '0.900', 'HITCOUNT': '2.360', 'weapon3': '2.784', 'DAMAGECOUNT': '11.370', 'FRAGCOUNT': '35.000'} [2023-02-25 13:17:00,608][36156] DAMAGECOUNT value on done: 72795.0 [2023-02-25 13:17:00,608][36156] Sum rewards: 60.147, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.895', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.057', 'AMMO3': '0.180', 'weapon5': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.300', 'weapon4': '0.514', 'WEAPON3': '1.050', 'weapon3': '2.764', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.776', 'FRAGCOUNT': '50.000'} [2023-02-25 13:17:00,621][36156] DAMAGECOUNT value on done: 67403.0 [2023-02-25 13:17:00,621][36156] Sum rewards: 48.920, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.311', 'AMMO5': '0.015', 'AMMO2': '0.054', 'AMMO3': '0.137', 'weapon5': '0.258', 'AMMO4': '0.271', 'WEAPON5': '0.450', 'weapon2': '0.560', 'weapon4': '0.648', 'WEAPON4': '0.650', 'WEAPON3': '0.750', 'weapon3': '2.184', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '11.844', 'FRAGCOUNT': '44.000'} [2023-02-25 13:17:00,675][36157] DAMAGECOUNT value on done: 70608.0 [2023-02-25 13:17:00,676][36157] Sum rewards: 59.787, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.688', 'AMMO5': '0.016', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.188', 'weapon2': '0.268', 'weapon5': '0.276', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon4': '0.592', 'WEAPON3': '1.050', 'weapon3': '2.614', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '50.000'} [2023-02-25 13:17:00,679][36141] DAMAGECOUNT value on done: 69023.0 [2023-02-25 13:17:00,680][36141] Sum rewards: 47.952, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.826', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.188', 'AMMO3': '0.218', 'weapon4': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.460', 'WEAPON3': '1.400', 'HITCOUNT': '2.690', 'weapon3': '2.808', 'DAMAGECOUNT': '13.233', 'FRAGCOUNT': '43.000'} [2023-02-25 13:17:00,784][36154] DAMAGECOUNT value on done: 71790.0 [2023-02-25 13:17:00,784][36154] Sum rewards: 45.393, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.134', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.092', 'AMMO4': '0.168', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'weapon2': '0.380', 'WEAPON4': '0.500', 'weapon4': '0.922', 'WEAPON3': '1.000', 'weapon3': '2.384', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '12.396', 'FRAGCOUNT': '40.500'} [2023-02-25 13:17:00,810][36140] DAMAGECOUNT value on done: 73050.0 [2023-02-25 13:17:00,810][36140] Sum rewards: 49.362, reward structure: {'DEATHCOUNT': '-13.500', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.024', 'HEALTH': '0.078', 'AMMO4': '0.120', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon4': '0.232', 'weapon5': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.564', 'WEAPON3': '1.000', 'HITCOUNT': '2.620', 'weapon3': '2.686', 'DAMAGECOUNT': '12.537', 'FRAGCOUNT': '42.000'} [2023-02-25 13:17:00,933][36156] DAMAGECOUNT value on done: 68179.0 [2023-02-25 13:17:00,934][36156] Sum rewards: 51.027, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.680', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.026', 'AMMO3': '0.116', 'AMMO4': '0.129', 'weapon5': '0.180', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.476', 'weapon4': '0.492', 'WEAPON3': '0.700', 'weapon3': '2.548', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '12.741', 'FRAGCOUNT': '43.500'} [2023-02-25 13:17:00,983][36141] DAMAGECOUNT value on done: 69269.0 [2023-02-25 13:17:00,983][36141] Sum rewards: 52.729, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.024', 'AMMO5': '0.005', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'weapon5': '0.142', 'AMMO4': '0.164', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'weapon2': '0.394', 'weapon4': '0.564', 'WEAPON3': '1.250', 'weapon3': '2.542', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.464', 'FRAGCOUNT': '47.000'} [2023-02-25 13:17:00,993][36157] DAMAGECOUNT value on done: 68286.0 [2023-02-25 13:17:00,993][36157] Sum rewards: 47.268, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.900', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.138', 'AMMO4': '0.174', 'weapon4': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.265', 'weapon2': '0.426', 'WEAPON3': '1.500', 'HITCOUNT': '2.540', 'weapon3': '2.938', 'DAMAGECOUNT': '13.017', 'FRAGCOUNT': '44.000'} [2023-02-25 13:17:01,071][36154] DAMAGECOUNT value on done: 71169.0 [2023-02-25 13:17:01,071][36154] Sum rewards: 48.879, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.000', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO3': '0.267', 'weapon2': '0.422', 'WEAPON3': '1.550', 'HITCOUNT': '2.600', 'weapon3': '3.410', 'DAMAGECOUNT': '12.372', 'FRAGCOUNT': '46.000'} [2023-02-25 13:17:01,077][36138] Updated weights for policy 0, policy_version 37673 (0.0010) [2023-02-25 13:17:01,101][36142] DAMAGECOUNT value on done: 66689.0 [2023-02-25 13:17:01,101][36142] Sum rewards: 44.982, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.776', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.057', 'AMMO3': '0.211', 'weapon5': '0.214', 'weapon2': '0.236', 'AMMO4': '0.286', 'WEAPON5': '0.350', 'WEAPON4': '0.700', 'weapon4': '0.914', 'WEAPON3': '1.200', 'weapon3': '2.256', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.017', 'FRAGCOUNT': '42.000'} [2023-02-25 13:17:01,123][36140] DAMAGECOUNT value on done: 69349.0 [2023-02-25 13:17:01,124][36140] Sum rewards: 51.825, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.777', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.099', 'AMMO3': '0.141', 'WEAPON4': '0.200', 'weapon5': '0.208', 'WEAPON5': '0.250', 'weapon4': '0.428', 'weapon2': '0.520', 'WEAPON3': '0.850', 'weapon3': '2.638', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.668', 'FRAGCOUNT': '42.000'} [2023-02-25 13:17:01,220][36141] DAMAGECOUNT value on done: 72748.0 [2023-02-25 13:17:01,220][36141] Sum rewards: 45.104, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.870', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.144', 'AMMO3': '0.146', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.570', 'weapon4': '0.702', 'WEAPON3': '0.850', 'weapon3': '2.226', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.744', 'FRAGCOUNT': '38.000'} [2023-02-25 13:17:01,311][36157] DAMAGECOUNT value on done: 72589.0 [2023-02-25 13:17:01,312][36157] Sum rewards: 63.223, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.872', 'AMMO5': '0.007', 'weapon5': '0.016', 'AMMO2': '0.017', 'weapon4': '0.032', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'weapon2': '0.370', 'WEAPON3': '1.400', 'weapon3': '3.370', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '54.500'} [2023-02-25 13:17:01,433][36142] DAMAGECOUNT value on done: 72555.0 [2023-02-25 13:17:01,434][36142] Sum rewards: 50.498, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.380', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.108', 'AMMO4': '0.118', 'weapon4': '0.190', 'weapon2': '0.274', 'AMMO3': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'HITCOUNT': '2.880', 'weapon3': '3.106', 'DAMAGECOUNT': '13.566', 'FRAGCOUNT': '48.000'} [2023-02-25 13:17:01,522][36141] DAMAGECOUNT value on done: 66553.0 [2023-02-25 13:17:01,523][36141] Sum rewards: 45.035, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.320', 'AMMO5': '0.015', 'AMMO2': '0.021', 'weapon5': '0.090', 'AMMO4': '0.107', 'AMMO3': '0.214', 'weapon4': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.554', 'WEAPON3': '1.300', 'HITCOUNT': '2.520', 'weapon3': '2.856', 'DAMAGECOUNT': '12.480', 'FRAGCOUNT': '40.000'} [2023-02-25 13:17:01,612][36157] DAMAGECOUNT value on done: 67586.0 [2023-02-25 13:17:01,612][36157] Sum rewards: 62.815, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.082', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO3': '0.137', 'AMMO4': '0.164', 'weapon5': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.398', 'weapon4': '0.806', 'WEAPON3': '0.900', 'weapon3': '2.366', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.765', 'FRAGCOUNT': '49.000'} [2023-02-25 13:17:01,654][36142] DAMAGECOUNT value on done: 69036.0 [2023-02-25 13:17:01,655][36142] Sum rewards: 37.525, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.010', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.044', 'weapon7': '0.058', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'WEAPON7': '0.200', 'weapon2': '0.386', 'WEAPON4': '0.600', 'weapon4': '0.786', 'WEAPON3': '0.800', 'weapon3': '1.944', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '9.711', 'FRAGCOUNT': '34.000'} [2023-02-25 13:17:01,968][36142] DAMAGECOUNT value on done: 69747.0 [2023-02-25 13:17:01,968][36142] Sum rewards: 54.315, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.775', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.052', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'weapon2': '0.226', 'AMMO3': '0.249', 'WEAPON5': '0.250', 'weapon4': '0.284', 'WEAPON3': '1.550', 'HITCOUNT': '3.170', 'weapon3': '3.190', 'DAMAGECOUNT': '14.841', 'FRAGCOUNT': '48.000'} [2023-02-25 13:17:04,617][36138] Updated weights for policy 0, policy_version 37683 (0.0010) [2023-02-25 13:17:04,729][36114] Fps is (10 sec: 12697.6, 60 sec: 13175.5, 300 sec: 12954.5). Total num frames: 154349568. Throughput: 0: 3267.6. Samples: 1085324. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:17:04,730][36114] Avg episode reward: [(0, '49.534')] [2023-02-25 13:17:07,697][36138] Updated weights for policy 0, policy_version 37693 (0.0009) [2023-02-25 13:17:09,729][36114] Fps is (10 sec: 12697.6, 60 sec: 13107.2, 300 sec: 12954.5). Total num frames: 154415104. Throughput: 0: 3260.8. Samples: 1095120. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:17:09,730][36114] Avg episode reward: [(0, '49.534')] [2023-02-25 13:17:10,888][36138] Updated weights for policy 0, policy_version 37703 (0.0009) [2023-02-25 13:17:14,105][36138] Updated weights for policy 0, policy_version 37713 (0.0010) [2023-02-25 13:17:14,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13107.2, 300 sec: 12954.5). Total num frames: 154480640. Throughput: 0: 3248.3. Samples: 1114502. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:17:14,729][36114] Avg episode reward: [(0, '49.534')] [2023-02-25 13:17:17,479][36138] Updated weights for policy 0, policy_version 37723 (0.0010) [2023-02-25 13:17:19,246][36155] DAMAGECOUNT value on done: 71754.0 [2023-02-25 13:17:19,246][36155] Sum rewards: 46.067, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.990', 'AMMO5': '0.005', 'ARMOR': '0.008', 'weapon5': '0.020', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.189', 'weapon4': '0.278', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.100', 'HITCOUNT': '2.850', 'weapon3': '3.188', 'DAMAGECOUNT': '12.792', 'FRAGCOUNT': '40.000'} [2023-02-25 13:17:19,565][36155] DAMAGECOUNT value on done: 74249.0 [2023-02-25 13:17:19,566][36155] Sum rewards: 45.501, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.180', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.074', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.185', 'weapon4': '0.276', 'weapon2': '0.402', 'WEAPON3': '1.050', 'HITCOUNT': '2.370', 'weapon3': '3.040', 'DAMAGECOUNT': '11.163', 'FRAGCOUNT': '41.000'} [2023-02-25 13:17:19,729][36114] Fps is (10 sec: 12697.7, 60 sec: 13038.9, 300 sec: 12954.5). Total num frames: 154542080. Throughput: 0: 3230.2. Samples: 1133286. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:17:19,729][36114] Avg episode reward: [(0, '49.674')] [2023-02-25 13:17:19,734][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000037730_154542080.pth... [2023-02-25 13:17:19,793][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000036972_151437312.pth [2023-02-25 13:17:19,799][36155] DAMAGECOUNT value on done: 72396.0 [2023-02-25 13:17:19,800][36155] Sum rewards: 44.103, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.714', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.035', 'AMMO4': '0.174', 'AMMO3': '0.181', 'weapon5': '0.238', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.460', 'weapon2': '0.534', 'WEAPON3': '1.050', 'weapon3': '2.442', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.843', 'FRAGCOUNT': '38.500'} [2023-02-25 13:17:19,823][36139] DAMAGECOUNT value on done: 74868.0 [2023-02-25 13:17:19,823][36139] Sum rewards: 57.512, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.002', 'AMMO5': '0.019', 'AMMO2': '0.064', 'AMMO3': '0.130', 'weapon5': '0.264', 'AMMO4': '0.319', 'weapon4': '0.446', 'weapon2': '0.466', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '0.800', 'weapon3': '2.528', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.328', 'FRAGCOUNT': '48.000'} [2023-02-25 13:17:20,136][36155] DAMAGECOUNT value on done: 73520.0 [2023-02-25 13:17:20,136][36155] Sum rewards: 45.350, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.300', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.138', 'AMMO3': '0.188', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.374', 'weapon2': '0.668', 'WEAPON3': '1.150', 'HITCOUNT': '2.530', 'weapon3': '2.560', 'DAMAGECOUNT': '11.817', 'FRAGCOUNT': '41.000'} [2023-02-25 13:17:20,152][36139] DAMAGECOUNT value on done: 76563.0 [2023-02-25 13:17:20,152][36139] Sum rewards: 53.830, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.008', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.100', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'weapon2': '0.184', 'WEAPON4': '0.200', 'AMMO3': '0.289', 'weapon4': '0.406', 'WEAPON3': '1.650', 'weapon3': '2.878', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.268', 'FRAGCOUNT': '49.000'} [2023-02-25 13:17:20,477][36139] DAMAGECOUNT value on done: 78091.0 [2023-02-25 13:17:20,478][36139] Sum rewards: 36.942, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.324', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.026', 'weapon5': '0.062', 'AMMO4': '0.130', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon2': '0.302', 'WEAPON5': '0.350', 'weapon4': '0.388', 'WEAPON3': '1.400', 'HITCOUNT': '2.520', 'weapon3': '2.962', 'DAMAGECOUNT': '11.133', 'FRAGCOUNT': '34.000'} [2023-02-25 13:17:20,635][36138] Updated weights for policy 0, policy_version 37733 (0.0010) [2023-02-25 13:17:20,785][36139] DAMAGECOUNT value on done: 72870.0 [2023-02-25 13:17:20,786][36139] Sum rewards: 35.666, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.894', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon5': '0.148', 'AMMO3': '0.206', 'weapon2': '0.254', 'AMMO4': '0.257', 'WEAPON5': '0.450', 'weapon4': '0.652', 'WEAPON4': '0.700', 'WEAPON3': '1.250', 'HITCOUNT': '2.370', 'weapon3': '2.614', 'DAMAGECOUNT': '11.586', 'FRAGCOUNT': '37.000'} [2023-02-25 13:17:21,462][36140] DAMAGECOUNT value on done: 74930.0 [2023-02-25 13:17:21,463][36140] Sum rewards: 49.009, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.455', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.110', 'weapon4': '0.120', 'AMMO3': '0.148', 'AMMO4': '0.179', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.766', 'WEAPON3': '0.900', 'weapon3': '2.826', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.678', 'FRAGCOUNT': '42.000'} [2023-02-25 13:17:21,585][36154] DAMAGECOUNT value on done: 73534.0 [2023-02-25 13:17:21,586][36154] Sum rewards: 44.359, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.380', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.162', 'AMMO3': '0.199', 'weapon5': '0.220', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.490', 'weapon4': '0.540', 'WEAPON3': '1.250', 'weapon3': '2.500', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '11.673', 'FRAGCOUNT': '40.000'} [2023-02-25 13:17:21,883][36140] DAMAGECOUNT value on done: 73622.0 [2023-02-25 13:17:21,884][36140] Sum rewards: 42.211, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.272', 'ARMOR': '0.004', 'AMMO5': '0.026', 'AMMO2': '0.054', 'AMMO3': '0.139', 'AMMO4': '0.272', 'weapon2': '0.308', 'weapon5': '0.372', 'WEAPON4': '0.500', 'WEAPON5': '0.650', 'WEAPON3': '0.850', 'weapon4': '1.158', 'weapon3': '1.720', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '11.649', 'FRAGCOUNT': '36.000'} [2023-02-25 13:17:21,944][36156] DAMAGECOUNT value on done: 74550.0 [2023-02-25 13:17:21,944][36156] Sum rewards: 43.478, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.342', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.066', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'weapon2': '0.468', 'weapon4': '0.566', 'WEAPON3': '1.200', 'weapon3': '2.632', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '12.486', 'FRAGCOUNT': '38.500'} [2023-02-25 13:17:21,989][36154] DAMAGECOUNT value on done: 73221.0 [2023-02-25 13:17:21,990][36154] Sum rewards: 44.596, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.710', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.020', 'weapon5': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'weapon4': '0.312', 'weapon2': '0.696', 'WEAPON3': '1.300', 'HITCOUNT': '2.440', 'weapon3': '2.666', 'DAMAGECOUNT': '11.637', 'FRAGCOUNT': '40.000'} [2023-02-25 13:17:22,071][36157] DAMAGECOUNT value on done: 74786.0 [2023-02-25 13:17:22,071][36157] Sum rewards: 48.578, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.855', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.114', 'AMMO3': '0.217', 'weapon2': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.426', 'WEAPON3': '1.300', 'HITCOUNT': '2.660', 'weapon3': '2.932', 'DAMAGECOUNT': '12.534', 'FRAGCOUNT': '43.000'} [2023-02-25 13:17:22,224][36141] DAMAGECOUNT value on done: 73729.0 [2023-02-25 13:17:22,225][36141] Sum rewards: 52.968, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.210', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon5': '0.148', 'AMMO4': '0.168', 'AMMO3': '0.214', 'weapon4': '0.250', 'weapon2': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.020', 'weapon3': '3.104', 'DAMAGECOUNT': '14.118', 'FRAGCOUNT': '46.000'} [2023-02-25 13:17:22,234][36154] DAMAGECOUNT value on done: 75440.0 [2023-02-25 13:17:22,235][36154] Sum rewards: 42.455, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.402', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.092', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'weapon4': '0.344', 'weapon2': '0.454', 'WEAPON3': '1.300', 'HITCOUNT': '2.500', 'weapon3': '2.858', 'DAMAGECOUNT': '10.950', 'FRAGCOUNT': '41.000'} [2023-02-25 13:17:22,249][36140] DAMAGECOUNT value on done: 76928.0 [2023-02-25 13:17:22,249][36140] Sum rewards: 39.533, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.638', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.037', 'weapon5': '0.130', 'AMMO4': '0.183', 'AMMO3': '0.240', 'weapon2': '0.316', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.534', 'WEAPON3': '1.350', 'weapon3': '2.724', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '11.634', 'FRAGCOUNT': '40.000'} [2023-02-25 13:17:22,308][36156] DAMAGECOUNT value on done: 76992.0 [2023-02-25 13:17:22,309][36156] Sum rewards: 39.696, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.062', 'ARMOR': '0.004', 'AMMO5': '0.035', 'AMMO2': '0.049', 'AMMO3': '0.242', 'AMMO4': '0.245', 'weapon2': '0.270', 'weapon5': '0.312', 'weapon4': '0.372', 'WEAPON4': '0.600', 'WEAPON5': '0.800', 'WEAPON3': '1.450', 'HITCOUNT': '2.630', 'weapon3': '2.710', 'DAMAGECOUNT': '12.039', 'FRAGCOUNT': '39.000'} [2023-02-25 13:17:22,323][36156] DAMAGECOUNT value on done: 72449.0 [2023-02-25 13:17:22,324][36156] Sum rewards: 57.682, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.504', 'ARMOR': '0.008', 'AMMO2': '0.015', 'AMMO5': '0.016', 'AMMO4': '0.072', 'weapon5': '0.164', 'weapon4': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'weapon2': '0.278', 'WEAPON3': '1.600', 'weapon3': '3.086', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.108', 'FRAGCOUNT': '51.500'} [2023-02-25 13:17:22,459][36157] DAMAGECOUNT value on done: 73446.0 [2023-02-25 13:17:22,460][36157] Sum rewards: 57.052, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.946', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.036', 'weapon5': '0.146', 'weapon4': '0.168', 'AMMO4': '0.178', 'AMMO3': '0.238', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.056', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.480', 'FRAGCOUNT': '50.000'} [2023-02-25 13:17:22,599][36141] DAMAGECOUNT value on done: 73612.0 [2023-02-25 13:17:22,600][36141] Sum rewards: 49.907, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.318', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.092', 'AMMO4': '0.113', 'AMMO3': '0.156', 'WEAPON4': '0.400', 'ARMOR': '0.500', 'weapon2': '0.558', 'WEAPON3': '0.900', 'weapon4': '0.914', 'weapon3': '1.988', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.029', 'FRAGCOUNT': '43.000'} [2023-02-25 13:17:22,619][36154] DAMAGECOUNT value on done: 75127.0 [2023-02-25 13:17:22,619][36154] Sum rewards: 38.826, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.636', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.078', 'AMMO4': '0.187', 'weapon2': '0.236', 'AMMO3': '0.263', 'WEAPON5': '0.300', 'WEAPON4': '0.600', 'weapon4': '0.862', 'WEAPON3': '1.450', 'weapon3': '2.518', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '11.874', 'FRAGCOUNT': '39.000'} [2023-02-25 13:17:22,659][36140] DAMAGECOUNT value on done: 74166.0 [2023-02-25 13:17:22,659][36140] Sum rewards: 52.479, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-1.864', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.154', 'weapon2': '0.230', 'AMMO3': '0.294', 'WEAPON4': '0.300', 'weapon4': '0.590', 'WEAPON3': '1.650', 'weapon3': '2.814', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.451', 'FRAGCOUNT': '51.000'} [2023-02-25 13:17:22,665][36142] DAMAGECOUNT value on done: 70589.0 [2023-02-25 13:17:22,666][36142] Sum rewards: 35.419, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.248', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon2': '0.180', 'AMMO4': '0.190', 'weapon5': '0.252', 'AMMO3': '0.266', 'weapon4': '0.364', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '2.340', 'weapon3': '2.872', 'DAMAGECOUNT': '11.700', 'FRAGCOUNT': '36.000'} [2023-02-25 13:17:22,702][36156] DAMAGECOUNT value on done: 72079.0 [2023-02-25 13:17:22,703][36156] Sum rewards: 42.800, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.113', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.036', 'AMMO3': '0.133', 'AMMO4': '0.179', 'weapon5': '0.204', 'weapon4': '0.326', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.574', 'WEAPON3': '0.750', 'HITCOUNT': '2.660', 'weapon3': '2.678', 'DAMAGECOUNT': '11.700', 'FRAGCOUNT': '35.000'} [2023-02-25 13:17:22,835][36141] DAMAGECOUNT value on done: 77176.0 [2023-02-25 13:17:22,835][36141] Sum rewards: 52.399, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.966', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.056', 'AMMO3': '0.155', 'weapon5': '0.180', 'AMMO4': '0.280', 'weapon2': '0.298', 'weapon4': '0.384', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'HITCOUNT': '2.600', 'weapon3': '2.904', 'DAMAGECOUNT': '13.284', 'FRAGCOUNT': '44.000'} [2023-02-25 13:17:22,850][36157] DAMAGECOUNT value on done: 76730.0 [2023-02-25 13:17:22,850][36157] Sum rewards: 50.297, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.408', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.098', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon4': '0.460', 'weapon2': '0.610', 'WEAPON3': '1.000', 'weapon3': '2.750', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.423', 'FRAGCOUNT': '43.000'} [2023-02-25 13:17:23,051][36142] DAMAGECOUNT value on done: 76181.0 [2023-02-25 13:17:23,052][36142] Sum rewards: 40.700, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.636', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'AMMO4': '0.188', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'weapon4': '1.194', 'weapon3': '2.112', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '10.878', 'FRAGCOUNT': '35.000'} [2023-02-25 13:17:23,201][36141] DAMAGECOUNT value on done: 70694.0 [2023-02-25 13:17:23,201][36141] Sum rewards: 42.975, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.630', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.078', 'AMMO4': '0.107', 'weapon4': '0.174', 'AMMO3': '0.180', 'weapon2': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.100', 'HITCOUNT': '2.740', 'weapon3': '3.304', 'DAMAGECOUNT': '12.423', 'FRAGCOUNT': '38.000'} [2023-02-25 13:17:23,227][36157] DAMAGECOUNT value on done: 72058.0 [2023-02-25 13:17:23,228][36157] Sum rewards: 53.695, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.869', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon5': '0.126', 'AMMO3': '0.173', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.426', 'weapon2': '0.448', 'WEAPON3': '1.150', 'weapon3': '2.776', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.416', 'FRAGCOUNT': '47.000'} [2023-02-25 13:17:23,325][36142] DAMAGECOUNT value on done: 73225.0 [2023-02-25 13:17:23,325][36142] Sum rewards: 40.803, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.015', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.246', 'AMMO3': '0.259', 'weapon4': '0.570', 'WEAPON3': '1.550', 'HITCOUNT': '2.700', 'weapon3': '2.778', 'DAMAGECOUNT': '12.567', 'FRAGCOUNT': '37.000'} [2023-02-25 13:17:23,693][36142] DAMAGECOUNT value on done: 73879.0 [2023-02-25 13:17:23,694][36142] Sum rewards: 47.321, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.238', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.254', 'weapon4': '0.382', 'weapon2': '0.386', 'WEAPON3': '1.550', 'weapon3': '2.654', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.396', 'FRAGCOUNT': '44.000'} [2023-02-25 13:17:24,202][36138] Updated weights for policy 0, policy_version 37743 (0.0009) [2023-02-25 13:17:24,729][36114] Fps is (10 sec: 11878.3, 60 sec: 12834.1, 300 sec: 12926.7). Total num frames: 154599424. Throughput: 0: 3238.0. Samples: 1142280. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:17:24,730][36114] Avg episode reward: [(0, '48.580')] [2023-02-25 13:17:27,338][36138] Updated weights for policy 0, policy_version 37753 (0.0010) [2023-02-25 13:17:29,729][36114] Fps is (10 sec: 12287.8, 60 sec: 12834.1, 300 sec: 12926.7). Total num frames: 154664960. Throughput: 0: 3221.0. Samples: 1161028. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:17:29,730][36114] Avg episode reward: [(0, '48.580')] [2023-02-25 13:17:30,448][36138] Updated weights for policy 0, policy_version 37763 (0.0009) [2023-02-25 13:17:33,623][36138] Updated weights for policy 0, policy_version 37773 (0.0010) [2023-02-25 13:17:34,729][36114] Fps is (10 sec: 13107.2, 60 sec: 12834.1, 300 sec: 12926.7). Total num frames: 154730496. Throughput: 0: 3200.0. Samples: 1180532. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:17:34,730][36114] Avg episode reward: [(0, '48.580')] [2023-02-25 13:17:35,505][36156] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:17:36,765][36138] Updated weights for policy 0, policy_version 37783 (0.0010) [2023-02-25 13:17:39,729][36114] Fps is (10 sec: 13107.2, 60 sec: 12902.4, 300 sec: 12926.7). Total num frames: 154796032. Throughput: 0: 3188.5. Samples: 1190268. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:17:39,730][36114] Avg episode reward: [(0, '48.580')] [2023-02-25 13:17:39,957][36138] Updated weights for policy 0, policy_version 37793 (0.0009) [2023-02-25 13:17:40,301][36155] DAMAGECOUNT value on done: 75128.0 [2023-02-25 13:17:40,302][36155] Sum rewards: 39.477, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.466', 'AMMO5': '0.022', 'AMMO2': '0.045', 'weapon7': '0.068', 'AMMO3': '0.091', 'weapon5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO4': '0.225', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'weapon2': '0.632', 'weapon4': '0.840', 'weapon3': '2.138', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '10.122', 'FRAGCOUNT': '32.000'} [2023-02-25 13:17:40,624][36155] DAMAGECOUNT value on done: 78728.0 [2023-02-25 13:17:40,624][36155] Sum rewards: 49.823, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.875', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'weapon4': '0.418', 'weapon2': '0.464', 'WEAPON3': '1.350', 'weapon3': '2.844', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '13.437', 'FRAGCOUNT': '45.000'} [2023-02-25 13:17:40,834][36155] DAMAGECOUNT value on done: 77291.0 [2023-02-25 13:17:40,834][36155] Sum rewards: 56.956, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.661', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'AMMO3': '0.245', 'weapon4': '0.310', 'weapon2': '0.432', 'WEAPON3': '1.500', 'weapon3': '3.074', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.685', 'FRAGCOUNT': '51.000'} [2023-02-25 13:17:40,953][36139] DAMAGECOUNT value on done: 78846.0 [2023-02-25 13:17:40,953][36139] Sum rewards: 37.136, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.510', 'AMMO5': '0.014', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.152', 'weapon4': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.271', 'WEAPON5': '0.350', 'weapon2': '0.482', 'WEAPON3': '1.650', 'HITCOUNT': '2.380', 'weapon3': '2.950', 'DAMAGECOUNT': '11.934', 'FRAGCOUNT': '36.500'} [2023-02-25 13:17:41,144][36155] DAMAGECOUNT value on done: 77291.0 [2023-02-25 13:17:41,145][36155] Sum rewards: 38.656, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-1.900', 'ARMOR': '0.008', 'AMMO5': '0.024', 'AMMO2': '0.053', 'AMMO3': '0.232', 'weapon2': '0.264', 'AMMO4': '0.265', 'weapon5': '0.270', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.570', 'WEAPON3': '1.350', 'HITCOUNT': '2.230', 'weapon3': '2.476', 'DAMAGECOUNT': '11.313', 'FRAGCOUNT': '40.000'} [2023-02-25 13:17:41,275][36139] DAMAGECOUNT value on done: 80474.0 [2023-02-25 13:17:41,275][36139] Sum rewards: 35.519, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.940', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.155', 'AMMO3': '0.181', 'weapon5': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon2': '0.616', 'weapon4': '0.812', 'WEAPON3': '1.100', 'weapon3': '1.990', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '11.733', 'FRAGCOUNT': '31.000'} [2023-02-25 13:17:41,492][36139] DAMAGECOUNT value on done: 82060.0 [2023-02-25 13:17:41,492][36139] Sum rewards: 35.682, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.626', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.069', 'AMMO3': '0.158', 'weapon5': '0.186', 'AMMO4': '0.345', 'weapon2': '0.442', 'WEAPON5': '0.550', 'WEAPON4': '0.750', 'weapon4': '0.876', 'WEAPON3': '0.950', 'weapon3': '2.188', 'HITCOUNT': '2.360', 'DAMAGECOUNT': '11.907', 'FRAGCOUNT': '34.000'} [2023-02-25 13:17:41,786][36139] DAMAGECOUNT value on done: 77240.0 [2023-02-25 13:17:41,787][36139] Sum rewards: 54.209, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.910', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'AMMO3': '0.141', 'AMMO4': '0.168', 'weapon5': '0.168', 'weapon4': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.418', 'WEAPON3': '1.000', 'HITCOUNT': '2.670', 'weapon3': '2.902', 'DAMAGECOUNT': '13.110', 'FRAGCOUNT': '46.000'} [2023-02-25 13:17:42,653][36154] DAMAGECOUNT value on done: 77507.0 [2023-02-25 13:17:42,654][36154] Sum rewards: 45.340, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.469', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'weapon4': '0.068', 'AMMO4': '0.092', 'weapon5': '0.134', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'weapon2': '0.490', 'WEAPON3': '1.200', 'HITCOUNT': '2.560', 'weapon3': '3.118', 'DAMAGECOUNT': '11.919', 'FRAGCOUNT': '38.000'} [2023-02-25 13:17:42,664][36140] DAMAGECOUNT value on done: 79701.0 [2023-02-25 13:17:42,665][36140] Sum rewards: 52.031, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.405', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon2': '0.196', 'weapon4': '0.464', 'WEAPON3': '1.250', 'HITCOUNT': '2.960', 'weapon3': '3.038', 'DAMAGECOUNT': '14.313', 'FRAGCOUNT': '44.000'} [2023-02-25 13:17:42,972][36154] DAMAGECOUNT value on done: 77231.0 [2023-02-25 13:17:42,973][36154] Sum rewards: 50.225, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.616', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.144', 'weapon5': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.354', 'weapon4': '0.566', 'WEAPON3': '0.850', 'weapon3': '2.640', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '12.030', 'FRAGCOUNT': '42.000'} [2023-02-25 13:17:42,980][36140] DAMAGECOUNT value on done: 77515.0 [2023-02-25 13:17:42,981][36140] Sum rewards: 36.985, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.010', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.104', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'weapon4': '0.312', 'weapon2': '0.476', 'WEAPON3': '1.500', 'HITCOUNT': '2.410', 'weapon3': '2.794', 'DAMAGECOUNT': '11.679', 'FRAGCOUNT': '35.000'} [2023-02-25 13:17:43,042][36138] Updated weights for policy 0, policy_version 37803 (0.0010) [2023-02-25 13:17:43,072][36156] DAMAGECOUNT value on done: 79850.0 [2023-02-25 13:17:43,072][36156] Sum rewards: 64.697, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.224', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.158', 'AMMO3': '0.184', 'AMMO4': '0.192', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.384', 'weapon4': '0.614', 'WEAPON3': '1.200', 'weapon3': '2.610', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '56.000'} [2023-02-25 13:17:43,107][36157] DAMAGECOUNT value on done: 79888.0 [2023-02-25 13:17:43,108][36157] Sum rewards: 54.612, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.635', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'weapon2': '0.274', 'AMMO3': '0.308', 'WEAPON3': '1.750', 'HITCOUNT': '3.120', 'weapon3': '3.492', 'DAMAGECOUNT': '15.306', 'FRAGCOUNT': '50.000'} [2023-02-25 13:17:43,143][36141] DAMAGECOUNT value on done: 78753.0 [2023-02-25 13:17:43,143][36141] Sum rewards: 62.187, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.340', 'AMMO5': '0.017', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon4': '0.168', 'weapon5': '0.184', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'weapon2': '0.256', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.880', 'weapon3': '3.022', 'DAMAGECOUNT': '15.072', 'FRAGCOUNT': '54.000'} [2023-02-25 13:17:43,223][36154] DAMAGECOUNT value on done: 80108.0 [2023-02-25 13:17:43,224][36154] Sum rewards: 51.519, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.026', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.146', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.374', 'weapon4': '0.474', 'WEAPON3': '1.350', 'weapon3': '2.726', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.004', 'FRAGCOUNT': '47.000'} [2023-02-25 13:17:43,278][36140] DAMAGECOUNT value on done: 81465.0 [2023-02-25 13:17:43,279][36140] Sum rewards: 56.537, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.837', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.053', 'AMMO3': '0.165', 'weapon5': '0.252', 'AMMO4': '0.267', 'WEAPON5': '0.350', 'weapon2': '0.410', 'WEAPON4': '0.550', 'weapon4': '0.728', 'WEAPON3': '0.900', 'weapon3': '2.240', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.611', 'FRAGCOUNT': '50.000'} [2023-02-25 13:17:43,378][36142] DAMAGECOUNT value on done: 74909.0 [2023-02-25 13:17:43,378][36142] Sum rewards: 48.245, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.940', 'AMMO5': '0.016', 'AMMO2': '0.036', 'AMMO4': '0.178', 'AMMO3': '0.199', 'weapon5': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.316', 'WEAPON5': '0.350', 'weapon4': '0.684', 'WEAPON3': '1.200', 'weapon3': '2.516', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.960', 'FRAGCOUNT': '42.000'} [2023-02-25 13:17:43,382][36156] DAMAGECOUNT value on done: 81387.0 [2023-02-25 13:17:43,383][36156] Sum rewards: 46.445, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.425', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.151', 'AMMO3': '0.160', 'weapon5': '0.250', 'weapon2': '0.372', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.498', 'WEAPON3': '1.000', 'weapon3': '2.470', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '13.185', 'FRAGCOUNT': '40.500'} [2023-02-25 13:17:43,394][36156] DAMAGECOUNT value on done: 76531.0 [2023-02-25 13:17:43,395][36156] Sum rewards: 50.360, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.735', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.156', 'AMMO3': '0.175', 'weapon2': '0.474', 'WEAPON3': '1.100', 'HITCOUNT': '2.590', 'weapon3': '3.136', 'DAMAGECOUNT': '12.246', 'FRAGCOUNT': '43.000'} [2023-02-25 13:17:43,420][36157] DAMAGECOUNT value on done: 78176.0 [2023-02-25 13:17:43,420][36157] Sum rewards: 47.363, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.872', 'AMMO5': '0.007', 'AMMO2': '0.030', 'AMMO4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.172', 'WEAPON4': '0.250', 'weapon5': '0.258', 'AMMO3': '0.272', 'weapon4': '0.292', 'WEAPON3': '1.650', 'HITCOUNT': '2.850', 'weapon3': '2.964', 'DAMAGECOUNT': '14.190', 'FRAGCOUNT': '45.000'} [2023-02-25 13:17:43,465][36141] DAMAGECOUNT value on done: 78407.0 [2023-02-25 13:17:43,466][36141] Sum rewards: 57.807, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.524', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.020', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon4': '0.256', 'weapon2': '0.290', 'WEAPON3': '1.300', 'HITCOUNT': '3.070', 'weapon3': '3.156', 'DAMAGECOUNT': '14.385', 'FRAGCOUNT': '50.000'} [2023-02-25 13:17:43,553][36154] DAMAGECOUNT value on done: 79257.0 [2023-02-25 13:17:43,554][36154] Sum rewards: 47.263, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.378', 'AMMO2': '0.024', 'weapon7': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.118', 'weapon2': '0.188', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon4': '0.684', 'WEAPON3': '1.100', 'HITCOUNT': '2.570', 'weapon3': '2.778', 'DAMAGECOUNT': '12.390', 'FRAGCOUNT': '39.000'} [2023-02-25 13:17:43,575][36141] DAMAGECOUNT value on done: 80608.0 [2023-02-25 13:17:43,575][36141] Sum rewards: 36.664, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.078', 'AMMO5': '0.019', 'AMMO2': '0.055', 'weapon5': '0.120', 'AMMO3': '0.157', 'AMMO4': '0.274', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.468', 'WEAPON4': '0.500', 'weapon2': '0.590', 'WEAPON3': '0.900', 'HITCOUNT': '2.350', 'weapon3': '2.530', 'DAMAGECOUNT': '10.179', 'FRAGCOUNT': '33.000'} [2023-02-25 13:17:43,589][36140] DAMAGECOUNT value on done: 78075.0 [2023-02-25 13:17:43,590][36140] Sum rewards: 46.741, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.132', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO3': '0.118', 'AMMO4': '0.131', 'WEAPON5': '0.250', 'weapon5': '0.284', 'WEAPON4': '0.400', 'ARMOR': '0.504', 'weapon4': '0.548', 'weapon2': '0.690', 'WEAPON3': '0.800', 'weapon3': '2.264', 'HITCOUNT': '2.370', 'DAMAGECOUNT': '11.727', 'FRAGCOUNT': '39.000'} [2023-02-25 13:17:43,710][36157] DAMAGECOUNT value on done: 81412.0 [2023-02-25 13:17:43,711][36157] Sum rewards: 56.933, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.670', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon5': '0.080', 'AMMO4': '0.093', 'weapon4': '0.104', 'weapon2': '0.106', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.250', 'HITCOUNT': '2.720', 'weapon3': '3.590', 'DAMAGECOUNT': '14.046', 'FRAGCOUNT': '49.000'} [2023-02-25 13:17:43,713][36142] DAMAGECOUNT value on done: 80511.0 [2023-02-25 13:17:43,715][36142] Sum rewards: 51.848, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.151', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.122', 'AMMO3': '0.125', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.438', 'weapon4': '0.584', 'WEAPON3': '0.850', 'weapon3': '2.250', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.990', 'FRAGCOUNT': '43.000'} [2023-02-25 13:17:43,721][36156] DAMAGECOUNT value on done: 75842.0 [2023-02-25 13:17:43,722][36156] Sum rewards: 41.808, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.472', 'AMMO5': '0.021', 'AMMO2': '0.048', 'AMMO3': '0.192', 'AMMO4': '0.241', 'weapon5': '0.288', 'weapon2': '0.392', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'weapon4': '0.786', 'WEAPON3': '1.050', 'weapon3': '2.182', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '11.289', 'FRAGCOUNT': '39.000'} [2023-02-25 13:17:43,902][36141] DAMAGECOUNT value on done: 75025.0 [2023-02-25 13:17:43,902][36141] Sum rewards: 40.111, reward structure: {'DEATHCOUNT': '-21.750', 'HEALTH': '-3.672', 'ARMOR': '0.012', 'AMMO5': '0.029', 'AMMO2': '0.076', 'weapon5': '0.186', 'AMMO3': '0.259', 'AMMO4': '0.378', 'weapon2': '0.484', 'weapon4': '0.534', 'WEAPON5': '0.600', 'WEAPON4': '0.750', 'WEAPON3': '1.500', 'weapon3': '2.392', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.993', 'FRAGCOUNT': '42.500'} [2023-02-25 13:17:43,923][36142] DAMAGECOUNT value on done: 76655.0 [2023-02-25 13:17:43,924][36142] Sum rewards: 36.016, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.510', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.032', 'AMMO4': '0.162', 'weapon5': '0.174', 'AMMO3': '0.182', 'weapon2': '0.424', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.748', 'WEAPON3': '1.050', 'HITCOUNT': '2.310', 'weapon3': '2.384', 'DAMAGECOUNT': '10.290', 'FRAGCOUNT': '34.000'} [2023-02-25 13:17:44,034][36157] DAMAGECOUNT value on done: 75991.0 [2023-02-25 13:17:44,034][36157] Sum rewards: 49.373, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'weapon7': '0.050', 'weapon5': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'weapon2': '0.262', 'weapon4': '0.500', 'HEALTH': '0.830', 'WEAPON3': '0.900', 'HITCOUNT': '2.360', 'weapon3': '2.962', 'DAMAGECOUNT': '11.799', 'FRAGCOUNT': '41.000'} [2023-02-25 13:17:44,231][36142] DAMAGECOUNT value on done: 79206.0 [2023-02-25 13:17:44,231][36142] Sum rewards: 59.769, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.174', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.043', 'AMMO3': '0.183', 'weapon5': '0.194', 'AMMO4': '0.213', 'weapon2': '0.358', 'weapon4': '0.382', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.748', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.981', 'FRAGCOUNT': '51.000'} [2023-02-25 13:17:44,729][36114] Fps is (10 sec: 13107.1, 60 sec: 12902.4, 300 sec: 12926.7). Total num frames: 154861568. Throughput: 0: 3180.1. Samples: 1209770. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:17:44,730][36114] Avg episode reward: [(0, '47.764')] [2023-02-25 13:17:46,222][36138] Updated weights for policy 0, policy_version 37813 (0.0009) [2023-02-25 13:17:49,301][36138] Updated weights for policy 0, policy_version 37823 (0.0009) [2023-02-25 13:17:49,729][36114] Fps is (10 sec: 13107.2, 60 sec: 12834.1, 300 sec: 12926.7). Total num frames: 154927104. Throughput: 0: 3204.9. Samples: 1229546. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:17:49,730][36114] Avg episode reward: [(0, '47.764')] [2023-02-25 13:17:52,451][36138] Updated weights for policy 0, policy_version 37833 (0.0009) [2023-02-25 13:17:54,729][36114] Fps is (10 sec: 13107.3, 60 sec: 12834.1, 300 sec: 12926.7). Total num frames: 154992640. Throughput: 0: 3204.1. Samples: 1239304. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:17:54,730][36114] Avg episode reward: [(0, '47.764')] [2023-02-25 13:17:55,653][36138] Updated weights for policy 0, policy_version 37843 (0.0010) [2023-02-25 13:17:58,723][36138] Updated weights for policy 0, policy_version 37853 (0.0009) [2023-02-25 13:17:59,729][36114] Fps is (10 sec: 13107.3, 60 sec: 12834.1, 300 sec: 12926.7). Total num frames: 155058176. Throughput: 0: 3208.2. Samples: 1258872. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:17:59,730][36114] Avg episode reward: [(0, '47.764')] [2023-02-25 13:18:00,673][36155] DAMAGECOUNT value on done: 79029.0 [2023-02-25 13:18:00,674][36155] Sum rewards: 45.858, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.660', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.094', 'AMMO3': '0.115', 'AMMO4': '0.155', 'WEAPON5': '0.250', 'weapon2': '0.398', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'weapon4': '1.174', 'weapon3': '2.126', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '11.673', 'FRAGCOUNT': '39.000'} [2023-02-25 13:18:00,989][36155] DAMAGECOUNT value on done: 83553.0 [2023-02-25 13:18:00,989][36155] Sum rewards: 47.461, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.576', 'AMMO5': '0.017', 'AMMO2': '0.050', 'AMMO3': '0.242', 'AMMO4': '0.252', 'weapon5': '0.358', 'WEAPON5': '0.400', 'weapon2': '0.462', 'weapon4': '0.478', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.362', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '14.475', 'FRAGCOUNT': '45.000'} [2023-02-25 13:18:01,197][36155] DAMAGECOUNT value on done: 81929.0 [2023-02-25 13:18:01,197][36155] Sum rewards: 53.660, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.800', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO3': '0.142', 'weapon5': '0.190', 'AMMO4': '0.197', 'weapon2': '0.240', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '0.850', 'weapon4': '0.876', 'weapon3': '2.474', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '13.914', 'FRAGCOUNT': '45.000'} [2023-02-25 13:18:01,464][36139] DAMAGECOUNT value on done: 83878.0 [2023-02-25 13:18:01,465][36139] Sum rewards: 51.218, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.255', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.027', 'weapon5': '0.132', 'AMMO4': '0.137', 'weapon4': '0.194', 'AMMO3': '0.263', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.040', 'weapon3': '3.128', 'DAMAGECOUNT': '15.096', 'FRAGCOUNT': '45.000'} [2023-02-25 13:18:01,499][36155] DAMAGECOUNT value on done: 80978.0 [2023-02-25 13:18:01,499][36155] Sum rewards: 39.249, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.939', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon5': '0.136', 'AMMO3': '0.170', 'AMMO4': '0.194', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.452', 'weapon4': '0.820', 'WEAPON3': '0.950', 'HITCOUNT': '2.300', 'weapon3': '2.352', 'DAMAGECOUNT': '11.061', 'FRAGCOUNT': '36.000'} [2023-02-25 13:18:01,771][36139] DAMAGECOUNT value on done: 84988.0 [2023-02-25 13:18:01,771][36139] Sum rewards: 53.614, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.749', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon2': '0.136', 'weapon5': '0.226', 'AMMO3': '0.231', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.682', 'WEAPON3': '1.350', 'weapon3': '2.614', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '13.542', 'FRAGCOUNT': '47.000'} [2023-02-25 13:18:01,803][36138] Updated weights for policy 0, policy_version 37863 (0.0010) [2023-02-25 13:18:02,032][36139] DAMAGECOUNT value on done: 86919.0 [2023-02-25 13:18:02,032][36139] Sum rewards: 61.931, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.269', 'AMMO5': '0.017', 'AMMO2': '0.041', 'AMMO3': '0.114', 'AMMO4': '0.205', 'weapon5': '0.280', 'WEAPON4': '0.300', 'weapon2': '0.396', 'WEAPON5': '0.400', 'weapon4': '0.638', 'WEAPON3': '0.750', 'weapon3': '2.288', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '14.571', 'FRAGCOUNT': '50.000'} [2023-02-25 13:18:02,346][36139] DAMAGECOUNT value on done: 81956.0 [2023-02-25 13:18:02,347][36139] Sum rewards: 50.135, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.012', 'AMMO5': '0.016', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.163', 'WEAPON4': '0.250', 'weapon5': '0.326', 'WEAPON5': '0.350', 'weapon2': '0.404', 'weapon4': '0.696', 'WEAPON3': '0.950', 'weapon3': '2.340', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '14.148', 'FRAGCOUNT': '40.000'} [2023-02-25 13:18:03,007][36140] DAMAGECOUNT value on done: 84064.0 [2023-02-25 13:18:03,008][36140] Sum rewards: 51.540, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.345', 'AMMO2': '0.006', 'AMMO5': '0.011', 'AMMO4': '0.030', 'weapon5': '0.054', 'AMMO3': '0.108', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.460', 'weapon2': '0.720', 'WEAPON3': '0.800', 'weapon3': '2.666', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '13.089', 'FRAGCOUNT': '41.000'} [2023-02-25 13:18:03,179][36154] DAMAGECOUNT value on done: 82532.0 [2023-02-25 13:18:03,180][36154] Sum rewards: 60.107, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.332', 'AMMO2': '0.004', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'weapon2': '0.380', 'WEAPON3': '1.450', 'HITCOUNT': '3.130', 'weapon3': '3.366', 'DAMAGECOUNT': '15.075', 'FRAGCOUNT': '52.000'} [2023-02-25 13:18:03,314][36140] DAMAGECOUNT value on done: 82223.0 [2023-02-25 13:18:03,314][36140] Sum rewards: 54.955, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.474', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.088', 'AMMO4': '0.117', 'weapon4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.264', 'weapon2': '0.466', 'WEAPON3': '1.450', 'HITCOUNT': '2.860', 'weapon3': '3.092', 'DAMAGECOUNT': '14.124', 'FRAGCOUNT': '50.000'} [2023-02-25 13:18:03,476][36156] DAMAGECOUNT value on done: 84006.0 [2023-02-25 13:18:03,476][36156] Sum rewards: 45.055, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.600', 'ARMOR': '0.008', 'AMMO5': '0.008', 'AMMO2': '0.050', 'AMMO3': '0.129', 'weapon5': '0.172', 'WEAPON5': '0.200', 'AMMO4': '0.249', 'WEAPON4': '0.500', 'weapon2': '0.650', 'weapon4': '0.692', 'WEAPON3': '0.750', 'weapon3': '2.258', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '12.468', 'FRAGCOUNT': '39.500'} [2023-02-25 13:18:03,507][36154] DAMAGECOUNT value on done: 81163.0 [2023-02-25 13:18:03,507][36154] Sum rewards: 42.742, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.600', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.160', 'AMMO3': '0.172', 'AMMO4': '0.246', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON4': '0.550', 'weapon4': '0.636', 'WEAPON3': '0.950', 'HITCOUNT': '2.370', 'weapon3': '2.632', 'DAMAGECOUNT': '11.796', 'FRAGCOUNT': '39.000'} [2023-02-25 13:18:03,650][36140] DAMAGECOUNT value on done: 85146.0 [2023-02-25 13:18:03,651][36140] Sum rewards: 38.429, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.942', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.036', 'weapon5': '0.130', 'AMMO3': '0.172', 'AMMO4': '0.179', 'WEAPON5': '0.300', 'weapon2': '0.392', 'weapon4': '0.488', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.510', 'weapon3': '2.750', 'DAMAGECOUNT': '11.043', 'FRAGCOUNT': '36.000'} [2023-02-25 13:18:03,664][36157] DAMAGECOUNT value on done: 84985.0 [2023-02-25 13:18:03,665][36157] Sum rewards: 60.779, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.052', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.098', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'weapon2': '0.292', 'weapon4': '0.374', 'WEAPON3': '1.350', 'weapon3': '3.010', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.291', 'FRAGCOUNT': '52.000'} [2023-02-25 13:18:03,675][36141] DAMAGECOUNT value on done: 83805.0 [2023-02-25 13:18:03,675][36141] Sum rewards: 58.759, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.570', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon4': '0.122', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon5': '0.262', 'WEAPON5': '0.400', 'weapon2': '0.414', 'WEAPON3': '1.300', 'HITCOUNT': '2.880', 'weapon3': '2.928', 'DAMAGECOUNT': '14.991', 'FRAGCOUNT': '51.000'} [2023-02-25 13:18:03,768][36154] DAMAGECOUNT value on done: 84313.0 [2023-02-25 13:18:03,768][36154] Sum rewards: 40.360, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.835', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.061', 'AMMO3': '0.139', 'AMMO4': '0.306', 'weapon5': '0.358', 'WEAPON5': '0.500', 'weapon2': '0.522', 'WEAPON4': '0.700', 'weapon4': '0.828', 'WEAPON3': '0.850', 'weapon3': '1.906', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '12.615', 'FRAGCOUNT': '35.000'} [2023-02-25 13:18:03,816][36156] DAMAGECOUNT value on done: 85133.0 [2023-02-25 13:18:03,816][36156] Sum rewards: 39.649, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.800', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'weapon4': '0.232', 'weapon2': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'weapon5': '0.414', 'WEAPON3': '1.350', 'HITCOUNT': '2.370', 'weapon3': '2.808', 'DAMAGECOUNT': '11.238', 'FRAGCOUNT': '36.500'} [2023-02-25 13:18:03,829][36156] DAMAGECOUNT value on done: 81026.0 [2023-02-25 13:18:03,830][36156] Sum rewards: 55.507, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.831', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.025', 'weapon4': '0.044', 'WEAPON4': '0.050', 'weapon5': '0.072', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.244', 'WEAPON3': '1.250', 'HITCOUNT': '2.820', 'weapon3': '3.422', 'DAMAGECOUNT': '13.485', 'FRAGCOUNT': '48.000'} [2023-02-25 13:18:03,893][36155] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 13:18:03,910][36142] DAMAGECOUNT value on done: 79179.0 [2023-02-25 13:18:03,910][36142] Sum rewards: 48.849, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.163', 'ARMOR': '0.004', 'AMMO2': '0.031', 'weapon2': '0.154', 'AMMO4': '0.154', 'AMMO3': '0.219', 'WEAPON4': '0.450', 'weapon4': '0.734', 'WEAPON3': '1.250', 'HITCOUNT': '2.660', 'weapon3': '2.796', 'DAMAGECOUNT': '12.810', 'FRAGCOUNT': '44.000'} [2023-02-25 13:18:03,963][36140] DAMAGECOUNT value on done: 82155.0 [2023-02-25 13:18:03,964][36140] Sum rewards: 45.271, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.990', 'AMMO2': '0.012', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'weapon4': '0.142', 'AMMO3': '0.196', 'weapon2': '0.526', 'WEAPON3': '1.200', 'HITCOUNT': '2.560', 'weapon3': '3.226', 'DAMAGECOUNT': '12.240', 'FRAGCOUNT': '39.000'} [2023-02-25 13:18:03,995][36141] DAMAGECOUNT value on done: 82571.0 [2023-02-25 13:18:03,996][36141] Sum rewards: 49.906, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.940', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.138', 'AMMO3': '0.163', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON4': '0.350', 'weapon4': '0.554', 'WEAPON3': '1.000', 'HITCOUNT': '2.580', 'weapon3': '2.868', 'DAMAGECOUNT': '12.492', 'FRAGCOUNT': '43.000'} [2023-02-25 13:18:04,000][36157] DAMAGECOUNT value on done: 83346.0 [2023-02-25 13:18:04,001][36157] Sum rewards: 66.893, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.759', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.100', 'AMMO3': '0.174', 'AMMO4': '0.188', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON4': '0.550', 'weapon4': '0.914', 'WEAPON3': '1.000', 'weapon3': '2.488', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '58.000'} [2023-02-25 13:18:04,100][36154] DAMAGECOUNT value on done: 82798.0 [2023-02-25 13:18:04,100][36154] Sum rewards: 37.876, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.100', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.100', 'AMMO4': '0.203', 'AMMO3': '0.232', 'WEAPON5': '0.300', 'weapon4': '0.484', 'WEAPON4': '0.500', 'weapon2': '0.536', 'WEAPON3': '1.350', 'HITCOUNT': '2.470', 'weapon3': '2.626', 'DAMAGECOUNT': '10.623', 'FRAGCOUNT': '38.000'} [2023-02-25 13:18:04,122][36141] DAMAGECOUNT value on done: 85758.0 [2023-02-25 13:18:04,122][36141] Sum rewards: 56.334, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.627', 'AMMO5': '0.011', 'AMMO2': '0.036', 'AMMO3': '0.151', 'AMMO4': '0.178', 'weapon5': '0.196', 'weapon4': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.728', 'WEAPON3': '0.950', 'weapon3': '2.544', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '45.000'} [2023-02-25 13:18:04,158][36156] DAMAGECOUNT value on done: 79858.0 [2023-02-25 13:18:04,159][36156] Sum rewards: 45.685, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-1.855', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.138', 'AMMO4': '0.177', 'WEAPON5': '0.200', 'AMMO3': '0.294', 'weapon4': '0.312', 'WEAPON4': '0.400', 'weapon2': '0.452', 'WEAPON3': '1.550', 'HITCOUNT': '2.640', 'weapon3': '2.784', 'DAMAGECOUNT': '12.048', 'FRAGCOUNT': '46.000'} [2023-02-25 13:18:04,218][36142] DAMAGECOUNT value on done: 85230.0 [2023-02-25 13:18:04,219][36142] Sum rewards: 48.911, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.730', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.156', 'AMMO3': '0.164', 'weapon5': '0.180', 'weapon2': '0.278', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '1.044', 'WEAPON3': '1.100', 'weapon3': '2.194', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.157', 'FRAGCOUNT': '43.000'} [2023-02-25 13:18:04,280][36157] DAMAGECOUNT value on done: 85782.0 [2023-02-25 13:18:04,281][36157] Sum rewards: 44.228, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.902', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.021', 'AMMO2': '0.039', 'AMMO4': '0.194', 'AMMO3': '0.210', 'weapon5': '0.214', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon2': '0.736', 'weapon4': '0.802', 'WEAPON3': '1.300', 'weapon3': '1.870', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.110', 'FRAGCOUNT': '40.000'} [2023-02-25 13:18:04,438][36142] DAMAGECOUNT value on done: 80647.0 [2023-02-25 13:18:04,439][36142] Sum rewards: 46.119, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.076', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.048', 'weapon5': '0.092', 'AMMO3': '0.129', 'WEAPON5': '0.200', 'AMMO4': '0.242', 'weapon2': '0.390', 'WEAPON4': '0.550', 'WEAPON3': '0.750', 'weapon4': '0.920', 'weapon3': '2.296', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '11.976', 'FRAGCOUNT': '38.000'} [2023-02-25 13:18:04,451][36141] DAMAGECOUNT value on done: 79674.0 [2023-02-25 13:18:04,452][36141] Sum rewards: 51.410, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.814', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO3': '0.113', 'AMMO4': '0.158', 'WEAPON5': '0.250', 'weapon5': '0.256', 'WEAPON4': '0.400', 'weapon2': '0.594', 'weapon4': '0.604', 'WEAPON3': '0.750', 'weapon3': '2.298', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.947', 'FRAGCOUNT': '42.000'} [2023-02-25 13:18:04,598][36157] DAMAGECOUNT value on done: 79660.0 [2023-02-25 13:18:04,599][36157] Sum rewards: 38.457, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.772', 'AMMO5': '0.015', 'AMMO2': '0.051', 'AMMO3': '0.147', 'weapon5': '0.196', 'AMMO4': '0.255', 'WEAPON5': '0.350', 'weapon2': '0.588', 'weapon4': '0.640', 'WEAPON4': '0.650', 'WEAPON3': '0.950', 'weapon3': '2.310', 'HITCOUNT': '2.320', 'DAMAGECOUNT': '11.007', 'FRAGCOUNT': '36.000'} [2023-02-25 13:18:04,729][36114] Fps is (10 sec: 13107.2, 60 sec: 12902.4, 300 sec: 12940.6). Total num frames: 155123712. Throughput: 0: 3228.0. Samples: 1278546. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:18:04,730][36114] Avg episode reward: [(0, '47.937')] [2023-02-25 13:18:04,765][36142] DAMAGECOUNT value on done: 83855.0 [2023-02-25 13:18:04,766][36142] Sum rewards: 52.479, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.995', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.116', 'weapon5': '0.140', 'AMMO4': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.428', 'WEAPON3': '1.550', 'HITCOUNT': '2.850', 'weapon3': '3.098', 'DAMAGECOUNT': '13.947', 'FRAGCOUNT': '47.000'} [2023-02-25 13:18:04,998][36138] Updated weights for policy 0, policy_version 37873 (0.0009) [2023-02-25 13:18:08,007][36138] Updated weights for policy 0, policy_version 37883 (0.0010) [2023-02-25 13:18:09,729][36114] Fps is (10 sec: 13107.0, 60 sec: 12902.4, 300 sec: 12954.5). Total num frames: 155189248. Throughput: 0: 3251.1. Samples: 1288578. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:18:09,730][36114] Avg episode reward: [(0, '47.957')] [2023-02-25 13:18:11,076][36156] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 13:18:11,078][36138] Updated weights for policy 0, policy_version 37893 (0.0009) [2023-02-25 13:18:14,114][36138] Updated weights for policy 0, policy_version 37903 (0.0009) [2023-02-25 13:18:14,729][36114] Fps is (10 sec: 13517.0, 60 sec: 12970.7, 300 sec: 12954.5). Total num frames: 155258880. Throughput: 0: 3280.5. Samples: 1308652. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:18:14,729][36114] Avg episode reward: [(0, '47.957')] [2023-02-25 13:18:17,193][36138] Updated weights for policy 0, policy_version 37913 (0.0010) [2023-02-25 13:18:19,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13038.9, 300 sec: 12968.3). Total num frames: 155324416. Throughput: 0: 3296.3. Samples: 1328864. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:18:19,730][36114] Avg episode reward: [(0, '47.957')] [2023-02-25 13:18:20,231][36138] Updated weights for policy 0, policy_version 37923 (0.0009) [2023-02-25 13:18:20,783][36155] DAMAGECOUNT value on done: 83300.0 [2023-02-25 13:18:20,784][36155] Sum rewards: 42.887, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.716', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.039', 'weapon5': '0.104', 'AMMO4': '0.194', 'weapon2': '0.214', 'AMMO3': '0.227', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.768', 'WEAPON3': '1.350', 'weapon3': '2.676', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.693', 'FRAGCOUNT': '41.000'} [2023-02-25 13:18:21,118][36155] DAMAGECOUNT value on done: 87978.0 [2023-02-25 13:18:21,119][36155] Sum rewards: 45.479, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.260', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO4': '0.099', 'weapon2': '0.196', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'weapon4': '0.498', 'WEAPON3': '1.250', 'weapon3': '2.816', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.275', 'FRAGCOUNT': '40.000'} [2023-02-25 13:18:21,330][36155] DAMAGECOUNT value on done: 86639.0 [2023-02-25 13:18:21,330][36155] Sum rewards: 52.875, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.320', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'weapon2': '0.224', 'weapon4': '0.354', 'WEAPON3': '1.200', 'HITCOUNT': '3.040', 'weapon3': '3.250', 'DAMAGECOUNT': '14.130', 'FRAGCOUNT': '45.000'} [2023-02-25 13:18:21,567][36139] DAMAGECOUNT value on done: 88216.0 [2023-02-25 13:18:21,568][36139] Sum rewards: 43.469, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.090', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.257', 'weapon4': '0.268', 'weapon2': '0.318', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'HITCOUNT': '2.970', 'weapon3': '2.980', 'DAMAGECOUNT': '13.014', 'FRAGCOUNT': '41.000'} [2023-02-25 13:18:21,645][36155] DAMAGECOUNT value on done: 85748.0 [2023-02-25 13:18:21,645][36155] Sum rewards: 54.657, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.188', 'AMMO2': '0.013', 'AMMO5': '0.020', 'AMMO4': '0.066', 'weapon5': '0.172', 'WEAPON4': '0.200', 'AMMO3': '0.249', 'weapon4': '0.266', 'weapon2': '0.278', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.950', 'weapon3': '2.970', 'DAMAGECOUNT': '14.310', 'FRAGCOUNT': '49.000'} [2023-02-25 13:18:21,885][36139] DAMAGECOUNT value on done: 90119.0 [2023-02-25 13:18:21,885][36139] Sum rewards: 55.217, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.101', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon5': '0.128', 'AMMO4': '0.140', 'AMMO3': '0.196', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.382', 'weapon2': '0.390', 'WEAPON3': '1.250', 'weapon3': '2.874', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.393', 'FRAGCOUNT': '47.000'} [2023-02-25 13:18:22,080][36139] DAMAGECOUNT value on done: 90250.0 [2023-02-25 13:18:22,081][36139] Sum rewards: 39.445, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.788', 'ARMOR': '0.004', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.164', 'AMMO3': '0.181', 'weapon2': '0.214', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.714', 'WEAPON3': '1.000', 'HITCOUNT': '2.220', 'weapon3': '2.308', 'DAMAGECOUNT': '9.993', 'FRAGCOUNT': '37.000'} [2023-02-25 13:18:22,368][36139] DAMAGECOUNT value on done: 86348.0 [2023-02-25 13:18:22,369][36139] Sum rewards: 45.463, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.660', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO4': '0.181', 'AMMO3': '0.187', 'weapon5': '0.310', 'weapon4': '0.434', 'WEAPON5': '0.450', 'weapon2': '0.464', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.502', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '13.176', 'FRAGCOUNT': '42.000'} [2023-02-25 13:18:23,104][36140] DAMAGECOUNT value on done: 88322.0 [2023-02-25 13:18:23,105][36140] Sum rewards: 43.539, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.749', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.070', 'AMMO4': '0.106', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'weapon2': '0.416', 'weapon4': '0.572', 'WEAPON3': '1.550', 'weapon3': '2.658', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.774', 'FRAGCOUNT': '42.000'} [2023-02-25 13:18:23,278][36138] Updated weights for policy 0, policy_version 37933 (0.0009) [2023-02-25 13:18:23,291][36154] DAMAGECOUNT value on done: 87353.0 [2023-02-25 13:18:23,291][36154] Sum rewards: 51.194, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.518', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.033', 'weapon5': '0.118', 'AMMO4': '0.165', 'AMMO3': '0.212', 'weapon4': '0.282', 'weapon2': '0.306', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.012', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.463', 'FRAGCOUNT': '45.500'} [2023-02-25 13:18:23,416][36140] DAMAGECOUNT value on done: 87009.0 [2023-02-25 13:18:23,417][36140] Sum rewards: 57.481, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.940', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon4': '0.252', 'weapon2': '0.270', 'WEAPON3': '1.450', 'HITCOUNT': '2.860', 'weapon3': '3.130', 'DAMAGECOUNT': '14.358', 'FRAGCOUNT': '52.000'} [2023-02-25 13:18:23,591][36154] DAMAGECOUNT value on done: 84937.0 [2023-02-25 13:18:23,591][36154] Sum rewards: 43.342, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.342', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.038', 'AMMO3': '0.168', 'AMMO4': '0.188', 'weapon2': '0.196', 'weapon5': '0.212', 'WEAPON5': '0.300', 'weapon4': '0.328', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'HITCOUNT': '2.160', 'weapon3': '2.904', 'DAMAGECOUNT': '11.322', 'FRAGCOUNT': '38.000'} [2023-02-25 13:18:23,627][36156] DAMAGECOUNT value on done: 89217.0 [2023-02-25 13:18:23,628][36156] Sum rewards: 57.206, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.262', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon5': '0.132', 'AMMO4': '0.143', 'weapon4': '0.214', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.400', 'weapon3': '3.090', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.633', 'FRAGCOUNT': '49.500'} [2023-02-25 13:18:23,717][36140] DAMAGECOUNT value on done: 89684.0 [2023-02-25 13:18:23,717][36140] Sum rewards: 48.814, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.379', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.147', 'weapon5': '0.152', 'AMMO3': '0.198', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON4': '0.300', 'weapon4': '0.358', 'WEAPON3': '1.200', 'HITCOUNT': '2.700', 'weapon3': '2.966', 'DAMAGECOUNT': '13.614', 'FRAGCOUNT': '43.000'} [2023-02-25 13:18:23,721][36157] DAMAGECOUNT value on done: 89356.0 [2023-02-25 13:18:23,721][36157] Sum rewards: 48.110, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.608', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO4': '0.174', 'AMMO3': '0.199', 'weapon5': '0.250', 'weapon2': '0.268', 'WEAPON5': '0.400', 'weapon4': '0.410', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'HITCOUNT': '2.610', 'weapon3': '2.744', 'DAMAGECOUNT': '13.113', 'FRAGCOUNT': '40.500'} [2023-02-25 13:18:23,794][36141] DAMAGECOUNT value on done: 87807.0 [2023-02-25 13:18:23,794][36141] Sum rewards: 47.429, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.800', 'AMMO5': '0.021', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon2': '0.216', 'AMMO3': '0.270', 'weapon5': '0.270', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.526', 'WEAPON3': '1.550', 'weapon3': '2.622', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.006', 'FRAGCOUNT': '47.000'} [2023-02-25 13:18:23,802][36154] DAMAGECOUNT value on done: 88949.0 [2023-02-25 13:18:23,802][36154] Sum rewards: 53.102, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.540', 'AMMO5': '0.025', 'AMMO2': '0.027', 'AMMO4': '0.137', 'AMMO3': '0.150', 'weapon5': '0.150', 'weapon2': '0.238', 'WEAPON4': '0.400', 'weapon4': '0.402', 'WEAPON5': '0.600', 'WEAPON3': '0.900', 'weapon3': '2.874', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.908', 'FRAGCOUNT': '44.500'} [2023-02-25 13:18:23,926][36156] DAMAGECOUNT value on done: 89752.0 [2023-02-25 13:18:23,926][36156] Sum rewards: 45.906, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.872', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.052', 'AMMO3': '0.141', 'weapon2': '0.164', 'AMMO4': '0.261', 'weapon5': '0.440', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'weapon4': '1.102', 'weapon3': '1.962', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.857', 'FRAGCOUNT': '37.000'} [2023-02-25 13:18:23,938][36156] DAMAGECOUNT value on done: 84879.0 [2023-02-25 13:18:23,938][36156] Sum rewards: 34.179, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.317', 'AMMO5': '0.016', 'AMMO2': '0.065', 'weapon5': '0.182', 'AMMO3': '0.249', 'AMMO4': '0.323', 'weapon2': '0.370', 'ARMOR': '0.404', 'WEAPON5': '0.450', 'WEAPON4': '0.800', 'weapon4': '0.828', 'WEAPON3': '1.450', 'HITCOUNT': '2.250', 'weapon3': '2.300', 'DAMAGECOUNT': '11.559', 'FRAGCOUNT': '36.000'} [2023-02-25 13:18:23,982][36142] DAMAGECOUNT value on done: 83368.0 [2023-02-25 13:18:23,982][36142] Sum rewards: 44.949, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.926', 'AMMO5': '0.024', 'AMMO2': '0.067', 'AMMO3': '0.229', 'weapon2': '0.270', 'weapon5': '0.322', 'AMMO4': '0.336', 'WEAPON5': '0.550', 'weapon4': '0.582', 'WEAPON4': '0.750', 'WEAPON3': '1.250', 'weapon3': '2.448', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '12.567', 'FRAGCOUNT': '43.000'} [2023-02-25 13:18:24,029][36140] DAMAGECOUNT value on done: 86427.0 [2023-02-25 13:18:24,029][36157] DAMAGECOUNT value on done: 88064.0 [2023-02-25 13:18:24,029][36140] Sum rewards: 46.338, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.735', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'weapon4': '0.262', 'weapon2': '0.410', 'WEAPON3': '1.250', 'HITCOUNT': '2.710', 'weapon3': '3.192', 'DAMAGECOUNT': '12.816', 'FRAGCOUNT': '39.000'} [2023-02-25 13:18:24,029][36157] Sum rewards: 53.733, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.380', 'AMMO2': '0.010', 'AMMO5': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'weapon5': '0.142', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon4': '0.320', 'weapon2': '0.348', 'WEAPON3': '1.350', 'weapon3': '2.946', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.154', 'FRAGCOUNT': '46.000'} [2023-02-25 13:18:24,093][36141] DAMAGECOUNT value on done: 87383.0 [2023-02-25 13:18:24,093][36154] DAMAGECOUNT value on done: 87737.0 [2023-02-25 13:18:24,094][36141] Sum rewards: 51.759, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.770', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon5': '0.146', 'AMMO4': '0.173', 'AMMO3': '0.272', 'weapon2': '0.290', 'weapon4': '0.348', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.872', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.436', 'FRAGCOUNT': '48.000'} [2023-02-25 13:18:24,094][36154] Sum rewards: 57.787, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.773', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.068', 'AMMO3': '0.171', 'weapon2': '0.202', 'weapon5': '0.210', 'AMMO4': '0.339', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'weapon4': '0.900', 'WEAPON3': '1.050', 'weapon3': '2.442', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.817', 'FRAGCOUNT': '51.000'} [2023-02-25 13:18:24,214][36141] DAMAGECOUNT value on done: 89445.0 [2023-02-25 13:18:24,215][36141] Sum rewards: 33.551, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.800', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.050', 'weapon5': '0.200', 'weapon2': '0.242', 'AMMO4': '0.249', 'AMMO3': '0.272', 'WEAPON5': '0.500', 'weapon4': '0.552', 'WEAPON4': '0.650', 'WEAPON3': '1.600', 'HITCOUNT': '2.370', 'weapon3': '2.576', 'DAMAGECOUNT': '11.061', 'FRAGCOUNT': '36.000'} [2023-02-25 13:18:24,250][36156] DAMAGECOUNT value on done: 84273.0 [2023-02-25 13:18:24,251][36156] Sum rewards: 49.932, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.192', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.045', 'weapon2': '0.216', 'AMMO4': '0.225', 'AMMO3': '0.230', 'weapon5': '0.234', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.524', 'WEAPON3': '1.350', 'weapon3': '2.590', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.245', 'FRAGCOUNT': '46.000'} [2023-02-25 13:18:24,289][36142] DAMAGECOUNT value on done: 90173.0 [2023-02-25 13:18:24,290][36142] Sum rewards: 53.811, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.482', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO3': '0.180', 'weapon2': '0.180', 'AMMO4': '0.182', 'weapon5': '0.206', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon4': '1.134', 'weapon3': '2.082', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.829', 'FRAGCOUNT': '45.000'} [2023-02-25 13:18:24,291][36157] DAMAGECOUNT value on done: 91177.0 [2023-02-25 13:18:24,291][36157] Sum rewards: 63.509, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.612', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.061', 'AMMO3': '0.161', 'weapon5': '0.208', 'weapon2': '0.224', 'AMMO4': '0.304', 'WEAPON5': '0.450', 'WEAPON4': '0.700', 'weapon4': '0.878', 'WEAPON3': '1.000', 'weapon3': '2.414', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '55.000'} [2023-02-25 13:18:24,472][36142] DAMAGECOUNT value on done: 84439.0 [2023-02-25 13:18:24,473][36142] Sum rewards: 43.172, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.165', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.098', 'weapon4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'WEAPON4': '0.250', 'weapon2': '0.574', 'WEAPON3': '0.950', 'HITCOUNT': '2.490', 'weapon3': '3.014', 'DAMAGECOUNT': '11.376', 'FRAGCOUNT': '35.500'} [2023-02-25 13:18:24,506][36141] DAMAGECOUNT value on done: 84729.0 [2023-02-25 13:18:24,506][36141] Sum rewards: 60.745, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.601', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon5': '0.160', 'weapon2': '0.168', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.444', 'WEAPON3': '1.250', 'weapon3': '2.902', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.165', 'FRAGCOUNT': '53.000'} [2023-02-25 13:18:24,596][36157] DAMAGECOUNT value on done: 84378.0 [2023-02-25 13:18:24,597][36157] Sum rewards: 56.858, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.441', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.024', 'AMMO4': '0.117', 'AMMO3': '0.147', 'weapon2': '0.322', 'weapon5': '0.348', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.700', 'WEAPON3': '0.900', 'weapon3': '2.254', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.154', 'FRAGCOUNT': '49.000'} [2023-02-25 13:18:24,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13175.5, 300 sec: 12982.2). Total num frames: 155389952. Throughput: 0: 3303.8. Samples: 1338940. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:18:24,730][36114] Avg episode reward: [(0, '48.732')] [2023-02-25 13:18:24,787][36142] DAMAGECOUNT value on done: 88616.0 [2023-02-25 13:18:24,788][36142] Sum rewards: 55.620, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.800', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon5': '0.048', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'WEAPON4': '0.300', 'weapon4': '0.388', 'weapon2': '0.680', 'WEAPON3': '1.150', 'weapon3': '2.574', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.283', 'FRAGCOUNT': '48.000'} [2023-02-25 13:18:26,297][36138] Updated weights for policy 0, policy_version 37943 (0.0009) [2023-02-25 13:18:29,334][36138] Updated weights for policy 0, policy_version 37953 (0.0009) [2023-02-25 13:18:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13243.7, 300 sec: 12996.1). Total num frames: 155459584. Throughput: 0: 3322.4. Samples: 1359280. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:18:29,730][36114] Avg episode reward: [(0, '48.881')] [2023-02-25 13:18:32,353][36138] Updated weights for policy 0, policy_version 37963 (0.0009) [2023-02-25 13:18:34,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13243.7, 300 sec: 12996.1). Total num frames: 155525120. Throughput: 0: 3331.6. Samples: 1379470. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:18:34,730][36114] Avg episode reward: [(0, '48.881')] [2023-02-25 13:18:35,387][36138] Updated weights for policy 0, policy_version 37973 (0.0009) [2023-02-25 13:18:38,404][36138] Updated weights for policy 0, policy_version 37983 (0.0010) [2023-02-25 13:18:39,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13312.0, 300 sec: 13010.0). Total num frames: 155594752. Throughput: 0: 3340.3. Samples: 1389618. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:18:39,730][36114] Avg episode reward: [(0, '48.881')] [2023-02-25 13:18:40,713][36155] DAMAGECOUNT value on done: 88123.0 [2023-02-25 13:18:40,713][36155] Sum rewards: 53.573, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.380', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.086', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.254', 'weapon4': '0.412', 'WEAPON3': '1.500', 'weapon3': '3.052', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.469', 'FRAGCOUNT': '47.500'} [2023-02-25 13:18:41,016][36155] DAMAGECOUNT value on done: 92259.0 [2023-02-25 13:18:41,017][36155] Sum rewards: 40.267, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.270', 'ARMOR': '0.004', 'AMMO5': '0.030', 'AMMO2': '0.076', 'AMMO3': '0.158', 'weapon2': '0.268', 'AMMO4': '0.381', 'weapon5': '0.432', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'weapon4': '0.922', 'WEAPON3': '0.950', 'weapon3': '1.802', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '12.843', 'FRAGCOUNT': '38.000'} [2023-02-25 13:18:41,222][36155] DAMAGECOUNT value on done: 91029.0 [2023-02-25 13:18:41,223][36155] Sum rewards: 49.882, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.088', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.033', 'AMMO3': '0.138', 'AMMO4': '0.166', 'weapon5': '0.270', 'WEAPON5': '0.350', 'weapon2': '0.422', 'WEAPON4': '0.450', 'weapon4': '0.796', 'WEAPON3': '0.850', 'weapon3': '2.234', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.170', 'FRAGCOUNT': '42.000'} [2023-02-25 13:18:41,419][36138] Updated weights for policy 0, policy_version 37993 (0.0010) [2023-02-25 13:18:41,476][36139] DAMAGECOUNT value on done: 92098.0 [2023-02-25 13:18:41,476][36139] Sum rewards: 48.941, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.538', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.066', 'AMMO3': '0.145', 'AMMO4': '0.187', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon2': '0.548', 'weapon4': '0.682', 'WEAPON3': '0.800', 'weapon3': '2.516', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '11.646', 'FRAGCOUNT': '43.000'} [2023-02-25 13:18:41,526][36155] DAMAGECOUNT value on done: 90599.0 [2023-02-25 13:18:41,526][36155] Sum rewards: 54.575, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.180', 'AMMO5': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.112', 'WEAPON5': '0.150', 'weapon2': '0.180', 'WEAPON4': '0.200', 'AMMO3': '0.241', 'weapon4': '0.582', 'WEAPON3': '1.200', 'weapon3': '2.870', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.553', 'FRAGCOUNT': '45.500'} [2023-02-25 13:18:41,778][36139] DAMAGECOUNT value on done: 95013.0 [2023-02-25 13:18:41,779][36139] Sum rewards: 49.685, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.750', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.022', 'weapon5': '0.080', 'AMMO4': '0.109', 'AMMO3': '0.288', 'weapon2': '0.396', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.432', 'WEAPON3': '1.700', 'weapon3': '2.832', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.682', 'FRAGCOUNT': '46.000'} [2023-02-25 13:18:41,923][36139] DAMAGECOUNT value on done: 94676.0 [2023-02-25 13:18:41,924][36139] Sum rewards: 43.424, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.568', 'AMMO5': '0.026', 'AMMO2': '0.050', 'AMMO3': '0.179', 'AMMO4': '0.249', 'weapon5': '0.262', 'weapon2': '0.272', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'weapon4': '0.862', 'WEAPON3': '1.100', 'weapon3': '2.254', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '12.918', 'FRAGCOUNT': '39.000'} [2023-02-25 13:18:42,236][36139] DAMAGECOUNT value on done: 90959.0 [2023-02-25 13:18:42,237][36139] Sum rewards: 49.506, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.319', 'AMMO5': '0.014', 'AMMO2': '0.032', 'AMMO4': '0.162', 'weapon5': '0.182', 'AMMO3': '0.203', 'weapon2': '0.216', 'weapon4': '0.238', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.830', 'weapon3': '3.114', 'DAMAGECOUNT': '13.833', 'FRAGCOUNT': '44.000'} [2023-02-25 13:18:42,912][36140] DAMAGECOUNT value on done: 93102.0 [2023-02-25 13:18:42,913][36140] Sum rewards: 53.737, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.250', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon5': '0.082', 'AMMO4': '0.098', 'AMMO3': '0.160', 'weapon2': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.958', 'WEAPON3': '1.100', 'weapon3': '2.602', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.340', 'FRAGCOUNT': '45.000'} [2023-02-25 13:18:43,137][36154] DAMAGECOUNT value on done: 92477.0 [2023-02-25 13:18:43,137][36154] Sum rewards: 55.975, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.092', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.116', 'AMMO3': '0.173', 'weapon5': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.450', 'weapon2': '0.456', 'weapon4': '0.948', 'WEAPON3': '1.000', 'weapon3': '2.170', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.372', 'FRAGCOUNT': '48.000'} [2023-02-25 13:18:43,222][36140] DAMAGECOUNT value on done: 91002.0 [2023-02-25 13:18:43,224][36140] Sum rewards: 43.377, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.368', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.086', 'weapon5': '0.130', 'AMMO4': '0.149', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.346', 'WEAPON3': '1.300', 'HITCOUNT': '2.400', 'weapon3': '3.082', 'DAMAGECOUNT': '11.979', 'FRAGCOUNT': '41.000'} [2023-02-25 13:18:43,446][36154] DAMAGECOUNT value on done: 89580.0 [2023-02-25 13:18:43,447][36154] Sum rewards: 54.096, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.018', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'weapon5': '0.208', 'weapon4': '0.260', 'weapon2': '0.568', 'WEAPON3': '0.950', 'HITCOUNT': '2.760', 'weapon3': '2.802', 'DAMAGECOUNT': '13.929', 'FRAGCOUNT': '45.500'} [2023-02-25 13:18:43,498][36156] DAMAGECOUNT value on done: 93160.0 [2023-02-25 13:18:43,499][36156] Sum rewards: 49.567, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.357', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'weapon2': '0.348', 'weapon4': '0.542', 'WEAPON3': '1.050', 'HITCOUNT': '2.730', 'weapon3': '2.820', 'DAMAGECOUNT': '11.829', 'FRAGCOUNT': '41.500'} [2023-02-25 13:18:43,586][36140] DAMAGECOUNT value on done: 93446.0 [2023-02-25 13:18:43,586][36140] Sum rewards: 41.863, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.628', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.108', 'AMMO4': '0.148', 'AMMO3': '0.179', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.312', 'weapon4': '0.422', 'WEAPON3': '1.000', 'HITCOUNT': '2.240', 'weapon3': '2.954', 'DAMAGECOUNT': '11.286', 'FRAGCOUNT': '37.000'} [2023-02-25 13:18:43,636][36157] DAMAGECOUNT value on done: 93883.0 [2023-02-25 13:18:43,637][36157] Sum rewards: 53.070, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.160', 'AMMO5': '0.009', 'AMMO2': '0.012', 'weapon5': '0.020', 'AMMO4': '0.062', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.334', 'weapon4': '0.370', 'WEAPON3': '1.300', 'HITCOUNT': '3.050', 'weapon3': '3.122', 'DAMAGECOUNT': '13.581', 'FRAGCOUNT': '47.000'} [2023-02-25 13:18:43,653][36141] DAMAGECOUNT value on done: 92385.0 [2023-02-25 13:18:43,653][36141] Sum rewards: 55.097, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.597', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon5': '0.048', 'AMMO4': '0.136', 'AMMO3': '0.146', 'weapon4': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.356', 'WEAPON3': '0.900', 'HITCOUNT': '3.150', 'weapon3': '3.190', 'DAMAGECOUNT': '13.734', 'FRAGCOUNT': '46.000'} [2023-02-25 13:18:43,686][36154] DAMAGECOUNT value on done: 93386.0 [2023-02-25 13:18:43,687][36154] Sum rewards: 55.078, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.678', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon2': '0.144', 'AMMO3': '0.263', 'WEAPON3': '1.450', 'HITCOUNT': '2.560', 'weapon3': '3.580', 'DAMAGECOUNT': '13.311', 'FRAGCOUNT': '50.000'} [2023-02-25 13:18:43,806][36156] DAMAGECOUNT value on done: 93813.0 [2023-02-25 13:18:43,807][36156] Sum rewards: 42.054, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.302', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.126', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.328', 'WEAPON4': '0.350', 'weapon4': '0.598', 'WEAPON3': '1.350', 'weapon3': '2.752', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.183', 'FRAGCOUNT': '40.000'} [2023-02-25 13:18:43,820][36156] DAMAGECOUNT value on done: 89703.0 [2023-02-25 13:18:43,820][36156] Sum rewards: 50.480, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.220', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon5': '0.162', 'AMMO4': '0.188', 'AMMO3': '0.216', 'weapon4': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.472', 'WEAPON3': '1.300', 'weapon3': '2.760', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '14.442', 'FRAGCOUNT': '45.000'} [2023-02-25 13:18:43,898][36140] DAMAGECOUNT value on done: 89937.0 [2023-02-25 13:18:43,899][36140] Sum rewards: 44.168, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.661', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.212', 'weapon4': '0.380', 'weapon2': '0.694', 'WEAPON3': '0.750', 'HITCOUNT': '2.440', 'weapon3': '2.556', 'DAMAGECOUNT': '10.530', 'FRAGCOUNT': '35.000'} [2023-02-25 13:18:43,942][36157] DAMAGECOUNT value on done: 92457.0 [2023-02-25 13:18:43,943][36157] Sum rewards: 50.536, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.662', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon2': '0.174', 'weapon5': '0.178', 'AMMO3': '0.182', 'AMMO4': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.738', 'WEAPON3': '1.150', 'weapon3': '2.578', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.179', 'FRAGCOUNT': '43.000'} [2023-02-25 13:18:43,947][36142] DAMAGECOUNT value on done: 88216.0 [2023-02-25 13:18:43,948][36142] Sum rewards: 58.166, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.311', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.090', 'AMMO4': '0.165', 'AMMO3': '0.183', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.412', 'weapon2': '0.430', 'WEAPON3': '1.100', 'weapon3': '2.860', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.544', 'FRAGCOUNT': '51.000'} [2023-02-25 13:18:43,953][36141] DAMAGECOUNT value on done: 93204.0 [2023-02-25 13:18:43,953][36141] Sum rewards: 60.407, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.207', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.078', 'weapon5': '0.080', 'AMMO4': '0.090', 'weapon2': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'WEAPON3': '1.400', 'HITCOUNT': '3.200', 'weapon3': '3.488', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '51.000'} [2023-02-25 13:18:43,984][36154] DAMAGECOUNT value on done: 93056.0 [2023-02-25 13:18:43,984][36154] Sum rewards: 66.623, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.162', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon5': '0.160', 'AMMO4': '0.164', 'AMMO3': '0.184', 'weapon2': '0.208', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.514', 'WEAPON3': '1.100', 'weapon3': '2.740', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.957', 'FRAGCOUNT': '56.000'} [2023-02-25 13:18:44,053][36141] DAMAGECOUNT value on done: 93553.0 [2023-02-25 13:18:44,053][36141] Sum rewards: 48.856, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.962', 'AMMO5': '0.019', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon2': '0.180', 'AMMO3': '0.201', 'weapon5': '0.218', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.846', 'WEAPON3': '1.150', 'weapon3': '2.448', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.324', 'FRAGCOUNT': '43.500'} [2023-02-25 13:18:44,119][36156] DAMAGECOUNT value on done: 88753.0 [2023-02-25 13:18:44,119][36156] Sum rewards: 48.906, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.439', 'AMMO5': '0.009', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.152', 'weapon5': '0.152', 'WEAPON5': '0.250', 'weapon2': '0.356', 'WEAPON4': '0.450', 'weapon4': '0.778', 'WEAPON3': '0.950', 'weapon3': '2.476', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.440', 'FRAGCOUNT': '41.000'} [2023-02-25 13:18:44,230][36157] DAMAGECOUNT value on done: 94929.0 [2023-02-25 13:18:44,231][36157] Sum rewards: 41.491, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.552', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.017', 'weapon5': '0.066', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'weapon2': '0.198', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon4': '0.616', 'WEAPON3': '1.250', 'HITCOUNT': '2.540', 'weapon3': '2.946', 'DAMAGECOUNT': '11.256', 'FRAGCOUNT': '38.000'} [2023-02-25 13:18:44,254][36142] DAMAGECOUNT value on done: 94690.0 [2023-02-25 13:18:44,255][36142] Sum rewards: 52.101, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.908', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.071', 'WEAPON4': '0.150', 'weapon5': '0.188', 'weapon4': '0.190', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.300', 'HITCOUNT': '2.910', 'weapon3': '3.104', 'DAMAGECOUNT': '13.551', 'FRAGCOUNT': '46.000'} [2023-02-25 13:18:44,347][36141] DAMAGECOUNT value on done: 88335.0 [2023-02-25 13:18:44,347][36141] Sum rewards: 37.377, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.220', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.138', 'AMMO4': '0.170', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.442', 'weapon2': '0.588', 'WEAPON3': '1.100', 'HITCOUNT': '2.230', 'weapon3': '2.578', 'DAMAGECOUNT': '10.818', 'FRAGCOUNT': '34.000'} [2023-02-25 13:18:44,410][36142] DAMAGECOUNT value on done: 89138.0 [2023-02-25 13:18:44,411][36142] Sum rewards: 53.526, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.531', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.047', 'AMMO3': '0.207', 'weapon5': '0.208', 'AMMO4': '0.233', 'weapon2': '0.284', 'WEAPON5': '0.350', 'weapon4': '0.386', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.820', 'weapon3': '2.860', 'DAMAGECOUNT': '14.097', 'FRAGCOUNT': '47.000'} [2023-02-25 13:18:44,504][36138] Updated weights for policy 0, policy_version 38003 (0.0010) [2023-02-25 13:18:44,541][36157] DAMAGECOUNT value on done: 88829.0 [2023-02-25 13:18:44,541][36157] Sum rewards: 47.526, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.080', 'AMMO5': '0.009', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.170', 'weapon4': '0.172', 'weapon2': '0.184', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '2.610', 'weapon3': '3.206', 'DAMAGECOUNT': '13.353', 'FRAGCOUNT': '44.000'} [2023-02-25 13:18:44,715][36142] DAMAGECOUNT value on done: 93355.0 [2023-02-25 13:18:44,715][36142] Sum rewards: 52.505, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.306', 'AMMO5': '0.020', 'AMMO2': '0.042', 'weapon5': '0.130', 'weapon2': '0.162', 'AMMO4': '0.209', 'AMMO3': '0.215', 'weapon4': '0.294', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.920', 'weapon3': '3.102', 'DAMAGECOUNT': '14.217', 'FRAGCOUNT': '47.000'} [2023-02-25 13:18:44,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13312.0, 300 sec: 13023.9). Total num frames: 155660288. Throughput: 0: 3355.2. Samples: 1409854. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:18:44,730][36114] Avg episode reward: [(0, '49.567')] [2023-02-25 13:18:46,233][36139] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 13:18:47,532][36138] Updated weights for policy 0, policy_version 38013 (0.0009) [2023-02-25 13:18:49,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13051.7). Total num frames: 155729920. Throughput: 0: 3370.3. Samples: 1430208. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:18:49,730][36114] Avg episode reward: [(0, '49.567')] [2023-02-25 13:18:50,541][36138] Updated weights for policy 0, policy_version 38023 (0.0009) [2023-02-25 13:18:53,536][36157] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:18:53,581][36138] Updated weights for policy 0, policy_version 38033 (0.0009) [2023-02-25 13:18:54,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13051.7). Total num frames: 155795456. Throughput: 0: 3374.3. Samples: 1440420. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:18:54,730][36114] Avg episode reward: [(0, '49.567')] [2023-02-25 13:18:56,622][36138] Updated weights for policy 0, policy_version 38043 (0.0009) [2023-02-25 13:18:59,622][36138] Updated weights for policy 0, policy_version 38053 (0.0009) [2023-02-25 13:18:59,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13079.4). Total num frames: 155865088. Throughput: 0: 3377.3. Samples: 1460630. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:18:59,730][36114] Avg episode reward: [(0, '49.567')] [2023-02-25 13:19:00,504][36155] DAMAGECOUNT value on done: 91986.0 [2023-02-25 13:19:00,504][36155] Sum rewards: 40.656, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.488', 'AMMO5': '0.025', 'AMMO2': '0.077', 'AMMO3': '0.170', 'weapon5': '0.194', 'weapon2': '0.304', 'AMMO4': '0.387', 'WEAPON5': '0.600', 'WEAPON4': '0.800', 'WEAPON3': '0.950', 'weapon4': '1.152', 'weapon3': '1.936', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '11.589', 'FRAGCOUNT': '38.000'} [2023-02-25 13:19:00,807][36155] DAMAGECOUNT value on done: 96967.0 [2023-02-25 13:19:00,808][36155] Sum rewards: 52.782, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.450', 'ARMOR': '0.004', 'AMMO2': '0.014', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.071', 'weapon5': '0.080', 'WEAPON4': '0.150', 'weapon4': '0.172', 'weapon2': '0.238', 'AMMO3': '0.239', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.050', 'weapon3': '3.252', 'DAMAGECOUNT': '14.124', 'FRAGCOUNT': '47.000'} [2023-02-25 13:19:01,005][36155] DAMAGECOUNT value on done: 96131.0 [2023-02-25 13:19:01,006][36155] Sum rewards: 57.617, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.630', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.058', 'WEAPON5': '0.150', 'weapon4': '0.162', 'AMMO4': '0.165', 'AMMO3': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.396', 'WEAPON3': '1.550', 'HITCOUNT': '3.150', 'weapon3': '3.166', 'DAMAGECOUNT': '15.306', 'FRAGCOUNT': '53.000'} [2023-02-25 13:19:01,285][36155] DAMAGECOUNT value on done: 94640.0 [2023-02-25 13:19:01,286][36155] Sum rewards: 42.165, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.904', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.035', 'AMMO4': '0.177', 'AMMO3': '0.186', 'weapon5': '0.214', 'weapon2': '0.230', 'weapon4': '0.240', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.570', 'weapon3': '3.070', 'DAMAGECOUNT': '12.123', 'FRAGCOUNT': '39.000'} [2023-02-25 13:19:01,294][36139] DAMAGECOUNT value on done: 95734.0 [2023-02-25 13:19:01,295][36139] Sum rewards: 40.592, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.430', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.156', 'AMMO3': '0.195', 'weapon2': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.552', 'WEAPON3': '1.200', 'HITCOUNT': '2.700', 'weapon3': '2.858', 'DAMAGECOUNT': '10.908', 'FRAGCOUNT': '37.000'} [2023-02-25 13:19:01,594][36139] DAMAGECOUNT value on done: 99460.0 [2023-02-25 13:19:01,595][36139] Sum rewards: 55.310, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.068', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon5': '0.136', 'AMMO3': '0.175', 'weapon2': '0.224', 'AMMO4': '0.274', 'WEAPON5': '0.400', 'weapon4': '0.460', 'WEAPON4': '0.600', 'WEAPON3': '1.000', 'HITCOUNT': '2.800', 'weapon3': '2.888', 'DAMAGECOUNT': '13.341', 'FRAGCOUNT': '49.000'} [2023-02-25 13:19:01,734][36139] DAMAGECOUNT value on done: 99200.0 [2023-02-25 13:19:01,734][36139] Sum rewards: 47.296, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.168', 'AMMO2': '0.016', 'AMMO5': '0.020', 'AMMO4': '0.078', 'weapon5': '0.210', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'weapon4': '0.352', 'WEAPON5': '0.400', 'weapon2': '0.548', 'WEAPON3': '1.300', 'weapon3': '2.598', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.572', 'FRAGCOUNT': '40.500'} [2023-02-25 13:19:02,050][36139] DAMAGECOUNT value on done: 95594.0 [2023-02-25 13:19:02,051][36139] Sum rewards: 51.654, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.320', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon5': '0.086', 'AMMO4': '0.189', 'AMMO3': '0.217', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.400', 'weapon4': '0.566', 'WEAPON3': '1.250', 'weapon3': '2.702', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.782', 'FRAGCOUNT': '47.500'} [2023-02-25 13:19:02,649][36138] Updated weights for policy 0, policy_version 38063 (0.0009) [2023-02-25 13:19:02,930][36140] DAMAGECOUNT value on done: 98056.0 [2023-02-25 13:19:02,931][36140] Sum rewards: 55.609, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.616', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.092', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'weapon5': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'weapon2': '0.312', 'WEAPON3': '1.350', 'HITCOUNT': '2.880', 'weapon3': '3.226', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '48.000'} [2023-02-25 13:19:02,974][36154] DAMAGECOUNT value on done: 98228.0 [2023-02-25 13:19:02,974][36154] Sum rewards: 67.657, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.690', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.170', 'weapon4': '0.284', 'AMMO3': '0.292', 'WEAPON3': '1.800', 'weapon3': '3.232', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '61.000'} [2023-02-25 13:19:03,235][36140] DAMAGECOUNT value on done: 95663.0 [2023-02-25 13:19:03,236][36140] Sum rewards: 45.090, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.585', 'ARMOR': '0.004', 'AMMO5': '0.026', 'AMMO2': '0.044', 'weapon5': '0.190', 'AMMO3': '0.206', 'AMMO4': '0.220', 'weapon2': '0.356', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon4': '0.630', 'WEAPON3': '1.200', 'weapon3': '2.426', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.983', 'FRAGCOUNT': '41.500'} [2023-02-25 13:19:03,280][36154] DAMAGECOUNT value on done: 93541.0 [2023-02-25 13:19:03,281][36154] Sum rewards: 47.400, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.774', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.046', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.160', 'AMMO4': '0.231', 'WEAPON4': '0.400', 'ARMOR': '0.457', 'weapon2': '0.512', 'weapon4': '0.636', 'WEAPON3': '0.900', 'weapon3': '2.434', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '11.883', 'FRAGCOUNT': '41.000'} [2023-02-25 13:19:03,415][36156] DAMAGECOUNT value on done: 97782.0 [2023-02-25 13:19:03,416][36156] Sum rewards: 52.434, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.730', 'AMMO5': '0.027', 'AMMO2': '0.058', 'AMMO3': '0.191', 'weapon5': '0.244', 'weapon4': '0.268', 'AMMO4': '0.292', 'weapon2': '0.298', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.050', 'HITCOUNT': '2.530', 'weapon3': '2.690', 'DAMAGECOUNT': '13.866', 'FRAGCOUNT': '48.000'} [2023-02-25 13:19:03,497][36154] DAMAGECOUNT value on done: 98375.0 [2023-02-25 13:19:03,497][36154] Sum rewards: 61.178, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.009', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon5': '0.102', 'AMMO4': '0.120', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.388', 'weapon4': '0.426', 'WEAPON3': '1.150', 'weapon3': '2.910', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.967', 'FRAGCOUNT': '52.000'} [2023-02-25 13:19:03,537][36157] DAMAGECOUNT value on done: 97655.0 [2023-02-25 13:19:03,537][36157] Sum rewards: 36.406, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.618', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.155', 'WEAPON5': '0.200', 'weapon5': '0.224', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.300', 'weapon4': '0.708', 'WEAPON3': '1.450', 'HITCOUNT': '2.240', 'weapon3': '2.396', 'DAMAGECOUNT': '11.316', 'FRAGCOUNT': '36.000'} [2023-02-25 13:19:03,540][36141] DAMAGECOUNT value on done: 96791.0 [2023-02-25 13:19:03,541][36141] Sum rewards: 48.902, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.794', 'AMMO5': '0.017', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.162', 'AMMO3': '0.177', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.468', 'weapon4': '0.696', 'WEAPON3': '1.050', 'weapon3': '2.384', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.218', 'FRAGCOUNT': '43.000'} [2023-02-25 13:19:03,561][36140] DAMAGECOUNT value on done: 98183.0 [2023-02-25 13:19:03,561][36140] Sum rewards: 50.726, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.860', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon5': '0.180', 'AMMO4': '0.189', 'AMMO3': '0.244', 'weapon4': '0.298', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.600', 'weapon3': '2.872', 'DAMAGECOUNT': '14.211', 'FRAGCOUNT': '47.500'} [2023-02-25 13:19:03,728][36156] DAMAGECOUNT value on done: 98218.0 [2023-02-25 13:19:03,729][36156] Sum rewards: 51.641, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.512', 'AMMO5': '0.012', 'AMMO2': '0.018', 'weapon5': '0.090', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon2': '0.218', 'AMMO3': '0.274', 'weapon4': '0.328', 'WEAPON3': '1.600', 'HITCOUNT': '2.870', 'weapon3': '3.136', 'DAMAGECOUNT': '13.215', 'FRAGCOUNT': '47.000'} [2023-02-25 13:19:03,740][36156] DAMAGECOUNT value on done: 94051.0 [2023-02-25 13:19:03,741][36156] Sum rewards: 47.592, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.205', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.066', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.322', 'weapon2': '0.432', 'WEAPON3': '1.300', 'HITCOUNT': '2.620', 'weapon3': '2.958', 'DAMAGECOUNT': '12.879', 'FRAGCOUNT': '43.000'} [2023-02-25 13:19:03,792][36154] DAMAGECOUNT value on done: 97547.0 [2023-02-25 13:19:03,792][36154] Sum rewards: 51.562, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.090', 'AMMO5': '0.004', 'AMMO2': '0.018', 'weapon5': '0.064', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.298', 'weapon4': '0.380', 'weapon2': '0.480', 'WEAPON3': '1.700', 'weapon3': '2.784', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.473', 'FRAGCOUNT': '48.000'} [2023-02-25 13:19:03,821][36157] DAMAGECOUNT value on done: 96528.0 [2023-02-25 13:19:03,822][36157] Sum rewards: 48.532, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.631', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.056', 'weapon2': '0.178', 'AMMO3': '0.225', 'weapon5': '0.266', 'AMMO4': '0.278', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.604', 'WEAPON3': '1.250', 'HITCOUNT': '2.370', 'weapon3': '2.598', 'DAMAGECOUNT': '12.213', 'FRAGCOUNT': '45.000'} [2023-02-25 13:19:03,823][36141] DAMAGECOUNT value on done: 97976.0 [2023-02-25 13:19:03,824][36141] Sum rewards: 63.968, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.405', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.028', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'weapon2': '0.196', 'weapon4': '0.302', 'ARMOR': '0.400', 'WEAPON3': '0.950', 'HITCOUNT': '2.730', 'weapon3': '3.314', 'DAMAGECOUNT': '14.166', 'FRAGCOUNT': '53.000'} [2023-02-25 13:19:03,859][36140] DAMAGECOUNT value on done: 94705.0 [2023-02-25 13:19:03,859][36140] Sum rewards: 53.235, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.347', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.039', 'weapon5': '0.112', 'weapon2': '0.174', 'AMMO4': '0.197', 'AMMO3': '0.207', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.456', 'WEAPON3': '1.350', 'weapon3': '3.036', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.304', 'FRAGCOUNT': '47.000'} [2023-02-25 13:19:03,899][36142] DAMAGECOUNT value on done: 92657.0 [2023-02-25 13:19:03,900][36142] Sum rewards: 44.017, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.888', 'AMMO5': '0.023', 'AMMO2': '0.048', 'weapon5': '0.218', 'AMMO3': '0.229', 'AMMO4': '0.241', 'weapon2': '0.268', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'weapon4': '0.786', 'WEAPON3': '1.250', 'weapon3': '2.228', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '13.323', 'FRAGCOUNT': '40.000'} [2023-02-25 13:19:03,940][36141] DAMAGECOUNT value on done: 97883.0 [2023-02-25 13:19:03,940][36141] Sum rewards: 44.030, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.047', 'AMMO5': '0.019', 'AMMO2': '0.036', 'AMMO4': '0.177', 'AMMO3': '0.229', 'weapon5': '0.248', 'weapon4': '0.386', 'WEAPON4': '0.500', 'weapon2': '0.522', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.500', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '12.990', 'FRAGCOUNT': '40.000'} [2023-02-25 13:19:04,055][36156] DAMAGECOUNT value on done: 93651.0 [2023-02-25 13:19:04,056][36156] Sum rewards: 49.709, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.468', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon5': '0.186', 'weapon2': '0.204', 'AMMO3': '0.213', 'AMMO4': '0.270', 'WEAPON5': '0.300', 'weapon4': '0.484', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.854', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.679', 'FRAGCOUNT': '44.500'} [2023-02-25 13:19:04,132][36157] DAMAGECOUNT value on done: 99464.0 [2023-02-25 13:19:04,132][36157] Sum rewards: 52.737, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.850', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'weapon2': '0.252', 'weapon4': '0.324', 'WEAPON3': '1.200', 'HITCOUNT': '2.940', 'weapon3': '3.150', 'DAMAGECOUNT': '13.605', 'FRAGCOUNT': '46.000'} [2023-02-25 13:19:04,223][36142] DAMAGECOUNT value on done: 99413.0 [2023-02-25 13:19:04,223][36142] Sum rewards: 52.247, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.846', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon5': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon2': '0.306', 'weapon4': '0.358', 'WEAPON3': '1.100', 'HITCOUNT': '3.000', 'weapon3': '3.026', 'DAMAGECOUNT': '14.169', 'FRAGCOUNT': '44.000'} [2023-02-25 13:19:04,253][36141] DAMAGECOUNT value on done: 92855.0 [2023-02-25 13:19:04,254][36141] Sum rewards: 48.326, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.151', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon5': '0.158', 'AMMO3': '0.206', 'AMMO4': '0.226', 'WEAPON5': '0.250', 'weapon4': '0.384', 'weapon2': '0.386', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.822', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.560', 'FRAGCOUNT': '45.000'} [2023-02-25 13:19:04,388][36142] DAMAGECOUNT value on done: 93571.0 [2023-02-25 13:19:04,388][36142] Sum rewards: 43.788, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.212', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.136', 'weapon4': '0.180', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.528', 'WEAPON3': '1.450', 'HITCOUNT': '2.360', 'weapon3': '2.810', 'DAMAGECOUNT': '12.999', 'FRAGCOUNT': '41.000'} [2023-02-25 13:19:04,444][36157] DAMAGECOUNT value on done: 93607.0 [2023-02-25 13:19:04,444][36157] Sum rewards: 49.306, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.025', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.110', 'AMMO4': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon2': '0.302', 'WEAPON4': '0.350', 'weapon4': '0.668', 'WEAPON3': '1.300', 'weapon3': '2.668', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.259', 'FRAGCOUNT': '44.500'} [2023-02-25 13:19:04,685][36142] DAMAGECOUNT value on done: 98334.0 [2023-02-25 13:19:04,686][36142] Sum rewards: 59.876, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.280', 'AMMO5': '0.019', 'AMMO2': '0.051', 'weapon5': '0.096', 'AMMO3': '0.198', 'AMMO4': '0.253', 'WEAPON4': '0.350', 'weapon2': '0.390', 'WEAPON5': '0.400', 'weapon4': '0.670', 'WEAPON3': '1.150', 'weapon3': '2.472', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '14.937', 'FRAGCOUNT': '51.000'} [2023-02-25 13:19:04,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13093.3). Total num frames: 155930624. Throughput: 0: 3376.7. Samples: 1480814. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:19:04,730][36114] Avg episode reward: [(0, '49.905')] [2023-02-25 13:19:04,730][36125] Saving new best policy, reward=49.905! [2023-02-25 13:19:05,705][36138] Updated weights for policy 0, policy_version 38073 (0.0010) [2023-02-25 13:19:07,768][36140] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 13:19:08,730][36138] Updated weights for policy 0, policy_version 38083 (0.0009) [2023-02-25 13:19:09,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13107.2). Total num frames: 156000256. Throughput: 0: 3379.7. Samples: 1491026. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:19:09,730][36114] Avg episode reward: [(0, '49.905')] [2023-02-25 13:19:11,799][36138] Updated weights for policy 0, policy_version 38093 (0.0009) [2023-02-25 13:19:14,527][36139] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 13:19:14,729][36114] Fps is (10 sec: 13516.6, 60 sec: 13448.5, 300 sec: 13121.1). Total num frames: 156065792. Throughput: 0: 3376.6. Samples: 1511228. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:19:14,730][36114] Avg episode reward: [(0, '49.905')] [2023-02-25 13:19:14,815][36138] Updated weights for policy 0, policy_version 38103 (0.0010) [2023-02-25 13:19:16,394][36155] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:19:17,877][36138] Updated weights for policy 0, policy_version 38113 (0.0010) [2023-02-25 13:19:19,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13135.0). Total num frames: 156135424. Throughput: 0: 3379.6. Samples: 1531552. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:19:19,730][36114] Avg episode reward: [(0, '49.905')] [2023-02-25 13:19:19,734][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000038119_156135424.pth... [2023-02-25 13:19:19,790][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000037351_152989696.pth [2023-02-25 13:19:20,395][36155] DAMAGECOUNT value on done: 95580.0 [2023-02-25 13:19:20,395][36155] Sum rewards: 35.972, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.878', 'ARMOR': '0.004', 'AMMO5': '0.028', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon5': '0.230', 'AMMO3': '0.253', 'WEAPON4': '0.450', 'weapon2': '0.458', 'weapon4': '0.476', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'HITCOUNT': '2.240', 'weapon3': '2.470', 'DAMAGECOUNT': '10.782', 'FRAGCOUNT': '35.000'} [2023-02-25 13:19:20,699][36155] DAMAGECOUNT value on done: 101774.0 [2023-02-25 13:19:20,700][36155] Sum rewards: 52.907, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.110', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO3': '0.132', 'AMMO4': '0.167', 'weapon5': '0.242', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.702', 'WEAPON3': '0.900', 'weapon2': '0.914', 'weapon3': '1.918', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.421', 'FRAGCOUNT': '44.000'} [2023-02-25 13:19:20,844][36155] DAMAGECOUNT value on done: 100379.0 [2023-02-25 13:19:20,845][36155] Sum rewards: 45.478, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.755', 'ARMOR': '0.004', 'AMMO5': '0.026', 'AMMO2': '0.049', 'AMMO3': '0.136', 'weapon5': '0.218', 'AMMO4': '0.247', 'weapon2': '0.464', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon4': '0.602', 'WEAPON3': '0.850', 'HITCOUNT': '2.340', 'weapon3': '2.402', 'DAMAGECOUNT': '12.744', 'FRAGCOUNT': '39.500'} [2023-02-25 13:19:20,907][36138] Updated weights for policy 0, policy_version 38123 (0.0009) [2023-02-25 13:19:21,153][36155] DAMAGECOUNT value on done: 99811.0 [2023-02-25 13:19:21,154][36155] Sum rewards: 59.000, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.288', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO4': '0.186', 'weapon2': '0.190', 'AMMO3': '0.237', 'weapon5': '0.258', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.506', 'WEAPON3': '1.350', 'weapon3': '2.756', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '53.000'} [2023-02-25 13:19:21,159][36139] DAMAGECOUNT value on done: 99936.0 [2023-02-25 13:19:21,160][36139] Sum rewards: 49.328, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.232', 'AMMO5': '0.012', 'AMMO2': '0.041', 'AMMO3': '0.147', 'AMMO4': '0.207', 'weapon5': '0.220', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.526', 'weapon4': '0.554', 'WEAPON3': '0.900', 'weapon3': '2.426', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.606', 'FRAGCOUNT': '43.000'} [2023-02-25 13:19:21,460][36139] DAMAGECOUNT value on done: 104425.0 [2023-02-25 13:19:21,461][36139] Sum rewards: 59.540, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.197', 'AMMO5': '0.011', 'AMMO2': '0.018', 'weapon5': '0.086', 'AMMO4': '0.092', 'weapon2': '0.144', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.266', 'weapon4': '0.284', 'WEAPON3': '1.650', 'weapon3': '3.250', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.895', 'FRAGCOUNT': '55.000'} [2023-02-25 13:19:21,626][36139] DAMAGECOUNT value on done: 103531.0 [2023-02-25 13:19:21,627][36139] Sum rewards: 47.460, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.820', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.172', 'weapon2': '0.178', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.804', 'WEAPON3': '1.250', 'weapon3': '2.540', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '12.993', 'FRAGCOUNT': '42.000'} [2023-02-25 13:19:21,934][36139] DAMAGECOUNT value on done: 99672.0 [2023-02-25 13:19:21,935][36139] Sum rewards: 51.767, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.189', 'AMMO5': '0.009', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'weapon5': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.364', 'ARMOR': '0.400', 'weapon4': '0.716', 'WEAPON3': '1.150', 'weapon3': '2.464', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '12.234', 'FRAGCOUNT': '44.500'} [2023-02-25 13:19:22,675][36154] DAMAGECOUNT value on done: 102916.0 [2023-02-25 13:19:22,676][36154] Sum rewards: 57.250, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.249', 'AMMO2': '0.012', 'AMMO5': '0.013', 'AMMO4': '0.059', 'weapon5': '0.158', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'weapon2': '0.324', 'WEAPON5': '0.350', 'weapon4': '0.558', 'WEAPON3': '1.050', 'weapon3': '2.624', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.064', 'FRAGCOUNT': '48.000'} [2023-02-25 13:19:22,929][36140] DAMAGECOUNT value on done: 102984.0 [2023-02-25 13:19:22,930][36140] Sum rewards: 55.036, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.696', 'AMMO5': '0.013', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.097', 'weapon5': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.262', 'weapon4': '0.376', 'WEAPON3': '1.350', 'weapon3': '2.936', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.784', 'FRAGCOUNT': '49.500'} [2023-02-25 13:19:22,982][36154] DAMAGECOUNT value on done: 98551.0 [2023-02-25 13:19:22,982][36154] Sum rewards: 54.792, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.477', 'ARMOR': '0.012', 'AMMO5': '0.016', 'AMMO2': '0.043', 'AMMO3': '0.168', 'AMMO4': '0.214', 'weapon5': '0.214', 'weapon2': '0.302', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.814', 'WEAPON3': '1.000', 'weapon3': '2.376', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.030', 'FRAGCOUNT': '47.000'} [2023-02-25 13:19:23,231][36140] DAMAGECOUNT value on done: 100528.0 [2023-02-25 13:19:23,232][36140] Sum rewards: 54.013, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.385', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon5': '0.186', 'weapon4': '0.226', 'AMMO3': '0.253', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '2.984', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '49.000'} [2023-02-25 13:19:23,246][36154] DAMAGECOUNT value on done: 102019.0 [2023-02-25 13:19:23,246][36154] Sum rewards: 33.018, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.985', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon7': '0.052', 'AMMO3': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.150', 'weapon5': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '0.500', 'weapon3': '0.896', 'weapon4': '1.172', 'HITCOUNT': '2.070', 'DAMAGECOUNT': '9.432', 'FRAGCOUNT': '27.000'} [2023-02-25 13:19:23,409][36157] DAMAGECOUNT value on done: 101979.0 [2023-02-25 13:19:23,410][36157] Sum rewards: 45.511, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.205', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.054', 'AMMO4': '0.129', 'AMMO3': '0.175', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.378', 'weapon4': '0.514', 'WEAPON3': '1.000', 'HITCOUNT': '2.820', 'weapon3': '2.888', 'DAMAGECOUNT': '12.972', 'FRAGCOUNT': '38.000'} [2023-02-25 13:19:23,419][36156] DAMAGECOUNT value on done: 101607.0 [2023-02-25 13:19:23,419][36156] Sum rewards: 42.013, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.350', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.182', 'weapon5': '0.200', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.508', 'weapon4': '0.688', 'WEAPON3': '1.150', 'weapon3': '2.184', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '11.475', 'FRAGCOUNT': '39.000'} [2023-02-25 13:19:23,426][36141] DAMAGECOUNT value on done: 101212.0 [2023-02-25 13:19:23,427][36141] Sum rewards: 49.389, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.162', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon4': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'weapon2': '0.402', 'WEAPON3': '1.400', 'HITCOUNT': '2.810', 'weapon3': '3.166', 'DAMAGECOUNT': '13.263', 'FRAGCOUNT': '44.000'} [2023-02-25 13:19:23,550][36140] DAMAGECOUNT value on done: 102173.0 [2023-02-25 13:19:23,551][36140] Sum rewards: 41.112, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.052', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.158', 'AMMO3': '0.175', 'AMMO4': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.384', 'ARMOR': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.770', 'WEAPON3': '1.100', 'weapon3': '2.370', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '11.964', 'FRAGCOUNT': '36.000'} [2023-02-25 13:19:23,555][36154] DAMAGECOUNT value on done: 102324.0 [2023-02-25 13:19:23,556][36154] Sum rewards: 54.053, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.921', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.202', 'AMMO3': '0.223', 'weapon4': '0.292', 'weapon2': '0.332', 'WEAPON3': '1.400', 'weapon3': '2.916', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.151', 'FRAGCOUNT': '48.000'} [2023-02-25 13:19:23,685][36142] DAMAGECOUNT value on done: 96494.0 [2023-02-25 13:19:23,685][36142] Sum rewards: 41.470, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.040', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.108', 'AMMO4': '0.185', 'weapon2': '0.194', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.718', 'WEAPON3': '1.450', 'HITCOUNT': '2.600', 'weapon3': '2.658', 'DAMAGECOUNT': '11.511', 'FRAGCOUNT': '40.000'} [2023-02-25 13:19:23,727][36141] DAMAGECOUNT value on done: 102880.0 [2023-02-25 13:19:23,728][36141] Sum rewards: 55.987, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.181', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.077', 'WEAPON4': '0.200', 'weapon2': '0.218', 'AMMO3': '0.265', 'weapon4': '0.432', 'WEAPON3': '1.500', 'HITCOUNT': '3.070', 'weapon3': '3.072', 'DAMAGECOUNT': '14.712', 'FRAGCOUNT': '50.000'} [2023-02-25 13:19:23,733][36157] DAMAGECOUNT value on done: 100927.0 [2023-02-25 13:19:23,734][36157] Sum rewards: 49.862, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.540', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.058', 'AMMO3': '0.135', 'AMMO4': '0.140', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.600', 'weapon4': '0.634', 'WEAPON3': '0.900', 'weapon3': '2.526', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.197', 'FRAGCOUNT': '41.000'} [2023-02-25 13:19:23,743][36156] DAMAGECOUNT value on done: 102097.0 [2023-02-25 13:19:23,744][36156] Sum rewards: 42.717, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.426', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon5': '0.100', 'weapon4': '0.184', 'AMMO4': '0.193', 'AMMO3': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.472', 'WEAPON3': '1.500', 'HITCOUNT': '2.420', 'weapon3': '2.982', 'DAMAGECOUNT': '11.637', 'FRAGCOUNT': '42.000'} [2023-02-25 13:19:23,757][36156] DAMAGECOUNT value on done: 98082.0 [2023-02-25 13:19:23,757][36156] Sum rewards: 44.251, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.205', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.312', 'weapon4': '0.658', 'WEAPON3': '1.250', 'weapon3': '2.690', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.093', 'FRAGCOUNT': '39.500'} [2023-02-25 13:19:23,837][36141] DAMAGECOUNT value on done: 102762.0 [2023-02-25 13:19:23,838][36141] Sum rewards: 58.368, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.494', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.112', 'WEAPON4': '0.150', 'weapon4': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.224', 'WEAPON3': '1.250', 'HITCOUNT': '3.070', 'weapon3': '3.242', 'DAMAGECOUNT': '14.637', 'FRAGCOUNT': '50.000'} [2023-02-25 13:19:23,859][36140] DAMAGECOUNT value on done: 98759.0 [2023-02-25 13:19:23,860][36140] Sum rewards: 47.363, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.030', 'AMMO5': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.083', 'AMMO3': '0.160', 'weapon5': '0.224', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.604', 'weapon4': '0.708', 'WEAPON3': '0.950', 'weapon3': '2.222', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '12.162', 'FRAGCOUNT': '41.000'} [2023-02-25 13:19:23,915][36138] Updated weights for policy 0, policy_version 38133 (0.0009) [2023-02-25 13:19:23,997][36142] DAMAGECOUNT value on done: 102999.0 [2023-02-25 13:19:23,997][36142] Sum rewards: 38.664, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.826', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.119', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon4': '0.336', 'weapon2': '0.386', 'WEAPON3': '1.100', 'HITCOUNT': '2.230', 'weapon3': '3.032', 'DAMAGECOUNT': '10.758', 'FRAGCOUNT': '36.000'} [2023-02-25 13:19:24,052][36157] DAMAGECOUNT value on done: 103150.0 [2023-02-25 13:19:24,052][36157] Sum rewards: 40.993, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.184', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.124', 'AMMO4': '0.160', 'weapon4': '0.224', 'WEAPON5': '0.250', 'AMMO3': '0.266', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '2.300', 'weapon3': '3.052', 'DAMAGECOUNT': '11.058', 'FRAGCOUNT': '40.000'} [2023-02-25 13:19:24,076][36156] DAMAGECOUNT value on done: 98543.0 [2023-02-25 13:19:24,077][36156] Sum rewards: 56.088, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.118', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.041', 'AMMO3': '0.133', 'WEAPON5': '0.200', 'weapon5': '0.202', 'AMMO4': '0.206', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON3': '0.750', 'weapon4': '1.200', 'weapon3': '1.976', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '45.000'} [2023-02-25 13:19:24,133][36141] DAMAGECOUNT value on done: 97462.0 [2023-02-25 13:19:24,134][36141] Sum rewards: 49.429, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.181', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'weapon5': '0.280', 'WEAPON5': '0.450', 'weapon4': '0.480', 'weapon2': '0.502', 'WEAPON3': '1.050', 'weapon3': '2.456', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.821', 'FRAGCOUNT': '41.500'} [2023-02-25 13:19:24,274][36142] DAMAGECOUNT value on done: 98173.0 [2023-02-25 13:19:24,275][36142] Sum rewards: 48.716, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.198', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.071', 'AMMO3': '0.163', 'weapon5': '0.210', 'weapon2': '0.228', 'AMMO4': '0.353', 'WEAPON5': '0.550', 'weapon4': '0.696', 'WEAPON4': '0.700', 'WEAPON3': '0.950', 'weapon3': '2.392', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.806', 'FRAGCOUNT': '43.000'} [2023-02-25 13:19:24,376][36157] DAMAGECOUNT value on done: 97943.0 [2023-02-25 13:19:24,377][36157] Sum rewards: 48.368, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.480', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'WEAPON1': '0.020', 'WEAPON4': '0.100', 'AMMO3': '0.208', 'weapon4': '0.304', 'weapon2': '0.346', 'WEAPON3': '1.250', 'weapon3': '3.012', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.008', 'FRAGCOUNT': '43.000'} [2023-02-25 13:19:24,581][36142] DAMAGECOUNT value on done: 102896.0 [2023-02-25 13:19:24,582][36142] Sum rewards: 55.785, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.575', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.038', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.170', 'weapon4': '0.282', 'weapon2': '0.346', 'WEAPON3': '1.100', 'HITCOUNT': '2.930', 'weapon3': '3.096', 'DAMAGECOUNT': '13.686', 'FRAGCOUNT': '46.000'} [2023-02-25 13:19:24,729][36114] Fps is (10 sec: 13517.0, 60 sec: 13516.8, 300 sec: 13135.0). Total num frames: 156200960. Throughput: 0: 3379.1. Samples: 1541676. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:19:24,730][36114] Avg episode reward: [(0, '50.026')] [2023-02-25 13:19:24,730][36125] Saving new best policy, reward=50.026! [2023-02-25 13:19:26,921][36138] Updated weights for policy 0, policy_version 38143 (0.0010) [2023-02-25 13:19:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13148.9). Total num frames: 156270592. Throughput: 0: 3380.3. Samples: 1561966. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:19:29,730][36114] Avg episode reward: [(0, '50.026')] [2023-02-25 13:19:29,957][36138] Updated weights for policy 0, policy_version 38153 (0.0009) [2023-02-25 13:19:31,578][36139] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:19:32,791][36154] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 13:19:32,965][36138] Updated weights for policy 0, policy_version 38163 (0.0009) [2023-02-25 13:19:34,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13148.9). Total num frames: 156336128. Throughput: 0: 3377.6. Samples: 1582198. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:19:34,730][36114] Avg episode reward: [(0, '50.026')] [2023-02-25 13:19:36,002][36138] Updated weights for policy 0, policy_version 38173 (0.0009) [2023-02-25 13:19:39,056][36138] Updated weights for policy 0, policy_version 38183 (0.0010) [2023-02-25 13:19:39,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13148.9). Total num frames: 156405760. Throughput: 0: 3373.0. Samples: 1592204. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:19:39,730][36114] Avg episode reward: [(0, '50.026')] [2023-02-25 13:19:40,351][36155] DAMAGECOUNT value on done: 100424.0 [2023-02-25 13:19:40,352][36155] Sum rewards: 54.174, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.317', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.157', 'weapon5': '0.166', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'weapon2': '0.364', 'WEAPON4': '0.400', 'weapon4': '0.584', 'WEAPON3': '1.150', 'weapon3': '2.686', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.532', 'FRAGCOUNT': '47.000'} [2023-02-25 13:19:40,653][36155] DAMAGECOUNT value on done: 107730.0 [2023-02-25 13:19:40,653][36155] Sum rewards: 71.790, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.139', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.151', 'weapon5': '0.152', 'weapon2': '0.156', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.544', 'WEAPON3': '1.000', 'weapon3': '2.920', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '57.000'} [2023-02-25 13:19:40,786][36155] DAMAGECOUNT value on done: 105807.0 [2023-02-25 13:19:40,787][36155] Sum rewards: 63.968, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.835', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'weapon5': '0.162', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon4': '0.308', 'weapon2': '0.408', 'WEAPON3': '1.150', 'weapon3': '2.870', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '54.000'} [2023-02-25 13:19:40,944][36139] DAMAGECOUNT value on done: 104078.0 [2023-02-25 13:19:40,944][36139] Sum rewards: 44.522, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.620', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.212', 'weapon4': '0.272', 'WEAPON3': '1.300', 'HITCOUNT': '2.670', 'weapon3': '3.124', 'DAMAGECOUNT': '12.426', 'FRAGCOUNT': '39.000'} [2023-02-25 13:19:41,094][36155] DAMAGECOUNT value on done: 104247.0 [2023-02-25 13:19:41,094][36155] Sum rewards: 54.178, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.055', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon2': '0.270', 'weapon4': '0.564', 'WEAPON3': '1.350', 'weapon3': '2.768', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.308', 'FRAGCOUNT': '48.000'} [2023-02-25 13:19:41,252][36139] DAMAGECOUNT value on done: 108562.0 [2023-02-25 13:19:41,253][36139] Sum rewards: 42.254, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.690', 'AMMO5': '0.008', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.090', 'weapon5': '0.164', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'weapon4': '0.260', 'weapon2': '0.550', 'WEAPON3': '1.250', 'HITCOUNT': '2.750', 'weapon3': '2.758', 'DAMAGECOUNT': '12.411', 'FRAGCOUNT': '38.000'} [2023-02-25 13:19:41,490][36139] DAMAGECOUNT value on done: 109087.0 [2023-02-25 13:19:41,490][36139] Sum rewards: 64.610, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.076', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.027', 'weapon5': '0.092', 'weapon7': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'WEAPON7': '0.200', 'weapon2': '0.366', 'WEAPON4': '0.500', 'weapon4': '0.770', 'WEAPON3': '1.050', 'weapon3': '2.456', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '54.000'} [2023-02-25 13:19:41,818][36139] DAMAGECOUNT value on done: 104771.0 [2023-02-25 13:19:41,819][36139] Sum rewards: 62.700, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.130', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'weapon4': '0.182', 'weapon2': '0.548', 'WEAPON3': '1.000', 'weapon3': '2.976', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.297', 'FRAGCOUNT': '52.000'} [2023-02-25 13:19:42,150][36138] Updated weights for policy 0, policy_version 38193 (0.0009) [2023-02-25 13:19:42,626][36154] DAMAGECOUNT value on done: 107487.0 [2023-02-25 13:19:42,627][36154] Sum rewards: 54.847, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.922', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.130', 'AMMO4': '0.155', 'AMMO3': '0.183', 'weapon4': '0.186', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.150', 'HITCOUNT': '2.710', 'weapon3': '3.028', 'DAMAGECOUNT': '13.713', 'FRAGCOUNT': '48.000'} [2023-02-25 13:19:42,951][36154] DAMAGECOUNT value on done: 103564.0 [2023-02-25 13:19:42,951][36154] Sum rewards: 59.756, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.725', 'AMMO2': '0.006', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'weapon5': '0.072', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'weapon4': '0.292', 'WEAPON5': '0.300', 'weapon2': '0.658', 'WEAPON3': '1.150', 'weapon3': '2.766', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.039', 'FRAGCOUNT': '50.500'} [2023-02-25 13:19:43,022][36140] DAMAGECOUNT value on done: 107784.0 [2023-02-25 13:19:43,022][36140] Sum rewards: 55.693, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.100', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.146', 'weapon2': '0.180', 'AMMO3': '0.182', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.584', 'WEAPON3': '1.100', 'weapon3': '2.770', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.400', 'FRAGCOUNT': '47.000'} [2023-02-25 13:19:43,224][36154] DAMAGECOUNT value on done: 106146.0 [2023-02-25 13:19:43,225][36154] Sum rewards: 47.260, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.097', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon5': '0.166', 'AMMO4': '0.186', 'AMMO3': '0.207', 'WEAPON5': '0.300', 'weapon2': '0.346', 'weapon4': '0.470', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.770', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.381', 'FRAGCOUNT': '43.000'} [2023-02-25 13:19:43,283][36141] DAMAGECOUNT value on done: 105294.0 [2023-02-25 13:19:43,283][36141] Sum rewards: 42.162, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.355', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'weapon5': '0.078', 'AMMO4': '0.148', 'AMMO3': '0.162', 'WEAPON5': '0.200', 'weapon2': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.374', 'WEAPON3': '1.050', 'HITCOUNT': '2.480', 'weapon3': '3.118', 'DAMAGECOUNT': '12.246', 'FRAGCOUNT': '36.000'} [2023-02-25 13:19:43,337][36157] DAMAGECOUNT value on done: 106791.0 [2023-02-25 13:19:43,337][36157] Sum rewards: 45.703, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.830', 'AMMO5': '0.011', 'ARMOR': '0.013', 'AMMO2': '0.059', 'weapon5': '0.164', 'AMMO3': '0.201', 'AMMO4': '0.293', 'WEAPON5': '0.350', 'weapon2': '0.464', 'WEAPON4': '0.750', 'weapon4': '1.064', 'WEAPON3': '1.200', 'weapon3': '2.018', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.436', 'FRAGCOUNT': '40.000'} [2023-02-25 13:19:43,354][36140] DAMAGECOUNT value on done: 105128.0 [2023-02-25 13:19:43,355][36140] Sum rewards: 53.485, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.368', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.042', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'AMMO3': '0.211', 'weapon2': '0.320', 'WEAPON3': '1.300', 'HITCOUNT': '2.770', 'weapon3': '3.396', 'DAMAGECOUNT': '13.800', 'FRAGCOUNT': '47.000'} [2023-02-25 13:19:43,457][36156] DAMAGECOUNT value on done: 106956.0 [2023-02-25 13:19:43,457][36156] Sum rewards: 58.822, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.352', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.031', 'weapon5': '0.074', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'weapon2': '0.332', 'weapon4': '0.488', 'WEAPON3': '1.350', 'weapon3': '2.850', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '16.047', 'FRAGCOUNT': '51.000'} [2023-02-25 13:19:43,530][36154] DAMAGECOUNT value on done: 106581.0 [2023-02-25 13:19:43,530][36154] Sum rewards: 54.216, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.480', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.072', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon2': '0.350', 'weapon4': '0.392', 'WEAPON3': '1.000', 'weapon3': '2.912', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '12.771', 'FRAGCOUNT': '47.000'} [2023-02-25 13:19:43,608][36141] DAMAGECOUNT value on done: 107474.0 [2023-02-25 13:19:43,608][36141] Sum rewards: 50.529, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.898', 'ARMOR': '0.005', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO4': '0.204', 'AMMO3': '0.218', 'weapon5': '0.228', 'weapon2': '0.294', 'WEAPON5': '0.400', 'weapon4': '0.416', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.756', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.782', 'FRAGCOUNT': '46.000'} [2023-02-25 13:19:43,636][36157] DAMAGECOUNT value on done: 105115.0 [2023-02-25 13:19:43,636][36157] Sum rewards: 59.546, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.642', 'AMMO2': '0.006', 'ARMOR': '0.014', 'AMMO5': '0.015', 'AMMO4': '0.029', 'weapon4': '0.034', 'weapon5': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.164', 'WEAPON5': '0.350', 'weapon2': '0.454', 'WEAPON3': '1.150', 'HITCOUNT': '2.720', 'weapon3': '3.286', 'DAMAGECOUNT': '12.564', 'FRAGCOUNT': '51.000'} [2023-02-25 13:19:43,663][36140] DAMAGECOUNT value on done: 106062.0 [2023-02-25 13:19:43,663][36140] Sum rewards: 51.218, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.548', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.027', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.131', 'AMMO4': '0.135', 'WEAPON4': '0.200', 'weapon4': '0.284', 'weapon2': '0.522', 'WEAPON3': '0.800', 'HITCOUNT': '2.620', 'weapon3': '3.042', 'DAMAGECOUNT': '11.667', 'FRAGCOUNT': '42.000'} [2023-02-25 13:19:43,738][36141] DAMAGECOUNT value on done: 106890.0 [2023-02-25 13:19:43,738][36141] Sum rewards: 41.342, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.277', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.061', 'weapon2': '0.206', 'AMMO3': '0.210', 'weapon5': '0.246', 'AMMO4': '0.304', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '1.134', 'WEAPON3': '1.200', 'weapon3': '1.990', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '12.324', 'FRAGCOUNT': '39.000'} [2023-02-25 13:19:43,785][36156] DAMAGECOUNT value on done: 107478.0 [2023-02-25 13:19:43,785][36156] Sum rewards: 61.945, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.700', 'ARMOR': '0.008', 'AMMO5': '0.025', 'AMMO2': '0.034', 'AMMO4': '0.170', 'weapon5': '0.190', 'AMMO3': '0.196', 'weapon2': '0.220', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'weapon4': '0.618', 'WEAPON3': '1.200', 'weapon3': '2.670', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.143', 'FRAGCOUNT': '53.000'} [2023-02-25 13:19:43,797][36156] DAMAGECOUNT value on done: 103312.0 [2023-02-25 13:19:43,797][36156] Sum rewards: 52.958, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.190', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.072', 'weapon5': '0.142', 'AMMO3': '0.167', 'WEAPON5': '0.250', 'weapon2': '0.356', 'AMMO4': '0.360', 'weapon4': '0.556', 'WEAPON4': '0.700', 'WEAPON3': '1.000', 'weapon3': '2.692', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '46.500'} [2023-02-25 13:19:43,827][36142] DAMAGECOUNT value on done: 101901.0 [2023-02-25 13:19:43,828][36142] Sum rewards: 64.742, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.697', 'AMMO5': '0.006', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.182', 'AMMO3': '0.200', 'weapon4': '0.302', 'WEAPON3': '1.200', 'weapon3': '3.186', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.221', 'FRAGCOUNT': '53.000'} [2023-02-25 13:19:43,960][36157] DAMAGECOUNT value on done: 106857.0 [2023-02-25 13:19:43,960][36157] Sum rewards: 38.905, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.965', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.082', 'AMMO3': '0.154', 'AMMO4': '0.159', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.388', 'WEAPON3': '0.900', 'weapon2': '0.998', 'weapon3': '2.352', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '11.121', 'FRAGCOUNT': '32.000'} [2023-02-25 13:19:43,979][36140] DAMAGECOUNT value on done: 102885.0 [2023-02-25 13:19:43,979][36140] Sum rewards: 41.067, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.894', 'ARMOR': '0.008', 'AMMO5': '0.035', 'AMMO2': '0.066', 'AMMO3': '0.197', 'weapon2': '0.268', 'AMMO4': '0.332', 'weapon5': '0.390', 'WEAPON5': '0.750', 'WEAPON4': '0.850', 'weapon4': '1.018', 'WEAPON3': '1.100', 'weapon3': '1.878', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.378', 'FRAGCOUNT': '39.000'} [2023-02-25 13:19:44,052][36141] DAMAGECOUNT value on done: 101337.0 [2023-02-25 13:19:44,052][36141] Sum rewards: 50.308, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.180', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.180', 'weapon5': '0.242', 'WEAPON5': '0.250', 'weapon2': '0.398', 'WEAPON4': '0.400', 'weapon4': '0.658', 'WEAPON3': '0.950', 'weapon3': '2.410', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '11.625', 'FRAGCOUNT': '46.000'} [2023-02-25 13:19:44,116][36156] DAMAGECOUNT value on done: 103203.0 [2023-02-25 13:19:44,117][36156] Sum rewards: 52.684, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.214', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.025', 'weapon4': '0.120', 'AMMO4': '0.126', 'weapon5': '0.144', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.478', 'WEAPON3': '1.150', 'HITCOUNT': '2.820', 'weapon3': '2.978', 'DAMAGECOUNT': '13.980', 'FRAGCOUNT': '47.000'} [2023-02-25 13:19:44,145][36142] DAMAGECOUNT value on done: 107510.0 [2023-02-25 13:19:44,146][36142] Sum rewards: 60.004, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.430', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'weapon4': '0.260', 'weapon2': '0.314', 'WEAPON3': '1.000', 'HITCOUNT': '2.980', 'weapon3': '3.150', 'DAMAGECOUNT': '13.533', 'FRAGCOUNT': '50.000'} [2023-02-25 13:19:44,270][36157] DAMAGECOUNT value on done: 102786.0 [2023-02-25 13:19:44,271][36157] Sum rewards: 60.807, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.210', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'weapon5': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.252', 'weapon4': '0.352', 'weapon2': '0.388', 'WEAPON3': '1.500', 'HITCOUNT': '2.930', 'weapon3': '3.022', 'DAMAGECOUNT': '14.529', 'FRAGCOUNT': '54.000'} [2023-02-25 13:19:44,420][36142] DAMAGECOUNT value on done: 102099.0 [2023-02-25 13:19:44,420][36142] Sum rewards: 42.142, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.214', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon5': '0.114', 'weapon7': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.188', 'WEAPON7': '0.200', 'AMMO4': '0.251', 'WEAPON5': '0.450', 'weapon2': '0.452', 'weapon4': '0.554', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'HITCOUNT': '2.290', 'weapon3': '2.452', 'DAMAGECOUNT': '11.778', 'FRAGCOUNT': '38.000'} [2023-02-25 13:19:44,722][36142] DAMAGECOUNT value on done: 107390.0 [2023-02-25 13:19:44,722][36142] Sum rewards: 46.300, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.220', 'ARMOR': '0.004', 'AMMO5': '0.031', 'AMMO2': '0.052', 'AMMO3': '0.182', 'weapon5': '0.250', 'AMMO4': '0.261', 'weapon2': '0.418', 'WEAPON5': '0.650', 'WEAPON4': '0.850', 'weapon4': '1.052', 'WEAPON3': '1.100', 'weapon3': '1.868', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.482', 'FRAGCOUNT': '43.000'} [2023-02-25 13:19:44,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13148.8). Total num frames: 156471296. Throughput: 0: 3371.9. Samples: 1612364. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:19:44,730][36114] Avg episode reward: [(0, '50.811')] [2023-02-25 13:19:44,730][36125] Saving new best policy, reward=50.811! [2023-02-25 13:19:45,188][36138] Updated weights for policy 0, policy_version 38203 (0.0009) [2023-02-25 13:19:48,222][36138] Updated weights for policy 0, policy_version 38213 (0.0010) [2023-02-25 13:19:49,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13448.5, 300 sec: 13148.9). Total num frames: 156536832. Throughput: 0: 3371.8. Samples: 1632546. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:19:49,730][36114] Avg episode reward: [(0, '50.753')] [2023-02-25 13:19:51,240][36138] Updated weights for policy 0, policy_version 38223 (0.0009) [2023-02-25 13:19:54,269][36138] Updated weights for policy 0, policy_version 38233 (0.0009) [2023-02-25 13:19:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13162.7). Total num frames: 156606464. Throughput: 0: 3371.8. Samples: 1642758. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-25 13:19:54,730][36114] Avg episode reward: [(0, '50.753')] [2023-02-25 13:19:57,313][36138] Updated weights for policy 0, policy_version 38243 (0.0010) [2023-02-25 13:19:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13148.9). Total num frames: 156672000. Throughput: 0: 3369.3. Samples: 1662848. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-25 13:19:59,730][36114] Avg episode reward: [(0, '50.753')] [2023-02-25 13:20:00,281][36155] DAMAGECOUNT value on done: 105039.0 [2023-02-25 13:20:00,281][36155] Sum rewards: 51.186, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.290', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon5': '0.158', 'AMMO3': '0.176', 'AMMO4': '0.217', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON4': '0.500', 'weapon4': '0.644', 'WEAPON3': '1.050', 'weapon3': '2.362', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.845', 'FRAGCOUNT': '45.000'} [2023-02-25 13:20:00,395][36138] Updated weights for policy 0, policy_version 38253 (0.0010) [2023-02-25 13:20:00,582][36155] DAMAGECOUNT value on done: 112349.0 [2023-02-25 13:20:00,582][36155] Sum rewards: 50.446, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.434', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.053', 'AMMO3': '0.169', 'weapon2': '0.208', 'AMMO4': '0.267', 'weapon5': '0.336', 'WEAPON5': '0.400', 'WEAPON4': '0.700', 'weapon4': '0.732', 'WEAPON3': '0.950', 'weapon3': '2.470', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '13.857', 'FRAGCOUNT': '44.000'} [2023-02-25 13:20:00,742][36155] DAMAGECOUNT value on done: 110016.0 [2023-02-25 13:20:00,743][36155] Sum rewards: 49.826, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.244', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.052', 'AMMO3': '0.162', 'weapon5': '0.196', 'AMMO4': '0.261', 'WEAPON5': '0.400', 'weapon2': '0.508', 'WEAPON4': '0.600', 'WEAPON3': '0.900', 'weapon4': '0.906', 'weapon3': '2.062', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.627', 'FRAGCOUNT': '43.000'} [2023-02-25 13:20:00,861][36139] DAMAGECOUNT value on done: 109042.0 [2023-02-25 13:20:00,861][36139] Sum rewards: 54.933, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.850', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon4': '0.110', 'weapon5': '0.110', 'AMMO4': '0.150', 'weapon2': '0.186', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '2.930', 'weapon3': '3.324', 'DAMAGECOUNT': '14.892', 'FRAGCOUNT': '50.000'} [2023-02-25 13:20:01,045][36155] DAMAGECOUNT value on done: 108805.0 [2023-02-25 13:20:01,045][36155] Sum rewards: 49.641, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.612', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.051', 'AMMO3': '0.176', 'weapon5': '0.246', 'AMMO4': '0.256', 'WEAPON5': '0.400', 'weapon2': '0.434', 'WEAPON4': '0.450', 'weapon4': '0.858', 'WEAPON3': '1.050', 'weapon3': '2.030', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.674', 'FRAGCOUNT': '42.000'} [2023-02-25 13:20:01,169][36139] DAMAGECOUNT value on done: 113379.0 [2023-02-25 13:20:01,169][36139] Sum rewards: 62.426, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.230', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.140', 'AMMO3': '0.148', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.450', 'WEAPON3': '0.900', 'weapon4': '0.936', 'weapon3': '2.112', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.451', 'FRAGCOUNT': '52.000'} [2023-02-25 13:20:01,368][36139] DAMAGECOUNT value on done: 112885.0 [2023-02-25 13:20:01,368][36139] Sum rewards: 47.030, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.307', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon2': '0.134', 'AMMO3': '0.163', 'weapon5': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.642', 'WEAPON3': '0.900', 'HITCOUNT': '2.530', 'weapon3': '2.774', 'DAMAGECOUNT': '11.394', 'FRAGCOUNT': '40.000'} [2023-02-25 13:20:01,666][36139] DAMAGECOUNT value on done: 109527.0 [2023-02-25 13:20:01,666][36139] Sum rewards: 52.210, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.302', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.172', 'weapon5': '0.212', 'weapon4': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.492', 'WEAPON3': '1.000', 'HITCOUNT': '2.760', 'weapon3': '2.848', 'DAMAGECOUNT': '14.268', 'FRAGCOUNT': '44.000'} [2023-02-25 13:20:02,592][36154] DAMAGECOUNT value on done: 111214.0 [2023-02-25 13:20:02,592][36154] Sum rewards: 45.241, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.058', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO5': '0.018', 'weapon5': '0.054', 'AMMO4': '0.075', 'weapon2': '0.178', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'weapon4': '0.280', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.570', 'weapon3': '3.244', 'DAMAGECOUNT': '11.181', 'FRAGCOUNT': '40.000'} [2023-02-25 13:20:02,896][36154] DAMAGECOUNT value on done: 108143.0 [2023-02-25 13:20:02,897][36154] Sum rewards: 52.046, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.490', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.014', 'weapon4': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.142', 'AMMO3': '0.269', 'weapon2': '0.402', 'WEAPON3': '1.600', 'HITCOUNT': '2.720', 'weapon3': '3.228', 'DAMAGECOUNT': '13.737', 'FRAGCOUNT': '48.000'} [2023-02-25 13:20:02,921][36140] DAMAGECOUNT value on done: 111995.0 [2023-02-25 13:20:02,921][36140] Sum rewards: 47.993, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.596', 'AMMO5': '0.019', 'AMMO2': '0.042', 'weapon4': '0.118', 'weapon5': '0.130', 'AMMO4': '0.208', 'AMMO3': '0.208', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.554', 'WEAPON3': '1.250', 'HITCOUNT': '2.350', 'weapon3': '2.928', 'DAMAGECOUNT': '12.633', 'FRAGCOUNT': '45.000'} [2023-02-25 13:20:03,181][36154] DAMAGECOUNT value on done: 111795.0 [2023-02-25 13:20:03,182][36154] Sum rewards: 62.321, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.510', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.106', 'weapon4': '0.128', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.276', 'AMMO3': '0.286', 'WEAPON3': '1.800', 'weapon3': '3.252', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '56.000'} [2023-02-25 13:20:03,223][36140] DAMAGECOUNT value on done: 109431.0 [2023-02-25 13:20:03,223][36140] Sum rewards: 44.785, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.000', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.122', 'AMMO4': '0.220', 'WEAPON5': '0.250', 'AMMO3': '0.272', 'weapon2': '0.314', 'WEAPON4': '0.350', 'weapon4': '0.832', 'WEAPON3': '1.500', 'weapon3': '2.386', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.909', 'FRAGCOUNT': '42.000'} [2023-02-25 13:20:03,223][36157] DAMAGECOUNT value on done: 109311.0 [2023-02-25 13:20:03,224][36157] Sum rewards: 25.012, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.830', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'weapon2': '0.224', 'AMMO4': '0.229', 'WEAPON4': '0.350', 'WEAPON3': '0.900', 'weapon4': '0.980', 'weapon3': '1.458', 'HITCOUNT': '1.850', 'DAMAGECOUNT': '7.560', 'FRAGCOUNT': '23.000'} [2023-02-25 13:20:03,252][36141] DAMAGECOUNT value on done: 110030.0 [2023-02-25 13:20:03,252][36141] Sum rewards: 63.421, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.115', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.116', 'AMMO3': '0.188', 'weapon2': '0.256', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.766', 'WEAPON3': '1.100', 'weapon3': '2.626', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.208', 'FRAGCOUNT': '54.000'} [2023-02-25 13:20:03,340][36156] DAMAGECOUNT value on done: 111456.0 [2023-02-25 13:20:03,340][36156] Sum rewards: 44.386, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.120', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.130', 'AMMO4': '0.186', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.320', 'weapon2': '0.436', 'WEAPON3': '1.350', 'weapon3': '2.842', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.500', 'FRAGCOUNT': '40.500'} [2023-02-25 13:20:03,408][36138] Updated weights for policy 0, policy_version 38263 (0.0009) [2023-02-25 13:20:03,472][36154] DAMAGECOUNT value on done: 110901.0 [2023-02-25 13:20:03,473][36154] Sum rewards: 47.417, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.400', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'weapon5': '0.068', 'AMMO4': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon4': '0.260', 'weapon2': '0.358', 'WEAPON3': '1.350', 'HITCOUNT': '2.860', 'weapon3': '3.094', 'DAMAGECOUNT': '12.960', 'FRAGCOUNT': '43.000'} [2023-02-25 13:20:03,525][36157] DAMAGECOUNT value on done: 109690.0 [2023-02-25 13:20:03,526][36157] Sum rewards: 52.827, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.650', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.052', 'weapon5': '0.142', 'AMMO3': '0.168', 'AMMO4': '0.258', 'weapon2': '0.312', 'WEAPON5': '0.350', 'weapon4': '0.582', 'WEAPON4': '0.600', 'WEAPON3': '0.950', 'weapon3': '2.710', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.725', 'FRAGCOUNT': '46.000'} [2023-02-25 13:20:03,567][36140] DAMAGECOUNT value on done: 111332.0 [2023-02-25 13:20:03,567][36140] Sum rewards: 65.577, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.476', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.163', 'weapon4': '0.216', 'weapon2': '0.618', 'WEAPON3': '1.100', 'weapon3': '3.016', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.810', 'FRAGCOUNT': '53.000'} [2023-02-25 13:20:03,574][36141] DAMAGECOUNT value on done: 112576.0 [2023-02-25 13:20:03,574][36141] Sum rewards: 58.260, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.590', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.074', 'AMMO4': '0.077', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.261', 'weapon4': '0.264', 'weapon2': '0.276', 'WEAPON3': '1.650', 'weapon3': '3.132', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.306', 'FRAGCOUNT': '53.000'} [2023-02-25 13:20:03,648][36141] DAMAGECOUNT value on done: 112043.0 [2023-02-25 13:20:03,648][36141] Sum rewards: 62.799, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.252', 'AMMO5': '0.012', 'ARMOR': '0.028', 'AMMO2': '0.056', 'AMMO3': '0.152', 'weapon5': '0.212', 'AMMO4': '0.280', 'weapon2': '0.332', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.614', 'WEAPON3': '0.950', 'weapon3': '2.566', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.459', 'FRAGCOUNT': '52.000'} [2023-02-25 13:20:03,660][36156] DAMAGECOUNT value on done: 111456.0 [2023-02-25 13:20:03,660][36156] Sum rewards: 48.008, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.388', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.160', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.530', 'weapon4': '0.538', 'WEAPON3': '1.200', 'weapon3': '2.496', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '11.934', 'FRAGCOUNT': '43.000'} [2023-02-25 13:20:03,673][36156] DAMAGECOUNT value on done: 108448.0 [2023-02-25 13:20:03,674][36156] Sum rewards: 59.324, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.050', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.040', 'AMMO4': '0.053', 'weapon4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.216', 'AMMO3': '0.313', 'WEAPON3': '1.800', 'HITCOUNT': '3.130', 'weapon3': '3.356', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '54.000'} [2023-02-25 13:20:03,799][36157] DAMAGECOUNT value on done: 110282.0 [2023-02-25 13:20:03,799][36157] Sum rewards: 34.259, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.370', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon5': '0.066', 'AMMO4': '0.099', 'WEAPON5': '0.300', 'AMMO3': '0.317', 'WEAPON4': '0.350', 'weapon4': '0.376', 'weapon2': '0.510', 'WEAPON3': '1.850', 'HITCOUNT': '2.470', 'weapon3': '2.734', 'DAMAGECOUNT': '10.275', 'FRAGCOUNT': '38.000'} [2023-02-25 13:20:03,877][36140] DAMAGECOUNT value on done: 107607.0 [2023-02-25 13:20:03,878][36140] Sum rewards: 56.935, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.984', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'weapon5': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.322', 'weapon4': '0.408', 'WEAPON3': '1.300', 'weapon3': '2.788', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '14.166', 'FRAGCOUNT': '49.500'} [2023-02-25 13:20:03,941][36142] DAMAGECOUNT value on done: 105941.0 [2023-02-25 13:20:03,942][36142] Sum rewards: 50.918, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.336', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon7': '0.058', 'weapon5': '0.144', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO4': '0.176', 'weapon2': '0.192', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'AMMO3': '0.201', 'WEAPON4': '0.350', 'weapon4': '0.486', 'WEAPON3': '1.200', 'HITCOUNT': '2.710', 'weapon3': '2.850', 'DAMAGECOUNT': '12.120', 'FRAGCOUNT': '46.000'} [2023-02-25 13:20:03,962][36141] DAMAGECOUNT value on done: 105526.0 [2023-02-25 13:20:03,962][36141] Sum rewards: 49.848, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.320', 'AMMO5': '0.017', 'AMMO2': '0.023', 'weapon4': '0.098', 'AMMO4': '0.113', 'weapon5': '0.154', 'weapon2': '0.180', 'WEAPON4': '0.250', 'AMMO3': '0.277', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '2.520', 'weapon3': '3.270', 'DAMAGECOUNT': '12.567', 'FRAGCOUNT': '48.000'} [2023-02-25 13:20:03,968][36156] DAMAGECOUNT value on done: 107179.0 [2023-02-25 13:20:03,968][36156] Sum rewards: 40.317, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.795', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.074', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon2': '0.348', 'WEAPON4': '0.400', 'weapon4': '0.572', 'WEAPON3': '1.200', 'weapon3': '2.728', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '11.928', 'FRAGCOUNT': '36.000'} [2023-02-25 13:20:04,089][36141] Large shaping reward -2.521 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.273, -91.0), ('weapon5', 0.002)] [2023-02-25 13:20:04,122][36157] DAMAGECOUNT value on done: 107998.0 [2023-02-25 13:20:04,122][36157] Sum rewards: 62.264, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.425', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon5': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.464', 'weapon2': '0.496', 'WEAPON3': '1.200', 'weapon3': '2.792', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '54.000'} [2023-02-25 13:20:04,259][36142] DAMAGECOUNT value on done: 111818.0 [2023-02-25 13:20:04,259][36142] Sum rewards: 46.738, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.540', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.062', 'weapon5': '0.184', 'AMMO3': '0.236', 'weapon2': '0.290', 'AMMO4': '0.311', 'WEAPON4': '0.450', 'weapon4': '0.538', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.656', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '12.924', 'FRAGCOUNT': '44.000'} [2023-02-25 13:20:04,523][36142] DAMAGECOUNT value on done: 106523.0 [2023-02-25 13:20:04,524][36142] Sum rewards: 48.130, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.185', 'ARMOR': '0.004', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'AMMO4': '0.162', 'weapon5': '0.180', 'AMMO3': '0.193', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.644', 'weapon2': '0.668', 'WEAPON3': '1.050', 'weapon3': '2.164', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '13.272', 'FRAGCOUNT': '44.000'} [2023-02-25 13:20:04,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13162.7). Total num frames: 156741632. Throughput: 0: 3367.5. Samples: 1683088. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-25 13:20:04,729][36114] Avg episode reward: [(0, '51.104')] [2023-02-25 13:20:04,730][36125] Saving new best policy, reward=51.104! [2023-02-25 13:20:04,849][36142] DAMAGECOUNT value on done: 112013.0 [2023-02-25 13:20:04,849][36142] Sum rewards: 46.263, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.832', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon5': '0.088', 'AMMO4': '0.117', 'weapon2': '0.188', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'WEAPON5': '0.300', 'weapon4': '0.464', 'WEAPON3': '1.650', 'HITCOUNT': '2.990', 'weapon3': '3.032', 'DAMAGECOUNT': '13.719', 'FRAGCOUNT': '43.000'} [2023-02-25 13:20:06,497][36138] Updated weights for policy 0, policy_version 38273 (0.0010) [2023-02-25 13:20:09,491][36138] Updated weights for policy 0, policy_version 38283 (0.0010) [2023-02-25 13:20:09,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13162.7). Total num frames: 156807168. Throughput: 0: 3368.7. Samples: 1693268. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-25 13:20:09,729][36114] Avg episode reward: [(0, '51.044')] [2023-02-25 13:20:12,534][36138] Updated weights for policy 0, policy_version 38293 (0.0009) [2023-02-25 13:20:14,729][36114] Fps is (10 sec: 13516.6, 60 sec: 13516.8, 300 sec: 13176.6). Total num frames: 156876800. Throughput: 0: 3370.1. Samples: 1713622. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-25 13:20:14,730][36114] Avg episode reward: [(0, '51.044')] [2023-02-25 13:20:15,528][36138] Updated weights for policy 0, policy_version 38303 (0.0009) [2023-02-25 13:20:18,571][36138] Updated weights for policy 0, policy_version 38313 (0.0009) [2023-02-25 13:20:19,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13176.6). Total num frames: 156942336. Throughput: 0: 3370.0. Samples: 1733846. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:20:19,730][36114] Avg episode reward: [(0, '51.044')] [2023-02-25 13:20:20,102][36155] DAMAGECOUNT value on done: 110113.0 [2023-02-25 13:20:20,102][36155] Sum rewards: 51.858, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.992', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.192', 'weapon2': '0.238', 'AMMO3': '0.281', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.428', 'WEAPON3': '1.600', 'weapon3': '2.820', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.222', 'FRAGCOUNT': '48.000'} [2023-02-25 13:20:20,390][36155] DAMAGECOUNT value on done: 116139.0 [2023-02-25 13:20:20,391][36155] Sum rewards: 38.965, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.042', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.030', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.148', 'AMMO3': '0.164', 'weapon2': '0.370', 'WEAPON4': '0.450', 'weapon4': '0.670', 'WEAPON3': '1.000', 'HITCOUNT': '2.470', 'weapon3': '2.682', 'DAMAGECOUNT': '11.370', 'FRAGCOUNT': '35.000'} [2023-02-25 13:20:20,500][36155] DAMAGECOUNT value on done: 114436.0 [2023-02-25 13:20:20,501][36155] Sum rewards: 42.479, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.030', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO3': '0.183', 'AMMO4': '0.191', 'weapon2': '0.194', 'weapon5': '0.280', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.754', 'WEAPON3': '1.000', 'weapon3': '2.390', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.260', 'FRAGCOUNT': '37.000'} [2023-02-25 13:20:20,682][36139] DAMAGECOUNT value on done: 112861.0 [2023-02-25 13:20:20,682][36139] Sum rewards: 44.882, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.554', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO3': '0.103', 'weapon5': '0.160', 'AMMO4': '0.165', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.454', 'WEAPON3': '0.650', 'weapon4': '1.404', 'weapon3': '1.496', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '11.457', 'FRAGCOUNT': '37.000'} [2023-02-25 13:20:20,794][36155] DAMAGECOUNT value on done: 112385.0 [2023-02-25 13:20:20,795][36155] Sum rewards: 42.634, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.804', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon5': '0.116', 'AMMO3': '0.188', 'AMMO4': '0.257', 'weapon4': '0.332', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.730', 'WEAPON3': '1.050', 'weapon3': '2.474', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '10.740', 'FRAGCOUNT': '37.000'} [2023-02-25 13:20:20,999][36139] DAMAGECOUNT value on done: 117787.0 [2023-02-25 13:20:20,999][36139] Sum rewards: 52.621, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.900', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon5': '0.072', 'AMMO4': '0.077', 'weapon4': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'weapon2': '0.308', 'WEAPON3': '1.300', 'HITCOUNT': '2.950', 'weapon3': '3.352', 'DAMAGECOUNT': '13.224', 'FRAGCOUNT': '46.000'} [2023-02-25 13:20:21,151][36139] DAMAGECOUNT value on done: 117125.0 [2023-02-25 13:20:21,152][36139] Sum rewards: 44.086, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.100', 'weapon5': '0.004', 'AMMO2': '0.005', 'AMMO5': '0.009', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'weapon4': '0.062', 'WEAPON5': '0.200', 'AMMO3': '0.266', 'weapon2': '0.336', 'WEAPON3': '1.650', 'HITCOUNT': '2.760', 'weapon3': '3.346', 'DAMAGECOUNT': '12.720', 'FRAGCOUNT': '40.000'} [2023-02-25 13:20:21,440][36139] DAMAGECOUNT value on done: 113507.0 [2023-02-25 13:20:21,441][36139] Sum rewards: 48.239, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.637', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.050', 'AMMO3': '0.162', 'weapon5': '0.218', 'AMMO4': '0.248', 'weapon4': '0.290', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.644', 'WEAPON3': '1.100', 'HITCOUNT': '2.540', 'weapon3': '2.558', 'DAMAGECOUNT': '11.940', 'FRAGCOUNT': '44.500'} [2023-02-25 13:20:21,611][36138] Updated weights for policy 0, policy_version 38323 (0.0009) [2023-02-25 13:20:22,315][36154] DAMAGECOUNT value on done: 115042.0 [2023-02-25 13:20:22,316][36154] Sum rewards: 38.809, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.036', 'ARMOR': '0.004', 'AMMO5': '0.010', 'weapon7': '0.038', 'AMMO2': '0.043', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'AMMO3': '0.203', 'AMMO4': '0.217', 'weapon5': '0.234', 'WEAPON5': '0.350', 'weapon2': '0.422', 'WEAPON4': '0.600', 'weapon4': '0.682', 'WEAPON3': '1.200', 'weapon3': '2.318', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '11.484', 'FRAGCOUNT': '36.000'} [2023-02-25 13:20:22,629][36154] DAMAGECOUNT value on done: 112292.0 [2023-02-25 13:20:22,630][36154] Sum rewards: 54.626, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.994', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'weapon5': '0.122', 'AMMO4': '0.140', 'AMMO3': '0.177', 'WEAPON4': '0.300', 'weapon2': '0.452', 'weapon4': '0.512', 'WEAPON3': '1.150', 'weapon3': '2.636', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.447', 'FRAGCOUNT': '47.000'} [2023-02-25 13:20:22,776][36140] DAMAGECOUNT value on done: 116459.0 [2023-02-25 13:20:22,777][36140] Sum rewards: 49.630, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.940', 'AMMO5': '0.017', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon4': '0.110', 'weapon5': '0.184', 'WEAPON4': '0.200', 'AMMO3': '0.269', 'weapon2': '0.368', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '2.600', 'weapon3': '3.070', 'DAMAGECOUNT': '13.392', 'FRAGCOUNT': '47.000'} [2023-02-25 13:20:22,929][36154] DAMAGECOUNT value on done: 115617.0 [2023-02-25 13:20:22,929][36154] Sum rewards: 48.590, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.817', 'AMMO2': '0.022', 'WEAPON4': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.178', 'weapon2': '0.382', 'weapon4': '0.524', 'WEAPON3': '1.100', 'HITCOUNT': '2.680', 'weapon3': '2.844', 'DAMAGECOUNT': '11.466', 'FRAGCOUNT': '42.000'} [2023-02-25 13:20:23,095][36140] DAMAGECOUNT value on done: 113699.0 [2023-02-25 13:20:23,095][36140] Sum rewards: 49.919, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.224', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.139', 'weapon5': '0.184', 'weapon2': '0.258', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon4': '1.010', 'weapon3': '2.230', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.804', 'FRAGCOUNT': '42.000'} [2023-02-25 13:20:23,130][36157] DAMAGECOUNT value on done: 113985.0 [2023-02-25 13:20:23,131][36157] Sum rewards: 50.535, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.062', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.102', 'AMMO3': '0.274', 'weapon5': '0.290', 'WEAPON4': '0.300', 'weapon2': '0.326', 'WEAPON5': '0.350', 'weapon4': '0.494', 'WEAPON3': '1.600', 'weapon3': '2.602', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.022', 'FRAGCOUNT': '47.000'} [2023-02-25 13:20:23,250][36154] DAMAGECOUNT value on done: 115300.0 [2023-02-25 13:20:23,250][36154] Sum rewards: 48.005, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.182', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.023', 'weapon5': '0.098', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.424', 'weapon4': '0.456', 'WEAPON3': '1.350', 'HITCOUNT': '2.710', 'weapon3': '2.792', 'DAMAGECOUNT': '13.107', 'FRAGCOUNT': '43.000'} [2023-02-25 13:20:23,275][36141] DAMAGECOUNT value on done: 114561.0 [2023-02-25 13:20:23,276][36141] Sum rewards: 50.962, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.480', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.179', 'weapon2': '0.194', 'weapon5': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.738', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.593', 'FRAGCOUNT': '44.000'} [2023-02-25 13:20:23,460][36157] DAMAGECOUNT value on done: 114196.0 [2023-02-25 13:20:23,460][36157] Sum rewards: 50.622, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.087', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.046', 'AMMO3': '0.155', 'AMMO4': '0.230', 'weapon5': '0.250', 'weapon2': '0.308', 'WEAPON5': '0.350', 'weapon4': '0.398', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'weapon3': '2.372', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '13.401', 'FRAGCOUNT': '44.000'} [2023-02-25 13:20:23,523][36140] DAMAGECOUNT value on done: 115888.0 [2023-02-25 13:20:23,523][36140] Sum rewards: 48.737, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.557', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.138', 'weapon4': '0.178', 'AMMO3': '0.249', 'weapon2': '0.312', 'WEAPON3': '1.550', 'HITCOUNT': '2.790', 'weapon3': '3.156', 'DAMAGECOUNT': '13.668', 'FRAGCOUNT': '44.000'} [2023-02-25 13:20:23,540][36156] DAMAGECOUNT value on done: 115454.0 [2023-02-25 13:20:23,541][36156] Sum rewards: 41.847, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.906', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.070', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'weapon2': '0.242', 'weapon4': '0.246', 'WEAPON4': '0.250', 'AMMO3': '0.252', 'WEAPON3': '1.500', 'HITCOUNT': '2.460', 'weapon3': '3.236', 'DAMAGECOUNT': '11.973', 'FRAGCOUNT': '40.000'} [2023-02-25 13:20:23,581][36141] DAMAGECOUNT value on done: 116209.0 [2023-02-25 13:20:23,582][36141] Sum rewards: 38.081, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.490', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon2': '0.306', 'weapon4': '0.936', 'WEAPON3': '1.250', 'weapon3': '2.244', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '10.899', 'FRAGCOUNT': '35.000'} [2023-02-25 13:20:23,605][36141] DAMAGECOUNT value on done: 116132.0 [2023-02-25 13:20:23,605][36141] Sum rewards: 46.024, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.539', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.034', 'AMMO4': '0.168', 'AMMO3': '0.184', 'weapon5': '0.250', 'weapon2': '0.258', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.698', 'WEAPON3': '1.050', 'weapon3': '2.350', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.267', 'FRAGCOUNT': '41.500'} [2023-02-25 13:20:23,702][36157] DAMAGECOUNT value on done: 114371.0 [2023-02-25 13:20:23,702][36157] Sum rewards: 51.296, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.352', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.156', 'WEAPON4': '0.250', 'weapon2': '0.426', 'weapon4': '0.638', 'WEAPON3': '0.900', 'HITCOUNT': '2.610', 'weapon3': '2.638', 'DAMAGECOUNT': '12.267', 'FRAGCOUNT': '42.000'} [2023-02-25 13:20:23,832][36156] DAMAGECOUNT value on done: 113480.0 [2023-02-25 13:20:23,833][36156] Sum rewards: 62.698, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.116', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon5': '0.018', 'AMMO4': '0.022', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'weapon2': '0.312', 'weapon4': '0.406', 'WEAPON3': '1.000', 'weapon3': '2.990', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.096', 'FRAGCOUNT': '50.000'} [2023-02-25 13:20:23,841][36140] DAMAGECOUNT value on done: 111897.0 [2023-02-25 13:20:23,842][36140] Sum rewards: 50.404, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.720', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon5': '0.118', 'WEAPON4': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.210', 'weapon4': '0.258', 'WEAPON5': '0.350', 'weapon2': '0.638', 'WEAPON3': '1.200', 'weapon3': '2.778', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.870', 'FRAGCOUNT': '44.000'} [2023-02-25 13:20:23,843][36156] DAMAGECOUNT value on done: 115739.0 [2023-02-25 13:20:23,843][36156] Sum rewards: 46.571, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.398', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.062', 'AMMO3': '0.152', 'weapon2': '0.294', 'AMMO4': '0.309', 'weapon5': '0.314', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'weapon4': '0.782', 'WEAPON3': '0.900', 'weapon3': '2.282', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.849', 'FRAGCOUNT': '41.000'} [2023-02-25 13:20:23,857][36142] DAMAGECOUNT value on done: 110316.0 [2023-02-25 13:20:23,857][36142] Sum rewards: 41.450, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.675', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.084', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'weapon2': '0.518', 'weapon4': '0.614', 'WEAPON3': '1.250', 'weapon3': '2.468', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.125', 'FRAGCOUNT': '36.000'} [2023-02-25 13:20:23,913][36141] DAMAGECOUNT value on done: 109779.0 [2023-02-25 13:20:23,913][36141] Sum rewards: 47.631, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.016', 'AMMO5': '0.015', 'AMMO2': '0.017', 'weapon4': '0.044', 'weapon5': '0.084', 'AMMO4': '0.086', 'WEAPON4': '0.200', 'AMMO3': '0.274', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.700', 'HITCOUNT': '2.820', 'weapon3': '3.242', 'DAMAGECOUNT': '12.759', 'FRAGCOUNT': '46.000'} [2023-02-25 13:20:24,011][36157] DAMAGECOUNT value on done: 112587.0 [2023-02-25 13:20:24,012][36157] Sum rewards: 52.866, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.190', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.218', 'WEAPON5': '0.300', 'weapon2': '0.322', 'weapon4': '0.448', 'WEAPON3': '1.300', 'weapon3': '2.810', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.767', 'FRAGCOUNT': '45.000'} [2023-02-25 13:20:24,148][36156] DAMAGECOUNT value on done: 112183.0 [2023-02-25 13:20:24,149][36156] Sum rewards: 51.072, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.720', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon5': '0.162', 'weapon4': '0.174', 'weapon2': '0.214', 'AMMO3': '0.221', 'AMMO4': '0.221', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.920', 'weapon3': '3.210', 'DAMAGECOUNT': '15.012', 'FRAGCOUNT': '46.000'} [2023-02-25 13:20:24,160][36142] DAMAGECOUNT value on done: 115976.0 [2023-02-25 13:20:24,161][36142] Sum rewards: 49.408, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.175', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.049', 'AMMO3': '0.138', 'weapon5': '0.200', 'AMMO4': '0.244', 'weapon4': '0.404', 'WEAPON5': '0.450', 'weapon2': '0.506', 'WEAPON4': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.600', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.474', 'FRAGCOUNT': '45.000'} [2023-02-25 13:20:24,463][36142] DAMAGECOUNT value on done: 111260.0 [2023-02-25 13:20:24,464][36142] Sum rewards: 51.502, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.195', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.138', 'AMMO4': '0.139', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'weapon2': '0.366', 'weapon4': '0.452', 'WEAPON3': '1.200', 'weapon3': '2.820', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.211', 'FRAGCOUNT': '45.000'} [2023-02-25 13:20:24,686][36138] Updated weights for policy 0, policy_version 38333 (0.0009) [2023-02-25 13:20:24,729][36114] Fps is (10 sec: 13517.0, 60 sec: 13516.8, 300 sec: 13204.4). Total num frames: 157011968. Throughput: 0: 3373.0. Samples: 1743990. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:20:24,730][36114] Avg episode reward: [(0, '50.829')] [2023-02-25 13:20:24,772][36142] DAMAGECOUNT value on done: 116653.0 [2023-02-25 13:20:24,773][36142] Sum rewards: 53.881, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.625', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.070', 'weapon4': '0.078', 'AMMO4': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.472', 'WEAPON3': '1.450', 'weapon3': '3.160', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '13.920', 'FRAGCOUNT': '48.000'} [2023-02-25 13:20:26,111][36141] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-25 13:20:27,661][36138] Updated weights for policy 0, policy_version 38343 (0.0009) [2023-02-25 13:20:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13204.4). Total num frames: 157077504. Throughput: 0: 3374.8. Samples: 1764230. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:20:29,730][36114] Avg episode reward: [(0, '50.807')] [2023-02-25 13:20:30,716][36138] Updated weights for policy 0, policy_version 38353 (0.0010) [2023-02-25 13:20:33,761][36138] Updated weights for policy 0, policy_version 38363 (0.0009) [2023-02-25 13:20:34,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13218.3). Total num frames: 157147136. Throughput: 0: 3376.4. Samples: 1784482. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:20:34,730][36114] Avg episode reward: [(0, '50.807')] [2023-02-25 13:20:36,808][36138] Updated weights for policy 0, policy_version 38373 (0.0009) [2023-02-25 13:20:39,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13218.3). Total num frames: 157212672. Throughput: 0: 3373.5. Samples: 1794564. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:20:39,729][36114] Avg episode reward: [(0, '50.807')] [2023-02-25 13:20:39,859][36138] Updated weights for policy 0, policy_version 38383 (0.0009) [2023-02-25 13:20:40,038][36155] DAMAGECOUNT value on done: 114967.0 [2023-02-25 13:20:40,038][36155] Sum rewards: 52.164, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.716', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon5': '0.100', 'AMMO4': '0.105', 'weapon2': '0.180', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.552', 'WEAPON3': '1.300', 'weapon3': '2.900', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.562', 'FRAGCOUNT': '46.000'} [2023-02-25 13:20:40,336][36155] DAMAGECOUNT value on done: 121680.0 [2023-02-25 13:20:40,337][36155] Sum rewards: 57.020, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.595', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon4': '0.118', 'weapon5': '0.140', 'WEAPON4': '0.200', 'weapon2': '0.246', 'WEAPON5': '0.300', 'AMMO3': '0.311', 'WEAPON3': '1.850', 'weapon3': '3.132', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.593', 'FRAGCOUNT': '52.000'} [2023-02-25 13:20:40,451][36155] DAMAGECOUNT value on done: 118654.0 [2023-02-25 13:20:40,452][36155] Sum rewards: 48.139, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.800', 'ARMOR': '0.005', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon4': '0.324', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.720', 'weapon3': '2.998', 'DAMAGECOUNT': '12.624', 'FRAGCOUNT': '44.000'} [2023-02-25 13:20:40,467][36139] DAMAGECOUNT value on done: 117146.0 [2023-02-25 13:20:40,468][36139] Sum rewards: 44.114, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.402', 'AMMO5': '0.017', 'AMMO2': '0.034', 'AMMO3': '0.161', 'AMMO4': '0.172', 'weapon5': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.382', 'weapon2': '0.448', 'WEAPON3': '0.950', 'HITCOUNT': '2.660', 'weapon3': '2.704', 'DAMAGECOUNT': '12.855', 'FRAGCOUNT': '37.500'} [2023-02-25 13:20:40,749][36155] DAMAGECOUNT value on done: 116710.0 [2023-02-25 13:20:40,750][36155] Sum rewards: 45.833, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.682', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.031', 'AMMO4': '0.157', 'AMMO3': '0.214', 'weapon5': '0.262', 'WEAPON4': '0.400', 'weapon4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.512', 'WEAPON3': '1.250', 'weapon3': '2.412', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.975', 'FRAGCOUNT': '43.000'} [2023-02-25 13:20:40,774][36139] DAMAGECOUNT value on done: 121984.0 [2023-02-25 13:20:40,774][36139] Sum rewards: 55.928, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.840', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.068', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'WEAPON4': '0.350', 'weapon2': '0.450', 'weapon4': '0.478', 'WEAPON3': '0.900', 'weapon3': '2.814', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '12.591', 'FRAGCOUNT': '49.000'} [2023-02-25 13:20:40,931][36139] DAMAGECOUNT value on done: 120848.0 [2023-02-25 13:20:40,931][36139] Sum rewards: 38.258, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.120', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.040', 'AMMO3': '0.184', 'AMMO4': '0.200', 'weapon5': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.562', 'weapon4': '0.760', 'WEAPON3': '1.150', 'weapon3': '2.068', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '11.169', 'FRAGCOUNT': '35.000'} [2023-02-25 13:20:41,223][36139] DAMAGECOUNT value on done: 118491.0 [2023-02-25 13:20:41,224][36139] Sum rewards: 55.807, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.730', 'ARMOR': '0.004', 'AMMO5': '0.027', 'AMMO2': '0.027', 'weapon5': '0.086', 'AMMO4': '0.134', 'weapon2': '0.198', 'AMMO3': '0.222', 'weapon4': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.090', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.952', 'FRAGCOUNT': '49.000'} [2023-02-25 13:20:42,155][36154] DAMAGECOUNT value on done: 119377.0 [2023-02-25 13:20:42,156][36154] Sum rewards: 45.270, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.816', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.170', 'weapon2': '0.214', 'AMMO4': '0.243', 'AMMO3': '0.251', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.418', 'WEAPON3': '1.500', 'HITCOUNT': '2.610', 'weapon3': '2.714', 'DAMAGECOUNT': '13.005', 'FRAGCOUNT': '42.000'} [2023-02-25 13:20:42,480][36154] DAMAGECOUNT value on done: 117122.0 [2023-02-25 13:20:42,480][36154] Sum rewards: 59.076, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.985', 'AMMO5': '0.014', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.096', 'weapon4': '0.170', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.270', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.166', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.490', 'FRAGCOUNT': '51.000'} [2023-02-25 13:20:42,786][36140] DAMAGECOUNT value on done: 120987.0 [2023-02-25 13:20:42,786][36140] Sum rewards: 51.757, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.682', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO3': '0.212', 'weapon2': '0.212', 'weapon4': '0.226', 'WEAPON3': '1.250', 'HITCOUNT': '2.630', 'weapon3': '3.206', 'DAMAGECOUNT': '13.584', 'FRAGCOUNT': '45.000'} [2023-02-25 13:20:42,798][36154] DAMAGECOUNT value on done: 119901.0 [2023-02-25 13:20:42,799][36154] Sum rewards: 48.052, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.759', 'AMMO2': '0.005', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.022', 'weapon5': '0.110', 'weapon4': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'weapon2': '0.690', 'WEAPON3': '1.050', 'weapon3': '2.832', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.522', 'FRAGCOUNT': '41.000'} [2023-02-25 13:20:42,886][36138] Updated weights for policy 0, policy_version 38393 (0.0009) [2023-02-25 13:20:42,909][36157] DAMAGECOUNT value on done: 118773.0 [2023-02-25 13:20:42,909][36157] Sum rewards: 59.728, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.705', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.016', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'weapon2': '0.748', 'WEAPON3': '1.000', 'HITCOUNT': '3.100', 'weapon3': '3.104', 'DAMAGECOUNT': '14.364', 'FRAGCOUNT': '49.000'} [2023-02-25 13:20:43,098][36140] DAMAGECOUNT value on done: 118239.0 [2023-02-25 13:20:43,098][36140] Sum rewards: 51.413, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.740', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'AMMO3': '0.174', 'WEAPON4': '0.350', 'weapon4': '0.392', 'weapon2': '0.462', 'ARMOR': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.910', 'weapon3': '2.948', 'DAMAGECOUNT': '13.620', 'FRAGCOUNT': '44.000'} [2023-02-25 13:20:43,117][36154] DAMAGECOUNT value on done: 119498.0 [2023-02-25 13:20:43,117][36154] Sum rewards: 46.870, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.110', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon2': '0.374', 'weapon4': '0.408', 'WEAPON3': '1.250', 'HITCOUNT': '2.810', 'weapon3': '2.866', 'DAMAGECOUNT': '12.504', 'FRAGCOUNT': '43.000'} [2023-02-25 13:20:43,154][36141] DAMAGECOUNT value on done: 118778.0 [2023-02-25 13:20:43,154][36141] Sum rewards: 50.883, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.445', 'AMMO5': '0.004', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.211', 'weapon4': '0.212', 'weapon2': '0.218', 'WEAPON3': '1.250', 'HITCOUNT': '2.890', 'weapon3': '3.352', 'DAMAGECOUNT': '12.651', 'FRAGCOUNT': '44.000'} [2023-02-25 13:20:43,222][36157] DAMAGECOUNT value on done: 118764.0 [2023-02-25 13:20:43,223][36157] Sum rewards: 54.459, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.890', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon4': '0.204', 'weapon2': '0.918', 'WEAPON3': '1.100', 'weapon3': '2.718', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '13.704', 'FRAGCOUNT': '45.000'} [2023-02-25 13:20:43,487][36141] DAMAGECOUNT value on done: 120115.0 [2023-02-25 13:20:43,487][36141] Sum rewards: 40.540, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.500', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.043', 'weapon7': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.164', 'WEAPON7': '0.200', 'AMMO4': '0.213', 'weapon5': '0.240', 'weapon2': '0.266', 'WEAPON5': '0.550', 'WEAPON4': '0.750', 'WEAPON3': '1.000', 'weapon4': '1.346', 'weapon3': '1.418', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '11.688', 'FRAGCOUNT': '36.000'} [2023-02-25 13:20:43,493][36157] DAMAGECOUNT value on done: 119112.0 [2023-02-25 13:20:43,493][36157] Sum rewards: 53.195, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.050', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.041', 'AMMO3': '0.197', 'AMMO4': '0.206', 'weapon2': '0.214', 'weapon5': '0.216', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.724', 'WEAPON3': '1.200', 'weapon3': '2.560', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.223', 'FRAGCOUNT': '48.000'} [2023-02-25 13:20:43,499][36141] DAMAGECOUNT value on done: 121050.0 [2023-02-25 13:20:43,500][36141] Sum rewards: 59.890, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.030', 'AMMO5': '0.014', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon5': '0.178', 'AMMO3': '0.179', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.396', 'weapon4': '0.702', 'WEAPON3': '1.050', 'weapon3': '2.468', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.754', 'FRAGCOUNT': '50.000'} [2023-02-25 13:20:43,503][36140] DAMAGECOUNT value on done: 119835.0 [2023-02-25 13:20:43,503][36140] Sum rewards: 49.554, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.497', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.140', 'weapon5': '0.178', 'weapon2': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.694', 'WEAPON3': '0.800', 'weapon3': '2.590', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '11.841', 'FRAGCOUNT': '42.000'} [2023-02-25 13:20:43,547][36156] DAMAGECOUNT value on done: 120335.0 [2023-02-25 13:20:43,547][36156] Sum rewards: 54.470, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.584', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.055', 'AMMO3': '0.158', 'weapon2': '0.256', 'AMMO4': '0.277', 'weapon5': '0.318', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '1.000', 'weapon4': '1.092', 'weapon3': '1.936', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.643', 'FRAGCOUNT': '48.000'} [2023-02-25 13:20:43,804][36157] DAMAGECOUNT value on done: 118561.0 [2023-02-25 13:20:43,805][36157] Sum rewards: 77.090, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.673', 'AMMO5': '0.003', 'AMMO2': '0.003', 'weapon5': '0.016', 'AMMO4': '0.017', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.204', 'weapon2': '0.292', 'weapon4': '0.326', 'WEAPON3': '1.300', 'weapon3': '3.220', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.922', 'FRAGCOUNT': '65.000'} [2023-02-25 13:20:43,808][36141] DAMAGECOUNT value on done: 113683.0 [2023-02-25 13:20:43,808][36140] DAMAGECOUNT value on done: 116518.0 [2023-02-25 13:20:43,809][36140] Sum rewards: 55.301, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.062', 'AMMO5': '0.016', 'AMMO2': '0.051', 'AMMO3': '0.157', 'AMMO4': '0.254', 'weapon5': '0.280', 'weapon2': '0.366', 'WEAPON5': '0.450', 'weapon4': '0.466', 'WEAPON4': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.600', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.863', 'FRAGCOUNT': '48.000'} [2023-02-25 13:20:43,809][36141] Sum rewards: 46.927, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.890', 'AMMO5': '0.010', 'weapon5': '0.030', 'AMMO2': '0.046', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'AMMO4': '0.230', 'weapon2': '0.332', 'WEAPON4': '0.350', 'weapon4': '0.434', 'WEAPON3': '1.100', 'HITCOUNT': '2.650', 'weapon3': '3.036', 'DAMAGECOUNT': '11.712', 'FRAGCOUNT': '42.000'} [2023-02-25 13:20:43,853][36156] DAMAGECOUNT value on done: 116959.0 [2023-02-25 13:20:43,853][36156] Sum rewards: 42.737, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.100', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon5': '0.122', 'AMMO3': '0.143', 'weapon2': '0.206', 'AMMO4': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.724', 'WEAPON3': '0.900', 'HITCOUNT': '2.360', 'weapon3': '2.530', 'DAMAGECOUNT': '10.437', 'FRAGCOUNT': '38.000'} [2023-02-25 13:20:43,864][36156] DAMAGECOUNT value on done: 120094.0 [2023-02-25 13:20:43,864][36156] Sum rewards: 44.032, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.284', 'ARMOR': '0.008', 'AMMO5': '0.009', 'weapon5': '0.024', 'AMMO2': '0.035', 'AMMO4': '0.177', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.326', 'weapon4': '0.418', 'WEAPON3': '1.200', 'HITCOUNT': '3.010', 'weapon3': '3.034', 'DAMAGECOUNT': '12.885', 'FRAGCOUNT': '38.000'} [2023-02-25 13:20:43,896][36142] DAMAGECOUNT value on done: 113618.0 [2023-02-25 13:20:43,897][36142] Sum rewards: 38.413, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.098', 'AMMO3': '0.135', 'AMMO4': '0.215', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HEALTH': '0.594', 'weapon4': '0.660', 'weapon2': '0.708', 'WEAPON3': '0.750', 'weapon3': '2.282', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '9.906', 'FRAGCOUNT': '32.000'} [2023-02-25 13:20:44,162][36156] DAMAGECOUNT value on done: 117114.0 [2023-02-25 13:20:44,163][36156] Sum rewards: 63.881, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.275', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.036', 'weapon5': '0.044', 'AMMO4': '0.062', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.207', 'weapon2': '0.388', 'WEAPON3': '1.350', 'HITCOUNT': '3.140', 'weapon3': '3.318', 'DAMAGECOUNT': '14.793', 'FRAGCOUNT': '56.000'} [2023-02-25 13:20:44,216][36142] DAMAGECOUNT value on done: 119935.0 [2023-02-25 13:20:44,217][36142] Sum rewards: 48.428, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.194', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.120', 'AMMO3': '0.131', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.400', 'weapon2': '0.430', 'weapon4': '0.710', 'WEAPON3': '0.850', 'weapon3': '2.536', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '11.877', 'FRAGCOUNT': '40.000'} [2023-02-25 13:20:44,520][36142] DAMAGECOUNT value on done: 115534.0 [2023-02-25 13:20:44,520][36142] Sum rewards: 45.071, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.680', 'AMMO5': '0.009', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.252', 'AMMO3': '0.262', 'weapon2': '0.292', 'WEAPON3': '1.550', 'HITCOUNT': '2.880', 'weapon3': '3.088', 'DAMAGECOUNT': '12.822', 'FRAGCOUNT': '42.500'} [2023-02-25 13:20:44,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13246.0). Total num frames: 157282304. Throughput: 0: 3376.2. Samples: 1814778. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:20:44,730][36114] Avg episode reward: [(0, '50.200')] [2023-02-25 13:20:44,823][36142] DAMAGECOUNT value on done: 121100.0 [2023-02-25 13:20:44,823][36142] Sum rewards: 49.532, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.675', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon5': '0.124', 'AMMO3': '0.186', 'AMMO4': '0.227', 'weapon2': '0.272', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.530', 'WEAPON3': '1.100', 'HITCOUNT': '2.780', 'weapon3': '2.834', 'DAMAGECOUNT': '13.341', 'FRAGCOUNT': '44.000'} [2023-02-25 13:20:45,859][36138] Updated weights for policy 0, policy_version 38403 (0.0009) [2023-02-25 13:20:48,868][36138] Updated weights for policy 0, policy_version 38413 (0.0009) [2023-02-25 13:20:49,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13259.9). Total num frames: 157347840. Throughput: 0: 3383.1. Samples: 1835328. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:20:49,729][36114] Avg episode reward: [(0, '50.168')] [2023-02-25 13:20:51,860][36138] Updated weights for policy 0, policy_version 38423 (0.0010) [2023-02-25 13:20:54,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13287.7). Total num frames: 157417472. Throughput: 0: 3383.2. Samples: 1845512. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:20:54,730][36114] Avg episode reward: [(0, '50.168')] [2023-02-25 13:20:54,913][36138] Updated weights for policy 0, policy_version 38433 (0.0009) [2023-02-25 13:20:57,960][36138] Updated weights for policy 0, policy_version 38443 (0.0009) [2023-02-25 13:20:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13301.6). Total num frames: 157483008. Throughput: 0: 3380.4. Samples: 1865738. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:20:59,729][36114] Avg episode reward: [(0, '50.168')] [2023-02-25 13:20:59,738][36155] DAMAGECOUNT value on done: 118743.0 [2023-02-25 13:20:59,739][36155] Sum rewards: 35.255, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.716', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.038', 'weapon5': '0.130', 'AMMO4': '0.189', 'weapon2': '0.226', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'WEAPON4': '0.350', 'weapon4': '0.602', 'WEAPON3': '1.450', 'HITCOUNT': '2.640', 'weapon3': '2.740', 'DAMAGECOUNT': '11.328', 'FRAGCOUNT': '34.000'} [2023-02-25 13:21:00,037][36155] DAMAGECOUNT value on done: 126224.0 [2023-02-25 13:21:00,037][36155] Sum rewards: 45.079, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.730', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon5': '0.034', 'AMMO4': '0.147', 'WEAPON5': '0.200', 'AMMO3': '0.261', 'weapon2': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.590', 'WEAPON3': '1.450', 'weapon3': '2.842', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.632', 'FRAGCOUNT': '42.000'} [2023-02-25 13:21:00,113][36139] DAMAGECOUNT value on done: 121127.0 [2023-02-25 13:21:00,113][36139] Sum rewards: 51.531, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.020', 'AMMO5': '0.014', 'AMMO2': '0.018', 'weapon5': '0.052', 'AMMO4': '0.087', 'AMMO3': '0.183', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.330', 'weapon4': '0.530', 'WEAPON3': '1.100', 'HITCOUNT': '2.670', 'weapon3': '2.824', 'DAMAGECOUNT': '11.943', 'FRAGCOUNT': '46.000'} [2023-02-25 13:21:00,159][36155] DAMAGECOUNT value on done: 123341.0 [2023-02-25 13:21:00,159][36155] Sum rewards: 60.624, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO2': '0.021', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.178', 'weapon2': '0.352', 'weapon4': '0.424', 'HEALTH': '0.632', 'WEAPON3': '1.000', 'HITCOUNT': '2.910', 'weapon3': '3.044', 'DAMAGECOUNT': '14.061', 'FRAGCOUNT': '52.000'} [2023-02-25 13:21:00,418][36139] DAMAGECOUNT value on done: 126047.0 [2023-02-25 13:21:00,419][36139] Sum rewards: 47.737, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.548', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.024', 'weapon5': '0.094', 'AMMO4': '0.121', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'weapon4': '0.328', 'WEAPON5': '0.400', 'weapon2': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.720', 'weapon3': '2.922', 'DAMAGECOUNT': '12.159', 'FRAGCOUNT': '42.000'} [2023-02-25 13:21:00,471][36155] DAMAGECOUNT value on done: 120580.0 [2023-02-25 13:21:00,472][36155] Sum rewards: 46.594, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.965', 'AMMO5': '0.016', 'AMMO2': '0.047', 'AMMO3': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.118', 'weapon5': '0.194', 'AMMO4': '0.233', 'weapon2': '0.354', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.700', 'weapon4': '0.742', 'weapon3': '1.736', 'HITCOUNT': '2.310', 'DAMAGECOUNT': '11.610', 'FRAGCOUNT': '39.000'} [2023-02-25 13:21:00,575][36139] DAMAGECOUNT value on done: 125513.0 [2023-02-25 13:21:00,576][36139] Sum rewards: 52.871, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.737', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.040', 'AMMO4': '0.201', 'AMMO3': '0.202', 'weapon5': '0.236', 'weapon2': '0.352', 'weapon4': '0.426', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.682', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.995', 'FRAGCOUNT': '48.000'} [2023-02-25 13:21:00,887][36139] DAMAGECOUNT value on done: 122251.0 [2023-02-25 13:21:00,887][36139] Sum rewards: 42.358, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.088', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.040', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon2': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.430', 'weapon3': '3.412', 'DAMAGECOUNT': '11.280', 'FRAGCOUNT': '37.000'} [2023-02-25 13:21:00,963][36138] Updated weights for policy 0, policy_version 38453 (0.0009) [2023-02-25 13:21:02,088][36154] DAMAGECOUNT value on done: 123413.0 [2023-02-25 13:21:02,088][36154] Sum rewards: 36.979, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.200', 'AMMO5': '0.014', 'AMMO2': '0.056', 'weapon5': '0.236', 'AMMO3': '0.238', 'AMMO4': '0.282', 'weapon2': '0.346', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.662', 'WEAPON3': '1.300', 'weapon3': '2.436', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '12.108', 'FRAGCOUNT': '34.500'} [2023-02-25 13:21:02,389][36154] DAMAGECOUNT value on done: 120700.0 [2023-02-25 13:21:02,389][36154] Sum rewards: 38.690, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.530', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'AMMO4': '0.197', 'weapon2': '0.346', 'WEAPON4': '0.400', 'weapon4': '0.590', 'WEAPON3': '1.250', 'HITCOUNT': '2.630', 'weapon3': '2.698', 'DAMAGECOUNT': '10.734', 'FRAGCOUNT': '37.000'} [2023-02-25 13:21:02,626][36140] DAMAGECOUNT value on done: 125495.0 [2023-02-25 13:21:02,626][36140] Sum rewards: 53.611, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.092', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'weapon4': '0.252', 'weapon2': '0.394', 'WEAPON3': '1.300', 'weapon3': '2.900', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.524', 'FRAGCOUNT': '48.000'} [2023-02-25 13:21:02,669][36154] DAMAGECOUNT value on done: 123679.0 [2023-02-25 13:21:02,669][36154] Sum rewards: 40.319, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.936', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.048', 'AMMO3': '0.189', 'AMMO4': '0.238', 'weapon5': '0.258', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.400', 'weapon4': '0.514', 'WEAPON3': '1.200', 'weapon3': '2.516', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '11.334', 'FRAGCOUNT': '37.000'} [2023-02-25 13:21:02,782][36157] DAMAGECOUNT value on done: 123527.0 [2023-02-25 13:21:02,783][36157] Sum rewards: 53.098, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.202', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.226', 'weapon2': '0.416', 'WEAPON4': '0.450', 'weapon4': '0.468', 'WEAPON3': '1.250', 'weapon3': '2.736', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.262', 'FRAGCOUNT': '49.000'} [2023-02-25 13:21:02,931][36140] DAMAGECOUNT value on done: 122225.0 [2023-02-25 13:21:02,931][36140] Sum rewards: 40.041, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.595', 'AMMO2': '0.004', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO4': '0.019', 'weapon5': '0.058', 'weapon4': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.692', 'WEAPON3': '1.250', 'HITCOUNT': '2.860', 'weapon3': '2.896', 'DAMAGECOUNT': '11.958', 'FRAGCOUNT': '35.000'} [2023-02-25 13:21:02,989][36154] DAMAGECOUNT value on done: 123401.0 [2023-02-25 13:21:02,990][36154] Sum rewards: 41.096, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.250', 'AMMO5': '0.007', 'AMMO2': '0.012', 'ARMOR': '0.016', 'weapon5': '0.052', 'AMMO4': '0.062', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon4': '0.266', 'weapon2': '0.454', 'WEAPON3': '1.200', 'weapon3': '2.860', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '11.709', 'FRAGCOUNT': '34.500'} [2023-02-25 13:21:03,069][36141] DAMAGECOUNT value on done: 122691.0 [2023-02-25 13:21:03,070][36141] Sum rewards: 48.052, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.572', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.044', 'AMMO4': '0.059', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'weapon4': '0.450', 'ARMOR': '0.456', 'weapon2': '0.526', 'WEAPON3': '1.000', 'HITCOUNT': '2.630', 'weapon3': '2.750', 'DAMAGECOUNT': '11.739', 'FRAGCOUNT': '40.000'} [2023-02-25 13:21:03,091][36157] DAMAGECOUNT value on done: 123310.0 [2023-02-25 13:21:03,092][36157] Sum rewards: 51.171, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.950', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.038', 'weapon5': '0.134', 'AMMO4': '0.192', 'AMMO3': '0.207', 'weapon4': '0.412', 'weapon2': '0.492', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.612', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.638', 'FRAGCOUNT': '46.000'} [2023-02-25 13:21:03,193][36156] DAMAGECOUNT value on done: 125734.0 [2023-02-25 13:21:03,194][36156] Sum rewards: 62.617, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.742', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.096', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon2': '0.276', 'weapon4': '0.286', 'WEAPON3': '1.300', 'weapon3': '3.100', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.197', 'FRAGCOUNT': '53.000'} [2023-02-25 13:21:03,314][36140] DAMAGECOUNT value on done: 124185.0 [2023-02-25 13:21:03,315][36140] Sum rewards: 47.912, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.350', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.031', 'weapon5': '0.044', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'weapon2': '0.196', 'AMMO3': '0.254', 'WEAPON4': '0.500', 'weapon4': '0.536', 'WEAPON3': '1.600', 'HITCOUNT': '2.830', 'weapon3': '2.902', 'DAMAGECOUNT': '13.050', 'FRAGCOUNT': '48.000'} [2023-02-25 13:21:03,339][36157] DAMAGECOUNT value on done: 124543.0 [2023-02-25 13:21:03,340][36157] Sum rewards: 64.967, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.880', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon5': '0.080', 'AMMO3': '0.165', 'weapon2': '0.192', 'AMMO4': '0.222', 'WEAPON5': '0.350', 'WEAPON4': '0.650', 'weapon4': '0.754', 'WEAPON3': '1.000', 'weapon3': '2.696', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.257', 'FRAGCOUNT': '56.000'} [2023-02-25 13:21:03,363][36141] DAMAGECOUNT value on done: 124027.0 [2023-02-25 13:21:03,364][36141] Sum rewards: 41.612, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.786', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'weapon5': '0.166', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'weapon4': '0.404', 'weapon2': '0.538', 'WEAPON3': '1.350', 'weapon3': '2.650', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '11.736', 'FRAGCOUNT': '38.000'} [2023-02-25 13:21:03,375][36141] DAMAGECOUNT value on done: 126067.0 [2023-02-25 13:21:03,375][36141] Sum rewards: 59.441, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.636', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO3': '0.226', 'weapon2': '0.466', 'WEAPON3': '1.500', 'HITCOUNT': '3.190', 'weapon3': '3.384', 'DAMAGECOUNT': '15.051', 'FRAGCOUNT': '51.000'} [2023-02-25 13:21:03,489][36156] DAMAGECOUNT value on done: 121292.0 [2023-02-25 13:21:03,489][36156] Sum rewards: 45.550, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.662', 'AMMO5': '0.011', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.114', 'weapon4': '0.236', 'WEAPON4': '0.250', 'AMMO3': '0.279', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.600', 'weapon3': '3.010', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '12.819', 'FRAGCOUNT': '44.000'} [2023-02-25 13:21:03,523][36156] DAMAGECOUNT value on done: 124150.0 [2023-02-25 13:21:03,523][36156] Sum rewards: 50.379, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.944', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.260', 'weapon4': '0.280', 'WEAPON3': '1.050', 'HITCOUNT': '2.690', 'weapon3': '3.162', 'DAMAGECOUNT': '12.168', 'FRAGCOUNT': '43.000'} [2023-02-25 13:21:03,617][36140] DAMAGECOUNT value on done: 122077.0 [2023-02-25 13:21:03,617][36140] Sum rewards: 63.686, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.474', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon5': '0.170', 'AMMO3': '0.199', 'AMMO4': '0.244', 'weapon2': '0.298', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.728', 'WEAPON3': '1.200', 'weapon3': '2.416', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '53.000'} [2023-02-25 13:21:03,640][36157] DAMAGECOUNT value on done: 122736.0 [2023-02-25 13:21:03,641][36157] Sum rewards: 50.355, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.460', 'weapon5': '0.002', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.014', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.147', 'weapon2': '0.702', 'WEAPON3': '0.900', 'HITCOUNT': '2.820', 'weapon3': '3.166', 'DAMAGECOUNT': '12.525', 'FRAGCOUNT': '40.000'} [2023-02-25 13:21:03,658][36141] DAMAGECOUNT value on done: 117959.0 [2023-02-25 13:21:03,658][36141] Sum rewards: 50.857, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.980', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'weapon5': '0.028', 'AMMO2': '0.040', 'AMMO4': '0.199', 'AMMO3': '0.206', 'WEAPON5': '0.450', 'weapon2': '0.468', 'weapon4': '0.536', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.660', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '12.828', 'FRAGCOUNT': '48.000'} [2023-02-25 13:21:03,788][36156] DAMAGECOUNT value on done: 120984.0 [2023-02-25 13:21:03,788][36156] Sum rewards: 42.943, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.936', 'AMMO5': '0.018', 'AMMO2': '0.035', 'AMMO4': '0.177', 'AMMO3': '0.192', 'weapon4': '0.212', 'weapon5': '0.228', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.516', 'WEAPON3': '0.950', 'HITCOUNT': '2.400', 'weapon3': '2.770', 'DAMAGECOUNT': '11.430', 'FRAGCOUNT': '37.000'} [2023-02-25 13:21:03,868][36142] DAMAGECOUNT value on done: 117763.0 [2023-02-25 13:21:03,868][36142] Sum rewards: 40.096, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.436', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.031', 'weapon5': '0.152', 'AMMO4': '0.154', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.346', 'WEAPON4': '0.350', 'weapon4': '0.408', 'WEAPON3': '1.250', 'HITCOUNT': '2.700', 'weapon3': '2.722', 'DAMAGECOUNT': '12.435', 'FRAGCOUNT': '35.500'} [2023-02-25 13:21:04,013][36138] Updated weights for policy 0, policy_version 38463 (0.0009) [2023-02-25 13:21:04,177][36142] DAMAGECOUNT value on done: 123215.0 [2023-02-25 13:21:04,177][36142] Sum rewards: 39.056, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.269', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.042', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.177', 'WEAPON4': '0.400', 'weapon4': '0.616', 'weapon2': '0.844', 'WEAPON3': '1.000', 'weapon3': '2.132', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '9.840', 'FRAGCOUNT': '36.000'} [2023-02-25 13:21:04,481][36142] DAMAGECOUNT value on done: 120517.0 [2023-02-25 13:21:04,481][36142] Sum rewards: 64.098, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.681', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.046', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.270', 'weapon4': '0.424', 'WEAPON3': '1.300', 'weapon3': '3.002', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '14.949', 'FRAGCOUNT': '56.000'} [2023-02-25 13:21:04,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13301.6). Total num frames: 157552640. Throughput: 0: 3380.6. Samples: 1885972. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:21:04,730][36114] Avg episode reward: [(0, '49.272')] [2023-02-25 13:21:04,791][36142] DAMAGECOUNT value on done: 126004.0 [2023-02-25 13:21:04,791][36142] Sum rewards: 58.643, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.624', 'ARMOR': '0.004', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.023', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'WEAPON5': '0.250', 'weapon5': '0.260', 'weapon2': '0.430', 'weapon4': '0.458', 'WEAPON3': '1.200', 'weapon3': '2.576', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.712', 'FRAGCOUNT': '49.000'} [2023-02-25 13:21:04,935][36142] Large shaping reward 2.585 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.555, 185.0)] [2023-02-25 13:21:07,011][36138] Updated weights for policy 0, policy_version 38473 (0.0009) [2023-02-25 13:21:09,729][36114] Fps is (10 sec: 13926.4, 60 sec: 13585.1, 300 sec: 13315.5). Total num frames: 157622272. Throughput: 0: 3381.5. Samples: 1896156. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:21:09,730][36114] Avg episode reward: [(0, '49.455')] [2023-02-25 13:21:10,013][36138] Updated weights for policy 0, policy_version 38483 (0.0010) [2023-02-25 13:21:13,008][36138] Updated weights for policy 0, policy_version 38493 (0.0009) [2023-02-25 13:21:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13315.5). Total num frames: 157687808. Throughput: 0: 3386.1. Samples: 1916604. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:21:14,730][36114] Avg episode reward: [(0, '49.455')] [2023-02-25 13:21:16,048][36138] Updated weights for policy 0, policy_version 38503 (0.0009) [2023-02-25 13:21:19,099][36138] Updated weights for policy 0, policy_version 38513 (0.0009) [2023-02-25 13:21:19,465][36155] DAMAGECOUNT value on done: 122924.0 [2023-02-25 13:21:19,466][36155] Sum rewards: 49.595, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.114', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.060', 'AMMO4': '0.102', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon4': '0.254', 'weapon2': '0.358', 'WEAPON3': '1.350', 'HITCOUNT': '2.770', 'weapon3': '3.074', 'DAMAGECOUNT': '12.543', 'FRAGCOUNT': '45.000'} [2023-02-25 13:21:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13315.5). Total num frames: 157757440. Throughput: 0: 3385.6. Samples: 1936834. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:21:19,730][36114] Avg episode reward: [(0, '49.328')] [2023-02-25 13:21:19,733][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000038515_157757440.pth... [2023-02-25 13:21:19,791][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000037730_154542080.pth [2023-02-25 13:21:19,794][36155] DAMAGECOUNT value on done: 130671.0 [2023-02-25 13:21:19,794][36155] Sum rewards: 54.006, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.677', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'weapon4': '0.098', 'WEAPON5': '0.100', 'weapon5': '0.112', 'weapon2': '0.152', 'AMMO3': '0.226', 'WEAPON3': '1.350', 'HITCOUNT': '3.050', 'weapon3': '3.422', 'DAMAGECOUNT': '13.341', 'FRAGCOUNT': '47.000'} [2023-02-25 13:21:19,843][36139] DAMAGECOUNT value on done: 124938.0 [2023-02-25 13:21:19,843][36139] Sum rewards: 37.964, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.072', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.061', 'AMMO3': '0.191', 'weapon5': '0.258', 'AMMO4': '0.306', 'WEAPON5': '0.400', 'weapon2': '0.596', 'WEAPON4': '0.600', 'weapon4': '0.826', 'WEAPON3': '1.100', 'weapon3': '1.878', 'HITCOUNT': '2.370', 'DAMAGECOUNT': '11.433', 'FRAGCOUNT': '36.000'} [2023-02-25 13:21:19,905][36155] DAMAGECOUNT value on done: 127520.0 [2023-02-25 13:21:19,905][36155] Sum rewards: 52.605, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.090', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon5': '0.038', 'AMMO4': '0.045', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.306', 'weapon2': '0.406', 'WEAPON3': '1.050', 'weapon3': '3.046', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '12.537', 'FRAGCOUNT': '45.000'} [2023-02-25 13:21:20,140][36139] DAMAGECOUNT value on done: 130758.0 [2023-02-25 13:21:20,140][36139] Sum rewards: 52.162, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.886', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.238', 'AMMO3': '0.262', 'weapon2': '0.262', 'WEAPON3': '1.550', 'HITCOUNT': '3.000', 'weapon3': '3.160', 'DAMAGECOUNT': '14.133', 'FRAGCOUNT': '47.000'} [2023-02-25 13:21:20,219][36155] DAMAGECOUNT value on done: 124690.0 [2023-02-25 13:21:20,219][36155] Sum rewards: 43.956, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.395', 'AMMO2': '0.023', 'AMMO5': '0.027', 'weapon4': '0.108', 'AMMO4': '0.117', 'weapon5': '0.226', 'WEAPON4': '0.250', 'AMMO3': '0.288', 'weapon2': '0.314', 'WEAPON5': '0.500', 'WEAPON3': '1.700', 'HITCOUNT': '2.460', 'weapon3': '3.008', 'DAMAGECOUNT': '12.330', 'FRAGCOUNT': '44.000'} [2023-02-25 13:21:20,345][36139] DAMAGECOUNT value on done: 129514.0 [2023-02-25 13:21:20,345][36139] Sum rewards: 45.021, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.775', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon5': '0.092', 'AMMO3': '0.178', 'weapon4': '0.234', 'AMMO4': '0.246', 'WEAPON5': '0.300', 'weapon2': '0.430', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.690', 'weapon3': '3.008', 'DAMAGECOUNT': '12.003', 'FRAGCOUNT': '42.000'} [2023-02-25 13:21:20,663][36139] DAMAGECOUNT value on done: 126539.0 [2023-02-25 13:21:20,664][36139] Sum rewards: 47.791, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.190', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.050', 'weapon5': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.239', 'weapon2': '0.244', 'WEAPON3': '1.400', 'HITCOUNT': '2.950', 'weapon3': '3.462', 'DAMAGECOUNT': '12.864', 'FRAGCOUNT': '42.000'} [2023-02-25 13:21:21,963][36154] DAMAGECOUNT value on done: 128341.0 [2023-02-25 13:21:21,964][36154] Sum rewards: 57.959, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.496', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon7': '0.076', 'weapon5': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon4': '0.390', 'weapon2': '0.506', 'WEAPON3': '1.250', 'weapon3': '2.688', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.784', 'FRAGCOUNT': '49.000'} [2023-02-25 13:21:22,192][36138] Updated weights for policy 0, policy_version 38523 (0.0009) [2023-02-25 13:21:22,278][36154] DAMAGECOUNT value on done: 124751.0 [2023-02-25 13:21:22,278][36154] Sum rewards: 45.629, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.017', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.156', 'AMMO3': '0.200', 'weapon2': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.432', 'WEAPON3': '1.150', 'HITCOUNT': '2.710', 'weapon3': '2.752', 'DAMAGECOUNT': '12.153', 'FRAGCOUNT': '41.000'} [2023-02-25 13:21:22,486][36140] DAMAGECOUNT value on done: 129310.0 [2023-02-25 13:21:22,486][36140] Sum rewards: 43.989, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.979', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.025', 'AMMO3': '0.116', 'AMMO4': '0.124', 'weapon5': '0.138', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.422', 'WEAPON3': '0.700', 'weapon2': '0.740', 'HITCOUNT': '2.500', 'weapon3': '2.538', 'DAMAGECOUNT': '11.445', 'FRAGCOUNT': '36.000'} [2023-02-25 13:21:22,562][36154] DAMAGECOUNT value on done: 128137.0 [2023-02-25 13:21:22,563][36154] Sum rewards: 50.819, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.584', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon5': '0.072', 'AMMO4': '0.097', 'AMMO3': '0.196', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.332', 'weapon4': '0.662', 'WEAPON3': '1.200', 'weapon3': '2.670', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.374', 'FRAGCOUNT': '43.000'} [2023-02-25 13:21:22,736][36157] DAMAGECOUNT value on done: 128630.0 [2023-02-25 13:21:22,737][36157] Sum rewards: 63.425, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.560', 'AMMO5': '0.006', 'AMMO2': '0.011', 'AMMO4': '0.057', 'weapon5': '0.100', 'AMMO3': '0.121', 'weapon4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.850', 'weapon2': '0.868', 'weapon3': '2.762', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.309', 'FRAGCOUNT': '51.000'} [2023-02-25 13:21:22,807][36140] DAMAGECOUNT value on done: 126457.0 [2023-02-25 13:21:22,807][36140] Sum rewards: 50.540, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.800', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon5': '0.056', 'weapon4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.208', 'AMMO3': '0.212', 'WEAPON3': '1.250', 'HITCOUNT': '2.630', 'weapon3': '3.448', 'DAMAGECOUNT': '12.696', 'FRAGCOUNT': '44.000'} [2023-02-25 13:21:22,879][36154] DAMAGECOUNT value on done: 128317.0 [2023-02-25 13:21:22,880][36154] Sum rewards: 55.925, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.750', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.138', 'AMMO4': '0.153', 'weapon4': '0.208', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.016', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.748', 'FRAGCOUNT': '51.000'} [2023-02-25 13:21:23,049][36157] DAMAGECOUNT value on done: 127932.0 [2023-02-25 13:21:23,049][36157] Sum rewards: 54.024, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.759', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.046', 'AMMO3': '0.120', 'weapon5': '0.152', 'AMMO4': '0.230', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.452', 'weapon4': '0.698', 'WEAPON3': '0.750', 'weapon3': '2.098', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.866', 'FRAGCOUNT': '43.000'} [2023-02-25 13:21:23,092][36141] DAMAGECOUNT value on done: 127574.0 [2023-02-25 13:21:23,093][36141] Sum rewards: 50.908, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.866', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.043', 'AMMO3': '0.190', 'AMMO4': '0.217', 'weapon5': '0.222', 'weapon2': '0.320', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.714', 'WEAPON3': '1.100', 'weapon3': '2.306', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '14.649', 'FRAGCOUNT': '45.000'} [2023-02-25 13:21:23,174][36156] DAMAGECOUNT value on done: 129888.0 [2023-02-25 13:21:23,175][36156] Sum rewards: 39.263, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.245', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.050', 'AMMO3': '0.121', 'AMMO4': '0.251', 'weapon5': '0.278', 'WEAPON5': '0.400', 'weapon2': '0.484', 'WEAPON4': '0.550', 'WEAPON3': '0.800', 'weapon4': '0.842', 'weapon3': '1.964', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '12.462', 'FRAGCOUNT': '34.000'} [2023-02-25 13:21:23,195][36140] DAMAGECOUNT value on done: 127591.0 [2023-02-25 13:21:23,196][36140] Sum rewards: 38.222, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.226', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon5': '0.100', 'AMMO4': '0.134', 'AMMO3': '0.254', 'weapon2': '0.260', 'weapon4': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '2.170', 'weapon3': '3.106', 'DAMAGECOUNT': '10.218', 'FRAGCOUNT': '40.000'} [2023-02-25 13:21:23,305][36157] DAMAGECOUNT value on done: 129013.0 [2023-02-25 13:21:23,305][36157] Sum rewards: 51.546, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.184', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.053', 'AMMO3': '0.154', 'weapon5': '0.176', 'AMMO4': '0.266', 'WEAPON5': '0.350', 'weapon2': '0.442', 'WEAPON4': '0.600', 'weapon4': '0.604', 'WEAPON3': '0.950', 'weapon3': '2.494', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.410', 'FRAGCOUNT': '46.000'} [2023-02-25 13:21:23,388][36141] DAMAGECOUNT value on done: 128504.0 [2023-02-25 13:21:23,389][36141] Sum rewards: 51.697, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.814', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.162', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.258', 'WEAPON4': '0.300', 'weapon4': '0.736', 'ARMOR': '0.836', 'WEAPON3': '1.200', 'weapon3': '2.572', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '13.431', 'FRAGCOUNT': '46.000'} [2023-02-25 13:21:23,453][36156] DAMAGECOUNT value on done: 126975.0 [2023-02-25 13:21:23,454][36156] Sum rewards: 66.841, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.750', 'AMMO5': '0.015', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.100', 'AMMO3': '0.220', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.408', 'WEAPON3': '1.350', 'weapon3': '2.948', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '57.000'} [2023-02-25 13:21:23,458][36141] DAMAGECOUNT value on done: 130333.0 [2023-02-25 13:21:23,459][36141] Sum rewards: 48.267, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.535', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.153', 'weapon5': '0.158', 'AMMO3': '0.213', 'weapon2': '0.322', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon4': '0.458', 'WEAPON3': '1.350', 'weapon3': '2.754', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.798', 'FRAGCOUNT': '44.000'} [2023-02-25 13:21:23,491][36156] DAMAGECOUNT value on done: 128522.0 [2023-02-25 13:21:23,492][36156] Sum rewards: 45.577, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.908', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon4': '0.038', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'weapon2': '0.228', 'AMMO3': '0.270', 'WEAPON3': '1.500', 'HITCOUNT': '2.670', 'weapon3': '3.434', 'DAMAGECOUNT': '13.116', 'FRAGCOUNT': '43.000'} [2023-02-25 13:21:23,514][36140] DAMAGECOUNT value on done: 126562.0 [2023-02-25 13:21:23,515][36140] Sum rewards: 49.146, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.390', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.076', 'weapon2': '0.138', 'AMMO4': '0.139', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.306', 'WEAPON3': '1.150', 'HITCOUNT': '2.880', 'weapon3': '3.218', 'DAMAGECOUNT': '13.455', 'FRAGCOUNT': '42.000'} [2023-02-25 13:21:23,610][36157] DAMAGECOUNT value on done: 128327.0 [2023-02-25 13:21:23,610][36157] Sum rewards: 64.393, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.770', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.092', 'AMMO3': '0.180', 'AMMO4': '0.195', 'WEAPON5': '0.250', 'weapon2': '0.334', 'WEAPON4': '0.500', 'weapon4': '0.874', 'WEAPON3': '1.050', 'weapon3': '2.454', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '54.000'} [2023-02-25 13:21:23,766][36141] DAMAGECOUNT value on done: 122558.0 [2023-02-25 13:21:23,766][36141] Sum rewards: 48.785, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.720', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon5': '0.186', 'AMMO3': '0.187', 'AMMO4': '0.193', 'weapon2': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.524', 'WEAPON3': '1.150', 'weapon3': '2.760', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.797', 'FRAGCOUNT': '43.000'} [2023-02-25 13:21:23,776][36156] DAMAGECOUNT value on done: 125764.0 [2023-02-25 13:21:23,777][36156] Sum rewards: 54.320, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.490', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.064', 'AMMO4': '0.146', 'WEAPON5': '0.200', 'weapon4': '0.218', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'weapon2': '0.696', 'WEAPON3': '1.400', 'weapon3': '2.804', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.340', 'FRAGCOUNT': '49.000'} [2023-02-25 13:21:23,861][36142] DAMAGECOUNT value on done: 122584.0 [2023-02-25 13:21:23,861][36142] Sum rewards: 55.770, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.952', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.054', 'AMMO4': '0.106', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.322', 'weapon2': '0.636', 'WEAPON3': '1.100', 'weapon3': '2.746', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.463', 'FRAGCOUNT': '47.000'} [2023-02-25 13:21:24,173][36142] DAMAGECOUNT value on done: 127621.0 [2023-02-25 13:21:24,173][36142] Sum rewards: 49.653, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.296', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.110', 'AMMO4': '0.124', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon4': '0.256', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '2.830', 'weapon3': '3.058', 'DAMAGECOUNT': '13.218', 'FRAGCOUNT': '44.000'} [2023-02-25 13:21:24,480][36142] DAMAGECOUNT value on done: 124698.0 [2023-02-25 13:21:24,481][36142] Sum rewards: 49.096, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.044', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.124', 'weapon5': '0.228', 'WEAPON5': '0.250', 'weapon2': '0.340', 'WEAPON4': '0.450', 'WEAPON3': '0.700', 'weapon4': '0.842', 'weapon3': '2.104', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '12.543', 'FRAGCOUNT': '40.000'} [2023-02-25 13:21:24,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13315.5). Total num frames: 157822976. Throughput: 0: 3382.4. Samples: 1946770. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:21:24,730][36114] Avg episode reward: [(0, '50.288')] [2023-02-25 13:21:24,788][36142] DAMAGECOUNT value on done: 129774.0 [2023-02-25 13:21:24,788][36142] Sum rewards: 36.132, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.410', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.020', 'AMMO4': '0.099', 'AMMO3': '0.165', 'weapon5': '0.186', 'weapon2': '0.310', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.946', 'WEAPON3': '1.050', 'weapon3': '1.984', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '11.310', 'FRAGCOUNT': '31.000'} [2023-02-25 13:21:25,275][36138] Updated weights for policy 0, policy_version 38533 (0.0010) [2023-02-25 13:21:28,300][36138] Updated weights for policy 0, policy_version 38543 (0.0009) [2023-02-25 13:21:29,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13516.8, 300 sec: 13315.5). Total num frames: 157888512. Throughput: 0: 3380.4. Samples: 1966898. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:21:29,730][36114] Avg episode reward: [(0, '50.120')] [2023-02-25 13:21:31,342][36138] Updated weights for policy 0, policy_version 38553 (0.0010) [2023-02-25 13:21:34,330][36138] Updated weights for policy 0, policy_version 38563 (0.0010) [2023-02-25 13:21:34,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13343.2). Total num frames: 157958144. Throughput: 0: 3375.2. Samples: 1987214. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:21:34,730][36114] Avg episode reward: [(0, '50.120')] [2023-02-25 13:21:37,402][36138] Updated weights for policy 0, policy_version 38573 (0.0009) [2023-02-25 13:21:38,170][36156] Large shaping reward 2.509 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.123, -41.0), ('weapon5', 0.002)] [2023-02-25 13:21:39,358][36155] DAMAGECOUNT value on done: 127303.0 [2023-02-25 13:21:39,359][36155] Sum rewards: 48.561, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.245', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon5': '0.078', 'AMMO4': '0.104', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.288', 'weapon2': '0.534', 'WEAPON3': '1.200', 'HITCOUNT': '2.830', 'weapon3': '2.906', 'DAMAGECOUNT': '13.137', 'FRAGCOUNT': '41.000'} [2023-02-25 13:21:39,674][36155] DAMAGECOUNT value on done: 134946.0 [2023-02-25 13:21:39,675][36155] Sum rewards: 46.462, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.394', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO5': '0.022', 'weapon5': '0.080', 'AMMO4': '0.109', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'weapon4': '0.318', 'WEAPON5': '0.350', 'weapon2': '0.434', 'WEAPON3': '1.100', 'HITCOUNT': '2.710', 'weapon3': '2.790', 'DAMAGECOUNT': '12.825', 'FRAGCOUNT': '38.000'} [2023-02-25 13:21:39,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13343.2). Total num frames: 158023680. Throughput: 0: 3371.4. Samples: 1997224. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:21:39,729][36114] Avg episode reward: [(0, '50.066')] [2023-02-25 13:21:39,755][36155] DAMAGECOUNT value on done: 131489.0 [2023-02-25 13:21:39,756][36155] Sum rewards: 44.147, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.356', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.088', 'AMMO4': '0.140', 'AMMO3': '0.194', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON4': '0.350', 'weapon4': '0.370', 'WEAPON3': '1.150', 'HITCOUNT': '2.750', 'weapon3': '2.918', 'DAMAGECOUNT': '11.907', 'FRAGCOUNT': '40.000'} [2023-02-25 13:21:39,820][36139] DAMAGECOUNT value on done: 129119.0 [2023-02-25 13:21:39,821][36139] Sum rewards: 49.536, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.789', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon7': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.128', 'AMMO4': '0.143', 'AMMO3': '0.189', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.346', 'WEAPON4': '0.500', 'weapon4': '0.916', 'WEAPON3': '1.050', 'weapon3': '2.294', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '12.543', 'FRAGCOUNT': '44.000'} [2023-02-25 13:21:40,070][36155] DAMAGECOUNT value on done: 128914.0 [2023-02-25 13:21:40,070][36155] Sum rewards: 50.690, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.671', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO4': '0.102', 'weapon5': '0.118', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.366', 'weapon4': '0.424', 'WEAPON3': '1.150', 'weapon3': '2.750', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.672', 'FRAGCOUNT': '43.000'} [2023-02-25 13:21:40,126][36139] DAMAGECOUNT value on done: 135614.0 [2023-02-25 13:21:40,126][36139] Sum rewards: 59.032, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.622', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.194', 'weapon2': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'weapon4': '0.456', 'WEAPON3': '1.350', 'weapon3': '2.836', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.532', 'FRAGCOUNT': '53.000'} [2023-02-25 13:21:40,361][36139] DAMAGECOUNT value on done: 134365.0 [2023-02-25 13:21:40,361][36139] Sum rewards: 56.929, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.530', 'AMMO5': '0.017', 'AMMO2': '0.034', 'weapon4': '0.140', 'weapon5': '0.146', 'AMMO4': '0.172', 'AMMO3': '0.197', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.486', 'WEAPON3': '1.200', 'weapon3': '2.864', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.553', 'FRAGCOUNT': '50.000'} [2023-02-25 13:21:40,452][36138] Updated weights for policy 0, policy_version 38583 (0.0009) [2023-02-25 13:21:40,670][36139] DAMAGECOUNT value on done: 130919.0 [2023-02-25 13:21:40,670][36139] Sum rewards: 46.724, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.930', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.128', 'AMMO4': '0.143', 'weapon4': '0.150', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.504', 'WEAPON3': '1.350', 'HITCOUNT': '2.740', 'weapon3': '3.008', 'DAMAGECOUNT': '13.140', 'FRAGCOUNT': '42.000'} [2023-02-25 13:21:41,994][36154] DAMAGECOUNT value on done: 132777.0 [2023-02-25 13:21:41,994][36154] Sum rewards: 45.319, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.643', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.164', 'WEAPON4': '0.250', 'weapon4': '0.254', 'AMMO3': '0.279', 'weapon2': '0.284', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '2.860', 'weapon3': '2.996', 'DAMAGECOUNT': '13.308', 'FRAGCOUNT': '43.000'} [2023-02-25 13:21:42,001][36139] Large shaping reward 2.601 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.579, 193.0), ('weapon5', 0.002)] [2023-02-25 13:21:42,293][36154] DAMAGECOUNT value on done: 128475.0 [2023-02-25 13:21:42,294][36154] Sum rewards: 36.448, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.794', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.222', 'weapon5': '0.236', 'WEAPON4': '0.350', 'weapon4': '0.398', 'WEAPON5': '0.400', 'weapon2': '0.418', 'WEAPON3': '1.450', 'HITCOUNT': '2.590', 'weapon3': '2.598', 'DAMAGECOUNT': '11.172', 'FRAGCOUNT': '36.000'} [2023-02-25 13:21:42,425][36140] DAMAGECOUNT value on done: 133994.0 [2023-02-25 13:21:42,425][36140] Sum rewards: 60.150, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.180', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'weapon2': '0.186', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'weapon4': '0.274', 'WEAPON3': '1.600', 'HITCOUNT': '3.220', 'weapon3': '3.348', 'DAMAGECOUNT': '14.052', 'FRAGCOUNT': '56.000'} [2023-02-25 13:21:42,579][36154] DAMAGECOUNT value on done: 132583.0 [2023-02-25 13:21:42,579][36154] Sum rewards: 45.979, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.008', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.078', 'AMMO4': '0.160', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON4': '0.400', 'weapon4': '0.418', 'WEAPON3': '1.400', 'HITCOUNT': '2.930', 'weapon3': '2.950', 'DAMAGECOUNT': '13.338', 'FRAGCOUNT': '43.000'} [2023-02-25 13:21:42,741][36140] DAMAGECOUNT value on done: 131178.0 [2023-02-25 13:21:42,742][36140] Sum rewards: 46.311, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.535', 'ARMOR': '0.004', 'AMMO5': '0.027', 'AMMO2': '0.060', 'AMMO3': '0.239', 'AMMO4': '0.299', 'weapon5': '0.318', 'weapon2': '0.426', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'weapon4': '0.814', 'WEAPON3': '1.350', 'weapon3': '2.016', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '14.163', 'FRAGCOUNT': '44.000'} [2023-02-25 13:21:42,779][36157] DAMAGECOUNT value on done: 132515.0 [2023-02-25 13:21:42,780][36157] Sum rewards: 41.732, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.682', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.062', 'AMMO4': '0.095', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.256', 'weapon2': '0.520', 'WEAPON3': '1.250', 'HITCOUNT': '2.730', 'weapon3': '2.952', 'DAMAGECOUNT': '11.655', 'FRAGCOUNT': '39.000'} [2023-02-25 13:21:42,870][36154] DAMAGECOUNT value on done: 131547.0 [2023-02-25 13:21:42,870][36154] Sum rewards: 29.509, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.486', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.035', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'AMMO3': '0.195', 'weapon5': '0.204', 'weapon2': '0.306', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon4': '1.272', 'weapon3': '1.748', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '9.570', 'FRAGCOUNT': '30.500'} [2023-02-25 13:21:43,075][36141] DAMAGECOUNT value on done: 132383.0 [2023-02-25 13:21:43,075][36141] Sum rewards: 58.900, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.770', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.100', 'AMMO4': '0.186', 'AMMO3': '0.189', 'weapon2': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.690', 'WEAPON3': '1.100', 'weapon3': '2.634', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.427', 'FRAGCOUNT': '49.000'} [2023-02-25 13:21:43,088][36157] DAMAGECOUNT value on done: 132022.0 [2023-02-25 13:21:43,089][36157] Sum rewards: 45.085, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.214', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'weapon5': '0.094', 'AMMO4': '0.152', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon2': '0.332', 'WEAPON4': '0.350', 'weapon4': '0.584', 'WEAPON3': '1.300', 'weapon3': '2.614', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '12.255', 'FRAGCOUNT': '41.000'} [2023-02-25 13:21:43,126][36140] DAMAGECOUNT value on done: 132112.0 [2023-02-25 13:21:43,126][36140] Sum rewards: 54.704, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.626', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.038', 'AMMO3': '0.157', 'AMMO4': '0.190', 'weapon2': '0.246', 'weapon5': '0.292', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.718', 'WEAPON3': '1.000', 'weapon3': '2.440', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.563', 'FRAGCOUNT': '47.000'} [2023-02-25 13:21:43,339][36156] DAMAGECOUNT value on done: 134774.0 [2023-02-25 13:21:43,339][36156] Sum rewards: 54.782, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.190', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon4': '0.148', 'AMMO4': '0.210', 'AMMO3': '0.227', 'weapon5': '0.288', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.686', 'WEAPON3': '1.350', 'weapon3': '2.580', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '14.376', 'FRAGCOUNT': '49.500'} [2023-02-25 13:21:43,348][36157] DAMAGECOUNT value on done: 133839.0 [2023-02-25 13:21:43,349][36157] Sum rewards: 55.405, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.028', 'ARMOR': '0.008', 'AMMO5': '0.021', 'AMMO2': '0.038', 'AMMO3': '0.174', 'AMMO4': '0.192', 'weapon2': '0.210', 'weapon5': '0.240', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.740', 'WEAPON3': '1.050', 'weapon3': '2.382', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.478', 'FRAGCOUNT': '48.000'} [2023-02-25 13:21:43,379][36141] DAMAGECOUNT value on done: 132406.0 [2023-02-25 13:21:43,379][36141] Sum rewards: 39.101, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.086', 'AMMO5': '0.016', 'AMMO2': '0.030', 'weapon4': '0.124', 'AMMO4': '0.149', 'AMMO3': '0.200', 'weapon5': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.792', 'WEAPON3': '1.100', 'HITCOUNT': '2.500', 'weapon3': '2.582', 'DAMAGECOUNT': '11.706', 'FRAGCOUNT': '35.000'} [2023-02-25 13:21:43,436][36140] DAMAGECOUNT value on done: 131244.0 [2023-02-25 13:21:43,436][36140] Sum rewards: 55.163, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.753', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.014', 'weapon5': '0.036', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.219', 'weapon2': '0.590', 'WEAPON3': '1.250', 'HITCOUNT': '2.920', 'weapon3': '3.182', 'DAMAGECOUNT': '14.046', 'FRAGCOUNT': '47.000'} [2023-02-25 13:21:43,451][36141] DAMAGECOUNT value on done: 135053.0 [2023-02-25 13:21:43,451][36141] Sum rewards: 49.700, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.423', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.052', 'AMMO3': '0.186', 'weapon5': '0.214', 'AMMO4': '0.257', 'weapon4': '0.384', 'weapon2': '0.420', 'WEAPON5': '0.550', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.632', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.160', 'FRAGCOUNT': '45.000'} [2023-02-25 13:21:43,523][36138] Updated weights for policy 0, policy_version 38593 (0.0010) [2023-02-25 13:21:43,608][36156] DAMAGECOUNT value on done: 132359.0 [2023-02-25 13:21:43,608][36156] Sum rewards: 55.318, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.035', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.038', 'AMMO4': '0.188', 'AMMO3': '0.214', 'weapon5': '0.248', 'weapon4': '0.260', 'weapon2': '0.288', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.858', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '48.500'} [2023-02-25 13:21:43,649][36156] DAMAGECOUNT value on done: 132337.0 [2023-02-25 13:21:43,649][36156] Sum rewards: 37.805, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.228', 'AMMO5': '0.013', 'AMMO2': '0.043', 'AMMO3': '0.201', 'AMMO4': '0.213', 'weapon2': '0.234', 'weapon5': '0.286', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon4': '1.226', 'weapon3': '1.892', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '11.445', 'FRAGCOUNT': '34.000'} [2023-02-25 13:21:43,659][36157] DAMAGECOUNT value on done: 132443.0 [2023-02-25 13:21:43,660][36157] Sum rewards: 46.796, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.615', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.105', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon2': '0.424', 'weapon4': '0.446', 'WEAPON3': '1.000', 'HITCOUNT': '2.660', 'weapon3': '2.818', 'DAMAGECOUNT': '12.348', 'FRAGCOUNT': '39.000'} [2023-02-25 13:21:43,754][36141] DAMAGECOUNT value on done: 127741.0 [2023-02-25 13:21:43,754][36141] Sum rewards: 56.669, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.097', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.106', 'AMMO4': '0.123', 'weapon4': '0.200', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.450', 'weapon3': '3.082', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.549', 'FRAGCOUNT': '49.000'} [2023-02-25 13:21:43,762][36142] DAMAGECOUNT value on done: 125992.0 [2023-02-25 13:21:43,763][36142] Sum rewards: 35.328, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.510', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.098', 'AMMO4': '0.142', 'AMMO3': '0.161', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.436', 'weapon2': '0.816', 'WEAPON3': '0.950', 'weapon3': '2.400', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '10.224', 'FRAGCOUNT': '32.000'} [2023-02-25 13:21:43,932][36156] DAMAGECOUNT value on done: 129323.0 [2023-02-25 13:21:43,932][36156] Sum rewards: 42.152, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.304', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.058', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.256', 'weapon4': '0.296', 'weapon2': '0.378', 'WEAPON3': '1.500', 'HITCOUNT': '2.520', 'weapon3': '2.988', 'DAMAGECOUNT': '10.677', 'FRAGCOUNT': '41.000'} [2023-02-25 13:21:44,089][36142] DAMAGECOUNT value on done: 131876.0 [2023-02-25 13:21:44,090][36142] Sum rewards: 52.471, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.664', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.086', 'AMMO3': '0.146', 'AMMO4': '0.194', 'WEAPON5': '0.200', 'weapon2': '0.240', 'WEAPON4': '0.450', 'weapon4': '0.832', 'WEAPON3': '0.950', 'weapon3': '2.540', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.492', 'FRAGCOUNT': '45.000'} [2023-02-25 13:21:44,408][36142] DAMAGECOUNT value on done: 129095.0 [2023-02-25 13:21:44,408][36142] Sum rewards: 47.585, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.570', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.046', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'weapon4': '0.246', 'weapon2': '0.732', 'WEAPON3': '1.150', 'HITCOUNT': '2.810', 'weapon3': '2.856', 'DAMAGECOUNT': '13.191', 'FRAGCOUNT': '39.000'} [2023-02-25 13:21:44,709][36142] DAMAGECOUNT value on done: 133885.0 [2023-02-25 13:21:44,709][36142] Sum rewards: 43.194, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.862', 'AMMO5': '0.014', 'AMMO2': '0.050', 'AMMO3': '0.178', 'weapon5': '0.216', 'AMMO4': '0.249', 'weapon4': '0.430', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon2': '0.864', 'WEAPON3': '1.050', 'weapon3': '2.152', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.333', 'FRAGCOUNT': '38.000'} [2023-02-25 13:21:44,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13343.2). Total num frames: 158093312. Throughput: 0: 3370.0. Samples: 2017386. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:21:44,729][36114] Avg episode reward: [(0, '49.169')] [2023-02-25 13:21:46,491][36138] Updated weights for policy 0, policy_version 38603 (0.0009) [2023-02-25 13:21:49,493][36138] Updated weights for policy 0, policy_version 38613 (0.0009) [2023-02-25 13:21:49,729][36114] Fps is (10 sec: 13516.4, 60 sec: 13516.7, 300 sec: 13343.2). Total num frames: 158158848. Throughput: 0: 3375.4. Samples: 2037866. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:21:49,730][36114] Avg episode reward: [(0, '49.169')] [2023-02-25 13:21:52,544][36138] Updated weights for policy 0, policy_version 38623 (0.0010) [2023-02-25 13:21:53,764][36157] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:21:54,729][36114] Fps is (10 sec: 13516.6, 60 sec: 13516.8, 300 sec: 13357.1). Total num frames: 158228480. Throughput: 0: 3374.7. Samples: 2048016. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:21:54,730][36114] Avg episode reward: [(0, '49.169')] [2023-02-25 13:21:54,980][36141] Large shaping reward 2.524 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.504, 168.0)] [2023-02-25 13:21:55,582][36138] Updated weights for policy 0, policy_version 38633 (0.0009) [2023-02-25 13:21:57,195][36142] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 13:21:57,330][36155] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:21:58,602][36138] Updated weights for policy 0, policy_version 38643 (0.0009) [2023-02-25 13:21:59,034][36155] DAMAGECOUNT value on done: 131287.0 [2023-02-25 13:21:59,034][36155] Sum rewards: 41.962, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.844', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon5': '0.124', 'AMMO4': '0.127', 'AMMO3': '0.170', 'weapon2': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.390', 'WEAPON3': '1.050', 'HITCOUNT': '2.650', 'weapon3': '2.878', 'DAMAGECOUNT': '11.952', 'FRAGCOUNT': '37.000'} [2023-02-25 13:21:59,353][36155] DAMAGECOUNT value on done: 138629.0 [2023-02-25 13:21:59,354][36155] Sum rewards: 44.587, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.512', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.174', 'WEAPON4': '0.300', 'weapon2': '0.534', 'weapon4': '0.766', 'WEAPON3': '1.100', 'weapon3': '2.334', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '11.049', 'FRAGCOUNT': '39.000'} [2023-02-25 13:21:59,453][36155] DAMAGECOUNT value on done: 135552.0 [2023-02-25 13:21:59,453][36155] Sum rewards: 50.697, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.890', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon4': '0.336', 'weapon2': '0.354', 'WEAPON3': '1.150', 'HITCOUNT': '2.640', 'weapon3': '3.150', 'DAMAGECOUNT': '12.189', 'FRAGCOUNT': '44.000'} [2023-02-25 13:21:59,650][36139] DAMAGECOUNT value on done: 134373.0 [2023-02-25 13:21:59,651][36139] Sum rewards: 58.669, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.236', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon2': '0.296', 'weapon4': '0.476', 'WEAPON3': '1.250', 'weapon3': '2.968', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '15.762', 'FRAGCOUNT': '49.000'} [2023-02-25 13:21:59,729][36114] Fps is (10 sec: 13517.1, 60 sec: 13516.8, 300 sec: 13371.0). Total num frames: 158294016. Throughput: 0: 3372.1. Samples: 2068350. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:21:59,730][36114] Avg episode reward: [(0, '49.059')] [2023-02-25 13:21:59,763][36155] DAMAGECOUNT value on done: 132395.0 [2023-02-25 13:21:59,764][36155] Sum rewards: 39.644, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.304', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.041', 'AMMO3': '0.192', 'AMMO4': '0.204', 'weapon5': '0.252', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.648', 'weapon2': '0.746', 'WEAPON3': '1.100', 'weapon3': '2.044', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '10.443', 'FRAGCOUNT': '37.000'} [2023-02-25 13:21:59,975][36139] DAMAGECOUNT value on done: 139583.0 [2023-02-25 13:21:59,976][36139] Sum rewards: 47.757, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.654', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.110', 'AMMO3': '0.150', 'weapon2': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.454', 'weapon4': '0.538', 'WEAPON3': '0.850', 'HITCOUNT': '2.760', 'weapon3': '2.792', 'DAMAGECOUNT': '11.907', 'FRAGCOUNT': '40.000'} [2023-02-25 13:22:00,271][36139] DAMAGECOUNT value on done: 138441.0 [2023-02-25 13:22:00,271][36139] Sum rewards: 40.863, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.054', 'ARMOR': '0.004', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon5': '0.136', 'AMMO3': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.490', 'weapon2': '0.552', 'WEAPON3': '1.600', 'weapon3': '2.532', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '12.228', 'FRAGCOUNT': '39.500'} [2023-02-25 13:22:00,570][36139] DAMAGECOUNT value on done: 135110.0 [2023-02-25 13:22:00,571][36139] Sum rewards: 40.762, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.392', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon5': '0.112', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'AMMO4': '0.263', 'weapon2': '0.264', 'ARMOR': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.000', 'weapon4': '1.060', 'weapon3': '2.112', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.573', 'FRAGCOUNT': '37.000'} [2023-02-25 13:22:01,629][36138] Updated weights for policy 0, policy_version 38653 (0.0009) [2023-02-25 13:22:01,885][36154] DAMAGECOUNT value on done: 137003.0 [2023-02-25 13:22:01,885][36154] Sum rewards: 49.058, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.224', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon5': '0.054', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.236', 'weapon4': '0.364', 'weapon2': '0.698', 'WEAPON3': '1.450', 'weapon3': '2.610', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.678', 'FRAGCOUNT': '45.000'} [2023-02-25 13:22:02,193][36154] DAMAGECOUNT value on done: 133210.0 [2023-02-25 13:22:02,194][36154] Sum rewards: 60.860, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.030', 'AMMO5': '0.011', 'AMMO2': '0.019', 'weapon5': '0.082', 'AMMO4': '0.095', 'AMMO3': '0.157', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.500', 'WEAPON3': '0.900', 'weapon3': '2.872', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.205', 'FRAGCOUNT': '51.000'} [2023-02-25 13:22:02,313][36140] DAMAGECOUNT value on done: 138768.0 [2023-02-25 13:22:02,314][36140] Sum rewards: 54.327, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.850', 'AMMO5': '0.013', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.182', 'AMMO3': '0.204', 'weapon2': '0.590', 'WEAPON3': '1.300', 'weapon3': '2.908', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.322', 'FRAGCOUNT': '46.000'} [2023-02-25 13:22:02,468][36154] DAMAGECOUNT value on done: 137613.0 [2023-02-25 13:22:02,468][36154] Sum rewards: 53.110, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.520', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.036', 'weapon5': '0.104', 'AMMO3': '0.157', 'AMMO4': '0.182', 'weapon4': '0.278', 'WEAPON5': '0.350', 'weapon2': '0.384', 'WEAPON4': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '2.970', 'weapon3': '3.006', 'DAMAGECOUNT': '15.090', 'FRAGCOUNT': '44.000'} [2023-02-25 13:22:02,580][36157] DAMAGECOUNT value on done: 137608.0 [2023-02-25 13:22:02,581][36157] Sum rewards: 57.048, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.569', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.029', 'weapon5': '0.126', 'AMMO4': '0.143', 'AMMO3': '0.199', 'weapon4': '0.258', 'weapon2': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '3.040', 'weapon3': '3.092', 'DAMAGECOUNT': '15.279', 'FRAGCOUNT': '48.500'} [2023-02-25 13:22:02,633][36140] DAMAGECOUNT value on done: 135656.0 [2023-02-25 13:22:02,634][36140] Sum rewards: 46.585, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.322', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.056', 'weapon5': '0.116', 'AMMO3': '0.221', 'weapon2': '0.246', 'WEAPON5': '0.250', 'AMMO4': '0.280', 'WEAPON4': '0.650', 'weapon4': '0.842', 'WEAPON3': '1.350', 'weapon3': '2.526', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.434', 'FRAGCOUNT': '45.000'} [2023-02-25 13:22:02,767][36154] DAMAGECOUNT value on done: 134578.0 [2023-02-25 13:22:02,768][36154] Sum rewards: 36.831, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.036', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.054', 'AMMO4': '0.098', 'AMMO3': '0.133', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.598', 'weapon2': '0.826', 'WEAPON3': '0.900', 'weapon3': '2.284', 'HITCOUNT': '2.350', 'DAMAGECOUNT': '9.093', 'FRAGCOUNT': '34.000'} [2023-02-25 13:22:02,895][36157] DAMAGECOUNT value on done: 137350.0 [2023-02-25 13:22:02,895][36157] Sum rewards: 55.226, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.718', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon5': '0.178', 'AMMO4': '0.191', 'weapon2': '0.232', 'AMMO3': '0.249', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.524', 'WEAPON3': '1.550', 'weapon3': '2.726', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.984', 'FRAGCOUNT': '49.000'} [2023-02-25 13:22:03,022][36141] DAMAGECOUNT value on done: 137027.0 [2023-02-25 13:22:03,022][36141] Sum rewards: 56.580, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.440', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.064', 'AMMO4': '0.091', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon2': '0.208', 'WEAPON4': '0.250', 'weapon4': '0.348', 'WEAPON3': '1.200', 'HITCOUNT': '2.950', 'weapon3': '3.098', 'DAMAGECOUNT': '13.932', 'FRAGCOUNT': '49.000'} [2023-02-25 13:22:03,024][36140] DAMAGECOUNT value on done: 135920.0 [2023-02-25 13:22:03,025][36140] Sum rewards: 38.779, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.405', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.190', 'AMMO3': '0.218', 'weapon2': '0.452', 'WEAPON4': '0.550', 'weapon4': '0.760', 'WEAPON3': '1.250', 'weapon3': '2.460', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '11.424', 'FRAGCOUNT': '38.000'} [2023-02-25 13:22:03,109][36157] DAMAGECOUNT value on done: 138807.0 [2023-02-25 13:22:03,109][36157] Sum rewards: 58.102, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.060', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO3': '0.107', 'AMMO4': '0.136', 'weapon5': '0.144', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.436', 'weapon4': '0.496', 'WEAPON3': '0.700', 'weapon3': '2.666', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.568', 'FRAGCOUNT': '46.000'} [2023-02-25 13:22:03,118][36156] DAMAGECOUNT value on done: 139307.0 [2023-02-25 13:22:03,119][36156] Sum rewards: 54.836, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.353', 'AMMO5': '0.012', 'AMMO2': '0.052', 'AMMO3': '0.123', 'weapon5': '0.190', 'WEAPON5': '0.250', 'AMMO4': '0.262', 'weapon2': '0.370', 'WEAPON4': '0.500', 'WEAPON3': '0.700', 'weapon4': '0.966', 'weapon3': '2.114', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '13.599', 'FRAGCOUNT': '44.000'} [2023-02-25 13:22:03,335][36140] DAMAGECOUNT value on done: 135149.0 [2023-02-25 13:22:03,335][36141] DAMAGECOUNT value on done: 136559.0 [2023-02-25 13:22:03,336][36140] Sum rewards: 38.427, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.460', 'AMMO5': '0.012', 'AMMO2': '0.069', 'weapon5': '0.122', 'AMMO3': '0.168', 'WEAPON5': '0.300', 'AMMO4': '0.346', 'ARMOR': '0.456', 'weapon2': '0.572', 'weapon4': '0.632', 'WEAPON4': '0.700', 'WEAPON3': '1.050', 'weapon3': '2.194', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '11.715', 'FRAGCOUNT': '36.000'} [2023-02-25 13:22:03,336][36141] Sum rewards: 52.687, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.709', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.046', 'AMMO4': '0.129', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'weapon4': '0.206', 'WEAPON4': '0.300', 'weapon2': '0.606', 'WEAPON3': '1.050', 'HITCOUNT': '2.670', 'weapon3': '2.790', 'DAMAGECOUNT': '12.459', 'FRAGCOUNT': '45.000'} [2023-02-25 13:22:03,347][36141] DAMAGECOUNT value on done: 139363.0 [2023-02-25 13:22:03,348][36141] Sum rewards: 47.595, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.424', 'ARMOR': '0.004', 'AMMO5': '0.016', 'weapon7': '0.062', 'AMMO2': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.134', 'weapon5': '0.154', 'weapon2': '0.368', 'AMMO4': '0.378', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'WEAPON4': '0.800', 'weapon4': '0.826', 'weapon3': '2.156', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '12.885', 'FRAGCOUNT': '42.000'} [2023-02-25 13:22:03,403][36157] DAMAGECOUNT value on done: 136910.0 [2023-02-25 13:22:03,404][36157] Sum rewards: 52.164, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.620', 'AMMO5': '0.017', 'AMMO2': '0.032', 'weapon5': '0.122', 'AMMO4': '0.158', 'AMMO3': '0.189', 'weapon2': '0.332', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.442', 'WEAPON3': '1.100', 'weapon3': '2.800', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.401', 'FRAGCOUNT': '45.000'} [2023-02-25 13:22:03,411][36156] DAMAGECOUNT value on done: 136836.0 [2023-02-25 13:22:03,412][36156] Sum rewards: 53.335, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.210', 'AMMO5': '0.004', 'weapon5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.240', 'WEAPON4': '0.350', 'weapon4': '0.394', 'weapon2': '0.410', 'WEAPON3': '1.500', 'weapon3': '2.760', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.431', 'FRAGCOUNT': '50.000'} [2023-02-25 13:22:03,458][36156] DAMAGECOUNT value on done: 136493.0 [2023-02-25 13:22:03,459][36156] Sum rewards: 45.177, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.605', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.070', 'AMMO4': '0.120', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON4': '0.400', 'weapon4': '0.494', 'WEAPON3': '1.200', 'HITCOUNT': '2.830', 'weapon3': '2.910', 'DAMAGECOUNT': '12.468', 'FRAGCOUNT': '41.500'} [2023-02-25 13:22:03,664][36141] DAMAGECOUNT value on done: 131215.0 [2023-02-25 13:22:03,664][36141] Sum rewards: 42.555, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.835', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.133', 'weapon5': '0.170', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.672', 'weapon2': '0.698', 'WEAPON3': '0.850', 'weapon3': '1.968', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '10.422', 'FRAGCOUNT': '36.000'} [2023-02-25 13:22:03,702][36142] DAMAGECOUNT value on done: 130596.0 [2023-02-25 13:22:03,702][36142] Sum rewards: 49.790, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.364', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO3': '0.161', 'AMMO4': '0.167', 'weapon5': '0.236', 'WEAPON5': '0.400', 'weapon4': '0.486', 'WEAPON4': '0.500', 'weapon2': '0.540', 'WEAPON3': '1.000', 'weapon3': '2.500', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.716', 'FRAGCOUNT': '43.000'} [2023-02-25 13:22:03,723][36156] DAMAGECOUNT value on done: 133175.0 [2023-02-25 13:22:03,723][36156] Sum rewards: 43.430, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.336', 'ARMOR': '0.004', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.040', 'AMMO3': '0.183', 'AMMO4': '0.201', 'weapon5': '0.300', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.520', 'weapon4': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.254', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '11.556', 'FRAGCOUNT': '42.000'} [2023-02-25 13:22:04,021][36142] DAMAGECOUNT value on done: 135479.0 [2023-02-25 13:22:04,022][36142] Sum rewards: 39.626, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.268', 'AMMO5': '0.005', 'AMMO2': '0.046', 'weapon5': '0.064', 'AMMO3': '0.117', 'WEAPON5': '0.150', 'AMMO4': '0.228', 'WEAPON4': '0.350', 'ARMOR': '0.404', 'weapon2': '0.478', 'weapon4': '0.644', 'WEAPON3': '0.700', 'weapon3': '2.188', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '10.329', 'FRAGCOUNT': '33.000'} [2023-02-25 13:22:04,340][36142] DAMAGECOUNT value on done: 134050.0 [2023-02-25 13:22:04,341][36142] Sum rewards: 57.689, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.380', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.048', 'AMMO4': '0.078', 'WEAPON5': '0.150', 'weapon4': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon2': '0.850', 'WEAPON3': '1.300', 'weapon3': '2.766', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '50.000'} [2023-02-25 13:22:04,660][36142] DAMAGECOUNT value on done: 138086.0 [2023-02-25 13:22:04,661][36142] Sum rewards: 43.629, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.390', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON5': '0.050', 'weapon5': '0.056', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon2': '0.516', 'weapon4': '0.616', 'WEAPON3': '1.350', 'weapon3': '2.554', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.603', 'FRAGCOUNT': '40.000'} [2023-02-25 13:22:04,715][36138] Updated weights for policy 0, policy_version 38663 (0.0009) [2023-02-25 13:22:04,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13384.9). Total num frames: 158363648. Throughput: 0: 3368.5. Samples: 2088416. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:22:04,730][36114] Avg episode reward: [(0, '48.970')] [2023-02-25 13:22:07,775][36138] Updated weights for policy 0, policy_version 38673 (0.0010) [2023-02-25 13:22:09,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 158429184. Throughput: 0: 3369.6. Samples: 2098404. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:22:09,730][36114] Avg episode reward: [(0, '48.970')] [2023-02-25 13:22:10,783][36138] Updated weights for policy 0, policy_version 38683 (0.0009) [2023-02-25 13:22:13,818][36138] Updated weights for policy 0, policy_version 38693 (0.0009) [2023-02-25 13:22:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13412.7). Total num frames: 158498816. Throughput: 0: 3372.8. Samples: 2118672. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:22:14,730][36114] Avg episode reward: [(0, '48.970')] [2023-02-25 13:22:16,852][36138] Updated weights for policy 0, policy_version 38703 (0.0010) [2023-02-25 13:22:18,990][36155] DAMAGECOUNT value on done: 134509.0 [2023-02-25 13:22:18,990][36155] Sum rewards: 33.831, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.010', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.044', 'weapon4': '0.080', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon2': '0.440', 'WEAPON3': '1.400', 'HITCOUNT': '2.400', 'weapon3': '3.152', 'DAMAGECOUNT': '9.666', 'FRAGCOUNT': '34.000'} [2023-02-25 13:22:19,294][36155] DAMAGECOUNT value on done: 142742.0 [2023-02-25 13:22:19,294][36155] Sum rewards: 40.005, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.864', 'AMMO5': '0.024', 'AMMO2': '0.034', 'AMMO4': '0.171', 'weapon5': '0.222', 'AMMO3': '0.275', 'weapon2': '0.374', 'WEAPON4': '0.450', 'weapon4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'HITCOUNT': '2.550', 'weapon3': '2.580', 'DAMAGECOUNT': '12.339', 'FRAGCOUNT': '38.000'} [2023-02-25 13:22:19,364][36155] DAMAGECOUNT value on done: 139578.0 [2023-02-25 13:22:19,365][36155] Sum rewards: 44.102, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.060', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.027', 'weapon5': '0.098', 'AMMO4': '0.136', 'weapon4': '0.142', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.456', 'WEAPON3': '1.300', 'HITCOUNT': '2.320', 'weapon3': '3.026', 'DAMAGECOUNT': '12.078', 'FRAGCOUNT': '40.000'} [2023-02-25 13:22:19,577][36139] DAMAGECOUNT value on done: 139153.0 [2023-02-25 13:22:19,578][36139] Sum rewards: 54.081, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.020', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.082', 'weapon4': '0.098', 'AMMO3': '0.196', 'weapon2': '0.458', 'WEAPON3': '1.200', 'HITCOUNT': '3.130', 'weapon3': '3.180', 'DAMAGECOUNT': '14.340', 'FRAGCOUNT': '45.000'} [2023-02-25 13:22:19,685][36155] DAMAGECOUNT value on done: 136456.0 [2023-02-25 13:22:19,685][36155] Sum rewards: 53.771, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.755', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.008', 'WEAPON5': '0.100', 'AMMO3': '0.162', 'weapon5': '0.164', 'weapon2': '0.494', 'WEAPON3': '1.050', 'HITCOUNT': '2.660', 'weapon3': '3.198', 'DAMAGECOUNT': '12.183', 'FRAGCOUNT': '45.000'} [2023-02-25 13:22:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 158564352. Throughput: 0: 3370.1. Samples: 2138870. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:22:19,730][36114] Avg episode reward: [(0, '48.713')] [2023-02-25 13:22:19,870][36139] DAMAGECOUNT value on done: 144412.0 [2023-02-25 13:22:19,871][36139] Sum rewards: 55.116, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.880', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.132', 'AMMO3': '0.154', 'AMMO4': '0.193', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.438', 'weapon4': '0.570', 'WEAPON3': '1.000', 'weapon3': '2.520', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.487', 'FRAGCOUNT': '47.000'} [2023-02-25 13:22:19,915][36138] Updated weights for policy 0, policy_version 38713 (0.0009) [2023-02-25 13:22:20,181][36139] DAMAGECOUNT value on done: 142628.0 [2023-02-25 13:22:20,181][36139] Sum rewards: 48.992, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.532', 'AMMO5': '0.017', 'AMMO2': '0.048', 'AMMO3': '0.147', 'weapon2': '0.198', 'AMMO4': '0.240', 'weapon5': '0.396', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon4': '0.836', 'WEAPON3': '0.850', 'weapon3': '2.200', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '12.561', 'FRAGCOUNT': '43.000'} [2023-02-25 13:22:20,486][36139] DAMAGECOUNT value on done: 138466.0 [2023-02-25 13:22:20,486][36139] Sum rewards: 33.352, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.353', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon5': '0.076', 'AMMO3': '0.110', 'AMMO4': '0.144', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.676', 'WEAPON3': '0.700', 'weapon2': '0.848', 'weapon3': '2.230', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '10.068', 'FRAGCOUNT': '28.000'} [2023-02-25 13:22:21,819][36154] DAMAGECOUNT value on done: 141817.0 [2023-02-25 13:22:21,820][36154] Sum rewards: 55.307, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.990', 'AMMO2': '0.015', 'AMMO5': '0.019', 'AMMO4': '0.073', 'weapon5': '0.116', 'AMMO3': '0.204', 'weapon4': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.388', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.968', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.442', 'FRAGCOUNT': '47.500'} [2023-02-25 13:22:22,127][36154] DAMAGECOUNT value on done: 136847.0 [2023-02-25 13:22:22,128][36154] Sum rewards: 37.662, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.510', 'AMMO5': '0.018', 'AMMO2': '0.025', 'weapon4': '0.118', 'AMMO4': '0.122', 'weapon5': '0.168', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.594', 'WEAPON3': '1.200', 'HITCOUNT': '2.050', 'weapon3': '2.872', 'DAMAGECOUNT': '10.911', 'FRAGCOUNT': '34.000'} [2023-02-25 13:22:22,228][36140] DAMAGECOUNT value on done: 142696.0 [2023-02-25 13:22:22,228][36140] Sum rewards: 50.395, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.385', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.118', 'AMMO3': '0.190', 'WEAPON5': '0.250', 'weapon2': '0.256', 'WEAPON4': '0.350', 'weapon4': '0.840', 'WEAPON3': '1.200', 'weapon3': '2.452', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '11.784', 'FRAGCOUNT': '43.000'} [2023-02-25 13:22:22,402][36154] DAMAGECOUNT value on done: 142273.0 [2023-02-25 13:22:22,403][36154] Sum rewards: 54.515, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.475', 'AMMO5': '0.019', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.150', 'AMMO3': '0.187', 'weapon4': '0.218', 'WEAPON4': '0.300', 'weapon2': '0.384', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '2.880', 'weapon3': '2.982', 'DAMAGECOUNT': '13.980', 'FRAGCOUNT': '47.000'} [2023-02-25 13:22:22,538][36140] DAMAGECOUNT value on done: 139796.0 [2023-02-25 13:22:22,538][36140] Sum rewards: 43.992, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.130', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'weapon5': '0.138', 'AMMO4': '0.157', 'AMMO3': '0.169', 'weapon4': '0.212', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.590', 'weapon3': '3.124', 'DAMAGECOUNT': '12.420', 'FRAGCOUNT': '38.000'} [2023-02-25 13:22:22,638][36157] DAMAGECOUNT value on done: 142479.0 [2023-02-25 13:22:22,639][36157] Sum rewards: 56.055, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.360', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.098', 'weapon5': '0.124', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon2': '0.274', 'weapon4': '0.298', 'WEAPON3': '1.400', 'HITCOUNT': '2.960', 'weapon3': '3.034', 'DAMAGECOUNT': '14.613', 'FRAGCOUNT': '50.000'} [2023-02-25 13:22:22,716][36154] DAMAGECOUNT value on done: 138967.0 [2023-02-25 13:22:22,717][36154] Sum rewards: 46.259, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.410', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.136', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.324', 'weapon2': '0.482', 'WEAPON3': '1.300', 'weapon3': '2.688', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.167', 'FRAGCOUNT': '41.500'} [2023-02-25 13:22:22,953][36138] Updated weights for policy 0, policy_version 38723 (0.0009) [2023-02-25 13:22:22,972][36140] DAMAGECOUNT value on done: 140541.0 [2023-02-25 13:22:22,973][36140] Sum rewards: 58.542, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.850', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.014', 'weapon4': '0.018', 'weapon5': '0.024', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.326', 'WEAPON3': '1.550', 'HITCOUNT': '3.030', 'weapon3': '3.448', 'DAMAGECOUNT': '13.863', 'FRAGCOUNT': '53.000'} [2023-02-25 13:22:22,974][36157] DAMAGECOUNT value on done: 141640.0 [2023-02-25 13:22:22,975][36157] Sum rewards: 43.244, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.254', 'ARMOR': '0.008', 'AMMO5': '0.024', 'AMMO2': '0.040', 'weapon5': '0.158', 'weapon2': '0.194', 'AMMO4': '0.201', 'AMMO3': '0.221', 'weapon4': '0.260', 'WEAPON4': '0.450', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'HITCOUNT': '2.700', 'weapon3': '3.072', 'DAMAGECOUNT': '12.870', 'FRAGCOUNT': '41.000'} [2023-02-25 13:22:23,050][36141] DAMAGECOUNT value on done: 142428.0 [2023-02-25 13:22:23,050][36141] Sum rewards: 63.952, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.865', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.006', 'weapon5': '0.008', 'WEAPON5': '0.100', 'AMMO3': '0.244', 'weapon2': '0.394', 'WEAPON3': '1.550', 'HITCOUNT': '3.390', 'weapon3': '3.416', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '55.000'} [2023-02-25 13:22:23,121][36156] DAMAGECOUNT value on done: 144240.0 [2023-02-25 13:22:23,122][36156] Sum rewards: 53.767, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.750', 'ARMOR': '0.004', 'AMMO5': '0.028', 'AMMO2': '0.057', 'AMMO3': '0.202', 'weapon2': '0.216', 'weapon5': '0.256', 'AMMO4': '0.283', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'weapon4': '0.770', 'WEAPON3': '1.250', 'weapon3': '2.362', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.799', 'FRAGCOUNT': '48.000'} [2023-02-25 13:22:23,168][36157] DAMAGECOUNT value on done: 142891.0 [2023-02-25 13:22:23,169][36157] Sum rewards: 46.661, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.093', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon5': '0.112', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'weapon2': '0.208', 'AMMO3': '0.230', 'weapon4': '0.266', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '2.610', 'weapon3': '3.170', 'DAMAGECOUNT': '12.252', 'FRAGCOUNT': '43.000'} [2023-02-25 13:22:23,280][36140] DAMAGECOUNT value on done: 138350.0 [2023-02-25 13:22:23,280][36140] Sum rewards: 36.102, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.140', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO3': '0.134', 'AMMO4': '0.143', 'weapon5': '0.216', 'weapon4': '0.352', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.676', 'WEAPON3': '0.850', 'HITCOUNT': '1.820', 'weapon3': '2.000', 'DAMAGECOUNT': '9.603', 'FRAGCOUNT': '32.000'} [2023-02-25 13:22:23,373][36141] DAMAGECOUNT value on done: 140691.0 [2023-02-25 13:22:23,373][36141] Sum rewards: 43.160, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.620', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon5': '0.104', 'AMMO4': '0.137', 'weapon4': '0.208', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.374', 'WEAPON3': '1.300', 'HITCOUNT': '2.640', 'weapon3': '3.062', 'DAMAGECOUNT': '12.396', 'FRAGCOUNT': '39.500'} [2023-02-25 13:22:23,386][36141] DAMAGECOUNT value on done: 144032.0 [2023-02-25 13:22:23,387][36141] Sum rewards: 50.748, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.412', 'AMMO5': '0.033', 'AMMO2': '0.053', 'weapon2': '0.238', 'AMMO3': '0.265', 'AMMO4': '0.267', 'weapon5': '0.384', 'WEAPON4': '0.650', 'weapon4': '0.698', 'WEAPON5': '0.800', 'WEAPON3': '1.550', 'weapon3': '2.254', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '14.007', 'FRAGCOUNT': '49.000'} [2023-02-25 13:22:23,406][36156] DAMAGECOUNT value on done: 141156.0 [2023-02-25 13:22:23,406][36156] Sum rewards: 50.530, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.812', 'AMMO5': '0.010', 'AMMO2': '0.011', 'weapon4': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'weapon5': '0.124', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'weapon2': '0.224', 'WEAPON3': '1.100', 'HITCOUNT': '2.800', 'weapon3': '3.370', 'DAMAGECOUNT': '12.960', 'FRAGCOUNT': '41.500'} [2023-02-25 13:22:23,444][36156] DAMAGECOUNT value on done: 139991.0 [2023-02-25 13:22:23,444][36156] Sum rewards: 39.670, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.796', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.096', 'AMMO4': '0.107', 'AMMO3': '0.119', 'WEAPON5': '0.150', 'WEAPON4': '0.450', 'weapon2': '0.502', 'WEAPON3': '0.800', 'weapon4': '1.132', 'weapon3': '1.980', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '10.494', 'FRAGCOUNT': '35.000'} [2023-02-25 13:22:23,484][36157] DAMAGECOUNT value on done: 141550.0 [2023-02-25 13:22:23,485][36157] Sum rewards: 46.710, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.717', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.096', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon2': '0.390', 'WEAPON4': '0.400', 'weapon4': '0.616', 'WEAPON3': '1.300', 'weapon3': '2.710', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '13.920', 'FRAGCOUNT': '42.000'} [2023-02-25 13:22:23,701][36141] DAMAGECOUNT value on done: 135077.0 [2023-02-25 13:22:23,702][36141] Sum rewards: 39.009, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.543', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.032', 'WEAPON1': '0.040', 'weapon5': '0.144', 'AMMO4': '0.160', 'AMMO3': '0.195', 'weapon2': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.664', 'WEAPON3': '1.100', 'weapon3': '2.258', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '11.586', 'FRAGCOUNT': '35.000'} [2023-02-25 13:22:23,718][36156] DAMAGECOUNT value on done: 137043.0 [2023-02-25 13:22:23,718][36156] Sum rewards: 44.604, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.510', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.052', 'AMMO3': '0.159', 'weapon5': '0.224', 'AMMO4': '0.261', 'WEAPON5': '0.350', 'weapon2': '0.352', 'weapon4': '0.474', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'HITCOUNT': '2.450', 'weapon3': '2.470', 'DAMAGECOUNT': '11.604', 'FRAGCOUNT': '42.000'} [2023-02-25 13:22:23,742][36142] DAMAGECOUNT value on done: 135035.0 [2023-02-25 13:22:23,743][36142] Sum rewards: 57.488, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.437', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.074', 'AMMO3': '0.130', 'AMMO4': '0.142', 'WEAPON5': '0.200', 'weapon2': '0.382', 'WEAPON4': '0.400', 'weapon4': '0.664', 'WEAPON3': '0.850', 'weapon3': '2.654', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.317', 'FRAGCOUNT': '49.000'} [2023-02-25 13:22:24,053][36142] DAMAGECOUNT value on done: 139592.0 [2023-02-25 13:22:24,054][36142] Sum rewards: 41.582, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.019', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.132', 'WEAPON5': '0.250', 'weapon5': '0.254', 'WEAPON4': '0.300', 'weapon2': '0.372', 'WEAPON3': '0.700', 'weapon4': '0.848', 'weapon3': '2.110', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '12.339', 'FRAGCOUNT': '32.000'} [2023-02-25 13:22:24,359][36142] DAMAGECOUNT value on done: 138726.0 [2023-02-25 13:22:24,359][36142] Sum rewards: 51.688, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.741', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.052', 'weapon5': '0.060', 'WEAPON4': '0.100', 'weapon2': '0.176', 'WEAPON5': '0.200', 'weapon4': '0.200', 'AMMO3': '0.202', 'WEAPON3': '1.150', 'HITCOUNT': '2.880', 'weapon3': '3.360', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '42.000'} [2023-02-25 13:22:24,655][36142] DAMAGECOUNT value on done: 141604.0 [2023-02-25 13:22:24,655][36142] Sum rewards: 39.446, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.041', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.152', 'weapon7': '0.174', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON4': '0.350', 'ARMOR': '0.460', 'weapon4': '0.692', 'WEAPON3': '0.700', 'HITCOUNT': '2.320', 'weapon3': '2.344', 'DAMAGECOUNT': '10.314', 'FRAGCOUNT': '32.000'} [2023-02-25 13:22:24,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 158629888. Throughput: 0: 3373.6. Samples: 2149036. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:22:24,730][36114] Avg episode reward: [(0, '47.951')] [2023-02-25 13:22:25,947][36138] Updated weights for policy 0, policy_version 38733 (0.0009) [2023-02-25 13:22:28,953][36138] Updated weights for policy 0, policy_version 38743 (0.0010) [2023-02-25 13:22:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13454.3). Total num frames: 158699520. Throughput: 0: 3375.9. Samples: 2169304. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:22:29,730][36114] Avg episode reward: [(0, '47.951')] [2023-02-25 13:22:31,982][36138] Updated weights for policy 0, policy_version 38753 (0.0009) [2023-02-25 13:22:34,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 158765056. Throughput: 0: 3373.0. Samples: 2189648. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:22:34,729][36114] Avg episode reward: [(0, '47.951')] [2023-02-25 13:22:35,039][36138] Updated weights for policy 0, policy_version 38763 (0.0009) [2023-02-25 13:22:38,081][36138] Updated weights for policy 0, policy_version 38773 (0.0010) [2023-02-25 13:22:38,787][36155] DAMAGECOUNT value on done: 139362.0 [2023-02-25 13:22:38,788][36155] Sum rewards: 50.809, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.292', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.074', 'AMMO4': '0.153', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.412', 'weapon4': '0.468', 'WEAPON3': '1.500', 'weapon3': '2.802', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.559', 'FRAGCOUNT': '45.500'} [2023-02-25 13:22:39,107][36155] DAMAGECOUNT value on done: 146451.0 [2023-02-25 13:22:39,108][36155] Sum rewards: 43.464, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.730', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.090', 'AMMO4': '0.146', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'weapon4': '0.330', 'WEAPON4': '0.400', 'weapon2': '0.580', 'WEAPON3': '1.250', 'HITCOUNT': '2.550', 'weapon3': '2.806', 'DAMAGECOUNT': '11.127', 'FRAGCOUNT': '41.000'} [2023-02-25 13:22:39,211][36155] DAMAGECOUNT value on done: 143975.0 [2023-02-25 13:22:39,211][36155] Sum rewards: 54.542, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.467', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.032', 'AMMO3': '0.127', 'AMMO4': '0.162', 'weapon5': '0.210', 'weapon2': '0.392', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.640', 'WEAPON3': '0.750', 'weapon3': '2.532', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.191', 'FRAGCOUNT': '45.000'} [2023-02-25 13:22:39,439][36139] DAMAGECOUNT value on done: 143396.0 [2023-02-25 13:22:39,440][36139] Sum rewards: 46.314, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.290', 'AMMO5': '0.006', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon4': '0.264', 'weapon2': '0.380', 'WEAPON3': '1.400', 'HITCOUNT': '2.840', 'weapon3': '2.942', 'DAMAGECOUNT': '12.729', 'FRAGCOUNT': '41.000'} [2023-02-25 13:22:39,521][36155] DAMAGECOUNT value on done: 141415.0 [2023-02-25 13:22:39,522][36155] Sum rewards: 58.091, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.400', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.082', 'AMMO3': '0.172', 'weapon5': '0.180', 'weapon4': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.496', 'WEAPON3': '1.150', 'weapon3': '2.900', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.877', 'FRAGCOUNT': '49.500'} [2023-02-25 13:22:39,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13468.2). Total num frames: 158834688. Throughput: 0: 3371.8. Samples: 2199748. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:22:39,730][36114] Avg episode reward: [(0, '48.091')] [2023-02-25 13:22:39,751][36139] DAMAGECOUNT value on done: 148429.0 [2023-02-25 13:22:39,751][36139] Sum rewards: 42.745, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.213', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO4': '0.150', 'AMMO3': '0.172', 'weapon5': '0.264', 'weapon2': '0.278', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.502', 'WEAPON3': '1.150', 'HITCOUNT': '2.630', 'weapon3': '2.660', 'DAMAGECOUNT': '12.051', 'FRAGCOUNT': '38.000'} [2023-02-25 13:22:40,047][36139] DAMAGECOUNT value on done: 147500.0 [2023-02-25 13:22:40,048][36139] Sum rewards: 53.385, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.300', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon5': '0.198', 'weapon2': '0.234', 'WEAPON4': '0.250', 'weapon4': '0.382', 'WEAPON3': '1.250', 'weapon3': '2.982', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.616', 'FRAGCOUNT': '45.000'} [2023-02-25 13:22:40,351][36139] DAMAGECOUNT value on done: 143219.0 [2023-02-25 13:22:40,352][36139] Sum rewards: 56.733, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.344', 'AMMO5': '0.014', 'AMMO2': '0.025', 'weapon5': '0.124', 'AMMO4': '0.125', 'weapon2': '0.190', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'WEAPON5': '0.300', 'weapon4': '0.380', 'WEAPON3': '1.400', 'weapon3': '3.012', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.259', 'FRAGCOUNT': '50.000'} [2023-02-25 13:22:41,136][36138] Updated weights for policy 0, policy_version 38783 (0.0009) [2023-02-25 13:22:41,775][36154] DAMAGECOUNT value on done: 146142.0 [2023-02-25 13:22:41,775][36154] Sum rewards: 50.384, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.216', 'AMMO2': '0.008', 'AMMO4': '0.037', 'WEAPON4': '0.100', 'weapon4': '0.160', 'AMMO3': '0.225', 'weapon2': '0.430', 'WEAPON3': '1.350', 'HITCOUNT': '2.810', 'weapon3': '3.290', 'DAMAGECOUNT': '12.690', 'FRAGCOUNT': '45.000'} [2023-02-25 13:22:42,079][36154] DAMAGECOUNT value on done: 141344.0 [2023-02-25 13:22:42,080][36154] Sum rewards: 50.776, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.720', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.037', 'weapon5': '0.122', 'AMMO4': '0.188', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'weapon2': '0.312', 'WEAPON4': '0.400', 'weapon4': '0.446', 'WEAPON3': '1.250', 'weapon3': '2.872', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.491', 'FRAGCOUNT': '46.000'} [2023-02-25 13:22:42,140][36140] DAMAGECOUNT value on done: 146686.0 [2023-02-25 13:22:42,140][36140] Sum rewards: 46.433, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.982', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.016', 'AMMO4': '0.058', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.248', 'weapon2': '0.460', 'WEAPON3': '0.950', 'HITCOUNT': '2.830', 'weapon3': '2.916', 'DAMAGECOUNT': '11.970', 'FRAGCOUNT': '38.000'} [2023-02-25 13:22:42,360][36154] DAMAGECOUNT value on done: 146103.0 [2023-02-25 13:22:42,361][36154] Sum rewards: 39.883, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.956', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.132', 'weapon4': '0.138', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.342', 'WEAPON3': '1.150', 'HITCOUNT': '2.410', 'weapon3': '3.164', 'DAMAGECOUNT': '11.490', 'FRAGCOUNT': '35.000'} [2023-02-25 13:22:42,461][36140] DAMAGECOUNT value on done: 142850.0 [2023-02-25 13:22:42,461][36140] Sum rewards: 30.845, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.770', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.146', 'AMMO4': '0.155', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.610', 'weapon2': '0.632', 'WEAPON3': '0.950', 'HITCOUNT': '2.070', 'weapon3': '2.134', 'DAMAGECOUNT': '9.162', 'FRAGCOUNT': '28.000'} [2023-02-25 13:22:42,572][36157] DAMAGECOUNT value on done: 148011.0 [2023-02-25 13:22:42,573][36157] Sum rewards: 56.722, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.820', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.047', 'AMMO3': '0.210', 'weapon4': '0.216', 'AMMO4': '0.235', 'weapon5': '0.290', 'weapon2': '0.432', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.740', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '50.000'} [2023-02-25 13:22:42,682][36154] DAMAGECOUNT value on done: 141990.0 [2023-02-25 13:22:42,682][36154] Sum rewards: 32.292, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.964', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'AMMO3': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.208', 'ARMOR': '0.424', 'weapon2': '0.568', 'WEAPON3': '0.900', 'HITCOUNT': '1.860', 'weapon3': '2.076', 'DAMAGECOUNT': '9.069', 'FRAGCOUNT': '28.000'} [2023-02-25 13:22:42,859][36140] DAMAGECOUNT value on done: 144556.0 [2023-02-25 13:22:42,859][36140] Sum rewards: 46.552, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.150', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.106', 'AMMO4': '0.137', 'AMMO3': '0.183', 'WEAPON5': '0.300', 'weapon2': '0.390', 'WEAPON4': '0.500', 'weapon4': '1.024', 'WEAPON3': '1.050', 'weapon3': '2.162', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '11.760', 'FRAGCOUNT': '41.000'} [2023-02-25 13:22:42,893][36157] DAMAGECOUNT value on done: 146242.0 [2023-02-25 13:22:42,894][36157] Sum rewards: 51.970, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.140', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.114', 'AMMO4': '0.118', 'weapon5': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'WEAPON5': '0.250', 'weapon2': '0.384', 'WEAPON3': '1.150', 'HITCOUNT': '2.720', 'weapon3': '3.160', 'DAMAGECOUNT': '13.719', 'FRAGCOUNT': '44.000'} [2023-02-25 13:22:42,925][36141] DAMAGECOUNT value on done: 147101.0 [2023-02-25 13:22:42,926][36141] Sum rewards: 47.976, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.875', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.053', 'weapon5': '0.132', 'AMMO3': '0.165', 'AMMO4': '0.266', 'WEAPON5': '0.350', 'WEAPON4': '0.650', 'weapon2': '0.660', 'weapon4': '0.776', 'WEAPON3': '1.000', 'weapon3': '2.062', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.019', 'FRAGCOUNT': '41.000'} [2023-02-25 13:22:43,115][36156] DAMAGECOUNT value on done: 148622.0 [2023-02-25 13:22:43,116][36156] Sum rewards: 56.387, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.852', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.038', 'weapon4': '0.048', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'weapon2': '0.308', 'WEAPON3': '1.500', 'HITCOUNT': '3.030', 'weapon3': '3.380', 'DAMAGECOUNT': '13.146', 'FRAGCOUNT': '52.500'} [2023-02-25 13:22:43,143][36157] DAMAGECOUNT value on done: 147645.0 [2023-02-25 13:22:43,144][36157] Sum rewards: 49.925, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.655', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'weapon2': '0.272', 'weapon4': '0.464', 'WEAPON3': '1.250', 'weapon3': '3.000', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '14.262', 'FRAGCOUNT': '41.000'} [2023-02-25 13:22:43,149][36140] DAMAGECOUNT value on done: 142410.0 [2023-02-25 13:22:43,150][36140] Sum rewards: 46.690, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.845', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.050', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon2': '0.410', 'weapon4': '0.440', 'WEAPON3': '1.300', 'HITCOUNT': '2.820', 'weapon3': '2.882', 'DAMAGECOUNT': '12.180', 'FRAGCOUNT': '42.000'} [2023-02-25 13:22:43,236][36141] DAMAGECOUNT value on done: 144594.0 [2023-02-25 13:22:43,237][36141] Sum rewards: 44.338, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.327', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.078', 'AMMO4': '0.149', 'weapon5': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.295', 'weapon2': '0.764', 'WEAPON3': '1.650', 'HITCOUNT': '2.410', 'weapon3': '2.700', 'DAMAGECOUNT': '11.709', 'FRAGCOUNT': '45.000'} [2023-02-25 13:22:43,249][36141] DAMAGECOUNT value on done: 147082.0 [2023-02-25 13:22:43,250][36141] Sum rewards: 34.572, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.169', 'AMMO5': '0.003', 'AMMO2': '0.005', 'ARMOR': '0.008', 'AMMO4': '0.023', 'weapon5': '0.052', 'weapon7': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.141', 'weapon4': '0.160', 'WEAPON7': '0.200', 'WEAPON3': '0.900', 'weapon2': '1.050', 'HITCOUNT': '2.210', 'weapon3': '2.344', 'DAMAGECOUNT': '9.150', 'FRAGCOUNT': '29.000'} [2023-02-25 13:22:43,388][36156] DAMAGECOUNT value on done: 146636.0 [2023-02-25 13:22:43,388][36156] Sum rewards: 66.731, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.470', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO4': '0.177', 'weapon5': '0.188', 'AMMO3': '0.198', 'weapon2': '0.218', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.896', 'WEAPON3': '1.150', 'weapon3': '2.356', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '58.000'} [2023-02-25 13:22:43,426][36156] DAMAGECOUNT value on done: 145242.0 [2023-02-25 13:22:43,427][36156] Sum rewards: 58.735, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.984', 'AMMO2': '0.016', 'AMMO5': '0.017', 'weapon5': '0.060', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'weapon2': '0.192', 'weapon4': '0.202', 'AMMO3': '0.260', 'WEAPON5': '0.350', 'ARMOR': '0.405', 'WEAPON3': '1.550', 'weapon3': '3.220', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.498', 'FRAGCOUNT': '52.000'} [2023-02-25 13:22:43,442][36157] DAMAGECOUNT value on done: 146690.0 [2023-02-25 13:22:43,442][36157] Sum rewards: 59.640, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.117', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.046', 'AMMO3': '0.137', 'weapon5': '0.184', 'AMMO4': '0.229', 'weapon2': '0.272', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.794', 'WEAPON3': '0.800', 'weapon3': '2.352', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '49.000'} [2023-02-25 13:22:43,548][36142] DAMAGECOUNT value on done: 139807.0 [2023-02-25 13:22:43,549][36142] Sum rewards: 50.977, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.882', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon7': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.176', 'weapon5': '0.182', 'AMMO3': '0.190', 'WEAPON7': '0.200', 'weapon2': '0.326', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.644', 'WEAPON3': '1.200', 'weapon3': '2.448', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.316', 'FRAGCOUNT': '43.500'} [2023-02-25 13:22:43,569][36141] DAMAGECOUNT value on done: 139151.0 [2023-02-25 13:22:43,570][36141] Sum rewards: 40.572, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.371', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.055', 'AMMO3': '0.180', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.224', 'weapon2': '0.226', 'AMMO4': '0.274', 'WEAPON5': '0.450', 'WEAPON4': '0.800', 'WEAPON3': '1.000', 'weapon4': '1.302', 'weapon3': '1.734', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '12.222', 'FRAGCOUNT': '35.000'} [2023-02-25 13:22:43,700][36156] DAMAGECOUNT value on done: 141087.0 [2023-02-25 13:22:43,700][36156] Sum rewards: 41.308, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.424', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.044', 'weapon5': '0.066', 'WEAPON5': '0.200', 'AMMO4': '0.220', 'AMMO3': '0.304', 'weapon2': '0.356', 'WEAPON4': '0.500', 'weapon4': '0.764', 'WEAPON3': '1.700', 'weapon3': '2.294', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.132', 'FRAGCOUNT': '42.000'} [2023-02-25 13:22:43,850][36142] DAMAGECOUNT value on done: 143570.0 [2023-02-25 13:22:43,851][36142] Sum rewards: 39.329, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.628', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon5': '0.152', 'AMMO4': '0.184', 'AMMO3': '0.211', 'weapon2': '0.350', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.634', 'WEAPON3': '1.200', 'weapon3': '2.474', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '11.934', 'FRAGCOUNT': '36.000'} [2023-02-25 13:22:44,156][36142] DAMAGECOUNT value on done: 142320.0 [2023-02-25 13:22:44,157][36142] Sum rewards: 33.754, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.760', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.027', 'weapon7': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.137', 'weapon5': '0.186', 'AMMO3': '0.196', 'WEAPON7': '0.200', 'weapon2': '0.222', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon4': '1.144', 'weapon3': '1.758', 'HITCOUNT': '2.310', 'DAMAGECOUNT': '10.782', 'FRAGCOUNT': '32.000'} [2023-02-25 13:22:44,186][36138] Updated weights for policy 0, policy_version 38793 (0.0011) [2023-02-25 13:22:44,443][36142] DAMAGECOUNT value on done: 145456.0 [2023-02-25 13:22:44,444][36142] Sum rewards: 40.307, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.305', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.026', 'AMMO2': '0.055', 'AMMO3': '0.168', 'weapon5': '0.228', 'AMMO4': '0.273', 'weapon2': '0.340', 'weapon4': '0.640', 'WEAPON5': '0.700', 'WEAPON4': '0.750', 'WEAPON3': '0.950', 'weapon3': '2.402', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '11.556', 'FRAGCOUNT': '37.000'} [2023-02-25 13:22:44,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13468.2). Total num frames: 158900224. Throughput: 0: 3366.8. Samples: 2219854. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:22:44,729][36114] Avg episode reward: [(0, '47.753')] [2023-02-25 13:22:47,162][36138] Updated weights for policy 0, policy_version 38803 (0.0009) [2023-02-25 13:22:49,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.9, 300 sec: 13482.1). Total num frames: 158969856. Throughput: 0: 3376.3. Samples: 2240350. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:22:49,729][36114] Avg episode reward: [(0, '47.753')] [2023-02-25 13:22:50,179][36138] Updated weights for policy 0, policy_version 38813 (0.0010) [2023-02-25 13:22:50,856][36157] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 13:22:53,184][36138] Updated weights for policy 0, policy_version 38823 (0.0009) [2023-02-25 13:22:54,205][36140] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:22:54,729][36114] Fps is (10 sec: 13926.3, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 159039488. Throughput: 0: 3379.0. Samples: 2250458. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:22:54,730][36114] Avg episode reward: [(0, '47.753')] [2023-02-25 13:22:56,228][36138] Updated weights for policy 0, policy_version 38833 (0.0009) [2023-02-25 13:22:56,992][36154] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:22:58,536][36155] DAMAGECOUNT value on done: 143763.0 [2023-02-25 13:22:58,537][36155] Sum rewards: 46.607, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.752', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.007', 'WEAPON4': '0.050', 'weapon5': '0.056', 'weapon4': '0.072', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.838', 'WEAPON3': '1.300', 'weapon3': '2.844', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.203', 'FRAGCOUNT': '41.000'} [2023-02-25 13:22:58,842][36155] DAMAGECOUNT value on done: 150934.0 [2023-02-25 13:22:58,843][36155] Sum rewards: 48.936, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.012', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon4': '0.126', 'weapon5': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.200', 'HITCOUNT': '2.810', 'weapon3': '3.150', 'DAMAGECOUNT': '13.449', 'FRAGCOUNT': '41.000'} [2023-02-25 13:22:59,032][36155] DAMAGECOUNT value on done: 148655.0 [2023-02-25 13:22:59,033][36155] Sum rewards: 56.420, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.293', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.048', 'AMMO4': '0.134', 'weapon4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'weapon2': '0.452', 'WEAPON3': '1.450', 'weapon3': '3.108', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.040', 'FRAGCOUNT': '51.000'} [2023-02-25 13:22:59,243][36139] DAMAGECOUNT value on done: 147366.0 [2023-02-25 13:22:59,243][36139] Sum rewards: 47.210, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.129', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.168', 'weapon5': '0.180', 'AMMO3': '0.189', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.592', 'weapon4': '0.740', 'WEAPON3': '1.050', 'weapon3': '2.164', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '11.910', 'FRAGCOUNT': '42.000'} [2023-02-25 13:22:59,261][36138] Updated weights for policy 0, policy_version 38843 (0.0009) [2023-02-25 13:22:59,347][36155] DAMAGECOUNT value on done: 146175.0 [2023-02-25 13:22:59,348][36155] Sum rewards: 55.049, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.482', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO3': '0.130', 'AMMO4': '0.186', 'weapon5': '0.316', 'weapon2': '0.330', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon4': '0.758', 'WEAPON3': '0.850', 'weapon3': '2.264', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.280', 'FRAGCOUNT': '47.000'} [2023-02-25 13:22:59,552][36139] DAMAGECOUNT value on done: 152582.0 [2023-02-25 13:22:59,552][36139] Sum rewards: 49.790, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.053', 'AMMO5': '0.012', 'weapon5': '0.062', 'WEAPON5': '0.150', 'weapon2': '0.212', 'AMMO3': '0.288', 'WEAPON3': '1.750', 'HITCOUNT': '2.720', 'weapon3': '3.440', 'DAMAGECOUNT': '12.459', 'FRAGCOUNT': '48.000'} [2023-02-25 13:22:59,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 159105024. Throughput: 0: 3378.6. Samples: 2270708. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:22:59,729][36114] Avg episode reward: [(0, '48.074')] [2023-02-25 13:22:59,835][36139] DAMAGECOUNT value on done: 151778.0 [2023-02-25 13:22:59,836][36139] Sum rewards: 48.793, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.740', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO3': '0.164', 'AMMO4': '0.198', 'weapon5': '0.246', 'WEAPON5': '0.350', 'weapon2': '0.422', 'WEAPON4': '0.500', 'weapon4': '0.556', 'WEAPON3': '0.900', 'weapon3': '2.406', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '12.834', 'FRAGCOUNT': '41.000'} [2023-02-25 13:23:00,148][36139] DAMAGECOUNT value on done: 147821.0 [2023-02-25 13:23:00,149][36139] Sum rewards: 49.948, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.752', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'weapon4': '0.064', 'weapon5': '0.064', 'WEAPON5': '0.100', 'weapon2': '0.222', 'AMMO3': '0.268', 'WEAPON3': '1.650', 'HITCOUNT': '3.010', 'weapon3': '3.430', 'DAMAGECOUNT': '13.806', 'FRAGCOUNT': '45.000'} [2023-02-25 13:23:01,463][36155] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO2', -0.0001, -1.0), ('AMMO4', -0.0005, -1.0), ('weapon4', 0.002)] [2023-02-25 13:23:01,771][36154] DAMAGECOUNT value on done: 150713.0 [2023-02-25 13:23:01,771][36154] Sum rewards: 48.791, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.487', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.055', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO3': '0.183', 'weapon2': '0.270', 'AMMO4': '0.274', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'weapon4': '1.088', 'weapon3': '2.070', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.713', 'FRAGCOUNT': '42.000'} [2023-02-25 13:23:01,983][36140] DAMAGECOUNT value on done: 151282.0 [2023-02-25 13:23:01,983][36140] Sum rewards: 54.365, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.826', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.034', 'AMMO4': '0.060', 'weapon5': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.230', 'weapon2': '0.508', 'WEAPON3': '1.400', 'HITCOUNT': '3.000', 'weapon3': '3.142', 'DAMAGECOUNT': '13.788', 'FRAGCOUNT': '48.000'} [2023-02-25 13:23:02,062][36154] DAMAGECOUNT value on done: 145683.0 [2023-02-25 13:23:02,062][36154] Sum rewards: 45.692, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.730', 'ARMOR': '0.004', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.037', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.118', 'AMMO4': '0.185', 'AMMO3': '0.199', 'weapon2': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.522', 'WEAPON3': '1.250', 'weapon3': '2.730', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.002', 'FRAGCOUNT': '40.000'} [2023-02-25 13:23:02,268][36138] Updated weights for policy 0, policy_version 38853 (0.0009) [2023-02-25 13:23:02,299][36154] DAMAGECOUNT value on done: 150396.0 [2023-02-25 13:23:02,299][36154] Sum rewards: 48.870, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.730', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.050', 'AMMO3': '0.152', 'weapon5': '0.216', 'AMMO4': '0.249', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'weapon2': '0.678', 'weapon4': '0.844', 'WEAPON3': '0.900', 'weapon3': '1.716', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.879', 'FRAGCOUNT': '44.000'} [2023-02-25 13:23:02,302][36140] DAMAGECOUNT value on done: 147821.0 [2023-02-25 13:23:02,302][36140] Sum rewards: 46.488, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.825', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.053', 'AMMO3': '0.189', 'weapon2': '0.228', 'AMMO4': '0.267', 'weapon5': '0.328', 'WEAPON5': '0.650', 'weapon4': '0.678', 'WEAPON4': '0.750', 'WEAPON3': '1.100', 'weapon3': '2.406', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.718', 'FRAGCOUNT': '42.000'} [2023-02-25 13:23:02,450][36157] DAMAGECOUNT value on done: 152481.0 [2023-02-25 13:23:02,450][36157] Sum rewards: 46.153, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.411', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.118', 'AMMO4': '0.129', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.458', 'weapon2': '0.618', 'WEAPON3': '1.200', 'weapon3': '2.456', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.410', 'FRAGCOUNT': '40.500'} [2023-02-25 13:23:02,616][36154] DAMAGECOUNT value on done: 146245.0 [2023-02-25 13:23:02,617][36154] Sum rewards: 48.572, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.240', 'AMMO2': '0.002', 'AMMO5': '0.010', 'AMMO4': '0.011', 'weapon5': '0.078', 'WEAPON4': '0.100', 'weapon4': '0.226', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON3': '1.300', 'HITCOUNT': '2.770', 'weapon3': '3.034', 'DAMAGECOUNT': '12.765', 'FRAGCOUNT': '43.000'} [2023-02-25 13:23:02,698][36140] DAMAGECOUNT value on done: 148482.0 [2023-02-25 13:23:02,698][36140] Sum rewards: 42.059, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.365', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'weapon4': '0.386', 'weapon2': '0.496', 'WEAPON3': '1.350', 'weapon3': '2.680', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '11.778', 'FRAGCOUNT': '39.000'} [2023-02-25 13:23:02,751][36157] DAMAGECOUNT value on done: 150662.0 [2023-02-25 13:23:02,751][36157] Sum rewards: 49.671, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.739', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.030', 'weapon5': '0.052', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'WEAPON5': '0.250', 'weapon2': '0.538', 'WEAPON3': '1.050', 'HITCOUNT': '2.850', 'weapon3': '3.214', 'DAMAGECOUNT': '12.945', 'FRAGCOUNT': '41.000'} [2023-02-25 13:23:02,854][36141] DAMAGECOUNT value on done: 151861.0 [2023-02-25 13:23:02,854][36141] Sum rewards: 57.919, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.935', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.070', 'weapon5': '0.078', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon4': '0.260', 'weapon2': '0.474', 'WEAPON3': '1.000', 'weapon3': '2.964', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.280', 'FRAGCOUNT': '46.000'} [2023-02-25 13:23:02,898][36156] DAMAGECOUNT value on done: 152712.0 [2023-02-25 13:23:02,898][36156] Sum rewards: 47.319, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.245', 'AMMO2': '0.009', 'weapon4': '0.018', 'AMMO5': '0.019', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.145', 'weapon5': '0.152', 'WEAPON5': '0.400', 'weapon2': '0.564', 'WEAPON3': '1.000', 'weapon3': '2.690', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '12.270', 'FRAGCOUNT': '39.000'} [2023-02-25 13:23:02,997][36140] DAMAGECOUNT value on done: 146119.0 [2023-02-25 13:23:02,998][36140] Sum rewards: 43.005, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.738', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.138', 'weapon5': '0.142', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.484', 'weapon2': '0.560', 'WEAPON3': '1.000', 'HITCOUNT': '2.520', 'weapon3': '2.628', 'DAMAGECOUNT': '11.127', 'FRAGCOUNT': '37.000'} [2023-02-25 13:23:03,044][36157] DAMAGECOUNT value on done: 152093.0 [2023-02-25 13:23:03,045][36157] Sum rewards: 51.622, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.540', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.027', 'weapon5': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.134', 'WEAPON5': '0.200', 'weapon2': '0.214', 'AMMO3': '0.230', 'WEAPON3': '1.400', 'HITCOUNT': '2.890', 'weapon3': '3.276', 'DAMAGECOUNT': '13.080', 'FRAGCOUNT': '46.000'} [2023-02-25 13:23:03,154][36141] DAMAGECOUNT value on done: 149507.0 [2023-02-25 13:23:03,154][36141] Sum rewards: 50.183, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.705', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon5': '0.106', 'AMMO4': '0.187', 'AMMO3': '0.233', 'weapon4': '0.240', 'WEAPON5': '0.350', 'weapon2': '0.420', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.968', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '45.000'} [2023-02-25 13:23:03,158][36156] DAMAGECOUNT value on done: 150250.0 [2023-02-25 13:23:03,158][36156] Sum rewards: 44.633, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.956', 'AMMO5': '0.011', 'AMMO2': '0.019', 'weapon5': '0.094', 'AMMO4': '0.095', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon4': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON3': '1.200', 'HITCOUNT': '2.470', 'weapon3': '3.208', 'DAMAGECOUNT': '10.842', 'FRAGCOUNT': '39.500'} [2023-02-25 13:23:03,168][36141] DAMAGECOUNT value on done: 151926.0 [2023-02-25 13:23:03,169][36141] Sum rewards: 55.759, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.874', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'WEAPON4': '0.250', 'weapon2': '0.284', 'weapon4': '0.380', 'WEAPON3': '1.100', 'weapon3': '3.076', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.532', 'FRAGCOUNT': '47.000'} [2023-02-25 13:23:03,207][36156] DAMAGECOUNT value on done: 149086.0 [2023-02-25 13:23:03,207][36156] Sum rewards: 43.383, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.242', 'AMMO2': '0.002', 'ARMOR': '0.004', 'AMMO4': '0.012', 'AMMO5': '0.016', 'AMMO3': '0.179', 'weapon5': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.592', 'weapon2': '0.642', 'WEAPON3': '1.050', 'weapon3': '2.288', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '11.532', 'FRAGCOUNT': '40.000'} [2023-02-25 13:23:03,355][36157] DAMAGECOUNT value on done: 151643.0 [2023-02-25 13:23:03,355][36157] Sum rewards: 56.062, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.005', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'weapon5': '0.180', 'weapon2': '0.584', 'WEAPON3': '0.900', 'weapon3': '2.980', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.859', 'FRAGCOUNT': '45.000'} [2023-02-25 13:23:03,391][36142] DAMAGECOUNT value on done: 144262.0 [2023-02-25 13:23:03,391][36142] Sum rewards: 51.045, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.889', 'AMMO5': '0.019', 'ARMOR': '0.036', 'AMMO2': '0.042', 'AMMO3': '0.120', 'AMMO4': '0.208', 'weapon5': '0.234', 'WEAPON5': '0.400', 'weapon2': '0.456', 'WEAPON4': '0.500', 'weapon4': '0.536', 'WEAPON3': '0.750', 'weapon3': '2.418', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '13.365', 'FRAGCOUNT': '43.000'} [2023-02-25 13:23:03,477][36156] DAMAGECOUNT value on done: 145921.0 [2023-02-25 13:23:03,478][36156] Sum rewards: 59.098, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.293', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.164', 'AMMO3': '0.214', 'weapon4': '0.214', 'weapon2': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.050', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.502', 'FRAGCOUNT': '52.000'} [2023-02-25 13:23:03,484][36141] DAMAGECOUNT value on done: 143046.0 [2023-02-25 13:23:03,485][36141] Sum rewards: 39.349, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.747', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.078', 'AMMO4': '0.106', 'weapon2': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'weapon4': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.410', 'weapon3': '3.174', 'DAMAGECOUNT': '11.685', 'FRAGCOUNT': '37.000'} [2023-02-25 13:23:03,713][36142] DAMAGECOUNT value on done: 148374.0 [2023-02-25 13:23:03,713][36142] Sum rewards: 53.476, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.450', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.030', 'weapon5': '0.088', 'AMMO4': '0.149', 'AMMO3': '0.226', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.464', 'WEAPON3': '1.350', 'weapon3': '2.834', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.412', 'FRAGCOUNT': '47.000'} [2023-02-25 13:23:04,029][36142] DAMAGECOUNT value on done: 147215.0 [2023-02-25 13:23:04,029][36142] Sum rewards: 54.214, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.473', 'AMMO5': '0.012', 'AMMO2': '0.030', 'ARMOR': '0.040', 'weapon5': '0.046', 'AMMO4': '0.150', 'AMMO3': '0.176', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.358', 'weapon2': '0.564', 'WEAPON3': '1.200', 'weapon3': '2.746', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.685', 'FRAGCOUNT': '45.000'} [2023-02-25 13:23:04,342][36142] DAMAGECOUNT value on done: 150172.0 [2023-02-25 13:23:04,342][36142] Sum rewards: 50.466, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.031', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'AMMO3': '0.160', 'WEAPON4': '0.250', 'weapon2': '0.306', 'weapon4': '0.602', 'WEAPON3': '1.100', 'weapon3': '2.898', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.148', 'FRAGCOUNT': '42.000'} [2023-02-25 13:23:04,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 159170560. Throughput: 0: 3379.4. Samples: 2290944. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:23:04,730][36114] Avg episode reward: [(0, '48.128')] [2023-02-25 13:23:05,344][36138] Updated weights for policy 0, policy_version 38863 (0.0009) [2023-02-25 13:23:08,408][36138] Updated weights for policy 0, policy_version 38873 (0.0009) [2023-02-25 13:23:09,729][36114] Fps is (10 sec: 13516.6, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 159240192. Throughput: 0: 3377.4. Samples: 2301020. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:23:09,730][36114] Avg episode reward: [(0, '48.128')] [2023-02-25 13:23:11,451][36138] Updated weights for policy 0, policy_version 38883 (0.0009) [2023-02-25 13:23:14,472][36138] Updated weights for policy 0, policy_version 38893 (0.0009) [2023-02-25 13:23:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 159305728. Throughput: 0: 3376.9. Samples: 2321266. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:23:14,730][36114] Avg episode reward: [(0, '48.128')] [2023-02-25 13:23:17,503][36138] Updated weights for policy 0, policy_version 38903 (0.0009) [2023-02-25 13:23:18,360][36155] DAMAGECOUNT value on done: 148291.0 [2023-02-25 13:23:18,361][36155] Sum rewards: 54.766, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.603', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.060', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.188', 'weapon4': '0.204', 'weapon2': '0.380', 'WEAPON3': '1.100', 'HITCOUNT': '3.020', 'weapon3': '3.210', 'DAMAGECOUNT': '13.584', 'FRAGCOUNT': '47.000'} [2023-02-25 13:23:18,668][36155] DAMAGECOUNT value on done: 156358.0 [2023-02-25 13:23:18,669][36155] Sum rewards: 63.415, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.782', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon5': '0.150', 'AMMO3': '0.207', 'AMMO4': '0.214', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON4': '0.500', 'weapon4': '0.682', 'WEAPON3': '1.200', 'weapon3': '2.458', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '55.000'} [2023-02-25 13:23:18,968][36155] DAMAGECOUNT value on done: 152318.0 [2023-02-25 13:23:18,968][36155] Sum rewards: 42.224, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.554', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.098', 'AMMO3': '0.140', 'weapon5': '0.224', 'weapon2': '0.262', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'weapon4': '1.162', 'weapon3': '1.850', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '10.989', 'FRAGCOUNT': '36.000'} [2023-02-25 13:23:19,229][36139] DAMAGECOUNT value on done: 151889.0 [2023-02-25 13:23:19,229][36139] Sum rewards: 47.330, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.346', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.374', 'weapon2': '0.412', 'WEAPON3': '1.150', 'weapon3': '2.904', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.569', 'FRAGCOUNT': '40.000'} [2023-02-25 13:23:19,275][36155] DAMAGECOUNT value on done: 151203.0 [2023-02-25 13:23:19,275][36155] Sum rewards: 56.391, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.792', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon7': '0.074', 'weapon5': '0.104', 'AMMO4': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.232', 'WEAPON4': '0.250', 'weapon4': '0.428', 'WEAPON3': '1.250', 'weapon3': '2.896', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.042', 'FRAGCOUNT': '48.000'} [2023-02-25 13:23:19,542][36139] DAMAGECOUNT value on done: 156864.0 [2023-02-25 13:23:19,543][36139] Sum rewards: 47.984, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.570', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.146', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'AMMO4': '0.220', 'WEAPON4': '0.350', 'weapon2': '0.398', 'weapon4': '0.902', 'WEAPON3': '1.150', 'weapon3': '2.188', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '12.846', 'FRAGCOUNT': '42.000'} [2023-02-25 13:23:19,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13509.9). Total num frames: 159375360. Throughput: 0: 3372.3. Samples: 2341400. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:23:19,730][36114] Avg episode reward: [(0, '48.667')] [2023-02-25 13:23:19,734][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000038910_159375360.pth... [2023-02-25 13:23:19,795][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000038119_156135424.pth [2023-02-25 13:23:19,833][36139] DAMAGECOUNT value on done: 156737.0 [2023-02-25 13:23:19,834][36139] Sum rewards: 54.571, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.850', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO3': '0.138', 'AMMO4': '0.157', 'weapon5': '0.278', 'weapon2': '0.386', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.798', 'WEAPON3': '0.850', 'weapon3': '1.846', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.787', 'FRAGCOUNT': '46.000'} [2023-02-25 13:23:20,139][36139] DAMAGECOUNT value on done: 152181.0 [2023-02-25 13:23:20,139][36139] Sum rewards: 45.345, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.786', 'AMMO5': '0.017', 'AMMO2': '0.022', 'weapon5': '0.036', 'AMMO4': '0.112', 'weapon2': '0.172', 'weapon4': '0.226', 'WEAPON5': '0.250', 'AMMO3': '0.281', 'WEAPON4': '0.300', 'WEAPON3': '1.700', 'HITCOUNT': '2.790', 'weapon3': '3.310', 'DAMAGECOUNT': '12.915', 'FRAGCOUNT': '45.000'} [2023-02-25 13:23:20,599][36138] Updated weights for policy 0, policy_version 38913 (0.0009) [2023-02-25 13:23:21,710][36154] DAMAGECOUNT value on done: 155288.0 [2023-02-25 13:23:21,711][36154] Sum rewards: 55.979, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.350', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.124', 'AMMO4': '0.147', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.338', 'weapon4': '0.496', 'WEAPON3': '0.850', 'weapon3': '2.690', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.725', 'FRAGCOUNT': '47.000'} [2023-02-25 13:23:22,025][36154] DAMAGECOUNT value on done: 150080.0 [2023-02-25 13:23:22,026][36154] Sum rewards: 46.971, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.982', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.041', 'weapon5': '0.078', 'weapon4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon2': '0.456', 'WEAPON3': '1.300', 'HITCOUNT': '2.640', 'weapon3': '3.084', 'DAMAGECOUNT': '13.191', 'FRAGCOUNT': '41.000'} [2023-02-25 13:23:22,055][36140] DAMAGECOUNT value on done: 155091.0 [2023-02-25 13:23:22,055][36140] Sum rewards: 42.193, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.224', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'weapon4': '0.250', 'weapon2': '0.412', 'WEAPON3': '1.400', 'HITCOUNT': '2.780', 'weapon3': '3.048', 'DAMAGECOUNT': '11.427', 'FRAGCOUNT': '38.000'} [2023-02-25 13:23:22,228][36154] DAMAGECOUNT value on done: 154070.0 [2023-02-25 13:23:22,228][36154] Sum rewards: 39.235, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.080', 'AMMO5': '0.019', 'AMMO2': '0.065', 'AMMO3': '0.110', 'weapon5': '0.288', 'AMMO4': '0.323', 'weapon2': '0.452', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'WEAPON4': '0.650', 'weapon4': '1.048', 'weapon3': '1.734', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '10.986', 'FRAGCOUNT': '33.500'} [2023-02-25 13:23:22,347][36140] DAMAGECOUNT value on done: 152899.0 [2023-02-25 13:23:22,348][36140] Sum rewards: 56.117, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.047', 'AMMO5': '0.017', 'AMMO2': '0.038', 'AMMO4': '0.192', 'AMMO3': '0.230', 'weapon5': '0.264', 'weapon2': '0.352', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.604', 'WEAPON3': '1.350', 'weapon3': '2.342', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '51.000'} [2023-02-25 13:23:22,530][36157] DAMAGECOUNT value on done: 156593.0 [2023-02-25 13:23:22,531][36157] Sum rewards: 45.279, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.424', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.182', 'AMMO3': '0.190', 'WEAPON4': '0.450', 'weapon2': '0.570', 'weapon4': '0.574', 'WEAPON3': '1.000', 'weapon3': '2.628', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.336', 'FRAGCOUNT': '40.000'} [2023-02-25 13:23:22,533][36154] DAMAGECOUNT value on done: 150638.0 [2023-02-25 13:23:22,534][36154] Sum rewards: 46.914, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.002', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon5': '0.112', 'AMMO3': '0.141', 'WEAPON5': '0.200', 'weapon2': '0.284', 'WEAPON4': '0.350', 'weapon4': '0.752', 'WEAPON3': '0.950', 'weapon3': '2.446', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.179', 'FRAGCOUNT': '39.000'} [2023-02-25 13:23:22,764][36140] DAMAGECOUNT value on done: 152214.0 [2023-02-25 13:23:22,764][36140] Sum rewards: 45.192, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.704', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.024', 'AMMO4': '0.121', 'AMMO3': '0.138', 'weapon4': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon5': '0.428', 'weapon2': '0.828', 'WEAPON3': '0.850', 'HITCOUNT': '2.280', 'weapon3': '2.302', 'DAMAGECOUNT': '11.196', 'FRAGCOUNT': '39.000'} [2023-02-25 13:23:22,843][36157] DAMAGECOUNT value on done: 154680.0 [2023-02-25 13:23:22,843][36157] Sum rewards: 43.433, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.717', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO4': '0.170', 'AMMO3': '0.190', 'weapon5': '0.210', 'weapon2': '0.232', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'WEAPON3': '1.050', 'weapon4': '1.060', 'weapon3': '2.174', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.054', 'FRAGCOUNT': '36.500'} [2023-02-25 13:23:22,900][36156] DAMAGECOUNT value on done: 157478.0 [2023-02-25 13:23:22,900][36156] Sum rewards: 55.052, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.280', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.136', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon4': '0.208', 'weapon2': '0.286', 'WEAPON3': '1.000', 'HITCOUNT': '3.010', 'weapon3': '3.194', 'DAMAGECOUNT': '14.298', 'FRAGCOUNT': '46.000'} [2023-02-25 13:23:22,910][36141] DAMAGECOUNT value on done: 156542.0 [2023-02-25 13:23:22,911][36141] Sum rewards: 59.117, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.420', 'AMMO5': '0.015', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.030', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'weapon4': '0.268', 'WEAPON5': '0.300', 'weapon2': '0.358', 'WEAPON3': '1.050', 'weapon3': '3.072', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.043', 'FRAGCOUNT': '49.000'} [2023-02-25 13:23:23,063][36140] DAMAGECOUNT value on done: 150053.0 [2023-02-25 13:23:23,063][36140] Sum rewards: 48.910, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.480', 'ARMOR': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon5': '0.102', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'weapon4': '0.382', 'weapon2': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.600', 'weapon3': '2.762', 'DAMAGECOUNT': '11.802', 'FRAGCOUNT': '42.000'} [2023-02-25 13:23:23,133][36157] DAMAGECOUNT value on done: 157120.0 [2023-02-25 13:23:23,133][36157] Sum rewards: 55.669, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.550', 'AMMO5': '0.012', 'AMMO2': '0.043', 'AMMO3': '0.182', 'weapon5': '0.204', 'AMMO4': '0.215', 'WEAPON5': '0.250', 'weapon4': '0.448', 'WEAPON4': '0.450', 'weapon2': '0.558', 'WEAPON3': '1.250', 'weapon3': '2.526', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.081', 'FRAGCOUNT': '49.000'} [2023-02-25 13:23:23,186][36156] DAMAGECOUNT value on done: 155066.0 [2023-02-25 13:23:23,187][36156] Sum rewards: 50.095, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.324', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.116', 'AMMO4': '0.189', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'weapon4': '0.288', 'WEAPON4': '0.300', 'weapon2': '0.564', 'WEAPON3': '1.200', 'weapon3': '2.752', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.448', 'FRAGCOUNT': '45.000'} [2023-02-25 13:23:23,203][36141] DAMAGECOUNT value on done: 153452.0 [2023-02-25 13:23:23,204][36141] Sum rewards: 35.394, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.665', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.142', 'weapon2': '0.168', 'AMMO4': '0.174', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.438', 'WEAPON3': '1.300', 'HITCOUNT': '2.390', 'weapon3': '2.788', 'DAMAGECOUNT': '11.835', 'FRAGCOUNT': '33.000'} [2023-02-25 13:23:23,216][36141] DAMAGECOUNT value on done: 156512.0 [2023-02-25 13:23:23,217][36141] Sum rewards: 48.543, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.501', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.132', 'AMMO3': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.440', 'weapon4': '0.516', 'WEAPON3': '1.200', 'weapon3': '2.616', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.758', 'FRAGCOUNT': '42.000'} [2023-02-25 13:23:23,225][36156] DAMAGECOUNT value on done: 153869.0 [2023-02-25 13:23:23,226][36156] Sum rewards: 59.150, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.532', 'ARMOR': '0.004', 'AMMO2': '0.015', 'AMMO5': '0.021', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'weapon2': '0.104', 'AMMO3': '0.172', 'weapon5': '0.248', 'weapon4': '0.374', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'HITCOUNT': '2.760', 'weapon3': '2.960', 'DAMAGECOUNT': '14.349', 'FRAGCOUNT': '47.500'} [2023-02-25 13:23:23,439][36157] DAMAGECOUNT value on done: 156098.0 [2023-02-25 13:23:23,439][36157] Sum rewards: 49.047, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.175', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.107', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'weapon4': '0.292', 'weapon2': '0.720', 'WEAPON3': '1.200', 'weapon3': '2.694', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.365', 'FRAGCOUNT': '42.000'} [2023-02-25 13:23:23,502][36156] DAMAGECOUNT value on done: 150524.0 [2023-02-25 13:23:23,503][36156] Sum rewards: 52.752, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.960', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO3': '0.184', 'weapon2': '0.632', 'WEAPON3': '1.250', 'HITCOUNT': '3.100', 'weapon3': '3.274', 'DAMAGECOUNT': '13.809', 'FRAGCOUNT': '44.000'} [2023-02-25 13:23:23,504][36142] DAMAGECOUNT value on done: 148886.0 [2023-02-25 13:23:23,505][36142] Sum rewards: 53.936, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.440', 'AMMO2': '0.007', 'AMMO5': '0.012', 'AMMO4': '0.035', 'weapon4': '0.072', 'WEAPON4': '0.100', 'weapon5': '0.140', 'AMMO3': '0.239', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.350', 'HITCOUNT': '2.960', 'weapon3': '3.222', 'DAMAGECOUNT': '13.872', 'FRAGCOUNT': '47.000'} [2023-02-25 13:23:23,526][36141] DAMAGECOUNT value on done: 147227.0 [2023-02-25 13:23:23,527][36141] Sum rewards: 51.570, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.534', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.104', 'AMMO3': '0.122', 'AMMO4': '0.166', 'WEAPON5': '0.250', 'weapon2': '0.290', 'WEAPON4': '0.300', 'weapon4': '0.678', 'WEAPON3': '0.700', 'weapon3': '2.616', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.543', 'FRAGCOUNT': '42.000'} [2023-02-25 13:23:23,643][36138] Updated weights for policy 0, policy_version 38923 (0.0009) [2023-02-25 13:23:23,817][36142] DAMAGECOUNT value on done: 153126.0 [2023-02-25 13:23:23,817][36142] Sum rewards: 53.446, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.380', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.148', 'AMMO3': '0.155', 'AMMO4': '0.177', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.458', 'weapon4': '0.598', 'WEAPON3': '0.950', 'weapon3': '2.548', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '14.256', 'FRAGCOUNT': '45.000'} [2023-02-25 13:23:24,125][36142] DAMAGECOUNT value on done: 151239.0 [2023-02-25 13:23:24,125][36142] Sum rewards: 42.288, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.026', 'AMMO5': '0.021', 'AMMO2': '0.060', 'AMMO3': '0.073', 'AMMO4': '0.301', 'weapon2': '0.304', 'weapon5': '0.392', 'WEAPON3': '0.450', 'WEAPON5': '0.600', 'WEAPON4': '0.600', 'weapon4': '1.046', 'weapon3': '1.424', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '12.072', 'FRAGCOUNT': '34.000'} [2023-02-25 13:23:24,423][36142] DAMAGECOUNT value on done: 153974.0 [2023-02-25 13:23:24,423][36142] Sum rewards: 44.880, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.150', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.032', 'AMMO3': '0.137', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'WEAPON4': '0.350', 'weapon4': '0.476', 'weapon2': '0.490', 'WEAPON3': '0.850', 'HITCOUNT': '2.600', 'weapon3': '2.866', 'DAMAGECOUNT': '11.406', 'FRAGCOUNT': '37.000'} [2023-02-25 13:23:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 159440896. Throughput: 0: 3368.5. Samples: 2351332. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:23:24,730][36114] Avg episode reward: [(0, '48.975')] [2023-02-25 13:23:25,978][36142] Large shaping reward 2.568 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.546, 182.0), ('weapon5', 0.002)] [2023-02-25 13:23:26,664][36138] Updated weights for policy 0, policy_version 38933 (0.0009) [2023-02-25 13:23:29,704][36138] Updated weights for policy 0, policy_version 38943 (0.0009) [2023-02-25 13:23:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13509.9). Total num frames: 159510528. Throughput: 0: 3372.9. Samples: 2371634. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:23:29,730][36114] Avg episode reward: [(0, '48.975')] [2023-02-25 13:23:32,704][36138] Updated weights for policy 0, policy_version 38953 (0.0009) [2023-02-25 13:23:34,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 159576064. Throughput: 0: 3368.7. Samples: 2391940. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:23:34,730][36114] Avg episode reward: [(0, '48.975')] [2023-02-25 13:23:35,749][36138] Updated weights for policy 0, policy_version 38963 (0.0009) [2023-02-25 13:23:38,265][36155] DAMAGECOUNT value on done: 151947.0 [2023-02-25 13:23:38,265][36155] Sum rewards: 44.686, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.992', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.090', 'WEAPON5': '0.150', 'weapon5': '0.190', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon4': '0.420', 'weapon2': '0.508', 'WEAPON3': '1.250', 'HITCOUNT': '2.500', 'weapon3': '2.602', 'DAMAGECOUNT': '10.968', 'FRAGCOUNT': '40.000'} [2023-02-25 13:23:38,570][36155] DAMAGECOUNT value on done: 161249.0 [2023-02-25 13:23:38,570][36155] Sum rewards: 56.503, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.698', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.058', 'weapon5': '0.066', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'weapon2': '0.456', 'WEAPON3': '1.300', 'HITCOUNT': '2.860', 'weapon3': '3.218', 'DAMAGECOUNT': '14.673', 'FRAGCOUNT': '49.000'} [2023-02-25 13:23:38,756][36138] Updated weights for policy 0, policy_version 38973 (0.0009) [2023-02-25 13:23:38,828][36155] DAMAGECOUNT value on done: 157001.0 [2023-02-25 13:23:38,828][36155] Sum rewards: 44.345, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.706', 'ARMOR': '0.008', 'AMMO5': '0.023', 'AMMO2': '0.066', 'AMMO3': '0.236', 'weapon2': '0.244', 'AMMO4': '0.330', 'weapon5': '0.432', 'WEAPON5': '0.650', 'weapon4': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.272', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '13.560', 'FRAGCOUNT': '41.000'} [2023-02-25 13:23:39,022][36139] DAMAGECOUNT value on done: 156667.0 [2023-02-25 13:23:39,022][36139] Sum rewards: 55.189, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.635', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.053', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'WEAPON4': '0.350', 'weapon2': '0.378', 'weapon4': '0.754', 'WEAPON3': '1.100', 'weapon3': '2.562', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.334', 'FRAGCOUNT': '46.000'} [2023-02-25 13:23:39,122][36155] DAMAGECOUNT value on done: 155794.0 [2023-02-25 13:23:39,123][36155] Sum rewards: 46.899, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.378', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon7': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.141', 'weapon5': '0.152', 'AMMO3': '0.180', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.498', 'weapon4': '0.764', 'WEAPON3': '1.100', 'weapon3': '2.108', 'HITCOUNT': '2.300', 'DAMAGECOUNT': '13.755', 'FRAGCOUNT': '40.000'} [2023-02-25 13:23:39,324][36139] DAMAGECOUNT value on done: 161647.0 [2023-02-25 13:23:39,324][36139] Sum rewards: 57.649, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.204', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon2': '0.144', 'AMMO3': '0.157', 'weapon5': '0.172', 'AMMO4': '0.189', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.696', 'WEAPON3': '0.950', 'weapon3': '2.682', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '14.349', 'FRAGCOUNT': '48.000'} [2023-02-25 13:23:39,583][36139] DAMAGECOUNT value on done: 159906.0 [2023-02-25 13:23:39,584][36139] Sum rewards: 39.839, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.840', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.046', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'WEAPON4': '0.200', 'weapon4': '0.318', 'weapon2': '0.750', 'WEAPON3': '0.850', 'HITCOUNT': '2.220', 'weapon3': '2.696', 'DAMAGECOUNT': '9.507', 'FRAGCOUNT': '35.000'} [2023-02-25 13:23:39,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13509.9). Total num frames: 159645696. Throughput: 0: 3371.6. Samples: 2402182. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:23:39,730][36114] Avg episode reward: [(0, '49.036')] [2023-02-25 13:23:39,894][36139] DAMAGECOUNT value on done: 156561.0 [2023-02-25 13:23:39,894][36139] Sum rewards: 47.699, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.030', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.052', 'AMMO4': '0.092', 'WEAPON5': '0.150', 'weapon4': '0.210', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'weapon2': '0.462', 'WEAPON3': '1.500', 'HITCOUNT': '2.770', 'weapon3': '3.078', 'DAMAGECOUNT': '13.140', 'FRAGCOUNT': '46.000'} [2023-02-25 13:23:40,140][36157] Large shaping reward 2.554 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.522, 174.0), ('weapon5', 0.002)] [2023-02-25 13:23:41,308][36154] DAMAGECOUNT value on done: 159738.0 [2023-02-25 13:23:41,309][36154] Sum rewards: 55.374, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.150', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.116', 'AMMO3': '0.149', 'weapon2': '0.710', 'WEAPON3': '1.100', 'HITCOUNT': '2.680', 'weapon3': '3.082', 'DAMAGECOUNT': '13.350', 'FRAGCOUNT': '46.000'} [2023-02-25 13:23:41,621][36154] DAMAGECOUNT value on done: 154914.0 [2023-02-25 13:23:41,622][36154] Sum rewards: 55.508, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.284', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'weapon5': '0.130', 'AMMO3': '0.162', 'WEAPON4': '0.400', 'weapon2': '0.464', 'weapon4': '0.668', 'WEAPON3': '1.000', 'weapon3': '2.578', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '14.502', 'FRAGCOUNT': '47.000'} [2023-02-25 13:23:41,792][36154] DAMAGECOUNT value on done: 158031.0 [2023-02-25 13:23:41,792][36154] Sum rewards: 43.872, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.232', 'weapon7': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.032', 'AMMO3': '0.093', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.159', 'WEAPON5': '0.200', 'weapon5': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.358', 'weapon4': '0.394', 'WEAPON3': '0.600', 'HITCOUNT': '2.310', 'weapon3': '2.692', 'DAMAGECOUNT': '11.883', 'FRAGCOUNT': '33.500'} [2023-02-25 13:23:41,793][36138] Updated weights for policy 0, policy_version 38983 (0.0010) [2023-02-25 13:23:41,802][36140] DAMAGECOUNT value on done: 159677.0 [2023-02-25 13:23:41,803][36140] Sum rewards: 51.887, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.454', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.064', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'AMMO3': '0.218', 'WEAPON4': '0.400', 'weapon2': '0.466', 'weapon4': '0.602', 'WEAPON3': '1.200', 'weapon3': '2.588', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.758', 'FRAGCOUNT': '46.000'} [2023-02-25 13:23:42,086][36154] DAMAGECOUNT value on done: 153916.0 [2023-02-25 13:23:42,086][36154] Sum rewards: 41.222, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.851', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.038', 'AMMO3': '0.137', 'AMMO4': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon5': '0.332', 'weapon4': '0.512', 'weapon2': '0.528', 'WEAPON3': '0.800', 'HITCOUNT': '2.260', 'weapon3': '2.314', 'DAMAGECOUNT': '9.834', 'FRAGCOUNT': '35.000'} [2023-02-25 13:23:42,115][36140] DAMAGECOUNT value on done: 156414.0 [2023-02-25 13:23:42,115][36140] Sum rewards: 34.258, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.086', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'weapon4': '0.200', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.722', 'WEAPON3': '1.250', 'HITCOUNT': '2.260', 'weapon3': '2.812', 'DAMAGECOUNT': '10.527', 'FRAGCOUNT': '32.000'} [2023-02-25 13:23:42,503][36157] DAMAGECOUNT value on done: 161031.0 [2023-02-25 13:23:42,503][36157] Sum rewards: 49.350, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.914', 'ARMOR': '0.004', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.167', 'WEAPON4': '0.300', 'weapon5': '0.314', 'WEAPON5': '0.350', 'weapon4': '0.382', 'weapon2': '0.572', 'WEAPON3': '1.000', 'weapon3': '2.434', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.314', 'FRAGCOUNT': '41.000'} [2023-02-25 13:23:42,511][36140] DAMAGECOUNT value on done: 156328.0 [2023-02-25 13:23:42,512][36140] Sum rewards: 42.772, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.126', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'weapon2': '0.514', 'weapon4': '0.552', 'WEAPON3': '1.600', 'weapon3': '2.686', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.342', 'FRAGCOUNT': '42.000'} [2023-02-25 13:23:42,817][36157] DAMAGECOUNT value on done: 159564.0 [2023-02-25 13:23:42,818][36157] Sum rewards: 62.108, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.617', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO5': '0.012', 'weapon4': '0.016', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'weapon5': '0.096', 'AMMO3': '0.170', 'weapon2': '0.182', 'WEAPON5': '0.250', 'WEAPON3': '1.050', 'HITCOUNT': '2.950', 'weapon3': '3.506', 'DAMAGECOUNT': '14.652', 'FRAGCOUNT': '51.000'} [2023-02-25 13:23:42,820][36140] DAMAGECOUNT value on done: 153545.0 [2023-02-25 13:23:42,820][36140] Sum rewards: 41.543, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.802', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.115', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.256', 'weapon2': '0.550', 'weapon4': '0.636', 'WEAPON3': '0.650', 'weapon3': '1.930', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '10.476', 'FRAGCOUNT': '33.000'} [2023-02-25 13:23:42,852][36141] DAMAGECOUNT value on done: 161228.0 [2023-02-25 13:23:42,853][36141] Sum rewards: 43.774, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.913', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.078', 'AMMO3': '0.201', 'weapon2': '0.384', 'AMMO4': '0.392', 'weapon5': '0.394', 'weapon4': '0.594', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.200', 'weapon3': '2.198', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '14.058', 'FRAGCOUNT': '40.500'} [2023-02-25 13:23:42,930][36156] DAMAGECOUNT value on done: 162090.0 [2023-02-25 13:23:42,931][36156] Sum rewards: 46.093, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.635', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon5': '0.072', 'weapon4': '0.180', 'AMMO4': '0.213', 'WEAPON5': '0.250', 'AMMO3': '0.265', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'HITCOUNT': '2.630', 'weapon3': '3.144', 'DAMAGECOUNT': '13.836', 'FRAGCOUNT': '45.000'} [2023-02-25 13:23:43,122][36157] DAMAGECOUNT value on done: 161670.0 [2023-02-25 13:23:43,122][36157] Sum rewards: 51.725, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.953', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.027', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'weapon2': '0.290', 'WEAPON5': '0.300', 'weapon4': '0.320', 'weapon5': '0.334', 'WEAPON3': '0.850', 'HITCOUNT': '2.690', 'weapon3': '2.772', 'DAMAGECOUNT': '13.539', 'FRAGCOUNT': '41.000'} [2023-02-25 13:23:43,168][36141] DAMAGECOUNT value on done: 158035.0 [2023-02-25 13:23:43,168][36141] Sum rewards: 51.434, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.283', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.045', 'weapon5': '0.182', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'AMMO4': '0.226', 'weapon2': '0.348', 'WEAPON4': '0.450', 'weapon4': '0.612', 'WEAPON3': '1.150', 'weapon3': '2.548', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.749', 'FRAGCOUNT': '45.000'} [2023-02-25 13:23:43,192][36141] DAMAGECOUNT value on done: 160224.0 [2023-02-25 13:23:43,192][36141] Sum rewards: 39.227, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.543', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.121', 'weapon7': '0.128', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'AMMO3': '0.208', 'WEAPON4': '0.400', 'weapon4': '0.552', 'weapon2': '0.602', 'WEAPON3': '1.200', 'weapon3': '2.324', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '11.136', 'FRAGCOUNT': '37.000'} [2023-02-25 13:23:43,220][36156] DAMAGECOUNT value on done: 160033.0 [2023-02-25 13:23:43,221][36156] Sum rewards: 53.420, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.464', 'ARMOR': '0.004', 'AMMO5': '0.027', 'AMMO2': '0.053', 'AMMO3': '0.179', 'weapon5': '0.246', 'AMMO4': '0.266', 'weapon2': '0.352', 'weapon4': '0.466', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.578', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.742', 'FRAGCOUNT': '47.500'} [2023-02-25 13:23:43,261][36156] DAMAGECOUNT value on done: 158539.0 [2023-02-25 13:23:43,262][36156] Sum rewards: 50.275, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.868', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.174', 'weapon2': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.472', 'WEAPON3': '1.050', 'weapon3': '3.020', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '13.710', 'FRAGCOUNT': '42.000'} [2023-02-25 13:23:43,440][36157] DAMAGECOUNT value on done: 161470.0 [2023-02-25 13:23:43,441][36157] Sum rewards: 60.463, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.672', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'weapon5': '0.140', 'AMMO3': '0.243', 'WEAPON4': '0.350', 'weapon2': '0.472', 'weapon4': '0.626', 'WEAPON3': '1.500', 'weapon3': '2.536', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '54.000'} [2023-02-25 13:23:43,479][36142] DAMAGECOUNT value on done: 152781.0 [2023-02-25 13:23:43,480][36142] Sum rewards: 43.038, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.522', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.050', 'weapon7': '0.072', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'weapon4': '0.164', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.300', 'HITCOUNT': '2.400', 'weapon3': '3.126', 'DAMAGECOUNT': '11.685', 'FRAGCOUNT': '39.000'} [2023-02-25 13:23:43,504][36141] DAMAGECOUNT value on done: 151550.0 [2023-02-25 13:23:43,505][36141] Sum rewards: 48.941, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.380', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon7': '0.038', 'weapon5': '0.156', 'AMMO4': '0.175', 'weapon2': '0.178', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.216', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.786', 'WEAPON3': '1.300', 'weapon3': '2.610', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.954', 'FRAGCOUNT': '44.500'} [2023-02-25 13:23:43,550][36156] DAMAGECOUNT value on done: 155420.0 [2023-02-25 13:23:43,550][36156] Sum rewards: 56.128, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.390', 'AMMO2': '0.015', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'weapon4': '0.150', 'weapon2': '0.198', 'AMMO3': '0.287', 'WEAPON3': '1.700', 'HITCOUNT': '3.090', 'weapon3': '3.414', 'DAMAGECOUNT': '14.688', 'FRAGCOUNT': '52.000'} [2023-02-25 13:23:43,792][36142] DAMAGECOUNT value on done: 157817.0 [2023-02-25 13:23:43,792][36142] Sum rewards: 50.570, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.008', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.112', 'AMMO4': '0.164', 'weapon2': '0.208', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.406', 'WEAPON3': '1.400', 'weapon3': '3.054', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.073', 'FRAGCOUNT': '45.000'} [2023-02-25 13:23:44,040][36142] DAMAGECOUNT value on done: 154869.0 [2023-02-25 13:23:44,041][36142] Sum rewards: 42.753, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.238', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon2': '0.188', 'AMMO3': '0.195', 'weapon5': '0.258', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.884', 'WEAPON3': '1.100', 'weapon3': '2.326', 'HITCOUNT': '2.350', 'DAMAGECOUNT': '10.890', 'FRAGCOUNT': '39.000'} [2023-02-25 13:23:44,335][36142] DAMAGECOUNT value on done: 157948.0 [2023-02-25 13:23:44,335][36142] Sum rewards: 51.342, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.350', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.050', 'AMMO3': '0.124', 'weapon5': '0.182', 'WEAPON5': '0.200', 'AMMO4': '0.252', 'weapon2': '0.258', 'WEAPON4': '0.550', 'WEAPON3': '0.850', 'weapon4': '1.038', 'weapon3': '2.242', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '11.922', 'FRAGCOUNT': '45.000'} [2023-02-25 13:23:44,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 159711232. Throughput: 0: 3369.5. Samples: 2422334. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:23:44,729][36114] Avg episode reward: [(0, '48.987')] [2023-02-25 13:23:44,858][36138] Updated weights for policy 0, policy_version 38993 (0.0009) [2023-02-25 13:23:47,885][36138] Updated weights for policy 0, policy_version 39003 (0.0009) [2023-02-25 13:23:48,826][36142] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 13:23:48,938][36155] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 13:23:49,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13509.9). Total num frames: 159780864. Throughput: 0: 3372.9. Samples: 2442726. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:23:49,729][36114] Avg episode reward: [(0, '48.987')] [2023-02-25 13:23:50,924][36138] Updated weights for policy 0, policy_version 39013 (0.0009) [2023-02-25 13:23:53,987][36138] Updated weights for policy 0, policy_version 39023 (0.0009) [2023-02-25 13:23:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 159846400. Throughput: 0: 3372.3. Samples: 2452774. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:23:54,730][36114] Avg episode reward: [(0, '48.987')] [2023-02-25 13:23:54,948][36157] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-25 13:23:57,045][36138] Updated weights for policy 0, policy_version 39033 (0.0009) [2023-02-25 13:23:58,140][36155] DAMAGECOUNT value on done: 156810.0 [2023-02-25 13:23:58,140][36155] Sum rewards: 53.794, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO3': '0.110', 'AMMO4': '0.131', 'weapon5': '0.154', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.404', 'weapon4': '0.524', 'WEAPON3': '0.600', 'HEALTH': '1.498', 'weapon3': '2.678', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.589', 'FRAGCOUNT': '41.000'} [2023-02-25 13:23:58,438][36155] DAMAGECOUNT value on done: 165009.0 [2023-02-25 13:23:58,439][36155] Sum rewards: 43.166, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.751', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.053', 'weapon5': '0.092', 'AMMO3': '0.140', 'AMMO4': '0.263', 'weapon2': '0.358', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '0.850', 'weapon4': '0.986', 'weapon3': '2.292', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '11.280', 'FRAGCOUNT': '39.000'} [2023-02-25 13:23:58,693][36155] DAMAGECOUNT value on done: 161911.0 [2023-02-25 13:23:58,694][36155] Sum rewards: 59.397, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.952', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon5': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'WEAPON5': '0.300', 'weapon4': '0.318', 'weapon2': '0.556', 'WEAPON3': '1.350', 'weapon3': '2.638', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.730', 'FRAGCOUNT': '52.000'} [2023-02-25 13:23:58,893][36139] DAMAGECOUNT value on done: 161266.0 [2023-02-25 13:23:58,893][36139] Sum rewards: 51.395, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.786', 'AMMO5': '0.016', 'AMMO2': '0.057', 'weapon5': '0.188', 'AMMO3': '0.194', 'weapon2': '0.268', 'AMMO4': '0.283', 'ARMOR': '0.400', 'weapon4': '0.482', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.736', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.797', 'FRAGCOUNT': '46.000'} [2023-02-25 13:23:58,991][36155] DAMAGECOUNT value on done: 160640.0 [2023-02-25 13:23:58,991][36155] Sum rewards: 49.424, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.842', 'AMMO5': '0.021', 'AMMO2': '0.038', 'AMMO3': '0.186', 'AMMO4': '0.192', 'weapon5': '0.216', 'weapon2': '0.268', 'weapon4': '0.296', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'HITCOUNT': '2.890', 'weapon3': '2.920', 'DAMAGECOUNT': '14.538', 'FRAGCOUNT': '43.500'} [2023-02-25 13:23:59,186][36139] DAMAGECOUNT value on done: 166035.0 [2023-02-25 13:23:59,187][36139] Sum rewards: 44.684, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.480', 'AMMO5': '0.014', 'AMMO2': '0.016', 'weapon5': '0.076', 'AMMO4': '0.078', 'weapon4': '0.140', 'WEAPON4': '0.200', 'AMMO3': '0.288', 'WEAPON5': '0.350', 'weapon2': '0.380', 'WEAPON3': '1.650', 'HITCOUNT': '2.740', 'weapon3': '3.068', 'DAMAGECOUNT': '13.164', 'FRAGCOUNT': '43.000'} [2023-02-25 13:23:59,444][36139] DAMAGECOUNT value on done: 164586.0 [2023-02-25 13:23:59,445][36139] Sum rewards: 51.894, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.326', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.090', 'weapon4': '0.100', 'WEAPON4': '0.200', 'weapon5': '0.212', 'AMMO3': '0.220', 'WEAPON5': '0.300', 'weapon2': '0.436', 'WEAPON3': '1.350', 'HITCOUNT': '2.950', 'weapon3': '3.018', 'DAMAGECOUNT': '14.040', 'FRAGCOUNT': '45.500'} [2023-02-25 13:23:59,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 159911936. Throughput: 0: 3371.3. Samples: 2472972. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:23:59,729][36114] Avg episode reward: [(0, '49.458')] [2023-02-25 13:23:59,754][36139] DAMAGECOUNT value on done: 161544.0 [2023-02-25 13:23:59,754][36139] Sum rewards: 53.318, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.746', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.010', 'WEAPON4': '0.050', 'weapon5': '0.074', 'weapon4': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon2': '0.432', 'WEAPON3': '1.300', 'HITCOUNT': '3.070', 'weapon3': '3.204', 'DAMAGECOUNT': '14.949', 'FRAGCOUNT': '44.000'} [2023-02-25 13:24:00,081][36138] Updated weights for policy 0, policy_version 39043 (0.0009) [2023-02-25 13:24:01,117][36154] DAMAGECOUNT value on done: 163857.0 [2023-02-25 13:24:01,118][36154] Sum rewards: 45.310, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.090', 'AMMO5': '0.017', 'AMMO2': '0.023', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'weapon2': '0.168', 'AMMO3': '0.174', 'weapon5': '0.206', 'WEAPON5': '0.350', 'weapon4': '0.950', 'WEAPON3': '1.050', 'weapon3': '2.378', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.357', 'FRAGCOUNT': '37.000'} [2023-02-25 13:24:01,431][36154] DAMAGECOUNT value on done: 158968.0 [2023-02-25 13:24:01,432][36154] Sum rewards: 48.079, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.676', 'AMMO5': '0.007', 'ARMOR': '0.013', 'weapon5': '0.018', 'AMMO2': '0.037', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'AMMO4': '0.185', 'WEAPON4': '0.250', 'weapon4': '0.272', 'weapon2': '0.368', 'WEAPON3': '1.000', 'HITCOUNT': '2.690', 'weapon3': '3.182', 'DAMAGECOUNT': '12.162', 'FRAGCOUNT': '41.000'} [2023-02-25 13:24:01,616][36154] DAMAGECOUNT value on done: 161641.0 [2023-02-25 13:24:01,617][36154] Sum rewards: 42.393, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.490', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.060', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon4': '0.278', 'weapon2': '0.490', 'WEAPON3': '1.250', 'HITCOUNT': '2.500', 'weapon3': '2.930', 'DAMAGECOUNT': '10.830', 'FRAGCOUNT': '38.500'} [2023-02-25 13:24:01,739][36140] DAMAGECOUNT value on done: 163700.0 [2023-02-25 13:24:01,739][36140] Sum rewards: 46.174, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.668', 'AMMO2': '0.016', 'AMMO5': '0.017', 'weapon4': '0.062', 'AMMO4': '0.078', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon5': '0.302', 'WEAPON5': '0.450', 'weapon2': '0.536', 'WEAPON3': '1.050', 'HITCOUNT': '2.330', 'weapon3': '2.812', 'DAMAGECOUNT': '12.069', 'FRAGCOUNT': '39.000'} [2023-02-25 13:24:01,922][36154] DAMAGECOUNT value on done: 158755.0 [2023-02-25 13:24:01,923][36154] Sum rewards: 58.245, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.500', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.028', 'weapon5': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.158', 'weapon2': '0.194', 'WEAPON5': '0.300', 'weapon4': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.002', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.517', 'FRAGCOUNT': '48.000'} [2023-02-25 13:24:02,053][36140] DAMAGECOUNT value on done: 161629.0 [2023-02-25 13:24:02,054][36140] Sum rewards: 54.410, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.252', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.193', 'weapon5': '0.244', 'WEAPON5': '0.350', 'weapon2': '0.376', 'WEAPON4': '0.450', 'weapon4': '0.720', 'WEAPON3': '1.150', 'weapon3': '2.398', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.645', 'FRAGCOUNT': '47.000'} [2023-02-25 13:24:02,429][36140] DAMAGECOUNT value on done: 160412.0 [2023-02-25 13:24:02,430][36140] Sum rewards: 44.496, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.708', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.120', 'WEAPON7': '0.200', 'AMMO3': '0.201', 'weapon5': '0.206', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.554', 'weapon2': '0.598', 'WEAPON3': '1.100', 'weapon3': '2.264', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '12.252', 'FRAGCOUNT': '40.000'} [2023-02-25 13:24:02,604][36157] DAMAGECOUNT value on done: 165273.0 [2023-02-25 13:24:02,605][36157] Sum rewards: 52.227, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.006', 'weapon5': '0.066', 'WEAPON4': '0.100', 'HEALTH': '0.145', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon2': '0.220', 'weapon4': '0.222', 'WEAPON3': '0.950', 'HITCOUNT': '2.690', 'weapon3': '3.270', 'DAMAGECOUNT': '12.726', 'FRAGCOUNT': '42.000'} [2023-02-25 13:24:02,734][36140] DAMAGECOUNT value on done: 157889.0 [2023-02-25 13:24:02,735][36140] Sum rewards: 44.701, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.769', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.064', 'AMMO3': '0.174', 'weapon2': '0.204', 'AMMO4': '0.321', 'weapon5': '0.496', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.934', 'WEAPON3': '1.050', 'weapon3': '1.792', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '13.032', 'FRAGCOUNT': '40.000'} [2023-02-25 13:24:02,847][36141] DAMAGECOUNT value on done: 165483.0 [2023-02-25 13:24:02,847][36141] Sum rewards: 50.785, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.953', 'AMMO5': '0.016', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.168', 'weapon5': '0.168', 'weapon4': '0.304', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.426', 'WEAPON3': '1.050', 'HITCOUNT': '2.640', 'weapon3': '2.882', 'DAMAGECOUNT': '12.699', 'FRAGCOUNT': '45.000'} [2023-02-25 13:24:02,917][36157] DAMAGECOUNT value on done: 164401.0 [2023-02-25 13:24:02,917][36157] Sum rewards: 55.825, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.182', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.165', 'weapon2': '0.198', 'weapon5': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.396', 'WEAPON3': '1.000', 'weapon3': '2.954', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.511', 'FRAGCOUNT': '45.000'} [2023-02-25 13:24:02,943][36156] DAMAGECOUNT value on done: 167082.0 [2023-02-25 13:24:02,944][36156] Sum rewards: 58.784, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.122', 'AMMO4': '0.128', 'weapon2': '0.166', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.392', 'WEAPON3': '0.950', 'HITCOUNT': '3.010', 'weapon3': '3.136', 'DAMAGECOUNT': '14.976', 'FRAGCOUNT': '48.000'} [2023-02-25 13:24:03,113][36138] Updated weights for policy 0, policy_version 39053 (0.0009) [2023-02-25 13:24:03,143][36141] DAMAGECOUNT value on done: 164004.0 [2023-02-25 13:24:03,143][36141] Sum rewards: 42.895, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.430', 'AMMO5': '0.017', 'AMMO2': '0.021', 'weapon4': '0.034', 'AMMO4': '0.105', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'weapon5': '0.208', 'WEAPON5': '0.350', 'weapon2': '0.488', 'WEAPON3': '1.100', 'HITCOUNT': '2.250', 'weapon3': '3.036', 'DAMAGECOUNT': '11.340', 'FRAGCOUNT': '38.000'} [2023-02-25 13:24:03,153][36141] DAMAGECOUNT value on done: 163429.0 [2023-02-25 13:24:03,153][36141] Sum rewards: 65.039, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.605', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO3': '0.165', 'weapon2': '0.284', 'WEAPON3': '1.050', 'HITCOUNT': '3.160', 'weapon3': '3.380', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '53.000'} [2023-02-25 13:24:03,225][36157] DAMAGECOUNT value on done: 165624.0 [2023-02-25 13:24:03,226][36157] Sum rewards: 45.068, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.448', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.067', 'AMMO3': '0.131', 'weapon5': '0.270', 'AMMO4': '0.333', 'weapon2': '0.496', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '0.800', 'weapon4': '0.870', 'weapon3': '2.070', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '11.862', 'FRAGCOUNT': '40.000'} [2023-02-25 13:24:03,237][36156] DAMAGECOUNT value on done: 164314.0 [2023-02-25 13:24:03,238][36156] Sum rewards: 47.893, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.420', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.148', 'AMMO4': '0.176', 'weapon2': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'weapon4': '0.498', 'WEAPON3': '1.450', 'weapon3': '2.938', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '12.843', 'FRAGCOUNT': '44.000'} [2023-02-25 13:24:03,247][36156] DAMAGECOUNT value on done: 163423.0 [2023-02-25 13:24:03,247][36156] Sum rewards: 55.015, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.948', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.050', 'AMMO3': '0.183', 'AMMO4': '0.251', 'weapon5': '0.376', 'weapon2': '0.406', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.678', 'WEAPON3': '1.100', 'weapon3': '2.196', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '14.652', 'FRAGCOUNT': '46.000'} [2023-02-25 13:24:03,462][36141] DAMAGECOUNT value on done: 156202.0 [2023-02-25 13:24:03,462][36141] Sum rewards: 56.287, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.646', 'AMMO5': '0.014', 'AMMO2': '0.036', 'AMMO3': '0.148', 'AMMO4': '0.179', 'weapon5': '0.226', 'weapon2': '0.268', 'WEAPON5': '0.300', 'weapon4': '0.368', 'WEAPON4': '0.450', 'WEAPON3': '0.850', 'HITCOUNT': '2.810', 'weapon3': '2.828', 'DAMAGECOUNT': '13.956', 'FRAGCOUNT': '48.000'} [2023-02-25 13:24:03,512][36157] DAMAGECOUNT value on done: 166544.0 [2023-02-25 13:24:03,513][36157] Sum rewards: 57.816, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.810', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.156', 'AMMO4': '0.157', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'weapon2': '0.232', 'WEAPON4': '0.250', 'weapon4': '0.668', 'WEAPON3': '1.200', 'weapon3': '2.652', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.042', 'FRAGCOUNT': '49.000'} [2023-02-25 13:24:03,530][36142] DAMAGECOUNT value on done: 157045.0 [2023-02-25 13:24:03,531][36142] Sum rewards: 51.635, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.650', 'AMMO2': '0.010', 'AMMO5': '0.013', 'weapon4': '0.014', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'weapon2': '0.140', 'weapon5': '0.162', 'AMMO3': '0.224', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '2.700', 'weapon3': '3.382', 'DAMAGECOUNT': '12.792', 'FRAGCOUNT': '46.500'} [2023-02-25 13:24:03,546][36156] DAMAGECOUNT value on done: 160570.0 [2023-02-25 13:24:03,546][36156] Sum rewards: 58.913, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon5': '0.090', 'AMMO4': '0.104', 'AMMO3': '0.147', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'HEALTH': '0.241', 'weapon4': '0.414', 'weapon2': '0.516', 'WEAPON3': '0.800', 'weapon3': '2.790', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '46.000'} [2023-02-25 13:24:03,841][36142] DAMAGECOUNT value on done: 162092.0 [2023-02-25 13:24:03,841][36142] Sum rewards: 46.674, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.039', 'AMMO5': '0.005', 'AMMO2': '0.024', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'weapon5': '0.216', 'weapon4': '0.544', 'weapon2': '0.592', 'WEAPON3': '0.950', 'weapon3': '2.460', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.816', 'FRAGCOUNT': '38.000'} [2023-02-25 13:24:04,050][36142] DAMAGECOUNT value on done: 158580.0 [2023-02-25 13:24:04,050][36142] Sum rewards: 35.412, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.566', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.089', 'WEAPON5': '0.150', 'weapon5': '0.188', 'WEAPON4': '0.200', 'AMMO3': '0.238', 'weapon4': '0.364', 'weapon2': '0.442', 'WEAPON3': '1.400', 'HITCOUNT': '2.470', 'weapon3': '2.776', 'DAMAGECOUNT': '11.133', 'FRAGCOUNT': '35.000'} [2023-02-25 13:24:04,352][36142] DAMAGECOUNT value on done: 162697.0 [2023-02-25 13:24:04,353][36142] Sum rewards: 51.794, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.686', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.047', 'AMMO3': '0.132', 'weapon5': '0.172', 'AMMO4': '0.234', 'weapon4': '0.248', 'WEAPON5': '0.350', 'weapon2': '0.448', 'WEAPON4': '0.450', 'WEAPON3': '0.900', 'HITCOUNT': '2.580', 'weapon3': '2.902', 'DAMAGECOUNT': '14.247', 'FRAGCOUNT': '43.500'} [2023-02-25 13:24:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 159981568. Throughput: 0: 3374.2. Samples: 2493238. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:24:04,729][36114] Avg episode reward: [(0, '49.735')] [2023-02-25 13:24:06,140][36138] Updated weights for policy 0, policy_version 39063 (0.0009) [2023-02-25 13:24:08,497][36142] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 13:24:09,121][36138] Updated weights for policy 0, policy_version 39073 (0.0009) [2023-02-25 13:24:09,729][36114] Fps is (10 sec: 13926.3, 60 sec: 13516.8, 300 sec: 13509.9). Total num frames: 160051200. Throughput: 0: 3380.2. Samples: 2503442. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:24:09,729][36114] Avg episode reward: [(0, '49.735')] [2023-02-25 13:24:12,162][36138] Updated weights for policy 0, policy_version 39083 (0.0009) [2023-02-25 13:24:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 160116736. Throughput: 0: 3380.1. Samples: 2523738. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:24:14,729][36114] Avg episode reward: [(0, '49.735')] [2023-02-25 13:24:15,203][36138] Updated weights for policy 0, policy_version 39093 (0.0010) [2023-02-25 13:24:17,835][36155] DAMAGECOUNT value on done: 161100.0 [2023-02-25 13:24:17,836][36155] Sum rewards: 49.187, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.120', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.054', 'AMMO3': '0.139', 'weapon4': '0.252', 'AMMO4': '0.272', 'weapon5': '0.328', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon2': '0.672', 'WEAPON3': '1.000', 'weapon3': '2.466', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.870', 'FRAGCOUNT': '44.000'} [2023-02-25 13:24:18,148][36155] DAMAGECOUNT value on done: 170433.0 [2023-02-25 13:24:18,149][36155] Sum rewards: 65.663, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.978', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'weapon4': '0.062', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.209', 'weapon2': '0.280', 'WEAPON3': '1.250', 'weapon3': '3.380', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '55.000'} [2023-02-25 13:24:18,259][36138] Updated weights for policy 0, policy_version 39103 (0.0009) [2023-02-25 13:24:18,436][36155] DAMAGECOUNT value on done: 166275.0 [2023-02-25 13:24:18,437][36155] Sum rewards: 56.117, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.170', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.132', 'AMMO3': '0.165', 'weapon2': '0.206', 'WEAPON4': '0.250', 'weapon4': '0.298', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '2.830', 'weapon3': '3.058', 'DAMAGECOUNT': '13.092', 'FRAGCOUNT': '47.000'} [2023-02-25 13:24:18,739][36155] DAMAGECOUNT value on done: 165239.0 [2023-02-25 13:24:18,739][36155] Sum rewards: 49.849, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.508', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.106', 'AMMO4': '0.146', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.324', 'weapon2': '0.330', 'WEAPON3': '1.250', 'HITCOUNT': '2.900', 'weapon3': '3.020', 'DAMAGECOUNT': '13.797', 'FRAGCOUNT': '44.000'} [2023-02-25 13:24:18,762][36139] DAMAGECOUNT value on done: 165536.0 [2023-02-25 13:24:18,762][36139] Sum rewards: 49.112, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.820', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'weapon4': '0.032', 'AMMO4': '0.090', 'weapon5': '0.118', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.762', 'WEAPON3': '1.150', 'weapon3': '2.868', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.810', 'FRAGCOUNT': '41.500'} [2023-02-25 13:24:19,088][36139] DAMAGECOUNT value on done: 170263.0 [2023-02-25 13:24:19,088][36139] Sum rewards: 41.906, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.350', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.134', 'AMMO3': '0.202', 'weapon2': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.566', 'WEAPON3': '1.350', 'weapon3': '2.778', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '12.399', 'FRAGCOUNT': '38.000'} [2023-02-25 13:24:19,376][36139] DAMAGECOUNT value on done: 168133.0 [2023-02-25 13:24:19,377][36139] Sum rewards: 41.856, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.194', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.046', 'AMMO3': '0.112', 'AMMO4': '0.231', 'weapon2': '0.330', 'weapon5': '0.364', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon4': '0.452', 'WEAPON3': '0.800', 'HITCOUNT': '2.140', 'weapon3': '2.504', 'DAMAGECOUNT': '10.641', 'FRAGCOUNT': '36.000'} [2023-02-25 13:24:19,688][36139] DAMAGECOUNT value on done: 165766.0 [2023-02-25 13:24:19,688][36139] Sum rewards: 44.069, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.156', 'AMMO5': '0.017', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.194', 'weapon5': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.302', 'weapon2': '0.596', 'WEAPON3': '1.200', 'HITCOUNT': '2.450', 'weapon3': '2.586', 'DAMAGECOUNT': '12.426', 'FRAGCOUNT': '39.000'} [2023-02-25 13:24:19,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13448.6, 300 sec: 13496.0). Total num frames: 160182272. Throughput: 0: 3373.5. Samples: 2543746. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:24:19,729][36114] Avg episode reward: [(0, '49.660')] [2023-02-25 13:24:21,037][36154] DAMAGECOUNT value on done: 168718.0 [2023-02-25 13:24:21,037][36154] Sum rewards: 50.097, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.725', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.096', 'WEAPON5': '0.150', 'weapon2': '0.200', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon4': '0.628', 'WEAPON3': '1.250', 'weapon3': '2.908', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.583', 'FRAGCOUNT': '42.000'} [2023-02-25 13:24:21,315][36138] Updated weights for policy 0, policy_version 39113 (0.0009) [2023-02-25 13:24:21,353][36154] DAMAGECOUNT value on done: 163363.0 [2023-02-25 13:24:21,354][36154] Sum rewards: 53.825, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.664', 'AMMO2': '0.013', 'AMMO5': '0.015', 'AMMO4': '0.065', 'weapon4': '0.114', 'WEAPON4': '0.150', 'weapon5': '0.176', 'AMMO3': '0.227', 'weapon2': '0.248', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.830', 'weapon3': '3.216', 'DAMAGECOUNT': '13.185', 'FRAGCOUNT': '48.000'} [2023-02-25 13:24:21,535][36154] DAMAGECOUNT value on done: 166166.0 [2023-02-25 13:24:21,535][36154] Sum rewards: 54.909, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.471', 'AMMO5': '0.022', 'AMMO2': '0.030', 'AMMO4': '0.147', 'weapon5': '0.164', 'AMMO3': '0.174', 'weapon2': '0.224', 'WEAPON4': '0.350', 'weapon4': '0.446', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'HITCOUNT': '2.860', 'weapon3': '2.888', 'DAMAGECOUNT': '13.575', 'FRAGCOUNT': '46.000'} [2023-02-25 13:24:21,716][36140] DAMAGECOUNT value on done: 168147.0 [2023-02-25 13:24:21,717][36140] Sum rewards: 49.623, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.468', 'AMMO5': '0.015', 'AMMO2': '0.040', 'AMMO3': '0.162', 'weapon5': '0.176', 'AMMO4': '0.201', 'WEAPON5': '0.350', 'weapon2': '0.448', 'WEAPON4': '0.500', 'weapon4': '0.658', 'WEAPON3': '1.000', 'weapon3': '2.414', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.206', 'FRAGCOUNT': '44.000'} [2023-02-25 13:24:21,838][36154] DAMAGECOUNT value on done: 163639.0 [2023-02-25 13:24:21,839][36154] Sum rewards: 58.566, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.742', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.072', 'AMMO4': '0.094', 'WEAPON5': '0.150', 'weapon2': '0.180', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon4': '0.340', 'WEAPON3': '1.150', 'HITCOUNT': '3.000', 'weapon3': '3.248', 'DAMAGECOUNT': '14.652', 'FRAGCOUNT': '49.000'} [2023-02-25 13:24:22,030][36140] DAMAGECOUNT value on done: 166727.0 [2023-02-25 13:24:22,030][36140] Sum rewards: 58.629, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.379', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'weapon4': '0.086', 'weapon5': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.207', 'weapon2': '0.268', 'WEAPON3': '1.400', 'HITCOUNT': '3.120', 'weapon3': '3.324', 'DAMAGECOUNT': '15.294', 'FRAGCOUNT': '50.000'} [2023-02-25 13:24:22,435][36140] DAMAGECOUNT value on done: 164398.0 [2023-02-25 13:24:22,436][36140] Sum rewards: 46.255, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.650', 'AMMO2': '0.014', 'AMMO5': '0.014', 'weapon4': '0.050', 'AMMO4': '0.072', 'weapon5': '0.122', 'weapon2': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.240', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '2.430', 'weapon3': '3.408', 'DAMAGECOUNT': '11.958', 'FRAGCOUNT': '43.500'} [2023-02-25 13:24:22,583][36157] DAMAGECOUNT value on done: 169870.0 [2023-02-25 13:24:22,584][36157] Sum rewards: 54.570, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.549', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'weapon2': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'weapon4': '0.306', 'WEAPON3': '1.150', 'HITCOUNT': '2.840', 'weapon3': '3.410', 'DAMAGECOUNT': '13.791', 'FRAGCOUNT': '46.000'} [2023-02-25 13:24:22,703][36141] DAMAGECOUNT value on done: 170378.0 [2023-02-25 13:24:22,703][36141] Sum rewards: 53.512, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.740', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.102', 'weapon2': '0.124', 'weapon4': '0.204', 'AMMO3': '0.225', 'WEAPON3': '1.450', 'HITCOUNT': '3.140', 'weapon3': '3.322', 'DAMAGECOUNT': '14.670', 'FRAGCOUNT': '47.000'} [2023-02-25 13:24:22,743][36140] DAMAGECOUNT value on done: 162661.0 [2023-02-25 13:24:22,743][36140] Sum rewards: 54.346, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.562', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.026', 'AMMO4': '0.127', 'weapon2': '0.154', 'AMMO3': '0.208', 'weapon4': '0.260', 'weapon5': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.680', 'weapon3': '2.992', 'DAMAGECOUNT': '14.316', 'FRAGCOUNT': '48.000'} [2023-02-25 13:24:22,869][36156] DAMAGECOUNT value on done: 171904.0 [2023-02-25 13:24:22,869][36156] Sum rewards: 54.019, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.625', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.023', 'weapon4': '0.084', 'AMMO4': '0.113', 'weapon5': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'WEAPON5': '0.400', 'weapon2': '0.618', 'WEAPON3': '1.200', 'HITCOUNT': '2.920', 'weapon3': '2.940', 'DAMAGECOUNT': '14.106', 'FRAGCOUNT': '46.500'} [2023-02-25 13:24:22,891][36157] DAMAGECOUNT value on done: 169046.0 [2023-02-25 13:24:22,892][36157] Sum rewards: 55.267, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.686', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.108', 'AMMO4': '0.168', 'AMMO3': '0.172', 'WEAPON5': '0.300', 'weapon2': '0.358', 'WEAPON4': '0.450', 'weapon4': '0.462', 'WEAPON3': '1.050', 'HITCOUNT': '2.790', 'weapon3': '2.866', 'DAMAGECOUNT': '13.935', 'FRAGCOUNT': '48.000'} [2023-02-25 13:24:23,018][36141] DAMAGECOUNT value on done: 166594.0 [2023-02-25 13:24:23,018][36141] Sum rewards: 37.030, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.725', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.108', 'AMMO3': '0.155', 'AMMO4': '0.157', 'weapon2': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'WEAPON3': '0.900', 'weapon4': '0.952', 'HITCOUNT': '2.460', 'weapon3': '2.544', 'DAMAGECOUNT': '9.495', 'FRAGCOUNT': '35.000'} [2023-02-25 13:24:23,049][36141] DAMAGECOUNT value on done: 168377.0 [2023-02-25 13:24:23,050][36141] Sum rewards: 55.375, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.330', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.129', 'AMMO3': '0.152', 'weapon4': '0.338', 'weapon2': '0.520', 'WEAPON3': '0.950', 'weapon3': '2.796', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.119', 'FRAGCOUNT': '46.000'} [2023-02-25 13:24:23,173][36156] DAMAGECOUNT value on done: 169000.0 [2023-02-25 13:24:23,173][36156] Sum rewards: 46.491, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.944', 'ARMOR': '0.004', 'AMMO5': '0.031', 'AMMO2': '0.090', 'AMMO3': '0.170', 'weapon5': '0.348', 'weapon2': '0.416', 'AMMO4': '0.448', 'weapon4': '0.498', 'WEAPON5': '0.750', 'WEAPON4': '0.900', 'WEAPON3': '1.000', 'weapon3': '2.282', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '14.058', 'FRAGCOUNT': '44.000'} [2023-02-25 13:24:23,183][36156] DAMAGECOUNT value on done: 168133.0 [2023-02-25 13:24:23,183][36156] Sum rewards: 61.075, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.944', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.098', 'AMMO3': '0.135', 'weapon5': '0.144', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.514', 'weapon2': '0.580', 'WEAPON3': '0.900', 'weapon3': '2.618', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.130', 'FRAGCOUNT': '50.000'} [2023-02-25 13:24:23,200][36157] DAMAGECOUNT value on done: 169667.0 [2023-02-25 13:24:23,201][36157] Sum rewards: 42.677, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.788', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon5': '0.164', 'AMMO4': '0.173', 'weapon4': '0.234', 'AMMO3': '0.251', 'weapon2': '0.282', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.570', 'weapon3': '2.960', 'DAMAGECOUNT': '12.129', 'FRAGCOUNT': '40.000'} [2023-02-25 13:24:23,359][36141] DAMAGECOUNT value on done: 161084.0 [2023-02-25 13:24:23,360][36141] Sum rewards: 51.291, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.780', 'AMMO5': '0.016', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.148', 'weapon2': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.232', 'weapon4': '0.328', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.104', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.646', 'FRAGCOUNT': '45.000'} [2023-02-25 13:24:23,492][36156] DAMAGECOUNT value on done: 165545.0 [2023-02-25 13:24:23,493][36156] Sum rewards: 57.230, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.180', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.086', 'weapon5': '0.128', 'WEAPON4': '0.150', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.222', 'WEAPON3': '1.400', 'HITCOUNT': '3.070', 'weapon3': '3.306', 'DAMAGECOUNT': '14.925', 'FRAGCOUNT': '50.000'} [2023-02-25 13:24:23,500][36157] DAMAGECOUNT value on done: 171044.0 [2023-02-25 13:24:23,500][36157] Sum rewards: 52.221, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.495', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.206', 'weapon2': '0.208', 'AMMO3': '0.233', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.612', 'WEAPON3': '1.500', 'weapon3': '2.726', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.500', 'FRAGCOUNT': '48.000'} [2023-02-25 13:24:23,586][36142] DAMAGECOUNT value on done: 162214.0 [2023-02-25 13:24:23,586][36142] Sum rewards: 60.876, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.140', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.158', 'weapon5': '0.164', 'WEAPON4': '0.200', 'weapon2': '0.346', 'WEAPON5': '0.350', 'weapon4': '0.722', 'WEAPON3': '1.000', 'weapon3': '2.504', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '49.000'} [2023-02-25 13:24:23,897][36142] DAMAGECOUNT value on done: 166870.0 [2023-02-25 13:24:23,897][36142] Sum rewards: 44.469, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-2.970', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.140', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.290', 'AMMO3': '0.333', 'weapon4': '0.334', 'WEAPON3': '1.850', 'HITCOUNT': '2.860', 'weapon3': '2.912', 'DAMAGECOUNT': '14.277', 'FRAGCOUNT': '45.000'} [2023-02-25 13:24:24,118][36142] DAMAGECOUNT value on done: 163295.0 [2023-02-25 13:24:24,119][36142] Sum rewards: 54.590, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.422', 'AMMO5': '0.015', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.098', 'AMMO3': '0.142', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.280', 'weapon2': '0.586', 'WEAPON3': '0.850', 'weapon3': '2.844', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.145', 'FRAGCOUNT': '43.500'} [2023-02-25 13:24:24,362][36138] Updated weights for policy 0, policy_version 39123 (0.0009) [2023-02-25 13:24:24,431][36142] DAMAGECOUNT value on done: 167463.0 [2023-02-25 13:24:24,431][36142] Sum rewards: 50.109, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.456', 'AMMO5': '0.014', 'AMMO2': '0.053', 'AMMO3': '0.184', 'weapon5': '0.212', 'AMMO4': '0.264', 'WEAPON5': '0.400', 'weapon2': '0.510', 'weapon4': '0.516', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.454', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '14.298', 'FRAGCOUNT': '45.000'} [2023-02-25 13:24:24,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 160251904. Throughput: 0: 3371.2. Samples: 2553886. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:24:24,730][36114] Avg episode reward: [(0, '50.298')] [2023-02-25 13:24:27,348][36138] Updated weights for policy 0, policy_version 39133 (0.0010) [2023-02-25 13:24:29,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 160317440. Throughput: 0: 3373.5. Samples: 2574144. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:24:29,730][36114] Avg episode reward: [(0, '50.298')] [2023-02-25 13:24:30,390][36138] Updated weights for policy 0, policy_version 39143 (0.0009) [2023-02-25 13:24:31,614][36139] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:24:33,444][36138] Updated weights for policy 0, policy_version 39153 (0.0009) [2023-02-25 13:24:34,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 160387072. Throughput: 0: 3370.5. Samples: 2594398. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:24:34,730][36114] Avg episode reward: [(0, '50.298')] [2023-02-25 13:24:36,498][36138] Updated weights for policy 0, policy_version 39163 (0.0010) [2023-02-25 13:24:37,791][36155] DAMAGECOUNT value on done: 166857.0 [2023-02-25 13:24:37,791][36155] Sum rewards: 67.594, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.782', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.094', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.214', 'weapon2': '0.626', 'WEAPON3': '1.050', 'weapon3': '2.886', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '55.000'} [2023-02-25 13:24:38,097][36155] DAMAGECOUNT value on done: 174362.0 [2023-02-25 13:24:38,098][36155] Sum rewards: 44.728, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.110', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'weapon4': '0.280', 'weapon2': '0.590', 'WEAPON3': '0.850', 'HEALTH': '1.029', 'HITCOUNT': '2.590', 'weapon3': '2.828', 'DAMAGECOUNT': '11.787', 'FRAGCOUNT': '36.000'} [2023-02-25 13:24:38,343][36155] DAMAGECOUNT value on done: 170199.0 [2023-02-25 13:24:38,344][36155] Sum rewards: 36.491, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.980', 'ARMOR': '0.004', 'AMMO5': '0.028', 'AMMO2': '0.037', 'AMMO4': '0.183', 'AMMO3': '0.245', 'weapon5': '0.290', 'weapon4': '0.396', 'weapon2': '0.432', 'WEAPON4': '0.450', 'WEAPON5': '0.650', 'WEAPON3': '1.450', 'HITCOUNT': '2.340', 'weapon3': '2.444', 'DAMAGECOUNT': '11.772', 'FRAGCOUNT': '37.000'} [2023-02-25 13:24:38,548][36139] DAMAGECOUNT value on done: 169951.0 [2023-02-25 13:24:38,548][36139] Sum rewards: 54.206, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.585', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.035', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.056', 'weapon5': '0.076', 'AMMO3': '0.209', 'weapon2': '0.370', 'WEAPON3': '1.350', 'HITCOUNT': '3.010', 'weapon3': '3.330', 'DAMAGECOUNT': '13.245', 'FRAGCOUNT': '47.000'} [2023-02-25 13:24:38,645][36155] DAMAGECOUNT value on done: 169062.0 [2023-02-25 13:24:38,646][36155] Sum rewards: 32.641, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.760', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon5': '0.108', 'AMMO4': '0.236', 'AMMO3': '0.242', 'WEAPON5': '0.350', 'weapon2': '0.376', 'weapon4': '0.482', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'HITCOUNT': '2.490', 'weapon3': '2.630', 'DAMAGECOUNT': '11.469', 'FRAGCOUNT': '33.000'} [2023-02-25 13:24:38,842][36139] DAMAGECOUNT value on done: 174280.0 [2023-02-25 13:24:38,843][36139] Sum rewards: 51.794, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.905', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.018', 'AMMO4': '0.092', 'AMMO3': '0.112', 'weapon5': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.226', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'weapon2': '0.768', 'weapon3': '2.554', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '12.051', 'FRAGCOUNT': '41.000'} [2023-02-25 13:24:39,101][36139] DAMAGECOUNT value on done: 171937.0 [2023-02-25 13:24:39,101][36139] Sum rewards: 31.784, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.326', 'AMMO5': '0.019', 'AMMO2': '0.049', 'AMMO3': '0.191', 'AMMO4': '0.243', 'weapon5': '0.244', 'weapon2': '0.382', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.726', 'WEAPON3': '1.100', 'weapon3': '2.278', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '11.388', 'FRAGCOUNT': '29.500'} [2023-02-25 13:24:39,404][36139] DAMAGECOUNT value on done: 170027.0 [2023-02-25 13:24:39,405][36139] Sum rewards: 50.402, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.640', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'weapon4': '0.060', 'AMMO3': '0.211', 'weapon2': '0.740', 'WEAPON3': '1.250', 'HITCOUNT': '2.840', 'weapon3': '3.068', 'DAMAGECOUNT': '12.783', 'FRAGCOUNT': '43.000'} [2023-02-25 13:24:39,544][36138] Updated weights for policy 0, policy_version 39173 (0.0009) [2023-02-25 13:24:39,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 160452608. Throughput: 0: 3370.1. Samples: 2604428. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:24:39,730][36114] Avg episode reward: [(0, '50.066')] [2023-02-25 13:24:40,913][36154] DAMAGECOUNT value on done: 172694.0 [2023-02-25 13:24:40,914][36154] Sum rewards: 40.851, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.064', 'AMMO5': '0.018', 'AMMO2': '0.032', 'weapon5': '0.108', 'AMMO4': '0.159', 'weapon4': '0.176', 'AMMO3': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.604', 'WEAPON3': '1.450', 'HITCOUNT': '2.320', 'weapon3': '2.838', 'DAMAGECOUNT': '11.928', 'FRAGCOUNT': '39.000'} [2023-02-25 13:24:41,222][36154] DAMAGECOUNT value on done: 167081.0 [2023-02-25 13:24:41,223][36154] Sum rewards: 39.337, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.490', 'AMMO5': '0.014', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.119', 'weapon5': '0.208', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.420', 'weapon4': '0.444', 'WEAPON3': '0.750', 'HITCOUNT': '2.370', 'weapon3': '2.706', 'DAMAGECOUNT': '10.674', 'FRAGCOUNT': '32.000'} [2023-02-25 13:24:41,455][36154] DAMAGECOUNT value on done: 170224.0 [2023-02-25 13:24:41,456][36154] Sum rewards: 43.442, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.302', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.102', 'weapon2': '0.140', 'AMMO4': '0.175', 'AMMO3': '0.225', 'weapon4': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.500', 'weapon3': '3.288', 'DAMAGECOUNT': '12.174', 'FRAGCOUNT': '40.000'} [2023-02-25 13:24:41,751][36140] DAMAGECOUNT value on done: 173119.0 [2023-02-25 13:24:41,752][36140] Sum rewards: 52.105, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.040', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.165', 'AMMO3': '0.238', 'weapon5': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.404', 'weapon4': '0.732', 'WEAPON3': '1.350', 'weapon3': '2.234', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.916', 'FRAGCOUNT': '45.000'} [2023-02-25 13:24:41,773][36154] DAMAGECOUNT value on done: 167709.0 [2023-02-25 13:24:41,774][36154] Sum rewards: 43.161, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.740', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon5': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon4': '0.294', 'weapon2': '0.598', 'WEAPON3': '1.200', 'HITCOUNT': '2.440', 'weapon3': '2.718', 'DAMAGECOUNT': '12.165', 'FRAGCOUNT': '39.000'} [2023-02-25 13:24:42,062][36140] DAMAGECOUNT value on done: 170516.0 [2023-02-25 13:24:42,063][36140] Sum rewards: 40.402, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.370', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'AMMO3': '0.159', 'AMMO4': '0.174', 'weapon5': '0.220', 'WEAPON5': '0.500', 'weapon2': '0.568', 'WEAPON4': '0.600', 'weapon4': '0.798', 'WEAPON3': '0.950', 'weapon3': '2.004', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '11.367', 'FRAGCOUNT': '37.000'} [2023-02-25 13:24:42,454][36140] DAMAGECOUNT value on done: 168695.0 [2023-02-25 13:24:42,455][36140] Sum rewards: 49.764, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.670', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.070', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.246', 'weapon2': '0.260', 'weapon4': '0.354', 'WEAPON3': '1.450', 'HITCOUNT': '2.990', 'weapon3': '3.022', 'DAMAGECOUNT': '12.891', 'FRAGCOUNT': '44.000'} [2023-02-25 13:24:42,505][36157] DAMAGECOUNT value on done: 174395.0 [2023-02-25 13:24:42,506][36157] Sum rewards: 55.103, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.594', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.150', 'weapon2': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon4': '0.312', 'WEAPON3': '1.150', 'HITCOUNT': '2.710', 'weapon3': '3.126', 'DAMAGECOUNT': '13.575', 'FRAGCOUNT': '48.000'} [2023-02-25 13:24:42,599][36138] Updated weights for policy 0, policy_version 39183 (0.0010) [2023-02-25 13:24:42,683][36141] DAMAGECOUNT value on done: 174599.0 [2023-02-25 13:24:42,683][36141] Sum rewards: 48.977, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.435', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.048', 'AMMO4': '0.130', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'weapon2': '0.244', 'weapon4': '0.280', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'HITCOUNT': '2.610', 'weapon3': '3.172', 'DAMAGECOUNT': '12.663', 'FRAGCOUNT': '43.000'} [2023-02-25 13:24:42,777][36140] DAMAGECOUNT value on done: 167795.0 [2023-02-25 13:24:42,777][36140] Sum rewards: 54.244, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.674', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.040', 'AMMO3': '0.161', 'AMMO4': '0.201', 'weapon5': '0.274', 'weapon4': '0.424', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon2': '0.750', 'WEAPON3': '1.000', 'weapon3': '2.276', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '15.402', 'FRAGCOUNT': '46.000'} [2023-02-25 13:24:42,814][36157] DAMAGECOUNT value on done: 173729.0 [2023-02-25 13:24:42,815][36157] Sum rewards: 53.388, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.119', 'ARMOR': '0.004', 'AMMO2': '0.019', 'AMMO5': '0.020', 'AMMO4': '0.092', 'weapon2': '0.138', 'weapon5': '0.156', 'AMMO3': '0.211', 'weapon4': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.700', 'weapon3': '3.230', 'DAMAGECOUNT': '14.049', 'FRAGCOUNT': '47.000'} [2023-02-25 13:24:42,910][36156] DAMAGECOUNT value on done: 177526.0 [2023-02-25 13:24:42,910][36156] Sum rewards: 71.236, reward structure: {'DEATHCOUNT': '-10.500', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'weapon4': '0.154', 'AMMO3': '0.160', 'HEALTH': '0.380', 'weapon2': '0.570', 'WEAPON3': '0.950', 'weapon3': '3.050', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '56.000'} [2023-02-25 13:24:43,005][36141] DAMAGECOUNT value on done: 169864.0 [2023-02-25 13:24:43,006][36141] Sum rewards: 36.671, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.390', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.032', 'weapon5': '0.038', 'AMMO4': '0.158', 'AMMO3': '0.175', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.638', 'weapon2': '0.734', 'WEAPON3': '1.100', 'HITCOUNT': '2.310', 'weapon3': '2.396', 'DAMAGECOUNT': '9.810', 'FRAGCOUNT': '33.000'} [2023-02-25 13:24:43,035][36141] DAMAGECOUNT value on done: 172486.0 [2023-02-25 13:24:43,036][36141] Sum rewards: 42.972, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.030', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.045', 'AMMO3': '0.123', 'AMMO4': '0.225', 'weapon5': '0.310', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.516', 'weapon4': '0.756', 'WEAPON3': '0.800', 'weapon3': '2.066', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '12.327', 'FRAGCOUNT': '37.000'} [2023-02-25 13:24:43,144][36157] DAMAGECOUNT value on done: 175979.0 [2023-02-25 13:24:43,144][36157] Sum rewards: 73.631, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.700', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.082', 'weapon2': '0.180', 'AMMO4': '0.193', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'weapon4': '0.314', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.172', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.936', 'FRAGCOUNT': '63.000'} [2023-02-25 13:24:43,228][36156] DAMAGECOUNT value on done: 173182.0 [2023-02-25 13:24:43,229][36156] Sum rewards: 50.624, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.230', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.156', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon4': '0.256', 'WEAPON5': '0.300', 'weapon2': '0.576', 'WEAPON3': '1.100', 'HITCOUNT': '2.630', 'weapon3': '2.736', 'DAMAGECOUNT': '12.546', 'FRAGCOUNT': '43.000'} [2023-02-25 13:24:43,238][36156] DAMAGECOUNT value on done: 171821.0 [2023-02-25 13:24:43,239][36156] Sum rewards: 39.506, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.408', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.192', 'AMMO3': '0.199', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.434', 'weapon4': '0.806', 'WEAPON3': '1.200', 'weapon3': '2.130', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '11.064', 'FRAGCOUNT': '36.000'} [2023-02-25 13:24:43,351][36141] DAMAGECOUNT value on done: 165672.0 [2023-02-25 13:24:43,351][36141] Sum rewards: 53.564, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.712', 'AMMO2': '0.009', 'AMMO5': '0.022', 'AMMO4': '0.046', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'weapon5': '0.236', 'weapon4': '0.338', 'WEAPON5': '0.400', 'weapon2': '0.440', 'WEAPON3': '1.050', 'weapon3': '2.742', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.764', 'FRAGCOUNT': '45.000'} [2023-02-25 13:24:43,459][36157] DAMAGECOUNT value on done: 175638.0 [2023-02-25 13:24:43,460][36157] Sum rewards: 56.037, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.789', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.035', 'AMMO3': '0.122', 'AMMO4': '0.174', 'weapon5': '0.312', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.642', 'WEAPON3': '0.700', 'weapon2': '0.802', 'weapon3': '1.878', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.782', 'FRAGCOUNT': '46.000'} [2023-02-25 13:24:43,550][36156] DAMAGECOUNT value on done: 169796.0 [2023-02-25 13:24:43,551][36156] Sum rewards: 47.816, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.003', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon7': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.142', 'AMMO4': '0.166', 'AMMO3': '0.196', 'WEAPON7': '0.200', 'weapon2': '0.282', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.604', 'WEAPON3': '1.200', 'HITCOUNT': '2.530', 'weapon3': '2.548', 'DAMAGECOUNT': '12.753', 'FRAGCOUNT': '44.000'} [2023-02-25 13:24:43,639][36142] DAMAGECOUNT value on done: 167247.0 [2023-02-25 13:24:43,639][36142] Sum rewards: 59.317, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.017', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.142', 'AMMO3': '0.196', 'weapon2': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.462', 'WEAPON3': '1.250', 'weapon3': '2.886', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '15.099', 'FRAGCOUNT': '51.000'} [2023-02-25 13:24:43,949][36142] DAMAGECOUNT value on done: 171871.0 [2023-02-25 13:24:43,949][36142] Sum rewards: 54.168, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.456', 'ARMOR': '0.004', 'AMMO2': '0.013', 'AMMO5': '0.018', 'AMMO4': '0.066', 'weapon5': '0.218', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon2': '0.282', 'weapon4': '0.448', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.670', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '15.003', 'FRAGCOUNT': '47.000'} [2023-02-25 13:24:44,134][36142] DAMAGECOUNT value on done: 168159.0 [2023-02-25 13:24:44,134][36142] Sum rewards: 61.757, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.436', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO3': '0.105', 'AMMO4': '0.164', 'WEAPON4': '0.250', 'weapon5': '0.294', 'WEAPON5': '0.300', 'weapon4': '0.362', 'WEAPON3': '0.700', 'weapon2': '0.884', 'weapon3': '2.116', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.592', 'FRAGCOUNT': '49.000'} [2023-02-25 13:24:44,439][36142] DAMAGECOUNT value on done: 172401.0 [2023-02-25 13:24:44,440][36142] Sum rewards: 58.369, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.647', 'AMMO5': '0.004', 'ARMOR': '0.004', 'AMMO2': '0.012', 'weapon5': '0.052', 'AMMO4': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon4': '0.254', 'weapon2': '0.382', 'WEAPON3': '1.100', 'weapon3': '3.096', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.814', 'FRAGCOUNT': '49.000'} [2023-02-25 13:24:44,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 160518144. Throughput: 0: 3368.5. Samples: 2624554. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:24:44,729][36114] Avg episode reward: [(0, '50.746')] [2023-02-25 13:24:45,622][36138] Updated weights for policy 0, policy_version 39193 (0.0009) [2023-02-25 13:24:48,631][36138] Updated weights for policy 0, policy_version 39203 (0.0009) [2023-02-25 13:24:49,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 160587776. Throughput: 0: 3367.2. Samples: 2644764. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:24:49,729][36114] Avg episode reward: [(0, '50.746')] [2023-02-25 13:24:51,718][36138] Updated weights for policy 0, policy_version 39213 (0.0009) [2023-02-25 13:24:54,729][36114] Fps is (10 sec: 13516.5, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 160653312. Throughput: 0: 3363.1. Samples: 2654780. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:24:54,730][36114] Avg episode reward: [(0, '50.746')] [2023-02-25 13:24:54,779][36138] Updated weights for policy 0, policy_version 39223 (0.0009) [2023-02-25 13:24:57,693][36155] DAMAGECOUNT value on done: 171949.0 [2023-02-25 13:24:57,694][36155] Sum rewards: 51.860, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.690', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon2': '0.168', 'AMMO4': '0.172', 'weapon5': '0.180', 'AMMO3': '0.250', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.662', 'WEAPON3': '1.500', 'weapon3': '2.606', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '15.231', 'FRAGCOUNT': '46.000'} [2023-02-25 13:24:57,856][36138] Updated weights for policy 0, policy_version 39233 (0.0009) [2023-02-25 13:24:58,009][36155] DAMAGECOUNT value on done: 179051.0 [2023-02-25 13:24:58,010][36155] Sum rewards: 59.576, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.848', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon4': '0.066', 'weapon5': '0.074', 'AMMO4': '0.171', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.506', 'WEAPON3': '1.250', 'HITCOUNT': '3.000', 'weapon3': '3.158', 'DAMAGECOUNT': '14.067', 'FRAGCOUNT': '51.500'} [2023-02-25 13:24:58,257][36155] DAMAGECOUNT value on done: 175000.0 [2023-02-25 13:24:58,257][36155] Sum rewards: 51.970, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.668', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.122', 'weapon2': '0.192', 'AMMO4': '0.197', 'AMMO3': '0.250', 'weapon4': '0.326', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '2.910', 'weapon3': '3.034', 'DAMAGECOUNT': '14.403', 'FRAGCOUNT': '49.000'} [2023-02-25 13:24:58,457][36139] DAMAGECOUNT value on done: 174278.0 [2023-02-25 13:24:58,457][36139] Sum rewards: 44.162, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.224', 'WEAPON1': '0.010', 'AMMO5': '0.026', 'AMMO2': '0.052', 'AMMO3': '0.152', 'weapon5': '0.230', 'AMMO4': '0.260', 'weapon2': '0.484', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'weapon4': '0.622', 'WEAPON3': '0.850', 'weapon3': '2.118', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '12.981', 'FRAGCOUNT': '38.000'} [2023-02-25 13:24:58,564][36155] DAMAGECOUNT value on done: 172874.0 [2023-02-25 13:24:58,564][36155] Sum rewards: 40.987, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.006', 'AMMO5': '0.014', 'AMMO2': '0.038', 'AMMO3': '0.158', 'AMMO4': '0.190', 'weapon5': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.502', 'weapon2': '0.746', 'WEAPON3': '0.900', 'weapon3': '2.254', 'HITCOUNT': '2.310', 'DAMAGECOUNT': '11.436', 'FRAGCOUNT': '36.000'} [2023-02-25 13:24:58,775][36139] DAMAGECOUNT value on done: 178607.0 [2023-02-25 13:24:58,775][36139] Sum rewards: 57.079, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.134', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.044', 'weapon5': '0.074', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'WEAPON5': '0.200', 'weapon4': '0.474', 'weapon2': '0.476', 'WEAPON3': '1.000', 'weapon3': '2.804', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '12.981', 'FRAGCOUNT': '48.000'} [2023-02-25 13:24:59,039][36139] DAMAGECOUNT value on done: 177292.0 [2023-02-25 13:24:59,039][36139] Sum rewards: 63.200, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.425', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.007', 'weapon5': '0.010', 'weapon2': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.240', 'WEAPON3': '1.500', 'HITCOUNT': '3.390', 'weapon3': '3.646', 'DAMAGECOUNT': '16.065', 'FRAGCOUNT': '54.000'} [2023-02-25 13:24:59,343][36139] DAMAGECOUNT value on done: 174717.0 [2023-02-25 13:24:59,343][36139] Sum rewards: 60.493, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.200', 'AMMO2': '0.004', 'ARMOR': '0.004', 'AMMO5': '0.017', 'weapon4': '0.018', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'weapon5': '0.072', 'AMMO3': '0.140', 'WEAPON5': '0.350', 'weapon2': '0.776', 'WEAPON3': '0.850', 'weapon3': '2.982', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.070', 'FRAGCOUNT': '48.000'} [2023-02-25 13:24:59,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 160722944. Throughput: 0: 3357.1. Samples: 2674808. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:24:59,730][36114] Avg episode reward: [(0, '50.954')] [2023-02-25 13:25:00,920][36138] Updated weights for policy 0, policy_version 39243 (0.0009) [2023-02-25 13:25:01,090][36154] DAMAGECOUNT value on done: 177930.0 [2023-02-25 13:25:01,090][36154] Sum rewards: 67.036, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.448', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon4': '0.124', 'AMMO3': '0.158', 'weapon5': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.438', 'WEAPON3': '0.900', 'HITCOUNT': '2.930', 'weapon3': '2.942', 'DAMAGECOUNT': '15.708', 'FRAGCOUNT': '56.000'} [2023-02-25 13:25:01,397][36154] DAMAGECOUNT value on done: 171311.0 [2023-02-25 13:25:01,398][36154] Sum rewards: 40.883, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.628', 'AMMO5': '0.022', 'AMMO2': '0.049', 'AMMO3': '0.216', 'weapon5': '0.238', 'AMMO4': '0.245', 'weapon2': '0.336', 'weapon4': '0.394', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '2.390', 'weapon3': '2.630', 'DAMAGECOUNT': '12.690', 'FRAGCOUNT': '37.000'} [2023-02-25 13:25:01,633][36154] DAMAGECOUNT value on done: 174423.0 [2023-02-25 13:25:01,634][36154] Sum rewards: 45.383, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.994', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.043', 'AMMO3': '0.148', 'weapon2': '0.202', 'AMMO4': '0.216', 'weapon5': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.892', 'WEAPON3': '0.900', 'weapon3': '2.174', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '12.597', 'FRAGCOUNT': '39.000'} [2023-02-25 13:25:01,940][36154] DAMAGECOUNT value on done: 173297.0 [2023-02-25 13:25:01,940][36154] Sum rewards: 67.131, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.250', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.018', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO3': '0.236', 'weapon2': '0.394', 'WEAPON3': '1.500', 'weapon3': '3.262', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '58.000'} [2023-02-25 13:25:01,990][36140] DAMAGECOUNT value on done: 177880.0 [2023-02-25 13:25:01,990][36140] Sum rewards: 56.185, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.490', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.070', 'AMMO4': '0.073', 'weapon4': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'weapon2': '0.296', 'WEAPON3': '1.500', 'HITCOUNT': '3.140', 'weapon3': '3.270', 'DAMAGECOUNT': '14.283', 'FRAGCOUNT': '51.000'} [2023-02-25 13:25:02,305][36140] DAMAGECOUNT value on done: 175217.0 [2023-02-25 13:25:02,306][36140] Sum rewards: 55.098, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.455', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.046', 'AMMO3': '0.154', 'weapon2': '0.212', 'AMMO4': '0.230', 'weapon5': '0.258', 'weapon4': '0.488', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.786', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.103', 'FRAGCOUNT': '47.500'} [2023-02-25 13:25:02,616][36157] DAMAGECOUNT value on done: 179569.0 [2023-02-25 13:25:02,616][36157] Sum rewards: 63.633, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.700', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon4': '0.270', 'weapon2': '0.526', 'WEAPON3': '1.200', 'weapon3': '2.944', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.522', 'FRAGCOUNT': '53.000'} [2023-02-25 13:25:02,619][36141] DAMAGECOUNT value on done: 178776.0 [2023-02-25 13:25:02,620][36141] Sum rewards: 47.012, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.885', 'AMMO5': '0.017', 'AMMO2': '0.033', 'AMMO3': '0.151', 'AMMO4': '0.165', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon5': '0.402', 'weapon2': '0.556', 'weapon4': '0.588', 'WEAPON3': '0.950', 'weapon3': '2.174', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.531', 'FRAGCOUNT': '39.000'} [2023-02-25 13:25:02,781][36140] DAMAGECOUNT value on done: 173694.0 [2023-02-25 13:25:02,782][36140] Sum rewards: 57.033, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.577', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.164', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.354', 'weapon4': '0.414', 'WEAPON3': '1.300', 'weapon3': '2.776', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.997', 'FRAGCOUNT': '49.000'} [2023-02-25 13:25:02,893][36156] DAMAGECOUNT value on done: 181256.0 [2023-02-25 13:25:02,894][36156] Sum rewards: 45.745, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.441', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO3': '0.104', 'AMMO4': '0.125', 'weapon5': '0.184', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.420', 'weapon2': '0.564', 'WEAPON3': '0.700', 'weapon3': '2.482', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '11.190', 'FRAGCOUNT': '38.000'} [2023-02-25 13:25:02,939][36157] DAMAGECOUNT value on done: 178776.0 [2023-02-25 13:25:02,940][36157] Sum rewards: 60.351, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.430', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'AMMO3': '0.273', 'weapon4': '0.302', 'weapon2': '0.340', 'WEAPON3': '1.650', 'weapon3': '2.970', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.141', 'FRAGCOUNT': '54.000'} [2023-02-25 13:25:02,955][36141] DAMAGECOUNT value on done: 174138.0 [2023-02-25 13:25:02,956][36141] Sum rewards: 45.652, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.902', 'AMMO5': '0.015', 'AMMO2': '0.049', 'AMMO3': '0.167', 'weapon5': '0.210', 'AMMO4': '0.243', 'WEAPON5': '0.400', 'weapon2': '0.490', 'weapon4': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '0.950', 'weapon3': '2.328', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.822', 'FRAGCOUNT': '41.000'} [2023-02-25 13:25:03,077][36141] DAMAGECOUNT value on done: 177791.0 [2023-02-25 13:25:03,077][36141] Sum rewards: 58.919, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.190', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.116', 'AMMO4': '0.154', 'weapon5': '0.160', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.450', 'HITCOUNT': '3.050', 'weapon3': '3.092', 'DAMAGECOUNT': '15.915', 'FRAGCOUNT': '52.500'} [2023-02-25 13:25:03,116][36140] DAMAGECOUNT value on done: 172316.0 [2023-02-25 13:25:03,117][36140] Sum rewards: 53.533, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.960', 'AMMO5': '0.018', 'AMMO2': '0.034', 'weapon4': '0.170', 'AMMO4': '0.172', 'AMMO3': '0.245', 'weapon5': '0.346', 'weapon2': '0.374', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'HITCOUNT': '2.640', 'weapon3': '2.760', 'DAMAGECOUNT': '13.083', 'FRAGCOUNT': '51.000'} [2023-02-25 13:25:03,226][36156] DAMAGECOUNT value on done: 177576.0 [2023-02-25 13:25:03,226][36156] Sum rewards: 51.016, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.318', 'ARMOR': '0.004', 'AMMO5': '0.028', 'AMMO2': '0.032', 'AMMO3': '0.146', 'AMMO4': '0.161', 'weapon5': '0.224', 'weapon2': '0.254', 'weapon4': '0.352', 'WEAPON4': '0.450', 'WEAPON5': '0.700', 'WEAPON3': '1.000', 'HITCOUNT': '2.700', 'weapon3': '2.850', 'DAMAGECOUNT': '13.182', 'FRAGCOUNT': '44.000'} [2023-02-25 13:25:03,237][36156] DAMAGECOUNT value on done: 176158.0 [2023-02-25 13:25:03,237][36156] Sum rewards: 44.905, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.920', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.056', 'AMMO3': '0.149', 'weapon5': '0.268', 'AMMO4': '0.279', 'weapon2': '0.510', 'WEAPON5': '0.550', 'weapon4': '0.560', 'WEAPON4': '0.600', 'WEAPON3': '0.850', 'weapon3': '2.324', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '13.011', 'FRAGCOUNT': '40.000'} [2023-02-25 13:25:03,280][36157] DAMAGECOUNT value on done: 180650.0 [2023-02-25 13:25:03,281][36157] Sum rewards: 53.379, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.594', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.155', 'AMMO4': '0.189', 'WEAPON4': '0.200', 'weapon2': '0.228', 'WEAPON5': '0.250', 'weapon5': '0.304', 'WEAPON3': '0.850', 'weapon4': '0.976', 'weapon3': '1.994', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '14.013', 'FRAGCOUNT': '42.500'} [2023-02-25 13:25:03,392][36141] DAMAGECOUNT value on done: 169347.0 [2023-02-25 13:25:03,393][36141] Sum rewards: 39.606, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.650', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.080', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'weapon4': '0.198', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'weapon2': '0.242', 'WEAPON3': '1.400', 'HITCOUNT': '2.390', 'weapon3': '3.290', 'DAMAGECOUNT': '11.025', 'FRAGCOUNT': '38.000'} [2023-02-25 13:25:03,546][36156] DAMAGECOUNT value on done: 175100.0 [2023-02-25 13:25:03,547][36156] Sum rewards: 59.815, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.232', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon5': '0.090', 'weapon4': '0.104', 'AMMO4': '0.141', 'weapon2': '0.214', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.130', 'weapon3': '3.346', 'DAMAGECOUNT': '15.912', 'FRAGCOUNT': '51.000'} [2023-02-25 13:25:03,577][36157] DAMAGECOUNT value on done: 180631.0 [2023-02-25 13:25:03,577][36157] Sum rewards: 57.943, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.990', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon4': '0.060', 'AMMO4': '0.143', 'AMMO3': '0.169', 'weapon5': '0.226', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.880', 'weapon3': '2.908', 'DAMAGECOUNT': '14.979', 'FRAGCOUNT': '50.000'} [2023-02-25 13:25:03,743][36142] DAMAGECOUNT value on done: 171192.0 [2023-02-25 13:25:03,744][36142] Sum rewards: 43.818, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.050', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.024', 'AMMO3': '0.117', 'AMMO4': '0.122', 'weapon5': '0.166', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.528', 'weapon4': '0.624', 'WEAPON3': '0.800', 'weapon3': '2.234', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '11.835', 'FRAGCOUNT': '38.000'} [2023-02-25 13:25:03,979][36138] Updated weights for policy 0, policy_version 39253 (0.0009) [2023-02-25 13:25:04,062][36142] DAMAGECOUNT value on done: 176693.0 [2023-02-25 13:25:04,062][36142] Sum rewards: 58.321, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.502', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.027', 'weapon4': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.120', 'AMMO4': '0.133', 'AMMO3': '0.152', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.270', 'WEAPON5': '0.400', 'weapon2': '0.520', 'WEAPON3': '1.000', 'HITCOUNT': '2.620', 'weapon3': '2.728', 'DAMAGECOUNT': '14.316', 'FRAGCOUNT': '48.000'} [2023-02-25 13:25:04,222][36142] DAMAGECOUNT value on done: 172062.0 [2023-02-25 13:25:04,222][36142] Sum rewards: 49.529, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.280', 'AMMO5': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.084', 'AMMO3': '0.119', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.470', 'weapon2': '0.692', 'WEAPON3': '0.850', 'weapon3': '2.584', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '11.709', 'FRAGCOUNT': '41.000'} [2023-02-25 13:25:04,537][36142] DAMAGECOUNT value on done: 177073.0 [2023-02-25 13:25:04,538][36142] Sum rewards: 60.129, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.333', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.030', 'AMMO4': '0.043', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'weapon2': '0.684', 'WEAPON3': '1.000', 'HITCOUNT': '2.910', 'weapon3': '3.038', 'DAMAGECOUNT': '14.016', 'FRAGCOUNT': '49.000'} [2023-02-25 13:25:04,729][36114] Fps is (10 sec: 13517.2, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 160788480. Throughput: 0: 3358.2. Samples: 2694864. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:25:04,729][36114] Avg episode reward: [(0, '51.551')] [2023-02-25 13:25:04,730][36125] Saving new best policy, reward=51.551! [2023-02-25 13:25:05,847][36156] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 13:25:07,005][36138] Updated weights for policy 0, policy_version 39263 (0.0009) [2023-02-25 13:25:09,729][36114] Fps is (10 sec: 13107.4, 60 sec: 13380.3, 300 sec: 13482.1). Total num frames: 160854016. Throughput: 0: 3360.4. Samples: 2705104. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:25:09,729][36114] Avg episode reward: [(0, '51.551')] [2023-02-25 13:25:10,043][36138] Updated weights for policy 0, policy_version 39273 (0.0008) [2023-02-25 13:25:13,030][36138] Updated weights for policy 0, policy_version 39283 (0.0009) [2023-02-25 13:25:14,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 160923648. Throughput: 0: 3361.2. Samples: 2725398. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:25:14,730][36114] Avg episode reward: [(0, '51.551')] [2023-02-25 13:25:16,034][36138] Updated weights for policy 0, policy_version 39293 (0.0010) [2023-02-25 13:25:17,567][36155] DAMAGECOUNT value on done: 176079.0 [2023-02-25 13:25:17,568][36155] Sum rewards: 39.347, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.880', 'AMMO5': '0.031', 'AMMO2': '0.057', 'AMMO3': '0.136', 'AMMO4': '0.286', 'weapon2': '0.380', 'weapon5': '0.384', 'weapon4': '0.598', 'WEAPON4': '0.750', 'WEAPON5': '0.800', 'WEAPON3': '0.900', 'weapon3': '2.274', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '12.390', 'FRAGCOUNT': '36.000'} [2023-02-25 13:25:17,568][36141] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 13:25:17,885][36155] DAMAGECOUNT value on done: 182247.0 [2023-02-25 13:25:17,885][36155] Sum rewards: 32.720, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.490', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'weapon4': '0.434', 'weapon2': '0.886', 'WEAPON3': '1.250', 'HITCOUNT': '2.130', 'weapon3': '2.274', 'DAMAGECOUNT': '9.588', 'FRAGCOUNT': '32.000'} [2023-02-25 13:25:18,171][36155] DAMAGECOUNT value on done: 178901.0 [2023-02-25 13:25:18,172][36155] Sum rewards: 44.149, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-4.045', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.094', 'AMMO3': '0.184', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.624', 'weapon2': '0.634', 'WEAPON3': '1.200', 'weapon3': '2.394', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '11.703', 'FRAGCOUNT': '40.000'} [2023-02-25 13:25:18,271][36139] DAMAGECOUNT value on done: 178926.0 [2023-02-25 13:25:18,272][36139] Sum rewards: 53.910, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.280', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.164', 'AMMO3': '0.180', 'weapon2': '0.344', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.572', 'WEAPON3': '1.250', 'weapon3': '2.630', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.944', 'FRAGCOUNT': '48.000'} [2023-02-25 13:25:18,485][36155] DAMAGECOUNT value on done: 177511.0 [2023-02-25 13:25:18,485][36155] Sum rewards: 54.956, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.397', 'ARMOR': '0.004', 'AMMO5': '0.027', 'AMMO2': '0.047', 'AMMO3': '0.190', 'AMMO4': '0.237', 'weapon5': '0.254', 'weapon2': '0.354', 'WEAPON4': '0.500', 'WEAPON5': '0.650', 'weapon4': '0.652', 'WEAPON3': '1.200', 'weapon3': '2.376', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.911', 'FRAGCOUNT': '49.000'} [2023-02-25 13:25:18,580][36139] DAMAGECOUNT value on done: 183445.0 [2023-02-25 13:25:18,580][36139] Sum rewards: 55.398, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.900', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.035', 'AMMO3': '0.163', 'weapon2': '0.174', 'AMMO4': '0.175', 'weapon5': '0.176', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.712', 'WEAPON3': '1.050', 'weapon3': '2.604', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.514', 'FRAGCOUNT': '47.000'} [2023-02-25 13:25:18,862][36139] DAMAGECOUNT value on done: 181726.0 [2023-02-25 13:25:18,863][36139] Sum rewards: 47.320, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.650', 'AMMO5': '0.017', 'AMMO2': '0.030', 'AMMO4': '0.147', 'weapon5': '0.172', 'AMMO3': '0.240', 'weapon2': '0.290', 'WEAPON4': '0.300', 'weapon4': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '2.820', 'weapon3': '2.902', 'DAMAGECOUNT': '13.302', 'FRAGCOUNT': '44.000'} [2023-02-25 13:25:19,071][36138] Updated weights for policy 0, policy_version 39303 (0.0009) [2023-02-25 13:25:19,179][36139] DAMAGECOUNT value on done: 178979.0 [2023-02-25 13:25:19,179][36139] Sum rewards: 51.262, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.955', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.222', 'weapon2': '0.412', 'weapon4': '0.538', 'WEAPON3': '0.950', 'weapon3': '2.584', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '12.786', 'FRAGCOUNT': '42.000'} [2023-02-25 13:25:19,729][36114] Fps is (10 sec: 13926.3, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 160993280. Throughput: 0: 3361.7. Samples: 2745676. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:25:19,730][36114] Avg episode reward: [(0, '51.205')] [2023-02-25 13:25:19,733][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000039305_160993280.pth... [2023-02-25 13:25:19,799][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000038515_157757440.pth [2023-02-25 13:25:21,032][36154] DAMAGECOUNT value on done: 182310.0 [2023-02-25 13:25:21,032][36154] Sum rewards: 50.857, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.967', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.020', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'weapon2': '0.162', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon4': '0.772', 'WEAPON3': '1.200', 'weapon3': '2.686', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.140', 'FRAGCOUNT': '45.000'} [2023-02-25 13:25:21,363][36154] DAMAGECOUNT value on done: 176726.0 [2023-02-25 13:25:21,363][36154] Sum rewards: 64.120, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.630', 'AMMO2': '0.011', 'AMMO5': '0.015', 'AMMO4': '0.056', 'AMMO3': '0.183', 'weapon4': '0.214', 'weapon5': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'weapon2': '0.738', 'WEAPON3': '1.100', 'weapon3': '2.552', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '54.000'} [2023-02-25 13:25:21,597][36154] DAMAGECOUNT value on done: 179735.0 [2023-02-25 13:25:21,597][36154] Sum rewards: 59.833, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.617', 'AMMO5': '0.017', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon5': '0.186', 'AMMO3': '0.193', 'weapon2': '0.234', 'weapon4': '0.266', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.998', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.936', 'FRAGCOUNT': '52.000'} [2023-02-25 13:25:21,904][36154] DAMAGECOUNT value on done: 177577.0 [2023-02-25 13:25:21,905][36154] Sum rewards: 56.102, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.790', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.070', 'weapon4': '0.122', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'weapon2': '0.348', 'WEAPON3': '1.100', 'HITCOUNT': '2.730', 'weapon3': '3.256', 'DAMAGECOUNT': '12.840', 'FRAGCOUNT': '48.000'} [2023-02-25 13:25:21,979][36140] DAMAGECOUNT value on done: 182535.0 [2023-02-25 13:25:21,979][36140] Sum rewards: 57.030, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.440', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO4': '0.138', 'AMMO3': '0.166', 'weapon5': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.504', 'weapon2': '0.568', 'WEAPON3': '1.100', 'weapon3': '2.402', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '13.965', 'FRAGCOUNT': '49.000'} [2023-02-25 13:25:22,147][36138] Updated weights for policy 0, policy_version 39313 (0.0009) [2023-02-25 13:25:22,280][36140] DAMAGECOUNT value on done: 180424.0 [2023-02-25 13:25:22,281][36140] Sum rewards: 54.835, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.235', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.148', 'WEAPON4': '0.200', 'AMMO3': '0.244', 'WEAPON5': '0.300', 'weapon2': '0.300', 'weapon4': '0.342', 'WEAPON3': '1.550', 'weapon3': '2.948', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.621', 'FRAGCOUNT': '49.000'} [2023-02-25 13:25:22,482][36141] DAMAGECOUNT value on done: 183210.0 [2023-02-25 13:25:22,482][36141] Sum rewards: 53.118, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.930', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.044', 'AMMO3': '0.128', 'weapon5': '0.174', 'weapon2': '0.176', 'AMMO4': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.692', 'WEAPON3': '0.900', 'weapon3': '2.674', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.302', 'FRAGCOUNT': '44.500'} [2023-02-25 13:25:22,546][36157] DAMAGECOUNT value on done: 183137.0 [2023-02-25 13:25:22,546][36157] Sum rewards: 35.275, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.750', 'AMMO5': '0.019', 'AMMO2': '0.026', 'WEAPON1': '0.040', 'AMMO4': '0.131', 'AMMO3': '0.182', 'weapon5': '0.182', 'weapon2': '0.264', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon4': '0.582', 'WEAPON3': '1.100', 'weapon3': '2.334', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '10.704', 'FRAGCOUNT': '32.500'} [2023-02-25 13:25:22,739][36140] DAMAGECOUNT value on done: 178593.0 [2023-02-25 13:25:22,739][36140] Sum rewards: 51.990, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.736', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.174', 'weapon4': '0.192', 'weapon2': '0.214', 'WEAPON4': '0.250', 'AMMO3': '0.286', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'HITCOUNT': '2.810', 'weapon3': '3.074', 'DAMAGECOUNT': '14.652', 'FRAGCOUNT': '49.000'} [2023-02-25 13:25:22,796][36141] DAMAGECOUNT value on done: 178676.0 [2023-02-25 13:25:22,797][36141] Sum rewards: 56.517, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.095', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.007', 'weapon5': '0.116', 'weapon2': '0.138', 'AMMO3': '0.142', 'WEAPON5': '0.150', 'WEAPON3': '1.100', 'HITCOUNT': '2.760', 'weapon3': '3.586', 'DAMAGECOUNT': '13.614', 'FRAGCOUNT': '46.000'} [2023-02-25 13:25:22,819][36156] DAMAGECOUNT value on done: 185534.0 [2023-02-25 13:25:22,819][36156] Sum rewards: 60.302, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.377', 'ARMOR': '0.008', 'AMMO5': '0.024', 'AMMO2': '0.035', 'AMMO3': '0.113', 'weapon5': '0.174', 'AMMO4': '0.176', 'WEAPON4': '0.300', 'weapon2': '0.456', 'weapon4': '0.480', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'weapon3': '2.648', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '12.834', 'FRAGCOUNT': '49.000'} [2023-02-25 13:25:22,864][36157] DAMAGECOUNT value on done: 182615.0 [2023-02-25 13:25:22,864][36157] Sum rewards: 44.909, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.390', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon4': '0.016', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.165', 'weapon2': '0.894', 'WEAPON3': '1.050', 'HITCOUNT': '2.270', 'weapon3': '2.856', 'DAMAGECOUNT': '11.517', 'FRAGCOUNT': '37.000'} [2023-02-25 13:25:22,906][36141] DAMAGECOUNT value on done: 180933.0 [2023-02-25 13:25:22,906][36141] Sum rewards: 32.857, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.644', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.067', 'weapon5': '0.070', 'weapon4': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.544', 'WEAPON3': '1.150', 'HITCOUNT': '2.060', 'weapon3': '3.024', 'DAMAGECOUNT': '9.426', 'FRAGCOUNT': '29.500'} [2023-02-25 13:25:23,041][36140] DAMAGECOUNT value on done: 177342.0 [2023-02-25 13:25:23,041][36140] Sum rewards: 50.928, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.460', 'AMMO5': '0.020', 'AMMO2': '0.067', 'AMMO3': '0.184', 'weapon5': '0.240', 'weapon2': '0.278', 'AMMO4': '0.337', 'weapon4': '0.370', 'WEAPON5': '0.600', 'WEAPON4': '0.750', 'WEAPON3': '1.100', 'weapon3': '2.764', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '15.078', 'FRAGCOUNT': '46.000'} [2023-02-25 13:25:23,121][36156] DAMAGECOUNT value on done: 182384.0 [2023-02-25 13:25:23,122][36156] Sum rewards: 54.691, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.160', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'WEAPON4': '0.350', 'weapon2': '0.400', 'weapon4': '0.702', 'WEAPON3': '1.350', 'weapon3': '2.446', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.406', 'FRAGCOUNT': '50.000'} [2023-02-25 13:25:23,131][36156] DAMAGECOUNT value on done: 180664.0 [2023-02-25 13:25:23,132][36156] Sum rewards: 52.520, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.615', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.046', 'weapon4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.207', 'weapon2': '0.382', 'WEAPON3': '1.300', 'HITCOUNT': '3.020', 'weapon3': '3.316', 'DAMAGECOUNT': '13.518', 'FRAGCOUNT': '45.000'} [2023-02-25 13:25:23,173][36157] DAMAGECOUNT value on done: 184188.0 [2023-02-25 13:25:23,174][36157] Sum rewards: 40.988, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.425', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.019', 'AMMO4': '0.094', 'AMMO3': '0.107', 'weapon5': '0.162', 'weapon2': '0.186', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '0.550', 'weapon4': '1.156', 'weapon3': '2.036', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '10.614', 'FRAGCOUNT': '33.000'} [2023-02-25 13:25:23,218][36141] DAMAGECOUNT value on done: 174147.0 [2023-02-25 13:25:23,218][36141] Sum rewards: 55.971, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.840', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'weapon5': '0.006', 'AMMO5': '0.010', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'weapon2': '0.550', 'WEAPON3': '1.400', 'HITCOUNT': '3.110', 'weapon3': '3.310', 'DAMAGECOUNT': '14.400', 'FRAGCOUNT': '47.000'} [2023-02-25 13:25:23,440][36156] DAMAGECOUNT value on done: 179999.0 [2023-02-25 13:25:23,440][36156] Sum rewards: 55.534, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.580', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.194', 'weapon4': '0.228', 'WEAPON4': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.250', 'weapon3': '3.138', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.697', 'FRAGCOUNT': '48.500'} [2023-02-25 13:25:23,477][36157] DAMAGECOUNT value on done: 184277.0 [2023-02-25 13:25:23,478][36157] Sum rewards: 40.555, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.040', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.046', 'AMMO3': '0.088', 'AMMO4': '0.232', 'weapon2': '0.404', 'weapon5': '0.438', 'WEAPON3': '0.600', 'WEAPON5': '0.600', 'WEAPON4': '0.750', 'weapon4': '1.078', 'weapon3': '1.692', 'HITCOUNT': '2.200', 'DAMAGECOUNT': '10.938', 'FRAGCOUNT': '34.000'} [2023-02-25 13:25:23,768][36142] DAMAGECOUNT value on done: 175813.0 [2023-02-25 13:25:23,768][36142] Sum rewards: 57.032, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.265', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon5': '0.046', 'AMMO4': '0.068', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.340', 'weapon4': '0.348', 'WEAPON3': '1.150', 'weapon3': '3.114', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '13.863', 'FRAGCOUNT': '48.000'} [2023-02-25 13:25:24,071][36142] DAMAGECOUNT value on done: 180145.0 [2023-02-25 13:25:24,072][36142] Sum rewards: 32.034, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.757', 'AMMO2': '0.003', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.012', 'weapon5': '0.022', 'weapon4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.253', 'weapon2': '1.062', 'WEAPON3': '1.450', 'HITCOUNT': '2.320', 'weapon3': '2.622', 'DAMAGECOUNT': '10.356', 'FRAGCOUNT': '32.000'} [2023-02-25 13:25:24,253][36142] DAMAGECOUNT value on done: 176844.0 [2023-02-25 13:25:24,253][36142] Sum rewards: 56.818, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.635', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.025', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'weapon2': '0.396', 'weapon4': '0.570', 'WEAPON3': '1.050', 'weapon3': '2.742', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '14.346', 'FRAGCOUNT': '47.000'} [2023-02-25 13:25:24,557][36142] DAMAGECOUNT value on done: 181690.0 [2023-02-25 13:25:24,558][36142] Sum rewards: 51.714, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.900', 'AMMO2': '0.004', 'weapon5': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'weapon4': '0.078', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.274', 'WEAPON3': '1.350', 'HITCOUNT': '2.880', 'weapon3': '3.436', 'DAMAGECOUNT': '13.851', 'FRAGCOUNT': '44.000'} [2023-02-25 13:25:24,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 161058816. Throughput: 0: 3360.7. Samples: 2755660. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:25:24,730][36114] Avg episode reward: [(0, '51.231')] [2023-02-25 13:25:25,163][36138] Updated weights for policy 0, policy_version 39323 (0.0010) [2023-02-25 13:25:28,172][36138] Updated weights for policy 0, policy_version 39333 (0.0009) [2023-02-25 13:25:29,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 161128448. Throughput: 0: 3366.8. Samples: 2776060. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:25:29,730][36114] Avg episode reward: [(0, '51.231')] [2023-02-25 13:25:31,177][36138] Updated weights for policy 0, policy_version 39343 (0.0008) [2023-02-25 13:25:34,237][36138] Updated weights for policy 0, policy_version 39353 (0.0009) [2023-02-25 13:25:34,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 161193984. Throughput: 0: 3369.9. Samples: 2796408. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:25:34,730][36114] Avg episode reward: [(0, '51.231')] [2023-02-25 13:25:37,279][36138] Updated weights for policy 0, policy_version 39363 (0.0009) [2023-02-25 13:25:37,513][36155] DAMAGECOUNT value on done: 180957.0 [2023-02-25 13:25:37,513][36155] Sum rewards: 58.761, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.844', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.146', 'AMMO3': '0.157', 'AMMO4': '0.163', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.298', 'weapon4': '0.624', 'WEAPON3': '0.950', 'weapon3': '2.700', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.634', 'FRAGCOUNT': '48.500'} [2023-02-25 13:25:37,828][36155] DAMAGECOUNT value on done: 185864.0 [2023-02-25 13:25:37,829][36155] Sum rewards: 37.988, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.030', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.134', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.374', 'weapon2': '0.440', 'WEAPON3': '1.250', 'weapon3': '2.618', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '10.851', 'FRAGCOUNT': '35.500'} [2023-02-25 13:25:38,104][36155] DAMAGECOUNT value on done: 182561.0 [2023-02-25 13:25:38,104][36155] Sum rewards: 37.348, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.144', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.120', 'AMMO3': '0.212', 'weapon2': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.552', 'WEAPON3': '1.250', 'HITCOUNT': '2.230', 'weapon3': '2.794', 'DAMAGECOUNT': '10.980', 'FRAGCOUNT': '36.000'} [2023-02-25 13:25:38,193][36139] DAMAGECOUNT value on done: 183057.0 [2023-02-25 13:25:38,193][36139] Sum rewards: 48.942, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.137', 'ARMOR': '0.004', 'weapon5': '0.006', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.143', 'AMMO3': '0.161', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON4': '0.450', 'weapon4': '0.858', 'WEAPON3': '1.000', 'weapon3': '2.442', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.393', 'FRAGCOUNT': '42.000'} [2023-02-25 13:25:38,420][36155] DAMAGECOUNT value on done: 181781.0 [2023-02-25 13:25:38,421][36155] Sum rewards: 50.162, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.362', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.142', 'AMMO3': '0.174', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.384', 'weapon2': '0.476', 'WEAPON3': '1.000', 'weapon3': '2.722', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.810', 'FRAGCOUNT': '43.000'} [2023-02-25 13:25:38,514][36139] DAMAGECOUNT value on done: 188078.0 [2023-02-25 13:25:38,514][36139] Sum rewards: 54.096, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.814', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.144', 'weapon5': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.328', 'weapon2': '0.582', 'WEAPON3': '0.850', 'weapon3': '2.500', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.899', 'FRAGCOUNT': '44.000'} [2023-02-25 13:25:38,769][36139] DAMAGECOUNT value on done: 186413.0 [2023-02-25 13:25:38,769][36139] Sum rewards: 53.786, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.270', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.050', 'AMMO3': '0.144', 'weapon4': '0.156', 'weapon5': '0.172', 'AMMO4': '0.249', 'WEAPON5': '0.400', 'weapon2': '0.426', 'WEAPON4': '0.450', 'WEAPON3': '0.900', 'HITCOUNT': '2.980', 'weapon3': '3.044', 'DAMAGECOUNT': '14.061', 'FRAGCOUNT': '45.500'} [2023-02-25 13:25:39,084][36139] DAMAGECOUNT value on done: 183300.0 [2023-02-25 13:25:39,085][36139] Sum rewards: 50.884, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.872', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.140', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.280', 'weapon4': '0.364', 'WEAPON3': '1.100', 'weapon3': '3.050', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '12.963', 'FRAGCOUNT': '43.000'} [2023-02-25 13:25:39,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 161263616. Throughput: 0: 3370.1. Samples: 2806436. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:25:39,730][36114] Avg episode reward: [(0, '51.020')] [2023-02-25 13:25:40,308][36138] Updated weights for policy 0, policy_version 39373 (0.0010) [2023-02-25 13:25:41,009][36154] DAMAGECOUNT value on done: 187671.0 [2023-02-25 13:25:41,010][36154] Sum rewards: 51.772, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.128', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.206', 'AMMO3': '0.226', 'weapon2': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.540', 'WEAPON3': '1.350', 'weapon3': '2.722', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.083', 'FRAGCOUNT': '44.500'} [2023-02-25 13:25:41,313][36154] DAMAGECOUNT value on done: 181680.0 [2023-02-25 13:25:41,314][36154] Sum rewards: 62.193, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.282', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.126', 'AMMO3': '0.157', 'AMMO4': '0.161', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.462', 'weapon4': '0.508', 'WEAPON3': '0.950', 'weapon3': '2.632', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '52.000'} [2023-02-25 13:25:41,505][36154] DAMAGECOUNT value on done: 184388.0 [2023-02-25 13:25:41,506][36154] Sum rewards: 53.022, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.120', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.116', 'AMMO3': '0.187', 'weapon5': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.442', 'weapon2': '0.564', 'WEAPON3': '1.050', 'weapon3': '2.520', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.959', 'FRAGCOUNT': '45.000'} [2023-02-25 13:25:41,764][36140] DAMAGECOUNT value on done: 186827.0 [2023-02-25 13:25:41,764][36140] Sum rewards: 47.968, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.026', 'AMMO5': '0.007', 'AMMO2': '0.032', 'AMMO3': '0.108', 'WEAPON5': '0.150', 'weapon5': '0.152', 'AMMO4': '0.160', 'WEAPON4': '0.200', 'weapon4': '0.624', 'WEAPON3': '0.650', 'weapon2': '0.806', 'weapon3': '2.148', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.876', 'FRAGCOUNT': '37.000'} [2023-02-25 13:25:41,820][36154] DAMAGECOUNT value on done: 182642.0 [2023-02-25 13:25:41,820][36154] Sum rewards: 63.526, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.295', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.078', 'AMMO4': '0.110', 'AMMO3': '0.149', 'WEAPON5': '0.200', 'weapon2': '0.226', 'WEAPON4': '0.350', 'weapon4': '0.634', 'WEAPON3': '0.950', 'weapon3': '2.846', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.195', 'FRAGCOUNT': '53.000'} [2023-02-25 13:25:42,069][36140] DAMAGECOUNT value on done: 183969.0 [2023-02-25 13:25:42,069][36140] Sum rewards: 41.423, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.952', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'weapon2': '0.250', 'weapon4': '0.508', 'WEAPON3': '1.100', 'HITCOUNT': '2.180', 'weapon3': '3.040', 'DAMAGECOUNT': '10.635', 'FRAGCOUNT': '37.000'} [2023-02-25 13:25:42,307][36141] DAMAGECOUNT value on done: 188300.0 [2023-02-25 13:25:42,307][36141] Sum rewards: 60.316, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.665', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.007', 'weapon5': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'weapon4': '0.270', 'weapon2': '0.684', 'WEAPON3': '1.300', 'weapon3': '2.756', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '50.000'} [2023-02-25 13:25:42,330][36157] DAMAGECOUNT value on done: 188318.0 [2023-02-25 13:25:42,330][36157] Sum rewards: 58.762, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.104', 'AMMO5': '0.027', 'AMMO2': '0.044', 'AMMO3': '0.171', 'AMMO4': '0.219', 'weapon5': '0.278', 'weapon4': '0.314', 'weapon2': '0.438', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.642', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.543', 'FRAGCOUNT': '51.000'} [2023-02-25 13:25:42,500][36140] DAMAGECOUNT value on done: 182399.0 [2023-02-25 13:25:42,501][36140] Sum rewards: 47.567, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.970', 'AMMO5': '0.021', 'AMMO2': '0.033', 'weapon5': '0.138', 'AMMO3': '0.151', 'AMMO4': '0.163', 'weapon2': '0.246', 'WEAPON5': '0.450', 'ARMOR': '0.456', 'WEAPON4': '0.500', 'WEAPON3': '0.900', 'weapon4': '1.056', 'weapon3': '2.174', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '11.418', 'FRAGCOUNT': '42.000'} [2023-02-25 13:25:42,607][36141] DAMAGECOUNT value on done: 183451.0 [2023-02-25 13:25:42,607][36141] Sum rewards: 52.910, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.072', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.031', 'weapon4': '0.064', 'AMMO4': '0.155', 'weapon5': '0.200', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'weapon2': '0.306', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.720', 'weapon3': '3.120', 'DAMAGECOUNT': '14.325', 'FRAGCOUNT': '47.500'} [2023-02-25 13:25:42,641][36157] DAMAGECOUNT value on done: 186357.0 [2023-02-25 13:25:42,641][36157] Sum rewards: 44.633, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.696', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon5': '0.088', 'AMMO4': '0.099', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'weapon4': '0.162', 'WEAPON5': '0.300', 'weapon2': '0.450', 'WEAPON3': '0.800', 'HITCOUNT': '2.510', 'weapon3': '3.130', 'DAMAGECOUNT': '11.226', 'FRAGCOUNT': '36.000'} [2023-02-25 13:25:42,744][36156] DAMAGECOUNT value on done: 190299.0 [2023-02-25 13:25:42,744][36156] Sum rewards: 57.252, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.582', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.072', 'weapon4': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'weapon2': '0.602', 'WEAPON3': '1.050', 'HITCOUNT': '2.900', 'weapon3': '3.042', 'DAMAGECOUNT': '14.157', 'FRAGCOUNT': '49.000'} [2023-02-25 13:25:42,765][36141] DAMAGECOUNT value on done: 185305.0 [2023-02-25 13:25:42,765][36141] Sum rewards: 47.792, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.762', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.138', 'AMMO4': '0.141', 'AMMO3': '0.222', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.562', 'weapon4': '0.602', 'WEAPON3': '1.350', 'weapon3': '2.444', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '13.116', 'FRAGCOUNT': '42.000'} [2023-02-25 13:25:42,801][36140] DAMAGECOUNT value on done: 181999.0 [2023-02-25 13:25:42,802][36140] Sum rewards: 49.427, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.216', 'AMMO5': '0.020', 'AMMO2': '0.048', 'AMMO3': '0.204', 'weapon5': '0.228', 'AMMO4': '0.240', 'weapon4': '0.454', 'weapon2': '0.504', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.544', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '13.971', 'FRAGCOUNT': '44.500'} [2023-02-25 13:25:42,962][36157] DAMAGECOUNT value on done: 188666.0 [2023-02-25 13:25:42,962][36157] Sum rewards: 56.598, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.032', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.034', 'AMMO3': '0.131', 'AMMO4': '0.168', 'weapon5': '0.204', 'weapon2': '0.304', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.726', 'WEAPON3': '0.750', 'HITCOUNT': '2.550', 'weapon3': '2.572', 'DAMAGECOUNT': '13.416', 'FRAGCOUNT': '47.000'} [2023-02-25 13:25:43,048][36156] DAMAGECOUNT value on done: 187253.0 [2023-02-25 13:25:43,049][36156] Sum rewards: 60.602, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.640', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'weapon5': '0.080', 'AMMO4': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon4': '0.236', 'weapon2': '0.252', 'WEAPON3': '1.250', 'HITCOUNT': '2.830', 'weapon3': '3.284', 'DAMAGECOUNT': '14.532', 'FRAGCOUNT': '52.000'} [2023-02-25 13:25:43,058][36156] DAMAGECOUNT value on done: 185729.0 [2023-02-25 13:25:43,059][36156] Sum rewards: 56.200, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.027', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.075', 'weapon5': '0.166', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.462', 'weapon2': '0.702', 'WEAPON3': '1.150', 'weapon3': '2.478', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.195', 'FRAGCOUNT': '47.000'} [2023-02-25 13:25:43,065][36141] DAMAGECOUNT value on done: 178873.0 [2023-02-25 13:25:43,065][36141] Sum rewards: 44.937, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.110', 'AMMO5': '0.022', 'AMMO2': '0.074', 'AMMO3': '0.169', 'AMMO4': '0.371', 'weapon5': '0.376', 'weapon4': '0.528', 'weapon2': '0.548', 'WEAPON5': '0.750', 'WEAPON4': '0.800', 'WEAPON3': '1.000', 'weapon3': '2.210', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '14.178', 'FRAGCOUNT': '41.000'} [2023-02-25 13:25:43,273][36157] DAMAGECOUNT value on done: 188860.0 [2023-02-25 13:25:43,274][36157] Sum rewards: 51.404, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.008', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.134', 'AMMO4': '0.174', 'AMMO3': '0.217', 'weapon2': '0.290', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.558', 'WEAPON3': '1.300', 'weapon3': '2.692', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.749', 'FRAGCOUNT': '47.000'} [2023-02-25 13:25:43,346][36156] DAMAGECOUNT value on done: 184854.0 [2023-02-25 13:25:43,346][36156] Sum rewards: 60.533, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.784', 'ARMOR': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.130', 'weapon5': '0.224', 'WEAPON5': '0.250', 'weapon2': '0.410', 'WEAPON4': '0.450', 'WEAPON3': '0.750', 'weapon4': '1.008', 'weapon3': '2.126', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.565', 'FRAGCOUNT': '50.000'} [2023-02-25 13:25:43,376][36138] Updated weights for policy 0, policy_version 39383 (0.0010) [2023-02-25 13:25:43,725][36142] DAMAGECOUNT value on done: 180527.0 [2023-02-25 13:25:43,725][36142] Sum rewards: 51.241, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.010', 'AMMO5': '0.021', 'AMMO2': '0.042', 'weapon5': '0.202', 'AMMO3': '0.208', 'AMMO4': '0.211', 'weapon2': '0.396', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'weapon4': '1.114', 'WEAPON3': '1.200', 'weapon3': '1.994', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.142', 'FRAGCOUNT': '45.500'} [2023-02-25 13:25:43,735][36139] Large shaping reward 2.579 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.549, 183.0)] [2023-02-25 13:25:44,022][36142] DAMAGECOUNT value on done: 184686.0 [2023-02-25 13:25:44,023][36142] Sum rewards: 55.951, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.234', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.124', 'weapon5': '0.150', 'weapon2': '0.202', 'WEAPON4': '0.250', 'weapon4': '0.714', 'WEAPON3': '0.750', 'weapon3': '2.730', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.623', 'FRAGCOUNT': '45.000'} [2023-02-25 13:25:44,168][36142] DAMAGECOUNT value on done: 180487.0 [2023-02-25 13:25:44,168][36142] Sum rewards: 35.058, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.035', 'ARMOR': '0.004', 'AMMO5': '0.027', 'AMMO2': '0.061', 'AMMO3': '0.245', 'AMMO4': '0.307', 'weapon5': '0.372', 'weapon2': '0.398', 'weapon4': '0.642', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.158', 'HITCOUNT': '2.250', 'DAMAGECOUNT': '10.929', 'FRAGCOUNT': '36.000'} [2023-02-25 13:25:44,475][36142] DAMAGECOUNT value on done: 186973.0 [2023-02-25 13:25:44,476][36142] Sum rewards: 63.435, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.612', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'weapon5': '0.148', 'AMMO4': '0.174', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'weapon4': '0.292', 'WEAPON4': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.050', 'weapon3': '2.862', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.849', 'FRAGCOUNT': '54.000'} [2023-02-25 13:25:44,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 161329152. Throughput: 0: 3374.6. Samples: 2826664. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:25:44,730][36114] Avg episode reward: [(0, '52.171')] [2023-02-25 13:25:44,730][36125] Saving new best policy, reward=52.171! [2023-02-25 13:25:46,399][36138] Updated weights for policy 0, policy_version 39393 (0.0009) [2023-02-25 13:25:49,467][36138] Updated weights for policy 0, policy_version 39403 (0.0009) [2023-02-25 13:25:49,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 161394688. Throughput: 0: 3380.9. Samples: 2847004. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:25:49,730][36114] Avg episode reward: [(0, '52.171')] [2023-02-25 13:25:52,099][36157] Large shaping reward 3.631 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 13:25:52,472][36138] Updated weights for policy 0, policy_version 39413 (0.0009) [2023-02-25 13:25:54,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 161464320. Throughput: 0: 3379.0. Samples: 2857160. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:25:54,730][36114] Avg episode reward: [(0, '52.171')] [2023-02-25 13:25:55,478][36138] Updated weights for policy 0, policy_version 39423 (0.0010) [2023-02-25 13:25:57,396][36155] DAMAGECOUNT value on done: 185522.0 [2023-02-25 13:25:57,397][36155] Sum rewards: 58.925, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.860', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.088', 'AMMO4': '0.114', 'AMMO3': '0.135', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.324', 'ARMOR': '0.400', 'weapon4': '0.626', 'WEAPON3': '0.900', 'weapon3': '2.464', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '13.695', 'FRAGCOUNT': '48.000'} [2023-02-25 13:25:57,698][36155] DAMAGECOUNT value on done: 191139.0 [2023-02-25 13:25:57,699][36155] Sum rewards: 57.069, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.805', 'AMMO5': '0.015', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.092', 'weapon2': '0.152', 'AMMO3': '0.216', 'weapon4': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.260', 'weapon3': '3.280', 'DAMAGECOUNT': '15.825', 'FRAGCOUNT': '49.000'} [2023-02-25 13:25:57,966][36155] DAMAGECOUNT value on done: 186483.0 [2023-02-25 13:25:57,966][36155] Sum rewards: 35.566, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.900', 'AMMO5': '0.012', 'AMMO2': '0.054', 'AMMO3': '0.165', 'weapon5': '0.170', 'AMMO4': '0.268', 'WEAPON5': '0.350', 'weapon2': '0.450', 'WEAPON4': '0.700', 'weapon4': '0.964', 'WEAPON3': '1.000', 'weapon3': '2.136', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '11.766', 'FRAGCOUNT': '33.000'} [2023-02-25 13:25:58,034][36139] DAMAGECOUNT value on done: 187403.0 [2023-02-25 13:25:58,035][36139] Sum rewards: 43.528, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.828', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO3': '0.162', 'AMMO4': '0.204', 'weapon2': '0.226', 'weapon5': '0.346', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.680', 'WEAPON3': '1.000', 'HITCOUNT': '2.280', 'weapon3': '2.460', 'DAMAGECOUNT': '12.738', 'FRAGCOUNT': '38.500'} [2023-02-25 13:25:58,270][36155] DAMAGECOUNT value on done: 186743.0 [2023-02-25 13:25:58,270][36155] Sum rewards: 59.692, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.098', 'AMMO5': '0.017', 'AMMO2': '0.027', 'weapon5': '0.132', 'AMMO4': '0.134', 'weapon4': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon2': '0.282', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.184', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.886', 'FRAGCOUNT': '51.000'} [2023-02-25 13:25:58,347][36139] DAMAGECOUNT value on done: 192572.0 [2023-02-25 13:25:58,348][36139] Sum rewards: 52.984, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.815', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.044', 'weapon5': '0.178', 'weapon2': '0.192', 'AMMO4': '0.218', 'AMMO3': '0.257', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.936', 'WEAPON3': '1.500', 'weapon3': '2.338', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.482', 'FRAGCOUNT': '50.000'} [2023-02-25 13:25:58,521][36138] Updated weights for policy 0, policy_version 39433 (0.0009) [2023-02-25 13:25:58,614][36139] DAMAGECOUNT value on done: 190887.0 [2023-02-25 13:25:58,615][36139] Sum rewards: 52.012, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.305', 'WEAPON1': '0.010', 'AMMO5': '0.025', 'AMMO2': '0.046', 'AMMO3': '0.115', 'AMMO4': '0.230', 'weapon5': '0.384', 'WEAPON4': '0.450', 'weapon2': '0.554', 'weapon4': '0.572', 'WEAPON5': '0.650', 'WEAPON3': '0.800', 'weapon3': '2.118', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.422', 'FRAGCOUNT': '44.000'} [2023-02-25 13:25:58,920][36139] DAMAGECOUNT value on done: 188116.0 [2023-02-25 13:25:58,921][36139] Sum rewards: 51.582, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.354', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.052', 'AMMO3': '0.196', 'weapon5': '0.252', 'weapon2': '0.254', 'AMMO4': '0.259', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.854', 'WEAPON3': '1.100', 'weapon3': '2.280', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.448', 'FRAGCOUNT': '45.000'} [2023-02-25 13:25:59,282][36139] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.006, -2.0), ('weapon5', 0.002)] [2023-02-25 13:25:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 161529856. Throughput: 0: 3377.4. Samples: 2877380. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:25:59,730][36114] Avg episode reward: [(0, '51.873')] [2023-02-25 13:26:00,756][36154] DAMAGECOUNT value on done: 192430.0 [2023-02-25 13:26:00,756][36154] Sum rewards: 55.467, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.450', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon2': '0.246', 'weapon4': '0.564', 'WEAPON3': '1.250', 'weapon3': '2.716', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.277', 'FRAGCOUNT': '49.000'} [2023-02-25 13:26:01,058][36154] DAMAGECOUNT value on done: 186211.0 [2023-02-25 13:26:01,058][36154] Sum rewards: 48.333, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.649', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'weapon2': '0.522', 'weapon4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.622', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '13.593', 'FRAGCOUNT': '44.000'} [2023-02-25 13:26:01,218][36154] DAMAGECOUNT value on done: 187854.0 [2023-02-25 13:26:01,219][36154] Sum rewards: 36.537, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.937', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'weapon5': '0.132', 'AMMO4': '0.143', 'weapon2': '0.148', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon4': '0.344', 'WEAPON3': '1.250', 'HITCOUNT': '2.260', 'weapon3': '3.188', 'DAMAGECOUNT': '10.398', 'FRAGCOUNT': '35.000'} [2023-02-25 13:26:01,311][36156] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 13:26:01,534][36154] DAMAGECOUNT value on done: 187124.0 [2023-02-25 13:26:01,535][36154] Sum rewards: 51.907, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.870', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.104', 'AMMO4': '0.133', 'AMMO3': '0.213', 'weapon2': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.548', 'WEAPON3': '1.250', 'HITCOUNT': '2.830', 'weapon3': '2.872', 'DAMAGECOUNT': '13.446', 'FRAGCOUNT': '45.000'} [2023-02-25 13:26:01,595][36138] Updated weights for policy 0, policy_version 39443 (0.0009) [2023-02-25 13:26:01,726][36140] DAMAGECOUNT value on done: 191831.0 [2023-02-25 13:26:01,726][36140] Sum rewards: 58.448, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.858', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.120', 'AMMO4': '0.180', 'AMMO3': '0.192', 'weapon4': '0.210', 'weapon2': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.970', 'weapon3': '3.198', 'DAMAGECOUNT': '15.012', 'FRAGCOUNT': '50.500'} [2023-02-25 13:26:02,036][36140] DAMAGECOUNT value on done: 188111.0 [2023-02-25 13:26:02,036][36140] Sum rewards: 50.319, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.629', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.237', 'weapon4': '0.240', 'weapon2': '0.262', 'WEAPON3': '1.450', 'HITCOUNT': '2.510', 'weapon3': '3.172', 'DAMAGECOUNT': '12.111', 'FRAGCOUNT': '46.000'} [2023-02-25 13:26:02,219][36141] DAMAGECOUNT value on done: 192344.0 [2023-02-25 13:26:02,220][36141] Sum rewards: 41.493, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.460', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.042', 'AMMO3': '0.203', 'AMMO4': '0.208', 'weapon5': '0.246', 'weapon4': '0.262', 'weapon2': '0.446', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.340', 'weapon3': '2.702', 'DAMAGECOUNT': '12.132', 'FRAGCOUNT': '39.000'} [2023-02-25 13:26:02,240][36157] DAMAGECOUNT value on done: 192966.0 [2023-02-25 13:26:02,240][36157] Sum rewards: 48.862, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.560', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.215', 'WEAPON4': '0.350', 'weapon4': '0.404', 'weapon2': '0.426', 'WEAPON3': '1.300', 'weapon3': '2.934', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.836', 'FRAGCOUNT': '42.000'} [2023-02-25 13:26:02,484][36140] DAMAGECOUNT value on done: 187382.0 [2023-02-25 13:26:02,485][36140] Sum rewards: 46.138, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.360', 'AMMO5': '0.011', 'AMMO2': '0.020', 'weapon4': '0.048', 'AMMO4': '0.098', 'weapon5': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'weapon2': '0.388', 'WEAPON3': '1.400', 'HITCOUNT': '2.870', 'weapon3': '3.182', 'DAMAGECOUNT': '14.649', 'FRAGCOUNT': '41.500'} [2023-02-25 13:26:02,525][36141] DAMAGECOUNT value on done: 188364.0 [2023-02-25 13:26:02,525][36141] Sum rewards: 60.578, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.950', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.046', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'weapon4': '0.300', 'weapon2': '0.630', 'WEAPON3': '1.150', 'weapon3': '2.866', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '51.000'} [2023-02-25 13:26:02,552][36157] DAMAGECOUNT value on done: 190537.0 [2023-02-25 13:26:02,552][36157] Sum rewards: 47.823, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.554', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.029', 'weapon5': '0.086', 'AMMO4': '0.144', 'weapon4': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '2.580', 'weapon3': '3.282', 'DAMAGECOUNT': '12.540', 'FRAGCOUNT': '43.500'} [2023-02-25 13:26:02,665][36141] DAMAGECOUNT value on done: 189924.0 [2023-02-25 13:26:02,665][36141] Sum rewards: 44.855, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.672', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.041', 'weapon5': '0.052', 'WEAPON5': '0.200', 'AMMO4': '0.204', 'AMMO3': '0.217', 'WEAPON4': '0.400', 'weapon4': '0.486', 'weapon2': '0.586', 'WEAPON3': '1.350', 'weapon3': '2.498', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.857', 'FRAGCOUNT': '42.000'} [2023-02-25 13:26:02,726][36156] DAMAGECOUNT value on done: 194872.0 [2023-02-25 13:26:02,726][36156] Sum rewards: 48.715, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.522', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon4': '0.120', 'AMMO3': '0.212', 'weapon2': '0.228', 'WEAPON4': '0.250', 'weapon5': '0.268', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.550', 'weapon3': '3.032', 'DAMAGECOUNT': '13.719', 'FRAGCOUNT': '43.000'} [2023-02-25 13:26:02,770][36140] DAMAGECOUNT value on done: 186639.0 [2023-02-25 13:26:02,770][36140] Sum rewards: 43.399, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.184', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.042', 'AMMO3': '0.151', 'weapon2': '0.162', 'AMMO4': '0.208', 'weapon5': '0.326', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon4': '0.840', 'WEAPON3': '0.950', 'weapon3': '2.374', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '13.920', 'FRAGCOUNT': '36.500'} [2023-02-25 13:26:02,871][36157] DAMAGECOUNT value on done: 193681.0 [2023-02-25 13:26:02,871][36157] Sum rewards: 51.635, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.186', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.172', 'AMMO4': '0.178', 'weapon4': '0.216', 'AMMO3': '0.234', 'weapon2': '0.258', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.770', 'weapon3': '3.040', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '47.000'} [2023-02-25 13:26:02,982][36141] DAMAGECOUNT value on done: 182707.0 [2023-02-25 13:26:02,982][36141] Sum rewards: 43.194, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.880', 'AMMO5': '0.030', 'AMMO2': '0.039', 'AMMO3': '0.139', 'weapon5': '0.184', 'AMMO4': '0.194', 'weapon2': '0.378', 'weapon4': '0.478', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '0.850', 'weapon3': '2.580', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '11.502', 'FRAGCOUNT': '37.000'} [2023-02-25 13:26:03,030][36156] DAMAGECOUNT value on done: 192405.0 [2023-02-25 13:26:03,030][36156] Sum rewards: 58.725, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.228', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.049', 'AMMO3': '0.136', 'AMMO4': '0.247', 'weapon5': '0.304', 'weapon2': '0.314', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.748', 'WEAPON3': '0.800', 'weapon3': '2.282', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '15.456', 'FRAGCOUNT': '48.500'} [2023-02-25 13:26:03,039][36156] DAMAGECOUNT value on done: 189864.0 [2023-02-25 13:26:03,039][36156] Sum rewards: 44.304, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.480', 'ARMOR': '0.009', 'AMMO5': '0.022', 'AMMO2': '0.067', 'AMMO3': '0.163', 'weapon5': '0.232', 'AMMO4': '0.337', 'WEAPON5': '0.550', 'weapon2': '0.564', 'weapon4': '0.706', 'WEAPON4': '0.750', 'WEAPON3': '0.950', 'weapon3': '2.218', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.405', 'FRAGCOUNT': '40.000'} [2023-02-25 13:26:03,176][36157] DAMAGECOUNT value on done: 193962.0 [2023-02-25 13:26:03,177][36157] Sum rewards: 56.422, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.290', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.082', 'AMMO4': '0.177', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon2': '0.242', 'WEAPON4': '0.350', 'weapon4': '0.378', 'WEAPON3': '1.150', 'HITCOUNT': '3.030', 'weapon3': '3.062', 'DAMAGECOUNT': '15.306', 'FRAGCOUNT': '48.000'} [2023-02-25 13:26:03,348][36156] DAMAGECOUNT value on done: 189115.0 [2023-02-25 13:26:03,348][36156] Sum rewards: 43.788, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.810', 'AMMO5': '0.017', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.128', 'AMMO3': '0.207', 'WEAPON4': '0.350', 'weapon2': '0.360', 'WEAPON5': '0.450', 'weapon4': '0.740', 'WEAPON3': '1.350', 'weapon3': '2.462', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '12.783', 'FRAGCOUNT': '39.000'} [2023-02-25 13:26:03,779][36142] DAMAGECOUNT value on done: 185772.0 [2023-02-25 13:26:03,780][36142] Sum rewards: 62.549, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.030', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.112', 'AMMO4': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.294', 'WEAPON4': '0.300', 'weapon4': '0.458', 'WEAPON3': '1.300', 'weapon3': '2.912', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.735', 'FRAGCOUNT': '54.500'} [2023-02-25 13:26:04,089][36142] DAMAGECOUNT value on done: 189640.0 [2023-02-25 13:26:04,090][36142] Sum rewards: 55.128, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.234', 'ARMOR': '0.005', 'WEAPON1': '0.010', 'AMMO5': '0.025', 'AMMO2': '0.049', 'AMMO3': '0.184', 'AMMO4': '0.245', 'weapon5': '0.270', 'WEAPON4': '0.450', 'weapon2': '0.474', 'weapon4': '0.478', 'WEAPON5': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.420', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '48.000'} [2023-02-25 13:26:04,213][36142] DAMAGECOUNT value on done: 184853.0 [2023-02-25 13:26:04,213][36142] Sum rewards: 46.635, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.379', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.074', 'AMMO4': '0.075', 'weapon5': '0.096', 'weapon2': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.237', 'WEAPON3': '1.350', 'HITCOUNT': '2.850', 'weapon3': '3.538', 'DAMAGECOUNT': '13.098', 'FRAGCOUNT': '40.500'} [2023-02-25 13:26:04,527][36142] DAMAGECOUNT value on done: 191905.0 [2023-02-25 13:26:04,528][36142] Sum rewards: 60.068, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.272', 'AMMO5': '0.014', 'AMMO2': '0.039', 'AMMO3': '0.172', 'AMMO4': '0.197', 'weapon5': '0.278', 'WEAPON4': '0.350', 'weapon4': '0.360', 'WEAPON5': '0.400', 'weapon2': '0.506', 'WEAPON3': '1.000', 'weapon3': '2.588', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.796', 'FRAGCOUNT': '51.000'} [2023-02-25 13:26:04,682][36138] Updated weights for policy 0, policy_version 39453 (0.0009) [2023-02-25 13:26:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13482.1). Total num frames: 161599488. Throughput: 0: 3376.3. Samples: 2897608. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:26:04,730][36114] Avg episode reward: [(0, '51.006')] [2023-02-25 13:26:07,724][36138] Updated weights for policy 0, policy_version 39463 (0.0009) [2023-02-25 13:26:09,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13482.1). Total num frames: 161665024. Throughput: 0: 3379.3. Samples: 2907730. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:26:09,730][36114] Avg episode reward: [(0, '51.006')] [2023-02-25 13:26:10,803][36138] Updated weights for policy 0, policy_version 39473 (0.0009) [2023-02-25 13:26:13,880][36138] Updated weights for policy 0, policy_version 39483 (0.0009) [2023-02-25 13:26:14,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13448.5, 300 sec: 13468.2). Total num frames: 161730560. Throughput: 0: 3369.3. Samples: 2927680. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:26:14,730][36114] Avg episode reward: [(0, '51.006')] [2023-02-25 13:26:16,910][36138] Updated weights for policy 0, policy_version 39493 (0.0009) [2023-02-25 13:26:17,377][36155] DAMAGECOUNT value on done: 189871.0 [2023-02-25 13:26:17,378][36155] Sum rewards: 48.933, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.920', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.074', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.164', 'weapon2': '0.262', 'AMMO3': '0.287', 'WEAPON3': '1.650', 'HITCOUNT': '2.830', 'weapon3': '3.216', 'DAMAGECOUNT': '13.047', 'FRAGCOUNT': '47.000'} [2023-02-25 13:26:17,695][36155] DAMAGECOUNT value on done: 195469.0 [2023-02-25 13:26:17,695][36155] Sum rewards: 56.580, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.140', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'weapon4': '0.202', 'weapon2': '0.532', 'WEAPON3': '0.950', 'HITCOUNT': '2.660', 'weapon3': '3.120', 'DAMAGECOUNT': '12.990', 'FRAGCOUNT': '47.000'} [2023-02-25 13:26:17,951][36139] DAMAGECOUNT value on done: 191109.0 [2023-02-25 13:26:17,951][36139] Sum rewards: 44.262, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.867', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.102', 'weapon5': '0.126', 'AMMO3': '0.140', 'weapon2': '0.292', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.654', 'WEAPON3': '0.850', 'HITCOUNT': '2.550', 'weapon3': '2.664', 'DAMAGECOUNT': '11.118', 'FRAGCOUNT': '38.000'} [2023-02-25 13:26:17,983][36155] DAMAGECOUNT value on done: 191459.0 [2023-02-25 13:26:17,984][36155] Sum rewards: 56.921, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.260', 'AMMO2': '0.010', 'AMMO5': '0.025', 'AMMO4': '0.047', 'weapon5': '0.086', 'WEAPON4': '0.150', 'weapon4': '0.214', 'AMMO3': '0.265', 'weapon2': '0.362', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'HITCOUNT': '2.980', 'weapon3': '3.064', 'DAMAGECOUNT': '14.928', 'FRAGCOUNT': '51.000'} [2023-02-25 13:26:18,267][36139] DAMAGECOUNT value on done: 197278.0 [2023-02-25 13:26:18,267][36139] Sum rewards: 60.064, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.848', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.041', 'AMMO3': '0.091', 'weapon5': '0.194', 'AMMO4': '0.206', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON4': '0.450', 'weapon4': '0.562', 'WEAPON3': '0.650', 'weapon3': '2.730', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.797', 'FRAGCOUNT': '49.000'} [2023-02-25 13:26:18,298][36155] DAMAGECOUNT value on done: 191587.0 [2023-02-25 13:26:18,298][36155] Sum rewards: 60.346, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.061', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.042', 'weapon4': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO3': '0.222', 'weapon2': '0.568', 'WEAPON3': '1.350', 'HITCOUNT': '3.080', 'weapon3': '3.138', 'DAMAGECOUNT': '14.532', 'FRAGCOUNT': '52.000'} [2023-02-25 13:26:18,587][36139] DAMAGECOUNT value on done: 195233.0 [2023-02-25 13:26:18,587][36139] Sum rewards: 53.713, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.904', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'weapon4': '0.168', 'AMMO3': '0.256', 'weapon2': '0.582', 'WEAPON3': '1.500', 'HITCOUNT': '3.010', 'weapon3': '3.012', 'DAMAGECOUNT': '13.038', 'FRAGCOUNT': '49.000'} [2023-02-25 13:26:18,885][36139] DAMAGECOUNT value on done: 191621.0 [2023-02-25 13:26:18,885][36139] Sum rewards: 37.504, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.818', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.016', 'weapon5': '0.070', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.380', 'weapon4': '0.422', 'WEAPON3': '1.200', 'HITCOUNT': '2.460', 'weapon3': '2.906', 'DAMAGECOUNT': '10.515', 'FRAGCOUNT': '33.000'} [2023-02-25 13:26:19,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 161800192. Throughput: 0: 3364.2. Samples: 2947798. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:26:19,730][36114] Avg episode reward: [(0, '51.370')] [2023-02-25 13:26:19,928][36138] Updated weights for policy 0, policy_version 39503 (0.0009) [2023-02-25 13:26:20,777][36154] DAMAGECOUNT value on done: 196344.0 [2023-02-25 13:26:20,778][36154] Sum rewards: 44.143, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.688', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'weapon5': '0.120', 'AMMO3': '0.138', 'AMMO4': '0.150', 'weapon2': '0.162', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'weapon4': '1.358', 'weapon3': '1.970', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '11.742', 'FRAGCOUNT': '36.000'} [2023-02-25 13:26:21,090][36154] DAMAGECOUNT value on done: 191745.0 [2023-02-25 13:26:21,090][36154] Sum rewards: 63.103, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.611', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'weapon2': '0.290', 'weapon4': '0.370', 'WEAPON3': '1.500', 'weapon3': '3.024', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '54.000'} [2023-02-25 13:26:21,255][36154] DAMAGECOUNT value on done: 192615.0 [2023-02-25 13:26:21,256][36154] Sum rewards: 52.121, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.710', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.048', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.249', 'WEAPON4': '0.300', 'weapon4': '0.312', 'weapon2': '0.316', 'WEAPON3': '1.400', 'weapon3': '3.080', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.283', 'FRAGCOUNT': '47.000'} [2023-02-25 13:26:21,565][36154] DAMAGECOUNT value on done: 191629.0 [2023-02-25 13:26:21,566][36154] Sum rewards: 51.393, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.120', 'AMMO5': '0.015', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.122', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon2': '0.280', 'WEAPON5': '0.300', 'weapon4': '0.328', 'WEAPON3': '1.450', 'HITCOUNT': '2.890', 'weapon3': '3.012', 'DAMAGECOUNT': '13.515', 'FRAGCOUNT': '47.000'} [2023-02-25 13:26:21,832][36140] DAMAGECOUNT value on done: 196861.0 [2023-02-25 13:26:21,832][36140] Sum rewards: 58.460, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.263', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.150', 'AMMO3': '0.158', 'weapon4': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.304', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '3.110', 'weapon3': '3.144', 'DAMAGECOUNT': '15.090', 'FRAGCOUNT': '48.000'} [2023-02-25 13:26:22,133][36141] DAMAGECOUNT value on done: 197331.0 [2023-02-25 13:26:22,133][36141] Sum rewards: 53.178, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.836', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.014', 'WEAPON4': '0.100', 'weapon5': '0.104', 'WEAPON5': '0.150', 'weapon4': '0.154', 'AMMO3': '0.243', 'weapon2': '0.246', 'WEAPON3': '1.500', 'HITCOUNT': '3.000', 'weapon3': '3.284', 'DAMAGECOUNT': '14.961', 'FRAGCOUNT': '46.500'} [2023-02-25 13:26:22,153][36140] DAMAGECOUNT value on done: 191886.0 [2023-02-25 13:26:22,154][36140] Sum rewards: 43.281, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.266', 'AMMO5': '0.012', 'AMMO2': '0.016', 'weapon5': '0.048', 'weapon4': '0.060', 'AMMO4': '0.081', 'AMMO3': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON3': '0.900', 'HITCOUNT': '2.490', 'weapon3': '3.396', 'DAMAGECOUNT': '11.325', 'FRAGCOUNT': '35.000'} [2023-02-25 13:26:22,239][36157] DAMAGECOUNT value on done: 197947.0 [2023-02-25 13:26:22,240][36157] Sum rewards: 59.375, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.040', 'AMMO5': '0.006', 'AMMO2': '0.010', 'AMMO4': '0.052', 'weapon5': '0.146', 'WEAPON4': '0.150', 'weapon4': '0.158', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'weapon2': '0.504', 'WEAPON3': '1.100', 'weapon3': '2.936', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.808', 'FRAGCOUNT': '49.000'} [2023-02-25 13:26:22,438][36141] DAMAGECOUNT value on done: 191966.0 [2023-02-25 13:26:22,439][36141] Sum rewards: 37.497, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.150', 'AMMO5': '0.005', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.037', 'WEAPON4': '0.100', 'weapon4': '0.116', 'weapon5': '0.122', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'weapon2': '0.540', 'WEAPON3': '1.150', 'HITCOUNT': '2.380', 'weapon3': '2.978', 'DAMAGECOUNT': '10.806', 'FRAGCOUNT': '33.000'} [2023-02-25 13:26:22,555][36157] DAMAGECOUNT value on done: 195676.0 [2023-02-25 13:26:22,556][36157] Sum rewards: 64.135, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.816', 'AMMO5': '0.010', 'AMMO2': '0.044', 'AMMO3': '0.145', 'weapon4': '0.190', 'weapon5': '0.202', 'AMMO4': '0.219', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.584', 'WEAPON3': '0.850', 'weapon3': '2.790', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.417', 'FRAGCOUNT': '52.000'} [2023-02-25 13:26:22,576][36141] DAMAGECOUNT value on done: 194311.0 [2023-02-25 13:26:22,577][36141] Sum rewards: 46.754, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.827', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.038', 'AMMO3': '0.188', 'AMMO4': '0.188', 'weapon5': '0.222', 'weapon2': '0.234', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.816', 'WEAPON3': '1.100', 'weapon3': '2.458', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.161', 'FRAGCOUNT': '43.000'} [2023-02-25 13:26:22,598][36140] DAMAGECOUNT value on done: 191853.0 [2023-02-25 13:26:22,599][36140] Sum rewards: 51.697, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.632', 'AMMO5': '0.010', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.132', 'weapon2': '0.174', 'AMMO3': '0.272', 'WEAPON3': '1.550', 'HITCOUNT': '2.780', 'weapon3': '3.422', 'DAMAGECOUNT': '13.413', 'FRAGCOUNT': '47.000'} [2023-02-25 13:26:22,873][36141] DAMAGECOUNT value on done: 186673.0 [2023-02-25 13:26:22,874][36141] Sum rewards: 42.716, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.150', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.060', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.232', 'WEAPON4': '0.350', 'weapon4': '0.510', 'WEAPON3': '1.200', 'HITCOUNT': '2.790', 'weapon3': '2.958', 'DAMAGECOUNT': '11.898', 'FRAGCOUNT': '39.000'} [2023-02-25 13:26:22,882][36157] DAMAGECOUNT value on done: 198899.0 [2023-02-25 13:26:22,882][36157] Sum rewards: 65.641, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.305', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.064', 'AMMO4': '0.140', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.338', 'weapon2': '0.424', 'WEAPON3': '1.150', 'weapon3': '3.024', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.654', 'FRAGCOUNT': '56.000'} [2023-02-25 13:26:22,884][36140] DAMAGECOUNT value on done: 189814.0 [2023-02-25 13:26:22,885][36140] Sum rewards: 40.246, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.840', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.170', 'AMMO3': '0.184', 'AMMO4': '0.223', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON4': '0.450', 'weapon4': '0.898', 'WEAPON3': '1.100', 'weapon3': '2.308', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '9.525', 'FRAGCOUNT': '37.000'} [2023-02-25 13:26:22,983][36138] Updated weights for policy 0, policy_version 39513 (0.0010) [2023-02-25 13:26:22,996][36156] DAMAGECOUNT value on done: 199556.0 [2023-02-25 13:26:22,997][36156] Sum rewards: 50.638, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.220', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.040', 'WEAPON4': '0.100', 'AMMO4': '0.109', 'weapon5': '0.110', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.462', 'WEAPON3': '1.450', 'HITCOUNT': '2.860', 'weapon3': '3.204', 'DAMAGECOUNT': '14.052', 'FRAGCOUNT': '46.000'} [2023-02-25 13:26:23,180][36157] DAMAGECOUNT value on done: 198283.0 [2023-02-25 13:26:23,180][36157] Sum rewards: 46.526, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.452', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO3': '0.148', 'AMMO4': '0.197', 'weapon4': '0.242', 'WEAPON5': '0.250', 'weapon5': '0.290', 'WEAPON4': '0.350', 'weapon2': '0.438', 'WEAPON3': '0.850', 'HITCOUNT': '2.380', 'weapon3': '2.814', 'DAMAGECOUNT': '12.963', 'FRAGCOUNT': '38.000'} [2023-02-25 13:26:23,312][36156] DAMAGECOUNT value on done: 194678.0 [2023-02-25 13:26:23,312][36156] Sum rewards: 52.386, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.492', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.153', 'weapon5': '0.232', 'AMMO3': '0.234', 'weapon2': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.390', 'WEAPON3': '1.400', 'weapon3': '2.842', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.442', 'FRAGCOUNT': '47.000'} [2023-02-25 13:26:23,324][36156] DAMAGECOUNT value on done: 197425.0 [2023-02-25 13:26:23,325][36156] Sum rewards: 55.946, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.780', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.054', 'AMMO3': '0.192', 'weapon5': '0.222', 'AMMO4': '0.269', 'weapon4': '0.270', 'weapon2': '0.546', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.626', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '49.000'} [2023-02-25 13:26:23,622][36156] DAMAGECOUNT value on done: 194058.0 [2023-02-25 13:26:23,622][36156] Sum rewards: 54.799, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.254', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.340', 'weapon2': '0.496', 'WEAPON3': '1.200', 'weapon3': '2.808', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.829', 'FRAGCOUNT': '46.000'} [2023-02-25 13:26:23,858][36142] DAMAGECOUNT value on done: 189642.0 [2023-02-25 13:26:23,859][36142] Sum rewards: 39.902, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.136', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.039', 'AMMO3': '0.167', 'AMMO4': '0.194', 'weapon5': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.520', 'weapon4': '0.574', 'WEAPON3': '0.900', 'weapon3': '2.338', 'HITCOUNT': '2.340', 'DAMAGECOUNT': '11.475', 'FRAGCOUNT': '35.000'} [2023-02-25 13:26:24,175][36142] DAMAGECOUNT value on done: 193453.0 [2023-02-25 13:26:24,176][36142] Sum rewards: 35.800, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.710', 'AMMO5': '0.003', 'AMMO2': '0.024', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon2': '0.248', 'ARMOR': '0.485', 'weapon4': '0.618', 'WEAPON3': '1.350', 'weapon3': '2.470', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '11.439', 'FRAGCOUNT': '32.000'} [2023-02-25 13:26:24,342][36142] DAMAGECOUNT value on done: 189723.0 [2023-02-25 13:26:24,342][36142] Sum rewards: 56.239, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.676', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.128', 'AMMO4': '0.184', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.356', 'weapon4': '0.448', 'WEAPON3': '1.350', 'weapon3': '2.762', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.610', 'FRAGCOUNT': '50.000'} [2023-02-25 13:26:24,648][36142] DAMAGECOUNT value on done: 196325.0 [2023-02-25 13:26:24,649][36142] Sum rewards: 46.348, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.455', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.070', 'AMMO3': '0.164', 'weapon5': '0.192', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.462', 'WEAPON3': '1.050', 'weapon3': '2.612', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '13.260', 'FRAGCOUNT': '40.000'} [2023-02-25 13:26:24,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 161865728. Throughput: 0: 3365.2. Samples: 2957872. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:26:24,730][36114] Avg episode reward: [(0, '51.114')] [2023-02-25 13:26:26,038][36138] Updated weights for policy 0, policy_version 39523 (0.0009) [2023-02-25 13:26:29,064][36138] Updated weights for policy 0, policy_version 39533 (0.0010) [2023-02-25 13:26:29,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13482.1). Total num frames: 161935360. Throughput: 0: 3366.7. Samples: 2978166. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:26:29,729][36114] Avg episode reward: [(0, '51.114')] [2023-02-25 13:26:32,053][36138] Updated weights for policy 0, policy_version 39543 (0.0009) [2023-02-25 13:26:34,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 162000896. Throughput: 0: 3366.0. Samples: 2998474. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:26:34,730][36114] Avg episode reward: [(0, '51.114')] [2023-02-25 13:26:35,113][36138] Updated weights for policy 0, policy_version 39553 (0.0010) [2023-02-25 13:26:37,273][36155] DAMAGECOUNT value on done: 194879.0 [2023-02-25 13:26:37,274][36155] Sum rewards: 58.471, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.441', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.116', 'WEAPON5': '0.150', 'weapon4': '0.162', 'AMMO3': '0.168', 'AMMO4': '0.176', 'WEAPON4': '0.250', 'weapon2': '0.260', 'WEAPON3': '1.000', 'HITCOUNT': '2.780', 'weapon3': '3.304', 'DAMAGECOUNT': '14.505', 'FRAGCOUNT': '49.000'} [2023-02-25 13:26:37,559][36155] DAMAGECOUNT value on done: 201303.0 [2023-02-25 13:26:37,560][36155] Sum rewards: 72.936, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.719', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.052', 'AMMO4': '0.058', 'WEAPON5': '0.100', 'weapon2': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'weapon4': '0.272', 'WEAPON3': '1.200', 'HITCOUNT': '3.320', 'weapon3': '3.408', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '61.000'} [2023-02-25 13:26:37,861][36155] DAMAGECOUNT value on done: 196017.0 [2023-02-25 13:26:37,862][36155] Sum rewards: 46.601, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.865', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon4': '0.136', 'AMMO4': '0.139', 'weapon5': '0.160', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.552', 'WEAPON3': '1.200', 'HITCOUNT': '2.740', 'weapon3': '2.868', 'DAMAGECOUNT': '13.674', 'FRAGCOUNT': '43.000'} [2023-02-25 13:26:37,865][36139] DAMAGECOUNT value on done: 195187.0 [2023-02-25 13:26:37,866][36139] Sum rewards: 42.686, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.745', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.122', 'AMMO3': '0.153', 'WEAPON5': '0.200', 'weapon5': '0.208', 'WEAPON4': '0.300', 'weapon4': '0.402', 'weapon2': '0.560', 'WEAPON3': '1.050', 'HITCOUNT': '2.510', 'weapon3': '2.656', 'DAMAGECOUNT': '12.234', 'FRAGCOUNT': '37.000'} [2023-02-25 13:26:38,146][36138] Updated weights for policy 0, policy_version 39563 (0.0010) [2023-02-25 13:26:38,164][36155] DAMAGECOUNT value on done: 196423.0 [2023-02-25 13:26:38,164][36155] Sum rewards: 59.672, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.760', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.050', 'AMMO4': '0.053', 'weapon4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.217', 'weapon2': '0.278', 'WEAPON3': '1.350', 'HITCOUNT': '3.240', 'weapon3': '3.466', 'DAMAGECOUNT': '14.508', 'FRAGCOUNT': '51.000'} [2023-02-25 13:26:38,178][36139] DAMAGECOUNT value on done: 201587.0 [2023-02-25 13:26:38,178][36139] Sum rewards: 52.918, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.655', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon5': '0.192', 'WEAPON4': '0.250', 'weapon2': '0.254', 'WEAPON3': '1.100', 'HITCOUNT': '2.750', 'weapon3': '3.230', 'DAMAGECOUNT': '12.927', 'FRAGCOUNT': '46.000'} [2023-02-25 13:26:38,372][36139] DAMAGECOUNT value on done: 199246.0 [2023-02-25 13:26:38,373][36139] Sum rewards: 48.881, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.960', 'AMMO5': '0.012', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.140', 'WEAPON4': '0.150', 'weapon4': '0.154', 'AMMO3': '0.177', 'WEAPON5': '0.250', 'weapon2': '0.632', 'WEAPON3': '1.100', 'HITCOUNT': '2.470', 'weapon3': '2.894', 'DAMAGECOUNT': '12.039', 'FRAGCOUNT': '42.000'} [2023-02-25 13:26:38,674][36139] DAMAGECOUNT value on done: 196266.0 [2023-02-25 13:26:38,675][36139] Sum rewards: 54.388, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.930', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO4': '0.142', 'AMMO3': '0.156', 'weapon5': '0.224', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.446', 'weapon2': '0.454', 'WEAPON3': '0.950', 'weapon3': '2.674', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.935', 'FRAGCOUNT': '45.500'} [2023-02-25 13:26:39,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13482.1). Total num frames: 162070528. Throughput: 0: 3365.1. Samples: 3008590. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:26:39,729][36114] Avg episode reward: [(0, '51.673')] [2023-02-25 13:26:40,610][36154] DAMAGECOUNT value on done: 200996.0 [2023-02-25 13:26:40,610][36154] Sum rewards: 54.378, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.268', 'AMMO5': '0.013', 'AMMO2': '0.022', 'weapon5': '0.102', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon4': '0.228', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.200', 'HITCOUNT': '2.880', 'weapon3': '3.042', 'DAMAGECOUNT': '13.956', 'FRAGCOUNT': '46.500'} [2023-02-25 13:26:40,913][36154] DAMAGECOUNT value on done: 195994.0 [2023-02-25 13:26:40,913][36154] Sum rewards: 48.838, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.661', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.020', 'AMMO4': '0.098', 'AMMO3': '0.147', 'weapon5': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.712', 'weapon4': '0.738', 'WEAPON3': '0.850', 'weapon3': '1.960', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.417', 'FRAGCOUNT': '41.000'} [2023-02-25 13:26:41,136][36138] Updated weights for policy 0, policy_version 39573 (0.0010) [2023-02-25 13:26:41,151][36154] DAMAGECOUNT value on done: 196815.0 [2023-02-25 13:26:41,152][36154] Sum rewards: 48.878, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.597', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.016', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.246', 'weapon2': '0.352', 'WEAPON3': '1.400', 'HITCOUNT': '2.520', 'weapon3': '3.412', 'DAMAGECOUNT': '12.600', 'FRAGCOUNT': '44.000'} [2023-02-25 13:26:41,440][36154] DAMAGECOUNT value on done: 195841.0 [2023-02-25 13:26:41,440][36154] Sum rewards: 46.258, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.060', 'AMMO2': '0.020', 'AMMO5': '0.027', 'AMMO4': '0.102', 'AMMO3': '0.190', 'weapon5': '0.280', 'WEAPON4': '0.300', 'weapon2': '0.334', 'weapon4': '0.362', 'WEAPON5': '0.700', 'WEAPON3': '1.100', 'HITCOUNT': '2.280', 'weapon3': '2.736', 'DAMAGECOUNT': '12.636', 'FRAGCOUNT': '40.000'} [2023-02-25 13:26:41,717][36140] DAMAGECOUNT value on done: 202146.0 [2023-02-25 13:26:41,717][36140] Sum rewards: 62.273, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.060', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.012', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.281', 'weapon2': '0.382', 'WEAPON3': '1.550', 'HITCOUNT': '3.310', 'weapon3': '3.356', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '55.000'} [2023-02-25 13:26:42,016][36141] DAMAGECOUNT value on done: 202471.0 [2023-02-25 13:26:42,017][36141] Sum rewards: 61.158, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.838', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.062', 'weapon4': '0.114', 'AMMO4': '0.153', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.508', 'WEAPON3': '1.250', 'weapon3': '3.092', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '52.000'} [2023-02-25 13:26:42,024][36140] DAMAGECOUNT value on done: 196645.0 [2023-02-25 13:26:42,024][36140] Sum rewards: 57.163, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.110', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.027', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon4': '0.286', 'weapon2': '0.480', 'WEAPON3': '1.150', 'weapon3': '2.960', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.277', 'FRAGCOUNT': '47.000'} [2023-02-25 13:26:42,108][36157] DAMAGECOUNT value on done: 202958.0 [2023-02-25 13:26:42,109][36157] Sum rewards: 54.323, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.102', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.184', 'AMMO3': '0.196', 'weapon4': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.824', 'WEAPON3': '1.150', 'weapon3': '2.484', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.033', 'FRAGCOUNT': '46.000'} [2023-02-25 13:26:42,308][36141] DAMAGECOUNT value on done: 196921.0 [2023-02-25 13:26:42,308][36141] Sum rewards: 62.195, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.250', 'AMMO2': '0.016', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'weapon2': '0.198', 'AMMO3': '0.234', 'weapon4': '0.522', 'WEAPON3': '1.350', 'weapon3': '3.110', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '54.000'} [2023-02-25 13:26:42,411][36157] DAMAGECOUNT value on done: 199510.0 [2023-02-25 13:26:42,411][36157] Sum rewards: 35.854, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.427', 'ARMOR': '0.012', 'AMMO5': '0.016', 'AMMO2': '0.050', 'AMMO3': '0.136', 'AMMO4': '0.249', 'weapon5': '0.372', 'weapon2': '0.408', 'WEAPON5': '0.500', 'WEAPON4': '0.750', 'WEAPON3': '0.750', 'weapon4': '1.138', 'weapon3': '1.638', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '11.502', 'FRAGCOUNT': '31.000'} [2023-02-25 13:26:42,462][36141] DAMAGECOUNT value on done: 198352.0 [2023-02-25 13:26:42,462][36141] Sum rewards: 47.185, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.890', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO3': '0.138', 'AMMO4': '0.148', 'weapon5': '0.170', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON4': '0.450', 'weapon4': '0.534', 'WEAPON3': '0.900', 'HITCOUNT': '2.420', 'weapon3': '2.686', 'DAMAGECOUNT': '12.123', 'FRAGCOUNT': '40.000'} [2023-02-25 13:26:42,490][36140] DAMAGECOUNT value on done: 195771.0 [2023-02-25 13:26:42,490][36140] Sum rewards: 42.117, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.640', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon5': '0.158', 'AMMO3': '0.215', 'AMMO4': '0.227', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.534', 'weapon2': '0.686', 'WEAPON3': '1.350', 'weapon3': '2.376', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '11.754', 'FRAGCOUNT': '42.000'} [2023-02-25 13:26:42,724][36157] DAMAGECOUNT value on done: 203758.0 [2023-02-25 13:26:42,724][36157] Sum rewards: 59.632, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.536', 'AMMO2': '0.007', 'AMMO4': '0.032', 'WEAPON4': '0.100', 'weapon4': '0.174', 'weapon2': '0.180', 'AMMO3': '0.212', 'WEAPON3': '1.350', 'HITCOUNT': '2.980', 'weapon3': '3.556', 'DAMAGECOUNT': '14.577', 'FRAGCOUNT': '51.000'} [2023-02-25 13:26:42,767][36141] DAMAGECOUNT value on done: 190948.0 [2023-02-25 13:26:42,768][36141] Sum rewards: 49.704, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.326', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.024', 'weapon4': '0.052', 'weapon5': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'weapon2': '0.518', 'WEAPON3': '1.200', 'HITCOUNT': '2.780', 'weapon3': '3.184', 'DAMAGECOUNT': '12.825', 'FRAGCOUNT': '43.000'} [2023-02-25 13:26:42,794][36140] DAMAGECOUNT value on done: 194147.0 [2023-02-25 13:26:42,795][36140] Sum rewards: 52.494, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.608', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.043', 'AMMO3': '0.152', 'weapon5': '0.180', 'AMMO4': '0.216', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.434', 'weapon4': '0.462', 'WEAPON3': '0.950', 'weapon3': '2.672', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.999', 'FRAGCOUNT': '45.000'} [2023-02-25 13:26:42,841][36156] DAMAGECOUNT value on done: 203386.0 [2023-02-25 13:26:42,841][36156] Sum rewards: 44.054, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.240', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.050', 'AMMO3': '0.108', 'weapon5': '0.110', 'AMMO4': '0.251', 'WEAPON5': '0.400', 'weapon2': '0.576', 'WEAPON3': '0.650', 'WEAPON4': '0.650', 'weapon4': '0.868', 'weapon3': '2.216', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '11.490', 'FRAGCOUNT': '39.000'} [2023-02-25 13:26:43,038][36157] DAMAGECOUNT value on done: 203108.0 [2023-02-25 13:26:43,039][36157] Sum rewards: 56.807, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.926', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.011', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.070', 'AMMO3': '0.236', 'weapon2': '0.480', 'WEAPON3': '1.450', 'HITCOUNT': '2.920', 'weapon3': '3.190', 'DAMAGECOUNT': '14.475', 'FRAGCOUNT': '50.000'} [2023-02-25 13:26:43,154][36156] DAMAGECOUNT value on done: 198595.0 [2023-02-25 13:26:43,155][36156] Sum rewards: 45.542, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.331', 'AMMO5': '0.017', 'AMMO2': '0.021', 'weapon5': '0.096', 'AMMO4': '0.103', 'AMMO3': '0.171', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.570', 'weapon4': '0.594', 'WEAPON3': '1.050', 'weapon3': '2.580', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '11.751', 'FRAGCOUNT': '39.000'} [2023-02-25 13:26:43,170][36156] DAMAGECOUNT value on done: 201071.0 [2023-02-25 13:26:43,170][36156] Sum rewards: 45.858, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.996', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.036', 'AMMO3': '0.141', 'AMMO4': '0.178', 'weapon5': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.574', 'weapon2': '0.592', 'WEAPON3': '0.900', 'weapon3': '2.502', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '10.938', 'FRAGCOUNT': '39.000'} [2023-02-25 13:26:43,472][36156] DAMAGECOUNT value on done: 198228.0 [2023-02-25 13:26:43,472][36156] Sum rewards: 50.678, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.870', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon2': '0.126', 'weapon5': '0.176', 'AMMO3': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.822', 'WEAPON3': '1.150', 'weapon3': '2.204', 'HITCOUNT': '2.360', 'DAMAGECOUNT': '12.510', 'FRAGCOUNT': '46.000'} [2023-02-25 13:26:43,725][36142] DAMAGECOUNT value on done: 194953.0 [2023-02-25 13:26:43,726][36142] Sum rewards: 71.718, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.398', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.012', 'WEAPON4': '0.100', 'AMMO3': '0.168', 'weapon4': '0.302', 'weapon2': '0.418', 'WEAPON3': '1.050', 'weapon3': '3.136', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.933', 'FRAGCOUNT': '59.000'} [2023-02-25 13:26:44,024][36142] DAMAGECOUNT value on done: 198193.0 [2023-02-25 13:26:44,025][36142] Sum rewards: 57.478, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.416', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.156', 'AMMO3': '0.171', 'weapon2': '0.338', 'weapon4': '0.350', 'WEAPON3': '1.000', 'weapon3': '2.976', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.220', 'FRAGCOUNT': '46.500'} [2023-02-25 13:26:44,134][36138] Updated weights for policy 0, policy_version 39583 (0.0009) [2023-02-25 13:26:44,298][36142] DAMAGECOUNT value on done: 194538.0 [2023-02-25 13:26:44,298][36142] Sum rewards: 52.070, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.597', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon5': '0.156', 'AMMO3': '0.176', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.440', 'weapon2': '0.674', 'WEAPON3': '1.050', 'weapon3': '2.436', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '14.424', 'FRAGCOUNT': '46.000'} [2023-02-25 13:26:44,622][36142] DAMAGECOUNT value on done: 200455.0 [2023-02-25 13:26:44,623][36142] Sum rewards: 43.193, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.640', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.067', 'AMMO3': '0.171', 'weapon5': '0.306', 'AMMO4': '0.335', 'weapon2': '0.342', 'WEAPON5': '0.400', 'weapon4': '0.798', 'WEAPON4': '0.850', 'WEAPON3': '1.000', 'weapon3': '2.214', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.390', 'FRAGCOUNT': '41.000'} [2023-02-25 13:26:44,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13482.1). Total num frames: 162136064. Throughput: 0: 3367.0. Samples: 3028894. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:26:44,730][36114] Avg episode reward: [(0, '51.394')] [2023-02-25 13:26:47,140][36138] Updated weights for policy 0, policy_version 39593 (0.0009) [2023-02-25 13:26:49,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13482.1). Total num frames: 162205696. Throughput: 0: 3371.0. Samples: 3049302. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:26:49,730][36114] Avg episode reward: [(0, '51.394')] [2023-02-25 13:26:50,183][36138] Updated weights for policy 0, policy_version 39603 (0.0009) [2023-02-25 13:26:52,805][36154] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:26:53,196][36138] Updated weights for policy 0, policy_version 39613 (0.0009) [2023-02-25 13:26:54,729][36114] Fps is (10 sec: 13926.5, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 162275328. Throughput: 0: 3370.4. Samples: 3059396. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:26:54,729][36114] Avg episode reward: [(0, '51.394')] [2023-02-25 13:26:56,203][36138] Updated weights for policy 0, policy_version 39623 (0.0009) [2023-02-25 13:26:56,956][36155] DAMAGECOUNT value on done: 198920.0 [2023-02-25 13:26:56,957][36155] Sum rewards: 46.583, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.590', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.060', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'weapon2': '0.170', 'WEAPON4': '0.250', 'AMMO3': '0.257', 'weapon4': '0.304', 'WEAPON3': '1.500', 'HITCOUNT': '2.510', 'weapon3': '3.222', 'DAMAGECOUNT': '12.123', 'FRAGCOUNT': '45.000'} [2023-02-25 13:26:57,268][36155] DAMAGECOUNT value on done: 205668.0 [2023-02-25 13:26:57,269][36155] Sum rewards: 48.280, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.478', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO3': '0.107', 'AMMO4': '0.179', 'weapon2': '0.242', 'weapon5': '0.326', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '0.650', 'weapon4': '0.656', 'weapon3': '2.418', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '13.095', 'FRAGCOUNT': '39.500'} [2023-02-25 13:26:57,474][36155] DAMAGECOUNT value on done: 200921.0 [2023-02-25 13:26:57,475][36155] Sum rewards: 57.065, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.191', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO3': '0.127', 'AMMO4': '0.166', 'weapon5': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.544', 'weapon2': '0.578', 'WEAPON3': '0.800', 'weapon3': '2.372', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.712', 'FRAGCOUNT': '45.500'} [2023-02-25 13:26:57,644][36139] DAMAGECOUNT value on done: 199932.0 [2023-02-25 13:26:57,644][36139] Sum rewards: 60.036, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.433', 'AMMO2': '0.011', 'AMMO5': '0.012', 'AMMO4': '0.055', 'weapon5': '0.132', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.354', 'weapon4': '0.480', 'WEAPON3': '1.000', 'weapon3': '2.856', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.235', 'FRAGCOUNT': '50.000'} [2023-02-25 13:26:57,773][36155] DAMAGECOUNT value on done: 199681.0 [2023-02-25 13:26:57,774][36155] Sum rewards: 33.363, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.830', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon7': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.141', 'weapon5': '0.232', 'AMMO4': '0.238', 'weapon2': '0.266', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '0.800', 'weapon4': '0.900', 'weapon3': '1.872', 'HITCOUNT': '2.050', 'DAMAGECOUNT': '9.774', 'FRAGCOUNT': '31.000'} [2023-02-25 13:26:57,940][36139] DAMAGECOUNT value on done: 206569.0 [2023-02-25 13:26:57,940][36139] Sum rewards: 61.477, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.104', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'AMMO3': '0.184', 'weapon2': '0.288', 'weapon4': '0.308', 'ARMOR': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.104', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.946', 'FRAGCOUNT': '51.000'} [2023-02-25 13:26:58,167][36139] DAMAGECOUNT value on done: 203911.0 [2023-02-25 13:26:58,168][36139] Sum rewards: 52.588, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.570', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.027', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.224', 'weapon4': '0.238', 'weapon2': '0.748', 'WEAPON3': '1.400', 'weapon3': '2.780', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.995', 'FRAGCOUNT': '46.000'} [2023-02-25 13:26:58,467][36139] DAMAGECOUNT value on done: 200140.0 [2023-02-25 13:26:58,467][36139] Sum rewards: 46.356, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.516', 'ARMOR': '0.012', 'AMMO5': '0.023', 'AMMO2': '0.044', 'AMMO3': '0.089', 'AMMO4': '0.221', 'weapon5': '0.266', 'weapon2': '0.370', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.600', 'weapon4': '1.114', 'weapon3': '1.940', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '11.622', 'FRAGCOUNT': '37.000'} [2023-02-25 13:26:59,228][36138] Updated weights for policy 0, policy_version 39633 (0.0010) [2023-02-25 13:26:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13482.1). Total num frames: 162340864. Throughput: 0: 3381.2. Samples: 3079834. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:26:59,730][36114] Avg episode reward: [(0, '51.444')] [2023-02-25 13:27:00,343][36154] DAMAGECOUNT value on done: 206315.0 [2023-02-25 13:27:00,344][36154] Sum rewards: 58.589, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.660', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.023', 'AMMO2': '0.043', 'weapon5': '0.094', 'AMMO4': '0.215', 'AMMO3': '0.237', 'weapon2': '0.246', 'weapon4': '0.410', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.926', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.957', 'FRAGCOUNT': '53.500'} [2023-02-25 13:27:00,650][36154] DAMAGECOUNT value on done: 200197.0 [2023-02-25 13:27:00,650][36154] Sum rewards: 48.679, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.003', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon4': '0.134', 'weapon5': '0.160', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.696', 'WEAPON3': '1.050', 'HITCOUNT': '2.470', 'weapon3': '2.838', 'DAMAGECOUNT': '12.609', 'FRAGCOUNT': '41.000'} [2023-02-25 13:27:00,958][36154] DAMAGECOUNT value on done: 201216.0 [2023-02-25 13:27:00,959][36154] Sum rewards: 56.555, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.789', 'AMMO5': '0.006', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.030', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon2': '0.184', 'AMMO3': '0.228', 'WEAPON3': '1.350', 'HITCOUNT': '2.920', 'weapon3': '3.596', 'DAMAGECOUNT': '13.203', 'FRAGCOUNT': '50.000'} [2023-02-25 13:27:01,258][36154] DAMAGECOUNT value on done: 201286.0 [2023-02-25 13:27:01,258][36154] Sum rewards: 71.968, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.782', 'AMMO2': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.187', 'weapon2': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '3.410', 'weapon3': '3.424', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '59.000'} [2023-02-25 13:27:01,504][36140] DAMAGECOUNT value on done: 207335.0 [2023-02-25 13:27:01,504][36140] Sum rewards: 60.009, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.942', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.166', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'weapon4': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.792', 'WEAPON3': '1.100', 'weapon3': '2.456', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '51.000'} [2023-02-25 13:27:01,795][36157] DAMAGECOUNT value on done: 207360.0 [2023-02-25 13:27:01,795][36157] Sum rewards: 44.744, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.958', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.052', 'AMMO3': '0.150', 'weapon5': '0.234', 'AMMO4': '0.261', 'weapon4': '0.404', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon2': '0.882', 'WEAPON3': '0.900', 'weapon3': '2.216', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '13.206', 'FRAGCOUNT': '39.000'} [2023-02-25 13:27:01,810][36140] DAMAGECOUNT value on done: 201283.0 [2023-02-25 13:27:01,810][36140] Sum rewards: 52.800, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.922', 'AMMO5': '0.018', 'AMMO2': '0.029', 'weapon5': '0.102', 'AMMO4': '0.146', 'AMMO3': '0.192', 'weapon4': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.452', 'WEAPON3': '1.150', 'HITCOUNT': '2.940', 'weapon3': '3.018', 'DAMAGECOUNT': '13.914', 'FRAGCOUNT': '44.000'} [2023-02-25 13:27:01,871][36141] DAMAGECOUNT value on done: 206741.0 [2023-02-25 13:27:01,872][36141] Sum rewards: 45.639, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.884', 'ARMOR': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'weapon4': '0.124', 'weapon5': '0.142', 'AMMO4': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'weapon2': '0.546', 'WEAPON3': '1.150', 'HITCOUNT': '2.890', 'weapon3': '2.990', 'DAMAGECOUNT': '12.540', 'FRAGCOUNT': '39.000'} [2023-02-25 13:27:02,118][36157] DAMAGECOUNT value on done: 203701.0 [2023-02-25 13:27:02,118][36157] Sum rewards: 47.191, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.950', 'AMMO5': '0.014', 'AMMO2': '0.054', 'weapon5': '0.142', 'AMMO3': '0.197', 'AMMO4': '0.272', 'WEAPON5': '0.300', 'weapon2': '0.420', 'WEAPON4': '0.550', 'weapon4': '0.784', 'WEAPON3': '1.150', 'weapon3': '2.384', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.483', 'FRAGCOUNT': '44.000'} [2023-02-25 13:27:02,177][36141] DAMAGECOUNT value on done: 202031.0 [2023-02-25 13:27:02,177][36141] Sum rewards: 55.954, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.594', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.130', 'AMMO4': '0.141', 'weapon4': '0.228', 'AMMO3': '0.249', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.076', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '51.000'} [2023-02-25 13:27:02,261][36138] Updated weights for policy 0, policy_version 39643 (0.0009) [2023-02-25 13:27:02,278][36140] DAMAGECOUNT value on done: 199914.0 [2023-02-25 13:27:02,279][36140] Sum rewards: 45.537, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.865', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.053', 'AMMO3': '0.126', 'weapon2': '0.202', 'AMMO4': '0.263', 'weapon5': '0.312', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.840', 'WEAPON3': '0.850', 'weapon3': '2.370', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.123', 'FRAGCOUNT': '40.000'} [2023-02-25 13:27:02,323][36141] DAMAGECOUNT value on done: 202710.0 [2023-02-25 13:27:02,324][36141] Sum rewards: 49.588, reward structure: {'DEATHCOUNT': '-12.750', 'ARMOR': '0.004', 'AMMO5': '0.012', 'HEALTH': '0.020', 'AMMO2': '0.036', 'weapon5': '0.150', 'AMMO3': '0.155', 'AMMO4': '0.182', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.454', 'weapon2': '0.622', 'WEAPON3': '0.850', 'HITCOUNT': '2.480', 'weapon3': '2.548', 'DAMAGECOUNT': '13.074', 'FRAGCOUNT': '41.000'} [2023-02-25 13:27:02,484][36157] DAMAGECOUNT value on done: 207693.0 [2023-02-25 13:27:02,484][36157] Sum rewards: 46.305, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.556', 'AMMO5': '0.019', 'AMMO2': '0.044', 'AMMO3': '0.181', 'weapon5': '0.184', 'AMMO4': '0.218', 'weapon4': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.460', 'WEAPON3': '1.050', 'HITCOUNT': '2.510', 'weapon3': '2.840', 'DAMAGECOUNT': '11.805', 'FRAGCOUNT': '41.000'} [2023-02-25 13:27:02,574][36140] DAMAGECOUNT value on done: 198149.0 [2023-02-25 13:27:02,575][36140] Sum rewards: 46.031, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.838', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.175', 'weapon5': '0.326', 'weapon2': '0.332', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.736', 'WEAPON3': '1.050', 'weapon3': '2.262', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '12.006', 'FRAGCOUNT': '40.000'} [2023-02-25 13:27:02,636][36141] DAMAGECOUNT value on done: 194232.0 [2023-02-25 13:27:02,637][36141] Sum rewards: 40.524, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.740', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.022', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO3': '0.136', 'WEAPON3': '0.950', 'weapon2': '0.956', 'HITCOUNT': '2.260', 'weapon3': '2.776', 'DAMAGECOUNT': '9.852', 'FRAGCOUNT': '34.000'} [2023-02-25 13:27:02,722][36156] DAMAGECOUNT value on done: 207942.0 [2023-02-25 13:27:02,723][36156] Sum rewards: 51.662, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.207', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon4': '0.216', 'weapon2': '0.246', 'WEAPON3': '1.350', 'HITCOUNT': '2.860', 'weapon3': '3.178', 'DAMAGECOUNT': '13.668', 'FRAGCOUNT': '45.000'} [2023-02-25 13:27:02,782][36157] DAMAGECOUNT value on done: 207454.0 [2023-02-25 13:27:02,782][36157] Sum rewards: 43.454, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.625', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.224', 'weapon5': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.320', 'weapon4': '0.358', 'WEAPON3': '1.400', 'HITCOUNT': '2.730', 'weapon3': '2.742', 'DAMAGECOUNT': '13.038', 'FRAGCOUNT': '41.000'} [2023-02-25 13:27:03,037][36156] DAMAGECOUNT value on done: 202607.0 [2023-02-25 13:27:03,037][36156] Sum rewards: 45.114, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.398', 'AMMO5': '0.003', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'weapon5': '0.026', 'AMMO2': '0.038', 'weapon7': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.120', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO4': '0.191', 'WEAPON7': '0.200', 'WEAPON4': '0.450', 'weapon4': '0.666', 'weapon2': '0.756', 'WEAPON3': '0.850', 'weapon3': '2.332', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '12.036', 'FRAGCOUNT': '38.000'} [2023-02-25 13:27:03,078][36156] DAMAGECOUNT value on done: 205956.0 [2023-02-25 13:27:03,079][36156] Sum rewards: 56.131, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.390', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO4': '0.137', 'weapon2': '0.162', 'weapon5': '0.206', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.396', 'WEAPON3': '1.300', 'HITCOUNT': '2.900', 'weapon3': '2.916', 'DAMAGECOUNT': '14.655', 'FRAGCOUNT': '50.000'} [2023-02-25 13:27:03,374][36156] DAMAGECOUNT value on done: 202844.0 [2023-02-25 13:27:03,375][36156] Sum rewards: 57.662, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.201', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.016', 'AMMO4': '0.033', 'weapon4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.170', 'weapon2': '0.486', 'WEAPON3': '1.100', 'HITCOUNT': '2.900', 'weapon3': '3.280', 'DAMAGECOUNT': '13.848', 'FRAGCOUNT': '48.000'} [2023-02-25 13:27:03,558][36142] DAMAGECOUNT value on done: 199610.0 [2023-02-25 13:27:03,558][36142] Sum rewards: 52.435, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.130', 'AMMO4': '0.176', 'AMMO3': '0.186', 'weapon2': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.716', 'HEALTH': '0.725', 'WEAPON3': '1.050', 'weapon3': '2.720', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.971', 'FRAGCOUNT': '44.000'} [2023-02-25 13:27:03,860][36142] DAMAGECOUNT value on done: 202909.0 [2023-02-25 13:27:03,861][36142] Sum rewards: 60.454, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.386', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon5': '0.088', 'AMMO4': '0.108', 'weapon2': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon4': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '3.090', 'weapon3': '3.158', 'DAMAGECOUNT': '14.148', 'FRAGCOUNT': '53.000'} [2023-02-25 13:27:04,151][36142] DAMAGECOUNT value on done: 198426.0 [2023-02-25 13:27:04,152][36142] Sum rewards: 43.250, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.322', 'AMMO5': '0.018', 'AMMO2': '0.038', 'AMMO3': '0.161', 'AMMO4': '0.192', 'weapon2': '0.322', 'weapon5': '0.380', 'weapon4': '0.430', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'HITCOUNT': '2.200', 'weapon3': '2.566', 'DAMAGECOUNT': '11.664', 'FRAGCOUNT': '37.500'} [2023-02-25 13:27:04,467][36142] DAMAGECOUNT value on done: 205325.0 [2023-02-25 13:27:04,468][36142] Sum rewards: 55.792, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.796', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.052', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'weapon4': '0.252', 'AMMO3': '0.262', 'weapon2': '0.470', 'WEAPON3': '1.400', 'weapon3': '2.988', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.610', 'FRAGCOUNT': '49.000'} [2023-02-25 13:27:04,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 162410496. Throughput: 0: 3385.6. Samples: 3100150. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:27:04,730][36114] Avg episode reward: [(0, '51.832')] [2023-02-25 13:27:05,330][36138] Updated weights for policy 0, policy_version 39653 (0.0009) [2023-02-25 13:27:08,338][36138] Updated weights for policy 0, policy_version 39663 (0.0010) [2023-02-25 13:27:09,729][36114] Fps is (10 sec: 13517.0, 60 sec: 13516.8, 300 sec: 13482.1). Total num frames: 162476032. Throughput: 0: 3388.0. Samples: 3110332. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:27:09,730][36114] Avg episode reward: [(0, '51.832')] [2023-02-25 13:27:11,378][36138] Updated weights for policy 0, policy_version 39673 (0.0010) [2023-02-25 13:27:14,368][36138] Updated weights for policy 0, policy_version 39683 (0.0009) [2023-02-25 13:27:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13496.0). Total num frames: 162545664. Throughput: 0: 3389.3. Samples: 3130686. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:27:14,730][36114] Avg episode reward: [(0, '51.832')] [2023-02-25 13:27:16,788][36155] DAMAGECOUNT value on done: 203464.0 [2023-02-25 13:27:16,789][36155] Sum rewards: 54.256, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.654', 'ARMOR': '0.004', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon5': '0.092', 'AMMO4': '0.119', 'weapon4': '0.168', 'AMMO3': '0.190', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.150', 'HITCOUNT': '2.860', 'weapon3': '3.212', 'DAMAGECOUNT': '13.632', 'FRAGCOUNT': '47.000'} [2023-02-25 13:27:17,110][36155] DAMAGECOUNT value on done: 210381.0 [2023-02-25 13:27:17,111][36155] Sum rewards: 52.543, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.392', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.038', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'weapon4': '0.126', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.438', 'WEAPON3': '1.250', 'HITCOUNT': '2.860', 'weapon3': '3.222', 'DAMAGECOUNT': '14.139', 'FRAGCOUNT': '45.000'} [2023-02-25 13:27:17,319][36155] DAMAGECOUNT value on done: 206297.0 [2023-02-25 13:27:17,320][36155] Sum rewards: 58.178, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.810', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.210', 'weapon2': '0.210', 'WEAPON4': '0.350', 'weapon4': '0.476', 'WEAPON3': '1.250', 'weapon3': '2.968', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.128', 'FRAGCOUNT': '52.000'} [2023-02-25 13:27:17,418][36138] Updated weights for policy 0, policy_version 39693 (0.0009) [2023-02-25 13:27:17,521][36139] DAMAGECOUNT value on done: 204743.0 [2023-02-25 13:27:17,521][36139] Sum rewards: 46.937, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.270', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'weapon4': '0.588', 'weapon2': '0.696', 'WEAPON3': '1.550', 'weapon3': '2.326', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.433', 'FRAGCOUNT': '44.000'} [2023-02-25 13:27:17,645][36155] DAMAGECOUNT value on done: 203771.0 [2023-02-25 13:27:17,646][36155] Sum rewards: 45.749, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.991', 'AMMO5': '0.004', 'AMMO2': '0.019', 'weapon5': '0.030', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.212', 'AMMO3': '0.223', 'weapon2': '0.332', 'WEAPON3': '1.400', 'HITCOUNT': '2.810', 'weapon3': '3.296', 'DAMAGECOUNT': '12.270', 'FRAGCOUNT': '42.000'} [2023-02-25 13:27:17,842][36139] DAMAGECOUNT value on done: 210530.0 [2023-02-25 13:27:17,842][36139] Sum rewards: 43.478, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.857', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.086', 'AMMO4': '0.112', 'weapon4': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.258', 'weapon2': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '2.680', 'weapon3': '3.162', 'DAMAGECOUNT': '11.883', 'FRAGCOUNT': '42.000'} [2023-02-25 13:27:18,015][36139] DAMAGECOUNT value on done: 208321.0 [2023-02-25 13:27:18,016][36139] Sum rewards: 57.812, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.749', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon5': '0.078', 'AMMO4': '0.103', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'weapon4': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.484', 'WEAPON3': '1.200', 'HITCOUNT': '2.800', 'weapon3': '3.032', 'DAMAGECOUNT': '13.230', 'FRAGCOUNT': '50.000'} [2023-02-25 13:27:18,300][36139] DAMAGECOUNT value on done: 204372.0 [2023-02-25 13:27:18,302][36139] Sum rewards: 51.917, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.833', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'weapon5': '0.118', 'AMMO3': '0.149', 'WEAPON4': '0.200', 'weapon2': '0.288', 'weapon4': '0.886', 'WEAPON3': '0.900', 'weapon3': '2.444', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.696', 'FRAGCOUNT': '41.000'} [2023-02-25 13:27:19,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 162611200. Throughput: 0: 3383.7. Samples: 3150740. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:27:19,730][36114] Avg episode reward: [(0, '51.630')] [2023-02-25 13:27:19,733][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000039700_162611200.pth... [2023-02-25 13:27:19,787][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000038910_159375360.pth [2023-02-25 13:27:20,078][36154] DAMAGECOUNT value on done: 208225.0 [2023-02-25 13:27:20,079][36154] Sum rewards: 24.276, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.424', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon7': '0.072', 'AMMO3': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.124', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'weapon2': '0.182', 'WEAPON4': '0.200', 'WEAPON3': '0.500', 'weapon4': '0.594', 'HITCOUNT': '1.080', 'weapon3': '1.260', 'DAMAGECOUNT': '5.730', 'FRAGCOUNT': '21.000'} [2023-02-25 13:27:20,390][36154] DAMAGECOUNT value on done: 205087.0 [2023-02-25 13:27:20,390][36154] Sum rewards: 64.804, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO2': '0.001', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO4': '0.006', 'WEAPON5': '0.100', 'AMMO3': '0.191', 'weapon2': '0.244', 'HEALTH': '0.708', 'WEAPON3': '1.050', 'HITCOUNT': '3.190', 'weapon3': '3.632', 'DAMAGECOUNT': '14.670', 'FRAGCOUNT': '53.000'} [2023-02-25 13:27:20,504][36138] Updated weights for policy 0, policy_version 39703 (0.0010) [2023-02-25 13:27:20,702][36154] DAMAGECOUNT value on done: 205986.0 [2023-02-25 13:27:20,702][36154] Sum rewards: 48.754, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.705', 'AMMO5': '0.024', 'AMMO2': '0.065', 'AMMO3': '0.159', 'weapon5': '0.174', 'AMMO4': '0.326', 'WEAPON5': '0.500', 'weapon2': '0.694', 'WEAPON4': '0.750', 'weapon4': '0.784', 'WEAPON3': '1.050', 'weapon3': '2.010', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.202', 'FRAGCOUNT': '46.000'} [2023-02-25 13:27:21,012][36154] DAMAGECOUNT value on done: 206014.0 [2023-02-25 13:27:21,013][36154] Sum rewards: 50.231, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.550', 'AMMO5': '0.022', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.212', 'weapon4': '0.250', 'weapon2': '0.270', 'AMMO3': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.962', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.184', 'FRAGCOUNT': '48.000'} [2023-02-25 13:27:21,541][36140] DAMAGECOUNT value on done: 211056.0 [2023-02-25 13:27:21,542][36140] Sum rewards: 44.035, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.394', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.172', 'weapon5': '0.190', 'WEAPON4': '0.250', 'weapon2': '0.260', 'WEAPON5': '0.350', 'weapon4': '0.552', 'WEAPON3': '1.050', 'HITCOUNT': '2.560', 'weapon3': '2.702', 'DAMAGECOUNT': '11.163', 'FRAGCOUNT': '38.000'} [2023-02-25 13:27:21,745][36141] DAMAGECOUNT value on done: 211154.0 [2023-02-25 13:27:21,745][36141] Sum rewards: 43.788, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-4.255', 'AMMO5': '0.016', 'AMMO2': '0.063', 'weapon2': '0.234', 'AMMO3': '0.278', 'weapon5': '0.300', 'AMMO4': '0.316', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'weapon4': '0.768', 'WEAPON3': '1.600', 'weapon3': '2.228', 'HITCOUNT': '2.450', 'DAMAGECOUNT': '13.239', 'FRAGCOUNT': '45.000'} [2023-02-25 13:27:21,867][36140] DAMAGECOUNT value on done: 205670.0 [2023-02-25 13:27:21,868][36140] Sum rewards: 49.014, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.030', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.145', 'AMMO4': '0.168', 'weapon2': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.266', 'weapon4': '0.692', 'WEAPON3': '0.900', 'weapon3': '2.586', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '13.161', 'FRAGCOUNT': '40.000'} [2023-02-25 13:27:21,908][36157] DAMAGECOUNT value on done: 211979.0 [2023-02-25 13:27:21,909][36157] Sum rewards: 54.200, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.810', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.204', 'weapon4': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.688', 'WEAPON3': '1.200', 'weapon3': '2.866', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.857', 'FRAGCOUNT': '46.000'} [2023-02-25 13:27:22,052][36141] DAMAGECOUNT value on done: 206343.0 [2023-02-25 13:27:22,053][36141] Sum rewards: 47.176, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.040', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon4': '0.070', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.484', 'WEAPON3': '1.250', 'HITCOUNT': '2.380', 'weapon3': '3.076', 'DAMAGECOUNT': '12.936', 'FRAGCOUNT': '41.000'} [2023-02-25 13:27:22,157][36141] DAMAGECOUNT value on done: 206573.0 [2023-02-25 13:27:22,157][36141] Sum rewards: 42.620, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.947', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.142', 'AMMO3': '0.214', 'weapon4': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.654', 'WEAPON3': '1.250', 'HITCOUNT': '2.360', 'weapon3': '2.738', 'DAMAGECOUNT': '11.589', 'FRAGCOUNT': '39.000'} [2023-02-25 13:27:22,212][36157] DAMAGECOUNT value on done: 208045.0 [2023-02-25 13:27:22,212][36157] Sum rewards: 39.964, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.630', 'AMMO5': '0.018', 'AMMO2': '0.036', 'weapon5': '0.110', 'weapon4': '0.116', 'AMMO4': '0.178', 'AMMO3': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON3': '1.450', 'HITCOUNT': '2.680', 'weapon3': '3.156', 'DAMAGECOUNT': '13.032', 'FRAGCOUNT': '37.000'} [2023-02-25 13:27:22,231][36140] DAMAGECOUNT value on done: 205430.0 [2023-02-25 13:27:22,231][36140] Sum rewards: 72.372, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.380', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.018', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon2': '0.624', 'WEAPON3': '1.050', 'weapon3': '3.258', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.548', 'FRAGCOUNT': '58.000'} [2023-02-25 13:27:22,466][36141] DAMAGECOUNT value on done: 199053.0 [2023-02-25 13:27:22,467][36141] Sum rewards: 52.114, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.370', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.142', 'AMMO4': '0.158', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.426', 'ARMOR': '0.456', 'weapon2': '0.472', 'WEAPON3': '1.200', 'HITCOUNT': '2.640', 'weapon3': '2.678', 'DAMAGECOUNT': '14.463', 'FRAGCOUNT': '46.000'} [2023-02-25 13:27:22,536][36140] DAMAGECOUNT value on done: 202402.0 [2023-02-25 13:27:22,536][36140] Sum rewards: 57.519, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.302', 'AMMO5': '0.003', 'AMMO2': '0.035', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.162', 'AMMO4': '0.173', 'weapon4': '0.214', 'WEAPON4': '0.350', 'weapon2': '0.582', 'WEAPON3': '0.900', 'HITCOUNT': '2.770', 'weapon3': '2.970', 'DAMAGECOUNT': '12.759', 'FRAGCOUNT': '51.000'} [2023-02-25 13:27:22,538][36157] DAMAGECOUNT value on done: 212361.0 [2023-02-25 13:27:22,539][36157] Sum rewards: 53.782, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.440', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.068', 'AMMO3': '0.144', 'weapon5': '0.264', 'weapon2': '0.280', 'AMMO4': '0.339', 'weapon4': '0.398', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.764', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.004', 'FRAGCOUNT': '46.000'} [2023-02-25 13:27:22,793][36156] DAMAGECOUNT value on done: 213052.0 [2023-02-25 13:27:22,793][36156] Sum rewards: 57.400, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.244', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.184', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.350', 'weapon4': '0.360', 'WEAPON3': '1.350', 'weapon3': '2.848', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '51.000'} [2023-02-25 13:27:22,858][36157] DAMAGECOUNT value on done: 211763.0 [2023-02-25 13:27:22,859][36157] Sum rewards: 48.974, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.508', 'AMMO5': '0.016', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.568', 'WEAPON3': '1.050', 'weapon3': '2.820', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.927', 'FRAGCOUNT': '41.000'} [2023-02-25 13:27:23,097][36156] DAMAGECOUNT value on done: 210522.0 [2023-02-25 13:27:23,098][36156] Sum rewards: 51.492, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.678', 'ARMOR': '0.013', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon4': '0.136', 'AMMO3': '0.161', 'weapon5': '0.164', 'AMMO4': '0.264', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.528', 'WEAPON3': '0.900', 'HITCOUNT': '2.560', 'weapon3': '2.826', 'DAMAGECOUNT': '13.698', 'FRAGCOUNT': '45.000'} [2023-02-25 13:27:23,106][36156] DAMAGECOUNT value on done: 207007.0 [2023-02-25 13:27:23,106][36156] Sum rewards: 44.004, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.078', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.176', 'weapon5': '0.228', 'WEAPON5': '0.450', 'weapon2': '0.492', 'WEAPON4': '0.550', 'weapon4': '0.638', 'WEAPON3': '1.100', 'weapon3': '2.378', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.200', 'FRAGCOUNT': '39.000'} [2023-02-25 13:27:23,405][36156] DAMAGECOUNT value on done: 207283.0 [2023-02-25 13:27:23,405][36156] Sum rewards: 50.348, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.605', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.029', 'AMMO4': '0.147', 'AMMO3': '0.179', 'weapon5': '0.204', 'weapon2': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.340', 'WEAPON3': '1.150', 'HITCOUNT': '2.490', 'weapon3': '2.992', 'DAMAGECOUNT': '13.317', 'FRAGCOUNT': '44.000'} [2023-02-25 13:27:23,511][36138] Updated weights for policy 0, policy_version 39713 (0.0009) [2023-02-25 13:27:23,595][36142] DAMAGECOUNT value on done: 202952.0 [2023-02-25 13:27:23,595][36142] Sum rewards: 39.318, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.784', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.049', 'AMMO3': '0.125', 'weapon5': '0.240', 'AMMO4': '0.245', 'weapon4': '0.484', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'weapon2': '0.716', 'WEAPON3': '0.800', 'weapon3': '2.260', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '10.026', 'FRAGCOUNT': '35.500'} [2023-02-25 13:27:23,909][36142] DAMAGECOUNT value on done: 207776.0 [2023-02-25 13:27:23,909][36142] Sum rewards: 54.651, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.055', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.029', 'weapon5': '0.096', 'AMMO4': '0.144', 'AMMO3': '0.166', 'weapon2': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.648', 'WEAPON3': '1.000', 'weapon3': '2.630', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.601', 'FRAGCOUNT': '45.000'} [2023-02-25 13:27:24,149][36142] DAMAGECOUNT value on done: 202981.0 [2023-02-25 13:27:24,150][36142] Sum rewards: 53.865, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.813', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.012', 'AMMO4': '0.042', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'weapon2': '0.302', 'WEAPON3': '1.350', 'HITCOUNT': '2.840', 'weapon3': '3.420', 'DAMAGECOUNT': '13.665', 'FRAGCOUNT': '47.000'} [2023-02-25 13:27:24,475][36142] DAMAGECOUNT value on done: 210524.0 [2023-02-25 13:27:24,475][36142] Sum rewards: 58.894, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.022', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.166', 'weapon2': '0.202', 'AMMO3': '0.282', 'weapon4': '0.318', 'WEAPON3': '1.600', 'weapon3': '3.082', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '52.000'} [2023-02-25 13:27:24,729][36114] Fps is (10 sec: 13517.0, 60 sec: 13585.1, 300 sec: 13496.0). Total num frames: 162680832. Throughput: 0: 3381.7. Samples: 3160768. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:27:24,729][36114] Avg episode reward: [(0, '51.210')] [2023-02-25 13:27:26,553][36138] Updated weights for policy 0, policy_version 39723 (0.0009) [2023-02-25 13:27:29,571][36138] Updated weights for policy 0, policy_version 39733 (0.0009) [2023-02-25 13:27:29,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 162746368. Throughput: 0: 3383.7. Samples: 3181160. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:27:29,729][36114] Avg episode reward: [(0, '51.210')] [2023-02-25 13:27:32,602][36138] Updated weights for policy 0, policy_version 39743 (0.0009) [2023-02-25 13:27:34,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13585.1, 300 sec: 13496.0). Total num frames: 162816000. Throughput: 0: 3381.3. Samples: 3201462. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:27:34,730][36114] Avg episode reward: [(0, '51.210')] [2023-02-25 13:27:35,560][36138] Updated weights for policy 0, policy_version 39753 (0.0010) [2023-02-25 13:27:36,640][36155] DAMAGECOUNT value on done: 207869.0 [2023-02-25 13:27:36,640][36155] Sum rewards: 48.262, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.363', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.116', 'AMMO4': '0.155', 'weapon2': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'WEAPON4': '0.350', 'weapon4': '0.904', 'WEAPON3': '1.450', 'weapon3': '2.430', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.215', 'FRAGCOUNT': '45.000'} [2023-02-25 13:27:36,947][36155] DAMAGECOUNT value on done: 215080.0 [2023-02-25 13:27:36,948][36155] Sum rewards: 46.714, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.370', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.096', 'AMMO4': '0.096', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'WEAPON4': '0.400', 'weapon2': '0.412', 'weapon4': '0.676', 'WEAPON3': '1.400', 'weapon3': '2.590', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.097', 'FRAGCOUNT': '42.000'} [2023-02-25 13:27:37,171][36155] DAMAGECOUNT value on done: 210262.0 [2023-02-25 13:27:37,172][36155] Sum rewards: 42.694, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.076', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.047', 'AMMO4': '0.234', 'AMMO3': '0.240', 'WEAPON5': '0.300', 'weapon5': '0.312', 'weapon2': '0.448', 'WEAPON4': '0.450', 'weapon4': '0.666', 'WEAPON3': '1.400', 'weapon3': '2.232', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '11.895', 'FRAGCOUNT': '43.000'} [2023-02-25 13:27:37,433][36139] DAMAGECOUNT value on done: 209697.0 [2023-02-25 13:27:37,434][36139] Sum rewards: 58.312, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.022', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.034', 'AMMO4': '0.168', 'weapon2': '0.270', 'AMMO3': '0.271', 'weapon5': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.506', 'WEAPON3': '1.600', 'weapon3': '2.574', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '56.000'} [2023-02-25 13:27:37,478][36155] DAMAGECOUNT value on done: 208758.0 [2023-02-25 13:27:37,479][36155] Sum rewards: 59.056, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.426', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.128', 'AMMO4': '0.135', 'AMMO3': '0.207', 'weapon5': '0.218', 'weapon2': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.990', 'weapon3': '3.142', 'DAMAGECOUNT': '14.961', 'FRAGCOUNT': '51.000'} [2023-02-25 13:27:37,757][36139] DAMAGECOUNT value on done: 214168.0 [2023-02-25 13:27:37,758][36139] Sum rewards: 38.641, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.850', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon5': '0.064', 'WEAPON5': '0.100', 'weapon2': '0.170', 'WEAPON4': '0.200', 'AMMO3': '0.261', 'weapon4': '0.362', 'WEAPON3': '1.450', 'HITCOUNT': '2.550', 'weapon3': '3.128', 'DAMAGECOUNT': '10.914', 'FRAGCOUNT': '37.000'} [2023-02-25 13:27:37,910][36139] DAMAGECOUNT value on done: 212708.0 [2023-02-25 13:27:37,910][36139] Sum rewards: 38.793, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.842', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.131', 'WEAPON5': '0.200', 'weapon5': '0.220', 'AMMO3': '0.273', 'WEAPON4': '0.350', 'weapon4': '0.442', 'weapon2': '0.534', 'WEAPON3': '1.650', 'weapon3': '2.506', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '13.161', 'FRAGCOUNT': '37.000'} [2023-02-25 13:27:38,213][36139] DAMAGECOUNT value on done: 209122.0 [2023-02-25 13:27:38,213][36139] Sum rewards: 58.662, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.129', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.060', 'AMMO4': '0.121', 'AMMO3': '0.162', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.414', 'weapon2': '0.544', 'WEAPON3': '1.000', 'weapon3': '2.738', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.250', 'FRAGCOUNT': '49.000'} [2023-02-25 13:27:38,606][36138] Updated weights for policy 0, policy_version 39763 (0.0009) [2023-02-25 13:27:39,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 162881536. Throughput: 0: 3383.5. Samples: 3211654. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:27:39,730][36114] Avg episode reward: [(0, '51.131')] [2023-02-25 13:27:39,772][36142] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 13:27:39,951][36154] DAMAGECOUNT value on done: 213616.0 [2023-02-25 13:27:39,952][36154] Sum rewards: 62.633, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.120', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.064', 'AMMO4': '0.101', 'weapon5': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.268', 'weapon2': '0.356', 'WEAPON3': '1.450', 'weapon3': '3.182', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.011', 'FRAGCOUNT': '55.000'} [2023-02-25 13:27:40,254][36154] DAMAGECOUNT value on done: 209487.0 [2023-02-25 13:27:40,254][36154] Sum rewards: 59.818, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.882', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.032', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon5': '0.210', 'WEAPON5': '0.250', 'weapon4': '0.472', 'weapon2': '0.560', 'WEAPON3': '1.150', 'weapon3': '2.542', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.200', 'FRAGCOUNT': '51.000'} [2023-02-25 13:27:40,566][36154] DAMAGECOUNT value on done: 210727.0 [2023-02-25 13:27:40,567][36154] Sum rewards: 56.984, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.921', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.060', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'weapon2': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon4': '0.354', 'WEAPON3': '1.250', 'HITCOUNT': '2.920', 'weapon3': '3.228', 'DAMAGECOUNT': '13.968', 'FRAGCOUNT': '49.000'} [2023-02-25 13:27:40,859][36154] DAMAGECOUNT value on done: 210699.0 [2023-02-25 13:27:40,860][36154] Sum rewards: 52.196, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.010', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.092', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.280', 'weapon4': '0.466', 'WEAPON3': '1.450', 'HITCOUNT': '2.810', 'weapon3': '2.982', 'DAMAGECOUNT': '14.055', 'FRAGCOUNT': '46.000'} [2023-02-25 13:27:41,426][36140] DAMAGECOUNT value on done: 215285.0 [2023-02-25 13:27:41,426][36140] Sum rewards: 36.958, reward structure: {'DEATHCOUNT': '-24.000', 'HEALTH': '-3.314', 'ARMOR': '0.012', 'AMMO5': '0.019', 'AMMO2': '0.046', 'AMMO4': '0.231', 'weapon2': '0.246', 'weapon5': '0.288', 'AMMO3': '0.337', 'WEAPON5': '0.350', 'weapon4': '0.362', 'WEAPON4': '0.450', 'WEAPON3': '1.900', 'HITCOUNT': '2.660', 'weapon3': '2.684', 'DAMAGECOUNT': '12.687', 'FRAGCOUNT': '42.000'} [2023-02-25 13:27:41,627][36141] DAMAGECOUNT value on done: 216018.0 [2023-02-25 13:27:41,628][36141] Sum rewards: 56.998, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.525', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.134', 'weapon2': '0.146', 'AMMO3': '0.211', 'weapon4': '0.324', 'WEAPON3': '1.300', 'HITCOUNT': '2.780', 'weapon3': '3.224', 'DAMAGECOUNT': '14.592', 'FRAGCOUNT': '49.000'} [2023-02-25 13:27:41,665][36138] Updated weights for policy 0, policy_version 39773 (0.0010) [2023-02-25 13:27:41,742][36140] DAMAGECOUNT value on done: 210133.0 [2023-02-25 13:27:41,743][36140] Sum rewards: 54.056, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.758', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon5': '0.160', 'AMMO3': '0.198', 'AMMO4': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.286', 'WEAPON5': '0.300', 'weapon4': '0.894', 'WEAPON3': '1.150', 'weapon3': '2.318', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.389', 'FRAGCOUNT': '47.000'} [2023-02-25 13:27:41,858][36157] DAMAGECOUNT value on done: 216849.0 [2023-02-25 13:27:41,859][36157] Sum rewards: 50.925, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.240', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.034', 'AMMO3': '0.161', 'AMMO4': '0.169', 'weapon2': '0.236', 'weapon5': '0.280', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.942', 'WEAPON3': '1.000', 'weapon3': '2.132', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.610', 'FRAGCOUNT': '44.000'} [2023-02-25 13:27:41,928][36141] DAMAGECOUNT value on done: 210564.0 [2023-02-25 13:27:41,928][36141] Sum rewards: 46.600, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.858', 'ARMOR': '0.004', 'AMMO2': '0.014', 'AMMO5': '0.017', 'WEAPON4': '0.050', 'weapon4': '0.060', 'AMMO4': '0.072', 'weapon5': '0.104', 'weapon2': '0.166', 'AMMO3': '0.215', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.640', 'weapon3': '3.452', 'DAMAGECOUNT': '12.663', 'FRAGCOUNT': '41.000'} [2023-02-25 13:27:42,003][36141] DAMAGECOUNT value on done: 211179.0 [2023-02-25 13:27:42,003][36141] Sum rewards: 59.237, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.175', 'AMMO5': '0.004', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.020', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'weapon2': '0.356', 'WEAPON3': '1.250', 'HITCOUNT': '2.990', 'weapon3': '3.494', 'DAMAGECOUNT': '13.818', 'FRAGCOUNT': '51.000'} [2023-02-25 13:27:42,124][36140] DAMAGECOUNT value on done: 209864.0 [2023-02-25 13:27:42,124][36140] Sum rewards: 56.056, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.592', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'weapon5': '0.064', 'AMMO3': '0.138', 'WEAPON5': '0.150', 'weapon4': '0.364', 'weapon2': '0.418', 'WEAPON3': '0.850', 'HITCOUNT': '2.460', 'weapon3': '3.000', 'DAMAGECOUNT': '13.101', 'FRAGCOUNT': '45.000'} [2023-02-25 13:27:42,157][36157] DAMAGECOUNT value on done: 212832.0 [2023-02-25 13:27:42,158][36157] Sum rewards: 54.106, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.049', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.117', 'AMMO3': '0.126', 'WEAPON5': '0.200', 'weapon5': '0.234', 'weapon2': '0.302', 'WEAPON4': '0.400', 'WEAPON3': '0.700', 'weapon4': '0.800', 'weapon3': '2.462', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.361', 'FRAGCOUNT': '42.500'} [2023-02-25 13:27:42,315][36141] DAMAGECOUNT value on done: 203972.0 [2023-02-25 13:27:42,316][36141] Sum rewards: 51.500, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.890', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'weapon4': '0.192', 'AMMO3': '0.226', 'WEAPON4': '0.350', 'weapon2': '0.572', 'WEAPON3': '1.400', 'weapon3': '2.916', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.757', 'FRAGCOUNT': '47.000'} [2023-02-25 13:27:42,418][36140] DAMAGECOUNT value on done: 207295.0 [2023-02-25 13:27:42,419][36140] Sum rewards: 59.447, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.858', 'AMMO2': '0.014', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.254', 'weapon2': '0.642', 'WEAPON3': '1.450', 'weapon3': '3.178', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '14.679', 'FRAGCOUNT': '53.000'} [2023-02-25 13:27:42,479][36157] DAMAGECOUNT value on done: 217237.0 [2023-02-25 13:27:42,479][36157] Sum rewards: 54.961, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.147', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO3': '0.168', 'AMMO4': '0.196', 'weapon5': '0.198', 'weapon2': '0.212', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.776', 'WEAPON3': '1.050', 'weapon3': '2.460', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.628', 'FRAGCOUNT': '47.000'} [2023-02-25 13:27:42,502][36156] DAMAGECOUNT value on done: 218007.0 [2023-02-25 13:27:42,503][36156] Sum rewards: 59.451, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.550', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.084', 'AMMO4': '0.118', 'AMMO3': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.254', 'weapon4': '0.318', 'WEAPON3': '0.900', 'HITCOUNT': '3.020', 'weapon3': '3.112', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '48.000'} [2023-02-25 13:27:42,779][36157] DAMAGECOUNT value on done: 216400.0 [2023-02-25 13:27:42,779][36157] Sum rewards: 51.026, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.220', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon5': '0.078', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon2': '0.214', 'WEAPON4': '0.250', 'weapon4': '0.398', 'WEAPON3': '1.150', 'HITCOUNT': '2.840', 'weapon3': '2.966', 'DAMAGECOUNT': '13.911', 'FRAGCOUNT': '43.000'} [2023-02-25 13:27:42,793][36156] DAMAGECOUNT value on done: 216089.0 [2023-02-25 13:27:42,794][36156] Sum rewards: 62.644, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.754', 'AMMO5': '0.020', 'AMMO2': '0.052', 'AMMO3': '0.152', 'AMMO4': '0.258', 'weapon5': '0.386', 'weapon2': '0.410', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'weapon4': '0.702', 'WEAPON3': '0.950', 'weapon3': '2.176', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '52.000'} [2023-02-25 13:27:42,813][36156] DAMAGECOUNT value on done: 211240.0 [2023-02-25 13:27:42,814][36156] Sum rewards: 50.505, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.130', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'weapon4': '0.104', 'weapon5': '0.146', 'AMMO4': '0.175', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.304', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.570', 'weapon3': '2.754', 'DAMAGECOUNT': '12.699', 'FRAGCOUNT': '46.000'} [2023-02-25 13:27:43,050][36141] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-25 13:27:43,112][36156] DAMAGECOUNT value on done: 212304.0 [2023-02-25 13:27:43,113][36156] Sum rewards: 59.276, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.950', 'ARMOR': '0.005', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.128', 'AMMO3': '0.172', 'weapon2': '0.186', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.562', 'WEAPON3': '1.100', 'weapon3': '2.906', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '50.000'} [2023-02-25 13:27:43,625][36142] DAMAGECOUNT value on done: 207161.0 [2023-02-25 13:27:43,626][36142] Sum rewards: 46.986, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.715', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO4': '0.171', 'AMMO3': '0.190', 'weapon2': '0.240', 'weapon5': '0.368', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.956', 'WEAPON3': '1.100', 'weapon3': '1.990', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.627', 'FRAGCOUNT': '41.000'} [2023-02-25 13:27:43,939][36142] DAMAGECOUNT value on done: 212558.0 [2023-02-25 13:27:43,939][36142] Sum rewards: 58.671, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.115', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.189', 'weapon5': '0.234', 'weapon2': '0.272', 'weapon4': '0.318', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.770', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.346', 'FRAGCOUNT': '52.000'} [2023-02-25 13:27:44,143][36142] DAMAGECOUNT value on done: 207030.0 [2023-02-25 13:27:44,144][36142] Sum rewards: 37.994, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.780', 'ARMOR': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'weapon5': '0.118', 'AMMO4': '0.165', 'AMMO3': '0.256', 'weapon4': '0.318', 'WEAPON4': '0.400', 'weapon2': '0.490', 'WEAPON3': '1.450', 'HITCOUNT': '2.550', 'weapon3': '2.778', 'DAMAGECOUNT': '12.087', 'FRAGCOUNT': '38.000'} [2023-02-25 13:27:44,451][36142] DAMAGECOUNT value on done: 214924.0 [2023-02-25 13:27:44,452][36142] Sum rewards: 45.667, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.455', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.038', 'AMMO3': '0.180', 'AMMO4': '0.189', 'weapon2': '0.218', 'weapon5': '0.336', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'weapon4': '0.874', 'WEAPON3': '1.150', 'weapon3': '2.328', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.164', 'FRAGCOUNT': '42.000'} [2023-02-25 13:27:44,698][36138] Updated weights for policy 0, policy_version 39783 (0.0010) [2023-02-25 13:27:44,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13585.1, 300 sec: 13496.0). Total num frames: 162951168. Throughput: 0: 3378.5. Samples: 3231868. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:27:44,730][36114] Avg episode reward: [(0, '51.566')] [2023-02-25 13:27:47,657][36138] Updated weights for policy 0, policy_version 39793 (0.0010) [2023-02-25 13:27:49,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13482.1). Total num frames: 163016704. Throughput: 0: 3382.0. Samples: 3252342. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:27:49,730][36114] Avg episode reward: [(0, '51.566')] [2023-02-25 13:27:50,704][36138] Updated weights for policy 0, policy_version 39803 (0.0010) [2023-02-25 13:27:53,719][36138] Updated weights for policy 0, policy_version 39813 (0.0009) [2023-02-25 13:27:54,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 163086336. Throughput: 0: 3379.8. Samples: 3262422. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:27:54,729][36114] Avg episode reward: [(0, '51.566')] [2023-02-25 13:27:56,347][36155] DAMAGECOUNT value on done: 211995.0 [2023-02-25 13:27:56,348][36155] Sum rewards: 49.567, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.807', 'AMMO5': '0.019', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.146', 'WEAPON4': '0.200', 'weapon2': '0.318', 'weapon5': '0.320', 'WEAPON5': '0.400', 'weapon4': '0.730', 'WEAPON3': '0.900', 'HITCOUNT': '2.390', 'weapon3': '2.410', 'DAMAGECOUNT': '12.378', 'FRAGCOUNT': '40.500'} [2023-02-25 13:27:56,657][36155] DAMAGECOUNT value on done: 220113.0 [2023-02-25 13:27:56,658][36155] Sum rewards: 53.921, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.559', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon4': '0.136', 'AMMO4': '0.140', 'weapon2': '0.184', 'weapon5': '0.236', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '2.780', 'weapon3': '3.158', 'DAMAGECOUNT': '15.099', 'FRAGCOUNT': '48.000'} [2023-02-25 13:27:56,748][36138] Updated weights for policy 0, policy_version 39823 (0.0009) [2023-02-25 13:27:56,883][36155] DAMAGECOUNT value on done: 214361.0 [2023-02-25 13:27:56,883][36155] Sum rewards: 46.208, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.166', 'AMMO5': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.124', 'weapon4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'weapon2': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '2.810', 'weapon3': '3.168', 'DAMAGECOUNT': '12.297', 'FRAGCOUNT': '44.000'} [2023-02-25 13:27:57,188][36155] DAMAGECOUNT value on done: 213582.0 [2023-02-25 13:27:57,188][36155] Sum rewards: 58.009, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.372', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.016', 'WEAPON4': '0.050', 'weapon5': '0.052', 'AMMO4': '0.077', 'WEAPON5': '0.150', 'AMMO3': '0.247', 'weapon2': '0.582', 'WEAPON3': '1.450', 'weapon3': '3.122', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.472', 'FRAGCOUNT': '51.000'} [2023-02-25 13:27:57,196][36139] DAMAGECOUNT value on done: 215014.0 [2023-02-25 13:27:57,197][36139] Sum rewards: 54.807, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.380', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.162', 'AMMO4': '0.189', 'AMMO3': '0.244', 'weapon4': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.442', 'WEAPON3': '1.400', 'weapon3': '2.842', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '49.000'} [2023-02-25 13:27:57,498][36139] DAMAGECOUNT value on done: 218805.0 [2023-02-25 13:27:57,499][36139] Sum rewards: 57.463, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.223', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon2': '0.094', 'AMMO3': '0.193', 'WEAPON3': '1.100', 'HITCOUNT': '2.770', 'weapon3': '3.808', 'DAMAGECOUNT': '13.911', 'FRAGCOUNT': '47.000'} [2023-02-25 13:27:57,580][36139] DAMAGECOUNT value on done: 217529.0 [2023-02-25 13:27:57,581][36139] Sum rewards: 53.844, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.029', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.082', 'AMMO4': '0.098', 'WEAPON5': '0.150', 'weapon2': '0.184', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'weapon4': '0.418', 'WEAPON3': '1.550', 'weapon3': '2.950', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.394', 'FRAGCOUNT': '50.000'} [2023-02-25 13:27:57,895][36139] DAMAGECOUNT value on done: 214111.0 [2023-02-25 13:27:57,895][36139] Sum rewards: 56.775, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.835', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon5': '0.170', 'AMMO4': '0.181', 'weapon4': '0.202', 'AMMO3': '0.208', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.020', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '51.000'} [2023-02-25 13:27:59,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 163151872. Throughput: 0: 3377.8. Samples: 3282688. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:27:59,730][36114] Avg episode reward: [(0, '51.507')] [2023-02-25 13:27:59,799][36138] Updated weights for policy 0, policy_version 39833 (0.0010) [2023-02-25 13:27:59,867][36154] DAMAGECOUNT value on done: 218238.0 [2023-02-25 13:27:59,868][36154] Sum rewards: 51.270, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.348', 'AMMO5': '0.023', 'AMMO2': '0.035', 'AMMO3': '0.118', 'AMMO4': '0.177', 'weapon5': '0.318', 'weapon2': '0.556', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'weapon4': '0.950', 'weapon3': '1.914', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.866', 'FRAGCOUNT': '43.000'} [2023-02-25 13:28:00,188][36154] DAMAGECOUNT value on done: 213903.0 [2023-02-25 13:28:00,189][36154] Sum rewards: 46.714, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.148', 'AMMO5': '0.015', 'AMMO2': '0.052', 'AMMO3': '0.182', 'AMMO4': '0.258', 'weapon5': '0.302', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.488', 'weapon2': '0.672', 'WEAPON3': '1.050', 'weapon3': '2.174', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '13.248', 'FRAGCOUNT': '42.000'} [2023-02-25 13:28:00,507][36154] DAMAGECOUNT value on done: 214726.0 [2023-02-25 13:28:00,508][36154] Sum rewards: 41.775, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.960', 'AMMO5': '0.026', 'AMMO2': '0.050', 'weapon5': '0.206', 'weapon2': '0.220', 'AMMO4': '0.249', 'AMMO3': '0.253', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.596', 'WEAPON3': '1.500', 'HITCOUNT': '2.570', 'weapon3': '2.618', 'DAMAGECOUNT': '11.997', 'FRAGCOUNT': '40.000'} [2023-02-25 13:28:00,819][36154] DAMAGECOUNT value on done: 216083.0 [2023-02-25 13:28:00,820][36154] Sum rewards: 55.288, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.502', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon5': '0.150', 'AMMO4': '0.174', 'weapon2': '0.222', 'AMMO3': '0.271', 'weapon4': '0.382', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.954', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '51.000'} [2023-02-25 13:28:01,213][36140] DAMAGECOUNT value on done: 219605.0 [2023-02-25 13:28:01,213][36140] Sum rewards: 48.906, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.733', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.031', 'WEAPON4': '0.100', 'weapon4': '0.100', 'weapon5': '0.152', 'AMMO3': '0.202', 'weapon2': '0.230', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '2.770', 'weapon3': '3.326', 'DAMAGECOUNT': '12.960', 'FRAGCOUNT': '42.000'} [2023-02-25 13:28:01,526][36140] DAMAGECOUNT value on done: 215190.0 [2023-02-25 13:28:01,526][36140] Sum rewards: 61.430, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.174', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'weapon5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.240', 'weapon4': '0.508', 'weapon2': '0.716', 'WEAPON3': '1.400', 'weapon3': '2.458', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.171', 'FRAGCOUNT': '55.000'} [2023-02-25 13:28:01,529][36141] DAMAGECOUNT value on done: 220998.0 [2023-02-25 13:28:01,529][36141] Sum rewards: 61.696, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.418', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.025', 'weapon5': '0.080', 'AMMO4': '0.124', 'AMMO3': '0.209', 'weapon4': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.276', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.110', 'weapon3': '3.208', 'DAMAGECOUNT': '14.940', 'FRAGCOUNT': '54.000'} [2023-02-25 13:28:01,641][36157] DAMAGECOUNT value on done: 221827.0 [2023-02-25 13:28:01,642][36157] Sum rewards: 54.205, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.267', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.196', 'AMMO3': '0.220', 'weapon2': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.828', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.934', 'FRAGCOUNT': '48.000'} [2023-02-25 13:28:01,838][36141] DAMAGECOUNT value on done: 215310.0 [2023-02-25 13:28:01,839][36141] Sum rewards: 56.734, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.328', 'ARMOR': '0.004', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'weapon5': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.278', 'weapon2': '0.338', 'WEAPON3': '1.100', 'HITCOUNT': '2.840', 'weapon3': '3.150', 'DAMAGECOUNT': '14.238', 'FRAGCOUNT': '48.000'} [2023-02-25 13:28:01,900][36141] DAMAGECOUNT value on done: 215946.0 [2023-02-25 13:28:01,900][36141] Sum rewards: 55.147, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.055', 'WEAPON1': '0.020', 'AMMO5': '0.032', 'AMMO2': '0.057', 'AMMO3': '0.194', 'weapon5': '0.214', 'AMMO4': '0.284', 'weapon2': '0.290', 'WEAPON4': '0.500', 'weapon4': '0.616', 'WEAPON5': '0.750', 'WEAPON3': '1.200', 'weapon3': '2.536', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.148', 'FRAGCOUNT': '50.000'} [2023-02-25 13:28:01,904][36140] DAMAGECOUNT value on done: 214466.0 [2023-02-25 13:28:01,905][36140] Sum rewards: 56.853, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.138', 'AMMO5': '0.017', 'AMMO2': '0.050', 'AMMO3': '0.176', 'weapon2': '0.208', 'AMMO4': '0.251', 'weapon5': '0.334', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.776', 'WEAPON3': '1.100', 'weapon3': '2.332', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '13.806', 'FRAGCOUNT': '50.000'} [2023-02-25 13:28:01,968][36157] DAMAGECOUNT value on done: 217665.0 [2023-02-25 13:28:01,968][36157] Sum rewards: 53.335, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.117', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon5': '0.120', 'AMMO4': '0.134', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'weapon4': '0.254', 'weapon2': '0.288', 'WEAPON3': '1.350', 'HITCOUNT': '3.010', 'weapon3': '3.072', 'DAMAGECOUNT': '14.499', 'FRAGCOUNT': '47.000'} [2023-02-25 13:28:02,214][36140] DAMAGECOUNT value on done: 211955.0 [2023-02-25 13:28:02,215][36140] Sum rewards: 53.362, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.860', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.100', 'AMMO4': '0.150', 'weapon2': '0.168', 'AMMO3': '0.254', 'WEAPON5': '0.300', 'weapon4': '0.384', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.910', 'weapon3': '3.084', 'DAMAGECOUNT': '13.980', 'FRAGCOUNT': '48.000'} [2023-02-25 13:28:02,219][36141] DAMAGECOUNT value on done: 208719.0 [2023-02-25 13:28:02,219][36141] Sum rewards: 56.215, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.770', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.046', 'weapon5': '0.108', 'weapon4': '0.126', 'AMMO3': '0.178', 'AMMO4': '0.231', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.518', 'WEAPON3': '1.100', 'HITCOUNT': '2.820', 'weapon3': '3.054', 'DAMAGECOUNT': '14.241', 'FRAGCOUNT': '48.000'} [2023-02-25 13:28:02,297][36157] DAMAGECOUNT value on done: 221400.0 [2023-02-25 13:28:02,298][36157] Sum rewards: 48.149, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.730', 'AMMO2': '0.014', 'AMMO5': '0.014', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'AMMO3': '0.148', 'weapon5': '0.164', 'weapon2': '0.198', 'WEAPON5': '0.200', 'weapon4': '0.320', 'WEAPON3': '0.900', 'HITCOUNT': '2.440', 'weapon3': '3.070', 'DAMAGECOUNT': '12.489', 'FRAGCOUNT': '38.500'} [2023-02-25 13:28:02,321][36156] DAMAGECOUNT value on done: 221919.0 [2023-02-25 13:28:02,322][36156] Sum rewards: 45.976, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.255', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon5': '0.154', 'AMMO3': '0.170', 'AMMO4': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.334', 'WEAPON5': '0.350', 'weapon4': '0.420', 'WEAPON3': '1.000', 'HITCOUNT': '2.630', 'weapon3': '2.918', 'DAMAGECOUNT': '11.736', 'FRAGCOUNT': '39.000'} [2023-02-25 13:28:02,614][36157] DAMAGECOUNT value on done: 221263.0 [2023-02-25 13:28:02,614][36157] Sum rewards: 59.597, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.790', 'AMMO5': '0.015', 'AMMO2': '0.019', 'weapon5': '0.068', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'weapon2': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'weapon4': '0.424', 'WEAPON3': '1.450', 'HITCOUNT': '2.900', 'weapon3': '3.078', 'DAMAGECOUNT': '14.589', 'FRAGCOUNT': '53.000'} [2023-02-25 13:28:02,625][36156] DAMAGECOUNT value on done: 220821.0 [2023-02-25 13:28:02,626][36156] Sum rewards: 51.822, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.955', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon5': '0.128', 'AMMO3': '0.168', 'AMMO4': '0.236', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON4': '0.550', 'weapon4': '0.716', 'WEAPON3': '1.050', 'weapon3': '2.574', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.196', 'FRAGCOUNT': '45.000'} [2023-02-25 13:28:02,644][36156] DAMAGECOUNT value on done: 215764.0 [2023-02-25 13:28:02,645][36156] Sum rewards: 55.233, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.064', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'weapon5': '0.164', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'weapon2': '0.226', 'weapon4': '0.252', 'WEAPON3': '1.200', 'HITCOUNT': '2.880', 'weapon3': '3.118', 'DAMAGECOUNT': '13.572', 'FRAGCOUNT': '47.000'} [2023-02-25 13:28:02,850][36138] Updated weights for policy 0, policy_version 39843 (0.0009) [2023-02-25 13:28:02,937][36156] DAMAGECOUNT value on done: 217211.0 [2023-02-25 13:28:02,937][36156] Sum rewards: 61.589, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.578', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.039', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.157', 'weapon5': '0.176', 'weapon2': '0.192', 'AMMO4': '0.194', 'weapon4': '0.328', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'HITCOUNT': '2.910', 'weapon3': '2.954', 'DAMAGECOUNT': '14.721', 'FRAGCOUNT': '52.000'} [2023-02-25 13:28:03,627][36142] DAMAGECOUNT value on done: 212211.0 [2023-02-25 13:28:03,627][36142] Sum rewards: 55.923, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.155', 'AMMO5': '0.020', 'AMMO2': '0.024', 'WEAPON1': '0.040', 'AMMO4': '0.121', 'AMMO3': '0.128', 'weapon5': '0.188', 'WEAPON4': '0.400', 'weapon2': '0.422', 'WEAPON5': '0.450', 'weapon4': '0.514', 'WEAPON3': '0.800', 'weapon3': '2.600', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '14.850', 'FRAGCOUNT': '46.000'} [2023-02-25 13:28:03,946][36142] DAMAGECOUNT value on done: 217060.0 [2023-02-25 13:28:03,946][36142] Sum rewards: 46.800, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.372', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.049', 'AMMO3': '0.212', 'weapon2': '0.232', 'AMMO4': '0.242', 'weapon5': '0.260', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'weapon4': '0.854', 'WEAPON3': '1.200', 'weapon3': '2.302', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '13.506', 'FRAGCOUNT': '43.000'} [2023-02-25 13:28:04,123][36142] DAMAGECOUNT value on done: 211335.0 [2023-02-25 13:28:04,123][36142] Sum rewards: 49.317, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.450', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon5': '0.208', 'AMMO4': '0.219', 'AMMO3': '0.227', 'weapon2': '0.248', 'weapon4': '0.256', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.670', 'weapon3': '3.016', 'DAMAGECOUNT': '12.915', 'FRAGCOUNT': '47.000'} [2023-02-25 13:28:04,433][36142] DAMAGECOUNT value on done: 219345.0 [2023-02-25 13:28:04,434][36142] Sum rewards: 50.370, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.680', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon5': '0.192', 'AMMO4': '0.200', 'weapon2': '0.208', 'AMMO3': '0.286', 'WEAPON5': '0.350', 'weapon4': '0.378', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'HITCOUNT': '2.710', 'weapon3': '2.856', 'DAMAGECOUNT': '13.263', 'FRAGCOUNT': '50.000'} [2023-02-25 13:28:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 163221504. Throughput: 0: 3382.6. Samples: 3302956. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:28:04,729][36114] Avg episode reward: [(0, '52.105')] [2023-02-25 13:28:05,913][36138] Updated weights for policy 0, policy_version 39853 (0.0009) [2023-02-25 13:28:07,825][36139] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:28:08,883][36138] Updated weights for policy 0, policy_version 39863 (0.0010) [2023-02-25 13:28:09,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 163287040. Throughput: 0: 3387.2. Samples: 3313190. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:28:09,730][36114] Avg episode reward: [(0, '52.105')] [2023-02-25 13:28:11,878][36138] Updated weights for policy 0, policy_version 39873 (0.0010) [2023-02-25 13:28:14,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 163356672. Throughput: 0: 3386.1. Samples: 3333534. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:28:14,730][36114] Avg episode reward: [(0, '52.105')] [2023-02-25 13:28:14,775][36157] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:28:14,930][36138] Updated weights for policy 0, policy_version 39883 (0.0009) [2023-02-25 13:28:16,285][36155] DAMAGECOUNT value on done: 217923.0 [2023-02-25 13:28:16,286][36155] Sum rewards: 66.982, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.397', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon4': '0.150', 'AMMO4': '0.169', 'weapon5': '0.182', 'AMMO3': '0.236', 'weapon2': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.152', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '57.000'} [2023-02-25 13:28:16,591][36155] DAMAGECOUNT value on done: 223776.0 [2023-02-25 13:28:16,591][36155] Sum rewards: 36.386, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.852', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO4': '0.168', 'AMMO3': '0.180', 'weapon5': '0.334', 'weapon4': '0.414', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.616', 'WEAPON3': '1.150', 'weapon3': '2.330', 'HITCOUNT': '2.350', 'DAMAGECOUNT': '10.989', 'FRAGCOUNT': '35.500'} [2023-02-25 13:28:16,857][36155] DAMAGECOUNT value on done: 218239.0 [2023-02-25 13:28:16,857][36155] Sum rewards: 41.472, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.342', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.221', 'weapon5': '0.228', 'weapon4': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.670', 'WEAPON3': '1.250', 'HITCOUNT': '2.460', 'weapon3': '2.628', 'DAMAGECOUNT': '11.634', 'FRAGCOUNT': '40.000'} [2023-02-25 13:28:16,937][36139] DAMAGECOUNT value on done: 220024.0 [2023-02-25 13:28:16,938][36139] Sum rewards: 62.559, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.860', 'AMMO5': '0.010', 'weapon4': '0.014', 'weapon5': '0.014', 'AMMO2': '0.020', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon2': '0.156', 'AMMO3': '0.235', 'WEAPON3': '1.400', 'HITCOUNT': '2.840', 'weapon3': '3.648', 'DAMAGECOUNT': '15.030', 'FRAGCOUNT': '55.000'} [2023-02-25 13:28:17,184][36155] DAMAGECOUNT value on done: 218259.0 [2023-02-25 13:28:17,185][36155] Sum rewards: 60.163, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.546', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.037', 'weapon5': '0.090', 'AMMO3': '0.124', 'AMMO4': '0.185', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.352', 'weapon2': '0.476', 'WEAPON3': '0.850', 'HITCOUNT': '2.830', 'weapon3': '2.912', 'DAMAGECOUNT': '14.031', 'FRAGCOUNT': '49.000'} [2023-02-25 13:28:17,252][36139] DAMAGECOUNT value on done: 223258.0 [2023-02-25 13:28:17,253][36139] Sum rewards: 56.501, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.512', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.048', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.126', 'AMMO3': '0.160', 'weapon2': '0.348', 'WEAPON3': '1.050', 'HITCOUNT': '2.780', 'weapon3': '3.332', 'DAMAGECOUNT': '13.359', 'FRAGCOUNT': '47.000'} [2023-02-25 13:28:17,395][36139] DAMAGECOUNT value on done: 221945.0 [2023-02-25 13:28:17,396][36139] Sum rewards: 59.927, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.528', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.019', 'weapon4': '0.030', 'weapon5': '0.032', 'AMMO4': '0.093', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.558', 'WEAPON3': '0.950', 'HITCOUNT': '2.910', 'weapon3': '3.128', 'DAMAGECOUNT': '13.248', 'FRAGCOUNT': '50.000'} [2023-02-25 13:28:17,701][36139] DAMAGECOUNT value on done: 218856.0 [2023-02-25 13:28:17,702][36139] Sum rewards: 49.512, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.260', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.064', 'AMMO4': '0.166', 'WEAPON4': '0.200', 'weapon4': '0.202', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.300', 'HITCOUNT': '2.760', 'weapon3': '3.184', 'DAMAGECOUNT': '13.575', 'FRAGCOUNT': '43.000'} [2023-02-25 13:28:17,987][36138] Updated weights for policy 0, policy_version 39893 (0.0009) [2023-02-25 13:28:19,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 163422208. Throughput: 0: 3383.2. Samples: 3353708. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:28:19,730][36114] Avg episode reward: [(0, '52.202')] [2023-02-25 13:28:19,733][36125] Saving new best policy, reward=52.202! [2023-02-25 13:28:19,899][36154] DAMAGECOUNT value on done: 223423.0 [2023-02-25 13:28:19,899][36154] Sum rewards: 51.490, reward structure: {'DEATHCOUNT': '-21.750', 'HEALTH': '-6.080', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.040', 'weapon5': '0.176', 'AMMO4': '0.198', 'weapon2': '0.210', 'AMMO3': '0.367', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.562', 'WEAPON3': '2.150', 'weapon3': '2.634', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '53.000'} [2023-02-25 13:28:20,192][36154] DAMAGECOUNT value on done: 219460.0 [2023-02-25 13:28:20,192][36154] Sum rewards: 64.242, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.400', 'AMMO5': '0.013', 'AMMO2': '0.024', 'AMMO4': '0.121', 'AMMO3': '0.196', 'weapon5': '0.254', 'weapon2': '0.328', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon4': '1.106', 'weapon3': '1.908', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '54.000'} [2023-02-25 13:28:20,473][36154] DAMAGECOUNT value on done: 219283.0 [2023-02-25 13:28:20,473][36154] Sum rewards: 48.696, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.590', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'weapon2': '0.248', 'WEAPON4': '0.250', 'AMMO3': '0.279', 'weapon4': '0.484', 'WEAPON3': '1.550', 'HITCOUNT': '2.810', 'weapon3': '2.970', 'DAMAGECOUNT': '13.671', 'FRAGCOUNT': '45.000'} [2023-02-25 13:28:20,779][36154] DAMAGECOUNT value on done: 220204.0 [2023-02-25 13:28:20,780][36154] Sum rewards: 45.159, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.016', 'AMMO5': '0.022', 'AMMO2': '0.043', 'weapon5': '0.152', 'AMMO3': '0.165', 'AMMO4': '0.216', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.592', 'weapon2': '0.614', 'WEAPON3': '0.950', 'weapon3': '2.338', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.363', 'FRAGCOUNT': '40.000'} [2023-02-25 13:28:21,039][36138] Updated weights for policy 0, policy_version 39903 (0.0010) [2023-02-25 13:28:21,194][36140] DAMAGECOUNT value on done: 223325.0 [2023-02-25 13:28:21,194][36140] Sum rewards: 40.097, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.796', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'AMMO3': '0.225', 'WEAPON4': '0.350', 'weapon2': '0.478', 'weapon4': '0.676', 'WEAPON3': '1.300', 'weapon3': '2.460', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '11.160', 'FRAGCOUNT': '38.000'} [2023-02-25 13:28:21,274][36141] DAMAGECOUNT value on done: 225612.0 [2023-02-25 13:28:21,274][36141] Sum rewards: 59.232, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.364', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.019', 'AMMO4': '0.092', 'AMMO3': '0.187', 'weapon5': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.294', 'weapon2': '0.402', 'WEAPON3': '1.050', 'weapon3': '2.906', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.842', 'FRAGCOUNT': '50.000'} [2023-02-25 13:28:21,503][36140] DAMAGECOUNT value on done: 219967.0 [2023-02-25 13:28:21,503][36140] Sum rewards: 48.354, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.502', 'AMMO5': '0.008', 'AMMO2': '0.034', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'weapon5': '0.210', 'AMMO3': '0.229', 'WEAPON4': '0.350', 'weapon4': '0.442', 'weapon2': '0.516', 'WEAPON3': '1.400', 'weapon3': '2.498', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.331', 'FRAGCOUNT': '44.000'} [2023-02-25 13:28:21,561][36157] DAMAGECOUNT value on done: 226657.0 [2023-02-25 13:28:21,562][36157] Sum rewards: 51.442, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.265', 'AMMO5': '0.020', 'AMMO2': '0.070', 'AMMO3': '0.196', 'weapon5': '0.216', 'weapon2': '0.232', 'AMMO4': '0.351', 'WEAPON5': '0.450', 'WEAPON4': '0.750', 'weapon4': '0.996', 'WEAPON3': '1.200', 'weapon3': '2.206', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.490', 'FRAGCOUNT': '47.000'} [2023-02-25 13:28:21,580][36141] DAMAGECOUNT value on done: 220010.0 [2023-02-25 13:28:21,580][36141] Sum rewards: 48.291, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.334', 'ARMOR': '0.008', 'AMMO5': '0.025', 'AMMO2': '0.057', 'AMMO3': '0.209', 'AMMO4': '0.286', 'weapon5': '0.354', 'weapon2': '0.408', 'WEAPON5': '0.550', 'WEAPON4': '0.550', 'weapon4': '0.968', 'WEAPON3': '1.250', 'weapon3': '1.840', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '14.100', 'FRAGCOUNT': '44.500'} [2023-02-25 13:28:21,692][36141] DAMAGECOUNT value on done: 219763.0 [2023-02-25 13:28:21,692][36141] Sum rewards: 36.561, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.751', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.045', 'AMMO3': '0.207', 'AMMO4': '0.223', 'weapon5': '0.298', 'WEAPON5': '0.350', 'weapon4': '0.396', 'WEAPON4': '0.400', 'weapon2': '0.466', 'WEAPON3': '1.200', 'HITCOUNT': '2.450', 'weapon3': '2.558', 'DAMAGECOUNT': '11.451', 'FRAGCOUNT': '34.000'} [2023-02-25 13:28:21,855][36140] DAMAGECOUNT value on done: 219612.0 [2023-02-25 13:28:21,855][36140] Sum rewards: 60.170, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.620', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.084', 'AMMO4': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'WEAPON4': '0.250', 'weapon4': '0.362', 'weapon2': '0.762', 'WEAPON3': '0.900', 'weapon3': '2.608', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.438', 'FRAGCOUNT': '48.000'} [2023-02-25 13:28:21,870][36157] DAMAGECOUNT value on done: 222632.0 [2023-02-25 13:28:21,871][36157] Sum rewards: 59.707, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.873', 'AMMO2': '0.009', 'weapon4': '0.034', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'weapon2': '0.186', 'AMMO3': '0.258', 'WEAPON3': '1.550', 'HITCOUNT': '3.150', 'weapon3': '3.598', 'DAMAGECOUNT': '14.901', 'FRAGCOUNT': '53.000'} [2023-02-25 13:28:22,005][36141] DAMAGECOUNT value on done: 213190.0 [2023-02-25 13:28:22,006][36141] Sum rewards: 45.966, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.000', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'weapon4': '0.034', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.268', 'weapon2': '0.494', 'WEAPON3': '1.500', 'HITCOUNT': '2.750', 'weapon3': '3.058', 'DAMAGECOUNT': '13.413', 'FRAGCOUNT': '42.000'} [2023-02-25 13:28:22,113][36156] DAMAGECOUNT value on done: 225816.0 [2023-02-25 13:28:22,113][36156] Sum rewards: 44.834, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.350', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.056', 'weapon7': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.165', 'WEAPON7': '0.200', 'weapon2': '0.242', 'weapon5': '0.270', 'AMMO4': '0.281', 'WEAPON5': '0.600', 'weapon4': '0.634', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'weapon3': '1.988', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '11.691', 'FRAGCOUNT': '42.000'} [2023-02-25 13:28:22,162][36140] DAMAGECOUNT value on done: 216201.0 [2023-02-25 13:28:22,162][36140] Sum rewards: 48.373, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.872', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon5': '0.164', 'AMMO4': '0.205', 'AMMO3': '0.258', 'weapon2': '0.286', 'weapon4': '0.400', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.828', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.738', 'FRAGCOUNT': '47.000'} [2023-02-25 13:28:22,207][36157] DAMAGECOUNT value on done: 226226.0 [2023-02-25 13:28:22,208][36157] Sum rewards: 56.947, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.216', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO4': '0.144', 'AMMO3': '0.207', 'weapon5': '0.218', 'WEAPON4': '0.300', 'weapon2': '0.334', 'WEAPON5': '0.350', 'weapon4': '0.410', 'WEAPON3': '1.350', 'weapon3': '2.812', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.478', 'FRAGCOUNT': '51.500'} [2023-02-25 13:28:22,416][36156] DAMAGECOUNT value on done: 225456.0 [2023-02-25 13:28:22,416][36156] Sum rewards: 50.295, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.568', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'weapon5': '0.090', 'AMMO4': '0.135', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'weapon4': '0.246', 'WEAPON4': '0.300', 'weapon2': '0.646', 'WEAPON3': '1.000', 'weapon3': '2.704', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.905', 'FRAGCOUNT': '42.000'} [2023-02-25 13:28:22,435][36156] DAMAGECOUNT value on done: 220127.0 [2023-02-25 13:28:22,436][36156] Sum rewards: 52.256, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.856', 'AMMO5': '0.011', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.076', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon5': '0.220', 'WEAPON5': '0.300', 'weapon4': '0.362', 'weapon2': '0.578', 'WEAPON3': '1.150', 'weapon3': '2.494', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '13.089', 'FRAGCOUNT': '47.000'} [2023-02-25 13:28:22,513][36157] DAMAGECOUNT value on done: 225314.0 [2023-02-25 13:28:22,514][36157] Sum rewards: 46.413, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.030', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO2': '0.025', 'AMMO3': '0.119', 'AMMO4': '0.125', 'weapon5': '0.196', 'weapon2': '0.506', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'weapon4': '0.844', 'weapon3': '2.204', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '12.153', 'FRAGCOUNT': '40.000'} [2023-02-25 13:28:22,732][36156] DAMAGECOUNT value on done: 221593.0 [2023-02-25 13:28:22,732][36156] Sum rewards: 42.504, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.712', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.186', 'weapon4': '0.256', 'AMMO3': '0.288', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'HITCOUNT': '2.460', 'weapon3': '2.930', 'DAMAGECOUNT': '13.146', 'FRAGCOUNT': '43.000'} [2023-02-25 13:28:23,595][36142] DAMAGECOUNT value on done: 217140.0 [2023-02-25 13:28:23,595][36142] Sum rewards: 56.939, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.894', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'weapon4': '0.016', 'AMMO5': '0.017', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'weapon5': '0.124', 'AMMO3': '0.215', 'WEAPON5': '0.300', 'weapon2': '0.416', 'WEAPON3': '1.350', 'HITCOUNT': '2.920', 'weapon3': '3.226', 'DAMAGECOUNT': '14.652', 'FRAGCOUNT': '49.000'} [2023-02-25 13:28:23,919][36142] DAMAGECOUNT value on done: 221442.0 [2023-02-25 13:28:23,919][36142] Sum rewards: 52.941, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.800', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon5': '0.144', 'weapon2': '0.174', 'AMMO4': '0.189', 'AMMO3': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.416', 'WEAPON3': '1.400', 'HITCOUNT': '2.800', 'weapon3': '2.978', 'DAMAGECOUNT': '13.146', 'FRAGCOUNT': '49.000'} [2023-02-25 13:28:24,074][36138] Updated weights for policy 0, policy_version 39913 (0.0009) [2023-02-25 13:28:24,087][36142] DAMAGECOUNT value on done: 216681.0 [2023-02-25 13:28:24,088][36142] Sum rewards: 63.562, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.884', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon4': '0.110', 'WEAPON4': '0.150', 'weapon5': '0.160', 'weapon2': '0.192', 'AMMO3': '0.247', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.200', 'weapon3': '3.292', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '55.000'} [2023-02-25 13:28:24,400][36142] DAMAGECOUNT value on done: 224009.0 [2023-02-25 13:28:24,401][36142] Sum rewards: 54.271, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.140', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.062', 'weapon5': '0.068', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon2': '0.196', 'weapon4': '0.200', 'AMMO3': '0.213', 'WEAPON3': '1.350', 'HITCOUNT': '3.150', 'weapon3': '3.360', 'DAMAGECOUNT': '13.992', 'FRAGCOUNT': '47.000'} [2023-02-25 13:28:24,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 163491840. Throughput: 0: 3378.5. Samples: 3363688. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:28:24,729][36114] Avg episode reward: [(0, '52.531')] [2023-02-25 13:28:24,730][36125] Saving new best policy, reward=52.531! [2023-02-25 13:28:27,096][36138] Updated weights for policy 0, policy_version 39923 (0.0009) [2023-02-25 13:28:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 163557376. Throughput: 0: 3376.7. Samples: 3383820. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:28:29,730][36114] Avg episode reward: [(0, '52.531')] [2023-02-25 13:28:29,963][36141] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:28:30,153][36138] Updated weights for policy 0, policy_version 39933 (0.0009) [2023-02-25 13:28:33,228][36138] Updated weights for policy 0, policy_version 39943 (0.0009) [2023-02-25 13:28:34,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 163622912. Throughput: 0: 3369.2. Samples: 3403958. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:28:34,730][36114] Avg episode reward: [(0, '52.531')] [2023-02-25 13:28:36,283][36138] Updated weights for policy 0, policy_version 39953 (0.0010) [2023-02-25 13:28:36,321][36155] DAMAGECOUNT value on done: 223106.0 [2023-02-25 13:28:36,322][36155] Sum rewards: 60.639, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.670', 'AMMO5': '0.019', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.182', 'weapon5': '0.206', 'weapon4': '0.434', 'weapon2': '0.446', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.596', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.531', 'FRAGCOUNT': '53.000'} [2023-02-25 13:28:36,633][36155] DAMAGECOUNT value on done: 228735.0 [2023-02-25 13:28:36,633][36155] Sum rewards: 51.937, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-4.159', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.026', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'AMMO3': '0.332', 'weapon2': '0.334', 'weapon4': '0.426', 'WEAPON3': '1.950', 'weapon3': '2.900', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.877', 'FRAGCOUNT': '51.000'} [2023-02-25 13:28:36,900][36155] DAMAGECOUNT value on done: 222482.0 [2023-02-25 13:28:36,900][36155] Sum rewards: 48.434, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.808', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.045', 'AMMO3': '0.137', 'AMMO4': '0.226', 'WEAPON5': '0.250', 'weapon5': '0.250', 'weapon2': '0.330', 'WEAPON4': '0.450', 'weapon4': '0.752', 'WEAPON3': '0.800', 'weapon3': '2.360', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.729', 'FRAGCOUNT': '40.000'} [2023-02-25 13:28:36,955][36139] DAMAGECOUNT value on done: 224248.0 [2023-02-25 13:28:36,955][36139] Sum rewards: 48.260, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.882', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.148', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.522', 'weapon4': '0.534', 'WEAPON3': '1.150', 'HITCOUNT': '2.520', 'weapon3': '2.560', 'DAMAGECOUNT': '12.672', 'FRAGCOUNT': '42.000'} [2023-02-25 13:28:37,211][36155] DAMAGECOUNT value on done: 222582.0 [2023-02-25 13:28:37,212][36155] Sum rewards: 46.444, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.540', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon5': '0.090', 'AMMO4': '0.109', 'AMMO3': '0.196', 'weapon2': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'ARMOR': '0.457', 'weapon4': '0.668', 'WEAPON3': '1.150', 'weapon3': '2.592', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.969', 'FRAGCOUNT': '42.000'} [2023-02-25 13:28:37,262][36139] DAMAGECOUNT value on done: 227265.0 [2023-02-25 13:28:37,263][36139] Sum rewards: 40.406, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.700', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon5': '0.214', 'AMMO3': '0.229', 'weapon2': '0.244', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.480', 'WEAPON3': '1.350', 'HITCOUNT': '2.590', 'weapon3': '2.718', 'DAMAGECOUNT': '12.021', 'FRAGCOUNT': '39.000'} [2023-02-25 13:28:37,394][36139] DAMAGECOUNT value on done: 225698.0 [2023-02-25 13:28:37,394][36139] Sum rewards: 42.207, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.780', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.164', 'AMMO3': '0.177', 'weapon5': '0.218', 'weapon2': '0.330', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.658', 'WEAPON3': '1.000', 'HITCOUNT': '2.300', 'weapon3': '2.536', 'DAMAGECOUNT': '11.259', 'FRAGCOUNT': '38.000'} [2023-02-25 13:28:37,700][36139] DAMAGECOUNT value on done: 223990.0 [2023-02-25 13:28:37,701][36139] Sum rewards: 59.253, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.907', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.154', 'weapon4': '0.186', 'AMMO3': '0.213', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.046', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.402', 'FRAGCOUNT': '51.000'} [2023-02-25 13:28:39,308][36138] Updated weights for policy 0, policy_version 39963 (0.0009) [2023-02-25 13:28:39,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 163692544. Throughput: 0: 3368.1. Samples: 3413986. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:28:39,730][36114] Avg episode reward: [(0, '52.480')] [2023-02-25 13:28:39,877][36154] DAMAGECOUNT value on done: 228153.0 [2023-02-25 13:28:39,877][36154] Sum rewards: 55.816, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.385', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon5': '0.074', 'AMMO4': '0.086', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.442', 'weapon2': '0.682', 'WEAPON3': '1.000', 'weapon3': '2.644', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.962', 'FRAGCOUNT': '47.000'} [2023-02-25 13:28:40,205][36154] DAMAGECOUNT value on done: 223365.0 [2023-02-25 13:28:40,206][36154] Sum rewards: 45.907, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.888', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.084', 'AMMO3': '0.138', 'AMMO4': '0.165', 'WEAPON5': '0.300', 'weapon2': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '0.900', 'weapon4': '0.964', 'weapon3': '2.180', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '11.715', 'FRAGCOUNT': '40.500'} [2023-02-25 13:28:40,484][36154] DAMAGECOUNT value on done: 224132.0 [2023-02-25 13:28:40,484][36154] Sum rewards: 55.938, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.718', 'weapon5': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.033', 'AMMO4': '0.162', 'AMMO3': '0.181', 'weapon2': '0.214', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.682', 'WEAPON3': '1.100', 'weapon3': '2.870', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.547', 'FRAGCOUNT': '48.000'} [2023-02-25 13:28:40,794][36154] DAMAGECOUNT value on done: 224420.0 [2023-02-25 13:28:40,795][36154] Sum rewards: 49.870, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.602', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.062', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.174', 'AMMO3': '0.191', 'weapon2': '0.630', 'WEAPON3': '1.250', 'HITCOUNT': '2.720', 'weapon3': '2.916', 'DAMAGECOUNT': '12.648', 'FRAGCOUNT': '44.000'} [2023-02-25 13:28:41,284][36140] DAMAGECOUNT value on done: 228515.0 [2023-02-25 13:28:41,284][36140] Sum rewards: 62.465, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.382', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon5': '0.110', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon2': '0.260', 'weapon4': '0.482', 'WEAPON3': '1.500', 'weapon3': '2.968', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '55.000'} [2023-02-25 13:28:41,354][36141] DAMAGECOUNT value on done: 230799.0 [2023-02-25 13:28:41,354][36141] Sum rewards: 58.380, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.354', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.096', 'AMMO4': '0.127', 'weapon2': '0.160', 'weapon4': '0.176', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.120', 'weapon3': '3.334', 'DAMAGECOUNT': '15.561', 'FRAGCOUNT': '51.000'} [2023-02-25 13:28:41,458][36157] DAMAGECOUNT value on done: 232029.0 [2023-02-25 13:28:41,458][36157] Sum rewards: 66.632, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.386', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.050', 'AMMO4': '0.106', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon5': '0.210', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.150', 'HITCOUNT': '2.960', 'weapon3': '3.120', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '56.000'} [2023-02-25 13:28:41,608][36140] DAMAGECOUNT value on done: 224636.0 [2023-02-25 13:28:41,608][36140] Sum rewards: 50.959, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.922', 'AMMO2': '0.014', 'AMMO5': '0.019', 'WEAPON4': '0.050', 'AMMO4': '0.072', 'weapon5': '0.140', 'AMMO3': '0.222', 'weapon4': '0.242', 'weapon2': '0.266', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.990', 'weapon3': '3.058', 'DAMAGECOUNT': '14.007', 'FRAGCOUNT': '42.000'} [2023-02-25 13:28:41,671][36141] DAMAGECOUNT value on done: 224742.0 [2023-02-25 13:28:41,672][36141] Sum rewards: 49.810, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.908', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.138', 'AMMO4': '0.143', 'weapon2': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.236', 'AMMO3': '0.283', 'WEAPON3': '1.750', 'HITCOUNT': '2.630', 'weapon3': '3.248', 'DAMAGECOUNT': '14.196', 'FRAGCOUNT': '47.000'} [2023-02-25 13:28:41,764][36157] DAMAGECOUNT value on done: 226897.0 [2023-02-25 13:28:41,765][36157] Sum rewards: 48.580, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.222', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.046', 'AMMO3': '0.163', 'weapon5': '0.188', 'AMMO4': '0.230', 'weapon2': '0.316', 'weapon4': '0.324', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.760', 'weapon3': '2.858', 'DAMAGECOUNT': '12.795', 'FRAGCOUNT': '42.000'} [2023-02-25 13:28:41,773][36141] DAMAGECOUNT value on done: 224318.0 [2023-02-25 13:28:41,773][36141] Sum rewards: 52.908, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.058', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.140', 'weapon5': '0.160', 'AMMO4': '0.161', 'AMMO3': '0.228', 'weapon2': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.680', 'weapon3': '3.202', 'DAMAGECOUNT': '13.665', 'FRAGCOUNT': '49.000'} [2023-02-25 13:28:41,971][36140] DAMAGECOUNT value on done: 224701.0 [2023-02-25 13:28:41,971][36140] Sum rewards: 53.447, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.897', 'ARMOR': '0.012', 'AMMO5': '0.023', 'AMMO2': '0.058', 'AMMO3': '0.211', 'weapon5': '0.212', 'weapon2': '0.286', 'AMMO4': '0.289', 'weapon4': '0.468', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.708', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.267', 'FRAGCOUNT': '50.000'} [2023-02-25 13:28:42,094][36141] DAMAGECOUNT value on done: 216818.0 [2023-02-25 13:28:42,095][36141] Sum rewards: 41.321, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.658', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'weapon5': '0.090', 'AMMO4': '0.141', 'AMMO3': '0.171', 'weapon2': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.456', 'weapon4': '0.926', 'WEAPON3': '1.000', 'weapon3': '2.000', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '10.884', 'FRAGCOUNT': '37.000'} [2023-02-25 13:28:42,096][36157] DAMAGECOUNT value on done: 231002.0 [2023-02-25 13:28:42,096][36157] Sum rewards: 59.373, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.419', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon4': '0.050', 'weapon5': '0.092', 'AMMO4': '0.116', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'WEAPON5': '0.300', 'weapon2': '0.512', 'WEAPON3': '1.200', 'weapon3': '3.096', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.328', 'FRAGCOUNT': '51.000'} [2023-02-25 13:28:42,283][36140] DAMAGECOUNT value on done: 221026.0 [2023-02-25 13:28:42,283][36140] Sum rewards: 62.167, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.428', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.118', 'AMMO3': '0.146', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'weapon2': '0.280', 'weapon4': '0.818', 'WEAPON3': '0.850', 'weapon3': '2.642', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.475', 'FRAGCOUNT': '50.000'} [2023-02-25 13:28:42,315][36156] DAMAGECOUNT value on done: 231045.0 [2023-02-25 13:28:42,316][36156] Sum rewards: 60.160, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.192', 'AMMO5': '0.017', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.210', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'weapon4': '0.264', 'weapon2': '0.278', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.952', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.687', 'FRAGCOUNT': '54.000'} [2023-02-25 13:28:42,377][36157] DAMAGECOUNT value on done: 229779.0 [2023-02-25 13:28:42,377][36157] Sum rewards: 50.106, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.002', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.060', 'AMMO3': '0.149', 'weapon5': '0.244', 'AMMO4': '0.302', 'weapon2': '0.342', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.630', 'WEAPON3': '0.850', 'weapon3': '2.320', 'HITCOUNT': '2.450', 'DAMAGECOUNT': '13.182', 'FRAGCOUNT': '43.000'} [2023-02-25 13:28:42,434][36138] Updated weights for policy 0, policy_version 39973 (0.0009) [2023-02-25 13:28:42,618][36156] DAMAGECOUNT value on done: 229985.0 [2023-02-25 13:28:42,619][36156] Sum rewards: 50.220, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.732', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.185', 'weapon5': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.248', 'weapon4': '0.324', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.820', 'weapon3': '2.920', 'DAMAGECOUNT': '13.587', 'FRAGCOUNT': '42.500'} [2023-02-25 13:28:42,638][36156] DAMAGECOUNT value on done: 225326.0 [2023-02-25 13:28:42,638][36156] Sum rewards: 60.038, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.979', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO4': '0.178', 'weapon5': '0.184', 'weapon2': '0.186', 'AMMO3': '0.205', 'WEAPON5': '0.350', 'weapon4': '0.368', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.018', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '53.000'} [2023-02-25 13:28:42,927][36156] DAMAGECOUNT value on done: 225778.0 [2023-02-25 13:28:42,928][36156] Sum rewards: 49.955, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.990', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.128', 'AMMO4': '0.154', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'weapon2': '0.286', 'WEAPON4': '0.350', 'weapon4': '0.780', 'WEAPON3': '1.150', 'weapon3': '2.602', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '12.555', 'FRAGCOUNT': '45.000'} [2023-02-25 13:28:43,451][36157] Large shaping reward 2.650 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-25 13:28:43,638][36142] DAMAGECOUNT value on done: 220770.0 [2023-02-25 13:28:43,639][36142] Sum rewards: 34.723, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.862', 'AMMO5': '0.027', 'AMMO2': '0.074', 'AMMO3': '0.178', 'weapon5': '0.214', 'AMMO4': '0.370', 'weapon2': '0.518', 'WEAPON5': '0.650', 'weapon4': '0.782', 'WEAPON4': '0.800', 'WEAPON3': '1.000', 'weapon3': '2.082', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '10.890', 'FRAGCOUNT': '34.000'} [2023-02-25 13:28:43,945][36142] DAMAGECOUNT value on done: 225980.0 [2023-02-25 13:28:43,945][36142] Sum rewards: 50.221, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.825', 'AMMO5': '0.021', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.174', 'weapon5': '0.350', 'weapon2': '0.454', 'weapon4': '0.496', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.386', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.614', 'FRAGCOUNT': '43.000'} [2023-02-25 13:28:44,092][36142] DAMAGECOUNT value on done: 222158.0 [2023-02-25 13:28:44,092][36142] Sum rewards: 64.549, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.655', 'AMMO5': '0.014', 'AMMO2': '0.043', 'AMMO3': '0.142', 'weapon5': '0.216', 'AMMO4': '0.217', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.462', 'weapon4': '0.610', 'WEAPON3': '0.900', 'weapon3': '2.448', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.431', 'FRAGCOUNT': '52.000'} [2023-02-25 13:28:44,397][36142] DAMAGECOUNT value on done: 228807.0 [2023-02-25 13:28:44,397][36142] Sum rewards: 54.866, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.952', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.077', 'AMMO3': '0.193', 'weapon5': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.312', 'weapon4': '0.482', 'WEAPON3': '1.250', 'weapon3': '2.602', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.394', 'FRAGCOUNT': '49.000'} [2023-02-25 13:28:44,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13482.1). Total num frames: 163758080. Throughput: 0: 3366.4. Samples: 3434176. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:28:44,729][36114] Avg episode reward: [(0, '52.459')] [2023-02-25 13:28:45,416][36138] Updated weights for policy 0, policy_version 39983 (0.0009) [2023-02-25 13:28:48,499][36138] Updated weights for policy 0, policy_version 39993 (0.0009) [2023-02-25 13:28:49,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 163827712. Throughput: 0: 3366.4. Samples: 3454444. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:28:49,730][36114] Avg episode reward: [(0, '52.459')] [2023-02-25 13:28:51,528][36138] Updated weights for policy 0, policy_version 40003 (0.0009) [2023-02-25 13:28:53,669][36141] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:28:54,563][36138] Updated weights for policy 0, policy_version 40013 (0.0009) [2023-02-25 13:28:54,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 163893248. Throughput: 0: 3364.0. Samples: 3464572. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:28:54,730][36114] Avg episode reward: [(0, '52.459')] [2023-02-25 13:28:54,876][36142] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:28:56,195][36155] DAMAGECOUNT value on done: 228216.0 [2023-02-25 13:28:56,195][36155] Sum rewards: 68.457, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.969', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.030', 'AMMO4': '0.080', 'weapon2': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'weapon4': '0.450', 'WEAPON3': '1.000', 'weapon3': '3.096', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '57.000'} [2023-02-25 13:28:56,495][36155] DAMAGECOUNT value on done: 233086.0 [2023-02-25 13:28:56,496][36155] Sum rewards: 51.066, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.550', 'AMMO5': '0.020', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.166', 'AMMO3': '0.206', 'weapon2': '0.208', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.730', 'WEAPON3': '1.200', 'weapon3': '2.572', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.053', 'FRAGCOUNT': '47.000'} [2023-02-25 13:28:56,753][36155] DAMAGECOUNT value on done: 227499.0 [2023-02-25 13:28:56,753][36155] Sum rewards: 58.538, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.120', 'AMMO5': '0.011', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.143', 'weapon4': '0.150', 'weapon5': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.450', 'WEAPON3': '0.850', 'HITCOUNT': '2.900', 'weapon3': '2.950', 'DAMAGECOUNT': '15.051', 'FRAGCOUNT': '49.000'} [2023-02-25 13:28:56,772][36139] DAMAGECOUNT value on done: 228996.0 [2023-02-25 13:28:56,772][36139] Sum rewards: 54.713, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.271', 'AMMO5': '0.023', 'AMMO2': '0.046', 'AMMO4': '0.229', 'weapon2': '0.230', 'weapon5': '0.240', 'AMMO3': '0.246', 'weapon4': '0.340', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.856', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.244', 'FRAGCOUNT': '50.000'} [2023-02-25 13:28:57,065][36139] DAMAGECOUNT value on done: 232251.0 [2023-02-25 13:28:57,065][36139] Sum rewards: 47.798, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.758', 'ARMOR': '0.004', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'weapon5': '0.182', 'AMMO4': '0.191', 'AMMO3': '0.214', 'weapon4': '0.318', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.640', 'WEAPON3': '1.200', 'weapon3': '2.508', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.598', 'FRAGCOUNT': '44.000'} [2023-02-25 13:28:57,065][36155] DAMAGECOUNT value on done: 227651.0 [2023-02-25 13:28:57,065][36155] Sum rewards: 56.123, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.703', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.046', 'AMMO3': '0.171', 'weapon5': '0.212', 'AMMO4': '0.228', 'WEAPON5': '0.350', 'weapon2': '0.380', 'WEAPON4': '0.400', 'weapon4': '0.452', 'WEAPON3': '1.050', 'weapon3': '2.654', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.207', 'FRAGCOUNT': '48.000'} [2023-02-25 13:28:57,106][36139] DAMAGECOUNT value on done: 229163.0 [2023-02-25 13:28:57,106][36139] Sum rewards: 38.570, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.882', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.127', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'WEAPON4': '0.600', 'weapon2': '0.608', 'WEAPON3': '0.700', 'weapon4': '1.332', 'weapon3': '1.838', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '10.395', 'FRAGCOUNT': '34.000'} [2023-02-25 13:28:57,410][36139] DAMAGECOUNT value on done: 228702.0 [2023-02-25 13:28:57,410][36139] Sum rewards: 52.179, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.440', 'AMMO5': '0.013', 'AMMO2': '0.039', 'AMMO3': '0.180', 'AMMO4': '0.196', 'weapon5': '0.216', 'WEAPON5': '0.400', 'weapon4': '0.472', 'WEAPON4': '0.500', 'weapon2': '0.622', 'WEAPON3': '1.100', 'weapon3': '2.434', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '14.136', 'FRAGCOUNT': '45.000'} [2023-02-25 13:28:57,602][36138] Updated weights for policy 0, policy_version 40023 (0.0009) [2023-02-25 13:28:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 163962880. Throughput: 0: 3363.0. Samples: 3484870. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:28:59,730][36114] Avg episode reward: [(0, '52.763')] [2023-02-25 13:28:59,732][36125] Saving new best policy, reward=52.763! [2023-02-25 13:28:59,852][36154] DAMAGECOUNT value on done: 232572.0 [2023-02-25 13:28:59,852][36154] Sum rewards: 54.507, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.740', 'AMMO2': '0.009', 'AMMO5': '0.011', 'AMMO4': '0.043', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.156', 'AMMO3': '0.219', 'weapon2': '0.326', 'WEAPON3': '1.300', 'HITCOUNT': '2.870', 'weapon3': '3.228', 'DAMAGECOUNT': '13.257', 'FRAGCOUNT': '48.000'} [2023-02-25 13:29:00,156][36154] DAMAGECOUNT value on done: 227900.0 [2023-02-25 13:29:00,156][36154] Sum rewards: 56.494, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.292', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'weapon5': '0.102', 'weapon4': '0.116', 'AMMO3': '0.150', 'WEAPON5': '0.250', 'weapon2': '0.810', 'WEAPON3': '0.900', 'HITCOUNT': '2.820', 'weapon3': '2.840', 'DAMAGECOUNT': '13.605', 'FRAGCOUNT': '45.000'} [2023-02-25 13:29:00,465][36154] DAMAGECOUNT value on done: 228469.0 [2023-02-25 13:29:00,465][36154] Sum rewards: 41.308, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.980', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon2': '0.164', 'weapon5': '0.196', 'AMMO3': '0.218', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.460', 'WEAPON3': '1.300', 'weapon3': '2.938', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.011', 'FRAGCOUNT': '37.000'} [2023-02-25 13:29:00,633][36138] Updated weights for policy 0, policy_version 40033 (0.0009) [2023-02-25 13:29:00,773][36154] DAMAGECOUNT value on done: 229233.0 [2023-02-25 13:29:00,773][36154] Sum rewards: 55.096, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.421', 'ARMOR': '0.012', 'AMMO5': '0.012', 'weapon7': '0.022', 'AMMO2': '0.035', 'AMMO3': '0.137', 'AMMO4': '0.175', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.252', 'weapon2': '0.338', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.518', 'WEAPON3': '0.900', 'weapon3': '2.256', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '14.439', 'FRAGCOUNT': '46.000'} [2023-02-25 13:29:01,147][36140] DAMAGECOUNT value on done: 233819.0 [2023-02-25 13:29:01,147][36140] Sum rewards: 58.162, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.690', 'AMMO5': '0.020', 'AMMO2': '0.044', 'weapon5': '0.172', 'AMMO3': '0.218', 'AMMO4': '0.220', 'weapon4': '0.238', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.458', 'WEAPON3': '1.300', 'weapon3': '2.860', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.912', 'FRAGCOUNT': '52.000'} [2023-02-25 13:29:01,304][36141] DAMAGECOUNT value on done: 236029.0 [2023-02-25 13:29:01,304][36141] Sum rewards: 57.644, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.615', 'WEAPON1': '0.020', 'AMMO5': '0.030', 'AMMO2': '0.052', 'weapon5': '0.238', 'AMMO3': '0.245', 'AMMO4': '0.261', 'weapon2': '0.310', 'weapon4': '0.404', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.718', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '51.500'} [2023-02-25 13:29:01,377][36157] DAMAGECOUNT value on done: 236397.0 [2023-02-25 13:29:01,378][36157] Sum rewards: 42.888, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.040', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.182', 'weapon5': '0.222', 'weapon2': '0.266', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '1.022', 'WEAPON3': '1.100', 'weapon3': '2.142', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.104', 'FRAGCOUNT': '39.000'} [2023-02-25 13:29:01,458][36140] DAMAGECOUNT value on done: 229721.0 [2023-02-25 13:29:01,459][36140] Sum rewards: 55.755, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.925', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.088', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon4': '0.304', 'weapon2': '0.344', 'WEAPON3': '1.450', 'weapon3': '2.992', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '49.000'} [2023-02-25 13:29:01,628][36141] DAMAGECOUNT value on done: 229716.0 [2023-02-25 13:29:01,629][36141] Sum rewards: 57.575, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.565', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO5': '0.021', 'AMMO4': '0.085', 'weapon4': '0.112', 'weapon5': '0.156', 'weapon2': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.060', 'weapon3': '3.314', 'DAMAGECOUNT': '14.922', 'FRAGCOUNT': '50.500'} [2023-02-25 13:29:01,692][36157] DAMAGECOUNT value on done: 231394.0 [2023-02-25 13:29:01,693][36157] Sum rewards: 56.313, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.175', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.128', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.178', 'weapon2': '0.442', 'weapon4': '0.452', 'WEAPON3': '1.050', 'HITCOUNT': '2.760', 'weapon3': '2.824', 'DAMAGECOUNT': '13.491', 'FRAGCOUNT': '47.000'} [2023-02-25 13:29:01,727][36141] DAMAGECOUNT value on done: 228071.0 [2023-02-25 13:29:01,727][36141] Sum rewards: 42.344, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.130', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon5': '0.126', 'AMMO3': '0.157', 'AMMO4': '0.274', 'weapon2': '0.348', 'WEAPON5': '0.350', 'WEAPON4': '0.650', 'weapon4': '0.818', 'WEAPON3': '0.850', 'weapon3': '2.428', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '11.259', 'FRAGCOUNT': '38.000'} [2023-02-25 13:29:01,816][36140] DAMAGECOUNT value on done: 229091.0 [2023-02-25 13:29:01,817][36140] Sum rewards: 47.116, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.700', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon5': '0.046', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'weapon4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.248', 'weapon2': '0.628', 'WEAPON3': '1.450', 'HITCOUNT': '2.890', 'weapon3': '2.986', 'DAMAGECOUNT': '13.170', 'FRAGCOUNT': '43.000'} [2023-02-25 13:29:02,008][36157] DAMAGECOUNT value on done: 235362.0 [2023-02-25 13:29:02,008][36157] Sum rewards: 52.894, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.602', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon5': '0.118', 'AMMO4': '0.135', 'AMMO3': '0.161', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.450', 'weapon2': '0.664', 'WEAPON3': '1.000', 'weapon3': '2.530', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.080', 'FRAGCOUNT': '44.000'} [2023-02-25 13:29:02,035][36141] DAMAGECOUNT value on done: 221549.0 [2023-02-25 13:29:02,035][36141] Sum rewards: 53.888, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.910', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.120', 'AMMO3': '0.169', 'weapon2': '0.198', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.642', 'WEAPON3': '1.100', 'weapon3': '2.688', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.193', 'FRAGCOUNT': '46.000'} [2023-02-25 13:29:02,124][36140] DAMAGECOUNT value on done: 225631.0 [2023-02-25 13:29:02,125][36140] Sum rewards: 55.222, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.326', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.114', 'AMMO3': '0.144', 'AMMO4': '0.195', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.430', 'weapon2': '0.968', 'WEAPON3': '1.000', 'weapon3': '2.250', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.815', 'FRAGCOUNT': '47.000'} [2023-02-25 13:29:02,323][36156] DAMAGECOUNT value on done: 235241.0 [2023-02-25 13:29:02,323][36156] Sum rewards: 51.272, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.381', 'AMMO2': '0.008', 'AMMO5': '0.012', 'AMMO4': '0.041', 'WEAPON4': '0.100', 'weapon4': '0.124', 'AMMO3': '0.155', 'weapon5': '0.174', 'WEAPON5': '0.350', 'weapon2': '0.890', 'WEAPON3': '1.000', 'HITCOUNT': '2.410', 'weapon3': '2.550', 'DAMAGECOUNT': '12.588', 'FRAGCOUNT': '42.000'} [2023-02-25 13:29:02,325][36157] DAMAGECOUNT value on done: 234885.0 [2023-02-25 13:29:02,325][36157] Sum rewards: 52.497, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.323', 'AMMO5': '0.035', 'AMMO2': '0.059', 'AMMO3': '0.166', 'AMMO4': '0.293', 'weapon2': '0.430', 'weapon4': '0.440', 'weapon5': '0.446', 'WEAPON4': '0.650', 'WEAPON5': '0.900', 'WEAPON3': '0.950', 'weapon3': '2.288', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '14.913', 'FRAGCOUNT': '46.000'} [2023-02-25 13:29:02,632][36156] DAMAGECOUNT value on done: 234786.0 [2023-02-25 13:29:02,632][36156] Sum rewards: 55.445, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.240', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.062', 'AMMO4': '0.082', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.650', 'WEAPON3': '1.250', 'HITCOUNT': '2.780', 'weapon3': '2.934', 'DAMAGECOUNT': '14.403', 'FRAGCOUNT': '48.000'} [2023-02-25 13:29:02,640][36156] DAMAGECOUNT value on done: 229393.0 [2023-02-25 13:29:02,641][36156] Sum rewards: 48.231, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.328', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.163', 'weapon5': '0.236', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.446', 'weapon2': '0.696', 'WEAPON3': '1.000', 'weapon3': '2.318', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '12.201', 'FRAGCOUNT': '42.000'} [2023-02-25 13:29:02,953][36156] DAMAGECOUNT value on done: 230080.0 [2023-02-25 13:29:02,953][36156] Sum rewards: 49.701, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.268', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.041', 'weapon5': '0.170', 'AMMO3': '0.184', 'AMMO4': '0.204', 'weapon2': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.438', 'WEAPON3': '1.150', 'weapon3': '2.756', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.906', 'FRAGCOUNT': '45.000'} [2023-02-25 13:29:03,607][36142] DAMAGECOUNT value on done: 225290.0 [2023-02-25 13:29:03,608][36142] Sum rewards: 53.372, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.792', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon5': '0.052', 'AMMO4': '0.110', 'weapon4': '0.122', 'WEAPON5': '0.200', 'weapon2': '0.230', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '2.800', 'weapon3': '3.242', 'DAMAGECOUNT': '13.530', 'FRAGCOUNT': '48.000'} [2023-02-25 13:29:03,667][36138] Updated weights for policy 0, policy_version 40043 (0.0009) [2023-02-25 13:29:03,920][36142] DAMAGECOUNT value on done: 231059.0 [2023-02-25 13:29:03,920][36142] Sum rewards: 59.729, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.078', 'AMMO5': '0.017', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.188', 'weapon5': '0.286', 'weapon2': '0.334', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.656', 'WEAPON3': '1.100', 'weapon3': '2.406', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.237', 'FRAGCOUNT': '51.000'} [2023-02-25 13:29:04,152][36142] DAMAGECOUNT value on done: 226378.0 [2023-02-25 13:29:04,153][36142] Sum rewards: 44.858, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.540', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon5': '0.184', 'AMMO3': '0.195', 'weapon2': '0.232', 'AMMO4': '0.256', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.832', 'WEAPON3': '1.150', 'weapon3': '2.370', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.660', 'FRAGCOUNT': '40.000'} [2023-02-25 13:29:04,195][36155] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:29:04,445][36142] DAMAGECOUNT value on done: 233410.0 [2023-02-25 13:29:04,445][36142] Sum rewards: 53.268, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.854', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.047', 'AMMO3': '0.160', 'weapon5': '0.202', 'AMMO4': '0.235', 'weapon2': '0.348', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.582', 'WEAPON3': '0.950', 'weapon3': '2.558', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '13.809', 'FRAGCOUNT': '46.000'} [2023-02-25 13:29:04,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 164028416. Throughput: 0: 3363.9. Samples: 3505084. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:29:04,729][36114] Avg episode reward: [(0, '52.337')] [2023-02-25 13:29:06,676][36138] Updated weights for policy 0, policy_version 40053 (0.0010) [2023-02-25 13:29:09,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 164098048. Throughput: 0: 3365.2. Samples: 3515120. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:29:09,729][36114] Avg episode reward: [(0, '52.337')] [2023-02-25 13:29:09,731][36138] Updated weights for policy 0, policy_version 40063 (0.0010) [2023-02-25 13:29:12,037][36142] Large shaping reward 2.652 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2023-02-25 13:29:12,795][36138] Updated weights for policy 0, policy_version 40073 (0.0010) [2023-02-25 13:29:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 164163584. Throughput: 0: 3368.2. Samples: 3535390. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:29:14,730][36114] Avg episode reward: [(0, '52.337')] [2023-02-25 13:29:15,803][36138] Updated weights for policy 0, policy_version 40083 (0.0009) [2023-02-25 13:29:15,908][36155] DAMAGECOUNT value on done: 232989.0 [2023-02-25 13:29:15,908][36155] Sum rewards: 53.364, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.000', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon5': '0.090', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'weapon2': '0.312', 'weapon4': '0.446', 'WEAPON3': '1.550', 'weapon3': '2.888', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.319', 'FRAGCOUNT': '48.500'} [2023-02-25 13:29:16,216][36155] DAMAGECOUNT value on done: 237944.0 [2023-02-25 13:29:16,217][36155] Sum rewards: 57.293, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.355', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.036', 'AMMO4': '0.179', 'AMMO3': '0.185', 'weapon4': '0.200', 'weapon5': '0.206', 'WEAPON4': '0.300', 'weapon2': '0.366', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.610', 'weapon3': '2.972', 'DAMAGECOUNT': '14.574', 'FRAGCOUNT': '49.000'} [2023-02-25 13:29:16,456][36139] DAMAGECOUNT value on done: 233441.0 [2023-02-25 13:29:16,457][36139] Sum rewards: 54.407, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.455', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'weapon4': '0.344', 'weapon2': '0.386', 'WEAPON3': '1.000', 'weapon3': '2.974', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.335', 'FRAGCOUNT': '45.000'} [2023-02-25 13:29:16,493][36155] DAMAGECOUNT value on done: 230905.0 [2023-02-25 13:29:16,493][36155] Sum rewards: 34.741, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.402', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon4': '0.090', 'weapon5': '0.154', 'AMMO3': '0.166', 'AMMO4': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.870', 'WEAPON3': '0.900', 'HITCOUNT': '2.050', 'weapon3': '2.182', 'DAMAGECOUNT': '10.218', 'FRAGCOUNT': '31.000'} [2023-02-25 13:29:16,766][36139] DAMAGECOUNT value on done: 236762.0 [2023-02-25 13:29:16,766][36139] Sum rewards: 49.362, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.020', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.130', 'AMMO4': '0.132', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.318', 'weapon2': '0.596', 'WEAPON3': '1.150', 'weapon3': '2.612', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.533', 'FRAGCOUNT': '42.000'} [2023-02-25 13:29:16,793][36155] DAMAGECOUNT value on done: 231984.0 [2023-02-25 13:29:16,793][36155] Sum rewards: 46.991, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.323', 'AMMO5': '0.016', 'AMMO2': '0.048', 'AMMO3': '0.161', 'AMMO4': '0.240', 'weapon5': '0.248', 'WEAPON4': '0.350', 'weapon4': '0.362', 'WEAPON5': '0.400', 'weapon2': '0.628', 'WEAPON3': '0.950', 'weapon3': '2.482', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.999', 'FRAGCOUNT': '38.000'} [2023-02-25 13:29:16,898][36139] DAMAGECOUNT value on done: 233856.0 [2023-02-25 13:29:16,898][36139] Sum rewards: 51.957, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.480', 'AMMO5': '0.018', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.156', 'weapon4': '0.192', 'weapon5': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.666', 'WEAPON3': '1.000', 'weapon3': '2.548', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '14.079', 'FRAGCOUNT': '45.000'} [2023-02-25 13:29:17,197][36139] DAMAGECOUNT value on done: 232792.0 [2023-02-25 13:29:17,197][36139] Sum rewards: 50.196, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.771', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'weapon2': '0.204', 'weapon4': '0.268', 'WEAPON3': '1.100', 'HITCOUNT': '2.650', 'weapon3': '3.234', 'DAMAGECOUNT': '12.270', 'FRAGCOUNT': '42.000'} [2023-02-25 13:29:18,856][36138] Updated weights for policy 0, policy_version 40093 (0.0009) [2023-02-25 13:29:19,729][36114] Fps is (10 sec: 13106.8, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 164229120. Throughput: 0: 3370.3. Samples: 3555620. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:29:19,730][36114] Avg episode reward: [(0, '52.222')] [2023-02-25 13:29:19,771][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000040096_164233216.pth... [2023-02-25 13:29:19,827][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000039305_160993280.pth [2023-02-25 13:29:19,893][36154] DAMAGECOUNT value on done: 236904.0 [2023-02-25 13:29:19,893][36154] Sum rewards: 49.393, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.802', 'AMMO2': '0.009', 'AMMO5': '0.016', 'AMMO4': '0.044', 'weapon5': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.276', 'AMMO3': '0.306', 'weapon4': '0.380', 'WEAPON3': '1.850', 'HITCOUNT': '2.810', 'weapon3': '2.956', 'DAMAGECOUNT': '12.996', 'FRAGCOUNT': '49.000'} [2023-02-25 13:29:20,204][36154] DAMAGECOUNT value on done: 232771.0 [2023-02-25 13:29:20,205][36154] Sum rewards: 58.592, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.798', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.041', 'AMMO3': '0.149', 'AMMO4': '0.207', 'weapon5': '0.220', 'weapon2': '0.260', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.674', 'WEAPON3': '0.850', 'weapon3': '2.594', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.613', 'FRAGCOUNT': '50.000'} [2023-02-25 13:29:20,485][36154] DAMAGECOUNT value on done: 232989.0 [2023-02-25 13:29:20,485][36154] Sum rewards: 51.072, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.340', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.074', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.206', 'AMMO3': '0.213', 'weapon4': '0.278', 'WEAPON3': '1.350', 'HITCOUNT': '2.970', 'weapon3': '3.278', 'DAMAGECOUNT': '13.560', 'FRAGCOUNT': '44.500'} [2023-02-25 13:29:20,780][36154] DAMAGECOUNT value on done: 233299.0 [2023-02-25 13:29:20,781][36154] Sum rewards: 46.036, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.600', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon5': '0.174', 'AMMO3': '0.203', 'AMMO4': '0.203', 'weapon2': '0.254', 'WEAPON5': '0.400', 'weapon4': '0.504', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'HITCOUNT': '2.640', 'weapon3': '2.754', 'DAMAGECOUNT': '12.198', 'FRAGCOUNT': '42.500'} [2023-02-25 13:29:21,172][36141] DAMAGECOUNT value on done: 239193.0 [2023-02-25 13:29:21,172][36141] Sum rewards: 34.616, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.530', 'ARMOR': '0.008', 'AMMO5': '0.023', 'AMMO2': '0.037', 'AMMO3': '0.102', 'weapon5': '0.168', 'AMMO4': '0.183', 'WEAPON4': '0.450', 'weapon2': '0.462', 'WEAPON5': '0.500', 'WEAPON3': '0.650', 'weapon4': '0.816', 'weapon3': '2.074', 'HITCOUNT': '2.180', 'DAMAGECOUNT': '9.492', 'FRAGCOUNT': '29.500'} [2023-02-25 13:29:21,243][36140] DAMAGECOUNT value on done: 239584.0 [2023-02-25 13:29:21,243][36140] Sum rewards: 59.887, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.880', 'AMMO5': '0.021', 'AMMO2': '0.051', 'AMMO3': '0.218', 'AMMO4': '0.255', 'weapon5': '0.314', 'weapon2': '0.326', 'weapon4': '0.484', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.492', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '54.000'} [2023-02-25 13:29:21,327][36157] DAMAGECOUNT value on done: 241105.0 [2023-02-25 13:29:21,327][36157] Sum rewards: 49.631, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.155', 'ARMOR': '0.012', 'AMMO5': '0.022', 'AMMO2': '0.069', 'AMMO3': '0.117', 'weapon5': '0.296', 'AMMO4': '0.343', 'weapon2': '0.408', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '0.750', 'weapon4': '0.928', 'weapon3': '1.966', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.124', 'FRAGCOUNT': '42.000'} [2023-02-25 13:29:21,484][36141] DAMAGECOUNT value on done: 234721.0 [2023-02-25 13:29:21,484][36141] Sum rewards: 62.161, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.740', 'AMMO5': '0.003', 'AMMO2': '0.003', 'weapon5': '0.008', 'weapon4': '0.012', 'AMMO4': '0.015', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.178', 'weapon2': '0.710', 'WEAPON3': '1.150', 'HITCOUNT': '3.090', 'weapon3': '3.118', 'DAMAGECOUNT': '15.015', 'FRAGCOUNT': '52.500'} [2023-02-25 13:29:21,542][36140] DAMAGECOUNT value on done: 233821.0 [2023-02-25 13:29:21,543][36140] Sum rewards: 46.678, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.525', 'AMMO5': '0.017', 'AMMO2': '0.034', 'AMMO4': '0.169', 'weapon5': '0.176', 'AMMO3': '0.203', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.378', 'weapon2': '0.634', 'WEAPON3': '1.200', 'weapon3': '2.552', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '12.300', 'FRAGCOUNT': '43.000'} [2023-02-25 13:29:21,628][36157] DAMAGECOUNT value on done: 235615.0 [2023-02-25 13:29:21,629][36157] Sum rewards: 50.990, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.067', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.060', 'AMMO4': '0.157', 'AMMO3': '0.166', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.448', 'weapon4': '0.508', 'WEAPON3': '1.000', 'weapon3': '2.674', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.663', 'FRAGCOUNT': '46.000'} [2023-02-25 13:29:21,638][36141] DAMAGECOUNT value on done: 233146.0 [2023-02-25 13:29:21,638][36141] Sum rewards: 57.453, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.645', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon2': '0.172', 'weapon5': '0.190', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.368', 'WEAPON3': '1.200', 'weapon3': '2.996', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.225', 'FRAGCOUNT': '50.000'} [2023-02-25 13:29:21,905][36138] Updated weights for policy 0, policy_version 40103 (0.0009) [2023-02-25 13:29:21,930][36140] DAMAGECOUNT value on done: 234070.0 [2023-02-25 13:29:21,931][36140] Sum rewards: 58.412, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.870', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.150', 'AMMO3': '0.150', 'weapon5': '0.264', 'WEAPON5': '0.350', 'weapon2': '0.368', 'WEAPON4': '0.550', 'weapon4': '0.746', 'WEAPON3': '0.950', 'weapon3': '2.348', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.937', 'FRAGCOUNT': '50.000'} [2023-02-25 13:29:21,936][36157] DAMAGECOUNT value on done: 239990.0 [2023-02-25 13:29:21,936][36157] Sum rewards: 48.917, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.105', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon5': '0.156', 'AMMO4': '0.181', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.358', 'weapon4': '0.754', 'WEAPON3': '1.150', 'weapon3': '2.438', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.884', 'FRAGCOUNT': '43.000'} [2023-02-25 13:29:21,955][36141] DAMAGECOUNT value on done: 224915.0 [2023-02-25 13:29:21,955][36141] Sum rewards: 40.294, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.760', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon5': '0.100', 'AMMO3': '0.141', 'AMMO4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.256', 'weapon4': '0.414', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'HITCOUNT': '2.330', 'weapon3': '3.000', 'DAMAGECOUNT': '10.098', 'FRAGCOUNT': '36.000'} [2023-02-25 13:29:22,241][36140] DAMAGECOUNT value on done: 230887.0 [2023-02-25 13:29:22,242][36140] Sum rewards: 59.853, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.440', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.041', 'AMMO3': '0.181', 'weapon4': '0.194', 'AMMO4': '0.206', 'weapon5': '0.220', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon2': '0.582', 'WEAPON3': '1.100', 'weapon3': '2.682', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.768', 'FRAGCOUNT': '52.000'} [2023-02-25 13:29:22,244][36157] DAMAGECOUNT value on done: 239826.0 [2023-02-25 13:29:22,245][36157] Sum rewards: 54.770, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.332', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon5': '0.212', 'WEAPON5': '0.250', 'weapon4': '0.304', 'weapon2': '0.360', 'WEAPON3': '1.250', 'weapon3': '2.900', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.823', 'FRAGCOUNT': '47.000'} [2023-02-25 13:29:22,381][36156] DAMAGECOUNT value on done: 239669.0 [2023-02-25 13:29:22,381][36156] Sum rewards: 43.009, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.295', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.050', 'weapon5': '0.144', 'AMMO3': '0.205', 'AMMO4': '0.249', 'weapon2': '0.350', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.638', 'WEAPON3': '1.200', 'weapon3': '2.520', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '13.284', 'FRAGCOUNT': '40.000'} [2023-02-25 13:29:22,700][36156] DAMAGECOUNT value on done: 239628.0 [2023-02-25 13:29:22,700][36156] Sum rewards: 47.193, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.376', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.194', 'weapon2': '0.216', 'AMMO3': '0.258', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.732', 'WEAPON3': '1.550', 'weapon3': '2.520', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.526', 'FRAGCOUNT': '44.000'} [2023-02-25 13:29:22,710][36156] DAMAGECOUNT value on done: 233921.0 [2023-02-25 13:29:22,711][36156] Sum rewards: 48.141, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.142', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'weapon2': '0.394', 'weapon4': '0.646', 'WEAPON3': '1.400', 'weapon3': '2.556', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.569', 'FRAGCOUNT': '44.000'} [2023-02-25 13:29:23,015][36156] DAMAGECOUNT value on done: 234087.0 [2023-02-25 13:29:23,015][36156] Sum rewards: 46.128, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.400', 'ARMOR': '0.008', 'AMMO5': '0.027', 'AMMO2': '0.061', 'AMMO3': '0.164', 'weapon5': '0.266', 'AMMO4': '0.306', 'weapon4': '0.588', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon2': '0.632', 'WEAPON3': '1.050', 'weapon3': '2.104', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '12.021', 'FRAGCOUNT': '44.000'} [2023-02-25 13:29:23,633][36142] DAMAGECOUNT value on done: 228922.0 [2023-02-25 13:29:23,633][36142] Sum rewards: 44.665, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.054', 'weapon5': '0.002', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'weapon7': '0.064', 'AMMO4': '0.069', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.348', 'ARMOR': '0.440', 'weapon2': '0.602', 'WEAPON3': '0.850', 'HITCOUNT': '2.300', 'weapon3': '2.358', 'DAMAGECOUNT': '10.557', 'FRAGCOUNT': '37.000'} [2023-02-25 13:29:23,935][36142] DAMAGECOUNT value on done: 235418.0 [2023-02-25 13:29:23,936][36142] Sum rewards: 51.025, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.080', 'AMMO5': '0.011', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.130', 'weapon4': '0.150', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.452', 'WEAPON3': '1.150', 'HITCOUNT': '2.870', 'weapon3': '3.010', 'DAMAGECOUNT': '13.077', 'FRAGCOUNT': '44.000'} [2023-02-25 13:29:24,161][36142] DAMAGECOUNT value on done: 230992.0 [2023-02-25 13:29:24,161][36142] Sum rewards: 54.024, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.895', 'AMMO5': '0.018', 'AMMO2': '0.046', 'weapon5': '0.152', 'AMMO3': '0.168', 'AMMO4': '0.230', 'weapon2': '0.346', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon4': '0.640', 'WEAPON3': '0.950', 'weapon3': '2.456', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.842', 'FRAGCOUNT': '47.000'} [2023-02-25 13:29:24,463][36142] DAMAGECOUNT value on done: 238170.0 [2023-02-25 13:29:24,464][36142] Sum rewards: 52.664, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.742', 'ARMOR': '0.012', 'AMMO5': '0.026', 'AMMO2': '0.063', 'AMMO3': '0.129', 'weapon2': '0.292', 'AMMO4': '0.314', 'weapon5': '0.412', 'WEAPON3': '0.750', 'WEAPON5': '0.800', 'WEAPON4': '0.850', 'weapon4': '1.142', 'weapon3': '1.786', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '14.280', 'FRAGCOUNT': '46.000'} [2023-02-25 13:29:24,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 164298752. Throughput: 0: 3370.8. Samples: 3565674. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-25 13:29:24,730][36114] Avg episode reward: [(0, '52.106')] [2023-02-25 13:29:24,943][36138] Updated weights for policy 0, policy_version 40113 (0.0009) [2023-02-25 13:29:27,949][36138] Updated weights for policy 0, policy_version 40123 (0.0009) [2023-02-25 13:29:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 164364288. Throughput: 0: 3371.3. Samples: 3585886. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-25 13:29:29,730][36114] Avg episode reward: [(0, '52.106')] [2023-02-25 13:29:31,003][36138] Updated weights for policy 0, policy_version 40133 (0.0009) [2023-02-25 13:29:34,072][36138] Updated weights for policy 0, policy_version 40143 (0.0009) [2023-02-25 13:29:34,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13496.0). Total num frames: 164433920. Throughput: 0: 3369.6. Samples: 3606074. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-25 13:29:34,729][36114] Avg episode reward: [(0, '52.106')] [2023-02-25 13:29:35,889][36155] DAMAGECOUNT value on done: 237589.0 [2023-02-25 13:29:35,889][36155] Sum rewards: 49.476, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.530', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.276', 'weapon2': '0.338', 'WEAPON3': '1.700', 'HITCOUNT': '2.820', 'weapon3': '3.318', 'DAMAGECOUNT': '13.800', 'FRAGCOUNT': '46.000'} [2023-02-25 13:29:36,201][36155] DAMAGECOUNT value on done: 242560.0 [2023-02-25 13:29:36,201][36155] Sum rewards: 53.846, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.342', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon5': '0.052', 'AMMO4': '0.111', 'AMMO3': '0.195', 'weapon4': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.672', 'WEAPON3': '1.150', 'weapon3': '2.862', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.848', 'FRAGCOUNT': '47.000'} [2023-02-25 13:29:36,398][36139] DAMAGECOUNT value on done: 238985.0 [2023-02-25 13:29:36,399][36139] Sum rewards: 62.992, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.715', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon2': '0.392', 'weapon4': '0.490', 'WEAPON3': '1.250', 'weapon3': '2.806', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '54.000'} [2023-02-25 13:29:36,465][36155] DAMAGECOUNT value on done: 235135.0 [2023-02-25 13:29:36,465][36155] Sum rewards: 49.308, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.380', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon2': '0.288', 'weapon4': '0.408', 'WEAPON3': '1.300', 'HITCOUNT': '2.750', 'weapon3': '2.862', 'DAMAGECOUNT': '12.690', 'FRAGCOUNT': '44.000'} [2023-02-25 13:29:36,714][36139] DAMAGECOUNT value on done: 239431.0 [2023-02-25 13:29:36,714][36139] Sum rewards: 28.663, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.966', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.028', 'AMMO3': '0.112', 'AMMO4': '0.138', 'weapon5': '0.224', 'weapon2': '0.270', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '0.750', 'weapon4': '1.248', 'weapon3': '1.544', 'HITCOUNT': '1.930', 'DAMAGECOUNT': '8.007', 'FRAGCOUNT': '26.000'} [2023-02-25 13:29:36,777][36155] DAMAGECOUNT value on done: 235667.0 [2023-02-25 13:29:36,778][36155] Sum rewards: 41.445, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.954', 'ARMOR': '0.004', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO4': '0.046', 'weapon7': '0.078', 'weapon5': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.386', 'weapon2': '0.628', 'WEAPON3': '0.900', 'HITCOUNT': '2.370', 'weapon3': '2.506', 'DAMAGECOUNT': '11.049', 'FRAGCOUNT': '33.000'} [2023-02-25 13:29:36,846][36139] DAMAGECOUNT value on done: 238844.0 [2023-02-25 13:29:36,846][36139] Sum rewards: 57.690, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.876', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon5': '0.072', 'AMMO4': '0.127', 'weapon2': '0.232', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'WEAPON4': '0.350', 'ARMOR': '0.482', 'weapon4': '0.498', 'WEAPON3': '1.450', 'weapon3': '2.918', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.964', 'FRAGCOUNT': '52.000'} [2023-02-25 13:29:37,155][36139] DAMAGECOUNT value on done: 237165.0 [2023-02-25 13:29:37,155][36138] Updated weights for policy 0, policy_version 40153 (0.0009) [2023-02-25 13:29:37,156][36139] Sum rewards: 43.166, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.844', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.058', 'AMMO3': '0.208', 'weapon5': '0.264', 'weapon2': '0.278', 'AMMO4': '0.291', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.798', 'WEAPON3': '1.200', 'weapon3': '2.034', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '12.864', 'FRAGCOUNT': '40.000'} [2023-02-25 13:29:39,729][36114] Fps is (10 sec: 13517.1, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 164499456. Throughput: 0: 3366.7. Samples: 3616074. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-25 13:29:39,730][36114] Avg episode reward: [(0, '51.602')] [2023-02-25 13:29:40,001][36154] DAMAGECOUNT value on done: 242166.0 [2023-02-25 13:29:40,002][36154] Sum rewards: 57.898, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.863', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.190', 'AMMO3': '0.237', 'weapon4': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.500', 'weapon3': '2.904', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.786', 'FRAGCOUNT': '52.000'} [2023-02-25 13:29:40,193][36138] Updated weights for policy 0, policy_version 40163 (0.0010) [2023-02-25 13:29:40,310][36154] DAMAGECOUNT value on done: 236425.0 [2023-02-25 13:29:40,311][36154] Sum rewards: 47.058, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.420', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.150', 'weapon4': '0.164', 'weapon5': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.850', 'weapon2': '0.926', 'HITCOUNT': '2.340', 'weapon3': '2.512', 'DAMAGECOUNT': '10.932', 'FRAGCOUNT': '40.000'} [2023-02-25 13:29:40,587][36154] DAMAGECOUNT value on done: 236599.0 [2023-02-25 13:29:40,588][36154] Sum rewards: 43.905, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.126', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.038', 'weapon5': '0.140', 'AMMO3': '0.154', 'AMMO4': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.310', 'WEAPON4': '0.500', 'weapon4': '0.964', 'WEAPON3': '1.050', 'weapon3': '2.182', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '10.830', 'FRAGCOUNT': '40.000'} [2023-02-25 13:29:40,899][36154] DAMAGECOUNT value on done: 237654.0 [2023-02-25 13:29:40,900][36154] Sum rewards: 37.454, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.750', 'AMMO5': '0.007', 'AMMO2': '0.062', 'weapon5': '0.138', 'WEAPON5': '0.200', 'weapon2': '0.222', 'AMMO3': '0.229', 'AMMO4': '0.312', 'WEAPON4': '0.650', 'weapon4': '1.172', 'WEAPON3': '1.400', 'weapon3': '2.166', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.065', 'FRAGCOUNT': '36.500'} [2023-02-25 13:29:41,034][36141] Large shaping reward 3.632 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 13:29:41,208][36141] DAMAGECOUNT value on done: 243442.0 [2023-02-25 13:29:41,209][36141] Sum rewards: 45.380, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.277', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.134', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.300', 'weapon4': '0.578', 'WEAPON3': '1.200', 'HITCOUNT': '2.630', 'weapon3': '2.776', 'DAMAGECOUNT': '12.747', 'FRAGCOUNT': '40.000'} [2023-02-25 13:29:41,330][36140] DAMAGECOUNT value on done: 244320.0 [2023-02-25 13:29:41,330][36140] Sum rewards: 54.004, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.362', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.102', 'WEAPON5': '0.150', 'weapon2': '0.156', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon4': '0.298', 'WEAPON3': '1.250', 'HITCOUNT': '3.180', 'weapon3': '3.266', 'DAMAGECOUNT': '14.208', 'FRAGCOUNT': '46.000'} [2023-02-25 13:29:41,394][36157] DAMAGECOUNT value on done: 245847.0 [2023-02-25 13:29:41,394][36157] Sum rewards: 54.340, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.799', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.049', 'AMMO3': '0.176', 'weapon2': '0.220', 'weapon5': '0.222', 'AMMO4': '0.243', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.836', 'WEAPON3': '1.000', 'weapon3': '2.406', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.226', 'FRAGCOUNT': '47.000'} [2023-02-25 13:29:41,512][36141] DAMAGECOUNT value on done: 239848.0 [2023-02-25 13:29:41,512][36141] Sum rewards: 63.404, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.670', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.062', 'WEAPON4': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'weapon4': '0.258', 'weapon2': '0.442', 'WEAPON3': '1.300', 'weapon3': '3.016', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.381', 'FRAGCOUNT': '54.000'} [2023-02-25 13:29:41,639][36140] DAMAGECOUNT value on done: 238027.0 [2023-02-25 13:29:41,640][36140] Sum rewards: 48.664, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.771', 'AMMO5': '0.009', 'AMMO2': '0.021', 'WEAPON1': '0.030', 'weapon7': '0.090', 'AMMO4': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.126', 'AMMO3': '0.129', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.266', 'weapon2': '0.720', 'WEAPON3': '0.800', 'weapon3': '2.322', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '12.618', 'FRAGCOUNT': '38.500'} [2023-02-25 13:29:41,707][36157] DAMAGECOUNT value on done: 240071.0 [2023-02-25 13:29:41,707][36157] Sum rewards: 47.835, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.394', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.049', 'AMMO3': '0.153', 'weapon5': '0.166', 'AMMO4': '0.246', 'WEAPON5': '0.400', 'weapon2': '0.450', 'WEAPON4': '0.700', 'weapon4': '0.764', 'WEAPON3': '1.000', 'weapon3': '2.324', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.368', 'FRAGCOUNT': '43.000'} [2023-02-25 13:29:41,715][36141] DAMAGECOUNT value on done: 237437.0 [2023-02-25 13:29:41,716][36141] Sum rewards: 42.851, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.957', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.185', 'weapon2': '0.204', 'weapon5': '0.204', 'WEAPON5': '0.300', 'WEAPON4': '0.550', 'weapon4': '0.722', 'WEAPON3': '1.050', 'weapon3': '2.472', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.873', 'FRAGCOUNT': '39.000'} [2023-02-25 13:29:42,029][36141] DAMAGECOUNT value on done: 229642.0 [2023-02-25 13:29:42,030][36141] Sum rewards: 60.740, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.553', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.090', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.386', 'weapon4': '0.438', 'WEAPON3': '0.850', 'weapon3': '2.770', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.899', 'FRAGCOUNT': '50.000'} [2023-02-25 13:29:42,035][36157] DAMAGECOUNT value on done: 244265.0 [2023-02-25 13:29:42,036][36157] Sum rewards: 50.466, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.602', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.092', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon4': '0.268', 'weapon2': '0.398', 'WEAPON3': '1.200', 'HITCOUNT': '2.610', 'weapon3': '3.038', 'DAMAGECOUNT': '12.825', 'FRAGCOUNT': '43.000'} [2023-02-25 13:29:42,051][36140] DAMAGECOUNT value on done: 238549.0 [2023-02-25 13:29:42,052][36140] Sum rewards: 50.207, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.288', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.178', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.312', 'weapon5': '0.394', 'weapon4': '0.506', 'WEAPON3': '1.150', 'weapon3': '2.564', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.437', 'FRAGCOUNT': '43.000'} [2023-02-25 13:29:42,346][36140] DAMAGECOUNT value on done: 235898.0 [2023-02-25 13:29:42,346][36140] Sum rewards: 61.147, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.545', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.050', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon2': '0.286', 'weapon4': '0.346', 'WEAPON3': '1.350', 'weapon3': '3.100', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.033', 'FRAGCOUNT': '53.000'} [2023-02-25 13:29:42,351][36157] DAMAGECOUNT value on done: 244380.0 [2023-02-25 13:29:42,351][36157] Sum rewards: 50.326, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.370', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.042', 'AMMO3': '0.171', 'AMMO4': '0.209', 'weapon5': '0.216', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.508', 'weapon4': '0.852', 'WEAPON3': '1.050', 'weapon3': '2.066', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.662', 'FRAGCOUNT': '44.000'} [2023-02-25 13:29:42,438][36156] DAMAGECOUNT value on done: 244415.0 [2023-02-25 13:29:42,438][36156] Sum rewards: 56.765, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.890', 'AMMO5': '0.009', 'AMMO2': '0.031', 'WEAPON4': '0.100', 'weapon5': '0.124', 'weapon2': '0.144', 'AMMO4': '0.153', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'weapon4': '0.360', 'WEAPON3': '1.000', 'HITCOUNT': '3.060', 'weapon3': '3.080', 'DAMAGECOUNT': '14.238', 'FRAGCOUNT': '45.500'} [2023-02-25 13:29:42,754][36156] DAMAGECOUNT value on done: 243897.0 [2023-02-25 13:29:42,755][36156] Sum rewards: 46.268, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.104', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon2': '0.194', 'AMMO3': '0.196', 'weapon5': '0.204', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.478', 'WEAPON3': '1.100', 'HITCOUNT': '2.820', 'weapon3': '2.854', 'DAMAGECOUNT': '12.807', 'FRAGCOUNT': '41.000'} [2023-02-25 13:29:42,763][36156] DAMAGECOUNT value on done: 238486.0 [2023-02-25 13:29:42,763][36156] Sum rewards: 54.994, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.210', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon4': '0.032', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.155', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon2': '0.504', 'WEAPON3': '1.050', 'HITCOUNT': '2.950', 'weapon3': '3.258', 'DAMAGECOUNT': '13.695', 'FRAGCOUNT': '46.000'} [2023-02-25 13:29:43,065][36156] DAMAGECOUNT value on done: 238745.0 [2023-02-25 13:29:43,066][36156] Sum rewards: 50.412, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.330', 'AMMO5': '0.023', 'AMMO2': '0.050', 'AMMO3': '0.178', 'weapon5': '0.238', 'AMMO4': '0.252', 'WEAPON5': '0.500', 'weapon2': '0.502', 'WEAPON4': '0.600', 'weapon4': '0.676', 'WEAPON3': '1.100', 'weapon3': '2.198', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.974', 'FRAGCOUNT': '46.000'} [2023-02-25 13:29:43,280][36138] Updated weights for policy 0, policy_version 40173 (0.0009) [2023-02-25 13:29:43,640][36142] DAMAGECOUNT value on done: 232867.0 [2023-02-25 13:29:43,641][36142] Sum rewards: 46.689, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.495', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.116', 'weapon5': '0.232', 'WEAPON5': '0.250', 'weapon2': '0.258', 'WEAPON4': '0.350', 'WEAPON3': '0.850', 'weapon4': '1.010', 'weapon3': '2.036', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '11.835', 'FRAGCOUNT': '39.000'} [2023-02-25 13:29:43,954][36142] DAMAGECOUNT value on done: 240288.0 [2023-02-25 13:29:43,955][36142] Sum rewards: 54.846, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.690', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.153', 'weapon5': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.368', 'weapon4': '0.504', 'WEAPON3': '1.300', 'weapon3': '2.616', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.610', 'FRAGCOUNT': '48.000'} [2023-02-25 13:29:44,197][36142] DAMAGECOUNT value on done: 236101.0 [2023-02-25 13:29:44,197][36142] Sum rewards: 59.582, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.982', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.094', 'AMMO4': '0.140', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.428', 'weapon2': '0.454', 'WEAPON3': '1.200', 'weapon3': '2.774', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.327', 'FRAGCOUNT': '49.000'} [2023-02-25 13:29:44,493][36142] DAMAGECOUNT value on done: 242742.0 [2023-02-25 13:29:44,493][36142] Sum rewards: 53.319, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.108', 'AMMO5': '0.020', 'AMMO2': '0.022', 'WEAPON4': '0.100', 'AMMO4': '0.112', 'weapon5': '0.114', 'weapon4': '0.186', 'AMMO3': '0.217', 'WEAPON5': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.400', 'HITCOUNT': '2.980', 'weapon3': '3.048', 'DAMAGECOUNT': '13.716', 'FRAGCOUNT': '47.000'} [2023-02-25 13:29:44,729][36114] Fps is (10 sec: 13107.0, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 164564992. Throughput: 0: 3359.6. Samples: 3636050. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-25 13:29:44,730][36114] Avg episode reward: [(0, '51.264')] [2023-02-25 13:29:46,301][36138] Updated weights for policy 0, policy_version 40183 (0.0009) [2023-02-25 13:29:48,498][36154] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:29:49,385][36138] Updated weights for policy 0, policy_version 40193 (0.0009) [2023-02-25 13:29:49,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 164634624. Throughput: 0: 3358.9. Samples: 3656234. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:29:49,730][36114] Avg episode reward: [(0, '51.264')] [2023-02-25 13:29:52,481][36138] Updated weights for policy 0, policy_version 40203 (0.0009) [2023-02-25 13:29:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 164700160. Throughput: 0: 3355.4. Samples: 3666114. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:29:54,730][36114] Avg episode reward: [(0, '51.264')] [2023-02-25 13:29:55,571][36138] Updated weights for policy 0, policy_version 40213 (0.0009) [2023-02-25 13:29:56,038][36155] DAMAGECOUNT value on done: 242065.0 [2023-02-25 13:29:56,039][36155] Sum rewards: 49.608, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.786', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'weapon2': '0.296', 'weapon4': '0.476', 'WEAPON3': '1.400', 'weapon3': '2.834', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.428', 'FRAGCOUNT': '45.000'} [2023-02-25 13:29:56,353][36155] DAMAGECOUNT value on done: 247538.0 [2023-02-25 13:29:56,354][36155] Sum rewards: 58.636, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.895', 'AMMO2': '0.004', 'AMMO4': '0.017', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.244', 'weapon4': '0.454', 'ARMOR': '0.457', 'WEAPON3': '1.200', 'weapon3': '2.980', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.934', 'FRAGCOUNT': '50.000'} [2023-02-25 13:29:56,457][36139] DAMAGECOUNT value on done: 243245.0 [2023-02-25 13:29:56,458][36139] Sum rewards: 50.339, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.130', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.170', 'weapon5': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.484', 'weapon2': '0.520', 'WEAPON3': '1.050', 'weapon3': '2.574', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '12.465', 'FRAGCOUNT': '43.000'} [2023-02-25 13:29:56,636][36155] DAMAGECOUNT value on done: 240217.0 [2023-02-25 13:29:56,636][36155] Sum rewards: 54.036, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.614', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.133', 'weapon5': '0.168', 'weapon2': '0.376', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.464', 'WEAPON3': '0.850', 'HITCOUNT': '2.710', 'weapon3': '2.740', 'DAMAGECOUNT': '15.246', 'FRAGCOUNT': '44.000'} [2023-02-25 13:29:56,776][36139] DAMAGECOUNT value on done: 243381.0 [2023-02-25 13:29:56,777][36139] Sum rewards: 44.774, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.655', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.043', 'AMMO3': '0.154', 'weapon5': '0.202', 'AMMO4': '0.217', 'weapon2': '0.420', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'weapon4': '0.686', 'WEAPON3': '0.850', 'weapon3': '2.396', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '11.850', 'FRAGCOUNT': '40.000'} [2023-02-25 13:29:56,915][36139] DAMAGECOUNT value on done: 243615.0 [2023-02-25 13:29:56,916][36139] Sum rewards: 55.408, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.974', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO4': '0.182', 'AMMO3': '0.188', 'weapon5': '0.226', 'weapon2': '0.276', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.612', 'WEAPON3': '1.100', 'weapon3': '2.596', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.313', 'FRAGCOUNT': '48.000'} [2023-02-25 13:29:56,941][36155] DAMAGECOUNT value on done: 240054.0 [2023-02-25 13:29:56,941][36155] Sum rewards: 48.600, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.635', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.112', 'AMMO4': '0.147', 'AMMO3': '0.198', 'weapon2': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.522', 'WEAPON3': '1.250', 'weapon3': '2.856', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.161', 'FRAGCOUNT': '44.000'} [2023-02-25 13:29:57,213][36139] DAMAGECOUNT value on done: 241786.0 [2023-02-25 13:29:57,213][36139] Sum rewards: 48.752, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.700', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon5': '0.162', 'AMMO4': '0.193', 'weapon2': '0.206', 'AMMO3': '0.228', 'WEAPON5': '0.350', 'weapon4': '0.420', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.760', 'weapon3': '2.914', 'DAMAGECOUNT': '13.863', 'FRAGCOUNT': '45.000'} [2023-02-25 13:29:58,631][36138] Updated weights for policy 0, policy_version 40223 (0.0009) [2023-02-25 13:29:59,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13482.1). Total num frames: 164765696. Throughput: 0: 3350.0. Samples: 3686140. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:29:59,730][36114] Avg episode reward: [(0, '50.995')] [2023-02-25 13:30:00,067][36154] DAMAGECOUNT value on done: 246724.0 [2023-02-25 13:30:00,068][36154] Sum rewards: 49.491, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.456', 'AMMO5': '0.011', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.120', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.274', 'weapon2': '0.438', 'WEAPON3': '1.350', 'weapon3': '2.914', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.674', 'FRAGCOUNT': '45.000'} [2023-02-25 13:30:00,372][36154] DAMAGECOUNT value on done: 240954.0 [2023-02-25 13:30:00,373][36154] Sum rewards: 49.597, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.000', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon5': '0.130', 'AMMO3': '0.193', 'AMMO4': '0.207', 'weapon2': '0.328', 'WEAPON5': '0.400', 'weapon4': '0.466', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.726', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.278', 'FRAGCOUNT': '45.000'} [2023-02-25 13:30:00,648][36154] DAMAGECOUNT value on done: 240061.0 [2023-02-25 13:30:00,648][36154] Sum rewards: 36.382, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.292', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.030', 'AMMO3': '0.138', 'AMMO4': '0.148', 'weapon5': '0.158', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.358', 'weapon4': '0.578', 'WEAPON3': '0.900', 'HITCOUNT': '2.190', 'weapon3': '2.362', 'DAMAGECOUNT': '10.386', 'FRAGCOUNT': '31.000'} [2023-02-25 13:30:00,929][36155] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-25 13:30:00,975][36154] DAMAGECOUNT value on done: 241454.0 [2023-02-25 13:30:00,976][36154] Sum rewards: 38.812, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.684', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'weapon5': '0.156', 'AMMO3': '0.181', 'weapon2': '0.280', 'WEAPON4': '0.350', 'weapon4': '0.828', 'WEAPON3': '1.050', 'weapon3': '2.330', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '11.400', 'FRAGCOUNT': '34.000'} [2023-02-25 13:30:01,125][36141] DAMAGECOUNT value on done: 248409.0 [2023-02-25 13:30:01,125][36141] Sum rewards: 55.947, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.367', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.062', 'AMMO3': '0.190', 'weapon5': '0.204', 'weapon2': '0.212', 'AMMO4': '0.312', 'WEAPON5': '0.500', 'weapon4': '0.530', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.770', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.895', 'FRAGCOUNT': '49.000'} [2023-02-25 13:30:01,423][36141] DAMAGECOUNT value on done: 244626.0 [2023-02-25 13:30:01,424][36141] Sum rewards: 56.556, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.620', 'AMMO5': '0.004', 'AMMO2': '0.013', 'weapon4': '0.014', 'weapon5': '0.030', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.228', 'weapon2': '0.584', 'WEAPON3': '1.450', 'weapon3': '3.186', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.334', 'FRAGCOUNT': '50.000'} [2023-02-25 13:30:01,550][36157] DAMAGECOUNT value on done: 250752.0 [2023-02-25 13:30:01,550][36157] Sum rewards: 61.647, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.548', 'ARMOR': '0.004', 'AMMO5': '0.026', 'AMMO2': '0.051', 'weapon5': '0.106', 'weapon4': '0.162', 'AMMO3': '0.172', 'AMMO4': '0.255', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'weapon2': '0.724', 'WEAPON3': '1.100', 'weapon3': '2.780', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.715', 'FRAGCOUNT': '55.000'} [2023-02-25 13:30:01,570][36140] DAMAGECOUNT value on done: 249744.0 [2023-02-25 13:30:01,571][36140] Sum rewards: 53.630, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.084', 'ARMOR': '0.008', 'AMMO5': '0.021', 'AMMO2': '0.041', 'AMMO4': '0.205', 'AMMO3': '0.217', 'weapon2': '0.254', 'weapon5': '0.342', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'weapon4': '0.794', 'WEAPON3': '1.250', 'weapon3': '2.200', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.242', 'FRAGCOUNT': '46.000'} [2023-02-25 13:30:01,603][36138] Updated weights for policy 0, policy_version 40233 (0.0009) [2023-02-25 13:30:01,671][36141] DAMAGECOUNT value on done: 241113.0 [2023-02-25 13:30:01,672][36141] Sum rewards: 38.864, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.335', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.020', 'weapon5': '0.020', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.235', 'weapon2': '0.642', 'WEAPON3': '1.300', 'HITCOUNT': '2.590', 'weapon3': '3.090', 'DAMAGECOUNT': '10.983', 'FRAGCOUNT': '36.000'} [2023-02-25 13:30:01,849][36157] DAMAGECOUNT value on done: 244063.0 [2023-02-25 13:30:01,850][36157] Sum rewards: 46.736, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.130', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.050', 'AMMO4': '0.091', 'WEAPON5': '0.150', 'weapon4': '0.198', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon2': '0.812', 'WEAPON3': '1.300', 'weapon3': '2.770', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '11.976', 'FRAGCOUNT': '41.000'} [2023-02-25 13:30:01,885][36140] DAMAGECOUNT value on done: 241972.0 [2023-02-25 13:30:01,886][36140] Sum rewards: 44.884, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.891', 'AMMO2': '0.013', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.193', 'weapon4': '0.296', 'weapon2': '0.780', 'WEAPON3': '1.050', 'HITCOUNT': '2.670', 'weapon3': '2.774', 'DAMAGECOUNT': '11.835', 'FRAGCOUNT': '38.000'} [2023-02-25 13:30:01,984][36141] DAMAGECOUNT value on done: 233502.0 [2023-02-25 13:30:01,984][36141] Sum rewards: 45.855, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.382', 'AMMO5': '0.013', 'weapon5': '0.016', 'AMMO2': '0.030', 'AMMO3': '0.146', 'AMMO4': '0.148', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.380', 'WEAPON3': '0.800', 'weapon2': '0.900', 'HITCOUNT': '2.360', 'weapon3': '2.514', 'DAMAGECOUNT': '11.580', 'FRAGCOUNT': '38.000'} [2023-02-25 13:30:02,172][36157] DAMAGECOUNT value on done: 249016.0 [2023-02-25 13:30:02,173][36157] Sum rewards: 57.478, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.245', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon5': '0.102', 'AMMO3': '0.218', 'AMMO4': '0.263', 'weapon4': '0.328', 'WEAPON5': '0.450', 'weapon2': '0.490', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.812', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.253', 'FRAGCOUNT': '53.000'} [2023-02-25 13:30:02,267][36140] DAMAGECOUNT value on done: 243913.0 [2023-02-25 13:30:02,268][36140] Sum rewards: 60.073, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.740', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.104', 'AMMO4': '0.129', 'weapon5': '0.144', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.450', 'weapon3': '3.110', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '54.000'} [2023-02-25 13:30:02,497][36157] DAMAGECOUNT value on done: 248862.0 [2023-02-25 13:30:02,498][36157] Sum rewards: 52.076, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.846', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.032', 'weapon5': '0.096', 'AMMO4': '0.162', 'AMMO3': '0.219', 'weapon4': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.468', 'WEAPON3': '1.350', 'HITCOUNT': '2.770', 'weapon3': '2.832', 'DAMAGECOUNT': '13.086', 'FRAGCOUNT': '48.000'} [2023-02-25 13:30:02,556][36140] DAMAGECOUNT value on done: 240562.0 [2023-02-25 13:30:02,556][36140] Sum rewards: 53.549, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.051', 'AMMO5': '0.017', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.110', 'weapon2': '0.198', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'weapon4': '0.338', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.790', 'weapon3': '3.136', 'DAMAGECOUNT': '13.992', 'FRAGCOUNT': '47.000'} [2023-02-25 13:30:02,558][36156] DAMAGECOUNT value on done: 249437.0 [2023-02-25 13:30:02,559][36156] Sum rewards: 53.995, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.386', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO4': '0.157', 'AMMO3': '0.184', 'weapon5': '0.222', 'WEAPON4': '0.250', 'weapon4': '0.284', 'weapon2': '0.310', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '2.916', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.871', 'FRAGCOUNT': '45.000'} [2023-02-25 13:30:02,864][36156] DAMAGECOUNT value on done: 249426.0 [2023-02-25 13:30:02,865][36156] Sum rewards: 70.511, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.228', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.094', 'AMMO3': '0.168', 'AMMO4': '0.179', 'WEAPON5': '0.250', 'weapon2': '0.448', 'WEAPON4': '0.500', 'weapon4': '0.516', 'WEAPON3': '1.050', 'weapon3': '2.598', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '61.000'} [2023-02-25 13:30:02,873][36156] DAMAGECOUNT value on done: 242573.0 [2023-02-25 13:30:02,874][36156] Sum rewards: 41.634, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.392', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.065', 'weapon4': '0.198', 'AMMO3': '0.272', 'weapon2': '0.592', 'WEAPON3': '1.500', 'HITCOUNT': '2.770', 'weapon3': '3.050', 'DAMAGECOUNT': '12.261', 'FRAGCOUNT': '38.000'} [2023-02-25 13:30:03,189][36156] DAMAGECOUNT value on done: 243331.0 [2023-02-25 13:30:03,189][36156] Sum rewards: 53.033, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.678', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon5': '0.122', 'AMMO3': '0.175', 'AMMO4': '0.175', 'weapon2': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.348', 'WEAPON3': '1.150', 'HITCOUNT': '2.950', 'weapon3': '2.960', 'DAMAGECOUNT': '13.758', 'FRAGCOUNT': '45.000'} [2023-02-25 13:30:03,724][36142] DAMAGECOUNT value on done: 237258.0 [2023-02-25 13:30:03,725][36142] Sum rewards: 49.034, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.904', 'AMMO5': '0.014', 'AMMO2': '0.026', 'weapon4': '0.046', 'weapon5': '0.072', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.640', 'WEAPON3': '1.300', 'HITCOUNT': '2.740', 'weapon3': '3.030', 'DAMAGECOUNT': '13.173', 'FRAGCOUNT': '42.000'} [2023-02-25 13:30:04,039][36142] DAMAGECOUNT value on done: 244468.0 [2023-02-25 13:30:04,039][36142] Sum rewards: 45.857, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.434', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.055', 'AMMO3': '0.155', 'weapon5': '0.168', 'AMMO4': '0.273', 'weapon2': '0.318', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.816', 'WEAPON3': '0.900', 'weapon3': '2.358', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.195', 'FRAGCOUNT': '41.000'} [2023-02-25 13:30:04,248][36142] DAMAGECOUNT value on done: 240236.0 [2023-02-25 13:30:04,249][36142] Sum rewards: 47.520, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.290', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.048', 'AMMO4': '0.089', 'weapon4': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.612', 'WEAPON3': '1.300', 'HITCOUNT': '2.810', 'weapon3': '2.984', 'DAMAGECOUNT': '12.405', 'FRAGCOUNT': '43.000'} [2023-02-25 13:30:04,563][36142] DAMAGECOUNT value on done: 247666.0 [2023-02-25 13:30:04,563][36142] Sum rewards: 56.209, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.672', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.112', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'weapon2': '0.454', 'weapon4': '0.484', 'WEAPON3': '1.350', 'weapon3': '2.758', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.772', 'FRAGCOUNT': '49.000'} [2023-02-25 13:30:04,662][36138] Updated weights for policy 0, policy_version 40243 (0.0009) [2023-02-25 13:30:04,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 164835328. Throughput: 0: 3350.0. Samples: 3706370. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:30:04,729][36114] Avg episode reward: [(0, '50.798')] [2023-02-25 13:30:05,753][36142] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:30:07,717][36138] Updated weights for policy 0, policy_version 40253 (0.0010) [2023-02-25 13:30:09,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13482.1). Total num frames: 164900864. Throughput: 0: 3350.8. Samples: 3716462. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:30:09,730][36114] Avg episode reward: [(0, '50.798')] [2023-02-25 13:30:10,724][36138] Updated weights for policy 0, policy_version 40263 (0.0009) [2023-02-25 13:30:13,783][36138] Updated weights for policy 0, policy_version 40273 (0.0009) [2023-02-25 13:30:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 164970496. Throughput: 0: 3350.0. Samples: 3736634. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:30:14,730][36114] Avg episode reward: [(0, '50.798')] [2023-02-25 13:30:15,981][36155] DAMAGECOUNT value on done: 246963.0 [2023-02-25 13:30:15,982][36155] Sum rewards: 58.029, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.995', 'AMMO5': '0.009', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.122', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.394', 'weapon2': '0.414', 'WEAPON3': '1.050', 'weapon3': '2.744', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.604', 'FRAGCOUNT': '48.000'} [2023-02-25 13:30:16,295][36155] DAMAGECOUNT value on done: 252706.0 [2023-02-25 13:30:16,296][36155] Sum rewards: 56.165, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.210', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.146', 'AMMO3': '0.170', 'AMMO4': '0.198', 'WEAPON5': '0.200', 'weapon2': '0.296', 'WEAPON4': '0.300', 'weapon4': '0.560', 'WEAPON3': '1.100', 'weapon3': '2.754', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.324', 'FRAGCOUNT': '47.000'} [2023-02-25 13:30:16,369][36139] DAMAGECOUNT value on done: 247744.0 [2023-02-25 13:30:16,369][36139] Sum rewards: 52.124, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.176', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon4': '0.326', 'weapon2': '0.574', 'WEAPON3': '1.150', 'weapon3': '2.728', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.497', 'FRAGCOUNT': '44.000'} [2023-02-25 13:30:16,558][36155] DAMAGECOUNT value on done: 244101.0 [2023-02-25 13:30:16,559][36155] Sum rewards: 45.002, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.160', 'AMMO5': '0.029', 'AMMO2': '0.056', 'AMMO3': '0.104', 'AMMO4': '0.282', 'weapon5': '0.386', 'weapon2': '0.480', 'WEAPON3': '0.600', 'WEAPON4': '0.650', 'weapon4': '0.666', 'WEAPON5': '0.700', 'weapon3': '1.926', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '11.652', 'FRAGCOUNT': '38.000'} [2023-02-25 13:30:16,677][36139] DAMAGECOUNT value on done: 247299.0 [2023-02-25 13:30:16,677][36139] Sum rewards: 42.173, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.020', 'ARMOR': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO4': '0.116', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon2': '0.530', 'WEAPON3': '1.300', 'HITCOUNT': '2.650', 'weapon3': '3.120', 'DAMAGECOUNT': '11.754', 'FRAGCOUNT': '39.000'} [2023-02-25 13:30:16,848][36138] Updated weights for policy 0, policy_version 40283 (0.0010) [2023-02-25 13:30:16,867][36139] DAMAGECOUNT value on done: 248128.0 [2023-02-25 13:30:16,867][36139] Sum rewards: 52.071, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.116', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon4': '0.060', 'weapon5': '0.128', 'AMMO4': '0.143', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.544', 'WEAPON3': '1.400', 'HITCOUNT': '2.740', 'weapon3': '3.000', 'DAMAGECOUNT': '13.539', 'FRAGCOUNT': '46.000'} [2023-02-25 13:30:16,891][36155] DAMAGECOUNT value on done: 244043.0 [2023-02-25 13:30:16,892][36155] Sum rewards: 40.459, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.390', 'AMMO5': '0.020', 'AMMO2': '0.068', 'AMMO3': '0.171', 'weapon5': '0.244', 'AMMO4': '0.341', 'weapon2': '0.408', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.530', 'WEAPON3': '0.950', 'weapon3': '2.400', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '11.967', 'FRAGCOUNT': '36.000'} [2023-02-25 13:30:17,176][36139] DAMAGECOUNT value on done: 247087.0 [2023-02-25 13:30:17,177][36139] Sum rewards: 58.294, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.590', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.098', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.242', 'weapon4': '0.294', 'weapon2': '0.326', 'WEAPON3': '1.400', 'weapon3': '2.976', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '50.500'} [2023-02-25 13:30:18,298][36155] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0)] [2023-02-25 13:30:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13482.1). Total num frames: 165036032. Throughput: 0: 3349.2. Samples: 3756788. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:30:19,729][36114] Avg episode reward: [(0, '50.731')] [2023-02-25 13:30:19,899][36138] Updated weights for policy 0, policy_version 40293 (0.0009) [2023-02-25 13:30:20,060][36154] DAMAGECOUNT value on done: 250127.0 [2023-02-25 13:30:20,061][36154] Sum rewards: 38.909, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.208', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.126', 'AMMO3': '0.150', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'ARMOR': '0.470', 'weapon2': '0.718', 'weapon4': '0.722', 'WEAPON3': '0.850', 'HITCOUNT': '1.980', 'weapon3': '2.078', 'DAMAGECOUNT': '10.209', 'FRAGCOUNT': '34.000'} [2023-02-25 13:30:20,368][36154] DAMAGECOUNT value on done: 244827.0 [2023-02-25 13:30:20,368][36154] Sum rewards: 40.776, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.336', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon5': '0.170', 'AMMO3': '0.194', 'weapon2': '0.326', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.536', 'WEAPON3': '1.200', 'HITCOUNT': '2.350', 'weapon3': '2.698', 'DAMAGECOUNT': '11.619', 'FRAGCOUNT': '38.000'} [2023-02-25 13:30:20,648][36154] DAMAGECOUNT value on done: 245241.0 [2023-02-25 13:30:20,648][36154] Sum rewards: 58.498, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.130', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO3': '0.195', 'AMMO4': '0.223', 'weapon5': '0.264', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.616', 'WEAPON3': '1.200', 'weapon3': '2.496', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.540', 'FRAGCOUNT': '50.000'} [2023-02-25 13:30:20,943][36154] DAMAGECOUNT value on done: 246694.0 [2023-02-25 13:30:20,943][36154] Sum rewards: 60.369, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.190', 'AMMO5': '0.012', 'ARMOR': '0.013', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon5': '0.130', 'AMMO3': '0.149', 'WEAPON5': '0.250', 'weapon2': '0.396', 'WEAPON4': '0.400', 'weapon4': '0.608', 'WEAPON3': '0.850', 'weapon3': '2.572', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '48.000'} [2023-02-25 13:30:21,100][36141] DAMAGECOUNT value on done: 252244.0 [2023-02-25 13:30:21,101][36141] Sum rewards: 43.686, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.114', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.074', 'AMMO4': '0.151', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.370', 'ARMOR': '0.460', 'weapon4': '0.596', 'WEAPON3': '1.100', 'HITCOUNT': '2.550', 'weapon3': '2.722', 'DAMAGECOUNT': '11.505', 'FRAGCOUNT': '39.000'} [2023-02-25 13:30:21,418][36141] DAMAGECOUNT value on done: 249500.0 [2023-02-25 13:30:21,418][36141] Sum rewards: 54.676, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.556', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.050', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.232', 'weapon4': '0.294', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.138', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.622', 'FRAGCOUNT': '47.000'} [2023-02-25 13:30:21,522][36157] DAMAGECOUNT value on done: 255083.0 [2023-02-25 13:30:21,523][36157] Sum rewards: 51.990, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.040', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.009', 'weapon5': '0.022', 'WEAPON4': '0.100', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'weapon4': '0.260', 'weapon2': '0.452', 'WEAPON3': '1.100', 'weapon3': '3.106', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '12.993', 'FRAGCOUNT': '43.000'} [2023-02-25 13:30:21,533][36140] DAMAGECOUNT value on done: 253742.0 [2023-02-25 13:30:21,534][36140] Sum rewards: 39.833, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.935', 'AMMO2': '0.016', 'AMMO5': '0.017', 'AMMO4': '0.078', 'weapon5': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.249', 'weapon4': '0.298', 'WEAPON5': '0.300', 'weapon2': '0.390', 'WEAPON3': '1.450', 'HITCOUNT': '2.790', 'weapon3': '2.918', 'DAMAGECOUNT': '11.994', 'FRAGCOUNT': '37.000'} [2023-02-25 13:30:21,616][36141] DAMAGECOUNT value on done: 245332.0 [2023-02-25 13:30:21,617][36141] Sum rewards: 50.224, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.716', 'AMMO5': '0.017', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.090', 'weapon5': '0.136', 'WEAPON4': '0.250', 'AMMO3': '0.258', 'WEAPON5': '0.350', 'weapon4': '0.368', 'weapon2': '0.414', 'WEAPON3': '1.500', 'HITCOUNT': '2.780', 'weapon3': '2.832', 'DAMAGECOUNT': '12.657', 'FRAGCOUNT': '47.000'} [2023-02-25 13:30:21,832][36140] DAMAGECOUNT value on done: 246551.0 [2023-02-25 13:30:21,832][36140] Sum rewards: 51.157, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.993', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.030', 'weapon5': '0.074', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon2': '0.666', 'WEAPON3': '1.400', 'HITCOUNT': '3.020', 'weapon3': '3.054', 'DAMAGECOUNT': '13.737', 'FRAGCOUNT': '45.000'} [2023-02-25 13:30:21,836][36157] DAMAGECOUNT value on done: 248642.0 [2023-02-25 13:30:21,837][36157] Sum rewards: 47.030, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.478', 'AMMO5': '0.017', 'AMMO2': '0.053', 'AMMO3': '0.183', 'weapon2': '0.208', 'AMMO4': '0.267', 'weapon5': '0.366', 'WEAPON4': '0.500', 'weapon4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.528', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '13.125', 'FRAGCOUNT': '43.000'} [2023-02-25 13:30:21,919][36141] DAMAGECOUNT value on done: 237703.0 [2023-02-25 13:30:21,919][36141] Sum rewards: 51.921, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.218', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon5': '0.088', 'AMMO4': '0.144', 'AMMO3': '0.222', 'weapon4': '0.282', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.364', 'WEAPON3': '1.300', 'HITCOUNT': '2.760', 'weapon3': '2.934', 'DAMAGECOUNT': '12.603', 'FRAGCOUNT': '49.000'} [2023-02-25 13:30:22,150][36157] DAMAGECOUNT value on done: 253143.0 [2023-02-25 13:30:22,151][36157] Sum rewards: 46.708, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.714', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.053', 'AMMO3': '0.172', 'weapon5': '0.204', 'weapon2': '0.252', 'AMMO4': '0.267', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.770', 'WEAPON3': '0.950', 'weapon3': '2.216', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.381', 'FRAGCOUNT': '41.000'} [2023-02-25 13:30:22,221][36140] DAMAGECOUNT value on done: 248883.0 [2023-02-25 13:30:22,221][36140] Sum rewards: 56.292, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.510', 'ARMOR': '0.008', 'AMMO5': '0.030', 'AMMO2': '0.067', 'weapon5': '0.126', 'AMMO3': '0.217', 'AMMO4': '0.337', 'weapon2': '0.380', 'weapon4': '0.464', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.702', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '51.000'} [2023-02-25 13:30:22,458][36157] DAMAGECOUNT value on done: 253696.0 [2023-02-25 13:30:22,458][36157] Sum rewards: 62.062, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.636', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO3': '0.109', 'AMMO4': '0.143', 'weapon5': '0.242', 'weapon2': '0.330', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '0.650', 'weapon4': '0.858', 'weapon3': '2.350', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '14.502', 'FRAGCOUNT': '51.000'} [2023-02-25 13:30:22,525][36140] DAMAGECOUNT value on done: 244578.0 [2023-02-25 13:30:22,526][36140] Sum rewards: 45.919, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.024', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.059', 'AMMO3': '0.155', 'weapon5': '0.274', 'AMMO4': '0.296', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.596', 'weapon4': '0.858', 'WEAPON3': '0.900', 'weapon3': '1.918', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '12.048', 'FRAGCOUNT': '39.000'} [2023-02-25 13:30:22,596][36156] DAMAGECOUNT value on done: 253569.0 [2023-02-25 13:30:22,597][36156] Sum rewards: 45.405, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.840', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.050', 'AMMO4': '0.091', 'weapon4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon2': '0.510', 'WEAPON3': '1.150', 'HITCOUNT': '2.700', 'weapon3': '3.188', 'DAMAGECOUNT': '12.396', 'FRAGCOUNT': '40.000'} [2023-02-25 13:30:22,859][36156] DAMAGECOUNT value on done: 254501.0 [2023-02-25 13:30:22,860][36156] Sum rewards: 50.603, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.638', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.140', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon2': '0.286', 'WEAPON4': '0.300', 'weapon4': '0.814', 'WEAPON3': '1.150', 'weapon3': '2.464', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.225', 'FRAGCOUNT': '42.000'} [2023-02-25 13:30:22,899][36156] DAMAGECOUNT value on done: 247914.0 [2023-02-25 13:30:22,899][36156] Sum rewards: 59.963, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.846', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.055', 'weapon5': '0.172', 'AMMO3': '0.192', 'AMMO4': '0.276', 'weapon2': '0.284', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.828', 'WEAPON3': '1.050', 'weapon3': '2.410', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.023', 'FRAGCOUNT': '51.000'} [2023-02-25 13:30:22,929][36138] Updated weights for policy 0, policy_version 40303 (0.0009) [2023-02-25 13:30:23,174][36156] DAMAGECOUNT value on done: 248287.0 [2023-02-25 13:30:23,175][36156] Sum rewards: 55.251, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.289', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon5': '0.082', 'AMMO4': '0.103', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.408', 'weapon2': '0.504', 'WEAPON3': '1.100', 'weapon3': '2.652', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.868', 'FRAGCOUNT': '46.500'} [2023-02-25 13:30:23,799][36142] DAMAGECOUNT value on done: 241565.0 [2023-02-25 13:30:23,799][36142] Sum rewards: 46.082, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.906', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.140', 'weapon2': '0.190', 'AMMO4': '0.215', 'AMMO3': '0.254', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.460', 'WEAPON3': '1.500', 'HITCOUNT': '2.620', 'weapon3': '2.938', 'DAMAGECOUNT': '12.615', 'FRAGCOUNT': '46.000'} [2023-02-25 13:30:24,102][36142] DAMAGECOUNT value on done: 249379.0 [2023-02-25 13:30:24,102][36142] Sum rewards: 62.607, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.557', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.091', 'weapon4': '0.124', 'AMMO3': '0.145', 'weapon2': '0.828', 'WEAPON3': '0.900', 'weapon3': '2.706', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.733', 'FRAGCOUNT': '51.000'} [2023-02-25 13:30:24,321][36142] DAMAGECOUNT value on done: 243508.0 [2023-02-25 13:30:24,322][36142] Sum rewards: 33.128, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.010', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'weapon2': '0.462', 'weapon4': '0.580', 'WEAPON3': '1.150', 'HITCOUNT': '2.030', 'weapon3': '2.656', 'DAMAGECOUNT': '9.816', 'FRAGCOUNT': '30.000'} [2023-02-25 13:30:24,628][36142] DAMAGECOUNT value on done: 252551.0 [2023-02-25 13:30:24,628][36142] Sum rewards: 61.219, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.298', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'weapon4': '0.062', 'AMMO4': '0.070', 'AMMO3': '0.206', 'weapon2': '0.398', 'WEAPON3': '1.250', 'HITCOUNT': '3.140', 'weapon3': '3.296', 'DAMAGECOUNT': '14.655', 'FRAGCOUNT': '52.000'} [2023-02-25 13:30:24,729][36114] Fps is (10 sec: 13107.0, 60 sec: 13380.2, 300 sec: 13468.2). Total num frames: 165101568. Throughput: 0: 3351.5. Samples: 3766890. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:30:24,730][36114] Avg episode reward: [(0, '50.757')] [2023-02-25 13:30:25,982][36138] Updated weights for policy 0, policy_version 40313 (0.0009) [2023-02-25 13:30:29,006][36138] Updated weights for policy 0, policy_version 40323 (0.0009) [2023-02-25 13:30:29,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.6, 300 sec: 13482.1). Total num frames: 165171200. Throughput: 0: 3359.3. Samples: 3787218. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:30:29,730][36114] Avg episode reward: [(0, '50.757')] [2023-02-25 13:30:32,086][36138] Updated weights for policy 0, policy_version 40333 (0.0009) [2023-02-25 13:30:34,729][36114] Fps is (10 sec: 13517.1, 60 sec: 13380.3, 300 sec: 13468.2). Total num frames: 165236736. Throughput: 0: 3358.5. Samples: 3807364. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:30:34,730][36114] Avg episode reward: [(0, '50.757')] [2023-02-25 13:30:35,132][36138] Updated weights for policy 0, policy_version 40343 (0.0010) [2023-02-25 13:30:35,884][36155] DAMAGECOUNT value on done: 251678.0 [2023-02-25 13:30:35,885][36155] Sum rewards: 56.474, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.672', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.108', 'AMMO3': '0.162', 'WEAPON5': '0.200', 'weapon4': '0.228', 'weapon2': '0.606', 'WEAPON3': '1.000', 'weapon3': '2.930', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.145', 'FRAGCOUNT': '46.500'} [2023-02-25 13:30:36,189][36155] DAMAGECOUNT value on done: 257829.0 [2023-02-25 13:30:36,190][36155] Sum rewards: 56.637, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.608', 'AMMO5': '0.010', 'AMMO2': '0.032', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'weapon5': '0.164', 'AMMO3': '0.180', 'weapon2': '0.244', 'WEAPON4': '0.350', 'weapon4': '0.932', 'WEAPON3': '1.150', 'weapon3': '2.432', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.369', 'FRAGCOUNT': '48.000'} [2023-02-25 13:30:36,212][36139] DAMAGECOUNT value on done: 250694.0 [2023-02-25 13:30:36,213][36139] Sum rewards: 27.951, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.851', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.042', 'weapon7': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.176', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'weapon2': '0.340', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'weapon4': '1.172', 'WEAPON3': '1.250', 'weapon3': '2.058', 'HITCOUNT': '2.170', 'DAMAGECOUNT': '8.850', 'FRAGCOUNT': '28.000'} [2023-02-25 13:30:36,521][36139] DAMAGECOUNT value on done: 251482.0 [2023-02-25 13:30:36,521][36139] Sum rewards: 47.547, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.299', 'AMMO5': '0.009', 'AMMO2': '0.045', 'weapon5': '0.124', 'AMMO3': '0.136', 'AMMO4': '0.227', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'weapon2': '0.422', 'WEAPON4': '0.550', 'WEAPON3': '0.750', 'weapon4': '1.068', 'weapon3': '1.826', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '12.549', 'FRAGCOUNT': '40.000'} [2023-02-25 13:30:36,526][36155] DAMAGECOUNT value on done: 248534.0 [2023-02-25 13:30:36,526][36155] Sum rewards: 50.058, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.535', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.051', 'AMMO3': '0.167', 'weapon5': '0.202', 'AMMO4': '0.254', 'weapon2': '0.354', 'WEAPON4': '0.450', 'weapon4': '0.466', 'WEAPON5': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.694', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.299', 'FRAGCOUNT': '43.500'} [2023-02-25 13:30:36,654][36139] DAMAGECOUNT value on done: 253085.0 [2023-02-25 13:30:36,655][36139] Sum rewards: 49.842, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.124', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO4': '0.157', 'AMMO3': '0.193', 'weapon4': '0.238', 'weapon5': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '1.028', 'WEAPON3': '1.150', 'weapon3': '2.148', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.871', 'FRAGCOUNT': '41.500'} [2023-02-25 13:30:36,828][36155] DAMAGECOUNT value on done: 249033.0 [2023-02-25 13:30:36,829][36155] Sum rewards: 55.438, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.456', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.160', 'AMMO3': '0.210', 'weapon2': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.564', 'WEAPON3': '1.300', 'weapon3': '2.698', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.970', 'FRAGCOUNT': '49.000'} [2023-02-25 13:30:36,959][36139] DAMAGECOUNT value on done: 251408.0 [2023-02-25 13:30:36,960][36139] Sum rewards: 54.905, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.660', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon5': '0.070', 'AMMO4': '0.093', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.240', 'weapon4': '0.246', 'WEAPON3': '0.950', 'HITCOUNT': '2.660', 'weapon3': '3.316', 'DAMAGECOUNT': '12.963', 'FRAGCOUNT': '46.000'} [2023-02-25 13:30:38,190][36138] Updated weights for policy 0, policy_version 40353 (0.0009) [2023-02-25 13:30:39,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 165306368. Throughput: 0: 3361.5. Samples: 3817382. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:30:39,729][36114] Avg episode reward: [(0, '50.565')] [2023-02-25 13:30:39,897][36154] DAMAGECOUNT value on done: 253844.0 [2023-02-25 13:30:39,898][36154] Sum rewards: 44.004, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.255', 'AMMO2': '0.009', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'AMMO3': '0.141', 'weapon4': '0.212', 'weapon2': '0.220', 'WEAPON3': '1.050', 'HITCOUNT': '2.590', 'weapon3': '3.494', 'DAMAGECOUNT': '11.151', 'FRAGCOUNT': '37.000'} [2023-02-25 13:30:40,208][36154] DAMAGECOUNT value on done: 249742.0 [2023-02-25 13:30:40,209][36154] Sum rewards: 50.787, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.844', 'ARMOR': '0.012', 'AMMO5': '0.018', 'AMMO2': '0.053', 'weapon2': '0.202', 'AMMO3': '0.210', 'weapon5': '0.260', 'AMMO4': '0.265', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.726', 'WEAPON3': '1.300', 'weapon3': '2.490', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.745', 'FRAGCOUNT': '45.000'} [2023-02-25 13:30:40,491][36154] DAMAGECOUNT value on done: 249387.0 [2023-02-25 13:30:40,492][36154] Sum rewards: 45.216, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.037', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon7': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.157', 'AMMO3': '0.161', 'WEAPON7': '0.200', 'weapon5': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.414', 'weapon4': '0.860', 'WEAPON3': '1.000', 'weapon3': '1.944', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.438', 'FRAGCOUNT': '38.000'} [2023-02-25 13:30:40,793][36154] DAMAGECOUNT value on done: 251282.0 [2023-02-25 13:30:40,793][36154] Sum rewards: 49.941, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.255', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.012', 'weapon5': '0.046', 'AMMO4': '0.061', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.254', 'weapon4': '0.346', 'weapon2': '0.394', 'WEAPON3': '1.500', 'HITCOUNT': '2.730', 'weapon3': '3.032', 'DAMAGECOUNT': '13.764', 'FRAGCOUNT': '45.000'} [2023-02-25 13:30:41,166][36141] DAMAGECOUNT value on done: 257100.0 [2023-02-25 13:30:41,166][36141] Sum rewards: 64.269, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.250', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.019', 'weapon4': '0.036', 'weapon5': '0.050', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'weapon2': '0.292', 'WEAPON3': '1.200', 'HITCOUNT': '3.240', 'weapon3': '3.376', 'DAMAGECOUNT': '14.568', 'FRAGCOUNT': '55.000'} [2023-02-25 13:30:41,206][36138] Updated weights for policy 0, policy_version 40363 (0.0009) [2023-02-25 13:30:41,469][36141] DAMAGECOUNT value on done: 254125.0 [2023-02-25 13:30:41,470][36141] Sum rewards: 52.570, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.840', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.020', 'AMMO4': '0.059', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.219', 'weapon4': '0.238', 'weapon2': '0.314', 'WEAPON3': '1.300', 'HITCOUNT': '3.110', 'weapon3': '3.256', 'DAMAGECOUNT': '13.875', 'FRAGCOUNT': '46.000'} [2023-02-25 13:30:41,532][36157] DAMAGECOUNT value on done: 259254.0 [2023-02-25 13:30:41,532][36157] Sum rewards: 51.565, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.780', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.168', 'weapon2': '0.178', 'AMMO3': '0.232', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '1.146', 'WEAPON3': '1.250', 'weapon3': '2.056', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.513', 'FRAGCOUNT': '47.000'} [2023-02-25 13:30:41,543][36140] DAMAGECOUNT value on done: 257338.0 [2023-02-25 13:30:41,544][36140] Sum rewards: 42.210, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.122', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.042', 'AMMO3': '0.101', 'AMMO4': '0.209', 'weapon5': '0.222', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON4': '0.450', 'WEAPON3': '0.600', 'weapon4': '0.730', 'HITCOUNT': '2.510', 'weapon3': '2.554', 'DAMAGECOUNT': '10.788', 'FRAGCOUNT': '34.000'} [2023-02-25 13:30:41,613][36141] DAMAGECOUNT value on done: 250255.0 [2023-02-25 13:30:41,614][36141] Sum rewards: 49.837, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.705', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.102', 'AMMO3': '0.177', 'AMMO4': '0.187', 'WEAPON5': '0.250', 'weapon2': '0.404', 'weapon4': '0.464', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.794', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.769', 'FRAGCOUNT': '42.500'} [2023-02-25 13:30:41,838][36157] DAMAGECOUNT value on done: 253146.0 [2023-02-25 13:30:41,838][36157] Sum rewards: 50.521, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.524', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.017', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'weapon2': '0.324', 'weapon4': '0.584', 'WEAPON3': '1.300', 'weapon3': '2.894', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.512', 'FRAGCOUNT': '45.000'} [2023-02-25 13:30:41,870][36140] DAMAGECOUNT value on done: 250860.0 [2023-02-25 13:30:41,870][36140] Sum rewards: 53.545, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.344', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'weapon5': '0.082', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'weapon2': '0.266', 'weapon4': '0.354', 'WEAPON3': '1.200', 'HITCOUNT': '2.820', 'weapon3': '3.096', 'DAMAGECOUNT': '12.927', 'FRAGCOUNT': '47.000'} [2023-02-25 13:30:41,925][36141] DAMAGECOUNT value on done: 241607.0 [2023-02-25 13:30:41,926][36141] Sum rewards: 36.717, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.938', 'AMMO5': '0.015', 'AMMO2': '0.059', 'weapon2': '0.212', 'weapon5': '0.262', 'AMMO3': '0.265', 'AMMO4': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'ARMOR': '0.404', 'weapon4': '0.438', 'WEAPON3': '1.550', 'HITCOUNT': '2.240', 'weapon3': '2.702', 'DAMAGECOUNT': '11.712', 'FRAGCOUNT': '36.000'} [2023-02-25 13:30:42,169][36157] DAMAGECOUNT value on done: 257845.0 [2023-02-25 13:30:42,169][36157] Sum rewards: 52.655, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.517', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO4': '0.157', 'weapon5': '0.174', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.436', 'weapon2': '0.526', 'WEAPON3': '1.250', 'weapon3': '2.610', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.106', 'FRAGCOUNT': '46.000'} [2023-02-25 13:30:42,262][36140] DAMAGECOUNT value on done: 253767.0 [2023-02-25 13:30:42,262][36140] Sum rewards: 55.804, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.418', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.158', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'weapon4': '0.312', 'weapon2': '0.328', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '2.892', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.652', 'FRAGCOUNT': '50.000'} [2023-02-25 13:30:42,283][36156] Large shaping reward 2.600 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.558, 186.0), ('weapon5', 0.002)] [2023-02-25 13:30:42,473][36157] DAMAGECOUNT value on done: 257693.0 [2023-02-25 13:30:42,474][36157] Sum rewards: 42.561, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.862', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.061', 'AMMO3': '0.171', 'weapon5': '0.194', 'AMMO4': '0.305', 'weapon2': '0.494', 'WEAPON5': '0.550', 'weapon4': '0.584', 'WEAPON4': '0.700', 'WEAPON3': '1.000', 'weapon3': '2.456', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '11.991', 'FRAGCOUNT': '40.000'} [2023-02-25 13:30:42,571][36140] DAMAGECOUNT value on done: 248070.0 [2023-02-25 13:30:42,572][36140] Sum rewards: 34.969, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.892', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.152', 'AMMO4': '0.180', 'weapon2': '0.188', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'weapon4': '0.338', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '2.360', 'weapon3': '3.072', 'DAMAGECOUNT': '10.476', 'FRAGCOUNT': '35.000'} [2023-02-25 13:30:42,700][36156] DAMAGECOUNT value on done: 258036.0 [2023-02-25 13:30:42,700][36156] Sum rewards: 43.598, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.550', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon5': '0.104', 'AMMO4': '0.134', 'AMMO3': '0.188', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.536', 'weapon4': '0.654', 'WEAPON3': '1.100', 'weapon3': '2.456', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.401', 'FRAGCOUNT': '38.000'} [2023-02-25 13:30:42,928][36156] DAMAGECOUNT value on done: 259020.0 [2023-02-25 13:30:42,928][36156] Sum rewards: 49.286, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.520', 'AMMO5': '0.025', 'AMMO2': '0.059', 'AMMO3': '0.209', 'weapon5': '0.218', 'AMMO4': '0.297', 'weapon2': '0.542', 'WEAPON5': '0.550', 'WEAPON4': '0.750', 'weapon4': '0.892', 'WEAPON3': '1.200', 'weapon3': '2.056', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '13.557', 'FRAGCOUNT': '46.500'} [2023-02-25 13:30:43,011][36156] DAMAGECOUNT value on done: 253459.0 [2023-02-25 13:30:43,012][36156] Sum rewards: 71.017, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.158', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.030', 'AMMO4': '0.147', 'weapon5': '0.154', 'weapon2': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.448', 'WEAPON3': '1.400', 'weapon3': '3.020', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '62.000'} [2023-02-25 13:30:43,236][36156] DAMAGECOUNT value on done: 253760.0 [2023-02-25 13:30:43,237][36156] Sum rewards: 59.779, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.580', 'AMMO5': '0.023', 'AMMO2': '0.053', 'AMMO3': '0.190', 'AMMO4': '0.266', 'weapon5': '0.298', 'weapon2': '0.370', 'weapon4': '0.578', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.376', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '16.164', 'FRAGCOUNT': '53.000'} [2023-02-25 13:30:43,811][36142] DAMAGECOUNT value on done: 245282.0 [2023-02-25 13:30:43,811][36142] Sum rewards: 41.908, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.942', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.033', 'weapon5': '0.072', 'weapon4': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.165', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon2': '0.650', 'WEAPON3': '1.050', 'HITCOUNT': '2.420', 'weapon3': '2.722', 'DAMAGECOUNT': '11.151', 'FRAGCOUNT': '36.000'} [2023-02-25 13:30:44,114][36142] DAMAGECOUNT value on done: 253990.0 [2023-02-25 13:30:44,114][36142] Sum rewards: 54.828, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.290', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.154', 'AMMO3': '0.196', 'weapon4': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.292', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '2.440', 'weapon3': '3.070', 'DAMAGECOUNT': '13.833', 'FRAGCOUNT': '47.000'} [2023-02-25 13:30:44,177][36142] DAMAGECOUNT value on done: 247092.0 [2023-02-25 13:30:44,178][36142] Sum rewards: 34.460, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.619', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.166', 'weapon5': '0.188', 'weapon4': '0.250', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.796', 'WEAPON3': '1.000', 'weapon3': '2.280', 'HITCOUNT': '2.320', 'DAMAGECOUNT': '10.752', 'FRAGCOUNT': '31.000'} [2023-02-25 13:30:44,247][36138] Updated weights for policy 0, policy_version 40373 (0.0009) [2023-02-25 13:30:44,492][36142] DAMAGECOUNT value on done: 257361.0 [2023-02-25 13:30:44,493][36142] Sum rewards: 58.396, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.488', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.126', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.202', 'AMMO4': '0.207', 'weapon2': '0.502', 'WEAPON3': '1.000', 'HITCOUNT': '2.870', 'weapon3': '2.942', 'DAMAGECOUNT': '14.430', 'FRAGCOUNT': '48.000'} [2023-02-25 13:30:44,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 165371904. Throughput: 0: 3365.3. Samples: 3837580. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:30:44,730][36114] Avg episode reward: [(0, '50.519')] [2023-02-25 13:30:46,811][36142] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:30:47,260][36138] Updated weights for policy 0, policy_version 40383 (0.0009) [2023-02-25 13:30:49,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 165441536. Throughput: 0: 3369.2. Samples: 3857986. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:30:49,730][36114] Avg episode reward: [(0, '50.519')] [2023-02-25 13:30:50,297][36138] Updated weights for policy 0, policy_version 40393 (0.0009) [2023-02-25 13:30:53,326][36138] Updated weights for policy 0, policy_version 40403 (0.0009) [2023-02-25 13:30:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 165507072. Throughput: 0: 3370.4. Samples: 3868128. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:30:54,730][36114] Avg episode reward: [(0, '50.519')] [2023-02-25 13:30:55,728][36155] DAMAGECOUNT value on done: 256431.0 [2023-02-25 13:30:55,730][36155] Sum rewards: 54.210, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.767', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.148', 'AMMO4': '0.164', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon2': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.606', 'WEAPON3': '1.200', 'weapon3': '2.732', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.217', 'FRAGCOUNT': '49.000'} [2023-02-25 13:30:56,059][36155] DAMAGECOUNT value on done: 262995.0 [2023-02-25 13:30:56,060][36155] Sum rewards: 52.295, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.270', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO4': '0.205', 'weapon4': '0.216', 'AMMO3': '0.230', 'weapon2': '0.320', 'weapon5': '0.326', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '2.760', 'weapon3': '2.800', 'DAMAGECOUNT': '15.498', 'FRAGCOUNT': '46.000'} [2023-02-25 13:30:56,091][36139] DAMAGECOUNT value on done: 255092.0 [2023-02-25 13:30:56,092][36139] Sum rewards: 49.799, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.442', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.092', 'AMMO4': '0.141', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.564', 'weapon2': '0.634', 'WEAPON3': '1.050', 'weapon3': '2.452', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.194', 'FRAGCOUNT': '44.000'} [2023-02-25 13:30:56,376][36138] Updated weights for policy 0, policy_version 40413 (0.0010) [2023-02-25 13:30:56,389][36155] DAMAGECOUNT value on done: 253280.0 [2023-02-25 13:30:56,389][36155] Sum rewards: 52.924, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.540', 'ARMOR': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.036', 'AMMO4': '0.182', 'weapon5': '0.198', 'weapon2': '0.222', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.618', 'WEAPON3': '1.350', 'weapon3': '2.626', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.238', 'FRAGCOUNT': '47.000'} [2023-02-25 13:30:56,391][36139] DAMAGECOUNT value on done: 256110.0 [2023-02-25 13:30:56,391][36139] Sum rewards: 44.138, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.542', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon2': '0.182', 'AMMO3': '0.189', 'AMMO4': '0.200', 'weapon5': '0.222', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.612', 'WEAPON3': '1.100', 'HITCOUNT': '2.650', 'weapon3': '2.716', 'DAMAGECOUNT': '13.749', 'FRAGCOUNT': '37.500'} [2023-02-25 13:30:56,484][36139] DAMAGECOUNT value on done: 256885.0 [2023-02-25 13:30:56,484][36139] Sum rewards: 42.434, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.660', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.027', 'weapon5': '0.108', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.278', 'WEAPON4': '0.350', 'weapon4': '0.952', 'WEAPON3': '1.100', 'weapon3': '2.450', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '11.400', 'FRAGCOUNT': '37.000'} [2023-02-25 13:30:56,679][36155] DAMAGECOUNT value on done: 253798.0 [2023-02-25 13:30:56,679][36155] Sum rewards: 56.291, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.408', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.148', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.308', 'weapon2': '0.646', 'WEAPON3': '0.900', 'weapon3': '2.664', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '14.280', 'FRAGCOUNT': '47.000'} [2023-02-25 13:30:56,795][36139] DAMAGECOUNT value on done: 256594.0 [2023-02-25 13:30:56,795][36139] Sum rewards: 61.676, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.003', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'weapon4': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'weapon2': '0.404', 'WEAPON3': '1.550', 'weapon3': '3.072', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.558', 'FRAGCOUNT': '55.000'} [2023-02-25 13:30:59,425][36138] Updated weights for policy 0, policy_version 40423 (0.0009) [2023-02-25 13:30:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13482.1). Total num frames: 165576704. Throughput: 0: 3367.7. Samples: 3888182. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:30:59,730][36114] Avg episode reward: [(0, '50.386')] [2023-02-25 13:30:59,846][36154] DAMAGECOUNT value on done: 259299.0 [2023-02-25 13:30:59,847][36154] Sum rewards: 59.616, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.625', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon5': '0.102', 'AMMO4': '0.138', 'weapon2': '0.228', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon4': '0.290', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.072', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '52.000'} [2023-02-25 13:31:00,167][36154] DAMAGECOUNT value on done: 254308.0 [2023-02-25 13:31:00,167][36154] Sum rewards: 51.089, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.905', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.118', 'AMMO4': '0.173', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.356', 'WEAPON4': '0.400', 'weapon4': '0.478', 'WEAPON3': '1.200', 'weapon3': '2.734', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.698', 'FRAGCOUNT': '46.000'} [2023-02-25 13:31:00,468][36154] DAMAGECOUNT value on done: 253591.0 [2023-02-25 13:31:00,468][36154] Sum rewards: 50.464, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.360', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.154', 'AMMO3': '0.193', 'weapon2': '0.214', 'WEAPON4': '0.300', 'weapon4': '0.630', 'WEAPON3': '1.250', 'HITCOUNT': '2.880', 'weapon3': '2.914', 'DAMAGECOUNT': '12.612', 'FRAGCOUNT': '45.000'} [2023-02-25 13:31:00,773][36154] DAMAGECOUNT value on done: 255407.0 [2023-02-25 13:31:00,773][36154] Sum rewards: 43.492, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.885', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.054', 'weapon5': '0.104', 'AMMO4': '0.163', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.486', 'WEAPON3': '1.550', 'HITCOUNT': '2.650', 'weapon3': '3.104', 'DAMAGECOUNT': '12.375', 'FRAGCOUNT': '41.000'} [2023-02-25 13:31:01,080][36141] DAMAGECOUNT value on done: 261769.0 [2023-02-25 13:31:01,080][36141] Sum rewards: 47.273, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.397', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO4': '0.202', 'AMMO3': '0.218', 'weapon5': '0.288', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.460', 'weapon2': '0.548', 'WEAPON3': '1.250', 'weapon3': '2.276', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.986', 'FRAGCOUNT': '43.000'} [2023-02-25 13:31:01,387][36141] DAMAGECOUNT value on done: 259333.0 [2023-02-25 13:31:01,387][36141] Sum rewards: 54.426, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.139', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.150', 'AMMO4': '0.168', 'weapon4': '0.180', 'weapon2': '0.184', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '3.230', 'weapon3': '3.278', 'DAMAGECOUNT': '15.624', 'FRAGCOUNT': '46.000'} [2023-02-25 13:31:01,473][36157] DAMAGECOUNT value on done: 262575.0 [2023-02-25 13:31:01,473][36157] Sum rewards: 30.871, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.737', 'AMMO5': '0.015', 'AMMO2': '0.063', 'AMMO3': '0.152', 'weapon5': '0.212', 'AMMO4': '0.314', 'WEAPON5': '0.400', 'ARMOR': '0.453', 'WEAPON4': '0.500', 'weapon2': '0.574', 'weapon4': '0.638', 'WEAPON3': '0.900', 'HITCOUNT': '1.890', 'weapon3': '2.284', 'DAMAGECOUNT': '9.963', 'FRAGCOUNT': '27.000'} [2023-02-25 13:31:01,521][36141] DAMAGECOUNT value on done: 254680.0 [2023-02-25 13:31:01,522][36141] Sum rewards: 52.571, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.462', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.100', 'AMMO3': '0.190', 'AMMO4': '0.194', 'WEAPON5': '0.300', 'weapon4': '0.340', 'WEAPON4': '0.350', 'weapon2': '0.414', 'WEAPON3': '1.200', 'weapon3': '2.916', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.275', 'FRAGCOUNT': '47.000'} [2023-02-25 13:31:01,608][36140] DAMAGECOUNT value on done: 262087.0 [2023-02-25 13:31:01,608][36140] Sum rewards: 59.671, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.802', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.027', 'weapon5': '0.084', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'WEAPON4': '0.250', 'weapon4': '0.332', 'weapon2': '0.482', 'WEAPON3': '1.000', 'HITCOUNT': '2.920', 'weapon3': '2.930', 'DAMAGECOUNT': '14.247', 'FRAGCOUNT': '50.000'} [2023-02-25 13:31:01,617][36157] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 13:31:01,807][36157] DAMAGECOUNT value on done: 257934.0 [2023-02-25 13:31:01,807][36157] Sum rewards: 55.314, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.310', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.204', 'AMMO3': '0.206', 'weapon4': '0.518', 'WEAPON3': '1.200', 'HITCOUNT': '2.840', 'weapon3': '2.910', 'DAMAGECOUNT': '14.364', 'FRAGCOUNT': '48.000'} [2023-02-25 13:31:01,841][36141] DAMAGECOUNT value on done: 245869.0 [2023-02-25 13:31:01,842][36141] Sum rewards: 43.859, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.850', 'ARMOR': '0.004', 'AMMO5': '0.026', 'AMMO2': '0.050', 'AMMO3': '0.171', 'weapon5': '0.178', 'AMMO4': '0.247', 'weapon2': '0.284', 'weapon4': '0.494', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.050', 'HITCOUNT': '2.450', 'weapon3': '2.690', 'DAMAGECOUNT': '12.615', 'FRAGCOUNT': '40.000'} [2023-02-25 13:31:01,915][36140] DAMAGECOUNT value on done: 255394.0 [2023-02-25 13:31:01,916][36140] Sum rewards: 49.729, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.528', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'weapon4': '0.202', 'weapon2': '0.732', 'WEAPON3': '1.150', 'weapon3': '2.774', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.602', 'FRAGCOUNT': '42.000'} [2023-02-25 13:31:02,137][36157] DAMAGECOUNT value on done: 262821.0 [2023-02-25 13:31:02,138][36157] Sum rewards: 58.826, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.500', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon2': '0.138', 'weapon5': '0.144', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'WEAPON5': '0.300', 'weapon4': '0.486', 'WEAPON3': '1.550', 'weapon3': '2.974', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.928', 'FRAGCOUNT': '53.000'} [2023-02-25 13:31:02,244][36156] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:31:02,325][36140] DAMAGECOUNT value on done: 258919.0 [2023-02-25 13:31:02,325][36140] Sum rewards: 61.660, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.350', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.032', 'AMMO4': '0.160', 'AMMO3': '0.162', 'weapon5': '0.166', 'weapon4': '0.268', 'WEAPON4': '0.350', 'weapon2': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.908', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.456', 'FRAGCOUNT': '52.000'} [2023-02-25 13:31:02,448][36138] Updated weights for policy 0, policy_version 40433 (0.0010) [2023-02-25 13:31:02,452][36157] DAMAGECOUNT value on done: 263578.0 [2023-02-25 13:31:02,453][36157] Sum rewards: 63.138, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.423', 'AMMO5': '0.024', 'AMMO2': '0.049', 'weapon5': '0.208', 'AMMO3': '0.211', 'AMMO4': '0.244', 'weapon4': '0.268', 'weapon2': '0.344', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.884', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '55.500'} [2023-02-25 13:31:02,634][36140] DAMAGECOUNT value on done: 253198.0 [2023-02-25 13:31:02,635][36140] Sum rewards: 56.486, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.236', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon2': '0.156', 'weapon5': '0.196', 'AMMO3': '0.215', 'AMMO4': '0.222', 'WEAPON5': '0.350', 'weapon4': '0.396', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.978', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.384', 'FRAGCOUNT': '49.000'} [2023-02-25 13:31:02,774][36156] DAMAGECOUNT value on done: 263391.0 [2023-02-25 13:31:02,774][36156] Sum rewards: 64.098, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.586', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon5': '0.076', 'weapon4': '0.088', 'AMMO4': '0.116', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'weapon2': '0.296', 'WEAPON3': '1.500', 'HITCOUNT': '3.230', 'weapon3': '3.272', 'DAMAGECOUNT': '16.065', 'FRAGCOUNT': '57.000'} [2023-02-25 13:31:02,990][36156] DAMAGECOUNT value on done: 263817.0 [2023-02-25 13:31:02,991][36156] Sum rewards: 60.388, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.980', 'AMMO2': '0.017', 'AMMO5': '0.017', 'weapon5': '0.054', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'weapon4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.522', 'WEAPON3': '1.150', 'weapon3': '2.988', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.391', 'FRAGCOUNT': '51.000'} [2023-02-25 13:31:03,087][36156] DAMAGECOUNT value on done: 258133.0 [2023-02-25 13:31:03,087][36156] Sum rewards: 51.106, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.103', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.100', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'weapon2': '0.284', 'WEAPON4': '0.400', 'weapon4': '0.724', 'WEAPON3': '1.150', 'weapon3': '2.616', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.022', 'FRAGCOUNT': '44.000'} [2023-02-25 13:31:03,302][36156] DAMAGECOUNT value on done: 259362.0 [2023-02-25 13:31:03,302][36156] Sum rewards: 63.709, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.350', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.100', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.302', 'weapon2': '0.508', 'WEAPON3': '1.100', 'weapon3': '2.902', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '51.000'} [2023-02-25 13:31:03,799][36142] DAMAGECOUNT value on done: 249396.0 [2023-02-25 13:31:03,799][36142] Sum rewards: 47.929, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.410', 'AMMO5': '0.005', 'AMMO2': '0.041', 'WEAPON5': '0.100', 'weapon5': '0.116', 'AMMO3': '0.146', 'AMMO4': '0.205', 'WEAPON4': '0.250', 'weapon2': '0.598', 'WEAPON3': '0.900', 'weapon4': '0.906', 'weapon3': '2.190', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '12.342', 'FRAGCOUNT': '39.000'} [2023-02-25 13:31:04,111][36142] DAMAGECOUNT value on done: 259385.0 [2023-02-25 13:31:04,112][36142] Sum rewards: 55.611, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.409', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'weapon4': '0.082', 'weapon5': '0.096', 'AMMO4': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.250', 'AMMO3': '0.294', 'WEAPON3': '1.750', 'weapon3': '3.238', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '52.000'} [2023-02-25 13:31:04,156][36142] DAMAGECOUNT value on done: 251755.0 [2023-02-25 13:31:04,156][36142] Sum rewards: 56.480, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.218', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.159', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'weapon4': '0.378', 'weapon2': '0.504', 'WEAPON3': '1.150', 'weapon3': '2.868', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.989', 'FRAGCOUNT': '48.000'} [2023-02-25 13:31:04,459][36142] DAMAGECOUNT value on done: 262427.0 [2023-02-25 13:31:04,460][36142] Sum rewards: 55.700, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.082', 'AMMO5': '0.014', 'AMMO2': '0.023', 'weapon5': '0.076', 'AMMO4': '0.113', 'weapon4': '0.116', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON3': '1.350', 'HITCOUNT': '3.230', 'weapon3': '3.282', 'DAMAGECOUNT': '14.589', 'FRAGCOUNT': '49.000'} [2023-02-25 13:31:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 165642240. Throughput: 0: 3366.5. Samples: 3908280. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:31:04,730][36114] Avg episode reward: [(0, '51.138')] [2023-02-25 13:31:05,505][36138] Updated weights for policy 0, policy_version 40443 (0.0009) [2023-02-25 13:31:08,533][36138] Updated weights for policy 0, policy_version 40453 (0.0009) [2023-02-25 13:31:09,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 165707776. Throughput: 0: 3367.6. Samples: 3918430. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 13:31:09,730][36114] Avg episode reward: [(0, '51.138')] [2023-02-25 13:31:11,084][36139] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 13:31:11,574][36138] Updated weights for policy 0, policy_version 40463 (0.0009) [2023-02-25 13:31:11,714][36142] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:31:14,672][36138] Updated weights for policy 0, policy_version 40473 (0.0009) [2023-02-25 13:31:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 165777408. Throughput: 0: 3364.4. Samples: 3938618. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 13:31:14,730][36114] Avg episode reward: [(0, '51.138')] [2023-02-25 13:31:15,565][36155] DAMAGECOUNT value on done: 260917.0 [2023-02-25 13:31:15,565][36155] Sum rewards: 45.528, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.122', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon5': '0.090', 'AMMO4': '0.119', 'weapon4': '0.160', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.418', 'WEAPON3': '1.500', 'HITCOUNT': '2.570', 'weapon3': '3.022', 'DAMAGECOUNT': '13.443', 'FRAGCOUNT': '43.000'} [2023-02-25 13:31:15,879][36155] DAMAGECOUNT value on done: 266802.0 [2023-02-25 13:31:15,880][36155] Sum rewards: 43.789, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.880', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.146', 'weapon4': '0.172', 'weapon2': '0.812', 'WEAPON3': '0.950', 'HITCOUNT': '2.610', 'weapon3': '2.856', 'DAMAGECOUNT': '11.421', 'FRAGCOUNT': '36.000'} [2023-02-25 13:31:15,994][36139] DAMAGECOUNT value on done: 259163.0 [2023-02-25 13:31:15,995][36139] Sum rewards: 45.002, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.890', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO3': '0.152', 'AMMO4': '0.178', 'weapon5': '0.242', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.562', 'weapon4': '0.698', 'WEAPON3': '0.900', 'weapon3': '2.052', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '12.213', 'FRAGCOUNT': '39.000'} [2023-02-25 13:31:16,218][36155] DAMAGECOUNT value on done: 257961.0 [2023-02-25 13:31:16,218][36155] Sum rewards: 54.410, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.098', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO3': '0.141', 'AMMO4': '0.184', 'weapon5': '0.198', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.552', 'weapon2': '0.722', 'WEAPON3': '0.800', 'weapon3': '2.314', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.043', 'FRAGCOUNT': '46.000'} [2023-02-25 13:31:16,299][36139] DAMAGECOUNT value on done: 260155.0 [2023-02-25 13:31:16,300][36139] Sum rewards: 54.383, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.003', 'HEALTH': '0.007', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.114', 'AMMO4': '0.123', 'AMMO3': '0.149', 'WEAPON4': '0.250', 'weapon2': '0.252', 'ARMOR': '0.454', 'weapon4': '0.500', 'WEAPON3': '0.900', 'HITCOUNT': '2.920', 'weapon3': '3.002', 'DAMAGECOUNT': '12.135', 'FRAGCOUNT': '45.500'} [2023-02-25 13:31:16,431][36139] DAMAGECOUNT value on done: 261509.0 [2023-02-25 13:31:16,431][36139] Sum rewards: 48.490, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.285', 'AMMO5': '0.020', 'AMMO2': '0.054', 'AMMO3': '0.128', 'weapon5': '0.232', 'AMMO4': '0.269', 'weapon4': '0.366', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon2': '0.624', 'WEAPON3': '0.800', 'weapon3': '2.462', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '13.719', 'FRAGCOUNT': '41.000'} [2023-02-25 13:31:16,540][36155] DAMAGECOUNT value on done: 258540.0 [2023-02-25 13:31:16,541][36155] Sum rewards: 57.632, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.540', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon5': '0.136', 'AMMO3': '0.155', 'AMMO4': '0.198', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON5': '0.400', 'weapon4': '0.722', 'WEAPON3': '1.000', 'weapon3': '2.522', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.226', 'FRAGCOUNT': '48.000'} [2023-02-25 13:31:16,720][36139] DAMAGECOUNT value on done: 261141.0 [2023-02-25 13:31:16,721][36139] Sum rewards: 53.134, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.960', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.040', 'weapon5': '0.042', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.358', 'WEAPON3': '1.250', 'HITCOUNT': '2.880', 'weapon3': '3.340', 'DAMAGECOUNT': '13.641', 'FRAGCOUNT': '47.000'} [2023-02-25 13:31:17,692][36138] Updated weights for policy 0, policy_version 40483 (0.0009) [2023-02-25 13:31:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 165842944. Throughput: 0: 3364.7. Samples: 3958778. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 13:31:19,729][36114] Avg episode reward: [(0, '51.062')] [2023-02-25 13:31:19,733][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000040489_165842944.pth... [2023-02-25 13:31:19,764][36154] DAMAGECOUNT value on done: 264289.0 [2023-02-25 13:31:19,765][36154] Sum rewards: 58.146, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.960', 'AMMO5': '0.016', 'AMMO2': '0.025', 'weapon4': '0.054', 'weapon5': '0.118', 'AMMO4': '0.127', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'weapon2': '0.306', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '2.990', 'weapon3': '3.318', 'DAMAGECOUNT': '14.970', 'FRAGCOUNT': '49.000'} [2023-02-25 13:31:19,789][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000039700_162611200.pth [2023-02-25 13:31:20,090][36154] DAMAGECOUNT value on done: 259364.0 [2023-02-25 13:31:20,090][36154] Sum rewards: 55.846, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.992', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.031', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon2': '0.592', 'WEAPON3': '1.100', 'HITCOUNT': '3.070', 'weapon3': '3.162', 'DAMAGECOUNT': '15.168', 'FRAGCOUNT': '48.000'} [2023-02-25 13:31:20,408][36154] DAMAGECOUNT value on done: 258479.0 [2023-02-25 13:31:20,409][36154] Sum rewards: 48.256, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.395', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.064', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'weapon2': '0.362', 'weapon4': '0.612', 'WEAPON3': '1.400', 'weapon3': '2.732', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.649', 'FRAGCOUNT': '44.000'} [2023-02-25 13:31:20,721][36154] DAMAGECOUNT value on done: 259293.0 [2023-02-25 13:31:20,722][36154] Sum rewards: 46.185, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.220', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.080', 'weapon4': '0.092', 'weapon7': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'WEAPON3': '1.050', 'weapon2': '1.122', 'weapon3': '2.370', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '11.658', 'FRAGCOUNT': '39.000'} [2023-02-25 13:31:20,807][36138] Updated weights for policy 0, policy_version 40493 (0.0009) [2023-02-25 13:31:21,102][36141] DAMAGECOUNT value on done: 266574.0 [2023-02-25 13:31:21,103][36141] Sum rewards: 56.605, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.471', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon5': '0.102', 'AMMO4': '0.115', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.298', 'weapon2': '0.358', 'WEAPON3': '1.100', 'weapon3': '3.026', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.115', 'FRAGCOUNT': '48.000'} [2023-02-25 13:31:21,392][36141] DAMAGECOUNT value on done: 263392.0 [2023-02-25 13:31:21,393][36141] Sum rewards: 44.052, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.146', 'AMMO5': '0.009', 'AMMO2': '0.054', 'weapon5': '0.102', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'AMMO4': '0.268', 'weapon2': '0.310', 'WEAPON4': '0.400', 'weapon4': '0.668', 'WEAPON3': '1.200', 'weapon3': '2.684', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.177', 'FRAGCOUNT': '40.000'} [2023-02-25 13:31:21,520][36141] DAMAGECOUNT value on done: 257364.0 [2023-02-25 13:31:21,520][36141] Sum rewards: 35.278, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.972', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.032', 'AMMO3': '0.079', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'weapon5': '0.160', 'WEAPON4': '0.250', 'WEAPON3': '0.500', 'weapon4': '1.110', 'weapon3': '1.198', 'weapon2': '1.448', 'HITCOUNT': '1.860', 'DAMAGECOUNT': '8.043', 'FRAGCOUNT': '28.000'} [2023-02-25 13:31:21,576][36157] DAMAGECOUNT value on done: 267830.0 [2023-02-25 13:31:21,577][36157] Sum rewards: 61.257, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.530', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon5': '0.048', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.226', 'weapon4': '0.270', 'weapon2': '0.394', 'WEAPON3': '1.350', 'weapon3': '2.982', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.765', 'FRAGCOUNT': '53.000'} [2023-02-25 13:31:21,690][36140] DAMAGECOUNT value on done: 266542.0 [2023-02-25 13:31:21,690][36140] Sum rewards: 43.741, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.889', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.031', 'weapon5': '0.058', 'AMMO4': '0.155', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'weapon2': '0.236', 'WEAPON4': '0.500', 'weapon4': '0.562', 'WEAPON3': '1.250', 'weapon3': '2.772', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.032', 'FRAGCOUNT': '40.000'} [2023-02-25 13:31:21,828][36141] DAMAGECOUNT value on done: 250356.0 [2023-02-25 13:31:21,829][36141] Sum rewards: 54.911, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.626', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.060', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon4': '0.272', 'weapon2': '0.448', 'WEAPON3': '1.300', 'HITCOUNT': '2.830', 'weapon3': '3.010', 'DAMAGECOUNT': '13.461', 'FRAGCOUNT': '48.000'} [2023-02-25 13:31:21,891][36157] DAMAGECOUNT value on done: 262721.0 [2023-02-25 13:31:21,891][36157] Sum rewards: 54.425, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.761', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.154', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'weapon4': '0.340', 'WEAPON5': '0.400', 'weapon2': '0.538', 'WEAPON3': '1.000', 'weapon3': '2.664', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.361', 'FRAGCOUNT': '45.000'} [2023-02-25 13:31:22,001][36140] DAMAGECOUNT value on done: 259492.0 [2023-02-25 13:31:22,002][36140] Sum rewards: 42.649, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.694', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO4': '0.174', 'AMMO3': '0.193', 'weapon2': '0.214', 'weapon5': '0.244', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.972', 'WEAPON3': '1.100', 'weapon3': '2.178', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.294', 'FRAGCOUNT': '39.000'} [2023-02-25 13:31:22,213][36157] DAMAGECOUNT value on done: 267446.0 [2023-02-25 13:31:22,214][36157] Sum rewards: 49.485, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.106', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.182', 'weapon5': '0.242', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.748', 'WEAPON3': '1.000', 'weapon3': '2.370', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.875', 'FRAGCOUNT': '39.500'} [2023-02-25 13:31:22,406][36140] DAMAGECOUNT value on done: 262916.0 [2023-02-25 13:31:22,406][36140] Sum rewards: 41.702, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.495', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.062', 'AMMO4': '0.140', 'AMMO3': '0.146', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.510', 'weapon4': '0.876', 'WEAPON3': '0.950', 'weapon3': '2.374', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '11.991', 'FRAGCOUNT': '34.000'} [2023-02-25 13:31:22,519][36157] DAMAGECOUNT value on done: 268154.0 [2023-02-25 13:31:22,519][36157] Sum rewards: 55.061, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.130', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.127', 'AMMO3': '0.147', 'weapon5': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.426', 'weapon2': '0.696', 'WEAPON3': '0.800', 'weapon3': '2.420', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '13.728', 'FRAGCOUNT': '46.000'} [2023-02-25 13:31:22,709][36140] DAMAGECOUNT value on done: 257063.0 [2023-02-25 13:31:22,709][36140] Sum rewards: 45.692, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.940', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.042', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.178', 'AMMO3': '0.263', 'weapon2': '0.280', 'WEAPON3': '1.550', 'HITCOUNT': '2.770', 'weapon3': '3.252', 'DAMAGECOUNT': '11.520', 'FRAGCOUNT': '44.000'} [2023-02-25 13:31:22,829][36156] DAMAGECOUNT value on done: 267721.0 [2023-02-25 13:31:22,829][36156] Sum rewards: 48.514, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.675', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.090', 'AMMO4': '0.177', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'weapon4': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.274', 'WEAPON3': '1.250', 'HITCOUNT': '3.010', 'weapon3': '3.230', 'DAMAGECOUNT': '12.990', 'FRAGCOUNT': '42.000'} [2023-02-25 13:31:23,060][36156] DAMAGECOUNT value on done: 268946.0 [2023-02-25 13:31:23,060][36156] Sum rewards: 51.626, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.280', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.112', 'AMMO4': '0.148', 'weapon4': '0.174', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.494', 'WEAPON3': '1.400', 'weapon3': '3.000', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.907', 'FRAGCOUNT': '45.000'} [2023-02-25 13:31:23,144][36156] DAMAGECOUNT value on done: 263402.0 [2023-02-25 13:31:23,144][36156] Sum rewards: 58.941, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.600', 'AMMO5': '0.009', 'AMMO2': '0.033', 'AMMO4': '0.166', 'AMMO3': '0.167', 'weapon5': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.324', 'weapon2': '0.582', 'WEAPON3': '1.050', 'weapon3': '2.668', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.807', 'FRAGCOUNT': '50.000'} [2023-02-25 13:31:23,386][36156] DAMAGECOUNT value on done: 263974.0 [2023-02-25 13:31:23,387][36156] Sum rewards: 58.367, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.007', 'AMMO2': '0.032', 'HEALTH': '0.076', 'AMMO3': '0.135', 'weapon5': '0.158', 'AMMO4': '0.158', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON3': '0.800', 'weapon4': '0.924', 'weapon3': '2.318', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.836', 'FRAGCOUNT': '48.000'} [2023-02-25 13:31:23,832][36142] DAMAGECOUNT value on done: 253877.0 [2023-02-25 13:31:23,832][36142] Sum rewards: 52.545, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.903', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.142', 'AMMO3': '0.165', 'weapon2': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.760', 'WEAPON3': '1.100', 'weapon3': '2.428', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.443', 'FRAGCOUNT': '44.500'} [2023-02-25 13:31:23,853][36138] Updated weights for policy 0, policy_version 40503 (0.0009) [2023-02-25 13:31:24,142][36142] DAMAGECOUNT value on done: 263780.0 [2023-02-25 13:31:24,143][36142] Sum rewards: 54.198, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.630', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.014', 'weapon4': '0.016', 'AMMO4': '0.067', 'weapon5': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.185', 'WEAPON5': '0.300', 'weapon2': '0.594', 'WEAPON3': '1.150', 'HITCOUNT': '2.700', 'weapon3': '3.158', 'DAMAGECOUNT': '12.705', 'FRAGCOUNT': '46.000'} [2023-02-25 13:31:24,187][36142] DAMAGECOUNT value on done: 256626.0 [2023-02-25 13:31:24,188][36142] Sum rewards: 53.969, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.690', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.100', 'AMMO3': '0.157', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.484', 'weapon2': '0.622', 'WEAPON3': '1.100', 'weapon3': '2.536', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.598', 'FRAGCOUNT': '46.000'} [2023-02-25 13:31:24,506][36142] DAMAGECOUNT value on done: 266022.0 [2023-02-25 13:31:24,507][36142] Sum rewards: 42.082, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.594', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'weapon4': '0.264', 'weapon2': '0.482', 'WEAPON3': '1.100', 'HITCOUNT': '2.500', 'weapon3': '2.790', 'DAMAGECOUNT': '10.785', 'FRAGCOUNT': '37.000'} [2023-02-25 13:31:24,729][36114] Fps is (10 sec: 13107.0, 60 sec: 13448.5, 300 sec: 13468.2). Total num frames: 165908480. Throughput: 0: 3363.1. Samples: 3968724. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 13:31:24,730][36114] Avg episode reward: [(0, '51.155')] [2023-02-25 13:31:26,889][36138] Updated weights for policy 0, policy_version 40513 (0.0009) [2023-02-25 13:31:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 165978112. Throughput: 0: 3363.9. Samples: 3988956. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 13:31:29,729][36114] Avg episode reward: [(0, '51.155')] [2023-02-25 13:31:29,918][36138] Updated weights for policy 0, policy_version 40523 (0.0010) [2023-02-25 13:31:32,066][36141] Large shaping reward 2.598 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.024, -8.0), ('weapon5', 0.002)] [2023-02-25 13:31:32,981][36138] Updated weights for policy 0, policy_version 40533 (0.0010) [2023-02-25 13:31:34,729][36114] Fps is (10 sec: 13517.0, 60 sec: 13448.5, 300 sec: 13468.2). Total num frames: 166043648. Throughput: 0: 3358.2. Samples: 4009104. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:31:34,730][36114] Avg episode reward: [(0, '51.155')] [2023-02-25 13:31:35,590][36155] DAMAGECOUNT value on done: 264048.0 [2023-02-25 13:31:35,591][36155] Sum rewards: 39.166, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.123', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO3': '0.103', 'AMMO4': '0.184', 'weapon5': '0.186', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.596', 'WEAPON3': '0.700', 'weapon2': '0.982', 'weapon3': '2.004', 'HITCOUNT': '2.290', 'DAMAGECOUNT': '9.393', 'FRAGCOUNT': '33.000'} [2023-02-25 13:31:35,865][36139] DAMAGECOUNT value on done: 263855.0 [2023-02-25 13:31:35,866][36139] Sum rewards: 55.818, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.664', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.121', 'AMMO3': '0.135', 'weapon2': '0.144', 'WEAPON4': '0.150', 'weapon4': '0.562', 'WEAPON3': '0.900', 'weapon3': '2.690', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.076', 'FRAGCOUNT': '44.000'} [2023-02-25 13:31:35,887][36155] DAMAGECOUNT value on done: 271506.0 [2023-02-25 13:31:35,888][36155] Sum rewards: 53.164, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.542', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.160', 'AMMO3': '0.189', 'weapon5': '0.196', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON4': '0.500', 'weapon4': '0.728', 'WEAPON3': '1.100', 'weapon3': '2.258', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.112', 'FRAGCOUNT': '47.000'} [2023-02-25 13:31:36,073][36138] Updated weights for policy 0, policy_version 40543 (0.0009) [2023-02-25 13:31:36,167][36139] DAMAGECOUNT value on done: 264924.0 [2023-02-25 13:31:36,168][36139] Sum rewards: 51.714, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.827', 'AMMO5': '0.008', 'AMMO2': '0.009', 'weapon4': '0.014', 'AMMO4': '0.046', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.274', 'weapon2': '0.274', 'WEAPON3': '1.700', 'HITCOUNT': '3.140', 'weapon3': '3.410', 'DAMAGECOUNT': '14.307', 'FRAGCOUNT': '47.000'} [2023-02-25 13:31:36,195][36155] DAMAGECOUNT value on done: 262490.0 [2023-02-25 13:31:36,196][36155] Sum rewards: 50.647, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.745', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.082', 'AMMO4': '0.084', 'WEAPON5': '0.150', 'weapon2': '0.206', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon4': '0.514', 'WEAPON3': '1.250', 'weapon3': '2.970', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.587', 'FRAGCOUNT': '45.000'} [2023-02-25 13:31:36,328][36139] DAMAGECOUNT value on done: 265897.0 [2023-02-25 13:31:36,328][36139] Sum rewards: 51.396, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.283', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.155', 'WEAPON5': '0.200', 'weapon5': '0.216', 'weapon2': '0.290', 'WEAPON4': '0.300', 'weapon4': '0.612', 'WEAPON3': '1.000', 'weapon3': '2.526', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.164', 'FRAGCOUNT': '43.000'} [2023-02-25 13:31:36,508][36155] DAMAGECOUNT value on done: 263306.0 [2023-02-25 13:31:36,508][36155] Sum rewards: 61.813, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.892', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.018', 'weapon5': '0.046', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.169', 'weapon2': '0.318', 'weapon4': '0.468', 'WEAPON3': '1.100', 'weapon3': '3.080', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.298', 'FRAGCOUNT': '51.000'} [2023-02-25 13:31:36,631][36139] DAMAGECOUNT value on done: 265762.0 [2023-02-25 13:31:36,631][36139] Sum rewards: 46.675, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.320', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.065', 'AMMO3': '0.166', 'weapon5': '0.214', 'WEAPON5': '0.300', 'AMMO4': '0.326', 'weapon2': '0.460', 'WEAPON4': '0.700', 'weapon4': '0.810', 'WEAPON3': '1.000', 'weapon3': '2.200', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '13.860', 'FRAGCOUNT': '39.000'} [2023-02-25 13:31:39,068][36138] Updated weights for policy 0, policy_version 40553 (0.0009) [2023-02-25 13:31:39,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13482.1). Total num frames: 166113280. Throughput: 0: 3353.9. Samples: 4019054. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:31:39,730][36114] Avg episode reward: [(0, '51.343')] [2023-02-25 13:31:39,927][36154] DAMAGECOUNT value on done: 269326.0 [2023-02-25 13:31:39,927][36154] Sum rewards: 58.430, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.405', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon4': '0.112', 'weapon5': '0.128', 'AMMO4': '0.186', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.486', 'WEAPON3': '1.300', 'weapon3': '3.058', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.111', 'FRAGCOUNT': '51.000'} [2023-02-25 13:31:40,239][36154] DAMAGECOUNT value on done: 264138.0 [2023-02-25 13:31:40,240][36154] Sum rewards: 60.452, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.875', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.050', 'AMMO3': '0.132', 'WEAPON5': '0.150', 'AMMO4': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.332', 'weapon2': '0.342', 'WEAPON3': '0.850', 'HITCOUNT': '3.080', 'weapon3': '3.128', 'DAMAGECOUNT': '14.322', 'FRAGCOUNT': '49.000'} [2023-02-25 13:31:40,568][36154] DAMAGECOUNT value on done: 264097.0 [2023-02-25 13:31:40,569][36154] Sum rewards: 63.326, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.992', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.038', 'AMMO4': '0.189', 'AMMO3': '0.214', 'weapon5': '0.232', 'weapon2': '0.318', 'weapon4': '0.322', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.838', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.854', 'FRAGCOUNT': '55.000'} [2023-02-25 13:31:40,886][36154] DAMAGECOUNT value on done: 264196.0 [2023-02-25 13:31:40,886][36154] Sum rewards: 58.247, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.800', 'AMMO5': '0.015', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon4': '0.132', 'weapon5': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'WEAPON5': '0.350', 'weapon2': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '2.690', 'weapon3': '2.862', 'DAMAGECOUNT': '14.709', 'FRAGCOUNT': '51.000'} [2023-02-25 13:31:40,982][36141] DAMAGECOUNT value on done: 270721.0 [2023-02-25 13:31:40,982][36141] Sum rewards: 48.336, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.336', 'AMMO5': '0.003', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'AMMO3': '0.166', 'AMMO4': '0.187', 'WEAPON4': '0.250', 'weapon2': '0.424', 'weapon4': '0.430', 'WEAPON3': '1.050', 'HITCOUNT': '2.690', 'weapon3': '2.944', 'DAMAGECOUNT': '12.441', 'FRAGCOUNT': '41.000'} [2023-02-25 13:31:41,294][36141] DAMAGECOUNT value on done: 267887.0 [2023-02-25 13:31:41,294][36141] Sum rewards: 43.165, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.444', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.018', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO4': '0.115', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'weapon4': '0.374', 'weapon2': '0.402', 'WEAPON3': '1.250', 'HITCOUNT': '2.910', 'weapon3': '3.000', 'DAMAGECOUNT': '13.485', 'FRAGCOUNT': '38.000'} [2023-02-25 13:31:41,430][36141] DAMAGECOUNT value on done: 261834.0 [2023-02-25 13:31:41,431][36141] Sum rewards: 43.596, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.872', 'AMMO5': '0.022', 'AMMO2': '0.040', 'AMMO3': '0.182', 'weapon5': '0.196', 'AMMO4': '0.200', 'weapon2': '0.360', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.924', 'WEAPON3': '1.000', 'weapon3': '2.264', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '13.410', 'FRAGCOUNT': '39.000'} [2023-02-25 13:31:41,547][36157] DAMAGECOUNT value on done: 272671.0 [2023-02-25 13:31:41,547][36157] Sum rewards: 59.558, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.892', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.162', 'AMMO3': '0.163', 'AMMO4': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.338', 'weapon2': '0.358', 'WEAPON3': '1.050', 'HITCOUNT': '2.890', 'weapon3': '2.960', 'DAMAGECOUNT': '14.523', 'FRAGCOUNT': '51.000'} [2023-02-25 13:31:41,749][36141] DAMAGECOUNT value on done: 255027.0 [2023-02-25 13:31:41,749][36141] Sum rewards: 52.882, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.660', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.094', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.334', 'WEAPON4': '0.400', 'weapon4': '0.558', 'WEAPON3': '1.350', 'weapon3': '2.704', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.806', 'FRAGCOUNT': '48.000'} [2023-02-25 13:31:41,858][36157] DAMAGECOUNT value on done: 268480.0 [2023-02-25 13:31:41,859][36157] Sum rewards: 57.538, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.155', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.132', 'AMMO4': '0.136', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'weapon4': '0.270', 'weapon2': '0.276', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.058', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '49.000'} [2023-02-25 13:31:41,915][36140] DAMAGECOUNT value on done: 271306.0 [2023-02-25 13:31:41,915][36140] Sum rewards: 48.555, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.780', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO4': '0.184', 'weapon5': '0.222', 'AMMO3': '0.264', 'weapon2': '0.274', 'WEAPON4': '0.350', 'weapon4': '0.398', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.736', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.292', 'FRAGCOUNT': '45.000'} [2023-02-25 13:31:42,126][36138] Updated weights for policy 0, policy_version 40563 (0.0009) [2023-02-25 13:31:42,201][36157] DAMAGECOUNT value on done: 271541.0 [2023-02-25 13:31:42,202][36157] Sum rewards: 48.565, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.255', 'AMMO5': '0.005', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.212', 'weapon2': '0.522', 'WEAPON3': '1.250', 'HITCOUNT': '2.690', 'weapon3': '3.084', 'DAMAGECOUNT': '12.285', 'FRAGCOUNT': '43.000'} [2023-02-25 13:31:42,223][36140] DAMAGECOUNT value on done: 263367.0 [2023-02-25 13:31:42,224][36140] Sum rewards: 43.535, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.294', 'AMMO5': '0.012', 'AMMO2': '0.046', 'AMMO3': '0.161', 'AMMO4': '0.232', 'weapon5': '0.236', 'weapon2': '0.272', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.664', 'WEAPON3': '1.050', 'weapon3': '2.420', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '11.625', 'FRAGCOUNT': '40.000'} [2023-02-25 13:31:42,512][36157] DAMAGECOUNT value on done: 272448.0 [2023-02-25 13:31:42,513][36157] Sum rewards: 48.912, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.335', 'AMMO5': '0.011', 'AMMO2': '0.017', 'weapon5': '0.040', 'AMMO4': '0.087', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'AMMO3': '0.267', 'weapon2': '0.274', 'weapon4': '0.346', 'WEAPON3': '1.500', 'HITCOUNT': '2.700', 'weapon3': '3.122', 'DAMAGECOUNT': '12.882', 'FRAGCOUNT': '46.000'} [2023-02-25 13:31:42,621][36140] DAMAGECOUNT value on done: 268191.0 [2023-02-25 13:31:42,622][36140] Sum rewards: 61.633, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.595', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon2': '0.132', 'weapon5': '0.156', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.836', 'WEAPON3': '1.200', 'weapon3': '2.612', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.825', 'FRAGCOUNT': '52.000'} [2023-02-25 13:31:42,910][36156] DAMAGECOUNT value on done: 272734.0 [2023-02-25 13:31:42,911][36156] Sum rewards: 43.840, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.834', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon4': '0.150', 'AMMO3': '0.223', 'weapon5': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.302', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '2.780', 'weapon3': '2.976', 'DAMAGECOUNT': '15.039', 'FRAGCOUNT': '38.500'} [2023-02-25 13:31:42,936][36140] DAMAGECOUNT value on done: 261509.0 [2023-02-25 13:31:42,937][36140] Sum rewards: 50.303, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.016', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.084', 'AMMO4': '0.183', 'WEAPON4': '0.200', 'weapon2': '0.212', 'AMMO3': '0.228', 'weapon4': '0.230', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '2.730', 'weapon3': '3.208', 'DAMAGECOUNT': '13.338', 'FRAGCOUNT': '44.500'} [2023-02-25 13:31:43,158][36156] DAMAGECOUNT value on done: 273283.0 [2023-02-25 13:31:43,158][36156] Sum rewards: 43.907, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.693', 'AMMO5': '0.005', 'ARMOR': '0.028', 'AMMO2': '0.047', 'weapon5': '0.092', 'WEAPON5': '0.200', 'AMMO4': '0.236', 'weapon2': '0.250', 'AMMO3': '0.252', 'WEAPON4': '0.450', 'weapon4': '0.554', 'WEAPON3': '1.500', 'weapon3': '2.804', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.011', 'FRAGCOUNT': '41.000'} [2023-02-25 13:31:43,235][36156] DAMAGECOUNT value on done: 268271.0 [2023-02-25 13:31:43,235][36156] Sum rewards: 59.019, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.300', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.026', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'AMMO3': '0.190', 'WEAPON4': '0.300', 'weapon2': '0.302', 'weapon4': '0.332', 'WEAPON3': '1.200', 'HITCOUNT': '3.010', 'weapon3': '3.068', 'DAMAGECOUNT': '14.607', 'FRAGCOUNT': '50.000'} [2023-02-25 13:31:43,474][36156] DAMAGECOUNT value on done: 267611.0 [2023-02-25 13:31:43,474][36156] Sum rewards: 33.655, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.865', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.168', 'AMMO4': '0.175', 'AMMO3': '0.241', 'weapon2': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '1.096', 'WEAPON3': '1.400', 'weapon3': '2.212', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '10.899', 'FRAGCOUNT': '35.000'} [2023-02-25 13:31:43,765][36142] DAMAGECOUNT value on done: 259305.0 [2023-02-25 13:31:43,766][36142] Sum rewards: 62.615, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.985', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.120', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon4': '0.260', 'weapon2': '0.416', 'WEAPON3': '1.300', 'weapon3': '3.058', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '54.000'} [2023-02-25 13:31:44,082][36142] DAMAGECOUNT value on done: 267903.0 [2023-02-25 13:31:44,083][36142] Sum rewards: 47.072, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.260', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon2': '0.150', 'AMMO3': '0.158', 'weapon5': '0.164', 'AMMO4': '0.173', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.522', 'WEAPON3': '0.950', 'weapon3': '2.406', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.369', 'FRAGCOUNT': '40.000'} [2023-02-25 13:31:44,096][36142] DAMAGECOUNT value on done: 260667.0 [2023-02-25 13:31:44,096][36142] Sum rewards: 42.733, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.088', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.053', 'AMMO3': '0.184', 'AMMO4': '0.265', 'weapon5': '0.332', 'weapon2': '0.382', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'weapon4': '0.772', 'WEAPON3': '1.000', 'weapon3': '2.140', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '11.988', 'FRAGCOUNT': '38.000'} [2023-02-25 13:31:44,404][36142] DAMAGECOUNT value on done: 270236.0 [2023-02-25 13:31:44,405][36142] Sum rewards: 53.138, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.610', 'AMMO5': '0.004', 'weapon4': '0.016', 'AMMO2': '0.020', 'weapon5': '0.032', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.166', 'weapon2': '0.576', 'WEAPON3': '1.050', 'HITCOUNT': '2.530', 'weapon3': '3.274', 'DAMAGECOUNT': '12.282', 'FRAGCOUNT': '45.000'} [2023-02-25 13:31:44,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13468.2). Total num frames: 166178816. Throughput: 0: 3357.8. Samples: 4039284. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:31:44,730][36114] Avg episode reward: [(0, '51.562')] [2023-02-25 13:31:45,174][36138] Updated weights for policy 0, policy_version 40573 (0.0009) [2023-02-25 13:31:48,224][36138] Updated weights for policy 0, policy_version 40583 (0.0009) [2023-02-25 13:31:49,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13454.3). Total num frames: 166244352. Throughput: 0: 3358.6. Samples: 4059416. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:31:49,729][36114] Avg episode reward: [(0, '51.562')] [2023-02-25 13:31:51,291][36138] Updated weights for policy 0, policy_version 40593 (0.0009) [2023-02-25 13:31:54,358][36138] Updated weights for policy 0, policy_version 40603 (0.0009) [2023-02-25 13:31:54,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13468.2). Total num frames: 166313984. Throughput: 0: 3356.3. Samples: 4069462. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:31:54,729][36114] Avg episode reward: [(0, '51.562')] [2023-02-25 13:31:55,645][36155] DAMAGECOUNT value on done: 268328.0 [2023-02-25 13:31:55,646][36155] Sum rewards: 45.372, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.640', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.129', 'AMMO3': '0.204', 'weapon4': '0.286', 'WEAPON4': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.300', 'HITCOUNT': '2.860', 'weapon3': '3.082', 'DAMAGECOUNT': '12.840', 'FRAGCOUNT': '40.000'} [2023-02-25 13:31:55,835][36139] DAMAGECOUNT value on done: 269054.0 [2023-02-25 13:31:55,835][36139] Sum rewards: 53.529, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.796', 'AMMO5': '0.011', 'AMMO2': '0.012', 'AMMO4': '0.062', 'weapon5': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'weapon2': '0.290', 'WEAPON4': '0.300', 'weapon4': '0.656', 'WEAPON3': '1.400', 'weapon3': '2.542', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '46.500'} [2023-02-25 13:31:55,958][36155] DAMAGECOUNT value on done: 276344.0 [2023-02-25 13:31:55,959][36155] Sum rewards: 60.686, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.192', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO3': '0.128', 'AMMO4': '0.129', 'weapon5': '0.170', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.478', 'WEAPON3': '0.850', 'weapon3': '2.690', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.514', 'FRAGCOUNT': '50.000'} [2023-02-25 13:31:56,146][36139] DAMAGECOUNT value on done: 270099.0 [2023-02-25 13:31:56,146][36139] Sum rewards: 58.626, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.078', 'AMMO5': '0.018', 'AMMO2': '0.034', 'weapon5': '0.116', 'AMMO3': '0.162', 'AMMO4': '0.167', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.508', 'weapon4': '0.590', 'WEAPON3': '1.050', 'weapon3': '2.434', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.525', 'FRAGCOUNT': '49.000'} [2023-02-25 13:31:56,236][36155] DAMAGECOUNT value on done: 267314.0 [2023-02-25 13:31:56,236][36155] Sum rewards: 54.143, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.550', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon5': '0.128', 'weapon4': '0.146', 'AMMO4': '0.161', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.406', 'WEAPON3': '1.350', 'HITCOUNT': '2.950', 'weapon3': '3.052', 'DAMAGECOUNT': '14.472', 'FRAGCOUNT': '48.000'} [2023-02-25 13:31:56,306][36139] DAMAGECOUNT value on done: 271151.0 [2023-02-25 13:31:56,307][36139] Sum rewards: 55.711, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.305', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.086', 'AMMO4': '0.165', 'AMMO3': '0.244', 'weapon4': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.408', 'WEAPON3': '1.450', 'weapon3': '3.008', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.750', 'FRAGCOUNT': '51.000'} [2023-02-25 13:31:56,546][36155] DAMAGECOUNT value on done: 267241.0 [2023-02-25 13:31:56,546][36155] Sum rewards: 40.591, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.944', 'AMMO5': '0.014', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.178', 'AMMO3': '0.221', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.350', 'weapon4': '0.510', 'WEAPON3': '1.300', 'weapon3': '2.208', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '11.805', 'FRAGCOUNT': '38.000'} [2023-02-25 13:31:56,620][36139] DAMAGECOUNT value on done: 270613.0 [2023-02-25 13:31:56,621][36139] Sum rewards: 54.563, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.714', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.044', 'AMMO3': '0.164', 'weapon5': '0.218', 'AMMO4': '0.221', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON4': '0.350', 'weapon4': '0.728', 'WEAPON3': '1.000', 'weapon3': '2.436', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.553', 'FRAGCOUNT': '46.000'} [2023-02-25 13:31:57,455][36138] Updated weights for policy 0, policy_version 40613 (0.0010) [2023-02-25 13:31:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13454.3). Total num frames: 166379520. Throughput: 0: 3350.8. Samples: 4089406. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:31:59,729][36114] Avg episode reward: [(0, '51.806')] [2023-02-25 13:32:00,081][36154] DAMAGECOUNT value on done: 274135.0 [2023-02-25 13:32:00,081][36154] Sum rewards: 49.351, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.060', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon5': '0.082', 'AMMO4': '0.117', 'AMMO3': '0.162', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.484', 'weapon2': '0.622', 'WEAPON3': '1.150', 'weapon3': '2.500', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.427', 'FRAGCOUNT': '41.000'} [2023-02-25 13:32:00,382][36154] DAMAGECOUNT value on done: 268293.0 [2023-02-25 13:32:00,382][36154] Sum rewards: 47.548, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.065', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.117', 'AMMO3': '0.150', 'weapon5': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.682', 'weapon2': '0.846', 'WEAPON3': '0.900', 'weapon3': '1.946', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '12.330', 'FRAGCOUNT': '41.000'} [2023-02-25 13:32:00,499][36138] Updated weights for policy 0, policy_version 40623 (0.0009) [2023-02-25 13:32:00,695][36154] DAMAGECOUNT value on done: 268449.0 [2023-02-25 13:32:00,696][36154] Sum rewards: 39.768, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.586', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.050', 'AMMO3': '0.154', 'AMMO4': '0.251', 'weapon5': '0.302', 'WEAPON5': '0.450', 'weapon2': '0.524', 'WEAPON4': '0.650', 'weapon4': '0.756', 'WEAPON3': '0.900', 'weapon3': '2.044', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '12.789', 'FRAGCOUNT': '36.000'} [2023-02-25 13:32:01,006][36154] DAMAGECOUNT value on done: 269038.0 [2023-02-25 13:32:01,006][36154] Sum rewards: 50.500, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.671', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.116', 'AMMO4': '0.144', 'weapon2': '0.188', 'AMMO3': '0.234', 'weapon4': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.040', 'weapon3': '3.088', 'DAMAGECOUNT': '14.286', 'FRAGCOUNT': '45.000'} [2023-02-25 13:32:01,014][36141] DAMAGECOUNT value on done: 274438.0 [2023-02-25 13:32:01,015][36141] Sum rewards: 40.708, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.000', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.061', 'weapon5': '0.070', 'AMMO3': '0.168', 'weapon4': '0.234', 'AMMO4': '0.306', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.584', 'WEAPON3': '1.000', 'HITCOUNT': '2.550', 'weapon3': '2.850', 'DAMAGECOUNT': '11.151', 'FRAGCOUNT': '37.000'} [2023-02-25 13:32:01,314][36141] DAMAGECOUNT value on done: 272721.0 [2023-02-25 13:32:01,314][36141] Sum rewards: 58.754, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.560', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon5': '0.096', 'AMMO3': '0.138', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'WEAPON4': '0.200', 'weapon2': '0.382', 'weapon4': '0.398', 'WEAPON3': '0.900', 'weapon3': '2.776', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.502', 'FRAGCOUNT': '48.000'} [2023-02-25 13:32:01,443][36141] DAMAGECOUNT value on done: 266836.0 [2023-02-25 13:32:01,443][36141] Sum rewards: 59.746, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.102', 'AMMO3': '0.135', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HEALTH': '0.296', 'weapon2': '0.454', 'weapon4': '0.488', 'WEAPON3': '0.750', 'weapon3': '2.596', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.006', 'FRAGCOUNT': '46.000'} [2023-02-25 13:32:01,651][36157] DAMAGECOUNT value on done: 277820.0 [2023-02-25 13:32:01,652][36157] Sum rewards: 59.093, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.570', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.114', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.388', 'weapon4': '0.392', 'WEAPON3': '1.050', 'weapon3': '2.896', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.447', 'FRAGCOUNT': '49.000'} [2023-02-25 13:32:01,745][36141] DAMAGECOUNT value on done: 259917.0 [2023-02-25 13:32:01,745][36141] Sum rewards: 57.461, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.600', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.122', 'weapon2': '0.166', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.464', 'WEAPON3': '1.300', 'weapon3': '2.956', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.670', 'FRAGCOUNT': '50.000'} [2023-02-25 13:32:01,942][36140] DAMAGECOUNT value on done: 275506.0 [2023-02-25 13:32:01,943][36140] Sum rewards: 49.230, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.417', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO4': '0.034', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'weapon4': '0.476', 'weapon2': '0.590', 'WEAPON3': '1.100', 'weapon3': '2.752', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.600', 'FRAGCOUNT': '42.000'} [2023-02-25 13:32:01,968][36157] DAMAGECOUNT value on done: 273685.0 [2023-02-25 13:32:01,970][36157] Sum rewards: 64.515, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.285', 'AMMO5': '0.023', 'AMMO2': '0.031', 'AMMO4': '0.156', 'AMMO3': '0.166', 'weapon2': '0.258', 'weapon5': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.540', 'WEAPON3': '1.100', 'weapon3': '2.752', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '53.500'} [2023-02-25 13:32:02,256][36140] DAMAGECOUNT value on done: 267966.0 [2023-02-25 13:32:02,257][36140] Sum rewards: 58.645, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.202', 'AMMO2': '0.013', 'AMMO4': '0.063', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'weapon2': '0.210', 'weapon4': '0.652', 'WEAPON3': '1.050', 'weapon3': '2.966', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '13.797', 'FRAGCOUNT': '48.000'} [2023-02-25 13:32:02,306][36157] DAMAGECOUNT value on done: 276101.0 [2023-02-25 13:32:02,306][36157] Sum rewards: 55.332, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.445', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.062', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'weapon4': '0.278', 'weapon2': '0.718', 'WEAPON3': '1.050', 'weapon3': '2.756', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.680', 'FRAGCOUNT': '45.000'} [2023-02-25 13:32:02,613][36157] DAMAGECOUNT value on done: 277175.0 [2023-02-25 13:32:02,613][36157] Sum rewards: 50.797, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.448', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon4': '0.242', 'weapon2': '0.292', 'WEAPON3': '1.100', 'HITCOUNT': '2.740', 'weapon3': '3.086', 'DAMAGECOUNT': '14.181', 'FRAGCOUNT': '43.000'} [2023-02-25 13:32:02,698][36140] DAMAGECOUNT value on done: 272386.0 [2023-02-25 13:32:02,699][36140] Sum rewards: 49.844, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.652', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.054', 'AMMO3': '0.115', 'weapon5': '0.264', 'AMMO4': '0.270', 'weapon2': '0.402', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.658', 'WEAPON3': '0.700', 'weapon3': '2.372', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.585', 'FRAGCOUNT': '42.000'} [2023-02-25 13:32:03,011][36156] DAMAGECOUNT value on done: 277332.0 [2023-02-25 13:32:03,012][36156] Sum rewards: 57.855, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.656', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.084', 'weapon5': '0.114', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'weapon2': '0.208', 'WEAPON3': '1.100', 'HITCOUNT': '2.880', 'weapon3': '3.396', 'DAMAGECOUNT': '13.794', 'FRAGCOUNT': '49.000'} [2023-02-25 13:32:03,013][36140] DAMAGECOUNT value on done: 266120.0 [2023-02-25 13:32:03,013][36140] Sum rewards: 56.489, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.348', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.127', 'AMMO3': '0.180', 'weapon5': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.458', 'weapon2': '0.634', 'WEAPON3': '1.150', 'weapon3': '2.440', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.833', 'FRAGCOUNT': '48.000'} [2023-02-25 13:32:03,260][36156] DAMAGECOUNT value on done: 278169.0 [2023-02-25 13:32:03,261][36156] Sum rewards: 62.649, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.996', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.194', 'AMMO3': '0.206', 'weapon2': '0.332', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.742', 'WEAPON3': '1.150', 'weapon3': '2.404', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.658', 'FRAGCOUNT': '55.000'} [2023-02-25 13:32:03,315][36156] DAMAGECOUNT value on done: 272471.0 [2023-02-25 13:32:03,316][36156] Sum rewards: 44.483, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.103', 'AMMO5': '0.009', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.138', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.306', 'weapon4': '0.460', 'WEAPON3': '1.300', 'weapon3': '2.750', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.600', 'FRAGCOUNT': '41.000'} [2023-02-25 13:32:03,538][36138] Updated weights for policy 0, policy_version 40633 (0.0009) [2023-02-25 13:32:03,570][36156] DAMAGECOUNT value on done: 270933.0 [2023-02-25 13:32:03,570][36156] Sum rewards: 39.085, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.129', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.088', 'AMMO4': '0.116', 'AMMO3': '0.148', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.506', 'WEAPON3': '0.850', 'weapon4': '1.146', 'weapon3': '1.880', 'HITCOUNT': '2.230', 'DAMAGECOUNT': '9.966', 'FRAGCOUNT': '34.000'} [2023-02-25 13:32:03,863][36142] DAMAGECOUNT value on done: 264184.0 [2023-02-25 13:32:03,864][36142] Sum rewards: 51.926, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.456', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.059', 'weapon2': '0.170', 'WEAPON4': '0.250', 'AMMO3': '0.298', 'weapon4': '0.552', 'WEAPON3': '1.800', 'weapon3': '2.950', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.637', 'FRAGCOUNT': '50.000'} [2023-02-25 13:32:04,157][36142] DAMAGECOUNT value on done: 271825.0 [2023-02-25 13:32:04,157][36142] Sum rewards: 40.476, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.051', 'AMMO5': '0.005', 'AMMO2': '0.052', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'AMMO4': '0.258', 'WEAPON4': '0.350', 'weapon4': '0.430', 'weapon2': '0.482', 'WEAPON3': '1.150', 'HITCOUNT': '2.570', 'weapon3': '2.746', 'DAMAGECOUNT': '11.766', 'FRAGCOUNT': '35.000'} [2023-02-25 13:32:04,195][36142] DAMAGECOUNT value on done: 264662.0 [2023-02-25 13:32:04,196][36142] Sum rewards: 45.844, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.130', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'weapon2': '0.544', 'weapon4': '0.586', 'WEAPON3': '1.100', 'HITCOUNT': '2.520', 'weapon3': '2.576', 'DAMAGECOUNT': '11.985', 'FRAGCOUNT': '40.000'} [2023-02-25 13:32:04,500][36142] DAMAGECOUNT value on done: 275370.0 [2023-02-25 13:32:04,501][36142] Sum rewards: 64.653, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.818', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.018', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.167', 'weapon4': '0.188', 'weapon2': '0.214', 'WEAPON3': '1.100', 'HITCOUNT': '3.220', 'weapon3': '3.394', 'DAMAGECOUNT': '15.402', 'FRAGCOUNT': '53.000'} [2023-02-25 13:32:04,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13468.2). Total num frames: 166449152. Throughput: 0: 3354.2. Samples: 4109718. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:32:04,730][36114] Avg episode reward: [(0, '51.530')] [2023-02-25 13:32:06,565][36138] Updated weights for policy 0, policy_version 40643 (0.0009) [2023-02-25 13:32:09,603][36138] Updated weights for policy 0, policy_version 40653 (0.0009) [2023-02-25 13:32:09,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 166514688. Throughput: 0: 3357.2. Samples: 4119796. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:32:09,729][36114] Avg episode reward: [(0, '51.530')] [2023-02-25 13:32:12,400][36156] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:32:12,659][36138] Updated weights for policy 0, policy_version 40663 (0.0010) [2023-02-25 13:32:14,126][36156] Large shaping reward 2.514 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200.0), ('HEALTH', -0.108, -36.0), ('weapon5', 0.002)] [2023-02-25 13:32:14,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13454.3). Total num frames: 166580224. Throughput: 0: 3357.6. Samples: 4140048. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:32:14,730][36114] Avg episode reward: [(0, '51.530')] [2023-02-25 13:32:15,682][36155] DAMAGECOUNT value on done: 273196.0 [2023-02-25 13:32:15,682][36155] Sum rewards: 57.231, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.819', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'weapon4': '0.110', 'AMMO3': '0.178', 'weapon2': '0.550', 'WEAPON3': '1.150', 'weapon3': '3.116', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.604', 'FRAGCOUNT': '47.000'} [2023-02-25 13:32:15,685][36138] Updated weights for policy 0, policy_version 40673 (0.0009) [2023-02-25 13:32:15,739][36139] DAMAGECOUNT value on done: 273527.0 [2023-02-25 13:32:15,739][36139] Sum rewards: 47.070, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.191', 'AMMO5': '0.007', 'AMMO2': '0.011', 'ARMOR': '0.012', 'weapon4': '0.038', 'weapon5': '0.042', 'AMMO4': '0.056', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.552', 'WEAPON3': '1.350', 'HITCOUNT': '2.870', 'weapon3': '3.158', 'DAMAGECOUNT': '13.419', 'FRAGCOUNT': '41.000'} [2023-02-25 13:32:15,990][36155] DAMAGECOUNT value on done: 281513.0 [2023-02-25 13:32:15,990][36155] Sum rewards: 62.320, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.415', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.018', 'AMMO4': '0.029', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'weapon2': '0.296', 'weapon4': '0.334', 'WEAPON3': '1.000', 'weapon3': '3.100', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '51.000'} [2023-02-25 13:32:16,056][36139] DAMAGECOUNT value on done: 274742.0 [2023-02-25 13:32:16,056][36139] Sum rewards: 59.008, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.840', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO3': '0.140', 'AMMO4': '0.180', 'weapon5': '0.192', 'weapon2': '0.212', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '0.900', 'weapon4': '1.220', 'weapon3': '2.020', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.929', 'FRAGCOUNT': '51.000'} [2023-02-25 13:32:16,232][36139] DAMAGECOUNT value on done: 275437.0 [2023-02-25 13:32:16,233][36139] Sum rewards: 51.775, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.265', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO3': '0.104', 'AMMO4': '0.116', 'weapon5': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.624', 'weapon2': '0.684', 'WEAPON3': '0.700', 'weapon3': '2.160', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.858', 'FRAGCOUNT': '41.000'} [2023-02-25 13:32:16,321][36155] DAMAGECOUNT value on done: 272127.0 [2023-02-25 13:32:16,322][36155] Sum rewards: 57.408, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.296', 'AMMO5': '0.008', 'AMMO2': '0.017', 'weapon4': '0.082', 'AMMO4': '0.083', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.492', 'WEAPON3': '1.150', 'HITCOUNT': '2.890', 'weapon3': '3.138', 'DAMAGECOUNT': '14.439', 'FRAGCOUNT': '49.000'} [2023-02-25 13:32:16,560][36139] DAMAGECOUNT value on done: 276009.0 [2023-02-25 13:32:16,561][36139] Sum rewards: 65.744, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.150', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.184', 'weapon4': '0.264', 'weapon2': '0.488', 'WEAPON3': '1.250', 'weapon3': '2.956', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.188', 'FRAGCOUNT': '54.000'} [2023-02-25 13:32:16,645][36155] DAMAGECOUNT value on done: 272268.0 [2023-02-25 13:32:16,645][36155] Sum rewards: 54.111, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.617', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.150', 'AMMO4': '0.165', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.442', 'weapon4': '0.518', 'WEAPON3': '1.350', 'weapon3': '2.612', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.081', 'FRAGCOUNT': '47.000'} [2023-02-25 13:32:18,765][36138] Updated weights for policy 0, policy_version 40683 (0.0009) [2023-02-25 13:32:19,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13454.3). Total num frames: 166649856. Throughput: 0: 3356.8. Samples: 4160158. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:32:19,729][36114] Avg episode reward: [(0, '52.032')] [2023-02-25 13:32:19,863][36154] DAMAGECOUNT value on done: 278029.0 [2023-02-25 13:32:19,864][36154] Sum rewards: 44.406, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.900', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.060', 'weapon5': '0.160', 'AMMO3': '0.193', 'AMMO4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON4': '0.600', 'weapon4': '0.966', 'WEAPON3': '1.300', 'weapon3': '2.244', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '11.682', 'FRAGCOUNT': '43.500'} [2023-02-25 13:32:20,168][36154] DAMAGECOUNT value on done: 273100.0 [2023-02-25 13:32:20,169][36154] Sum rewards: 56.761, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.302', 'AMMO5': '0.017', 'AMMO2': '0.030', 'AMMO4': '0.150', 'AMMO3': '0.190', 'weapon2': '0.236', 'weapon5': '0.242', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.558', 'WEAPON3': '1.150', 'weapon3': '2.628', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.421', 'FRAGCOUNT': '49.000'} [2023-02-25 13:32:20,469][36154] DAMAGECOUNT value on done: 272939.0 [2023-02-25 13:32:20,469][36154] Sum rewards: 53.191, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.600', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.140', 'AMMO3': '0.152', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.452', 'weapon4': '0.494', 'WEAPON3': '0.950', 'weapon3': '2.682', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.470', 'FRAGCOUNT': '44.000'} [2023-02-25 13:32:20,750][36141] DAMAGECOUNT value on done: 278725.0 [2023-02-25 13:32:20,751][36141] Sum rewards: 41.851, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.620', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon5': '0.076', 'AMMO3': '0.206', 'AMMO4': '0.240', 'WEAPON5': '0.300', 'weapon4': '0.406', 'weapon2': '0.444', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.784', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.861', 'FRAGCOUNT': '39.000'} [2023-02-25 13:32:20,768][36154] DAMAGECOUNT value on done: 274250.0 [2023-02-25 13:32:20,769][36154] Sum rewards: 61.868, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.224', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.170', 'AMMO4': '0.170', 'AMMO3': '0.222', 'weapon4': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.356', 'WEAPON3': '1.300', 'weapon3': '2.960', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '54.000'} [2023-02-25 13:32:21,097][36141] DAMAGECOUNT value on done: 277616.0 [2023-02-25 13:32:21,097][36141] Sum rewards: 48.125, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.673', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.050', 'AMMO3': '0.190', 'AMMO4': '0.248', 'weapon2': '0.250', 'weapon5': '0.268', 'WEAPON5': '0.400', 'WEAPON4': '0.750', 'WEAPON3': '1.100', 'weapon4': '1.156', 'weapon3': '1.970', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.685', 'FRAGCOUNT': '44.000'} [2023-02-25 13:32:21,197][36141] DAMAGECOUNT value on done: 271864.0 [2023-02-25 13:32:21,198][36141] Sum rewards: 56.349, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.830', 'AMMO5': '0.015', 'AMMO2': '0.051', 'AMMO3': '0.182', 'weapon5': '0.192', 'AMMO4': '0.256', 'weapon4': '0.284', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon2': '0.610', 'WEAPON3': '1.100', 'weapon3': '2.594', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.084', 'FRAGCOUNT': '49.000'} [2023-02-25 13:32:21,503][36141] DAMAGECOUNT value on done: 264274.0 [2023-02-25 13:32:21,504][36141] Sum rewards: 46.668, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.438', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.051', 'AMMO3': '0.170', 'AMMO4': '0.254', 'weapon5': '0.286', 'weapon2': '0.312', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.884', 'WEAPON3': '1.000', 'weapon3': '1.958', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.071', 'FRAGCOUNT': '40.000'} [2023-02-25 13:32:21,644][36157] DAMAGECOUNT value on done: 282543.0 [2023-02-25 13:32:21,644][36157] Sum rewards: 56.243, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.410', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO3': '0.152', 'weapon5': '0.180', 'AMMO4': '0.204', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.424', 'weapon4': '0.440', 'WEAPON3': '0.950', 'weapon3': '2.640', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '14.169', 'FRAGCOUNT': '47.000'} [2023-02-25 13:32:21,815][36138] Updated weights for policy 0, policy_version 40693 (0.0010) [2023-02-25 13:32:21,944][36157] DAMAGECOUNT value on done: 278338.0 [2023-02-25 13:32:21,944][36157] Sum rewards: 57.693, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.696', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO3': '0.132', 'AMMO4': '0.157', 'weapon5': '0.168', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.558', 'weapon2': '0.664', 'WEAPON3': '0.750', 'weapon3': '2.406', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.959', 'FRAGCOUNT': '47.000'} [2023-02-25 13:32:22,017][36140] DAMAGECOUNT value on done: 281796.0 [2023-02-25 13:32:22,018][36140] Sum rewards: 70.727, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.876', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon2': '0.158', 'AMMO4': '0.166', 'weapon5': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'weapon4': '0.314', 'WEAPON3': '1.600', 'weapon3': '3.138', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '60.500'} [2023-02-25 13:32:22,304][36157] DAMAGECOUNT value on done: 280466.0 [2023-02-25 13:32:22,305][36157] Sum rewards: 52.386, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.626', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'weapon5': '0.162', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon4': '0.354', 'weapon2': '0.720', 'WEAPON3': '1.100', 'weapon3': '2.492', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '13.050', 'FRAGCOUNT': '46.000'} [2023-02-25 13:32:22,325][36140] DAMAGECOUNT value on done: 272761.0 [2023-02-25 13:32:22,326][36140] Sum rewards: 49.853, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.178', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.136', 'weapon2': '0.164', 'AMMO4': '0.171', 'weapon5': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.266', 'WEAPON3': '1.550', 'HITCOUNT': '3.000', 'weapon3': '3.240', 'DAMAGECOUNT': '14.385', 'FRAGCOUNT': '45.000'} [2023-02-25 13:32:22,623][36157] DAMAGECOUNT value on done: 282750.0 [2023-02-25 13:32:22,624][36157] Sum rewards: 64.070, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.940', 'AMMO5': '0.024', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.160', 'AMMO3': '0.214', 'weapon2': '0.228', 'WEAPON4': '0.350', 'weapon4': '0.378', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.840', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '54.000'} [2023-02-25 13:32:22,689][36140] DAMAGECOUNT value on done: 277297.0 [2023-02-25 13:32:22,689][36140] Sum rewards: 53.952, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.040', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.189', 'weapon5': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.384', 'weapon2': '0.420', 'WEAPON3': '1.150', 'weapon3': '2.646', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.733', 'FRAGCOUNT': '46.000'} [2023-02-25 13:32:23,000][36140] DAMAGECOUNT value on done: 270702.0 [2023-02-25 13:32:23,001][36140] Sum rewards: 55.104, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.391', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.052', 'weapon5': '0.128', 'weapon2': '0.146', 'AMMO3': '0.161', 'AMMO4': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.840', 'WEAPON3': '1.050', 'weapon3': '2.698', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '13.746', 'FRAGCOUNT': '47.000'} [2023-02-25 13:32:23,031][36156] DAMAGECOUNT value on done: 282482.0 [2023-02-25 13:32:23,031][36156] Sum rewards: 64.009, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.810', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.048', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon4': '0.246', 'weapon2': '0.284', 'WEAPON3': '1.250', 'weapon3': '3.214', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '54.000'} [2023-02-25 13:32:23,305][36156] DAMAGECOUNT value on done: 282116.0 [2023-02-25 13:32:23,306][36156] Sum rewards: 47.658, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.056', 'AMMO5': '0.020', 'AMMO2': '0.039', 'AMMO3': '0.144', 'AMMO4': '0.194', 'weapon2': '0.198', 'weapon5': '0.314', 'WEAPON4': '0.500', 'weapon4': '0.518', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'weapon3': '2.506', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '11.841', 'FRAGCOUNT': '39.000'} [2023-02-25 13:32:23,349][36156] DAMAGECOUNT value on done: 277350.0 [2023-02-25 13:32:23,350][36156] Sum rewards: 49.832, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.402', 'AMMO5': '0.010', 'AMMO2': '0.056', 'AMMO3': '0.188', 'weapon5': '0.190', 'WEAPON5': '0.250', 'AMMO4': '0.282', 'weapon2': '0.314', 'WEAPON4': '0.600', 'weapon4': '0.864', 'WEAPON3': '1.100', 'weapon3': '2.282', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.637', 'FRAGCOUNT': '44.000'} [2023-02-25 13:32:23,641][36156] DAMAGECOUNT value on done: 275399.0 [2023-02-25 13:32:23,641][36156] Sum rewards: 49.802, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.992', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.172', 'weapon2': '0.194', 'weapon5': '0.212', 'AMMO3': '0.224', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon4': '1.304', 'weapon3': '2.014', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.398', 'FRAGCOUNT': '45.000'} [2023-02-25 13:32:23,807][36142] DAMAGECOUNT value on done: 269189.0 [2023-02-25 13:32:23,808][36142] Sum rewards: 55.219, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.090', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.094', 'WEAPON4': '0.100', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.656', 'WEAPON3': '1.300', 'weapon3': '2.776', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.015', 'FRAGCOUNT': '46.000'} [2023-02-25 13:32:24,107][36142] DAMAGECOUNT value on done: 275656.0 [2023-02-25 13:32:24,107][36142] Sum rewards: 42.614, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.275', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.046', 'AMMO4': '0.108', 'weapon4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.528', 'WEAPON3': '1.300', 'HITCOUNT': '2.790', 'weapon3': '3.094', 'DAMAGECOUNT': '11.493', 'FRAGCOUNT': '39.000'} [2023-02-25 13:32:24,144][36142] DAMAGECOUNT value on done: 269515.0 [2023-02-25 13:32:24,145][36142] Sum rewards: 53.631, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.898', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.172', 'weapon5': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.456', 'weapon2': '0.558', 'WEAPON3': '1.050', 'weapon3': '2.482', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.559', 'FRAGCOUNT': '45.000'} [2023-02-25 13:32:24,455][36142] DAMAGECOUNT value on done: 280224.0 [2023-02-25 13:32:24,456][36142] Sum rewards: 57.074, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.704', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.034', 'weapon5': '0.046', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon4': '0.368', 'weapon2': '0.508', 'WEAPON3': '1.150', 'weapon3': '2.872', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.562', 'FRAGCOUNT': '48.000'} [2023-02-25 13:32:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13454.3). Total num frames: 166715392. Throughput: 0: 3360.7. Samples: 4170286. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:32:24,730][36114] Avg episode reward: [(0, '52.679')] [2023-02-25 13:32:24,859][36138] Updated weights for policy 0, policy_version 40703 (0.0009) [2023-02-25 13:32:26,486][36142] Large shaping reward 2.532 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.501, 167.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 13:32:27,949][36138] Updated weights for policy 0, policy_version 40713 (0.0009) [2023-02-25 13:32:29,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13440.4). Total num frames: 166780928. Throughput: 0: 3355.4. Samples: 4190278. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:32:29,729][36114] Avg episode reward: [(0, '52.679')] [2023-02-25 13:32:30,983][36138] Updated weights for policy 0, policy_version 40723 (0.0009) [2023-02-25 13:32:34,004][36138] Updated weights for policy 0, policy_version 40733 (0.0009) [2023-02-25 13:32:34,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 166850560. Throughput: 0: 3356.3. Samples: 4210450. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:32:34,729][36114] Avg episode reward: [(0, '52.679')] [2023-02-25 13:32:35,602][36155] DAMAGECOUNT value on done: 278327.0 [2023-02-25 13:32:35,603][36155] Sum rewards: 65.570, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.724', 'AMMO5': '0.004', 'WEAPON1': '0.010', 'weapon5': '0.016', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.148', 'AMMO3': '0.185', 'weapon4': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.150', 'HITCOUNT': '3.220', 'weapon3': '3.240', 'DAMAGECOUNT': '15.393', 'FRAGCOUNT': '55.000'} [2023-02-25 13:32:35,778][36139] DAMAGECOUNT value on done: 277932.0 [2023-02-25 13:32:35,778][36139] Sum rewards: 53.543, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.922', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.106', 'AMMO3': '0.136', 'AMMO4': '0.144', 'weapon4': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON3': '0.950', 'HITCOUNT': '2.810', 'weapon3': '2.994', 'DAMAGECOUNT': '13.215', 'FRAGCOUNT': '45.000'} [2023-02-25 13:32:35,915][36155] DAMAGECOUNT value on done: 285834.0 [2023-02-25 13:32:35,916][36155] Sum rewards: 43.271, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.549', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon5': '0.118', 'AMMO3': '0.157', 'AMMO4': '0.192', 'WEAPON5': '0.300', 'weapon4': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.508', 'WEAPON3': '1.000', 'weapon3': '2.810', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.963', 'FRAGCOUNT': '36.500'} [2023-02-25 13:32:36,086][36139] DAMAGECOUNT value on done: 279242.0 [2023-02-25 13:32:36,087][36139] Sum rewards: 51.044, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.928', 'AMMO5': '0.017', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon5': '0.142', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.372', 'weapon4': '0.512', 'WEAPON3': '1.250', 'weapon3': '2.702', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.500', 'FRAGCOUNT': '44.000'} [2023-02-25 13:32:36,260][36155] DAMAGECOUNT value on done: 275837.0 [2023-02-25 13:32:36,260][36155] Sum rewards: 39.664, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.612', 'AMMO2': '0.030', 'ARMOR': '0.032', 'AMMO4': '0.151', 'AMMO3': '0.182', 'weapon2': '0.242', 'WEAPON4': '0.300', 'weapon4': '0.674', 'WEAPON3': '1.050', 'HITCOUNT': '2.660', 'weapon3': '2.824', 'DAMAGECOUNT': '11.130', 'FRAGCOUNT': '33.000'} [2023-02-25 13:32:36,293][36139] DAMAGECOUNT value on done: 279780.0 [2023-02-25 13:32:36,294][36139] Sum rewards: 51.053, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.045', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.106', 'AMMO3': '0.196', 'weapon4': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.150', 'HITCOUNT': '2.780', 'weapon3': '2.968', 'DAMAGECOUNT': '13.029', 'FRAGCOUNT': '45.000'} [2023-02-25 13:32:36,564][36155] DAMAGECOUNT value on done: 277601.0 [2023-02-25 13:32:36,565][36155] Sum rewards: 56.965, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.100', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO3': '0.143', 'AMMO4': '0.161', 'weapon5': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.418', 'weapon2': '0.464', 'WEAPON3': '0.900', 'weapon3': '2.712', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.489', 'FRAGCOUNT': '45.000'} [2023-02-25 13:32:36,608][36139] DAMAGECOUNT value on done: 280360.0 [2023-02-25 13:32:36,608][36139] Sum rewards: 54.261, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.602', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.086', 'AMMO4': '0.138', 'weapon2': '0.148', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.320', 'WEAPON3': '1.100', 'HITCOUNT': '2.940', 'weapon3': '3.108', 'DAMAGECOUNT': '13.053', 'FRAGCOUNT': '47.000'} [2023-02-25 13:32:37,080][36138] Updated weights for policy 0, policy_version 40743 (0.0009) [2023-02-25 13:32:39,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13440.4). Total num frames: 166916096. Throughput: 0: 3356.3. Samples: 4220494. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:32:39,730][36114] Avg episode reward: [(0, '52.806')] [2023-02-25 13:32:39,733][36125] Saving new best policy, reward=52.806! [2023-02-25 13:32:39,956][36154] DAMAGECOUNT value on done: 283398.0 [2023-02-25 13:32:39,957][36154] Sum rewards: 55.108, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.806', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon5': '0.176', 'AMMO4': '0.249', 'AMMO3': '0.253', 'weapon2': '0.368', 'WEAPON5': '0.400', 'weapon4': '0.482', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.590', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '49.000'} [2023-02-25 13:32:40,199][36138] Updated weights for policy 0, policy_version 40753 (0.0009) [2023-02-25 13:32:40,258][36154] DAMAGECOUNT value on done: 277605.0 [2023-02-25 13:32:40,259][36154] Sum rewards: 56.637, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.284', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon2': '0.136', 'AMMO3': '0.154', 'weapon5': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.880', 'WEAPON3': '0.900', 'weapon3': '2.486', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.515', 'FRAGCOUNT': '47.000'} [2023-02-25 13:32:40,572][36154] DAMAGECOUNT value on done: 277423.0 [2023-02-25 13:32:40,572][36154] Sum rewards: 44.179, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.560', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.211', 'weapon5': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.400', 'weapon4': '0.544', 'WEAPON3': '1.300', 'weapon3': '2.422', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '13.452', 'FRAGCOUNT': '40.000'} [2023-02-25 13:32:40,875][36154] DAMAGECOUNT value on done: 279009.0 [2023-02-25 13:32:40,875][36154] Sum rewards: 54.748, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.672', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.014', 'weapon5': '0.054', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'weapon4': '0.104', 'weapon2': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.263', 'WEAPON3': '1.650', 'HITCOUNT': '3.070', 'weapon3': '3.520', 'DAMAGECOUNT': '14.277', 'FRAGCOUNT': '50.000'} [2023-02-25 13:32:40,925][36141] DAMAGECOUNT value on done: 282829.0 [2023-02-25 13:32:40,925][36141] Sum rewards: 45.463, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.570', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.098', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'weapon2': '0.262', 'weapon4': '0.650', 'WEAPON3': '1.450', 'HITCOUNT': '2.770', 'weapon3': '2.780', 'DAMAGECOUNT': '12.267', 'FRAGCOUNT': '42.000'} [2023-02-25 13:32:41,242][36141] DAMAGECOUNT value on done: 282400.0 [2023-02-25 13:32:41,242][36141] Sum rewards: 50.417, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.588', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.062', 'AMMO3': '0.151', 'weapon5': '0.152', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.580', 'weapon4': '0.596', 'WEAPON3': '0.900', 'weapon3': '2.408', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.352', 'FRAGCOUNT': '42.000'} [2023-02-25 13:32:41,330][36141] DAMAGECOUNT value on done: 276763.0 [2023-02-25 13:32:41,330][36141] Sum rewards: 51.982, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.760', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.070', 'AMMO4': '0.101', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'weapon2': '0.282', 'WEAPON4': '0.300', 'weapon4': '0.310', 'WEAPON3': '1.200', 'HITCOUNT': '3.020', 'weapon3': '3.124', 'DAMAGECOUNT': '14.667', 'FRAGCOUNT': '44.000'} [2023-02-25 13:32:41,633][36141] DAMAGECOUNT value on done: 268888.0 [2023-02-25 13:32:41,634][36141] Sum rewards: 50.371, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.344', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.126', 'AMMO3': '0.202', 'AMMO4': '0.207', 'WEAPON5': '0.250', 'weapon2': '0.340', 'WEAPON4': '0.400', 'weapon4': '0.488', 'WEAPON3': '1.150', 'weapon3': '2.764', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.842', 'FRAGCOUNT': '43.000'} [2023-02-25 13:32:41,777][36157] DAMAGECOUNT value on done: 287362.0 [2023-02-25 13:32:41,778][36157] Sum rewards: 51.538, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.883', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon5': '0.200', 'AMMO3': '0.212', 'AMMO4': '0.232', 'weapon2': '0.304', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'weapon4': '0.638', 'WEAPON3': '1.300', 'weapon3': '2.566', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.457', 'FRAGCOUNT': '47.000'} [2023-02-25 13:32:42,088][36157] DAMAGECOUNT value on done: 282775.0 [2023-02-25 13:32:42,088][36157] Sum rewards: 53.810, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.065', 'AMMO5': '0.005', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon5': '0.140', 'AMMO3': '0.170', 'weapon4': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.850', 'weapon3': '3.116', 'DAMAGECOUNT': '13.311', 'FRAGCOUNT': '46.000'} [2023-02-25 13:32:42,276][36140] DAMAGECOUNT value on done: 285944.0 [2023-02-25 13:32:42,277][36140] Sum rewards: 41.979, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.922', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.132', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON4': '0.300', 'weapon4': '0.434', 'WEAPON3': '1.450', 'weapon3': '2.754', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.444', 'FRAGCOUNT': '40.000'} [2023-02-25 13:32:42,409][36157] DAMAGECOUNT value on done: 284985.0 [2023-02-25 13:32:42,410][36157] Sum rewards: 54.987, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.806', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.128', 'AMMO3': '0.170', 'weapon2': '0.214', 'WEAPON4': '0.250', 'weapon4': '0.458', 'WEAPON3': '1.150', 'HITCOUNT': '2.840', 'weapon3': '3.144', 'DAMAGECOUNT': '13.557', 'FRAGCOUNT': '47.000'} [2023-02-25 13:32:42,581][36140] DAMAGECOUNT value on done: 277433.0 [2023-02-25 13:32:42,581][36140] Sum rewards: 52.950, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.909', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.164', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'weapon4': '0.242', 'WEAPON4': '0.300', 'weapon2': '0.480', 'WEAPON3': '1.050', 'HITCOUNT': '2.740', 'weapon3': '2.856', 'DAMAGECOUNT': '14.016', 'FRAGCOUNT': '46.000'} [2023-02-25 13:32:42,711][36157] DAMAGECOUNT value on done: 286706.0 [2023-02-25 13:32:42,712][36157] Sum rewards: 43.242, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.144', 'AMMO5': '0.013', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.098', 'AMMO3': '0.131', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.372', 'weapon4': '0.440', 'WEAPON3': '0.750', 'HITCOUNT': '2.460', 'weapon3': '2.864', 'DAMAGECOUNT': '11.868', 'FRAGCOUNT': '35.000'} [2023-02-25 13:32:42,946][36140] DAMAGECOUNT value on done: 281932.0 [2023-02-25 13:32:42,946][36140] Sum rewards: 45.025, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.415', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.096', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.268', 'WEAPON5': '0.300', 'weapon4': '0.324', 'WEAPON3': '1.300', 'HITCOUNT': '2.880', 'weapon3': '3.056', 'DAMAGECOUNT': '13.905', 'FRAGCOUNT': '39.000'} [2023-02-25 13:32:43,110][36156] DAMAGECOUNT value on done: 286528.0 [2023-02-25 13:32:43,111][36156] Sum rewards: 46.381, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.195', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon2': '0.142', 'weapon5': '0.142', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.958', 'WEAPON3': '1.250', 'weapon3': '2.536', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.138', 'FRAGCOUNT': '42.000'} [2023-02-25 13:32:43,209][36138] Updated weights for policy 0, policy_version 40763 (0.0009) [2023-02-25 13:32:43,258][36140] DAMAGECOUNT value on done: 275054.0 [2023-02-25 13:32:43,258][36140] Sum rewards: 43.386, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.635', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.036', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.152', 'AMMO4': '0.182', 'weapon2': '0.238', 'WEAPON4': '0.450', 'weapon4': '0.682', 'WEAPON3': '1.100', 'weapon3': '2.686', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.056', 'FRAGCOUNT': '38.000'} [2023-02-25 13:32:43,390][36156] DAMAGECOUNT value on done: 287058.0 [2023-02-25 13:32:43,390][36156] Sum rewards: 59.326, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.430', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO3': '0.191', 'weapon4': '0.448', 'weapon2': '0.584', 'WEAPON3': '1.200', 'weapon3': '2.616', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.826', 'FRAGCOUNT': '50.000'} [2023-02-25 13:32:43,424][36156] DAMAGECOUNT value on done: 282467.0 [2023-02-25 13:32:43,425][36156] Sum rewards: 55.329, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.367', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.142', 'AMMO4': '0.183', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'weapon2': '0.284', 'WEAPON4': '0.300', 'weapon4': '0.422', 'WEAPON3': '1.250', 'weapon3': '2.936', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.351', 'FRAGCOUNT': '47.000'} [2023-02-25 13:32:43,705][36156] DAMAGECOUNT value on done: 280555.0 [2023-02-25 13:32:43,706][36156] Sum rewards: 60.675, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.063', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.075', 'WEAPON5': '0.150', 'weapon2': '0.150', 'weapon5': '0.192', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon4': '0.540', 'WEAPON3': '1.300', 'weapon3': '2.718', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.468', 'FRAGCOUNT': '53.000'} [2023-02-25 13:32:43,876][36142] DAMAGECOUNT value on done: 273494.0 [2023-02-25 13:32:43,876][36142] Sum rewards: 47.017, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.254', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.110', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'weapon2': '0.188', 'WEAPON5': '0.200', 'weapon4': '0.484', 'WEAPON3': '0.900', 'HITCOUNT': '2.760', 'weapon3': '2.870', 'DAMAGECOUNT': '12.855', 'FRAGCOUNT': '38.000'} [2023-02-25 13:32:44,197][36142] DAMAGECOUNT value on done: 279748.0 [2023-02-25 13:32:44,198][36142] Sum rewards: 44.963, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.467', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon4': '0.254', 'weapon2': '0.580', 'WEAPON3': '1.300', 'HITCOUNT': '2.450', 'weapon3': '2.916', 'DAMAGECOUNT': '12.276', 'FRAGCOUNT': '39.000'} [2023-02-25 13:32:44,250][36142] DAMAGECOUNT value on done: 273700.0 [2023-02-25 13:32:44,250][36142] Sum rewards: 45.307, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.874', 'AMMO5': '0.009', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.140', 'AMMO3': '0.190', 'WEAPON5': '0.250', 'weapon2': '0.340', 'WEAPON4': '0.350', 'weapon4': '0.404', 'WEAPON3': '1.150', 'HITCOUNT': '2.700', 'weapon3': '2.922', 'DAMAGECOUNT': '12.315', 'FRAGCOUNT': '40.000'} [2023-02-25 13:32:44,565][36142] DAMAGECOUNT value on done: 285020.0 [2023-02-25 13:32:44,565][36142] Sum rewards: 53.917, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.725', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.076', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.224', 'AMMO3': '0.235', 'weapon4': '0.242', 'WEAPON3': '1.350', 'HITCOUNT': '3.140', 'weapon3': '3.246', 'DAMAGECOUNT': '14.388', 'FRAGCOUNT': '48.000'} [2023-02-25 13:32:44,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 166985728. Throughput: 0: 3357.4. Samples: 4240490. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:32:44,729][36114] Avg episode reward: [(0, '52.514')] [2023-02-25 13:32:46,280][36138] Updated weights for policy 0, policy_version 40773 (0.0009) [2023-02-25 13:32:49,299][36138] Updated weights for policy 0, policy_version 40783 (0.0009) [2023-02-25 13:32:49,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 167051264. Throughput: 0: 3355.1. Samples: 4260698. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:32:49,730][36114] Avg episode reward: [(0, '52.514')] [2023-02-25 13:32:52,402][36138] Updated weights for policy 0, policy_version 40793 (0.0009) [2023-02-25 13:32:54,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13440.4). Total num frames: 167116800. Throughput: 0: 3353.6. Samples: 4270710. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:32:54,729][36114] Avg episode reward: [(0, '52.514')] [2023-02-25 13:32:55,398][36138] Updated weights for policy 0, policy_version 40803 (0.0009) [2023-02-25 13:32:55,493][36155] DAMAGECOUNT value on done: 283083.0 [2023-02-25 13:32:55,493][36155] Sum rewards: 57.218, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.280', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.098', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon4': '0.210', 'weapon2': '0.646', 'WEAPON3': '1.250', 'weapon3': '2.874', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.268', 'FRAGCOUNT': '49.000'} [2023-02-25 13:32:55,754][36139] DAMAGECOUNT value on done: 283226.0 [2023-02-25 13:32:55,755][36139] Sum rewards: 55.352, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.460', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.173', 'AMMO3': '0.174', 'weapon5': '0.268', 'weapon2': '0.334', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.508', 'WEAPON3': '1.200', 'weapon3': '2.596', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.882', 'FRAGCOUNT': '47.000'} [2023-02-25 13:32:55,794][36155] DAMAGECOUNT value on done: 290919.0 [2023-02-25 13:32:55,795][36155] Sum rewards: 59.065, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.185', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.084', 'AMMO4': '0.094', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'weapon4': '0.340', 'weapon2': '0.458', 'WEAPON3': '1.500', 'weapon3': '2.846', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.255', 'FRAGCOUNT': '52.000'} [2023-02-25 13:32:56,061][36139] DAMAGECOUNT value on done: 283843.0 [2023-02-25 13:32:56,061][36139] Sum rewards: 47.550, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.240', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.106', 'WEAPON5': '0.150', 'weapon2': '0.256', 'AMMO3': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.776', 'WEAPON3': '1.800', 'weapon3': '2.568', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.803', 'FRAGCOUNT': '46.000'} [2023-02-25 13:32:56,235][36155] DAMAGECOUNT value on done: 279631.0 [2023-02-25 13:32:56,235][36155] Sum rewards: 39.505, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.666', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon4': '0.276', 'weapon2': '0.310', 'WEAPON3': '1.250', 'HITCOUNT': '2.670', 'weapon3': '3.200', 'DAMAGECOUNT': '11.382', 'FRAGCOUNT': '37.000'} [2023-02-25 13:32:56,285][36139] DAMAGECOUNT value on done: 284354.0 [2023-02-25 13:32:56,286][36139] Sum rewards: 51.901, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.301', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.140', 'AMMO4': '0.217', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.286', 'weapon2': '0.542', 'WEAPON3': '1.300', 'weapon3': '2.732', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '13.722', 'FRAGCOUNT': '46.000'} [2023-02-25 13:32:56,555][36155] DAMAGECOUNT value on done: 282566.0 [2023-02-25 13:32:56,555][36155] Sum rewards: 57.893, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.859', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.138', 'AMMO3': '0.181', 'weapon4': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.472', 'WEAPON3': '1.200', 'weapon3': '2.842', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.895', 'FRAGCOUNT': '49.000'} [2023-02-25 13:32:56,569][36139] DAMAGECOUNT value on done: 284411.0 [2023-02-25 13:32:56,569][36139] Sum rewards: 47.402, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.880', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.054', 'AMMO4': '0.072', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'weapon4': '0.316', 'weapon2': '0.584', 'WEAPON3': '1.000', 'HITCOUNT': '2.760', 'weapon3': '2.800', 'DAMAGECOUNT': '12.153', 'FRAGCOUNT': '40.000'} [2023-02-25 13:32:58,376][36157] Large shaping reward 2.574 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.582, 194.0), ('HEALTH', -0.03, -10.0), ('weapon5', 0.002)] [2023-02-25 13:32:58,452][36138] Updated weights for policy 0, policy_version 40813 (0.0009) [2023-02-25 13:32:59,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 167186432. Throughput: 0: 3353.6. Samples: 4290962. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:32:59,730][36114] Avg episode reward: [(0, '52.435')] [2023-02-25 13:32:59,991][36154] DAMAGECOUNT value on done: 287485.0 [2023-02-25 13:32:59,991][36154] Sum rewards: 47.871, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.906', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.027', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.076', 'AMMO4': '0.134', 'AMMO3': '0.197', 'weapon2': '0.430', 'WEAPON3': '1.250', 'HITCOUNT': '2.650', 'weapon3': '3.146', 'DAMAGECOUNT': '12.261', 'FRAGCOUNT': '40.000'} [2023-02-25 13:33:00,305][36154] DAMAGECOUNT value on done: 281604.0 [2023-02-25 13:33:00,306][36154] Sum rewards: 41.286, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.516', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.239', 'weapon5': '0.274', 'WEAPON4': '0.350', 'weapon4': '0.418', 'WEAPON5': '0.450', 'weapon2': '0.564', 'WEAPON3': '1.350', 'weapon3': '2.402', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '11.997', 'FRAGCOUNT': '38.500'} [2023-02-25 13:33:00,625][36154] DAMAGECOUNT value on done: 281501.0 [2023-02-25 13:33:00,625][36154] Sum rewards: 47.047, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.720', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.065', 'WEAPON4': '0.150', 'weapon4': '0.198', 'AMMO3': '0.202', 'weapon2': '0.396', 'WEAPON3': '1.350', 'HITCOUNT': '2.630', 'weapon3': '3.172', 'DAMAGECOUNT': '12.234', 'FRAGCOUNT': '42.000'} [2023-02-25 13:33:00,838][36141] DAMAGECOUNT value on done: 287427.0 [2023-02-25 13:33:00,838][36141] Sum rewards: 54.010, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.225', 'AMMO5': '0.004', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.120', 'AMMO3': '0.150', 'weapon2': '0.532', 'WEAPON3': '1.050', 'HITCOUNT': '2.890', 'weapon3': '3.122', 'DAMAGECOUNT': '13.794', 'FRAGCOUNT': '44.000'} [2023-02-25 13:33:00,942][36154] DAMAGECOUNT value on done: 282940.0 [2023-02-25 13:33:00,943][36154] Sum rewards: 41.584, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.540', 'AMMO5': '0.018', 'AMMO2': '0.026', 'AMMO4': '0.132', 'AMMO3': '0.203', 'weapon2': '0.276', 'weapon5': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.454', 'WEAPON3': '1.200', 'HITCOUNT': '2.510', 'weapon3': '2.682', 'DAMAGECOUNT': '11.793', 'FRAGCOUNT': '38.000'} [2023-02-25 13:33:01,170][36141] DAMAGECOUNT value on done: 286948.0 [2023-02-25 13:33:01,170][36141] Sum rewards: 54.297, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.080', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.011', 'weapon4': '0.032', 'weapon5': '0.052', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'weapon2': '0.314', 'WEAPON3': '1.300', 'HITCOUNT': '3.180', 'weapon3': '3.410', 'DAMAGECOUNT': '13.614', 'FRAGCOUNT': '46.000'} [2023-02-25 13:33:01,251][36141] DAMAGECOUNT value on done: 281103.0 [2023-02-25 13:33:01,251][36141] Sum rewards: 54.721, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.386', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon5': '0.064', 'AMMO3': '0.096', 'WEAPON5': '0.200', 'AMMO4': '0.221', 'WEAPON4': '0.250', 'weapon2': '0.384', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'weapon4': '0.936', 'weapon3': '2.252', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.020', 'FRAGCOUNT': '42.000'} [2023-02-25 13:33:01,520][36138] Updated weights for policy 0, policy_version 40823 (0.0009) [2023-02-25 13:33:01,574][36141] DAMAGECOUNT value on done: 272645.0 [2023-02-25 13:33:01,574][36141] Sum rewards: 48.912, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.075', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.011', 'AMMO4': '0.057', 'weapon5': '0.128', 'weapon2': '0.140', 'AMMO3': '0.147', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.404', 'WEAPON3': '1.000', 'HITCOUNT': '2.450', 'weapon3': '3.116', 'DAMAGECOUNT': '11.271', 'FRAGCOUNT': '43.000'} [2023-02-25 13:33:01,843][36157] DAMAGECOUNT value on done: 292097.0 [2023-02-25 13:33:01,843][36157] Sum rewards: 52.473, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.587', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.144', 'AMMO3': '0.165', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.472', 'weapon4': '0.486', 'WEAPON3': '1.100', 'weapon3': '2.706', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '14.205', 'FRAGCOUNT': '43.000'} [2023-02-25 13:33:02,109][36140] DAMAGECOUNT value on done: 290821.0 [2023-02-25 13:33:02,110][36140] Sum rewards: 50.544, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.060', 'AMMO5': '0.019', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.198', 'AMMO3': '0.222', 'weapon4': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.458', 'WEAPON3': '1.350', 'weapon3': '2.824', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.631', 'FRAGCOUNT': '44.000'} [2023-02-25 13:33:02,154][36157] DAMAGECOUNT value on done: 286860.0 [2023-02-25 13:33:02,155][36157] Sum rewards: 44.114, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.502', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon5': '0.124', 'AMMO4': '0.228', 'AMMO3': '0.251', 'weapon2': '0.286', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.542', 'WEAPON3': '1.400', 'HITCOUNT': '2.540', 'weapon3': '2.728', 'DAMAGECOUNT': '12.255', 'FRAGCOUNT': '42.000'} [2023-02-25 13:33:02,411][36140] DAMAGECOUNT value on done: 282187.0 [2023-02-25 13:33:02,411][36140] Sum rewards: 58.876, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.935', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.148', 'AMMO3': '0.152', 'weapon2': '0.540', 'WEAPON3': '1.050', 'HITCOUNT': '2.950', 'weapon3': '3.130', 'DAMAGECOUNT': '14.262', 'FRAGCOUNT': '48.000'} [2023-02-25 13:33:02,459][36157] DAMAGECOUNT value on done: 289703.0 [2023-02-25 13:33:02,460][36157] Sum rewards: 56.800, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.377', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'weapon4': '0.102', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon2': '0.562', 'WEAPON3': '1.200', 'weapon3': '3.024', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.154', 'FRAGCOUNT': '47.500'} [2023-02-25 13:33:02,707][36140] DAMAGECOUNT value on done: 286016.0 [2023-02-25 13:33:02,708][36140] Sum rewards: 49.418, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.320', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.088', 'AMMO4': '0.094', 'AMMO3': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.364', 'WEAPON3': '0.850', 'weapon2': '1.000', 'weapon3': '2.360', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '12.252', 'FRAGCOUNT': '41.000'} [2023-02-25 13:33:02,769][36157] DAMAGECOUNT value on done: 291301.0 [2023-02-25 13:33:02,770][36157] Sum rewards: 57.017, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.650', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'weapon2': '0.348', 'weapon4': '0.392', 'WEAPON3': '1.000', 'HITCOUNT': '3.030', 'weapon3': '3.048', 'DAMAGECOUNT': '13.785', 'FRAGCOUNT': '46.000'} [2023-02-25 13:33:03,026][36140] DAMAGECOUNT value on done: 279506.0 [2023-02-25 13:33:03,026][36140] Sum rewards: 53.153, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.434', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon5': '0.096', 'AMMO3': '0.127', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.564', 'weapon4': '0.666', 'WEAPON3': '0.850', 'weapon3': '2.286', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '13.356', 'FRAGCOUNT': '44.000'} [2023-02-25 13:33:03,308][36156] DAMAGECOUNT value on done: 291064.0 [2023-02-25 13:33:03,309][36156] Sum rewards: 56.089, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.240', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon5': '0.050', 'AMMO4': '0.152', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.406', 'weapon4': '0.416', 'WEAPON3': '1.250', 'weapon3': '2.792', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.608', 'FRAGCOUNT': '49.000'} [2023-02-25 13:33:03,446][36139] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 13:33:03,601][36156] DAMAGECOUNT value on done: 291427.0 [2023-02-25 13:33:03,602][36156] Sum rewards: 48.940, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.716', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.045', 'AMMO3': '0.143', 'weapon5': '0.220', 'AMMO4': '0.224', 'weapon2': '0.372', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.576', 'WEAPON3': '0.950', 'HITCOUNT': '2.390', 'weapon3': '2.602', 'DAMAGECOUNT': '13.107', 'FRAGCOUNT': '42.000'} [2023-02-25 13:33:03,627][36156] DAMAGECOUNT value on done: 286734.0 [2023-02-25 13:33:03,627][36156] Sum rewards: 50.813, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.830', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.202', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.250', 'weapon4': '0.264', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.910', 'weapon3': '3.042', 'DAMAGECOUNT': '12.801', 'FRAGCOUNT': '46.000'} [2023-02-25 13:33:03,928][36156] DAMAGECOUNT value on done: 285233.0 [2023-02-25 13:33:03,929][36156] Sum rewards: 45.674, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.166', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.090', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.226', 'weapon4': '0.266', 'AMMO3': '0.268', 'WEAPON3': '1.450', 'HITCOUNT': '2.970', 'weapon3': '3.112', 'DAMAGECOUNT': '13.779', 'FRAGCOUNT': '40.000'} [2023-02-25 13:33:03,961][36142] DAMAGECOUNT value on done: 278613.0 [2023-02-25 13:33:03,962][36142] Sum rewards: 59.261, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.850', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.112', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon4': '0.232', 'WEAPON5': '0.300', 'weapon2': '0.686', 'WEAPON3': '1.050', 'weapon3': '2.732', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.357', 'FRAGCOUNT': '48.000'} [2023-02-25 13:33:04,283][36142] DAMAGECOUNT value on done: 284724.0 [2023-02-25 13:33:04,283][36142] Sum rewards: 56.118, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.080', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.090', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.200', 'AMMO3': '0.212', 'weapon4': '0.456', 'WEAPON3': '1.250', 'weapon3': '2.854', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.928', 'FRAGCOUNT': '48.000'} [2023-02-25 13:33:04,307][36142] DAMAGECOUNT value on done: 278052.0 [2023-02-25 13:33:04,307][36142] Sum rewards: 52.269, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.332', 'AMMO5': '0.013', 'AMMO2': '0.039', 'AMMO3': '0.138', 'AMMO4': '0.196', 'weapon5': '0.204', 'weapon2': '0.276', 'WEAPON5': '0.400', 'ARMOR': '0.404', 'WEAPON4': '0.450', 'weapon4': '0.784', 'WEAPON3': '0.800', 'weapon3': '2.460', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '13.056', 'FRAGCOUNT': '42.000'} [2023-02-25 13:33:04,574][36138] Updated weights for policy 0, policy_version 40833 (0.0009) [2023-02-25 13:33:04,610][36142] DAMAGECOUNT value on done: 289340.0 [2023-02-25 13:33:04,610][36142] Sum rewards: 49.697, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.525', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO3': '0.145', 'weapon5': '0.184', 'AMMO4': '0.206', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.434', 'weapon4': '0.724', 'WEAPON3': '0.850', 'weapon3': '2.354', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.960', 'FRAGCOUNT': '41.000'} [2023-02-25 13:33:04,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13440.4). Total num frames: 167251968. Throughput: 0: 3352.4. Samples: 4311018. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:33:04,730][36114] Avg episode reward: [(0, '52.176')] [2023-02-25 13:33:07,574][36138] Updated weights for policy 0, policy_version 40843 (0.0009) [2023-02-25 13:33:09,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 167321600. Throughput: 0: 3355.5. Samples: 4321284. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:33:09,730][36114] Avg episode reward: [(0, '52.176')] [2023-02-25 13:33:10,614][36138] Updated weights for policy 0, policy_version 40853 (0.0009) [2023-02-25 13:33:13,650][36138] Updated weights for policy 0, policy_version 40863 (0.0010) [2023-02-25 13:33:14,558][36142] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:33:14,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 167387136. Throughput: 0: 3360.5. Samples: 4341500. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:33:14,730][36114] Avg episode reward: [(0, '52.176')] [2023-02-25 13:33:15,390][36155] DAMAGECOUNT value on done: 287755.0 [2023-02-25 13:33:15,391][36155] Sum rewards: 51.601, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.101', 'AMMO5': '0.019', 'AMMO2': '0.030', 'weapon5': '0.142', 'AMMO4': '0.148', 'AMMO3': '0.191', 'weapon4': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.150', 'HITCOUNT': '2.950', 'weapon3': '3.086', 'DAMAGECOUNT': '14.016', 'FRAGCOUNT': '45.000'} [2023-02-25 13:33:15,671][36139] DAMAGECOUNT value on done: 287630.0 [2023-02-25 13:33:15,672][36139] Sum rewards: 53.357, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.460', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.030', 'AMMO4': '0.050', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.158', 'AMMO3': '0.210', 'WEAPON3': '1.350', 'HITCOUNT': '2.680', 'weapon3': '3.570', 'DAMAGECOUNT': '13.212', 'FRAGCOUNT': '47.000'} [2023-02-25 13:33:15,693][36155] DAMAGECOUNT value on done: 296049.0 [2023-02-25 13:33:15,693][36155] Sum rewards: 60.815, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.791', 'AMMO5': '0.025', 'AMMO2': '0.043', 'AMMO3': '0.160', 'AMMO4': '0.216', 'weapon5': '0.296', 'weapon2': '0.318', 'weapon4': '0.522', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'weapon3': '2.580', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '52.500'} [2023-02-25 13:33:15,975][36139] DAMAGECOUNT value on done: 288218.0 [2023-02-25 13:33:15,975][36139] Sum rewards: 53.034, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.980', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.076', 'WEAPON4': '0.100', 'weapon4': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'weapon2': '0.708', 'WEAPON3': '1.000', 'HITCOUNT': '2.820', 'weapon3': '2.944', 'DAMAGECOUNT': '13.125', 'FRAGCOUNT': '44.000'} [2023-02-25 13:33:16,149][36155] DAMAGECOUNT value on done: 283736.0 [2023-02-25 13:33:16,150][36155] Sum rewards: 49.024, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.147', 'AMMO5': '0.007', 'ARMOR': '0.008', 'weapon5': '0.022', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'weapon2': '0.298', 'WEAPON3': '1.150', 'HITCOUNT': '2.650', 'weapon3': '3.380', 'DAMAGECOUNT': '12.315', 'FRAGCOUNT': '44.000'} [2023-02-25 13:33:16,245][36139] DAMAGECOUNT value on done: 289383.0 [2023-02-25 13:33:16,246][36139] Sum rewards: 56.507, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.590', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO3': '0.165', 'AMMO4': '0.166', 'weapon5': '0.176', 'WEAPON5': '0.350', 'weapon2': '0.428', 'WEAPON4': '0.500', 'weapon4': '0.620', 'WEAPON3': '1.050', 'weapon3': '2.570', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.087', 'FRAGCOUNT': '48.000'} [2023-02-25 13:33:16,487][36155] DAMAGECOUNT value on done: 286980.0 [2023-02-25 13:33:16,488][36155] Sum rewards: 51.463, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.057', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.182', 'AMMO3': '0.199', 'AMMO4': '0.199', 'weapon2': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.756', 'WEAPON3': '1.150', 'weapon3': '2.420', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '13.242', 'FRAGCOUNT': '45.000'} [2023-02-25 13:33:16,552][36139] DAMAGECOUNT value on done: 289430.0 [2023-02-25 13:33:16,553][36139] Sum rewards: 59.011, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.660', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.142', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.334', 'weapon4': '0.380', 'WEAPON3': '1.300', 'weapon3': '2.856', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.718', 'FRAGCOUNT': '52.000'} [2023-02-25 13:33:16,678][36138] Updated weights for policy 0, policy_version 40873 (0.0009) [2023-02-25 13:33:19,702][36138] Updated weights for policy 0, policy_version 40883 (0.0009) [2023-02-25 13:33:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 167456768. Throughput: 0: 3364.2. Samples: 4361838. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:33:19,729][36114] Avg episode reward: [(0, '52.239')] [2023-02-25 13:33:19,733][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000040883_167456768.pth... [2023-02-25 13:33:19,790][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000040096_164233216.pth [2023-02-25 13:33:19,879][36154] DAMAGECOUNT value on done: 292345.0 [2023-02-25 13:33:19,880][36154] Sum rewards: 60.059, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.685', 'AMMO5': '0.007', 'weapon5': '0.024', 'AMMO2': '0.027', 'weapon4': '0.130', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.245', 'weapon2': '0.484', 'WEAPON3': '1.400', 'weapon3': '3.170', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '53.000'} [2023-02-25 13:33:20,193][36154] DAMAGECOUNT value on done: 285696.0 [2023-02-25 13:33:20,194][36154] Sum rewards: 46.457, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.962', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.061', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon7': '0.150', 'AMMO3': '0.174', 'weapon2': '0.420', 'weapon4': '0.508', 'WEAPON3': '1.100', 'weapon3': '2.452', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '12.276', 'FRAGCOUNT': '39.000'} [2023-02-25 13:33:20,506][36154] DAMAGECOUNT value on done: 284581.0 [2023-02-25 13:33:20,506][36154] Sum rewards: 38.462, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.287', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO3': '0.074', 'weapon5': '0.076', 'weapon7': '0.078', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.500', 'weapon2': '0.604', 'weapon4': '0.904', 'weapon3': '1.940', 'HITCOUNT': '2.050', 'DAMAGECOUNT': '8.955', 'FRAGCOUNT': '28.000'} [2023-02-25 13:33:20,813][36154] DAMAGECOUNT value on done: 287218.0 [2023-02-25 13:33:20,814][36154] Sum rewards: 48.979, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.367', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.012', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.185', 'weapon4': '0.298', 'weapon2': '0.442', 'WEAPON3': '1.100', 'HITCOUNT': '2.690', 'weapon3': '3.074', 'DAMAGECOUNT': '12.834', 'FRAGCOUNT': '40.000'} [2023-02-25 13:33:20,874][36141] DAMAGECOUNT value on done: 291870.0 [2023-02-25 13:33:20,875][36141] Sum rewards: 51.546, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.112', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'weapon5': '0.132', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon2': '0.420', 'weapon4': '0.682', 'WEAPON3': '1.300', 'weapon3': '2.534', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.329', 'FRAGCOUNT': '46.000'} [2023-02-25 13:33:21,183][36141] DAMAGECOUNT value on done: 291671.0 [2023-02-25 13:33:21,183][36141] Sum rewards: 58.767, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.666', 'AMMO2': '0.010', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'weapon4': '0.146', 'AMMO3': '0.233', 'weapon2': '0.330', 'WEAPON3': '1.450', 'HITCOUNT': '3.090', 'weapon3': '3.354', 'DAMAGECOUNT': '14.169', 'FRAGCOUNT': '52.000'} [2023-02-25 13:33:21,270][36141] DAMAGECOUNT value on done: 285623.0 [2023-02-25 13:33:21,271][36141] Sum rewards: 48.845, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.815', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO3': '0.139', 'AMMO4': '0.161', 'weapon4': '0.260', 'weapon5': '0.336', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.512', 'WEAPON3': '0.850', 'HITCOUNT': '2.480', 'weapon3': '2.680', 'DAMAGECOUNT': '12.993', 'FRAGCOUNT': '42.000'} [2023-02-25 13:33:21,590][36141] DAMAGECOUNT value on done: 276832.0 [2023-02-25 13:33:21,591][36141] Sum rewards: 46.147, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.412', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.159', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'weapon4': '0.472', 'weapon2': '0.486', 'WEAPON3': '1.200', 'weapon3': '2.562', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.561', 'FRAGCOUNT': '42.000'} [2023-02-25 13:33:21,649][36157] DAMAGECOUNT value on done: 296330.0 [2023-02-25 13:33:21,649][36157] Sum rewards: 49.161, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.505', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.016', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.058', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'weapon2': '0.770', 'WEAPON3': '0.850', 'HITCOUNT': '2.620', 'weapon3': '2.990', 'DAMAGECOUNT': '12.699', 'FRAGCOUNT': '39.000'} [2023-02-25 13:33:21,961][36157] DAMAGECOUNT value on done: 291503.0 [2023-02-25 13:33:21,962][36157] Sum rewards: 55.719, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.675', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.088', 'AMMO3': '0.113', 'AMMO4': '0.159', 'WEAPON5': '0.200', 'weapon2': '0.262', 'WEAPON4': '0.450', 'WEAPON3': '0.650', 'weapon4': '0.970', 'weapon3': '2.524', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '13.929', 'FRAGCOUNT': '45.000'} [2023-02-25 13:33:22,059][36140] DAMAGECOUNT value on done: 295180.0 [2023-02-25 13:33:22,060][36140] Sum rewards: 50.157, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.800', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.206', 'weapon4': '0.226', 'weapon2': '0.316', 'WEAPON3': '1.250', 'HITCOUNT': '2.900', 'weapon3': '3.206', 'DAMAGECOUNT': '13.077', 'FRAGCOUNT': '43.000'} [2023-02-25 13:33:22,317][36157] DAMAGECOUNT value on done: 293194.0 [2023-02-25 13:33:22,317][36157] Sum rewards: 42.875, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.007', 'AMMO2': '0.044', 'AMMO3': '0.075', 'HEALTH': '0.075', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO4': '0.222', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'weapon4': '0.616', 'weapon2': '1.004', 'weapon3': '2.072', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '10.473', 'FRAGCOUNT': '33.000'} [2023-02-25 13:33:22,372][36140] DAMAGECOUNT value on done: 286810.0 [2023-02-25 13:33:22,372][36140] Sum rewards: 55.472, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.810', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.046', 'AMMO3': '0.112', 'AMMO4': '0.230', 'weapon2': '0.242', 'weapon5': '0.294', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '0.650', 'weapon4': '1.424', 'weapon3': '1.622', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.869', 'FRAGCOUNT': '46.000'} [2023-02-25 13:33:22,617][36157] DAMAGECOUNT value on done: 295669.0 [2023-02-25 13:33:22,618][36157] Sum rewards: 48.221, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.351', 'weapon7': '0.002', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.053', 'weapon5': '0.146', 'AMMO3': '0.152', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.260', 'AMMO4': '0.264', 'WEAPON5': '0.300', 'weapon2': '0.418', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'HITCOUNT': '2.720', 'weapon3': '2.838', 'DAMAGECOUNT': '13.104', 'FRAGCOUNT': '41.000'} [2023-02-25 13:33:22,676][36140] DAMAGECOUNT value on done: 290350.0 [2023-02-25 13:33:22,676][36140] Sum rewards: 51.186, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.028', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.066', 'weapon5': '0.084', 'WEAPON4': '0.100', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'weapon2': '0.414', 'WEAPON3': '1.450', 'HITCOUNT': '2.810', 'weapon3': '3.224', 'DAMAGECOUNT': '13.002', 'FRAGCOUNT': '46.000'} [2023-02-25 13:33:22,774][36138] Updated weights for policy 0, policy_version 40893 (0.0010) [2023-02-25 13:33:22,994][36140] DAMAGECOUNT value on done: 283966.0 [2023-02-25 13:33:22,994][36140] Sum rewards: 52.912, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.788', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.048', 'AMMO3': '0.124', 'weapon5': '0.234', 'AMMO4': '0.241', 'WEAPON5': '0.350', 'weapon2': '0.394', 'WEAPON4': '0.550', 'WEAPON3': '0.750', 'weapon4': '0.910', 'weapon3': '2.120', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.368', 'FRAGCOUNT': '46.000'} [2023-02-25 13:33:23,264][36156] DAMAGECOUNT value on done: 294856.0 [2023-02-25 13:33:23,264][36156] Sum rewards: 43.481, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.870', 'weapon5': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.150', 'AMMO4': '0.158', 'WEAPON4': '0.250', 'weapon4': '0.482', 'weapon2': '0.796', 'WEAPON3': '0.850', 'weapon3': '2.566', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '11.376', 'FRAGCOUNT': '37.000'} [2023-02-25 13:33:23,549][36156] DAMAGECOUNT value on done: 295114.0 [2023-02-25 13:33:23,550][36156] Sum rewards: 41.147, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.420', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.136', 'weapon7': '0.226', 'weapon4': '0.408', 'weapon2': '0.420', 'WEAPON3': '0.750', 'HITCOUNT': '2.320', 'weapon3': '2.326', 'DAMAGECOUNT': '11.061', 'FRAGCOUNT': '34.000'} [2023-02-25 13:33:23,569][36156] DAMAGECOUNT value on done: 289995.0 [2023-02-25 13:33:23,570][36156] Sum rewards: 32.107, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.015', 'AMMO2': '0.080', 'AMMO3': '0.090', 'weapon2': '0.192', 'weapon5': '0.276', 'HEALTH': '0.334', 'WEAPON5': '0.350', 'AMMO4': '0.401', 'WEAPON3': '0.500', 'WEAPON4': '0.600', 'weapon4': '1.370', 'weapon3': '1.846', 'HITCOUNT': '2.270', 'DAMAGECOUNT': '9.783', 'FRAGCOUNT': '26.000'} [2023-02-25 13:33:23,869][36156] DAMAGECOUNT value on done: 289235.0 [2023-02-25 13:33:23,870][36156] Sum rewards: 41.960, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.020', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.050', 'weapon5': '0.110', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'AMMO4': '0.248', 'WEAPON4': '0.400', 'weapon2': '0.458', 'weapon4': '0.520', 'WEAPON3': '1.050', 'weapon3': '2.616', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '12.006', 'FRAGCOUNT': '37.000'} [2023-02-25 13:33:23,924][36142] DAMAGECOUNT value on done: 283703.0 [2023-02-25 13:33:23,925][36142] Sum rewards: 54.812, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.949', 'AMMO5': '0.014', 'AMMO2': '0.039', 'AMMO4': '0.193', 'AMMO3': '0.196', 'weapon4': '0.226', 'weapon5': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.200', 'weapon3': '2.918', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '46.000'} [2023-02-25 13:33:24,152][36157] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 13:33:24,215][36142] DAMAGECOUNT value on done: 282542.0 [2023-02-25 13:33:24,215][36142] Sum rewards: 53.845, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.630', 'AMMO5': '0.013', 'AMMO2': '0.020', 'AMMO4': '0.098', 'AMMO3': '0.172', 'weapon5': '0.174', 'weapon2': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.592', 'WEAPON3': '1.150', 'weapon3': '2.596', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.470', 'FRAGCOUNT': '46.500'} [2023-02-25 13:33:24,223][36142] DAMAGECOUNT value on done: 289450.0 [2023-02-25 13:33:24,224][36142] Sum rewards: 47.897, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.832', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.154', 'weapon2': '0.170', 'WEAPON5': '0.250', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'weapon4': '0.764', 'WEAPON3': '1.550', 'weapon3': '2.614', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '14.178', 'FRAGCOUNT': '44.000'} [2023-02-25 13:33:24,513][36142] DAMAGECOUNT value on done: 294152.0 [2023-02-25 13:33:24,514][36142] Sum rewards: 53.940, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.070', 'ARMOR': '0.004', 'AMMO2': '0.012', 'AMMO5': '0.012', 'AMMO4': '0.057', 'weapon5': '0.146', 'AMMO3': '0.159', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.562', 'weapon2': '0.696', 'WEAPON3': '1.050', 'weapon3': '2.286', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.436', 'FRAGCOUNT': '45.000'} [2023-02-25 13:33:24,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 167522304. Throughput: 0: 3362.4. Samples: 4371804. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:33:24,730][36114] Avg episode reward: [(0, '50.885')] [2023-02-25 13:33:25,785][36138] Updated weights for policy 0, policy_version 40903 (0.0009) [2023-02-25 13:33:28,849][36138] Updated weights for policy 0, policy_version 40913 (0.0010) [2023-02-25 13:33:29,729][36114] Fps is (10 sec: 13106.9, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 167587840. Throughput: 0: 3368.6. Samples: 4392076. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:33:29,730][36114] Avg episode reward: [(0, '50.885')] [2023-02-25 13:33:31,860][36138] Updated weights for policy 0, policy_version 40923 (0.0010) [2023-02-25 13:33:34,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 167657472. Throughput: 0: 3366.4. Samples: 4412186. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:33:34,729][36114] Avg episode reward: [(0, '50.885')] [2023-02-25 13:33:34,960][36138] Updated weights for policy 0, policy_version 40933 (0.0009) [2023-02-25 13:33:35,366][36155] DAMAGECOUNT value on done: 292179.0 [2023-02-25 13:33:35,366][36155] Sum rewards: 51.624, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.940', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.112', 'AMMO4': '0.148', 'AMMO3': '0.202', 'weapon2': '0.276', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '2.780', 'weapon3': '2.932', 'DAMAGECOUNT': '13.272', 'FRAGCOUNT': '45.000'} [2023-02-25 13:33:35,655][36139] DAMAGECOUNT value on done: 292563.0 [2023-02-25 13:33:35,655][36139] Sum rewards: 60.723, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.370', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.046', 'AMMO4': '0.075', 'AMMO3': '0.173', 'weapon4': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.336', 'WEAPON3': '1.050', 'HITCOUNT': '2.980', 'weapon3': '3.284', 'DAMAGECOUNT': '14.799', 'FRAGCOUNT': '50.000'} [2023-02-25 13:33:35,692][36155] DAMAGECOUNT value on done: 300507.0 [2023-02-25 13:33:35,693][36155] Sum rewards: 53.232, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.583', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon5': '0.140', 'AMMO3': '0.143', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.410', 'weapon4': '0.482', 'WEAPON3': '0.850', 'weapon3': '2.638', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.374', 'FRAGCOUNT': '43.000'} [2023-02-25 13:33:35,994][36139] DAMAGECOUNT value on done: 290839.0 [2023-02-25 13:33:35,995][36139] Sum rewards: 28.294, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.482', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.048', 'AMMO3': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.138', 'weapon7': '0.166', 'weapon2': '0.224', 'AMMO4': '0.238', 'WEAPON5': '0.350', 'WEAPON3': '0.400', 'WEAPON4': '0.500', 'weapon3': '0.816', 'HITCOUNT': '1.620', 'weapon4': '2.034', 'DAMAGECOUNT': '7.863', 'FRAGCOUNT': '22.500'} [2023-02-25 13:33:36,167][36155] DAMAGECOUNT value on done: 288346.0 [2023-02-25 13:33:36,168][36155] Sum rewards: 55.023, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.494', 'AMMO2': '0.003', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO4': '0.014', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'weapon2': '0.590', 'WEAPON3': '0.900', 'HITCOUNT': '2.920', 'weapon3': '2.954', 'DAMAGECOUNT': '13.830', 'FRAGCOUNT': '43.000'} [2023-02-25 13:33:36,176][36139] DAMAGECOUNT value on done: 293602.0 [2023-02-25 13:33:36,177][36139] Sum rewards: 45.192, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.324', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.134', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon2': '0.244', 'WEAPON4': '0.250', 'weapon4': '0.318', 'WEAPON3': '1.150', 'HITCOUNT': '2.690', 'weapon3': '3.088', 'DAMAGECOUNT': '12.657', 'FRAGCOUNT': '39.000'} [2023-02-25 13:33:36,485][36155] DAMAGECOUNT value on done: 291418.0 [2023-02-25 13:33:36,486][36155] Sum rewards: 48.998, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.996', 'ARMOR': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'weapon4': '0.052', 'weapon5': '0.084', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.794', 'WEAPON3': '1.200', 'weapon3': '2.846', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.314', 'FRAGCOUNT': '42.500'} [2023-02-25 13:33:36,491][36139] DAMAGECOUNT value on done: 293792.0 [2023-02-25 13:33:36,492][36139] Sum rewards: 48.659, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.578', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'AMMO4': '0.203', 'weapon4': '0.248', 'weapon2': '0.474', 'WEAPON3': '1.000', 'HITCOUNT': '2.610', 'weapon3': '2.972', 'DAMAGECOUNT': '13.086', 'FRAGCOUNT': '41.000'} [2023-02-25 13:33:38,102][36138] Updated weights for policy 0, policy_version 40943 (0.0010) [2023-02-25 13:33:39,729][36114] Fps is (10 sec: 13517.1, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 167723008. Throughput: 0: 3361.4. Samples: 4421974. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:33:39,730][36114] Avg episode reward: [(0, '50.583')] [2023-02-25 13:33:39,997][36154] DAMAGECOUNT value on done: 297021.0 [2023-02-25 13:33:39,997][36154] Sum rewards: 62.251, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.157', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.106', 'AMMO3': '0.131', 'AMMO4': '0.152', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.298', 'weapon2': '0.306', 'WEAPON3': '0.850', 'HITCOUNT': '2.820', 'weapon3': '2.926', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '51.000'} [2023-02-25 13:33:40,319][36154] DAMAGECOUNT value on done: 290225.0 [2023-02-25 13:33:40,320][36154] Sum rewards: 51.623, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.350', 'AMMO5': '0.017', 'AMMO2': '0.036', 'weapon5': '0.160', 'AMMO3': '0.161', 'AMMO4': '0.180', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.424', 'WEAPON3': '1.000', 'weapon3': '2.788', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.587', 'FRAGCOUNT': '44.000'} [2023-02-25 13:33:40,628][36154] DAMAGECOUNT value on done: 288610.0 [2023-02-25 13:33:40,628][36154] Sum rewards: 46.234, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.832', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.064', 'AMMO3': '0.152', 'weapon5': '0.184', 'weapon2': '0.204', 'AMMO4': '0.322', 'WEAPON5': '0.400', 'WEAPON4': '0.650', 'WEAPON3': '0.900', 'weapon4': '0.914', 'weapon3': '2.438', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '12.087', 'FRAGCOUNT': '41.000'} [2023-02-25 13:33:40,943][36154] DAMAGECOUNT value on done: 291442.0 [2023-02-25 13:33:40,943][36154] Sum rewards: 44.360, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.243', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.037', 'AMMO3': '0.155', 'AMMO4': '0.183', 'weapon5': '0.234', 'weapon2': '0.270', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.512', 'WEAPON3': '0.950', 'HITCOUNT': '2.520', 'weapon3': '2.700', 'DAMAGECOUNT': '12.672', 'FRAGCOUNT': '39.000'} [2023-02-25 13:33:41,081][36141] DAMAGECOUNT value on done: 295812.0 [2023-02-25 13:33:41,082][36141] Sum rewards: 44.373, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.470', 'AMMO5': '0.011', 'AMMO2': '0.036', 'AMMO3': '0.173', 'AMMO4': '0.178', 'weapon2': '0.334', 'weapon5': '0.344', 'WEAPON5': '0.400', 'weapon4': '0.446', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.594', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '11.826', 'FRAGCOUNT': '42.500'} [2023-02-25 13:33:41,151][36138] Updated weights for policy 0, policy_version 40953 (0.0009) [2023-02-25 13:33:41,408][36141] DAMAGECOUNT value on done: 296581.0 [2023-02-25 13:33:41,409][36141] Sum rewards: 57.741, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.044', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.052', 'AMMO4': '0.098', 'weapon5': '0.156', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.432', 'WEAPON3': '1.300', 'HITCOUNT': '3.030', 'weapon3': '3.116', 'DAMAGECOUNT': '14.730', 'FRAGCOUNT': '50.000'} [2023-02-25 13:33:41,485][36141] DAMAGECOUNT value on done: 290231.0 [2023-02-25 13:33:41,485][36141] Sum rewards: 52.394, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.608', 'AMMO5': '0.010', 'AMMO2': '0.052', 'weapon5': '0.058', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'AMMO4': '0.262', 'weapon2': '0.380', 'WEAPON4': '0.450', 'weapon4': '0.698', 'WEAPON3': '1.300', 'weapon3': '2.630', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '13.824', 'FRAGCOUNT': '47.000'} [2023-02-25 13:33:41,684][36157] DAMAGECOUNT value on done: 300673.0 [2023-02-25 13:33:41,685][36157] Sum rewards: 45.118, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.686', 'AMMO5': '0.028', 'AMMO2': '0.063', 'AMMO3': '0.102', 'weapon5': '0.288', 'AMMO4': '0.317', 'weapon2': '0.600', 'WEAPON3': '0.650', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'weapon4': '0.870', 'weapon3': '1.952', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '12.573', 'FRAGCOUNT': '39.000'} [2023-02-25 13:33:41,792][36141] DAMAGECOUNT value on done: 281810.0 [2023-02-25 13:33:41,793][36141] Sum rewards: 55.983, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.155', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.125', 'weapon5': '0.148', 'weapon2': '0.212', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.680', 'WEAPON3': '0.900', 'weapon3': '2.736', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.934', 'FRAGCOUNT': '46.000'} [2023-02-25 13:33:41,995][36157] DAMAGECOUNT value on done: 295692.0 [2023-02-25 13:33:41,996][36157] Sum rewards: 49.903, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.809', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon5': '0.112', 'AMMO4': '0.114', 'AMMO3': '0.144', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.488', 'weapon4': '0.564', 'WEAPON3': '0.800', 'weapon3': '2.666', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.567', 'FRAGCOUNT': '41.000'} [2023-02-25 13:33:42,124][36140] DAMAGECOUNT value on done: 300334.0 [2023-02-25 13:33:42,124][36140] Sum rewards: 53.923, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.186', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO4': '0.141', 'AMMO3': '0.157', 'weapon2': '0.172', 'weapon5': '0.332', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.756', 'WEAPON3': '0.950', 'weapon3': '2.326', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.462', 'FRAGCOUNT': '44.500'} [2023-02-25 13:33:42,428][36140] DAMAGECOUNT value on done: 290687.0 [2023-02-25 13:33:42,428][36140] Sum rewards: 48.249, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.912', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.152', 'weapon5': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.274', 'weapon2': '0.348', 'WEAPON3': '0.850', 'HITCOUNT': '2.560', 'weapon3': '2.976', 'DAMAGECOUNT': '11.631', 'FRAGCOUNT': '40.000'} [2023-02-25 13:33:42,432][36157] DAMAGECOUNT value on done: 297448.0 [2023-02-25 13:33:42,433][36157] Sum rewards: 48.277, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.821', 'AMMO5': '0.014', 'AMMO2': '0.037', 'AMMO3': '0.180', 'AMMO4': '0.186', 'weapon5': '0.192', 'weapon2': '0.202', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.798', 'WEAPON3': '1.100', 'weapon3': '2.576', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.753', 'FRAGCOUNT': '42.000'} [2023-02-25 13:33:42,722][36140] DAMAGECOUNT value on done: 294498.0 [2023-02-25 13:33:42,722][36140] Sum rewards: 56.286, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.782', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.117', 'AMMO3': '0.154', 'weapon5': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.526', 'weapon2': '0.538', 'WEAPON3': '0.900', 'weapon3': '2.548', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.444', 'FRAGCOUNT': '47.000'} [2023-02-25 13:33:42,730][36157] DAMAGECOUNT value on done: 299522.0 [2023-02-25 13:33:42,730][36157] Sum rewards: 48.221, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'weapon2': '0.128', 'HEALTH': '0.145', 'AMMO4': '0.167', 'WEAPON4': '0.300', 'WEAPON3': '0.600', 'weapon4': '0.662', 'HITCOUNT': '2.600', 'weapon3': '2.762', 'DAMAGECOUNT': '11.559', 'FRAGCOUNT': '38.000'} [2023-02-25 13:33:43,019][36140] DAMAGECOUNT value on done: 288898.0 [2023-02-25 13:33:43,019][36140] Sum rewards: 57.382, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.230', 'AMMO2': '0.016', 'AMMO5': '0.017', 'AMMO4': '0.079', 'weapon5': '0.120', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.302', 'weapon2': '0.334', 'WEAPON3': '1.150', 'weapon3': '3.014', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.796', 'FRAGCOUNT': '48.000'} [2023-02-25 13:33:43,424][36156] DAMAGECOUNT value on done: 299042.0 [2023-02-25 13:33:43,425][36156] Sum rewards: 49.442, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.065', 'weapon7': '0.004', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.039', 'weapon5': '0.066', 'AMMO3': '0.131', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.426', 'WEAPON3': '0.750', 'weapon2': '1.014', 'weapon3': '2.266', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '12.558', 'FRAGCOUNT': '39.000'} [2023-02-25 13:33:43,733][36156] DAMAGECOUNT value on done: 299951.0 [2023-02-25 13:33:43,733][36156] Sum rewards: 53.613, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.956', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO4': '0.182', 'AMMO3': '0.229', 'weapon5': '0.262', 'weapon2': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.522', 'WEAPON3': '1.400', 'weapon3': '2.622', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.511', 'FRAGCOUNT': '48.000'} [2023-02-25 13:33:43,742][36156] DAMAGECOUNT value on done: 294148.0 [2023-02-25 13:33:43,743][36156] Sum rewards: 47.127, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.866', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.050', 'AMMO3': '0.138', 'weapon5': '0.182', 'AMMO4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.390', 'WEAPON4': '0.450', 'weapon4': '0.816', 'WEAPON3': '0.850', 'weapon3': '2.280', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '12.459', 'FRAGCOUNT': '40.000'} [2023-02-25 13:33:44,004][36142] DAMAGECOUNT value on done: 288102.0 [2023-02-25 13:33:44,004][36142] Sum rewards: 49.219, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.930', 'AMMO5': '0.006', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.076', 'weapon4': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.434', 'WEAPON3': '1.350', 'HITCOUNT': '2.910', 'weapon3': '3.070', 'DAMAGECOUNT': '13.197', 'FRAGCOUNT': '43.000'} [2023-02-25 13:33:44,061][36156] DAMAGECOUNT value on done: 294086.0 [2023-02-25 13:33:44,061][36156] Sum rewards: 53.556, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.247', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.050', 'AMMO3': '0.173', 'AMMO4': '0.248', 'weapon5': '0.270', 'weapon2': '0.290', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'weapon4': '1.178', 'weapon3': '1.964', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.553', 'FRAGCOUNT': '44.000'} [2023-02-25 13:33:44,185][36138] Updated weights for policy 0, policy_version 40963 (0.0009) [2023-02-25 13:33:44,316][36142] DAMAGECOUNT value on done: 294030.0 [2023-02-25 13:33:44,317][36142] Sum rewards: 49.515, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.860', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.171', 'AMMO3': '0.181', 'weapon5': '0.182', 'weapon2': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.878', 'WEAPON3': '1.100', 'weapon3': '2.414', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.740', 'FRAGCOUNT': '43.000'} [2023-02-25 13:33:44,332][36142] DAMAGECOUNT value on done: 287764.0 [2023-02-25 13:33:44,333][36142] Sum rewards: 58.217, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.290', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.115', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'weapon4': '0.306', 'weapon2': '0.462', 'WEAPON3': '1.250', 'weapon3': '2.940', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.666', 'FRAGCOUNT': '50.000'} [2023-02-25 13:33:44,646][36142] DAMAGECOUNT value on done: 299998.0 [2023-02-25 13:33:44,646][36142] Sum rewards: 62.775, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-5.175', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon5': '0.048', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'weapon2': '0.226', 'AMMO3': '0.283', 'weapon4': '0.330', 'WEAPON4': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.092', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '56.000'} [2023-02-25 13:33:44,729][36114] Fps is (10 sec: 13107.0, 60 sec: 13380.2, 300 sec: 13426.5). Total num frames: 167788544. Throughput: 0: 3357.4. Samples: 4442046. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:33:44,730][36114] Avg episode reward: [(0, '50.846')] [2023-02-25 13:33:47,252][36138] Updated weights for policy 0, policy_version 40973 (0.0009) [2023-02-25 13:33:49,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 167858176. Throughput: 0: 3360.5. Samples: 4462242. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:33:49,730][36114] Avg episode reward: [(0, '50.846')] [2023-02-25 13:33:50,288][36138] Updated weights for policy 0, policy_version 40983 (0.0009) [2023-02-25 13:33:53,353][36138] Updated weights for policy 0, policy_version 40993 (0.0009) [2023-02-25 13:33:53,562][36157] Large shaping reward 2.626 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.594, 198.0), ('weapon5', 0.002)] [2023-02-25 13:33:54,028][36157] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:33:54,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13426.6). Total num frames: 167923712. Throughput: 0: 3354.4. Samples: 4472230. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:33:54,730][36114] Avg episode reward: [(0, '50.846')] [2023-02-25 13:33:55,381][36155] DAMAGECOUNT value on done: 296145.0 [2023-02-25 13:33:55,382][36155] Sum rewards: 48.364, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.750', 'AMMO5': '0.013', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.102', 'AMMO3': '0.153', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.626', 'weapon2': '0.934', 'WEAPON3': '0.950', 'weapon3': '2.146', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '11.898', 'FRAGCOUNT': '41.000'} [2023-02-25 13:33:55,667][36139] DAMAGECOUNT value on done: 296994.0 [2023-02-25 13:33:55,668][36139] Sum rewards: 45.752, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.567', 'weapon5': '0.002', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.050', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'weapon2': '0.810', 'WEAPON3': '1.250', 'HITCOUNT': '2.830', 'weapon3': '2.942', 'DAMAGECOUNT': '13.293', 'FRAGCOUNT': '38.000'} [2023-02-25 13:33:55,684][36155] DAMAGECOUNT value on done: 304110.0 [2023-02-25 13:33:55,685][36155] Sum rewards: 38.736, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.124', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon5': '0.208', 'AMMO3': '0.213', 'AMMO4': '0.238', 'weapon2': '0.244', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.774', 'WEAPON3': '1.150', 'HITCOUNT': '2.190', 'weapon3': '2.466', 'DAMAGECOUNT': '10.809', 'FRAGCOUNT': '38.000'} [2023-02-25 13:33:55,975][36139] DAMAGECOUNT value on done: 294752.0 [2023-02-25 13:33:55,976][36139] Sum rewards: 45.242, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.463', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.080', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'weapon2': '0.166', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon4': '0.302', 'WEAPON3': '1.250', 'HITCOUNT': '2.510', 'weapon3': '3.224', 'DAMAGECOUNT': '11.739', 'FRAGCOUNT': '41.000'} [2023-02-25 13:33:56,036][36139] DAMAGECOUNT value on done: 298073.0 [2023-02-25 13:33:56,036][36139] Sum rewards: 56.924, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.732', 'ARMOR': '0.008', 'AMMO5': '0.014', 'weapon7': '0.024', 'AMMO2': '0.035', 'AMMO3': '0.157', 'AMMO4': '0.174', 'weapon2': '0.176', 'weapon5': '0.194', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.414', 'WEAPON3': '0.950', 'weapon3': '2.860', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.260', 'FRAGCOUNT': '48.000'} [2023-02-25 13:33:56,081][36155] DAMAGECOUNT value on done: 292639.0 [2023-02-25 13:33:56,081][36155] Sum rewards: 47.220, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.326', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.040', 'AMMO3': '0.140', 'weapon5': '0.186', 'AMMO4': '0.200', 'weapon2': '0.304', 'weapon4': '0.420', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '0.850', 'HITCOUNT': '2.470', 'weapon3': '2.804', 'DAMAGECOUNT': '12.663', 'FRAGCOUNT': '41.000'} [2023-02-25 13:33:56,339][36139] DAMAGECOUNT value on done: 298945.0 [2023-02-25 13:33:56,339][36139] Sum rewards: 55.981, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.960', 'AMMO5': '0.016', 'AMMO2': '0.036', 'AMMO3': '0.131', 'AMMO4': '0.181', 'weapon2': '0.202', 'weapon5': '0.246', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '0.800', 'weapon4': '0.972', 'weapon3': '2.370', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '15.306', 'FRAGCOUNT': '45.000'} [2023-02-25 13:33:56,380][36138] Updated weights for policy 0, policy_version 41003 (0.0010) [2023-02-25 13:33:56,395][36155] DAMAGECOUNT value on done: 296766.0 [2023-02-25 13:33:56,395][36155] Sum rewards: 65.717, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.330', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.243', 'weapon2': '0.378', 'WEAPON3': '1.450', 'weapon3': '3.438', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.044', 'FRAGCOUNT': '56.000'} [2023-02-25 13:33:59,443][36138] Updated weights for policy 0, policy_version 41013 (0.0009) [2023-02-25 13:33:59,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13426.5). Total num frames: 167989248. Throughput: 0: 3352.4. Samples: 4492356. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:33:59,730][36114] Avg episode reward: [(0, '50.781')] [2023-02-25 13:34:00,073][36154] DAMAGECOUNT value on done: 301612.0 [2023-02-25 13:34:00,074][36154] Sum rewards: 51.634, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.614', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.186', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'weapon4': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.546', 'WEAPON3': '1.100', 'HITCOUNT': '2.780', 'weapon3': '2.806', 'DAMAGECOUNT': '13.773', 'FRAGCOUNT': '43.000'} [2023-02-25 13:34:00,378][36154] DAMAGECOUNT value on done: 295324.0 [2023-02-25 13:34:00,378][36154] Sum rewards: 55.582, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.317', 'AMMO2': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.052', 'weapon5': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'WEAPON5': '0.300', 'weapon4': '0.354', 'weapon2': '0.604', 'WEAPON3': '1.100', 'weapon3': '2.730', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.057', 'FRAGCOUNT': '45.000'} [2023-02-25 13:34:00,685][36154] DAMAGECOUNT value on done: 292859.0 [2023-02-25 13:34:00,685][36154] Sum rewards: 53.478, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.959', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.130', 'weapon5': '0.140', 'AMMO4': '0.174', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.332', 'WEAPON3': '1.150', 'HITCOUNT': '2.550', 'weapon3': '3.238', 'DAMAGECOUNT': '12.747', 'FRAGCOUNT': '48.000'} [2023-02-25 13:34:00,995][36154] DAMAGECOUNT value on done: 296050.0 [2023-02-25 13:34:00,996][36154] Sum rewards: 54.702, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.095', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon5': '0.174', 'weapon2': '0.220', 'AMMO3': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.452', 'WEAPON3': '1.250', 'weapon3': '2.848', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.824', 'FRAGCOUNT': '48.000'} [2023-02-25 13:34:01,174][36141] DAMAGECOUNT value on done: 300449.0 [2023-02-25 13:34:01,174][36141] Sum rewards: 58.051, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.458', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon2': '0.136', 'weapon5': '0.172', 'weapon4': '0.230', 'AMMO3': '0.238', 'AMMO4': '0.263', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.830', 'weapon3': '3.114', 'DAMAGECOUNT': '13.911', 'FRAGCOUNT': '51.000'} [2023-02-25 13:34:01,479][36141] DAMAGECOUNT value on done: 301280.0 [2023-02-25 13:34:01,480][36141] Sum rewards: 46.380, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.312', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.065', 'AMMO3': '0.206', 'weapon5': '0.222', 'AMMO4': '0.323', 'weapon2': '0.340', 'WEAPON5': '0.400', 'WEAPON4': '0.750', 'weapon4': '0.978', 'WEAPON3': '1.150', 'weapon3': '2.102', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.097', 'FRAGCOUNT': '44.000'} [2023-02-25 13:34:01,582][36141] DAMAGECOUNT value on done: 295702.0 [2023-02-25 13:34:01,582][36141] Sum rewards: 56.719, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.972', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.144', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon2': '0.258', 'weapon4': '0.272', 'WEAPON3': '1.250', 'weapon3': '3.094', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.413', 'FRAGCOUNT': '48.000'} [2023-02-25 13:34:01,601][36157] DAMAGECOUNT value on done: 305858.0 [2023-02-25 13:34:01,602][36157] Sum rewards: 59.649, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.885', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon5': '0.024', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'weapon4': '0.126', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'weapon2': '0.368', 'WEAPON3': '1.150', 'HITCOUNT': '3.230', 'weapon3': '3.248', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '49.000'} [2023-02-25 13:34:01,903][36157] DAMAGECOUNT value on done: 300958.0 [2023-02-25 13:34:01,903][36157] Sum rewards: 62.202, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.128', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.131', 'WEAPON5': '0.200', 'weapon2': '0.216', 'AMMO3': '0.228', 'weapon5': '0.228', 'WEAPON4': '0.300', 'weapon4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.912', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '55.000'} [2023-02-25 13:34:01,909][36141] DAMAGECOUNT value on done: 287294.0 [2023-02-25 13:34:01,910][36141] Sum rewards: 65.272, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.855', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.017', 'WEAPON4': '0.050', 'weapon4': '0.070', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'weapon2': '0.316', 'WEAPON3': '1.300', 'weapon3': '3.308', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.452', 'FRAGCOUNT': '55.000'} [2023-02-25 13:34:02,148][36139] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 13:34:02,289][36140] DAMAGECOUNT value on done: 304866.0 [2023-02-25 13:34:02,290][36140] Sum rewards: 56.277, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.932', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.086', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'weapon5': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.574', 'weapon4': '0.672', 'WEAPON3': '1.100', 'weapon3': '2.254', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.596', 'FRAGCOUNT': '48.000'} [2023-02-25 13:34:02,377][36157] DAMAGECOUNT value on done: 300687.0 [2023-02-25 13:34:02,378][36157] Sum rewards: 40.669, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.750', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO3': '0.085', 'AMMO4': '0.152', 'weapon5': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'weapon2': '0.950', 'weapon4': '1.136', 'weapon3': '1.364', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '9.717', 'FRAGCOUNT': '34.000'} [2023-02-25 13:34:02,494][36138] Updated weights for policy 0, policy_version 41023 (0.0010) [2023-02-25 13:34:02,612][36140] DAMAGECOUNT value on done: 295829.0 [2023-02-25 13:34:02,612][36140] Sum rewards: 52.305, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.755', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.044', 'weapon5': '0.196', 'AMMO4': '0.222', 'AMMO3': '0.241', 'weapon2': '0.282', 'weapon4': '0.436', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.768', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '48.000'} [2023-02-25 13:34:02,687][36157] DAMAGECOUNT value on done: 304281.0 [2023-02-25 13:34:02,688][36157] Sum rewards: 48.567, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.060', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon4': '0.074', 'AMMO4': '0.077', 'weapon5': '0.104', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.648', 'WEAPON3': '1.150', 'weapon3': '2.996', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.277', 'FRAGCOUNT': '39.500'} [2023-02-25 13:34:02,925][36140] DAMAGECOUNT value on done: 299740.0 [2023-02-25 13:34:02,926][36140] Sum rewards: 63.741, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.240', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.044', 'AMMO4': '0.059', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon4': '0.272', 'weapon2': '0.318', 'WEAPON3': '1.150', 'weapon3': '3.160', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '54.000'} [2023-02-25 13:34:03,240][36140] DAMAGECOUNT value on done: 293275.0 [2023-02-25 13:34:03,240][36140] Sum rewards: 49.894, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.933', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.140', 'AMMO3': '0.158', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.506', 'WEAPON3': '1.100', 'HITCOUNT': '2.810', 'weapon3': '2.842', 'DAMAGECOUNT': '13.131', 'FRAGCOUNT': '43.000'} [2023-02-25 13:34:03,535][36156] DAMAGECOUNT value on done: 304430.0 [2023-02-25 13:34:03,536][36156] Sum rewards: 65.426, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.452', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon5': '0.278', 'WEAPON5': '0.300', 'weapon4': '0.356', 'weapon2': '0.386', 'WEAPON3': '1.200', 'weapon3': '2.648', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '16.149', 'FRAGCOUNT': '57.000'} [2023-02-25 13:34:03,850][36156] DAMAGECOUNT value on done: 304916.0 [2023-02-25 13:34:03,851][36156] Sum rewards: 58.262, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.128', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon5': '0.116', 'AMMO4': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.257', 'weapon2': '0.366', 'weapon4': '0.398', 'WEAPON3': '1.450', 'weapon3': '2.844', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.895', 'FRAGCOUNT': '52.000'} [2023-02-25 13:34:03,860][36156] DAMAGECOUNT value on done: 298978.0 [2023-02-25 13:34:03,860][36156] Sum rewards: 55.778, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.465', 'AMMO5': '0.015', 'AMMO2': '0.043', 'AMMO3': '0.147', 'weapon5': '0.192', 'AMMO4': '0.215', 'WEAPON5': '0.350', 'weapon2': '0.356', 'weapon4': '0.368', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'weapon3': '2.766', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.490', 'FRAGCOUNT': '48.000'} [2023-02-25 13:34:03,948][36142] DAMAGECOUNT value on done: 293487.0 [2023-02-25 13:34:03,948][36142] Sum rewards: 69.654, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.110', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'weapon5': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.094', 'AMMO3': '0.219', 'weapon2': '0.516', 'WEAPON3': '1.450', 'weapon3': '3.178', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.155', 'FRAGCOUNT': '61.000'} [2023-02-25 13:34:04,161][36156] DAMAGECOUNT value on done: 299123.0 [2023-02-25 13:34:04,161][36156] Sum rewards: 53.404, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.560', 'AMMO5': '0.017', 'AMMO2': '0.034', 'weapon5': '0.142', 'AMMO4': '0.172', 'AMMO3': '0.233', 'weapon2': '0.340', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.384', 'WEAPON3': '1.350', 'weapon3': '2.840', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.111', 'FRAGCOUNT': '47.000'} [2023-02-25 13:34:04,249][36142] DAMAGECOUNT value on done: 298301.0 [2023-02-25 13:34:04,250][36142] Sum rewards: 47.798, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.450', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'weapon4': '0.030', 'weapon5': '0.038', 'AMMO4': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.354', 'WEAPON3': '1.300', 'HITCOUNT': '2.410', 'weapon3': '3.428', 'DAMAGECOUNT': '12.813', 'FRAGCOUNT': '42.000'} [2023-02-25 13:34:04,272][36142] DAMAGECOUNT value on done: 291851.0 [2023-02-25 13:34:04,273][36142] Sum rewards: 50.157, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.037', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon5': '0.146', 'AMMO4': '0.156', 'AMMO3': '0.185', 'weapon2': '0.256', 'weapon4': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'HITCOUNT': '2.670', 'weapon3': '3.116', 'DAMAGECOUNT': '12.186', 'FRAGCOUNT': '44.000'} [2023-02-25 13:34:04,580][36142] DAMAGECOUNT value on done: 304188.0 [2023-02-25 13:34:04,581][36142] Sum rewards: 48.487, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.570', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.035', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.160', 'AMMO3': '0.180', 'weapon2': '0.256', 'WEAPON3': '1.100', 'HITCOUNT': '2.560', 'weapon3': '3.170', 'DAMAGECOUNT': '12.570', 'FRAGCOUNT': '41.000'} [2023-02-25 13:34:04,730][36114] Fps is (10 sec: 13516.2, 60 sec: 13448.4, 300 sec: 13426.5). Total num frames: 168058880. Throughput: 0: 3346.4. Samples: 4512428. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:34:04,730][36114] Avg episode reward: [(0, '51.919')] [2023-02-25 13:34:05,564][36138] Updated weights for policy 0, policy_version 41033 (0.0009) [2023-02-25 13:34:08,585][36138] Updated weights for policy 0, policy_version 41043 (0.0009) [2023-02-25 13:34:09,007][36141] Large shaping reward 2.629 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0)] [2023-02-25 13:34:09,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13426.5). Total num frames: 168124416. Throughput: 0: 3351.0. Samples: 4522598. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:34:09,730][36114] Avg episode reward: [(0, '51.919')] [2023-02-25 13:34:11,640][36138] Updated weights for policy 0, policy_version 41053 (0.0009) [2023-02-25 13:34:13,908][36155] Large shaping reward 2.641 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 13:34:14,630][36138] Updated weights for policy 0, policy_version 41063 (0.0009) [2023-02-25 13:34:14,729][36114] Fps is (10 sec: 13517.4, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 168194048. Throughput: 0: 3351.3. Samples: 4542882. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:34:14,730][36114] Avg episode reward: [(0, '51.919')] [2023-02-25 13:34:15,278][36155] DAMAGECOUNT value on done: 300483.0 [2023-02-25 13:34:15,278][36155] Sum rewards: 42.192, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.164', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.108', 'weapon4': '0.184', 'AMMO3': '0.218', 'AMMO4': '0.229', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.692', 'WEAPON3': '1.250', 'HITCOUNT': '2.600', 'weapon3': '2.630', 'DAMAGECOUNT': '12.486', 'FRAGCOUNT': '39.000'} [2023-02-25 13:34:15,586][36155] DAMAGECOUNT value on done: 308158.0 [2023-02-25 13:34:15,586][36155] Sum rewards: 43.289, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.958', 'AMMO5': '0.011', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.204', 'AMMO3': '0.219', 'weapon4': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.642', 'WEAPON3': '1.250', 'HITCOUNT': '2.450', 'weapon3': '2.610', 'DAMAGECOUNT': '12.144', 'FRAGCOUNT': '42.000'} [2023-02-25 13:34:15,632][36139] DAMAGECOUNT value on done: 301182.0 [2023-02-25 13:34:15,633][36139] Sum rewards: 50.391, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.475', 'AMMO5': '0.015', 'AMMO2': '0.020', 'weapon5': '0.098', 'AMMO4': '0.102', 'weapon2': '0.162', 'AMMO3': '0.173', 'weapon4': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'HITCOUNT': '2.650', 'weapon3': '3.090', 'DAMAGECOUNT': '12.564', 'FRAGCOUNT': '44.000'} [2023-02-25 13:34:15,938][36139] DAMAGECOUNT value on done: 299560.0 [2023-02-25 13:34:15,938][36139] Sum rewards: 60.336, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.527', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon5': '0.072', 'AMMO4': '0.116', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.288', 'weapon4': '0.376', 'WEAPON3': '1.100', 'weapon3': '3.008', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.424', 'FRAGCOUNT': '52.000'} [2023-02-25 13:34:15,977][36139] DAMAGECOUNT value on done: 302620.0 [2023-02-25 13:34:15,977][36139] Sum rewards: 57.062, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.470', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.076', 'weapon5': '0.106', 'AMMO4': '0.139', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.566', 'WEAPON3': '1.100', 'HITCOUNT': '2.880', 'weapon3': '3.058', 'DAMAGECOUNT': '13.641', 'FRAGCOUNT': '50.000'} [2023-02-25 13:34:15,998][36155] DAMAGECOUNT value on done: 297315.0 [2023-02-25 13:34:15,999][36155] Sum rewards: 47.253, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.951', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.017', 'weapon5': '0.050', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'AMMO3': '0.186', 'weapon4': '0.192', 'WEAPON4': '0.250', 'weapon2': '0.564', 'WEAPON3': '1.200', 'weapon3': '2.996', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '40.000'} [2023-02-25 13:34:16,294][36139] DAMAGECOUNT value on done: 302604.0 [2023-02-25 13:34:16,294][36139] Sum rewards: 45.050, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.112', 'ARMOR': '0.004', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon5': '0.050', 'weapon4': '0.074', 'AMMO4': '0.105', 'AMMO3': '0.125', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.900', 'weapon2': '0.994', 'HITCOUNT': '2.490', 'weapon3': '2.556', 'DAMAGECOUNT': '10.977', 'FRAGCOUNT': '37.500'} [2023-02-25 13:34:16,310][36155] DAMAGECOUNT value on done: 301790.0 [2023-02-25 13:34:16,310][36155] Sum rewards: 60.360, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.805', 'AMMO5': '0.014', 'AMMO2': '0.048', 'AMMO3': '0.158', 'weapon5': '0.228', 'AMMO4': '0.239', 'weapon2': '0.256', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.606', 'WEAPON3': '0.900', 'weapon3': '2.564', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.072', 'FRAGCOUNT': '50.500'} [2023-02-25 13:34:17,714][36138] Updated weights for policy 0, policy_version 41073 (0.0009) [2023-02-25 13:34:19,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13426.6). Total num frames: 168259584. Throughput: 0: 3351.4. Samples: 4562998. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:34:19,729][36114] Avg episode reward: [(0, '51.616')] [2023-02-25 13:34:19,970][36154] DAMAGECOUNT value on done: 305881.0 [2023-02-25 13:34:19,971][36154] Sum rewards: 46.463, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.360', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'weapon4': '0.196', 'weapon2': '0.610', 'WEAPON3': '1.050', 'HITCOUNT': '2.780', 'weapon3': '3.052', 'DAMAGECOUNT': '12.807', 'FRAGCOUNT': '38.000'} [2023-02-25 13:34:20,279][36154] DAMAGECOUNT value on done: 299470.0 [2023-02-25 13:34:20,279][36154] Sum rewards: 44.744, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.912', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.039', 'AMMO3': '0.160', 'AMMO4': '0.195', 'weapon5': '0.260', 'weapon2': '0.360', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'weapon4': '0.800', 'WEAPON3': '1.000', 'weapon3': '2.306', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.438', 'FRAGCOUNT': '36.500'} [2023-02-25 13:34:20,564][36154] DAMAGECOUNT value on done: 297350.0 [2023-02-25 13:34:20,565][36154] Sum rewards: 53.032, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.106', 'AMMO5': '0.005', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon5': '0.076', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.346', 'weapon4': '0.552', 'WEAPON3': '1.100', 'weapon3': '2.614', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.473', 'FRAGCOUNT': '46.000'} [2023-02-25 13:34:20,730][36138] Updated weights for policy 0, policy_version 41083 (0.0010) [2023-02-25 13:34:20,873][36154] DAMAGECOUNT value on done: 300619.0 [2023-02-25 13:34:20,874][36154] Sum rewards: 52.604, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.260', 'AMMO5': '0.017', 'AMMO2': '0.046', 'AMMO3': '0.205', 'AMMO4': '0.232', 'weapon2': '0.240', 'weapon5': '0.330', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.668', 'WEAPON3': '1.200', 'weapon3': '2.438', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '13.707', 'FRAGCOUNT': '48.000'} [2023-02-25 13:34:21,148][36141] DAMAGECOUNT value on done: 304774.0 [2023-02-25 13:34:21,148][36141] Sum rewards: 44.367, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.122', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon7': '0.028', 'AMMO4': '0.125', 'weapon2': '0.158', 'AMMO3': '0.178', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.804', 'WEAPON3': '0.950', 'weapon3': '2.340', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '12.975', 'FRAGCOUNT': '38.000'} [2023-02-25 13:34:21,463][36141] DAMAGECOUNT value on done: 306212.0 [2023-02-25 13:34:21,464][36141] Sum rewards: 62.362, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.098', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon5': '0.104', 'AMMO4': '0.130', 'AMMO3': '0.151', 'weapon2': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.700', 'WEAPON3': '0.950', 'weapon3': '2.740', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.796', 'FRAGCOUNT': '52.500'} [2023-02-25 13:34:21,541][36141] DAMAGECOUNT value on done: 300758.0 [2023-02-25 13:34:21,541][36141] Sum rewards: 58.674, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.400', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.128', 'weapon5': '0.130', 'AMMO3': '0.180', 'AMMO4': '0.225', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.510', 'WEAPON3': '1.100', 'HITCOUNT': '2.960', 'weapon3': '2.972', 'DAMAGECOUNT': '15.108', 'FRAGCOUNT': '51.000'} [2023-02-25 13:34:21,729][36157] DAMAGECOUNT value on done: 310748.0 [2023-02-25 13:34:21,729][36157] Sum rewards: 65.323, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.775', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'weapon5': '0.132', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon2': '0.238', 'weapon4': '0.460', 'WEAPON3': '1.150', 'weapon3': '2.808', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '14.670', 'FRAGCOUNT': '56.000'} [2023-02-25 13:34:21,851][36141] DAMAGECOUNT value on done: 292452.0 [2023-02-25 13:34:21,851][36141] Sum rewards: 54.411, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.277', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.148', 'AMMO3': '0.207', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.424', 'weapon2': '0.782', 'WEAPON3': '1.300', 'weapon3': '2.380', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '48.000'} [2023-02-25 13:34:22,046][36157] DAMAGECOUNT value on done: 305479.0 [2023-02-25 13:34:22,046][36157] Sum rewards: 49.643, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.720', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon5': '0.114', 'AMMO4': '0.130', 'AMMO3': '0.218', 'weapon2': '0.226', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.768', 'WEAPON3': '1.250', 'weapon3': '2.566', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.563', 'FRAGCOUNT': '43.000'} [2023-02-25 13:34:22,374][36140] DAMAGECOUNT value on done: 309959.0 [2023-02-25 13:34:22,375][36140] Sum rewards: 58.231, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.457', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.045', 'AMMO3': '0.174', 'weapon5': '0.212', 'AMMO4': '0.225', 'weapon2': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.774', 'WEAPON3': '1.100', 'weapon3': '2.316', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '15.279', 'FRAGCOUNT': '48.000'} [2023-02-25 13:34:22,538][36157] DAMAGECOUNT value on done: 305671.0 [2023-02-25 13:34:22,538][36157] Sum rewards: 50.414, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.590', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon5': '0.078', 'AMMO4': '0.120', 'weapon2': '0.158', 'AMMO3': '0.249', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.714', 'WEAPON3': '1.450', 'weapon3': '2.818', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.952', 'FRAGCOUNT': '45.000'} [2023-02-25 13:34:22,676][36140] DAMAGECOUNT value on done: 300569.0 [2023-02-25 13:34:22,677][36140] Sum rewards: 43.379, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.190', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.064', 'AMMO3': '0.228', 'weapon5': '0.298', 'AMMO4': '0.319', 'weapon2': '0.506', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.552', 'WEAPON3': '1.350', 'weapon3': '2.230', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '14.220', 'FRAGCOUNT': '41.500'} [2023-02-25 13:34:22,846][36157] DAMAGECOUNT value on done: 308566.0 [2023-02-25 13:34:22,846][36157] Sum rewards: 47.843, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.128', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.142', 'AMMO3': '0.196', 'AMMO4': '0.204', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.682', 'weapon4': '0.768', 'WEAPON3': '1.100', 'weapon3': '2.086', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '12.855', 'FRAGCOUNT': '43.000'} [2023-02-25 13:34:22,984][36140] DAMAGECOUNT value on done: 304743.0 [2023-02-25 13:34:22,985][36140] Sum rewards: 58.515, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.050', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.048', 'AMMO3': '0.145', 'weapon5': '0.170', 'weapon2': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.874', 'WEAPON3': '0.950', 'weapon3': '2.542', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.009', 'FRAGCOUNT': '48.000'} [2023-02-25 13:34:23,291][36140] DAMAGECOUNT value on done: 298017.0 [2023-02-25 13:34:23,291][36140] Sum rewards: 52.098, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.517', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.141', 'weapon5': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.502', 'weapon4': '0.516', 'WEAPON3': '0.900', 'weapon3': '2.456', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.226', 'FRAGCOUNT': '42.000'} [2023-02-25 13:34:23,403][36156] DAMAGECOUNT value on done: 308494.0 [2023-02-25 13:34:23,404][36156] Sum rewards: 44.580, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.294', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.049', 'AMMO3': '0.118', 'AMMO4': '0.244', 'WEAPON5': '0.300', 'weapon5': '0.306', 'WEAPON4': '0.400', 'weapon2': '0.500', 'WEAPON3': '0.650', 'weapon4': '0.798', 'weapon3': '2.064', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '12.192', 'FRAGCOUNT': '36.000'} [2023-02-25 13:34:23,709][36156] DAMAGECOUNT value on done: 309246.0 [2023-02-25 13:34:23,710][36156] Sum rewards: 47.712, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.760', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon5': '0.156', 'AMMO4': '0.164', 'AMMO3': '0.247', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.370', 'WEAPON3': '1.450', 'weapon3': '2.840', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.990', 'FRAGCOUNT': '44.000'} [2023-02-25 13:34:23,719][36156] DAMAGECOUNT value on done: 303784.0 [2023-02-25 13:34:23,719][36156] Sum rewards: 55.173, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.166', 'weapon4': '0.194', 'HEALTH': '0.336', 'weapon2': '0.564', 'WEAPON3': '0.900', 'weapon3': '2.944', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.418', 'FRAGCOUNT': '45.000'} [2023-02-25 13:34:23,791][36138] Updated weights for policy 0, policy_version 41093 (0.0009) [2023-02-25 13:34:23,915][36142] DAMAGECOUNT value on done: 298884.0 [2023-02-25 13:34:23,916][36142] Sum rewards: 56.271, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.784', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.059', 'AMMO3': '0.217', 'weapon2': '0.240', 'weapon5': '0.278', 'AMMO4': '0.295', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.626', 'WEAPON3': '1.200', 'weapon3': '2.532', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '51.000'} [2023-02-25 13:34:24,025][36156] DAMAGECOUNT value on done: 303651.0 [2023-02-25 13:34:24,026][36156] Sum rewards: 45.569, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.750', 'AMMO5': '0.007', 'AMMO2': '0.039', 'AMMO4': '0.193', 'weapon2': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.206', 'AMMO3': '0.221', 'weapon4': '0.374', 'WEAPON3': '1.350', 'weapon3': '2.866', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.584', 'FRAGCOUNT': '40.000'} [2023-02-25 13:34:24,201][36142] DAMAGECOUNT value on done: 296720.0 [2023-02-25 13:34:24,201][36142] Sum rewards: 54.418, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.538', 'AMMO5': '0.022', 'AMMO2': '0.044', 'weapon5': '0.128', 'AMMO3': '0.201', 'AMMO4': '0.221', 'weapon4': '0.266', 'weapon2': '0.290', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '3.010', 'weapon3': '3.016', 'DAMAGECOUNT': '14.607', 'FRAGCOUNT': '48.500'} [2023-02-25 13:34:24,239][36142] DAMAGECOUNT value on done: 302209.0 [2023-02-25 13:34:24,239][36142] Sum rewards: 47.867, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.520', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.154', 'WEAPON4': '0.250', 'weapon2': '0.542', 'weapon4': '0.874', 'WEAPON3': '1.000', 'weapon3': '2.378', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '11.724', 'FRAGCOUNT': '40.000'} [2023-02-25 13:34:24,525][36142] DAMAGECOUNT value on done: 308803.0 [2023-02-25 13:34:24,526][36142] Sum rewards: 55.960, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.678', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon7': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.136', 'AMMO4': '0.193', 'WEAPON7': '0.200', 'AMMO3': '0.206', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.450', 'weapon2': '0.458', 'WEAPON3': '1.200', 'weapon3': '2.440', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.845', 'FRAGCOUNT': '51.000'} [2023-02-25 13:34:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 168329216. Throughput: 0: 3356.8. Samples: 4573028. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:34:24,730][36114] Avg episode reward: [(0, '52.316')] [2023-02-25 13:34:26,865][36138] Updated weights for policy 0, policy_version 41103 (0.0009) [2023-02-25 13:34:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13426.5). Total num frames: 168394752. Throughput: 0: 3359.1. Samples: 4593204. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:34:29,729][36114] Avg episode reward: [(0, '52.316')] [2023-02-25 13:34:29,941][36138] Updated weights for policy 0, policy_version 41113 (0.0009) [2023-02-25 13:34:30,711][36142] Large shaping reward 2.577 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.045, -15.0), ('weapon5', 0.002)] [2023-02-25 13:34:33,063][36138] Updated weights for policy 0, policy_version 41123 (0.0009) [2023-02-25 13:34:33,953][36140] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 13:34:34,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13426.6). Total num frames: 168460288. Throughput: 0: 3351.5. Samples: 4613058. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:34:34,730][36114] Avg episode reward: [(0, '52.316')] [2023-02-25 13:34:35,303][36155] DAMAGECOUNT value on done: 303981.0 [2023-02-25 13:34:35,303][36155] Sum rewards: 38.048, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.842', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.033', 'WEAPON5': '0.050', 'weapon5': '0.070', 'weapon2': '0.162', 'AMMO3': '0.178', 'WEAPON4': '0.350', 'weapon4': '0.884', 'WEAPON3': '1.100', 'weapon3': '2.500', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '10.494', 'FRAGCOUNT': '34.500'} [2023-02-25 13:34:35,606][36155] DAMAGECOUNT value on done: 313175.0 [2023-02-25 13:34:35,606][36155] Sum rewards: 60.338, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.987', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.176', 'weapon5': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.350', 'weapon4': '0.684', 'WEAPON3': '1.000', 'weapon3': '2.436', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.051', 'FRAGCOUNT': '51.000'} [2023-02-25 13:34:35,627][36139] DAMAGECOUNT value on done: 306349.0 [2023-02-25 13:34:35,628][36139] Sum rewards: 62.246, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.775', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'AMMO4': '0.093', 'weapon4': '0.098', 'AMMO3': '0.178', 'weapon2': '0.190', 'WEAPON3': '1.200', 'HITCOUNT': '3.340', 'weapon3': '3.602', 'DAMAGECOUNT': '15.501', 'FRAGCOUNT': '51.000'} [2023-02-25 13:34:35,938][36139] DAMAGECOUNT value on done: 304379.0 [2023-02-25 13:34:35,938][36139] Sum rewards: 57.445, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.153', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon5': '0.148', 'AMMO3': '0.170', 'AMMO4': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.458', 'weapon2': '0.706', 'WEAPON3': '0.950', 'weapon3': '2.442', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.457', 'FRAGCOUNT': '47.000'} [2023-02-25 13:34:36,107][36155] DAMAGECOUNT value on done: 302466.0 [2023-02-25 13:34:36,107][36155] Sum rewards: 57.785, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.950', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.019', 'weapon5': '0.072', 'AMMO4': '0.093', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon2': '0.272', 'WEAPON4': '0.300', 'weapon4': '0.398', 'WEAPON3': '1.150', 'weapon3': '3.006', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.453', 'FRAGCOUNT': '50.000'} [2023-02-25 13:34:36,110][36139] DAMAGECOUNT value on done: 307278.0 [2023-02-25 13:34:36,111][36139] Sum rewards: 55.334, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.812', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO3': '0.165', 'AMMO4': '0.179', 'weapon5': '0.188', 'WEAPON5': '0.350', 'weapon2': '0.392', 'WEAPON4': '0.400', 'weapon4': '0.410', 'WEAPON3': '1.150', 'weapon3': '2.776', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.974', 'FRAGCOUNT': '47.000'} [2023-02-25 13:34:36,131][36138] Updated weights for policy 0, policy_version 41133 (0.0009) [2023-02-25 13:34:36,416][36155] DAMAGECOUNT value on done: 305835.0 [2023-02-25 13:34:36,416][36155] Sum rewards: 39.673, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.258', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.036', 'weapon5': '0.158', 'AMMO4': '0.180', 'AMMO3': '0.275', 'weapon2': '0.284', 'WEAPON5': '0.350', 'weapon4': '0.440', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'HITCOUNT': '2.540', 'weapon3': '2.708', 'DAMAGECOUNT': '12.135', 'FRAGCOUNT': '39.500'} [2023-02-25 13:34:36,423][36139] DAMAGECOUNT value on done: 306074.0 [2023-02-25 13:34:36,423][36139] Sum rewards: 30.215, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.310', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.066', 'AMMO3': '0.190', 'weapon5': '0.310', 'AMMO4': '0.329', 'weapon2': '0.330', 'WEAPON5': '0.600', 'WEAPON4': '0.950', 'WEAPON3': '1.100', 'weapon4': '1.252', 'weapon3': '1.596', 'HITCOUNT': '2.370', 'DAMAGECOUNT': '10.410', 'FRAGCOUNT': '31.500'} [2023-02-25 13:34:37,170][36157] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:34:37,986][36155] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-25 13:34:39,069][36156] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:34:39,156][36139] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:34:39,209][36138] Updated weights for policy 0, policy_version 41143 (0.0009) [2023-02-25 13:34:39,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13426.5). Total num frames: 168525824. Throughput: 0: 3351.7. Samples: 4623056. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:34:39,730][36114] Avg episode reward: [(0, '52.284')] [2023-02-25 13:34:40,138][36154] DAMAGECOUNT value on done: 310381.0 [2023-02-25 13:34:40,138][36154] Sum rewards: 53.277, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.408', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.170', 'AMMO3': '0.178', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'weapon4': '0.202', 'weapon2': '0.224', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '2.600', 'weapon3': '3.168', 'DAMAGECOUNT': '13.500', 'FRAGCOUNT': '46.500'} [2023-02-25 13:34:40,444][36154] DAMAGECOUNT value on done: 304111.0 [2023-02-25 13:34:40,444][36154] Sum rewards: 48.505, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.292', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.057', 'AMMO3': '0.136', 'AMMO4': '0.285', 'weapon5': '0.364', 'WEAPON5': '0.600', 'weapon2': '0.602', 'WEAPON4': '0.650', 'weapon4': '0.742', 'WEAPON3': '0.800', 'weapon3': '1.954', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.923', 'FRAGCOUNT': '42.000'} [2023-02-25 13:34:40,758][36154] DAMAGECOUNT value on done: 301599.0 [2023-02-25 13:34:40,758][36154] Sum rewards: 50.360, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.993', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.068', 'weapon5': '0.080', 'AMMO4': '0.102', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.512', 'WEAPON3': '1.050', 'HITCOUNT': '2.760', 'weapon3': '3.110', 'DAMAGECOUNT': '12.747', 'FRAGCOUNT': '43.000'} [2023-02-25 13:34:41,063][36154] DAMAGECOUNT value on done: 305573.0 [2023-02-25 13:34:41,063][36154] Sum rewards: 53.757, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.377', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.040', 'weapon5': '0.042', 'AMMO4': '0.093', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.388', 'WEAPON3': '1.350', 'HITCOUNT': '3.140', 'weapon3': '3.308', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '47.000'} [2023-02-25 13:34:41,364][36141] DAMAGECOUNT value on done: 310321.0 [2023-02-25 13:34:41,364][36141] Sum rewards: 71.166, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.772', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.110', 'weapon2': '0.182', 'WEAPON5': '0.200', 'AMMO4': '0.206', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon4': '0.364', 'WEAPON3': '1.250', 'weapon3': '3.140', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '61.000'} [2023-02-25 13:34:41,660][36141] DAMAGECOUNT value on done: 311370.0 [2023-02-25 13:34:41,660][36141] Sum rewards: 64.114, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.215', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO3': '0.268', 'weapon2': '0.294', 'WEAPON3': '1.600', 'HITCOUNT': '3.170', 'weapon3': '3.530', 'DAMAGECOUNT': '15.474', 'FRAGCOUNT': '57.000'} [2023-02-25 13:34:41,696][36141] DAMAGECOUNT value on done: 305163.0 [2023-02-25 13:34:41,697][36141] Sum rewards: 52.850, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.502', 'AMMO5': '0.018', 'AMMO2': '0.044', 'AMMO3': '0.124', 'weapon5': '0.216', 'AMMO4': '0.222', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.644', 'weapon4': '0.676', 'WEAPON3': '0.750', 'weapon3': '2.242', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.215', 'FRAGCOUNT': '43.000'} [2023-02-25 13:34:41,922][36157] DAMAGECOUNT value on done: 315615.0 [2023-02-25 13:34:41,922][36157] Sum rewards: 51.498, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.253', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.210', 'weapon5': '0.270', 'WEAPON4': '0.350', 'weapon2': '0.434', 'WEAPON5': '0.450', 'weapon4': '0.530', 'WEAPON3': '1.300', 'weapon3': '2.446', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.601', 'FRAGCOUNT': '45.000'} [2023-02-25 13:34:42,012][36141] DAMAGECOUNT value on done: 296617.0 [2023-02-25 13:34:42,013][36141] Sum rewards: 44.175, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.904', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.096', 'AMMO4': '0.097', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.216', 'WEAPON4': '0.300', 'weapon4': '0.670', 'WEAPON3': '1.300', 'weapon3': '2.558', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.495', 'FRAGCOUNT': '41.000'} [2023-02-25 13:34:42,221][36157] DAMAGECOUNT value on done: 309889.0 [2023-02-25 13:34:42,221][36157] Sum rewards: 48.941, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.327', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.044', 'AMMO3': '0.137', 'AMMO4': '0.222', 'weapon5': '0.250', 'weapon2': '0.394', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.684', 'WEAPON3': '0.800', 'weapon3': '2.328', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.230', 'FRAGCOUNT': '42.500'} [2023-02-25 13:34:42,237][36138] Updated weights for policy 0, policy_version 41153 (0.0009) [2023-02-25 13:34:42,243][36157] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 13:34:42,594][36140] DAMAGECOUNT value on done: 314898.0 [2023-02-25 13:34:42,595][36140] Sum rewards: 59.435, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.744', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.037', 'AMMO3': '0.148', 'AMMO4': '0.183', 'weapon5': '0.210', 'weapon2': '0.332', 'weapon4': '0.414', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'weapon3': '2.820', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.817', 'FRAGCOUNT': '50.000'} [2023-02-25 13:34:42,707][36157] DAMAGECOUNT value on done: 311079.0 [2023-02-25 13:34:42,707][36157] Sum rewards: 61.157, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.276', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'weapon2': '0.154', 'AMMO3': '0.270', 'WEAPON3': '1.650', 'HITCOUNT': '3.460', 'weapon3': '3.676', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '53.000'} [2023-02-25 13:34:42,910][36140] DAMAGECOUNT value on done: 305521.0 [2023-02-25 13:34:42,911][36140] Sum rewards: 55.862, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.850', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.078', 'AMMO4': '0.113', 'weapon4': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.434', 'WEAPON3': '1.300', 'weapon3': '3.170', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.856', 'FRAGCOUNT': '48.000'} [2023-02-25 13:34:43,018][36157] DAMAGECOUNT value on done: 314220.0 [2023-02-25 13:34:43,018][36157] Sum rewards: 64.023, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.852', 'AMMO5': '0.018', 'AMMO2': '0.042', 'weapon5': '0.114', 'weapon2': '0.188', 'AMMO4': '0.211', 'AMMO3': '0.235', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.440', 'WEAPON3': '1.350', 'weapon3': '2.980', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '56.500'} [2023-02-25 13:34:43,138][36140] DAMAGECOUNT value on done: 310338.0 [2023-02-25 13:34:43,138][36140] Sum rewards: 62.235, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.696', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.134', 'AMMO3': '0.223', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.746', 'WEAPON3': '1.400', 'weapon3': '2.550', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '54.000'} [2023-02-25 13:34:43,449][36140] DAMAGECOUNT value on done: 302917.0 [2023-02-25 13:34:43,449][36140] Sum rewards: 54.655, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.805', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.110', 'weapon2': '0.134', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'weapon4': '0.278', 'ARMOR': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '3.170', 'weapon3': '3.208', 'DAMAGECOUNT': '14.670', 'FRAGCOUNT': '49.000'} [2023-02-25 13:34:43,528][36156] DAMAGECOUNT value on done: 313504.0 [2023-02-25 13:34:43,529][36156] Sum rewards: 59.381, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.525', 'AMMO2': '0.005', 'AMMO5': '0.012', 'weapon4': '0.018', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'weapon5': '0.062', 'AMMO3': '0.170', 'WEAPON5': '0.250', 'weapon2': '0.480', 'WEAPON3': '1.100', 'HITCOUNT': '2.960', 'weapon3': '3.246', 'DAMAGECOUNT': '15.030', 'FRAGCOUNT': '48.000'} [2023-02-25 13:34:43,857][36156] DAMAGECOUNT value on done: 309324.0 [2023-02-25 13:34:43,857][36156] Sum rewards: 70.921, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.021', 'AMMO5': '0.014', 'AMMO2': '0.023', 'weapon5': '0.050', 'AMMO4': '0.112', 'AMMO3': '0.193', 'weapon2': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.316', 'WEAPON3': '1.200', 'weapon3': '3.170', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '60.000'} [2023-02-25 13:34:43,872][36156] DAMAGECOUNT value on done: 313768.0 [2023-02-25 13:34:43,873][36156] Sum rewards: 47.034, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.098', 'AMMO5': '0.024', 'AMMO2': '0.054', 'AMMO3': '0.178', 'weapon5': '0.188', 'AMMO4': '0.268', 'weapon4': '0.272', 'weapon2': '0.322', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'HITCOUNT': '2.890', 'weapon3': '2.920', 'DAMAGECOUNT': '13.566', 'FRAGCOUNT': '42.000'} [2023-02-25 13:34:44,091][36142] DAMAGECOUNT value on done: 303737.0 [2023-02-25 13:34:44,092][36142] Sum rewards: 63.187, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.097', 'ARMOR': '0.012', 'AMMO5': '0.018', 'AMMO2': '0.051', 'AMMO3': '0.167', 'weapon5': '0.228', 'AMMO4': '0.256', 'weapon2': '0.398', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.598', 'WEAPON3': '1.000', 'weapon3': '2.506', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.559', 'FRAGCOUNT': '54.000'} [2023-02-25 13:34:44,191][36156] DAMAGECOUNT value on done: 308485.0 [2023-02-25 13:34:44,191][36156] Sum rewards: 51.695, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.064', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.138', 'AMMO4': '0.151', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.312', 'weapon2': '0.350', 'WEAPON3': '1.400', 'weapon3': '2.856', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.502', 'FRAGCOUNT': '46.000'} [2023-02-25 13:34:44,399][36142] DAMAGECOUNT value on done: 307091.0 [2023-02-25 13:34:44,399][36142] Sum rewards: 58.598, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.800', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO3': '0.141', 'AMMO4': '0.176', 'weapon5': '0.184', 'weapon4': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.804', 'WEAPON3': '0.900', 'HITCOUNT': '2.560', 'weapon3': '2.596', 'DAMAGECOUNT': '14.646', 'FRAGCOUNT': '48.000'} [2023-02-25 13:34:44,423][36142] DAMAGECOUNT value on done: 301484.0 [2023-02-25 13:34:44,424][36142] Sum rewards: 55.896, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.785', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.146', 'AMMO3': '0.148', 'AMMO4': '0.156', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.404', 'weapon4': '0.456', 'WEAPON3': '0.900', 'weapon3': '2.658', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.292', 'FRAGCOUNT': '46.000'} [2023-02-25 13:34:44,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13426.6). Total num frames: 168595456. Throughput: 0: 3353.5. Samples: 4643262. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:34:44,729][36114] Avg episode reward: [(0, '53.607')] [2023-02-25 13:34:44,730][36142] DAMAGECOUNT value on done: 314323.0 [2023-02-25 13:34:44,730][36125] Saving new best policy, reward=53.607! [2023-02-25 13:34:44,730][36142] Sum rewards: 70.050, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.240', 'AMMO5': '0.014', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon5': '0.174', 'AMMO3': '0.183', 'weapon4': '0.212', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.062', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '61.000'} [2023-02-25 13:34:45,292][36138] Updated weights for policy 0, policy_version 41163 (0.0010) [2023-02-25 13:34:48,312][36138] Updated weights for policy 0, policy_version 41173 (0.0009) [2023-02-25 13:34:49,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13426.6). Total num frames: 168660992. Throughput: 0: 3356.2. Samples: 4663454. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:34:49,730][36114] Avg episode reward: [(0, '53.815')] [2023-02-25 13:34:49,733][36125] Saving new best policy, reward=53.815! [2023-02-25 13:34:51,389][36138] Updated weights for policy 0, policy_version 41183 (0.0008) [2023-02-25 13:34:54,430][36138] Updated weights for policy 0, policy_version 41193 (0.0009) [2023-02-25 13:34:54,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13426.6). Total num frames: 168726528. Throughput: 0: 3353.5. Samples: 4673504. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:34:54,729][36114] Avg episode reward: [(0, '53.815')] [2023-02-25 13:34:55,245][36155] DAMAGECOUNT value on done: 308146.0 [2023-02-25 13:34:55,245][36155] Sum rewards: 41.999, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.490', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.164', 'WEAPON5': '0.250', 'AMMO3': '0.269', 'WEAPON4': '0.350', 'weapon4': '0.628', 'weapon2': '0.706', 'WEAPON3': '1.600', 'weapon3': '2.234', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.240', 'FRAGCOUNT': '40.000'} [2023-02-25 13:34:55,520][36139] DAMAGECOUNT value on done: 311285.0 [2023-02-25 13:34:55,521][36139] Sum rewards: 56.132, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.176', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon5': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.253', 'weapon2': '0.290', 'weapon4': '0.646', 'WEAPON3': '1.500', 'weapon3': '2.558', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.808', 'FRAGCOUNT': '50.000'} [2023-02-25 13:34:55,561][36155] DAMAGECOUNT value on done: 318095.0 [2023-02-25 13:34:55,561][36155] Sum rewards: 53.009, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.260', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO4': '0.184', 'weapon2': '0.210', 'weapon5': '0.214', 'AMMO3': '0.217', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.636', 'WEAPON3': '1.350', 'weapon3': '2.632', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.670', 'FRAGCOUNT': '48.000'} [2023-02-25 13:34:55,828][36139] DAMAGECOUNT value on done: 308756.0 [2023-02-25 13:34:55,829][36139] Sum rewards: 56.031, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.216', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon4': '0.046', 'WEAPON4': '0.100', 'AMMO3': '0.179', 'weapon2': '0.252', 'WEAPON3': '1.150', 'HITCOUNT': '2.740', 'weapon3': '3.592', 'DAMAGECOUNT': '13.131', 'FRAGCOUNT': '49.000'} [2023-02-25 13:34:56,008][36155] DAMAGECOUNT value on done: 306781.0 [2023-02-25 13:34:56,008][36155] Sum rewards: 46.079, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.817', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.156', 'weapon2': '0.208', 'AMMO3': '0.274', 'WEAPON3': '1.650', 'HITCOUNT': '2.780', 'weapon3': '3.280', 'DAMAGECOUNT': '12.945', 'FRAGCOUNT': '43.000'} [2023-02-25 13:34:56,126][36139] DAMAGECOUNT value on done: 311766.0 [2023-02-25 13:34:56,127][36139] Sum rewards: 45.939, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.020', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO5': '0.012', 'AMMO4': '0.040', 'weapon5': '0.144', 'weapon2': '0.198', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.406', 'WEAPON3': '1.350', 'weapon3': '2.998', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.464', 'FRAGCOUNT': '40.000'} [2023-02-25 13:34:56,314][36155] DAMAGECOUNT value on done: 310477.0 [2023-02-25 13:34:56,314][36155] Sum rewards: 58.694, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.290', 'AMMO5': '0.020', 'AMMO2': '0.025', 'weapon5': '0.080', 'AMMO4': '0.126', 'AMMO3': '0.175', 'weapon4': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.528', 'WEAPON3': '1.150', 'HITCOUNT': '2.910', 'weapon3': '2.984', 'DAMAGECOUNT': '13.926', 'FRAGCOUNT': '51.000'} [2023-02-25 13:34:56,422][36139] DAMAGECOUNT value on done: 310788.0 [2023-02-25 13:34:56,422][36139] Sum rewards: 46.248, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-5.706', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.068', 'weapon5': '0.140', 'AMMO3': '0.294', 'weapon2': '0.296', 'AMMO4': '0.338', 'WEAPON5': '0.450', 'weapon4': '0.478', 'WEAPON4': '0.800', 'WEAPON3': '1.750', 'weapon3': '2.696', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.962', 'FRAGCOUNT': '48.000'} [2023-02-25 13:34:57,499][36138] Updated weights for policy 0, policy_version 41203 (0.0010) [2023-02-25 13:34:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 168796160. Throughput: 0: 3347.8. Samples: 4693534. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:34:59,730][36114] Avg episode reward: [(0, '53.835')] [2023-02-25 13:34:59,733][36125] Saving new best policy, reward=53.835! [2023-02-25 13:35:00,190][36154] DAMAGECOUNT value on done: 314294.0 [2023-02-25 13:35:00,190][36154] Sum rewards: 49.267, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.020', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.052', 'AMMO3': '0.116', 'AMMO4': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon7': '0.156', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.530', 'weapon4': '0.590', 'WEAPON3': '0.750', 'weapon3': '2.402', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '11.739', 'FRAGCOUNT': '40.000'} [2023-02-25 13:35:00,498][36154] DAMAGECOUNT value on done: 308477.0 [2023-02-25 13:35:00,498][36154] Sum rewards: 50.510, reward structure: {'DEATHCOUNT': '-15.000', 'ARMOR': '0.004', 'AMMO2': '0.012', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.202', 'weapon4': '0.206', 'weapon2': '0.280', 'HEALTH': '0.472', 'WEAPON3': '1.150', 'HITCOUNT': '2.820', 'weapon3': '3.374', 'DAMAGECOUNT': '12.828', 'FRAGCOUNT': '44.000'} [2023-02-25 13:35:00,585][36138] Updated weights for policy 0, policy_version 41213 (0.0009) [2023-02-25 13:35:00,822][36154] DAMAGECOUNT value on done: 306267.0 [2023-02-25 13:35:00,822][36154] Sum rewards: 49.380, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.948', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.114', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'weapon2': '0.222', 'AMMO3': '0.228', 'weapon4': '0.236', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '2.850', 'weapon3': '3.154', 'DAMAGECOUNT': '13.989', 'FRAGCOUNT': '45.000'} [2023-02-25 13:35:01,132][36154] DAMAGECOUNT value on done: 310965.0 [2023-02-25 13:35:01,132][36154] Sum rewards: 64.107, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.990', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO4': '0.187', 'AMMO3': '0.199', 'weapon5': '0.240', 'WEAPON5': '0.350', 'weapon2': '0.382', 'WEAPON4': '0.450', 'weapon4': '0.620', 'WEAPON3': '1.150', 'weapon3': '2.500', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.891', 'FRAGCOUNT': '56.000'} [2023-02-25 13:35:01,387][36141] DAMAGECOUNT value on done: 314976.0 [2023-02-25 13:35:01,388][36141] Sum rewards: 50.290, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.390', 'AMMO5': '0.023', 'AMMO2': '0.040', 'AMMO3': '0.172', 'AMMO4': '0.200', 'weapon5': '0.284', 'weapon2': '0.358', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'weapon4': '0.950', 'WEAPON3': '1.000', 'weapon3': '2.138', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '13.965', 'FRAGCOUNT': '45.500'} [2023-02-25 13:35:01,658][36141] DAMAGECOUNT value on done: 309498.0 [2023-02-25 13:35:01,658][36141] Sum rewards: 48.292, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.532', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'AMMO3': '0.155', 'weapon5': '0.160', 'AMMO4': '0.167', 'WEAPON4': '0.350', 'weapon2': '0.406', 'weapon4': '0.846', 'WEAPON3': '1.000', 'weapon3': '2.328', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.005', 'FRAGCOUNT': '41.000'} [2023-02-25 13:35:01,704][36141] DAMAGECOUNT value on done: 315756.0 [2023-02-25 13:35:01,705][36141] Sum rewards: 48.443, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.920', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon4': '0.110', 'weapon5': '0.140', 'AMMO4': '0.155', 'WEAPON5': '0.200', 'AMMO3': '0.274', 'WEAPON4': '0.300', 'weapon2': '0.536', 'WEAPON3': '1.500', 'HITCOUNT': '2.740', 'weapon3': '2.960', 'DAMAGECOUNT': '13.158', 'FRAGCOUNT': '45.000'} [2023-02-25 13:35:01,971][36141] DAMAGECOUNT value on done: 300984.0 [2023-02-25 13:35:01,972][36141] Sum rewards: 44.271, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.172', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.136', 'AMMO4': '0.154', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.273', 'weapon4': '0.286', 'weapon2': '0.404', 'WEAPON3': '1.550', 'HITCOUNT': '2.830', 'weapon3': '2.916', 'DAMAGECOUNT': '13.101', 'FRAGCOUNT': '41.500'} [2023-02-25 13:35:02,013][36157] DAMAGECOUNT value on done: 319648.0 [2023-02-25 13:35:02,014][36157] Sum rewards: 48.527, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.942', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.094', 'AMMO3': '0.171', 'AMMO4': '0.239', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.656', 'weapon4': '0.820', 'WEAPON3': '1.050', 'weapon3': '2.034', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.099', 'FRAGCOUNT': '42.000'} [2023-02-25 13:35:02,319][36157] DAMAGECOUNT value on done: 314631.0 [2023-02-25 13:35:02,319][36157] Sum rewards: 54.061, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.755', 'ARMOR': '0.004', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'weapon5': '0.162', 'AMMO4': '0.169', 'AMMO3': '0.191', 'weapon2': '0.266', 'weapon4': '0.330', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '2.942', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.226', 'FRAGCOUNT': '47.000'} [2023-02-25 13:35:02,626][36140] DAMAGECOUNT value on done: 319171.0 [2023-02-25 13:35:02,626][36140] Sum rewards: 45.111, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.460', 'ARMOR': '0.009', 'AMMO5': '0.018', 'AMMO2': '0.055', 'AMMO3': '0.165', 'weapon5': '0.208', 'AMMO4': '0.274', 'weapon2': '0.480', 'WEAPON5': '0.500', 'weapon4': '0.544', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.378', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '12.480', 'FRAGCOUNT': '39.000'} [2023-02-25 13:35:02,767][36157] DAMAGECOUNT value on done: 316095.0 [2023-02-25 13:35:02,768][36157] Sum rewards: 57.551, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.575', 'AMMO5': '0.008', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon5': '0.144', 'weapon2': '0.178', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.328', 'WEAPON3': '1.100', 'weapon3': '3.054', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '48.000'} [2023-02-25 13:35:02,934][36140] DAMAGECOUNT value on done: 310290.0 [2023-02-25 13:35:02,935][36140] Sum rewards: 51.216, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.657', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.118', 'AMMO3': '0.207', 'AMMO4': '0.245', 'weapon2': '0.246', 'WEAPON5': '0.300', 'weapon4': '0.338', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '2.890', 'weapon3': '3.056', 'DAMAGECOUNT': '14.307', 'FRAGCOUNT': '47.000'} [2023-02-25 13:35:03,074][36157] DAMAGECOUNT value on done: 318441.0 [2023-02-25 13:35:03,075][36157] Sum rewards: 51.119, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.144', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.142', 'weapon5': '0.174', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.530', 'weapon4': '0.738', 'WEAPON3': '0.850', 'weapon3': '2.380', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.663', 'FRAGCOUNT': '41.000'} [2023-02-25 13:35:03,121][36140] DAMAGECOUNT value on done: 313463.0 [2023-02-25 13:35:03,121][36140] Sum rewards: 35.574, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.554', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'weapon2': '0.146', 'AMMO4': '0.174', 'WEAPON4': '0.300', 'WEAPON3': '0.750', 'weapon4': '1.138', 'HITCOUNT': '2.180', 'weapon3': '2.218', 'DAMAGECOUNT': '9.375', 'FRAGCOUNT': '30.000'} [2023-02-25 13:35:03,430][36140] DAMAGECOUNT value on done: 307622.0 [2023-02-25 13:35:03,430][36140] Sum rewards: 50.124, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.667', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon5': '0.162', 'AMMO3': '0.180', 'AMMO4': '0.263', 'WEAPON5': '0.350', 'weapon2': '0.416', 'WEAPON4': '0.500', 'weapon4': '0.974', 'WEAPON3': '1.100', 'weapon3': '2.144', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '14.115', 'FRAGCOUNT': '43.000'} [2023-02-25 13:35:03,652][36138] Updated weights for policy 0, policy_version 41223 (0.0009) [2023-02-25 13:35:03,697][36156] DAMAGECOUNT value on done: 318374.0 [2023-02-25 13:35:03,697][36156] Sum rewards: 53.435, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.453', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.132', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon2': '0.308', 'WEAPON4': '0.400', 'weapon4': '0.726', 'WEAPON3': '1.500', 'weapon3': '2.520', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.610', 'FRAGCOUNT': '48.000'} [2023-02-25 13:35:04,006][36156] DAMAGECOUNT value on done: 313590.0 [2023-02-25 13:35:04,006][36156] Sum rewards: 50.048, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.917', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.147', 'weapon5': '0.178', 'AMMO3': '0.188', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.372', 'WEAPON3': '1.100', 'HITCOUNT': '2.740', 'weapon3': '2.912', 'DAMAGECOUNT': '12.798', 'FRAGCOUNT': '42.500'} [2023-02-25 13:35:04,018][36156] DAMAGECOUNT value on done: 318249.0 [2023-02-25 13:35:04,018][36156] Sum rewards: 45.614, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.315', 'AMMO2': '0.027', 'AMMO4': '0.136', 'WEAPON4': '0.200', 'weapon4': '0.206', 'weapon2': '0.242', 'AMMO3': '0.337', 'WEAPON3': '1.950', 'HITCOUNT': '2.910', 'weapon3': '3.228', 'DAMAGECOUNT': '13.443', 'FRAGCOUNT': '46.000'} [2023-02-25 13:35:04,196][36142] DAMAGECOUNT value on done: 307866.0 [2023-02-25 13:35:04,197][36142] Sum rewards: 47.681, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.060', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.130', 'AMMO4': '0.194', 'AMMO3': '0.204', 'weapon2': '0.276', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.354', 'WEAPON3': '1.250', 'HITCOUNT': '2.560', 'weapon3': '2.928', 'DAMAGECOUNT': '12.387', 'FRAGCOUNT': '43.000'} [2023-02-25 13:35:04,337][36156] DAMAGECOUNT value on done: 313083.0 [2023-02-25 13:35:04,337][36156] Sum rewards: 47.731, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.420', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.153', 'weapon5': '0.208', 'AMMO3': '0.216', 'weapon2': '0.274', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.580', 'WEAPON3': '1.300', 'weapon3': '2.660', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.794', 'FRAGCOUNT': '44.000'} [2023-02-25 13:35:04,490][36142] DAMAGECOUNT value on done: 312012.0 [2023-02-25 13:35:04,490][36142] Sum rewards: 62.382, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.163', 'AMMO5': '0.017', 'AMMO2': '0.030', 'weapon5': '0.146', 'AMMO4': '0.150', 'AMMO3': '0.179', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON4': '0.350', 'weapon4': '0.420', 'WEAPON3': '1.050', 'weapon3': '2.872', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.763', 'FRAGCOUNT': '54.000'} [2023-02-25 13:35:04,507][36142] DAMAGECOUNT value on done: 306008.0 [2023-02-25 13:35:04,508][36142] Sum rewards: 49.187, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.800', 'ARMOR': '0.008', 'AMMO5': '0.021', 'AMMO2': '0.051', 'AMMO3': '0.140', 'weapon5': '0.174', 'AMMO4': '0.253', 'weapon2': '0.406', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.876', 'WEAPON3': '0.900', 'weapon3': '2.306', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '13.572', 'FRAGCOUNT': '41.500'} [2023-02-25 13:35:04,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.4, 300 sec: 13426.5). Total num frames: 168861696. Throughput: 0: 3343.2. Samples: 4713440. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:35:04,730][36114] Avg episode reward: [(0, '52.570')] [2023-02-25 13:35:04,827][36142] DAMAGECOUNT value on done: 319371.0 [2023-02-25 13:35:04,828][36142] Sum rewards: 63.398, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.200', 'AMMO5': '0.012', 'AMMO2': '0.016', 'weapon5': '0.044', 'AMMO4': '0.080', 'weapon4': '0.086', 'WEAPON4': '0.150', 'AMMO3': '0.227', 'WEAPON5': '0.300', 'weapon2': '0.528', 'WEAPON3': '1.400', 'weapon3': '3.140', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.144', 'FRAGCOUNT': '54.000'} [2023-02-25 13:35:06,726][36138] Updated weights for policy 0, policy_version 41233 (0.0009) [2023-02-25 13:35:09,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 168927232. Throughput: 0: 3341.0. Samples: 4723372. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:35:09,729][36114] Avg episode reward: [(0, '52.507')] [2023-02-25 13:35:09,789][36138] Updated weights for policy 0, policy_version 41243 (0.0009) [2023-02-25 13:35:12,846][36138] Updated weights for policy 0, policy_version 41253 (0.0009) [2023-02-25 13:35:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13426.5). Total num frames: 168996864. Throughput: 0: 3343.9. Samples: 4743678. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:35:14,730][36114] Avg episode reward: [(0, '52.507')] [2023-02-25 13:35:15,368][36155] DAMAGECOUNT value on done: 312650.0 [2023-02-25 13:35:15,369][36155] Sum rewards: 58.511, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.292', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.074', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.294', 'weapon4': '0.298', 'WEAPON3': '1.250', 'HITCOUNT': '2.850', 'weapon3': '3.122', 'DAMAGECOUNT': '13.512', 'FRAGCOUNT': '50.000'} [2023-02-25 13:35:15,639][36139] DAMAGECOUNT value on done: 316484.0 [2023-02-25 13:35:15,640][36139] Sum rewards: 58.420, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.490', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO3': '0.252', 'weapon4': '0.254', 'weapon2': '0.286', 'WEAPON3': '1.500', 'weapon3': '3.180', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '51.000'} [2023-02-25 13:35:15,672][36155] DAMAGECOUNT value on done: 323100.0 [2023-02-25 13:35:15,672][36155] Sum rewards: 62.975, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.540', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.021', 'weapon5': '0.060', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'weapon4': '0.232', 'weapon2': '0.564', 'WEAPON3': '1.200', 'weapon3': '2.928', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.015', 'FRAGCOUNT': '53.000'} [2023-02-25 13:35:15,847][36138] Updated weights for policy 0, policy_version 41263 (0.0010) [2023-02-25 13:35:15,949][36139] DAMAGECOUNT value on done: 314272.0 [2023-02-25 13:35:15,949][36139] Sum rewards: 66.442, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.433', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.092', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'weapon2': '0.220', 'WEAPON4': '0.300', 'weapon4': '0.452', 'WEAPON3': '1.050', 'weapon3': '3.072', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.548', 'FRAGCOUNT': '55.000'} [2023-02-25 13:35:16,107][36155] DAMAGECOUNT value on done: 311492.0 [2023-02-25 13:35:16,107][36155] Sum rewards: 46.805, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.010', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO4': '0.162', 'weapon5': '0.190', 'AMMO3': '0.243', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.400', 'weapon2': '0.598', 'WEAPON3': '1.450', 'weapon3': '2.484', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.133', 'FRAGCOUNT': '43.000'} [2023-02-25 13:35:16,257][36139] DAMAGECOUNT value on done: 317113.0 [2023-02-25 13:35:16,257][36139] Sum rewards: 63.299, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.764', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.048', 'weapon5': '0.050', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon2': '0.340', 'WEAPON3': '1.400', 'HITCOUNT': '3.180', 'weapon3': '3.290', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '55.000'} [2023-02-25 13:35:16,430][36155] DAMAGECOUNT value on done: 315352.0 [2023-02-25 13:35:16,430][36155] Sum rewards: 51.824, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.740', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.064', 'weapon5': '0.064', 'AMMO4': '0.099', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.258', 'weapon2': '0.408', 'WEAPON3': '1.400', 'HITCOUNT': '3.010', 'weapon3': '3.210', 'DAMAGECOUNT': '14.625', 'FRAGCOUNT': '45.000'} [2023-02-25 13:35:16,561][36139] DAMAGECOUNT value on done: 315210.0 [2023-02-25 13:35:16,561][36139] Sum rewards: 56.309, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.392', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.044', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon4': '0.274', 'weapon2': '0.478', 'WEAPON3': '1.200', 'weapon3': '2.818', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.266', 'FRAGCOUNT': '50.000'} [2023-02-25 13:35:18,929][36138] Updated weights for policy 0, policy_version 41273 (0.0009) [2023-02-25 13:35:19,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13426.6). Total num frames: 169062400. Throughput: 0: 3347.6. Samples: 4763700. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:35:19,730][36114] Avg episode reward: [(0, '53.193')] [2023-02-25 13:35:19,733][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000041275_169062400.pth... [2023-02-25 13:35:19,788][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000040489_165842944.pth [2023-02-25 13:35:20,320][36154] DAMAGECOUNT value on done: 318856.0 [2023-02-25 13:35:20,321][36154] Sum rewards: 56.366, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.225', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'weapon5': '0.162', 'WEAPON5': '0.200', 'weapon4': '0.222', 'weapon2': '0.678', 'WEAPON3': '0.900', 'weapon3': '2.680', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.686', 'FRAGCOUNT': '46.000'} [2023-02-25 13:35:20,636][36154] DAMAGECOUNT value on done: 312938.0 [2023-02-25 13:35:20,636][36154] Sum rewards: 52.901, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.932', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon2': '0.146', 'weapon5': '0.148', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.468', 'WEAPON3': '1.150', 'HITCOUNT': '2.700', 'weapon3': '2.982', 'DAMAGECOUNT': '13.383', 'FRAGCOUNT': '45.000'} [2023-02-25 13:35:20,940][36154] DAMAGECOUNT value on done: 310539.0 [2023-02-25 13:35:20,941][36154] Sum rewards: 40.550, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-5.088', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO4': '0.178', 'weapon5': '0.196', 'AMMO3': '0.309', 'weapon4': '0.350', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.454', 'WEAPON3': '1.800', 'weapon3': '2.698', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.816', 'FRAGCOUNT': '42.000'} [2023-02-25 13:35:21,251][36154] DAMAGECOUNT value on done: 316470.0 [2023-02-25 13:35:21,252][36154] Sum rewards: 62.046, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.838', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.023', 'AMMO4': '0.112', 'weapon5': '0.156', 'weapon2': '0.212', 'AMMO3': '0.239', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.552', 'WEAPON3': '1.450', 'weapon3': '2.770', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.515', 'FRAGCOUNT': '53.000'} [2023-02-25 13:35:21,515][36141] DAMAGECOUNT value on done: 320047.0 [2023-02-25 13:35:21,516][36141] Sum rewards: 56.424, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.356', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.100', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'weapon2': '0.266', 'WEAPON4': '0.350', 'weapon4': '0.428', 'WEAPON3': '1.400', 'weapon3': '2.952', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.213', 'FRAGCOUNT': '48.000'} [2023-02-25 13:35:21,694][36141] DAMAGECOUNT value on done: 313739.0 [2023-02-25 13:35:21,694][36141] Sum rewards: 55.534, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.208', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.018', 'weapon5': '0.084', 'AMMO4': '0.091', 'AMMO3': '0.143', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.436', 'weapon2': '0.520', 'WEAPON3': '0.900', 'HITCOUNT': '2.750', 'weapon3': '2.760', 'DAMAGECOUNT': '12.723', 'FRAGCOUNT': '47.000'} [2023-02-25 13:35:21,817][36141] DAMAGECOUNT value on done: 320865.0 [2023-02-25 13:35:21,818][36141] Sum rewards: 57.895, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.620', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.021', 'weapon5': '0.088', 'AMMO4': '0.104', 'AMMO3': '0.151', 'WEAPON4': '0.300', 'weapon4': '0.300', 'weapon2': '0.320', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'HITCOUNT': '3.000', 'weapon3': '3.080', 'DAMAGECOUNT': '15.327', 'FRAGCOUNT': '46.500'} [2023-02-25 13:35:21,983][36138] Updated weights for policy 0, policy_version 41283 (0.0009) [2023-02-25 13:35:22,012][36141] DAMAGECOUNT value on done: 305024.0 [2023-02-25 13:35:22,013][36141] Sum rewards: 46.798, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.215', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.066', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon2': '0.314', 'weapon4': '0.374', 'WEAPON3': '1.300', 'HITCOUNT': '2.650', 'weapon3': '3.002', 'DAMAGECOUNT': '12.120', 'FRAGCOUNT': '42.000'} [2023-02-25 13:35:22,246][36157] DAMAGECOUNT value on done: 324619.0 [2023-02-25 13:35:22,247][36157] Sum rewards: 56.699, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.092', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.172', 'weapon5': '0.260', 'weapon2': '0.290', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.902', 'WEAPON3': '1.050', 'weapon3': '2.136', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.913', 'FRAGCOUNT': '48.500'} [2023-02-25 13:35:22,579][36157] DAMAGECOUNT value on done: 320521.0 [2023-02-25 13:35:22,580][36157] Sum rewards: 72.308, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.862', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.086', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'weapon4': '0.164', 'WEAPON4': '0.250', 'weapon2': '0.258', 'WEAPON3': '0.900', 'HITCOUNT': '3.270', 'weapon3': '3.368', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '58.000'} [2023-02-25 13:35:22,747][36140] DAMAGECOUNT value on done: 324081.0 [2023-02-25 13:35:22,748][36140] Sum rewards: 57.321, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.830', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.018', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.142', 'weapon4': '0.164', 'AMMO3': '0.212', 'WEAPON3': '1.250', 'HITCOUNT': '3.240', 'weapon3': '3.504', 'DAMAGECOUNT': '14.730', 'FRAGCOUNT': '49.000'} [2023-02-25 13:35:23,040][36157] DAMAGECOUNT value on done: 321223.0 [2023-02-25 13:35:23,041][36157] Sum rewards: 58.823, reward structure: {'DEATHCOUNT': '-10.500', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.042', 'AMMO3': '0.107', 'AMMO4': '0.211', 'weapon5': '0.300', 'WEAPON5': '0.350', 'HEALTH': '0.396', 'WEAPON4': '0.400', 'weapon2': '0.532', 'WEAPON3': '0.650', 'weapon4': '0.650', 'weapon3': '2.234', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.384', 'FRAGCOUNT': '45.000'} [2023-02-25 13:35:23,076][36140] DAMAGECOUNT value on done: 314588.0 [2023-02-25 13:35:23,076][36140] Sum rewards: 54.240, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.090', 'AMMO5': '0.024', 'AMMO2': '0.035', 'AMMO3': '0.145', 'AMMO4': '0.177', 'weapon5': '0.192', 'weapon2': '0.260', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '0.800', 'weapon4': '1.246', 'weapon3': '1.656', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '12.894', 'FRAGCOUNT': '48.000'} [2023-02-25 13:35:23,256][36140] DAMAGECOUNT value on done: 318160.0 [2023-02-25 13:35:23,256][36140] Sum rewards: 49.212, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.330', 'AMMO5': '0.021', 'AMMO2': '0.046', 'AMMO3': '0.146', 'weapon5': '0.178', 'AMMO4': '0.228', 'WEAPON5': '0.550', 'weapon2': '0.638', 'WEAPON4': '0.700', 'weapon4': '0.728', 'WEAPON3': '0.900', 'weapon3': '2.186', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.091', 'FRAGCOUNT': '43.000'} [2023-02-25 13:35:23,352][36157] DAMAGECOUNT value on done: 323749.0 [2023-02-25 13:35:23,353][36157] Sum rewards: 59.970, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.719', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon5': '0.188', 'AMMO3': '0.213', 'weapon2': '0.252', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.810', 'WEAPON3': '1.400', 'weapon3': '2.478', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.924', 'FRAGCOUNT': '53.000'} [2023-02-25 13:35:23,584][36140] DAMAGECOUNT value on done: 311969.0 [2023-02-25 13:35:23,584][36140] Sum rewards: 53.273, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.660', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.104', 'AMMO4': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'weapon4': '0.246', 'weapon2': '0.602', 'WEAPON3': '1.050', 'weapon3': '2.804', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.041', 'FRAGCOUNT': '44.000'} [2023-02-25 13:35:23,687][36156] DAMAGECOUNT value on done: 323019.0 [2023-02-25 13:35:23,688][36156] Sum rewards: 56.134, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.554', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.112', 'AMMO3': '0.159', 'AMMO4': '0.179', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.438', 'weapon4': '0.566', 'WEAPON3': '0.950', 'weapon3': '2.360', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.890', 'FRAGCOUNT': '46.000'} [2023-02-25 13:35:23,999][36156] DAMAGECOUNT value on done: 316664.0 [2023-02-25 13:35:24,000][36156] Sum rewards: 30.505, reward structure: {'DEATHCOUNT': '-6.750', 'ARMOR': '0.013', 'AMMO2': '0.017', 'AMMO3': '0.076', 'AMMO4': '0.083', 'weapon7': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HEALTH': '0.282', 'WEAPON3': '0.400', 'weapon2': '0.612', 'weapon4': '0.708', 'weapon3': '1.126', 'HITCOUNT': '1.730', 'DAMAGECOUNT': '7.422', 'FRAGCOUNT': '24.000'} [2023-02-25 13:35:24,012][36156] DAMAGECOUNT value on done: 323418.0 [2023-02-25 13:35:24,013][36156] Sum rewards: 55.510, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.272', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.174', 'weapon4': '0.204', 'AMMO3': '0.275', 'WEAPON3': '1.700', 'HITCOUNT': '3.000', 'weapon3': '3.316', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '50.000'} [2023-02-25 13:35:24,242][36142] DAMAGECOUNT value on done: 313296.0 [2023-02-25 13:35:24,243][36142] Sum rewards: 64.225, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.388', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.110', 'AMMO4': '0.124', 'weapon2': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.254', 'AMMO3': '0.258', 'WEAPON3': '1.500', 'weapon3': '3.122', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '57.000'} [2023-02-25 13:35:24,318][36156] DAMAGECOUNT value on done: 317029.0 [2023-02-25 13:35:24,318][36156] Sum rewards: 36.985, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.570', 'AMMO5': '0.021', 'AMMO2': '0.054', 'AMMO3': '0.167', 'AMMO4': '0.271', 'weapon5': '0.294', 'weapon2': '0.416', 'WEAPON5': '0.650', 'weapon4': '0.692', 'WEAPON4': '0.750', 'WEAPON3': '1.000', 'weapon3': '1.982', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '11.838', 'FRAGCOUNT': '35.000'} [2023-02-25 13:35:24,546][36142] DAMAGECOUNT value on done: 311193.0 [2023-02-25 13:35:24,546][36142] Sum rewards: 65.462, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.526', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.145', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.432', 'weapon4': '0.540', 'WEAPON3': '1.300', 'weapon3': '2.648', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '55.000'} [2023-02-25 13:35:24,555][36142] DAMAGECOUNT value on done: 316573.0 [2023-02-25 13:35:24,556][36142] Sum rewards: 54.056, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.200', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.023', 'AMMO4': '0.112', 'AMMO3': '0.151', 'weapon5': '0.220', 'weapon4': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.458', 'WEAPON3': '1.000', 'HITCOUNT': '2.740', 'weapon3': '2.848', 'DAMAGECOUNT': '13.683', 'FRAGCOUNT': '46.000'} [2023-02-25 13:35:24,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13426.6). Total num frames: 169132032. Throughput: 0: 3348.6. Samples: 4773742. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:35:24,729][36114] Avg episode reward: [(0, '53.732')] [2023-02-25 13:35:24,864][36142] DAMAGECOUNT value on done: 324287.0 [2023-02-25 13:35:24,865][36142] Sum rewards: 54.738, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.674', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.152', 'AMMO4': '0.172', 'AMMO3': '0.181', 'WEAPON5': '0.250', 'weapon4': '0.290', 'weapon2': '0.388', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.900', 'weapon3': '2.934', 'DAMAGECOUNT': '14.748', 'FRAGCOUNT': '48.000'} [2023-02-25 13:35:25,040][36138] Updated weights for policy 0, policy_version 41293 (0.0009) [2023-02-25 13:35:25,272][36140] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 13:35:28,035][36138] Updated weights for policy 0, policy_version 41303 (0.0009) [2023-02-25 13:35:29,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13426.5). Total num frames: 169197568. Throughput: 0: 3350.1. Samples: 4794016. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:35:29,729][36114] Avg episode reward: [(0, '53.717')] [2023-02-25 13:35:31,100][36138] Updated weights for policy 0, policy_version 41313 (0.0009) [2023-02-25 13:35:34,146][36138] Updated weights for policy 0, policy_version 41323 (0.0010) [2023-02-25 13:35:34,583][36139] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 13:35:34,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 169263104. Throughput: 0: 3350.7. Samples: 4814236. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:35:34,730][36114] Avg episode reward: [(0, '53.717')] [2023-02-25 13:35:35,364][36155] DAMAGECOUNT value on done: 317538.0 [2023-02-25 13:35:35,364][36155] Sum rewards: 59.606, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.185', 'AMMO2': '0.003', 'AMMO4': '0.012', 'WEAPON4': '0.050', 'weapon4': '0.140', 'AMMO3': '0.232', 'weapon2': '0.432', 'WEAPON3': '1.450', 'HITCOUNT': '3.020', 'weapon3': '3.288', 'DAMAGECOUNT': '14.664', 'FRAGCOUNT': '52.000'} [2023-02-25 13:35:35,530][36139] DAMAGECOUNT value on done: 321001.0 [2023-02-25 13:35:35,531][36139] Sum rewards: 58.660, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.656', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'weapon5': '0.106', 'AMMO3': '0.140', 'WEAPON5': '0.250', 'weapon2': '0.678', 'WEAPON3': '0.900', 'HITCOUNT': '2.660', 'weapon3': '3.006', 'DAMAGECOUNT': '13.092', 'FRAGCOUNT': '48.000'} [2023-02-25 13:35:35,678][36155] DAMAGECOUNT value on done: 327014.0 [2023-02-25 13:35:35,678][36155] Sum rewards: 44.339, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.872', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.055', 'AMMO3': '0.151', 'weapon5': '0.200', 'WEAPON5': '0.250', 'AMMO4': '0.274', 'weapon2': '0.292', 'WEAPON4': '0.400', 'weapon4': '0.846', 'WEAPON3': '0.850', 'weapon3': '2.446', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '11.742', 'FRAGCOUNT': '37.500'} [2023-02-25 13:35:35,843][36139] DAMAGECOUNT value on done: 319333.0 [2023-02-25 13:35:35,843][36139] Sum rewards: 61.788, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.305', 'AMMO5': '0.013', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.108', 'AMMO3': '0.153', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.356', 'weapon2': '0.586', 'WEAPON3': '0.950', 'weapon3': '2.700', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '15.183', 'FRAGCOUNT': '50.000'} [2023-02-25 13:35:36,063][36155] DAMAGECOUNT value on done: 316532.0 [2023-02-25 13:35:36,063][36155] Sum rewards: 61.842, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.684', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.021', 'weapon5': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.110', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'weapon2': '0.290', 'WEAPON3': '1.200', 'HITCOUNT': '2.880', 'weapon3': '3.320', 'DAMAGECOUNT': '15.120', 'FRAGCOUNT': '52.000'} [2023-02-25 13:35:36,156][36139] DAMAGECOUNT value on done: 321507.0 [2023-02-25 13:35:36,157][36139] Sum rewards: 44.630, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.208', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'weapon5': '0.204', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'weapon2': '0.318', 'weapon4': '0.438', 'WEAPON3': '1.350', 'HITCOUNT': '2.680', 'weapon3': '2.776', 'DAMAGECOUNT': '13.182', 'FRAGCOUNT': '40.000'} [2023-02-25 13:35:36,374][36155] DAMAGECOUNT value on done: 320328.0 [2023-02-25 13:35:36,374][36155] Sum rewards: 54.859, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.208', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.098', 'WEAPON4': '0.150', 'weapon4': '0.170', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'weapon2': '0.412', 'WEAPON3': '1.100', 'HITCOUNT': '3.100', 'weapon3': '3.110', 'DAMAGECOUNT': '14.928', 'FRAGCOUNT': '45.000'} [2023-02-25 13:35:36,473][36139] DAMAGECOUNT value on done: 319613.0 [2023-02-25 13:35:36,474][36139] Sum rewards: 44.464, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.531', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.031', 'weapon5': '0.114', 'AMMO4': '0.155', 'AMMO3': '0.213', 'weapon2': '0.318', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.432', 'WEAPON3': '1.300', 'weapon3': '2.820', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.209', 'FRAGCOUNT': '41.000'} [2023-02-25 13:35:37,215][36138] Updated weights for policy 0, policy_version 41333 (0.0009) [2023-02-25 13:35:39,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 169332736. Throughput: 0: 3345.9. Samples: 4824070. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:35:39,730][36114] Avg episode reward: [(0, '53.800')] [2023-02-25 13:35:40,289][36138] Updated weights for policy 0, policy_version 41343 (0.0009) [2023-02-25 13:35:40,299][36154] DAMAGECOUNT value on done: 323516.0 [2023-02-25 13:35:40,299][36154] Sum rewards: 53.328, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.087', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.066', 'AMMO3': '0.165', 'weapon2': '0.292', 'weapon5': '0.314', 'AMMO4': '0.328', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '0.950', 'weapon4': '1.008', 'weapon3': '2.034', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.980', 'FRAGCOUNT': '46.500'} [2023-02-25 13:35:40,600][36154] DAMAGECOUNT value on done: 318078.0 [2023-02-25 13:35:40,601][36154] Sum rewards: 59.016, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.742', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.162', 'AMMO3': '0.205', 'weapon4': '0.278', 'WEAPON4': '0.300', 'weapon2': '0.318', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.896', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '52.000'} [2023-02-25 13:35:40,925][36154] DAMAGECOUNT value on done: 315424.0 [2023-02-25 13:35:40,926][36154] Sum rewards: 51.977, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.335', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon5': '0.136', 'AMMO3': '0.215', 'AMMO4': '0.238', 'weapon2': '0.382', 'weapon4': '0.412', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.654', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.655', 'FRAGCOUNT': '46.000'} [2023-02-25 13:35:41,233][36154] DAMAGECOUNT value on done: 321229.0 [2023-02-25 13:35:41,234][36154] Sum rewards: 51.667, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.506', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'WEAPON4': '0.200', 'AMMO3': '0.267', 'weapon4': '0.298', 'weapon2': '0.366', 'ARMOR': '0.482', 'WEAPON3': '1.500', 'weapon3': '3.026', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.277', 'FRAGCOUNT': '46.000'} [2023-02-25 13:35:41,576][36141] DAMAGECOUNT value on done: 324966.0 [2023-02-25 13:35:41,577][36141] Sum rewards: 53.063, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.356', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon5': '0.042', 'AMMO4': '0.110', 'weapon4': '0.188', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.620', 'WEAPON3': '1.200', 'weapon3': '2.932', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.757', 'FRAGCOUNT': '44.000'} [2023-02-25 13:35:41,768][36141] DAMAGECOUNT value on done: 318053.0 [2023-02-25 13:35:41,768][36141] Sum rewards: 50.083, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.246', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon5': '0.056', 'AMMO4': '0.111', 'WEAPON5': '0.200', 'weapon4': '0.216', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.288', 'WEAPON3': '1.500', 'HITCOUNT': '2.810', 'weapon3': '3.192', 'DAMAGECOUNT': '12.942', 'FRAGCOUNT': '46.000'} [2023-02-25 13:35:41,898][36141] DAMAGECOUNT value on done: 325527.0 [2023-02-25 13:35:41,898][36141] Sum rewards: 54.550, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.950', 'AMMO5': '0.015', 'AMMO2': '0.048', 'AMMO3': '0.209', 'AMMO4': '0.240', 'weapon5': '0.284', 'weapon2': '0.360', 'weapon4': '0.476', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.562', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.986', 'FRAGCOUNT': '50.500'} [2023-02-25 13:35:42,090][36141] DAMAGECOUNT value on done: 307604.0 [2023-02-25 13:35:42,091][36141] Sum rewards: 26.931, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.540', 'AMMO5': '0.017', 'AMMO2': '0.033', 'AMMO3': '0.131', 'AMMO4': '0.164', 'weapon5': '0.260', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.456', 'weapon4': '0.632', 'WEAPON3': '0.750', 'HITCOUNT': '1.710', 'weapon3': '1.928', 'DAMAGECOUNT': '7.740', 'FRAGCOUNT': '25.000'} [2023-02-25 13:35:42,382][36157] DAMAGECOUNT value on done: 329568.0 [2023-02-25 13:35:42,382][36157] Sum rewards: 56.121, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.056', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.039', 'AMMO3': '0.178', 'AMMO4': '0.193', 'weapon5': '0.260', 'weapon2': '0.334', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.494', 'WEAPON3': '1.000', 'weapon3': '2.546', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.847', 'FRAGCOUNT': '48.000'} [2023-02-25 13:35:42,697][36157] DAMAGECOUNT value on done: 326022.0 [2023-02-25 13:35:42,697][36157] Sum rewards: 71.522, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.052', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.011', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'weapon4': '0.144', 'AMMO3': '0.193', 'weapon2': '0.416', 'WEAPON3': '1.200', 'weapon3': '3.244', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '60.000'} [2023-02-25 13:35:42,917][36140] DAMAGECOUNT value on done: 329301.0 [2023-02-25 13:35:42,918][36140] Sum rewards: 57.832, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.930', 'AMMO5': '0.017', 'AMMO2': '0.027', 'AMMO4': '0.137', 'weapon4': '0.146', 'AMMO3': '0.213', 'weapon5': '0.256', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.006', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '49.000'} [2023-02-25 13:35:43,154][36157] DAMAGECOUNT value on done: 326137.0 [2023-02-25 13:35:43,155][36157] Sum rewards: 57.630, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.512', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon5': '0.094', 'AMMO3': '0.149', 'AMMO4': '0.221', 'weapon2': '0.266', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.614', 'WEAPON3': '1.050', 'weapon3': '2.802', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.742', 'FRAGCOUNT': '48.000'} [2023-02-25 13:35:43,236][36140] DAMAGECOUNT value on done: 319206.0 [2023-02-25 13:35:43,237][36140] Sum rewards: 39.045, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.700', 'AMMO5': '0.021', 'AMMO2': '0.060', 'AMMO3': '0.186', 'AMMO4': '0.300', 'weapon2': '0.362', 'weapon5': '0.366', 'WEAPON5': '0.650', 'WEAPON4': '0.800', 'weapon4': '1.044', 'WEAPON3': '1.100', 'weapon3': '1.826', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '13.569', 'FRAGCOUNT': '37.000'} [2023-02-25 13:35:43,407][36138] Updated weights for policy 0, policy_version 41353 (0.0009) [2023-02-25 13:35:43,439][36140] DAMAGECOUNT value on done: 323239.0 [2023-02-25 13:35:43,439][36140] Sum rewards: 58.051, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.930', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.146', 'weapon4': '0.160', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.526', 'WEAPON3': '1.100', 'HITCOUNT': '2.810', 'weapon3': '2.972', 'DAMAGECOUNT': '15.237', 'FRAGCOUNT': '49.000'} [2023-02-25 13:35:43,468][36157] DAMAGECOUNT value on done: 327496.0 [2023-02-25 13:35:43,468][36157] Sum rewards: 45.273, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.070', 'AMMO5': '0.008', 'AMMO2': '0.035', 'AMMO3': '0.103', 'weapon5': '0.138', 'AMMO4': '0.175', 'WEAPON5': '0.300', 'WEAPON4': '0.600', 'WEAPON3': '0.600', 'weapon2': '0.854', 'weapon4': '1.164', 'weapon3': '1.464', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '11.241', 'FRAGCOUNT': '38.000'} [2023-02-25 13:35:43,650][36156] DAMAGECOUNT value on done: 327579.0 [2023-02-25 13:35:43,651][36156] Sum rewards: 61.177, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.710', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'weapon5': '0.048', 'AMMO4': '0.118', 'AMMO3': '0.187', 'weapon4': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.542', 'WEAPON3': '1.100', 'HITCOUNT': '2.970', 'weapon3': '2.984', 'DAMAGECOUNT': '13.680', 'FRAGCOUNT': '53.000'} [2023-02-25 13:35:43,758][36140] DAMAGECOUNT value on done: 316644.0 [2023-02-25 13:35:43,759][36140] Sum rewards: 55.223, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.290', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon2': '0.152', 'weapon4': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.259', 'WEAPON3': '1.500', 'HITCOUNT': '3.150', 'weapon3': '3.476', 'DAMAGECOUNT': '14.025', 'FRAGCOUNT': '51.000'} [2023-02-25 13:35:43,891][36156] DAMAGECOUNT value on done: 328367.0 [2023-02-25 13:35:43,891][36156] Sum rewards: 62.450, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.960', 'AMMO5': '0.006', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon4': '0.214', 'weapon2': '0.416', 'WEAPON3': '1.150', 'HITCOUNT': '3.110', 'weapon3': '3.146', 'DAMAGECOUNT': '14.847', 'FRAGCOUNT': '51.500'} [2023-02-25 13:35:43,981][36156] DAMAGECOUNT value on done: 320331.0 [2023-02-25 13:35:43,982][36156] Sum rewards: 35.726, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.376', 'ARMOR': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.155', 'AMMO3': '0.199', 'WEAPON4': '0.350', 'weapon4': '0.464', 'weapon2': '0.616', 'WEAPON3': '1.150', 'HITCOUNT': '2.340', 'weapon3': '2.584', 'DAMAGECOUNT': '11.001', 'FRAGCOUNT': '33.000'} [2023-02-25 13:35:44,208][36156] DAMAGECOUNT value on done: 321027.0 [2023-02-25 13:35:44,209][36156] Sum rewards: 42.604, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.560', 'AMMO5': '0.006', 'AMMO2': '0.040', 'weapon5': '0.104', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'AMMO3': '0.215', 'WEAPON4': '0.400', 'weapon4': '0.448', 'weapon2': '0.574', 'WEAPON3': '1.300', 'weapon3': '2.580', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '11.994', 'FRAGCOUNT': '38.000'} [2023-02-25 13:35:44,335][36142] DAMAGECOUNT value on done: 317593.0 [2023-02-25 13:35:44,335][36142] Sum rewards: 49.663, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.688', 'AMMO2': '0.007', 'AMMO5': '0.012', 'AMMO4': '0.033', 'weapon5': '0.070', 'WEAPON4': '0.150', 'weapon4': '0.164', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.428', 'WEAPON3': '1.400', 'HITCOUNT': '2.800', 'weapon3': '3.194', 'DAMAGECOUNT': '12.891', 'FRAGCOUNT': '44.500'} [2023-02-25 13:35:44,651][36142] DAMAGECOUNT value on done: 315953.0 [2023-02-25 13:35:44,652][36142] Sum rewards: 50.721, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.038', 'AMMO5': '0.009', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.030', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.283', 'weapon2': '0.290', 'WEAPON3': '1.750', 'HITCOUNT': '3.100', 'weapon3': '3.464', 'DAMAGECOUNT': '13.701', 'FRAGCOUNT': '48.000'} [2023-02-25 13:35:44,661][36142] DAMAGECOUNT value on done: 321793.0 [2023-02-25 13:35:44,661][36142] Sum rewards: 58.550, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.112', 'AMMO5': '0.009', 'AMMO2': '0.014', 'weapon5': '0.036', 'AMMO4': '0.067', 'weapon2': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.272', 'weapon4': '0.330', 'WEAPON3': '1.650', 'weapon3': '3.200', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '53.000'} [2023-02-25 13:35:44,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 169398272. Throughput: 0: 3344.7. Samples: 4844044. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:35:44,730][36114] Avg episode reward: [(0, '53.258')] [2023-02-25 13:35:44,975][36142] DAMAGECOUNT value on done: 328686.0 [2023-02-25 13:35:44,975][36142] Sum rewards: 50.861, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.996', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.150', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'weapon4': '0.346', 'weapon2': '0.948', 'WEAPON3': '1.050', 'weapon3': '2.462', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.197', 'FRAGCOUNT': '44.000'} [2023-02-25 13:35:45,274][36157] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.021, -7.0), ('weapon5', 0.002)] [2023-02-25 13:35:46,488][36138] Updated weights for policy 0, policy_version 41363 (0.0009) [2023-02-25 13:35:47,461][36141] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:35:49,595][36138] Updated weights for policy 0, policy_version 41373 (0.0009) [2023-02-25 13:35:49,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 169463808. Throughput: 0: 3344.6. Samples: 4863948. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:35:49,730][36114] Avg episode reward: [(0, '53.135')] [2023-02-25 13:35:52,634][36138] Updated weights for policy 0, policy_version 41383 (0.0010) [2023-02-25 13:35:54,730][36114] Fps is (10 sec: 13106.7, 60 sec: 13380.2, 300 sec: 13398.8). Total num frames: 169529344. Throughput: 0: 3345.1. Samples: 4873904. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:35:54,731][36114] Avg episode reward: [(0, '53.135')] [2023-02-25 13:35:55,588][36155] DAMAGECOUNT value on done: 321878.0 [2023-02-25 13:35:55,589][36155] Sum rewards: 43.148, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.776', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.052', 'weapon5': '0.182', 'AMMO3': '0.197', 'WEAPON5': '0.250', 'AMMO4': '0.262', 'weapon2': '0.292', 'WEAPON4': '0.500', 'weapon4': '0.602', 'WEAPON3': '1.200', 'weapon3': '2.652', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.020', 'FRAGCOUNT': '40.000'} [2023-02-25 13:35:55,675][36138] Updated weights for policy 0, policy_version 41393 (0.0009) [2023-02-25 13:35:55,726][36139] DAMAGECOUNT value on done: 325666.0 [2023-02-25 13:35:55,726][36139] Sum rewards: 51.561, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.662', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.148', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.316', 'weapon4': '0.484', 'WEAPON3': '1.350', 'weapon3': '2.780', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.995', 'FRAGCOUNT': '47.000'} [2023-02-25 13:35:55,906][36155] DAMAGECOUNT value on done: 331596.0 [2023-02-25 13:35:55,907][36155] Sum rewards: 53.294, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.246', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon5': '0.188', 'AMMO3': '0.210', 'weapon2': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.558', 'WEAPON3': '1.250', 'weapon3': '2.510', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.746', 'FRAGCOUNT': '48.000'} [2023-02-25 13:35:56,017][36139] DAMAGECOUNT value on done: 324227.0 [2023-02-25 13:35:56,018][36139] Sum rewards: 51.771, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.010', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.210', 'AMMO3': '0.234', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON4': '0.350', 'weapon4': '0.476', 'WEAPON3': '1.450', 'weapon3': '2.702', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '47.000'} [2023-02-25 13:35:56,263][36155] DAMAGECOUNT value on done: 321755.0 [2023-02-25 13:35:56,263][36155] Sum rewards: 60.077, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.775', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO4': '0.179', 'AMMO3': '0.231', 'weapon2': '0.302', 'WEAPON4': '0.400', 'weapon4': '0.516', 'WEAPON3': '1.250', 'weapon3': '2.844', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.669', 'FRAGCOUNT': '54.000'} [2023-02-25 13:35:56,319][36139] DAMAGECOUNT value on done: 326364.0 [2023-02-25 13:35:56,319][36139] Sum rewards: 53.272, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.675', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon5': '0.140', 'AMMO3': '0.162', 'AMMO4': '0.225', 'WEAPON5': '0.400', 'weapon2': '0.424', 'WEAPON4': '0.600', 'weapon4': '0.670', 'WEAPON3': '1.050', 'weapon3': '2.454', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.571', 'FRAGCOUNT': '47.000'} [2023-02-25 13:35:56,574][36155] DAMAGECOUNT value on done: 324774.0 [2023-02-25 13:35:56,574][36155] Sum rewards: 49.507, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.732', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.046', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'AMMO3': '0.216', 'weapon2': '0.252', 'WEAPON3': '1.300', 'HITCOUNT': '2.790', 'weapon3': '3.434', 'DAMAGECOUNT': '13.338', 'FRAGCOUNT': '43.000'} [2023-02-25 13:35:56,629][36139] DAMAGECOUNT value on done: 324640.0 [2023-02-25 13:35:56,630][36139] Sum rewards: 58.360, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.624', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.130', 'AMMO4': '0.136', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'weapon2': '0.298', 'WEAPON4': '0.300', 'weapon4': '0.556', 'WEAPON3': '0.950', 'weapon3': '2.416', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.982', 'FRAGCOUNT': '48.000'} [2023-02-25 13:35:58,733][36138] Updated weights for policy 0, policy_version 41403 (0.0009) [2023-02-25 13:35:59,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.2, 300 sec: 13412.7). Total num frames: 169598976. Throughput: 0: 3342.2. Samples: 4894076. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:35:59,730][36114] Avg episode reward: [(0, '52.911')] [2023-02-25 13:36:00,551][36154] DAMAGECOUNT value on done: 328708.0 [2023-02-25 13:36:00,551][36154] Sum rewards: 64.229, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.922', 'AMMO5': '0.015', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon5': '0.154', 'AMMO3': '0.197', 'weapon2': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.310', 'WEAPON3': '1.200', 'weapon3': '3.080', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.576', 'FRAGCOUNT': '55.000'} [2023-02-25 13:36:00,859][36154] DAMAGECOUNT value on done: 322080.0 [2023-02-25 13:36:00,859][36154] Sum rewards: 48.202, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.480', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.090', 'AMMO4': '0.122', 'AMMO3': '0.138', 'WEAPON5': '0.200', 'WEAPON4': '0.450', 'weapon4': '0.604', 'WEAPON3': '0.850', 'weapon2': '0.884', 'weapon3': '2.218', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.006', 'FRAGCOUNT': '42.000'} [2023-02-25 13:36:01,166][36154] DAMAGECOUNT value on done: 319504.0 [2023-02-25 13:36:01,166][36154] Sum rewards: 46.432, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.612', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.114', 'AMMO4': '0.120', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.262', 'weapon2': '0.408', 'WEAPON3': '1.050', 'HITCOUNT': '2.680', 'weapon3': '3.014', 'DAMAGECOUNT': '12.240', 'FRAGCOUNT': '40.000'} [2023-02-25 13:36:01,467][36154] DAMAGECOUNT value on done: 326755.0 [2023-02-25 13:36:01,468][36154] Sum rewards: 59.698, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.598', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.068', 'AMMO4': '0.092', 'WEAPON5': '0.200', 'weapon2': '0.236', 'AMMO3': '0.286', 'WEAPON4': '0.300', 'weapon4': '0.352', 'WEAPON3': '1.750', 'weapon3': '3.054', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '55.000'} [2023-02-25 13:36:01,861][36138] Updated weights for policy 0, policy_version 41413 (0.0009) [2023-02-25 13:36:01,890][36141] DAMAGECOUNT value on done: 330112.0 [2023-02-25 13:36:01,891][36141] Sum rewards: 62.623, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.151', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.015', 'weapon5': '0.038', 'WEAPON5': '0.050', 'weapon4': '0.052', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'weapon2': '0.394', 'WEAPON3': '1.200', 'HITCOUNT': '3.330', 'weapon3': '3.332', 'DAMAGECOUNT': '15.438', 'FRAGCOUNT': '53.000'} [2023-02-25 13:36:02,161][36141] DAMAGECOUNT value on done: 323346.0 [2023-02-25 13:36:02,161][36141] Sum rewards: 67.247, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.133', 'AMMO2': '0.012', 'AMMO5': '0.012', 'AMMO4': '0.060', 'weapon4': '0.094', 'WEAPON4': '0.100', 'weapon5': '0.112', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.250', 'weapon3': '3.120', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '57.000'} [2023-02-25 13:36:02,205][36141] DAMAGECOUNT value on done: 329878.0 [2023-02-25 13:36:02,205][36141] Sum rewards: 47.670, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.510', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.088', 'AMMO4': '0.091', 'weapon4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.240', 'weapon2': '0.894', 'WEAPON3': '1.450', 'weapon3': '2.652', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.053', 'FRAGCOUNT': '42.000'} [2023-02-25 13:36:02,477][36141] DAMAGECOUNT value on done: 312586.0 [2023-02-25 13:36:02,477][36141] Sum rewards: 55.383, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.526', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon5': '0.094', 'AMMO4': '0.167', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.324', 'weapon4': '0.588', 'WEAPON3': '1.250', 'weapon3': '2.758', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '14.946', 'FRAGCOUNT': '47.000'} [2023-02-25 13:36:02,580][36157] DAMAGECOUNT value on done: 334141.0 [2023-02-25 13:36:02,581][36157] Sum rewards: 52.526, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.070', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.216', 'weapon4': '0.378', 'weapon2': '0.384', 'WEAPON3': '1.300', 'weapon3': '3.006', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '13.719', 'FRAGCOUNT': '46.000'} [2023-02-25 13:36:02,890][36157] DAMAGECOUNT value on done: 330276.0 [2023-02-25 13:36:02,891][36157] Sum rewards: 51.275, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.155', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.124', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.362', 'weapon2': '0.664', 'WEAPON3': '1.000', 'HITCOUNT': '2.560', 'weapon3': '2.600', 'DAMAGECOUNT': '12.420', 'FRAGCOUNT': '44.000'} [2023-02-25 13:36:03,114][36140] DAMAGECOUNT value on done: 334440.0 [2023-02-25 13:36:03,114][36140] Sum rewards: 57.350, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.412', 'AMMO5': '0.020', 'AMMO2': '0.045', 'AMMO3': '0.107', 'AMMO4': '0.223', 'weapon5': '0.236', 'WEAPON5': '0.500', 'weapon2': '0.588', 'WEAPON3': '0.700', 'WEAPON4': '0.700', 'weapon4': '1.252', 'weapon3': '1.544', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.417', 'FRAGCOUNT': '48.000'} [2023-02-25 13:36:03,293][36157] DAMAGECOUNT value on done: 330181.0 [2023-02-25 13:36:03,293][36157] Sum rewards: 41.770, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-2.512', 'AMMO5': '0.012', 'weapon5': '0.024', 'AMMO2': '0.041', 'WEAPON5': '0.200', 'AMMO4': '0.206', 'weapon2': '0.218', 'AMMO3': '0.310', 'WEAPON4': '0.400', 'weapon4': '0.566', 'WEAPON3': '1.750', 'weapon3': '2.882', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '12.132', 'FRAGCOUNT': '43.500'} [2023-02-25 13:36:03,433][36140] DAMAGECOUNT value on done: 323565.0 [2023-02-25 13:36:03,433][36140] Sum rewards: 45.235, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.388', 'AMMO5': '0.025', 'AMMO2': '0.046', 'AMMO3': '0.192', 'AMMO4': '0.229', 'weapon2': '0.270', 'weapon5': '0.418', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon4': '1.080', 'WEAPON3': '1.150', 'weapon3': '1.786', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '13.077', 'FRAGCOUNT': '41.000'} [2023-02-25 13:36:03,608][36157] DAMAGECOUNT value on done: 332128.0 [2023-02-25 13:36:03,608][36157] Sum rewards: 49.615, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.814', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.120', 'AMMO4': '0.128', 'weapon4': '0.230', 'AMMO3': '0.283', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.600', 'HITCOUNT': '2.670', 'weapon3': '3.020', 'DAMAGECOUNT': '13.896', 'FRAGCOUNT': '46.000'} [2023-02-25 13:36:03,626][36140] DAMAGECOUNT value on done: 328281.0 [2023-02-25 13:36:03,627][36140] Sum rewards: 58.614, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.615', 'AMMO5': '0.007', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO4': '0.129', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.318', 'weapon4': '0.486', 'WEAPON3': '1.150', 'weapon3': '2.826', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.126', 'FRAGCOUNT': '48.000'} [2023-02-25 13:36:03,878][36156] DAMAGECOUNT value on done: 331975.0 [2023-02-25 13:36:03,879][36156] Sum rewards: 47.922, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.160', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.138', 'AMMO4': '0.139', 'weapon2': '0.162', 'AMMO3': '0.193', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '1.108', 'WEAPON3': '1.150', 'weapon3': '2.244', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.188', 'FRAGCOUNT': '43.000'} [2023-02-25 13:36:03,935][36140] DAMAGECOUNT value on done: 322066.0 [2023-02-25 13:36:03,936][36140] Sum rewards: 62.048, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.504', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.048', 'AMMO3': '0.176', 'weapon2': '0.186', 'AMMO4': '0.242', 'WEAPON5': '0.250', 'weapon5': '0.254', 'WEAPON4': '0.400', 'weapon4': '0.982', 'WEAPON3': '1.000', 'weapon3': '2.258', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.221', 'FRAGCOUNT': '52.000'} [2023-02-25 13:36:04,038][36156] DAMAGECOUNT value on done: 333105.0 [2023-02-25 13:36:04,039][36156] Sum rewards: 51.788, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.790', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.148', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'weapon4': '0.324', 'WEAPON5': '0.350', 'weapon2': '0.456', 'WEAPON3': '1.350', 'weapon3': '2.760', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.214', 'FRAGCOUNT': '46.000'} [2023-02-25 13:36:04,191][36156] DAMAGECOUNT value on done: 325835.0 [2023-02-25 13:36:04,191][36156] Sum rewards: 62.687, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.594', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon5': '0.158', 'weapon2': '0.170', 'AMMO3': '0.209', 'weapon4': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.150', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '54.000'} [2023-02-25 13:36:04,355][36156] DAMAGECOUNT value on done: 326329.0 [2023-02-25 13:36:04,355][36156] Sum rewards: 59.655, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.776', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.148', 'weapon2': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon4': '0.234', 'WEAPON3': '1.350', 'HITCOUNT': '3.000', 'weapon3': '3.128', 'DAMAGECOUNT': '15.906', 'FRAGCOUNT': '51.000'} [2023-02-25 13:36:04,483][36142] DAMAGECOUNT value on done: 322503.0 [2023-02-25 13:36:04,484][36142] Sum rewards: 56.554, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.457', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.100', 'AMMO4': '0.168', 'AMMO3': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.300', 'weapon4': '0.402', 'WEAPON3': '1.350', 'weapon3': '2.878', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.730', 'FRAGCOUNT': '49.000'} [2023-02-25 13:36:04,729][36114] Fps is (10 sec: 13517.3, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 169664512. Throughput: 0: 3338.8. Samples: 4913946. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:36:04,730][36114] Avg episode reward: [(0, '53.914')] [2023-02-25 13:36:04,730][36125] Saving new best policy, reward=53.914! [2023-02-25 13:36:04,817][36142] DAMAGECOUNT value on done: 327725.0 [2023-02-25 13:36:04,817][36142] Sum rewards: 70.737, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.010', 'HEALTH': '0.024', 'AMMO2': '0.033', 'weapon5': '0.146', 'AMMO4': '0.165', 'AMMO3': '0.166', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.508', 'weapon2': '0.546', 'WEAPON3': '0.950', 'weapon3': '2.512', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '57.000'} [2023-02-25 13:36:04,829][36142] DAMAGECOUNT value on done: 320203.0 [2023-02-25 13:36:04,829][36142] Sum rewards: 48.077, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.140', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.126', 'weapon2': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'weapon4': '0.668', 'WEAPON3': '1.350', 'HITCOUNT': '2.780', 'weapon3': '2.804', 'DAMAGECOUNT': '12.750', 'FRAGCOUNT': '43.000'} [2023-02-25 13:36:04,957][36138] Updated weights for policy 0, policy_version 41423 (0.0009) [2023-02-25 13:36:05,142][36142] DAMAGECOUNT value on done: 334095.0 [2023-02-25 13:36:05,143][36142] Sum rewards: 64.257, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.370', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO3': '0.132', 'AMMO4': '0.150', 'weapon4': '0.240', 'weapon5': '0.266', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'weapon3': '2.910', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '54.000'} [2023-02-25 13:36:07,997][36138] Updated weights for policy 0, policy_version 41433 (0.0009) [2023-02-25 13:36:09,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13380.2, 300 sec: 13398.8). Total num frames: 169730048. Throughput: 0: 3338.3. Samples: 4923968. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:36:09,730][36114] Avg episode reward: [(0, '54.311')] [2023-02-25 13:36:09,733][36125] Saving new best policy, reward=54.311! [2023-02-25 13:36:11,047][36138] Updated weights for policy 0, policy_version 41443 (0.0009) [2023-02-25 13:36:14,129][36138] Updated weights for policy 0, policy_version 41453 (0.0009) [2023-02-25 13:36:14,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13312.0, 300 sec: 13398.8). Total num frames: 169795584. Throughput: 0: 3333.3. Samples: 4944014. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:36:14,730][36114] Avg episode reward: [(0, '54.311')] [2023-02-25 13:36:15,692][36155] DAMAGECOUNT value on done: 326049.0 [2023-02-25 13:36:15,693][36155] Sum rewards: 41.756, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.240', 'AMMO5': '0.006', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.130', 'AMMO3': '0.149', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.406', 'weapon2': '0.680', 'WEAPON3': '1.000', 'weapon3': '2.566', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '12.513', 'FRAGCOUNT': '35.000'} [2023-02-25 13:36:15,746][36139] DAMAGECOUNT value on done: 331260.0 [2023-02-25 13:36:15,746][36139] Sum rewards: 65.914, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.799', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon4': '0.078', 'WEAPON4': '0.100', 'weapon5': '0.116', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.292', 'WEAPON3': '1.400', 'weapon3': '3.290', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.782', 'FRAGCOUNT': '56.000'} [2023-02-25 13:36:15,988][36155] DAMAGECOUNT value on done: 336720.0 [2023-02-25 13:36:15,988][36155] Sum rewards: 64.854, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.580', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'AMMO4': '0.059', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.160', 'AMMO3': '0.229', 'weapon2': '0.462', 'WEAPON3': '1.400', 'weapon3': '3.138', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.327', 'FRAGCOUNT': '58.000'} [2023-02-25 13:36:16,053][36139] DAMAGECOUNT value on done: 329557.0 [2023-02-25 13:36:16,053][36139] Sum rewards: 55.344, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.384', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.077', 'AMMO3': '0.219', 'weapon5': '0.266', 'weapon2': '0.286', 'AMMO4': '0.387', 'WEAPON5': '0.500', 'WEAPON4': '0.750', 'weapon4': '1.168', 'WEAPON3': '1.250', 'weapon3': '1.828', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.990', 'FRAGCOUNT': '49.000'} [2023-02-25 13:36:16,335][36139] DAMAGECOUNT value on done: 330042.0 [2023-02-25 13:36:16,335][36139] Sum rewards: 41.813, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.423', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.132', 'AMMO3': '0.144', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.320', 'weapon4': '0.586', 'WEAPON3': '0.900', 'HITCOUNT': '2.270', 'weapon3': '2.698', 'DAMAGECOUNT': '11.034', 'FRAGCOUNT': '35.000'} [2023-02-25 13:36:16,350][36155] DAMAGECOUNT value on done: 326425.0 [2023-02-25 13:36:16,351][36155] Sum rewards: 54.602, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.927', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.030', 'weapon5': '0.066', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon2': '0.466', 'WEAPON3': '1.100', 'HITCOUNT': '2.990', 'weapon3': '3.248', 'DAMAGECOUNT': '14.010', 'FRAGCOUNT': '45.000'} [2023-02-25 13:36:16,653][36139] DAMAGECOUNT value on done: 329201.0 [2023-02-25 13:36:16,653][36139] Sum rewards: 54.298, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.626', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.088', 'AMMO4': '0.097', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'weapon4': '0.426', 'weapon2': '0.508', 'WEAPON3': '1.100', 'weapon3': '2.780', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.683', 'FRAGCOUNT': '46.000'} [2023-02-25 13:36:16,673][36155] DAMAGECOUNT value on done: 329145.0 [2023-02-25 13:36:16,674][36155] Sum rewards: 49.100, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.360', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.164', 'weapon5': '0.192', 'AMMO3': '0.194', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON4': '0.500', 'weapon4': '0.590', 'WEAPON3': '1.200', 'weapon3': '2.548', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.113', 'FRAGCOUNT': '43.000'} [2023-02-25 13:36:17,204][36138] Updated weights for policy 0, policy_version 41463 (0.0009) [2023-02-25 13:36:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 169865216. Throughput: 0: 3329.0. Samples: 4964040. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:36:19,729][36114] Avg episode reward: [(0, '53.897')] [2023-02-25 13:36:20,269][36138] Updated weights for policy 0, policy_version 41473 (0.0010) [2023-02-25 13:36:20,642][36154] DAMAGECOUNT value on done: 332809.0 [2023-02-25 13:36:20,643][36154] Sum rewards: 48.171, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.376', 'ARMOR': '0.004', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.020', 'weapon5': '0.122', 'AMMO3': '0.179', 'weapon2': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.692', 'WEAPON3': '1.100', 'weapon3': '2.502', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.303', 'FRAGCOUNT': '42.000'} [2023-02-25 13:36:20,959][36154] DAMAGECOUNT value on done: 326910.0 [2023-02-25 13:36:20,960][36154] Sum rewards: 53.201, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.684', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.110', 'AMMO4': '0.155', 'weapon4': '0.164', 'AMMO3': '0.172', 'WEAPON4': '0.300', 'weapon2': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '3.060', 'weapon3': '3.190', 'DAMAGECOUNT': '14.490', 'FRAGCOUNT': '44.000'} [2023-02-25 13:36:21,281][36154] DAMAGECOUNT value on done: 323614.0 [2023-02-25 13:36:21,281][36154] Sum rewards: 43.411, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.120', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.021', 'weapon5': '0.060', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.274', 'AMMO3': '0.275', 'weapon2': '0.276', 'WEAPON3': '1.550', 'HITCOUNT': '2.580', 'weapon3': '3.106', 'DAMAGECOUNT': '12.330', 'FRAGCOUNT': '42.000'} [2023-02-25 13:36:21,583][36154] DAMAGECOUNT value on done: 330645.0 [2023-02-25 13:36:21,583][36154] Sum rewards: 42.442, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.588', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon4': '0.022', 'AMMO4': '0.076', 'weapon5': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'weapon2': '0.728', 'WEAPON3': '1.100', 'HITCOUNT': '2.570', 'weapon3': '2.974', 'DAMAGECOUNT': '11.670', 'FRAGCOUNT': '37.000'} [2023-02-25 13:36:21,929][36141] DAMAGECOUNT value on done: 335684.0 [2023-02-25 13:36:21,930][36141] Sum rewards: 52.771, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.028', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.071', 'AMMO3': '0.188', 'weapon2': '0.244', 'weapon5': '0.266', 'AMMO4': '0.356', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'weapon4': '0.738', 'WEAPON3': '1.150', 'weapon3': '2.436', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '46.000'} [2023-02-25 13:36:22,199][36141] DAMAGECOUNT value on done: 327672.0 [2023-02-25 13:36:22,200][36141] Sum rewards: 49.196, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.484', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.092', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'WEAPON4': '0.350', 'weapon4': '0.398', 'weapon2': '0.698', 'WEAPON3': '1.100', 'weapon3': '2.614', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '12.978', 'FRAGCOUNT': '42.000'} [2023-02-25 13:36:22,243][36141] DAMAGECOUNT value on done: 334581.0 [2023-02-25 13:36:22,244][36141] Sum rewards: 56.064, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.504', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'weapon2': '0.176', 'weapon5': '0.194', 'WEAPON5': '0.250', 'weapon4': '0.630', 'WEAPON3': '1.100', 'weapon3': '2.790', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.109', 'FRAGCOUNT': '46.000'} [2023-02-25 13:36:22,501][36141] DAMAGECOUNT value on done: 317330.0 [2023-02-25 13:36:22,501][36141] Sum rewards: 53.872, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.080', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO4': '0.184', 'AMMO3': '0.191', 'weapon5': '0.230', 'weapon2': '0.292', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.584', 'WEAPON3': '1.200', 'weapon3': '2.566', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.232', 'FRAGCOUNT': '46.000'} [2023-02-25 13:36:22,615][36157] DAMAGECOUNT value on done: 337928.0 [2023-02-25 13:36:22,616][36157] Sum rewards: 39.776, reward structure: {'DEATHCOUNT': '-16.500', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.048', 'AMMO3': '0.182', 'weapon5': '0.198', 'AMMO4': '0.241', 'HEALTH': '0.245', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'weapon4': '1.062', 'weapon3': '2.066', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '11.346', 'FRAGCOUNT': '36.000'} [2023-02-25 13:36:22,920][36157] DAMAGECOUNT value on done: 334866.0 [2023-02-25 13:36:22,921][36157] Sum rewards: 56.448, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.556', 'AMMO2': '0.011', 'AMMO4': '0.055', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon4': '0.280', 'weapon2': '0.700', 'WEAPON3': '1.100', 'weapon3': '2.884', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.770', 'FRAGCOUNT': '47.000'} [2023-02-25 13:36:23,311][36138] Updated weights for policy 0, policy_version 41483 (0.0009) [2023-02-25 13:36:23,372][36157] DAMAGECOUNT value on done: 334787.0 [2023-02-25 13:36:23,373][36157] Sum rewards: 49.796, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.815', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO2': '0.063', 'AMMO3': '0.129', 'weapon5': '0.166', 'AMMO4': '0.314', 'weapon2': '0.472', 'WEAPON5': '0.600', 'weapon4': '0.714', 'WEAPON4': '0.800', 'WEAPON3': '0.850', 'weapon3': '2.186', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.818', 'FRAGCOUNT': '45.500'} [2023-02-25 13:36:23,441][36140] DAMAGECOUNT value on done: 339230.0 [2023-02-25 13:36:23,442][36140] Sum rewards: 58.095, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.690', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'weapon4': '0.150', 'AMMO3': '0.217', 'weapon2': '0.456', 'WEAPON3': '1.300', 'HITCOUNT': '3.050', 'weapon3': '3.194', 'DAMAGECOUNT': '14.370', 'FRAGCOUNT': '51.000'} [2023-02-25 13:36:23,667][36157] DAMAGECOUNT value on done: 336338.0 [2023-02-25 13:36:23,668][36157] Sum rewards: 44.143, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.874', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'AMMO4': '0.181', 'weapon2': '0.342', 'WEAPON4': '0.500', 'weapon4': '0.524', 'WEAPON3': '1.150', 'HITCOUNT': '2.720', 'weapon3': '2.740', 'DAMAGECOUNT': '12.630', 'FRAGCOUNT': '40.000'} [2023-02-25 13:36:23,743][36140] DAMAGECOUNT value on done: 328021.0 [2023-02-25 13:36:23,744][36140] Sum rewards: 55.227, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.445', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'AMMO3': '0.131', 'WEAPON4': '0.200', 'weapon4': '0.460', 'weapon2': '0.616', 'WEAPON3': '0.800', 'weapon3': '2.702', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.368', 'FRAGCOUNT': '44.000'} [2023-02-25 13:36:23,905][36140] DAMAGECOUNT value on done: 332555.0 [2023-02-25 13:36:23,905][36140] Sum rewards: 45.024, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.705', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.031', 'weapon4': '0.144', 'AMMO4': '0.155', 'weapon5': '0.160', 'AMMO3': '0.194', 'WEAPON4': '0.350', 'weapon2': '0.362', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.730', 'weapon3': '3.060', 'DAMAGECOUNT': '12.822', 'FRAGCOUNT': '40.500'} [2023-02-25 13:36:24,091][36156] DAMAGECOUNT value on done: 336808.0 [2023-02-25 13:36:24,092][36156] Sum rewards: 53.960, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.764', 'AMMO5': '0.015', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.174', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.572', 'weapon4': '0.608', 'WEAPON3': '1.250', 'weapon3': '2.320', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.499', 'FRAGCOUNT': '48.000'} [2023-02-25 13:36:24,204][36140] DAMAGECOUNT value on done: 326282.0 [2023-02-25 13:36:24,205][36140] Sum rewards: 42.740, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.763', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.066', 'AMMO3': '0.193', 'weapon5': '0.250', 'weapon2': '0.278', 'AMMO4': '0.330', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'weapon4': '0.904', 'WEAPON3': '1.200', 'weapon3': '2.130', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '12.648', 'FRAGCOUNT': '40.000'} [2023-02-25 13:36:24,250][36156] DAMAGECOUNT value on done: 336851.0 [2023-02-25 13:36:24,250][36156] Sum rewards: 40.849, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.504', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.172', 'weapon4': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.806', 'WEAPON3': '1.100', 'weapon3': '2.678', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '11.238', 'FRAGCOUNT': '37.000'} [2023-02-25 13:36:24,337][36141] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 13:36:24,402][36156] DAMAGECOUNT value on done: 330899.0 [2023-02-25 13:36:24,402][36156] Sum rewards: 56.117, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.806', 'AMMO5': '0.006', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon4': '0.096', 'weapon5': '0.100', 'weapon2': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'WEAPON3': '1.450', 'HITCOUNT': '3.260', 'weapon3': '3.440', 'DAMAGECOUNT': '15.192', 'FRAGCOUNT': '50.000'} [2023-02-25 13:36:24,560][36156] DAMAGECOUNT value on done: 331684.0 [2023-02-25 13:36:24,561][36156] Sum rewards: 63.283, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.650', 'AMMO2': '0.009', 'AMMO5': '0.010', 'weapon5': '0.012', 'AMMO4': '0.047', 'WEAPON5': '0.100', 'AMMO3': '0.220', 'weapon2': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.340', 'weapon3': '3.430', 'DAMAGECOUNT': '16.065', 'FRAGCOUNT': '53.000'} [2023-02-25 13:36:24,577][36142] DAMAGECOUNT value on done: 326512.0 [2023-02-25 13:36:24,578][36142] Sum rewards: 53.219, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.538', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.106', 'AMMO3': '0.139', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON4': '0.300', 'weapon4': '0.478', 'WEAPON3': '0.900', 'HITCOUNT': '2.650', 'weapon3': '2.736', 'DAMAGECOUNT': '12.027', 'FRAGCOUNT': '46.000'} [2023-02-25 13:36:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13312.0, 300 sec: 13398.8). Total num frames: 169930752. Throughput: 0: 3334.3. Samples: 4974112. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:36:24,730][36114] Avg episode reward: [(0, '52.828')] [2023-02-25 13:36:24,872][36142] DAMAGECOUNT value on done: 324518.0 [2023-02-25 13:36:24,872][36142] Sum rewards: 42.412, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.131', 'AMMO5': '0.023', 'AMMO2': '0.042', 'weapon5': '0.186', 'AMMO3': '0.207', 'AMMO4': '0.208', 'WEAPON4': '0.400', 'weapon2': '0.482', 'WEAPON5': '0.550', 'weapon4': '0.560', 'WEAPON3': '1.200', 'weapon3': '2.470', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.945', 'FRAGCOUNT': '37.500'} [2023-02-25 13:36:24,902][36142] DAMAGECOUNT value on done: 332510.0 [2023-02-25 13:36:24,902][36142] Sum rewards: 53.577, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.925', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.153', 'weapon2': '0.168', 'weapon5': '0.172', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'WEAPON5': '0.300', 'weapon4': '0.534', 'WEAPON3': '1.400', 'weapon3': '2.792', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.355', 'FRAGCOUNT': '47.500'} [2023-02-25 13:36:25,195][36142] DAMAGECOUNT value on done: 338695.0 [2023-02-25 13:36:25,196][36142] Sum rewards: 55.064, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.520', 'ARMOR': '0.004', 'weapon5': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO4': '0.162', 'AMMO3': '0.176', 'weapon2': '0.282', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.554', 'WEAPON3': '1.000', 'weapon3': '2.890', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '13.800', 'FRAGCOUNT': '47.000'} [2023-02-25 13:36:26,384][36138] Updated weights for policy 0, policy_version 41493 (0.0009) [2023-02-25 13:36:29,413][36138] Updated weights for policy 0, policy_version 41503 (0.0009) [2023-02-25 13:36:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.2, 300 sec: 13412.7). Total num frames: 170000384. Throughput: 0: 3339.9. Samples: 4994340. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:36:29,730][36114] Avg episode reward: [(0, '52.836')] [2023-02-25 13:36:32,461][36138] Updated weights for policy 0, policy_version 41513 (0.0009) [2023-02-25 13:36:34,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 170065920. Throughput: 0: 3341.9. Samples: 5014332. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:36:34,729][36114] Avg episode reward: [(0, '52.836')] [2023-02-25 13:36:35,512][36138] Updated weights for policy 0, policy_version 41523 (0.0009) [2023-02-25 13:36:35,689][36155] DAMAGECOUNT value on done: 329223.0 [2023-02-25 13:36:35,689][36155] Sum rewards: 37.396, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.842', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO3': '0.119', 'AMMO4': '0.164', 'weapon5': '0.182', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.570', 'WEAPON3': '0.750', 'weapon2': '0.824', 'weapon3': '2.064', 'HITCOUNT': '2.150', 'DAMAGECOUNT': '9.522', 'FRAGCOUNT': '31.000'} [2023-02-25 13:36:35,748][36139] DAMAGECOUNT value on done: 337084.0 [2023-02-25 13:36:35,748][36139] Sum rewards: 60.513, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.540', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.061', 'AMMO3': '0.180', 'weapon5': '0.288', 'AMMO4': '0.306', 'weapon2': '0.500', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'weapon4': '0.756', 'WEAPON3': '1.200', 'weapon3': '2.122', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '53.000'} [2023-02-25 13:36:36,003][36155] DAMAGECOUNT value on done: 342040.0 [2023-02-25 13:36:36,003][36155] Sum rewards: 56.825, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.645', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.054', 'AMMO3': '0.153', 'weapon5': '0.252', 'AMMO4': '0.270', 'weapon2': '0.398', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.528', 'WEAPON3': '1.050', 'weapon3': '2.448', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '49.000'} [2023-02-25 13:36:36,072][36139] DAMAGECOUNT value on done: 334778.0 [2023-02-25 13:36:36,073][36139] Sum rewards: 55.569, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.541', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'weapon5': '0.160', 'AMMO3': '0.217', 'weapon4': '0.224', 'WEAPON5': '0.250', 'weapon2': '0.410', 'WEAPON3': '1.300', 'weapon3': '2.918', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.540', 'FRAGCOUNT': '47.000'} [2023-02-25 13:36:36,398][36139] DAMAGECOUNT value on done: 334424.0 [2023-02-25 13:36:36,399][36139] Sum rewards: 47.649, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.011', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.158', 'AMMO3': '0.160', 'weapon5': '0.164', 'AMMO4': '0.190', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.404', 'weapon2': '0.542', 'WEAPON3': '1.050', 'HITCOUNT': '2.510', 'weapon3': '2.888', 'DAMAGECOUNT': '13.146', 'FRAGCOUNT': '40.500'} [2023-02-25 13:36:36,452][36155] DAMAGECOUNT value on done: 331263.0 [2023-02-25 13:36:36,452][36155] Sum rewards: 53.993, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.331', 'AMMO5': '0.017', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon5': '0.156', 'AMMO3': '0.160', 'WEAPON4': '0.300', 'weapon2': '0.348', 'WEAPON5': '0.400', 'weapon4': '0.676', 'WEAPON3': '1.000', 'weapon3': '2.330', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.514', 'FRAGCOUNT': '45.000'} [2023-02-25 13:36:36,712][36139] DAMAGECOUNT value on done: 333430.0 [2023-02-25 13:36:36,713][36139] Sum rewards: 53.477, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.762', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon5': '0.156', 'AMMO3': '0.168', 'AMMO4': '0.229', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.628', 'weapon4': '0.680', 'WEAPON3': '1.000', 'weapon3': '2.254', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.687', 'FRAGCOUNT': '47.000'} [2023-02-25 13:36:36,769][36155] DAMAGECOUNT value on done: 334210.0 [2023-02-25 13:36:36,769][36155] Sum rewards: 56.750, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.580', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon4': '0.070', 'weapon5': '0.130', 'AMMO4': '0.151', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'weapon2': '0.336', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.196', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '52.000'} [2023-02-25 13:36:37,789][36140] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:36:38,588][36138] Updated weights for policy 0, policy_version 41533 (0.0009) [2023-02-25 13:36:39,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13312.0, 300 sec: 13398.8). Total num frames: 170131456. Throughput: 0: 3344.1. Samples: 5024386. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:36:39,730][36114] Avg episode reward: [(0, '52.702')] [2023-02-25 13:36:40,739][36154] DAMAGECOUNT value on done: 336771.0 [2023-02-25 13:36:40,740][36154] Sum rewards: 51.103, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.232', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.048', 'AMMO4': '0.099', 'weapon4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'weapon2': '0.620', 'WEAPON3': '1.050', 'HITCOUNT': '2.640', 'weapon3': '3.000', 'DAMAGECOUNT': '11.886', 'FRAGCOUNT': '45.000'} [2023-02-25 13:36:41,061][36154] DAMAGECOUNT value on done: 331739.0 [2023-02-25 13:36:41,061][36154] Sum rewards: 54.256, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.135', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.092', 'AMMO4': '0.120', 'AMMO3': '0.162', 'WEAPON5': '0.300', 'weapon2': '0.358', 'weapon4': '0.394', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.944', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.487', 'FRAGCOUNT': '45.000'} [2023-02-25 13:36:41,370][36154] DAMAGECOUNT value on done: 328619.0 [2023-02-25 13:36:41,371][36154] Sum rewards: 57.546, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.292', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon5': '0.090', 'AMMO4': '0.125', 'weapon4': '0.138', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.604', 'WEAPON3': '1.250', 'weapon3': '2.866', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.015', 'FRAGCOUNT': '50.000'} [2023-02-25 13:36:41,586][36138] Updated weights for policy 0, policy_version 41543 (0.0009) [2023-02-25 13:36:41,683][36154] DAMAGECOUNT value on done: 335788.0 [2023-02-25 13:36:41,683][36154] Sum rewards: 56.762, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.180', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.154', 'weapon5': '0.222', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon4': '0.474', 'weapon2': '0.496', 'WEAPON3': '1.050', 'weapon3': '2.396', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.429', 'FRAGCOUNT': '48.500'} [2023-02-25 13:36:41,827][36141] DAMAGECOUNT value on done: 341269.0 [2023-02-25 13:36:41,827][36141] Sum rewards: 58.039, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.739', 'AMMO5': '0.019', 'AMMO2': '0.051', 'AMMO3': '0.222', 'AMMO4': '0.257', 'weapon2': '0.292', 'weapon5': '0.304', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'weapon4': '0.658', 'WEAPON3': '1.250', 'weapon3': '2.316', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.098', 'FRAGCOUNT': '53.000'} [2023-02-25 13:36:42,127][36141] DAMAGECOUNT value on done: 332478.0 [2023-02-25 13:36:42,128][36141] Sum rewards: 53.873, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.610', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.090', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'weapon4': '0.480', 'weapon2': '0.542', 'WEAPON3': '1.000', 'weapon3': '2.692', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.418', 'FRAGCOUNT': '45.000'} [2023-02-25 13:36:42,155][36141] DAMAGECOUNT value on done: 339472.0 [2023-02-25 13:36:42,155][36141] Sum rewards: 56.766, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.672', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO3': '0.112', 'AMMO4': '0.142', 'WEAPON4': '0.200', 'weapon5': '0.212', 'WEAPON5': '0.300', 'weapon4': '0.334', 'WEAPON3': '0.750', 'weapon2': '0.900', 'weapon3': '2.306', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '14.673', 'FRAGCOUNT': '43.000'} [2023-02-25 13:36:42,449][36141] DAMAGECOUNT value on done: 321234.0 [2023-02-25 13:36:42,450][36141] Sum rewards: 46.251, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.120', 'AMMO5': '0.012', 'AMMO2': '0.017', 'weapon5': '0.020', 'AMMO4': '0.084', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.282', 'weapon2': '0.616', 'WEAPON3': '1.100', 'weapon3': '2.698', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '11.712', 'FRAGCOUNT': '39.000'} [2023-02-25 13:36:42,679][36157] DAMAGECOUNT value on done: 342721.0 [2023-02-25 13:36:42,679][36157] Sum rewards: 49.682, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.128', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.062', 'AMMO4': '0.134', 'AMMO3': '0.186', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON4': '0.350', 'weapon4': '0.952', 'WEAPON3': '1.200', 'weapon3': '2.446', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.379', 'FRAGCOUNT': '42.500'} [2023-02-25 13:36:42,982][36157] DAMAGECOUNT value on done: 338800.0 [2023-02-25 13:36:42,982][36157] Sum rewards: 52.093, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.130', 'AMMO5': '0.012', 'AMMO2': '0.045', 'AMMO3': '0.131', 'weapon5': '0.212', 'AMMO4': '0.224', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'weapon4': '1.074', 'weapon3': '1.898', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '11.802', 'FRAGCOUNT': '44.000'} [2023-02-25 13:36:43,486][36157] DAMAGECOUNT value on done: 339230.0 [2023-02-25 13:36:43,487][36157] Sum rewards: 50.145, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.294', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.044', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.207', 'AMMO4': '0.218', 'weapon2': '0.234', 'WEAPON4': '0.350', 'weapon4': '0.880', 'WEAPON3': '1.150', 'weapon3': '2.578', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '13.329', 'FRAGCOUNT': '44.000'} [2023-02-25 13:36:43,540][36140] DAMAGECOUNT value on done: 343938.0 [2023-02-25 13:36:43,541][36140] Sum rewards: 56.210, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.219', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.124', 'AMMO4': '0.152', 'weapon2': '0.210', 'AMMO3': '0.215', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.572', 'WEAPON3': '1.350', 'weapon3': '2.872', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.124', 'FRAGCOUNT': '51.000'} [2023-02-25 13:36:43,773][36157] DAMAGECOUNT value on done: 340793.0 [2023-02-25 13:36:43,773][36157] Sum rewards: 51.693, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.226', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon5': '0.102', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.380', 'WEAPON4': '0.400', 'weapon4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.662', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.365', 'FRAGCOUNT': '45.000'} [2023-02-25 13:36:43,849][36140] DAMAGECOUNT value on done: 332124.0 [2023-02-25 13:36:43,850][36140] Sum rewards: 45.607, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.540', 'AMMO5': '0.019', 'AMMO2': '0.045', 'weapon5': '0.130', 'AMMO3': '0.147', 'AMMO4': '0.226', 'weapon2': '0.272', 'ARMOR': '0.422', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'weapon4': '0.818', 'WEAPON3': '0.850', 'weapon3': '2.558', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.309', 'FRAGCOUNT': '39.000'} [2023-02-25 13:36:44,021][36140] DAMAGECOUNT value on done: 336949.0 [2023-02-25 13:36:44,021][36140] Sum rewards: 51.473, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.025', 'AMMO5': '0.016', 'AMMO2': '0.033', 'AMMO3': '0.137', 'weapon5': '0.142', 'AMMO4': '0.165', 'weapon4': '0.222', 'weapon2': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.900', 'HITCOUNT': '2.780', 'weapon3': '3.190', 'DAMAGECOUNT': '13.182', 'FRAGCOUNT': '43.000'} [2023-02-25 13:36:44,111][36156] DAMAGECOUNT value on done: 341837.0 [2023-02-25 13:36:44,112][36156] Sum rewards: 58.327, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.092', 'AMMO5': '0.014', 'AMMO2': '0.022', 'weapon4': '0.046', 'AMMO4': '0.112', 'AMMO3': '0.148', 'weapon5': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.458', 'WEAPON3': '0.900', 'weapon3': '3.096', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.087', 'FRAGCOUNT': '46.500'} [2023-02-25 13:36:44,253][36156] DAMAGECOUNT value on done: 341155.0 [2023-02-25 13:36:44,253][36156] Sum rewards: 49.641, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.270', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'weapon5': '0.100', 'AMMO3': '0.153', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.428', 'weapon4': '0.464', 'WEAPON3': '0.900', 'weapon3': '2.706', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '12.912', 'FRAGCOUNT': '42.000'} [2023-02-25 13:36:44,334][36140] DAMAGECOUNT value on done: 330842.0 [2023-02-25 13:36:44,334][36140] Sum rewards: 53.197, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.054', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.053', 'AMMO3': '0.131', 'weapon5': '0.218', 'AMMO4': '0.266', 'weapon2': '0.440', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '0.800', 'weapon4': '0.868', 'weapon3': '2.154', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.680', 'FRAGCOUNT': '45.000'} [2023-02-25 13:36:44,425][36156] DAMAGECOUNT value on done: 335523.0 [2023-02-25 13:36:44,425][36156] Sum rewards: 57.056, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.244', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon2': '0.154', 'AMMO3': '0.233', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon5': '0.322', 'weapon4': '0.524', 'WEAPON3': '1.400', 'weapon3': '2.726', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.872', 'FRAGCOUNT': '52.000'} [2023-02-25 13:36:44,572][36156] DAMAGECOUNT value on done: 336317.0 [2023-02-25 13:36:44,572][36156] Sum rewards: 45.560, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.810', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.054', 'AMMO3': '0.159', 'weapon2': '0.202', 'weapon5': '0.216', 'AMMO4': '0.272', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'weapon4': '0.770', 'WEAPON3': '1.000', 'weapon3': '2.506', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.899', 'FRAGCOUNT': '39.000'} [2023-02-25 13:36:44,677][36138] Updated weights for policy 0, policy_version 41553 (0.0009) [2023-02-25 13:36:44,679][36142] DAMAGECOUNT value on done: 331300.0 [2023-02-25 13:36:44,680][36142] Sum rewards: 52.742, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.194', 'ARMOR': '0.008', 'AMMO5': '0.023', 'AMMO2': '0.032', 'AMMO3': '0.135', 'AMMO4': '0.161', 'weapon5': '0.274', 'WEAPON4': '0.400', 'weapon4': '0.432', 'WEAPON5': '0.600', 'weapon2': '0.876', 'WEAPON3': '0.900', 'weapon3': '2.000', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.364', 'FRAGCOUNT': '44.500'} [2023-02-25 13:36:44,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 170201088. Throughput: 0: 3343.1. Samples: 5044514. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:36:44,730][36114] Avg episode reward: [(0, '52.699')] [2023-02-25 13:36:45,000][36142] DAMAGECOUNT value on done: 336560.0 [2023-02-25 13:36:45,001][36142] Sum rewards: 52.559, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.576', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.094', 'AMMO3': '0.181', 'weapon2': '0.718', 'WEAPON3': '1.100', 'HITCOUNT': '2.760', 'weapon3': '3.006', 'DAMAGECOUNT': '12.150', 'FRAGCOUNT': '45.000'} [2023-02-25 13:36:45,012][36142] DAMAGECOUNT value on done: 328852.0 [2023-02-25 13:36:45,013][36142] Sum rewards: 45.311, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.980', 'AMMO5': '0.017', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon5': '0.148', 'AMMO3': '0.195', 'weapon2': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.822', 'WEAPON3': '1.200', 'weapon3': '2.438', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.002', 'FRAGCOUNT': '42.000'} [2023-02-25 13:36:45,328][36142] DAMAGECOUNT value on done: 344270.0 [2023-02-25 13:36:45,329][36142] Sum rewards: 64.836, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.940', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.040', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.233', 'weapon2': '0.448', 'WEAPON3': '1.500', 'weapon3': '3.234', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '56.000'} [2023-02-25 13:36:47,711][36138] Updated weights for policy 0, policy_version 41563 (0.0009) [2023-02-25 13:36:49,048][36154] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 13:36:49,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 170266624. Throughput: 0: 3350.3. Samples: 5064710. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:36:49,730][36114] Avg episode reward: [(0, '52.918')] [2023-02-25 13:36:50,797][36138] Updated weights for policy 0, policy_version 41573 (0.0009) [2023-02-25 13:36:52,883][36142] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:36:53,855][36138] Updated weights for policy 0, policy_version 41583 (0.0009) [2023-02-25 13:36:54,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13380.4, 300 sec: 13398.8). Total num frames: 170332160. Throughput: 0: 3350.1. Samples: 5074722. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:36:54,729][36114] Avg episode reward: [(0, '52.918')] [2023-02-25 13:36:55,457][36155] DAMAGECOUNT value on done: 333170.0 [2023-02-25 13:36:55,457][36155] Sum rewards: 39.654, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.904', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.053', 'AMMO3': '0.177', 'weapon5': '0.210', 'weapon2': '0.264', 'AMMO4': '0.266', 'WEAPON5': '0.400', 'weapon4': '0.466', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'HITCOUNT': '2.510', 'weapon3': '2.796', 'DAMAGECOUNT': '11.841', 'FRAGCOUNT': '36.000'} [2023-02-25 13:36:55,647][36139] DAMAGECOUNT value on done: 341566.0 [2023-02-25 13:36:55,647][36139] Sum rewards: 55.966, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.915', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO3': '0.129', 'weapon5': '0.136', 'AMMO4': '0.137', 'WEAPON5': '0.250', 'weapon2': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.392', 'WEAPON3': '0.800', 'HITCOUNT': '2.910', 'weapon3': '3.046', 'DAMAGECOUNT': '13.446', 'FRAGCOUNT': '47.000'} [2023-02-25 13:36:55,771][36155] DAMAGECOUNT value on done: 346525.0 [2023-02-25 13:36:55,772][36155] Sum rewards: 54.162, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.830', 'AMMO5': '0.019', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.162', 'weapon5': '0.268', 'weapon2': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.714', 'WEAPON3': '1.050', 'weapon3': '2.282', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.455', 'FRAGCOUNT': '46.000'} [2023-02-25 13:36:55,917][36139] DAMAGECOUNT value on done: 339230.0 [2023-02-25 13:36:55,918][36139] Sum rewards: 42.788, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.366', 'ARMOR': '0.012', 'AMMO5': '0.024', 'AMMO2': '0.065', 'AMMO3': '0.226', 'weapon5': '0.248', 'weapon2': '0.280', 'weapon4': '0.318', 'AMMO4': '0.325', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.300', 'HITCOUNT': '2.680', 'weapon3': '2.720', 'DAMAGECOUNT': '13.356', 'FRAGCOUNT': '41.000'} [2023-02-25 13:36:56,194][36155] DAMAGECOUNT value on done: 336221.0 [2023-02-25 13:36:56,194][36155] Sum rewards: 57.196, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.497', 'AMMO5': '0.009', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.080', 'weapon5': '0.132', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.564', 'WEAPON3': '1.200', 'weapon3': '3.076', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.874', 'FRAGCOUNT': '48.000'} [2023-02-25 13:36:56,409][36139] DAMAGECOUNT value on done: 338811.0 [2023-02-25 13:36:56,409][36139] Sum rewards: 48.431, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.520', 'AMMO5': '0.015', 'AMMO2': '0.016', 'weapon4': '0.032', 'weapon5': '0.060', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'weapon2': '0.204', 'AMMO3': '0.224', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '2.820', 'weapon3': '3.490', 'DAMAGECOUNT': '13.161', 'FRAGCOUNT': '43.000'} [2023-02-25 13:36:56,505][36155] DAMAGECOUNT value on done: 338171.0 [2023-02-25 13:36:56,506][36155] Sum rewards: 44.262, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.665', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.106', 'weapon4': '0.112', 'AMMO4': '0.137', 'AMMO3': '0.153', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.560', 'WEAPON3': '1.050', 'HITCOUNT': '2.610', 'weapon3': '3.088', 'DAMAGECOUNT': '11.724', 'FRAGCOUNT': '38.000'} [2023-02-25 13:36:56,715][36139] DAMAGECOUNT value on done: 338865.0 [2023-02-25 13:36:56,716][36139] Sum rewards: 61.025, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.051', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.144', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'AMMO3': '0.214', 'weapon2': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.772', 'WEAPON3': '1.300', 'weapon3': '2.498', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '53.000'} [2023-02-25 13:36:56,895][36138] Updated weights for policy 0, policy_version 41593 (0.0010) [2023-02-25 13:36:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 170401792. Throughput: 0: 3352.0. Samples: 5094854. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:36:59,730][36114] Avg episode reward: [(0, '52.857')] [2023-02-25 13:36:59,942][36138] Updated weights for policy 0, policy_version 41603 (0.0009) [2023-02-25 13:37:00,849][36154] DAMAGECOUNT value on done: 340310.0 [2023-02-25 13:37:00,849][36154] Sum rewards: 37.008, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.898', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.042', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.208', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'weapon2': '0.372', 'weapon4': '0.698', 'WEAPON3': '1.350', 'weapon3': '2.444', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '10.515', 'FRAGCOUNT': '37.000'} [2023-02-25 13:37:01,178][36154] DAMAGECOUNT value on done: 335490.0 [2023-02-25 13:37:01,178][36154] Sum rewards: 49.613, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.642', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.150', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'weapon2': '0.224', 'weapon4': '0.754', 'WEAPON3': '0.950', 'weapon3': '2.752', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '11.253', 'FRAGCOUNT': '42.000'} [2023-02-25 13:37:01,477][36154] DAMAGECOUNT value on done: 333421.0 [2023-02-25 13:37:01,478][36154] Sum rewards: 60.320, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.104', 'HEALTH': '0.135', 'AMMO3': '0.150', 'weapon2': '0.180', 'weapon5': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.836', 'WEAPON3': '0.900', 'weapon3': '2.406', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.406', 'FRAGCOUNT': '48.000'} [2023-02-25 13:37:01,795][36154] DAMAGECOUNT value on done: 340015.0 [2023-02-25 13:37:01,796][36154] Sum rewards: 45.193, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.120', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.046', 'AMMO3': '0.191', 'AMMO4': '0.228', 'weapon5': '0.234', 'weapon2': '0.344', 'weapon4': '0.458', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.560', 'weapon3': '2.644', 'DAMAGECOUNT': '12.681', 'FRAGCOUNT': '40.000'} [2023-02-25 13:37:01,986][36141] DAMAGECOUNT value on done: 345721.0 [2023-02-25 13:37:01,986][36141] Sum rewards: 58.192, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.010', 'AMMO2': '0.019', 'HEALTH': '0.044', 'AMMO4': '0.092', 'weapon5': '0.132', 'AMMO3': '0.143', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.614', 'weapon2': '0.640', 'WEAPON3': '0.800', 'weapon3': '2.392', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.356', 'FRAGCOUNT': '49.000'} [2023-02-25 13:37:02,273][36141] DAMAGECOUNT value on done: 336301.0 [2023-02-25 13:37:02,273][36141] Sum rewards: 42.648, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.877', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.025', 'weapon5': '0.074', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon4': '0.246', 'weapon2': '0.484', 'WEAPON3': '1.300', 'HITCOUNT': '2.530', 'weapon3': '2.778', 'DAMAGECOUNT': '11.205', 'FRAGCOUNT': '39.000'} [2023-02-25 13:37:02,282][36141] DAMAGECOUNT value on done: 343685.0 [2023-02-25 13:37:02,283][36141] Sum rewards: 39.468, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.315', 'AMMO5': '0.021', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.179', 'weapon5': '0.212', 'weapon2': '0.238', 'WEAPON4': '0.450', 'WEAPON5': '0.600', 'weapon4': '0.880', 'WEAPON3': '1.050', 'weapon3': '2.364', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.639', 'FRAGCOUNT': '33.000'} [2023-02-25 13:37:02,586][36141] DAMAGECOUNT value on done: 326347.0 [2023-02-25 13:37:02,586][36141] Sum rewards: 60.626, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.060', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.058', 'AMMO4': '0.090', 'AMMO3': '0.167', 'weapon4': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.466', 'WEAPON3': '1.100', 'weapon3': '3.072', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.339', 'FRAGCOUNT': '52.000'} [2023-02-25 13:37:02,862][36157] DAMAGECOUNT value on done: 347470.0 [2023-02-25 13:37:02,863][36157] Sum rewards: 53.976, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.829', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO4': '0.131', 'weapon4': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'WEAPON3': '0.950', 'weapon2': '0.982', 'weapon3': '2.586', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.247', 'FRAGCOUNT': '44.000'} [2023-02-25 13:37:03,034][36138] Updated weights for policy 0, policy_version 41613 (0.0009) [2023-02-25 13:37:03,176][36157] DAMAGECOUNT value on done: 343355.0 [2023-02-25 13:37:03,177][36157] Sum rewards: 53.300, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.344', 'AMMO5': '0.003', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.158', 'AMMO4': '0.174', 'weapon2': '0.226', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON3': '1.000', 'weapon4': '1.056', 'weapon3': '2.462', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.665', 'FRAGCOUNT': '44.000'} [2023-02-25 13:37:03,543][36140] DAMAGECOUNT value on done: 349171.0 [2023-02-25 13:37:03,543][36140] Sum rewards: 64.204, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.400', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon4': '0.058', 'weapon5': '0.100', 'AMMO4': '0.155', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.484', 'WEAPON3': '1.200', 'weapon3': '3.118', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.699', 'FRAGCOUNT': '55.000'} [2023-02-25 13:37:03,611][36157] DAMAGECOUNT value on done: 343991.0 [2023-02-25 13:37:03,612][36157] Sum rewards: 54.734, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.339', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'AMMO4': '0.206', 'WEAPON4': '0.300', 'weapon2': '0.384', 'weapon4': '0.588', 'WEAPON3': '1.150', 'weapon3': '2.668', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.283', 'FRAGCOUNT': '47.000'} [2023-02-25 13:37:03,865][36140] DAMAGECOUNT value on done: 336737.0 [2023-02-25 13:37:03,866][36140] Sum rewards: 56.679, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.214', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.098', 'AMMO4': '0.129', 'AMMO3': '0.149', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.378', 'WEAPON3': '0.900', 'weapon2': '1.034', 'weapon3': '2.286', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.839', 'FRAGCOUNT': '46.000'} [2023-02-25 13:37:03,937][36157] DAMAGECOUNT value on done: 345078.0 [2023-02-25 13:37:03,938][36157] Sum rewards: 47.162, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.200', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.160', 'weapon5': '0.168', 'AMMO4': '0.184', 'AMMO3': '0.215', 'weapon2': '0.372', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.760', 'weapon3': '3.022', 'DAMAGECOUNT': '12.678', 'FRAGCOUNT': '44.500'} [2023-02-25 13:37:04,090][36140] DAMAGECOUNT value on done: 340477.0 [2023-02-25 13:37:04,091][36140] Sum rewards: 40.470, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.640', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.024', 'weapon5': '0.094', 'WEAPON4': '0.100', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon2': '0.786', 'WEAPON3': '1.000', 'HITCOUNT': '2.380', 'weapon3': '2.924', 'DAMAGECOUNT': '10.584', 'FRAGCOUNT': '34.000'} [2023-02-25 13:37:04,230][36156] DAMAGECOUNT value on done: 346533.0 [2023-02-25 13:37:04,230][36156] Sum rewards: 53.859, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.790', 'AMMO5': '0.007', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.159', 'weapon5': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.356', 'weapon2': '0.452', 'WEAPON3': '1.000', 'weapon3': '2.778', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.773', 'FRAGCOUNT': '44.000'} [2023-02-25 13:37:04,406][36140] DAMAGECOUNT value on done: 335373.0 [2023-02-25 13:37:04,406][36140] Sum rewards: 54.015, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.369', 'AMMO2': '0.007', 'AMMO5': '0.010', 'weapon4': '0.030', 'AMMO4': '0.036', 'WEAPON4': '0.100', 'weapon5': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.430', 'WEAPON3': '1.500', 'HITCOUNT': '2.950', 'weapon3': '3.166', 'DAMAGECOUNT': '13.593', 'FRAGCOUNT': '49.000'} [2023-02-25 13:37:04,417][36156] DAMAGECOUNT value on done: 346137.0 [2023-02-25 13:37:04,418][36156] Sum rewards: 58.673, reward structure: {'DEATHCOUNT': '-12.000', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.025', 'HEALTH': '0.056', 'AMMO4': '0.126', 'AMMO3': '0.149', 'weapon5': '0.178', 'weapon4': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.628', 'WEAPON3': '0.900', 'weapon3': '2.698', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.946', 'FRAGCOUNT': '47.000'} [2023-02-25 13:37:04,549][36156] DAMAGECOUNT value on done: 339934.0 [2023-02-25 13:37:04,550][36156] Sum rewards: 54.416, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.032', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.136', 'weapon5': '0.146', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON4': '0.350', 'weapon4': '0.430', 'WEAPON3': '0.900', 'HITCOUNT': '2.860', 'weapon3': '2.980', 'DAMAGECOUNT': '13.233', 'FRAGCOUNT': '46.000'} [2023-02-25 13:37:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 170467328. Throughput: 0: 3351.2. Samples: 5114842. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:37:04,729][36114] Avg episode reward: [(0, '52.412')] [2023-02-25 13:37:04,739][36156] DAMAGECOUNT value on done: 342052.0 [2023-02-25 13:37:04,740][36156] Sum rewards: 63.035, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.935', 'AMMO5': '0.020', 'AMMO2': '0.042', 'AMMO3': '0.142', 'AMMO4': '0.209', 'weapon5': '0.230', 'weapon2': '0.336', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.740', 'WEAPON3': '0.950', 'weapon3': '2.446', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '51.000'} [2023-02-25 13:37:04,791][36142] DAMAGECOUNT value on done: 335767.0 [2023-02-25 13:37:04,791][36142] Sum rewards: 52.305, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.460', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon5': '0.146', 'AMMO3': '0.184', 'AMMO4': '0.225', 'weapon4': '0.378', 'WEAPON5': '0.400', 'weapon2': '0.408', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.764', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.401', 'FRAGCOUNT': '47.000'} [2023-02-25 13:37:05,100][36142] DAMAGECOUNT value on done: 340595.0 [2023-02-25 13:37:05,100][36142] Sum rewards: 42.486, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.980', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.100', 'AMMO4': '0.111', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'weapon4': '0.368', 'weapon2': '0.696', 'WEAPON3': '1.300', 'weapon3': '2.576', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.105', 'FRAGCOUNT': '40.000'} [2023-02-25 13:37:05,112][36142] DAMAGECOUNT value on done: 333802.0 [2023-02-25 13:37:05,112][36142] Sum rewards: 58.408, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.563', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.146', 'AMMO3': '0.149', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.380', 'weapon2': '0.616', 'WEAPON3': '1.000', 'weapon3': '2.556', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.850', 'FRAGCOUNT': '48.000'} [2023-02-25 13:37:05,428][36142] DAMAGECOUNT value on done: 348020.0 [2023-02-25 13:37:05,428][36142] Sum rewards: 46.277, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.120', 'AMMO5': '0.014', 'AMMO2': '0.047', 'AMMO3': '0.127', 'weapon5': '0.176', 'AMMO4': '0.233', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.450', 'WEAPON3': '0.800', 'weapon2': '0.960', 'weapon3': '2.010', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '11.250', 'FRAGCOUNT': '40.000'} [2023-02-25 13:37:06,110][36138] Updated weights for policy 0, policy_version 41623 (0.0009) [2023-02-25 13:37:09,203][36138] Updated weights for policy 0, policy_version 41633 (0.0009) [2023-02-25 13:37:09,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 170532864. Throughput: 0: 3352.1. Samples: 5124958. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-25 13:37:09,730][36114] Avg episode reward: [(0, '52.196')] [2023-02-25 13:37:12,239][36138] Updated weights for policy 0, policy_version 41643 (0.0009) [2023-02-25 13:37:14,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 170602496. Throughput: 0: 3349.4. Samples: 5145064. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-25 13:37:14,730][36114] Avg episode reward: [(0, '52.196')] [2023-02-25 13:37:15,105][36154] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:37:15,283][36138] Updated weights for policy 0, policy_version 41653 (0.0010) [2023-02-25 13:37:15,404][36155] DAMAGECOUNT value on done: 337220.0 [2023-02-25 13:37:15,404][36155] Sum rewards: 45.902, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.384', 'AMMO5': '0.015', 'AMMO2': '0.046', 'AMMO3': '0.118', 'weapon5': '0.152', 'weapon2': '0.174', 'AMMO4': '0.229', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '0.750', 'weapon4': '1.056', 'weapon3': '2.206', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.150', 'FRAGCOUNT': '38.000'} [2023-02-25 13:37:15,619][36139] DAMAGECOUNT value on done: 346699.0 [2023-02-25 13:37:15,619][36139] Sum rewards: 58.119, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.448', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.036', 'weapon5': '0.048', 'weapon4': '0.088', 'WEAPON4': '0.100', 'weapon2': '0.190', 'WEAPON5': '0.250', 'AMMO3': '0.301', 'WEAPON3': '1.750', 'HITCOUNT': '3.230', 'weapon3': '3.408', 'DAMAGECOUNT': '15.399', 'FRAGCOUNT': '53.000'} [2023-02-25 13:37:15,714][36155] DAMAGECOUNT value on done: 351647.0 [2023-02-25 13:37:15,714][36155] Sum rewards: 58.375, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.053', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.016', 'AMMO4': '0.081', 'AMMO3': '0.131', 'weapon5': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'weapon2': '0.480', 'weapon4': '0.548', 'WEAPON3': '0.850', 'weapon3': '2.462', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.366', 'FRAGCOUNT': '46.000'} [2023-02-25 13:37:15,931][36139] DAMAGECOUNT value on done: 344666.0 [2023-02-25 13:37:15,932][36139] Sum rewards: 63.499, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.453', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON5': '0.150', 'weapon5': '0.166', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon4': '0.370', 'ARMOR': '0.404', 'weapon2': '0.458', 'WEAPON3': '1.200', 'weapon3': '2.784', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '53.500'} [2023-02-25 13:37:16,217][36155] DAMAGECOUNT value on done: 340975.0 [2023-02-25 13:37:16,218][36155] Sum rewards: 54.708, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.430', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.036', 'AMMO3': '0.136', 'AMMO4': '0.180', 'weapon5': '0.194', 'WEAPON4': '0.400', 'weapon4': '0.470', 'WEAPON5': '0.500', 'weapon2': '0.520', 'WEAPON3': '0.900', 'weapon3': '2.526', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.262', 'FRAGCOUNT': '45.000'} [2023-02-25 13:37:16,523][36155] DAMAGECOUNT value on done: 342805.0 [2023-02-25 13:37:16,524][36155] Sum rewards: 53.504, reward structure: {'DEATHCOUNT': '-12.000', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.144', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'HEALTH': '0.213', 'weapon4': '0.340', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON3': '0.900', 'weapon3': '2.870', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.902', 'FRAGCOUNT': '43.000'} [2023-02-25 13:37:16,555][36139] DAMAGECOUNT value on done: 343302.0 [2023-02-25 13:37:16,556][36139] Sum rewards: 52.320, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.018', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon5': '0.068', 'weapon4': '0.098', 'AMMO4': '0.123', 'AMMO3': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.490', 'WEAPON3': '1.150', 'HITCOUNT': '2.820', 'weapon3': '3.154', 'DAMAGECOUNT': '13.473', 'FRAGCOUNT': '45.000'} [2023-02-25 13:37:16,875][36139] DAMAGECOUNT value on done: 343111.0 [2023-02-25 13:37:16,876][36139] Sum rewards: 48.596, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.436', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.112', 'AMMO4': '0.200', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.352', 'weapon4': '0.430', 'WEAPON3': '1.250', 'HITCOUNT': '2.800', 'weapon3': '2.844', 'DAMAGECOUNT': '12.738', 'FRAGCOUNT': '43.500'} [2023-02-25 13:37:18,322][36138] Updated weights for policy 0, policy_version 41663 (0.0009) [2023-02-25 13:37:19,729][36114] Fps is (10 sec: 13517.0, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 170668032. Throughput: 0: 3351.5. Samples: 5165150. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-25 13:37:19,729][36114] Avg episode reward: [(0, '51.872')] [2023-02-25 13:37:19,733][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000041667_170668032.pth... [2023-02-25 13:37:19,797][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000040883_167456768.pth [2023-02-25 13:37:20,778][36154] DAMAGECOUNT value on done: 345368.0 [2023-02-25 13:37:20,778][36154] Sum rewards: 54.854, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.240', 'AMMO5': '0.014', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.104', 'weapon4': '0.134', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'WEAPON5': '0.350', 'weapon2': '0.630', 'WEAPON3': '1.450', 'weapon3': '2.838', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.174', 'FRAGCOUNT': '48.000'} [2023-02-25 13:37:21,097][36154] DAMAGECOUNT value on done: 339348.0 [2023-02-25 13:37:21,098][36154] Sum rewards: 40.713, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.142', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO3': '0.137', 'AMMO4': '0.173', 'weapon5': '0.260', 'weapon2': '0.276', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '0.850', 'weapon4': '0.918', 'weapon3': '2.308', 'HITCOUNT': '2.360', 'DAMAGECOUNT': '11.574', 'FRAGCOUNT': '35.000'} [2023-02-25 13:37:21,378][36138] Updated weights for policy 0, policy_version 41673 (0.0009) [2023-02-25 13:37:21,404][36154] DAMAGECOUNT value on done: 338082.0 [2023-02-25 13:37:21,404][36154] Sum rewards: 60.273, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.812', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.060', 'AMMO4': '0.086', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.312', 'weapon2': '0.552', 'WEAPON3': '1.050', 'weapon3': '2.806', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '13.983', 'FRAGCOUNT': '50.000'} [2023-02-25 13:37:21,710][36154] DAMAGECOUNT value on done: 344407.0 [2023-02-25 13:37:21,710][36154] Sum rewards: 52.151, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.312', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon5': '0.136', 'AMMO3': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.368', 'weapon4': '0.702', 'WEAPON3': '1.100', 'weapon3': '2.476', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.176', 'FRAGCOUNT': '46.000'} [2023-02-25 13:37:22,174][36141] DAMAGECOUNT value on done: 350475.0 [2023-02-25 13:37:22,174][36141] Sum rewards: 49.944, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.347', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO4': '0.185', 'AMMO3': '0.197', 'weapon5': '0.228', 'weapon4': '0.420', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.476', 'WEAPON3': '1.250', 'weapon3': '2.594', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.262', 'FRAGCOUNT': '44.000'} [2023-02-25 13:37:22,481][36141] DAMAGECOUNT value on done: 340538.0 [2023-02-25 13:37:22,481][36141] Sum rewards: 51.410, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.845', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon5': '0.166', 'AMMO3': '0.185', 'AMMO4': '0.244', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.622', 'weapon4': '0.642', 'WEAPON3': '1.100', 'weapon3': '2.242', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.711', 'FRAGCOUNT': '48.000'} [2023-02-25 13:37:22,490][36141] DAMAGECOUNT value on done: 348865.0 [2023-02-25 13:37:22,491][36141] Sum rewards: 59.498, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.716', 'ARMOR': '0.004', 'AMMO5': '0.029', 'AMMO2': '0.057', 'AMMO3': '0.162', 'weapon5': '0.222', 'AMMO4': '0.286', 'weapon2': '0.576', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'weapon4': '0.778', 'WEAPON3': '1.000', 'weapon3': '2.102', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '52.000'} [2023-02-25 13:37:22,809][36141] DAMAGECOUNT value on done: 330253.0 [2023-02-25 13:37:22,810][36141] Sum rewards: 47.292, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.488', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.050', 'AMMO3': '0.183', 'weapon5': '0.240', 'AMMO4': '0.252', 'weapon2': '0.346', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.652', 'WEAPON3': '1.150', 'weapon3': '2.500', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '11.718', 'FRAGCOUNT': '45.000'} [2023-02-25 13:37:23,008][36157] DAMAGECOUNT value on done: 351648.0 [2023-02-25 13:37:23,008][36157] Sum rewards: 42.437, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.564', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.054', 'AMMO3': '0.170', 'weapon5': '0.176', 'weapon2': '0.262', 'AMMO4': '0.269', 'WEAPON5': '0.400', 'WEAPON4': '0.650', 'WEAPON3': '1.000', 'weapon4': '1.150', 'weapon3': '2.034', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.534', 'FRAGCOUNT': '39.000'} [2023-02-25 13:37:23,317][36157] DAMAGECOUNT value on done: 347528.0 [2023-02-25 13:37:23,318][36157] Sum rewards: 48.578, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.906', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.059', 'AMMO3': '0.142', 'weapon5': '0.206', 'AMMO4': '0.297', 'WEAPON5': '0.450', 'weapon2': '0.472', 'WEAPON4': '0.600', 'weapon4': '0.666', 'WEAPON3': '0.850', 'weapon3': '2.340', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.519', 'FRAGCOUNT': '41.000'} [2023-02-25 13:37:23,580][36140] DAMAGECOUNT value on done: 352708.0 [2023-02-25 13:37:23,580][36140] Sum rewards: 41.834, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.769', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.102', 'AMMO3': '0.145', 'AMMO4': '0.183', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.384', 'weapon4': '0.532', 'WEAPON3': '0.850', 'HITCOUNT': '2.340', 'weapon3': '2.754', 'DAMAGECOUNT': '10.611', 'FRAGCOUNT': '36.000'} [2023-02-25 13:37:23,673][36157] DAMAGECOUNT value on done: 349084.0 [2023-02-25 13:37:23,674][36157] Sum rewards: 56.550, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.535', 'AMMO5': '0.018', 'AMMO2': '0.038', 'AMMO3': '0.127', 'AMMO4': '0.192', 'weapon5': '0.192', 'weapon4': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.724', 'WEAPON3': '0.850', 'weapon3': '2.518', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.279', 'FRAGCOUNT': '46.000'} [2023-02-25 13:37:23,898][36140] DAMAGECOUNT value on done: 341937.0 [2023-02-25 13:37:23,898][36140] Sum rewards: 57.877, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.115', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.046', 'AMMO4': '0.105', 'weapon4': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon2': '0.728', 'WEAPON3': '1.350', 'weapon3': '2.844', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.600', 'FRAGCOUNT': '51.000'} [2023-02-25 13:37:23,978][36157] DAMAGECOUNT value on done: 349418.0 [2023-02-25 13:37:23,978][36157] Sum rewards: 54.613, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.707', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.128', 'AMMO4': '0.180', 'AMMO3': '0.191', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON4': '0.400', 'weapon4': '0.618', 'WEAPON3': '1.200', 'weapon3': '2.510', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.020', 'FRAGCOUNT': '49.000'} [2023-02-25 13:37:24,215][36140] DAMAGECOUNT value on done: 344927.0 [2023-02-25 13:37:24,216][36140] Sum rewards: 51.615, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.757', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.114', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon4': '0.190', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON3': '1.150', 'HITCOUNT': '2.890', 'weapon3': '3.216', 'DAMAGECOUNT': '13.350', 'FRAGCOUNT': '45.000'} [2023-02-25 13:37:24,389][36138] Updated weights for policy 0, policy_version 41683 (0.0009) [2023-02-25 13:37:24,407][36156] DAMAGECOUNT value on done: 351593.0 [2023-02-25 13:37:24,408][36156] Sum rewards: 53.599, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.394', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon5': '0.114', 'AMMO3': '0.135', 'AMMO4': '0.261', 'weapon2': '0.298', 'WEAPON5': '0.400', 'WEAPON4': '0.650', 'WEAPON3': '0.850', 'weapon4': '1.264', 'weapon3': '2.068', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '45.000'} [2023-02-25 13:37:24,519][36140] DAMAGECOUNT value on done: 340704.0 [2023-02-25 13:37:24,519][36140] Sum rewards: 58.947, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.798', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.096', 'AMMO4': '0.102', 'weapon4': '0.148', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.556', 'WEAPON3': '1.300', 'weapon3': '2.954', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.993', 'FRAGCOUNT': '50.000'} [2023-02-25 13:37:24,604][36156] DAMAGECOUNT value on done: 351037.0 [2023-02-25 13:37:24,605][36156] Sum rewards: 49.396, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.457', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.114', 'AMMO4': '0.137', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.334', 'weapon4': '0.798', 'WEAPON3': '1.200', 'weapon3': '2.466', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.700', 'FRAGCOUNT': '42.500'} [2023-02-25 13:37:24,722][36156] DAMAGECOUNT value on done: 344547.0 [2023-02-25 13:37:24,723][36156] Sum rewards: 50.549, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.092', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.060', 'AMMO4': '0.181', 'WEAPON4': '0.200', 'weapon2': '0.214', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon4': '0.484', 'WEAPON3': '1.600', 'weapon3': '2.972', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '13.839', 'FRAGCOUNT': '46.000'} [2023-02-25 13:37:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 170737664. Throughput: 0: 3349.0. Samples: 5175090. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-25 13:37:24,730][36114] Avg episode reward: [(0, '52.163')] [2023-02-25 13:37:24,831][36142] DAMAGECOUNT value on done: 340856.0 [2023-02-25 13:37:24,831][36142] Sum rewards: 63.167, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.022', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.148', 'HEALTH': '0.160', 'weapon4': '0.266', 'weapon2': '0.464', 'WEAPON3': '0.900', 'weapon3': '2.890', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.267', 'FRAGCOUNT': '50.000'} [2023-02-25 13:37:24,929][36156] DAMAGECOUNT value on done: 346662.0 [2023-02-25 13:37:24,930][36156] Sum rewards: 45.378, reward structure: {'DEATHCOUNT': '-22.500', 'HEALTH': '-2.950', 'ARMOR': '0.004', 'AMMO5': '0.031', 'AMMO2': '0.091', 'AMMO3': '0.250', 'weapon5': '0.254', 'weapon2': '0.428', 'AMMO4': '0.457', 'weapon4': '0.538', 'WEAPON5': '0.800', 'WEAPON4': '0.900', 'WEAPON3': '1.400', 'weapon3': '2.334', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.830', 'FRAGCOUNT': '46.500'} [2023-02-25 13:37:25,167][36142] DAMAGECOUNT value on done: 344805.0 [2023-02-25 13:37:25,167][36142] Sum rewards: 48.323, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.118', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'weapon4': '0.102', 'weapon5': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.678', 'WEAPON3': '1.200', 'weapon3': '2.824', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.630', 'FRAGCOUNT': '42.000'} [2023-02-25 13:37:25,180][36142] DAMAGECOUNT value on done: 338499.0 [2023-02-25 13:37:25,180][36142] Sum rewards: 56.077, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.042', 'AMMO4': '0.066', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'weapon2': '0.526', 'HEALTH': '0.585', 'WEAPON3': '0.950', 'weapon3': '3.140', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.091', 'FRAGCOUNT': '45.000'} [2023-02-25 13:37:25,486][36142] DAMAGECOUNT value on done: 352545.0 [2023-02-25 13:37:25,486][36142] Sum rewards: 52.097, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.895', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon5': '0.160', 'AMMO3': '0.184', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.372', 'weapon2': '0.410', 'WEAPON3': '1.200', 'weapon3': '2.830', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.575', 'FRAGCOUNT': '46.000'} [2023-02-25 13:37:27,454][36138] Updated weights for policy 0, policy_version 41693 (0.0009) [2023-02-25 13:37:29,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 170803200. Throughput: 0: 3351.6. Samples: 5195334. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-25 13:37:29,729][36114] Avg episode reward: [(0, '52.299')] [2023-02-25 13:37:30,484][36138] Updated weights for policy 0, policy_version 41703 (0.0010) [2023-02-25 13:37:33,565][36138] Updated weights for policy 0, policy_version 41713 (0.0009) [2023-02-25 13:37:34,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 170872832. Throughput: 0: 3351.1. Samples: 5215510. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-25 13:37:34,730][36114] Avg episode reward: [(0, '52.299')] [2023-02-25 13:37:35,199][36155] DAMAGECOUNT value on done: 341738.0 [2023-02-25 13:37:35,199][36155] Sum rewards: 47.797, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.860', 'AMMO2': '0.010', 'AMMO5': '0.010', 'AMMO4': '0.047', 'weapon5': '0.150', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'weapon2': '0.248', 'WEAPON5': '0.250', 'weapon4': '0.382', 'WEAPON3': '1.050', 'weapon3': '2.874', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.554', 'FRAGCOUNT': '39.500'} [2023-02-25 13:37:35,517][36155] DAMAGECOUNT value on done: 355550.0 [2023-02-25 13:37:35,518][36155] Sum rewards: 44.330, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.452', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.068', 'weapon5': '0.146', 'AMMO3': '0.169', 'weapon2': '0.294', 'AMMO4': '0.342', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'weapon4': '1.084', 'weapon3': '2.054', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '11.709', 'FRAGCOUNT': '41.000'} [2023-02-25 13:37:35,684][36139] DAMAGECOUNT value on done: 351726.0 [2023-02-25 13:37:35,684][36139] Sum rewards: 54.585, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.800', 'AMMO5': '0.010', 'AMMO2': '0.040', 'AMMO4': '0.201', 'weapon5': '0.204', 'weapon2': '0.206', 'AMMO3': '0.218', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.662', 'WEAPON3': '1.250', 'weapon3': '2.612', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.081', 'FRAGCOUNT': '47.000'} [2023-02-25 13:37:35,998][36139] DAMAGECOUNT value on done: 349268.0 [2023-02-25 13:37:35,999][36139] Sum rewards: 48.260, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.650', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon5': '0.090', 'AMMO4': '0.105', 'AMMO3': '0.217', 'weapon4': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.476', 'WEAPON3': '1.350', 'weapon3': '2.942', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.806', 'FRAGCOUNT': '43.000'} [2023-02-25 13:37:36,020][36155] DAMAGECOUNT value on done: 346126.0 [2023-02-25 13:37:36,021][36155] Sum rewards: 61.792, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.390', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.029', 'weapon5': '0.084', 'AMMO4': '0.143', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'WEAPON4': '0.400', 'weapon4': '0.480', 'weapon2': '0.546', 'WEAPON3': '1.250', 'weapon3': '2.656', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.453', 'FRAGCOUNT': '55.000'} [2023-02-25 13:37:36,323][36155] DAMAGECOUNT value on done: 347563.0 [2023-02-25 13:37:36,323][36155] Sum rewards: 53.352, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.640', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.110', 'AMMO4': '0.124', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.452', 'ARMOR': '0.455', 'weapon4': '0.548', 'WEAPON3': '1.350', 'weapon3': '2.562', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.274', 'FRAGCOUNT': '48.000'} [2023-02-25 13:37:36,564][36138] Updated weights for policy 0, policy_version 41723 (0.0009) [2023-02-25 13:37:36,606][36139] DAMAGECOUNT value on done: 347937.0 [2023-02-25 13:37:36,606][36139] Sum rewards: 46.822, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.258', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.047', 'AMMO3': '0.171', 'weapon2': '0.198', 'AMMO4': '0.236', 'weapon5': '0.332', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.926', 'WEAPON3': '1.050', 'weapon3': '2.104', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '13.905', 'FRAGCOUNT': '40.500'} [2023-02-25 13:37:36,909][36139] DAMAGECOUNT value on done: 347595.0 [2023-02-25 13:37:36,909][36139] Sum rewards: 47.714, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.378', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon5': '0.152', 'AMMO3': '0.199', 'AMMO4': '0.212', 'WEAPON5': '0.400', 'weapon4': '0.406', 'WEAPON4': '0.550', 'weapon2': '0.606', 'WEAPON3': '1.150', 'weapon3': '2.544', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.452', 'FRAGCOUNT': '43.500'} [2023-02-25 13:37:39,624][36138] Updated weights for policy 0, policy_version 41733 (0.0010) [2023-02-25 13:37:39,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 170938368. Throughput: 0: 3352.4. Samples: 5225580. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:37:39,730][36114] Avg episode reward: [(0, '52.200')] [2023-02-25 13:37:40,743][36154] DAMAGECOUNT value on done: 349837.0 [2023-02-25 13:37:40,744][36154] Sum rewards: 53.284, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.380', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.106', 'AMMO4': '0.176', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.300', 'weapon4': '0.530', 'WEAPON3': '1.200', 'weapon3': '2.840', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.407', 'FRAGCOUNT': '46.000'} [2023-02-25 13:37:41,050][36154] DAMAGECOUNT value on done: 344335.0 [2023-02-25 13:37:41,051][36154] Sum rewards: 61.178, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.018', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.023', 'weapon5': '0.062', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon4': '0.266', 'weapon2': '0.678', 'WEAPON3': '1.100', 'weapon3': '2.764', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.961', 'FRAGCOUNT': '50.000'} [2023-02-25 13:37:41,354][36154] DAMAGECOUNT value on done: 343538.0 [2023-02-25 13:37:41,354][36154] Sum rewards: 61.966, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.555', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.042', 'weapon5': '0.180', 'AMMO3': '0.207', 'AMMO4': '0.209', 'weapon2': '0.224', 'weapon4': '0.292', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.020', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.338', 'FRAGCOUNT': '55.000'} [2023-02-25 13:37:41,663][36154] DAMAGECOUNT value on done: 348857.0 [2023-02-25 13:37:41,663][36154] Sum rewards: 54.358, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.682', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO3': '0.125', 'weapon5': '0.136', 'AMMO4': '0.160', 'weapon4': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.800', 'weapon2': '0.998', 'weapon3': '2.442', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '13.350', 'FRAGCOUNT': '44.000'} [2023-02-25 13:37:42,146][36141] DAMAGECOUNT value on done: 354451.0 [2023-02-25 13:37:42,146][36141] Sum rewards: 40.050, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.949', 'ARMOR': '0.012', 'AMMO5': '0.018', 'AMMO2': '0.051', 'AMMO3': '0.157', 'weapon5': '0.186', 'AMMO4': '0.257', 'WEAPON5': '0.400', 'weapon2': '0.482', 'WEAPON4': '0.550', 'weapon4': '0.568', 'WEAPON3': '1.050', 'weapon3': '2.450', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '11.928', 'FRAGCOUNT': '36.000'} [2023-02-25 13:37:42,448][36141] DAMAGECOUNT value on done: 345802.0 [2023-02-25 13:37:42,449][36141] Sum rewards: 55.085, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.602', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.069', 'AMMO3': '0.138', 'weapon5': '0.218', 'weapon2': '0.268', 'AMMO4': '0.343', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '0.900', 'weapon4': '1.012', 'weapon3': '2.198', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '47.000'} [2023-02-25 13:37:42,459][36141] DAMAGECOUNT value on done: 352953.0 [2023-02-25 13:37:42,460][36141] Sum rewards: 44.224, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.224', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.120', 'AMMO4': '0.164', 'AMMO3': '0.247', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.446', 'weapon4': '0.498', 'WEAPON3': '1.450', 'weapon3': '2.656', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.264', 'FRAGCOUNT': '44.000'} [2023-02-25 13:37:42,647][36138] Updated weights for policy 0, policy_version 41743 (0.0009) [2023-02-25 13:37:42,749][36141] DAMAGECOUNT value on done: 336426.0 [2023-02-25 13:37:42,749][36141] Sum rewards: 62.121, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.796', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.060', 'weapon5': '0.098', 'AMMO4': '0.127', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'weapon2': '0.536', 'WEAPON3': '1.600', 'weapon3': '3.078', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '54.500'} [2023-02-25 13:37:43,023][36157] DAMAGECOUNT value on done: 356713.0 [2023-02-25 13:37:43,024][36157] Sum rewards: 56.584, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.704', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.029', 'weapon5': '0.100', 'AMMO4': '0.143', 'weapon4': '0.152', 'AMMO3': '0.193', 'weapon2': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.194', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.195', 'FRAGCOUNT': '50.000'} [2023-02-25 13:37:43,329][36157] DAMAGECOUNT value on done: 351913.0 [2023-02-25 13:37:43,330][36157] Sum rewards: 43.557, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.475', 'AMMO5': '0.009', 'weapon5': '0.020', 'AMMO2': '0.029', 'AMMO4': '0.144', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'weapon4': '0.352', 'weapon2': '0.456', 'WEAPON3': '1.450', 'weapon3': '2.928', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.155', 'FRAGCOUNT': '41.000'} [2023-02-25 13:37:43,673][36140] DAMAGECOUNT value on done: 356772.0 [2023-02-25 13:37:43,674][36140] Sum rewards: 46.580, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.850', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.092', 'AMMO4': '0.127', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'weapon2': '0.342', 'WEAPON4': '0.400', 'weapon4': '0.792', 'WEAPON3': '1.050', 'weapon3': '2.454', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.192', 'FRAGCOUNT': '39.000'} [2023-02-25 13:37:43,690][36157] DAMAGECOUNT value on done: 353895.0 [2023-02-25 13:37:43,691][36157] Sum rewards: 57.969, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.370', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.016', 'AMMO4': '0.028', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.218', 'weapon2': '0.712', 'WEAPON3': '1.400', 'weapon3': '3.048', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.433', 'FRAGCOUNT': '50.000'} [2023-02-25 13:37:43,988][36140] DAMAGECOUNT value on done: 346304.0 [2023-02-25 13:37:43,989][36140] Sum rewards: 54.684, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.482', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.100', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.454', 'weapon4': '0.600', 'WEAPON3': '0.900', 'weapon3': '2.512', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.101', 'FRAGCOUNT': '45.000'} [2023-02-25 13:37:43,991][36157] DAMAGECOUNT value on done: 353704.0 [2023-02-25 13:37:43,992][36157] Sum rewards: 44.683, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.815', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.153', 'weapon5': '0.168', 'AMMO3': '0.184', 'weapon2': '0.226', 'WEAPON5': '0.300', 'weapon4': '0.326', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.540', 'weapon3': '2.998', 'DAMAGECOUNT': '12.858', 'FRAGCOUNT': '40.000'} [2023-02-25 13:37:44,294][36140] DAMAGECOUNT value on done: 349659.0 [2023-02-25 13:37:44,295][36140] Sum rewards: 50.419, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.198', 'AMMO5': '0.011', 'ARMOR': '0.028', 'AMMO2': '0.032', 'weapon5': '0.098', 'AMMO4': '0.157', 'weapon2': '0.198', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.532', 'WEAPON3': '1.300', 'weapon3': '2.688', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.196', 'FRAGCOUNT': '44.500'} [2023-02-25 13:37:44,497][36156] DAMAGECOUNT value on done: 357068.0 [2023-02-25 13:37:44,497][36156] Sum rewards: 53.117, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.762', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon5': '0.156', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.364', 'weapon4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.742', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '42.000'} [2023-02-25 13:37:44,592][36140] DAMAGECOUNT value on done: 345212.0 [2023-02-25 13:37:44,593][36140] Sum rewards: 40.765, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-4.372', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon5': '0.222', 'AMMO3': '0.237', 'AMMO4': '0.248', 'weapon2': '0.350', 'WEAPON5': '0.400', 'ARMOR': '0.456', 'weapon4': '0.692', 'WEAPON4': '0.700', 'WEAPON3': '1.450', 'weapon3': '2.334', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.524', 'FRAGCOUNT': '41.000'} [2023-02-25 13:37:44,658][36156] DAMAGECOUNT value on done: 355904.0 [2023-02-25 13:37:44,658][36156] Sum rewards: 51.820, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.840', 'AMMO5': '0.019', 'AMMO2': '0.047', 'AMMO3': '0.132', 'weapon5': '0.172', 'AMMO4': '0.235', 'weapon4': '0.430', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.592', 'WEAPON3': '0.850', 'weapon3': '2.502', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.601', 'FRAGCOUNT': '43.000'} [2023-02-25 13:37:44,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 171003904. Throughput: 0: 3354.3. Samples: 5245796. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:37:44,730][36114] Avg episode reward: [(0, '52.006')] [2023-02-25 13:37:44,810][36142] DAMAGECOUNT value on done: 344000.0 [2023-02-25 13:37:44,810][36142] Sum rewards: 36.076, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.176', 'AMMO5': '0.007', 'AMMO2': '0.012', 'ARMOR': '0.020', 'AMMO4': '0.060', 'weapon5': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.135', 'WEAPON5': '0.150', 'weapon4': '0.196', 'weapon2': '0.816', 'WEAPON3': '0.850', 'HITCOUNT': '1.910', 'weapon3': '2.504', 'DAMAGECOUNT': '9.432', 'FRAGCOUNT': '28.500'} [2023-02-25 13:37:44,844][36156] DAMAGECOUNT value on done: 349464.0 [2023-02-25 13:37:44,845][36156] Sum rewards: 54.787, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.286', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.184', 'AMMO4': '0.231', 'AMMO3': '0.236', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.438', 'weapon4': '0.670', 'WEAPON3': '1.350', 'weapon3': '2.404', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.751', 'FRAGCOUNT': '48.000'} [2023-02-25 13:37:45,012][36156] DAMAGECOUNT value on done: 350853.0 [2023-02-25 13:37:45,012][36156] Sum rewards: 51.203, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.996', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.076', 'weapon5': '0.094', 'AMMO3': '0.161', 'AMMO4': '0.162', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.732', 'WEAPON3': '0.900', 'weapon3': '2.878', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '12.573', 'FRAGCOUNT': '43.000'} [2023-02-25 13:37:45,134][36142] DAMAGECOUNT value on done: 349073.0 [2023-02-25 13:37:45,135][36142] Sum rewards: 47.708, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.760', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO4': '0.178', 'AMMO3': '0.195', 'weapon5': '0.224', 'weapon2': '0.290', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.472', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '12.804', 'FRAGCOUNT': '42.000'} [2023-02-25 13:37:45,145][36142] DAMAGECOUNT value on done: 343434.0 [2023-02-25 13:37:45,146][36142] Sum rewards: 56.947, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.802', 'ARMOR': '0.004', 'AMMO2': '0.020', 'weapon7': '0.056', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon4': '0.164', 'AMMO3': '0.193', 'WEAPON7': '0.200', 'weapon2': '0.284', 'WEAPON3': '1.300', 'HITCOUNT': '3.020', 'weapon3': '3.182', 'DAMAGECOUNT': '14.805', 'FRAGCOUNT': '48.000'} [2023-02-25 13:37:45,443][36142] DAMAGECOUNT value on done: 356765.0 [2023-02-25 13:37:45,443][36142] Sum rewards: 46.688, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.815', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.072', 'weapon4': '0.104', 'AMMO3': '0.133', 'AMMO4': '0.139', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.754', 'WEAPON3': '0.900', 'HITCOUNT': '2.830', 'weapon3': '2.926', 'DAMAGECOUNT': '12.660', 'FRAGCOUNT': '38.000'} [2023-02-25 13:37:45,689][36138] Updated weights for policy 0, policy_version 41753 (0.0009) [2023-02-25 13:37:48,716][36138] Updated weights for policy 0, policy_version 41763 (0.0009) [2023-02-25 13:37:49,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 171073536. Throughput: 0: 3361.3. Samples: 5266102. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:37:49,730][36114] Avg episode reward: [(0, '51.787')] [2023-02-25 13:37:51,740][36138] Updated weights for policy 0, policy_version 41773 (0.0009) [2023-02-25 13:37:54,390][36141] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 13:37:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 171139072. Throughput: 0: 3361.7. Samples: 5276234. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:37:54,729][36114] Avg episode reward: [(0, '51.787')] [2023-02-25 13:37:54,789][36138] Updated weights for policy 0, policy_version 41783 (0.0009) [2023-02-25 13:37:54,968][36155] DAMAGECOUNT value on done: 346179.0 [2023-02-25 13:37:54,968][36155] Sum rewards: 44.135, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.511', 'AMMO5': '0.017', 'AMMO2': '0.062', 'AMMO3': '0.212', 'weapon5': '0.236', 'AMMO4': '0.308', 'weapon2': '0.392', 'WEAPON5': '0.450', 'weapon4': '0.530', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.506', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.323', 'FRAGCOUNT': '40.500'} [2023-02-25 13:37:55,280][36155] DAMAGECOUNT value on done: 360285.0 [2023-02-25 13:37:55,280][36155] Sum rewards: 55.460, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.157', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon2': '0.284', 'weapon4': '0.384', 'WEAPON3': '1.300', 'weapon3': '3.066', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.205', 'FRAGCOUNT': '48.000'} [2023-02-25 13:37:55,627][36139] DAMAGECOUNT value on done: 356007.0 [2023-02-25 13:37:55,628][36139] Sum rewards: 52.037, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.895', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.134', 'AMMO3': '0.176', 'AMMO4': '0.179', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON4': '0.450', 'weapon4': '0.682', 'WEAPON3': '1.150', 'weapon3': '2.606', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.843', 'FRAGCOUNT': '46.000'} [2023-02-25 13:37:55,792][36155] DAMAGECOUNT value on done: 351103.0 [2023-02-25 13:37:55,793][36155] Sum rewards: 55.377, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.462', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon5': '0.036', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.080', 'WEAPON5': '0.150', 'weapon2': '0.178', 'AMMO3': '0.287', 'WEAPON3': '1.750', 'HITCOUNT': '3.170', 'weapon3': '3.450', 'DAMAGECOUNT': '14.871', 'FRAGCOUNT': '51.000'} [2023-02-25 13:37:55,952][36139] DAMAGECOUNT value on done: 353997.0 [2023-02-25 13:37:55,953][36139] Sum rewards: 56.530, reward structure: {'DEATHCOUNT': '-13.500', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.049', 'HEALTH': '0.083', 'weapon5': '0.140', 'AMMO3': '0.161', 'WEAPON5': '0.200', 'AMMO4': '0.244', 'weapon2': '0.338', 'WEAPON4': '0.350', 'weapon4': '0.850', 'WEAPON3': '0.900', 'weapon3': '2.424', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.187', 'FRAGCOUNT': '47.000'} [2023-02-25 13:37:56,098][36155] DAMAGECOUNT value on done: 351861.0 [2023-02-25 13:37:56,098][36155] Sum rewards: 44.803, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.172', 'AMMO5': '0.011', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon4': '0.082', 'WEAPON4': '0.100', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.558', 'WEAPON3': '1.100', 'HITCOUNT': '2.880', 'weapon3': '3.076', 'DAMAGECOUNT': '12.894', 'FRAGCOUNT': '36.500'} [2023-02-25 13:37:56,584][36139] DAMAGECOUNT value on done: 353278.0 [2023-02-25 13:37:56,584][36139] Sum rewards: 65.855, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.090', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO4': '0.032', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'weapon4': '0.236', 'weapon2': '0.394', 'WEAPON3': '1.250', 'weapon3': '3.154', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.023', 'FRAGCOUNT': '55.000'} [2023-02-25 13:37:56,903][36139] DAMAGECOUNT value on done: 351490.0 [2023-02-25 13:37:56,904][36139] Sum rewards: 46.282, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.718', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.052', 'AMMO3': '0.162', 'AMMO4': '0.262', 'weapon5': '0.266', 'weapon2': '0.292', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.996', 'WEAPON3': '1.050', 'weapon3': '2.170', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '11.685', 'FRAGCOUNT': '41.000'} [2023-02-25 13:37:57,861][36138] Updated weights for policy 0, policy_version 41793 (0.0009) [2023-02-25 13:37:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 171208704. Throughput: 0: 3361.1. Samples: 5296312. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:37:59,730][36114] Avg episode reward: [(0, '51.912')] [2023-02-25 13:38:00,655][36154] DAMAGECOUNT value on done: 354407.0 [2023-02-25 13:38:00,656][36154] Sum rewards: 58.281, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.818', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.138', 'AMMO3': '0.155', 'weapon4': '0.172', 'weapon2': '0.640', 'WEAPON3': '1.000', 'HITCOUNT': '2.630', 'weapon3': '2.858', 'DAMAGECOUNT': '13.710', 'FRAGCOUNT': '48.000'} [2023-02-25 13:38:00,904][36138] Updated weights for policy 0, policy_version 41803 (0.0009) [2023-02-25 13:38:00,970][36154] DAMAGECOUNT value on done: 348555.0 [2023-02-25 13:38:00,970][36154] Sum rewards: 44.667, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.920', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO3': '0.171', 'weapon5': '0.174', 'AMMO4': '0.213', 'WEAPON5': '0.400', 'weapon2': '0.422', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'weapon4': '1.034', 'weapon3': '2.006', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.603', 'FRAGCOUNT': '38.000'} [2023-02-25 13:38:01,304][36154] DAMAGECOUNT value on done: 348081.0 [2023-02-25 13:38:01,304][36154] Sum rewards: 47.123, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-0.390', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon5': '0.110', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'AMMO4': '0.257', 'weapon2': '0.312', 'WEAPON4': '0.500', 'weapon4': '0.644', 'WEAPON3': '1.300', 'weapon3': '2.638', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.629', 'FRAGCOUNT': '44.000'} [2023-02-25 13:38:01,612][36154] DAMAGECOUNT value on done: 353337.0 [2023-02-25 13:38:01,613][36154] Sum rewards: 52.155, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.564', 'AMMO4': '-0.018', 'AMMO2': '-0.003', 'AMMO3': '0.206', 'weapon2': '0.796', 'WEAPON3': '1.250', 'HITCOUNT': '3.000', 'weapon3': '3.048', 'DAMAGECOUNT': '13.440', 'FRAGCOUNT': '44.000'} [2023-02-25 13:38:01,891][36141] DAMAGECOUNT value on done: 358976.0 [2023-02-25 13:38:01,891][36141] Sum rewards: 46.045, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.122', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.188', 'weapon5': '0.208', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.352', 'weapon4': '0.358', 'WEAPON3': '1.200', 'weapon3': '2.776', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.575', 'FRAGCOUNT': '40.000'} [2023-02-25 13:38:02,204][36141] DAMAGECOUNT value on done: 356727.0 [2023-02-25 13:38:02,204][36141] Sum rewards: 42.749, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.696', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.039', 'weapon5': '0.104', 'AMMO3': '0.153', 'AMMO4': '0.193', 'WEAPON5': '0.300', 'weapon2': '0.510', 'WEAPON4': '0.600', 'weapon4': '0.676', 'WEAPON3': '0.950', 'weapon3': '2.474', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '11.322', 'FRAGCOUNT': '39.000'} [2023-02-25 13:38:02,229][36141] DAMAGECOUNT value on done: 350612.0 [2023-02-25 13:38:02,230][36141] Sum rewards: 55.823, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.468', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO3': '0.192', 'weapon5': '0.210', 'AMMO4': '0.223', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.422', 'weapon4': '0.776', 'WEAPON3': '1.150', 'weapon3': '2.328', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.430', 'FRAGCOUNT': '48.500'} [2023-02-25 13:38:02,547][36141] DAMAGECOUNT value on done: 340345.0 [2023-02-25 13:38:02,548][36141] Sum rewards: 42.504, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.286', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.046', 'AMMO3': '0.156', 'weapon5': '0.162', 'AMMO4': '0.232', 'weapon2': '0.386', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.684', 'WEAPON3': '0.950', 'weapon3': '2.446', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '11.757', 'FRAGCOUNT': '35.500'} [2023-02-25 13:38:03,005][36157] DAMAGECOUNT value on done: 361222.0 [2023-02-25 13:38:03,006][36157] Sum rewards: 45.851, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.222', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.035', 'AMMO4': '0.175', 'weapon2': '0.178', 'weapon5': '0.228', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.500', 'WEAPON3': '1.500', 'HITCOUNT': '2.720', 'weapon3': '2.742', 'DAMAGECOUNT': '13.527', 'FRAGCOUNT': '42.000'} [2023-02-25 13:38:03,311][36157] DAMAGECOUNT value on done: 356978.0 [2023-02-25 13:38:03,312][36157] Sum rewards: 56.176, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.650', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.125', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon4': '0.322', 'weapon2': '0.370', 'WEAPON3': '1.350', 'weapon3': '2.974', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.195', 'FRAGCOUNT': '48.000'} [2023-02-25 13:38:03,679][36157] DAMAGECOUNT value on done: 358192.0 [2023-02-25 13:38:03,680][36157] Sum rewards: 57.231, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.004', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.049', 'weapon5': '0.100', 'AMMO3': '0.136', 'WEAPON5': '0.200', 'AMMO4': '0.243', 'WEAPON4': '0.350', 'weapon2': '0.484', 'WEAPON3': '0.800', 'weapon4': '0.902', 'weapon3': '2.234', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '12.831', 'FRAGCOUNT': '47.000'} [2023-02-25 13:38:03,764][36140] DAMAGECOUNT value on done: 360973.0 [2023-02-25 13:38:03,764][36140] Sum rewards: 44.113, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.470', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.094', 'AMMO4': '0.124', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'weapon4': '0.324', 'weapon2': '0.660', 'WEAPON3': '1.300', 'weapon3': '2.662', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.603', 'FRAGCOUNT': '39.500'} [2023-02-25 13:38:03,961][36138] Updated weights for policy 0, policy_version 41813 (0.0009) [2023-02-25 13:38:03,992][36157] DAMAGECOUNT value on done: 358806.0 [2023-02-25 13:38:03,993][36157] Sum rewards: 57.725, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.226', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.158', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON4': '0.350', 'ARMOR': '0.456', 'weapon4': '0.502', 'WEAPON3': '1.300', 'weapon3': '2.798', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.306', 'FRAGCOUNT': '51.000'} [2023-02-25 13:38:04,077][36140] DAMAGECOUNT value on done: 350274.0 [2023-02-25 13:38:04,078][36140] Sum rewards: 45.870, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.256', 'AMMO5': '0.018', 'AMMO2': '0.039', 'weapon5': '0.072', 'AMMO4': '0.194', 'AMMO3': '0.204', 'weapon2': '0.334', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.620', 'WEAPON3': '1.200', 'weapon3': '2.654', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '11.910', 'FRAGCOUNT': '43.000'} [2023-02-25 13:38:04,348][36140] DAMAGECOUNT value on done: 353664.0 [2023-02-25 13:38:04,349][36140] Sum rewards: 48.091, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.670', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.192', 'weapon2': '0.976', 'WEAPON3': '1.100', 'HITCOUNT': '2.810', 'weapon3': '2.858', 'DAMAGECOUNT': '12.015', 'FRAGCOUNT': '40.000'} [2023-02-25 13:38:04,539][36156] DAMAGECOUNT value on done: 362270.0 [2023-02-25 13:38:04,539][36156] Sum rewards: 55.236, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.190', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon5': '0.176', 'AMMO3': '0.185', 'weapon4': '0.198', 'AMMO4': '0.200', 'weapon2': '0.396', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.798', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '48.000'} [2023-02-25 13:38:04,668][36140] DAMAGECOUNT value on done: 350032.0 [2023-02-25 13:38:04,669][36140] Sum rewards: 60.560, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO2': '0.002', 'AMMO4': '0.008', 'HEALTH': '0.061', 'AMMO3': '0.213', 'weapon2': '0.236', 'WEAPON3': '1.200', 'HITCOUNT': '3.250', 'weapon3': '3.630', 'DAMAGECOUNT': '14.460', 'FRAGCOUNT': '51.000'} [2023-02-25 13:38:04,721][36156] DAMAGECOUNT value on done: 360747.0 [2023-02-25 13:38:04,721][36156] Sum rewards: 64.296, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.301', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.085', 'AMMO3': '0.134', 'weapon4': '0.164', 'weapon5': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.682', 'WEAPON3': '0.850', 'weapon3': '2.776', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.529', 'FRAGCOUNT': '51.000'} [2023-02-25 13:38:04,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 171274240. Throughput: 0: 3362.2. Samples: 5316450. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:38:04,730][36114] Avg episode reward: [(0, '51.816')] [2023-02-25 13:38:04,839][36142] DAMAGECOUNT value on done: 348057.0 [2023-02-25 13:38:04,840][36142] Sum rewards: 43.627, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.860', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon5': '0.084', 'AMMO4': '0.095', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.932', 'WEAPON3': '0.950', 'weapon3': '2.550', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.171', 'FRAGCOUNT': '37.000'} [2023-02-25 13:38:04,860][36156] DAMAGECOUNT value on done: 354179.0 [2023-02-25 13:38:04,860][36156] Sum rewards: 46.236, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.950', 'ARMOR': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.042', 'AMMO4': '0.210', 'AMMO3': '0.259', 'weapon5': '0.266', 'weapon2': '0.298', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.530', 'WEAPON3': '1.500', 'weapon3': '2.488', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '14.145', 'FRAGCOUNT': '44.500'} [2023-02-25 13:38:05,033][36156] DAMAGECOUNT value on done: 355715.0 [2023-02-25 13:38:05,033][36156] Sum rewards: 54.642, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.960', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.088', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.180', 'AMMO3': '0.210', 'weapon4': '0.328', 'WEAPON3': '1.200', 'weapon3': '3.160', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.586', 'FRAGCOUNT': '45.000'} [2023-02-25 13:38:05,138][36142] DAMAGECOUNT value on done: 352403.0 [2023-02-25 13:38:05,139][36142] Sum rewards: 38.092, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.170', 'AMMO5': '0.010', 'AMMO2': '0.042', 'AMMO3': '0.126', 'weapon2': '0.194', 'AMMO4': '0.210', 'weapon5': '0.268', 'WEAPON5': '0.300', 'ARMOR': '0.404', 'WEAPON4': '0.550', 'WEAPON3': '0.750', 'weapon4': '1.426', 'weapon3': '1.602', 'HITCOUNT': '2.390', 'DAMAGECOUNT': '9.990', 'FRAGCOUNT': '33.000'} [2023-02-25 13:38:05,151][36142] DAMAGECOUNT value on done: 347450.0 [2023-02-25 13:38:05,151][36142] Sum rewards: 46.484, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.495', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.144', 'AMMO3': '0.156', 'AMMO4': '0.158', 'weapon2': '0.210', 'weapon4': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '2.570', 'weapon3': '3.062', 'DAMAGECOUNT': '12.048', 'FRAGCOUNT': '39.000'} [2023-02-25 13:38:05,449][36142] DAMAGECOUNT value on done: 361102.0 [2023-02-25 13:38:05,449][36142] Sum rewards: 44.573, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.372', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon2': '0.182', 'weapon5': '0.188', 'AMMO3': '0.210', 'AMMO4': '0.213', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.510', 'WEAPON3': '1.200', 'weapon3': '2.524', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '13.011', 'FRAGCOUNT': '39.500'} [2023-02-25 13:38:06,975][36138] Updated weights for policy 0, policy_version 41823 (0.0009) [2023-02-25 13:38:09,176][36139] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 13:38:09,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13412.7). Total num frames: 171343872. Throughput: 0: 3368.5. Samples: 5326674. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:38:09,729][36114] Avg episode reward: [(0, '51.308')] [2023-02-25 13:38:10,009][36138] Updated weights for policy 0, policy_version 41833 (0.0009) [2023-02-25 13:38:13,046][36138] Updated weights for policy 0, policy_version 41843 (0.0009) [2023-02-25 13:38:13,860][36139] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 13:38:14,729][36114] Fps is (10 sec: 13517.0, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 171409408. Throughput: 0: 3369.2. Samples: 5346948. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:38:14,729][36114] Avg episode reward: [(0, '51.308')] [2023-02-25 13:38:14,748][36155] DAMAGECOUNT value on done: 351054.0 [2023-02-25 13:38:14,748][36155] Sum rewards: 60.617, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.742', 'AMMO5': '0.006', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.100', 'weapon4': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.212', 'AMMO3': '0.228', 'WEAPON3': '1.400', 'HITCOUNT': '3.110', 'weapon3': '3.324', 'DAMAGECOUNT': '14.595', 'FRAGCOUNT': '54.000'} [2023-02-25 13:38:15,049][36155] DAMAGECOUNT value on done: 363136.0 [2023-02-25 13:38:15,050][36155] Sum rewards: 29.604, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.810', 'AMMO5': '0.007', 'AMMO2': '0.034', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.130', 'AMMO3': '0.133', 'weapon5': '0.152', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.202', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'weapon4': '1.272', 'weapon3': '1.752', 'HITCOUNT': '1.920', 'DAMAGECOUNT': '8.553', 'FRAGCOUNT': '24.500'} [2023-02-25 13:38:15,535][36155] DAMAGECOUNT value on done: 355625.0 [2023-02-25 13:38:15,536][36155] Sum rewards: 46.269, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.605', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO2': '0.018', 'AMMO4': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'weapon4': '0.258', 'weapon2': '0.420', 'WEAPON3': '1.500', 'weapon3': '3.046', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.566', 'FRAGCOUNT': '42.000'} [2023-02-25 13:38:15,543][36139] DAMAGECOUNT value on done: 360555.0 [2023-02-25 13:38:15,543][36139] Sum rewards: 44.245, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.626', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.192', 'weapon5': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.386', 'WEAPON4': '0.400', 'weapon4': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.312', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.545', 'FRAGCOUNT': '38.000'} [2023-02-25 13:38:15,817][36155] DAMAGECOUNT value on done: 354882.0 [2023-02-25 13:38:15,817][36155] Sum rewards: 34.694, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.382', 'AMMO5': '0.010', 'AMMO2': '0.041', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.110', 'AMMO3': '0.111', 'weapon2': '0.152', 'weapon5': '0.204', 'AMMO4': '0.207', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '0.650', 'weapon4': '0.966', 'weapon3': '1.482', 'HITCOUNT': '1.680', 'DAMAGECOUNT': '9.063', 'FRAGCOUNT': '30.000'} [2023-02-25 13:38:15,849][36139] DAMAGECOUNT value on done: 358117.0 [2023-02-25 13:38:15,850][36139] Sum rewards: 45.711, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.337', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon7': '0.080', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.108', 'AMMO4': '0.135', 'AMMO3': '0.177', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.450', 'ARMOR': '0.477', 'weapon4': '0.676', 'WEAPON3': '1.200', 'weapon3': '2.388', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.360', 'FRAGCOUNT': '40.000'} [2023-02-25 13:38:16,108][36138] Updated weights for policy 0, policy_version 41853 (0.0009) [2023-02-25 13:38:16,466][36139] DAMAGECOUNT value on done: 357681.0 [2023-02-25 13:38:16,467][36139] Sum rewards: 44.903, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.280', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.028', 'AMMO4': '0.064', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.257', 'weapon2': '0.370', 'WEAPON3': '1.600', 'HITCOUNT': '2.740', 'weapon3': '3.250', 'DAMAGECOUNT': '13.209', 'FRAGCOUNT': '42.000'} [2023-02-25 13:38:16,772][36139] DAMAGECOUNT value on done: 356417.0 [2023-02-25 13:38:16,772][36139] Sum rewards: 57.059, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.160', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon5': '0.070', 'AMMO4': '0.093', 'AMMO3': '0.238', 'weapon2': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.404', 'WEAPON3': '1.450', 'weapon3': '2.858', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '14.781', 'FRAGCOUNT': '52.500'} [2023-02-25 13:38:19,156][36138] Updated weights for policy 0, policy_version 41863 (0.0009) [2023-02-25 13:38:19,247][36140] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.012, -4.0), ('weapon5', 0.002)] [2023-02-25 13:38:19,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 171474944. Throughput: 0: 3369.6. Samples: 5367144. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:38:19,730][36114] Avg episode reward: [(0, '50.685')] [2023-02-25 13:38:20,649][36154] DAMAGECOUNT value on done: 359049.0 [2023-02-25 13:38:20,649][36154] Sum rewards: 50.207, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.340', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon5': '0.124', 'AMMO4': '0.153', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.358', 'weapon4': '0.480', 'WEAPON3': '1.400', 'weapon3': '2.640', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.926', 'FRAGCOUNT': '44.000'} [2023-02-25 13:38:20,965][36154] DAMAGECOUNT value on done: 353090.0 [2023-02-25 13:38:20,965][36154] Sum rewards: 48.900, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.112', 'AMMO5': '0.008', 'weapon5': '0.036', 'AMMO2': '0.042', 'weapon4': '0.178', 'WEAPON5': '0.200', 'AMMO4': '0.208', 'AMMO3': '0.243', 'weapon2': '0.308', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '2.810', 'weapon3': '3.274', 'DAMAGECOUNT': '13.605', 'FRAGCOUNT': '45.000'} [2023-02-25 13:38:21,140][36157] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:38:21,281][36154] DAMAGECOUNT value on done: 352134.0 [2023-02-25 13:38:21,282][36154] Sum rewards: 48.051, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.656', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.031', 'weapon5': '0.098', 'AMMO3': '0.144', 'AMMO4': '0.154', 'weapon4': '0.216', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.552', 'WEAPON3': '0.950', 'HITCOUNT': '2.630', 'weapon3': '2.950', 'DAMAGECOUNT': '12.159', 'FRAGCOUNT': '41.000'} [2023-02-25 13:38:21,589][36154] DAMAGECOUNT value on done: 358677.0 [2023-02-25 13:38:21,589][36154] Sum rewards: 62.296, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.076', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.188', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.278', 'weapon2': '0.288', 'WEAPON3': '1.250', 'weapon3': '3.014', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '53.000'} [2023-02-25 13:38:21,786][36141] DAMAGECOUNT value on done: 363343.0 [2023-02-25 13:38:21,787][36141] Sum rewards: 51.529, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.788', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.016', 'weapon5': '0.020', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.190', 'weapon2': '0.566', 'WEAPON3': '1.250', 'HITCOUNT': '2.800', 'weapon3': '3.236', 'DAMAGECOUNT': '13.101', 'FRAGCOUNT': '44.000'} [2023-02-25 13:38:22,094][36141] DAMAGECOUNT value on done: 361448.0 [2023-02-25 13:38:22,094][36141] Sum rewards: 55.271, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.830', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'weapon5': '0.108', 'AMMO4': '0.148', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.358', 'weapon2': '0.364', 'WEAPON3': '1.200', 'weapon3': '2.930', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.163', 'FRAGCOUNT': '47.000'} [2023-02-25 13:38:22,185][36141] DAMAGECOUNT value on done: 355636.0 [2023-02-25 13:38:22,185][36141] Sum rewards: 49.332, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.114', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon5': '0.090', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'weapon2': '0.288', 'weapon4': '0.370', 'WEAPON3': '1.400', 'weapon3': '2.904', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.072', 'FRAGCOUNT': '43.500'} [2023-02-25 13:38:22,187][36138] Updated weights for policy 0, policy_version 41873 (0.0009) [2023-02-25 13:38:22,488][36141] DAMAGECOUNT value on done: 345007.0 [2023-02-25 13:38:22,489][36141] Sum rewards: 52.428, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.408', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.116', 'AMMO4': '0.133', 'AMMO3': '0.236', 'weapon2': '0.250', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.460', 'WEAPON3': '1.400', 'weapon3': '2.904', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.986', 'FRAGCOUNT': '49.000'} [2023-02-25 13:38:23,029][36157] DAMAGECOUNT value on done: 366110.0 [2023-02-25 13:38:23,029][36157] Sum rewards: 58.472, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.702', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.059', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.152', 'AMMO3': '0.183', 'weapon4': '0.326', 'weapon2': '0.776', 'WEAPON3': '1.150', 'weapon3': '2.484', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.664', 'FRAGCOUNT': '49.000'} [2023-02-25 13:38:23,364][36157] DAMAGECOUNT value on done: 362441.0 [2023-02-25 13:38:23,365][36157] Sum rewards: 68.298, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.124', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.110', 'AMMO4': '0.145', 'AMMO3': '0.197', 'WEAPON5': '0.250', 'weapon4': '0.264', 'weapon2': '0.288', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.060', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '58.000'} [2023-02-25 13:38:23,773][36157] DAMAGECOUNT value on done: 362604.0 [2023-02-25 13:38:23,774][36157] Sum rewards: 48.228, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.104', 'AMMO5': '0.023', 'AMMO2': '0.037', 'AMMO3': '0.140', 'AMMO4': '0.186', 'weapon2': '0.192', 'weapon5': '0.278', 'WEAPON4': '0.450', 'ARMOR': '0.494', 'WEAPON5': '0.500', 'weapon4': '0.620', 'WEAPON3': '0.850', 'weapon3': '2.646', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '13.236', 'FRAGCOUNT': '40.500'} [2023-02-25 13:38:23,852][36140] DAMAGECOUNT value on done: 365620.0 [2023-02-25 13:38:23,853][36140] Sum rewards: 53.384, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.034', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'weapon4': '0.206', 'AMMO3': '0.248', 'weapon2': '0.598', 'WEAPON3': '1.450', 'weapon3': '2.944', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.941', 'FRAGCOUNT': '47.000'} [2023-02-25 13:38:24,090][36157] DAMAGECOUNT value on done: 363280.0 [2023-02-25 13:38:24,091][36157] Sum rewards: 57.332, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.464', 'ARMOR': '0.004', 'AMMO5': '0.007', 'weapon5': '0.016', 'AMMO2': '0.028', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.205', 'weapon4': '0.214', 'weapon2': '0.492', 'WEAPON3': '1.250', 'weapon3': '3.080', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.422', 'FRAGCOUNT': '50.000'} [2023-02-25 13:38:24,156][36140] DAMAGECOUNT value on done: 354560.0 [2023-02-25 13:38:24,156][36140] Sum rewards: 49.386, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.610', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'AMMO3': '0.160', 'weapon4': '0.356', 'weapon2': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.660', 'weapon3': '3.110', 'DAMAGECOUNT': '12.858', 'FRAGCOUNT': '40.000'} [2023-02-25 13:38:24,424][36140] DAMAGECOUNT value on done: 358462.0 [2023-02-25 13:38:24,424][36140] Sum rewards: 58.169, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.412', 'AMMO5': '0.019', 'AMMO2': '0.034', 'AMMO3': '0.162', 'AMMO4': '0.169', 'weapon5': '0.200', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.554', 'WEAPON3': '1.000', 'weapon3': '2.648', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.340', 'FRAGCOUNT': '49.000'} [2023-02-25 13:38:24,428][36156] DAMAGECOUNT value on done: 365840.0 [2023-02-25 13:38:24,428][36156] Sum rewards: 38.776, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.659', 'AMMO5': '0.017', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.202', 'AMMO3': '0.212', 'weapon2': '0.330', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.600', 'WEAPON3': '1.200', 'HITCOUNT': '2.500', 'weapon3': '2.582', 'DAMAGECOUNT': '10.710', 'FRAGCOUNT': '37.000'} [2023-02-25 13:38:24,655][36156] DAMAGECOUNT value on done: 365218.0 [2023-02-25 13:38:24,655][36156] Sum rewards: 43.795, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.260', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon4': '0.104', 'weapon5': '0.124', 'AMMO4': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.268', 'weapon2': '0.424', 'WEAPON3': '1.650', 'HITCOUNT': '2.980', 'weapon3': '3.066', 'DAMAGECOUNT': '13.413', 'FRAGCOUNT': '41.000'} [2023-02-25 13:38:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13412.7). Total num frames: 171544576. Throughput: 0: 3370.9. Samples: 5377270. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:38:24,729][36114] Avg episode reward: [(0, '50.899')] [2023-02-25 13:38:24,739][36140] DAMAGECOUNT value on done: 354822.0 [2023-02-25 13:38:24,739][36140] Sum rewards: 48.588, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.528', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.100', 'weapon4': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.263', 'weapon2': '0.462', 'WEAPON3': '1.650', 'weapon3': '3.000', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.370', 'FRAGCOUNT': '45.000'} [2023-02-25 13:38:24,749][36156] DAMAGECOUNT value on done: 357974.0 [2023-02-25 13:38:24,749][36156] Sum rewards: 35.159, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.322', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.063', 'AMMO3': '0.201', 'AMMO4': '0.313', 'weapon5': '0.370', 'WEAPON5': '0.400', 'weapon2': '0.552', 'WEAPON4': '0.600', 'weapon4': '0.712', 'WEAPON3': '1.150', 'weapon3': '1.996', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '11.385', 'FRAGCOUNT': '33.000'} [2023-02-25 13:38:24,786][36142] DAMAGECOUNT value on done: 352265.0 [2023-02-25 13:38:24,786][36142] Sum rewards: 49.917, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.122', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.100', 'AMMO3': '0.118', 'AMMO4': '0.201', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.614', 'weapon2': '0.690', 'WEAPON3': '0.800', 'weapon3': '2.370', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.624', 'FRAGCOUNT': '42.000'} [2023-02-25 13:38:24,978][36156] DAMAGECOUNT value on done: 361362.0 [2023-02-25 13:38:24,979][36156] Sum rewards: 63.376, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.040', 'AMMO5': '0.022', 'AMMO2': '0.055', 'AMMO3': '0.132', 'AMMO4': '0.274', 'weapon5': '0.298', 'weapon2': '0.398', 'WEAPON5': '0.550', 'WEAPON4': '0.550', 'WEAPON3': '0.700', 'weapon4': '0.958', 'weapon3': '2.018', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '51.000'} [2023-02-25 13:38:25,093][36142] DAMAGECOUNT value on done: 355989.0 [2023-02-25 13:38:25,093][36142] Sum rewards: 41.275, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.112', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.048', 'AMMO3': '0.151', 'weapon5': '0.158', 'AMMO4': '0.240', 'WEAPON5': '0.350', 'weapon2': '0.610', 'WEAPON4': '0.650', 'weapon4': '0.864', 'WEAPON3': '0.950', 'weapon3': '1.998', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '10.758', 'FRAGCOUNT': '40.000'} [2023-02-25 13:38:25,106][36142] DAMAGECOUNT value on done: 352007.0 [2023-02-25 13:38:25,106][36142] Sum rewards: 55.946, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.503', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.030', 'weapon5': '0.080', 'AMMO4': '0.087', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.928', 'WEAPON3': '0.950', 'weapon3': '2.792', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.671', 'FRAGCOUNT': '46.000'} [2023-02-25 13:38:25,255][36138] Updated weights for policy 0, policy_version 41883 (0.0009) [2023-02-25 13:38:25,411][36142] DAMAGECOUNT value on done: 365514.0 [2023-02-25 13:38:25,412][36142] Sum rewards: 51.556, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.080', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.206', 'weapon5': '0.230', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.466', 'weapon2': '0.492', 'WEAPON3': '1.300', 'weapon3': '2.540', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '13.236', 'FRAGCOUNT': '46.000'} [2023-02-25 13:38:28,308][36138] Updated weights for policy 0, policy_version 41893 (0.0009) [2023-02-25 13:38:29,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 171610112. Throughput: 0: 3367.5. Samples: 5397334. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:38:29,730][36114] Avg episode reward: [(0, '50.538')] [2023-02-25 13:38:31,337][36138] Updated weights for policy 0, policy_version 41903 (0.0009) [2023-02-25 13:38:34,381][36138] Updated weights for policy 0, policy_version 41913 (0.0009) [2023-02-25 13:38:34,727][36155] DAMAGECOUNT value on done: 355465.0 [2023-02-25 13:38:34,728][36155] Sum rewards: 52.073, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.654', 'AMMO5': '0.014', 'AMMO2': '0.022', 'weapon4': '0.028', 'weapon5': '0.086', 'WEAPON4': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.180', 'WEAPON5': '0.300', 'weapon2': '0.636', 'WEAPON3': '1.200', 'HITCOUNT': '2.550', 'weapon3': '3.018', 'DAMAGECOUNT': '13.233', 'FRAGCOUNT': '45.000'} [2023-02-25 13:38:34,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 171679744. Throughput: 0: 3366.4. Samples: 5417588. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:38:34,729][36114] Avg episode reward: [(0, '50.538')] [2023-02-25 13:38:35,035][36155] DAMAGECOUNT value on done: 367865.0 [2023-02-25 13:38:35,036][36155] Sum rewards: 55.603, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.115', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon5': '0.142', 'AMMO4': '0.148', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.344', 'WEAPON5': '0.350', 'weapon4': '0.588', 'WEAPON3': '1.400', 'weapon3': '2.692', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.187', 'FRAGCOUNT': '49.000'} [2023-02-25 13:38:35,405][36139] DAMAGECOUNT value on done: 365406.0 [2023-02-25 13:38:35,406][36139] Sum rewards: 56.338, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.040', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.086', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.184', 'weapon2': '0.188', 'AMMO3': '0.249', 'WEAPON3': '1.550', 'weapon3': '3.294', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.553', 'FRAGCOUNT': '51.000'} [2023-02-25 13:38:35,532][36155] DAMAGECOUNT value on done: 360345.0 [2023-02-25 13:38:35,532][36155] Sum rewards: 54.547, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.068', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.055', 'AMMO3': '0.130', 'weapon5': '0.198', 'AMMO4': '0.273', 'WEAPON5': '0.350', 'weapon2': '0.364', 'WEAPON4': '0.500', 'WEAPON3': '0.900', 'weapon4': '1.106', 'weapon3': '1.958', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.860', 'FRAGCOUNT': '45.000'} [2023-02-25 13:38:35,702][36139] DAMAGECOUNT value on done: 362376.0 [2023-02-25 13:38:35,703][36139] Sum rewards: 55.265, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.775', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.116', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'weapon4': '0.178', 'WEAPON5': '0.200', 'weapon2': '0.240', 'WEAPON3': '0.850', 'HITCOUNT': '2.720', 'weapon3': '3.310', 'DAMAGECOUNT': '12.777', 'FRAGCOUNT': '45.000'} [2023-02-25 13:38:35,850][36155] DAMAGECOUNT value on done: 359821.0 [2023-02-25 13:38:35,851][36155] Sum rewards: 58.415, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.850', 'AMMO5': '0.010', 'AMMO2': '0.056', 'AMMO3': '0.160', 'weapon5': '0.194', 'AMMO4': '0.282', 'weapon4': '0.290', 'WEAPON5': '0.400', 'weapon2': '0.426', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.740', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.817', 'FRAGCOUNT': '51.000'} [2023-02-25 13:38:36,362][36139] DAMAGECOUNT value on done: 362378.0 [2023-02-25 13:38:36,362][36139] Sum rewards: 55.617, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.384', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'weapon4': '0.056', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO3': '0.177', 'weapon2': '0.432', 'WEAPON3': '1.100', 'HITCOUNT': '2.860', 'weapon3': '3.236', 'DAMAGECOUNT': '14.091', 'FRAGCOUNT': '44.500'} [2023-02-25 13:38:36,676][36139] DAMAGECOUNT value on done: 361562.0 [2023-02-25 13:38:36,677][36139] Sum rewards: 57.953, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.650', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon4': '0.094', 'WEAPON4': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.217', 'weapon2': '0.632', 'WEAPON3': '1.350', 'weapon3': '3.076', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.435', 'FRAGCOUNT': '50.000'} [2023-02-25 13:38:37,437][36138] Updated weights for policy 0, policy_version 41923 (0.0009) [2023-02-25 13:38:39,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 171745280. Throughput: 0: 3363.5. Samples: 5427590. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:38:39,729][36114] Avg episode reward: [(0, '51.027')] [2023-02-25 13:38:40,421][36138] Updated weights for policy 0, policy_version 41933 (0.0010) [2023-02-25 13:38:40,659][36154] DAMAGECOUNT value on done: 363429.0 [2023-02-25 13:38:40,660][36154] Sum rewards: 52.371, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.052', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.251', 'weapon2': '0.794', 'WEAPON3': '1.450', 'weapon3': '3.000', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.140', 'FRAGCOUNT': '46.000'} [2023-02-25 13:38:40,965][36154] DAMAGECOUNT value on done: 358272.0 [2023-02-25 13:38:40,966][36154] Sum rewards: 52.613, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.085', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.140', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.358', 'weapon4': '0.420', 'WEAPON3': '1.300', 'weapon3': '2.850', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.546', 'FRAGCOUNT': '45.000'} [2023-02-25 13:38:41,290][36154] DAMAGECOUNT value on done: 357084.0 [2023-02-25 13:38:41,290][36154] Sum rewards: 48.972, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.447', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.012', 'weapon5': '0.042', 'WEAPON5': '0.150', 'weapon2': '0.204', 'AMMO3': '0.253', 'WEAPON3': '1.600', 'HITCOUNT': '3.120', 'weapon3': '3.478', 'DAMAGECOUNT': '14.565', 'FRAGCOUNT': '43.000'} [2023-02-25 13:38:41,595][36154] DAMAGECOUNT value on done: 363585.0 [2023-02-25 13:38:41,595][36154] Sum rewards: 59.295, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.520', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.140', 'AMMO4': '0.141', 'weapon4': '0.176', 'AMMO3': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.844', 'WEAPON3': '1.050', 'weapon3': '2.602', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.724', 'FRAGCOUNT': '50.000'} [2023-02-25 13:38:41,791][36141] DAMAGECOUNT value on done: 368556.0 [2023-02-25 13:38:41,792][36141] Sum rewards: 64.069, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.122', 'AMMO5': '0.017', 'AMMO2': '0.034', 'weapon5': '0.072', 'AMMO4': '0.171', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'weapon4': '0.278', 'WEAPON4': '0.350', 'weapon2': '0.578', 'WEAPON3': '1.250', 'weapon3': '2.806', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '56.000'} [2023-02-25 13:38:42,103][36141] DAMAGECOUNT value on done: 365776.0 [2023-02-25 13:38:42,103][36141] Sum rewards: 54.558, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.005', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'WEAPON4': '0.250', 'weapon4': '0.320', 'weapon2': '0.424', 'HEALTH': '0.899', 'WEAPON3': '0.900', 'HITCOUNT': '2.790', 'weapon3': '2.922', 'DAMAGECOUNT': '12.984', 'FRAGCOUNT': '46.000'} [2023-02-25 13:38:42,229][36141] DAMAGECOUNT value on done: 359904.0 [2023-02-25 13:38:42,229][36141] Sum rewards: 46.044, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.564', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.163', 'AMMO4': '0.173', 'weapon5': '0.226', 'WEAPON5': '0.350', 'weapon2': '0.398', 'WEAPON4': '0.450', 'weapon4': '0.882', 'WEAPON3': '1.050', 'weapon3': '2.232', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '12.804', 'FRAGCOUNT': '41.000'} [2023-02-25 13:38:42,535][36141] DAMAGECOUNT value on done: 349518.0 [2023-02-25 13:38:42,535][36141] Sum rewards: 52.390, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.732', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'WEAPON4': '0.300', 'weapon2': '0.386', 'weapon4': '0.718', 'WEAPON3': '1.150', 'weapon3': '2.446', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.533', 'FRAGCOUNT': '44.000'} [2023-02-25 13:38:43,074][36157] DAMAGECOUNT value on done: 370836.0 [2023-02-25 13:38:43,075][36157] Sum rewards: 53.622, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.109', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'weapon4': '0.226', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'weapon2': '0.464', 'WEAPON3': '1.500', 'weapon3': '3.070', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.178', 'FRAGCOUNT': '49.000'} [2023-02-25 13:38:43,385][36157] DAMAGECOUNT value on done: 367158.0 [2023-02-25 13:38:43,386][36157] Sum rewards: 50.469, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.835', 'AMMO2': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.232', 'weapon2': '0.478', 'WEAPON3': '1.500', 'HITCOUNT': '3.020', 'weapon3': '3.380', 'DAMAGECOUNT': '14.151', 'FRAGCOUNT': '44.000'} [2023-02-25 13:38:43,472][36138] Updated weights for policy 0, policy_version 41943 (0.0010) [2023-02-25 13:38:43,766][36157] DAMAGECOUNT value on done: 367737.0 [2023-02-25 13:38:43,767][36157] Sum rewards: 62.858, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.010', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.086', 'AMMO4': '0.117', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.324', 'weapon2': '0.326', 'WEAPON3': '1.250', 'weapon3': '3.048', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.399', 'FRAGCOUNT': '54.000'} [2023-02-25 13:38:43,899][36140] DAMAGECOUNT value on done: 370405.0 [2023-02-25 13:38:43,900][36140] Sum rewards: 53.977, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.357', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO3': '0.127', 'AMMO4': '0.175', 'weapon5': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.384', 'weapon4': '0.510', 'WEAPON3': '0.850', 'HITCOUNT': '2.630', 'weapon3': '2.662', 'DAMAGECOUNT': '14.355', 'FRAGCOUNT': '44.000'} [2023-02-25 13:38:44,073][36157] DAMAGECOUNT value on done: 368201.0 [2023-02-25 13:38:44,073][36157] Sum rewards: 48.143, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.192', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.134', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON4': '0.350', 'weapon4': '0.356', 'WEAPON3': '1.350', 'weapon3': '2.970', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.619', 'FRAGCOUNT': '43.000'} [2023-02-25 13:38:44,208][36140] DAMAGECOUNT value on done: 358889.0 [2023-02-25 13:38:44,209][36140] Sum rewards: 51.685, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.575', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.108', 'AMMO4': '0.138', 'AMMO3': '0.201', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.300', 'weapon2': '0.658', 'WEAPON3': '1.200', 'weapon3': '2.702', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.987', 'FRAGCOUNT': '46.000'} [2023-02-25 13:38:44,412][36156] DAMAGECOUNT value on done: 370324.0 [2023-02-25 13:38:44,413][36156] Sum rewards: 48.515, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.730', 'ARMOR': '0.004', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.066', 'AMMO3': '0.152', 'weapon5': '0.210', 'AMMO4': '0.331', 'WEAPON5': '0.450', 'weapon2': '0.502', 'WEAPON4': '0.550', 'weapon4': '0.560', 'WEAPON3': '1.000', 'weapon3': '2.478', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.452', 'FRAGCOUNT': '42.000'} [2023-02-25 13:38:44,489][36140] DAMAGECOUNT value on done: 362628.0 [2023-02-25 13:38:44,489][36140] Sum rewards: 45.402, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.525', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon4': '0.100', 'AMMO3': '0.192', 'weapon2': '0.240', 'WEAPON3': '1.250', 'HITCOUNT': '2.630', 'weapon3': '3.428', 'DAMAGECOUNT': '12.405', 'FRAGCOUNT': '38.000'} [2023-02-25 13:38:44,632][36156] DAMAGECOUNT value on done: 369922.0 [2023-02-25 13:38:44,632][36156] Sum rewards: 57.046, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.785', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.092', 'weapon4': '0.188', 'WEAPON4': '0.200', 'weapon2': '0.200', 'AMMO3': '0.214', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '2.980', 'weapon3': '3.314', 'DAMAGECOUNT': '13.782', 'FRAGCOUNT': '50.000'} [2023-02-25 13:38:44,665][36142] DAMAGECOUNT value on done: 357319.0 [2023-02-25 13:38:44,665][36142] Sum rewards: 58.986, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.930', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.120', 'AMMO4': '0.137', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.254', 'WEAPON4': '0.300', 'weapon4': '0.582', 'WEAPON3': '1.200', 'weapon3': '2.776', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.162', 'FRAGCOUNT': '50.000'} [2023-02-25 13:38:44,723][36156] DAMAGECOUNT value on done: 362097.0 [2023-02-25 13:38:44,723][36156] Sum rewards: 48.852, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.859', 'AMMO5': '0.017', 'AMMO2': '0.044', 'AMMO3': '0.134', 'AMMO4': '0.219', 'weapon2': '0.220', 'weapon5': '0.258', 'ARMOR': '0.408', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '0.800', 'weapon4': '1.028', 'weapon3': '2.164', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '12.369', 'FRAGCOUNT': '40.000'} [2023-02-25 13:38:44,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13412.7). Total num frames: 171814912. Throughput: 0: 3366.8. Samples: 5447818. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:38:44,730][36114] Avg episode reward: [(0, '51.178')] [2023-02-25 13:38:44,795][36140] DAMAGECOUNT value on done: 359619.0 [2023-02-25 13:38:44,796][36140] Sum rewards: 57.910, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.661', 'ARMOR': '0.004', 'AMMO2': '0.016', 'weapon7': '0.050', 'AMMO4': '0.081', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.184', 'weapon2': '0.270', 'weapon4': '0.370', 'WEAPON3': '1.200', 'weapon3': '3.154', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.331', 'FRAGCOUNT': '49.000'} [2023-02-25 13:38:44,943][36156] DAMAGECOUNT value on done: 366261.0 [2023-02-25 13:38:44,944][36156] Sum rewards: 61.786, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.474', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.052', 'weapon5': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'weapon2': '0.228', 'weapon4': '0.312', 'WEAPON3': '1.350', 'HITCOUNT': '3.110', 'weapon3': '3.124', 'DAMAGECOUNT': '14.697', 'FRAGCOUNT': '54.000'} [2023-02-25 13:38:44,992][36142] DAMAGECOUNT value on done: 360096.0 [2023-02-25 13:38:44,992][36142] Sum rewards: 46.869, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.420', 'ARMOR': '0.005', 'AMMO5': '0.015', 'AMMO2': '0.065', 'AMMO3': '0.123', 'weapon5': '0.154', 'AMMO4': '0.325', 'WEAPON5': '0.400', 'weapon2': '0.614', 'WEAPON4': '0.650', 'WEAPON3': '0.700', 'weapon4': '0.758', 'weapon3': '2.068', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '12.321', 'FRAGCOUNT': '41.000'} [2023-02-25 13:38:45,006][36142] DAMAGECOUNT value on done: 355178.0 [2023-02-25 13:38:45,007][36142] Sum rewards: 35.657, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.022', 'AMMO5': '0.011', 'AMMO2': '0.051', 'AMMO3': '0.107', 'weapon5': '0.136', 'AMMO4': '0.257', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'ARMOR': '0.460', 'WEAPON3': '0.600', 'weapon4': '0.648', 'weapon2': '0.964', 'weapon3': '1.912', 'HITCOUNT': '2.190', 'DAMAGECOUNT': '9.093', 'FRAGCOUNT': '30.000'} [2023-02-25 13:38:45,322][36142] DAMAGECOUNT value on done: 369696.0 [2023-02-25 13:38:45,323][36142] Sum rewards: 51.063, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.504', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.182', 'WEAPON4': '0.350', 'weapon2': '0.564', 'weapon4': '0.666', 'WEAPON3': '1.000', 'weapon3': '2.584', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '12.546', 'FRAGCOUNT': '44.000'} [2023-02-25 13:38:46,478][36138] Updated weights for policy 0, policy_version 41953 (0.0009) [2023-02-25 13:38:49,541][36138] Updated weights for policy 0, policy_version 41963 (0.0010) [2023-02-25 13:38:49,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13412.7). Total num frames: 171880448. Throughput: 0: 3368.5. Samples: 5468030. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:38:49,730][36114] Avg episode reward: [(0, '51.329')] [2023-02-25 13:38:52,562][36138] Updated weights for policy 0, policy_version 41973 (0.0009) [2023-02-25 13:38:54,596][36155] DAMAGECOUNT value on done: 359909.0 [2023-02-25 13:38:54,596][36155] Sum rewards: 51.710, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.275', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.056', 'WEAPON5': '0.100', 'weapon2': '0.164', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.582', 'WEAPON3': '1.300', 'weapon3': '3.014', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.332', 'FRAGCOUNT': '46.000'} [2023-02-25 13:38:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13426.5). Total num frames: 171950080. Throughput: 0: 3366.2. Samples: 5478154. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:38:54,730][36114] Avg episode reward: [(0, '51.334')] [2023-02-25 13:38:54,939][36155] DAMAGECOUNT value on done: 372184.0 [2023-02-25 13:38:54,939][36155] Sum rewards: 55.522, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.036', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.110', 'weapon4': '0.132', 'AMMO3': '0.139', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON3': '0.950', 'HITCOUNT': '2.640', 'weapon3': '3.188', 'DAMAGECOUNT': '12.927', 'FRAGCOUNT': '46.000'} [2023-02-25 13:38:55,255][36139] DAMAGECOUNT value on done: 369671.0 [2023-02-25 13:38:55,255][36139] Sum rewards: 52.663, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.388', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.146', 'AMMO4': '0.149', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.412', 'weapon4': '0.644', 'WEAPON3': '0.900', 'weapon3': '2.598', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '12.795', 'FRAGCOUNT': '43.000'} [2023-02-25 13:38:55,442][36155] DAMAGECOUNT value on done: 364286.0 [2023-02-25 13:38:55,442][36155] Sum rewards: 43.658, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.364', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.098', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.248', 'AMMO3': '0.256', 'weapon2': '0.258', 'WEAPON3': '1.500', 'HITCOUNT': '2.720', 'weapon3': '3.170', 'DAMAGECOUNT': '11.823', 'FRAGCOUNT': '42.000'} [2023-02-25 13:38:55,553][36139] DAMAGECOUNT value on done: 366692.0 [2023-02-25 13:38:55,553][36139] Sum rewards: 52.200, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.060', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.021', 'weapon5': '0.056', 'WEAPON4': '0.150', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'weapon4': '0.284', 'weapon2': '0.310', 'WEAPON3': '1.350', 'HITCOUNT': '2.780', 'weapon3': '3.144', 'DAMAGECOUNT': '12.948', 'FRAGCOUNT': '45.000'} [2023-02-25 13:38:55,656][36138] Updated weights for policy 0, policy_version 41983 (0.0009) [2023-02-25 13:38:55,746][36155] DAMAGECOUNT value on done: 363758.0 [2023-02-25 13:38:55,747][36155] Sum rewards: 47.492, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.591', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.100', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'weapon2': '0.292', 'WEAPON4': '0.300', 'weapon4': '0.314', 'WEAPON3': '1.000', 'HITCOUNT': '2.780', 'weapon3': '3.020', 'DAMAGECOUNT': '11.811', 'FRAGCOUNT': '41.000'} [2023-02-25 13:38:56,252][36139] DAMAGECOUNT value on done: 367066.0 [2023-02-25 13:38:56,253][36139] Sum rewards: 41.216, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.519', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.070', 'AMMO3': '0.201', 'weapon2': '0.248', 'weapon5': '0.316', 'AMMO4': '0.348', 'weapon4': '0.520', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.150', 'HITCOUNT': '2.460', 'weapon3': '2.534', 'DAMAGECOUNT': '14.064', 'FRAGCOUNT': '38.000'} [2023-02-25 13:38:56,565][36139] DAMAGECOUNT value on done: 366536.0 [2023-02-25 13:38:56,565][36139] Sum rewards: 55.345, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.374', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.044', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon4': '0.234', 'weapon2': '0.498', 'WEAPON3': '1.350', 'weapon3': '3.008', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '14.922', 'FRAGCOUNT': '47.000'} [2023-02-25 13:38:58,674][36138] Updated weights for policy 0, policy_version 41993 (0.0009) [2023-02-25 13:38:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 172015616. Throughput: 0: 3361.8. Samples: 5498228. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:38:59,730][36114] Avg episode reward: [(0, '51.232')] [2023-02-25 13:39:00,734][36154] DAMAGECOUNT value on done: 368257.0 [2023-02-25 13:39:00,735][36154] Sum rewards: 58.289, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.350', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon4': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'weapon2': '0.796', 'WEAPON3': '1.100', 'weapon3': '2.994', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.484', 'FRAGCOUNT': '48.000'} [2023-02-25 13:39:01,051][36154] DAMAGECOUNT value on done: 363254.0 [2023-02-25 13:39:01,051][36154] Sum rewards: 54.655, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.315', 'AMMO5': '0.023', 'AMMO2': '0.059', 'AMMO3': '0.124', 'AMMO4': '0.296', 'weapon5': '0.350', 'weapon2': '0.458', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '0.700', 'weapon4': '1.316', 'weapon3': '1.548', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.916', 'FRAGCOUNT': '46.000'} [2023-02-25 13:39:01,370][36154] DAMAGECOUNT value on done: 362061.0 [2023-02-25 13:39:01,370][36154] Sum rewards: 53.355, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.370', 'AMMO5': '0.009', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.075', 'weapon5': '0.092', 'weapon4': '0.100', 'weapon2': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '3.070', 'weapon3': '3.488', 'DAMAGECOUNT': '14.931', 'FRAGCOUNT': '45.500'} [2023-02-25 13:39:01,698][36154] DAMAGECOUNT value on done: 366628.0 [2023-02-25 13:39:01,698][36154] Sum rewards: 34.502, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.404', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.024', 'weapon5': '0.074', 'AMMO4': '0.098', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.950', 'weapon2': '1.080', 'HITCOUNT': '2.060', 'weapon3': '2.406', 'DAMAGECOUNT': '9.129', 'FRAGCOUNT': '30.000'} [2023-02-25 13:39:01,756][36138] Updated weights for policy 0, policy_version 42003 (0.0009) [2023-02-25 13:39:01,806][36141] DAMAGECOUNT value on done: 373925.0 [2023-02-25 13:39:01,807][36141] Sum rewards: 61.946, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.793', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon4': '0.148', 'WEAPON4': '0.150', 'weapon5': '0.156', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'weapon2': '0.242', 'WEAPON3': '1.150', 'HITCOUNT': '3.080', 'weapon3': '3.234', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '51.000'} [2023-02-25 13:39:02,113][36141] DAMAGECOUNT value on done: 369531.0 [2023-02-25 13:39:02,114][36141] Sum rewards: 37.187, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.236', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.047', 'AMMO3': '0.147', 'WEAPON5': '0.150', 'weapon5': '0.156', 'AMMO4': '0.233', 'weapon2': '0.446', 'WEAPON4': '0.600', 'weapon4': '0.872', 'WEAPON3': '1.000', 'weapon3': '2.300', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '11.265', 'FRAGCOUNT': '34.000'} [2023-02-25 13:39:02,236][36141] DAMAGECOUNT value on done: 363995.0 [2023-02-25 13:39:02,236][36141] Sum rewards: 54.783, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.297', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.046', 'AMMO3': '0.109', 'weapon5': '0.136', 'AMMO4': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '0.600', 'weapon2': '0.644', 'weapon4': '0.754', 'weapon3': '2.126', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.273', 'FRAGCOUNT': '43.000'} [2023-02-25 13:39:02,536][36141] DAMAGECOUNT value on done: 354088.0 [2023-02-25 13:39:02,536][36141] Sum rewards: 52.454, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.922', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.086', 'AMMO4': '0.106', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.350', 'weapon4': '0.782', 'WEAPON3': '0.950', 'weapon3': '2.332', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.710', 'FRAGCOUNT': '43.000'} [2023-02-25 13:39:03,061][36157] DAMAGECOUNT value on done: 374469.0 [2023-02-25 13:39:03,061][36157] Sum rewards: 43.217, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.413', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO3': '0.116', 'AMMO4': '0.147', 'weapon5': '0.208', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.486', 'weapon4': '0.714', 'WEAPON3': '0.800', 'weapon3': '2.370', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '10.899', 'FRAGCOUNT': '36.000'} [2023-02-25 13:39:03,364][36157] DAMAGECOUNT value on done: 370586.0 [2023-02-25 13:39:03,364][36157] Sum rewards: 41.956, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.108', 'AMMO5': '0.011', 'AMMO2': '0.034', 'AMMO3': '0.136', 'AMMO4': '0.172', 'weapon5': '0.188', 'WEAPON5': '0.300', 'weapon4': '0.322', 'WEAPON4': '0.350', 'weapon2': '0.446', 'WEAPON3': '0.950', 'HITCOUNT': '2.260', 'weapon3': '2.860', 'DAMAGECOUNT': '10.284', 'FRAGCOUNT': '37.000'} [2023-02-25 13:39:03,735][36157] DAMAGECOUNT value on done: 371939.0 [2023-02-25 13:39:03,735][36157] Sum rewards: 42.935, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.589', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.044', 'AMMO3': '0.141', 'AMMO4': '0.222', 'weapon2': '0.322', 'weapon5': '0.330', 'WEAPON4': '0.550', 'weapon4': '0.564', 'WEAPON5': '0.600', 'WEAPON3': '0.850', 'HITCOUNT': '2.450', 'weapon3': '2.506', 'DAMAGECOUNT': '12.414', 'FRAGCOUNT': '37.000'} [2023-02-25 13:39:03,886][36140] DAMAGECOUNT value on done: 374757.0 [2023-02-25 13:39:03,886][36140] Sum rewards: 49.630, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.069', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon4': '0.122', 'weapon5': '0.140', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.492', 'WEAPON3': '1.050', 'HITCOUNT': '2.700', 'weapon3': '3.036', 'DAMAGECOUNT': '13.056', 'FRAGCOUNT': '43.000'} [2023-02-25 13:39:04,033][36157] DAMAGECOUNT value on done: 372741.0 [2023-02-25 13:39:04,034][36157] Sum rewards: 48.002, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.268', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'weapon4': '0.186', 'WEAPON4': '0.200', 'weapon2': '0.424', 'WEAPON3': '1.100', 'HITCOUNT': '2.880', 'weapon3': '3.116', 'DAMAGECOUNT': '13.620', 'FRAGCOUNT': '39.500'} [2023-02-25 13:39:04,178][36140] DAMAGECOUNT value on done: 364333.0 [2023-02-25 13:39:04,178][36140] Sum rewards: 63.237, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.386', 'AMMO5': '0.012', 'AMMO2': '0.017', 'weapon4': '0.050', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'weapon5': '0.164', 'AMMO3': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.534', 'WEAPON3': '1.250', 'weapon3': '3.020', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.332', 'FRAGCOUNT': '53.500'} [2023-02-25 13:39:04,448][36140] DAMAGECOUNT value on done: 367815.0 [2023-02-25 13:39:04,448][36140] Sum rewards: 72.264, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.261', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'weapon5': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'weapon4': '0.392', 'weapon2': '0.660', 'WEAPON3': '1.000', 'weapon3': '2.708', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.561', 'FRAGCOUNT': '60.000'} [2023-02-25 13:39:04,519][36156] DAMAGECOUNT value on done: 375555.0 [2023-02-25 13:39:04,520][36156] Sum rewards: 52.795, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.816', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.186', 'AMMO3': '0.215', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.396', 'weapon2': '0.414', 'WEAPON3': '1.350', 'weapon3': '2.668', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.663', 'FRAGCOUNT': '45.000'} [2023-02-25 13:39:04,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13448.6, 300 sec: 13412.7). Total num frames: 172081152. Throughput: 0: 3360.0. Samples: 5518344. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:39:04,730][36114] Avg episode reward: [(0, '51.382')] [2023-02-25 13:39:04,738][36156] DAMAGECOUNT value on done: 374283.0 [2023-02-25 13:39:04,739][36156] Sum rewards: 48.240, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.232', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.036', 'weapon5': '0.172', 'AMMO4': '0.182', 'AMMO3': '0.184', 'weapon4': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.844', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.083', 'FRAGCOUNT': '42.000'} [2023-02-25 13:39:04,750][36140] DAMAGECOUNT value on done: 363382.0 [2023-02-25 13:39:04,751][36140] Sum rewards: 39.836, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.081', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.036', 'AMMO4': '0.178', 'weapon5': '0.188', 'weapon4': '0.192', 'AMMO3': '0.222', 'weapon2': '0.300', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.620', 'weapon3': '3.020', 'DAMAGECOUNT': '11.289', 'FRAGCOUNT': '38.500'} [2023-02-25 13:39:04,804][36138] Updated weights for policy 0, policy_version 42013 (0.0010) [2023-02-25 13:39:04,814][36142] DAMAGECOUNT value on done: 362864.0 [2023-02-25 13:39:04,814][36142] Sum rewards: 61.871, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.400', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon4': '0.108', 'weapon5': '0.148', 'AMMO4': '0.197', 'AMMO3': '0.231', 'weapon2': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.190', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '54.500'} [2023-02-25 13:39:04,844][36156] DAMAGECOUNT value on done: 366181.0 [2023-02-25 13:39:04,844][36156] Sum rewards: 38.960, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.650', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.112', 'AMMO4': '0.122', 'weapon4': '0.174', 'AMMO3': '0.186', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.680', 'WEAPON3': '1.200', 'HITCOUNT': '2.520', 'weapon3': '2.842', 'DAMAGECOUNT': '11.937', 'FRAGCOUNT': '35.500'} [2023-02-25 13:39:05,062][36156] DAMAGECOUNT value on done: 370994.0 [2023-02-25 13:39:05,062][36156] Sum rewards: 55.655, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.120', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.054', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'weapon2': '0.304', 'weapon4': '0.418', 'WEAPON3': '1.200', 'weapon3': '3.050', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.199', 'FRAGCOUNT': '48.000'} [2023-02-25 13:39:05,121][36142] DAMAGECOUNT value on done: 364668.0 [2023-02-25 13:39:05,122][36142] Sum rewards: 51.268, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.380', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.051', 'AMMO3': '0.199', 'weapon5': '0.228', 'AMMO4': '0.254', 'weapon2': '0.294', 'weapon4': '0.384', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.680', 'weapon3': '2.722', 'DAMAGECOUNT': '13.716', 'FRAGCOUNT': '46.500'} [2023-02-25 13:39:05,134][36142] DAMAGECOUNT value on done: 359404.0 [2023-02-25 13:39:05,135][36142] Sum rewards: 54.407, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.570', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'AMMO3': '0.158', 'AMMO4': '0.163', 'weapon2': '0.224', 'WEAPON4': '0.300', 'weapon4': '0.602', 'WEAPON3': '1.050', 'HITCOUNT': '2.870', 'weapon3': '3.034', 'DAMAGECOUNT': '12.678', 'FRAGCOUNT': '47.000'} [2023-02-25 13:39:05,437][36142] DAMAGECOUNT value on done: 373635.0 [2023-02-25 13:39:05,437][36142] Sum rewards: 39.931, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.166', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.108', 'WEAPON4': '0.150', 'weapon4': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.276', 'AMMO3': '0.277', 'WEAPON3': '1.550', 'HITCOUNT': '2.500', 'weapon3': '3.152', 'DAMAGECOUNT': '11.817', 'FRAGCOUNT': '38.000'} [2023-02-25 13:39:06,481][36157] Large shaping reward 2.597 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.045, -15.0), ('weapon5', 0.002)] [2023-02-25 13:39:07,842][36138] Updated weights for policy 0, policy_version 42023 (0.0010) [2023-02-25 13:39:09,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 172150784. Throughput: 0: 3361.0. Samples: 5528516. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:39:09,730][36114] Avg episode reward: [(0, '51.067')] [2023-02-25 13:39:10,911][36138] Updated weights for policy 0, policy_version 42033 (0.0010) [2023-02-25 13:39:13,949][36138] Updated weights for policy 0, policy_version 42043 (0.0009) [2023-02-25 13:39:14,604][36155] DAMAGECOUNT value on done: 365015.0 [2023-02-25 13:39:14,604][36155] Sum rewards: 62.594, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.895', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.085', 'AMMO3': '0.138', 'weapon5': '0.170', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.486', 'weapon4': '0.646', 'WEAPON3': '0.850', 'weapon3': '2.478', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.318', 'FRAGCOUNT': '50.000'} [2023-02-25 13:39:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 172216320. Throughput: 0: 3362.8. Samples: 5548658. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:39:14,730][36114] Avg episode reward: [(0, '51.147')] [2023-02-25 13:39:14,908][36155] DAMAGECOUNT value on done: 376293.0 [2023-02-25 13:39:14,909][36155] Sum rewards: 43.102, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.624', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.049', 'AMMO3': '0.154', 'AMMO4': '0.244', 'weapon5': '0.248', 'weapon4': '0.314', 'weapon2': '0.378', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'HITCOUNT': '2.750', 'weapon3': '2.782', 'DAMAGECOUNT': '12.327', 'FRAGCOUNT': '38.000'} [2023-02-25 13:39:15,112][36139] DAMAGECOUNT value on done: 375457.0 [2023-02-25 13:39:15,113][36139] Sum rewards: 64.270, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.670', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'weapon5': '0.114', 'AMMO3': '0.174', 'AMMO4': '0.191', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON4': '0.400', 'weapon4': '0.434', 'WEAPON3': '1.000', 'weapon3': '2.876', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.854', 'FRAGCOUNT': '53.000'} [2023-02-25 13:39:15,413][36139] DAMAGECOUNT value on done: 371542.0 [2023-02-25 13:39:15,413][36139] Sum rewards: 52.505, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.718', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon5': '0.116', 'AMMO4': '0.130', 'AMMO3': '0.170', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.530', 'weapon2': '0.544', 'WEAPON3': '1.050', 'weapon3': '2.536', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.550', 'FRAGCOUNT': '43.000'} [2023-02-25 13:39:15,434][36155] DAMAGECOUNT value on done: 369573.0 [2023-02-25 13:39:15,434][36155] Sum rewards: 53.580, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.112', 'AMMO5': '0.016', 'AMMO2': '0.054', 'weapon2': '0.204', 'AMMO3': '0.246', 'weapon5': '0.254', 'AMMO4': '0.270', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon4': '1.008', 'WEAPON3': '1.400', 'weapon3': '2.048', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '48.000'} [2023-02-25 13:39:15,741][36155] DAMAGECOUNT value on done: 368808.0 [2023-02-25 13:39:15,742][36155] Sum rewards: 50.050, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.210', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.073', 'AMMO3': '0.145', 'AMMO4': '0.366', 'weapon2': '0.370', 'weapon5': '0.380', 'weapon4': '0.636', 'WEAPON5': '0.700', 'WEAPON4': '0.800', 'WEAPON3': '0.950', 'weapon3': '2.170', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '15.150', 'FRAGCOUNT': '44.000'} [2023-02-25 13:39:16,107][36139] DAMAGECOUNT value on done: 371074.0 [2023-02-25 13:39:16,107][36139] Sum rewards: 43.989, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.838', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.050', 'AMMO3': '0.208', 'AMMO4': '0.252', 'weapon2': '0.340', 'weapon5': '0.458', 'WEAPON4': '0.550', 'weapon4': '0.636', 'WEAPON5': '0.650', 'WEAPON3': '1.200', 'HITCOUNT': '2.210', 'weapon3': '2.220', 'DAMAGECOUNT': '12.024', 'FRAGCOUNT': '40.000'} [2023-02-25 13:39:16,414][36139] DAMAGECOUNT value on done: 370714.0 [2023-02-25 13:39:16,415][36139] Sum rewards: 43.186, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.430', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO4': '0.192', 'weapon5': '0.204', 'AMMO3': '0.205', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.532', 'weapon4': '0.544', 'WEAPON3': '1.200', 'weapon3': '2.400', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '12.534', 'FRAGCOUNT': '41.000'} [2023-02-25 13:39:17,034][36138] Updated weights for policy 0, policy_version 42053 (0.0010) [2023-02-25 13:39:19,594][36154] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0)] [2023-02-25 13:39:19,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 172281856. Throughput: 0: 3359.7. Samples: 5568776. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:39:19,730][36114] Avg episode reward: [(0, '51.555')] [2023-02-25 13:39:19,759][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000042062_172285952.pth... [2023-02-25 13:39:19,816][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000041275_169062400.pth [2023-02-25 13:39:20,084][36138] Updated weights for policy 0, policy_version 42063 (0.0009) [2023-02-25 13:39:20,787][36154] DAMAGECOUNT value on done: 373203.0 [2023-02-25 13:39:20,787][36154] Sum rewards: 58.758, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.670', 'AMMO5': '0.009', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon4': '0.280', 'weapon2': '0.406', 'WEAPON3': '1.300', 'weapon3': '2.934', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.838', 'FRAGCOUNT': '51.000'} [2023-02-25 13:39:21,095][36154] DAMAGECOUNT value on done: 368382.0 [2023-02-25 13:39:21,096][36154] Sum rewards: 62.325, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.058', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon5': '0.102', 'AMMO3': '0.158', 'AMMO4': '0.195', 'weapon2': '0.266', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.620', 'WEAPON3': '0.900', 'weapon3': '2.692', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.384', 'FRAGCOUNT': '53.000'} [2023-02-25 13:39:21,404][36154] DAMAGECOUNT value on done: 366830.0 [2023-02-25 13:39:21,405][36154] Sum rewards: 51.088, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.938', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon5': '0.166', 'AMMO4': '0.172', 'AMMO3': '0.225', 'weapon4': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.360', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.866', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.307', 'FRAGCOUNT': '44.500'} [2023-02-25 13:39:21,714][36154] DAMAGECOUNT value on done: 371275.0 [2023-02-25 13:39:21,715][36154] Sum rewards: 50.685, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.840', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.039', 'AMMO3': '0.145', 'AMMO4': '0.195', 'weapon2': '0.252', 'weapon5': '0.308', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon4': '0.682', 'WEAPON3': '0.900', 'weapon3': '2.358', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.941', 'FRAGCOUNT': '41.000'} [2023-02-25 13:39:21,852][36141] DAMAGECOUNT value on done: 378582.0 [2023-02-25 13:39:21,852][36141] Sum rewards: 55.638, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.360', 'AMMO4': '-0.023', 'AMMO2': '-0.004', 'ARMOR': '0.004', 'AMMO5': '0.005', 'WEAPON4': '0.100', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'weapon2': '0.528', 'weapon4': '0.546', 'WEAPON3': '1.400', 'weapon3': '2.490', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.971', 'FRAGCOUNT': '49.000'} [2023-02-25 13:39:22,148][36141] DAMAGECOUNT value on done: 374166.0 [2023-02-25 13:39:22,149][36141] Sum rewards: 45.862, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.882', 'AMMO2': '0.002', 'ARMOR': '0.004', 'AMMO4': '0.008', 'AMMO5': '0.012', 'WEAPON4': '0.050', 'weapon5': '0.104', 'weapon4': '0.140', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'weapon2': '0.476', 'WEAPON3': '1.600', 'HITCOUNT': '2.860', 'weapon3': '3.074', 'DAMAGECOUNT': '13.905', 'FRAGCOUNT': '42.000'} [2023-02-25 13:39:22,268][36141] DAMAGECOUNT value on done: 368933.0 [2023-02-25 13:39:22,269][36141] Sum rewards: 57.100, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.055', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon5': '0.148', 'AMMO3': '0.158', 'weapon4': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.342', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '2.980', 'weapon3': '3.070', 'DAMAGECOUNT': '14.814', 'FRAGCOUNT': '48.000'} [2023-02-25 13:39:22,577][36141] DAMAGECOUNT value on done: 359012.0 [2023-02-25 13:39:22,578][36141] Sum rewards: 51.410, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.710', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.118', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon2': '0.636', 'WEAPON3': '1.350', 'weapon3': '2.834', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.772', 'FRAGCOUNT': '43.500'} [2023-02-25 13:39:23,000][36157] DAMAGECOUNT value on done: 378753.0 [2023-02-25 13:39:23,001][36157] Sum rewards: 45.626, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.430', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon5': '0.164', 'AMMO3': '0.189', 'AMMO4': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.516', 'weapon4': '0.556', 'WEAPON3': '1.050', 'weapon3': '2.514', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.852', 'FRAGCOUNT': '38.000'} [2023-02-25 13:39:23,134][36138] Updated weights for policy 0, policy_version 42073 (0.0009) [2023-02-25 13:39:23,319][36157] DAMAGECOUNT value on done: 375007.0 [2023-02-25 13:39:23,319][36157] Sum rewards: 46.119, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.124', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.156', 'weapon2': '0.162', 'AMMO3': '0.166', 'AMMO4': '0.237', 'WEAPON5': '0.350', 'ARMOR': '0.404', 'weapon4': '0.470', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'HITCOUNT': '2.770', 'weapon3': '2.966', 'DAMAGECOUNT': '13.053', 'FRAGCOUNT': '38.500'} [2023-02-25 13:39:23,708][36157] DAMAGECOUNT value on done: 375615.0 [2023-02-25 13:39:23,708][36157] Sum rewards: 47.312, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.310', 'AMMO5': '0.007', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'weapon5': '0.074', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'AMMO4': '0.172', 'weapon2': '0.404', 'WEAPON4': '0.450', 'weapon4': '0.472', 'WEAPON3': '1.100', 'HITCOUNT': '2.740', 'weapon3': '2.800', 'DAMAGECOUNT': '11.028', 'FRAGCOUNT': '43.000'} [2023-02-25 13:39:23,930][36140] DAMAGECOUNT value on done: 379402.0 [2023-02-25 13:39:23,931][36140] Sum rewards: 54.279, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.156', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.052', 'AMMO4': '0.092', 'WEAPON5': '0.150', 'weapon4': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon2': '0.294', 'WEAPON3': '1.350', 'HITCOUNT': '3.000', 'weapon3': '3.222', 'DAMAGECOUNT': '13.899', 'FRAGCOUNT': '48.000'} [2023-02-25 13:39:23,988][36157] DAMAGECOUNT value on done: 378417.0 [2023-02-25 13:39:23,989][36157] Sum rewards: 66.846, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.632', 'AMMO5': '0.009', 'AMMO2': '0.058', 'weapon5': '0.164', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.208', 'AMMO4': '0.288', 'WEAPON4': '0.400', 'weapon4': '0.658', 'WEAPON3': '1.300', 'weapon3': '2.690', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '57.000'} [2023-02-25 13:39:24,242][36140] DAMAGECOUNT value on done: 368475.0 [2023-02-25 13:39:24,242][36140] Sum rewards: 45.096, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.998', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO3': '0.138', 'AMMO4': '0.157', 'weapon5': '0.260', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon4': '0.502', 'WEAPON3': '0.950', 'weapon2': '0.968', 'weapon3': '2.068', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '12.426', 'FRAGCOUNT': '38.000'} [2023-02-25 13:39:24,522][36140] DAMAGECOUNT value on done: 372226.0 [2023-02-25 13:39:24,523][36140] Sum rewards: 52.878, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.730', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.036', 'AMMO3': '0.137', 'AMMO4': '0.178', 'weapon5': '0.236', 'WEAPON4': '0.400', 'weapon4': '0.440', 'WEAPON5': '0.450', 'weapon2': '0.770', 'WEAPON3': '0.900', 'weapon3': '2.370', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '13.233', 'FRAGCOUNT': '45.000'} [2023-02-25 13:39:24,624][36156] DAMAGECOUNT value on done: 379764.0 [2023-02-25 13:39:24,625][36156] Sum rewards: 52.924, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.092', 'AMMO5': '0.015', 'AMMO2': '0.027', 'weapon4': '0.118', 'weapon5': '0.120', 'AMMO4': '0.135', 'AMMO3': '0.246', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.450', 'HITCOUNT': '2.680', 'weapon3': '3.130', 'DAMAGECOUNT': '12.627', 'FRAGCOUNT': '50.000'} [2023-02-25 13:39:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 172351488. Throughput: 0: 3358.0. Samples: 5578700. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:39:24,730][36114] Avg episode reward: [(0, '51.706')] [2023-02-25 13:39:24,764][36156] DAMAGECOUNT value on done: 378793.0 [2023-02-25 13:39:24,764][36156] Sum rewards: 50.320, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.018', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.169', 'weapon5': '0.226', 'WEAPON4': '0.250', 'weapon4': '0.308', 'WEAPON5': '0.400', 'weapon2': '0.768', 'WEAPON3': '1.100', 'weapon3': '2.464', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.530', 'FRAGCOUNT': '42.000'} [2023-02-25 13:39:24,849][36140] DAMAGECOUNT value on done: 367940.0 [2023-02-25 13:39:24,850][36140] Sum rewards: 47.837, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.768', 'AMMO5': '0.030', 'AMMO2': '0.064', 'AMMO3': '0.188', 'weapon2': '0.206', 'AMMO4': '0.321', 'weapon5': '0.326', 'weapon4': '0.580', 'WEAPON4': '0.600', 'WEAPON5': '0.750', 'WEAPON3': '1.150', 'weapon3': '2.506', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '13.674', 'FRAGCOUNT': '44.000'} [2023-02-25 13:39:24,862][36142] DAMAGECOUNT value on done: 367021.0 [2023-02-25 13:39:24,863][36142] Sum rewards: 48.491, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.511', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.058', 'AMMO3': '0.132', 'AMMO4': '0.166', 'WEAPON5': '0.200', 'weapon2': '0.356', 'WEAPON4': '0.550', 'weapon4': '0.832', 'WEAPON3': '0.850', 'weapon3': '2.472', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.471', 'FRAGCOUNT': '42.000'} [2023-02-25 13:39:24,944][36156] DAMAGECOUNT value on done: 370192.0 [2023-02-25 13:39:24,945][36156] Sum rewards: 43.199, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.565', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon5': '0.154', 'AMMO4': '0.157', 'weapon2': '0.198', 'AMMO3': '0.262', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.606', 'WEAPON3': '1.550', 'HITCOUNT': '2.720', 'weapon3': '2.738', 'DAMAGECOUNT': '12.033', 'FRAGCOUNT': '42.000'} [2023-02-25 13:39:25,080][36156] DAMAGECOUNT value on done: 375495.0 [2023-02-25 13:39:25,081][36156] Sum rewards: 48.558, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.836', 'AMMO5': '0.012', 'AMMO2': '0.046', 'AMMO3': '0.157', 'weapon2': '0.204', 'AMMO4': '0.230', 'weapon5': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.920', 'WEAPON3': '0.950', 'weapon3': '2.358', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.503', 'FRAGCOUNT': '42.000'} [2023-02-25 13:39:25,177][36142] DAMAGECOUNT value on done: 368380.0 [2023-02-25 13:39:25,177][36142] Sum rewards: 29.053, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.502', 'AMMO5': '0.021', 'AMMO2': '0.054', 'weapon5': '0.266', 'AMMO3': '0.268', 'AMMO4': '0.270', 'weapon2': '0.324', 'weapon4': '0.398', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '2.290', 'weapon3': '2.604', 'DAMAGECOUNT': '10.860', 'FRAGCOUNT': '32.000'} [2023-02-25 13:39:25,189][36142] DAMAGECOUNT value on done: 363989.0 [2023-02-25 13:39:25,190][36142] Sum rewards: 47.290, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.540', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon5': '0.032', 'AMMO4': '0.075', 'WEAPON5': '0.150', 'weapon4': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon2': '0.458', 'WEAPON3': '1.350', 'HITCOUNT': '3.010', 'weapon3': '3.150', 'DAMAGECOUNT': '13.755', 'FRAGCOUNT': '41.000'} [2023-02-25 13:39:25,465][36156] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 13:39:25,505][36142] DAMAGECOUNT value on done: 377968.0 [2023-02-25 13:39:25,505][36142] Sum rewards: 51.835, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.514', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'weapon5': '0.062', 'weapon4': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.646', 'WEAPON3': '1.300', 'HITCOUNT': '2.590', 'weapon3': '2.942', 'DAMAGECOUNT': '12.999', 'FRAGCOUNT': '44.000'} [2023-02-25 13:39:26,215][36138] Updated weights for policy 0, policy_version 42083 (0.0009) [2023-02-25 13:39:29,319][36138] Updated weights for policy 0, policy_version 42093 (0.0010) [2023-02-25 13:39:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 172417024. Throughput: 0: 3354.5. Samples: 5598770. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:39:29,730][36114] Avg episode reward: [(0, '51.561')] [2023-02-25 13:39:32,380][36138] Updated weights for policy 0, policy_version 42103 (0.0010) [2023-02-25 13:39:34,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 172482560. Throughput: 0: 3348.7. Samples: 5618720. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:39:34,729][36114] Avg episode reward: [(0, '51.561')] [2023-02-25 13:39:34,750][36155] DAMAGECOUNT value on done: 369249.0 [2023-02-25 13:39:34,750][36155] Sum rewards: 50.118, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.904', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.126', 'AMMO3': '0.158', 'AMMO4': '0.186', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.568', 'weapon2': '0.598', 'WEAPON3': '0.900', 'weapon3': '2.434', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '12.702', 'FRAGCOUNT': '43.000'} [2023-02-25 13:39:35,064][36155] DAMAGECOUNT value on done: 380890.0 [2023-02-25 13:39:35,064][36155] Sum rewards: 41.935, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.184', 'AMMO5': '0.011', 'AMMO2': '0.013', 'weapon4': '0.042', 'AMMO4': '0.067', 'weapon5': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.500', 'HITCOUNT': '2.600', 'weapon3': '3.304', 'DAMAGECOUNT': '13.791', 'FRAGCOUNT': '37.500'} [2023-02-25 13:39:35,178][36139] DAMAGECOUNT value on done: 379970.0 [2023-02-25 13:39:35,178][36139] Sum rewards: 57.091, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.155', 'AMMO5': '0.011', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.074', 'weapon2': '0.126', 'AMMO3': '0.175', 'weapon5': '0.204', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.449', 'WEAPON3': '1.000', 'weapon4': '1.068', 'weapon3': '2.254', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.539', 'FRAGCOUNT': '46.000'} [2023-02-25 13:39:35,454][36138] Updated weights for policy 0, policy_version 42113 (0.0009) [2023-02-25 13:39:35,479][36139] DAMAGECOUNT value on done: 375391.0 [2023-02-25 13:39:35,479][36139] Sum rewards: 47.193, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.666', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.148', 'weapon4': '0.230', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.400', 'HITCOUNT': '2.420', 'weapon3': '3.114', 'DAMAGECOUNT': '11.547', 'FRAGCOUNT': '45.000'} [2023-02-25 13:39:35,590][36155] DAMAGECOUNT value on done: 374623.0 [2023-02-25 13:39:35,590][36155] Sum rewards: 65.178, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.227', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.152', 'weapon5': '0.152', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.274', 'weapon2': '0.524', 'WEAPON3': '1.000', 'weapon3': '2.840', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.120', 'FRAGCOUNT': '54.000'} [2023-02-25 13:39:35,896][36155] DAMAGECOUNT value on done: 373542.0 [2023-02-25 13:39:35,897][36155] Sum rewards: 53.297, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.736', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon5': '0.106', 'weapon4': '0.116', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'weapon2': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.286', 'WEAPON3': '1.700', 'HITCOUNT': '3.100', 'weapon3': '3.338', 'DAMAGECOUNT': '14.202', 'FRAGCOUNT': '49.000'} [2023-02-25 13:39:36,043][36139] DAMAGECOUNT value on done: 376072.0 [2023-02-25 13:39:36,043][36139] Sum rewards: 58.107, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.251', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.094', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'weapon4': '0.166', 'weapon2': '0.202', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'WEAPON3': '1.550', 'HITCOUNT': '2.960', 'weapon3': '3.342', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '51.500'} [2023-02-25 13:39:36,345][36139] DAMAGECOUNT value on done: 375689.0 [2023-02-25 13:39:36,346][36139] Sum rewards: 57.353, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.212', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.056', 'AMMO4': '0.062', 'AMMO3': '0.215', 'weapon2': '0.410', 'WEAPON3': '1.200', 'HITCOUNT': '2.960', 'weapon3': '3.324', 'DAMAGECOUNT': '14.925', 'FRAGCOUNT': '47.000'} [2023-02-25 13:39:38,020][36155] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200.0), ('weapon5', 0.002)] [2023-02-25 13:39:38,512][36138] Updated weights for policy 0, policy_version 42123 (0.0009) [2023-02-25 13:39:39,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 172552192. Throughput: 0: 3348.8. Samples: 5628850. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:39:39,730][36114] Avg episode reward: [(0, '51.557')] [2023-02-25 13:39:40,786][36154] DAMAGECOUNT value on done: 377745.0 [2023-02-25 13:39:40,787][36154] Sum rewards: 48.369, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.896', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon4': '0.048', 'AMMO4': '0.143', 'weapon5': '0.166', 'WEAPON4': '0.250', 'AMMO3': '0.272', 'weapon2': '0.316', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'HITCOUNT': '2.740', 'weapon3': '3.212', 'DAMAGECOUNT': '13.626', 'FRAGCOUNT': '45.000'} [2023-02-25 13:39:41,106][36154] DAMAGECOUNT value on done: 372283.0 [2023-02-25 13:39:41,107][36154] Sum rewards: 44.361, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.040', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon4': '0.104', 'AMMO4': '0.142', 'AMMO3': '0.149', 'WEAPON4': '0.300', 'weapon2': '0.350', 'weapon5': '0.352', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'HITCOUNT': '2.110', 'weapon3': '2.926', 'DAMAGECOUNT': '11.703', 'FRAGCOUNT': '38.000'} [2023-02-25 13:39:41,406][36154] DAMAGECOUNT value on done: 371452.0 [2023-02-25 13:39:41,406][36154] Sum rewards: 49.523, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.190', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon5': '0.200', 'weapon2': '0.214', 'AMMO3': '0.230', 'AMMO4': '0.264', 'WEAPON5': '0.450', 'weapon4': '0.572', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.660', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '13.866', 'FRAGCOUNT': '46.000'} [2023-02-25 13:39:41,533][36138] Updated weights for policy 0, policy_version 42133 (0.0009) [2023-02-25 13:39:41,720][36154] DAMAGECOUNT value on done: 376039.0 [2023-02-25 13:39:41,721][36154] Sum rewards: 54.261, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.672', 'AMMO5': '0.017', 'AMMO2': '0.049', 'AMMO3': '0.150', 'AMMO4': '0.246', 'weapon5': '0.250', 'WEAPON5': '0.450', 'weapon4': '0.512', 'WEAPON4': '0.550', 'weapon2': '0.684', 'WEAPON3': '0.850', 'weapon3': '2.262', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.292', 'FRAGCOUNT': '47.000'} [2023-02-25 13:39:41,898][36141] DAMAGECOUNT value on done: 382988.0 [2023-02-25 13:39:41,898][36141] Sum rewards: 42.600, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.342', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO5': '0.026', 'AMMO2': '0.073', 'AMMO3': '0.178', 'weapon2': '0.294', 'weapon5': '0.350', 'AMMO4': '0.365', 'WEAPON5': '0.600', 'WEAPON4': '0.750', 'weapon4': '0.904', 'WEAPON3': '1.150', 'weapon3': '2.028', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.669', 'FRAGCOUNT': '41.000'} [2023-02-25 13:39:42,191][36141] DAMAGECOUNT value on done: 379049.0 [2023-02-25 13:39:42,192][36141] Sum rewards: 54.181, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.705', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON4': '0.100', 'weapon4': '0.116', 'AMMO3': '0.197', 'weapon2': '0.558', 'WEAPON3': '1.300', 'HITCOUNT': '2.990', 'weapon3': '3.190', 'DAMAGECOUNT': '14.649', 'FRAGCOUNT': '45.000'} [2023-02-25 13:39:42,269][36141] DAMAGECOUNT value on done: 373115.0 [2023-02-25 13:39:42,269][36141] Sum rewards: 48.948, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.770', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.124', 'AMMO3': '0.162', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.474', 'weapon4': '0.744', 'WEAPON3': '1.050', 'weapon3': '2.480', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '12.546', 'FRAGCOUNT': '43.000'} [2023-02-25 13:39:42,582][36141] DAMAGECOUNT value on done: 364541.0 [2023-02-25 13:39:42,582][36141] Sum rewards: 66.636, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.300', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.042', 'AMMO4': '0.111', 'weapon5': '0.166', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'WEAPON5': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.150', 'weapon3': '3.176', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '56.000'} [2023-02-25 13:39:43,080][36157] DAMAGECOUNT value on done: 382938.0 [2023-02-25 13:39:43,081][36157] Sum rewards: 50.413, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.865', 'AMMO2': '0.010', 'AMMO4': '0.047', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'weapon4': '0.276', 'ARMOR': '0.456', 'weapon2': '0.768', 'WEAPON3': '0.850', 'HITCOUNT': '2.650', 'weapon3': '2.840', 'DAMAGECOUNT': '12.555', 'FRAGCOUNT': '39.000'} [2023-02-25 13:39:43,400][36157] DAMAGECOUNT value on done: 379736.0 [2023-02-25 13:39:43,400][36157] Sum rewards: 55.251, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.150', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO4': '0.188', 'weapon2': '0.200', 'AMMO3': '0.201', 'weapon5': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.612', 'WEAPON3': '1.050', 'weapon3': '2.534', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '14.187', 'FRAGCOUNT': '46.000'} [2023-02-25 13:39:43,820][36157] DAMAGECOUNT value on done: 380505.0 [2023-02-25 13:39:43,821][36157] Sum rewards: 50.496, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.580', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.041', 'AMMO3': '0.169', 'weapon5': '0.188', 'AMMO4': '0.205', 'weapon2': '0.362', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.470', 'WEAPON3': '1.050', 'weapon3': '2.716', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.670', 'FRAGCOUNT': '43.000'} [2023-02-25 13:39:44,071][36140] DAMAGECOUNT value on done: 383741.0 [2023-02-25 13:39:44,072][36140] Sum rewards: 49.687, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.540', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.112', 'AMMO4': '0.157', 'WEAPON5': '0.200', 'weapon2': '0.214', 'AMMO3': '0.244', 'WEAPON4': '0.350', 'weapon4': '0.418', 'WEAPON3': '1.450', 'HITCOUNT': '2.740', 'weapon3': '3.034', 'DAMAGECOUNT': '13.017', 'FRAGCOUNT': '46.000'} [2023-02-25 13:39:44,129][36157] DAMAGECOUNT value on done: 384156.0 [2023-02-25 13:39:44,129][36157] Sum rewards: 63.392, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.032', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.100', 'weapon2': '0.158', 'AMMO4': '0.164', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon4': '0.266', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.216', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '56.000'} [2023-02-25 13:39:44,385][36140] DAMAGECOUNT value on done: 373062.0 [2023-02-25 13:39:44,385][36140] Sum rewards: 45.334, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.628', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon5': '0.160', 'AMMO3': '0.181', 'AMMO4': '0.213', 'weapon4': '0.328', 'weapon2': '0.378', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.850', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.761', 'FRAGCOUNT': '41.500'} [2023-02-25 13:39:44,578][36138] Updated weights for policy 0, policy_version 42143 (0.0009) [2023-02-25 13:39:44,587][36156] DAMAGECOUNT value on done: 384002.0 [2023-02-25 13:39:44,588][36156] Sum rewards: 44.344, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.642', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'weapon5': '0.242', 'WEAPON4': '0.250', 'weapon4': '0.422', 'weapon2': '0.490', 'WEAPON3': '1.200', 'weapon3': '2.572', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.684', 'FRAGCOUNT': '39.000'} [2023-02-25 13:39:44,680][36140] DAMAGECOUNT value on done: 376753.0 [2023-02-25 13:39:44,680][36140] Sum rewards: 49.289, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.680', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon2': '0.206', 'AMMO4': '0.207', 'weapon5': '0.214', 'AMMO3': '0.249', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.530', 'WEAPON3': '1.350', 'weapon3': '2.776', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.581', 'FRAGCOUNT': '43.500'} [2023-02-25 13:39:44,728][36156] DAMAGECOUNT value on done: 383896.0 [2023-02-25 13:39:44,728][36156] Sum rewards: 55.407, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.548', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'weapon5': '0.166', 'WEAPON4': '0.200', 'AMMO3': '0.254', 'weapon4': '0.322', 'weapon2': '0.390', 'WEAPON3': '1.450', 'weapon3': '2.850', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.306', 'FRAGCOUNT': '50.000'} [2023-02-25 13:39:44,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 172617728. Throughput: 0: 3353.9. Samples: 5649152. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:39:44,729][36114] Avg episode reward: [(0, '50.943')] [2023-02-25 13:39:44,912][36156] DAMAGECOUNT value on done: 374470.0 [2023-02-25 13:39:44,912][36156] Sum rewards: 52.989, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.005', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.036', 'weapon5': '0.110', 'weapon4': '0.152', 'AMMO4': '0.181', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.598', 'WEAPON3': '1.100', 'HITCOUNT': '2.640', 'weapon3': '2.928', 'DAMAGECOUNT': '12.834', 'FRAGCOUNT': '47.000'} [2023-02-25 13:39:45,008][36140] DAMAGECOUNT value on done: 372102.0 [2023-02-25 13:39:45,009][36140] Sum rewards: 51.846, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.930', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.104', 'AMMO3': '0.146', 'AMMO4': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.380', 'weapon2': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '2.630', 'weapon3': '2.874', 'DAMAGECOUNT': '12.486', 'FRAGCOUNT': '44.000'} [2023-02-25 13:39:45,038][36142] DAMAGECOUNT value on done: 372359.0 [2023-02-25 13:39:45,038][36142] Sum rewards: 58.144, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.369', 'AMMO5': '0.018', 'AMMO2': '0.041', 'AMMO3': '0.179', 'AMMO4': '0.204', 'weapon2': '0.280', 'weapon5': '0.296', 'weapon4': '0.380', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.786', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.699', 'FRAGCOUNT': '50.000'} [2023-02-25 13:39:45,057][36156] DAMAGECOUNT value on done: 379548.0 [2023-02-25 13:39:45,058][36156] Sum rewards: 46.701, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.402', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.092', 'AMMO4': '0.123', 'weapon5': '0.204', 'weapon2': '0.264', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'ARMOR': '0.459', 'WEAPON3': '0.600', 'weapon4': '0.934', 'weapon3': '2.300', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '11.787', 'FRAGCOUNT': '37.000'} [2023-02-25 13:39:45,350][36142] DAMAGECOUNT value on done: 368429.0 [2023-02-25 13:39:45,350][36142] Sum rewards: 43.084, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.867', 'ARMOR': '0.008', 'AMMO5': '0.027', 'AMMO2': '0.048', 'AMMO3': '0.169', 'AMMO4': '0.242', 'weapon2': '0.274', 'weapon5': '0.314', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.598', 'WEAPON3': '1.050', 'weapon3': '2.510', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '13.320', 'FRAGCOUNT': '37.000'} [2023-02-25 13:39:45,360][36142] DAMAGECOUNT value on done: 372689.0 [2023-02-25 13:39:45,361][36142] Sum rewards: 47.588, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.728', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.067', 'weapon5': '0.108', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'weapon2': '0.334', 'weapon4': '0.458', 'WEAPON3': '1.450', 'HITCOUNT': '2.390', 'weapon3': '2.856', 'DAMAGECOUNT': '12.927', 'FRAGCOUNT': '44.000'} [2023-02-25 13:39:45,665][36142] DAMAGECOUNT value on done: 382462.0 [2023-02-25 13:39:45,665][36142] Sum rewards: 48.993, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.170', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.116', 'AMMO4': '0.148', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'weapon2': '0.378', 'WEAPON4': '0.400', 'weapon4': '0.780', 'WEAPON3': '1.150', 'weapon3': '2.494', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.482', 'FRAGCOUNT': '44.000'} [2023-02-25 13:39:47,646][36138] Updated weights for policy 0, policy_version 42153 (0.0009) [2023-02-25 13:39:49,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 172687360. Throughput: 0: 3354.9. Samples: 5669314. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:39:49,729][36114] Avg episode reward: [(0, '50.825')] [2023-02-25 13:39:50,659][36138] Updated weights for policy 0, policy_version 42163 (0.0009) [2023-02-25 13:39:53,751][36138] Updated weights for policy 0, policy_version 42173 (0.0009) [2023-02-25 13:39:54,688][36155] DAMAGECOUNT value on done: 373973.0 [2023-02-25 13:39:54,689][36155] Sum rewards: 52.283, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.243', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.134', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.252', 'WEAPON4': '0.350', 'weapon4': '0.598', 'WEAPON3': '1.100', 'weapon3': '2.622', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.172', 'FRAGCOUNT': '46.000'} [2023-02-25 13:39:54,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 172752896. Throughput: 0: 3351.6. Samples: 5679338. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:39:54,730][36114] Avg episode reward: [(0, '50.730')] [2023-02-25 13:39:55,006][36155] DAMAGECOUNT value on done: 385594.0 [2023-02-25 13:39:55,006][36155] Sum rewards: 59.954, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.406', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon5': '0.116', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'weapon4': '0.188', 'WEAPON5': '0.250', 'weapon2': '0.476', 'WEAPON3': '1.100', 'HITCOUNT': '2.880', 'weapon3': '2.992', 'DAMAGECOUNT': '14.112', 'FRAGCOUNT': '52.000'} [2023-02-25 13:39:55,053][36139] DAMAGECOUNT value on done: 385161.0 [2023-02-25 13:39:55,053][36139] Sum rewards: 55.577, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.344', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon2': '0.228', 'AMMO3': '0.230', 'weapon5': '0.230', 'AMMO4': '0.241', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.660', 'WEAPON3': '1.300', 'weapon3': '2.550', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.573', 'FRAGCOUNT': '51.000'} [2023-02-25 13:39:55,370][36139] DAMAGECOUNT value on done: 380110.0 [2023-02-25 13:39:55,371][36139] Sum rewards: 55.685, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.255', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.098', 'AMMO3': '0.133', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.316', 'WEAPON3': '0.850', 'weapon2': '0.930', 'weapon3': '2.466', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.157', 'FRAGCOUNT': '45.500'} [2023-02-25 13:39:55,618][36155] DAMAGECOUNT value on done: 379817.0 [2023-02-25 13:39:55,618][36155] Sum rewards: 54.392, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.788', 'AMMO5': '0.020', 'AMMO2': '0.053', 'AMMO3': '0.220', 'weapon5': '0.246', 'AMMO4': '0.266', 'weapon2': '0.308', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon4': '0.806', 'WEAPON3': '1.250', 'weapon3': '2.218', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.582', 'FRAGCOUNT': '48.500'} [2023-02-25 13:39:55,934][36155] DAMAGECOUNT value on done: 377890.0 [2023-02-25 13:39:55,935][36155] Sum rewards: 46.974, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.260', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO3': '0.150', 'AMMO4': '0.195', 'weapon5': '0.270', 'weapon4': '0.322', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.458', 'WEAPON3': '0.950', 'HITCOUNT': '2.540', 'weapon3': '2.700', 'DAMAGECOUNT': '13.044', 'FRAGCOUNT': '41.000'} [2023-02-25 13:39:55,937][36139] DAMAGECOUNT value on done: 379632.0 [2023-02-25 13:39:55,938][36139] Sum rewards: 34.326, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.610', 'AMMO5': '0.024', 'AMMO2': '0.050', 'AMMO3': '0.185', 'weapon2': '0.190', 'AMMO4': '0.251', 'weapon5': '0.274', 'weapon4': '0.400', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'HITCOUNT': '2.010', 'weapon3': '2.872', 'DAMAGECOUNT': '10.680', 'FRAGCOUNT': '33.000'} [2023-02-25 13:39:56,254][36139] DAMAGECOUNT value on done: 380012.0 [2023-02-25 13:39:56,255][36139] Sum rewards: 45.609, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.134', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.038', 'weapon5': '0.050', 'AMMO4': '0.140', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'weapon2': '0.364', 'WEAPON3': '1.300', 'HITCOUNT': '2.820', 'weapon3': '3.340', 'DAMAGECOUNT': '12.969', 'FRAGCOUNT': '40.000'} [2023-02-25 13:39:56,809][36138] Updated weights for policy 0, policy_version 42183 (0.0009) [2023-02-25 13:39:57,281][36157] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-25 13:39:59,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 172818432. Throughput: 0: 3349.6. Samples: 5699390. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:39:59,730][36114] Avg episode reward: [(0, '50.884')] [2023-02-25 13:39:59,854][36138] Updated weights for policy 0, policy_version 42193 (0.0009) [2023-02-25 13:40:00,813][36154] DAMAGECOUNT value on done: 382355.0 [2023-02-25 13:40:00,814][36154] Sum rewards: 52.784, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.260', 'AMMO5': '0.021', 'AMMO2': '0.058', 'AMMO3': '0.166', 'weapon5': '0.272', 'AMMO4': '0.288', 'weapon2': '0.340', 'weapon4': '0.398', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'HITCOUNT': '2.630', 'weapon3': '2.690', 'DAMAGECOUNT': '13.830', 'FRAGCOUNT': '45.000'} [2023-02-25 13:40:01,112][36154] DAMAGECOUNT value on done: 376904.0 [2023-02-25 13:40:01,112][36154] Sum rewards: 47.050, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.424', 'ARMOR': '0.004', 'AMMO5': '0.029', 'AMMO2': '0.066', 'AMMO3': '0.157', 'weapon5': '0.322', 'AMMO4': '0.331', 'weapon2': '0.370', 'weapon4': '0.510', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '0.900', 'weapon3': '2.482', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '13.863', 'FRAGCOUNT': '40.500'} [2023-02-25 13:40:01,401][36154] DAMAGECOUNT value on done: 375873.0 [2023-02-25 13:40:01,402][36154] Sum rewards: 45.781, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.185', 'AMMO5': '0.009', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon4': '0.096', 'WEAPON4': '0.150', 'weapon5': '0.176', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'weapon2': '0.568', 'WEAPON3': '1.350', 'HITCOUNT': '2.390', 'weapon3': '2.932', 'DAMAGECOUNT': '12.996', 'FRAGCOUNT': '42.000'} [2023-02-25 13:40:01,719][36154] DAMAGECOUNT value on done: 379739.0 [2023-02-25 13:40:01,719][36154] Sum rewards: 35.055, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.730', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.058', 'AMMO4': '0.091', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.162', 'AMMO3': '0.252', 'weapon2': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '2.260', 'weapon3': '3.086', 'DAMAGECOUNT': '11.100', 'FRAGCOUNT': '34.000'} [2023-02-25 13:40:01,990][36141] DAMAGECOUNT value on done: 387763.0 [2023-02-25 13:40:01,990][36141] Sum rewards: 57.413, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.254', 'AMMO5': '0.013', 'AMMO2': '0.047', 'AMMO3': '0.181', 'weapon5': '0.188', 'weapon2': '0.230', 'AMMO4': '0.236', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.942', 'WEAPON3': '1.100', 'weapon3': '2.354', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.325', 'FRAGCOUNT': '51.000'} [2023-02-25 13:40:02,280][36141] DAMAGECOUNT value on done: 383352.0 [2023-02-25 13:40:02,280][36141] Sum rewards: 47.052, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.342', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon4': '0.208', 'AMMO3': '0.224', 'weapon5': '0.282', 'WEAPON4': '0.300', 'weapon2': '0.306', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.410', 'weapon3': '2.926', 'DAMAGECOUNT': '12.909', 'FRAGCOUNT': '43.000'} [2023-02-25 13:40:02,336][36141] DAMAGECOUNT value on done: 376778.0 [2023-02-25 13:40:02,336][36141] Sum rewards: 35.105, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.860', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.048', 'AMMO4': '0.055', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.247', 'weapon2': '0.564', 'WEAPON3': '1.400', 'HITCOUNT': '2.280', 'weapon3': '3.078', 'DAMAGECOUNT': '10.989', 'FRAGCOUNT': '33.000'} [2023-02-25 13:40:02,652][36141] DAMAGECOUNT value on done: 368464.0 [2023-02-25 13:40:02,652][36141] Sum rewards: 45.840, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.407', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO3': '0.128', 'AMMO4': '0.145', 'weapon5': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.386', 'weapon2': '0.562', 'WEAPON3': '0.850', 'HITCOUNT': '2.540', 'weapon3': '2.594', 'DAMAGECOUNT': '11.769', 'FRAGCOUNT': '38.000'} [2023-02-25 13:40:02,910][36138] Updated weights for policy 0, policy_version 42203 (0.0009) [2023-02-25 13:40:03,207][36157] DAMAGECOUNT value on done: 388442.0 [2023-02-25 13:40:03,208][36157] Sum rewards: 64.388, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.175', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon5': '0.122', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'weapon4': '0.202', 'weapon2': '0.226', 'AMMO3': '0.234', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.170', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '55.000'} [2023-02-25 13:40:03,526][36157] DAMAGECOUNT value on done: 384465.0 [2023-02-25 13:40:03,527][36157] Sum rewards: 60.899, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.070', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'weapon2': '0.354', 'WEAPON3': '1.100', 'HITCOUNT': '2.920', 'weapon3': '3.548', 'DAMAGECOUNT': '14.187', 'FRAGCOUNT': '50.000'} [2023-02-25 13:40:03,964][36157] DAMAGECOUNT value on done: 385138.0 [2023-02-25 13:40:03,964][36157] Sum rewards: 54.590, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.909', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'weapon5': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.492', 'weapon4': '0.512', 'WEAPON3': '1.000', 'weapon3': '2.434', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '13.863', 'FRAGCOUNT': '45.500'} [2023-02-25 13:40:04,138][36140] DAMAGECOUNT value on done: 388232.0 [2023-02-25 13:40:04,139][36140] Sum rewards: 52.947, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.130', 'AMMO5': '0.005', 'weapon5': '0.026', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon2': '0.474', 'weapon4': '0.482', 'ARMOR': '0.495', 'WEAPON3': '1.200', 'weapon3': '2.874', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.473', 'FRAGCOUNT': '45.000'} [2023-02-25 13:40:04,285][36157] DAMAGECOUNT value on done: 388384.0 [2023-02-25 13:40:04,286][36157] Sum rewards: 46.117, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.382', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.144', 'AMMO3': '0.199', 'AMMO4': '0.201', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON4': '0.350', 'weapon4': '0.578', 'WEAPON3': '1.200', 'weapon3': '2.814', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '12.684', 'FRAGCOUNT': '41.000'} [2023-02-25 13:40:04,440][36140] DAMAGECOUNT value on done: 378109.0 [2023-02-25 13:40:04,440][36140] Sum rewards: 56.371, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.446', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.032', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.118', 'weapon4': '0.166', 'AMMO3': '0.265', 'WEAPON3': '1.550', 'HITCOUNT': '3.060', 'weapon3': '3.472', 'DAMAGECOUNT': '15.141', 'FRAGCOUNT': '49.000'} [2023-02-25 13:40:04,670][36156] DAMAGECOUNT value on done: 388040.0 [2023-02-25 13:40:04,671][36156] Sum rewards: 48.516, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.555', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon5': '0.170', 'AMMO3': '0.192', 'AMMO4': '0.240', 'weapon2': '0.320', 'WEAPON5': '0.450', 'weapon4': '0.496', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.710', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.114', 'FRAGCOUNT': '44.000'} [2023-02-25 13:40:04,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 172883968. Throughput: 0: 3351.3. Samples: 5719584. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:40:04,730][36114] Avg episode reward: [(0, '51.067')] [2023-02-25 13:40:04,745][36140] DAMAGECOUNT value on done: 380822.0 [2023-02-25 13:40:04,746][36140] Sum rewards: 42.869, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.616', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.102', 'weapon5': '0.172', 'weapon4': '0.228', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.482', 'WEAPON3': '1.450', 'HITCOUNT': '2.640', 'weapon3': '2.690', 'DAMAGECOUNT': '12.207', 'FRAGCOUNT': '39.000'} [2023-02-25 13:40:04,834][36156] DAMAGECOUNT value on done: 388300.0 [2023-02-25 13:40:04,835][36156] Sum rewards: 43.001, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.100', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.068', 'WEAPON5': '0.150', 'weapon2': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.330', 'weapon4': '0.618', 'WEAPON3': '1.850', 'weapon3': '2.874', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.212', 'FRAGCOUNT': '43.000'} [2023-02-25 13:40:05,013][36156] DAMAGECOUNT value on done: 379809.0 [2023-02-25 13:40:05,014][36156] Sum rewards: 63.622, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.182', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO3': '0.138', 'AMMO4': '0.192', 'weapon5': '0.200', 'weapon4': '0.330', 'weapon2': '0.378', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'weapon3': '2.812', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '51.000'} [2023-02-25 13:40:05,072][36140] DAMAGECOUNT value on done: 376857.0 [2023-02-25 13:40:05,073][36140] Sum rewards: 58.451, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.110', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.142', 'AMMO4': '0.184', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'weapon2': '0.300', 'weapon4': '0.306', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.960', 'weapon3': '3.002', 'DAMAGECOUNT': '14.265', 'FRAGCOUNT': '53.000'} [2023-02-25 13:40:05,082][36142] DAMAGECOUNT value on done: 376636.0 [2023-02-25 13:40:05,082][36142] Sum rewards: 46.374, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.938', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.208', 'WEAPON4': '0.250', 'AMMO3': '0.258', 'WEAPON5': '0.300', 'weapon2': '0.308', 'weapon4': '0.426', 'WEAPON3': '1.500', 'weapon3': '2.794', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.831', 'FRAGCOUNT': '44.000'} [2023-02-25 13:40:05,170][36156] DAMAGECOUNT value on done: 384197.0 [2023-02-25 13:40:05,171][36156] Sum rewards: 55.217, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.145', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon5': '0.116', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.340', 'weapon2': '0.398', 'WEAPON3': '1.000', 'HITCOUNT': '2.740', 'weapon3': '2.970', 'DAMAGECOUNT': '13.947', 'FRAGCOUNT': '45.000'} [2023-02-25 13:40:05,360][36142] DAMAGECOUNT value on done: 372865.0 [2023-02-25 13:40:05,360][36142] Sum rewards: 53.154, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.507', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO3': '0.130', 'AMMO4': '0.187', 'weapon5': '0.242', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.434', 'weapon2': '0.460', 'WEAPON3': '0.800', 'weapon3': '2.612', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '13.308', 'FRAGCOUNT': '44.000'} [2023-02-25 13:40:05,381][36142] DAMAGECOUNT value on done: 376848.0 [2023-02-25 13:40:05,382][36142] Sum rewards: 48.799, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.970', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.142', 'AMMO3': '0.153', 'AMMO4': '0.192', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.428', 'WEAPON4': '0.450', 'weapon2': '0.778', 'WEAPON3': '1.000', 'weapon3': '2.262', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '12.477', 'FRAGCOUNT': '41.000'} [2023-02-25 13:40:05,669][36142] DAMAGECOUNT value on done: 385126.0 [2023-02-25 13:40:05,670][36142] Sum rewards: 33.763, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.199', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.098', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'weapon7': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.224', 'WEAPON3': '0.550', 'weapon4': '0.584', 'weapon3': '1.460', 'HITCOUNT': '1.550', 'DAMAGECOUNT': '7.992', 'FRAGCOUNT': '28.000'} [2023-02-25 13:40:05,961][36138] Updated weights for policy 0, policy_version 42213 (0.0009) [2023-02-25 13:40:08,941][36138] Updated weights for policy 0, policy_version 42223 (0.0009) [2023-02-25 13:40:09,129][36154] Large shaping reward 2.599 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5670000000000001, 189.0), ('weapon5', 0.002)] [2023-02-25 13:40:09,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 172953600. Throughput: 0: 3354.7. Samples: 5729660. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:40:09,729][36114] Avg episode reward: [(0, '50.771')] [2023-02-25 13:40:11,986][36138] Updated weights for policy 0, policy_version 42233 (0.0009) [2023-02-25 13:40:14,672][36155] DAMAGECOUNT value on done: 378131.0 [2023-02-25 13:40:14,672][36155] Sum rewards: 49.430, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.860', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.112', 'WEAPON4': '0.150', 'AMMO4': '0.171', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'weapon4': '0.262', 'weapon2': '0.332', 'WEAPON3': '1.150', 'HITCOUNT': '2.610', 'weapon3': '3.088', 'DAMAGECOUNT': '12.474', 'FRAGCOUNT': '43.000'} [2023-02-25 13:40:14,729][36114] Fps is (10 sec: 13926.5, 60 sec: 13448.5, 300 sec: 13426.6). Total num frames: 173023232. Throughput: 0: 3360.3. Samples: 5749984. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:40:14,729][36114] Avg episode reward: [(0, '50.709')] [2023-02-25 13:40:14,775][36139] DAMAGECOUNT value on done: 389763.0 [2023-02-25 13:40:14,776][36139] Sum rewards: 53.340, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.156', 'AMMO5': '0.011', 'AMMO2': '0.071', 'AMMO3': '0.167', 'weapon5': '0.214', 'WEAPON5': '0.350', 'AMMO4': '0.355', 'weapon2': '0.400', 'WEAPON4': '0.800', 'WEAPON3': '0.900', 'weapon4': '1.130', 'weapon3': '2.022', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '13.806', 'FRAGCOUNT': '47.000'} [2023-02-25 13:40:14,979][36155] DAMAGECOUNT value on done: 390264.0 [2023-02-25 13:40:14,979][36155] Sum rewards: 50.894, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.082', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.162', 'AMMO4': '0.176', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.382', 'weapon2': '0.628', 'WEAPON3': '1.050', 'weapon3': '2.576', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.010', 'FRAGCOUNT': '42.000'} [2023-02-25 13:40:15,010][36138] Updated weights for policy 0, policy_version 42243 (0.0010) [2023-02-25 13:40:15,092][36139] DAMAGECOUNT value on done: 384552.0 [2023-02-25 13:40:15,092][36139] Sum rewards: 49.240, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.040', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.028', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.267', 'weapon2': '0.268', 'WEAPON3': '1.650', 'HITCOUNT': '2.860', 'weapon3': '3.194', 'DAMAGECOUNT': '13.326', 'FRAGCOUNT': '46.500'} [2023-02-25 13:40:15,606][36155] DAMAGECOUNT value on done: 384600.0 [2023-02-25 13:40:15,606][36155] Sum rewards: 54.380, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.486', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon2': '0.176', 'AMMO3': '0.185', 'weapon5': '0.316', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.490', 'WEAPON3': '1.050', 'weapon3': '2.692', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.349', 'FRAGCOUNT': '47.000'} [2023-02-25 13:40:15,627][36139] DAMAGECOUNT value on done: 383365.0 [2023-02-25 13:40:15,627][36139] Sum rewards: 45.380, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.712', 'AMMO5': '0.005', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.130', 'AMMO4': '0.165', 'weapon2': '0.226', 'WEAPON4': '0.500', 'weapon4': '0.716', 'WEAPON3': '0.800', 'HITCOUNT': '2.530', 'weapon3': '2.588', 'DAMAGECOUNT': '11.199', 'FRAGCOUNT': '40.000'} [2023-02-25 13:40:15,906][36155] DAMAGECOUNT value on done: 382665.0 [2023-02-25 13:40:15,906][36155] Sum rewards: 56.656, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.720', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.046', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'weapon2': '0.360', 'weapon4': '0.498', 'WEAPON3': '1.200', 'weapon3': '2.944', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.325', 'FRAGCOUNT': '48.000'} [2023-02-25 13:40:15,943][36139] DAMAGECOUNT value on done: 384533.0 [2023-02-25 13:40:15,944][36139] Sum rewards: 55.054, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.370', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.094', 'AMMO4': '0.120', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'weapon4': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.288', 'WEAPON3': '1.000', 'HITCOUNT': '3.060', 'weapon3': '3.162', 'DAMAGECOUNT': '13.563', 'FRAGCOUNT': '47.500'} [2023-02-25 13:40:18,042][36138] Updated weights for policy 0, policy_version 42253 (0.0009) [2023-02-25 13:40:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 173088768. Throughput: 0: 3369.0. Samples: 5770324. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:40:19,729][36114] Avg episode reward: [(0, '50.678')] [2023-02-25 13:40:20,711][36154] DAMAGECOUNT value on done: 387774.0 [2023-02-25 13:40:20,712][36154] Sum rewards: 65.396, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.754', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.124', 'AMMO3': '0.127', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon4': '0.404', 'weapon2': '0.672', 'WEAPON3': '0.900', 'weapon3': '2.642', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.257', 'FRAGCOUNT': '52.000'} [2023-02-25 13:40:21,015][36154] DAMAGECOUNT value on done: 381361.0 [2023-02-25 13:40:21,016][36154] Sum rewards: 57.495, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.608', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.021', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'AMMO3': '0.197', 'weapon4': '0.266', 'weapon2': '0.552', 'WEAPON3': '1.200', 'weapon3': '2.998', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.371', 'FRAGCOUNT': '49.000'} [2023-02-25 13:40:21,040][36138] Updated weights for policy 0, policy_version 42263 (0.0009) [2023-02-25 13:40:21,320][36154] DAMAGECOUNT value on done: 381823.0 [2023-02-25 13:40:21,321][36154] Sum rewards: 64.602, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.201', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.044', 'AMMO3': '0.170', 'AMMO4': '0.221', 'weapon2': '0.236', 'weapon4': '0.248', 'weapon5': '0.266', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.866', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.850', 'FRAGCOUNT': '53.500'} [2023-02-25 13:40:21,626][36154] DAMAGECOUNT value on done: 383658.0 [2023-02-25 13:40:21,626][36154] Sum rewards: 47.736, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.865', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.058', 'AMMO4': '0.061', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.154', 'AMMO3': '0.237', 'weapon2': '0.356', 'WEAPON3': '1.350', 'HITCOUNT': '2.430', 'weapon3': '3.180', 'DAMAGECOUNT': '11.757', 'FRAGCOUNT': '44.000'} [2023-02-25 13:40:21,802][36141] DAMAGECOUNT value on done: 392740.0 [2023-02-25 13:40:21,803][36141] Sum rewards: 59.015, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.061', 'AMMO5': '0.012', 'AMMO2': '0.045', 'AMMO3': '0.203', 'weapon5': '0.210', 'AMMO4': '0.224', 'weapon4': '0.312', 'WEAPON5': '0.350', 'weapon2': '0.386', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.842', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.931', 'FRAGCOUNT': '52.000'} [2023-02-25 13:40:22,119][36141] DAMAGECOUNT value on done: 387733.0 [2023-02-25 13:40:22,119][36141] Sum rewards: 52.857, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.548', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.152', 'weapon2': '0.184', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.382', 'WEAPON3': '1.050', 'HITCOUNT': '2.540', 'weapon3': '3.048', 'DAMAGECOUNT': '13.143', 'FRAGCOUNT': '44.000'} [2023-02-25 13:40:22,198][36141] DAMAGECOUNT value on done: 380329.0 [2023-02-25 13:40:22,198][36141] Sum rewards: 44.952, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.162', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.280', 'weapon5': '0.304', 'weapon2': '0.446', 'WEAPON3': '0.800', 'HITCOUNT': '2.130', 'weapon3': '2.772', 'DAMAGECOUNT': '10.653', 'FRAGCOUNT': '37.000'} [2023-02-25 13:40:22,496][36141] DAMAGECOUNT value on done: 372761.0 [2023-02-25 13:40:22,497][36141] Sum rewards: 43.560, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.042', 'ARMOR': '0.008', 'AMMO5': '0.021', 'AMMO2': '0.056', 'AMMO3': '0.159', 'AMMO4': '0.282', 'weapon5': '0.340', 'weapon2': '0.360', 'WEAPON5': '0.600', 'WEAPON4': '0.750', 'weapon4': '0.878', 'WEAPON3': '0.950', 'weapon3': '2.046', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.891', 'FRAGCOUNT': '40.000'} [2023-02-25 13:40:23,108][36157] DAMAGECOUNT value on done: 393671.0 [2023-02-25 13:40:23,108][36157] Sum rewards: 60.482, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.111', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon5': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.218', 'AMMO3': '0.219', 'weapon4': '0.276', 'WEAPON3': '1.350', 'weapon3': '3.106', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.687', 'FRAGCOUNT': '52.000'} [2023-02-25 13:40:23,417][36157] DAMAGECOUNT value on done: 389165.0 [2023-02-25 13:40:23,418][36157] Sum rewards: 55.364, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.748', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'weapon5': '0.084', 'AMMO3': '0.134', 'AMMO4': '0.192', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.440', 'weapon4': '0.588', 'WEAPON3': '0.900', 'weapon3': '2.706', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.100', 'FRAGCOUNT': '45.000'} [2023-02-25 13:40:23,840][36157] DAMAGECOUNT value on done: 390001.0 [2023-02-25 13:40:23,841][36157] Sum rewards: 52.962, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.526', 'AMMO5': '0.007', 'AMMO2': '0.031', 'AMMO4': '0.153', 'weapon5': '0.160', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.404', 'weapon4': '0.658', 'WEAPON3': '1.050', 'weapon3': '2.430', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '14.574', 'FRAGCOUNT': '45.000'} [2023-02-25 13:40:23,891][36140] DAMAGECOUNT value on done: 392282.0 [2023-02-25 13:40:23,892][36140] Sum rewards: 44.304, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.888', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'weapon5': '0.040', 'AMMO4': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.240', 'AMMO3': '0.244', 'weapon2': '0.384', 'WEAPON3': '1.350', 'HITCOUNT': '2.780', 'weapon3': '3.132', 'DAMAGECOUNT': '12.150', 'FRAGCOUNT': '41.000'} [2023-02-25 13:40:24,064][36138] Updated weights for policy 0, policy_version 42273 (0.0009) [2023-02-25 13:40:24,154][36157] DAMAGECOUNT value on done: 393965.0 [2023-02-25 13:40:24,154][36157] Sum rewards: 59.785, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.061', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.162', 'AMMO3': '0.185', 'weapon4': '0.222', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.974', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '51.000'} [2023-02-25 13:40:24,206][36140] DAMAGECOUNT value on done: 380266.0 [2023-02-25 13:40:24,206][36140] Sum rewards: 23.232, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.490', 'AMMO5': '0.003', 'weapon5': '0.020', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon7': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.136', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'weapon2': '0.232', 'weapon4': '0.662', 'WEAPON3': '0.800', 'HITCOUNT': '1.510', 'weapon3': '1.634', 'DAMAGECOUNT': '6.471', 'FRAGCOUNT': '21.500'} [2023-02-25 13:40:24,500][36140] DAMAGECOUNT value on done: 385415.0 [2023-02-25 13:40:24,500][36140] Sum rewards: 51.615, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.188', 'AMMO5': '0.011', 'AMMO2': '0.037', 'AMMO3': '0.167', 'AMMO4': '0.184', 'weapon5': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.314', 'weapon4': '0.610', 'WEAPON3': '1.000', 'weapon3': '2.658', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '13.779', 'FRAGCOUNT': '43.000'} [2023-02-25 13:40:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 173158400. Throughput: 0: 3367.0. Samples: 5780364. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:40:24,730][36114] Avg episode reward: [(0, '50.884')] [2023-02-25 13:40:24,751][36156] DAMAGECOUNT value on done: 392066.0 [2023-02-25 13:40:24,752][36156] Sum rewards: 48.207, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.037', 'AMMO2': '0.005', 'AMMO5': '0.009', 'AMMO4': '0.026', 'weapon4': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.159', 'weapon5': '0.164', 'WEAPON5': '0.200', 'weapon2': '0.228', 'WEAPON3': '1.100', 'HITCOUNT': '2.560', 'weapon3': '3.418', 'DAMAGECOUNT': '12.048', 'FRAGCOUNT': '40.000'} [2023-02-25 13:40:24,808][36140] DAMAGECOUNT value on done: 381405.0 [2023-02-25 13:40:24,808][36140] Sum rewards: 48.824, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.816', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.042', 'AMMO3': '0.152', 'AMMO4': '0.209', 'weapon2': '0.332', 'WEAPON5': '0.350', 'weapon5': '0.422', 'WEAPON4': '0.550', 'WEAPON3': '0.950', 'weapon4': '1.028', 'weapon3': '1.878', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.644', 'FRAGCOUNT': '43.000'} [2023-02-25 13:40:24,873][36156] DAMAGECOUNT value on done: 393282.0 [2023-02-25 13:40:24,873][36156] Sum rewards: 63.445, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.598', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon2': '0.258', 'weapon4': '0.486', 'WEAPON3': '1.200', 'weapon3': '3.016', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '14.946', 'FRAGCOUNT': '55.000'} [2023-02-25 13:40:25,036][36142] DAMAGECOUNT value on done: 380950.0 [2023-02-25 13:40:25,037][36142] Sum rewards: 49.216, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.065', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.122', 'AMMO4': '0.156', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'weapon4': '0.324', 'WEAPON4': '0.350', 'weapon2': '0.506', 'WEAPON3': '1.100', 'HITCOUNT': '2.730', 'weapon3': '2.826', 'DAMAGECOUNT': '12.942', 'FRAGCOUNT': '44.000'} [2023-02-25 13:40:25,090][36156] DAMAGECOUNT value on done: 384354.0 [2023-02-25 13:40:25,091][36156] Sum rewards: 55.488, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.905', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.207', 'weapon2': '0.418', 'WEAPON3': '1.300', 'HITCOUNT': '2.790', 'weapon3': '3.378', 'DAMAGECOUNT': '13.635', 'FRAGCOUNT': '47.500'} [2023-02-25 13:40:25,208][36156] DAMAGECOUNT value on done: 389523.0 [2023-02-25 13:40:25,209][36156] Sum rewards: 59.514, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.973', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon2': '0.176', 'AMMO3': '0.182', 'weapon5': '0.194', 'AMMO4': '0.215', 'WEAPON5': '0.350', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon4': '1.150', 'weapon3': '2.234', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '50.000'} [2023-02-25 13:40:25,359][36142] DAMAGECOUNT value on done: 377259.0 [2023-02-25 13:40:25,360][36142] Sum rewards: 42.620, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.002', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.037', 'AMMO4': '0.183', 'weapon5': '0.202', 'AMMO3': '0.237', 'weapon4': '0.378', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.572', 'WEAPON3': '1.400', 'weapon3': '2.508', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '13.182', 'FRAGCOUNT': '39.000'} [2023-02-25 13:40:25,370][36142] DAMAGECOUNT value on done: 381169.0 [2023-02-25 13:40:25,371][36142] Sum rewards: 50.167, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.540', 'ARMOR': '0.004', 'AMMO5': '0.006', 'weapon5': '0.030', 'AMMO2': '0.034', 'weapon4': '0.104', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon2': '0.546', 'WEAPON3': '1.150', 'HITCOUNT': '2.700', 'weapon3': '2.930', 'DAMAGECOUNT': '12.933', 'FRAGCOUNT': '44.000'} [2023-02-25 13:40:25,663][36142] DAMAGECOUNT value on done: 389368.0 [2023-02-25 13:40:25,664][36142] Sum rewards: 50.199, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.308', 'AMMO5': '0.017', 'AMMO2': '0.052', 'AMMO3': '0.163', 'AMMO4': '0.259', 'weapon5': '0.348', 'WEAPON5': '0.450', 'weapon2': '0.456', 'weapon4': '0.470', 'WEAPON4': '0.550', 'WEAPON3': '0.950', 'weapon3': '2.346', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '12.726', 'FRAGCOUNT': '45.000'} [2023-02-25 13:40:27,085][36138] Updated weights for policy 0, policy_version 42283 (0.0009) [2023-02-25 13:40:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13426.6). Total num frames: 173223936. Throughput: 0: 3368.2. Samples: 5800722. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:40:29,729][36114] Avg episode reward: [(0, '50.942')] [2023-02-25 13:40:30,099][36138] Updated weights for policy 0, policy_version 42293 (0.0009) [2023-02-25 13:40:33,113][36138] Updated weights for policy 0, policy_version 42303 (0.0010) [2023-02-25 13:40:34,405][36155] DAMAGECOUNT value on done: 383239.0 [2023-02-25 13:40:34,405][36155] Sum rewards: 55.895, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.986', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.132', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.384', 'weapon2': '0.546', 'WEAPON3': '1.300', 'weapon3': '2.694', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.324', 'FRAGCOUNT': '48.000'} [2023-02-25 13:40:34,657][36139] DAMAGECOUNT value on done: 394437.0 [2023-02-25 13:40:34,658][36139] Sum rewards: 52.695, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.855', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon5': '0.124', 'AMMO3': '0.142', 'AMMO4': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.340', 'weapon4': '0.352', 'WEAPON3': '0.950', 'weapon3': '2.960', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.022', 'FRAGCOUNT': '43.000'} [2023-02-25 13:40:34,720][36155] DAMAGECOUNT value on done: 395000.0 [2023-02-25 13:40:34,720][36155] Sum rewards: 59.917, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.549', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.024', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.215', 'weapon2': '0.258', 'WEAPON3': '1.250', 'HITCOUNT': '2.980', 'weapon3': '3.504', 'DAMAGECOUNT': '14.208', 'FRAGCOUNT': '52.000'} [2023-02-25 13:40:34,729][36114] Fps is (10 sec: 13517.0, 60 sec: 13516.8, 300 sec: 13426.6). Total num frames: 173293568. Throughput: 0: 3373.2. Samples: 5821108. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:40:34,729][36114] Avg episode reward: [(0, '51.378')] [2023-02-25 13:40:34,955][36139] DAMAGECOUNT value on done: 388989.0 [2023-02-25 13:40:34,956][36139] Sum rewards: 47.252, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.136', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.147', 'AMMO3': '0.195', 'weapon5': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.408', 'weapon4': '0.526', 'WEAPON3': '1.100', 'weapon3': '2.480', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '13.311', 'FRAGCOUNT': '40.500'} [2023-02-25 13:40:35,315][36155] DAMAGECOUNT value on done: 388967.0 [2023-02-25 13:40:35,315][36155] Sum rewards: 52.298, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.888', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.040', 'AMMO3': '0.139', 'AMMO4': '0.199', 'weapon5': '0.204', 'weapon4': '0.248', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.456', 'WEAPON3': '0.900', 'HITCOUNT': '2.710', 'weapon3': '2.866', 'DAMAGECOUNT': '13.101', 'FRAGCOUNT': '44.500'} [2023-02-25 13:40:35,465][36139] DAMAGECOUNT value on done: 388531.0 [2023-02-25 13:40:35,466][36139] Sum rewards: 57.012, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.715', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon5': '0.186', 'AMMO3': '0.203', 'weapon2': '0.242', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.704', 'WEAPON3': '1.100', 'weapon3': '2.546', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.498', 'FRAGCOUNT': '47.000'} [2023-02-25 13:40:35,625][36155] DAMAGECOUNT value on done: 387840.0 [2023-02-25 13:40:35,625][36155] Sum rewards: 62.432, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.550', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.136', 'AMMO3': '0.137', 'weapon5': '0.156', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.516', 'weapon4': '0.660', 'WEAPON3': '0.850', 'weapon3': '2.440', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.525', 'FRAGCOUNT': '50.500'} [2023-02-25 13:40:35,768][36139] DAMAGECOUNT value on done: 388991.0 [2023-02-25 13:40:35,768][36139] Sum rewards: 56.500, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.340', 'AMMO5': '0.008', 'weapon5': '0.016', 'AMMO2': '0.031', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.177', 'weapon2': '0.238', 'WEAPON4': '0.300', 'weapon4': '0.436', 'WEAPON3': '1.100', 'HITCOUNT': '2.940', 'weapon3': '3.166', 'DAMAGECOUNT': '13.374', 'FRAGCOUNT': '48.500'} [2023-02-25 13:40:36,148][36138] Updated weights for policy 0, policy_version 42313 (0.0009) [2023-02-25 13:40:39,176][36138] Updated weights for policy 0, policy_version 42323 (0.0009) [2023-02-25 13:40:39,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 173359104. Throughput: 0: 3375.1. Samples: 5831218. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:40:39,730][36114] Avg episode reward: [(0, '51.651')] [2023-02-25 13:40:40,719][36154] DAMAGECOUNT value on done: 391441.0 [2023-02-25 13:40:40,719][36154] Sum rewards: 45.285, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.213', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.080', 'AMMO4': '0.159', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon2': '0.366', 'weapon4': '0.588', 'WEAPON3': '1.050', 'HITCOUNT': '2.480', 'weapon3': '2.736', 'DAMAGECOUNT': '11.001', 'FRAGCOUNT': '40.000'} [2023-02-25 13:40:41,029][36154] DAMAGECOUNT value on done: 386092.0 [2023-02-25 13:40:41,029][36154] Sum rewards: 45.210, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-4.416', 'ARMOR': '0.008', 'AMMO5': '0.024', 'AMMO2': '0.065', 'AMMO3': '0.245', 'weapon5': '0.274', 'AMMO4': '0.323', 'weapon4': '0.418', 'WEAPON5': '0.450', 'weapon2': '0.714', 'WEAPON4': '0.750', 'WEAPON3': '1.450', 'weapon3': '2.222', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.193', 'FRAGCOUNT': '45.000'} [2023-02-25 13:40:41,314][36154] DAMAGECOUNT value on done: 386590.0 [2023-02-25 13:40:41,315][36154] Sum rewards: 55.488, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.722', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.182', 'weapon5': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.508', 'weapon4': '0.570', 'WEAPON3': '1.150', 'weapon3': '2.512', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.301', 'FRAGCOUNT': '47.000'} [2023-02-25 13:40:41,615][36154] DAMAGECOUNT value on done: 389384.0 [2023-02-25 13:40:41,616][36154] Sum rewards: 61.882, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.595', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.088', 'AMMO4': '0.137', 'weapon4': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.250', 'weapon3': '3.220', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '53.000'} [2023-02-25 13:40:41,669][36141] DAMAGECOUNT value on done: 397297.0 [2023-02-25 13:40:41,669][36141] Sum rewards: 54.740, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.752', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.194', 'AMMO3': '0.196', 'weapon4': '0.306', 'weapon2': '0.336', 'WEAPON3': '1.200', 'HITCOUNT': '2.810', 'weapon3': '2.940', 'DAMAGECOUNT': '13.671', 'FRAGCOUNT': '46.500'} [2023-02-25 13:40:41,973][36141] DAMAGECOUNT value on done: 392905.0 [2023-02-25 13:40:41,974][36141] Sum rewards: 60.253, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.464', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon5': '0.140', 'weapon4': '0.170', 'AMMO3': '0.178', 'AMMO4': '0.246', 'WEAPON5': '0.400', 'weapon2': '0.402', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.990', 'weapon3': '3.052', 'DAMAGECOUNT': '15.516', 'FRAGCOUNT': '52.000'} [2023-02-25 13:40:42,055][36141] DAMAGECOUNT value on done: 384777.0 [2023-02-25 13:40:42,055][36141] Sum rewards: 57.766, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.990', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.071', 'weapon4': '0.122', 'AMMO3': '0.190', 'weapon2': '0.706', 'WEAPON3': '1.150', 'HITCOUNT': '2.790', 'weapon3': '3.064', 'DAMAGECOUNT': '13.344', 'FRAGCOUNT': '50.000'} [2023-02-25 13:40:42,209][36138] Updated weights for policy 0, policy_version 42333 (0.0009) [2023-02-25 13:40:42,347][36141] DAMAGECOUNT value on done: 377255.0 [2023-02-25 13:40:42,348][36141] Sum rewards: 54.077, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.475', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.090', 'AMMO4': '0.166', 'AMMO3': '0.166', 'weapon4': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.050', 'HITCOUNT': '2.570', 'weapon3': '3.132', 'DAMAGECOUNT': '13.482', 'FRAGCOUNT': '46.500'} [2023-02-25 13:40:42,800][36157] DAMAGECOUNT value on done: 397727.0 [2023-02-25 13:40:42,800][36157] Sum rewards: 44.666, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.340', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.037', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO4': '0.187', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'weapon4': '0.304', 'weapon2': '0.708', 'WEAPON3': '1.150', 'HITCOUNT': '2.480', 'weapon3': '2.502', 'DAMAGECOUNT': '12.168', 'FRAGCOUNT': '40.000'} [2023-02-25 13:40:43,107][36157] DAMAGECOUNT value on done: 393169.0 [2023-02-25 13:40:43,108][36157] Sum rewards: 48.239, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.800', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.106', 'weapon4': '0.126', 'weapon2': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'WEAPON3': '1.150', 'HITCOUNT': '2.300', 'weapon3': '3.442', 'DAMAGECOUNT': '12.012', 'FRAGCOUNT': '41.000'} [2023-02-25 13:40:43,553][36157] DAMAGECOUNT value on done: 393895.0 [2023-02-25 13:40:43,554][36157] Sum rewards: 45.777, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.150', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.112', 'AMMO3': '0.130', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.316', 'WEAPON3': '0.850', 'weapon4': '0.870', 'HITCOUNT': '2.370', 'weapon3': '2.540', 'DAMAGECOUNT': '11.682', 'FRAGCOUNT': '38.000'} [2023-02-25 13:40:43,858][36157] DAMAGECOUNT value on done: 397740.0 [2023-02-25 13:40:43,858][36157] Sum rewards: 45.069, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.050', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.034', 'AMMO4': '0.141', 'AMMO3': '0.153', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.302', 'weapon4': '0.416', 'WEAPON3': '0.900', 'HITCOUNT': '2.530', 'weapon3': '3.076', 'DAMAGECOUNT': '11.325', 'FRAGCOUNT': '38.000'} [2023-02-25 13:40:43,900][36140] DAMAGECOUNT value on done: 396496.0 [2023-02-25 13:40:43,900][36140] Sum rewards: 43.112, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.874', 'ARMOR': '0.008', 'AMMO5': '0.025', 'AMMO2': '0.073', 'AMMO3': '0.150', 'weapon2': '0.332', 'weapon5': '0.362', 'AMMO4': '0.366', 'WEAPON5': '0.600', 'WEAPON4': '0.750', 'WEAPON3': '0.850', 'weapon4': '0.960', 'weapon3': '2.018', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '12.642', 'FRAGCOUNT': '39.000'} [2023-02-25 13:40:44,223][36140] DAMAGECOUNT value on done: 385700.0 [2023-02-25 13:40:44,224][36140] Sum rewards: 60.301, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.703', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.163', 'AMMO3': '0.182', 'weapon5': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON4': '0.300', 'weapon4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.634', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '50.500'} [2023-02-25 13:40:44,547][36140] DAMAGECOUNT value on done: 390061.0 [2023-02-25 13:40:44,547][36140] Sum rewards: 50.669, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.001', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.170', 'weapon2': '0.268', 'weapon5': '0.286', 'weapon4': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '2.930', 'weapon3': '2.944', 'DAMAGECOUNT': '13.623', 'FRAGCOUNT': '43.500'} [2023-02-25 13:40:44,676][36156] DAMAGECOUNT value on done: 395709.0 [2023-02-25 13:40:44,676][36156] Sum rewards: 45.831, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.792', 'ARMOR': '0.004', 'AMMO5': '0.027', 'AMMO2': '0.035', 'AMMO3': '0.115', 'AMMO4': '0.173', 'weapon5': '0.250', 'weapon4': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.650', 'WEAPON3': '0.700', 'weapon2': '0.790', 'weapon3': '2.394', 'HITCOUNT': '2.400', 'DAMAGECOUNT': '10.929', 'FRAGCOUNT': '38.000'} [2023-02-25 13:40:44,729][36114] Fps is (10 sec: 13516.5, 60 sec: 13516.8, 300 sec: 13440.4). Total num frames: 173428736. Throughput: 0: 3379.1. Samples: 5851448. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:40:44,730][36114] Avg episode reward: [(0, '51.348')] [2023-02-25 13:40:44,813][36156] DAMAGECOUNT value on done: 397688.0 [2023-02-25 13:40:44,813][36156] Sum rewards: 46.291, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.344', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.061', 'weapon5': '0.082', 'AMMO3': '0.210', 'AMMO4': '0.304', 'WEAPON5': '0.400', 'weapon2': '0.540', 'weapon4': '0.686', 'WEAPON4': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.398', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.218', 'FRAGCOUNT': '44.000'} [2023-02-25 13:40:44,865][36140] DAMAGECOUNT value on done: 386231.0 [2023-02-25 13:40:44,866][36140] Sum rewards: 58.935, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.750', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.090', 'AMMO4': '0.135', 'AMMO3': '0.180', 'weapon4': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.402', 'WEAPON3': '1.100', 'HITCOUNT': '3.060', 'weapon3': '3.120', 'DAMAGECOUNT': '14.478', 'FRAGCOUNT': '50.000'} [2023-02-25 13:40:44,992][36156] DAMAGECOUNT value on done: 388742.0 [2023-02-25 13:40:44,992][36156] Sum rewards: 45.812, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.398', 'AMMO2': '0.025', 'AMMO5': '0.026', 'AMMO4': '0.123', 'weapon2': '0.170', 'weapon5': '0.182', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.418', 'WEAPON3': '1.400', 'HITCOUNT': '2.550', 'weapon3': '2.964', 'DAMAGECOUNT': '13.164', 'FRAGCOUNT': '42.000'} [2023-02-25 13:40:45,000][36142] DAMAGECOUNT value on done: 384792.0 [2023-02-25 13:40:45,001][36142] Sum rewards: 37.423, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.220', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'AMMO4': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.516', 'weapon2': '0.660', 'WEAPON3': '1.100', 'HITCOUNT': '2.480', 'weapon3': '2.514', 'DAMAGECOUNT': '11.526', 'FRAGCOUNT': '34.000'} [2023-02-25 13:40:45,125][36156] DAMAGECOUNT value on done: 393773.0 [2023-02-25 13:40:45,125][36156] Sum rewards: 49.779, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.342', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.058', 'AMMO4': '0.178', 'AMMO3': '0.179', 'weapon2': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.792', 'WEAPON3': '1.150', 'weapon3': '2.674', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.750', 'FRAGCOUNT': '45.000'} [2023-02-25 13:40:45,276][36138] Updated weights for policy 0, policy_version 42343 (0.0009) [2023-02-25 13:40:45,302][36142] DAMAGECOUNT value on done: 381567.0 [2023-02-25 13:40:45,303][36142] Sum rewards: 45.290, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.800', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon5': '0.146', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'AMMO4': '0.204', 'weapon4': '0.218', 'WEAPON4': '0.350', 'weapon2': '0.386', 'WEAPON3': '1.100', 'HITCOUNT': '2.590', 'weapon3': '2.992', 'DAMAGECOUNT': '12.924', 'FRAGCOUNT': '40.000'} [2023-02-25 13:40:45,312][36142] DAMAGECOUNT value on done: 386502.0 [2023-02-25 13:40:45,313][36142] Sum rewards: 49.248, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.656', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.098', 'AMMO3': '0.183', 'AMMO4': '0.193', 'weapon5': '0.216', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.440', 'WEAPON3': '1.200', 'weapon3': '2.950', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '41.000'} [2023-02-25 13:40:45,631][36142] DAMAGECOUNT value on done: 393794.0 [2023-02-25 13:40:45,631][36142] Sum rewards: 50.846, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.073', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'weapon4': '0.528', 'weapon2': '0.588', 'WEAPON3': '1.150', 'weapon3': '2.688', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.278', 'FRAGCOUNT': '43.000'} [2023-02-25 13:40:48,337][36138] Updated weights for policy 0, policy_version 42353 (0.0009) [2023-02-25 13:40:49,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 173494272. Throughput: 0: 3372.9. Samples: 5871364. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:40:49,730][36114] Avg episode reward: [(0, '50.977')] [2023-02-25 13:40:51,462][36138] Updated weights for policy 0, policy_version 42363 (0.0009) [2023-02-25 13:40:52,455][36154] Large shaping reward 2.584 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.552, 184.0), ('weapon5', 0.002)] [2023-02-25 13:40:54,462][36155] DAMAGECOUNT value on done: 388457.0 [2023-02-25 13:40:54,463][36155] Sum rewards: 51.506, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.328', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.043', 'AMMO3': '0.204', 'AMMO4': '0.216', 'weapon5': '0.230', 'weapon2': '0.272', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon4': '0.582', 'WEAPON3': '1.200', 'weapon3': '2.572', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.591', 'FRAGCOUNT': '44.000'} [2023-02-25 13:40:54,500][36138] Updated weights for policy 0, policy_version 42373 (0.0009) [2023-02-25 13:40:54,627][36139] DAMAGECOUNT value on done: 398623.0 [2023-02-25 13:40:54,627][36139] Sum rewards: 42.386, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.419', 'ARMOR': '0.008', 'AMMO5': '0.023', 'AMMO2': '0.048', 'weapon5': '0.118', 'weapon4': '0.152', 'AMMO3': '0.231', 'AMMO4': '0.239', 'WEAPON4': '0.450', 'weapon2': '0.508', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'HITCOUNT': '2.610', 'weapon3': '2.960', 'DAMAGECOUNT': '12.558', 'FRAGCOUNT': '41.000'} [2023-02-25 13:40:54,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13448.5, 300 sec: 13426.6). Total num frames: 173559808. Throughput: 0: 3371.7. Samples: 5881388. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:40:54,730][36114] Avg episode reward: [(0, '51.018')] [2023-02-25 13:40:54,772][36155] DAMAGECOUNT value on done: 399989.0 [2023-02-25 13:40:54,773][36155] Sum rewards: 53.824, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.432', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.060', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.246', 'weapon2': '0.378', 'weapon4': '0.508', 'WEAPON3': '1.500', 'weapon3': '2.858', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.958', 'FRAGCOUNT': '48.000'} [2023-02-25 13:40:54,935][36139] DAMAGECOUNT value on done: 394246.0 [2023-02-25 13:40:54,936][36139] Sum rewards: 60.351, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.530', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon5': '0.094', 'AMMO4': '0.171', 'AMMO3': '0.194', 'weapon2': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.498', 'WEAPON3': '1.200', 'weapon3': '2.592', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '15.771', 'FRAGCOUNT': '51.000'} [2023-02-25 13:40:55,370][36155] DAMAGECOUNT value on done: 394843.0 [2023-02-25 13:40:55,371][36155] Sum rewards: 59.101, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.200', 'ARMOR': '0.004', 'AMMO5': '0.026', 'AMMO2': '0.062', 'weapon4': '0.170', 'AMMO3': '0.206', 'AMMO4': '0.307', 'weapon5': '0.444', 'weapon2': '0.480', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.564', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '52.000'} [2023-02-25 13:40:55,450][36139] DAMAGECOUNT value on done: 392666.0 [2023-02-25 13:40:55,451][36139] Sum rewards: 42.851, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.479', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.096', 'weapon4': '0.144', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '1.006', 'WEAPON3': '1.150', 'weapon3': '2.536', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '12.405', 'FRAGCOUNT': '39.000'} [2023-02-25 13:40:55,681][36155] DAMAGECOUNT value on done: 392602.0 [2023-02-25 13:40:55,682][36155] Sum rewards: 55.728, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.895', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.096', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.256', 'weapon2': '0.570', 'WEAPON3': '1.050', 'weapon3': '2.982', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.286', 'FRAGCOUNT': '45.000'} [2023-02-25 13:40:55,770][36139] DAMAGECOUNT value on done: 393930.0 [2023-02-25 13:40:55,771][36139] Sum rewards: 56.050, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.750', 'AMMO2': '0.009', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'weapon5': '0.162', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.448', 'weapon4': '0.666', 'WEAPON3': '1.200', 'weapon3': '2.504', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.817', 'FRAGCOUNT': '47.000'} [2023-02-25 13:40:57,597][36138] Updated weights for policy 0, policy_version 42383 (0.0009) [2023-02-25 13:40:59,729][36114] Fps is (10 sec: 13107.4, 60 sec: 13448.6, 300 sec: 13426.6). Total num frames: 173625344. Throughput: 0: 3362.9. Samples: 5901314. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:40:59,729][36114] Avg episode reward: [(0, '51.097')] [2023-02-25 13:41:00,646][36138] Updated weights for policy 0, policy_version 42393 (0.0009) [2023-02-25 13:41:00,897][36154] DAMAGECOUNT value on done: 396049.0 [2023-02-25 13:41:00,898][36154] Sum rewards: 54.065, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.210', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.034', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.244', 'weapon4': '0.476', 'WEAPON3': '1.250', 'weapon3': '2.994', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '13.824', 'FRAGCOUNT': '46.000'} [2023-02-25 13:41:01,217][36154] DAMAGECOUNT value on done: 390039.0 [2023-02-25 13:41:01,217][36154] Sum rewards: 44.953, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.611', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.032', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'weapon4': '0.336', 'weapon2': '0.524', 'WEAPON3': '1.150', 'HITCOUNT': '2.560', 'weapon3': '2.958', 'DAMAGECOUNT': '11.841', 'FRAGCOUNT': '38.000'} [2023-02-25 13:41:01,504][36154] DAMAGECOUNT value on done: 391892.0 [2023-02-25 13:41:01,505][36154] Sum rewards: 59.613, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.889', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO3': '0.149', 'AMMO4': '0.167', 'weapon5': '0.240', 'WEAPON5': '0.400', 'weapon2': '0.486', 'WEAPON4': '0.500', 'weapon4': '0.618', 'WEAPON3': '0.900', 'weapon3': '2.330', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.906', 'FRAGCOUNT': '51.000'} [2023-02-25 13:41:01,806][36154] DAMAGECOUNT value on done: 394374.0 [2023-02-25 13:41:01,806][36154] Sum rewards: 50.769, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.657', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.040', 'AMMO3': '0.171', 'weapon5': '0.190', 'AMMO4': '0.201', 'weapon2': '0.252', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.784', 'WEAPON3': '1.000', 'weapon3': '2.522', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.970', 'FRAGCOUNT': '42.000'} [2023-02-25 13:41:01,900][36141] DAMAGECOUNT value on done: 401812.0 [2023-02-25 13:41:01,900][36141] Sum rewards: 51.476, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.633', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'weapon2': '0.286', 'weapon4': '0.416', 'WEAPON3': '1.200', 'HITCOUNT': '2.650', 'weapon3': '2.954', 'DAMAGECOUNT': '13.545', 'FRAGCOUNT': '45.000'} [2023-02-25 13:41:02,211][36141] DAMAGECOUNT value on done: 397663.0 [2023-02-25 13:41:02,211][36141] Sum rewards: 54.411, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.692', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.048', 'WEAPON5': '0.100', 'weapon2': '0.124', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'weapon4': '0.286', 'WEAPON3': '1.450', 'HITCOUNT': '2.980', 'weapon3': '3.354', 'DAMAGECOUNT': '14.274', 'FRAGCOUNT': '49.000'} [2023-02-25 13:41:02,223][36141] DAMAGECOUNT value on done: 389277.0 [2023-02-25 13:41:02,224][36141] Sum rewards: 46.439, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.534', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.050', 'AMMO3': '0.138', 'AMMO4': '0.248', 'weapon2': '0.260', 'weapon5': '0.296', 'weapon4': '0.638', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '0.850', 'weapon3': '2.472', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '13.500', 'FRAGCOUNT': '40.000'} [2023-02-25 13:41:02,553][36141] DAMAGECOUNT value on done: 381858.0 [2023-02-25 13:41:02,554][36141] Sum rewards: 56.438, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.640', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.048', 'weapon5': '0.064', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.392', 'WEAPON3': '1.300', 'HITCOUNT': '2.960', 'weapon3': '3.322', 'DAMAGECOUNT': '13.809', 'FRAGCOUNT': '50.000'} [2023-02-25 13:41:02,977][36157] DAMAGECOUNT value on done: 402612.0 [2023-02-25 13:41:02,978][36157] Sum rewards: 52.454, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.065', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.050', 'weapon5': '0.102', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.388', 'WEAPON3': '1.450', 'HITCOUNT': '3.120', 'weapon3': '3.248', 'DAMAGECOUNT': '14.655', 'FRAGCOUNT': '46.000'} [2023-02-25 13:41:03,302][36157] DAMAGECOUNT value on done: 397658.0 [2023-02-25 13:41:03,303][36157] Sum rewards: 44.220, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.773', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.104', 'AMMO4': '0.135', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.280', 'weapon2': '0.512', 'WEAPON3': '1.200', 'HITCOUNT': '2.510', 'weapon3': '2.842', 'DAMAGECOUNT': '13.467', 'FRAGCOUNT': '37.000'} [2023-02-25 13:41:03,756][36138] Updated weights for policy 0, policy_version 42403 (0.0009) [2023-02-25 13:41:03,793][36157] DAMAGECOUNT value on done: 397970.0 [2023-02-25 13:41:03,793][36157] Sum rewards: 50.658, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.246', 'ARMOR': '0.005', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO3': '0.132', 'AMMO4': '0.132', 'weapon5': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.594', 'weapon2': '0.644', 'WEAPON3': '0.800', 'weapon3': '2.304', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.222', 'FRAGCOUNT': '42.000'} [2023-02-25 13:41:04,082][36140] DAMAGECOUNT value on done: 401480.0 [2023-02-25 13:41:04,083][36140] Sum rewards: 53.013, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.630', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.038', 'AMMO3': '0.143', 'weapon5': '0.150', 'AMMO4': '0.188', 'weapon2': '0.242', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.704', 'WEAPON3': '0.950', 'weapon3': '2.588', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.952', 'FRAGCOUNT': '45.000'} [2023-02-25 13:41:04,097][36157] DAMAGECOUNT value on done: 401040.0 [2023-02-25 13:41:04,098][36157] Sum rewards: 38.481, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.050', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.122', 'AMMO3': '0.129', 'AMMO4': '0.220', 'WEAPON5': '0.250', 'weapon2': '0.452', 'WEAPON4': '0.550', 'WEAPON3': '0.750', 'weapon4': '1.108', 'weapon3': '2.128', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '9.900', 'FRAGCOUNT': '34.000'} [2023-02-25 13:41:04,391][36140] DAMAGECOUNT value on done: 390383.0 [2023-02-25 13:41:04,391][36140] Sum rewards: 59.200, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.142', 'AMMO2': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.051', 'weapon5': '0.086', 'WEAPON4': '0.100', 'weapon2': '0.124', 'weapon4': '0.198', 'AMMO3': '0.227', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.930', 'weapon3': '3.402', 'DAMAGECOUNT': '14.049', 'FRAGCOUNT': '51.000'} [2023-02-25 13:41:04,699][36140] DAMAGECOUNT value on done: 393708.0 [2023-02-25 13:41:04,699][36140] Sum rewards: 46.445, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.236', 'ARMOR': '0.005', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.130', 'AMMO3': '0.131', 'WEAPON5': '0.200', 'AMMO4': '0.217', 'WEAPON4': '0.350', 'weapon2': '0.436', 'WEAPON3': '0.700', 'weapon4': '0.858', 'weapon3': '2.402', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '10.941', 'FRAGCOUNT': '39.000'} [2023-02-25 13:41:04,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13440.4). Total num frames: 173694976. Throughput: 0: 3354.5. Samples: 5921278. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:41:04,729][36114] Avg episode reward: [(0, '51.450')] [2023-02-25 13:41:04,822][36156] DAMAGECOUNT value on done: 400403.0 [2023-02-25 13:41:04,823][36156] Sum rewards: 59.724, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.244', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.067', 'weapon5': '0.120', 'weapon2': '0.124', 'AMMO3': '0.150', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.800', 'weapon4': '1.172', 'weapon3': '2.322', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.082', 'FRAGCOUNT': '48.000'} [2023-02-25 13:41:05,005][36140] DAMAGECOUNT value on done: 390595.0 [2023-02-25 13:41:05,006][36140] Sum rewards: 47.518, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.937', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.045', 'AMMO3': '0.197', 'weapon2': '0.200', 'weapon5': '0.214', 'AMMO4': '0.227', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.584', 'WEAPON3': '1.200', 'weapon3': '2.726', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.092', 'FRAGCOUNT': '44.000'} [2023-02-25 13:41:05,030][36156] DAMAGECOUNT value on done: 402723.0 [2023-02-25 13:41:05,030][36156] Sum rewards: 60.866, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.630', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.126', 'AMMO4': '0.160', 'weapon2': '0.166', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.336', 'WEAPON3': '1.150', 'weapon3': '3.164', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '51.000'} [2023-02-25 13:41:05,148][36156] DAMAGECOUNT value on done: 393091.0 [2023-02-25 13:41:05,148][36156] Sum rewards: 48.735, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.616', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.005', 'weapon5': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.594', 'WEAPON3': '1.250', 'HITCOUNT': '2.820', 'weapon3': '3.008', 'DAMAGECOUNT': '13.047', 'FRAGCOUNT': '42.000'} [2023-02-25 13:41:05,207][36142] DAMAGECOUNT value on done: 389454.0 [2023-02-25 13:41:05,207][36142] Sum rewards: 54.811, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.067', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'weapon4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'weapon2': '0.624', 'WEAPON3': '1.100', 'weapon3': '2.992', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.986', 'FRAGCOUNT': '47.000'} [2023-02-25 13:41:05,343][36156] DAMAGECOUNT value on done: 398432.0 [2023-02-25 13:41:05,343][36156] Sum rewards: 52.609, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.395', 'AMMO5': '0.007', 'AMMO2': '0.007', 'weapon5': '0.018', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'weapon4': '0.154', 'AMMO3': '0.265', 'weapon2': '0.308', 'WEAPON3': '1.450', 'HITCOUNT': '3.270', 'weapon3': '3.312', 'DAMAGECOUNT': '13.977', 'FRAGCOUNT': '46.000'} [2023-02-25 13:41:05,500][36142] DAMAGECOUNT value on done: 386191.0 [2023-02-25 13:41:05,501][36142] Sum rewards: 51.843, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.040', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.056', 'AMMO4': '0.123', 'AMMO3': '0.162', 'WEAPON5': '0.200', 'weapon4': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.410', 'WEAPON3': '1.000', 'HITCOUNT': '2.970', 'weapon3': '3.064', 'DAMAGECOUNT': '13.872', 'FRAGCOUNT': '43.000'} [2023-02-25 13:41:05,509][36142] DAMAGECOUNT value on done: 390644.0 [2023-02-25 13:41:05,510][36142] Sum rewards: 45.366, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.283', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'weapon2': '0.518', 'weapon4': '0.560', 'WEAPON3': '1.150', 'weapon3': '2.546', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.426', 'FRAGCOUNT': '40.000'} [2023-02-25 13:41:05,800][36142] DAMAGECOUNT value on done: 398423.0 [2023-02-25 13:41:05,800][36142] Sum rewards: 50.738, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.455', 'ARMOR': '0.004', 'AMMO5': '0.030', 'AMMO2': '0.079', 'AMMO3': '0.149', 'weapon5': '0.204', 'AMMO4': '0.395', 'weapon2': '0.552', 'WEAPON5': '0.700', 'WEAPON4': '0.850', 'weapon4': '0.870', 'WEAPON3': '0.900', 'weapon3': '2.072', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '13.887', 'FRAGCOUNT': '45.000'} [2023-02-25 13:41:06,773][36138] Updated weights for policy 0, policy_version 42413 (0.0010) [2023-02-25 13:41:09,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 173760512. Throughput: 0: 3356.8. Samples: 5931420. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 13:41:09,730][36114] Avg episode reward: [(0, '51.590')] [2023-02-25 13:41:09,866][36138] Updated weights for policy 0, policy_version 42423 (0.0009) [2023-02-25 13:41:12,935][36138] Updated weights for policy 0, policy_version 42433 (0.0009) [2023-02-25 13:41:14,548][36155] DAMAGECOUNT value on done: 391696.0 [2023-02-25 13:41:14,549][36155] Sum rewards: 29.697, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.376', 'ARMOR': '0.004', 'AMMO5': '0.029', 'AMMO2': '0.074', 'AMMO3': '0.135', 'weapon5': '0.352', 'AMMO4': '0.368', 'WEAPON5': '0.650', 'weapon2': '0.718', 'WEAPON3': '0.750', 'WEAPON4': '0.750', 'weapon4': '0.838', 'weapon3': '1.688', 'HITCOUNT': '2.000', 'DAMAGECOUNT': '9.717', 'FRAGCOUNT': '28.000'} [2023-02-25 13:41:14,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13426.5). Total num frames: 173826048. Throughput: 0: 3346.4. Samples: 5951310. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 13:41:14,730][36114] Avg episode reward: [(0, '51.335')] [2023-02-25 13:41:14,829][36139] DAMAGECOUNT value on done: 402850.0 [2023-02-25 13:41:14,830][36139] Sum rewards: 41.677, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.934', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.210', 'AMMO3': '0.238', 'weapon2': '0.278', 'weapon4': '0.330', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.450', 'weapon3': '2.920', 'DAMAGECOUNT': '12.681', 'FRAGCOUNT': '39.000'} [2023-02-25 13:41:14,869][36155] DAMAGECOUNT value on done: 403749.0 [2023-02-25 13:41:14,869][36155] Sum rewards: 43.581, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.482', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.010', 'weapon5': '0.026', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.210', 'AMMO3': '0.271', 'weapon2': '0.450', 'WEAPON3': '1.600', 'HITCOUNT': '2.710', 'weapon3': '3.102', 'DAMAGECOUNT': '11.280', 'FRAGCOUNT': '42.000'} [2023-02-25 13:41:15,132][36139] DAMAGECOUNT value on done: 398865.0 [2023-02-25 13:41:15,132][36139] Sum rewards: 55.135, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.194', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.051', 'AMMO3': '0.159', 'weapon5': '0.198', 'weapon2': '0.230', 'AMMO4': '0.253', 'WEAPON5': '0.400', 'weapon4': '0.410', 'WEAPON4': '0.600', 'WEAPON3': '1.000', 'HITCOUNT': '2.760', 'weapon3': '2.882', 'DAMAGECOUNT': '13.857', 'FRAGCOUNT': '48.000'} [2023-02-25 13:41:15,473][36155] DAMAGECOUNT value on done: 399264.0 [2023-02-25 13:41:15,474][36155] Sum rewards: 45.702, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.460', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'weapon4': '0.188', 'WEAPON4': '0.200', 'weapon2': '0.230', 'AMMO3': '0.271', 'WEAPON3': '1.550', 'HITCOUNT': '2.810', 'weapon3': '3.242', 'DAMAGECOUNT': '13.263', 'FRAGCOUNT': '44.000'} [2023-02-25 13:41:15,655][36139] DAMAGECOUNT value on done: 398229.0 [2023-02-25 13:41:15,656][36139] Sum rewards: 65.862, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.105', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO3': '0.266', 'weapon2': '0.298', 'WEAPON3': '1.700', 'weapon3': '3.454', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.674', 'FRAGCOUNT': '58.000'} [2023-02-25 13:41:15,776][36155] DAMAGECOUNT value on done: 396457.0 [2023-02-25 13:41:15,777][36155] Sum rewards: 44.430, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.530', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO2': '0.043', 'weapon5': '0.062', 'AMMO3': '0.162', 'AMMO4': '0.215', 'weapon4': '0.462', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.894', 'WEAPON3': '1.050', 'weapon3': '2.198', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '11.565', 'FRAGCOUNT': '41.000'} [2023-02-25 13:41:15,971][36139] DAMAGECOUNT value on done: 398712.0 [2023-02-25 13:41:15,971][36139] Sum rewards: 47.727, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.090', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.092', 'AMMO4': '0.106', 'weapon4': '0.140', 'weapon2': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'WEAPON3': '1.400', 'HITCOUNT': '2.770', 'weapon3': '3.366', 'DAMAGECOUNT': '14.346', 'FRAGCOUNT': '41.000'} [2023-02-25 13:41:15,975][36138] Updated weights for policy 0, policy_version 42443 (0.0009) [2023-02-25 13:41:19,088][36138] Updated weights for policy 0, policy_version 42453 (0.0009) [2023-02-25 13:41:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 173895680. Throughput: 0: 3339.1. Samples: 5971370. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 13:41:19,729][36114] Avg episode reward: [(0, '51.390')] [2023-02-25 13:41:19,733][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000042455_173895680.pth... [2023-02-25 13:41:19,788][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000041667_170668032.pth [2023-02-25 13:41:21,095][36154] DAMAGECOUNT value on done: 400400.0 [2023-02-25 13:41:21,095][36154] Sum rewards: 45.970, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.488', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.181', 'WEAPON4': '0.300', 'weapon2': '0.462', 'weapon4': '0.556', 'WEAPON3': '1.100', 'weapon3': '2.688', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '13.053', 'FRAGCOUNT': '39.000'} [2023-02-25 13:41:21,416][36154] DAMAGECOUNT value on done: 394640.0 [2023-02-25 13:41:21,417][36154] Sum rewards: 51.797, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.144', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.042', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'AMMO4': '0.209', 'WEAPON4': '0.300', 'weapon4': '0.500', 'weapon2': '0.722', 'WEAPON3': '1.050', 'weapon3': '2.448', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.803', 'FRAGCOUNT': '42.000'} [2023-02-25 13:41:21,703][36154] DAMAGECOUNT value on done: 397456.0 [2023-02-25 13:41:21,704][36154] Sum rewards: 67.732, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.062', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.190', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon2': '0.238', 'WEAPON5': '0.250', 'weapon4': '0.280', 'WEAPON3': '1.250', 'weapon3': '3.020', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.692', 'FRAGCOUNT': '56.000'} [2023-02-25 13:41:22,015][36154] DAMAGECOUNT value on done: 399800.0 [2023-02-25 13:41:22,016][36154] Sum rewards: 67.181, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.943', 'AMMO2': '0.011', 'AMMO4': '0.056', 'AMMO3': '0.249', 'weapon2': '0.306', 'WEAPON3': '1.450', 'HITCOUNT': '3.510', 'weapon3': '3.514', 'DAMAGECOUNT': '16.278', 'FRAGCOUNT': '57.000'} [2023-02-25 13:41:22,091][36141] DAMAGECOUNT value on done: 407041.0 [2023-02-25 13:41:22,092][36141] Sum rewards: 52.983, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.850', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.047', 'AMMO3': '0.221', 'AMMO4': '0.236', 'weapon5': '0.276', 'weapon4': '0.300', 'weapon2': '0.330', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.734', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.672', 'FRAGCOUNT': '47.000'} [2023-02-25 13:41:22,199][36138] Updated weights for policy 0, policy_version 42463 (0.0009) [2023-02-25 13:41:22,404][36141] DAMAGECOUNT value on done: 402951.0 [2023-02-25 13:41:22,405][36141] Sum rewards: 64.513, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.815', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.044', 'weapon5': '0.122', 'AMMO3': '0.218', 'AMMO4': '0.218', 'weapon4': '0.240', 'weapon2': '0.244', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.098', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.864', 'FRAGCOUNT': '58.000'} [2023-02-25 13:41:22,417][36141] DAMAGECOUNT value on done: 394045.0 [2023-02-25 13:41:22,418][36141] Sum rewards: 51.175, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.093', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO3': '0.135', 'AMMO4': '0.148', 'weapon5': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.502', 'weapon2': '0.622', 'WEAPON3': '0.900', 'weapon3': '2.456', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '14.304', 'FRAGCOUNT': '41.000'} [2023-02-25 13:41:22,722][36141] DAMAGECOUNT value on done: 386948.0 [2023-02-25 13:41:22,722][36141] Sum rewards: 55.376, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.940', 'AMMO5': '0.009', 'AMMO2': '0.027', 'AMMO4': '0.137', 'weapon5': '0.142', 'weapon4': '0.188', 'weapon2': '0.202', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '3.180', 'weapon3': '3.208', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '51.000'} [2023-02-25 13:41:23,016][36157] DAMAGECOUNT value on done: 407440.0 [2023-02-25 13:41:23,016][36157] Sum rewards: 59.618, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.376', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.031', 'AMMO3': '0.134', 'AMMO4': '0.153', 'weapon5': '0.158', 'weapon2': '0.202', 'weapon4': '0.316', 'WEAPON4': '0.400', 'WEAPON5': '0.600', 'WEAPON3': '1.000', 'HITCOUNT': '2.880', 'weapon3': '3.108', 'DAMAGECOUNT': '14.484', 'FRAGCOUNT': '50.000'} [2023-02-25 13:41:23,330][36157] DAMAGECOUNT value on done: 401950.0 [2023-02-25 13:41:23,331][36157] Sum rewards: 46.294, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.572', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'weapon5': '0.114', 'AMMO4': '0.145', 'weapon4': '0.180', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.518', 'WEAPON3': '1.400', 'HITCOUNT': '2.660', 'weapon3': '2.928', 'DAMAGECOUNT': '12.876', 'FRAGCOUNT': '43.000'} [2023-02-25 13:41:23,823][36157] DAMAGECOUNT value on done: 401991.0 [2023-02-25 13:41:23,824][36157] Sum rewards: 44.261, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.742', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon2': '0.418', 'weapon4': '0.510', 'WEAPON3': '1.000', 'weapon3': '2.588', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '12.063', 'FRAGCOUNT': '36.500'} [2023-02-25 13:41:24,137][36157] DAMAGECOUNT value on done: 405225.0 [2023-02-25 13:41:24,137][36157] Sum rewards: 46.536, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.899', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.188', 'weapon5': '0.218', 'weapon2': '0.436', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.548', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.555', 'FRAGCOUNT': '42.000'} [2023-02-25 13:41:24,323][36140] DAMAGECOUNT value on done: 405679.0 [2023-02-25 13:41:24,323][36140] Sum rewards: 44.872, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.459', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.170', 'AMMO4': '0.175', 'AMMO3': '0.182', 'weapon2': '0.184', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.842', 'WEAPON3': '1.100', 'HITCOUNT': '2.560', 'weapon3': '2.570', 'DAMAGECOUNT': '12.597', 'FRAGCOUNT': '39.000'} [2023-02-25 13:41:24,643][36140] DAMAGECOUNT value on done: 395826.0 [2023-02-25 13:41:24,644][36140] Sum rewards: 59.919, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.322', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.034', 'AMMO3': '0.164', 'AMMO4': '0.172', 'weapon5': '0.224', 'weapon4': '0.322', 'WEAPON5': '0.400', 'weapon2': '0.430', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.712', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.329', 'FRAGCOUNT': '51.000'} [2023-02-25 13:41:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13426.5). Total num frames: 173961216. Throughput: 0: 3335.7. Samples: 5981324. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 13:41:24,730][36114] Avg episode reward: [(0, '51.343')] [2023-02-25 13:41:24,976][36140] DAMAGECOUNT value on done: 398172.0 [2023-02-25 13:41:24,977][36140] Sum rewards: 45.251, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.347', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon5': '0.198', 'AMMO3': '0.232', 'AMMO4': '0.260', 'weapon4': '0.422', 'WEAPON4': '0.450', 'weapon2': '0.472', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.554', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '13.392', 'FRAGCOUNT': '42.000'} [2023-02-25 13:41:25,000][36156] DAMAGECOUNT value on done: 405087.0 [2023-02-25 13:41:25,000][36156] Sum rewards: 59.520, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.175', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO3': '0.140', 'AMMO4': '0.140', 'WEAPON4': '0.200', 'weapon2': '0.420', 'weapon4': '0.428', 'WEAPON3': '0.800', 'weapon3': '2.844', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.052', 'FRAGCOUNT': '47.000'} [2023-02-25 13:41:25,183][36156] DAMAGECOUNT value on done: 407155.0 [2023-02-25 13:41:25,183][36156] Sum rewards: 48.545, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.050', 'AMMO2': '0.015', 'AMMO4': '0.073', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon4': '0.268', 'weapon2': '0.508', 'WEAPON3': '1.300', 'HITCOUNT': '2.930', 'weapon3': '3.046', 'DAMAGECOUNT': '13.296', 'FRAGCOUNT': '43.000'} [2023-02-25 13:41:25,261][36138] Updated weights for policy 0, policy_version 42473 (0.0009) [2023-02-25 13:41:25,277][36140] DAMAGECOUNT value on done: 394430.0 [2023-02-25 13:41:25,277][36140] Sum rewards: 37.271, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.296', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon2': '0.198', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'weapon4': '0.260', 'weapon5': '0.278', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '2.300', 'weapon3': '2.900', 'DAMAGECOUNT': '11.505', 'FRAGCOUNT': '34.000'} [2023-02-25 13:41:25,282][36142] DAMAGECOUNT value on done: 394843.0 [2023-02-25 13:41:25,282][36142] Sum rewards: 52.906, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.524', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.176', 'AMMO4': '0.184', 'weapon4': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.264', 'WEAPON4': '0.350', 'weapon2': '0.468', 'WEAPON3': '1.600', 'weapon3': '2.908', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '48.500'} [2023-02-25 13:41:25,311][36156] DAMAGECOUNT value on done: 398473.0 [2023-02-25 13:41:25,312][36156] Sum rewards: 57.102, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.726', 'AMMO5': '0.024', 'AMMO2': '0.042', 'AMMO3': '0.159', 'AMMO4': '0.212', 'weapon2': '0.238', 'weapon5': '0.364', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'weapon4': '0.826', 'WEAPON3': '1.100', 'weapon3': '2.246', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.146', 'FRAGCOUNT': '49.000'} [2023-02-25 13:41:25,506][36156] DAMAGECOUNT value on done: 401475.0 [2023-02-25 13:41:25,507][36156] Sum rewards: 31.348, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.452', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.044', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.174', 'AMMO4': '0.220', 'WEAPON4': '0.500', 'weapon2': '0.536', 'WEAPON3': '0.950', 'weapon4': '1.112', 'weapon3': '2.004', 'HITCOUNT': '2.070', 'DAMAGECOUNT': '9.129', 'FRAGCOUNT': '31.000'} [2023-02-25 13:41:25,610][36142] DAMAGECOUNT value on done: 391182.0 [2023-02-25 13:41:25,610][36142] Sum rewards: 55.472, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.173', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.116', 'AMMO4': '0.164', 'AMMO3': '0.201', 'weapon2': '0.246', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.382', 'WEAPON3': '1.250', 'HITCOUNT': '3.010', 'weapon3': '3.024', 'DAMAGECOUNT': '14.853', 'FRAGCOUNT': '48.000'} [2023-02-25 13:41:25,619][36142] DAMAGECOUNT value on done: 395005.0 [2023-02-25 13:41:25,619][36142] Sum rewards: 56.252, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.400', 'AMMO5': '0.010', 'weapon5': '0.018', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.158', 'WEAPON5': '0.200', 'weapon4': '0.252', 'WEAPON4': '0.300', 'weapon2': '0.792', 'WEAPON3': '1.050', 'weapon3': '2.794', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.083', 'FRAGCOUNT': '48.000'} [2023-02-25 13:41:25,923][36142] DAMAGECOUNT value on done: 403019.0 [2023-02-25 13:41:25,923][36142] Sum rewards: 55.638, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.917', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.064', 'AMMO3': '0.156', 'weapon5': '0.198', 'weapon2': '0.298', 'AMMO4': '0.318', 'weapon4': '0.388', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.898', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.788', 'FRAGCOUNT': '48.000'} [2023-02-25 13:41:28,219][36138] Updated weights for policy 0, policy_version 42483 (0.0010) [2023-02-25 13:41:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 174030848. Throughput: 0: 3335.5. Samples: 6001546. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 13:41:29,730][36114] Avg episode reward: [(0, '51.365')] [2023-02-25 13:41:31,224][36138] Updated weights for policy 0, policy_version 42493 (0.0009) [2023-02-25 13:41:34,233][36138] Updated weights for policy 0, policy_version 42503 (0.0010) [2023-02-25 13:41:34,560][36155] DAMAGECOUNT value on done: 395895.0 [2023-02-25 13:41:34,560][36155] Sum rewards: 43.707, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.820', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.106', 'AMMO3': '0.178', 'AMMO4': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.328', 'weapon2': '0.378', 'WEAPON3': '1.200', 'HITCOUNT': '2.680', 'weapon3': '3.012', 'DAMAGECOUNT': '12.597', 'FRAGCOUNT': '38.000'} [2023-02-25 13:41:34,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.2, 300 sec: 13440.4). Total num frames: 174096384. Throughput: 0: 3345.6. Samples: 6021914. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 13:41:34,730][36114] Avg episode reward: [(0, '51.207')] [2023-02-25 13:41:34,849][36155] DAMAGECOUNT value on done: 408637.0 [2023-02-25 13:41:34,849][36155] Sum rewards: 55.839, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.940', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon2': '0.136', 'AMMO4': '0.140', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.656', 'WEAPON3': '1.150', 'weapon3': '2.794', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.664', 'FRAGCOUNT': '47.000'} [2023-02-25 13:41:34,870][36139] DAMAGECOUNT value on done: 407714.0 [2023-02-25 13:41:34,870][36139] Sum rewards: 59.593, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.194', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon4': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.658', 'WEAPON3': '1.150', 'weapon3': '2.860', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.292', 'FRAGCOUNT': '50.500'} [2023-02-25 13:41:35,168][36156] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0)] [2023-02-25 13:41:35,185][36139] DAMAGECOUNT value on done: 403350.0 [2023-02-25 13:41:35,186][36139] Sum rewards: 52.257, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.934', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.034', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.203', 'weapon2': '0.340', 'weapon4': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '2.950', 'weapon3': '3.112', 'DAMAGECOUNT': '13.455', 'FRAGCOUNT': '44.000'} [2023-02-25 13:41:35,457][36155] DAMAGECOUNT value on done: 403990.0 [2023-02-25 13:41:35,458][36155] Sum rewards: 55.695, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.775', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.046', 'AMMO4': '0.050', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.176', 'AMMO3': '0.184', 'weapon2': '0.204', 'WEAPON3': '1.100', 'HITCOUNT': '2.950', 'weapon3': '3.420', 'DAMAGECOUNT': '14.178', 'FRAGCOUNT': '46.000'} [2023-02-25 13:41:35,698][36139] DAMAGECOUNT value on done: 402865.0 [2023-02-25 13:41:35,699][36139] Sum rewards: 53.069, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.362', 'AMMO5': '0.014', 'AMMO2': '0.036', 'AMMO4': '0.178', 'weapon5': '0.192', 'AMMO3': '0.219', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.530', 'weapon2': '0.546', 'WEAPON3': '1.300', 'weapon3': '2.468', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.908', 'FRAGCOUNT': '47.500'} [2023-02-25 13:41:35,754][36155] DAMAGECOUNT value on done: 400357.0 [2023-02-25 13:41:35,755][36155] Sum rewards: 43.898, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.590', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.042', 'weapon4': '0.074', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon2': '0.762', 'WEAPON3': '1.250', 'HITCOUNT': '2.640', 'weapon3': '2.882', 'DAMAGECOUNT': '11.700', 'FRAGCOUNT': '39.000'} [2023-02-25 13:41:36,013][36139] DAMAGECOUNT value on done: 403357.0 [2023-02-25 13:41:36,014][36139] Sum rewards: 52.449, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.892', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.148', 'AMMO4': '0.148', 'weapon4': '0.194', 'weapon2': '0.208', 'AMMO3': '0.209', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.970', 'weapon3': '3.086', 'DAMAGECOUNT': '13.935', 'FRAGCOUNT': '47.000'} [2023-02-25 13:41:37,310][36138] Updated weights for policy 0, policy_version 42513 (0.0009) [2023-02-25 13:41:39,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13426.6). Total num frames: 174161920. Throughput: 0: 3345.4. Samples: 6031932. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 13:41:39,729][36114] Avg episode reward: [(0, '51.347')] [2023-02-25 13:41:40,364][36138] Updated weights for policy 0, policy_version 42523 (0.0009) [2023-02-25 13:41:41,025][36154] DAMAGECOUNT value on done: 405543.0 [2023-02-25 13:41:41,026][36154] Sum rewards: 58.308, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.152', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'AMMO4': '0.208', 'WEAPON4': '0.350', 'weapon2': '0.360', 'weapon4': '0.686', 'WEAPON3': '1.000', 'weapon3': '2.636', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.429', 'FRAGCOUNT': '50.000'} [2023-02-25 13:41:41,338][36154] DAMAGECOUNT value on done: 398757.0 [2023-02-25 13:41:41,338][36154] Sum rewards: 39.861, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.348', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.023', 'AMMO4': '0.117', 'AMMO3': '0.119', 'weapon2': '0.250', 'weapon5': '0.372', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.544', 'WEAPON3': '0.800', 'HITCOUNT': '2.470', 'weapon3': '2.590', 'DAMAGECOUNT': '12.351', 'FRAGCOUNT': '32.000'} [2023-02-25 13:41:41,601][36154] DAMAGECOUNT value on done: 401709.0 [2023-02-25 13:41:41,601][36154] Sum rewards: 52.694, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.092', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon5': '0.054', 'AMMO4': '0.081', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.468', 'weapon2': '0.674', 'WEAPON3': '1.050', 'weapon3': '2.596', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.759', 'FRAGCOUNT': '46.000'} [2023-02-25 13:41:41,913][36154] DAMAGECOUNT value on done: 403834.0 [2023-02-25 13:41:41,914][36154] Sum rewards: 45.270, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.900', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.058', 'weapon5': '0.160', 'AMMO3': '0.202', 'weapon2': '0.246', 'AMMO4': '0.288', 'weapon4': '0.482', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.250', 'HITCOUNT': '2.610', 'weapon3': '2.794', 'DAMAGECOUNT': '12.102', 'FRAGCOUNT': '44.000'} [2023-02-25 13:41:42,139][36141] DAMAGECOUNT value on done: 411817.0 [2023-02-25 13:41:42,140][36141] Sum rewards: 61.747, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.542', 'ARMOR': '0.005', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon5': '0.016', 'weapon4': '0.016', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon2': '0.446', 'WEAPON3': '1.100', 'HITCOUNT': '3.010', 'weapon3': '3.384', 'DAMAGECOUNT': '14.328', 'FRAGCOUNT': '51.000'} [2023-02-25 13:41:42,439][36141] DAMAGECOUNT value on done: 406514.0 [2023-02-25 13:41:42,439][36141] Sum rewards: 40.474, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.377', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.045', 'AMMO3': '0.192', 'AMMO4': '0.225', 'weapon5': '0.364', 'weapon2': '0.440', 'WEAPON5': '0.600', 'weapon4': '0.620', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.218', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '10.689', 'FRAGCOUNT': '39.000'} [2023-02-25 13:41:42,451][36141] DAMAGECOUNT value on done: 399728.0 [2023-02-25 13:41:42,452][36141] Sum rewards: 62.196, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.079', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.092', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'weapon4': '0.110', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'weapon2': '0.420', 'WEAPON3': '1.400', 'weapon3': '3.122', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '54.000'} [2023-02-25 13:41:42,745][36141] DAMAGECOUNT value on done: 392575.0 [2023-02-25 13:41:42,746][36141] Sum rewards: 68.143, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.077', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO3': '0.158', 'weapon4': '0.348', 'weapon2': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.018', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '55.000'} [2023-02-25 13:41:43,011][36157] DAMAGECOUNT value on done: 412176.0 [2023-02-25 13:41:43,012][36157] Sum rewards: 48.748, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.312', 'AMMO5': '0.012', 'AMMO2': '0.047', 'AMMO3': '0.144', 'AMMO4': '0.233', 'weapon5': '0.296', 'WEAPON5': '0.400', 'weapon4': '0.404', 'weapon2': '0.434', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'HITCOUNT': '2.590', 'weapon3': '2.592', 'DAMAGECOUNT': '14.208', 'FRAGCOUNT': '42.000'} [2023-02-25 13:41:43,308][36157] DAMAGECOUNT value on done: 406297.0 [2023-02-25 13:41:43,308][36157] Sum rewards: 43.152, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.058', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.047', 'AMMO3': '0.197', 'AMMO4': '0.237', 'weapon5': '0.318', 'weapon4': '0.398', 'WEAPON5': '0.400', 'weapon2': '0.486', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.470', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '13.041', 'FRAGCOUNT': '39.000'} [2023-02-25 13:41:43,408][36138] Updated weights for policy 0, policy_version 42533 (0.0009) [2023-02-25 13:41:43,795][36157] DAMAGECOUNT value on done: 406553.0 [2023-02-25 13:41:43,795][36157] Sum rewards: 58.485, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.691', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.051', 'AMMO3': '0.146', 'weapon5': '0.218', 'AMMO4': '0.256', 'weapon2': '0.300', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.738', 'WEAPON3': '0.900', 'weapon3': '2.442', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.686', 'FRAGCOUNT': '49.000'} [2023-02-25 13:41:44,061][36140] DAMAGECOUNT value on done: 410574.0 [2023-02-25 13:41:44,061][36140] Sum rewards: 57.776, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.828', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'weapon2': '0.252', 'AMMO3': '0.261', 'weapon4': '0.298', 'WEAPON3': '1.600', 'HITCOUNT': '3.060', 'weapon3': '3.170', 'DAMAGECOUNT': '14.685', 'FRAGCOUNT': '52.000'} [2023-02-25 13:41:44,111][36157] DAMAGECOUNT value on done: 408851.0 [2023-02-25 13:41:44,112][36157] Sum rewards: 42.866, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.324', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.156', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.336', 'weapon2': '0.438', 'WEAPON3': '1.050', 'HITCOUNT': '2.070', 'weapon3': '2.846', 'DAMAGECOUNT': '10.857', 'FRAGCOUNT': '37.000'} [2023-02-25 13:41:44,362][36140] DAMAGECOUNT value on done: 400440.0 [2023-02-25 13:41:44,363][36140] Sum rewards: 52.913, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.368', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.118', 'AMMO3': '0.198', 'weapon4': '0.310', 'weapon2': '0.658', 'WEAPON3': '1.300', 'weapon3': '2.714', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.842', 'FRAGCOUNT': '45.000'} [2023-02-25 13:41:44,661][36140] DAMAGECOUNT value on done: 402769.0 [2023-02-25 13:41:44,661][36140] Sum rewards: 57.987, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.255', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon4': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.031', 'weapon5': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.148', 'WEAPON5': '0.200', 'weapon2': '0.798', 'WEAPON3': '0.950', 'weapon3': '2.908', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.791', 'FRAGCOUNT': '47.000'} [2023-02-25 13:41:44,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13440.4). Total num frames: 174231552. Throughput: 0: 3352.4. Samples: 6052172. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 13:41:44,730][36114] Avg episode reward: [(0, '51.237')] [2023-02-25 13:41:44,915][36156] DAMAGECOUNT value on done: 410136.0 [2023-02-25 13:41:44,915][36156] Sum rewards: 54.751, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.458', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.042', 'AMMO3': '0.148', 'AMMO4': '0.212', 'weapon5': '0.224', 'WEAPON5': '0.450', 'weapon4': '0.478', 'WEAPON4': '0.550', 'weapon2': '0.588', 'WEAPON3': '0.950', 'weapon3': '2.440', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.147', 'FRAGCOUNT': '45.000'} [2023-02-25 13:41:44,958][36140] DAMAGECOUNT value on done: 398024.0 [2023-02-25 13:41:44,958][36140] Sum rewards: 41.660, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.102', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.144', 'AMMO3': '0.187', 'AMMO4': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.542', 'weapon4': '0.726', 'WEAPON3': '1.150', 'weapon3': '1.908', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '10.782', 'FRAGCOUNT': '37.000'} [2023-02-25 13:41:45,110][36156] DAMAGECOUNT value on done: 412011.0 [2023-02-25 13:41:45,110][36156] Sum rewards: 57.279, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.877', 'AMMO5': '0.014', 'AMMO2': '0.045', 'AMMO3': '0.170', 'weapon5': '0.208', 'AMMO4': '0.226', 'weapon4': '0.318', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.502', 'WEAPON3': '1.100', 'weapon3': '2.674', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.568', 'FRAGCOUNT': '50.000'} [2023-02-25 13:41:45,156][36142] DAMAGECOUNT value on done: 399639.0 [2023-02-25 13:41:45,157][36142] Sum rewards: 55.641, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.100', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'weapon5': '0.130', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon2': '0.386', 'weapon4': '0.388', 'WEAPON3': '1.200', 'weapon3': '2.732', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.388', 'FRAGCOUNT': '48.000'} [2023-02-25 13:41:45,236][36156] DAMAGECOUNT value on done: 403449.0 [2023-02-25 13:41:45,236][36156] Sum rewards: 55.987, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.808', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.104', 'weapon5': '0.120', 'AMMO4': '0.165', 'AMMO3': '0.177', 'weapon2': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.960', 'weapon3': '3.358', 'DAMAGECOUNT': '14.928', 'FRAGCOUNT': '47.500'} [2023-02-25 13:41:45,423][36156] DAMAGECOUNT value on done: 406441.0 [2023-02-25 13:41:45,424][36156] Sum rewards: 58.556, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.670', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon4': '0.060', 'WEAPON4': '0.150', 'weapon5': '0.158', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.550', 'HITCOUNT': '3.020', 'weapon3': '3.288', 'DAMAGECOUNT': '14.898', 'FRAGCOUNT': '51.000'} [2023-02-25 13:41:45,451][36142] DAMAGECOUNT value on done: 396088.0 [2023-02-25 13:41:45,451][36142] Sum rewards: 56.366, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.616', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.102', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'weapon2': '0.312', 'weapon4': '0.352', 'WEAPON3': '1.350', 'weapon3': '3.008', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.718', 'FRAGCOUNT': '49.000'} [2023-02-25 13:41:45,460][36142] DAMAGECOUNT value on done: 399283.0 [2023-02-25 13:41:45,461][36142] Sum rewards: 47.174, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.253', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.032', 'weapon5': '0.060', 'AMMO4': '0.145', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.464', 'WEAPON3': '1.250', 'HITCOUNT': '2.640', 'weapon3': '3.274', 'DAMAGECOUNT': '12.834', 'FRAGCOUNT': '42.500'} [2023-02-25 13:41:45,741][36142] DAMAGECOUNT value on done: 407431.0 [2023-02-25 13:41:45,742][36142] Sum rewards: 51.797, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.926', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'weapon5': '0.110', 'AMMO4': '0.157', 'AMMO3': '0.193', 'WEAPON5': '0.250', 'weapon4': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.520', 'WEAPON3': '1.150', 'HITCOUNT': '2.670', 'weapon3': '2.914', 'DAMAGECOUNT': '12.660', 'FRAGCOUNT': '46.000'} [2023-02-25 13:41:46,468][36138] Updated weights for policy 0, policy_version 42543 (0.0009) [2023-02-25 13:41:46,535][36155] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 13:41:48,702][36141] Large shaping reward 2.527 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.507, 169.0)] [2023-02-25 13:41:49,490][36138] Updated weights for policy 0, policy_version 42553 (0.0009) [2023-02-25 13:41:49,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13440.4). Total num frames: 174297088. Throughput: 0: 3360.1. Samples: 6072482. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 13:41:49,730][36114] Avg episode reward: [(0, '51.695')] [2023-02-25 13:41:52,530][36138] Updated weights for policy 0, policy_version 42563 (0.0009) [2023-02-25 13:41:54,411][36155] DAMAGECOUNT value on done: 400833.0 [2023-02-25 13:41:54,412][36155] Sum rewards: 54.304, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.007', 'AMMO2': '0.024', 'HEALTH': '0.040', 'AMMO4': '0.118', 'weapon5': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'weapon4': '0.406', 'weapon2': '0.530', 'WEAPON3': '1.000', 'weapon3': '2.708', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.814', 'FRAGCOUNT': '46.000'} [2023-02-25 13:41:54,713][36156] Large shaping reward -2.510 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.261, -87.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 13:41:54,719][36155] DAMAGECOUNT value on done: 413477.0 [2023-02-25 13:41:54,720][36155] Sum rewards: 58.756, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.245', 'AMMO5': '0.006', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon4': '0.214', 'weapon2': '0.402', 'WEAPON3': '1.100', 'HITCOUNT': '2.930', 'weapon3': '3.114', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '49.000'} [2023-02-25 13:41:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 174366720. Throughput: 0: 3357.5. Samples: 6082506. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 13:41:54,730][36114] Avg episode reward: [(0, '51.740')] [2023-02-25 13:41:54,884][36139] DAMAGECOUNT value on done: 413556.0 [2023-02-25 13:41:54,885][36139] Sum rewards: 71.899, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.225', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.187', 'weapon5': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.252', 'weapon2': '0.300', 'WEAPON3': '1.200', 'weapon3': '2.986', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '60.000'} [2023-02-25 13:41:55,184][36139] DAMAGECOUNT value on done: 407158.0 [2023-02-25 13:41:55,185][36139] Sum rewards: 45.862, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.428', 'AMMO5': '0.007', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon7': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.122', 'AMMO4': '0.125', 'AMMO3': '0.148', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.330', 'WEAPON3': '0.900', 'weapon4': '0.968', 'weapon3': '2.232', 'HITCOUNT': '2.310', 'DAMAGECOUNT': '11.424', 'FRAGCOUNT': '37.500'} [2023-02-25 13:41:55,302][36155] DAMAGECOUNT value on done: 408455.0 [2023-02-25 13:41:55,303][36155] Sum rewards: 42.333, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.654', 'AMMO5': '0.021', 'AMMO2': '0.054', 'AMMO3': '0.171', 'AMMO4': '0.271', 'weapon5': '0.334', 'weapon2': '0.418', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon4': '0.818', 'WEAPON3': '1.050', 'weapon3': '2.094', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '13.395', 'FRAGCOUNT': '37.500'} [2023-02-25 13:41:55,591][36138] Updated weights for policy 0, policy_version 42573 (0.0010) [2023-02-25 13:41:55,609][36155] DAMAGECOUNT value on done: 405295.0 [2023-02-25 13:41:55,609][36155] Sum rewards: 54.805, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.199', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.340', 'weapon4': '0.388', 'WEAPON3': '1.500', 'weapon3': '2.782', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.709', 'FRAGCOUNT': '51.000'} [2023-02-25 13:41:55,706][36139] DAMAGECOUNT value on done: 407377.0 [2023-02-25 13:41:55,706][36139] Sum rewards: 56.210, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.774', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon5': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.178', 'weapon2': '0.326', 'weapon4': '0.530', 'WEAPON3': '1.000', 'HITCOUNT': '2.790', 'weapon3': '2.904', 'DAMAGECOUNT': '13.536', 'FRAGCOUNT': '46.500'} [2023-02-25 13:41:56,010][36139] DAMAGECOUNT value on done: 408604.0 [2023-02-25 13:41:56,011][36139] Sum rewards: 56.741, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.882', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.152', 'AMMO4': '0.194', 'AMMO3': '0.196', 'weapon4': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.574', 'WEAPON3': '1.150', 'weapon3': '2.828', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.741', 'FRAGCOUNT': '47.000'} [2023-02-25 13:41:58,608][36138] Updated weights for policy 0, policy_version 42583 (0.0009) [2023-02-25 13:41:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 174432256. Throughput: 0: 3365.3. Samples: 6102748. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 13:41:59,730][36114] Avg episode reward: [(0, '52.072')] [2023-02-25 13:42:01,029][36154] DAMAGECOUNT value on done: 410043.0 [2023-02-25 13:42:01,030][36154] Sum rewards: 54.714, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.623', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.108', 'AMMO4': '0.118', 'AMMO3': '0.151', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.290', 'weapon4': '0.582', 'WEAPON3': '0.900', 'weapon3': '2.710', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.500', 'FRAGCOUNT': '45.000'} [2023-02-25 13:42:01,348][36154] DAMAGECOUNT value on done: 403390.0 [2023-02-25 13:42:01,348][36154] Sum rewards: 53.356, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.458', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon5': '0.138', 'AMMO3': '0.171', 'AMMO4': '0.182', 'weapon4': '0.210', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.000', 'HITCOUNT': '2.760', 'weapon3': '3.068', 'DAMAGECOUNT': '13.899', 'FRAGCOUNT': '45.000'} [2023-02-25 13:42:01,615][36154] DAMAGECOUNT value on done: 405585.0 [2023-02-25 13:42:01,615][36154] Sum rewards: 47.412, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.078', 'AMMO2': '0.006', 'AMMO4': '0.030', 'AMMO3': '0.135', 'WEAPON4': '0.200', 'weapon2': '0.556', 'weapon4': '0.556', 'WEAPON3': '0.800', 'HITCOUNT': '2.750', 'weapon3': '2.828', 'DAMAGECOUNT': '11.628', 'FRAGCOUNT': '38.000'} [2023-02-25 13:42:01,678][36138] Updated weights for policy 0, policy_version 42593 (0.0009) [2023-02-25 13:42:01,938][36154] DAMAGECOUNT value on done: 408237.0 [2023-02-25 13:42:01,938][36154] Sum rewards: 51.703, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.647', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon2': '0.256', 'weapon4': '0.442', 'WEAPON3': '1.150', 'HITCOUNT': '2.830', 'weapon3': '3.138', 'DAMAGECOUNT': '13.209', 'FRAGCOUNT': '44.000'} [2023-02-25 13:42:02,102][36141] DAMAGECOUNT value on done: 416493.0 [2023-02-25 13:42:02,102][36141] Sum rewards: 49.313, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.773', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.068', 'AMMO3': '0.158', 'weapon5': '0.212', 'weapon2': '0.242', 'AMMO4': '0.341', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '0.950', 'weapon4': '1.026', 'weapon3': '2.218', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '42.000'} [2023-02-25 13:42:02,416][36141] DAMAGECOUNT value on done: 412004.0 [2023-02-25 13:42:02,416][36141] Sum rewards: 62.497, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.424', 'AMMO5': '0.028', 'AMMO2': '0.040', 'AMMO3': '0.195', 'AMMO4': '0.202', 'weapon2': '0.238', 'weapon5': '0.276', 'weapon4': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.780', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '53.000'} [2023-02-25 13:42:02,428][36141] DAMAGECOUNT value on done: 404609.0 [2023-02-25 13:42:02,428][36141] Sum rewards: 51.792, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.327', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.175', 'AMMO3': '0.215', 'weapon5': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.366', 'weapon2': '0.402', 'WEAPON3': '1.350', 'weapon3': '2.642', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.643', 'FRAGCOUNT': '47.000'} [2023-02-25 13:42:02,719][36141] DAMAGECOUNT value on done: 397472.0 [2023-02-25 13:42:02,720][36141] Sum rewards: 64.159, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.145', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.076', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.181', 'weapon2': '0.282', 'WEAPON4': '0.300', 'weapon4': '0.492', 'WEAPON3': '0.950', 'weapon3': '2.958', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.691', 'FRAGCOUNT': '54.000'} [2023-02-25 13:42:02,902][36157] DAMAGECOUNT value on done: 416781.0 [2023-02-25 13:42:02,903][36157] Sum rewards: 55.859, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.412', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.046', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.118', 'AMMO3': '0.230', 'weapon2': '0.420', 'WEAPON3': '1.350', 'HITCOUNT': '3.060', 'weapon3': '3.204', 'DAMAGECOUNT': '13.815', 'FRAGCOUNT': '49.000'} [2023-02-25 13:42:03,214][36157] DAMAGECOUNT value on done: 411195.0 [2023-02-25 13:42:03,214][36157] Sum rewards: 55.536, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.184', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.136', 'weapon5': '0.140', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.354', 'weapon2': '0.624', 'WEAPON3': '0.900', 'weapon3': '2.708', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '14.469', 'FRAGCOUNT': '44.500'} [2023-02-25 13:42:03,717][36157] DAMAGECOUNT value on done: 410501.0 [2023-02-25 13:42:03,718][36157] Sum rewards: 44.088, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.042', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.147', 'weapon5': '0.150', 'AMMO3': '0.205', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.478', 'weapon2': '0.564', 'WEAPON3': '1.150', 'weapon3': '2.568', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '11.844', 'FRAGCOUNT': '40.000'} [2023-02-25 13:42:04,023][36157] DAMAGECOUNT value on done: 413464.0 [2023-02-25 13:42:04,024][36157] Sum rewards: 48.970, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.360', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.116', 'weapon4': '0.170', 'AMMO3': '0.209', 'weapon2': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '2.980', 'weapon3': '3.262', 'DAMAGECOUNT': '13.839', 'FRAGCOUNT': '43.000'} [2023-02-25 13:42:04,144][36140] DAMAGECOUNT value on done: 415775.0 [2023-02-25 13:42:04,144][36140] Sum rewards: 62.976, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.790', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.112', 'AMMO3': '0.180', 'weapon4': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.546', 'WEAPON3': '1.200', 'weapon3': '2.922', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.603', 'FRAGCOUNT': '53.000'} [2023-02-25 13:42:04,452][36140] DAMAGECOUNT value on done: 404447.0 [2023-02-25 13:42:04,453][36140] Sum rewards: 44.040, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.859', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO4': '0.183', 'AMMO3': '0.190', 'weapon5': '0.248', 'WEAPON5': '0.300', 'weapon4': '0.372', 'weapon2': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.480', 'weapon3': '2.606', 'DAMAGECOUNT': '12.021', 'FRAGCOUNT': '40.500'} [2023-02-25 13:42:04,692][36138] Updated weights for policy 0, policy_version 42603 (0.0009) [2023-02-25 13:42:04,711][36140] DAMAGECOUNT value on done: 407156.0 [2023-02-25 13:42:04,711][36140] Sum rewards: 53.166, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.235', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.068', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon4': '0.204', 'weapon2': '0.364', 'WEAPON3': '1.100', 'HITCOUNT': '2.660', 'weapon3': '3.008', 'DAMAGECOUNT': '13.161', 'FRAGCOUNT': '46.000'} [2023-02-25 13:42:04,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 174501888. Throughput: 0: 3368.3. Samples: 6122944. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:42:04,730][36114] Avg episode reward: [(0, '52.275')] [2023-02-25 13:42:04,894][36156] DAMAGECOUNT value on done: 415466.0 [2023-02-25 13:42:04,895][36156] Sum rewards: 65.385, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.060', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon5': '0.054', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'weapon4': '0.184', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'weapon2': '0.262', 'WEAPON3': '1.200', 'HITCOUNT': '3.260', 'weapon3': '3.316', 'DAMAGECOUNT': '15.990', 'FRAGCOUNT': '55.000'} [2023-02-25 13:42:05,009][36140] DAMAGECOUNT value on done: 402773.0 [2023-02-25 13:42:05,010][36140] Sum rewards: 51.425, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.636', 'AMMO5': '0.021', 'AMMO2': '0.058', 'weapon5': '0.180', 'AMMO3': '0.192', 'AMMO4': '0.291', 'ARMOR': '0.400', 'weapon2': '0.418', 'weapon4': '0.470', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.634', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '14.247', 'FRAGCOUNT': '45.000'} [2023-02-25 13:42:05,102][36156] DAMAGECOUNT value on done: 416356.0 [2023-02-25 13:42:05,102][36156] Sum rewards: 44.966, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.222', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO3': '0.148', 'AMMO4': '0.151', 'weapon5': '0.154', 'WEAPON5': '0.350', 'weapon2': '0.376', 'WEAPON4': '0.550', 'WEAPON3': '0.850', 'weapon4': '0.944', 'weapon3': '2.254', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.705', 'FRAGCOUNT': '38.500'} [2023-02-25 13:42:05,118][36142] DAMAGECOUNT value on done: 404838.0 [2023-02-25 13:42:05,119][36142] Sum rewards: 56.838, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.673', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO3': '0.140', 'AMMO4': '0.184', 'weapon2': '0.198', 'weapon5': '0.268', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.706', 'WEAPON3': '0.850', 'weapon3': '2.584', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.591', 'FRAGCOUNT': '46.000'} [2023-02-25 13:42:05,225][36156] DAMAGECOUNT value on done: 408513.0 [2023-02-25 13:42:05,226][36156] Sum rewards: 51.848, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.336', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.106', 'AMMO4': '0.121', 'weapon5': '0.168', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'AMMO3': '0.267', 'weapon2': '0.360', 'WEAPON3': '1.600', 'HITCOUNT': '2.990', 'weapon3': '3.094', 'DAMAGECOUNT': '15.192', 'FRAGCOUNT': '46.500'} [2023-02-25 13:42:05,416][36142] DAMAGECOUNT value on done: 400818.0 [2023-02-25 13:42:05,417][36142] Sum rewards: 58.319, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.602', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.102', 'weapon5': '0.142', 'weapon2': '0.152', 'AMMO3': '0.206', 'WEAPON3': '1.250', 'HITCOUNT': '2.970', 'weapon3': '3.394', 'DAMAGECOUNT': '14.190', 'FRAGCOUNT': '50.500'} [2023-02-25 13:42:05,422][36156] DAMAGECOUNT value on done: 410665.0 [2023-02-25 13:42:05,423][36156] Sum rewards: 50.058, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.040', 'AMMO5': '0.003', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon4': '0.312', 'weapon2': '0.410', 'WEAPON3': '1.150', 'HITCOUNT': '2.850', 'weapon3': '3.054', 'DAMAGECOUNT': '12.672', 'FRAGCOUNT': '43.000'} [2023-02-25 13:42:05,426][36142] DAMAGECOUNT value on done: 403626.0 [2023-02-25 13:42:05,426][36142] Sum rewards: 50.196, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.888', 'ARMOR': '0.008', 'AMMO5': '0.021', 'AMMO2': '0.052', 'AMMO3': '0.159', 'weapon5': '0.214', 'AMMO4': '0.261', 'weapon2': '0.342', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.590', 'WEAPON3': '1.000', 'HITCOUNT': '2.620', 'weapon3': '2.638', 'DAMAGECOUNT': '13.029', 'FRAGCOUNT': '44.000'} [2023-02-25 13:42:05,727][36142] DAMAGECOUNT value on done: 412112.0 [2023-02-25 13:42:05,728][36142] Sum rewards: 47.454, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.516', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.151', 'AMMO3': '0.190', 'weapon5': '0.192', 'weapon4': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON3': '1.150', 'HITCOUNT': '2.630', 'weapon3': '3.060', 'DAMAGECOUNT': '14.043', 'FRAGCOUNT': '40.000'} [2023-02-25 13:42:07,766][36138] Updated weights for policy 0, policy_version 42613 (0.0010) [2023-02-25 13:42:09,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 174567424. Throughput: 0: 3371.0. Samples: 6133018. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:42:09,730][36114] Avg episode reward: [(0, '52.352')] [2023-02-25 13:42:10,779][36138] Updated weights for policy 0, policy_version 42623 (0.0009) [2023-02-25 13:42:13,812][36138] Updated weights for policy 0, policy_version 42633 (0.0009) [2023-02-25 13:42:14,268][36155] DAMAGECOUNT value on done: 405290.0 [2023-02-25 13:42:14,269][36155] Sum rewards: 49.841, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.165', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon5': '0.110', 'AMMO4': '0.110', 'weapon2': '0.150', 'weapon4': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '2.790', 'weapon3': '3.354', 'DAMAGECOUNT': '13.131', 'FRAGCOUNT': '44.500'} [2023-02-25 13:42:14,578][36155] DAMAGECOUNT value on done: 418591.0 [2023-02-25 13:42:14,579][36155] Sum rewards: 55.027, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.434', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.058', 'weapon5': '0.104', 'AMMO3': '0.150', 'AMMO4': '0.290', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON4': '0.700', 'WEAPON3': '0.900', 'weapon4': '0.946', 'weapon3': '2.358', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '47.000'} [2023-02-25 13:42:14,640][36139] DAMAGECOUNT value on done: 418794.0 [2023-02-25 13:42:14,640][36139] Sum rewards: 60.695, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.032', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon5': '0.154', 'AMMO4': '0.162', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.364', 'weapon4': '0.388', 'WEAPON3': '1.200', 'weapon3': '2.806', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '15.714', 'FRAGCOUNT': '53.000'} [2023-02-25 13:42:14,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13454.3). Total num frames: 174637056. Throughput: 0: 3375.0. Samples: 6153422. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:42:14,730][36114] Avg episode reward: [(0, '52.510')] [2023-02-25 13:42:14,951][36139] DAMAGECOUNT value on done: 410957.0 [2023-02-25 13:42:14,952][36139] Sum rewards: 45.043, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.620', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.090', 'AMMO3': '0.150', 'weapon4': '0.170', 'AMMO4': '0.171', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.770', 'WEAPON3': '0.950', 'HITCOUNT': '2.290', 'weapon3': '2.780', 'DAMAGECOUNT': '11.397', 'FRAGCOUNT': '41.000'} [2023-02-25 13:42:15,196][36155] DAMAGECOUNT value on done: 413268.0 [2023-02-25 13:42:15,196][36155] Sum rewards: 60.673, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.314', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'weapon4': '0.228', 'weapon2': '0.482', 'WEAPON3': '1.150', 'weapon3': '3.054', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '14.439', 'FRAGCOUNT': '50.000'} [2023-02-25 13:42:15,495][36139] DAMAGECOUNT value on done: 411809.0 [2023-02-25 13:42:15,495][36139] Sum rewards: 35.813, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.105', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO2': '0.060', 'AMMO3': '0.206', 'weapon5': '0.258', 'weapon2': '0.296', 'AMMO4': '0.299', 'weapon4': '0.312', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'HITCOUNT': '2.450', 'weapon3': '2.816', 'DAMAGECOUNT': '13.281', 'FRAGCOUNT': '34.500'} [2023-02-25 13:42:15,501][36155] DAMAGECOUNT value on done: 409563.0 [2023-02-25 13:42:15,501][36155] Sum rewards: 51.697, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.503', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.164', 'weapon4': '0.180', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.698', 'WEAPON3': '1.200', 'weapon3': '2.718', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.804', 'FRAGCOUNT': '46.000'} [2023-02-25 13:42:15,824][36139] DAMAGECOUNT value on done: 412693.0 [2023-02-25 13:42:15,825][36139] Sum rewards: 49.079, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.455', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.060', 'AMMO4': '0.069', 'weapon2': '0.172', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.246', 'WEAPON3': '1.200', 'HITCOUNT': '2.590', 'weapon3': '3.324', 'DAMAGECOUNT': '12.267', 'FRAGCOUNT': '43.000'} [2023-02-25 13:42:16,901][36138] Updated weights for policy 0, policy_version 42643 (0.0009) [2023-02-25 13:42:19,240][36139] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:42:19,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 174702592. Throughput: 0: 3369.2. Samples: 6173526. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:42:19,729][36114] Avg episode reward: [(0, '52.724')] [2023-02-25 13:42:19,897][36138] Updated weights for policy 0, policy_version 42653 (0.0009) [2023-02-25 13:42:20,959][36154] DAMAGECOUNT value on done: 414916.0 [2023-02-25 13:42:20,959][36154] Sum rewards: 58.541, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.384', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO2': '0.030', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.207', 'weapon4': '0.320', 'WEAPON4': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.200', 'weapon3': '2.998', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.619', 'FRAGCOUNT': '52.000'} [2023-02-25 13:42:21,275][36154] DAMAGECOUNT value on done: 408121.0 [2023-02-25 13:42:21,275][36154] Sum rewards: 47.011, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.474', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO5': '0.026', 'AMMO4': '0.118', 'weapon2': '0.190', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'weapon5': '0.332', 'weapon4': '0.442', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'HITCOUNT': '2.730', 'weapon3': '2.758', 'DAMAGECOUNT': '14.190', 'FRAGCOUNT': '40.000'} [2023-02-25 13:42:21,551][36154] DAMAGECOUNT value on done: 409865.0 [2023-02-25 13:42:21,551][36154] Sum rewards: 50.196, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.822', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.070', 'weapon2': '0.138', 'weapon4': '0.146', 'AMMO4': '0.181', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '2.800', 'weapon3': '3.476', 'DAMAGECOUNT': '12.840', 'FRAGCOUNT': '46.000'} [2023-02-25 13:42:21,866][36154] DAMAGECOUNT value on done: 412817.0 [2023-02-25 13:42:21,867][36154] Sum rewards: 50.365, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.560', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon4': '0.132', 'WEAPON5': '0.150', 'weapon5': '0.158', 'WEAPON4': '0.250', 'weapon2': '0.252', 'AMMO3': '0.261', 'WEAPON3': '1.450', 'HITCOUNT': '2.680', 'weapon3': '3.166', 'DAMAGECOUNT': '13.740', 'FRAGCOUNT': '46.000'} [2023-02-25 13:42:21,923][36141] DAMAGECOUNT value on done: 420345.0 [2023-02-25 13:42:21,924][36141] Sum rewards: 35.909, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.720', 'AMMO5': '0.016', 'AMMO2': '0.041', 'AMMO4': '0.206', 'weapon5': '0.216', 'AMMO3': '0.271', 'weapon4': '0.366', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.410', 'WEAPON3': '1.650', 'HITCOUNT': '2.400', 'weapon3': '2.696', 'DAMAGECOUNT': '11.556', 'FRAGCOUNT': '38.000'} [2023-02-25 13:42:22,251][36141] DAMAGECOUNT value on done: 417165.0 [2023-02-25 13:42:22,251][36141] Sum rewards: 58.520, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.292', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'weapon5': '0.114', 'weapon2': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.273', 'weapon4': '0.392', 'WEAPON3': '1.600', 'HITCOUNT': '3.050', 'weapon3': '3.068', 'DAMAGECOUNT': '15.483', 'FRAGCOUNT': '52.000'} [2023-02-25 13:42:22,263][36141] DAMAGECOUNT value on done: 409513.0 [2023-02-25 13:42:22,264][36141] Sum rewards: 57.048, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.610', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.134', 'AMMO4': '0.149', 'AMMO3': '0.186', 'weapon4': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.460', 'WEAPON3': '1.200', 'HITCOUNT': '2.760', 'weapon3': '3.024', 'DAMAGECOUNT': '14.712', 'FRAGCOUNT': '49.000'} [2023-02-25 13:42:22,588][36141] DAMAGECOUNT value on done: 402290.0 [2023-02-25 13:42:22,589][36141] Sum rewards: 49.568, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.815', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon5': '0.104', 'AMMO4': '0.152', 'AMMO3': '0.196', 'weapon4': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.586', 'WEAPON3': '1.150', 'weapon3': '2.768', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.454', 'FRAGCOUNT': '43.000'} [2023-02-25 13:42:22,963][36157] DAMAGECOUNT value on done: 422279.0 [2023-02-25 13:42:22,963][36157] Sum rewards: 69.712, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.088', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.076', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.188', 'AMMO3': '0.203', 'weapon2': '0.242', 'WEAPON3': '1.250', 'weapon3': '3.280', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '58.000'} [2023-02-25 13:42:22,965][36138] Updated weights for policy 0, policy_version 42663 (0.0010) [2023-02-25 13:42:23,270][36157] DAMAGECOUNT value on done: 415515.0 [2023-02-25 13:42:23,270][36157] Sum rewards: 48.441, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.461', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.148', 'AMMO4': '0.165', 'AMMO3': '0.214', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.556', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.960', 'FRAGCOUNT': '44.000'} [2023-02-25 13:42:23,780][36157] DAMAGECOUNT value on done: 415248.0 [2023-02-25 13:42:23,781][36157] Sum rewards: 57.193, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.727', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.136', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.246', 'WEAPON4': '0.250', 'weapon4': '0.296', 'WEAPON3': '1.300', 'HITCOUNT': '2.840', 'weapon3': '3.040', 'DAMAGECOUNT': '14.217', 'FRAGCOUNT': '50.000'} [2023-02-25 13:42:24,037][36140] DAMAGECOUNT value on done: 419648.0 [2023-02-25 13:42:24,037][36140] Sum rewards: 38.527, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.302', 'ARMOR': '0.008', 'AMMO5': '0.028', 'AMMO2': '0.069', 'AMMO3': '0.217', 'weapon5': '0.264', 'weapon2': '0.322', 'AMMO4': '0.347', 'weapon4': '0.674', 'WEAPON5': '0.700', 'WEAPON4': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.350', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '11.619', 'FRAGCOUNT': '37.500'} [2023-02-25 13:42:24,084][36157] DAMAGECOUNT value on done: 418238.0 [2023-02-25 13:42:24,084][36157] Sum rewards: 56.607, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.864', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.021', 'weapon5': '0.058', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.170', 'AMMO3': '0.202', 'weapon4': '0.292', 'WEAPON3': '1.250', 'HITCOUNT': '2.850', 'weapon3': '3.246', 'DAMAGECOUNT': '14.322', 'FRAGCOUNT': '49.000'} [2023-02-25 13:42:24,344][36140] DAMAGECOUNT value on done: 407624.0 [2023-02-25 13:42:24,344][36140] Sum rewards: 28.358, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.998', 'AMMO5': '0.018', 'AMMO2': '0.036', 'weapon7': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.172', 'AMMO4': '0.179', 'weapon5': '0.216', 'weapon2': '0.246', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon4': '0.712', 'WEAPON3': '0.950', 'weapon3': '1.294', 'HITCOUNT': '1.460', 'DAMAGECOUNT': '9.531', 'FRAGCOUNT': '25.500'} [2023-02-25 13:42:24,600][36140] DAMAGECOUNT value on done: 410776.0 [2023-02-25 13:42:24,601][36140] Sum rewards: 45.984, reward structure: {'DEATHCOUNT': '-9.000', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.041', 'AMMO3': '0.085', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'weapon5': '0.226', 'WEAPON4': '0.250', 'WEAPON3': '0.500', 'weapon4': '0.580', 'HEALTH': '0.662', 'weapon2': '0.880', 'weapon3': '2.184', 'HITCOUNT': '2.300', 'DAMAGECOUNT': '10.860', 'FRAGCOUNT': '36.000'} [2023-02-25 13:42:24,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 174768128. Throughput: 0: 3369.9. Samples: 6183578. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:42:24,730][36114] Avg episode reward: [(0, '52.138')] [2023-02-25 13:42:24,925][36140] DAMAGECOUNT value on done: 406952.0 [2023-02-25 13:42:24,925][36140] Sum rewards: 40.071, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.506', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.148', 'weapon4': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.278', 'AMMO3': '0.284', 'ARMOR': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '2.370', 'weapon3': '3.110', 'DAMAGECOUNT': '12.537', 'FRAGCOUNT': '39.000'} [2023-02-25 13:42:24,973][36156] DAMAGECOUNT value on done: 419657.0 [2023-02-25 13:42:24,974][36156] Sum rewards: 48.728, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.592', 'ARMOR': '0.008', 'AMMO5': '0.024', 'AMMO2': '0.070', 'AMMO3': '0.126', 'weapon5': '0.176', 'weapon2': '0.230', 'AMMO4': '0.350', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'WEAPON4': '0.850', 'weapon4': '1.202', 'weapon3': '1.972', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.393', 'FRAGCOUNT': '44.000'} [2023-02-25 13:42:25,044][36142] DAMAGECOUNT value on done: 409307.0 [2023-02-25 13:42:25,044][36142] Sum rewards: 46.693, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.836', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.134', 'weapon4': '0.142', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.608', 'WEAPON3': '1.150', 'HITCOUNT': '2.650', 'weapon3': '2.934', 'DAMAGECOUNT': '13.407', 'FRAGCOUNT': '41.000'} [2023-02-25 13:42:25,086][36156] DAMAGECOUNT value on done: 420962.0 [2023-02-25 13:42:25,087][36156] Sum rewards: 54.562, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.540', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.007', 'weapon4': '0.014', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.241', 'weapon2': '0.484', 'WEAPON3': '1.500', 'HITCOUNT': '2.830', 'weapon3': '3.310', 'DAMAGECOUNT': '13.818', 'FRAGCOUNT': '49.000'} [2023-02-25 13:42:25,280][36156] DAMAGECOUNT value on done: 413623.0 [2023-02-25 13:42:25,280][36156] Sum rewards: 60.528, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.456', 'ARMOR': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.041', 'weapon4': '0.156', 'AMMO4': '0.204', 'AMMO3': '0.208', 'weapon5': '0.224', 'WEAPON5': '0.250', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.982', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '53.500'} [2023-02-25 13:42:25,362][36142] DAMAGECOUNT value on done: 404579.0 [2023-02-25 13:42:25,362][36142] Sum rewards: 42.717, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.838', 'AMMO2': '0.017', 'AMMO5': '0.017', 'weapon5': '0.070', 'AMMO4': '0.084', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon2': '0.262', 'WEAPON4': '0.300', 'weapon4': '0.458', 'WEAPON3': '1.050', 'HITCOUNT': '2.490', 'weapon3': '2.684', 'DAMAGECOUNT': '11.283', 'FRAGCOUNT': '38.000'} [2023-02-25 13:42:25,372][36142] DAMAGECOUNT value on done: 407237.0 [2023-02-25 13:42:25,372][36142] Sum rewards: 39.172, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.680', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.060', 'weapon5': '0.150', 'AMMO3': '0.155', 'weapon2': '0.258', 'AMMO4': '0.300', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'weapon4': '0.900', 'WEAPON3': '0.950', 'weapon3': '2.326', 'HITCOUNT': '2.400', 'DAMAGECOUNT': '10.833', 'FRAGCOUNT': '36.500'} [2023-02-25 13:42:25,405][36156] DAMAGECOUNT value on done: 415856.0 [2023-02-25 13:42:25,406][36156] Sum rewards: 56.471, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.290', 'AMMO5': '0.012', 'AMMO2': '0.049', 'AMMO3': '0.159', 'weapon5': '0.236', 'AMMO4': '0.247', 'WEAPON5': '0.400', 'weapon4': '0.406', 'WEAPON4': '0.450', 'weapon2': '0.450', 'WEAPON3': '0.950', 'weapon3': '2.588', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.573', 'FRAGCOUNT': '47.500'} [2023-02-25 13:42:25,613][36140] Large shaping reward -2.506 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0)] [2023-02-25 13:42:25,667][36142] DAMAGECOUNT value on done: 416495.0 [2023-02-25 13:42:25,667][36142] Sum rewards: 48.683, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.435', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.156', 'AMMO3': '0.187', 'weapon2': '0.386', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.564', 'WEAPON3': '1.100', 'weapon3': '2.656', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.149', 'FRAGCOUNT': '42.000'} [2023-02-25 13:42:26,010][36138] Updated weights for policy 0, policy_version 42673 (0.0009) [2023-02-25 13:42:29,047][36138] Updated weights for policy 0, policy_version 42683 (0.0009) [2023-02-25 13:42:29,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 174837760. Throughput: 0: 3370.0. Samples: 6203824. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:42:29,730][36114] Avg episode reward: [(0, '51.995')] [2023-02-25 13:42:31,386][36155] Large shaping reward 2.532 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.51, 170.0), ('weapon5', 0.002)] [2023-02-25 13:42:32,129][36138] Updated weights for policy 0, policy_version 42693 (0.0010) [2023-02-25 13:42:34,146][36155] DAMAGECOUNT value on done: 409286.0 [2023-02-25 13:42:34,147][36155] Sum rewards: 44.833, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.652', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon5': '0.078', 'AMMO3': '0.180', 'weapon4': '0.190', 'AMMO4': '0.208', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.472', 'WEAPON3': '1.150', 'HITCOUNT': '2.610', 'weapon3': '3.050', 'DAMAGECOUNT': '11.988', 'FRAGCOUNT': '41.000'} [2023-02-25 13:42:34,467][36155] DAMAGECOUNT value on done: 422588.0 [2023-02-25 13:42:34,467][36155] Sum rewards: 55.362, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.128', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'weapon5': '0.316', 'weapon2': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '2.420', 'weapon3': '2.952', 'DAMAGECOUNT': '11.991', 'FRAGCOUNT': '47.000'} [2023-02-25 13:42:34,659][36139] DAMAGECOUNT value on done: 423194.0 [2023-02-25 13:42:34,659][36139] Sum rewards: 49.300, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.283', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.045', 'AMMO3': '0.193', 'AMMO4': '0.226', 'weapon2': '0.246', 'weapon5': '0.266', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.808', 'WEAPON3': '1.150', 'weapon3': '2.352', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '13.200', 'FRAGCOUNT': '43.000'} [2023-02-25 13:42:34,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 174903296. Throughput: 0: 3363.4. Samples: 6223836. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:42:34,729][36114] Avg episode reward: [(0, '52.059')] [2023-02-25 13:42:34,972][36139] DAMAGECOUNT value on done: 415313.0 [2023-02-25 13:42:34,973][36139] Sum rewards: 53.517, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.635', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.012', 'weapon5': '0.156', 'AMMO3': '0.159', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.050', 'HITCOUNT': '2.760', 'weapon3': '3.316', 'DAMAGECOUNT': '13.068', 'FRAGCOUNT': '44.500'} [2023-02-25 13:42:35,049][36155] DAMAGECOUNT value on done: 418041.0 [2023-02-25 13:42:35,049][36155] Sum rewards: 60.995, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.680', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.017', 'weapon4': '0.076', 'weapon5': '0.078', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.172', 'weapon2': '0.510', 'WEAPON3': '1.000', 'HITCOUNT': '2.990', 'weapon3': '3.174', 'DAMAGECOUNT': '14.319', 'FRAGCOUNT': '51.000'} [2023-02-25 13:42:35,172][36138] Updated weights for policy 0, policy_version 42703 (0.0009) [2023-02-25 13:42:35,342][36155] DAMAGECOUNT value on done: 414355.0 [2023-02-25 13:42:35,342][36155] Sum rewards: 45.721, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.848', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.146', 'AMMO4': '0.245', 'AMMO3': '0.254', 'weapon4': '0.274', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.452', 'WEAPON3': '1.500', 'HITCOUNT': '2.600', 'weapon3': '2.846', 'DAMAGECOUNT': '14.376', 'FRAGCOUNT': '42.500'} [2023-02-25 13:42:35,504][36139] DAMAGECOUNT value on done: 416148.0 [2023-02-25 13:42:35,504][36139] Sum rewards: 54.196, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.140', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon5': '0.050', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon2': '0.406', 'weapon4': '0.488', 'WEAPON3': '1.350', 'weapon3': '2.854', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.017', 'FRAGCOUNT': '48.000'} [2023-02-25 13:42:35,823][36139] DAMAGECOUNT value on done: 417775.0 [2023-02-25 13:42:35,823][36139] Sum rewards: 54.144, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.668', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.140', 'WEAPON5': '0.200', 'weapon2': '0.228', 'WEAPON4': '0.250', 'AMMO3': '0.275', 'weapon4': '0.482', 'WEAPON3': '1.650', 'weapon3': '2.860', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.946', 'FRAGCOUNT': '50.000'} [2023-02-25 13:42:36,722][36157] Large shaping reward 2.529 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0)] [2023-02-25 13:42:38,246][36138] Updated weights for policy 0, policy_version 42713 (0.0009) [2023-02-25 13:42:39,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 174968832. Throughput: 0: 3363.8. Samples: 6233878. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:42:39,730][36114] Avg episode reward: [(0, '52.075')] [2023-02-25 13:42:41,045][36154] DAMAGECOUNT value on done: 419615.0 [2023-02-25 13:42:41,046][36154] Sum rewards: 59.057, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.590', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.142', 'AMMO4': '0.169', 'AMMO3': '0.177', 'weapon2': '0.264', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.610', 'WEAPON3': '1.000', 'weapon3': '2.752', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.097', 'FRAGCOUNT': '51.000'} [2023-02-25 13:42:41,326][36138] Updated weights for policy 0, policy_version 42723 (0.0009) [2023-02-25 13:42:41,364][36154] DAMAGECOUNT value on done: 413024.0 [2023-02-25 13:42:41,364][36154] Sum rewards: 55.383, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.859', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.042', 'AMMO3': '0.150', 'weapon5': '0.188', 'AMMO4': '0.210', 'weapon2': '0.310', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.800', 'WEAPON3': '0.900', 'weapon3': '2.442', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.709', 'FRAGCOUNT': '47.000'} [2023-02-25 13:42:41,681][36154] DAMAGECOUNT value on done: 414481.0 [2023-02-25 13:42:41,682][36154] Sum rewards: 52.624, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.280', 'AMMO5': '0.017', 'AMMO2': '0.039', 'AMMO3': '0.145', 'weapon5': '0.154', 'AMMO4': '0.194', 'weapon2': '0.216', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.582', 'WEAPON3': '0.850', 'weapon3': '2.716', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '13.461', 'FRAGCOUNT': '44.000'} [2023-02-25 13:42:41,983][36141] DAMAGECOUNT value on done: 425334.0 [2023-02-25 13:42:41,983][36141] Sum rewards: 56.598, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.754', 'AMMO5': '0.031', 'AMMO2': '0.057', 'AMMO3': '0.207', 'weapon2': '0.218', 'weapon5': '0.282', 'AMMO4': '0.284', 'weapon4': '0.526', 'WEAPON4': '0.650', 'WEAPON5': '0.800', 'WEAPON3': '1.250', 'weapon3': '2.600', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.967', 'FRAGCOUNT': '51.000'} [2023-02-25 13:42:41,999][36154] DAMAGECOUNT value on done: 416824.0 [2023-02-25 13:42:41,999][36154] Sum rewards: 49.775, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.605', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.104', 'AMMO4': '0.131', 'weapon5': '0.222', 'WEAPON4': '0.300', 'weapon2': '0.328', 'WEAPON5': '0.350', 'weapon4': '0.394', 'WEAPON3': '0.700', 'HITCOUNT': '2.670', 'weapon3': '2.848', 'DAMAGECOUNT': '12.021', 'FRAGCOUNT': '41.000'} [2023-02-25 13:42:42,289][36141] DAMAGECOUNT value on done: 421561.0 [2023-02-25 13:42:42,289][36141] Sum rewards: 50.847, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.192', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.062', 'weapon5': '0.094', 'AMMO4': '0.103', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '1.044', 'WEAPON3': '1.100', 'weapon3': '2.614', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '13.188', 'FRAGCOUNT': '45.000'} [2023-02-25 13:42:42,303][36141] DAMAGECOUNT value on done: 413887.0 [2023-02-25 13:42:42,303][36141] Sum rewards: 53.488, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.755', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.080', 'AMMO4': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'weapon2': '0.168', 'weapon4': '0.188', 'WEAPON3': '1.100', 'HITCOUNT': '2.830', 'weapon3': '3.436', 'DAMAGECOUNT': '13.122', 'FRAGCOUNT': '45.000'} [2023-02-25 13:42:42,615][36141] DAMAGECOUNT value on done: 406674.0 [2023-02-25 13:42:42,615][36141] Sum rewards: 46.065, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.440', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.050', 'weapon4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'weapon2': '0.310', 'WEAPON3': '1.300', 'HITCOUNT': '2.790', 'weapon3': '3.362', 'DAMAGECOUNT': '13.152', 'FRAGCOUNT': '39.000'} [2023-02-25 13:42:43,084][36157] DAMAGECOUNT value on done: 426682.0 [2023-02-25 13:42:43,084][36157] Sum rewards: 48.660, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.980', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.128', 'AMMO3': '0.204', 'AMMO4': '0.228', 'weapon4': '0.260', 'WEAPON5': '0.300', 'weapon2': '0.476', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '2.860', 'weapon3': '2.914', 'DAMAGECOUNT': '13.209', 'FRAGCOUNT': '45.000'} [2023-02-25 13:42:43,414][36157] DAMAGECOUNT value on done: 420406.0 [2023-02-25 13:42:43,415][36157] Sum rewards: 51.823, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.402', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.098', 'AMMO4': '0.127', 'weapon4': '0.178', 'weapon2': '0.184', 'WEAPON5': '0.250', 'AMMO3': '0.296', 'WEAPON4': '0.300', 'WEAPON3': '1.750', 'HITCOUNT': '2.840', 'weapon3': '3.240', 'DAMAGECOUNT': '14.673', 'FRAGCOUNT': '50.000'} [2023-02-25 13:42:43,958][36157] DAMAGECOUNT value on done: 419832.0 [2023-02-25 13:42:43,958][36157] Sum rewards: 44.060, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.310', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.042', 'weapon2': '0.208', 'AMMO4': '0.210', 'weapon5': '0.232', 'AMMO3': '0.242', 'weapon4': '0.334', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'HITCOUNT': '2.780', 'weapon3': '2.864', 'DAMAGECOUNT': '13.227', 'FRAGCOUNT': '42.500'} [2023-02-25 13:42:44,189][36140] DAMAGECOUNT value on done: 424644.0 [2023-02-25 13:42:44,189][36140] Sum rewards: 52.607, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.450', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.146', 'AMMO4': '0.170', 'AMMO3': '0.204', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON4': '0.400', 'weapon4': '0.528', 'WEAPON3': '1.300', 'weapon3': '2.766', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.988', 'FRAGCOUNT': '46.500'} [2023-02-25 13:42:44,276][36157] DAMAGECOUNT value on done: 423493.0 [2023-02-25 13:42:44,276][36157] Sum rewards: 61.454, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.756', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.108', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.208', 'WEAPON4': '0.250', 'weapon4': '0.512', 'WEAPON3': '1.200', 'weapon3': '2.886', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.765', 'FRAGCOUNT': '52.000'} [2023-02-25 13:42:44,383][36138] Updated weights for policy 0, policy_version 42733 (0.0009) [2023-02-25 13:42:44,499][36140] DAMAGECOUNT value on done: 412320.0 [2023-02-25 13:42:44,499][36140] Sum rewards: 50.677, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.175', 'AMMO5': '0.009', 'AMMO2': '0.048', 'weapon5': '0.124', 'AMMO3': '0.178', 'AMMO4': '0.241', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON4': '0.650', 'weapon4': '0.750', 'WEAPON3': '1.100', 'weapon3': '2.560', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.088', 'FRAGCOUNT': '44.000'} [2023-02-25 13:42:44,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 175038464. Throughput: 0: 3361.1. Samples: 6253996. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:42:44,729][36114] Avg episode reward: [(0, '52.149')] [2023-02-25 13:42:44,776][36140] DAMAGECOUNT value on done: 415168.0 [2023-02-25 13:42:44,776][36140] Sum rewards: 45.014, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.434', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.031', 'weapon4': '0.086', 'AMMO4': '0.156', 'weapon5': '0.180', 'AMMO3': '0.215', 'weapon2': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '2.720', 'weapon3': '3.188', 'DAMAGECOUNT': '13.176', 'FRAGCOUNT': '41.000'} [2023-02-25 13:42:45,053][36142] DAMAGECOUNT value on done: 414132.0 [2023-02-25 13:42:45,053][36142] Sum rewards: 53.290, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.955', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.272', 'weapon4': '0.272', 'AMMO3': '0.280', 'WEAPON3': '1.600', 'HITCOUNT': '2.880', 'weapon3': '3.010', 'DAMAGECOUNT': '14.475', 'FRAGCOUNT': '48.500'} [2023-02-25 13:42:45,056][36156] DAMAGECOUNT value on done: 424133.0 [2023-02-25 13:42:45,057][36156] Sum rewards: 50.845, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.202', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.122', 'AMMO3': '0.163', 'weapon4': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.684', 'WEAPON3': '1.000', 'weapon3': '2.748', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.428', 'FRAGCOUNT': '43.000'} [2023-02-25 13:42:45,089][36140] DAMAGECOUNT value on done: 410576.0 [2023-02-25 13:42:45,090][36140] Sum rewards: 38.073, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.610', 'ARMOR': '0.008', 'AMMO5': '0.027', 'AMMO2': '0.047', 'AMMO3': '0.180', 'AMMO4': '0.236', 'weapon2': '0.286', 'weapon5': '0.378', 'WEAPON4': '0.700', 'WEAPON5': '0.800', 'weapon4': '0.900', 'WEAPON3': '1.100', 'weapon3': '2.068', 'HITCOUNT': '2.330', 'DAMAGECOUNT': '10.872', 'FRAGCOUNT': '36.000'} [2023-02-25 13:42:45,163][36156] DAMAGECOUNT value on done: 425590.0 [2023-02-25 13:42:45,163][36156] Sum rewards: 54.661, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.015', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.215', 'weapon4': '0.366', 'weapon2': '0.604', 'WEAPON3': '1.300', 'weapon3': '2.854', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.734', 'FRAGCOUNT': '47.000'} [2023-02-25 13:42:45,370][36142] DAMAGECOUNT value on done: 409574.0 [2023-02-25 13:42:45,371][36142] Sum rewards: 61.875, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.571', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon4': '0.264', 'weapon2': '0.318', 'WEAPON3': '1.200', 'HITCOUNT': '3.030', 'weapon3': '3.132', 'DAMAGECOUNT': '14.985', 'FRAGCOUNT': '52.000'} [2023-02-25 13:42:45,379][36142] DAMAGECOUNT value on done: 411660.0 [2023-02-25 13:42:45,380][36142] Sum rewards: 53.362, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.692', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon4': '0.094', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'AMMO3': '0.184', 'weapon5': '0.192', 'WEAPON5': '0.200', 'weapon2': '0.758', 'WEAPON3': '1.100', 'HITCOUNT': '2.460', 'weapon3': '2.762', 'DAMAGECOUNT': '13.269', 'FRAGCOUNT': '45.000'} [2023-02-25 13:42:45,380][36156] DAMAGECOUNT value on done: 417828.0 [2023-02-25 13:42:45,381][36156] Sum rewards: 52.148, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.848', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.115', 'weapon5': '0.146', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.416', 'weapon4': '0.602', 'WEAPON3': '0.750', 'weapon3': '2.652', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '12.615', 'FRAGCOUNT': '43.000'} [2023-02-25 13:42:45,485][36156] DAMAGECOUNT value on done: 420119.0 [2023-02-25 13:42:45,485][36156] Sum rewards: 48.620, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.489', 'AMMO5': '0.008', 'weapon7': '0.010', 'AMMO2': '0.025', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.125', 'weapon5': '0.130', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.352', 'weapon2': '0.426', 'WEAPON3': '1.300', 'HITCOUNT': '2.630', 'weapon3': '2.798', 'DAMAGECOUNT': '12.789', 'FRAGCOUNT': '43.000'} [2023-02-25 13:42:45,702][36142] DAMAGECOUNT value on done: 421086.0 [2023-02-25 13:42:45,702][36142] Sum rewards: 58.215, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.987', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO4': '0.019', 'WEAPON5': '0.100', 'AMMO3': '0.239', 'weapon2': '0.252', 'WEAPON3': '1.400', 'HITCOUNT': '3.120', 'weapon3': '3.534', 'DAMAGECOUNT': '13.773', 'FRAGCOUNT': '51.000'} [2023-02-25 13:42:47,417][36138] Updated weights for policy 0, policy_version 42743 (0.0009) [2023-02-25 13:42:49,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13440.4). Total num frames: 175104000. Throughput: 0: 3355.5. Samples: 6273940. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:42:49,730][36114] Avg episode reward: [(0, '51.956')] [2023-02-25 13:42:50,505][36138] Updated weights for policy 0, policy_version 42753 (0.0009) [2023-02-25 13:42:53,564][36138] Updated weights for policy 0, policy_version 42763 (0.0009) [2023-02-25 13:42:54,186][36155] DAMAGECOUNT value on done: 414406.0 [2023-02-25 13:42:54,186][36155] Sum rewards: 57.739, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.322', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.142', 'AMMO3': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.320', 'weapon2': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.772', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.360', 'FRAGCOUNT': '49.000'} [2023-02-25 13:42:54,490][36155] DAMAGECOUNT value on done: 427225.0 [2023-02-25 13:42:54,491][36155] Sum rewards: 48.159, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.575', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.060', 'AMMO4': '0.099', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON4': '0.400', 'weapon2': '0.480', 'weapon4': '0.756', 'WEAPON3': '1.400', 'weapon3': '2.494', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.911', 'FRAGCOUNT': '44.000'} [2023-02-25 13:42:54,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13426.6). Total num frames: 175169536. Throughput: 0: 3354.3. Samples: 6283962. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:42:54,730][36114] Avg episode reward: [(0, '51.866')] [2023-02-25 13:42:54,805][36139] DAMAGECOUNT value on done: 427831.0 [2023-02-25 13:42:54,806][36139] Sum rewards: 56.537, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.505', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.027', 'weapon4': '0.036', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.184', 'weapon2': '0.270', 'WEAPON3': '1.100', 'HITCOUNT': '2.880', 'weapon3': '3.484', 'DAMAGECOUNT': '13.911', 'FRAGCOUNT': '47.000'} [2023-02-25 13:42:55,064][36155] DAMAGECOUNT value on done: 421836.0 [2023-02-25 13:42:55,064][36155] Sum rewards: 45.230, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO2': '0.022', 'AMMO4': '0.109', 'AMMO3': '0.148', 'HEALTH': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.380', 'weapon4': '0.676', 'WEAPON3': '0.800', 'HITCOUNT': '2.570', 'weapon3': '2.828', 'DAMAGECOUNT': '11.385', 'FRAGCOUNT': '37.000'} [2023-02-25 13:42:55,123][36139] DAMAGECOUNT value on done: 420884.0 [2023-02-25 13:42:55,123][36139] Sum rewards: 60.420, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.533', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.036', 'AMMO4': '0.182', 'AMMO3': '0.208', 'weapon5': '0.344', 'weapon2': '0.432', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.590', 'WEAPON3': '1.200', 'weapon3': '2.286', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '52.500'} [2023-02-25 13:42:55,362][36155] DAMAGECOUNT value on done: 419035.0 [2023-02-25 13:42:55,363][36155] Sum rewards: 54.870, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.528', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon5': '0.176', 'AMMO3': '0.195', 'weapon2': '0.316', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.608', 'WEAPON3': '1.250', 'weapon3': '2.556', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.530', 'FRAGCOUNT': '50.000'} [2023-02-25 13:42:55,694][36139] DAMAGECOUNT value on done: 421792.0 [2023-02-25 13:42:55,694][36139] Sum rewards: 59.351, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.842', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon2': '0.166', 'weapon4': '0.178', 'weapon5': '0.216', 'WEAPON4': '0.300', 'AMMO3': '0.317', 'WEAPON5': '0.400', 'WEAPON3': '1.850', 'weapon3': '3.104', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '55.000'} [2023-02-25 13:42:55,999][36139] DAMAGECOUNT value on done: 422463.0 [2023-02-25 13:42:56,000][36139] Sum rewards: 53.169, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.165', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.396', 'weapon2': '0.758', 'WEAPON3': '1.000', 'weapon3': '2.560', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.064', 'FRAGCOUNT': '44.000'} [2023-02-25 13:42:56,655][36138] Updated weights for policy 0, policy_version 42773 (0.0010) [2023-02-25 13:42:59,713][36138] Updated weights for policy 0, policy_version 42783 (0.0009) [2023-02-25 13:42:59,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13440.4). Total num frames: 175239168. Throughput: 0: 3346.9. Samples: 6304032. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:42:59,729][36114] Avg episode reward: [(0, '51.864')] [2023-02-25 13:43:01,077][36154] DAMAGECOUNT value on done: 424480.0 [2023-02-25 13:43:01,078][36154] Sum rewards: 59.993, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.520', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.072', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'weapon4': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.150', 'HITCOUNT': '3.200', 'weapon3': '3.264', 'DAMAGECOUNT': '14.595', 'FRAGCOUNT': '51.000'} [2023-02-25 13:43:01,087][36155] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 13:43:01,393][36154] DAMAGECOUNT value on done: 417939.0 [2023-02-25 13:43:01,393][36154] Sum rewards: 55.580, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.203', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'weapon5': '0.172', 'weapon4': '0.208', 'AMMO3': '0.236', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON3': '1.450', 'HITCOUNT': '2.870', 'weapon3': '3.048', 'DAMAGECOUNT': '14.745', 'FRAGCOUNT': '50.000'} [2023-02-25 13:43:01,717][36154] DAMAGECOUNT value on done: 418740.0 [2023-02-25 13:43:01,718][36154] Sum rewards: 40.519, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.642', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.066', 'AMMO3': '0.166', 'weapon5': '0.244', 'AMMO4': '0.330', 'WEAPON5': '0.350', 'weapon2': '0.350', 'weapon4': '0.624', 'WEAPON4': '0.700', 'WEAPON3': '1.000', 'weapon3': '2.476', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '12.777', 'FRAGCOUNT': '38.000'} [2023-02-25 13:43:02,022][36154] DAMAGECOUNT value on done: 422138.0 [2023-02-25 13:43:02,022][36154] Sum rewards: 55.971, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.945', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.150', 'AMMO3': '0.183', 'WEAPON5': '0.250', 'weapon2': '0.274', 'WEAPON4': '0.450', 'weapon4': '0.690', 'WEAPON3': '1.050', 'weapon3': '2.576', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.942', 'FRAGCOUNT': '47.000'} [2023-02-25 13:43:02,170][36141] DAMAGECOUNT value on done: 430556.0 [2023-02-25 13:43:02,171][36141] Sum rewards: 66.614, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.088', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.114', 'weapon2': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon4': '0.322', 'WEAPON3': '1.250', 'weapon3': '3.184', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.666', 'FRAGCOUNT': '58.000'} [2023-02-25 13:43:02,491][36141] DAMAGECOUNT value on done: 427549.0 [2023-02-25 13:43:02,492][36141] Sum rewards: 66.007, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.900', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.080', 'weapon2': '0.118', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon4': '0.236', 'WEAPON3': '1.250', 'weapon3': '3.370', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '54.000'} [2023-02-25 13:43:02,506][36141] DAMAGECOUNT value on done: 418449.0 [2023-02-25 13:43:02,507][36141] Sum rewards: 48.467, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.560', 'ARMOR': '0.008', 'AMMO5': '0.024', 'AMMO2': '0.065', 'weapon5': '0.184', 'AMMO3': '0.204', 'AMMO4': '0.327', 'weapon2': '0.336', 'WEAPON5': '0.600', 'weapon4': '0.620', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.452', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '13.686', 'FRAGCOUNT': '44.000'} [2023-02-25 13:43:02,758][36138] Updated weights for policy 0, policy_version 42793 (0.0010) [2023-02-25 13:43:02,825][36141] DAMAGECOUNT value on done: 411154.0 [2023-02-25 13:43:02,825][36141] Sum rewards: 53.168, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.630', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon5': '0.162', 'AMMO3': '0.170', 'weapon4': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.788', 'WEAPON3': '1.000', 'weapon3': '2.570', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '13.440', 'FRAGCOUNT': '44.000'} [2023-02-25 13:43:03,151][36157] DAMAGECOUNT value on done: 432547.0 [2023-02-25 13:43:03,151][36157] Sum rewards: 67.183, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.097', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.130', 'AMMO3': '0.152', 'AMMO4': '0.203', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.350', 'weapon2': '0.432', 'WEAPON3': '0.900', 'weapon3': '2.852', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '54.000'} [2023-02-25 13:43:03,472][36157] DAMAGECOUNT value on done: 424179.0 [2023-02-25 13:43:03,473][36157] Sum rewards: 45.918, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.466', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.138', 'weapon5': '0.146', 'WEAPON5': '0.300', 'weapon2': '0.402', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'weapon4': '1.012', 'weapon3': '2.018', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '11.319', 'FRAGCOUNT': '40.000'} [2023-02-25 13:43:04,013][36157] DAMAGECOUNT value on done: 425196.0 [2023-02-25 13:43:04,014][36157] Sum rewards: 66.128, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.055', 'AMMO5': '0.008', 'AMMO2': '0.012', 'weapon5': '0.054', 'AMMO4': '0.058', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'weapon2': '0.276', 'weapon4': '0.362', 'WEAPON3': '1.100', 'weapon3': '3.108', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '55.000'} [2023-02-25 13:43:04,318][36140] DAMAGECOUNT value on done: 429432.0 [2023-02-25 13:43:04,319][36140] Sum rewards: 57.472, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.667', 'ARMOR': '0.008', 'AMMO5': '0.026', 'AMMO2': '0.052', 'AMMO3': '0.119', 'weapon5': '0.150', 'AMMO4': '0.258', 'weapon4': '0.336', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'weapon2': '0.704', 'WEAPON3': '0.800', 'weapon3': '2.562', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.364', 'FRAGCOUNT': '50.000'} [2023-02-25 13:43:04,347][36157] DAMAGECOUNT value on done: 427906.0 [2023-02-25 13:43:04,348][36157] Sum rewards: 52.601, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.110', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.128', 'AMMO3': '0.173', 'weapon2': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.256', 'WEAPON3': '1.050', 'HITCOUNT': '2.900', 'weapon3': '3.256', 'DAMAGECOUNT': '13.239', 'FRAGCOUNT': '44.000'} [2023-02-25 13:43:04,646][36140] DAMAGECOUNT value on done: 417501.0 [2023-02-25 13:43:04,646][36140] Sum rewards: 58.955, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.140', 'AMMO5': '0.020', 'AMMO2': '0.032', 'AMMO3': '0.147', 'AMMO4': '0.159', 'weapon5': '0.362', 'WEAPON4': '0.500', 'weapon4': '0.506', 'weapon2': '0.534', 'WEAPON5': '0.700', 'WEAPON3': '0.950', 'weapon3': '2.262', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.543', 'FRAGCOUNT': '50.000'} [2023-02-25 13:43:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13426.5). Total num frames: 175304704. Throughput: 0: 3345.2. Samples: 6324062. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:43:04,730][36114] Avg episode reward: [(0, '52.245')] [2023-02-25 13:43:04,924][36140] DAMAGECOUNT value on done: 420071.0 [2023-02-25 13:43:04,924][36140] Sum rewards: 51.670, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.532', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.146', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'weapon2': '0.390', 'weapon4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.778', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.709', 'FRAGCOUNT': '44.500'} [2023-02-25 13:43:05,136][36142] DAMAGECOUNT value on done: 419389.0 [2023-02-25 13:43:05,137][36142] Sum rewards: 59.790, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.422', 'AMMO5': '0.014', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.175', 'weapon5': '0.272', 'weapon2': '0.334', 'WEAPON5': '0.350', 'weapon4': '0.424', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.692', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.771', 'FRAGCOUNT': '51.000'} [2023-02-25 13:43:05,150][36156] DAMAGECOUNT value on done: 428315.0 [2023-02-25 13:43:05,150][36156] Sum rewards: 56.106, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.763', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'weapon5': '0.212', 'WEAPON5': '0.250', 'weapon4': '0.288', 'weapon2': '0.678', 'WEAPON3': '1.000', 'weapon3': '2.520', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '12.546', 'FRAGCOUNT': '48.000'} [2023-02-25 13:43:05,227][36140] DAMAGECOUNT value on done: 415809.0 [2023-02-25 13:43:05,227][36140] Sum rewards: 60.577, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.913', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.192', 'weapon5': '0.194', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON4': '0.350', 'weapon4': '0.530', 'WEAPON3': '1.050', 'weapon3': '2.656', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.699', 'FRAGCOUNT': '51.000'} [2023-02-25 13:43:05,259][36156] DAMAGECOUNT value on done: 430400.0 [2023-02-25 13:43:05,259][36156] Sum rewards: 59.954, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.145', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.006', 'WEAPON5': '0.100', 'weapon2': '0.142', 'AMMO3': '0.269', 'WEAPON3': '1.650', 'HITCOUNT': '3.090', 'weapon3': '3.660', 'DAMAGECOUNT': '14.430', 'FRAGCOUNT': '54.000'} [2023-02-25 13:43:05,457][36142] DAMAGECOUNT value on done: 413723.0 [2023-02-25 13:43:05,457][36142] Sum rewards: 45.313, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.040', 'ARMOR': '0.004', 'AMMO2': '0.017', 'AMMO5': '0.019', 'AMMO4': '0.085', 'AMMO3': '0.152', 'weapon5': '0.278', 'WEAPON4': '0.300', 'weapon4': '0.314', 'weapon2': '0.342', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'HITCOUNT': '2.440', 'weapon3': '2.804', 'DAMAGECOUNT': '12.447', 'FRAGCOUNT': '38.000'} [2023-02-25 13:43:05,464][36156] DAMAGECOUNT value on done: 422692.0 [2023-02-25 13:43:05,465][36156] Sum rewards: 51.832, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.690', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon4': '0.074', 'weapon5': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'weapon2': '0.646', 'WEAPON3': '1.500', 'weapon3': '2.956', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.592', 'FRAGCOUNT': '45.000'} [2023-02-25 13:43:05,469][36142] DAMAGECOUNT value on done: 416219.0 [2023-02-25 13:43:05,470][36142] Sum rewards: 53.752, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.296', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.072', 'AMMO4': '0.119', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon5': '0.230', 'WEAPON5': '0.250', 'weapon2': '0.476', 'WEAPON3': '0.950', 'HITCOUNT': '2.690', 'weapon3': '2.924', 'DAMAGECOUNT': '13.677', 'FRAGCOUNT': '45.000'} [2023-02-25 13:43:05,557][36156] DAMAGECOUNT value on done: 424566.0 [2023-02-25 13:43:05,558][36156] Sum rewards: 50.559, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.408', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.132', 'AMMO3': '0.168', 'weapon5': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.398', 'weapon2': '0.644', 'WEAPON3': '1.050', 'weapon3': '2.514', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.221', 'FRAGCOUNT': '43.000'} [2023-02-25 13:43:05,782][36142] DAMAGECOUNT value on done: 425056.0 [2023-02-25 13:43:05,782][36142] Sum rewards: 41.917, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.440', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon4': '0.170', 'AMMO4': '0.175', 'weapon2': '0.192', 'AMMO3': '0.246', 'weapon5': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.390', 'weapon3': '3.100', 'DAMAGECOUNT': '11.910', 'FRAGCOUNT': '40.000'} [2023-02-25 13:43:05,839][36138] Updated weights for policy 0, policy_version 42803 (0.0009) [2023-02-25 13:43:08,846][36138] Updated weights for policy 0, policy_version 42813 (0.0009) [2023-02-25 13:43:09,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13426.6). Total num frames: 175370240. Throughput: 0: 3344.5. Samples: 6334082. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:43:09,729][36114] Avg episode reward: [(0, '52.323')] [2023-02-25 13:43:11,914][36138] Updated weights for policy 0, policy_version 42823 (0.0009) [2023-02-25 13:43:14,244][36155] DAMAGECOUNT value on done: 418773.0 [2023-02-25 13:43:14,245][36155] Sum rewards: 52.349, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.072', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.154', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.314', 'weapon4': '0.368', 'WEAPON3': '1.100', 'HITCOUNT': '2.610', 'weapon3': '2.962', 'DAMAGECOUNT': '13.101', 'FRAGCOUNT': '44.000'} [2023-02-25 13:43:14,545][36155] DAMAGECOUNT value on done: 431531.0 [2023-02-25 13:43:14,546][36155] Sum rewards: 46.045, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.379', 'ARMOR': '0.004', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'AMMO3': '0.148', 'AMMO4': '0.178', 'weapon5': '0.226', 'WEAPON5': '0.400', 'weapon2': '0.428', 'WEAPON4': '0.550', 'WEAPON3': '0.900', 'weapon4': '1.116', 'weapon3': '1.960', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.885', 'FRAGCOUNT': '41.000'} [2023-02-25 13:43:14,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13440.4). Total num frames: 175439872. Throughput: 0: 3344.1. Samples: 6354308. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:43:14,730][36114] Avg episode reward: [(0, '52.223')] [2023-02-25 13:43:14,809][36139] DAMAGECOUNT value on done: 431949.0 [2023-02-25 13:43:14,810][36139] Sum rewards: 46.264, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.224', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.047', 'AMMO3': '0.203', 'weapon5': '0.226', 'AMMO4': '0.235', 'weapon4': '0.282', 'weapon2': '0.286', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.670', 'weapon3': '2.866', 'DAMAGECOUNT': '12.354', 'FRAGCOUNT': '42.000'} [2023-02-25 13:43:14,923][36138] Updated weights for policy 0, policy_version 42833 (0.0009) [2023-02-25 13:43:15,121][36139] DAMAGECOUNT value on done: 425203.0 [2023-02-25 13:43:15,122][36139] Sum rewards: 51.742, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.420', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.110', 'weapon4': '0.164', 'AMMO3': '0.202', 'weapon2': '0.436', 'WEAPON3': '1.200', 'HITCOUNT': '2.740', 'weapon3': '3.100', 'DAMAGECOUNT': '12.957', 'FRAGCOUNT': '45.500'} [2023-02-25 13:43:15,130][36155] DAMAGECOUNT value on done: 426862.0 [2023-02-25 13:43:15,130][36155] Sum rewards: 51.743, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.055', 'AMMO5': '0.025', 'AMMO2': '0.062', 'AMMO3': '0.203', 'weapon5': '0.242', 'weapon2': '0.304', 'AMMO4': '0.310', 'weapon4': '0.386', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.698', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.078', 'FRAGCOUNT': '45.500'} [2023-02-25 13:43:15,432][36155] DAMAGECOUNT value on done: 423042.0 [2023-02-25 13:43:15,433][36155] Sum rewards: 36.868, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.442', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.039', 'AMMO4': '0.195', 'weapon2': '0.220', 'weapon5': '0.260', 'AMMO3': '0.286', 'WEAPON4': '0.500', 'weapon4': '0.544', 'WEAPON5': '0.600', 'WEAPON3': '1.600', 'weapon3': '2.448', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '12.021', 'FRAGCOUNT': '37.000'} [2023-02-25 13:43:15,657][36139] DAMAGECOUNT value on done: 425954.0 [2023-02-25 13:43:15,657][36139] Sum rewards: 45.168, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.764', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO4': '0.177', 'weapon5': '0.210', 'AMMO3': '0.246', 'weapon2': '0.258', 'weapon4': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '2.670', 'weapon3': '2.896', 'DAMAGECOUNT': '12.486', 'FRAGCOUNT': '42.000'} [2023-02-25 13:43:15,968][36139] DAMAGECOUNT value on done: 427376.0 [2023-02-25 13:43:15,968][36139] Sum rewards: 54.530, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.695', 'AMMO5': '0.010', 'AMMO2': '0.011', 'weapon4': '0.030', 'AMMO4': '0.053', 'weapon5': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'WEAPON5': '0.250', 'weapon2': '0.820', 'WEAPON3': '1.050', 'weapon3': '2.836', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '45.000'} [2023-02-25 13:43:17,498][36139] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 13:43:17,954][36138] Updated weights for policy 0, policy_version 42843 (0.0009) [2023-02-25 13:43:19,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13426.5). Total num frames: 175505408. Throughput: 0: 3349.0. Samples: 6374542. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:43:19,730][36114] Avg episode reward: [(0, '52.004')] [2023-02-25 13:43:19,763][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000042849_175509504.pth... [2023-02-25 13:43:19,818][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000042062_172285952.pth [2023-02-25 13:43:20,995][36138] Updated weights for policy 0, policy_version 42853 (0.0009) [2023-02-25 13:43:21,170][36154] DAMAGECOUNT value on done: 429142.0 [2023-02-25 13:43:21,171][36154] Sum rewards: 55.363, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.110', 'AMMO5': '0.009', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.104', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'weapon2': '0.290', 'WEAPON4': '0.300', 'weapon4': '0.336', 'WEAPON3': '1.200', 'weapon3': '3.038', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.986', 'FRAGCOUNT': '49.000'} [2023-02-25 13:43:21,482][36154] DAMAGECOUNT value on done: 422053.0 [2023-02-25 13:43:21,482][36154] Sum rewards: 47.511, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.220', 'AMMO5': '0.019', 'AMMO2': '0.038', 'AMMO4': '0.190', 'AMMO3': '0.226', 'weapon5': '0.290', 'weapon2': '0.380', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'weapon4': '0.790', 'WEAPON3': '1.350', 'weapon3': '2.196', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.342', 'FRAGCOUNT': '42.000'} [2023-02-25 13:43:21,665][36156] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:43:21,788][36154] DAMAGECOUNT value on done: 423811.0 [2023-02-25 13:43:21,788][36154] Sum rewards: 57.660, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.581', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.049', 'AMMO3': '0.175', 'weapon5': '0.222', 'AMMO4': '0.246', 'WEAPON5': '0.300', 'weapon4': '0.402', 'WEAPON4': '0.450', 'weapon2': '0.454', 'WEAPON3': '1.000', 'weapon3': '2.680', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.808', 'FRAGCOUNT': '49.000'} [2023-02-25 13:43:22,090][36154] DAMAGECOUNT value on done: 426691.0 [2023-02-25 13:43:22,090][36154] Sum rewards: 50.828, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.940', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.013', 'weapon4': '0.018', 'weapon5': '0.048', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.276', 'weapon2': '0.544', 'WEAPON3': '1.650', 'HITCOUNT': '2.870', 'weapon3': '3.168', 'DAMAGECOUNT': '13.659', 'FRAGCOUNT': '47.000'} [2023-02-25 13:43:22,270][36141] DAMAGECOUNT value on done: 435445.0 [2023-02-25 13:43:22,270][36141] Sum rewards: 63.402, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.165', 'AMMO2': '0.007', 'AMMO5': '0.012', 'AMMO4': '0.035', 'WEAPON4': '0.100', 'weapon5': '0.108', 'weapon4': '0.134', 'AMMO3': '0.206', 'weapon2': '0.230', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.160', 'weapon3': '3.358', 'DAMAGECOUNT': '14.667', 'FRAGCOUNT': '54.000'} [2023-02-25 13:43:22,579][36141] DAMAGECOUNT value on done: 433110.0 [2023-02-25 13:43:22,579][36141] Sum rewards: 67.004, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.797', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.154', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.322', 'weapon2': '0.338', 'WEAPON3': '1.050', 'weapon3': '2.882', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '55.000'} [2023-02-25 13:43:22,601][36141] DAMAGECOUNT value on done: 424124.0 [2023-02-25 13:43:22,602][36141] Sum rewards: 64.327, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.810', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon5': '0.160', 'AMMO3': '0.167', 'weapon4': '0.222', 'weapon2': '0.254', 'AMMO4': '0.263', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.138', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '52.500'} [2023-02-25 13:43:22,891][36141] DAMAGECOUNT value on done: 415929.0 [2023-02-25 13:43:22,891][36141] Sum rewards: 50.378, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.640', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'weapon4': '0.216', 'weapon2': '0.236', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '3.030', 'weapon3': '3.260', 'DAMAGECOUNT': '14.325', 'FRAGCOUNT': '47.000'} [2023-02-25 13:43:23,110][36157] DAMAGECOUNT value on done: 436672.0 [2023-02-25 13:43:23,110][36157] Sum rewards: 57.114, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.575', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.092', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.340', 'weapon4': '0.552', 'WEAPON3': '0.750', 'weapon3': '2.546', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.375', 'FRAGCOUNT': '46.000'} [2023-02-25 13:43:23,444][36157] DAMAGECOUNT value on done: 428700.0 [2023-02-25 13:43:23,445][36157] Sum rewards: 53.283, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.582', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.065', 'AMMO3': '0.160', 'weapon5': '0.266', 'AMMO4': '0.324', 'WEAPON5': '0.450', 'weapon4': '0.534', 'weapon2': '0.542', 'WEAPON4': '0.650', 'WEAPON3': '0.900', 'weapon3': '2.384', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.563', 'FRAGCOUNT': '45.000'} [2023-02-25 13:43:23,966][36157] DAMAGECOUNT value on done: 430081.0 [2023-02-25 13:43:23,966][36157] Sum rewards: 56.504, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.980', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon5': '0.132', 'AMMO4': '0.144', 'weapon2': '0.188', 'AMMO3': '0.211', 'weapon4': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.920', 'weapon3': '3.198', 'DAMAGECOUNT': '14.655', 'FRAGCOUNT': '49.000'} [2023-02-25 13:43:24,032][36138] Updated weights for policy 0, policy_version 42863 (0.0010) [2023-02-25 13:43:24,272][36157] DAMAGECOUNT value on done: 432972.0 [2023-02-25 13:43:24,272][36157] Sum rewards: 53.058, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.116', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'weapon2': '0.178', 'WEAPON4': '0.250', 'AMMO3': '0.255', 'weapon4': '0.336', 'WEAPON3': '1.500', 'weapon3': '3.160', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.198', 'FRAGCOUNT': '48.000'} [2023-02-25 13:43:24,393][36140] DAMAGECOUNT value on done: 433887.0 [2023-02-25 13:43:24,393][36140] Sum rewards: 51.829, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.597', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.046', 'AMMO3': '0.143', 'AMMO4': '0.228', 'weapon5': '0.258', 'weapon2': '0.264', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.700', 'WEAPON3': '0.950', 'weapon3': '2.472', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.320', 'FRAGCOUNT': '44.000'} [2023-02-25 13:43:24,702][36140] DAMAGECOUNT value on done: 421645.0 [2023-02-25 13:43:24,703][36140] Sum rewards: 44.687, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.942', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.060', 'AMMO3': '0.150', 'AMMO4': '0.170', 'WEAPON5': '0.200', 'weapon2': '0.394', 'WEAPON4': '0.450', 'ARMOR': '0.463', 'weapon4': '0.964', 'WEAPON3': '1.000', 'weapon3': '2.334', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.432', 'FRAGCOUNT': '38.000'} [2023-02-25 13:43:24,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 175575040. Throughput: 0: 3347.7. Samples: 6384524. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:43:24,730][36114] Avg episode reward: [(0, '52.508')] [2023-02-25 13:43:24,972][36140] DAMAGECOUNT value on done: 424166.0 [2023-02-25 13:43:24,972][36140] Sum rewards: 47.719, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.893', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.034', 'weapon5': '0.052', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.248', 'weapon2': '0.248', 'WEAPON3': '1.350', 'HITCOUNT': '2.630', 'weapon3': '3.440', 'DAMAGECOUNT': '12.285', 'FRAGCOUNT': '43.000'} [2023-02-25 13:43:25,227][36156] DAMAGECOUNT value on done: 432314.0 [2023-02-25 13:43:25,228][36156] Sum rewards: 41.222, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.890', 'ARMOR': '0.004', 'AMMO2': '0.015', 'AMMO5': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.147', 'WEAPON4': '0.250', 'weapon5': '0.260', 'weapon4': '0.336', 'WEAPON5': '0.350', 'weapon2': '0.708', 'WEAPON3': '0.900', 'HITCOUNT': '2.390', 'weapon3': '2.416', 'DAMAGECOUNT': '11.997', 'FRAGCOUNT': '34.500'} [2023-02-25 13:43:25,282][36140] DAMAGECOUNT value on done: 420137.0 [2023-02-25 13:43:25,283][36140] Sum rewards: 46.573, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.088', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO3': '0.134', 'weapon5': '0.172', 'AMMO4': '0.216', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.614', 'WEAPON3': '0.800', 'weapon4': '0.880', 'weapon3': '2.056', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.969', 'FRAGCOUNT': '38.000'} [2023-02-25 13:43:25,284][36142] DAMAGECOUNT value on done: 424449.0 [2023-02-25 13:43:25,284][36142] Sum rewards: 53.963, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.570', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.238', 'weapon2': '0.242', 'weapon4': '0.252', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.150', 'weapon3': '3.242', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '48.000'} [2023-02-25 13:43:25,303][36156] DAMAGECOUNT value on done: 435004.0 [2023-02-25 13:43:25,304][36156] Sum rewards: 45.944, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.582', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.037', 'weapon5': '0.152', 'AMMO4': '0.187', 'AMMO3': '0.237', 'weapon4': '0.308', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'weapon2': '0.530', 'WEAPON3': '1.450', 'weapon3': '2.672', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.809', 'FRAGCOUNT': '45.000'} [2023-02-25 13:43:25,542][36156] DAMAGECOUNT value on done: 427324.0 [2023-02-25 13:43:25,543][36156] Sum rewards: 46.787, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.990', 'AMMO2': '0.009', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.042', 'weapon5': '0.138', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.260', 'weapon4': '0.456', 'WEAPON3': '1.450', 'weapon3': '2.884', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.896', 'FRAGCOUNT': '41.500'} [2023-02-25 13:43:25,585][36142] DAMAGECOUNT value on done: 417726.0 [2023-02-25 13:43:25,586][36142] Sum rewards: 44.301, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.835', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.160', 'AMMO4': '0.164', 'AMMO3': '0.238', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.452', 'weapon2': '0.612', 'WEAPON3': '1.400', 'weapon3': '2.438', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '12.009', 'FRAGCOUNT': '42.000'} [2023-02-25 13:43:25,594][36142] DAMAGECOUNT value on done: 421133.0 [2023-02-25 13:43:25,595][36142] Sum rewards: 58.086, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.342', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.074', 'AMMO4': '0.099', 'weapon4': '0.158', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.532', 'WEAPON3': '1.050', 'weapon3': '3.062', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.742', 'FRAGCOUNT': '48.000'} [2023-02-25 13:43:25,616][36156] DAMAGECOUNT value on done: 429111.0 [2023-02-25 13:43:25,617][36156] Sum rewards: 51.129, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.535', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.190', 'weapon2': '0.218', 'AMMO3': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.358', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.840', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.635', 'FRAGCOUNT': '45.000'} [2023-02-25 13:43:25,894][36142] DAMAGECOUNT value on done: 429769.0 [2023-02-25 13:43:25,894][36142] Sum rewards: 60.724, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.920', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.057', 'weapon5': '0.146', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon4': '0.380', 'weapon2': '0.492', 'WEAPON3': '1.250', 'weapon3': '2.780', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.986', 'FRAGCOUNT': '54.000'} [2023-02-25 13:43:27,072][36138] Updated weights for policy 0, policy_version 42873 (0.0009) [2023-02-25 13:43:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13426.5). Total num frames: 175640576. Throughput: 0: 3351.1. Samples: 6404796. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:43:29,730][36114] Avg episode reward: [(0, '52.700')] [2023-02-25 13:43:30,128][36138] Updated weights for policy 0, policy_version 42883 (0.0009) [2023-02-25 13:43:33,200][36138] Updated weights for policy 0, policy_version 42893 (0.0009) [2023-02-25 13:43:34,006][36155] DAMAGECOUNT value on done: 423162.0 [2023-02-25 13:43:34,006][36155] Sum rewards: 51.598, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.748', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'weapon4': '0.308', 'weapon2': '0.316', 'WEAPON3': '1.000', 'HITCOUNT': '2.760', 'weapon3': '3.012', 'DAMAGECOUNT': '13.167', 'FRAGCOUNT': '43.000'} [2023-02-25 13:43:34,321][36155] DAMAGECOUNT value on done: 436683.0 [2023-02-25 13:43:34,322][36155] Sum rewards: 69.008, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.462', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.128', 'weapon2': '0.246', 'WEAPON4': '0.300', 'weapon4': '0.540', 'WEAPON3': '0.900', 'weapon3': '2.854', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.456', 'FRAGCOUNT': '57.000'} [2023-02-25 13:43:34,728][36139] DAMAGECOUNT value on done: 436016.0 [2023-02-25 13:43:34,728][36139] Sum rewards: 46.051, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.887', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.096', 'AMMO3': '0.141', 'AMMO4': '0.179', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON4': '0.500', 'WEAPON3': '0.850', 'weapon4': '1.034', 'weapon3': '2.336', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '11.721', 'FRAGCOUNT': '39.000'} [2023-02-25 13:43:34,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13426.5). Total num frames: 175706112. Throughput: 0: 3355.5. Samples: 6424936. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:43:34,730][36114] Avg episode reward: [(0, '53.087')] [2023-02-25 13:43:34,904][36155] DAMAGECOUNT value on done: 431052.0 [2023-02-25 13:43:34,904][36155] Sum rewards: 45.453, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.100', 'AMMO5': '0.005', 'AMMO2': '0.049', 'weapon5': '0.096', 'WEAPON5': '0.100', 'weapon2': '0.170', 'AMMO3': '0.172', 'AMMO4': '0.243', 'WEAPON4': '0.250', 'weapon4': '0.954', 'WEAPON3': '1.100', 'weapon3': '2.514', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.570', 'FRAGCOUNT': '39.000'} [2023-02-25 13:43:35,049][36139] DAMAGECOUNT value on done: 428270.0 [2023-02-25 13:43:35,050][36139] Sum rewards: 37.639, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.754', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.092', 'weapon7': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.124', 'WEAPON5': '0.150', 'weapon2': '0.180', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.510', 'WEAPON3': '0.800', 'HITCOUNT': '1.880', 'weapon3': '2.072', 'DAMAGECOUNT': '9.201', 'FRAGCOUNT': '32.500'} [2023-02-25 13:43:35,218][36155] DAMAGECOUNT value on done: 427452.0 [2023-02-25 13:43:35,219][36155] Sum rewards: 50.687, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.890', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.164', 'AMMO3': '0.173', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.282', 'weapon4': '0.342', 'WEAPON3': '1.150', 'HITCOUNT': '2.880', 'weapon3': '3.012', 'DAMAGECOUNT': '13.230', 'FRAGCOUNT': '43.000'} [2023-02-25 13:43:35,628][36139] DAMAGECOUNT value on done: 430004.0 [2023-02-25 13:43:35,628][36139] Sum rewards: 46.112, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.966', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.045', 'weapon5': '0.182', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.384', 'weapon4': '0.466', 'WEAPON3': '1.200', 'weapon3': '2.690', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.150', 'FRAGCOUNT': '41.000'} [2023-02-25 13:43:35,915][36141] Large shaping reward 2.557 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.525, 175.0), ('weapon5', 0.002)] [2023-02-25 13:43:35,929][36139] DAMAGECOUNT value on done: 431670.0 [2023-02-25 13:43:35,930][36139] Sum rewards: 49.642, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.884', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.136', 'weapon2': '0.230', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'weapon4': '0.268', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.830', 'weapon3': '3.100', 'DAMAGECOUNT': '12.882', 'FRAGCOUNT': '45.000'} [2023-02-25 13:43:36,048][36139] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 13:43:36,304][36138] Updated weights for policy 0, policy_version 42903 (0.0009) [2023-02-25 13:43:39,337][36138] Updated weights for policy 0, policy_version 42913 (0.0009) [2023-02-25 13:43:39,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13426.6). Total num frames: 175775744. Throughput: 0: 3352.3. Samples: 6434814. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:43:39,729][36114] Avg episode reward: [(0, '52.761')] [2023-02-25 13:43:41,223][36154] DAMAGECOUNT value on done: 433730.0 [2023-02-25 13:43:41,224][36154] Sum rewards: 46.907, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-5.790', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon5': '0.086', 'AMMO4': '0.090', 'weapon2': '0.150', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'AMMO3': '0.308', 'weapon4': '0.360', 'WEAPON3': '1.900', 'HITCOUNT': '2.850', 'weapon3': '3.174', 'DAMAGECOUNT': '13.755', 'FRAGCOUNT': '46.000'} [2023-02-25 13:43:41,543][36154] DAMAGECOUNT value on done: 427349.0 [2023-02-25 13:43:41,544][36154] Sum rewards: 60.276, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.168', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon2': '0.134', 'weapon4': '0.146', 'weapon5': '0.174', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.130', 'weapon3': '3.282', 'DAMAGECOUNT': '15.888', 'FRAGCOUNT': '51.000'} [2023-02-25 13:43:41,864][36154] DAMAGECOUNT value on done: 428418.0 [2023-02-25 13:43:41,865][36154] Sum rewards: 47.668, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.389', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.100', 'weapon2': '0.206', 'weapon4': '0.220', 'AMMO3': '0.294', 'WEAPON3': '1.700', 'HITCOUNT': '3.000', 'weapon3': '3.200', 'DAMAGECOUNT': '13.821', 'FRAGCOUNT': '45.000'} [2023-02-25 13:43:42,159][36154] DAMAGECOUNT value on done: 431398.0 [2023-02-25 13:43:42,160][36154] Sum rewards: 57.902, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.645', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.016', 'AMMO4': '0.061', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'weapon2': '0.386', 'WEAPON3': '1.050', 'HITCOUNT': '3.020', 'weapon3': '3.388', 'DAMAGECOUNT': '14.121', 'FRAGCOUNT': '47.500'} [2023-02-25 13:43:42,375][36138] Updated weights for policy 0, policy_version 42923 (0.0009) [2023-02-25 13:43:42,424][36141] DAMAGECOUNT value on done: 440600.0 [2023-02-25 13:43:42,424][36141] Sum rewards: 59.477, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.791', 'AMMO5': '0.016', 'AMMO2': '0.044', 'AMMO3': '0.179', 'weapon5': '0.214', 'weapon4': '0.220', 'AMMO4': '0.222', 'weapon2': '0.334', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.890', 'weapon3': '2.934', 'DAMAGECOUNT': '15.465', 'FRAGCOUNT': '52.000'} [2023-02-25 13:43:42,744][36141] DAMAGECOUNT value on done: 437720.0 [2023-02-25 13:43:42,744][36141] Sum rewards: 53.392, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.264', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon4': '0.394', 'weapon2': '0.398', 'WEAPON3': '1.250', 'weapon3': '2.892', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.830', 'FRAGCOUNT': '46.000'} [2023-02-25 13:43:42,796][36141] DAMAGECOUNT value on done: 428237.0 [2023-02-25 13:43:42,796][36141] Sum rewards: 43.591, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.818', 'AMMO5': '0.012', 'AMMO2': '0.023', 'ARMOR': '0.036', 'AMMO4': '0.116', 'weapon5': '0.154', 'AMMO3': '0.164', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.664', 'weapon4': '0.714', 'WEAPON3': '1.000', 'weapon3': '1.916', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '12.339', 'FRAGCOUNT': '37.000'} [2023-02-25 13:43:43,087][36141] DAMAGECOUNT value on done: 420757.0 [2023-02-25 13:43:43,087][36141] Sum rewards: 56.533, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.978', 'AMMO5': '0.021', 'AMMO2': '0.047', 'AMMO3': '0.183', 'AMMO4': '0.234', 'weapon5': '0.260', 'weapon2': '0.294', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.568', 'WEAPON3': '1.100', 'weapon3': '2.580', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '14.484', 'FRAGCOUNT': '49.000'} [2023-02-25 13:43:43,254][36157] DAMAGECOUNT value on done: 441166.0 [2023-02-25 13:43:43,254][36157] Sum rewards: 42.376, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.460', 'AMMO5': '0.015', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon2': '0.172', 'weapon5': '0.226', 'AMMO3': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.632', 'WEAPON3': '1.400', 'weapon3': '2.542', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.482', 'FRAGCOUNT': '39.000'} [2023-02-25 13:43:43,592][36157] DAMAGECOUNT value on done: 433254.0 [2023-02-25 13:43:43,592][36157] Sum rewards: 52.452, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.800', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.044', 'AMMO3': '0.142', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'weapon4': '0.310', 'WEAPON4': '0.350', 'weapon2': '0.676', 'WEAPON3': '1.000', 'weapon3': '2.802', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.662', 'FRAGCOUNT': '44.000'} [2023-02-25 13:43:44,133][36157] DAMAGECOUNT value on done: 434518.0 [2023-02-25 13:43:44,134][36157] Sum rewards: 52.758, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.860', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon5': '0.076', 'AMMO4': '0.109', 'AMMO3': '0.211', 'weapon2': '0.292', 'weapon4': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.900', 'weapon3': '3.036', 'DAMAGECOUNT': '13.311', 'FRAGCOUNT': '47.000'} [2023-02-25 13:43:44,443][36157] DAMAGECOUNT value on done: 438213.0 [2023-02-25 13:43:44,444][36157] Sum rewards: 60.721, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.984', 'AMMO2': '0.017', 'AMMO5': '0.020', 'AMMO4': '0.084', 'weapon5': '0.118', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'weapon4': '0.264', 'weapon2': '0.328', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.020', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.723', 'FRAGCOUNT': '54.000'} [2023-02-25 13:43:44,546][36140] DAMAGECOUNT value on done: 438607.0 [2023-02-25 13:43:44,546][36140] Sum rewards: 54.492, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.238', 'AMMO2': '0.005', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO4': '0.024', 'WEAPON5': '0.050', 'weapon2': '0.220', 'AMMO3': '0.242', 'WEAPON3': '1.450', 'HITCOUNT': '2.730', 'weapon3': '3.588', 'DAMAGECOUNT': '14.160', 'FRAGCOUNT': '47.500'} [2023-02-25 13:43:44,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13426.5). Total num frames: 175841280. Throughput: 0: 3353.1. Samples: 6454924. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:43:44,730][36114] Avg episode reward: [(0, '52.771')] [2023-02-25 13:43:44,855][36140] DAMAGECOUNT value on done: 426573.0 [2023-02-25 13:43:44,856][36140] Sum rewards: 60.248, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.808', 'AMMO2': '0.017', 'AMMO5': '0.019', 'AMMO4': '0.082', 'weapon4': '0.100', 'weapon5': '0.172', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'weapon2': '0.548', 'WEAPON3': '1.150', 'weapon3': '2.966', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.493', 'FRAGCOUNT': '52.000'} [2023-02-25 13:43:45,096][36140] DAMAGECOUNT value on done: 430214.0 [2023-02-25 13:43:45,096][36140] Sum rewards: 69.571, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.588', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.116', 'AMMO4': '0.164', 'weapon5': '0.188', 'weapon2': '0.204', 'AMMO3': '0.221', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.238', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '60.000'} [2023-02-25 13:43:45,223][36156] DAMAGECOUNT value on done: 437206.0 [2023-02-25 13:43:45,223][36156] Sum rewards: 52.423, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.187', 'AMMO5': '0.012', 'AMMO2': '0.044', 'AMMO3': '0.195', 'AMMO4': '0.219', 'weapon5': '0.262', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON4': '0.450', 'weapon4': '0.614', 'WEAPON3': '1.200', 'weapon3': '2.418', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '46.000'} [2023-02-25 13:43:45,283][36142] DAMAGECOUNT value on done: 429123.0 [2023-02-25 13:43:45,283][36142] Sum rewards: 54.687, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.570', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.137', 'AMMO3': '0.194', 'weapon2': '0.324', 'weapon5': '0.344', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.728', 'WEAPON3': '1.200', 'weapon3': '2.314', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.022', 'FRAGCOUNT': '47.000'} [2023-02-25 13:43:45,288][36156] DAMAGECOUNT value on done: 438875.0 [2023-02-25 13:43:45,288][36156] Sum rewards: 39.404, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.796', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO2': '0.063', 'AMMO3': '0.208', 'weapon5': '0.228', 'AMMO4': '0.313', 'weapon2': '0.372', 'ARMOR': '0.404', 'WEAPON5': '0.550', 'WEAPON4': '0.550', 'weapon4': '0.574', 'WEAPON3': '1.200', 'weapon3': '2.394', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '11.613', 'FRAGCOUNT': '38.500'} [2023-02-25 13:43:45,401][36140] DAMAGECOUNT value on done: 424454.0 [2023-02-25 13:43:45,401][36140] Sum rewards: 46.979, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.345', 'AMMO5': '0.026', 'AMMO2': '0.046', 'weapon2': '0.214', 'AMMO3': '0.219', 'AMMO4': '0.228', 'weapon5': '0.228', 'weapon4': '0.460', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.772', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.951', 'FRAGCOUNT': '45.000'} [2023-02-25 13:43:45,476][36138] Updated weights for policy 0, policy_version 42933 (0.0010) [2023-02-25 13:43:45,553][36156] DAMAGECOUNT value on done: 430770.0 [2023-02-25 13:43:45,554][36156] Sum rewards: 42.434, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.315', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.039', 'AMMO3': '0.123', 'AMMO4': '0.196', 'weapon5': '0.276', 'WEAPON4': '0.350', 'weapon4': '0.392', 'WEAPON5': '0.450', 'weapon2': '0.506', 'WEAPON3': '0.700', 'HITCOUNT': '2.230', 'weapon3': '2.370', 'DAMAGECOUNT': '10.338', 'FRAGCOUNT': '36.000'} [2023-02-25 13:43:45,601][36142] DAMAGECOUNT value on done: 422277.0 [2023-02-25 13:43:45,602][36142] Sum rewards: 52.544, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.522', 'AMMO5': '0.027', 'AMMO2': '0.051', 'AMMO3': '0.199', 'weapon5': '0.244', 'AMMO4': '0.255', 'weapon2': '0.258', 'weapon4': '0.338', 'WEAPON4': '0.500', 'WEAPON5': '0.650', 'WEAPON3': '1.100', 'HITCOUNT': '2.740', 'weapon3': '2.802', 'DAMAGECOUNT': '13.653', 'FRAGCOUNT': '47.000'} [2023-02-25 13:43:45,611][36142] DAMAGECOUNT value on done: 425819.0 [2023-02-25 13:43:45,611][36142] Sum rewards: 53.078, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.177', 'AMMO5': '0.011', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.082', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.264', 'weapon2': '0.418', 'WEAPON3': '1.450', 'weapon3': '2.990', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.058', 'FRAGCOUNT': '48.000'} [2023-02-25 13:43:45,621][36156] DAMAGECOUNT value on done: 433761.0 [2023-02-25 13:43:45,622][36156] Sum rewards: 55.695, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.786', 'AMMO5': '0.013', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.092', 'weapon4': '0.112', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'WEAPON5': '0.300', 'weapon2': '0.648', 'WEAPON3': '1.200', 'weapon3': '2.922', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.950', 'FRAGCOUNT': '49.000'} [2023-02-25 13:43:45,910][36142] DAMAGECOUNT value on done: 434772.0 [2023-02-25 13:43:45,911][36142] Sum rewards: 60.386, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.449', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.086', 'weapon4': '0.144', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon2': '0.394', 'WEAPON3': '1.200', 'weapon3': '3.230', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.009', 'FRAGCOUNT': '52.000'} [2023-02-25 13:43:48,517][36138] Updated weights for policy 0, policy_version 42943 (0.0009) [2023-02-25 13:43:49,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.2, 300 sec: 13412.7). Total num frames: 175906816. Throughput: 0: 3355.8. Samples: 6475072. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:43:49,730][36114] Avg episode reward: [(0, '53.002')] [2023-02-25 13:43:51,528][36138] Updated weights for policy 0, policy_version 42953 (0.0010) [2023-02-25 13:43:54,082][36155] DAMAGECOUNT value on done: 428357.0 [2023-02-25 13:43:54,082][36155] Sum rewards: 62.435, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.380', 'AMMO2': '0.018', 'AMMO5': '0.019', 'weapon4': '0.028', 'weapon5': '0.064', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'AMMO3': '0.211', 'WEAPON5': '0.350', 'weapon2': '0.464', 'WEAPON3': '1.150', 'HITCOUNT': '2.960', 'weapon3': '3.224', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '52.000'} [2023-02-25 13:43:54,400][36155] DAMAGECOUNT value on done: 441734.0 [2023-02-25 13:43:54,401][36155] Sum rewards: 55.627, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.509', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.007', 'weapon5': '0.080', 'weapon4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'weapon2': '0.568', 'WEAPON3': '1.450', 'weapon3': '3.066', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.153', 'FRAGCOUNT': '49.000'} [2023-02-25 13:43:54,578][36138] Updated weights for policy 0, policy_version 42963 (0.0009) [2023-02-25 13:43:54,716][36139] DAMAGECOUNT value on done: 441068.0 [2023-02-25 13:43:54,717][36139] Sum rewards: 56.293, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.454', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon4': '0.266', 'weapon2': '0.528', 'WEAPON3': '1.250', 'weapon3': '2.764', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.156', 'FRAGCOUNT': '49.000'} [2023-02-25 13:43:54,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 175976448. Throughput: 0: 3357.3. Samples: 6485160. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:43:54,730][36114] Avg episode reward: [(0, '53.204')] [2023-02-25 13:43:54,984][36155] DAMAGECOUNT value on done: 435887.0 [2023-02-25 13:43:54,984][36155] Sum rewards: 53.691, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.208', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.020', 'weapon5': '0.092', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon4': '0.206', 'weapon2': '0.208', 'WEAPON4': '0.250', 'WEAPON3': '1.150', 'HITCOUNT': '2.940', 'weapon3': '3.328', 'DAMAGECOUNT': '14.505', 'FRAGCOUNT': '45.500'} [2023-02-25 13:43:55,035][36139] DAMAGECOUNT value on done: 431607.0 [2023-02-25 13:43:55,036][36139] Sum rewards: 39.397, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.336', 'AMMO2': '0.006', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.032', 'WEAPON4': '0.100', 'weapon5': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon4': '0.236', 'weapon2': '0.706', 'WEAPON3': '1.400', 'HITCOUNT': '2.230', 'weapon3': '2.728', 'DAMAGECOUNT': '10.011', 'FRAGCOUNT': '36.000'} [2023-02-25 13:43:55,298][36155] DAMAGECOUNT value on done: 431539.0 [2023-02-25 13:43:55,298][36155] Sum rewards: 43.529, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.814', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'AMMO2': '0.028', 'AMMO4': '0.137', 'weapon5': '0.196', 'AMMO3': '0.201', 'weapon2': '0.378', 'WEAPON4': '0.400', 'weapon4': '0.482', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.586', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.261', 'FRAGCOUNT': '40.000'} [2023-02-25 13:43:55,658][36139] DAMAGECOUNT value on done: 435512.0 [2023-02-25 13:43:55,658][36139] Sum rewards: 59.563, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.330', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.173', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon5': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.352', 'weapon4': '0.656', 'WEAPON3': '1.250', 'weapon3': '2.368', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '51.500'} [2023-02-25 13:43:55,970][36139] DAMAGECOUNT value on done: 436945.0 [2023-02-25 13:43:55,970][36139] Sum rewards: 57.454, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.852', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.124', 'AMMO4': '0.143', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.396', 'weapon4': '0.614', 'WEAPON3': '0.950', 'weapon3': '2.578', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.825', 'FRAGCOUNT': '47.000'} [2023-02-25 13:43:57,632][36138] Updated weights for policy 0, policy_version 42973 (0.0009) [2023-02-25 13:43:57,678][36154] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 13:43:59,729][36114] Fps is (10 sec: 13517.0, 60 sec: 13380.3, 300 sec: 13426.6). Total num frames: 176041984. Throughput: 0: 3355.7. Samples: 6505314. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:43:59,729][36114] Avg episode reward: [(0, '53.081')] [2023-02-25 13:44:00,667][36138] Updated weights for policy 0, policy_version 42983 (0.0009) [2023-02-25 13:44:01,276][36154] DAMAGECOUNT value on done: 438206.0 [2023-02-25 13:44:01,276][36154] Sum rewards: 56.761, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.050', 'weapon5': '0.056', 'AMMO3': '0.141', 'weapon4': '0.244', 'weapon2': '0.440', 'HEALTH': '0.701', 'WEAPON3': '0.850', 'HITCOUNT': '3.100', 'weapon3': '3.138', 'DAMAGECOUNT': '13.428', 'FRAGCOUNT': '45.000'} [2023-02-25 13:44:01,570][36154] DAMAGECOUNT value on done: 431579.0 [2023-02-25 13:44:01,571][36154] Sum rewards: 47.368, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.236', 'AMMO2': '0.014', 'AMMO5': '0.015', 'AMMO4': '0.070', 'AMMO3': '0.161', 'WEAPON4': '0.250', 'weapon5': '0.252', 'weapon2': '0.332', 'WEAPON5': '0.400', 'weapon4': '0.484', 'WEAPON3': '0.950', 'weapon3': '2.656', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.690', 'FRAGCOUNT': '40.000'} [2023-02-25 13:44:01,904][36154] DAMAGECOUNT value on done: 432555.0 [2023-02-25 13:44:01,904][36154] Sum rewards: 44.320, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.584', 'AMMO5': '0.010', 'AMMO2': '0.041', 'AMMO3': '0.155', 'AMMO4': '0.204', 'weapon5': '0.210', 'WEAPON5': '0.300', 'weapon4': '0.398', 'WEAPON4': '0.400', 'weapon2': '0.938', 'WEAPON3': '1.000', 'weapon3': '2.224', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '12.324', 'FRAGCOUNT': '41.000'} [2023-02-25 13:44:02,212][36154] DAMAGECOUNT value on done: 436436.0 [2023-02-25 13:44:02,213][36154] Sum rewards: 58.342, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.790', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.042', 'weapon5': '0.050', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.228', 'AMMO3': '0.246', 'weapon4': '0.254', 'WEAPON3': '1.600', 'weapon3': '3.252', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.114', 'FRAGCOUNT': '52.000'} [2023-02-25 13:44:02,405][36141] DAMAGECOUNT value on done: 445377.0 [2023-02-25 13:44:02,406][36141] Sum rewards: 56.349, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.194', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.088', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon4': '0.248', 'WEAPON4': '0.300', 'weapon2': '0.588', 'WEAPON3': '1.250', 'weapon3': '2.852', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.331', 'FRAGCOUNT': '51.000'} [2023-02-25 13:44:02,712][36141] DAMAGECOUNT value on done: 442443.0 [2023-02-25 13:44:02,713][36141] Sum rewards: 51.997, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.225', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.102', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.254', 'weapon2': '0.274', 'WEAPON3': '1.300', 'HITCOUNT': '2.940', 'weapon3': '3.168', 'DAMAGECOUNT': '14.169', 'FRAGCOUNT': '45.000'} [2023-02-25 13:44:02,768][36141] DAMAGECOUNT value on done: 432306.0 [2023-02-25 13:44:02,769][36141] Sum rewards: 49.055, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.496', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.021', 'weapon5': '0.074', 'WEAPON5': '0.100', 'weapon4': '0.102', 'AMMO4': '0.103', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon2': '0.474', 'WEAPON3': '1.100', 'HITCOUNT': '2.520', 'weapon3': '3.212', 'DAMAGECOUNT': '12.207', 'FRAGCOUNT': '43.000'} [2023-02-25 13:44:03,072][36141] DAMAGECOUNT value on done: 425462.0 [2023-02-25 13:44:03,072][36141] Sum rewards: 51.430, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.673', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.064', 'weapon4': '0.100', 'AMMO4': '0.182', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.608', 'WEAPON3': '1.150', 'HITCOUNT': '2.810', 'weapon3': '3.016', 'DAMAGECOUNT': '14.115', 'FRAGCOUNT': '45.000'} [2023-02-25 13:44:03,226][36157] DAMAGECOUNT value on done: 446048.0 [2023-02-25 13:44:03,227][36157] Sum rewards: 55.972, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.005', 'AMMO5': '0.015', 'AMMO2': '0.029', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'AMMO4': '0.146', 'WEAPON5': '0.350', 'weapon5': '0.350', 'weapon4': '0.518', 'WEAPON3': '0.650', 'weapon2': '0.740', 'weapon3': '2.164', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.646', 'FRAGCOUNT': '43.000'} [2023-02-25 13:44:03,537][36157] DAMAGECOUNT value on done: 437729.0 [2023-02-25 13:44:03,537][36157] Sum rewards: 58.800, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.600', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'WEAPON5': '0.250', 'weapon4': '0.252', 'weapon2': '0.480', 'WEAPON3': '0.950', 'weapon3': '2.988', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.425', 'FRAGCOUNT': '48.000'} [2023-02-25 13:44:03,711][36138] Updated weights for policy 0, policy_version 42993 (0.0010) [2023-02-25 13:44:04,071][36157] DAMAGECOUNT value on done: 439568.0 [2023-02-25 13:44:04,071][36157] Sum rewards: 58.232, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.192', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'weapon4': '0.310', 'weapon2': '0.330', 'WEAPON3': '1.300', 'weapon3': '2.986', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.150', 'FRAGCOUNT': '50.500'} [2023-02-25 13:44:04,391][36157] DAMAGECOUNT value on done: 442847.0 [2023-02-25 13:44:04,392][36157] Sum rewards: 52.481, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.672', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.142', 'AMMO4': '0.186', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.480', 'weapon2': '0.728', 'WEAPON3': '1.250', 'weapon3': '2.298', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.902', 'FRAGCOUNT': '48.000'} [2023-02-25 13:44:04,424][36140] DAMAGECOUNT value on done: 443222.0 [2023-02-25 13:44:04,424][36140] Sum rewards: 50.951, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.438', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.102', 'AMMO3': '0.155', 'AMMO4': '0.159', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.332', 'weapon4': '0.638', 'WEAPON3': '1.000', 'weapon3': '2.676', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.845', 'FRAGCOUNT': '42.000'} [2023-02-25 13:44:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 176111616. Throughput: 0: 3354.6. Samples: 6525500. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:44:04,730][36114] Avg episode reward: [(0, '52.589')] [2023-02-25 13:44:04,738][36140] DAMAGECOUNT value on done: 431642.0 [2023-02-25 13:44:04,738][36140] Sum rewards: 59.558, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.000', 'AMMO5': '0.004', 'AMMO2': '0.021', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'weapon2': '0.232', 'weapon4': '0.364', 'WEAPON3': '1.100', 'HITCOUNT': '3.040', 'weapon3': '3.230', 'DAMAGECOUNT': '15.207', 'FRAGCOUNT': '49.000'} [2023-02-25 13:44:04,966][36140] DAMAGECOUNT value on done: 433650.0 [2023-02-25 13:44:04,966][36140] Sum rewards: 42.253, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.620', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.110', 'AMMO3': '0.123', 'AMMO4': '0.148', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '0.750', 'weapon4': '0.780', 'weapon2': '1.192', 'weapon3': '1.748', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '10.308', 'FRAGCOUNT': '36.000'} [2023-02-25 13:44:05,136][36156] DAMAGECOUNT value on done: 441584.0 [2023-02-25 13:44:05,137][36156] Sum rewards: 52.285, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.398', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.178', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.290', 'weapon4': '0.392', 'WEAPON3': '1.200', 'weapon3': '2.926', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.134', 'FRAGCOUNT': '46.000'} [2023-02-25 13:44:05,213][36156] DAMAGECOUNT value on done: 444355.0 [2023-02-25 13:44:05,214][36156] Sum rewards: 71.291, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.320', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.206', 'weapon2': '0.250', 'weapon4': '0.292', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.244', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '62.000'} [2023-02-25 13:44:05,271][36140] DAMAGECOUNT value on done: 428949.0 [2023-02-25 13:44:05,271][36140] Sum rewards: 56.661, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.540', 'AMMO2': '0.002', 'AMMO5': '0.006', 'AMMO4': '0.010', 'weapon2': '0.082', 'weapon5': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'weapon4': '0.200', 'WEAPON3': '1.050', 'HITCOUNT': '2.790', 'weapon3': '3.518', 'DAMAGECOUNT': '13.485', 'FRAGCOUNT': '47.000'} [2023-02-25 13:44:05,341][36142] DAMAGECOUNT value on done: 433288.0 [2023-02-25 13:44:05,342][36142] Sum rewards: 40.537, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.820', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.074', 'WEAPON5': '0.100', 'weapon2': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.238', 'weapon4': '0.388', 'WEAPON3': '1.450', 'HITCOUNT': '2.730', 'weapon3': '2.962', 'DAMAGECOUNT': '12.495', 'FRAGCOUNT': '37.500'} [2023-02-25 13:44:05,465][36156] DAMAGECOUNT value on done: 435831.0 [2023-02-25 13:44:05,466][36156] Sum rewards: 58.807, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.502', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO5': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'weapon5': '0.118', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'weapon4': '0.266', 'weapon2': '0.360', 'WEAPON3': '1.050', 'weapon3': '2.884', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.613', 'FRAGCOUNT': '48.000'} [2023-02-25 13:44:05,551][36156] DAMAGECOUNT value on done: 437135.0 [2023-02-25 13:44:05,551][36156] Sum rewards: 38.622, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.448', 'AMMO5': '0.023', 'AMMO2': '0.027', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.122', 'AMMO4': '0.134', 'AMMO3': '0.164', 'weapon7': '0.192', 'WEAPON7': '0.200', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon2': '0.502', 'weapon4': '0.892', 'WEAPON3': '0.950', 'weapon3': '1.942', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '10.122', 'FRAGCOUNT': '34.000'} [2023-02-25 13:44:05,653][36142] DAMAGECOUNT value on done: 426737.0 [2023-02-25 13:44:05,653][36142] Sum rewards: 54.890, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.630', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.050', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'weapon2': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'WEAPON3': '1.200', 'HITCOUNT': '2.780', 'weapon3': '3.622', 'DAMAGECOUNT': '13.380', 'FRAGCOUNT': '48.000'} [2023-02-25 13:44:05,662][36142] DAMAGECOUNT value on done: 430320.0 [2023-02-25 13:44:05,663][36142] Sum rewards: 51.265, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.690', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.054', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon2': '0.270', 'AMMO3': '0.279', 'weapon4': '0.458', 'WEAPON3': '1.600', 'HITCOUNT': '2.950', 'weapon3': '2.956', 'DAMAGECOUNT': '13.503', 'FRAGCOUNT': '47.000'} [2023-02-25 13:44:05,970][36142] DAMAGECOUNT value on done: 439820.0 [2023-02-25 13:44:05,971][36142] Sum rewards: 55.461, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.094', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon4': '0.086', 'weapon5': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.196', 'AMMO3': '0.275', 'WEAPON3': '1.650', 'HITCOUNT': '3.130', 'weapon3': '3.396', 'DAMAGECOUNT': '15.144', 'FRAGCOUNT': '50.000'} [2023-02-25 13:44:06,774][36138] Updated weights for policy 0, policy_version 43003 (0.0009) [2023-02-25 13:44:09,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 176177152. Throughput: 0: 3359.6. Samples: 6535708. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:44:09,730][36114] Avg episode reward: [(0, '52.260')] [2023-02-25 13:44:09,829][36138] Updated weights for policy 0, policy_version 43013 (0.0009) [2023-02-25 13:44:12,858][36138] Updated weights for policy 0, policy_version 43023 (0.0010) [2023-02-25 13:44:14,153][36155] DAMAGECOUNT value on done: 433159.0 [2023-02-25 13:44:14,154][36155] Sum rewards: 53.120, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.523', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.046', 'AMMO3': '0.163', 'weapon2': '0.194', 'weapon5': '0.202', 'AMMO4': '0.231', 'WEAPON5': '0.250', 'WEAPON4': '0.550', 'WEAPON3': '0.950', 'weapon4': '1.418', 'weapon3': '1.888', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.406', 'FRAGCOUNT': '46.000'} [2023-02-25 13:44:14,450][36155] DAMAGECOUNT value on done: 445713.0 [2023-02-25 13:44:14,450][36155] Sum rewards: 45.792, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.782', 'AMMO5': '0.023', 'AMMO2': '0.070', 'AMMO3': '0.144', 'weapon5': '0.334', 'AMMO4': '0.350', 'WEAPON5': '0.500', 'weapon2': '0.574', 'WEAPON4': '0.600', 'WEAPON3': '0.800', 'weapon4': '1.024', 'weapon3': '1.728', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '11.937', 'FRAGCOUNT': '41.000'} [2023-02-25 13:44:14,480][36139] DAMAGECOUNT value on done: 445801.0 [2023-02-25 13:44:14,480][36139] Sum rewards: 58.916, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.138', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'weapon5': '0.020', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'weapon4': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'weapon2': '0.332', 'WEAPON3': '1.300', 'HITCOUNT': '3.030', 'weapon3': '3.238', 'DAMAGECOUNT': '14.199', 'FRAGCOUNT': '52.000'} [2023-02-25 13:44:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 176246784. Throughput: 0: 3358.1. Samples: 6555912. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:44:14,730][36114] Avg episode reward: [(0, '52.277')] [2023-02-25 13:44:14,791][36139] DAMAGECOUNT value on done: 436366.0 [2023-02-25 13:44:14,791][36139] Sum rewards: 54.638, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.051', 'AMMO2': '0.008', 'AMMO5': '0.013', 'weapon4': '0.016', 'AMMO4': '0.037', 'weapon5': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.182', 'WEAPON5': '0.300', 'weapon2': '0.432', 'WEAPON3': '1.300', 'HITCOUNT': '2.980', 'weapon3': '3.216', 'DAMAGECOUNT': '14.277', 'FRAGCOUNT': '46.000'} [2023-02-25 13:44:15,025][36155] DAMAGECOUNT value on done: 440660.0 [2023-02-25 13:44:15,025][36155] Sum rewards: 57.859, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.810', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.022', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO3': '0.204', 'weapon2': '0.750', 'WEAPON3': '1.250', 'HITCOUNT': '2.930', 'weapon3': '2.984', 'DAMAGECOUNT': '14.319', 'FRAGCOUNT': '49.000'} [2023-02-25 13:44:15,324][36155] DAMAGECOUNT value on done: 435955.0 [2023-02-25 13:44:15,325][36155] Sum rewards: 46.581, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.194', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.154', 'AMMO4': '0.167', 'AMMO3': '0.247', 'WEAPON5': '0.250', 'weapon4': '0.338', 'WEAPON4': '0.400', 'weapon2': '0.552', 'WEAPON3': '1.350', 'weapon3': '2.678', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.248', 'FRAGCOUNT': '46.000'} [2023-02-25 13:44:15,413][36139] DAMAGECOUNT value on done: 439954.0 [2023-02-25 13:44:15,414][36139] Sum rewards: 53.228, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.386', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'AMMO4': '0.162', 'weapon2': '0.344', 'WEAPON4': '0.350', 'weapon4': '0.708', 'WEAPON3': '0.850', 'weapon3': '2.632', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '13.326', 'FRAGCOUNT': '44.000'} [2023-02-25 13:44:15,723][36139] DAMAGECOUNT value on done: 440846.0 [2023-02-25 13:44:15,723][36139] Sum rewards: 42.795, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.490', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.030', 'AMMO4': '0.147', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.264', 'weapon2': '0.304', 'weapon4': '0.320', 'WEAPON3': '1.250', 'HITCOUNT': '2.420', 'weapon3': '2.630', 'DAMAGECOUNT': '11.703', 'FRAGCOUNT': '39.000'} [2023-02-25 13:44:15,939][36138] Updated weights for policy 0, policy_version 43033 (0.0010) [2023-02-25 13:44:18,931][36138] Updated weights for policy 0, policy_version 43043 (0.0009) [2023-02-25 13:44:19,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13426.6). Total num frames: 176312320. Throughput: 0: 3359.9. Samples: 6576130. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:44:19,729][36114] Avg episode reward: [(0, '52.445')] [2023-02-25 13:44:21,231][36154] DAMAGECOUNT value on done: 441994.0 [2023-02-25 13:44:21,231][36154] Sum rewards: 45.667, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.605', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.042', 'weapon5': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'weapon4': '0.268', 'weapon2': '0.664', 'WEAPON3': '1.150', 'HITCOUNT': '2.620', 'weapon3': '2.782', 'DAMAGECOUNT': '11.364', 'FRAGCOUNT': '39.000'} [2023-02-25 13:44:21,385][36142] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:44:21,541][36154] DAMAGECOUNT value on done: 436060.0 [2023-02-25 13:44:21,542][36154] Sum rewards: 51.793, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.974', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'weapon2': '0.590', 'weapon4': '0.616', 'WEAPON3': '1.150', 'weapon3': '2.556', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.443', 'FRAGCOUNT': '43.000'} [2023-02-25 13:44:21,859][36154] DAMAGECOUNT value on done: 438111.0 [2023-02-25 13:44:21,860][36154] Sum rewards: 61.108, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.720', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.194', 'AMMO4': '0.222', 'weapon5': '0.232', 'weapon2': '0.270', 'AMMO3': '0.292', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'weapon3': '2.984', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '57.000'} [2023-02-25 13:44:21,993][36138] Updated weights for policy 0, policy_version 43053 (0.0010) [2023-02-25 13:44:22,182][36154] DAMAGECOUNT value on done: 441590.0 [2023-02-25 13:44:22,183][36154] Sum rewards: 64.198, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.810', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.048', 'AMMO4': '0.070', 'weapon5': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'weapon2': '0.480', 'WEAPON3': '1.000', 'weapon3': '3.142', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.462', 'FRAGCOUNT': '53.000'} [2023-02-25 13:44:22,352][36141] DAMAGECOUNT value on done: 449487.0 [2023-02-25 13:44:22,353][36141] Sum rewards: 49.927, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO3': '0.138', 'AMMO4': '0.193', 'weapon5': '0.232', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'HEALTH': '0.486', 'weapon2': '0.512', 'WEAPON3': '0.700', 'weapon4': '0.846', 'weapon3': '2.006', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.330', 'FRAGCOUNT': '40.000'} [2023-02-25 13:44:22,651][36141] DAMAGECOUNT value on done: 436442.0 [2023-02-25 13:44:22,652][36141] Sum rewards: 49.787, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.416', 'AMMO5': '0.005', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon5': '0.114', 'WEAPON5': '0.150', 'weapon4': '0.154', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'weapon2': '0.604', 'WEAPON3': '1.000', 'HITCOUNT': '2.320', 'weapon3': '2.946', 'DAMAGECOUNT': '12.408', 'FRAGCOUNT': '43.000'} [2023-02-25 13:44:22,662][36141] DAMAGECOUNT value on done: 446779.0 [2023-02-25 13:44:22,663][36141] Sum rewards: 44.103, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.040', 'weapon7': '0.016', 'AMMO2': '0.022', 'AMMO5': '0.022', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.110', 'weapon5': '0.164', 'AMMO3': '0.198', 'WEAPON4': '0.400', 'weapon2': '0.418', 'WEAPON5': '0.550', 'weapon4': '0.674', 'WEAPON3': '1.250', 'weapon3': '2.410', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.008', 'FRAGCOUNT': '39.000'} [2023-02-25 13:44:22,959][36141] DAMAGECOUNT value on done: 430464.0 [2023-02-25 13:44:22,960][36141] Sum rewards: 62.699, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.086', 'ARMOR': '0.004', 'AMMO2': '0.005', 'AMMO5': '0.015', 'AMMO4': '0.025', 'WEAPON4': '0.100', 'weapon4': '0.120', 'weapon5': '0.170', 'AMMO3': '0.184', 'weapon2': '0.374', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '3.060', 'weapon3': '3.172', 'DAMAGECOUNT': '15.006', 'FRAGCOUNT': '53.000'} [2023-02-25 13:44:23,317][36157] DAMAGECOUNT value on done: 452033.0 [2023-02-25 13:44:23,318][36157] Sum rewards: 68.635, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.712', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon7': '0.072', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'AMMO3': '0.212', 'weapon2': '0.256', 'weapon4': '0.548', 'WEAPON3': '1.200', 'weapon3': '2.754', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.355', 'FRAGCOUNT': '57.000'} [2023-02-25 13:44:23,625][36157] DAMAGECOUNT value on done: 442074.0 [2023-02-25 13:44:23,626][36157] Sum rewards: 42.924, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.592', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.045', 'AMMO4': '0.225', 'AMMO3': '0.261', 'weapon5': '0.302', 'weapon2': '0.320', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.526', 'WEAPON3': '1.550', 'weapon3': '2.440', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '13.035', 'FRAGCOUNT': '41.500'} [2023-02-25 13:44:24,183][36157] DAMAGECOUNT value on done: 444015.0 [2023-02-25 13:44:24,184][36157] Sum rewards: 43.622, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.028', 'AMMO5': '0.016', 'AMMO2': '0.054', 'AMMO3': '0.224', 'weapon5': '0.250', 'AMMO4': '0.271', 'weapon2': '0.302', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.688', 'WEAPON3': '1.250', 'weapon3': '2.404', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '13.341', 'FRAGCOUNT': '42.000'} [2023-02-25 13:44:24,219][36140] DAMAGECOUNT value on done: 448680.0 [2023-02-25 13:44:24,219][36140] Sum rewards: 55.294, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.096', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.118', 'AMMO4': '0.208', 'AMMO3': '0.272', 'WEAPON5': '0.300', 'weapon4': '0.356', 'WEAPON4': '0.400', 'weapon2': '0.448', 'WEAPON3': '1.650', 'weapon3': '2.800', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.374', 'FRAGCOUNT': '51.000'} [2023-02-25 13:44:24,483][36157] DAMAGECOUNT value on done: 446680.0 [2023-02-25 13:44:24,483][36157] Sum rewards: 48.255, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.155', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.078', 'AMMO4': '0.113', 'AMMO3': '0.167', 'weapon5': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.564', 'WEAPON3': '0.900', 'HITCOUNT': '2.440', 'weapon3': '2.976', 'DAMAGECOUNT': '11.499', 'FRAGCOUNT': '41.000'} [2023-02-25 13:44:24,526][36140] DAMAGECOUNT value on done: 435876.0 [2023-02-25 13:44:24,527][36140] Sum rewards: 46.244, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.373', 'AMMO5': '0.016', 'AMMO2': '0.050', 'AMMO3': '0.089', 'weapon5': '0.184', 'AMMO4': '0.252', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.600', 'weapon4': '0.672', 'weapon2': '0.894', 'weapon3': '2.078', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '12.702', 'FRAGCOUNT': '37.500'} [2023-02-25 13:44:24,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13426.6). Total num frames: 176377856. Throughput: 0: 3363.9. Samples: 6586188. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:44:24,729][36114] Avg episode reward: [(0, '52.236')] [2023-02-25 13:44:24,802][36140] DAMAGECOUNT value on done: 438117.0 [2023-02-25 13:44:24,802][36140] Sum rewards: 50.708, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.082', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.007', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.152', 'weapon4': '0.224', 'weapon2': '0.650', 'WEAPON3': '0.950', 'HITCOUNT': '2.710', 'weapon3': '2.946', 'DAMAGECOUNT': '13.401', 'FRAGCOUNT': '42.000'} [2023-02-25 13:44:25,061][36138] Updated weights for policy 0, policy_version 43063 (0.0010) [2023-02-25 13:44:25,096][36140] DAMAGECOUNT value on done: 434197.0 [2023-02-25 13:44:25,097][36140] Sum rewards: 61.544, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.805', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.176', 'weapon4': '0.272', 'weapon2': '0.604', 'WEAPON3': '1.100', 'weapon3': '2.912', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.744', 'FRAGCOUNT': '50.000'} [2023-02-25 13:44:25,185][36142] DAMAGECOUNT value on done: 437639.0 [2023-02-25 13:44:25,186][36142] Sum rewards: 43.538, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.370', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.046', 'AMMO3': '0.148', 'AMMO4': '0.230', 'weapon4': '0.268', 'weapon5': '0.370', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'weapon2': '0.698', 'WEAPON3': '0.950', 'weapon3': '2.352', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '13.053', 'FRAGCOUNT': '37.500'} [2023-02-25 13:44:25,190][36156] DAMAGECOUNT value on done: 446172.0 [2023-02-25 13:44:25,190][36156] Sum rewards: 49.733, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.510', 'ARMOR': '0.009', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'weapon5': '0.134', 'AMMO4': '0.142', 'AMMO3': '0.193', 'weapon2': '0.220', 'weapon4': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.910', 'weapon3': '3.186', 'DAMAGECOUNT': '13.764', 'FRAGCOUNT': '42.000'} [2023-02-25 13:44:25,259][36156] DAMAGECOUNT value on done: 448366.0 [2023-02-25 13:44:25,259][36156] Sum rewards: 43.324, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.076', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.222', 'WEAPON4': '0.250', 'AMMO3': '0.258', 'WEAPON5': '0.350', 'weapon4': '0.360', 'weapon2': '0.430', 'WEAPON3': '1.500', 'HITCOUNT': '2.420', 'weapon3': '2.734', 'DAMAGECOUNT': '12.018', 'FRAGCOUNT': '43.000'} [2023-02-25 13:44:25,479][36142] DAMAGECOUNT value on done: 431352.0 [2023-02-25 13:44:25,480][36142] Sum rewards: 50.179, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.794', 'AMMO5': '0.017', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.190', 'weapon5': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.404', 'weapon4': '0.638', 'WEAPON3': '1.100', 'weapon3': '2.440', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '13.845', 'FRAGCOUNT': '43.500'} [2023-02-25 13:44:25,489][36142] DAMAGECOUNT value on done: 434440.0 [2023-02-25 13:44:25,490][36142] Sum rewards: 50.355, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.100', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.009', 'weapon5': '0.046', 'AMMO4': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.145', 'WEAPON4': '0.300', 'weapon2': '0.500', 'weapon4': '0.726', 'WEAPON3': '0.950', 'weapon3': '2.586', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.360', 'FRAGCOUNT': '43.000'} [2023-02-25 13:44:25,501][36156] DAMAGECOUNT value on done: 439804.0 [2023-02-25 13:44:25,502][36156] Sum rewards: 41.875, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.257', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon4': '0.250', 'weapon2': '0.594', 'WEAPON3': '1.300', 'HITCOUNT': '2.700', 'weapon3': '2.792', 'DAMAGECOUNT': '11.919', 'FRAGCOUNT': '38.000'} [2023-02-25 13:44:25,570][36156] DAMAGECOUNT value on done: 441608.0 [2023-02-25 13:44:25,571][36156] Sum rewards: 48.152, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.620', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon5': '0.150', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.430', 'weapon4': '0.476', 'WEAPON3': '1.100', 'weapon3': '2.636', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.419', 'FRAGCOUNT': '43.000'} [2023-02-25 13:44:25,794][36142] DAMAGECOUNT value on done: 444941.0 [2023-02-25 13:44:25,795][36142] Sum rewards: 58.099, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.397', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.100', 'weapon5': '0.108', 'AMMO4': '0.119', 'AMMO3': '0.180', 'weapon2': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'HITCOUNT': '3.220', 'weapon3': '3.416', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '49.000'} [2023-02-25 13:44:28,038][36138] Updated weights for policy 0, policy_version 43073 (0.0010) [2023-02-25 13:44:29,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 176447488. Throughput: 0: 3368.8. Samples: 6606522. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:44:29,730][36114] Avg episode reward: [(0, '52.328')] [2023-02-25 13:44:30,397][36139] Large shaping reward 2.505 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.483, 161.0), ('weapon5', 0.002)] [2023-02-25 13:44:31,047][36138] Updated weights for policy 0, policy_version 43083 (0.0009) [2023-02-25 13:44:31,546][36140] Large shaping reward 2.511 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.489, 163.0), ('weapon5', 0.002)] [2023-02-25 13:44:33,846][36155] DAMAGECOUNT value on done: 436368.0 [2023-02-25 13:44:33,847][36155] Sum rewards: 36.133, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.516', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon7': '0.074', 'AMMO4': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.162', 'weapon2': '0.464', 'weapon4': '0.692', 'WEAPON3': '0.750', 'weapon3': '1.804', 'HITCOUNT': '1.970', 'DAMAGECOUNT': '9.627', 'FRAGCOUNT': '30.000'} [2023-02-25 13:44:34,069][36138] Updated weights for policy 0, policy_version 43093 (0.0009) [2023-02-25 13:44:34,158][36155] DAMAGECOUNT value on done: 449733.0 [2023-02-25 13:44:34,158][36155] Sum rewards: 50.168, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.162', 'AMMO5': '0.020', 'ARMOR': '0.020', 'AMMO2': '0.028', 'weapon4': '0.134', 'AMMO4': '0.142', 'weapon5': '0.154', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'weapon2': '0.312', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.450', 'weapon3': '3.180', 'DAMAGECOUNT': '12.060', 'FRAGCOUNT': '45.000'} [2023-02-25 13:44:34,466][36139] DAMAGECOUNT value on done: 451139.0 [2023-02-25 13:44:34,467][36139] Sum rewards: 62.458, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.252', 'AMMO2': '0.003', 'AMMO5': '0.009', 'AMMO4': '0.016', 'weapon5': '0.044', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.302', 'WEAPON3': '1.500', 'HITCOUNT': '3.240', 'weapon3': '3.400', 'DAMAGECOUNT': '16.014', 'FRAGCOUNT': '54.000'} [2023-02-25 13:44:34,721][36155] DAMAGECOUNT value on done: 445381.0 [2023-02-25 13:44:34,721][36155] Sum rewards: 50.557, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.225', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.027', 'weapon4': '0.098', 'AMMO4': '0.135', 'weapon5': '0.174', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'weapon2': '0.372', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.690', 'weapon3': '3.100', 'DAMAGECOUNT': '14.013', 'FRAGCOUNT': '43.500'} [2023-02-25 13:44:34,729][36114] Fps is (10 sec: 13926.4, 60 sec: 13516.8, 300 sec: 13440.4). Total num frames: 176517120. Throughput: 0: 3372.9. Samples: 6626852. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:44:34,729][36114] Avg episode reward: [(0, '52.179')] [2023-02-25 13:44:34,792][36139] DAMAGECOUNT value on done: 441023.0 [2023-02-25 13:44:34,792][36139] Sum rewards: 50.140, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.538', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon5': '0.094', 'AMMO4': '0.105', 'weapon4': '0.204', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.854', 'WEAPON3': '1.350', 'weapon3': '2.602', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.443', 'FRAGCOUNT': '46.000'} [2023-02-25 13:44:35,028][36155] DAMAGECOUNT value on done: 440167.0 [2023-02-25 13:44:35,029][36155] Sum rewards: 49.106, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.000', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.184', 'AMMO4': '0.186', 'AMMO3': '0.210', 'weapon4': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.390', 'ARMOR': '0.462', 'WEAPON3': '1.300', 'HITCOUNT': '2.630', 'weapon3': '2.876', 'DAMAGECOUNT': '12.591', 'FRAGCOUNT': '44.500'} [2023-02-25 13:44:35,405][36139] DAMAGECOUNT value on done: 445410.0 [2023-02-25 13:44:35,405][36139] Sum rewards: 65.575, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.975', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.039', 'AMMO4': '0.193', 'AMMO3': '0.202', 'weapon2': '0.238', 'weapon5': '0.312', 'WEAPON4': '0.500', 'weapon4': '0.562', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.560', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '56.000'} [2023-02-25 13:44:35,726][36139] DAMAGECOUNT value on done: 445324.0 [2023-02-25 13:44:35,727][36139] Sum rewards: 52.884, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.580', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.184', 'AMMO3': '0.199', 'AMMO4': '0.222', 'weapon2': '0.276', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.728', 'WEAPON3': '1.100', 'weapon3': '2.370', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '13.299', 'FRAGCOUNT': '47.000'} [2023-02-25 13:44:37,145][36138] Updated weights for policy 0, policy_version 43103 (0.0009) [2023-02-25 13:44:39,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 176582656. Throughput: 0: 3373.2. Samples: 6636952. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:44:39,730][36114] Avg episode reward: [(0, '52.235')] [2023-02-25 13:44:40,179][36138] Updated weights for policy 0, policy_version 43113 (0.0010) [2023-02-25 13:44:40,566][36154] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:44:41,128][36154] DAMAGECOUNT value on done: 445763.0 [2023-02-25 13:44:41,129][36154] Sum rewards: 47.992, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.970', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.082', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.310', 'weapon2': '0.592', 'WEAPON3': '1.050', 'HITCOUNT': '2.410', 'weapon3': '2.818', 'DAMAGECOUNT': '11.307', 'FRAGCOUNT': '42.000'} [2023-02-25 13:44:41,454][36154] DAMAGECOUNT value on done: 440365.0 [2023-02-25 13:44:41,454][36154] Sum rewards: 47.061, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.685', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.112', 'AMMO4': '0.198', 'weapon5': '0.206', 'AMMO3': '0.243', 'weapon2': '0.360', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.670', 'weapon3': '2.984', 'DAMAGECOUNT': '12.915', 'FRAGCOUNT': '45.000'} [2023-02-25 13:44:41,773][36154] DAMAGECOUNT value on done: 443781.0 [2023-02-25 13:44:41,774][36154] Sum rewards: 65.376, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.680', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon5': '0.082', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon4': '0.328', 'weapon2': '0.480', 'WEAPON3': '1.450', 'weapon3': '2.892', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '56.000'} [2023-02-25 13:44:42,083][36154] DAMAGECOUNT value on done: 446578.0 [2023-02-25 13:44:42,083][36154] Sum rewards: 57.730, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.390', 'AMMO5': '0.020', 'AMMO2': '0.056', 'AMMO3': '0.138', 'weapon5': '0.254', 'AMMO4': '0.281', 'WEAPON5': '0.400', 'weapon2': '0.420', 'WEAPON4': '0.500', 'weapon4': '0.632', 'WEAPON3': '0.800', 'weapon3': '2.384', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.964', 'FRAGCOUNT': '47.000'} [2023-02-25 13:44:42,263][36141] DAMAGECOUNT value on done: 454229.0 [2023-02-25 13:44:42,264][36141] Sum rewards: 54.322, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.286', 'AMMO5': '0.011', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon2': '0.114', 'weapon5': '0.154', 'weapon4': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '2.890', 'weapon3': '3.366', 'DAMAGECOUNT': '14.226', 'FRAGCOUNT': '47.000'} [2023-02-25 13:44:42,421][36156] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:44:42,562][36141] DAMAGECOUNT value on done: 440925.0 [2023-02-25 13:44:42,562][36141] Sum rewards: 46.827, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.225', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.142', 'weapon5': '0.186', 'AMMO4': '0.205', 'AMMO3': '0.244', 'weapon2': '0.252', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '2.610', 'weapon3': '3.150', 'DAMAGECOUNT': '13.398', 'FRAGCOUNT': '44.000'} [2023-02-25 13:44:42,583][36141] DAMAGECOUNT value on done: 451130.0 [2023-02-25 13:44:42,584][36141] Sum rewards: 48.272, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.380', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon5': '0.152', 'AMMO4': '0.168', 'AMMO3': '0.223', 'weapon2': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.406', 'WEAPON3': '1.300', 'HITCOUNT': '2.740', 'weapon3': '2.966', 'DAMAGECOUNT': '13.053', 'FRAGCOUNT': '43.500'} [2023-02-25 13:44:42,776][36155] Large shaping reward 2.559 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.537, 179.0), ('weapon5', 0.002)] [2023-02-25 13:44:42,878][36141] DAMAGECOUNT value on done: 435004.0 [2023-02-25 13:44:42,878][36141] Sum rewards: 49.989, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.133', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.102', 'weapon5': '0.116', 'AMMO4': '0.142', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.334', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '2.680', 'weapon3': '3.180', 'DAMAGECOUNT': '13.620', 'FRAGCOUNT': '46.000'} [2023-02-25 13:44:43,242][36138] Updated weights for policy 0, policy_version 43123 (0.0009) [2023-02-25 13:44:43,310][36157] DAMAGECOUNT value on done: 457546.0 [2023-02-25 13:44:43,310][36157] Sum rewards: 63.891, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.190', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon2': '0.154', 'weapon5': '0.222', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.526', 'WEAPON3': '1.450', 'weapon3': '2.798', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.539', 'FRAGCOUNT': '56.000'} [2023-02-25 13:44:43,620][36157] DAMAGECOUNT value on done: 446401.0 [2023-02-25 13:44:43,621][36157] Sum rewards: 52.756, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.114', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.198', 'AMMO3': '0.205', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.590', 'weapon4': '0.788', 'WEAPON3': '1.200', 'weapon3': '2.168', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '12.981', 'FRAGCOUNT': '47.000'} [2023-02-25 13:44:44,076][36140] DAMAGECOUNT value on done: 452909.0 [2023-02-25 13:44:44,077][36140] Sum rewards: 47.774, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.039', 'ARMOR': '0.004', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon4': '0.044', 'AMMO4': '0.077', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.254', 'WEAPON3': '1.250', 'HITCOUNT': '2.490', 'weapon3': '3.372', 'DAMAGECOUNT': '12.687', 'FRAGCOUNT': '43.000'} [2023-02-25 13:44:44,211][36157] DAMAGECOUNT value on done: 448811.0 [2023-02-25 13:44:44,211][36157] Sum rewards: 53.987, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.034', 'ARMOR': '0.008', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.100', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon2': '0.336', 'weapon4': '0.732', 'WEAPON3': '1.200', 'weapon3': '2.614', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.388', 'FRAGCOUNT': '47.000'} [2023-02-25 13:44:44,389][36140] DAMAGECOUNT value on done: 440865.0 [2023-02-25 13:44:44,390][36140] Sum rewards: 57.418, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.980', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon2': '0.190', 'AMMO3': '0.221', 'weapon5': '0.360', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.496', 'WEAPON3': '1.300', 'weapon3': '2.638', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.967', 'FRAGCOUNT': '51.000'} [2023-02-25 13:44:44,527][36157] DAMAGECOUNT value on done: 451661.0 [2023-02-25 13:44:44,528][36157] Sum rewards: 55.957, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.385', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO3': '0.161', 'AMMO4': '0.186', 'weapon5': '0.244', 'weapon2': '0.364', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.536', 'WEAPON3': '0.950', 'weapon3': '2.584', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '14.943', 'FRAGCOUNT': '48.000'} [2023-02-25 13:44:44,684][36140] DAMAGECOUNT value on done: 442430.0 [2023-02-25 13:44:44,685][36140] Sum rewards: 44.213, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.899', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon5': '0.090', 'AMMO4': '0.177', 'AMMO3': '0.228', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.364', 'weapon4': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.574', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.939', 'FRAGCOUNT': '40.000'} [2023-02-25 13:44:44,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 176648192. Throughput: 0: 3372.3. Samples: 6657066. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:44:44,730][36114] Avg episode reward: [(0, '52.596')] [2023-02-25 13:44:44,992][36140] DAMAGECOUNT value on done: 439120.0 [2023-02-25 13:44:44,992][36140] Sum rewards: 57.862, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.870', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.045', 'AMMO3': '0.178', 'AMMO4': '0.227', 'weapon2': '0.232', 'weapon4': '0.244', 'weapon5': '0.268', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'HITCOUNT': '2.690', 'weapon3': '3.004', 'DAMAGECOUNT': '14.769', 'FRAGCOUNT': '51.000'} [2023-02-25 13:44:45,071][36156] DAMAGECOUNT value on done: 451860.0 [2023-02-25 13:44:45,071][36156] Sum rewards: 57.951, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.468', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon2': '0.200', 'weapon5': '0.224', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'weapon4': '0.342', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '2.968', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '49.500'} [2023-02-25 13:44:45,139][36156] DAMAGECOUNT value on done: 453322.0 [2023-02-25 13:44:45,139][36156] Sum rewards: 50.409, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.080', 'AMMO5': '0.012', 'AMMO2': '0.049', 'AMMO3': '0.170', 'weapon2': '0.226', 'AMMO4': '0.243', 'weapon5': '0.328', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.876', 'WEAPON3': '0.950', 'weapon3': '2.256', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.868', 'FRAGCOUNT': '41.500'} [2023-02-25 13:44:45,202][36142] DAMAGECOUNT value on done: 442760.0 [2023-02-25 13:44:45,203][36142] Sum rewards: 58.101, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.217', 'AMMO5': '0.014', 'AMMO2': '0.037', 'AMMO4': '0.187', 'AMMO3': '0.192', 'weapon5': '0.202', 'weapon2': '0.226', 'weapon4': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '2.930', 'weapon3': '3.010', 'DAMAGECOUNT': '15.363', 'FRAGCOUNT': '50.000'} [2023-02-25 13:44:45,379][36156] DAMAGECOUNT value on done: 444192.0 [2023-02-25 13:44:45,379][36156] Sum rewards: 47.154, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.736', 'AMMO5': '0.015', 'AMMO2': '0.021', 'weapon5': '0.104', 'AMMO4': '0.106', 'weapon4': '0.172', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'weapon2': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '2.750', 'weapon3': '3.210', 'DAMAGECOUNT': '13.119', 'FRAGCOUNT': '42.000'} [2023-02-25 13:44:45,449][36156] DAMAGECOUNT value on done: 446207.0 [2023-02-25 13:44:45,449][36156] Sum rewards: 44.294, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.670', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon4': '0.062', 'AMMO4': '0.100', 'weapon2': '0.182', 'WEAPON4': '0.200', 'weapon5': '0.224', 'AMMO3': '0.274', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '2.730', 'weapon3': '3.242', 'DAMAGECOUNT': '13.797', 'FRAGCOUNT': '40.500'} [2023-02-25 13:44:45,511][36142] DAMAGECOUNT value on done: 435016.0 [2023-02-25 13:44:45,511][36142] Sum rewards: 43.823, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.076', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.050', 'AMMO3': '0.165', 'AMMO4': '0.248', 'weapon5': '0.296', 'WEAPON5': '0.350', 'weapon2': '0.494', 'WEAPON4': '0.550', 'weapon4': '0.704', 'WEAPON3': '0.950', 'weapon3': '2.216', 'HITCOUNT': '2.370', 'DAMAGECOUNT': '10.992', 'FRAGCOUNT': '40.000'} [2023-02-25 13:44:45,521][36142] DAMAGECOUNT value on done: 439203.0 [2023-02-25 13:44:45,522][36142] Sum rewards: 48.448, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.066', 'AMMO5': '0.029', 'AMMO2': '0.063', 'AMMO3': '0.237', 'weapon5': '0.250', 'AMMO4': '0.314', 'weapon2': '0.410', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon4': '0.646', 'WEAPON3': '1.350', 'weapon3': '2.346', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.289', 'FRAGCOUNT': '46.000'} [2023-02-25 13:44:45,832][36142] DAMAGECOUNT value on done: 449132.0 [2023-02-25 13:44:45,832][36142] Sum rewards: 47.285, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.090', 'AMMO5': '0.014', 'AMMO2': '0.046', 'AMMO3': '0.186', 'AMMO4': '0.230', 'weapon5': '0.302', 'weapon4': '0.370', 'WEAPON5': '0.450', 'weapon2': '0.498', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.576', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.573', 'FRAGCOUNT': '43.000'} [2023-02-25 13:44:46,324][36138] Updated weights for policy 0, policy_version 43133 (0.0009) [2023-02-25 13:44:46,681][36141] Large shaping reward 2.601 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.039, -13.0)] [2023-02-25 13:44:47,288][36140] Large shaping reward 2.517 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.105, -35.0), ('weapon5', 0.002)] [2023-02-25 13:44:49,360][36138] Updated weights for policy 0, policy_version 43143 (0.0009) [2023-02-25 13:44:49,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13440.4). Total num frames: 176717824. Throughput: 0: 3371.9. Samples: 6677236. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:44:49,730][36114] Avg episode reward: [(0, '52.340')] [2023-02-25 13:44:52,420][36138] Updated weights for policy 0, policy_version 43153 (0.0009) [2023-02-25 13:44:53,796][36155] DAMAGECOUNT value on done: 440653.0 [2023-02-25 13:44:53,797][36155] Sum rewards: 47.535, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.350', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.051', 'AMMO3': '0.220', 'weapon2': '0.222', 'weapon5': '0.242', 'AMMO4': '0.257', 'weapon4': '0.354', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'HITCOUNT': '2.690', 'weapon3': '2.868', 'DAMAGECOUNT': '12.855', 'FRAGCOUNT': '45.000'} [2023-02-25 13:44:54,103][36155] DAMAGECOUNT value on done: 454095.0 [2023-02-25 13:44:54,104][36155] Sum rewards: 49.523, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.634', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.154', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'weapon2': '0.366', 'WEAPON4': '0.400', 'weapon4': '0.674', 'WEAPON3': '1.300', 'weapon3': '2.556', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.086', 'FRAGCOUNT': '45.000'} [2023-02-25 13:44:54,386][36139] DAMAGECOUNT value on done: 455387.0 [2023-02-25 13:44:54,386][36139] Sum rewards: 53.849, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.549', 'AMMO5': '0.003', 'AMMO2': '0.008', 'ARMOR': '0.012', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'weapon4': '0.062', 'AMMO3': '0.169', 'weapon2': '0.818', 'WEAPON3': '1.000', 'HITCOUNT': '2.700', 'weapon3': '2.940', 'DAMAGECOUNT': '12.744', 'FRAGCOUNT': '45.000'} [2023-02-25 13:44:54,685][36139] DAMAGECOUNT value on done: 444600.0 [2023-02-25 13:44:54,685][36139] Sum rewards: 42.202, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.640', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon4': '0.126', 'AMMO3': '0.187', 'weapon5': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.960', 'WEAPON3': '1.150', 'HITCOUNT': '2.240', 'weapon3': '2.538', 'DAMAGECOUNT': '10.731', 'FRAGCOUNT': '38.000'} [2023-02-25 13:44:54,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13440.4). Total num frames: 176783360. Throughput: 0: 3368.0. Samples: 6687270. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:44:54,729][36114] Avg episode reward: [(0, '52.054')] [2023-02-25 13:44:54,736][36155] DAMAGECOUNT value on done: 450370.0 [2023-02-25 13:44:54,736][36155] Sum rewards: 54.152, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-5.020', 'AMMO5': '0.017', 'AMMO2': '0.067', 'AMMO3': '0.239', 'weapon2': '0.256', 'weapon5': '0.264', 'AMMO4': '0.333', 'weapon4': '0.376', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.762', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.748', 'FRAGCOUNT': '51.000'} [2023-02-25 13:44:55,043][36155] DAMAGECOUNT value on done: 444727.0 [2023-02-25 13:44:55,043][36155] Sum rewards: 52.320, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.470', 'AMMO5': '0.013', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.130', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.252', 'weapon4': '0.586', 'WEAPON3': '1.050', 'weapon3': '2.788', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.680', 'FRAGCOUNT': '45.000'} [2023-02-25 13:44:55,325][36139] DAMAGECOUNT value on done: 450086.0 [2023-02-25 13:44:55,325][36139] Sum rewards: 56.256, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.275', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.126', 'WEAPON4': '0.150', 'weapon4': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon2': '0.310', 'WEAPON3': '1.400', 'HITCOUNT': '2.890', 'weapon3': '3.176', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '50.000'} [2023-02-25 13:44:55,500][36138] Updated weights for policy 0, policy_version 43163 (0.0009) [2023-02-25 13:44:55,648][36139] DAMAGECOUNT value on done: 451225.0 [2023-02-25 13:44:55,648][36139] Sum rewards: 66.905, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.448', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon4': '0.084', 'AMMO4': '0.104', 'weapon5': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.269', 'weapon2': '0.406', 'WEAPON3': '1.600', 'weapon3': '3.090', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '58.500'} [2023-02-25 13:44:58,534][36138] Updated weights for policy 0, policy_version 43173 (0.0009) [2023-02-25 13:44:59,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 176848896. Throughput: 0: 3364.8. Samples: 6707326. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:44:59,730][36114] Avg episode reward: [(0, '52.070')] [2023-02-25 13:45:01,182][36154] DAMAGECOUNT value on done: 450516.0 [2023-02-25 13:45:01,183][36154] Sum rewards: 50.085, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.538', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.032', 'AMMO3': '0.156', 'AMMO4': '0.158', 'weapon5': '0.238', 'weapon4': '0.394', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.768', 'WEAPON3': '0.950', 'weapon3': '2.042', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '13.944', 'FRAGCOUNT': '44.000'} [2023-02-25 13:45:01,496][36154] DAMAGECOUNT value on done: 444450.0 [2023-02-25 13:45:01,497][36154] Sum rewards: 48.858, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.691', 'ARMOR': '0.012', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.064', 'AMMO3': '0.117', 'weapon5': '0.158', 'AMMO4': '0.321', 'weapon2': '0.448', 'WEAPON5': '0.450', 'WEAPON4': '0.700', 'WEAPON3': '0.750', 'weapon4': '1.240', 'weapon3': '1.886', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.225', 'FRAGCOUNT': '43.000'} [2023-02-25 13:45:01,565][36138] Updated weights for policy 0, policy_version 43183 (0.0009) [2023-02-25 13:45:01,800][36154] DAMAGECOUNT value on done: 448743.0 [2023-02-25 13:45:01,801][36154] Sum rewards: 53.228, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.596', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.061', 'AMMO3': '0.164', 'weapon2': '0.192', 'weapon5': '0.282', 'AMMO4': '0.304', 'weapon4': '0.442', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.794', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.586', 'FRAGCOUNT': '46.000'} [2023-02-25 13:45:02,111][36154] DAMAGECOUNT value on done: 451961.0 [2023-02-25 13:45:02,112][36154] Sum rewards: 61.313, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.842', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.084', 'AMMO4': '0.114', 'AMMO3': '0.207', 'weapon2': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.316', 'WEAPON3': '1.250', 'weapon3': '3.152', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.149', 'FRAGCOUNT': '52.000'} [2023-02-25 13:45:02,384][36141] DAMAGECOUNT value on done: 459164.0 [2023-02-25 13:45:02,384][36141] Sum rewards: 53.568, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.884', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon5': '0.120', 'weapon2': '0.146', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.279', 'weapon4': '0.464', 'WEAPON3': '1.550', 'weapon3': '2.988', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.805', 'FRAGCOUNT': '50.000'} [2023-02-25 13:45:02,684][36141] DAMAGECOUNT value on done: 443458.0 [2023-02-25 13:45:02,685][36141] Sum rewards: 26.481, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.566', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.102', 'weapon5': '0.136', 'AMMO3': '0.143', 'AMMO4': '0.170', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.457', 'weapon2': '0.736', 'WEAPON3': '0.800', 'HITCOUNT': '1.470', 'weapon3': '1.942', 'DAMAGECOUNT': '7.599', 'FRAGCOUNT': '25.000'} [2023-02-25 13:45:02,707][36141] DAMAGECOUNT value on done: 456360.0 [2023-02-25 13:45:02,708][36141] Sum rewards: 63.483, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.044', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.050', 'weapon5': '0.086', 'AMMO3': '0.163', 'AMMO4': '0.248', 'weapon4': '0.286', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.030', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '54.500'} [2023-02-25 13:45:03,010][36141] DAMAGECOUNT value on done: 439745.0 [2023-02-25 13:45:03,011][36141] Sum rewards: 58.520, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.294', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.117', 'AMMO3': '0.118', 'WEAPON5': '0.150', 'weapon5': '0.182', 'WEAPON4': '0.300', 'weapon2': '0.402', 'ARMOR': '0.451', 'weapon4': '0.544', 'WEAPON3': '0.800', 'weapon3': '2.622', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.917', 'FRAGCOUNT': '47.000'} [2023-02-25 13:45:03,393][36157] DAMAGECOUNT value on done: 462467.0 [2023-02-25 13:45:03,394][36157] Sum rewards: 53.143, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.474', 'WEAPON1': '0.010', 'AMMO5': '0.023', 'AMMO2': '0.052', 'weapon5': '0.198', 'AMMO3': '0.202', 'weapon2': '0.252', 'AMMO4': '0.259', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'weapon4': '0.710', 'WEAPON3': '1.150', 'weapon3': '2.478', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.763', 'FRAGCOUNT': '47.000'} [2023-02-25 13:45:03,711][36157] DAMAGECOUNT value on done: 450725.0 [2023-02-25 13:45:03,712][36157] Sum rewards: 43.133, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.438', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.041', 'AMMO3': '0.172', 'weapon2': '0.172', 'AMMO4': '0.203', 'weapon5': '0.204', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.752', 'WEAPON3': '1.000', 'weapon3': '2.480', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '12.972', 'FRAGCOUNT': '37.500'} [2023-02-25 13:45:04,254][36140] DAMAGECOUNT value on done: 457351.0 [2023-02-25 13:45:04,255][36140] Sum rewards: 57.231, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.006', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.172', 'AMMO3': '0.189', 'weapon5': '0.240', 'weapon2': '0.352', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'weapon4': '1.020', 'weapon3': '2.054', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '13.254', 'FRAGCOUNT': '50.000'} [2023-02-25 13:45:04,291][36157] DAMAGECOUNT value on done: 453642.0 [2023-02-25 13:45:04,291][36157] Sum rewards: 54.214, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.341', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.060', 'AMMO4': '0.154', 'weapon5': '0.164', 'weapon2': '0.250', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '2.890', 'weapon3': '3.188', 'DAMAGECOUNT': '14.493', 'FRAGCOUNT': '50.000'} [2023-02-25 13:45:04,566][36140] DAMAGECOUNT value on done: 444537.0 [2023-02-25 13:45:04,566][36140] Sum rewards: 47.206, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.572', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.117', 'AMMO3': '0.122', 'WEAPON5': '0.200', 'weapon5': '0.208', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon2': '0.656', 'weapon4': '0.792', 'WEAPON3': '0.850', 'weapon3': '2.066', 'HITCOUNT': '2.320', 'DAMAGECOUNT': '11.016', 'FRAGCOUNT': '38.000'} [2023-02-25 13:45:04,598][36157] DAMAGECOUNT value on done: 456532.0 [2023-02-25 13:45:04,598][36157] Sum rewards: 56.518, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.092', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon5': '0.076', 'weapon4': '0.086', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.197', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON3': '1.150', 'HITCOUNT': '3.050', 'weapon3': '3.350', 'DAMAGECOUNT': '14.613', 'FRAGCOUNT': '47.000'} [2023-02-25 13:45:04,640][36138] Updated weights for policy 0, policy_version 43193 (0.0009) [2023-02-25 13:45:04,725][36142] Large shaping reward 2.611 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.009000000000000001, -3.0)] [2023-02-25 13:45:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 176918528. Throughput: 0: 3359.9. Samples: 6727326. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:45:04,730][36114] Avg episode reward: [(0, '52.036')] [2023-02-25 13:45:04,860][36140] DAMAGECOUNT value on done: 446378.0 [2023-02-25 13:45:04,860][36140] Sum rewards: 42.540, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.854', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.205', 'weapon5': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.396', 'weapon2': '0.542', 'WEAPON3': '1.150', 'weapon3': '2.546', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '11.844', 'FRAGCOUNT': '39.000'} [2023-02-25 13:45:05,171][36140] DAMAGECOUNT value on done: 444115.0 [2023-02-25 13:45:05,172][36140] Sum rewards: 62.551, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.482', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.098', 'weapon4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.440', 'WEAPON3': '1.400', 'weapon3': '3.126', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.985', 'FRAGCOUNT': '55.000'} [2023-02-25 13:45:05,289][36156] DAMAGECOUNT value on done: 457317.0 [2023-02-25 13:45:05,289][36156] Sum rewards: 56.444, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.837', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.122', 'AMMO4': '0.141', 'weapon4': '0.186', 'AMMO3': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.302', 'WEAPON3': '1.500', 'weapon3': '3.138', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.371', 'FRAGCOUNT': '50.000'} [2023-02-25 13:45:05,303][36142] DAMAGECOUNT value on done: 447685.0 [2023-02-25 13:45:05,304][36142] Sum rewards: 57.415, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.580', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.051', 'weapon5': '0.106', 'AMMO3': '0.173', 'WEAPON5': '0.250', 'AMMO4': '0.253', 'weapon2': '0.298', 'WEAPON4': '0.550', 'weapon4': '0.570', 'WEAPON3': '1.100', 'weapon3': '2.786', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '49.500'} [2023-02-25 13:45:05,396][36156] DAMAGECOUNT value on done: 457256.0 [2023-02-25 13:45:05,397][36156] Sum rewards: 32.928, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.496', 'AMMO5': '0.025', 'AMMO2': '0.058', 'AMMO3': '0.211', 'weapon2': '0.262', 'AMMO4': '0.291', 'weapon5': '0.304', 'weapon4': '0.410', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'HITCOUNT': '2.390', 'weapon3': '2.720', 'DAMAGECOUNT': '11.502', 'FRAGCOUNT': '31.500'} [2023-02-25 13:45:05,605][36156] DAMAGECOUNT value on done: 449084.0 [2023-02-25 13:45:05,605][36156] Sum rewards: 61.185, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.504', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.032', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'weapon4': '0.176', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.200', 'HITCOUNT': '3.240', 'weapon3': '3.344', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '53.000'} [2023-02-25 13:45:05,608][36142] DAMAGECOUNT value on done: 439249.0 [2023-02-25 13:45:05,608][36142] Sum rewards: 45.720, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.671', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.028', 'AMMO4': '0.142', 'AMMO3': '0.153', 'weapon5': '0.180', 'weapon4': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.620', 'WEAPON3': '1.000', 'weapon3': '2.730', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.699', 'FRAGCOUNT': '38.000'} [2023-02-25 13:45:05,617][36142] DAMAGECOUNT value on done: 444179.0 [2023-02-25 13:45:05,618][36142] Sum rewards: 55.265, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.687', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.051', 'AMMO3': '0.159', 'weapon5': '0.172', 'AMMO4': '0.254', 'WEAPON5': '0.400', 'weapon4': '0.468', 'weapon2': '0.530', 'WEAPON4': '0.550', 'WEAPON3': '0.950', 'weapon3': '2.572', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.925', 'FRAGCOUNT': '47.000'} [2023-02-25 13:45:05,716][36156] DAMAGECOUNT value on done: 451601.0 [2023-02-25 13:45:05,716][36156] Sum rewards: 56.996, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.962', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon5': '0.084', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.290', 'weapon2': '0.290', 'weapon4': '0.434', 'WEAPON3': '1.700', 'weapon3': '2.922', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '53.000'} [2023-02-25 13:45:05,930][36142] DAMAGECOUNT value on done: 454196.0 [2023-02-25 13:45:05,931][36142] Sum rewards: 55.849, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.139', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.148', 'weapon4': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.446', 'WEAPON3': '1.300', 'HITCOUNT': '2.980', 'weapon3': '3.040', 'DAMAGECOUNT': '15.192', 'FRAGCOUNT': '49.000'} [2023-02-25 13:45:07,695][36138] Updated weights for policy 0, policy_version 43203 (0.0009) [2023-02-25 13:45:09,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 176984064. Throughput: 0: 3360.1. Samples: 6737394. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:45:09,729][36114] Avg episode reward: [(0, '51.875')] [2023-02-25 13:45:10,755][36138] Updated weights for policy 0, policy_version 43213 (0.0009) [2023-02-25 13:45:13,820][36155] DAMAGECOUNT value on done: 444851.0 [2023-02-25 13:45:13,820][36155] Sum rewards: 53.770, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.072', 'AMMO5': '0.017', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.199', 'weapon5': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.314', 'WEAPON5': '0.350', 'weapon4': '0.520', 'WEAPON3': '1.050', 'weapon3': '2.600', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.594', 'FRAGCOUNT': '47.000'} [2023-02-25 13:45:13,821][36138] Updated weights for policy 0, policy_version 43223 (0.0010) [2023-02-25 13:45:14,134][36155] DAMAGECOUNT value on done: 458653.0 [2023-02-25 13:45:14,135][36155] Sum rewards: 54.767, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.150', 'AMMO5': '0.020', 'AMMO2': '0.041', 'AMMO3': '0.172', 'AMMO4': '0.206', 'weapon2': '0.220', 'weapon5': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon4': '0.542', 'WEAPON3': '1.000', 'weapon3': '2.648', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.674', 'FRAGCOUNT': '46.000'} [2023-02-25 13:45:14,366][36139] DAMAGECOUNT value on done: 461264.0 [2023-02-25 13:45:14,366][36139] Sum rewards: 64.102, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.320', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.033', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO4': '0.165', 'weapon4': '0.170', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon2': '0.488', 'WEAPON3': '1.200', 'weapon3': '2.964', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '56.000'} [2023-02-25 13:45:14,673][36155] DAMAGECOUNT value on done: 455835.0 [2023-02-25 13:45:14,673][36155] Sum rewards: 62.504, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.278', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.082', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'weapon2': '0.336', 'weapon4': '0.352', 'WEAPON3': '1.050', 'weapon3': '3.050', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '52.500'} [2023-02-25 13:45:14,681][36139] DAMAGECOUNT value on done: 448886.0 [2023-02-25 13:45:14,681][36139] Sum rewards: 47.548, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.270', 'ARMOR': '0.008', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.047', 'weapon5': '0.122', 'AMMO3': '0.194', 'AMMO4': '0.233', 'weapon2': '0.382', 'WEAPON5': '0.400', 'weapon4': '0.476', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.740', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.783', 'FRAGCOUNT': '43.000'} [2023-02-25 13:45:14,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13426.5). Total num frames: 177049600. Throughput: 0: 3355.5. Samples: 6757518. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:45:14,730][36114] Avg episode reward: [(0, '52.168')] [2023-02-25 13:45:14,990][36155] DAMAGECOUNT value on done: 449706.0 [2023-02-25 13:45:14,991][36155] Sum rewards: 54.415, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.380', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.112', 'AMMO3': '0.163', 'weapon2': '0.226', 'AMMO4': '0.227', 'WEAPON4': '0.350', 'weapon5': '0.378', 'WEAPON5': '0.450', 'WEAPON3': '0.900', 'HITCOUNT': '2.670', 'weapon3': '2.990', 'DAMAGECOUNT': '14.517', 'FRAGCOUNT': '45.500'} [2023-02-25 13:45:15,289][36139] DAMAGECOUNT value on done: 455191.0 [2023-02-25 13:45:15,290][36139] Sum rewards: 61.239, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.253', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'weapon5': '0.002', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.242', 'weapon2': '0.290', 'WEAPON3': '1.550', 'HITCOUNT': '3.280', 'weapon3': '3.520', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '53.000'} [2023-02-25 13:45:15,613][36139] DAMAGECOUNT value on done: 455877.0 [2023-02-25 13:45:15,613][36139] Sum rewards: 51.236, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.520', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.030', 'weapon5': '0.068', 'WEAPON5': '0.100', 'weapon2': '0.180', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'weapon4': '0.754', 'WEAPON3': '1.400', 'weapon3': '2.490', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.956', 'FRAGCOUNT': '45.000'} [2023-02-25 13:45:16,884][36138] Updated weights for policy 0, policy_version 43233 (0.0010) [2023-02-25 13:45:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 177119232. Throughput: 0: 3349.8. Samples: 6777592. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:45:19,729][36114] Avg episode reward: [(0, '52.243')] [2023-02-25 13:45:19,733][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000043242_177119232.pth... [2023-02-25 13:45:19,789][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000042455_173895680.pth [2023-02-25 13:45:19,950][36138] Updated weights for policy 0, policy_version 43243 (0.0009) [2023-02-25 13:45:20,658][36157] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:45:21,228][36154] DAMAGECOUNT value on done: 456119.0 [2023-02-25 13:45:21,228][36154] Sum rewards: 62.396, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.848', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.114', 'AMMO4': '0.164', 'weapon2': '0.222', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'WEAPON4': '0.400', 'weapon4': '0.486', 'WEAPON3': '1.500', 'weapon3': '2.870', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.752', 'FRAGCOUNT': '55.500'} [2023-02-25 13:45:21,545][36154] DAMAGECOUNT value on done: 449305.0 [2023-02-25 13:45:21,545][36154] Sum rewards: 59.283, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.695', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.118', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.304', 'weapon2': '0.438', 'WEAPON3': '1.150', 'weapon3': '2.938', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.565', 'FRAGCOUNT': '49.000'} [2023-02-25 13:45:21,854][36154] DAMAGECOUNT value on done: 453672.0 [2023-02-25 13:45:21,855][36154] Sum rewards: 55.386, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.610', 'ARMOR': '0.005', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon5': '0.122', 'AMMO3': '0.191', 'AMMO4': '0.243', 'weapon2': '0.288', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.672', 'WEAPON3': '1.100', 'weapon3': '2.554', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.787', 'FRAGCOUNT': '48.000'} [2023-02-25 13:45:22,160][36154] DAMAGECOUNT value on done: 455675.0 [2023-02-25 13:45:22,160][36154] Sum rewards: 38.230, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.913', 'AMMO5': '0.026', 'AMMO2': '0.050', 'weapon4': '0.110', 'AMMO3': '0.166', 'weapon5': '0.214', 'AMMO4': '0.251', 'WEAPON4': '0.500', 'weapon2': '0.594', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'HITCOUNT': '2.220', 'weapon3': '2.820', 'DAMAGECOUNT': '11.142', 'FRAGCOUNT': '35.500'} [2023-02-25 13:45:22,514][36141] DAMAGECOUNT value on done: 463768.0 [2023-02-25 13:45:22,514][36141] Sum rewards: 55.903, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.610', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.030', 'AMMO4': '0.043', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.197', 'weapon2': '0.378', 'weapon4': '0.424', 'WEAPON3': '1.200', 'HITCOUNT': '2.950', 'weapon3': '3.018', 'DAMAGECOUNT': '13.812', 'FRAGCOUNT': '48.000'} [2023-02-25 13:45:22,818][36141] DAMAGECOUNT value on done: 447447.0 [2023-02-25 13:45:22,819][36141] Sum rewards: 41.106, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.424', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon5': '0.124', 'AMMO3': '0.149', 'AMMO4': '0.175', 'weapon2': '0.270', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '0.950', 'weapon4': '0.988', 'weapon3': '2.326', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '11.559', 'FRAGCOUNT': '37.000'} [2023-02-25 13:45:22,837][36141] DAMAGECOUNT value on done: 461301.0 [2023-02-25 13:45:22,838][36141] Sum rewards: 52.202, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.172', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.050', 'WEAPON5': '0.200', 'AMMO4': '0.205', 'weapon2': '0.220', 'AMMO3': '0.225', 'WEAPON4': '0.350', 'weapon4': '0.496', 'WEAPON3': '1.400', 'weapon3': '2.980', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.823', 'FRAGCOUNT': '46.000'} [2023-02-25 13:45:22,989][36138] Updated weights for policy 0, policy_version 43253 (0.0009) [2023-02-25 13:45:23,134][36141] DAMAGECOUNT value on done: 444858.0 [2023-02-25 13:45:23,135][36141] Sum rewards: 51.393, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.090', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.052', 'AMMO3': '0.198', 'weapon5': '0.248', 'AMMO4': '0.261', 'weapon2': '0.316', 'weapon4': '0.344', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.736', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '47.000'} [2023-02-25 13:45:23,434][36157] DAMAGECOUNT value on done: 466947.0 [2023-02-25 13:45:23,434][36157] Sum rewards: 56.498, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.780', 'AMMO5': '0.003', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.150', 'weapon2': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '2.770', 'weapon3': '3.148', 'DAMAGECOUNT': '13.440', 'FRAGCOUNT': '47.000'} [2023-02-25 13:45:23,754][36157] DAMAGECOUNT value on done: 455409.0 [2023-02-25 13:45:23,755][36157] Sum rewards: 55.005, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.454', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.140', 'AMMO4': '0.156', 'AMMO3': '0.170', 'weapon5': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.374', 'WEAPON3': '1.100', 'HITCOUNT': '2.570', 'weapon3': '3.054', 'DAMAGECOUNT': '14.052', 'FRAGCOUNT': '47.000'} [2023-02-25 13:45:24,296][36140] DAMAGECOUNT value on done: 462637.0 [2023-02-25 13:45:24,296][36140] Sum rewards: 60.457, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.919', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.029', 'weapon5': '0.122', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'weapon2': '0.232', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'weapon4': '0.354', 'WEAPON3': '1.400', 'weapon3': '3.036', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.858', 'FRAGCOUNT': '53.000'} [2023-02-25 13:45:24,368][36157] DAMAGECOUNT value on done: 458609.0 [2023-02-25 13:45:24,369][36157] Sum rewards: 57.494, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.226', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.060', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'weapon2': '0.440', 'weapon4': '0.720', 'WEAPON3': '1.150', 'weapon3': '2.666', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '14.901', 'FRAGCOUNT': '47.000'} [2023-02-25 13:45:24,612][36140] DAMAGECOUNT value on done: 448831.0 [2023-02-25 13:45:24,613][36140] Sum rewards: 42.712, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.940', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.058', 'AMMO3': '0.198', 'AMMO4': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.270', 'weapon4': '0.398', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '2.750', 'weapon3': '2.986', 'DAMAGECOUNT': '12.882', 'FRAGCOUNT': '38.000'} [2023-02-25 13:45:24,672][36157] DAMAGECOUNT value on done: 461992.0 [2023-02-25 13:45:24,673][36157] Sum rewards: 58.799, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.654', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.250', 'weapon4': '0.256', 'AMMO3': '0.257', 'WEAPON3': '1.450', 'weapon3': '3.208', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '50.500'} [2023-02-25 13:45:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 177184768. Throughput: 0: 3347.7. Samples: 6787600. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:45:24,730][36114] Avg episode reward: [(0, '52.299')] [2023-02-25 13:45:24,943][36140] DAMAGECOUNT value on done: 451014.0 [2023-02-25 13:45:24,944][36140] Sum rewards: 51.224, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.382', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.154', 'weapon2': '0.186', 'AMMO3': '0.199', 'AMMO4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.390', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.770', 'weapon3': '3.040', 'DAMAGECOUNT': '13.908', 'FRAGCOUNT': '45.000'} [2023-02-25 13:45:25,270][36140] DAMAGECOUNT value on done: 449285.0 [2023-02-25 13:45:25,270][36140] Sum rewards: 56.482, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.572', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'weapon2': '0.198', 'weapon4': '0.268', 'AMMO3': '0.290', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.072', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '53.000'} [2023-02-25 13:45:25,394][36156] DAMAGECOUNT value on done: 461821.0 [2023-02-25 13:45:25,395][36156] Sum rewards: 52.116, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.150', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.082', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.258', 'weapon4': '0.338', 'WEAPON3': '1.350', 'weapon3': '3.122', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.512', 'FRAGCOUNT': '46.000'} [2023-02-25 13:45:25,514][36156] DAMAGECOUNT value on done: 462332.0 [2023-02-25 13:45:25,514][36156] Sum rewards: 49.335, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.540', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.062', 'AMMO4': '0.150', 'weapon2': '0.218', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.256', 'WEAPON3': '1.500', 'HITCOUNT': '2.680', 'weapon3': '3.248', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '43.500'} [2023-02-25 13:45:25,570][36142] DAMAGECOUNT value on done: 452516.0 [2023-02-25 13:45:25,571][36142] Sum rewards: 57.685, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.302', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO4': '0.037', 'WEAPON5': '0.050', 'weapon5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.169', 'weapon4': '0.244', 'weapon2': '0.532', 'WEAPON3': '1.150', 'weapon3': '3.028', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '14.493', 'FRAGCOUNT': '48.000'} [2023-02-25 13:45:25,705][36156] DAMAGECOUNT value on done: 453758.0 [2023-02-25 13:45:25,705][36156] Sum rewards: 51.791, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.010', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.150', 'weapon4': '0.180', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.300', 'HITCOUNT': '2.870', 'weapon3': '3.090', 'DAMAGECOUNT': '14.022', 'FRAGCOUNT': '45.000'} [2023-02-25 13:45:25,819][36156] DAMAGECOUNT value on done: 456192.0 [2023-02-25 13:45:25,819][36156] Sum rewards: 47.075, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.060', 'AMMO5': '0.017', 'AMMO2': '0.056', 'AMMO3': '0.184', 'AMMO4': '0.279', 'weapon2': '0.302', 'weapon5': '0.314', 'WEAPON5': '0.400', 'weapon4': '0.476', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.584', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '13.773', 'FRAGCOUNT': '42.000'} [2023-02-25 13:45:25,893][36142] DAMAGECOUNT value on done: 444026.0 [2023-02-25 13:45:25,894][36142] Sum rewards: 52.765, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.540', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.078', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon2': '0.356', 'weapon4': '0.362', 'WEAPON3': '1.400', 'weapon3': '2.988', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.331', 'FRAGCOUNT': '47.000'} [2023-02-25 13:45:25,903][36142] DAMAGECOUNT value on done: 449082.0 [2023-02-25 13:45:25,904][36142] Sum rewards: 48.830, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.501', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.056', 'weapon5': '0.184', 'AMMO3': '0.221', 'AMMO4': '0.280', 'WEAPON5': '0.350', 'weapon2': '0.354', 'weapon4': '0.502', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.670', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '14.349', 'FRAGCOUNT': '45.000'} [2023-02-25 13:45:26,028][36138] Updated weights for policy 0, policy_version 43263 (0.0009) [2023-02-25 13:45:26,193][36142] DAMAGECOUNT value on done: 459031.0 [2023-02-25 13:45:26,194][36142] Sum rewards: 56.078, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.875', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.198', 'weapon4': '0.212', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.350', 'HITCOUNT': '2.720', 'weapon3': '3.060', 'DAMAGECOUNT': '14.505', 'FRAGCOUNT': '49.000'} [2023-02-25 13:45:26,404][36157] Large shaping reward 2.526 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.504, 168.0), ('weapon5', 0.002)] [2023-02-25 13:45:27,407][36156] Large shaping reward 3.246 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.195, 65.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:45:29,039][36138] Updated weights for policy 0, policy_version 43273 (0.0009) [2023-02-25 13:45:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13426.5). Total num frames: 177254400. Throughput: 0: 3347.2. Samples: 6807690. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:45:29,729][36114] Avg episode reward: [(0, '52.608')] [2023-02-25 13:45:32,121][36138] Updated weights for policy 0, policy_version 43283 (0.0010) [2023-02-25 13:45:32,492][36154] Large shaping reward 2.604 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.582, 194.0), ('weapon5', 0.002)] [2023-02-25 13:45:33,779][36155] DAMAGECOUNT value on done: 449349.0 [2023-02-25 13:45:33,780][36155] Sum rewards: 54.729, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.540', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.043', 'AMMO3': '0.156', 'weapon5': '0.212', 'AMMO4': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.400', 'weapon4': '0.728', 'WEAPON3': '0.950', 'weapon3': '2.422', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.494', 'FRAGCOUNT': '45.000'} [2023-02-25 13:45:34,087][36155] DAMAGECOUNT value on done: 464303.0 [2023-02-25 13:45:34,087][36155] Sum rewards: 67.008, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.432', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.075', 'weapon5': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'weapon2': '0.320', 'WEAPON3': '1.300', 'HITCOUNT': '3.250', 'weapon3': '3.344', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '55.500'} [2023-02-25 13:45:34,445][36141] Large shaping reward -2.503 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('weapon5', 0.002)] [2023-02-25 13:45:34,465][36139] DAMAGECOUNT value on done: 465633.0 [2023-02-25 13:45:34,465][36139] Sum rewards: 46.527, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.910', 'ARMOR': '0.004', 'AMMO5': '0.028', 'AMMO2': '0.046', 'weapon2': '0.190', 'AMMO3': '0.227', 'AMMO4': '0.228', 'weapon5': '0.294', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.680', 'WEAPON3': '1.350', 'weapon3': '2.452', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '13.107', 'FRAGCOUNT': '43.000'} [2023-02-25 13:45:34,630][36155] DAMAGECOUNT value on done: 460614.0 [2023-02-25 13:45:34,630][36155] Sum rewards: 53.926, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.205', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.188', 'AMMO4': '0.197', 'AMMO3': '0.202', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.400', 'weapon4': '0.534', 'WEAPON3': '1.150', 'weapon3': '2.638', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.337', 'FRAGCOUNT': '47.500'} [2023-02-25 13:45:34,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.2, 300 sec: 13426.5). Total num frames: 177319936. Throughput: 0: 3346.1. Samples: 6827810. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:45:34,730][36114] Avg episode reward: [(0, '52.845')] [2023-02-25 13:45:34,786][36139] DAMAGECOUNT value on done: 454247.0 [2023-02-25 13:45:34,787][36139] Sum rewards: 61.477, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.459', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon5': '0.188', 'AMMO4': '0.210', 'weapon4': '0.222', 'AMMO3': '0.250', 'weapon2': '0.266', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.040', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.083', 'FRAGCOUNT': '56.000'} [2023-02-25 13:45:34,947][36155] DAMAGECOUNT value on done: 454613.0 [2023-02-25 13:45:34,948][36155] Sum rewards: 59.232, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.440', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'weapon5': '0.016', 'WEAPON5': '0.150', 'weapon2': '0.164', 'AMMO3': '0.242', 'WEAPON3': '1.450', 'HITCOUNT': '3.010', 'weapon3': '3.666', 'DAMAGECOUNT': '14.721', 'FRAGCOUNT': '51.000'} [2023-02-25 13:45:35,224][36138] Updated weights for policy 0, policy_version 43293 (0.0009) [2023-02-25 13:45:35,404][36139] DAMAGECOUNT value on done: 460001.0 [2023-02-25 13:45:35,404][36139] Sum rewards: 52.748, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.840', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.034', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.211', 'weapon2': '0.282', 'WEAPON4': '0.400', 'weapon4': '0.560', 'WEAPON3': '1.250', 'weapon3': '2.766', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.430', 'FRAGCOUNT': '46.000'} [2023-02-25 13:45:35,716][36139] DAMAGECOUNT value on done: 460436.0 [2023-02-25 13:45:35,716][36139] Sum rewards: 53.200, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.490', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.062', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon2': '0.274', 'WEAPON4': '0.350', 'weapon4': '0.470', 'WEAPON3': '1.100', 'HITCOUNT': '2.940', 'weapon3': '3.056', 'DAMAGECOUNT': '13.677', 'FRAGCOUNT': '46.000'} [2023-02-25 13:45:38,250][36138] Updated weights for policy 0, policy_version 43303 (0.0009) [2023-02-25 13:45:39,729][36114] Fps is (10 sec: 13107.0, 60 sec: 13380.2, 300 sec: 13412.7). Total num frames: 177385472. Throughput: 0: 3346.3. Samples: 6837854. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:45:39,730][36114] Avg episode reward: [(0, '53.119')] [2023-02-25 13:45:41,305][36138] Updated weights for policy 0, policy_version 43313 (0.0009) [2023-02-25 13:45:41,375][36154] DAMAGECOUNT value on done: 460917.0 [2023-02-25 13:45:41,376][36154] Sum rewards: 52.290, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.082', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.036', 'weapon5': '0.162', 'AMMO4': '0.182', 'weapon2': '0.182', 'AMMO3': '0.261', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.458', 'WEAPON3': '1.400', 'HITCOUNT': '2.890', 'weapon3': '2.936', 'DAMAGECOUNT': '14.394', 'FRAGCOUNT': '47.000'} [2023-02-25 13:45:41,688][36154] DAMAGECOUNT value on done: 453907.0 [2023-02-25 13:45:41,688][36154] Sum rewards: 58.149, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.411', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.064', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'weapon2': '0.456', 'weapon4': '0.548', 'WEAPON3': '1.150', 'weapon3': '2.770', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.806', 'FRAGCOUNT': '50.000'} [2023-02-25 13:45:42,009][36154] DAMAGECOUNT value on done: 458363.0 [2023-02-25 13:45:42,009][36154] Sum rewards: 55.231, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.570', 'AMMO5': '0.024', 'AMMO2': '0.050', 'AMMO3': '0.204', 'AMMO4': '0.252', 'weapon5': '0.300', 'weapon2': '0.428', 'weapon4': '0.572', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.408', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '14.073', 'FRAGCOUNT': '50.000'} [2023-02-25 13:45:42,316][36154] DAMAGECOUNT value on done: 460388.0 [2023-02-25 13:45:42,317][36154] Sum rewards: 53.944, reward structure: {'DEATHCOUNT': '-14.250', 'ARMOR': '0.004', 'AMMO5': '0.005', 'HEALTH': '0.012', 'AMMO2': '0.024', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.175', 'weapon2': '0.226', 'WEAPON4': '0.250', 'weapon4': '0.510', 'WEAPON3': '1.000', 'HITCOUNT': '2.660', 'weapon3': '2.876', 'DAMAGECOUNT': '14.139', 'FRAGCOUNT': '46.000'} [2023-02-25 13:45:42,641][36141] DAMAGECOUNT value on done: 468663.0 [2023-02-25 13:45:42,641][36141] Sum rewards: 51.145, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.774', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.038', 'AMMO4': '0.189', 'AMMO3': '0.226', 'weapon2': '0.236', 'weapon5': '0.248', 'weapon4': '0.314', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.894', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.685', 'FRAGCOUNT': '45.500'} [2023-02-25 13:45:42,939][36141] DAMAGECOUNT value on done: 452098.0 [2023-02-25 13:45:42,940][36141] Sum rewards: 52.221, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.900', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.106', 'AMMO4': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'WEAPON4': '0.400', 'weapon2': '0.536', 'weapon4': '0.688', 'WEAPON3': '1.200', 'weapon3': '2.466', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.953', 'FRAGCOUNT': '47.000'} [2023-02-25 13:45:42,963][36141] DAMAGECOUNT value on done: 465857.0 [2023-02-25 13:45:42,964][36141] Sum rewards: 53.939, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.405', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon2': '0.130', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'weapon5': '0.296', 'WEAPON5': '0.350', 'weapon4': '0.410', 'WEAPON3': '1.250', 'HITCOUNT': '2.840', 'weapon3': '2.854', 'DAMAGECOUNT': '13.668', 'FRAGCOUNT': '46.000'} [2023-02-25 13:45:43,235][36141] DAMAGECOUNT value on done: 450356.0 [2023-02-25 13:45:43,235][36141] Sum rewards: 62.953, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.795', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.206', 'weapon2': '0.220', 'weapon4': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.320', 'WEAPON3': '1.850', 'weapon3': '2.896', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '59.000'} [2023-02-25 13:45:43,459][36157] DAMAGECOUNT value on done: 471070.0 [2023-02-25 13:45:43,459][36157] Sum rewards: 50.726, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.790', 'AMMO5': '0.007', 'weapon5': '0.024', 'AMMO2': '0.027', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'weapon2': '0.268', 'WEAPON4': '0.450', 'weapon4': '0.548', 'WEAPON3': '1.000', 'HITCOUNT': '2.800', 'weapon3': '2.828', 'DAMAGECOUNT': '12.369', 'FRAGCOUNT': '43.000'} [2023-02-25 13:45:43,778][36157] DAMAGECOUNT value on done: 459232.0 [2023-02-25 13:45:43,778][36157] Sum rewards: 43.406, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.555', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'AMMO3': '0.166', 'weapon2': '0.426', 'WEAPON4': '0.500', 'weapon4': '1.000', 'WEAPON3': '1.050', 'weapon3': '2.314', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '11.469', 'FRAGCOUNT': '38.000'} [2023-02-25 13:45:44,285][36140] DAMAGECOUNT value on done: 468103.0 [2023-02-25 13:45:44,285][36140] Sum rewards: 58.356, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.810', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.229', 'weapon5': '0.286', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.518', 'WEAPON3': '1.400', 'weapon3': '2.566', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '49.500'} [2023-02-25 13:45:44,362][36157] DAMAGECOUNT value on done: 464411.0 [2023-02-25 13:45:44,363][36157] Sum rewards: 69.074, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.688', 'AMMO2': '0.022', 'AMMO5': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.210', 'weapon2': '0.240', 'WEAPON4': '0.300', 'weapon5': '0.328', 'weapon4': '0.490', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.596', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.406', 'FRAGCOUNT': '58.000'} [2023-02-25 13:45:44,427][36138] Updated weights for policy 0, policy_version 43323 (0.0010) [2023-02-25 13:45:44,606][36140] DAMAGECOUNT value on done: 452952.0 [2023-02-25 13:45:44,607][36140] Sum rewards: 43.209, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.226', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'AMMO4': '0.260', 'weapon4': '0.308', 'weapon2': '0.342', 'WEAPON3': '1.450', 'HITCOUNT': '2.720', 'weapon3': '3.090', 'DAMAGECOUNT': '12.363', 'FRAGCOUNT': '41.000'} [2023-02-25 13:45:44,679][36157] DAMAGECOUNT value on done: 466237.0 [2023-02-25 13:45:44,680][36157] Sum rewards: 46.376, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.034', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon2': '0.188', 'weapon5': '0.224', 'AMMO3': '0.232', 'AMMO4': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.550', 'weapon4': '0.796', 'WEAPON3': '1.400', 'weapon3': '2.480', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '12.420', 'FRAGCOUNT': '44.000'} [2023-02-25 13:45:44,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 177451008. Throughput: 0: 3345.5. Samples: 6857874. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:45:44,730][36114] Avg episode reward: [(0, '53.110')] [2023-02-25 13:45:44,896][36140] DAMAGECOUNT value on done: 456089.0 [2023-02-25 13:45:44,897][36140] Sum rewards: 55.203, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.370', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon5': '0.150', 'AMMO4': '0.159', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.454', 'weapon4': '0.666', 'WEAPON3': '1.250', 'weapon3': '2.480', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '15.225', 'FRAGCOUNT': '48.000'} [2023-02-25 13:45:45,211][36140] DAMAGECOUNT value on done: 453474.0 [2023-02-25 13:45:45,212][36140] Sum rewards: 47.036, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.996', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.128', 'AMMO3': '0.161', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.318', 'weapon2': '0.492', 'WEAPON3': '1.100', 'HITCOUNT': '2.470', 'weapon3': '2.886', 'DAMAGECOUNT': '12.567', 'FRAGCOUNT': '41.000'} [2023-02-25 13:45:45,490][36156] DAMAGECOUNT value on done: 466890.0 [2023-02-25 13:45:45,490][36156] Sum rewards: 59.022, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.360', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'weapon4': '0.082', 'AMMO4': '0.105', 'weapon2': '0.180', 'AMMO3': '0.210', 'WEAPON3': '1.350', 'HITCOUNT': '3.070', 'weapon3': '3.606', 'DAMAGECOUNT': '15.207', 'FRAGCOUNT': '51.000'} [2023-02-25 13:45:45,609][36156] DAMAGECOUNT value on done: 467184.0 [2023-02-25 13:45:45,610][36156] Sum rewards: 52.262, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.752', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon4': '0.122', 'weapon2': '0.208', 'AMMO4': '0.214', 'weapon5': '0.218', 'AMMO3': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '2.890', 'weapon3': '3.218', 'DAMAGECOUNT': '14.556', 'FRAGCOUNT': '47.000'} [2023-02-25 13:45:45,668][36142] DAMAGECOUNT value on done: 458150.0 [2023-02-25 13:45:45,669][36142] Sum rewards: 66.785, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.050', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.160', 'AMMO3': '0.194', 'weapon2': '0.320', 'WEAPON3': '1.350', 'weapon3': '3.362', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '16.902', 'FRAGCOUNT': '57.000'} [2023-02-25 13:45:45,811][36156] DAMAGECOUNT value on done: 457148.0 [2023-02-25 13:45:45,812][36156] Sum rewards: 38.808, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.140', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon5': '0.138', 'AMMO3': '0.189', 'weapon2': '0.216', 'WEAPON4': '0.350', 'weapon4': '0.688', 'WEAPON3': '1.050', 'HITCOUNT': '2.490', 'weapon3': '2.676', 'DAMAGECOUNT': '10.170', 'FRAGCOUNT': '36.000'} [2023-02-25 13:45:45,941][36156] DAMAGECOUNT value on done: 460422.0 [2023-02-25 13:45:45,942][36156] Sum rewards: 49.257, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.212', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.051', 'AMMO3': '0.130', 'weapon5': '0.252', 'AMMO4': '0.253', 'weapon2': '0.488', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.626', 'WEAPON3': '0.700', 'weapon3': '2.234', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '12.690', 'FRAGCOUNT': '43.000'} [2023-02-25 13:45:45,956][36142] DAMAGECOUNT value on done: 449453.0 [2023-02-25 13:45:45,956][36142] Sum rewards: 70.877, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.116', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.048', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'weapon4': '0.226', 'weapon2': '0.352', 'WEAPON3': '1.000', 'weapon3': '3.190', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '58.000'} [2023-02-25 13:45:45,965][36142] DAMAGECOUNT value on done: 453162.0 [2023-02-25 13:45:45,966][36142] Sum rewards: 43.506, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.348', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.150', 'weapon2': '0.172', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'weapon4': '0.652', 'WEAPON3': '1.350', 'HITCOUNT': '2.490', 'weapon3': '2.850', 'DAMAGECOUNT': '12.240', 'FRAGCOUNT': '40.000'} [2023-02-25 13:45:46,265][36142] DAMAGECOUNT value on done: 464121.0 [2023-02-25 13:45:46,266][36142] Sum rewards: 58.432, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.225', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.235', 'WEAPON4': '0.400', 'weapon4': '0.500', 'weapon2': '0.654', 'WEAPON3': '1.400', 'weapon3': '2.578', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '52.000'} [2023-02-25 13:45:47,453][36138] Updated weights for policy 0, policy_version 43333 (0.0009) [2023-02-25 13:45:49,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13426.6). Total num frames: 177520640. Throughput: 0: 3352.5. Samples: 6878188. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:45:49,730][36114] Avg episode reward: [(0, '53.213')] [2023-02-25 13:45:50,507][36138] Updated weights for policy 0, policy_version 43343 (0.0009) [2023-02-25 13:45:53,017][36157] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 13:45:53,522][36138] Updated weights for policy 0, policy_version 43353 (0.0009) [2023-02-25 13:45:53,782][36155] DAMAGECOUNT value on done: 454226.0 [2023-02-25 13:45:53,783][36155] Sum rewards: 51.219, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.022', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon5': '0.170', 'AMMO4': '0.228', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.282', 'WEAPON5': '0.300', 'weapon4': '0.362', 'WEAPON3': '1.400', 'weapon3': '2.928', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.631', 'FRAGCOUNT': '45.000'} [2023-02-25 13:45:54,088][36155] DAMAGECOUNT value on done: 469556.0 [2023-02-25 13:45:54,088][36155] Sum rewards: 66.770, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.700', 'AMMO2': '0.002', 'weapon5': '0.008', 'AMMO4': '0.009', 'AMMO5': '0.010', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.182', 'AMMO3': '0.250', 'weapon2': '0.372', 'WEAPON3': '1.650', 'weapon3': '3.258', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '58.000'} [2023-02-25 13:45:54,156][36155] Large shaping reward 2.520 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.111, -37.0), ('ARMOR', -0.001, -1.0), ('weapon5', 0.002)] [2023-02-25 13:45:54,539][36139] DAMAGECOUNT value on done: 470303.0 [2023-02-25 13:45:54,540][36139] Sum rewards: 46.363, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.314', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.049', 'AMMO3': '0.188', 'weapon5': '0.206', 'weapon2': '0.214', 'AMMO4': '0.245', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.716', 'WEAPON3': '1.200', 'weapon3': '2.542', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.548', 'FRAGCOUNT': '41.000'} [2023-02-25 13:45:54,630][36155] DAMAGECOUNT value on done: 464931.0 [2023-02-25 13:45:54,630][36155] Sum rewards: 45.611, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.458', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO4': '0.193', 'weapon5': '0.206', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'weapon4': '0.388', 'WEAPON4': '0.400', 'weapon2': '0.552', 'WEAPON3': '1.250', 'HITCOUNT': '2.520', 'weapon3': '2.590', 'DAMAGECOUNT': '12.951', 'FRAGCOUNT': '42.000'} [2023-02-25 13:45:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13426.5). Total num frames: 177586176. Throughput: 0: 3352.2. Samples: 6888244. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:45:54,730][36114] Avg episode reward: [(0, '53.475')] [2023-02-25 13:45:54,847][36139] DAMAGECOUNT value on done: 459176.0 [2023-02-25 13:45:54,848][36139] Sum rewards: 59.421, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.022', 'AMMO5': '0.005', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'weapon5': '0.118', 'AMMO3': '0.188', 'AMMO4': '0.195', 'WEAPON4': '0.250', 'weapon4': '0.258', 'weapon2': '0.314', 'WEAPON3': '1.200', 'HITCOUNT': '2.950', 'weapon3': '3.040', 'DAMAGECOUNT': '14.787', 'FRAGCOUNT': '50.000'} [2023-02-25 13:45:54,941][36155] DAMAGECOUNT value on done: 459660.0 [2023-02-25 13:45:54,941][36155] Sum rewards: 62.693, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.880', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.192', 'weapon2': '0.196', 'WEAPON3': '1.150', 'HITCOUNT': '3.070', 'weapon3': '3.604', 'DAMAGECOUNT': '15.141', 'FRAGCOUNT': '52.000'} [2023-02-25 13:45:55,415][36139] DAMAGECOUNT value on done: 464395.0 [2023-02-25 13:45:55,416][36139] Sum rewards: 43.464, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.124', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.025', 'AMMO2': '0.062', 'AMMO3': '0.144', 'AMMO4': '0.312', 'weapon5': '0.382', 'weapon4': '0.386', 'weapon2': '0.576', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '0.850', 'weapon3': '2.340', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '12.882', 'FRAGCOUNT': '38.500'} [2023-02-25 13:45:55,730][36139] DAMAGECOUNT value on done: 465390.0 [2023-02-25 13:45:55,731][36139] Sum rewards: 67.193, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.301', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon2': '0.126', 'AMMO3': '0.195', 'weapon4': '0.208', 'WEAPON3': '1.200', 'HITCOUNT': '3.210', 'weapon3': '3.500', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '57.000'} [2023-02-25 13:45:56,559][36138] Updated weights for policy 0, policy_version 43363 (0.0010) [2023-02-25 13:45:59,556][36138] Updated weights for policy 0, policy_version 43373 (0.0010) [2023-02-25 13:45:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 177655808. Throughput: 0: 3354.0. Samples: 6908450. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:45:59,730][36114] Avg episode reward: [(0, '53.871')] [2023-02-25 13:46:01,417][36154] DAMAGECOUNT value on done: 466154.0 [2023-02-25 13:46:01,417][36154] Sum rewards: 62.027, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.300', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.036', 'AMMO3': '0.140', 'AMMO4': '0.181', 'weapon5': '0.192', 'weapon2': '0.218', 'WEAPON4': '0.400', 'weapon4': '0.424', 'WEAPON5': '0.550', 'WEAPON3': '0.950', 'weapon3': '2.940', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '50.000'} [2023-02-25 13:46:01,733][36154] DAMAGECOUNT value on done: 457894.0 [2023-02-25 13:46:01,734][36154] Sum rewards: 43.517, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.625', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'AMMO3': '0.208', 'weapon2': '0.212', 'WEAPON4': '0.300', 'weapon4': '0.426', 'WEAPON3': '1.250', 'HITCOUNT': '2.850', 'weapon3': '2.990', 'DAMAGECOUNT': '11.961', 'FRAGCOUNT': '38.000'} [2023-02-25 13:46:02,050][36154] DAMAGECOUNT value on done: 462647.0 [2023-02-25 13:46:02,050][36154] Sum rewards: 49.146, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.932', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon5': '0.136', 'AMMO4': '0.185', 'AMMO3': '0.202', 'weapon4': '0.206', 'weapon2': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.770', 'weapon3': '3.186', 'DAMAGECOUNT': '12.852', 'FRAGCOUNT': '44.500'} [2023-02-25 13:46:02,360][36154] DAMAGECOUNT value on done: 465499.0 [2023-02-25 13:46:02,360][36154] Sum rewards: 60.007, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.419', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'weapon4': '0.472', 'weapon2': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.730', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.333', 'FRAGCOUNT': '50.000'} [2023-02-25 13:46:02,468][36141] DAMAGECOUNT value on done: 473007.0 [2023-02-25 13:46:02,469][36141] Sum rewards: 41.807, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.334', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon5': '0.104', 'AMMO4': '0.193', 'AMMO3': '0.206', 'WEAPON5': '0.300', 'weapon4': '0.434', 'WEAPON4': '0.450', 'weapon2': '0.740', 'WEAPON3': '1.300', 'weapon3': '2.526', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.032', 'FRAGCOUNT': '38.000'} [2023-02-25 13:46:02,620][36138] Updated weights for policy 0, policy_version 43383 (0.0009) [2023-02-25 13:46:02,767][36141] DAMAGECOUNT value on done: 456595.0 [2023-02-25 13:46:02,767][36141] Sum rewards: 55.660, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.118', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.116', 'AMMO3': '0.140', 'WEAPON5': '0.200', 'weapon2': '0.240', 'WEAPON4': '0.400', 'weapon4': '0.632', 'WEAPON3': '0.850', 'weapon3': '2.554', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.491', 'FRAGCOUNT': '47.000'} [2023-02-25 13:46:02,776][36141] DAMAGECOUNT value on done: 471199.0 [2023-02-25 13:46:02,776][36141] Sum rewards: 57.194, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.462', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.233', 'WEAPON4': '0.350', 'weapon2': '0.394', 'weapon4': '0.566', 'WEAPON3': '1.350', 'weapon3': '2.732', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.026', 'FRAGCOUNT': '48.000'} [2023-02-25 13:46:03,084][36141] DAMAGECOUNT value on done: 454025.0 [2023-02-25 13:46:03,084][36141] Sum rewards: 44.532, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.662', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon7': '0.048', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.142', 'AMMO3': '0.143', 'weapon5': '0.156', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.320', 'weapon4': '0.652', 'WEAPON3': '0.850', 'weapon3': '1.794', 'HITCOUNT': '2.100', 'DAMAGECOUNT': '11.007', 'FRAGCOUNT': '36.000'} [2023-02-25 13:46:03,420][36157] DAMAGECOUNT value on done: 476228.0 [2023-02-25 13:46:03,421][36157] Sum rewards: 52.295, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.008', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.086', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'weapon2': '0.244', 'WEAPON4': '0.400', 'weapon4': '0.752', 'WEAPON3': '1.400', 'weapon3': '2.658', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.474', 'FRAGCOUNT': '46.500'} [2023-02-25 13:46:03,735][36157] DAMAGECOUNT value on done: 463182.0 [2023-02-25 13:46:03,735][36157] Sum rewards: 48.030, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.825', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.213', 'weapon2': '0.608', 'WEAPON3': '1.300', 'HITCOUNT': '2.520', 'weapon3': '3.274', 'DAMAGECOUNT': '11.850', 'FRAGCOUNT': '42.000'} [2023-02-25 13:46:04,312][36157] DAMAGECOUNT value on done: 469127.0 [2023-02-25 13:46:04,312][36157] Sum rewards: 54.659, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.580', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.128', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.376', 'weapon2': '0.388', 'WEAPON3': '1.200', 'weapon3': '2.762', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '14.121', 'FRAGCOUNT': '47.000'} [2023-02-25 13:46:04,363][36140] DAMAGECOUNT value on done: 472393.0 [2023-02-25 13:46:04,363][36140] Sum rewards: 47.693, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.703', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.062', 'WEAPON5': '0.100', 'weapon2': '0.158', 'WEAPON4': '0.200', 'weapon4': '0.228', 'AMMO3': '0.255', 'WEAPON3': '1.500', 'HITCOUNT': '2.820', 'weapon3': '3.436', 'DAMAGECOUNT': '12.870', 'FRAGCOUNT': '42.000'} [2023-02-25 13:46:04,612][36157] DAMAGECOUNT value on done: 470952.0 [2023-02-25 13:46:04,613][36157] Sum rewards: 52.057, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.300', 'ARMOR': '0.004', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'weapon4': '0.066', 'weapon5': '0.120', 'AMMO4': '0.179', 'AMMO3': '0.190', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.662', 'WEAPON3': '1.150', 'HITCOUNT': '2.710', 'weapon3': '2.894', 'DAMAGECOUNT': '13.863', 'FRAGCOUNT': '46.000'} [2023-02-25 13:46:04,680][36140] DAMAGECOUNT value on done: 458419.0 [2023-02-25 13:46:04,681][36140] Sum rewards: 64.009, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.543', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon2': '0.158', 'AMMO4': '0.189', 'weapon5': '0.224', 'AMMO3': '0.225', 'WEAPON5': '0.500', 'weapon4': '0.530', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.816', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.401', 'FRAGCOUNT': '53.500'} [2023-02-25 13:46:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13426.6). Total num frames: 177721344. Throughput: 0: 3355.0. Samples: 6928568. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:46:04,730][36114] Avg episode reward: [(0, '53.783')] [2023-02-25 13:46:04,897][36140] DAMAGECOUNT value on done: 460647.0 [2023-02-25 13:46:04,898][36140] Sum rewards: 52.135, reward structure: {'DEATHCOUNT': '-14.250', 'ARMOR': '0.004', 'AMMO5': '0.015', 'HEALTH': '0.024', 'AMMO2': '0.055', 'weapon5': '0.140', 'AMMO3': '0.184', 'AMMO4': '0.275', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON4': '0.400', 'weapon4': '0.674', 'WEAPON3': '1.000', 'weapon3': '2.514', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.674', 'FRAGCOUNT': '44.000'} [2023-02-25 13:46:05,225][36140] DAMAGECOUNT value on done: 458669.0 [2023-02-25 13:46:05,225][36140] Sum rewards: 52.914, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.477', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.067', 'AMMO3': '0.208', 'weapon5': '0.210', 'weapon2': '0.270', 'AMMO4': '0.337', 'weapon4': '0.548', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.622', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '15.225', 'FRAGCOUNT': '48.000'} [2023-02-25 13:46:05,522][36156] DAMAGECOUNT value on done: 471895.0 [2023-02-25 13:46:05,523][36156] Sum rewards: 54.101, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.598', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'weapon5': '0.086', 'AMMO4': '0.130', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.296', 'weapon4': '0.326', 'WEAPON3': '1.350', 'HITCOUNT': '3.000', 'weapon3': '3.032', 'DAMAGECOUNT': '15.015', 'FRAGCOUNT': '46.000'} [2023-02-25 13:46:05,592][36156] DAMAGECOUNT value on done: 471377.0 [2023-02-25 13:46:05,592][36156] Sum rewards: 53.323, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.450', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO3': '0.179', 'weapon2': '0.932', 'WEAPON3': '1.050', 'HITCOUNT': '2.590', 'weapon3': '2.924', 'DAMAGECOUNT': '12.579', 'FRAGCOUNT': '44.000'} [2023-02-25 13:46:05,603][36142] DAMAGECOUNT value on done: 462872.0 [2023-02-25 13:46:05,604][36142] Sum rewards: 46.233, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.246', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon5': '0.172', 'weapon2': '0.210', 'AMMO4': '0.234', 'AMMO3': '0.265', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'weapon4': '0.678', 'WEAPON3': '1.600', 'weapon3': '2.642', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.166', 'FRAGCOUNT': '45.000'} [2023-02-25 13:46:05,753][36138] Updated weights for policy 0, policy_version 43393 (0.0009) [2023-02-25 13:46:05,833][36156] DAMAGECOUNT value on done: 462177.0 [2023-02-25 13:46:05,833][36156] Sum rewards: 52.399, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.162', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.051', 'AMMO3': '0.197', 'weapon5': '0.224', 'AMMO4': '0.256', 'weapon2': '0.384', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.562', 'WEAPON3': '1.200', 'weapon3': '2.504', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.901', 'FRAGCOUNT': '46.500'} [2023-02-25 13:46:05,906][36142] DAMAGECOUNT value on done: 454024.0 [2023-02-25 13:46:05,906][36142] Sum rewards: 52.813, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.927', 'ARMOR': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.040', 'weapon5': '0.094', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'WEAPON4': '0.350', 'weapon4': '0.366', 'weapon2': '0.460', 'WEAPON3': '0.900', 'HITCOUNT': '2.630', 'weapon3': '2.880', 'DAMAGECOUNT': '13.443', 'FRAGCOUNT': '44.000'} [2023-02-25 13:46:05,913][36156] DAMAGECOUNT value on done: 464821.0 [2023-02-25 13:46:05,914][36156] Sum rewards: 40.911, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.178', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.144', 'weapon2': '0.182', 'WEAPON5': '0.200', 'AMMO4': '0.230', 'AMMO3': '0.267', 'WEAPON4': '0.450', 'weapon4': '0.772', 'WEAPON3': '1.550', 'weapon3': '2.554', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '13.197', 'FRAGCOUNT': '39.000'} [2023-02-25 13:46:05,915][36142] DAMAGECOUNT value on done: 457703.0 [2023-02-25 13:46:05,916][36142] Sum rewards: 57.535, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.410', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'weapon4': '0.114', 'AMMO4': '0.135', 'weapon5': '0.146', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'weapon2': '0.494', 'WEAPON3': '1.350', 'HITCOUNT': '2.870', 'weapon3': '2.986', 'DAMAGECOUNT': '13.623', 'FRAGCOUNT': '50.000'} [2023-02-25 13:46:06,221][36142] DAMAGECOUNT value on done: 467842.0 [2023-02-25 13:46:06,222][36142] Sum rewards: 50.113, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.644', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon7': '0.042', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'AMMO4': '0.161', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.298', 'weapon2': '0.480', 'WEAPON3': '0.850', 'HITCOUNT': '2.470', 'weapon3': '3.024', 'DAMAGECOUNT': '11.163', 'FRAGCOUNT': '41.000'} [2023-02-25 13:46:08,114][36156] Large shaping reward 2.502 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.48, 160.0), ('weapon5', 0.002)] [2023-02-25 13:46:08,700][36138] Updated weights for policy 0, policy_version 43403 (0.0009) [2023-02-25 13:46:09,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 177790976. Throughput: 0: 3357.7. Samples: 6938696. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:46:09,729][36114] Avg episode reward: [(0, '53.626')] [2023-02-25 13:46:11,808][36138] Updated weights for policy 0, policy_version 43413 (0.0009) [2023-02-25 13:46:13,655][36155] DAMAGECOUNT value on done: 458520.0 [2023-02-25 13:46:13,656][36155] Sum rewards: 47.977, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.070', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.130', 'AMMO3': '0.173', 'AMMO4': '0.206', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon2': '0.560', 'weapon4': '0.992', 'WEAPON3': '1.100', 'weapon3': '2.096', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.852', 'FRAGCOUNT': '42.000'} [2023-02-25 13:46:13,969][36155] DAMAGECOUNT value on done: 474831.0 [2023-02-25 13:46:13,969][36155] Sum rewards: 62.803, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.044', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.152', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon2': '0.314', 'weapon4': '0.530', 'WEAPON3': '1.450', 'weapon3': '2.868', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.825', 'FRAGCOUNT': '55.000'} [2023-02-25 13:46:14,418][36139] DAMAGECOUNT value on done: 474610.0 [2023-02-25 13:46:14,418][36139] Sum rewards: 47.388, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.500', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.094', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'weapon5': '0.174', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.450', 'HITCOUNT': '2.460', 'weapon3': '3.134', 'DAMAGECOUNT': '12.921', 'FRAGCOUNT': '43.500'} [2023-02-25 13:46:14,502][36155] DAMAGECOUNT value on done: 469915.0 [2023-02-25 13:46:14,502][36155] Sum rewards: 56.573, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.726', 'AMMO5': '0.020', 'AMMO2': '0.035', 'AMMO4': '0.175', 'AMMO3': '0.199', 'weapon5': '0.256', 'weapon2': '0.324', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon4': '0.678', 'WEAPON3': '1.100', 'weapon3': '2.440', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.952', 'FRAGCOUNT': '50.000'} [2023-02-25 13:46:14,728][36139] DAMAGECOUNT value on done: 464338.0 [2023-02-25 13:46:14,728][36139] Sum rewards: 54.895, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.684', 'AMMO5': '0.007', 'AMMO2': '0.047', 'weapon4': '0.138', 'weapon5': '0.152', 'WEAPON5': '0.200', 'AMMO4': '0.237', 'AMMO3': '0.262', 'WEAPON4': '0.400', 'weapon2': '0.478', 'WEAPON3': '1.600', 'HITCOUNT': '2.860', 'weapon3': '2.962', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '51.000'} [2023-02-25 13:46:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 177856512. Throughput: 0: 3358.8. Samples: 6958836. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:46:14,730][36114] Avg episode reward: [(0, '53.635')] [2023-02-25 13:46:14,830][36155] DAMAGECOUNT value on done: 463719.0 [2023-02-25 13:46:14,831][36155] Sum rewards: 47.226, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.257', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon5': '0.158', 'AMMO4': '0.186', 'AMMO3': '0.205', 'weapon2': '0.240', 'weapon4': '0.438', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '2.600', 'weapon3': '2.874', 'DAMAGECOUNT': '12.177', 'FRAGCOUNT': '43.500'} [2023-02-25 13:46:14,861][36138] Updated weights for policy 0, policy_version 43423 (0.0010) [2023-02-25 13:46:15,394][36139] DAMAGECOUNT value on done: 469774.0 [2023-02-25 13:46:15,395][36139] Sum rewards: 61.836, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.250', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon5': '0.032', 'AMMO4': '0.121', 'WEAPON5': '0.200', 'AMMO3': '0.271', 'weapon2': '0.394', 'WEAPON3': '1.650', 'HITCOUNT': '3.370', 'weapon3': '3.378', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '53.000'} [2023-02-25 13:46:15,706][36139] DAMAGECOUNT value on done: 470315.0 [2023-02-25 13:46:15,706][36139] Sum rewards: 62.505, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.950', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.016', 'WEAPON5': '0.100', 'AMMO3': '0.210', 'weapon2': '0.290', 'WEAPON3': '1.400', 'HITCOUNT': '3.130', 'weapon3': '3.540', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '54.000'} [2023-02-25 13:46:16,618][36139] Large shaping reward 2.514 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.492, 164.0), ('weapon5', 0.002)] [2023-02-25 13:46:17,978][36138] Updated weights for policy 0, policy_version 43433 (0.0009) [2023-02-25 13:46:19,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13426.6). Total num frames: 177922048. Throughput: 0: 3352.8. Samples: 6978684. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:46:19,730][36114] Avg episode reward: [(0, '53.548')] [2023-02-25 13:46:21,029][36138] Updated weights for policy 0, policy_version 43443 (0.0009) [2023-02-25 13:46:21,459][36154] DAMAGECOUNT value on done: 470852.0 [2023-02-25 13:46:21,459][36154] Sum rewards: 52.030, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.976', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.090', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon2': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.640', 'WEAPON3': '1.200', 'weapon3': '2.804', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '14.094', 'FRAGCOUNT': '44.000'} [2023-02-25 13:46:21,782][36154] DAMAGECOUNT value on done: 462425.0 [2023-02-25 13:46:21,783][36154] Sum rewards: 48.156, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.725', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon5': '0.148', 'AMMO3': '0.154', 'AMMO4': '0.201', 'weapon4': '0.396', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.626', 'WEAPON3': '0.950', 'weapon3': '2.598', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.593', 'FRAGCOUNT': '41.000'} [2023-02-25 13:46:22,087][36154] DAMAGECOUNT value on done: 467556.0 [2023-02-25 13:46:22,088][36154] Sum rewards: 51.160, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.930', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.032', 'weapon5': '0.122', 'AMMO4': '0.160', 'AMMO3': '0.262', 'weapon4': '0.282', 'weapon2': '0.286', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.998', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.727', 'FRAGCOUNT': '48.000'} [2023-02-25 13:46:22,405][36154] DAMAGECOUNT value on done: 469172.0 [2023-02-25 13:46:22,405][36154] Sum rewards: 45.611, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.227', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.148', 'weapon4': '0.194', 'WEAPON4': '0.200', 'weapon5': '0.248', 'WEAPON5': '0.300', 'weapon2': '0.434', 'WEAPON3': '0.950', 'HITCOUNT': '2.280', 'weapon3': '2.876', 'DAMAGECOUNT': '11.019', 'FRAGCOUNT': '40.000'} [2023-02-25 13:46:22,532][36141] DAMAGECOUNT value on done: 477827.0 [2023-02-25 13:46:22,532][36141] Sum rewards: 56.752, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.850', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon5': '0.108', 'AMMO4': '0.165', 'AMMO3': '0.254', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.414', 'weapon4': '0.634', 'WEAPON3': '1.450', 'weapon3': '2.598', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.460', 'FRAGCOUNT': '52.000'} [2023-02-25 13:46:22,811][36141] DAMAGECOUNT value on done: 461757.0 [2023-02-25 13:46:22,812][36141] Sum rewards: 55.249, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.510', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'weapon4': '0.252', 'weapon2': '0.274', 'WEAPON3': '1.500', 'weapon3': '3.216', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.456', 'FRAGCOUNT': '49.000'} [2023-02-25 13:46:22,854][36141] DAMAGECOUNT value on done: 476126.0 [2023-02-25 13:46:22,855][36141] Sum rewards: 60.300, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.113', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.110', 'weapon5': '0.140', 'AMMO4': '0.153', 'AMMO3': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.100', 'HITCOUNT': '3.070', 'weapon3': '3.204', 'DAMAGECOUNT': '14.781', 'FRAGCOUNT': '51.000'} [2023-02-25 13:46:23,135][36141] DAMAGECOUNT value on done: 458376.0 [2023-02-25 13:46:23,136][36141] Sum rewards: 45.675, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.940', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.197', 'AMMO3': '0.215', 'weapon2': '0.228', 'WEAPON4': '0.450', 'weapon4': '0.950', 'WEAPON3': '1.200', 'weapon3': '2.492', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.053', 'FRAGCOUNT': '41.500'} [2023-02-25 13:46:23,492][36157] DAMAGECOUNT value on done: 480564.0 [2023-02-25 13:46:23,492][36157] Sum rewards: 48.764, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.410', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.072', 'weapon4': '0.186', 'AMMO4': '0.189', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.200', 'HITCOUNT': '2.780', 'weapon3': '3.132', 'DAMAGECOUNT': '13.008', 'FRAGCOUNT': '45.000'} [2023-02-25 13:46:23,808][36157] DAMAGECOUNT value on done: 467898.0 [2023-02-25 13:46:23,808][36157] Sum rewards: 58.102, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.348', 'AMMO5': '0.017', 'AMMO2': '0.035', 'AMMO3': '0.122', 'AMMO4': '0.173', 'weapon5': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.392', 'weapon2': '0.436', 'WEAPON3': '0.850', 'weapon3': '2.662', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.148', 'FRAGCOUNT': '48.000'} [2023-02-25 13:46:24,109][36138] Updated weights for policy 0, policy_version 43453 (0.0009) [2023-02-25 13:46:24,413][36157] DAMAGECOUNT value on done: 474517.0 [2023-02-25 13:46:24,413][36157] Sum rewards: 65.090, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.866', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.272', 'AMMO3': '0.278', 'weapon2': '0.392', 'WEAPON3': '1.550', 'weapon3': '2.972', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '58.000'} [2023-02-25 13:46:24,435][36140] DAMAGECOUNT value on done: 476563.0 [2023-02-25 13:46:24,436][36140] Sum rewards: 48.350, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.663', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.052', 'weapon7': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.215', 'weapon2': '0.236', 'AMMO3': '0.244', 'WEAPON4': '0.350', 'weapon4': '0.976', 'WEAPON3': '1.350', 'weapon3': '2.346', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '12.510', 'FRAGCOUNT': '45.000'} [2023-02-25 13:46:24,703][36157] DAMAGECOUNT value on done: 475568.0 [2023-02-25 13:46:24,704][36157] Sum rewards: 53.852, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.730', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'weapon2': '0.172', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'weapon4': '0.320', 'WEAPON3': '1.250', 'HITCOUNT': '3.020', 'weapon3': '3.282', 'DAMAGECOUNT': '13.848', 'FRAGCOUNT': '47.000'} [2023-02-25 13:46:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13426.6). Total num frames: 177991680. Throughput: 0: 3353.0. Samples: 6988740. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:46:24,730][36114] Avg episode reward: [(0, '53.570')] [2023-02-25 13:46:24,749][36140] DAMAGECOUNT value on done: 462332.0 [2023-02-25 13:46:24,749][36140] Sum rewards: 44.021, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.900', 'AMMO5': '0.017', 'AMMO2': '0.042', 'AMMO3': '0.133', 'weapon5': '0.184', 'AMMO4': '0.209', 'weapon2': '0.314', 'ARMOR': '0.458', 'WEAPON5': '0.500', 'WEAPON4': '0.800', 'WEAPON3': '0.900', 'weapon4': '1.112', 'weapon3': '2.012', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '11.739', 'FRAGCOUNT': '38.000'} [2023-02-25 13:46:24,845][36155] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:46:25,013][36140] DAMAGECOUNT value on done: 465197.0 [2023-02-25 13:46:25,014][36140] Sum rewards: 52.055, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.800', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon4': '0.320', 'weapon2': '0.506', 'WEAPON3': '1.100', 'weapon3': '2.914', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '13.650', 'FRAGCOUNT': '44.000'} [2023-02-25 13:46:25,311][36140] DAMAGECOUNT value on done: 463120.0 [2023-02-25 13:46:25,311][36140] Sum rewards: 45.524, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.060', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.162', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon4': '0.234', 'WEAPON4': '0.350', 'weapon2': '0.432', 'WEAPON3': '1.300', 'HITCOUNT': '2.750', 'weapon3': '2.872', 'DAMAGECOUNT': '13.353', 'FRAGCOUNT': '42.000'} [2023-02-25 13:46:25,674][36156] DAMAGECOUNT value on done: 477125.0 [2023-02-25 13:46:25,674][36156] Sum rewards: 59.923, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.382', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.128', 'weapon2': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'weapon4': '0.286', 'WEAPON3': '1.500', 'weapon3': '3.092', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '53.000'} [2023-02-25 13:46:25,686][36142] DAMAGECOUNT value on done: 468081.0 [2023-02-25 13:46:25,686][36142] Sum rewards: 60.426, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.531', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.148', 'weapon2': '0.178', 'AMMO3': '0.185', 'AMMO4': '0.204', 'WEAPON5': '0.300', 'weapon4': '0.384', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '3.068', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.627', 'FRAGCOUNT': '52.000'} [2023-02-25 13:46:25,748][36156] DAMAGECOUNT value on done: 475837.0 [2023-02-25 13:46:25,748][36156] Sum rewards: 57.125, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.139', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.029', 'weapon5': '0.098', 'AMMO4': '0.145', 'weapon4': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.224', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '3.010', 'weapon3': '3.074', 'DAMAGECOUNT': '13.380', 'FRAGCOUNT': '51.000'} [2023-02-25 13:46:25,985][36156] DAMAGECOUNT value on done: 466101.0 [2023-02-25 13:46:25,986][36156] Sum rewards: 49.272, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.555', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.126', 'WEAPON4': '0.150', 'weapon4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.674', 'WEAPON3': '1.300', 'HITCOUNT': '2.460', 'weapon3': '2.872', 'DAMAGECOUNT': '11.772', 'FRAGCOUNT': '43.000'} [2023-02-25 13:46:25,989][36142] DAMAGECOUNT value on done: 459529.0 [2023-02-25 13:46:25,990][36142] Sum rewards: 62.616, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.060', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.056', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'AMMO3': '0.254', 'weapon2': '0.276', 'WEAPON4': '0.300', 'weapon4': '0.336', 'WEAPON3': '1.450', 'weapon3': '3.078', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.515', 'FRAGCOUNT': '56.000'} [2023-02-25 13:46:25,999][36142] DAMAGECOUNT value on done: 462019.0 [2023-02-25 13:46:26,000][36142] Sum rewards: 39.727, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.930', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon5': '0.142', 'AMMO3': '0.221', 'AMMO4': '0.256', 'WEAPON5': '0.350', 'ARMOR': '0.459', 'weapon2': '0.586', 'WEAPON4': '0.700', 'weapon4': '0.768', 'WEAPON3': '1.250', 'weapon3': '2.160', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.948', 'FRAGCOUNT': '39.000'} [2023-02-25 13:46:26,064][36156] DAMAGECOUNT value on done: 469230.0 [2023-02-25 13:46:26,064][36156] Sum rewards: 51.309, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.030', 'AMMO5': '0.010', 'AMMO2': '0.044', 'AMMO3': '0.176', 'weapon5': '0.212', 'AMMO4': '0.218', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON4': '0.400', 'weapon4': '0.644', 'WEAPON3': '1.050', 'weapon3': '2.630', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '13.227', 'FRAGCOUNT': '44.000'} [2023-02-25 13:46:26,306][36142] DAMAGECOUNT value on done: 471504.0 [2023-02-25 13:46:26,307][36142] Sum rewards: 40.198, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.709', 'ARMOR': '0.004', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon7': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.123', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.484', 'weapon2': '0.678', 'WEAPON3': '0.850', 'HITCOUNT': '2.340', 'weapon3': '2.408', 'DAMAGECOUNT': '10.986', 'FRAGCOUNT': '33.000'} [2023-02-25 13:46:27,065][36138] Updated weights for policy 0, policy_version 43463 (0.0009) [2023-02-25 13:46:29,336][36141] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 13:46:29,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13426.6). Total num frames: 178057216. Throughput: 0: 3359.8. Samples: 7009066. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:46:29,730][36114] Avg episode reward: [(0, '53.261')] [2023-02-25 13:46:30,103][36138] Updated weights for policy 0, policy_version 43473 (0.0010) [2023-02-25 13:46:33,155][36138] Updated weights for policy 0, policy_version 43483 (0.0009) [2023-02-25 13:46:33,743][36155] DAMAGECOUNT value on done: 463493.0 [2023-02-25 13:46:33,744][36155] Sum rewards: 55.828, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.401', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'weapon4': '0.158', 'weapon5': '0.184', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'weapon2': '0.322', 'WEAPON3': '1.500', 'weapon3': '3.036', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '50.000'} [2023-02-25 13:46:34,026][36155] DAMAGECOUNT value on done: 478546.0 [2023-02-25 13:46:34,026][36155] Sum rewards: 42.881, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.830', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.094', 'AMMO3': '0.137', 'AMMO4': '0.157', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.596', 'weapon2': '0.814', 'WEAPON3': '0.950', 'weapon3': '2.276', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '11.145', 'FRAGCOUNT': '38.000'} [2023-02-25 13:46:34,554][36139] DAMAGECOUNT value on done: 480075.0 [2023-02-25 13:46:34,555][36139] Sum rewards: 60.171, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.763', 'AMMO2': '0.011', 'AMMO4': '0.055', 'AMMO3': '0.208', 'weapon2': '0.716', 'WEAPON3': '1.350', 'weapon3': '3.078', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '50.000'} [2023-02-25 13:46:34,610][36155] DAMAGECOUNT value on done: 474696.0 [2023-02-25 13:46:34,610][36155] Sum rewards: 45.913, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.552', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.100', 'AMMO4': '0.147', 'weapon4': '0.228', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.432', 'WEAPON3': '1.400', 'HITCOUNT': '2.830', 'weapon3': '2.944', 'DAMAGECOUNT': '14.256', 'FRAGCOUNT': '41.000'} [2023-02-25 13:46:34,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13426.6). Total num frames: 178122752. Throughput: 0: 3358.0. Samples: 7029298. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:46:34,729][36114] Avg episode reward: [(0, '53.262')] [2023-02-25 13:46:34,857][36139] DAMAGECOUNT value on done: 469351.0 [2023-02-25 13:46:34,858][36139] Sum rewards: 54.772, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.435', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.046', 'AMMO3': '0.167', 'weapon5': '0.206', 'AMMO4': '0.230', 'WEAPON5': '0.400', 'weapon2': '0.408', 'WEAPON4': '0.550', 'weapon4': '0.608', 'WEAPON3': '1.100', 'weapon3': '2.544', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.039', 'FRAGCOUNT': '48.000'} [2023-02-25 13:46:34,924][36155] DAMAGECOUNT value on done: 468011.0 [2023-02-25 13:46:34,925][36155] Sum rewards: 49.508, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.898', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.066', 'AMMO3': '0.169', 'weapon5': '0.238', 'AMMO4': '0.328', 'weapon2': '0.456', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.632', 'WEAPON3': '0.900', 'weapon3': '2.330', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.831', 'FRAGCOUNT': '43.000'} [2023-02-25 13:46:35,509][36139] DAMAGECOUNT value on done: 474497.0 [2023-02-25 13:46:35,509][36139] Sum rewards: 51.583, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.601', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon5': '0.108', 'weapon4': '0.164', 'AMMO4': '0.215', 'AMMO3': '0.285', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.434', 'WEAPON3': '1.700', 'HITCOUNT': '2.870', 'weapon3': '2.982', 'DAMAGECOUNT': '14.169', 'FRAGCOUNT': '51.000'} [2023-02-25 13:46:35,806][36139] DAMAGECOUNT value on done: 475057.0 [2023-02-25 13:46:35,806][36139] Sum rewards: 49.356, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.440', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.039', 'AMMO4': '0.193', 'weapon5': '0.212', 'AMMO3': '0.226', 'WEAPON5': '0.350', 'weapon4': '0.464', 'weapon2': '0.478', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.512', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '14.226', 'FRAGCOUNT': '46.000'} [2023-02-25 13:46:36,275][36138] Updated weights for policy 0, policy_version 43493 (0.0010) [2023-02-25 13:46:39,266][36138] Updated weights for policy 0, policy_version 43503 (0.0009) [2023-02-25 13:46:39,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 178192384. Throughput: 0: 3359.2. Samples: 7039410. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:46:39,730][36114] Avg episode reward: [(0, '53.092')] [2023-02-25 13:46:41,359][36154] DAMAGECOUNT value on done: 476406.0 [2023-02-25 13:46:41,359][36154] Sum rewards: 64.756, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.746', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.022', 'weapon2': '0.176', 'weapon5': '0.208', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.502', 'WEAPON3': '1.350', 'weapon3': '2.772', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '55.000'} [2023-02-25 13:46:41,662][36154] DAMAGECOUNT value on done: 467565.0 [2023-02-25 13:46:41,662][36154] Sum rewards: 61.870, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.650', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.139', 'AMMO3': '0.152', 'weapon2': '0.274', 'WEAPON4': '0.350', 'weapon4': '0.948', 'WEAPON3': '0.950', 'weapon3': '2.470', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '52.000'} [2023-02-25 13:46:41,961][36154] DAMAGECOUNT value on done: 471545.0 [2023-02-25 13:46:41,962][36154] Sum rewards: 48.303, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.854', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.100', 'AMMO3': '0.160', 'weapon2': '0.436', 'weapon4': '0.584', 'WEAPON3': '1.000', 'HITCOUNT': '2.550', 'weapon3': '2.816', 'DAMAGECOUNT': '11.967', 'FRAGCOUNT': '40.000'} [2023-02-25 13:46:42,258][36154] DAMAGECOUNT value on done: 473963.0 [2023-02-25 13:46:42,259][36154] Sum rewards: 55.948, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.622', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon4': '0.176', 'weapon2': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.245', 'WEAPON3': '1.600', 'HITCOUNT': '3.130', 'weapon3': '3.408', 'DAMAGECOUNT': '14.373', 'FRAGCOUNT': '51.000'} [2023-02-25 13:46:42,308][36138] Updated weights for policy 0, policy_version 43513 (0.0010) [2023-02-25 13:46:42,478][36141] DAMAGECOUNT value on done: 481752.0 [2023-02-25 13:46:42,479][36141] Sum rewards: 42.521, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.600', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.056', 'AMMO3': '0.103', 'AMMO4': '0.281', 'weapon5': '0.296', 'WEAPON5': '0.500', 'weapon2': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '0.700', 'weapon4': '0.768', 'weapon3': '1.910', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '11.775', 'FRAGCOUNT': '37.000'} [2023-02-25 13:46:42,672][36141] DAMAGECOUNT value on done: 466709.0 [2023-02-25 13:46:42,672][36141] Sum rewards: 62.376, reward structure: {'DEATHCOUNT': '-12.000', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.023', 'HEALTH': '0.107', 'AMMO4': '0.113', 'weapon5': '0.118', 'AMMO3': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.324', 'weapon2': '0.468', 'WEAPON3': '0.850', 'weapon3': '2.900', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.856', 'FRAGCOUNT': '51.000'} [2023-02-25 13:46:42,789][36141] DAMAGECOUNT value on done: 480406.0 [2023-02-25 13:46:42,789][36141] Sum rewards: 45.350, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.170', 'AMMO5': '0.018', 'AMMO2': '0.027', 'AMMO4': '0.136', 'AMMO3': '0.184', 'weapon5': '0.208', 'weapon4': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.550', 'WEAPON3': '1.100', 'HITCOUNT': '2.660', 'weapon3': '2.802', 'DAMAGECOUNT': '12.840', 'FRAGCOUNT': '41.000'} [2023-02-25 13:46:42,995][36141] DAMAGECOUNT value on done: 462856.0 [2023-02-25 13:46:42,995][36141] Sum rewards: 50.339, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.639', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon2': '0.422', 'weapon4': '0.582', 'WEAPON3': '1.250', 'weapon3': '2.476', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '13.428', 'FRAGCOUNT': '43.000'} [2023-02-25 13:46:43,444][36157] DAMAGECOUNT value on done: 485001.0 [2023-02-25 13:46:43,444][36157] Sum rewards: 52.024, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.560', 'AMMO5': '0.005', 'AMMO2': '0.028', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'weapon5': '0.174', 'AMMO3': '0.204', 'weapon2': '0.344', 'WEAPON4': '0.350', 'weapon4': '0.570', 'WEAPON3': '1.200', 'weapon3': '2.686', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.311', 'FRAGCOUNT': '48.000'} [2023-02-25 13:46:43,781][36157] DAMAGECOUNT value on done: 471569.0 [2023-02-25 13:46:43,781][36157] Sum rewards: 40.554, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.165', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.059', 'weapon7': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.188', 'WEAPON7': '0.200', 'weapon5': '0.248', 'weapon2': '0.286', 'AMMO4': '0.297', 'WEAPON5': '0.550', 'WEAPON4': '0.700', 'weapon4': '0.976', 'WEAPON3': '1.100', 'weapon3': '2.040', 'HITCOUNT': '2.220', 'DAMAGECOUNT': '11.013', 'FRAGCOUNT': '40.000'} [2023-02-25 13:46:44,336][36140] DAMAGECOUNT value on done: 480632.0 [2023-02-25 13:46:44,336][36140] Sum rewards: 43.147, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.008', 'AMMO2': '0.045', 'HEALTH': '0.144', 'AMMO3': '0.153', 'weapon4': '0.176', 'AMMO4': '0.227', 'WEAPON5': '0.250', 'weapon5': '0.268', 'WEAPON4': '0.400', 'weapon2': '0.448', 'WEAPON3': '0.800', 'HITCOUNT': '2.380', 'weapon3': '2.890', 'DAMAGECOUNT': '12.207', 'FRAGCOUNT': '35.500'} [2023-02-25 13:46:44,398][36157] DAMAGECOUNT value on done: 478872.0 [2023-02-25 13:46:44,398][36157] Sum rewards: 41.366, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.252', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.040', 'WEAPON5': '0.100', 'weapon5': '0.122', 'AMMO4': '0.202', 'AMMO3': '0.233', 'weapon2': '0.358', 'WEAPON4': '0.500', 'weapon4': '0.538', 'WEAPON3': '1.400', 'weapon3': '2.542', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '13.065', 'FRAGCOUNT': '40.000'} [2023-02-25 13:46:44,638][36140] DAMAGECOUNT value on done: 466826.0 [2023-02-25 13:46:44,638][36140] Sum rewards: 46.079, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.384', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.050', 'AMMO3': '0.132', 'weapon5': '0.154', 'weapon2': '0.214', 'WEAPON5': '0.250', 'AMMO4': '0.252', 'WEAPON4': '0.500', 'WEAPON3': '0.800', 'weapon4': '1.218', 'weapon3': '2.174', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.482', 'FRAGCOUNT': '38.000'} [2023-02-25 13:46:44,700][36157] DAMAGECOUNT value on done: 480118.0 [2023-02-25 13:46:44,700][36157] Sum rewards: 49.991, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.265', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO3': '0.134', 'weapon5': '0.170', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.400', 'ARMOR': '0.464', 'weapon2': '0.826', 'WEAPON3': '0.850', 'weapon3': '2.308', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.650', 'FRAGCOUNT': '41.500'} [2023-02-25 13:46:44,729][36114] Fps is (10 sec: 13926.2, 60 sec: 13516.8, 300 sec: 13440.4). Total num frames: 178262016. Throughput: 0: 3359.2. Samples: 7059614. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:46:44,730][36114] Avg episode reward: [(0, '52.532')] [2023-02-25 13:46:44,884][36140] DAMAGECOUNT value on done: 469971.0 [2023-02-25 13:46:44,885][36140] Sum rewards: 54.818, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.210', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.118', 'AMMO3': '0.140', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON4': '0.350', 'weapon4': '0.364', 'WEAPON3': '0.850', 'weapon3': '3.026', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.322', 'FRAGCOUNT': '45.000'} [2023-02-25 13:46:45,186][36140] DAMAGECOUNT value on done: 467858.0 [2023-02-25 13:46:45,186][36140] Sum rewards: 54.011, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.320', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.094', 'AMMO3': '0.159', 'AMMO4': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.476', 'weapon4': '0.588', 'WEAPON3': '0.900', 'weapon3': '2.500', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.214', 'FRAGCOUNT': '43.000'} [2023-02-25 13:46:45,337][36138] Updated weights for policy 0, policy_version 43523 (0.0010) [2023-02-25 13:46:45,567][36142] DAMAGECOUNT value on done: 473791.0 [2023-02-25 13:46:45,567][36142] Sum rewards: 68.070, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.165', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.052', 'weapon5': '0.054', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.203', 'weapon2': '0.532', 'WEAPON3': '1.300', 'weapon3': '3.160', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '56.000'} [2023-02-25 13:46:45,645][36156] DAMAGECOUNT value on done: 482177.0 [2023-02-25 13:46:45,646][36156] Sum rewards: 53.158, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.634', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.076', 'AMMO3': '0.188', 'weapon5': '0.258', 'weapon2': '0.360', 'AMMO4': '0.378', 'WEAPON5': '0.500', 'weapon4': '0.710', 'WEAPON4': '0.850', 'WEAPON3': '1.100', 'weapon3': '2.354', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.156', 'FRAGCOUNT': '49.000'} [2023-02-25 13:46:45,719][36156] DAMAGECOUNT value on done: 480938.0 [2023-02-25 13:46:45,720][36156] Sum rewards: 58.790, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.590', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.060', 'AMMO3': '0.163', 'weapon2': '0.266', 'AMMO4': '0.302', 'weapon5': '0.414', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'weapon4': '0.990', 'WEAPON3': '1.050', 'weapon3': '2.004', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.303', 'FRAGCOUNT': '52.000'} [2023-02-25 13:46:45,878][36142] DAMAGECOUNT value on done: 464183.0 [2023-02-25 13:46:45,878][36142] Sum rewards: 61.607, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.870', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.043', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'weapon2': '0.328', 'WEAPON3': '1.200', 'HITCOUNT': '2.900', 'weapon3': '3.368', 'DAMAGECOUNT': '13.962', 'FRAGCOUNT': '54.000'} [2023-02-25 13:46:45,890][36142] DAMAGECOUNT value on done: 466628.0 [2023-02-25 13:46:45,890][36142] Sum rewards: 56.059, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.405', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.104', 'AMMO4': '0.111', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.494', 'weapon2': '0.564', 'WEAPON3': '1.050', 'weapon3': '2.596', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.827', 'FRAGCOUNT': '47.000'} [2023-02-25 13:46:45,955][36156] DAMAGECOUNT value on done: 470801.0 [2023-02-25 13:46:45,955][36156] Sum rewards: 53.607, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.970', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.078', 'AMMO4': '0.159', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.288', 'weapon2': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.910', 'weapon3': '3.020', 'DAMAGECOUNT': '14.100', 'FRAGCOUNT': '47.000'} [2023-02-25 13:46:46,035][36156] DAMAGECOUNT value on done: 473230.0 [2023-02-25 13:46:46,036][36156] Sum rewards: 49.193, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.994', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.102', 'weapon4': '0.126', 'AMMO4': '0.138', 'weapon2': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.248', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '2.540', 'weapon3': '3.328', 'DAMAGECOUNT': '12.000', 'FRAGCOUNT': '45.000'} [2023-02-25 13:46:46,188][36142] DAMAGECOUNT value on done: 476929.0 [2023-02-25 13:46:46,188][36142] Sum rewards: 59.227, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.898', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.156', 'AMMO4': '0.209', 'AMMO3': '0.223', 'WEAPON5': '0.300', 'weapon4': '0.308', 'weapon2': '0.322', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.874', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '53.000'} [2023-02-25 13:46:48,374][36138] Updated weights for policy 0, policy_version 43533 (0.0009) [2023-02-25 13:46:49,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13426.6). Total num frames: 178327552. Throughput: 0: 3360.0. Samples: 7079766. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:46:49,730][36114] Avg episode reward: [(0, '52.856')] [2023-02-25 13:46:50,690][36142] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:46:51,359][36157] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:46:51,412][36138] Updated weights for policy 0, policy_version 43543 (0.0009) [2023-02-25 13:46:53,486][36155] DAMAGECOUNT value on done: 467584.0 [2023-02-25 13:46:53,487][36155] Sum rewards: 39.401, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.296', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.047', 'AMMO3': '0.193', 'weapon5': '0.206', 'AMMO4': '0.235', 'WEAPON5': '0.250', 'weapon2': '0.358', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'weapon4': '1.188', 'weapon3': '1.878', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.207', 'FRAGCOUNT': '37.000'} [2023-02-25 13:46:53,784][36155] DAMAGECOUNT value on done: 483718.0 [2023-02-25 13:46:53,785][36155] Sum rewards: 55.305, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.720', 'AMMO5': '0.011', 'AMMO2': '0.020', 'weapon5': '0.068', 'AMMO4': '0.099', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.362', 'weapon4': '0.464', 'WEAPON3': '1.200', 'weapon3': '2.848', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.516', 'FRAGCOUNT': '48.000'} [2023-02-25 13:46:54,354][36155] DAMAGECOUNT value on done: 479782.0 [2023-02-25 13:46:54,354][36155] Sum rewards: 54.153, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.730', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon5': '0.202', 'AMMO3': '0.208', 'weapon2': '0.234', 'AMMO4': '0.271', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.658', 'WEAPON3': '1.250', 'weapon3': '2.632', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.018', 'FRAGCOUNT': '48.000'} [2023-02-25 13:46:54,473][36138] Updated weights for policy 0, policy_version 43553 (0.0009) [2023-02-25 13:46:54,538][36139] DAMAGECOUNT value on done: 483905.0 [2023-02-25 13:46:54,539][36139] Sum rewards: 36.635, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.140', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.059', 'weapon5': '0.186', 'AMMO3': '0.193', 'AMMO4': '0.294', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON4': '0.600', 'weapon4': '0.652', 'WEAPON3': '1.100', 'HITCOUNT': '2.350', 'weapon3': '2.364', 'DAMAGECOUNT': '11.487', 'FRAGCOUNT': '36.000'} [2023-02-25 13:46:54,668][36155] DAMAGECOUNT value on done: 472256.0 [2023-02-25 13:46:54,668][36155] Sum rewards: 53.036, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.182', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'weapon2': '0.364', 'weapon4': '0.422', 'WEAPON3': '0.950', 'HITCOUNT': '2.710', 'weapon3': '3.008', 'DAMAGECOUNT': '12.735', 'FRAGCOUNT': '44.000'} [2023-02-25 13:46:54,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13448.5, 300 sec: 13426.6). Total num frames: 178393088. Throughput: 0: 3360.8. Samples: 7089932. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:46:54,730][36114] Avg episode reward: [(0, '52.508')] [2023-02-25 13:46:54,852][36139] DAMAGECOUNT value on done: 473632.0 [2023-02-25 13:46:54,853][36139] Sum rewards: 47.892, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.856', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.052', 'weapon5': '0.190', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'AMMO4': '0.258', 'weapon2': '0.270', 'WEAPON4': '0.450', 'weapon4': '0.622', 'WEAPON3': '1.200', 'weapon3': '2.568', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.843', 'FRAGCOUNT': '43.000'} [2023-02-25 13:46:55,461][36139] DAMAGECOUNT value on done: 480313.0 [2023-02-25 13:46:55,462][36139] Sum rewards: 69.400, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.785', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.034', 'weapon5': '0.090', 'WEAPON4': '0.150', 'AMMO4': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.269', 'weapon2': '0.304', 'WEAPON3': '1.600', 'weapon3': '3.300', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '61.000'} [2023-02-25 13:46:55,765][36139] DAMAGECOUNT value on done: 479482.0 [2023-02-25 13:46:55,765][36139] Sum rewards: 47.165, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.268', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.082', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'weapon2': '0.254', 'weapon4': '0.318', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '2.940', 'weapon3': '3.206', 'DAMAGECOUNT': '13.275', 'FRAGCOUNT': '39.500'} [2023-02-25 13:46:57,523][36138] Updated weights for policy 0, policy_version 43563 (0.0009) [2023-02-25 13:46:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13426.6). Total num frames: 178462720. Throughput: 0: 3360.9. Samples: 7110078. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:46:59,729][36114] Avg episode reward: [(0, '52.565')] [2023-02-25 13:47:00,532][36138] Updated weights for policy 0, policy_version 43573 (0.0009) [2023-02-25 13:47:01,315][36154] DAMAGECOUNT value on done: 481065.0 [2023-02-25 13:47:01,315][36154] Sum rewards: 50.112, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.760', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.148', 'AMMO3': '0.182', 'AMMO4': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.572', 'weapon4': '0.698', 'WEAPON3': '1.100', 'weapon3': '2.334', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.977', 'FRAGCOUNT': '44.000'} [2023-02-25 13:47:01,634][36154] DAMAGECOUNT value on done: 473106.0 [2023-02-25 13:47:01,634][36154] Sum rewards: 59.818, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.240', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.057', 'weapon5': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.212', 'AMMO3': '0.255', 'weapon2': '0.488', 'WEAPON3': '1.550', 'weapon3': '2.912', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '53.000'} [2023-02-25 13:47:01,954][36154] DAMAGECOUNT value on done: 476124.0 [2023-02-25 13:47:01,954][36154] Sum rewards: 53.283, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.007', 'HEALTH': '0.018', 'AMMO2': '0.033', 'AMMO3': '0.138', 'weapon5': '0.138', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'WEAPON4': '0.250', 'weapon2': '0.484', 'weapon4': '0.572', 'WEAPON3': '0.800', 'weapon3': '2.620', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.737', 'FRAGCOUNT': '43.000'} [2023-02-25 13:47:02,258][36154] DAMAGECOUNT value on done: 478876.0 [2023-02-25 13:47:02,259][36154] Sum rewards: 58.515, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.602', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon5': '0.148', 'AMMO4': '0.166', 'AMMO3': '0.210', 'weapon2': '0.312', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.412', 'WEAPON3': '1.200', 'weapon3': '2.832', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '51.000'} [2023-02-25 13:47:02,509][36141] DAMAGECOUNT value on done: 485913.0 [2023-02-25 13:47:02,509][36141] Sum rewards: 50.494, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.721', 'ARMOR': '0.004', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'AMMO3': '0.139', 'weapon4': '0.252', 'weapon2': '0.626', 'WEAPON3': '1.000', 'weapon3': '2.590', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '12.483', 'FRAGCOUNT': '41.000'} [2023-02-25 13:47:02,686][36141] DAMAGECOUNT value on done: 472143.0 [2023-02-25 13:47:02,687][36141] Sum rewards: 67.140, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.736', 'AMMO5': '0.011', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.120', 'weapon4': '0.132', 'weapon2': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'WEAPON3': '1.300', 'HITCOUNT': '3.070', 'weapon3': '3.396', 'DAMAGECOUNT': '16.233', 'FRAGCOUNT': '58.000'} [2023-02-25 13:47:02,817][36141] DAMAGECOUNT value on done: 485541.0 [2023-02-25 13:47:02,817][36141] Sum rewards: 59.326, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.002', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.054', 'weapon2': '0.116', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon4': '0.594', 'WEAPON3': '1.250', 'weapon3': '3.068', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '50.000'} [2023-02-25 13:47:02,996][36141] DAMAGECOUNT value on done: 467202.0 [2023-02-25 13:47:02,997][36141] Sum rewards: 49.020, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.850', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO3': '0.207', 'weapon2': '0.246', 'WEAPON3': '1.250', 'HITCOUNT': '2.710', 'weapon3': '3.668', 'DAMAGECOUNT': '13.038', 'FRAGCOUNT': '41.000'} [2023-02-25 13:47:03,300][36157] DAMAGECOUNT value on done: 489190.0 [2023-02-25 13:47:03,301][36157] Sum rewards: 50.366, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.510', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.192', 'WEAPON4': '0.300', 'weapon2': '0.408', 'weapon4': '0.530', 'WEAPON3': '1.150', 'weapon3': '2.856', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.567', 'FRAGCOUNT': '43.000'} [2023-02-25 13:47:03,603][36138] Updated weights for policy 0, policy_version 43583 (0.0009) [2023-02-25 13:47:03,611][36157] DAMAGECOUNT value on done: 477611.0 [2023-02-25 13:47:03,612][36157] Sum rewards: 78.285, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.960', 'AMMO5': '0.009', 'AMMO2': '0.045', 'weapon5': '0.124', 'weapon2': '0.168', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'AMMO4': '0.225', 'WEAPON4': '0.300', 'weapon4': '0.668', 'WEAPON3': '1.100', 'weapon3': '2.782', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.126', 'FRAGCOUNT': '65.000'} [2023-02-25 13:47:04,270][36157] DAMAGECOUNT value on done: 483532.0 [2023-02-25 13:47:04,270][36157] Sum rewards: 54.077, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.120', 'ARMOR': '0.004', 'AMMO2': '0.018', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'AMMO3': '0.248', 'weapon4': '0.316', 'weapon2': '0.484', 'WEAPON3': '1.400', 'weapon3': '2.980', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.980', 'FRAGCOUNT': '49.000'} [2023-02-25 13:47:04,356][36140] DAMAGECOUNT value on done: 484842.0 [2023-02-25 13:47:04,356][36140] Sum rewards: 47.141, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.595', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.122', 'AMMO4': '0.133', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.306', 'weapon2': '0.542', 'WEAPON3': '1.150', 'HITCOUNT': '2.630', 'weapon3': '2.738', 'DAMAGECOUNT': '12.630', 'FRAGCOUNT': '42.000'} [2023-02-25 13:47:04,578][36157] DAMAGECOUNT value on done: 484234.0 [2023-02-25 13:47:04,578][36157] Sum rewards: 49.894, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.948', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.040', 'weapon4': '0.130', 'weapon5': '0.134', 'AMMO3': '0.162', 'AMMO4': '0.198', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '2.790', 'weapon3': '3.128', 'DAMAGECOUNT': '12.348', 'FRAGCOUNT': '44.000'} [2023-02-25 13:47:04,674][36140] DAMAGECOUNT value on done: 470803.0 [2023-02-25 13:47:04,674][36140] Sum rewards: 47.321, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.645', 'AMMO2': '0.002', 'AMMO4': '0.012', 'WEAPON4': '0.100', 'AMMO3': '0.149', 'weapon4': '0.250', 'weapon2': '0.260', 'WEAPON3': '0.850', 'HITCOUNT': '2.730', 'weapon3': '3.432', 'DAMAGECOUNT': '11.931', 'FRAGCOUNT': '38.000'} [2023-02-25 13:47:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 178528256. Throughput: 0: 3366.7. Samples: 7130184. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:47:04,730][36114] Avg episode reward: [(0, '52.843')] [2023-02-25 13:47:04,940][36140] DAMAGECOUNT value on done: 475066.0 [2023-02-25 13:47:04,940][36140] Sum rewards: 56.812, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.812', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.168', 'AMMO4': '0.191', 'AMMO3': '0.203', 'weapon2': '0.390', 'WEAPON5': '0.400', 'weapon4': '0.452', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.724', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.285', 'FRAGCOUNT': '50.000'} [2023-02-25 13:47:05,238][36140] DAMAGECOUNT value on done: 472994.0 [2023-02-25 13:47:05,238][36140] Sum rewards: 58.967, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.880', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.052', 'weapon4': '0.106', 'AMMO4': '0.150', 'weapon2': '0.194', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.260', 'weapon3': '3.414', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '51.000'} [2023-02-25 13:47:05,580][36142] DAMAGECOUNT value on done: 478783.0 [2023-02-25 13:47:05,581][36142] Sum rewards: 58.195, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.685', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON4': '0.150', 'weapon4': '0.216', 'weapon2': '0.220', 'AMMO3': '0.223', 'WEAPON3': '1.250', 'weapon3': '3.388', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '14.976', 'FRAGCOUNT': '50.000'} [2023-02-25 13:47:05,782][36156] DAMAGECOUNT value on done: 486973.0 [2023-02-25 13:47:05,782][36156] Sum rewards: 55.758, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.762', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.142', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.478', 'weapon2': '0.532', 'WEAPON3': '0.950', 'weapon3': '2.558', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.388', 'FRAGCOUNT': '47.000'} [2023-02-25 13:47:05,870][36156] DAMAGECOUNT value on done: 485356.0 [2023-02-25 13:47:05,871][36156] Sum rewards: 53.834, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.563', 'AMMO5': '0.023', 'AMMO2': '0.060', 'AMMO3': '0.149', 'weapon5': '0.164', 'weapon2': '0.220', 'AMMO4': '0.301', 'weapon4': '0.474', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '0.950', 'HITCOUNT': '2.760', 'weapon3': '2.842', 'DAMAGECOUNT': '13.254', 'FRAGCOUNT': '49.000'} [2023-02-25 13:47:05,900][36142] DAMAGECOUNT value on done: 469344.0 [2023-02-25 13:47:05,901][36142] Sum rewards: 58.190, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.760', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.132', 'AMMO3': '0.170', 'weapon5': '0.172', 'weapon2': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.380', 'WEAPON3': '1.000', 'HITCOUNT': '3.000', 'weapon3': '3.010', 'DAMAGECOUNT': '15.483', 'FRAGCOUNT': '47.500'} [2023-02-25 13:47:05,910][36142] DAMAGECOUNT value on done: 472166.0 [2023-02-25 13:47:05,910][36142] Sum rewards: 62.780, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.806', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.084', 'AMMO4': '0.125', 'WEAPON4': '0.200', 'weapon2': '0.202', 'weapon5': '0.244', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'WEAPON3': '1.500', 'HITCOUNT': '3.100', 'weapon3': '3.226', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '54.500'} [2023-02-25 13:47:06,112][36156] DAMAGECOUNT value on done: 475608.0 [2023-02-25 13:47:06,113][36156] Sum rewards: 52.558, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.400', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.070', 'weapon5': '0.096', 'AMMO3': '0.219', 'weapon2': '0.324', 'weapon4': '0.348', 'AMMO4': '0.352', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'HITCOUNT': '2.800', 'weapon3': '2.906', 'DAMAGECOUNT': '14.421', 'FRAGCOUNT': '48.500'} [2023-02-25 13:47:06,198][36156] DAMAGECOUNT value on done: 478608.0 [2023-02-25 13:47:06,199][36156] Sum rewards: 62.664, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.910', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon5': '0.060', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'AMMO3': '0.180', 'WEAPON4': '0.350', 'weapon4': '0.388', 'weapon2': '0.552', 'WEAPON3': '1.000', 'weapon3': '2.812', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '54.000'} [2023-02-25 13:47:06,223][36142] DAMAGECOUNT value on done: 481633.0 [2023-02-25 13:47:06,223][36142] Sum rewards: 55.212, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.470', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.082', 'AMMO4': '0.116', 'weapon4': '0.144', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.506', 'WEAPON3': '1.250', 'HITCOUNT': '2.990', 'weapon3': '3.112', 'DAMAGECOUNT': '14.112', 'FRAGCOUNT': '47.000'} [2023-02-25 13:47:06,640][36138] Updated weights for policy 0, policy_version 43593 (0.0010) [2023-02-25 13:47:09,673][36138] Updated weights for policy 0, policy_version 43603 (0.0009) [2023-02-25 13:47:09,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 178597888. Throughput: 0: 3366.3. Samples: 7140224. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:47:09,730][36114] Avg episode reward: [(0, '53.298')] [2023-02-25 13:47:10,333][36142] Large shaping reward 2.508 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.486, 162.0), ('weapon5', 0.002)] [2023-02-25 13:47:12,716][36138] Updated weights for policy 0, policy_version 43613 (0.0009) [2023-02-25 13:47:13,566][36155] DAMAGECOUNT value on done: 472913.0 [2023-02-25 13:47:13,566][36155] Sum rewards: 62.564, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.980', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'weapon4': '0.116', 'AMMO4': '0.126', 'AMMO3': '0.206', 'weapon5': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.458', 'WEAPON3': '1.250', 'weapon3': '2.894', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '53.000'} [2023-02-25 13:47:13,878][36155] DAMAGECOUNT value on done: 488884.0 [2023-02-25 13:47:13,878][36155] Sum rewards: 58.278, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.655', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'weapon5': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon4': '0.262', 'weapon2': '0.294', 'WEAPON3': '1.300', 'weapon3': '2.996', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.498', 'FRAGCOUNT': '50.500'} [2023-02-25 13:47:14,445][36155] DAMAGECOUNT value on done: 485098.0 [2023-02-25 13:47:14,445][36155] Sum rewards: 62.709, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.552', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.138', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon2': '0.186', 'WEAPON4': '0.350', 'ARMOR': '0.461', 'weapon4': '0.554', 'WEAPON3': '1.300', 'weapon3': '2.916', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.948', 'FRAGCOUNT': '54.000'} [2023-02-25 13:47:14,556][36139] DAMAGECOUNT value on done: 488914.0 [2023-02-25 13:47:14,556][36139] Sum rewards: 59.884, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.599', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon2': '0.160', 'AMMO3': '0.163', 'AMMO4': '0.175', 'weapon5': '0.218', 'WEAPON5': '0.300', 'weapon4': '0.324', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '3.010', 'weapon3': '3.110', 'DAMAGECOUNT': '15.027', 'FRAGCOUNT': '51.000'} [2023-02-25 13:47:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 178663424. Throughput: 0: 3365.8. Samples: 7160526. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:47:14,730][36114] Avg episode reward: [(0, '53.719')] [2023-02-25 13:47:14,763][36155] DAMAGECOUNT value on done: 477346.0 [2023-02-25 13:47:14,764][36155] Sum rewards: 59.388, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.337', 'AMMO5': '0.014', 'AMMO2': '0.056', 'AMMO3': '0.130', 'weapon5': '0.242', 'AMMO4': '0.280', 'weapon2': '0.284', 'WEAPON5': '0.350', 'ARMOR': '0.458', 'WEAPON4': '0.650', 'WEAPON3': '0.800', 'weapon4': '1.214', 'weapon3': '2.046', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '50.000'} [2023-02-25 13:47:14,865][36139] DAMAGECOUNT value on done: 478779.0 [2023-02-25 13:47:14,865][36139] Sum rewards: 60.041, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.660', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.151', 'AMMO3': '0.162', 'weapon5': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.314', 'weapon2': '0.426', 'WEAPON3': '1.050', 'weapon3': '2.864', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.441', 'FRAGCOUNT': '51.000'} [2023-02-25 13:47:15,502][36139] DAMAGECOUNT value on done: 484631.0 [2023-02-25 13:47:15,502][36139] Sum rewards: 48.755, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.982', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.200', 'weapon5': '0.238', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.460', 'WEAPON3': '1.250', 'weapon3': '2.676', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.654', 'FRAGCOUNT': '45.000'} [2023-02-25 13:47:15,818][36139] DAMAGECOUNT value on done: 484179.0 [2023-02-25 13:47:15,818][36139] Sum rewards: 45.462, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.629', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.170', 'AMMO4': '0.201', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.414', 'weapon4': '0.492', 'WEAPON3': '1.450', 'weapon3': '2.632', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.986', 'FRAGCOUNT': '42.000'} [2023-02-25 13:47:15,827][36138] Updated weights for policy 0, policy_version 43623 (0.0010) [2023-02-25 13:47:17,353][36154] Large shaping reward 2.603 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.039, -13.0), ('weapon5', 0.002)] [2023-02-25 13:47:18,810][36138] Updated weights for policy 0, policy_version 43633 (0.0009) [2023-02-25 13:47:19,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13448.5, 300 sec: 13426.6). Total num frames: 178728960. Throughput: 0: 3362.1. Samples: 7180592. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:47:19,729][36114] Avg episode reward: [(0, '53.708')] [2023-02-25 13:47:19,739][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000043636_178733056.pth... [2023-02-25 13:47:19,795][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000042849_175509504.pth [2023-02-25 13:47:21,428][36154] DAMAGECOUNT value on done: 486239.0 [2023-02-25 13:47:21,428][36154] Sum rewards: 54.591, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.484', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.059', 'AMMO3': '0.190', 'weapon2': '0.220', 'weapon5': '0.276', 'AMMO4': '0.296', 'WEAPON5': '0.450', 'WEAPON4': '0.750', 'WEAPON3': '1.100', 'weapon4': '1.224', 'weapon3': '1.914', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.021', 'FRAGCOUNT': '49.000'} [2023-02-25 13:47:21,736][36154] DAMAGECOUNT value on done: 478539.0 [2023-02-25 13:47:21,737][36154] Sum rewards: 61.880, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.458', 'AMMO5': '0.014', 'AMMO2': '0.043', 'AMMO3': '0.126', 'weapon5': '0.172', 'AMMO4': '0.217', 'weapon4': '0.382', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.452', 'WEAPON3': '0.900', 'weapon3': '2.802', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.299', 'FRAGCOUNT': '50.000'} [2023-02-25 13:47:21,900][36138] Updated weights for policy 0, policy_version 43643 (0.0009) [2023-02-25 13:47:22,047][36154] DAMAGECOUNT value on done: 480809.0 [2023-02-25 13:47:22,048][36154] Sum rewards: 52.218, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.710', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon5': '0.170', 'AMMO3': '0.175', 'AMMO4': '0.242', 'weapon2': '0.330', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.574', 'WEAPON3': '1.000', 'weapon3': '2.654', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.055', 'FRAGCOUNT': '45.500'} [2023-02-25 13:47:22,362][36154] DAMAGECOUNT value on done: 483743.0 [2023-02-25 13:47:22,362][36154] Sum rewards: 57.120, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.000', 'AMMO5': '0.009', 'AMMO2': '0.048', 'weapon5': '0.100', 'weapon4': '0.174', 'AMMO4': '0.238', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'weapon2': '0.384', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '2.870', 'weapon3': '3.036', 'DAMAGECOUNT': '14.301', 'FRAGCOUNT': '53.000'} [2023-02-25 13:47:22,509][36141] DAMAGECOUNT value on done: 490823.0 [2023-02-25 13:47:22,510][36141] Sum rewards: 55.111, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.558', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon5': '0.086', 'AMMO4': '0.109', 'AMMO3': '0.153', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.392', 'weapon4': '0.656', 'WEAPON3': '0.950', 'weapon3': '2.678', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.730', 'FRAGCOUNT': '45.000'} [2023-02-25 13:47:22,677][36141] DAMAGECOUNT value on done: 477683.0 [2023-02-25 13:47:22,677][36141] Sum rewards: 59.074, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.396', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.140', 'weapon4': '0.212', 'WEAPON5': '0.250', 'AMMO3': '0.263', 'WEAPON4': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.068', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '53.500'} [2023-02-25 13:47:22,829][36141] DAMAGECOUNT value on done: 490570.0 [2023-02-25 13:47:22,830][36141] Sum rewards: 61.976, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO2': '0.010', 'AMMO5': '0.010', 'AMMO4': '0.050', 'weapon5': '0.074', 'WEAPON4': '0.100', 'weapon4': '0.118', 'AMMO3': '0.155', 'WEAPON5': '0.200', 'weapon2': '0.258', 'HEALTH': '0.430', 'WEAPON3': '0.950', 'HITCOUNT': '3.220', 'weapon3': '3.336', 'DAMAGECOUNT': '15.066', 'FRAGCOUNT': '50.000'} [2023-02-25 13:47:22,994][36141] DAMAGECOUNT value on done: 471903.0 [2023-02-25 13:47:22,994][36141] Sum rewards: 52.858, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.915', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.080', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'AMMO4': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.468', 'weapon4': '0.488', 'WEAPON3': '1.150', 'weapon3': '2.636', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.103', 'FRAGCOUNT': '45.000'} [2023-02-25 13:47:23,297][36157] DAMAGECOUNT value on done: 493780.0 [2023-02-25 13:47:23,297][36157] Sum rewards: 59.421, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.159', 'AMMO5': '0.006', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.100', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.296', 'weapon2': '0.390', 'WEAPON3': '1.100', 'weapon3': '2.960', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.770', 'FRAGCOUNT': '51.000'} [2023-02-25 13:47:23,608][36157] DAMAGECOUNT value on done: 482696.0 [2023-02-25 13:47:23,608][36157] Sum rewards: 60.551, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.412', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'weapon4': '0.236', 'weapon2': '0.356', 'WEAPON3': '1.300', 'weapon3': '3.138', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.255', 'FRAGCOUNT': '52.000'} [2023-02-25 13:47:24,276][36157] DAMAGECOUNT value on done: 488419.0 [2023-02-25 13:47:24,276][36157] Sum rewards: 55.663, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.650', 'AMMO5': '0.003', 'weapon5': '0.040', 'AMMO2': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.200', 'AMMO4': '0.201', 'WEAPON4': '0.300', 'weapon2': '0.458', 'weapon4': '0.492', 'WEAPON3': '1.150', 'weapon3': '2.798', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.661', 'FRAGCOUNT': '47.000'} [2023-02-25 13:47:24,398][36140] DAMAGECOUNT value on done: 489203.0 [2023-02-25 13:47:24,399][36140] Sum rewards: 47.093, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.711', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.055', 'AMMO3': '0.135', 'weapon5': '0.184', 'AMMO4': '0.277', 'weapon2': '0.364', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.756', 'WEAPON3': '0.800', 'weapon3': '2.408', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '13.083', 'FRAGCOUNT': '39.000'} [2023-02-25 13:47:24,576][36157] DAMAGECOUNT value on done: 488721.0 [2023-02-25 13:47:24,576][36157] Sum rewards: 48.370, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.872', 'AMMO5': '0.010', 'AMMO2': '0.042', 'AMMO3': '0.193', 'AMMO4': '0.208', 'weapon5': '0.220', 'weapon2': '0.254', 'WEAPON5': '0.350', 'weapon4': '0.392', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.710', 'weapon3': '2.852', 'DAMAGECOUNT': '13.461', 'FRAGCOUNT': '43.000'} [2023-02-25 13:47:24,712][36140] DAMAGECOUNT value on done: 475690.0 [2023-02-25 13:47:24,712][36140] Sum rewards: 63.404, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.164', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.005', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.217', 'weapon2': '0.218', 'WEAPON3': '1.400', 'HITCOUNT': '3.080', 'weapon3': '3.558', 'DAMAGECOUNT': '14.661', 'FRAGCOUNT': '55.000'} [2023-02-25 13:47:24,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13426.6). Total num frames: 178798592. Throughput: 0: 3358.5. Samples: 7190544. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:47:24,730][36114] Avg episode reward: [(0, '54.118')] [2023-02-25 13:47:24,956][36138] Updated weights for policy 0, policy_version 43653 (0.0009) [2023-02-25 13:47:25,000][36140] DAMAGECOUNT value on done: 479151.0 [2023-02-25 13:47:25,001][36140] Sum rewards: 46.903, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.844', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.130', 'AMMO3': '0.195', 'WEAPON4': '0.350', 'weapon2': '0.372', 'weapon4': '0.460', 'WEAPON3': '1.100', 'weapon3': '2.740', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.255', 'FRAGCOUNT': '42.000'} [2023-02-25 13:47:25,303][36140] DAMAGECOUNT value on done: 477945.0 [2023-02-25 13:47:25,303][36140] Sum rewards: 51.563, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.984', 'AMMO5': '0.018', 'AMMO2': '0.058', 'weapon5': '0.214', 'AMMO3': '0.222', 'weapon2': '0.240', 'AMMO4': '0.290', 'WEAPON5': '0.450', 'weapon4': '0.486', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.716', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.853', 'FRAGCOUNT': '48.000'} [2023-02-25 13:47:25,603][36142] DAMAGECOUNT value on done: 483589.0 [2023-02-25 13:47:25,603][36142] Sum rewards: 53.851, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.555', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.154', 'weapon5': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.518', 'weapon4': '0.712', 'WEAPON3': '0.950', 'weapon3': '2.368', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.418', 'FRAGCOUNT': '45.000'} [2023-02-25 13:47:25,896][36156] DAMAGECOUNT value on done: 490832.0 [2023-02-25 13:47:25,896][36156] Sum rewards: 38.396, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.382', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.062', 'weapon5': '0.144', 'AMMO3': '0.191', 'WEAPON5': '0.250', 'AMMO4': '0.311', 'weapon2': '0.378', 'WEAPON4': '0.650', 'weapon4': '0.956', 'WEAPON3': '1.100', 'weapon3': '1.894', 'HITCOUNT': '2.250', 'DAMAGECOUNT': '11.577', 'FRAGCOUNT': '36.000'} [2023-02-25 13:47:25,910][36142] DAMAGECOUNT value on done: 473977.0 [2023-02-25 13:47:25,911][36142] Sum rewards: 56.355, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.584', 'AMMO2': '0.011', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.165', 'weapon4': '0.226', 'weapon2': '0.726', 'WEAPON3': '1.100', 'weapon3': '2.956', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '13.899', 'FRAGCOUNT': '47.000'} [2023-02-25 13:47:25,920][36142] DAMAGECOUNT value on done: 476520.0 [2023-02-25 13:47:25,920][36142] Sum rewards: 49.112, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.842', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon5': '0.078', 'AMMO3': '0.153', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.448', 'WEAPON3': '0.900', 'weapon4': '1.160', 'weapon3': '1.992', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.062', 'FRAGCOUNT': '41.000'} [2023-02-25 13:47:25,937][36156] DAMAGECOUNT value on done: 490461.0 [2023-02-25 13:47:25,937][36156] Sum rewards: 57.330, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.732', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon5': '0.170', 'AMMO3': '0.201', 'weapon4': '0.206', 'AMMO4': '0.238', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.508', 'WEAPON3': '1.200', 'HITCOUNT': '2.810', 'weapon3': '2.850', 'DAMAGECOUNT': '15.012', 'FRAGCOUNT': '51.000'} [2023-02-25 13:47:26,221][36142] DAMAGECOUNT value on done: 486732.0 [2023-02-25 13:47:26,222][36142] Sum rewards: 61.025, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.336', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.138', 'weapon2': '0.156', 'weapon4': '0.156', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.040', 'weapon3': '3.274', 'DAMAGECOUNT': '15.297', 'FRAGCOUNT': '53.000'} [2023-02-25 13:47:26,235][36156] DAMAGECOUNT value on done: 479278.0 [2023-02-25 13:47:26,235][36156] Sum rewards: 40.408, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.198', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.048', 'AMMO4': '0.094', 'AMMO3': '0.142', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.472', 'WEAPON3': '0.850', 'weapon4': '0.906', 'weapon3': '2.378', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '11.010', 'FRAGCOUNT': '34.000'} [2023-02-25 13:47:26,277][36156] DAMAGECOUNT value on done: 482896.0 [2023-02-25 13:47:26,278][36156] Sum rewards: 56.724, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.308', 'AMMO5': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.084', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'weapon2': '0.182', 'WEAPON4': '0.250', 'weapon4': '0.454', 'WEAPON3': '0.800', 'HITCOUNT': '2.700', 'weapon3': '3.056', 'DAMAGECOUNT': '12.864', 'FRAGCOUNT': '49.000'} [2023-02-25 13:47:27,981][36138] Updated weights for policy 0, policy_version 43663 (0.0010) [2023-02-25 13:47:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13426.6). Total num frames: 178864128. Throughput: 0: 3356.8. Samples: 7210670. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 13:47:29,730][36114] Avg episode reward: [(0, '53.879')] [2023-02-25 13:47:31,029][36138] Updated weights for policy 0, policy_version 43673 (0.0009) [2023-02-25 13:47:33,496][36155] DAMAGECOUNT value on done: 478436.0 [2023-02-25 13:47:33,496][36155] Sum rewards: 62.971, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.125', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.088', 'AMMO4': '0.135', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon4': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.350', 'HITCOUNT': '3.070', 'weapon3': '3.120', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '54.000'} [2023-02-25 13:47:33,813][36155] DAMAGECOUNT value on done: 493434.0 [2023-02-25 13:47:33,813][36155] Sum rewards: 52.641, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.650', 'AMMO5': '0.013', 'AMMO2': '0.042', 'AMMO3': '0.203', 'AMMO4': '0.209', 'weapon5': '0.212', 'weapon4': '0.358', 'weapon2': '0.362', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.650', 'weapon3': '2.792', 'DAMAGECOUNT': '13.650', 'FRAGCOUNT': '49.000'} [2023-02-25 13:47:34,024][36138] Updated weights for policy 0, policy_version 43683 (0.0010) [2023-02-25 13:47:34,351][36155] DAMAGECOUNT value on done: 489196.0 [2023-02-25 13:47:34,352][36155] Sum rewards: 50.062, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.450', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon4': '0.198', 'weapon2': '0.336', 'WEAPON3': '1.150', 'HITCOUNT': '2.660', 'weapon3': '3.128', 'DAMAGECOUNT': '12.294', 'FRAGCOUNT': '43.000'} [2023-02-25 13:47:34,587][36139] DAMAGECOUNT value on done: 493990.0 [2023-02-25 13:47:34,587][36139] Sum rewards: 59.115, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.990', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.144', 'AMMO3': '0.149', 'weapon5': '0.244', 'weapon4': '0.368', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.414', 'WEAPON3': '1.000', 'weapon3': '2.764', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '47.500'} [2023-02-25 13:47:34,638][36155] DAMAGECOUNT value on done: 481538.0 [2023-02-25 13:47:34,639][36155] Sum rewards: 44.815, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.622', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.039', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.186', 'AMMO4': '0.192', 'WEAPON4': '0.350', 'weapon2': '0.456', 'weapon4': '0.680', 'WEAPON3': '1.100', 'weapon3': '2.628', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.576', 'FRAGCOUNT': '40.000'} [2023-02-25 13:47:34,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13440.4). Total num frames: 178933760. Throughput: 0: 3358.7. Samples: 7230908. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 13:47:34,730][36114] Avg episode reward: [(0, '54.078')] [2023-02-25 13:47:34,900][36139] DAMAGECOUNT value on done: 483925.0 [2023-02-25 13:47:34,901][36139] Sum rewards: 54.610, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.590', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.165', 'AMMO3': '0.191', 'weapon2': '0.272', 'WEAPON4': '0.350', 'weapon4': '0.436', 'WEAPON3': '1.100', 'weapon3': '2.986', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.438', 'FRAGCOUNT': '46.000'} [2023-02-25 13:47:35,498][36139] DAMAGECOUNT value on done: 489932.0 [2023-02-25 13:47:35,498][36139] Sum rewards: 61.427, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.326', 'AMMO2': '0.005', 'AMMO5': '0.006', 'AMMO4': '0.027', 'WEAPON4': '0.100', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.265', 'weapon2': '0.266', 'weapon4': '0.436', 'WEAPON3': '1.550', 'weapon3': '2.930', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '55.000'} [2023-02-25 13:47:35,796][36139] DAMAGECOUNT value on done: 488316.0 [2023-02-25 13:47:35,796][36139] Sum rewards: 47.633, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.784', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.159', 'WEAPON4': '0.350', 'weapon2': '0.420', 'weapon4': '0.420', 'WEAPON3': '0.950', 'weapon3': '2.908', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.396', 'FRAGCOUNT': '41.000'} [2023-02-25 13:47:37,057][36138] Updated weights for policy 0, policy_version 43693 (0.0009) [2023-02-25 13:47:39,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 178999296. Throughput: 0: 3359.0. Samples: 7241088. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 13:47:39,730][36114] Avg episode reward: [(0, '54.225')] [2023-02-25 13:47:40,113][36138] Updated weights for policy 0, policy_version 43703 (0.0009) [2023-02-25 13:47:41,453][36154] DAMAGECOUNT value on done: 491243.0 [2023-02-25 13:47:41,453][36154] Sum rewards: 61.016, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.229', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.053', 'AMMO3': '0.136', 'weapon5': '0.172', 'AMMO4': '0.263', 'WEAPON5': '0.400', 'weapon2': '0.410', 'WEAPON4': '0.600', 'weapon4': '0.774', 'WEAPON3': '0.900', 'weapon3': '2.388', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.012', 'FRAGCOUNT': '53.000'} [2023-02-25 13:47:41,755][36154] DAMAGECOUNT value on done: 483101.0 [2023-02-25 13:47:41,756][36154] Sum rewards: 56.676, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.805', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon2': '0.150', 'AMMO3': '0.192', 'AMMO4': '0.200', 'weapon5': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.388', 'WEAPON3': '1.200', 'HITCOUNT': '2.840', 'weapon3': '3.014', 'DAMAGECOUNT': '13.686', 'FRAGCOUNT': '49.000'} [2023-02-25 13:47:42,055][36154] DAMAGECOUNT value on done: 486383.0 [2023-02-25 13:47:42,056][36154] Sum rewards: 64.228, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.180', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'weapon4': '0.182', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon2': '0.280', 'WEAPON3': '1.450', 'weapon3': '3.206', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '57.000'} [2023-02-25 13:47:42,308][36141] DAMAGECOUNT value on done: 494843.0 [2023-02-25 13:47:42,308][36141] Sum rewards: 41.644, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.870', 'AMMO5': '0.014', 'AMMO2': '0.069', 'AMMO3': '0.196', 'weapon5': '0.208', 'weapon2': '0.298', 'AMMO4': '0.347', 'WEAPON5': '0.350', 'weapon4': '0.394', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'HITCOUNT': '2.560', 'weapon3': '2.828', 'DAMAGECOUNT': '11.799', 'FRAGCOUNT': '40.000'} [2023-02-25 13:47:42,364][36154] DAMAGECOUNT value on done: 488497.0 [2023-02-25 13:47:42,365][36154] Sum rewards: 54.091, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.646', 'AMMO5': '0.005', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.270', 'weapon4': '0.352', 'WEAPON3': '1.250', 'weapon3': '2.858', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.262', 'FRAGCOUNT': '47.000'} [2023-02-25 13:47:42,477][36141] DAMAGECOUNT value on done: 482130.0 [2023-02-25 13:47:42,478][36141] Sum rewards: 46.073, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.604', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.126', 'AMMO4': '0.161', 'WEAPON5': '0.250', 'weapon2': '0.260', 'AMMO3': '0.285', 'WEAPON4': '0.350', 'weapon4': '0.412', 'WEAPON3': '1.750', 'weapon3': '2.910', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.341', 'FRAGCOUNT': '45.000'} [2023-02-25 13:47:42,620][36141] DAMAGECOUNT value on done: 495002.0 [2023-02-25 13:47:42,620][36141] Sum rewards: 50.664, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.174', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.130', 'AMMO3': '0.132', 'AMMO4': '0.209', 'WEAPON5': '0.250', 'weapon2': '0.414', 'WEAPON4': '0.450', 'weapon4': '0.646', 'WEAPON3': '0.850', 'weapon3': '2.592', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.296', 'FRAGCOUNT': '43.000'} [2023-02-25 13:47:42,783][36141] DAMAGECOUNT value on done: 476655.0 [2023-02-25 13:47:42,783][36141] Sum rewards: 54.051, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.984', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.064', 'AMMO4': '0.127', 'weapon5': '0.164', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.200', 'HITCOUNT': '2.860', 'weapon3': '3.242', 'DAMAGECOUNT': '14.256', 'FRAGCOUNT': '48.000'} [2023-02-25 13:47:43,100][36157] DAMAGECOUNT value on done: 498424.0 [2023-02-25 13:47:43,100][36157] Sum rewards: 53.660, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.916', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon5': '0.144', 'AMMO3': '0.238', 'AMMO4': '0.247', 'weapon2': '0.304', 'WEAPON5': '0.400', 'weapon4': '0.518', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.720', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.932', 'FRAGCOUNT': '51.000'} [2023-02-25 13:47:43,191][36138] Updated weights for policy 0, policy_version 43713 (0.0010) [2023-02-25 13:47:43,410][36157] DAMAGECOUNT value on done: 487145.0 [2023-02-25 13:47:43,410][36157] Sum rewards: 51.107, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.598', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.040', 'AMMO3': '0.193', 'AMMO4': '0.199', 'weapon2': '0.214', 'weapon5': '0.310', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.618', 'WEAPON3': '1.200', 'weapon3': '2.590', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.347', 'FRAGCOUNT': '44.500'} [2023-02-25 13:47:44,133][36157] DAMAGECOUNT value on done: 493821.0 [2023-02-25 13:47:44,134][36157] Sum rewards: 66.598, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.167', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.156', 'AMMO3': '0.169', 'weapon2': '0.336', 'WEAPON3': '1.050', 'weapon3': '3.198', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.206', 'FRAGCOUNT': '54.000'} [2023-02-25 13:47:44,358][36140] DAMAGECOUNT value on done: 493976.0 [2023-02-25 13:47:44,359][36140] Sum rewards: 53.030, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.000', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.088', 'AMMO4': '0.147', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'weapon2': '0.284', 'WEAPON4': '0.350', 'weapon4': '0.726', 'WEAPON3': '1.150', 'weapon3': '2.716', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.319', 'FRAGCOUNT': '46.000'} [2023-02-25 13:47:44,436][36157] DAMAGECOUNT value on done: 492557.0 [2023-02-25 13:47:44,437][36157] Sum rewards: 46.619, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.524', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.102', 'AMMO3': '0.127', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon5': '0.316', 'weapon2': '0.572', 'WEAPON3': '0.750', 'weapon4': '0.758', 'weapon3': '2.062', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '11.508', 'FRAGCOUNT': '37.000'} [2023-02-25 13:47:44,674][36140] DAMAGECOUNT value on done: 480885.0 [2023-02-25 13:47:44,674][36140] Sum rewards: 55.693, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.298', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.076', 'AMMO4': '0.145', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'weapon2': '0.310', 'weapon4': '0.420', 'WEAPON3': '1.350', 'weapon3': '2.952', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '49.000'} [2023-02-25 13:47:44,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 179068928. Throughput: 0: 3361.6. Samples: 7261350. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 13:47:44,730][36114] Avg episode reward: [(0, '54.484')] [2023-02-25 13:47:44,730][36125] Saving new best policy, reward=54.484! [2023-02-25 13:47:44,978][36140] DAMAGECOUNT value on done: 483939.0 [2023-02-25 13:47:44,979][36140] Sum rewards: 58.596, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.320', 'AMMO5': '0.017', 'AMMO2': '0.028', 'AMMO4': '0.142', 'AMMO3': '0.182', 'weapon5': '0.192', 'weapon4': '0.248', 'weapon2': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.980', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.364', 'FRAGCOUNT': '51.000'} [2023-02-25 13:47:45,324][36140] DAMAGECOUNT value on done: 482639.0 [2023-02-25 13:47:45,324][36140] Sum rewards: 55.177, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.712', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'weapon5': '0.182', 'AMMO3': '0.217', 'weapon2': '0.294', 'WEAPON4': '0.300', 'weapon4': '0.314', 'WEAPON3': '1.250', 'HITCOUNT': '2.870', 'weapon3': '2.940', 'DAMAGECOUNT': '13.947', 'FRAGCOUNT': '50.000'} [2023-02-25 13:47:45,617][36142] DAMAGECOUNT value on done: 488615.0 [2023-02-25 13:47:45,618][36142] Sum rewards: 61.339, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.437', 'ARMOR': '0.004', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon4': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.184', 'weapon2': '0.326', 'WEAPON3': '1.200', 'HITCOUNT': '3.220', 'weapon3': '3.402', 'DAMAGECOUNT': '15.078', 'FRAGCOUNT': '52.000'} [2023-02-25 13:47:45,932][36142] DAMAGECOUNT value on done: 479221.0 [2023-02-25 13:47:45,933][36142] Sum rewards: 66.520, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.435', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.009', 'WEAPON4': '0.100', 'AMMO3': '0.173', 'weapon5': '0.212', 'WEAPON5': '0.250', 'weapon4': '0.254', 'weapon2': '0.354', 'WEAPON3': '1.150', 'weapon3': '3.022', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '55.000'} [2023-02-25 13:47:45,940][36142] DAMAGECOUNT value on done: 480686.0 [2023-02-25 13:47:45,941][36142] Sum rewards: 48.027, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.728', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.178', 'WEAPON5': '0.200', 'AMMO4': '0.207', 'WEAPON4': '0.250', 'AMMO3': '0.255', 'weapon2': '0.414', 'weapon4': '0.468', 'WEAPON3': '1.400', 'HITCOUNT': '2.660', 'weapon3': '2.670', 'DAMAGECOUNT': '12.498', 'FRAGCOUNT': '45.000'} [2023-02-25 13:47:46,034][36156] DAMAGECOUNT value on done: 495151.0 [2023-02-25 13:47:46,035][36156] Sum rewards: 43.820, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.853', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO4': '0.166', 'AMMO3': '0.214', 'weapon5': '0.220', 'weapon4': '0.324', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.678', 'WEAPON3': '1.300', 'weapon3': '2.416', 'HITCOUNT': '2.450', 'DAMAGECOUNT': '12.957', 'FRAGCOUNT': '40.000'} [2023-02-25 13:47:46,071][36156] DAMAGECOUNT value on done: 494934.0 [2023-02-25 13:47:46,072][36156] Sum rewards: 47.937, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.202', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.116', 'WEAPON5': '0.150', 'weapon2': '0.200', 'AMMO4': '0.208', 'AMMO3': '0.235', 'WEAPON4': '0.400', 'weapon4': '0.838', 'WEAPON3': '1.450', 'weapon3': '2.572', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.419', 'FRAGCOUNT': '45.000'} [2023-02-25 13:47:46,246][36142] DAMAGECOUNT value on done: 492027.0 [2023-02-25 13:47:46,246][36142] Sum rewards: 56.970, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.405', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.066', 'weapon5': '0.084', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'weapon2': '0.288', 'WEAPON3': '1.450', 'HITCOUNT': '3.030', 'weapon3': '3.356', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '49.500'} [2023-02-25 13:47:46,254][36138] Updated weights for policy 0, policy_version 43723 (0.0009) [2023-02-25 13:47:46,347][36156] DAMAGECOUNT value on done: 483920.0 [2023-02-25 13:47:46,348][36156] Sum rewards: 52.569, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.376', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.068', 'AMMO4': '0.098', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon4': '0.246', 'weapon2': '0.396', 'WEAPON3': '1.450', 'weapon3': '3.066', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.926', 'FRAGCOUNT': '47.000'} [2023-02-25 13:47:46,385][36156] DAMAGECOUNT value on done: 487776.0 [2023-02-25 13:47:46,386][36156] Sum rewards: 52.555, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.509', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.072', 'weapon5': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.270', 'weapon2': '0.372', 'weapon4': '0.486', 'WEAPON3': '1.550', 'weapon3': '2.790', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.640', 'FRAGCOUNT': '46.000'} [2023-02-25 13:47:49,275][36138] Updated weights for policy 0, policy_version 43733 (0.0009) [2023-02-25 13:47:49,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 179134464. Throughput: 0: 3360.4. Samples: 7281402. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 13:47:49,730][36114] Avg episode reward: [(0, '54.609')] [2023-02-25 13:47:49,733][36125] Saving new best policy, reward=54.609! [2023-02-25 13:47:52,375][36138] Updated weights for policy 0, policy_version 43743 (0.0010) [2023-02-25 13:47:53,371][36155] DAMAGECOUNT value on done: 483218.0 [2023-02-25 13:47:53,371][36155] Sum rewards: 55.015, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.012', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.092', 'AMMO4': '0.163', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.314', 'ARMOR': '0.404', 'weapon4': '0.538', 'WEAPON3': '1.150', 'weapon3': '2.832', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.346', 'FRAGCOUNT': '47.000'} [2023-02-25 13:47:53,676][36155] DAMAGECOUNT value on done: 498359.0 [2023-02-25 13:47:53,676][36155] Sum rewards: 60.707, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.330', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.046', 'AMMO4': '0.046', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.222', 'weapon4': '0.328', 'weapon2': '0.402', 'WEAPON3': '1.250', 'weapon3': '2.986', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '53.000'} [2023-02-25 13:47:54,235][36155] DAMAGECOUNT value on done: 493410.0 [2023-02-25 13:47:54,236][36155] Sum rewards: 52.697, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.922', 'AMMO2': '0.012', 'AMMO5': '0.016', 'AMMO4': '0.057', 'weapon5': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.158', 'WEAPON5': '0.250', 'weapon4': '0.350', 'weapon2': '0.862', 'WEAPON3': '1.050', 'weapon3': '2.512', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.642', 'FRAGCOUNT': '44.000'} [2023-02-25 13:47:54,536][36155] DAMAGECOUNT value on done: 486056.0 [2023-02-25 13:47:54,536][36155] Sum rewards: 51.020, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.441', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.034', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.178', 'WEAPON4': '0.300', 'weapon2': '0.426', 'weapon4': '0.736', 'WEAPON3': '1.050', 'weapon3': '2.518', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.554', 'FRAGCOUNT': '43.000'} [2023-02-25 13:47:54,597][36139] DAMAGECOUNT value on done: 498420.0 [2023-02-25 13:47:54,597][36139] Sum rewards: 50.419, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.720', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'weapon2': '0.208', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'weapon4': '1.184', 'weapon3': '2.314', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '13.290', 'FRAGCOUNT': '43.000'} [2023-02-25 13:47:54,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 179200000. Throughput: 0: 3360.5. Samples: 7291446. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 13:47:54,729][36114] Avg episode reward: [(0, '54.732')] [2023-02-25 13:47:54,730][36125] Saving new best policy, reward=54.732! [2023-02-25 13:47:54,911][36139] DAMAGECOUNT value on done: 488490.0 [2023-02-25 13:47:54,911][36139] Sum rewards: 54.548, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.186', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.022', 'AMMO4': '0.065', 'WEAPON5': '0.100', 'AMMO3': '0.193', 'weapon2': '0.548', 'WEAPON3': '1.250', 'HITCOUNT': '2.800', 'weapon3': '3.292', 'DAMAGECOUNT': '13.695', 'FRAGCOUNT': '46.000'} [2023-02-25 13:47:55,400][36138] Updated weights for policy 0, policy_version 43753 (0.0009) [2023-02-25 13:47:55,515][36139] DAMAGECOUNT value on done: 494411.0 [2023-02-25 13:47:55,516][36139] Sum rewards: 48.157, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.310', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon5': '0.174', 'AMMO3': '0.205', 'AMMO4': '0.219', 'weapon2': '0.366', 'weapon4': '0.392', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.780', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.437', 'FRAGCOUNT': '43.000'} [2023-02-25 13:47:55,816][36139] DAMAGECOUNT value on done: 493514.0 [2023-02-25 13:47:55,817][36139] Sum rewards: 52.951, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.048', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'weapon4': '0.184', 'AMMO3': '0.250', 'weapon2': '0.326', 'WEAPON3': '1.400', 'weapon3': '3.254', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.594', 'FRAGCOUNT': '45.000'} [2023-02-25 13:47:57,654][36139] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:47:58,400][36138] Updated weights for policy 0, policy_version 43763 (0.0009) [2023-02-25 13:47:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 179269632. Throughput: 0: 3361.1. Samples: 7311776. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:47:59,730][36114] Avg episode reward: [(0, '54.828')] [2023-02-25 13:47:59,733][36125] Saving new best policy, reward=54.828! [2023-02-25 13:48:01,367][36154] DAMAGECOUNT value on done: 495190.0 [2023-02-25 13:48:01,367][36154] Sum rewards: 47.863, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.385', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.058', 'weapon4': '0.066', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.150', 'WEAPON3': '0.900', 'weapon2': '0.932', 'HITCOUNT': '2.700', 'weapon3': '2.784', 'DAMAGECOUNT': '11.841', 'FRAGCOUNT': '39.000'} [2023-02-25 13:48:01,458][36138] Updated weights for policy 0, policy_version 43773 (0.0009) [2023-02-25 13:48:01,684][36154] DAMAGECOUNT value on done: 486562.0 [2023-02-25 13:48:01,684][36154] Sum rewards: 38.377, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.315', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon7': '0.090', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.147', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.386', 'WEAPON3': '0.850', 'weapon4': '1.086', 'weapon3': '1.678', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '10.383', 'FRAGCOUNT': '32.000'} [2023-02-25 13:48:01,950][36154] DAMAGECOUNT value on done: 491124.0 [2023-02-25 13:48:01,950][36154] Sum rewards: 61.496, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.950', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.054', 'AMMO4': '0.086', 'weapon4': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'weapon2': '0.238', 'WEAPON3': '1.400', 'HITCOUNT': '2.810', 'weapon3': '3.390', 'DAMAGECOUNT': '14.223', 'FRAGCOUNT': '55.000'} [2023-02-25 13:48:02,259][36154] DAMAGECOUNT value on done: 493133.0 [2023-02-25 13:48:02,260][36154] Sum rewards: 53.567, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.766', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO4': '0.165', 'AMMO3': '0.231', 'weapon5': '0.248', 'weapon2': '0.360', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.730', 'WEAPON3': '1.400', 'weapon3': '2.370', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.908', 'FRAGCOUNT': '49.000'} [2023-02-25 13:48:02,266][36141] DAMAGECOUNT value on done: 498983.0 [2023-02-25 13:48:02,267][36141] Sum rewards: 45.376, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.028', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.043', 'weapon5': '0.144', 'WEAPON5': '0.200', 'AMMO4': '0.213', 'AMMO3': '0.236', 'WEAPON4': '0.350', 'weapon4': '0.438', 'weapon2': '0.576', 'WEAPON3': '1.350', 'weapon3': '2.610', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.420', 'FRAGCOUNT': '44.000'} [2023-02-25 13:48:02,446][36141] DAMAGECOUNT value on done: 486813.0 [2023-02-25 13:48:02,446][36141] Sum rewards: 49.489, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.176', 'AMMO5': '0.012', 'AMMO2': '0.057', 'weapon5': '0.066', 'AMMO3': '0.162', 'WEAPON5': '0.250', 'AMMO4': '0.286', 'WEAPON4': '0.450', 'weapon2': '0.466', 'weapon4': '0.720', 'WEAPON3': '1.050', 'weapon3': '2.536', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.049', 'FRAGCOUNT': '42.000'} [2023-02-25 13:48:02,583][36141] DAMAGECOUNT value on done: 499625.0 [2023-02-25 13:48:02,584][36141] Sum rewards: 53.387, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.343', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.104', 'AMMO4': '0.129', 'AMMO3': '0.236', 'weapon4': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.692', 'WEAPON3': '1.350', 'weapon3': '2.696', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.869', 'FRAGCOUNT': '48.000'} [2023-02-25 13:48:02,767][36141] DAMAGECOUNT value on done: 481606.0 [2023-02-25 13:48:02,768][36141] Sum rewards: 59.303, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.528', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon5': '0.094', 'AMMO3': '0.142', 'AMMO4': '0.177', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.350', 'ARMOR': '0.400', 'weapon2': '0.480', 'WEAPON3': '0.850', 'weapon3': '2.906', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.553', 'FRAGCOUNT': '48.000'} [2023-02-25 13:48:03,112][36157] DAMAGECOUNT value on done: 503429.0 [2023-02-25 13:48:03,113][36157] Sum rewards: 57.418, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.130', 'AMMO5': '0.005', 'AMMO2': '0.028', 'AMMO4': '0.137', 'weapon5': '0.138', 'WEAPON5': '0.150', 'weapon2': '0.162', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon4': '0.510', 'WEAPON3': '1.250', 'HITCOUNT': '2.950', 'weapon3': '2.994', 'DAMAGECOUNT': '15.015', 'FRAGCOUNT': '50.000'} [2023-02-25 13:48:03,421][36157] DAMAGECOUNT value on done: 491407.0 [2023-02-25 13:48:03,422][36157] Sum rewards: 48.854, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.331', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.146', 'AMMO3': '0.173', 'AMMO4': '0.217', 'WEAPON5': '0.250', 'weapon4': '0.336', 'WEAPON4': '0.400', 'weapon2': '0.430', 'WEAPON3': '1.050', 'HITCOUNT': '2.710', 'weapon3': '2.884', 'DAMAGECOUNT': '12.786', 'FRAGCOUNT': '44.000'} [2023-02-25 13:48:04,123][36157] DAMAGECOUNT value on done: 498714.0 [2023-02-25 13:48:04,123][36157] Sum rewards: 56.772, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.600', 'AMMO5': '0.005', 'AMMO2': '0.011', 'ARMOR': '0.012', 'weapon4': '0.036', 'AMMO4': '0.053', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.226', 'weapon2': '0.562', 'WEAPON3': '1.350', 'HITCOUNT': '3.050', 'weapon3': '3.104', 'DAMAGECOUNT': '14.679', 'FRAGCOUNT': '50.000'} [2023-02-25 13:48:04,352][36140] DAMAGECOUNT value on done: 499476.0 [2023-02-25 13:48:04,352][36140] Sum rewards: 64.785, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.525', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.160', 'weapon5': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.380', 'weapon2': '0.542', 'WEAPON3': '1.050', 'weapon3': '2.546', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '52.000'} [2023-02-25 13:48:04,451][36157] DAMAGECOUNT value on done: 497107.0 [2023-02-25 13:48:04,451][36157] Sum rewards: 48.033, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.476', 'AMMO5': '0.020', 'AMMO2': '0.054', 'AMMO3': '0.231', 'AMMO4': '0.269', 'weapon5': '0.300', 'weapon2': '0.306', 'weapon4': '0.356', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'HITCOUNT': '2.530', 'weapon3': '2.694', 'DAMAGECOUNT': '13.650', 'FRAGCOUNT': '48.000'} [2023-02-25 13:48:04,479][36138] Updated weights for policy 0, policy_version 43783 (0.0009) [2023-02-25 13:48:04,726][36140] DAMAGECOUNT value on done: 485154.0 [2023-02-25 13:48:04,726][36140] Sum rewards: 48.983, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.637', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'weapon5': '0.108', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'weapon4': '0.494', 'weapon2': '0.592', 'WEAPON3': '0.900', 'weapon3': '2.586', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.807', 'FRAGCOUNT': '40.000'} [2023-02-25 13:48:04,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 179335168. Throughput: 0: 3363.3. Samples: 7331942. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:48:04,730][36114] Avg episode reward: [(0, '54.519')] [2023-02-25 13:48:05,071][36140] DAMAGECOUNT value on done: 489107.0 [2023-02-25 13:48:05,072][36140] Sum rewards: 60.715, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.688', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon2': '0.186', 'AMMO4': '0.213', 'AMMO3': '0.242', 'weapon5': '0.276', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.444', 'WEAPON3': '1.400', 'HITCOUNT': '2.790', 'weapon3': '2.796', 'DAMAGECOUNT': '15.504', 'FRAGCOUNT': '56.000'} [2023-02-25 13:48:05,407][36140] DAMAGECOUNT value on done: 487442.0 [2023-02-25 13:48:05,408][36140] Sum rewards: 55.850, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.592', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.052', 'weapon5': '0.058', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'weapon2': '0.190', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '2.820', 'weapon3': '3.426', 'DAMAGECOUNT': '14.409', 'FRAGCOUNT': '51.000'} [2023-02-25 13:48:05,884][36142] DAMAGECOUNT value on done: 493706.0 [2023-02-25 13:48:05,885][36142] Sum rewards: 58.962, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.962', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon7': '0.060', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'weapon5': '0.116', 'WEAPON4': '0.150', 'weapon2': '0.154', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO3': '0.195', 'WEAPON7': '0.200', 'weapon4': '0.346', 'ARMOR': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '3.130', 'weapon3': '3.186', 'DAMAGECOUNT': '15.273', 'FRAGCOUNT': '48.000'} [2023-02-25 13:48:06,181][36142] DAMAGECOUNT value on done: 484364.0 [2023-02-25 13:48:06,182][36142] Sum rewards: 65.176, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.704', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'AMMO4': '0.198', 'weapon4': '0.246', 'WEAPON4': '0.350', 'weapon2': '0.578', 'WEAPON3': '1.050', 'weapon3': '2.856', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '56.000'} [2023-02-25 13:48:06,192][36142] DAMAGECOUNT value on done: 484885.0 [2023-02-25 13:48:06,192][36142] Sum rewards: 44.536, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.228', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.074', 'AMMO3': '0.158', 'AMMO4': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.516', 'weapon4': '0.604', 'WEAPON3': '0.900', 'weapon3': '2.588', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.597', 'FRAGCOUNT': '38.000'} [2023-02-25 13:48:06,282][36156] DAMAGECOUNT value on done: 499501.0 [2023-02-25 13:48:06,283][36156] Sum rewards: 49.435, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.506', 'AMMO2': '0.001', 'AMMO4': '0.007', 'WEAPON4': '0.050', 'weapon4': '0.156', 'AMMO3': '0.267', 'weapon2': '0.648', 'WEAPON3': '1.600', 'HITCOUNT': '2.680', 'weapon3': '2.982', 'DAMAGECOUNT': '13.050', 'FRAGCOUNT': '48.000'} [2023-02-25 13:48:06,312][36156] DAMAGECOUNT value on done: 499477.0 [2023-02-25 13:48:06,313][36156] Sum rewards: 47.834, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.632', 'AMMO5': '0.012', 'AMMO2': '0.047', 'AMMO3': '0.166', 'weapon5': '0.210', 'AMMO4': '0.237', 'weapon4': '0.380', 'weapon2': '0.382', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '0.950', 'HITCOUNT': '2.460', 'weapon3': '2.792', 'DAMAGECOUNT': '13.629', 'FRAGCOUNT': '41.000'} [2023-02-25 13:48:06,490][36142] DAMAGECOUNT value on done: 496936.0 [2023-02-25 13:48:06,491][36142] Sum rewards: 54.734, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.445', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.094', 'AMMO4': '0.145', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.318', 'WEAPON4': '0.400', 'weapon4': '0.712', 'WEAPON3': '1.250', 'weapon3': '2.686', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.727', 'FRAGCOUNT': '49.000'} [2023-02-25 13:48:06,613][36156] DAMAGECOUNT value on done: 488735.0 [2023-02-25 13:48:06,614][36156] Sum rewards: 52.770, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.340', 'AMMO5': '0.012', 'AMMO2': '0.047', 'AMMO3': '0.199', 'AMMO4': '0.235', 'weapon2': '0.256', 'weapon4': '0.280', 'WEAPON4': '0.350', 'weapon5': '0.360', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.730', 'weapon3': '2.846', 'DAMAGECOUNT': '14.445', 'FRAGCOUNT': '46.000'} [2023-02-25 13:48:06,649][36156] DAMAGECOUNT value on done: 491590.0 [2023-02-25 13:48:06,650][36156] Sum rewards: 43.447, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.342', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'weapon5': '0.058', 'AMMO3': '0.097', 'AMMO4': '0.167', 'WEAPON5': '0.200', 'ARMOR': '0.408', 'weapon2': '0.420', 'WEAPON4': '0.450', 'WEAPON3': '0.650', 'weapon4': '1.402', 'weapon3': '1.644', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '11.442', 'FRAGCOUNT': '34.000'} [2023-02-25 13:48:07,751][36138] Updated weights for policy 0, policy_version 43793 (0.0010) [2023-02-25 13:48:09,729][36114] Fps is (10 sec: 13107.0, 60 sec: 13380.2, 300 sec: 13426.5). Total num frames: 179400704. Throughput: 0: 3351.4. Samples: 7341358. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:48:09,730][36114] Avg episode reward: [(0, '54.159')] [2023-02-25 13:48:10,776][36138] Updated weights for policy 0, policy_version 43803 (0.0009) [2023-02-25 13:48:13,426][36155] DAMAGECOUNT value on done: 487606.0 [2023-02-25 13:48:13,426][36155] Sum rewards: 47.960, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.270', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.138', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'weapon2': '0.368', 'WEAPON4': '0.450', 'weapon4': '0.754', 'WEAPON3': '0.950', 'weapon3': '2.570', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.164', 'FRAGCOUNT': '41.000'} [2023-02-25 13:48:13,746][36155] DAMAGECOUNT value on done: 502820.0 [2023-02-25 13:48:13,746][36155] Sum rewards: 50.998, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.795', 'AMMO5': '0.008', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon2': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon5': '0.220', 'weapon4': '0.252', 'WEAPON3': '1.350', 'HITCOUNT': '2.740', 'weapon3': '3.100', 'DAMAGECOUNT': '13.383', 'FRAGCOUNT': '46.000'} [2023-02-25 13:48:13,885][36138] Updated weights for policy 0, policy_version 43813 (0.0009) [2023-02-25 13:48:14,275][36155] DAMAGECOUNT value on done: 498416.0 [2023-02-25 13:48:14,276][36155] Sum rewards: 58.711, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.748', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.082', 'AMMO4': '0.151', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'weapon2': '0.396', 'WEAPON4': '0.400', 'weapon4': '0.630', 'WEAPON3': '1.150', 'weapon3': '2.726', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.018', 'FRAGCOUNT': '50.000'} [2023-02-25 13:48:14,295][36154] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 13:48:14,593][36155] DAMAGECOUNT value on done: 491264.0 [2023-02-25 13:48:14,593][36155] Sum rewards: 56.736, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.540', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.182', 'AMMO4': '0.192', 'WEAPON5': '0.300', 'weapon5': '0.304', 'weapon2': '0.392', 'weapon4': '0.410', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.522', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.624', 'FRAGCOUNT': '48.000'} [2023-02-25 13:48:14,726][36139] DAMAGECOUNT value on done: 503006.0 [2023-02-25 13:48:14,726][36139] Sum rewards: 50.824, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.372', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.140', 'AMMO3': '0.148', 'AMMO4': '0.222', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.646', 'weapon2': '0.842', 'WEAPON3': '0.950', 'weapon3': '2.058', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.725', 'FRAGCOUNT': '45.000'} [2023-02-25 13:48:14,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13426.6). Total num frames: 179466240. Throughput: 0: 3354.3. Samples: 7361612. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:48:14,730][36114] Avg episode reward: [(0, '53.971')] [2023-02-25 13:48:15,032][36139] DAMAGECOUNT value on done: 493501.0 [2023-02-25 13:48:15,033][36139] Sum rewards: 54.322, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.758', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.068', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'weapon5': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'weapon2': '0.302', 'WEAPON3': '1.250', 'HITCOUNT': '2.840', 'weapon3': '3.188', 'DAMAGECOUNT': '15.033', 'FRAGCOUNT': '47.000'} [2023-02-25 13:48:15,636][36139] DAMAGECOUNT value on done: 498958.0 [2023-02-25 13:48:15,636][36139] Sum rewards: 45.715, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.778', 'AMMO5': '0.016', 'AMMO2': '0.040', 'AMMO3': '0.134', 'AMMO4': '0.202', 'weapon5': '0.314', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.604', 'weapon4': '0.768', 'WEAPON3': '0.850', 'weapon3': '2.064', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.641', 'FRAGCOUNT': '37.000'} [2023-02-25 13:48:15,962][36139] DAMAGECOUNT value on done: 498182.0 [2023-02-25 13:48:15,963][36139] Sum rewards: 57.063, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.030', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.044', 'AMMO4': '0.062', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.294', 'weapon2': '0.416', 'WEAPON3': '0.800', 'HITCOUNT': '2.910', 'weapon3': '3.118', 'DAMAGECOUNT': '14.004', 'FRAGCOUNT': '45.000'} [2023-02-25 13:48:16,914][36138] Updated weights for policy 0, policy_version 43823 (0.0010) [2023-02-25 13:48:19,729][36114] Fps is (10 sec: 13517.0, 60 sec: 13448.5, 300 sec: 13426.6). Total num frames: 179535872. Throughput: 0: 3350.0. Samples: 7381660. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:48:19,730][36114] Avg episode reward: [(0, '53.616')] [2023-02-25 13:48:19,981][36138] Updated weights for policy 0, policy_version 43833 (0.0009) [2023-02-25 13:48:21,530][36154] DAMAGECOUNT value on done: 499586.0 [2023-02-25 13:48:21,531][36154] Sum rewards: 55.829, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.008', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON5': '0.050', 'weapon5': '0.080', 'weapon4': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'weapon2': '0.700', 'WEAPON3': '1.300', 'HITCOUNT': '2.800', 'weapon3': '2.940', 'DAMAGECOUNT': '13.188', 'FRAGCOUNT': '50.000'} [2023-02-25 13:48:21,839][36154] DAMAGECOUNT value on done: 491422.0 [2023-02-25 13:48:21,839][36154] Sum rewards: 52.326, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.455', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.037', 'AMMO4': '0.187', 'AMMO3': '0.203', 'weapon5': '0.226', 'weapon2': '0.360', 'weapon4': '0.418', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.730', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '46.000'} [2023-02-25 13:48:22,101][36154] DAMAGECOUNT value on done: 495489.0 [2023-02-25 13:48:22,102][36154] Sum rewards: 54.834, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.045', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.035', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.161', 'AMMO4': '0.175', 'weapon2': '0.280', 'WEAPON4': '0.400', 'weapon4': '0.592', 'WEAPON3': '1.000', 'weapon3': '2.890', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.095', 'FRAGCOUNT': '48.000'} [2023-02-25 13:48:22,408][36154] DAMAGECOUNT value on done: 498134.0 [2023-02-25 13:48:22,409][36154] Sum rewards: 54.349, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.414', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'weapon4': '0.176', 'weapon5': '0.218', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON3': '1.400', 'HITCOUNT': '2.890', 'weapon3': '3.070', 'DAMAGECOUNT': '15.003', 'FRAGCOUNT': '48.000'} [2023-02-25 13:48:22,495][36141] DAMAGECOUNT value on done: 504498.0 [2023-02-25 13:48:22,496][36141] Sum rewards: 65.355, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.786', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.165', 'AMMO4': '0.177', 'WEAPON5': '0.300', 'weapon5': '0.312', 'weapon2': '0.338', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'weapon4': '1.060', 'weapon3': '2.008', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '54.000'} [2023-02-25 13:48:22,679][36141] DAMAGECOUNT value on done: 489858.0 [2023-02-25 13:48:22,680][36141] Sum rewards: 40.385, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.075', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon5': '0.054', 'weapon7': '0.068', 'AMMO4': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.127', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.358', 'weapon4': '0.602', 'WEAPON3': '0.650', 'weapon3': '2.000', 'HITCOUNT': '2.130', 'DAMAGECOUNT': '9.135', 'FRAGCOUNT': '34.000'} [2023-02-25 13:48:22,805][36141] DAMAGECOUNT value on done: 504183.0 [2023-02-25 13:48:22,806][36141] Sum rewards: 46.890, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.430', 'AMMO5': '0.022', 'AMMO2': '0.081', 'AMMO3': '0.145', 'weapon2': '0.368', 'weapon5': '0.394', 'AMMO4': '0.407', 'WEAPON5': '0.650', 'WEAPON3': '0.850', 'WEAPON4': '0.900', 'weapon4': '1.030', 'weapon3': '1.888', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '13.674', 'FRAGCOUNT': '43.000'} [2023-02-25 13:48:22,989][36141] DAMAGECOUNT value on done: 486238.0 [2023-02-25 13:48:22,989][36141] Sum rewards: 56.460, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.695', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.114', 'AMMO4': '0.129', 'weapon2': '0.134', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'weapon4': '0.320', 'WEAPON3': '1.300', 'HITCOUNT': '3.040', 'weapon3': '3.220', 'DAMAGECOUNT': '13.896', 'FRAGCOUNT': '49.000'} [2023-02-25 13:48:23,007][36138] Updated weights for policy 0, policy_version 43843 (0.0009) [2023-02-25 13:48:23,235][36157] DAMAGECOUNT value on done: 508484.0 [2023-02-25 13:48:23,236][36157] Sum rewards: 53.755, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.670', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.164', 'weapon5': '0.168', 'AMMO4': '0.182', 'AMMO3': '0.209', 'weapon2': '0.276', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '3.060', 'weapon3': '3.150', 'DAMAGECOUNT': '15.165', 'FRAGCOUNT': '47.000'} [2023-02-25 13:48:23,535][36157] DAMAGECOUNT value on done: 495626.0 [2023-02-25 13:48:23,536][36157] Sum rewards: 47.415, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.138', 'AMMO5': '0.015', 'AMMO2': '0.040', 'AMMO3': '0.153', 'AMMO4': '0.202', 'weapon5': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.416', 'weapon4': '0.542', 'WEAPON3': '0.950', 'weapon3': '2.532', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '12.657', 'FRAGCOUNT': '41.000'} [2023-02-25 13:48:24,250][36157] DAMAGECOUNT value on done: 503486.0 [2023-02-25 13:48:24,251][36157] Sum rewards: 53.732, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.761', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'weapon5': '0.072', 'weapon4': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.250', 'weapon2': '0.544', 'WEAPON3': '1.500', 'HITCOUNT': '2.910', 'weapon3': '3.088', 'DAMAGECOUNT': '14.316', 'FRAGCOUNT': '47.000'} [2023-02-25 13:48:24,549][36140] DAMAGECOUNT value on done: 504000.0 [2023-02-25 13:48:24,550][36140] Sum rewards: 52.689, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.106', 'HEALTH': '0.114', 'AMMO3': '0.177', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.338', 'weapon4': '0.612', 'WEAPON3': '0.950', 'weapon3': '2.692', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.572', 'FRAGCOUNT': '44.000'} [2023-02-25 13:48:24,567][36157] DAMAGECOUNT value on done: 501830.0 [2023-02-25 13:48:24,568][36157] Sum rewards: 55.788, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.310', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.040', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'AMMO4': '0.202', 'weapon2': '0.332', 'WEAPON4': '0.350', 'weapon4': '0.688', 'WEAPON3': '1.100', 'weapon3': '2.680', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '14.169', 'FRAGCOUNT': '47.000'} [2023-02-25 13:48:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13426.6). Total num frames: 179601408. Throughput: 0: 3347.2. Samples: 7391714. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:48:24,730][36114] Avg episode reward: [(0, '53.235')] [2023-02-25 13:48:24,860][36140] DAMAGECOUNT value on done: 489105.0 [2023-02-25 13:48:24,861][36140] Sum rewards: 44.767, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.316', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'weapon2': '0.228', 'weapon4': '0.268', 'WEAPON3': '1.100', 'HITCOUNT': '2.530', 'weapon3': '3.142', 'DAMAGECOUNT': '11.853', 'FRAGCOUNT': '38.000'} [2023-02-25 13:48:25,152][36140] DAMAGECOUNT value on done: 493985.0 [2023-02-25 13:48:25,153][36140] Sum rewards: 55.139, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.455', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon5': '0.146', 'AMMO4': '0.193', 'AMMO3': '0.210', 'weapon4': '0.252', 'WEAPON5': '0.300', 'weapon2': '0.384', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.860', 'weapon3': '2.908', 'DAMAGECOUNT': '14.634', 'FRAGCOUNT': '49.000'} [2023-02-25 13:48:25,465][36140] DAMAGECOUNT value on done: 492493.0 [2023-02-25 13:48:25,466][36140] Sum rewards: 60.570, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.235', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.164', 'AMMO3': '0.175', 'weapon2': '0.224', 'weapon4': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.142', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.003', 'FRAGCOUNT': '52.000'} [2023-02-25 13:48:26,019][36138] Updated weights for policy 0, policy_version 43853 (0.0010) [2023-02-25 13:48:26,032][36142] DAMAGECOUNT value on done: 498429.0 [2023-02-25 13:48:26,033][36142] Sum rewards: 51.393, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.700', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.064', 'AMMO4': '0.090', 'WEAPON5': '0.150', 'weapon4': '0.188', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon2': '0.510', 'WEAPON3': '1.250', 'weapon3': '2.844', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.169', 'FRAGCOUNT': '47.500'} [2023-02-25 13:48:26,278][36142] DAMAGECOUNT value on done: 488567.0 [2023-02-25 13:48:26,278][36142] Sum rewards: 41.979, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.320', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.076', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'WEAPON4': '0.350', 'weapon2': '0.440', 'weapon4': '0.478', 'WEAPON3': '1.150', 'HITCOUNT': '2.480', 'weapon3': '2.716', 'DAMAGECOUNT': '12.609', 'FRAGCOUNT': '37.000'} [2023-02-25 13:48:26,353][36142] DAMAGECOUNT value on done: 489808.0 [2023-02-25 13:48:26,354][36142] Sum rewards: 50.540, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.660', 'AMMO5': '0.017', 'AMMO2': '0.054', 'AMMO3': '0.202', 'AMMO4': '0.271', 'weapon5': '0.272', 'WEAPON5': '0.450', 'weapon4': '0.510', 'weapon2': '0.536', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.368', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '14.769', 'FRAGCOUNT': '46.000'} [2023-02-25 13:48:26,447][36156] DAMAGECOUNT value on done: 503621.0 [2023-02-25 13:48:26,448][36156] Sum rewards: 46.733, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.659', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon4': '0.138', 'weapon5': '0.194', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'weapon2': '0.382', 'WEAPON3': '1.150', 'HITCOUNT': '2.350', 'weapon3': '2.994', 'DAMAGECOUNT': '12.360', 'FRAGCOUNT': '42.000'} [2023-02-25 13:48:26,478][36156] DAMAGECOUNT value on done: 504749.0 [2023-02-25 13:48:26,479][36156] Sum rewards: 55.911, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.018', 'AMMO5': '0.020', 'AMMO2': '0.036', 'weapon5': '0.174', 'AMMO4': '0.181', 'AMMO3': '0.213', 'weapon2': '0.308', 'WEAPON4': '0.350', 'ARMOR': '0.408', 'WEAPON5': '0.500', 'weapon4': '0.610', 'WEAPON3': '1.300', 'weapon3': '2.582', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.816', 'FRAGCOUNT': '48.000'} [2023-02-25 13:48:26,604][36142] DAMAGECOUNT value on done: 502528.0 [2023-02-25 13:48:26,605][36142] Sum rewards: 64.640, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.723', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.146', 'AMMO3': '0.159', 'AMMO4': '0.190', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON4': '0.400', 'weapon4': '0.478', 'WEAPON3': '1.000', 'weapon3': '2.774', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '54.000'} [2023-02-25 13:48:26,750][36156] DAMAGECOUNT value on done: 493602.0 [2023-02-25 13:48:26,750][36156] Sum rewards: 56.712, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.938', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO3': '0.144', 'weapon5': '0.178', 'AMMO4': '0.203', 'WEAPON5': '0.350', 'weapon2': '0.428', 'WEAPON4': '0.450', 'weapon4': '0.482', 'WEAPON3': '0.850', 'weapon3': '2.654', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.601', 'FRAGCOUNT': '47.000'} [2023-02-25 13:48:26,778][36156] DAMAGECOUNT value on done: 495240.0 [2023-02-25 13:48:26,779][36156] Sum rewards: 41.425, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.690', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.054', 'AMMO3': '0.160', 'weapon5': '0.200', 'AMMO4': '0.271', 'weapon2': '0.334', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'weapon4': '0.720', 'WEAPON3': '1.000', 'HITCOUNT': '2.410', 'weapon3': '2.442', 'DAMAGECOUNT': '10.950', 'FRAGCOUNT': '38.000'} [2023-02-25 13:48:29,014][36138] Updated weights for policy 0, policy_version 43863 (0.0009) [2023-02-25 13:48:29,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 179671040. Throughput: 0: 3347.2. Samples: 7411976. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:48:29,730][36114] Avg episode reward: [(0, '53.220')] [2023-02-25 13:48:32,070][36138] Updated weights for policy 0, policy_version 43873 (0.0009) [2023-02-25 13:48:33,393][36155] DAMAGECOUNT value on done: 491911.0 [2023-02-25 13:48:33,393][36155] Sum rewards: 50.906, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.730', 'ARMOR': '0.004', 'weapon5': '0.006', 'AMMO5': '0.013', 'AMMO2': '0.017', 'AMMO4': '0.082', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'weapon4': '0.430', 'weapon2': '0.468', 'WEAPON3': '1.300', 'weapon3': '2.686', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.915', 'FRAGCOUNT': '45.000'} [2023-02-25 13:48:33,699][36155] DAMAGECOUNT value on done: 507405.0 [2023-02-25 13:48:33,700][36155] Sum rewards: 52.101, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.110', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.090', 'AMMO4': '0.138', 'AMMO3': '0.164', 'weapon4': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.458', 'WEAPON3': '0.950', 'HITCOUNT': '2.890', 'weapon3': '3.050', 'DAMAGECOUNT': '13.755', 'FRAGCOUNT': '43.000'} [2023-02-25 13:48:34,165][36155] DAMAGECOUNT value on done: 503626.0 [2023-02-25 13:48:34,165][36155] Sum rewards: 60.018, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.520', 'AMMO2': '0.010', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'AMMO3': '0.239', 'weapon2': '0.266', 'WEAPON3': '1.400', 'HITCOUNT': '3.300', 'weapon3': '3.542', 'DAMAGECOUNT': '15.630', 'FRAGCOUNT': '52.000'} [2023-02-25 13:48:34,473][36155] DAMAGECOUNT value on done: 495808.0 [2023-02-25 13:48:34,474][36155] Sum rewards: 51.836, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.860', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.066', 'weapon4': '0.076', 'AMMO4': '0.134', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.444', 'WEAPON3': '1.150', 'HITCOUNT': '3.080', 'weapon3': '3.242', 'DAMAGECOUNT': '13.632', 'FRAGCOUNT': '44.000'} [2023-02-25 13:48:34,530][36139] DAMAGECOUNT value on done: 507330.0 [2023-02-25 13:48:34,531][36139] Sum rewards: 42.809, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.548', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.045', 'weapon5': '0.142', 'AMMO3': '0.218', 'AMMO4': '0.224', 'WEAPON5': '0.250', 'weapon4': '0.392', 'WEAPON4': '0.450', 'weapon2': '0.452', 'WEAPON3': '1.250', 'HITCOUNT': '2.690', 'weapon3': '2.758', 'DAMAGECOUNT': '12.972', 'FRAGCOUNT': '40.000'} [2023-02-25 13:48:34,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13426.5). Total num frames: 179736576. Throughput: 0: 3350.6. Samples: 7432180. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:48:34,730][36114] Avg episode reward: [(0, '53.013')] [2023-02-25 13:48:34,838][36139] DAMAGECOUNT value on done: 497591.0 [2023-02-25 13:48:34,839][36139] Sum rewards: 52.495, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.122', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.012', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.141', 'WEAPON4': '0.250', 'weapon4': '0.320', 'weapon2': '0.704', 'WEAPON3': '1.000', 'HITCOUNT': '2.730', 'weapon3': '2.778', 'DAMAGECOUNT': '12.270', 'FRAGCOUNT': '44.000'} [2023-02-25 13:48:35,112][36138] Updated weights for policy 0, policy_version 43883 (0.0010) [2023-02-25 13:48:35,434][36139] DAMAGECOUNT value on done: 503176.0 [2023-02-25 13:48:35,435][36139] Sum rewards: 41.390, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.920', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.069', 'weapon5': '0.156', 'AMMO3': '0.209', 'AMMO4': '0.343', 'weapon2': '0.358', 'WEAPON5': '0.400', 'weapon4': '0.698', 'WEAPON4': '0.750', 'WEAPON3': '1.300', 'weapon3': '2.464', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.654', 'FRAGCOUNT': '41.000'} [2023-02-25 13:48:35,735][36139] DAMAGECOUNT value on done: 503521.0 [2023-02-25 13:48:35,735][36139] Sum rewards: 54.793, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.091', 'AMMO5': '0.013', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon5': '0.174', 'AMMO3': '0.220', 'weapon2': '0.334', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.494', 'WEAPON3': '1.300', 'weapon3': '2.746', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '48.000'} [2023-02-25 13:48:38,165][36138] Updated weights for policy 0, policy_version 43893 (0.0009) [2023-02-25 13:48:39,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 179806208. Throughput: 0: 3350.7. Samples: 7442226. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:48:39,730][36114] Avg episode reward: [(0, '52.881')] [2023-02-25 13:48:41,213][36138] Updated weights for policy 0, policy_version 43903 (0.0009) [2023-02-25 13:48:41,465][36154] DAMAGECOUNT value on done: 504888.0 [2023-02-25 13:48:41,466][36154] Sum rewards: 57.952, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.914', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon5': '0.082', 'AMMO4': '0.155', 'AMMO3': '0.178', 'weapon4': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.662', 'WEAPON3': '1.200', 'weapon3': '2.776', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.906', 'FRAGCOUNT': '50.000'} [2023-02-25 13:48:41,774][36154] DAMAGECOUNT value on done: 495659.0 [2023-02-25 13:48:41,775][36154] Sum rewards: 40.970, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.040', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.102', 'AMMO3': '0.113', 'weapon5': '0.180', 'AMMO4': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'weapon2': '0.986', 'HITCOUNT': '2.170', 'weapon3': '2.500', 'DAMAGECOUNT': '11.229', 'FRAGCOUNT': '34.000'} [2023-02-25 13:48:42,046][36154] DAMAGECOUNT value on done: 500182.0 [2023-02-25 13:48:42,046][36154] Sum rewards: 53.701, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.873', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon4': '0.028', 'AMMO4': '0.098', 'weapon5': '0.150', 'AMMO3': '0.175', 'weapon2': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'HITCOUNT': '2.560', 'weapon3': '3.406', 'DAMAGECOUNT': '14.079', 'FRAGCOUNT': '46.000'} [2023-02-25 13:48:42,348][36154] DAMAGECOUNT value on done: 502373.0 [2023-02-25 13:48:42,348][36154] Sum rewards: 48.938, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.485', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.100', 'AMMO4': '0.144', 'AMMO3': '0.152', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.512', 'weapon2': '0.600', 'WEAPON3': '0.900', 'weapon3': '2.616', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.702', 'FRAGCOUNT': '40.500'} [2023-02-25 13:48:42,489][36141] DAMAGECOUNT value on done: 509631.0 [2023-02-25 13:48:42,490][36141] Sum rewards: 57.341, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.768', 'AMMO5': '0.013', 'AMMO2': '0.015', 'weapon4': '0.064', 'AMMO4': '0.076', 'weapon5': '0.092', 'weapon2': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'AMMO3': '0.275', 'WEAPON3': '1.650', 'HITCOUNT': '3.030', 'weapon3': '3.448', 'DAMAGECOUNT': '15.399', 'FRAGCOUNT': '52.000'} [2023-02-25 13:48:42,640][36141] DAMAGECOUNT value on done: 494339.0 [2023-02-25 13:48:42,641][36141] Sum rewards: 53.329, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.202', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.076', 'weapon4': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.241', 'weapon2': '0.652', 'WEAPON3': '1.400', 'HITCOUNT': '2.770', 'weapon3': '2.966', 'DAMAGECOUNT': '13.443', 'FRAGCOUNT': '50.000'} [2023-02-25 13:48:42,796][36141] DAMAGECOUNT value on done: 509092.0 [2023-02-25 13:48:42,797][36141] Sum rewards: 50.813, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.743', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.174', 'AMMO4': '0.182', 'AMMO3': '0.189', 'weapon4': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.674', 'WEAPON3': '1.200', 'weapon3': '2.566', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.427', 'FRAGCOUNT': '46.000'} [2023-02-25 13:48:42,951][36141] DAMAGECOUNT value on done: 490751.0 [2023-02-25 13:48:42,951][36141] Sum rewards: 53.681, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.285', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon5': '0.108', 'AMMO3': '0.187', 'AMMO4': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.322', 'weapon4': '0.508', 'WEAPON3': '1.150', 'HITCOUNT': '2.730', 'weapon3': '2.900', 'DAMAGECOUNT': '13.539', 'FRAGCOUNT': '45.000'} [2023-02-25 13:48:43,119][36157] DAMAGECOUNT value on done: 514059.0 [2023-02-25 13:48:43,120][36157] Sum rewards: 65.926, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.930', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.127', 'weapon5': '0.164', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.408', 'weapon2': '0.552', 'WEAPON3': '1.100', 'weapon3': '2.660', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '54.500'} [2023-02-25 13:48:43,428][36157] DAMAGECOUNT value on done: 499970.0 [2023-02-25 13:48:43,428][36157] Sum rewards: 53.981, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.335', 'AMMO2': '0.009', 'AMMO4': '0.047', 'AMMO3': '0.190', 'weapon2': '0.218', 'WEAPON3': '1.200', 'HITCOUNT': '2.960', 'weapon3': '3.660', 'DAMAGECOUNT': '13.032', 'FRAGCOUNT': '46.000'} [2023-02-25 13:48:44,147][36157] DAMAGECOUNT value on done: 508015.0 [2023-02-25 13:48:44,148][36157] Sum rewards: 47.780, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.028', 'AMMO5': '0.017', 'AMMO2': '0.042', 'AMMO3': '0.142', 'AMMO4': '0.211', 'weapon5': '0.360', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.630', 'weapon4': '0.804', 'WEAPON3': '0.900', 'weapon3': '1.934', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.587', 'FRAGCOUNT': '40.000'} [2023-02-25 13:48:44,301][36138] Updated weights for policy 0, policy_version 43913 (0.0009) [2023-02-25 13:48:44,452][36157] DAMAGECOUNT value on done: 506457.0 [2023-02-25 13:48:44,453][36157] Sum rewards: 57.307, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.285', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.090', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.220', 'weapon2': '0.272', 'WEAPON4': '0.300', 'weapon4': '0.572', 'WEAPON3': '1.200', 'weapon3': '2.848', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '13.881', 'FRAGCOUNT': '50.000'} [2023-02-25 13:48:44,480][36140] DAMAGECOUNT value on done: 509698.0 [2023-02-25 13:48:44,481][36140] Sum rewards: 60.303, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.324', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon5': '0.184', 'AMMO3': '0.219', 'weapon2': '0.236', 'AMMO4': '0.258', 'WEAPON5': '0.400', 'weapon4': '0.486', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.768', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '53.000'} [2023-02-25 13:48:44,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13440.4). Total num frames: 179871744. Throughput: 0: 3349.7. Samples: 7462512. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:48:44,730][36114] Avg episode reward: [(0, '52.996')] [2023-02-25 13:48:44,795][36140] DAMAGECOUNT value on done: 493651.0 [2023-02-25 13:48:44,795][36140] Sum rewards: 48.339, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.812', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.060', 'AMMO3': '0.138', 'weapon5': '0.228', 'AMMO4': '0.302', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon2': '0.600', 'WEAPON3': '0.800', 'weapon4': '1.152', 'weapon3': '1.778', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '13.638', 'FRAGCOUNT': '40.000'} [2023-02-25 13:48:45,092][36140] DAMAGECOUNT value on done: 498786.0 [2023-02-25 13:48:45,093][36140] Sum rewards: 58.832, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.329', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'weapon2': '0.398', 'weapon4': '0.462', 'WEAPON3': '1.000', 'weapon3': '2.900', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.403', 'FRAGCOUNT': '50.000'} [2023-02-25 13:48:45,400][36140] DAMAGECOUNT value on done: 496837.0 [2023-02-25 13:48:45,400][36140] Sum rewards: 50.002, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.780', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.016', 'weapon5': '0.056', 'AMMO4': '0.081', 'WEAPON5': '0.100', 'weapon4': '0.150', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon2': '0.344', 'WEAPON3': '1.100', 'HITCOUNT': '2.690', 'weapon3': '3.322', 'DAMAGECOUNT': '13.032', 'FRAGCOUNT': '43.000'} [2023-02-25 13:48:45,987][36142] DAMAGECOUNT value on done: 503103.0 [2023-02-25 13:48:45,988][36142] Sum rewards: 54.815, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.409', 'AMMO5': '0.008', 'AMMO2': '0.033', 'AMMO4': '0.164', 'weapon5': '0.198', 'AMMO3': '0.247', 'WEAPON5': '0.250', 'weapon4': '0.346', 'WEAPON4': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.400', 'weapon3': '2.834', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.022', 'FRAGCOUNT': '49.000'} [2023-02-25 13:48:46,241][36142] DAMAGECOUNT value on done: 493643.0 [2023-02-25 13:48:46,242][36142] Sum rewards: 53.635, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.180', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.132', 'AMMO3': '0.207', 'weapon4': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.434', 'WEAPON3': '1.200', 'HITCOUNT': '2.900', 'weapon3': '2.970', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '45.000'} [2023-02-25 13:48:46,303][36142] DAMAGECOUNT value on done: 494798.0 [2023-02-25 13:48:46,303][36142] Sum rewards: 51.629, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.544', 'AMMO5': '0.020', 'AMMO2': '0.047', 'AMMO3': '0.139', 'AMMO4': '0.235', 'weapon5': '0.416', 'weapon4': '0.426', 'weapon2': '0.490', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'weapon3': '2.310', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '14.970', 'FRAGCOUNT': '43.500'} [2023-02-25 13:48:46,551][36142] DAMAGECOUNT value on done: 507385.0 [2023-02-25 13:48:46,552][36142] Sum rewards: 52.614, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.570', 'AMMO5': '0.015', 'AMMO2': '0.042', 'AMMO3': '0.203', 'AMMO4': '0.212', 'weapon5': '0.238', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.594', 'weapon2': '0.630', 'WEAPON3': '1.200', 'weapon3': '2.248', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.571', 'FRAGCOUNT': '48.000'} [2023-02-25 13:48:46,553][36156] DAMAGECOUNT value on done: 508610.0 [2023-02-25 13:48:46,553][36156] Sum rewards: 55.671, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.353', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.096', 'AMMO4': '0.222', 'AMMO3': '0.230', 'WEAPON5': '0.300', 'weapon4': '0.356', 'weapon2': '0.426', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.776', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.967', 'FRAGCOUNT': '51.000'} [2023-02-25 13:48:46,573][36156] DAMAGECOUNT value on done: 510015.0 [2023-02-25 13:48:46,574][36156] Sum rewards: 69.257, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.641', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.176', 'weapon2': '0.420', 'WEAPON3': '1.150', 'HITCOUNT': '3.280', 'weapon3': '3.426', 'DAMAGECOUNT': '15.798', 'FRAGCOUNT': '57.000'} [2023-02-25 13:48:46,866][36156] DAMAGECOUNT value on done: 497780.0 [2023-02-25 13:48:46,867][36156] Sum rewards: 47.370, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.232', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.033', 'AMMO4': '0.163', 'AMMO3': '0.189', 'weapon4': '0.246', 'weapon5': '0.288', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.478', 'WEAPON3': '1.200', 'weapon3': '2.564', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '12.534', 'FRAGCOUNT': '43.000'} [2023-02-25 13:48:46,886][36156] DAMAGECOUNT value on done: 499935.0 [2023-02-25 13:48:46,887][36156] Sum rewards: 48.844, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.770', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.059', 'weapon5': '0.110', 'WEAPON5': '0.150', 'weapon2': '0.182', 'AMMO3': '0.214', 'AMMO4': '0.296', 'WEAPON4': '0.450', 'weapon4': '0.638', 'WEAPON3': '1.300', 'weapon3': '2.844', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.085', 'FRAGCOUNT': '44.000'} [2023-02-25 13:48:47,301][36138] Updated weights for policy 0, policy_version 43923 (0.0009) [2023-02-25 13:48:49,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13440.4). Total num frames: 179941376. Throughput: 0: 3353.8. Samples: 7482862. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:48:49,729][36114] Avg episode reward: [(0, '52.840')] [2023-02-25 13:48:50,343][36138] Updated weights for policy 0, policy_version 43933 (0.0009) [2023-02-25 13:48:53,288][36155] DAMAGECOUNT value on done: 496775.0 [2023-02-25 13:48:53,288][36155] Sum rewards: 46.305, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.609', 'ARMOR': '0.008', 'AMMO5': '0.014', 'weapon7': '0.048', 'AMMO2': '0.065', 'AMMO3': '0.156', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon2': '0.222', 'weapon5': '0.274', 'AMMO4': '0.323', 'WEAPON5': '0.350', 'WEAPON4': '0.600', 'weapon4': '0.852', 'WEAPON3': '0.900', 'weapon3': '2.180', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '14.172', 'FRAGCOUNT': '39.500'} [2023-02-25 13:48:53,358][36138] Updated weights for policy 0, policy_version 43943 (0.0009) [2023-02-25 13:48:53,607][36155] DAMAGECOUNT value on done: 512908.0 [2023-02-25 13:48:53,607][36155] Sum rewards: 72.439, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.692', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon2': '0.178', 'AMMO3': '0.193', 'WEAPON3': '1.150', 'HITCOUNT': '3.370', 'weapon3': '3.696', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '60.000'} [2023-02-25 13:48:54,085][36155] DAMAGECOUNT value on done: 509341.0 [2023-02-25 13:48:54,085][36155] Sum rewards: 65.266, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.930', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon5': '0.158', 'AMMO4': '0.164', 'weapon2': '0.182', 'AMMO3': '0.197', 'weapon4': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.136', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '54.000'} [2023-02-25 13:48:54,384][36155] DAMAGECOUNT value on done: 501711.0 [2023-02-25 13:48:54,384][36155] Sum rewards: 67.802, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.748', 'AMMO5': '0.007', 'AMMO2': '0.031', 'AMMO4': '0.157', 'weapon5': '0.172', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.374', 'weapon4': '0.946', 'WEAPON3': '1.050', 'weapon3': '2.250', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.709', 'FRAGCOUNT': '55.000'} [2023-02-25 13:48:54,436][36139] DAMAGECOUNT value on done: 511978.0 [2023-02-25 13:48:54,436][36139] Sum rewards: 43.430, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.192', 'AMMO5': '0.012', 'ARMOR': '0.012', 'AMMO2': '0.045', 'weapon5': '0.110', 'AMMO4': '0.226', 'AMMO3': '0.255', 'weapon2': '0.314', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.596', 'WEAPON3': '1.550', 'weapon3': '2.648', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.944', 'FRAGCOUNT': '42.000'} [2023-02-25 13:48:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 180006912. Throughput: 0: 3368.5. Samples: 7492940. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:48:54,730][36114] Avg episode reward: [(0, '53.142')] [2023-02-25 13:48:54,733][36139] DAMAGECOUNT value on done: 502533.0 [2023-02-25 13:48:54,733][36139] Sum rewards: 61.563, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.190', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.028', 'WEAPON5': '0.050', 'weapon2': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.233', 'weapon4': '0.356', 'WEAPON3': '1.350', 'HITCOUNT': '3.290', 'weapon3': '3.302', 'DAMAGECOUNT': '14.826', 'FRAGCOUNT': '54.000'} [2023-02-25 13:48:55,309][36139] DAMAGECOUNT value on done: 507402.0 [2023-02-25 13:48:55,310][36139] Sum rewards: 50.058, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.457', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.181', 'AMMO3': '0.195', 'WEAPON4': '0.350', 'weapon2': '0.466', 'weapon4': '0.492', 'WEAPON3': '1.100', 'weapon3': '2.744', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.678', 'FRAGCOUNT': '45.000'} [2023-02-25 13:48:55,620][36139] DAMAGECOUNT value on done: 507502.0 [2023-02-25 13:48:55,621][36139] Sum rewards: 46.805, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.447', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.052', 'AMMO4': '0.072', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon4': '0.332', 'weapon2': '0.594', 'WEAPON3': '1.050', 'weapon3': '2.572', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '11.943', 'FRAGCOUNT': '39.000'} [2023-02-25 13:48:56,434][36138] Updated weights for policy 0, policy_version 43953 (0.0009) [2023-02-25 13:48:59,464][36138] Updated weights for policy 0, policy_version 43963 (0.0010) [2023-02-25 13:48:59,729][36114] Fps is (10 sec: 13106.9, 60 sec: 13380.2, 300 sec: 13426.5). Total num frames: 180072448. Throughput: 0: 3369.2. Samples: 7513226. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:48:59,730][36114] Avg episode reward: [(0, '53.082')] [2023-02-25 13:49:01,309][36154] DAMAGECOUNT value on done: 509350.0 [2023-02-25 13:49:01,310][36154] Sum rewards: 45.436, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.577', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.010', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'weapon5': '0.058', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.292', 'weapon2': '0.320', 'WEAPON3': '1.700', 'HITCOUNT': '2.910', 'weapon3': '3.296', 'DAMAGECOUNT': '13.386', 'FRAGCOUNT': '43.000'} [2023-02-25 13:49:01,625][36154] DAMAGECOUNT value on done: 500638.0 [2023-02-25 13:49:01,626][36154] Sum rewards: 54.206, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.168', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.068', 'weapon5': '0.192', 'AMMO3': '0.222', 'WEAPON5': '0.300', 'AMMO4': '0.340', 'weapon4': '0.352', 'WEAPON4': '0.450', 'weapon2': '0.474', 'WEAPON3': '1.250', 'weapon3': '2.680', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.937', 'FRAGCOUNT': '48.500'} [2023-02-25 13:49:01,903][36154] DAMAGECOUNT value on done: 504239.0 [2023-02-25 13:49:01,903][36154] Sum rewards: 39.854, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.510', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.064', 'AMMO3': '0.198', 'weapon5': '0.226', 'AMMO4': '0.321', 'weapon4': '0.392', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'weapon2': '0.738', 'WEAPON3': '1.100', 'weapon3': '2.376', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '12.171', 'FRAGCOUNT': '37.000'} [2023-02-25 13:49:02,183][36141] DAMAGECOUNT value on done: 513723.0 [2023-02-25 13:49:02,184][36141] Sum rewards: 44.404, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.350', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.040', 'AMMO4': '0.197', 'AMMO3': '0.203', 'weapon5': '0.266', 'weapon4': '0.334', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.678', 'WEAPON3': '1.200', 'weapon3': '2.166', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '12.276', 'FRAGCOUNT': '40.000'} [2023-02-25 13:49:02,203][36154] DAMAGECOUNT value on done: 507758.0 [2023-02-25 13:49:02,203][36154] Sum rewards: 68.950, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.381', 'AMMO5': '0.019', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.168', 'weapon5': '0.170', 'weapon4': '0.204', 'WEAPON4': '0.300', 'weapon2': '0.318', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '3.110', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.155', 'FRAGCOUNT': '57.000'} [2023-02-25 13:49:02,445][36141] DAMAGECOUNT value on done: 498803.0 [2023-02-25 13:49:02,446][36141] Sum rewards: 52.449, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.270', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.042', 'AMMO4': '0.145', 'AMMO3': '0.186', 'weapon4': '0.220', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '2.690', 'weapon3': '3.300', 'DAMAGECOUNT': '13.392', 'FRAGCOUNT': '47.000'} [2023-02-25 13:49:02,463][36138] Updated weights for policy 0, policy_version 43973 (0.0009) [2023-02-25 13:49:02,496][36141] DAMAGECOUNT value on done: 513666.0 [2023-02-25 13:49:02,496][36141] Sum rewards: 47.748, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.486', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO4': '0.193', 'AMMO3': '0.246', 'weapon4': '0.256', 'weapon2': '0.342', 'weapon5': '0.344', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.736', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '13.722', 'FRAGCOUNT': '44.000'} [2023-02-25 13:49:02,765][36141] DAMAGECOUNT value on done: 495621.0 [2023-02-25 13:49:02,765][36141] Sum rewards: 57.496, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.749', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.158', 'AMMO3': '0.166', 'WEAPON4': '0.350', 'weapon4': '0.632', 'weapon2': '0.712', 'WEAPON3': '1.000', 'weapon3': '2.456', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '14.610', 'FRAGCOUNT': '46.500'} [2023-02-25 13:49:03,135][36157] DAMAGECOUNT value on done: 518757.0 [2023-02-25 13:49:03,135][36157] Sum rewards: 52.160, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.400', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO4': '0.057', 'weapon5': '0.062', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'weapon4': '0.248', 'weapon2': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.800', 'weapon3': '3.066', 'DAMAGECOUNT': '14.094', 'FRAGCOUNT': '46.000'} [2023-02-25 13:49:03,460][36157] DAMAGECOUNT value on done: 505151.0 [2023-02-25 13:49:03,461][36157] Sum rewards: 56.310, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.103', 'AMMO5': '0.016', 'AMMO2': '0.038', 'AMMO3': '0.153', 'AMMO4': '0.189', 'weapon5': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.360', 'weapon4': '0.468', 'WEAPON3': '1.000', 'weapon3': '2.702', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.543', 'FRAGCOUNT': '45.500'} [2023-02-25 13:49:04,073][36157] DAMAGECOUNT value on done: 512688.0 [2023-02-25 13:49:04,074][36157] Sum rewards: 56.428, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.560', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.024', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'weapon4': '0.334', 'weapon2': '0.570', 'WEAPON3': '1.300', 'weapon3': '2.800', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.019', 'FRAGCOUNT': '50.000'} [2023-02-25 13:49:04,270][36140] DAMAGECOUNT value on done: 513910.0 [2023-02-25 13:49:04,270][36140] Sum rewards: 41.052, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.754', 'ARMOR': '0.012', 'AMMO5': '0.027', 'AMMO2': '0.060', 'weapon2': '0.224', 'AMMO3': '0.232', 'AMMO4': '0.299', 'weapon5': '0.362', 'weapon4': '0.492', 'WEAPON4': '0.700', 'WEAPON5': '0.750', 'WEAPON3': '1.250', 'HITCOUNT': '2.440', 'weapon3': '2.572', 'DAMAGECOUNT': '12.636', 'FRAGCOUNT': '39.000'} [2023-02-25 13:49:04,381][36157] DAMAGECOUNT value on done: 511786.0 [2023-02-25 13:49:04,382][36157] Sum rewards: 65.363, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.480', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.096', 'weapon2': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon4': '0.314', 'WEAPON3': '1.300', 'weapon3': '3.230', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '56.000'} [2023-02-25 13:49:04,577][36140] DAMAGECOUNT value on done: 497669.0 [2023-02-25 13:49:04,577][36140] Sum rewards: 48.693, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.018', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.228', 'weapon4': '0.282', 'weapon2': '0.730', 'WEAPON3': '1.400', 'HITCOUNT': '2.630', 'weapon3': '2.782', 'DAMAGECOUNT': '12.054', 'FRAGCOUNT': '44.000'} [2023-02-25 13:49:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 180142080. Throughput: 0: 3374.9. Samples: 7533530. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:49:04,730][36114] Avg episode reward: [(0, '53.176')] [2023-02-25 13:49:04,890][36140] DAMAGECOUNT value on done: 504219.0 [2023-02-25 13:49:04,891][36140] Sum rewards: 72.578, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.320', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO3': '0.182', 'weapon2': '0.444', 'WEAPON3': '1.050', 'weapon3': '3.408', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.299', 'FRAGCOUNT': '60.000'} [2023-02-25 13:49:05,206][36140] DAMAGECOUNT value on done: 502469.0 [2023-02-25 13:49:05,207][36140] Sum rewards: 67.061, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.766', 'AMMO5': '0.022', 'AMMO2': '0.051', 'AMMO3': '0.146', 'weapon2': '0.204', 'AMMO4': '0.257', 'weapon5': '0.306', 'weapon4': '0.414', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '0.850', 'weapon3': '2.780', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '56.000'} [2023-02-25 13:49:05,493][36138] Updated weights for policy 0, policy_version 43983 (0.0009) [2023-02-25 13:49:05,894][36142] DAMAGECOUNT value on done: 508738.0 [2023-02-25 13:49:05,894][36142] Sum rewards: 65.629, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.457', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.127', 'AMMO3': '0.158', 'weapon5': '0.206', 'weapon2': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.482', 'WEAPON3': '0.900', 'weapon3': '2.840', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '53.000'} [2023-02-25 13:49:06,170][36142] DAMAGECOUNT value on done: 499094.0 [2023-02-25 13:49:06,170][36142] Sum rewards: 66.634, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.563', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.086', 'weapon5': '0.112', 'AMMO4': '0.154', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.350', 'HITCOUNT': '3.070', 'weapon3': '3.136', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '58.000'} [2023-02-25 13:49:06,220][36142] DAMAGECOUNT value on done: 499052.0 [2023-02-25 13:49:06,220][36142] Sum rewards: 44.757, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.414', 'ARMOR': '0.008', 'AMMO5': '0.021', 'AMMO2': '0.058', 'AMMO3': '0.196', 'weapon5': '0.198', 'weapon2': '0.268', 'AMMO4': '0.291', 'weapon4': '0.422', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'HITCOUNT': '2.470', 'weapon3': '2.726', 'DAMAGECOUNT': '12.762', 'FRAGCOUNT': '42.000'} [2023-02-25 13:49:06,443][36156] DAMAGECOUNT value on done: 514126.0 [2023-02-25 13:49:06,444][36156] Sum rewards: 63.707, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.490', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.126', 'AMMO4': '0.129', 'AMMO3': '0.217', 'weapon4': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.466', 'WEAPON3': '1.350', 'weapon3': '2.944', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '56.000'} [2023-02-25 13:49:06,455][36156] DAMAGECOUNT value on done: 515712.0 [2023-02-25 13:49:06,456][36156] Sum rewards: 70.845, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.090', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.166', 'AMMO3': '0.232', 'ARMOR': '0.400', 'weapon2': '0.458', 'WEAPON3': '1.400', 'weapon3': '3.134', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '60.000'} [2023-02-25 13:49:06,483][36142] DAMAGECOUNT value on done: 512196.0 [2023-02-25 13:49:06,483][36142] Sum rewards: 55.278, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.954', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'AMMO3': '0.198', 'weapon4': '0.200', 'weapon2': '0.270', 'WEAPON3': '1.200', 'HITCOUNT': '3.190', 'weapon3': '3.380', 'DAMAGECOUNT': '14.388', 'FRAGCOUNT': '47.000'} [2023-02-25 13:49:06,756][36156] DAMAGECOUNT value on done: 502242.0 [2023-02-25 13:49:06,757][36156] Sum rewards: 39.478, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.791', 'ARMOR': '0.008', 'AMMO5': '0.028', 'AMMO2': '0.084', 'AMMO3': '0.175', 'weapon2': '0.360', 'weapon5': '0.380', 'AMMO4': '0.421', 'WEAPON5': '0.650', 'WEAPON4': '0.800', 'WEAPON3': '1.100', 'weapon4': '1.128', 'weapon3': '1.818', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.386', 'FRAGCOUNT': '36.500'} [2023-02-25 13:49:06,768][36156] DAMAGECOUNT value on done: 504683.0 [2023-02-25 13:49:06,769][36156] Sum rewards: 55.602, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.090', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.414', 'weapon4': '0.506', 'WEAPON3': '1.300', 'weapon3': '2.808', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.244', 'FRAGCOUNT': '49.000'} [2023-02-25 13:49:08,466][36138] Updated weights for policy 0, policy_version 43993 (0.0009) [2023-02-25 13:49:09,729][36114] Fps is (10 sec: 13926.5, 60 sec: 13516.8, 300 sec: 13440.4). Total num frames: 180211712. Throughput: 0: 3378.9. Samples: 7543764. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:49:09,730][36114] Avg episode reward: [(0, '53.659')] [2023-02-25 13:49:11,479][36138] Updated weights for policy 0, policy_version 44003 (0.0009) [2023-02-25 13:49:12,977][36155] DAMAGECOUNT value on done: 501795.0 [2023-02-25 13:49:12,978][36155] Sum rewards: 62.885, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.326', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'weapon2': '0.206', 'weapon4': '0.250', 'WEAPON3': '1.100', 'HITCOUNT': '3.070', 'weapon3': '3.232', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '51.000'} [2023-02-25 13:49:13,283][36155] DAMAGECOUNT value on done: 517014.0 [2023-02-25 13:49:13,284][36155] Sum rewards: 44.277, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.104', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.127', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon5': '0.240', 'WEAPON4': '0.250', 'weapon4': '0.262', 'weapon2': '0.306', 'WEAPON3': '1.200', 'HITCOUNT': '2.300', 'weapon3': '2.940', 'DAMAGECOUNT': '12.318', 'FRAGCOUNT': '40.000'} [2023-02-25 13:49:13,745][36155] DAMAGECOUNT value on done: 513619.0 [2023-02-25 13:49:13,745][36155] Sum rewards: 48.913, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.986', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon5': '0.074', 'AMMO4': '0.096', 'AMMO3': '0.165', 'weapon2': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.308', 'WEAPON3': '1.000', 'HITCOUNT': '2.410', 'weapon3': '3.266', 'DAMAGECOUNT': '12.594', 'FRAGCOUNT': '42.000'} [2023-02-25 13:49:14,024][36139] DAMAGECOUNT value on done: 516421.0 [2023-02-25 13:49:14,025][36139] Sum rewards: 42.441, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.706', 'ARMOR': '0.012', 'AMMO5': '0.034', 'AMMO2': '0.095', 'AMMO3': '0.127', 'weapon2': '0.342', 'weapon5': '0.440', 'AMMO4': '0.473', 'weapon4': '0.532', 'WEAPON3': '0.800', 'WEAPON5': '0.950', 'WEAPON4': '1.050', 'weapon3': '2.252', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '13.320', 'FRAGCOUNT': '39.000'} [2023-02-25 13:49:14,055][36155] DAMAGECOUNT value on done: 506442.0 [2023-02-25 13:49:14,055][36155] Sum rewards: 58.380, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.280', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.066', 'weapon4': '0.090', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.226', 'WEAPON3': '1.300', 'HITCOUNT': '2.970', 'weapon3': '3.570', 'DAMAGECOUNT': '14.193', 'FRAGCOUNT': '51.000'} [2023-02-25 13:49:14,318][36139] DAMAGECOUNT value on done: 506710.0 [2023-02-25 13:49:14,318][36139] Sum rewards: 52.596, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.699', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'WEAPON5': '0.100', 'AMMO3': '0.158', 'weapon2': '0.574', 'WEAPON3': '0.950', 'HITCOUNT': '2.450', 'weapon3': '3.262', 'DAMAGECOUNT': '12.531', 'FRAGCOUNT': '43.000'} [2023-02-25 13:49:14,478][36138] Updated weights for policy 0, policy_version 44013 (0.0009) [2023-02-25 13:49:14,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13440.4). Total num frames: 180277248. Throughput: 0: 3382.3. Samples: 7564180. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:49:14,730][36114] Avg episode reward: [(0, '53.777')] [2023-02-25 13:49:14,902][36139] DAMAGECOUNT value on done: 511493.0 [2023-02-25 13:49:14,903][36139] Sum rewards: 42.900, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.892', 'AMMO5': '0.010', 'AMMO2': '0.054', 'AMMO3': '0.164', 'weapon5': '0.220', 'weapon2': '0.256', 'AMMO4': '0.272', 'WEAPON5': '0.350', 'WEAPON4': '0.600', 'weapon4': '0.912', 'WEAPON3': '1.100', 'weapon3': '2.390', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.273', 'FRAGCOUNT': '38.000'} [2023-02-25 13:49:15,205][36139] DAMAGECOUNT value on done: 513673.0 [2023-02-25 13:49:15,206][36139] Sum rewards: 74.371, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.990', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.100', 'AMMO4': '0.145', 'weapon4': '0.158', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.490', 'WEAPON3': '1.250', 'weapon3': '3.026', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '63.000'} [2023-02-25 13:49:17,519][36138] Updated weights for policy 0, policy_version 44023 (0.0009) [2023-02-25 13:49:17,817][36156] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('ARMOR', -0.001, -1.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 13:49:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13454.3). Total num frames: 180346880. Throughput: 0: 3383.3. Samples: 7584430. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:49:19,730][36114] Avg episode reward: [(0, '53.795')] [2023-02-25 13:49:19,734][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000044030_180346880.pth... [2023-02-25 13:49:19,787][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000043242_177119232.pth [2023-02-25 13:49:20,567][36138] Updated weights for policy 0, policy_version 44033 (0.0010) [2023-02-25 13:49:21,170][36154] DAMAGECOUNT value on done: 514633.0 [2023-02-25 13:49:21,171][36154] Sum rewards: 55.382, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.565', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO4': '0.181', 'AMMO3': '0.208', 'weapon5': '0.326', 'weapon2': '0.338', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.494', 'WEAPON3': '1.250', 'weapon3': '2.518', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.849', 'FRAGCOUNT': '49.000'} [2023-02-25 13:49:21,478][36154] DAMAGECOUNT value on done: 505349.0 [2023-02-25 13:49:21,479][36154] Sum rewards: 53.760, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.105', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.044', 'AMMO3': '0.175', 'weapon2': '0.214', 'AMMO4': '0.221', 'weapon5': '0.340', 'WEAPON5': '0.400', 'weapon4': '0.488', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.660', 'weapon3': '2.696', 'DAMAGECOUNT': '14.013', 'FRAGCOUNT': '46.000'} [2023-02-25 13:49:21,750][36154] DAMAGECOUNT value on done: 509295.0 [2023-02-25 13:49:21,751][36154] Sum rewards: 58.118, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.388', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon5': '0.140', 'AMMO3': '0.232', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON4': '0.300', 'weapon4': '0.630', 'WEAPON3': '1.400', 'weapon3': '2.746', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.168', 'FRAGCOUNT': '51.000'} [2023-02-25 13:49:22,005][36141] DAMAGECOUNT value on done: 516459.0 [2023-02-25 13:49:22,006][36141] Sum rewards: 32.398, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.890', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.044', 'AMMO3': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.164', 'weapon7': '0.174', 'WEAPON7': '0.200', 'AMMO4': '0.218', 'weapon2': '0.312', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '0.750', 'weapon4': '0.772', 'HITCOUNT': '1.690', 'weapon3': '1.974', 'DAMAGECOUNT': '8.208', 'FRAGCOUNT': '30.000'} [2023-02-25 13:49:22,052][36154] DAMAGECOUNT value on done: 512063.0 [2023-02-25 13:49:22,052][36154] Sum rewards: 47.715, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.893', 'AMMO5': '0.017', 'AMMO2': '0.032', 'AMMO3': '0.138', 'AMMO4': '0.160', 'weapon5': '0.254', 'weapon2': '0.288', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '0.850', 'weapon4': '1.192', 'weapon3': '1.952', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.915', 'FRAGCOUNT': '41.000'} [2023-02-25 13:49:22,267][36141] DAMAGECOUNT value on done: 503280.0 [2023-02-25 13:49:22,268][36141] Sum rewards: 47.379, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.940', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.182', 'AMMO3': '0.194', 'AMMO4': '0.214', 'weapon5': '0.274', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.532', 'WEAPON3': '1.150', 'weapon3': '2.694', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '13.431', 'FRAGCOUNT': '43.500'} [2023-02-25 13:49:22,319][36141] DAMAGECOUNT value on done: 517946.0 [2023-02-25 13:49:22,320][36141] Sum rewards: 51.268, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.656', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.053', 'AMMO3': '0.169', 'AMMO4': '0.264', 'weapon5': '0.276', 'weapon2': '0.308', 'weapon4': '0.408', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.050', 'HITCOUNT': '2.690', 'weapon3': '2.742', 'DAMAGECOUNT': '12.840', 'FRAGCOUNT': '47.000'} [2023-02-25 13:49:22,574][36141] DAMAGECOUNT value on done: 502025.0 [2023-02-25 13:49:22,574][36141] Sum rewards: 80.179, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.354', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon2': '0.158', 'weapon5': '0.164', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.264', 'WEAPON3': '1.300', 'weapon3': '3.192', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.212', 'FRAGCOUNT': '65.000'} [2023-02-25 13:49:23,005][36157] DAMAGECOUNT value on done: 523887.0 [2023-02-25 13:49:23,005][36157] Sum rewards: 57.223, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.620', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon4': '0.096', 'AMMO4': '0.158', 'weapon5': '0.192', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.400', 'HITCOUNT': '3.020', 'weapon3': '3.026', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '51.500'} [2023-02-25 13:49:23,322][36157] DAMAGECOUNT value on done: 509763.0 [2023-02-25 13:49:23,322][36157] Sum rewards: 52.931, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.298', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon5': '0.194', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.420', 'weapon4': '0.444', 'WEAPON3': '1.350', 'weapon3': '2.644', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.836', 'FRAGCOUNT': '48.000'} [2023-02-25 13:49:23,633][36138] Updated weights for policy 0, policy_version 44043 (0.0009) [2023-02-25 13:49:23,937][36157] DAMAGECOUNT value on done: 517208.0 [2023-02-25 13:49:23,938][36157] Sum rewards: 58.152, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.505', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO3': '0.154', 'weapon2': '0.326', 'weapon4': '0.412', 'WEAPON3': '0.950', 'HITCOUNT': '2.720', 'weapon3': '3.062', 'DAMAGECOUNT': '13.560', 'FRAGCOUNT': '47.000'} [2023-02-25 13:49:24,141][36140] DAMAGECOUNT value on done: 519192.0 [2023-02-25 13:49:24,141][36140] Sum rewards: 56.279, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.410', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.055', 'AMMO3': '0.170', 'weapon5': '0.220', 'weapon2': '0.224', 'AMMO4': '0.274', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'weapon4': '0.840', 'WEAPON3': '0.950', 'weapon3': '2.262', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '47.500'} [2023-02-25 13:49:24,246][36157] DAMAGECOUNT value on done: 516248.0 [2023-02-25 13:49:24,247][36157] Sum rewards: 48.471, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.020', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'AMMO4': '0.174', 'WEAPON4': '0.450', 'weapon2': '0.538', 'weapon4': '0.812', 'WEAPON3': '1.000', 'weapon3': '2.350', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.386', 'FRAGCOUNT': '41.000'} [2023-02-25 13:49:24,455][36140] DAMAGECOUNT value on done: 502236.0 [2023-02-25 13:49:24,455][36140] Sum rewards: 53.450, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.727', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'weapon5': '0.142', 'AMMO4': '0.159', 'AMMO3': '0.166', 'WEAPON4': '0.300', 'weapon2': '0.506', 'weapon4': '0.528', 'WEAPON3': '1.050', 'weapon3': '2.684', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.701', 'FRAGCOUNT': '44.000'} [2023-02-25 13:49:24,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13440.4). Total num frames: 180412416. Throughput: 0: 3385.1. Samples: 7594554. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:49:24,729][36114] Avg episode reward: [(0, '53.967')] [2023-02-25 13:49:24,756][36140] DAMAGECOUNT value on done: 509431.0 [2023-02-25 13:49:24,757][36140] Sum rewards: 65.632, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.010', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.102', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.338', 'weapon4': '0.444', 'WEAPON3': '1.100', 'weapon3': '2.918', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '55.000'} [2023-02-25 13:49:25,059][36140] DAMAGECOUNT value on done: 507248.0 [2023-02-25 13:49:25,060][36140] Sum rewards: 51.599, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.468', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon4': '0.054', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.168', 'AMMO3': '0.213', 'weapon2': '0.562', 'WEAPON3': '1.350', 'HITCOUNT': '2.760', 'weapon3': '2.964', 'DAMAGECOUNT': '14.337', 'FRAGCOUNT': '45.500'} [2023-02-25 13:49:25,770][36142] DAMAGECOUNT value on done: 513888.0 [2023-02-25 13:49:25,771][36142] Sum rewards: 65.548, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.124', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.011', 'weapon4': '0.030', 'weapon5': '0.034', 'AMMO4': '0.056', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon2': '0.486', 'WEAPON3': '1.200', 'HITCOUNT': '3.100', 'weapon3': '3.312', 'DAMAGECOUNT': '15.435', 'FRAGCOUNT': '56.000'} [2023-02-25 13:49:26,052][36142] DAMAGECOUNT value on done: 502860.0 [2023-02-25 13:49:26,053][36142] Sum rewards: 38.207, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.580', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'weapon4': '0.256', 'weapon5': '0.302', 'weapon2': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.380', 'weapon3': '2.722', 'DAMAGECOUNT': '10.998', 'FRAGCOUNT': '36.000'} [2023-02-25 13:49:26,099][36142] DAMAGECOUNT value on done: 503640.0 [2023-02-25 13:49:26,099][36142] Sum rewards: 48.509, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.742', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.034', 'AMMO4': '0.172', 'AMMO3': '0.196', 'weapon5': '0.230', 'weapon4': '0.280', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '2.520', 'weapon3': '2.880', 'DAMAGECOUNT': '13.764', 'FRAGCOUNT': '43.000'} [2023-02-25 13:49:26,317][36156] DAMAGECOUNT value on done: 519756.0 [2023-02-25 13:49:26,317][36156] Sum rewards: 61.484, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.116', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon2': '0.192', 'AMMO4': '0.211', 'weapon5': '0.228', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.570', 'WEAPON3': '1.450', 'weapon3': '2.734', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '54.000'} [2023-02-25 13:49:26,327][36156] DAMAGECOUNT value on done: 520498.0 [2023-02-25 13:49:26,328][36156] Sum rewards: 67.076, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.478', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'weapon4': '0.194', 'weapon2': '0.372', 'WEAPON3': '0.900', 'weapon3': '3.138', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.358', 'FRAGCOUNT': '56.000'} [2023-02-25 13:49:26,348][36142] DAMAGECOUNT value on done: 516114.0 [2023-02-25 13:49:26,349][36142] Sum rewards: 44.282, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.098', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.038', 'AMMO3': '0.173', 'AMMO4': '0.191', 'weapon5': '0.220', 'WEAPON5': '0.400', 'weapon2': '0.494', 'WEAPON4': '0.500', 'weapon4': '0.632', 'WEAPON3': '1.050', 'weapon3': '2.364', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '11.754', 'FRAGCOUNT': '41.000'} [2023-02-25 13:49:26,532][36140] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 13:49:26,638][36138] Updated weights for policy 0, policy_version 44053 (0.0010) [2023-02-25 13:49:26,649][36156] DAMAGECOUNT value on done: 507029.0 [2023-02-25 13:49:26,650][36156] Sum rewards: 43.136, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.377', 'ARMOR': '0.008', 'AMMO5': '0.021', 'AMMO2': '0.063', 'AMMO3': '0.234', 'weapon5': '0.234', 'weapon4': '0.274', 'AMMO4': '0.317', 'weapon2': '0.374', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.450', 'HITCOUNT': '2.580', 'weapon3': '2.826', 'DAMAGECOUNT': '13.881', 'FRAGCOUNT': '42.000'} [2023-02-25 13:49:26,661][36156] DAMAGECOUNT value on done: 509716.0 [2023-02-25 13:49:26,662][36156] Sum rewards: 55.591, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.996', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon5': '0.118', 'AMMO4': '0.131', 'weapon4': '0.220', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.344', 'WEAPON3': '1.400', 'weapon3': '3.078', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.376', 'FRAGCOUNT': '50.500'} [2023-02-25 13:49:29,565][36138] Updated weights for policy 0, policy_version 44063 (0.0009) [2023-02-25 13:49:29,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13440.4). Total num frames: 180482048. Throughput: 0: 3385.8. Samples: 7614872. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:49:29,730][36114] Avg episode reward: [(0, '54.244')] [2023-02-25 13:49:32,626][36138] Updated weights for policy 0, policy_version 44073 (0.0009) [2023-02-25 13:49:32,953][36155] DAMAGECOUNT value on done: 505986.0 [2023-02-25 13:49:32,954][36155] Sum rewards: 45.052, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.432', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.078', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon5': '0.226', 'WEAPON4': '0.300', 'weapon2': '0.466', 'weapon4': '0.468', 'WEAPON3': '1.200', 'weapon3': '2.564', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.573', 'FRAGCOUNT': '40.500'} [2023-02-25 13:49:33,244][36155] DAMAGECOUNT value on done: 522169.0 [2023-02-25 13:49:33,244][36155] Sum rewards: 62.061, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.355', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.026', 'weapon4': '0.122', 'AMMO4': '0.130', 'AMMO3': '0.167', 'weapon5': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.476', 'WEAPON3': '1.000', 'weapon3': '2.850', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '15.465', 'FRAGCOUNT': '52.000'} [2023-02-25 13:49:33,722][36155] DAMAGECOUNT value on done: 518904.0 [2023-02-25 13:49:33,723][36155] Sum rewards: 59.094, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.165', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO4': '0.188', 'weapon5': '0.202', 'AMMO3': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.440', 'weapon2': '0.458', 'WEAPON3': '1.250', 'weapon3': '2.572', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '50.500'} [2023-02-25 13:49:33,917][36139] DAMAGECOUNT value on done: 520834.0 [2023-02-25 13:49:33,917][36139] Sum rewards: 51.211, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.934', 'AMMO5': '0.013', 'AMMO2': '0.050', 'AMMO3': '0.141', 'weapon5': '0.240', 'AMMO4': '0.251', 'WEAPON5': '0.400', 'weapon2': '0.406', 'WEAPON4': '0.550', 'weapon4': '0.784', 'WEAPON3': '0.900', 'weapon3': '2.280', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '13.239', 'FRAGCOUNT': '44.000'} [2023-02-25 13:49:34,017][36155] DAMAGECOUNT value on done: 511253.0 [2023-02-25 13:49:34,018][36155] Sum rewards: 54.505, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.757', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.165', 'weapon5': '0.212', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.724', 'WEAPON3': '1.050', 'weapon3': '2.474', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.433', 'FRAGCOUNT': '45.000'} [2023-02-25 13:49:34,219][36139] DAMAGECOUNT value on done: 512017.0 [2023-02-25 13:49:34,220][36139] Sum rewards: 53.098, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.646', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.055', 'AMMO3': '0.162', 'weapon5': '0.190', 'AMMO4': '0.273', 'weapon2': '0.462', 'weapon4': '0.494', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.536', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.912', 'FRAGCOUNT': '44.500'} [2023-02-25 13:49:34,729][36114] Fps is (10 sec: 13516.5, 60 sec: 13516.7, 300 sec: 13440.4). Total num frames: 180547584. Throughput: 0: 3383.7. Samples: 7635128. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:49:34,730][36114] Avg episode reward: [(0, '54.277')] [2023-02-25 13:49:34,809][36139] DAMAGECOUNT value on done: 517006.0 [2023-02-25 13:49:34,809][36139] Sum rewards: 60.883, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.302', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon5': '0.140', 'AMMO4': '0.156', 'AMMO3': '0.197', 'weapon2': '0.230', 'WEAPON5': '0.350', 'weapon4': '0.442', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.952', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.539', 'FRAGCOUNT': '52.000'} [2023-02-25 13:49:35,103][36139] DAMAGECOUNT value on done: 518677.0 [2023-02-25 13:49:35,103][36139] Sum rewards: 60.660, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.436', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.098', 'weapon5': '0.132', 'AMMO4': '0.152', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.150', 'weapon3': '3.074', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.012', 'FRAGCOUNT': '50.000'} [2023-02-25 13:49:35,688][36138] Updated weights for policy 0, policy_version 44083 (0.0009) [2023-02-25 13:49:38,696][36138] Updated weights for policy 0, policy_version 44093 (0.0009) [2023-02-25 13:49:39,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13454.3). Total num frames: 180617216. Throughput: 0: 3384.6. Samples: 7645246. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:49:39,729][36114] Avg episode reward: [(0, '54.374')] [2023-02-25 13:49:41,082][36154] DAMAGECOUNT value on done: 519132.0 [2023-02-25 13:49:41,082][36154] Sum rewards: 46.425, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.812', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.120', 'weapon2': '0.196', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.283', 'weapon4': '0.328', 'WEAPON3': '1.600', 'weapon3': '2.844', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.497', 'FRAGCOUNT': '42.000'} [2023-02-25 13:49:41,389][36154] DAMAGECOUNT value on done: 508843.0 [2023-02-25 13:49:41,390][36154] Sum rewards: 36.243, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.432', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'AMMO3': '0.233', 'weapon2': '0.240', 'ARMOR': '0.483', 'weapon4': '0.578', 'WEAPON3': '1.300', 'HITCOUNT': '2.240', 'weapon3': '2.926', 'DAMAGECOUNT': '10.482', 'FRAGCOUNT': '33.000'} [2023-02-25 13:49:41,675][36154] DAMAGECOUNT value on done: 514465.0 [2023-02-25 13:49:41,675][36154] Sum rewards: 55.127, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.430', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.104', 'weapon5': '0.134', 'AMMO4': '0.158', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.350', 'HITCOUNT': '2.930', 'weapon3': '3.026', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '48.000'} [2023-02-25 13:49:41,680][36138] Updated weights for policy 0, policy_version 44103 (0.0009) [2023-02-25 13:49:41,866][36141] DAMAGECOUNT value on done: 521231.0 [2023-02-25 13:49:41,867][36141] Sum rewards: 54.889, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.120', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon5': '0.154', 'WEAPON5': '0.200', 'AMMO3': '0.273', 'weapon2': '0.278', 'WEAPON4': '0.400', 'weapon4': '0.780', 'WEAPON3': '1.550', 'weapon3': '2.514', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.016', 'FRAGCOUNT': '51.000'} [2023-02-25 13:49:41,980][36154] DAMAGECOUNT value on done: 516797.0 [2023-02-25 13:49:41,980][36154] Sum rewards: 43.870, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.620', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO4': '0.186', 'weapon5': '0.194', 'AMMO3': '0.246', 'weapon2': '0.284', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.618', 'WEAPON3': '1.550', 'weapon3': '2.562', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.178', 'FRAGCOUNT': '41.000'} [2023-02-25 13:49:42,152][36141] DAMAGECOUNT value on done: 507834.0 [2023-02-25 13:49:42,153][36141] Sum rewards: 50.666, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.957', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.048', 'AMMO3': '0.191', 'weapon5': '0.226', 'AMMO4': '0.238', 'weapon4': '0.336', 'WEAPON5': '0.400', 'weapon2': '0.452', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.620', 'weapon3': '2.732', 'DAMAGECOUNT': '13.662', 'FRAGCOUNT': '46.000'} [2023-02-25 13:49:42,183][36141] DAMAGECOUNT value on done: 522052.0 [2023-02-25 13:49:42,184][36141] Sum rewards: 46.180, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.522', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.029', 'weapon5': '0.116', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.216', 'WEAPON4': '0.300', 'weapon4': '0.476', 'WEAPON3': '1.150', 'HITCOUNT': '2.610', 'weapon3': '2.966', 'DAMAGECOUNT': '12.318', 'FRAGCOUNT': '41.000'} [2023-02-25 13:49:42,485][36141] DAMAGECOUNT value on done: 507234.0 [2023-02-25 13:49:42,485][36141] Sum rewards: 61.138, reward structure: {'DEATHCOUNT': '-14.250', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'HEALTH': '0.156', 'weapon5': '0.162', 'AMMO3': '0.204', 'weapon2': '0.446', 'weapon4': '0.464', 'WEAPON3': '1.100', 'weapon3': '2.704', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.627', 'FRAGCOUNT': '51.000'} [2023-02-25 13:49:42,889][36157] DAMAGECOUNT value on done: 528202.0 [2023-02-25 13:49:42,890][36157] Sum rewards: 51.402, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.310', 'AMMO5': '0.008', 'AMMO2': '0.030', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.150', 'AMMO3': '0.163', 'weapon7': '0.168', 'weapon5': '0.198', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.428', 'weapon4': '0.876', 'WEAPON3': '0.950', 'weapon3': '2.056', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '12.645', 'FRAGCOUNT': '43.000'} [2023-02-25 13:49:43,198][36157] DAMAGECOUNT value on done: 514488.0 [2023-02-25 13:49:43,199][36157] Sum rewards: 40.794, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.162', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO4': '0.197', 'weapon2': '0.212', 'AMMO3': '0.285', 'weapon4': '0.316', 'weapon5': '0.338', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'HITCOUNT': '2.640', 'weapon3': '2.844', 'DAMAGECOUNT': '13.815', 'FRAGCOUNT': '40.500'} [2023-02-25 13:49:43,826][36157] DAMAGECOUNT value on done: 521739.0 [2023-02-25 13:49:43,826][36157] Sum rewards: 48.362, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.856', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon5': '0.112', 'AMMO4': '0.205', 'AMMO3': '0.217', 'weapon4': '0.346', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.594', 'WEAPON3': '1.200', 'weapon3': '2.682', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.593', 'FRAGCOUNT': '43.000'} [2023-02-25 13:49:44,000][36140] DAMAGECOUNT value on done: 524190.0 [2023-02-25 13:49:44,000][36140] Sum rewards: 64.310, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.847', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'weapon2': '0.314', 'weapon4': '0.494', 'WEAPON3': '1.050', 'weapon3': '2.894', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '53.000'} [2023-02-25 13:49:44,126][36157] DAMAGECOUNT value on done: 521303.0 [2023-02-25 13:49:44,126][36157] Sum rewards: 63.905, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.205', 'AMMO5': '0.006', 'AMMO2': '0.014', 'AMMO4': '0.067', 'weapon5': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon4': '0.206', 'weapon2': '0.394', 'WEAPON3': '1.150', 'weapon3': '3.084', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.165', 'FRAGCOUNT': '54.000'} [2023-02-25 13:49:44,298][36140] DAMAGECOUNT value on done: 506751.0 [2023-02-25 13:49:44,298][36140] Sum rewards: 49.627, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.700', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO3': '0.250', 'weapon2': '0.350', 'WEAPON3': '1.600', 'HITCOUNT': '2.850', 'weapon3': '3.496', 'DAMAGECOUNT': '13.545', 'FRAGCOUNT': '44.000'} [2023-02-25 13:49:44,612][36140] DAMAGECOUNT value on done: 513787.0 [2023-02-25 13:49:44,613][36140] Sum rewards: 42.081, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.888', 'AMMO5': '0.025', 'AMMO2': '0.072', 'weapon5': '0.148', 'AMMO3': '0.179', 'weapon2': '0.252', 'AMMO4': '0.359', 'ARMOR': '0.453', 'WEAPON5': '0.600', 'weapon4': '0.772', 'WEAPON4': '0.800', 'WEAPON3': '1.000', 'weapon3': '2.462', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.068', 'FRAGCOUNT': '38.500'} [2023-02-25 13:49:44,729][36114] Fps is (10 sec: 13517.2, 60 sec: 13516.8, 300 sec: 13440.4). Total num frames: 180682752. Throughput: 0: 3384.5. Samples: 7665526. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:49:44,729][36114] Avg episode reward: [(0, '54.165')] [2023-02-25 13:49:44,755][36138] Updated weights for policy 0, policy_version 44113 (0.0009) [2023-02-25 13:49:44,933][36140] DAMAGECOUNT value on done: 512859.0 [2023-02-25 13:49:44,934][36140] Sum rewards: 67.203, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.197', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.163', 'weapon4': '0.164', 'weapon5': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.636', 'WEAPON3': '1.000', 'weapon3': '2.814', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '56.000'} [2023-02-25 13:49:45,712][36142] DAMAGECOUNT value on done: 519350.0 [2023-02-25 13:49:45,713][36142] Sum rewards: 54.643, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.883', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.186', 'weapon2': '0.204', 'AMMO3': '0.217', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.668', 'WEAPON3': '1.350', 'weapon3': '2.626', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '49.000'} [2023-02-25 13:49:45,972][36142] DAMAGECOUNT value on done: 507039.0 [2023-02-25 13:49:45,972][36142] Sum rewards: 45.228, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.452', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.094', 'AMMO3': '0.157', 'weapon2': '0.274', 'WEAPON4': '0.300', 'weapon5': '0.306', 'WEAPON5': '0.350', 'weapon4': '0.624', 'WEAPON3': '0.950', 'HITCOUNT': '2.510', 'weapon3': '2.548', 'DAMAGECOUNT': '12.537', 'FRAGCOUNT': '38.000'} [2023-02-25 13:49:46,035][36142] DAMAGECOUNT value on done: 508781.0 [2023-02-25 13:49:46,036][36142] Sum rewards: 60.113, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.592', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon5': '0.162', 'AMMO4': '0.192', 'AMMO3': '0.196', 'weapon4': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.150', 'weapon3': '2.944', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.423', 'FRAGCOUNT': '50.500'} [2023-02-25 13:49:46,293][36142] DAMAGECOUNT value on done: 522127.0 [2023-02-25 13:49:46,293][36142] Sum rewards: 71.547, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.331', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.106', 'AMMO3': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.344', 'weapon2': '0.362', 'WEAPON3': '0.950', 'weapon3': '2.950', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '57.000'} [2023-02-25 13:49:46,362][36156] DAMAGECOUNT value on done: 524182.0 [2023-02-25 13:49:46,363][36156] Sum rewards: 52.398, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.080', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.144', 'AMMO3': '0.174', 'AMMO4': '0.192', 'weapon4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.740', 'weapon3': '3.142', 'DAMAGECOUNT': '13.278', 'FRAGCOUNT': '46.000'} [2023-02-25 13:49:46,374][36156] DAMAGECOUNT value on done: 525209.0 [2023-02-25 13:49:46,375][36156] Sum rewards: 48.905, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.406', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO3': '0.160', 'AMMO4': '0.182', 'weapon5': '0.184', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.556', 'weapon2': '0.656', 'WEAPON3': '1.000', 'weapon3': '2.320', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.983', 'FRAGCOUNT': '41.000'} [2023-02-25 13:49:46,667][36156] DAMAGECOUNT value on done: 511640.0 [2023-02-25 13:49:46,668][36156] Sum rewards: 51.568, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.817', 'ARMOR': '0.012', 'AMMO5': '0.016', 'AMMO2': '0.053', 'AMMO3': '0.150', 'weapon5': '0.194', 'weapon2': '0.224', 'AMMO4': '0.265', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '0.950', 'weapon4': '1.124', 'weapon3': '2.084', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.833', 'FRAGCOUNT': '44.000'} [2023-02-25 13:49:46,677][36156] DAMAGECOUNT value on done: 515070.0 [2023-02-25 13:49:46,678][36156] Sum rewards: 65.278, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.904', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.058', 'AMMO4': '0.095', 'weapon4': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon2': '0.336', 'WEAPON3': '1.350', 'weapon3': '3.238', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.062', 'FRAGCOUNT': '56.000'} [2023-02-25 13:49:47,845][36138] Updated weights for policy 0, policy_version 44123 (0.0009) [2023-02-25 13:49:49,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13454.3). Total num frames: 180752384. Throughput: 0: 3381.2. Samples: 7685682. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:49:49,729][36114] Avg episode reward: [(0, '54.429')] [2023-02-25 13:49:50,910][36138] Updated weights for policy 0, policy_version 44133 (0.0009) [2023-02-25 13:49:52,626][36155] DAMAGECOUNT value on done: 511520.0 [2023-02-25 13:49:52,627][36155] Sum rewards: 60.731, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.170', 'AMMO5': '0.008', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon5': '0.148', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'weapon2': '0.208', 'WEAPON4': '0.300', 'weapon4': '0.462', 'WEAPON3': '1.150', 'weapon3': '3.018', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '50.000'} [2023-02-25 13:49:52,921][36155] DAMAGECOUNT value on done: 526466.0 [2023-02-25 13:49:52,922][36155] Sum rewards: 50.482, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.820', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.152', 'AMMO3': '0.164', 'WEAPON4': '0.400', 'weapon2': '0.430', 'ARMOR': '0.450', 'weapon4': '0.850', 'WEAPON3': '1.000', 'weapon3': '2.522', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.891', 'FRAGCOUNT': '44.000'} [2023-02-25 13:49:53,370][36155] DAMAGECOUNT value on done: 524036.0 [2023-02-25 13:49:53,371][36155] Sum rewards: 50.474, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.307', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon5': '0.162', 'AMMO4': '0.241', 'AMMO3': '0.247', 'WEAPON5': '0.350', 'weapon2': '0.474', 'WEAPON4': '0.500', 'weapon4': '0.566', 'WEAPON3': '1.450', 'weapon3': '2.440', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '46.500'} [2023-02-25 13:49:53,677][36155] DAMAGECOUNT value on done: 515359.0 [2023-02-25 13:49:53,678][36155] Sum rewards: 41.980, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.345', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.126', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'weapon4': '0.318', 'WEAPON4': '0.350', 'weapon2': '0.414', 'WEAPON3': '1.200', 'HITCOUNT': '2.580', 'weapon3': '2.656', 'DAMAGECOUNT': '12.318', 'FRAGCOUNT': '38.000'} [2023-02-25 13:49:53,873][36139] DAMAGECOUNT value on done: 526003.0 [2023-02-25 13:49:53,873][36139] Sum rewards: 60.139, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.410', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.170', 'AMMO4': '0.191', 'weapon4': '0.204', 'AMMO3': '0.240', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.960', 'weapon3': '3.012', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '55.000'} [2023-02-25 13:49:53,932][36138] Updated weights for policy 0, policy_version 44143 (0.0010) [2023-02-25 13:49:54,177][36139] DAMAGECOUNT value on done: 516338.0 [2023-02-25 13:49:54,177][36139] Sum rewards: 45.686, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.225', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon5': '0.182', 'WEAPON4': '0.350', 'weapon2': '0.410', 'weapon4': '0.558', 'WEAPON3': '1.050', 'weapon3': '2.666', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.963', 'FRAGCOUNT': '40.000'} [2023-02-25 13:49:54,708][36139] DAMAGECOUNT value on done: 522065.0 [2023-02-25 13:49:54,708][36139] Sum rewards: 56.084, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.310', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.138', 'AMMO4': '0.166', 'AMMO3': '0.218', 'weapon2': '0.266', 'WEAPON5': '0.350', 'weapon4': '0.394', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.962', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.177', 'FRAGCOUNT': '50.000'} [2023-02-25 13:49:54,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13454.3). Total num frames: 180817920. Throughput: 0: 3378.4. Samples: 7695790. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:49:54,729][36114] Avg episode reward: [(0, '54.064')] [2023-02-25 13:49:55,030][36139] DAMAGECOUNT value on done: 523519.0 [2023-02-25 13:49:55,031][36139] Sum rewards: 60.962, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.006', 'AMMO5': '0.005', 'AMMO2': '0.035', 'AMMO3': '0.149', 'weapon5': '0.154', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'weapon2': '0.282', 'WEAPON4': '0.400', 'weapon4': '0.674', 'WEAPON3': '0.950', 'weapon3': '2.740', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '14.526', 'FRAGCOUNT': '52.000'} [2023-02-25 13:49:56,946][36138] Updated weights for policy 0, policy_version 44153 (0.0009) [2023-02-25 13:49:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13454.3). Total num frames: 180887552. Throughput: 0: 3373.8. Samples: 7716002. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:49:59,730][36114] Avg episode reward: [(0, '53.995')] [2023-02-25 13:49:59,950][36138] Updated weights for policy 0, policy_version 44163 (0.0009) [2023-02-25 13:50:01,035][36154] DAMAGECOUNT value on done: 523904.0 [2023-02-25 13:50:01,035][36154] Sum rewards: 54.120, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.215', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'weapon2': '0.406', 'weapon4': '0.444', 'WEAPON3': '1.200', 'weapon3': '2.804', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.316', 'FRAGCOUNT': '47.000'} [2023-02-25 13:50:01,349][36154] DAMAGECOUNT value on done: 513998.0 [2023-02-25 13:50:01,350][36154] Sum rewards: 60.440, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.180', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'weapon4': '0.080', 'weapon2': '0.248', 'AMMO3': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '3.250', 'weapon3': '3.518', 'DAMAGECOUNT': '15.465', 'FRAGCOUNT': '53.000'} [2023-02-25 13:50:01,630][36154] DAMAGECOUNT value on done: 520447.0 [2023-02-25 13:50:01,630][36154] Sum rewards: 67.956, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.675', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.122', 'AMMO3': '0.184', 'weapon5': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.380', 'weapon2': '0.586', 'WEAPON3': '1.100', 'weapon3': '2.494', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.946', 'FRAGCOUNT': '56.000'} [2023-02-25 13:50:01,936][36141] DAMAGECOUNT value on done: 526462.0 [2023-02-25 13:50:01,937][36141] Sum rewards: 65.587, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.652', 'AMMO5': '0.005', 'AMMO2': '0.046', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.165', 'weapon2': '0.216', 'AMMO4': '0.228', 'WEAPON4': '0.500', 'weapon4': '0.790', 'WEAPON3': '1.050', 'weapon3': '2.712', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '15.693', 'FRAGCOUNT': '57.000'} [2023-02-25 13:50:01,943][36154] DAMAGECOUNT value on done: 521982.0 [2023-02-25 13:50:01,944][36154] Sum rewards: 62.973, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.799', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.028', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'AMMO3': '0.162', 'weapon2': '0.296', 'WEAPON4': '0.300', 'weapon4': '0.544', 'WEAPON3': '1.100', 'weapon3': '2.902', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '52.000'} [2023-02-25 13:50:02,209][36141] DAMAGECOUNT value on done: 513589.0 [2023-02-25 13:50:02,210][36141] Sum rewards: 65.281, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.574', 'AMMO5': '0.008', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.154', 'weapon4': '0.200', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.350', 'weapon3': '3.072', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '56.000'} [2023-02-25 13:50:02,236][36141] DAMAGECOUNT value on done: 527145.0 [2023-02-25 13:50:02,237][36141] Sum rewards: 59.213, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.042', 'AMMO5': '0.003', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.175', 'AMMO3': '0.203', 'weapon2': '0.260', 'WEAPON4': '0.300', 'weapon4': '0.722', 'WEAPON3': '1.200', 'weapon3': '2.766', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.279', 'FRAGCOUNT': '50.000'} [2023-02-25 13:50:02,513][36141] DAMAGECOUNT value on done: 512293.0 [2023-02-25 13:50:02,514][36141] Sum rewards: 57.427, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.700', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.112', 'AMMO3': '0.141', 'weapon5': '0.148', 'weapon4': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.668', 'WEAPON3': '0.950', 'weapon3': '2.764', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.177', 'FRAGCOUNT': '46.000'} [2023-02-25 13:50:02,810][36157] DAMAGECOUNT value on done: 533570.0 [2023-02-25 13:50:02,810][36157] Sum rewards: 63.496, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.741', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.027', 'weapon5': '0.126', 'AMMO4': '0.135', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon2': '0.286', 'WEAPON4': '0.350', 'weapon4': '0.456', 'WEAPON3': '1.450', 'weapon3': '2.884', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '57.000'} [2023-02-25 13:50:02,986][36138] Updated weights for policy 0, policy_version 44173 (0.0009) [2023-02-25 13:50:03,116][36157] DAMAGECOUNT value on done: 518714.0 [2023-02-25 13:50:03,117][36157] Sum rewards: 46.621, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.590', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO4': '0.186', 'AMMO3': '0.203', 'weapon5': '0.216', 'WEAPON5': '0.300', 'weapon4': '0.324', 'WEAPON4': '0.400', 'weapon2': '0.446', 'WEAPON3': '1.200', 'weapon3': '2.714', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.678', 'FRAGCOUNT': '44.000'} [2023-02-25 13:50:03,735][36157] DAMAGECOUNT value on done: 527105.0 [2023-02-25 13:50:03,735][36157] Sum rewards: 64.320, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.712', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon2': '0.298', 'weapon4': '0.384', 'WEAPON3': '1.050', 'weapon3': '3.000', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.098', 'FRAGCOUNT': '53.000'} [2023-02-25 13:50:04,015][36140] DAMAGECOUNT value on done: 529747.0 [2023-02-25 13:50:04,015][36140] Sum rewards: 65.897, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.314', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'weapon4': '0.130', 'AMMO3': '0.203', 'weapon2': '0.328', 'WEAPON3': '1.250', 'weapon3': '3.344', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '54.000'} [2023-02-25 13:50:04,057][36157] DAMAGECOUNT value on done: 526369.0 [2023-02-25 13:50:04,057][36157] Sum rewards: 57.175, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.029', 'ARMOR': '0.004', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON4': '0.200', 'weapon2': '0.226', 'AMMO3': '0.240', 'weapon4': '0.346', 'WEAPON3': '1.550', 'weapon3': '3.234', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.198', 'FRAGCOUNT': '50.000'} [2023-02-25 13:50:04,320][36140] DAMAGECOUNT value on done: 511662.0 [2023-02-25 13:50:04,320][36140] Sum rewards: 54.135, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.300', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon5': '0.156', 'AMMO3': '0.169', 'AMMO4': '0.186', 'weapon2': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.442', 'WEAPON3': '1.000', 'weapon3': '2.804', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.733', 'FRAGCOUNT': '46.000'} [2023-02-25 13:50:04,629][36140] DAMAGECOUNT value on done: 518697.0 [2023-02-25 13:50:04,630][36140] Sum rewards: 53.029, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.228', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.055', 'weapon4': '0.180', 'AMMO3': '0.184', 'AMMO4': '0.275', 'weapon5': '0.298', 'weapon2': '0.366', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.760', 'weapon3': '2.786', 'DAMAGECOUNT': '14.730', 'FRAGCOUNT': '47.000'} [2023-02-25 13:50:04,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13454.3). Total num frames: 180953088. Throughput: 0: 3373.7. Samples: 7736246. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:50:04,730][36114] Avg episode reward: [(0, '55.199')] [2023-02-25 13:50:04,730][36125] Saving new best policy, reward=55.199! [2023-02-25 13:50:04,944][36140] DAMAGECOUNT value on done: 518179.0 [2023-02-25 13:50:04,944][36140] Sum rewards: 65.025, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.679', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.072', 'weapon4': '0.132', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon2': '0.360', 'WEAPON3': '1.100', 'weapon3': '3.152', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '54.500'} [2023-02-25 13:50:05,710][36142] DAMAGECOUNT value on done: 524319.0 [2023-02-25 13:50:05,711][36142] Sum rewards: 61.774, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.601', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.084', 'WEAPON5': '0.100', 'weapon4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.154', 'weapon2': '0.340', 'WEAPON3': '1.000', 'HITCOUNT': '3.130', 'weapon3': '3.296', 'DAMAGECOUNT': '14.907', 'FRAGCOUNT': '51.000'} [2023-02-25 13:50:05,950][36142] DAMAGECOUNT value on done: 512377.0 [2023-02-25 13:50:05,951][36142] Sum rewards: 61.399, reward structure: {'DEATHCOUNT': '-17.250', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.224', 'weapon4': '0.234', 'weapon2': '0.290', 'HEALTH': '0.758', 'WEAPON3': '1.200', 'weapon3': '3.126', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.014', 'FRAGCOUNT': '53.000'} [2023-02-25 13:50:06,023][36142] DAMAGECOUNT value on done: 514344.0 [2023-02-25 13:50:06,023][36142] Sum rewards: 64.929, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.772', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.023', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon4': '0.266', 'weapon2': '0.404', 'WEAPON3': '1.350', 'weapon3': '2.974', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '58.000'} [2023-02-25 13:50:06,080][36138] Updated weights for policy 0, policy_version 44183 (0.0009) [2023-02-25 13:50:06,277][36142] DAMAGECOUNT value on done: 526880.0 [2023-02-25 13:50:06,278][36142] Sum rewards: 50.864, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.496', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.021', 'weapon4': '0.060', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.185', 'weapon5': '0.242', 'WEAPON5': '0.450', 'weapon2': '0.496', 'WEAPON3': '1.250', 'HITCOUNT': '2.740', 'weapon3': '2.878', 'DAMAGECOUNT': '14.259', 'FRAGCOUNT': '44.000'} [2023-02-25 13:50:06,312][36156] DAMAGECOUNT value on done: 529843.0 [2023-02-25 13:50:06,312][36156] Sum rewards: 54.619, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.065', 'AMMO5': '0.007', 'AMMO2': '0.037', 'AMMO3': '0.130', 'WEAPON5': '0.150', 'weapon5': '0.172', 'AMMO4': '0.185', 'WEAPON4': '0.200', 'weapon4': '0.426', 'weapon2': '0.512', 'WEAPON3': '0.850', 'weapon3': '2.682', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.902', 'FRAGCOUNT': '44.000'} [2023-02-25 13:50:06,324][36156] DAMAGECOUNT value on done: 527881.0 [2023-02-25 13:50:06,325][36156] Sum rewards: 40.295, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.870', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.080', 'AMMO3': '0.169', 'AMMO4': '0.205', 'WEAPON5': '0.250', 'weapon4': '0.320', 'WEAPON4': '0.400', 'weapon2': '0.584', 'WEAPON3': '1.150', 'HITCOUNT': '2.550', 'weapon3': '2.808', 'DAMAGECOUNT': '11.097', 'FRAGCOUNT': '37.000'} [2023-02-25 13:50:06,620][36156] DAMAGECOUNT value on done: 520247.0 [2023-02-25 13:50:06,621][36156] Sum rewards: 56.501, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.354', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.058', 'AMMO4': '0.158', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.340', 'weapon2': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.918', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.531', 'FRAGCOUNT': '46.000'} [2023-02-25 13:50:06,631][36156] DAMAGECOUNT value on done: 515926.0 [2023-02-25 13:50:06,631][36156] Sum rewards: 55.366, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.470', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.058', 'AMMO3': '0.129', 'WEAPON5': '0.150', 'weapon5': '0.182', 'weapon2': '0.228', 'AMMO4': '0.291', 'WEAPON4': '0.350', 'WEAPON3': '0.850', 'weapon4': '0.858', 'weapon3': '2.472', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.858', 'FRAGCOUNT': '46.000'} [2023-02-25 13:50:08,006][36139] Large shaping reward 2.506 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.126, -42.0), ('weapon5', 0.002)] [2023-02-25 13:50:09,146][36138] Updated weights for policy 0, policy_version 44193 (0.0009) [2023-02-25 13:50:09,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 181018624. Throughput: 0: 3372.4. Samples: 7746310. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:50:09,730][36114] Avg episode reward: [(0, '54.952')] [2023-02-25 13:50:12,163][36138] Updated weights for policy 0, policy_version 44203 (0.0010) [2023-02-25 13:50:12,665][36155] DAMAGECOUNT value on done: 516703.0 [2023-02-25 13:50:12,665][36155] Sum rewards: 60.740, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.200', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO3': '0.171', 'weapon2': '0.496', 'WEAPON3': '1.200', 'weapon3': '3.380', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.549', 'FRAGCOUNT': '50.000'} [2023-02-25 13:50:12,988][36155] DAMAGECOUNT value on done: 531511.0 [2023-02-25 13:50:12,989][36155] Sum rewards: 58.008, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.544', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.044', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'AMMO4': '0.219', 'WEAPON4': '0.350', 'weapon2': '0.416', 'weapon4': '0.586', 'WEAPON3': '1.050', 'weapon3': '2.534', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '50.000'} [2023-02-25 13:50:13,442][36155] DAMAGECOUNT value on done: 529695.0 [2023-02-25 13:50:13,442][36155] Sum rewards: 68.891, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.741', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.104', 'AMMO4': '0.142', 'weapon2': '0.158', 'AMMO3': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.456', 'WEAPON3': '1.150', 'weapon3': '3.032', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '57.000'} [2023-02-25 13:50:13,651][36139] DAMAGECOUNT value on done: 530685.0 [2023-02-25 13:50:13,651][36139] Sum rewards: 54.539, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.500', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.122', 'AMMO3': '0.160', 'AMMO4': '0.183', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON4': '0.450', 'weapon4': '0.680', 'WEAPON3': '0.900', 'weapon3': '2.644', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.046', 'FRAGCOUNT': '45.000'} [2023-02-25 13:50:13,752][36155] DAMAGECOUNT value on done: 520421.0 [2023-02-25 13:50:13,753][36155] Sum rewards: 60.828, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.191', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.044', 'weapon7': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'AMMO4': '0.219', 'weapon2': '0.418', 'WEAPON4': '0.500', 'weapon4': '0.840', 'WEAPON3': '1.050', 'weapon3': '2.150', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.186', 'FRAGCOUNT': '53.000'} [2023-02-25 13:50:13,927][36139] DAMAGECOUNT value on done: 520675.0 [2023-02-25 13:50:13,927][36139] Sum rewards: 55.700, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.310', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.127', 'AMMO3': '0.148', 'weapon5': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.400', 'weapon4': '0.790', 'WEAPON3': '0.850', 'weapon3': '2.230', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.011', 'FRAGCOUNT': '46.000'} [2023-02-25 13:50:14,436][36139] DAMAGECOUNT value on done: 527080.0 [2023-02-25 13:50:14,436][36139] Sum rewards: 60.309, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.970', 'weapon7': '0.002', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.058', 'AMMO4': '0.083', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'weapon2': '0.304', 'WEAPON3': '1.250', 'HITCOUNT': '3.080', 'weapon3': '3.322', 'DAMAGECOUNT': '14.934', 'FRAGCOUNT': '51.000'} [2023-02-25 13:50:14,725][36139] DAMAGECOUNT value on done: 527663.0 [2023-02-25 13:50:14,726][36139] Sum rewards: 46.935, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.970', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.090', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'weapon2': '0.354', 'weapon4': '0.858', 'WEAPON3': '1.000', 'weapon3': '2.550', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '12.432', 'FRAGCOUNT': '39.000'} [2023-02-25 13:50:14,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13454.3). Total num frames: 181088256. Throughput: 0: 3369.4. Samples: 7766494. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:50:14,730][36114] Avg episode reward: [(0, '55.369')] [2023-02-25 13:50:14,730][36125] Saving new best policy, reward=55.369! [2023-02-25 13:50:15,190][36138] Updated weights for policy 0, policy_version 44213 (0.0009) [2023-02-25 13:50:18,184][36138] Updated weights for policy 0, policy_version 44223 (0.0009) [2023-02-25 13:50:19,729][36114] Fps is (10 sec: 13926.5, 60 sec: 13516.8, 300 sec: 13468.2). Total num frames: 181157888. Throughput: 0: 3372.8. Samples: 7786904. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:50:19,730][36114] Avg episode reward: [(0, '55.414')] [2023-02-25 13:50:19,734][36125] Saving new best policy, reward=55.414! [2023-02-25 13:50:20,946][36154] DAMAGECOUNT value on done: 528276.0 [2023-02-25 13:50:20,947][36154] Sum rewards: 51.982, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.312', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon5': '0.130', 'weapon4': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'WEAPON5': '0.250', 'weapon2': '0.460', 'WEAPON3': '1.150', 'HITCOUNT': '2.800', 'weapon3': '3.082', 'DAMAGECOUNT': '13.104', 'FRAGCOUNT': '44.000'} [2023-02-25 13:50:21,215][36138] Updated weights for policy 0, policy_version 44233 (0.0009) [2023-02-25 13:50:21,258][36154] DAMAGECOUNT value on done: 519406.0 [2023-02-25 13:50:21,259][36154] Sum rewards: 62.201, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.516', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.178', 'AMMO4': '0.213', 'AMMO3': '0.222', 'weapon2': '0.256', 'WEAPON5': '0.300', 'weapon4': '0.384', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.922', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '54.000'} [2023-02-25 13:50:21,531][36154] DAMAGECOUNT value on done: 524998.0 [2023-02-25 13:50:21,532][36154] Sum rewards: 58.631, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.552', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.100', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon2': '0.236', 'weapon4': '0.592', 'WEAPON3': '1.200', 'weapon3': '2.826', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.653', 'FRAGCOUNT': '50.000'} [2023-02-25 13:50:21,822][36141] DAMAGECOUNT value on done: 531065.0 [2023-02-25 13:50:21,823][36141] Sum rewards: 52.682, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.474', 'AMMO5': '0.015', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.204', 'AMMO3': '0.205', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.472', 'weapon4': '0.528', 'WEAPON3': '1.250', 'weapon3': '2.454', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '13.809', 'FRAGCOUNT': '46.000'} [2023-02-25 13:50:21,824][36154] DAMAGECOUNT value on done: 527304.0 [2023-02-25 13:50:21,825][36154] Sum rewards: 55.179, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.316', 'AMMO5': '0.016', 'AMMO2': '0.058', 'AMMO3': '0.221', 'AMMO4': '0.288', 'weapon2': '0.292', 'weapon5': '0.326', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.622', 'WEAPON3': '1.300', 'weapon3': '2.436', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '15.966', 'FRAGCOUNT': '51.000'} [2023-02-25 13:50:22,090][36141] DAMAGECOUNT value on done: 518392.0 [2023-02-25 13:50:22,090][36141] Sum rewards: 55.902, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.002', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon5': '0.120', 'AMMO3': '0.216', 'AMMO4': '0.223', 'weapon2': '0.320', 'WEAPON5': '0.350', 'weapon4': '0.482', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.750', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.409', 'FRAGCOUNT': '50.000'} [2023-02-25 13:50:22,129][36141] DAMAGECOUNT value on done: 531004.0 [2023-02-25 13:50:22,129][36141] Sum rewards: 34.906, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.282', 'AMMO5': '0.008', 'ARMOR': '0.016', 'AMMO2': '0.048', 'AMMO3': '0.122', 'weapon5': '0.146', 'weapon2': '0.212', 'AMMO4': '0.239', 'WEAPON5': '0.250', 'WEAPON3': '0.700', 'WEAPON4': '0.800', 'weapon4': '1.308', 'weapon3': '2.052', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '11.577', 'FRAGCOUNT': '30.500'} [2023-02-25 13:50:22,273][36155] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:50:22,406][36141] DAMAGECOUNT value on done: 518314.0 [2023-02-25 13:50:22,407][36141] Sum rewards: 67.649, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.520', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.044', 'weapon4': '0.098', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.284', 'weapon2': '0.336', 'WEAPON3': '1.600', 'weapon3': '3.186', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '61.000'} [2023-02-25 13:50:22,754][36157] DAMAGECOUNT value on done: 539479.0 [2023-02-25 13:50:22,754][36157] Sum rewards: 72.008, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.990', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.059', 'AMMO3': '0.163', 'weapon4': '0.204', 'weapon2': '0.540', 'WEAPON3': '1.050', 'weapon3': '3.004', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '57.000'} [2023-02-25 13:50:23,075][36157] DAMAGECOUNT value on done: 522722.0 [2023-02-25 13:50:23,075][36157] Sum rewards: 47.116, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.081', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon2': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon4': '0.372', 'WEAPON3': '1.100', 'HITCOUNT': '2.700', 'weapon3': '3.420', 'DAMAGECOUNT': '12.024', 'FRAGCOUNT': '40.000'} [2023-02-25 13:50:23,683][36157] DAMAGECOUNT value on done: 532372.0 [2023-02-25 13:50:23,684][36157] Sum rewards: 59.218, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.478', 'ARMOR': '0.012', 'AMMO5': '0.014', 'AMMO2': '0.050', 'AMMO3': '0.152', 'weapon2': '0.228', 'AMMO4': '0.250', 'weapon5': '0.298', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '0.850', 'weapon4': '1.004', 'weapon3': '2.166', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '49.000'} [2023-02-25 13:50:23,995][36157] DAMAGECOUNT value on done: 530395.0 [2023-02-25 13:50:23,995][36157] Sum rewards: 39.447, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.106', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.062', 'weapon5': '0.104', 'WEAPON5': '0.200', 'weapon2': '0.202', 'AMMO3': '0.241', 'AMMO4': '0.309', 'WEAPON4': '0.550', 'weapon4': '1.338', 'WEAPON3': '1.400', 'weapon3': '2.058', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.078', 'FRAGCOUNT': '37.000'} [2023-02-25 13:50:24,048][36140] DAMAGECOUNT value on done: 533745.0 [2023-02-25 13:50:24,049][36140] Sum rewards: 49.389, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.385', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.078', 'weapon7': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.130', 'AMMO4': '0.180', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.430', 'weapon4': '0.778', 'WEAPON3': '0.800', 'weapon3': '2.258', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '11.994', 'FRAGCOUNT': '41.500'} [2023-02-25 13:50:24,294][36138] Updated weights for policy 0, policy_version 44243 (0.0009) [2023-02-25 13:50:24,339][36140] DAMAGECOUNT value on done: 516149.0 [2023-02-25 13:50:24,339][36140] Sum rewards: 47.651, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.748', 'AMMO5': '0.010', 'AMMO2': '0.044', 'AMMO3': '0.179', 'AMMO4': '0.219', 'weapon5': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.526', 'weapon4': '0.894', 'WEAPON3': '1.000', 'weapon3': '2.046', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.461', 'FRAGCOUNT': '39.000'} [2023-02-25 13:50:24,628][36140] DAMAGECOUNT value on done: 523687.0 [2023-02-25 13:50:24,628][36140] Sum rewards: 54.080, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.060', 'ARMOR': '0.012', 'AMMO5': '0.020', 'AMMO2': '0.058', 'AMMO3': '0.142', 'weapon5': '0.278', 'AMMO4': '0.290', 'weapon2': '0.446', 'WEAPON5': '0.550', 'WEAPON4': '0.550', 'weapon4': '0.828', 'WEAPON3': '0.900', 'weapon3': '2.066', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.970', 'FRAGCOUNT': '44.500'} [2023-02-25 13:50:24,729][36114] Fps is (10 sec: 13517.0, 60 sec: 13516.8, 300 sec: 13454.3). Total num frames: 181223424. Throughput: 0: 3372.2. Samples: 7796994. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:50:24,730][36114] Avg episode reward: [(0, '55.267')] [2023-02-25 13:50:24,924][36140] DAMAGECOUNT value on done: 523424.0 [2023-02-25 13:50:24,924][36140] Sum rewards: 59.213, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.277', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.162', 'AMMO4': '0.243', 'weapon2': '0.244', 'AMMO3': '0.270', 'weapon5': '0.284', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '2.930', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.735', 'FRAGCOUNT': '55.000'} [2023-02-25 13:50:25,652][36142] DAMAGECOUNT value on done: 529413.0 [2023-02-25 13:50:25,652][36142] Sum rewards: 52.918, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.624', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'weapon2': '0.146', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'weapon4': '0.378', 'WEAPON3': '1.500', 'weapon3': '3.184', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.282', 'FRAGCOUNT': '46.000'} [2023-02-25 13:50:25,866][36142] DAMAGECOUNT value on done: 517017.0 [2023-02-25 13:50:25,866][36142] Sum rewards: 58.517, reward structure: {'DEATHCOUNT': '-12.750', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'weapon4': '0.118', 'AMMO3': '0.191', 'weapon2': '0.298', 'WEAPON3': '1.050', 'HEALTH': '1.108', 'HITCOUNT': '3.050', 'weapon3': '3.444', 'DAMAGECOUNT': '13.920', 'FRAGCOUNT': '48.000'} [2023-02-25 13:50:25,972][36142] DAMAGECOUNT value on done: 518901.0 [2023-02-25 13:50:25,972][36142] Sum rewards: 53.905, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO3': '0.139', 'AMMO4': '0.153', 'weapon5': '0.182', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.478', 'HEALTH': '0.479', 'weapon4': '0.596', 'WEAPON3': '0.750', 'weapon3': '2.506', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.671', 'FRAGCOUNT': '45.000'} [2023-02-25 13:50:26,175][36142] DAMAGECOUNT value on done: 531321.0 [2023-02-25 13:50:26,175][36142] Sum rewards: 45.641, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.445', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.127', 'weapon5': '0.164', 'AMMO4': '0.173', 'WEAPON5': '0.350', 'weapon2': '0.496', 'WEAPON4': '0.550', 'weapon4': '0.588', 'WEAPON3': '0.750', 'weapon3': '2.396', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '13.323', 'FRAGCOUNT': '39.000'} [2023-02-25 13:50:26,255][36156] DAMAGECOUNT value on done: 533669.0 [2023-02-25 13:50:26,255][36156] Sum rewards: 38.101, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.185', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO3': '0.154', 'AMMO4': '0.157', 'weapon5': '0.202', 'weapon2': '0.268', 'weapon4': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.950', 'HITCOUNT': '2.340', 'weapon3': '2.986', 'DAMAGECOUNT': '11.082', 'FRAGCOUNT': '33.000'} [2023-02-25 13:50:26,266][36156] DAMAGECOUNT value on done: 532733.0 [2023-02-25 13:50:26,267][36156] Sum rewards: 61.993, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.992', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon7': '0.066', 'weapon5': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.200', 'AMMO3': '0.208', 'weapon2': '0.288', 'WEAPON3': '1.300', 'weapon3': '3.072', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.511', 'FRAGCOUNT': '52.000'} [2023-02-25 13:50:26,592][36156] DAMAGECOUNT value on done: 524199.0 [2023-02-25 13:50:26,592][36156] Sum rewards: 46.853, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.835', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.012', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'weapon7': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.148', 'WEAPON7': '0.200', 'weapon2': '0.246', 'WEAPON4': '0.250', 'weapon4': '0.684', 'WEAPON3': '0.850', 'HITCOUNT': '2.570', 'weapon3': '2.644', 'DAMAGECOUNT': '11.856', 'FRAGCOUNT': '39.000'} [2023-02-25 13:50:26,603][36156] DAMAGECOUNT value on done: 521198.0 [2023-02-25 13:50:26,604][36156] Sum rewards: 64.930, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.794', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.162', 'AMMO3': '0.183', 'AMMO4': '0.193', 'weapon4': '0.228', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.128', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.816', 'FRAGCOUNT': '53.500'} [2023-02-25 13:50:27,323][36138] Updated weights for policy 0, policy_version 44253 (0.0009) [2023-02-25 13:50:29,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 181288960. Throughput: 0: 3369.9. Samples: 7817174. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:50:29,730][36114] Avg episode reward: [(0, '55.196')] [2023-02-25 13:50:30,362][36138] Updated weights for policy 0, policy_version 44263 (0.0010) [2023-02-25 13:50:32,627][36155] DAMAGECOUNT value on done: 521267.0 [2023-02-25 13:50:32,628][36155] Sum rewards: 54.953, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.180', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.074', 'AMMO4': '0.096', 'weapon4': '0.132', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon2': '0.250', 'WEAPON3': '1.150', 'HITCOUNT': '2.950', 'weapon3': '3.334', 'DAMAGECOUNT': '13.662', 'FRAGCOUNT': '48.000'} [2023-02-25 13:50:32,944][36155] DAMAGECOUNT value on done: 536790.0 [2023-02-25 13:50:32,944][36155] Sum rewards: 63.577, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.334', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.026', 'AMMO4': '0.073', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.182', 'AMMO3': '0.245', 'WEAPON3': '1.450', 'HITCOUNT': '3.290', 'weapon3': '3.514', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '55.000'} [2023-02-25 13:50:33,423][36139] DAMAGECOUNT value on done: 535287.0 [2023-02-25 13:50:33,424][36139] Sum rewards: 55.598, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.020', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.016', 'weapon4': '0.022', 'weapon5': '0.044', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.230', 'weapon2': '0.258', 'WEAPON3': '1.300', 'HITCOUNT': '2.660', 'weapon3': '3.494', 'DAMAGECOUNT': '13.806', 'FRAGCOUNT': '48.000'} [2023-02-25 13:50:33,425][36138] Updated weights for policy 0, policy_version 44273 (0.0009) [2023-02-25 13:50:33,444][36155] DAMAGECOUNT value on done: 533748.0 [2023-02-25 13:50:33,445][36155] Sum rewards: 39.053, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.483', 'ARMOR': '0.008', 'AMMO5': '0.023', 'AMMO2': '0.070', 'AMMO3': '0.193', 'weapon2': '0.214', 'AMMO4': '0.351', 'weapon5': '0.380', 'weapon4': '0.470', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.150', 'HITCOUNT': '2.360', 'weapon3': '2.608', 'DAMAGECOUNT': '12.159', 'FRAGCOUNT': '37.000'} [2023-02-25 13:50:33,718][36139] DAMAGECOUNT value on done: 524776.0 [2023-02-25 13:50:33,718][36139] Sum rewards: 42.327, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.315', 'AMMO5': '0.021', 'ARMOR': '0.032', 'AMMO2': '0.076', 'weapon7': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.121', 'WEAPON7': '0.200', 'weapon5': '0.276', 'weapon2': '0.344', 'AMMO4': '0.379', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'WEAPON4': '0.800', 'weapon4': '1.080', 'weapon3': '1.816', 'HITCOUNT': '2.110', 'DAMAGECOUNT': '12.303', 'FRAGCOUNT': '35.500'} [2023-02-25 13:50:33,743][36155] DAMAGECOUNT value on done: 525663.0 [2023-02-25 13:50:33,744][36155] Sum rewards: 59.010, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.466', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.036', 'weapon5': '0.066', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO4': '0.178', 'weapon2': '0.282', 'AMMO3': '0.291', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '3.210', 'weapon3': '3.268', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '55.000'} [2023-02-25 13:50:34,202][36139] DAMAGECOUNT value on done: 532212.0 [2023-02-25 13:50:34,202][36139] Sum rewards: 60.270, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.545', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.038', 'AMMO3': '0.128', 'AMMO4': '0.192', 'weapon4': '0.306', 'weapon5': '0.316', 'WEAPON4': '0.350', 'weapon2': '0.494', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'weapon3': '2.664', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '49.000'} [2023-02-25 13:50:34,505][36139] DAMAGECOUNT value on done: 532197.0 [2023-02-25 13:50:34,505][36139] Sum rewards: 56.315, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.211', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon5': '0.054', 'AMMO4': '0.056', 'weapon4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.247', 'weapon2': '0.296', 'WEAPON3': '1.500', 'HITCOUNT': '3.030', 'weapon3': '3.374', 'DAMAGECOUNT': '13.602', 'FRAGCOUNT': '51.000'} [2023-02-25 13:50:34,729][36114] Fps is (10 sec: 13516.6, 60 sec: 13516.8, 300 sec: 13468.2). Total num frames: 181358592. Throughput: 0: 3370.5. Samples: 7837356. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:50:34,730][36114] Avg episode reward: [(0, '55.232')] [2023-02-25 13:50:36,456][36138] Updated weights for policy 0, policy_version 44283 (0.0009) [2023-02-25 13:50:39,505][36138] Updated weights for policy 0, policy_version 44293 (0.0009) [2023-02-25 13:50:39,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13468.2). Total num frames: 181424128. Throughput: 0: 3370.6. Samples: 7847468. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:50:39,730][36114] Avg episode reward: [(0, '55.232')] [2023-02-25 13:50:40,957][36154] DAMAGECOUNT value on done: 532890.0 [2023-02-25 13:50:40,958][36154] Sum rewards: 58.688, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.839', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.153', 'weapon5': '0.190', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON4': '0.300', 'weapon4': '0.746', 'WEAPON3': '1.050', 'weapon3': '2.578', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '13.842', 'FRAGCOUNT': '50.000'} [2023-02-25 13:50:41,271][36154] DAMAGECOUNT value on done: 522881.0 [2023-02-25 13:50:41,271][36154] Sum rewards: 40.119, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.232', 'AMMO5': '0.009', 'ARMOR': '0.016', 'AMMO2': '0.040', 'weapon5': '0.114', 'AMMO3': '0.181', 'AMMO4': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.388', 'weapon2': '0.710', 'WEAPON3': '1.050', 'weapon3': '2.418', 'HITCOUNT': '2.450', 'DAMAGECOUNT': '10.425', 'FRAGCOUNT': '37.000'} [2023-02-25 13:50:41,544][36154] DAMAGECOUNT value on done: 529953.0 [2023-02-25 13:50:41,545][36154] Sum rewards: 57.173, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.586', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'AMMO3': '0.227', 'weapon2': '0.268', 'WEAPON4': '0.300', 'weapon4': '0.934', 'WEAPON3': '1.300', 'weapon3': '2.560', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '50.000'} [2023-02-25 13:50:41,704][36141] DAMAGECOUNT value on done: 536754.0 [2023-02-25 13:50:41,705][36141] Sum rewards: 69.211, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.138', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.144', 'weapon5': '0.170', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.370', 'weapon4': '0.388', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'weapon3': '2.834', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.067', 'FRAGCOUNT': '56.000'} [2023-02-25 13:50:41,863][36154] DAMAGECOUNT value on done: 532078.0 [2023-02-25 13:50:41,863][36154] Sum rewards: 53.874, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.822', 'ARMOR': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon7': '0.100', 'weapon5': '0.102', 'AMMO3': '0.118', 'AMMO4': '0.155', 'WEAPON4': '0.300', 'weapon2': '0.478', 'weapon4': '0.822', 'WEAPON3': '0.850', 'weapon3': '2.238', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.322', 'FRAGCOUNT': '44.000'} [2023-02-25 13:50:41,990][36141] DAMAGECOUNT value on done: 523930.0 [2023-02-25 13:50:41,991][36141] Sum rewards: 66.944, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.982', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.078', 'AMMO4': '0.100', 'weapon5': '0.108', 'weapon2': '0.138', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'WEAPON3': '1.400', 'HITCOUNT': '3.350', 'weapon3': '3.476', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '58.000'} [2023-02-25 13:50:42,017][36141] DAMAGECOUNT value on done: 534955.0 [2023-02-25 13:50:42,018][36141] Sum rewards: 40.647, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.350', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon5': '0.148', 'AMMO3': '0.191', 'weapon2': '0.204', 'AMMO4': '0.250', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.630', 'WEAPON3': '1.150', 'weapon3': '2.630', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '11.853', 'FRAGCOUNT': '37.000'} [2023-02-25 13:50:42,291][36141] DAMAGECOUNT value on done: 522836.0 [2023-02-25 13:50:42,291][36141] Sum rewards: 49.724, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.160', 'AMMO5': '0.004', 'ARMOR': '0.004', 'weapon5': '0.030', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'weapon2': '0.196', 'AMMO4': '0.196', 'AMMO3': '0.197', 'WEAPON4': '0.300', 'weapon4': '0.692', 'WEAPON3': '1.150', 'weapon3': '2.690', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.566', 'FRAGCOUNT': '43.000'} [2023-02-25 13:50:42,550][36138] Updated weights for policy 0, policy_version 44303 (0.0009) [2023-02-25 13:50:42,685][36157] DAMAGECOUNT value on done: 544036.0 [2023-02-25 13:50:42,686][36157] Sum rewards: 51.121, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.975', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon5': '0.120', 'AMMO4': '0.216', 'AMMO3': '0.217', 'weapon4': '0.244', 'weapon2': '0.318', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.890', 'weapon3': '3.002', 'DAMAGECOUNT': '13.671', 'FRAGCOUNT': '47.000'} [2023-02-25 13:50:43,003][36157] DAMAGECOUNT value on done: 527840.0 [2023-02-25 13:50:43,003][36157] Sum rewards: 57.870, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.370', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'weapon2': '0.256', 'weapon4': '0.404', 'WEAPON3': '1.300', 'weapon3': '3.118', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.354', 'FRAGCOUNT': '50.000'} [2023-02-25 13:50:43,604][36157] DAMAGECOUNT value on done: 537814.0 [2023-02-25 13:50:43,605][36157] Sum rewards: 57.842, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.785', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.046', 'weapon4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.261', 'weapon2': '0.270', 'WEAPON3': '1.650', 'weapon3': '3.318', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '50.000'} [2023-02-25 13:50:43,907][36157] DAMAGECOUNT value on done: 534616.0 [2023-02-25 13:50:43,908][36157] Sum rewards: 46.938, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.648', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.098', 'AMMO4': '0.167', 'weapon4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.800', 'weapon3': '3.124', 'DAMAGECOUNT': '12.663', 'FRAGCOUNT': '44.000'} [2023-02-25 13:50:43,984][36140] DAMAGECOUNT value on done: 538816.0 [2023-02-25 13:50:43,985][36140] Sum rewards: 60.982, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.406', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.066', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'weapon4': '0.242', 'weapon2': '0.494', 'WEAPON3': '1.400', 'weapon3': '2.994', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.213', 'FRAGCOUNT': '54.000'} [2023-02-25 13:50:44,300][36140] DAMAGECOUNT value on done: 520952.0 [2023-02-25 13:50:44,300][36140] Sum rewards: 55.075, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.114', 'AMMO5': '0.009', 'AMMO2': '0.044', 'AMMO3': '0.167', 'AMMO4': '0.218', 'weapon5': '0.248', 'weapon2': '0.254', 'WEAPON5': '0.300', 'ARMOR': '0.454', 'WEAPON4': '0.600', 'weapon4': '0.664', 'WEAPON3': '1.050', 'weapon3': '2.552', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.409', 'FRAGCOUNT': '48.500'} [2023-02-25 13:50:44,604][36140] DAMAGECOUNT value on done: 528966.0 [2023-02-25 13:50:44,604][36140] Sum rewards: 55.373, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.506', 'AMMO5': '0.012', 'AMMO2': '0.048', 'AMMO3': '0.179', 'weapon2': '0.218', 'weapon5': '0.220', 'AMMO4': '0.242', 'WEAPON5': '0.350', 'ARMOR': '0.456', 'weapon4': '0.462', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.814', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '48.000'} [2023-02-25 13:50:44,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13468.2). Total num frames: 181493760. Throughput: 0: 3369.0. Samples: 7867606. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:50:44,730][36114] Avg episode reward: [(0, '55.805')] [2023-02-25 13:50:44,730][36125] Saving new best policy, reward=55.805! [2023-02-25 13:50:44,928][36140] DAMAGECOUNT value on done: 528571.0 [2023-02-25 13:50:44,928][36140] Sum rewards: 52.726, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.654', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.126', 'weapon2': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.266', 'weapon4': '0.430', 'WEAPON3': '1.600', 'weapon3': '2.982', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.441', 'FRAGCOUNT': '48.000'} [2023-02-25 13:50:45,589][36138] Updated weights for policy 0, policy_version 44313 (0.0010) [2023-02-25 13:50:45,731][36142] DAMAGECOUNT value on done: 535047.0 [2023-02-25 13:50:45,731][36142] Sum rewards: 62.155, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.512', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.044', 'weapon4': '0.118', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.458', 'WEAPON3': '1.450', 'weapon3': '3.118', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.902', 'FRAGCOUNT': '56.000'} [2023-02-25 13:50:45,916][36142] DAMAGECOUNT value on done: 522021.0 [2023-02-25 13:50:45,917][36142] Sum rewards: 59.152, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.695', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon4': '0.228', 'weapon2': '0.534', 'WEAPON3': '1.150', 'weapon3': '2.954', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.012', 'FRAGCOUNT': '50.000'} [2023-02-25 13:50:46,048][36142] DAMAGECOUNT value on done: 524222.0 [2023-02-25 13:50:46,049][36142] Sum rewards: 58.899, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.605', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.086', 'AMMO4': '0.178', 'AMMO3': '0.188', 'WEAPON5': '0.250', 'weapon2': '0.256', 'WEAPON4': '0.450', 'weapon4': '0.538', 'WEAPON3': '1.200', 'weapon3': '2.810', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.963', 'FRAGCOUNT': '52.000'} [2023-02-25 13:50:46,230][36156] DAMAGECOUNT value on done: 537815.0 [2023-02-25 13:50:46,230][36156] Sum rewards: 57.008, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.117', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.043', 'weapon5': '0.164', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'AMMO4': '0.216', 'weapon4': '0.380', 'WEAPON4': '0.450', 'weapon2': '0.520', 'WEAPON3': '1.100', 'weapon3': '2.664', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.246', 'FRAGCOUNT': '48.000'} [2023-02-25 13:50:46,237][36142] DAMAGECOUNT value on done: 535894.0 [2023-02-25 13:50:46,238][36142] Sum rewards: 52.175, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.850', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon5': '0.080', 'AMMO4': '0.196', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.436', 'weapon4': '0.436', 'WEAPON3': '1.250', 'HITCOUNT': '2.730', 'weapon3': '2.754', 'DAMAGECOUNT': '13.719', 'FRAGCOUNT': '46.000'} [2023-02-25 13:50:46,242][36156] DAMAGECOUNT value on done: 539037.0 [2023-02-25 13:50:46,242][36156] Sum rewards: 57.378, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.316', 'ARMOR': '0.012', 'AMMO5': '0.022', 'AMMO2': '0.039', 'AMMO3': '0.171', 'AMMO4': '0.196', 'weapon5': '0.256', 'weapon2': '0.294', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'weapon4': '0.780', 'WEAPON3': '1.100', 'weapon3': '2.400', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '50.000'} [2023-02-25 13:50:46,539][36156] DAMAGECOUNT value on done: 525622.0 [2023-02-25 13:50:46,539][36156] Sum rewards: 52.870, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.153', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.075', 'AMMO3': '0.141', 'weapon2': '0.262', 'AMMO4': '0.375', 'weapon5': '0.382', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '0.850', 'weapon4': '0.980', 'weapon3': '2.028', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '13.272', 'FRAGCOUNT': '46.000'} [2023-02-25 13:50:46,549][36156] DAMAGECOUNT value on done: 530005.0 [2023-02-25 13:50:46,550][36156] Sum rewards: 65.824, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.080', 'AMMO5': '0.013', 'AMMO2': '0.018', 'weapon5': '0.040', 'AMMO4': '0.089', 'weapon2': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon4': '0.324', 'WEAPON3': '1.450', 'weapon3': '3.236', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '57.000'} [2023-02-25 13:50:48,637][36138] Updated weights for policy 0, policy_version 44323 (0.0010) [2023-02-25 13:50:49,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13468.2). Total num frames: 181559296. Throughput: 0: 3368.9. Samples: 7887848. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:50:49,729][36114] Avg episode reward: [(0, '55.801')] [2023-02-25 13:50:51,682][36138] Updated weights for policy 0, policy_version 44333 (0.0009) [2023-02-25 13:50:52,609][36155] DAMAGECOUNT value on done: 525499.0 [2023-02-25 13:50:52,609][36155] Sum rewards: 47.969, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.215', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'weapon2': '0.168', 'AMMO3': '0.193', 'weapon4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.770', 'weapon3': '3.228', 'DAMAGECOUNT': '12.381', 'FRAGCOUNT': '42.000'} [2023-02-25 13:50:52,914][36155] DAMAGECOUNT value on done: 542580.0 [2023-02-25 13:50:52,915][36155] Sum rewards: 70.001, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.485', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.094', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'weapon2': '0.230', 'weapon4': '0.286', 'WEAPON3': '1.050', 'weapon3': '3.242', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '57.000'} [2023-02-25 13:50:53,372][36155] DAMAGECOUNT value on done: 538384.0 [2023-02-25 13:50:53,373][36155] Sum rewards: 52.964, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.742', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.122', 'AMMO4': '0.181', 'weapon4': '0.208', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.250', 'HITCOUNT': '2.950', 'weapon3': '3.020', 'DAMAGECOUNT': '13.908', 'FRAGCOUNT': '47.500'} [2023-02-25 13:50:53,390][36139] DAMAGECOUNT value on done: 540094.0 [2023-02-25 13:50:53,390][36139] Sum rewards: 54.501, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.872', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.048', 'AMMO3': '0.162', 'AMMO4': '0.240', 'weapon5': '0.270', 'WEAPON5': '0.400', 'weapon2': '0.410', 'WEAPON4': '0.450', 'weapon4': '0.566', 'WEAPON3': '0.950', 'weapon3': '2.408', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '14.421', 'FRAGCOUNT': '46.000'} [2023-02-25 13:50:53,677][36155] DAMAGECOUNT value on done: 531444.0 [2023-02-25 13:50:53,677][36155] Sum rewards: 64.138, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.996', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.098', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.212', 'weapon4': '0.234', 'weapon2': '0.370', 'WEAPON3': '1.250', 'weapon3': '3.086', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '53.000'} [2023-02-25 13:50:53,696][36139] DAMAGECOUNT value on done: 529525.0 [2023-02-25 13:50:53,696][36139] Sum rewards: 53.123, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.130', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon5': '0.132', 'weapon4': '0.168', 'AMMO3': '0.226', 'AMMO4': '0.233', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.800', 'weapon3': '3.096', 'DAMAGECOUNT': '14.247', 'FRAGCOUNT': '46.000'} [2023-02-25 13:50:54,100][36139] DAMAGECOUNT value on done: 538431.0 [2023-02-25 13:50:54,101][36139] Sum rewards: 68.112, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.469', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO4': '0.208', 'weapon2': '0.254', 'AMMO3': '0.261', 'WEAPON4': '0.350', 'weapon4': '0.366', 'WEAPON3': '1.600', 'weapon3': '2.970', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '60.000'} [2023-02-25 13:50:54,411][36139] DAMAGECOUNT value on done: 536550.0 [2023-02-25 13:50:54,411][36139] Sum rewards: 52.404, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.180', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon5': '0.068', 'AMMO4': '0.078', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon4': '0.318', 'weapon2': '0.612', 'WEAPON3': '1.200', 'weapon3': '2.840', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.059', 'FRAGCOUNT': '47.000'} [2023-02-25 13:50:54,710][36138] Updated weights for policy 0, policy_version 44343 (0.0009) [2023-02-25 13:50:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13468.2). Total num frames: 181628928. Throughput: 0: 3369.7. Samples: 7897948. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:50:54,730][36114] Avg episode reward: [(0, '56.215')] [2023-02-25 13:50:54,730][36125] Saving new best policy, reward=56.215! [2023-02-25 13:50:57,795][36138] Updated weights for policy 0, policy_version 44353 (0.0009) [2023-02-25 13:50:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13468.2). Total num frames: 181694464. Throughput: 0: 3369.0. Samples: 7918098. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:50:59,729][36114] Avg episode reward: [(0, '56.215')] [2023-02-25 13:51:00,850][36138] Updated weights for policy 0, policy_version 44363 (0.0009) [2023-02-25 13:51:01,041][36155] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:51:01,077][36154] DAMAGECOUNT value on done: 538442.0 [2023-02-25 13:51:01,078][36154] Sum rewards: 60.026, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.768', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.057', 'AMMO3': '0.154', 'weapon4': '0.246', 'AMMO4': '0.285', 'weapon5': '0.294', 'weapon2': '0.622', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '0.950', 'weapon3': '2.512', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '51.000'} [2023-02-25 13:51:01,398][36154] DAMAGECOUNT value on done: 527185.0 [2023-02-25 13:51:01,399][36154] Sum rewards: 48.990, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.573', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.077', 'WEAPON5': '0.150', 'weapon5': '0.240', 'WEAPON4': '0.250', 'AMMO3': '0.253', 'weapon2': '0.280', 'weapon4': '0.438', 'WEAPON3': '1.450', 'weapon3': '2.660', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.912', 'FRAGCOUNT': '47.000'} [2023-02-25 13:51:01,616][36141] DAMAGECOUNT value on done: 542485.0 [2023-02-25 13:51:01,616][36141] Sum rewards: 68.049, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.176', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'AMMO4': '0.188', 'weapon2': '0.272', 'WEAPON4': '0.350', 'ARMOR': '0.404', 'weapon4': '0.422', 'WEAPON3': '1.150', 'weapon3': '2.918', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.193', 'FRAGCOUNT': '57.000'} [2023-02-25 13:51:01,681][36154] DAMAGECOUNT value on done: 534621.0 [2023-02-25 13:51:01,681][36154] Sum rewards: 53.900, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.236', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.038', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.187', 'AMMO3': '0.218', 'weapon2': '0.270', 'WEAPON4': '0.400', 'weapon4': '0.612', 'WEAPON3': '1.200', 'weapon3': '2.848', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.719', 'FRAGCOUNT': '49.000'} [2023-02-25 13:51:01,892][36141] DAMAGECOUNT value on done: 529045.0 [2023-02-25 13:51:01,893][36141] Sum rewards: 55.585, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.440', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.117', 'weapon4': '0.124', 'weapon5': '0.124', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.436', 'WEAPON3': '1.450', 'weapon3': '3.070', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.309', 'FRAGCOUNT': '50.000'} [2023-02-25 13:51:01,942][36141] DAMAGECOUNT value on done: 539563.0 [2023-02-25 13:51:01,943][36141] Sum rewards: 57.462, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.930', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'WEAPON4': '0.100', 'AMMO3': '0.174', 'weapon4': '0.260', 'ARMOR': '0.458', 'weapon2': '0.574', 'WEAPON3': '1.100', 'weapon3': '3.004', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.824', 'FRAGCOUNT': '48.000'} [2023-02-25 13:51:02,000][36154] DAMAGECOUNT value on done: 536682.0 [2023-02-25 13:51:02,000][36154] Sum rewards: 50.844, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.458', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.122', 'AMMO4': '0.230', 'WEAPON5': '0.250', 'AMMO3': '0.261', 'weapon2': '0.366', 'WEAPON4': '0.450', 'weapon4': '0.700', 'WEAPON3': '1.500', 'weapon3': '2.544', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.812', 'FRAGCOUNT': '50.000'} [2023-02-25 13:51:02,209][36141] DAMAGECOUNT value on done: 527839.0 [2023-02-25 13:51:02,209][36141] Sum rewards: 55.682, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.959', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.073', 'WEAPON5': '0.150', 'weapon4': '0.164', 'weapon5': '0.184', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon2': '0.536', 'WEAPON3': '1.100', 'HITCOUNT': '2.860', 'weapon3': '2.892', 'DAMAGECOUNT': '15.009', 'FRAGCOUNT': '47.500'} [2023-02-25 13:51:02,640][36157] DAMAGECOUNT value on done: 548389.0 [2023-02-25 13:51:02,641][36157] Sum rewards: 43.325, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.578', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.044', 'weapon5': '0.150', 'weapon2': '0.202', 'AMMO4': '0.222', 'AMMO3': '0.248', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '2.560', 'weapon3': '2.928', 'DAMAGECOUNT': '12.774', 'FRAGCOUNT': '42.000'} [2023-02-25 13:51:02,976][36157] DAMAGECOUNT value on done: 532851.0 [2023-02-25 13:51:02,977][36157] Sum rewards: 63.171, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.667', 'AMMO2': '0.008', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'weapon4': '0.110', 'AMMO3': '0.249', 'weapon2': '0.490', 'WEAPON3': '1.500', 'weapon3': '3.246', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.033', 'FRAGCOUNT': '56.000'} [2023-02-25 13:51:03,579][36157] DAMAGECOUNT value on done: 542484.0 [2023-02-25 13:51:03,579][36157] Sum rewards: 50.143, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.187', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.048', 'AMMO3': '0.174', 'weapon2': '0.220', 'AMMO4': '0.242', 'weapon5': '0.396', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon4': '0.658', 'WEAPON3': '1.100', 'weapon3': '2.424', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.010', 'FRAGCOUNT': '43.500'} [2023-02-25 13:51:03,918][36138] Updated weights for policy 0, policy_version 44373 (0.0010) [2023-02-25 13:51:03,918][36157] DAMAGECOUNT value on done: 539104.0 [2023-02-25 13:51:03,919][36157] Sum rewards: 49.444, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.691', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon2': '0.140', 'weapon5': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon4': '0.472', 'WEAPON3': '1.250', 'HITCOUNT': '2.800', 'weapon3': '3.014', 'DAMAGECOUNT': '13.464', 'FRAGCOUNT': '42.500'} [2023-02-25 13:51:04,050][36140] DAMAGECOUNT value on done: 543127.0 [2023-02-25 13:51:04,050][36140] Sum rewards: 49.137, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.168', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.028', 'weapon5': '0.138', 'AMMO4': '0.140', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'weapon2': '0.278', 'WEAPON4': '0.350', 'weapon4': '0.584', 'WEAPON3': '0.950', 'weapon3': '2.740', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.933', 'FRAGCOUNT': '43.000'} [2023-02-25 13:51:04,360][36140] DAMAGECOUNT value on done: 525877.0 [2023-02-25 13:51:04,360][36140] Sum rewards: 57.953, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.440', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon5': '0.158', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'AMMO4': '0.222', 'weapon2': '0.292', 'WEAPON4': '0.300', 'weapon4': '0.556', 'WEAPON3': '1.050', 'weapon3': '2.740', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '49.000'} [2023-02-25 13:51:04,670][36140] DAMAGECOUNT value on done: 533467.0 [2023-02-25 13:51:04,671][36140] Sum rewards: 53.575, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.730', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.126', 'AMMO4': '0.139', 'AMMO3': '0.173', 'weapon2': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.308', 'WEAPON3': '1.150', 'HITCOUNT': '2.790', 'weapon3': '3.098', 'DAMAGECOUNT': '13.503', 'FRAGCOUNT': '47.000'} [2023-02-25 13:51:04,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 181760000. Throughput: 0: 3358.0. Samples: 7938016. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:51:04,730][36114] Avg episode reward: [(0, '55.484')] [2023-02-25 13:51:04,980][36140] DAMAGECOUNT value on done: 532800.0 [2023-02-25 13:51:04,981][36140] Sum rewards: 48.805, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.515', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.053', 'weapon5': '0.106', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.248', 'AMMO4': '0.265', 'WEAPON4': '0.700', 'WEAPON3': '1.150', 'weapon4': '1.590', 'weapon3': '1.616', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '12.687', 'FRAGCOUNT': '46.000'} [2023-02-25 13:51:05,270][36155] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:51:05,725][36142] DAMAGECOUNT value on done: 540817.0 [2023-02-25 13:51:05,725][36142] Sum rewards: 62.671, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.592', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.060', 'AMMO3': '0.203', 'weapon5': '0.228', 'AMMO4': '0.299', 'weapon2': '0.310', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.518', 'WEAPON3': '1.150', 'weapon3': '2.652', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '53.000'} [2023-02-25 13:51:05,907][36142] DAMAGECOUNT value on done: 526847.0 [2023-02-25 13:51:05,907][36142] Sum rewards: 57.383, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.066', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.167', 'weapon5': '0.218', 'weapon2': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.814', 'WEAPON3': '1.050', 'weapon3': '2.218', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.478', 'FRAGCOUNT': '49.000'} [2023-02-25 13:51:06,043][36142] DAMAGECOUNT value on done: 528528.0 [2023-02-25 13:51:06,044][36142] Sum rewards: 53.083, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.647', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.110', 'AMMO3': '0.149', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.516', 'weapon2': '0.638', 'WEAPON3': '0.950', 'weapon3': '2.440', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '12.918', 'FRAGCOUNT': '44.000'} [2023-02-25 13:51:06,226][36142] DAMAGECOUNT value on done: 540408.0 [2023-02-25 13:51:06,227][36142] Sum rewards: 51.771, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.839', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.051', 'AMMO3': '0.173', 'weapon5': '0.206', 'AMMO4': '0.256', 'weapon2': '0.354', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.688', 'WEAPON3': '1.100', 'weapon3': '2.480', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.497', 'FRAGCOUNT': '45.500'} [2023-02-25 13:51:06,370][36156] DAMAGECOUNT value on done: 542285.0 [2023-02-25 13:51:06,371][36156] Sum rewards: 51.144, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.695', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.082', 'weapon4': '0.114', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon2': '0.706', 'WEAPON3': '1.300', 'HITCOUNT': '2.850', 'weapon3': '2.924', 'DAMAGECOUNT': '13.410', 'FRAGCOUNT': '46.000'} [2023-02-25 13:51:06,382][36156] DAMAGECOUNT value on done: 544224.0 [2023-02-25 13:51:06,382][36156] Sum rewards: 59.055, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.620', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.180', 'AMMO3': '0.213', 'weapon2': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.436', 'WEAPON3': '1.300', 'weapon3': '2.832', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.561', 'FRAGCOUNT': '51.000'} [2023-02-25 13:51:06,690][36156] DAMAGECOUNT value on done: 530806.0 [2023-02-25 13:51:06,691][36156] Sum rewards: 61.829, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.082', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'weapon5': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'weapon2': '0.320', 'weapon4': '0.474', 'WEAPON3': '1.300', 'weapon3': '2.794', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.552', 'FRAGCOUNT': '54.000'} [2023-02-25 13:51:06,701][36156] DAMAGECOUNT value on done: 534798.0 [2023-02-25 13:51:06,701][36156] Sum rewards: 47.710, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.424', 'AMMO5': '0.011', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon5': '0.194', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'ARMOR': '0.458', 'weapon4': '0.466', 'weapon2': '0.472', 'WEAPON3': '1.350', 'weapon3': '2.558', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.899', 'FRAGCOUNT': '44.000'} [2023-02-25 13:51:06,999][36138] Updated weights for policy 0, policy_version 44383 (0.0009) [2023-02-25 13:51:07,282][36141] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:51:07,641][36154] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:51:09,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 181825536. Throughput: 0: 3354.4. Samples: 7947940. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:51:09,729][36114] Avg episode reward: [(0, '55.077')] [2023-02-25 13:51:10,256][36138] Updated weights for policy 0, policy_version 44393 (0.0010) [2023-02-25 13:51:12,977][36155] DAMAGECOUNT value on done: 529504.0 [2023-02-25 13:51:12,978][36155] Sum rewards: 42.068, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.235', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO3': '0.155', 'AMMO4': '0.164', 'weapon5': '0.302', 'weapon4': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.558', 'WEAPON3': '0.950', 'HITCOUNT': '2.150', 'weapon3': '2.520', 'DAMAGECOUNT': '11.937', 'FRAGCOUNT': '37.000'} [2023-02-25 13:51:13,296][36155] DAMAGECOUNT value on done: 547901.0 [2023-02-25 13:51:13,296][36155] Sum rewards: 59.624, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.354', 'AMMO5': '0.014', 'weapon5': '0.036', 'AMMO2': '0.040', 'weapon4': '0.064', 'AMMO4': '0.198', 'AMMO3': '0.198', 'weapon2': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.100', 'weapon3': '3.482', 'DAMAGECOUNT': '15.963', 'FRAGCOUNT': '51.000'} [2023-02-25 13:51:13,437][36138] Updated weights for policy 0, policy_version 44403 (0.0010) [2023-02-25 13:51:13,819][36155] DAMAGECOUNT value on done: 543564.0 [2023-02-25 13:51:13,819][36155] Sum rewards: 58.185, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.025', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon5': '0.102', 'weapon4': '0.104', 'AMMO4': '0.176', 'AMMO3': '0.211', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.040', 'weapon3': '3.234', 'DAMAGECOUNT': '15.540', 'FRAGCOUNT': '51.000'} [2023-02-25 13:51:13,921][36139] DAMAGECOUNT value on done: 545096.0 [2023-02-25 13:51:13,921][36139] Sum rewards: 65.110, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.605', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon4': '0.322', 'weapon2': '0.528', 'WEAPON3': '1.250', 'weapon3': '2.992', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.006', 'FRAGCOUNT': '57.000'} [2023-02-25 13:51:14,132][36155] DAMAGECOUNT value on done: 536092.0 [2023-02-25 13:51:14,132][36155] Sum rewards: 51.246, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.018', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.124', 'AMMO3': '0.175', 'AMMO4': '0.177', 'weapon2': '0.242', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.482', 'WEAPON3': '1.100', 'HITCOUNT': '2.770', 'weapon3': '2.952', 'DAMAGECOUNT': '13.944', 'FRAGCOUNT': '44.000'} [2023-02-25 13:51:14,233][36139] DAMAGECOUNT value on done: 534325.0 [2023-02-25 13:51:14,234][36139] Sum rewards: 60.137, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.046', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.117', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon2': '0.240', 'weapon4': '0.332', 'WEAPON3': '1.150', 'HITCOUNT': '3.210', 'weapon3': '3.248', 'DAMAGECOUNT': '14.400', 'FRAGCOUNT': '51.000'} [2023-02-25 13:51:14,611][36139] DAMAGECOUNT value on done: 543090.0 [2023-02-25 13:51:14,611][36139] Sum rewards: 51.129, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.052', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.106', 'AMMO4': '0.207', 'weapon2': '0.210', 'AMMO3': '0.231', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.576', 'WEAPON3': '1.350', 'weapon3': '2.816', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.977', 'FRAGCOUNT': '48.000'} [2023-02-25 13:51:14,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13454.3). Total num frames: 181891072. Throughput: 0: 3328.7. Samples: 7966966. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 13:51:14,730][36114] Avg episode reward: [(0, '55.008')] [2023-02-25 13:51:14,926][36139] DAMAGECOUNT value on done: 541767.0 [2023-02-25 13:51:14,927][36139] Sum rewards: 53.616, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.578', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.072', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.278', 'weapon2': '0.280', 'AMMO3': '0.310', 'WEAPON3': '1.800', 'weapon3': '3.010', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.651', 'FRAGCOUNT': '51.000'} [2023-02-25 13:51:15,524][36155] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 13:51:16,585][36138] Updated weights for policy 0, policy_version 44413 (0.0009) [2023-02-25 13:51:17,438][36141] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:51:19,729][36114] Fps is (10 sec: 12697.5, 60 sec: 13243.7, 300 sec: 13426.5). Total num frames: 181952512. Throughput: 0: 3310.8. Samples: 7986340. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 13:51:19,730][36114] Avg episode reward: [(0, '54.998')] [2023-02-25 13:51:19,757][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000044423_181956608.pth... [2023-02-25 13:51:19,761][36138] Updated weights for policy 0, policy_version 44423 (0.0009) [2023-02-25 13:51:19,814][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000043636_178733056.pth [2023-02-25 13:51:21,936][36154] DAMAGECOUNT value on done: 543331.0 [2023-02-25 13:51:21,937][36154] Sum rewards: 47.967, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.238', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon5': '0.184', 'weapon2': '0.214', 'AMMO4': '0.275', 'AMMO3': '0.294', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.670', 'WEAPON3': '1.650', 'weapon3': '2.568', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.667', 'FRAGCOUNT': '46.000'} [2023-02-25 13:51:22,271][36154] DAMAGECOUNT value on done: 531788.0 [2023-02-25 13:51:22,272][36154] Sum rewards: 50.506, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.396', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.111', 'AMMO3': '0.258', 'WEAPON4': '0.350', 'weapon2': '0.386', 'weapon4': '0.488', 'WEAPON3': '1.550', 'weapon3': '2.872', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.809', 'FRAGCOUNT': '46.000'} [2023-02-25 13:51:22,371][36141] DAMAGECOUNT value on done: 547616.0 [2023-02-25 13:51:22,372][36141] Sum rewards: 59.378, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.392', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.152', 'weapon2': '0.162', 'AMMO3': '0.180', 'AMMO4': '0.189', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.364', 'WEAPON3': '1.150', 'HITCOUNT': '2.890', 'weapon3': '3.140', 'DAMAGECOUNT': '15.393', 'FRAGCOUNT': '49.500'} [2023-02-25 13:51:22,571][36154] DAMAGECOUNT value on done: 538912.0 [2023-02-25 13:51:22,571][36154] Sum rewards: 46.675, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.940', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.094', 'AMMO4': '0.153', 'weapon4': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.400', 'HITCOUNT': '2.760', 'weapon3': '3.018', 'DAMAGECOUNT': '12.873', 'FRAGCOUNT': '42.000'} [2023-02-25 13:51:22,663][36141] DAMAGECOUNT value on done: 534612.0 [2023-02-25 13:51:22,663][36141] Sum rewards: 60.829, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.337', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.124', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'weapon2': '0.180', 'WEAPON4': '0.250', 'AMMO3': '0.258', 'weapon4': '0.564', 'WEAPON3': '1.550', 'weapon3': '2.870', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '55.000'} [2023-02-25 13:51:22,713][36141] DAMAGECOUNT value on done: 544937.0 [2023-02-25 13:51:22,713][36141] Sum rewards: 65.306, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.192', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.054', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon4': '0.294', 'weapon2': '0.378', 'WEAPON3': '1.150', 'weapon3': '2.994', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.122', 'FRAGCOUNT': '55.000'} [2023-02-25 13:51:22,881][36154] DAMAGECOUNT value on done: 539798.0 [2023-02-25 13:51:22,881][36154] Sum rewards: 34.976, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.694', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.098', 'AMMO4': '0.135', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'weapon4': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.492', 'WEAPON3': '1.100', 'HITCOUNT': '2.100', 'weapon3': '2.912', 'DAMAGECOUNT': '9.348', 'FRAGCOUNT': '33.000'} [2023-02-25 13:51:22,959][36138] Updated weights for policy 0, policy_version 44433 (0.0010) [2023-02-25 13:51:22,985][36141] DAMAGECOUNT value on done: 532783.0 [2023-02-25 13:51:22,985][36141] Sum rewards: 57.006, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.448', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.154', 'WEAPON4': '0.400', 'weapon2': '0.428', 'weapon4': '0.598', 'WEAPON3': '0.900', 'weapon3': '2.692', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '14.832', 'FRAGCOUNT': '48.000'} [2023-02-25 13:51:23,601][36157] DAMAGECOUNT value on done: 553569.0 [2023-02-25 13:51:23,601][36157] Sum rewards: 55.915, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.048', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.043', 'AMMO3': '0.194', 'weapon5': '0.198', 'AMMO4': '0.215', 'weapon2': '0.224', 'weapon4': '0.500', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.788', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '49.000'} [2023-02-25 13:51:23,909][36157] DAMAGECOUNT value on done: 538023.0 [2023-02-25 13:51:23,910][36157] Sum rewards: 64.172, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.168', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon5': '0.012', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO3': '0.210', 'weapon2': '0.448', 'WEAPON3': '1.200', 'weapon3': '3.180', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.516', 'FRAGCOUNT': '55.000'} [2023-02-25 13:51:24,561][36157] DAMAGECOUNT value on done: 547250.0 [2023-02-25 13:51:24,562][36157] Sum rewards: 52.769, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.640', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.075', 'weapon5': '0.112', 'weapon2': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.306', 'WEAPON3': '1.850', 'HITCOUNT': '3.100', 'weapon3': '3.452', 'DAMAGECOUNT': '14.268', 'FRAGCOUNT': '50.000'} [2023-02-25 13:51:24,729][36114] Fps is (10 sec: 12697.6, 60 sec: 13243.7, 300 sec: 13426.5). Total num frames: 182018048. Throughput: 0: 3298.3. Samples: 7995892. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 13:51:24,730][36114] Avg episode reward: [(0, '55.001')] [2023-02-25 13:51:24,821][36140] DAMAGECOUNT value on done: 548393.0 [2023-02-25 13:51:24,821][36140] Sum rewards: 64.787, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.784', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.020', 'weapon4': '0.038', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'weapon2': '0.102', 'AMMO3': '0.205', 'WEAPON3': '1.300', 'HITCOUNT': '3.160', 'weapon3': '3.696', 'DAMAGECOUNT': '15.798', 'FRAGCOUNT': '54.000'} [2023-02-25 13:51:24,883][36157] DAMAGECOUNT value on done: 544046.0 [2023-02-25 13:51:24,884][36157] Sum rewards: 57.665, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.765', 'AMMO5': '0.005', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.112', 'WEAPON5': '0.200', 'weapon4': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.250', 'AMMO3': '0.270', 'WEAPON3': '1.550', 'HITCOUNT': '2.990', 'weapon3': '3.132', 'DAMAGECOUNT': '14.826', 'FRAGCOUNT': '53.000'} [2023-02-25 13:51:25,126][36140] DAMAGECOUNT value on done: 530578.0 [2023-02-25 13:51:25,126][36140] Sum rewards: 55.181, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.860', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon2': '0.156', 'AMMO4': '0.175', 'weapon5': '0.204', 'AMMO3': '0.213', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.432', 'WEAPON3': '1.200', 'weapon3': '2.708', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '14.103', 'FRAGCOUNT': '49.000'} [2023-02-25 13:51:25,448][36140] DAMAGECOUNT value on done: 537409.0 [2023-02-25 13:51:25,448][36140] Sum rewards: 44.507, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.235', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon5': '0.110', 'AMMO3': '0.168', 'WEAPON5': '0.250', 'AMMO4': '0.253', 'weapon2': '0.290', 'WEAPON4': '0.650', 'WEAPON3': '0.950', 'weapon4': '1.036', 'weapon3': '2.234', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '11.826', 'FRAGCOUNT': '40.000'} [2023-02-25 13:51:25,782][36140] DAMAGECOUNT value on done: 537869.0 [2023-02-25 13:51:25,782][36140] Sum rewards: 50.012, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.922', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'weapon2': '0.232', 'AMMO3': '0.246', 'weapon4': '0.530', 'WEAPON3': '1.550', 'weapon3': '3.032', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.207', 'FRAGCOUNT': '44.000'} [2023-02-25 13:51:26,110][36138] Updated weights for policy 0, policy_version 44443 (0.0010) [2023-02-25 13:51:26,602][36142] DAMAGECOUNT value on done: 546209.0 [2023-02-25 13:51:26,603][36142] Sum rewards: 60.776, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.518', 'AMMO5': '0.010', 'AMMO2': '0.010', 'weapon4': '0.032', 'weapon5': '0.044', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.182', 'AMMO3': '0.274', 'WEAPON3': '1.550', 'HITCOUNT': '2.970', 'weapon3': '3.544', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '53.000'} [2023-02-25 13:51:26,798][36142] DAMAGECOUNT value on done: 531264.0 [2023-02-25 13:51:26,799][36142] Sum rewards: 52.019, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.540', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'weapon5': '0.062', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'weapon4': '0.114', 'AMMO3': '0.220', 'weapon2': '0.746', 'WEAPON3': '1.200', 'HITCOUNT': '2.800', 'weapon3': '2.906', 'DAMAGECOUNT': '13.251', 'FRAGCOUNT': '43.000'} [2023-02-25 13:51:26,919][36142] DAMAGECOUNT value on done: 534203.0 [2023-02-25 13:51:26,919][36142] Sum rewards: 63.649, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.098', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon5': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'weapon4': '0.314', 'weapon2': '0.354', 'WEAPON3': '1.450', 'weapon3': '2.862', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '55.000'} [2023-02-25 13:51:27,107][36142] DAMAGECOUNT value on done: 545445.0 [2023-02-25 13:51:27,107][36142] Sum rewards: 57.627, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.722', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.104', 'AMMO4': '0.138', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.376', 'weapon4': '0.404', 'WEAPON3': '1.250', 'weapon3': '2.930', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.111', 'FRAGCOUNT': '49.000'} [2023-02-25 13:51:27,261][36156] DAMAGECOUNT value on done: 547245.0 [2023-02-25 13:51:27,261][36156] Sum rewards: 55.610, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.083', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.052', 'weapon5': '0.164', 'AMMO3': '0.196', 'AMMO4': '0.261', 'WEAPON5': '0.450', 'weapon2': '0.476', 'WEAPON4': '0.550', 'weapon4': '0.610', 'WEAPON3': '1.150', 'weapon3': '2.436', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.880', 'FRAGCOUNT': '50.000'} [2023-02-25 13:51:27,271][36156] DAMAGECOUNT value on done: 548844.0 [2023-02-25 13:51:27,272][36156] Sum rewards: 56.858, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.864', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.026', 'weapon5': '0.120', 'AMMO4': '0.131', 'AMMO3': '0.162', 'weapon2': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.808', 'WEAPON3': '0.900', 'weapon3': '2.436', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.860', 'FRAGCOUNT': '48.000'} [2023-02-25 13:51:27,557][36156] DAMAGECOUNT value on done: 534861.0 [2023-02-25 13:51:27,558][36156] Sum rewards: 48.038, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.305', 'AMMO5': '0.003', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.078', 'WEAPON5': '0.100', 'weapon4': '0.162', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'weapon2': '0.374', 'WEAPON3': '1.150', 'HITCOUNT': '2.600', 'weapon3': '3.246', 'DAMAGECOUNT': '12.165', 'FRAGCOUNT': '42.000'} [2023-02-25 13:51:27,568][36156] DAMAGECOUNT value on done: 539497.0 [2023-02-25 13:51:27,569][36156] Sum rewards: 59.949, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.731', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.070', 'AMMO4': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.344', 'WEAPON4': '0.350', 'weapon4': '0.362', 'ARMOR': '0.496', 'WEAPON3': '1.350', 'HITCOUNT': '3.000', 'weapon3': '3.012', 'DAMAGECOUNT': '14.097', 'FRAGCOUNT': '54.000'} [2023-02-25 13:51:29,154][36138] Updated weights for policy 0, policy_version 44453 (0.0009) [2023-02-25 13:51:29,178][36155] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:51:29,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13243.7, 300 sec: 13426.5). Total num frames: 182083584. Throughput: 0: 3291.5. Samples: 8015722. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 13:51:29,730][36114] Avg episode reward: [(0, '55.200')] [2023-02-25 13:51:32,213][36138] Updated weights for policy 0, policy_version 44463 (0.0009) [2023-02-25 13:51:33,542][36155] DAMAGECOUNT value on done: 534670.0 [2023-02-25 13:51:33,543][36155] Sum rewards: 56.161, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.610', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.144', 'AMMO4': '0.150', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.436', 'weapon2': '0.454', 'WEAPON3': '1.200', 'weapon3': '2.698', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.498', 'FRAGCOUNT': '48.000'} [2023-02-25 13:51:33,853][36155] DAMAGECOUNT value on done: 553001.0 [2023-02-25 13:51:33,854][36155] Sum rewards: 57.916, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.525', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.098', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon2': '0.256', 'weapon4': '0.586', 'WEAPON3': '1.150', 'weapon3': '2.820', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '49.000'} [2023-02-25 13:51:34,187][36139] DAMAGECOUNT value on done: 549294.0 [2023-02-25 13:51:34,187][36139] Sum rewards: 46.925, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.661', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon4': '0.354', 'weapon2': '0.428', 'WEAPON3': '1.200', 'HITCOUNT': '2.570', 'weapon3': '2.870', 'DAMAGECOUNT': '12.594', 'FRAGCOUNT': '42.000'} [2023-02-25 13:51:34,408][36155] DAMAGECOUNT value on done: 548407.0 [2023-02-25 13:51:34,408][36155] Sum rewards: 56.750, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.478', 'AMMO5': '0.007', 'AMMO2': '0.042', 'AMMO3': '0.132', 'weapon5': '0.160', 'AMMO4': '0.208', 'weapon2': '0.246', 'WEAPON5': '0.250', 'weapon4': '0.348', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.950', 'HITCOUNT': '2.850', 'weapon3': '3.006', 'DAMAGECOUNT': '14.529', 'FRAGCOUNT': '46.000'} [2023-02-25 13:51:34,491][36139] DAMAGECOUNT value on done: 539858.0 [2023-02-25 13:51:34,491][36139] Sum rewards: 68.579, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.880', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.092', 'weapon2': '0.120', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.382', 'WEAPON3': '1.250', 'weapon3': '3.230', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '59.000'} [2023-02-25 13:51:34,715][36155] DAMAGECOUNT value on done: 540365.0 [2023-02-25 13:51:34,715][36155] Sum rewards: 47.995, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.779', 'AMMO5': '0.011', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.162', 'WEAPON4': '0.200', 'weapon2': '0.202', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'weapon4': '0.336', 'WEAPON3': '1.350', 'HITCOUNT': '2.570', 'weapon3': '3.018', 'DAMAGECOUNT': '12.819', 'FRAGCOUNT': '43.500'} [2023-02-25 13:51:34,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13243.8, 300 sec: 13426.6). Total num frames: 182153216. Throughput: 0: 3287.6. Samples: 8035788. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 13:51:34,729][36114] Avg episode reward: [(0, '55.239')] [2023-02-25 13:51:34,899][36139] DAMAGECOUNT value on done: 548262.0 [2023-02-25 13:51:34,899][36139] Sum rewards: 66.857, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.271', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.026', 'AMMO4': '0.061', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.158', 'weapon2': '0.616', 'WEAPON3': '1.000', 'HITCOUNT': '3.030', 'weapon3': '3.178', 'DAMAGECOUNT': '15.516', 'FRAGCOUNT': '54.000'} [2023-02-25 13:51:35,205][36139] DAMAGECOUNT value on done: 546926.0 [2023-02-25 13:51:35,206][36139] Sum rewards: 60.353, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.895', 'AMMO5': '0.004', 'AMMO2': '0.030', 'weapon5': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'AMMO3': '0.228', 'weapon4': '0.308', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.166', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '55.000'} [2023-02-25 13:51:35,273][36138] Updated weights for policy 0, policy_version 44473 (0.0009) [2023-02-25 13:51:35,552][36140] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-25 13:51:38,311][36138] Updated weights for policy 0, policy_version 44483 (0.0009) [2023-02-25 13:51:39,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13243.7, 300 sec: 13412.7). Total num frames: 182218752. Throughput: 0: 3287.8. Samples: 8045898. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:51:39,730][36114] Avg episode reward: [(0, '55.565')] [2023-02-25 13:51:41,353][36138] Updated weights for policy 0, policy_version 44493 (0.0010) [2023-02-25 13:51:42,193][36154] DAMAGECOUNT value on done: 548573.0 [2023-02-25 13:51:42,193][36154] Sum rewards: 56.743, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.425', 'AMMO5': '0.018', 'AMMO2': '0.046', 'AMMO3': '0.192', 'AMMO4': '0.232', 'weapon4': '0.370', 'weapon5': '0.424', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.758', 'WEAPON3': '1.100', 'weapon3': '2.142', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '49.000'} [2023-02-25 13:51:42,503][36154] DAMAGECOUNT value on done: 536614.0 [2023-02-25 13:51:42,503][36154] Sum rewards: 61.036, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.200', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.084', 'AMMO4': '0.143', 'AMMO3': '0.236', 'WEAPON5': '0.250', 'weapon4': '0.254', 'WEAPON4': '0.350', 'weapon2': '0.570', 'WEAPON3': '1.350', 'weapon3': '2.840', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.406', 'FRAGCOUNT': '56.000'} [2023-02-25 13:51:42,613][36141] DAMAGECOUNT value on done: 553539.0 [2023-02-25 13:51:42,614][36141] Sum rewards: 70.649, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.550', 'AMMO5': '0.004', 'AMMO2': '0.013', 'weapon5': '0.026', 'AMMO4': '0.065', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon4': '0.284', 'weapon2': '0.328', 'WEAPON3': '1.350', 'weapon3': '3.138', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.769', 'FRAGCOUNT': '61.500'} [2023-02-25 13:51:42,814][36154] DAMAGECOUNT value on done: 544507.0 [2023-02-25 13:51:42,814][36154] Sum rewards: 64.458, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.450', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.060', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'weapon4': '0.164', 'WEAPON5': '0.200', 'weapon2': '0.226', 'AMMO3': '0.277', 'WEAPON3': '1.650', 'weapon3': '3.322', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '57.000'} [2023-02-25 13:51:42,869][36141] DAMAGECOUNT value on done: 538947.0 [2023-02-25 13:51:42,869][36141] Sum rewards: 48.852, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.380', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.078', 'WEAPON4': '0.100', 'AMMO4': '0.113', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.265', 'weapon2': '0.322', 'WEAPON3': '1.550', 'HITCOUNT': '2.790', 'weapon3': '3.214', 'DAMAGECOUNT': '13.005', 'FRAGCOUNT': '44.500'} [2023-02-25 13:51:42,928][36141] DAMAGECOUNT value on done: 549707.0 [2023-02-25 13:51:42,929][36141] Sum rewards: 58.637, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.782', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO3': '0.157', 'weapon5': '0.168', 'AMMO4': '0.174', 'weapon4': '0.248', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '2.940', 'weapon3': '3.016', 'DAMAGECOUNT': '14.295', 'FRAGCOUNT': '50.000'} [2023-02-25 13:51:43,119][36154] DAMAGECOUNT value on done: 543573.0 [2023-02-25 13:51:43,120][36154] Sum rewards: 42.277, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.083', 'AMMO5': '0.014', 'weapon5': '0.026', 'AMMO2': '0.033', 'weapon4': '0.124', 'AMMO4': '0.164', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'weapon2': '0.564', 'WEAPON3': '1.300', 'HITCOUNT': '2.480', 'weapon3': '3.124', 'DAMAGECOUNT': '11.325', 'FRAGCOUNT': '39.000'} [2023-02-25 13:51:43,190][36141] DAMAGECOUNT value on done: 537263.0 [2023-02-25 13:51:43,190][36141] Sum rewards: 49.479, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.910', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.106', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon4': '0.316', 'weapon2': '0.480', 'WEAPON3': '1.150', 'HITCOUNT': '2.810', 'weapon3': '2.858', 'DAMAGECOUNT': '13.440', 'FRAGCOUNT': '42.000'} [2023-02-25 13:51:43,509][36157] DAMAGECOUNT value on done: 557638.0 [2023-02-25 13:51:43,510][36157] Sum rewards: 40.334, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.810', 'AMMO5': '0.025', 'AMMO2': '0.081', 'weapon5': '0.120', 'AMMO3': '0.238', 'weapon2': '0.304', 'weapon4': '0.322', 'AMMO4': '0.403', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'HITCOUNT': '2.760', 'weapon3': '2.934', 'DAMAGECOUNT': '12.207', 'FRAGCOUNT': '41.000'} [2023-02-25 13:51:43,838][36157] DAMAGECOUNT value on done: 542462.0 [2023-02-25 13:51:43,838][36157] Sum rewards: 48.445, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.301', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.044', 'AMMO3': '0.154', 'weapon2': '0.206', 'AMMO4': '0.218', 'weapon5': '0.362', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.634', 'WEAPON3': '1.000', 'HITCOUNT': '2.510', 'weapon3': '2.532', 'DAMAGECOUNT': '13.317', 'FRAGCOUNT': '43.000'} [2023-02-25 13:51:44,409][36138] Updated weights for policy 0, policy_version 44503 (0.0010) [2023-02-25 13:51:44,441][36157] DAMAGECOUNT value on done: 552482.0 [2023-02-25 13:51:44,441][36157] Sum rewards: 61.582, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.326', 'AMMO5': '0.007', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.170', 'weapon2': '0.176', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.406', 'WEAPON3': '1.400', 'weapon3': '2.956', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '54.000'} [2023-02-25 13:51:44,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13243.7, 300 sec: 13426.5). Total num frames: 182288384. Throughput: 0: 3291.4. Samples: 8066210. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:51:44,730][36114] Avg episode reward: [(0, '55.544')] [2023-02-25 13:51:44,749][36157] DAMAGECOUNT value on done: 549084.0 [2023-02-25 13:51:44,749][36157] Sum rewards: 55.938, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.919', 'AMMO5': '0.017', 'AMMO2': '0.033', 'AMMO4': '0.165', 'AMMO3': '0.168', 'weapon5': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.310', 'WEAPON5': '0.350', 'weapon4': '0.606', 'WEAPON3': '1.000', 'weapon3': '2.436', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '15.114', 'FRAGCOUNT': '47.000'} [2023-02-25 13:51:44,839][36140] DAMAGECOUNT value on done: 553984.0 [2023-02-25 13:51:44,840][36140] Sum rewards: 71.476, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.357', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.076', 'weapon5': '0.090', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.246', 'WEAPON3': '1.200', 'weapon3': '3.390', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '59.000'} [2023-02-25 13:51:45,151][36140] DAMAGECOUNT value on done: 534722.0 [2023-02-25 13:51:45,152][36140] Sum rewards: 45.033, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.346', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.083', 'WEAPON4': '0.250', 'AMMO3': '0.256', 'weapon4': '0.434', 'weapon2': '0.508', 'WEAPON3': '1.500', 'weapon3': '2.772', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '12.432', 'FRAGCOUNT': '41.000'} [2023-02-25 13:51:45,449][36140] DAMAGECOUNT value on done: 542420.0 [2023-02-25 13:51:45,449][36140] Sum rewards: 53.986, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.661', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.110', 'weapon2': '0.156', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'weapon4': '0.354', 'WEAPON3': '1.400', 'HITCOUNT': '2.960', 'weapon3': '3.174', 'DAMAGECOUNT': '15.024', 'FRAGCOUNT': '47.500'} [2023-02-25 13:51:45,758][36140] DAMAGECOUNT value on done: 541911.0 [2023-02-25 13:51:45,758][36140] Sum rewards: 41.474, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.640', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.048', 'AMMO3': '0.174', 'weapon5': '0.208', 'AMMO4': '0.241', 'WEAPON5': '0.400', 'weapon2': '0.576', 'WEAPON4': '0.600', 'WEAPON3': '1.000', 'weapon4': '1.140', 'weapon3': '1.840', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.126', 'FRAGCOUNT': '38.000'} [2023-02-25 13:51:46,517][36142] DAMAGECOUNT value on done: 549198.0 [2023-02-25 13:51:46,517][36142] Sum rewards: 33.398, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.058', 'AMMO2': '0.051', 'weapon7': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.123', 'AMMO4': '0.253', 'weapon2': '0.368', 'WEAPON4': '0.450', 'WEAPON3': '0.750', 'weapon4': '1.276', 'weapon3': '1.574', 'HITCOUNT': '2.250', 'DAMAGECOUNT': '8.967', 'FRAGCOUNT': '30.000'} [2023-02-25 13:51:46,658][36142] DAMAGECOUNT value on done: 535348.0 [2023-02-25 13:51:46,659][36142] Sum rewards: 49.115, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.510', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.119', 'weapon5': '0.232', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON4': '0.400', 'weapon4': '0.630', 'WEAPON3': '0.750', 'weapon3': '2.398', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '12.252', 'FRAGCOUNT': '41.000'} [2023-02-25 13:51:46,829][36142] DAMAGECOUNT value on done: 538698.0 [2023-02-25 13:51:46,829][36142] Sum rewards: 54.871, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.690', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.141', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'weapon2': '0.242', 'weapon4': '0.252', 'WEAPON3': '1.100', 'HITCOUNT': '2.840', 'weapon3': '3.286', 'DAMAGECOUNT': '13.485', 'FRAGCOUNT': '48.000'} [2023-02-25 13:51:46,968][36142] DAMAGECOUNT value on done: 549849.0 [2023-02-25 13:51:46,968][36142] Sum rewards: 45.708, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.013', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.088', 'AMMO4': '0.095', 'WEAPON5': '0.150', 'weapon4': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon2': '0.480', 'WEAPON3': '1.250', 'HITCOUNT': '2.600', 'weapon3': '2.996', 'DAMAGECOUNT': '13.212', 'FRAGCOUNT': '41.000'} [2023-02-25 13:51:47,283][36156] DAMAGECOUNT value on done: 552965.0 [2023-02-25 13:51:47,284][36156] Sum rewards: 69.054, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.395', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.176', 'weapon5': '0.198', 'WEAPON5': '0.250', 'weapon2': '0.336', 'WEAPON4': '0.350', 'weapon4': '0.734', 'WEAPON3': '1.100', 'weapon3': '2.424', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '58.000'} [2023-02-25 13:51:47,294][36156] DAMAGECOUNT value on done: 554444.0 [2023-02-25 13:51:47,294][36156] Sum rewards: 58.518, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.452', 'ARMOR': '0.004', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'weapon4': '0.112', 'AMMO4': '0.190', 'AMMO3': '0.232', 'weapon5': '0.272', 'WEAPON4': '0.400', 'weapon2': '0.408', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.824', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '52.500'} [2023-02-25 13:51:47,456][36138] Updated weights for policy 0, policy_version 44513 (0.0009) [2023-02-25 13:51:47,599][36156] DAMAGECOUNT value on done: 539977.0 [2023-02-25 13:51:47,600][36156] Sum rewards: 58.919, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.312', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.086', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'weapon4': '0.172', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'weapon2': '0.492', 'WEAPON3': '1.250', 'weapon3': '3.018', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.348', 'FRAGCOUNT': '50.000'} [2023-02-25 13:51:47,612][36156] DAMAGECOUNT value on done: 544647.0 [2023-02-25 13:51:47,612][36156] Sum rewards: 54.044, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.472', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon5': '0.172', 'weapon2': '0.184', 'AMMO4': '0.188', 'AMMO3': '0.232', 'WEAPON5': '0.350', 'weapon4': '0.362', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '3.000', 'weapon3': '3.028', 'DAMAGECOUNT': '15.090', 'FRAGCOUNT': '48.000'} [2023-02-25 13:51:49,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13243.7, 300 sec: 13426.5). Total num frames: 182353920. Throughput: 0: 3297.3. Samples: 8086394. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:51:49,730][36114] Avg episode reward: [(0, '55.211')] [2023-02-25 13:51:50,445][36138] Updated weights for policy 0, policy_version 44523 (0.0009) [2023-02-25 13:51:53,127][36155] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:51:53,364][36155] DAMAGECOUNT value on done: 539735.0 [2023-02-25 13:51:53,365][36155] Sum rewards: 55.905, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.480', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.136', 'AMMO3': '0.207', 'AMMO4': '0.233', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.366', 'weapon2': '0.376', 'WEAPON3': '1.200', 'weapon3': '2.872', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.195', 'FRAGCOUNT': '48.000'} [2023-02-25 13:51:53,483][36138] Updated weights for policy 0, policy_version 44533 (0.0009) [2023-02-25 13:51:53,681][36155] DAMAGECOUNT value on done: 557988.0 [2023-02-25 13:51:53,681][36155] Sum rewards: 54.685, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.198', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.160', 'AMMO4': '0.170', 'AMMO3': '0.209', 'weapon4': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.448', 'WEAPON3': '1.300', 'weapon3': '2.778', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.961', 'FRAGCOUNT': '49.500'} [2023-02-25 13:51:54,150][36139] DAMAGECOUNT value on done: 553949.0 [2023-02-25 13:51:54,150][36139] Sum rewards: 53.480, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.016', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.130', 'AMMO4': '0.165', 'WEAPON5': '0.200', 'AMMO3': '0.272', 'WEAPON4': '0.300', 'weapon4': '0.424', 'weapon2': '0.458', 'WEAPON3': '1.650', 'weapon3': '2.702', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.965', 'FRAGCOUNT': '52.000'} [2023-02-25 13:51:54,213][36155] DAMAGECOUNT value on done: 553829.0 [2023-02-25 13:51:54,214][36155] Sum rewards: 59.276, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.345', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.043', 'weapon5': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon4': '0.232', 'weapon2': '0.490', 'WEAPON3': '1.350', 'weapon3': '2.922', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '49.000'} [2023-02-25 13:51:54,458][36139] DAMAGECOUNT value on done: 544654.0 [2023-02-25 13:51:54,459][36139] Sum rewards: 56.966, reward structure: {'DEATHCOUNT': '-15.750', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.028', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.245', 'HEALTH': '0.264', 'weapon2': '0.394', 'weapon4': '0.584', 'WEAPON3': '1.300', 'weapon3': '2.692', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.388', 'FRAGCOUNT': '49.000'} [2023-02-25 13:51:54,520][36155] DAMAGECOUNT value on done: 545085.0 [2023-02-25 13:51:54,521][36155] Sum rewards: 52.762, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.554', 'ARMOR': '0.008', 'AMMO5': '0.021', 'AMMO2': '0.061', 'AMMO3': '0.188', 'weapon5': '0.198', 'weapon2': '0.294', 'AMMO4': '0.305', 'weapon4': '0.404', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.736', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.160', 'FRAGCOUNT': '46.000'} [2023-02-25 13:51:54,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13175.5, 300 sec: 13412.7). Total num frames: 182419456. Throughput: 0: 3302.5. Samples: 8096554. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:51:54,730][36114] Avg episode reward: [(0, '55.079')] [2023-02-25 13:51:54,850][36139] DAMAGECOUNT value on done: 552448.0 [2023-02-25 13:51:54,851][36139] Sum rewards: 48.538, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.142', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon4': '0.220', 'weapon2': '0.494', 'WEAPON3': '1.250', 'HITCOUNT': '2.810', 'weapon3': '2.958', 'DAMAGECOUNT': '12.558', 'FRAGCOUNT': '43.000'} [2023-02-25 13:51:55,160][36139] DAMAGECOUNT value on done: 551808.0 [2023-02-25 13:51:55,161][36139] Sum rewards: 58.520, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.852', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO4': '0.138', 'weapon4': '0.160', 'AMMO3': '0.227', 'weapon2': '0.478', 'WEAPON3': '1.500', 'weapon3': '3.018', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.646', 'FRAGCOUNT': '52.000'} [2023-02-25 13:51:56,550][36138] Updated weights for policy 0, policy_version 44543 (0.0009) [2023-02-25 13:51:59,581][36138] Updated weights for policy 0, policy_version 44553 (0.0010) [2023-02-25 13:51:59,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13243.7, 300 sec: 13426.5). Total num frames: 182489088. Throughput: 0: 3329.1. Samples: 8116776. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:51:59,730][36114] Avg episode reward: [(0, '55.075')] [2023-02-25 13:52:01,635][36157] Large shaping reward -2.501 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.252, -84.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 13:52:02,083][36154] DAMAGECOUNT value on done: 554013.0 [2023-02-25 13:52:02,084][36154] Sum rewards: 61.100, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.780', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.094', 'weapon2': '0.198', 'AMMO3': '0.244', 'WEAPON3': '1.500', 'HITCOUNT': '3.360', 'weapon3': '3.484', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '52.000'} [2023-02-25 13:52:02,388][36154] DAMAGECOUNT value on done: 541334.0 [2023-02-25 13:52:02,389][36154] Sum rewards: 55.754, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.042', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.173', 'weapon4': '0.228', 'weapon2': '0.270', 'weapon5': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.820', 'weapon3': '2.924', 'DAMAGECOUNT': '14.160', 'FRAGCOUNT': '47.500'} [2023-02-25 13:52:02,609][36141] DAMAGECOUNT value on done: 558028.0 [2023-02-25 13:52:02,610][36141] Sum rewards: 48.137, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.782', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.070', 'AMMO3': '0.217', 'weapon5': '0.236', 'weapon2': '0.292', 'AMMO4': '0.348', 'WEAPON5': '0.400', 'weapon4': '0.420', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.760', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.077', 'FRAGCOUNT': '45.000'} [2023-02-25 13:52:02,650][36138] Updated weights for policy 0, policy_version 44563 (0.0009) [2023-02-25 13:52:02,691][36154] DAMAGECOUNT value on done: 549682.0 [2023-02-25 13:52:02,692][36154] Sum rewards: 60.159, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.713', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.098', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.206', 'AMMO3': '0.236', 'weapon2': '0.296', 'WEAPON3': '1.400', 'weapon3': '3.170', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.480', 'FRAGCOUNT': '53.000'} [2023-02-25 13:52:02,868][36141] DAMAGECOUNT value on done: 544404.0 [2023-02-25 13:52:02,868][36141] Sum rewards: 61.159, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.494', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.156', 'weapon2': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon4': '0.276', 'WEAPON3': '1.450', 'HITCOUNT': '3.040', 'weapon3': '3.174', 'DAMAGECOUNT': '16.371', 'FRAGCOUNT': '53.000'} [2023-02-25 13:52:02,937][36141] DAMAGECOUNT value on done: 555099.0 [2023-02-25 13:52:02,937][36141] Sum rewards: 56.149, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-1.562', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.126', 'AMMO4': '0.178', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'weapon2': '0.318', 'weapon4': '0.366', 'WEAPON3': '1.500', 'weapon3': '2.844', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '51.500'} [2023-02-25 13:52:03,011][36154] DAMAGECOUNT value on done: 548888.0 [2023-02-25 13:52:03,011][36154] Sum rewards: 61.475, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-5.012', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO4': '0.179', 'weapon2': '0.266', 'AMMO3': '0.286', 'weapon4': '0.444', 'WEAPON4': '0.450', 'WEAPON3': '1.800', 'weapon3': '2.898', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.945', 'FRAGCOUNT': '58.000'} [2023-02-25 13:52:03,191][36141] DAMAGECOUNT value on done: 542622.0 [2023-02-25 13:52:03,191][36141] Sum rewards: 57.120, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.475', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.106', 'weapon5': '0.128', 'AMMO4': '0.176', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.514', 'WEAPON3': '1.550', 'weapon3': '3.000', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '50.000'} [2023-02-25 13:52:03,457][36157] DAMAGECOUNT value on done: 561254.0 [2023-02-25 13:52:03,457][36157] Sum rewards: 42.071, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.420', 'AMMO5': '0.003', 'AMMO2': '0.013', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO3': '0.118', 'weapon4': '0.140', 'WEAPON4': '0.200', 'weapon2': '0.788', 'WEAPON3': '0.900', 'HITCOUNT': '2.600', 'weapon3': '2.866', 'DAMAGECOUNT': '10.848', 'FRAGCOUNT': '34.000'} [2023-02-25 13:52:03,763][36157] DAMAGECOUNT value on done: 548209.0 [2023-02-25 13:52:03,764][36157] Sum rewards: 56.459, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-5.081', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.045', 'AMMO3': '0.215', 'AMMO4': '0.226', 'weapon5': '0.242', 'weapon4': '0.446', 'weapon2': '0.476', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.566', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '51.000'} [2023-02-25 13:52:04,357][36157] DAMAGECOUNT value on done: 557903.0 [2023-02-25 13:52:04,358][36157] Sum rewards: 59.616, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.738', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon5': '0.106', 'AMMO4': '0.116', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon4': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.250', 'HITCOUNT': '3.020', 'weapon3': '3.084', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '50.500'} [2023-02-25 13:52:04,656][36157] DAMAGECOUNT value on done: 554238.0 [2023-02-25 13:52:04,657][36157] Sum rewards: 66.142, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.027', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.206', 'AMMO3': '0.209', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.250', 'HITCOUNT': '3.070', 'weapon3': '3.072', 'DAMAGECOUNT': '15.462', 'FRAGCOUNT': '58.000'} [2023-02-25 13:52:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13243.7, 300 sec: 13412.7). Total num frames: 182554624. Throughput: 0: 3344.1. Samples: 8136822. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:52:04,730][36114] Avg episode reward: [(0, '55.045')] [2023-02-25 13:52:04,778][36140] DAMAGECOUNT value on done: 558593.0 [2023-02-25 13:52:04,779][36140] Sum rewards: 56.498, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.160', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.176', 'AMMO4': '0.194', 'AMMO3': '0.218', 'WEAPON5': '0.300', 'weapon2': '0.432', 'WEAPON4': '0.450', 'weapon4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.590', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.827', 'FRAGCOUNT': '52.000'} [2023-02-25 13:52:05,103][36140] DAMAGECOUNT value on done: 539810.0 [2023-02-25 13:52:05,104][36140] Sum rewards: 58.074, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.995', 'AMMO5': '0.019', 'AMMO2': '0.057', 'AMMO3': '0.171', 'AMMO4': '0.284', 'weapon5': '0.340', 'weapon2': '0.408', 'weapon4': '0.432', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.484', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '49.500'} [2023-02-25 13:52:05,222][36140] Large shaping reward 2.556 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.534, 178.0), ('weapon5', 0.002)] [2023-02-25 13:52:05,427][36140] DAMAGECOUNT value on done: 546855.0 [2023-02-25 13:52:05,428][36140] Sum rewards: 50.824, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.937', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon5': '0.114', 'weapon4': '0.136', 'AMMO4': '0.196', 'AMMO3': '0.216', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.404', 'WEAPON3': '1.250', 'HITCOUNT': '2.790', 'weapon3': '3.098', 'DAMAGECOUNT': '13.305', 'FRAGCOUNT': '47.000'} [2023-02-25 13:52:05,740][36140] DAMAGECOUNT value on done: 547141.0 [2023-02-25 13:52:05,740][36140] Sum rewards: 60.176, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.581', 'ARMOR': '0.008', 'AMMO5': '0.024', 'AMMO2': '0.069', 'weapon5': '0.132', 'AMMO3': '0.212', 'weapon4': '0.248', 'AMMO4': '0.343', 'weapon2': '0.408', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.882', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.501', 'FRAGCOUNT': '56.000'} [2023-02-25 13:52:05,760][36138] Updated weights for policy 0, policy_version 44573 (0.0009) [2023-02-25 13:52:06,593][36142] DAMAGECOUNT value on done: 553987.0 [2023-02-25 13:52:06,593][36142] Sum rewards: 49.847, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.625', 'ARMOR': '0.004', 'AMMO5': '0.026', 'AMMO2': '0.050', 'weapon5': '0.162', 'AMMO3': '0.171', 'AMMO4': '0.249', 'weapon2': '0.376', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'weapon4': '0.758', 'WEAPON3': '1.050', 'weapon3': '2.328', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.367', 'FRAGCOUNT': '45.000'} [2023-02-25 13:52:06,748][36142] DAMAGECOUNT value on done: 539673.0 [2023-02-25 13:52:06,748][36142] Sum rewards: 42.925, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.054', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.108', 'AMMO4': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'weapon2': '0.368', 'weapon4': '0.538', 'WEAPON3': '1.400', 'weapon3': '2.730', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.975', 'FRAGCOUNT': '41.000'} [2023-02-25 13:52:06,910][36142] DAMAGECOUNT value on done: 543860.0 [2023-02-25 13:52:06,911][36142] Sum rewards: 60.153, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.850', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.014', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.302', 'weapon2': '0.342', 'WEAPON3': '1.900', 'weapon3': '3.352', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '57.000'} [2023-02-25 13:52:07,066][36142] DAMAGECOUNT value on done: 553176.0 [2023-02-25 13:52:07,067][36142] Sum rewards: 38.717, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.050', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.116', 'AMMO3': '0.130', 'AMMO4': '0.136', 'weapon4': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.600', 'weapon2': '0.788', 'HITCOUNT': '1.880', 'weapon3': '2.678', 'DAMAGECOUNT': '9.981', 'FRAGCOUNT': '31.000'} [2023-02-25 13:52:07,472][36156] DAMAGECOUNT value on done: 558037.0 [2023-02-25 13:52:07,473][36156] Sum rewards: 56.716, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.696', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'AMMO3': '0.259', 'weapon4': '0.346', 'weapon2': '0.380', 'WEAPON3': '1.550', 'weapon3': '2.926', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.216', 'FRAGCOUNT': '50.000'} [2023-02-25 13:52:07,485][36156] DAMAGECOUNT value on done: 558761.0 [2023-02-25 13:52:07,485][36156] Sum rewards: 50.123, reward structure: {'DEATHCOUNT': '-15.750', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.054', 'HEALTH': '0.086', 'AMMO3': '0.147', 'weapon5': '0.202', 'AMMO4': '0.270', 'weapon2': '0.340', 'WEAPON5': '0.350', 'WEAPON4': '0.600', 'WEAPON3': '0.800', 'weapon4': '0.986', 'weapon3': '2.186', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.951', 'FRAGCOUNT': '44.000'} [2023-02-25 13:52:07,800][36156] DAMAGECOUNT value on done: 544873.0 [2023-02-25 13:52:07,800][36156] Sum rewards: 53.081, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.805', 'AMMO5': '0.009', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.150', 'weapon4': '0.160', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.450', 'HITCOUNT': '2.940', 'weapon3': '3.122', 'DAMAGECOUNT': '14.688', 'FRAGCOUNT': '48.000'} [2023-02-25 13:52:07,811][36156] DAMAGECOUNT value on done: 550178.0 [2023-02-25 13:52:07,812][36156] Sum rewards: 67.902, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.910', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.033', 'AMMO3': '0.159', 'AMMO4': '0.167', 'weapon5': '0.174', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.454', 'weapon4': '0.562', 'WEAPON3': '1.100', 'weapon3': '2.574', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.593', 'FRAGCOUNT': '56.000'} [2023-02-25 13:52:08,833][36138] Updated weights for policy 0, policy_version 44583 (0.0009) [2023-02-25 13:52:09,729][36114] Fps is (10 sec: 13107.4, 60 sec: 13243.7, 300 sec: 13412.7). Total num frames: 182620160. Throughput: 0: 3351.3. Samples: 8146702. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:52:09,729][36114] Avg episode reward: [(0, '55.091')] [2023-02-25 13:52:11,903][36138] Updated weights for policy 0, policy_version 44593 (0.0009) [2023-02-25 13:52:13,394][36155] DAMAGECOUNT value on done: 544105.0 [2023-02-25 13:52:13,395][36155] Sum rewards: 43.211, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.565', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon5': '0.184', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.394', 'weapon2': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.562', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.110', 'FRAGCOUNT': '39.000'} [2023-02-25 13:52:13,718][36155] DAMAGECOUNT value on done: 563497.0 [2023-02-25 13:52:13,718][36155] Sum rewards: 61.303, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.264', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.046', 'WEAPON5': '0.100', 'weapon2': '0.194', 'AMMO4': '0.203', 'WEAPON4': '0.250', 'AMMO3': '0.291', 'weapon4': '0.520', 'WEAPON3': '1.700', 'weapon3': '2.970', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '56.000'} [2023-02-25 13:52:14,256][36139] DAMAGECOUNT value on done: 558625.0 [2023-02-25 13:52:14,256][36155] DAMAGECOUNT value on done: 559038.0 [2023-02-25 13:52:14,256][36139] Sum rewards: 56.479, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.636', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon4': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.119', 'AMMO3': '0.208', 'weapon2': '0.334', 'WEAPON3': '1.400', 'HITCOUNT': '2.900', 'weapon3': '3.422', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '50.000'} [2023-02-25 13:52:14,257][36155] Sum rewards: 56.299, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.930', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.162', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'weapon4': '0.344', 'weapon2': '0.448', 'WEAPON3': '1.500', 'weapon3': '2.724', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.627', 'FRAGCOUNT': '51.000'} [2023-02-25 13:52:14,555][36155] DAMAGECOUNT value on done: 549902.0 [2023-02-25 13:52:14,556][36155] Sum rewards: 48.171, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.021', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.116', 'AMMO4': '0.191', 'AMMO3': '0.224', 'weapon4': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.514', 'WEAPON3': '1.300', 'weapon3': '2.912', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.451', 'FRAGCOUNT': '44.500'} [2023-02-25 13:52:14,579][36139] DAMAGECOUNT value on done: 549221.0 [2023-02-25 13:52:14,579][36139] Sum rewards: 52.547, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.595', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.096', 'weapon4': '0.144', 'AMMO4': '0.196', 'weapon2': '0.216', 'AMMO3': '0.223', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.910', 'weapon3': '3.252', 'DAMAGECOUNT': '13.701', 'FRAGCOUNT': '49.000'} [2023-02-25 13:52:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13312.0, 300 sec: 13426.5). Total num frames: 182689792. Throughput: 0: 3356.0. Samples: 8166740. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:52:14,730][36114] Avg episode reward: [(0, '55.057')] [2023-02-25 13:52:15,009][36138] Updated weights for policy 0, policy_version 44603 (0.0009) [2023-02-25 13:52:15,060][36139] DAMAGECOUNT value on done: 557400.0 [2023-02-25 13:52:15,060][36139] Sum rewards: 54.958, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.072', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.108', 'AMMO4': '0.144', 'AMMO3': '0.198', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON4': '0.400', 'weapon4': '0.616', 'WEAPON3': '1.150', 'weapon3': '2.760', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.721', 'FRAGCOUNT': '47.000'} [2023-02-25 13:52:15,389][36139] DAMAGECOUNT value on done: 556968.0 [2023-02-25 13:52:15,390][36139] Sum rewards: 57.636, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.360', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.132', 'AMMO4': '0.161', 'AMMO3': '0.197', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.338', 'weapon4': '0.460', 'WEAPON3': '1.150', 'weapon3': '2.578', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.480', 'FRAGCOUNT': '49.000'} [2023-02-25 13:52:18,083][36138] Updated weights for policy 0, policy_version 44613 (0.0009) [2023-02-25 13:52:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 182755328. Throughput: 0: 3352.0. Samples: 8186628. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:52:19,730][36114] Avg episode reward: [(0, '54.950')] [2023-02-25 13:52:21,177][36138] Updated weights for policy 0, policy_version 44623 (0.0009) [2023-02-25 13:52:22,321][36154] DAMAGECOUNT value on done: 559396.0 [2023-02-25 13:52:22,322][36154] Sum rewards: 64.403, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.680', 'AMMO5': '0.004', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.040', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.234', 'weapon4': '0.242', 'weapon2': '0.286', 'WEAPON3': '1.500', 'weapon3': '3.232', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.149', 'FRAGCOUNT': '56.000'} [2023-02-25 13:52:22,643][36154] DAMAGECOUNT value on done: 545797.0 [2023-02-25 13:52:22,644][36154] Sum rewards: 45.441, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.020', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.045', 'AMMO3': '0.191', 'AMMO4': '0.225', 'weapon5': '0.226', 'WEAPON5': '0.300', 'weapon4': '0.412', 'WEAPON4': '0.450', 'weapon2': '0.520', 'WEAPON3': '1.150', 'weapon3': '2.416', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '13.389', 'FRAGCOUNT': '41.000'} [2023-02-25 13:52:22,861][36141] DAMAGECOUNT value on done: 562602.0 [2023-02-25 13:52:22,861][36141] Sum rewards: 49.780, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.219', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.066', 'AMMO3': '0.167', 'weapon5': '0.266', 'AMMO4': '0.328', 'weapon2': '0.412', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'weapon4': '0.726', 'WEAPON3': '1.050', 'weapon3': '2.248', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.722', 'FRAGCOUNT': '44.000'} [2023-02-25 13:52:22,937][36154] DAMAGECOUNT value on done: 554395.0 [2023-02-25 13:52:22,938][36154] Sum rewards: 56.888, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.510', 'AMMO2': '0.007', 'AMMO4': '0.032', 'AMMO3': '0.234', 'weapon2': '0.266', 'WEAPON3': '1.400', 'HITCOUNT': '3.220', 'weapon3': '3.600', 'DAMAGECOUNT': '14.139', 'FRAGCOUNT': '49.000'} [2023-02-25 13:52:23,113][36141] DAMAGECOUNT value on done: 548976.0 [2023-02-25 13:52:23,114][36141] Sum rewards: 55.697, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.290', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.222', 'weapon2': '0.544', 'WEAPON3': '1.150', 'weapon3': '2.926', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.716', 'FRAGCOUNT': '49.000'} [2023-02-25 13:52:23,170][36141] DAMAGECOUNT value on done: 560097.0 [2023-02-25 13:52:23,171][36141] Sum rewards: 60.724, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.836', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.104', 'AMMO3': '0.128', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.306', 'weapon4': '0.836', 'WEAPON3': '0.850', 'weapon3': '2.550', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '50.000'} [2023-02-25 13:52:23,248][36154] DAMAGECOUNT value on done: 553434.0 [2023-02-25 13:52:23,248][36154] Sum rewards: 53.438, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.092', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.076', 'AMMO4': '0.177', 'AMMO3': '0.190', 'weapon2': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.672', 'WEAPON3': '1.150', 'weapon3': '2.624', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.638', 'FRAGCOUNT': '47.000'} [2023-02-25 13:52:23,426][36141] DAMAGECOUNT value on done: 547657.0 [2023-02-25 13:52:23,426][36141] Sum rewards: 58.128, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.132', 'AMMO5': '0.016', 'AMMO2': '0.037', 'AMMO3': '0.134', 'AMMO4': '0.187', 'weapon4': '0.218', 'weapon5': '0.220', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.572', 'WEAPON3': '1.000', 'weapon3': '2.710', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '48.000'} [2023-02-25 13:52:23,651][36157] DAMAGECOUNT value on done: 566014.0 [2023-02-25 13:52:23,652][36157] Sum rewards: 53.461, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.410', 'AMMO5': '0.018', 'weapon5': '0.028', 'AMMO2': '0.037', 'weapon4': '0.058', 'AMMO4': '0.183', 'AMMO3': '0.209', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.534', 'WEAPON3': '1.400', 'weapon3': '3.164', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.280', 'FRAGCOUNT': '48.000'} [2023-02-25 13:52:23,967][36157] DAMAGECOUNT value on done: 553672.0 [2023-02-25 13:52:23,967][36157] Sum rewards: 64.481, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.862', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.048', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.262', 'weapon2': '0.394', 'WEAPON3': '1.550', 'HITCOUNT': '3.230', 'weapon3': '3.236', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '58.000'} [2023-02-25 13:52:24,250][36138] Updated weights for policy 0, policy_version 44633 (0.0009) [2023-02-25 13:52:24,598][36157] DAMAGECOUNT value on done: 563073.0 [2023-02-25 13:52:24,598][36157] Sum rewards: 56.512, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.900', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.088', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'weapon2': '0.304', 'weapon4': '0.538', 'WEAPON3': '1.250', 'weapon3': '2.832', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '48.000'} [2023-02-25 13:52:24,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 182820864. Throughput: 0: 3352.6. Samples: 8196766. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:52:24,730][36114] Avg episode reward: [(0, '55.322')] [2023-02-25 13:52:24,900][36157] DAMAGECOUNT value on done: 558758.0 [2023-02-25 13:52:24,900][36157] Sum rewards: 53.830, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.090', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.204', 'AMMO3': '0.209', 'weapon4': '0.268', 'WEAPON3': '1.250', 'HITCOUNT': '2.870', 'weapon3': '3.126', 'DAMAGECOUNT': '13.560', 'FRAGCOUNT': '47.000'} [2023-02-25 13:52:24,943][36139] Large shaping reward 2.504 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.453, 151.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:52:24,951][36140] DAMAGECOUNT value on done: 563555.0 [2023-02-25 13:52:24,952][36140] Sum rewards: 54.910, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.280', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.046', 'AMMO3': '0.184', 'weapon5': '0.224', 'AMMO4': '0.228', 'weapon2': '0.272', 'weapon4': '0.440', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.686', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '14.886', 'FRAGCOUNT': '49.000'} [2023-02-25 13:52:25,254][36140] DAMAGECOUNT value on done: 544428.0 [2023-02-25 13:52:25,254][36140] Sum rewards: 52.597, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.080', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.027', 'weapon4': '0.100', 'weapon5': '0.120', 'AMMO4': '0.135', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.322', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.740', 'weapon3': '3.192', 'DAMAGECOUNT': '13.854', 'FRAGCOUNT': '47.000'} [2023-02-25 13:52:25,554][36140] DAMAGECOUNT value on done: 552227.0 [2023-02-25 13:52:25,555][36140] Sum rewards: 59.995, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.564', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.016', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.064', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.193', 'weapon2': '0.320', 'WEAPON3': '1.250', 'HITCOUNT': '3.240', 'weapon3': '3.354', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '49.500'} [2023-02-25 13:52:25,851][36140] DAMAGECOUNT value on done: 551239.0 [2023-02-25 13:52:25,851][36140] Sum rewards: 42.776, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.280', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.056', 'AMMO4': '0.123', 'AMMO3': '0.129', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.318', 'weapon4': '0.776', 'WEAPON3': '0.900', 'weapon3': '2.704', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.294', 'FRAGCOUNT': '35.000'} [2023-02-25 13:52:26,771][36142] DAMAGECOUNT value on done: 558622.0 [2023-02-25 13:52:26,771][36142] Sum rewards: 55.538, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.035', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.160', 'AMMO3': '0.189', 'WEAPON5': '0.250', 'weapon4': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.460', 'WEAPON3': '1.250', 'weapon3': '2.888', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.905', 'FRAGCOUNT': '50.000'} [2023-02-25 13:52:26,895][36142] DAMAGECOUNT value on done: 544222.0 [2023-02-25 13:52:26,895][36142] Sum rewards: 48.256, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.913', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.198', 'AMMO3': '0.208', 'AMMO4': '0.234', 'weapon4': '0.304', 'WEAPON5': '0.350', 'weapon2': '0.496', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.690', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.647', 'FRAGCOUNT': '44.000'} [2023-02-25 13:52:27,095][36142] DAMAGECOUNT value on done: 548366.0 [2023-02-25 13:52:27,096][36142] Sum rewards: 52.440, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.342', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.035', 'weapon5': '0.142', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'AMMO3': '0.223', 'weapon2': '0.260', 'WEAPON4': '0.300', 'weapon4': '0.362', 'WEAPON3': '1.300', 'HITCOUNT': '2.820', 'weapon3': '2.982', 'DAMAGECOUNT': '13.518', 'FRAGCOUNT': '47.500'} [2023-02-25 13:52:27,221][36142] DAMAGECOUNT value on done: 558198.0 [2023-02-25 13:52:27,222][36142] Sum rewards: 59.159, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.086', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO3': '0.158', 'AMMO4': '0.185', 'weapon5': '0.186', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON4': '0.350', 'weapon4': '0.904', 'WEAPON3': '1.000', 'weapon3': '2.262', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.066', 'FRAGCOUNT': '50.000'} [2023-02-25 13:52:27,290][36138] Updated weights for policy 0, policy_version 44643 (0.0009) [2023-02-25 13:52:27,695][36156] DAMAGECOUNT value on done: 561930.0 [2023-02-25 13:52:27,695][36156] Sum rewards: 38.347, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.192', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.067', 'AMMO3': '0.153', 'weapon5': '0.204', 'WEAPON5': '0.300', 'AMMO4': '0.334', 'WEAPON4': '0.650', 'weapon2': '0.752', 'WEAPON3': '0.800', 'weapon4': '1.320', 'weapon3': '1.438', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '11.679', 'FRAGCOUNT': '36.000'} [2023-02-25 13:52:27,716][36156] DAMAGECOUNT value on done: 563837.0 [2023-02-25 13:52:27,717][36156] Sum rewards: 58.062, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.114', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.030', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.150', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'weapon4': '0.256', 'weapon2': '0.526', 'WEAPON3': '1.100', 'weapon3': '3.000', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '48.000'} [2023-02-25 13:52:28,011][36156] DAMAGECOUNT value on done: 549952.0 [2023-02-25 13:52:28,011][36156] Sum rewards: 56.704, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.120', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.146', 'AMMO3': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.352', 'weapon4': '0.412', 'WEAPON3': '1.450', 'weapon3': '2.812', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.237', 'FRAGCOUNT': '50.000'} [2023-02-25 13:52:28,033][36156] DAMAGECOUNT value on done: 554747.0 [2023-02-25 13:52:28,033][36156] Sum rewards: 47.379, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.370', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'weapon5': '0.102', 'WEAPON4': '0.150', 'weapon4': '0.160', 'AMMO3': '0.203', 'weapon2': '0.514', 'WEAPON3': '1.300', 'HITCOUNT': '2.850', 'weapon3': '3.054', 'DAMAGECOUNT': '13.707', 'FRAGCOUNT': '41.500'} [2023-02-25 13:52:29,300][36154] Large shaping reward -2.534 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 13:52:29,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 182890496. Throughput: 0: 3347.9. Samples: 8216864. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:52:29,730][36114] Avg episode reward: [(0, '54.761')] [2023-02-25 13:52:30,300][36138] Updated weights for policy 0, policy_version 44653 (0.0009) [2023-02-25 13:52:33,299][36155] DAMAGECOUNT value on done: 548808.0 [2023-02-25 13:52:33,300][36155] Sum rewards: 53.199, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.704', 'ARMOR': '0.004', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'weapon4': '0.088', 'weapon5': '0.108', 'AMMO4': '0.118', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON3': '1.050', 'HITCOUNT': '2.880', 'weapon3': '3.302', 'DAMAGECOUNT': '14.109', 'FRAGCOUNT': '44.000'} [2023-02-25 13:52:33,334][36138] Updated weights for policy 0, policy_version 44663 (0.0009) [2023-02-25 13:52:33,604][36155] DAMAGECOUNT value on done: 568109.0 [2023-02-25 13:52:33,604][36155] Sum rewards: 55.213, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.832', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon5': '0.118', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.524', 'weapon4': '0.786', 'WEAPON3': '1.100', 'weapon3': '2.368', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.836', 'FRAGCOUNT': '46.000'} [2023-02-25 13:52:34,181][36155] DAMAGECOUNT value on done: 563238.0 [2023-02-25 13:52:34,181][36155] Sum rewards: 51.122, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.149', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.092', 'AMMO4': '0.106', 'AMMO3': '0.112', 'WEAPON5': '0.150', 'weapon4': '0.186', 'WEAPON4': '0.250', 'weapon2': '0.420', 'WEAPON3': '0.600', 'HITCOUNT': '2.740', 'weapon3': '2.988', 'DAMAGECOUNT': '12.600', 'FRAGCOUNT': '40.000'} [2023-02-25 13:52:34,185][36139] DAMAGECOUNT value on done: 563355.0 [2023-02-25 13:52:34,185][36139] Sum rewards: 45.908, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.816', 'AMMO5': '0.016', 'AMMO2': '0.052', 'AMMO3': '0.200', 'weapon5': '0.204', 'AMMO4': '0.262', 'WEAPON5': '0.400', 'weapon2': '0.426', 'weapon4': '0.508', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.526', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.190', 'FRAGCOUNT': '43.000'} [2023-02-25 13:52:34,483][36139] DAMAGECOUNT value on done: 553700.0 [2023-02-25 13:52:34,483][36139] Sum rewards: 51.239, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.730', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.175', 'weapon5': '0.176', 'WEAPON5': '0.350', 'weapon2': '0.430', 'WEAPON4': '0.450', 'weapon4': '0.790', 'WEAPON3': '1.200', 'weapon3': '2.364', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '13.422', 'FRAGCOUNT': '45.000'} [2023-02-25 13:52:34,491][36155] DAMAGECOUNT value on done: 554755.0 [2023-02-25 13:52:34,491][36155] Sum rewards: 50.803, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.162', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.052', 'AMMO3': '0.165', 'AMMO4': '0.259', 'weapon5': '0.284', 'weapon2': '0.312', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'weapon4': '0.712', 'WEAPON3': '1.000', 'weapon3': '2.368', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.559', 'FRAGCOUNT': '44.500'} [2023-02-25 13:52:34,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 182956032. Throughput: 0: 3350.8. Samples: 8237180. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:52:34,730][36114] Avg episode reward: [(0, '54.490')] [2023-02-25 13:52:34,943][36139] DAMAGECOUNT value on done: 563435.0 [2023-02-25 13:52:34,943][36139] Sum rewards: 66.491, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.268', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.035', 'weapon4': '0.070', 'AMMO4': '0.175', 'weapon2': '0.214', 'weapon5': '0.218', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.124', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '58.000'} [2023-02-25 13:52:35,243][36139] DAMAGECOUNT value on done: 560933.0 [2023-02-25 13:52:35,244][36139] Sum rewards: 40.418, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.768', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO3': '0.179', 'weapon5': '0.186', 'AMMO4': '0.186', 'weapon4': '0.280', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.918', 'WEAPON3': '1.050', 'weapon3': '2.370', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '11.895', 'FRAGCOUNT': '36.000'} [2023-02-25 13:52:36,323][36138] Updated weights for policy 0, policy_version 44673 (0.0009) [2023-02-25 13:52:39,356][36138] Updated weights for policy 0, policy_version 44683 (0.0009) [2023-02-25 13:52:39,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 183025664. Throughput: 0: 3349.2. Samples: 8247266. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:52:39,730][36114] Avg episode reward: [(0, '54.523')] [2023-02-25 13:52:42,272][36154] DAMAGECOUNT value on done: 565108.0 [2023-02-25 13:52:42,272][36154] Sum rewards: 65.338, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.460', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon5': '0.150', 'AMMO3': '0.170', 'AMMO4': '0.239', 'WEAPON5': '0.250', 'weapon2': '0.376', 'WEAPON4': '0.500', 'weapon4': '0.670', 'WEAPON3': '1.100', 'weapon3': '2.546', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '56.000'} [2023-02-25 13:52:42,406][36138] Updated weights for policy 0, policy_version 44693 (0.0009) [2023-02-25 13:52:42,581][36154] DAMAGECOUNT value on done: 549971.0 [2023-02-25 13:52:42,581][36154] Sum rewards: 47.654, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.598', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.048', 'AMMO3': '0.154', 'weapon2': '0.164', 'AMMO4': '0.240', 'weapon5': '0.276', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '0.850', 'weapon4': '0.906', 'weapon3': '2.246', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.522', 'FRAGCOUNT': '41.000'} [2023-02-25 13:52:42,784][36141] DAMAGECOUNT value on done: 566672.0 [2023-02-25 13:52:42,784][36141] Sum rewards: 44.424, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.495', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon5': '0.042', 'WEAPON5': '0.050', 'weapon4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'weapon2': '0.878', 'WEAPON3': '1.250', 'HITCOUNT': '2.720', 'weapon3': '2.768', 'DAMAGECOUNT': '12.210', 'FRAGCOUNT': '40.000'} [2023-02-25 13:52:42,885][36154] DAMAGECOUNT value on done: 558595.0 [2023-02-25 13:52:42,886][36154] Sum rewards: 45.096, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.890', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.122', 'AMMO4': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'weapon4': '0.358', 'weapon2': '0.416', 'WEAPON3': '1.450', 'HITCOUNT': '2.760', 'weapon3': '2.846', 'DAMAGECOUNT': '12.600', 'FRAGCOUNT': '42.000'} [2023-02-25 13:52:43,053][36141] DAMAGECOUNT value on done: 553580.0 [2023-02-25 13:52:43,053][36141] Sum rewards: 47.212, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.025', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.049', 'AMMO3': '0.145', 'weapon5': '0.198', 'weapon2': '0.228', 'AMMO4': '0.246', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.742', 'WEAPON3': '1.050', 'weapon3': '2.590', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.812', 'FRAGCOUNT': '41.000'} [2023-02-25 13:52:43,102][36141] DAMAGECOUNT value on done: 565070.0 [2023-02-25 13:52:43,103][36141] Sum rewards: 55.474, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.271', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon4': '0.254', 'weapon2': '0.728', 'WEAPON3': '1.200', 'weapon3': '2.748', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '46.500'} [2023-02-25 13:52:43,200][36154] DAMAGECOUNT value on done: 558540.0 [2023-02-25 13:52:43,200][36154] Sum rewards: 61.385, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.180', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'weapon5': '0.090', 'weapon4': '0.106', 'AMMO4': '0.131', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.418', 'WEAPON3': '1.050', 'HITCOUNT': '3.160', 'weapon3': '3.180', 'DAMAGECOUNT': '15.318', 'FRAGCOUNT': '50.500'} [2023-02-25 13:52:43,378][36141] DAMAGECOUNT value on done: 552871.0 [2023-02-25 13:52:43,379][36141] Sum rewards: 59.587, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.516', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.012', 'weapon5': '0.044', 'AMMO4': '0.061', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.182', 'weapon2': '0.240', 'AMMO3': '0.275', 'WEAPON3': '1.650', 'HITCOUNT': '3.180', 'weapon3': '3.310', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '53.000'} [2023-02-25 13:52:43,542][36157] DAMAGECOUNT value on done: 570882.0 [2023-02-25 13:52:43,543][36157] Sum rewards: 52.997, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.764', 'AMMO5': '0.010', 'AMMO2': '0.040', 'AMMO3': '0.179', 'AMMO4': '0.202', 'weapon5': '0.212', 'weapon2': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.394', 'WEAPON3': '1.050', 'weapon3': '2.918', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.604', 'FRAGCOUNT': '43.000'} [2023-02-25 13:52:43,847][36157] DAMAGECOUNT value on done: 559258.0 [2023-02-25 13:52:43,847][36157] Sum rewards: 62.456, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.141', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon5': '0.070', 'AMMO4': '0.185', 'AMMO3': '0.189', 'weapon2': '0.224', 'weapon4': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.246', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '52.500'} [2023-02-25 13:52:44,467][36157] DAMAGECOUNT value on done: 568028.0 [2023-02-25 13:52:44,467][36157] Sum rewards: 62.898, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.010', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon5': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'weapon2': '0.312', 'weapon4': '0.394', 'WEAPON3': '1.200', 'weapon3': '2.988', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '53.000'} [2023-02-25 13:52:44,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 183091200. Throughput: 0: 3346.8. Samples: 8267382. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:52:44,729][36114] Avg episode reward: [(0, '54.103')] [2023-02-25 13:52:44,777][36157] DAMAGECOUNT value on done: 564138.0 [2023-02-25 13:52:44,778][36157] Sum rewards: 59.743, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.194', 'ARMOR': '0.012', 'AMMO5': '0.022', 'AMMO2': '0.040', 'AMMO3': '0.144', 'weapon5': '0.160', 'AMMO4': '0.202', 'weapon2': '0.390', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.718', 'WEAPON3': '0.850', 'weapon3': '2.478', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.140', 'FRAGCOUNT': '47.500'} [2023-02-25 13:52:45,019][36140] DAMAGECOUNT value on done: 568010.0 [2023-02-25 13:52:45,019][36140] Sum rewards: 45.460, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.174', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon2': '0.262', 'WEAPON4': '0.300', 'weapon4': '0.358', 'WEAPON3': '1.500', 'weapon3': '2.900', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.365', 'FRAGCOUNT': '42.000'} [2023-02-25 13:52:45,323][36140] DAMAGECOUNT value on done: 548559.0 [2023-02-25 13:52:45,324][36140] Sum rewards: 47.825, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.780', 'AMMO5': '0.014', 'AMMO2': '0.041', 'AMMO3': '0.185', 'AMMO4': '0.203', 'weapon5': '0.206', 'weapon4': '0.332', 'weapon2': '0.380', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.750', 'weapon3': '2.760', 'DAMAGECOUNT': '12.333', 'FRAGCOUNT': '43.500'} [2023-02-25 13:52:45,455][36138] Updated weights for policy 0, policy_version 44703 (0.0010) [2023-02-25 13:52:45,632][36140] DAMAGECOUNT value on done: 556896.0 [2023-02-25 13:52:45,633][36140] Sum rewards: 53.972, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.468', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.059', 'AMMO3': '0.151', 'weapon2': '0.276', 'AMMO4': '0.295', 'weapon5': '0.334', 'WEAPON5': '0.550', 'WEAPON4': '0.750', 'WEAPON3': '0.900', 'weapon4': '1.056', 'weapon3': '1.946', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.007', 'FRAGCOUNT': '48.000'} [2023-02-25 13:52:45,942][36140] DAMAGECOUNT value on done: 555969.0 [2023-02-25 13:52:45,943][36140] Sum rewards: 63.145, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.871', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.068', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'weapon4': '0.166', 'weapon2': '0.380', 'WEAPON3': '0.950', 'HITCOUNT': '3.140', 'weapon3': '3.210', 'DAMAGECOUNT': '14.190', 'FRAGCOUNT': '52.000'} [2023-02-25 13:52:46,675][36142] DAMAGECOUNT value on done: 563584.0 [2023-02-25 13:52:46,675][36142] Sum rewards: 57.070, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.570', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.092', 'AMMO4': '0.120', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.472', 'weapon2': '0.528', 'WEAPON3': '1.200', 'weapon3': '2.684', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '14.886', 'FRAGCOUNT': '49.000'} [2023-02-25 13:52:46,805][36142] DAMAGECOUNT value on done: 548066.0 [2023-02-25 13:52:46,806][36142] Sum rewards: 43.134, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.626', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.047', 'AMMO3': '0.130', 'AMMO4': '0.235', 'weapon2': '0.244', 'WEAPON5': '0.250', 'weapon5': '0.298', 'WEAPON4': '0.350', 'WEAPON3': '0.800', 'weapon4': '0.892', 'weapon3': '2.146', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '11.532', 'FRAGCOUNT': '35.500'} [2023-02-25 13:52:46,997][36142] DAMAGECOUNT value on done: 552246.0 [2023-02-25 13:52:46,998][36142] Sum rewards: 42.211, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.237', 'AMMO5': '0.011', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.124', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.256', 'weapon2': '0.622', 'WEAPON3': '1.100', 'HITCOUNT': '2.580', 'weapon3': '2.790', 'DAMAGECOUNT': '11.640', 'FRAGCOUNT': '38.500'} [2023-02-25 13:52:47,121][36142] DAMAGECOUNT value on done: 563178.0 [2023-02-25 13:52:47,122][36142] Sum rewards: 56.363, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.415', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.137', 'weapon5': '0.150', 'weapon4': '0.222', 'AMMO3': '0.247', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '2.890', 'weapon3': '3.086', 'DAMAGECOUNT': '14.940', 'FRAGCOUNT': '52.000'} [2023-02-25 13:52:47,797][36156] DAMAGECOUNT value on done: 567120.0 [2023-02-25 13:52:47,798][36156] Sum rewards: 67.026, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.302', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.012', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'WEAPON4': '0.150', 'AMMO3': '0.169', 'weapon4': '0.272', 'weapon2': '0.442', 'WEAPON3': '1.100', 'weapon3': '3.030', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '56.000'} [2023-02-25 13:52:47,829][36156] DAMAGECOUNT value on done: 569101.0 [2023-02-25 13:52:47,829][36156] Sum rewards: 58.305, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.632', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO3': '0.144', 'AMMO4': '0.164', 'weapon5': '0.228', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.464', 'weapon4': '0.628', 'WEAPON3': '0.900', 'weapon3': '2.310', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.792', 'FRAGCOUNT': '47.000'} [2023-02-25 13:52:48,119][36156] DAMAGECOUNT value on done: 554354.0 [2023-02-25 13:52:48,119][36156] Sum rewards: 45.808, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.720', 'AMMO5': '0.019', 'AMMO2': '0.064', 'weapon2': '0.208', 'AMMO3': '0.225', 'weapon5': '0.248', 'AMMO4': '0.319', 'weapon4': '0.554', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'HITCOUNT': '2.640', 'weapon3': '2.694', 'DAMAGECOUNT': '13.206', 'FRAGCOUNT': '44.000'} [2023-02-25 13:52:48,149][36156] DAMAGECOUNT value on done: 559686.0 [2023-02-25 13:52:48,149][36156] Sum rewards: 57.286, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.188', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'weapon2': '0.178', 'AMMO3': '0.180', 'weapon4': '0.218', 'ARMOR': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '3.100', 'weapon3': '3.280', 'DAMAGECOUNT': '14.817', 'FRAGCOUNT': '46.000'} [2023-02-25 13:52:48,499][36138] Updated weights for policy 0, policy_version 44713 (0.0009) [2023-02-25 13:52:49,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 183160832. Throughput: 0: 3352.8. Samples: 8287700. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:52:49,729][36114] Avg episode reward: [(0, '54.569')] [2023-02-25 13:52:51,517][36138] Updated weights for policy 0, policy_version 44723 (0.0010) [2023-02-25 13:52:53,000][36155] DAMAGECOUNT value on done: 551896.0 [2023-02-25 13:52:53,000][36155] Sum rewards: 41.191, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.250', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.058', 'AMMO3': '0.083', 'weapon7': '0.090', 'AMMO4': '0.109', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'weapon2': '0.638', 'weapon4': '1.138', 'weapon3': '1.492', 'HITCOUNT': '2.350', 'DAMAGECOUNT': '9.264', 'FRAGCOUNT': '34.000'} [2023-02-25 13:52:53,316][36155] DAMAGECOUNT value on done: 571918.0 [2023-02-25 13:52:53,316][36155] Sum rewards: 43.245, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.550', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.171', 'weapon5': '0.184', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.400', 'weapon4': '0.530', 'WEAPON3': '1.050', 'HITCOUNT': '2.650', 'weapon3': '2.668', 'DAMAGECOUNT': '11.427', 'FRAGCOUNT': '39.000'} [2023-02-25 13:52:53,924][36155] DAMAGECOUNT value on done: 566769.0 [2023-02-25 13:52:53,924][36155] Sum rewards: 40.452, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.150', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.124', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.284', 'WEAPON3': '0.800', 'weapon4': '0.840', 'HITCOUNT': '2.210', 'weapon3': '2.402', 'DAMAGECOUNT': '10.524', 'FRAGCOUNT': '34.000'} [2023-02-25 13:52:54,112][36139] DAMAGECOUNT value on done: 568108.0 [2023-02-25 13:52:54,112][36139] Sum rewards: 57.684, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.427', 'AMMO5': '0.011', 'AMMO2': '0.035', 'AMMO4': '0.175', 'AMMO3': '0.181', 'weapon5': '0.182', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.418', 'weapon4': '0.428', 'WEAPON3': '1.000', 'weapon3': '2.682', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.259', 'FRAGCOUNT': '48.000'} [2023-02-25 13:52:54,217][36155] DAMAGECOUNT value on done: 559893.0 [2023-02-25 13:52:54,218][36155] Sum rewards: 63.302, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.851', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.164', 'weapon5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.640', 'WEAPON3': '1.200', 'weapon3': '2.566', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.414', 'FRAGCOUNT': '55.000'} [2023-02-25 13:52:54,418][36139] DAMAGECOUNT value on done: 558745.0 [2023-02-25 13:52:54,418][36139] Sum rewards: 55.039, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.946', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.088', 'WEAPON5': '0.100', 'weapon2': '0.156', 'AMMO4': '0.178', 'AMMO3': '0.197', 'WEAPON4': '0.350', 'weapon4': '0.816', 'WEAPON3': '1.200', 'weapon3': '2.694', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '47.000'} [2023-02-25 13:52:54,527][36138] Updated weights for policy 0, policy_version 44733 (0.0009) [2023-02-25 13:52:54,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 183226368. Throughput: 0: 3357.6. Samples: 8297794. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:52:54,730][36114] Avg episode reward: [(0, '54.066')] [2023-02-25 13:52:54,844][36139] DAMAGECOUNT value on done: 568002.0 [2023-02-25 13:52:54,845][36139] Sum rewards: 56.379, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.862', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.164', 'AMMO3': '0.190', 'weapon2': '0.202', 'AMMO4': '0.213', 'WEAPON5': '0.300', 'WEAPON4': '0.550', 'weapon4': '0.942', 'WEAPON3': '1.150', 'weapon3': '2.104', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.701', 'FRAGCOUNT': '50.000'} [2023-02-25 13:52:55,168][36139] DAMAGECOUNT value on done: 565370.0 [2023-02-25 13:52:55,169][36139] Sum rewards: 50.230, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.385', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon5': '0.076', 'weapon2': '0.164', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'WEAPON4': '0.450', 'weapon4': '0.490', 'WEAPON3': '1.150', 'HITCOUNT': '2.780', 'weapon3': '3.084', 'DAMAGECOUNT': '13.311', 'FRAGCOUNT': '45.500'} [2023-02-25 13:52:57,607][36138] Updated weights for policy 0, policy_version 44743 (0.0010) [2023-02-25 13:52:59,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 183291904. Throughput: 0: 3361.9. Samples: 8318024. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:52:59,729][36114] Avg episode reward: [(0, '54.005')] [2023-02-25 13:53:00,275][36139] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 13:53:00,689][36138] Updated weights for policy 0, policy_version 44753 (0.0009) [2023-02-25 13:53:02,251][36154] DAMAGECOUNT value on done: 569218.0 [2023-02-25 13:53:02,251][36154] Sum rewards: 44.155, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.604', 'AMMO5': '0.014', 'ARMOR': '0.024', 'AMMO2': '0.045', 'weapon5': '0.134', 'AMMO3': '0.197', 'AMMO4': '0.223', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.426', 'weapon4': '0.460', 'WEAPON3': '1.050', 'HITCOUNT': '2.520', 'weapon3': '2.652', 'DAMAGECOUNT': '12.315', 'FRAGCOUNT': '39.000'} [2023-02-25 13:53:02,568][36154] DAMAGECOUNT value on done: 554678.0 [2023-02-25 13:53:02,569][36154] Sum rewards: 55.287, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.402', 'AMMO5': '0.007', 'AMMO2': '0.037', 'AMMO3': '0.120', 'weapon5': '0.134', 'weapon4': '0.172', 'AMMO4': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.658', 'WEAPON3': '0.950', 'HITCOUNT': '2.710', 'weapon3': '2.842', 'DAMAGECOUNT': '14.121', 'FRAGCOUNT': '45.000'} [2023-02-25 13:53:02,726][36141] DAMAGECOUNT value on done: 571249.0 [2023-02-25 13:53:02,727][36141] Sum rewards: 46.984, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.490', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.058', 'weapon5': '0.166', 'AMMO3': '0.196', 'AMMO4': '0.292', 'weapon2': '0.292', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.594', 'WEAPON3': '1.250', 'weapon3': '2.624', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.731', 'FRAGCOUNT': '43.000'} [2023-02-25 13:53:02,860][36154] DAMAGECOUNT value on done: 564116.0 [2023-02-25 13:53:02,861][36154] Sum rewards: 68.587, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.094', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.112', 'weapon5': '0.120', 'AMMO4': '0.135', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.428', 'WEAPON3': '1.150', 'weapon3': '3.100', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '57.000'} [2023-02-25 13:53:02,992][36141] DAMAGECOUNT value on done: 558338.0 [2023-02-25 13:53:02,992][36141] Sum rewards: 51.582, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.765', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.013', 'AMMO3': '0.227', 'weapon2': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.340', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '14.274', 'FRAGCOUNT': '43.000'} [2023-02-25 13:53:03,050][36141] DAMAGECOUNT value on done: 569890.0 [2023-02-25 13:53:03,050][36141] Sum rewards: 59.094, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.444', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon5': '0.108', 'AMMO3': '0.167', 'AMMO4': '0.230', 'weapon4': '0.348', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.490', 'WEAPON3': '1.050', 'weapon3': '2.804', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.460', 'FRAGCOUNT': '50.000'} [2023-02-25 13:53:03,175][36154] DAMAGECOUNT value on done: 563114.0 [2023-02-25 13:53:03,175][36154] Sum rewards: 45.637, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.550', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.096', 'AMMO4': '0.129', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon4': '0.252', 'WEAPON4': '0.300', 'weapon2': '0.582', 'WEAPON3': '1.250', 'weapon3': '2.856', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.254', 'FRAGCOUNT': '41.000'} [2023-02-25 13:53:03,312][36141] DAMAGECOUNT value on done: 557634.0 [2023-02-25 13:53:03,313][36141] Sum rewards: 45.312, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-4.290', 'AMMO5': '0.018', 'AMMO2': '0.057', 'weapon4': '0.176', 'weapon5': '0.192', 'AMMO3': '0.270', 'AMMO4': '0.286', 'weapon2': '0.300', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.650', 'HITCOUNT': '2.770', 'weapon3': '2.994', 'DAMAGECOUNT': '14.289', 'FRAGCOUNT': '45.000'} [2023-02-25 13:53:03,549][36157] DAMAGECOUNT value on done: 575729.0 [2023-02-25 13:53:03,549][36157] Sum rewards: 50.586, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.273', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.134', 'AMMO3': '0.138', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.436', 'weapon2': '0.580', 'WEAPON3': '0.900', 'weapon3': '2.614', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.460', 'FRAGCOUNT': '41.000'} [2023-02-25 13:53:03,772][36138] Updated weights for policy 0, policy_version 44763 (0.0009) [2023-02-25 13:53:03,853][36157] DAMAGECOUNT value on done: 563554.0 [2023-02-25 13:53:03,854][36157] Sum rewards: 51.556, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.170', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.054', 'AMMO4': '0.113', 'AMMO3': '0.183', 'weapon4': '0.212', 'weapon2': '0.286', 'WEAPON3': '1.000', 'HITCOUNT': '3.050', 'weapon3': '3.314', 'DAMAGECOUNT': '12.888', 'FRAGCOUNT': '41.000'} [2023-02-25 13:53:04,492][36157] DAMAGECOUNT value on done: 572415.0 [2023-02-25 13:53:04,492][36157] Sum rewards: 52.163, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.200', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.124', 'weapon5': '0.150', 'weapon4': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.482', 'WEAPON3': '0.900', 'weapon3': '2.894', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.161', 'FRAGCOUNT': '43.000'} [2023-02-25 13:53:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13426.6). Total num frames: 183361536. Throughput: 0: 3365.6. Samples: 8338082. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:53:04,729][36114] Avg episode reward: [(0, '53.507')] [2023-02-25 13:53:04,813][36157] DAMAGECOUNT value on done: 568740.0 [2023-02-25 13:53:04,813][36157] Sum rewards: 47.191, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.108', 'ARMOR': '0.008', 'AMMO5': '0.021', 'AMMO2': '0.056', 'AMMO3': '0.175', 'AMMO4': '0.279', 'weapon5': '0.330', 'weapon2': '0.370', 'weapon4': '0.452', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.000', 'weapon3': '2.352', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.806', 'FRAGCOUNT': '40.500'} [2023-02-25 13:53:05,119][36140] DAMAGECOUNT value on done: 571780.0 [2023-02-25 13:53:05,120][36140] Sum rewards: 42.360, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.180', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.039', 'AMMO3': '0.190', 'AMMO4': '0.193', 'weapon5': '0.200', 'weapon2': '0.386', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon4': '1.104', 'weapon3': '1.980', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '11.310', 'FRAGCOUNT': '40.000'} [2023-02-25 13:53:05,432][36140] DAMAGECOUNT value on done: 553378.0 [2023-02-25 13:53:05,432][36140] Sum rewards: 57.928, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.948', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.147', 'weapon5': '0.210', 'AMMO3': '0.213', 'weapon4': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.592', 'WEAPON3': '1.300', 'weapon3': '2.688', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.457', 'FRAGCOUNT': '51.000'} [2023-02-25 13:53:05,726][36140] DAMAGECOUNT value on done: 560861.0 [2023-02-25 13:53:05,726][36140] Sum rewards: 42.958, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.340', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.057', 'weapon5': '0.134', 'AMMO3': '0.161', 'AMMO4': '0.285', 'WEAPON5': '0.350', 'weapon4': '0.472', 'WEAPON4': '0.650', 'weapon2': '0.698', 'WEAPON3': '1.000', 'weapon3': '2.402', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '11.880', 'FRAGCOUNT': '41.000'} [2023-02-25 13:53:06,040][36140] DAMAGECOUNT value on done: 560573.0 [2023-02-25 13:53:06,040][36140] Sum rewards: 54.196, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.690', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon5': '0.130', 'AMMO3': '0.203', 'AMMO4': '0.234', 'WEAPON4': '0.350', 'weapon4': '0.384', 'WEAPON5': '0.400', 'weapon2': '0.492', 'WEAPON3': '1.250', 'weapon3': '2.716', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.812', 'FRAGCOUNT': '47.000'} [2023-02-25 13:53:06,669][36142] DAMAGECOUNT value on done: 568264.0 [2023-02-25 13:53:06,669][36142] Sum rewards: 55.666, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.862', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO4': '0.181', 'AMMO3': '0.184', 'weapon5': '0.232', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.404', 'weapon4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.524', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '14.040', 'FRAGCOUNT': '49.000'} [2023-02-25 13:53:06,760][36142] DAMAGECOUNT value on done: 552526.0 [2023-02-25 13:53:06,761][36142] Sum rewards: 51.291, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.780', 'ARMOR': '0.004', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO2': '0.026', 'weapon5': '0.072', 'WEAPON4': '0.100', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.242', 'weapon2': '0.358', 'WEAPON3': '1.400', 'HITCOUNT': '3.100', 'weapon3': '3.338', 'DAMAGECOUNT': '13.380', 'FRAGCOUNT': '45.000'} [2023-02-25 13:53:06,813][36138] Updated weights for policy 0, policy_version 44773 (0.0009) [2023-02-25 13:53:07,000][36142] DAMAGECOUNT value on done: 556636.0 [2023-02-25 13:53:07,000][36142] Sum rewards: 54.068, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.260', 'AMMO5': '0.014', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon4': '0.116', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'weapon5': '0.238', 'WEAPON5': '0.350', 'weapon2': '0.738', 'WEAPON3': '0.800', 'weapon3': '2.608', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '13.125', 'FRAGCOUNT': '43.000'} [2023-02-25 13:53:07,117][36142] DAMAGECOUNT value on done: 567446.0 [2023-02-25 13:53:07,118][36142] Sum rewards: 51.578, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.790', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO3': '0.269', 'weapon2': '0.354', 'WEAPON3': '1.450', 'HITCOUNT': '3.020', 'weapon3': '3.454', 'DAMAGECOUNT': '12.804', 'FRAGCOUNT': '46.000'} [2023-02-25 13:53:07,880][36156] DAMAGECOUNT value on done: 571887.0 [2023-02-25 13:53:07,881][36156] Sum rewards: 53.627, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.375', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.122', 'weapon5': '0.160', 'AMMO4': '0.181', 'AMMO3': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.984', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.301', 'FRAGCOUNT': '48.000'} [2023-02-25 13:53:07,901][36156] DAMAGECOUNT value on done: 573490.0 [2023-02-25 13:53:07,901][36156] Sum rewards: 46.084, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.076', 'AMMO5': '0.015', 'AMMO2': '0.047', 'AMMO3': '0.188', 'AMMO4': '0.234', 'weapon5': '0.320', 'weapon2': '0.350', 'WEAPON5': '0.450', 'ARMOR': '0.455', 'WEAPON4': '0.650', 'weapon4': '0.752', 'WEAPON3': '1.150', 'weapon3': '2.152', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.167', 'FRAGCOUNT': '42.000'} [2023-02-25 13:53:08,201][36156] DAMAGECOUNT value on done: 558117.0 [2023-02-25 13:53:08,201][36156] Sum rewards: 40.816, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.840', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon5': '0.058', 'weapon4': '0.080', 'AMMO4': '0.235', 'AMMO3': '0.247', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.388', 'WEAPON3': '1.450', 'HITCOUNT': '2.480', 'weapon3': '3.162', 'DAMAGECOUNT': '11.289', 'FRAGCOUNT': '40.000'} [2023-02-25 13:53:08,224][36156] DAMAGECOUNT value on done: 564145.0 [2023-02-25 13:53:08,225][36156] Sum rewards: 53.849, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.005', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.036', 'AMMO3': '0.130', 'AMMO4': '0.178', 'weapon5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.426', 'WEAPON5': '0.450', 'weapon4': '0.514', 'WEAPON3': '0.900', 'weapon3': '2.600', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.377', 'FRAGCOUNT': '44.000'} [2023-02-25 13:53:09,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 183427072. Throughput: 0: 3363.3. Samples: 8348116. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:53:09,730][36114] Avg episode reward: [(0, '53.037')] [2023-02-25 13:53:09,857][36138] Updated weights for policy 0, policy_version 44783 (0.0009) [2023-02-25 13:53:12,908][36138] Updated weights for policy 0, policy_version 44793 (0.0009) [2023-02-25 13:53:12,924][36155] DAMAGECOUNT value on done: 556467.0 [2023-02-25 13:53:12,924][36155] Sum rewards: 47.954, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.446', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon5': '0.184', 'AMMO3': '0.186', 'WEAPON5': '0.350', 'weapon4': '0.382', 'WEAPON4': '0.450', 'weapon2': '0.816', 'WEAPON3': '1.150', 'weapon3': '2.346', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.713', 'FRAGCOUNT': '43.000'} [2023-02-25 13:53:13,235][36155] DAMAGECOUNT value on done: 576755.0 [2023-02-25 13:53:13,236][36155] Sum rewards: 56.754, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.197', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon5': '0.182', 'weapon2': '0.222', 'AMMO3': '0.255', 'WEAPON5': '0.350', 'ARMOR': '0.457', 'WEAPON4': '0.600', 'weapon4': '0.852', 'WEAPON3': '1.450', 'weapon3': '2.390', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.511', 'FRAGCOUNT': '51.000'} [2023-02-25 13:53:13,842][36155] DAMAGECOUNT value on done: 571591.0 [2023-02-25 13:53:13,842][36155] Sum rewards: 53.221, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.576', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.012', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'weapon5': '0.114', 'weapon4': '0.164', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.350', 'HITCOUNT': '2.940', 'weapon3': '2.974', 'DAMAGECOUNT': '14.466', 'FRAGCOUNT': '46.000'} [2023-02-25 13:53:14,037][36139] DAMAGECOUNT value on done: 572257.0 [2023-02-25 13:53:14,037][36139] Sum rewards: 45.993, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.300', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.043', 'AMMO3': '0.179', 'AMMO4': '0.214', 'weapon5': '0.296', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.538', 'weapon2': '0.572', 'WEAPON3': '1.050', 'weapon3': '2.292', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.447', 'FRAGCOUNT': '39.000'} [2023-02-25 13:53:14,137][36155] DAMAGECOUNT value on done: 563922.0 [2023-02-25 13:53:14,137][36155] Sum rewards: 39.527, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.552', 'AMMO5': '0.020', 'AMMO2': '0.054', 'weapon5': '0.202', 'AMMO3': '0.225', 'AMMO4': '0.271', 'weapon2': '0.286', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'weapon4': '0.840', 'WEAPON3': '1.300', 'weapon3': '2.344', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '12.087', 'FRAGCOUNT': '38.000'} [2023-02-25 13:53:14,336][36139] DAMAGECOUNT value on done: 564105.0 [2023-02-25 13:53:14,337][36139] Sum rewards: 60.940, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.402', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.426', 'weapon4': '0.470', 'WEAPON3': '1.400', 'weapon3': '2.670', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '53.000'} [2023-02-25 13:53:14,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 183492608. Throughput: 0: 3365.2. Samples: 8368300. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:53:14,730][36114] Avg episode reward: [(0, '52.758')] [2023-02-25 13:53:14,770][36139] DAMAGECOUNT value on done: 572793.0 [2023-02-25 13:53:14,770][36139] Sum rewards: 53.019, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.270', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.110', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'weapon5': '0.236', 'WEAPON5': '0.250', 'weapon2': '0.286', 'weapon4': '0.352', 'WEAPON3': '1.400', 'weapon3': '2.798', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.373', 'FRAGCOUNT': '45.500'} [2023-02-25 13:53:15,070][36139] DAMAGECOUNT value on done: 570296.0 [2023-02-25 13:53:15,070][36139] Sum rewards: 54.889, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.815', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.044', 'AMMO4': '0.045', 'weapon4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.249', 'weapon2': '0.356', 'WEAPON3': '1.500', 'HITCOUNT': '3.310', 'weapon3': '3.348', 'DAMAGECOUNT': '14.589', 'FRAGCOUNT': '48.000'} [2023-02-25 13:53:15,205][36139] Large shaping reward 2.582 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.552, 184.0)] [2023-02-25 13:53:15,955][36138] Updated weights for policy 0, policy_version 44803 (0.0009) [2023-02-25 13:53:18,999][36138] Updated weights for policy 0, policy_version 44813 (0.0009) [2023-02-25 13:53:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 183562240. Throughput: 0: 3360.3. Samples: 8388392. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:53:19,730][36114] Avg episode reward: [(0, '52.709')] [2023-02-25 13:53:19,733][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000044815_183562240.pth... [2023-02-25 13:53:19,791][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000044030_180346880.pth [2023-02-25 13:53:22,015][36138] Updated weights for policy 0, policy_version 44823 (0.0009) [2023-02-25 13:53:22,298][36154] DAMAGECOUNT value on done: 573638.0 [2023-02-25 13:53:22,299][36154] Sum rewards: 49.733, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.060', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon4': '0.180', 'weapon5': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.267', 'weapon2': '0.496', 'WEAPON3': '1.550', 'HITCOUNT': '2.690', 'weapon3': '2.850', 'DAMAGECOUNT': '13.260', 'FRAGCOUNT': '44.000'} [2023-02-25 13:53:22,610][36154] DAMAGECOUNT value on done: 559074.0 [2023-02-25 13:53:22,611][36154] Sum rewards: 50.968, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.110', 'AMMO5': '0.016', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.154', 'AMMO3': '0.204', 'weapon2': '0.222', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'ARMOR': '0.456', 'weapon4': '0.616', 'WEAPON3': '1.150', 'weapon3': '2.632', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.188', 'FRAGCOUNT': '44.000'} [2023-02-25 13:53:22,780][36141] DAMAGECOUNT value on done: 575564.0 [2023-02-25 13:53:22,781][36141] Sum rewards: 47.647, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.866', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon5': '0.118', 'AMMO4': '0.121', 'AMMO3': '0.169', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.388', 'weapon2': '0.476', 'WEAPON3': '1.100', 'HITCOUNT': '2.570', 'weapon3': '2.788', 'DAMAGECOUNT': '12.945', 'FRAGCOUNT': '41.000'} [2023-02-25 13:53:22,885][36154] DAMAGECOUNT value on done: 568922.0 [2023-02-25 13:53:22,886][36154] Sum rewards: 52.098, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.038', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.132', 'weapon4': '0.146', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'weapon2': '0.202', 'AMMO3': '0.268', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '2.700', 'weapon3': '3.192', 'DAMAGECOUNT': '14.418', 'FRAGCOUNT': '48.000'} [2023-02-25 13:53:23,049][36141] DAMAGECOUNT value on done: 563051.0 [2023-02-25 13:53:23,050][36141] Sum rewards: 51.798, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.038', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.047', 'weapon4': '0.106', 'AMMO3': '0.196', 'AMMO4': '0.237', 'weapon5': '0.262', 'WEAPON4': '0.350', 'weapon2': '0.360', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.650', 'weapon3': '2.916', 'DAMAGECOUNT': '14.139', 'FRAGCOUNT': '46.000'} [2023-02-25 13:53:23,108][36141] DAMAGECOUNT value on done: 573927.0 [2023-02-25 13:53:23,109][36141] Sum rewards: 49.425, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.722', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'AMMO4': '0.178', 'WEAPON4': '0.200', 'weapon2': '0.570', 'weapon4': '0.628', 'WEAPON3': '0.950', 'weapon3': '2.548', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.111', 'FRAGCOUNT': '41.000'} [2023-02-25 13:53:23,198][36154] DAMAGECOUNT value on done: 567242.0 [2023-02-25 13:53:23,199][36154] Sum rewards: 49.848, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.557', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon4': '0.108', 'AMMO4': '0.117', 'weapon5': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'WEAPON5': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.400', 'HITCOUNT': '2.700', 'weapon3': '3.078', 'DAMAGECOUNT': '12.384', 'FRAGCOUNT': '45.000'} [2023-02-25 13:53:23,376][36141] DAMAGECOUNT value on done: 561916.0 [2023-02-25 13:53:23,376][36141] Sum rewards: 46.185, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.566', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.110', 'AMMO3': '0.170', 'AMMO4': '0.185', 'WEAPON5': '0.300', 'weapon4': '0.472', 'WEAPON4': '0.500', 'weapon2': '0.754', 'WEAPON3': '1.050', 'weapon3': '2.428', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '12.846', 'FRAGCOUNT': '41.000'} [2023-02-25 13:53:23,585][36157] DAMAGECOUNT value on done: 579984.0 [2023-02-25 13:53:23,585][36157] Sum rewards: 49.080, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.550', 'ARMOR': '0.004', 'weapon5': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.047', 'AMMO3': '0.153', 'WEAPON5': '0.200', 'AMMO4': '0.233', 'weapon2': '0.428', 'WEAPON4': '0.500', 'weapon4': '0.828', 'WEAPON3': '0.900', 'weapon3': '2.310', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '12.765', 'FRAGCOUNT': '41.000'} [2023-02-25 13:53:23,876][36157] DAMAGECOUNT value on done: 568527.0 [2023-02-25 13:53:23,876][36157] Sum rewards: 59.149, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.626', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.018', 'weapon4': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.250', 'weapon2': '0.376', 'WEAPON3': '1.550', 'HITCOUNT': '3.170', 'weapon3': '3.306', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '52.000'} [2023-02-25 13:53:24,589][36157] DAMAGECOUNT value on done: 578053.0 [2023-02-25 13:53:24,589][36157] Sum rewards: 63.572, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.900', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon4': '0.078', 'AMMO4': '0.112', 'weapon5': '0.130', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.626', 'WEAPON3': '1.150', 'weapon3': '2.940', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '52.000'} [2023-02-25 13:53:24,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 183627776. Throughput: 0: 3359.1. Samples: 8398424. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:53:24,730][36114] Avg episode reward: [(0, '52.407')] [2023-02-25 13:53:24,906][36157] DAMAGECOUNT value on done: 574295.0 [2023-02-25 13:53:24,907][36157] Sum rewards: 67.664, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.000', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.019', 'weapon5': '0.048', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.188', 'weapon2': '0.366', 'weapon4': '0.388', 'WEAPON3': '1.200', 'weapon3': '2.948', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '56.000'} [2023-02-25 13:53:25,071][36138] Updated weights for policy 0, policy_version 44833 (0.0009) [2023-02-25 13:53:25,259][36140] DAMAGECOUNT value on done: 576965.0 [2023-02-25 13:53:25,259][36140] Sum rewards: 59.136, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.112', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon5': '0.134', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon4': '0.290', 'weapon2': '0.340', 'WEAPON3': '1.450', 'weapon3': '2.962', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '52.000'} [2023-02-25 13:53:25,564][36140] DAMAGECOUNT value on done: 558364.0 [2023-02-25 13:53:25,565][36140] Sum rewards: 55.095, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.038', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.122', 'weapon2': '0.180', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.398', 'WEAPON3': '1.150', 'weapon3': '2.966', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.958', 'FRAGCOUNT': '47.000'} [2023-02-25 13:53:25,861][36140] DAMAGECOUNT value on done: 566388.0 [2023-02-25 13:53:25,862][36140] Sum rewards: 64.858, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.706', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.054', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'weapon4': '0.176', 'WEAPON4': '0.250', 'AMMO3': '0.260', 'weapon2': '0.328', 'WEAPON3': '1.550', 'weapon3': '3.204', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '58.000'} [2023-02-25 13:53:26,163][36140] DAMAGECOUNT value on done: 565698.0 [2023-02-25 13:53:26,164][36140] Sum rewards: 60.008, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.380', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.104', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon4': '0.272', 'weapon2': '0.384', 'WEAPON3': '1.200', 'weapon3': '3.044', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '51.000'} [2023-02-25 13:53:26,743][36142] DAMAGECOUNT value on done: 573159.0 [2023-02-25 13:53:26,744][36142] Sum rewards: 50.215, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.373', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.102', 'AMMO4': '0.112', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.338', 'weapon2': '0.346', 'WEAPON3': '1.450', 'weapon3': '2.994', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.685', 'FRAGCOUNT': '44.000'} [2023-02-25 13:53:26,833][36142] DAMAGECOUNT value on done: 558183.0 [2023-02-25 13:53:26,833][36142] Sum rewards: 61.525, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.254', 'ARMOR': '0.013', 'AMMO5': '0.015', 'AMMO2': '0.056', 'AMMO3': '0.159', 'weapon5': '0.194', 'AMMO4': '0.279', 'weapon2': '0.410', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'weapon4': '0.692', 'WEAPON3': '1.000', 'weapon3': '2.460', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.971', 'FRAGCOUNT': '50.000'} [2023-02-25 13:53:27,054][36142] DAMAGECOUNT value on done: 562123.0 [2023-02-25 13:53:27,055][36142] Sum rewards: 61.399, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.834', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.134', 'weapon4': '0.196', 'AMMO3': '0.238', 'weapon2': '0.442', 'WEAPON3': '1.500', 'weapon3': '3.004', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '52.000'} [2023-02-25 13:53:27,145][36142] DAMAGECOUNT value on done: 572241.0 [2023-02-25 13:53:27,146][36142] Sum rewards: 54.020, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.624', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon5': '0.092', 'AMMO4': '0.187', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.358', 'ARMOR': '0.400', 'weapon2': '0.414', 'WEAPON3': '1.300', 'weapon3': '2.798', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.385', 'FRAGCOUNT': '48.000'} [2023-02-25 13:53:28,017][36156] DAMAGECOUNT value on done: 576577.0 [2023-02-25 13:53:28,017][36156] Sum rewards: 53.384, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.286', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'weapon4': '0.064', 'weapon5': '0.090', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'weapon2': '0.462', 'WEAPON3': '1.250', 'HITCOUNT': '2.920', 'weapon3': '3.166', 'DAMAGECOUNT': '13.770', 'FRAGCOUNT': '46.000'} [2023-02-25 13:53:28,039][36156] DAMAGECOUNT value on done: 579761.0 [2023-02-25 13:53:28,040][36156] Sum rewards: 68.465, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.918', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.162', 'AMMO3': '0.261', 'weapon4': '0.286', 'WEAPON3': '1.550', 'weapon3': '3.070', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.813', 'FRAGCOUNT': '58.000'} [2023-02-25 13:53:28,103][36138] Updated weights for policy 0, policy_version 44843 (0.0009) [2023-02-25 13:53:28,340][36156] DAMAGECOUNT value on done: 563683.0 [2023-02-25 13:53:28,340][36156] Sum rewards: 59.907, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.140', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon4': '0.076', 'AMMO4': '0.141', 'weapon5': '0.178', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.456', 'WEAPON3': '1.400', 'weapon3': '2.984', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '52.000'} [2023-02-25 13:53:28,370][36156] DAMAGECOUNT value on done: 569486.0 [2023-02-25 13:53:28,371][36156] Sum rewards: 64.951, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.770', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO2': '0.019', 'weapon4': '0.084', 'AMMO4': '0.093', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.464', 'WEAPON3': '1.350', 'weapon3': '3.256', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '56.000'} [2023-02-25 13:53:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 183697408. Throughput: 0: 3360.6. Samples: 8418610. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 13:53:29,729][36114] Avg episode reward: [(0, '53.093')] [2023-02-25 13:53:31,136][36138] Updated weights for policy 0, policy_version 44853 (0.0009) [2023-02-25 13:53:32,841][36155] DAMAGECOUNT value on done: 561457.0 [2023-02-25 13:53:32,841][36155] Sum rewards: 54.675, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.040', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.148', 'weapon5': '0.182', 'WEAPON5': '0.300', 'weapon2': '0.338', 'WEAPON4': '0.500', 'weapon4': '0.792', 'WEAPON3': '0.950', 'weapon3': '2.286', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.970', 'FRAGCOUNT': '46.000'} [2023-02-25 13:53:33,150][36155] DAMAGECOUNT value on done: 581576.0 [2023-02-25 13:53:33,151][36155] Sum rewards: 59.581, reward structure: {'DEATHCOUNT': '-12.750', 'ARMOR': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'weapon5': '0.084', 'AMMO4': '0.157', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'HEALTH': '0.324', 'weapon4': '0.454', 'weapon2': '0.498', 'WEAPON3': '0.950', 'weapon3': '2.690', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.463', 'FRAGCOUNT': '49.000'} [2023-02-25 13:53:33,721][36155] DAMAGECOUNT value on done: 575698.0 [2023-02-25 13:53:33,721][36155] Sum rewards: 47.212, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.632', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.043', 'AMMO3': '0.150', 'weapon5': '0.154', 'AMMO4': '0.215', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON4': '0.550', 'weapon4': '0.900', 'WEAPON3': '0.950', 'weapon3': '2.272', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.321', 'FRAGCOUNT': '40.000'} [2023-02-25 13:53:33,998][36139] DAMAGECOUNT value on done: 577030.0 [2023-02-25 13:53:33,998][36139] Sum rewards: 57.855, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.262', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.044', 'AMMO3': '0.127', 'weapon5': '0.212', 'AMMO4': '0.219', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON4': '0.500', 'weapon4': '0.680', 'WEAPON3': '0.800', 'weapon3': '2.530', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '14.319', 'FRAGCOUNT': '49.000'} [2023-02-25 13:53:34,026][36155] DAMAGECOUNT value on done: 568225.0 [2023-02-25 13:53:34,026][36155] Sum rewards: 53.961, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.744', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.090', 'AMMO3': '0.134', 'AMMO4': '0.138', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.538', 'weapon2': '0.674', 'WEAPON3': '0.850', 'weapon3': '2.550', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.909', 'FRAGCOUNT': '44.000'} [2023-02-25 13:53:34,182][36138] Updated weights for policy 0, policy_version 44863 (0.0009) [2023-02-25 13:53:34,315][36139] DAMAGECOUNT value on done: 569443.0 [2023-02-25 13:53:34,315][36139] Sum rewards: 62.761, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.496', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.107', 'AMMO3': '0.198', 'weapon5': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.350', 'weapon4': '0.432', 'WEAPON3': '1.300', 'weapon3': '2.786', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.014', 'FRAGCOUNT': '56.000'} [2023-02-25 13:53:34,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 183762944. Throughput: 0: 3359.6. Samples: 8438884. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:53:34,730][36114] Avg episode reward: [(0, '53.364')] [2023-02-25 13:53:34,777][36139] DAMAGECOUNT value on done: 577469.0 [2023-02-25 13:53:34,778][36139] Sum rewards: 56.039, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.272', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.031', 'AMMO3': '0.153', 'AMMO4': '0.153', 'weapon5': '0.234', 'weapon2': '0.380', 'WEAPON4': '0.450', 'weapon4': '0.560', 'WEAPON5': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.558', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '48.000'} [2023-02-25 13:53:35,076][36139] DAMAGECOUNT value on done: 573798.0 [2023-02-25 13:53:35,076][36139] Sum rewards: 31.600, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.897', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.033', 'AMMO4': '0.163', 'AMMO3': '0.200', 'weapon2': '0.222', 'weapon5': '0.224', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.832', 'WEAPON3': '1.100', 'weapon3': '2.236', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '10.506', 'FRAGCOUNT': '31.000'} [2023-02-25 13:53:37,211][36138] Updated weights for policy 0, policy_version 44873 (0.0009) [2023-02-25 13:53:39,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13426.6). Total num frames: 183832576. Throughput: 0: 3361.3. Samples: 8449052. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:53:39,729][36114] Avg episode reward: [(0, '53.270')] [2023-02-25 13:53:40,251][36138] Updated weights for policy 0, policy_version 44883 (0.0010) [2023-02-25 13:53:42,140][36154] DAMAGECOUNT value on done: 577917.0 [2023-02-25 13:53:42,140][36154] Sum rewards: 51.006, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.392', 'AMMO5': '0.013', 'AMMO2': '0.036', 'AMMO3': '0.160', 'AMMO4': '0.180', 'weapon5': '0.204', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.472', 'weapon2': '0.498', 'WEAPON3': '0.900', 'weapon3': '2.528', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '12.837', 'FRAGCOUNT': '43.000'} [2023-02-25 13:53:42,449][36154] DAMAGECOUNT value on done: 564158.0 [2023-02-25 13:53:42,449][36154] Sum rewards: 60.513, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.207', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.081', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.370', 'WEAPON3': '1.350', 'HITCOUNT': '3.050', 'weapon3': '3.262', 'DAMAGECOUNT': '15.252', 'FRAGCOUNT': '52.000'} [2023-02-25 13:53:42,716][36154] DAMAGECOUNT value on done: 573028.0 [2023-02-25 13:53:42,716][36154] Sum rewards: 49.734, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.900', 'ARMOR': '0.009', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.058', 'AMMO4': '0.151', 'AMMO3': '0.217', 'WEAPON5': '0.300', 'weapon4': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.462', 'WEAPON3': '1.350', 'weapon3': '2.796', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.318', 'FRAGCOUNT': '47.000'} [2023-02-25 13:53:42,750][36141] DAMAGECOUNT value on done: 580306.0 [2023-02-25 13:53:42,750][36141] Sum rewards: 55.069, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.174', 'ARMOR': '0.004', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.045', 'AMMO3': '0.168', 'weapon5': '0.198', 'AMMO4': '0.225', 'WEAPON5': '0.350', 'weapon2': '0.380', 'WEAPON4': '0.450', 'weapon4': '0.666', 'WEAPON3': '1.000', 'weapon3': '2.266', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.226', 'FRAGCOUNT': '48.000'} [2023-02-25 13:53:43,008][36154] DAMAGECOUNT value on done: 572176.0 [2023-02-25 13:53:43,008][36154] Sum rewards: 55.769, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.602', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.094', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'weapon2': '0.158', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'weapon4': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.618', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.802', 'FRAGCOUNT': '47.000'} [2023-02-25 13:53:43,009][36141] DAMAGECOUNT value on done: 567985.0 [2023-02-25 13:53:43,010][36141] Sum rewards: 51.398, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.210', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.094', 'weapon2': '0.194', 'AMMO3': '0.206', 'AMMO4': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon4': '0.696', 'WEAPON3': '1.300', 'weapon3': '2.722', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.802', 'FRAGCOUNT': '46.000'} [2023-02-25 13:53:43,065][36141] DAMAGECOUNT value on done: 579064.0 [2023-02-25 13:53:43,065][36141] Sum rewards: 65.050, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.095', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon5': '0.128', 'AMMO3': '0.150', 'AMMO4': '0.220', 'weapon2': '0.234', 'weapon4': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.900', 'weapon3': '3.042', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.411', 'FRAGCOUNT': '54.000'} [2023-02-25 13:53:43,284][36138] Updated weights for policy 0, policy_version 44893 (0.0009) [2023-02-25 13:53:43,329][36141] DAMAGECOUNT value on done: 566588.0 [2023-02-25 13:53:43,329][36141] Sum rewards: 51.080, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.922', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.092', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'weapon2': '0.236', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon4': '1.000', 'WEAPON3': '1.400', 'weapon3': '2.256', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '14.016', 'FRAGCOUNT': '46.000'} [2023-02-25 13:53:43,492][36157] DAMAGECOUNT value on done: 584924.0 [2023-02-25 13:53:43,492][36157] Sum rewards: 54.660, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.350', 'AMMO5': '0.013', 'AMMO2': '0.052', 'AMMO3': '0.121', 'weapon5': '0.170', 'AMMO4': '0.260', 'WEAPON5': '0.400', 'WEAPON4': '0.650', 'weapon2': '0.750', 'WEAPON3': '0.900', 'weapon4': '0.960', 'weapon3': '1.854', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.820', 'FRAGCOUNT': '45.000'} [2023-02-25 13:53:43,794][36157] DAMAGECOUNT value on done: 574412.0 [2023-02-25 13:53:43,794][36157] Sum rewards: 71.416, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.460', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.052', 'weapon4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.124', 'weapon2': '0.228', 'AMMO3': '0.232', 'WEAPON3': '1.500', 'weapon3': '3.352', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '62.000'} [2023-02-25 13:53:43,973][36141] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 13:53:44,496][36157] DAMAGECOUNT value on done: 582084.0 [2023-02-25 13:53:44,497][36157] Sum rewards: 48.687, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.042', 'AMMO5': '0.003', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.052', 'WEAPON4': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.191', 'weapon4': '0.338', 'weapon2': '0.548', 'WEAPON3': '1.100', 'HITCOUNT': '2.660', 'weapon3': '2.862', 'DAMAGECOUNT': '12.093', 'FRAGCOUNT': '42.000'} [2023-02-25 13:53:44,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 183898112. Throughput: 0: 3361.0. Samples: 8469270. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:53:44,730][36114] Avg episode reward: [(0, '53.659')] [2023-02-25 13:53:44,793][36157] DAMAGECOUNT value on done: 578289.0 [2023-02-25 13:53:44,794][36157] Sum rewards: 42.659, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.139', 'ARMOR': '0.004', 'AMMO5': '0.030', 'AMMO2': '0.068', 'AMMO3': '0.124', 'AMMO4': '0.340', 'weapon5': '0.356', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'weapon2': '0.610', 'WEAPON3': '0.700', 'weapon4': '0.876', 'weapon3': '1.758', 'HITCOUNT': '2.350', 'DAMAGECOUNT': '11.982', 'FRAGCOUNT': '36.000'} [2023-02-25 13:53:45,143][36140] DAMAGECOUNT value on done: 581344.0 [2023-02-25 13:53:45,143][36140] Sum rewards: 51.746, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.410', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.094', 'AMMO4': '0.095', 'AMMO3': '0.183', 'weapon2': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.252', 'WEAPON3': '1.200', 'HITCOUNT': '2.970', 'weapon3': '3.220', 'DAMAGECOUNT': '13.137', 'FRAGCOUNT': '45.000'} [2023-02-25 13:53:45,476][36140] DAMAGECOUNT value on done: 563286.0 [2023-02-25 13:53:45,477][36140] Sum rewards: 60.734, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.132', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.130', 'weapon2': '0.178', 'AMMO4': '0.194', 'AMMO3': '0.240', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.638', 'WEAPON3': '1.350', 'weapon3': '2.806', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.766', 'FRAGCOUNT': '55.000'} [2023-02-25 13:53:45,790][36140] DAMAGECOUNT value on done: 571480.0 [2023-02-25 13:53:45,791][36140] Sum rewards: 58.889, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.960', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.073', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'weapon2': '0.302', 'weapon4': '0.380', 'WEAPON3': '1.100', 'weapon3': '3.028', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.276', 'FRAGCOUNT': '48.000'} [2023-02-25 13:53:46,107][36140] DAMAGECOUNT value on done: 570999.0 [2023-02-25 13:53:46,107][36140] Sum rewards: 60.440, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.828', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.067', 'AMMO3': '0.163', 'weapon5': '0.194', 'weapon2': '0.324', 'AMMO4': '0.336', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'weapon4': '0.876', 'WEAPON3': '0.950', 'weapon3': '2.326', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.600', 'FRAGCOUNT': '51.000'} [2023-02-25 13:53:46,368][36138] Updated weights for policy 0, policy_version 44903 (0.0009) [2023-02-25 13:53:46,554][36142] DAMAGECOUNT value on done: 577736.0 [2023-02-25 13:53:46,555][36142] Sum rewards: 52.542, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.745', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon5': '0.116', 'AMMO4': '0.197', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon4': '0.696', 'weapon2': '0.874', 'WEAPON3': '1.300', 'weapon3': '2.000', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.731', 'FRAGCOUNT': '49.000'} [2023-02-25 13:53:46,616][36142] DAMAGECOUNT value on done: 563373.0 [2023-02-25 13:53:46,617][36142] Sum rewards: 54.446, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.257', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon5': '0.134', 'AMMO3': '0.230', 'AMMO4': '0.245', 'weapon2': '0.338', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.714', 'WEAPON3': '1.450', 'weapon3': '2.500', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '49.000'} [2023-02-25 13:53:46,876][36142] DAMAGECOUNT value on done: 565805.0 [2023-02-25 13:53:46,876][36142] Sum rewards: 42.575, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.877', 'AMMO5': '0.006', 'AMMO2': '0.023', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon5': '0.204', 'AMMO3': '0.215', 'weapon2': '0.402', 'weapon4': '0.452', 'WEAPON3': '1.250', 'HITCOUNT': '2.670', 'weapon3': '2.720', 'DAMAGECOUNT': '11.046', 'FRAGCOUNT': '39.000'} [2023-02-25 13:53:46,948][36142] DAMAGECOUNT value on done: 576362.0 [2023-02-25 13:53:46,949][36142] Sum rewards: 56.630, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.084', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.082', 'AMMO4': '0.085', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.214', 'weapon4': '0.234', 'weapon2': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.970', 'weapon3': '3.044', 'DAMAGECOUNT': '12.363', 'FRAGCOUNT': '51.000'} [2023-02-25 13:53:48,020][36156] DAMAGECOUNT value on done: 581265.0 [2023-02-25 13:53:48,021][36156] Sum rewards: 56.348, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.648', 'AMMO5': '0.014', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon2': '0.188', 'AMMO3': '0.196', 'weapon5': '0.204', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '1.020', 'WEAPON3': '1.150', 'weapon3': '2.280', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '14.064', 'FRAGCOUNT': '49.500'} [2023-02-25 13:53:48,047][36156] DAMAGECOUNT value on done: 583898.0 [2023-02-25 13:53:48,047][36156] Sum rewards: 52.045, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.134', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.154', 'AMMO3': '0.172', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.482', 'weapon4': '0.554', 'WEAPON3': '1.000', 'weapon3': '2.534', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.411', 'FRAGCOUNT': '45.000'} [2023-02-25 13:53:48,313][36156] DAMAGECOUNT value on done: 569394.0 [2023-02-25 13:53:48,313][36156] Sum rewards: 73.498, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.402', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO3': '0.139', 'weapon5': '0.158', 'AMMO4': '0.162', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON4': '0.350', 'weapon4': '0.536', 'WEAPON3': '0.850', 'weapon3': '2.772', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '59.000'} [2023-02-25 13:53:48,343][36156] DAMAGECOUNT value on done: 574077.0 [2023-02-25 13:53:48,343][36156] Sum rewards: 55.544, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.705', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.112', 'weapon4': '0.128', 'weapon2': '0.136', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'WEAPON3': '1.300', 'HITCOUNT': '2.890', 'weapon3': '3.356', 'DAMAGECOUNT': '13.773', 'FRAGCOUNT': '49.000'} [2023-02-25 13:53:49,415][36138] Updated weights for policy 0, policy_version 44913 (0.0010) [2023-02-25 13:53:49,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13426.6). Total num frames: 183967744. Throughput: 0: 3362.2. Samples: 8489382. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:53:49,730][36114] Avg episode reward: [(0, '53.771')] [2023-02-25 13:53:52,444][36138] Updated weights for policy 0, policy_version 44923 (0.0009) [2023-02-25 13:53:52,828][36155] DAMAGECOUNT value on done: 566044.0 [2023-02-25 13:53:52,829][36155] Sum rewards: 54.236, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.770', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.127', 'weapon2': '0.172', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon4': '0.838', 'WEAPON3': '1.350', 'weapon3': '2.596', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '13.761', 'FRAGCOUNT': '47.000'} [2023-02-25 13:53:53,132][36155] DAMAGECOUNT value on done: 586738.0 [2023-02-25 13:53:53,133][36155] Sum rewards: 62.604, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.036', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.157', 'weapon5': '0.174', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.256', 'weapon4': '0.644', 'WEAPON3': '0.950', 'weapon3': '2.520', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '51.000'} [2023-02-25 13:53:53,638][36155] DAMAGECOUNT value on done: 581217.0 [2023-02-25 13:53:53,639][36155] Sum rewards: 61.000, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.882', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.056', 'weapon5': '0.164', 'AMMO3': '0.166', 'weapon2': '0.270', 'AMMO4': '0.282', 'WEAPON5': '0.400', 'weapon4': '0.428', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.700', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '53.000'} [2023-02-25 13:53:53,927][36139] DAMAGECOUNT value on done: 582010.0 [2023-02-25 13:53:53,927][36139] Sum rewards: 62.063, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.957', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.052', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'weapon4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.233', 'weapon2': '0.362', 'WEAPON3': '1.400', 'HITCOUNT': '3.090', 'weapon3': '3.240', 'DAMAGECOUNT': '14.940', 'FRAGCOUNT': '55.000'} [2023-02-25 13:53:53,940][36155] DAMAGECOUNT value on done: 573332.0 [2023-02-25 13:53:53,940][36155] Sum rewards: 59.814, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.430', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.198', 'weapon4': '0.240', 'weapon2': '0.542', 'WEAPON3': '1.250', 'weapon3': '2.948', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.321', 'FRAGCOUNT': '50.000'} [2023-02-25 13:53:54,236][36139] DAMAGECOUNT value on done: 574001.0 [2023-02-25 13:53:54,236][36139] Sum rewards: 55.093, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.095', 'AMMO5': '0.018', 'AMMO2': '0.052', 'weapon5': '0.064', 'AMMO3': '0.179', 'AMMO4': '0.259', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.504', 'weapon4': '0.522', 'WEAPON3': '1.100', 'weapon3': '2.656', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '13.674', 'FRAGCOUNT': '49.000'} [2023-02-25 13:53:54,710][36139] DAMAGECOUNT value on done: 581797.0 [2023-02-25 13:53:54,710][36139] Sum rewards: 46.371, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.790', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon7': '0.060', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'weapon2': '0.156', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'AMMO3': '0.230', 'WEAPON4': '0.350', 'weapon4': '0.986', 'WEAPON3': '1.450', 'weapon3': '2.500', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.984', 'FRAGCOUNT': '43.000'} [2023-02-25 13:53:54,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13426.6). Total num frames: 184033280. Throughput: 0: 3364.2. Samples: 8499506. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:53:54,730][36114] Avg episode reward: [(0, '54.250')] [2023-02-25 13:53:55,015][36139] DAMAGECOUNT value on done: 578339.0 [2023-02-25 13:53:55,015][36139] Sum rewards: 49.444, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.140', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.075', 'AMMO3': '0.158', 'weapon5': '0.288', 'weapon2': '0.342', 'AMMO4': '0.373', 'WEAPON5': '0.500', 'WEAPON4': '0.800', 'WEAPON3': '0.950', 'weapon4': '0.970', 'weapon3': '2.032', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.623', 'FRAGCOUNT': '45.000'} [2023-02-25 13:53:55,522][36138] Updated weights for policy 0, policy_version 44933 (0.0009) [2023-02-25 13:53:58,562][36138] Updated weights for policy 0, policy_version 44943 (0.0010) [2023-02-25 13:53:59,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 184098816. Throughput: 0: 3363.6. Samples: 8519664. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:53:59,729][36114] Avg episode reward: [(0, '54.167')] [2023-02-25 13:54:01,620][36138] Updated weights for policy 0, policy_version 44953 (0.0009) [2023-02-25 13:54:02,212][36154] DAMAGECOUNT value on done: 582562.0 [2023-02-25 13:54:02,213][36154] Sum rewards: 49.251, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.365', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon2': '0.198', 'weapon5': '0.206', 'AMMO3': '0.248', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.772', 'WEAPON3': '1.450', 'weapon3': '2.524', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.935', 'FRAGCOUNT': '45.000'} [2023-02-25 13:54:02,544][36154] DAMAGECOUNT value on done: 568799.0 [2023-02-25 13:54:02,545][36154] Sum rewards: 54.558, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.686', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.057', 'WEAPON4': '0.150', 'AMMO3': '0.228', 'weapon4': '0.326', 'weapon2': '0.662', 'WEAPON3': '1.400', 'weapon3': '2.782', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.923', 'FRAGCOUNT': '49.000'} [2023-02-25 13:54:02,732][36141] DAMAGECOUNT value on done: 585308.0 [2023-02-25 13:54:02,732][36141] Sum rewards: 52.075, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.203', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon5': '0.234', 'AMMO3': '0.252', 'weapon2': '0.254', 'AMMO4': '0.266', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.760', 'WEAPON3': '1.450', 'weapon3': '2.356', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '14.787', 'FRAGCOUNT': '47.500'} [2023-02-25 13:54:02,824][36154] DAMAGECOUNT value on done: 578353.0 [2023-02-25 13:54:02,825][36154] Sum rewards: 63.245, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.883', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.098', 'AMMO4': '0.168', 'weapon4': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.257', 'weapon2': '0.494', 'WEAPON3': '1.500', 'weapon3': '2.914', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '57.000'} [2023-02-25 13:54:02,998][36141] DAMAGECOUNT value on done: 572999.0 [2023-02-25 13:54:02,998][36141] Sum rewards: 60.684, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.270', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.052', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.238', 'weapon2': '0.276', 'weapon4': '0.276', 'WEAPON3': '1.350', 'weapon3': '3.056', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.042', 'FRAGCOUNT': '55.000'} [2023-02-25 13:54:03,052][36141] DAMAGECOUNT value on done: 583788.0 [2023-02-25 13:54:03,053][36141] Sum rewards: 53.112, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.915', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon5': '0.104', 'AMMO4': '0.116', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.380', 'WEAPON4': '0.450', 'weapon4': '0.664', 'WEAPON3': '1.400', 'weapon3': '2.586', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.172', 'FRAGCOUNT': '48.500'} [2023-02-25 13:54:03,120][36154] DAMAGECOUNT value on done: 577068.0 [2023-02-25 13:54:03,120][36154] Sum rewards: 56.978, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.694', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.034', 'AMMO4': '0.064', 'weapon5': '0.068', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.240', 'weapon2': '0.438', 'WEAPON3': '1.450', 'weapon3': '3.240', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '50.000'} [2023-02-25 13:54:03,304][36141] DAMAGECOUNT value on done: 571564.0 [2023-02-25 13:54:03,304][36141] Sum rewards: 52.211, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.782', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.061', 'AMMO3': '0.168', 'AMMO4': '0.304', 'weapon5': '0.304', 'weapon2': '0.332', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.764', 'WEAPON3': '1.000', 'weapon3': '2.250', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.928', 'FRAGCOUNT': '44.000'} [2023-02-25 13:54:03,646][36157] DAMAGECOUNT value on done: 589077.0 [2023-02-25 13:54:03,647][36157] Sum rewards: 47.286, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.512', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.052', 'weapon5': '0.086', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'AMMO4': '0.259', 'WEAPON4': '0.300', 'weapon4': '0.318', 'weapon2': '0.470', 'WEAPON3': '1.450', 'HITCOUNT': '2.810', 'weapon3': '2.910', 'DAMAGECOUNT': '12.444', 'FRAGCOUNT': '44.000'} [2023-02-25 13:54:03,951][36157] DAMAGECOUNT value on done: 579428.0 [2023-02-25 13:54:03,951][36157] Sum rewards: 60.756, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.122', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.058', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.210', 'AMMO3': '0.231', 'weapon4': '0.626', 'WEAPON3': '1.350', 'weapon3': '2.858', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '52.000'} [2023-02-25 13:54:04,608][36157] DAMAGECOUNT value on done: 586889.0 [2023-02-25 13:54:04,608][36157] Sum rewards: 54.864, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.660', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.034', 'weapon5': '0.044', 'weapon4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.242', 'AMMO3': '0.253', 'WEAPON3': '1.650', 'HITCOUNT': '2.830', 'weapon3': '3.330', 'DAMAGECOUNT': '14.100', 'FRAGCOUNT': '50.000'} [2023-02-25 13:54:04,701][36138] Updated weights for policy 0, policy_version 44963 (0.0009) [2023-02-25 13:54:04,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 184168448. Throughput: 0: 3359.7. Samples: 8539578. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:54:04,730][36114] Avg episode reward: [(0, '54.255')] [2023-02-25 13:54:04,913][36157] DAMAGECOUNT value on done: 583471.0 [2023-02-25 13:54:04,914][36157] Sum rewards: 53.848, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.090', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.036', 'AMMO4': '0.182', 'AMMO3': '0.206', 'weapon5': '0.222', 'weapon4': '0.332', 'WEAPON4': '0.400', 'weapon2': '0.464', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.678', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '48.000'} [2023-02-25 13:54:05,255][36140] DAMAGECOUNT value on done: 586023.0 [2023-02-25 13:54:05,256][36140] Sum rewards: 61.534, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.613', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.150', 'AMMO3': '0.151', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon2': '0.498', 'weapon4': '0.552', 'WEAPON3': '0.950', 'weapon3': '2.524', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.031', 'FRAGCOUNT': '51.000'} [2023-02-25 13:54:05,572][36140] DAMAGECOUNT value on done: 568401.0 [2023-02-25 13:54:05,572][36140] Sum rewards: 62.311, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.807', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.132', 'AMMO3': '0.146', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.470', 'weapon4': '0.586', 'WEAPON3': '0.950', 'weapon3': '2.496', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.345', 'FRAGCOUNT': '51.000'} [2023-02-25 13:54:05,879][36140] DAMAGECOUNT value on done: 575709.0 [2023-02-25 13:54:05,879][36140] Sum rewards: 53.094, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.206', 'AMMO5': '0.015', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.138', 'AMMO3': '0.160', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.376', 'weapon4': '0.486', 'WEAPON3': '0.950', 'weapon3': '2.668', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.687', 'FRAGCOUNT': '46.000'} [2023-02-25 13:54:06,004][36156] Large shaping reward 2.640 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-25 13:54:06,096][36154] Large shaping reward 2.514 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.492, 164.0), ('weapon5', 0.002)] [2023-02-25 13:54:06,180][36140] DAMAGECOUNT value on done: 576090.0 [2023-02-25 13:54:06,181][36140] Sum rewards: 62.250, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.410', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.118', 'AMMO3': '0.163', 'AMMO4': '0.180', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.488', 'weapon4': '0.722', 'WEAPON3': '0.950', 'weapon3': '2.424', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.273', 'FRAGCOUNT': '52.000'} [2023-02-25 13:54:06,710][36142] DAMAGECOUNT value on done: 583479.0 [2023-02-25 13:54:06,711][36142] Sum rewards: 64.827, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.005', 'AMMO2': '0.005', 'AMMO5': '0.007', 'weapon4': '0.018', 'AMMO4': '0.026', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'weapon2': '0.180', 'AMMO3': '0.213', 'WEAPON3': '1.400', 'HITCOUNT': '3.440', 'weapon3': '3.572', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '54.000'} [2023-02-25 13:54:06,741][36142] DAMAGECOUNT value on done: 568827.0 [2023-02-25 13:54:06,742][36142] Sum rewards: 62.389, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.670', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.173', 'weapon5': '0.222', 'WEAPON4': '0.300', 'weapon2': '0.314', 'weapon4': '0.336', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.768', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.362', 'FRAGCOUNT': '52.000'} [2023-02-25 13:54:07,031][36142] DAMAGECOUNT value on done: 571164.0 [2023-02-25 13:54:07,032][36142] Sum rewards: 58.585, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.620', 'AMMO5': '0.018', 'AMMO2': '0.064', 'AMMO3': '0.213', 'weapon5': '0.276', 'AMMO4': '0.318', 'weapon4': '0.332', 'weapon2': '0.416', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.670', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '16.077', 'FRAGCOUNT': '52.000'} [2023-02-25 13:54:07,059][36142] DAMAGECOUNT value on done: 580512.0 [2023-02-25 13:54:07,060][36142] Sum rewards: 52.410, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.320', 'AMMO5': '0.010', 'weapon5': '0.022', 'AMMO2': '0.030', 'weapon4': '0.034', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.568', 'WEAPON3': '1.200', 'HITCOUNT': '3.050', 'weapon3': '3.158', 'DAMAGECOUNT': '12.450', 'FRAGCOUNT': '46.000'} [2023-02-25 13:54:07,786][36138] Updated weights for policy 0, policy_version 44973 (0.0009) [2023-02-25 13:54:08,155][36156] DAMAGECOUNT value on done: 586328.0 [2023-02-25 13:54:08,156][36156] Sum rewards: 57.264, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.682', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.140', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'weapon2': '0.338', 'weapon4': '0.530', 'WEAPON3': '1.150', 'weapon3': '2.590', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.189', 'FRAGCOUNT': '47.000'} [2023-02-25 13:54:08,203][36156] DAMAGECOUNT value on done: 589056.0 [2023-02-25 13:54:08,203][36156] Sum rewards: 57.638, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.198', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.136', 'AMMO3': '0.155', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON4': '0.400', 'weapon4': '0.812', 'WEAPON3': '1.050', 'weapon3': '2.470', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.474', 'FRAGCOUNT': '48.000'} [2023-02-25 13:54:08,460][36156] DAMAGECOUNT value on done: 574440.0 [2023-02-25 13:54:08,460][36156] Sum rewards: 57.878, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.066', 'HEALTH': '0.148', 'weapon2': '0.164', 'AMMO3': '0.169', 'AMMO4': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.562', 'WEAPON3': '1.000', 'weapon3': '3.022', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.066', 'FRAGCOUNT': '48.000'} [2023-02-25 13:54:08,505][36156] DAMAGECOUNT value on done: 579136.0 [2023-02-25 13:54:08,506][36156] Sum rewards: 61.385, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.910', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.093', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon4': '0.296', 'WEAPON4': '0.300', 'weapon2': '0.528', 'WEAPON3': '1.200', 'weapon3': '2.826', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.177', 'FRAGCOUNT': '54.000'} [2023-02-25 13:54:09,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13412.7). Total num frames: 184233984. Throughput: 0: 3360.1. Samples: 8549626. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:54:09,729][36114] Avg episode reward: [(0, '55.340')] [2023-02-25 13:54:10,824][36138] Updated weights for policy 0, policy_version 44983 (0.0010) [2023-02-25 13:54:12,911][36155] DAMAGECOUNT value on done: 571475.0 [2023-02-25 13:54:12,911][36155] Sum rewards: 55.889, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-5.145', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon5': '0.172', 'weapon2': '0.182', 'AMMO3': '0.260', 'AMMO4': '0.263', 'weapon4': '0.300', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.700', 'HITCOUNT': '3.020', 'weapon3': '3.024', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '52.000'} [2023-02-25 13:54:13,206][36155] DAMAGECOUNT value on done: 591561.0 [2023-02-25 13:54:13,207][36155] Sum rewards: 58.023, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.112', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.022', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.279', 'WEAPON4': '0.300', 'weapon2': '0.312', 'weapon4': '0.414', 'WEAPON3': '1.650', 'weapon3': '2.902', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.469', 'FRAGCOUNT': '56.000'} [2023-02-25 13:54:13,691][36155] DAMAGECOUNT value on done: 586196.0 [2023-02-25 13:54:13,692][36155] Sum rewards: 54.028, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.634', 'ARMOR': '0.008', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.061', 'AMMO3': '0.154', 'AMMO4': '0.304', 'weapon2': '0.330', 'weapon5': '0.330', 'WEAPON5': '0.700', 'WEAPON4': '0.850', 'weapon4': '0.902', 'WEAPON3': '0.950', 'weapon3': '1.986', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.937', 'FRAGCOUNT': '48.000'} [2023-02-25 13:54:13,875][36138] Updated weights for policy 0, policy_version 44993 (0.0009) [2023-02-25 13:54:13,969][36139] DAMAGECOUNT value on done: 586700.0 [2023-02-25 13:54:13,969][36139] Sum rewards: 50.618, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-3.199', 'AMMO5': '0.018', 'AMMO2': '0.041', 'weapon5': '0.148', 'AMMO4': '0.203', 'weapon2': '0.206', 'weapon4': '0.268', 'AMMO3': '0.310', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.800', 'HITCOUNT': '2.920', 'weapon3': '2.982', 'DAMAGECOUNT': '14.070', 'FRAGCOUNT': '51.000'} [2023-02-25 13:54:13,994][36155] DAMAGECOUNT value on done: 578481.0 [2023-02-25 13:54:13,994][36155] Sum rewards: 54.624, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.702', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO3': '0.159', 'weapon5': '0.186', 'AMMO4': '0.196', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON4': '0.500', 'weapon4': '0.748', 'WEAPON3': '0.950', 'weapon3': '2.572', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.447', 'FRAGCOUNT': '45.500'} [2023-02-25 13:54:14,279][36139] DAMAGECOUNT value on done: 578050.0 [2023-02-25 13:54:14,279][36139] Sum rewards: 48.950, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.106', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon5': '0.052', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'AMMO4': '0.257', 'weapon2': '0.284', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon4': '0.598', 'WEAPON3': '1.200', 'weapon3': '2.594', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.147', 'FRAGCOUNT': '44.000'} [2023-02-25 13:54:14,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 184299520. Throughput: 0: 3357.7. Samples: 8569708. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:54:14,729][36114] Avg episode reward: [(0, '55.571')] [2023-02-25 13:54:14,803][36139] DAMAGECOUNT value on done: 587164.0 [2023-02-25 13:54:14,804][36139] Sum rewards: 47.262, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-3.941', 'AMMO5': '0.016', 'AMMO2': '0.060', 'weapon5': '0.190', 'weapon2': '0.280', 'AMMO3': '0.300', 'AMMO4': '0.301', 'weapon4': '0.464', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.700', 'weapon3': '2.670', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.101', 'FRAGCOUNT': '46.000'} [2023-02-25 13:54:15,110][36139] DAMAGECOUNT value on done: 582608.0 [2023-02-25 13:54:15,110][36139] Sum rewards: 46.863, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.950', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.120', 'AMMO3': '0.162', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'weapon2': '0.252', 'WEAPON4': '0.350', 'weapon4': '0.784', 'WEAPON3': '1.000', 'weapon3': '2.532', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.807', 'FRAGCOUNT': '40.000'} [2023-02-25 13:54:16,898][36138] Updated weights for policy 0, policy_version 45003 (0.0009) [2023-02-25 13:54:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 184369152. Throughput: 0: 3357.7. Samples: 8589980. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:54:19,729][36114] Avg episode reward: [(0, '55.520')] [2023-02-25 13:54:19,922][36138] Updated weights for policy 0, policy_version 45013 (0.0009) [2023-02-25 13:54:22,261][36154] DAMAGECOUNT value on done: 586656.0 [2023-02-25 13:54:22,261][36154] Sum rewards: 53.577, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.572', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.042', 'AMMO3': '0.098', 'AMMO4': '0.211', 'weapon5': '0.266', 'weapon2': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.600', 'weapon4': '1.100', 'weapon3': '2.094', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.282', 'FRAGCOUNT': '42.500'} [2023-02-25 13:54:22,570][36154] DAMAGECOUNT value on done: 573657.0 [2023-02-25 13:54:22,570][36154] Sum rewards: 51.632, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.430', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon2': '0.200', 'weapon4': '0.214', 'AMMO3': '0.217', 'AMMO4': '0.220', 'weapon5': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.920', 'weapon3': '3.028', 'DAMAGECOUNT': '14.094', 'FRAGCOUNT': '46.500'} [2023-02-25 13:54:22,668][36141] DAMAGECOUNT value on done: 590340.0 [2023-02-25 13:54:22,668][36141] Sum rewards: 58.150, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.585', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.112', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.306', 'weapon4': '0.318', 'WEAPON3': '1.200', 'weapon3': '2.876', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.096', 'FRAGCOUNT': '51.000'} [2023-02-25 13:54:22,859][36154] DAMAGECOUNT value on done: 583453.0 [2023-02-25 13:54:22,859][36154] Sum rewards: 58.997, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.872', 'AMMO5': '0.008', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon5': '0.186', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.290', 'WEAPON4': '0.350', 'weapon4': '0.480', 'WEAPON3': '1.250', 'weapon3': '2.770', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.880', 'FRAGCOUNT': '52.000'} [2023-02-25 13:54:22,905][36141] DAMAGECOUNT value on done: 578219.0 [2023-02-25 13:54:22,905][36141] Sum rewards: 64.024, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.816', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.082', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'weapon4': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'weapon2': '0.510', 'WEAPON3': '1.400', 'weapon3': '2.976', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '56.000'} [2023-02-25 13:54:22,966][36138] Updated weights for policy 0, policy_version 45023 (0.0009) [2023-02-25 13:54:22,974][36141] DAMAGECOUNT value on done: 588985.0 [2023-02-25 13:54:22,974][36141] Sum rewards: 52.579, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.665', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO4': '0.182', 'weapon5': '0.192', 'AMMO3': '0.226', 'WEAPON5': '0.300', 'weapon2': '0.432', 'WEAPON4': '0.500', 'weapon4': '0.544', 'WEAPON3': '1.350', 'weapon3': '2.560', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.591', 'FRAGCOUNT': '48.500'} [2023-02-25 13:54:23,183][36154] DAMAGECOUNT value on done: 582739.0 [2023-02-25 13:54:23,184][36154] Sum rewards: 60.656, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.504', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.049', 'AMMO3': '0.217', 'AMMO4': '0.245', 'weapon5': '0.310', 'weapon2': '0.344', 'WEAPON5': '0.400', 'weapon4': '0.480', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.438', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '54.000'} [2023-02-25 13:54:23,220][36141] DAMAGECOUNT value on done: 575840.0 [2023-02-25 13:54:23,220][36141] Sum rewards: 47.751, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.415', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.051', 'AMMO3': '0.155', 'weapon5': '0.210', 'AMMO4': '0.256', 'weapon4': '0.352', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.490', 'WEAPON3': '0.900', 'HITCOUNT': '2.570', 'weapon3': '2.682', 'DAMAGECOUNT': '12.828', 'FRAGCOUNT': '41.000'} [2023-02-25 13:54:23,661][36157] DAMAGECOUNT value on done: 593587.0 [2023-02-25 13:54:23,661][36157] Sum rewards: 49.532, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.774', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.122', 'AMMO4': '0.193', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'weapon2': '0.414', 'WEAPON4': '0.450', 'weapon4': '0.458', 'WEAPON3': '1.550', 'weapon3': '2.736', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.530', 'FRAGCOUNT': '49.000'} [2023-02-25 13:54:23,978][36157] DAMAGECOUNT value on done: 584012.0 [2023-02-25 13:54:23,978][36157] Sum rewards: 51.782, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.062', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.076', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon2': '0.416', 'weapon4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.746', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.752', 'FRAGCOUNT': '46.000'} [2023-02-25 13:54:24,651][36157] DAMAGECOUNT value on done: 592086.0 [2023-02-25 13:54:24,652][36157] Sum rewards: 57.955, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.976', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon2': '0.250', 'weapon4': '0.414', 'WEAPON3': '1.500', 'weapon3': '3.032', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.591', 'FRAGCOUNT': '51.000'} [2023-02-25 13:54:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 184434688. Throughput: 0: 3356.6. Samples: 8600098. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:54:24,730][36114] Avg episode reward: [(0, '55.987')] [2023-02-25 13:54:24,949][36157] DAMAGECOUNT value on done: 587975.0 [2023-02-25 13:54:24,950][36157] Sum rewards: 54.049, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.642', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.020', 'weapon5': '0.064', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'weapon2': '0.152', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'weapon4': '0.446', 'WEAPON3': '1.150', 'HITCOUNT': '2.860', 'weapon3': '2.972', 'DAMAGECOUNT': '13.512', 'FRAGCOUNT': '47.000'} [2023-02-25 13:54:25,322][36140] DAMAGECOUNT value on done: 590673.0 [2023-02-25 13:54:25,322][36140] Sum rewards: 48.368, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.460', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.136', 'weapon2': '0.174', 'weapon4': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.261', 'WEAPON3': '1.650', 'HITCOUNT': '2.700', 'weapon3': '3.086', 'DAMAGECOUNT': '13.950', 'FRAGCOUNT': '45.000'} [2023-02-25 13:54:25,638][36140] DAMAGECOUNT value on done: 573833.0 [2023-02-25 13:54:25,639][36140] Sum rewards: 60.642, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.152', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.134', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.390', 'weapon2': '0.576', 'WEAPON3': '1.150', 'weapon3': '2.632', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.296', 'FRAGCOUNT': '50.000'} [2023-02-25 13:54:25,948][36140] DAMAGECOUNT value on done: 580596.0 [2023-02-25 13:54:25,948][36140] Sum rewards: 58.323, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.030', 'ARMOR': '0.008', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.140', 'weapon4': '0.170', 'AMMO3': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.200', 'weapon3': '2.984', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.661', 'FRAGCOUNT': '50.000'} [2023-02-25 13:54:26,062][36138] Updated weights for policy 0, policy_version 45033 (0.0009) [2023-02-25 13:54:26,256][36140] DAMAGECOUNT value on done: 581123.0 [2023-02-25 13:54:26,256][36140] Sum rewards: 54.973, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.176', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon5': '0.116', 'AMMO4': '0.153', 'weapon4': '0.208', 'AMMO3': '0.236', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.036', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.099', 'FRAGCOUNT': '49.000'} [2023-02-25 13:54:26,840][36142] DAMAGECOUNT value on done: 588454.0 [2023-02-25 13:54:26,841][36142] Sum rewards: 60.717, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.232', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO3': '0.143', 'AMMO4': '0.205', 'WEAPON4': '0.250', 'weapon5': '0.262', 'WEAPON5': '0.350', 'weapon4': '0.436', 'weapon2': '0.486', 'WEAPON3': '0.900', 'weapon3': '2.572', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.925', 'FRAGCOUNT': '50.000'} [2023-02-25 13:54:26,873][36142] DAMAGECOUNT value on done: 572856.0 [2023-02-25 13:54:26,874][36142] Sum rewards: 41.191, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.962', 'AMMO5': '0.003', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'AMMO4': '0.173', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon4': '0.270', 'weapon2': '0.794', 'WEAPON3': '1.400', 'weapon3': '2.732', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.087', 'FRAGCOUNT': '39.000'} [2023-02-25 13:54:27,149][36142] DAMAGECOUNT value on done: 575529.0 [2023-02-25 13:54:27,149][36142] Sum rewards: 49.966, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.635', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.056', 'AMMO4': '0.086', 'weapon2': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'weapon4': '0.412', 'WEAPON3': '1.250', 'HITCOUNT': '2.920', 'weapon3': '3.116', 'DAMAGECOUNT': '13.095', 'FRAGCOUNT': '45.000'} [2023-02-25 13:54:27,182][36142] DAMAGECOUNT value on done: 585718.0 [2023-02-25 13:54:27,183][36142] Sum rewards: 60.002, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.327', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.048', 'AMMO3': '0.156', 'weapon5': '0.238', 'AMMO4': '0.238', 'weapon2': '0.422', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.516', 'WEAPON3': '1.100', 'weapon3': '2.486', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.618', 'FRAGCOUNT': '52.000'} [2023-02-25 13:54:28,168][36156] DAMAGECOUNT value on done: 591142.0 [2023-02-25 13:54:28,168][36156] Sum rewards: 56.675, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.633', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.122', 'AMMO3': '0.184', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.418', 'weapon4': '0.702', 'WEAPON3': '1.200', 'weapon3': '2.476', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.442', 'FRAGCOUNT': '50.000'} [2023-02-25 13:54:28,246][36156] DAMAGECOUNT value on done: 594485.0 [2023-02-25 13:54:28,247][36156] Sum rewards: 54.399, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.955', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon5': '0.036', 'AMMO4': '0.120', 'weapon4': '0.180', 'weapon2': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.289', 'WEAPON4': '0.300', 'WEAPON3': '1.850', 'weapon3': '3.342', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '51.000'} [2023-02-25 13:54:28,501][36156] DAMAGECOUNT value on done: 580265.0 [2023-02-25 13:54:28,501][36156] Sum rewards: 66.381, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.545', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.226', 'weapon4': '0.414', 'WEAPON3': '1.400', 'weapon3': '2.976', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '56.000'} [2023-02-25 13:54:28,562][36156] DAMAGECOUNT value on done: 583463.0 [2023-02-25 13:54:28,563][36156] Sum rewards: 44.298, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.602', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon5': '0.214', 'AMMO3': '0.221', 'AMMO4': '0.247', 'WEAPON5': '0.400', 'weapon2': '0.438', 'weapon4': '0.470', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.518', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.981', 'FRAGCOUNT': '42.500'} [2023-02-25 13:54:29,124][36138] Updated weights for policy 0, policy_version 45043 (0.0009) [2023-02-25 13:54:29,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.2, 300 sec: 13398.8). Total num frames: 184500224. Throughput: 0: 3352.0. Samples: 8620112. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:54:29,730][36114] Avg episode reward: [(0, '55.568')] [2023-02-25 13:54:32,152][36138] Updated weights for policy 0, policy_version 45053 (0.0010) [2023-02-25 13:54:32,741][36155] DAMAGECOUNT value on done: 575809.0 [2023-02-25 13:54:32,742][36155] Sum rewards: 50.755, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.362', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.160', 'AMMO4': '0.166', 'AMMO3': '0.181', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.382', 'weapon4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.600', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.002', 'FRAGCOUNT': '45.000'} [2023-02-25 13:54:33,058][36155] DAMAGECOUNT value on done: 596512.0 [2023-02-25 13:54:33,059][36155] Sum rewards: 52.786, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.996', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.088', 'AMMO4': '0.131', 'weapon4': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.010', 'weapon3': '3.236', 'DAMAGECOUNT': '14.853', 'FRAGCOUNT': '45.000'} [2023-02-25 13:54:33,584][36155] DAMAGECOUNT value on done: 591087.0 [2023-02-25 13:54:33,585][36155] Sum rewards: 54.912, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.536', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.104', 'AMMO3': '0.174', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'weapon2': '0.498', 'WEAPON4': '0.500', 'weapon4': '0.688', 'WEAPON3': '1.100', 'weapon3': '2.442', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.673', 'FRAGCOUNT': '47.000'} [2023-02-25 13:54:33,889][36155] DAMAGECOUNT value on done: 584491.0 [2023-02-25 13:54:33,889][36155] Sum rewards: 64.091, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.400', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon4': '0.176', 'weapon5': '0.190', 'AMMO3': '0.200', 'AMMO4': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.486', 'WEAPON3': '1.150', 'weapon3': '2.854', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '53.000'} [2023-02-25 13:54:34,044][36139] DAMAGECOUNT value on done: 591169.0 [2023-02-25 13:54:34,044][36139] Sum rewards: 46.197, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.215', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.144', 'AMMO3': '0.196', 'weapon2': '0.330', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.792', 'WEAPON3': '1.200', 'weapon3': '2.302', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.407', 'FRAGCOUNT': '42.000'} [2023-02-25 13:54:34,361][36139] DAMAGECOUNT value on done: 582579.0 [2023-02-25 13:54:34,361][36139] Sum rewards: 50.618, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.640', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO4': '0.150', 'AMMO3': '0.237', 'weapon2': '0.282', 'WEAPON4': '0.300', 'weapon4': '0.790', 'WEAPON3': '1.450', 'weapon3': '2.562', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '13.587', 'FRAGCOUNT': '46.000'} [2023-02-25 13:54:34,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 184569856. Throughput: 0: 3352.6. Samples: 8640248. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:54:34,730][36114] Avg episode reward: [(0, '55.152')] [2023-02-25 13:54:34,864][36139] DAMAGECOUNT value on done: 591140.0 [2023-02-25 13:54:34,865][36139] Sum rewards: 45.301, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.144', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.150', 'AMMO3': '0.191', 'AMMO4': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON4': '0.400', 'weapon4': '0.668', 'WEAPON3': '1.050', 'weapon3': '2.622', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '11.913', 'FRAGCOUNT': '41.000'} [2023-02-25 13:54:35,180][36139] DAMAGECOUNT value on done: 586732.0 [2023-02-25 13:54:35,181][36139] Sum rewards: 42.301, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.260', 'AMMO5': '0.017', 'AMMO2': '0.030', 'AMMO4': '0.151', 'AMMO3': '0.170', 'weapon2': '0.288', 'weapon5': '0.368', 'WEAPON4': '0.500', 'weapon4': '0.596', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'weapon3': '2.338', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.372', 'FRAGCOUNT': '36.500'} [2023-02-25 13:54:35,239][36138] Updated weights for policy 0, policy_version 45063 (0.0010) [2023-02-25 13:54:38,307][36138] Updated weights for policy 0, policy_version 45073 (0.0009) [2023-02-25 13:54:39,729][36114] Fps is (10 sec: 13517.0, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 184635392. Throughput: 0: 3351.0. Samples: 8650300. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:54:39,729][36114] Avg episode reward: [(0, '54.977')] [2023-02-25 13:54:41,330][36138] Updated weights for policy 0, policy_version 45083 (0.0009) [2023-02-25 13:54:42,398][36154] DAMAGECOUNT value on done: 591903.0 [2023-02-25 13:54:42,399][36154] Sum rewards: 53.854, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.220', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.019', 'weapon5': '0.080', 'AMMO4': '0.096', 'AMMO3': '0.184', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.362', 'weapon2': '0.646', 'WEAPON3': '1.250', 'weapon3': '2.688', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.741', 'FRAGCOUNT': '45.500'} [2023-02-25 13:54:42,648][36141] DAMAGECOUNT value on done: 594565.0 [2023-02-25 13:54:42,649][36141] Sum rewards: 43.452, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.866', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon4': '0.346', 'weapon2': '0.438', 'WEAPON3': '1.350', 'HITCOUNT': '2.860', 'weapon3': '3.004', 'DAMAGECOUNT': '12.675', 'FRAGCOUNT': '40.000'} [2023-02-25 13:54:42,717][36154] DAMAGECOUNT value on done: 578517.0 [2023-02-25 13:54:42,717][36154] Sum rewards: 48.762, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.044', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.048', 'AMMO3': '0.195', 'weapon5': '0.226', 'weapon2': '0.234', 'AMMO4': '0.238', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.828', 'WEAPON3': '1.100', 'weapon3': '2.362', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '43.000'} [2023-02-25 13:54:42,887][36141] DAMAGECOUNT value on done: 583109.0 [2023-02-25 13:54:42,887][36141] Sum rewards: 57.803, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.130', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.096', 'AMMO4': '0.133', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.394', 'weapon2': '0.430', 'WEAPON3': '1.150', 'weapon3': '2.908', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.670', 'FRAGCOUNT': '49.000'} [2023-02-25 13:54:42,957][36141] DAMAGECOUNT value on done: 593451.0 [2023-02-25 13:54:42,958][36141] Sum rewards: 49.560, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.481', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.039', 'weapon5': '0.046', 'weapon7': '0.090', 'WEAPON5': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.221', 'weapon4': '0.246', 'weapon2': '0.558', 'WEAPON3': '1.350', 'weapon3': '2.732', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.398', 'FRAGCOUNT': '44.000'} [2023-02-25 13:54:42,972][36154] DAMAGECOUNT value on done: 588635.0 [2023-02-25 13:54:42,973][36154] Sum rewards: 61.645, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.642', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon4': '0.270', 'weapon2': '0.378', 'WEAPON3': '1.450', 'weapon3': '3.002', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.546', 'FRAGCOUNT': '54.000'} [2023-02-25 13:54:43,200][36141] DAMAGECOUNT value on done: 580637.0 [2023-02-25 13:54:43,200][36141] Sum rewards: 54.292, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.676', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.094', 'weapon4': '0.106', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.450', 'HITCOUNT': '3.020', 'weapon3': '3.076', 'DAMAGECOUNT': '14.391', 'FRAGCOUNT': '50.000'} [2023-02-25 13:54:43,282][36154] DAMAGECOUNT value on done: 587775.0 [2023-02-25 13:54:43,282][36154] Sum rewards: 60.990, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.973', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.090', 'AMMO3': '0.191', 'AMMO4': '0.198', 'WEAPON5': '0.250', 'weapon4': '0.332', 'WEAPON4': '0.350', 'weapon2': '0.606', 'WEAPON3': '1.150', 'weapon3': '2.788', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.108', 'FRAGCOUNT': '52.000'} [2023-02-25 13:54:43,735][36157] DAMAGECOUNT value on done: 598202.0 [2023-02-25 13:54:43,736][36157] Sum rewards: 51.071, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.920', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon4': '0.390', 'weapon2': '0.664', 'WEAPON3': '1.300', 'weapon3': '2.776', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '13.845', 'FRAGCOUNT': '44.000'} [2023-02-25 13:54:44,037][36157] DAMAGECOUNT value on done: 588283.0 [2023-02-25 13:54:44,038][36157] Sum rewards: 51.023, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.250', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO4': '0.174', 'AMMO3': '0.184', 'weapon5': '0.232', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.422', 'WEAPON3': '1.200', 'HITCOUNT': '2.680', 'weapon3': '2.716', 'DAMAGECOUNT': '12.813', 'FRAGCOUNT': '46.000'} [2023-02-25 13:54:44,333][36138] Updated weights for policy 0, policy_version 45093 (0.0009) [2023-02-25 13:54:44,708][36157] DAMAGECOUNT value on done: 595938.0 [2023-02-25 13:54:44,708][36157] Sum rewards: 41.590, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.266', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon5': '0.140', 'AMMO4': '0.176', 'AMMO3': '0.212', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.378', 'ARMOR': '0.400', 'weapon2': '0.862', 'WEAPON3': '1.200', 'weapon3': '2.362', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '11.556', 'FRAGCOUNT': '36.000'} [2023-02-25 13:54:44,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 184705024. Throughput: 0: 3351.4. Samples: 8670478. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:54:44,730][36114] Avg episode reward: [(0, '54.789')] [2023-02-25 13:54:45,022][36157] DAMAGECOUNT value on done: 592578.0 [2023-02-25 13:54:45,022][36157] Sum rewards: 51.007, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.761', 'ARMOR': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.051', 'AMMO3': '0.139', 'weapon5': '0.194', 'AMMO4': '0.253', 'weapon2': '0.316', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.900', 'weapon4': '1.074', 'weapon3': '1.998', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.695', 'FRAGCOUNT': '43.000'} [2023-02-25 13:54:45,291][36140] DAMAGECOUNT value on done: 595755.0 [2023-02-25 13:54:45,291][36140] Sum rewards: 60.679, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.090', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.010', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.160', 'weapon2': '0.176', 'AMMO3': '0.185', 'WEAPON4': '0.350', 'weapon4': '0.540', 'WEAPON3': '1.150', 'weapon3': '3.024', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.246', 'FRAGCOUNT': '53.000'} [2023-02-25 13:54:45,607][36140] DAMAGECOUNT value on done: 577962.0 [2023-02-25 13:54:45,608][36140] Sum rewards: 48.355, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.442', 'AMMO5': '0.007', 'weapon7': '0.012', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.610', 'weapon4': '0.686', 'WEAPON3': '1.000', 'weapon3': '2.286', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.387', 'FRAGCOUNT': '40.000'} [2023-02-25 13:54:45,911][36140] DAMAGECOUNT value on done: 585503.0 [2023-02-25 13:54:45,911][36140] Sum rewards: 58.192, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.620', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.050', 'AMMO4': '0.152', 'WEAPON5': '0.200', 'weapon2': '0.220', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'weapon4': '0.356', 'ARMOR': '0.404', 'WEAPON3': '1.350', 'weapon3': '3.102', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.721', 'FRAGCOUNT': '52.000'} [2023-02-25 13:54:46,238][36140] DAMAGECOUNT value on done: 585397.0 [2023-02-25 13:54:46,239][36140] Sum rewards: 49.048, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.647', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.166', 'weapon2': '0.178', 'AMMO3': '0.240', 'WEAPON3': '1.350', 'HITCOUNT': '2.900', 'weapon3': '3.270', 'DAMAGECOUNT': '12.822', 'FRAGCOUNT': '44.000'} [2023-02-25 13:54:46,802][36142] DAMAGECOUNT value on done: 593752.0 [2023-02-25 13:54:46,802][36142] Sum rewards: 64.207, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.218', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.140', 'weapon4': '0.166', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.392', 'WEAPON3': '1.300', 'weapon3': '3.070', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.894', 'FRAGCOUNT': '55.000'} [2023-02-25 13:54:46,833][36142] DAMAGECOUNT value on done: 577166.0 [2023-02-25 13:54:46,833][36142] Sum rewards: 47.779, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.458', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.152', 'AMMO3': '0.163', 'AMMO4': '0.201', 'weapon2': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.554', 'WEAPON3': '1.100', 'HITCOUNT': '2.550', 'weapon3': '2.664', 'DAMAGECOUNT': '12.930', 'FRAGCOUNT': '41.000'} [2023-02-25 13:54:47,117][36142] DAMAGECOUNT value on done: 579797.0 [2023-02-25 13:54:47,118][36142] Sum rewards: 54.152, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.648', 'weapon5': '0.002', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'AMMO3': '0.218', 'weapon2': '0.232', 'weapon4': '0.238', 'WEAPON3': '1.350', 'HITCOUNT': '3.080', 'weapon3': '3.304', 'DAMAGECOUNT': '12.804', 'FRAGCOUNT': '47.000'} [2023-02-25 13:54:47,147][36142] DAMAGECOUNT value on done: 590705.0 [2023-02-25 13:54:47,148][36142] Sum rewards: 51.568, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.368', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.048', 'AMMO3': '0.184', 'weapon5': '0.238', 'AMMO4': '0.239', 'weapon2': '0.282', 'WEAPON5': '0.500', 'WEAPON4': '0.750', 'weapon4': '0.964', 'WEAPON3': '1.000', 'weapon3': '2.040', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.961', 'FRAGCOUNT': '46.000'} [2023-02-25 13:54:47,380][36138] Updated weights for policy 0, policy_version 45103 (0.0009) [2023-02-25 13:54:48,152][36156] DAMAGECOUNT value on done: 596291.0 [2023-02-25 13:54:48,152][36156] Sum rewards: 56.387, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.725', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'weapon5': '0.198', 'AMMO3': '0.294', 'weapon2': '0.460', 'WEAPON3': '1.700', 'HITCOUNT': '3.080', 'weapon3': '3.094', 'DAMAGECOUNT': '15.447', 'FRAGCOUNT': '50.500'} [2023-02-25 13:54:48,190][36156] DAMAGECOUNT value on done: 599999.0 [2023-02-25 13:54:48,190][36156] Sum rewards: 65.233, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.316', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon5': '0.034', 'AMMO4': '0.076', 'weapon4': '0.080', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon2': '0.198', 'AMMO3': '0.271', 'WEAPON3': '1.500', 'weapon3': '3.406', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.362', 'FRAGCOUNT': '58.000'} [2023-02-25 13:54:48,467][36156] DAMAGECOUNT value on done: 584910.0 [2023-02-25 13:54:48,467][36156] Sum rewards: 51.597, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.197', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon5': '0.188', 'weapon4': '0.192', 'weapon2': '0.208', 'AMMO3': '0.234', 'AMMO4': '0.250', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.830', 'weapon3': '3.084', 'DAMAGECOUNT': '13.935', 'FRAGCOUNT': '48.000'} [2023-02-25 13:54:48,509][36156] DAMAGECOUNT value on done: 588399.0 [2023-02-25 13:54:48,510][36156] Sum rewards: 53.419, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.243', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.104', 'weapon4': '0.122', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.197', 'WEAPON4': '0.300', 'weapon2': '0.516', 'WEAPON3': '1.200', 'weapon3': '3.014', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.808', 'FRAGCOUNT': '46.000'} [2023-02-25 13:54:49,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 184770560. Throughput: 0: 3357.7. Samples: 8690676. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:54:49,730][36114] Avg episode reward: [(0, '54.840')] [2023-02-25 13:54:50,445][36138] Updated weights for policy 0, policy_version 45113 (0.0009) [2023-02-25 13:54:50,698][36141] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 13:54:52,639][36155] DAMAGECOUNT value on done: 580126.0 [2023-02-25 13:54:52,639][36155] Sum rewards: 47.419, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.072', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.156', 'AMMO3': '0.162', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.412', 'weapon4': '0.444', 'WEAPON3': '0.950', 'weapon3': '2.554', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.951', 'FRAGCOUNT': '39.500'} [2023-02-25 13:54:52,945][36155] DAMAGECOUNT value on done: 600903.0 [2023-02-25 13:54:52,945][36155] Sum rewards: 50.500, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.010', 'AMMO5': '0.015', 'AMMO2': '0.060', 'AMMO3': '0.154', 'weapon5': '0.166', 'AMMO4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.448', 'WEAPON4': '0.450', 'ARMOR': '0.504', 'weapon4': '0.646', 'WEAPON3': '0.850', 'weapon3': '2.394', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '13.173', 'FRAGCOUNT': '42.000'} [2023-02-25 13:54:53,498][36138] Updated weights for policy 0, policy_version 45123 (0.0009) [2023-02-25 13:54:53,546][36155] DAMAGECOUNT value on done: 596231.0 [2023-02-25 13:54:53,546][36155] Sum rewards: 59.352, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.629', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.140', 'weapon5': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.276', 'WEAPON4': '0.350', 'weapon4': '0.602', 'WEAPON3': '0.950', 'weapon3': '2.452', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '49.000'} [2023-02-25 13:54:53,857][36155] DAMAGECOUNT value on done: 588667.0 [2023-02-25 13:54:53,857][36155] Sum rewards: 45.767, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.622', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon5': '0.102', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon2': '0.364', 'weapon4': '0.814', 'WEAPON3': '1.200', 'weapon3': '2.406', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.528', 'FRAGCOUNT': '40.000'} [2023-02-25 13:54:53,858][36139] DAMAGECOUNT value on done: 595871.0 [2023-02-25 13:54:53,859][36139] Sum rewards: 55.531, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.696', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.142', 'weapon5': '0.178', 'AMMO3': '0.210', 'weapon4': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.434', 'WEAPON3': '1.300', 'weapon3': '2.782', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.106', 'FRAGCOUNT': '49.000'} [2023-02-25 13:54:54,156][36139] DAMAGECOUNT value on done: 586592.0 [2023-02-25 13:54:54,157][36139] Sum rewards: 49.134, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.228', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO3': '0.099', 'weapon5': '0.156', 'AMMO4': '0.186', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.566', 'weapon2': '0.582', 'WEAPON3': '0.600', 'weapon3': '2.116', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.039', 'FRAGCOUNT': '40.000'} [2023-02-25 13:54:54,720][36139] DAMAGECOUNT value on done: 595988.0 [2023-02-25 13:54:54,720][36139] Sum rewards: 55.245, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.380', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.153', 'weapon5': '0.174', 'AMMO3': '0.194', 'WEAPON5': '0.250', 'weapon2': '0.364', 'WEAPON4': '0.400', 'weapon4': '0.664', 'WEAPON3': '1.100', 'weapon3': '2.476', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.409', 'FRAGCOUNT': '49.000'} [2023-02-25 13:54:54,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 184836096. Throughput: 0: 3359.1. Samples: 8700786. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:54:54,730][36114] Avg episode reward: [(0, '54.317')] [2023-02-25 13:54:54,986][36154] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 13:54:55,047][36139] DAMAGECOUNT value on done: 592082.0 [2023-02-25 13:54:55,047][36139] Sum rewards: 55.401, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-5.020', 'AMMO5': '0.013', 'AMMO2': '0.058', 'weapon5': '0.224', 'AMMO3': '0.255', 'weapon2': '0.258', 'AMMO4': '0.288', 'weapon4': '0.350', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '1.600', 'weapon3': '2.794', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '53.000'} [2023-02-25 13:54:56,539][36138] Updated weights for policy 0, policy_version 45133 (0.0010) [2023-02-25 13:54:58,961][36157] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-25 13:54:59,326][36156] Large shaping reward 2.597 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.555, 185.0), ('weapon5', 0.002)] [2023-02-25 13:54:59,558][36138] Updated weights for policy 0, policy_version 45143 (0.0009) [2023-02-25 13:54:59,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 184905728. Throughput: 0: 3360.6. Samples: 8720934. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:54:59,730][36114] Avg episode reward: [(0, '54.250')] [2023-02-25 13:55:02,538][36154] DAMAGECOUNT value on done: 596431.0 [2023-02-25 13:55:02,539][36154] Sum rewards: 50.760, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.346', 'ARMOR': '0.004', 'AMMO5': '0.028', 'AMMO2': '0.063', 'AMMO3': '0.169', 'weapon5': '0.310', 'AMMO4': '0.315', 'weapon4': '0.492', 'weapon2': '0.618', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.172', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.434', 'FRAGCOUNT': '46.000'} [2023-02-25 13:55:02,657][36138] Updated weights for policy 0, policy_version 45153 (0.0009) [2023-02-25 13:55:02,697][36141] DAMAGECOUNT value on done: 600030.0 [2023-02-25 13:55:02,697][36141] Sum rewards: 65.018, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.250', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon4': '0.450', 'weapon2': '0.718', 'WEAPON3': '1.250', 'weapon3': '2.614', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '54.000'} [2023-02-25 13:55:02,844][36154] DAMAGECOUNT value on done: 582667.0 [2023-02-25 13:55:02,844][36154] Sum rewards: 41.564, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.492', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.096', 'AMMO4': '0.124', 'weapon4': '0.134', 'weapon2': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.289', 'WEAPON3': '1.800', 'HITCOUNT': '2.730', 'weapon3': '3.326', 'DAMAGECOUNT': '12.450', 'FRAGCOUNT': '41.000'} [2023-02-25 13:55:02,918][36141] DAMAGECOUNT value on done: 588091.0 [2023-02-25 13:55:02,918][36141] Sum rewards: 50.934, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.220', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.146', 'AMMO3': '0.235', 'WEAPON5': '0.350', 'weapon2': '0.408', 'WEAPON4': '0.450', 'weapon4': '0.722', 'WEAPON3': '1.400', 'weapon3': '2.426', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '14.946', 'FRAGCOUNT': '46.000'} [2023-02-25 13:55:03,020][36141] DAMAGECOUNT value on done: 597586.0 [2023-02-25 13:55:03,021][36141] Sum rewards: 47.504, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.555', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.078', 'AMMO3': '0.179', 'weapon2': '0.460', 'WEAPON3': '1.150', 'HITCOUNT': '2.850', 'weapon3': '3.260', 'DAMAGECOUNT': '12.405', 'FRAGCOUNT': '39.000'} [2023-02-25 13:55:03,121][36154] DAMAGECOUNT value on done: 593842.0 [2023-02-25 13:55:03,121][36154] Sum rewards: 58.358, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.735', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.166', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.488', 'weapon2': '0.572', 'WEAPON3': '1.100', 'weapon3': '2.524', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.414', 'FRAGCOUNT': '48.000'} [2023-02-25 13:55:03,227][36141] DAMAGECOUNT value on done: 584895.0 [2023-02-25 13:55:03,228][36141] Sum rewards: 49.696, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.586', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon7': '0.090', 'AMMO4': '0.119', 'weapon5': '0.138', 'weapon2': '0.154', 'AMMO3': '0.158', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.668', 'WEAPON3': '1.100', 'weapon3': '2.530', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.555', 'FRAGCOUNT': '43.000'} [2023-02-25 13:55:03,425][36154] DAMAGECOUNT value on done: 592623.0 [2023-02-25 13:55:03,426][36154] Sum rewards: 57.539, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.230', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.108', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon2': '0.234', 'WEAPON5': '0.250', 'weapon4': '0.436', 'WEAPON3': '1.250', 'HITCOUNT': '2.900', 'weapon3': '3.004', 'DAMAGECOUNT': '14.544', 'FRAGCOUNT': '50.000'} [2023-02-25 13:55:03,797][36157] DAMAGECOUNT value on done: 603515.0 [2023-02-25 13:55:03,797][36157] Sum rewards: 65.114, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.720', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO3': '0.139', 'AMMO4': '0.164', 'weapon5': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.442', 'weapon4': '0.720', 'WEAPON3': '0.900', 'weapon3': '2.398', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.939', 'FRAGCOUNT': '53.000'} [2023-02-25 13:55:04,101][36157] DAMAGECOUNT value on done: 592820.0 [2023-02-25 13:55:04,101][36157] Sum rewards: 56.393, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.370', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.126', 'weapon4': '0.170', 'AMMO4': '0.175', 'AMMO3': '0.182', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.726', 'WEAPON3': '1.150', 'weapon3': '2.730', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.527', 'FRAGCOUNT': '50.000'} [2023-02-25 13:55:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 184971264. Throughput: 0: 3354.0. Samples: 8740910. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:55:04,730][36114] Avg episode reward: [(0, '54.242')] [2023-02-25 13:55:04,765][36157] DAMAGECOUNT value on done: 600376.0 [2023-02-25 13:55:04,765][36157] Sum rewards: 55.193, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.409', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.035', 'AMMO3': '0.159', 'weapon5': '0.164', 'AMMO4': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.310', 'weapon4': '0.486', 'WEAPON3': '0.900', 'weapon3': '2.716', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.314', 'FRAGCOUNT': '46.000'} [2023-02-25 13:55:05,081][36157] DAMAGECOUNT value on done: 597134.0 [2023-02-25 13:55:05,082][36157] Sum rewards: 61.456, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.522', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.046', 'AMMO4': '0.074', 'weapon4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.308', 'WEAPON3': '1.300', 'HITCOUNT': '3.140', 'weapon3': '3.342', 'DAMAGECOUNT': '13.638', 'FRAGCOUNT': '54.000'} [2023-02-25 13:55:05,374][36140] DAMAGECOUNT value on done: 600615.0 [2023-02-25 13:55:05,375][36140] Sum rewards: 51.315, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.780', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.061', 'weapon5': '0.166', 'weapon2': '0.198', 'AMMO3': '0.209', 'AMMO4': '0.304', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.850', 'WEAPON3': '1.150', 'weapon3': '2.404', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '44.000'} [2023-02-25 13:55:05,671][36138] Updated weights for policy 0, policy_version 45163 (0.0009) [2023-02-25 13:55:05,672][36140] DAMAGECOUNT value on done: 582100.0 [2023-02-25 13:55:05,673][36140] Sum rewards: 47.708, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.688', 'ARMOR': '0.008', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.118', 'AMMO4': '0.153', 'AMMO3': '0.173', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON4': '0.400', 'weapon4': '0.518', 'WEAPON3': '1.100', 'weapon3': '2.802', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.414', 'FRAGCOUNT': '42.000'} [2023-02-25 13:55:05,960][36140] DAMAGECOUNT value on done: 590848.0 [2023-02-25 13:55:05,961][36140] Sum rewards: 64.348, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.410', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.144', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon2': '0.278', 'weapon4': '0.310', 'WEAPON3': '1.200', 'weapon3': '3.000', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '54.000'} [2023-02-25 13:55:06,265][36140] DAMAGECOUNT value on done: 590377.0 [2023-02-25 13:55:06,266][36140] Sum rewards: 47.889, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.930', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO2': '0.038', 'AMMO4': '0.190', 'AMMO3': '0.220', 'weapon5': '0.260', 'weapon2': '0.272', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.680', 'WEAPON3': '1.300', 'weapon3': '2.176', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.940', 'FRAGCOUNT': '44.000'} [2023-02-25 13:55:06,652][36156] Large shaping reward 2.511 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.51, 170.0), ('HEALTH', -0.021, -7.0), ('weapon5', 0.002)] [2023-02-25 13:55:06,900][36142] DAMAGECOUNT value on done: 599002.0 [2023-02-25 13:55:06,901][36142] Sum rewards: 68.071, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.620', 'AMMO5': '0.015', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.134', 'AMMO3': '0.142', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.478', 'weapon4': '0.784', 'WEAPON3': '0.900', 'weapon3': '2.244', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.750', 'FRAGCOUNT': '57.000'} [2023-02-25 13:55:06,931][36142] DAMAGECOUNT value on done: 581205.0 [2023-02-25 13:55:06,931][36142] Sum rewards: 47.472, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.470', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon5': '0.046', 'AMMO4': '0.053', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon2': '0.462', 'weapon4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.708', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.117', 'FRAGCOUNT': '42.000'} [2023-02-25 13:55:07,214][36142] DAMAGECOUNT value on done: 583941.0 [2023-02-25 13:55:07,214][36142] Sum rewards: 48.543, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.394', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.128', 'AMMO4': '0.141', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.288', 'weapon4': '0.406', 'WEAPON3': '1.100', 'weapon3': '2.716', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.432', 'FRAGCOUNT': '42.000'} [2023-02-25 13:55:07,241][36142] DAMAGECOUNT value on done: 595906.0 [2023-02-25 13:55:07,242][36142] Sum rewards: 60.528, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.671', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.170', 'weapon5': '0.190', 'AMMO3': '0.211', 'weapon2': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.778', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.603', 'FRAGCOUNT': '53.000'} [2023-02-25 13:55:08,148][36155] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:55:08,281][36156] DAMAGECOUNT value on done: 601386.0 [2023-02-25 13:55:08,281][36156] Sum rewards: 58.991, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.190', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.176', 'AMMO4': '0.193', 'AMMO3': '0.211', 'weapon2': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.730', 'WEAPON3': '1.200', 'weapon3': '2.556', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.285', 'FRAGCOUNT': '51.000'} [2023-02-25 13:55:08,318][36156] DAMAGECOUNT value on done: 605051.0 [2023-02-25 13:55:08,319][36156] Sum rewards: 61.214, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.282', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.138', 'AMMO3': '0.152', 'AMMO4': '0.177', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.510', 'weapon4': '0.706', 'WEAPON3': '0.850', 'weapon3': '2.298', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '15.156', 'FRAGCOUNT': '50.000'} [2023-02-25 13:55:08,590][36156] DAMAGECOUNT value on done: 589329.0 [2023-02-25 13:55:08,591][36156] Sum rewards: 47.861, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.352', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon5': '0.172', 'AMMO4': '0.188', 'AMMO3': '0.194', 'weapon2': '0.290', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.672', 'WEAPON3': '1.150', 'weapon3': '2.626', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '13.257', 'FRAGCOUNT': '42.500'} [2023-02-25 13:55:08,633][36156] DAMAGECOUNT value on done: 592899.0 [2023-02-25 13:55:08,634][36156] Sum rewards: 57.674, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.790', 'AMMO5': '0.003', 'AMMO2': '0.022', 'AMMO4': '0.107', 'AMMO3': '0.229', 'weapon2': '0.518', 'WEAPON3': '1.350', 'HITCOUNT': '3.180', 'weapon3': '3.336', 'DAMAGECOUNT': '13.470', 'FRAGCOUNT': '50.000'} [2023-02-25 13:55:08,694][36138] Updated weights for policy 0, policy_version 45173 (0.0009) [2023-02-25 13:55:09,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 185040896. Throughput: 0: 3354.5. Samples: 8751050. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:55:09,729][36114] Avg episode reward: [(0, '53.992')] [2023-02-25 13:55:11,703][36138] Updated weights for policy 0, policy_version 45183 (0.0009) [2023-02-25 13:55:12,632][36155] DAMAGECOUNT value on done: 584782.0 [2023-02-25 13:55:12,633][36155] Sum rewards: 55.083, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.930', 'AMMO5': '0.018', 'AMMO2': '0.031', 'weapon5': '0.134', 'AMMO4': '0.153', 'AMMO3': '0.245', 'weapon4': '0.294', 'WEAPON4': '0.350', 'weapon2': '0.364', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.936', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.968', 'FRAGCOUNT': '52.000'} [2023-02-25 13:55:12,949][36155] DAMAGECOUNT value on done: 605815.0 [2023-02-25 13:55:12,949][36155] Sum rewards: 52.299, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.620', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon5': '0.094', 'AMMO4': '0.240', 'AMMO3': '0.250', 'weapon2': '0.282', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.862', 'WEAPON3': '1.500', 'weapon3': '2.408', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.736', 'FRAGCOUNT': '49.000'} [2023-02-25 13:55:13,559][36155] DAMAGECOUNT value on done: 600905.0 [2023-02-25 13:55:13,560][36155] Sum rewards: 49.168, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.164', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO3': '0.161', 'AMMO4': '0.182', 'weapon5': '0.244', 'weapon2': '0.348', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.510', 'WEAPON3': '0.900', 'weapon3': '2.616', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '14.022', 'FRAGCOUNT': '42.000'} [2023-02-25 13:55:13,701][36139] DAMAGECOUNT value on done: 601048.0 [2023-02-25 13:55:13,701][36139] Sum rewards: 54.293, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.341', 'AMMO5': '0.020', 'AMMO2': '0.042', 'AMMO3': '0.204', 'weapon5': '0.206', 'weapon4': '0.212', 'AMMO4': '0.212', 'WEAPON4': '0.500', 'weapon2': '0.504', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.762', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.531', 'FRAGCOUNT': '48.000'} [2023-02-25 13:55:13,864][36155] DAMAGECOUNT value on done: 593212.0 [2023-02-25 13:55:13,864][36155] Sum rewards: 54.099, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.240', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.024', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'weapon4': '0.368', 'weapon2': '0.642', 'WEAPON3': '1.200', 'weapon3': '2.740', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.635', 'FRAGCOUNT': '47.000'} [2023-02-25 13:55:14,009][36139] DAMAGECOUNT value on done: 590696.0 [2023-02-25 13:55:14,010][36139] Sum rewards: 40.633, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.698', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.082', 'AMMO4': '0.083', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.466', 'weapon2': '0.614', 'WEAPON3': '1.450', 'weapon3': '2.562', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.312', 'FRAGCOUNT': '37.000'} [2023-02-25 13:55:14,560][36139] DAMAGECOUNT value on done: 600434.0 [2023-02-25 13:55:14,561][36139] Sum rewards: 45.392, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.404', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.065', 'AMMO3': '0.140', 'weapon2': '0.214', 'AMMO4': '0.327', 'weapon5': '0.386', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '0.750', 'weapon4': '1.218', 'weapon3': '1.764', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '13.338', 'FRAGCOUNT': '36.500'} [2023-02-25 13:55:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 185106432. Throughput: 0: 3362.8. Samples: 8771436. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:55:14,730][36114] Avg episode reward: [(0, '53.480')] [2023-02-25 13:55:14,752][36138] Updated weights for policy 0, policy_version 45193 (0.0009) [2023-02-25 13:55:14,871][36139] DAMAGECOUNT value on done: 596124.0 [2023-02-25 13:55:14,871][36139] Sum rewards: 39.764, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.788', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.054', 'weapon5': '0.082', 'AMMO4': '0.184', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.422', 'WEAPON3': '1.400', 'HITCOUNT': '2.550', 'weapon3': '3.204', 'DAMAGECOUNT': '12.126', 'FRAGCOUNT': '36.000'} [2023-02-25 13:55:17,816][36138] Updated weights for policy 0, policy_version 45203 (0.0009) [2023-02-25 13:55:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 185176064. Throughput: 0: 3363.1. Samples: 8791588. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:55:19,729][36114] Avg episode reward: [(0, '53.372')] [2023-02-25 13:55:19,732][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000045209_185176064.pth... [2023-02-25 13:55:19,789][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000044423_181956608.pth [2023-02-25 13:55:20,906][36138] Updated weights for policy 0, policy_version 45213 (0.0009) [2023-02-25 13:55:22,524][36141] DAMAGECOUNT value on done: 604731.0 [2023-02-25 13:55:22,524][36141] Sum rewards: 55.064, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.695', 'AMMO5': '0.008', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.082', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.318', 'weapon2': '0.458', 'WEAPON3': '1.000', 'weapon3': '2.858', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.103', 'FRAGCOUNT': '44.000'} [2023-02-25 13:55:22,533][36154] DAMAGECOUNT value on done: 600495.0 [2023-02-25 13:55:22,534][36154] Sum rewards: 49.113, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.128', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'weapon4': '0.326', 'weapon2': '0.408', 'WEAPON3': '0.900', 'HITCOUNT': '2.970', 'weapon3': '2.986', 'DAMAGECOUNT': '12.192', 'FRAGCOUNT': '41.000'} [2023-02-25 13:55:22,756][36141] DAMAGECOUNT value on done: 593123.0 [2023-02-25 13:55:22,756][36141] Sum rewards: 65.364, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.844', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.040', 'weapon5': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon2': '0.288', 'weapon4': '0.332', 'WEAPON3': '1.100', 'weapon3': '3.148', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.096', 'FRAGCOUNT': '54.000'} [2023-02-25 13:55:22,840][36141] DAMAGECOUNT value on done: 601216.0 [2023-02-25 13:55:22,840][36141] Sum rewards: 40.712, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.395', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.028', 'weapon4': '0.032', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon2': '0.778', 'WEAPON3': '1.150', 'HITCOUNT': '2.370', 'weapon3': '2.986', 'DAMAGECOUNT': '10.890', 'FRAGCOUNT': '37.000'} [2023-02-25 13:55:22,841][36154] DAMAGECOUNT value on done: 587386.0 [2023-02-25 13:55:22,841][36154] Sum rewards: 55.315, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.286', 'AMMO5': '0.018', 'AMMO2': '0.053', 'AMMO3': '0.161', 'weapon5': '0.192', 'AMMO4': '0.266', 'weapon4': '0.384', 'weapon2': '0.418', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '0.900', 'weapon3': '2.704', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.575', 'FRAGCOUNT': '49.000'} [2023-02-25 13:55:23,079][36141] DAMAGECOUNT value on done: 589360.0 [2023-02-25 13:55:23,080][36141] Sum rewards: 47.065, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.276', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.049', 'AMMO3': '0.166', 'weapon5': '0.220', 'AMMO4': '0.244', 'weapon2': '0.300', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.702', 'WEAPON3': '1.000', 'weapon3': '2.386', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.395', 'FRAGCOUNT': '39.000'} [2023-02-25 13:55:23,116][36154] DAMAGECOUNT value on done: 599348.0 [2023-02-25 13:55:23,117][36154] Sum rewards: 63.264, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.350', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.052', 'AMMO4': '0.127', 'weapon4': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.262', 'weapon2': '0.340', 'WEAPON3': '1.550', 'weapon3': '3.230', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '56.000'} [2023-02-25 13:55:23,424][36154] DAMAGECOUNT value on done: 597766.0 [2023-02-25 13:55:23,425][36154] Sum rewards: 54.583, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.522', 'AMMO5': '0.012', 'AMMO2': '0.040', 'AMMO3': '0.169', 'weapon5': '0.172', 'AMMO4': '0.199', 'weapon2': '0.376', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.590', 'WEAPON3': '1.150', 'weapon3': '2.598', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.429', 'FRAGCOUNT': '48.000'} [2023-02-25 13:55:23,831][36157] DAMAGECOUNT value on done: 608431.0 [2023-02-25 13:55:23,832][36157] Sum rewards: 48.416, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.112', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon5': '0.182', 'AMMO3': '0.245', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.410', 'WEAPON3': '1.400', 'weapon3': '2.722', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.748', 'FRAGCOUNT': '43.000'} [2023-02-25 13:55:23,929][36138] Updated weights for policy 0, policy_version 45223 (0.0009) [2023-02-25 13:55:24,143][36157] DAMAGECOUNT value on done: 597456.0 [2023-02-25 13:55:24,143][36157] Sum rewards: 52.567, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.015', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.164', 'weapon5': '0.204', 'AMMO4': '0.231', 'AMMO3': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '2.690', 'weapon3': '2.898', 'DAMAGECOUNT': '13.908', 'FRAGCOUNT': '49.000'} [2023-02-25 13:55:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 185241600. Throughput: 0: 3363.5. Samples: 8801656. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:55:24,730][36114] Avg episode reward: [(0, '53.320')] [2023-02-25 13:55:24,849][36157] DAMAGECOUNT value on done: 605820.0 [2023-02-25 13:55:24,849][36157] Sum rewards: 62.353, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.346', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.064', 'AMMO4': '0.111', 'weapon2': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.262', 'weapon4': '0.564', 'WEAPON3': '1.600', 'weapon3': '2.958', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.332', 'FRAGCOUNT': '54.000'} [2023-02-25 13:55:25,139][36157] DAMAGECOUNT value on done: 602099.0 [2023-02-25 13:55:25,140][36157] Sum rewards: 52.965, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.360', 'AMMO5': '0.017', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.156', 'weapon4': '0.184', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'weapon2': '0.496', 'WEAPON3': '1.550', 'weapon3': '2.860', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.895', 'FRAGCOUNT': '48.000'} [2023-02-25 13:55:25,221][36140] DAMAGECOUNT value on done: 605450.0 [2023-02-25 13:55:25,221][36140] Sum rewards: 54.745, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.140', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.210', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.376', 'weapon4': '0.402', 'WEAPON3': '1.350', 'weapon3': '2.730', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.505', 'FRAGCOUNT': '48.500'} [2023-02-25 13:55:25,532][36140] DAMAGECOUNT value on done: 586325.0 [2023-02-25 13:55:25,532][36140] Sum rewards: 41.247, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.066', 'AMMO5': '0.021', 'AMMO2': '0.046', 'weapon4': '0.094', 'weapon5': '0.136', 'AMMO3': '0.172', 'AMMO4': '0.229', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.632', 'WEAPON3': '0.950', 'HITCOUNT': '2.580', 'weapon3': '2.878', 'DAMAGECOUNT': '12.675', 'FRAGCOUNT': '35.000'} [2023-02-25 13:55:25,832][36140] DAMAGECOUNT value on done: 596007.0 [2023-02-25 13:55:25,833][36140] Sum rewards: 61.385, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.894', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.122', 'AMMO3': '0.167', 'weapon5': '0.236', 'weapon4': '0.360', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.406', 'WEAPON3': '1.050', 'weapon3': '2.776', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '52.500'} [2023-02-25 13:55:26,161][36140] DAMAGECOUNT value on done: 595345.0 [2023-02-25 13:55:26,162][36140] Sum rewards: 59.379, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.824', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.152', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.100', 'weapon4': '1.126', 'weapon3': '2.146', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.904', 'FRAGCOUNT': '50.000'} [2023-02-25 13:55:26,922][36142] DAMAGECOUNT value on done: 603009.0 [2023-02-25 13:55:26,922][36142] Sum rewards: 48.660, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.740', 'AMMO5': '0.010', 'AMMO2': '0.044', 'AMMO3': '0.131', 'weapon5': '0.172', 'AMMO4': '0.219', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.470', 'weapon4': '0.552', 'WEAPON3': '0.850', 'weapon3': '2.280', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '12.021', 'FRAGCOUNT': '40.000'} [2023-02-25 13:55:26,963][36142] DAMAGECOUNT value on done: 585920.0 [2023-02-25 13:55:26,964][36142] Sum rewards: 53.964, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.408', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.047', 'AMMO4': '0.233', 'AMMO3': '0.235', 'weapon5': '0.266', 'weapon2': '0.362', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.514', 'WEAPON3': '1.350', 'weapon3': '2.514', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.130', 'FRAGCOUNT': '51.000'} [2023-02-25 13:55:27,032][36138] Updated weights for policy 0, policy_version 45233 (0.0009) [2023-02-25 13:55:27,079][36154] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:55:27,248][36142] DAMAGECOUNT value on done: 588409.0 [2023-02-25 13:55:27,249][36142] Sum rewards: 53.116, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.574', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon5': '0.156', 'AMMO3': '0.186', 'AMMO4': '0.224', 'weapon2': '0.316', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.456', 'WEAPON3': '1.150', 'HITCOUNT': '2.640', 'weapon3': '2.810', 'DAMAGECOUNT': '13.389', 'FRAGCOUNT': '47.000'} [2023-02-25 13:55:27,285][36142] DAMAGECOUNT value on done: 601064.0 [2023-02-25 13:55:27,286][36142] Sum rewards: 63.427, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.017', 'AMMO2': '0.041', 'HEALTH': '0.090', 'AMMO3': '0.177', 'AMMO4': '0.204', 'weapon4': '0.216', 'weapon5': '0.236', 'weapon2': '0.306', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'weapon3': '2.926', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.474', 'FRAGCOUNT': '54.000'} [2023-02-25 13:55:28,306][36156] DAMAGECOUNT value on done: 606521.0 [2023-02-25 13:55:28,306][36156] Sum rewards: 54.715, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.455', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.052', 'weapon5': '0.152', 'weapon4': '0.230', 'AMMO3': '0.250', 'AMMO4': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.500', 'weapon3': '2.924', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '50.000'} [2023-02-25 13:55:28,345][36156] DAMAGECOUNT value on done: 608707.0 [2023-02-25 13:55:28,345][36156] Sum rewards: 45.287, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.403', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.124', 'weapon5': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.290', 'weapon2': '0.618', 'WEAPON3': '0.850', 'HITCOUNT': '2.270', 'weapon3': '2.720', 'DAMAGECOUNT': '10.968', 'FRAGCOUNT': '38.000'} [2023-02-25 13:55:28,613][36156] DAMAGECOUNT value on done: 593601.0 [2023-02-25 13:55:28,614][36156] Sum rewards: 52.781, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.589', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.089', 'weapon5': '0.110', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.340', 'weapon4': '0.358', 'WEAPON3': '0.950', 'HITCOUNT': '2.630', 'weapon3': '2.868', 'DAMAGECOUNT': '12.816', 'FRAGCOUNT': '44.000'} [2023-02-25 13:55:28,654][36156] DAMAGECOUNT value on done: 597440.0 [2023-02-25 13:55:28,654][36156] Sum rewards: 55.864, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.650', 'AMMO2': '0.018', 'ARMOR': '0.024', 'AMMO4': '0.090', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon4': '0.322', 'weapon2': '0.454', 'WEAPON3': '1.150', 'weapon3': '3.038', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.623', 'FRAGCOUNT': '48.000'} [2023-02-25 13:55:29,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 185307136. Throughput: 0: 3359.6. Samples: 8821660. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:55:29,730][36114] Avg episode reward: [(0, '53.360')] [2023-02-25 13:55:30,074][36138] Updated weights for policy 0, policy_version 45243 (0.0009) [2023-02-25 13:55:32,608][36155] DAMAGECOUNT value on done: 590525.0 [2023-02-25 13:55:32,609][36155] Sum rewards: 63.999, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.433', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'weapon5': '0.176', 'AMMO3': '0.179', 'AMMO4': '0.192', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.542', 'weapon2': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.454', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '56.000'} [2023-02-25 13:55:32,888][36155] DAMAGECOUNT value on done: 610663.0 [2023-02-25 13:55:32,888][36155] Sum rewards: 55.916, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.430', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO3': '0.124', 'AMMO4': '0.184', 'weapon5': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.530', 'weapon2': '0.576', 'WEAPON3': '0.750', 'weapon3': '2.446', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.544', 'FRAGCOUNT': '46.000'} [2023-02-25 13:55:33,104][36138] Updated weights for policy 0, policy_version 45253 (0.0009) [2023-02-25 13:55:33,467][36155] DAMAGECOUNT value on done: 605710.0 [2023-02-25 13:55:33,468][36155] Sum rewards: 53.887, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.047', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO4': '0.195', 'AMMO3': '0.196', 'weapon5': '0.226', 'WEAPON5': '0.300', 'weapon4': '0.308', 'weapon2': '0.372', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.822', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.352', 'FRAGCOUNT': '46.000'} [2023-02-25 13:55:33,646][36139] DAMAGECOUNT value on done: 605658.0 [2023-02-25 13:55:33,647][36139] Sum rewards: 55.936, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.038', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.035', 'weapon5': '0.098', 'AMMO3': '0.148', 'AMMO4': '0.177', 'WEAPON5': '0.250', 'weapon2': '0.410', 'WEAPON4': '0.450', 'weapon4': '0.532', 'WEAPON3': '0.800', 'weapon3': '2.648', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.830', 'FRAGCOUNT': '47.000'} [2023-02-25 13:55:33,779][36155] DAMAGECOUNT value on done: 598306.0 [2023-02-25 13:55:33,780][36155] Sum rewards: 54.730, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.322', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.045', 'AMMO3': '0.148', 'weapon5': '0.176', 'AMMO4': '0.225', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.616', 'weapon4': '0.660', 'WEAPON3': '0.950', 'weapon3': '2.330', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.282', 'FRAGCOUNT': '46.000'} [2023-02-25 13:55:33,984][36139] DAMAGECOUNT value on done: 596239.0 [2023-02-25 13:55:33,985][36139] Sum rewards: 68.215, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.920', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.064', 'AMMO4': '0.180', 'AMMO3': '0.199', 'weapon2': '0.222', 'weapon4': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.224', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '60.000'} [2023-02-25 13:55:34,566][36139] DAMAGECOUNT value on done: 605353.0 [2023-02-25 13:55:34,566][36139] Sum rewards: 54.932, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.523', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon5': '0.156', 'AMMO3': '0.159', 'AMMO4': '0.195', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.538', 'weapon2': '0.542', 'WEAPON3': '1.000', 'weapon3': '2.504', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.757', 'FRAGCOUNT': '47.000'} [2023-02-25 13:55:34,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13398.8). Total num frames: 185376768. Throughput: 0: 3358.9. Samples: 8841826. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:55:34,729][36114] Avg episode reward: [(0, '53.634')] [2023-02-25 13:55:34,872][36139] DAMAGECOUNT value on done: 601492.0 [2023-02-25 13:55:34,873][36139] Sum rewards: 56.453, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.486', 'AMMO5': '0.018', 'AMMO2': '0.035', 'AMMO4': '0.176', 'weapon5': '0.222', 'AMMO3': '0.239', 'weapon4': '0.342', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.462', 'WEAPON3': '1.450', 'weapon3': '2.700', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '50.000'} [2023-02-25 13:55:36,105][36138] Updated weights for policy 0, policy_version 45263 (0.0010) [2023-02-25 13:55:39,132][36138] Updated weights for policy 0, policy_version 45273 (0.0009) [2023-02-25 13:55:39,729][36114] Fps is (10 sec: 13516.5, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 185442304. Throughput: 0: 3361.4. Samples: 8852050. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:55:39,730][36114] Avg episode reward: [(0, '53.557')] [2023-02-25 13:55:42,206][36138] Updated weights for policy 0, policy_version 45283 (0.0009) [2023-02-25 13:55:42,568][36154] DAMAGECOUNT value on done: 604590.0 [2023-02-25 13:55:42,569][36154] Sum rewards: 47.597, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.402', 'AMMO2': '0.007', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'AMMO3': '0.205', 'weapon4': '0.244', 'weapon2': '0.456', 'WEAPON3': '1.250', 'HITCOUNT': '2.880', 'weapon3': '3.086', 'DAMAGECOUNT': '12.285', 'FRAGCOUNT': '42.000'} [2023-02-25 13:55:42,569][36141] DAMAGECOUNT value on done: 609504.0 [2023-02-25 13:55:42,569][36141] Sum rewards: 51.834, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.887', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.122', 'AMMO4': '0.199', 'AMMO3': '0.205', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.418', 'weapon4': '0.662', 'WEAPON3': '1.200', 'weapon3': '2.546', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.319', 'FRAGCOUNT': '45.000'} [2023-02-25 13:55:42,801][36141] DAMAGECOUNT value on done: 598381.0 [2023-02-25 13:55:42,801][36141] Sum rewards: 56.906, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.760', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon4': '0.254', 'weapon2': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.842', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.774', 'FRAGCOUNT': '49.000'} [2023-02-25 13:55:42,865][36154] DAMAGECOUNT value on done: 592222.0 [2023-02-25 13:55:42,865][36154] Sum rewards: 53.440, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.940', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.132', 'AMMO3': '0.207', 'weapon4': '0.344', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.418', 'WEAPON3': '1.200', 'weapon3': '2.880', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.508', 'FRAGCOUNT': '46.000'} [2023-02-25 13:55:42,893][36141] DAMAGECOUNT value on done: 605559.0 [2023-02-25 13:55:42,894][36141] Sum rewards: 43.874, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.602', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.038', 'weapon5': '0.096', 'AMMO4': '0.189', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.424', 'WEAPON4': '0.500', 'weapon4': '1.062', 'WEAPON3': '1.150', 'weapon3': '2.072', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.029', 'FRAGCOUNT': '40.000'} [2023-02-25 13:55:42,932][36155] Large shaping reward 2.538 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.516, 172.0), ('weapon5', 0.002)] [2023-02-25 13:55:43,119][36154] DAMAGECOUNT value on done: 603901.0 [2023-02-25 13:55:43,120][36154] Sum rewards: 48.440, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.807', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.190', 'AMMO3': '0.196', 'weapon4': '0.294', 'WEAPON4': '0.350', 'weapon2': '0.372', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.640', 'weapon3': '2.806', 'DAMAGECOUNT': '13.257', 'FRAGCOUNT': '42.000'} [2023-02-25 13:55:43,131][36141] DAMAGECOUNT value on done: 594156.0 [2023-02-25 13:55:43,132][36141] Sum rewards: 51.935, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.708', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.136', 'AMMO3': '0.183', 'AMMO4': '0.208', 'WEAPON5': '0.250', 'weapon4': '0.288', 'weapon2': '0.346', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.842', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.388', 'FRAGCOUNT': '45.000'} [2023-02-25 13:55:43,402][36154] DAMAGECOUNT value on done: 603184.0 [2023-02-25 13:55:43,402][36154] Sum rewards: 60.706, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.380', 'AMMO5': '0.017', 'AMMO2': '0.026', 'weapon5': '0.122', 'AMMO4': '0.127', 'weapon2': '0.164', 'AMMO3': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.574', 'WEAPON3': '1.450', 'weapon3': '2.802', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.254', 'FRAGCOUNT': '56.000'} [2023-02-25 13:55:43,774][36157] DAMAGECOUNT value on done: 612916.0 [2023-02-25 13:55:43,774][36157] Sum rewards: 56.154, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.182', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.078', 'AMMO4': '0.118', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'weapon4': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.740', 'WEAPON3': '1.200', 'weapon3': '2.768', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.455', 'FRAGCOUNT': '49.000'} [2023-02-25 13:55:44,086][36157] DAMAGECOUNT value on done: 601809.0 [2023-02-25 13:55:44,086][36157] Sum rewards: 51.077, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.970', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.086', 'AMMO3': '0.173', 'weapon5': '0.176', 'weapon2': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.682', 'WEAPON3': '1.150', 'weapon3': '2.592', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.059', 'FRAGCOUNT': '45.000'} [2023-02-25 13:55:44,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 185511936. Throughput: 0: 3361.1. Samples: 8872184. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:55:44,730][36114] Avg episode reward: [(0, '53.782')] [2023-02-25 13:55:44,829][36157] DAMAGECOUNT value on done: 611536.0 [2023-02-25 13:55:44,829][36157] Sum rewards: 56.562, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.662', 'AMMO5': '0.015', 'weapon5': '0.034', 'AMMO2': '0.038', 'AMMO4': '0.191', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'WEAPON4': '0.350', 'weapon4': '0.416', 'weapon2': '0.472', 'WEAPON3': '1.550', 'weapon3': '2.712', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.148', 'FRAGCOUNT': '51.000'} [2023-02-25 13:55:45,158][36157] DAMAGECOUNT value on done: 606369.0 [2023-02-25 13:55:45,158][36157] Sum rewards: 53.494, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.384', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.172', 'weapon2': '0.790', 'WEAPON3': '1.050', 'HITCOUNT': '2.650', 'weapon3': '3.060', 'DAMAGECOUNT': '12.810', 'FRAGCOUNT': '44.000'} [2023-02-25 13:55:45,258][36140] DAMAGECOUNT value on done: 610539.0 [2023-02-25 13:55:45,259][36140] Sum rewards: 55.060, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.058', 'AMMO5': '0.018', 'AMMO2': '0.047', 'AMMO3': '0.208', 'weapon5': '0.222', 'AMMO4': '0.235', 'weapon4': '0.394', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.548', 'WEAPON3': '1.200', 'weapon3': '2.528', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.129', 'FRAGCOUNT': '49.000'} [2023-02-25 13:55:45,322][36138] Updated weights for policy 0, policy_version 45293 (0.0009) [2023-02-25 13:55:45,578][36140] DAMAGECOUNT value on done: 591690.0 [2023-02-25 13:55:45,579][36140] Sum rewards: 59.625, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.272', 'ARMOR': '0.008', 'AMMO5': '0.024', 'AMMO2': '0.050', 'AMMO3': '0.182', 'AMMO4': '0.251', 'weapon2': '0.316', 'weapon5': '0.368', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'weapon4': '0.866', 'WEAPON3': '1.050', 'weapon3': '2.056', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '51.000'} [2023-02-25 13:55:45,892][36140] DAMAGECOUNT value on done: 601285.0 [2023-02-25 13:55:45,892][36140] Sum rewards: 63.987, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.260', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.016', 'AMMO4': '0.053', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.214', 'weapon2': '0.336', 'WEAPON3': '1.250', 'HITCOUNT': '3.350', 'weapon3': '3.388', 'DAMAGECOUNT': '15.834', 'FRAGCOUNT': '54.000'} [2023-02-25 13:55:46,203][36140] DAMAGECOUNT value on done: 600043.0 [2023-02-25 13:55:46,204][36140] Sum rewards: 51.809, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.955', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.046', 'AMMO4': '0.114', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon4': '0.260', 'weapon2': '0.586', 'WEAPON3': '1.200', 'weapon3': '2.894', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.094', 'FRAGCOUNT': '45.000'} [2023-02-25 13:55:46,992][36142] DAMAGECOUNT value on done: 608486.0 [2023-02-25 13:55:46,992][36142] Sum rewards: 63.764, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.430', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'WEAPON4': '0.150', 'weapon2': '0.156', 'AMMO3': '0.223', 'weapon4': '0.286', 'WEAPON3': '1.350', 'HITCOUNT': '3.330', 'weapon3': '3.342', 'DAMAGECOUNT': '16.431', 'FRAGCOUNT': '55.000'} [2023-02-25 13:55:47,041][36142] DAMAGECOUNT value on done: 590191.0 [2023-02-25 13:55:47,042][36142] Sum rewards: 52.750, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.382', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.141', 'AMMO4': '0.155', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon2': '0.418', 'WEAPON3': '0.800', 'weapon4': '0.974', 'weapon3': '2.294', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '12.813', 'FRAGCOUNT': '42.000'} [2023-02-25 13:55:47,311][36142] DAMAGECOUNT value on done: 593046.0 [2023-02-25 13:55:47,311][36142] Sum rewards: 58.589, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.650', 'AMMO5': '0.014', 'AMMO2': '0.041', 'AMMO3': '0.161', 'weapon2': '0.184', 'AMMO4': '0.205', 'weapon5': '0.268', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.494', 'WEAPON3': '0.900', 'weapon3': '2.790', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.911', 'FRAGCOUNT': '50.000'} [2023-02-25 13:55:47,362][36142] DAMAGECOUNT value on done: 605844.0 [2023-02-25 13:55:47,363][36142] Sum rewards: 54.235, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.695', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.194', 'AMMO3': '0.211', 'weapon2': '0.496', 'WEAPON3': '1.200', 'weapon3': '3.034', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.340', 'FRAGCOUNT': '45.500'} [2023-02-25 13:55:48,254][36156] DAMAGECOUNT value on done: 610352.0 [2023-02-25 13:55:48,255][36156] Sum rewards: 46.768, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.146', 'AMMO5': '0.009', 'weapon5': '0.032', 'AMMO2': '0.036', 'AMMO3': '0.133', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.330', 'weapon2': '0.630', 'WEAPON3': '0.850', 'HITCOUNT': '2.590', 'weapon3': '2.682', 'DAMAGECOUNT': '11.493', 'FRAGCOUNT': '39.000'} [2023-02-25 13:55:48,303][36156] DAMAGECOUNT value on done: 612911.0 [2023-02-25 13:55:48,304][36156] Sum rewards: 40.117, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.012', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO3': '0.195', 'AMMO4': '0.196', 'weapon2': '0.318', 'weapon5': '0.334', 'weapon4': '0.348', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.470', 'weapon3': '2.652', 'DAMAGECOUNT': '12.612', 'FRAGCOUNT': '36.500'} [2023-02-25 13:55:48,333][36138] Updated weights for policy 0, policy_version 45303 (0.0009) [2023-02-25 13:55:48,566][36156] DAMAGECOUNT value on done: 597725.0 [2023-02-25 13:55:48,567][36156] Sum rewards: 46.300, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.410', 'AMMO5': '0.003', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.163', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'weapon4': '0.426', 'weapon2': '0.598', 'WEAPON3': '1.100', 'HITCOUNT': '2.740', 'weapon3': '2.768', 'DAMAGECOUNT': '12.342', 'FRAGCOUNT': '40.000'} [2023-02-25 13:55:48,627][36156] DAMAGECOUNT value on done: 602522.0 [2023-02-25 13:55:48,628][36156] Sum rewards: 61.175, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.062', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.108', 'weapon2': '0.138', 'AMMO4': '0.151', 'weapon4': '0.182', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.270', 'weapon3': '3.390', 'DAMAGECOUNT': '15.246', 'FRAGCOUNT': '53.000'} [2023-02-25 13:55:49,729][36114] Fps is (10 sec: 13517.2, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 185577472. Throughput: 0: 3367.0. Samples: 8892426. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:55:49,730][36114] Avg episode reward: [(0, '53.985')] [2023-02-25 13:55:51,349][36138] Updated weights for policy 0, policy_version 45313 (0.0009) [2023-02-25 13:55:52,303][36155] DAMAGECOUNT value on done: 595538.0 [2023-02-25 13:55:52,304][36155] Sum rewards: 53.926, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.675', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO3': '0.179', 'AMMO4': '0.187', 'weapon5': '0.216', 'WEAPON5': '0.450', 'weapon2': '0.524', 'WEAPON4': '0.550', 'weapon4': '0.698', 'WEAPON3': '1.100', 'weapon3': '2.248', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '15.039', 'FRAGCOUNT': '47.000'} [2023-02-25 13:55:52,612][36155] DAMAGECOUNT value on done: 614895.0 [2023-02-25 13:55:52,613][36155] Sum rewards: 44.789, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.157', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.029', 'AMMO4': '0.144', 'AMMO3': '0.166', 'WEAPON4': '0.250', 'weapon4': '0.286', 'WEAPON5': '0.350', 'weapon5': '0.354', 'weapon2': '0.650', 'WEAPON3': '1.050', 'HITCOUNT': '2.440', 'weapon3': '2.510', 'DAMAGECOUNT': '12.696', 'FRAGCOUNT': '36.500'} [2023-02-25 13:55:53,200][36155] DAMAGECOUNT value on done: 610038.0 [2023-02-25 13:55:53,201][36155] Sum rewards: 45.739, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.624', 'AMMO5': '0.011', 'AMMO2': '0.043', 'AMMO3': '0.149', 'weapon5': '0.174', 'AMMO4': '0.216', 'WEAPON5': '0.350', 'ARMOR': '0.451', 'WEAPON4': '0.550', 'weapon2': '0.694', 'weapon4': '0.762', 'WEAPON3': '0.900', 'weapon3': '2.158', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '12.984', 'FRAGCOUNT': '39.000'} [2023-02-25 13:55:53,506][36155] DAMAGECOUNT value on done: 603082.0 [2023-02-25 13:55:53,507][36155] Sum rewards: 52.158, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.776', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon5': '0.162', 'AMMO3': '0.188', 'AMMO4': '0.200', 'weapon2': '0.322', 'WEAPON5': '0.350', 'weapon4': '0.446', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.760', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.328', 'FRAGCOUNT': '46.000'} [2023-02-25 13:55:53,664][36139] DAMAGECOUNT value on done: 609556.0 [2023-02-25 13:55:53,665][36139] Sum rewards: 45.615, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.580', 'AMMO5': '0.008', 'AMMO2': '0.040', 'AMMO3': '0.146', 'weapon5': '0.164', 'weapon4': '0.182', 'AMMO4': '0.199', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.486', 'WEAPON3': '0.850', 'HITCOUNT': '2.470', 'weapon3': '3.006', 'DAMAGECOUNT': '11.694', 'FRAGCOUNT': '40.000'} [2023-02-25 13:55:53,972][36139] DAMAGECOUNT value on done: 600537.0 [2023-02-25 13:55:53,972][36139] Sum rewards: 52.755, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.262', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.046', 'weapon2': '0.188', 'AMMO3': '0.195', 'AMMO4': '0.230', 'weapon5': '0.350', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon4': '1.282', 'weapon3': '1.698', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.894', 'FRAGCOUNT': '49.000'} [2023-02-25 13:55:54,401][36138] Updated weights for policy 0, policy_version 45323 (0.0009) [2023-02-25 13:55:54,550][36139] DAMAGECOUNT value on done: 610840.0 [2023-02-25 13:55:54,550][36139] Sum rewards: 56.069, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.000', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.100', 'AMMO4': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.198', 'AMMO3': '0.298', 'weapon4': '0.362', 'WEAPON3': '1.750', 'weapon3': '3.010', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '51.000'} [2023-02-25 13:55:54,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13398.8). Total num frames: 185647104. Throughput: 0: 3365.3. Samples: 8902490. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:55:54,729][36114] Avg episode reward: [(0, '53.656')] [2023-02-25 13:55:54,863][36139] DAMAGECOUNT value on done: 606577.0 [2023-02-25 13:55:54,864][36139] Sum rewards: 64.482, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.872', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.252', 'weapon4': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.044', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.255', 'FRAGCOUNT': '56.000'} [2023-02-25 13:55:57,454][36138] Updated weights for policy 0, policy_version 45333 (0.0010) [2023-02-25 13:55:58,761][36139] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 13:55:59,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 185712640. Throughput: 0: 3359.7. Samples: 8922622. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:55:59,730][36114] Avg episode reward: [(0, '53.843')] [2023-02-25 13:56:00,496][36138] Updated weights for policy 0, policy_version 45343 (0.0009) [2023-02-25 13:56:01,313][36155] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 13:56:02,493][36154] DAMAGECOUNT value on done: 609146.0 [2023-02-25 13:56:02,494][36154] Sum rewards: 50.350, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.454', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.126', 'AMMO3': '0.209', 'weapon4': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.452', 'WEAPON3': '1.250', 'HITCOUNT': '2.740', 'weapon3': '2.848', 'DAMAGECOUNT': '13.668', 'FRAGCOUNT': '44.000'} [2023-02-25 13:56:02,692][36141] DAMAGECOUNT value on done: 614396.0 [2023-02-25 13:56:02,692][36141] Sum rewards: 57.668, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.205', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.253', 'weapon2': '0.282', 'WEAPON3': '1.550', 'HITCOUNT': '3.120', 'weapon3': '3.290', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '52.000'} [2023-02-25 13:56:02,804][36154] DAMAGECOUNT value on done: 597070.0 [2023-02-25 13:56:02,804][36154] Sum rewards: 53.696, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.495', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.054', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.270', 'AMMO3': '0.272', 'weapon2': '0.362', 'WEAPON3': '1.650', 'weapon3': '3.096', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.544', 'FRAGCOUNT': '49.000'} [2023-02-25 13:56:02,938][36141] DAMAGECOUNT value on done: 603009.0 [2023-02-25 13:56:02,939][36141] Sum rewards: 50.514, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.706', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.030', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'weapon5': '0.176', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.520', 'weapon4': '0.640', 'WEAPON3': '1.250', 'weapon3': '2.328', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.884', 'FRAGCOUNT': '43.000'} [2023-02-25 13:56:03,034][36141] DAMAGECOUNT value on done: 610841.0 [2023-02-25 13:56:03,034][36141] Sum rewards: 61.042, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.042', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.076', 'weapon4': '0.088', 'AMMO4': '0.141', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.264', 'WEAPON3': '1.200', 'HITCOUNT': '3.140', 'weapon3': '3.366', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '52.000'} [2023-02-25 13:56:03,111][36154] DAMAGECOUNT value on done: 608332.0 [2023-02-25 13:56:03,112][36154] Sum rewards: 52.235, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.610', 'AMMO5': '0.003', 'AMMO2': '0.042', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.141', 'AMMO4': '0.208', 'WEAPON4': '0.400', 'weapon2': '0.544', 'weapon4': '0.602', 'WEAPON3': '0.850', 'weapon3': '2.578', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.293', 'FRAGCOUNT': '43.000'} [2023-02-25 13:56:03,294][36141] DAMAGECOUNT value on done: 598498.0 [2023-02-25 13:56:03,295][36141] Sum rewards: 50.213, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.330', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.016', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'weapon4': '0.368', 'weapon2': '0.572', 'WEAPON3': '1.050', 'weapon3': '2.674', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.026', 'FRAGCOUNT': '42.000'} [2023-02-25 13:56:03,439][36154] DAMAGECOUNT value on done: 608311.0 [2023-02-25 13:56:03,439][36154] Sum rewards: 52.455, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.240', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.064', 'AMMO4': '0.121', 'weapon2': '0.210', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'weapon4': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.146', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.381', 'FRAGCOUNT': '46.500'} [2023-02-25 13:56:03,612][36138] Updated weights for policy 0, policy_version 45353 (0.0008) [2023-02-25 13:56:03,857][36157] DAMAGECOUNT value on done: 617436.0 [2023-02-25 13:56:03,858][36157] Sum rewards: 56.383, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.630', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.038', 'AMMO3': '0.141', 'AMMO4': '0.190', 'weapon5': '0.262', 'WEAPON5': '0.350', 'weapon4': '0.376', 'WEAPON4': '0.450', 'weapon2': '0.450', 'WEAPON3': '0.900', 'weapon3': '2.620', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.560', 'FRAGCOUNT': '47.000'} [2023-02-25 13:56:04,180][36157] DAMAGECOUNT value on done: 607437.0 [2023-02-25 13:56:04,180][36157] Sum rewards: 56.945, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.090', 'ARMOR': '0.012', 'AMMO5': '0.016', 'AMMO2': '0.034', 'AMMO4': '0.169', 'weapon5': '0.174', 'AMMO3': '0.271', 'weapon2': '0.308', 'WEAPON5': '0.350', 'weapon4': '0.394', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.782', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '52.000'} [2023-02-25 13:56:04,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13448.6, 300 sec: 13398.8). Total num frames: 185778176. Throughput: 0: 3356.8. Samples: 8942644. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:56:04,729][36114] Avg episode reward: [(0, '53.964')] [2023-02-25 13:56:04,904][36157] DAMAGECOUNT value on done: 616643.0 [2023-02-25 13:56:04,905][36157] Sum rewards: 56.872, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.910', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.158', 'weapon5': '0.186', 'AMMO4': '0.190', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.556', 'weapon2': '0.608', 'WEAPON3': '0.950', 'weapon3': '2.334', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.321', 'FRAGCOUNT': '48.000'} [2023-02-25 13:56:05,211][36157] DAMAGECOUNT value on done: 611589.0 [2023-02-25 13:56:05,212][36157] Sum rewards: 64.782, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.451', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.084', 'weapon2': '0.144', 'AMMO4': '0.150', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.224', 'AMMO3': '0.227', 'WEAPON3': '1.400', 'HITCOUNT': '3.350', 'weapon3': '3.358', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '57.000'} [2023-02-25 13:56:05,283][36140] DAMAGECOUNT value on done: 615244.0 [2023-02-25 13:56:05,283][36140] Sum rewards: 59.166, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'weapon5': '0.200', 'weapon2': '0.334', 'HEALTH': '0.423', 'weapon4': '0.426', 'WEAPON3': '0.950', 'weapon3': '2.832', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.115', 'FRAGCOUNT': '49.000'} [2023-02-25 13:56:05,594][36140] DAMAGECOUNT value on done: 595687.0 [2023-02-25 13:56:05,594][36140] Sum rewards: 48.413, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.855', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.142', 'weapon5': '0.188', 'weapon2': '0.372', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.794', 'WEAPON3': '0.850', 'weapon3': '2.458', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '11.991', 'FRAGCOUNT': '41.000'} [2023-02-25 13:56:05,908][36140] DAMAGECOUNT value on done: 606123.0 [2023-02-25 13:56:05,908][36140] Sum rewards: 54.378, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.150', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'weapon2': '0.220', 'weapon4': '0.220', 'AMMO3': '0.325', 'WEAPON3': '1.900', 'HITCOUNT': '3.130', 'weapon3': '3.268', 'DAMAGECOUNT': '14.514', 'FRAGCOUNT': '51.000'} [2023-02-25 13:56:06,212][36140] DAMAGECOUNT value on done: 605273.0 [2023-02-25 13:56:06,212][36140] Sum rewards: 59.056, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.990', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.068', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon4': '0.254', 'weapon2': '0.468', 'WEAPON3': '1.400', 'weapon3': '3.002', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '49.000'} [2023-02-25 13:56:06,638][36138] Updated weights for policy 0, policy_version 45363 (0.0010) [2023-02-25 13:56:06,994][36142] DAMAGECOUNT value on done: 613825.0 [2023-02-25 13:56:06,995][36142] Sum rewards: 56.567, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.576', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.092', 'AMMO4': '0.111', 'AMMO3': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON4': '0.350', 'weapon4': '0.446', 'WEAPON3': '1.500', 'weapon3': '2.880', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '51.000'} [2023-02-25 13:56:07,036][36142] DAMAGECOUNT value on done: 595434.0 [2023-02-25 13:56:07,037][36142] Sum rewards: 57.810, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.620', 'AMMO5': '0.007', 'weapon5': '0.046', 'AMMO2': '0.049', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'AMMO4': '0.244', 'weapon2': '0.274', 'weapon4': '0.376', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.096', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.729', 'FRAGCOUNT': '48.000'} [2023-02-25 13:56:07,306][36142] DAMAGECOUNT value on done: 597671.0 [2023-02-25 13:56:07,306][36142] Sum rewards: 56.635, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.320', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.043', 'AMMO3': '0.148', 'weapon5': '0.172', 'AMMO4': '0.214', 'weapon2': '0.398', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon4': '0.562', 'WEAPON3': '1.050', 'weapon3': '2.516', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.875', 'FRAGCOUNT': '49.000'} [2023-02-25 13:56:07,344][36142] DAMAGECOUNT value on done: 609920.0 [2023-02-25 13:56:07,344][36142] Sum rewards: 45.306, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.619', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.054', 'AMMO3': '0.165', 'AMMO4': '0.171', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.404', 'weapon4': '0.620', 'WEAPON3': '1.150', 'weapon3': '2.732', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.228', 'FRAGCOUNT': '40.000'} [2023-02-25 13:56:08,347][36156] DAMAGECOUNT value on done: 614922.0 [2023-02-25 13:56:08,347][36156] Sum rewards: 51.985, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.780', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.116', 'weapon2': '0.146', 'AMMO4': '0.167', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.338', 'WEAPON3': '1.350', 'weapon3': '3.082', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.710', 'FRAGCOUNT': '47.000'} [2023-02-25 13:56:08,389][36156] DAMAGECOUNT value on done: 617043.0 [2023-02-25 13:56:08,390][36156] Sum rewards: 51.265, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.256', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.101', 'weapon2': '0.154', 'AMMO3': '0.191', 'weapon4': '0.330', 'WEAPON3': '1.050', 'HITCOUNT': '2.930', 'weapon3': '3.202', 'DAMAGECOUNT': '12.396', 'FRAGCOUNT': '43.000'} [2023-02-25 13:56:08,673][36156] DAMAGECOUNT value on done: 603034.0 [2023-02-25 13:56:08,673][36156] Sum rewards: 64.804, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.448', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.098', 'weapon4': '0.130', 'AMMO4': '0.169', 'AMMO3': '0.203', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.200', 'weapon3': '3.170', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.927', 'FRAGCOUNT': '56.000'} [2023-02-25 13:56:08,731][36156] DAMAGECOUNT value on done: 607592.0 [2023-02-25 13:56:08,731][36156] Sum rewards: 62.852, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.875', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon4': '0.288', 'weapon2': '0.376', 'WEAPON3': '1.150', 'weapon3': '3.042', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '54.000'} [2023-02-25 13:56:09,650][36138] Updated weights for policy 0, policy_version 45373 (0.0009) [2023-02-25 13:56:09,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 185847808. Throughput: 0: 3358.9. Samples: 8952808. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:56:09,730][36114] Avg episode reward: [(0, '54.050')] [2023-02-25 13:56:12,160][36155] DAMAGECOUNT value on done: 600262.0 [2023-02-25 13:56:12,160][36155] Sum rewards: 53.179, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.898', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'AMMO4': '0.153', 'weapon5': '0.184', 'AMMO3': '0.189', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.332', 'WEAPON3': '1.250', 'HITCOUNT': '2.710', 'weapon3': '2.928', 'DAMAGECOUNT': '14.172', 'FRAGCOUNT': '46.000'} [2023-02-25 13:56:12,476][36155] DAMAGECOUNT value on done: 619681.0 [2023-02-25 13:56:12,476][36155] Sum rewards: 56.191, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.112', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon2': '0.132', 'weapon5': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.201', 'WEAPON5': '0.300', 'weapon4': '0.324', 'WEAPON3': '1.250', 'weapon3': '3.164', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.358', 'FRAGCOUNT': '47.000'} [2023-02-25 13:56:12,693][36138] Updated weights for policy 0, policy_version 45383 (0.0009) [2023-02-25 13:56:13,069][36155] DAMAGECOUNT value on done: 614673.0 [2023-02-25 13:56:13,069][36155] Sum rewards: 57.416, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.855', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon4': '0.016', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'weapon2': '0.222', 'WEAPON3': '1.050', 'HITCOUNT': '2.780', 'weapon3': '3.506', 'DAMAGECOUNT': '13.518', 'FRAGCOUNT': '48.000'} [2023-02-25 13:56:13,380][36155] DAMAGECOUNT value on done: 607102.0 [2023-02-25 13:56:13,381][36155] Sum rewards: 46.129, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.620', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon2': '0.518', 'weapon4': '0.554', 'WEAPON3': '1.200', 'weapon3': '2.506', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '11.955', 'FRAGCOUNT': '41.000'} [2023-02-25 13:56:13,511][36139] DAMAGECOUNT value on done: 613896.0 [2023-02-25 13:56:13,512][36139] Sum rewards: 49.151, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.540', 'AMMO5': '0.017', 'AMMO2': '0.036', 'AMMO3': '0.124', 'weapon5': '0.138', 'AMMO4': '0.182', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.566', 'WEAPON3': '0.800', 'weapon2': '1.034', 'weapon3': '2.038', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.915', 'FRAGCOUNT': '41.000'} [2023-02-25 13:56:13,816][36139] DAMAGECOUNT value on done: 605006.0 [2023-02-25 13:56:13,817][36139] Sum rewards: 49.646, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.288', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.124', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'weapon2': '0.296', 'WEAPON4': '0.450', 'weapon4': '0.830', 'WEAPON3': '1.100', 'weapon3': '2.360', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.407', 'FRAGCOUNT': '44.000'} [2023-02-25 13:56:14,411][36139] DAMAGECOUNT value on done: 615383.0 [2023-02-25 13:56:14,412][36139] Sum rewards: 53.642, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.108', 'AMMO5': '0.017', 'AMMO2': '0.040', 'AMMO3': '0.157', 'AMMO4': '0.199', 'weapon5': '0.228', 'weapon4': '0.262', 'weapon2': '0.428', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.900', 'HITCOUNT': '2.700', 'weapon3': '2.790', 'DAMAGECOUNT': '13.629', 'FRAGCOUNT': '45.000'} [2023-02-25 13:56:14,704][36139] DAMAGECOUNT value on done: 610055.0 [2023-02-25 13:56:14,704][36139] Sum rewards: 33.196, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.810', 'AMMO5': '0.017', 'AMMO2': '0.038', 'AMMO3': '0.169', 'AMMO4': '0.191', 'weapon5': '0.210', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.720', 'weapon2': '0.802', 'WEAPON3': '1.050', 'weapon3': '1.974', 'HITCOUNT': '2.150', 'DAMAGECOUNT': '10.434', 'FRAGCOUNT': '33.000'} [2023-02-25 13:56:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13426.6). Total num frames: 185913344. Throughput: 0: 3362.2. Samples: 8972958. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:56:14,730][36114] Avg episode reward: [(0, '53.670')] [2023-02-25 13:56:15,711][36138] Updated weights for policy 0, policy_version 45393 (0.0009) [2023-02-25 13:56:18,742][36138] Updated weights for policy 0, policy_version 45403 (0.0010) [2023-02-25 13:56:19,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 185982976. Throughput: 0: 3362.3. Samples: 8993132. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:56:19,730][36114] Avg episode reward: [(0, '53.670')] [2023-02-25 13:56:21,798][36138] Updated weights for policy 0, policy_version 45413 (0.0009) [2023-02-25 13:56:22,419][36154] DAMAGECOUNT value on done: 615115.0 [2023-02-25 13:56:22,419][36154] Sum rewards: 64.786, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.204', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon4': '0.106', 'weapon5': '0.128', 'WEAPON4': '0.200', 'weapon2': '0.240', 'AMMO3': '0.241', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.262', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '54.500'} [2023-02-25 13:56:22,616][36141] DAMAGECOUNT value on done: 619829.0 [2023-02-25 13:56:22,617][36141] Sum rewards: 64.823, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.300', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.014', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'weapon2': '0.132', 'AMMO3': '0.254', 'weapon4': '0.298', 'WEAPON3': '1.450', 'weapon3': '3.358', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.299', 'FRAGCOUNT': '56.000'} [2023-02-25 13:56:22,716][36154] DAMAGECOUNT value on done: 601672.0 [2023-02-25 13:56:22,717][36154] Sum rewards: 55.412, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.002', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.122', 'AMMO3': '0.156', 'weapon5': '0.158', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.350', 'weapon4': '0.464', 'WEAPON3': '1.100', 'weapon3': '2.792', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.746', 'FRAGCOUNT': '47.000'} [2023-02-25 13:56:22,828][36141] DAMAGECOUNT value on done: 607500.0 [2023-02-25 13:56:22,829][36141] Sum rewards: 52.885, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.114', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.102', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.354', 'weapon4': '0.708', 'WEAPON3': '1.150', 'weapon3': '2.620', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.473', 'FRAGCOUNT': '46.000'} [2023-02-25 13:56:22,926][36141] DAMAGECOUNT value on done: 613404.0 [2023-02-25 13:56:22,926][36141] Sum rewards: 29.693, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.198', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.089', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.139', 'weapon7': '0.152', 'weapon2': '0.242', 'WEAPON3': '0.850', 'weapon4': '0.890', 'HITCOUNT': '1.690', 'weapon3': '1.926', 'DAMAGECOUNT': '7.689', 'FRAGCOUNT': '25.000'} [2023-02-25 13:56:22,960][36154] DAMAGECOUNT value on done: 612572.0 [2023-02-25 13:56:22,961][36154] Sum rewards: 47.050, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.122', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon4': '0.016', 'AMMO2': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.131', 'AMMO3': '0.236', 'weapon2': '0.320', 'WEAPON3': '1.450', 'HITCOUNT': '2.910', 'weapon3': '3.506', 'DAMAGECOUNT': '12.720', 'FRAGCOUNT': '42.000'} [2023-02-25 13:56:23,145][36141] DAMAGECOUNT value on done: 602815.0 [2023-02-25 13:56:23,145][36141] Sum rewards: 46.940, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.555', 'AMMO5': '0.007', 'weapon5': '0.014', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.212', 'weapon4': '0.274', 'weapon2': '0.458', 'WEAPON3': '1.300', 'weapon3': '3.052', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '12.951', 'FRAGCOUNT': '42.000'} [2023-02-25 13:56:23,151][36156] Large shaping reward 2.595 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5730000000000001, 191.0), ('weapon5', 0.002)] [2023-02-25 13:56:23,280][36154] DAMAGECOUNT value on done: 612473.0 [2023-02-25 13:56:23,281][36154] Sum rewards: 46.201, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.860', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.149', 'AMMO3': '0.199', 'weapon4': '0.218', 'weapon5': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon2': '0.554', 'WEAPON3': '1.350', 'weapon3': '2.624', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.486', 'FRAGCOUNT': '42.000'} [2023-02-25 13:56:23,927][36154] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-25 13:56:24,087][36157] DAMAGECOUNT value on done: 621777.0 [2023-02-25 13:56:24,087][36157] Sum rewards: 52.687, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.290', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'weapon2': '0.464', 'weapon4': '0.520', 'WEAPON3': '1.050', 'weapon3': '2.368', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.023', 'FRAGCOUNT': '45.000'} [2023-02-25 13:56:24,396][36157] DAMAGECOUNT value on done: 612142.0 [2023-02-25 13:56:24,397][36157] Sum rewards: 51.342, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.300', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.118', 'AMMO4': '0.157', 'weapon2': '0.198', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'WEAPON4': '0.550', 'weapon4': '0.930', 'WEAPON3': '1.300', 'weapon3': '2.442', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.115', 'FRAGCOUNT': '46.000'} [2023-02-25 13:56:24,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 186048512. Throughput: 0: 3361.6. Samples: 9003322. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:56:24,730][36114] Avg episode reward: [(0, '53.863')] [2023-02-25 13:56:24,836][36138] Updated weights for policy 0, policy_version 45423 (0.0010) [2023-02-25 13:56:25,140][36157] DAMAGECOUNT value on done: 622033.0 [2023-02-25 13:56:25,141][36157] Sum rewards: 61.940, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.810', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO4': '0.173', 'AMMO3': '0.195', 'weapon5': '0.202', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.500', 'weapon2': '0.616', 'WEAPON3': '1.250', 'weapon3': '2.344', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '54.000'} [2023-02-25 13:56:25,302][36140] DAMAGECOUNT value on done: 619807.0 [2023-02-25 13:56:25,302][36140] Sum rewards: 49.703, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.671', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.050', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon4': '0.226', 'weapon2': '0.398', 'WEAPON3': '1.300', 'weapon3': '3.080', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.689', 'FRAGCOUNT': '43.000'} [2023-02-25 13:56:25,423][36157] DAMAGECOUNT value on done: 615242.0 [2023-02-25 13:56:25,423][36157] Sum rewards: 37.488, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.088', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.180', 'AMMO3': '0.198', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.444', 'weapon2': '0.506', 'WEAPON3': '1.150', 'HITCOUNT': '2.490', 'weapon3': '2.526', 'DAMAGECOUNT': '10.959', 'FRAGCOUNT': '36.000'} [2023-02-25 13:56:25,613][36140] DAMAGECOUNT value on done: 600467.0 [2023-02-25 13:56:25,614][36140] Sum rewards: 55.848, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.600', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon7': '0.048', 'weapon5': '0.070', 'AMMO4': '0.083', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'weapon2': '0.400', 'weapon4': '0.498', 'WEAPON3': '1.150', 'weapon3': '2.688', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.340', 'FRAGCOUNT': '47.000'} [2023-02-25 13:56:25,930][36140] DAMAGECOUNT value on done: 611653.0 [2023-02-25 13:56:25,931][36140] Sum rewards: 62.920, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.040', 'AMMO5': '0.007', 'weapon5': '0.044', 'AMMO2': '0.048', 'WEAPON5': '0.150', 'weapon2': '0.188', 'AMMO3': '0.207', 'AMMO4': '0.241', 'WEAPON4': '0.350', 'weapon4': '0.442', 'ARMOR': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.092', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '53.000'} [2023-02-25 13:56:26,241][36140] DAMAGECOUNT value on done: 609903.0 [2023-02-25 13:56:26,242][36140] Sum rewards: 44.311, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.514', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.048', 'AMMO3': '0.207', 'weapon2': '0.214', 'AMMO4': '0.242', 'weapon5': '0.244', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '1.148', 'WEAPON3': '1.250', 'weapon3': '2.058', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.890', 'FRAGCOUNT': '40.000'} [2023-02-25 13:56:27,174][36142] DAMAGECOUNT value on done: 618005.0 [2023-02-25 13:56:27,174][36142] Sum rewards: 40.957, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.632', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.045', 'AMMO4': '0.223', 'weapon5': '0.236', 'weapon2': '0.240', 'AMMO3': '0.259', 'weapon4': '0.422', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.778', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.540', 'FRAGCOUNT': '40.500'} [2023-02-25 13:56:27,213][36142] DAMAGECOUNT value on done: 600612.0 [2023-02-25 13:56:27,214][36142] Sum rewards: 61.664, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.872', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon4': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.212', 'AMMO3': '0.240', 'weapon2': '0.318', 'WEAPON3': '1.400', 'HITCOUNT': '3.060', 'weapon3': '3.076', 'DAMAGECOUNT': '15.534', 'FRAGCOUNT': '54.000'} [2023-02-25 13:56:27,493][36142] DAMAGECOUNT value on done: 602928.0 [2023-02-25 13:56:27,493][36142] Sum rewards: 61.286, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.404', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon2': '0.170', 'AMMO3': '0.173', 'AMMO4': '0.224', 'weapon5': '0.258', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'ARMOR': '0.404', 'weapon4': '0.444', 'WEAPON3': '1.050', 'weapon3': '2.858', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.771', 'FRAGCOUNT': '53.000'} [2023-02-25 13:56:27,533][36142] DAMAGECOUNT value on done: 614443.0 [2023-02-25 13:56:27,534][36142] Sum rewards: 58.472, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.070', 'AMMO5': '0.010', 'AMMO2': '0.025', 'ARMOR': '0.040', 'weapon5': '0.054', 'AMMO4': '0.127', 'AMMO3': '0.135', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.410', 'weapon2': '0.502', 'WEAPON3': '0.900', 'weapon3': '2.780', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.569', 'FRAGCOUNT': '48.000'} [2023-02-25 13:56:27,957][36138] Updated weights for policy 0, policy_version 45433 (0.0010) [2023-02-25 13:56:28,400][36156] DAMAGECOUNT value on done: 620272.0 [2023-02-25 13:56:28,400][36156] Sum rewards: 64.174, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.340', 'AMMO2': '0.005', 'AMMO4': '0.026', 'AMMO3': '0.249', 'weapon2': '0.258', 'WEAPON3': '1.400', 'HITCOUNT': '3.450', 'weapon3': '3.576', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '54.000'} [2023-02-25 13:56:28,445][36156] DAMAGECOUNT value on done: 622963.0 [2023-02-25 13:56:28,446][36156] Sum rewards: 70.559, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.229', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'weapon2': '0.364', 'weapon4': '0.412', 'WEAPON3': '0.950', 'weapon3': '2.900', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '56.000'} [2023-02-25 13:56:28,712][36156] DAMAGECOUNT value on done: 608062.0 [2023-02-25 13:56:28,713][36156] Sum rewards: 52.151, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.130', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.194', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.340', 'weapon4': '0.362', 'WEAPON3': '1.350', 'weapon3': '2.758', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.084', 'FRAGCOUNT': '46.000'} [2023-02-25 13:56:28,760][36156] DAMAGECOUNT value on done: 613296.0 [2023-02-25 13:56:28,760][36156] Sum rewards: 66.300, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.542', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.038', 'AMMO4': '0.190', 'weapon5': '0.198', 'weapon2': '0.206', 'AMMO3': '0.207', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon4': '0.636', 'WEAPON3': '1.300', 'weapon3': '2.618', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '57.000'} [2023-02-25 13:56:29,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 186114048. Throughput: 0: 3356.9. Samples: 9023246. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:56:29,730][36114] Avg episode reward: [(0, '54.040')] [2023-02-25 13:56:31,027][36138] Updated weights for policy 0, policy_version 45443 (0.0010) [2023-02-25 13:56:32,100][36155] DAMAGECOUNT value on done: 604273.0 [2023-02-25 13:56:32,101][36155] Sum rewards: 42.547, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.634', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.057', 'AMMO3': '0.118', 'weapon5': '0.266', 'AMMO4': '0.284', 'WEAPON5': '0.400', 'weapon2': '0.452', 'WEAPON4': '0.600', 'WEAPON3': '0.750', 'weapon4': '0.912', 'weapon3': '2.052', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '12.033', 'FRAGCOUNT': '37.000'} [2023-02-25 13:56:32,408][36155] DAMAGECOUNT value on done: 624615.0 [2023-02-25 13:56:32,409][36155] Sum rewards: 60.919, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.924', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.102', 'AMMO4': '0.106', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon2': '0.296', 'WEAPON4': '0.300', 'weapon4': '0.374', 'WEAPON3': '1.250', 'weapon3': '3.024', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.802', 'FRAGCOUNT': '51.000'} [2023-02-25 13:56:32,968][36155] DAMAGECOUNT value on done: 619579.0 [2023-02-25 13:56:32,968][36155] Sum rewards: 56.481, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.748', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.132', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'weapon4': '0.364', 'weapon2': '0.384', 'WEAPON3': '1.250', 'weapon3': '2.764', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.718', 'FRAGCOUNT': '48.000'} [2023-02-25 13:56:33,274][36155] DAMAGECOUNT value on done: 612213.0 [2023-02-25 13:56:33,275][36155] Sum rewards: 59.899, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.702', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON5': '0.050', 'weapon5': '0.054', 'WEAPON4': '0.100', 'weapon4': '0.132', 'AMMO3': '0.222', 'weapon2': '0.322', 'WEAPON3': '1.500', 'weapon3': '3.342', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.333', 'FRAGCOUNT': '53.000'} [2023-02-25 13:56:33,369][36139] DAMAGECOUNT value on done: 618507.0 [2023-02-25 13:56:33,369][36139] Sum rewards: 46.102, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.180', 'AMMO2': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.041', 'weapon5': '0.090', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon4': '0.254', 'weapon2': '0.684', 'WEAPON3': '1.300', 'weapon3': '2.706', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.833', 'FRAGCOUNT': '39.000'} [2023-02-25 13:56:33,670][36139] DAMAGECOUNT value on done: 609704.0 [2023-02-25 13:56:33,671][36139] Sum rewards: 51.564, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.480', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon5': '0.048', 'AMMO4': '0.093', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'weapon2': '0.228', 'WEAPON4': '0.300', 'weapon4': '0.432', 'WEAPON3': '1.200', 'weapon3': '3.012', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.794', 'FRAGCOUNT': '45.000'} [2023-02-25 13:56:34,075][36138] Updated weights for policy 0, policy_version 45453 (0.0009) [2023-02-25 13:56:34,250][36139] DAMAGECOUNT value on done: 620063.0 [2023-02-25 13:56:34,251][36139] Sum rewards: 54.183, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.367', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.116', 'AMMO3': '0.149', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.468', 'weapon2': '0.716', 'WEAPON3': '0.900', 'weapon3': '2.500', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.040', 'FRAGCOUNT': '45.000'} [2023-02-25 13:56:34,574][36139] DAMAGECOUNT value on done: 614812.0 [2023-02-25 13:56:34,575][36139] Sum rewards: 58.774, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.810', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.016', 'WEAPON4': '0.050', 'weapon4': '0.066', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'weapon2': '0.298', 'WEAPON3': '1.250', 'HITCOUNT': '3.180', 'weapon3': '3.324', 'DAMAGECOUNT': '14.271', 'FRAGCOUNT': '49.000'} [2023-02-25 13:56:34,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 186183680. Throughput: 0: 3356.1. Samples: 9043450. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:56:34,730][36114] Avg episode reward: [(0, '53.961')] [2023-02-25 13:56:37,149][36138] Updated weights for policy 0, policy_version 45463 (0.0010) [2023-02-25 13:56:39,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13426.5). Total num frames: 186249216. Throughput: 0: 3352.9. Samples: 9053370. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:56:39,730][36114] Avg episode reward: [(0, '53.961')] [2023-02-25 13:56:40,226][36138] Updated weights for policy 0, policy_version 45473 (0.0009) [2023-02-25 13:56:42,147][36142] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 13:56:42,498][36154] DAMAGECOUNT value on done: 619533.0 [2023-02-25 13:56:42,498][36154] Sum rewards: 46.738, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.778', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.091', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon4': '0.334', 'weapon2': '0.684', 'WEAPON3': '1.150', 'weapon3': '2.684', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.254', 'FRAGCOUNT': '40.000'} [2023-02-25 13:56:42,811][36154] DAMAGECOUNT value on done: 606854.0 [2023-02-25 13:56:42,811][36154] Sum rewards: 67.065, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.680', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.014', 'WEAPON4': '0.050', 'weapon5': '0.050', 'weapon4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'weapon2': '0.418', 'WEAPON3': '1.050', 'weapon3': '3.234', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.525', 'FRAGCOUNT': '54.000'} [2023-02-25 13:56:42,866][36141] DAMAGECOUNT value on done: 623788.0 [2023-02-25 13:56:42,867][36141] Sum rewards: 37.588, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.070', 'weapon7': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.055', 'AMMO3': '0.114', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.273', 'weapon5': '0.314', 'weapon2': '0.356', 'WEAPON5': '0.450', 'WEAPON4': '0.750', 'WEAPON3': '0.750', 'weapon4': '1.324', 'weapon3': '1.568', 'HITCOUNT': '2.450', 'DAMAGECOUNT': '11.877', 'FRAGCOUNT': '33.000'} [2023-02-25 13:56:43,098][36141] DAMAGECOUNT value on done: 611497.0 [2023-02-25 13:56:43,099][36141] Sum rewards: 50.257, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.713', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.050', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'WEAPON4': '0.350', 'weapon4': '0.492', 'weapon2': '0.626', 'WEAPON3': '0.900', 'HITCOUNT': '2.660', 'weapon3': '2.670', 'DAMAGECOUNT': '11.991', 'FRAGCOUNT': '43.000'} [2023-02-25 13:56:43,117][36154] DAMAGECOUNT value on done: 617377.0 [2023-02-25 13:56:43,117][36154] Sum rewards: 53.640, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.491', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.037', 'AMMO3': '0.155', 'AMMO4': '0.184', 'weapon5': '0.210', 'WEAPON5': '0.400', 'weapon2': '0.420', 'WEAPON4': '0.500', 'weapon4': '0.710', 'WEAPON3': '0.850', 'weapon3': '2.370', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.415', 'FRAGCOUNT': '45.000'} [2023-02-25 13:56:43,183][36141] DAMAGECOUNT value on done: 618814.0 [2023-02-25 13:56:43,184][36141] Sum rewards: 62.351, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.710', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'weapon2': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon4': '0.770', 'WEAPON3': '1.000', 'weapon3': '2.640', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '51.000'} [2023-02-25 13:56:43,323][36138] Updated weights for policy 0, policy_version 45483 (0.0009) [2023-02-25 13:56:43,428][36141] DAMAGECOUNT value on done: 607259.0 [2023-02-25 13:56:43,428][36141] Sum rewards: 50.670, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.462', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.031', 'AMMO3': '0.115', 'weapon5': '0.136', 'AMMO4': '0.155', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.498', 'weapon4': '0.700', 'WEAPON3': '0.850', 'weapon3': '2.434', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.332', 'FRAGCOUNT': '41.000'} [2023-02-25 13:56:43,436][36154] DAMAGECOUNT value on done: 617078.0 [2023-02-25 13:56:43,437][36154] Sum rewards: 51.640, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.524', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.051', 'AMMO3': '0.179', 'weapon5': '0.224', 'AMMO4': '0.254', 'weapon2': '0.332', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.746', 'WEAPON3': '1.050', 'weapon3': '2.420', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '13.815', 'FRAGCOUNT': '45.000'} [2023-02-25 13:56:44,228][36157] DAMAGECOUNT value on done: 627007.0 [2023-02-25 13:56:44,229][36157] Sum rewards: 54.793, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.113', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.036', 'weapon5': '0.160', 'AMMO4': '0.178', 'weapon4': '0.198', 'AMMO3': '0.243', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.500', 'weapon3': '2.974', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '50.000'} [2023-02-25 13:56:44,534][36157] DAMAGECOUNT value on done: 617863.0 [2023-02-25 13:56:44,535][36157] Sum rewards: 61.666, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.330', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.106', 'AMMO4': '0.149', 'weapon2': '0.188', 'AMMO3': '0.208', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.640', 'WEAPON3': '1.250', 'weapon3': '2.804', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '53.000'} [2023-02-25 13:56:44,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13426.6). Total num frames: 186314752. Throughput: 0: 3349.1. Samples: 9073330. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:56:44,729][36114] Avg episode reward: [(0, '53.961')] [2023-02-25 13:56:45,292][36157] DAMAGECOUNT value on done: 627012.0 [2023-02-25 13:56:45,292][36157] Sum rewards: 65.909, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.885', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'WEAPON4': '0.100', 'AMMO3': '0.172', 'weapon2': '0.178', 'weapon4': '0.352', 'WEAPON3': '1.100', 'weapon3': '3.166', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.937', 'FRAGCOUNT': '55.000'} [2023-02-25 13:56:45,540][36140] DAMAGECOUNT value on done: 624918.0 [2023-02-25 13:56:45,541][36140] Sum rewards: 52.261, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.335', 'AMMO5': '0.006', 'AMMO2': '0.042', 'weapon5': '0.066', 'WEAPON5': '0.200', 'AMMO4': '0.212', 'weapon2': '0.248', 'AMMO3': '0.256', 'WEAPON4': '0.350', 'weapon4': '0.354', 'WEAPON3': '1.550', 'weapon3': '3.068', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.333', 'FRAGCOUNT': '48.000'} [2023-02-25 13:56:45,595][36157] DAMAGECOUNT value on done: 620634.0 [2023-02-25 13:56:45,595][36157] Sum rewards: 63.464, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.530', 'AMMO5': '0.012', 'weapon5': '0.020', 'AMMO2': '0.034', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'weapon2': '0.200', 'weapon4': '0.236', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.342', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '56.000'} [2023-02-25 13:56:45,850][36140] DAMAGECOUNT value on done: 605838.0 [2023-02-25 13:56:45,851][36140] Sum rewards: 61.748, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.870', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.160', 'weapon5': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.378', 'weapon2': '0.404', 'WEAPON3': '1.050', 'weapon3': '2.776', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.113', 'FRAGCOUNT': '52.000'} [2023-02-25 13:56:46,165][36140] DAMAGECOUNT value on done: 616495.0 [2023-02-25 13:56:46,165][36140] Sum rewards: 59.215, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.679', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO3': '0.172', 'weapon5': '0.174', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.294', 'weapon4': '0.560', 'WEAPON3': '1.000', 'weapon3': '2.758', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.496', 'FRAGCOUNT': '50.000'} [2023-02-25 13:56:46,405][36138] Updated weights for policy 0, policy_version 45493 (0.0009) [2023-02-25 13:56:46,469][36140] DAMAGECOUNT value on done: 614666.0 [2023-02-25 13:56:46,469][36140] Sum rewards: 49.726, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.802', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.138', 'AMMO4': '0.166', 'weapon5': '0.174', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.786', 'WEAPON3': '1.350', 'weapon3': '2.630', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.289', 'FRAGCOUNT': '44.000'} [2023-02-25 13:56:47,330][36142] DAMAGECOUNT value on done: 622391.0 [2023-02-25 13:56:47,331][36142] Sum rewards: 52.596, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.520', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'weapon2': '0.178', 'WEAPON4': '0.300', 'weapon4': '0.694', 'WEAPON3': '1.150', 'weapon3': '2.868', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.158', 'FRAGCOUNT': '46.000'} [2023-02-25 13:56:47,415][36142] DAMAGECOUNT value on done: 606132.0 [2023-02-25 13:56:47,416][36142] Sum rewards: 69.000, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.750', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.150', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'weapon2': '0.306', 'weapon4': '0.642', 'WEAPON3': '1.000', 'weapon3': '2.844', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '16.560', 'FRAGCOUNT': '56.000'} [2023-02-25 13:56:47,652][36142] DAMAGECOUNT value on done: 608266.0 [2023-02-25 13:56:47,653][36142] Sum rewards: 59.941, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.850', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.104', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.292', 'weapon2': '0.458', 'WEAPON3': '1.400', 'weapon3': '2.862', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.014', 'FRAGCOUNT': '51.000'} [2023-02-25 13:56:47,736][36142] DAMAGECOUNT value on done: 619570.0 [2023-02-25 13:56:47,737][36142] Sum rewards: 58.183, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.297', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.065', 'AMMO3': '0.118', 'weapon5': '0.238', 'AMMO4': '0.323', 'WEAPON5': '0.550', 'weapon4': '0.630', 'WEAPON4': '0.700', 'weapon2': '0.728', 'WEAPON3': '0.800', 'weapon3': '2.036', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '15.369', 'FRAGCOUNT': '51.000'} [2023-02-25 13:56:48,399][36156] DAMAGECOUNT value on done: 624779.0 [2023-02-25 13:56:48,399][36156] Sum rewards: 47.493, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.798', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.128', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.408', 'weapon2': '0.572', 'WEAPON3': '1.250', 'weapon3': '2.612', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.521', 'FRAGCOUNT': '42.000'} [2023-02-25 13:56:48,552][36156] DAMAGECOUNT value on done: 627086.0 [2023-02-25 13:56:48,552][36156] Sum rewards: 49.934, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.193', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.024', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.174', 'weapon2': '0.454', 'WEAPON3': '1.100', 'HITCOUNT': '2.850', 'weapon3': '3.220', 'DAMAGECOUNT': '12.369', 'FRAGCOUNT': '42.000'} [2023-02-25 13:56:48,723][36156] DAMAGECOUNT value on done: 611912.0 [2023-02-25 13:56:48,723][36156] Sum rewards: 37.535, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.694', 'AMMO5': '0.014', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon5': '0.180', 'AMMO3': '0.241', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.520', 'WEAPON3': '1.500', 'HITCOUNT': '2.500', 'weapon3': '2.602', 'DAMAGECOUNT': '11.550', 'FRAGCOUNT': '36.000'} [2023-02-25 13:56:48,875][36156] DAMAGECOUNT value on done: 617723.0 [2023-02-25 13:56:48,876][36156] Sum rewards: 46.825, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.178', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.069', 'AMMO3': '0.150', 'weapon5': '0.264', 'AMMO4': '0.343', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.628', 'WEAPON3': '0.850', 'weapon4': '1.084', 'weapon3': '1.672', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '13.269', 'FRAGCOUNT': '38.000'} [2023-02-25 13:56:49,426][36138] Updated weights for policy 0, policy_version 45503 (0.0009) [2023-02-25 13:56:49,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 186384384. Throughput: 0: 3351.9. Samples: 9093480. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:56:49,729][36114] Avg episode reward: [(0, '53.801')] [2023-02-25 13:56:52,076][36155] DAMAGECOUNT value on done: 608954.0 [2023-02-25 13:56:52,076][36155] Sum rewards: 51.367, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.508', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.132', 'AMMO4': '0.150', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.310', 'weapon2': '0.644', 'WEAPON3': '1.050', 'weapon3': '2.694', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.998', 'FRAGCOUNT': '43.000'} [2023-02-25 13:56:52,396][36155] DAMAGECOUNT value on done: 628747.0 [2023-02-25 13:56:52,396][36155] Sum rewards: 48.517, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.606', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'AMMO3': '0.143', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'weapon4': '0.608', 'weapon2': '0.714', 'WEAPON3': '0.850', 'weapon3': '2.404', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.396', 'FRAGCOUNT': '39.000'} [2023-02-25 13:56:52,485][36138] Updated weights for policy 0, policy_version 45513 (0.0010) [2023-02-25 13:56:52,949][36155] DAMAGECOUNT value on done: 624009.0 [2023-02-25 13:56:52,949][36155] Sum rewards: 44.462, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.980', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.004', 'AMMO4': '0.022', 'weapon5': '0.046', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon4': '0.308', 'weapon2': '0.740', 'WEAPON3': '1.400', 'weapon3': '2.752', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.290', 'FRAGCOUNT': '40.000'} [2023-02-25 13:56:53,257][36155] DAMAGECOUNT value on done: 616855.0 [2023-02-25 13:56:53,258][36155] Sum rewards: 56.873, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.975', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.056', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'weapon4': '0.234', 'weapon2': '0.358', 'WEAPON3': '1.300', 'weapon3': '3.116', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.926', 'FRAGCOUNT': '49.000'} [2023-02-25 13:56:53,344][36139] DAMAGECOUNT value on done: 622723.0 [2023-02-25 13:56:53,345][36139] Sum rewards: 51.130, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.534', 'AMMO2': '0.016', 'AMMO4': '0.081', 'AMMO3': '0.173', 'weapon2': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.712', 'WEAPON3': '1.050', 'weapon3': '2.944', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '12.648', 'FRAGCOUNT': '45.000'} [2023-02-25 13:56:53,648][36139] DAMAGECOUNT value on done: 614626.0 [2023-02-25 13:56:53,648][36139] Sum rewards: 56.352, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.600', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.052', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.198', 'AMMO3': '0.244', 'weapon2': '0.492', 'WEAPON3': '1.500', 'weapon3': '3.042', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.766', 'FRAGCOUNT': '50.000'} [2023-02-25 13:56:54,270][36139] DAMAGECOUNT value on done: 624758.0 [2023-02-25 13:56:54,270][36139] Sum rewards: 58.078, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.010', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon5': '0.048', 'weapon4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.166', 'AMMO3': '0.213', 'WEAPON3': '1.250', 'HITCOUNT': '3.180', 'weapon3': '3.568', 'DAMAGECOUNT': '14.085', 'FRAGCOUNT': '49.000'} [2023-02-25 13:56:54,588][36139] DAMAGECOUNT value on done: 619744.0 [2023-02-25 13:56:54,588][36139] Sum rewards: 57.394, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.460', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.048', 'weapon5': '0.098', 'AMMO3': '0.145', 'WEAPON5': '0.200', 'AMMO4': '0.239', 'weapon2': '0.336', 'WEAPON4': '0.350', 'weapon4': '0.494', 'WEAPON3': '0.950', 'weapon3': '2.888', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.796', 'FRAGCOUNT': '45.000'} [2023-02-25 13:56:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13426.6). Total num frames: 186449920. Throughput: 0: 3350.0. Samples: 9103558. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:56:54,729][36114] Avg episode reward: [(0, '54.133')] [2023-02-25 13:56:55,503][36138] Updated weights for policy 0, policy_version 45523 (0.0009) [2023-02-25 13:56:58,592][36138] Updated weights for policy 0, policy_version 45533 (0.0009) [2023-02-25 13:56:59,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13426.5). Total num frames: 186515456. Throughput: 0: 3348.4. Samples: 9123638. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:56:59,730][36114] Avg episode reward: [(0, '54.133')] [2023-02-25 13:57:01,629][36138] Updated weights for policy 0, policy_version 45543 (0.0009) [2023-02-25 13:57:02,751][36154] DAMAGECOUNT value on done: 625858.0 [2023-02-25 13:57:02,752][36154] Sum rewards: 68.181, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.685', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.164', 'AMMO3': '0.220', 'weapon2': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.374', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.866', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.975', 'FRAGCOUNT': '57.000'} [2023-02-25 13:57:02,956][36141] DAMAGECOUNT value on done: 628280.0 [2023-02-25 13:57:02,957][36141] Sum rewards: 49.862, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.178', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'weapon5': '0.112', 'weapon4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.207', 'weapon2': '0.908', 'WEAPON3': '1.250', 'weapon3': '2.668', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.476', 'FRAGCOUNT': '44.000'} [2023-02-25 13:57:03,066][36154] DAMAGECOUNT value on done: 612456.0 [2023-02-25 13:57:03,066][36154] Sum rewards: 64.700, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.608', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.084', 'weapon5': '0.090', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.270', 'AMMO3': '0.299', 'WEAPON3': '1.700', 'weapon3': '3.252', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '59.000'} [2023-02-25 13:57:03,187][36141] DAMAGECOUNT value on done: 617219.0 [2023-02-25 13:57:03,188][36141] Sum rewards: 68.075, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.470', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.201', 'weapon4': '0.206', 'weapon2': '0.458', 'WEAPON3': '1.250', 'weapon3': '3.178', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '56.000'} [2023-02-25 13:57:03,271][36141] DAMAGECOUNT value on done: 623209.0 [2023-02-25 13:57:03,271][36141] Sum rewards: 47.448, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.092', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.118', 'AMMO4': '0.131', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.324', 'WEAPON4': '0.350', 'weapon4': '0.444', 'WEAPON3': '1.250', 'weapon3': '2.664', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.185', 'FRAGCOUNT': '43.500'} [2023-02-25 13:57:03,373][36154] DAMAGECOUNT value on done: 622963.0 [2023-02-25 13:57:03,373][36154] Sum rewards: 61.905, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.202', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon5': '0.150', 'weapon4': '0.192', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.600', 'weapon3': '2.948', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.758', 'FRAGCOUNT': '56.000'} [2023-02-25 13:57:03,502][36141] DAMAGECOUNT value on done: 611364.0 [2023-02-25 13:57:03,502][36141] Sum rewards: 41.072, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.290', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.175', 'weapon5': '0.260', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.570', 'WEAPON3': '1.100', 'weapon3': '2.348', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.315', 'FRAGCOUNT': '37.000'} [2023-02-25 13:57:03,673][36154] DAMAGECOUNT value on done: 622806.0 [2023-02-25 13:57:03,674][36154] Sum rewards: 66.376, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.760', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.098', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon4': '0.368', 'weapon2': '0.396', 'WEAPON3': '1.300', 'weapon3': '2.906', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '56.000'} [2023-02-25 13:57:04,257][36157] DAMAGECOUNT value on done: 631238.0 [2023-02-25 13:57:04,257][36157] Sum rewards: 47.677, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.170', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.156', 'AMMO3': '0.184', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.490', 'weapon4': '0.794', 'WEAPON3': '1.100', 'weapon3': '2.354', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.693', 'FRAGCOUNT': '42.000'} [2023-02-25 13:57:04,562][36157] DAMAGECOUNT value on done: 622923.0 [2023-02-25 13:57:04,562][36157] Sum rewards: 55.974, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.444', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.158', 'WEAPON5': '0.200', 'AMMO4': '0.218', 'AMMO3': '0.224', 'WEAPON4': '0.350', 'weapon2': '0.384', 'weapon4': '0.406', 'WEAPON3': '1.450', 'weapon3': '2.744', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '50.500'} [2023-02-25 13:57:04,694][36138] Updated weights for policy 0, policy_version 45553 (0.0009) [2023-02-25 13:57:04,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 186585088. Throughput: 0: 3347.4. Samples: 9143764. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:57:04,730][36114] Avg episode reward: [(0, '54.402')] [2023-02-25 13:57:05,340][36157] DAMAGECOUNT value on done: 631019.0 [2023-02-25 13:57:05,341][36157] Sum rewards: 44.562, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.160', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.044', 'AMMO3': '0.169', 'AMMO4': '0.218', 'weapon5': '0.238', 'weapon2': '0.312', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon4': '1.044', 'WEAPON3': '1.050', 'weapon3': '2.120', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.021', 'FRAGCOUNT': '40.000'} [2023-02-25 13:57:05,519][36140] DAMAGECOUNT value on done: 629166.0 [2023-02-25 13:57:05,520][36140] Sum rewards: 48.406, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.150', 'AMMO5': '0.005', 'AMMO2': '0.029', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.138', 'AMMO4': '0.145', 'AMMO3': '0.154', 'weapon4': '0.298', 'weapon2': '0.684', 'WEAPON3': '0.950', 'weapon3': '2.718', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '12.744', 'FRAGCOUNT': '39.000'} [2023-02-25 13:57:05,655][36157] DAMAGECOUNT value on done: 625163.0 [2023-02-25 13:57:05,655][36157] Sum rewards: 52.282, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.230', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.108', 'weapon4': '0.112', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.240', 'weapon2': '0.252', 'WEAPON3': '1.550', 'HITCOUNT': '2.810', 'weapon3': '3.212', 'DAMAGECOUNT': '13.587', 'FRAGCOUNT': '49.000'} [2023-02-25 13:57:05,833][36140] DAMAGECOUNT value on done: 609945.0 [2023-02-25 13:57:05,833][36140] Sum rewards: 45.806, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.248', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.046', 'AMMO3': '0.105', 'weapon7': '0.114', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon5': '0.230', 'AMMO4': '0.232', 'WEAPON5': '0.300', 'weapon2': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '0.600', 'weapon4': '0.916', 'weapon3': '1.972', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.321', 'FRAGCOUNT': '38.500'} [2023-02-25 13:57:06,135][36140] DAMAGECOUNT value on done: 621145.0 [2023-02-25 13:57:06,135][36140] Sum rewards: 51.627, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.978', 'AMMO5': '0.022', 'AMMO2': '0.074', 'AMMO3': '0.197', 'weapon5': '0.244', 'AMMO4': '0.371', 'weapon2': '0.412', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.606', 'WEAPON3': '1.200', 'weapon3': '2.318', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.950', 'FRAGCOUNT': '47.000'} [2023-02-25 13:57:06,448][36140] DAMAGECOUNT value on done: 618923.0 [2023-02-25 13:57:06,448][36140] Sum rewards: 42.491, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.408', 'ARMOR': '0.005', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon5': '0.162', 'AMMO3': '0.190', 'AMMO4': '0.198', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.492', 'weapon2': '0.494', 'WEAPON3': '1.150', 'weapon3': '2.504', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.771', 'FRAGCOUNT': '38.000'} [2023-02-25 13:57:07,440][36142] DAMAGECOUNT value on done: 627719.0 [2023-02-25 13:57:07,440][36142] Sum rewards: 58.205, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.931', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.034', 'weapon5': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.172', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.392', 'weapon2': '0.452', 'WEAPON3': '1.200', 'weapon3': '2.710', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '49.500'} [2023-02-25 13:57:07,502][36142] DAMAGECOUNT value on done: 611034.0 [2023-02-25 13:57:07,503][36142] Sum rewards: 55.307, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.882', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO4': '0.182', 'AMMO3': '0.185', 'weapon5': '0.286', 'weapon4': '0.396', 'weapon2': '0.408', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.594', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.706', 'FRAGCOUNT': '49.000'} [2023-02-25 13:57:07,756][36138] Updated weights for policy 0, policy_version 45563 (0.0009) [2023-02-25 13:57:07,758][36142] DAMAGECOUNT value on done: 613781.0 [2023-02-25 13:57:07,759][36142] Sum rewards: 61.152, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.012', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.042', 'weapon5': '0.168', 'AMMO4': '0.208', 'AMMO3': '0.214', 'weapon2': '0.346', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.436', 'WEAPON3': '1.350', 'weapon3': '2.762', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '53.000'} [2023-02-25 13:57:07,827][36142] DAMAGECOUNT value on done: 624145.0 [2023-02-25 13:57:07,828][36142] Sum rewards: 43.272, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.375', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.202', 'AMMO4': '0.212', 'AMMO3': '0.265', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON4': '0.550', 'weapon4': '0.898', 'WEAPON3': '1.450', 'weapon3': '2.226', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.725', 'FRAGCOUNT': '42.000'} [2023-02-25 13:57:08,400][36156] DAMAGECOUNT value on done: 628797.0 [2023-02-25 13:57:08,401][36156] Sum rewards: 48.893, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.030', 'AMMO5': '0.014', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.183', 'weapon5': '0.222', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.504', 'weapon4': '0.748', 'WEAPON3': '1.050', 'weapon3': '2.130', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.054', 'FRAGCOUNT': '42.000'} [2023-02-25 13:57:08,533][36156] DAMAGECOUNT value on done: 631641.0 [2023-02-25 13:57:08,534][36156] Sum rewards: 48.634, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.032', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.140', 'AMMO3': '0.159', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON4': '0.350', 'weapon4': '0.596', 'WEAPON3': '1.000', 'weapon3': '2.400', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '13.665', 'FRAGCOUNT': '41.000'} [2023-02-25 13:57:08,724][36156] DAMAGECOUNT value on done: 616038.0 [2023-02-25 13:57:08,724][36156] Sum rewards: 48.393, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.382', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.040', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.190', 'AMMO3': '0.216', 'weapon2': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '2.800', 'weapon3': '2.986', 'DAMAGECOUNT': '12.378', 'FRAGCOUNT': '42.000'} [2023-02-25 13:57:08,857][36156] DAMAGECOUNT value on done: 623018.0 [2023-02-25 13:57:08,858][36156] Sum rewards: 63.290, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.696', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.112', 'AMMO3': '0.126', 'AMMO4': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon4': '0.548', 'weapon2': '0.556', 'WEAPON3': '0.800', 'weapon3': '2.616', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '52.000'} [2023-02-25 13:57:09,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13426.5). Total num frames: 186650624. Throughput: 0: 3344.3. Samples: 9153814. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:57:09,729][36114] Avg episode reward: [(0, '53.775')] [2023-02-25 13:57:09,966][36157] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 13:57:10,824][36138] Updated weights for policy 0, policy_version 45573 (0.0010) [2023-02-25 13:57:11,940][36155] DAMAGECOUNT value on done: 613578.0 [2023-02-25 13:57:11,940][36155] Sum rewards: 54.208, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.684', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.162', 'AMMO4': '0.184', 'AMMO3': '0.205', 'weapon4': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.300', 'weapon3': '2.990', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.872', 'FRAGCOUNT': '48.000'} [2023-02-25 13:57:12,249][36155] DAMAGECOUNT value on done: 634106.0 [2023-02-25 13:57:12,249][36155] Sum rewards: 57.246, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.360', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.152', 'AMMO4': '0.216', 'AMMO3': '0.245', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.402', 'weapon4': '0.510', 'WEAPON3': '1.450', 'weapon3': '2.568', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.077', 'FRAGCOUNT': '52.000'} [2023-02-25 13:57:12,453][36156] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 13:57:12,829][36155] DAMAGECOUNT value on done: 628918.0 [2023-02-25 13:57:12,830][36155] Sum rewards: 55.667, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.889', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.188', 'weapon5': '0.226', 'weapon2': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.790', 'WEAPON3': '1.050', 'weapon3': '2.460', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.727', 'FRAGCOUNT': '48.000'} [2023-02-25 13:57:13,129][36155] DAMAGECOUNT value on done: 621497.0 [2023-02-25 13:57:13,130][36155] Sum rewards: 49.586, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.510', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO3': '0.182', 'AMMO4': '0.184', 'weapon5': '0.218', 'weapon2': '0.388', 'WEAPON5': '0.450', 'weapon4': '0.514', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.614', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.926', 'FRAGCOUNT': '44.000'} [2023-02-25 13:57:13,376][36139] DAMAGECOUNT value on done: 626950.0 [2023-02-25 13:57:13,377][36139] Sum rewards: 39.662, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.540', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.198', 'weapon2': '0.212', 'weapon5': '0.236', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'weapon4': '0.762', 'WEAPON3': '1.200', 'weapon3': '2.180', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.681', 'FRAGCOUNT': '36.000'} [2023-02-25 13:57:13,678][36139] DAMAGECOUNT value on done: 618766.0 [2023-02-25 13:57:13,679][36139] Sum rewards: 50.173, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.537', 'ARMOR': '0.004', 'AMMO2': '0.011', 'AMMO5': '0.015', 'AMMO4': '0.056', 'AMMO3': '0.154', 'weapon5': '0.206', 'WEAPON4': '0.250', 'weapon4': '0.294', 'WEAPON5': '0.450', 'weapon2': '0.752', 'WEAPON3': '0.900', 'weapon3': '2.518', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.420', 'FRAGCOUNT': '43.000'} [2023-02-25 13:57:13,871][36138] Updated weights for policy 0, policy_version 45583 (0.0009) [2023-02-25 13:57:14,246][36139] DAMAGECOUNT value on done: 630116.0 [2023-02-25 13:57:14,246][36139] Sum rewards: 62.209, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.425', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.025', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon2': '0.348', 'weapon4': '0.384', 'WEAPON3': '1.200', 'weapon3': '3.014', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '15.813', 'FRAGCOUNT': '51.000'} [2023-02-25 13:57:14,558][36139] DAMAGECOUNT value on done: 624235.0 [2023-02-25 13:57:14,558][36139] Sum rewards: 45.011, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.792', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.031', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'weapon2': '0.188', 'AMMO3': '0.269', 'WEAPON4': '0.350', 'weapon4': '0.540', 'WEAPON3': '1.600', 'weapon3': '2.870', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.473', 'FRAGCOUNT': '43.000'} [2023-02-25 13:57:14,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13426.5). Total num frames: 186716160. Throughput: 0: 3348.3. Samples: 9173918. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:57:14,730][36114] Avg episode reward: [(0, '53.475')] [2023-02-25 13:57:16,919][36138] Updated weights for policy 0, policy_version 45593 (0.0009) [2023-02-25 13:57:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13440.4). Total num frames: 186785792. Throughput: 0: 3344.8. Samples: 9193968. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:57:19,729][36114] Avg episode reward: [(0, '53.475')] [2023-02-25 13:57:19,734][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000045602_186785792.pth... [2023-02-25 13:57:19,794][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000044815_183562240.pth [2023-02-25 13:57:19,974][36138] Updated weights for policy 0, policy_version 45603 (0.0009) [2023-02-25 13:57:22,875][36154] DAMAGECOUNT value on done: 629308.0 [2023-02-25 13:57:22,876][36154] Sum rewards: 33.640, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.180', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.137', 'WEAPON4': '0.200', 'weapon4': '0.290', 'WEAPON3': '0.900', 'weapon2': '1.008', 'weapon3': '2.486', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '10.350', 'FRAGCOUNT': '27.000'} [2023-02-25 13:57:23,053][36138] Updated weights for policy 0, policy_version 45613 (0.0009) [2023-02-25 13:57:23,121][36141] DAMAGECOUNT value on done: 633221.0 [2023-02-25 13:57:23,122][36141] Sum rewards: 58.706, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.610', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.224', 'weapon2': '0.444', 'WEAPON3': '1.450', 'weapon3': '3.340', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '14.778', 'FRAGCOUNT': '51.000'} [2023-02-25 13:57:23,191][36154] DAMAGECOUNT value on done: 617786.0 [2023-02-25 13:57:23,192][36154] Sum rewards: 58.193, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.245', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.072', 'AMMO3': '0.179', 'AMMO4': '0.192', 'weapon5': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.750', 'WEAPON3': '1.000', 'weapon3': '2.706', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.984', 'FRAGCOUNT': '48.000'} [2023-02-25 13:57:23,357][36141] DAMAGECOUNT value on done: 618859.0 [2023-02-25 13:57:23,358][36141] Sum rewards: 18.840, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.424', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.018', 'AMMO4': '0.071', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'ARMOR': '0.408', 'weapon2': '0.568', 'WEAPON3': '0.600', 'HITCOUNT': '1.110', 'weapon3': '1.492', 'DAMAGECOUNT': '4.920', 'FRAGCOUNT': '16.000'} [2023-02-25 13:57:23,441][36141] DAMAGECOUNT value on done: 627733.0 [2023-02-25 13:57:23,442][36141] Sum rewards: 49.813, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.662', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon5': '0.128', 'AMMO4': '0.156', 'AMMO3': '0.233', 'weapon2': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.418', 'WEAPON3': '1.500', 'weapon3': '2.874', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.572', 'FRAGCOUNT': '47.000'} [2023-02-25 13:57:23,454][36154] DAMAGECOUNT value on done: 626653.0 [2023-02-25 13:57:23,454][36154] Sum rewards: 33.543, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.435', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon5': '0.044', 'weapon4': '0.114', 'AMMO4': '0.184', 'AMMO3': '0.233', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.560', 'weapon3': '3.238', 'DAMAGECOUNT': '11.070', 'FRAGCOUNT': '33.500'} [2023-02-25 13:57:23,677][36141] DAMAGECOUNT value on done: 615768.0 [2023-02-25 13:57:23,678][36141] Sum rewards: 44.952, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.464', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO4': '0.216', 'weapon5': '0.236', 'AMMO3': '0.237', 'weapon2': '0.356', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.620', 'WEAPON3': '1.450', 'weapon3': '2.380', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '13.212', 'FRAGCOUNT': '44.000'} [2023-02-25 13:57:23,765][36154] DAMAGECOUNT value on done: 627821.0 [2023-02-25 13:57:23,766][36154] Sum rewards: 55.168, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.304', 'AMMO5': '0.010', 'AMMO2': '0.058', 'AMMO3': '0.122', 'weapon5': '0.182', 'AMMO4': '0.287', 'weapon2': '0.346', 'WEAPON5': '0.350', 'WEAPON4': '0.600', 'WEAPON3': '0.650', 'weapon4': '0.908', 'weapon3': '2.224', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '44.000'} [2023-02-25 13:57:24,405][36157] DAMAGECOUNT value on done: 635950.0 [2023-02-25 13:57:24,405][36157] Sum rewards: 59.896, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.550', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.052', 'AMMO4': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon4': '0.194', 'weapon2': '0.672', 'WEAPON3': '1.100', 'weapon3': '2.954', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.136', 'FRAGCOUNT': '50.000'} [2023-02-25 13:57:24,699][36157] DAMAGECOUNT value on done: 627498.0 [2023-02-25 13:57:24,699][36157] Sum rewards: 52.640, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.417', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.046', 'AMMO4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon4': '0.226', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.250', 'weapon3': '3.144', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.725', 'FRAGCOUNT': '48.000'} [2023-02-25 13:57:24,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13426.5). Total num frames: 186851328. Throughput: 0: 3345.6. Samples: 9203922. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:57:24,730][36114] Avg episode reward: [(0, '53.126')] [2023-02-25 13:57:25,452][36157] DAMAGECOUNT value on done: 636024.0 [2023-02-25 13:57:25,453][36157] Sum rewards: 57.767, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.759', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon4': '0.268', 'weapon2': '0.642', 'WEAPON3': '1.100', 'weapon3': '2.742', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.015', 'FRAGCOUNT': '49.000'} [2023-02-25 13:57:25,518][36140] DAMAGECOUNT value on done: 633819.0 [2023-02-25 13:57:25,519][36140] Sum rewards: 52.084, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.030', 'AMMO5': '0.013', 'AMMO2': '0.033', 'AMMO4': '0.164', 'AMMO3': '0.191', 'weapon5': '0.226', 'weapon2': '0.284', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.872', 'WEAPON3': '1.150', 'weapon3': '2.272', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.959', 'FRAGCOUNT': '47.000'} [2023-02-25 13:57:25,761][36157] DAMAGECOUNT value on done: 629564.0 [2023-02-25 13:57:25,762][36157] Sum rewards: 47.431, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.534', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.050', 'AMMO4': '0.075', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'weapon2': '0.406', 'weapon4': '0.502', 'WEAPON3': '1.300', 'weapon3': '2.844', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '12.903', 'FRAGCOUNT': '43.000'} [2023-02-25 13:57:25,820][36140] DAMAGECOUNT value on done: 614447.0 [2023-02-25 13:57:25,821][36140] Sum rewards: 53.946, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.060', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.150', 'weapon2': '0.172', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.304', 'WEAPON3': '1.400', 'HITCOUNT': '2.880', 'weapon3': '2.958', 'DAMAGECOUNT': '13.506', 'FRAGCOUNT': '49.000'} [2023-02-25 13:57:26,105][36138] Updated weights for policy 0, policy_version 45623 (0.0009) [2023-02-25 13:57:26,133][36140] DAMAGECOUNT value on done: 625432.0 [2023-02-25 13:57:26,134][36140] Sum rewards: 50.372, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.538', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO3': '0.155', 'weapon5': '0.160', 'AMMO4': '0.225', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.482', 'weapon4': '0.694', 'WEAPON3': '0.950', 'weapon3': '2.408', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.861', 'FRAGCOUNT': '43.000'} [2023-02-25 13:57:26,447][36140] DAMAGECOUNT value on done: 623638.0 [2023-02-25 13:57:26,447][36140] Sum rewards: 49.406, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.150', 'AMMO5': '0.017', 'AMMO2': '0.036', 'AMMO4': '0.181', 'weapon5': '0.190', 'AMMO3': '0.196', 'weapon2': '0.334', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.672', 'WEAPON3': '1.150', 'weapon3': '2.504', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.145', 'FRAGCOUNT': '45.000'} [2023-02-25 13:57:27,677][36142] DAMAGECOUNT value on done: 632922.0 [2023-02-25 13:57:27,678][36142] Sum rewards: 55.108, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.963', 'AMMO5': '0.020', 'AMMO2': '0.048', 'AMMO3': '0.175', 'AMMO4': '0.239', 'weapon5': '0.248', 'weapon4': '0.326', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.634', 'WEAPON3': '1.100', 'weapon3': '2.482', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.609', 'FRAGCOUNT': '48.000'} [2023-02-25 13:57:27,744][36142] DAMAGECOUNT value on done: 615980.0 [2023-02-25 13:57:27,744][36142] Sum rewards: 56.522, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.030', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.092', 'weapon5': '0.130', 'AMMO4': '0.193', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.532', 'WEAPON3': '1.300', 'weapon3': '3.014', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.838', 'FRAGCOUNT': '49.000'} [2023-02-25 13:57:27,982][36142] DAMAGECOUNT value on done: 617875.0 [2023-02-25 13:57:27,982][36142] Sum rewards: 49.855, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.911', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.098', 'AMMO4': '0.140', 'AMMO3': '0.195', 'weapon4': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.476', 'WEAPON3': '1.100', 'weapon3': '2.566', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.282', 'FRAGCOUNT': '44.000'} [2023-02-25 13:57:28,050][36142] DAMAGECOUNT value on done: 628680.0 [2023-02-25 13:57:28,051][36142] Sum rewards: 53.170, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.655', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.020', 'weapon5': '0.054', 'weapon4': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'weapon2': '0.538', 'WEAPON3': '1.200', 'weapon3': '2.912', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.605', 'FRAGCOUNT': '45.000'} [2023-02-25 13:57:28,483][36156] DAMAGECOUNT value on done: 634175.0 [2023-02-25 13:57:28,483][36156] Sum rewards: 61.510, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.045', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.027', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.206', 'weapon4': '0.290', 'weapon2': '0.360', 'WEAPON3': '1.250', 'weapon3': '3.040', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '52.000'} [2023-02-25 13:57:28,615][36156] DAMAGECOUNT value on done: 637294.0 [2023-02-25 13:57:28,616][36156] Sum rewards: 58.809, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.292', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO3': '0.165', 'AMMO4': '0.184', 'weapon2': '0.238', 'weapon5': '0.258', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.528', 'WEAPON3': '0.950', 'weapon3': '2.652', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '48.000'} [2023-02-25 13:57:28,787][36156] DAMAGECOUNT value on done: 621302.0 [2023-02-25 13:57:28,788][36156] Sum rewards: 60.742, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.580', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.054', 'weapon5': '0.064', 'weapon2': '0.148', 'AMMO4': '0.149', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.380', 'weapon3': '3.530', 'DAMAGECOUNT': '15.792', 'FRAGCOUNT': '53.000'} [2023-02-25 13:57:28,942][36156] DAMAGECOUNT value on done: 627161.0 [2023-02-25 13:57:28,943][36156] Sum rewards: 49.515, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.695', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.126', 'AMMO3': '0.144', 'weapon5': '0.152', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.654', 'weapon4': '0.764', 'WEAPON3': '0.950', 'weapon3': '2.186', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.429', 'FRAGCOUNT': '42.500'} [2023-02-25 13:57:29,165][36138] Updated weights for policy 0, policy_version 45633 (0.0009) [2023-02-25 13:57:29,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13426.5). Total num frames: 186916864. Throughput: 0: 3350.3. Samples: 9224092. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:57:29,729][36114] Avg episode reward: [(0, '53.370')] [2023-02-25 13:57:32,040][36155] DAMAGECOUNT value on done: 618529.0 [2023-02-25 13:57:32,041][36155] Sum rewards: 50.585, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.534', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.042', 'AMMO4': '0.210', 'AMMO3': '0.216', 'weapon5': '0.252', 'WEAPON4': '0.400', 'weapon2': '0.522', 'WEAPON5': '0.550', 'weapon4': '0.652', 'WEAPON3': '1.350', 'weapon3': '2.234', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.451', 'FRAGCOUNT': '45.000'} [2023-02-25 13:57:32,242][36138] Updated weights for policy 0, policy_version 45643 (0.0009) [2023-02-25 13:57:32,363][36155] DAMAGECOUNT value on done: 638724.0 [2023-02-25 13:57:32,363][36155] Sum rewards: 49.784, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.363', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.112', 'weapon2': '0.160', 'AMMO3': '0.183', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.814', 'WEAPON3': '1.100', 'weapon3': '2.500', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.854', 'FRAGCOUNT': '43.000'} [2023-02-25 13:57:32,934][36155] DAMAGECOUNT value on done: 634103.0 [2023-02-25 13:57:32,934][36155] Sum rewards: 55.645, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.050', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.055', 'AMMO3': '0.189', 'weapon5': '0.220', 'AMMO4': '0.276', 'weapon4': '0.388', 'weapon2': '0.410', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.626', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '48.000'} [2023-02-25 13:57:33,234][36155] DAMAGECOUNT value on done: 625798.0 [2023-02-25 13:57:33,234][36155] Sum rewards: 49.339, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.210', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.049', 'weapon5': '0.146', 'AMMO3': '0.161', 'AMMO4': '0.243', 'WEAPON5': '0.300', 'weapon2': '0.346', 'WEAPON4': '0.600', 'WEAPON3': '0.950', 'weapon4': '1.086', 'weapon3': '2.174', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.903', 'FRAGCOUNT': '44.000'} [2023-02-25 13:57:33,514][36139] DAMAGECOUNT value on done: 632448.0 [2023-02-25 13:57:33,515][36139] Sum rewards: 56.771, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.906', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.182', 'weapon5': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.362', 'weapon4': '0.690', 'WEAPON3': '1.100', 'weapon3': '2.446', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.194', 'FRAGCOUNT': '45.500'} [2023-02-25 13:57:33,829][36139] DAMAGECOUNT value on done: 623669.0 [2023-02-25 13:57:33,829][36139] Sum rewards: 55.504, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.430', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.046', 'AMMO4': '0.227', 'AMMO3': '0.228', 'weapon5': '0.228', 'weapon2': '0.294', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.668', 'WEAPON3': '1.300', 'weapon3': '2.492', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.709', 'FRAGCOUNT': '50.000'} [2023-02-25 13:57:34,321][36139] DAMAGECOUNT value on done: 634811.0 [2023-02-25 13:57:34,322][36139] Sum rewards: 50.894, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.782', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.034', 'AMMO3': '0.116', 'AMMO4': '0.169', 'weapon5': '0.172', 'weapon2': '0.264', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '0.800', 'weapon4': '1.030', 'weapon3': '2.268', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.082', 'FRAGCOUNT': '44.000'} [2023-02-25 13:57:34,647][36139] DAMAGECOUNT value on done: 629105.0 [2023-02-25 13:57:34,648][36139] Sum rewards: 56.880, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.512', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.009', 'weapon5': '0.044', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.156', 'AMMO3': '0.199', 'weapon2': '0.458', 'WEAPON3': '1.150', 'HITCOUNT': '2.990', 'weapon3': '3.124', 'DAMAGECOUNT': '14.610', 'FRAGCOUNT': '48.000'} [2023-02-25 13:57:34,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13426.5). Total num frames: 186986496. Throughput: 0: 3348.8. Samples: 9244176. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:57:34,730][36114] Avg episode reward: [(0, '52.894')] [2023-02-25 13:57:35,324][36138] Updated weights for policy 0, policy_version 45653 (0.0009) [2023-02-25 13:57:38,376][36138] Updated weights for policy 0, policy_version 45663 (0.0009) [2023-02-25 13:57:39,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13426.5). Total num frames: 187052032. Throughput: 0: 3348.2. Samples: 9254226. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:57:39,730][36114] Avg episode reward: [(0, '52.894')] [2023-02-25 13:57:41,395][36138] Updated weights for policy 0, policy_version 45673 (0.0009) [2023-02-25 13:57:42,854][36154] DAMAGECOUNT value on done: 634772.0 [2023-02-25 13:57:42,854][36154] Sum rewards: 61.831, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.804', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.158', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'weapon2': '0.404', 'weapon4': '0.722', 'WEAPON3': '1.150', 'weapon3': '2.254', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '51.000'} [2023-02-25 13:57:43,151][36154] DAMAGECOUNT value on done: 621237.0 [2023-02-25 13:57:43,151][36154] Sum rewards: 39.413, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.165', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.092', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'weapon2': '0.422', 'weapon4': '0.850', 'WEAPON3': '1.050', 'weapon3': '2.524', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '10.353', 'FRAGCOUNT': '35.000'} [2023-02-25 13:57:43,231][36141] DAMAGECOUNT value on done: 637446.0 [2023-02-25 13:57:43,231][36141] Sum rewards: 47.759, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.849', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.148', 'weapon2': '0.158', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'AMMO4': '0.204', 'WEAPON4': '0.350', 'weapon4': '0.858', 'WEAPON3': '1.050', 'weapon3': '2.334', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '12.675', 'FRAGCOUNT': '42.000'} [2023-02-25 13:57:43,425][36154] DAMAGECOUNT value on done: 630293.0 [2023-02-25 13:57:43,425][36154] Sum rewards: 41.218, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.312', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon2': '0.196', 'AMMO3': '0.206', 'AMMO4': '0.211', 'weapon5': '0.268', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.844', 'WEAPON3': '1.250', 'weapon3': '2.318', 'HITCOUNT': '2.400', 'DAMAGECOUNT': '10.920', 'FRAGCOUNT': '40.500'} [2023-02-25 13:57:43,458][36141] DAMAGECOUNT value on done: 624383.0 [2023-02-25 13:57:43,458][36141] Sum rewards: 55.982, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.580', 'ARMOR': '0.004', 'AMMO5': '0.034', 'AMMO2': '0.083', 'AMMO3': '0.135', 'AMMO4': '0.415', 'weapon5': '0.484', 'weapon2': '0.524', 'WEAPON5': '0.750', 'WEAPON3': '0.800', 'WEAPON4': '0.800', 'weapon4': '0.992', 'weapon3': '1.628', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '47.000'} [2023-02-25 13:57:43,556][36141] DAMAGECOUNT value on done: 632460.0 [2023-02-25 13:57:43,556][36141] Sum rewards: 50.758, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.936', 'ARMOR': '0.008', 'AMMO5': '0.023', 'AMMO2': '0.049', 'AMMO3': '0.200', 'weapon5': '0.202', 'AMMO4': '0.243', 'weapon2': '0.322', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'weapon4': '0.816', 'WEAPON3': '1.150', 'weapon3': '2.280', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.181', 'FRAGCOUNT': '46.500'} [2023-02-25 13:57:43,721][36154] DAMAGECOUNT value on done: 632977.0 [2023-02-25 13:57:43,722][36154] Sum rewards: 54.697, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.720', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.055', 'weapon5': '0.190', 'weapon2': '0.204', 'AMMO3': '0.222', 'AMMO4': '0.276', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.590', 'WEAPON3': '1.300', 'weapon3': '2.718', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.468', 'FRAGCOUNT': '49.500'} [2023-02-25 13:57:43,774][36141] DAMAGECOUNT value on done: 619973.0 [2023-02-25 13:57:43,774][36141] Sum rewards: 45.126, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.470', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.208', 'weapon2': '0.274', 'weapon4': '0.466', 'WEAPON3': '1.200', 'HITCOUNT': '2.970', 'weapon3': '3.114', 'DAMAGECOUNT': '12.615', 'FRAGCOUNT': '38.000'} [2023-02-25 13:57:44,488][36138] Updated weights for policy 0, policy_version 45683 (0.0009) [2023-02-25 13:57:44,507][36157] DAMAGECOUNT value on done: 640774.0 [2023-02-25 13:57:44,507][36157] Sum rewards: 56.253, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.146', 'AMMO5': '0.005', 'AMMO2': '0.048', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'AMMO4': '0.239', 'weapon2': '0.314', 'WEAPON4': '0.350', 'weapon4': '0.584', 'WEAPON3': '1.100', 'weapon3': '2.766', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.472', 'FRAGCOUNT': '49.000'} [2023-02-25 13:57:44,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 187117568. Throughput: 0: 3346.8. Samples: 9274244. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:57:44,729][36114] Avg episode reward: [(0, '52.765')] [2023-02-25 13:57:44,824][36157] DAMAGECOUNT value on done: 632075.0 [2023-02-25 13:57:44,824][36157] Sum rewards: 58.862, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.870', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'AMMO3': '0.171', 'weapon4': '0.262', 'weapon2': '0.800', 'WEAPON3': '1.150', 'weapon3': '2.594', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.701', 'FRAGCOUNT': '50.000'} [2023-02-25 13:57:45,567][36157] DAMAGECOUNT value on done: 640136.0 [2023-02-25 13:57:45,567][36157] Sum rewards: 48.502, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.750', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'weapon2': '0.244', 'weapon4': '0.648', 'WEAPON3': '0.950', 'weapon3': '2.356', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.336', 'FRAGCOUNT': '42.000'} [2023-02-25 13:57:45,677][36140] DAMAGECOUNT value on done: 638794.0 [2023-02-25 13:57:45,677][36140] Sum rewards: 60.436, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.286', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO3': '0.121', 'weapon5': '0.144', 'AMMO4': '0.162', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.406', 'weapon2': '0.526', 'WEAPON3': '0.750', 'weapon3': '2.636', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.925', 'FRAGCOUNT': '51.000'} [2023-02-25 13:57:45,873][36157] DAMAGECOUNT value on done: 634404.0 [2023-02-25 13:57:45,873][36157] Sum rewards: 49.040, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.858', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.061', 'AMMO3': '0.207', 'AMMO4': '0.304', 'weapon2': '0.308', 'weapon5': '0.334', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'weapon4': '0.768', 'WEAPON3': '1.150', 'weapon3': '2.168', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '43.500'} [2023-02-25 13:57:45,997][36140] DAMAGECOUNT value on done: 618970.0 [2023-02-25 13:57:45,997][36140] Sum rewards: 47.876, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.922', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon5': '0.114', 'AMMO3': '0.174', 'AMMO4': '0.249', 'weapon2': '0.364', 'WEAPON5': '0.450', 'weapon4': '0.510', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.726', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.569', 'FRAGCOUNT': '43.000'} [2023-02-25 13:57:46,291][36140] DAMAGECOUNT value on done: 630687.0 [2023-02-25 13:57:46,291][36140] Sum rewards: 59.487, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.108', 'AMMO5': '0.009', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.090', 'weapon2': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'weapon4': '0.286', 'WEAPON3': '1.400', 'HITCOUNT': '3.100', 'weapon3': '3.112', 'DAMAGECOUNT': '15.765', 'FRAGCOUNT': '52.500'} [2023-02-25 13:57:46,606][36140] DAMAGECOUNT value on done: 629498.0 [2023-02-25 13:57:46,606][36140] Sum rewards: 69.950, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.748', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon5': '0.172', 'AMMO3': '0.194', 'AMMO4': '0.222', 'weapon2': '0.446', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.588', 'WEAPON3': '1.200', 'weapon3': '2.532', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '60.000'} [2023-02-25 13:57:47,565][36138] Updated weights for policy 0, policy_version 45693 (0.0010) [2023-02-25 13:57:47,748][36142] DAMAGECOUNT value on done: 637639.0 [2023-02-25 13:57:47,748][36142] Sum rewards: 51.585, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.770', 'AMMO5': '0.016', 'weapon5': '0.038', 'AMMO2': '0.052', 'weapon2': '0.234', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'AMMO4': '0.262', 'weapon4': '0.270', 'WEAPON4': '0.350', 'ARMOR': '0.462', 'WEAPON3': '1.400', 'HITCOUNT': '3.150', 'weapon3': '3.194', 'DAMAGECOUNT': '13.941', 'FRAGCOUNT': '46.000'} [2023-02-25 13:57:47,816][36142] DAMAGECOUNT value on done: 621608.0 [2023-02-25 13:57:47,817][36142] Sum rewards: 67.704, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.962', 'ARMOR': '0.005', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon5': '0.176', 'weapon2': '0.182', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.378', 'WEAPON3': '1.350', 'weapon3': '2.996', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '58.000'} [2023-02-25 13:57:48,071][36142] DAMAGECOUNT value on done: 622808.0 [2023-02-25 13:57:48,071][36142] Sum rewards: 52.503, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.525', 'AMMO5': '0.019', 'AMMO2': '0.049', 'weapon2': '0.202', 'AMMO3': '0.208', 'weapon5': '0.218', 'AMMO4': '0.245', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon4': '0.810', 'WEAPON3': '1.350', 'weapon3': '2.478', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.799', 'FRAGCOUNT': '48.000'} [2023-02-25 13:57:48,145][36142] DAMAGECOUNT value on done: 633382.0 [2023-02-25 13:57:48,146][36142] Sum rewards: 48.474, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.015', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.090', 'AMMO4': '0.146', 'weapon4': '0.186', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.456', 'WEAPON3': '1.350', 'weapon3': '3.002', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.106', 'FRAGCOUNT': '43.000'} [2023-02-25 13:57:48,590][36156] DAMAGECOUNT value on done: 638741.0 [2023-02-25 13:57:48,590][36156] Sum rewards: 51.702, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.492', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.098', 'AMMO4': '0.149', 'AMMO3': '0.157', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.452', 'weapon4': '0.804', 'WEAPON3': '1.000', 'weapon3': '2.364', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.443', 'FRAGCOUNT': '44.000'} [2023-02-25 13:57:48,718][36156] DAMAGECOUNT value on done: 642257.0 [2023-02-25 13:57:48,718][36156] Sum rewards: 60.580, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.147', 'AMMO2': '0.012', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'weapon4': '0.114', 'AMMO3': '0.251', 'weapon2': '0.312', 'WEAPON3': '1.500', 'HITCOUNT': '3.090', 'weapon3': '3.400', 'DAMAGECOUNT': '14.889', 'FRAGCOUNT': '54.000'} [2023-02-25 13:57:48,895][36156] DAMAGECOUNT value on done: 625902.0 [2023-02-25 13:57:48,895][36156] Sum rewards: 51.239, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.770', 'AMMO4': '-0.018', 'AMMO2': '-0.003', 'ARMOR': '0.004', 'WEAPON4': '0.100', 'AMMO3': '0.232', 'weapon4': '0.252', 'weapon2': '0.484', 'WEAPON3': '1.550', 'weapon3': '3.048', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.800', 'FRAGCOUNT': '46.000'} [2023-02-25 13:57:49,028][36156] DAMAGECOUNT value on done: 632179.0 [2023-02-25 13:57:49,029][36156] Sum rewards: 56.452, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.314', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO4': '0.166', 'AMMO3': '0.172', 'weapon5': '0.208', 'weapon4': '0.302', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.422', 'WEAPON3': '1.000', 'weapon3': '2.804', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.054', 'FRAGCOUNT': '48.000'} [2023-02-25 13:57:49,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13312.0, 300 sec: 13412.7). Total num frames: 187183104. Throughput: 0: 3343.6. Samples: 9294228. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:57:49,730][36114] Avg episode reward: [(0, '52.378')] [2023-02-25 13:57:50,671][36138] Updated weights for policy 0, policy_version 45703 (0.0010) [2023-02-25 13:57:51,725][36140] Large shaping reward 2.555 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.525, 175.0)] [2023-02-25 13:57:52,163][36155] DAMAGECOUNT value on done: 622419.0 [2023-02-25 13:57:52,164][36155] Sum rewards: 45.289, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.672', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.152', 'AMMO3': '0.162', 'WEAPON5': '0.200', 'weapon2': '0.270', 'WEAPON4': '0.300', 'weapon4': '0.326', 'WEAPON3': '1.150', 'HITCOUNT': '2.710', 'weapon3': '3.092', 'DAMAGECOUNT': '11.670', 'FRAGCOUNT': '39.000'} [2023-02-25 13:57:52,482][36155] DAMAGECOUNT value on done: 643714.0 [2023-02-25 13:57:52,482][36155] Sum rewards: 56.542, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.705', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.046', 'AMMO4': '0.094', 'weapon5': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon2': '0.622', 'WEAPON3': '1.150', 'weapon3': '3.030', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.970', 'FRAGCOUNT': '48.000'} [2023-02-25 13:57:53,091][36155] DAMAGECOUNT value on done: 639512.0 [2023-02-25 13:57:53,091][36155] Sum rewards: 70.013, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.765', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.048', 'AMMO4': '0.165', 'AMMO3': '0.190', 'weapon5': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.442', 'WEAPON3': '1.200', 'weapon3': '3.070', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '60.000'} [2023-02-25 13:57:53,397][36155] DAMAGECOUNT value on done: 630120.0 [2023-02-25 13:57:53,397][36155] Sum rewards: 43.628, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.156', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.140', 'AMMO4': '0.162', 'AMMO3': '0.182', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.416', 'weapon4': '0.976', 'WEAPON3': '1.050', 'weapon3': '2.188', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.966', 'FRAGCOUNT': '37.000'} [2023-02-25 13:57:53,697][36139] DAMAGECOUNT value on done: 636366.0 [2023-02-25 13:57:53,697][36139] Sum rewards: 42.738, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.880', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.052', 'AMMO4': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.173', 'WEAPON4': '0.300', 'weapon2': '0.432', 'weapon4': '0.656', 'WEAPON3': '1.000', 'weapon3': '2.314', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '11.754', 'FRAGCOUNT': '37.000'} [2023-02-25 13:57:53,783][36138] Updated weights for policy 0, policy_version 45713 (0.0010) [2023-02-25 13:57:54,000][36139] DAMAGECOUNT value on done: 627527.0 [2023-02-25 13:57:54,000][36139] Sum rewards: 42.475, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.029', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.054', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'weapon4': '0.276', 'weapon2': '0.546', 'WEAPON3': '1.050', 'HITCOUNT': '2.820', 'weapon3': '2.956', 'DAMAGECOUNT': '11.574', 'FRAGCOUNT': '36.000'} [2023-02-25 13:57:54,309][36139] DAMAGECOUNT value on done: 639756.0 [2023-02-25 13:57:54,309][36139] Sum rewards: 55.722, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.581', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon5': '0.088', 'AMMO3': '0.223', 'weapon4': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.350', 'weapon3': '3.010', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.835', 'FRAGCOUNT': '50.000'} [2023-02-25 13:57:54,634][36139] DAMAGECOUNT value on done: 634014.0 [2023-02-25 13:57:54,634][36139] Sum rewards: 59.085, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.502', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.104', 'AMMO3': '0.138', 'AMMO4': '0.165', 'WEAPON5': '0.200', 'weapon2': '0.332', 'WEAPON4': '0.450', 'weapon4': '0.770', 'WEAPON3': '0.950', 'weapon3': '2.588', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.727', 'FRAGCOUNT': '50.000'} [2023-02-25 13:57:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13426.5). Total num frames: 187252736. Throughput: 0: 3341.3. Samples: 9304174. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:57:54,729][36114] Avg episode reward: [(0, '52.703')] [2023-02-25 13:57:56,791][36138] Updated weights for policy 0, policy_version 45723 (0.0009) [2023-02-25 13:57:59,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 187318272. Throughput: 0: 3338.1. Samples: 9324132. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:57:59,730][36114] Avg episode reward: [(0, '52.703')] [2023-02-25 13:57:59,868][36138] Updated weights for policy 0, policy_version 45733 (0.0009) [2023-02-25 13:58:02,912][36138] Updated weights for policy 0, policy_version 45743 (0.0009) [2023-02-25 13:58:03,085][36154] DAMAGECOUNT value on done: 639311.0 [2023-02-25 13:58:03,086][36154] Sum rewards: 45.523, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.637', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.039', 'AMMO3': '0.167', 'AMMO4': '0.197', 'weapon5': '0.328', 'weapon4': '0.342', 'weapon2': '0.396', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.624', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.617', 'FRAGCOUNT': '39.000'} [2023-02-25 13:58:03,358][36141] DAMAGECOUNT value on done: 643393.0 [2023-02-25 13:58:03,359][36141] Sum rewards: 70.235, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.490', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.100', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon2': '0.218', 'weapon4': '0.296', 'WEAPON3': '1.300', 'weapon3': '3.110', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '58.000'} [2023-02-25 13:58:03,424][36154] DAMAGECOUNT value on done: 626548.0 [2023-02-25 13:58:03,424][36154] Sum rewards: 60.812, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.366', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.120', 'AMMO4': '0.153', 'weapon2': '0.198', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.466', 'WEAPON3': '1.300', 'weapon3': '3.010', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.933', 'FRAGCOUNT': '52.000'} [2023-02-25 13:58:03,608][36141] DAMAGECOUNT value on done: 630302.0 [2023-02-25 13:58:03,608][36141] Sum rewards: 69.833, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.270', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.070', 'weapon5': '0.086', 'weapon2': '0.178', 'WEAPON4': '0.200', 'AMMO4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.266', 'WEAPON3': '1.500', 'weapon3': '3.346', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '61.000'} [2023-02-25 13:58:03,691][36141] DAMAGECOUNT value on done: 636936.0 [2023-02-25 13:58:03,691][36141] Sum rewards: 55.351, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.244', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.033', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'AMMO4': '0.164', 'WEAPON4': '0.250', 'weapon4': '0.426', 'weapon2': '0.526', 'WEAPON3': '0.750', 'weapon3': '2.642', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.428', 'FRAGCOUNT': '45.000'} [2023-02-25 13:58:03,696][36154] DAMAGECOUNT value on done: 635468.0 [2023-02-25 13:58:03,697][36154] Sum rewards: 65.124, reward structure: {'DEATHCOUNT': '-12.750', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.298', 'weapon4': '0.326', 'HEALTH': '0.422', 'weapon2': '0.622', 'WEAPON3': '0.850', 'weapon3': '2.516', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.195', 'FRAGCOUNT': '54.000'} [2023-02-25 13:58:03,932][36141] DAMAGECOUNT value on done: 625189.0 [2023-02-25 13:58:03,933][36141] Sum rewards: 61.936, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.488', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.150', 'weapon5': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.450', 'weapon2': '0.520', 'WEAPON3': '0.950', 'weapon3': '2.714', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '51.000'} [2023-02-25 13:58:04,005][36154] DAMAGECOUNT value on done: 637467.0 [2023-02-25 13:58:04,006][36154] Sum rewards: 51.928, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.250', 'AMMO5': '0.012', 'AMMO2': '0.041', 'AMMO3': '0.171', 'weapon5': '0.172', 'AMMO4': '0.203', 'WEAPON5': '0.350', 'weapon4': '0.394', 'weapon2': '0.420', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'HITCOUNT': '2.730', 'weapon3': '2.748', 'DAMAGECOUNT': '13.437', 'FRAGCOUNT': '46.000'} [2023-02-25 13:58:04,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13312.0, 300 sec: 13412.7). Total num frames: 187383808. Throughput: 0: 3333.8. Samples: 9343988. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:58:04,730][36114] Avg episode reward: [(0, '52.772')] [2023-02-25 13:58:04,861][36157] DAMAGECOUNT value on done: 645353.0 [2023-02-25 13:58:04,862][36157] Sum rewards: 55.099, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.378', 'AMMO5': '0.014', 'AMMO2': '0.041', 'AMMO3': '0.108', 'weapon5': '0.178', 'AMMO4': '0.205', 'WEAPON5': '0.300', 'weapon4': '0.338', 'WEAPON4': '0.400', 'weapon2': '0.410', 'WEAPON3': '0.650', 'weapon3': '2.796', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.737', 'FRAGCOUNT': '44.000'} [2023-02-25 13:58:05,175][36157] DAMAGECOUNT value on done: 636745.0 [2023-02-25 13:58:05,176][36157] Sum rewards: 39.359, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-4.096', 'AMMO5': '0.019', 'AMMO2': '0.048', 'weapon5': '0.206', 'AMMO4': '0.239', 'weapon2': '0.268', 'AMMO3': '0.288', 'WEAPON5': '0.450', 'weapon4': '0.644', 'WEAPON4': '0.650', 'WEAPON3': '1.700', 'weapon3': '2.492', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '13.710', 'FRAGCOUNT': '41.000'} [2023-02-25 13:58:05,862][36157] DAMAGECOUNT value on done: 645518.0 [2023-02-25 13:58:05,863][36157] Sum rewards: 58.818, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.160', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.182', 'weapon2': '0.200', 'AMMO4': '0.206', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.304', 'WEAPON3': '1.400', 'weapon3': '3.032', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.146', 'FRAGCOUNT': '51.000'} [2023-02-25 13:58:05,990][36140] DAMAGECOUNT value on done: 644029.0 [2023-02-25 13:58:05,991][36140] Sum rewards: 57.357, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.062', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.180', 'weapon4': '0.218', 'AMMO3': '0.243', 'WEAPON3': '1.500', 'HITCOUNT': '3.170', 'weapon3': '3.298', 'DAMAGECOUNT': '15.705', 'FRAGCOUNT': '49.000'} [2023-02-25 13:58:06,055][36138] Updated weights for policy 0, policy_version 45753 (0.0010) [2023-02-25 13:58:06,175][36157] DAMAGECOUNT value on done: 638719.0 [2023-02-25 13:58:06,176][36157] Sum rewards: 48.361, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.300', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.134', 'weapon2': '0.174', 'AMMO3': '0.175', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.462', 'WEAPON3': '0.900', 'HITCOUNT': '2.570', 'weapon3': '3.008', 'DAMAGECOUNT': '12.945', 'FRAGCOUNT': '42.500'} [2023-02-25 13:58:06,304][36140] DAMAGECOUNT value on done: 624749.0 [2023-02-25 13:58:06,304][36140] Sum rewards: 59.195, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.570', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.158', 'AMMO3': '0.201', 'AMMO4': '0.211', 'weapon2': '0.222', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.568', 'WEAPON3': '1.250', 'weapon3': '2.824', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '49.000'} [2023-02-25 13:58:06,586][36140] DAMAGECOUNT value on done: 634306.0 [2023-02-25 13:58:06,586][36140] Sum rewards: 41.219, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.633', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.192', 'weapon5': '0.196', 'weapon2': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.550', 'weapon4': '1.060', 'WEAPON3': '1.150', 'weapon3': '2.232', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '10.857', 'FRAGCOUNT': '40.000'} [2023-02-25 13:58:06,895][36140] DAMAGECOUNT value on done: 634158.0 [2023-02-25 13:58:06,895][36140] Sum rewards: 52.252, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.515', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon5': '0.104', 'AMMO4': '0.127', 'AMMO3': '0.235', 'weapon2': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.354', 'WEAPON3': '1.350', 'weapon3': '2.890', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.980', 'FRAGCOUNT': '47.500'} [2023-02-25 13:58:08,031][36142] DAMAGECOUNT value on done: 642469.0 [2023-02-25 13:58:08,031][36142] Sum rewards: 59.155, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.442', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'weapon5': '0.172', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon4': '0.222', 'weapon2': '0.988', 'WEAPON3': '1.000', 'weapon3': '2.428', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.490', 'FRAGCOUNT': '51.000'} [2023-02-25 13:58:08,110][36142] DAMAGECOUNT value on done: 625419.0 [2023-02-25 13:58:08,111][36142] Sum rewards: 45.247, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.456', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.014', 'weapon5': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.060', 'AMMO4': '0.070', 'AMMO3': '0.171', 'weapon2': '0.180', 'WEAPON3': '1.100', 'HITCOUNT': '2.420', 'weapon3': '3.620', 'DAMAGECOUNT': '11.433', 'FRAGCOUNT': '38.000'} [2023-02-25 13:58:08,354][36142] DAMAGECOUNT value on done: 627582.0 [2023-02-25 13:58:08,355][36142] Sum rewards: 57.233, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.886', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.143', 'AMMO3': '0.193', 'weapon5': '0.224', 'weapon4': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.150', 'HITCOUNT': '2.650', 'weapon3': '2.920', 'DAMAGECOUNT': '14.322', 'FRAGCOUNT': '48.000'} [2023-02-25 13:58:08,434][36142] DAMAGECOUNT value on done: 638831.0 [2023-02-25 13:58:08,434][36142] Sum rewards: 62.419, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.750', 'AMMO5': '0.009', 'AMMO2': '0.030', 'AMMO3': '0.138', 'AMMO4': '0.152', 'weapon5': '0.158', 'weapon4': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.394', 'WEAPON3': '0.850', 'weapon3': '3.042', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '50.000'} [2023-02-25 13:58:08,911][36156] DAMAGECOUNT value on done: 643157.0 [2023-02-25 13:58:08,912][36156] Sum rewards: 46.962, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.264', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.176', 'AMMO3': '0.188', 'weapon5': '0.234', 'weapon2': '0.290', 'weapon4': '0.344', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.700', 'weapon3': '2.844', 'DAMAGECOUNT': '13.248', 'FRAGCOUNT': '41.500'} [2023-02-25 13:58:09,040][36156] DAMAGECOUNT value on done: 648109.0 [2023-02-25 13:58:09,040][36156] Sum rewards: 70.990, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.950', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.216', 'AMMO3': '0.282', 'weapon4': '0.316', 'WEAPON3': '1.750', 'weapon3': '2.998', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.556', 'FRAGCOUNT': '64.000'} [2023-02-25 13:58:09,145][36138] Updated weights for policy 0, policy_version 45763 (0.0009) [2023-02-25 13:58:09,238][36156] DAMAGECOUNT value on done: 631212.0 [2023-02-25 13:58:09,239][36156] Sum rewards: 59.581, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.255', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO3': '0.166', 'AMMO4': '0.188', 'weapon5': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.548', 'weapon2': '0.552', 'WEAPON3': '1.100', 'weapon3': '2.452', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.930', 'FRAGCOUNT': '49.000'} [2023-02-25 13:58:09,373][36156] DAMAGECOUNT value on done: 636186.0 [2023-02-25 13:58:09,374][36156] Sum rewards: 43.683, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.396', 'AMMO5': '0.023', 'AMMO2': '0.063', 'AMMO3': '0.129', 'AMMO4': '0.316', 'weapon5': '0.376', 'weapon4': '0.500', 'weapon2': '0.548', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'weapon3': '2.302', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '12.021', 'FRAGCOUNT': '36.000'} [2023-02-25 13:58:09,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13312.0, 300 sec: 13412.7). Total num frames: 187449344. Throughput: 0: 3332.9. Samples: 9353904. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:58:09,729][36114] Avg episode reward: [(0, '53.106')] [2023-02-25 13:58:12,156][36138] Updated weights for policy 0, policy_version 45773 (0.0009) [2023-02-25 13:58:12,255][36155] DAMAGECOUNT value on done: 626833.0 [2023-02-25 13:58:12,255][36155] Sum rewards: 51.116, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.660', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.070', 'AMMO4': '0.174', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON4': '0.400', 'weapon4': '0.602', 'WEAPON3': '1.400', 'HITCOUNT': '2.790', 'weapon3': '2.812', 'DAMAGECOUNT': '13.242', 'FRAGCOUNT': '48.000'} [2023-02-25 13:58:12,567][36155] DAMAGECOUNT value on done: 648140.0 [2023-02-25 13:58:12,567][36155] Sum rewards: 50.442, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.120', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.116', 'AMMO3': '0.172', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'weapon2': '0.386', 'WEAPON4': '0.450', 'weapon4': '0.564', 'WEAPON3': '1.150', 'weapon3': '2.728', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '13.278', 'FRAGCOUNT': '45.000'} [2023-02-25 13:58:13,163][36155] DAMAGECOUNT value on done: 643292.0 [2023-02-25 13:58:13,163][36155] Sum rewards: 32.572, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.190', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.053', 'weapon4': '0.188', 'AMMO3': '0.207', 'weapon5': '0.242', 'AMMO4': '0.268', 'weapon2': '0.300', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'HITCOUNT': '2.230', 'weapon3': '2.956', 'DAMAGECOUNT': '11.340', 'FRAGCOUNT': '32.000'} [2023-02-25 13:58:13,460][36155] DAMAGECOUNT value on done: 634636.0 [2023-02-25 13:58:13,460][36155] Sum rewards: 49.996, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.744', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.120', 'AMMO4': '0.141', 'AMMO3': '0.168', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.468', 'weapon4': '0.542', 'weapon2': '0.626', 'WEAPON3': '1.000', 'weapon3': '2.508', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.548', 'FRAGCOUNT': '45.000'} [2023-02-25 13:58:13,883][36139] DAMAGECOUNT value on done: 640711.0 [2023-02-25 13:58:13,884][36139] Sum rewards: 51.937, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.335', 'AMMO2': '0.008', 'AMMO4': '0.037', 'WEAPON4': '0.150', 'weapon2': '0.218', 'AMMO3': '0.264', 'weapon4': '0.364', 'WEAPON3': '1.550', 'HITCOUNT': '3.180', 'weapon3': '3.216', 'DAMAGECOUNT': '13.035', 'FRAGCOUNT': '48.000'} [2023-02-25 13:58:14,193][36139] DAMAGECOUNT value on done: 632520.0 [2023-02-25 13:58:14,193][36139] Sum rewards: 60.098, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.700', 'AMMO5': '0.007', 'AMMO2': '0.034', 'AMMO3': '0.154', 'AMMO4': '0.168', 'weapon2': '0.268', 'weapon5': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.600', 'WEAPON3': '0.900', 'weapon4': '1.182', 'weapon3': '2.056', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '14.979', 'FRAGCOUNT': '50.000'} [2023-02-25 13:58:14,493][36139] DAMAGECOUNT value on done: 644806.0 [2023-02-25 13:58:14,494][36139] Sum rewards: 57.116, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.060', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.182', 'AMMO3': '0.230', 'weapon2': '0.298', 'WEAPON3': '1.350', 'weapon3': '3.348', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.150', 'FRAGCOUNT': '49.000'} [2023-02-25 13:58:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 187518976. Throughput: 0: 3333.9. Samples: 9374118. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 13:58:14,730][36114] Avg episode reward: [(0, '52.875')] [2023-02-25 13:58:14,798][36139] DAMAGECOUNT value on done: 639601.0 [2023-02-25 13:58:14,798][36139] Sum rewards: 69.686, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.910', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon5': '0.156', 'AMMO3': '0.175', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON4': '0.350', 'weapon4': '0.426', 'WEAPON3': '1.050', 'weapon3': '2.882', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '59.000'} [2023-02-25 13:58:15,219][36138] Updated weights for policy 0, policy_version 45783 (0.0010) [2023-02-25 13:58:18,260][36138] Updated weights for policy 0, policy_version 45793 (0.0010) [2023-02-25 13:58:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13312.0, 300 sec: 13412.7). Total num frames: 187584512. Throughput: 0: 3338.0. Samples: 9394386. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:58:19,730][36114] Avg episode reward: [(0, '53.076')] [2023-02-25 13:58:21,322][36138] Updated weights for policy 0, policy_version 45803 (0.0009) [2023-02-25 13:58:23,078][36154] DAMAGECOUNT value on done: 643539.0 [2023-02-25 13:58:23,079][36154] Sum rewards: 51.864, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.332', 'AMMO5': '0.004', 'AMMO2': '0.034', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.158', 'AMMO4': '0.170', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon2': '0.442', 'weapon4': '0.516', 'WEAPON3': '1.100', 'HITCOUNT': '2.740', 'weapon3': '2.760', 'DAMAGECOUNT': '12.684', 'FRAGCOUNT': '44.000'} [2023-02-25 13:58:23,351][36141] DAMAGECOUNT value on done: 648845.0 [2023-02-25 13:58:23,351][36141] Sum rewards: 60.730, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.990', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon5': '0.198', 'AMMO4': '0.209', 'AMMO3': '0.211', 'weapon4': '0.298', 'weapon2': '0.372', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.850', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.356', 'FRAGCOUNT': '54.000'} [2023-02-25 13:58:23,391][36154] DAMAGECOUNT value on done: 631436.0 [2023-02-25 13:58:23,392][36154] Sum rewards: 53.308, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.150', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon5': '0.162', 'AMMO4': '0.204', 'AMMO3': '0.229', 'weapon2': '0.402', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.572', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.664', 'FRAGCOUNT': '50.000'} [2023-02-25 13:58:23,424][36155] Large shaping reward 2.520 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.528, 176.0), ('HEALTH', -0.03, -10.0), ('weapon5', 0.002)] [2023-02-25 13:58:23,602][36141] DAMAGECOUNT value on done: 635634.0 [2023-02-25 13:58:23,603][36141] Sum rewards: 59.028, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.800', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO3': '0.174', 'AMMO4': '0.196', 'weapon5': '0.218', 'weapon4': '0.324', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.460', 'WEAPON3': '1.150', 'weapon3': '2.744', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '50.000'} [2023-02-25 13:58:23,651][36154] DAMAGECOUNT value on done: 640883.0 [2023-02-25 13:58:23,652][36154] Sum rewards: 62.523, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.224', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.022', 'AMMO4': '0.024', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.202', 'AMMO3': '0.220', 'WEAPON3': '1.350', 'HITCOUNT': '3.240', 'weapon3': '3.542', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '53.000'} [2023-02-25 13:58:23,668][36141] DAMAGECOUNT value on done: 641856.0 [2023-02-25 13:58:23,668][36141] Sum rewards: 61.541, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.604', 'AMMO5': '0.010', 'weapon5': '0.020', 'AMMO2': '0.021', 'weapon4': '0.056', 'AMMO4': '0.105', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.408', 'WEAPON3': '1.200', 'HITCOUNT': '2.910', 'weapon3': '3.316', 'DAMAGECOUNT': '14.760', 'FRAGCOUNT': '54.000'} [2023-02-25 13:58:23,917][36141] DAMAGECOUNT value on done: 631327.0 [2023-02-25 13:58:23,917][36141] Sum rewards: 76.637, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.650', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.172', 'AMMO3': '0.180', 'AMMO4': '0.180', 'weapon5': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.100', 'weapon3': '2.824', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '64.000'} [2023-02-25 13:58:23,957][36154] DAMAGECOUNT value on done: 642941.0 [2023-02-25 13:58:23,957][36154] Sum rewards: 65.519, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.050', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.092', 'AMMO4': '0.112', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.366', 'weapon4': '0.416', 'WEAPON3': '1.400', 'weapon3': '2.858', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.422', 'FRAGCOUNT': '59.000'} [2023-02-25 13:58:24,366][36138] Updated weights for policy 0, policy_version 45813 (0.0008) [2023-02-25 13:58:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 187654144. Throughput: 0: 3339.2. Samples: 9404492. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:58:24,729][36114] Avg episode reward: [(0, '54.324')] [2023-02-25 13:58:24,883][36157] DAMAGECOUNT value on done: 650429.0 [2023-02-25 13:58:24,883][36157] Sum rewards: 55.289, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.790', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.170', 'weapon5': '0.192', 'AMMO3': '0.245', 'weapon2': '0.304', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.682', 'WEAPON3': '1.450', 'weapon3': '2.500', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '50.000'} [2023-02-25 13:58:25,196][36157] DAMAGECOUNT value on done: 641282.0 [2023-02-25 13:58:25,196][36157] Sum rewards: 51.638, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.710', 'ARMOR': '0.004', 'AMMO2': '0.004', 'AMMO5': '0.008', 'AMMO4': '0.020', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'weapon5': '0.258', 'weapon4': '0.402', 'weapon2': '0.430', 'WEAPON3': '1.250', 'weapon3': '2.626', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.191', 'FRAGCOUNT': '44.000'} [2023-02-25 13:58:25,870][36157] DAMAGECOUNT value on done: 649491.0 [2023-02-25 13:58:25,870][36157] Sum rewards: 47.122, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.878', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.055', 'AMMO3': '0.126', 'AMMO4': '0.274', 'weapon5': '0.400', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.508', 'weapon4': '0.558', 'WEAPON3': '0.700', 'weapon3': '2.232', 'HITCOUNT': '2.450', 'DAMAGECOUNT': '11.919', 'FRAGCOUNT': '39.000'} [2023-02-25 13:58:26,076][36140] DAMAGECOUNT value on done: 649588.0 [2023-02-25 13:58:26,076][36140] Sum rewards: 68.239, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.120', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.054', 'WEAPON4': '0.150', 'AMMO3': '0.155', 'weapon4': '0.168', 'weapon5': '0.234', 'WEAPON5': '0.250', 'weapon2': '0.610', 'WEAPON3': '1.050', 'weapon3': '2.782', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '55.000'} [2023-02-25 13:58:26,165][36157] DAMAGECOUNT value on done: 643409.0 [2023-02-25 13:58:26,166][36157] Sum rewards: 54.140, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.424', 'AMMO5': '0.012', 'AMMO2': '0.049', 'AMMO3': '0.134', 'AMMO4': '0.243', 'weapon5': '0.246', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.524', 'weapon4': '0.606', 'WEAPON3': '0.750', 'weapon3': '2.240', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.070', 'FRAGCOUNT': '44.000'} [2023-02-25 13:58:26,390][36140] DAMAGECOUNT value on done: 629390.0 [2023-02-25 13:58:26,391][36140] Sum rewards: 57.908, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.942', 'ARMOR': '0.004', 'AMMO2': '0.005', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO4': '0.022', 'weapon4': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'weapon2': '0.164', 'AMMO3': '0.201', 'WEAPON3': '1.250', 'HITCOUNT': '3.140', 'weapon3': '3.624', 'DAMAGECOUNT': '13.923', 'FRAGCOUNT': '49.000'} [2023-02-25 13:58:26,652][36140] DAMAGECOUNT value on done: 638959.0 [2023-02-25 13:58:26,653][36140] Sum rewards: 52.682, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.946', 'AMMO5': '0.014', 'AMMO2': '0.052', 'AMMO3': '0.132', 'weapon5': '0.182', 'weapon2': '0.244', 'AMMO4': '0.258', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '0.750', 'weapon4': '0.876', 'weapon3': '2.282', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '13.938', 'FRAGCOUNT': '44.000'} [2023-02-25 13:58:26,970][36140] DAMAGECOUNT value on done: 639759.0 [2023-02-25 13:58:26,971][36140] Sum rewards: 63.763, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.301', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.047', 'AMMO3': '0.222', 'AMMO4': '0.234', 'weapon2': '0.268', 'weapon5': '0.352', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.810', 'WEAPON3': '1.300', 'weapon3': '2.230', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '57.000'} [2023-02-25 13:58:27,470][36138] Updated weights for policy 0, policy_version 45823 (0.0009) [2023-02-25 13:58:27,934][36142] DAMAGECOUNT value on done: 648083.0 [2023-02-25 13:58:27,934][36142] Sum rewards: 65.293, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.720', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.130', 'WEAPON5': '0.150', 'weapon2': '0.178', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'ARMOR': '0.454', 'weapon4': '0.684', 'WEAPON3': '1.550', 'weapon3': '2.724', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '57.000'} [2023-02-25 13:58:28,009][36142] DAMAGECOUNT value on done: 630909.0 [2023-02-25 13:58:28,009][36142] Sum rewards: 57.582, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.359', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon4': '0.066', 'AMMO4': '0.114', 'weapon5': '0.214', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.460', 'WEAPON3': '1.550', 'weapon3': '2.998', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '51.500'} [2023-02-25 13:58:28,252][36142] DAMAGECOUNT value on done: 632497.0 [2023-02-25 13:58:28,252][36142] Sum rewards: 63.089, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.498', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'weapon5': '0.226', 'weapon4': '0.234', 'weapon2': '0.276', 'WEAPON3': '1.200', 'weapon3': '3.088', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.745', 'FRAGCOUNT': '53.000'} [2023-02-25 13:58:28,328][36142] DAMAGECOUNT value on done: 644779.0 [2023-02-25 13:58:28,329][36142] Sum rewards: 70.323, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.890', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.136', 'AMMO4': '0.143', 'AMMO3': '0.181', 'weapon2': '0.302', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.570', 'WEAPON3': '1.100', 'weapon3': '2.676', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.844', 'FRAGCOUNT': '59.000'} [2023-02-25 13:58:28,897][36156] DAMAGECOUNT value on done: 648223.0 [2023-02-25 13:58:28,898][36156] Sum rewards: 55.040, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.810', 'AMMO5': '0.011', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon2': '0.176', 'weapon5': '0.230', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.568', 'WEAPON3': '1.450', 'weapon3': '2.714', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.898', 'FRAGCOUNT': '48.000'} [2023-02-25 13:58:29,057][36156] DAMAGECOUNT value on done: 653126.0 [2023-02-25 13:58:29,058][36156] Sum rewards: 55.692, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.686', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon5': '0.222', 'AMMO3': '0.224', 'AMMO4': '0.264', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.476', 'weapon2': '0.616', 'WEAPON3': '1.350', 'weapon3': '2.378', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.051', 'FRAGCOUNT': '49.500'} [2023-02-25 13:58:29,205][36156] DAMAGECOUNT value on done: 635403.0 [2023-02-25 13:58:29,205][36156] Sum rewards: 45.761, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.812', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO3': '0.149', 'AMMO4': '0.173', 'weapon5': '0.206', 'weapon4': '0.250', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.444', 'WEAPON3': '0.900', 'HITCOUNT': '2.510', 'weapon3': '2.818', 'DAMAGECOUNT': '12.573', 'FRAGCOUNT': '38.500'} [2023-02-25 13:58:29,367][36156] DAMAGECOUNT value on done: 640681.0 [2023-02-25 13:58:29,367][36156] Sum rewards: 51.074, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.046', 'ARMOR': '0.008', 'AMMO5': '0.024', 'AMMO2': '0.051', 'AMMO3': '0.159', 'weapon5': '0.164', 'AMMO4': '0.255', 'WEAPON5': '0.400', 'weapon2': '0.496', 'WEAPON4': '0.550', 'WEAPON3': '0.900', 'weapon4': '0.938', 'weapon3': '2.160', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.485', 'FRAGCOUNT': '43.000'} [2023-02-25 13:58:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 187719680. Throughput: 0: 3339.5. Samples: 9424522. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:58:29,730][36114] Avg episode reward: [(0, '55.253')] [2023-02-25 13:58:30,506][36138] Updated weights for policy 0, policy_version 45833 (0.0009) [2023-02-25 13:58:32,044][36155] DAMAGECOUNT value on done: 631564.0 [2023-02-25 13:58:32,045][36155] Sum rewards: 51.638, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.505', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.142', 'weapon2': '0.180', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.452', 'WEAPON3': '1.300', 'weapon3': '2.974', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.193', 'FRAGCOUNT': '46.000'} [2023-02-25 13:58:32,363][36155] DAMAGECOUNT value on done: 652816.0 [2023-02-25 13:58:32,363][36155] Sum rewards: 46.930, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.760', 'AMMO5': '0.016', 'AMMO2': '0.043', 'AMMO4': '0.216', 'AMMO3': '0.226', 'weapon5': '0.238', 'weapon2': '0.266', 'WEAPON5': '0.450', 'weapon4': '0.516', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.640', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '44.000'} [2023-02-25 13:58:32,966][36155] DAMAGECOUNT value on done: 647980.0 [2023-02-25 13:58:32,967][36155] Sum rewards: 54.483, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.960', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.217', 'weapon2': '0.486', 'WEAPON3': '1.450', 'HITCOUNT': '2.970', 'weapon3': '3.258', 'DAMAGECOUNT': '14.064', 'FRAGCOUNT': '49.000'} [2023-02-25 13:58:33,279][36155] DAMAGECOUNT value on done: 639545.0 [2023-02-25 13:58:33,280][36155] Sum rewards: 59.101, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.970', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'weapon4': '0.344', 'weapon2': '0.374', 'WEAPON3': '1.150', 'weapon3': '2.972', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.727', 'FRAGCOUNT': '51.000'} [2023-02-25 13:58:33,598][36138] Updated weights for policy 0, policy_version 45843 (0.0009) [2023-02-25 13:58:33,967][36139] DAMAGECOUNT value on done: 646092.0 [2023-02-25 13:58:33,968][36139] Sum rewards: 62.330, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.412', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon5': '0.188', 'weapon4': '0.224', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.544', 'WEAPON3': '1.400', 'weapon3': '2.764', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.143', 'FRAGCOUNT': '55.000'} [2023-02-25 13:58:34,281][36139] DAMAGECOUNT value on done: 636513.0 [2023-02-25 13:58:34,281][36139] Sum rewards: 43.793, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.150', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.095', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'weapon4': '0.550', 'weapon2': '0.836', 'WEAPON3': '1.050', 'weapon3': '2.470', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '11.979', 'FRAGCOUNT': '37.000'} [2023-02-25 13:58:34,585][36139] DAMAGECOUNT value on done: 649529.0 [2023-02-25 13:58:34,585][36139] Sum rewards: 54.097, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.658', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon5': '0.232', 'weapon2': '0.262', 'weapon4': '0.830', 'WEAPON3': '1.200', 'weapon3': '2.428', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.169', 'FRAGCOUNT': '46.000'} [2023-02-25 13:58:34,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13312.0, 300 sec: 13398.8). Total num frames: 187785216. Throughput: 0: 3341.8. Samples: 9444608. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:58:34,730][36114] Avg episode reward: [(0, '55.111')] [2023-02-25 13:58:34,893][36139] DAMAGECOUNT value on done: 644046.0 [2023-02-25 13:58:34,894][36139] Sum rewards: 53.431, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.319', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.155', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.270', 'weapon2': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.082', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.335', 'FRAGCOUNT': '45.000'} [2023-02-25 13:58:36,596][36138] Updated weights for policy 0, policy_version 45853 (0.0010) [2023-02-25 13:58:39,623][36138] Updated weights for policy 0, policy_version 45863 (0.0009) [2023-02-25 13:58:39,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 187854848. Throughput: 0: 3344.4. Samples: 9454672. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:58:39,729][36114] Avg episode reward: [(0, '55.152')] [2023-02-25 13:58:42,671][36138] Updated weights for policy 0, policy_version 45873 (0.0009) [2023-02-25 13:58:43,199][36154] DAMAGECOUNT value on done: 647552.0 [2023-02-25 13:58:43,199][36154] Sum rewards: 39.170, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.630', 'weapon5': '0.002', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.011', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon4': '0.118', 'AMMO3': '0.274', 'weapon2': '0.474', 'WEAPON3': '1.700', 'HITCOUNT': '2.580', 'weapon3': '3.194', 'DAMAGECOUNT': '12.039', 'FRAGCOUNT': '38.000'} [2023-02-25 13:58:43,418][36141] DAMAGECOUNT value on done: 653467.0 [2023-02-25 13:58:43,418][36141] Sum rewards: 48.075, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.722', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.140', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon2': '0.264', 'weapon4': '0.284', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.900', 'weapon3': '3.036', 'DAMAGECOUNT': '13.866', 'FRAGCOUNT': '43.000'} [2023-02-25 13:58:43,500][36154] DAMAGECOUNT value on done: 635877.0 [2023-02-25 13:58:43,501][36154] Sum rewards: 51.117, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.539', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon5': '0.048', 'AMMO3': '0.182', 'AMMO4': '0.218', 'WEAPON5': '0.250', 'weapon4': '0.384', 'weapon2': '0.440', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.860', 'weapon3': '2.938', 'DAMAGECOUNT': '13.323', 'FRAGCOUNT': '46.500'} [2023-02-25 13:58:43,685][36141] DAMAGECOUNT value on done: 641705.0 [2023-02-25 13:58:43,686][36141] Sum rewards: 68.226, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.734', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.096', 'weapon4': '0.100', 'AMMO4': '0.152', 'weapon2': '0.188', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.388', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.213', 'FRAGCOUNT': '58.000'} [2023-02-25 13:58:43,743][36141] DAMAGECOUNT value on done: 646613.0 [2023-02-25 13:58:43,743][36141] Sum rewards: 48.272, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.034', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.040', 'AMMO3': '0.180', 'AMMO4': '0.200', 'weapon5': '0.222', 'weapon2': '0.250', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.644', 'WEAPON3': '1.050', 'weapon3': '2.620', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '14.271', 'FRAGCOUNT': '42.000'} [2023-02-25 13:58:43,761][36154] DAMAGECOUNT value on done: 645512.0 [2023-02-25 13:58:43,762][36154] Sum rewards: 48.934, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.662', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.053', 'AMMO3': '0.205', 'AMMO4': '0.264', 'weapon5': '0.268', 'weapon2': '0.366', 'weapon4': '0.416', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.620', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.887', 'FRAGCOUNT': '45.000'} [2023-02-25 13:58:43,990][36141] DAMAGECOUNT value on done: 636907.0 [2023-02-25 13:58:43,991][36141] Sum rewards: 67.247, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.220', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.186', 'AMMO3': '0.232', 'weapon2': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.402', 'WEAPON3': '1.450', 'weapon3': '2.944', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '59.000'} [2023-02-25 13:58:44,060][36154] DAMAGECOUNT value on done: 647781.0 [2023-02-25 13:58:44,061][36154] Sum rewards: 52.723, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.770', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.046', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'AMMO3': '0.262', 'weapon4': '0.284', 'WEAPON4': '0.350', 'weapon2': '0.410', 'WEAPON3': '1.550', 'weapon3': '2.962', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '48.000'} [2023-02-25 13:58:44,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 187920384. Throughput: 0: 3348.4. Samples: 9474808. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 13:58:44,730][36114] Avg episode reward: [(0, '55.287')] [2023-02-25 13:58:44,930][36157] DAMAGECOUNT value on done: 655587.0 [2023-02-25 13:58:44,930][36157] Sum rewards: 59.810, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.614', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.172', 'AMMO3': '0.208', 'weapon4': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.626', 'WEAPON3': '1.200', 'weapon3': '2.716', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.474', 'FRAGCOUNT': '52.000'} [2023-02-25 13:58:45,243][36157] DAMAGECOUNT value on done: 646438.0 [2023-02-25 13:58:45,244][36157] Sum rewards: 57.995, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.875', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.036', 'AMMO4': '0.098', 'weapon5': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.236', 'AMMO3': '0.249', 'WEAPON3': '1.500', 'HITCOUNT': '3.200', 'weapon3': '3.360', 'DAMAGECOUNT': '15.468', 'FRAGCOUNT': '51.000'} [2023-02-25 13:58:45,726][36138] Updated weights for policy 0, policy_version 45883 (0.0009) [2023-02-25 13:58:45,930][36157] DAMAGECOUNT value on done: 654329.0 [2023-02-25 13:58:45,931][36157] Sum rewards: 53.177, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.264', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon5': '0.134', 'AMMO4': '0.145', 'AMMO3': '0.181', 'WEAPON5': '0.350', 'weapon2': '0.384', 'WEAPON4': '0.400', 'weapon4': '0.440', 'WEAPON3': '1.150', 'weapon3': '2.752', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.514', 'FRAGCOUNT': '46.000'} [2023-02-25 13:58:46,236][36140] DAMAGECOUNT value on done: 654898.0 [2023-02-25 13:58:46,237][36140] Sum rewards: 55.752, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.370', 'AMMO5': '0.015', 'AMMO2': '0.025', 'weapon5': '0.086', 'AMMO4': '0.122', 'AMMO3': '0.210', 'weapon2': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.322', 'WEAPON3': '1.450', 'HITCOUNT': '3.060', 'weapon3': '3.138', 'DAMAGECOUNT': '15.930', 'FRAGCOUNT': '49.000'} [2023-02-25 13:58:46,241][36157] DAMAGECOUNT value on done: 648672.0 [2023-02-25 13:58:46,242][36157] Sum rewards: 61.069, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.586', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.058', 'weapon5': '0.158', 'AMMO3': '0.223', 'AMMO4': '0.292', 'weapon2': '0.318', 'WEAPON5': '0.450', 'weapon4': '0.524', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.728', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '54.500'} [2023-02-25 13:58:46,542][36140] DAMAGECOUNT value on done: 634474.0 [2023-02-25 13:58:46,543][36140] Sum rewards: 57.463, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.612', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.018', 'weapon5': '0.076', 'AMMO4': '0.088', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.230', 'AMMO3': '0.284', 'weapon4': '0.572', 'WEAPON3': '1.650', 'weapon3': '2.800', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.252', 'FRAGCOUNT': '54.000'} [2023-02-25 13:58:46,852][36140] DAMAGECOUNT value on done: 643938.0 [2023-02-25 13:58:46,853][36140] Sum rewards: 63.137, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.272', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.042', 'AMMO3': '0.160', 'weapon5': '0.162', 'AMMO4': '0.211', 'weapon4': '0.248', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.598', 'WEAPON3': '0.950', 'weapon3': '2.756', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.937', 'FRAGCOUNT': '53.000'} [2023-02-25 13:58:47,171][36140] DAMAGECOUNT value on done: 644752.0 [2023-02-25 13:58:47,171][36140] Sum rewards: 57.915, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.030', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon5': '0.174', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.396', 'weapon2': '0.644', 'WEAPON3': '1.100', 'weapon3': '2.582', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.979', 'FRAGCOUNT': '48.000'} [2023-02-25 13:58:47,991][36142] DAMAGECOUNT value on done: 653768.0 [2023-02-25 13:58:47,992][36142] Sum rewards: 66.254, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.590', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.058', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon2': '0.238', 'AMMO3': '0.261', 'WEAPON3': '1.550', 'HITCOUNT': '3.370', 'weapon3': '3.438', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '58.000'} [2023-02-25 13:58:48,063][36142] DAMAGECOUNT value on done: 636742.0 [2023-02-25 13:58:48,064][36142] Sum rewards: 65.869, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.846', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.160', 'AMMO4': '0.191', 'AMMO3': '0.242', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON4': '0.450', 'weapon4': '0.644', 'WEAPON3': '1.400', 'weapon3': '2.570', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '17.499', 'FRAGCOUNT': '59.000'} [2023-02-25 13:58:48,178][36140] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 13:58:48,310][36142] DAMAGECOUNT value on done: 636841.0 [2023-02-25 13:58:48,311][36142] Sum rewards: 48.279, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.600', 'AMMO5': '0.006', 'weapon4': '0.014', 'AMMO2': '0.023', 'weapon5': '0.060', 'WEAPON4': '0.100', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.474', 'WEAPON3': '1.200', 'HITCOUNT': '2.750', 'weapon3': '3.254', 'DAMAGECOUNT': '13.032', 'FRAGCOUNT': '42.000'} [2023-02-25 13:58:48,376][36142] DAMAGECOUNT value on done: 650657.0 [2023-02-25 13:58:48,377][36142] Sum rewards: 67.256, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.866', 'AMMO5': '0.007', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon4': '0.172', 'AMMO3': '0.215', 'weapon5': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.200', 'weapon3': '2.956', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '57.000'} [2023-02-25 13:58:48,791][36138] Updated weights for policy 0, policy_version 45893 (0.0009) [2023-02-25 13:58:48,871][36156] DAMAGECOUNT value on done: 652828.0 [2023-02-25 13:58:48,872][36156] Sum rewards: 54.219, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.926', 'AMMO5': '0.013', 'AMMO2': '0.050', 'AMMO3': '0.136', 'AMMO4': '0.252', 'weapon5': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.496', 'weapon2': '0.784', 'WEAPON3': '0.900', 'weapon3': '2.112', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.815', 'FRAGCOUNT': '45.000'} [2023-02-25 13:58:49,022][36156] DAMAGECOUNT value on done: 658805.0 [2023-02-25 13:58:49,022][36156] Sum rewards: 64.560, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.880', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.033', 'AMMO4': '0.163', 'AMMO3': '0.185', 'weapon2': '0.192', 'weapon5': '0.196', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.646', 'WEAPON3': '1.200', 'weapon3': '2.602', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '55.000'} [2023-02-25 13:58:49,188][36156] DAMAGECOUNT value on done: 640833.0 [2023-02-25 13:58:49,188][36156] Sum rewards: 55.820, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.504', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.168', 'AMMO3': '0.195', 'AMMO4': '0.206', 'WEAPON5': '0.300', 'weapon2': '0.430', 'WEAPON4': '0.450', 'weapon4': '0.562', 'WEAPON3': '1.200', 'weapon3': '2.522', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.290', 'FRAGCOUNT': '48.000'} [2023-02-25 13:58:49,334][36156] DAMAGECOUNT value on done: 645940.0 [2023-02-25 13:58:49,335][36156] Sum rewards: 59.846, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.992', 'AMMO5': '0.016', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.174', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.538', 'weapon2': '0.618', 'WEAPON3': '1.200', 'weapon3': '2.422', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.777', 'FRAGCOUNT': '52.000'} [2023-02-25 13:58:49,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 187990016. Throughput: 0: 3355.5. Samples: 9494986. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:58:49,730][36114] Avg episode reward: [(0, '55.999')] [2023-02-25 13:58:51,823][36138] Updated weights for policy 0, policy_version 45903 (0.0009) [2023-02-25 13:58:52,012][36155] DAMAGECOUNT value on done: 636825.0 [2023-02-25 13:58:52,012][36155] Sum rewards: 58.728, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.096', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.152', 'AMMO4': '0.173', 'AMMO3': '0.215', 'weapon5': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.400', 'weapon3': '2.934', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.783', 'FRAGCOUNT': '52.500'} [2023-02-25 13:58:52,314][36155] DAMAGECOUNT value on done: 657597.0 [2023-02-25 13:58:52,315][36155] Sum rewards: 51.468, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.345', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.064', 'AMMO3': '0.186', 'AMMO4': '0.187', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.424', 'weapon2': '0.682', 'WEAPON3': '1.200', 'weapon3': '2.564', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.343', 'FRAGCOUNT': '47.000'} [2023-02-25 13:58:52,922][36155] DAMAGECOUNT value on done: 652542.0 [2023-02-25 13:58:52,923][36155] Sum rewards: 53.006, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.626', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO3': '0.101', 'AMMO4': '0.174', 'weapon5': '0.312', 'weapon4': '0.372', 'weapon2': '0.436', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon3': '2.610', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '13.686', 'FRAGCOUNT': '44.000'} [2023-02-25 13:58:53,227][36155] DAMAGECOUNT value on done: 644438.0 [2023-02-25 13:58:53,228][36155] Sum rewards: 59.666, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.152', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO3': '0.178', 'AMMO4': '0.206', 'weapon5': '0.240', 'WEAPON5': '0.300', 'weapon2': '0.392', 'WEAPON4': '0.400', 'weapon4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.614', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.679', 'FRAGCOUNT': '52.000'} [2023-02-25 13:58:54,073][36139] DAMAGECOUNT value on done: 651630.0 [2023-02-25 13:58:54,073][36139] Sum rewards: 68.067, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.150', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'weapon4': '0.056', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.283', 'weapon2': '0.370', 'WEAPON3': '1.650', 'weapon3': '3.186', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '60.000'} [2023-02-25 13:58:54,375][36139] DAMAGECOUNT value on done: 642246.0 [2023-02-25 13:58:54,376][36139] Sum rewards: 65.734, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.650', 'AMMO5': '0.009', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.098', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.332', 'weapon4': '0.366', 'WEAPON3': '1.400', 'weapon3': '3.012', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '56.000'} [2023-02-25 13:58:54,670][36139] DAMAGECOUNT value on done: 654589.0 [2023-02-25 13:58:54,670][36139] Sum rewards: 51.083, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.080', 'AMMO5': '0.021', 'AMMO2': '0.035', 'AMMO4': '0.177', 'AMMO3': '0.203', 'weapon5': '0.214', 'weapon2': '0.326', 'WEAPON4': '0.400', 'weapon4': '0.402', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.690', 'weapon3': '2.784', 'DAMAGECOUNT': '14.610', 'FRAGCOUNT': '47.000'} [2023-02-25 13:58:54,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.2, 300 sec: 13412.7). Total num frames: 188055552. Throughput: 0: 3359.6. Samples: 9505088. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:58:54,730][36114] Avg episode reward: [(0, '56.158')] [2023-02-25 13:58:54,843][36138] Updated weights for policy 0, policy_version 45913 (0.0009) [2023-02-25 13:58:54,989][36139] DAMAGECOUNT value on done: 649013.0 [2023-02-25 13:58:54,990][36139] Sum rewards: 56.318, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.228', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon5': '0.152', 'AMMO3': '0.184', 'WEAPON5': '0.250', 'weapon4': '0.292', 'WEAPON4': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.100', 'weapon3': '2.970', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.901', 'FRAGCOUNT': '48.000'} [2023-02-25 13:58:57,870][36138] Updated weights for policy 0, policy_version 45923 (0.0009) [2023-02-25 13:58:59,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 188125184. Throughput: 0: 3361.2. Samples: 9525372. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:58:59,730][36114] Avg episode reward: [(0, '56.285')] [2023-02-25 13:58:59,733][36125] Saving new best policy, reward=56.285! [2023-02-25 13:59:00,865][36138] Updated weights for policy 0, policy_version 45933 (0.0009) [2023-02-25 13:59:02,226][36154] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 13:59:03,189][36154] DAMAGECOUNT value on done: 651733.0 [2023-02-25 13:59:03,189][36154] Sum rewards: 45.117, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.800', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.050', 'weapon4': '0.060', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.248', 'weapon2': '0.492', 'WEAPON3': '1.600', 'HITCOUNT': '2.660', 'weapon3': '3.218', 'DAMAGECOUNT': '12.543', 'FRAGCOUNT': '42.000'} [2023-02-25 13:59:03,369][36141] DAMAGECOUNT value on done: 658796.0 [2023-02-25 13:59:03,369][36141] Sum rewards: 65.965, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.501', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.050', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.184', 'WEAPON5': '0.200', 'weapon5': '0.228', 'AMMO3': '0.261', 'WEAPON3': '1.550', 'weapon3': '3.306', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '58.500'} [2023-02-25 13:59:03,501][36154] DAMAGECOUNT value on done: 641677.0 [2023-02-25 13:59:03,501][36154] Sum rewards: 68.340, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.850', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.096', 'WEAPON5': '0.100', 'weapon2': '0.168', 'AMMO4': '0.171', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'weapon4': '0.332', 'WEAPON3': '1.400', 'weapon3': '3.026', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.400', 'FRAGCOUNT': '60.000'} [2023-02-25 13:59:03,667][36141] DAMAGECOUNT value on done: 645888.0 [2023-02-25 13:59:03,668][36141] Sum rewards: 42.458, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.970', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.082', 'AMMO4': '0.195', 'weapon4': '0.200', 'AMMO3': '0.274', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'ARMOR': '0.456', 'weapon2': '0.756', 'WEAPON3': '1.600', 'weapon3': '2.622', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '12.549', 'FRAGCOUNT': '42.000'} [2023-02-25 13:59:03,698][36141] DAMAGECOUNT value on done: 651170.0 [2023-02-25 13:59:03,698][36141] Sum rewards: 47.889, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.605', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO2': '0.024', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'weapon4': '0.192', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon2': '0.592', 'WEAPON3': '1.300', 'HITCOUNT': '2.980', 'weapon3': '3.018', 'DAMAGECOUNT': '13.671', 'FRAGCOUNT': '42.000'} [2023-02-25 13:59:03,771][36154] DAMAGECOUNT value on done: 650802.0 [2023-02-25 13:59:03,772][36154] Sum rewards: 61.368, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.412', 'AMMO5': '0.013', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon5': '0.168', 'weapon4': '0.190', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.506', 'WEAPON3': '1.250', 'weapon3': '2.848', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.870', 'FRAGCOUNT': '53.000'} [2023-02-25 13:59:03,959][36138] Updated weights for policy 0, policy_version 45943 (0.0009) [2023-02-25 13:59:03,989][36141] DAMAGECOUNT value on done: 642317.0 [2023-02-25 13:59:03,989][36141] Sum rewards: 61.521, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.260', 'AMMO5': '0.007', 'AMMO2': '0.030', 'AMMO4': '0.150', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'weapon5': '0.228', 'weapon2': '0.422', 'WEAPON4': '0.450', 'weapon4': '0.554', 'WEAPON3': '0.900', 'weapon3': '2.544', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '53.000'} [2023-02-25 13:59:04,076][36154] DAMAGECOUNT value on done: 653590.0 [2023-02-25 13:59:04,076][36154] Sum rewards: 67.070, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.424', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.088', 'weapon5': '0.144', 'AMMO3': '0.214', 'weapon2': '0.232', 'AMMO4': '0.249', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.278', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '59.500'} [2023-02-25 13:59:04,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 188190720. Throughput: 0: 3358.6. Samples: 9545524. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:59:04,730][36114] Avg episode reward: [(0, '56.418')] [2023-02-25 13:59:04,730][36125] Saving new best policy, reward=56.418! [2023-02-25 13:59:04,889][36157] DAMAGECOUNT value on done: 660294.0 [2023-02-25 13:59:04,890][36157] Sum rewards: 52.753, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.025', 'AMMO5': '0.017', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.204', 'weapon5': '0.234', 'weapon2': '0.270', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.532', 'WEAPON3': '1.200', 'weapon3': '2.584', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.121', 'FRAGCOUNT': '46.000'} [2023-02-25 13:59:05,206][36157] DAMAGECOUNT value on done: 651735.0 [2023-02-25 13:59:05,206][36157] Sum rewards: 61.013, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.878', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.080', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon2': '0.222', 'WEAPON4': '0.250', 'weapon4': '0.426', 'WEAPON3': '1.200', 'weapon3': '2.994', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.891', 'FRAGCOUNT': '53.500'} [2023-02-25 13:59:05,870][36157] DAMAGECOUNT value on done: 659238.0 [2023-02-25 13:59:05,870][36157] Sum rewards: 54.156, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.748', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.041', 'AMMO3': '0.136', 'weapon5': '0.140', 'AMMO4': '0.203', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.764', 'weapon2': '0.822', 'WEAPON3': '0.850', 'weapon3': '1.982', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.682', 'FRAGCOUNT': '45.000'} [2023-02-25 13:59:06,182][36157] DAMAGECOUNT value on done: 653706.0 [2023-02-25 13:59:06,182][36157] Sum rewards: 63.998, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.630', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.015', 'weapon4': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'AMMO3': '0.213', 'weapon2': '0.326', 'WEAPON3': '1.300', 'HITCOUNT': '3.200', 'weapon3': '3.408', 'DAMAGECOUNT': '15.102', 'FRAGCOUNT': '56.000'} [2023-02-25 13:59:06,271][36140] DAMAGECOUNT value on done: 660333.0 [2023-02-25 13:59:06,271][36140] Sum rewards: 68.200, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.275', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.032', 'AMMO3': '0.160', 'AMMO4': '0.160', 'weapon5': '0.190', 'weapon2': '0.256', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.606', 'WEAPON3': '1.000', 'weapon3': '2.692', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '57.000'} [2023-02-25 13:59:06,578][36140] DAMAGECOUNT value on done: 639699.0 [2023-02-25 13:59:06,578][36140] Sum rewards: 57.816, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.952', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.045', 'AMMO3': '0.138', 'AMMO4': '0.227', 'weapon2': '0.354', 'weapon5': '0.360', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '0.850', 'weapon4': '1.022', 'weapon3': '1.932', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.612', 'FRAGCOUNT': '47.000'} [2023-02-25 13:59:06,862][36140] DAMAGECOUNT value on done: 647915.0 [2023-02-25 13:59:06,863][36140] Sum rewards: 37.228, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.240', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.050', 'AMMO3': '0.161', 'AMMO4': '0.199', 'weapon2': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon4': '0.546', 'WEAPON3': '1.000', 'HITCOUNT': '2.490', 'weapon3': '3.034', 'DAMAGECOUNT': '11.472', 'FRAGCOUNT': '33.000'} [2023-02-25 13:59:07,029][36138] Updated weights for policy 0, policy_version 45953 (0.0009) [2023-02-25 13:59:07,186][36140] DAMAGECOUNT value on done: 649377.0 [2023-02-25 13:59:07,187][36140] Sum rewards: 50.024, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.345', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.041', 'AMMO3': '0.147', 'AMMO4': '0.203', 'weapon5': '0.228', 'weapon4': '0.294', 'WEAPON4': '0.450', 'weapon2': '0.486', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'weapon3': '2.726', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '13.875', 'FRAGCOUNT': '43.000'} [2023-02-25 13:59:07,991][36142] DAMAGECOUNT value on done: 657286.0 [2023-02-25 13:59:07,991][36142] Sum rewards: 36.208, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.751', 'AMMO5': '0.017', 'AMMO2': '0.084', 'AMMO3': '0.144', 'weapon5': '0.168', 'AMMO4': '0.421', 'WEAPON5': '0.450', 'ARMOR': '0.488', 'weapon2': '0.694', 'WEAPON3': '0.900', 'WEAPON4': '0.950', 'weapon4': '1.162', 'weapon3': '1.706', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '10.554', 'FRAGCOUNT': '37.000'} [2023-02-25 13:59:08,065][36142] DAMAGECOUNT value on done: 641780.0 [2023-02-25 13:59:08,066][36142] Sum rewards: 56.166, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.712', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.020', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.150', 'weapon2': '0.188', 'AMMO3': '0.273', 'WEAPON5': '0.300', 'weapon4': '0.458', 'WEAPON3': '1.650', 'weapon3': '2.846', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.114', 'FRAGCOUNT': '51.000'} [2023-02-25 13:59:08,320][36142] DAMAGECOUNT value on done: 641711.0 [2023-02-25 13:59:08,320][36142] Sum rewards: 55.997, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.463', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.058', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'weapon4': '0.260', 'weapon2': '0.354', 'WEAPON3': '1.050', 'HITCOUNT': '3.050', 'weapon3': '3.114', 'DAMAGECOUNT': '14.610', 'FRAGCOUNT': '47.000'} [2023-02-25 13:59:08,386][36142] DAMAGECOUNT value on done: 654692.0 [2023-02-25 13:59:08,386][36142] Sum rewards: 42.026, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.082', 'AMMO5': '0.009', 'AMMO2': '0.015', 'weapon4': '0.016', 'WEAPON4': '0.050', 'weapon5': '0.062', 'AMMO4': '0.074', 'WEAPON5': '0.200', 'AMMO3': '0.273', 'weapon2': '0.338', 'WEAPON3': '1.600', 'HITCOUNT': '2.540', 'weapon3': '3.326', 'DAMAGECOUNT': '12.105', 'FRAGCOUNT': '40.000'} [2023-02-25 13:59:08,955][36156] DAMAGECOUNT value on done: 657137.0 [2023-02-25 13:59:08,955][36156] Sum rewards: 45.684, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.609', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon5': '0.144', 'AMMO3': '0.219', 'AMMO4': '0.247', 'weapon2': '0.288', 'weapon4': '0.342', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.670', 'weapon3': '2.990', 'DAMAGECOUNT': '12.927', 'FRAGCOUNT': '42.000'} [2023-02-25 13:59:09,142][36156] DAMAGECOUNT value on done: 663932.0 [2023-02-25 13:59:09,142][36156] Sum rewards: 58.895, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.272', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.108', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'weapon4': '0.282', 'weapon2': '0.428', 'WEAPON3': '1.050', 'weapon3': '2.904', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.381', 'FRAGCOUNT': '48.000'} [2023-02-25 13:59:09,280][36156] DAMAGECOUNT value on done: 645788.0 [2023-02-25 13:59:09,280][36156] Sum rewards: 60.609, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.418', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon4': '0.144', 'AMMO3': '0.172', 'weapon5': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.000', 'HITCOUNT': '2.890', 'weapon3': '3.074', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '50.500'} [2023-02-25 13:59:09,459][36156] DAMAGECOUNT value on done: 650263.0 [2023-02-25 13:59:09,459][36156] Sum rewards: 51.518, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.776', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.134', 'AMMO4': '0.163', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'weapon2': '0.328', 'WEAPON4': '0.350', 'weapon4': '0.582', 'WEAPON3': '1.300', 'weapon3': '2.698', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.969', 'FRAGCOUNT': '46.500'} [2023-02-25 13:59:09,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 188256256. Throughput: 0: 3355.2. Samples: 9555478. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:59:09,730][36114] Avg episode reward: [(0, '56.240')] [2023-02-25 13:59:10,038][36138] Updated weights for policy 0, policy_version 45963 (0.0009) [2023-02-25 13:59:11,836][36155] DAMAGECOUNT value on done: 641682.0 [2023-02-25 13:59:11,836][36155] Sum rewards: 53.215, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.405', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon5': '0.084', 'weapon4': '0.086', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.316', 'WEAPON3': '1.400', 'HITCOUNT': '3.110', 'weapon3': '3.294', 'DAMAGECOUNT': '14.571', 'FRAGCOUNT': '47.000'} [2023-02-25 13:59:12,151][36155] DAMAGECOUNT value on done: 662981.0 [2023-02-25 13:59:12,152][36155] Sum rewards: 62.004, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.728', 'AMMO5': '0.014', 'AMMO2': '0.016', 'AMMO4': '0.077', 'AMMO3': '0.227', 'weapon5': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.304', 'weapon4': '0.394', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.748', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '53.500'} [2023-02-25 13:59:12,763][36155] DAMAGECOUNT value on done: 658073.0 [2023-02-25 13:59:12,764][36155] Sum rewards: 56.478, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-4.900', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.042', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'weapon4': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.284', 'AMMO3': '0.312', 'WEAPON3': '1.950', 'weapon3': '3.180', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.593', 'FRAGCOUNT': '55.000'} [2023-02-25 13:59:13,065][36155] DAMAGECOUNT value on done: 649029.0 [2023-02-25 13:59:13,066][36155] Sum rewards: 54.265, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.014', 'AMMO5': '0.011', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon4': '0.154', 'AMMO3': '0.163', 'WEAPON4': '0.250', 'weapon5': '0.264', 'WEAPON5': '0.300', 'weapon2': '0.472', 'WEAPON3': '1.000', 'weapon3': '2.876', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.773', 'FRAGCOUNT': '45.000'} [2023-02-25 13:59:13,151][36138] Updated weights for policy 0, policy_version 45973 (0.0009) [2023-02-25 13:59:13,836][36139] DAMAGECOUNT value on done: 657287.0 [2023-02-25 13:59:13,837][36139] Sum rewards: 69.422, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.380', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.102', 'AMMO3': '0.172', 'weapon5': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.308', 'WEAPON5': '0.350', 'weapon4': '0.410', 'WEAPON3': '1.050', 'weapon3': '2.892', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '56.000'} [2023-02-25 13:59:14,149][36139] DAMAGECOUNT value on done: 647259.0 [2023-02-25 13:59:14,150][36139] Sum rewards: 55.507, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.660', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.243', 'weapon2': '0.638', 'WEAPON3': '1.400', 'weapon3': '3.152', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.039', 'FRAGCOUNT': '47.000'} [2023-02-25 13:59:14,439][36139] DAMAGECOUNT value on done: 658824.0 [2023-02-25 13:59:14,440][36139] Sum rewards: 46.065, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.700', 'AMMO5': '0.021', 'AMMO2': '0.045', 'AMMO3': '0.194', 'AMMO4': '0.223', 'weapon2': '0.232', 'weapon5': '0.240', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon4': '0.614', 'WEAPON3': '1.150', 'weapon3': '2.500', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.705', 'FRAGCOUNT': '42.000'} [2023-02-25 13:59:14,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 188325888. Throughput: 0: 3357.7. Samples: 9575620. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:59:14,729][36114] Avg episode reward: [(0, '56.657')] [2023-02-25 13:59:14,730][36125] Saving new best policy, reward=56.657! [2023-02-25 13:59:14,762][36139] DAMAGECOUNT value on done: 653867.0 [2023-02-25 13:59:14,762][36139] Sum rewards: 57.997, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.670', 'AMMO5': '0.011', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.138', 'weapon5': '0.144', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.450', 'weapon4': '0.648', 'WEAPON3': '0.900', 'weapon3': '2.574', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.508', 'FRAGCOUNT': '47.000'} [2023-02-25 13:59:16,228][36138] Updated weights for policy 0, policy_version 45983 (0.0009) [2023-02-25 13:59:18,282][36142] Large shaping reward 2.551 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.519, 173.0), ('weapon5', 0.002)] [2023-02-25 13:59:19,270][36138] Updated weights for policy 0, policy_version 45993 (0.0009) [2023-02-25 13:59:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 188391424. Throughput: 0: 3356.0. Samples: 9595626. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:59:19,729][36114] Avg episode reward: [(0, '56.737')] [2023-02-25 13:59:19,734][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000045994_188391424.pth... [2023-02-25 13:59:19,792][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000045209_185176064.pth [2023-02-25 13:59:19,797][36125] Saving new best policy, reward=56.737! [2023-02-25 13:59:22,341][36138] Updated weights for policy 0, policy_version 46003 (0.0009) [2023-02-25 13:59:22,885][36154] Large shaping reward 2.504 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.483, 161.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 13:59:23,301][36154] DAMAGECOUNT value on done: 655969.0 [2023-02-25 13:59:23,302][36154] Sum rewards: 45.674, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.790', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.142', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon4': '0.330', 'weapon2': '0.824', 'WEAPON3': '1.200', 'weapon3': '2.500', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.708', 'FRAGCOUNT': '41.000'} [2023-02-25 13:59:23,568][36141] DAMAGECOUNT value on done: 663390.0 [2023-02-25 13:59:23,569][36141] Sum rewards: 58.368, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.002', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.206', 'weapon4': '0.324', 'WEAPON3': '1.150', 'HITCOUNT': '3.190', 'weapon3': '3.218', 'DAMAGECOUNT': '13.782', 'FRAGCOUNT': '49.000'} [2023-02-25 13:59:23,596][36154] DAMAGECOUNT value on done: 646574.0 [2023-02-25 13:59:23,597][36154] Sum rewards: 53.356, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.400', 'AMMO5': '0.017', 'AMMO2': '0.027', 'AMMO4': '0.132', 'weapon2': '0.162', 'weapon5': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.253', 'WEAPON5': '0.300', 'weapon4': '0.432', 'WEAPON3': '1.500', 'weapon3': '2.880', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.691', 'FRAGCOUNT': '47.500'} [2023-02-25 13:59:23,836][36154] DAMAGECOUNT value on done: 655377.0 [2023-02-25 13:59:23,837][36154] Sum rewards: 49.970, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.940', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon5': '0.136', 'AMMO3': '0.190', 'AMMO4': '0.201', 'weapon4': '0.226', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.434', 'WEAPON3': '1.150', 'weapon3': '2.924', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.725', 'FRAGCOUNT': '44.000'} [2023-02-25 13:59:23,839][36141] DAMAGECOUNT value on done: 650856.0 [2023-02-25 13:59:23,840][36141] Sum rewards: 52.765, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.280', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.096', 'AMMO4': '0.141', 'weapon5': '0.172', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.540', 'WEAPON3': '1.250', 'HITCOUNT': '2.750', 'weapon3': '2.966', 'DAMAGECOUNT': '14.877', 'FRAGCOUNT': '45.500'} [2023-02-25 13:59:23,873][36141] DAMAGECOUNT value on done: 656664.0 [2023-02-25 13:59:23,874][36141] Sum rewards: 62.998, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.580', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.156', 'AMMO4': '0.193', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'weapon2': '0.320', 'weapon4': '0.370', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.812', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.482', 'FRAGCOUNT': '56.000'} [2023-02-25 13:59:24,148][36154] DAMAGECOUNT value on done: 657415.0 [2023-02-25 13:59:24,148][36154] Sum rewards: 41.636, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.102', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.049', 'AMMO3': '0.133', 'weapon5': '0.162', 'AMMO4': '0.246', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.516', 'WEAPON3': '0.700', 'weapon4': '0.790', 'weapon3': '2.020', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '11.475', 'FRAGCOUNT': '35.000'} [2023-02-25 13:59:24,151][36141] DAMAGECOUNT value on done: 647381.0 [2023-02-25 13:59:24,152][36141] Sum rewards: 66.110, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.670', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'weapon5': '0.050', 'WEAPON5': '0.100', 'weapon4': '0.136', 'weapon2': '0.170', 'AMMO3': '0.184', 'WEAPON3': '1.150', 'HITCOUNT': '3.230', 'weapon3': '3.480', 'DAMAGECOUNT': '15.192', 'FRAGCOUNT': '55.000'} [2023-02-25 13:59:24,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 188456960. Throughput: 0: 3354.1. Samples: 9605606. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:59:24,730][36114] Avg episode reward: [(0, '56.408')] [2023-02-25 13:59:25,051][36157] DAMAGECOUNT value on done: 664610.0 [2023-02-25 13:59:25,051][36157] Sum rewards: 44.272, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.058', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon2': '0.176', 'AMMO3': '0.228', 'AMMO4': '0.247', 'weapon5': '0.280', 'ARMOR': '0.412', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.828', 'WEAPON3': '1.400', 'weapon3': '2.414', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '12.948', 'FRAGCOUNT': '39.000'} [2023-02-25 13:59:25,361][36157] DAMAGECOUNT value on done: 656637.0 [2023-02-25 13:59:25,362][36157] Sum rewards: 52.189, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.292', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO3': '0.203', 'AMMO4': '0.215', 'weapon5': '0.258', 'weapon2': '0.262', 'weapon4': '0.322', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.806', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.706', 'FRAGCOUNT': '47.000'} [2023-02-25 13:59:25,456][36138] Updated weights for policy 0, policy_version 46013 (0.0009) [2023-02-25 13:59:26,040][36157] DAMAGECOUNT value on done: 663115.0 [2023-02-25 13:59:26,041][36157] Sum rewards: 40.148, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.420', 'AMMO5': '0.008', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon5': '0.172', 'AMMO3': '0.202', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.486', 'weapon4': '0.528', 'WEAPON3': '1.250', 'weapon3': '2.592', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '11.631', 'FRAGCOUNT': '36.500'} [2023-02-25 13:59:26,366][36157] DAMAGECOUNT value on done: 658031.0 [2023-02-25 13:59:26,367][36157] Sum rewards: 47.555, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.375', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.102', 'weapon5': '0.106', 'AMMO3': '0.149', 'WEAPON5': '0.200', 'weapon2': '0.218', 'WEAPON4': '0.350', 'weapon4': '0.612', 'WEAPON3': '1.000', 'HITCOUNT': '2.750', 'weapon3': '2.818', 'DAMAGECOUNT': '12.597', 'FRAGCOUNT': '41.000'} [2023-02-25 13:59:26,431][36140] DAMAGECOUNT value on done: 664259.0 [2023-02-25 13:59:26,431][36140] Sum rewards: 44.633, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.696', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.104', 'AMMO4': '0.115', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.304', 'weapon4': '0.514', 'WEAPON3': '1.300', 'HITCOUNT': '2.700', 'weapon3': '2.810', 'DAMAGECOUNT': '11.778', 'FRAGCOUNT': '41.000'} [2023-02-25 13:59:26,763][36140] DAMAGECOUNT value on done: 645077.0 [2023-02-25 13:59:26,764][36140] Sum rewards: 62.840, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.224', 'ARMOR': '0.012', 'AMMO5': '0.022', 'AMMO2': '0.048', 'weapon5': '0.094', 'AMMO3': '0.168', 'AMMO4': '0.238', 'weapon2': '0.350', 'weapon4': '0.412', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.856', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '53.000'} [2023-02-25 13:59:27,003][36140] DAMAGECOUNT value on done: 653254.0 [2023-02-25 13:59:27,003][36140] Sum rewards: 65.841, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.084', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.131', 'weapon2': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon4': '0.208', 'WEAPON3': '1.300', 'HITCOUNT': '3.200', 'weapon3': '3.252', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '57.000'} [2023-02-25 13:59:27,303][36140] DAMAGECOUNT value on done: 654377.0 [2023-02-25 13:59:27,304][36140] Sum rewards: 51.656, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.903', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.034', 'AMMO4': '0.171', 'AMMO3': '0.206', 'weapon2': '0.272', 'weapon5': '0.272', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.502', 'WEAPON3': '1.300', 'weapon3': '2.660', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '46.000'} [2023-02-25 13:59:28,160][36142] DAMAGECOUNT value on done: 662784.0 [2023-02-25 13:59:28,161][36142] Sum rewards: 66.220, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.630', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.094', 'AMMO3': '0.149', 'WEAPON5': '0.200', 'AMMO4': '0.205', 'weapon4': '0.222', 'WEAPON4': '0.350', 'weapon2': '0.508', 'WEAPON3': '1.050', 'weapon3': '2.942', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '56.000'} [2023-02-25 13:59:28,236][36142] DAMAGECOUNT value on done: 646723.0 [2023-02-25 13:59:28,237][36142] Sum rewards: 54.252, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.490', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.037', 'weapon5': '0.046', 'weapon4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.516', 'WEAPON3': '1.300', 'HITCOUNT': '3.110', 'weapon3': '3.130', 'DAMAGECOUNT': '14.829', 'FRAGCOUNT': '45.000'} [2023-02-25 13:59:28,503][36138] Updated weights for policy 0, policy_version 46023 (0.0010) [2023-02-25 13:59:28,503][36142] DAMAGECOUNT value on done: 647225.0 [2023-02-25 13:59:28,504][36142] Sum rewards: 63.084, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.720', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.104', 'AMMO4': '0.170', 'AMMO3': '0.197', 'weapon4': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.142', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.542', 'FRAGCOUNT': '54.000'} [2023-02-25 13:59:28,571][36142] DAMAGECOUNT value on done: 659293.0 [2023-02-25 13:59:28,572][36142] Sum rewards: 47.913, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.972', 'AMMO5': '0.011', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon4': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'weapon5': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.398', 'WEAPON3': '1.100', 'weapon3': '3.006', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.803', 'FRAGCOUNT': '38.500'} [2023-02-25 13:59:29,160][36156] DAMAGECOUNT value on done: 661628.0 [2023-02-25 13:59:29,160][36156] Sum rewards: 55.254, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.680', 'weapon7': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.182', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon2': '0.286', 'WEAPON4': '0.300', 'weapon4': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.770', 'weapon3': '3.014', 'DAMAGECOUNT': '13.473', 'FRAGCOUNT': '48.000'} [2023-02-25 13:59:29,326][36156] DAMAGECOUNT value on done: 668608.0 [2023-02-25 13:59:29,326][36156] Sum rewards: 56.149, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.064', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.171', 'weapon5': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon2': '0.494', 'weapon4': '0.878', 'WEAPON3': '1.050', 'weapon3': '2.158', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '47.500'} [2023-02-25 13:59:29,486][36156] DAMAGECOUNT value on done: 650778.0 [2023-02-25 13:59:29,486][36156] Sum rewards: 56.756, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.134', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon5': '0.162', 'AMMO3': '0.188', 'AMMO4': '0.230', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.464', 'weapon2': '0.466', 'WEAPON3': '1.100', 'weapon3': '2.510', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.970', 'FRAGCOUNT': '49.500'} [2023-02-25 13:59:29,659][36156] DAMAGECOUNT value on done: 655022.0 [2023-02-25 13:59:29,660][36156] Sum rewards: 57.741, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.340', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.056', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.240', 'weapon2': '0.262', 'weapon4': '0.556', 'WEAPON3': '1.350', 'weapon3': '2.890', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.277', 'FRAGCOUNT': '51.000'} [2023-02-25 13:59:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 188526592. Throughput: 0: 3351.4. Samples: 9625622. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:59:29,730][36114] Avg episode reward: [(0, '55.340')] [2023-02-25 13:59:31,563][36138] Updated weights for policy 0, policy_version 46033 (0.0010) [2023-02-25 13:59:31,971][36155] DAMAGECOUNT value on done: 647523.0 [2023-02-25 13:59:31,971][36155] Sum rewards: 58.420, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.890', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.170', 'AMMO4': '0.209', 'AMMO3': '0.238', 'weapon4': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.466', 'WEAPON3': '1.400', 'weapon3': '2.654', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '51.000'} [2023-02-25 13:59:32,281][36155] DAMAGECOUNT value on done: 668266.0 [2023-02-25 13:59:32,282][36155] Sum rewards: 60.342, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.502', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.030', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.252', 'weapon4': '0.280', 'weapon2': '0.306', 'WEAPON3': '1.500', 'weapon3': '3.110', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '52.000'} [2023-02-25 13:59:32,876][36155] DAMAGECOUNT value on done: 663577.0 [2023-02-25 13:59:32,877][36155] Sum rewards: 60.292, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.618', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.068', 'weapon4': '0.112', 'AMMO4': '0.175', 'weapon2': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.270', 'WEAPON3': '1.600', 'HITCOUNT': '3.320', 'weapon3': '3.338', 'DAMAGECOUNT': '16.506', 'FRAGCOUNT': '54.000'} [2023-02-25 13:59:33,178][36155] DAMAGECOUNT value on done: 653599.0 [2023-02-25 13:59:33,178][36155] Sum rewards: 49.356, reward structure: {'DEATHCOUNT': '-15.000', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.040', 'HEALTH': '0.108', 'AMMO4': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon5': '0.250', 'weapon2': '0.292', 'weapon4': '0.580', 'WEAPON3': '1.200', 'weapon3': '2.470', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.710', 'FRAGCOUNT': '42.000'} [2023-02-25 13:59:33,996][36139] DAMAGECOUNT value on done: 662614.0 [2023-02-25 13:59:33,996][36139] Sum rewards: 59.319, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.638', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.048', 'AMMO3': '0.188', 'AMMO4': '0.238', 'weapon5': '0.250', 'weapon2': '0.332', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.590', 'WEAPON3': '1.100', 'weapon3': '2.518', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.981', 'FRAGCOUNT': '49.000'} [2023-02-25 13:59:34,307][36139] DAMAGECOUNT value on done: 652164.0 [2023-02-25 13:59:34,308][36139] Sum rewards: 54.104, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.548', 'AMMO5': '0.018', 'AMMO2': '0.047', 'weapon5': '0.164', 'AMMO3': '0.199', 'AMMO4': '0.233', 'weapon2': '0.342', 'WEAPON5': '0.400', 'ARMOR': '0.460', 'WEAPON4': '0.600', 'weapon4': '0.760', 'WEAPON3': '1.150', 'weapon3': '2.424', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '14.715', 'FRAGCOUNT': '48.000'} [2023-02-25 13:59:34,597][36139] DAMAGECOUNT value on done: 663449.0 [2023-02-25 13:59:34,597][36139] Sum rewards: 51.498, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.412', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.050', 'AMMO3': '0.123', 'AMMO4': '0.249', 'weapon2': '0.274', 'weapon5': '0.286', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '0.800', 'weapon4': '0.980', 'weapon3': '2.134', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.875', 'FRAGCOUNT': '44.000'} [2023-02-25 13:59:34,642][36138] Updated weights for policy 0, policy_version 46043 (0.0009) [2023-02-25 13:59:34,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13412.7). Total num frames: 188592128. Throughput: 0: 3350.4. Samples: 9645754. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:59:34,730][36114] Avg episode reward: [(0, '55.667')] [2023-02-25 13:59:34,920][36139] DAMAGECOUNT value on done: 659204.0 [2023-02-25 13:59:34,920][36139] Sum rewards: 53.807, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.410', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon5': '0.182', 'AMMO3': '0.234', 'AMMO4': '0.238', 'weapon2': '0.312', 'weapon4': '0.438', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.678', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '16.011', 'FRAGCOUNT': '48.000'} [2023-02-25 13:59:37,610][36138] Updated weights for policy 0, policy_version 46053 (0.0010) [2023-02-25 13:59:39,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 188661760. Throughput: 0: 3351.5. Samples: 9655904. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 13:59:39,729][36114] Avg episode reward: [(0, '55.614')] [2023-02-25 13:59:40,606][36138] Updated weights for policy 0, policy_version 46063 (0.0009) [2023-02-25 13:59:41,272][36141] Large shaping reward 2.532 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.51, 170.0), ('weapon5', 0.002)] [2023-02-25 13:59:43,323][36154] DAMAGECOUNT value on done: 660892.0 [2023-02-25 13:59:43,323][36154] Sum rewards: 60.647, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.409', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.118', 'AMMO3': '0.173', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.528', 'weapon2': '0.596', 'WEAPON3': '1.100', 'weapon3': '2.526', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '14.769', 'FRAGCOUNT': '51.000'} [2023-02-25 13:59:43,630][36154] DAMAGECOUNT value on done: 651092.0 [2023-02-25 13:59:43,630][36154] Sum rewards: 47.659, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.110', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO3': '0.139', 'AMMO4': '0.193', 'weapon5': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.446', 'weapon4': '0.820', 'WEAPON3': '0.900', 'weapon3': '2.220', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.554', 'FRAGCOUNT': '39.500'} [2023-02-25 13:59:43,652][36141] DAMAGECOUNT value on done: 667401.0 [2023-02-25 13:59:43,652][36141] Sum rewards: 46.819, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.378', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO3': '0.146', 'AMMO4': '0.170', 'weapon5': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.380', 'weapon4': '0.408', 'WEAPON3': '0.900', 'HITCOUNT': '2.320', 'weapon3': '2.784', 'DAMAGECOUNT': '12.033', 'FRAGCOUNT': '39.500'} [2023-02-25 13:59:43,697][36138] Updated weights for policy 0, policy_version 46073 (0.0010) [2023-02-25 13:59:43,895][36154] DAMAGECOUNT value on done: 660596.0 [2023-02-25 13:59:43,896][36154] Sum rewards: 61.169, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.210', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.032', 'weapon5': '0.134', 'AMMO4': '0.161', 'AMMO3': '0.262', 'weapon4': '0.288', 'weapon2': '0.334', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.926', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.657', 'FRAGCOUNT': '57.000'} [2023-02-25 13:59:43,898][36141] DAMAGECOUNT value on done: 656071.0 [2023-02-25 13:59:43,899][36141] Sum rewards: 60.976, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.872', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.054', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.241', 'weapon4': '0.278', 'weapon2': '0.446', 'WEAPON3': '1.500', 'weapon3': '2.958', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '54.000'} [2023-02-25 13:59:43,953][36141] DAMAGECOUNT value on done: 661471.0 [2023-02-25 13:59:43,954][36141] Sum rewards: 54.874, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.250', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.044', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'weapon2': '0.190', 'WEAPON4': '0.250', 'AMMO3': '0.263', 'weapon4': '0.434', 'WEAPON3': '1.550', 'weapon3': '3.090', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.421', 'FRAGCOUNT': '50.000'} [2023-02-25 13:59:44,206][36141] DAMAGECOUNT value on done: 651938.0 [2023-02-25 13:59:44,206][36141] Sum rewards: 48.052, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.170', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.172', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.326', 'weapon4': '0.560', 'WEAPON3': '1.150', 'weapon3': '2.652', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.671', 'FRAGCOUNT': '42.000'} [2023-02-25 13:59:44,209][36154] DAMAGECOUNT value on done: 662612.0 [2023-02-25 13:59:44,209][36154] Sum rewards: 55.141, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.648', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'AMMO2': '0.047', 'weapon4': '0.210', 'weapon5': '0.222', 'AMMO4': '0.234', 'AMMO3': '0.281', 'weapon2': '0.292', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.650', 'weapon3': '2.914', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.591', 'FRAGCOUNT': '51.000'} [2023-02-25 13:59:44,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 188727296. Throughput: 0: 3352.6. Samples: 9676240. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:59:44,730][36114] Avg episode reward: [(0, '55.765')] [2023-02-25 13:59:45,012][36157] DAMAGECOUNT value on done: 669531.0 [2023-02-25 13:59:45,013][36157] Sum rewards: 52.165, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.798', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.038', 'weapon4': '0.088', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.260', 'weapon2': '0.286', 'WEAPON3': '1.500', 'HITCOUNT': '3.070', 'weapon3': '3.336', 'DAMAGECOUNT': '14.463', 'FRAGCOUNT': '47.500'} [2023-02-25 13:59:45,325][36157] DAMAGECOUNT value on done: 661281.0 [2023-02-25 13:59:45,326][36157] Sum rewards: 55.079, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.600', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.114', 'weapon5': '0.132', 'AMMO4': '0.143', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.200', 'HITCOUNT': '2.810', 'weapon3': '3.248', 'DAMAGECOUNT': '13.932', 'FRAGCOUNT': '47.500'} [2023-02-25 13:59:45,993][36157] DAMAGECOUNT value on done: 667514.0 [2023-02-25 13:59:45,994][36157] Sum rewards: 51.319, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.952', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon5': '0.098', 'weapon2': '0.240', 'AMMO3': '0.245', 'AMMO4': '0.263', 'WEAPON5': '0.350', 'ARMOR': '0.450', 'WEAPON4': '0.650', 'weapon4': '0.842', 'WEAPON3': '1.400', 'weapon3': '2.536', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.197', 'FRAGCOUNT': '49.000'} [2023-02-25 13:59:46,308][36157] DAMAGECOUNT value on done: 662081.0 [2023-02-25 13:59:46,309][36157] Sum rewards: 50.791, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.532', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon5': '0.064', 'AMMO4': '0.142', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.326', 'weapon4': '0.396', 'WEAPON3': '1.200', 'HITCOUNT': '2.800', 'weapon3': '3.056', 'DAMAGECOUNT': '12.150', 'FRAGCOUNT': '45.000'} [2023-02-25 13:59:46,314][36140] DAMAGECOUNT value on done: 668937.0 [2023-02-25 13:59:46,314][36140] Sum rewards: 48.058, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.490', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon5': '0.054', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'AMMO4': '0.249', 'weapon2': '0.310', 'WEAPON4': '0.450', 'weapon4': '0.578', 'WEAPON3': '1.200', 'weapon3': '2.788', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.034', 'FRAGCOUNT': '42.000'} [2023-02-25 13:59:46,630][36140] DAMAGECOUNT value on done: 650139.0 [2023-02-25 13:59:46,630][36140] Sum rewards: 64.225, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.045', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'weapon4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.188', 'weapon2': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.060', 'weapon3': '3.404', 'DAMAGECOUNT': '15.186', 'FRAGCOUNT': '56.000'} [2023-02-25 13:59:46,749][36138] Updated weights for policy 0, policy_version 46083 (0.0009) [2023-02-25 13:59:46,866][36140] DAMAGECOUNT value on done: 658190.0 [2023-02-25 13:59:46,867][36140] Sum rewards: 59.053, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.188', 'AMMO5': '0.005', 'AMMO2': '0.014', 'ARMOR': '0.036', 'weapon4': '0.038', 'weapon5': '0.056', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.213', 'weapon2': '0.514', 'WEAPON3': '1.250', 'weapon3': '3.208', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.808', 'FRAGCOUNT': '50.000'} [2023-02-25 13:59:47,178][36140] DAMAGECOUNT value on done: 659604.0 [2023-02-25 13:59:47,178][36140] Sum rewards: 63.113, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.291', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'weapon5': '0.062', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'weapon2': '0.310', 'weapon4': '0.396', 'WEAPON3': '1.100', 'weapon3': '2.948', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.681', 'FRAGCOUNT': '52.000'} [2023-02-25 13:59:48,074][36154] Large shaping reward 3.605 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5730000000000001, 191.0), ('weapon5', 0.002)] [2023-02-25 13:59:48,097][36142] DAMAGECOUNT value on done: 668061.0 [2023-02-25 13:59:48,098][36142] Sum rewards: 58.548, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.438', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.040', 'WEAPON5': '0.050', 'weapon4': '0.050', 'AMMO4': '0.058', 'WEAPON4': '0.150', 'AMMO3': '0.204', 'weapon2': '0.444', 'WEAPON3': '1.250', 'weapon3': '3.304', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.831', 'FRAGCOUNT': '49.500'} [2023-02-25 13:59:48,162][36142] DAMAGECOUNT value on done: 651667.0 [2023-02-25 13:59:48,163][36142] Sum rewards: 58.075, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.825', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.038', 'AMMO4': '0.191', 'AMMO3': '0.204', 'weapon5': '0.214', 'weapon4': '0.230', 'WEAPON4': '0.300', 'weapon2': '0.324', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '2.948', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.832', 'FRAGCOUNT': '51.000'} [2023-02-25 13:59:48,408][36142] DAMAGECOUNT value on done: 652161.0 [2023-02-25 13:59:48,409][36142] Sum rewards: 56.025, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.168', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon5': '0.130', 'AMMO3': '0.189', 'AMMO4': '0.216', 'weapon2': '0.226', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon4': '1.288', 'weapon3': '1.952', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '14.808', 'FRAGCOUNT': '48.000'} [2023-02-25 13:59:48,475][36142] DAMAGECOUNT value on done: 663950.0 [2023-02-25 13:59:48,476][36142] Sum rewards: 58.218, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.230', 'ARMOR': '0.004', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.177', 'weapon5': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.224', 'weapon2': '0.526', 'WEAPON3': '1.050', 'weapon3': '2.850', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.971', 'FRAGCOUNT': '49.000'} [2023-02-25 13:59:49,181][36156] DAMAGECOUNT value on done: 665024.0 [2023-02-25 13:59:49,182][36156] Sum rewards: 37.966, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.747', 'ARMOR': '0.012', 'AMMO5': '0.021', 'AMMO2': '0.033', 'AMMO3': '0.138', 'AMMO4': '0.167', 'weapon5': '0.256', 'weapon2': '0.428', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'weapon4': '1.464', 'weapon3': '1.576', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '10.188', 'FRAGCOUNT': '31.500'} [2023-02-25 13:59:49,302][36156] DAMAGECOUNT value on done: 673600.0 [2023-02-25 13:59:49,303][36156] Sum rewards: 52.901, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.410', 'AMMO5': '0.006', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.108', 'WEAPON5': '0.150', 'weapon2': '0.204', 'WEAPON4': '0.250', 'AMMO3': '0.279', 'weapon4': '0.368', 'WEAPON3': '1.550', 'weapon3': '3.070', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.826', 'FRAGCOUNT': '48.500'} [2023-02-25 13:59:49,490][36156] DAMAGECOUNT value on done: 655610.0 [2023-02-25 13:59:49,491][36156] Sum rewards: 54.159, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.778', 'AMMO5': '0.021', 'AMMO2': '0.042', 'weapon5': '0.188', 'AMMO4': '0.208', 'AMMO3': '0.256', 'weapon4': '0.266', 'weapon2': '0.368', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.822', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '14.136', 'FRAGCOUNT': '53.000'} [2023-02-25 13:59:49,618][36156] DAMAGECOUNT value on done: 660234.0 [2023-02-25 13:59:49,619][36156] Sum rewards: 55.519, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.334', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'weapon5': '0.124', 'weapon2': '0.158', 'WEAPON4': '0.250', 'weapon4': '0.264', 'AMMO3': '0.267', 'WEAPON3': '1.550', 'HITCOUNT': '3.180', 'weapon3': '3.186', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '51.000'} [2023-02-25 13:59:49,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.2, 300 sec: 13412.7). Total num frames: 188792832. Throughput: 0: 3353.5. Samples: 9696432. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:59:49,730][36114] Avg episode reward: [(0, '55.206')] [2023-02-25 13:59:49,770][36138] Updated weights for policy 0, policy_version 46093 (0.0009) [2023-02-25 13:59:51,766][36155] DAMAGECOUNT value on done: 652457.0 [2023-02-25 13:59:51,766][36155] Sum rewards: 53.930, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.315', 'AMMO5': '0.014', 'AMMO2': '0.050', 'AMMO3': '0.146', 'weapon5': '0.210', 'AMMO4': '0.252', 'WEAPON5': '0.350', 'weapon4': '0.406', 'weapon2': '0.516', 'WEAPON4': '0.550', 'WEAPON3': '0.950', 'weapon3': '2.550', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '14.250', 'FRAGCOUNT': '46.000'} [2023-02-25 13:59:52,078][36155] DAMAGECOUNT value on done: 672504.0 [2023-02-25 13:59:52,078][36155] Sum rewards: 48.730, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.180', 'AMMO5': '0.011', 'AMMO2': '0.020', 'weapon5': '0.068', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'weapon4': '0.374', 'weapon2': '0.766', 'WEAPON3': '0.900', 'HITCOUNT': '2.610', 'weapon3': '2.640', 'DAMAGECOUNT': '12.714', 'FRAGCOUNT': '39.000'} [2023-02-25 13:59:52,678][36155] DAMAGECOUNT value on done: 668830.0 [2023-02-25 13:59:52,679][36155] Sum rewards: 60.499, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.136', 'AMMO5': '0.017', 'AMMO2': '0.035', 'AMMO4': '0.175', 'AMMO3': '0.199', 'weapon5': '0.226', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.376', 'weapon2': '0.402', 'WEAPON3': '1.250', 'weapon3': '2.696', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '52.000'} [2023-02-25 13:59:52,765][36138] Updated weights for policy 0, policy_version 46103 (0.0010) [2023-02-25 13:59:52,988][36155] DAMAGECOUNT value on done: 659053.0 [2023-02-25 13:59:52,989][36155] Sum rewards: 59.140, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.956', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.122', 'weapon2': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.094', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.362', 'FRAGCOUNT': '50.500'} [2023-02-25 13:59:53,621][36139] DAMAGECOUNT value on done: 666204.0 [2023-02-25 13:59:53,622][36139] Sum rewards: 40.173, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.305', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon4': '0.058', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'weapon2': '0.150', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'weapon5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '2.120', 'weapon3': '3.044', 'DAMAGECOUNT': '10.770', 'FRAGCOUNT': '36.000'} [2023-02-25 13:59:53,935][36139] DAMAGECOUNT value on done: 656957.0 [2023-02-25 13:59:53,936][36139] Sum rewards: 54.336, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.370', 'AMMO5': '0.003', 'AMMO2': '0.043', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'AMMO4': '0.216', 'weapon2': '0.266', 'WEAPON4': '0.450', 'weapon4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.882', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.379', 'FRAGCOUNT': '50.000'} [2023-02-25 13:59:54,239][36139] DAMAGECOUNT value on done: 667599.0 [2023-02-25 13:59:54,240][36139] Sum rewards: 49.745, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.650', 'AMMO5': '0.022', 'AMMO2': '0.041', 'weapon4': '0.102', 'AMMO3': '0.152', 'AMMO4': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon5': '0.404', 'weapon2': '0.646', 'WEAPON3': '0.900', 'weapon3': '2.634', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '12.450', 'FRAGCOUNT': '41.500'} [2023-02-25 13:59:54,555][36139] DAMAGECOUNT value on done: 663713.0 [2023-02-25 13:59:54,555][36139] Sum rewards: 47.628, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.640', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.096', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.200', 'AMMO3': '0.245', 'weapon4': '0.490', 'WEAPON3': '1.500', 'HITCOUNT': '2.740', 'weapon3': '2.980', 'DAMAGECOUNT': '13.527', 'FRAGCOUNT': '43.000'} [2023-02-25 13:59:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 188862464. Throughput: 0: 3359.8. Samples: 9706670. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:59:54,730][36114] Avg episode reward: [(0, '54.774')] [2023-02-25 13:59:55,810][36138] Updated weights for policy 0, policy_version 46113 (0.0009) [2023-02-25 13:59:58,864][36138] Updated weights for policy 0, policy_version 46123 (0.0010) [2023-02-25 13:59:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 188928000. Throughput: 0: 3360.0. Samples: 9726822. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 13:59:59,730][36114] Avg episode reward: [(0, '54.774')] [2023-02-25 14:00:01,949][36138] Updated weights for policy 0, policy_version 46133 (0.0009) [2023-02-25 14:00:03,319][36154] DAMAGECOUNT value on done: 664850.0 [2023-02-25 14:00:03,320][36154] Sum rewards: 42.196, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.612', 'ARMOR': '0.008', 'AMMO5': '0.027', 'AMMO2': '0.053', 'AMMO3': '0.151', 'AMMO4': '0.263', 'weapon5': '0.284', 'weapon2': '0.528', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.820', 'WEAPON3': '0.900', 'weapon3': '2.040', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '11.874', 'FRAGCOUNT': '36.000'} [2023-02-25 14:00:03,444][36141] DAMAGECOUNT value on done: 671816.0 [2023-02-25 14:00:03,444][36141] Sum rewards: 51.154, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.112', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO3': '0.148', 'AMMO4': '0.154', 'WEAPON4': '0.250', 'weapon5': '0.272', 'weapon4': '0.298', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.000', 'HITCOUNT': '2.850', 'weapon3': '2.854', 'DAMAGECOUNT': '13.245', 'FRAGCOUNT': '42.000'} [2023-02-25 14:00:03,628][36154] DAMAGECOUNT value on done: 655491.0 [2023-02-25 14:00:03,629][36154] Sum rewards: 50.935, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.633', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.034', 'weapon5': '0.070', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'weapon2': '0.278', 'WEAPON4': '0.300', 'weapon4': '0.318', 'WEAPON3': '1.450', 'HITCOUNT': '2.710', 'weapon3': '3.068', 'DAMAGECOUNT': '13.197', 'FRAGCOUNT': '47.000'} [2023-02-25 14:00:03,679][36141] DAMAGECOUNT value on done: 662046.0 [2023-02-25 14:00:03,680][36141] Sum rewards: 66.736, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.336', 'AMMO5': '0.020', 'AMMO2': '0.044', 'AMMO3': '0.198', 'AMMO4': '0.219', 'weapon5': '0.296', 'weapon2': '0.312', 'WEAPON4': '0.400', 'weapon4': '0.460', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.628', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '57.000'} [2023-02-25 14:00:03,772][36141] DAMAGECOUNT value on done: 665828.0 [2023-02-25 14:00:03,773][36141] Sum rewards: 50.729, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.737', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.149', 'weapon5': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.492', 'WEAPON3': '0.950', 'weapon4': '0.952', 'weapon3': '2.150', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.071', 'FRAGCOUNT': '42.000'} [2023-02-25 14:00:03,945][36154] DAMAGECOUNT value on done: 665144.0 [2023-02-25 14:00:03,946][36154] Sum rewards: 51.379, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.440', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon5': '0.126', 'AMMO3': '0.221', 'AMMO4': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.486', 'weapon4': '0.684', 'WEAPON3': '1.250', 'weapon3': '2.428', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.644', 'FRAGCOUNT': '45.000'} [2023-02-25 14:00:04,000][36141] DAMAGECOUNT value on done: 657779.0 [2023-02-25 14:00:04,001][36141] Sum rewards: 75.007, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO2': '0.015', 'HEALTH': '0.069', 'AMMO4': '0.077', 'weapon2': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.157', 'weapon4': '0.560', 'WEAPON3': '0.950', 'weapon3': '3.224', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '59.000'} [2023-02-25 14:00:04,245][36154] DAMAGECOUNT value on done: 667262.0 [2023-02-25 14:00:04,245][36154] Sum rewards: 51.901, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.164', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon5': '0.144', 'weapon4': '0.158', 'AMMO3': '0.207', 'AMMO4': '0.236', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.720', 'weapon3': '3.130', 'DAMAGECOUNT': '13.950', 'FRAGCOUNT': '46.000'} [2023-02-25 14:00:04,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13412.7). Total num frames: 188997632. Throughput: 0: 3366.0. Samples: 9747098. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:00:04,729][36114] Avg episode reward: [(0, '54.544')] [2023-02-25 14:00:04,958][36157] DAMAGECOUNT value on done: 673725.0 [2023-02-25 14:00:04,958][36157] Sum rewards: 45.812, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.050', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.160', 'weapon2': '0.170', 'AMMO4': '0.200', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.540', 'WEAPON3': '1.500', 'HITCOUNT': '2.580', 'weapon3': '2.928', 'DAMAGECOUNT': '12.282', 'FRAGCOUNT': '45.000'} [2023-02-25 14:00:04,993][36138] Updated weights for policy 0, policy_version 46143 (0.0010) [2023-02-25 14:00:05,274][36157] DAMAGECOUNT value on done: 665820.0 [2023-02-25 14:00:05,275][36157] Sum rewards: 49.460, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.382', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon5': '0.064', 'AMMO4': '0.139', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon4': '0.276', 'WEAPON4': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.870', 'weapon3': '3.074', 'DAMAGECOUNT': '13.617', 'FRAGCOUNT': '45.000'} [2023-02-25 14:00:05,944][36157] DAMAGECOUNT value on done: 671975.0 [2023-02-25 14:00:05,945][36157] Sum rewards: 50.018, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.662', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.118', 'AMMO3': '0.189', 'AMMO4': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon4': '0.548', 'weapon2': '0.654', 'WEAPON3': '1.100', 'weapon3': '2.394', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.383', 'FRAGCOUNT': '45.000'} [2023-02-25 14:00:06,228][36140] DAMAGECOUNT value on done: 673840.0 [2023-02-25 14:00:06,229][36140] Sum rewards: 58.086, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.212', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.156', 'AMMO4': '0.210', 'AMMO3': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.424', 'weapon4': '0.658', 'WEAPON3': '1.300', 'weapon3': '2.528', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.709', 'FRAGCOUNT': '51.000'} [2023-02-25 14:00:06,254][36157] DAMAGECOUNT value on done: 667265.0 [2023-02-25 14:00:06,255][36157] Sum rewards: 58.981, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.878', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.015', 'weapon4': '0.060', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.200', 'AMMO3': '0.244', 'WEAPON3': '1.450', 'HITCOUNT': '3.230', 'weapon3': '3.512', 'DAMAGECOUNT': '15.552', 'FRAGCOUNT': '52.000'} [2023-02-25 14:00:06,533][36140] DAMAGECOUNT value on done: 654891.0 [2023-02-25 14:00:06,533][36140] Sum rewards: 56.192, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.630', 'AMMO5': '0.015', 'AMMO2': '0.020', 'weapon5': '0.096', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'weapon4': '0.182', 'WEAPON5': '0.250', 'weapon2': '0.700', 'WEAPON3': '1.100', 'weapon3': '2.818', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.256', 'FRAGCOUNT': '46.000'} [2023-02-25 14:00:06,749][36140] DAMAGECOUNT value on done: 662647.0 [2023-02-25 14:00:06,749][36140] Sum rewards: 53.774, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.645', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.074', 'AMMO4': '0.102', 'weapon5': '0.118', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.258', 'weapon2': '0.278', 'WEAPON3': '1.600', 'HITCOUNT': '2.890', 'weapon3': '3.300', 'DAMAGECOUNT': '13.371', 'FRAGCOUNT': '50.000'} [2023-02-25 14:00:07,059][36140] DAMAGECOUNT value on done: 663913.0 [2023-02-25 14:00:07,060][36140] Sum rewards: 44.961, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.284', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.064', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'weapon4': '0.120', 'WEAPON4': '0.200', 'AMMO3': '0.317', 'weapon2': '0.336', 'WEAPON3': '1.950', 'HITCOUNT': '2.680', 'weapon3': '3.186', 'DAMAGECOUNT': '12.927', 'FRAGCOUNT': '46.000'} [2023-02-25 14:00:08,036][36138] Updated weights for policy 0, policy_version 46153 (0.0009) [2023-02-25 14:00:08,037][36142] DAMAGECOUNT value on done: 673001.0 [2023-02-25 14:00:08,038][36142] Sum rewards: 57.087, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.617', 'AMMO2': '0.008', 'AMMO5': '0.013', 'weapon5': '0.030', 'AMMO4': '0.037', 'weapon4': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon2': '0.302', 'WEAPON3': '1.250', 'HITCOUNT': '3.080', 'weapon3': '3.400', 'DAMAGECOUNT': '14.820', 'FRAGCOUNT': '48.000'} [2023-02-25 14:00:08,111][36142] DAMAGECOUNT value on done: 655793.0 [2023-02-25 14:00:08,111][36142] Sum rewards: 46.836, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.190', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.104', 'weapon2': '0.184', 'AMMO3': '0.186', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon4': '1.208', 'weapon3': '2.252', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.378', 'FRAGCOUNT': '40.000'} [2023-02-25 14:00:08,358][36142] DAMAGECOUNT value on done: 656889.0 [2023-02-25 14:00:08,359][36142] Sum rewards: 55.798, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.400', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.060', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'weapon2': '0.358', 'weapon4': '0.390', 'WEAPON3': '1.400', 'weapon3': '2.966', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.184', 'FRAGCOUNT': '51.000'} [2023-02-25 14:00:08,420][36142] DAMAGECOUNT value on done: 668901.0 [2023-02-25 14:00:08,421][36142] Sum rewards: 57.362, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.710', 'AMMO5': '0.013', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon4': '0.144', 'weapon5': '0.146', 'weapon2': '0.212', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.060', 'weapon3': '3.242', 'DAMAGECOUNT': '14.853', 'FRAGCOUNT': '50.000'} [2023-02-25 14:00:09,163][36156] DAMAGECOUNT value on done: 669974.0 [2023-02-25 14:00:09,164][36156] Sum rewards: 48.440, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.024', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.057', 'AMMO3': '0.231', 'AMMO4': '0.283', 'weapon2': '0.288', 'WEAPON5': '0.300', 'weapon5': '0.320', 'WEAPON4': '0.600', 'weapon4': '0.814', 'WEAPON3': '1.300', 'weapon3': '2.158', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.820', 'FRAGCOUNT': '46.500'} [2023-02-25 14:00:09,293][36156] DAMAGECOUNT value on done: 678295.0 [2023-02-25 14:00:09,294][36156] Sum rewards: 56.585, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.260', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon5': '0.116', 'AMMO4': '0.136', 'AMMO3': '0.159', 'WEAPON4': '0.250', 'weapon4': '0.282', 'WEAPON5': '0.350', 'weapon2': '0.784', 'WEAPON3': '1.150', 'weapon3': '2.602', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.085', 'FRAGCOUNT': '49.000'} [2023-02-25 14:00:09,462][36156] DAMAGECOUNT value on done: 660328.0 [2023-02-25 14:00:09,463][36156] Sum rewards: 55.089, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.421', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.177', 'AMMO3': '0.217', 'weapon2': '0.414', 'WEAPON4': '0.450', 'weapon4': '0.458', 'WEAPON3': '1.300', 'weapon3': '2.738', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.154', 'FRAGCOUNT': '50.000'} [2023-02-25 14:00:09,600][36156] DAMAGECOUNT value on done: 664184.0 [2023-02-25 14:00:09,600][36156] Sum rewards: 47.920, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.616', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.032', 'weapon4': '0.042', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.148', 'AMMO3': '0.179', 'weapon2': '0.460', 'WEAPON3': '1.150', 'HITCOUNT': '2.530', 'weapon3': '3.186', 'DAMAGECOUNT': '11.850', 'FRAGCOUNT': '41.000'} [2023-02-25 14:00:09,729][36114] Fps is (10 sec: 13517.0, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 189063168. Throughput: 0: 3368.8. Samples: 9757204. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:00:09,730][36114] Avg episode reward: [(0, '54.234')] [2023-02-25 14:00:11,071][36138] Updated weights for policy 0, policy_version 46163 (0.0009) [2023-02-25 14:00:11,761][36155] DAMAGECOUNT value on done: 656693.0 [2023-02-25 14:00:11,762][36155] Sum rewards: 50.357, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.414', 'AMMO5': '0.009', 'AMMO2': '0.018', 'weapon5': '0.076', 'AMMO4': '0.091', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'weapon2': '0.280', 'WEAPON4': '0.400', 'ARMOR': '0.456', 'weapon4': '0.758', 'WEAPON3': '1.150', 'weapon3': '2.654', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '12.708', 'FRAGCOUNT': '45.000'} [2023-02-25 14:00:12,065][36155] DAMAGECOUNT value on done: 677374.0 [2023-02-25 14:00:12,065][36155] Sum rewards: 39.252, reward structure: {'DEATHCOUNT': '-23.250', 'HEALTH': '-2.670', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon5': '0.264', 'AMMO4': '0.265', 'AMMO3': '0.281', 'weapon2': '0.402', 'weapon4': '0.426', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.494', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '14.601', 'FRAGCOUNT': '41.000'} [2023-02-25 14:00:12,669][36155] DAMAGECOUNT value on done: 673277.0 [2023-02-25 14:00:12,670][36155] Sum rewards: 53.011, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.634', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'weapon4': '0.166', 'weapon2': '0.174', 'AMMO3': '0.190', 'WEAPON3': '1.200', 'HITCOUNT': '2.750', 'weapon3': '3.358', 'DAMAGECOUNT': '13.341', 'FRAGCOUNT': '45.000'} [2023-02-25 14:00:12,982][36155] DAMAGECOUNT value on done: 663956.0 [2023-02-25 14:00:12,982][36155] Sum rewards: 50.150, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.104', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon2': '0.296', 'WEAPON4': '0.300', 'weapon4': '0.324', 'WEAPON3': '1.500', 'HITCOUNT': '2.870', 'weapon3': '3.004', 'DAMAGECOUNT': '14.709', 'FRAGCOUNT': '46.000'} [2023-02-25 14:00:13,570][36139] DAMAGECOUNT value on done: 671423.0 [2023-02-25 14:00:13,571][36139] Sum rewards: 64.499, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.430', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.104', 'weapon2': '0.134', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.522', 'WEAPON3': '1.200', 'weapon3': '3.080', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.657', 'FRAGCOUNT': '55.000'} [2023-02-25 14:00:13,882][36139] DAMAGECOUNT value on done: 661852.0 [2023-02-25 14:00:13,883][36139] Sum rewards: 58.380, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.059', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.036', 'weapon5': '0.152', 'AMMO3': '0.170', 'AMMO4': '0.178', 'weapon4': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.508', 'WEAPON3': '1.000', 'HITCOUNT': '2.700', 'weapon3': '2.826', 'DAMAGECOUNT': '14.685', 'FRAGCOUNT': '50.500'} [2023-02-25 14:00:14,140][36138] Updated weights for policy 0, policy_version 46173 (0.0009) [2023-02-25 14:00:14,196][36139] DAMAGECOUNT value on done: 672333.0 [2023-02-25 14:00:14,197][36139] Sum rewards: 55.693, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.818', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.074', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'WEAPON4': '0.350', 'weapon2': '0.470', 'weapon4': '0.684', 'WEAPON3': '1.100', 'weapon3': '2.536', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.202', 'FRAGCOUNT': '48.000'} [2023-02-25 14:00:14,501][36139] DAMAGECOUNT value on done: 668563.0 [2023-02-25 14:00:14,501][36139] Sum rewards: 52.631, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.710', 'AMMO5': '0.019', 'AMMO2': '0.038', 'weapon4': '0.146', 'weapon5': '0.186', 'AMMO4': '0.188', 'weapon2': '0.236', 'AMMO3': '0.261', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.078', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.550', 'FRAGCOUNT': '49.000'} [2023-02-25 14:00:14,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 189128704. Throughput: 0: 3371.6. Samples: 9777346. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:00:14,730][36114] Avg episode reward: [(0, '54.047')] [2023-02-25 14:00:17,141][36138] Updated weights for policy 0, policy_version 46183 (0.0010) [2023-02-25 14:00:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 189198336. Throughput: 0: 3372.9. Samples: 9797534. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:00:19,729][36114] Avg episode reward: [(0, '54.047')] [2023-02-25 14:00:20,195][36138] Updated weights for policy 0, policy_version 46193 (0.0009) [2023-02-25 14:00:23,245][36138] Updated weights for policy 0, policy_version 46203 (0.0009) [2023-02-25 14:00:23,299][36154] DAMAGECOUNT value on done: 670155.0 [2023-02-25 14:00:23,299][36154] Sum rewards: 59.116, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.670', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'weapon4': '0.260', 'weapon2': '0.326', 'WEAPON3': '1.050', 'weapon3': '3.268', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.915', 'FRAGCOUNT': '47.000'} [2023-02-25 14:00:23,309][36141] DAMAGECOUNT value on done: 676046.0 [2023-02-25 14:00:23,309][36141] Sum rewards: 45.034, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.320', 'ARMOR': '0.008', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.074', 'AMMO3': '0.153', 'weapon5': '0.168', 'weapon2': '0.266', 'AMMO4': '0.370', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.904', 'WEAPON3': '0.950', 'weapon3': '2.320', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.663', 'FRAGCOUNT': '39.000'} [2023-02-25 14:00:23,570][36141] DAMAGECOUNT value on done: 667310.0 [2023-02-25 14:00:23,571][36141] Sum rewards: 49.312, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.365', 'ARMOR': '0.012', 'AMMO5': '0.024', 'AMMO2': '0.064', 'AMMO3': '0.213', 'weapon5': '0.252', 'weapon2': '0.278', 'AMMO4': '0.319', 'weapon4': '0.450', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.672', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.792', 'FRAGCOUNT': '45.000'} [2023-02-25 14:00:23,615][36154] DAMAGECOUNT value on done: 659934.0 [2023-02-25 14:00:23,616][36154] Sum rewards: 51.335, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.270', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.106', 'weapon4': '0.160', 'AMMO4': '0.178', 'AMMO3': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.788', 'WEAPON3': '1.450', 'weapon3': '2.714', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '13.329', 'FRAGCOUNT': '48.000'} [2023-02-25 14:00:23,635][36141] DAMAGECOUNT value on done: 670151.0 [2023-02-25 14:00:23,636][36141] Sum rewards: 52.309, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.289', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.046', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.178', 'AMMO3': '0.197', 'weapon2': '0.432', 'WEAPON3': '1.250', 'HITCOUNT': '2.680', 'weapon3': '3.160', 'DAMAGECOUNT': '12.969', 'FRAGCOUNT': '46.000'} [2023-02-25 14:00:23,893][36141] DAMAGECOUNT value on done: 662368.0 [2023-02-25 14:00:23,893][36141] Sum rewards: 53.909, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.410', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO3': '0.142', 'AMMO4': '0.203', 'weapon5': '0.272', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.490', 'WEAPON3': '0.800', 'weapon4': '1.192', 'weapon3': '1.640', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '13.767', 'FRAGCOUNT': '44.000'} [2023-02-25 14:00:23,927][36154] DAMAGECOUNT value on done: 669200.0 [2023-02-25 14:00:23,927][36154] Sum rewards: 45.433, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.293', 'AMMO5': '0.015', 'AMMO2': '0.054', 'AMMO3': '0.156', 'AMMO4': '0.268', 'weapon5': '0.282', 'weapon2': '0.346', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '0.850', 'weapon4': '0.882', 'weapon3': '2.194', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '12.168', 'FRAGCOUNT': '41.000'} [2023-02-25 14:00:24,244][36154] DAMAGECOUNT value on done: 672117.0 [2023-02-25 14:00:24,244][36154] Sum rewards: 54.261, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.804', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.076', 'AMMO4': '0.148', 'weapon4': '0.186', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.546', 'WEAPON3': '1.400', 'weapon3': '2.946', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.565', 'FRAGCOUNT': '49.000'} [2023-02-25 14:00:24,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 189263872. Throughput: 0: 3370.9. Samples: 9807594. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:00:24,730][36114] Avg episode reward: [(0, '53.790')] [2023-02-25 14:00:24,947][36157] DAMAGECOUNT value on done: 678672.0 [2023-02-25 14:00:24,948][36157] Sum rewards: 54.787, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.406', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.176', 'AMMO4': '0.187', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.222', 'WEAPON4': '0.250', 'weapon4': '0.564', 'WEAPON3': '1.300', 'weapon3': '2.760', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.841', 'FRAGCOUNT': '46.000'} [2023-02-25 14:00:25,256][36157] DAMAGECOUNT value on done: 669717.0 [2023-02-25 14:00:25,256][36157] Sum rewards: 40.440, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.318', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.036', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'weapon5': '0.208', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'weapon2': '0.296', 'ARMOR': '0.404', 'weapon4': '0.690', 'WEAPON3': '1.350', 'weapon3': '2.496', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '11.691', 'FRAGCOUNT': '37.500'} [2023-02-25 14:00:25,897][36157] DAMAGECOUNT value on done: 676376.0 [2023-02-25 14:00:25,898][36157] Sum rewards: 45.903, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.550', 'ARMOR': '0.004', 'AMMO5': '0.009', 'weapon5': '0.028', 'AMMO2': '0.029', 'weapon4': '0.082', 'AMMO4': '0.145', 'weapon2': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.284', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '2.840', 'weapon3': '3.506', 'DAMAGECOUNT': '13.203', 'FRAGCOUNT': '45.000'} [2023-02-25 14:00:26,075][36140] DAMAGECOUNT value on done: 678402.0 [2023-02-25 14:00:26,075][36140] Sum rewards: 54.841, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.962', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.027', 'weapon5': '0.086', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'weapon2': '0.310', 'WEAPON3': '1.200', 'HITCOUNT': '2.860', 'weapon3': '3.480', 'DAMAGECOUNT': '13.686', 'FRAGCOUNT': '46.000'} [2023-02-25 14:00:26,208][36157] DAMAGECOUNT value on done: 672734.0 [2023-02-25 14:00:26,208][36157] Sum rewards: 67.591, reward structure: {'DEATHCOUNT': '-13.500', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.016', 'HEALTH': '0.030', 'weapon5': '0.056', 'weapon4': '0.072', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon2': '0.262', 'WEAPON3': '1.050', 'HITCOUNT': '3.240', 'weapon3': '3.396', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '56.000'} [2023-02-25 14:00:26,306][36138] Updated weights for policy 0, policy_version 46213 (0.0009) [2023-02-25 14:00:26,376][36140] DAMAGECOUNT value on done: 659811.0 [2023-02-25 14:00:26,378][36140] Sum rewards: 56.537, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.180', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.032', 'AMMO4': '0.083', 'weapon5': '0.088', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.478', 'WEAPON3': '1.350', 'HITCOUNT': '2.810', 'weapon3': '3.230', 'DAMAGECOUNT': '14.760', 'FRAGCOUNT': '49.000'} [2023-02-25 14:00:26,639][36140] DAMAGECOUNT value on done: 667468.0 [2023-02-25 14:00:26,639][36140] Sum rewards: 55.289, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.180', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.021', 'AMMO2': '0.053', 'AMMO3': '0.125', 'weapon5': '0.234', 'AMMO4': '0.266', 'weapon2': '0.452', 'WEAPON5': '0.550', 'WEAPON4': '0.700', 'WEAPON3': '0.850', 'weapon4': '0.980', 'weapon3': '2.050', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '14.463', 'FRAGCOUNT': '46.000'} [2023-02-25 14:00:26,940][36140] DAMAGECOUNT value on done: 668680.0 [2023-02-25 14:00:26,940][36140] Sum rewards: 50.565, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.319', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.142', 'weapon5': '0.180', 'weapon4': '0.218', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.422', 'WEAPON3': '1.350', 'HITCOUNT': '2.760', 'weapon3': '2.892', 'DAMAGECOUNT': '14.301', 'FRAGCOUNT': '44.000'} [2023-02-25 14:00:28,219][36142] DAMAGECOUNT value on done: 678379.0 [2023-02-25 14:00:28,220][36142] Sum rewards: 58.618, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.882', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon5': '0.120', 'AMMO4': '0.141', 'AMMO3': '0.201', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.470', 'weapon4': '0.692', 'WEAPON3': '1.250', 'weapon3': '2.306', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '51.000'} [2023-02-25 14:00:28,299][36142] DAMAGECOUNT value on done: 660553.0 [2023-02-25 14:00:28,300][36142] Sum rewards: 55.289, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.360', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.132', 'weapon5': '0.180', 'AMMO3': '0.194', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.448', 'weapon4': '0.526', 'WEAPON3': '1.150', 'weapon3': '2.562', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.280', 'FRAGCOUNT': '49.000'} [2023-02-25 14:00:28,541][36142] DAMAGECOUNT value on done: 661690.0 [2023-02-25 14:00:28,542][36142] Sum rewards: 59.019, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.700', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.058', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.233', 'weapon4': '0.438', 'weapon2': '0.448', 'WEAPON3': '1.350', 'weapon3': '2.848', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.403', 'FRAGCOUNT': '54.000'} [2023-02-25 14:00:28,622][36142] DAMAGECOUNT value on done: 674172.0 [2023-02-25 14:00:28,622][36142] Sum rewards: 58.367, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.244', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.128', 'weapon4': '0.178', 'AMMO3': '0.187', 'AMMO4': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.448', 'WEAPON3': '1.150', 'weapon3': '2.994', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.813', 'FRAGCOUNT': '49.000'} [2023-02-25 14:00:29,151][36156] DAMAGECOUNT value on done: 674952.0 [2023-02-25 14:00:29,151][36156] Sum rewards: 62.869, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.250', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.010', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.213', 'weapon4': '0.294', 'weapon2': '0.462', 'WEAPON3': '1.350', 'weapon3': '2.904', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '14.934', 'FRAGCOUNT': '54.000'} [2023-02-25 14:00:29,268][36156] DAMAGECOUNT value on done: 682960.0 [2023-02-25 14:00:29,268][36156] Sum rewards: 50.995, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.930', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.156', 'AMMO4': '0.171', 'AMMO3': '0.212', 'WEAPON5': '0.400', 'weapon4': '0.402', 'WEAPON4': '0.450', 'weapon2': '0.518', 'WEAPON3': '1.200', 'weapon3': '2.624', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.995', 'FRAGCOUNT': '47.000'} [2023-02-25 14:00:29,313][36138] Updated weights for policy 0, policy_version 46223 (0.0009) [2023-02-25 14:00:29,467][36156] DAMAGECOUNT value on done: 665448.0 [2023-02-25 14:00:29,468][36156] Sum rewards: 53.688, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.746', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.196', 'weapon5': '0.250', 'weapon2': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.376', 'WEAPON3': '1.100', 'weapon3': '2.768', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.360', 'FRAGCOUNT': '46.000'} [2023-02-25 14:00:29,599][36156] DAMAGECOUNT value on done: 668993.0 [2023-02-25 14:00:29,600][36156] Sum rewards: 58.875, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.091', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.182', 'AMMO3': '0.207', 'weapon2': '0.258', 'WEAPON3': '1.350', 'HITCOUNT': '2.910', 'weapon3': '3.348', 'DAMAGECOUNT': '14.427', 'FRAGCOUNT': '51.000'} [2023-02-25 14:00:29,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 189333504. Throughput: 0: 3368.0. Samples: 9827802. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:00:29,730][36114] Avg episode reward: [(0, '53.986')] [2023-02-25 14:00:31,667][36155] DAMAGECOUNT value on done: 661178.0 [2023-02-25 14:00:31,668][36155] Sum rewards: 48.953, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.746', 'AMMO5': '0.012', 'AMMO2': '0.044', 'AMMO3': '0.201', 'weapon5': '0.216', 'AMMO4': '0.220', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON4': '0.400', 'weapon4': '0.526', 'WEAPON3': '1.250', 'weapon3': '2.658', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.455', 'FRAGCOUNT': '44.000'} [2023-02-25 14:00:31,962][36155] DAMAGECOUNT value on done: 681896.0 [2023-02-25 14:00:31,963][36155] Sum rewards: 54.932, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.660', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.084', 'weapon4': '0.130', 'AMMO3': '0.219', 'weapon2': '0.600', 'WEAPON3': '1.350', 'HITCOUNT': '2.970', 'weapon3': '3.104', 'DAMAGECOUNT': '13.566', 'FRAGCOUNT': '48.000'} [2023-02-25 14:00:32,358][36138] Updated weights for policy 0, policy_version 46233 (0.0010) [2023-02-25 14:00:32,544][36155] DAMAGECOUNT value on done: 677344.0 [2023-02-25 14:00:32,545][36155] Sum rewards: 43.055, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.217', 'AMMO5': '0.017', 'AMMO2': '0.034', 'AMMO3': '0.161', 'AMMO4': '0.172', 'weapon5': '0.246', 'weapon2': '0.262', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'weapon4': '0.996', 'weapon3': '2.242', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.201', 'FRAGCOUNT': '37.000'} [2023-02-25 14:00:32,843][36155] DAMAGECOUNT value on done: 668896.0 [2023-02-25 14:00:32,844][36155] Sum rewards: 50.179, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.262', 'ARMOR': '0.016', 'AMMO5': '0.026', 'AMMO2': '0.076', 'AMMO3': '0.164', 'weapon5': '0.240', 'weapon2': '0.304', 'AMMO4': '0.379', 'weapon4': '0.498', 'WEAPON5': '0.650', 'WEAPON4': '0.800', 'WEAPON3': '1.000', 'weapon3': '2.558', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '14.820', 'FRAGCOUNT': '44.000'} [2023-02-25 14:00:33,561][36139] DAMAGECOUNT value on done: 676331.0 [2023-02-25 14:00:33,562][36139] Sum rewards: 54.601, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.040', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'AMMO3': '0.205', 'weapon2': '0.242', 'WEAPON4': '0.450', 'weapon4': '0.784', 'WEAPON3': '1.200', 'weapon3': '2.624', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.724', 'FRAGCOUNT': '47.000'} [2023-02-25 14:00:33,866][36139] DAMAGECOUNT value on done: 667183.0 [2023-02-25 14:00:33,867][36139] Sum rewards: 55.046, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.208', 'AMMO5': '0.018', 'AMMO2': '0.055', 'AMMO3': '0.160', 'weapon5': '0.228', 'AMMO4': '0.274', 'weapon2': '0.316', 'WEAPON5': '0.450', 'weapon4': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '0.950', 'weapon3': '2.660', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '48.000'} [2023-02-25 14:00:34,191][36139] DAMAGECOUNT value on done: 677547.0 [2023-02-25 14:00:34,191][36139] Sum rewards: 65.633, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.045', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.146', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.320', 'weapon4': '0.406', 'WEAPON3': '0.950', 'weapon3': '2.908', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '53.000'} [2023-02-25 14:00:34,503][36139] DAMAGECOUNT value on done: 673299.0 [2023-02-25 14:00:34,504][36139] Sum rewards: 49.193, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.940', 'AMMO5': '0.019', 'AMMO2': '0.051', 'weapon5': '0.118', 'AMMO3': '0.225', 'AMMO4': '0.254', 'weapon2': '0.256', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.946', 'WEAPON3': '1.350', 'weapon3': '2.346', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.208', 'FRAGCOUNT': '47.000'} [2023-02-25 14:00:34,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 189399040. Throughput: 0: 3369.3. Samples: 9848050. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:00:34,730][36114] Avg episode reward: [(0, '53.658')] [2023-02-25 14:00:35,396][36138] Updated weights for policy 0, policy_version 46243 (0.0009) [2023-02-25 14:00:36,083][36156] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:00:38,407][36138] Updated weights for policy 0, policy_version 46253 (0.0009) [2023-02-25 14:00:39,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 189468672. Throughput: 0: 3366.0. Samples: 9858138. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:00:39,730][36114] Avg episode reward: [(0, '53.658')] [2023-02-25 14:00:41,470][36138] Updated weights for policy 0, policy_version 46263 (0.0008) [2023-02-25 14:00:42,835][36139] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-25 14:00:43,343][36141] DAMAGECOUNT value on done: 680121.0 [2023-02-25 14:00:43,344][36141] Sum rewards: 38.348, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.752', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.063', 'AMMO3': '0.216', 'weapon5': '0.300', 'weapon2': '0.314', 'AMMO4': '0.316', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon4': '0.874', 'WEAPON3': '1.150', 'weapon3': '2.162', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '11.970', 'FRAGCOUNT': '37.000'} [2023-02-25 14:00:43,348][36154] DAMAGECOUNT value on done: 674525.0 [2023-02-25 14:00:43,348][36154] Sum rewards: 54.150, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.839', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.063', 'AMMO3': '0.179', 'AMMO4': '0.315', 'weapon5': '0.340', 'weapon2': '0.358', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'weapon4': '0.670', 'WEAPON3': '1.050', 'weapon3': '2.208', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '13.110', 'FRAGCOUNT': '49.000'} [2023-02-25 14:00:43,626][36141] DAMAGECOUNT value on done: 673123.0 [2023-02-25 14:00:43,627][36141] Sum rewards: 69.335, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.303', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.122', 'weapon2': '0.214', 'weapon4': '0.226', 'AMMO3': '0.252', 'WEAPON3': '1.500', 'weapon3': '3.184', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '59.000'} [2023-02-25 14:00:43,657][36154] DAMAGECOUNT value on done: 665711.0 [2023-02-25 14:00:43,658][36154] Sum rewards: 66.646, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.315', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.070', 'weapon5': '0.082', 'weapon2': '0.118', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.252', 'WEAPON3': '1.700', 'HITCOUNT': '3.400', 'weapon3': '3.552', 'DAMAGECOUNT': '17.331', 'FRAGCOUNT': '59.000'} [2023-02-25 14:00:43,664][36141] DAMAGECOUNT value on done: 675391.0 [2023-02-25 14:00:43,664][36141] Sum rewards: 60.063, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.781', 'AMMO2': '0.013', 'AMMO5': '0.015', 'AMMO4': '0.066', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon5': '0.284', 'weapon4': '0.342', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.350', 'weapon3': '2.710', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '53.000'} [2023-02-25 14:00:43,924][36154] DAMAGECOUNT value on done: 674405.0 [2023-02-25 14:00:43,924][36154] Sum rewards: 56.150, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.920', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon5': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.212', 'AMMO3': '0.251', 'weapon2': '0.364', 'WEAPON3': '1.500', 'weapon3': '3.098', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '50.000'} [2023-02-25 14:00:43,954][36141] DAMAGECOUNT value on done: 667389.0 [2023-02-25 14:00:43,954][36141] Sum rewards: 60.398, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.850', 'AMMO2': '0.017', 'AMMO4': '0.087', 'AMMO3': '0.267', 'weapon2': '0.518', 'WEAPON3': '1.500', 'HITCOUNT': '3.260', 'weapon3': '3.286', 'DAMAGECOUNT': '15.063', 'FRAGCOUNT': '53.000'} [2023-02-25 14:00:44,232][36154] DAMAGECOUNT value on done: 677613.0 [2023-02-25 14:00:44,233][36154] Sum rewards: 62.650, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.357', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.114', 'AMMO4': '0.142', 'WEAPON5': '0.250', 'AMMO3': '0.274', 'weapon4': '0.282', 'WEAPON4': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.650', 'weapon3': '2.862', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '57.000'} [2023-02-25 14:00:44,490][36138] Updated weights for policy 0, policy_version 46273 (0.0009) [2023-02-25 14:00:44,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 189534208. Throughput: 0: 3364.3. Samples: 9878214. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:00:44,729][36114] Avg episode reward: [(0, '53.986')] [2023-02-25 14:00:44,940][36157] DAMAGECOUNT value on done: 683760.0 [2023-02-25 14:00:44,941][36157] Sum rewards: 56.691, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.011', 'AMMO5': '0.017', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon2': '0.182', 'weapon4': '0.196', 'weapon5': '0.206', 'AMMO3': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.988', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '52.000'} [2023-02-25 14:00:45,249][36157] DAMAGECOUNT value on done: 675001.0 [2023-02-25 14:00:45,249][36157] Sum rewards: 54.708, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.176', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.052', 'AMMO4': '0.145', 'WEAPON5': '0.200', 'AMMO3': '0.271', 'weapon4': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.378', 'ARMOR': '0.448', 'WEAPON3': '1.500', 'weapon3': '2.970', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '50.000'} [2023-02-25 14:00:45,903][36157] DAMAGECOUNT value on done: 682113.0 [2023-02-25 14:00:45,903][36157] Sum rewards: 62.879, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.830', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon5': '0.082', 'AMMO4': '0.109', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon4': '0.336', 'weapon2': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.948', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '53.000'} [2023-02-25 14:00:45,960][36140] DAMAGECOUNT value on done: 683373.0 [2023-02-25 14:00:45,961][36140] Sum rewards: 63.141, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.438', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.018', 'weapon5': '0.028', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.158', 'weapon2': '0.524', 'WEAPON3': '0.950', 'HITCOUNT': '2.910', 'weapon3': '3.326', 'DAMAGECOUNT': '14.778', 'FRAGCOUNT': '52.000'} [2023-02-25 14:00:46,209][36157] DAMAGECOUNT value on done: 677229.0 [2023-02-25 14:00:46,209][36157] Sum rewards: 51.522, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.306', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon4': '0.302', 'weapon2': '0.320', 'WEAPON3': '1.150', 'HITCOUNT': '2.610', 'weapon3': '2.830', 'DAMAGECOUNT': '13.170', 'FRAGCOUNT': '45.000'} [2023-02-25 14:00:46,274][36140] DAMAGECOUNT value on done: 665310.0 [2023-02-25 14:00:46,274][36140] Sum rewards: 64.189, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.288', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.120', 'weapon4': '0.172', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.358', 'WEAPON3': '1.150', 'weapon3': '3.098', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.497', 'FRAGCOUNT': '53.500'} [2023-02-25 14:00:46,524][36140] DAMAGECOUNT value on done: 673029.0 [2023-02-25 14:00:46,524][36140] Sum rewards: 61.613, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.198', 'AMMO5': '0.015', 'AMMO2': '0.052', 'AMMO3': '0.200', 'weapon2': '0.208', 'weapon5': '0.244', 'AMMO4': '0.261', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.760', 'WEAPON3': '1.150', 'weapon3': '2.488', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '51.500'} [2023-02-25 14:00:46,837][36140] DAMAGECOUNT value on done: 674138.0 [2023-02-25 14:00:46,838][36140] Sum rewards: 62.444, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.770', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO4': '0.167', 'AMMO3': '0.194', 'weapon5': '0.198', 'weapon2': '0.208', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.844', 'WEAPON3': '1.250', 'weapon3': '2.456', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.374', 'FRAGCOUNT': '52.000'} [2023-02-25 14:00:47,147][36141] Large shaping reward 2.532 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.51, 170.0), ('weapon5', 0.002)] [2023-02-25 14:00:47,521][36138] Updated weights for policy 0, policy_version 46283 (0.0009) [2023-02-25 14:00:48,260][36142] DAMAGECOUNT value on done: 683061.0 [2023-02-25 14:00:48,260][36142] Sum rewards: 59.652, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.385', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.082', 'AMMO4': '0.120', 'weapon4': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.238', 'weapon2': '0.266', 'WEAPON3': '1.450', 'HITCOUNT': '3.260', 'weapon3': '3.298', 'DAMAGECOUNT': '14.046', 'FRAGCOUNT': '54.500'} [2023-02-25 14:00:48,338][36142] DAMAGECOUNT value on done: 664821.0 [2023-02-25 14:00:48,338][36142] Sum rewards: 48.916, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.780', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.157', 'AMMO3': '0.166', 'weapon4': '0.394', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon5': '0.468', 'weapon2': '0.780', 'WEAPON3': '1.100', 'weapon3': '2.090', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '12.804', 'FRAGCOUNT': '43.000'} [2023-02-25 14:00:48,586][36142] DAMAGECOUNT value on done: 666590.0 [2023-02-25 14:00:48,587][36142] Sum rewards: 58.265, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.575', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'AMMO3': '0.249', 'weapon2': '0.306', 'weapon4': '0.306', 'WEAPON3': '1.450', 'weapon3': '3.076', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.700', 'FRAGCOUNT': '52.000'} [2023-02-25 14:00:48,665][36142] DAMAGECOUNT value on done: 679087.0 [2023-02-25 14:00:48,666][36142] Sum rewards: 56.835, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.305', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon5': '0.204', 'AMMO4': '0.216', 'AMMO3': '0.235', 'weapon2': '0.256', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'ARMOR': '0.487', 'weapon4': '0.626', 'WEAPON3': '1.400', 'weapon3': '2.630', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.745', 'FRAGCOUNT': '51.000'} [2023-02-25 14:00:49,135][36156] DAMAGECOUNT value on done: 680759.0 [2023-02-25 14:00:49,136][36156] Sum rewards: 69.025, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.940', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'weapon4': '0.324', 'weapon2': '0.356', 'WEAPON3': '1.200', 'weapon3': '3.086', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '57.000'} [2023-02-25 14:00:49,247][36156] DAMAGECOUNT value on done: 689072.0 [2023-02-25 14:00:49,248][36156] Sum rewards: 70.350, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.478', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon5': '0.170', 'weapon2': '0.178', 'AMMO3': '0.195', 'AMMO4': '0.204', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.612', 'WEAPON3': '1.200', 'weapon3': '2.764', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '60.500'} [2023-02-25 14:00:49,450][36156] DAMAGECOUNT value on done: 671720.0 [2023-02-25 14:00:49,451][36156] Sum rewards: 73.018, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.148', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon2': '0.142', 'weapon5': '0.144', 'AMMO4': '0.178', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.394', 'WEAPON3': '1.300', 'weapon3': '3.096', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.816', 'FRAGCOUNT': '61.000'} [2023-02-25 14:00:49,593][36156] DAMAGECOUNT value on done: 673816.0 [2023-02-25 14:00:49,594][36156] Sum rewards: 51.467, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.270', 'AMMO5': '0.014', 'AMMO2': '0.050', 'AMMO3': '0.180', 'weapon5': '0.222', 'AMMO4': '0.251', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.482', 'weapon4': '0.622', 'WEAPON3': '1.050', 'weapon3': '2.372', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.463', 'FRAGCOUNT': '45.000'} [2023-02-25 14:00:49,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13412.7). Total num frames: 189603840. Throughput: 0: 3364.8. Samples: 9898516. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:00:49,730][36114] Avg episode reward: [(0, '54.696')] [2023-02-25 14:00:50,567][36138] Updated weights for policy 0, policy_version 46293 (0.0009) [2023-02-25 14:00:51,511][36155] DAMAGECOUNT value on done: 665271.0 [2023-02-25 14:00:51,511][36155] Sum rewards: 44.394, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.264', 'AMMO5': '0.011', 'AMMO2': '0.038', 'AMMO3': '0.122', 'AMMO4': '0.188', 'weapon5': '0.188', 'WEAPON5': '0.300', 'weapon2': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '0.700', 'weapon4': '1.042', 'weapon3': '2.090', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.279', 'FRAGCOUNT': '37.500'} [2023-02-25 14:00:51,824][36155] DAMAGECOUNT value on done: 686554.0 [2023-02-25 14:00:51,824][36155] Sum rewards: 47.668, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.684', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.154', 'AMMO3': '0.177', 'AMMO4': '0.219', 'weapon4': '0.372', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.636', 'WEAPON3': '1.100', 'weapon3': '2.530', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.974', 'FRAGCOUNT': '41.000'} [2023-02-25 14:00:52,414][36155] DAMAGECOUNT value on done: 682561.0 [2023-02-25 14:00:52,415][36155] Sum rewards: 60.744, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.962', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.168', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'weapon4': '0.318', 'weapon2': '0.362', 'WEAPON3': '1.200', 'weapon3': '2.924', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.651', 'FRAGCOUNT': '53.000'} [2023-02-25 14:00:52,717][36155] DAMAGECOUNT value on done: 674298.0 [2023-02-25 14:00:52,718][36155] Sum rewards: 57.756, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.464', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.062', 'weapon4': '0.178', 'AMMO3': '0.197', 'AMMO4': '0.207', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.572', 'WEAPON3': '1.150', 'weapon3': '2.960', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.206', 'FRAGCOUNT': '48.000'} [2023-02-25 14:00:53,512][36139] DAMAGECOUNT value on done: 681314.0 [2023-02-25 14:00:53,513][36139] Sum rewards: 53.505, reward structure: {'DEATHCOUNT': '-12.750', 'ARMOR': '0.004', 'AMMO5': '0.012', 'HEALTH': '0.018', 'AMMO2': '0.031', 'weapon5': '0.106', 'AMMO3': '0.131', 'AMMO4': '0.153', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON4': '0.350', 'weapon4': '0.672', 'WEAPON3': '0.750', 'weapon3': '2.630', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.709', 'FRAGCOUNT': '43.000'} [2023-02-25 14:00:53,616][36138] Updated weights for policy 0, policy_version 46303 (0.0009) [2023-02-25 14:00:53,811][36139] DAMAGECOUNT value on done: 671925.0 [2023-02-25 14:00:53,811][36139] Sum rewards: 50.141, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.587', 'AMMO5': '0.018', 'AMMO2': '0.055', 'AMMO3': '0.202', 'weapon2': '0.220', 'weapon5': '0.252', 'AMMO4': '0.275', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'weapon4': '0.680', 'WEAPON3': '1.300', 'weapon3': '2.528', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.827', 'FRAGCOUNT': '47.000'} [2023-02-25 14:00:54,130][36139] DAMAGECOUNT value on done: 682509.0 [2023-02-25 14:00:54,131][36139] Sum rewards: 58.734, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.424', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.169', 'weapon2': '0.210', 'weapon5': '0.222', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.614', 'WEAPON3': '0.950', 'weapon3': '2.678', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.886', 'FRAGCOUNT': '49.000'} [2023-02-25 14:00:54,433][36139] DAMAGECOUNT value on done: 678338.0 [2023-02-25 14:00:54,433][36139] Sum rewards: 57.373, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.598', 'ARMOR': '0.004', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO4': '0.151', 'AMMO3': '0.192', 'weapon5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.520', 'weapon2': '0.522', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.266', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.117', 'FRAGCOUNT': '49.000'} [2023-02-25 14:00:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 189669376. Throughput: 0: 3365.3. Samples: 9908644. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:00:54,730][36114] Avg episode reward: [(0, '54.770')] [2023-02-25 14:00:56,682][36138] Updated weights for policy 0, policy_version 46313 (0.0010) [2023-02-25 14:00:57,044][36155] Large shaping reward 2.512 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.48, 160.0), ('weapon5', 0.002)] [2023-02-25 14:00:59,703][36138] Updated weights for policy 0, policy_version 46323 (0.0009) [2023-02-25 14:00:59,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13426.5). Total num frames: 189739008. Throughput: 0: 3366.7. Samples: 9928848. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:00:59,730][36114] Avg episode reward: [(0, '54.770')] [2023-02-25 14:01:02,726][36138] Updated weights for policy 0, policy_version 46333 (0.0009) [2023-02-25 14:01:03,246][36141] DAMAGECOUNT value on done: 685797.0 [2023-02-25 14:01:03,246][36141] Sum rewards: 65.816, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.224', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.066', 'AMMO4': '0.085', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon2': '0.468', 'WEAPON3': '1.150', 'weapon3': '3.142', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '54.000'} [2023-02-25 14:01:03,369][36154] DAMAGECOUNT value on done: 679831.0 [2023-02-25 14:01:03,370][36154] Sum rewards: 56.261, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.044', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.076', 'weapon5': '0.132', 'AMMO4': '0.174', 'weapon2': '0.196', 'AMMO3': '0.265', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'HITCOUNT': '3.120', 'weapon3': '3.272', 'DAMAGECOUNT': '15.918', 'FRAGCOUNT': '52.000'} [2023-02-25 14:01:03,528][36141] DAMAGECOUNT value on done: 678223.0 [2023-02-25 14:01:03,529][36141] Sum rewards: 61.707, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.500', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.094', 'AMMO4': '0.100', 'weapon4': '0.160', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.330', 'WEAPON3': '1.100', 'HITCOUNT': '3.050', 'weapon3': '3.206', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '52.000'} [2023-02-25 14:01:03,567][36141] DAMAGECOUNT value on done: 681644.0 [2023-02-25 14:01:03,567][36141] Sum rewards: 74.857, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.990', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO3': '0.163', 'weapon5': '0.166', 'AMMO4': '0.180', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON4': '0.350', 'weapon4': '0.356', 'WEAPON3': '1.100', 'weapon3': '2.944', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.759', 'FRAGCOUNT': '62.000'} [2023-02-25 14:01:03,684][36154] DAMAGECOUNT value on done: 669900.0 [2023-02-25 14:01:03,684][36154] Sum rewards: 45.116, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.180', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon5': '0.190', 'AMMO3': '0.229', 'weapon4': '0.242', 'weapon2': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.510', 'weapon3': '3.010', 'DAMAGECOUNT': '12.567', 'FRAGCOUNT': '44.000'} [2023-02-25 14:01:03,856][36141] DAMAGECOUNT value on done: 672974.0 [2023-02-25 14:01:03,857][36141] Sum rewards: 65.390, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.308', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon5': '0.142', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.400', 'weapon2': '0.554', 'WEAPON3': '1.350', 'weapon3': '2.702', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '56.000'} [2023-02-25 14:01:03,867][36154] Large shaping reward 2.607 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.585, 195.0), ('weapon5', 0.002)] [2023-02-25 14:01:03,924][36154] DAMAGECOUNT value on done: 679628.0 [2023-02-25 14:01:03,924][36154] Sum rewards: 63.714, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.688', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.127', 'AMMO3': '0.153', 'weapon5': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.374', 'weapon2': '0.768', 'WEAPON3': '1.000', 'weapon3': '2.436', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.669', 'FRAGCOUNT': '52.000'} [2023-02-25 14:01:04,239][36154] DAMAGECOUNT value on done: 682784.0 [2023-02-25 14:01:04,240][36154] Sum rewards: 57.991, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.810', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.050', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'AMMO3': '0.186', 'weapon4': '0.280', 'WEAPON4': '0.300', 'weapon2': '0.526', 'WEAPON3': '1.200', 'weapon3': '2.984', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '49.000'} [2023-02-25 14:01:04,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 189804544. Throughput: 0: 3366.5. Samples: 9949028. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:01:04,729][36114] Avg episode reward: [(0, '55.650')] [2023-02-25 14:01:04,784][36157] DAMAGECOUNT value on done: 687964.0 [2023-02-25 14:01:04,784][36157] Sum rewards: 46.690, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.850', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'AMMO4': '0.102', 'weapon4': '0.140', 'AMMO3': '0.155', 'WEAPON4': '0.250', 'weapon2': '0.294', 'WEAPON5': '0.350', 'weapon5': '0.460', 'WEAPON3': '1.050', 'HITCOUNT': '2.320', 'weapon3': '2.752', 'DAMAGECOUNT': '12.612', 'FRAGCOUNT': '39.500'} [2023-02-25 14:01:05,080][36157] DAMAGECOUNT value on done: 680326.0 [2023-02-25 14:01:05,080][36157] Sum rewards: 59.819, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.397', 'AMMO5': '0.015', 'AMMO2': '0.054', 'AMMO3': '0.155', 'AMMO4': '0.269', 'weapon5': '0.318', 'weapon2': '0.364', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon4': '1.204', 'weapon3': '1.822', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '49.000'} [2023-02-25 14:01:05,760][36157] DAMAGECOUNT value on done: 687282.0 [2023-02-25 14:01:05,761][36157] Sum rewards: 59.749, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.948', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.168', 'AMMO3': '0.244', 'weapon2': '0.348', 'WEAPON3': '1.550', 'weapon3': '3.178', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '53.000'} [2023-02-25 14:01:05,807][36138] Updated weights for policy 0, policy_version 46343 (0.0009) [2023-02-25 14:01:05,970][36140] DAMAGECOUNT value on done: 688743.0 [2023-02-25 14:01:05,971][36140] Sum rewards: 63.239, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.150', 'AMMO5': '0.014', 'AMMO2': '0.026', 'weapon5': '0.124', 'AMMO4': '0.132', 'AMMO3': '0.263', 'weapon2': '0.270', 'weapon4': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.070', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '58.000'} [2023-02-25 14:01:06,078][36157] DAMAGECOUNT value on done: 682569.0 [2023-02-25 14:01:06,078][36157] Sum rewards: 59.691, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.508', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.042', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'weapon4': '0.158', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.510', 'WEAPON3': '1.250', 'weapon3': '3.000', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '52.000'} [2023-02-25 14:01:06,280][36140] DAMAGECOUNT value on done: 670671.0 [2023-02-25 14:01:06,281][36140] Sum rewards: 57.421, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.612', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.078', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'weapon4': '0.276', 'WEAPON4': '0.300', 'weapon2': '0.590', 'WEAPON3': '1.350', 'weapon3': '2.788', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.083', 'FRAGCOUNT': '51.000'} [2023-02-25 14:01:06,531][36140] DAMAGECOUNT value on done: 678241.0 [2023-02-25 14:01:06,532][36140] Sum rewards: 57.920, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.318', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.102', 'AMMO4': '0.196', 'AMMO3': '0.197', 'weapon4': '0.308', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.414', 'WEAPON3': '1.250', 'weapon3': '2.926', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '50.000'} [2023-02-25 14:01:06,831][36140] DAMAGECOUNT value on done: 678515.0 [2023-02-25 14:01:06,832][36140] Sum rewards: 51.103, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.062', 'AMMO5': '0.011', 'AMMO2': '0.034', 'AMMO3': '0.147', 'weapon5': '0.166', 'AMMO4': '0.168', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.526', 'weapon2': '0.538', 'WEAPON3': '0.800', 'weapon3': '2.484', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.131', 'FRAGCOUNT': '43.000'} [2023-02-25 14:01:07,805][36141] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:01:08,249][36142] DAMAGECOUNT value on done: 688594.0 [2023-02-25 14:01:08,249][36142] Sum rewards: 62.649, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.853', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.136', 'weapon2': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon4': '0.554', 'WEAPON3': '1.550', 'weapon3': '2.818', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '55.000'} [2023-02-25 14:01:08,323][36142] DAMAGECOUNT value on done: 669089.0 [2023-02-25 14:01:08,324][36142] Sum rewards: 47.690, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.968', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'AMMO4': '0.204', 'WEAPON4': '0.300', 'weapon4': '0.414', 'weapon2': '0.652', 'WEAPON3': '1.250', 'weapon3': '2.606', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.804', 'FRAGCOUNT': '43.000'} [2023-02-25 14:01:08,569][36142] DAMAGECOUNT value on done: 671756.0 [2023-02-25 14:01:08,569][36142] Sum rewards: 54.078, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.880', 'AMMO5': '0.015', 'AMMO2': '0.060', 'AMMO3': '0.170', 'weapon2': '0.244', 'weapon5': '0.288', 'AMMO4': '0.299', 'WEAPON5': '0.450', 'weapon4': '0.602', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.542', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.498', 'FRAGCOUNT': '46.000'} [2023-02-25 14:01:08,645][36142] DAMAGECOUNT value on done: 683363.0 [2023-02-25 14:01:08,646][36142] Sum rewards: 48.790, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.350', 'AMMO5': '0.012', 'AMMO2': '0.040', 'AMMO3': '0.166', 'weapon5': '0.194', 'weapon2': '0.200', 'AMMO4': '0.201', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.522', 'WEAPON3': '1.000', 'HITCOUNT': '2.600', 'weapon3': '2.886', 'DAMAGECOUNT': '12.468', 'FRAGCOUNT': '42.000'} [2023-02-25 14:01:08,833][36138] Updated weights for policy 0, policy_version 46353 (0.0009) [2023-02-25 14:01:08,961][36156] DAMAGECOUNT value on done: 685134.0 [2023-02-25 14:01:08,961][36156] Sum rewards: 51.105, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.045', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.038', 'AMMO3': '0.120', 'weapon5': '0.170', 'AMMO4': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.300', 'WEAPON3': '0.700', 'weapon4': '0.918', 'weapon3': '2.020', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.125', 'FRAGCOUNT': '41.000'} [2023-02-25 14:01:09,076][36156] DAMAGECOUNT value on done: 693199.0 [2023-02-25 14:01:09,077][36156] Sum rewards: 45.067, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.101', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.094', 'AMMO4': '0.150', 'weapon5': '0.172', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon2': '0.226', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'HITCOUNT': '2.430', 'weapon3': '3.316', 'DAMAGECOUNT': '12.381', 'FRAGCOUNT': '39.000'} [2023-02-25 14:01:09,280][36156] DAMAGECOUNT value on done: 676595.0 [2023-02-25 14:01:09,281][36156] Sum rewards: 59.447, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.810', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.068', 'WEAPON4': '0.150', 'weapon2': '0.150', 'weapon5': '0.176', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon4': '0.260', 'WEAPON3': '1.200', 'HITCOUNT': '3.090', 'weapon3': '3.122', 'DAMAGECOUNT': '14.625', 'FRAGCOUNT': '50.000'} [2023-02-25 14:01:09,396][36156] DAMAGECOUNT value on done: 678999.0 [2023-02-25 14:01:09,397][36156] Sum rewards: 61.888, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.691', 'AMMO5': '0.015', 'AMMO2': '0.050', 'AMMO3': '0.178', 'weapon2': '0.200', 'weapon5': '0.220', 'AMMO4': '0.250', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.846', 'WEAPON3': '1.000', 'weapon3': '2.440', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.549', 'FRAGCOUNT': '52.000'} [2023-02-25 14:01:09,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 189870080. Throughput: 0: 3368.1. Samples: 9959160. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:01:09,729][36114] Avg episode reward: [(0, '55.880')] [2023-02-25 14:01:11,003][36142] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:01:11,496][36155] DAMAGECOUNT value on done: 669788.0 [2023-02-25 14:01:11,496][36155] Sum rewards: 54.071, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.626', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.104', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'weapon2': '0.200', 'AMMO3': '0.282', 'WEAPON4': '0.350', 'weapon4': '0.708', 'WEAPON3': '1.550', 'weapon3': '2.642', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '13.551', 'FRAGCOUNT': '50.000'} [2023-02-25 14:01:11,812][36155] DAMAGECOUNT value on done: 691232.0 [2023-02-25 14:01:11,813][36155] Sum rewards: 58.282, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.133', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon5': '0.084', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.178', 'WEAPON5': '0.250', 'weapon4': '0.274', 'weapon2': '0.700', 'WEAPON3': '1.100', 'weapon3': '2.762', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.746', 'FRAGCOUNT': '49.000'} [2023-02-25 14:01:11,838][36138] Updated weights for policy 0, policy_version 46363 (0.0009) [2023-02-25 14:01:12,402][36155] DAMAGECOUNT value on done: 687362.0 [2023-02-25 14:01:12,403][36155] Sum rewards: 59.809, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.703', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.168', 'AMMO3': '0.193', 'weapon2': '0.366', 'WEAPON3': '1.200', 'HITCOUNT': '2.750', 'weapon3': '3.110', 'DAMAGECOUNT': '14.403', 'FRAGCOUNT': '51.500'} [2023-02-25 14:01:12,708][36155] DAMAGECOUNT value on done: 679288.0 [2023-02-25 14:01:12,709][36155] Sum rewards: 56.928, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.790', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.084', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.204', 'AMMO3': '0.261', 'weapon4': '0.390', 'weapon2': '0.556', 'WEAPON3': '1.500', 'weapon3': '2.568', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.970', 'FRAGCOUNT': '51.000'} [2023-02-25 14:01:13,484][36139] DAMAGECOUNT value on done: 685532.0 [2023-02-25 14:01:13,484][36139] Sum rewards: 52.526, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.020', 'AMMO5': '0.007', 'AMMO2': '0.030', 'AMMO3': '0.135', 'AMMO4': '0.149', 'weapon5': '0.158', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.536', 'weapon4': '0.608', 'WEAPON3': '0.850', 'weapon3': '2.308', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '12.654', 'FRAGCOUNT': '45.000'} [2023-02-25 14:01:13,794][36139] DAMAGECOUNT value on done: 677509.0 [2023-02-25 14:01:13,795][36139] Sum rewards: 60.031, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.495', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.162', 'AMMO4': '0.182', 'weapon2': '0.236', 'AMMO3': '0.270', 'weapon4': '0.312', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.984', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.752', 'FRAGCOUNT': '55.000'} [2023-02-25 14:01:14,115][36139] DAMAGECOUNT value on done: 687380.0 [2023-02-25 14:01:14,115][36139] Sum rewards: 56.356, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.615', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.146', 'weapon2': '0.178', 'AMMO3': '0.195', 'AMMO4': '0.195', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.902', 'WEAPON3': '1.200', 'weapon3': '2.532', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.613', 'FRAGCOUNT': '51.000'} [2023-02-25 14:01:14,427][36139] DAMAGECOUNT value on done: 682838.0 [2023-02-25 14:01:14,428][36139] Sum rewards: 52.762, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.984', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO3': '0.118', 'weapon5': '0.122', 'AMMO4': '0.146', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.370', 'weapon2': '0.472', 'WEAPON3': '0.800', 'HITCOUNT': '2.670', 'weapon3': '2.758', 'DAMAGECOUNT': '13.500', 'FRAGCOUNT': '42.000'} [2023-02-25 14:01:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13412.7). Total num frames: 189939712. Throughput: 0: 3368.5. Samples: 9979384. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:01:14,730][36114] Avg episode reward: [(0, '56.379')] [2023-02-25 14:01:14,892][36138] Updated weights for policy 0, policy_version 46373 (0.0010) [2023-02-25 14:01:17,927][36138] Updated weights for policy 0, policy_version 46383 (0.0009) [2023-02-25 14:01:19,729][36114] Fps is (10 sec: 13516.4, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 190005248. Throughput: 0: 3367.9. Samples: 9999608. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:01:19,730][36114] Avg episode reward: [(0, '56.379')] [2023-02-25 14:01:19,735][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000046388_190005248.pth... [2023-02-25 14:01:19,792][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000045602_186785792.pth [2023-02-25 14:01:21,025][36138] Updated weights for policy 0, policy_version 46393 (0.0010) [2023-02-25 14:01:21,970][36142] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:01:23,114][36141] DAMAGECOUNT value on done: 691005.0 [2023-02-25 14:01:23,114][36141] Sum rewards: 60.743, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.262', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.114', 'AMMO4': '0.128', 'AMMO3': '0.137', 'WEAPON5': '0.200', 'weapon4': '0.246', 'WEAPON4': '0.300', 'WEAPON3': '0.900', 'weapon2': '0.942', 'weapon3': '2.470', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.624', 'FRAGCOUNT': '49.000'} [2023-02-25 14:01:23,248][36154] DAMAGECOUNT value on done: 684440.0 [2023-02-25 14:01:23,249][36154] Sum rewards: 54.302, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.460', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon4': '0.282', 'weapon2': '0.610', 'WEAPON3': '1.150', 'HITCOUNT': '2.820', 'weapon3': '2.836', 'DAMAGECOUNT': '13.827', 'FRAGCOUNT': '46.500'} [2023-02-25 14:01:23,417][36141] DAMAGECOUNT value on done: 686422.0 [2023-02-25 14:01:23,418][36141] Sum rewards: 57.145, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.120', 'AMMO5': '0.006', 'AMMO2': '0.013', 'weapon4': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'WEAPON5': '0.150', 'weapon5': '0.176', 'AMMO3': '0.256', 'weapon2': '0.326', 'WEAPON3': '1.700', 'HITCOUNT': '3.140', 'weapon3': '3.252', 'DAMAGECOUNT': '14.334', 'FRAGCOUNT': '52.000'} [2023-02-25 14:01:23,531][36141] DAMAGECOUNT value on done: 682861.0 [2023-02-25 14:01:23,531][36141] Sum rewards: 51.914, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.230', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.037', 'weapon5': '0.086', 'AMMO4': '0.183', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.374', 'WEAPON4': '0.450', 'weapon4': '0.488', 'WEAPON3': '1.350', 'weapon3': '2.834', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.728', 'FRAGCOUNT': '48.000'} [2023-02-25 14:01:23,559][36154] DAMAGECOUNT value on done: 674145.0 [2023-02-25 14:01:23,560][36154] Sum rewards: 43.829, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.504', 'ARMOR': '0.008', 'AMMO5': '0.027', 'AMMO2': '0.073', 'AMMO3': '0.161', 'weapon5': '0.224', 'weapon2': '0.242', 'AMMO4': '0.365', 'WEAPON5': '0.650', 'WEAPON4': '0.800', 'WEAPON3': '0.950', 'weapon4': '0.954', 'weapon3': '2.254', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.735', 'FRAGCOUNT': '40.500'} [2023-02-25 14:01:23,808][36154] DAMAGECOUNT value on done: 684490.0 [2023-02-25 14:01:23,808][36154] Sum rewards: 59.092, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.180', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.173', 'AMMO3': '0.186', 'weapon5': '0.238', 'weapon2': '0.366', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.472', 'WEAPON3': '1.100', 'weapon3': '2.630', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.586', 'FRAGCOUNT': '51.000'} [2023-02-25 14:01:23,824][36141] DAMAGECOUNT value on done: 677767.0 [2023-02-25 14:01:23,824][36141] Sum rewards: 47.561, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.045', 'AMMO5': '0.005', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.261', 'weapon2': '0.378', 'weapon4': '0.444', 'ARMOR': '0.495', 'WEAPON3': '1.650', 'weapon3': '2.658', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.379', 'FRAGCOUNT': '44.000'} [2023-02-25 14:01:24,056][36138] Updated weights for policy 0, policy_version 46403 (0.0009) [2023-02-25 14:01:24,116][36154] DAMAGECOUNT value on done: 687797.0 [2023-02-25 14:01:24,117][36154] Sum rewards: 54.723, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.886', 'AMMO5': '0.015', 'AMMO2': '0.018', 'weapon4': '0.046', 'AMMO4': '0.091', 'weapon5': '0.124', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.150', 'HITCOUNT': '2.790', 'weapon3': '3.246', 'DAMAGECOUNT': '15.039', 'FRAGCOUNT': '46.500'} [2023-02-25 14:01:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13426.6). Total num frames: 190074880. Throughput: 0: 3366.6. Samples: 10009636. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:01:24,729][36114] Avg episode reward: [(0, '56.312')] [2023-02-25 14:01:24,820][36141] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:01:24,914][36157] DAMAGECOUNT value on done: 692565.0 [2023-02-25 14:01:24,915][36157] Sum rewards: 53.996, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.545', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.162', 'weapon5': '0.188', 'weapon2': '0.306', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.614', 'WEAPON3': '1.050', 'weapon3': '2.614', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.803', 'FRAGCOUNT': '47.000'} [2023-02-25 14:01:25,234][36157] DAMAGECOUNT value on done: 684845.0 [2023-02-25 14:01:25,235][36157] Sum rewards: 47.201, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.728', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.076', 'AMMO4': '0.098', 'WEAPON5': '0.200', 'weapon2': '0.258', 'WEAPON4': '0.300', 'AMMO3': '0.310', 'weapon4': '0.338', 'ARMOR': '0.461', 'WEAPON3': '1.750', 'HITCOUNT': '2.800', 'weapon3': '3.004', 'DAMAGECOUNT': '13.557', 'FRAGCOUNT': '47.000'} [2023-02-25 14:01:25,906][36157] DAMAGECOUNT value on done: 692441.0 [2023-02-25 14:01:25,906][36157] Sum rewards: 52.548, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.380', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.170', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'WEAPON5': '0.250', 'weapon2': '0.296', 'weapon4': '0.440', 'WEAPON3': '1.300', 'weapon3': '2.798', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '45.000'} [2023-02-25 14:01:25,952][36140] DAMAGECOUNT value on done: 693685.0 [2023-02-25 14:01:25,953][36140] Sum rewards: 55.711, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.032', 'ARMOR': '0.004', 'AMMO2': '0.014', 'AMMO5': '0.017', 'AMMO4': '0.072', 'weapon5': '0.138', 'WEAPON4': '0.200', 'AMMO3': '0.239', 'weapon2': '0.248', 'weapon4': '0.274', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.810', 'weapon3': '3.050', 'DAMAGECOUNT': '14.826', 'FRAGCOUNT': '49.000'} [2023-02-25 14:01:26,212][36157] DAMAGECOUNT value on done: 687884.0 [2023-02-25 14:01:26,212][36157] Sum rewards: 64.957, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.482', 'AMMO5': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.052', 'weapon5': '0.086', 'AMMO3': '0.149', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.316', 'weapon2': '0.562', 'WEAPON3': '0.850', 'weapon3': '2.870', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.945', 'FRAGCOUNT': '52.000'} [2023-02-25 14:01:26,269][36140] DAMAGECOUNT value on done: 674874.0 [2023-02-25 14:01:26,269][36140] Sum rewards: 45.386, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.622', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.060', 'weapon5': '0.088', 'AMMO3': '0.182', 'weapon4': '0.244', 'WEAPON5': '0.250', 'AMMO4': '0.301', 'weapon2': '0.436', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.780', 'weapon3': '2.996', 'DAMAGECOUNT': '12.609', 'FRAGCOUNT': '40.000'} [2023-02-25 14:01:26,578][36140] DAMAGECOUNT value on done: 683294.0 [2023-02-25 14:01:26,579][36140] Sum rewards: 58.361, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.370', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.147', 'AMMO3': '0.158', 'weapon5': '0.188', 'weapon2': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.626', 'WEAPON3': '0.900', 'weapon3': '2.682', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.159', 'FRAGCOUNT': '47.000'} [2023-02-25 14:01:26,874][36140] DAMAGECOUNT value on done: 683239.0 [2023-02-25 14:01:26,874][36140] Sum rewards: 50.220, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.240', 'ARMOR': '0.005', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon5': '0.124', 'AMMO4': '0.192', 'AMMO3': '0.202', 'weapon2': '0.312', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.614', 'WEAPON3': '1.100', 'weapon3': '2.686', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.172', 'FRAGCOUNT': '45.000'} [2023-02-25 14:01:27,111][36138] Updated weights for policy 0, policy_version 46413 (0.0009) [2023-02-25 14:01:28,285][36142] DAMAGECOUNT value on done: 693126.0 [2023-02-25 14:01:28,286][36142] Sum rewards: 49.211, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.791', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon5': '0.128', 'weapon2': '0.180', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'AMMO4': '0.257', 'WEAPON4': '0.450', 'weapon4': '0.890', 'WEAPON3': '1.300', 'weapon3': '2.584', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.596', 'FRAGCOUNT': '45.000'} [2023-02-25 14:01:28,406][36142] DAMAGECOUNT value on done: 673849.0 [2023-02-25 14:01:28,407][36142] Sum rewards: 57.830, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.340', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon5': '0.080', 'AMMO4': '0.119', 'AMMO3': '0.181', 'weapon2': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.488', 'WEAPON3': '1.000', 'HITCOUNT': '2.990', 'weapon3': '3.004', 'DAMAGECOUNT': '14.280', 'FRAGCOUNT': '48.000'} [2023-02-25 14:01:28,608][36142] DAMAGECOUNT value on done: 676312.0 [2023-02-25 14:01:28,609][36142] Sum rewards: 55.379, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.854', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.040', 'AMMO3': '0.139', 'AMMO4': '0.202', 'weapon5': '0.256', 'weapon4': '0.446', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon2': '0.708', 'WEAPON3': '0.850', 'weapon3': '2.160', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '13.467', 'FRAGCOUNT': '48.000'} [2023-02-25 14:01:28,709][36142] DAMAGECOUNT value on done: 688544.0 [2023-02-25 14:01:28,709][36142] Sum rewards: 63.653, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.240', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.148', 'AMMO3': '0.168', 'AMMO4': '0.177', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.472', 'weapon2': '0.540', 'WEAPON3': '1.000', 'weapon3': '2.648', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.543', 'FRAGCOUNT': '53.000'} [2023-02-25 14:01:29,011][36156] DAMAGECOUNT value on done: 689980.0 [2023-02-25 14:01:29,011][36156] Sum rewards: 62.494, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.930', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.072', 'AMMO3': '0.135', 'weapon5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.318', 'WEAPON5': '0.350', 'weapon4': '0.656', 'WEAPON3': '0.900', 'weapon3': '2.546', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.538', 'FRAGCOUNT': '51.000'} [2023-02-25 14:01:29,057][36156] DAMAGECOUNT value on done: 697087.0 [2023-02-25 14:01:29,057][36156] Sum rewards: 46.121, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.434', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO3': '0.139', 'AMMO4': '0.181', 'weapon5': '0.230', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.504', 'WEAPON3': '0.800', 'HITCOUNT': '2.490', 'weapon3': '2.736', 'DAMAGECOUNT': '11.664', 'FRAGCOUNT': '38.000'} [2023-02-25 14:01:29,376][36156] DAMAGECOUNT value on done: 681675.0 [2023-02-25 14:01:29,377][36156] Sum rewards: 57.308, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.680', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.272', 'AMMO3': '0.288', 'weapon2': '0.566', 'WEAPON3': '1.650', 'weapon3': '2.780', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '15.240', 'FRAGCOUNT': '53.000'} [2023-02-25 14:01:29,421][36156] DAMAGECOUNT value on done: 683922.0 [2023-02-25 14:01:29,421][36156] Sum rewards: 57.266, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.574', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.074', 'weapon4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.216', 'weapon2': '0.598', 'WEAPON3': '1.350', 'HITCOUNT': '3.000', 'weapon3': '3.032', 'DAMAGECOUNT': '14.724', 'FRAGCOUNT': '49.000'} [2023-02-25 14:01:29,729][36114] Fps is (10 sec: 13517.2, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 190140416. Throughput: 0: 3367.5. Samples: 10029752. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:01:29,730][36114] Avg episode reward: [(0, '56.457')] [2023-02-25 14:01:30,309][36138] Updated weights for policy 0, policy_version 46423 (0.0010) [2023-02-25 14:01:31,806][36155] DAMAGECOUNT value on done: 674706.0 [2023-02-25 14:01:31,806][36155] Sum rewards: 55.326, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.290', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO3': '0.127', 'weapon5': '0.154', 'AMMO4': '0.187', 'WEAPON5': '0.350', 'weapon2': '0.666', 'WEAPON4': '0.700', 'WEAPON3': '0.750', 'weapon4': '1.100', 'weapon3': '1.824', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.574', 'FRAGCOUNT': '48.000'} [2023-02-25 14:01:32,140][36155] DAMAGECOUNT value on done: 695864.0 [2023-02-25 14:01:32,140][36155] Sum rewards: 54.546, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.400', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.177', 'AMMO3': '0.184', 'WEAPON4': '0.300', 'weapon4': '0.314', 'weapon2': '0.432', 'WEAPON3': '1.100', 'HITCOUNT': '2.860', 'weapon3': '2.986', 'DAMAGECOUNT': '13.896', 'FRAGCOUNT': '47.000'} [2023-02-25 14:01:32,780][36155] DAMAGECOUNT value on done: 691728.0 [2023-02-25 14:01:32,781][36155] Sum rewards: 45.942, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.340', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.051', 'AMMO3': '0.182', 'weapon5': '0.240', 'AMMO4': '0.254', 'weapon4': '0.518', 'WEAPON5': '0.550', 'weapon2': '0.594', 'WEAPON4': '0.650', 'WEAPON3': '1.000', 'weapon3': '2.330', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.098', 'FRAGCOUNT': '42.000'} [2023-02-25 14:01:33,108][36155] DAMAGECOUNT value on done: 684358.0 [2023-02-25 14:01:33,108][36155] Sum rewards: 57.263, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.236', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.096', 'AMMO4': '0.173', 'weapon5': '0.178', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.808', 'WEAPON3': '1.450', 'weapon3': '2.656', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '52.000'} [2023-02-25 14:01:33,605][36138] Updated weights for policy 0, policy_version 46433 (0.0009) [2023-02-25 14:01:33,832][36139] DAMAGECOUNT value on done: 690610.0 [2023-02-25 14:01:33,832][36139] Sum rewards: 58.129, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.573', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon7': '0.036', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.144', 'weapon2': '0.150', 'weapon5': '0.170', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.500', 'WEAPON3': '0.900', 'weapon3': '2.658', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '47.000'} [2023-02-25 14:01:34,147][36139] DAMAGECOUNT value on done: 682213.0 [2023-02-25 14:01:34,148][36139] Sum rewards: 58.926, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.109', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.096', 'AMMO3': '0.131', 'AMMO4': '0.134', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.436', 'weapon4': '0.464', 'WEAPON3': '0.750', 'weapon3': '2.796', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.007', 'FRAGCOUNT': '48.000'} [2023-02-25 14:01:34,444][36139] DAMAGECOUNT value on done: 692545.0 [2023-02-25 14:01:34,445][36139] Sum rewards: 58.499, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.388', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.162', 'AMMO3': '0.164', 'AMMO4': '0.178', 'WEAPON5': '0.250', 'weapon4': '0.338', 'WEAPON4': '0.400', 'weapon2': '0.424', 'WEAPON3': '0.950', 'weapon3': '2.842', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '50.000'} [2023-02-25 14:01:34,729][36114] Fps is (10 sec: 12697.5, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 190201856. Throughput: 0: 3330.9. Samples: 10048408. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:01:34,730][36114] Avg episode reward: [(0, '56.610')] [2023-02-25 14:01:34,755][36139] DAMAGECOUNT value on done: 687070.0 [2023-02-25 14:01:34,756][36139] Sum rewards: 51.046, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.626', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO4': '0.187', 'AMMO3': '0.194', 'weapon5': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.386', 'weapon4': '0.452', 'WEAPON3': '1.100', 'weapon3': '2.552', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '12.696', 'FRAGCOUNT': '45.000'} [2023-02-25 14:01:36,815][36138] Updated weights for policy 0, policy_version 46443 (0.0009) [2023-02-25 14:01:39,729][36114] Fps is (10 sec: 12697.6, 60 sec: 13312.0, 300 sec: 13398.8). Total num frames: 190267392. Throughput: 0: 3317.5. Samples: 10057930. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:01:39,730][36114] Avg episode reward: [(0, '56.618')] [2023-02-25 14:01:39,961][36138] Updated weights for policy 0, policy_version 46453 (0.0009) [2023-02-25 14:01:40,468][36157] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:01:43,039][36138] Updated weights for policy 0, policy_version 46463 (0.0009) [2023-02-25 14:01:43,804][36141] DAMAGECOUNT value on done: 695909.0 [2023-02-25 14:01:43,805][36141] Sum rewards: 54.981, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.055', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'weapon5': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.226', 'weapon2': '0.334', 'weapon4': '0.508', 'WEAPON3': '1.300', 'weapon3': '2.680', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.712', 'FRAGCOUNT': '47.000'} [2023-02-25 14:01:43,856][36154] DAMAGECOUNT value on done: 689430.0 [2023-02-25 14:01:43,857][36154] Sum rewards: 49.240, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.510', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.100', 'AMMO4': '0.242', 'WEAPON5': '0.250', 'AMMO3': '0.289', 'weapon2': '0.316', 'weapon4': '0.352', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'weapon3': '2.890', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.970', 'FRAGCOUNT': '47.500'} [2023-02-25 14:01:44,122][36141] DAMAGECOUNT value on done: 692002.0 [2023-02-25 14:01:44,122][36141] Sum rewards: 59.112, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.970', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.072', 'AMMO4': '0.171', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'weapon4': '0.308', 'weapon2': '0.440', 'WEAPON3': '1.300', 'weapon3': '2.728', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.611', 'FRAGCOUNT': '51.000'} [2023-02-25 14:01:44,146][36154] DAMAGECOUNT value on done: 678806.0 [2023-02-25 14:01:44,147][36154] Sum rewards: 48.617, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.722', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.138', 'AMMO4': '0.190', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'weapon4': '0.284', 'WEAPON4': '0.400', 'weapon2': '0.496', 'WEAPON3': '1.300', 'weapon3': '2.828', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.968', 'FRAGCOUNT': '44.000'} [2023-02-25 14:01:44,238][36141] DAMAGECOUNT value on done: 687628.0 [2023-02-25 14:01:44,239][36141] Sum rewards: 52.388, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.500', 'ARMOR': '0.004', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'weapon4': '0.076', 'weapon2': '0.132', 'AMMO3': '0.331', 'WEAPON3': '1.900', 'HITCOUNT': '3.020', 'weapon3': '3.544', 'DAMAGECOUNT': '14.301', 'FRAGCOUNT': '51.000'} [2023-02-25 14:01:44,461][36154] DAMAGECOUNT value on done: 689188.0 [2023-02-25 14:01:44,461][36154] Sum rewards: 52.659, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.682', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.170', 'AMMO4': '0.188', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.436', 'weapon4': '0.572', 'WEAPON3': '1.400', 'weapon3': '2.538', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '14.094', 'FRAGCOUNT': '48.000'} [2023-02-25 14:01:44,543][36141] DAMAGECOUNT value on done: 682089.0 [2023-02-25 14:01:44,544][36141] Sum rewards: 44.524, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.255', 'AMMO5': '0.020', 'AMMO2': '0.049', 'AMMO3': '0.189', 'weapon5': '0.190', 'AMMO4': '0.243', 'weapon2': '0.424', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'weapon4': '0.744', 'WEAPON3': '1.150', 'weapon3': '2.314', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.966', 'FRAGCOUNT': '42.000'} [2023-02-25 14:01:44,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13312.0, 300 sec: 13384.9). Total num frames: 190332928. Throughput: 0: 3309.9. Samples: 10077792. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:01:44,730][36114] Avg episode reward: [(0, '56.370')] [2023-02-25 14:01:44,769][36154] DAMAGECOUNT value on done: 692382.0 [2023-02-25 14:01:44,769][36154] Sum rewards: 48.323, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.296', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon7': '0.080', 'AMMO3': '0.135', 'weapon5': '0.202', 'AMMO4': '0.270', 'weapon2': '0.274', 'WEAPON5': '0.300', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.766', 'WEAPON3': '0.800', 'weapon3': '2.256', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '13.755', 'FRAGCOUNT': '40.000'} [2023-02-25 14:01:45,558][36157] DAMAGECOUNT value on done: 697524.0 [2023-02-25 14:01:45,558][36157] Sum rewards: 60.790, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.384', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon5': '0.106', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'weapon2': '0.288', 'weapon4': '0.426', 'WEAPON3': '1.100', 'weapon3': '2.934', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.877', 'FRAGCOUNT': '51.000'} [2023-02-25 14:01:45,865][36157] DAMAGECOUNT value on done: 688969.0 [2023-02-25 14:01:45,866][36157] Sum rewards: 46.930, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.676', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.038', 'weapon5': '0.118', 'AMMO3': '0.164', 'AMMO4': '0.192', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.564', 'weapon2': '0.660', 'WEAPON3': '0.950', 'weapon3': '2.268', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '12.324', 'FRAGCOUNT': '42.500'} [2023-02-25 14:01:46,090][36138] Updated weights for policy 0, policy_version 46473 (0.0010) [2023-02-25 14:01:46,568][36157] DAMAGECOUNT value on done: 697213.0 [2023-02-25 14:01:46,568][36157] Sum rewards: 52.935, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.455', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.198', 'AMMO3': '0.221', 'weapon2': '0.294', 'WEAPON4': '0.350', 'weapon4': '0.894', 'WEAPON3': '1.300', 'weapon3': '2.428', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.316', 'FRAGCOUNT': '47.000'} [2023-02-25 14:01:46,614][36140] DAMAGECOUNT value on done: 698087.0 [2023-02-25 14:01:46,615][36140] Sum rewards: 47.180, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.182', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon5': '0.172', 'AMMO4': '0.201', 'weapon2': '0.248', 'AMMO3': '0.259', 'weapon4': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '2.790', 'weapon3': '2.914', 'DAMAGECOUNT': '13.206', 'FRAGCOUNT': '45.000'} [2023-02-25 14:01:46,875][36157] DAMAGECOUNT value on done: 693268.0 [2023-02-25 14:01:46,875][36157] Sum rewards: 66.435, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.732', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.207', 'weapon2': '0.282', 'WEAPON4': '0.300', 'weapon4': '0.308', 'WEAPON3': '1.100', 'weapon3': '3.246', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '57.000'} [2023-02-25 14:01:46,907][36140] DAMAGECOUNT value on done: 679626.0 [2023-02-25 14:01:46,907][36140] Sum rewards: 58.858, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.885', 'weapon5': '0.006', 'AMMO5': '0.009', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.161', 'weapon2': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.558', 'WEAPON3': '0.950', 'weapon3': '2.912', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.256', 'FRAGCOUNT': '49.000'} [2023-02-25 14:01:47,215][36140] DAMAGECOUNT value on done: 687988.0 [2023-02-25 14:01:47,215][36140] Sum rewards: 52.075, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.586', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.146', 'weapon5': '0.146', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON4': '0.400', 'WEAPON3': '0.900', 'weapon4': '0.966', 'weapon3': '2.240', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.082', 'FRAGCOUNT': '43.000'} [2023-02-25 14:01:47,508][36140] DAMAGECOUNT value on done: 686585.0 [2023-02-25 14:01:47,509][36140] Sum rewards: 37.834, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.012', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.031', 'AMMO3': '0.134', 'AMMO4': '0.155', 'weapon5': '0.264', 'weapon2': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.608', 'WEAPON3': '0.800', 'HITCOUNT': '2.040', 'weapon3': '2.644', 'DAMAGECOUNT': '10.038', 'FRAGCOUNT': '32.500'} [2023-02-25 14:01:49,070][36142] DAMAGECOUNT value on done: 697386.0 [2023-02-25 14:01:49,070][36142] Sum rewards: 51.980, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.157', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.172', 'AMMO3': '0.184', 'weapon5': '0.188', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.372', 'weapon4': '0.796', 'WEAPON3': '1.100', 'weapon3': '2.346', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '12.780', 'FRAGCOUNT': '46.000'} [2023-02-25 14:01:49,130][36138] Updated weights for policy 0, policy_version 46483 (0.0009) [2023-02-25 14:01:49,198][36142] DAMAGECOUNT value on done: 678554.0 [2023-02-25 14:01:49,198][36142] Sum rewards: 55.787, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.413', 'AMMO5': '0.017', 'AMMO2': '0.059', 'AMMO3': '0.152', 'weapon2': '0.184', 'weapon5': '0.244', 'AMMO4': '0.295', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'ARMOR': '0.804', 'WEAPON3': '0.850', 'weapon4': '0.900', 'weapon3': '2.350', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '14.115', 'FRAGCOUNT': '46.000'} [2023-02-25 14:01:49,415][36142] DAMAGECOUNT value on done: 681384.0 [2023-02-25 14:01:49,416][36142] Sum rewards: 53.324, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.880', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.098', 'AMMO3': '0.204', 'AMMO4': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.368', 'WEAPON4': '0.600', 'weapon4': '0.872', 'WEAPON3': '1.200', 'weapon3': '2.378', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.216', 'FRAGCOUNT': '48.000'} [2023-02-25 14:01:49,520][36142] DAMAGECOUNT value on done: 693197.0 [2023-02-25 14:01:49,521][36142] Sum rewards: 61.717, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.278', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO5': '0.011', 'AMMO4': '0.044', 'AMMO3': '0.164', 'weapon5': '0.196', 'WEAPON4': '0.200', 'weapon2': '0.228', 'WEAPON5': '0.300', 'weapon4': '0.506', 'WEAPON3': '1.000', 'HITCOUNT': '2.740', 'weapon3': '2.884', 'DAMAGECOUNT': '13.959', 'FRAGCOUNT': '52.000'} [2023-02-25 14:01:49,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13243.7, 300 sec: 13384.9). Total num frames: 190398464. Throughput: 0: 3310.3. Samples: 10097990. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:01:49,730][36114] Avg episode reward: [(0, '55.481')] [2023-02-25 14:01:49,765][36156] DAMAGECOUNT value on done: 695133.0 [2023-02-25 14:01:49,765][36156] Sum rewards: 65.529, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.126', 'AMMO5': '0.007', 'weapon7': '0.036', 'AMMO2': '0.045', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.143', 'WEAPON5': '0.150', 'weapon5': '0.154', 'AMMO4': '0.224', 'weapon2': '0.232', 'WEAPON4': '0.400', 'weapon4': '0.524', 'WEAPON3': '0.900', 'weapon3': '2.760', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.459', 'FRAGCOUNT': '55.000'} [2023-02-25 14:01:49,804][36156] DAMAGECOUNT value on done: 702077.0 [2023-02-25 14:01:49,805][36156] Sum rewards: 55.368, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.898', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.058', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.244', 'weapon4': '0.270', 'AMMO3': '0.287', 'ARMOR': '0.400', 'WEAPON3': '1.800', 'HITCOUNT': '3.150', 'weapon3': '3.178', 'DAMAGECOUNT': '14.970', 'FRAGCOUNT': '51.000'} [2023-02-25 14:01:50,089][36156] DAMAGECOUNT value on done: 686777.0 [2023-02-25 14:01:50,089][36156] Sum rewards: 56.899, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.965', 'AMMO5': '0.012', 'AMMO2': '0.045', 'AMMO3': '0.180', 'weapon5': '0.190', 'AMMO4': '0.226', 'WEAPON5': '0.450', 'ARMOR': '0.452', 'weapon2': '0.472', 'WEAPON4': '0.650', 'weapon4': '0.718', 'WEAPON3': '1.050', 'weapon3': '2.322', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.306', 'FRAGCOUNT': '49.000'} [2023-02-25 14:01:50,130][36156] DAMAGECOUNT value on done: 689290.0 [2023-02-25 14:01:50,130][36156] Sum rewards: 62.948, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.704', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'weapon2': '0.372', 'weapon4': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.908', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '52.000'} [2023-02-25 14:01:52,142][36138] Updated weights for policy 0, policy_version 46493 (0.0009) [2023-02-25 14:01:52,246][36155] DAMAGECOUNT value on done: 679436.0 [2023-02-25 14:01:52,246][36155] Sum rewards: 51.109, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.350', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.154', 'AMMO4': '0.198', 'weapon2': '0.226', 'AMMO3': '0.244', 'weapon4': '0.258', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '2.810', 'weapon3': '3.074', 'DAMAGECOUNT': '14.190', 'FRAGCOUNT': '48.000'} [2023-02-25 14:01:52,561][36155] DAMAGECOUNT value on done: 700929.0 [2023-02-25 14:01:52,562][36155] Sum rewards: 61.073, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.885', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.058', 'weapon5': '0.066', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'weapon4': '0.234', 'weapon2': '0.262', 'WEAPON3': '1.350', 'weapon3': '3.204', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.195', 'FRAGCOUNT': '53.000'} [2023-02-25 14:01:53,124][36155] DAMAGECOUNT value on done: 696573.0 [2023-02-25 14:01:53,124][36155] Sum rewards: 51.409, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.504', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon4': '0.134', 'weapon5': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.257', 'weapon2': '0.356', 'WEAPON3': '1.500', 'HITCOUNT': '2.780', 'weapon3': '3.068', 'DAMAGECOUNT': '14.535', 'FRAGCOUNT': '47.000'} [2023-02-25 14:01:53,437][36155] DAMAGECOUNT value on done: 689126.0 [2023-02-25 14:01:53,437][36155] Sum rewards: 57.487, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.790', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.116', 'AMMO3': '0.160', 'AMMO4': '0.161', 'weapon2': '0.182', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.712', 'WEAPON3': '1.000', 'weapon3': '2.772', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.304', 'FRAGCOUNT': '49.500'} [2023-02-25 14:01:53,930][36139] DAMAGECOUNT value on done: 696145.0 [2023-02-25 14:01:53,931][36139] Sum rewards: 69.027, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.450', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.078', 'weapon5': '0.078', 'weapon2': '0.208', 'AMMO3': '0.235', 'WEAPON3': '1.500', 'HITCOUNT': '3.430', 'weapon3': '3.456', 'DAMAGECOUNT': '16.605', 'FRAGCOUNT': '60.000'} [2023-02-25 14:01:54,238][36139] DAMAGECOUNT value on done: 687447.0 [2023-02-25 14:01:54,239][36139] Sum rewards: 50.172, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-3.020', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon5': '0.140', 'AMMO4': '0.208', 'weapon2': '0.216', 'weapon4': '0.258', 'AMMO3': '0.270', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.016', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '48.000'} [2023-02-25 14:01:54,481][36139] DAMAGECOUNT value on done: 697263.0 [2023-02-25 14:01:54,482][36139] Sum rewards: 56.601, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.200', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon7': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon2': '0.156', 'AMMO3': '0.174', 'WEAPON7': '0.200', 'weapon4': '0.214', 'WEAPON3': '1.000', 'HITCOUNT': '2.740', 'weapon3': '3.378', 'DAMAGECOUNT': '14.154', 'FRAGCOUNT': '47.000'} [2023-02-25 14:01:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13312.0, 300 sec: 13398.8). Total num frames: 190468096. Throughput: 0: 3308.7. Samples: 10108050. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:01:54,730][36114] Avg episode reward: [(0, '55.454')] [2023-02-25 14:01:54,781][36139] DAMAGECOUNT value on done: 691941.0 [2023-02-25 14:01:54,781][36139] Sum rewards: 61.247, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.333', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'weapon4': '0.170', 'AMMO3': '0.212', 'weapon2': '0.774', 'WEAPON3': '1.250', 'weapon3': '2.876', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.613', 'FRAGCOUNT': '52.000'} [2023-02-25 14:01:55,176][36138] Updated weights for policy 0, policy_version 46503 (0.0009) [2023-02-25 14:01:58,258][36138] Updated weights for policy 0, policy_version 46513 (0.0009) [2023-02-25 14:01:59,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13243.7, 300 sec: 13384.9). Total num frames: 190533632. Throughput: 0: 3308.4. Samples: 10128262. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:01:59,730][36114] Avg episode reward: [(0, '55.489')] [2023-02-25 14:02:01,272][36138] Updated weights for policy 0, policy_version 46523 (0.0009) [2023-02-25 14:02:02,004][36156] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:02:03,855][36141] DAMAGECOUNT value on done: 699920.0 [2023-02-25 14:02:03,855][36141] Sum rewards: 42.537, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.650', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.056', 'weapon5': '0.108', 'AMMO3': '0.190', 'AMMO4': '0.282', 'WEAPON5': '0.450', 'weapon2': '0.588', 'WEAPON4': '0.600', 'weapon4': '0.824', 'WEAPON3': '1.150', 'weapon3': '2.106', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '12.033', 'FRAGCOUNT': '40.000'} [2023-02-25 14:02:03,920][36154] DAMAGECOUNT value on done: 694334.0 [2023-02-25 14:02:03,920][36154] Sum rewards: 58.215, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.791', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.134', 'AMMO4': '0.155', 'AMMO3': '0.224', 'weapon2': '0.230', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.580', 'WEAPON3': '1.300', 'weapon3': '2.786', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.712', 'FRAGCOUNT': '52.000'} [2023-02-25 14:02:04,171][36141] DAMAGECOUNT value on done: 696011.0 [2023-02-25 14:02:04,172][36141] Sum rewards: 36.911, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.022', 'AMMO5': '0.017', 'AMMO2': '0.056', 'weapon7': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.157', 'weapon5': '0.238', 'AMMO4': '0.279', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.528', 'WEAPON3': '0.950', 'weapon4': '1.112', 'weapon3': '1.648', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '11.778', 'FRAGCOUNT': '32.000'} [2023-02-25 14:02:04,235][36154] DAMAGECOUNT value on done: 683434.0 [2023-02-25 14:02:04,235][36154] Sum rewards: 51.202, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.160', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon5': '0.102', 'AMMO3': '0.159', 'AMMO4': '0.177', 'WEAPON5': '0.350', 'weapon2': '0.364', 'WEAPON4': '0.450', 'weapon4': '0.614', 'WEAPON3': '1.050', 'weapon3': '2.642', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.884', 'FRAGCOUNT': '44.000'} [2023-02-25 14:02:04,271][36141] DAMAGECOUNT value on done: 692588.0 [2023-02-25 14:02:04,272][36141] Sum rewards: 55.391, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.042', 'weapon7': '0.002', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.061', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.201', 'weapon5': '0.202', 'weapon2': '0.222', 'AMMO4': '0.303', 'WEAPON5': '0.400', 'weapon4': '0.488', 'WEAPON4': '0.700', 'WEAPON3': '1.100', 'weapon3': '2.728', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '14.880', 'FRAGCOUNT': '51.000'} [2023-02-25 14:02:04,335][36138] Updated weights for policy 0, policy_version 46533 (0.0009) [2023-02-25 14:02:04,525][36154] DAMAGECOUNT value on done: 694757.0 [2023-02-25 14:02:04,526][36154] Sum rewards: 62.895, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.664', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.066', 'weapon5': '0.102', 'AMMO4': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.160', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.707', 'FRAGCOUNT': '56.000'} [2023-02-25 14:02:04,593][36141] DAMAGECOUNT value on done: 687251.0 [2023-02-25 14:02:04,593][36141] Sum rewards: 63.849, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.704', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'weapon5': '0.112', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon2': '0.410', 'weapon4': '0.606', 'WEAPON3': '1.150', 'weapon3': '2.586', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '53.000'} [2023-02-25 14:02:04,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13312.0, 300 sec: 13398.8). Total num frames: 190603264. Throughput: 0: 3308.7. Samples: 10148498. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:02:04,730][36114] Avg episode reward: [(0, '55.164')] [2023-02-25 14:02:04,840][36154] DAMAGECOUNT value on done: 696981.0 [2023-02-25 14:02:04,841][36154] Sum rewards: 49.977, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.450', 'AMMO5': '0.021', 'AMMO2': '0.076', 'AMMO3': '0.161', 'weapon5': '0.258', 'weapon2': '0.294', 'AMMO4': '0.382', 'ARMOR': '0.412', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '0.950', 'weapon4': '1.042', 'weapon3': '1.834', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.797', 'FRAGCOUNT': '44.000'} [2023-02-25 14:02:05,455][36140] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:02:05,511][36157] DAMAGECOUNT value on done: 702461.0 [2023-02-25 14:02:05,511][36157] Sum rewards: 53.871, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.910', 'AMMO5': '0.022', 'AMMO2': '0.045', 'AMMO3': '0.148', 'AMMO4': '0.226', 'weapon5': '0.332', 'weapon2': '0.536', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon4': '0.768', 'WEAPON3': '1.000', 'weapon3': '2.062', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.811', 'FRAGCOUNT': '46.000'} [2023-02-25 14:02:05,797][36157] DAMAGECOUNT value on done: 693488.0 [2023-02-25 14:02:05,798][36157] Sum rewards: 50.782, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.752', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.146', 'AMMO4': '0.165', 'weapon2': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.274', 'AMMO3': '0.279', 'WEAPON3': '1.550', 'HITCOUNT': '2.560', 'weapon3': '3.068', 'DAMAGECOUNT': '13.557', 'FRAGCOUNT': '49.000'} [2023-02-25 14:02:06,495][36157] DAMAGECOUNT value on done: 702185.0 [2023-02-25 14:02:06,495][36157] Sum rewards: 56.655, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.820', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.043', 'weapon5': '0.176', 'AMMO3': '0.205', 'AMMO4': '0.212', 'weapon2': '0.252', 'weapon4': '0.340', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.888', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.916', 'FRAGCOUNT': '51.000'} [2023-02-25 14:02:06,522][36140] DAMAGECOUNT value on done: 703422.0 [2023-02-25 14:02:06,522][36140] Sum rewards: 64.329, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.695', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'weapon4': '0.148', 'AMMO3': '0.199', 'weapon2': '0.410', 'WEAPON3': '1.250', 'weapon3': '3.168', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '54.000'} [2023-02-25 14:02:06,798][36157] DAMAGECOUNT value on done: 698546.0 [2023-02-25 14:02:06,799][36157] Sum rewards: 60.237, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.525', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.062', 'weapon7': '0.064', 'AMMO4': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.218', 'weapon4': '0.596', 'WEAPON3': '1.200', 'weapon3': '2.820', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.834', 'FRAGCOUNT': '49.000'} [2023-02-25 14:02:06,825][36140] DAMAGECOUNT value on done: 683362.0 [2023-02-25 14:02:06,825][36140] Sum rewards: 38.331, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.130', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.024', 'weapon7': '0.076', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO3': '0.169', 'WEAPON7': '0.200', 'weapon2': '0.348', 'WEAPON4': '0.350', 'weapon4': '0.702', 'WEAPON3': '1.000', 'weapon3': '2.428', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '11.208', 'FRAGCOUNT': '34.500'} [2023-02-25 14:02:07,116][36140] DAMAGECOUNT value on done: 693043.0 [2023-02-25 14:02:07,117][36140] Sum rewards: 58.722, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.244', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.106', 'AMMO4': '0.194', 'AMMO3': '0.213', 'weapon4': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.536', 'WEAPON3': '1.250', 'weapon3': '2.830', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.165', 'FRAGCOUNT': '51.500'} [2023-02-25 14:02:07,358][36138] Updated weights for policy 0, policy_version 46543 (0.0009) [2023-02-25 14:02:07,421][36140] DAMAGECOUNT value on done: 691455.0 [2023-02-25 14:02:07,422][36140] Sum rewards: 56.212, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.443', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon7': '0.100', 'weapon5': '0.138', 'AMMO3': '0.161', 'AMMO4': '0.175', 'weapon2': '0.276', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.456', 'WEAPON3': '1.000', 'weapon3': '2.642', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.610', 'FRAGCOUNT': '47.500'} [2023-02-25 14:02:09,216][36142] DAMAGECOUNT value on done: 702257.0 [2023-02-25 14:02:09,217][36142] Sum rewards: 53.830, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.270', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.090', 'AMMO4': '0.193', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon2': '0.246', 'WEAPON4': '0.400', 'ARMOR': '0.404', 'weapon4': '0.666', 'WEAPON3': '1.400', 'weapon3': '2.690', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.613', 'FRAGCOUNT': '49.000'} [2023-02-25 14:02:09,329][36142] DAMAGECOUNT value on done: 683845.0 [2023-02-25 14:02:09,330][36142] Sum rewards: 63.493, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.847', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.106', 'weapon4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon2': '0.316', 'WEAPON3': '1.450', 'weapon3': '3.168', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.873', 'FRAGCOUNT': '56.000'} [2023-02-25 14:02:09,534][36142] DAMAGECOUNT value on done: 686122.0 [2023-02-25 14:02:09,535][36142] Sum rewards: 59.753, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.496', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.154', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.376', 'weapon4': '0.410', 'WEAPON3': '1.050', 'weapon3': '2.452', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.214', 'FRAGCOUNT': '51.000'} [2023-02-25 14:02:09,628][36142] DAMAGECOUNT value on done: 698700.0 [2023-02-25 14:02:09,629][36142] Sum rewards: 71.566, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.245', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'WEAPON4': '0.200', 'weapon4': '0.206', 'AMMO3': '0.223', 'weapon2': '0.352', 'WEAPON3': '1.400', 'weapon3': '3.284', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '63.000'} [2023-02-25 14:02:09,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13312.0, 300 sec: 13398.8). Total num frames: 190668800. Throughput: 0: 3310.7. Samples: 10158616. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:02:09,729][36114] Avg episode reward: [(0, '54.914')] [2023-02-25 14:02:09,738][36156] DAMAGECOUNT value on done: 701196.0 [2023-02-25 14:02:09,739][36156] Sum rewards: 73.586, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.487', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'AMMO4': '0.212', 'weapon2': '0.242', 'WEAPON4': '0.350', 'weapon4': '0.462', 'WEAPON3': '1.300', 'weapon3': '2.994', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '63.000'} [2023-02-25 14:02:09,786][36156] DAMAGECOUNT value on done: 706963.0 [2023-02-25 14:02:09,786][36156] Sum rewards: 58.460, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.852', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.044', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'weapon4': '0.166', 'weapon2': '0.204', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.310', 'weapon3': '3.376', 'DAMAGECOUNT': '14.658', 'FRAGCOUNT': '53.000'} [2023-02-25 14:02:10,070][36156] DAMAGECOUNT value on done: 691519.0 [2023-02-25 14:02:10,070][36156] Sum rewards: 56.300, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.600', 'AMMO5': '0.016', 'AMMO2': '0.073', 'weapon5': '0.098', 'AMMO3': '0.176', 'weapon2': '0.244', 'WEAPON5': '0.350', 'AMMO4': '0.364', 'WEAPON4': '0.600', 'weapon4': '0.636', 'WEAPON3': '1.000', 'weapon3': '2.782', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.121', 'FRAGCOUNT': '50.000'} [2023-02-25 14:02:10,109][36156] DAMAGECOUNT value on done: 694028.0 [2023-02-25 14:02:10,110][36156] Sum rewards: 52.893, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.556', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'weapon5': '0.066', 'WEAPON4': '0.100', 'weapon2': '0.226', 'weapon4': '0.234', 'AMMO3': '0.302', 'WEAPON3': '1.750', 'HITCOUNT': '2.820', 'weapon3': '3.120', 'DAMAGECOUNT': '14.214', 'FRAGCOUNT': '49.000'} [2023-02-25 14:02:10,383][36138] Updated weights for policy 0, policy_version 46553 (0.0009) [2023-02-25 14:02:11,950][36155] DAMAGECOUNT value on done: 683668.0 [2023-02-25 14:02:11,950][36155] Sum rewards: 47.507, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.786', 'AMMO5': '0.019', 'AMMO2': '0.020', 'weapon4': '0.068', 'AMMO4': '0.099', 'weapon5': '0.106', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'weapon2': '0.472', 'WEAPON3': '1.150', 'HITCOUNT': '2.790', 'weapon3': '3.090', 'DAMAGECOUNT': '12.696', 'FRAGCOUNT': '40.000'} [2023-02-25 14:02:12,262][36155] DAMAGECOUNT value on done: 705298.0 [2023-02-25 14:02:12,263][36155] Sum rewards: 45.467, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.022', 'ARMOR': '0.004', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.053', 'AMMO3': '0.142', 'weapon5': '0.252', 'AMMO4': '0.263', 'WEAPON5': '0.450', 'weapon2': '0.458', 'WEAPON4': '0.500', 'weapon4': '0.660', 'WEAPON3': '0.800', 'weapon3': '2.108', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '13.092', 'FRAGCOUNT': '38.500'} [2023-02-25 14:02:12,824][36155] DAMAGECOUNT value on done: 701591.0 [2023-02-25 14:02:12,824][36155] Sum rewards: 56.914, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.780', 'AMMO5': '0.020', 'AMMO2': '0.031', 'AMMO3': '0.142', 'AMMO4': '0.157', 'weapon5': '0.254', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.534', 'weapon2': '0.650', 'WEAPON3': '0.850', 'weapon3': '2.272', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.054', 'FRAGCOUNT': '46.000'} [2023-02-25 14:02:13,121][36155] DAMAGECOUNT value on done: 694185.0 [2023-02-25 14:02:13,121][36155] Sum rewards: 56.516, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.805', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.046', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.208', 'AMMO3': '0.243', 'weapon2': '0.268', 'WEAPON3': '1.500', 'HITCOUNT': '3.120', 'weapon3': '3.234', 'DAMAGECOUNT': '15.177', 'FRAGCOUNT': '50.000'} [2023-02-25 14:02:13,441][36138] Updated weights for policy 0, policy_version 46563 (0.0009) [2023-02-25 14:02:13,748][36139] DAMAGECOUNT value on done: 700416.0 [2023-02-25 14:02:13,749][36139] Sum rewards: 50.343, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.724', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon7': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO3': '0.159', 'WEAPON7': '0.200', 'AMMO4': '0.206', 'weapon2': '0.226', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'weapon4': '0.982', 'weapon3': '2.322', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.813', 'FRAGCOUNT': '43.000'} [2023-02-25 14:02:14,062][36139] DAMAGECOUNT value on done: 692698.0 [2023-02-25 14:02:14,063][36139] Sum rewards: 61.038, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.486', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.080', 'AMMO4': '0.142', 'weapon5': '0.144', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'WEAPON5': '0.300', 'weapon2': '0.440', 'WEAPON3': '1.450', 'weapon3': '3.120', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '53.000'} [2023-02-25 14:02:14,338][36139] DAMAGECOUNT value on done: 702083.0 [2023-02-25 14:02:14,338][36139] Sum rewards: 52.976, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.672', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.054', 'AMMO3': '0.182', 'weapon5': '0.188', 'AMMO4': '0.270', 'WEAPON5': '0.350', 'weapon2': '0.412', 'WEAPON4': '0.750', 'weapon4': '0.940', 'WEAPON3': '1.000', 'weapon3': '2.134', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.460', 'FRAGCOUNT': '47.000'} [2023-02-25 14:02:14,636][36139] DAMAGECOUNT value on done: 696918.0 [2023-02-25 14:02:14,636][36139] Sum rewards: 59.515, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.051', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon7': '0.048', 'AMMO3': '0.139', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon5': '0.180', 'WEAPON7': '0.200', 'AMMO4': '0.208', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON4': '0.500', 'WEAPON3': '0.850', 'weapon4': '0.930', 'weapon3': '2.230', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.931', 'FRAGCOUNT': '49.000'} [2023-02-25 14:02:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13312.0, 300 sec: 13398.8). Total num frames: 190738432. Throughput: 0: 3314.5. Samples: 10178906. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:02:14,730][36114] Avg episode reward: [(0, '55.031')] [2023-02-25 14:02:16,479][36138] Updated weights for policy 0, policy_version 46573 (0.0009) [2023-02-25 14:02:19,574][36138] Updated weights for policy 0, policy_version 46583 (0.0009) [2023-02-25 14:02:19,729][36114] Fps is (10 sec: 13516.6, 60 sec: 13312.0, 300 sec: 13398.8). Total num frames: 190803968. Throughput: 0: 3343.9. Samples: 10198882. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:02:19,730][36114] Avg episode reward: [(0, '55.031')] [2023-02-25 14:02:21,080][36142] Large shaping reward 2.613 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.009000000000000001, -3.0), ('weapon5', 0.002)] [2023-02-25 14:02:22,596][36138] Updated weights for policy 0, policy_version 46593 (0.0009) [2023-02-25 14:02:23,052][36142] Large shaping reward 2.535 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.513, 171.0), ('weapon5', 0.002)] [2023-02-25 14:02:23,877][36154] DAMAGECOUNT value on done: 699376.0 [2023-02-25 14:02:23,877][36154] Sum rewards: 61.629, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.270', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.092', 'weapon5': '0.106', 'weapon4': '0.152', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.274', 'WEAPON3': '1.100', 'HITCOUNT': '3.020', 'weapon3': '3.170', 'DAMAGECOUNT': '15.126', 'FRAGCOUNT': '52.000'} [2023-02-25 14:02:23,918][36141] DAMAGECOUNT value on done: 705345.0 [2023-02-25 14:02:23,918][36141] Sum rewards: 62.847, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.315', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'weapon5': '0.166', 'weapon2': '0.172', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'weapon4': '0.376', 'WEAPON3': '1.350', 'weapon3': '2.952', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '55.000'} [2023-02-25 14:02:24,190][36154] DAMAGECOUNT value on done: 687885.0 [2023-02-25 14:02:24,191][36154] Sum rewards: 48.022, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.098', 'weapon5': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.328', 'weapon4': '0.494', 'WEAPON3': '1.100', 'HITCOUNT': '2.880', 'weapon3': '2.908', 'DAMAGECOUNT': '13.353', 'FRAGCOUNT': '40.000'} [2023-02-25 14:02:24,238][36141] DAMAGECOUNT value on done: 699810.0 [2023-02-25 14:02:24,239][36141] Sum rewards: 45.083, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.966', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'weapon2': '0.272', 'weapon4': '0.480', 'WEAPON3': '1.300', 'weapon3': '2.522', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '11.397', 'FRAGCOUNT': '41.000'} [2023-02-25 14:02:24,334][36141] DAMAGECOUNT value on done: 696774.0 [2023-02-25 14:02:24,335][36141] Sum rewards: 50.986, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.574', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'ARMOR': '0.488', 'weapon4': '0.526', 'weapon2': '0.670', 'WEAPON3': '1.050', 'weapon3': '2.516', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.558', 'FRAGCOUNT': '41.000'} [2023-02-25 14:02:24,504][36154] DAMAGECOUNT value on done: 698662.0 [2023-02-25 14:02:24,504][36154] Sum rewards: 44.211, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.617', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.142', 'AMMO3': '0.188', 'weapon5': '0.192', 'weapon2': '0.266', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.402', 'WEAPON3': '1.150', 'HITCOUNT': '2.530', 'weapon3': '2.750', 'DAMAGECOUNT': '11.715', 'FRAGCOUNT': '41.000'} [2023-02-25 14:02:24,653][36141] DAMAGECOUNT value on done: 692238.0 [2023-02-25 14:02:24,653][36141] Sum rewards: 49.327, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.548', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon5': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.252', 'AMMO3': '0.272', 'weapon2': '0.318', 'WEAPON3': '1.600', 'HITCOUNT': '2.950', 'weapon3': '3.034', 'DAMAGECOUNT': '14.961', 'FRAGCOUNT': '46.000'} [2023-02-25 14:02:24,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13243.7, 300 sec: 13398.8). Total num frames: 190869504. Throughput: 0: 3357.0. Samples: 10208994. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:02:24,730][36114] Avg episode reward: [(0, '54.714')] [2023-02-25 14:02:24,813][36154] DAMAGECOUNT value on done: 701292.0 [2023-02-25 14:02:24,813][36154] Sum rewards: 57.196, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.262', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.056', 'AMMO4': '0.145', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.394', 'weapon4': '0.482', 'WEAPON3': '1.000', 'weapon3': '2.772', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '12.933', 'FRAGCOUNT': '49.000'} [2023-02-25 14:02:25,589][36157] DAMAGECOUNT value on done: 706963.0 [2023-02-25 14:02:25,590][36157] Sum rewards: 48.268, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.528', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.142', 'AMMO4': '0.189', 'AMMO3': '0.242', 'weapon2': '0.260', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.588', 'WEAPON3': '1.400', 'weapon3': '2.588', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.506', 'FRAGCOUNT': '44.000'} [2023-02-25 14:02:25,671][36138] Updated weights for policy 0, policy_version 46603 (0.0009) [2023-02-25 14:02:25,909][36157] DAMAGECOUNT value on done: 699229.0 [2023-02-25 14:02:25,909][36157] Sum rewards: 65.237, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.471', 'AMMO5': '0.020', 'AMMO2': '0.057', 'weapon2': '0.196', 'AMMO3': '0.203', 'weapon5': '0.234', 'AMMO4': '0.283', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'weapon4': '0.586', 'WEAPON3': '1.150', 'weapon3': '2.616', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.223', 'FRAGCOUNT': '55.500'} [2023-02-25 14:02:26,574][36140] DAMAGECOUNT value on done: 707393.0 [2023-02-25 14:02:26,574][36140] Sum rewards: 44.626, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.830', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon5': '0.050', 'AMMO3': '0.208', 'AMMO4': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.456', 'weapon4': '0.528', 'WEAPON3': '1.300', 'HITCOUNT': '2.540', 'weapon3': '2.596', 'DAMAGECOUNT': '11.913', 'FRAGCOUNT': '42.000'} [2023-02-25 14:02:26,665][36157] DAMAGECOUNT value on done: 707178.0 [2023-02-25 14:02:26,666][36157] Sum rewards: 56.010, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.600', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.116', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'weapon2': '0.250', 'weapon4': '0.462', 'WEAPON3': '1.200', 'weapon3': '2.782', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.979', 'FRAGCOUNT': '48.000'} [2023-02-25 14:02:26,887][36140] DAMAGECOUNT value on done: 687589.0 [2023-02-25 14:02:26,887][36140] Sum rewards: 52.473, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.512', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.086', 'AMMO3': '0.125', 'AMMO4': '0.147', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.502', 'WEAPON3': '0.650', 'weapon4': '0.744', 'weapon3': '2.454', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '12.681', 'FRAGCOUNT': '43.000'} [2023-02-25 14:02:26,969][36157] DAMAGECOUNT value on done: 703990.0 [2023-02-25 14:02:26,970][36157] Sum rewards: 63.159, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.232', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.096', 'weapon2': '0.168', 'AMMO3': '0.169', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.538', 'WEAPON3': '1.150', 'weapon3': '2.896', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.332', 'FRAGCOUNT': '52.000'} [2023-02-25 14:02:27,165][36140] DAMAGECOUNT value on done: 698075.0 [2023-02-25 14:02:27,166][36140] Sum rewards: 52.400, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.253', 'AMMO5': '0.015', 'AMMO2': '0.026', 'weapon5': '0.102', 'AMMO4': '0.130', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon4': '0.290', 'WEAPON5': '0.300', 'weapon2': '0.542', 'WEAPON3': '1.250', 'weapon3': '2.800', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '15.096', 'FRAGCOUNT': '45.500'} [2023-02-25 14:02:27,503][36140] DAMAGECOUNT value on done: 696434.0 [2023-02-25 14:02:27,504][36140] Sum rewards: 59.941, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.004', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.110', 'AMMO4': '0.139', 'AMMO3': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'weapon2': '0.394', 'weapon4': '0.710', 'WEAPON3': '0.900', 'weapon3': '2.572', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.937', 'FRAGCOUNT': '51.000'} [2023-02-25 14:02:28,728][36138] Updated weights for policy 0, policy_version 46613 (0.0010) [2023-02-25 14:02:29,200][36142] DAMAGECOUNT value on done: 707891.0 [2023-02-25 14:02:29,201][36142] Sum rewards: 66.397, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.040', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'AMMO3': '0.203', 'weapon2': '0.236', 'weapon4': '0.494', 'WEAPON3': '1.350', 'weapon3': '3.116', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.902', 'FRAGCOUNT': '56.000'} [2023-02-25 14:02:29,329][36142] DAMAGECOUNT value on done: 689235.0 [2023-02-25 14:02:29,329][36142] Sum rewards: 61.836, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.562', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.175', 'AMMO3': '0.209', 'weapon2': '0.212', 'WEAPON5': '0.250', 'weapon5': '0.274', 'WEAPON4': '0.300', 'weapon4': '0.912', 'WEAPON3': '1.150', 'weapon3': '2.268', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.113', 'FRAGCOUNT': '52.000'} [2023-02-25 14:02:29,507][36142] DAMAGECOUNT value on done: 690755.0 [2023-02-25 14:02:29,508][36142] Sum rewards: 54.459, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.028', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'weapon4': '0.132', 'AMMO3': '0.169', 'HEALTH': '0.454', 'weapon2': '0.594', 'WEAPON3': '0.950', 'HITCOUNT': '2.900', 'weapon3': '3.056', 'DAMAGECOUNT': '13.899', 'FRAGCOUNT': '44.000'} [2023-02-25 14:02:29,634][36142] DAMAGECOUNT value on done: 704137.0 [2023-02-25 14:02:29,634][36142] Sum rewards: 68.452, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.290', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'weapon5': '0.150', 'weapon4': '0.178', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.544', 'WEAPON3': '1.350', 'weapon3': '2.888', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '58.000'} [2023-02-25 14:02:29,729][36114] Fps is (10 sec: 13517.0, 60 sec: 13312.0, 300 sec: 13398.8). Total num frames: 190939136. Throughput: 0: 3362.1. Samples: 10229084. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:02:29,729][36114] Avg episode reward: [(0, '55.363')] [2023-02-25 14:02:29,874][36156] DAMAGECOUNT value on done: 706589.0 [2023-02-25 14:02:29,874][36156] Sum rewards: 59.373, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.694', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.130', 'AMMO4': '0.143', 'AMMO3': '0.247', 'weapon4': '0.258', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.500', 'weapon3': '2.962', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '52.000'} [2023-02-25 14:02:29,937][36156] DAMAGECOUNT value on done: 711050.0 [2023-02-25 14:02:29,938][36156] Sum rewards: 40.715, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.284', 'AMMO5': '0.013', 'AMMO2': '0.060', 'AMMO3': '0.170', 'weapon5': '0.204', 'WEAPON5': '0.300', 'AMMO4': '0.300', 'weapon2': '0.366', 'WEAPON4': '0.550', 'weapon4': '0.772', 'WEAPON3': '1.050', 'HITCOUNT': '2.340', 'weapon3': '2.362', 'DAMAGECOUNT': '12.261', 'FRAGCOUNT': '38.000'} [2023-02-25 14:02:30,192][36156] DAMAGECOUNT value on done: 695628.0 [2023-02-25 14:02:30,192][36156] Sum rewards: 46.689, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.074', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.086', 'AMMO4': '0.173', 'AMMO3': '0.199', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.498', 'weapon4': '0.516', 'WEAPON3': '1.250', 'HITCOUNT': '2.550', 'weapon3': '2.716', 'DAMAGECOUNT': '12.327', 'FRAGCOUNT': '43.000'} [2023-02-25 14:02:30,259][36156] DAMAGECOUNT value on done: 698957.0 [2023-02-25 14:02:30,260][36156] Sum rewards: 58.080, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.007', 'HEALTH': '0.018', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.158', 'weapon5': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.294', 'weapon2': '0.478', 'WEAPON3': '0.900', 'weapon3': '2.850', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.487', 'FRAGCOUNT': '48.000'} [2023-02-25 14:02:31,387][36142] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:02:31,782][36138] Updated weights for policy 0, policy_version 46623 (0.0010) [2023-02-25 14:02:31,930][36155] DAMAGECOUNT value on done: 689088.0 [2023-02-25 14:02:31,930][36155] Sum rewards: 62.474, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.442', 'AMMO2': '0.024', 'weapon4': '0.080', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.254', 'weapon2': '0.266', 'WEAPON3': '1.550', 'weapon3': '3.470', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '55.000'} [2023-02-25 14:02:32,258][36155] DAMAGECOUNT value on done: 709956.0 [2023-02-25 14:02:32,258][36155] Sum rewards: 50.048, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.298', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.140', 'weapon4': '0.162', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.450', 'HITCOUNT': '3.050', 'weapon3': '3.166', 'DAMAGECOUNT': '13.974', 'FRAGCOUNT': '46.000'} [2023-02-25 14:02:32,822][36155] DAMAGECOUNT value on done: 706663.0 [2023-02-25 14:02:32,823][36155] Sum rewards: 55.690, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.160', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.194', 'AMMO3': '0.262', 'WEAPON4': '0.300', 'weapon4': '0.342', 'WEAPON5': '0.400', 'weapon2': '0.486', 'WEAPON3': '1.550', 'weapon3': '2.670', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.216', 'FRAGCOUNT': '50.000'} [2023-02-25 14:02:33,131][36155] DAMAGECOUNT value on done: 698050.0 [2023-02-25 14:02:33,131][36155] Sum rewards: 41.044, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.460', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.197', 'WEAPON4': '0.350', 'weapon2': '0.680', 'weapon4': '0.920', 'WEAPON3': '1.100', 'weapon3': '2.116', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '11.595', 'FRAGCOUNT': '37.000'} [2023-02-25 14:02:33,676][36139] DAMAGECOUNT value on done: 704373.0 [2023-02-25 14:02:33,677][36139] Sum rewards: 46.106, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.945', 'ARMOR': '0.008', 'AMMO5': '0.021', 'AMMO2': '0.048', 'weapon5': '0.106', 'AMMO3': '0.169', 'weapon2': '0.202', 'AMMO4': '0.240', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.904', 'WEAPON3': '1.100', 'weapon3': '2.492', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '11.871', 'FRAGCOUNT': '41.000'} [2023-02-25 14:02:33,987][36139] DAMAGECOUNT value on done: 697950.0 [2023-02-25 14:02:33,988][36139] Sum rewards: 58.900, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.978', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon5': '0.150', 'AMMO4': '0.178', 'AMMO3': '0.252', 'weapon4': '0.256', 'weapon2': '0.336', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.930', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '53.000'} [2023-02-25 14:02:34,272][36139] DAMAGECOUNT value on done: 707248.0 [2023-02-25 14:02:34,273][36139] Sum rewards: 52.553, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.197', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.179', 'weapon2': '0.200', 'AMMO3': '0.271', 'WEAPON4': '0.350', 'weapon4': '0.790', 'WEAPON3': '1.600', 'weapon3': '2.670', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '47.000'} [2023-02-25 14:02:34,578][36139] DAMAGECOUNT value on done: 701286.0 [2023-02-25 14:02:34,578][36139] Sum rewards: 50.090, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '0.007', 'AMMO5': '0.008', 'AMMO2': '0.046', 'AMMO3': '0.132', 'weapon5': '0.132', 'AMMO4': '0.230', 'WEAPON5': '0.250', 'weapon2': '0.422', 'weapon4': '0.486', 'WEAPON4': '0.500', 'WEAPON3': '0.750', 'weapon3': '2.684', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.702', 'FRAGCOUNT': '41.000'} [2023-02-25 14:02:34,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 191004672. Throughput: 0: 3361.1. Samples: 10249240. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:02:34,730][36114] Avg episode reward: [(0, '54.958')] [2023-02-25 14:02:34,833][36138] Updated weights for policy 0, policy_version 46633 (0.0009) [2023-02-25 14:02:37,878][36138] Updated weights for policy 0, policy_version 46643 (0.0010) [2023-02-25 14:02:39,729][36114] Fps is (10 sec: 13516.6, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 191074304. Throughput: 0: 3360.7. Samples: 10259280. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:02:39,730][36114] Avg episode reward: [(0, '54.958')] [2023-02-25 14:02:40,929][36138] Updated weights for policy 0, policy_version 46653 (0.0010) [2023-02-25 14:02:44,000][36154] DAMAGECOUNT value on done: 704746.0 [2023-02-25 14:02:44,001][36154] Sum rewards: 62.032, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.310', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.043', 'weapon5': '0.118', 'weapon2': '0.196', 'AMMO4': '0.214', 'AMMO3': '0.272', 'WEAPON5': '0.300', 'weapon4': '0.322', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.074', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '57.000'} [2023-02-25 14:02:44,002][36138] Updated weights for policy 0, policy_version 46663 (0.0010) [2023-02-25 14:02:44,034][36141] DAMAGECOUNT value on done: 710803.0 [2023-02-25 14:02:44,035][36141] Sum rewards: 62.235, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.698', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon5': '0.166', 'AMMO3': '0.228', 'weapon2': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.438', 'WEAPON3': '1.300', 'weapon3': '2.854', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.374', 'FRAGCOUNT': '54.000'} [2023-02-25 14:02:44,330][36154] DAMAGECOUNT value on done: 693641.0 [2023-02-25 14:02:44,330][36154] Sum rewards: 63.627, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.382', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon2': '0.200', 'AMMO3': '0.220', 'weapon5': '0.220', 'AMMO4': '0.220', 'WEAPON5': '0.300', 'WEAPON4': '0.600', 'weapon4': '0.652', 'WEAPON3': '1.300', 'weapon3': '2.630', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '56.000'} [2023-02-25 14:02:44,352][36141] DAMAGECOUNT value on done: 705362.0 [2023-02-25 14:02:44,352][36141] Sum rewards: 61.041, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.079', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon4': '0.164', 'weapon5': '0.192', 'AMMO3': '0.209', 'AMMO4': '0.239', 'weapon2': '0.304', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.990', 'weapon3': '3.110', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '54.000'} [2023-02-25 14:02:44,470][36141] DAMAGECOUNT value on done: 701769.0 [2023-02-25 14:02:44,470][36141] Sum rewards: 51.953, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.340', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon5': '0.204', 'AMMO3': '0.218', 'weapon2': '0.254', 'AMMO4': '0.265', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.750', 'WEAPON3': '1.300', 'weapon3': '2.448', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.985', 'FRAGCOUNT': '48.000'} [2023-02-25 14:02:44,651][36154] DAMAGECOUNT value on done: 703280.0 [2023-02-25 14:02:44,652][36154] Sum rewards: 55.555, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.610', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.022', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon4': '0.132', 'AMMO3': '0.210', 'weapon2': '0.430', 'WEAPON3': '1.300', 'HITCOUNT': '2.920', 'weapon3': '3.092', 'DAMAGECOUNT': '13.854', 'FRAGCOUNT': '47.000'} [2023-02-25 14:02:44,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 191139840. Throughput: 0: 3360.7. Samples: 10279492. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:02:44,730][36114] Avg episode reward: [(0, '55.214')] [2023-02-25 14:02:44,794][36141] DAMAGECOUNT value on done: 697406.0 [2023-02-25 14:02:44,795][36141] Sum rewards: 60.926, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.070', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.030', 'WEAPON5': '0.100', 'weapon2': '0.120', 'AMMO3': '0.275', 'WEAPON3': '1.600', 'HITCOUNT': '3.200', 'weapon3': '3.632', 'DAMAGECOUNT': '15.504', 'FRAGCOUNT': '54.000'} [2023-02-25 14:02:44,971][36154] DAMAGECOUNT value on done: 705276.0 [2023-02-25 14:02:44,972][36154] Sum rewards: 43.012, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.232', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.104', 'AMMO3': '0.167', 'AMMO4': '0.220', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.590', 'weapon4': '0.614', 'WEAPON3': '0.900', 'weapon3': '2.456', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '11.952', 'FRAGCOUNT': '38.000'} [2023-02-25 14:02:45,542][36157] DAMAGECOUNT value on done: 711989.0 [2023-02-25 14:02:45,542][36157] Sum rewards: 49.442, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.914', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon5': '0.220', 'AMMO3': '0.229', 'AMMO4': '0.251', 'weapon2': '0.306', 'WEAPON5': '0.400', 'weapon4': '0.468', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.662', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.853', 'FRAGCOUNT': '44.500'} [2023-02-25 14:02:45,847][36157] DAMAGECOUNT value on done: 703995.0 [2023-02-25 14:02:45,847][36157] Sum rewards: 62.264, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.765', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon5': '0.072', 'AMMO3': '0.135', 'AMMO4': '0.228', 'weapon2': '0.268', 'WEAPON5': '0.350', 'WEAPON4': '0.700', 'weapon4': '0.876', 'WEAPON3': '0.900', 'weapon3': '2.538', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.298', 'FRAGCOUNT': '54.000'} [2023-02-25 14:02:46,556][36157] DAMAGECOUNT value on done: 711731.0 [2023-02-25 14:02:46,557][36157] Sum rewards: 53.076, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.970', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.032', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.102', 'AMMO3': '0.214', 'weapon2': '0.262', 'WEAPON3': '1.350', 'HITCOUNT': '3.240', 'weapon3': '3.476', 'DAMAGECOUNT': '13.659', 'FRAGCOUNT': '46.000'} [2023-02-25 14:02:46,634][36140] DAMAGECOUNT value on done: 711928.0 [2023-02-25 14:02:46,634][36140] Sum rewards: 52.565, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.040', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.072', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'weapon4': '0.184', 'WEAPON5': '0.200', 'weapon2': '0.646', 'WEAPON3': '1.050', 'weapon3': '2.874', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.605', 'FRAGCOUNT': '43.000'} [2023-02-25 14:02:46,862][36157] DAMAGECOUNT value on done: 708902.0 [2023-02-25 14:02:46,862][36157] Sum rewards: 55.613, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.175', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon5': '0.110', 'AMMO4': '0.162', 'AMMO3': '0.180', 'weapon4': '0.218', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.830', 'weapon3': '3.128', 'DAMAGECOUNT': '14.706', 'FRAGCOUNT': '48.500'} [2023-02-25 14:02:46,945][36140] DAMAGECOUNT value on done: 692783.0 [2023-02-25 14:02:46,945][36140] Sum rewards: 60.282, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.851', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.064', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.202', 'AMMO3': '0.216', 'weapon2': '0.496', 'WEAPON3': '1.350', 'weapon3': '3.024', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.582', 'FRAGCOUNT': '52.000'} [2023-02-25 14:02:47,035][36138] Updated weights for policy 0, policy_version 46673 (0.0009) [2023-02-25 14:02:47,255][36140] DAMAGECOUNT value on done: 704087.0 [2023-02-25 14:02:47,255][36140] Sum rewards: 70.877, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.245', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.140', 'AMMO4': '0.189', 'weapon2': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon4': '0.462', 'WEAPON3': '1.250', 'weapon3': '2.804', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '59.000'} [2023-02-25 14:02:47,570][36140] DAMAGECOUNT value on done: 701128.0 [2023-02-25 14:02:47,570][36140] Sum rewards: 54.994, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.820', 'AMMO5': '0.015', 'AMMO2': '0.023', 'AMMO4': '0.112', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'weapon5': '0.222', 'WEAPON5': '0.300', 'weapon2': '0.344', 'weapon4': '0.414', 'WEAPON3': '1.000', 'weapon3': '2.728', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.082', 'FRAGCOUNT': '46.000'} [2023-02-25 14:02:49,043][36142] DAMAGECOUNT value on done: 711779.0 [2023-02-25 14:02:49,044][36142] Sum rewards: 40.248, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.334', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon5': '0.068', 'AMMO3': '0.159', 'AMMO4': '0.177', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.300', 'weapon2': '0.692', 'WEAPON3': '0.950', 'HITCOUNT': '2.420', 'weapon3': '2.634', 'DAMAGECOUNT': '11.433', 'FRAGCOUNT': '35.000'} [2023-02-25 14:02:49,181][36142] DAMAGECOUNT value on done: 693807.0 [2023-02-25 14:02:49,181][36142] Sum rewards: 50.373, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.834', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.057', 'AMMO3': '0.188', 'AMMO4': '0.286', 'weapon2': '0.286', 'weapon5': '0.288', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.752', 'WEAPON3': '1.150', 'weapon3': '2.370', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '13.656', 'FRAGCOUNT': '45.500'} [2023-02-25 14:02:49,365][36142] DAMAGECOUNT value on done: 695787.0 [2023-02-25 14:02:49,366][36142] Sum rewards: 56.766, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.160', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.140', 'AMMO3': '0.160', 'AMMO4': '0.165', 'WEAPON5': '0.200', 'weapon2': '0.234', 'WEAPON4': '0.350', 'weapon4': '0.784', 'WEAPON3': '1.000', 'weapon3': '2.166', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.096', 'FRAGCOUNT': '47.000'} [2023-02-25 14:02:49,492][36142] DAMAGECOUNT value on done: 708653.0 [2023-02-25 14:02:49,492][36142] Sum rewards: 50.584, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.194', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon5': '0.080', 'AMMO4': '0.195', 'AMMO3': '0.206', 'WEAPON5': '0.300', 'weapon4': '0.330', 'WEAPON4': '0.400', 'weapon2': '0.550', 'WEAPON3': '1.250', 'HITCOUNT': '2.780', 'weapon3': '2.836', 'DAMAGECOUNT': '13.548', 'FRAGCOUNT': '46.000'} [2023-02-25 14:02:49,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 191205376. Throughput: 0: 3355.5. Samples: 10299494. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:02:49,730][36114] Avg episode reward: [(0, '55.537')] [2023-02-25 14:02:50,042][36156] DAMAGECOUNT value on done: 711896.0 [2023-02-25 14:02:50,042][36156] Sum rewards: 60.106, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.800', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.036', 'weapon5': '0.044', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.263', 'weapon2': '0.424', 'WEAPON3': '1.600', 'HITCOUNT': '3.120', 'weapon3': '3.240', 'DAMAGECOUNT': '15.921', 'FRAGCOUNT': '53.000'} [2023-02-25 14:02:50,095][36156] DAMAGECOUNT value on done: 715947.0 [2023-02-25 14:02:50,096][36156] Sum rewards: 54.919, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.235', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon5': '0.136', 'AMMO4': '0.185', 'AMMO3': '0.196', 'weapon2': '0.210', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.552', 'WEAPON3': '1.250', 'weapon3': '2.824', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.691', 'FRAGCOUNT': '47.000'} [2023-02-25 14:02:50,113][36138] Updated weights for policy 0, policy_version 46683 (0.0009) [2023-02-25 14:02:50,363][36156] DAMAGECOUNT value on done: 700570.0 [2023-02-25 14:02:50,363][36156] Sum rewards: 56.346, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.340', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.098', 'AMMO4': '0.112', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.334', 'weapon2': '0.410', 'WEAPON3': '1.450', 'weapon3': '2.898', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.826', 'FRAGCOUNT': '51.000'} [2023-02-25 14:02:50,422][36156] DAMAGECOUNT value on done: 703640.0 [2023-02-25 14:02:50,422][36156] Sum rewards: 44.753, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.760', 'AMMO2': '0.014', 'AMMO5': '0.015', 'WEAPON1': '0.040', 'AMMO4': '0.070', 'weapon5': '0.128', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.420', 'weapon4': '0.510', 'WEAPON3': '1.450', 'weapon3': '2.620', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.049', 'FRAGCOUNT': '39.000'} [2023-02-25 14:02:52,019][36155] DAMAGECOUNT value on done: 694608.0 [2023-02-25 14:02:52,019][36155] Sum rewards: 54.527, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.679', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO4': '0.184', 'AMMO3': '0.190', 'weapon5': '0.206', 'weapon2': '0.290', 'WEAPON5': '0.350', 'weapon4': '0.354', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.842', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.560', 'FRAGCOUNT': '47.000'} [2023-02-25 14:02:52,315][36155] DAMAGECOUNT value on done: 715592.0 [2023-02-25 14:02:52,315][36155] Sum rewards: 55.029, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-4.480', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.153', 'weapon5': '0.174', 'weapon2': '0.262', 'AMMO3': '0.303', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.358', 'ARMOR': '0.480', 'WEAPON3': '1.850', 'weapon3': '2.868', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.908', 'FRAGCOUNT': '51.500'} [2023-02-25 14:02:52,836][36155] DAMAGECOUNT value on done: 711079.0 [2023-02-25 14:02:52,837][36155] Sum rewards: 48.851, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.130', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.080', 'AMMO4': '0.112', 'AMMO3': '0.201', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.288', 'weapon2': '0.808', 'WEAPON3': '1.150', 'weapon3': '2.588', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.248', 'FRAGCOUNT': '41.500'} [2023-02-25 14:02:53,124][36138] Updated weights for policy 0, policy_version 46693 (0.0009) [2023-02-25 14:02:53,132][36155] DAMAGECOUNT value on done: 703676.0 [2023-02-25 14:02:53,133][36155] Sum rewards: 65.084, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.458', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.058', 'weapon4': '0.060', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'weapon2': '0.392', 'WEAPON3': '1.150', 'weapon3': '3.288', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.878', 'FRAGCOUNT': '54.000'} [2023-02-25 14:02:53,729][36139] DAMAGECOUNT value on done: 708640.0 [2023-02-25 14:02:53,729][36139] Sum rewards: 46.539, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.222', 'AMMO5': '0.012', 'AMMO2': '0.048', 'AMMO3': '0.230', 'weapon5': '0.230', 'AMMO4': '0.239', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON4': '0.450', 'weapon4': '0.766', 'WEAPON3': '1.250', 'weapon3': '2.320', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.801', 'FRAGCOUNT': '43.000'} [2023-02-25 14:02:54,036][36139] DAMAGECOUNT value on done: 702626.0 [2023-02-25 14:02:54,037][36139] Sum rewards: 51.201, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.405', 'AMMO5': '0.013', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon5': '0.156', 'AMMO3': '0.161', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.498', 'weapon2': '0.504', 'WEAPON3': '1.100', 'weapon3': '2.670', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '43.000'} [2023-02-25 14:02:54,311][36139] DAMAGECOUNT value on done: 713026.0 [2023-02-25 14:02:54,311][36139] Sum rewards: 61.697, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.200', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.067', 'weapon5': '0.166', 'AMMO3': '0.237', 'weapon2': '0.256', 'weapon4': '0.258', 'AMMO4': '0.336', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '1.400', 'weapon3': '2.968', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '57.000'} [2023-02-25 14:02:54,604][36139] DAMAGECOUNT value on done: 706249.0 [2023-02-25 14:02:54,605][36139] Sum rewards: 54.899, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.702', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.053', 'weapon5': '0.148', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.250', 'AMMO4': '0.263', 'WEAPON4': '0.450', 'weapon4': '0.486', 'WEAPON3': '1.300', 'weapon3': '2.828', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.889', 'FRAGCOUNT': '50.000'} [2023-02-25 14:02:54,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13412.7). Total num frames: 191275008. Throughput: 0: 3354.6. Samples: 10309572. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:02:54,729][36114] Avg episode reward: [(0, '55.231')] [2023-02-25 14:02:56,143][36138] Updated weights for policy 0, policy_version 46703 (0.0010) [2023-02-25 14:02:59,189][36138] Updated weights for policy 0, policy_version 46713 (0.0009) [2023-02-25 14:02:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 191340544. Throughput: 0: 3354.4. Samples: 10329856. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:02:59,730][36114] Avg episode reward: [(0, '55.231')] [2023-02-25 14:03:02,213][36138] Updated weights for policy 0, policy_version 46723 (0.0010) [2023-02-25 14:03:03,907][36141] DAMAGECOUNT value on done: 715865.0 [2023-02-25 14:03:03,907][36141] Sum rewards: 63.657, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.841', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'weapon5': '0.060', 'weapon2': '0.168', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon4': '0.846', 'WEAPON3': '1.200', 'weapon3': '2.702', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '15.186', 'FRAGCOUNT': '54.000'} [2023-02-25 14:03:03,940][36154] DAMAGECOUNT value on done: 709975.0 [2023-02-25 14:03:03,941][36154] Sum rewards: 64.323, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.412', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.068', 'AMMO3': '0.119', 'weapon5': '0.254', 'AMMO4': '0.340', 'weapon2': '0.350', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '0.750', 'weapon4': '0.784', 'weapon3': '2.316', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.687', 'FRAGCOUNT': '54.000'} [2023-02-25 14:03:04,214][36141] DAMAGECOUNT value on done: 710698.0 [2023-02-25 14:03:04,215][36141] Sum rewards: 60.390, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.500', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.086', 'AMMO4': '0.169', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'weapon2': '0.254', 'WEAPON4': '0.400', 'weapon4': '0.534', 'WEAPON3': '1.050', 'weapon3': '2.912', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.708', 'FRAGCOUNT': '52.000'} [2023-02-25 14:03:04,248][36154] DAMAGECOUNT value on done: 698251.0 [2023-02-25 14:03:04,249][36154] Sum rewards: 54.904, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.100', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon5': '0.186', 'AMMO3': '0.188', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.324', 'weapon2': '0.332', 'WEAPON3': '1.150', 'HITCOUNT': '2.890', 'weapon3': '2.950', 'DAMAGECOUNT': '13.830', 'FRAGCOUNT': '48.000'} [2023-02-25 14:03:04,359][36141] DAMAGECOUNT value on done: 706068.0 [2023-02-25 14:03:04,360][36141] Sum rewards: 49.501, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.298', 'AMMO5': '0.018', 'AMMO2': '0.036', 'AMMO4': '0.179', 'AMMO3': '0.191', 'weapon5': '0.278', 'weapon2': '0.310', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.566', 'WEAPON3': '1.200', 'HITCOUNT': '2.460', 'weapon3': '2.514', 'DAMAGECOUNT': '12.897', 'FRAGCOUNT': '46.000'} [2023-02-25 14:03:04,566][36154] DAMAGECOUNT value on done: 708034.0 [2023-02-25 14:03:04,566][36154] Sum rewards: 47.750, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.740', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.132', 'weapon5': '0.152', 'AMMO3': '0.187', 'weapon2': '0.196', 'weapon4': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.730', 'weapon3': '3.214', 'DAMAGECOUNT': '14.262', 'FRAGCOUNT': '41.000'} [2023-02-25 14:03:04,679][36141] DAMAGECOUNT value on done: 701612.0 [2023-02-25 14:03:04,679][36141] Sum rewards: 51.811, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.125', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO3': '0.120', 'AMMO4': '0.129', 'weapon5': '0.214', 'WEAPON4': '0.350', 'weapon2': '0.390', 'WEAPON5': '0.450', 'weapon4': '0.762', 'WEAPON3': '0.850', 'weapon3': '2.378', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '12.618', 'FRAGCOUNT': '42.000'} [2023-02-25 14:03:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13426.6). Total num frames: 191410176. Throughput: 0: 3359.1. Samples: 10350040. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:03:04,729][36114] Avg episode reward: [(0, '55.407')] [2023-02-25 14:03:04,878][36154] DAMAGECOUNT value on done: 710132.0 [2023-02-25 14:03:04,878][36154] Sum rewards: 50.608, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-3.114', 'AMMO5': '0.018', 'AMMO2': '0.068', 'weapon5': '0.226', 'AMMO3': '0.241', 'AMMO4': '0.341', 'weapon2': '0.398', 'weapon4': '0.468', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.552', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.169', 'FRAGCOUNT': '50.000'} [2023-02-25 14:03:05,273][36138] Updated weights for policy 0, policy_version 46733 (0.0009) [2023-02-25 14:03:05,561][36157] DAMAGECOUNT value on done: 716288.0 [2023-02-25 14:03:05,561][36157] Sum rewards: 46.298, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.627', 'AMMO5': '0.005', 'weapon5': '0.024', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO3': '0.135', 'AMMO4': '0.140', 'WEAPON4': '0.350', 'weapon2': '0.354', 'ARMOR': '0.456', 'weapon4': '0.794', 'WEAPON3': '0.900', 'weapon3': '2.662', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '12.897', 'FRAGCOUNT': '38.000'} [2023-02-25 14:03:05,866][36157] DAMAGECOUNT value on done: 709036.0 [2023-02-25 14:03:05,866][36157] Sum rewards: 57.433, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.122', 'ARMOR': '0.004', 'AMMO2': '0.011', 'AMMO5': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.187', 'weapon5': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.438', 'weapon2': '0.482', 'WEAPON3': '1.250', 'weapon3': '2.516', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.123', 'FRAGCOUNT': '50.000'} [2023-02-25 14:03:06,568][36157] DAMAGECOUNT value on done: 717377.0 [2023-02-25 14:03:06,569][36157] Sum rewards: 65.645, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.432', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.152', 'AMMO3': '0.160', 'weapon5': '0.278', 'weapon2': '0.290', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.658', 'WEAPON3': '1.050', 'weapon3': '2.498', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '56.000'} [2023-02-25 14:03:06,580][36140] DAMAGECOUNT value on done: 715930.0 [2023-02-25 14:03:06,580][36140] Sum rewards: 36.584, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.590', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon5': '0.142', 'AMMO3': '0.176', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.878', 'weapon4': '0.944', 'WEAPON3': '1.050', 'weapon3': '1.774', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '12.006', 'FRAGCOUNT': '32.000'} [2023-02-25 14:03:06,872][36157] DAMAGECOUNT value on done: 714125.0 [2023-02-25 14:03:06,873][36157] Sum rewards: 67.190, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.820', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.151', 'weapon2': '0.152', 'WEAPON3': '1.000', 'HITCOUNT': '3.200', 'weapon3': '3.492', 'DAMAGECOUNT': '15.669', 'FRAGCOUNT': '54.000'} [2023-02-25 14:03:06,903][36140] DAMAGECOUNT value on done: 697032.0 [2023-02-25 14:03:06,904][36140] Sum rewards: 48.869, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.824', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.092', 'AMMO4': '0.122', 'AMMO3': '0.134', 'WEAPON5': '0.150', 'weapon2': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.658', 'WEAPON3': '0.850', 'weapon3': '2.500', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '12.747', 'FRAGCOUNT': '40.000'} [2023-02-25 14:03:07,205][36140] DAMAGECOUNT value on done: 708732.0 [2023-02-25 14:03:07,206][36140] Sum rewards: 48.088, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.930', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.132', 'AMMO4': '0.186', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.544', 'weapon2': '0.582', 'WEAPON3': '1.250', 'weapon3': '2.476', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.935', 'FRAGCOUNT': '44.000'} [2023-02-25 14:03:07,531][36140] DAMAGECOUNT value on done: 706271.0 [2023-02-25 14:03:07,532][36140] Sum rewards: 56.191, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.744', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.056', 'AMMO3': '0.212', 'weapon5': '0.274', 'AMMO4': '0.281', 'weapon4': '0.438', 'weapon2': '0.510', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.262', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '15.429', 'FRAGCOUNT': '50.000'} [2023-02-25 14:03:08,358][36138] Updated weights for policy 0, policy_version 46743 (0.0009) [2023-02-25 14:03:09,174][36142] DAMAGECOUNT value on done: 716957.0 [2023-02-25 14:03:09,175][36142] Sum rewards: 51.303, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.552', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.206', 'AMMO4': '0.214', 'weapon2': '0.222', 'AMMO3': '0.251', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.554', 'WEAPON3': '1.450', 'weapon3': '2.680', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.534', 'FRAGCOUNT': '46.500'} [2023-02-25 14:03:09,317][36142] DAMAGECOUNT value on done: 698477.0 [2023-02-25 14:03:09,318][36142] Sum rewards: 49.452, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.899', 'AMMO5': '0.023', 'AMMO2': '0.048', 'AMMO3': '0.177', 'weapon5': '0.230', 'AMMO4': '0.241', 'weapon2': '0.530', 'WEAPON5': '0.550', 'WEAPON4': '0.700', 'weapon4': '0.784', 'WEAPON3': '1.000', 'weapon3': '1.818', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '14.010', 'FRAGCOUNT': '46.000'} [2023-02-25 14:03:09,494][36142] DAMAGECOUNT value on done: 700286.0 [2023-02-25 14:03:09,494][36142] Sum rewards: 47.194, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.262', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.058', 'AMMO3': '0.160', 'weapon5': '0.226', 'AMMO4': '0.290', 'weapon2': '0.302', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'weapon4': '0.888', 'WEAPON3': '1.050', 'weapon3': '2.234', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '13.497', 'FRAGCOUNT': '43.000'} [2023-02-25 14:03:09,620][36142] DAMAGECOUNT value on done: 713872.0 [2023-02-25 14:03:09,620][36142] Sum rewards: 55.073, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.940', 'AMMO5': '0.010', 'AMMO2': '0.048', 'AMMO4': '0.242', 'AMMO3': '0.250', 'weapon2': '0.282', 'weapon5': '0.288', 'WEAPON5': '0.300', 'weapon4': '0.336', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.760', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.657', 'FRAGCOUNT': '50.000'} [2023-02-25 14:03:09,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 191475712. Throughput: 0: 3356.9. Samples: 10360056. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:03:09,729][36114] Avg episode reward: [(0, '54.982')] [2023-02-25 14:03:10,187][36156] DAMAGECOUNT value on done: 716372.0 [2023-02-25 14:03:10,188][36156] Sum rewards: 48.582, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.401', 'AMMO5': '0.023', 'AMMO2': '0.048', 'AMMO3': '0.157', 'AMMO4': '0.239', 'weapon5': '0.248', 'weapon2': '0.296', 'weapon4': '0.398', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.766', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.428', 'FRAGCOUNT': '41.000'} [2023-02-25 14:03:10,232][36156] DAMAGECOUNT value on done: 720415.0 [2023-02-25 14:03:10,233][36156] Sum rewards: 46.139, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.076', 'AMMO5': '0.006', 'AMMO2': '0.012', 'weapon4': '0.014', 'weapon5': '0.050', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.690', 'WEAPON3': '1.250', 'HITCOUNT': '2.830', 'weapon3': '2.930', 'DAMAGECOUNT': '13.404', 'FRAGCOUNT': '39.000'} [2023-02-25 14:03:10,514][36156] DAMAGECOUNT value on done: 705767.0 [2023-02-25 14:03:10,514][36156] Sum rewards: 63.542, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.390', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO3': '0.240', 'weapon2': '0.288', 'WEAPON3': '1.350', 'HITCOUNT': '3.160', 'weapon3': '3.546', 'DAMAGECOUNT': '15.591', 'FRAGCOUNT': '54.000'} [2023-02-25 14:03:10,554][36156] DAMAGECOUNT value on done: 709114.0 [2023-02-25 14:03:10,554][36156] Sum rewards: 60.307, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.074', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.166', 'AMMO3': '0.197', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.440', 'weapon4': '0.544', 'WEAPON3': '1.250', 'weapon3': '2.526', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '52.000'} [2023-02-25 14:03:11,429][36138] Updated weights for policy 0, policy_version 46753 (0.0009) [2023-02-25 14:03:11,843][36155] DAMAGECOUNT value on done: 699221.0 [2023-02-25 14:03:11,844][36155] Sum rewards: 58.983, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.900', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO3': '0.146', 'AMMO4': '0.157', 'weapon5': '0.200', 'WEAPON5': '0.400', 'weapon2': '0.472', 'WEAPON4': '0.500', 'weapon4': '0.634', 'WEAPON3': '0.900', 'weapon3': '2.354', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.839', 'FRAGCOUNT': '52.000'} [2023-02-25 14:03:12,146][36155] DAMAGECOUNT value on done: 720212.0 [2023-02-25 14:03:12,147][36155] Sum rewards: 52.977, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.700', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.136', 'AMMO3': '0.258', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.846', 'WEAPON3': '1.500', 'weapon3': '2.350', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.860', 'FRAGCOUNT': '49.000'} [2023-02-25 14:03:12,338][36142] Large shaping reward 2.589 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.033, -11.0), ('weapon5', 0.002)] [2023-02-25 14:03:12,676][36155] DAMAGECOUNT value on done: 716254.0 [2023-02-25 14:03:12,677][36155] Sum rewards: 58.597, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.521', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO4': '0.189', 'weapon2': '0.206', 'AMMO3': '0.215', 'weapon5': '0.294', 'weapon4': '0.436', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.726', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.525', 'FRAGCOUNT': '51.000'} [2023-02-25 14:03:12,999][36155] DAMAGECOUNT value on done: 708132.0 [2023-02-25 14:03:12,999][36155] Sum rewards: 50.661, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.702', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.110', 'weapon5': '0.120', 'AMMO4': '0.143', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.588', 'WEAPON3': '1.400', 'HITCOUNT': '2.700', 'weapon3': '2.962', 'DAMAGECOUNT': '13.368', 'FRAGCOUNT': '47.000'} [2023-02-25 14:03:13,603][36139] DAMAGECOUNT value on done: 713151.0 [2023-02-25 14:03:13,603][36139] Sum rewards: 45.828, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.724', 'ARMOR': '0.004', 'AMMO5': '0.026', 'AMMO2': '0.043', 'AMMO4': '0.215', 'weapon5': '0.222', 'weapon2': '0.260', 'AMMO3': '0.286', 'weapon4': '0.370', 'WEAPON4': '0.450', 'WEAPON5': '0.650', 'WEAPON3': '1.600', 'weapon3': '2.764', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.533', 'FRAGCOUNT': '44.000'} [2023-02-25 14:03:13,911][36139] DAMAGECOUNT value on done: 706783.0 [2023-02-25 14:03:13,912][36139] Sum rewards: 47.623, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.818', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.038', 'AMMO3': '0.157', 'AMMO4': '0.189', 'weapon5': '0.212', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.604', 'weapon2': '0.664', 'WEAPON3': '0.950', 'weapon3': '2.098', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.471', 'FRAGCOUNT': '42.000'} [2023-02-25 14:03:14,178][36139] DAMAGECOUNT value on done: 718150.0 [2023-02-25 14:03:14,178][36139] Sum rewards: 64.355, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.459', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon4': '0.144', 'AMMO3': '0.152', 'weapon5': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.502', 'WEAPON3': '1.000', 'weapon3': '2.918', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.372', 'FRAGCOUNT': '53.000'} [2023-02-25 14:03:14,476][36138] Updated weights for policy 0, policy_version 46763 (0.0010) [2023-02-25 14:03:14,487][36139] DAMAGECOUNT value on done: 711133.0 [2023-02-25 14:03:14,488][36139] Sum rewards: 57.668, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.100', 'AMMO2': '0.013', 'AMMO4': '0.065', 'WEAPON4': '0.150', 'weapon4': '0.156', 'weapon2': '0.200', 'AMMO3': '0.244', 'WEAPON3': '1.500', 'HITCOUNT': '3.070', 'weapon3': '3.468', 'DAMAGECOUNT': '14.652', 'FRAGCOUNT': '52.000'} [2023-02-25 14:03:14,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 191541248. Throughput: 0: 3358.2. Samples: 10380202. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:03:14,730][36114] Avg episode reward: [(0, '54.571')] [2023-02-25 14:03:16,225][36142] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:03:17,609][36138] Updated weights for policy 0, policy_version 46773 (0.0009) [2023-02-25 14:03:17,677][36154] Large shaping reward 2.521 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.111, -37.0), ('weapon5', 0.002)] [2023-02-25 14:03:19,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 191610880. Throughput: 0: 3353.1. Samples: 10400128. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:03:19,730][36114] Avg episode reward: [(0, '54.571')] [2023-02-25 14:03:19,734][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000046780_191610880.pth... [2023-02-25 14:03:19,793][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000045994_188391424.pth [2023-02-25 14:03:20,662][36138] Updated weights for policy 0, policy_version 46783 (0.0009) [2023-02-25 14:03:21,368][36155] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:03:23,743][36138] Updated weights for policy 0, policy_version 46793 (0.0009) [2023-02-25 14:03:23,929][36154] DAMAGECOUNT value on done: 715142.0 [2023-02-25 14:03:23,929][36154] Sum rewards: 57.003, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.715', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon4': '0.142', 'AMMO3': '0.191', 'weapon5': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.300', 'HITCOUNT': '2.990', 'weapon3': '3.042', 'DAMAGECOUNT': '15.345', 'FRAGCOUNT': '50.000'} [2023-02-25 14:03:23,966][36141] DAMAGECOUNT value on done: 720158.0 [2023-02-25 14:03:23,967][36141] Sum rewards: 48.887, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.808', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.154', 'AMMO3': '0.191', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.294', 'weapon4': '0.556', 'WEAPON3': '1.100', 'HITCOUNT': '2.620', 'weapon3': '2.736', 'DAMAGECOUNT': '12.864', 'FRAGCOUNT': '42.000'} [2023-02-25 14:03:24,253][36154] DAMAGECOUNT value on done: 702679.0 [2023-02-25 14:03:24,254][36154] Sum rewards: 51.150, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.140', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.116', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.358', 'weapon4': '0.446', 'WEAPON3': '1.250', 'HITCOUNT': '2.760', 'weapon3': '2.890', 'DAMAGECOUNT': '13.269', 'FRAGCOUNT': '45.000'} [2023-02-25 14:03:24,299][36141] DAMAGECOUNT value on done: 716003.0 [2023-02-25 14:03:24,300][36141] Sum rewards: 65.796, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.285', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO3': '0.161', 'AMMO4': '0.166', 'weapon5': '0.212', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON4': '0.350', 'weapon4': '0.382', 'WEAPON3': '0.950', 'weapon3': '2.806', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '55.000'} [2023-02-25 14:03:24,409][36141] DAMAGECOUNT value on done: 710597.0 [2023-02-25 14:03:24,409][36141] Sum rewards: 52.791, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.370', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.011', 'AMMO4': '0.057', 'weapon5': '0.116', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'weapon4': '0.274', 'weapon2': '0.478', 'WEAPON3': '1.350', 'HITCOUNT': '2.690', 'weapon3': '2.894', 'DAMAGECOUNT': '13.587', 'FRAGCOUNT': '48.000'} [2023-02-25 14:03:24,552][36154] DAMAGECOUNT value on done: 712546.0 [2023-02-25 14:03:24,553][36154] Sum rewards: 44.369, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.294', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon2': '0.188', 'AMMO3': '0.220', 'AMMO4': '0.233', 'weapon5': '0.244', 'WEAPON5': '0.400', 'ARMOR': '0.504', 'WEAPON4': '0.600', 'weapon4': '1.016', 'WEAPON3': '1.250', 'weapon3': '2.198', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '13.500', 'FRAGCOUNT': '41.000'} [2023-02-25 14:03:24,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 191676416. Throughput: 0: 3352.7. Samples: 10410150. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:03:24,730][36114] Avg episode reward: [(0, '54.288')] [2023-02-25 14:03:24,730][36141] DAMAGECOUNT value on done: 706400.0 [2023-02-25 14:03:24,730][36141] Sum rewards: 58.199, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.260', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.184', 'weapon2': '0.268', 'weapon4': '0.374', 'WEAPON3': '1.100', 'HITCOUNT': '3.040', 'weapon3': '3.130', 'DAMAGECOUNT': '14.364', 'FRAGCOUNT': '48.000'} [2023-02-25 14:03:24,848][36154] DAMAGECOUNT value on done: 714499.0 [2023-02-25 14:03:24,848][36154] Sum rewards: 54.547, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.695', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.030', 'weapon5': '0.078', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'weapon2': '0.718', 'WEAPON3': '1.050', 'HITCOUNT': '2.890', 'weapon3': '3.024', 'DAMAGECOUNT': '13.101', 'FRAGCOUNT': '46.000'} [2023-02-25 14:03:25,819][36157] DAMAGECOUNT value on done: 721190.0 [2023-02-25 14:03:25,819][36157] Sum rewards: 56.468, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.031', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO4': '0.157', 'AMMO3': '0.183', 'weapon5': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.302', 'weapon4': '0.452', 'WEAPON3': '1.150', 'HITCOUNT': '2.720', 'weapon3': '2.758', 'DAMAGECOUNT': '14.706', 'FRAGCOUNT': '48.000'} [2023-02-25 14:03:26,133][36157] DAMAGECOUNT value on done: 713508.0 [2023-02-25 14:03:26,134][36157] Sum rewards: 49.476, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.494', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon5': '0.192', 'AMMO3': '0.193', 'weapon2': '0.312', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.534', 'WEAPON3': '1.150', 'weapon3': '2.652', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.416', 'FRAGCOUNT': '45.500'} [2023-02-25 14:03:26,864][36138] Updated weights for policy 0, policy_version 46803 (0.0009) [2023-02-25 14:03:26,866][36157] DAMAGECOUNT value on done: 722232.0 [2023-02-25 14:03:26,867][36157] Sum rewards: 58.612, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.994', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO4': '0.191', 'AMMO3': '0.196', 'weapon5': '0.214', 'weapon2': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.378', 'WEAPON3': '1.150', 'weapon3': '2.858', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.565', 'FRAGCOUNT': '51.000'} [2023-02-25 14:03:26,885][36140] DAMAGECOUNT value on done: 721326.0 [2023-02-25 14:03:26,886][36140] Sum rewards: 57.705, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.642', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon5': '0.152', 'AMMO3': '0.170', 'weapon2': '0.240', 'AMMO4': '0.273', 'WEAPON5': '0.300', 'WEAPON4': '0.650', 'weapon4': '0.698', 'WEAPON3': '0.950', 'weapon3': '2.630', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.188', 'FRAGCOUNT': '50.000'} [2023-02-25 14:03:27,173][36157] DAMAGECOUNT value on done: 718965.0 [2023-02-25 14:03:27,173][36157] Sum rewards: 49.428, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.309', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.031', 'weapon5': '0.142', 'AMMO4': '0.156', 'WEAPON5': '0.250', 'weapon2': '0.252', 'AMMO3': '0.266', 'WEAPON4': '0.350', 'weapon4': '0.392', 'WEAPON3': '1.650', 'HITCOUNT': '2.800', 'weapon3': '2.912', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '47.000'} [2023-02-25 14:03:27,203][36140] DAMAGECOUNT value on done: 701765.0 [2023-02-25 14:03:27,204][36140] Sum rewards: 55.839, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.300', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'weapon5': '0.064', 'AMMO4': '0.081', 'WEAPON5': '0.100', 'weapon4': '0.182', 'AMMO3': '0.201', 'weapon2': '0.572', 'WEAPON3': '1.300', 'weapon3': '2.938', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.199', 'FRAGCOUNT': '48.000'} [2023-02-25 14:03:27,513][36140] DAMAGECOUNT value on done: 713531.0 [2023-02-25 14:03:27,514][36140] Sum rewards: 52.672, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.156', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.014', 'weapon4': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'WEAPON4': '0.150', 'weapon2': '0.284', 'AMMO3': '0.317', 'WEAPON3': '1.850', 'HITCOUNT': '3.220', 'weapon3': '3.448', 'DAMAGECOUNT': '14.397', 'FRAGCOUNT': '50.000'} [2023-02-25 14:03:27,832][36140] DAMAGECOUNT value on done: 710745.0 [2023-02-25 14:03:27,832][36140] Sum rewards: 41.193, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.292', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.098', 'AMMO4': '0.105', 'WEAPON5': '0.200', 'AMMO3': '0.282', 'WEAPON4': '0.300', 'weapon2': '0.346', 'weapon4': '0.632', 'WEAPON3': '1.700', 'weapon3': '2.598', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.422', 'FRAGCOUNT': '39.000'} [2023-02-25 14:03:29,324][36142] DAMAGECOUNT value on done: 721413.0 [2023-02-25 14:03:29,325][36142] Sum rewards: 49.450, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.807', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.116', 'AMMO3': '0.170', 'AMMO4': '0.177', 'weapon2': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.678', 'WEAPON3': '1.000', 'weapon3': '2.610', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.368', 'FRAGCOUNT': '42.000'} [2023-02-25 14:03:29,485][36142] DAMAGECOUNT value on done: 703350.0 [2023-02-25 14:03:29,486][36142] Sum rewards: 47.849, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.100', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.117', 'AMMO3': '0.182', 'weapon5': '0.204', 'weapon4': '0.342', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.512', 'WEAPON3': '1.150', 'weapon3': '2.724', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.130', 'FRAGCOUNT': '41.500'} [2023-02-25 14:03:29,637][36142] DAMAGECOUNT value on done: 704652.0 [2023-02-25 14:03:29,638][36142] Sum rewards: 49.734, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.182', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.053', 'AMMO3': '0.132', 'weapon5': '0.196', 'AMMO4': '0.266', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.544', 'weapon2': '0.642', 'WEAPON3': '0.800', 'weapon3': '2.344', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '13.098', 'FRAGCOUNT': '42.000'} [2023-02-25 14:03:29,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.2, 300 sec: 13412.7). Total num frames: 191741952. Throughput: 0: 3346.7. Samples: 10430092. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:03:29,730][36114] Avg episode reward: [(0, '54.330')] [2023-02-25 14:03:29,798][36142] DAMAGECOUNT value on done: 718785.0 [2023-02-25 14:03:29,798][36142] Sum rewards: 56.614, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.392', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon4': '0.184', 'weapon5': '0.188', 'AMMO3': '0.233', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.618', 'WEAPON3': '1.450', 'weapon3': '2.716', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.673', 'FRAGCOUNT': '51.000'} [2023-02-25 14:03:29,901][36138] Updated weights for policy 0, policy_version 46813 (0.0009) [2023-02-25 14:03:30,338][36156] DAMAGECOUNT value on done: 720791.0 [2023-02-25 14:03:30,338][36156] Sum rewards: 51.091, reward structure: {'DEATHCOUNT': '-11.250', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.031', 'HEALTH': '0.098', 'AMMO3': '0.126', 'AMMO4': '0.155', 'weapon4': '0.174', 'weapon5': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.466', 'WEAPON3': '0.750', 'HITCOUNT': '2.610', 'weapon3': '2.968', 'DAMAGECOUNT': '13.257', 'FRAGCOUNT': '41.000'} [2023-02-25 14:03:30,498][36156] DAMAGECOUNT value on done: 725540.0 [2023-02-25 14:03:30,499][36156] Sum rewards: 60.752, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.601', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon5': '0.116', 'AMMO4': '0.120', 'weapon2': '0.162', 'AMMO3': '0.167', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.654', 'WEAPON3': '1.000', 'weapon3': '2.882', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '50.000'} [2023-02-25 14:03:30,655][36156] DAMAGECOUNT value on done: 710463.0 [2023-02-25 14:03:30,655][36156] Sum rewards: 50.462, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.706', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.154', 'AMMO3': '0.171', 'weapon2': '0.186', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.480', 'WEAPON3': '0.950', 'HITCOUNT': '2.800', 'weapon3': '2.876', 'DAMAGECOUNT': '14.088', 'FRAGCOUNT': '42.000'} [2023-02-25 14:03:30,827][36156] DAMAGECOUNT value on done: 713641.0 [2023-02-25 14:03:30,828][36156] Sum rewards: 51.871, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.130', 'AMMO5': '0.017', 'AMMO2': '0.036', 'AMMO3': '0.159', 'AMMO4': '0.179', 'weapon5': '0.246', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.502', 'weapon4': '0.840', 'WEAPON3': '0.950', 'weapon3': '2.030', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.581', 'FRAGCOUNT': '45.000'} [2023-02-25 14:03:31,998][36155] DAMAGECOUNT value on done: 703860.0 [2023-02-25 14:03:31,999][36155] Sum rewards: 59.610, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.900', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon5': '0.132', 'weapon4': '0.152', 'weapon2': '0.182', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '2.780', 'weapon3': '3.322', 'DAMAGECOUNT': '13.767', 'FRAGCOUNT': '54.000'} [2023-02-25 14:03:32,302][36155] DAMAGECOUNT value on done: 725444.0 [2023-02-25 14:03:32,302][36155] Sum rewards: 59.347, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.910', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'weapon5': '0.154', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'weapon2': '0.422', 'weapon4': '0.530', 'WEAPON3': '1.450', 'weapon3': '2.586', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.696', 'FRAGCOUNT': '52.000'} [2023-02-25 14:03:32,858][36155] DAMAGECOUNT value on done: 721174.0 [2023-02-25 14:03:32,858][36155] Sum rewards: 50.240, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.347', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.058', 'AMMO3': '0.116', 'weapon5': '0.262', 'AMMO4': '0.290', 'weapon2': '0.358', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'weapon4': '0.700', 'WEAPON4': '0.750', 'weapon3': '2.338', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.760', 'FRAGCOUNT': '41.000'} [2023-02-25 14:03:32,937][36138] Updated weights for policy 0, policy_version 46823 (0.0009) [2023-02-25 14:03:33,165][36155] DAMAGECOUNT value on done: 713253.0 [2023-02-25 14:03:33,166][36155] Sum rewards: 59.016, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.321', 'AMMO5': '0.016', 'AMMO2': '0.030', 'AMMO4': '0.151', 'AMMO3': '0.171', 'weapon2': '0.194', 'weapon5': '0.252', 'weapon4': '0.354', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.926', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.363', 'FRAGCOUNT': '51.000'} [2023-02-25 14:03:33,681][36139] DAMAGECOUNT value on done: 718291.0 [2023-02-25 14:03:33,681][36139] Sum rewards: 63.098, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.828', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.130', 'AMMO3': '0.158', 'AMMO4': '0.216', 'WEAPON5': '0.350', 'weapon2': '0.468', 'WEAPON4': '0.500', 'weapon4': '0.712', 'WEAPON3': '1.000', 'weapon3': '2.442', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '55.000'} [2023-02-25 14:03:33,998][36139] DAMAGECOUNT value on done: 710859.0 [2023-02-25 14:03:33,999][36139] Sum rewards: 43.046, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.000', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO4': '0.180', 'AMMO3': '0.200', 'weapon5': '0.248', 'weapon2': '0.408', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.706', 'WEAPON3': '1.150', 'weapon3': '2.284', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.228', 'FRAGCOUNT': '39.000'} [2023-02-25 14:03:34,310][36139] DAMAGECOUNT value on done: 723939.0 [2023-02-25 14:03:34,310][36139] Sum rewards: 69.044, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.905', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.054', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon2': '0.222', 'weapon4': '0.376', 'WEAPON3': '1.400', 'weapon3': '3.168', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '60.000'} [2023-02-25 14:03:34,613][36139] DAMAGECOUNT value on done: 716546.0 [2023-02-25 14:03:34,614][36139] Sum rewards: 58.187, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.028', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.132', 'weapon4': '0.164', 'WEAPON5': '0.200', 'AMMO3': '0.266', 'weapon2': '0.270', 'WEAPON4': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.186', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.239', 'FRAGCOUNT': '53.500'} [2023-02-25 14:03:34,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 191807488. Throughput: 0: 3348.7. Samples: 10450184. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:03:34,730][36114] Avg episode reward: [(0, '54.401')] [2023-02-25 14:03:35,957][36138] Updated weights for policy 0, policy_version 46833 (0.0009) [2023-02-25 14:03:38,986][36138] Updated weights for policy 0, policy_version 46843 (0.0009) [2023-02-25 14:03:39,729][36114] Fps is (10 sec: 13517.0, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 191877120. Throughput: 0: 3349.9. Samples: 10460318. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:03:39,729][36114] Avg episode reward: [(0, '54.401')] [2023-02-25 14:03:42,083][36138] Updated weights for policy 0, policy_version 46853 (0.0009) [2023-02-25 14:03:44,105][36141] DAMAGECOUNT value on done: 725313.0 [2023-02-25 14:03:44,105][36141] Sum rewards: 59.609, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.955', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.074', 'AMMO4': '0.076', 'weapon4': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.542', 'WEAPON3': '1.150', 'weapon3': '3.082', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.465', 'FRAGCOUNT': '50.500'} [2023-02-25 14:03:44,156][36154] DAMAGECOUNT value on done: 719187.0 [2023-02-25 14:03:44,156][36154] Sum rewards: 45.023, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.120', 'AMMO5': '0.015', 'AMMO2': '0.044', 'AMMO3': '0.205', 'weapon5': '0.206', 'AMMO4': '0.219', 'weapon2': '0.224', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'ARMOR': '0.461', 'weapon4': '0.874', 'WEAPON3': '1.250', 'weapon3': '2.390', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.135', 'FRAGCOUNT': '42.000'} [2023-02-25 14:03:44,403][36141] DAMAGECOUNT value on done: 719701.0 [2023-02-25 14:03:44,403][36141] Sum rewards: 37.878, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.260', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.086', 'AMMO4': '0.087', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'weapon4': '0.538', 'weapon2': '0.682', 'WEAPON3': '1.050', 'weapon3': '2.410', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '11.094', 'FRAGCOUNT': '33.000'} [2023-02-25 14:03:44,459][36141] DAMAGECOUNT value on done: 715930.0 [2023-02-25 14:03:44,459][36141] Sum rewards: 56.454, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.439', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.190', 'AMMO3': '0.195', 'weapon4': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.200', 'weapon3': '2.980', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '48.000'} [2023-02-25 14:03:44,460][36154] DAMAGECOUNT value on done: 708458.0 [2023-02-25 14:03:44,460][36154] Sum rewards: 66.780, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.420', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.082', 'AMMO3': '0.176', 'weapon5': '0.202', 'weapon2': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.548', 'WEAPON3': '1.050', 'weapon3': '2.756', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '55.000'} [2023-02-25 14:03:44,687][36154] DAMAGECOUNT value on done: 717841.0 [2023-02-25 14:03:44,687][36154] Sum rewards: 61.295, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.222', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.190', 'AMMO4': '0.209', 'AMMO3': '0.243', 'weapon2': '0.304', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.734', 'WEAPON3': '1.450', 'weapon3': '2.184', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '54.000'} [2023-02-25 14:03:44,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 191942656. Throughput: 0: 3344.3. Samples: 10480348. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:03:44,729][36114] Avg episode reward: [(0, '54.353')] [2023-02-25 14:03:44,775][36141] DAMAGECOUNT value on done: 710487.0 [2023-02-25 14:03:44,775][36141] Sum rewards: 50.787, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.830', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.074', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'weapon4': '0.284', 'weapon2': '0.314', 'ARMOR': '0.453', 'WEAPON3': '1.100', 'HITCOUNT': '2.540', 'weapon3': '3.154', 'DAMAGECOUNT': '12.261', 'FRAGCOUNT': '44.000'} [2023-02-25 14:03:45,012][36154] DAMAGECOUNT value on done: 718970.0 [2023-02-25 14:03:45,013][36154] Sum rewards: 42.199, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.280', 'ARMOR': '0.008', 'AMMO5': '0.029', 'AMMO2': '0.065', 'AMMO3': '0.116', 'AMMO4': '0.324', 'weapon4': '0.386', 'weapon5': '0.530', 'WEAPON4': '0.650', 'WEAPON3': '0.650', 'weapon2': '0.778', 'WEAPON5': '0.900', 'weapon3': '1.940', 'HITCOUNT': '2.190', 'DAMAGECOUNT': '13.413', 'FRAGCOUNT': '35.000'} [2023-02-25 14:03:45,194][36138] Updated weights for policy 0, policy_version 46863 (0.0010) [2023-02-25 14:03:45,937][36157] DAMAGECOUNT value on done: 726340.0 [2023-02-25 14:03:45,937][36157] Sum rewards: 58.818, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.330', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO3': '0.149', 'weapon5': '0.188', 'AMMO4': '0.197', 'weapon2': '0.328', 'WEAPON5': '0.350', 'weapon4': '0.368', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'weapon3': '2.856', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '51.500'} [2023-02-25 14:03:46,231][36157] DAMAGECOUNT value on done: 717896.0 [2023-02-25 14:03:46,231][36157] Sum rewards: 45.193, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.240', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.040', 'AMMO3': '0.167', 'weapon2': '0.170', 'weapon5': '0.194', 'AMMO4': '0.201', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.594', 'WEAPON3': '0.950', 'HITCOUNT': '2.420', 'weapon3': '2.766', 'DAMAGECOUNT': '13.164', 'FRAGCOUNT': '40.000'} [2023-02-25 14:03:46,870][36157] DAMAGECOUNT value on done: 726445.0 [2023-02-25 14:03:46,871][36157] Sum rewards: 44.532, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.295', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.080', 'AMMO3': '0.183', 'AMMO4': '0.185', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.422', 'weapon2': '0.744', 'WEAPON3': '1.150', 'weapon3': '2.504', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.639', 'FRAGCOUNT': '41.000'} [2023-02-25 14:03:47,165][36140] DAMAGECOUNT value on done: 726191.0 [2023-02-25 14:03:47,166][36140] Sum rewards: 55.721, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.832', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.202', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.440', 'weapon4': '0.602', 'WEAPON3': '1.400', 'weapon3': '2.316', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.595', 'FRAGCOUNT': '49.000'} [2023-02-25 14:03:47,176][36157] DAMAGECOUNT value on done: 724181.0 [2023-02-25 14:03:47,176][36157] Sum rewards: 64.136, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.790', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.182', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'weapon4': '0.258', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '2.890', 'weapon3': '2.982', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '56.000'} [2023-02-25 14:03:47,473][36140] DAMAGECOUNT value on done: 707334.0 [2023-02-25 14:03:47,473][36140] Sum rewards: 70.783, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.030', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon5': '0.018', 'weapon4': '0.030', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.259', 'weapon2': '0.444', 'WEAPON3': '1.600', 'weapon3': '3.302', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.707', 'FRAGCOUNT': '62.000'} [2023-02-25 14:03:47,759][36140] DAMAGECOUNT value on done: 718937.0 [2023-02-25 14:03:47,759][36140] Sum rewards: 67.466, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.930', 'AMMO5': '0.007', 'weapon4': '0.034', 'AMMO2': '0.034', 'weapon5': '0.058', 'AMMO4': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.614', 'WEAPON3': '1.250', 'weapon3': '3.052', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.218', 'FRAGCOUNT': '58.000'} [2023-02-25 14:03:48,091][36140] DAMAGECOUNT value on done: 715851.0 [2023-02-25 14:03:48,091][36140] Sum rewards: 62.640, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.150', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.127', 'weapon4': '0.204', 'AMMO3': '0.235', 'weapon2': '0.332', 'WEAPON3': '1.300', 'weapon3': '3.198', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.988', 'FRAGCOUNT': '54.000'} [2023-02-25 14:03:48,245][36138] Updated weights for policy 0, policy_version 46873 (0.0009) [2023-02-25 14:03:49,358][36142] DAMAGECOUNT value on done: 727050.0 [2023-02-25 14:03:49,359][36142] Sum rewards: 59.660, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.780', 'AMMO5': '0.017', 'AMMO2': '0.047', 'AMMO3': '0.164', 'weapon5': '0.228', 'AMMO4': '0.233', 'weapon2': '0.272', 'WEAPON5': '0.500', 'weapon4': '0.662', 'WEAPON4': '0.700', 'WEAPON3': '1.000', 'weapon3': '2.580', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.446', 'FRAGCOUNT': '53.000'} [2023-02-25 14:03:49,538][36142] DAMAGECOUNT value on done: 707849.0 [2023-02-25 14:03:49,538][36142] Sum rewards: 50.048, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.498', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.141', 'AMMO3': '0.178', 'weapon5': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.520', 'weapon4': '0.560', 'WEAPON3': '1.150', 'weapon3': '2.350', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.497', 'FRAGCOUNT': '43.000'} [2023-02-25 14:03:49,687][36142] DAMAGECOUNT value on done: 708301.0 [2023-02-25 14:03:49,687][36142] Sum rewards: 44.699, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.581', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO3': '0.096', 'weapon5': '0.134', 'AMMO4': '0.150', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.592', 'WEAPON3': '0.600', 'weapon2': '0.660', 'weapon3': '2.250', 'HITCOUNT': '2.360', 'DAMAGECOUNT': '10.947', 'FRAGCOUNT': '36.000'} [2023-02-25 14:03:49,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 192008192. Throughput: 0: 3342.6. Samples: 10500458. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:03:49,729][36114] Avg episode reward: [(0, '54.117')] [2023-02-25 14:03:49,857][36142] DAMAGECOUNT value on done: 724195.0 [2023-02-25 14:03:49,858][36142] Sum rewards: 64.375, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.875', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.112', 'AMMO4': '0.116', 'AMMO3': '0.227', 'weapon2': '0.286', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.542', 'WEAPON3': '1.350', 'weapon3': '2.774', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '57.000'} [2023-02-25 14:03:50,416][36156] DAMAGECOUNT value on done: 725328.0 [2023-02-25 14:03:50,417][36156] Sum rewards: 52.939, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.655', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.158', 'AMMO3': '0.184', 'weapon4': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.762', 'WEAPON3': '1.100', 'weapon3': '2.644', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.611', 'FRAGCOUNT': '45.000'} [2023-02-25 14:03:50,584][36156] DAMAGECOUNT value on done: 731384.0 [2023-02-25 14:03:50,585][36156] Sum rewards: 66.183, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.400', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.059', 'WEAPON5': '0.100', 'weapon5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.352', 'weapon4': '0.380', 'WEAPON3': '1.200', 'weapon3': '2.938', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '55.000'} [2023-02-25 14:03:50,726][36156] DAMAGECOUNT value on done: 715078.0 [2023-02-25 14:03:50,726][36156] Sum rewards: 48.329, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.363', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.130', 'weapon5': '0.134', 'AMMO4': '0.206', 'AMMO3': '0.232', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.990', 'weapon3': '3.212', 'DAMAGECOUNT': '13.365', 'FRAGCOUNT': '43.500'} [2023-02-25 14:03:50,899][36156] DAMAGECOUNT value on done: 718146.0 [2023-02-25 14:03:50,899][36156] Sum rewards: 52.200, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.060', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.151', 'weapon5': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.464', 'weapon4': '0.590', 'WEAPON3': '0.900', 'weapon3': '2.280', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.515', 'FRAGCOUNT': '43.000'} [2023-02-25 14:03:51,262][36138] Updated weights for policy 0, policy_version 46883 (0.0009) [2023-02-25 14:03:51,996][36155] DAMAGECOUNT value on done: 708657.0 [2023-02-25 14:03:51,996][36155] Sum rewards: 57.221, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.519', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.158', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.268', 'weapon4': '0.270', 'WEAPON3': '1.150', 'weapon3': '3.036', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.391', 'FRAGCOUNT': '49.000'} [2023-02-25 14:03:52,305][36155] DAMAGECOUNT value on done: 730062.0 [2023-02-25 14:03:52,306][36155] Sum rewards: 56.947, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.010', 'AMMO2': '0.053', 'weapon5': '0.078', 'AMMO3': '0.177', 'WEAPON5': '0.250', 'AMMO4': '0.263', 'HEALTH': '0.308', 'weapon4': '0.312', 'weapon2': '0.392', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'weapon3': '2.910', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.854', 'FRAGCOUNT': '49.000'} [2023-02-25 14:03:52,684][36155] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:03:52,883][36155] DAMAGECOUNT value on done: 725772.0 [2023-02-25 14:03:52,883][36155] Sum rewards: 51.432, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.800', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.096', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.216', 'WEAPON4': '0.250', 'weapon4': '0.418', 'WEAPON3': '1.200', 'weapon3': '2.944', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.794', 'FRAGCOUNT': '45.000'} [2023-02-25 14:03:53,185][36155] DAMAGECOUNT value on done: 717680.0 [2023-02-25 14:03:53,185][36155] Sum rewards: 49.587, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.803', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.132', 'AMMO4': '0.191', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.404', 'weapon2': '0.600', 'weapon4': '0.656', 'WEAPON3': '1.200', 'weapon3': '2.280', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '13.281', 'FRAGCOUNT': '43.000'} [2023-02-25 14:03:53,559][36139] DAMAGECOUNT value on done: 723932.0 [2023-02-25 14:03:53,560][36139] Sum rewards: 64.173, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.788', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.158', 'weapon2': '0.200', 'AMMO4': '0.204', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'weapon4': '0.312', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.054', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '56.000'} [2023-02-25 14:03:53,861][36139] DAMAGECOUNT value on done: 715316.0 [2023-02-25 14:03:53,861][36139] Sum rewards: 49.972, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.520', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.041', 'AMMO3': '0.158', 'AMMO4': '0.203', 'weapon5': '0.240', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.466', 'weapon2': '0.716', 'WEAPON3': '0.950', 'weapon3': '2.290', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '13.371', 'FRAGCOUNT': '42.000'} [2023-02-25 14:03:54,190][36139] DAMAGECOUNT value on done: 729384.0 [2023-02-25 14:03:54,190][36139] Sum rewards: 64.686, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.441', 'ARMOR': '0.004', 'AMMO5': '0.027', 'AMMO2': '0.068', 'AMMO3': '0.151', 'weapon5': '0.256', 'AMMO4': '0.341', 'weapon2': '0.400', 'WEAPON4': '0.450', 'WEAPON5': '0.600', 'weapon4': '0.618', 'WEAPON3': '1.000', 'weapon3': '2.376', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '54.000'} [2023-02-25 14:03:54,232][36138] Updated weights for policy 0, policy_version 46893 (0.0009) [2023-02-25 14:03:54,516][36139] DAMAGECOUNT value on done: 721522.0 [2023-02-25 14:03:54,517][36139] Sum rewards: 58.347, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.922', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'weapon5': '0.064', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon4': '0.214', 'weapon2': '0.672', 'WEAPON3': '1.050', 'weapon3': '2.868', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.928', 'FRAGCOUNT': '49.000'} [2023-02-25 14:03:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 192077824. Throughput: 0: 3345.0. Samples: 10510582. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:03:54,729][36114] Avg episode reward: [(0, '54.555')] [2023-02-25 14:03:57,245][36138] Updated weights for policy 0, policy_version 46903 (0.0009) [2023-02-25 14:03:59,729][36114] Fps is (10 sec: 13926.5, 60 sec: 13448.6, 300 sec: 13412.7). Total num frames: 192147456. Throughput: 0: 3348.8. Samples: 10530898. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:03:59,729][36114] Avg episode reward: [(0, '54.555')] [2023-02-25 14:04:00,326][36138] Updated weights for policy 0, policy_version 46913 (0.0009) [2023-02-25 14:04:03,366][36138] Updated weights for policy 0, policy_version 46923 (0.0009) [2023-02-25 14:04:04,114][36154] DAMAGECOUNT value on done: 723415.0 [2023-02-25 14:04:04,115][36154] Sum rewards: 44.353, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.565', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.162', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'AMMO3': '0.252', 'weapon4': '0.314', 'weapon2': '0.342', 'WEAPON3': '1.550', 'HITCOUNT': '2.760', 'weapon3': '2.776', 'DAMAGECOUNT': '12.609', 'FRAGCOUNT': '42.000'} [2023-02-25 14:04:04,117][36141] DAMAGECOUNT value on done: 730011.0 [2023-02-25 14:04:04,118][36141] Sum rewards: 50.800, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.140', 'HEALTH': '0.162', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'weapon2': '0.238', 'WEAPON4': '0.300', 'weapon4': '0.896', 'WEAPON3': '1.050', 'weapon3': '2.436', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.094', 'FRAGCOUNT': '42.000'} [2023-02-25 14:04:04,425][36154] DAMAGECOUNT value on done: 712972.0 [2023-02-25 14:04:04,426][36154] Sum rewards: 39.054, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.734', 'ARMOR': '0.004', 'AMMO5': '0.026', 'AMMO2': '0.059', 'AMMO3': '0.232', 'weapon5': '0.242', 'AMMO4': '0.295', 'weapon2': '0.368', 'weapon4': '0.522', 'WEAPON5': '0.700', 'WEAPON4': '0.750', 'WEAPON3': '1.250', 'weapon3': '2.468', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '13.542', 'FRAGCOUNT': '39.000'} [2023-02-25 14:04:04,435][36141] DAMAGECOUNT value on done: 723894.0 [2023-02-25 14:04:04,436][36141] Sum rewards: 50.441, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.430', 'AMMO5': '0.017', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.177', 'weapon5': '0.198', 'weapon2': '0.444', 'WEAPON5': '0.550', 'WEAPON4': '0.550', 'weapon4': '0.872', 'WEAPON3': '1.100', 'weapon3': '1.950', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.579', 'FRAGCOUNT': '46.000'} [2023-02-25 14:04:04,498][36141] DAMAGECOUNT value on done: 721415.0 [2023-02-25 14:04:04,498][36141] Sum rewards: 65.739, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.955', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.042', 'AMMO3': '0.155', 'weapon5': '0.198', 'AMMO4': '0.212', 'WEAPON5': '0.350', 'weapon2': '0.380', 'WEAPON4': '0.500', 'weapon4': '0.670', 'WEAPON3': '0.900', 'weapon3': '2.442', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '56.000'} [2023-02-25 14:04:04,665][36154] DAMAGECOUNT value on done: 723173.0 [2023-02-25 14:04:04,666][36154] Sum rewards: 54.775, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.730', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.194', 'weapon2': '0.196', 'weapon5': '0.252', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.578', 'WEAPON3': '1.200', 'weapon3': '2.678', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '47.500'} [2023-02-25 14:04:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 192212992. Throughput: 0: 3356.0. Samples: 10551148. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:04:04,729][36114] Avg episode reward: [(0, '54.184')] [2023-02-25 14:04:04,826][36141] DAMAGECOUNT value on done: 715034.0 [2023-02-25 14:04:04,826][36141] Sum rewards: 54.856, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.050', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.080', 'AMMO4': '0.084', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon4': '0.274', 'weapon2': '0.454', 'WEAPON3': '1.250', 'weapon3': '2.984', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.641', 'FRAGCOUNT': '48.000'} [2023-02-25 14:04:04,966][36154] DAMAGECOUNT value on done: 723918.0 [2023-02-25 14:04:04,967][36154] Sum rewards: 61.588, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.772', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.148', 'AMMO3': '0.163', 'weapon4': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.548', 'WEAPON3': '1.000', 'weapon3': '2.860', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.844', 'FRAGCOUNT': '51.000'} [2023-02-25 14:04:05,884][36157] DAMAGECOUNT value on done: 730545.0 [2023-02-25 14:04:05,885][36157] Sum rewards: 46.728, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.532', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon2': '0.198', 'weapon5': '0.216', 'AMMO3': '0.228', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.772', 'WEAPON3': '1.350', 'weapon3': '2.452', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '12.615', 'FRAGCOUNT': '45.000'} [2023-02-25 14:04:06,207][36157] DAMAGECOUNT value on done: 723390.0 [2023-02-25 14:04:06,208][36157] Sum rewards: 54.305, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.742', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.025', 'AMMO2': '0.046', 'AMMO4': '0.229', 'weapon5': '0.238', 'weapon4': '0.238', 'AMMO3': '0.243', 'weapon2': '0.416', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.756', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.482', 'FRAGCOUNT': '49.500'} [2023-02-25 14:04:06,438][36138] Updated weights for policy 0, policy_version 46933 (0.0009) [2023-02-25 14:04:06,857][36157] DAMAGECOUNT value on done: 732043.0 [2023-02-25 14:04:06,857][36157] Sum rewards: 66.562, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.550', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.066', 'weapon5': '0.066', 'AMMO4': '0.138', 'AMMO3': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON3': '0.900', 'weapon3': '3.226', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '55.000'} [2023-02-25 14:04:06,916][36140] DAMAGECOUNT value on done: 731316.0 [2023-02-25 14:04:06,917][36140] Sum rewards: 58.163, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.290', 'AMMO5': '0.019', 'AMMO2': '0.032', 'weapon5': '0.126', 'weapon4': '0.158', 'AMMO4': '0.161', 'AMMO3': '0.187', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.526', 'WEAPON3': '1.200', 'weapon3': '2.948', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '51.000'} [2023-02-25 14:04:07,177][36157] DAMAGECOUNT value on done: 729326.0 [2023-02-25 14:04:07,177][36157] Sum rewards: 52.510, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.464', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon5': '0.086', 'weapon4': '0.116', 'AMMO4': '0.195', 'WEAPON4': '0.200', 'AMMO3': '0.310', 'weapon2': '0.328', 'WEAPON5': '0.350', 'WEAPON3': '1.850', 'HITCOUNT': '3.150', 'weapon3': '3.152', 'DAMAGECOUNT': '15.435', 'FRAGCOUNT': '49.000'} [2023-02-25 14:04:07,238][36140] DAMAGECOUNT value on done: 711827.0 [2023-02-25 14:04:07,239][36140] Sum rewards: 50.063, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.985', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon5': '0.082', 'AMMO3': '0.170', 'weapon2': '0.250', 'AMMO4': '0.274', 'WEAPON5': '0.350', 'weapon4': '0.380', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.992', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.479', 'FRAGCOUNT': '44.500'} [2023-02-25 14:04:07,531][36140] DAMAGECOUNT value on done: 723321.0 [2023-02-25 14:04:07,532][36140] Sum rewards: 55.414, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.070', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.020', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.130', 'AMMO3': '0.191', 'weapon2': '0.446', 'WEAPON3': '1.100', 'HITCOUNT': '2.910', 'weapon3': '3.078', 'DAMAGECOUNT': '13.152', 'FRAGCOUNT': '47.000'} [2023-02-25 14:04:07,846][36140] DAMAGECOUNT value on done: 720007.0 [2023-02-25 14:04:07,847][36140] Sum rewards: 52.325, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.350', 'AMMO5': '0.004', 'AMMO2': '0.005', 'AMMO4': '0.024', 'weapon5': '0.032', 'weapon4': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'weapon2': '0.480', 'WEAPON3': '1.200', 'HITCOUNT': '2.810', 'weapon3': '3.262', 'DAMAGECOUNT': '12.468', 'FRAGCOUNT': '45.000'} [2023-02-25 14:04:09,283][36142] DAMAGECOUNT value on done: 731582.0 [2023-02-25 14:04:09,284][36142] Sum rewards: 53.913, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.265', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.132', 'weapon2': '0.606', 'WEAPON3': '0.900', 'HITCOUNT': '2.990', 'weapon3': '3.116', 'DAMAGECOUNT': '13.596', 'FRAGCOUNT': '42.000'} [2023-02-25 14:04:09,463][36142] DAMAGECOUNT value on done: 713683.0 [2023-02-25 14:04:09,463][36142] Sum rewards: 68.139, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.442', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.146', 'weapon2': '0.160', 'AMMO3': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.632', 'WEAPON3': '1.000', 'weapon3': '2.714', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '55.000'} [2023-02-25 14:04:09,468][36138] Updated weights for policy 0, policy_version 46943 (0.0009) [2023-02-25 14:04:09,612][36142] DAMAGECOUNT value on done: 712796.0 [2023-02-25 14:04:09,612][36142] Sum rewards: 53.161, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.280', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.176', 'weapon5': '0.230', 'weapon2': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.570', 'WEAPON3': '1.050', 'weapon3': '2.634', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '13.485', 'FRAGCOUNT': '44.500'} [2023-02-25 14:04:09,729][36114] Fps is (10 sec: 13107.0, 60 sec: 13380.2, 300 sec: 13398.8). Total num frames: 192278528. Throughput: 0: 3353.6. Samples: 10561062. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:04:09,730][36114] Avg episode reward: [(0, '54.610')] [2023-02-25 14:04:09,787][36142] DAMAGECOUNT value on done: 728496.0 [2023-02-25 14:04:09,788][36142] Sum rewards: 42.145, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.226', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.049', 'weapon5': '0.132', 'AMMO4': '0.243', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'weapon2': '0.424', 'WEAPON4': '0.450', 'weapon4': '0.526', 'WEAPON3': '1.550', 'weapon3': '2.464', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '12.903', 'FRAGCOUNT': '41.000'} [2023-02-25 14:04:10,335][36156] DAMAGECOUNT value on done: 729669.0 [2023-02-25 14:04:10,335][36156] Sum rewards: 51.851, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.918', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.038', 'weapon4': '0.102', 'weapon5': '0.178', 'AMMO4': '0.190', 'weapon2': '0.206', 'AMMO3': '0.213', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'HITCOUNT': '2.650', 'weapon3': '3.186', 'DAMAGECOUNT': '12.927', 'FRAGCOUNT': '47.000'} [2023-02-25 14:04:10,492][36156] DAMAGECOUNT value on done: 735674.0 [2023-02-25 14:04:10,492][36156] Sum rewards: 50.372, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.862', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.038', 'weapon7': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.203', 'weapon2': '0.398', 'weapon4': '0.402', 'WEAPON3': '1.300', 'HITCOUNT': '2.630', 'weapon3': '2.774', 'DAMAGECOUNT': '12.870', 'FRAGCOUNT': '44.500'} [2023-02-25 14:04:10,647][36156] DAMAGECOUNT value on done: 719916.0 [2023-02-25 14:04:10,648][36156] Sum rewards: 50.050, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.728', 'ARMOR': '0.004', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO4': '0.152', 'AMMO3': '0.193', 'weapon5': '0.244', 'weapon2': '0.286', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.662', 'WEAPON3': '1.150', 'weapon3': '2.444', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.514', 'FRAGCOUNT': '43.000'} [2023-02-25 14:04:10,798][36156] DAMAGECOUNT value on done: 722324.0 [2023-02-25 14:04:10,799][36156] Sum rewards: 51.028, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.526', 'AMMO5': '0.017', 'AMMO2': '0.021', 'weapon4': '0.062', 'AMMO4': '0.103', 'AMMO3': '0.129', 'WEAPON4': '0.200', 'weapon5': '0.304', 'WEAPON5': '0.350', 'weapon2': '0.634', 'WEAPON3': '0.900', 'HITCOUNT': '2.540', 'weapon3': '2.760', 'DAMAGECOUNT': '12.534', 'FRAGCOUNT': '41.000'} [2023-02-25 14:04:11,832][36155] DAMAGECOUNT value on done: 713102.0 [2023-02-25 14:04:11,832][36155] Sum rewards: 50.445, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.525', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.148', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.502', 'weapon2': '0.558', 'WEAPON3': '1.150', 'weapon3': '2.428', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.230', 'FRAGCOUNT': '43.000'} [2023-02-25 14:04:12,130][36155] DAMAGECOUNT value on done: 734487.0 [2023-02-25 14:04:12,130][36155] Sum rewards: 51.363, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.930', 'AMMO2': '0.002', 'AMMO4': '0.008', 'WEAPON4': '0.100', 'AMMO3': '0.184', 'weapon4': '0.220', 'weapon2': '0.436', 'WEAPON3': '1.100', 'HITCOUNT': '2.990', 'weapon3': '3.228', 'DAMAGECOUNT': '13.275', 'FRAGCOUNT': '42.000'} [2023-02-25 14:04:12,546][36138] Updated weights for policy 0, policy_version 46953 (0.0009) [2023-02-25 14:04:12,728][36155] DAMAGECOUNT value on done: 730700.0 [2023-02-25 14:04:12,728][36155] Sum rewards: 55.378, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.920', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.026', 'AMMO4': '0.127', 'weapon5': '0.160', 'weapon2': '0.196', 'AMMO3': '0.198', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'weapon4': '0.862', 'WEAPON3': '1.200', 'weapon3': '2.378', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.784', 'FRAGCOUNT': '49.000'} [2023-02-25 14:04:13,029][36155] DAMAGECOUNT value on done: 722679.0 [2023-02-25 14:04:13,029][36155] Sum rewards: 59.528, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.002', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.088', 'AMMO4': '0.126', 'weapon2': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon4': '0.378', 'WEAPON3': '1.500', 'weapon3': '3.040', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '14.997', 'FRAGCOUNT': '53.000'} [2023-02-25 14:04:13,476][36139] DAMAGECOUNT value on done: 728262.0 [2023-02-25 14:04:13,477][36139] Sum rewards: 45.574, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.836', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon5': '0.116', 'AMMO4': '0.118', 'weapon4': '0.174', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.426', 'WEAPON3': '1.350', 'HITCOUNT': '2.670', 'weapon3': '3.066', 'DAMAGECOUNT': '12.984', 'FRAGCOUNT': '41.000'} [2023-02-25 14:04:13,773][36139] DAMAGECOUNT value on done: 719760.0 [2023-02-25 14:04:13,774][36139] Sum rewards: 52.240, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.785', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.088', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.368', 'WEAPON4': '0.400', 'weapon4': '0.494', 'WEAPON3': '1.250', 'weapon3': '2.818', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.332', 'FRAGCOUNT': '47.000'} [2023-02-25 14:04:14,105][36139] DAMAGECOUNT value on done: 734439.0 [2023-02-25 14:04:14,105][36139] Sum rewards: 57.162, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.930', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.049', 'weapon5': '0.144', 'AMMO3': '0.169', 'AMMO4': '0.246', 'weapon2': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.980', 'WEAPON3': '1.050', 'weapon3': '2.214', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.165', 'FRAGCOUNT': '48.000'} [2023-02-25 14:04:14,427][36139] DAMAGECOUNT value on done: 725521.0 [2023-02-25 14:04:14,428][36139] Sum rewards: 44.734, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.762', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon4': '0.192', 'weapon2': '0.214', 'AMMO3': '0.272', 'WEAPON3': '1.550', 'HITCOUNT': '2.740', 'weapon3': '3.326', 'DAMAGECOUNT': '11.997', 'FRAGCOUNT': '41.000'} [2023-02-25 14:04:14,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 192348160. Throughput: 0: 3357.6. Samples: 10581184. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:04:14,730][36114] Avg episode reward: [(0, '54.239')] [2023-02-25 14:04:15,586][36138] Updated weights for policy 0, policy_version 46963 (0.0009) [2023-02-25 14:04:18,668][36138] Updated weights for policy 0, policy_version 46973 (0.0009) [2023-02-25 14:04:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 192413696. Throughput: 0: 3356.8. Samples: 10601238. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:04:19,729][36114] Avg episode reward: [(0, '54.239')] [2023-02-25 14:04:20,452][36155] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:04:21,664][36138] Updated weights for policy 0, policy_version 46983 (0.0009) [2023-02-25 14:04:24,245][36154] DAMAGECOUNT value on done: 728961.0 [2023-02-25 14:04:24,245][36154] Sum rewards: 56.959, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.260', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.046', 'AMMO3': '0.191', 'AMMO4': '0.230', 'weapon4': '0.270', 'weapon5': '0.394', 'weapon2': '0.428', 'WEAPON4': '0.450', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.568', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '48.000'} [2023-02-25 14:04:24,258][36141] DAMAGECOUNT value on done: 734696.0 [2023-02-25 14:04:24,258][36141] Sum rewards: 52.356, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.397', 'AMMO5': '0.009', 'AMMO2': '0.021', 'AMMO4': '0.102', 'weapon5': '0.146', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.398', 'WEAPON4': '0.400', 'weapon4': '0.526', 'WEAPON3': '1.150', 'weapon3': '2.630', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.055', 'FRAGCOUNT': '46.000'} [2023-02-25 14:04:24,552][36154] DAMAGECOUNT value on done: 717509.0 [2023-02-25 14:04:24,553][36154] Sum rewards: 47.140, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.497', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.140', 'AMMO3': '0.214', 'AMMO4': '0.232', 'WEAPON5': '0.250', 'weapon2': '0.288', 'ARMOR': '0.460', 'weapon4': '0.548', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '2.740', 'weapon3': '2.750', 'DAMAGECOUNT': '13.611', 'FRAGCOUNT': '43.000'} [2023-02-25 14:04:24,567][36141] DAMAGECOUNT value on done: 728693.0 [2023-02-25 14:04:24,567][36141] Sum rewards: 60.583, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.810', 'AMMO2': '0.003', 'AMMO4': '0.013', 'WEAPON4': '0.100', 'AMMO3': '0.210', 'weapon4': '0.240', 'weapon2': '0.518', 'WEAPON3': '1.300', 'weapon3': '3.082', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.397', 'FRAGCOUNT': '52.000'} [2023-02-25 14:04:24,664][36141] DAMAGECOUNT value on done: 725762.0 [2023-02-25 14:04:24,664][36141] Sum rewards: 52.613, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.554', 'AMMO5': '0.023', 'AMMO2': '0.032', 'weapon5': '0.092', 'AMMO4': '0.158', 'AMMO3': '0.253', 'weapon4': '0.266', 'weapon2': '0.272', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'HITCOUNT': '2.810', 'weapon3': '3.070', 'DAMAGECOUNT': '13.041', 'FRAGCOUNT': '50.000'} [2023-02-25 14:04:24,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 192479232. Throughput: 0: 3357.7. Samples: 10611416. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:04:24,729][36114] Avg episode reward: [(0, '54.211')] [2023-02-25 14:04:24,770][36138] Updated weights for policy 0, policy_version 46993 (0.0009) [2023-02-25 14:04:24,782][36154] DAMAGECOUNT value on done: 727768.0 [2023-02-25 14:04:24,783][36154] Sum rewards: 53.028, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.358', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.032', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'weapon2': '0.152', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.304', 'WEAPON3': '1.250', 'HITCOUNT': '3.160', 'weapon3': '3.256', 'DAMAGECOUNT': '13.785', 'FRAGCOUNT': '46.000'} [2023-02-25 14:04:24,958][36141] DAMAGECOUNT value on done: 720429.0 [2023-02-25 14:04:24,959][36141] Sum rewards: 53.171, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.946', 'WEAPON1': '0.010', 'AMMO5': '0.025', 'AMMO2': '0.061', 'weapon7': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.129', 'AMMO4': '0.305', 'weapon2': '0.378', 'weapon5': '0.430', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '0.700', 'weapon4': '0.972', 'weapon3': '1.554', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '45.500'} [2023-02-25 14:04:25,098][36154] DAMAGECOUNT value on done: 729040.0 [2023-02-25 14:04:25,098][36154] Sum rewards: 62.799, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.264', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon5': '0.080', 'AMMO4': '0.116', 'AMMO3': '0.153', 'weapon4': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.404', 'WEAPON3': '0.950', 'weapon3': '3.148', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.366', 'FRAGCOUNT': '51.000'} [2023-02-25 14:04:25,995][36157] DAMAGECOUNT value on done: 735143.0 [2023-02-25 14:04:25,996][36157] Sum rewards: 46.680, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.890', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.224', 'weapon5': '0.258', 'weapon2': '0.352', 'WEAPON4': '0.400', 'weapon4': '0.462', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.448', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.779', 'FRAGCOUNT': '41.000'} [2023-02-25 14:04:26,305][36157] DAMAGECOUNT value on done: 727968.0 [2023-02-25 14:04:26,305][36157] Sum rewards: 48.460, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.256', 'AMMO5': '0.016', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.136', 'AMMO3': '0.209', 'weapon2': '0.290', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.734', 'WEAPON3': '1.250', 'weapon3': '2.526', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.644', 'FRAGCOUNT': '42.000'} [2023-02-25 14:04:26,943][36157] DAMAGECOUNT value on done: 736966.0 [2023-02-25 14:04:26,944][36157] Sum rewards: 58.407, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.870', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.042', 'AMMO3': '0.182', 'AMMO4': '0.209', 'weapon5': '0.226', 'WEAPON5': '0.350', 'weapon2': '0.386', 'WEAPON4': '0.450', 'weapon4': '0.546', 'WEAPON3': '1.050', 'weapon3': '2.470', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.769', 'FRAGCOUNT': '51.000'} [2023-02-25 14:04:26,989][36140] DAMAGECOUNT value on done: 736436.0 [2023-02-25 14:04:26,989][36140] Sum rewards: 54.036, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.340', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.174', 'weapon4': '0.220', 'WEAPON4': '0.250', 'AMMO3': '0.282', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.700', 'HITCOUNT': '2.930', 'weapon3': '2.970', 'DAMAGECOUNT': '15.360', 'FRAGCOUNT': '50.000'} [2023-02-25 14:04:27,256][36157] DAMAGECOUNT value on done: 734841.0 [2023-02-25 14:04:27,257][36157] Sum rewards: 67.553, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.510', 'AMMO5': '0.007', 'weapon5': '0.044', 'AMMO2': '0.046', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'AMMO4': '0.231', 'WEAPON4': '0.400', 'weapon4': '0.400', 'weapon2': '0.410', 'WEAPON3': '1.100', 'weapon3': '2.868', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '57.000'} [2023-02-25 14:04:27,303][36140] DAMAGECOUNT value on done: 716081.0 [2023-02-25 14:04:27,304][36140] Sum rewards: 44.552, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.823', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.170', 'WEAPON5': '0.200', 'weapon2': '0.212', 'AMMO4': '0.223', 'AMMO3': '0.277', 'WEAPON4': '0.350', 'weapon4': '0.568', 'WEAPON3': '1.650', 'weapon3': '2.644', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.762', 'FRAGCOUNT': '45.000'} [2023-02-25 14:04:27,616][36140] DAMAGECOUNT value on done: 728251.0 [2023-02-25 14:04:27,617][36140] Sum rewards: 56.978, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.966', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.048', 'WEAPON5': '0.150', 'AMMO4': '0.181', 'AMMO3': '0.188', 'weapon2': '0.292', 'WEAPON4': '0.400', 'ARMOR': '0.408', 'weapon4': '0.818', 'WEAPON3': '1.050', 'weapon3': '2.476', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.790', 'FRAGCOUNT': '48.000'} [2023-02-25 14:04:27,786][36138] Updated weights for policy 0, policy_version 47003 (0.0009) [2023-02-25 14:04:27,928][36140] DAMAGECOUNT value on done: 724776.0 [2023-02-25 14:04:27,929][36140] Sum rewards: 53.195, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.677', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.130', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.262', 'weapon4': '0.334', 'WEAPON3': '1.250', 'weapon3': '2.988', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.307', 'FRAGCOUNT': '47.500'} [2023-02-25 14:04:29,326][36142] DAMAGECOUNT value on done: 735732.0 [2023-02-25 14:04:29,327][36142] Sum rewards: 47.285, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.882', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.160', 'AMMO3': '0.188', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.610', 'weapon4': '0.784', 'WEAPON3': '1.150', 'weapon3': '2.092', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '12.450', 'FRAGCOUNT': '42.000'} [2023-02-25 14:04:29,551][36142] DAMAGECOUNT value on done: 718990.0 [2023-02-25 14:04:29,551][36142] Sum rewards: 68.668, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.316', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon5': '0.034', 'weapon4': '0.048', 'AMMO4': '0.126', 'AMMO3': '0.166', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.358', 'WEAPON3': '1.050', 'HITCOUNT': '3.370', 'weapon3': '3.374', 'DAMAGECOUNT': '15.921', 'FRAGCOUNT': '57.000'} [2023-02-25 14:04:29,647][36142] DAMAGECOUNT value on done: 717679.0 [2023-02-25 14:04:29,648][36142] Sum rewards: 56.715, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.886', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.191', 'WEAPON4': '0.300', 'weapon2': '0.450', 'ARMOR': '0.457', 'weapon4': '0.704', 'WEAPON3': '1.100', 'weapon3': '2.582', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.649', 'FRAGCOUNT': '49.000'} [2023-02-25 14:04:29,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13412.7). Total num frames: 192548864. Throughput: 0: 3359.2. Samples: 10631510. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:04:29,730][36114] Avg episode reward: [(0, '54.367')] [2023-02-25 14:04:29,869][36142] DAMAGECOUNT value on done: 733640.0 [2023-02-25 14:04:29,870][36142] Sum rewards: 63.110, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.652', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.064', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.221', 'weapon4': '0.240', 'weapon2': '0.420', 'WEAPON3': '1.300', 'weapon3': '2.728', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.432', 'FRAGCOUNT': '55.000'} [2023-02-25 14:04:30,410][36156] DAMAGECOUNT value on done: 733739.0 [2023-02-25 14:04:30,410][36156] Sum rewards: 52.182, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.900', 'AMMO5': '0.006', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'weapon4': '0.048', 'weapon5': '0.124', 'AMMO4': '0.150', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.660', 'WEAPON3': '1.100', 'HITCOUNT': '2.540', 'weapon3': '2.858', 'DAMAGECOUNT': '12.210', 'FRAGCOUNT': '45.000'} [2023-02-25 14:04:30,572][36156] DAMAGECOUNT value on done: 740006.0 [2023-02-25 14:04:30,573][36156] Sum rewards: 51.086, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.604', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon2': '0.332', 'weapon4': '0.342', 'WEAPON3': '1.300', 'weapon3': '2.852', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.990', 'FRAGCOUNT': '47.000'} [2023-02-25 14:04:30,746][36156] DAMAGECOUNT value on done: 724566.0 [2023-02-25 14:04:30,747][36156] Sum rewards: 55.329, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.820', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon2': '0.226', 'AMMO3': '0.241', 'WEAPON3': '1.450', 'HITCOUNT': '3.140', 'weapon3': '3.572', 'DAMAGECOUNT': '13.950', 'FRAGCOUNT': '48.000'} [2023-02-25 14:04:30,877][36138] Updated weights for policy 0, policy_version 47013 (0.0009) [2023-02-25 14:04:30,889][36156] DAMAGECOUNT value on done: 727372.0 [2023-02-25 14:04:30,889][36156] Sum rewards: 56.255, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.606', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'weapon2': '0.192', 'WEAPON5': '0.200', 'weapon4': '0.304', 'WEAPON3': '1.100', 'HITCOUNT': '3.000', 'weapon3': '3.110', 'DAMAGECOUNT': '15.144', 'FRAGCOUNT': '46.000'} [2023-02-25 14:04:31,882][36155] DAMAGECOUNT value on done: 717976.0 [2023-02-25 14:04:31,883][36155] Sum rewards: 52.136, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.399', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.049', 'AMMO3': '0.195', 'AMMO4': '0.246', 'weapon2': '0.318', 'WEAPON4': '0.350', 'weapon5': '0.388', 'WEAPON5': '0.450', 'weapon4': '0.718', 'WEAPON3': '1.150', 'weapon3': '2.102', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.292', 'FRAGCOUNT': '46.000'} [2023-02-25 14:04:32,189][36155] DAMAGECOUNT value on done: 739450.0 [2023-02-25 14:04:32,190][36155] Sum rewards: 55.655, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-2.373', 'AMMO5': '0.016', 'ARMOR': '0.016', 'AMMO2': '0.046', 'weapon5': '0.178', 'AMMO4': '0.232', 'AMMO3': '0.280', 'WEAPON5': '0.350', 'weapon2': '0.414', 'weapon4': '0.498', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.498', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.889', 'FRAGCOUNT': '54.500'} [2023-02-25 14:04:32,759][36155] DAMAGECOUNT value on done: 734359.0 [2023-02-25 14:04:32,759][36155] Sum rewards: 46.524, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.528', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.022', 'weapon5': '0.046', 'AMMO3': '0.104', 'AMMO4': '0.109', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.504', 'weapon2': '0.720', 'WEAPON3': '0.750', 'weapon3': '2.624', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '10.977', 'FRAGCOUNT': '38.000'} [2023-02-25 14:04:33,057][36155] DAMAGECOUNT value on done: 727854.0 [2023-02-25 14:04:33,058][36155] Sum rewards: 58.487, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.760', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.094', 'weapon2': '0.190', 'AMMO4': '0.199', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.528', 'WEAPON3': '1.400', 'weapon3': '2.894', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.525', 'FRAGCOUNT': '53.000'} [2023-02-25 14:04:33,105][36154] Large shaping reward -2.534 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:04:33,544][36139] DAMAGECOUNT value on done: 732503.0 [2023-02-25 14:04:33,544][36139] Sum rewards: 44.154, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.822', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon4': '0.110', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.660', 'WEAPON3': '1.150', 'HITCOUNT': '2.350', 'weapon3': '2.866', 'DAMAGECOUNT': '12.723', 'FRAGCOUNT': '38.000'} [2023-02-25 14:04:33,846][36139] DAMAGECOUNT value on done: 724280.0 [2023-02-25 14:04:33,846][36139] Sum rewards: 53.242, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.209', 'AMMO5': '0.015', 'AMMO2': '0.052', 'AMMO3': '0.135', 'AMMO4': '0.259', 'weapon5': '0.260', 'WEAPON5': '0.500', 'weapon4': '0.504', 'WEAPON4': '0.600', 'weapon2': '0.622', 'WEAPON3': '0.850', 'weapon3': '2.334', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '13.560', 'FRAGCOUNT': '46.000'} [2023-02-25 14:04:33,950][36138] Updated weights for policy 0, policy_version 47023 (0.0009) [2023-02-25 14:04:34,173][36139] DAMAGECOUNT value on done: 738932.0 [2023-02-25 14:04:34,173][36139] Sum rewards: 53.196, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.418', 'ARMOR': '0.008', 'AMMO5': '0.024', 'AMMO2': '0.064', 'AMMO3': '0.154', 'weapon5': '0.258', 'AMMO4': '0.322', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'weapon4': '0.670', 'weapon2': '0.712', 'WEAPON3': '0.850', 'weapon3': '2.022', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '13.479', 'FRAGCOUNT': '47.000'} [2023-02-25 14:04:34,479][36139] DAMAGECOUNT value on done: 729871.0 [2023-02-25 14:04:34,480][36139] Sum rewards: 45.669, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.245', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon5': '0.166', 'AMMO3': '0.175', 'AMMO4': '0.255', 'WEAPON5': '0.400', 'weapon2': '0.456', 'WEAPON4': '0.650', 'weapon4': '0.844', 'WEAPON3': '1.100', 'weapon3': '2.038', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.047', 'FRAGCOUNT': '41.500'} [2023-02-25 14:04:34,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 192614400. Throughput: 0: 3357.3. Samples: 10651538. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:04:34,730][36114] Avg episode reward: [(0, '54.365')] [2023-02-25 14:04:36,974][36138] Updated weights for policy 0, policy_version 47033 (0.0010) [2023-02-25 14:04:39,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 192684032. Throughput: 0: 3356.4. Samples: 10661622. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:04:39,729][36114] Avg episode reward: [(0, '54.365')] [2023-02-25 14:04:40,025][36138] Updated weights for policy 0, policy_version 47043 (0.0010) [2023-02-25 14:04:43,082][36138] Updated weights for policy 0, policy_version 47053 (0.0010) [2023-02-25 14:04:44,043][36140] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:04:44,105][36141] DAMAGECOUNT value on done: 738371.0 [2023-02-25 14:04:44,106][36141] Sum rewards: 44.107, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.380', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.049', 'weapon5': '0.090', 'AMMO3': '0.115', 'AMMO4': '0.243', 'weapon2': '0.344', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.736', 'WEAPON3': '0.750', 'weapon3': '2.322', 'HITCOUNT': '2.340', 'DAMAGECOUNT': '11.025', 'FRAGCOUNT': '38.000'} [2023-02-25 14:04:44,255][36154] DAMAGECOUNT value on done: 733428.0 [2023-02-25 14:04:44,255][36154] Sum rewards: 50.140, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.555', 'AMMO5': '0.021', 'AMMO2': '0.026', 'AMMO4': '0.133', 'weapon4': '0.146', 'AMMO3': '0.176', 'weapon5': '0.180', 'WEAPON4': '0.300', 'WEAPON5': '0.500', 'weapon2': '0.634', 'WEAPON3': '1.250', 'HITCOUNT': '2.480', 'weapon3': '2.698', 'DAMAGECOUNT': '13.401', 'FRAGCOUNT': '44.500'} [2023-02-25 14:04:44,427][36141] DAMAGECOUNT value on done: 733214.0 [2023-02-25 14:04:44,427][36141] Sum rewards: 51.245, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.042', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.081', 'weapon5': '0.096', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.200', 'AMMO3': '0.236', 'weapon2': '0.882', 'WEAPON3': '1.450', 'weapon3': '2.564', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.563', 'FRAGCOUNT': '46.000'} [2023-02-25 14:04:44,516][36141] DAMAGECOUNT value on done: 729557.0 [2023-02-25 14:04:44,517][36141] Sum rewards: 47.095, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.510', 'AMMO5': '0.010', 'AMMO2': '0.046', 'AMMO3': '0.114', 'weapon5': '0.124', 'AMMO4': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.610', 'weapon2': '0.618', 'WEAPON3': '0.750', 'weapon3': '1.952', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '11.379', 'FRAGCOUNT': '40.000'} [2023-02-25 14:04:44,558][36154] DAMAGECOUNT value on done: 722321.0 [2023-02-25 14:04:44,558][36154] Sum rewards: 57.659, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.759', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.041', 'AMMO3': '0.120', 'weapon5': '0.158', 'AMMO4': '0.203', 'weapon2': '0.394', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '0.850', 'weapon4': '1.060', 'weapon3': '2.052', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.436', 'FRAGCOUNT': '48.000'} [2023-02-25 14:04:44,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 192749568. Throughput: 0: 3355.4. Samples: 10681890. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:04:44,730][36114] Avg episode reward: [(0, '53.937')] [2023-02-25 14:04:44,779][36154] DAMAGECOUNT value on done: 732412.0 [2023-02-25 14:04:44,780][36154] Sum rewards: 51.873, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.180', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.196', 'weapon2': '0.222', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.740', 'WEAPON3': '1.400', 'weapon3': '2.402', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.932', 'FRAGCOUNT': '47.000'} [2023-02-25 14:04:44,837][36141] DAMAGECOUNT value on done: 724517.0 [2023-02-25 14:04:44,837][36141] Sum rewards: 47.653, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.777', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.136', 'AMMO3': '0.146', 'weapon2': '0.172', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'ARMOR': '0.456', 'weapon4': '0.858', 'WEAPON3': '0.950', 'weapon3': '2.260', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '12.264', 'FRAGCOUNT': '40.000'} [2023-02-25 14:04:45,094][36154] DAMAGECOUNT value on done: 733304.0 [2023-02-25 14:04:45,095][36154] Sum rewards: 49.148, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.690', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.028', 'AMMO3': '0.106', 'weapon5': '0.128', 'AMMO4': '0.137', 'WEAPON5': '0.350', 'weapon2': '0.474', 'WEAPON4': '0.550', 'WEAPON3': '0.600', 'weapon4': '1.020', 'weapon3': '1.984', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '12.792', 'FRAGCOUNT': '41.000'} [2023-02-25 14:04:46,067][36157] DAMAGECOUNT value on done: 741144.0 [2023-02-25 14:04:46,068][36157] Sum rewards: 68.496, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.460', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.108', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.478', 'weapon4': '0.546', 'WEAPON3': '1.250', 'weapon3': '2.646', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '57.000'} [2023-02-25 14:04:46,110][36138] Updated weights for policy 0, policy_version 47063 (0.0009) [2023-02-25 14:04:46,397][36157] DAMAGECOUNT value on done: 732151.0 [2023-02-25 14:04:46,398][36157] Sum rewards: 47.023, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.442', 'AMMO5': '0.010', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.070', 'weapon5': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'WEAPON5': '0.250', 'weapon4': '0.250', 'weapon2': '0.492', 'WEAPON3': '1.050', 'HITCOUNT': '2.700', 'weapon3': '2.894', 'DAMAGECOUNT': '12.549', 'FRAGCOUNT': '39.000'} [2023-02-25 14:04:47,032][36157] DAMAGECOUNT value on done: 743086.0 [2023-02-25 14:04:47,032][36157] Sum rewards: 71.312, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.292', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.104', 'weapon2': '0.154', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon4': '0.340', 'WEAPON3': '1.350', 'weapon3': '3.124', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '60.000'} [2023-02-25 14:04:47,073][36140] DAMAGECOUNT value on done: 740727.0 [2023-02-25 14:04:47,073][36140] Sum rewards: 48.410, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.818', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.147', 'weapon5': '0.152', 'WEAPON5': '0.250', 'ARMOR': '0.504', 'weapon2': '0.540', 'WEAPON4': '0.550', 'weapon4': '0.790', 'WEAPON3': '0.850', 'weapon3': '2.044', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '12.873', 'FRAGCOUNT': '41.000'} [2023-02-25 14:04:47,346][36157] DAMAGECOUNT value on done: 739268.0 [2023-02-25 14:04:47,347][36157] Sum rewards: 44.427, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.357', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.059', 'AMMO3': '0.186', 'weapon5': '0.276', 'weapon2': '0.284', 'AMMO4': '0.295', 'WEAPON5': '0.600', 'weapon4': '0.794', 'WEAPON4': '0.800', 'WEAPON3': '1.200', 'weapon3': '2.220', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.281', 'FRAGCOUNT': '41.000'} [2023-02-25 14:04:47,394][36140] DAMAGECOUNT value on done: 721751.0 [2023-02-25 14:04:47,394][36140] Sum rewards: 70.457, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.684', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.126', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'weapon4': '0.380', 'weapon2': '0.460', 'WEAPON3': '1.400', 'weapon3': '2.752', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '62.000'} [2023-02-25 14:04:47,690][36140] DAMAGECOUNT value on done: 732287.0 [2023-02-25 14:04:47,690][36140] Sum rewards: 49.041, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.360', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon5': '0.096', 'AMMO4': '0.111', 'AMMO3': '0.127', 'weapon2': '0.172', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.846', 'WEAPON3': '0.850', 'weapon3': '2.272', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '12.108', 'FRAGCOUNT': '41.000'} [2023-02-25 14:04:47,997][36140] DAMAGECOUNT value on done: 729189.0 [2023-02-25 14:04:47,997][36140] Sum rewards: 46.892, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.410', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'WEAPON4': '0.350', 'weapon2': '0.362', 'weapon4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.790', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.194', 'FRAGCOUNT': '43.000'} [2023-02-25 14:04:49,172][36138] Updated weights for policy 0, policy_version 47073 (0.0009) [2023-02-25 14:04:49,401][36142] DAMAGECOUNT value on done: 739874.0 [2023-02-25 14:04:49,401][36142] Sum rewards: 45.086, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.630', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.120', 'weapon2': '0.154', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'weapon4': '0.410', 'WEAPON3': '1.400', 'HITCOUNT': '2.780', 'weapon3': '3.050', 'DAMAGECOUNT': '12.426', 'FRAGCOUNT': '42.000'} [2023-02-25 14:04:49,624][36142] DAMAGECOUNT value on done: 723727.0 [2023-02-25 14:04:49,624][36142] Sum rewards: 52.822, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.035', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon2': '0.170', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon4': '0.448', 'WEAPON3': '1.150', 'HITCOUNT': '3.130', 'weapon3': '3.216', 'DAMAGECOUNT': '14.211', 'FRAGCOUNT': '43.000'} [2023-02-25 14:04:49,707][36142] DAMAGECOUNT value on done: 721877.0 [2023-02-25 14:04:49,708][36142] Sum rewards: 44.838, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.204', 'AMMO5': '0.013', 'AMMO2': '0.067', 'AMMO3': '0.143', 'weapon5': '0.186', 'weapon2': '0.232', 'WEAPON5': '0.300', 'AMMO4': '0.335', 'WEAPON4': '0.700', 'weapon4': '0.800', 'WEAPON3': '0.850', 'weapon3': '2.492', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.594', 'FRAGCOUNT': '41.000'} [2023-02-25 14:04:49,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 192815104. Throughput: 0: 3351.0. Samples: 10701942. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:04:49,730][36114] Avg episode reward: [(0, '53.641')] [2023-02-25 14:04:49,943][36142] DAMAGECOUNT value on done: 739476.0 [2023-02-25 14:04:49,943][36142] Sum rewards: 63.705, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.600', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.078', 'weapon4': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.196', 'AMMO3': '0.319', 'WEAPON3': '1.950', 'weapon3': '3.326', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.508', 'FRAGCOUNT': '59.000'} [2023-02-25 14:04:50,509][36156] DAMAGECOUNT value on done: 738139.0 [2023-02-25 14:04:50,509][36156] Sum rewards: 53.224, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.305', 'AMMO2': '0.007', 'AMMO5': '0.009', 'weapon4': '0.016', 'weapon5': '0.030', 'AMMO4': '0.034', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.424', 'WEAPON3': '1.500', 'HITCOUNT': '2.970', 'weapon3': '3.312', 'DAMAGECOUNT': '13.200', 'FRAGCOUNT': '48.000'} [2023-02-25 14:04:50,583][36156] DAMAGECOUNT value on done: 744329.0 [2023-02-25 14:04:50,584][36156] Sum rewards: 56.094, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.350', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.304', 'weapon2': '0.596', 'WEAPON3': '1.200', 'weapon3': '2.854', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '12.969', 'FRAGCOUNT': '48.000'} [2023-02-25 14:04:50,840][36156] DAMAGECOUNT value on done: 729917.0 [2023-02-25 14:04:50,840][36156] Sum rewards: 57.388, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-4.237', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO4': '0.184', 'weapon5': '0.198', 'weapon2': '0.206', 'weapon4': '0.266', 'AMMO3': '0.298', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.750', 'weapon3': '2.982', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '55.000'} [2023-02-25 14:04:50,919][36156] DAMAGECOUNT value on done: 732116.0 [2023-02-25 14:04:50,919][36156] Sum rewards: 53.835, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.330', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.156', 'weapon2': '0.206', 'AMMO3': '0.207', 'WEAPON4': '0.350', 'weapon4': '0.850', 'WEAPON3': '1.350', 'weapon3': '2.686', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.232', 'FRAGCOUNT': '48.000'} [2023-02-25 14:04:51,797][36155] DAMAGECOUNT value on done: 723265.0 [2023-02-25 14:04:51,797][36155] Sum rewards: 55.069, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.396', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.065', 'AMMO3': '0.199', 'weapon2': '0.234', 'weapon5': '0.276', 'AMMO4': '0.325', 'WEAPON5': '0.550', 'weapon4': '0.612', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.528', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '48.000'} [2023-02-25 14:04:52,112][36155] DAMAGECOUNT value on done: 743778.0 [2023-02-25 14:04:52,113][36155] Sum rewards: 44.894, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.809', 'AMMO5': '0.017', 'AMMO2': '0.034', 'AMMO3': '0.153', 'AMMO4': '0.170', 'weapon5': '0.236', 'WEAPON5': '0.400', 'weapon2': '0.478', 'ARMOR': '0.494', 'WEAPON4': '0.550', 'weapon4': '0.682', 'WEAPON3': '0.850', 'weapon3': '2.104', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.984', 'FRAGCOUNT': '38.000'} [2023-02-25 14:04:52,223][36138] Updated weights for policy 0, policy_version 47083 (0.0009) [2023-02-25 14:04:52,621][36155] DAMAGECOUNT value on done: 739207.0 [2023-02-25 14:04:52,622][36155] Sum rewards: 57.121, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.072', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.147', 'AMMO4': '0.171', 'WEAPON4': '0.200', 'weapon5': '0.228', 'weapon2': '0.292', 'WEAPON5': '0.300', 'weapon4': '0.308', 'WEAPON3': '0.950', 'HITCOUNT': '2.590', 'weapon3': '2.914', 'DAMAGECOUNT': '14.544', 'FRAGCOUNT': '46.000'} [2023-02-25 14:04:52,926][36155] DAMAGECOUNT value on done: 732584.0 [2023-02-25 14:04:52,927][36155] Sum rewards: 49.927, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.820', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.045', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.229', 'weapon2': '0.302', 'WEAPON3': '1.500', 'HITCOUNT': '3.030', 'weapon3': '3.420', 'DAMAGECOUNT': '14.190', 'FRAGCOUNT': '45.000'} [2023-02-25 14:04:53,503][36139] DAMAGECOUNT value on done: 737566.0 [2023-02-25 14:04:53,503][36139] Sum rewards: 63.920, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.632', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'weapon4': '0.322', 'weapon2': '0.370', 'WEAPON3': '1.350', 'weapon3': '2.798', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.189', 'FRAGCOUNT': '56.000'} [2023-02-25 14:04:53,810][36139] DAMAGECOUNT value on done: 728746.0 [2023-02-25 14:04:53,810][36139] Sum rewards: 44.282, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.200', 'AMMO5': '0.014', 'AMMO2': '0.081', 'weapon5': '0.186', 'AMMO3': '0.246', 'WEAPON5': '0.350', 'weapon2': '0.368', 'ARMOR': '0.404', 'AMMO4': '0.404', 'WEAPON4': '0.650', 'weapon4': '0.738', 'WEAPON3': '1.300', 'weapon3': '2.252', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '13.398', 'FRAGCOUNT': '43.000'} [2023-02-25 14:04:54,123][36139] DAMAGECOUNT value on done: 744614.0 [2023-02-25 14:04:54,124][36139] Sum rewards: 61.756, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.394', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.090', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.204', 'AMMO3': '0.255', 'WEAPON3': '1.500', 'weapon3': '3.210', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '54.000'} [2023-02-25 14:04:54,417][36139] DAMAGECOUNT value on done: 735257.0 [2023-02-25 14:04:54,418][36139] Sum rewards: 60.835, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.002', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO3': '0.160', 'AMMO4': '0.187', 'weapon5': '0.224', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.454', 'weapon2': '0.630', 'WEAPON3': '1.000', 'weapon3': '2.390', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '50.000'} [2023-02-25 14:04:54,729][36114] Fps is (10 sec: 13517.0, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 192884736. Throughput: 0: 3354.1. Samples: 10711998. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:04:54,729][36114] Avg episode reward: [(0, '53.699')] [2023-02-25 14:04:55,250][36138] Updated weights for policy 0, policy_version 47093 (0.0009) [2023-02-25 14:04:56,867][36139] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:04:58,249][36138] Updated weights for policy 0, policy_version 47103 (0.0009) [2023-02-25 14:04:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.2, 300 sec: 13398.8). Total num frames: 192950272. Throughput: 0: 3357.7. Samples: 10732280. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:04:59,730][36114] Avg episode reward: [(0, '53.699')] [2023-02-25 14:05:01,320][36138] Updated weights for policy 0, policy_version 47113 (0.0009) [2023-02-25 14:05:04,090][36141] DAMAGECOUNT value on done: 742896.0 [2023-02-25 14:05:04,090][36141] Sum rewards: 49.208, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.728', 'ARMOR': '0.008', 'AMMO5': '0.028', 'AMMO2': '0.055', 'AMMO3': '0.066', 'AMMO4': '0.277', 'weapon5': '0.448', 'WEAPON3': '0.450', 'weapon2': '0.454', 'WEAPON4': '0.850', 'WEAPON5': '0.850', 'weapon4': '1.262', 'weapon3': '1.442', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '13.575', 'FRAGCOUNT': '40.000'} [2023-02-25 14:05:04,200][36154] DAMAGECOUNT value on done: 737877.0 [2023-02-25 14:05:04,201][36154] Sum rewards: 47.866, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.320', 'AMMO5': '0.019', 'AMMO2': '0.041', 'AMMO3': '0.202', 'weapon5': '0.202', 'AMMO4': '0.204', 'weapon2': '0.378', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.624', 'WEAPON3': '1.250', 'weapon3': '2.524', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.302', 'FRAGCOUNT': '42.000'} [2023-02-25 14:05:04,230][36155] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:05:04,359][36138] Updated weights for policy 0, policy_version 47123 (0.0009) [2023-02-25 14:05:04,413][36141] DAMAGECOUNT value on done: 738187.0 [2023-02-25 14:05:04,413][36141] Sum rewards: 61.653, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.105', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon5': '0.110', 'AMMO4': '0.168', 'AMMO3': '0.193', 'weapon2': '0.236', 'weapon4': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.074', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '53.000'} [2023-02-25 14:05:04,497][36141] DAMAGECOUNT value on done: 733739.0 [2023-02-25 14:05:04,498][36141] Sum rewards: 48.823, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.530', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.154', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'AMMO4': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.274', 'weapon4': '0.402', 'WEAPON3': '0.900', 'HITCOUNT': '2.650', 'weapon3': '2.810', 'DAMAGECOUNT': '12.546', 'FRAGCOUNT': '40.000'} [2023-02-25 14:05:04,520][36154] DAMAGECOUNT value on done: 727454.0 [2023-02-25 14:05:04,521][36154] Sum rewards: 54.221, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.118', 'ARMOR': '0.004', 'AMMO2': '0.010', 'AMMO5': '0.010', 'weapon4': '0.042', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'weapon5': '0.106', 'weapon2': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.329', 'WEAPON3': '1.950', 'HITCOUNT': '3.350', 'weapon3': '3.374', 'DAMAGECOUNT': '15.399', 'FRAGCOUNT': '51.000'} [2023-02-25 14:05:04,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 193019904. Throughput: 0: 3360.4. Samples: 10752458. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:05:04,730][36114] Avg episode reward: [(0, '53.502')] [2023-02-25 14:05:04,745][36154] DAMAGECOUNT value on done: 736986.0 [2023-02-25 14:05:04,745][36154] Sum rewards: 50.033, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.070', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.162', 'weapon2': '0.172', 'AMMO3': '0.208', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.512', 'WEAPON3': '1.250', 'weapon3': '2.888', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.722', 'FRAGCOUNT': '45.000'} [2023-02-25 14:05:04,800][36141] DAMAGECOUNT value on done: 728836.0 [2023-02-25 14:05:04,800][36141] Sum rewards: 45.964, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.306', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO3': '0.186', 'AMMO4': '0.196', 'weapon2': '0.230', 'weapon5': '0.266', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.916', 'WEAPON3': '1.150', 'weapon3': '2.264', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '12.957', 'FRAGCOUNT': '40.000'} [2023-02-25 14:05:05,059][36154] DAMAGECOUNT value on done: 737599.0 [2023-02-25 14:05:05,059][36154] Sum rewards: 47.044, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.318', 'ARMOR': '0.008', 'AMMO5': '0.021', 'AMMO2': '0.054', 'AMMO3': '0.145', 'AMMO4': '0.270', 'weapon5': '0.298', 'weapon2': '0.486', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '0.850', 'weapon4': '0.980', 'weapon3': '1.914', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '12.885', 'FRAGCOUNT': '40.000'} [2023-02-25 14:05:06,089][36157] DAMAGECOUNT value on done: 746175.0 [2023-02-25 14:05:06,090][36157] Sum rewards: 52.288, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.568', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon2': '0.178', 'weapon4': '0.180', 'AMMO4': '0.215', 'weapon5': '0.224', 'AMMO3': '0.261', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '2.780', 'weapon3': '3.070', 'DAMAGECOUNT': '15.093', 'FRAGCOUNT': '48.000'} [2023-02-25 14:05:06,405][36157] DAMAGECOUNT value on done: 736023.0 [2023-02-25 14:05:06,406][36157] Sum rewards: 47.603, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.842', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.244', 'weapon2': '0.310', 'WEAPON3': '0.950', 'HITCOUNT': '2.660', 'weapon3': '3.184', 'DAMAGECOUNT': '11.616', 'FRAGCOUNT': '40.000'} [2023-02-25 14:05:07,059][36157] DAMAGECOUNT value on done: 747710.0 [2023-02-25 14:05:07,059][36157] Sum rewards: 51.478, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.110', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon4': '0.156', 'WEAPON4': '0.200', 'weapon5': '0.206', 'AMMO3': '0.210', 'WEAPON5': '0.300', 'weapon2': '0.496', 'WEAPON3': '1.300', 'weapon3': '2.828', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.872', 'FRAGCOUNT': '46.000'} [2023-02-25 14:05:07,111][36140] DAMAGECOUNT value on done: 745831.0 [2023-02-25 14:05:07,111][36140] Sum rewards: 54.068, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.490', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO4': '0.180', 'AMMO3': '0.187', 'weapon5': '0.190', 'WEAPON5': '0.450', 'weapon4': '0.472', 'WEAPON4': '0.500', 'weapon2': '0.548', 'WEAPON3': '1.200', 'weapon3': '2.512', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.267', 'FRAGCOUNT': '47.000'} [2023-02-25 14:05:07,364][36157] DAMAGECOUNT value on done: 743545.0 [2023-02-25 14:05:07,365][36157] Sum rewards: 41.099, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.616', 'AMMO5': '0.020', 'AMMO2': '0.068', 'weapon2': '0.196', 'AMMO3': '0.211', 'weapon5': '0.298', 'AMMO4': '0.342', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon4': '1.222', 'weapon3': '1.686', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '12.831', 'FRAGCOUNT': '38.000'} [2023-02-25 14:05:07,425][36140] DAMAGECOUNT value on done: 726066.0 [2023-02-25 14:05:07,425][36140] Sum rewards: 46.482, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.918', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.120', 'AMMO4': '0.136', 'weapon5': '0.136', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.282', 'weapon2': '0.416', 'WEAPON3': '1.650', 'HITCOUNT': '2.610', 'weapon3': '3.050', 'DAMAGECOUNT': '12.765', 'FRAGCOUNT': '45.000'} [2023-02-25 14:05:07,485][36138] Updated weights for policy 0, policy_version 47133 (0.0009) [2023-02-25 14:05:07,720][36140] DAMAGECOUNT value on done: 737811.0 [2023-02-25 14:05:07,721][36140] Sum rewards: 60.126, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.011', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.092', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'weapon4': '0.276', 'weapon2': '0.326', 'WEAPON3': '1.600', 'weapon3': '3.098', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '53.000'} [2023-02-25 14:05:08,018][36140] DAMAGECOUNT value on done: 733750.0 [2023-02-25 14:05:08,018][36140] Sum rewards: 51.358, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.512', 'AMMO5': '0.011', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.157', 'weapon5': '0.174', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.612', 'WEAPON3': '0.900', 'weapon3': '2.546', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.683', 'FRAGCOUNT': '42.000'} [2023-02-25 14:05:09,411][36142] DAMAGECOUNT value on done: 745015.0 [2023-02-25 14:05:09,412][36142] Sum rewards: 61.340, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.180', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.022', 'AMMO4': '0.091', 'weapon5': '0.100', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'weapon2': '0.296', 'WEAPON3': '1.400', 'HITCOUNT': '3.200', 'weapon3': '3.342', 'DAMAGECOUNT': '15.423', 'FRAGCOUNT': '54.000'} [2023-02-25 14:05:09,644][36142] DAMAGECOUNT value on done: 729059.0 [2023-02-25 14:05:09,644][36142] Sum rewards: 59.344, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.597', 'AMMO2': '0.014', 'AMMO5': '0.015', 'AMMO4': '0.068', 'AMMO3': '0.176', 'weapon5': '0.256', 'WEAPON4': '0.300', 'weapon4': '0.362', 'WEAPON5': '0.450', 'weapon2': '0.702', 'WEAPON3': '1.200', 'weapon3': '2.338', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.990', 'FRAGCOUNT': '50.000'} [2023-02-25 14:05:09,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 193085440. Throughput: 0: 3358.2. Samples: 10762534. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:05:09,730][36114] Avg episode reward: [(0, '53.128')] [2023-02-25 14:05:09,730][36142] DAMAGECOUNT value on done: 726623.0 [2023-02-25 14:05:09,730][36142] Sum rewards: 55.294, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.966', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.043', 'AMMO3': '0.162', 'weapon5': '0.176', 'AMMO4': '0.215', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.438', 'WEAPON3': '0.900', 'weapon2': '0.924', 'weapon3': '2.230', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.998', 'FRAGCOUNT': '48.000'} [2023-02-25 14:05:09,970][36142] DAMAGECOUNT value on done: 744361.0 [2023-02-25 14:05:09,970][36142] Sum rewards: 55.547, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.220', 'ARMOR': '0.012', 'AMMO5': '0.016', 'AMMO2': '0.076', 'weapon5': '0.116', 'AMMO3': '0.160', 'weapon2': '0.292', 'AMMO4': '0.379', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'weapon4': '0.810', 'WEAPON3': '0.950', 'weapon3': '2.220', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.655', 'FRAGCOUNT': '48.000'} [2023-02-25 14:05:10,528][36156] DAMAGECOUNT value on done: 742377.0 [2023-02-25 14:05:10,528][36156] Sum rewards: 46.775, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.852', 'AMMO5': '0.022', 'AMMO2': '0.048', 'AMMO3': '0.234', 'AMMO4': '0.239', 'weapon5': '0.262', 'weapon2': '0.268', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.914', 'WEAPON3': '1.300', 'weapon3': '2.166', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.714', 'FRAGCOUNT': '43.000'} [2023-02-25 14:05:10,546][36138] Updated weights for policy 0, policy_version 47143 (0.0009) [2023-02-25 14:05:10,550][36156] DAMAGECOUNT value on done: 749943.0 [2023-02-25 14:05:10,550][36156] Sum rewards: 66.328, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.770', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.154', 'weapon5': '0.154', 'AMMO4': '0.183', 'AMMO3': '0.212', 'weapon2': '0.368', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.086', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '57.000'} [2023-02-25 14:05:10,831][36156] DAMAGECOUNT value on done: 734828.0 [2023-02-25 14:05:10,831][36156] Sum rewards: 55.355, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.770', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.090', 'AMMO4': '0.109', 'weapon4': '0.136', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.250', 'AMMO3': '0.288', 'WEAPON3': '1.650', 'HITCOUNT': '3.130', 'weapon3': '3.204', 'DAMAGECOUNT': '14.733', 'FRAGCOUNT': '52.000'} [2023-02-25 14:05:10,856][36156] DAMAGECOUNT value on done: 737286.0 [2023-02-25 14:05:10,856][36156] Sum rewards: 57.355, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.349', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.068', 'AMMO4': '0.092', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.244', 'AMMO3': '0.248', 'weapon4': '0.258', 'WEAPON3': '1.550', 'HITCOUNT': '3.150', 'weapon3': '3.206', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '50.000'} [2023-02-25 14:05:11,686][36155] DAMAGECOUNT value on done: 728973.0 [2023-02-25 14:05:11,687][36155] Sum rewards: 62.629, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.215', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.126', 'AMMO3': '0.169', 'weapon5': '0.214', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.468', 'WEAPON3': '1.100', 'weapon3': '2.640', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '53.000'} [2023-02-25 14:05:11,984][36155] DAMAGECOUNT value on done: 749021.0 [2023-02-25 14:05:11,984][36155] Sum rewards: 69.758, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.984', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'weapon5': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon4': '0.252', 'weapon2': '0.474', 'WEAPON3': '1.250', 'weapon3': '2.862', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.729', 'FRAGCOUNT': '60.000'} [2023-02-25 14:05:12,511][36155] DAMAGECOUNT value on done: 744397.0 [2023-02-25 14:05:12,512][36155] Sum rewards: 56.113, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.442', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon5': '0.120', 'AMMO4': '0.124', 'weapon2': '0.196', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.446', 'WEAPON3': '1.350', 'weapon3': '2.876', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '50.000'} [2023-02-25 14:05:12,816][36155] DAMAGECOUNT value on done: 737731.0 [2023-02-25 14:05:12,817][36155] Sum rewards: 58.561, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.880', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.098', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'weapon2': '0.198', 'AMMO3': '0.237', 'weapon4': '0.258', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.180', 'weapon3': '3.212', 'DAMAGECOUNT': '15.441', 'FRAGCOUNT': '51.000'} [2023-02-25 14:05:13,425][36139] DAMAGECOUNT value on done: 741442.0 [2023-02-25 14:05:13,426][36139] Sum rewards: 42.426, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.374', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.174', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.256', 'weapon4': '0.872', 'WEAPON3': '1.250', 'weapon3': '2.368', 'HITCOUNT': '2.370', 'DAMAGECOUNT': '11.628', 'FRAGCOUNT': '39.000'} [2023-02-25 14:05:13,568][36138] Updated weights for policy 0, policy_version 47153 (0.0009) [2023-02-25 14:05:13,719][36139] DAMAGECOUNT value on done: 733340.0 [2023-02-25 14:05:13,719][36139] Sum rewards: 49.614, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.810', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon2': '0.158', 'AMMO4': '0.192', 'weapon5': '0.216', 'AMMO3': '0.237', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.464', 'WEAPON3': '1.350', 'weapon3': '2.882', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.782', 'FRAGCOUNT': '45.000'} [2023-02-25 14:05:14,043][36139] DAMAGECOUNT value on done: 749728.0 [2023-02-25 14:05:14,043][36139] Sum rewards: 62.748, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.640', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.072', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.130', 'AMMO3': '0.184', 'weapon4': '0.292', 'WEAPON3': '1.150', 'weapon3': '3.332', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '52.000'} [2023-02-25 14:05:14,349][36139] DAMAGECOUNT value on done: 740159.0 [2023-02-25 14:05:14,350][36139] Sum rewards: 48.639, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.250', 'ARMOR': '0.004', 'AMMO5': '0.028', 'AMMO2': '0.070', 'AMMO3': '0.123', 'AMMO4': '0.348', 'weapon5': '0.400', 'weapon2': '0.492', 'WEAPON3': '0.750', 'WEAPON4': '0.900', 'WEAPON5': '0.900', 'weapon4': '1.004', 'weapon3': '1.438', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '14.502', 'FRAGCOUNT': '41.000'} [2023-02-25 14:05:14,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 193150976. Throughput: 0: 3359.7. Samples: 10782696. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:05:14,729][36114] Avg episode reward: [(0, '53.548')] [2023-02-25 14:05:16,607][36138] Updated weights for policy 0, policy_version 47163 (0.0009) [2023-02-25 14:05:19,667][36138] Updated weights for policy 0, policy_version 47173 (0.0010) [2023-02-25 14:05:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 193220608. Throughput: 0: 3362.3. Samples: 10802840. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:05:19,730][36114] Avg episode reward: [(0, '53.548')] [2023-02-25 14:05:19,733][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000047173_193220608.pth... [2023-02-25 14:05:19,792][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000046388_190005248.pth [2023-02-25 14:05:22,738][36138] Updated weights for policy 0, policy_version 47183 (0.0009) [2023-02-25 14:05:24,240][36141] DAMAGECOUNT value on done: 747192.0 [2023-02-25 14:05:24,240][36141] Sum rewards: 48.969, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.476', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.071', 'weapon4': '0.126', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'weapon2': '0.282', 'WEAPON3': '1.200', 'HITCOUNT': '2.850', 'weapon3': '3.322', 'DAMAGECOUNT': '12.888', 'FRAGCOUNT': '42.000'} [2023-02-25 14:05:24,317][36154] DAMAGECOUNT value on done: 742868.0 [2023-02-25 14:05:24,318][36154] Sum rewards: 51.706, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.552', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.066', 'weapon5': '0.084', 'AMMO4': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.314', 'weapon2': '0.596', 'WEAPON3': '1.800', 'weapon3': '2.978', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.973', 'FRAGCOUNT': '50.000'} [2023-02-25 14:05:24,538][36141] DAMAGECOUNT value on done: 743171.0 [2023-02-25 14:05:24,538][36141] Sum rewards: 61.173, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.092', 'AMMO3': '0.137', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'weapon2': '0.170', 'HEALTH': '0.290', 'WEAPON4': '0.350', 'weapon4': '0.552', 'WEAPON3': '0.800', 'weapon3': '2.978', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.952', 'FRAGCOUNT': '50.000'} [2023-02-25 14:05:24,567][36142] Large shaping reward 2.526 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.504, 168.0), ('weapon5', 0.002)] [2023-02-25 14:05:24,624][36154] DAMAGECOUNT value on done: 732269.0 [2023-02-25 14:05:24,625][36154] Sum rewards: 52.384, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.681', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.104', 'AMMO4': '0.111', 'AMMO3': '0.247', 'weapon2': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.538', 'WEAPON3': '1.500', 'weapon3': '2.796', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.445', 'FRAGCOUNT': '48.000'} [2023-02-25 14:05:24,638][36141] DAMAGECOUNT value on done: 739012.0 [2023-02-25 14:05:24,638][36141] Sum rewards: 49.642, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-4.475', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.057', 'weapon5': '0.154', 'weapon2': '0.200', 'AMMO3': '0.271', 'AMMO4': '0.285', 'weapon4': '0.472', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.600', 'weapon3': '2.832', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.399', 'FRAGCOUNT': '48.000'} [2023-02-25 14:05:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 193286144. Throughput: 0: 3360.8. Samples: 10812858. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:05:24,730][36114] Avg episode reward: [(0, '53.620')] [2023-02-25 14:05:24,856][36154] DAMAGECOUNT value on done: 741105.0 [2023-02-25 14:05:24,856][36154] Sum rewards: 44.845, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.590', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.087', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon5': '0.202', 'weapon4': '0.212', 'WEAPON5': '0.300', 'weapon2': '0.574', 'WEAPON3': '1.200', 'HITCOUNT': '2.600', 'weapon3': '2.730', 'DAMAGECOUNT': '12.357', 'FRAGCOUNT': '40.000'} [2023-02-25 14:05:24,954][36141] DAMAGECOUNT value on done: 733531.0 [2023-02-25 14:05:24,955][36141] Sum rewards: 53.591, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.712', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.173', 'AMMO3': '0.174', 'weapon5': '0.248', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.500', 'weapon4': '0.696', 'WEAPON3': '1.050', 'weapon3': '2.100', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '14.085', 'FRAGCOUNT': '46.000'} [2023-02-25 14:05:25,168][36154] DAMAGECOUNT value on done: 741561.0 [2023-02-25 14:05:25,169][36154] Sum rewards: 46.643, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.072', 'AMMO5': '0.014', 'ARMOR': '0.036', 'AMMO2': '0.069', 'AMMO3': '0.138', 'weapon2': '0.198', 'weapon5': '0.256', 'AMMO4': '0.344', 'WEAPON5': '0.350', 'WEAPON4': '0.600', 'WEAPON3': '0.800', 'weapon4': '1.126', 'weapon3': '1.958', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '11.886', 'FRAGCOUNT': '40.000'} [2023-02-25 14:05:25,800][36138] Updated weights for policy 0, policy_version 47193 (0.0009) [2023-02-25 14:05:26,294][36157] DAMAGECOUNT value on done: 750716.0 [2023-02-25 14:05:26,295][36157] Sum rewards: 55.936, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.440', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.147', 'AMMO4': '0.175', 'weapon5': '0.186', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.368', 'weapon4': '0.806', 'WEAPON3': '0.900', 'weapon3': '2.282', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '13.623', 'FRAGCOUNT': '47.000'} [2023-02-25 14:05:26,607][36157] DAMAGECOUNT value on done: 740973.0 [2023-02-25 14:05:26,607][36157] Sum rewards: 56.514, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.806', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.022', 'AMMO4': '0.043', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.254', 'AMMO3': '0.273', 'WEAPON3': '1.750', 'HITCOUNT': '3.190', 'weapon3': '3.432', 'DAMAGECOUNT': '14.850', 'FRAGCOUNT': '52.000'} [2023-02-25 14:05:27,226][36157] DAMAGECOUNT value on done: 752977.0 [2023-02-25 14:05:27,227][36157] Sum rewards: 60.957, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.140', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.012', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.122', 'AMMO3': '0.197', 'weapon2': '0.396', 'WEAPON3': '1.200', 'weapon3': '3.260', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '51.000'} [2023-02-25 14:05:27,227][36140] DAMAGECOUNT value on done: 749577.0 [2023-02-25 14:05:27,227][36140] Sum rewards: 44.326, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.352', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO3': '0.097', 'AMMO4': '0.188', 'weapon5': '0.220', 'weapon2': '0.276', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '0.550', 'weapon4': '1.084', 'weapon3': '1.848', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '11.238', 'FRAGCOUNT': '37.000'} [2023-02-25 14:05:27,525][36157] DAMAGECOUNT value on done: 749484.0 [2023-02-25 14:05:27,526][36157] Sum rewards: 66.531, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.830', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.046', 'AMMO4': '0.145', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'weapon2': '0.318', 'WEAPON4': '0.350', 'weapon4': '0.542', 'WEAPON3': '1.450', 'weapon3': '2.834', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '58.000'} [2023-02-25 14:05:27,529][36140] DAMAGECOUNT value on done: 730387.0 [2023-02-25 14:05:27,529][36140] Sum rewards: 47.476, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.312', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.045', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'AMMO4': '0.227', 'WEAPON4': '0.300', 'weapon2': '0.472', 'weapon4': '0.638', 'WEAPON3': '1.300', 'weapon3': '2.478', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.963', 'FRAGCOUNT': '43.000'} [2023-02-25 14:05:27,754][36140] DAMAGECOUNT value on done: 742485.0 [2023-02-25 14:05:27,755][36140] Sum rewards: 48.979, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.850', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.062', 'weapon5': '0.080', 'AMMO4': '0.194', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.508', 'WEAPON3': '1.300', 'HITCOUNT': '2.960', 'weapon3': '3.070', 'DAMAGECOUNT': '14.022', 'FRAGCOUNT': '45.000'} [2023-02-25 14:05:28,070][36140] DAMAGECOUNT value on done: 738098.0 [2023-02-25 14:05:28,071][36140] Sum rewards: 49.131, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.566', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon5': '0.098', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'weapon2': '0.296', 'ARMOR': '0.400', 'weapon4': '0.456', 'WEAPON3': '1.050', 'weapon3': '2.898', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.044', 'FRAGCOUNT': '42.000'} [2023-02-25 14:05:28,842][36138] Updated weights for policy 0, policy_version 47203 (0.0009) [2023-02-25 14:05:29,499][36142] DAMAGECOUNT value on done: 750495.0 [2023-02-25 14:05:29,499][36142] Sum rewards: 64.016, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.030', 'AMMO5': '0.018', 'AMMO2': '0.042', 'AMMO4': '0.211', 'weapon5': '0.212', 'AMMO3': '0.216', 'weapon2': '0.260', 'ARMOR': '0.404', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.526', 'WEAPON3': '1.350', 'weapon3': '2.656', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '57.000'} [2023-02-25 14:05:29,717][36142] DAMAGECOUNT value on done: 734294.0 [2023-02-25 14:05:29,717][36142] Sum rewards: 61.298, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.850', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon5': '0.156', 'AMMO3': '0.211', 'weapon4': '0.258', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.250', 'weapon3': '2.940', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.705', 'FRAGCOUNT': '52.500'} [2023-02-25 14:05:29,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 193351680. Throughput: 0: 3355.9. Samples: 10832904. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:05:29,729][36114] Avg episode reward: [(0, '53.609')] [2023-02-25 14:05:29,813][36142] DAMAGECOUNT value on done: 730955.0 [2023-02-25 14:05:29,814][36142] Sum rewards: 47.470, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.200', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon4': '0.356', 'weapon2': '0.642', 'WEAPON3': '1.450', 'weapon3': '2.470', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.996', 'FRAGCOUNT': '43.000'} [2023-02-25 14:05:30,051][36142] DAMAGECOUNT value on done: 748212.0 [2023-02-25 14:05:30,052][36142] Sum rewards: 45.382, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.129', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.044', 'AMMO3': '0.123', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'weapon2': '0.350', 'WEAPON4': '0.400', 'ARMOR': '0.457', 'weapon4': '0.838', 'WEAPON3': '0.850', 'weapon3': '2.442', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '11.553', 'FRAGCOUNT': '38.000'} [2023-02-25 14:05:30,623][36156] DAMAGECOUNT value on done: 754589.0 [2023-02-25 14:05:30,624][36156] Sum rewards: 51.749, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.950', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon5': '0.194', 'AMMO3': '0.216', 'AMMO4': '0.221', 'weapon2': '0.296', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.594', 'WEAPON3': '1.350', 'weapon3': '2.600', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.938', 'FRAGCOUNT': '48.000'} [2023-02-25 14:05:30,638][36156] DAMAGECOUNT value on done: 747419.0 [2023-02-25 14:05:30,638][36156] Sum rewards: 58.870, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.732', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.096', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon4': '0.264', 'weapon2': '0.480', 'WEAPON3': '1.200', 'weapon3': '2.904', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.126', 'FRAGCOUNT': '49.000'} [2023-02-25 14:05:30,948][36156] DAMAGECOUNT value on done: 742783.0 [2023-02-25 14:05:30,949][36156] Sum rewards: 63.683, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.746', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.138', 'AMMO3': '0.167', 'AMMO4': '0.195', 'weapon2': '0.246', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.718', 'WEAPON3': '1.000', 'weapon3': '2.622', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.491', 'FRAGCOUNT': '53.000'} [2023-02-25 14:05:30,959][36156] DAMAGECOUNT value on done: 740389.0 [2023-02-25 14:05:30,960][36156] Sum rewards: 66.297, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.227', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO4': '0.193', 'weapon2': '0.194', 'AMMO3': '0.210', 'weapon5': '0.210', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.628', 'WEAPON3': '1.250', 'weapon3': '2.672', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '57.000'} [2023-02-25 14:05:31,603][36155] DAMAGECOUNT value on done: 733317.0 [2023-02-25 14:05:31,604][36155] Sum rewards: 49.060, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.098', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.045', 'weapon4': '0.050', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.230', 'WEAPON3': '1.350', 'HITCOUNT': '2.620', 'weapon3': '3.456', 'DAMAGECOUNT': '13.032', 'FRAGCOUNT': '42.500'} [2023-02-25 14:05:31,911][36138] Updated weights for policy 0, policy_version 47213 (0.0009) [2023-02-25 14:05:31,922][36155] DAMAGECOUNT value on done: 753937.0 [2023-02-25 14:05:31,923][36155] Sum rewards: 59.008, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.314', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.046', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon2': '0.404', 'ARMOR': '0.461', 'WEAPON3': '1.350', 'HITCOUNT': '3.000', 'weapon3': '3.120', 'DAMAGECOUNT': '14.748', 'FRAGCOUNT': '53.000'} [2023-02-25 14:05:32,546][36155] DAMAGECOUNT value on done: 748943.0 [2023-02-25 14:05:32,546][36155] Sum rewards: 57.860, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.062', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.166', 'AMMO3': '0.233', 'weapon2': '0.370', 'WEAPON3': '1.350', 'HITCOUNT': '2.880', 'weapon3': '3.186', 'DAMAGECOUNT': '13.638', 'FRAGCOUNT': '51.000'} [2023-02-25 14:05:32,857][36155] DAMAGECOUNT value on done: 742010.0 [2023-02-25 14:05:32,858][36155] Sum rewards: 50.362, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.370', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.144', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.272', 'weapon2': '0.600', 'WEAPON3': '1.250', 'HITCOUNT': '2.570', 'weapon3': '2.732', 'DAMAGECOUNT': '12.837', 'FRAGCOUNT': '45.000'} [2023-02-25 14:05:33,242][36139] DAMAGECOUNT value on done: 745396.0 [2023-02-25 14:05:33,242][36139] Sum rewards: 40.021, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.213', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.118', 'AMMO4': '0.155', 'weapon2': '0.162', 'AMMO3': '0.199', 'weapon4': '0.206', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.610', 'weapon3': '3.278', 'DAMAGECOUNT': '11.862', 'FRAGCOUNT': '36.000'} [2023-02-25 14:05:33,294][36142] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:05:33,555][36139] DAMAGECOUNT value on done: 738002.0 [2023-02-25 14:05:33,555][36139] Sum rewards: 46.590, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.460', 'ARMOR': '0.004', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.021', 'weapon5': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.128', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon2': '0.622', 'WEAPON3': '1.500', 'HITCOUNT': '2.930', 'weapon3': '2.984', 'DAMAGECOUNT': '13.986', 'FRAGCOUNT': '40.000'} [2023-02-25 14:05:33,874][36139] DAMAGECOUNT value on done: 754431.0 [2023-02-25 14:05:33,875][36139] Sum rewards: 51.589, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.027', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon2': '0.164', 'AMMO3': '0.174', 'weapon5': '0.192', 'AMMO4': '0.255', 'WEAPON5': '0.300', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'weapon4': '1.066', 'weapon3': '2.164', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '14.109', 'FRAGCOUNT': '46.000'} [2023-02-25 14:05:34,196][36139] DAMAGECOUNT value on done: 744629.0 [2023-02-25 14:05:34,197][36139] Sum rewards: 54.027, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.927', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon5': '0.136', 'AMMO3': '0.158', 'AMMO4': '0.206', 'WEAPON5': '0.350', 'weapon2': '0.408', 'weapon4': '0.506', 'WEAPON4': '0.550', 'WEAPON3': '0.950', 'weapon3': '2.690', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.410', 'FRAGCOUNT': '48.000'} [2023-02-25 14:05:34,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 193421312. Throughput: 0: 3355.2. Samples: 10852928. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:05:34,730][36114] Avg episode reward: [(0, '53.293')] [2023-02-25 14:05:34,997][36138] Updated weights for policy 0, policy_version 47223 (0.0009) [2023-02-25 14:05:38,099][36138] Updated weights for policy 0, policy_version 47233 (0.0010) [2023-02-25 14:05:39,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 193486848. Throughput: 0: 3354.4. Samples: 10862948. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:05:39,730][36114] Avg episode reward: [(0, '53.293')] [2023-02-25 14:05:41,174][36138] Updated weights for policy 0, policy_version 47243 (0.0009) [2023-02-25 14:05:44,234][36138] Updated weights for policy 0, policy_version 47253 (0.0009) [2023-02-25 14:05:44,274][36141] DAMAGECOUNT value on done: 751738.0 [2023-02-25 14:05:44,275][36141] Sum rewards: 51.720, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.580', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon5': '0.038', 'AMMO4': '0.104', 'weapon4': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.260', 'AMMO3': '0.264', 'WEAPON3': '1.500', 'HITCOUNT': '2.860', 'weapon3': '3.292', 'DAMAGECOUNT': '13.638', 'FRAGCOUNT': '48.000'} [2023-02-25 14:05:44,579][36141] DAMAGECOUNT value on done: 748936.0 [2023-02-25 14:05:44,579][36141] Sum rewards: 63.730, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.574', 'AMMO5': '0.020', 'AMMO2': '0.043', 'AMMO3': '0.167', 'AMMO4': '0.213', 'weapon2': '0.228', 'weapon5': '0.340', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.444', 'WEAPON3': '0.950', 'weapon3': '2.664', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '53.500'} [2023-02-25 14:05:44,586][36154] DAMAGECOUNT value on done: 747706.0 [2023-02-25 14:05:44,587][36154] Sum rewards: 61.766, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.735', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.102', 'AMMO4': '0.103', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.314', 'weapon4': '0.784', 'WEAPON3': '0.900', 'weapon3': '2.256', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.514', 'FRAGCOUNT': '51.000'} [2023-02-25 14:05:44,646][36141] DAMAGECOUNT value on done: 743487.0 [2023-02-25 14:05:44,647][36141] Sum rewards: 53.552, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.050', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.150', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'weapon4': '0.224', 'WEAPON5': '0.300', 'ARMOR': '0.451', 'weapon2': '0.836', 'WEAPON3': '1.000', 'weapon3': '2.570', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.425', 'FRAGCOUNT': '46.000'} [2023-02-25 14:05:44,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 193552384. Throughput: 0: 3349.9. Samples: 10883026. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:05:44,730][36114] Avg episode reward: [(0, '53.638')] [2023-02-25 14:05:44,897][36154] DAMAGECOUNT value on done: 737367.0 [2023-02-25 14:05:44,898][36154] Sum rewards: 58.860, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.086', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'WEAPON4': '0.050', 'weapon5': '0.070', 'weapon4': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'AMMO3': '0.270', 'weapon2': '0.282', 'WEAPON3': '1.600', 'weapon3': '3.204', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.294', 'FRAGCOUNT': '51.500'} [2023-02-25 14:05:44,955][36141] DAMAGECOUNT value on done: 738456.0 [2023-02-25 14:05:44,956][36141] Sum rewards: 49.792, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.715', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO4': '0.183', 'AMMO3': '0.195', 'weapon5': '0.202', 'weapon2': '0.302', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.430', 'WEAPON3': '1.300', 'weapon3': '2.812', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '43.500'} [2023-02-25 14:05:45,034][36154] DAMAGECOUNT value on done: 746291.0 [2023-02-25 14:05:45,034][36154] Sum rewards: 60.005, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.517', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.085', 'AMMO3': '0.162', 'weapon2': '0.226', 'weapon5': '0.228', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '0.900', 'weapon4': '1.114', 'weapon3': '1.942', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.558', 'FRAGCOUNT': '50.500'} [2023-02-25 14:05:45,332][36154] DAMAGECOUNT value on done: 746704.0 [2023-02-25 14:05:45,332][36154] Sum rewards: 60.425, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.060', 'ARMOR': '0.008', 'AMMO5': '0.026', 'AMMO2': '0.073', 'AMMO3': '0.175', 'weapon5': '0.250', 'AMMO4': '0.364', 'weapon2': '0.428', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.612', 'WEAPON3': '1.050', 'weapon3': '2.310', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.429', 'FRAGCOUNT': '54.000'} [2023-02-25 14:05:46,497][36157] DAMAGECOUNT value on done: 756122.0 [2023-02-25 14:05:46,498][36157] Sum rewards: 68.923, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.338', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.028', 'AMMO3': '0.139', 'weapon5': '0.142', 'AMMO4': '0.142', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.452', 'weapon4': '0.628', 'WEAPON3': '0.850', 'weapon3': '2.476', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.218', 'FRAGCOUNT': '55.000'} [2023-02-25 14:05:46,807][36157] DAMAGECOUNT value on done: 746065.0 [2023-02-25 14:05:46,808][36157] Sum rewards: 52.338, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.750', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.037', 'weapon5': '0.172', 'AMMO4': '0.186', 'AMMO3': '0.206', 'weapon2': '0.318', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.624', 'WEAPON3': '1.150', 'weapon3': '2.574', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.276', 'FRAGCOUNT': '46.000'} [2023-02-25 14:05:47,280][36138] Updated weights for policy 0, policy_version 47263 (0.0009) [2023-02-25 14:05:47,371][36140] DAMAGECOUNT value on done: 753552.0 [2023-02-25 14:05:47,372][36140] Sum rewards: 40.140, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.861', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon5': '0.034', 'AMMO4': '0.112', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon4': '0.266', 'WEAPON4': '0.350', 'weapon2': '0.398', 'WEAPON3': '1.300', 'HITCOUNT': '2.560', 'weapon3': '2.804', 'DAMAGECOUNT': '11.925', 'FRAGCOUNT': '38.000'} [2023-02-25 14:05:47,406][36157] DAMAGECOUNT value on done: 757895.0 [2023-02-25 14:05:47,407][36157] Sum rewards: 54.360, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.840', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.042', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.265', 'weapon2': '0.314', 'weapon4': '0.446', 'WEAPON3': '1.600', 'weapon3': '2.900', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.754', 'FRAGCOUNT': '49.000'} [2023-02-25 14:05:47,674][36140] DAMAGECOUNT value on done: 735652.0 [2023-02-25 14:05:47,675][36140] Sum rewards: 61.234, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.042', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.042', 'AMMO3': '0.122', 'weapon5': '0.194', 'AMMO4': '0.209', 'weapon4': '0.380', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.464', 'WEAPON3': '0.850', 'weapon3': '2.782', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '15.795', 'FRAGCOUNT': '50.000'} [2023-02-25 14:05:47,708][36157] DAMAGECOUNT value on done: 753850.0 [2023-02-25 14:05:47,709][36157] Sum rewards: 43.943, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.036', 'AMMO5': '0.018', 'AMMO2': '0.029', 'AMMO4': '0.144', 'AMMO3': '0.155', 'weapon2': '0.314', 'weapon5': '0.320', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.862', 'WEAPON3': '1.000', 'weapon3': '2.028', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '13.098', 'FRAGCOUNT': '38.000'} [2023-02-25 14:05:47,966][36140] DAMAGECOUNT value on done: 746546.0 [2023-02-25 14:05:47,967][36140] Sum rewards: 40.050, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.540', 'AMMO5': '0.011', 'AMMO2': '0.034', 'AMMO4': '0.168', 'weapon5': '0.182', 'AMMO3': '0.216', 'weapon4': '0.244', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.560', 'weapon3': '2.920', 'DAMAGECOUNT': '12.183', 'FRAGCOUNT': '37.500'} [2023-02-25 14:05:48,263][36140] DAMAGECOUNT value on done: 742934.0 [2023-02-25 14:05:48,264][36140] Sum rewards: 50.241, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.060', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.044', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'weapon4': '0.182', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'weapon2': '0.466', 'WEAPON3': '1.250', 'weapon3': '3.070', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.508', 'FRAGCOUNT': '43.000'} [2023-02-25 14:05:49,540][36142] DAMAGECOUNT value on done: 754080.0 [2023-02-25 14:05:49,541][36142] Sum rewards: 29.668, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.194', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon5': '0.116', 'AMMO3': '0.250', 'AMMO4': '0.253', 'weapon4': '0.308', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.534', 'WEAPON3': '1.500', 'HITCOUNT': '2.460', 'weapon3': '2.764', 'DAMAGECOUNT': '10.755', 'FRAGCOUNT': '31.000'} [2023-02-25 14:05:49,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13398.8). Total num frames: 193622016. Throughput: 0: 3349.5. Samples: 10903184. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:05:49,729][36114] Avg episode reward: [(0, '53.552')] [2023-02-25 14:05:49,787][36142] DAMAGECOUNT value on done: 739480.0 [2023-02-25 14:05:49,787][36142] Sum rewards: 59.478, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.400', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.128', 'weapon2': '0.212', 'AMMO3': '0.226', 'weapon4': '0.362', 'WEAPON3': '1.300', 'weapon3': '3.114', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '50.000'} [2023-02-25 14:05:49,854][36142] DAMAGECOUNT value on done: 735195.0 [2023-02-25 14:05:49,855][36142] Sum rewards: 52.743, reward structure: {'DEATHCOUNT': '-12.750', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.029', 'HEALTH': '0.035', 'AMMO4': '0.147', 'weapon2': '0.150', 'AMMO3': '0.170', 'weapon5': '0.170', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.576', 'WEAPON3': '0.950', 'weapon3': '2.860', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '12.720', 'FRAGCOUNT': '44.000'} [2023-02-25 14:05:50,102][36142] DAMAGECOUNT value on done: 752567.0 [2023-02-25 14:05:50,103][36142] Sum rewards: 48.229, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.358', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.158', 'AMMO4': '0.181', 'AMMO3': '0.188', 'weapon2': '0.238', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.790', 'WEAPON3': '1.100', 'weapon3': '2.398', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.065', 'FRAGCOUNT': '43.000'} [2023-02-25 14:05:50,336][36138] Updated weights for policy 0, policy_version 47273 (0.0009) [2023-02-25 14:05:50,585][36156] DAMAGECOUNT value on done: 759737.0 [2023-02-25 14:05:50,586][36156] Sum rewards: 55.387, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.195', 'AMMO5': '0.017', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.170', 'AMMO3': '0.253', 'weapon2': '0.322', 'weapon4': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.826', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.444', 'FRAGCOUNT': '51.000'} [2023-02-25 14:05:50,715][36156] DAMAGECOUNT value on done: 752729.0 [2023-02-25 14:05:50,716][36156] Sum rewards: 64.340, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.240', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'weapon2': '0.168', 'AMMO3': '0.229', 'weapon4': '0.344', 'WEAPON3': '1.350', 'HITCOUNT': '3.200', 'weapon3': '3.208', 'DAMAGECOUNT': '15.930', 'FRAGCOUNT': '55.000'} [2023-02-25 14:05:50,918][36156] DAMAGECOUNT value on done: 747713.0 [2023-02-25 14:05:50,919][36156] Sum rewards: 52.614, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.772', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.006', 'WEAPON5': '0.100', 'weapon2': '0.238', 'AMMO3': '0.320', 'WEAPON3': '1.750', 'HITCOUNT': '2.930', 'weapon3': '3.496', 'DAMAGECOUNT': '14.790', 'FRAGCOUNT': '48.000'} [2023-02-25 14:05:51,017][36156] DAMAGECOUNT value on done: 745172.0 [2023-02-25 14:05:51,018][36156] Sum rewards: 61.338, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.036', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.159', 'weapon4': '0.180', 'WEAPON4': '0.200', 'weapon2': '0.280', 'WEAPON3': '1.000', 'HITCOUNT': '2.920', 'weapon3': '3.216', 'DAMAGECOUNT': '14.349', 'FRAGCOUNT': '51.000'} [2023-02-25 14:05:51,718][36155] DAMAGECOUNT value on done: 738393.0 [2023-02-25 14:05:51,718][36155] Sum rewards: 59.003, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.842', 'AMMO5': '0.010', 'AMMO2': '0.056', 'AMMO3': '0.156', 'weapon5': '0.182', 'AMMO4': '0.278', 'WEAPON5': '0.300', 'weapon2': '0.448', 'ARMOR': '0.457', 'WEAPON4': '0.500', 'weapon4': '0.732', 'WEAPON3': '0.900', 'weapon3': '2.338', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '48.000'} [2023-02-25 14:05:52,032][36155] DAMAGECOUNT value on done: 758964.0 [2023-02-25 14:05:52,032][36155] Sum rewards: 60.603, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.400', 'ARMOR': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.130', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.318', 'weapon4': '0.366', 'WEAPON3': '1.050', 'weapon3': '2.884', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.081', 'FRAGCOUNT': '51.000'} [2023-02-25 14:05:52,791][36155] DAMAGECOUNT value on done: 754318.0 [2023-02-25 14:05:52,792][36155] Sum rewards: 57.734, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.706', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.222', 'WEAPON4': '0.350', 'weapon4': '0.434', 'weapon2': '0.558', 'WEAPON3': '1.350', 'weapon3': '2.700', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.125', 'FRAGCOUNT': '50.500'} [2023-02-25 14:05:53,101][36155] DAMAGECOUNT value on done: 747211.0 [2023-02-25 14:05:53,102][36155] Sum rewards: 65.296, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.686', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon5': '0.132', 'AMMO4': '0.155', 'AMMO3': '0.197', 'weapon4': '0.292', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '2.950', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.603', 'FRAGCOUNT': '57.000'} [2023-02-25 14:05:53,294][36139] DAMAGECOUNT value on done: 749995.0 [2023-02-25 14:05:53,294][36139] Sum rewards: 56.905, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.820', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.043', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.139', 'weapon2': '0.528', 'WEAPON3': '0.950', 'HITCOUNT': '2.880', 'weapon3': '3.156', 'DAMAGECOUNT': '13.797', 'FRAGCOUNT': '46.000'} [2023-02-25 14:05:53,369][36138] Updated weights for policy 0, policy_version 47283 (0.0009) [2023-02-25 14:05:53,613][36139] DAMAGECOUNT value on done: 743113.0 [2023-02-25 14:05:53,613][36139] Sum rewards: 56.547, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-1.908', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon5': '0.184', 'AMMO4': '0.217', 'weapon4': '0.218', 'AMMO3': '0.263', 'weapon2': '0.424', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.810', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.120', 'FRAGCOUNT': '54.000'} [2023-02-25 14:05:53,933][36139] DAMAGECOUNT value on done: 758524.0 [2023-02-25 14:05:53,934][36139] Sum rewards: 40.127, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.640', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon5': '0.076', 'weapon2': '0.210', 'AMMO4': '0.255', 'AMMO3': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.600', 'weapon4': '0.724', 'WEAPON3': '1.550', 'weapon3': '2.576', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.279', 'FRAGCOUNT': '39.000'} [2023-02-25 14:05:54,262][36139] DAMAGECOUNT value on done: 749315.0 [2023-02-25 14:05:54,263][36139] Sum rewards: 48.998, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.520', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.094', 'AMMO4': '0.101', 'AMMO3': '0.227', 'weapon2': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.510', 'WEAPON3': '1.450', 'weapon3': '2.816', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.058', 'FRAGCOUNT': '46.000'} [2023-02-25 14:05:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 193687552. Throughput: 0: 3348.5. Samples: 10913216. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:05:54,730][36114] Avg episode reward: [(0, '53.941')] [2023-02-25 14:05:56,412][36138] Updated weights for policy 0, policy_version 47293 (0.0009) [2023-02-25 14:05:59,459][36138] Updated weights for policy 0, policy_version 47303 (0.0010) [2023-02-25 14:05:59,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 193753088. Throughput: 0: 3346.2. Samples: 10933276. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:05:59,729][36114] Avg episode reward: [(0, '53.941')] [2023-02-25 14:06:02,479][36138] Updated weights for policy 0, policy_version 47313 (0.0009) [2023-02-25 14:06:04,261][36141] DAMAGECOUNT value on done: 756678.0 [2023-02-25 14:06:04,261][36141] Sum rewards: 55.914, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.668', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.184', 'AMMO3': '0.205', 'weapon2': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.432', 'WEAPON3': '1.200', 'weapon3': '2.838', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.820', 'FRAGCOUNT': '48.000'} [2023-02-25 14:06:04,575][36154] DAMAGECOUNT value on done: 752358.0 [2023-02-25 14:06:04,576][36154] Sum rewards: 60.609, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.028', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.125', 'weapon5': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.378', 'weapon2': '0.678', 'WEAPON3': '0.900', 'weapon3': '2.402', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.956', 'FRAGCOUNT': '50.000'} [2023-02-25 14:06:04,593][36141] DAMAGECOUNT value on done: 753666.0 [2023-02-25 14:06:04,594][36141] Sum rewards: 51.905, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.490', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.086', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'AMMO4': '0.197', 'WEAPON4': '0.450', 'weapon4': '0.522', 'WEAPON3': '0.850', 'weapon2': '1.000', 'weapon3': '2.176', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.190', 'FRAGCOUNT': '43.000'} [2023-02-25 14:06:04,631][36141] DAMAGECOUNT value on done: 747987.0 [2023-02-25 14:06:04,631][36141] Sum rewards: 51.556, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.979', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.138', 'AMMO3': '0.203', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.522', 'weapon2': '0.592', 'WEAPON3': '1.150', 'weapon3': '2.380', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.500', 'FRAGCOUNT': '46.000'} [2023-02-25 14:06:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 193822720. Throughput: 0: 3347.5. Samples: 10953478. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:06:04,730][36114] Avg episode reward: [(0, '53.833')] [2023-02-25 14:06:04,883][36154] DAMAGECOUNT value on done: 741299.0 [2023-02-25 14:06:04,884][36154] Sum rewards: 44.267, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.112', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.152', 'AMMO3': '0.159', 'weapon2': '0.258', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.874', 'WEAPON3': '0.900', 'weapon3': '2.186', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '11.796', 'FRAGCOUNT': '39.000'} [2023-02-25 14:06:04,947][36141] DAMAGECOUNT value on done: 742777.0 [2023-02-25 14:06:04,947][36141] Sum rewards: 49.597, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.990', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.116', 'AMMO3': '0.167', 'AMMO4': '0.173', 'weapon4': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.670', 'WEAPON3': '1.100', 'HITCOUNT': '2.610', 'weapon3': '2.830', 'DAMAGECOUNT': '12.948', 'FRAGCOUNT': '43.000'} [2023-02-25 14:06:04,985][36154] DAMAGECOUNT value on done: 751234.0 [2023-02-25 14:06:04,986][36154] Sum rewards: 57.062, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.398', 'AMMO5': '0.004', 'AMMO2': '0.009', 'weapon4': '0.022', 'AMMO4': '0.046', 'weapon5': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.264', 'weapon2': '0.480', 'WEAPON3': '1.550', 'weapon3': '3.168', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.829', 'FRAGCOUNT': '52.000'} [2023-02-25 14:06:05,297][36154] DAMAGECOUNT value on done: 751693.0 [2023-02-25 14:06:05,298][36154] Sum rewards: 56.411, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.044', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.102', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon4': '0.262', 'weapon2': '0.440', 'WEAPON3': '1.450', 'HITCOUNT': '2.770', 'weapon3': '2.902', 'DAMAGECOUNT': '14.967', 'FRAGCOUNT': '50.000'} [2023-02-25 14:06:05,603][36138] Updated weights for policy 0, policy_version 47323 (0.0009) [2023-02-25 14:06:06,619][36157] DAMAGECOUNT value on done: 760736.0 [2023-02-25 14:06:06,619][36157] Sum rewards: 54.212, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.430', 'AMMO5': '0.006', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.088', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon2': '0.370', 'ARMOR': '0.457', 'weapon4': '0.478', 'WEAPON3': '1.350', 'weapon3': '2.768', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.842', 'FRAGCOUNT': '47.000'} [2023-02-25 14:06:06,929][36157] DAMAGECOUNT value on done: 750658.0 [2023-02-25 14:06:06,930][36157] Sum rewards: 52.071, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.722', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.154', 'AMMO4': '0.156', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'weapon2': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.402', 'WEAPON3': '1.300', 'weapon3': '2.774', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.779', 'FRAGCOUNT': '49.000'} [2023-02-25 14:06:07,406][36140] DAMAGECOUNT value on done: 758912.0 [2023-02-25 14:06:07,406][36140] Sum rewards: 61.365, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.861', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.087', 'weapon2': '0.210', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon4': '0.354', 'WEAPON3': '1.400', 'weapon3': '3.230', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '54.000'} [2023-02-25 14:06:07,559][36157] DAMAGECOUNT value on done: 762646.0 [2023-02-25 14:06:07,559][36157] Sum rewards: 54.282, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.051', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.042', 'AMMO3': '0.188', 'AMMO4': '0.211', 'weapon5': '0.254', 'weapon2': '0.318', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.566', 'WEAPON3': '1.200', 'weapon3': '2.510', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '14.253', 'FRAGCOUNT': '48.000'} [2023-02-25 14:06:07,739][36140] DAMAGECOUNT value on done: 739909.0 [2023-02-25 14:06:07,740][36140] Sum rewards: 48.013, reward structure: {'DEATHCOUNT': '-15.750', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.049', 'HEALTH': '0.096', 'weapon5': '0.198', 'AMMO3': '0.220', 'weapon2': '0.222', 'AMMO4': '0.246', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.842', 'WEAPON3': '1.200', 'weapon3': '2.402', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.771', 'FRAGCOUNT': '42.000'} [2023-02-25 14:06:07,886][36157] DAMAGECOUNT value on done: 759371.0 [2023-02-25 14:06:07,886][36157] Sum rewards: 58.926, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.414', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.118', 'AMMO4': '0.119', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.258', 'AMMO3': '0.280', 'weapon2': '0.292', 'WEAPON3': '1.700', 'weapon3': '3.006', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '53.000'} [2023-02-25 14:06:08,037][36140] DAMAGECOUNT value on done: 751017.0 [2023-02-25 14:06:08,037][36140] Sum rewards: 51.686, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.943', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.130', 'AMMO4': '0.132', 'weapon2': '0.148', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.280', 'weapon4': '0.486', 'WEAPON3': '1.550', 'HITCOUNT': '2.550', 'weapon3': '2.952', 'DAMAGECOUNT': '13.413', 'FRAGCOUNT': '48.000'} [2023-02-25 14:06:08,345][36140] DAMAGECOUNT value on done: 747309.0 [2023-02-25 14:06:08,346][36140] Sum rewards: 44.044, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.929', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.116', 'AMMO4': '0.125', 'weapon2': '0.202', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.328', 'WEAPON3': '1.450', 'HITCOUNT': '2.790', 'weapon3': '3.052', 'DAMAGECOUNT': '13.125', 'FRAGCOUNT': '41.000'} [2023-02-25 14:06:08,640][36138] Updated weights for policy 0, policy_version 47333 (0.0009) [2023-02-25 14:06:09,547][36142] DAMAGECOUNT value on done: 758300.0 [2023-02-25 14:06:09,548][36142] Sum rewards: 44.279, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.452', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.029', 'weapon5': '0.096', 'AMMO4': '0.145', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.250', 'AMMO3': '0.288', 'weapon4': '0.328', 'WEAPON3': '1.600', 'HITCOUNT': '2.610', 'weapon3': '3.010', 'DAMAGECOUNT': '12.660', 'FRAGCOUNT': '43.000'} [2023-02-25 14:06:09,729][36114] Fps is (10 sec: 13516.5, 60 sec: 13380.2, 300 sec: 13384.9). Total num frames: 193888256. Throughput: 0: 3348.1. Samples: 10963522. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:06:09,730][36114] Avg episode reward: [(0, '54.082')] [2023-02-25 14:06:09,835][36142] DAMAGECOUNT value on done: 744373.0 [2023-02-25 14:06:09,835][36142] Sum rewards: 53.628, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.970', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon5': '0.076', 'AMMO4': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.314', 'WEAPON4': '0.350', 'weapon4': '0.732', 'WEAPON3': '1.250', 'weapon3': '2.518', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.679', 'FRAGCOUNT': '46.000'} [2023-02-25 14:06:09,843][36142] DAMAGECOUNT value on done: 739887.0 [2023-02-25 14:06:09,844][36142] Sum rewards: 55.557, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.019', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO3': '0.160', 'AMMO4': '0.178', 'weapon5': '0.180', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON4': '0.400', 'ARMOR': '0.457', 'weapon4': '0.846', 'WEAPON3': '0.900', 'weapon3': '2.326', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.076', 'FRAGCOUNT': '47.000'} [2023-02-25 14:06:10,153][36142] DAMAGECOUNT value on done: 757766.0 [2023-02-25 14:06:10,154][36142] Sum rewards: 55.338, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.510', 'AMMO5': '0.008', 'weapon5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon4': '0.112', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.244', 'weapon2': '0.536', 'WEAPON3': '1.450', 'weapon3': '3.134', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '48.000'} [2023-02-25 14:06:10,561][36156] DAMAGECOUNT value on done: 764473.0 [2023-02-25 14:06:10,562][36156] Sum rewards: 54.295, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.480', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO4': '0.172', 'weapon5': '0.176', 'AMMO3': '0.223', 'weapon2': '0.352', 'weapon4': '0.404', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.750', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.208', 'FRAGCOUNT': '50.000'} [2023-02-25 14:06:10,734][36156] DAMAGECOUNT value on done: 757191.0 [2023-02-25 14:06:10,735][36156] Sum rewards: 49.991, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.740', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.090', 'AMMO4': '0.133', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.260', 'weapon4': '0.502', 'WEAPON3': '1.250', 'weapon3': '2.950', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.386', 'FRAGCOUNT': '43.000'} [2023-02-25 14:06:10,884][36156] DAMAGECOUNT value on done: 752334.0 [2023-02-25 14:06:10,884][36156] Sum rewards: 50.926, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.955', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.088', 'AMMO4': '0.138', 'WEAPON5': '0.200', 'weapon2': '0.200', 'AMMO3': '0.217', 'WEAPON4': '0.450', 'weapon4': '0.922', 'WEAPON3': '1.300', 'weapon3': '2.430', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.863', 'FRAGCOUNT': '46.000'} [2023-02-25 14:06:11,065][36156] DAMAGECOUNT value on done: 750217.0 [2023-02-25 14:06:11,065][36156] Sum rewards: 56.186, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.780', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.016', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.079', 'weapon4': '0.164', 'WEAPON4': '0.200', 'AMMO3': '0.275', 'weapon2': '0.376', 'WEAPON3': '1.700', 'HITCOUNT': '3.060', 'weapon3': '3.108', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '53.000'} [2023-02-25 14:06:11,706][36138] Updated weights for policy 0, policy_version 47343 (0.0009) [2023-02-25 14:06:11,735][36155] DAMAGECOUNT value on done: 742850.0 [2023-02-25 14:06:11,735][36155] Sum rewards: 44.179, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.420', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.110', 'AMMO4': '0.166', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'weapon4': '0.338', 'WEAPON4': '0.350', 'weapon2': '0.398', 'WEAPON3': '1.300', 'weapon3': '2.878', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.371', 'FRAGCOUNT': '38.000'} [2023-02-25 14:06:12,052][36155] DAMAGECOUNT value on done: 763231.0 [2023-02-25 14:06:12,053][36155] Sum rewards: 43.893, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.717', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.058', 'AMMO4': '0.068', 'WEAPON5': '0.150', 'weapon2': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.294', 'weapon4': '0.386', 'WEAPON3': '1.700', 'HITCOUNT': '2.680', 'weapon3': '3.054', 'DAMAGECOUNT': '12.801', 'FRAGCOUNT': '43.000'} [2023-02-25 14:06:12,808][36155] DAMAGECOUNT value on done: 759448.0 [2023-02-25 14:06:12,809][36155] Sum rewards: 55.897, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.076', 'AMMO5': '0.017', 'AMMO2': '0.066', 'weapon5': '0.178', 'AMMO3': '0.262', 'AMMO4': '0.330', 'weapon2': '0.358', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.548', 'WEAPON3': '1.550', 'weapon3': '2.524', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '51.000'} [2023-02-25 14:06:13,120][36155] DAMAGECOUNT value on done: 751235.0 [2023-02-25 14:06:13,121][36155] Sum rewards: 43.507, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.307', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.032', 'weapon7': '0.060', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.144', 'AMMO4': '0.161', 'AMMO3': '0.233', 'weapon4': '0.292', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.428', 'WEAPON3': '1.450', 'HITCOUNT': '2.580', 'weapon3': '2.738', 'DAMAGECOUNT': '12.072', 'FRAGCOUNT': '42.000'} [2023-02-25 14:06:13,370][36139] DAMAGECOUNT value on done: 754738.0 [2023-02-25 14:06:13,370][36139] Sum rewards: 53.718, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.965', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.054', 'weapon4': '0.092', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'weapon2': '0.318', 'WEAPON3': '1.500', 'HITCOUNT': '2.900', 'weapon3': '3.258', 'DAMAGECOUNT': '14.229', 'FRAGCOUNT': '48.000'} [2023-02-25 14:06:13,681][36139] DAMAGECOUNT value on done: 748490.0 [2023-02-25 14:06:13,681][36139] Sum rewards: 61.076, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.480', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.084', 'weapon4': '0.108', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon2': '0.290', 'WEAPON3': '1.400', 'weapon3': '3.264', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.131', 'FRAGCOUNT': '53.000'} [2023-02-25 14:06:13,976][36139] DAMAGECOUNT value on done: 762817.0 [2023-02-25 14:06:13,976][36139] Sum rewards: 46.798, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.790', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO3': '0.140', 'AMMO4': '0.215', 'weapon5': '0.272', 'WEAPON5': '0.400', 'weapon2': '0.424', 'WEAPON4': '0.500', 'WEAPON3': '0.800', 'weapon4': '0.994', 'weapon3': '1.910', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '12.879', 'FRAGCOUNT': '38.000'} [2023-02-25 14:06:14,300][36139] DAMAGECOUNT value on done: 754114.0 [2023-02-25 14:06:14,300][36139] Sum rewards: 53.640, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.220', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon5': '0.090', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'WEAPON4': '0.350', 'weapon2': '0.404', 'weapon4': '0.644', 'WEAPON3': '1.350', 'weapon3': '2.618', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.397', 'FRAGCOUNT': '47.000'} [2023-02-25 14:06:14,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 193953792. Throughput: 0: 3346.4. Samples: 10983490. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:06:14,729][36114] Avg episode reward: [(0, '53.244')] [2023-02-25 14:06:14,836][36138] Updated weights for policy 0, policy_version 47353 (0.0010) [2023-02-25 14:06:17,886][36138] Updated weights for policy 0, policy_version 47363 (0.0010) [2023-02-25 14:06:19,729][36114] Fps is (10 sec: 13107.5, 60 sec: 13312.0, 300 sec: 13371.0). Total num frames: 194019328. Throughput: 0: 3343.8. Samples: 11003398. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:06:19,729][36114] Avg episode reward: [(0, '53.244')] [2023-02-25 14:06:20,982][36138] Updated weights for policy 0, policy_version 47373 (0.0009) [2023-02-25 14:06:23,993][36138] Updated weights for policy 0, policy_version 47383 (0.0009) [2023-02-25 14:06:24,505][36141] DAMAGECOUNT value on done: 761849.0 [2023-02-25 14:06:24,506][36141] Sum rewards: 52.546, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-3.292', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.064', 'weapon5': '0.174', 'AMMO3': '0.219', 'AMMO4': '0.320', 'weapon4': '0.522', 'weapon2': '0.526', 'WEAPON5': '0.600', 'WEAPON4': '0.750', 'WEAPON3': '1.250', 'weapon3': '2.424', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '51.000'} [2023-02-25 14:06:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 194088960. Throughput: 0: 3343.2. Samples: 11013394. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:06:24,730][36114] Avg episode reward: [(0, '53.346')] [2023-02-25 14:06:24,830][36141] DAMAGECOUNT value on done: 758054.0 [2023-02-25 14:06:24,830][36141] Sum rewards: 47.674, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.610', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.077', 'AMMO3': '0.174', 'weapon5': '0.230', 'AMMO4': '0.386', 'weapon4': '0.506', 'WEAPON5': '0.550', 'weapon2': '0.608', 'WEAPON4': '0.750', 'WEAPON3': '1.000', 'weapon3': '2.282', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '13.164', 'FRAGCOUNT': '43.500'} [2023-02-25 14:06:24,832][36154] DAMAGECOUNT value on done: 757249.0 [2023-02-25 14:06:24,832][36154] Sum rewards: 50.603, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.230', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.094', 'AMMO4': '0.182', 'WEAPON5': '0.250', 'AMMO3': '0.277', 'weapon4': '0.332', 'weapon2': '0.370', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.856', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.673', 'FRAGCOUNT': '49.000'} [2023-02-25 14:06:24,866][36141] DAMAGECOUNT value on done: 753342.0 [2023-02-25 14:06:24,867][36141] Sum rewards: 63.174, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.400', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'weapon4': '0.142', 'WEAPON4': '0.150', 'weapon2': '0.236', 'AMMO3': '0.253', 'WEAPON3': '1.500', 'HITCOUNT': '3.270', 'weapon3': '3.360', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '55.000'} [2023-02-25 14:06:25,138][36154] DAMAGECOUNT value on done: 746484.0 [2023-02-25 14:06:25,139][36154] Sum rewards: 59.022, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.462', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.142', 'AMMO4': '0.152', 'AMMO3': '0.189', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON4': '0.500', 'weapon4': '0.506', 'WEAPON3': '1.150', 'weapon3': '2.652', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '52.000'} [2023-02-25 14:06:25,183][36154] DAMAGECOUNT value on done: 756599.0 [2023-02-25 14:06:25,184][36154] Sum rewards: 67.235, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.382', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'weapon2': '0.156', 'AMMO3': '0.197', 'weapon4': '0.338', 'WEAPON3': '1.350', 'weapon3': '3.240', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '58.000'} [2023-02-25 14:06:25,186][36141] DAMAGECOUNT value on done: 748127.0 [2023-02-25 14:06:25,186][36141] Sum rewards: 64.303, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.196', 'ARMOR': '0.005', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.092', 'weapon2': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.254', 'AMMO3': '0.262', 'WEAPON3': '1.500', 'weapon3': '3.116', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '58.000'} [2023-02-25 14:06:25,483][36154] DAMAGECOUNT value on done: 756454.0 [2023-02-25 14:06:25,483][36154] Sum rewards: 59.955, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.984', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.130', 'AMMO3': '0.187', 'weapon2': '0.202', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.950', 'WEAPON3': '1.100', 'weapon3': '2.364', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.283', 'FRAGCOUNT': '52.000'} [2023-02-25 14:06:26,823][36157] DAMAGECOUNT value on done: 765346.0 [2023-02-25 14:06:26,824][36157] Sum rewards: 52.690, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.586', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.096', 'WEAPON5': '0.200', 'AMMO4': '0.200', 'AMMO3': '0.223', 'weapon2': '0.310', 'WEAPON4': '0.350', 'weapon4': '0.588', 'WEAPON3': '1.300', 'weapon3': '2.494', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.830', 'FRAGCOUNT': '48.000'} [2023-02-25 14:06:27,108][36138] Updated weights for policy 0, policy_version 47393 (0.0009) [2023-02-25 14:06:27,156][36157] DAMAGECOUNT value on done: 755046.0 [2023-02-25 14:06:27,156][36157] Sum rewards: 45.493, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.384', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.146', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.484', 'weapon2': '0.534', 'WEAPON3': '1.150', 'weapon3': '2.570', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.164', 'FRAGCOUNT': '41.000'} [2023-02-25 14:06:27,510][36140] DAMAGECOUNT value on done: 763190.0 [2023-02-25 14:06:27,511][36140] Sum rewards: 48.013, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.232', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.186', 'AMMO3': '0.192', 'AMMO4': '0.244', 'weapon2': '0.244', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.520', 'WEAPON3': '1.100', 'HITCOUNT': '2.740', 'weapon3': '2.822', 'DAMAGECOUNT': '12.834', 'FRAGCOUNT': '44.000'} [2023-02-25 14:06:27,780][36157] DAMAGECOUNT value on done: 767193.0 [2023-02-25 14:06:27,781][36157] Sum rewards: 50.306, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.970', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.158', 'AMMO3': '0.216', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.536', 'WEAPON3': '1.400', 'weapon3': '2.810', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.641', 'FRAGCOUNT': '45.000'} [2023-02-25 14:06:27,822][36140] DAMAGECOUNT value on done: 744727.0 [2023-02-25 14:06:27,822][36140] Sum rewards: 53.361, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.112', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.005', 'AMMO4': '0.023', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.102', 'weapon2': '0.152', 'AMMO3': '0.270', 'WEAPON3': '1.700', 'HITCOUNT': '3.140', 'weapon3': '3.222', 'DAMAGECOUNT': '14.454', 'FRAGCOUNT': '49.000'} [2023-02-25 14:06:28,077][36157] DAMAGECOUNT value on done: 764852.0 [2023-02-25 14:06:28,078][36157] Sum rewards: 63.433, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.850', 'AMMO5': '0.011', 'AMMO2': '0.061', 'weapon5': '0.134', 'AMMO3': '0.181', 'WEAPON5': '0.250', 'weapon2': '0.260', 'AMMO4': '0.305', 'weapon4': '0.364', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '3.014', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '54.000'} [2023-02-25 14:06:28,164][36140] DAMAGECOUNT value on done: 755877.0 [2023-02-25 14:06:28,164][36140] Sum rewards: 49.964, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.506', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.056', 'AMMO3': '0.130', 'weapon5': '0.168', 'AMMO4': '0.280', 'WEAPON5': '0.300', 'weapon2': '0.406', 'WEAPON4': '0.600', 'WEAPON3': '0.750', 'weapon4': '0.798', 'weapon3': '2.340', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '42.000'} [2023-02-25 14:06:28,474][36140] DAMAGECOUNT value on done: 752615.0 [2023-02-25 14:06:28,475][36140] Sum rewards: 68.017, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.003', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.025', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HEALTH': '0.154', 'weapon4': '0.158', 'AMMO3': '0.186', 'weapon2': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.170', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.918', 'FRAGCOUNT': '56.000'} [2023-02-25 14:06:29,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 194154496. Throughput: 0: 3339.6. Samples: 11033310. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:06:29,729][36114] Avg episode reward: [(0, '53.901')] [2023-02-25 14:06:29,774][36142] DAMAGECOUNT value on done: 763274.0 [2023-02-25 14:06:29,774][36142] Sum rewards: 61.535, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.656', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.036', 'WEAPON5': '0.150', 'weapon5': '0.160', 'AMMO3': '0.176', 'AMMO4': '0.178', 'WEAPON4': '0.250', 'weapon2': '0.464', 'weapon4': '0.588', 'WEAPON3': '1.050', 'weapon3': '2.586', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.922', 'FRAGCOUNT': '52.000'} [2023-02-25 14:06:30,082][36142] DAMAGECOUNT value on done: 749137.0 [2023-02-25 14:06:30,082][36142] Sum rewards: 55.074, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.456', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon5': '0.170', 'AMMO4': '0.171', 'AMMO3': '0.174', 'weapon2': '0.282', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.990', 'WEAPON3': '1.050', 'weapon3': '2.268', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.292', 'FRAGCOUNT': '48.000'} [2023-02-25 14:06:30,092][36142] DAMAGECOUNT value on done: 745379.0 [2023-02-25 14:06:30,093][36142] Sum rewards: 63.033, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.926', 'ARMOR': '0.004', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.045', 'weapon5': '0.054', 'WEAPON5': '0.200', 'AMMO4': '0.224', 'AMMO3': '0.226', 'weapon2': '0.384', 'WEAPON4': '0.400', 'weapon4': '0.432', 'WEAPON3': '1.300', 'weapon3': '2.886', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.476', 'FRAGCOUNT': '56.000'} [2023-02-25 14:06:30,172][36138] Updated weights for policy 0, policy_version 47403 (0.0010) [2023-02-25 14:06:30,395][36142] DAMAGECOUNT value on done: 762755.0 [2023-02-25 14:06:30,396][36142] Sum rewards: 64.085, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.866', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'weapon4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.250', 'weapon2': '0.402', 'WEAPON3': '1.550', 'HITCOUNT': '3.120', 'weapon3': '3.280', 'DAMAGECOUNT': '14.937', 'FRAGCOUNT': '58.000'} [2023-02-25 14:06:30,951][36156] DAMAGECOUNT value on done: 769277.0 [2023-02-25 14:06:30,951][36156] Sum rewards: 49.058, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.070', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.140', 'AMMO4': '0.142', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.382', 'weapon4': '0.432', 'WEAPON3': '1.400', 'weapon3': '2.724', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.412', 'FRAGCOUNT': '44.000'} [2023-02-25 14:06:31,118][36156] DAMAGECOUNT value on done: 762192.0 [2023-02-25 14:06:31,118][36156] Sum rewards: 58.999, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.394', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.033', 'weapon5': '0.044', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.166', 'AMMO4': '0.167', 'AMMO3': '0.237', 'weapon2': '0.660', 'WEAPON3': '1.400', 'weapon3': '2.866', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.003', 'FRAGCOUNT': '52.000'} [2023-02-25 14:06:31,268][36156] DAMAGECOUNT value on done: 757892.0 [2023-02-25 14:06:31,268][36156] Sum rewards: 60.419, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.030', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.180', 'AMMO3': '0.230', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.512', 'weapon4': '0.612', 'WEAPON3': '1.350', 'weapon3': '2.408', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '55.000'} [2023-02-25 14:06:31,422][36156] DAMAGECOUNT value on done: 755694.0 [2023-02-25 14:06:31,423][36156] Sum rewards: 62.663, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.259', 'AMMO5': '0.005', 'weapon5': '0.048', 'AMMO2': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.212', 'AMMO4': '0.288', 'weapon2': '0.312', 'WEAPON4': '0.350', 'weapon4': '0.390', 'WEAPON3': '1.150', 'weapon3': '2.888', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.431', 'FRAGCOUNT': '54.000'} [2023-02-25 14:06:31,765][36155] DAMAGECOUNT value on done: 748631.0 [2023-02-25 14:06:31,765][36155] Sum rewards: 71.646, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.885', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon2': '0.204', 'weapon4': '0.234', 'WEAPON3': '1.200', 'weapon3': '3.270', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '60.000'} [2023-02-25 14:06:32,081][36155] DAMAGECOUNT value on done: 768000.0 [2023-02-25 14:06:32,081][36155] Sum rewards: 54.788, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.224', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.148', 'AMMO3': '0.211', 'weapon2': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.438', 'WEAPON3': '1.200', 'HITCOUNT': '2.810', 'weapon3': '2.924', 'DAMAGECOUNT': '14.307', 'FRAGCOUNT': '48.000'} [2023-02-25 14:06:32,971][36155] DAMAGECOUNT value on done: 764831.0 [2023-02-25 14:06:32,972][36155] Sum rewards: 61.338, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.971', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon7': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.110', 'AMMO3': '0.185', 'weapon2': '0.194', 'AMMO4': '0.197', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.832', 'WEAPON3': '1.150', 'weapon3': '2.524', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.149', 'FRAGCOUNT': '51.000'} [2023-02-25 14:06:33,243][36138] Updated weights for policy 0, policy_version 47413 (0.0009) [2023-02-25 14:06:33,276][36155] DAMAGECOUNT value on done: 756011.0 [2023-02-25 14:06:33,276][36155] Sum rewards: 56.731, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.844', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.062', 'weapon5': '0.104', 'AMMO4': '0.107', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.628', 'WEAPON3': '1.200', 'weapon3': '2.960', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.328', 'FRAGCOUNT': '49.000'} [2023-02-25 14:06:33,523][36139] DAMAGECOUNT value on done: 759781.0 [2023-02-25 14:06:33,524][36139] Sum rewards: 50.520, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.420', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.106', 'AMMO4': '0.124', 'weapon2': '0.144', 'WEAPON5': '0.150', 'weapon4': '0.240', 'WEAPON4': '0.250', 'AMMO3': '0.265', 'WEAPON3': '1.500', 'HITCOUNT': '2.760', 'weapon3': '3.242', 'DAMAGECOUNT': '15.129', 'FRAGCOUNT': '46.000'} [2023-02-25 14:06:33,832][36139] DAMAGECOUNT value on done: 752534.0 [2023-02-25 14:06:33,832][36139] Sum rewards: 41.355, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.670', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.088', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'WEAPON4': '0.300', 'weapon4': '0.350', 'weapon2': '0.566', 'WEAPON3': '1.100', 'HITCOUNT': '2.680', 'weapon3': '2.792', 'DAMAGECOUNT': '12.132', 'FRAGCOUNT': '36.000'} [2023-02-25 14:06:34,179][36139] DAMAGECOUNT value on done: 767654.0 [2023-02-25 14:06:34,179][36139] Sum rewards: 49.815, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.592', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.058', 'AMMO3': '0.154', 'weapon5': '0.188', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.291', 'weapon2': '0.380', 'weapon4': '0.438', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '0.900', 'weapon3': '2.706', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.511', 'FRAGCOUNT': '42.000'} [2023-02-25 14:06:34,497][36139] DAMAGECOUNT value on done: 760104.0 [2023-02-25 14:06:34,497][36139] Sum rewards: 69.296, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.394', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.155', 'AMMO3': '0.196', 'weapon5': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.348', 'weapon2': '0.368', 'WEAPON3': '1.300', 'weapon3': '2.792', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.970', 'FRAGCOUNT': '58.500'} [2023-02-25 14:06:34,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13312.0, 300 sec: 13398.8). Total num frames: 194220032. Throughput: 0: 3337.2. Samples: 11053360. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:06:34,730][36114] Avg episode reward: [(0, '54.333')] [2023-02-25 14:06:36,316][36138] Updated weights for policy 0, policy_version 47423 (0.0010) [2023-02-25 14:06:39,316][36138] Updated weights for policy 0, policy_version 47433 (0.0010) [2023-02-25 14:06:39,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 194289664. Throughput: 0: 3337.3. Samples: 11063394. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:06:39,730][36114] Avg episode reward: [(0, '54.333')] [2023-02-25 14:06:42,380][36138] Updated weights for policy 0, policy_version 47443 (0.0009) [2023-02-25 14:06:44,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 194355200. Throughput: 0: 3337.7. Samples: 11083474. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:06:44,730][36114] Avg episode reward: [(0, '54.333')] [2023-02-25 14:06:44,792][36141] DAMAGECOUNT value on done: 767510.0 [2023-02-25 14:06:44,793][36141] Sum rewards: 61.203, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.582', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon5': '0.112', 'weapon4': '0.140', 'AMMO4': '0.211', 'AMMO3': '0.258', 'weapon2': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.204', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '54.000'} [2023-02-25 14:06:44,853][36154] DAMAGECOUNT value on done: 762047.0 [2023-02-25 14:06:44,853][36154] Sum rewards: 55.145, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.282', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.033', 'AMMO3': '0.132', 'weapon5': '0.142', 'AMMO4': '0.164', 'WEAPON5': '0.200', 'weapon4': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.742', 'WEAPON3': '0.900', 'weapon3': '2.650', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.394', 'FRAGCOUNT': '44.000'} [2023-02-25 14:06:45,118][36141] DAMAGECOUNT value on done: 763213.0 [2023-02-25 14:06:45,118][36141] Sum rewards: 56.875, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.442', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.092', 'AMMO4': '0.122', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.324', 'ARMOR': '0.404', 'weapon4': '0.574', 'WEAPON3': '1.450', 'weapon3': '2.664', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '50.000'} [2023-02-25 14:06:45,161][36141] DAMAGECOUNT value on done: 758088.0 [2023-02-25 14:06:45,162][36141] Sum rewards: 55.155, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.294', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.426', 'weapon4': '0.502', 'WEAPON3': '1.200', 'weapon3': '2.542', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.238', 'FRAGCOUNT': '47.000'} [2023-02-25 14:06:45,194][36154] DAMAGECOUNT value on done: 751026.0 [2023-02-25 14:06:45,195][36154] Sum rewards: 44.867, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.944', 'AMMO5': '0.022', 'AMMO2': '0.034', 'weapon5': '0.150', 'AMMO4': '0.171', 'AMMO3': '0.201', 'weapon2': '0.302', 'WEAPON4': '0.500', 'weapon4': '0.514', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.540', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.626', 'FRAGCOUNT': '40.000'} [2023-02-25 14:06:45,218][36154] DAMAGECOUNT value on done: 761530.0 [2023-02-25 14:06:45,218][36154] Sum rewards: 54.995, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.237', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.130', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.420', 'weapon4': '0.578', 'WEAPON3': '1.250', 'weapon3': '2.598', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.793', 'FRAGCOUNT': '48.000'} [2023-02-25 14:06:45,480][36141] DAMAGECOUNT value on done: 754102.0 [2023-02-25 14:06:45,480][36141] Sum rewards: 69.262, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.500', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.142', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.326', 'weapon4': '0.430', 'WEAPON3': '1.150', 'weapon3': '2.820', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '57.000'} [2023-02-25 14:06:45,495][36138] Updated weights for policy 0, policy_version 47453 (0.0010) [2023-02-25 14:06:45,531][36154] DAMAGECOUNT value on done: 760939.0 [2023-02-25 14:06:45,532][36154] Sum rewards: 51.596, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.604', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.166', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'weapon2': '0.270', 'WEAPON4': '0.350', 'weapon4': '0.638', 'WEAPON3': '1.200', 'weapon3': '2.518', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.455', 'FRAGCOUNT': '46.000'} [2023-02-25 14:06:46,884][36157] DAMAGECOUNT value on done: 770634.0 [2023-02-25 14:06:46,885][36157] Sum rewards: 51.896, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.699', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.164', 'AMMO3': '0.202', 'weapon5': '0.206', 'weapon2': '0.268', 'WEAPON5': '0.350', 'WEAPON4': '0.650', 'weapon4': '1.108', 'WEAPON3': '1.200', 'weapon3': '2.070', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.582', 'FRAGCOUNT': '47.000'} [2023-02-25 14:06:47,192][36157] DAMAGECOUNT value on done: 759940.0 [2023-02-25 14:06:47,192][36157] Sum rewards: 51.239, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.010', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon5': '0.132', 'AMMO4': '0.239', 'AMMO3': '0.256', 'weapon2': '0.256', 'WEAPON5': '0.350', 'weapon4': '0.372', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.898', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.682', 'FRAGCOUNT': '49.000'} [2023-02-25 14:06:47,670][36140] DAMAGECOUNT value on done: 767411.0 [2023-02-25 14:06:47,671][36140] Sum rewards: 50.893, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.545', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon7': '0.046', 'AMMO4': '0.114', 'weapon5': '0.156', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO3': '0.194', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.474', 'weapon4': '0.474', 'WEAPON3': '1.200', 'weapon3': '2.364', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '12.663', 'FRAGCOUNT': '44.000'} [2023-02-25 14:06:47,799][36157] DAMAGECOUNT value on done: 771888.0 [2023-02-25 14:06:47,800][36157] Sum rewards: 53.768, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.849', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.092', 'AMMO4': '0.178', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'weapon4': '0.312', 'WEAPON4': '0.400', 'weapon2': '0.446', 'WEAPON3': '1.400', 'HITCOUNT': '2.830', 'weapon3': '2.854', 'DAMAGECOUNT': '14.085', 'FRAGCOUNT': '50.000'} [2023-02-25 14:06:47,973][36140] DAMAGECOUNT value on done: 750005.0 [2023-02-25 14:06:47,974][36140] Sum rewards: 58.042, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.742', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.104', 'AMMO4': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon4': '0.284', 'weapon2': '0.292', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.142', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.534', 'FRAGCOUNT': '50.000'} [2023-02-25 14:06:48,116][36157] DAMAGECOUNT value on done: 768923.0 [2023-02-25 14:06:48,117][36157] Sum rewards: 35.945, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.940', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.122', 'weapon7': '0.122', 'weapon5': '0.182', 'WEAPON7': '0.200', 'AMMO3': '0.233', 'weapon2': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.786', 'WEAPON3': '1.400', 'weapon3': '2.204', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '12.213', 'FRAGCOUNT': '34.000'} [2023-02-25 14:06:48,301][36140] DAMAGECOUNT value on done: 760933.0 [2023-02-25 14:06:48,301][36140] Sum rewards: 61.754, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.420', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon4': '0.254', 'weapon2': '0.504', 'WEAPON3': '1.050', 'weapon3': '2.882', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.138', 'FRAGCOUNT': '52.000'} [2023-02-25 14:06:48,574][36138] Updated weights for policy 0, policy_version 47463 (0.0010) [2023-02-25 14:06:48,607][36140] DAMAGECOUNT value on done: 757490.0 [2023-02-25 14:06:48,607][36140] Sum rewards: 50.418, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.978', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO4': '0.178', 'weapon5': '0.204', 'AMMO3': '0.248', 'WEAPON5': '0.400', 'weapon2': '0.440', 'WEAPON4': '0.550', 'weapon4': '0.678', 'WEAPON3': '1.450', 'weapon3': '2.342', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.625', 'FRAGCOUNT': '47.000'} [2023-02-25 14:06:48,624][36141] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:06:49,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13312.0, 300 sec: 13398.8). Total num frames: 194420736. Throughput: 0: 3332.0. Samples: 11103416. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:06:49,730][36114] Avg episode reward: [(0, '54.285')] [2023-02-25 14:06:49,913][36142] DAMAGECOUNT value on done: 768302.0 [2023-02-25 14:06:49,913][36142] Sum rewards: 59.693, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.100', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.058', 'AMMO4': '0.128', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.206', 'weapon2': '0.888', 'WEAPON3': '1.100', 'weapon3': '2.688', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.084', 'FRAGCOUNT': '49.000'} [2023-02-25 14:06:50,229][36142] DAMAGECOUNT value on done: 754143.0 [2023-02-25 14:06:50,229][36142] Sum rewards: 58.852, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.062', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'weapon5': '0.152', 'AMMO3': '0.230', 'weapon4': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.444', 'WEAPON3': '1.400', 'weapon3': '2.862', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.018', 'FRAGCOUNT': '52.000'} [2023-02-25 14:06:50,238][36142] DAMAGECOUNT value on done: 749674.0 [2023-02-25 14:06:50,239][36142] Sum rewards: 43.758, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.900', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.037', 'AMMO4': '0.183', 'weapon5': '0.184', 'weapon2': '0.238', 'AMMO3': '0.253', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.562', 'WEAPON3': '1.500', 'weapon3': '2.578', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '12.885', 'FRAGCOUNT': '44.500'} [2023-02-25 14:06:50,557][36142] DAMAGECOUNT value on done: 767951.0 [2023-02-25 14:06:50,558][36142] Sum rewards: 63.120, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.382', 'AMMO5': '0.020', 'AMMO2': '0.046', 'weapon5': '0.194', 'AMMO4': '0.232', 'AMMO3': '0.248', 'weapon2': '0.294', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.582', 'WEAPON3': '1.500', 'weapon3': '2.518', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.588', 'FRAGCOUNT': '59.000'} [2023-02-25 14:06:51,189][36156] DAMAGECOUNT value on done: 774413.0 [2023-02-25 14:06:51,189][36156] Sum rewards: 55.432, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.069', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon5': '0.178', 'weapon2': '0.198', 'AMMO3': '0.245', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.466', 'WEAPON3': '1.450', 'HITCOUNT': '2.780', 'weapon3': '2.818', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '52.000'} [2023-02-25 14:06:51,399][36156] DAMAGECOUNT value on done: 765895.0 [2023-02-25 14:06:51,399][36156] Sum rewards: 37.597, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.710', 'AMMO5': '0.022', 'AMMO2': '0.070', 'AMMO3': '0.135', 'weapon2': '0.206', 'weapon5': '0.264', 'AMMO4': '0.352', 'ARMOR': '0.466', 'WEAPON5': '0.600', 'WEAPON3': '0.850', 'WEAPON4': '0.850', 'weapon4': '0.998', 'weapon3': '2.182', 'HITCOUNT': '2.290', 'DAMAGECOUNT': '11.022', 'FRAGCOUNT': '35.000'} [2023-02-25 14:06:51,524][36156] DAMAGECOUNT value on done: 762737.0 [2023-02-25 14:06:51,524][36156] Sum rewards: 52.461, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.700', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.098', 'AMMO4': '0.141', 'weapon4': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.322', 'WEAPON3': '1.300', 'HITCOUNT': '3.020', 'weapon3': '3.174', 'DAMAGECOUNT': '14.535', 'FRAGCOUNT': '46.500'} [2023-02-25 14:06:51,662][36138] Updated weights for policy 0, policy_version 47473 (0.0009) [2023-02-25 14:06:51,720][36156] DAMAGECOUNT value on done: 760677.0 [2023-02-25 14:06:51,720][36156] Sum rewards: 56.689, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.692', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.038', 'weapon5': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'AMMO4': '0.190', 'weapon2': '0.228', 'WEAPON4': '0.350', 'weapon4': '0.878', 'WEAPON3': '1.000', 'weapon3': '2.256', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.949', 'FRAGCOUNT': '49.500'} [2023-02-25 14:06:51,857][36155] DAMAGECOUNT value on done: 754010.0 [2023-02-25 14:06:51,857][36155] Sum rewards: 62.997, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.385', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.154', 'weapon4': '0.170', 'AMMO3': '0.230', 'WEAPON3': '1.450', 'weapon3': '3.378', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '55.000'} [2023-02-25 14:06:52,164][36155] DAMAGECOUNT value on done: 772982.0 [2023-02-25 14:06:52,164][36155] Sum rewards: 51.403, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.344', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.057', 'AMMO3': '0.192', 'AMMO4': '0.287', 'weapon5': '0.314', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon4': '0.620', 'weapon2': '0.634', 'WEAPON3': '1.250', 'weapon3': '1.998', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.946', 'FRAGCOUNT': '48.000'} [2023-02-25 14:06:53,071][36155] DAMAGECOUNT value on done: 769507.0 [2023-02-25 14:06:53,071][36155] Sum rewards: 54.652, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.810', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.168', 'AMMO3': '0.172', 'AMMO4': '0.175', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.356', 'weapon2': '0.552', 'WEAPON3': '1.050', 'weapon3': '2.526', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '48.000'} [2023-02-25 14:06:53,382][36155] DAMAGECOUNT value on done: 760588.0 [2023-02-25 14:06:53,383][36155] Sum rewards: 51.999, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.299', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'weapon4': '0.246', 'weapon2': '0.532', 'WEAPON3': '1.200', 'HITCOUNT': '2.850', 'weapon3': '2.988', 'DAMAGECOUNT': '13.731', 'FRAGCOUNT': '44.000'} [2023-02-25 14:06:53,496][36139] DAMAGECOUNT value on done: 764629.0 [2023-02-25 14:06:53,497][36139] Sum rewards: 54.972, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.628', 'AMMO5': '0.014', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.173', 'weapon5': '0.202', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.438', 'weapon2': '0.578', 'WEAPON3': '1.100', 'weapon3': '2.380', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.544', 'FRAGCOUNT': '48.000'} [2023-02-25 14:06:53,818][36139] DAMAGECOUNT value on done: 757229.0 [2023-02-25 14:06:53,819][36139] Sum rewards: 58.182, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.536', 'AMMO5': '0.006', 'weapon4': '0.016', 'AMMO2': '0.024', 'weapon5': '0.034', 'WEAPON4': '0.100', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.792', 'WEAPON3': '1.200', 'weapon3': '2.942', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.085', 'FRAGCOUNT': '49.000'} [2023-02-25 14:06:54,152][36139] DAMAGECOUNT value on done: 772843.0 [2023-02-25 14:06:54,153][36139] Sum rewards: 59.663, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.211', 'AMMO5': '0.015', 'AMMO2': '0.040', 'AMMO3': '0.146', 'AMMO4': '0.201', 'weapon2': '0.280', 'weapon5': '0.288', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'weapon4': '0.988', 'weapon3': '2.118', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '48.000'} [2023-02-25 14:06:54,462][36139] DAMAGECOUNT value on done: 764620.0 [2023-02-25 14:06:54,462][36139] Sum rewards: 53.611, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.067', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.082', 'AMMO4': '0.159', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'weapon4': '0.264', 'weapon2': '0.328', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.800', 'weapon3': '3.136', 'DAMAGECOUNT': '13.548', 'FRAGCOUNT': '47.000'} [2023-02-25 14:06:54,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13312.0, 300 sec: 13398.8). Total num frames: 194486272. Throughput: 0: 3330.6. Samples: 11113400. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:06:54,729][36114] Avg episode reward: [(0, '54.417')] [2023-02-25 14:06:54,744][36138] Updated weights for policy 0, policy_version 47483 (0.0009) [2023-02-25 14:06:57,719][36138] Updated weights for policy 0, policy_version 47493 (0.0009) [2023-02-25 14:06:59,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.2, 300 sec: 13398.8). Total num frames: 194555904. Throughput: 0: 3335.4. Samples: 11133582. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:06:59,730][36114] Avg episode reward: [(0, '54.417')] [2023-02-25 14:07:00,771][36138] Updated weights for policy 0, policy_version 47503 (0.0009) [2023-02-25 14:07:03,790][36138] Updated weights for policy 0, policy_version 47513 (0.0009) [2023-02-25 14:07:03,855][36155] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:07:04,729][36114] Fps is (10 sec: 13926.3, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 194625536. Throughput: 0: 3341.7. Samples: 11153774. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:07:04,730][36114] Avg episode reward: [(0, '54.417')] [2023-02-25 14:07:04,845][36141] DAMAGECOUNT value on done: 772297.0 [2023-02-25 14:07:04,845][36141] Sum rewards: 54.187, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.195', 'AMMO5': '0.004', 'AMMO2': '0.024', 'weapon5': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'weapon4': '0.238', 'AMMO3': '0.276', 'WEAPON4': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.650', 'weapon3': '3.126', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.361', 'FRAGCOUNT': '50.000'} [2023-02-25 14:07:05,053][36154] DAMAGECOUNT value on done: 766765.0 [2023-02-25 14:07:05,054][36154] Sum rewards: 52.818, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.554', 'AMMO5': '0.012', 'ARMOR': '0.013', 'AMMO2': '0.034', 'weapon5': '0.096', 'AMMO4': '0.171', 'AMMO3': '0.195', 'weapon2': '0.348', 'WEAPON5': '0.350', 'weapon4': '0.372', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.960', 'weapon3': '2.966', 'DAMAGECOUNT': '14.154', 'FRAGCOUNT': '48.000'} [2023-02-25 14:07:05,159][36141] DAMAGECOUNT value on done: 768060.0 [2023-02-25 14:07:05,159][36141] Sum rewards: 50.401, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.830', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon5': '0.166', 'AMMO3': '0.183', 'AMMO4': '0.258', 'weapon4': '0.418', 'weapon2': '0.426', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.748', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.244', 'FRAGCOUNT': '45.500'} [2023-02-25 14:07:05,239][36141] DAMAGECOUNT value on done: 762416.0 [2023-02-25 14:07:05,239][36141] Sum rewards: 47.727, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.380', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.050', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'weapon2': '0.392', 'ARMOR': '0.451', 'weapon4': '0.464', 'WEAPON3': '1.200', 'weapon3': '2.710', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.894', 'FRAGCOUNT': '43.000'} [2023-02-25 14:07:05,371][36154] DAMAGECOUNT value on done: 765591.0 [2023-02-25 14:07:05,372][36154] Sum rewards: 37.787, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.230', 'AMMO5': '0.020', 'AMMO2': '0.060', 'AMMO3': '0.148', 'AMMO4': '0.301', 'weapon2': '0.352', 'ARMOR': '0.452', 'weapon5': '0.472', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '0.900', 'weapon4': '1.282', 'weapon3': '1.346', 'HITCOUNT': '2.300', 'DAMAGECOUNT': '12.183', 'FRAGCOUNT': '35.000'} [2023-02-25 14:07:05,381][36154] DAMAGECOUNT value on done: 755357.0 [2023-02-25 14:07:05,382][36154] Sum rewards: 46.793, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.306', 'AMMO5': '0.026', 'AMMO2': '0.044', 'weapon5': '0.184', 'AMMO3': '0.198', 'AMMO4': '0.217', 'weapon2': '0.268', 'ARMOR': '0.456', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'weapon4': '0.846', 'WEAPON3': '1.200', 'weapon3': '2.350', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.930', 'FRAGCOUNT': '42.500'} [2023-02-25 14:07:05,536][36141] DAMAGECOUNT value on done: 759218.0 [2023-02-25 14:07:05,537][36141] Sum rewards: 65.198, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.692', 'AMMO2': '0.002', 'AMMO4': '0.008', 'WEAPON1': '0.020', 'AMMO3': '0.164', 'weapon2': '0.364', 'WEAPON3': '1.000', 'HITCOUNT': '3.290', 'weapon3': '3.444', 'DAMAGECOUNT': '15.348', 'FRAGCOUNT': '52.000'} [2023-02-25 14:07:05,692][36154] DAMAGECOUNT value on done: 765968.0 [2023-02-25 14:07:05,692][36154] Sum rewards: 53.751, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.250', 'ARMOR': '0.004', 'AMMO5': '0.029', 'AMMO2': '0.075', 'AMMO3': '0.165', 'weapon2': '0.252', 'weapon5': '0.330', 'AMMO4': '0.375', 'WEAPON5': '0.700', 'WEAPON4': '0.900', 'WEAPON3': '1.000', 'weapon4': '1.218', 'weapon3': '1.756', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.087', 'FRAGCOUNT': '49.000'} [2023-02-25 14:07:06,905][36138] Updated weights for policy 0, policy_version 47523 (0.0009) [2023-02-25 14:07:07,081][36157] DAMAGECOUNT value on done: 774369.0 [2023-02-25 14:07:07,081][36157] Sum rewards: 35.046, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.775', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.044', 'AMMO3': '0.169', 'AMMO4': '0.222', 'weapon5': '0.322', 'weapon2': '0.352', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'weapon4': '0.928', 'WEAPON3': '1.050', 'weapon3': '1.978', 'HITCOUNT': '2.170', 'DAMAGECOUNT': '11.160', 'FRAGCOUNT': '34.000'} [2023-02-25 14:07:07,393][36157] DAMAGECOUNT value on done: 765234.0 [2023-02-25 14:07:07,393][36157] Sum rewards: 61.672, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.237', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.122', 'AMMO4': '0.187', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.272', 'weapon2': '0.408', 'WEAPON3': '1.200', 'weapon3': '2.928', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.882', 'FRAGCOUNT': '51.500'} [2023-02-25 14:07:07,780][36140] DAMAGECOUNT value on done: 771865.0 [2023-02-25 14:07:07,781][36140] Sum rewards: 53.922, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.600', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.100', 'AMMO4': '0.150', 'AMMO3': '0.205', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.466', 'weapon4': '0.570', 'WEAPON3': '1.200', 'weapon3': '2.522', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '13.326', 'FRAGCOUNT': '48.000'} [2023-02-25 14:07:07,993][36157] DAMAGECOUNT value on done: 776264.0 [2023-02-25 14:07:07,993][36157] Sum rewards: 50.104, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.744', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon4': '0.122', 'AMMO4': '0.149', 'weapon5': '0.188', 'AMMO3': '0.191', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.200', 'HITCOUNT': '2.640', 'weapon3': '2.960', 'DAMAGECOUNT': '13.128', 'FRAGCOUNT': '45.000'} [2023-02-25 14:07:08,085][36140] DAMAGECOUNT value on done: 754178.0 [2023-02-25 14:07:08,085][36140] Sum rewards: 42.028, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.785', 'AMMO5': '0.016', 'AMMO2': '0.063', 'weapon5': '0.162', 'AMMO3': '0.169', 'AMMO4': '0.317', 'weapon2': '0.342', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.684', 'WEAPON3': '1.000', 'weapon3': '2.550', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.519', 'FRAGCOUNT': '38.000'} [2023-02-25 14:07:08,287][36157] DAMAGECOUNT value on done: 773586.0 [2023-02-25 14:07:08,288][36157] Sum rewards: 50.991, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.496', 'AMMO5': '0.017', 'AMMO2': '0.049', 'AMMO3': '0.214', 'AMMO4': '0.245', 'weapon2': '0.254', 'weapon5': '0.270', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.584', 'WEAPON3': '1.250', 'weapon3': '2.494', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '13.989', 'FRAGCOUNT': '46.000'} [2023-02-25 14:07:08,372][36140] DAMAGECOUNT value on done: 766178.0 [2023-02-25 14:07:08,372][36140] Sum rewards: 61.387, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.910', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.322', 'weapon4': '0.560', 'WEAPON3': '1.300', 'weapon3': '2.672', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.735', 'FRAGCOUNT': '53.000'} [2023-02-25 14:07:08,677][36140] DAMAGECOUNT value on done: 762105.0 [2023-02-25 14:07:08,677][36140] Sum rewards: 52.559, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.386', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'AMMO3': '0.194', 'weapon2': '0.248', 'weapon4': '0.284', 'WEAPON3': '1.300', 'HITCOUNT': '3.010', 'weapon3': '3.282', 'DAMAGECOUNT': '13.845', 'FRAGCOUNT': '46.000'} [2023-02-25 14:07:09,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 194691072. Throughput: 0: 3339.9. Samples: 11163690. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:07:09,730][36114] Avg episode reward: [(0, '54.062')] [2023-02-25 14:07:09,969][36138] Updated weights for policy 0, policy_version 47533 (0.0009) [2023-02-25 14:07:10,067][36142] DAMAGECOUNT value on done: 772950.0 [2023-02-25 14:07:10,068][36142] Sum rewards: 56.048, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.491', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.032', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.218', 'weapon2': '0.258', 'AMMO3': '0.287', 'WEAPON3': '1.650', 'HITCOUNT': '3.070', 'weapon3': '3.188', 'DAMAGECOUNT': '13.944', 'FRAGCOUNT': '52.000'} [2023-02-25 14:07:10,383][36142] DAMAGECOUNT value on done: 758553.0 [2023-02-25 14:07:10,383][36142] Sum rewards: 52.508, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.950', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.132', 'AMMO3': '0.144', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.484', 'weapon4': '0.858', 'WEAPON3': '0.900', 'weapon3': '2.300', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.230', 'FRAGCOUNT': '45.000'} [2023-02-25 14:07:10,393][36142] DAMAGECOUNT value on done: 754597.0 [2023-02-25 14:07:10,394][36142] Sum rewards: 56.800, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.621', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.042', 'AMMO3': '0.162', 'weapon2': '0.164', 'AMMO4': '0.211', 'weapon5': '0.262', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.528', 'WEAPON3': '1.000', 'weapon3': '2.714', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.769', 'FRAGCOUNT': '48.000'} [2023-02-25 14:07:10,697][36142] DAMAGECOUNT value on done: 772849.0 [2023-02-25 14:07:10,698][36142] Sum rewards: 54.200, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.235', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.156', 'AMMO3': '0.161', 'WEAPON4': '0.300', 'weapon2': '0.338', 'WEAPON5': '0.350', 'weapon4': '0.842', 'WEAPON3': '0.950', 'weapon3': '2.384', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.694', 'FRAGCOUNT': '44.000'} [2023-02-25 14:07:11,257][36156] DAMAGECOUNT value on done: 778696.0 [2023-02-25 14:07:11,258][36156] Sum rewards: 45.201, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.210', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.050', 'AMMO4': '0.137', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.500', 'weapon4': '0.524', 'weapon2': '0.538', 'WEAPON3': '1.200', 'weapon3': '2.590', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.849', 'FRAGCOUNT': '41.000'} [2023-02-25 14:07:11,445][36156] DAMAGECOUNT value on done: 770565.0 [2023-02-25 14:07:11,445][36156] Sum rewards: 54.075, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.955', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.117', 'weapon5': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon4': '0.286', 'weapon2': '0.452', 'WEAPON3': '1.250', 'HITCOUNT': '2.770', 'weapon3': '2.840', 'DAMAGECOUNT': '14.010', 'FRAGCOUNT': '47.000'} [2023-02-25 14:07:11,579][36156] DAMAGECOUNT value on done: 767394.0 [2023-02-25 14:07:11,579][36156] Sum rewards: 54.457, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.428', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'weapon2': '0.178', 'AMMO3': '0.246', 'weapon4': '0.460', 'WEAPON3': '1.400', 'weapon3': '2.888', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '13.971', 'FRAGCOUNT': '48.000'} [2023-02-25 14:07:11,759][36156] DAMAGECOUNT value on done: 765923.0 [2023-02-25 14:07:11,760][36156] Sum rewards: 61.072, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.862', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.039', 'AMMO3': '0.139', 'weapon5': '0.150', 'AMMO4': '0.196', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon2': '0.568', 'WEAPON3': '0.850', 'weapon4': '0.926', 'weapon3': '2.046', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '50.000'} [2023-02-25 14:07:11,810][36155] DAMAGECOUNT value on done: 759422.0 [2023-02-25 14:07:11,810][36155] Sum rewards: 59.786, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.300', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.166', 'AMMO3': '0.192', 'weapon4': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.384', 'WEAPON3': '1.150', 'weapon3': '2.904', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.236', 'FRAGCOUNT': '51.000'} [2023-02-25 14:07:12,116][36155] DAMAGECOUNT value on done: 776716.0 [2023-02-25 14:07:12,117][36155] Sum rewards: 40.144, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.616', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO3': '0.158', 'AMMO4': '0.186', 'weapon5': '0.246', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'ARMOR': '0.462', 'weapon2': '0.500', 'WEAPON3': '0.900', 'weapon4': '0.912', 'weapon3': '1.722', 'HITCOUNT': '2.360', 'DAMAGECOUNT': '11.202', 'FRAGCOUNT': '35.000'} [2023-02-25 14:07:13,004][36155] DAMAGECOUNT value on done: 775023.0 [2023-02-25 14:07:13,004][36155] Sum rewards: 70.457, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.690', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'weapon2': '0.358', 'WEAPON4': '0.400', 'weapon4': '0.610', 'WEAPON3': '1.250', 'weapon3': '2.760', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '16.548', 'FRAGCOUNT': '62.000'} [2023-02-25 14:07:13,089][36138] Updated weights for policy 0, policy_version 47543 (0.0009) [2023-02-25 14:07:13,316][36155] DAMAGECOUNT value on done: 764653.0 [2023-02-25 14:07:13,317][36155] Sum rewards: 45.507, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.280', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.090', 'AMMO4': '0.108', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.318', 'weapon2': '0.746', 'WEAPON3': '1.100', 'HITCOUNT': '2.510', 'weapon3': '2.564', 'DAMAGECOUNT': '12.195', 'FRAGCOUNT': '38.000'} [2023-02-25 14:07:13,489][36139] DAMAGECOUNT value on done: 769671.0 [2023-02-25 14:07:13,490][36139] Sum rewards: 58.041, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.482', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon5': '0.198', 'AMMO3': '0.212', 'weapon2': '0.266', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.582', 'WEAPON3': '1.300', 'weapon3': '2.574', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.126', 'FRAGCOUNT': '52.000'} [2023-02-25 14:07:13,803][36139] DAMAGECOUNT value on done: 761922.0 [2023-02-25 14:07:13,803][36139] Sum rewards: 52.364, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.707', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.137', 'weapon5': '0.158', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'weapon2': '0.324', 'WEAPON4': '0.450', 'weapon4': '0.634', 'WEAPON3': '1.200', 'weapon3': '2.546', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.079', 'FRAGCOUNT': '47.000'} [2023-02-25 14:07:14,122][36139] DAMAGECOUNT value on done: 778273.0 [2023-02-25 14:07:14,122][36139] Sum rewards: 58.184, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.165', 'ARMOR': '0.004', 'AMMO2': '0.012', 'AMMO5': '0.012', 'weapon5': '0.056', 'AMMO4': '0.059', 'WEAPON4': '0.200', 'weapon4': '0.238', 'AMMO3': '0.264', 'weapon2': '0.264', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.170', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.290', 'FRAGCOUNT': '52.000'} [2023-02-25 14:07:14,434][36139] DAMAGECOUNT value on done: 770011.0 [2023-02-25 14:07:14,434][36139] Sum rewards: 57.777, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.618', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.142', 'AMMO4': '0.180', 'AMMO3': '0.200', 'weapon4': '0.304', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.900', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.780', 'FRAGCOUNT': '49.500'} [2023-02-25 14:07:14,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 194756608. Throughput: 0: 3341.2. Samples: 11183662. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:07:14,729][36114] Avg episode reward: [(0, '54.725')] [2023-02-25 14:07:16,119][36138] Updated weights for policy 0, policy_version 47553 (0.0009) [2023-02-25 14:07:19,147][36138] Updated weights for policy 0, policy_version 47563 (0.0009) [2023-02-25 14:07:19,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.2, 300 sec: 13398.8). Total num frames: 194822144. Throughput: 0: 3346.4. Samples: 11203948. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:07:19,730][36114] Avg episode reward: [(0, '54.725')] [2023-02-25 14:07:19,746][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000047565_194826240.pth... [2023-02-25 14:07:19,813][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000046780_191610880.pth [2023-02-25 14:07:22,216][36138] Updated weights for policy 0, policy_version 47573 (0.0009) [2023-02-25 14:07:24,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 194891776. Throughput: 0: 3344.3. Samples: 11213886. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:07:24,730][36114] Avg episode reward: [(0, '54.725')] [2023-02-25 14:07:24,988][36141] DAMAGECOUNT value on done: 776541.0 [2023-02-25 14:07:24,989][36141] Sum rewards: 47.049, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.440', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.082', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'WEAPON4': '0.350', 'weapon4': '0.402', 'weapon2': '0.534', 'WEAPON3': '1.250', 'weapon3': '2.550', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '12.687', 'FRAGCOUNT': '42.000'} [2023-02-25 14:07:25,079][36154] DAMAGECOUNT value on done: 771758.0 [2023-02-25 14:07:25,080][36154] Sum rewards: 55.224, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.217', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.094', 'AMMO3': '0.160', 'weapon2': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.860', 'WEAPON3': '1.000', 'weapon3': '2.468', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.979', 'FRAGCOUNT': '45.000'} [2023-02-25 14:07:25,272][36138] Updated weights for policy 0, policy_version 47583 (0.0010) [2023-02-25 14:07:25,303][36141] DAMAGECOUNT value on done: 773330.0 [2023-02-25 14:07:25,304][36141] Sum rewards: 56.133, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-4.052', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.138', 'AMMO4': '0.164', 'weapon2': '0.190', 'WEAPON5': '0.250', 'AMMO3': '0.288', 'WEAPON4': '0.500', 'weapon4': '0.528', 'WEAPON3': '1.700', 'weapon3': '2.756', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.810', 'FRAGCOUNT': '54.000'} [2023-02-25 14:07:25,383][36154] DAMAGECOUNT value on done: 770498.0 [2023-02-25 14:07:25,383][36154] Sum rewards: 60.096, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.210', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.060', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.238', 'AMMO3': '0.267', 'weapon4': '0.446', 'WEAPON3': '1.600', 'weapon3': '2.962', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.721', 'FRAGCOUNT': '55.000'} [2023-02-25 14:07:25,391][36141] DAMAGECOUNT value on done: 768232.0 [2023-02-25 14:07:25,391][36141] Sum rewards: 65.579, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.810', 'AMMO5': '0.011', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.092', 'weapon4': '0.158', 'WEAPON4': '0.200', 'weapon2': '0.234', 'AMMO3': '0.267', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '3.210', 'weapon3': '3.234', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '59.000'} [2023-02-25 14:07:25,393][36154] DAMAGECOUNT value on done: 759475.0 [2023-02-25 14:07:25,393][36154] Sum rewards: 50.364, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.587', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.152', 'AMMO3': '0.168', 'AMMO4': '0.172', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON4': '0.450', 'weapon4': '0.958', 'WEAPON3': '1.000', 'weapon3': '2.054', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '12.354', 'FRAGCOUNT': '42.000'} [2023-02-25 14:07:25,708][36141] DAMAGECOUNT value on done: 763910.0 [2023-02-25 14:07:25,708][36141] Sum rewards: 58.321, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.144', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.112', 'weapon4': '0.162', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.540', 'WEAPON3': '1.200', 'weapon3': '2.994', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.076', 'FRAGCOUNT': '50.000'} [2023-02-25 14:07:25,711][36154] DAMAGECOUNT value on done: 770639.0 [2023-02-25 14:07:25,711][36154] Sum rewards: 52.462, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.880', 'AMMO5': '0.019', 'AMMO2': '0.032', 'weapon5': '0.144', 'AMMO4': '0.161', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'weapon2': '0.368', 'weapon4': '0.372', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.830', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.995', 'FRAGCOUNT': '47.000'} [2023-02-25 14:07:27,216][36157] DAMAGECOUNT value on done: 779312.0 [2023-02-25 14:07:27,216][36157] Sum rewards: 58.468, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.140', 'AMMO5': '0.020', 'AMMO2': '0.056', 'AMMO3': '0.153', 'weapon5': '0.262', 'AMMO4': '0.280', 'weapon4': '0.448', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon2': '0.718', 'WEAPON3': '1.000', 'weapon3': '2.262', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.829', 'FRAGCOUNT': '50.000'} [2023-02-25 14:07:27,524][36157] DAMAGECOUNT value on done: 769853.0 [2023-02-25 14:07:27,525][36157] Sum rewards: 47.395, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.330', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.068', 'weapon2': '0.182', 'AMMO4': '0.187', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon4': '0.594', 'WEAPON3': '1.350', 'weapon3': '2.818', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.857', 'FRAGCOUNT': '42.000'} [2023-02-25 14:07:27,775][36140] DAMAGECOUNT value on done: 776903.0 [2023-02-25 14:07:27,775][36140] Sum rewards: 59.066, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.886', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon5': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.372', 'weapon4': '0.388', 'WEAPON3': '1.400', 'weapon3': '2.870', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.114', 'FRAGCOUNT': '52.500'} [2023-02-25 14:07:28,067][36140] DAMAGECOUNT value on done: 758068.0 [2023-02-25 14:07:28,068][36140] Sum rewards: 44.023, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.065', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.108', 'AMMO3': '0.158', 'WEAPON5': '0.200', 'AMMO4': '0.251', 'WEAPON4': '0.300', 'weapon2': '0.428', 'WEAPON3': '0.850', 'weapon4': '0.894', 'weapon3': '2.298', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '11.670', 'FRAGCOUNT': '37.000'} [2023-02-25 14:07:28,103][36157] DAMAGECOUNT value on done: 781136.0 [2023-02-25 14:07:28,103][36157] Sum rewards: 54.796, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.080', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'weapon4': '0.196', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.428', 'WEAPON3': '1.500', 'weapon3': '3.014', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.616', 'FRAGCOUNT': '49.000'} [2023-02-25 14:07:28,313][36138] Updated weights for policy 0, policy_version 47593 (0.0009) [2023-02-25 14:07:28,348][36140] DAMAGECOUNT value on done: 770654.0 [2023-02-25 14:07:28,349][36140] Sum rewards: 46.412, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.595', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.088', 'AMMO4': '0.149', 'weapon2': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.263', 'weapon4': '0.382', 'WEAPON3': '1.600', 'weapon3': '3.038', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.428', 'FRAGCOUNT': '43.000'} [2023-02-25 14:07:28,399][36157] DAMAGECOUNT value on done: 778502.0 [2023-02-25 14:07:28,399][36157] Sum rewards: 56.235, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.900', 'AMMO5': '0.020', 'AMMO2': '0.048', 'AMMO3': '0.166', 'AMMO4': '0.242', 'weapon2': '0.298', 'weapon5': '0.398', 'WEAPON4': '0.500', 'weapon4': '0.588', 'WEAPON5': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.326', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.748', 'FRAGCOUNT': '48.000'} [2023-02-25 14:07:28,655][36140] DAMAGECOUNT value on done: 766997.0 [2023-02-25 14:07:28,656][36140] Sum rewards: 53.762, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.225', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.062', 'AMMO4': '0.093', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.262', 'weapon2': '0.376', 'WEAPON3': '1.400', 'weapon3': '3.046', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '47.000'} [2023-02-25 14:07:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 194957312. Throughput: 0: 3344.5. Samples: 11233976. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:07:29,730][36114] Avg episode reward: [(0, '54.616')] [2023-02-25 14:07:30,194][36142] DAMAGECOUNT value on done: 778132.0 [2023-02-25 14:07:30,194][36142] Sum rewards: 66.177, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.494', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.120', 'AMMO3': '0.148', 'weapon2': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.455', 'WEAPON3': '0.850', 'weapon4': '0.890', 'weapon3': '2.138', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.546', 'FRAGCOUNT': '54.000'} [2023-02-25 14:07:30,503][36142] DAMAGECOUNT value on done: 763430.0 [2023-02-25 14:07:30,504][36142] Sum rewards: 56.884, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.838', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.049', 'AMMO3': '0.126', 'weapon5': '0.224', 'AMMO4': '0.243', 'weapon2': '0.342', 'WEAPON5': '0.400', 'weapon4': '0.402', 'WEAPON4': '0.450', 'WEAPON3': '0.750', 'weapon3': '2.788', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.631', 'FRAGCOUNT': '45.500'} [2023-02-25 14:07:30,513][36142] DAMAGECOUNT value on done: 759189.0 [2023-02-25 14:07:30,513][36142] Sum rewards: 50.964, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.592', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'AMMO2': '0.050', 'weapon5': '0.218', 'AMMO3': '0.234', 'WEAPON5': '0.250', 'AMMO4': '0.250', 'weapon2': '0.322', 'WEAPON4': '0.450', 'weapon4': '0.604', 'WEAPON3': '1.450', 'weapon3': '2.380', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.776', 'FRAGCOUNT': '48.000'} [2023-02-25 14:07:30,794][36142] DAMAGECOUNT value on done: 777944.0 [2023-02-25 14:07:30,795][36142] Sum rewards: 51.833, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.085', 'AMMO5': '0.018', 'AMMO2': '0.051', 'weapon5': '0.154', 'weapon4': '0.166', 'weapon2': '0.184', 'AMMO3': '0.238', 'AMMO4': '0.257', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'HITCOUNT': '3.010', 'weapon3': '3.204', 'DAMAGECOUNT': '15.285', 'FRAGCOUNT': '48.000'} [2023-02-25 14:07:31,351][36138] Updated weights for policy 0, policy_version 47603 (0.0009) [2023-02-25 14:07:31,382][36156] DAMAGECOUNT value on done: 783659.0 [2023-02-25 14:07:31,382][36156] Sum rewards: 51.256, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.552', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO4': '0.189', 'AMMO3': '0.237', 'weapon2': '0.284', 'weapon5': '0.302', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.780', 'WEAPON3': '1.300', 'weapon3': '2.264', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.889', 'FRAGCOUNT': '46.000'} [2023-02-25 14:07:31,587][36156] DAMAGECOUNT value on done: 775996.0 [2023-02-25 14:07:31,587][36156] Sum rewards: 66.358, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.869', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.147', 'weapon5': '0.180', 'weapon2': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.564', 'WEAPON3': '1.000', 'weapon3': '2.736', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '56.000'} [2023-02-25 14:07:31,707][36156] DAMAGECOUNT value on done: 772861.0 [2023-02-25 14:07:31,707][36156] Sum rewards: 59.878, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.726', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon5': '0.152', 'weapon2': '0.206', 'AMMO4': '0.238', 'AMMO3': '0.242', 'weapon4': '0.350', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.762', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.383', 'FRAGCOUNT': '53.000'} [2023-02-25 14:07:31,767][36155] DAMAGECOUNT value on done: 763792.0 [2023-02-25 14:07:31,767][36155] Sum rewards: 50.594, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.498', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.045', 'AMMO3': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.194', 'WEAPON7': '0.200', 'AMMO4': '0.226', 'weapon7': '0.282', 'WEAPON5': '0.350', 'weapon2': '0.408', 'WEAPON3': '0.550', 'WEAPON4': '0.600', 'weapon4': '0.966', 'weapon3': '1.724', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '13.110', 'FRAGCOUNT': '41.000'} [2023-02-25 14:07:31,901][36156] DAMAGECOUNT value on done: 769977.0 [2023-02-25 14:07:31,902][36156] Sum rewards: 48.356, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.854', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'AMMO5': '0.027', 'AMMO2': '0.065', 'AMMO3': '0.110', 'AMMO4': '0.325', 'weapon5': '0.332', 'weapon2': '0.362', 'WEAPON4': '0.550', 'WEAPON3': '0.650', 'WEAPON5': '0.650', 'weapon4': '0.918', 'weapon3': '1.706', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '12.162', 'FRAGCOUNT': '40.000'} [2023-02-25 14:07:32,080][36155] DAMAGECOUNT value on done: 780730.0 [2023-02-25 14:07:32,081][36155] Sum rewards: 45.578, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.456', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.146', 'AMMO4': '0.178', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON4': '0.400', 'weapon4': '0.712', 'WEAPON3': '1.300', 'weapon3': '2.570', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '12.042', 'FRAGCOUNT': '43.000'} [2023-02-25 14:07:32,118][36154] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:07:32,961][36155] DAMAGECOUNT value on done: 780211.0 [2023-02-25 14:07:32,961][36155] Sum rewards: 58.109, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.330', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon2': '0.228', 'WEAPON4': '0.250', 'weapon4': '0.394', 'WEAPON3': '1.100', 'weapon3': '3.058', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.564', 'FRAGCOUNT': '48.000'} [2023-02-25 14:07:33,263][36155] DAMAGECOUNT value on done: 768838.0 [2023-02-25 14:07:33,264][36155] Sum rewards: 43.677, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.022', 'AMMO5': '0.010', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'weapon4': '0.104', 'weapon5': '0.116', 'WEAPON5': '0.200', 'AMMO3': '0.251', 'weapon2': '0.408', 'WEAPON3': '1.550', 'HITCOUNT': '2.900', 'weapon3': '3.132', 'DAMAGECOUNT': '12.555', 'FRAGCOUNT': '41.000'} [2023-02-25 14:07:33,645][36139] DAMAGECOUNT value on done: 773805.0 [2023-02-25 14:07:33,646][36139] Sum rewards: 50.212, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.520', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.103', 'weapon4': '0.168', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon2': '0.538', 'WEAPON3': '1.150', 'HITCOUNT': '2.540', 'weapon3': '3.068', 'DAMAGECOUNT': '12.402', 'FRAGCOUNT': '44.000'} [2023-02-25 14:07:33,967][36139] DAMAGECOUNT value on done: 766325.0 [2023-02-25 14:07:33,968][36139] Sum rewards: 44.936, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.520', 'AMMO5': '0.021', 'AMMO2': '0.041', 'weapon5': '0.166', 'AMMO4': '0.206', 'AMMO3': '0.269', 'weapon2': '0.294', 'weapon4': '0.470', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.660', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '13.209', 'FRAGCOUNT': '43.000'} [2023-02-25 14:07:34,271][36139] DAMAGECOUNT value on done: 782886.0 [2023-02-25 14:07:34,271][36139] Sum rewards: 55.425, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.830', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.112', 'AMMO4': '0.161', 'weapon4': '0.184', 'weapon2': '0.226', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.100', 'weapon3': '3.152', 'DAMAGECOUNT': '13.839', 'FRAGCOUNT': '50.000'} [2023-02-25 14:07:34,408][36138] Updated weights for policy 0, policy_version 47613 (0.0009) [2023-02-25 14:07:34,572][36139] DAMAGECOUNT value on done: 774768.0 [2023-02-25 14:07:34,572][36139] Sum rewards: 52.502, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.825', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.154', 'AMMO3': '0.199', 'AMMO4': '0.213', 'weapon4': '0.218', 'weapon2': '0.292', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.740', 'weapon3': '3.036', 'DAMAGECOUNT': '14.271', 'FRAGCOUNT': '47.000'} [2023-02-25 14:07:34,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 195026944. Throughput: 0: 3350.7. Samples: 11254198. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:07:34,730][36114] Avg episode reward: [(0, '53.602')] [2023-02-25 14:07:37,424][36138] Updated weights for policy 0, policy_version 47623 (0.0009) [2023-02-25 14:07:39,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 195092480. Throughput: 0: 3356.0. Samples: 11264422. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:07:39,730][36114] Avg episode reward: [(0, '53.602')] [2023-02-25 14:07:40,481][36138] Updated weights for policy 0, policy_version 47633 (0.0009) [2023-02-25 14:07:43,556][36138] Updated weights for policy 0, policy_version 47643 (0.0009) [2023-02-25 14:07:44,705][36139] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:07:44,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 195158016. Throughput: 0: 3354.2. Samples: 11284522. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:07:44,730][36114] Avg episode reward: [(0, '53.602')] [2023-02-25 14:07:45,046][36141] DAMAGECOUNT value on done: 781505.0 [2023-02-25 14:07:45,046][36141] Sum rewards: 62.043, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.466', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.090', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'weapon2': '0.252', 'WEAPON4': '0.350', 'weapon4': '0.706', 'WEAPON3': '1.000', 'weapon3': '2.540', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.892', 'FRAGCOUNT': '52.000'} [2023-02-25 14:07:45,132][36154] DAMAGECOUNT value on done: 776468.0 [2023-02-25 14:07:45,133][36154] Sum rewards: 50.641, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.562', 'AMMO5': '0.017', 'AMMO2': '0.039', 'AMMO3': '0.174', 'AMMO4': '0.198', 'weapon4': '0.206', 'weapon5': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.446', 'ARMOR': '0.491', 'WEAPON3': '1.100', 'weapon3': '2.750', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '14.130', 'FRAGCOUNT': '42.500'} [2023-02-25 14:07:45,341][36141] DAMAGECOUNT value on done: 777886.0 [2023-02-25 14:07:45,342][36141] Sum rewards: 51.686, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.680', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.143', 'AMMO3': '0.191', 'weapon5': '0.236', 'WEAPON5': '0.250', 'weapon4': '0.266', 'weapon2': '0.270', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '2.600', 'weapon3': '2.904', 'DAMAGECOUNT': '13.668', 'FRAGCOUNT': '46.000'} [2023-02-25 14:07:45,424][36141] DAMAGECOUNT value on done: 772256.0 [2023-02-25 14:07:45,425][36141] Sum rewards: 52.185, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.949', 'AMMO2': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.050', 'weapon5': '0.070', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.270', 'weapon4': '0.642', 'WEAPON3': '1.050', 'weapon3': '2.594', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.072', 'FRAGCOUNT': '46.000'} [2023-02-25 14:07:45,426][36154] DAMAGECOUNT value on done: 775534.0 [2023-02-25 14:07:45,426][36154] Sum rewards: 50.935, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.450', 'ARMOR': '0.008', 'AMMO5': '0.034', 'AMMO2': '0.065', 'AMMO3': '0.200', 'weapon2': '0.284', 'AMMO4': '0.324', 'weapon5': '0.394', 'weapon4': '0.654', 'WEAPON4': '0.850', 'WEAPON5': '0.900', 'WEAPON3': '1.200', 'weapon3': '2.244', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '15.108', 'FRAGCOUNT': '47.000'} [2023-02-25 14:07:45,435][36154] DAMAGECOUNT value on done: 763830.0 [2023-02-25 14:07:45,436][36154] Sum rewards: 50.102, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.542', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.110', 'weapon4': '0.178', 'AMMO3': '0.267', 'weapon2': '0.354', 'WEAPON3': '1.700', 'HITCOUNT': '2.670', 'weapon3': '3.044', 'DAMAGECOUNT': '13.065', 'FRAGCOUNT': '47.000'} [2023-02-25 14:07:45,729][36141] DAMAGECOUNT value on done: 769042.0 [2023-02-25 14:07:45,729][36141] Sum rewards: 59.967, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.716', 'AMMO2': '0.012', 'AMMO5': '0.012', 'AMMO4': '0.061', 'weapon5': '0.130', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.324', 'weapon2': '0.596', 'WEAPON3': '1.050', 'weapon3': '2.672', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '51.000'} [2023-02-25 14:07:45,749][36154] DAMAGECOUNT value on done: 775344.0 [2023-02-25 14:07:45,749][36154] Sum rewards: 50.962, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.000', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.044', 'AMMO4': '0.074', 'WEAPON4': '0.150', 'weapon5': '0.162', 'AMMO3': '0.211', 'weapon2': '0.218', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '2.830', 'weapon3': '3.386', 'DAMAGECOUNT': '14.115', 'FRAGCOUNT': '44.500'} [2023-02-25 14:07:46,616][36138] Updated weights for policy 0, policy_version 47653 (0.0009) [2023-02-25 14:07:47,208][36157] DAMAGECOUNT value on done: 784837.0 [2023-02-25 14:07:47,209][36157] Sum rewards: 67.583, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.740', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.082', 'weapon5': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon4': '0.316', 'weapon2': '0.330', 'WEAPON3': '1.350', 'weapon3': '2.916', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '59.000'} [2023-02-25 14:07:47,529][36157] DAMAGECOUNT value on done: 773235.0 [2023-02-25 14:07:47,529][36157] Sum rewards: 39.482, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.096', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.049', 'AMMO3': '0.180', 'weapon5': '0.196', 'AMMO4': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.694', 'WEAPON3': '1.000', 'weapon4': '1.156', 'weapon3': '1.626', 'HITCOUNT': '2.370', 'DAMAGECOUNT': '10.146', 'FRAGCOUNT': '35.000'} [2023-02-25 14:07:47,654][36140] DAMAGECOUNT value on done: 780673.0 [2023-02-25 14:07:47,654][36140] Sum rewards: 44.281, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.956', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.241', 'weapon4': '0.324', 'weapon2': '0.414', 'WEAPON3': '1.450', 'HITCOUNT': '2.480', 'weapon3': '3.038', 'DAMAGECOUNT': '11.310', 'FRAGCOUNT': '41.000'} [2023-02-25 14:07:47,969][36140] DAMAGECOUNT value on done: 763305.0 [2023-02-25 14:07:47,969][36140] Sum rewards: 62.904, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.530', 'AMMO5': '0.005', 'AMMO2': '0.044', 'weapon5': '0.094', 'weapon2': '0.158', 'weapon4': '0.170', 'WEAPON5': '0.200', 'AMMO4': '0.220', 'WEAPON4': '0.250', 'AMMO3': '0.252', 'WEAPON3': '1.550', 'weapon3': '3.340', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.531', 'FRAGCOUNT': '56.000'} [2023-02-25 14:07:48,183][36157] DAMAGECOUNT value on done: 786611.0 [2023-02-25 14:07:48,184][36157] Sum rewards: 64.453, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.545', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.092', 'AMMO4': '0.122', 'weapon2': '0.160', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'weapon4': '0.310', 'WEAPON3': '1.400', 'weapon3': '3.148', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '57.000'} [2023-02-25 14:07:48,240][36140] DAMAGECOUNT value on done: 774585.0 [2023-02-25 14:07:48,240][36140] Sum rewards: 43.576, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.805', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'AMMO4': '0.196', 'WEAPON4': '0.350', 'weapon2': '0.366', 'weapon4': '0.484', 'WEAPON3': '1.150', 'HITCOUNT': '2.740', 'weapon3': '2.790', 'DAMAGECOUNT': '11.793', 'FRAGCOUNT': '38.000'} [2023-02-25 14:07:48,497][36157] DAMAGECOUNT value on done: 783200.0 [2023-02-25 14:07:48,497][36157] Sum rewards: 54.353, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.165', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.126', 'AMMO3': '0.175', 'weapon2': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.396', 'WEAPON3': '1.050', 'weapon3': '3.012', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.094', 'FRAGCOUNT': '46.000'} [2023-02-25 14:07:48,546][36140] DAMAGECOUNT value on done: 771123.0 [2023-02-25 14:07:48,546][36140] Sum rewards: 40.424, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.134', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.182', 'weapon5': '0.190', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.538', 'weapon4': '0.564', 'WEAPON3': '1.100', 'weapon3': '2.278', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '12.378', 'FRAGCOUNT': '37.000'} [2023-02-25 14:07:48,611][36154] Large shaping reward 2.590 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.558, 186.0), ('weapon7', 0.002)] [2023-02-25 14:07:49,689][36138] Updated weights for policy 0, policy_version 47663 (0.0009) [2023-02-25 14:07:49,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 195227648. Throughput: 0: 3351.2. Samples: 11304576. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:07:49,730][36114] Avg episode reward: [(0, '53.379')] [2023-02-25 14:07:50,042][36142] DAMAGECOUNT value on done: 782324.0 [2023-02-25 14:07:50,043][36142] Sum rewards: 47.502, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.288', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.138', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.328', 'weapon4': '0.692', 'WEAPON3': '1.350', 'weapon3': '2.440', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.576', 'FRAGCOUNT': '44.000'} [2023-02-25 14:07:50,343][36142] DAMAGECOUNT value on done: 768704.0 [2023-02-25 14:07:50,344][36142] Sum rewards: 61.980, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.941', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.058', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.156', 'AMMO3': '0.227', 'weapon2': '0.472', 'WEAPON3': '1.400', 'weapon3': '3.122', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.822', 'FRAGCOUNT': '54.000'} [2023-02-25 14:07:50,381][36142] DAMAGECOUNT value on done: 764124.0 [2023-02-25 14:07:50,382][36142] Sum rewards: 56.664, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.070', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.190', 'AMMO3': '0.216', 'weapon2': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.404', 'WEAPON3': '1.350', 'weapon3': '2.808', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.805', 'FRAGCOUNT': '50.000'} [2023-02-25 14:07:50,724][36142] DAMAGECOUNT value on done: 782769.0 [2023-02-25 14:07:50,725][36142] Sum rewards: 57.959, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.475', 'AMMO2': '0.013', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'AMMO3': '0.212', 'weapon2': '0.282', 'weapon4': '0.442', 'ARMOR': '0.495', 'WEAPON3': '1.200', 'HITCOUNT': '2.990', 'weapon3': '3.108', 'DAMAGECOUNT': '14.475', 'FRAGCOUNT': '50.000'} [2023-02-25 14:07:51,753][36156] DAMAGECOUNT value on done: 788459.0 [2023-02-25 14:07:51,753][36156] Sum rewards: 55.389, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.408', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon4': '0.142', 'WEAPON4': '0.150', 'weapon5': '0.150', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'weapon2': '0.244', 'WEAPON3': '1.150', 'HITCOUNT': '2.920', 'weapon3': '3.156', 'DAMAGECOUNT': '14.400', 'FRAGCOUNT': '46.000'} [2023-02-25 14:07:51,881][36155] DAMAGECOUNT value on done: 768566.0 [2023-02-25 14:07:51,882][36155] Sum rewards: 54.902, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.490', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'WEAPON4': '0.100', 'AMMO3': '0.208', 'weapon2': '0.246', 'weapon4': '0.266', 'WEAPON3': '1.300', 'HITCOUNT': '2.800', 'weapon3': '3.134', 'DAMAGECOUNT': '14.322', 'FRAGCOUNT': '47.000'} [2023-02-25 14:07:51,952][36156] DAMAGECOUNT value on done: 780868.0 [2023-02-25 14:07:51,952][36156] Sum rewards: 54.778, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.528', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.150', 'AMMO3': '0.229', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.330', 'weapon4': '0.388', 'WEAPON3': '1.450', 'HITCOUNT': '2.820', 'weapon3': '2.850', 'DAMAGECOUNT': '14.586', 'FRAGCOUNT': '49.000'} [2023-02-25 14:07:52,077][36156] DAMAGECOUNT value on done: 776644.0 [2023-02-25 14:07:52,077][36156] Sum rewards: 42.948, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.200', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.099', 'weapon2': '0.118', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon4': '0.864', 'WEAPON3': '1.200', 'weapon3': '2.706', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '11.349', 'FRAGCOUNT': '38.000'} [2023-02-25 14:07:52,194][36155] DAMAGECOUNT value on done: 785224.0 [2023-02-25 14:07:52,194][36155] Sum rewards: 49.449, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.412', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.154', 'AMMO4': '0.164', 'AMMO3': '0.307', 'weapon4': '0.448', 'WEAPON3': '1.850', 'weapon3': '2.946', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.482', 'FRAGCOUNT': '48.000'} [2023-02-25 14:07:52,275][36156] DAMAGECOUNT value on done: 774440.0 [2023-02-25 14:07:52,276][36156] Sum rewards: 45.880, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.375', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon4': '0.132', 'weapon5': '0.156', 'AMMO4': '0.212', 'AMMO3': '0.255', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.458', 'WEAPON3': '1.600', 'HITCOUNT': '2.420', 'weapon3': '2.924', 'DAMAGECOUNT': '13.389', 'FRAGCOUNT': '45.000'} [2023-02-25 14:07:52,976][36138] Updated weights for policy 0, policy_version 47673 (0.0010) [2023-02-25 14:07:53,124][36155] DAMAGECOUNT value on done: 785464.0 [2023-02-25 14:07:53,125][36155] Sum rewards: 59.353, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.670', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.118', 'AMMO4': '0.210', 'AMMO3': '0.211', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON4': '0.350', 'weapon4': '0.362', 'WEAPON3': '1.350', 'weapon3': '2.864', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '52.000'} [2023-02-25 14:07:53,431][36155] DAMAGECOUNT value on done: 773453.0 [2023-02-25 14:07:53,431][36155] Sum rewards: 54.340, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.470', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'WEAPON4': '0.150', 'weapon4': '0.170', 'AMMO3': '0.247', 'weapon2': '0.346', 'WEAPON3': '1.500', 'HITCOUNT': '2.930', 'weapon3': '3.192', 'DAMAGECOUNT': '13.845', 'FRAGCOUNT': '50.000'} [2023-02-25 14:07:53,913][36139] DAMAGECOUNT value on done: 778915.0 [2023-02-25 14:07:53,914][36139] Sum rewards: 58.710, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.480', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.052', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO4': '0.143', 'WEAPON4': '0.200', 'weapon2': '0.240', 'AMMO3': '0.264', 'WEAPON3': '1.450', 'HITCOUNT': '3.180', 'weapon3': '3.344', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '53.000'} [2023-02-25 14:07:54,225][36139] DAMAGECOUNT value on done: 772071.0 [2023-02-25 14:07:54,226][36139] Sum rewards: 65.193, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.244', 'AMMO5': '0.013', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon4': '0.130', 'weapon5': '0.160', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.288', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.100', 'weapon3': '3.148', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '56.000'} [2023-02-25 14:07:54,529][36139] DAMAGECOUNT value on done: 787284.0 [2023-02-25 14:07:54,529][36139] Sum rewards: 48.497, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.901', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.134', 'AMMO3': '0.180', 'AMMO4': '0.187', 'weapon2': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.614', 'WEAPON3': '1.150', 'weapon3': '2.772', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.194', 'FRAGCOUNT': '42.000'} [2023-02-25 14:07:54,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.2, 300 sec: 13384.9). Total num frames: 195289088. Throughput: 0: 3336.6. Samples: 11313838. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:07:54,730][36114] Avg episode reward: [(0, '53.487')] [2023-02-25 14:07:54,850][36139] DAMAGECOUNT value on done: 779447.0 [2023-02-25 14:07:54,850][36139] Sum rewards: 53.112, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.887', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.152', 'weapon5': '0.232', 'weapon2': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.728', 'WEAPON3': '0.900', 'weapon3': '2.474', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '14.037', 'FRAGCOUNT': '45.000'} [2023-02-25 14:07:56,027][36138] Updated weights for policy 0, policy_version 47683 (0.0010) [2023-02-25 14:07:59,069][36138] Updated weights for policy 0, policy_version 47693 (0.0009) [2023-02-25 14:07:59,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 195358720. Throughput: 0: 3337.9. Samples: 11333866. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:07:59,730][36114] Avg episode reward: [(0, '53.498')] [2023-02-25 14:08:02,184][36138] Updated weights for policy 0, policy_version 47703 (0.0009) [2023-02-25 14:08:04,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13312.0, 300 sec: 13384.9). Total num frames: 195424256. Throughput: 0: 3330.7. Samples: 11353830. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:08:04,730][36114] Avg episode reward: [(0, '53.498')] [2023-02-25 14:08:05,241][36138] Updated weights for policy 0, policy_version 47713 (0.0009) [2023-02-25 14:08:05,393][36141] DAMAGECOUNT value on done: 785695.0 [2023-02-25 14:08:05,393][36141] Sum rewards: 49.922, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.783', 'AMMO2': '0.018', 'AMMO5': '0.018', 'AMMO4': '0.089', 'weapon5': '0.154', 'AMMO3': '0.170', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.434', 'weapon2': '0.746', 'WEAPON3': '1.150', 'weapon3': '2.426', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '12.570', 'FRAGCOUNT': '45.000'} [2023-02-25 14:08:05,477][36154] DAMAGECOUNT value on done: 781487.0 [2023-02-25 14:08:05,477][36154] Sum rewards: 54.787, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.832', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon2': '0.176', 'AMMO3': '0.182', 'weapon5': '0.240', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.748', 'WEAPON3': '1.100', 'weapon3': '2.524', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '15.054', 'FRAGCOUNT': '47.000'} [2023-02-25 14:08:05,690][36141] DAMAGECOUNT value on done: 782828.0 [2023-02-25 14:08:05,690][36141] Sum rewards: 61.434, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.018', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.158', 'AMMO3': '0.190', 'weapon2': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.652', 'WEAPON3': '1.200', 'weapon3': '2.710', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.826', 'FRAGCOUNT': '53.000'} [2023-02-25 14:08:05,738][36141] DAMAGECOUNT value on done: 777586.0 [2023-02-25 14:08:05,739][36141] Sum rewards: 56.262, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.955', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.007', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon2': '0.178', 'weapon4': '0.240', 'AMMO3': '0.255', 'WEAPON3': '1.700', 'weapon3': '3.228', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.990', 'FRAGCOUNT': '48.500'} [2023-02-25 14:08:05,780][36154] DAMAGECOUNT value on done: 780470.0 [2023-02-25 14:08:05,781][36154] Sum rewards: 50.388, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.780', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.118', 'AMMO3': '0.299', 'weapon2': '0.308', 'WEAPON3': '1.750', 'HITCOUNT': '3.110', 'weapon3': '3.194', 'DAMAGECOUNT': '14.808', 'FRAGCOUNT': '46.500'} [2023-02-25 14:08:05,802][36154] DAMAGECOUNT value on done: 768620.0 [2023-02-25 14:08:05,803][36154] Sum rewards: 54.268, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.650', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.146', 'AMMO3': '0.177', 'WEAPON4': '0.450', 'weapon2': '0.558', 'weapon4': '0.834', 'ARMOR': '0.861', 'WEAPON3': '1.100', 'weapon3': '2.294', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.370', 'FRAGCOUNT': '47.000'} [2023-02-25 14:08:06,060][36141] DAMAGECOUNT value on done: 773559.0 [2023-02-25 14:08:06,061][36141] Sum rewards: 53.268, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.082', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.122', 'AMMO4': '0.177', 'WEAPON5': '0.200', 'AMMO3': '0.257', 'weapon4': '0.286', 'weapon2': '0.320', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.910', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.551', 'FRAGCOUNT': '49.000'} [2023-02-25 14:08:06,120][36154] DAMAGECOUNT value on done: 780226.0 [2023-02-25 14:08:06,121][36154] Sum rewards: 48.419, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.620', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon7': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.160', 'WEAPON7': '0.200', 'AMMO4': '0.265', 'weapon5': '0.284', 'weapon2': '0.298', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '0.950', 'weapon4': '0.982', 'weapon3': '1.954', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.646', 'FRAGCOUNT': '41.000'} [2023-02-25 14:08:07,611][36157] DAMAGECOUNT value on done: 789913.0 [2023-02-25 14:08:07,612][36157] Sum rewards: 52.305, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.065', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon2': '0.358', 'weapon4': '0.438', 'WEAPON3': '1.400', 'weapon3': '2.812', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.183', 'FRAGCOUNT': '46.000'} [2023-02-25 14:08:07,929][36157] DAMAGECOUNT value on done: 778816.0 [2023-02-25 14:08:07,930][36157] Sum rewards: 64.765, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.155', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.042', 'weapon5': '0.044', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.284', 'weapon2': '0.288', 'WEAPON3': '1.650', 'weapon3': '3.374', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '58.000'} [2023-02-25 14:08:08,080][36140] DAMAGECOUNT value on done: 785650.0 [2023-02-25 14:08:08,081][36140] Sum rewards: 62.894, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.306', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.096', 'AMMO4': '0.181', 'AMMO3': '0.209', 'weapon4': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '3.050', 'weapon3': '3.154', 'DAMAGECOUNT': '14.931', 'FRAGCOUNT': '55.000'} [2023-02-25 14:08:08,314][36138] Updated weights for policy 0, policy_version 47723 (0.0009) [2023-02-25 14:08:08,409][36140] DAMAGECOUNT value on done: 767363.0 [2023-02-25 14:08:08,410][36140] Sum rewards: 44.095, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.490', 'AMMO5': '0.022', 'AMMO2': '0.077', 'AMMO3': '0.212', 'weapon2': '0.234', 'weapon5': '0.320', 'AMMO4': '0.384', 'weapon4': '0.462', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.570', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.174', 'FRAGCOUNT': '43.000'} [2023-02-25 14:08:08,576][36157] DAMAGECOUNT value on done: 792154.0 [2023-02-25 14:08:08,576][36157] Sum rewards: 63.435, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.030', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'weapon2': '0.250', 'AMMO3': '0.267', 'weapon4': '0.352', 'WEAPON3': '1.500', 'weapon3': '3.050', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '56.000'} [2023-02-25 14:08:08,703][36140] DAMAGECOUNT value on done: 780058.0 [2023-02-25 14:08:08,704][36140] Sum rewards: 67.000, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.782', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.088', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon4': '0.280', 'weapon2': '0.466', 'WEAPON3': '1.250', 'weapon3': '2.936', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '57.000'} [2023-02-25 14:08:08,894][36157] DAMAGECOUNT value on done: 787365.0 [2023-02-25 14:08:08,894][36157] Sum rewards: 49.174, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.785', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.032', 'AMMO3': '0.148', 'AMMO4': '0.160', 'weapon5': '0.160', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.494', 'weapon2': '0.662', 'WEAPON3': '0.800', 'weapon3': '2.474', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.495', 'FRAGCOUNT': '43.000'} [2023-02-25 14:08:09,009][36140] DAMAGECOUNT value on done: 775983.0 [2023-02-25 14:08:09,010][36140] Sum rewards: 56.719, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.398', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.172', 'weapon5': '0.176', 'AMMO3': '0.212', 'weapon2': '0.284', 'weapon4': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.770', 'weapon3': '2.926', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '52.000'} [2023-02-25 14:08:09,625][36141] Large shaping reward 2.535 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.513, 171.0), ('weapon5', 0.002)] [2023-02-25 14:08:09,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13312.0, 300 sec: 13384.9). Total num frames: 195489792. Throughput: 0: 3332.7. Samples: 11363858. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:08:09,730][36114] Avg episode reward: [(0, '54.031')] [2023-02-25 14:08:10,469][36142] DAMAGECOUNT value on done: 787420.0 [2023-02-25 14:08:10,469][36142] Sum rewards: 61.187, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.347', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.114', 'AMMO4': '0.197', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON4': '0.350', 'weapon4': '0.554', 'WEAPON3': '1.250', 'weapon3': '2.742', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.988', 'FRAGCOUNT': '54.000'} [2023-02-25 14:08:10,738][36142] DAMAGECOUNT value on done: 774186.0 [2023-02-25 14:08:10,739][36142] Sum rewards: 63.753, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.032', 'AMMO5': '0.011', 'AMMO2': '0.019', 'weapon5': '0.064', 'AMMO4': '0.092', 'weapon2': '0.192', 'weapon4': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'WEAPON3': '1.450', 'weapon3': '3.226', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.446', 'FRAGCOUNT': '57.000'} [2023-02-25 14:08:10,778][36142] DAMAGECOUNT value on done: 768900.0 [2023-02-25 14:08:10,778][36142] Sum rewards: 52.039, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.314', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.108', 'AMMO4': '0.184', 'AMMO3': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON4': '0.350', 'weapon4': '0.628', 'WEAPON3': '1.400', 'weapon3': '2.576', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.328', 'FRAGCOUNT': '47.000'} [2023-02-25 14:08:11,057][36142] DAMAGECOUNT value on done: 787846.0 [2023-02-25 14:08:11,057][36142] Sum rewards: 61.825, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.740', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.092', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon4': '0.486', 'weapon2': '0.520', 'WEAPON3': '1.300', 'weapon3': '2.708', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.231', 'FRAGCOUNT': '53.000'} [2023-02-25 14:08:11,413][36138] Updated weights for policy 0, policy_version 47733 (0.0010) [2023-02-25 14:08:11,931][36156] DAMAGECOUNT value on done: 793187.0 [2023-02-25 14:08:11,931][36156] Sum rewards: 49.968, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.099', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.104', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'weapon2': '0.234', 'AMMO3': '0.274', 'WEAPON4': '0.350', 'weapon4': '0.382', 'WEAPON3': '1.550', 'weapon3': '2.972', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.184', 'FRAGCOUNT': '48.000'} [2023-02-25 14:08:12,010][36155] DAMAGECOUNT value on done: 773638.0 [2023-02-25 14:08:12,011][36155] Sum rewards: 51.985, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.310', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.116', 'AMMO4': '0.198', 'AMMO3': '0.201', 'WEAPON5': '0.250', 'weapon2': '0.268', 'ARMOR': '0.404', 'WEAPON4': '0.500', 'weapon4': '0.652', 'WEAPON3': '1.200', 'weapon3': '2.580', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '15.204', 'FRAGCOUNT': '47.000'} [2023-02-25 14:08:12,139][36156] DAMAGECOUNT value on done: 785573.0 [2023-02-25 14:08:12,139][36156] Sum rewards: 51.653, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.722', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.056', 'AMMO3': '0.137', 'weapon2': '0.208', 'weapon5': '0.252', 'AMMO4': '0.282', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '0.850', 'weapon4': '0.934', 'weapon3': '2.234', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.115', 'FRAGCOUNT': '44.500'} [2023-02-25 14:08:12,247][36156] DAMAGECOUNT value on done: 781351.0 [2023-02-25 14:08:12,248][36156] Sum rewards: 52.921, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.130', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.048', 'WEAPON5': '0.150', 'weapon4': '0.150', 'AMMO3': '0.200', 'AMMO4': '0.201', 'WEAPON4': '0.300', 'weapon2': '0.606', 'WEAPON3': '1.250', 'weapon3': '2.940', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.121', 'FRAGCOUNT': '47.000'} [2023-02-25 14:08:12,328][36155] DAMAGECOUNT value on done: 790385.0 [2023-02-25 14:08:12,328][36155] Sum rewards: 54.284, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.964', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.142', 'WEAPON5': '0.200', 'weapon2': '0.224', 'WEAPON4': '0.250', 'AMMO3': '0.265', 'weapon4': '0.416', 'WEAPON3': '1.500', 'weapon3': '2.890', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.483', 'FRAGCOUNT': '48.000'} [2023-02-25 14:08:12,449][36156] DAMAGECOUNT value on done: 779015.0 [2023-02-25 14:08:12,450][36156] Sum rewards: 61.319, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.611', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.179', 'weapon4': '0.282', 'weapon2': '0.322', 'WEAPON3': '1.150', 'HITCOUNT': '2.820', 'weapon3': '3.248', 'DAMAGECOUNT': '13.725', 'FRAGCOUNT': '53.000'} [2023-02-25 14:08:13,316][36155] DAMAGECOUNT value on done: 790037.0 [2023-02-25 14:08:13,316][36155] Sum rewards: 55.987, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.080', 'AMMO5': '0.005', 'weapon7': '0.032', 'AMMO2': '0.034', 'weapon5': '0.094', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'AMMO3': '0.180', 'weapon2': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.756', 'WEAPON3': '1.050', 'HITCOUNT': '2.600', 'weapon3': '2.628', 'DAMAGECOUNT': '13.719', 'FRAGCOUNT': '49.000'} [2023-02-25 14:08:13,626][36155] DAMAGECOUNT value on done: 778592.0 [2023-02-25 14:08:13,627][36155] Sum rewards: 51.614, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.750', 'AMMO5': '0.019', 'AMMO2': '0.061', 'weapon5': '0.224', 'AMMO3': '0.236', 'AMMO4': '0.306', 'weapon2': '0.340', 'weapon4': '0.536', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.514', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.417', 'FRAGCOUNT': '48.500'} [2023-02-25 14:08:13,988][36139] DAMAGECOUNT value on done: 783603.0 [2023-02-25 14:08:13,989][36139] Sum rewards: 47.598, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-1.795', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.041', 'weapon5': '0.158', 'AMMO4': '0.204', 'AMMO3': '0.278', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON4': '0.400', 'weapon4': '0.778', 'WEAPON3': '1.550', 'weapon3': '2.296', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.064', 'FRAGCOUNT': '47.000'} [2023-02-25 14:08:14,312][36139] DAMAGECOUNT value on done: 776478.0 [2023-02-25 14:08:14,312][36139] Sum rewards: 50.681, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.046', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon5': '0.104', 'AMMO3': '0.170', 'AMMO4': '0.239', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON4': '0.400', 'weapon4': '0.852', 'WEAPON3': '0.950', 'weapon3': '2.338', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '13.221', 'FRAGCOUNT': '43.000'} [2023-02-25 14:08:14,457][36138] Updated weights for policy 0, policy_version 47743 (0.0009) [2023-02-25 14:08:14,603][36139] DAMAGECOUNT value on done: 792652.0 [2023-02-25 14:08:14,604][36139] Sum rewards: 59.514, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.054', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.053', 'AMMO3': '0.187', 'weapon5': '0.224', 'AMMO4': '0.267', 'weapon2': '0.288', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon4': '1.132', 'weapon3': '2.036', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '51.000'} [2023-02-25 14:08:14,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13312.0, 300 sec: 13371.0). Total num frames: 195555328. Throughput: 0: 3329.5. Samples: 11383802. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:08:14,729][36114] Avg episode reward: [(0, '54.177')] [2023-02-25 14:08:14,917][36139] DAMAGECOUNT value on done: 784882.0 [2023-02-25 14:08:14,917][36139] Sum rewards: 63.522, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.716', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.142', 'AMMO3': '0.166', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'weapon2': '0.274', 'WEAPON4': '0.300', 'ARMOR': '0.404', 'weapon4': '0.716', 'WEAPON3': '1.000', 'weapon3': '2.582', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '52.000'} [2023-02-25 14:08:17,505][36138] Updated weights for policy 0, policy_version 47753 (0.0009) [2023-02-25 14:08:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 195624960. Throughput: 0: 3329.4. Samples: 11404022. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:08:19,729][36114] Avg episode reward: [(0, '54.357')] [2023-02-25 14:08:20,540][36138] Updated weights for policy 0, policy_version 47763 (0.0009) [2023-02-25 14:08:23,556][36138] Updated weights for policy 0, policy_version 47773 (0.0009) [2023-02-25 14:08:24,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13312.0, 300 sec: 13384.9). Total num frames: 195690496. Throughput: 0: 3327.6. Samples: 11414166. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:08:24,730][36114] Avg episode reward: [(0, '54.357')] [2023-02-25 14:08:25,355][36141] DAMAGECOUNT value on done: 790496.0 [2023-02-25 14:08:25,355][36141] Sum rewards: 51.202, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.640', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon2': '0.184', 'weapon5': '0.194', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.512', 'WEAPON3': '1.350', 'weapon3': '2.840', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.403', 'FRAGCOUNT': '47.000'} [2023-02-25 14:08:25,499][36154] DAMAGECOUNT value on done: 787572.0 [2023-02-25 14:08:25,500][36154] Sum rewards: 70.103, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.850', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.042', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.202', 'weapon4': '0.236', 'AMMO3': '0.238', 'WEAPON3': '1.550', 'weapon3': '3.328', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '59.000'} [2023-02-25 14:08:25,675][36141] DAMAGECOUNT value on done: 788244.0 [2023-02-25 14:08:25,676][36141] Sum rewards: 58.963, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.008', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.069', 'AMMO3': '0.196', 'weapon5': '0.232', 'weapon2': '0.272', 'AMMO4': '0.345', 'WEAPON5': '0.500', 'weapon4': '0.616', 'WEAPON4': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.494', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.248', 'FRAGCOUNT': '53.000'} [2023-02-25 14:08:25,772][36141] DAMAGECOUNT value on done: 782185.0 [2023-02-25 14:08:25,772][36141] Sum rewards: 61.797, reward structure: {'DEATHCOUNT': '-9.750', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO3': '0.123', 'AMMO4': '0.154', 'weapon5': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.442', 'HEALTH': '0.656', 'WEAPON3': '0.700', 'weapon4': '0.822', 'weapon3': '2.192', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.797', 'FRAGCOUNT': '49.000'} [2023-02-25 14:08:25,797][36154] DAMAGECOUNT value on done: 784864.0 [2023-02-25 14:08:25,797][36154] Sum rewards: 53.289, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.814', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.140', 'AMMO4': '0.170', 'AMMO3': '0.177', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.490', 'weapon2': '0.514', 'WEAPON3': '1.050', 'weapon3': '2.592', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.170', 'FRAGCOUNT': '46.000'} [2023-02-25 14:08:25,816][36154] DAMAGECOUNT value on done: 773036.0 [2023-02-25 14:08:25,817][36154] Sum rewards: 57.940, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.167', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'AMMO3': '0.136', 'weapon5': '0.138', 'AMMO4': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.278', 'weapon4': '0.578', 'WEAPON3': '0.900', 'weapon3': '2.740', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.248', 'FRAGCOUNT': '48.000'} [2023-02-25 14:08:26,086][36141] DAMAGECOUNT value on done: 778531.0 [2023-02-25 14:08:26,086][36141] Sum rewards: 57.931, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.066', 'AMMO5': '0.021', 'AMMO2': '0.037', 'AMMO3': '0.109', 'AMMO4': '0.185', 'weapon5': '0.252', 'weapon2': '0.380', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'weapon4': '1.018', 'weapon3': '1.928', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.916', 'FRAGCOUNT': '48.000'} [2023-02-25 14:08:26,114][36154] DAMAGECOUNT value on done: 785414.0 [2023-02-25 14:08:26,114][36154] Sum rewards: 60.383, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.318', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon4': '0.342', 'weapon2': '0.608', 'WEAPON3': '1.200', 'weapon3': '2.794', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.564', 'FRAGCOUNT': '51.000'} [2023-02-25 14:08:26,638][36138] Updated weights for policy 0, policy_version 47783 (0.0009) [2023-02-25 14:08:27,651][36157] DAMAGECOUNT value on done: 794238.0 [2023-02-25 14:08:27,651][36157] Sum rewards: 51.043, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.355', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.058', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'WEAPON4': '0.300', 'weapon2': '0.312', 'ARMOR': '0.461', 'weapon4': '0.614', 'WEAPON3': '0.700', 'HITCOUNT': '2.680', 'weapon3': '2.704', 'DAMAGECOUNT': '12.975', 'FRAGCOUNT': '41.000'} [2023-02-25 14:08:27,957][36157] DAMAGECOUNT value on done: 783850.0 [2023-02-25 14:08:27,957][36157] Sum rewards: 64.736, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.696', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'weapon4': '0.146', 'AMMO3': '0.257', 'weapon2': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '3.240', 'weapon3': '3.282', 'DAMAGECOUNT': '15.102', 'FRAGCOUNT': '59.000'} [2023-02-25 14:08:28,233][36140] DAMAGECOUNT value on done: 791096.0 [2023-02-25 14:08:28,234][36140] Sum rewards: 65.494, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.302', 'AMMO5': '0.009', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon4': '0.082', 'weapon5': '0.114', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.000', 'weapon3': '3.196', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.338', 'FRAGCOUNT': '54.000'} [2023-02-25 14:08:28,564][36140] DAMAGECOUNT value on done: 772222.0 [2023-02-25 14:08:28,565][36140] Sum rewards: 49.390, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.360', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon5': '0.200', 'AMMO4': '0.226', 'AMMO3': '0.265', 'weapon2': '0.276', 'weapon4': '0.326', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.810', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.577', 'FRAGCOUNT': '48.000'} [2023-02-25 14:08:28,588][36157] DAMAGECOUNT value on done: 797412.0 [2023-02-25 14:08:28,589][36157] Sum rewards: 60.546, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.616', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon4': '0.082', 'weapon5': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'weapon2': '0.510', 'WEAPON3': '1.100', 'weapon3': '3.012', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.774', 'FRAGCOUNT': '51.000'} [2023-02-25 14:08:28,844][36140] DAMAGECOUNT value on done: 782812.0 [2023-02-25 14:08:28,845][36140] Sum rewards: 33.815, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.416', 'AMMO5': '0.005', 'AMMO2': '0.027', 'AMMO3': '0.093', 'weapon5': '0.102', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'WEAPON3': '0.600', 'weapon4': '0.752', 'weapon2': '1.486', 'weapon3': '1.590', 'HITCOUNT': '2.230', 'DAMAGECOUNT': '8.262', 'FRAGCOUNT': '27.000'} [2023-02-25 14:08:28,903][36157] DAMAGECOUNT value on done: 792491.0 [2023-02-25 14:08:28,904][36157] Sum rewards: 56.471, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.455', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'weapon2': '0.166', 'AMMO3': '0.292', 'WEAPON4': '0.300', 'weapon4': '0.476', 'WEAPON3': '1.650', 'weapon3': '3.066', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.378', 'FRAGCOUNT': '53.000'} [2023-02-25 14:08:29,161][36140] DAMAGECOUNT value on done: 780905.0 [2023-02-25 14:08:29,162][36140] Sum rewards: 59.168, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.163', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO3': '0.149', 'AMMO4': '0.163', 'weapon5': '0.186', 'weapon2': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.688', 'WEAPON3': '1.000', 'weapon3': '2.506', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.766', 'FRAGCOUNT': '49.000'} [2023-02-25 14:08:29,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13312.0, 300 sec: 13384.9). Total num frames: 195756032. Throughput: 0: 3326.8. Samples: 11434226. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:08:29,730][36114] Avg episode reward: [(0, '54.674')] [2023-02-25 14:08:29,734][36138] Updated weights for policy 0, policy_version 47793 (0.0009) [2023-02-25 14:08:30,492][36142] DAMAGECOUNT value on done: 792197.0 [2023-02-25 14:08:30,492][36142] Sum rewards: 55.894, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.383', 'ARMOR': '0.004', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.144', 'AMMO4': '0.148', 'weapon5': '0.218', 'weapon2': '0.318', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.686', 'WEAPON3': '0.950', 'weapon3': '2.288', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.331', 'FRAGCOUNT': '47.000'} [2023-02-25 14:08:30,790][36142] DAMAGECOUNT value on done: 778738.0 [2023-02-25 14:08:30,791][36142] Sum rewards: 52.338, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.944', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'WEAPON4': '0.300', 'weapon2': '0.428', 'weapon4': '0.596', 'WEAPON3': '1.200', 'weapon3': '2.404', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.656', 'FRAGCOUNT': '47.000'} [2023-02-25 14:08:30,819][36142] DAMAGECOUNT value on done: 773103.0 [2023-02-25 14:08:30,819][36142] Sum rewards: 46.955, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.992', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.094', 'AMMO3': '0.145', 'weapon5': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.426', 'weapon2': '0.728', 'WEAPON3': '0.950', 'weapon3': '2.250', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '12.609', 'FRAGCOUNT': '39.000'} [2023-02-25 14:08:31,093][36142] DAMAGECOUNT value on done: 792619.0 [2023-02-25 14:08:31,094][36142] Sum rewards: 56.783, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.026', 'AMMO5': '0.011', 'AMMO2': '0.038', 'AMMO4': '0.188', 'weapon5': '0.188', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.430', 'weapon2': '0.466', 'WEAPON3': '1.450', 'weapon3': '2.578', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.319', 'FRAGCOUNT': '52.000'} [2023-02-25 14:08:31,830][36142] Large shaping reward 2.586 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5640000000000001, 188.0), ('weapon5', 0.002)] [2023-02-25 14:08:31,919][36155] DAMAGECOUNT value on done: 778385.0 [2023-02-25 14:08:31,919][36155] Sum rewards: 54.287, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.610', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon5': '0.200', 'weapon2': '0.228', 'AMMO3': '0.248', 'AMMO4': '0.254', 'WEAPON5': '0.400', 'weapon4': '0.426', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'HITCOUNT': '2.780', 'weapon3': '2.800', 'DAMAGECOUNT': '14.241', 'FRAGCOUNT': '52.000'} [2023-02-25 14:08:31,933][36156] DAMAGECOUNT value on done: 797083.0 [2023-02-25 14:08:31,933][36156] Sum rewards: 43.447, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.965', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.162', 'AMMO4': '0.175', 'weapon5': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.312', 'weapon2': '0.658', 'WEAPON3': '0.950', 'weapon3': '2.544', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '11.688', 'FRAGCOUNT': '37.500'} [2023-02-25 14:08:32,148][36156] DAMAGECOUNT value on done: 791035.0 [2023-02-25 14:08:32,148][36156] Sum rewards: 63.690, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.056', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.019', 'WEAPON5': '0.050', 'AMMO3': '0.261', 'weapon2': '0.334', 'WEAPON3': '1.600', 'HITCOUNT': '3.390', 'weapon3': '3.450', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '56.000'} [2023-02-25 14:08:32,248][36155] DAMAGECOUNT value on done: 795291.0 [2023-02-25 14:08:32,249][36155] Sum rewards: 49.168, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.909', 'AMMO5': '0.017', 'AMMO2': '0.036', 'AMMO4': '0.179', 'AMMO3': '0.181', 'weapon5': '0.190', 'weapon2': '0.254', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.648', 'WEAPON3': '1.100', 'weapon3': '2.534', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '14.718', 'FRAGCOUNT': '42.500'} [2023-02-25 14:08:32,254][36156] DAMAGECOUNT value on done: 786093.0 [2023-02-25 14:08:32,254][36156] Sum rewards: 53.986, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.480', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.142', 'weapon4': '0.168', 'weapon2': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'WEAPON3': '1.450', 'HITCOUNT': '2.920', 'weapon3': '3.138', 'DAMAGECOUNT': '14.226', 'FRAGCOUNT': '49.000'} [2023-02-25 14:08:32,466][36156] DAMAGECOUNT value on done: 782776.0 [2023-02-25 14:08:32,467][36156] Sum rewards: 42.230, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.633', 'AMMO2': '0.004', 'AMMO5': '0.006', 'AMMO4': '0.019', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.096', 'WEAPON5': '0.150', 'weapon4': '0.194', 'AMMO3': '0.271', 'weapon2': '0.418', 'WEAPON3': '1.650', 'HITCOUNT': '2.430', 'weapon3': '3.022', 'DAMAGECOUNT': '11.283', 'FRAGCOUNT': '41.000'} [2023-02-25 14:08:32,748][36138] Updated weights for policy 0, policy_version 47803 (0.0009) [2023-02-25 14:08:33,266][36155] DAMAGECOUNT value on done: 795381.0 [2023-02-25 14:08:33,267][36155] Sum rewards: 65.705, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.340', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO3': '0.146', 'weapon5': '0.176', 'AMMO4': '0.178', 'weapon2': '0.196', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.576', 'WEAPON3': '0.950', 'weapon3': '2.806', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.032', 'FRAGCOUNT': '55.000'} [2023-02-25 14:08:33,570][36155] DAMAGECOUNT value on done: 782963.0 [2023-02-25 14:08:33,570][36155] Sum rewards: 50.132, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.352', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.207', 'weapon4': '0.328', 'weapon2': '0.616', 'WEAPON3': '1.250', 'HITCOUNT': '2.640', 'weapon3': '2.790', 'DAMAGECOUNT': '13.113', 'FRAGCOUNT': '44.000'} [2023-02-25 14:08:34,135][36139] DAMAGECOUNT value on done: 788291.0 [2023-02-25 14:08:34,135][36139] Sum rewards: 51.543, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-5.056', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.148', 'weapon2': '0.184', 'weapon4': '0.184', 'WEAPON4': '0.300', 'AMMO3': '0.346', 'WEAPON3': '2.100', 'HITCOUNT': '3.030', 'weapon3': '3.316', 'DAMAGECOUNT': '14.064', 'FRAGCOUNT': '53.000'} [2023-02-25 14:08:34,438][36139] DAMAGECOUNT value on done: 781399.0 [2023-02-25 14:08:34,439][36139] Sum rewards: 54.928, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.262', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.034', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon2': '0.164', 'AMMO4': '0.171', 'WEAPON4': '0.200', 'AMMO3': '0.267', 'weapon4': '0.352', 'WEAPON3': '1.600', 'HITCOUNT': '3.100', 'weapon3': '3.186', 'DAMAGECOUNT': '14.763', 'FRAGCOUNT': '50.000'} [2023-02-25 14:08:34,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13312.0, 300 sec: 13384.9). Total num frames: 195825664. Throughput: 0: 3326.2. Samples: 11454254. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:08:34,729][36114] Avg episode reward: [(0, '54.494')] [2023-02-25 14:08:34,735][36139] DAMAGECOUNT value on done: 797407.0 [2023-02-25 14:08:34,736][36139] Sum rewards: 51.648, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.160', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon5': '0.102', 'AMMO4': '0.254', 'AMMO3': '0.256', 'WEAPON5': '0.300', 'weapon2': '0.356', 'weapon4': '0.380', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.848', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.265', 'FRAGCOUNT': '49.000'} [2023-02-25 14:08:35,052][36139] DAMAGECOUNT value on done: 789856.0 [2023-02-25 14:08:35,053][36139] Sum rewards: 54.635, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.895', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.198', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'weapon4': '0.310', 'weapon2': '0.332', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '2.792', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.922', 'FRAGCOUNT': '47.000'} [2023-02-25 14:08:35,766][36138] Updated weights for policy 0, policy_version 47813 (0.0009) [2023-02-25 14:08:38,827][36138] Updated weights for policy 0, policy_version 47823 (0.0009) [2023-02-25 14:08:39,729][36114] Fps is (10 sec: 13926.5, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 195895296. Throughput: 0: 3345.6. Samples: 11464392. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:08:39,730][36114] Avg episode reward: [(0, '54.539')] [2023-02-25 14:08:41,907][36138] Updated weights for policy 0, policy_version 47833 (0.0009) [2023-02-25 14:08:44,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 195960832. Throughput: 0: 3345.6. Samples: 11484418. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:08:44,729][36114] Avg episode reward: [(0, '54.539')] [2023-02-25 14:08:44,941][36138] Updated weights for policy 0, policy_version 47843 (0.0009) [2023-02-25 14:08:45,578][36141] DAMAGECOUNT value on done: 794601.0 [2023-02-25 14:08:45,578][36141] Sum rewards: 43.589, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.180', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.036', 'AMMO4': '0.179', 'AMMO3': '0.212', 'weapon5': '0.224', 'weapon2': '0.280', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.512', 'WEAPON3': '1.200', 'HITCOUNT': '2.640', 'weapon3': '2.650', 'DAMAGECOUNT': '12.315', 'FRAGCOUNT': '41.000'} [2023-02-25 14:08:45,630][36154] DAMAGECOUNT value on done: 793053.0 [2023-02-25 14:08:45,630][36154] Sum rewards: 68.370, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.991', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.126', 'AMMO4': '0.138', 'weapon5': '0.146', 'AMMO3': '0.167', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.448', 'WEAPON3': '1.100', 'weapon3': '2.984', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '58.000'} [2023-02-25 14:08:45,900][36141] DAMAGECOUNT value on done: 792807.0 [2023-02-25 14:08:45,901][36141] Sum rewards: 50.701, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.525', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon5': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.208', 'AMMO3': '0.221', 'weapon2': '0.422', 'WEAPON3': '1.300', 'weapon3': '3.036', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.689', 'FRAGCOUNT': '44.000'} [2023-02-25 14:08:45,949][36154] DAMAGECOUNT value on done: 790135.0 [2023-02-25 14:08:45,950][36154] Sum rewards: 55.144, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.119', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.068', 'AMMO4': '0.079', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.260', 'AMMO3': '0.261', 'weapon2': '0.316', 'WEAPON3': '1.600', 'weapon3': '3.078', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.750', 'FRAGCOUNT': '49.000'} [2023-02-25 14:08:45,961][36154] DAMAGECOUNT value on done: 778489.0 [2023-02-25 14:08:45,962][36154] Sum rewards: 60.580, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.112', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.147', 'weapon5': '0.168', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.386', 'weapon2': '0.446', 'WEAPON3': '1.200', 'weapon3': '2.702', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '52.000'} [2023-02-25 14:08:45,990][36141] DAMAGECOUNT value on done: 787636.0 [2023-02-25 14:08:45,991][36141] Sum rewards: 61.780, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.700', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.174', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON4': '0.300', 'weapon4': '0.906', 'WEAPON3': '1.250', 'weapon3': '2.174', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '53.000'} [2023-02-25 14:08:46,279][36154] DAMAGECOUNT value on done: 790560.0 [2023-02-25 14:08:46,279][36154] Sum rewards: 59.161, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.015', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.096', 'weapon4': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon2': '0.212', 'WEAPON3': '1.100', 'weapon3': '3.304', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.438', 'FRAGCOUNT': '48.000'} [2023-02-25 14:08:46,304][36141] DAMAGECOUNT value on done: 783495.0 [2023-02-25 14:08:46,304][36141] Sum rewards: 52.722, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.360', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.044', 'AMMO4': '0.222', 'weapon5': '0.230', 'AMMO3': '0.255', 'weapon2': '0.314', 'weapon4': '0.352', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.694', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.892', 'FRAGCOUNT': '50.000'} [2023-02-25 14:08:47,846][36157] DAMAGECOUNT value on done: 798637.0 [2023-02-25 14:08:47,847][36157] Sum rewards: 48.047, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.556', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO3': '0.168', 'AMMO4': '0.217', 'weapon5': '0.334', 'weapon2': '0.364', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.512', 'WEAPON3': '1.050', 'weapon3': '2.442', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '13.197', 'FRAGCOUNT': '42.000'} [2023-02-25 14:08:48,007][36138] Updated weights for policy 0, policy_version 47853 (0.0010) [2023-02-25 14:08:48,159][36157] DAMAGECOUNT value on done: 789229.0 [2023-02-25 14:08:48,160][36157] Sum rewards: 59.083, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.374', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.154', 'AMMO3': '0.195', 'weapon4': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.150', 'weapon3': '2.938', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '50.000'} [2023-02-25 14:08:48,202][36140] DAMAGECOUNT value on done: 795196.0 [2023-02-25 14:08:48,202][36140] Sum rewards: 47.783, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.956', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.058', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'AMMO3': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.482', 'weapon2': '0.514', 'WEAPON3': '1.200', 'weapon3': '2.686', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.255', 'FRAGCOUNT': '43.000'} [2023-02-25 14:08:48,524][36140] DAMAGECOUNT value on done: 777098.0 [2023-02-25 14:08:48,524][36140] Sum rewards: 53.019, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.126', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.061', 'AMMO3': '0.186', 'weapon5': '0.216', 'AMMO4': '0.303', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.440', 'weapon4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.170', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.628', 'FRAGCOUNT': '46.000'} [2023-02-25 14:08:48,768][36140] DAMAGECOUNT value on done: 787766.0 [2023-02-25 14:08:48,769][36140] Sum rewards: 58.398, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.436', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.046', 'AMMO3': '0.107', 'AMMO4': '0.229', 'weapon5': '0.274', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '0.700', 'weapon4': '0.784', 'weapon2': '0.792', 'weapon3': '1.802', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.841', 'FRAGCOUNT': '49.000'} [2023-02-25 14:08:48,772][36157] DAMAGECOUNT value on done: 801911.0 [2023-02-25 14:08:48,772][36157] Sum rewards: 52.480, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.821', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.112', 'AMMO3': '0.184', 'AMMO4': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.452', 'weapon4': '0.868', 'WEAPON3': '1.100', 'weapon3': '2.246', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.497', 'FRAGCOUNT': '46.000'} [2023-02-25 14:08:49,076][36157] DAMAGECOUNT value on done: 797404.0 [2023-02-25 14:08:49,076][36157] Sum rewards: 55.752, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.792', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.050', 'AMMO4': '0.068', 'weapon4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.268', 'weapon2': '0.278', 'WEAPON3': '1.600', 'HITCOUNT': '3.100', 'weapon3': '3.318', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '51.000'} [2023-02-25 14:08:49,076][36140] DAMAGECOUNT value on done: 786320.0 [2023-02-25 14:08:49,077][36140] Sum rewards: 57.327, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.470', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.053', 'weapon5': '0.130', 'AMMO3': '0.213', 'weapon2': '0.218', 'AMMO4': '0.265', 'WEAPON5': '0.500', 'weapon4': '0.566', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.754', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '51.000'} [2023-02-25 14:08:49,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13312.0, 300 sec: 13384.9). Total num frames: 196026368. Throughput: 0: 3348.7. Samples: 11504522. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:08:49,730][36114] Avg episode reward: [(0, '54.920')] [2023-02-25 14:08:50,675][36142] DAMAGECOUNT value on done: 797513.0 [2023-02-25 14:08:50,676][36142] Sum rewards: 63.395, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.560', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.080', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'WEAPON4': '0.350', 'weapon4': '0.414', 'weapon2': '0.446', 'WEAPON3': '1.050', 'weapon3': '2.826', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.948', 'FRAGCOUNT': '52.000'} [2023-02-25 14:08:50,972][36142] DAMAGECOUNT value on done: 783742.0 [2023-02-25 14:08:50,972][36142] Sum rewards: 51.108, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.040', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon5': '0.176', 'AMMO3': '0.209', 'AMMO4': '0.242', 'weapon2': '0.242', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.796', 'WEAPON3': '1.200', 'weapon3': '2.476', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.012', 'FRAGCOUNT': '45.000'} [2023-02-25 14:08:51,004][36142] DAMAGECOUNT value on done: 777976.0 [2023-02-25 14:08:51,005][36142] Sum rewards: 52.532, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.781', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon2': '0.166', 'weapon5': '0.186', 'AMMO3': '0.246', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.830', 'WEAPON3': '1.400', 'weapon3': '2.414', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.619', 'FRAGCOUNT': '47.000'} [2023-02-25 14:08:51,098][36138] Updated weights for policy 0, policy_version 47863 (0.0009) [2023-02-25 14:08:51,305][36142] DAMAGECOUNT value on done: 795875.0 [2023-02-25 14:08:51,306][36142] Sum rewards: 36.596, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.598', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.046', 'AMMO4': '0.066', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.420', 'weapon2': '0.712', 'WEAPON3': '1.000', 'HITCOUNT': '2.310', 'weapon3': '2.680', 'DAMAGECOUNT': '9.768', 'FRAGCOUNT': '32.000'} [2023-02-25 14:08:51,933][36156] DAMAGECOUNT value on done: 801869.0 [2023-02-25 14:08:51,934][36156] Sum rewards: 60.249, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.238', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon2': '0.224', 'weapon4': '0.274', 'WEAPON3': '1.250', 'HITCOUNT': '3.150', 'weapon3': '3.330', 'DAMAGECOUNT': '14.358', 'FRAGCOUNT': '51.000'} [2023-02-25 14:08:51,940][36155] DAMAGECOUNT value on done: 783176.0 [2023-02-25 14:08:51,940][36155] Sum rewards: 55.996, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.566', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon5': '0.094', 'AMMO4': '0.129', 'AMMO3': '0.228', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.376', 'WEAPON3': '1.300', 'weapon3': '2.832', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.373', 'FRAGCOUNT': '50.000'} [2023-02-25 14:08:52,120][36156] DAMAGECOUNT value on done: 796292.0 [2023-02-25 14:08:52,121][36156] Sum rewards: 48.761, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.330', 'AMMO5': '0.010', 'AMMO2': '0.049', 'AMMO3': '0.176', 'weapon5': '0.188', 'weapon4': '0.224', 'AMMO4': '0.243', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.594', 'WEAPON3': '1.100', 'weapon3': '2.706', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.771', 'FRAGCOUNT': '40.000'} [2023-02-25 14:08:52,248][36156] DAMAGECOUNT value on done: 790907.0 [2023-02-25 14:08:52,248][36156] Sum rewards: 53.720, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.404', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.190', 'weapon2': '0.534', 'WEAPON3': '1.150', 'HITCOUNT': '3.140', 'weapon3': '3.244', 'DAMAGECOUNT': '14.442', 'FRAGCOUNT': '45.000'} [2023-02-25 14:08:52,251][36155] DAMAGECOUNT value on done: 799956.0 [2023-02-25 14:08:52,252][36155] Sum rewards: 50.946, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.886', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon2': '0.156', 'AMMO3': '0.248', 'weapon5': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.472', 'WEAPON3': '1.400', 'weapon3': '2.686', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.995', 'FRAGCOUNT': '45.500'} [2023-02-25 14:08:52,436][36156] DAMAGECOUNT value on done: 787382.0 [2023-02-25 14:08:52,437][36156] Sum rewards: 51.478, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.552', 'ARMOR': '0.004', 'AMMO2': '0.024', 'WEAPON4': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.217', 'weapon4': '0.412', 'weapon2': '0.578', 'WEAPON3': '1.300', 'weapon3': '2.876', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.818', 'FRAGCOUNT': '44.000'} [2023-02-25 14:08:53,295][36155] DAMAGECOUNT value on done: 799951.0 [2023-02-25 14:08:53,296][36155] Sum rewards: 44.856, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.180', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.112', 'AMMO4': '0.165', 'AMMO3': '0.243', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.460', 'weapon4': '0.530', 'WEAPON3': '1.450', 'weapon3': '2.516', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '13.665', 'FRAGCOUNT': '41.000'} [2023-02-25 14:08:53,602][36155] DAMAGECOUNT value on done: 787268.0 [2023-02-25 14:08:53,603][36155] Sum rewards: 50.546, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.830', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.144', 'AMMO3': '0.172', 'AMMO4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON4': '0.400', 'weapon4': '0.886', 'WEAPON3': '1.050', 'weapon3': '2.338', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '12.915', 'FRAGCOUNT': '44.000'} [2023-02-25 14:08:54,058][36139] DAMAGECOUNT value on done: 793100.0 [2023-02-25 14:08:54,058][36139] Sum rewards: 60.162, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.372', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.160', 'AMMO3': '0.185', 'weapon5': '0.196', 'AMMO4': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.200', 'HITCOUNT': '3.000', 'weapon3': '3.050', 'DAMAGECOUNT': '14.427', 'FRAGCOUNT': '52.000'} [2023-02-25 14:08:54,151][36138] Updated weights for policy 0, policy_version 47873 (0.0010) [2023-02-25 14:08:54,376][36139] DAMAGECOUNT value on done: 786237.0 [2023-02-25 14:08:54,377][36139] Sum rewards: 53.681, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.600', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.190', 'weapon4': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.402', 'WEAPON3': '1.150', 'HITCOUNT': '2.850', 'weapon3': '2.958', 'DAMAGECOUNT': '14.499', 'FRAGCOUNT': '47.000'} [2023-02-25 14:08:54,666][36139] DAMAGECOUNT value on done: 802365.0 [2023-02-25 14:08:54,666][36139] Sum rewards: 56.748, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.216', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.102', 'AMMO4': '0.196', 'AMMO3': '0.217', 'weapon4': '0.232', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.564', 'WEAPON3': '1.250', 'weapon3': '2.860', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.874', 'FRAGCOUNT': '49.000'} [2023-02-25 14:08:54,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13371.0). Total num frames: 196091904. Throughput: 0: 3348.1. Samples: 11514524. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:08:54,729][36114] Avg episode reward: [(0, '54.932')] [2023-02-25 14:08:54,969][36139] DAMAGECOUNT value on done: 794736.0 [2023-02-25 14:08:54,970][36139] Sum rewards: 54.476, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.034', 'AMMO5': '0.013', 'AMMO2': '0.042', 'AMMO3': '0.167', 'AMMO4': '0.210', 'weapon5': '0.254', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.648', 'weapon2': '0.732', 'WEAPON3': '1.100', 'weapon3': '2.094', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.640', 'FRAGCOUNT': '48.000'} [2023-02-25 14:08:57,210][36138] Updated weights for policy 0, policy_version 47883 (0.0009) [2023-02-25 14:08:59,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 196161536. Throughput: 0: 3353.2. Samples: 11534694. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:08:59,730][36114] Avg episode reward: [(0, '54.933')] [2023-02-25 14:09:00,019][36154] Large shaping reward -2.551 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('ARMOR', -0.001, -1.0), ('AMMO5', -0.0005, -1.0)] [2023-02-25 14:09:00,276][36138] Updated weights for policy 0, policy_version 47893 (0.0009) [2023-02-25 14:09:01,361][36142] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:09:03,328][36138] Updated weights for policy 0, policy_version 47903 (0.0009) [2023-02-25 14:09:04,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 196227072. Throughput: 0: 3348.4. Samples: 11554702. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:09:04,730][36114] Avg episode reward: [(0, '54.933')] [2023-02-25 14:09:04,761][36154] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:09:05,682][36154] DAMAGECOUNT value on done: 797516.0 [2023-02-25 14:09:05,683][36154] Sum rewards: 50.042, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.608', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.164', 'weapon5': '0.184', 'weapon4': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.664', 'WEAPON3': '0.950', 'weapon3': '2.652', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.389', 'FRAGCOUNT': '41.500'} [2023-02-25 14:09:05,798][36141] DAMAGECOUNT value on done: 799825.0 [2023-02-25 14:09:05,798][36141] Sum rewards: 58.128, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.580', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO4': '0.190', 'AMMO3': '0.216', 'weapon5': '0.226', 'weapon4': '0.274', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.626', 'WEAPON3': '1.250', 'weapon3': '2.516', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.672', 'FRAGCOUNT': '52.000'} [2023-02-25 14:09:05,995][36154] DAMAGECOUNT value on done: 795408.0 [2023-02-25 14:09:05,995][36154] Sum rewards: 67.261, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.105', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon5': '0.140', 'weapon4': '0.158', 'AMMO3': '0.182', 'AMMO4': '0.202', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.442', 'WEAPON3': '1.150', 'weapon3': '2.980', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '58.000'} [2023-02-25 14:09:06,003][36154] DAMAGECOUNT value on done: 783587.0 [2023-02-25 14:09:06,004][36154] Sum rewards: 58.626, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.110', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.068', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon4': '0.330', 'weapon2': '0.428', 'WEAPON3': '1.300', 'weapon3': '2.836', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.294', 'FRAGCOUNT': '50.000'} [2023-02-25 14:09:06,114][36141] DAMAGECOUNT value on done: 798356.0 [2023-02-25 14:09:06,115][36141] Sum rewards: 64.634, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.383', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.140', 'AMMO3': '0.204', 'weapon2': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.596', 'WEAPON3': '1.200', 'weapon3': '2.722', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '54.000'} [2023-02-25 14:09:06,174][36141] DAMAGECOUNT value on done: 792835.0 [2023-02-25 14:09:06,175][36141] Sum rewards: 61.935, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.990', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'AMMO3': '0.242', 'weapon4': '0.390', 'weapon2': '0.400', 'ARMOR': '0.404', 'WEAPON3': '1.350', 'weapon3': '2.936', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '53.000'} [2023-02-25 14:09:06,300][36154] DAMAGECOUNT value on done: 795362.0 [2023-02-25 14:09:06,301][36154] Sum rewards: 56.556, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.114', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.137', 'weapon5': '0.158', 'AMMO3': '0.224', 'weapon4': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.446', 'WEAPON3': '1.300', 'weapon3': '2.882', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.346', 'FRAGCOUNT': '51.000'} [2023-02-25 14:09:06,421][36138] Updated weights for policy 0, policy_version 47913 (0.0010) [2023-02-25 14:09:06,487][36141] DAMAGECOUNT value on done: 788131.0 [2023-02-25 14:09:06,488][36141] Sum rewards: 50.357, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.722', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.156', 'AMMO3': '0.182', 'weapon2': '0.324', 'WEAPON3': '1.150', 'HITCOUNT': '2.940', 'weapon3': '3.216', 'DAMAGECOUNT': '13.908', 'FRAGCOUNT': '41.000'} [2023-02-25 14:09:07,801][36157] DAMAGECOUNT value on done: 803134.0 [2023-02-25 14:09:07,802][36157] Sum rewards: 54.937, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.554', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.054', 'WEAPON5': '0.150', 'weapon2': '0.164', 'AMMO4': '0.177', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon4': '0.294', 'ARMOR': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.760', 'weapon3': '2.856', 'DAMAGECOUNT': '13.491', 'FRAGCOUNT': '48.000'} [2023-02-25 14:09:08,120][36157] DAMAGECOUNT value on done: 793567.0 [2023-02-25 14:09:08,121][36157] Sum rewards: 47.972, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.190', 'AMMO5': '0.012', 'AMMO2': '0.062', 'AMMO3': '0.128', 'weapon5': '0.266', 'AMMO4': '0.311', 'weapon2': '0.428', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.500', 'WEAPON3': '0.750', 'weapon3': '2.500', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '13.014', 'FRAGCOUNT': '41.000'} [2023-02-25 14:09:08,296][36140] DAMAGECOUNT value on done: 799533.0 [2023-02-25 14:09:08,297][36140] Sum rewards: 54.321, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.440', 'AMMO5': '0.011', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.130', 'weapon2': '0.150', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.352', 'WEAPON3': '1.200', 'HITCOUNT': '2.840', 'weapon3': '3.144', 'DAMAGECOUNT': '13.011', 'FRAGCOUNT': '49.000'} [2023-02-25 14:09:08,593][36140] DAMAGECOUNT value on done: 781295.0 [2023-02-25 14:09:08,594][36140] Sum rewards: 46.019, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.577', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.030', 'AMMO3': '0.130', 'weapon5': '0.144', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'weapon2': '0.208', 'WEAPON4': '0.300', 'weapon4': '0.644', 'WEAPON3': '0.900', 'HITCOUNT': '2.770', 'weapon3': '2.808', 'DAMAGECOUNT': '12.591', 'FRAGCOUNT': '38.000'} [2023-02-25 14:09:08,739][36157] DAMAGECOUNT value on done: 807292.0 [2023-02-25 14:09:08,739][36157] Sum rewards: 59.310, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.240', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.090', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.310', 'weapon2': '0.460', 'WEAPON3': '1.200', 'weapon3': '2.942', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.143', 'FRAGCOUNT': '50.000'} [2023-02-25 14:09:08,808][36140] DAMAGECOUNT value on done: 792069.0 [2023-02-25 14:09:08,808][36140] Sum rewards: 47.305, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.860', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.112', 'AMMO3': '0.198', 'weapon4': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.516', 'WEAPON3': '1.250', 'weapon3': '2.896', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.909', 'FRAGCOUNT': '42.500'} [2023-02-25 14:09:09,052][36157] DAMAGECOUNT value on done: 802999.0 [2023-02-25 14:09:09,053][36157] Sum rewards: 61.706, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.257', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.069', 'weapon5': '0.148', 'AMMO3': '0.156', 'AMMO4': '0.343', 'weapon2': '0.346', 'WEAPON5': '0.450', 'weapon4': '0.602', 'WEAPON4': '0.750', 'WEAPON3': '0.900', 'weapon3': '2.606', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '53.000'} [2023-02-25 14:09:09,133][36140] DAMAGECOUNT value on done: 791224.0 [2023-02-25 14:09:09,134][36140] Sum rewards: 52.103, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.760', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon5': '0.200', 'weapon4': '0.216', 'AMMO3': '0.237', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.430', 'WEAPON3': '1.400', 'weapon3': '2.836', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.712', 'FRAGCOUNT': '46.000'} [2023-02-25 14:09:09,488][36138] Updated weights for policy 0, policy_version 47923 (0.0010) [2023-02-25 14:09:09,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13371.0). Total num frames: 196292608. Throughput: 0: 3345.1. Samples: 11564694. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:09:09,730][36114] Avg episode reward: [(0, '55.062')] [2023-02-25 14:09:10,847][36142] DAMAGECOUNT value on done: 803123.0 [2023-02-25 14:09:10,847][36142] Sum rewards: 59.398, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.864', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.132', 'AMMO4': '0.135', 'weapon4': '0.154', 'AMMO3': '0.227', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.134', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '51.000'} [2023-02-25 14:09:11,144][36142] DAMAGECOUNT value on done: 789299.0 [2023-02-25 14:09:11,145][36142] Sum rewards: 62.810, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.248', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.098', 'AMMO3': '0.165', 'AMMO4': '0.193', 'WEAPON5': '0.300', 'weapon2': '0.442', 'WEAPON4': '0.550', 'weapon4': '0.654', 'WEAPON3': '1.100', 'weapon3': '2.586', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '53.000'} [2023-02-25 14:09:11,173][36142] DAMAGECOUNT value on done: 783512.0 [2023-02-25 14:09:11,173][36142] Sum rewards: 65.412, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.862', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.152', 'AMMO4': '0.191', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.324', 'weapon4': '0.382', 'WEAPON3': '1.300', 'weapon3': '2.888', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.548', 'FRAGCOUNT': '55.000'} [2023-02-25 14:09:11,461][36142] DAMAGECOUNT value on done: 801793.0 [2023-02-25 14:09:11,462][36142] Sum rewards: 63.880, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.555', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon5': '0.126', 'weapon4': '0.128', 'AMMO4': '0.179', 'AMMO3': '0.260', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.060', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.754', 'FRAGCOUNT': '57.000'} [2023-02-25 14:09:11,637][36157] Large shaping reward 2.550 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.528, 176.0), ('weapon5', 0.002)] [2023-02-25 14:09:11,922][36155] DAMAGECOUNT value on done: 788551.0 [2023-02-25 14:09:11,923][36155] Sum rewards: 60.025, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.952', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon5': '0.148', 'AMMO4': '0.199', 'AMMO3': '0.201', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.506', 'weapon4': '0.528', 'WEAPON3': '1.150', 'weapon3': '2.484', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.122', 'FRAGCOUNT': '51.000'} [2023-02-25 14:09:11,999][36156] DAMAGECOUNT value on done: 806279.0 [2023-02-25 14:09:12,000][36156] Sum rewards: 52.643, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.917', 'ARMOR': '0.008', 'AMMO5': '0.025', 'AMMO2': '0.064', 'AMMO3': '0.117', 'AMMO4': '0.319', 'weapon5': '0.410', 'weapon2': '0.588', 'WEAPON3': '0.650', 'WEAPON5': '0.750', 'WEAPON4': '0.800', 'weapon4': '1.170', 'weapon3': '1.488', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '13.230', 'FRAGCOUNT': '45.000'} [2023-02-25 14:09:12,159][36156] DAMAGECOUNT value on done: 801658.0 [2023-02-25 14:09:12,159][36156] Sum rewards: 65.187, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.025', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.044', 'AMMO4': '0.109', 'weapon4': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.266', 'weapon2': '0.308', 'WEAPON3': '1.550', 'weapon3': '3.226', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.098', 'FRAGCOUNT': '58.000'} [2023-02-25 14:09:12,239][36155] DAMAGECOUNT value on done: 804780.0 [2023-02-25 14:09:12,240][36155] Sum rewards: 58.825, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.859', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'weapon5': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'weapon2': '0.254', 'weapon4': '0.376', 'WEAPON3': '1.200', 'weapon3': '3.034', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.472', 'FRAGCOUNT': '50.000'} [2023-02-25 14:09:12,317][36156] DAMAGECOUNT value on done: 796615.0 [2023-02-25 14:09:12,318][36156] Sum rewards: 64.570, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.094', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.256', 'weapon4': '0.374', 'weapon2': '0.442', 'WEAPON3': '1.500', 'weapon3': '2.808', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '56.000'} [2023-02-25 14:09:12,489][36156] DAMAGECOUNT value on done: 792706.0 [2023-02-25 14:09:12,490][36156] Sum rewards: 55.428, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.615', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.161', 'weapon5': '0.162', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.352', 'weapon4': '0.440', 'WEAPON3': '1.300', 'weapon3': '2.626', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.972', 'FRAGCOUNT': '48.500'} [2023-02-25 14:09:12,542][36138] Updated weights for policy 0, policy_version 47933 (0.0009) [2023-02-25 14:09:13,263][36155] DAMAGECOUNT value on done: 804462.0 [2023-02-25 14:09:13,264][36155] Sum rewards: 50.320, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.144', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.040', 'AMMO3': '0.163', 'AMMO4': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.388', 'ARMOR': '0.400', 'weapon5': '0.512', 'weapon4': '0.614', 'WEAPON3': '1.000', 'weapon3': '2.196', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.533', 'FRAGCOUNT': '41.000'} [2023-02-25 14:09:13,578][36155] DAMAGECOUNT value on done: 792713.0 [2023-02-25 14:09:13,578][36155] Sum rewards: 66.510, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.970', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.046', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'weapon2': '0.220', 'WEAPON4': '0.350', 'weapon4': '0.610', 'WEAPON3': '1.100', 'weapon3': '2.888', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '57.000'} [2023-02-25 14:09:14,151][36139] DAMAGECOUNT value on done: 798295.0 [2023-02-25 14:09:14,152][36139] Sum rewards: 56.821, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.250', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.090', 'weapon5': '0.212', 'AMMO3': '0.219', 'AMMO4': '0.227', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.870', 'weapon3': '3.070', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '50.000'} [2023-02-25 14:09:14,456][36139] DAMAGECOUNT value on done: 791353.0 [2023-02-25 14:09:14,456][36139] Sum rewards: 59.603, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.966', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.202', 'AMMO3': '0.252', 'weapon2': '0.396', 'WEAPON3': '1.450', 'weapon3': '3.064', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.348', 'FRAGCOUNT': '52.000'} [2023-02-25 14:09:14,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 196362240. Throughput: 0: 3346.0. Samples: 11584798. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:09:14,730][36114] Avg episode reward: [(0, '55.504')] [2023-02-25 14:09:14,774][36139] DAMAGECOUNT value on done: 807016.0 [2023-02-25 14:09:14,775][36139] Sum rewards: 52.958, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.009', 'AMMO5': '0.023', 'AMMO2': '0.045', 'weapon2': '0.188', 'AMMO3': '0.210', 'AMMO4': '0.224', 'weapon5': '0.236', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'weapon4': '0.700', 'WEAPON3': '1.200', 'weapon3': '2.578', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.953', 'FRAGCOUNT': '49.000'} [2023-02-25 14:09:15,095][36139] DAMAGECOUNT value on done: 799146.0 [2023-02-25 14:09:15,095][36139] Sum rewards: 56.261, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.472', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.138', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.268', 'weapon2': '0.850', 'WEAPON3': '0.950', 'weapon3': '2.526', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.230', 'FRAGCOUNT': '47.000'} [2023-02-25 14:09:15,609][36138] Updated weights for policy 0, policy_version 47943 (0.0009) [2023-02-25 14:09:16,815][36139] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:09:18,395][36141] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:09:18,615][36138] Updated weights for policy 0, policy_version 47953 (0.0010) [2023-02-25 14:09:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 196427776. Throughput: 0: 3348.9. Samples: 11604956. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:09:19,730][36114] Avg episode reward: [(0, '55.520')] [2023-02-25 14:09:19,733][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000047956_196427776.pth... [2023-02-25 14:09:19,791][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000047173_193220608.pth [2023-02-25 14:09:21,716][36138] Updated weights for policy 0, policy_version 47963 (0.0009) [2023-02-25 14:09:24,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13371.0). Total num frames: 196493312. Throughput: 0: 3344.6. Samples: 11614898. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:09:24,730][36114] Avg episode reward: [(0, '55.520')] [2023-02-25 14:09:24,769][36138] Updated weights for policy 0, policy_version 47973 (0.0009) [2023-02-25 14:09:25,793][36154] DAMAGECOUNT value on done: 802764.0 [2023-02-25 14:09:25,793][36154] Sum rewards: 58.534, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.868', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.074', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon2': '0.316', 'WEAPON3': '1.400', 'HITCOUNT': '3.100', 'weapon3': '3.284', 'DAMAGECOUNT': '15.744', 'FRAGCOUNT': '51.000'} [2023-02-25 14:09:25,902][36141] DAMAGECOUNT value on done: 805934.0 [2023-02-25 14:09:25,903][36141] Sum rewards: 66.734, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.357', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.038', 'weapon2': '0.172', 'AMMO4': '0.190', 'AMMO3': '0.191', 'weapon5': '0.264', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.786', 'WEAPON3': '1.150', 'weapon3': '2.498', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.327', 'FRAGCOUNT': '56.000'} [2023-02-25 14:09:26,057][36154] DAMAGECOUNT value on done: 800767.0 [2023-02-25 14:09:26,057][36154] Sum rewards: 59.434, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.296', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.142', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.294', 'weapon2': '0.364', 'ARMOR': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.916', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.077', 'FRAGCOUNT': '51.000'} [2023-02-25 14:09:26,103][36154] DAMAGECOUNT value on done: 787502.0 [2023-02-25 14:09:26,103][36154] Sum rewards: 43.600, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.286', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.059', 'weapon5': '0.156', 'AMMO3': '0.234', 'weapon2': '0.240', 'AMMO4': '0.295', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'weapon4': '0.602', 'WEAPON3': '1.400', 'HITCOUNT': '2.610', 'weapon3': '2.666', 'DAMAGECOUNT': '11.745', 'FRAGCOUNT': '43.000'} [2023-02-25 14:09:26,228][36141] DAMAGECOUNT value on done: 803286.0 [2023-02-25 14:09:26,228][36141] Sum rewards: 55.492, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.395', 'AMMO5': '0.022', 'AMMO2': '0.046', 'AMMO3': '0.186', 'weapon2': '0.228', 'AMMO4': '0.232', 'weapon5': '0.234', 'ARMOR': '0.462', 'WEAPON5': '0.550', 'WEAPON4': '0.750', 'weapon4': '0.964', 'WEAPON3': '1.100', 'weapon3': '2.162', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.790', 'FRAGCOUNT': '49.500'} [2023-02-25 14:09:26,304][36141] DAMAGECOUNT value on done: 796904.0 [2023-02-25 14:09:26,304][36141] Sum rewards: 48.201, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.820', 'AMMO5': '0.005', 'ARMOR': '0.005', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO4': '0.113', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon2': '0.528', 'weapon4': '0.662', 'WEAPON3': '1.150', 'weapon3': '2.338', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.207', 'FRAGCOUNT': '42.000'} [2023-02-25 14:09:26,369][36154] DAMAGECOUNT value on done: 799722.0 [2023-02-25 14:09:26,370][36154] Sum rewards: 47.082, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.264', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.117', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon4': '0.416', 'weapon2': '0.486', 'WEAPON3': '1.300', 'weapon3': '2.810', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.080', 'FRAGCOUNT': '42.000'} [2023-02-25 14:09:26,606][36141] DAMAGECOUNT value on done: 793022.0 [2023-02-25 14:09:26,607][36141] Sum rewards: 54.988, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.942', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.134', 'AMMO4': '0.144', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.308', 'weapon2': '0.386', 'WEAPON3': '1.400', 'weapon3': '2.848', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.673', 'FRAGCOUNT': '49.000'} [2023-02-25 14:09:27,845][36138] Updated weights for policy 0, policy_version 47983 (0.0009) [2023-02-25 14:09:28,007][36157] DAMAGECOUNT value on done: 807852.0 [2023-02-25 14:09:28,008][36157] Sum rewards: 51.627, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.990', 'ARMOR': '0.008', 'AMMO5': '0.032', 'AMMO2': '0.064', 'AMMO3': '0.192', 'AMMO4': '0.322', 'weapon5': '0.356', 'weapon2': '0.456', 'WEAPON5': '0.800', 'weapon4': '0.832', 'WEAPON4': '0.850', 'WEAPON3': '1.150', 'weapon3': '1.940', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '14.154', 'FRAGCOUNT': '49.000'} [2023-02-25 14:09:28,311][36157] DAMAGECOUNT value on done: 798011.0 [2023-02-25 14:09:28,312][36157] Sum rewards: 50.613, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.390', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.056', 'AMMO3': '0.181', 'weapon5': '0.202', 'weapon2': '0.250', 'AMMO4': '0.282', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.936', 'WEAPON3': '1.000', 'weapon3': '2.102', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.332', 'FRAGCOUNT': '44.000'} [2023-02-25 14:09:28,500][36140] DAMAGECOUNT value on done: 803621.0 [2023-02-25 14:09:28,501][36140] Sum rewards: 56.593, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.069', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.088', 'WEAPON4': '0.200', 'ARMOR': '0.465', 'weapon4': '0.564', 'WEAPON3': '0.600', 'weapon2': '0.778', 'weapon3': '2.472', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.264', 'FRAGCOUNT': '44.000'} [2023-02-25 14:09:28,816][36140] DAMAGECOUNT value on done: 786838.0 [2023-02-25 14:09:28,816][36140] Sum rewards: 64.812, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.495', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.161', 'weapon5': '0.174', 'weapon2': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.012', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '53.000'} [2023-02-25 14:09:28,915][36157] DAMAGECOUNT value on done: 812802.0 [2023-02-25 14:09:28,915][36157] Sum rewards: 67.876, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.305', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.015', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'weapon4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.210', 'weapon2': '0.328', 'WEAPON3': '1.350', 'weapon3': '3.334', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '58.000'} [2023-02-25 14:09:29,028][36140] DAMAGECOUNT value on done: 796471.0 [2023-02-25 14:09:29,028][36140] Sum rewards: 45.791, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.220', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.056', 'weapon5': '0.158', 'AMMO3': '0.240', 'AMMO4': '0.282', 'WEAPON5': '0.400', 'weapon4': '0.516', 'weapon2': '0.530', 'WEAPON4': '0.700', 'WEAPON3': '1.400', 'weapon3': '2.484', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.206', 'FRAGCOUNT': '46.000'} [2023-02-25 14:09:29,226][36157] DAMAGECOUNT value on done: 807695.0 [2023-02-25 14:09:29,227][36157] Sum rewards: 54.540, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.528', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon4': '0.166', 'AMMO4': '0.205', 'AMMO3': '0.219', 'weapon2': '0.248', 'weapon5': '0.248', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.982', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.088', 'FRAGCOUNT': '50.000'} [2023-02-25 14:09:29,320][36140] DAMAGECOUNT value on done: 796833.0 [2023-02-25 14:09:29,321][36140] Sum rewards: 61.476, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.805', 'AMMO5': '0.013', 'AMMO2': '0.019', 'weapon5': '0.036', 'AMMO4': '0.096', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'weapon2': '0.290', 'WEAPON4': '0.350', 'weapon4': '0.480', 'WEAPON3': '1.400', 'weapon3': '2.936', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '53.000'} [2023-02-25 14:09:29,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 196562944. Throughput: 0: 3345.1. Samples: 11634948. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:09:29,730][36114] Avg episode reward: [(0, '55.158')] [2023-02-25 14:09:30,924][36138] Updated weights for policy 0, policy_version 47993 (0.0010) [2023-02-25 14:09:30,955][36142] DAMAGECOUNT value on done: 807303.0 [2023-02-25 14:09:30,955][36142] Sum rewards: 50.785, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.334', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.048', 'AMMO3': '0.123', 'weapon5': '0.182', 'AMMO4': '0.240', 'weapon2': '0.250', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.570', 'WEAPON3': '0.850', 'HITCOUNT': '2.680', 'weapon3': '2.810', 'DAMAGECOUNT': '12.540', 'FRAGCOUNT': '43.000'} [2023-02-25 14:09:31,253][36142] DAMAGECOUNT value on done: 794512.0 [2023-02-25 14:09:31,254][36142] Sum rewards: 58.834, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.055', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.051', 'AMMO3': '0.169', 'weapon5': '0.236', 'weapon2': '0.244', 'AMMO4': '0.257', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.000', 'weapon4': '1.116', 'weapon3': '2.036', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '51.000'} [2023-02-25 14:09:31,273][36142] DAMAGECOUNT value on done: 788632.0 [2023-02-25 14:09:31,273][36142] Sum rewards: 61.448, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.480', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.158', 'AMMO3': '0.191', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.342', 'weapon4': '0.554', 'WEAPON3': '1.100', 'weapon3': '2.652', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.360', 'FRAGCOUNT': '52.000'} [2023-02-25 14:09:31,583][36142] DAMAGECOUNT value on done: 806353.0 [2023-02-25 14:09:31,583][36142] Sum rewards: 51.431, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.480', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon4': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.268', 'weapon2': '0.398', 'WEAPON3': '1.600', 'HITCOUNT': '2.900', 'weapon3': '3.354', 'DAMAGECOUNT': '13.680', 'FRAGCOUNT': '48.000'} [2023-02-25 14:09:31,961][36155] DAMAGECOUNT value on done: 794151.0 [2023-02-25 14:09:31,961][36155] Sum rewards: 68.671, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.020', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.096', 'AMMO4': '0.169', 'weapon2': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon4': '0.254', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.200', 'weapon3': '3.250', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '59.000'} [2023-02-25 14:09:31,968][36156] DAMAGECOUNT value on done: 810395.0 [2023-02-25 14:09:31,968][36156] Sum rewards: 43.558, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.550', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.208', 'AMMO3': '0.217', 'weapon4': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.250', 'HITCOUNT': '2.600', 'weapon3': '2.858', 'DAMAGECOUNT': '12.345', 'FRAGCOUNT': '40.000'} [2023-02-25 14:09:32,166][36156] DAMAGECOUNT value on done: 806957.0 [2023-02-25 14:09:32,167][36156] Sum rewards: 63.308, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.330', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.060', 'WEAPON4': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.197', 'weapon4': '0.210', 'weapon2': '0.628', 'WEAPON3': '1.250', 'weapon3': '2.886', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.897', 'FRAGCOUNT': '52.000'} [2023-02-25 14:09:32,251][36155] DAMAGECOUNT value on done: 809439.0 [2023-02-25 14:09:32,252][36155] Sum rewards: 56.641, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.025', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.076', 'AMMO4': '0.133', 'AMMO3': '0.185', 'weapon4': '0.242', 'WEAPON5': '0.250', 'weapon2': '0.276', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '3.070', 'weapon3': '3.170', 'DAMAGECOUNT': '13.977', 'FRAGCOUNT': '50.000'} [2023-02-25 14:09:32,292][36156] DAMAGECOUNT value on done: 800857.0 [2023-02-25 14:09:32,293][36156] Sum rewards: 46.987, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.875', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.110', 'AMMO4': '0.120', 'AMMO3': '0.191', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.734', 'weapon4': '0.976', 'WEAPON3': '1.150', 'weapon3': '1.952', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '12.726', 'FRAGCOUNT': '41.000'} [2023-02-25 14:09:32,484][36156] DAMAGECOUNT value on done: 797151.0 [2023-02-25 14:09:32,484][36156] Sum rewards: 50.823, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.296', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.047', 'AMMO3': '0.163', 'weapon2': '0.234', 'AMMO4': '0.237', 'WEAPON5': '0.300', 'weapon5': '0.340', 'WEAPON4': '0.400', 'weapon4': '0.580', 'WEAPON3': '1.050', 'weapon3': '2.516', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '13.335', 'FRAGCOUNT': '44.000'} [2023-02-25 14:09:33,189][36155] DAMAGECOUNT value on done: 809970.0 [2023-02-25 14:09:33,190][36155] Sum rewards: 64.531, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.620', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.092', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon2': '0.282', 'weapon4': '0.436', 'WEAPON3': '1.100', 'weapon3': '2.944', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '53.000'} [2023-02-25 14:09:33,510][36155] DAMAGECOUNT value on done: 798448.0 [2023-02-25 14:09:33,511][36155] Sum rewards: 66.460, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.422', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.100', 'weapon4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.178', 'AMMO3': '0.270', 'WEAPON3': '1.700', 'HITCOUNT': '3.120', 'weapon3': '3.290', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '60.000'} [2023-02-25 14:09:33,904][36138] Updated weights for policy 0, policy_version 48003 (0.0008) [2023-02-25 14:09:34,185][36139] DAMAGECOUNT value on done: 802930.0 [2023-02-25 14:09:34,186][36139] Sum rewards: 50.916, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.028', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.045', 'AMMO3': '0.190', 'weapon5': '0.216', 'AMMO4': '0.226', 'weapon4': '0.238', 'weapon2': '0.268', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.770', 'weapon3': '2.962', 'DAMAGECOUNT': '13.905', 'FRAGCOUNT': '45.000'} [2023-02-25 14:09:34,490][36139] DAMAGECOUNT value on done: 797321.0 [2023-02-25 14:09:34,491][36139] Sum rewards: 68.698, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.630', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.096', 'AMMO4': '0.129', 'weapon2': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'weapon4': '0.366', 'WEAPON3': '1.500', 'weapon3': '3.094', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '61.000'} [2023-02-25 14:09:34,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13371.0). Total num frames: 196628480. Throughput: 0: 3350.0. Samples: 11655270. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:09:34,730][36114] Avg episode reward: [(0, '55.901')] [2023-02-25 14:09:34,798][36139] DAMAGECOUNT value on done: 811860.0 [2023-02-25 14:09:34,798][36139] Sum rewards: 57.620, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.610', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.054', 'weapon5': '0.122', 'AMMO4': '0.134', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.100', 'weapon3': '3.144', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.532', 'FRAGCOUNT': '49.000'} [2023-02-25 14:09:35,118][36139] DAMAGECOUNT value on done: 803671.0 [2023-02-25 14:09:35,119][36139] Sum rewards: 51.717, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.680', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.152', 'AMMO3': '0.188', 'weapon2': '0.308', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'ARMOR': '0.454', 'weapon4': '0.810', 'WEAPON3': '1.050', 'weapon3': '2.484', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.575', 'FRAGCOUNT': '44.500'} [2023-02-25 14:09:36,964][36138] Updated weights for policy 0, policy_version 48013 (0.0010) [2023-02-25 14:09:38,752][36156] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:09:39,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 196698112. Throughput: 0: 3351.6. Samples: 11665346. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:09:39,729][36114] Avg episode reward: [(0, '55.836')] [2023-02-25 14:09:39,988][36138] Updated weights for policy 0, policy_version 48023 (0.0009) [2023-02-25 14:09:43,033][36138] Updated weights for policy 0, policy_version 48033 (0.0009) [2023-02-25 14:09:44,421][36142] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('ARMOR', -0.001, -1.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:09:44,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 196763648. Throughput: 0: 3349.9. Samples: 11685440. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:09:44,730][36114] Avg episode reward: [(0, '55.836')] [2023-02-25 14:09:45,664][36154] DAMAGECOUNT value on done: 807323.0 [2023-02-25 14:09:45,664][36154] Sum rewards: 55.784, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.147', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.048', 'AMMO3': '0.101', 'weapon5': '0.170', 'AMMO4': '0.240', 'weapon2': '0.378', 'WEAPON5': '0.400', 'weapon4': '0.444', 'WEAPON4': '0.450', 'WEAPON3': '0.650', 'weapon3': '2.674', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.677', 'FRAGCOUNT': '46.000'} [2023-02-25 14:09:45,842][36141] DAMAGECOUNT value on done: 809638.0 [2023-02-25 14:09:45,842][36141] Sum rewards: 43.490, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.504', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'weapon2': '0.572', 'weapon4': '0.656', 'WEAPON3': '1.050', 'weapon3': '2.496', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '11.112', 'FRAGCOUNT': '37.000'} [2023-02-25 14:09:45,950][36154] DAMAGECOUNT value on done: 805230.0 [2023-02-25 14:09:45,951][36154] Sum rewards: 53.449, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.496', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.092', 'AMMO3': '0.159', 'weapon5': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.372', 'WEAPON5': '0.400', 'weapon4': '0.692', 'WEAPON3': '1.000', 'weapon3': '2.420', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.389', 'FRAGCOUNT': '46.000'} [2023-02-25 14:09:45,990][36154] DAMAGECOUNT value on done: 792349.0 [2023-02-25 14:09:45,990][36154] Sum rewards: 53.365, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.590', 'ARMOR': '0.008', 'AMMO5': '0.025', 'AMMO2': '0.044', 'weapon2': '0.190', 'AMMO3': '0.221', 'AMMO4': '0.221', 'weapon5': '0.228', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.638', 'WEAPON3': '1.300', 'weapon3': '2.468', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '14.541', 'FRAGCOUNT': '48.000'} [2023-02-25 14:09:46,082][36138] Updated weights for policy 0, policy_version 48043 (0.0009) [2023-02-25 14:09:46,156][36141] DAMAGECOUNT value on done: 808339.0 [2023-02-25 14:09:46,157][36141] Sum rewards: 56.448, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.312', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.254', 'weapon4': '0.316', 'weapon2': '0.336', 'WEAPON3': '1.550', 'weapon3': '2.836', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.159', 'FRAGCOUNT': '50.000'} [2023-02-25 14:09:46,216][36141] DAMAGECOUNT value on done: 802851.0 [2023-02-25 14:09:46,217][36141] Sum rewards: 67.536, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.544', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon4': '0.128', 'weapon5': '0.174', 'AMMO4': '0.244', 'AMMO3': '0.246', 'weapon2': '0.366', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.032', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.841', 'FRAGCOUNT': '61.000'} [2023-02-25 14:09:46,279][36154] DAMAGECOUNT value on done: 804343.0 [2023-02-25 14:09:46,280][36154] Sum rewards: 53.362, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.324', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.216', 'AMMO3': '0.243', 'weapon2': '0.750', 'WEAPON3': '1.400', 'weapon3': '2.736', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.863', 'FRAGCOUNT': '47.000'} [2023-02-25 14:09:46,518][36141] DAMAGECOUNT value on done: 797844.0 [2023-02-25 14:09:46,518][36141] Sum rewards: 50.860, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.985', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'weapon5': '0.128', 'weapon2': '0.164', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'ARMOR': '0.404', 'weapon4': '0.448', 'WEAPON3': '1.500', 'HITCOUNT': '3.020', 'weapon3': '3.036', 'DAMAGECOUNT': '14.466', 'FRAGCOUNT': '45.000'} [2023-02-25 14:09:48,044][36157] DAMAGECOUNT value on done: 813393.0 [2023-02-25 14:09:48,044][36157] Sum rewards: 67.474, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.285', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon5': '0.156', 'AMMO4': '0.171', 'AMMO3': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.384', 'weapon2': '0.692', 'WEAPON3': '1.150', 'weapon3': '2.508', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '57.000'} [2023-02-25 14:09:48,342][36157] DAMAGECOUNT value on done: 802950.0 [2023-02-25 14:09:48,342][36157] Sum rewards: 56.245, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.429', 'AMMO5': '0.010', 'AMMO2': '0.040', 'AMMO4': '0.198', 'weapon5': '0.202', 'AMMO3': '0.234', 'weapon2': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.412', 'WEAPON3': '1.400', 'weapon3': '2.834', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.592', 'FRAGCOUNT': '52.000'} [2023-02-25 14:09:48,552][36140] DAMAGECOUNT value on done: 808809.0 [2023-02-25 14:09:48,552][36140] Sum rewards: 60.857, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.941', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon5': '0.042', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'weapon2': '0.468', 'ARMOR': '0.475', 'weapon4': '0.768', 'WEAPON3': '1.250', 'weapon3': '2.476', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '15.564', 'FRAGCOUNT': '52.000'} [2023-02-25 14:09:48,856][36140] DAMAGECOUNT value on done: 791873.0 [2023-02-25 14:09:48,857][36140] Sum rewards: 57.427, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.320', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.060', 'AMMO4': '0.074', 'weapon4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon2': '0.234', 'WEAPON3': '1.400', 'HITCOUNT': '3.130', 'weapon3': '3.318', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '50.000'} [2023-02-25 14:09:48,949][36157] DAMAGECOUNT value on done: 817019.0 [2023-02-25 14:09:48,949][36157] Sum rewards: 49.819, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.690', 'AMMO5': '0.014', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.182', 'weapon5': '0.182', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.436', 'weapon4': '0.736', 'WEAPON3': '1.100', 'weapon3': '2.398', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.381', 'FRAGCOUNT': '44.000'} [2023-02-25 14:09:49,073][36140] DAMAGECOUNT value on done: 800844.0 [2023-02-25 14:09:49,073][36140] Sum rewards: 51.497, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.196', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.054', 'AMMO3': '0.137', 'weapon5': '0.150', 'AMMO4': '0.272', 'WEAPON5': '0.450', 'weapon4': '0.472', 'WEAPON4': '0.650', 'weapon2': '0.750', 'WEAPON3': '0.850', 'weapon3': '2.142', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.119', 'FRAGCOUNT': '46.000'} [2023-02-25 14:09:49,156][36138] Updated weights for policy 0, policy_version 48053 (0.0010) [2023-02-25 14:09:49,262][36157] DAMAGECOUNT value on done: 811780.0 [2023-02-25 14:09:49,262][36157] Sum rewards: 50.619, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.070', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.148', 'WEAPON4': '0.200', 'weapon4': '0.264', 'weapon2': '0.378', 'WEAPON3': '1.000', 'HITCOUNT': '2.820', 'weapon3': '3.244', 'DAMAGECOUNT': '12.255', 'FRAGCOUNT': '45.000'} [2023-02-25 14:09:49,364][36140] DAMAGECOUNT value on done: 802071.0 [2023-02-25 14:09:49,364][36140] Sum rewards: 54.256, reward structure: {'DEATHCOUNT': '-14.250', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon4': '0.152', 'HEALTH': '0.160', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'weapon5': '0.274', 'WEAPON5': '0.400', 'weapon2': '0.584', 'WEAPON3': '1.000', 'weapon3': '2.736', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.144', 'FRAGCOUNT': '44.500'} [2023-02-25 14:09:49,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13371.0). Total num frames: 196829184. Throughput: 0: 3352.3. Samples: 11705556. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:09:49,730][36114] Avg episode reward: [(0, '55.934')] [2023-02-25 14:09:51,070][36142] DAMAGECOUNT value on done: 812622.0 [2023-02-25 14:09:51,070][36142] Sum rewards: 54.498, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.960', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.110', 'weapon2': '0.180', 'AMMO3': '0.240', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.592', 'WEAPON3': '1.500', 'weapon3': '2.786', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.957', 'FRAGCOUNT': '48.500'} [2023-02-25 14:09:51,368][36142] DAMAGECOUNT value on done: 799496.0 [2023-02-25 14:09:51,368][36142] Sum rewards: 54.535, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.007', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.034', 'weapon5': '0.108', 'AMMO4': '0.169', 'AMMO3': '0.171', 'weapon2': '0.234', 'WEAPON5': '0.250', 'weapon4': '0.424', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.880', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.952', 'FRAGCOUNT': '47.000'} [2023-02-25 14:09:51,387][36142] DAMAGECOUNT value on done: 793457.0 [2023-02-25 14:09:51,387][36142] Sum rewards: 53.878, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.105', 'ARMOR': '0.012', 'AMMO5': '0.022', 'AMMO2': '0.050', 'AMMO3': '0.206', 'AMMO4': '0.249', 'weapon2': '0.292', 'weapon5': '0.334', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'weapon4': '1.066', 'WEAPON3': '1.200', 'weapon3': '1.876', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.475', 'FRAGCOUNT': '50.000'} [2023-02-25 14:09:51,659][36142] DAMAGECOUNT value on done: 811310.0 [2023-02-25 14:09:51,660][36142] Sum rewards: 59.937, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.622', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.092', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'WEAPON4': '0.250', 'weapon4': '0.520', 'weapon2': '0.564', 'WEAPON3': '0.950', 'weapon3': '2.600', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.871', 'FRAGCOUNT': '50.000'} [2023-02-25 14:09:51,795][36155] DAMAGECOUNT value on done: 799897.0 [2023-02-25 14:09:51,795][36155] Sum rewards: 66.216, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.936', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.154', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.330', 'weapon2': '0.516', 'WEAPON3': '1.250', 'weapon3': '2.710', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.193', 'FRAGCOUNT': '56.000'} [2023-02-25 14:09:52,097][36155] DAMAGECOUNT value on done: 813409.0 [2023-02-25 14:09:52,098][36155] Sum rewards: 46.801, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.435', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.092', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon4': '0.388', 'weapon2': '0.502', 'WEAPON3': '1.150', 'HITCOUNT': '2.730', 'weapon3': '2.820', 'DAMAGECOUNT': '11.910', 'FRAGCOUNT': '40.000'} [2023-02-25 14:09:52,103][36156] DAMAGECOUNT value on done: 815108.0 [2023-02-25 14:09:52,103][36156] Sum rewards: 52.481, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.724', 'AMMO2': '0.008', 'AMMO4': '0.037', 'AMMO3': '0.239', 'weapon2': '0.626', 'WEAPON3': '1.450', 'HITCOUNT': '2.990', 'weapon3': '3.216', 'DAMAGECOUNT': '14.139', 'FRAGCOUNT': '45.000'} [2023-02-25 14:09:52,192][36138] Updated weights for policy 0, policy_version 48063 (0.0009) [2023-02-25 14:09:52,256][36156] DAMAGECOUNT value on done: 811806.0 [2023-02-25 14:09:52,256][36156] Sum rewards: 62.124, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.322', 'AMMO5': '0.005', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'weapon5': '0.088', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon2': '0.288', 'weapon4': '0.452', 'WEAPON3': '1.150', 'weapon3': '2.936', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.547', 'FRAGCOUNT': '52.000'} [2023-02-25 14:09:52,415][36156] DAMAGECOUNT value on done: 805775.0 [2023-02-25 14:09:52,415][36156] Sum rewards: 54.106, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.110', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.041', 'AMMO3': '0.162', 'weapon4': '0.186', 'AMMO4': '0.202', 'weapon5': '0.210', 'weapon2': '0.410', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'HITCOUNT': '2.550', 'weapon3': '2.716', 'DAMAGECOUNT': '14.250', 'FRAGCOUNT': '47.000'} [2023-02-25 14:09:52,557][36156] DAMAGECOUNT value on done: 801923.0 [2023-02-25 14:09:52,557][36156] Sum rewards: 57.840, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.036', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO3': '0.137', 'AMMO4': '0.195', 'weapon5': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon4': '0.458', 'weapon2': '0.462', 'WEAPON3': '0.850', 'weapon3': '2.158', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.316', 'FRAGCOUNT': '48.000'} [2023-02-25 14:09:53,147][36155] DAMAGECOUNT value on done: 814273.0 [2023-02-25 14:09:53,148][36155] Sum rewards: 56.859, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.558', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO3': '0.120', 'AMMO4': '0.128', 'weapon5': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON3': '0.700', 'weapon4': '0.834', 'weapon3': '2.174', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.909', 'FRAGCOUNT': '47.000'} [2023-02-25 14:09:53,442][36155] DAMAGECOUNT value on done: 803167.0 [2023-02-25 14:09:53,442][36155] Sum rewards: 51.959, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.926', 'AMMO5': '0.003', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO3': '0.165', 'AMMO4': '0.172', 'WEAPON4': '0.300', 'weapon2': '0.376', 'ARMOR': '0.400', 'weapon4': '0.534', 'WEAPON3': '1.050', 'weapon3': '2.796', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.157', 'FRAGCOUNT': '44.000'} [2023-02-25 14:09:53,487][36139] Large shaping reward -2.533 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('weapon5', 0.002)] [2023-02-25 14:09:54,114][36139] DAMAGECOUNT value on done: 807874.0 [2023-02-25 14:09:54,114][36139] Sum rewards: 54.313, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.605', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.030', 'AMMO4': '0.082', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.256', 'weapon2': '0.320', 'WEAPON3': '1.600', 'HITCOUNT': '3.070', 'weapon3': '3.304', 'DAMAGECOUNT': '14.832', 'FRAGCOUNT': '49.000'} [2023-02-25 14:09:54,416][36139] DAMAGECOUNT value on done: 802118.0 [2023-02-25 14:09:54,416][36139] Sum rewards: 52.929, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.890', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.086', 'AMMO4': '0.160', 'AMMO3': '0.254', 'weapon5': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.510', 'WEAPON3': '1.400', 'weapon3': '2.778', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '14.391', 'FRAGCOUNT': '48.000'} [2023-02-25 14:09:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 196898816. Throughput: 0: 3354.9. Samples: 11715664. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:09:54,730][36114] Avg episode reward: [(0, '56.231')] [2023-02-25 14:09:54,750][36139] DAMAGECOUNT value on done: 816800.0 [2023-02-25 14:09:54,750][36139] Sum rewards: 48.606, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.920', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO4': '0.204', 'weapon5': '0.238', 'AMMO3': '0.257', 'weapon2': '0.274', 'weapon4': '0.380', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.722', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '14.367', 'FRAGCOUNT': '45.000'} [2023-02-25 14:09:55,039][36139] DAMAGECOUNT value on done: 808731.0 [2023-02-25 14:09:55,040][36139] Sum rewards: 57.859, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.350', 'AMMO2': '0.011', 'AMMO5': '0.012', 'AMMO4': '0.056', 'weapon5': '0.158', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon2': '0.326', 'WEAPON5': '0.350', 'weapon4': '0.458', 'WEAPON3': '1.300', 'weapon3': '2.810', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '49.500'} [2023-02-25 14:09:55,211][36138] Updated weights for policy 0, policy_version 48073 (0.0009) [2023-02-25 14:09:58,241][36138] Updated weights for policy 0, policy_version 48083 (0.0009) [2023-02-25 14:09:59,729][36114] Fps is (10 sec: 13516.6, 60 sec: 13380.2, 300 sec: 13371.0). Total num frames: 196964352. Throughput: 0: 3358.6. Samples: 11735934. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:09:59,730][36114] Avg episode reward: [(0, '56.342')] [2023-02-25 14:10:01,299][36138] Updated weights for policy 0, policy_version 48093 (0.0009) [2023-02-25 14:10:04,361][36138] Updated weights for policy 0, policy_version 48103 (0.0009) [2023-02-25 14:10:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 197033984. Throughput: 0: 3359.2. Samples: 11756122. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:10:04,729][36114] Avg episode reward: [(0, '56.342')] [2023-02-25 14:10:05,612][36154] DAMAGECOUNT value on done: 811554.0 [2023-02-25 14:10:05,613][36154] Sum rewards: 42.820, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.052', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.057', 'AMMO3': '0.153', 'weapon2': '0.264', 'AMMO4': '0.285', 'weapon5': '0.348', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'weapon4': '0.798', 'WEAPON3': '0.900', 'weapon3': '2.180', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '12.693', 'FRAGCOUNT': '39.000'} [2023-02-25 14:10:05,845][36141] DAMAGECOUNT value on done: 814844.0 [2023-02-25 14:10:05,846][36141] Sum rewards: 58.301, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.440', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.148', 'weapon2': '0.198', 'AMMO4': '0.205', 'AMMO3': '0.229', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '1.072', 'WEAPON3': '1.350', 'weapon3': '2.290', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.618', 'FRAGCOUNT': '52.000'} [2023-02-25 14:10:05,888][36154] DAMAGECOUNT value on done: 809858.0 [2023-02-25 14:10:05,888][36154] Sum rewards: 51.598, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.103', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.070', 'AMMO4': '0.097', 'weapon5': '0.152', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.330', 'WEAPON3': '1.150', 'HITCOUNT': '2.930', 'weapon3': '3.236', 'DAMAGECOUNT': '13.884', 'FRAGCOUNT': '44.000'} [2023-02-25 14:10:05,933][36154] DAMAGECOUNT value on done: 796742.0 [2023-02-25 14:10:05,933][36154] Sum rewards: 49.673, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.766', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon5': '0.172', 'weapon2': '0.186', 'AMMO3': '0.218', 'AMMO4': '0.252', 'weapon4': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.660', 'weapon3': '3.094', 'DAMAGECOUNT': '13.179', 'FRAGCOUNT': '46.000'} [2023-02-25 14:10:06,159][36141] DAMAGECOUNT value on done: 812270.0 [2023-02-25 14:10:06,160][36141] Sum rewards: 41.571, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.286', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'weapon2': '0.142', 'AMMO3': '0.214', 'WEAPON3': '1.350', 'HITCOUNT': '2.420', 'weapon3': '3.706', 'DAMAGECOUNT': '11.793', 'FRAGCOUNT': '36.000'} [2023-02-25 14:10:06,218][36154] DAMAGECOUNT value on done: 808994.0 [2023-02-25 14:10:06,218][36154] Sum rewards: 54.302, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.690', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.122', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.268', 'weapon2': '0.374', 'WEAPON3': '1.100', 'HITCOUNT': '2.870', 'weapon3': '2.984', 'DAMAGECOUNT': '13.953', 'FRAGCOUNT': '47.000'} [2023-02-25 14:10:06,229][36141] DAMAGECOUNT value on done: 807606.0 [2023-02-25 14:10:06,230][36141] Sum rewards: 56.558, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.414', 'AMMO2': '0.007', 'AMMO4': '0.032', 'WEAPON4': '0.100', 'weapon4': '0.130', 'weapon2': '0.200', 'AMMO3': '0.280', 'WEAPON3': '1.600', 'HITCOUNT': '3.180', 'weapon3': '3.428', 'DAMAGECOUNT': '14.265', 'FRAGCOUNT': '52.000'} [2023-02-25 14:10:06,540][36141] DAMAGECOUNT value on done: 802591.0 [2023-02-25 14:10:06,540][36141] Sum rewards: 56.020, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.655', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.036', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.156', 'weapon2': '0.402', 'WEAPON3': '1.150', 'HITCOUNT': '3.190', 'weapon3': '3.412', 'DAMAGECOUNT': '14.241', 'FRAGCOUNT': '47.000'} [2023-02-25 14:10:07,425][36138] Updated weights for policy 0, policy_version 48113 (0.0009) [2023-02-25 14:10:07,965][36157] DAMAGECOUNT value on done: 818273.0 [2023-02-25 14:10:07,966][36157] Sum rewards: 52.129, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.014', 'AMMO5': '0.017', 'AMMO2': '0.057', 'AMMO3': '0.224', 'AMMO4': '0.287', 'weapon2': '0.328', 'weapon5': '0.346', 'weapon4': '0.368', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.666', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.640', 'FRAGCOUNT': '46.000'} [2023-02-25 14:10:08,285][36157] DAMAGECOUNT value on done: 807354.0 [2023-02-25 14:10:08,286][36157] Sum rewards: 52.549, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.123', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.015', 'weapon5': '0.044', 'WEAPON5': '0.100', 'weapon2': '0.128', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.496', 'WEAPON3': '1.100', 'HITCOUNT': '2.910', 'weapon3': '3.032', 'DAMAGECOUNT': '13.212', 'FRAGCOUNT': '45.000'} [2023-02-25 14:10:08,457][36140] DAMAGECOUNT value on done: 813461.0 [2023-02-25 14:10:08,457][36140] Sum rewards: 55.757, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.832', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.154', 'weapon2': '0.156', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'weapon4': '0.454', 'WEAPON3': '1.250', 'HITCOUNT': '3.020', 'weapon3': '3.098', 'DAMAGECOUNT': '13.956', 'FRAGCOUNT': '49.000'} [2023-02-25 14:10:08,760][36140] DAMAGECOUNT value on done: 796076.0 [2023-02-25 14:10:08,760][36140] Sum rewards: 51.715, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.356', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'weapon2': '0.152', 'AMMO3': '0.162', 'WEAPON5': '0.250', 'weapon5': '0.270', 'weapon4': '0.684', 'WEAPON3': '1.000', 'weapon3': '2.632', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.609', 'FRAGCOUNT': '43.500'} [2023-02-25 14:10:08,877][36157] DAMAGECOUNT value on done: 822120.0 [2023-02-25 14:10:08,878][36157] Sum rewards: 61.236, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.348', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'weapon2': '0.332', 'weapon4': '0.472', 'WEAPON3': '1.200', 'weapon3': '2.894', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.303', 'FRAGCOUNT': '52.000'} [2023-02-25 14:10:09,044][36140] DAMAGECOUNT value on done: 805410.0 [2023-02-25 14:10:09,045][36140] Sum rewards: 47.254, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.565', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon7': '0.076', 'AMMO4': '0.102', 'AMMO3': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.182', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.486', 'WEAPON3': '0.800', 'weapon4': '1.120', 'weapon3': '1.856', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '12.798', 'FRAGCOUNT': '39.000'} [2023-02-25 14:10:09,172][36157] DAMAGECOUNT value on done: 816711.0 [2023-02-25 14:10:09,172][36157] Sum rewards: 53.000, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.175', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.082', 'AMMO4': '0.106', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon4': '0.228', 'WEAPON4': '0.300', 'weapon2': '0.358', 'WEAPON3': '1.350', 'HITCOUNT': '3.120', 'weapon3': '3.140', 'DAMAGECOUNT': '14.793', 'FRAGCOUNT': '48.000'} [2023-02-25 14:10:09,352][36140] DAMAGECOUNT value on done: 806764.0 [2023-02-25 14:10:09,352][36140] Sum rewards: 58.728, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.270', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.122', 'AMMO3': '0.149', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.576', 'weapon4': '0.660', 'WEAPON3': '0.900', 'weapon3': '2.358', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.079', 'FRAGCOUNT': '50.000'} [2023-02-25 14:10:09,729][36114] Fps is (10 sec: 13517.1, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 197099520. Throughput: 0: 3360.4. Samples: 11766116. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:10:09,730][36114] Avg episode reward: [(0, '55.815')] [2023-02-25 14:10:10,500][36138] Updated weights for policy 0, policy_version 48123 (0.0010) [2023-02-25 14:10:11,026][36142] DAMAGECOUNT value on done: 817554.0 [2023-02-25 14:10:11,027][36142] Sum rewards: 60.865, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.470', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'weapon4': '0.188', 'AMMO3': '0.207', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.070', 'weapon3': '3.312', 'DAMAGECOUNT': '14.796', 'FRAGCOUNT': '54.000'} [2023-02-25 14:10:11,325][36142] DAMAGECOUNT value on done: 804588.0 [2023-02-25 14:10:11,326][36142] Sum rewards: 62.220, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.747', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'weapon5': '0.100', 'weapon2': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'weapon4': '0.258', 'WEAPON3': '1.150', 'HITCOUNT': '3.180', 'weapon3': '3.320', 'DAMAGECOUNT': '15.276', 'FRAGCOUNT': '52.000'} [2023-02-25 14:10:11,344][36142] DAMAGECOUNT value on done: 798288.0 [2023-02-25 14:10:11,345][36142] Sum rewards: 51.404, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.485', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'weapon2': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.224', 'AMMO3': '0.235', 'WEAPON3': '1.450', 'HITCOUNT': '3.290', 'weapon3': '3.338', 'DAMAGECOUNT': '14.493', 'FRAGCOUNT': '46.000'} [2023-02-25 14:10:11,639][36142] DAMAGECOUNT value on done: 816417.0 [2023-02-25 14:10:11,639][36142] Sum rewards: 55.073, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.421', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.134', 'AMMO4': '0.158', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.348', 'weapon2': '0.518', 'WEAPON3': '1.300', 'weapon3': '2.770', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.321', 'FRAGCOUNT': '48.000'} [2023-02-25 14:10:11,751][36155] DAMAGECOUNT value on done: 805099.0 [2023-02-25 14:10:11,752][36155] Sum rewards: 62.935, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.600', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.112', 'AMMO4': '0.132', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'weapon4': '0.292', 'WEAPON4': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.000', 'weapon3': '2.848', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '53.000'} [2023-02-25 14:10:12,065][36155] DAMAGECOUNT value on done: 817555.0 [2023-02-25 14:10:12,066][36155] Sum rewards: 49.310, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.997', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.035', 'AMMO4': '0.177', 'weapon2': '0.188', 'AMMO3': '0.230', 'weapon5': '0.288', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.724', 'WEAPON3': '1.300', 'weapon3': '2.378', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.438', 'FRAGCOUNT': '46.000'} [2023-02-25 14:10:12,318][36156] DAMAGECOUNT value on done: 820508.0 [2023-02-25 14:10:12,318][36156] Sum rewards: 69.226, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.098', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO3': '0.222', 'weapon2': '0.328', 'WEAPON3': '1.450', 'HITCOUNT': '3.390', 'weapon3': '3.486', 'DAMAGECOUNT': '16.200', 'FRAGCOUNT': '59.000'} [2023-02-25 14:10:12,456][36156] DAMAGECOUNT value on done: 817415.0 [2023-02-25 14:10:12,457][36156] Sum rewards: 60.023, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.582', 'AMMO5': '0.006', 'AMMO2': '0.048', 'weapon5': '0.076', 'weapon4': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.240', 'WEAPON4': '0.250', 'AMMO3': '0.272', 'weapon2': '0.356', 'WEAPON3': '1.600', 'weapon3': '3.198', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '53.500'} [2023-02-25 14:10:12,629][36156] DAMAGECOUNT value on done: 810995.0 [2023-02-25 14:10:12,630][36156] Sum rewards: 57.279, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.480', 'AMMO5': '0.012', 'AMMO2': '0.042', 'AMMO3': '0.197', 'AMMO4': '0.211', 'weapon5': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.494', 'weapon4': '0.858', 'WEAPON3': '1.200', 'weapon3': '2.068', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '49.000'} [2023-02-25 14:10:12,769][36156] DAMAGECOUNT value on done: 806712.0 [2023-02-25 14:10:12,770][36156] Sum rewards: 51.422, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.204', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.175', 'AMMO3': '0.211', 'WEAPON5': '0.300', 'weapon5': '0.314', 'weapon2': '0.396', 'WEAPON4': '0.400', 'weapon4': '0.592', 'WEAPON3': '1.250', 'weapon3': '2.374', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.367', 'FRAGCOUNT': '46.000'} [2023-02-25 14:10:13,102][36155] DAMAGECOUNT value on done: 819088.0 [2023-02-25 14:10:13,102][36155] Sum rewards: 54.068, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.622', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.104', 'weapon4': '0.116', 'AMMO4': '0.198', 'WEAPON5': '0.200', 'weapon2': '0.200', 'AMMO3': '0.265', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '3.110', 'weapon3': '3.304', 'DAMAGECOUNT': '14.445', 'FRAGCOUNT': '51.000'} [2023-02-25 14:10:13,408][36155] DAMAGECOUNT value on done: 807722.0 [2023-02-25 14:10:13,409][36155] Sum rewards: 54.476, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.118', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.069', 'weapon5': '0.102', 'WEAPON5': '0.150', 'weapon4': '0.170', 'AMMO3': '0.221', 'weapon2': '0.530', 'WEAPON3': '1.350', 'weapon3': '2.986', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.665', 'FRAGCOUNT': '47.000'} [2023-02-25 14:10:13,550][36138] Updated weights for policy 0, policy_version 48133 (0.0009) [2023-02-25 14:10:13,908][36156] Large shaping reward 2.581 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.549, 183.0), ('weapon5', 0.002)] [2023-02-25 14:10:14,119][36139] DAMAGECOUNT value on done: 812674.0 [2023-02-25 14:10:14,120][36139] Sum rewards: 52.314, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'AMMO3': '0.189', 'weapon4': '0.200', 'weapon2': '0.204', 'HEALTH': '0.276', 'WEAPON3': '1.050', 'HITCOUNT': '3.100', 'weapon3': '3.372', 'DAMAGECOUNT': '14.400', 'FRAGCOUNT': '42.000'} [2023-02-25 14:10:14,426][36139] DAMAGECOUNT value on done: 806464.0 [2023-02-25 14:10:14,427][36139] Sum rewards: 49.575, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.454', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.142', 'AMMO3': '0.143', 'weapon2': '0.276', 'weapon5': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.762', 'WEAPON3': '0.800', 'weapon3': '2.112', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '13.038', 'FRAGCOUNT': '41.000'} [2023-02-25 14:10:14,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13371.0). Total num frames: 197165056. Throughput: 0: 3360.6. Samples: 11786174. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:10:14,730][36114] Avg episode reward: [(0, '55.431')] [2023-02-25 14:10:14,743][36139] DAMAGECOUNT value on done: 821995.0 [2023-02-25 14:10:14,743][36139] Sum rewards: 68.360, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.360', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.026', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'weapon4': '0.294', 'weapon2': '0.510', 'WEAPON3': '1.100', 'weapon3': '2.984', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '56.000'} [2023-02-25 14:10:15,056][36139] DAMAGECOUNT value on done: 814435.0 [2023-02-25 14:10:15,056][36139] Sum rewards: 67.843, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.265', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.164', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.220', 'WEAPON5': '0.250', 'weapon4': '0.266', 'WEAPON3': '1.250', 'weapon3': '3.118', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '57.000'} [2023-02-25 14:10:16,575][36138] Updated weights for policy 0, policy_version 48143 (0.0009) [2023-02-25 14:10:19,651][36138] Updated weights for policy 0, policy_version 48153 (0.0009) [2023-02-25 14:10:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 197234688. Throughput: 0: 3357.1. Samples: 11806340. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:10:19,729][36114] Avg episode reward: [(0, '55.625')] [2023-02-25 14:10:22,689][36138] Updated weights for policy 0, policy_version 48163 (0.0009) [2023-02-25 14:10:23,524][36157] Large shaping reward 2.528 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.47700000000000004, 159.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:10:24,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 197300224. Throughput: 0: 3357.5. Samples: 11816436. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:10:24,730][36114] Avg episode reward: [(0, '55.625')] [2023-02-25 14:10:25,721][36138] Updated weights for policy 0, policy_version 48173 (0.0009) [2023-02-25 14:10:25,751][36154] DAMAGECOUNT value on done: 816441.0 [2023-02-25 14:10:25,751][36154] Sum rewards: 55.872, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.991', 'ARMOR': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon5': '0.088', 'AMMO4': '0.131', 'AMMO3': '0.166', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.364', 'weapon4': '0.452', 'WEAPON3': '1.100', 'weapon3': '2.886', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.661', 'FRAGCOUNT': '47.000'} [2023-02-25 14:10:25,941][36154] DAMAGECOUNT value on done: 815248.0 [2023-02-25 14:10:25,942][36154] Sum rewards: 61.236, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.526', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.124', 'weapon4': '0.148', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.200', 'HITCOUNT': '3.000', 'weapon3': '3.182', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '52.000'} [2023-02-25 14:10:25,990][36141] DAMAGECOUNT value on done: 819826.0 [2023-02-25 14:10:25,991][36141] Sum rewards: 62.542, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.390', 'ARMOR': '0.004', 'AMMO2': '0.004', 'AMMO4': '0.022', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.179', 'weapon2': '0.368', 'WEAPON3': '1.300', 'HITCOUNT': '3.090', 'weapon3': '3.324', 'DAMAGECOUNT': '14.946', 'FRAGCOUNT': '53.000'} [2023-02-25 14:10:26,065][36154] DAMAGECOUNT value on done: 802089.0 [2023-02-25 14:10:26,065][36154] Sum rewards: 62.865, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.341', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.060', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'weapon2': '0.462', 'WEAPON3': '1.450', 'weapon3': '3.094', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '54.000'} [2023-02-25 14:10:26,269][36154] DAMAGECOUNT value on done: 814366.0 [2023-02-25 14:10:26,270][36154] Sum rewards: 57.349, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.526', 'AMMO5': '0.019', 'AMMO2': '0.040', 'weapon5': '0.158', 'AMMO4': '0.200', 'AMMO3': '0.288', 'weapon2': '0.296', 'weapon4': '0.344', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'weapon3': '2.814', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.086', 'FRAGCOUNT': '54.500'} [2023-02-25 14:10:26,300][36141] DAMAGECOUNT value on done: 817011.0 [2023-02-25 14:10:26,301][36141] Sum rewards: 48.152, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.490', 'AMMO5': '0.021', 'AMMO2': '0.062', 'AMMO3': '0.188', 'weapon5': '0.246', 'AMMO4': '0.308', 'ARMOR': '0.400', 'weapon2': '0.474', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'weapon4': '0.892', 'WEAPON3': '1.100', 'weapon3': '1.968', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.223', 'FRAGCOUNT': '43.500'} [2023-02-25 14:10:26,341][36141] DAMAGECOUNT value on done: 812188.0 [2023-02-25 14:10:26,341][36141] Sum rewards: 55.987, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.472', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon4': '0.090', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.144', 'AMMO3': '0.185', 'AMMO4': '0.206', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.664', 'WEAPON3': '1.200', 'weapon3': '2.810', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.746', 'FRAGCOUNT': '49.000'} [2023-02-25 14:10:26,657][36141] DAMAGECOUNT value on done: 807203.0 [2023-02-25 14:10:26,657][36141] Sum rewards: 52.099, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.945', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.107', 'AMMO3': '0.195', 'weapon5': '0.222', 'weapon2': '0.342', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.580', 'WEAPON3': '1.200', 'weapon3': '2.524', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.836', 'FRAGCOUNT': '47.000'} [2023-02-25 14:10:28,030][36157] DAMAGECOUNT value on done: 823005.0 [2023-02-25 14:10:28,030][36157] Sum rewards: 57.798, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.076', 'AMMO5': '0.023', 'AMMO2': '0.048', 'AMMO3': '0.146', 'AMMO4': '0.241', 'weapon2': '0.268', 'weapon5': '0.294', 'ARMOR': '0.459', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'weapon4': '0.742', 'WEAPON3': '0.900', 'weapon3': '2.416', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.196', 'FRAGCOUNT': '48.000'} [2023-02-25 14:10:28,357][36157] DAMAGECOUNT value on done: 812372.0 [2023-02-25 14:10:28,358][36157] Sum rewards: 59.054, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.012', 'AMMO2': '0.018', 'HEALTH': '0.064', 'AMMO4': '0.092', 'weapon4': '0.102', 'AMMO3': '0.132', 'weapon5': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.502', 'WEAPON3': '0.750', 'weapon3': '2.954', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.009', 'FRAGCOUNT': '47.000'} [2023-02-25 14:10:28,461][36140] DAMAGECOUNT value on done: 818235.0 [2023-02-25 14:10:28,461][36140] Sum rewards: 55.577, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO3': '0.155', 'AMMO4': '0.158', 'weapon5': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.428', 'HEALTH': '0.718', 'WEAPON3': '0.850', 'weapon4': '1.038', 'weapon3': '2.016', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.322', 'FRAGCOUNT': '45.000'} [2023-02-25 14:10:28,772][36140] DAMAGECOUNT value on done: 800344.0 [2023-02-25 14:10:28,772][36140] Sum rewards: 44.079, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.967', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.122', 'AMMO4': '0.132', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'weapon4': '0.246', 'WEAPON4': '0.300', 'weapon2': '0.564', 'WEAPON3': '1.050', 'HITCOUNT': '2.830', 'weapon3': '2.832', 'DAMAGECOUNT': '12.804', 'FRAGCOUNT': '38.000'} [2023-02-25 14:10:28,775][36138] Updated weights for policy 0, policy_version 48183 (0.0010) [2023-02-25 14:10:28,966][36157] DAMAGECOUNT value on done: 826864.0 [2023-02-25 14:10:28,966][36157] Sum rewards: 57.843, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.751', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO3': '0.123', 'AMMO4': '0.125', 'weapon5': '0.288', 'WEAPON5': '0.350', 'weapon2': '0.432', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'weapon4': '1.224', 'weapon3': '1.802', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.202', 'FRAGCOUNT': '48.000'} [2023-02-25 14:10:29,012][36140] DAMAGECOUNT value on done: 810578.0 [2023-02-25 14:10:29,013][36140] Sum rewards: 55.132, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.372', 'ARMOR': '0.008', 'AMMO5': '0.024', 'AMMO2': '0.051', 'AMMO3': '0.138', 'AMMO4': '0.256', 'weapon2': '0.442', 'weapon5': '0.460', 'weapon4': '0.486', 'WEAPON4': '0.650', 'WEAPON5': '0.700', 'WEAPON3': '0.800', 'weapon3': '2.170', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '14.988', 'FRAGCOUNT': '47.000'} [2023-02-25 14:10:29,286][36157] DAMAGECOUNT value on done: 821737.0 [2023-02-25 14:10:29,286][36157] Sum rewards: 57.954, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.140', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.108', 'AMMO3': '0.192', 'AMMO4': '0.224', 'weapon2': '0.288', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.544', 'WEAPON3': '1.200', 'weapon3': '2.808', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.078', 'FRAGCOUNT': '52.000'} [2023-02-25 14:10:29,319][36140] DAMAGECOUNT value on done: 811466.0 [2023-02-25 14:10:29,320][36140] Sum rewards: 47.214, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.697', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.128', 'weapon2': '0.186', 'AMMO4': '0.194', 'AMMO3': '0.292', 'weapon4': '0.324', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'HITCOUNT': '2.730', 'weapon3': '3.070', 'DAMAGECOUNT': '13.683', 'FRAGCOUNT': '45.000'} [2023-02-25 14:10:29,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13384.9). Total num frames: 197369856. Throughput: 0: 3358.5. Samples: 11836572. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:10:29,729][36114] Avg episode reward: [(0, '55.699')] [2023-02-25 14:10:31,093][36142] DAMAGECOUNT value on done: 817906.0 [2023-02-25 14:10:31,093][36142] Sum rewards: 5.223, reward structure: {'DEATHCOUNT': '-1.500', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO3': '0.048', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.062', 'weapon4': '0.136', 'WEAPON3': '0.150', 'HEALTH': '0.190', 'HITCOUNT': '0.190', 'ARMOR': '0.400', 'weapon2': '0.564', 'weapon3': '0.764', 'DAMAGECOUNT': '1.056', 'FRAGCOUNT': '3.000'} [2023-02-25 14:10:31,397][36142] DAMAGECOUNT value on done: 809280.0 [2023-02-25 14:10:31,397][36142] Sum rewards: 54.632, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.662', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon2': '0.156', 'weapon5': '0.166', 'AMMO3': '0.191', 'AMMO4': '0.206', 'weapon4': '0.308', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '3.060', 'weapon3': '3.124', 'DAMAGECOUNT': '14.076', 'FRAGCOUNT': '48.000'} [2023-02-25 14:10:31,417][36142] DAMAGECOUNT value on done: 802801.0 [2023-02-25 14:10:31,417][36142] Sum rewards: 45.207, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.790', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.058', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'AMMO3': '0.303', 'weapon2': '0.316', 'WEAPON4': '0.350', 'weapon4': '0.514', 'WEAPON3': '1.700', 'weapon3': '2.860', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.539', 'FRAGCOUNT': '44.000'} [2023-02-25 14:10:31,706][36155] DAMAGECOUNT value on done: 810047.0 [2023-02-25 14:10:31,707][36155] Sum rewards: 52.038, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.506', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'weapon5': '0.188', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon4': '0.328', 'weapon2': '0.554', 'WEAPON3': '1.150', 'weapon3': '2.612', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.844', 'FRAGCOUNT': '44.000'} [2023-02-25 14:10:31,719][36142] DAMAGECOUNT value on done: 822037.0 [2023-02-25 14:10:31,720][36142] Sum rewards: 61.857, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.637', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon4': '0.084', 'weapon5': '0.118', 'weapon2': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.293', 'WEAPON3': '1.750', 'HITCOUNT': '3.040', 'weapon3': '3.338', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '56.000'} [2023-02-25 14:10:31,802][36138] Updated weights for policy 0, policy_version 48193 (0.0009) [2023-02-25 14:10:32,011][36155] DAMAGECOUNT value on done: 821300.0 [2023-02-25 14:10:32,011][36155] Sum rewards: 43.691, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.944', 'AMMO5': '0.004', 'weapon5': '0.024', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.169', 'AMMO3': '0.257', 'weapon4': '0.298', 'weapon2': '0.654', 'WEAPON3': '1.500', 'HITCOUNT': '2.640', 'weapon3': '2.820', 'DAMAGECOUNT': '11.235', 'FRAGCOUNT': '41.000'} [2023-02-25 14:10:32,283][36156] DAMAGECOUNT value on done: 825010.0 [2023-02-25 14:10:32,283][36156] Sum rewards: 52.620, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.157', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.082', 'weapon5': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'weapon2': '0.642', 'WEAPON3': '1.650', 'weapon3': '2.762', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.506', 'FRAGCOUNT': '48.000'} [2023-02-25 14:10:32,452][36156] DAMAGECOUNT value on done: 822401.0 [2023-02-25 14:10:32,452][36156] Sum rewards: 56.033, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.330', 'weapon7': '0.006', 'AMMO5': '0.006', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.114', 'weapon2': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon4': '0.782', 'WEAPON3': '1.400', 'weapon3': '2.634', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.958', 'FRAGCOUNT': '49.000'} [2023-02-25 14:10:32,594][36156] DAMAGECOUNT value on done: 816174.0 [2023-02-25 14:10:32,594][36156] Sum rewards: 57.870, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.853', 'AMMO5': '0.022', 'AMMO2': '0.057', 'AMMO3': '0.145', 'weapon2': '0.230', 'weapon5': '0.234', 'AMMO4': '0.285', 'weapon4': '0.592', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '0.900', 'weapon3': '2.680', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '50.000'} [2023-02-25 14:10:32,753][36156] DAMAGECOUNT value on done: 811006.0 [2023-02-25 14:10:32,754][36156] Sum rewards: 49.391, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.098', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.138', 'AMMO4': '0.180', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.404', 'weapon2': '0.418', 'weapon4': '0.704', 'WEAPON3': '1.200', 'weapon3': '2.494', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '12.882', 'FRAGCOUNT': '44.000'} [2023-02-25 14:10:33,041][36155] DAMAGECOUNT value on done: 824574.0 [2023-02-25 14:10:33,041][36155] Sum rewards: 62.605, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.760', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.128', 'weapon4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'weapon2': '0.456', 'WEAPON3': '1.450', 'weapon3': '3.038', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '54.000'} [2023-02-25 14:10:33,358][36155] DAMAGECOUNT value on done: 813324.0 [2023-02-25 14:10:33,359][36155] Sum rewards: 63.811, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.712', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.130', 'weapon4': '0.132', 'weapon2': '0.148', 'WEAPON4': '0.150', 'AMMO4': '0.154', 'WEAPON5': '0.200', 'AMMO3': '0.306', 'WEAPON3': '1.750', 'weapon3': '3.338', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '58.000'} [2023-02-25 14:10:33,987][36139] DAMAGECOUNT value on done: 817051.0 [2023-02-25 14:10:33,987][36139] Sum rewards: 50.506, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.582', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.172', 'weapon5': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.480', 'WEAPON3': '0.950', 'weapon4': '1.070', 'weapon3': '1.940', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.131', 'FRAGCOUNT': '44.000'} [2023-02-25 14:10:34,308][36139] DAMAGECOUNT value on done: 811709.0 [2023-02-25 14:10:34,309][36139] Sum rewards: 52.903, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.660', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon5': '0.098', 'weapon7': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.137', 'AMMO3': '0.173', 'WEAPON7': '0.200', 'weapon2': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.746', 'WEAPON3': '1.200', 'weapon3': '2.198', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.735', 'FRAGCOUNT': '45.000'} [2023-02-25 14:10:34,617][36139] DAMAGECOUNT value on done: 827096.0 [2023-02-25 14:10:34,618][36139] Sum rewards: 60.678, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.094', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.173', 'weapon5': '0.188', 'weapon4': '0.202', 'weapon2': '0.232', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.100', 'weapon3': '3.134', 'DAMAGECOUNT': '15.303', 'FRAGCOUNT': '54.000'} [2023-02-25 14:10:34,729][36114] Fps is (10 sec: 13517.0, 60 sec: 13448.6, 300 sec: 13384.9). Total num frames: 197435392. Throughput: 0: 3359.6. Samples: 11856738. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:10:34,729][36114] Avg episode reward: [(0, '54.923')] [2023-02-25 14:10:34,851][36138] Updated weights for policy 0, policy_version 48203 (0.0009) [2023-02-25 14:10:34,933][36139] DAMAGECOUNT value on done: 820245.0 [2023-02-25 14:10:34,933][36139] Sum rewards: 65.947, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.650', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.030', 'weapon5': '0.052', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.208', 'AMMO3': '0.243', 'WEAPON3': '1.450', 'HITCOUNT': '3.370', 'weapon3': '3.428', 'DAMAGECOUNT': '17.172', 'FRAGCOUNT': '57.000'} [2023-02-25 14:10:37,887][36138] Updated weights for policy 0, policy_version 48213 (0.0009) [2023-02-25 14:10:39,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 197500928. Throughput: 0: 3357.2. Samples: 11866736. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:10:39,730][36114] Avg episode reward: [(0, '54.918')] [2023-02-25 14:10:40,978][36138] Updated weights for policy 0, policy_version 48223 (0.0009) [2023-02-25 14:10:44,073][36138] Updated weights for policy 0, policy_version 48233 (0.0009) [2023-02-25 14:10:44,729][36114] Fps is (10 sec: 13516.6, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 197570560. Throughput: 0: 3352.6. Samples: 11886802. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:10:44,730][36114] Avg episode reward: [(0, '54.918')] [2023-02-25 14:10:45,728][36154] DAMAGECOUNT value on done: 820903.0 [2023-02-25 14:10:45,729][36154] Sum rewards: 50.005, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.591', 'AMMO5': '0.007', 'AMMO2': '0.048', 'weapon5': '0.138', 'AMMO3': '0.184', 'AMMO4': '0.238', 'WEAPON5': '0.250', 'weapon2': '0.324', 'ARMOR': '0.404', 'WEAPON4': '0.450', 'weapon4': '0.786', 'WEAPON3': '1.100', 'weapon3': '2.530', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.356', 'FRAGCOUNT': '43.000'} [2023-02-25 14:10:45,940][36154] DAMAGECOUNT value on done: 820852.0 [2023-02-25 14:10:45,941][36154] Sum rewards: 63.279, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.909', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.100', 'AMMO4': '0.202', 'weapon4': '0.202', 'AMMO3': '0.241', 'WEAPON5': '0.350', 'weapon2': '0.404', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.834', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.812', 'FRAGCOUNT': '58.000'} [2023-02-25 14:10:46,045][36141] DAMAGECOUNT value on done: 824521.0 [2023-02-25 14:10:46,046][36141] Sum rewards: 51.623, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.992', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.278', 'weapon4': '0.288', 'weapon2': '0.348', 'WEAPON3': '1.550', 'HITCOUNT': '3.040', 'weapon3': '3.118', 'DAMAGECOUNT': '14.085', 'FRAGCOUNT': '48.000'} [2023-02-25 14:10:46,047][36154] DAMAGECOUNT value on done: 807394.0 [2023-02-25 14:10:46,047][36154] Sum rewards: 68.581, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.803', 'AMMO5': '0.017', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.143', 'weapon5': '0.158', 'WEAPON4': '0.250', 'weapon2': '0.306', 'weapon4': '0.346', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'weapon3': '2.868', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.915', 'FRAGCOUNT': '56.000'} [2023-02-25 14:10:46,257][36154] DAMAGECOUNT value on done: 819040.0 [2023-02-25 14:10:46,257][36154] Sum rewards: 48.598, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.733', 'AMMO5': '0.012', 'AMMO2': '0.042', 'AMMO3': '0.189', 'AMMO4': '0.211', 'weapon5': '0.252', 'WEAPON5': '0.400', 'weapon4': '0.444', 'WEAPON4': '0.500', 'weapon2': '0.556', 'WEAPON3': '1.200', 'weapon3': '2.342', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '14.022', 'FRAGCOUNT': '45.000'} [2023-02-25 14:10:46,375][36141] DAMAGECOUNT value on done: 821346.0 [2023-02-25 14:10:46,376][36141] Sum rewards: 50.114, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.140', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon5': '0.072', 'AMMO4': '0.114', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.360', 'weapon4': '0.460', 'WEAPON3': '1.200', 'weapon3': '2.894', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.005', 'FRAGCOUNT': '44.000'} [2023-02-25 14:10:46,409][36141] DAMAGECOUNT value on done: 817058.0 [2023-02-25 14:10:46,409][36141] Sum rewards: 56.777, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.622', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.102', 'weapon4': '0.162', 'AMMO4': '0.176', 'weapon2': '0.224', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '2.760', 'weapon3': '3.236', 'DAMAGECOUNT': '14.610', 'FRAGCOUNT': '52.000'} [2023-02-25 14:10:46,705][36141] DAMAGECOUNT value on done: 811994.0 [2023-02-25 14:10:46,705][36141] Sum rewards: 52.568, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.007', 'HEALTH': '0.026', 'AMMO2': '0.029', 'weapon4': '0.080', 'weapon5': '0.098', 'AMMO4': '0.143', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.480', 'WEAPON3': '1.000', 'HITCOUNT': '2.850', 'weapon3': '3.090', 'DAMAGECOUNT': '14.373', 'FRAGCOUNT': '44.000'} [2023-02-25 14:10:47,138][36138] Updated weights for policy 0, policy_version 48243 (0.0009) [2023-02-25 14:10:48,041][36157] DAMAGECOUNT value on done: 828206.0 [2023-02-25 14:10:48,042][36157] Sum rewards: 59.988, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.685', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'weapon4': '0.146', 'weapon2': '0.182', 'AMMO3': '0.266', 'WEAPON3': '1.550', 'HITCOUNT': '3.090', 'weapon3': '3.492', 'DAMAGECOUNT': '15.603', 'FRAGCOUNT': '53.000'} [2023-02-25 14:10:48,330][36157] DAMAGECOUNT value on done: 817658.0 [2023-02-25 14:10:48,330][36157] Sum rewards: 63.891, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.418', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.074', 'weapon4': '0.138', 'AMMO3': '0.276', 'weapon2': '0.314', 'WEAPON3': '1.650', 'HITCOUNT': '3.270', 'weapon3': '3.312', 'DAMAGECOUNT': '15.858', 'FRAGCOUNT': '57.000'} [2023-02-25 14:10:48,526][36140] DAMAGECOUNT value on done: 823008.0 [2023-02-25 14:10:48,526][36140] Sum rewards: 54.166, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.250', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.044', 'AMMO4': '0.059', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.205', 'weapon2': '0.238', 'weapon4': '0.370', 'WEAPON3': '1.300', 'HITCOUNT': '2.940', 'weapon3': '3.122', 'DAMAGECOUNT': '14.319', 'FRAGCOUNT': '47.000'} [2023-02-25 14:10:48,557][36142] Large shaping reward 2.508 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.486, 162.0), ('weapon5', 0.002)] [2023-02-25 14:10:48,864][36140] DAMAGECOUNT value on done: 804784.0 [2023-02-25 14:10:48,865][36140] Sum rewards: 47.943, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.392', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.076', 'weapon5': '0.148', 'AMMO4': '0.155', 'AMMO3': '0.257', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.384', 'WEAPON3': '1.500', 'HITCOUNT': '2.520', 'weapon3': '3.074', 'DAMAGECOUNT': '13.320', 'FRAGCOUNT': '47.000'} [2023-02-25 14:10:48,961][36157] DAMAGECOUNT value on done: 832098.0 [2023-02-25 14:10:48,962][36157] Sum rewards: 54.734, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.652', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.104', 'weapon5': '0.146', 'AMMO4': '0.170', 'weapon2': '0.228', 'AMMO3': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.800', 'HITCOUNT': '2.980', 'weapon3': '3.198', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '51.000'} [2023-02-25 14:10:49,092][36140] DAMAGECOUNT value on done: 816099.0 [2023-02-25 14:10:49,093][36140] Sum rewards: 62.081, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.340', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.096', 'WEAPON5': '0.100', 'weapon4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.235', 'weapon2': '0.316', 'WEAPON3': '1.450', 'HITCOUNT': '3.080', 'weapon3': '3.252', 'DAMAGECOUNT': '16.548', 'FRAGCOUNT': '54.000'} [2023-02-25 14:10:49,263][36157] DAMAGECOUNT value on done: 825257.0 [2023-02-25 14:10:49,264][36157] Sum rewards: 42.979, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.830', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.141', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.274', 'weapon5': '0.338', 'weapon2': '0.496', 'WEAPON3': '1.100', 'HITCOUNT': '2.440', 'weapon3': '2.716', 'DAMAGECOUNT': '10.560', 'FRAGCOUNT': '40.000'} [2023-02-25 14:10:49,390][36140] DAMAGECOUNT value on done: 816433.0 [2023-02-25 14:10:49,390][36140] Sum rewards: 49.806, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.542', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.171', 'AMMO3': '0.205', 'weapon5': '0.236', 'weapon2': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.590', 'WEAPON3': '1.100', 'weapon3': '2.674', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.901', 'FRAGCOUNT': '43.000'} [2023-02-25 14:10:49,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 197636096. Throughput: 0: 3351.8. Samples: 11906954. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:10:49,730][36114] Avg episode reward: [(0, '54.636')] [2023-02-25 14:10:50,158][36138] Updated weights for policy 0, policy_version 48253 (0.0009) [2023-02-25 14:10:51,153][36142] DAMAGECOUNT value on done: 823079.0 [2023-02-25 14:10:51,153][36142] Sum rewards: 63.840, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.597', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.146', 'AMMO4': '0.150', 'weapon2': '0.182', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.654', 'WEAPON3': '1.250', 'weapon3': '2.736', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.519', 'FRAGCOUNT': '56.000'} [2023-02-25 14:10:51,452][36142] DAMAGECOUNT value on done: 814774.0 [2023-02-25 14:10:51,453][36142] Sum rewards: 65.537, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.215', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.090', 'WEAPON5': '0.150', 'weapon2': '0.152', 'AMMO4': '0.199', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'weapon4': '0.442', 'ARMOR': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.096', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.482', 'FRAGCOUNT': '56.500'} [2023-02-25 14:10:51,472][36142] DAMAGECOUNT value on done: 807357.0 [2023-02-25 14:10:51,473][36142] Sum rewards: 56.350, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.147', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.216', 'AMMO3': '0.245', 'weapon5': '0.290', 'weapon2': '0.560', 'WEAPON3': '1.350', 'weapon3': '2.736', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.668', 'FRAGCOUNT': '51.000'} [2023-02-25 14:10:51,773][36142] DAMAGECOUNT value on done: 827281.0 [2023-02-25 14:10:51,773][36142] Sum rewards: 57.371, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.948', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'weapon4': '0.108', 'weapon2': '0.184', 'AMMO3': '0.299', 'WEAPON3': '1.800', 'HITCOUNT': '3.200', 'weapon3': '3.536', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '52.000'} [2023-02-25 14:10:51,783][36155] DAMAGECOUNT value on done: 814735.0 [2023-02-25 14:10:51,783][36155] Sum rewards: 47.727, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.196', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.052', 'AMMO4': '0.216', 'weapon2': '0.226', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.484', 'WEAPON3': '1.300', 'weapon3': '2.972', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.064', 'FRAGCOUNT': '42.000'} [2023-02-25 14:10:52,088][36155] DAMAGECOUNT value on done: 825533.0 [2023-02-25 14:10:52,089][36155] Sum rewards: 44.561, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.893', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.061', 'weapon5': '0.154', 'AMMO3': '0.239', 'AMMO4': '0.304', 'WEAPON5': '0.400', 'weapon2': '0.444', 'weapon4': '0.538', 'WEAPON4': '0.750', 'WEAPON3': '1.400', 'weapon3': '2.544', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '12.699', 'FRAGCOUNT': '45.000'} [2023-02-25 14:10:52,440][36156] DAMAGECOUNT value on done: 830794.0 [2023-02-25 14:10:52,441][36156] Sum rewards: 58.258, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-3.807', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO4': '0.171', 'weapon5': '0.192', 'weapon2': '0.240', 'AMMO3': '0.286', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.486', 'WEAPON3': '1.650', 'weapon3': '2.644', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.352', 'FRAGCOUNT': '55.000'} [2023-02-25 14:10:52,578][36156] DAMAGECOUNT value on done: 828025.0 [2023-02-25 14:10:52,578][36156] Sum rewards: 63.593, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.482', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.196', 'weapon2': '0.208', 'AMMO3': '0.228', 'weapon4': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.038', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '56.000'} [2023-02-25 14:10:52,745][36156] DAMAGECOUNT value on done: 820919.0 [2023-02-25 14:10:52,745][36156] Sum rewards: 52.675, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.271', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.046', 'AMMO3': '0.161', 'AMMO4': '0.232', 'weapon5': '0.310', 'weapon2': '0.312', 'weapon4': '0.356', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.650', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '14.235', 'FRAGCOUNT': '46.000'} [2023-02-25 14:10:52,878][36156] DAMAGECOUNT value on done: 815704.0 [2023-02-25 14:10:52,879][36156] Sum rewards: 50.540, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.126', 'AMMO5': '0.009', 'AMMO2': '0.036', 'AMMO4': '0.179', 'weapon5': '0.224', 'AMMO3': '0.244', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON4': '0.350', 'weapon4': '0.362', 'WEAPON3': '1.400', 'weapon3': '2.838', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.094', 'FRAGCOUNT': '46.000'} [2023-02-25 14:10:53,080][36155] DAMAGECOUNT value on done: 830003.0 [2023-02-25 14:10:53,080][36155] Sum rewards: 65.008, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.022', 'AMMO2': '0.005', 'AMMO5': '0.013', 'weapon4': '0.014', 'AMMO4': '0.027', 'WEAPON4': '0.100', 'weapon5': '0.140', 'AMMO3': '0.218', 'WEAPON5': '0.300', 'weapon2': '0.532', 'WEAPON3': '1.350', 'weapon3': '3.114', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '55.000'} [2023-02-25 14:10:53,209][36138] Updated weights for policy 0, policy_version 48263 (0.0009) [2023-02-25 14:10:53,379][36155] DAMAGECOUNT value on done: 818011.0 [2023-02-25 14:10:53,379][36155] Sum rewards: 47.691, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.490', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.023', 'AMMO2': '0.058', 'weapon5': '0.130', 'AMMO3': '0.214', 'weapon2': '0.286', 'AMMO4': '0.290', 'weapon4': '0.358', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '2.530', 'weapon3': '2.916', 'DAMAGECOUNT': '14.061', 'FRAGCOUNT': '46.000'} [2023-02-25 14:10:53,984][36139] DAMAGECOUNT value on done: 821812.0 [2023-02-25 14:10:53,985][36139] Sum rewards: 50.706, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-0.922', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.046', 'weapon5': '0.208', 'AMMO4': '0.229', 'AMMO3': '0.260', 'weapon2': '0.302', 'weapon4': '0.366', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.668', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '14.283', 'FRAGCOUNT': '48.500'} [2023-02-25 14:10:54,295][36139] DAMAGECOUNT value on done: 816800.0 [2023-02-25 14:10:54,295][36139] Sum rewards: 58.545, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.364', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.046', 'AMMO3': '0.201', 'weapon5': '0.214', 'weapon4': '0.216', 'AMMO4': '0.229', 'weapon2': '0.438', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.816', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.273', 'FRAGCOUNT': '51.000'} [2023-02-25 14:10:54,593][36139] DAMAGECOUNT value on done: 832548.0 [2023-02-25 14:10:54,594][36139] Sum rewards: 64.326, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.029', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon2': '0.198', 'AMMO3': '0.204', 'weapon5': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.670', 'WEAPON3': '1.200', 'weapon3': '2.594', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.356', 'FRAGCOUNT': '54.000'} [2023-02-25 14:10:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 197705728. Throughput: 0: 3355.2. Samples: 11917098. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:10:54,730][36114] Avg episode reward: [(0, '54.849')] [2023-02-25 14:10:54,896][36139] DAMAGECOUNT value on done: 825900.0 [2023-02-25 14:10:54,897][36139] Sum rewards: 67.239, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.695', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.182', 'weapon5': '0.200', 'AMMO3': '0.203', 'AMMO4': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.488', 'WEAPON3': '1.250', 'weapon3': '2.912', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '58.000'} [2023-02-25 14:10:56,244][36138] Updated weights for policy 0, policy_version 48273 (0.0009) [2023-02-25 14:10:59,297][36138] Updated weights for policy 0, policy_version 48283 (0.0009) [2023-02-25 14:10:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13384.9). Total num frames: 197771264. Throughput: 0: 3359.3. Samples: 11937342. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:10:59,730][36114] Avg episode reward: [(0, '55.002')] [2023-02-25 14:11:02,369][36138] Updated weights for policy 0, policy_version 48293 (0.0009) [2023-02-25 14:11:04,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 197836800. Throughput: 0: 3356.8. Samples: 11957394. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:11:04,730][36114] Avg episode reward: [(0, '55.002')] [2023-02-25 14:11:05,416][36138] Updated weights for policy 0, policy_version 48303 (0.0010) [2023-02-25 14:11:05,598][36154] DAMAGECOUNT value on done: 825935.0 [2023-02-25 14:11:05,598][36154] Sum rewards: 60.370, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.670', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.037', 'AMMO4': '0.184', 'AMMO3': '0.188', 'weapon2': '0.196', 'weapon5': '0.268', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.506', 'WEAPON3': '1.100', 'weapon3': '2.742', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.051', 'FRAGCOUNT': '52.000'} [2023-02-25 14:11:05,792][36154] DAMAGECOUNT value on done: 826121.0 [2023-02-25 14:11:05,793][36154] Sum rewards: 62.014, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.030', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'weapon4': '0.284', 'weapon2': '0.484', 'WEAPON3': '1.150', 'weapon3': '3.054', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.807', 'FRAGCOUNT': '52.000'} [2023-02-25 14:11:05,891][36154] DAMAGECOUNT value on done: 812539.0 [2023-02-25 14:11:05,892][36154] Sum rewards: 55.003, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.848', 'AMMO5': '0.009', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.134', 'AMMO3': '0.192', 'weapon2': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.408', 'WEAPON3': '1.250', 'HITCOUNT': '2.960', 'weapon3': '3.038', 'DAMAGECOUNT': '15.435', 'FRAGCOUNT': '47.000'} [2023-02-25 14:11:06,104][36154] DAMAGECOUNT value on done: 824513.0 [2023-02-25 14:11:06,104][36154] Sum rewards: 55.287, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.105', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.144', 'AMMO4': '0.170', 'AMMO3': '0.195', 'weapon4': '0.282', 'weapon2': '0.298', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.034', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '47.000'} [2023-02-25 14:11:06,130][36141] DAMAGECOUNT value on done: 829894.0 [2023-02-25 14:11:06,130][36141] Sum rewards: 64.177, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.690', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.232', 'AMMO3': '0.233', 'weapon2': '0.408', 'WEAPON3': '1.350', 'weapon3': '3.124', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.119', 'FRAGCOUNT': '55.000'} [2023-02-25 14:11:06,436][36141] DAMAGECOUNT value on done: 821639.0 [2023-02-25 14:11:06,436][36141] Sum rewards: 47.877, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.480', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.164', 'AMMO3': '0.321', 'weapon4': '0.430', 'WEAPON3': '1.850', 'HITCOUNT': '2.850', 'weapon3': '3.028', 'DAMAGECOUNT': '13.743', 'FRAGCOUNT': '47.000'} [2023-02-25 14:11:06,446][36141] DAMAGECOUNT value on done: 825991.0 [2023-02-25 14:11:06,446][36141] Sum rewards: 50.594, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.744', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon4': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.200', 'HITCOUNT': '2.800', 'weapon3': '3.028', 'DAMAGECOUNT': '13.935', 'FRAGCOUNT': '45.500'} [2023-02-25 14:11:06,747][36141] DAMAGECOUNT value on done: 816404.0 [2023-02-25 14:11:06,748][36141] Sum rewards: 51.127, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.816', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.024', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO3': '0.233', 'weapon2': '0.238', 'WEAPON3': '1.400', 'HITCOUNT': '2.630', 'weapon3': '3.488', 'DAMAGECOUNT': '13.230', 'FRAGCOUNT': '45.000'} [2023-02-25 14:11:07,935][36157] DAMAGECOUNT value on done: 833723.0 [2023-02-25 14:11:07,936][36157] Sum rewards: 55.815, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.006', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.045', 'AMMO4': '0.223', 'weapon4': '0.256', 'AMMO3': '0.284', 'weapon5': '0.288', 'weapon2': '0.296', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.648', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '16.551', 'FRAGCOUNT': '52.000'} [2023-02-25 14:11:08,251][36157] DAMAGECOUNT value on done: 822495.0 [2023-02-25 14:11:08,251][36157] Sum rewards: 53.486, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.134', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.046', 'AMMO3': '0.159', 'AMMO4': '0.227', 'weapon5': '0.264', 'weapon2': '0.272', 'weapon4': '0.354', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.746', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '14.511', 'FRAGCOUNT': '45.000'} [2023-02-25 14:11:08,447][36138] Updated weights for policy 0, policy_version 48313 (0.0010) [2023-02-25 14:11:08,483][36140] DAMAGECOUNT value on done: 827797.0 [2023-02-25 14:11:08,483][36140] Sum rewards: 63.113, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.169', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon4': '0.252', 'weapon2': '0.402', 'WEAPON3': '1.100', 'HITCOUNT': '2.910', 'weapon3': '3.212', 'DAMAGECOUNT': '14.367', 'FRAGCOUNT': '53.000'} [2023-02-25 14:11:08,803][36140] DAMAGECOUNT value on done: 809429.0 [2023-02-25 14:11:08,803][36140] Sum rewards: 46.287, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.040', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.059', 'AMMO3': '0.193', 'AMMO4': '0.297', 'weapon5': '0.314', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.554', 'weapon4': '0.562', 'WEAPON3': '1.100', 'weapon3': '2.294', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.935', 'FRAGCOUNT': '40.000'} [2023-02-25 14:11:08,849][36157] DAMAGECOUNT value on done: 836417.0 [2023-02-25 14:11:08,850][36157] Sum rewards: 46.281, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.142', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon5': '0.186', 'AMMO3': '0.196', 'weapon4': '0.242', 'weapon2': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.550', 'weapon3': '3.032', 'DAMAGECOUNT': '12.957', 'FRAGCOUNT': '41.000'} [2023-02-25 14:11:08,975][36140] DAMAGECOUNT value on done: 820567.0 [2023-02-25 14:11:08,975][36140] Sum rewards: 51.856, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.714', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO4': '0.136', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.268', 'weapon4': '0.368', 'WEAPON3': '1.400', 'HITCOUNT': '2.780', 'weapon3': '2.984', 'DAMAGECOUNT': '13.404', 'FRAGCOUNT': '48.000'} [2023-02-25 14:11:09,168][36157] DAMAGECOUNT value on done: 828671.0 [2023-02-25 14:11:09,169][36157] Sum rewards: 25.045, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-4.042', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO5': '0.028', 'AMMO2': '0.071', 'AMMO3': '0.224', 'weapon5': '0.326', 'AMMO4': '0.354', 'weapon2': '0.374', 'WEAPON5': '0.750', 'weapon4': '0.876', 'WEAPON4': '0.900', 'WEAPON3': '1.300', 'weapon3': '1.844', 'HITCOUNT': '2.300', 'DAMAGECOUNT': '10.218', 'FRAGCOUNT': '29.000'} [2023-02-25 14:11:09,285][36140] DAMAGECOUNT value on done: 821592.0 [2023-02-25 14:11:09,286][36140] Sum rewards: 58.861, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.220', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.206', 'weapon4': '0.274', 'WEAPON4': '0.350', 'weapon2': '0.360', 'WEAPON3': '1.250', 'HITCOUNT': '2.970', 'weapon3': '3.000', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '51.000'} [2023-02-25 14:11:09,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 197906432. Throughput: 0: 3357.0. Samples: 11967502. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:11:09,730][36114] Avg episode reward: [(0, '55.107')] [2023-02-25 14:11:11,147][36142] DAMAGECOUNT value on done: 827889.0 [2023-02-25 14:11:11,147][36142] Sum rewards: 55.679, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.490', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.039', 'AMMO4': '0.197', 'weapon5': '0.204', 'AMMO3': '0.205', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.494', 'WEAPON3': '1.250', 'weapon3': '2.812', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.400', 'FRAGCOUNT': '48.000'} [2023-02-25 14:11:11,450][36142] DAMAGECOUNT value on done: 819752.0 [2023-02-25 14:11:11,451][36142] Sum rewards: 49.553, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.992', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.220', 'AMMO4': '0.224', 'AMMO3': '0.258', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.476', 'WEAPON3': '1.550', 'weapon3': '2.630', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.934', 'FRAGCOUNT': '45.000'} [2023-02-25 14:11:11,471][36142] DAMAGECOUNT value on done: 811841.0 [2023-02-25 14:11:11,471][36142] Sum rewards: 50.160, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.012', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO4': '0.162', 'weapon5': '0.198', 'AMMO3': '0.212', 'weapon4': '0.252', 'weapon2': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.750', 'weapon3': '2.978', 'DAMAGECOUNT': '13.452', 'FRAGCOUNT': '45.000'} [2023-02-25 14:11:11,533][36138] Updated weights for policy 0, policy_version 48323 (0.0009) [2023-02-25 14:11:11,767][36142] DAMAGECOUNT value on done: 832422.0 [2023-02-25 14:11:11,768][36142] Sum rewards: 63.119, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.357', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon5': '0.114', 'AMMO4': '0.168', 'AMMO3': '0.198', 'weapon2': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.446', 'WEAPON3': '1.150', 'weapon3': '2.956', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.336', 'FRAGCOUNT': '54.000'} [2023-02-25 14:11:11,817][36155] DAMAGECOUNT value on done: 819910.0 [2023-02-25 14:11:11,818][36155] Sum rewards: 61.145, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.454', 'AMMO2': '0.029', 'weapon4': '0.074', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'AMMO3': '0.239', 'weapon2': '0.312', 'WEAPON3': '1.450', 'HITCOUNT': '3.170', 'weapon3': '3.454', 'DAMAGECOUNT': '15.525', 'FRAGCOUNT': '54.000'} [2023-02-25 14:11:12,120][36155] DAMAGECOUNT value on done: 830754.0 [2023-02-25 14:11:12,120][36155] Sum rewards: 63.630, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.316', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.074', 'AMMO4': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.200', 'AMMO3': '0.240', 'weapon4': '0.240', 'WEAPON3': '1.350', 'HITCOUNT': '3.070', 'weapon3': '3.268', 'DAMAGECOUNT': '15.663', 'FRAGCOUNT': '56.000'} [2023-02-25 14:11:12,519][36156] DAMAGECOUNT value on done: 835557.0 [2023-02-25 14:11:12,519][36156] Sum rewards: 51.933, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.964', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon5': '0.216', 'AMMO3': '0.239', 'weapon2': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.502', 'WEAPON3': '1.450', 'weapon3': '2.702', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.274', 'FRAGCOUNT': '48.000'} [2023-02-25 14:11:12,626][36156] DAMAGECOUNT value on done: 833183.0 [2023-02-25 14:11:12,626][36156] Sum rewards: 55.084, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.740', 'AMMO5': '0.008', 'weapon5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.030', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.274', 'AMMO3': '0.275', 'WEAPON3': '1.650', 'HITCOUNT': '3.020', 'weapon3': '3.438', 'DAMAGECOUNT': '15.474', 'FRAGCOUNT': '50.500'} [2023-02-25 14:11:12,822][36156] DAMAGECOUNT value on done: 826575.0 [2023-02-25 14:11:12,822][36156] Sum rewards: 64.294, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.840', 'AMMO5': '0.004', 'AMMO2': '0.009', 'weapon4': '0.014', 'weapon5': '0.016', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.240', 'AMMO3': '0.265', 'WEAPON3': '1.700', 'HITCOUNT': '3.380', 'weapon3': '3.540', 'DAMAGECOUNT': '16.968', 'FRAGCOUNT': '56.000'} [2023-02-25 14:11:12,929][36156] DAMAGECOUNT value on done: 821115.0 [2023-02-25 14:11:12,930][36156] Sum rewards: 58.319, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.332', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.044', 'AMMO3': '0.170', 'AMMO4': '0.221', 'weapon4': '0.258', 'weapon5': '0.334', 'weapon2': '0.348', 'WEAPON4': '0.500', 'WEAPON5': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.724', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '49.000'} [2023-02-25 14:11:13,120][36155] DAMAGECOUNT value on done: 834782.0 [2023-02-25 14:11:13,120][36155] Sum rewards: 53.160, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.145', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.033', 'weapon4': '0.090', 'WEAPON4': '0.100', 'weapon2': '0.130', 'weapon5': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'WEAPON3': '1.350', 'HITCOUNT': '2.790', 'weapon3': '3.402', 'DAMAGECOUNT': '14.337', 'FRAGCOUNT': '46.000'} [2023-02-25 14:11:13,435][36155] DAMAGECOUNT value on done: 822670.0 [2023-02-25 14:11:13,436][36155] Sum rewards: 56.982, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.010', 'HEALTH': '0.017', 'AMMO2': '0.025', 'AMMO3': '0.114', 'AMMO4': '0.125', 'weapon5': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.482', 'WEAPON3': '0.700', 'weapon4': '0.972', 'weapon3': '2.044', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.977', 'FRAGCOUNT': '46.000'} [2023-02-25 14:11:13,985][36139] DAMAGECOUNT value on done: 825982.0 [2023-02-25 14:11:13,986][36139] Sum rewards: 45.534, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.202', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.114', 'AMMO3': '0.186', 'AMMO4': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.450', 'weapon4': '0.540', 'WEAPON3': '1.050', 'HITCOUNT': '2.510', 'weapon3': '2.658', 'DAMAGECOUNT': '12.510', 'FRAGCOUNT': '40.000'} [2023-02-25 14:11:14,280][36139] DAMAGECOUNT value on done: 820790.0 [2023-02-25 14:11:14,280][36139] Sum rewards: 44.577, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.589', 'ARMOR': '0.012', 'AMMO5': '0.018', 'AMMO2': '0.042', 'weapon5': '0.160', 'AMMO4': '0.210', 'AMMO3': '0.234', 'WEAPON5': '0.400', 'weapon2': '0.470', 'WEAPON4': '0.500', 'weapon4': '0.722', 'WEAPON3': '1.400', 'weapon3': '2.228', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '11.970', 'FRAGCOUNT': '43.000'} [2023-02-25 14:11:14,553][36139] DAMAGECOUNT value on done: 838118.0 [2023-02-25 14:11:14,554][36139] Sum rewards: 64.338, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.544', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.142', 'weapon4': '0.150', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.636', 'WEAPON3': '1.250', 'weapon3': '2.782', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '56.000'} [2023-02-25 14:11:14,607][36138] Updated weights for policy 0, policy_version 48333 (0.0010) [2023-02-25 14:11:14,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 197971968. Throughput: 0: 3357.7. Samples: 11987668. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:11:14,730][36114] Avg episode reward: [(0, '54.941')] [2023-02-25 14:11:14,870][36139] DAMAGECOUNT value on done: 831837.0 [2023-02-25 14:11:14,871][36139] Sum rewards: 63.725, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.576', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.127', 'weapon5': '0.144', 'weapon2': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'ARMOR': '0.404', 'weapon4': '0.618', 'WEAPON3': '1.500', 'weapon3': '2.804', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '54.000'} [2023-02-25 14:11:17,636][36138] Updated weights for policy 0, policy_version 48343 (0.0009) [2023-02-25 14:11:19,729][36114] Fps is (10 sec: 13106.8, 60 sec: 13380.2, 300 sec: 13384.9). Total num frames: 198037504. Throughput: 0: 3357.1. Samples: 12007808. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:11:19,731][36114] Avg episode reward: [(0, '55.034')] [2023-02-25 14:11:19,737][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000048349_198037504.pth... [2023-02-25 14:11:19,795][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000047565_194826240.pth [2023-02-25 14:11:20,684][36138] Updated weights for policy 0, policy_version 48353 (0.0009) [2023-02-25 14:11:23,703][36138] Updated weights for policy 0, policy_version 48363 (0.0009) [2023-02-25 14:11:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 198107136. Throughput: 0: 3357.5. Samples: 12017822. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:11:24,730][36114] Avg episode reward: [(0, '55.034')] [2023-02-25 14:11:25,597][36154] DAMAGECOUNT value on done: 830167.0 [2023-02-25 14:11:25,598][36154] Sum rewards: 49.513, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.420', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.128', 'AMMO3': '0.149', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.302', 'weapon4': '0.664', 'WEAPON3': '0.900', 'weapon3': '2.716', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.696', 'FRAGCOUNT': '41.000'} [2023-02-25 14:11:25,850][36154] DAMAGECOUNT value on done: 831249.0 [2023-02-25 14:11:25,850][36154] Sum rewards: 53.962, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.259', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.040', 'AMMO3': '0.154', 'AMMO4': '0.198', 'weapon2': '0.216', 'weapon5': '0.298', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon4': '0.810', 'WEAPON3': '0.950', 'weapon3': '2.228', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.384', 'FRAGCOUNT': '45.500'} [2023-02-25 14:11:25,920][36154] DAMAGECOUNT value on done: 817945.0 [2023-02-25 14:11:25,920][36154] Sum rewards: 58.898, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.040', 'AMMO5': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.248', 'AMMO3': '0.274', 'weapon2': '0.298', 'WEAPON3': '1.700', 'weapon3': '3.112', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.918', 'FRAGCOUNT': '54.000'} [2023-02-25 14:11:26,134][36141] DAMAGECOUNT value on done: 834187.0 [2023-02-25 14:11:26,135][36141] Sum rewards: 54.573, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.970', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.090', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.334', 'weapon2': '0.374', 'WEAPON3': '1.150', 'weapon3': '2.710', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.579', 'FRAGCOUNT': '48.000'} [2023-02-25 14:11:26,181][36154] DAMAGECOUNT value on done: 829426.0 [2023-02-25 14:11:26,181][36154] Sum rewards: 42.836, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.323', 'ARMOR': '0.004', 'AMMO5': '0.026', 'AMMO2': '0.062', 'AMMO3': '0.212', 'AMMO4': '0.311', 'weapon2': '0.330', 'weapon5': '0.332', 'weapon4': '0.798', 'WEAPON4': '0.800', 'WEAPON5': '0.800', 'WEAPON3': '1.250', 'weapon3': '2.134', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.259', 'FRAGCOUNT': '40.000'} [2023-02-25 14:11:26,435][36141] DAMAGECOUNT value on done: 826034.0 [2023-02-25 14:11:26,435][36141] Sum rewards: 47.795, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.166', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.150', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'AMMO4': '0.215', 'weapon2': '0.304', 'WEAPON4': '0.450', 'weapon4': '0.634', 'WEAPON3': '1.100', 'HITCOUNT': '2.590', 'weapon3': '2.648', 'DAMAGECOUNT': '13.185', 'FRAGCOUNT': '41.500'} [2023-02-25 14:11:26,447][36141] DAMAGECOUNT value on done: 830506.0 [2023-02-25 14:11:26,448][36141] Sum rewards: 45.458, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.821', 'ARMOR': '0.008', 'AMMO5': '0.024', 'AMMO2': '0.068', 'AMMO3': '0.216', 'weapon2': '0.266', 'weapon5': '0.308', 'AMMO4': '0.341', 'weapon4': '0.596', 'WEAPON5': '0.600', 'WEAPON4': '0.750', 'WEAPON3': '1.250', 'weapon3': '2.486', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '13.545', 'FRAGCOUNT': '44.000'} [2023-02-25 14:11:26,755][36138] Updated weights for policy 0, policy_version 48373 (0.0009) [2023-02-25 14:11:26,767][36141] DAMAGECOUNT value on done: 820677.0 [2023-02-25 14:11:26,767][36141] Sum rewards: 58.677, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.293', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.031', 'AMMO3': '0.141', 'weapon5': '0.150', 'AMMO4': '0.157', 'weapon2': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'WEAPON3': '0.850', 'weapon4': '1.044', 'weapon3': '2.374', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.819', 'FRAGCOUNT': '50.000'} [2023-02-25 14:11:27,923][36157] DAMAGECOUNT value on done: 839255.0 [2023-02-25 14:11:27,923][36157] Sum rewards: 67.162, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.655', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.030', 'AMMO4': '0.089', 'weapon5': '0.116', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.480', 'WEAPON3': '1.450', 'weapon3': '3.162', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '60.000'} [2023-02-25 14:11:28,225][36157] DAMAGECOUNT value on done: 826937.0 [2023-02-25 14:11:28,226][36157] Sum rewards: 50.902, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.796', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.044', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.204', 'AMMO3': '0.235', 'WEAPON3': '1.400', 'HITCOUNT': '2.430', 'weapon3': '3.530', 'DAMAGECOUNT': '13.326', 'FRAGCOUNT': '45.000'} [2023-02-25 14:11:28,661][36140] DAMAGECOUNT value on done: 832414.0 [2023-02-25 14:11:28,662][36140] Sum rewards: 58.581, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.266', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.038', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.202', 'AMMO3': '0.235', 'weapon2': '0.324', 'WEAPON3': '1.350', 'weapon3': '3.216', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.851', 'FRAGCOUNT': '50.000'} [2023-02-25 14:11:28,829][36157] DAMAGECOUNT value on done: 840958.0 [2023-02-25 14:11:28,829][36157] Sum rewards: 42.053, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.050', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.056', 'AMMO3': '0.234', 'weapon2': '0.252', 'weapon5': '0.282', 'AMMO4': '0.282', 'WEAPON5': '0.400', 'WEAPON4': '0.750', 'weapon4': '1.092', 'WEAPON3': '1.400', 'weapon3': '2.044', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '13.623', 'FRAGCOUNT': '41.000'} [2023-02-25 14:11:28,973][36140] DAMAGECOUNT value on done: 814794.0 [2023-02-25 14:11:28,973][36140] Sum rewards: 64.266, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.010', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.090', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'weapon4': '0.278', 'weapon2': '0.316', 'WEAPON3': '1.400', 'weapon3': '3.058', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '56.000'} [2023-02-25 14:11:29,125][36140] DAMAGECOUNT value on done: 824628.0 [2023-02-25 14:11:29,126][36140] Sum rewards: 46.742, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.105', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.267', 'weapon4': '0.426', 'weapon2': '0.480', 'WEAPON3': '1.550', 'weapon3': '2.544', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.183', 'FRAGCOUNT': '44.000'} [2023-02-25 14:11:29,127][36157] DAMAGECOUNT value on done: 833180.0 [2023-02-25 14:11:29,127][36157] Sum rewards: 49.610, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.800', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.184', 'AMMO4': '0.199', 'AMMO3': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.492', 'weapon4': '0.778', 'WEAPON3': '1.150', 'weapon3': '2.196', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '13.527', 'FRAGCOUNT': '46.000'} [2023-02-25 14:11:29,377][36154] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:11:29,429][36140] DAMAGECOUNT value on done: 826731.0 [2023-02-25 14:11:29,429][36140] Sum rewards: 60.706, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.952', 'ARMOR': '0.008', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'weapon5': '0.116', 'AMMO4': '0.151', 'AMMO3': '0.235', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.446', 'WEAPON3': '1.400', 'weapon3': '2.936', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.117', 'FRAGCOUNT': '53.000'} [2023-02-25 14:11:29,729][36114] Fps is (10 sec: 13517.2, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 198172672. Throughput: 0: 3358.2. Samples: 12037920. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:11:29,729][36114] Avg episode reward: [(0, '54.444')] [2023-02-25 14:11:29,835][36138] Updated weights for policy 0, policy_version 48383 (0.0010) [2023-02-25 14:11:31,253][36142] DAMAGECOUNT value on done: 832844.0 [2023-02-25 14:11:31,254][36142] Sum rewards: 56.131, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.206', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON4': '0.200', 'AMMO3': '0.268', 'weapon2': '0.324', 'weapon4': '0.436', 'WEAPON3': '1.500', 'weapon3': '3.012', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '51.000'} [2023-02-25 14:11:31,541][36142] DAMAGECOUNT value on done: 824109.0 [2023-02-25 14:11:31,541][36142] Sum rewards: 50.645, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.807', 'ARMOR': '0.004', 'AMMO2': '0.010', 'AMMO5': '0.011', 'AMMO4': '0.051', 'weapon5': '0.190', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon2': '0.254', 'WEAPON5': '0.300', 'weapon4': '0.686', 'WEAPON3': '1.250', 'weapon3': '2.660', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.831', 'FRAGCOUNT': '44.000'} [2023-02-25 14:11:31,560][36142] DAMAGECOUNT value on done: 816907.0 [2023-02-25 14:11:31,561][36142] Sum rewards: 54.671, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.163', 'ARMOR': '0.016', 'AMMO5': '0.020', 'AMMO2': '0.078', 'AMMO3': '0.170', 'weapon2': '0.340', 'weapon5': '0.364', 'AMMO4': '0.390', 'WEAPON5': '0.600', 'WEAPON4': '0.800', 'weapon4': '0.974', 'WEAPON3': '1.000', 'weapon3': '1.964', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.198', 'FRAGCOUNT': '49.000'} [2023-02-25 14:11:31,822][36155] DAMAGECOUNT value on done: 824207.0 [2023-02-25 14:11:31,822][36155] Sum rewards: 53.469, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.848', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.037', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.174', 'weapon2': '0.178', 'AMMO4': '0.184', 'WEAPON4': '0.350', 'weapon4': '0.410', 'WEAPON3': '1.100', 'HITCOUNT': '2.660', 'weapon3': '3.154', 'DAMAGECOUNT': '12.891', 'FRAGCOUNT': '49.000'} [2023-02-25 14:11:31,857][36142] DAMAGECOUNT value on done: 836698.0 [2023-02-25 14:11:31,857][36142] Sum rewards: 50.850, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.185', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.132', 'AMMO4': '0.174', 'AMMO3': '0.199', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON4': '0.350', 'weapon4': '0.386', 'WEAPON3': '1.200', 'HITCOUNT': '2.610', 'weapon3': '2.902', 'DAMAGECOUNT': '12.735', 'FRAGCOUNT': '46.000'} [2023-02-25 14:11:32,137][36155] DAMAGECOUNT value on done: 835732.0 [2023-02-25 14:11:32,138][36155] Sum rewards: 60.158, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.370', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon4': '0.410', 'weapon2': '0.496', 'WEAPON3': '1.050', 'weapon3': '2.842', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.934', 'FRAGCOUNT': '50.000'} [2023-02-25 14:11:32,486][36156] DAMAGECOUNT value on done: 840991.0 [2023-02-25 14:11:32,487][36156] Sum rewards: 59.399, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.870', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.080', 'AMMO4': '0.149', 'weapon5': '0.162', 'AMMO3': '0.216', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.704', 'WEAPON3': '1.300', 'weapon3': '2.818', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '52.000'} [2023-02-25 14:11:32,568][36156] DAMAGECOUNT value on done: 837851.0 [2023-02-25 14:11:32,568][36156] Sum rewards: 55.932, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.367', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.052', 'AMMO3': '0.171', 'weapon4': '0.172', 'AMMO4': '0.262', 'weapon5': '0.288', 'weapon2': '0.360', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.690', 'weapon3': '2.932', 'DAMAGECOUNT': '14.004', 'FRAGCOUNT': '49.000'} [2023-02-25 14:11:32,804][36156] DAMAGECOUNT value on done: 831163.0 [2023-02-25 14:11:32,804][36156] Sum rewards: 50.698, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.680', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.042', 'weapon5': '0.110', 'AMMO4': '0.209', 'weapon4': '0.256', 'AMMO3': '0.261', 'weapon2': '0.376', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.968', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.764', 'FRAGCOUNT': '47.500'} [2023-02-25 14:11:32,871][36138] Updated weights for policy 0, policy_version 48393 (0.0009) [2023-02-25 14:11:32,889][36156] DAMAGECOUNT value on done: 826748.0 [2023-02-25 14:11:32,890][36156] Sum rewards: 63.560, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.722', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO3': '0.162', 'AMMO4': '0.174', 'weapon5': '0.272', 'WEAPON4': '0.300', 'weapon2': '0.302', 'weapon4': '0.372', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'weapon3': '2.748', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '52.000'} [2023-02-25 14:11:33,149][36155] DAMAGECOUNT value on done: 839039.0 [2023-02-25 14:11:33,150][36155] Sum rewards: 45.203, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.910', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.061', 'AMMO3': '0.211', 'weapon5': '0.248', 'AMMO4': '0.306', 'weapon2': '0.420', 'weapon4': '0.422', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.536', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '12.771', 'FRAGCOUNT': '44.000'} [2023-02-25 14:11:33,463][36155] DAMAGECOUNT value on done: 827479.0 [2023-02-25 14:11:33,463][36155] Sum rewards: 56.996, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.426', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO3': '0.139', 'weapon5': '0.190', 'AMMO4': '0.195', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.426', 'weapon4': '0.456', 'WEAPON3': '0.800', 'weapon3': '2.680', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.427', 'FRAGCOUNT': '47.000'} [2023-02-25 14:11:33,912][36139] DAMAGECOUNT value on done: 830006.0 [2023-02-25 14:11:33,913][36139] Sum rewards: 42.627, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.332', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.051', 'AMMO3': '0.211', 'weapon2': '0.218', 'AMMO4': '0.257', 'weapon5': '0.382', 'WEAPON5': '0.450', 'weapon4': '0.622', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'HITCOUNT': '2.410', 'weapon3': '2.416', 'DAMAGECOUNT': '12.072', 'FRAGCOUNT': '39.000'} [2023-02-25 14:11:34,218][36139] DAMAGECOUNT value on done: 825355.0 [2023-02-25 14:11:34,218][36139] Sum rewards: 53.235, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.120', 'ARMOR': '0.008', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon4': '0.030', 'weapon5': '0.082', 'AMMO4': '0.110', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.446', 'WEAPON3': '1.150', 'HITCOUNT': '2.690', 'weapon3': '3.208', 'DAMAGECOUNT': '13.695', 'FRAGCOUNT': '47.500'} [2023-02-25 14:11:34,520][36139] DAMAGECOUNT value on done: 843234.0 [2023-02-25 14:11:34,521][36139] Sum rewards: 57.041, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.612', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'weapon4': '0.150', 'AMMO3': '0.234', 'weapon2': '0.238', 'WEAPON3': '1.400', 'HITCOUNT': '3.050', 'weapon3': '3.246', 'DAMAGECOUNT': '15.348', 'FRAGCOUNT': '49.500'} [2023-02-25 14:11:34,729][36114] Fps is (10 sec: 13517.0, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 198242304. Throughput: 0: 3360.5. Samples: 12058176. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:11:34,729][36114] Avg episode reward: [(0, '54.957')] [2023-02-25 14:11:34,834][36139] DAMAGECOUNT value on done: 836055.0 [2023-02-25 14:11:34,835][36139] Sum rewards: 55.600, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.892', 'AMMO5': '0.005', 'AMMO2': '0.044', 'weapon5': '0.048', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon4': '0.210', 'AMMO4': '0.222', 'WEAPON4': '0.450', 'weapon2': '0.540', 'WEAPON3': '0.900', 'HITCOUNT': '2.830', 'weapon3': '3.032', 'DAMAGECOUNT': '12.654', 'FRAGCOUNT': '48.000'} [2023-02-25 14:11:34,985][36139] Large shaping reward 2.579 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.549, 183.0)] [2023-02-25 14:11:35,887][36138] Updated weights for policy 0, policy_version 48403 (0.0009) [2023-02-25 14:11:38,922][36138] Updated weights for policy 0, policy_version 48413 (0.0010) [2023-02-25 14:11:39,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13398.8). Total num frames: 198307840. Throughput: 0: 3360.8. Samples: 12068336. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:11:39,729][36114] Avg episode reward: [(0, '54.875')] [2023-02-25 14:11:41,035][36157] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:11:41,992][36138] Updated weights for policy 0, policy_version 48423 (0.0009) [2023-02-25 14:11:44,729][36114] Fps is (10 sec: 13107.0, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 198373376. Throughput: 0: 3357.7. Samples: 12088440. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:11:44,730][36114] Avg episode reward: [(0, '54.875')] [2023-02-25 14:11:45,050][36138] Updated weights for policy 0, policy_version 48433 (0.0009) [2023-02-25 14:11:45,594][36154] DAMAGECOUNT value on done: 835582.0 [2023-02-25 14:11:45,594][36154] Sum rewards: 57.769, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.716', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.063', 'weapon5': '0.258', 'AMMO3': '0.261', 'weapon2': '0.276', 'AMMO4': '0.317', 'weapon4': '0.432', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.688', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '53.000'} [2023-02-25 14:11:45,877][36154] DAMAGECOUNT value on done: 836383.0 [2023-02-25 14:11:45,877][36154] Sum rewards: 60.164, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.048', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO4': '0.116', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon2': '0.220', 'weapon4': '0.426', 'WEAPON3': '1.150', 'weapon3': '3.024', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.402', 'FRAGCOUNT': '51.000'} [2023-02-25 14:11:45,944][36154] DAMAGECOUNT value on done: 822811.0 [2023-02-25 14:11:45,945][36154] Sum rewards: 53.738, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.586', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO4': '0.181', 'AMMO3': '0.206', 'weapon5': '0.246', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.424', 'weapon4': '0.620', 'WEAPON3': '1.300', 'weapon3': '2.316', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.598', 'FRAGCOUNT': '47.000'} [2023-02-25 14:11:46,115][36141] DAMAGECOUNT value on done: 839213.0 [2023-02-25 14:11:46,116][36141] Sum rewards: 57.561, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.353', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.152', 'AMMO4': '0.218', 'AMMO3': '0.232', 'weapon4': '0.250', 'weapon2': '0.360', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.930', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.078', 'FRAGCOUNT': '49.000'} [2023-02-25 14:11:46,215][36154] DAMAGECOUNT value on done: 834788.0 [2023-02-25 14:11:46,216][36154] Sum rewards: 67.455, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.220', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON5': '0.050', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon2': '0.206', 'weapon4': '0.406', 'WEAPON3': '1.200', 'weapon3': '3.202', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.086', 'FRAGCOUNT': '58.000'} [2023-02-25 14:11:46,411][36141] DAMAGECOUNT value on done: 831252.0 [2023-02-25 14:11:46,412][36141] Sum rewards: 63.769, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.774', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO3': '0.226', 'weapon2': '0.660', 'WEAPON3': '1.450', 'weapon3': '3.204', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.654', 'FRAGCOUNT': '54.000'} [2023-02-25 14:11:46,432][36141] DAMAGECOUNT value on done: 836501.0 [2023-02-25 14:11:46,433][36141] Sum rewards: 75.348, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.970', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon4': '0.032', 'weapon5': '0.082', 'AMMO4': '0.138', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.340', 'WEAPON3': '1.100', 'weapon3': '3.344', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '62.000'} [2023-02-25 14:11:46,727][36141] DAMAGECOUNT value on done: 826307.0 [2023-02-25 14:11:46,728][36141] Sum rewards: 75.301, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.262', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon5': '0.074', 'AMMO4': '0.110', 'weapon4': '0.174', 'weapon2': '0.180', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.100', 'weapon3': '3.330', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '64.000'} [2023-02-25 14:11:47,943][36157] DAMAGECOUNT value on done: 844315.0 [2023-02-25 14:11:47,943][36157] Sum rewards: 62.585, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.946', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.154', 'AMMO4': '0.165', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.342', 'weapon2': '0.438', 'WEAPON3': '1.250', 'weapon3': '2.688', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '55.000'} [2023-02-25 14:11:48,140][36138] Updated weights for policy 0, policy_version 48443 (0.0009) [2023-02-25 14:11:48,244][36157] DAMAGECOUNT value on done: 832329.0 [2023-02-25 14:11:48,245][36157] Sum rewards: 59.717, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.492', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon4': '0.160', 'AMMO4': '0.178', 'weapon5': '0.188', 'weapon2': '0.224', 'AMMO3': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '2.940', 'weapon3': '3.154', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '53.000'} [2023-02-25 14:11:48,695][36140] DAMAGECOUNT value on done: 837262.0 [2023-02-25 14:11:48,696][36140] Sum rewards: 50.080, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.420', 'AMMO5': '0.016', 'AMMO2': '0.059', 'AMMO3': '0.218', 'weapon5': '0.228', 'weapon2': '0.282', 'AMMO4': '0.297', 'WEAPON5': '0.450', 'weapon4': '0.470', 'WEAPON4': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.696', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.244', 'FRAGCOUNT': '47.000'} [2023-02-25 14:11:48,903][36157] DAMAGECOUNT value on done: 846465.0 [2023-02-25 14:11:48,904][36157] Sum rewards: 64.615, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-2.580', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.140', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.252', 'AMMO3': '0.327', 'weapon2': '0.416', 'WEAPON3': '1.800', 'weapon3': '2.848', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.521', 'FRAGCOUNT': '62.000'} [2023-02-25 14:11:49,016][36140] DAMAGECOUNT value on done: 819944.0 [2023-02-25 14:11:49,017][36140] Sum rewards: 57.799, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.104', 'AMMO5': '0.005', 'weapon5': '0.024', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.214', 'weapon2': '0.318', 'WEAPON4': '0.350', 'ARMOR': '0.456', 'weapon4': '0.724', 'WEAPON3': '1.300', 'weapon3': '2.700', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '50.500'} [2023-02-25 14:11:49,195][36140] DAMAGECOUNT value on done: 829928.0 [2023-02-25 14:11:49,195][36140] Sum rewards: 64.195, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.344', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon5': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.204', 'weapon2': '0.368', 'WEAPON3': '1.250', 'HITCOUNT': '3.060', 'weapon3': '3.228', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '56.000'} [2023-02-25 14:11:49,224][36157] DAMAGECOUNT value on done: 838262.0 [2023-02-25 14:11:49,224][36157] Sum rewards: 57.152, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.114', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.030', 'AMMO4': '0.147', 'AMMO3': '0.158', 'weapon5': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.342', 'weapon4': '0.504', 'WEAPON3': '0.950', 'weapon3': '2.756', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.246', 'FRAGCOUNT': '48.000'} [2023-02-25 14:11:49,521][36140] DAMAGECOUNT value on done: 830894.0 [2023-02-25 14:11:49,521][36140] Sum rewards: 43.425, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.640', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon5': '0.180', 'AMMO3': '0.215', 'AMMO4': '0.276', 'weapon2': '0.328', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.602', 'WEAPON3': '1.200', 'weapon3': '2.598', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '12.489', 'FRAGCOUNT': '40.000'} [2023-02-25 14:11:49,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13412.7). Total num frames: 198443008. Throughput: 0: 3355.9. Samples: 12108410. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:11:49,729][36114] Avg episode reward: [(0, '55.606')] [2023-02-25 14:11:51,202][36138] Updated weights for policy 0, policy_version 48453 (0.0009) [2023-02-25 14:11:51,322][36142] DAMAGECOUNT value on done: 839255.0 [2023-02-25 14:11:51,323][36142] Sum rewards: 71.819, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.410', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.056', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.158', 'weapon2': '0.198', 'AMMO3': '0.240', 'WEAPON3': '1.400', 'weapon3': '3.386', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.233', 'FRAGCOUNT': '61.000'} [2023-02-25 14:11:51,641][36142] DAMAGECOUNT value on done: 828407.0 [2023-02-25 14:11:51,641][36142] Sum rewards: 48.303, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.087', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.100', 'AMMO3': '0.160', 'weapon2': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'weapon4': '1.010', 'weapon3': '2.428', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.894', 'FRAGCOUNT': '41.000'} [2023-02-25 14:11:51,650][36142] DAMAGECOUNT value on done: 820903.0 [2023-02-25 14:11:51,651][36142] Sum rewards: 40.365, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.197', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.045', 'AMMO3': '0.153', 'weapon5': '0.172', 'AMMO4': '0.227', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.674', 'weapon4': '0.882', 'WEAPON3': '0.950', 'weapon3': '2.036', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '11.988', 'FRAGCOUNT': '36.000'} [2023-02-25 14:11:51,801][36155] DAMAGECOUNT value on done: 829153.0 [2023-02-25 14:11:51,802][36155] Sum rewards: 52.185, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.570', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.072', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.450', 'weapon4': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.708', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.838', 'FRAGCOUNT': '48.000'} [2023-02-25 14:11:51,932][36142] DAMAGECOUNT value on done: 841797.0 [2023-02-25 14:11:51,932][36142] Sum rewards: 56.363, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.368', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon4': '0.186', 'weapon5': '0.194', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.478', 'WEAPON3': '1.400', 'weapon3': '2.804', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '15.297', 'FRAGCOUNT': '50.000'} [2023-02-25 14:11:52,117][36155] DAMAGECOUNT value on done: 841355.0 [2023-02-25 14:11:52,118][36155] Sum rewards: 64.873, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.694', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO4': '0.193', 'AMMO3': '0.197', 'weapon5': '0.218', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON4': '0.350', 'weapon4': '0.590', 'WEAPON3': '1.150', 'weapon3': '2.558', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.869', 'FRAGCOUNT': '56.000'} [2023-02-25 14:11:52,592][36156] DAMAGECOUNT value on done: 846210.0 [2023-02-25 14:11:52,592][36156] Sum rewards: 58.838, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.674', 'AMMO5': '0.011', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.178', 'weapon5': '0.192', 'weapon2': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.826', 'WEAPON3': '1.200', 'weapon3': '2.530', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.657', 'FRAGCOUNT': '48.000'} [2023-02-25 14:11:52,670][36156] DAMAGECOUNT value on done: 842760.0 [2023-02-25 14:11:52,671][36156] Sum rewards: 55.725, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.725', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.061', 'AMMO3': '0.129', 'weapon2': '0.256', 'weapon5': '0.256', 'AMMO4': '0.305', 'WEAPON5': '0.550', 'WEAPON4': '0.700', 'WEAPON3': '0.800', 'weapon4': '0.948', 'weapon3': '2.072', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.727', 'FRAGCOUNT': '47.000'} [2023-02-25 14:11:52,913][36156] DAMAGECOUNT value on done: 836789.0 [2023-02-25 14:11:52,913][36156] Sum rewards: 69.935, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.955', 'AMMO5': '0.009', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.124', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon2': '0.216', 'WEAPON5': '0.250', 'weapon4': '0.564', 'WEAPON3': '1.100', 'weapon3': '2.866', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.878', 'FRAGCOUNT': '57.000'} [2023-02-25 14:11:52,980][36156] DAMAGECOUNT value on done: 830734.0 [2023-02-25 14:11:52,981][36156] Sum rewards: 42.877, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.304', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.096', 'AMMO3': '0.159', 'AMMO4': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.606', 'weapon2': '0.642', 'WEAPON3': '1.000', 'weapon3': '2.414', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '11.958', 'FRAGCOUNT': '37.000'} [2023-02-25 14:11:53,148][36155] DAMAGECOUNT value on done: 843016.0 [2023-02-25 14:11:53,149][36155] Sum rewards: 48.764, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.994', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.102', 'AMMO3': '0.198', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.420', 'weapon2': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '2.770', 'weapon3': '2.856', 'DAMAGECOUNT': '11.931', 'FRAGCOUNT': '43.000'} [2023-02-25 14:11:53,450][36155] DAMAGECOUNT value on done: 831794.0 [2023-02-25 14:11:53,450][36155] Sum rewards: 47.995, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.705', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.017', 'weapon5': '0.048', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.208', 'AMMO3': '0.233', 'weapon2': '0.288', 'WEAPON3': '1.400', 'HITCOUNT': '2.930', 'weapon3': '3.238', 'DAMAGECOUNT': '12.945', 'FRAGCOUNT': '44.000'} [2023-02-25 14:11:53,885][36139] DAMAGECOUNT value on done: 834710.0 [2023-02-25 14:11:53,886][36139] Sum rewards: 42.320, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.390', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.057', 'AMMO3': '0.200', 'AMMO4': '0.286', 'weapon5': '0.302', 'weapon2': '0.332', 'WEAPON5': '0.550', 'weapon4': '0.608', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.426', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '13.941', 'FRAGCOUNT': '38.000'} [2023-02-25 14:11:54,194][36139] DAMAGECOUNT value on done: 829040.0 [2023-02-25 14:11:54,195][36139] Sum rewards: 36.679, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.474', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'weapon2': '0.166', 'AMMO3': '0.235', 'weapon4': '0.722', 'WEAPON3': '1.350', 'HITCOUNT': '2.340', 'weapon3': '2.748', 'DAMAGECOUNT': '11.055', 'FRAGCOUNT': '34.000'} [2023-02-25 14:11:54,242][36138] Updated weights for policy 0, policy_version 48463 (0.0009) [2023-02-25 14:11:54,596][36139] DAMAGECOUNT value on done: 847610.0 [2023-02-25 14:11:54,597][36139] Sum rewards: 47.042, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.685', 'AMMO5': '0.010', 'weapon5': '0.018', 'AMMO2': '0.030', 'AMMO4': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.426', 'ARMOR': '0.463', 'WEAPON4': '0.500', 'weapon4': '0.688', 'WEAPON3': '1.250', 'weapon3': '2.428', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.128', 'FRAGCOUNT': '43.000'} [2023-02-25 14:11:54,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 198508544. Throughput: 0: 3354.7. Samples: 12118464. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:11:54,730][36114] Avg episode reward: [(0, '55.096')] [2023-02-25 14:11:54,907][36139] DAMAGECOUNT value on done: 840905.0 [2023-02-25 14:11:54,907][36139] Sum rewards: 55.860, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.347', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.050', 'AMMO4': '0.172', 'weapon2': '0.214', 'weapon5': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.268', 'WEAPON3': '1.600', 'HITCOUNT': '2.800', 'weapon3': '3.282', 'DAMAGECOUNT': '14.550', 'FRAGCOUNT': '52.000'} [2023-02-25 14:11:57,278][36138] Updated weights for policy 0, policy_version 48473 (0.0009) [2023-02-25 14:11:59,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 198574080. Throughput: 0: 3354.6. Samples: 12138626. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:11:59,730][36114] Avg episode reward: [(0, '55.178')] [2023-02-25 14:12:00,358][36138] Updated weights for policy 0, policy_version 48483 (0.0010) [2023-02-25 14:12:00,487][36140] Large shaping reward 2.571 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.549, 183.0), ('weapon5', 0.002)] [2023-02-25 14:12:03,397][36138] Updated weights for policy 0, policy_version 48493 (0.0009) [2023-02-25 14:12:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 198643712. Throughput: 0: 3355.0. Samples: 12158780. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:12:04,730][36114] Avg episode reward: [(0, '55.178')] [2023-02-25 14:12:05,554][36154] DAMAGECOUNT value on done: 840450.0 [2023-02-25 14:12:05,554][36154] Sum rewards: 58.375, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.890', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon2': '0.402', 'weapon4': '1.024', 'WEAPON3': '1.050', 'weapon3': '2.264', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.439', 'FRAGCOUNT': '49.000'} [2023-02-25 14:12:05,826][36154] DAMAGECOUNT value on done: 841144.0 [2023-02-25 14:12:05,827][36154] Sum rewards: 55.177, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.120', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.028', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'weapon5': '0.188', 'AMMO3': '0.217', 'weapon4': '0.318', 'WEAPON4': '0.350', 'weapon2': '0.468', 'WEAPON3': '1.300', 'weapon3': '2.834', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.274', 'FRAGCOUNT': '50.000'} [2023-02-25 14:12:05,882][36154] DAMAGECOUNT value on done: 827385.0 [2023-02-25 14:12:05,882][36154] Sum rewards: 55.223, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.856', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.038', 'AMMO3': '0.115', 'AMMO4': '0.188', 'weapon5': '0.246', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.354', 'weapon4': '0.604', 'WEAPON3': '0.800', 'weapon3': '2.480', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.722', 'FRAGCOUNT': '44.000'} [2023-02-25 14:12:06,155][36154] DAMAGECOUNT value on done: 838654.0 [2023-02-25 14:12:06,156][36154] Sum rewards: 45.322, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.878', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.063', 'AMMO3': '0.120', 'weapon5': '0.288', 'AMMO4': '0.316', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.674', 'WEAPON3': '0.700', 'weapon2': '0.796', 'weapon3': '2.002', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '11.598', 'FRAGCOUNT': '38.000'} [2023-02-25 14:12:06,203][36156] Large shaping reward 2.523 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.501, 167.0), ('weapon5', 0.002)] [2023-02-25 14:12:06,224][36141] DAMAGECOUNT value on done: 843943.0 [2023-02-25 14:12:06,225][36141] Sum rewards: 62.475, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.310', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.242', 'weapon2': '0.316', 'WEAPON3': '1.200', 'HITCOUNT': '3.170', 'weapon3': '3.264', 'DAMAGECOUNT': '14.190', 'FRAGCOUNT': '53.000'} [2023-02-25 14:12:06,468][36138] Updated weights for policy 0, policy_version 48503 (0.0010) [2023-02-25 14:12:06,558][36141] DAMAGECOUNT value on done: 836295.0 [2023-02-25 14:12:06,558][36141] Sum rewards: 56.528, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.598', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.046', 'AMMO3': '0.183', 'weapon2': '0.212', 'weapon5': '0.218', 'AMMO4': '0.228', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'weapon4': '0.798', 'WEAPON3': '1.100', 'weapon3': '2.408', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.129', 'FRAGCOUNT': '51.000'} [2023-02-25 14:12:06,568][36141] DAMAGECOUNT value on done: 841141.0 [2023-02-25 14:12:06,569][36141] Sum rewards: 50.920, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.646', 'AMMO5': '0.013', 'AMMO2': '0.053', 'AMMO3': '0.167', 'AMMO4': '0.264', 'weapon5': '0.284', 'weapon4': '0.386', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.656', 'WEAPON3': '1.000', 'weapon3': '2.452', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '13.500', 'FRAGCOUNT': '43.000'} [2023-02-25 14:12:06,887][36141] DAMAGECOUNT value on done: 831420.0 [2023-02-25 14:12:06,887][36141] Sum rewards: 57.468, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.750', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon5': '0.106', 'AMMO4': '0.146', 'AMMO3': '0.162', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.560', 'weapon2': '0.614', 'WEAPON3': '1.000', 'weapon3': '2.486', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.339', 'FRAGCOUNT': '50.000'} [2023-02-25 14:12:08,041][36157] DAMAGECOUNT value on done: 848585.0 [2023-02-25 14:12:08,041][36157] Sum rewards: 47.002, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.932', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon2': '0.164', 'weapon5': '0.180', 'AMMO3': '0.188', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.716', 'WEAPON3': '1.150', 'HITCOUNT': '2.520', 'weapon3': '2.720', 'DAMAGECOUNT': '12.810', 'FRAGCOUNT': '42.000'} [2023-02-25 14:12:08,342][36157] DAMAGECOUNT value on done: 837649.0 [2023-02-25 14:12:08,343][36157] Sum rewards: 58.191, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.196', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.076', 'weapon4': '0.130', 'WEAPON4': '0.150', 'weapon2': '0.270', 'AMMO3': '0.303', 'WEAPON3': '1.700', 'weapon3': '3.266', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '53.000'} [2023-02-25 14:12:08,802][36140] DAMAGECOUNT value on done: 841639.0 [2023-02-25 14:12:08,802][36140] Sum rewards: 43.487, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.650', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon5': '0.214', 'AMMO3': '0.259', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.406', 'weapon2': '0.470', 'WEAPON3': '1.500', 'weapon3': '2.538', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '13.131', 'FRAGCOUNT': '42.000'} [2023-02-25 14:12:08,982][36157] DAMAGECOUNT value on done: 850787.0 [2023-02-25 14:12:08,983][36157] Sum rewards: 45.940, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.360', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.056', 'AMMO4': '0.058', 'weapon4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.277', 'weapon2': '0.538', 'WEAPON3': '1.750', 'HITCOUNT': '2.940', 'weapon3': '3.024', 'DAMAGECOUNT': '12.966', 'FRAGCOUNT': '44.000'} [2023-02-25 14:12:09,111][36140] DAMAGECOUNT value on done: 825677.0 [2023-02-25 14:12:09,112][36140] Sum rewards: 72.186, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.710', 'AMMO5': '0.006', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.088', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.100', 'weapon3': '3.016', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '60.000'} [2023-02-25 14:12:09,291][36157] DAMAGECOUNT value on done: 842636.0 [2023-02-25 14:12:09,292][36157] Sum rewards: 51.214, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.230', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.059', 'weapon5': '0.154', 'AMMO3': '0.176', 'weapon2': '0.288', 'AMMO4': '0.293', 'WEAPON5': '0.600', 'weapon4': '0.652', 'WEAPON4': '0.700', 'WEAPON3': '1.050', 'weapon3': '2.632', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.122', 'FRAGCOUNT': '46.000'} [2023-02-25 14:12:09,295][36140] DAMAGECOUNT value on done: 835081.0 [2023-02-25 14:12:09,295][36140] Sum rewards: 52.523, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.868', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.176', 'weapon2': '0.240', 'AMMO3': '0.257', 'WEAPON3': '1.650', 'HITCOUNT': '3.170', 'weapon3': '3.192', 'DAMAGECOUNT': '15.459', 'FRAGCOUNT': '48.000'} [2023-02-25 14:12:09,507][36138] Updated weights for policy 0, policy_version 48513 (0.0009) [2023-02-25 14:12:09,610][36140] DAMAGECOUNT value on done: 835821.0 [2023-02-25 14:12:09,611][36140] Sum rewards: 56.067, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.800', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.104', 'AMMO3': '0.219', 'weapon4': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.434', 'WEAPON3': '1.350', 'weapon3': '2.994', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.781', 'FRAGCOUNT': '49.000'} [2023-02-25 14:12:09,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 198709248. Throughput: 0: 3353.6. Samples: 12168736. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:12:09,730][36114] Avg episode reward: [(0, '54.799')] [2023-02-25 14:12:11,288][36142] DAMAGECOUNT value on done: 843799.0 [2023-02-25 14:12:11,288][36142] Sum rewards: 49.379, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.430', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO3': '0.131', 'AMMO4': '0.191', 'weapon5': '0.268', 'weapon2': '0.434', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.644', 'WEAPON3': '0.900', 'weapon3': '2.402', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.632', 'FRAGCOUNT': '42.000'} [2023-02-25 14:12:11,601][36142] DAMAGECOUNT value on done: 825012.0 [2023-02-25 14:12:11,602][36142] Sum rewards: 51.478, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.340', 'AMMO5': '0.006', 'AMMO2': '0.053', 'weapon7': '0.064', 'weapon5': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'AMMO4': '0.262', 'weapon2': '0.316', 'weapon4': '0.612', 'WEAPON3': '1.200', 'weapon3': '2.416', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '12.327', 'FRAGCOUNT': '45.000'} [2023-02-25 14:12:11,634][36142] DAMAGECOUNT value on done: 832613.0 [2023-02-25 14:12:11,635][36142] Sum rewards: 41.862, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.944', 'AMMO5': '0.022', 'AMMO2': '0.065', 'AMMO3': '0.166', 'weapon5': '0.238', 'AMMO4': '0.325', 'WEAPON5': '0.550', 'weapon2': '0.590', 'WEAPON4': '0.700', 'weapon4': '0.750', 'WEAPON3': '0.950', 'weapon3': '2.076', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.603', 'FRAGCOUNT': '40.000'} [2023-02-25 14:12:11,787][36155] DAMAGECOUNT value on done: 833359.0 [2023-02-25 14:12:11,787][36155] Sum rewards: 46.640, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.070', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.156', 'weapon2': '0.182', 'WEAPON4': '0.250', 'weapon4': '0.290', 'AMMO3': '0.293', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '2.770', 'weapon3': '3.064', 'DAMAGECOUNT': '12.618', 'FRAGCOUNT': '46.000'} [2023-02-25 14:12:11,935][36142] DAMAGECOUNT value on done: 846562.0 [2023-02-25 14:12:11,935][36142] Sum rewards: 60.326, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.212', 'AMMO5': '0.008', 'AMMO2': '0.043', 'AMMO4': '0.212', 'AMMO3': '0.214', 'weapon4': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.266', 'weapon2': '0.320', 'WEAPON3': '1.250', 'weapon3': '2.952', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.295', 'FRAGCOUNT': '51.000'} [2023-02-25 14:12:12,101][36155] DAMAGECOUNT value on done: 846219.0 [2023-02-25 14:12:12,102][36155] Sum rewards: 57.762, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.010', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.082', 'AMMO4': '0.155', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.652', 'weapon4': '0.672', 'WEAPON3': '1.000', 'weapon3': '2.362', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.592', 'FRAGCOUNT': '49.000'} [2023-02-25 14:12:12,548][36138] Updated weights for policy 0, policy_version 48523 (0.0010) [2023-02-25 14:12:12,669][36156] DAMAGECOUNT value on done: 850992.0 [2023-02-25 14:12:12,670][36156] Sum rewards: 54.853, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.734', 'AMMO5': '0.012', 'ARMOR': '0.012', 'AMMO2': '0.051', 'AMMO3': '0.191', 'weapon5': '0.220', 'weapon2': '0.232', 'AMMO4': '0.255', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.690', 'WEAPON3': '1.100', 'weapon3': '2.578', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.346', 'FRAGCOUNT': '49.000'} [2023-02-25 14:12:12,740][36156] DAMAGECOUNT value on done: 847759.0 [2023-02-25 14:12:12,741][36156] Sum rewards: 53.710, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.490', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.149', 'weapon5': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.312', 'weapon4': '0.320', 'WEAPON3': '1.000', 'weapon3': '2.900', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.997', 'FRAGCOUNT': '42.000'} [2023-02-25 14:12:12,996][36156] DAMAGECOUNT value on done: 842203.0 [2023-02-25 14:12:12,997][36156] Sum rewards: 66.670, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.532', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'weapon4': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'weapon2': '0.494', 'WEAPON3': '0.900', 'weapon3': '3.122', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.242', 'FRAGCOUNT': '53.000'} [2023-02-25 14:12:13,067][36156] DAMAGECOUNT value on done: 835677.0 [2023-02-25 14:12:13,068][36156] Sum rewards: 55.813, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.170', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.188', 'weapon5': '0.318', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.482', 'weapon4': '0.814', 'WEAPON3': '1.150', 'weapon3': '2.112', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.829', 'FRAGCOUNT': '48.500'} [2023-02-25 14:12:13,134][36155] DAMAGECOUNT value on done: 847405.0 [2023-02-25 14:12:13,135][36155] Sum rewards: 50.248, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.450', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.116', 'weapon5': '0.124', 'weapon4': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'weapon2': '0.836', 'weapon3': '2.602', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '13.167', 'FRAGCOUNT': '40.000'} [2023-02-25 14:12:13,433][36155] DAMAGECOUNT value on done: 836793.0 [2023-02-25 14:12:13,434][36155] Sum rewards: 56.142, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.110', 'AMMO5': '0.004', 'AMMO2': '0.014', 'weapon4': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'AMMO3': '0.220', 'weapon2': '0.318', 'WEAPON3': '1.400', 'HITCOUNT': '3.070', 'weapon3': '3.426', 'DAMAGECOUNT': '14.952', 'FRAGCOUNT': '48.000'} [2023-02-25 14:12:13,928][36139] DAMAGECOUNT value on done: 839850.0 [2023-02-25 14:12:13,928][36139] Sum rewards: 67.717, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.250', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.104', 'AMMO3': '0.144', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.488', 'weapon2': '0.548', 'WEAPON3': '0.900', 'weapon3': '2.628', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '56.000'} [2023-02-25 14:12:14,248][36139] DAMAGECOUNT value on done: 833219.0 [2023-02-25 14:12:14,249][36139] Sum rewards: 46.729, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.842', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon2': '0.136', 'weapon5': '0.136', 'AMMO4': '0.136', 'AMMO3': '0.147', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.712', 'WEAPON3': '0.900', 'HITCOUNT': '2.690', 'weapon3': '2.788', 'DAMAGECOUNT': '12.537', 'FRAGCOUNT': '39.000'} [2023-02-25 14:12:14,624][36139] DAMAGECOUNT value on done: 852448.0 [2023-02-25 14:12:14,624][36139] Sum rewards: 59.658, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.412', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon2': '0.208', 'weapon5': '0.238', 'AMMO3': '0.243', 'AMMO4': '0.251', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.502', 'WEAPON3': '1.400', 'weapon3': '2.760', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.514', 'FRAGCOUNT': '55.000'} [2023-02-25 14:12:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13412.7). Total num frames: 198778880. Throughput: 0: 3355.6. Samples: 12188920. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:12:14,729][36114] Avg episode reward: [(0, '54.908')] [2023-02-25 14:12:14,932][36139] DAMAGECOUNT value on done: 845618.0 [2023-02-25 14:12:14,933][36139] Sum rewards: 53.455, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.277', 'AMMO5': '0.030', 'AMMO2': '0.052', 'AMMO3': '0.113', 'weapon5': '0.252', 'AMMO4': '0.261', 'weapon2': '0.332', 'WEAPON5': '0.650', 'WEAPON3': '0.700', 'WEAPON4': '0.750', 'weapon4': '0.950', 'weapon3': '2.112', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.139', 'FRAGCOUNT': '46.000'} [2023-02-25 14:12:15,618][36138] Updated weights for policy 0, policy_version 48533 (0.0009) [2023-02-25 14:12:18,692][36138] Updated weights for policy 0, policy_version 48543 (0.0009) [2023-02-25 14:12:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13398.8). Total num frames: 198844416. Throughput: 0: 3352.4. Samples: 12209032. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:12:19,730][36114] Avg episode reward: [(0, '54.873')] [2023-02-25 14:12:21,708][36138] Updated weights for policy 0, policy_version 48553 (0.0009) [2023-02-25 14:12:24,729][36114] Fps is (10 sec: 13107.0, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 198909952. Throughput: 0: 3351.0. Samples: 12219130. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:12:24,730][36114] Avg episode reward: [(0, '54.873')] [2023-02-25 14:12:24,801][36138] Updated weights for policy 0, policy_version 48563 (0.0009) [2023-02-25 14:12:25,741][36154] DAMAGECOUNT value on done: 845675.0 [2023-02-25 14:12:25,741][36154] Sum rewards: 56.309, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.632', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.114', 'weapon5': '0.130', 'weapon4': '0.172', 'AMMO3': '0.207', 'WEAPON3': '1.350', 'HITCOUNT': '3.050', 'weapon3': '3.472', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '46.500'} [2023-02-25 14:12:26,030][36154] DAMAGECOUNT value on done: 845774.0 [2023-02-25 14:12:26,031][36154] Sum rewards: 54.383, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.729', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.132', 'AMMO3': '0.153', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.338', 'weapon5': '0.434', 'weapon4': '0.716', 'WEAPON3': '1.000', 'weapon3': '2.196', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.890', 'FRAGCOUNT': '45.000'} [2023-02-25 14:12:26,067][36154] DAMAGECOUNT value on done: 832628.0 [2023-02-25 14:12:26,067][36154] Sum rewards: 56.387, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.000', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.044', 'AMMO3': '0.206', 'AMMO4': '0.220', 'weapon5': '0.302', 'weapon2': '0.320', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon4': '0.768', 'WEAPON3': '1.200', 'weapon3': '2.244', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.729', 'FRAGCOUNT': '49.000'} [2023-02-25 14:12:26,230][36141] DAMAGECOUNT value on done: 848561.0 [2023-02-25 14:12:26,231][36141] Sum rewards: 52.979, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.756', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.110', 'AMMO4': '0.123', 'AMMO3': '0.143', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.366', 'weapon2': '0.588', 'WEAPON3': '0.900', 'weapon3': '2.712', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.854', 'FRAGCOUNT': '44.500'} [2023-02-25 14:12:26,345][36154] DAMAGECOUNT value on done: 843721.0 [2023-02-25 14:12:26,346][36154] Sum rewards: 59.584, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.552', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.029', 'weapon5': '0.102', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'weapon2': '0.456', 'weapon4': '0.546', 'WEAPON3': '1.150', 'weapon3': '2.720', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '15.201', 'FRAGCOUNT': '49.000'} [2023-02-25 14:12:26,537][36141] DAMAGECOUNT value on done: 840823.0 [2023-02-25 14:12:26,537][36141] Sum rewards: 52.318, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.534', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.148', 'AMMO4': '0.152', 'AMMO3': '0.202', 'weapon2': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.660', 'WEAPON3': '1.150', 'weapon3': '2.502', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.578', 'FRAGCOUNT': '46.000'} [2023-02-25 14:12:26,547][36141] DAMAGECOUNT value on done: 846004.0 [2023-02-25 14:12:26,547][36141] Sum rewards: 56.325, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.070', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.032', 'weapon5': '0.084', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'weapon2': '0.324', 'WEAPON3': '1.300', 'HITCOUNT': '3.090', 'weapon3': '3.334', 'DAMAGECOUNT': '14.589', 'FRAGCOUNT': '49.000'} [2023-02-25 14:12:26,847][36141] DAMAGECOUNT value on done: 835480.0 [2023-02-25 14:12:26,847][36141] Sum rewards: 44.599, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.140', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.054', 'AMMO3': '0.106', 'WEAPON5': '0.150', 'weapon5': '0.184', 'AMMO4': '0.269', 'weapon2': '0.306', 'WEAPON4': '0.450', 'WEAPON3': '0.700', 'weapon4': '1.136', 'weapon3': '2.052', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.180', 'FRAGCOUNT': '36.500'} [2023-02-25 14:12:27,842][36138] Updated weights for policy 0, policy_version 48573 (0.0009) [2023-02-25 14:12:28,041][36157] DAMAGECOUNT value on done: 852977.0 [2023-02-25 14:12:28,042][36157] Sum rewards: 50.599, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.992', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.136', 'AMMO3': '0.168', 'weapon5': '0.178', 'WEAPON5': '0.200', 'weapon4': '0.298', 'WEAPON4': '0.300', 'weapon2': '0.708', 'WEAPON3': '1.000', 'weapon3': '2.602', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.176', 'FRAGCOUNT': '42.000'} [2023-02-25 14:12:28,356][36157] DAMAGECOUNT value on done: 842404.0 [2023-02-25 14:12:28,357][36157] Sum rewards: 55.957, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.120', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.130', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'weapon4': '0.314', 'weapon2': '0.418', 'WEAPON3': '1.350', 'weapon3': '2.766', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.265', 'FRAGCOUNT': '50.000'} [2023-02-25 14:12:28,844][36140] DAMAGECOUNT value on done: 846391.0 [2023-02-25 14:12:28,845][36140] Sum rewards: 54.972, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.821', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.086', 'weapon4': '0.110', 'AMMO4': '0.149', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.448', 'WEAPON3': '1.200', 'HITCOUNT': '2.910', 'weapon3': '3.102', 'DAMAGECOUNT': '14.196', 'FRAGCOUNT': '48.000'} [2023-02-25 14:12:28,963][36157] DAMAGECOUNT value on done: 855034.0 [2023-02-25 14:12:28,963][36157] Sum rewards: 54.721, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.749', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON5': '0.050', 'weapon5': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.158', 'weapon4': '0.342', 'weapon2': '0.520', 'WEAPON3': '1.000', 'HITCOUNT': '2.830', 'weapon3': '2.864', 'DAMAGECOUNT': '12.741', 'FRAGCOUNT': '46.000'} [2023-02-25 14:12:29,157][36140] DAMAGECOUNT value on done: 830232.0 [2023-02-25 14:12:29,158][36140] Sum rewards: 49.725, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.270', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'AMMO4': '0.060', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.212', 'AMMO3': '0.219', 'weapon2': '0.484', 'WEAPON3': '1.300', 'weapon3': '3.036', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '13.665', 'FRAGCOUNT': '42.000'} [2023-02-25 14:12:29,272][36157] DAMAGECOUNT value on done: 847027.0 [2023-02-25 14:12:29,272][36157] Sum rewards: 48.830, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.455', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.055', 'weapon5': '0.102', 'AMMO3': '0.125', 'AMMO4': '0.277', 'weapon2': '0.366', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '0.900', 'weapon4': '0.924', 'weapon3': '2.278', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.173', 'FRAGCOUNT': '42.000'} [2023-02-25 14:12:29,331][36140] DAMAGECOUNT value on done: 840333.0 [2023-02-25 14:12:29,331][36140] Sum rewards: 58.309, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.130', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.086', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.164', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'weapon4': '0.438', 'WEAPON3': '1.450', 'weapon3': '3.092', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '51.000'} [2023-02-25 14:12:29,657][36140] DAMAGECOUNT value on done: 840238.0 [2023-02-25 14:12:29,658][36140] Sum rewards: 43.193, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.219', 'ARMOR': '0.008', 'AMMO5': '0.021', 'AMMO2': '0.066', 'AMMO3': '0.140', 'weapon5': '0.292', 'AMMO4': '0.328', 'weapon2': '0.446', 'WEAPON5': '0.550', 'weapon4': '0.554', 'WEAPON4': '0.650', 'WEAPON3': '0.900', 'weapon3': '2.366', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '13.251', 'FRAGCOUNT': '37.500'} [2023-02-25 14:12:29,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 198979584. Throughput: 0: 3349.3. Samples: 12239158. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:12:29,729][36114] Avg episode reward: [(0, '54.879')] [2023-02-25 14:12:30,859][36138] Updated weights for policy 0, policy_version 48583 (0.0009) [2023-02-25 14:12:31,371][36142] DAMAGECOUNT value on done: 848942.0 [2023-02-25 14:12:31,372][36142] Sum rewards: 53.237, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.140', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon5': '0.124', 'AMMO3': '0.192', 'AMMO4': '0.265', 'weapon2': '0.326', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.774', 'WEAPON3': '1.150', 'weapon3': '2.446', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.429', 'FRAGCOUNT': '47.000'} [2023-02-25 14:12:31,677][36142] DAMAGECOUNT value on done: 829007.0 [2023-02-25 14:12:31,678][36142] Sum rewards: 44.733, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.788', 'AMMO5': '0.020', 'AMMO2': '0.060', 'AMMO3': '0.108', 'weapon5': '0.190', 'AMMO4': '0.298', 'weapon2': '0.472', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '0.700', 'weapon4': '1.052', 'weapon3': '2.016', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '11.985', 'FRAGCOUNT': '38.000'} [2023-02-25 14:12:31,778][36142] DAMAGECOUNT value on done: 837354.0 [2023-02-25 14:12:31,779][36142] Sum rewards: 58.989, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.338', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.130', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon2': '0.344', 'weapon4': '0.664', 'WEAPON3': '1.300', 'weapon3': '2.730', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.223', 'FRAGCOUNT': '52.000'} [2023-02-25 14:12:31,816][36155] DAMAGECOUNT value on done: 837834.0 [2023-02-25 14:12:31,816][36155] Sum rewards: 50.286, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.718', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.048', 'weapon5': '0.168', 'AMMO4': '0.174', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.652', 'WEAPON3': '1.350', 'HITCOUNT': '2.710', 'weapon3': '2.866', 'DAMAGECOUNT': '13.425', 'FRAGCOUNT': '45.000'} [2023-02-25 14:12:32,100][36142] DAMAGECOUNT value on done: 852135.0 [2023-02-25 14:12:32,101][36142] Sum rewards: 60.657, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.765', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.058', 'AMMO4': '0.066', 'weapon4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.248', 'weapon2': '0.456', 'WEAPON3': '1.600', 'weapon3': '3.222', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.719', 'FRAGCOUNT': '52.000'} [2023-02-25 14:12:32,124][36155] DAMAGECOUNT value on done: 850504.0 [2023-02-25 14:12:32,124][36155] Sum rewards: 44.916, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.819', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon4': '0.170', 'AMMO3': '0.190', 'AMMO4': '0.207', 'weapon5': '0.234', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.516', 'WEAPON3': '1.200', 'HITCOUNT': '2.390', 'weapon3': '2.760', 'DAMAGECOUNT': '12.855', 'FRAGCOUNT': '42.000'} [2023-02-25 14:12:32,706][36156] DAMAGECOUNT value on done: 854844.0 [2023-02-25 14:12:32,707][36156] Sum rewards: 41.615, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.282', 'AMMO5': '0.015', 'AMMO2': '0.016', 'weapon5': '0.080', 'AMMO4': '0.080', 'weapon4': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.271', 'weapon2': '0.346', 'WEAPON3': '1.600', 'HITCOUNT': '2.680', 'weapon3': '3.040', 'DAMAGECOUNT': '11.556', 'FRAGCOUNT': '41.000'} [2023-02-25 14:12:32,770][36156] DAMAGECOUNT value on done: 852019.0 [2023-02-25 14:12:32,770][36156] Sum rewards: 51.406, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.148', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.136', 'AMMO3': '0.202', 'weapon2': '0.428', 'WEAPON3': '1.200', 'HITCOUNT': '2.840', 'weapon3': '3.104', 'DAMAGECOUNT': '12.780', 'FRAGCOUNT': '44.000'} [2023-02-25 14:12:33,019][36156] DAMAGECOUNT value on done: 847192.0 [2023-02-25 14:12:33,020][36156] Sum rewards: 53.396, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.365', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.142', 'weapon4': '0.160', 'AMMO4': '0.168', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.150', 'HITCOUNT': '2.980', 'weapon3': '3.134', 'DAMAGECOUNT': '14.967', 'FRAGCOUNT': '44.500'} [2023-02-25 14:12:33,086][36156] DAMAGECOUNT value on done: 840304.0 [2023-02-25 14:12:33,087][36156] Sum rewards: 56.039, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.842', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.148', 'AMMO3': '0.159', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.380', 'weapon2': '0.530', 'WEAPON3': '1.000', 'weapon3': '2.676', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.716', 'FRAGCOUNT': '47.000'} [2023-02-25 14:12:33,147][36155] DAMAGECOUNT value on done: 852817.0 [2023-02-25 14:12:33,147][36155] Sum rewards: 54.629, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.767', 'ARMOR': '0.008', 'AMMO5': '0.024', 'AMMO2': '0.072', 'AMMO3': '0.183', 'weapon5': '0.196', 'weapon2': '0.252', 'AMMO4': '0.360', 'weapon4': '0.548', 'WEAPON5': '0.600', 'WEAPON4': '0.750', 'WEAPON3': '1.150', 'weapon3': '2.670', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.693', 'FRAGCOUNT': '49.000'} [2023-02-25 14:12:33,441][36155] DAMAGECOUNT value on done: 841312.0 [2023-02-25 14:12:33,441][36155] Sum rewards: 52.926, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.312', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.024', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'weapon2': '0.228', 'AMMO3': '0.241', 'weapon4': '0.268', 'WEAPON3': '1.450', 'HITCOUNT': '3.140', 'weapon3': '3.158', 'DAMAGECOUNT': '13.557', 'FRAGCOUNT': '47.000'} [2023-02-25 14:12:33,876][36139] DAMAGECOUNT value on done: 845504.0 [2023-02-25 14:12:33,877][36139] Sum rewards: 66.113, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.650', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.058', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.156', 'weapon2': '0.162', 'AMMO3': '0.211', 'WEAPON3': '1.400', 'weapon3': '3.426', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '56.000'} [2023-02-25 14:12:33,926][36138] Updated weights for policy 0, policy_version 48593 (0.0009) [2023-02-25 14:12:34,189][36139] DAMAGECOUNT value on done: 838561.0 [2023-02-25 14:12:34,189][36139] Sum rewards: 55.188, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.590', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.180', 'AMMO4': '0.214', 'AMMO3': '0.224', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.360', 'weapon4': '0.570', 'WEAPON3': '1.300', 'weapon3': '2.468', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '48.000'} [2023-02-25 14:12:34,627][36139] DAMAGECOUNT value on done: 857337.0 [2023-02-25 14:12:34,628][36139] Sum rewards: 54.405, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.555', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.052', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'weapon4': '0.238', 'AMMO3': '0.246', 'WEAPON4': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.550', 'HITCOUNT': '2.900', 'weapon3': '3.144', 'DAMAGECOUNT': '14.667', 'FRAGCOUNT': '50.000'} [2023-02-25 14:12:34,729][36114] Fps is (10 sec: 13517.0, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 199045120. Throughput: 0: 3354.8. Samples: 12259378. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:12:34,729][36114] Avg episode reward: [(0, '54.644')] [2023-02-25 14:12:34,929][36139] DAMAGECOUNT value on done: 850982.0 [2023-02-25 14:12:34,930][36139] Sum rewards: 56.875, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.533', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO3': '0.125', 'AMMO4': '0.215', 'weapon5': '0.234', 'weapon2': '0.364', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '0.850', 'weapon4': '0.924', 'weapon3': '2.084', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.077', 'FRAGCOUNT': '46.000'} [2023-02-25 14:12:36,977][36138] Updated weights for policy 0, policy_version 48603 (0.0009) [2023-02-25 14:12:38,586][36139] Large shaping reward -2.521 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0)] [2023-02-25 14:12:39,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 199110656. Throughput: 0: 3354.6. Samples: 12269422. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:12:39,730][36114] Avg episode reward: [(0, '54.643')] [2023-02-25 14:12:40,055][36138] Updated weights for policy 0, policy_version 48613 (0.0009) [2023-02-25 14:12:43,107][36138] Updated weights for policy 0, policy_version 48623 (0.0009) [2023-02-25 14:12:44,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13398.8). Total num frames: 199180288. Throughput: 0: 3353.9. Samples: 12289550. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:12:44,729][36114] Avg episode reward: [(0, '54.643')] [2023-02-25 14:12:45,701][36154] DAMAGECOUNT value on done: 850802.0 [2023-02-25 14:12:45,702][36154] Sum rewards: 57.538, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.502', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.176', 'AMMO4': '0.190', 'AMMO3': '0.191', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.414', 'weapon4': '0.588', 'WEAPON3': '1.150', 'weapon3': '2.536', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.381', 'FRAGCOUNT': '49.000'} [2023-02-25 14:12:46,007][36154] DAMAGECOUNT value on done: 850267.0 [2023-02-25 14:12:46,007][36154] Sum rewards: 50.126, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.280', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'weapon2': '0.388', 'ARMOR': '0.459', 'weapon4': '0.590', 'WEAPON3': '1.400', 'weapon3': '2.622', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.479', 'FRAGCOUNT': '46.000'} [2023-02-25 14:12:46,036][36154] DAMAGECOUNT value on done: 836609.0 [2023-02-25 14:12:46,037][36154] Sum rewards: 45.937, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.732', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO3': '0.115', 'AMMO4': '0.195', 'weapon5': '0.204', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '0.750', 'weapon2': '0.754', 'weapon4': '0.852', 'weapon3': '1.986', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '11.943', 'FRAGCOUNT': '37.000'} [2023-02-25 14:12:46,145][36138] Updated weights for policy 0, policy_version 48633 (0.0009) [2023-02-25 14:12:46,328][36154] DAMAGECOUNT value on done: 848373.0 [2023-02-25 14:12:46,328][36154] Sum rewards: 63.482, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.468', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.052', 'WEAPON4': '0.100', 'weapon4': '0.114', 'AMMO3': '0.156', 'weapon2': '0.374', 'WEAPON3': '0.950', 'HITCOUNT': '3.110', 'weapon3': '3.290', 'DAMAGECOUNT': '13.956', 'FRAGCOUNT': '53.000'} [2023-02-25 14:12:46,399][36141] DAMAGECOUNT value on done: 853580.0 [2023-02-25 14:12:46,400][36141] Sum rewards: 60.808, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.011', 'HEALTH': '0.040', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.106', 'weapon4': '0.146', 'AMMO3': '0.176', 'weapon2': '0.614', 'WEAPON3': '1.050', 'weapon3': '2.896', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.619', 'FRAGCOUNT': '49.000'} [2023-02-25 14:12:46,693][36141] DAMAGECOUNT value on done: 846092.0 [2023-02-25 14:12:46,694][36141] Sum rewards: 60.038, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.599', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.086', 'weapon4': '0.106', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.314', 'WEAPON3': '1.400', 'HITCOUNT': '3.030', 'weapon3': '3.142', 'DAMAGECOUNT': '15.807', 'FRAGCOUNT': '52.000'} [2023-02-25 14:12:46,703][36141] DAMAGECOUNT value on done: 851265.0 [2023-02-25 14:12:46,704][36141] Sum rewards: 60.529, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.295', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.048', 'AMMO4': '0.086', 'WEAPON5': '0.150', 'weapon2': '0.158', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon4': '0.748', 'WEAPON3': '1.100', 'weapon3': '2.782', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.783', 'FRAGCOUNT': '50.000'} [2023-02-25 14:12:47,005][36141] DAMAGECOUNT value on done: 840216.0 [2023-02-25 14:12:47,006][36141] Sum rewards: 59.329, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.314', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.086', 'AMMO4': '0.115', 'AMMO3': '0.159', 'weapon4': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.752', 'WEAPON3': '0.950', 'weapon3': '2.550', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.208', 'FRAGCOUNT': '49.000'} [2023-02-25 14:12:48,134][36157] DAMAGECOUNT value on done: 858029.0 [2023-02-25 14:12:48,134][36157] Sum rewards: 55.256, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.252', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.134', 'AMMO3': '0.228', 'WEAPON5': '0.300', 'weapon2': '0.354', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.690', 'WEAPON3': '1.250', 'weapon3': '2.566', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.156', 'FRAGCOUNT': '50.000'} [2023-02-25 14:12:48,450][36157] DAMAGECOUNT value on done: 847229.0 [2023-02-25 14:12:48,451][36157] Sum rewards: 54.529, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.524', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.161', 'weapon5': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.490', 'weapon2': '0.718', 'WEAPON3': '1.050', 'weapon3': '2.166', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.475', 'FRAGCOUNT': '46.000'} [2023-02-25 14:12:48,962][36140] DAMAGECOUNT value on done: 852145.0 [2023-02-25 14:12:48,963][36140] Sum rewards: 64.124, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.710', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.102', 'AMMO4': '0.126', 'AMMO3': '0.194', 'weapon2': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.616', 'WEAPON3': '1.250', 'weapon3': '2.788', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.262', 'FRAGCOUNT': '55.000'} [2023-02-25 14:12:49,039][36157] DAMAGECOUNT value on done: 858735.0 [2023-02-25 14:12:49,040][36157] Sum rewards: 47.012, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.765', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon5': '0.156', 'AMMO4': '0.177', 'AMMO3': '0.192', 'WEAPON5': '0.400', 'ARMOR': '0.456', 'WEAPON4': '0.500', 'weapon4': '0.600', 'weapon2': '0.626', 'WEAPON3': '1.200', 'weapon3': '2.344', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '11.103', 'FRAGCOUNT': '44.000'} [2023-02-25 14:12:49,194][36138] Updated weights for policy 0, policy_version 48643 (0.0010) [2023-02-25 14:12:49,286][36140] DAMAGECOUNT value on done: 835672.0 [2023-02-25 14:12:49,286][36140] Sum rewards: 59.823, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.040', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.056', 'weapon5': '0.170', 'weapon4': '0.176', 'AMMO3': '0.206', 'AMMO4': '0.279', 'weapon2': '0.342', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.760', 'weapon3': '3.036', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '53.000'} [2023-02-25 14:12:49,361][36157] DAMAGECOUNT value on done: 852103.0 [2023-02-25 14:12:49,361][36157] Sum rewards: 52.776, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.447', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.198', 'AMMO4': '0.200', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.398', 'weapon2': '0.626', 'WEAPON3': '1.400', 'weapon3': '2.482', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '48.000'} [2023-02-25 14:12:49,462][36140] DAMAGECOUNT value on done: 845440.0 [2023-02-25 14:12:49,463][36140] Sum rewards: 57.161, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.090', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon4': '0.192', 'weapon5': '0.210', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'weapon2': '0.262', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.070', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.321', 'FRAGCOUNT': '50.500'} [2023-02-25 14:12:49,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 199245824. Throughput: 0: 3351.4. Samples: 12309592. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:12:49,730][36114] Avg episode reward: [(0, '54.207')] [2023-02-25 14:12:49,771][36140] DAMAGECOUNT value on done: 845427.0 [2023-02-25 14:12:49,772][36140] Sum rewards: 56.747, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.748', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.142', 'weapon2': '0.174', 'weapon5': '0.196', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.576', 'WEAPON3': '1.350', 'weapon3': '2.716', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '51.000'} [2023-02-25 14:12:51,363][36142] DAMAGECOUNT value on done: 854089.0 [2023-02-25 14:12:51,363][36142] Sum rewards: 59.961, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.040', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon4': '0.100', 'weapon5': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.310', 'WEAPON3': '1.300', 'HITCOUNT': '3.060', 'weapon3': '3.230', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '52.000'} [2023-02-25 14:12:51,686][36142] DAMAGECOUNT value on done: 833588.0 [2023-02-25 14:12:51,687][36142] Sum rewards: 53.930, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.059', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.140', 'AMMO3': '0.184', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.474', 'WEAPON3': '1.150', 'weapon3': '2.782', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.743', 'FRAGCOUNT': '47.000'} [2023-02-25 14:12:51,763][36142] DAMAGECOUNT value on done: 842442.0 [2023-02-25 14:12:51,764][36142] Sum rewards: 61.669, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.092', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.094', 'AMMO4': '0.130', 'weapon4': '0.162', 'weapon2': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'WEAPON3': '1.300', 'HITCOUNT': '2.960', 'weapon3': '3.260', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '53.000'} [2023-02-25 14:12:51,781][36155] DAMAGECOUNT value on done: 842103.0 [2023-02-25 14:12:51,782][36155] Sum rewards: 49.227, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.472', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.128', 'WEAPON5': '0.150', 'weapon5': '0.178', 'WEAPON4': '0.250', 'weapon4': '0.526', 'weapon2': '0.648', 'WEAPON3': '0.900', 'weapon3': '2.438', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '12.807', 'FRAGCOUNT': '40.000'} [2023-02-25 14:12:52,077][36142] DAMAGECOUNT value on done: 857469.0 [2023-02-25 14:12:52,077][36142] Sum rewards: 64.630, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.516', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.152', 'AMMO3': '0.197', 'weapon5': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.318', 'weapon4': '0.324', 'WEAPON3': '1.350', 'weapon3': '2.948', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.002', 'FRAGCOUNT': '57.000'} [2023-02-25 14:12:52,091][36155] DAMAGECOUNT value on done: 855603.0 [2023-02-25 14:12:52,092][36155] Sum rewards: 59.725, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.296', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.164', 'AMMO3': '0.167', 'AMMO4': '0.173', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.420', 'weapon2': '0.634', 'WEAPON3': '1.000', 'weapon3': '2.530', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.282', 'FRAGCOUNT': '49.000'} [2023-02-25 14:12:52,264][36138] Updated weights for policy 0, policy_version 48653 (0.0009) [2023-02-25 14:12:52,724][36156] DAMAGECOUNT value on done: 859588.0 [2023-02-25 14:12:52,724][36156] Sum rewards: 46.501, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-3.343', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon5': '0.208', 'AMMO4': '0.231', 'weapon2': '0.270', 'AMMO3': '0.307', 'WEAPON5': '0.400', 'weapon4': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.750', 'HITCOUNT': '2.720', 'weapon3': '2.756', 'DAMAGECOUNT': '14.232', 'FRAGCOUNT': '47.000'} [2023-02-25 14:12:52,790][36156] DAMAGECOUNT value on done: 856763.0 [2023-02-25 14:12:52,790][36156] Sum rewards: 64.108, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.806', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.121', 'AMMO3': '0.132', 'weapon5': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.480', 'weapon4': '0.622', 'WEAPON3': '0.800', 'weapon3': '2.482', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.232', 'FRAGCOUNT': '52.000'} [2023-02-25 14:12:53,035][36156] DAMAGECOUNT value on done: 852013.0 [2023-02-25 14:12:53,035][36156] Sum rewards: 62.753, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.836', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.138', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.236', 'weapon2': '0.934', 'WEAPON3': '1.000', 'weapon3': '2.478', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.463', 'FRAGCOUNT': '52.000'} [2023-02-25 14:12:53,100][36156] DAMAGECOUNT value on done: 845071.0 [2023-02-25 14:12:53,101][36156] Sum rewards: 57.314, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.491', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.127', 'weapon5': '0.162', 'weapon2': '0.204', 'AMMO3': '0.233', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.384', 'WEAPON3': '1.300', 'weapon3': '2.906', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.301', 'FRAGCOUNT': '52.000'} [2023-02-25 14:12:53,161][36155] DAMAGECOUNT value on done: 857954.0 [2023-02-25 14:12:53,161][36155] Sum rewards: 56.749, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.534', 'AMMO5': '0.021', 'AMMO2': '0.036', 'AMMO4': '0.179', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon5': '0.254', 'weapon2': '0.270', 'WEAPON5': '0.450', 'weapon4': '0.612', 'WEAPON3': '1.350', 'weapon3': '2.350', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.411', 'FRAGCOUNT': '49.000'} [2023-02-25 14:12:53,474][36155] DAMAGECOUNT value on done: 846126.0 [2023-02-25 14:12:53,475][36155] Sum rewards: 49.128, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.340', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.032', 'weapon5': '0.050', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.688', 'WEAPON3': '1.150', 'weapon3': '3.028', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.442', 'FRAGCOUNT': '41.500'} [2023-02-25 14:12:53,827][36139] DAMAGECOUNT value on done: 850947.0 [2023-02-25 14:12:53,828][36139] Sum rewards: 61.089, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.628', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.112', 'weapon5': '0.182', 'AMMO3': '0.185', 'AMMO4': '0.185', 'weapon2': '0.334', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.048', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.329', 'FRAGCOUNT': '52.500'} [2023-02-25 14:12:54,141][36139] DAMAGECOUNT value on done: 843916.0 [2023-02-25 14:12:54,141][36139] Sum rewards: 62.908, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.140', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon5': '0.142', 'AMMO4': '0.173', 'AMMO3': '0.210', 'weapon4': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.250', 'weapon3': '2.942', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.065', 'FRAGCOUNT': '54.000'} [2023-02-25 14:12:54,609][36139] DAMAGECOUNT value on done: 861839.0 [2023-02-25 14:12:54,610][36139] Sum rewards: 51.930, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.948', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.192', 'AMMO3': '0.238', 'weapon2': '0.270', 'WEAPON3': '1.400', 'HITCOUNT': '2.930', 'weapon3': '3.298', 'DAMAGECOUNT': '13.506', 'FRAGCOUNT': '46.000'} [2023-02-25 14:12:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 199315456. Throughput: 0: 3352.6. Samples: 12319604. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:12:54,730][36114] Avg episode reward: [(0, '54.419')] [2023-02-25 14:12:54,926][36139] DAMAGECOUNT value on done: 856298.0 [2023-02-25 14:12:54,927][36139] Sum rewards: 61.889, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.368', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.056', 'AMMO3': '0.123', 'weapon2': '0.230', 'AMMO4': '0.280', 'weapon5': '0.326', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon4': '0.726', 'WEAPON3': '0.850', 'weapon3': '2.412', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '15.948', 'FRAGCOUNT': '52.000'} [2023-02-25 14:12:55,325][36138] Updated weights for policy 0, policy_version 48663 (0.0010) [2023-02-25 14:12:56,669][36154] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:12:58,391][36138] Updated weights for policy 0, policy_version 48673 (0.0009) [2023-02-25 14:12:59,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 199380992. Throughput: 0: 3351.9. Samples: 12339758. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:12:59,730][36114] Avg episode reward: [(0, '54.558')] [2023-02-25 14:13:01,465][36138] Updated weights for policy 0, policy_version 48683 (0.0009) [2023-02-25 14:13:02,508][36155] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:13:04,485][36138] Updated weights for policy 0, policy_version 48693 (0.0009) [2023-02-25 14:13:04,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 199446528. Throughput: 0: 3351.6. Samples: 12359852. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:13:04,730][36114] Avg episode reward: [(0, '54.558')] [2023-02-25 14:13:05,777][36154] DAMAGECOUNT value on done: 855590.0 [2023-02-25 14:13:05,778][36154] Sum rewards: 62.000, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.645', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.094', 'AMMO3': '0.108', 'AMMO4': '0.148', 'weapon2': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.370', 'WEAPON3': '0.700', 'HITCOUNT': '2.870', 'weapon3': '3.000', 'DAMAGECOUNT': '14.364', 'FRAGCOUNT': '50.000'} [2023-02-25 14:13:05,908][36156] Large shaping reward 2.613 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.582, 194.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:13:06,080][36154] DAMAGECOUNT value on done: 855212.0 [2023-02-25 14:13:06,080][36154] Sum rewards: 60.090, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.064', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.043', 'weapon5': '0.102', 'AMMO3': '0.125', 'WEAPON5': '0.150', 'AMMO4': '0.214', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON3': '0.850', 'weapon4': '0.852', 'weapon3': '2.362', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.835', 'FRAGCOUNT': '49.000'} [2023-02-25 14:13:06,101][36154] DAMAGECOUNT value on done: 841994.0 [2023-02-25 14:13:06,102][36154] Sum rewards: 68.638, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.880', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.142', 'AMMO4': '0.166', 'AMMO3': '0.192', 'WEAPON5': '0.300', 'weapon4': '0.316', 'weapon2': '0.398', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.938', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.155', 'FRAGCOUNT': '61.000'} [2023-02-25 14:13:06,406][36154] DAMAGECOUNT value on done: 852531.0 [2023-02-25 14:13:06,407][36154] Sum rewards: 47.726, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.064', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon5': '0.100', 'AMMO4': '0.218', 'weapon4': '0.218', 'AMMO3': '0.237', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.432', 'WEAPON3': '1.400', 'HITCOUNT': '2.730', 'weapon3': '2.964', 'DAMAGECOUNT': '12.474', 'FRAGCOUNT': '44.000'} [2023-02-25 14:13:06,654][36141] DAMAGECOUNT value on done: 858768.0 [2023-02-25 14:13:06,654][36141] Sum rewards: 58.654, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.711', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.112', 'AMMO4': '0.119', 'weapon5': '0.168', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.370', 'WEAPON3': '1.300', 'HITCOUNT': '2.920', 'weapon3': '3.072', 'DAMAGECOUNT': '15.564', 'FRAGCOUNT': '51.000'} [2023-02-25 14:13:06,944][36141] DAMAGECOUNT value on done: 851392.0 [2023-02-25 14:13:06,944][36141] Sum rewards: 63.171, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.250', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.094', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'weapon4': '0.206', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'weapon2': '0.354', 'WEAPON3': '1.450', 'weapon3': '3.056', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '56.000'} [2023-02-25 14:13:06,978][36141] DAMAGECOUNT value on done: 856517.0 [2023-02-25 14:13:06,978][36141] Sum rewards: 52.723, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.745', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.057', 'weapon5': '0.232', 'AMMO3': '0.242', 'AMMO4': '0.284', 'weapon4': '0.298', 'weapon2': '0.402', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '2.650', 'weapon3': '2.678', 'DAMAGECOUNT': '15.750', 'FRAGCOUNT': '48.500'} [2023-02-25 14:13:07,290][36141] DAMAGECOUNT value on done: 845262.0 [2023-02-25 14:13:07,291][36141] Sum rewards: 55.401, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.580', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.060', 'AMMO4': '0.097', 'WEAPON5': '0.150', 'AMMO3': '0.269', 'WEAPON4': '0.350', 'weapon4': '0.398', 'weapon2': '0.458', 'WEAPON3': '1.650', 'weapon3': '2.836', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.138', 'FRAGCOUNT': '52.000'} [2023-02-25 14:13:07,626][36138] Updated weights for policy 0, policy_version 48703 (0.0010) [2023-02-25 14:13:08,372][36157] DAMAGECOUNT value on done: 863394.0 [2023-02-25 14:13:08,373][36157] Sum rewards: 67.406, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.602', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.128', 'AMMO4': '0.139', 'AMMO3': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.350', 'weapon4': '0.624', 'WEAPON3': '1.000', 'weapon3': '2.636', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '55.000'} [2023-02-25 14:13:08,694][36157] DAMAGECOUNT value on done: 851969.0 [2023-02-25 14:13:08,694][36157] Sum rewards: 55.665, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.085', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.092', 'AMMO4': '0.096', 'AMMO3': '0.142', 'WEAPON5': '0.200', 'weapon2': '0.258', 'WEAPON4': '0.400', 'weapon4': '0.678', 'WEAPON3': '1.000', 'weapon3': '2.856', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.220', 'FRAGCOUNT': '47.000'} [2023-02-25 14:13:09,139][36140] DAMAGECOUNT value on done: 857080.0 [2023-02-25 14:13:09,140][36140] Sum rewards: 59.069, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.485', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon2': '0.170', 'AMMO3': '0.175', 'weapon5': '0.252', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.822', 'WEAPON3': '1.000', 'weapon3': '2.480', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.805', 'FRAGCOUNT': '51.000'} [2023-02-25 14:13:09,288][36157] DAMAGECOUNT value on done: 863707.0 [2023-02-25 14:13:09,289][36157] Sum rewards: 56.633, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.510', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.136', 'AMMO4': '0.220', 'AMMO3': '0.231', 'weapon2': '0.266', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.428', 'WEAPON3': '1.350', 'weapon3': '2.910', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.916', 'FRAGCOUNT': '51.000'} [2023-02-25 14:13:09,430][36140] DAMAGECOUNT value on done: 840077.0 [2023-02-25 14:13:09,430][36140] Sum rewards: 55.106, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.400', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.062', 'AMMO3': '0.162', 'AMMO4': '0.185', 'WEAPON5': '0.200', 'weapon2': '0.390', 'weapon4': '0.422', 'WEAPON4': '0.500', 'WEAPON3': '0.900', 'HITCOUNT': '2.960', 'weapon3': '2.962', 'DAMAGECOUNT': '13.215', 'FRAGCOUNT': '48.000'} [2023-02-25 14:13:09,566][36140] DAMAGECOUNT value on done: 849605.0 [2023-02-25 14:13:09,567][36140] Sum rewards: 45.106, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.796', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.018', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'weapon2': '0.148', 'AMMO3': '0.208', 'WEAPON3': '1.300', 'HITCOUNT': '2.640', 'weapon3': '3.608', 'DAMAGECOUNT': '12.495', 'FRAGCOUNT': '39.000'} [2023-02-25 14:13:09,603][36157] DAMAGECOUNT value on done: 856869.0 [2023-02-25 14:13:09,604][36157] Sum rewards: 56.011, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.158', 'weapon5': '0.158', 'AMMO3': '0.208', 'HEALTH': '0.227', 'weapon4': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '2.940', 'weapon3': '3.094', 'DAMAGECOUNT': '14.298', 'FRAGCOUNT': '48.000'} [2023-02-25 14:13:09,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.2, 300 sec: 13412.7). Total num frames: 199512064. Throughput: 0: 3346.3. Samples: 12369712. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:13:09,730][36114] Avg episode reward: [(0, '55.471')] [2023-02-25 14:13:09,876][36140] DAMAGECOUNT value on done: 850657.0 [2023-02-25 14:13:09,876][36140] Sum rewards: 62.442, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.355', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon5': '0.130', 'weapon4': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'weapon2': '0.406', 'WEAPON3': '1.400', 'weapon3': '3.102', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '54.000'} [2023-02-25 14:13:10,698][36138] Updated weights for policy 0, policy_version 48713 (0.0009) [2023-02-25 14:13:11,517][36142] DAMAGECOUNT value on done: 858924.0 [2023-02-25 14:13:11,517][36142] Sum rewards: 56.047, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.767', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.117', 'weapon5': '0.144', 'weapon2': '0.202', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.804', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.505', 'FRAGCOUNT': '50.000'} [2023-02-25 14:13:11,771][36155] DAMAGECOUNT value on done: 846806.0 [2023-02-25 14:13:11,771][36155] Sum rewards: 58.106, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.805', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.134', 'AMMO4': '0.140', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon2': '0.214', 'WEAPON5': '0.300', 'weapon4': '0.334', 'WEAPON3': '1.150', 'HITCOUNT': '2.990', 'weapon3': '3.120', 'DAMAGECOUNT': '14.109', 'FRAGCOUNT': '49.000'} [2023-02-25 14:13:11,827][36142] DAMAGECOUNT value on done: 838321.0 [2023-02-25 14:13:11,827][36142] Sum rewards: 54.096, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.777', 'AMMO5': '0.015', 'AMMO2': '0.040', 'AMMO3': '0.158', 'AMMO4': '0.199', 'weapon2': '0.232', 'weapon5': '0.316', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.904', 'WEAPON3': '0.950', 'weapon3': '2.200', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.199', 'FRAGCOUNT': '44.000'} [2023-02-25 14:13:11,898][36142] DAMAGECOUNT value on done: 847053.0 [2023-02-25 14:13:11,898][36142] Sum rewards: 46.536, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.710', 'AMMO5': '0.017', 'AMMO2': '0.057', 'weapon5': '0.230', 'AMMO3': '0.235', 'AMMO4': '0.287', 'weapon2': '0.360', 'WEAPON5': '0.500', 'WEAPON4': '0.800', 'weapon4': '0.876', 'WEAPON3': '1.350', 'weapon3': '2.170', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.833', 'FRAGCOUNT': '46.000'} [2023-02-25 14:13:12,078][36155] DAMAGECOUNT value on done: 861213.0 [2023-02-25 14:13:12,079][36155] Sum rewards: 60.461, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.616', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.150', 'weapon2': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.281', 'weapon4': '0.462', 'WEAPON3': '1.600', 'weapon3': '2.888', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '54.000'} [2023-02-25 14:13:12,213][36142] DAMAGECOUNT value on done: 862929.0 [2023-02-25 14:13:12,213][36142] Sum rewards: 62.255, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.511', 'ARMOR': '0.004', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.024', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.166', 'AMMO3': '0.278', 'weapon4': '0.330', 'WEAPON3': '1.650', 'weapon3': '3.134', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '56.000'} [2023-02-25 14:13:12,760][36156] DAMAGECOUNT value on done: 861328.0 [2023-02-25 14:13:12,761][36156] Sum rewards: 50.174, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.956', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.132', 'AMMO3': '0.209', 'weapon5': '0.246', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.472', 'weapon4': '0.696', 'WEAPON3': '1.200', 'weapon3': '2.208', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '13.695', 'FRAGCOUNT': '44.000'} [2023-02-25 14:13:12,785][36156] DAMAGECOUNT value on done: 864531.0 [2023-02-25 14:13:12,785][36156] Sum rewards: 59.960, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.620', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.150', 'AMMO3': '0.193', 'AMMO4': '0.220', 'weapon2': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.740', 'WEAPON3': '1.150', 'weapon3': '2.642', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.829', 'FRAGCOUNT': '52.000'} [2023-02-25 14:13:13,088][36156] DAMAGECOUNT value on done: 850048.0 [2023-02-25 14:13:13,089][36156] Sum rewards: 57.010, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.215', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.166', 'weapon2': '0.188', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.426', 'WEAPON3': '1.400', 'weapon3': '2.956', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.931', 'FRAGCOUNT': '50.000'} [2023-02-25 14:13:13,131][36156] DAMAGECOUNT value on done: 856776.0 [2023-02-25 14:13:13,132][36156] Sum rewards: 51.909, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.235', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.034', 'AMMO4': '0.170', 'weapon5': '0.182', 'weapon4': '0.188', 'AMMO3': '0.205', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.426', 'WEAPON3': '1.300', 'HITCOUNT': '2.640', 'weapon3': '2.894', 'DAMAGECOUNT': '14.289', 'FRAGCOUNT': '47.000'} [2023-02-25 14:13:13,148][36155] DAMAGECOUNT value on done: 863438.0 [2023-02-25 14:13:13,148][36155] Sum rewards: 60.712, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.870', 'AMMO5': '0.017', 'AMMO2': '0.044', 'AMMO3': '0.201', 'weapon5': '0.202', 'AMMO4': '0.221', 'weapon2': '0.300', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.558', 'WEAPON3': '1.100', 'weapon3': '2.616', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.452', 'FRAGCOUNT': '52.000'} [2023-02-25 14:13:13,339][36140] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:13:13,459][36155] DAMAGECOUNT value on done: 851018.0 [2023-02-25 14:13:13,460][36155] Sum rewards: 54.011, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.924', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.052', 'weapon2': '0.192', 'AMMO3': '0.199', 'weapon5': '0.248', 'AMMO4': '0.259', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.690', 'WEAPON3': '1.100', 'weapon3': '2.432', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.391', 'FRAGCOUNT': '48.000'} [2023-02-25 14:13:13,750][36138] Updated weights for policy 0, policy_version 48723 (0.0010) [2023-02-25 14:13:13,996][36139] DAMAGECOUNT value on done: 855995.0 [2023-02-25 14:13:13,997][36139] Sum rewards: 59.293, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.770', 'ARMOR': '0.005', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.138', 'weapon5': '0.168', 'weapon2': '0.224', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '0.750', 'weapon4': '0.920', 'weapon3': '2.390', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.144', 'FRAGCOUNT': '49.000'} [2023-02-25 14:13:14,315][36139] DAMAGECOUNT value on done: 848658.0 [2023-02-25 14:13:14,316][36139] Sum rewards: 51.059, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.990', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.100', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'weapon2': '0.306', 'weapon4': '0.572', 'WEAPON3': '1.350', 'weapon3': '2.766', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.226', 'FRAGCOUNT': '45.000'} [2023-02-25 14:13:14,729][36139] DAMAGECOUNT value on done: 866415.0 [2023-02-25 14:13:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.2, 300 sec: 13412.7). Total num frames: 199581696. Throughput: 0: 3346.6. Samples: 12389754. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:13:14,730][36139] Sum rewards: 54.293, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'HEALTH': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'weapon4': '0.298', 'weapon2': '0.526', 'WEAPON3': '1.050', 'weapon3': '2.838', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.728', 'FRAGCOUNT': '45.000'} [2023-02-25 14:13:14,730][36114] Avg episode reward: [(0, '55.747')] [2023-02-25 14:13:15,045][36139] DAMAGECOUNT value on done: 861185.0 [2023-02-25 14:13:15,045][36139] Sum rewards: 52.930, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.110', 'AMMO5': '0.025', 'AMMO2': '0.066', 'AMMO3': '0.133', 'weapon5': '0.322', 'AMMO4': '0.331', 'weapon2': '0.534', 'WEAPON5': '0.600', 'WEAPON4': '0.750', 'weapon4': '0.848', 'WEAPON3': '0.900', 'weapon3': '1.930', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.661', 'FRAGCOUNT': '47.000'} [2023-02-25 14:13:16,784][36138] Updated weights for policy 0, policy_version 48733 (0.0010) [2023-02-25 14:13:19,729][36114] Fps is (10 sec: 13517.1, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 199647232. Throughput: 0: 3349.3. Samples: 12410098. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:13:19,730][36114] Avg episode reward: [(0, '55.756')] [2023-02-25 14:13:19,733][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000048742_199647232.pth... [2023-02-25 14:13:19,794][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000047956_196427776.pth [2023-02-25 14:13:19,850][36138] Updated weights for policy 0, policy_version 48743 (0.0009) [2023-02-25 14:13:22,856][36138] Updated weights for policy 0, policy_version 48753 (0.0009) [2023-02-25 14:13:24,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13426.6). Total num frames: 199716864. Throughput: 0: 3348.7. Samples: 12420114. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:13:24,729][36114] Avg episode reward: [(0, '55.756')] [2023-02-25 14:13:25,849][36154] DAMAGECOUNT value on done: 860042.0 [2023-02-25 14:13:25,850][36154] Sum rewards: 52.360, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.164', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.144', 'weapon5': '0.234', 'weapon4': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.606', 'WEAPON3': '0.850', 'weapon3': '2.620', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '13.356', 'FRAGCOUNT': '43.000'} [2023-02-25 14:13:25,899][36138] Updated weights for policy 0, policy_version 48763 (0.0009) [2023-02-25 14:13:26,153][36154] DAMAGECOUNT value on done: 860308.0 [2023-02-25 14:13:26,154][36154] Sum rewards: 61.798, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.652', 'AMMO5': '0.007', 'AMMO2': '0.025', 'WEAPON4': '0.100', 'AMMO4': '0.126', 'weapon2': '0.146', 'WEAPON5': '0.150', 'weapon5': '0.176', 'AMMO3': '0.209', 'weapon4': '0.388', 'WEAPON3': '1.250', 'HITCOUNT': '2.870', 'weapon3': '2.964', 'DAMAGECOUNT': '15.288', 'FRAGCOUNT': '52.500'} [2023-02-25 14:13:26,165][36154] DAMAGECOUNT value on done: 846940.0 [2023-02-25 14:13:26,166][36154] Sum rewards: 51.369, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.040', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.034', 'AMMO4': '0.171', 'weapon5': '0.204', 'AMMO3': '0.216', 'weapon2': '0.276', 'WEAPON5': '0.400', 'weapon4': '0.452', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.770', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.793', 'FRAGCOUNT': '46.500'} [2023-02-25 14:13:26,469][36154] DAMAGECOUNT value on done: 857649.0 [2023-02-25 14:13:26,469][36154] Sum rewards: 54.363, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.815', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon4': '0.040', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'weapon2': '0.226', 'AMMO3': '0.266', 'WEAPON3': '1.550', 'HITCOUNT': '2.850', 'weapon3': '3.492', 'DAMAGECOUNT': '15.354', 'FRAGCOUNT': '48.000'} [2023-02-25 14:13:26,691][36141] DAMAGECOUNT value on done: 862965.0 [2023-02-25 14:13:26,691][36141] Sum rewards: 47.432, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.130', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.116', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon2': '0.342', 'weapon4': '0.456', 'WEAPON3': '1.200', 'HITCOUNT': '2.570', 'weapon3': '2.880', 'DAMAGECOUNT': '12.591', 'FRAGCOUNT': '42.000'} [2023-02-25 14:13:26,998][36141] DAMAGECOUNT value on done: 856191.0 [2023-02-25 14:13:26,999][36141] Sum rewards: 49.791, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.310', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.036', 'AMMO4': '0.178', 'weapon5': '0.180', 'WEAPON5': '0.200', 'weapon4': '0.234', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'weapon2': '0.528', 'WEAPON3': '1.500', 'weapon3': '2.820', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.397', 'FRAGCOUNT': '46.000'} [2023-02-25 14:13:27,008][36141] DAMAGECOUNT value on done: 862136.0 [2023-02-25 14:13:27,008][36141] Sum rewards: 65.747, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.834', 'AMMO2': '0.007', 'AMMO5': '0.010', 'weapon4': '0.032', 'AMMO4': '0.034', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.492', 'WEAPON3': '1.300', 'weapon3': '3.194', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '56.000'} [2023-02-25 14:13:27,305][36141] DAMAGECOUNT value on done: 850569.0 [2023-02-25 14:13:27,305][36141] Sum rewards: 60.098, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.705', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.092', 'weapon2': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'weapon4': '0.538', 'WEAPON3': '1.450', 'weapon3': '2.920', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.921', 'FRAGCOUNT': '51.000'} [2023-02-25 14:13:28,474][36157] DAMAGECOUNT value on done: 868405.0 [2023-02-25 14:13:28,474][36157] Sum rewards: 59.057, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.910', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.140', 'weapon4': '0.180', 'AMMO3': '0.204', 'weapon2': '0.314', 'WEAPON3': '1.300', 'HITCOUNT': '3.060', 'weapon3': '3.178', 'DAMAGECOUNT': '15.030', 'FRAGCOUNT': '50.000'} [2023-02-25 14:13:28,790][36157] DAMAGECOUNT value on done: 857212.0 [2023-02-25 14:13:28,790][36157] Sum rewards: 62.832, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.394', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.086', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon4': '0.292', 'weapon2': '0.516', 'WEAPON3': '1.100', 'weapon3': '2.904', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.729', 'FRAGCOUNT': '53.000'} [2023-02-25 14:13:28,963][36138] Updated weights for policy 0, policy_version 48773 (0.0009) [2023-02-25 14:13:29,150][36140] DAMAGECOUNT value on done: 861985.0 [2023-02-25 14:13:29,150][36140] Sum rewards: 57.172, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.694', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'AMMO3': '0.155', 'weapon5': '0.184', 'WEAPON5': '0.200', 'weapon2': '0.222', 'weapon4': '0.290', 'WEAPON3': '1.000', 'HITCOUNT': '2.930', 'weapon3': '3.144', 'DAMAGECOUNT': '14.715', 'FRAGCOUNT': '46.000'} [2023-02-25 14:13:29,382][36157] DAMAGECOUNT value on done: 868628.0 [2023-02-25 14:13:29,383][36157] Sum rewards: 57.017, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.607', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.154', 'AMMO3': '0.223', 'weapon2': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.826', 'WEAPON3': '1.350', 'weapon3': '2.514', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.763', 'FRAGCOUNT': '50.000'} [2023-02-25 14:13:29,462][36140] DAMAGECOUNT value on done: 844164.0 [2023-02-25 14:13:29,463][36140] Sum rewards: 48.384, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.182', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.048', 'AMMO3': '0.177', 'AMMO4': '0.239', 'weapon2': '0.244', 'weapon5': '0.388', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.772', 'WEAPON3': '0.950', 'weapon3': '2.016', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '12.261', 'FRAGCOUNT': '43.000'} [2023-02-25 14:13:29,583][36140] DAMAGECOUNT value on done: 854784.0 [2023-02-25 14:13:29,583][36140] Sum rewards: 61.103, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.694', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.048', 'AMMO4': '0.114', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'WEAPON4': '0.350', 'weapon2': '0.478', 'weapon4': '0.726', 'WEAPON3': '1.300', 'weapon3': '2.494', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '15.504', 'FRAGCOUNT': '53.000'} [2023-02-25 14:13:29,691][36157] DAMAGECOUNT value on done: 861502.0 [2023-02-25 14:13:29,691][36157] Sum rewards: 50.862, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.064', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.116', 'AMMO4': '0.168', 'AMMO3': '0.198', 'WEAPON5': '0.250', 'weapon4': '0.324', 'WEAPON4': '0.400', 'weapon2': '0.422', 'ARMOR': '0.468', 'WEAPON3': '1.250', 'weapon3': '2.906', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.899', 'FRAGCOUNT': '44.500'} [2023-02-25 14:13:29,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.2, 300 sec: 13412.7). Total num frames: 199782400. Throughput: 0: 3349.2. Samples: 12440264. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:13:29,730][36114] Avg episode reward: [(0, '55.930')] [2023-02-25 14:13:29,885][36140] DAMAGECOUNT value on done: 854933.0 [2023-02-25 14:13:29,886][36140] Sum rewards: 49.748, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.340', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.077', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'weapon5': '0.234', 'weapon4': '0.292', 'WEAPON5': '0.300', 'weapon2': '0.528', 'WEAPON3': '0.900', 'weapon3': '2.700', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.645', 'FRAGCOUNT': '42.000'} [2023-02-25 14:13:31,392][36142] DAMAGECOUNT value on done: 863717.0 [2023-02-25 14:13:31,392][36142] Sum rewards: 54.633, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.125', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.042', 'AMMO3': '0.156', 'weapon5': '0.194', 'AMMO4': '0.211', 'WEAPON5': '0.300', 'weapon2': '0.476', 'WEAPON4': '0.500', 'weapon4': '0.692', 'WEAPON3': '1.000', 'weapon3': '2.360', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.379', 'FRAGCOUNT': '46.000'} [2023-02-25 14:13:31,708][36142] DAMAGECOUNT value on done: 842597.0 [2023-02-25 14:13:31,708][36142] Sum rewards: 49.266, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.000', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.040', 'AMMO3': '0.184', 'weapon5': '0.196', 'AMMO4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON4': '0.350', 'weapon4': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.790', 'weapon3': '2.794', 'DAMAGECOUNT': '12.828', 'FRAGCOUNT': '44.000'} [2023-02-25 14:13:31,751][36155] DAMAGECOUNT value on done: 851856.0 [2023-02-25 14:13:31,752][36155] Sum rewards: 57.441, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.532', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.041', 'AMMO3': '0.180', 'AMMO4': '0.207', 'weapon5': '0.208', 'weapon2': '0.280', 'WEAPON5': '0.300', 'weapon4': '0.382', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.814', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '15.150', 'FRAGCOUNT': '50.000'} [2023-02-25 14:13:31,850][36142] DAMAGECOUNT value on done: 852386.0 [2023-02-25 14:13:31,851][36142] Sum rewards: 59.392, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.170', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon4': '0.242', 'weapon2': '0.296', 'WEAPON3': '1.400', 'weapon3': '3.090', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '53.000'} [2023-02-25 14:13:32,021][36138] Updated weights for policy 0, policy_version 48783 (0.0009) [2023-02-25 14:13:32,059][36155] DAMAGECOUNT value on done: 866213.0 [2023-02-25 14:13:32,059][36155] Sum rewards: 51.979, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.788', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO3': '0.191', 'AMMO4': '0.224', 'weapon5': '0.300', 'weapon2': '0.448', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.840', 'WEAPON3': '1.100', 'weapon3': '2.100', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '44.000'} [2023-02-25 14:13:32,175][36142] DAMAGECOUNT value on done: 867798.0 [2023-02-25 14:13:32,176][36142] Sum rewards: 60.845, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.980', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.150', 'weapon5': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.438', 'weapon4': '0.570', 'WEAPON3': '0.950', 'weapon3': '2.500', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.607', 'FRAGCOUNT': '52.000'} [2023-02-25 14:13:32,761][36156] DAMAGECOUNT value on done: 865701.0 [2023-02-25 14:13:32,761][36156] Sum rewards: 48.330, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.375', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.136', 'AMMO3': '0.167', 'weapon5': '0.178', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.396', 'weapon4': '0.512', 'WEAPON3': '1.100', 'HITCOUNT': '2.590', 'weapon3': '2.620', 'DAMAGECOUNT': '13.119', 'FRAGCOUNT': '40.500'} [2023-02-25 14:13:32,800][36156] DAMAGECOUNT value on done: 869319.0 [2023-02-25 14:13:32,800][36156] Sum rewards: 55.524, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.040', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.120', 'AMMO4': '0.141', 'weapon2': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon4': '0.340', 'WEAPON3': '1.200', 'HITCOUNT': '2.910', 'weapon3': '3.184', 'DAMAGECOUNT': '14.064', 'FRAGCOUNT': '48.000'} [2023-02-25 14:13:32,994][36155] DAMAGECOUNT value on done: 868258.0 [2023-02-25 14:13:32,995][36155] Sum rewards: 56.637, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.265', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.104', 'AMMO3': '0.140', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.404', 'weapon4': '0.608', 'WEAPON3': '0.900', 'weapon3': '2.618', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.460', 'FRAGCOUNT': '46.000'} [2023-02-25 14:13:33,079][36156] DAMAGECOUNT value on done: 854452.0 [2023-02-25 14:13:33,080][36156] Sum rewards: 49.400, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.582', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon5': '0.072', 'AMMO3': '0.168', 'AMMO4': '0.245', 'WEAPON5': '0.250', 'weapon2': '0.278', 'weapon4': '0.366', 'WEAPON4': '0.400', 'ARMOR': '0.404', 'WEAPON3': '1.100', 'HITCOUNT': '2.850', 'weapon3': '3.092', 'DAMAGECOUNT': '13.197', 'FRAGCOUNT': '43.000'} [2023-02-25 14:13:33,119][36156] DAMAGECOUNT value on done: 861159.0 [2023-02-25 14:13:33,119][36156] Sum rewards: 41.378, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.858', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.047', 'AMMO3': '0.224', 'AMMO4': '0.237', 'weapon5': '0.272', 'weapon4': '0.304', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.504', 'WEAPON3': '1.300', 'weapon3': '2.628', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '13.149', 'FRAGCOUNT': '40.000'} [2023-02-25 14:13:33,298][36155] DAMAGECOUNT value on done: 856283.0 [2023-02-25 14:13:33,299][36155] Sum rewards: 62.556, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.850', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'weapon4': '0.142', 'WEAPON4': '0.150', 'weapon2': '0.180', 'AMMO3': '0.202', 'WEAPON3': '1.300', 'HITCOUNT': '3.250', 'weapon3': '3.494', 'DAMAGECOUNT': '15.795', 'FRAGCOUNT': '54.000'} [2023-02-25 14:13:33,881][36139] DAMAGECOUNT value on done: 860515.0 [2023-02-25 14:13:33,882][36139] Sum rewards: 51.145, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.131', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.015', 'weapon5': '0.054', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'weapon4': '0.192', 'WEAPON4': '0.200', 'weapon2': '0.310', 'WEAPON3': '1.100', 'HITCOUNT': '2.960', 'weapon3': '3.266', 'DAMAGECOUNT': '13.560', 'FRAGCOUNT': '43.000'} [2023-02-25 14:13:34,182][36139] DAMAGECOUNT value on done: 853736.0 [2023-02-25 14:13:34,182][36139] Sum rewards: 62.317, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.700', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.066', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon4': '0.348', 'weapon2': '0.518', 'WEAPON3': '1.100', 'weapon3': '2.866', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '51.000'} [2023-02-25 14:13:34,559][36139] DAMAGECOUNT value on done: 871049.0 [2023-02-25 14:13:34,559][36139] Sum rewards: 58.144, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.062', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.004', 'AMMO4': '0.021', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.148', 'weapon4': '0.176', 'weapon2': '0.426', 'WEAPON3': '1.000', 'HITCOUNT': '3.070', 'weapon3': '3.202', 'DAMAGECOUNT': '13.902', 'FRAGCOUNT': '47.000'} [2023-02-25 14:13:34,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 199847936. Throughput: 0: 3350.9. Samples: 12460384. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:13:34,730][36114] Avg episode reward: [(0, '56.371')] [2023-02-25 14:13:34,871][36139] DAMAGECOUNT value on done: 866699.0 [2023-02-25 14:13:34,871][36139] Sum rewards: 59.959, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.948', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.193', 'weapon2': '0.238', 'weapon5': '0.290', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon4': '1.162', 'weapon3': '1.900', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.542', 'FRAGCOUNT': '51.000'} [2023-02-25 14:13:35,102][36138] Updated weights for policy 0, policy_version 48793 (0.0009) [2023-02-25 14:13:37,540][36141] Large shaping reward 2.592 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('weapon5', 0.002)] [2023-02-25 14:13:38,186][36138] Updated weights for policy 0, policy_version 48803 (0.0009) [2023-02-25 14:13:39,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 199917568. Throughput: 0: 3349.9. Samples: 12470348. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:13:39,730][36114] Avg episode reward: [(0, '56.441')] [2023-02-25 14:13:41,200][36138] Updated weights for policy 0, policy_version 48813 (0.0009) [2023-02-25 14:13:44,252][36138] Updated weights for policy 0, policy_version 48823 (0.0009) [2023-02-25 14:13:44,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 199983104. Throughput: 0: 3348.7. Samples: 12490448. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:13:44,730][36114] Avg episode reward: [(0, '56.441')] [2023-02-25 14:13:45,759][36154] DAMAGECOUNT value on done: 864501.0 [2023-02-25 14:13:45,760][36154] Sum rewards: 50.567, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.828', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.150', 'AMMO4': '0.178', 'WEAPON4': '0.250', 'weapon2': '0.596', 'weapon4': '0.626', 'WEAPON3': '0.900', 'weapon3': '2.374', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.377', 'FRAGCOUNT': '41.000'} [2023-02-25 14:13:46,057][36154] DAMAGECOUNT value on done: 851622.0 [2023-02-25 14:13:46,057][36154] Sum rewards: 57.993, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'weapon5': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.169', 'HEALTH': '0.170', 'weapon4': '0.268', 'weapon2': '0.316', 'WEAPON3': '1.000', 'weapon3': '3.116', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.046', 'FRAGCOUNT': '48.000'} [2023-02-25 14:13:46,127][36154] DAMAGECOUNT value on done: 864872.0 [2023-02-25 14:13:46,128][36154] Sum rewards: 52.466, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.390', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.104', 'AMMO4': '0.113', 'weapon4': '0.144', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.702', 'WEAPON3': '1.100', 'weapon3': '2.868', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.692', 'FRAGCOUNT': '43.000'} [2023-02-25 14:13:46,444][36154] DAMAGECOUNT value on done: 862995.0 [2023-02-25 14:13:46,444][36154] Sum rewards: 58.417, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.627', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.138', 'AMMO4': '0.158', 'AMMO3': '0.206', 'weapon2': '0.248', 'WEAPON5': '0.250', 'weapon4': '0.294', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.098', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.993', 'FRAGCOUNT': '50.000'} [2023-02-25 14:13:46,799][36141] DAMAGECOUNT value on done: 868136.0 [2023-02-25 14:13:46,799][36141] Sum rewards: 57.068, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.180', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon5': '0.176', 'AMMO4': '0.216', 'AMMO3': '0.226', 'weapon4': '0.232', 'weapon2': '0.330', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.850', 'weapon3': '2.896', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '51.000'} [2023-02-25 14:13:47,108][36141] DAMAGECOUNT value on done: 861778.0 [2023-02-25 14:13:47,108][36141] Sum rewards: 68.250, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.517', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.142', 'AMMO3': '0.157', 'weapon2': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.716', 'WEAPON3': '0.900', 'weapon3': '2.666', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '55.000'} [2023-02-25 14:13:47,116][36141] DAMAGECOUNT value on done: 868164.0 [2023-02-25 14:13:47,117][36141] Sum rewards: 70.334, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.975', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.106', 'AMMO4': '0.131', 'weapon2': '0.202', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'weapon4': '0.282', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.096', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '62.000'} [2023-02-25 14:13:47,303][36138] Updated weights for policy 0, policy_version 48833 (0.0009) [2023-02-25 14:13:47,400][36141] DAMAGECOUNT value on done: 856275.0 [2023-02-25 14:13:47,400][36141] Sum rewards: 64.244, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.965', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.120', 'AMMO3': '0.183', 'weapon5': '0.184', 'AMMO4': '0.191', 'weapon2': '0.342', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'HITCOUNT': '3.050', 'weapon3': '3.064', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '54.000'} [2023-02-25 14:13:48,644][36157] DAMAGECOUNT value on done: 873617.0 [2023-02-25 14:13:48,644][36157] Sum rewards: 49.694, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.550', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.110', 'AMMO4': '0.115', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.272', 'AMMO3': '0.295', 'weapon4': '0.526', 'WEAPON3': '1.800', 'weapon3': '2.810', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '46.000'} [2023-02-25 14:13:48,980][36157] DAMAGECOUNT value on done: 862463.0 [2023-02-25 14:13:48,981][36157] Sum rewards: 63.448, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.225', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.104', 'AMMO4': '0.130', 'AMMO3': '0.154', 'WEAPON5': '0.200', 'weapon4': '0.308', 'WEAPON4': '0.350', 'weapon2': '0.714', 'WEAPON3': '1.000', 'weapon3': '2.598', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '53.000'} [2023-02-25 14:13:49,353][36140] DAMAGECOUNT value on done: 866552.0 [2023-02-25 14:13:49,353][36140] Sum rewards: 49.785, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.636', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.184', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.322', 'weapon4': '0.370', 'ARMOR': '0.408', 'WEAPON3': '1.350', 'HITCOUNT': '2.910', 'weapon3': '3.012', 'DAMAGECOUNT': '13.701', 'FRAGCOUNT': '45.000'} [2023-02-25 14:13:49,593][36157] DAMAGECOUNT value on done: 873948.0 [2023-02-25 14:13:49,593][36157] Sum rewards: 59.929, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.966', 'AMMO5': '0.016', 'AMMO2': '0.046', 'AMMO3': '0.126', 'weapon4': '0.182', 'AMMO4': '0.231', 'weapon5': '0.246', 'weapon2': '0.372', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'HITCOUNT': '2.780', 'weapon3': '2.936', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '49.000'} [2023-02-25 14:13:49,664][36140] DAMAGECOUNT value on done: 849056.0 [2023-02-25 14:13:49,664][36140] Sum rewards: 54.414, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.526', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.029', 'weapon5': '0.102', 'AMMO4': '0.145', 'AMMO3': '0.163', 'weapon2': '0.372', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.860', 'WEAPON3': '0.950', 'weapon3': '2.398', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '47.000'} [2023-02-25 14:13:49,729][36114] Fps is (10 sec: 13106.9, 60 sec: 13380.2, 300 sec: 13412.6). Total num frames: 200048640. Throughput: 0: 3347.5. Samples: 12510488. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:13:49,730][36114] Avg episode reward: [(0, '56.551')] [2023-02-25 14:13:49,750][36140] DAMAGECOUNT value on done: 860212.0 [2023-02-25 14:13:49,751][36140] Sum rewards: 62.165, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.263', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.176', 'weapon5': '0.182', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.322', 'weapon2': '0.606', 'WEAPON3': '1.150', 'weapon3': '2.610', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '51.000'} [2023-02-25 14:13:49,904][36157] DAMAGECOUNT value on done: 866034.0 [2023-02-25 14:13:49,904][36157] Sum rewards: 42.289, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.428', 'AMMO5': '0.021', 'AMMO2': '0.049', 'weapon5': '0.204', 'AMMO3': '0.206', 'AMMO4': '0.247', 'weapon4': '0.366', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.608', 'WEAPON3': '1.350', 'weapon3': '2.500', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.596', 'FRAGCOUNT': '40.000'} [2023-02-25 14:13:50,058][36140] DAMAGECOUNT value on done: 860317.0 [2023-02-25 14:13:50,058][36140] Sum rewards: 61.970, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.882', 'AMMO5': '0.012', 'AMMO2': '0.044', 'AMMO3': '0.210', 'AMMO4': '0.219', 'weapon5': '0.238', 'weapon2': '0.264', 'WEAPON5': '0.300', 'ARMOR': '0.455', 'WEAPON4': '0.500', 'weapon4': '0.656', 'WEAPON3': '1.300', 'weapon3': '2.522', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '53.000'} [2023-02-25 14:13:50,399][36138] Updated weights for policy 0, policy_version 48843 (0.0010) [2023-02-25 14:13:50,489][36139] Large shaping reward 2.523 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.501, 167.0), ('weapon5', 0.002)] [2023-02-25 14:13:51,502][36142] DAMAGECOUNT value on done: 868829.0 [2023-02-25 14:13:51,502][36142] Sum rewards: 56.713, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.695', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.046', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.176', 'AMMO3': '0.257', 'WEAPON3': '1.650', 'HITCOUNT': '3.090', 'weapon3': '3.570', 'DAMAGECOUNT': '15.336', 'FRAGCOUNT': '51.000'} [2023-02-25 14:13:51,768][36155] DAMAGECOUNT value on done: 856955.0 [2023-02-25 14:13:51,769][36155] Sum rewards: 64.427, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.730', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.242', 'weapon2': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '3.340', 'weapon3': '3.416', 'DAMAGECOUNT': '15.297', 'FRAGCOUNT': '56.000'} [2023-02-25 14:13:51,815][36142] DAMAGECOUNT value on done: 848347.0 [2023-02-25 14:13:51,816][36142] Sum rewards: 68.577, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.128', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.060', 'AMMO4': '0.095', 'weapon5': '0.148', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.218', 'WEAPON3': '1.150', 'HITCOUNT': '3.280', 'weapon3': '3.396', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '57.000'} [2023-02-25 14:13:52,024][36142] DAMAGECOUNT value on done: 856618.0 [2023-02-25 14:13:52,024][36142] Sum rewards: 49.868, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.208', 'AMMO5': '0.003', 'weapon5': '0.032', 'AMMO2': '0.049', 'WEAPON5': '0.050', 'AMMO3': '0.182', 'AMMO4': '0.244', 'weapon4': '0.346', 'WEAPON4': '0.500', 'weapon2': '0.698', 'WEAPON3': '1.150', 'weapon3': '2.746', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '12.696', 'FRAGCOUNT': '47.000'} [2023-02-25 14:13:52,082][36155] DAMAGECOUNT value on done: 870868.0 [2023-02-25 14:13:52,082][36155] Sum rewards: 60.698, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.260', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.128', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon4': '0.238', 'weapon2': '0.368', 'WEAPON3': '1.250', 'HITCOUNT': '2.950', 'weapon3': '3.048', 'DAMAGECOUNT': '13.965', 'FRAGCOUNT': '55.000'} [2023-02-25 14:13:52,323][36142] DAMAGECOUNT value on done: 872709.0 [2023-02-25 14:13:52,323][36142] Sum rewards: 58.287, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.180', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.018', 'AMMO4': '0.020', 'weapon5': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.226', 'weapon2': '0.262', 'WEAPON3': '1.400', 'HITCOUNT': '3.420', 'weapon3': '3.508', 'DAMAGECOUNT': '14.733', 'FRAGCOUNT': '50.000'} [2023-02-25 14:13:52,997][36156] DAMAGECOUNT value on done: 871207.0 [2023-02-25 14:13:52,997][36156] Sum rewards: 67.378, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.440', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'AMMO3': '0.183', 'weapon2': '0.230', 'WEAPON4': '0.300', 'weapon4': '0.750', 'WEAPON3': '1.150', 'weapon3': '2.634', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '56.000'} [2023-02-25 14:13:53,008][36156] DAMAGECOUNT value on done: 874498.0 [2023-02-25 14:13:53,008][36156] Sum rewards: 59.409, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.208', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.080', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.245', 'weapon2': '0.256', 'WEAPON4': '0.300', 'weapon4': '0.430', 'WEAPON3': '1.400', 'weapon3': '2.924', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '53.000'} [2023-02-25 14:13:53,084][36155] DAMAGECOUNT value on done: 872767.0 [2023-02-25 14:13:53,084][36155] Sum rewards: 54.536, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.595', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.016', 'weapon5': '0.090', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.234', 'weapon2': '0.452', 'WEAPON3': '1.000', 'HITCOUNT': '2.800', 'weapon3': '3.058', 'DAMAGECOUNT': '13.527', 'FRAGCOUNT': '45.000'} [2023-02-25 14:13:53,322][36156] DAMAGECOUNT value on done: 859425.0 [2023-02-25 14:13:53,323][36156] Sum rewards: 52.347, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.232', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.096', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon4': '0.382', 'weapon2': '0.528', 'WEAPON3': '1.400', 'weapon3': '2.748', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '46.000'} [2023-02-25 14:13:53,334][36156] DAMAGECOUNT value on done: 865384.0 [2023-02-25 14:13:53,335][36156] Sum rewards: 39.197, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.585', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon5': '0.200', 'AMMO4': '0.201', 'weapon2': '0.220', 'AMMO3': '0.249', 'WEAPON5': '0.400', 'weapon4': '0.498', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.632', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '12.675', 'FRAGCOUNT': '39.000'} [2023-02-25 14:13:53,396][36155] DAMAGECOUNT value on done: 860823.0 [2023-02-25 14:13:53,397][36155] Sum rewards: 53.199, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.144', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO4': '0.167', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'weapon2': '0.304', 'weapon5': '0.324', 'WEAPON5': '0.350', 'weapon4': '0.364', 'WEAPON3': '1.250', 'weapon3': '2.580', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.620', 'FRAGCOUNT': '47.000'} [2023-02-25 14:13:53,485][36138] Updated weights for policy 0, policy_version 48853 (0.0009) [2023-02-25 14:13:53,956][36139] DAMAGECOUNT value on done: 865815.0 [2023-02-25 14:13:53,957][36139] Sum rewards: 57.261, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.450', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.044', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.400', 'weapon4': '0.566', 'WEAPON3': '1.350', 'weapon3': '2.682', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '49.000'} [2023-02-25 14:13:54,271][36139] DAMAGECOUNT value on done: 858737.0 [2023-02-25 14:13:54,272][36139] Sum rewards: 54.275, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.420', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.074', 'AMMO4': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon4': '0.268', 'weapon2': '0.366', 'WEAPON3': '1.400', 'HITCOUNT': '3.010', 'weapon3': '3.028', 'DAMAGECOUNT': '15.003', 'FRAGCOUNT': '50.000'} [2023-02-25 14:13:54,667][36139] DAMAGECOUNT value on done: 875504.0 [2023-02-25 14:13:54,667][36139] Sum rewards: 50.469, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.300', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.149', 'weapon5': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.500', 'weapon4': '0.746', 'WEAPON3': '0.950', 'weapon3': '2.080', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.365', 'FRAGCOUNT': '43.000'} [2023-02-25 14:13:54,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 200118272. Throughput: 0: 3350.1. Samples: 12520468. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:13:54,730][36114] Avg episode reward: [(0, '56.394')] [2023-02-25 14:13:54,967][36139] DAMAGECOUNT value on done: 872708.0 [2023-02-25 14:13:54,968][36139] Sum rewards: 65.240, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.374', 'AMMO5': '0.020', 'AMMO2': '0.052', 'AMMO3': '0.232', 'AMMO4': '0.260', 'weapon2': '0.292', 'weapon5': '0.304', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.592', 'WEAPON3': '1.300', 'weapon3': '2.424', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '56.000'} [2023-02-25 14:13:56,536][36138] Updated weights for policy 0, policy_version 48863 (0.0010) [2023-02-25 14:13:59,570][36138] Updated weights for policy 0, policy_version 48873 (0.0009) [2023-02-25 14:13:59,729][36114] Fps is (10 sec: 13517.1, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 200183808. Throughput: 0: 3351.6. Samples: 12540576. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:13:59,730][36114] Avg episode reward: [(0, '56.555')] [2023-02-25 14:14:02,674][36138] Updated weights for policy 0, policy_version 48883 (0.0009) [2023-02-25 14:14:04,729][36114] Fps is (10 sec: 13106.9, 60 sec: 13380.2, 300 sec: 13412.7). Total num frames: 200249344. Throughput: 0: 3344.6. Samples: 12560606. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:14:04,730][36114] Avg episode reward: [(0, '56.555')] [2023-02-25 14:14:05,702][36138] Updated weights for policy 0, policy_version 48893 (0.0009) [2023-02-25 14:14:06,023][36154] DAMAGECOUNT value on done: 868791.0 [2023-02-25 14:14:06,024][36154] Sum rewards: 43.166, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.730', 'ARMOR': '0.009', 'AMMO5': '0.018', 'AMMO2': '0.043', 'AMMO3': '0.140', 'AMMO4': '0.214', 'weapon2': '0.232', 'weapon5': '0.248', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '0.900', 'weapon4': '1.246', 'weapon3': '1.726', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.870', 'FRAGCOUNT': '37.000'} [2023-02-25 14:14:06,347][36154] DAMAGECOUNT value on done: 857192.0 [2023-02-25 14:14:06,347][36154] Sum rewards: 61.165, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-4.230', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon4': '0.096', 'weapon5': '0.116', 'AMMO4': '0.237', 'AMMO3': '0.278', 'weapon2': '0.380', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.094', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '58.000'} [2023-02-25 14:14:06,463][36154] DAMAGECOUNT value on done: 869958.0 [2023-02-25 14:14:06,463][36154] Sum rewards: 53.888, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.494', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.039', 'weapon4': '0.072', 'weapon5': '0.096', 'AMMO4': '0.195', 'weapon2': '0.256', 'AMMO3': '0.263', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'HITCOUNT': '3.230', 'weapon3': '3.246', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '50.000'} [2023-02-25 14:14:06,782][36154] DAMAGECOUNT value on done: 867565.0 [2023-02-25 14:14:06,783][36154] Sum rewards: 45.095, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.554', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon5': '0.130', 'AMMO4': '0.209', 'AMMO3': '0.245', 'weapon2': '0.372', 'ARMOR': '0.443', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'weapon4': '0.644', 'WEAPON3': '1.450', 'weapon3': '2.348', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '13.710', 'FRAGCOUNT': '44.000'} [2023-02-25 14:14:06,869][36141] DAMAGECOUNT value on done: 873304.0 [2023-02-25 14:14:06,869][36141] Sum rewards: 55.199, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.587', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.134', 'weapon2': '0.164', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'AMMO4': '0.225', 'WEAPON4': '0.300', 'weapon4': '1.054', 'WEAPON3': '1.250', 'weapon3': '2.198', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.189', 'FRAGCOUNT': '47.000'} [2023-02-25 14:14:07,170][36141] DAMAGECOUNT value on done: 866492.0 [2023-02-25 14:14:07,170][36141] Sum rewards: 52.823, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.271', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon5': '0.162', 'AMMO3': '0.181', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON4': '0.400', 'weapon4': '0.630', 'WEAPON3': '1.050', 'weapon3': '2.724', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.142', 'FRAGCOUNT': '45.000'} [2023-02-25 14:14:07,212][36141] DAMAGECOUNT value on done: 872857.0 [2023-02-25 14:14:07,212][36141] Sum rewards: 44.976, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.815', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon5': '0.148', 'weapon2': '0.254', 'AMMO3': '0.261', 'AMMO4': '0.264', 'WEAPON5': '0.350', 'weapon4': '0.412', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'HITCOUNT': '2.740', 'weapon3': '2.860', 'DAMAGECOUNT': '14.079', 'FRAGCOUNT': '44.000'} [2023-02-25 14:14:07,477][36141] DAMAGECOUNT value on done: 861599.0 [2023-02-25 14:14:07,477][36141] Sum rewards: 59.477, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.414', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.043', 'weapon5': '0.156', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'AMMO4': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.322', 'weapon4': '0.378', 'WEAPON3': '1.250', 'weapon3': '2.914', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.957', 'FRAGCOUNT': '50.000'} [2023-02-25 14:14:08,768][36138] Updated weights for policy 0, policy_version 48903 (0.0009) [2023-02-25 14:14:08,815][36157] DAMAGECOUNT value on done: 878783.0 [2023-02-25 14:14:08,815][36157] Sum rewards: 59.087, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.944', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.032', 'AMMO4': '0.110', 'weapon5': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.354', 'WEAPON3': '1.300', 'HITCOUNT': '3.040', 'weapon3': '3.194', 'DAMAGECOUNT': '15.498', 'FRAGCOUNT': '51.000'} [2023-02-25 14:14:09,124][36157] DAMAGECOUNT value on done: 867806.0 [2023-02-25 14:14:09,125][36157] Sum rewards: 51.972, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.340', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.039', 'AMMO4': '0.196', 'AMMO3': '0.208', 'weapon5': '0.320', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'weapon2': '0.726', 'weapon4': '0.776', 'WEAPON3': '1.200', 'weapon3': '1.846', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.029', 'FRAGCOUNT': '43.500'} [2023-02-25 14:14:09,435][36140] DAMAGECOUNT value on done: 871582.0 [2023-02-25 14:14:09,436][36140] Sum rewards: 54.773, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.049', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.261', 'weapon2': '0.396', 'weapon4': '0.448', 'WEAPON3': '1.600', 'weapon3': '2.688', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.090', 'FRAGCOUNT': '50.000'} [2023-02-25 14:14:09,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13412.7). Total num frames: 200318976. Throughput: 0: 3344.0. Samples: 12570592. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:14:09,729][36114] Avg episode reward: [(0, '55.863')] [2023-02-25 14:14:09,755][36140] DAMAGECOUNT value on done: 853881.0 [2023-02-25 14:14:09,756][36140] Sum rewards: 51.008, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.202', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.092', 'AMMO4': '0.099', 'weapon2': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.278', 'weapon4': '0.418', 'WEAPON3': '1.600', 'HITCOUNT': '3.000', 'weapon3': '3.018', 'DAMAGECOUNT': '14.475', 'FRAGCOUNT': '47.000'} [2023-02-25 14:14:09,758][36157] DAMAGECOUNT value on done: 879133.0 [2023-02-25 14:14:09,758][36157] Sum rewards: 64.765, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.610', 'ARMOR': '0.004', 'AMMO2': '0.014', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'weapon2': '0.248', 'AMMO3': '0.270', 'weapon4': '0.298', 'WEAPON3': '1.750', 'weapon3': '3.218', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '59.000'} [2023-02-25 14:14:09,831][36140] DAMAGECOUNT value on done: 864945.0 [2023-02-25 14:14:09,831][36140] Sum rewards: 50.755, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.526', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.154', 'AMMO3': '0.232', 'weapon4': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.350', 'HITCOUNT': '2.900', 'weapon3': '3.058', 'DAMAGECOUNT': '14.199', 'FRAGCOUNT': '46.000'} [2023-02-25 14:14:10,067][36157] DAMAGECOUNT value on done: 871185.0 [2023-02-25 14:14:10,067][36157] Sum rewards: 64.285, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.145', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'weapon2': '0.306', 'weapon4': '0.482', 'WEAPON3': '1.100', 'weapon3': '2.874', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.453', 'FRAGCOUNT': '53.000'} [2023-02-25 14:14:10,146][36140] DAMAGECOUNT value on done: 865478.0 [2023-02-25 14:14:10,147][36140] Sum rewards: 60.467, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.028', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon5': '0.102', 'AMMO3': '0.202', 'AMMO4': '0.234', 'WEAPON5': '0.350', 'weapon4': '0.414', 'weapon2': '0.476', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.750', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.483', 'FRAGCOUNT': '53.000'} [2023-02-25 14:14:10,805][36155] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:14:11,583][36142] DAMAGECOUNT value on done: 874169.0 [2023-02-25 14:14:11,583][36142] Sum rewards: 61.790, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.815', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.112', 'weapon4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'weapon2': '0.432', 'WEAPON3': '1.450', 'weapon3': '3.048', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '15.750', 'FRAGCOUNT': '55.000'} [2023-02-25 14:14:11,741][36155] DAMAGECOUNT value on done: 862054.0 [2023-02-25 14:14:11,742][36155] Sum rewards: 51.531, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.137', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon5': '0.124', 'AMMO4': '0.222', 'AMMO3': '0.224', 'weapon2': '0.266', 'WEAPON5': '0.400', 'weapon4': '0.538', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.768', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.297', 'FRAGCOUNT': '46.000'} [2023-02-25 14:14:11,840][36138] Updated weights for policy 0, policy_version 48913 (0.0009) [2023-02-25 14:14:11,894][36142] DAMAGECOUNT value on done: 853912.0 [2023-02-25 14:14:11,895][36142] Sum rewards: 65.648, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.787', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.062', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.202', 'AMMO3': '0.210', 'weapon2': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.108', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '55.000'} [2023-02-25 14:14:12,052][36155] DAMAGECOUNT value on done: 875907.0 [2023-02-25 14:14:12,053][36155] Sum rewards: 57.168, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.874', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon5': '0.180', 'weapon2': '0.202', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.452', 'WEAPON3': '1.200', 'HITCOUNT': '2.850', 'weapon3': '2.860', 'DAMAGECOUNT': '15.036', 'FRAGCOUNT': '50.000'} [2023-02-25 14:14:12,150][36142] DAMAGECOUNT value on done: 861577.0 [2023-02-25 14:14:12,150][36142] Sum rewards: 60.611, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.066', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.098', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'weapon2': '0.458', 'weapon4': '0.684', 'WEAPON3': '1.100', 'weapon3': '2.456', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '14.877', 'FRAGCOUNT': '51.000'} [2023-02-25 14:14:12,473][36142] DAMAGECOUNT value on done: 877545.0 [2023-02-25 14:14:12,474][36142] Sum rewards: 49.276, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.875', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'WEAPON4': '0.200', 'AMMO3': '0.255', 'weapon4': '0.260', 'weapon2': '0.534', 'WEAPON3': '1.600', 'weapon3': '2.968', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.508', 'FRAGCOUNT': '46.000'} [2023-02-25 14:14:13,074][36155] DAMAGECOUNT value on done: 878806.0 [2023-02-25 14:14:13,074][36155] Sum rewards: 72.771, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.532', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.056', 'AMMO4': '0.070', 'weapon4': '0.134', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.294', 'WEAPON3': '1.250', 'weapon3': '3.322', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '61.000'} [2023-02-25 14:14:13,221][36156] DAMAGECOUNT value on done: 874921.0 [2023-02-25 14:14:13,222][36156] Sum rewards: 51.716, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.204', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO3': '0.137', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO4': '0.159', 'WEAPON4': '0.200', 'weapon2': '0.332', 'WEAPON3': '0.800', 'weapon4': '0.976', 'weapon3': '2.378', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '11.142', 'FRAGCOUNT': '44.000'} [2023-02-25 14:14:13,232][36156] DAMAGECOUNT value on done: 879751.0 [2023-02-25 14:14:13,232][36156] Sum rewards: 58.281, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.172', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.140', 'AMMO4': '0.185', 'AMMO3': '0.219', 'WEAPON5': '0.300', 'weapon2': '0.394', 'WEAPON4': '0.500', 'weapon4': '0.572', 'WEAPON3': '1.150', 'weapon3': '2.550', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '50.000'} [2023-02-25 14:14:13,384][36155] DAMAGECOUNT value on done: 865418.0 [2023-02-25 14:14:13,384][36155] Sum rewards: 56.927, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.682', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.062', 'AMMO4': '0.088', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'weapon4': '0.318', 'weapon2': '0.394', 'WEAPON3': '1.250', 'weapon3': '2.874', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.785', 'FRAGCOUNT': '50.000'} [2023-02-25 14:14:13,537][36156] DAMAGECOUNT value on done: 864179.0 [2023-02-25 14:14:13,537][36156] Sum rewards: 46.850, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.615', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.050', 'AMMO3': '0.195', 'AMMO4': '0.252', 'weapon5': '0.262', 'weapon2': '0.272', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.874', 'WEAPON3': '1.150', 'weapon3': '2.176', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.262', 'FRAGCOUNT': '41.500'} [2023-02-25 14:14:13,547][36156] DAMAGECOUNT value on done: 870774.0 [2023-02-25 14:14:13,547][36156] Sum rewards: 69.436, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.488', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.046', 'weapon4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'weapon2': '0.206', 'WEAPON3': '1.000', 'HITCOUNT': '3.480', 'weapon3': '3.522', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '57.000'} [2023-02-25 14:14:13,981][36139] DAMAGECOUNT value on done: 870755.0 [2023-02-25 14:14:13,982][36139] Sum rewards: 54.047, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.048', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon2': '0.254', 'WEAPON4': '0.350', 'weapon4': '0.458', 'WEAPON3': '1.250', 'weapon3': '2.918', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.820', 'FRAGCOUNT': '48.000'} [2023-02-25 14:14:14,299][36139] DAMAGECOUNT value on done: 863826.0 [2023-02-25 14:14:14,299][36139] Sum rewards: 68.396, reward structure: {'DEATHCOUNT': '-10.500', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'AMMO3': '0.135', 'weapon4': '0.178', 'HEALTH': '0.323', 'weapon2': '0.484', 'WEAPON3': '0.800', 'weapon3': '3.142', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.267', 'FRAGCOUNT': '55.000'} [2023-02-25 14:14:14,713][36139] DAMAGECOUNT value on done: 880637.0 [2023-02-25 14:14:14,714][36139] Sum rewards: 57.522, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.750', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon5': '0.078', 'AMMO4': '0.107', 'weapon2': '0.166', 'weapon4': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.315', 'WEAPON3': '1.900', 'HITCOUNT': '3.190', 'weapon3': '3.234', 'DAMAGECOUNT': '15.399', 'FRAGCOUNT': '55.000'} [2023-02-25 14:14:14,729][36114] Fps is (10 sec: 13517.1, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 200384512. Throughput: 0: 3339.7. Samples: 12590550. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:14:14,730][36114] Avg episode reward: [(0, '56.295')] [2023-02-25 14:14:14,921][36138] Updated weights for policy 0, policy_version 48923 (0.0009) [2023-02-25 14:14:15,025][36139] DAMAGECOUNT value on done: 877603.0 [2023-02-25 14:14:15,025][36139] Sum rewards: 61.970, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.816', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.092', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.204', 'weapon4': '0.260', 'WEAPON3': '1.150', 'HITCOUNT': '2.870', 'weapon3': '3.202', 'DAMAGECOUNT': '14.625', 'FRAGCOUNT': '53.000'} [2023-02-25 14:14:17,928][36138] Updated weights for policy 0, policy_version 48933 (0.0009) [2023-02-25 14:14:19,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 200450048. Throughput: 0: 3340.0. Samples: 12610682. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:14:19,729][36114] Avg episode reward: [(0, '56.374')] [2023-02-25 14:14:21,003][36138] Updated weights for policy 0, policy_version 48943 (0.0009) [2023-02-25 14:14:24,050][36138] Updated weights for policy 0, policy_version 48953 (0.0009) [2023-02-25 14:14:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 200519680. Throughput: 0: 3341.2. Samples: 12620700. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:14:24,730][36114] Avg episode reward: [(0, '56.374')] [2023-02-25 14:14:26,192][36154] DAMAGECOUNT value on done: 874471.0 [2023-02-25 14:14:26,192][36154] Sum rewards: 64.452, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.272', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.098', 'AMMO4': '0.151', 'weapon4': '0.228', 'AMMO3': '0.238', 'weapon2': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.176', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.040', 'FRAGCOUNT': '56.000'} [2023-02-25 14:14:26,508][36154] DAMAGECOUNT value on done: 861947.0 [2023-02-25 14:14:26,509][36154] Sum rewards: 51.709, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.106', 'AMMO5': '0.003', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.161', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'weapon2': '0.344', 'ARMOR': '0.404', 'weapon4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.840', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.265', 'FRAGCOUNT': '48.000'} [2023-02-25 14:14:26,620][36154] DAMAGECOUNT value on done: 875386.0 [2023-02-25 14:14:26,621][36154] Sum rewards: 65.435, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.365', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.072', 'AMMO3': '0.179', 'weapon5': '0.204', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.420', 'weapon2': '0.464', 'WEAPON3': '1.200', 'weapon3': '2.612', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '56.000'} [2023-02-25 14:14:26,931][36154] DAMAGECOUNT value on done: 872583.0 [2023-02-25 14:14:26,931][36154] Sum rewards: 60.707, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.209', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.054', 'AMMO3': '0.163', 'AMMO4': '0.268', 'weapon5': '0.278', 'weapon2': '0.402', 'WEAPON5': '0.500', 'weapon4': '0.682', 'WEAPON4': '0.700', 'WEAPON3': '0.950', 'weapon3': '2.280', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.054', 'FRAGCOUNT': '54.000'} [2023-02-25 14:14:27,049][36141] DAMAGECOUNT value on done: 877956.0 [2023-02-25 14:14:27,049][36141] Sum rewards: 47.627, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.872', 'AMMO5': '0.016', 'AMMO2': '0.065', 'weapon5': '0.180', 'AMMO3': '0.208', 'AMMO4': '0.326', 'WEAPON5': '0.400', 'weapon2': '0.432', 'WEAPON4': '0.500', 'weapon4': '0.596', 'WEAPON3': '1.300', 'weapon3': '2.440', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.956', 'FRAGCOUNT': '44.000'} [2023-02-25 14:14:27,144][36138] Updated weights for policy 0, policy_version 48963 (0.0009) [2023-02-25 14:14:27,351][36141] DAMAGECOUNT value on done: 870719.0 [2023-02-25 14:14:27,352][36141] Sum rewards: 46.632, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.662', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.238', 'weapon5': '0.290', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.450', 'weapon4': '0.608', 'WEAPON3': '1.350', 'weapon3': '2.274', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '12.681', 'FRAGCOUNT': '45.000'} [2023-02-25 14:14:27,372][36141] DAMAGECOUNT value on done: 876783.0 [2023-02-25 14:14:27,372][36141] Sum rewards: 42.886, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.784', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.114', 'AMMO4': '0.129', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'weapon2': '0.328', 'WEAPON4': '0.350', 'weapon4': '0.836', 'WEAPON3': '1.200', 'weapon3': '2.426', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '11.778', 'FRAGCOUNT': '39.000'} [2023-02-25 14:14:27,667][36141] DAMAGECOUNT value on done: 866958.0 [2023-02-25 14:14:27,667][36141] Sum rewards: 58.212, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.282', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.176', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.350', 'weapon2': '0.422', 'WEAPON3': '1.400', 'weapon3': '2.564', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.077', 'FRAGCOUNT': '51.000'} [2023-02-25 14:14:28,980][36157] DAMAGECOUNT value on done: 883052.0 [2023-02-25 14:14:28,980][36157] Sum rewards: 47.365, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.326', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.084', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'weapon2': '0.164', 'WEAPON4': '0.200', 'weapon4': '0.274', 'AMMO3': '0.310', 'WEAPON3': '1.700', 'HITCOUNT': '2.810', 'weapon3': '3.126', 'DAMAGECOUNT': '12.807', 'FRAGCOUNT': '46.000'} [2023-02-25 14:14:29,296][36157] DAMAGECOUNT value on done: 873679.0 [2023-02-25 14:14:29,296][36157] Sum rewards: 71.611, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.067', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.122', 'AMMO3': '0.163', 'AMMO4': '0.189', 'WEAPON5': '0.200', 'weapon2': '0.214', 'WEAPON4': '0.350', 'weapon4': '0.764', 'WEAPON3': '1.000', 'weapon3': '2.698', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '58.000'} [2023-02-25 14:14:29,613][36140] DAMAGECOUNT value on done: 876255.0 [2023-02-25 14:14:29,614][36140] Sum rewards: 53.405, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.116', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.148', 'weapon2': '0.156', 'AMMO4': '0.163', 'AMMO3': '0.221', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.472', 'WEAPON3': '1.350', 'weapon3': '2.976', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.019', 'FRAGCOUNT': '48.000'} [2023-02-25 14:14:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 200585216. Throughput: 0: 3340.8. Samples: 12640782. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:14:29,730][36114] Avg episode reward: [(0, '56.470')] [2023-02-25 14:14:29,912][36157] DAMAGECOUNT value on done: 884249.0 [2023-02-25 14:14:29,913][36157] Sum rewards: 60.485, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.100', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.084', 'weapon5': '0.146', 'AMMO4': '0.147', 'AMMO3': '0.211', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.230', 'weapon3': '3.288', 'DAMAGECOUNT': '15.348', 'FRAGCOUNT': '53.000'} [2023-02-25 14:14:29,918][36140] DAMAGECOUNT value on done: 858953.0 [2023-02-25 14:14:29,919][36140] Sum rewards: 53.554, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.135', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon5': '0.078', 'weapon4': '0.134', 'weapon2': '0.200', 'AMMO4': '0.241', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '3.000', 'weapon3': '3.272', 'DAMAGECOUNT': '15.006', 'FRAGCOUNT': '48.000'} [2023-02-25 14:14:30,016][36140] DAMAGECOUNT value on done: 870069.0 [2023-02-25 14:14:30,016][36140] Sum rewards: 55.240, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.042', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.042', 'AMMO3': '0.166', 'AMMO4': '0.209', 'weapon5': '0.214', 'weapon2': '0.348', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.662', 'WEAPON3': '0.950', 'weapon3': '2.326', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.372', 'FRAGCOUNT': '46.000'} [2023-02-25 14:14:30,198][36138] Updated weights for policy 0, policy_version 48973 (0.0010) [2023-02-25 14:14:30,220][36157] DAMAGECOUNT value on done: 876336.0 [2023-02-25 14:14:30,221][36157] Sum rewards: 58.845, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.551', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.104', 'AMMO4': '0.162', 'weapon2': '0.228', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'weapon4': '0.406', 'WEAPON3': '1.600', 'weapon3': '3.044', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.123', 'FRAGCOUNT': '54.000'} [2023-02-25 14:14:30,341][36140] DAMAGECOUNT value on done: 870613.0 [2023-02-25 14:14:30,341][36140] Sum rewards: 59.834, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.192', 'AMMO5': '0.006', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon2': '0.212', 'AMMO3': '0.219', 'WEAPON3': '1.250', 'HITCOUNT': '3.290', 'weapon3': '3.512', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '50.000'} [2023-02-25 14:14:31,663][36142] DAMAGECOUNT value on done: 879249.0 [2023-02-25 14:14:31,664][36142] Sum rewards: 53.267, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.932', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO4': '0.183', 'weapon2': '0.194', 'AMMO3': '0.198', 'weapon4': '0.362', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon5': '0.426', 'WEAPON3': '1.200', 'weapon3': '2.714', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '15.240', 'FRAGCOUNT': '46.000'} [2023-02-25 14:14:31,669][36155] DAMAGECOUNT value on done: 866722.0 [2023-02-25 14:14:31,670][36155] Sum rewards: 50.251, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.800', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.048', 'AMMO3': '0.197', 'weapon5': '0.220', 'AMMO4': '0.240', 'WEAPON5': '0.400', 'weapon4': '0.510', 'weapon2': '0.520', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.254', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '14.004', 'FRAGCOUNT': '45.000'} [2023-02-25 14:14:31,960][36142] DAMAGECOUNT value on done: 858658.0 [2023-02-25 14:14:31,960][36142] Sum rewards: 58.730, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.030', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.116', 'AMMO4': '0.122', 'AMMO3': '0.185', 'weapon2': '0.272', 'weapon4': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '2.956', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.238', 'FRAGCOUNT': '49.000'} [2023-02-25 14:14:31,970][36155] DAMAGECOUNT value on done: 879642.0 [2023-02-25 14:14:31,970][36155] Sum rewards: 40.639, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.400', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'WEAPON4': '0.300', 'AMMO3': '0.308', 'weapon2': '0.372', 'weapon4': '0.572', 'WEAPON3': '1.750', 'HITCOUNT': '2.630', 'weapon3': '2.760', 'DAMAGECOUNT': '11.205', 'FRAGCOUNT': '41.000'} [2023-02-25 14:14:32,218][36142] DAMAGECOUNT value on done: 866377.0 [2023-02-25 14:14:32,218][36142] Sum rewards: 57.641, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.337', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.136', 'AMMO4': '0.138', 'AMMO3': '0.176', 'weapon2': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.572', 'WEAPON3': '1.150', 'weapon3': '2.780', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.400', 'FRAGCOUNT': '50.000'} [2023-02-25 14:14:32,550][36142] DAMAGECOUNT value on done: 882690.0 [2023-02-25 14:14:32,550][36142] Sum rewards: 51.824, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.426', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.044', 'weapon5': '0.110', 'AMMO4': '0.146', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON3': '1.350', 'HITCOUNT': '3.180', 'weapon3': '3.274', 'DAMAGECOUNT': '15.435', 'FRAGCOUNT': '44.500'} [2023-02-25 14:14:33,001][36155] DAMAGECOUNT value on done: 883714.0 [2023-02-25 14:14:33,002][36155] Sum rewards: 55.754, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.286', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon5': '0.094', 'AMMO4': '0.113', 'AMMO3': '0.228', 'weapon2': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.324', 'WEAPON3': '1.350', 'weapon3': '3.060', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.724', 'FRAGCOUNT': '50.000'} [2023-02-25 14:14:33,258][36138] Updated weights for policy 0, policy_version 48983 (0.0010) [2023-02-25 14:14:33,310][36155] DAMAGECOUNT value on done: 869454.0 [2023-02-25 14:14:33,311][36155] Sum rewards: 46.917, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.609', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon2': '0.432', 'weapon4': '0.440', 'WEAPON3': '1.200', 'HITCOUNT': '2.670', 'weapon3': '2.890', 'DAMAGECOUNT': '12.108', 'FRAGCOUNT': '41.000'} [2023-02-25 14:14:33,318][36156] DAMAGECOUNT value on done: 879755.0 [2023-02-25 14:14:33,319][36156] Sum rewards: 56.581, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.781', 'AMMO5': '0.006', 'AMMO2': '0.008', 'WEAPON1': '0.030', 'AMMO4': '0.042', 'weapon5': '0.106', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.155', 'weapon4': '0.184', 'weapon2': '0.568', 'WEAPON3': '0.950', 'weapon3': '2.910', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.502', 'FRAGCOUNT': '45.000'} [2023-02-25 14:14:33,330][36156] DAMAGECOUNT value on done: 884317.0 [2023-02-25 14:14:33,330][36156] Sum rewards: 55.061, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.820', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.150', 'weapon5': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.424', 'weapon4': '0.442', 'WEAPON3': '1.000', 'weapon3': '2.614', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.698', 'FRAGCOUNT': '46.000'} [2023-02-25 14:14:33,634][36156] DAMAGECOUNT value on done: 868723.0 [2023-02-25 14:14:33,635][36156] Sum rewards: 45.275, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.482', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'WEAPON4': '0.200', 'weapon2': '0.270', 'AMMO3': '0.287', 'weapon4': '0.470', 'WEAPON3': '1.600', 'weapon3': '2.812', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.632', 'FRAGCOUNT': '43.000'} [2023-02-25 14:14:33,645][36156] DAMAGECOUNT value on done: 874574.0 [2023-02-25 14:14:33,646][36156] Sum rewards: 44.544, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.450', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.102', 'weapon5': '0.110', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'weapon4': '0.482', 'weapon2': '0.490', 'WEAPON3': '1.300', 'HITCOUNT': '2.560', 'weapon3': '2.570', 'DAMAGECOUNT': '11.400', 'FRAGCOUNT': '41.000'} [2023-02-25 14:14:34,008][36139] DAMAGECOUNT value on done: 875800.0 [2023-02-25 14:14:34,009][36139] Sum rewards: 60.741, reward structure: {'DEATHCOUNT': '-14.250', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.070', 'HEALTH': '0.073', 'weapon5': '0.168', 'AMMO3': '0.173', 'AMMO4': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.596', 'WEAPON3': '1.000', 'weapon3': '2.936', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '51.000'} [2023-02-25 14:14:34,316][36139] DAMAGECOUNT value on done: 868514.0 [2023-02-25 14:14:34,316][36139] Sum rewards: 53.092, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.140', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'weapon5': '0.094', 'AMMO4': '0.165', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'WEAPON4': '0.350', 'weapon2': '0.354', 'weapon4': '0.412', 'WEAPON3': '1.350', 'weapon3': '2.800', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.064', 'FRAGCOUNT': '47.000'} [2023-02-25 14:14:34,728][36139] DAMAGECOUNT value on done: 886326.0 [2023-02-25 14:14:34,728][36139] Sum rewards: 60.515, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.986', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.168', 'AMMO3': '0.248', 'weapon4': '0.364', 'WEAPON3': '1.450', 'weapon3': '3.112', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.812', 'FRAGCOUNT': '52.000'} [2023-02-25 14:14:34,729][36114] Fps is (10 sec: 13107.0, 60 sec: 13380.2, 300 sec: 13398.8). Total num frames: 200650752. Throughput: 0: 3341.8. Samples: 12660868. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:14:34,730][36114] Avg episode reward: [(0, '56.156')] [2023-02-25 14:14:35,050][36139] DAMAGECOUNT value on done: 882481.0 [2023-02-25 14:14:35,051][36139] Sum rewards: 53.049, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.325', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon2': '0.186', 'AMMO4': '0.217', 'AMMO3': '0.218', 'weapon5': '0.234', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.568', 'WEAPON3': '1.350', 'weapon3': '2.746', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.634', 'FRAGCOUNT': '47.000'} [2023-02-25 14:14:36,327][36138] Updated weights for policy 0, policy_version 48993 (0.0009) [2023-02-25 14:14:39,363][36138] Updated weights for policy 0, policy_version 49003 (0.0009) [2023-02-25 14:14:39,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 200720384. Throughput: 0: 3343.1. Samples: 12670906. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:14:39,730][36114] Avg episode reward: [(0, '56.252')] [2023-02-25 14:14:42,405][36138] Updated weights for policy 0, policy_version 49013 (0.0010) [2023-02-25 14:14:44,391][36154] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:14:44,729][36114] Fps is (10 sec: 13517.0, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 200785920. Throughput: 0: 3345.7. Samples: 12691134. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:14:44,729][36114] Avg episode reward: [(0, '56.252')] [2023-02-25 14:14:45,454][36138] Updated weights for policy 0, policy_version 49023 (0.0008) [2023-02-25 14:14:46,266][36154] DAMAGECOUNT value on done: 879332.0 [2023-02-25 14:14:46,267][36154] Sum rewards: 54.703, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.024', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'weapon4': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.259', 'weapon2': '0.422', 'WEAPON3': '1.400', 'HITCOUNT': '2.930', 'weapon3': '3.146', 'DAMAGECOUNT': '14.583', 'FRAGCOUNT': '49.000'} [2023-02-25 14:14:46,579][36154] DAMAGECOUNT value on done: 866079.0 [2023-02-25 14:14:46,580][36154] Sum rewards: 46.983, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.322', 'ARMOR': '0.012', 'AMMO5': '0.020', 'AMMO2': '0.056', 'AMMO3': '0.153', 'weapon5': '0.204', 'AMMO4': '0.281', 'weapon2': '0.430', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.618', 'WEAPON3': '0.950', 'weapon3': '2.434', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '12.396', 'FRAGCOUNT': '42.000'} [2023-02-25 14:14:46,743][36154] DAMAGECOUNT value on done: 880401.0 [2023-02-25 14:14:46,743][36154] Sum rewards: 58.837, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.450', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.042', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.205', 'weapon2': '0.208', 'WEAPON4': '0.250', 'weapon4': '0.520', 'WEAPON3': '1.250', 'weapon3': '3.022', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '51.000'} [2023-02-25 14:14:47,048][36141] DAMAGECOUNT value on done: 883283.0 [2023-02-25 14:14:47,048][36154] DAMAGECOUNT value on done: 877747.0 [2023-02-25 14:14:47,048][36141] Sum rewards: 67.843, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.540', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.096', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon4': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.342', 'WEAPON3': '1.150', 'weapon3': '3.074', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.981', 'FRAGCOUNT': '58.000'} [2023-02-25 14:14:47,049][36154] Sum rewards: 63.036, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.910', 'AMMO5': '0.017', 'AMMO2': '0.050', 'AMMO3': '0.135', 'AMMO4': '0.249', 'weapon5': '0.250', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.546', 'weapon4': '0.882', 'WEAPON3': '0.900', 'weapon3': '2.034', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.492', 'FRAGCOUNT': '53.000'} [2023-02-25 14:14:47,336][36141] DAMAGECOUNT value on done: 874509.0 [2023-02-25 14:14:47,336][36141] Sum rewards: 42.212, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.128', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.072', 'weapon4': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.188', 'AMMO3': '0.223', 'WEAPON4': '0.350', 'weapon2': '0.734', 'WEAPON3': '1.250', 'HITCOUNT': '2.540', 'weapon3': '2.798', 'DAMAGECOUNT': '11.370', 'FRAGCOUNT': '40.000'} [2023-02-25 14:14:47,356][36141] DAMAGECOUNT value on done: 880944.0 [2023-02-25 14:14:47,356][36141] Sum rewards: 50.307, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.090', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.137', 'AMMO4': '0.146', 'weapon2': '0.264', 'WEAPON4': '0.300', 'weapon4': '0.742', 'WEAPON3': '0.800', 'weapon3': '2.476', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.483', 'FRAGCOUNT': '43.000'} [2023-02-25 14:14:47,437][36141] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:14:47,655][36141] DAMAGECOUNT value on done: 871567.0 [2023-02-25 14:14:47,656][36141] Sum rewards: 47.327, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.732', 'AMMO5': '0.019', 'AMMO2': '0.040', 'AMMO4': '0.201', 'weapon5': '0.224', 'AMMO3': '0.231', 'weapon4': '0.360', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.606', 'WEAPON3': '1.450', 'weapon3': '2.480', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.827', 'FRAGCOUNT': '46.000'} [2023-02-25 14:14:48,536][36138] Updated weights for policy 0, policy_version 49033 (0.0009) [2023-02-25 14:14:48,932][36157] DAMAGECOUNT value on done: 887134.0 [2023-02-25 14:14:48,932][36157] Sum rewards: 43.301, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.446', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO4': '0.175', 'weapon5': '0.228', 'AMMO3': '0.253', 'weapon2': '0.282', 'weapon4': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.680', 'weapon3': '2.780', 'DAMAGECOUNT': '12.246', 'FRAGCOUNT': '40.000'} [2023-02-25 14:14:49,251][36157] DAMAGECOUNT value on done: 877684.0 [2023-02-25 14:14:49,251][36157] Sum rewards: 44.947, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.906', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.112', 'AMMO3': '0.205', 'weapon4': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.670', 'WEAPON3': '1.250', 'weapon3': '2.666', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '12.015', 'FRAGCOUNT': '42.000'} [2023-02-25 14:14:49,663][36140] DAMAGECOUNT value on done: 881633.0 [2023-02-25 14:14:49,664][36140] Sum rewards: 65.595, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.706', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.090', 'AMMO4': '0.106', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.208', 'weapon2': '0.458', 'WEAPON3': '1.100', 'weapon3': '3.036', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '54.000'} [2023-02-25 14:14:49,729][36114] Fps is (10 sec: 13107.0, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 200851456. Throughput: 0: 3348.2. Samples: 12711274. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:14:49,730][36114] Avg episode reward: [(0, '55.636')] [2023-02-25 14:14:49,865][36157] DAMAGECOUNT value on done: 888457.0 [2023-02-25 14:14:49,866][36157] Sum rewards: 42.589, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.498', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.202', 'weapon5': '0.204', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.382', 'weapon2': '0.438', 'WEAPON3': '1.150', 'HITCOUNT': '2.560', 'weapon3': '2.666', 'DAMAGECOUNT': '12.624', 'FRAGCOUNT': '38.000'} [2023-02-25 14:14:49,962][36140] DAMAGECOUNT value on done: 863349.0 [2023-02-25 14:14:49,963][36140] Sum rewards: 59.377, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.798', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO3': '0.214', 'weapon2': '0.440', 'ARMOR': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '2.920', 'weapon3': '3.306', 'DAMAGECOUNT': '13.188', 'FRAGCOUNT': '51.000'} [2023-02-25 14:14:50,076][36140] DAMAGECOUNT value on done: 874524.0 [2023-02-25 14:14:50,076][36140] Sum rewards: 60.050, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.326', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.228', 'weapon4': '0.640', 'WEAPON3': '1.150', 'weapon3': '2.696', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.365', 'FRAGCOUNT': '52.000'} [2023-02-25 14:14:50,164][36157] DAMAGECOUNT value on done: 881781.0 [2023-02-25 14:14:50,164][36157] Sum rewards: 66.026, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.303', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon2': '0.146', 'WEAPON4': '0.150', 'weapon5': '0.156', 'AMMO3': '0.184', 'WEAPON5': '0.250', 'weapon4': '0.674', 'WEAPON3': '1.150', 'weapon3': '2.730', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '54.000'} [2023-02-25 14:14:50,384][36140] DAMAGECOUNT value on done: 874645.0 [2023-02-25 14:14:50,385][36140] Sum rewards: 43.283, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.024', 'AMMO5': '0.017', 'AMMO2': '0.065', 'AMMO3': '0.172', 'weapon2': '0.248', 'weapon5': '0.288', 'AMMO4': '0.325', 'WEAPON5': '0.450', 'weapon4': '0.482', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'HITCOUNT': '2.420', 'weapon3': '2.644', 'DAMAGECOUNT': '12.096', 'FRAGCOUNT': '39.500'} [2023-02-25 14:14:51,591][36138] Updated weights for policy 0, policy_version 49043 (0.0009) [2023-02-25 14:14:51,634][36142] DAMAGECOUNT value on done: 883745.0 [2023-02-25 14:14:51,634][36142] Sum rewards: 43.182, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-2.545', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon5': '0.052', 'weapon4': '0.084', 'AMMO4': '0.169', 'weapon2': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.322', 'WEAPON3': '1.850', 'HITCOUNT': '2.850', 'weapon3': '3.264', 'DAMAGECOUNT': '13.218', 'FRAGCOUNT': '44.000'} [2023-02-25 14:14:51,693][36155] DAMAGECOUNT value on done: 872023.0 [2023-02-25 14:14:51,694][36155] Sum rewards: 59.404, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.845', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.068', 'weapon5': '0.146', 'weapon2': '0.228', 'AMMO3': '0.254', 'AMMO4': '0.341', 'WEAPON5': '0.350', 'weapon4': '0.514', 'WEAPON4': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.718', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '56.000'} [2023-02-25 14:14:51,949][36142] DAMAGECOUNT value on done: 863830.0 [2023-02-25 14:14:51,950][36142] Sum rewards: 61.705, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.802', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.102', 'AMMO3': '0.176', 'AMMO4': '0.188', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.466', 'weapon2': '0.628', 'WEAPON3': '1.100', 'weapon3': '2.532', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.516', 'FRAGCOUNT': '53.000'} [2023-02-25 14:14:52,004][36155] DAMAGECOUNT value on done: 884952.0 [2023-02-25 14:14:52,005][36155] Sum rewards: 52.125, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.477', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.224', 'weapon2': '0.232', 'weapon5': '0.268', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.698', 'WEAPON3': '1.400', 'weapon3': '2.448', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.930', 'FRAGCOUNT': '46.000'} [2023-02-25 14:14:52,210][36142] DAMAGECOUNT value on done: 870754.0 [2023-02-25 14:14:52,211][36142] Sum rewards: 51.115, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.078', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.036', 'weapon5': '0.138', 'AMMO3': '0.150', 'AMMO4': '0.177', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.568', 'weapon2': '0.704', 'WEAPON3': '0.850', 'weapon3': '2.374', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.131', 'FRAGCOUNT': '43.000'} [2023-02-25 14:14:52,505][36142] DAMAGECOUNT value on done: 887876.0 [2023-02-25 14:14:52,505][36142] Sum rewards: 58.988, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.415', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.100', 'weapon5': '0.104', 'AMMO3': '0.207', 'weapon2': '0.498', 'WEAPON3': '1.150', 'weapon3': '3.076', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.558', 'FRAGCOUNT': '50.000'} [2023-02-25 14:14:53,040][36155] DAMAGECOUNT value on done: 888036.0 [2023-02-25 14:14:53,040][36155] Sum rewards: 41.321, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.674', 'AMMO5': '0.028', 'AMMO2': '0.070', 'AMMO3': '0.197', 'AMMO4': '0.351', 'weapon5': '0.354', 'weapon4': '0.414', 'weapon2': '0.570', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.254', 'HITCOUNT': '2.390', 'DAMAGECOUNT': '12.966', 'FRAGCOUNT': '40.000'} [2023-02-25 14:14:53,354][36155] DAMAGECOUNT value on done: 873747.0 [2023-02-25 14:14:53,355][36155] Sum rewards: 50.620, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.725', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.092', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.428', 'weapon2': '0.656', 'WEAPON3': '0.950', 'weapon3': '2.668', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.879', 'FRAGCOUNT': '41.000'} [2023-02-25 14:14:53,470][36156] DAMAGECOUNT value on done: 884956.0 [2023-02-25 14:14:53,470][36156] Sum rewards: 60.801, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.689', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.200', 'AMMO4': '0.210', 'AMMO3': '0.220', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON4': '0.450', 'weapon4': '0.652', 'WEAPON3': '1.400', 'weapon3': '2.518', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.603', 'FRAGCOUNT': '54.000'} [2023-02-25 14:14:53,480][36156] DAMAGECOUNT value on done: 889308.0 [2023-02-25 14:14:53,481][36156] Sum rewards: 54.330, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.290', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon2': '0.216', 'weapon4': '0.310', 'WEAPON3': '1.350', 'HITCOUNT': '3.150', 'weapon3': '3.176', 'DAMAGECOUNT': '14.973', 'FRAGCOUNT': '47.000'} [2023-02-25 14:14:53,779][36156] DAMAGECOUNT value on done: 873641.0 [2023-02-25 14:14:53,780][36156] Sum rewards: 50.891, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.642', 'ARMOR': '0.004', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.049', 'AMMO3': '0.209', 'AMMO4': '0.243', 'weapon2': '0.296', 'weapon5': '0.332', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.812', 'WEAPON3': '1.200', 'weapon3': '2.056', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.754', 'FRAGCOUNT': '45.000'} [2023-02-25 14:14:53,790][36156] DAMAGECOUNT value on done: 878745.0 [2023-02-25 14:14:53,791][36156] Sum rewards: 49.017, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.750', 'AMMO5': '0.007', 'AMMO2': '0.034', 'AMMO4': '0.169', 'WEAPON5': '0.200', 'weapon5': '0.202', 'AMMO3': '0.203', 'weapon4': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.200', 'HITCOUNT': '2.740', 'weapon3': '2.940', 'DAMAGECOUNT': '12.513', 'FRAGCOUNT': '44.000'} [2023-02-25 14:14:53,909][36139] DAMAGECOUNT value on done: 880117.0 [2023-02-25 14:14:53,909][36139] Sum rewards: 42.189, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.833', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO4': '0.186', 'weapon5': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.374', 'weapon4': '0.382', 'WEAPON3': '1.250', 'HITCOUNT': '2.610', 'weapon3': '2.672', 'DAMAGECOUNT': '12.951', 'FRAGCOUNT': '37.000'} [2023-02-25 14:14:54,216][36139] DAMAGECOUNT value on done: 873277.0 [2023-02-25 14:14:54,216][36139] Sum rewards: 53.134, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.114', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.144', 'AMMO3': '0.229', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.428', 'weapon2': '0.682', 'WEAPON3': '1.350', 'weapon3': '2.376', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.289', 'FRAGCOUNT': '47.000'} [2023-02-25 14:14:54,612][36139] DAMAGECOUNT value on done: 891023.0 [2023-02-25 14:14:54,612][36139] Sum rewards: 51.275, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.026', 'ARMOR': '0.016', 'AMMO5': '0.021', 'AMMO2': '0.076', 'AMMO3': '0.185', 'weapon5': '0.226', 'weapon2': '0.312', 'AMMO4': '0.378', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'weapon4': '0.798', 'WEAPON3': '1.100', 'weapon3': '2.248', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.091', 'FRAGCOUNT': '47.000'} [2023-02-25 14:14:54,650][36138] Updated weights for policy 0, policy_version 49053 (0.0009) [2023-02-25 14:14:54,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.2, 300 sec: 13412.7). Total num frames: 200921088. Throughput: 0: 3348.8. Samples: 12721290. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:14:54,730][36114] Avg episode reward: [(0, '54.757')] [2023-02-25 14:14:54,918][36139] DAMAGECOUNT value on done: 888089.0 [2023-02-25 14:14:54,919][36139] Sum rewards: 61.075, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.190', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.086', 'AMMO4': '0.139', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.354', 'weapon2': '0.398', 'WEAPON3': '1.200', 'weapon3': '2.934', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '52.000'} [2023-02-25 14:14:57,707][36138] Updated weights for policy 0, policy_version 49063 (0.0009) [2023-02-25 14:14:58,686][36139] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:14:59,729][36114] Fps is (10 sec: 13517.1, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 200986624. Throughput: 0: 3354.0. Samples: 12741478. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:14:59,730][36114] Avg episode reward: [(0, '54.836')] [2023-02-25 14:15:00,757][36138] Updated weights for policy 0, policy_version 49073 (0.0009) [2023-02-25 14:15:03,809][36138] Updated weights for policy 0, policy_version 49083 (0.0009) [2023-02-25 14:15:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13412.7). Total num frames: 201056256. Throughput: 0: 3354.5. Samples: 12761636. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:15:04,730][36114] Avg episode reward: [(0, '54.836')] [2023-02-25 14:15:06,232][36154] DAMAGECOUNT value on done: 884456.0 [2023-02-25 14:15:06,232][36154] Sum rewards: 60.732, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.656', 'AMMO5': '0.015', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.182', 'AMMO3': '0.204', 'weapon2': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.430', 'WEAPON3': '1.250', 'weapon3': '2.924', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.372', 'FRAGCOUNT': '51.500'} [2023-02-25 14:15:06,528][36154] DAMAGECOUNT value on done: 871149.0 [2023-02-25 14:15:06,529][36154] Sum rewards: 59.294, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.002', 'AMMO5': '0.017', 'AMMO2': '0.041', 'AMMO3': '0.128', 'weapon5': '0.146', 'AMMO4': '0.204', 'weapon2': '0.248', 'WEAPON5': '0.350', 'WEAPON4': '0.600', 'WEAPON3': '0.750', 'weapon4': '0.990', 'weapon3': '2.222', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '49.000'} [2023-02-25 14:15:06,683][36154] DAMAGECOUNT value on done: 884791.0 [2023-02-25 14:15:06,684][36154] Sum rewards: 54.379, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.636', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO3': '0.136', 'AMMO4': '0.187', 'weapon5': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.726', 'WEAPON3': '0.850', 'weapon2': '0.928', 'weapon3': '1.730', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.170', 'FRAGCOUNT': '45.000'} [2023-02-25 14:15:06,878][36138] Updated weights for policy 0, policy_version 49093 (0.0010) [2023-02-25 14:15:06,987][36154] DAMAGECOUNT value on done: 882833.0 [2023-02-25 14:15:06,988][36154] Sum rewards: 61.431, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.428', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'weapon4': '0.290', 'weapon2': '0.528', 'WEAPON3': '1.450', 'weapon3': '2.874', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '55.000'} [2023-02-25 14:15:07,111][36141] DAMAGECOUNT value on done: 887168.0 [2023-02-25 14:15:07,111][36141] Sum rewards: 46.713, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.264', 'ARMOR': '0.012', 'AMMO5': '0.022', 'AMMO2': '0.068', 'AMMO3': '0.186', 'weapon5': '0.240', 'AMMO4': '0.342', 'weapon2': '0.534', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.760', 'WEAPON3': '1.050', 'weapon3': '1.932', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '11.520', 'FRAGCOUNT': '42.000'} [2023-02-25 14:15:07,403][36141] DAMAGECOUNT value on done: 879109.0 [2023-02-25 14:15:07,403][36141] Sum rewards: 51.332, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.556', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO4': '0.181', 'weapon5': '0.194', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON4': '0.350', 'weapon4': '0.580', 'WEAPON3': '1.350', 'weapon3': '2.614', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.800', 'FRAGCOUNT': '46.000'} [2023-02-25 14:15:07,444][36141] DAMAGECOUNT value on done: 886244.0 [2023-02-25 14:15:07,444][36141] Sum rewards: 59.118, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.072', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.110', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.314', 'weapon4': '0.394', 'WEAPON3': '1.500', 'weapon3': '2.916', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '52.000'} [2023-02-25 14:15:07,736][36141] DAMAGECOUNT value on done: 876247.0 [2023-02-25 14:15:07,737][36141] Sum rewards: 57.229, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.242', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'weapon4': '0.360', 'weapon2': '0.368', 'WEAPON3': '1.150', 'HITCOUNT': '3.090', 'weapon3': '3.108', 'DAMAGECOUNT': '14.040', 'FRAGCOUNT': '49.000'} [2023-02-25 14:15:08,911][36157] DAMAGECOUNT value on done: 891459.0 [2023-02-25 14:15:08,912][36157] Sum rewards: 47.363, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.978', 'AMMO5': '0.019', 'AMMO2': '0.054', 'AMMO3': '0.186', 'weapon5': '0.234', 'AMMO4': '0.271', 'weapon2': '0.398', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon4': '0.896', 'WEAPON3': '1.050', 'weapon3': '2.058', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '12.975', 'FRAGCOUNT': '42.000'} [2023-02-25 14:15:09,227][36157] DAMAGECOUNT value on done: 882243.0 [2023-02-25 14:15:09,227][36157] Sum rewards: 48.796, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.264', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'weapon4': '0.046', 'AMMO4': '0.119', 'weapon5': '0.138', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.840', 'WEAPON3': '1.200', 'weapon3': '2.750', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.677', 'FRAGCOUNT': '42.000'} [2023-02-25 14:15:09,555][36140] DAMAGECOUNT value on done: 886379.0 [2023-02-25 14:15:09,556][36140] Sum rewards: 57.047, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.404', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon4': '0.384', 'weapon2': '0.598', 'WEAPON3': '1.100', 'weapon3': '2.576', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.238', 'FRAGCOUNT': '47.000'} [2023-02-25 14:15:09,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 201121792. Throughput: 0: 3354.4. Samples: 12771648. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-25 14:15:09,729][36114] Avg episode reward: [(0, '55.034')] [2023-02-25 14:15:09,858][36157] DAMAGECOUNT value on done: 892967.0 [2023-02-25 14:15:09,859][36157] Sum rewards: 48.069, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.961', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon5': '0.192', 'AMMO4': '0.228', 'AMMO3': '0.255', 'weapon2': '0.270', 'WEAPON5': '0.450', 'weapon4': '0.598', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.548', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '13.530', 'FRAGCOUNT': '47.000'} [2023-02-25 14:15:09,860][36140] DAMAGECOUNT value on done: 868245.0 [2023-02-25 14:15:09,861][36140] Sum rewards: 55.525, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.275', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO3': '0.103', 'AMMO4': '0.175', 'weapon5': '0.216', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.576', 'WEAPON3': '0.700', 'weapon4': '0.724', 'weapon3': '2.240', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '14.688', 'FRAGCOUNT': '45.000'} [2023-02-25 14:15:09,927][36138] Updated weights for policy 0, policy_version 49103 (0.0009) [2023-02-25 14:15:09,994][36140] DAMAGECOUNT value on done: 879375.0 [2023-02-25 14:15:09,995][36140] Sum rewards: 53.147, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.476', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.092', 'AMMO4': '0.145', 'WEAPON5': '0.200', 'weapon2': '0.236', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'weapon4': '0.838', 'WEAPON3': '1.400', 'weapon3': '2.480', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.553', 'FRAGCOUNT': '47.000'} [2023-02-25 14:15:10,170][36157] DAMAGECOUNT value on done: 887205.0 [2023-02-25 14:15:10,171][36157] Sum rewards: 64.364, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.274', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO3': '0.176', 'AMMO4': '0.192', 'weapon5': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.310', 'weapon2': '0.448', 'WEAPON3': '1.150', 'weapon3': '2.774', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '53.000'} [2023-02-25 14:15:10,306][36140] DAMAGECOUNT value on done: 879406.0 [2023-02-25 14:15:10,306][36140] Sum rewards: 60.650, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.116', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.102', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon2': '0.476', 'weapon4': '0.488', 'WEAPON3': '1.100', 'weapon3': '2.580', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.283', 'FRAGCOUNT': '51.000'} [2023-02-25 14:15:11,684][36155] DAMAGECOUNT value on done: 876021.0 [2023-02-25 14:15:11,685][36155] Sum rewards: 45.227, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.828', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.048', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'AMMO4': '0.218', 'WEAPON4': '0.350', 'weapon4': '0.490', 'weapon2': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.648', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '11.994', 'FRAGCOUNT': '40.000'} [2023-02-25 14:15:11,714][36142] DAMAGECOUNT value on done: 887931.0 [2023-02-25 14:15:11,715][36142] Sum rewards: 44.711, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.472', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.023', 'weapon5': '0.068', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.590', 'weapon2': '0.628', 'WEAPON3': '1.200', 'weapon3': '2.388', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.558', 'FRAGCOUNT': '41.000'} [2023-02-25 14:15:12,000][36155] DAMAGECOUNT value on done: 889887.0 [2023-02-25 14:15:12,000][36155] Sum rewards: 59.840, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.330', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO3': '0.084', 'AMMO4': '0.180', 'weapon5': '0.252', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.524', 'WEAPON3': '0.550', 'weapon4': '1.084', 'weapon3': '1.886', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '14.805', 'FRAGCOUNT': '47.000'} [2023-02-25 14:15:12,047][36142] DAMAGECOUNT value on done: 868191.0 [2023-02-25 14:15:12,048][36142] Sum rewards: 51.221, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.764', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.094', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'weapon2': '0.474', 'weapon4': '0.654', 'WEAPON3': '1.200', 'weapon3': '2.388', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '13.083', 'FRAGCOUNT': '45.000'} [2023-02-25 14:15:12,315][36142] DAMAGECOUNT value on done: 876454.0 [2023-02-25 14:15:12,315][36142] Sum rewards: 71.951, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.725', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.030', 'weapon5': '0.064', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'weapon2': '0.260', 'WEAPON3': '1.450', 'weapon3': '3.416', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '64.000'} [2023-02-25 14:15:12,607][36142] DAMAGECOUNT value on done: 893577.0 [2023-02-25 14:15:12,608][36142] Sum rewards: 68.803, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.816', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon2': '0.206', 'weapon5': '0.228', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.258', 'WEAPON3': '1.350', 'weapon3': '2.954', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '60.500'} [2023-02-25 14:15:12,992][36138] Updated weights for policy 0, policy_version 49113 (0.0010) [2023-02-25 14:15:13,064][36155] DAMAGECOUNT value on done: 892857.0 [2023-02-25 14:15:13,065][36155] Sum rewards: 47.610, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.970', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon5': '0.146', 'AMMO4': '0.154', 'weapon4': '0.204', 'AMMO3': '0.227', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.040', 'weapon3': '3.072', 'DAMAGECOUNT': '14.463', 'FRAGCOUNT': '42.500'} [2023-02-25 14:15:13,372][36155] DAMAGECOUNT value on done: 879011.0 [2023-02-25 14:15:13,373][36155] Sum rewards: 62.354, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.500', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO3': '0.272', 'weapon2': '0.276', 'WEAPON3': '1.750', 'HITCOUNT': '3.270', 'weapon3': '3.504', 'DAMAGECOUNT': '15.792', 'FRAGCOUNT': '56.000'} [2023-02-25 14:15:13,513][36156] DAMAGECOUNT value on done: 889899.0 [2023-02-25 14:15:13,514][36156] Sum rewards: 51.722, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.854', 'AMMO5': '0.009', 'AMMO2': '0.057', 'weapon5': '0.184', 'AMMO3': '0.236', 'WEAPON5': '0.250', 'weapon2': '0.260', 'AMMO4': '0.285', 'WEAPON4': '0.350', 'weapon4': '0.510', 'WEAPON3': '1.400', 'weapon3': '2.746', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.829', 'FRAGCOUNT': '47.000'} [2023-02-25 14:15:13,524][36156] DAMAGECOUNT value on done: 893951.0 [2023-02-25 14:15:13,524][36156] Sum rewards: 49.249, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.487', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO5': '0.009', 'AMMO4': '0.045', 'weapon5': '0.118', 'weapon4': '0.126', 'WEAPON4': '0.150', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.500', 'HITCOUNT': '2.620', 'weapon3': '3.160', 'DAMAGECOUNT': '13.929', 'FRAGCOUNT': '45.000'} [2023-02-25 14:15:13,829][36156] DAMAGECOUNT value on done: 879032.0 [2023-02-25 14:15:13,830][36156] Sum rewards: 54.771, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.760', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon5': '0.186', 'AMMO3': '0.217', 'AMMO4': '0.253', 'weapon2': '0.310', 'weapon4': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.824', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.173', 'FRAGCOUNT': '49.000'} [2023-02-25 14:15:13,840][36156] DAMAGECOUNT value on done: 883617.0 [2023-02-25 14:15:13,841][36156] Sum rewards: 54.099, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.467', 'AMMO5': '0.012', 'AMMO2': '0.043', 'AMMO3': '0.205', 'AMMO4': '0.216', 'weapon5': '0.258', 'weapon4': '0.296', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.486', 'WEAPON3': '1.150', 'weapon3': '2.624', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.616', 'FRAGCOUNT': '48.000'} [2023-02-25 14:15:14,050][36139] DAMAGECOUNT value on done: 885316.0 [2023-02-25 14:15:14,051][36139] Sum rewards: 58.290, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.045', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.074', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'weapon4': '0.238', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'weapon2': '0.480', 'WEAPON3': '1.400', 'weapon3': '2.938', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '52.000'} [2023-02-25 14:15:14,341][36139] DAMAGECOUNT value on done: 878059.0 [2023-02-25 14:15:14,341][36139] Sum rewards: 50.030, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.761', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.078', 'AMMO3': '0.189', 'AMMO4': '0.388', 'weapon5': '0.396', 'weapon2': '0.416', 'weapon4': '0.470', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.290', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '14.346', 'FRAGCOUNT': '45.500'} [2023-02-25 14:15:14,690][36139] DAMAGECOUNT value on done: 894975.0 [2023-02-25 14:15:14,691][36139] Sum rewards: 42.111, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.982', 'AMMO5': '0.017', 'ARMOR': '0.032', 'AMMO2': '0.039', 'AMMO4': '0.195', 'AMMO3': '0.209', 'weapon5': '0.228', 'weapon2': '0.402', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.860', 'WEAPON3': '1.250', 'weapon3': '2.124', 'HITCOUNT': '2.180', 'DAMAGECOUNT': '11.856', 'FRAGCOUNT': '39.000'} [2023-02-25 14:15:14,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 201187328. Throughput: 0: 3355.7. Samples: 12791790. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-25 14:15:14,729][36114] Avg episode reward: [(0, '54.480')] [2023-02-25 14:15:14,994][36139] DAMAGECOUNT value on done: 893211.0 [2023-02-25 14:15:14,994][36139] Sum rewards: 54.543, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.610', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.146', 'AMMO4': '0.197', 'AMMO3': '0.272', 'weapon2': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.522', 'WEAPON3': '1.550', 'weapon3': '2.710', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.126', 'FRAGCOUNT': '50.500'} [2023-02-25 14:15:15,999][36138] Updated weights for policy 0, policy_version 49123 (0.0010) [2023-02-25 14:15:19,095][36138] Updated weights for policy 0, policy_version 49133 (0.0009) [2023-02-25 14:15:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 201256960. Throughput: 0: 3356.9. Samples: 12811928. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-25 14:15:19,730][36114] Avg episode reward: [(0, '54.331')] [2023-02-25 14:15:19,733][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000049135_201256960.pth... [2023-02-25 14:15:19,791][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000048349_198037504.pth [2023-02-25 14:15:22,145][36138] Updated weights for policy 0, policy_version 49143 (0.0009) [2023-02-25 14:15:24,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 201322496. Throughput: 0: 3355.7. Samples: 12821912. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-25 14:15:24,729][36114] Avg episode reward: [(0, '54.331')] [2023-02-25 14:15:25,171][36138] Updated weights for policy 0, policy_version 49153 (0.0010) [2023-02-25 14:15:26,256][36154] DAMAGECOUNT value on done: 890226.0 [2023-02-25 14:15:26,256][36154] Sum rewards: 66.551, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.432', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.126', 'weapon2': '0.168', 'weapon5': '0.186', 'AMMO4': '0.211', 'AMMO3': '0.253', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.232', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '59.000'} [2023-02-25 14:15:26,573][36154] DAMAGECOUNT value on done: 877210.0 [2023-02-25 14:15:26,573][36154] Sum rewards: 72.181, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.140', 'AMMO5': '0.020', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.194', 'weapon2': '0.302', 'weapon5': '0.306', 'WEAPON4': '0.450', 'ARMOR': '0.461', 'WEAPON5': '0.550', 'weapon4': '0.724', 'WEAPON3': '1.150', 'weapon3': '2.288', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '61.000'} [2023-02-25 14:15:26,705][36154] DAMAGECOUNT value on done: 890506.0 [2023-02-25 14:15:26,705][36154] Sum rewards: 64.895, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.624', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon5': '0.174', 'AMMO4': '0.180', 'AMMO3': '0.207', 'weapon2': '0.320', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.476', 'WEAPON3': '1.250', 'weapon3': '2.712', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '55.000'} [2023-02-25 14:15:26,997][36154] DAMAGECOUNT value on done: 887807.0 [2023-02-25 14:15:26,998][36154] Sum rewards: 57.709, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.201', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.057', 'AMMO3': '0.123', 'weapon5': '0.176', 'weapon2': '0.252', 'AMMO4': '0.284', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '0.800', 'weapon4': '0.830', 'weapon3': '2.132', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '14.892', 'FRAGCOUNT': '47.000'} [2023-02-25 14:15:27,161][36141] DAMAGECOUNT value on done: 892901.0 [2023-02-25 14:15:27,162][36141] Sum rewards: 59.101, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.990', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.118', 'AMMO3': '0.203', 'weapon5': '0.208', 'AMMO4': '0.215', 'weapon2': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.172', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '51.000'} [2023-02-25 14:15:27,470][36141] DAMAGECOUNT value on done: 891017.0 [2023-02-25 14:15:27,470][36141] Sum rewards: 51.201, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.718', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO4': '0.173', 'AMMO3': '0.201', 'weapon5': '0.312', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.516', 'weapon4': '0.556', 'WEAPON3': '1.200', 'weapon3': '2.094', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '14.319', 'FRAGCOUNT': '46.000'} [2023-02-25 14:15:27,493][36141] DAMAGECOUNT value on done: 884551.0 [2023-02-25 14:15:27,494][36141] Sum rewards: 58.475, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.085', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.164', 'weapon2': '0.174', 'AMMO3': '0.195', 'weapon5': '0.240', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.960', 'WEAPON3': '1.200', 'weapon3': '2.372', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '49.000'} [2023-02-25 14:15:27,791][36141] DAMAGECOUNT value on done: 880887.0 [2023-02-25 14:15:27,791][36141] Sum rewards: 49.606, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.171', 'AMMO5': '0.003', 'AMMO2': '0.038', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.188', 'AMMO3': '0.272', 'weapon2': '0.384', 'WEAPON4': '0.400', 'weapon4': '0.434', 'WEAPON3': '1.550', 'HITCOUNT': '2.810', 'weapon3': '2.884', 'DAMAGECOUNT': '13.920', 'FRAGCOUNT': '47.000'} [2023-02-25 14:15:27,950][36156] Large shaping reward 3.291 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.24, 80.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:15:28,230][36138] Updated weights for policy 0, policy_version 49163 (0.0009) [2023-02-25 14:15:28,918][36157] DAMAGECOUNT value on done: 896580.0 [2023-02-25 14:15:28,919][36157] Sum rewards: 66.537, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.290', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'AMMO3': '0.163', 'weapon2': '0.312', 'weapon4': '0.476', 'WEAPON3': '1.050', 'weapon3': '3.032', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.363', 'FRAGCOUNT': '55.000'} [2023-02-25 14:15:29,230][36157] DAMAGECOUNT value on done: 886275.0 [2023-02-25 14:15:29,231][36157] Sum rewards: 46.311, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.872', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.086', 'weapon4': '0.142', 'AMMO4': '0.147', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.362', 'WEAPON3': '1.400', 'HITCOUNT': '2.760', 'weapon3': '3.172', 'DAMAGECOUNT': '12.096', 'FRAGCOUNT': '42.500'} [2023-02-25 14:15:29,636][36140] DAMAGECOUNT value on done: 891490.0 [2023-02-25 14:15:29,637][36140] Sum rewards: 60.137, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.170', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.088', 'WEAPON5': '0.100', 'weapon4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.233', 'weapon2': '0.560', 'WEAPON3': '1.350', 'weapon3': '2.914', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.333', 'FRAGCOUNT': '52.000'} [2023-02-25 14:15:29,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 201388032. Throughput: 0: 3352.3. Samples: 12841988. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-25 14:15:29,730][36114] Avg episode reward: [(0, '54.644')] [2023-02-25 14:15:29,877][36157] DAMAGECOUNT value on done: 898108.0 [2023-02-25 14:15:29,878][36157] Sum rewards: 57.364, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.933', 'AMMO5': '0.011', 'AMMO2': '0.017', 'AMMO4': '0.086', 'AMMO3': '0.125', 'weapon5': '0.142', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.532', 'weapon4': '0.764', 'WEAPON3': '0.800', 'weapon3': '2.306', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.423', 'FRAGCOUNT': '46.000'} [2023-02-25 14:15:29,946][36140] DAMAGECOUNT value on done: 874302.0 [2023-02-25 14:15:29,946][36140] Sum rewards: 61.833, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.665', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.180', 'AMMO4': '0.229', 'AMMO3': '0.242', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON4': '0.450', 'weapon4': '0.566', 'WEAPON3': '1.500', 'weapon3': '2.552', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.171', 'FRAGCOUNT': '55.000'} [2023-02-25 14:15:30,060][36140] DAMAGECOUNT value on done: 884139.0 [2023-02-25 14:15:30,061][36140] Sum rewards: 56.299, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.515', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.036', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.213', 'weapon2': '0.432', 'WEAPON3': '1.300', 'HITCOUNT': '2.830', 'weapon3': '3.252', 'DAMAGECOUNT': '14.292', 'FRAGCOUNT': '48.000'} [2023-02-25 14:15:30,185][36157] DAMAGECOUNT value on done: 891166.0 [2023-02-25 14:15:30,185][36157] Sum rewards: 41.809, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.970', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.170', 'AMMO3': '0.198', 'weapon2': '0.312', 'WEAPON4': '0.450', 'ARMOR': '0.455', 'weapon4': '1.026', 'WEAPON3': '1.200', 'weapon3': '2.296', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '11.883', 'FRAGCOUNT': '38.000'} [2023-02-25 14:15:30,376][36140] DAMAGECOUNT value on done: 884519.0 [2023-02-25 14:15:30,377][36140] Sum rewards: 60.620, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.430', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.259', 'weapon4': '0.300', 'weapon2': '0.504', 'WEAPON3': '1.550', 'weapon3': '2.808', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.339', 'FRAGCOUNT': '54.000'} [2023-02-25 14:15:31,320][36138] Updated weights for policy 0, policy_version 49173 (0.0009) [2023-02-25 14:15:31,711][36155] DAMAGECOUNT value on done: 881590.0 [2023-02-25 14:15:31,711][36155] Sum rewards: 62.883, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.290', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.146', 'AMMO3': '0.256', 'weapon2': '0.312', 'WEAPON3': '1.450', 'weapon3': '3.206', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.707', 'FRAGCOUNT': '54.000'} [2023-02-25 14:15:31,865][36142] DAMAGECOUNT value on done: 893170.0 [2023-02-25 14:15:31,866][36142] Sum rewards: 60.216, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.888', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon2': '0.180', 'AMMO3': '0.193', 'weapon5': '0.222', 'AMMO4': '0.235', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.608', 'WEAPON3': '1.150', 'weapon3': '2.696', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '52.000'} [2023-02-25 14:15:32,025][36155] DAMAGECOUNT value on done: 893514.0 [2023-02-25 14:15:32,025][36155] Sum rewards: 38.944, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.852', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO4': '0.193', 'weapon5': '0.196', 'AMMO3': '0.211', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.346', 'weapon2': '0.756', 'WEAPON3': '1.250', 'weapon3': '2.328', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '10.881', 'FRAGCOUNT': '36.000'} [2023-02-25 14:15:32,167][36142] DAMAGECOUNT value on done: 872927.0 [2023-02-25 14:15:32,168][36142] Sum rewards: 58.021, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.352', 'AMMO5': '0.007', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'weapon4': '0.072', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.222', 'weapon2': '0.902', 'WEAPON3': '1.300', 'weapon3': '2.720', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.208', 'FRAGCOUNT': '50.000'} [2023-02-25 14:15:32,443][36142] DAMAGECOUNT value on done: 881987.0 [2023-02-25 14:15:32,444][36142] Sum rewards: 62.612, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.802', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.116', 'AMMO4': '0.181', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.376', 'weapon4': '0.714', 'WEAPON3': '1.350', 'weapon3': '2.514', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '54.000'} [2023-02-25 14:15:32,755][36142] DAMAGECOUNT value on done: 897954.0 [2023-02-25 14:15:32,755][36142] Sum rewards: 53.383, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.936', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.182', 'weapon2': '0.186', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.726', 'WEAPON3': '1.200', 'weapon3': '2.488', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.131', 'FRAGCOUNT': '47.000'} [2023-02-25 14:15:33,176][36155] DAMAGECOUNT value on done: 897711.0 [2023-02-25 14:15:33,176][36155] Sum rewards: 59.799, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.203', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon5': '0.144', 'AMMO3': '0.156', 'AMMO4': '0.176', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.542', 'weapon4': '0.658', 'WEAPON3': '0.900', 'weapon3': '2.332', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '14.562', 'FRAGCOUNT': '50.000'} [2023-02-25 14:15:33,479][36155] DAMAGECOUNT value on done: 883862.0 [2023-02-25 14:15:33,480][36155] Sum rewards: 54.463, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.150', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.050', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'weapon4': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.249', 'weapon2': '0.428', 'WEAPON3': '1.500', 'HITCOUNT': '3.100', 'weapon3': '3.170', 'DAMAGECOUNT': '14.553', 'FRAGCOUNT': '49.000'} [2023-02-25 14:15:33,741][36156] DAMAGECOUNT value on done: 894410.0 [2023-02-25 14:15:33,742][36156] Sum rewards: 38.166, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-4.019', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.058', 'weapon5': '0.186', 'weapon2': '0.258', 'AMMO3': '0.273', 'AMMO4': '0.289', 'WEAPON5': '0.300', 'WEAPON4': '0.700', 'weapon4': '1.292', 'WEAPON3': '1.550', 'weapon3': '1.894', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.533', 'FRAGCOUNT': '39.000'} [2023-02-25 14:15:33,753][36156] DAMAGECOUNT value on done: 899580.0 [2023-02-25 14:15:33,753][36156] Sum rewards: 66.523, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.410', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.032', 'AMMO4': '0.161', 'weapon4': '0.164', 'weapon5': '0.182', 'AMMO3': '0.257', 'weapon2': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.064', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '60.500'} [2023-02-25 14:15:34,056][36156] DAMAGECOUNT value on done: 884102.0 [2023-02-25 14:15:34,057][36156] Sum rewards: 55.369, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.905', 'AMMO5': '0.021', 'AMMO2': '0.052', 'weapon5': '0.178', 'weapon2': '0.240', 'weapon4': '0.260', 'AMMO4': '0.261', 'AMMO3': '0.300', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.750', 'HITCOUNT': '2.890', 'weapon3': '2.962', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '53.000'} [2023-02-25 14:15:34,068][36156] DAMAGECOUNT value on done: 889049.0 [2023-02-25 14:15:34,069][36156] Sum rewards: 62.702, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.872', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.096', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon4': '0.230', 'weapon2': '0.530', 'WEAPON3': '1.250', 'weapon3': '2.956', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '54.000'} [2023-02-25 14:15:34,122][36139] DAMAGECOUNT value on done: 889815.0 [2023-02-25 14:15:34,123][36139] Sum rewards: 49.792, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.982', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.204', 'AMMO3': '0.220', 'weapon4': '0.308', 'WEAPON3': '1.350', 'HITCOUNT': '2.780', 'weapon3': '3.158', 'DAMAGECOUNT': '13.497', 'FRAGCOUNT': '44.000'} [2023-02-25 14:15:34,330][36138] Updated weights for policy 0, policy_version 49183 (0.0009) [2023-02-25 14:15:34,434][36139] DAMAGECOUNT value on done: 883205.0 [2023-02-25 14:15:34,434][36139] Sum rewards: 58.503, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.400', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.170', 'AMMO3': '0.171', 'weapon2': '0.178', 'AMMO4': '0.217', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.958', 'WEAPON3': '1.000', 'weapon3': '2.256', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.438', 'FRAGCOUNT': '49.000'} [2023-02-25 14:15:34,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13412.7). Total num frames: 201457664. Throughput: 0: 3350.2. Samples: 12862032. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-25 14:15:34,730][36114] Avg episode reward: [(0, '54.785')] [2023-02-25 14:15:34,791][36139] DAMAGECOUNT value on done: 900527.0 [2023-02-25 14:15:34,791][36139] Sum rewards: 64.812, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.554', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.140', 'AMMO3': '0.182', 'AMMO4': '0.203', 'weapon2': '0.240', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.560', 'WEAPON3': '1.150', 'weapon3': '2.742', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '55.000'} [2023-02-25 14:15:35,084][36139] DAMAGECOUNT value on done: 898033.0 [2023-02-25 14:15:35,085][36139] Sum rewards: 57.962, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.108', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'weapon5': '0.056', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon4': '0.240', 'weapon2': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.088', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.466', 'FRAGCOUNT': '49.500'} [2023-02-25 14:15:37,350][36138] Updated weights for policy 0, policy_version 49193 (0.0009) [2023-02-25 14:15:39,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 201523200. Throughput: 0: 3353.1. Samples: 12872180. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:15:39,730][36114] Avg episode reward: [(0, '55.115')] [2023-02-25 14:15:40,410][36138] Updated weights for policy 0, policy_version 49203 (0.0009) [2023-02-25 14:15:43,450][36138] Updated weights for policy 0, policy_version 49213 (0.0009) [2023-02-25 14:15:44,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 201592832. Throughput: 0: 3353.9. Samples: 12892404. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:15:44,729][36114] Avg episode reward: [(0, '55.115')] [2023-02-25 14:15:46,339][36154] DAMAGECOUNT value on done: 895152.0 [2023-02-25 14:15:46,339][36154] Sum rewards: 66.581, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.935', 'AMMO5': '0.003', 'AMMO2': '0.003', 'ARMOR': '0.008', 'AMMO4': '0.013', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'WEAPON4': '0.200', 'weapon2': '0.244', 'weapon4': '0.504', 'WEAPON3': '0.950', 'weapon3': '3.056', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.778', 'FRAGCOUNT': '55.000'} [2023-02-25 14:15:46,519][36138] Updated weights for policy 0, policy_version 49223 (0.0008) [2023-02-25 14:15:46,644][36154] DAMAGECOUNT value on done: 882865.0 [2023-02-25 14:15:46,644][36154] Sum rewards: 69.050, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.624', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.010', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'weapon5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.126', 'AMMO3': '0.222', 'weapon2': '0.242', 'WEAPON3': '1.450', 'weapon3': '3.406', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '59.000'} [2023-02-25 14:15:46,774][36154] DAMAGECOUNT value on done: 896463.0 [2023-02-25 14:15:46,775][36154] Sum rewards: 61.912, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.474', 'ARMOR': '0.008', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.037', 'AMMO3': '0.178', 'AMMO4': '0.185', 'weapon5': '0.236', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.524', 'WEAPON3': '1.150', 'weapon3': '2.582', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '50.500'} [2023-02-25 14:15:47,079][36141] DAMAGECOUNT value on done: 897336.0 [2023-02-25 14:15:47,080][36141] Sum rewards: 46.188, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.502', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.052', 'AMMO3': '0.136', 'weapon5': '0.154', 'AMMO4': '0.262', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon2': '0.594', 'weapon4': '0.758', 'WEAPON3': '0.850', 'weapon3': '2.258', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.305', 'FRAGCOUNT': '40.000'} [2023-02-25 14:15:47,101][36154] DAMAGECOUNT value on done: 892301.0 [2023-02-25 14:15:47,102][36154] Sum rewards: 52.484, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.320', 'AMMO5': '0.014', 'AMMO2': '0.039', 'AMMO4': '0.193', 'AMMO3': '0.203', 'weapon4': '0.212', 'weapon5': '0.240', 'weapon2': '0.308', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.850', 'weapon3': '2.962', 'DAMAGECOUNT': '13.482', 'FRAGCOUNT': '46.500'} [2023-02-25 14:15:47,388][36141] DAMAGECOUNT value on done: 895930.0 [2023-02-25 14:15:47,389][36141] Sum rewards: 61.177, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.466', 'AMMO5': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.126', 'AMMO3': '0.169', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.376', 'weapon2': '0.396', 'WEAPON3': '1.050', 'weapon3': '2.914', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '52.500'} [2023-02-25 14:15:47,430][36141] DAMAGECOUNT value on done: 889375.0 [2023-02-25 14:15:47,430][36141] Sum rewards: 51.562, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.330', 'AMMO5': '0.015', 'AMMO2': '0.049', 'AMMO3': '0.183', 'weapon5': '0.204', 'AMMO4': '0.245', 'weapon2': '0.278', 'weapon4': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.630', 'weapon3': '2.948', 'DAMAGECOUNT': '14.472', 'FRAGCOUNT': '44.000'} [2023-02-25 14:15:47,734][36141] DAMAGECOUNT value on done: 885174.0 [2023-02-25 14:15:47,735][36141] Sum rewards: 50.993, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.340', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.056', 'WEAPON4': '0.100', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon2': '0.306', 'weapon4': '0.328', 'WEAPON3': '1.050', 'HITCOUNT': '2.770', 'weapon3': '3.128', 'DAMAGECOUNT': '12.861', 'FRAGCOUNT': '43.000'} [2023-02-25 14:15:49,041][36157] DAMAGECOUNT value on done: 901034.0 [2023-02-25 14:15:49,042][36157] Sum rewards: 55.257, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.612', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.148', 'AMMO3': '0.156', 'weapon4': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.640', 'WEAPON3': '0.950', 'weapon3': '2.782', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.362', 'FRAGCOUNT': '47.000'} [2023-02-25 14:15:49,361][36157] DAMAGECOUNT value on done: 891521.0 [2023-02-25 14:15:49,361][36157] Sum rewards: 55.637, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.535', 'AMMO5': '0.010', 'AMMO2': '0.042', 'AMMO3': '0.173', 'weapon5': '0.188', 'AMMO4': '0.211', 'weapon2': '0.226', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '0.950', 'weapon4': '1.404', 'weapon3': '1.710', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '47.000'} [2023-02-25 14:15:49,545][36138] Updated weights for policy 0, policy_version 49233 (0.0009) [2023-02-25 14:15:49,639][36140] DAMAGECOUNT value on done: 896659.0 [2023-02-25 14:15:49,640][36140] Sum rewards: 63.558, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.749', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.034', 'AMMO4': '0.168', 'weapon4': '0.170', 'weapon5': '0.192', 'AMMO3': '0.217', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.988', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '57.000'} [2023-02-25 14:15:49,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13398.8). Total num frames: 201658368. Throughput: 0: 3353.3. Samples: 12912536. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:15:49,729][36114] Avg episode reward: [(0, '55.346')] [2023-02-25 14:15:49,946][36140] DAMAGECOUNT value on done: 879747.0 [2023-02-25 14:15:49,947][36140] Sum rewards: 59.865, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.700', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon5': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.256', 'AMMO3': '0.274', 'weapon2': '0.346', 'WEAPON3': '1.700', 'weapon3': '2.784', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '53.000'} [2023-02-25 14:15:49,963][36157] DAMAGECOUNT value on done: 903314.0 [2023-02-25 14:15:49,963][36157] Sum rewards: 59.175, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.496', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.162', 'AMMO4': '0.173', 'AMMO3': '0.196', 'weapon4': '0.216', 'weapon2': '0.282', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.076', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.618', 'FRAGCOUNT': '51.000'} [2023-02-25 14:15:50,064][36140] DAMAGECOUNT value on done: 888703.0 [2023-02-25 14:15:50,064][36140] Sum rewards: 49.338, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.517', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.064', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'weapon2': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'weapon4': '0.438', 'WEAPON3': '1.350', 'HITCOUNT': '2.920', 'weapon3': '3.000', 'DAMAGECOUNT': '13.692', 'FRAGCOUNT': '43.000'} [2023-02-25 14:15:50,269][36157] DAMAGECOUNT value on done: 895861.0 [2023-02-25 14:15:50,269][36157] Sum rewards: 53.821, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.660', 'AMMO2': '0.013', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'AMMO3': '0.262', 'weapon4': '0.308', 'weapon2': '0.720', 'WEAPON3': '1.550', 'weapon3': '2.626', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.085', 'FRAGCOUNT': '50.000'} [2023-02-25 14:15:50,364][36140] DAMAGECOUNT value on done: 889662.0 [2023-02-25 14:15:50,365][36140] Sum rewards: 59.092, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.944', 'AMMO5': '0.014', 'AMMO2': '0.023', 'weapon5': '0.110', 'AMMO4': '0.116', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.412', 'weapon2': '0.532', 'WEAPON3': '1.250', 'weapon3': '2.700', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.429', 'FRAGCOUNT': '50.000'} [2023-02-25 14:15:51,701][36155] DAMAGECOUNT value on done: 886848.0 [2023-02-25 14:15:51,702][36155] Sum rewards: 54.380, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.068', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon5': '0.146', 'AMMO4': '0.218', 'AMMO3': '0.233', 'weapon2': '0.306', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.458', 'WEAPON3': '1.400', 'weapon3': '2.704', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.774', 'FRAGCOUNT': '50.000'} [2023-02-25 14:15:51,746][36142] DAMAGECOUNT value on done: 897826.0 [2023-02-25 14:15:51,746][36142] Sum rewards: 56.086, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.170', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.074', 'weapon4': '0.090', 'AMMO4': '0.096', 'AMMO3': '0.155', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.514', 'WEAPON3': '1.050', 'HITCOUNT': '2.860', 'weapon3': '3.170', 'DAMAGECOUNT': '13.968', 'FRAGCOUNT': '47.000'} [2023-02-25 14:15:52,015][36155] DAMAGECOUNT value on done: 898535.0 [2023-02-25 14:15:52,015][36155] Sum rewards: 56.710, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.198', 'AMMO5': '0.017', 'ARMOR': '0.020', 'AMMO2': '0.060', 'AMMO3': '0.193', 'weapon2': '0.194', 'AMMO4': '0.302', 'weapon5': '0.318', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'weapon4': '0.830', 'WEAPON3': '1.150', 'weapon3': '2.330', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.063', 'FRAGCOUNT': '49.000'} [2023-02-25 14:15:52,057][36142] DAMAGECOUNT value on done: 878210.0 [2023-02-25 14:15:52,058][36142] Sum rewards: 67.392, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.667', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.062', 'AMMO3': '0.223', 'weapon2': '0.666', 'WEAPON3': '1.450', 'weapon3': '3.046', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.849', 'FRAGCOUNT': '58.000'} [2023-02-25 14:15:52,345][36142] DAMAGECOUNT value on done: 886832.0 [2023-02-25 14:15:52,345][36142] Sum rewards: 55.999, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.462', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon2': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.160', 'weapon5': '0.204', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.602', 'WEAPON3': '1.000', 'weapon3': '2.812', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.535', 'FRAGCOUNT': '47.000'} [2023-02-25 14:15:52,584][36138] Updated weights for policy 0, policy_version 49243 (0.0009) [2023-02-25 14:15:52,672][36142] DAMAGECOUNT value on done: 903065.0 [2023-02-25 14:15:52,672][36142] Sum rewards: 59.763, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.543', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.134', 'AMMO4': '0.153', 'AMMO3': '0.196', 'weapon2': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.384', 'WEAPON3': '1.300', 'weapon3': '2.978', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.333', 'FRAGCOUNT': '52.000'} [2023-02-25 14:15:52,765][36140] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-25 14:15:53,156][36155] DAMAGECOUNT value on done: 903888.0 [2023-02-25 14:15:53,157][36155] Sum rewards: 58.954, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.191', 'AMMO5': '0.017', 'AMMO2': '0.049', 'AMMO3': '0.212', 'AMMO4': '0.244', 'weapon5': '0.308', 'weapon4': '0.340', 'weapon2': '0.426', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.518', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '51.000'} [2023-02-25 14:15:53,470][36155] DAMAGECOUNT value on done: 889243.0 [2023-02-25 14:15:53,471][36155] Sum rewards: 53.601, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.838', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.056', 'AMMO3': '0.193', 'weapon2': '0.196', 'AMMO4': '0.280', 'weapon5': '0.300', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.674', 'WEAPON3': '1.250', 'weapon3': '2.512', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.723', 'FRAGCOUNT': '47.000'} [2023-02-25 14:15:53,763][36156] DAMAGECOUNT value on done: 899448.0 [2023-02-25 14:15:53,763][36156] Sum rewards: 56.936, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.990', 'AMMO5': '0.005', 'AMMO2': '0.035', 'AMMO4': '0.172', 'weapon5': '0.186', 'weapon4': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.218', 'AMMO3': '0.238', 'WEAPON3': '1.500', 'weapon3': '3.140', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.114', 'FRAGCOUNT': '50.000'} [2023-02-25 14:15:53,774][36156] DAMAGECOUNT value on done: 905003.0 [2023-02-25 14:15:53,775][36156] Sum rewards: 64.767, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.814', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon4': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'weapon5': '0.122', 'AMMO3': '0.231', 'weapon2': '0.326', 'WEAPON3': '1.400', 'HITCOUNT': '3.040', 'weapon3': '3.274', 'DAMAGECOUNT': '16.269', 'FRAGCOUNT': '55.000'} [2023-02-25 14:15:53,921][36139] DAMAGECOUNT value on done: 894882.0 [2023-02-25 14:15:53,921][36139] Sum rewards: 58.614, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.664', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.160', 'AMMO3': '0.170', 'weapon2': '0.588', 'WEAPON3': '1.100', 'weapon3': '2.844', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.201', 'FRAGCOUNT': '48.000'} [2023-02-25 14:15:54,085][36156] DAMAGECOUNT value on done: 889319.0 [2023-02-25 14:15:54,086][36156] Sum rewards: 56.901, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.524', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon5': '0.192', 'AMMO3': '0.205', 'weapon2': '0.210', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.778', 'WEAPON3': '1.150', 'weapon3': '2.480', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.651', 'FRAGCOUNT': '50.000'} [2023-02-25 14:15:54,097][36156] DAMAGECOUNT value on done: 894569.0 [2023-02-25 14:15:54,098][36156] Sum rewards: 63.717, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.480', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.152', 'WEAPON5': '0.200', 'weapon2': '0.236', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'weapon4': '0.556', 'WEAPON3': '1.450', 'weapon3': '2.706', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.560', 'FRAGCOUNT': '57.000'} [2023-02-25 14:15:54,239][36139] DAMAGECOUNT value on done: 887800.0 [2023-02-25 14:15:54,239][36139] Sum rewards: 56.264, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.612', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.068', 'AMMO4': '0.107', 'AMMO3': '0.142', 'weapon5': '0.158', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.436', 'WEAPON3': '0.900', 'HITCOUNT': '2.660', 'weapon3': '3.090', 'DAMAGECOUNT': '13.785', 'FRAGCOUNT': '47.000'} [2023-02-25 14:15:54,626][36139] DAMAGECOUNT value on done: 906200.0 [2023-02-25 14:15:54,627][36139] Sum rewards: 59.627, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.910', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.180', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.372', 'weapon4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.682', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '51.000'} [2023-02-25 14:15:54,729][36114] Fps is (10 sec: 13107.0, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 201723904. Throughput: 0: 3355.9. Samples: 12922666. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:15:54,730][36114] Avg episode reward: [(0, '56.386')] [2023-02-25 14:15:54,917][36139] DAMAGECOUNT value on done: 903276.0 [2023-02-25 14:15:54,917][36139] Sum rewards: 51.692, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.607', 'ARMOR': '0.012', 'AMMO5': '0.020', 'AMMO2': '0.046', 'weapon5': '0.200', 'AMMO3': '0.206', 'AMMO4': '0.231', 'weapon4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.482', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.732', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.669', 'FRAGCOUNT': '45.500'} [2023-02-25 14:15:55,685][36138] Updated weights for policy 0, policy_version 49253 (0.0009) [2023-02-25 14:15:58,705][36138] Updated weights for policy 0, policy_version 49263 (0.0009) [2023-02-25 14:15:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13412.7). Total num frames: 201793536. Throughput: 0: 3355.5. Samples: 12942786. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:15:59,730][36114] Avg episode reward: [(0, '56.413')] [2023-02-25 14:16:01,768][36138] Updated weights for policy 0, policy_version 49273 (0.0009) [2023-02-25 14:16:04,596][36141] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:16:04,729][36114] Fps is (10 sec: 13517.0, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 201859072. Throughput: 0: 3352.7. Samples: 12962798. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:16:04,730][36114] Avg episode reward: [(0, '56.413')] [2023-02-25 14:16:04,881][36138] Updated weights for policy 0, policy_version 49283 (0.0009) [2023-02-25 14:16:06,401][36154] DAMAGECOUNT value on done: 899853.0 [2023-02-25 14:16:06,401][36154] Sum rewards: 59.387, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.317', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon5': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.128', 'WEAPON5': '0.150', 'weapon4': '0.296', 'weapon2': '0.650', 'WEAPON3': '0.850', 'weapon3': '2.808', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.103', 'FRAGCOUNT': '47.000'} [2023-02-25 14:16:06,697][36154] DAMAGECOUNT value on done: 887235.0 [2023-02-25 14:16:06,698][36154] Sum rewards: 53.300, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.153', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.124', 'AMMO3': '0.139', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'weapon4': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.560', 'WEAPON3': '0.800', 'HITCOUNT': '2.830', 'weapon3': '2.862', 'DAMAGECOUNT': '13.110', 'FRAGCOUNT': '43.500'} [2023-02-25 14:16:06,888][36154] DAMAGECOUNT value on done: 901076.0 [2023-02-25 14:16:06,889][36154] Sum rewards: 50.926, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.034', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.118', 'AMMO3': '0.174', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.338', 'ARMOR': '0.400', 'weapon2': '0.416', 'WEAPON3': '1.150', 'HITCOUNT': '2.790', 'weapon3': '2.810', 'DAMAGECOUNT': '13.833', 'FRAGCOUNT': '43.000'} [2023-02-25 14:16:07,166][36154] DAMAGECOUNT value on done: 897396.0 [2023-02-25 14:16:07,167][36154] Sum rewards: 57.605, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.670', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.051', 'AMMO3': '0.141', 'weapon5': '0.192', 'AMMO4': '0.256', 'WEAPON5': '0.300', 'weapon2': '0.380', 'WEAPON4': '0.700', 'weapon4': '0.896', 'WEAPON3': '0.900', 'weapon3': '2.286', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.285', 'FRAGCOUNT': '49.000'} [2023-02-25 14:16:07,277][36141] DAMAGECOUNT value on done: 902169.0 [2023-02-25 14:16:07,277][36141] Sum rewards: 56.324, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.114', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.038', 'AMMO4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.265', 'weapon2': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '3.180', 'weapon3': '3.344', 'DAMAGECOUNT': '14.499', 'FRAGCOUNT': '50.000'} [2023-02-25 14:16:07,595][36141] DAMAGECOUNT value on done: 901608.0 [2023-02-25 14:16:07,595][36141] Sum rewards: 60.078, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-3.695', 'ARMOR': '0.004', 'AMMO5': '0.008', 'weapon5': '0.032', 'AMMO2': '0.040', 'weapon4': '0.164', 'weapon2': '0.176', 'AMMO4': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'AMMO3': '0.333', 'WEAPON3': '1.950', 'weapon3': '3.332', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '57.500'} [2023-02-25 14:16:07,621][36141] DAMAGECOUNT value on done: 895061.0 [2023-02-25 14:16:07,621][36141] Sum rewards: 55.646, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-4.171', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.184', 'AMMO4': '0.216', 'weapon2': '0.256', 'AMMO3': '0.289', 'weapon4': '0.348', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.750', 'weapon3': '2.806', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '52.500'} [2023-02-25 14:16:07,928][36138] Updated weights for policy 0, policy_version 49293 (0.0010) [2023-02-25 14:16:07,929][36141] DAMAGECOUNT value on done: 890081.0 [2023-02-25 14:16:07,930][36141] Sum rewards: 58.784, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.720', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.090', 'AMMO4': '0.140', 'WEAPON5': '0.200', 'weapon4': '0.204', 'weapon2': '0.218', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.110', 'weapon3': '3.230', 'DAMAGECOUNT': '14.721', 'FRAGCOUNT': '54.000'} [2023-02-25 14:16:09,131][36157] DAMAGECOUNT value on done: 905716.0 [2023-02-25 14:16:09,131][36157] Sum rewards: 54.120, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.706', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.033', 'weapon5': '0.142', 'AMMO4': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.274', 'WEAPON4': '0.300', 'weapon4': '0.820', 'WEAPON3': '1.350', 'weapon3': '2.394', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.941', 'FRAGCOUNT': '48.000'} [2023-02-25 14:16:09,424][36157] DAMAGECOUNT value on done: 896694.0 [2023-02-25 14:16:09,424][36157] Sum rewards: 53.203, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.690', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon2': '0.212', 'weapon4': '0.278', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.062', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.519', 'FRAGCOUNT': '44.000'} [2023-02-25 14:16:09,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 201928704. Throughput: 0: 3352.0. Samples: 12972754. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:16:09,730][36114] Avg episode reward: [(0, '56.591')] [2023-02-25 14:16:09,737][36140] DAMAGECOUNT value on done: 902216.0 [2023-02-25 14:16:09,737][36140] Sum rewards: 61.711, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.006', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon5': '0.156', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.354', 'weapon2': '0.460', 'WEAPON3': '1.150', 'weapon3': '2.776', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '53.000'} [2023-02-25 14:16:10,039][36157] DAMAGECOUNT value on done: 907804.0 [2023-02-25 14:16:10,040][36157] Sum rewards: 46.961, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.979', 'AMMO5': '0.017', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.188', 'AMMO3': '0.208', 'weapon4': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.486', 'WEAPON3': '1.300', 'weapon3': '2.818', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.470', 'FRAGCOUNT': '42.500'} [2023-02-25 14:16:10,058][36140] DAMAGECOUNT value on done: 883899.0 [2023-02-25 14:16:10,059][36140] Sum rewards: 46.276, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.015', 'AMMO2': '0.031', 'HEALTH': '0.038', 'AMMO3': '0.113', 'AMMO4': '0.156', 'weapon5': '0.172', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.374', 'weapon4': '0.592', 'WEAPON3': '0.650', 'weapon3': '2.038', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '12.456', 'FRAGCOUNT': '37.000'} [2023-02-25 14:16:10,173][36140] DAMAGECOUNT value on done: 893951.0 [2023-02-25 14:16:10,173][36140] Sum rewards: 58.955, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.266', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'weapon5': '0.064', 'weapon4': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'weapon2': '0.334', 'WEAPON3': '1.350', 'HITCOUNT': '3.130', 'weapon3': '3.262', 'DAMAGECOUNT': '15.744', 'FRAGCOUNT': '50.000'} [2023-02-25 14:16:10,181][36139] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('ARMOR', -0.001, -1.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:16:10,351][36157] DAMAGECOUNT value on done: 900950.0 [2023-02-25 14:16:10,352][36157] Sum rewards: 59.089, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.000', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.025', 'weapon4': '0.056', 'AMMO4': '0.124', 'weapon5': '0.210', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.300', 'HITCOUNT': '2.800', 'weapon3': '3.066', 'DAMAGECOUNT': '15.267', 'FRAGCOUNT': '52.000'} [2023-02-25 14:16:10,472][36140] DAMAGECOUNT value on done: 894433.0 [2023-02-25 14:16:10,473][36140] Sum rewards: 49.232, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.894', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.067', 'AMMO3': '0.181', 'weapon2': '0.218', 'weapon5': '0.310', 'AMMO4': '0.333', 'WEAPON5': '0.550', 'WEAPON4': '0.700', 'weapon4': '0.962', 'WEAPON3': '1.000', 'weapon3': '2.176', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '14.313', 'FRAGCOUNT': '45.500'} [2023-02-25 14:16:10,942][36138] Updated weights for policy 0, policy_version 49303 (0.0009) [2023-02-25 14:16:11,666][36155] DAMAGECOUNT value on done: 891908.0 [2023-02-25 14:16:11,667][36155] Sum rewards: 56.798, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.808', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.136', 'AMMO3': '0.173', 'AMMO4': '0.226', 'WEAPON5': '0.350', 'weapon4': '0.406', 'WEAPON4': '0.450', 'weapon2': '0.492', 'WEAPON3': '0.950', 'weapon3': '2.718', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '47.000'} [2023-02-25 14:16:11,812][36142] DAMAGECOUNT value on done: 902773.0 [2023-02-25 14:16:11,813][36142] Sum rewards: 54.374, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.145', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.174', 'weapon2': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'weapon4': '0.280', 'WEAPON3': '1.700', 'HITCOUNT': '2.940', 'weapon3': '2.978', 'DAMAGECOUNT': '14.841', 'FRAGCOUNT': '51.000'} [2023-02-25 14:16:11,963][36155] DAMAGECOUNT value on done: 903670.0 [2023-02-25 14:16:11,964][36155] Sum rewards: 59.145, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.210', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.055', 'AMMO3': '0.160', 'weapon5': '0.230', 'AMMO4': '0.273', 'weapon4': '0.320', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.514', 'WEAPON3': '0.950', 'weapon3': '2.646', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '50.000'} [2023-02-25 14:16:12,126][36142] DAMAGECOUNT value on done: 883774.0 [2023-02-25 14:16:12,127][36142] Sum rewards: 60.570, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.450', 'ARMOR': '0.008', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'AMMO4': '0.162', 'weapon5': '0.168', 'AMMO3': '0.200', 'weapon2': '0.412', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.550', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.692', 'FRAGCOUNT': '53.000'} [2023-02-25 14:16:12,414][36142] DAMAGECOUNT value on done: 892557.0 [2023-02-25 14:16:12,414][36142] Sum rewards: 71.414, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.330', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.072', 'weapon5': '0.136', 'weapon2': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon4': '0.286', 'WEAPON3': '1.250', 'weapon3': '3.206', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '60.000'} [2023-02-25 14:16:12,719][36142] DAMAGECOUNT value on done: 908621.0 [2023-02-25 14:16:12,719][36142] Sum rewards: 70.459, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.366', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.165', 'weapon4': '0.222', 'weapon2': '0.360', 'WEAPON3': '1.100', 'weapon3': '3.234', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '57.000'} [2023-02-25 14:16:13,076][36155] DAMAGECOUNT value on done: 909215.0 [2023-02-25 14:16:13,076][36155] Sum rewards: 58.640, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.870', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.122', 'weapon5': '0.124', 'AMMO4': '0.188', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.412', 'WEAPON3': '1.300', 'HITCOUNT': '3.040', 'weapon3': '3.062', 'DAMAGECOUNT': '15.981', 'FRAGCOUNT': '51.000'} [2023-02-25 14:16:13,375][36155] DAMAGECOUNT value on done: 894998.0 [2023-02-25 14:16:13,375][36155] Sum rewards: 65.374, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.790', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.048', 'weapon5': '0.064', 'WEAPON5': '0.150', 'weapon4': '0.200', 'weapon2': '0.210', 'AMMO4': '0.241', 'WEAPON4': '0.250', 'AMMO3': '0.290', 'WEAPON3': '1.850', 'weapon3': '3.254', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '60.000'} [2023-02-25 14:16:13,833][36139] DAMAGECOUNT value on done: 900558.0 [2023-02-25 14:16:13,833][36139] Sum rewards: 62.550, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-4.340', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.066', 'weapon5': '0.138', 'weapon2': '0.174', 'AMMO4': '0.250', 'AMMO3': '0.304', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.850', 'weapon3': '3.328', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '59.000'} [2023-02-25 14:16:13,895][36156] DAMAGECOUNT value on done: 904007.0 [2023-02-25 14:16:13,895][36156] Sum rewards: 55.381, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.652', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.126', 'weapon2': '0.128', 'AMMO3': '0.177', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.662', 'WEAPON3': '1.050', 'weapon3': '2.846', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.677', 'FRAGCOUNT': '48.000'} [2023-02-25 14:16:13,926][36156] DAMAGECOUNT value on done: 910493.0 [2023-02-25 14:16:13,927][36156] Sum rewards: 59.521, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.730', 'AMMO5': '0.011', 'AMMO2': '0.071', 'weapon5': '0.186', 'AMMO3': '0.222', 'WEAPON5': '0.350', 'AMMO4': '0.354', 'weapon2': '0.364', 'WEAPON4': '0.600', 'weapon4': '0.734', 'WEAPON3': '1.300', 'weapon3': '2.382', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.957', 'FRAGCOUNT': '54.000'} [2023-02-25 14:16:13,982][36138] Updated weights for policy 0, policy_version 49313 (0.0009) [2023-02-25 14:16:14,140][36139] DAMAGECOUNT value on done: 893935.0 [2023-02-25 14:16:14,141][36139] Sum rewards: 66.520, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.588', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon5': '0.170', 'AMMO3': '0.277', 'weapon2': '0.338', 'WEAPON5': '0.350', 'weapon4': '0.364', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '2.782', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '59.000'} [2023-02-25 14:16:14,218][36156] DAMAGECOUNT value on done: 894624.0 [2023-02-25 14:16:14,219][36156] Sum rewards: 59.703, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.529', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon5': '0.150', 'AMMO3': '0.199', 'weapon2': '0.290', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.578', 'WEAPON3': '1.250', 'weapon3': '2.722', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.915', 'FRAGCOUNT': '51.000'} [2023-02-25 14:16:14,260][36156] DAMAGECOUNT value on done: 900403.0 [2023-02-25 14:16:14,261][36156] Sum rewards: 72.591, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.850', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.062', 'AMMO4': '0.091', 'AMMO3': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.532', 'weapon4': '0.628', 'WEAPON3': '0.900', 'weapon3': '2.516', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '59.000'} [2023-02-25 14:16:14,604][36139] DAMAGECOUNT value on done: 911383.0 [2023-02-25 14:16:14,605][36139] Sum rewards: 68.029, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.027', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon5': '0.112', 'AMMO4': '0.134', 'weapon4': '0.152', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.322', 'WEAPON3': '1.100', 'weapon3': '3.228', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.549', 'FRAGCOUNT': '58.000'} [2023-02-25 14:16:14,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 201994240. Throughput: 0: 3356.3. Samples: 12993020. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:16:14,729][36114] Avg episode reward: [(0, '57.636')] [2023-02-25 14:16:14,730][36125] Saving new best policy, reward=57.636! [2023-02-25 14:16:14,928][36139] DAMAGECOUNT value on done: 907959.0 [2023-02-25 14:16:14,929][36139] Sum rewards: 58.809, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.620', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.189', 'weapon4': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.672', 'WEAPON3': '1.050', 'weapon3': '2.844', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.019', 'FRAGCOUNT': '49.500'} [2023-02-25 14:16:17,013][36138] Updated weights for policy 0, policy_version 49323 (0.0009) [2023-02-25 14:16:18,853][36157] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:16:19,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 202059776. Throughput: 0: 3358.6. Samples: 13013168. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:16:19,729][36114] Avg episode reward: [(0, '57.683')] [2023-02-25 14:16:19,757][36125] Saving new best policy, reward=57.683! [2023-02-25 14:16:20,088][36138] Updated weights for policy 0, policy_version 49333 (0.0009) [2023-02-25 14:16:23,135][36138] Updated weights for policy 0, policy_version 49343 (0.0009) [2023-02-25 14:16:24,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 202129408. Throughput: 0: 3354.3. Samples: 13023122. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:16:24,730][36114] Avg episode reward: [(0, '57.683')] [2023-02-25 14:16:26,208][36138] Updated weights for policy 0, policy_version 49353 (0.0009) [2023-02-25 14:16:26,337][36154] DAMAGECOUNT value on done: 905523.0 [2023-02-25 14:16:26,337][36154] Sum rewards: 64.903, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.248', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.150', 'AMMO4': '0.188', 'AMMO3': '0.189', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON4': '0.350', 'weapon4': '0.456', 'WEAPON3': '1.150', 'weapon3': '2.850', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '55.000'} [2023-02-25 14:16:26,656][36154] DAMAGECOUNT value on done: 891961.0 [2023-02-25 14:16:26,657][36154] Sum rewards: 55.344, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.860', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.160', 'AMMO3': '0.170', 'weapon2': '0.228', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.612', 'WEAPON3': '1.050', 'weapon3': '2.696', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.178', 'FRAGCOUNT': '46.000'} [2023-02-25 14:16:26,852][36154] DAMAGECOUNT value on done: 905186.0 [2023-02-25 14:16:26,852][36154] Sum rewards: 47.499, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.282', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.018', 'AMMO4': '0.028', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.171', 'weapon2': '0.854', 'WEAPON3': '0.950', 'HITCOUNT': '2.500', 'weapon3': '2.808', 'DAMAGECOUNT': '12.300', 'FRAGCOUNT': '40.000'} [2023-02-25 14:16:27,168][36141] DAMAGECOUNT value on done: 907061.0 [2023-02-25 14:16:27,169][36141] Sum rewards: 58.865, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.185', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.038', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.222', 'weapon4': '0.286', 'weapon2': '0.648', 'WEAPON3': '1.400', 'weapon3': '2.920', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '52.000'} [2023-02-25 14:16:27,181][36154] DAMAGECOUNT value on done: 901305.0 [2023-02-25 14:16:27,182][36154] Sum rewards: 50.569, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.648', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.160', 'WEAPON4': '0.300', 'weapon2': '0.332', 'weapon4': '0.440', 'WEAPON3': '1.000', 'HITCOUNT': '2.680', 'weapon3': '2.826', 'DAMAGECOUNT': '11.727', 'FRAGCOUNT': '43.000'} [2023-02-25 14:16:27,472][36141] DAMAGECOUNT value on done: 906169.0 [2023-02-25 14:16:27,472][36141] Sum rewards: 51.238, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.710', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.132', 'weapon5': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.642', 'weapon4': '0.790', 'WEAPON3': '0.800', 'weapon3': '1.992', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.683', 'FRAGCOUNT': '42.000'} [2023-02-25 14:16:27,496][36141] DAMAGECOUNT value on done: 899993.0 [2023-02-25 14:16:27,496][36141] Sum rewards: 66.446, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.320', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.032', 'weapon5': '0.128', 'AMMO3': '0.137', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.378', 'weapon2': '0.402', 'WEAPON3': '0.900', 'weapon3': '2.902', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.796', 'FRAGCOUNT': '55.000'} [2023-02-25 14:16:27,815][36141] DAMAGECOUNT value on done: 895365.0 [2023-02-25 14:16:27,816][36141] Sum rewards: 65.762, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.812', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.046', 'AMMO4': '0.085', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon4': '0.272', 'weapon2': '0.422', 'WEAPON3': '1.300', 'weapon3': '3.012', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '59.000'} [2023-02-25 14:16:28,145][36154] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:16:29,262][36157] DAMAGECOUNT value on done: 910471.0 [2023-02-25 14:16:29,262][36157] Sum rewards: 59.923, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.862', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon4': '0.238', 'weapon2': '0.348', 'WEAPON3': '1.400', 'weapon3': '3.022', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.265', 'FRAGCOUNT': '53.000'} [2023-02-25 14:16:29,297][36138] Updated weights for policy 0, policy_version 49363 (0.0009) [2023-02-25 14:16:29,583][36157] DAMAGECOUNT value on done: 901731.0 [2023-02-25 14:16:29,584][36157] Sum rewards: 58.791, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.366', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'weapon2': '0.272', 'weapon4': '0.316', 'WEAPON3': '1.200', 'weapon3': '3.180', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.111', 'FRAGCOUNT': '49.000'} [2023-02-25 14:16:29,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13398.8). Total num frames: 202194944. Throughput: 0: 3353.5. Samples: 13043312. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:16:29,729][36114] Avg episode reward: [(0, '57.711')] [2023-02-25 14:16:29,733][36125] Saving new best policy, reward=57.711! [2023-02-25 14:16:29,760][36140] DAMAGECOUNT value on done: 907026.0 [2023-02-25 14:16:29,760][36140] Sum rewards: 54.152, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.818', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon4': '0.072', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'AMMO3': '0.241', 'weapon2': '0.322', 'WEAPON3': '1.450', 'HITCOUNT': '2.760', 'weapon3': '3.396', 'DAMAGECOUNT': '14.430', 'FRAGCOUNT': '48.000'} [2023-02-25 14:16:30,074][36140] DAMAGECOUNT value on done: 888043.0 [2023-02-25 14:16:30,075][36140] Sum rewards: 43.458, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.480', 'AMMO5': '0.008', 'AMMO2': '0.062', 'weapon5': '0.144', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'AMMO4': '0.309', 'WEAPON4': '0.350', 'weapon4': '0.544', 'weapon2': '0.558', 'WEAPON3': '1.300', 'HITCOUNT': '2.360', 'weapon3': '2.446', 'DAMAGECOUNT': '12.432', 'FRAGCOUNT': '40.000'} [2023-02-25 14:16:30,199][36140] DAMAGECOUNT value on done: 898417.0 [2023-02-25 14:16:30,200][36140] Sum rewards: 48.261, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.035', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon5': '0.190', 'AMMO3': '0.196', 'AMMO4': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.658', 'weapon4': '0.874', 'WEAPON3': '1.150', 'weapon3': '1.948', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.398', 'FRAGCOUNT': '43.000'} [2023-02-25 14:16:30,214][36157] DAMAGECOUNT value on done: 912493.0 [2023-02-25 14:16:30,215][36157] Sum rewards: 56.263, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.512', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.100', 'AMMO3': '0.164', 'weapon5': '0.168', 'AMMO4': '0.171', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.688', 'WEAPON3': '1.000', 'weapon3': '2.832', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.067', 'FRAGCOUNT': '47.000'} [2023-02-25 14:16:30,496][36140] DAMAGECOUNT value on done: 898743.0 [2023-02-25 14:16:30,496][36140] Sum rewards: 44.912, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.428', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.038', 'AMMO4': '0.190', 'AMMO3': '0.219', 'weapon2': '0.242', 'weapon5': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.754', 'WEAPON3': '1.300', 'weapon3': '2.454', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '12.930', 'FRAGCOUNT': '40.000'} [2023-02-25 14:16:30,532][36157] DAMAGECOUNT value on done: 907142.0 [2023-02-25 14:16:30,532][36157] Sum rewards: 68.880, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.866', 'AMMO5': '0.014', 'AMMO2': '0.047', 'AMMO3': '0.169', 'weapon5': '0.176', 'AMMO4': '0.236', 'weapon4': '0.306', 'weapon2': '0.448', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.784', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '57.000'} [2023-02-25 14:16:31,672][36155] DAMAGECOUNT value on done: 896681.0 [2023-02-25 14:16:31,672][36155] Sum rewards: 57.634, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.740', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.148', 'AMMO3': '0.188', 'AMMO4': '0.232', 'weapon2': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.740', 'WEAPON3': '1.100', 'weapon3': '2.558', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.319', 'FRAGCOUNT': '50.000'} [2023-02-25 14:16:31,945][36142] DAMAGECOUNT value on done: 906495.0 [2023-02-25 14:16:31,946][36142] Sum rewards: 41.007, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.030', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon7': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.124', 'AMMO3': '0.139', 'WEAPON7': '0.200', 'AMMO4': '0.250', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '0.850', 'weapon4': '0.880', 'weapon2': '0.884', 'weapon3': '1.588', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '11.166', 'FRAGCOUNT': '36.000'} [2023-02-25 14:16:32,003][36155] DAMAGECOUNT value on done: 908748.0 [2023-02-25 14:16:32,003][36155] Sum rewards: 58.364, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.955', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.053', 'AMMO3': '0.184', 'weapon2': '0.194', 'weapon5': '0.214', 'AMMO4': '0.265', 'WEAPON5': '0.350', 'weapon4': '0.352', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.994', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '51.000'} [2023-02-25 14:16:32,256][36142] DAMAGECOUNT value on done: 888046.0 [2023-02-25 14:16:32,257][36142] Sum rewards: 46.227, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.155', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon5': '0.170', 'AMMO4': '0.205', 'AMMO3': '0.208', 'weapon2': '0.210', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.710', 'WEAPON3': '1.250', 'weapon3': '2.516', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '12.816', 'FRAGCOUNT': '42.000'} [2023-02-25 14:16:32,350][36138] Updated weights for policy 0, policy_version 49373 (0.0009) [2023-02-25 14:16:32,535][36142] DAMAGECOUNT value on done: 896176.0 [2023-02-25 14:16:32,535][36142] Sum rewards: 35.390, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.360', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.080', 'weapon7': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.416', 'weapon4': '0.698', 'WEAPON3': '1.050', 'HITCOUNT': '2.270', 'weapon3': '2.274', 'DAMAGECOUNT': '10.857', 'FRAGCOUNT': '32.000'} [2023-02-25 14:16:32,832][36142] DAMAGECOUNT value on done: 913622.0 [2023-02-25 14:16:32,832][36142] Sum rewards: 57.263, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.323', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.052', 'weapon4': '0.094', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.364', 'WEAPON3': '1.400', 'HITCOUNT': '2.900', 'weapon3': '3.246', 'DAMAGECOUNT': '15.003', 'FRAGCOUNT': '50.000'} [2023-02-25 14:16:33,067][36155] DAMAGECOUNT value on done: 913715.0 [2023-02-25 14:16:33,068][36155] Sum rewards: 44.601, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.108', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.067', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.239', 'weapon5': '0.272', 'weapon2': '0.318', 'AMMO4': '0.334', 'WEAPON5': '0.500', 'weapon4': '0.690', 'WEAPON4': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.202', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.870', 'FRAGCOUNT': '43.500'} [2023-02-25 14:16:33,385][36155] DAMAGECOUNT value on done: 899701.0 [2023-02-25 14:16:33,386][36155] Sum rewards: 54.359, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.781', 'AMMO5': '0.017', 'AMMO2': '0.041', 'AMMO3': '0.202', 'AMMO4': '0.204', 'weapon5': '0.226', 'weapon2': '0.282', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.804', 'WEAPON3': '1.100', 'weapon3': '2.314', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.109', 'FRAGCOUNT': '49.000'} [2023-02-25 14:16:33,813][36139] DAMAGECOUNT value on done: 905656.0 [2023-02-25 14:16:33,814][36139] Sum rewards: 59.954, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.776', 'AMMO5': '0.019', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.145', 'weapon4': '0.156', 'WEAPON4': '0.250', 'weapon5': '0.262', 'WEAPON5': '0.450', 'weapon2': '0.552', 'WEAPON3': '0.900', 'weapon3': '2.722', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '15.294', 'FRAGCOUNT': '49.000'} [2023-02-25 14:16:33,960][36156] DAMAGECOUNT value on done: 907881.0 [2023-02-25 14:16:33,960][36156] Sum rewards: 40.676, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.302', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.044', 'AMMO3': '0.209', 'AMMO4': '0.222', 'weapon5': '0.244', 'weapon2': '0.278', 'WEAPON5': '0.350', 'weapon4': '0.474', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '2.560', 'weapon3': '2.702', 'DAMAGECOUNT': '11.622', 'FRAGCOUNT': '39.000'} [2023-02-25 14:16:33,972][36156] DAMAGECOUNT value on done: 915106.0 [2023-02-25 14:16:33,972][36156] Sum rewards: 49.756, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.485', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.126', 'weapon4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'WEAPON5': '0.250', 'weapon2': '0.728', 'WEAPON3': '1.150', 'weapon3': '2.790', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.839', 'FRAGCOUNT': '42.000'} [2023-02-25 14:16:34,123][36139] DAMAGECOUNT value on done: 898400.0 [2023-02-25 14:16:34,124][36139] Sum rewards: 47.359, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.068', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.034', 'weapon5': '0.114', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'weapon2': '0.256', 'WEAPON3': '1.350', 'HITCOUNT': '2.670', 'weapon3': '3.440', 'DAMAGECOUNT': '13.395', 'FRAGCOUNT': '42.500'} [2023-02-25 14:16:34,272][36156] DAMAGECOUNT value on done: 899764.0 [2023-02-25 14:16:34,273][36156] Sum rewards: 57.110, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.416', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.036', 'AMMO4': '0.178', 'weapon2': '0.188', 'WEAPON5': '0.200', 'weapon4': '0.204', 'AMMO3': '0.228', 'weapon5': '0.240', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.110', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '50.500'} [2023-02-25 14:16:34,283][36156] DAMAGECOUNT value on done: 904444.0 [2023-02-25 14:16:34,284][36156] Sum rewards: 43.255, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.524', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.021', 'weapon7': '0.038', 'weapon5': '0.088', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'weapon2': '0.170', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'weapon4': '0.356', 'WEAPON3': '1.350', 'HITCOUNT': '2.620', 'weapon3': '3.076', 'DAMAGECOUNT': '12.123', 'FRAGCOUNT': '39.000'} [2023-02-25 14:16:34,595][36139] DAMAGECOUNT value on done: 916252.0 [2023-02-25 14:16:34,596][36139] Sum rewards: 59.920, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.065', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.142', 'AMMO3': '0.191', 'weapon2': '0.340', 'WEAPON3': '1.300', 'HITCOUNT': '3.040', 'weapon3': '3.334', 'DAMAGECOUNT': '14.607', 'FRAGCOUNT': '51.000'} [2023-02-25 14:16:34,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 202260480. Throughput: 0: 3351.5. Samples: 13063352. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:16:34,730][36114] Avg episode reward: [(0, '56.705')] [2023-02-25 14:16:34,904][36139] DAMAGECOUNT value on done: 912671.0 [2023-02-25 14:16:34,905][36139] Sum rewards: 56.064, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.630', 'AMMO5': '0.011', 'AMMO2': '0.014', 'AMMO4': '0.069', 'AMMO3': '0.136', 'weapon5': '0.178', 'WEAPON4': '0.250', 'weapon2': '0.260', 'WEAPON5': '0.300', 'weapon4': '0.420', 'WEAPON3': '0.900', 'HITCOUNT': '2.710', 'weapon3': '2.810', 'DAMAGECOUNT': '14.136', 'FRAGCOUNT': '46.000'} [2023-02-25 14:16:35,348][36138] Updated weights for policy 0, policy_version 49383 (0.0009) [2023-02-25 14:16:38,448][36138] Updated weights for policy 0, policy_version 49393 (0.0009) [2023-02-25 14:16:39,729][36114] Fps is (10 sec: 13516.6, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 202330112. Throughput: 0: 3347.4. Samples: 13073298. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:16:39,730][36114] Avg episode reward: [(0, '56.638')] [2023-02-25 14:16:41,502][36138] Updated weights for policy 0, policy_version 49403 (0.0009) [2023-02-25 14:16:44,560][36138] Updated weights for policy 0, policy_version 49413 (0.0009) [2023-02-25 14:16:44,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 202395648. Throughput: 0: 3349.6. Samples: 13093520. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:16:44,730][36114] Avg episode reward: [(0, '56.638')] [2023-02-25 14:16:46,530][36154] DAMAGECOUNT value on done: 910469.0 [2023-02-25 14:16:46,531][36154] Sum rewards: 58.532, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.275', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.160', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.366', 'weapon4': '0.608', 'WEAPON3': '1.450', 'weapon3': '2.532', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.838', 'FRAGCOUNT': '52.000'} [2023-02-25 14:16:46,850][36154] DAMAGECOUNT value on done: 896496.0 [2023-02-25 14:16:46,851][36154] Sum rewards: 50.593, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.395', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.030', 'weapon5': '0.134', 'AMMO4': '0.147', 'AMMO3': '0.158', 'weapon4': '0.162', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.568', 'WEAPON3': '1.000', 'HITCOUNT': '2.780', 'weapon3': '2.800', 'DAMAGECOUNT': '13.485', 'FRAGCOUNT': '43.000'} [2023-02-25 14:16:47,054][36154] DAMAGECOUNT value on done: 910944.0 [2023-02-25 14:16:47,054][36154] Sum rewards: 64.704, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.650', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'weapon2': '0.214', 'weapon4': '0.274', 'AMMO3': '0.311', 'WEAPON3': '1.950', 'weapon3': '3.266', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '59.000'} [2023-02-25 14:16:47,257][36141] DAMAGECOUNT value on done: 912441.0 [2023-02-25 14:16:47,257][36141] Sum rewards: 59.663, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.175', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.156', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.454', 'weapon2': '0.626', 'WEAPON3': '1.200', 'weapon3': '2.544', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '51.000'} [2023-02-25 14:16:47,346][36154] DAMAGECOUNT value on done: 906295.0 [2023-02-25 14:16:47,347][36154] Sum rewards: 56.298, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.952', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.046', 'AMMO3': '0.199', 'weapon2': '0.210', 'AMMO4': '0.232', 'weapon5': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.834', 'WEAPON3': '1.100', 'weapon3': '2.398', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.970', 'FRAGCOUNT': '48.000'} [2023-02-25 14:16:47,559][36141] DAMAGECOUNT value on done: 911495.0 [2023-02-25 14:16:47,560][36141] Sum rewards: 64.877, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.542', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.102', 'weapon4': '0.144', 'AMMO4': '0.190', 'weapon2': '0.190', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.300', 'HITCOUNT': '3.250', 'weapon3': '3.374', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '55.000'} [2023-02-25 14:16:47,577][36141] DAMAGECOUNT value on done: 904823.0 [2023-02-25 14:16:47,577][36141] Sum rewards: 59.653, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.490', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.168', 'AMMO3': '0.172', 'weapon2': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.453', 'weapon4': '0.902', 'WEAPON3': '1.050', 'weapon3': '2.468', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.490', 'FRAGCOUNT': '50.000'} [2023-02-25 14:16:47,616][36138] Updated weights for policy 0, policy_version 49423 (0.0009) [2023-02-25 14:16:47,916][36141] DAMAGECOUNT value on done: 900974.0 [2023-02-25 14:16:47,916][36141] Sum rewards: 69.001, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.015', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.031', 'WEAPON4': '0.100', 'weapon4': '0.148', 'weapon5': '0.158', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon2': '0.490', 'WEAPON3': '1.250', 'weapon3': '2.966', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '58.000'} [2023-02-25 14:16:49,310][36157] DAMAGECOUNT value on done: 915044.0 [2023-02-25 14:16:49,311][36157] Sum rewards: 53.193, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.274', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon2': '0.162', 'AMMO3': '0.168', 'weapon5': '0.188', 'AMMO4': '0.272', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.742', 'WEAPON3': '1.000', 'weapon3': '2.536', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.719', 'FRAGCOUNT': '46.000'} [2023-02-25 14:16:49,632][36157] DAMAGECOUNT value on done: 906971.0 [2023-02-25 14:16:49,633][36157] Sum rewards: 61.413, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.070', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.046', 'weapon4': '0.134', 'AMMO4': '0.159', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.508', 'WEAPON3': '1.300', 'weapon3': '3.062', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '54.000'} [2023-02-25 14:16:49,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 202461184. Throughput: 0: 3351.2. Samples: 13113604. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:16:49,730][36114] Avg episode reward: [(0, '56.733')] [2023-02-25 14:16:49,810][36140] DAMAGECOUNT value on done: 911639.0 [2023-02-25 14:16:49,811][36140] Sum rewards: 56.264, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.880', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.088', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon2': '0.346', 'weapon4': '0.620', 'WEAPON3': '1.300', 'weapon3': '2.752', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.839', 'FRAGCOUNT': '50.000'} [2023-02-25 14:16:50,094][36140] DAMAGECOUNT value on done: 893137.0 [2023-02-25 14:16:50,095][36140] Sum rewards: 50.593, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.341', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.042', 'weapon5': '0.108', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'AMMO3': '0.323', 'weapon2': '0.374', 'WEAPON3': '1.850', 'HITCOUNT': '2.960', 'weapon3': '3.194', 'DAMAGECOUNT': '15.282', 'FRAGCOUNT': '49.000'} [2023-02-25 14:16:50,210][36140] DAMAGECOUNT value on done: 903022.0 [2023-02-25 14:16:50,210][36140] Sum rewards: 53.657, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.565', 'AMMO4': '-0.023', 'AMMO2': '-0.004', 'AMMO3': '0.132', 'weapon2': '0.522', 'WEAPON3': '1.050', 'HITCOUNT': '2.820', 'weapon3': '3.410', 'DAMAGECOUNT': '13.815', 'FRAGCOUNT': '42.000'} [2023-02-25 14:16:50,346][36157] DAMAGECOUNT value on done: 916352.0 [2023-02-25 14:16:50,346][36157] Sum rewards: 40.657, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.111', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.053', 'AMMO3': '0.150', 'weapon2': '0.246', 'AMMO4': '0.266', 'weapon5': '0.378', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'weapon4': '0.756', 'WEAPON3': '0.950', 'weapon3': '2.168', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '11.352', 'FRAGCOUNT': '37.000'} [2023-02-25 14:16:50,523][36140] DAMAGECOUNT value on done: 904337.0 [2023-02-25 14:16:50,523][36140] Sum rewards: 63.901, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.232', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.047', 'AMMO3': '0.133', 'AMMO4': '0.233', 'weapon2': '0.310', 'weapon5': '0.372', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.764', 'WEAPON3': '0.800', 'weapon3': '2.236', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.782', 'FRAGCOUNT': '52.000'} [2023-02-25 14:16:50,642][36157] DAMAGECOUNT value on done: 912341.0 [2023-02-25 14:16:50,643][36157] Sum rewards: 63.700, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.190', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.150', 'weapon2': '0.172', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.418', 'WEAPON3': '1.150', 'weapon3': '2.996', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '54.000'} [2023-02-25 14:16:50,714][36138] Updated weights for policy 0, policy_version 49433 (0.0009) [2023-02-25 14:16:51,668][36155] DAMAGECOUNT value on done: 901552.0 [2023-02-25 14:16:51,669][36155] Sum rewards: 58.727, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.632', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO3': '0.150', 'AMMO4': '0.185', 'weapon5': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.330', 'weapon4': '0.796', 'WEAPON3': '0.900', 'weapon3': '2.352', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.613', 'FRAGCOUNT': '48.000'} [2023-02-25 14:16:51,971][36155] DAMAGECOUNT value on done: 912773.0 [2023-02-25 14:16:51,972][36155] Sum rewards: 47.613, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.776', 'AMMO5': '0.003', 'AMMO2': '0.010', 'ARMOR': '0.012', 'weapon5': '0.048', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.215', 'weapon2': '0.258', 'weapon4': '0.262', 'WEAPON3': '1.300', 'HITCOUNT': '2.570', 'weapon3': '3.188', 'DAMAGECOUNT': '12.075', 'FRAGCOUNT': '42.000'} [2023-02-25 14:16:51,999][36142] DAMAGECOUNT value on done: 911301.0 [2023-02-25 14:16:51,999][36142] Sum rewards: 60.598, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.658', 'ARMOR': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'weapon2': '0.342', 'weapon4': '0.376', 'WEAPON3': '1.050', 'HITCOUNT': '2.810', 'weapon3': '2.912', 'DAMAGECOUNT': '14.418', 'FRAGCOUNT': '50.500'} [2023-02-25 14:16:52,294][36142] DAMAGECOUNT value on done: 892879.0 [2023-02-25 14:16:52,295][36142] Sum rewards: 56.366, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.240', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.050', 'AMMO4': '0.066', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.230', 'AMMO3': '0.250', 'weapon4': '0.354', 'WEAPON3': '1.400', 'HITCOUNT': '3.080', 'weapon3': '3.106', 'DAMAGECOUNT': '14.499', 'FRAGCOUNT': '50.000'} [2023-02-25 14:16:52,587][36142] DAMAGECOUNT value on done: 901562.0 [2023-02-25 14:16:52,588][36142] Sum rewards: 60.814, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.220', 'AMMO5': '0.017', 'AMMO2': '0.046', 'AMMO3': '0.163', 'weapon2': '0.200', 'AMMO4': '0.230', 'weapon5': '0.290', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.588', 'WEAPON3': '1.100', 'weapon3': '2.652', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '52.000'} [2023-02-25 14:16:52,892][36142] DAMAGECOUNT value on done: 918583.0 [2023-02-25 14:16:52,892][36142] Sum rewards: 56.035, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.275', 'ARMOR': '0.004', 'AMMO5': '0.026', 'AMMO2': '0.055', 'AMMO3': '0.167', 'weapon2': '0.260', 'weapon4': '0.260', 'AMMO4': '0.276', 'weapon5': '0.278', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '0.950', 'HITCOUNT': '2.890', 'weapon3': '2.910', 'DAMAGECOUNT': '14.883', 'FRAGCOUNT': '49.000'} [2023-02-25 14:16:53,020][36155] DAMAGECOUNT value on done: 919157.0 [2023-02-25 14:16:53,021][36155] Sum rewards: 62.423, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.050', 'AMMO5': '0.003', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.016', 'weapon4': '0.022', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.215', 'weapon2': '0.476', 'WEAPON3': '1.250', 'weapon3': '3.172', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '52.000'} [2023-02-25 14:16:53,339][36155] DAMAGECOUNT value on done: 904898.0 [2023-02-25 14:16:53,339][36155] Sum rewards: 65.927, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.472', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.138', 'AMMO4': '0.146', 'weapon5': '0.202', 'WEAPON5': '0.350', 'weapon2': '0.386', 'WEAPON4': '0.600', 'weapon4': '0.880', 'WEAPON3': '0.900', 'weapon3': '2.236', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.591', 'FRAGCOUNT': '57.000'} [2023-02-25 14:16:53,756][36138] Updated weights for policy 0, policy_version 49443 (0.0009) [2023-02-25 14:16:53,803][36139] DAMAGECOUNT value on done: 910011.0 [2023-02-25 14:16:53,804][36139] Sum rewards: 48.056, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.065', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.164', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON4': '0.350', 'weapon4': '0.762', 'WEAPON3': '1.250', 'weapon3': '2.514', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.065', 'FRAGCOUNT': '44.000'} [2023-02-25 14:16:54,056][36156] DAMAGECOUNT value on done: 912936.0 [2023-02-25 14:16:54,056][36156] Sum rewards: 61.279, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.560', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.102', 'weapon5': '0.164', 'AMMO3': '0.165', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON4': '0.400', 'weapon4': '0.756', 'WEAPON3': '1.000', 'weapon3': '2.442', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.165', 'FRAGCOUNT': '53.000'} [2023-02-25 14:16:54,066][36156] DAMAGECOUNT value on done: 920268.0 [2023-02-25 14:16:54,066][36156] Sum rewards: 57.813, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.191', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.230', 'AMMO3': '0.277', 'weapon2': '0.390', 'WEAPON3': '1.650', 'weapon3': '3.000', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '52.000'} [2023-02-25 14:16:54,112][36139] DAMAGECOUNT value on done: 903533.0 [2023-02-25 14:16:54,113][36139] Sum rewards: 62.859, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.095', 'AMMO2': '0.011', 'AMMO5': '0.012', 'weapon4': '0.016', 'AMMO4': '0.056', 'weapon5': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.241', 'weapon2': '0.284', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.080', 'weapon3': '3.406', 'DAMAGECOUNT': '15.162', 'FRAGCOUNT': '55.000'} [2023-02-25 14:16:54,374][36156] DAMAGECOUNT value on done: 905474.0 [2023-02-25 14:16:54,375][36156] Sum rewards: 65.989, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.142', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO3': '0.143', 'AMMO4': '0.154', 'weapon5': '0.158', 'WEAPON4': '0.200', 'weapon2': '0.544', 'weapon4': '0.588', 'WEAPON3': '0.900', 'weapon3': '2.440', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '52.000'} [2023-02-25 14:16:54,387][36156] DAMAGECOUNT value on done: 909405.0 [2023-02-25 14:16:54,387][36156] Sum rewards: 56.807, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.565', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.132', 'AMMO3': '0.142', 'weapon2': '0.220', 'weapon5': '0.266', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.782', 'WEAPON3': '0.800', 'weapon3': '2.454', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.883', 'FRAGCOUNT': '46.500'} [2023-02-25 14:16:54,535][36139] DAMAGECOUNT value on done: 920510.0 [2023-02-25 14:16:54,536][36139] Sum rewards: 50.842, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.976', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.102', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.208', 'weapon4': '0.790', 'WEAPON3': '1.050', 'weapon3': '2.178', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.774', 'FRAGCOUNT': '42.000'} [2023-02-25 14:16:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13412.7). Total num frames: 202530816. Throughput: 0: 3354.7. Samples: 13123716. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:16:54,730][36114] Avg episode reward: [(0, '56.727')] [2023-02-25 14:16:54,835][36139] DAMAGECOUNT value on done: 916685.0 [2023-02-25 14:16:54,836][36139] Sum rewards: 42.252, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.662', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon4': '0.390', 'weapon2': '0.570', 'WEAPON3': '1.300', 'weapon3': '2.636', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.042', 'FRAGCOUNT': '38.000'} [2023-02-25 14:16:56,731][36138] Updated weights for policy 0, policy_version 49453 (0.0009) [2023-02-25 14:16:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 202596352. Throughput: 0: 3351.8. Samples: 13143850. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:16:59,730][36114] Avg episode reward: [(0, '56.581')] [2023-02-25 14:16:59,789][36138] Updated weights for policy 0, policy_version 49463 (0.0009) [2023-02-25 14:17:02,848][36138] Updated weights for policy 0, policy_version 49473 (0.0009) [2023-02-25 14:17:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 202665984. Throughput: 0: 3353.8. Samples: 13164090. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:17:04,730][36114] Avg episode reward: [(0, '56.581')] [2023-02-25 14:17:05,911][36138] Updated weights for policy 0, policy_version 49483 (0.0009) [2023-02-25 14:17:06,629][36154] DAMAGECOUNT value on done: 916668.0 [2023-02-25 14:17:06,630][36154] Sum rewards: 76.924, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.947', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.114', 'weapon4': '0.124', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.207', 'weapon2': '0.324', 'WEAPON3': '1.250', 'weapon3': '3.136', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.597', 'FRAGCOUNT': '65.000'} [2023-02-25 14:17:06,958][36154] DAMAGECOUNT value on done: 901477.0 [2023-02-25 14:17:06,958][36154] Sum rewards: 60.395, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.616', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon2': '0.144', 'AMMO4': '0.164', 'weapon5': '0.178', 'AMMO3': '0.182', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.716', 'WEAPON3': '1.000', 'weapon3': '2.614', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '14.943', 'FRAGCOUNT': '51.000'} [2023-02-25 14:17:07,157][36154] DAMAGECOUNT value on done: 915897.0 [2023-02-25 14:17:07,157][36154] Sum rewards: 54.256, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.290', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon5': '0.140', 'AMMO3': '0.184', 'AMMO4': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.342', 'WEAPON4': '0.400', 'weapon4': '0.514', 'WEAPON3': '1.100', 'weapon3': '2.762', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.859', 'FRAGCOUNT': '45.000'} [2023-02-25 14:17:07,294][36141] DAMAGECOUNT value on done: 916920.0 [2023-02-25 14:17:07,295][36141] Sum rewards: 47.386, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.052', 'AMMO5': '0.027', 'AMMO2': '0.079', 'AMMO3': '0.147', 'weapon2': '0.240', 'weapon5': '0.324', 'AMMO4': '0.397', 'WEAPON5': '0.650', 'weapon4': '0.678', 'WEAPON4': '0.700', 'WEAPON3': '0.850', 'weapon3': '2.362', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '13.134', 'FRAGCOUNT': '42.000'} [2023-02-25 14:17:07,470][36154] DAMAGECOUNT value on done: 911205.0 [2023-02-25 14:17:07,470][36154] Sum rewards: 64.580, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.031', 'HEALTH': '0.087', 'AMMO4': '0.153', 'weapon5': '0.160', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.330', 'weapon4': '0.336', 'WEAPON3': '0.950', 'weapon3': '2.886', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.685', 'FRAGCOUNT': '54.000'} [2023-02-25 14:17:07,582][36141] DAMAGECOUNT value on done: 908790.0 [2023-02-25 14:17:07,582][36141] Sum rewards: 45.961, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.092', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.102', 'AMMO3': '0.122', 'WEAPON5': '0.150', 'AMMO4': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.308', 'weapon4': '0.512', 'WEAPON3': '0.750', 'HITCOUNT': '2.590', 'weapon3': '2.818', 'DAMAGECOUNT': '11.901', 'FRAGCOUNT': '37.000'} [2023-02-25 14:17:07,591][36141] DAMAGECOUNT value on done: 916116.0 [2023-02-25 14:17:07,592][36141] Sum rewards: 57.649, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.265', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.146', 'AMMO3': '0.148', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.458', 'weapon4': '0.686', 'WEAPON3': '0.900', 'weapon3': '2.356', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.863', 'FRAGCOUNT': '48.000'} [2023-02-25 14:17:07,898][36141] DAMAGECOUNT value on done: 905098.0 [2023-02-25 14:17:07,898][36141] Sum rewards: 45.471, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.600', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon5': '0.178', 'AMMO4': '0.188', 'AMMO3': '0.226', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.422', 'weapon4': '0.428', 'WEAPON3': '1.300', 'HITCOUNT': '2.610', 'weapon3': '2.684', 'DAMAGECOUNT': '12.372', 'FRAGCOUNT': '41.000'} [2023-02-25 14:17:08,991][36138] Updated weights for policy 0, policy_version 49493 (0.0009) [2023-02-25 14:17:09,319][36157] DAMAGECOUNT value on done: 920105.0 [2023-02-25 14:17:09,320][36157] Sum rewards: 57.362, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.722', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon5': '0.218', 'AMMO3': '0.223', 'weapon4': '0.240', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.542', 'WEAPON3': '1.300', 'weapon3': '2.726', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.183', 'FRAGCOUNT': '52.000'} [2023-02-25 14:17:09,628][36157] DAMAGECOUNT value on done: 911332.0 [2023-02-25 14:17:09,628][36157] Sum rewards: 51.148, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.888', 'AMMO5': '0.019', 'AMMO2': '0.051', 'AMMO3': '0.123', 'AMMO4': '0.256', 'weapon5': '0.314', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '0.700', 'weapon4': '0.824', 'weapon2': '0.870', 'weapon3': '1.646', 'HITCOUNT': '2.400', 'DAMAGECOUNT': '13.083', 'FRAGCOUNT': '45.000'} [2023-02-25 14:17:09,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 202731520. Throughput: 0: 3354.9. Samples: 13174092. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:17:09,729][36114] Avg episode reward: [(0, '56.503')] [2023-02-25 14:17:09,918][36140] DAMAGECOUNT value on done: 917032.0 [2023-02-25 14:17:09,919][36140] Sum rewards: 65.902, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.710', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'AMMO3': '0.141', 'AMMO4': '0.171', 'weapon4': '0.174', 'WEAPON4': '0.350', 'weapon5': '0.394', 'weapon2': '0.482', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'weapon3': '2.558', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '53.500'} [2023-02-25 14:17:10,222][36140] DAMAGECOUNT value on done: 898329.0 [2023-02-25 14:17:10,223][36140] Sum rewards: 59.111, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.498', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.242', 'AMMO3': '0.255', 'weapon4': '0.272', 'WEAPON3': '1.550', 'HITCOUNT': '3.010', 'weapon3': '3.088', 'DAMAGECOUNT': '15.576', 'FRAGCOUNT': '52.000'} [2023-02-25 14:17:10,345][36140] DAMAGECOUNT value on done: 907932.0 [2023-02-25 14:17:10,346][36140] Sum rewards: 59.062, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.972', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon4': '0.064', 'AMMO3': '0.225', 'weapon2': '0.496', 'WEAPON3': '1.300', 'HITCOUNT': '3.090', 'weapon3': '3.192', 'DAMAGECOUNT': '14.730', 'FRAGCOUNT': '51.000'} [2023-02-25 14:17:10,375][36157] DAMAGECOUNT value on done: 921197.0 [2023-02-25 14:17:10,376][36157] Sum rewards: 52.477, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.300', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.050', 'AMMO4': '0.091', 'WEAPON5': '0.150', 'weapon4': '0.162', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'weapon2': '0.684', 'WEAPON3': '1.250', 'weapon3': '2.936', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.535', 'FRAGCOUNT': '46.500'} [2023-02-25 14:17:10,654][36140] DAMAGECOUNT value on done: 908910.0 [2023-02-25 14:17:10,654][36140] Sum rewards: 49.414, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.569', 'AMMO2': '0.009', 'AMMO5': '0.012', 'AMMO4': '0.043', 'weapon5': '0.082', 'WEAPON4': '0.100', 'weapon4': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'weapon2': '0.284', 'WEAPON3': '1.450', 'HITCOUNT': '2.730', 'weapon3': '3.314', 'DAMAGECOUNT': '13.719', 'FRAGCOUNT': '44.000'} [2023-02-25 14:17:10,687][36157] DAMAGECOUNT value on done: 917388.0 [2023-02-25 14:17:10,688][36157] Sum rewards: 54.676, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.515', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.204', 'AMMO3': '0.227', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.482', 'weapon4': '0.652', 'WEAPON3': '1.300', 'weapon3': '2.366', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.141', 'FRAGCOUNT': '47.000'} [2023-02-25 14:17:11,523][36155] DAMAGECOUNT value on done: 906331.0 [2023-02-25 14:17:11,523][36155] Sum rewards: 51.057, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.115', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.056', 'weapon5': '0.092', 'AMMO4': '0.161', 'AMMO3': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.650', 'HITCOUNT': '2.860', 'weapon3': '3.192', 'DAMAGECOUNT': '14.337', 'FRAGCOUNT': '48.000'} [2023-02-25 14:17:11,840][36155] DAMAGECOUNT value on done: 917614.0 [2023-02-25 14:17:11,841][36155] Sum rewards: 48.901, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.792', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.051', 'AMMO3': '0.210', 'weapon5': '0.252', 'AMMO4': '0.254', 'weapon2': '0.366', 'weapon4': '0.436', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.596', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.523', 'FRAGCOUNT': '44.000'} [2023-02-25 14:17:11,979][36142] DAMAGECOUNT value on done: 916144.0 [2023-02-25 14:17:11,980][36142] Sum rewards: 57.883, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.580', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.012', 'WEAPON4': '0.100', 'AMMO3': '0.143', 'weapon4': '0.182', 'weapon5': '0.214', 'WEAPON5': '0.350', 'weapon2': '0.636', 'WEAPON3': '1.000', 'weapon3': '2.776', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.529', 'FRAGCOUNT': '48.000'} [2023-02-25 14:17:12,056][36138] Updated weights for policy 0, policy_version 49503 (0.0010) [2023-02-25 14:17:12,285][36142] DAMAGECOUNT value on done: 897874.0 [2023-02-25 14:17:12,285][36142] Sum rewards: 57.833, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-0.667', 'AMMO5': '0.018', 'AMMO2': '0.036', 'AMMO4': '0.178', 'AMMO3': '0.218', 'weapon5': '0.272', 'weapon2': '0.282', 'weapon4': '0.302', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.708', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.985', 'FRAGCOUNT': '53.000'} [2023-02-25 14:17:12,574][36142] DAMAGECOUNT value on done: 906347.0 [2023-02-25 14:17:12,574][36142] Sum rewards: 51.271, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.217', 'AMMO5': '0.028', 'AMMO2': '0.061', 'AMMO3': '0.164', 'weapon5': '0.188', 'AMMO4': '0.305', 'ARMOR': '0.404', 'weapon4': '0.430', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon2': '0.688', 'WEAPON3': '1.000', 'weapon3': '2.376', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.355', 'FRAGCOUNT': '45.000'} [2023-02-25 14:17:12,887][36142] DAMAGECOUNT value on done: 923978.0 [2023-02-25 14:17:12,887][36142] Sum rewards: 60.356, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.052', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon2': '0.164', 'WEAPON4': '0.200', 'weapon5': '0.204', 'weapon4': '0.214', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '2.900', 'weapon3': '3.118', 'DAMAGECOUNT': '15.870', 'FRAGCOUNT': '52.000'} [2023-02-25 14:17:12,908][36155] DAMAGECOUNT value on done: 924126.0 [2023-02-25 14:17:12,909][36155] Sum rewards: 60.723, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.300', 'AMMO5': '0.004', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.024', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.208', 'weapon2': '0.582', 'WEAPON3': '1.300', 'weapon3': '3.188', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.907', 'FRAGCOUNT': '52.000'} [2023-02-25 14:17:13,212][36155] DAMAGECOUNT value on done: 910068.0 [2023-02-25 14:17:13,213][36155] Sum rewards: 59.508, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.486', 'AMMO5': '0.009', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.190', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.380', 'weapon2': '0.412', 'WEAPON3': '1.150', 'weapon3': '2.770', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '50.000'} [2023-02-25 14:17:13,783][36139] DAMAGECOUNT value on done: 914816.0 [2023-02-25 14:17:13,783][36139] Sum rewards: 53.125, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.073', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon5': '0.176', 'AMMO3': '0.244', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON4': '0.400', 'weapon4': '0.442', 'WEAPON3': '1.350', 'weapon3': '2.756', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.995', 'FRAGCOUNT': '50.000'} [2023-02-25 14:17:14,089][36139] DAMAGECOUNT value on done: 909173.0 [2023-02-25 14:17:14,089][36139] Sum rewards: 56.266, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.014', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO4': '0.181', 'weapon5': '0.192', 'AMMO3': '0.256', 'weapon2': '0.256', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.438', 'WEAPON3': '1.500', 'weapon3': '2.770', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '50.000'} [2023-02-25 14:17:14,138][36156] DAMAGECOUNT value on done: 917824.0 [2023-02-25 14:17:14,139][36156] Sum rewards: 55.805, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.886', 'ARMOR': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.055', 'AMMO3': '0.201', 'AMMO4': '0.276', 'weapon2': '0.304', 'weapon5': '0.352', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.790', 'WEAPON3': '1.150', 'weapon3': '2.236', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '14.664', 'FRAGCOUNT': '48.000'} [2023-02-25 14:17:14,149][36156] DAMAGECOUNT value on done: 924958.0 [2023-02-25 14:17:14,150][36156] Sum rewards: 58.115, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.604', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO3': '0.123', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'weapon5': '0.202', 'WEAPON4': '0.250', 'weapon4': '0.458', 'ARMOR': '0.459', 'weapon2': '0.648', 'WEAPON3': '0.750', 'weapon3': '2.518', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.070', 'FRAGCOUNT': '45.000'} [2023-02-25 14:17:14,457][36156] DAMAGECOUNT value on done: 909860.0 [2023-02-25 14:17:14,457][36156] Sum rewards: 52.411, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.742', 'AMMO5': '0.020', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.132', 'weapon5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.228', 'WEAPON5': '0.350', 'weapon2': '0.664', 'WEAPON3': '0.850', 'weapon3': '2.740', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.113', 'FRAGCOUNT': '43.000'} [2023-02-25 14:17:14,469][36156] DAMAGECOUNT value on done: 914898.0 [2023-02-25 14:17:14,470][36156] Sum rewards: 65.872, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.640', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.064', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'weapon4': '0.280', 'weapon2': '0.418', 'WEAPON3': '1.150', 'weapon3': '3.052', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.479', 'FRAGCOUNT': '54.000'} [2023-02-25 14:17:14,553][36139] DAMAGECOUNT value on done: 925961.0 [2023-02-25 14:17:14,554][36139] Sum rewards: 58.080, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.012', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon2': '0.166', 'weapon5': '0.192', 'AMMO3': '0.227', 'weapon4': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.044', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '49.500'} [2023-02-25 14:17:14,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 202797056. Throughput: 0: 3351.6. Samples: 13194136. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:17:14,730][36114] Avg episode reward: [(0, '56.199')] [2023-02-25 14:17:14,853][36139] DAMAGECOUNT value on done: 921749.0 [2023-02-25 14:17:14,854][36139] Sum rewards: 57.262, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.350', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon4': '0.168', 'weapon5': '0.174', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.358', 'WEAPON3': '1.300', 'weapon3': '3.068', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.192', 'FRAGCOUNT': '50.000'} [2023-02-25 14:17:15,088][36138] Updated weights for policy 0, policy_version 49513 (0.0009) [2023-02-25 14:17:18,185][36138] Updated weights for policy 0, policy_version 49523 (0.0009) [2023-02-25 14:17:19,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 202866688. Throughput: 0: 3353.5. Samples: 13214258. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:17:19,730][36114] Avg episode reward: [(0, '56.107')] [2023-02-25 14:17:19,733][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000049528_202866688.pth... [2023-02-25 14:17:19,791][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000048742_199647232.pth [2023-02-25 14:17:21,229][36138] Updated weights for policy 0, policy_version 49533 (0.0009) [2023-02-25 14:17:24,275][36138] Updated weights for policy 0, policy_version 49543 (0.0009) [2023-02-25 14:17:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 202932224. Throughput: 0: 3356.9. Samples: 13224356. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:17:24,730][36114] Avg episode reward: [(0, '56.107')] [2023-02-25 14:17:26,747][36154] DAMAGECOUNT value on done: 921317.0 [2023-02-25 14:17:26,747][36154] Sum rewards: 55.402, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.145', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.133', 'weapon2': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon5': '0.332', 'weapon4': '0.676', 'WEAPON3': '0.950', 'weapon3': '2.516', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.947', 'FRAGCOUNT': '46.000'} [2023-02-25 14:17:27,050][36154] DAMAGECOUNT value on done: 906163.0 [2023-02-25 14:17:27,051][36154] Sum rewards: 56.147, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.641', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.063', 'AMMO3': '0.138', 'weapon5': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.330', 'weapon2': '0.414', 'WEAPON3': '0.900', 'weapon3': '2.816', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.058', 'FRAGCOUNT': '46.000'} [2023-02-25 14:17:27,199][36154] DAMAGECOUNT value on done: 920971.0 [2023-02-25 14:17:27,199][36154] Sum rewards: 52.127, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.625', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.047', 'AMMO3': '0.152', 'AMMO4': '0.233', 'weapon5': '0.284', 'weapon2': '0.320', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.576', 'WEAPON3': '1.000', 'weapon3': '2.506', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.222', 'FRAGCOUNT': '43.000'} [2023-02-25 14:17:27,310][36138] Updated weights for policy 0, policy_version 49553 (0.0009) [2023-02-25 14:17:27,367][36141] DAMAGECOUNT value on done: 922622.0 [2023-02-25 14:17:27,367][36141] Sum rewards: 68.985, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.438', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.118', 'AMMO3': '0.206', 'weapon4': '0.218', 'weapon2': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.172', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '59.000'} [2023-02-25 14:17:27,497][36154] DAMAGECOUNT value on done: 915704.0 [2023-02-25 14:17:27,497][36154] Sum rewards: 54.553, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.514', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.172', 'AMMO3': '0.196', 'WEAPON5': '0.250', 'weapon4': '0.274', 'WEAPON4': '0.300', 'weapon2': '0.584', 'WEAPON3': '1.150', 'weapon3': '2.634', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.497', 'FRAGCOUNT': '49.000'} [2023-02-25 14:17:27,678][36141] DAMAGECOUNT value on done: 920933.0 [2023-02-25 14:17:27,679][36141] Sum rewards: 56.240, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.984', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.038', 'AMMO3': '0.168', 'weapon5': '0.188', 'AMMO4': '0.189', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.480', 'weapon4': '0.506', 'WEAPON3': '1.100', 'weapon3': '2.554', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.451', 'FRAGCOUNT': '49.000'} [2023-02-25 14:17:27,693][36141] DAMAGECOUNT value on done: 913528.0 [2023-02-25 14:17:27,693][36141] Sum rewards: 49.885, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.314', 'AMMO5': '0.017', 'AMMO2': '0.053', 'AMMO3': '0.188', 'weapon2': '0.208', 'AMMO4': '0.266', 'weapon5': '0.270', 'WEAPON5': '0.400', 'WEAPON4': '0.650', 'weapon4': '0.902', 'WEAPON3': '1.100', 'weapon3': '2.250', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.214', 'FRAGCOUNT': '45.000'} [2023-02-25 14:17:27,995][36141] DAMAGECOUNT value on done: 909510.0 [2023-02-25 14:17:27,995][36141] Sum rewards: 48.804, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.064', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.088', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'weapon2': '0.266', 'weapon4': '0.658', 'WEAPON3': '1.400', 'weapon3': '2.658', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.236', 'FRAGCOUNT': '46.000'} [2023-02-25 14:17:29,377][36157] DAMAGECOUNT value on done: 925474.0 [2023-02-25 14:17:29,378][36157] Sum rewards: 61.317, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.852', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.124', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.308', 'weapon4': '0.438', 'WEAPON3': '1.300', 'weapon3': '2.872', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '53.000'} [2023-02-25 14:17:29,690][36157] Large shaping reward 2.562 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.54, 180.0), ('weapon5', 0.002)] [2023-02-25 14:17:29,696][36157] DAMAGECOUNT value on done: 916928.0 [2023-02-25 14:17:29,697][36157] Sum rewards: 59.141, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.320', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.053', 'weapon5': '0.144', 'AMMO3': '0.200', 'AMMO4': '0.266', 'weapon4': '0.312', 'weapon2': '0.372', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.878', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '51.000'} [2023-02-25 14:17:29,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 203001856. Throughput: 0: 3353.5. Samples: 13244428. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:17:29,729][36114] Avg episode reward: [(0, '55.857')] [2023-02-25 14:17:29,982][36140] DAMAGECOUNT value on done: 921742.0 [2023-02-25 14:17:29,983][36140] Sum rewards: 53.918, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.700', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.072', 'weapon5': '0.128', 'AMMO4': '0.130', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.250', 'HITCOUNT': '2.860', 'weapon3': '3.336', 'DAMAGECOUNT': '14.130', 'FRAGCOUNT': '47.000'} [2023-02-25 14:17:30,301][36140] DAMAGECOUNT value on done: 904071.0 [2023-02-25 14:17:30,302][36140] Sum rewards: 58.580, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.495', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.120', 'WEAPON4': '0.200', 'weapon5': '0.236', 'WEAPON5': '0.250', 'AMMO3': '0.277', 'weapon4': '0.338', 'weapon2': '0.360', 'WEAPON3': '1.600', 'weapon3': '2.750', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '52.000'} [2023-02-25 14:17:30,346][36138] Updated weights for policy 0, policy_version 49563 (0.0009) [2023-02-25 14:17:30,433][36157] DAMAGECOUNT value on done: 925391.0 [2023-02-25 14:17:30,434][36157] Sum rewards: 51.621, reward structure: {'DEATHCOUNT': '-10.500', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO3': '0.118', 'weapon5': '0.136', 'AMMO4': '0.147', 'WEAPON4': '0.250', 'HEALTH': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.364', 'weapon4': '0.524', 'WEAPON3': '0.700', 'weapon3': '2.772', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.582', 'FRAGCOUNT': '41.000'} [2023-02-25 14:17:30,444][36140] DAMAGECOUNT value on done: 912947.0 [2023-02-25 14:17:30,444][36140] Sum rewards: 56.486, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.668', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.092', 'AMMO4': '0.144', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.352', 'weapon2': '0.388', 'WEAPON3': '1.200', 'weapon3': '2.950', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '46.000'} [2023-02-25 14:17:30,752][36157] DAMAGECOUNT value on done: 922590.0 [2023-02-25 14:17:30,752][36157] Sum rewards: 62.070, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.084', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO4': '0.181', 'AMMO3': '0.215', 'weapon2': '0.260', 'weapon5': '0.262', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.626', 'WEAPON3': '1.250', 'weapon3': '2.502', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '55.000'} [2023-02-25 14:17:30,768][36140] DAMAGECOUNT value on done: 912952.0 [2023-02-25 14:17:30,768][36140] Sum rewards: 47.174, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.410', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.145', 'WEAPON4': '0.250', 'weapon5': '0.286', 'WEAPON5': '0.300', 'weapon2': '0.390', 'weapon4': '0.644', 'WEAPON3': '0.900', 'weapon3': '2.346', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '12.126', 'FRAGCOUNT': '39.000'} [2023-02-25 14:17:31,519][36155] DAMAGECOUNT value on done: 911388.0 [2023-02-25 14:17:31,520][36155] Sum rewards: 59.314, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.055', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.170', 'AMMO3': '0.184', 'weapon4': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.460', 'WEAPON3': '1.250', 'weapon3': '2.876', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.171', 'FRAGCOUNT': '51.000'} [2023-02-25 14:17:31,824][36155] DAMAGECOUNT value on done: 922897.0 [2023-02-25 14:17:31,824][36155] Sum rewards: 61.167, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.942', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO3': '0.145', 'AMMO4': '0.162', 'weapon5': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.444', 'weapon4': '0.452', 'WEAPON3': '0.850', 'weapon3': '2.546', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.849', 'FRAGCOUNT': '51.000'} [2023-02-25 14:17:32,204][36142] DAMAGECOUNT value on done: 922009.0 [2023-02-25 14:17:32,204][36142] Sum rewards: 68.021, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.952', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon2': '0.146', 'weapon5': '0.196', 'AMMO3': '0.216', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.704', 'WEAPON3': '1.250', 'weapon3': '2.622', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '58.000'} [2023-02-25 14:17:32,509][36142] DAMAGECOUNT value on done: 903410.0 [2023-02-25 14:17:32,510][36142] Sum rewards: 65.893, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.670', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.140', 'weapon2': '0.210', 'AMMO3': '0.230', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.418', 'WEAPON3': '1.450', 'weapon3': '2.926', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '59.000'} [2023-02-25 14:17:32,792][36142] DAMAGECOUNT value on done: 911499.0 [2023-02-25 14:17:32,792][36142] Sum rewards: 55.939, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.470', 'ARMOR': '0.012', 'AMMO5': '0.021', 'AMMO2': '0.056', 'AMMO3': '0.185', 'AMMO4': '0.279', 'weapon5': '0.290', 'weapon2': '0.410', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.620', 'WEAPON3': '1.050', 'weapon3': '2.240', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '15.456', 'FRAGCOUNT': '50.000'} [2023-02-25 14:17:32,914][36155] DAMAGECOUNT value on done: 928745.0 [2023-02-25 14:17:32,915][36155] Sum rewards: 51.083, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.190', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.019', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.238', 'AMMO3': '0.244', 'WEAPON3': '1.500', 'HITCOUNT': '2.800', 'weapon3': '3.550', 'DAMAGECOUNT': '13.857', 'FRAGCOUNT': '46.000'} [2023-02-25 14:17:33,111][36142] DAMAGECOUNT value on done: 928721.0 [2023-02-25 14:17:33,112][36142] Sum rewards: 61.302, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.076', 'WEAPON4': '0.100', 'HEALTH': '0.110', 'AMMO4': '0.114', 'AMMO3': '0.164', 'weapon4': '0.292', 'weapon2': '0.416', 'WEAPON3': '0.950', 'weapon3': '2.972', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.229', 'FRAGCOUNT': '50.000'} [2023-02-25 14:17:33,235][36155] DAMAGECOUNT value on done: 914659.0 [2023-02-25 14:17:33,236][36155] Sum rewards: 50.350, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.569', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.034', 'weapon5': '0.104', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'WEAPON4': '0.400', 'weapon2': '0.436', 'WEAPON3': '0.900', 'weapon4': '1.028', 'weapon3': '2.210', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '13.773', 'FRAGCOUNT': '42.000'} [2023-02-25 14:17:33,427][36138] Updated weights for policy 0, policy_version 49573 (0.0009) [2023-02-25 14:17:33,649][36139] DAMAGECOUNT value on done: 919169.0 [2023-02-25 14:17:33,649][36139] Sum rewards: 53.203, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.708', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.007', 'WEAPON4': '0.050', 'weapon5': '0.050', 'WEAPON5': '0.100', 'weapon4': '0.176', 'AMMO3': '0.221', 'weapon2': '0.466', 'WEAPON3': '1.250', 'HITCOUNT': '2.870', 'weapon3': '3.158', 'DAMAGECOUNT': '13.059', 'FRAGCOUNT': '47.000'} [2023-02-25 14:17:33,956][36139] DAMAGECOUNT value on done: 914971.0 [2023-02-25 14:17:33,956][36139] Sum rewards: 72.626, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.490', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.158', 'WEAPON5': '0.200', 'weapon5': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.494', 'weapon4': '0.520', 'WEAPON3': '1.050', 'weapon3': '2.522', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '59.000'} [2023-02-25 14:17:34,103][36156] DAMAGECOUNT value on done: 922085.0 [2023-02-25 14:17:34,103][36156] Sum rewards: 50.824, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.094', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.116', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon2': '0.252', 'weapon4': '0.652', 'WEAPON3': '1.200', 'weapon3': '2.708', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.783', 'FRAGCOUNT': '44.000'} [2023-02-25 14:17:34,116][36156] DAMAGECOUNT value on done: 930047.0 [2023-02-25 14:17:34,116][36156] Sum rewards: 62.946, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.687', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.029', 'weapon5': '0.092', 'AMMO3': '0.141', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'weapon2': '0.248', 'WEAPON4': '0.250', 'weapon4': '0.868', 'WEAPON3': '0.900', 'weapon3': '2.528', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.267', 'FRAGCOUNT': '51.000'} [2023-02-25 14:17:34,413][36156] DAMAGECOUNT value on done: 914386.0 [2023-02-25 14:17:34,413][36156] Sum rewards: 52.459, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.272', 'AMMO5': '0.011', 'AMMO2': '0.033', 'AMMO4': '0.166', 'AMMO3': '0.176', 'weapon5': '0.204', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.536', 'weapon2': '0.570', 'WEAPON3': '1.050', 'weapon3': '2.476', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.578', 'FRAGCOUNT': '45.000'} [2023-02-25 14:17:34,424][36156] DAMAGECOUNT value on done: 919286.0 [2023-02-25 14:17:34,424][36156] Sum rewards: 50.963, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.679', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO4': '0.137', 'AMMO3': '0.163', 'weapon5': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'weapon4': '0.418', 'weapon2': '0.514', 'WEAPON3': '0.950', 'weapon3': '2.460', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '12.984', 'FRAGCOUNT': '43.000'} [2023-02-25 14:17:34,449][36139] DAMAGECOUNT value on done: 931225.0 [2023-02-25 14:17:34,450][36139] Sum rewards: 54.746, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.015', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.050', 'AMMO3': '0.191', 'weapon2': '0.202', 'AMMO4': '0.248', 'weapon5': '0.370', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.684', 'WEAPON3': '1.100', 'weapon3': '2.398', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.792', 'FRAGCOUNT': '48.000'} [2023-02-25 14:17:34,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 203067392. Throughput: 0: 3355.4. Samples: 13264598. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:17:34,730][36114] Avg episode reward: [(0, '56.743')] [2023-02-25 14:17:34,763][36139] DAMAGECOUNT value on done: 926178.0 [2023-02-25 14:17:34,764][36139] Sum rewards: 48.886, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.820', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon5': '0.116', 'AMMO4': '0.154', 'AMMO3': '0.252', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON4': '0.400', 'weapon4': '0.526', 'WEAPON3': '1.450', 'HITCOUNT': '2.610', 'weapon3': '2.738', 'DAMAGECOUNT': '13.287', 'FRAGCOUNT': '46.000'} [2023-02-25 14:17:36,445][36138] Updated weights for policy 0, policy_version 49583 (0.0009) [2023-02-25 14:17:36,865][36156] Large shaping reward 2.553 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.531, 177.0), ('weapon5', 0.002)] [2023-02-25 14:17:39,513][36138] Updated weights for policy 0, policy_version 49593 (0.0010) [2023-02-25 14:17:39,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 203132928. Throughput: 0: 3356.0. Samples: 13274734. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:17:39,729][36114] Avg episode reward: [(0, '56.759')] [2023-02-25 14:17:42,566][36138] Updated weights for policy 0, policy_version 49603 (0.0010) [2023-02-25 14:17:44,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 203202560. Throughput: 0: 3356.7. Samples: 13294900. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:17:44,730][36114] Avg episode reward: [(0, '56.759')] [2023-02-25 14:17:45,553][36138] Updated weights for policy 0, policy_version 49613 (0.0009) [2023-02-25 14:17:46,547][36154] DAMAGECOUNT value on done: 926561.0 [2023-02-25 14:17:46,548][36154] Sum rewards: 57.713, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.138', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon4': '0.332', 'weapon2': '0.370', 'WEAPON3': '1.300', 'weapon3': '2.940', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '51.000'} [2023-02-25 14:17:46,864][36154] DAMAGECOUNT value on done: 911386.0 [2023-02-25 14:17:46,864][36154] Sum rewards: 61.545, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.000', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.070', 'AMMO4': '0.138', 'AMMO3': '0.182', 'weapon5': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.644', 'WEAPON3': '1.100', 'weapon3': '2.846', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '15.669', 'FRAGCOUNT': '52.000'} [2023-02-25 14:17:47,027][36154] DAMAGECOUNT value on done: 926269.0 [2023-02-25 14:17:47,028][36154] Sum rewards: 60.486, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.005', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.112', 'weapon2': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'weapon4': '0.314', 'WEAPON3': '1.500', 'HITCOUNT': '3.080', 'weapon3': '3.120', 'DAMAGECOUNT': '15.894', 'FRAGCOUNT': '54.000'} [2023-02-25 14:17:47,340][36154] DAMAGECOUNT value on done: 920659.0 [2023-02-25 14:17:47,341][36154] Sum rewards: 56.321, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.219', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.136', 'AMMO3': '0.182', 'weapon5': '0.316', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.506', 'weapon2': '0.548', 'WEAPON3': '1.150', 'weapon3': '2.362', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.820', 'FRAGCOUNT': '49.000'} [2023-02-25 14:17:47,341][36141] DAMAGECOUNT value on done: 927446.0 [2023-02-25 14:17:47,342][36141] Sum rewards: 49.665, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.344', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon4': '0.112', 'weapon5': '0.156', 'AMMO3': '0.211', 'AMMO4': '0.266', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.620', 'WEAPON3': '1.250', 'weapon3': '2.804', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.472', 'FRAGCOUNT': '44.000'} [2023-02-25 14:17:47,660][36141] DAMAGECOUNT value on done: 925940.0 [2023-02-25 14:17:47,661][36141] Sum rewards: 60.382, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.475', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.062', 'weapon2': '0.176', 'AMMO3': '0.302', 'WEAPON3': '1.750', 'HITCOUNT': '3.110', 'weapon3': '3.536', 'DAMAGECOUNT': '15.021', 'FRAGCOUNT': '56.000'} [2023-02-25 14:17:47,671][36141] DAMAGECOUNT value on done: 919065.0 [2023-02-25 14:17:47,672][36141] Sum rewards: 62.986, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.076', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.054', 'AMMO4': '0.068', 'weapon5': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.234', 'AMMO3': '0.262', 'WEAPON3': '1.600', 'HITCOUNT': '3.410', 'weapon3': '3.428', 'DAMAGECOUNT': '16.611', 'FRAGCOUNT': '55.000'} [2023-02-25 14:17:47,983][36141] DAMAGECOUNT value on done: 914308.0 [2023-02-25 14:17:47,983][36141] Sum rewards: 61.119, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.535', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon5': '0.022', 'weapon4': '0.050', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon2': '0.418', 'WEAPON3': '1.250', 'HITCOUNT': '3.160', 'weapon3': '3.252', 'DAMAGECOUNT': '14.394', 'FRAGCOUNT': '53.000'} [2023-02-25 14:17:48,632][36138] Updated weights for policy 0, policy_version 49623 (0.0009) [2023-02-25 14:17:49,399][36157] DAMAGECOUNT value on done: 930352.0 [2023-02-25 14:17:49,400][36157] Sum rewards: 49.888, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.132', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.040', 'AMMO4': '0.199', 'AMMO3': '0.218', 'weapon5': '0.228', 'weapon2': '0.230', 'weapon4': '0.302', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.942', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.634', 'FRAGCOUNT': '45.000'} [2023-02-25 14:17:49,709][36157] DAMAGECOUNT value on done: 921959.0 [2023-02-25 14:17:49,709][36157] Sum rewards: 56.036, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.235', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon4': '0.046', 'AMMO4': '0.075', 'weapon2': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.272', 'weapon5': '0.338', 'WEAPON3': '1.650', 'HITCOUNT': '2.840', 'weapon3': '3.196', 'DAMAGECOUNT': '15.093', 'FRAGCOUNT': '51.000'} [2023-02-25 14:17:49,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 203268096. Throughput: 0: 3354.7. Samples: 13315050. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:17:49,730][36114] Avg episode reward: [(0, '56.810')] [2023-02-25 14:17:50,134][36140] DAMAGECOUNT value on done: 927573.0 [2023-02-25 14:17:50,135][36140] Sum rewards: 68.231, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.186', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.054', 'weapon5': '0.134', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.156', 'AMMO3': '0.197', 'WEAPON3': '1.250', 'HITCOUNT': '3.370', 'weapon3': '3.530', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '56.500'} [2023-02-25 14:17:50,440][36140] DAMAGECOUNT value on done: 909061.0 [2023-02-25 14:17:50,441][36140] Sum rewards: 58.459, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.986', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.046', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'AMMO3': '0.259', 'weapon2': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '2.910', 'weapon3': '3.280', 'DAMAGECOUNT': '14.970', 'FRAGCOUNT': '54.000'} [2023-02-25 14:17:50,447][36157] DAMAGECOUNT value on done: 930237.0 [2023-02-25 14:17:50,448][36157] Sum rewards: 48.635, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.490', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO3': '0.184', 'AMMO4': '0.224', 'weapon2': '0.338', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon5': '0.518', 'weapon4': '0.754', 'WEAPON3': '1.100', 'weapon3': '2.018', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.538', 'FRAGCOUNT': '42.500'} [2023-02-25 14:17:50,545][36140] DAMAGECOUNT value on done: 918435.0 [2023-02-25 14:17:50,545][36140] Sum rewards: 64.977, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.361', 'AMMO5': '0.015', 'AMMO2': '0.021', 'weapon5': '0.102', 'AMMO4': '0.104', 'AMMO3': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.376', 'weapon4': '0.514', 'WEAPON3': '1.100', 'weapon3': '2.728', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '53.000'} [2023-02-25 14:17:50,753][36157] DAMAGECOUNT value on done: 926767.0 [2023-02-25 14:17:50,754][36157] Sum rewards: 48.084, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.210', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.048', 'AMMO3': '0.114', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO4': '0.238', 'WEAPON4': '0.450', 'weapon2': '0.612', 'WEAPON3': '0.700', 'weapon4': '0.904', 'weapon3': '2.150', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '12.531', 'FRAGCOUNT': '40.000'} [2023-02-25 14:17:50,853][36140] DAMAGECOUNT value on done: 917849.0 [2023-02-25 14:17:50,853][36140] Sum rewards: 57.755, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.173', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.041', 'weapon5': '0.176', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon2': '0.306', 'WEAPON5': '0.350', 'weapon4': '0.354', 'WEAPON3': '1.200', 'weapon3': '2.908', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.646', 'FRAGCOUNT': '49.000'} [2023-02-25 14:17:51,172][36142] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-25 14:17:51,412][36155] DAMAGECOUNT value on done: 916641.0 [2023-02-25 14:17:51,413][36155] Sum rewards: 59.157, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.466', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon2': '0.180', 'AMMO3': '0.247', 'WEAPON5': '0.250', 'weapon5': '0.256', 'WEAPON4': '0.300', 'weapon4': '0.532', 'WEAPON3': '1.400', 'weapon3': '2.716', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '53.000'} [2023-02-25 14:17:51,665][36138] Updated weights for policy 0, policy_version 49633 (0.0009) [2023-02-25 14:17:51,726][36155] DAMAGECOUNT value on done: 927327.0 [2023-02-25 14:17:51,726][36155] Sum rewards: 48.022, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.750', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.132', 'AMMO4': '0.217', 'weapon2': '0.238', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.370', 'WEAPON3': '1.600', 'HITCOUNT': '2.570', 'weapon3': '2.944', 'DAMAGECOUNT': '13.290', 'FRAGCOUNT': '46.000'} [2023-02-25 14:17:52,235][36142] DAMAGECOUNT value on done: 925587.0 [2023-02-25 14:17:52,236][36142] Sum rewards: 34.807, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.970', 'AMMO5': '0.017', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon4': '0.130', 'AMMO3': '0.206', 'weapon5': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.398', 'WEAPON3': '1.300', 'HITCOUNT': '2.090', 'weapon3': '2.940', 'DAMAGECOUNT': '10.734', 'FRAGCOUNT': '33.000'} [2023-02-25 14:17:52,553][36142] DAMAGECOUNT value on done: 908656.0 [2023-02-25 14:17:52,554][36142] Sum rewards: 57.178, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.425', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.070', 'AMMO4': '0.162', 'weapon2': '0.230', 'WEAPON5': '0.250', 'weapon4': '0.258', 'AMMO3': '0.289', 'WEAPON4': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.132', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '53.500'} [2023-02-25 14:17:52,776][36155] DAMAGECOUNT value on done: 933520.0 [2023-02-25 14:17:52,777][36155] Sum rewards: 57.169, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.018', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.158', 'AMMO4': '0.172', 'weapon5': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.360', 'weapon4': '0.508', 'WEAPON3': '1.000', 'weapon3': '2.594', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.325', 'FRAGCOUNT': '48.000'} [2023-02-25 14:17:52,870][36142] DAMAGECOUNT value on done: 916430.0 [2023-02-25 14:17:52,871][36142] Sum rewards: 55.167, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.820', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'weapon5': '0.056', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon4': '0.334', 'weapon2': '0.336', 'WEAPON3': '1.150', 'weapon3': '3.082', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.793', 'FRAGCOUNT': '44.500'} [2023-02-25 14:17:53,066][36155] DAMAGECOUNT value on done: 919434.0 [2023-02-25 14:17:53,067][36155] Sum rewards: 55.228, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.452', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.050', 'AMMO3': '0.136', 'weapon5': '0.184', 'AMMO4': '0.251', 'WEAPON5': '0.450', 'weapon2': '0.464', 'WEAPON4': '0.600', 'weapon4': '0.774', 'WEAPON3': '0.850', 'weapon3': '2.242', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '14.325', 'FRAGCOUNT': '48.000'} [2023-02-25 14:17:53,181][36142] DAMAGECOUNT value on done: 933161.0 [2023-02-25 14:17:53,182][36142] Sum rewards: 55.409, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.317', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.124', 'AMMO4': '0.156', 'AMMO3': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.414', 'weapon4': '0.712', 'WEAPON3': '1.100', 'weapon3': '2.492', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.293', 'FRAGCOUNT': '50.000'} [2023-02-25 14:17:53,489][36139] DAMAGECOUNT value on done: 923613.0 [2023-02-25 14:17:53,489][36139] Sum rewards: 52.411, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.218', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO3': '0.150', 'AMMO4': '0.180', 'weapon2': '0.196', 'weapon5': '0.212', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.814', 'WEAPON3': '0.850', 'weapon3': '2.554', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '13.332', 'FRAGCOUNT': '43.000'} [2023-02-25 14:17:53,797][36139] DAMAGECOUNT value on done: 919722.0 [2023-02-25 14:17:53,798][36139] Sum rewards: 50.060, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.248', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.073', 'AMMO3': '0.127', 'weapon2': '0.228', 'weapon5': '0.338', 'AMMO4': '0.367', 'WEAPON5': '0.450', 'WEAPON4': '0.750', 'WEAPON3': '0.750', 'weapon4': '1.260', 'weapon3': '1.788', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.253', 'FRAGCOUNT': '43.000'} [2023-02-25 14:17:54,135][36156] DAMAGECOUNT value on done: 925864.0 [2023-02-25 14:17:54,135][36156] Sum rewards: 37.463, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.440', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.109', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.124', 'WEAPON7': '0.200', 'weapon5': '0.202', 'AMMO3': '0.207', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.658', 'weapon4': '0.958', 'WEAPON3': '1.150', 'weapon3': '1.730', 'HITCOUNT': '2.400', 'DAMAGECOUNT': '11.337', 'FRAGCOUNT': '35.000'} [2023-02-25 14:17:54,146][36156] DAMAGECOUNT value on done: 934567.0 [2023-02-25 14:17:54,146][36156] Sum rewards: 59.132, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.955', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.208', 'weapon2': '0.390', 'weapon4': '0.580', 'WEAPON3': '1.200', 'weapon3': '2.822', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '13.560', 'FRAGCOUNT': '51.000'} [2023-02-25 14:17:54,250][36139] DAMAGECOUNT value on done: 936516.0 [2023-02-25 14:17:54,250][36139] Sum rewards: 62.030, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.396', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon2': '0.176', 'weapon5': '0.194', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.480', 'WEAPON3': '1.400', 'weapon3': '2.906', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.873', 'FRAGCOUNT': '55.000'} [2023-02-25 14:17:54,458][36156] DAMAGECOUNT value on done: 918148.0 [2023-02-25 14:17:54,458][36156] Sum rewards: 35.149, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.532', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.136', 'WEAPON5': '0.150', 'AMMO4': '0.217', 'AMMO3': '0.220', 'weapon2': '0.374', 'WEAPON4': '0.400', 'weapon4': '0.532', 'WEAPON3': '1.300', 'HITCOUNT': '2.200', 'weapon3': '2.584', 'DAMAGECOUNT': '11.256', 'FRAGCOUNT': '34.000'} [2023-02-25 14:17:54,469][36156] DAMAGECOUNT value on done: 924573.0 [2023-02-25 14:17:54,469][36156] Sum rewards: 53.257, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.829', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO4': '0.180', 'AMMO3': '0.250', 'weapon2': '0.266', 'weapon5': '0.278', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.754', 'WEAPON3': '1.500', 'weapon3': '2.356', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '48.000'} [2023-02-25 14:17:54,551][36139] DAMAGECOUNT value on done: 930520.0 [2023-02-25 14:17:54,551][36139] Sum rewards: 44.709, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.819', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon5': '0.052', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'weapon2': '0.232', 'WEAPON4': '0.300', 'weapon4': '0.612', 'WEAPON3': '1.300', 'HITCOUNT': '2.360', 'weapon3': '2.868', 'DAMAGECOUNT': '13.026', 'FRAGCOUNT': '41.000'} [2023-02-25 14:17:54,663][36138] Updated weights for policy 0, policy_version 49643 (0.0009) [2023-02-25 14:17:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 203337728. Throughput: 0: 3357.4. Samples: 13325174. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:17:54,730][36114] Avg episode reward: [(0, '55.729')] [2023-02-25 14:17:57,707][36138] Updated weights for policy 0, policy_version 49653 (0.0009) [2023-02-25 14:17:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 203403264. Throughput: 0: 3362.5. Samples: 13345450. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:17:59,730][36114] Avg episode reward: [(0, '55.729')] [2023-02-25 14:18:00,801][36138] Updated weights for policy 0, policy_version 49663 (0.0010) [2023-02-25 14:18:02,782][36154] Large shaping reward -2.535 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0)] [2023-02-25 14:18:03,890][36138] Updated weights for policy 0, policy_version 49673 (0.0009) [2023-02-25 14:18:04,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 203468800. Throughput: 0: 3362.1. Samples: 13365554. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:18:04,730][36114] Avg episode reward: [(0, '55.729')] [2023-02-25 14:18:06,541][36154] DAMAGECOUNT value on done: 932035.0 [2023-02-25 14:18:06,542][36154] Sum rewards: 61.529, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.832', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon5': '0.170', 'weapon2': '0.188', 'AMMO3': '0.206', 'AMMO4': '0.206', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.456', 'WEAPON3': '1.200', 'weapon3': '2.902', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.422', 'FRAGCOUNT': '53.500'} [2023-02-25 14:18:06,667][36142] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:18:06,839][36154] DAMAGECOUNT value on done: 916642.0 [2023-02-25 14:18:06,840][36154] Sum rewards: 56.966, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.100', 'AMMO5': '0.014', 'AMMO2': '0.021', 'weapon4': '0.036', 'AMMO4': '0.104', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon2': '0.288', 'weapon5': '0.294', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'HITCOUNT': '2.860', 'weapon3': '3.144', 'DAMAGECOUNT': '15.768', 'FRAGCOUNT': '46.500'} [2023-02-25 14:18:06,883][36155] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:18:06,945][36138] Updated weights for policy 0, policy_version 49683 (0.0009) [2023-02-25 14:18:07,038][36154] DAMAGECOUNT value on done: 932125.0 [2023-02-25 14:18:07,038][36154] Sum rewards: 66.395, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.390', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.204', 'weapon5': '0.224', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.376', 'WEAPON3': '1.200', 'weapon3': '2.794', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '56.000'} [2023-02-25 14:18:07,333][36141] DAMAGECOUNT value on done: 931737.0 [2023-02-25 14:18:07,333][36141] Sum rewards: 47.634, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.626', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.136', 'AMMO4': '0.149', 'AMMO3': '0.180', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON4': '0.400', 'weapon4': '0.414', 'WEAPON3': '1.050', 'HITCOUNT': '2.530', 'weapon3': '2.754', 'DAMAGECOUNT': '12.873', 'FRAGCOUNT': '41.000'} [2023-02-25 14:18:07,339][36154] DAMAGECOUNT value on done: 925226.0 [2023-02-25 14:18:07,340][36154] Sum rewards: 51.260, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.619', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.050', 'AMMO3': '0.108', 'AMMO4': '0.250', 'weapon5': '0.256', 'weapon2': '0.440', 'WEAPON5': '0.500', 'WEAPON3': '0.600', 'WEAPON4': '0.650', 'weapon4': '0.926', 'weapon3': '2.082', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.701', 'FRAGCOUNT': '42.000'} [2023-02-25 14:18:07,627][36141] DAMAGECOUNT value on done: 923902.0 [2023-02-25 14:18:07,628][36141] Sum rewards: 60.851, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.165', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon4': '0.048', 'weapon5': '0.176', 'AMMO3': '0.202', 'AMMO4': '0.221', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '2.960', 'weapon3': '3.256', 'DAMAGECOUNT': '14.511', 'FRAGCOUNT': '53.000'} [2023-02-25 14:18:07,656][36141] DAMAGECOUNT value on done: 930968.0 [2023-02-25 14:18:07,656][36141] Sum rewards: 57.753, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.357', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon7': '0.104', 'AMMO3': '0.160', 'weapon5': '0.220', 'AMMO4': '0.248', 'weapon2': '0.270', 'weapon4': '0.316', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.644', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '15.084', 'FRAGCOUNT': '51.000'} [2023-02-25 14:18:07,968][36141] DAMAGECOUNT value on done: 919283.0 [2023-02-25 14:18:07,969][36141] Sum rewards: 54.775, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.466', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.039', 'AMMO3': '0.174', 'AMMO4': '0.196', 'weapon2': '0.224', 'weapon5': '0.336', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.434', 'WEAPON3': '1.150', 'weapon3': '2.540', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.925', 'FRAGCOUNT': '47.000'} [2023-02-25 14:18:09,285][36157] DAMAGECOUNT value on done: 935456.0 [2023-02-25 14:18:09,286][36157] Sum rewards: 64.407, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.546', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.048', 'AMMO3': '0.148', 'AMMO4': '0.242', 'weapon2': '0.270', 'weapon5': '0.296', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.578', 'WEAPON3': '0.900', 'weapon3': '2.508', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '55.000'} [2023-02-25 14:18:09,590][36157] DAMAGECOUNT value on done: 926923.0 [2023-02-25 14:18:09,591][36157] Sum rewards: 60.012, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.720', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.136', 'WEAPON4': '0.250', 'weapon5': '0.270', 'WEAPON5': '0.350', 'weapon4': '0.356', 'weapon2': '0.528', 'WEAPON3': '0.900', 'weapon3': '2.570', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.892', 'FRAGCOUNT': '48.000'} [2023-02-25 14:18:09,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 203538432. Throughput: 0: 3361.7. Samples: 13375634. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:18:09,729][36114] Avg episode reward: [(0, '55.891')] [2023-02-25 14:18:09,989][36138] Updated weights for policy 0, policy_version 49693 (0.0009) [2023-02-25 14:18:10,138][36140] DAMAGECOUNT value on done: 932120.0 [2023-02-25 14:18:10,139][36140] Sum rewards: 48.482, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.219', 'AMMO5': '0.011', 'weapon5': '0.034', 'AMMO2': '0.044', 'weapon4': '0.158', 'AMMO4': '0.221', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'weapon2': '0.436', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.740', 'weapon3': '3.120', 'DAMAGECOUNT': '13.641', 'FRAGCOUNT': '46.000'} [2023-02-25 14:18:10,409][36157] DAMAGECOUNT value on done: 935256.0 [2023-02-25 14:18:10,410][36157] Sum rewards: 55.293, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.350', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon2': '0.328', 'weapon4': '0.840', 'WEAPON3': '1.150', 'weapon3': '2.548', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.742', 'FRAGCOUNT': '47.000'} [2023-02-25 14:18:10,451][36140] DAMAGECOUNT value on done: 914204.0 [2023-02-25 14:18:10,452][36140] Sum rewards: 64.910, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'HEALTH': '0.098', 'weapon4': '0.124', 'AMMO3': '0.188', 'weapon2': '0.242', 'WEAPON3': '1.050', 'HITCOUNT': '3.190', 'weapon3': '3.404', 'DAMAGECOUNT': '15.429', 'FRAGCOUNT': '53.000'} [2023-02-25 14:18:10,560][36140] DAMAGECOUNT value on done: 924499.0 [2023-02-25 14:18:10,561][36140] Sum rewards: 70.434, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.758', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO3': '0.172', 'AMMO4': '0.180', 'weapon2': '0.234', 'WEAPON5': '0.350', 'weapon5': '0.362', 'WEAPON4': '0.500', 'weapon4': '0.680', 'WEAPON3': '1.050', 'weapon3': '2.394', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '59.000'} [2023-02-25 14:18:10,719][36157] DAMAGECOUNT value on done: 931501.0 [2023-02-25 14:18:10,719][36157] Sum rewards: 51.498, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.759', 'AMMO5': '0.015', 'AMMO2': '0.046', 'AMMO3': '0.150', 'AMMO4': '0.232', 'weapon2': '0.268', 'weapon5': '0.436', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.914', 'WEAPON3': '0.950', 'weapon3': '2.074', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '14.202', 'FRAGCOUNT': '43.000'} [2023-02-25 14:18:10,865][36140] DAMAGECOUNT value on done: 922993.0 [2023-02-25 14:18:10,866][36140] Sum rewards: 52.629, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.874', 'AMMO5': '0.021', 'AMMO2': '0.076', 'AMMO3': '0.129', 'weapon2': '0.324', 'AMMO4': '0.379', 'weapon5': '0.422', 'WEAPON5': '0.550', 'WEAPON4': '0.750', 'WEAPON3': '0.800', 'weapon4': '1.048', 'weapon3': '1.592', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.432', 'FRAGCOUNT': '45.000'} [2023-02-25 14:18:11,550][36155] DAMAGECOUNT value on done: 921499.0 [2023-02-25 14:18:11,551][36155] Sum rewards: 61.069, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.210', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.271', 'weapon4': '0.374', 'weapon2': '0.382', 'WEAPON3': '1.550', 'weapon3': '2.844', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.574', 'FRAGCOUNT': '56.000'} [2023-02-25 14:18:11,843][36155] DAMAGECOUNT value on done: 932863.0 [2023-02-25 14:18:11,844][36155] Sum rewards: 61.157, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.095', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'weapon4': '0.182', 'WEAPON4': '0.250', 'AMMO3': '0.285', 'weapon2': '0.352', 'WEAPON3': '1.700', 'weapon3': '3.146', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '56.000'} [2023-02-25 14:18:12,389][36142] DAMAGECOUNT value on done: 930856.0 [2023-02-25 14:18:12,389][36142] Sum rewards: 63.491, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.898', 'AMMO5': '0.004', 'AMMO2': '0.024', 'weapon5': '0.026', 'WEAPON5': '0.100', 'weapon4': '0.118', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'weapon2': '0.242', 'AMMO3': '0.245', 'WEAPON3': '1.450', 'HITCOUNT': '3.200', 'weapon3': '3.402', 'DAMAGECOUNT': '15.807', 'FRAGCOUNT': '55.500'} [2023-02-25 14:18:12,695][36142] DAMAGECOUNT value on done: 913351.0 [2023-02-25 14:18:12,695][36142] Sum rewards: 52.459, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.780', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.065', 'WEAPON5': '0.150', 'weapon5': '0.164', 'weapon2': '0.194', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'weapon4': '0.580', 'WEAPON3': '1.350', 'weapon3': '2.818', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.085', 'FRAGCOUNT': '47.000'} [2023-02-25 14:18:12,833][36155] DAMAGECOUNT value on done: 939009.0 [2023-02-25 14:18:12,834][36155] Sum rewards: 70.889, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.550', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.038', 'WEAPON5': '0.050', 'weapon4': '0.054', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'weapon2': '0.200', 'AMMO3': '0.233', 'WEAPON3': '1.400', 'HITCOUNT': '3.270', 'weapon3': '3.532', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '62.000'} [2023-02-25 14:18:13,009][36142] DAMAGECOUNT value on done: 921869.0 [2023-02-25 14:18:13,009][36142] Sum rewards: 64.002, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.854', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.070', 'weapon5': '0.110', 'AMMO3': '0.168', 'weapon2': '0.218', 'WEAPON5': '0.300', 'AMMO4': '0.348', 'WEAPON4': '0.550', 'weapon4': '0.710', 'WEAPON3': '1.000', 'weapon3': '2.720', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '54.000'} [2023-02-25 14:18:13,052][36138] Updated weights for policy 0, policy_version 49703 (0.0009) [2023-02-25 14:18:13,142][36155] DAMAGECOUNT value on done: 924331.0 [2023-02-25 14:18:13,142][36155] Sum rewards: 62.200, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.003', 'AMMO5': '0.015', 'AMMO2': '0.022', 'AMMO4': '0.109', 'AMMO3': '0.230', 'weapon2': '0.318', 'weapon5': '0.336', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.458', 'WEAPON3': '1.400', 'weapon3': '2.534', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.691', 'FRAGCOUNT': '57.000'} [2023-02-25 14:18:13,327][36139] DAMAGECOUNT value on done: 927808.0 [2023-02-25 14:18:13,328][36139] Sum rewards: 46.195, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.040', 'AMMO5': '0.013', 'AMMO2': '0.021', 'weapon5': '0.052', 'AMMO4': '0.103', 'weapon2': '0.152', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.320', 'WEAPON3': '1.350', 'HITCOUNT': '2.430', 'weapon3': '3.228', 'DAMAGECOUNT': '12.585', 'FRAGCOUNT': '43.000'} [2023-02-25 14:18:13,332][36142] DAMAGECOUNT value on done: 938847.0 [2023-02-25 14:18:13,332][36142] Sum rewards: 63.349, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.362', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.035', 'weapon5': '0.140', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.252', 'weapon2': '0.270', 'WEAPON4': '0.300', 'weapon4': '0.552', 'WEAPON3': '1.400', 'weapon3': '2.762', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '56.000'} [2023-02-25 14:18:13,635][36139] DAMAGECOUNT value on done: 924672.0 [2023-02-25 14:18:13,635][36139] Sum rewards: 56.252, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.232', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon5': '0.156', 'AMMO4': '0.157', 'AMMO3': '0.246', 'WEAPON4': '0.300', 'weapon2': '0.342', 'WEAPON5': '0.350', 'weapon4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.676', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.850', 'FRAGCOUNT': '51.000'} [2023-02-25 14:18:14,143][36156] DAMAGECOUNT value on done: 930809.0 [2023-02-25 14:18:14,144][36156] Sum rewards: 55.295, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.314', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.117', 'WEAPON4': '0.200', 'weapon2': '0.230', 'AMMO3': '0.231', 'weapon4': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.020', 'weapon3': '3.150', 'DAMAGECOUNT': '14.835', 'FRAGCOUNT': '48.000'} [2023-02-25 14:18:14,155][36156] DAMAGECOUNT value on done: 939119.0 [2023-02-25 14:18:14,155][36156] Sum rewards: 48.987, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.225', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.168', 'weapon5': '0.188', 'weapon2': '0.192', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.814', 'WEAPON3': '1.000', 'weapon3': '2.546', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.656', 'FRAGCOUNT': '41.500'} [2023-02-25 14:18:14,228][36139] DAMAGECOUNT value on done: 940647.0 [2023-02-25 14:18:14,229][36139] Sum rewards: 49.882, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.202', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.057', 'AMMO3': '0.138', 'weapon5': '0.188', 'AMMO4': '0.287', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON4': '0.450', 'WEAPON3': '0.850', 'weapon4': '1.520', 'weapon3': '1.834', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '12.393', 'FRAGCOUNT': '42.000'} [2023-02-25 14:18:14,465][36156] DAMAGECOUNT value on done: 921947.0 [2023-02-25 14:18:14,466][36156] Sum rewards: 40.598, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.382', 'AMMO5': '0.020', 'AMMO2': '0.065', 'AMMO3': '0.169', 'AMMO4': '0.323', 'weapon5': '0.326', 'weapon2': '0.394', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'weapon4': '0.772', 'WEAPON3': '0.900', 'weapon3': '1.984', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '11.397', 'FRAGCOUNT': '37.000'} [2023-02-25 14:18:14,476][36156] DAMAGECOUNT value on done: 929502.0 [2023-02-25 14:18:14,476][36156] Sum rewards: 54.943, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.893', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO3': '0.183', 'AMMO4': '0.204', 'weapon2': '0.308', 'weapon5': '0.324', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.596', 'WEAPON3': '1.050', 'weapon3': '2.456', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '14.787', 'FRAGCOUNT': '46.000'} [2023-02-25 14:18:14,547][36139] DAMAGECOUNT value on done: 934763.0 [2023-02-25 14:18:14,548][36139] Sum rewards: 34.382, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.218', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.162', 'AMMO4': '0.203', 'AMMO3': '0.264', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON4': '0.500', 'weapon4': '0.602', 'WEAPON3': '1.450', 'weapon3': '2.594', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.729', 'FRAGCOUNT': '35.000'} [2023-02-25 14:18:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 203603968. Throughput: 0: 3360.9. Samples: 13395670. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:18:14,729][36114] Avg episode reward: [(0, '55.944')] [2023-02-25 14:18:16,088][36138] Updated weights for policy 0, policy_version 49713 (0.0009) [2023-02-25 14:18:19,090][36138] Updated weights for policy 0, policy_version 49723 (0.0009) [2023-02-25 14:18:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 203673600. Throughput: 0: 3360.8. Samples: 13415834. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:18:19,730][36114] Avg episode reward: [(0, '55.944')] [2023-02-25 14:18:22,130][36138] Updated weights for policy 0, policy_version 49733 (0.0009) [2023-02-25 14:18:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 203739136. Throughput: 0: 3358.7. Samples: 13425876. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:18:24,729][36114] Avg episode reward: [(0, '55.944')] [2023-02-25 14:18:25,174][36138] Updated weights for policy 0, policy_version 49743 (0.0009) [2023-02-25 14:18:26,609][36154] DAMAGECOUNT value on done: 936994.0 [2023-02-25 14:18:26,609][36154] Sum rewards: 48.676, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.542', 'ARMOR': '0.004', 'AMMO5': '0.026', 'AMMO2': '0.062', 'AMMO3': '0.162', 'AMMO4': '0.310', 'weapon2': '0.354', 'weapon5': '0.366', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'weapon4': '0.806', 'WEAPON3': '1.000', 'weapon3': '2.080', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.868', 'FRAGCOUNT': '42.000'} [2023-02-25 14:18:26,926][36154] DAMAGECOUNT value on done: 922512.0 [2023-02-25 14:18:26,926][36154] Sum rewards: 68.658, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.030', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'weapon4': '0.056', 'weapon2': '0.188', 'AMMO3': '0.296', 'WEAPON3': '1.750', 'HITCOUNT': '3.440', 'weapon3': '3.516', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '62.000'} [2023-02-25 14:18:27,187][36154] DAMAGECOUNT value on done: 937431.0 [2023-02-25 14:18:27,187][36154] Sum rewards: 56.616, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.311', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.054', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'weapon2': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.239', 'weapon4': '0.356', 'WEAPON3': '1.400', 'HITCOUNT': '3.180', 'weapon3': '3.200', 'DAMAGECOUNT': '15.918', 'FRAGCOUNT': '49.000'} [2023-02-25 14:18:27,443][36141] DAMAGECOUNT value on done: 936528.0 [2023-02-25 14:18:27,443][36141] Sum rewards: 49.245, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.220', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.043', 'AMMO4': '0.216', 'AMMO3': '0.229', 'weapon2': '0.296', 'weapon5': '0.322', 'weapon4': '0.354', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.742', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.373', 'FRAGCOUNT': '43.500'} [2023-02-25 14:18:27,499][36154] DAMAGECOUNT value on done: 930070.0 [2023-02-25 14:18:27,499][36154] Sum rewards: 54.958, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.580', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.215', 'weapon2': '0.250', 'weapon4': '0.374', 'WEAPON3': '1.300', 'HITCOUNT': '2.970', 'weapon3': '3.044', 'DAMAGECOUNT': '14.532', 'FRAGCOUNT': '47.000'} [2023-02-25 14:18:27,737][36141] DAMAGECOUNT value on done: 928765.0 [2023-02-25 14:18:27,737][36141] Sum rewards: 60.526, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.677', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.076', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.150', 'weapon2': '0.348', 'weapon4': '0.410', 'WEAPON3': '0.900', 'weapon3': '2.878', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.589', 'FRAGCOUNT': '49.000'} [2023-02-25 14:18:27,758][36141] DAMAGECOUNT value on done: 935880.0 [2023-02-25 14:18:27,758][36141] Sum rewards: 60.407, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.250', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.017', 'weapon5': '0.054', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon2': '0.246', 'AMMO3': '0.247', 'weapon4': '0.312', 'WEAPON3': '1.350', 'HITCOUNT': '3.130', 'weapon3': '3.174', 'DAMAGECOUNT': '14.736', 'FRAGCOUNT': '53.000'} [2023-02-25 14:18:28,049][36141] DAMAGECOUNT value on done: 924992.0 [2023-02-25 14:18:28,049][36141] Sum rewards: 65.977, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.072', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.056', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon2': '0.240', 'AMMO3': '0.264', 'weapon4': '0.326', 'WEAPON3': '1.550', 'weapon3': '2.998', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '59.000'} [2023-02-25 14:18:28,266][36138] Updated weights for policy 0, policy_version 49753 (0.0009) [2023-02-25 14:18:29,497][36157] DAMAGECOUNT value on done: 940707.0 [2023-02-25 14:18:29,497][36157] Sum rewards: 60.130, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.792', 'ARMOR': '0.008', 'AMMO5': '0.023', 'AMMO2': '0.050', 'AMMO3': '0.130', 'weapon5': '0.206', 'AMMO4': '0.250', 'WEAPON5': '0.450', 'weapon2': '0.454', 'WEAPON4': '0.550', 'weapon4': '0.738', 'WEAPON3': '0.850', 'weapon3': '2.370', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '49.500'} [2023-02-25 14:18:29,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.2, 300 sec: 13412.7). Total num frames: 203804672. Throughput: 0: 3356.6. Samples: 13445948. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:18:29,730][36114] Avg episode reward: [(0, '55.988')] [2023-02-25 14:18:29,813][36157] DAMAGECOUNT value on done: 931569.0 [2023-02-25 14:18:29,813][36157] Sum rewards: 51.743, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.852', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon4': '0.258', 'WEAPON5': '0.300', 'weapon2': '0.528', 'WEAPON3': '1.200', 'HITCOUNT': '2.820', 'weapon3': '2.822', 'DAMAGECOUNT': '13.938', 'FRAGCOUNT': '45.000'} [2023-02-25 14:18:30,233][36140] DAMAGECOUNT value on done: 937322.0 [2023-02-25 14:18:30,233][36140] Sum rewards: 64.524, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.226', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.168', 'WEAPON4': '0.200', 'weapon2': '0.432', 'weapon4': '0.700', 'WEAPON3': '0.750', 'weapon3': '2.624', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '50.000'} [2023-02-25 14:18:30,546][36140] DAMAGECOUNT value on done: 919439.0 [2023-02-25 14:18:30,547][36140] Sum rewards: 58.208, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.170', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.035', 'AMMO3': '0.158', 'AMMO4': '0.175', 'weapon5': '0.356', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.516', 'weapon4': '0.564', 'WEAPON3': '0.950', 'weapon3': '2.280', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.705', 'FRAGCOUNT': '49.000'} [2023-02-25 14:18:30,590][36157] DAMAGECOUNT value on done: 939445.0 [2023-02-25 14:18:30,591][36157] Sum rewards: 42.136, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.504', 'ARMOR': '0.008', 'AMMO5': '0.024', 'AMMO2': '0.053', 'AMMO3': '0.218', 'weapon5': '0.226', 'AMMO4': '0.267', 'weapon2': '0.476', 'WEAPON5': '0.700', 'WEAPON4': '0.750', 'weapon4': '0.996', 'WEAPON3': '1.250', 'weapon3': '1.904', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.567', 'FRAGCOUNT': '40.500'} [2023-02-25 14:18:30,651][36140] DAMAGECOUNT value on done: 929834.0 [2023-02-25 14:18:30,652][36140] Sum rewards: 63.343, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.502', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.168', 'AMMO3': '0.211', 'weapon2': '0.588', 'WEAPON3': '1.350', 'weapon3': '2.872', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '53.000'} [2023-02-25 14:18:30,904][36157] DAMAGECOUNT value on done: 936467.0 [2023-02-25 14:18:30,904][36157] Sum rewards: 58.988, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.710', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.110', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'weapon2': '0.266', 'weapon4': '0.420', 'WEAPON3': '1.450', 'weapon3': '2.832', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.886', 'FRAGCOUNT': '54.000'} [2023-02-25 14:18:30,965][36140] DAMAGECOUNT value on done: 927843.0 [2023-02-25 14:18:30,966][36140] Sum rewards: 52.408, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.050', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.178', 'AMMO4': '0.225', 'weapon2': '0.232', 'AMMO3': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.388', 'WEAPON3': '1.550', 'weapon3': '2.892', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.550', 'FRAGCOUNT': '48.000'} [2023-02-25 14:18:31,345][36138] Updated weights for policy 0, policy_version 49763 (0.0009) [2023-02-25 14:18:31,396][36155] DAMAGECOUNT value on done: 926339.0 [2023-02-25 14:18:31,396][36155] Sum rewards: 51.417, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.452', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.102', 'AMMO4': '0.156', 'weapon2': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.276', 'WEAPON4': '0.400', 'weapon4': '0.590', 'WEAPON3': '1.600', 'weapon3': '2.856', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '49.000'} [2023-02-25 14:18:31,722][36155] DAMAGECOUNT value on done: 937400.0 [2023-02-25 14:18:31,722][36155] Sum rewards: 52.434, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.568', 'AMMO5': '0.016', 'AMMO2': '0.026', 'weapon4': '0.046', 'weapon5': '0.130', 'AMMO4': '0.131', 'AMMO3': '0.173', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON3': '1.050', 'HITCOUNT': '2.650', 'weapon3': '3.276', 'DAMAGECOUNT': '13.611', 'FRAGCOUNT': '44.000'} [2023-02-25 14:18:32,406][36142] DAMAGECOUNT value on done: 935998.0 [2023-02-25 14:18:32,406][36142] Sum rewards: 65.647, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.271', 'AMMO5': '0.022', 'AMMO2': '0.044', 'AMMO3': '0.114', 'AMMO4': '0.218', 'weapon4': '0.302', 'weapon5': '0.372', 'WEAPON4': '0.400', 'WEAPON5': '0.600', 'WEAPON3': '0.700', 'weapon2': '1.106', 'weapon3': '1.934', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '54.000'} [2023-02-25 14:18:32,721][36142] DAMAGECOUNT value on done: 917624.0 [2023-02-25 14:18:32,721][36142] Sum rewards: 44.408, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.192', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.037', 'AMMO4': '0.184', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'weapon5': '0.216', 'weapon2': '0.316', 'WEAPON4': '0.350', 'weapon4': '0.372', 'WEAPON3': '1.150', 'weapon3': '2.840', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.819', 'FRAGCOUNT': '39.000'} [2023-02-25 14:18:32,764][36155] DAMAGECOUNT value on done: 944751.0 [2023-02-25 14:18:32,764][36155] Sum rewards: 69.183, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.703', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.097', 'AMMO3': '0.133', 'weapon5': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.444', 'weapon4': '0.548', 'WEAPON3': '0.900', 'weapon3': '2.490', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '55.000'} [2023-02-25 14:18:33,042][36142] DAMAGECOUNT value on done: 926919.0 [2023-02-25 14:18:33,042][36142] Sum rewards: 64.343, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.031', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.092', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon4': '0.382', 'weapon2': '0.428', 'WEAPON3': '1.150', 'weapon3': '2.760', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.150', 'FRAGCOUNT': '55.000'} [2023-02-25 14:18:33,071][36155] DAMAGECOUNT value on done: 929346.0 [2023-02-25 14:18:33,071][36155] Sum rewards: 65.351, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.150', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'weapon4': '0.062', 'weapon5': '0.108', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'weapon2': '0.626', 'WEAPON3': '0.950', 'HITCOUNT': '2.930', 'weapon3': '3.122', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '53.000'} [2023-02-25 14:18:33,321][36139] DAMAGECOUNT value on done: 933093.0 [2023-02-25 14:18:33,321][36139] Sum rewards: 63.394, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.054', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.073', 'AMMO3': '0.156', 'weapon5': '0.224', 'weapon2': '0.266', 'AMMO4': '0.365', 'weapon4': '0.480', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'weapon3': '2.742', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '54.000'} [2023-02-25 14:18:33,353][36142] DAMAGECOUNT value on done: 943822.0 [2023-02-25 14:18:33,353][36142] Sum rewards: 56.175, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.682', 'ARMOR': '0.008', 'AMMO2': '0.014', 'AMMO5': '0.015', 'AMMO4': '0.072', 'AMMO3': '0.163', 'weapon4': '0.168', 'WEAPON4': '0.200', 'weapon5': '0.236', 'WEAPON5': '0.400', 'weapon2': '0.764', 'WEAPON3': '1.100', 'weapon3': '2.582', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '14.925', 'FRAGCOUNT': '45.000'} [2023-02-25 14:18:33,632][36139] DAMAGECOUNT value on done: 929543.0 [2023-02-25 14:18:33,632][36139] Sum rewards: 58.181, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.334', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.178', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.306', 'weapon4': '0.380', 'WEAPON3': '1.150', 'weapon3': '2.892', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.613', 'FRAGCOUNT': '49.000'} [2023-02-25 14:18:34,213][36139] DAMAGECOUNT value on done: 945626.0 [2023-02-25 14:18:34,214][36139] Sum rewards: 54.969, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.306', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.140', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.292', 'weapon4': '0.370', 'WEAPON3': '1.150', 'HITCOUNT': '2.830', 'weapon3': '2.988', 'DAMAGECOUNT': '14.937', 'FRAGCOUNT': '48.000'} [2023-02-25 14:18:34,292][36156] DAMAGECOUNT value on done: 936788.0 [2023-02-25 14:18:34,293][36156] Sum rewards: 75.386, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.240', 'AMMO5': '0.004', 'AMMO2': '0.026', 'weapon5': '0.030', 'weapon4': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.204', 'weapon2': '0.232', 'WEAPON3': '1.200', 'weapon3': '3.504', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '63.000'} [2023-02-25 14:18:34,303][36156] DAMAGECOUNT value on done: 944463.0 [2023-02-25 14:18:34,303][36156] Sum rewards: 66.609, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.838', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.074', 'AMMO4': '0.169', 'weapon2': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'weapon4': '0.396', 'WEAPON3': '1.400', 'weapon3': '3.104', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.032', 'FRAGCOUNT': '59.000'} [2023-02-25 14:18:34,384][36138] Updated weights for policy 0, policy_version 49773 (0.0009) [2023-02-25 14:18:34,527][36139] DAMAGECOUNT value on done: 938601.0 [2023-02-25 14:18:34,528][36139] Sum rewards: 48.899, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.198', 'AMMO5': '0.019', 'AMMO2': '0.047', 'AMMO3': '0.141', 'weapon5': '0.152', 'AMMO4': '0.232', 'weapon2': '0.294', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'weapon4': '0.678', 'WEAPON3': '0.900', 'weapon3': '2.610', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '11.514', 'FRAGCOUNT': '45.000'} [2023-02-25 14:18:34,616][36156] DAMAGECOUNT value on done: 927171.0 [2023-02-25 14:18:34,616][36156] Sum rewards: 63.449, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.856', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.234', 'weapon4': '0.364', 'WEAPON3': '1.250', 'weapon3': '3.066', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.672', 'FRAGCOUNT': '54.000'} [2023-02-25 14:18:34,627][36156] DAMAGECOUNT value on done: 933979.0 [2023-02-25 14:18:34,627][36156] Sum rewards: 47.249, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.622', 'AMMO5': '0.006', 'AMMO2': '0.039', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO4': '0.193', 'weapon4': '0.222', 'AMMO3': '0.261', 'WEAPON4': '0.400', 'weapon2': '0.532', 'WEAPON3': '1.450', 'weapon3': '2.898', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.431', 'FRAGCOUNT': '45.000'} [2023-02-25 14:18:34,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 203874304. Throughput: 0: 3354.9. Samples: 13466020. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:18:34,729][36114] Avg episode reward: [(0, '56.193')] [2023-02-25 14:18:37,483][36138] Updated weights for policy 0, policy_version 49783 (0.0009) [2023-02-25 14:18:39,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 203939840. Throughput: 0: 3352.3. Samples: 13476028. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:18:39,730][36114] Avg episode reward: [(0, '56.193')] [2023-02-25 14:18:40,543][36138] Updated weights for policy 0, policy_version 49793 (0.0009) [2023-02-25 14:18:43,611][36138] Updated weights for policy 0, policy_version 49803 (0.0010) [2023-02-25 14:18:44,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 204005376. Throughput: 0: 3349.2. Samples: 13496166. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:18:44,730][36114] Avg episode reward: [(0, '56.193')] [2023-02-25 14:18:46,396][36141] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:18:46,648][36138] Updated weights for policy 0, policy_version 49813 (0.0010) [2023-02-25 14:18:46,741][36154] DAMAGECOUNT value on done: 941917.0 [2023-02-25 14:18:46,742][36154] Sum rewards: 61.315, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.432', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.043', 'AMMO3': '0.130', 'weapon5': '0.198', 'AMMO4': '0.217', 'WEAPON5': '0.250', 'weapon2': '0.274', 'WEAPON4': '0.450', 'weapon4': '0.494', 'WEAPON3': '0.800', 'weapon3': '2.786', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.751', 'FRAGCOUNT': '51.000'} [2023-02-25 14:18:47,042][36154] DAMAGECOUNT value on done: 927636.0 [2023-02-25 14:18:47,042][36154] Sum rewards: 57.914, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.436', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.170', 'AMMO3': '0.181', 'weapon2': '0.284', 'WEAPON4': '0.400', 'weapon4': '0.648', 'WEAPON3': '1.000', 'weapon3': '2.726', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.372', 'FRAGCOUNT': '49.000'} [2023-02-25 14:18:47,291][36154] DAMAGECOUNT value on done: 942536.0 [2023-02-25 14:18:47,291][36154] Sum rewards: 56.368, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.511', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO3': '0.142', 'AMMO4': '0.145', 'weapon5': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.466', 'weapon4': '0.536', 'WEAPON3': '0.850', 'weapon3': '2.506', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '46.000'} [2023-02-25 14:18:47,548][36141] DAMAGECOUNT value on done: 941171.0 [2023-02-25 14:18:47,549][36141] Sum rewards: 56.026, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.334', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.053', 'AMMO3': '0.084', 'weapon5': '0.256', 'AMMO4': '0.267', 'weapon2': '0.438', 'WEAPON3': '0.500', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon4': '0.926', 'weapon3': '2.078', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.869', 'FRAGCOUNT': '45.000'} [2023-02-25 14:18:47,598][36154] DAMAGECOUNT value on done: 935307.0 [2023-02-25 14:18:47,598][36154] Sum rewards: 58.805, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.555', 'AMMO5': '0.018', 'AMMO2': '0.055', 'AMMO3': '0.218', 'weapon2': '0.220', 'AMMO4': '0.274', 'weapon4': '0.320', 'weapon5': '0.386', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.748', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '55.000'} [2023-02-25 14:18:47,838][36141] DAMAGECOUNT value on done: 933676.0 [2023-02-25 14:18:47,838][36141] Sum rewards: 51.826, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.904', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.144', 'weapon4': '0.190', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.498', 'WEAPON3': '1.400', 'HITCOUNT': '2.930', 'weapon3': '2.932', 'DAMAGECOUNT': '14.733', 'FRAGCOUNT': '46.000'} [2023-02-25 14:18:47,862][36141] DAMAGECOUNT value on done: 941065.0 [2023-02-25 14:18:47,863][36141] Sum rewards: 55.288, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.923', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.032', 'AMMO4': '0.159', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon5': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.592', 'weapon4': '0.680', 'WEAPON3': '1.300', 'weapon3': '2.194', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '48.000'} [2023-02-25 14:18:48,152][36141] DAMAGECOUNT value on done: 929497.0 [2023-02-25 14:18:48,153][36141] Sum rewards: 51.539, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.302', 'AMMO5': '0.015', 'AMMO2': '0.025', 'weapon4': '0.048', 'AMMO4': '0.123', 'weapon5': '0.178', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.540', 'WEAPON3': '1.450', 'HITCOUNT': '2.860', 'weapon3': '2.994', 'DAMAGECOUNT': '13.515', 'FRAGCOUNT': '47.000'} [2023-02-25 14:18:49,530][36157] DAMAGECOUNT value on done: 946352.0 [2023-02-25 14:18:49,531][36157] Sum rewards: 63.835, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.387', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.101', 'AMMO3': '0.195', 'weapon2': '0.208', 'WEAPON4': '0.250', 'weapon4': '0.578', 'WEAPON3': '1.150', 'weapon3': '2.778', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '53.000'} [2023-02-25 14:18:49,667][36138] Updated weights for policy 0, policy_version 49823 (0.0009) [2023-02-25 14:18:49,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13412.7). Total num frames: 204075008. Throughput: 0: 3349.6. Samples: 13516286. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:18:49,730][36114] Avg episode reward: [(0, '56.394')] [2023-02-25 14:18:49,843][36157] DAMAGECOUNT value on done: 936733.0 [2023-02-25 14:18:49,844][36157] Sum rewards: 62.552, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.196', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon4': '0.212', 'weapon2': '0.404', 'WEAPON3': '1.150', 'weapon3': '3.034', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.492', 'FRAGCOUNT': '52.000'} [2023-02-25 14:18:50,162][36140] DAMAGECOUNT value on done: 941599.0 [2023-02-25 14:18:50,162][36140] Sum rewards: 50.043, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.002', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.100', 'weapon2': '0.134', 'AMMO4': '0.135', 'weapon7': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.221', 'weapon4': '0.532', 'WEAPON3': '1.300', 'HITCOUNT': '2.610', 'weapon3': '2.754', 'DAMAGECOUNT': '12.831', 'FRAGCOUNT': '44.000'} [2023-02-25 14:18:50,482][36140] DAMAGECOUNT value on done: 923899.0 [2023-02-25 14:18:50,483][36140] Sum rewards: 56.515, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.550', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.030', 'weapon5': '0.048', 'AMMO4': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.247', 'weapon2': '0.388', 'WEAPON3': '1.550', 'HITCOUNT': '2.930', 'weapon3': '3.350', 'DAMAGECOUNT': '13.380', 'FRAGCOUNT': '52.000'} [2023-02-25 14:18:50,549][36140] DAMAGECOUNT value on done: 935162.0 [2023-02-25 14:18:50,549][36140] Sum rewards: 64.369, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.255', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.025', 'weapon5': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.239', 'weapon2': '0.570', 'WEAPON3': '1.500', 'weapon3': '3.152', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.984', 'FRAGCOUNT': '56.000'} [2023-02-25 14:18:50,582][36157] DAMAGECOUNT value on done: 944933.0 [2023-02-25 14:18:50,582][36157] Sum rewards: 64.844, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.509', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.147', 'weapon5': '0.168', 'AMMO4': '0.173', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.394', 'weapon4': '0.534', 'WEAPON3': '0.900', 'weapon3': '2.684', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '53.000'} [2023-02-25 14:18:50,845][36140] DAMAGECOUNT value on done: 932323.0 [2023-02-25 14:18:50,846][36140] Sum rewards: 49.338, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.223', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.120', 'AMMO4': '0.131', 'weapon5': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON3': '1.250', 'HITCOUNT': '2.820', 'weapon3': '3.184', 'DAMAGECOUNT': '13.440', 'FRAGCOUNT': '43.000'} [2023-02-25 14:18:50,877][36157] DAMAGECOUNT value on done: 941942.0 [2023-02-25 14:18:50,878][36157] Sum rewards: 63.640, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.880', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.127', 'AMMO3': '0.188', 'weapon4': '0.220', 'weapon5': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.466', 'WEAPON3': '1.150', 'weapon3': '2.776', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '54.000'} [2023-02-25 14:18:51,421][36155] DAMAGECOUNT value on done: 931866.0 [2023-02-25 14:18:51,421][36155] Sum rewards: 67.876, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.832', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.019', 'weapon4': '0.024', 'weapon5': '0.050', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.162', 'weapon2': '0.180', 'WEAPON3': '1.000', 'HITCOUNT': '3.260', 'weapon3': '3.628', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '54.000'} [2023-02-25 14:18:51,747][36155] DAMAGECOUNT value on done: 941920.0 [2023-02-25 14:18:51,748][36155] Sum rewards: 53.642, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.356', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.076', 'weapon5': '0.088', 'AMMO4': '0.093', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.386', 'WEAPON3': '1.150', 'HITCOUNT': '2.780', 'weapon3': '3.260', 'DAMAGECOUNT': '13.560', 'FRAGCOUNT': '46.000'} [2023-02-25 14:18:52,481][36142] DAMAGECOUNT value on done: 940667.0 [2023-02-25 14:18:52,481][36142] Sum rewards: 55.117, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.408', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.144', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.302', 'weapon4': '0.798', 'WEAPON3': '1.150', 'weapon3': '2.526', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.007', 'FRAGCOUNT': '47.000'} [2023-02-25 14:18:52,757][36138] Updated weights for policy 0, policy_version 49833 (0.0009) [2023-02-25 14:18:52,798][36142] DAMAGECOUNT value on done: 922820.0 [2023-02-25 14:18:52,798][36142] Sum rewards: 57.067, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.182', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.058', 'weapon5': '0.206', 'AMMO3': '0.221', 'weapon2': '0.274', 'AMMO4': '0.291', 'weapon4': '0.440', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.746', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.588', 'FRAGCOUNT': '52.000'} [2023-02-25 14:18:52,853][36155] DAMAGECOUNT value on done: 949787.0 [2023-02-25 14:18:52,854][36155] Sum rewards: 57.340, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.434', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.044', 'AMMO3': '0.196', 'weapon5': '0.210', 'AMMO4': '0.219', 'weapon2': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.414', 'WEAPON3': '1.250', 'weapon3': '2.786', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.108', 'FRAGCOUNT': '50.500'} [2023-02-25 14:18:53,116][36142] DAMAGECOUNT value on done: 931976.0 [2023-02-25 14:18:53,116][36142] Sum rewards: 54.527, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.110', 'AMMO5': '0.025', 'AMMO2': '0.076', 'weapon5': '0.140', 'AMMO3': '0.185', 'weapon2': '0.228', 'AMMO4': '0.378', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'weapon4': '0.862', 'WEAPON3': '1.200', 'weapon3': '2.428', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.165', 'FRAGCOUNT': '50.000'} [2023-02-25 14:18:53,159][36155] DAMAGECOUNT value on done: 935788.0 [2023-02-25 14:18:53,159][36155] Sum rewards: 73.079, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.722', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.270', 'WEAPON4': '0.300', 'weapon4': '0.398', 'WEAPON3': '1.300', 'weapon3': '2.888', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.326', 'FRAGCOUNT': '60.500'} [2023-02-25 14:18:53,420][36139] DAMAGECOUNT value on done: 937704.0 [2023-02-25 14:18:53,420][36139] Sum rewards: 53.549, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.601', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.164', 'weapon5': '0.214', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.456', 'weapon4': '0.480', 'WEAPON3': '1.350', 'weapon3': '2.586', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.788', 'FRAGCOUNT': '47.500'} [2023-02-25 14:18:53,426][36142] DAMAGECOUNT value on done: 948616.0 [2023-02-25 14:18:53,426][36142] Sum rewards: 56.553, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'weapon5': '0.258', 'HEALTH': '0.258', 'weapon2': '0.278', 'weapon4': '0.326', 'WEAPON3': '0.900', 'HITCOUNT': '2.840', 'weapon3': '2.942', 'DAMAGECOUNT': '14.382', 'FRAGCOUNT': '45.000'} [2023-02-25 14:18:53,732][36139] DAMAGECOUNT value on done: 935395.0 [2023-02-25 14:18:53,732][36139] Sum rewards: 63.824, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.005', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.084', 'weapon5': '0.090', 'weapon2': '0.140', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.294', 'WEAPON3': '1.800', 'weapon3': '3.434', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.556', 'FRAGCOUNT': '57.000'} [2023-02-25 14:18:54,298][36139] DAMAGECOUNT value on done: 950622.0 [2023-02-25 14:18:54,298][36139] Sum rewards: 54.072, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.520', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.092', 'weapon5': '0.140', 'AMMO4': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.297', 'weapon2': '0.332', 'WEAPON3': '1.700', 'HITCOUNT': '2.950', 'weapon3': '3.120', 'DAMAGECOUNT': '14.988', 'FRAGCOUNT': '51.000'} [2023-02-25 14:18:54,399][36156] DAMAGECOUNT value on done: 942799.0 [2023-02-25 14:18:54,399][36156] Sum rewards: 70.628, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.052', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon5': '0.148', 'AMMO4': '0.151', 'weapon4': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'WEAPON5': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.946', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.033', 'FRAGCOUNT': '60.000'} [2023-02-25 14:18:54,409][36156] DAMAGECOUNT value on done: 949177.0 [2023-02-25 14:18:54,410][36156] Sum rewards: 50.709, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.818', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.069', 'AMMO3': '0.139', 'weapon2': '0.250', 'AMMO4': '0.346', 'weapon5': '0.394', 'WEAPON5': '0.600', 'WEAPON3': '0.800', 'WEAPON4': '0.850', 'weapon4': '0.894', 'weapon3': '2.106', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '14.142', 'FRAGCOUNT': '45.000'} [2023-02-25 14:18:54,612][36139] DAMAGECOUNT value on done: 943336.0 [2023-02-25 14:18:54,612][36139] Sum rewards: 57.312, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.450', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.118', 'AMMO3': '0.190', 'weapon2': '0.454', 'WEAPON3': '1.100', 'HITCOUNT': '2.900', 'weapon3': '3.176', 'DAMAGECOUNT': '14.205', 'FRAGCOUNT': '48.000'} [2023-02-25 14:18:54,710][36156] DAMAGECOUNT value on done: 932454.0 [2023-02-25 14:18:54,710][36156] Sum rewards: 57.265, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.802', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.082', 'AMMO3': '0.238', 'weapon5': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.318', 'weapon4': '0.378', 'WEAPON3': '1.450', 'weapon3': '2.786', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.849', 'FRAGCOUNT': '50.000'} [2023-02-25 14:18:54,721][36156] DAMAGECOUNT value on done: 939756.0 [2023-02-25 14:18:54,722][36156] Sum rewards: 63.934, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.729', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon2': '0.174', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.250', 'weapon4': '0.336', 'WEAPON3': '1.300', 'weapon3': '2.952', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.331', 'FRAGCOUNT': '54.000'} [2023-02-25 14:18:54,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 204140544. Throughput: 0: 3348.1. Samples: 13526300. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:18:54,729][36114] Avg episode reward: [(0, '57.347')] [2023-02-25 14:18:55,812][36138] Updated weights for policy 0, policy_version 49843 (0.0010) [2023-02-25 14:18:58,860][36138] Updated weights for policy 0, policy_version 49853 (0.0010) [2023-02-25 14:18:59,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 204206080. Throughput: 0: 3350.3. Samples: 13546434. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:18:59,730][36114] Avg episode reward: [(0, '57.395')] [2023-02-25 14:19:01,912][36138] Updated weights for policy 0, policy_version 49863 (0.0009) [2023-02-25 14:19:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 204275712. Throughput: 0: 3349.6. Samples: 13566568. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:19:04,729][36114] Avg episode reward: [(0, '57.395')] [2023-02-25 14:19:04,981][36138] Updated weights for policy 0, policy_version 49873 (0.0010) [2023-02-25 14:19:06,935][36154] DAMAGECOUNT value on done: 946594.0 [2023-02-25 14:19:06,936][36154] Sum rewards: 51.715, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.634', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.054', 'AMMO3': '0.195', 'weapon5': '0.248', 'AMMO4': '0.270', 'weapon2': '0.354', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.970', 'WEAPON3': '1.250', 'weapon3': '2.040', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.031', 'FRAGCOUNT': '46.000'} [2023-02-25 14:19:07,245][36154] DAMAGECOUNT value on done: 931700.0 [2023-02-25 14:19:07,245][36154] Sum rewards: 40.533, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.676', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon5': '0.206', 'WEAPON5': '0.250', 'AMMO3': '0.288', 'WEAPON4': '0.300', 'ARMOR': '0.404', 'weapon4': '0.494', 'weapon2': '0.564', 'WEAPON3': '1.650', 'weapon3': '2.380', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.192', 'FRAGCOUNT': '39.000'} [2023-02-25 14:19:07,404][36154] DAMAGECOUNT value on done: 947362.0 [2023-02-25 14:19:07,405][36154] Sum rewards: 52.869, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.047', 'ARMOR': '0.008', 'AMMO5': '0.023', 'AMMO2': '0.055', 'AMMO3': '0.208', 'weapon4': '0.268', 'AMMO4': '0.278', 'weapon2': '0.298', 'weapon5': '0.330', 'WEAPON5': '0.600', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.730', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.478', 'FRAGCOUNT': '49.000'} [2023-02-25 14:19:07,542][36141] DAMAGECOUNT value on done: 947223.0 [2023-02-25 14:19:07,543][36141] Sum rewards: 67.961, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.611', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.182', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.294', 'weapon2': '0.350', 'WEAPON3': '1.400', 'weapon3': '2.914', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.156', 'FRAGCOUNT': '58.000'} [2023-02-25 14:19:07,720][36154] DAMAGECOUNT value on done: 939793.0 [2023-02-25 14:19:07,721][36154] Sum rewards: 50.225, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.148', 'AMMO2': '0.015', 'AMMO4': '0.072', 'WEAPON4': '0.200', 'weapon2': '0.204', 'AMMO3': '0.215', 'weapon4': '0.394', 'ARMOR': '0.435', 'WEAPON3': '1.400', 'HITCOUNT': '2.670', 'weapon3': '3.060', 'DAMAGECOUNT': '13.458', 'FRAGCOUNT': '44.000'} [2023-02-25 14:19:07,844][36141] DAMAGECOUNT value on done: 937694.0 [2023-02-25 14:19:07,845][36141] Sum rewards: 43.084, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.165', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.065', 'AMMO3': '0.128', 'weapon5': '0.168', 'AMMO4': '0.326', 'WEAPON5': '0.500', 'weapon2': '0.540', 'WEAPON4': '0.700', 'weapon4': '0.702', 'WEAPON3': '0.750', 'weapon3': '2.274', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.054', 'FRAGCOUNT': '37.000'} [2023-02-25 14:19:07,866][36141] DAMAGECOUNT value on done: 947245.0 [2023-02-25 14:19:07,866][36141] Sum rewards: 70.296, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-5.520', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon4': '0.170', 'weapon5': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.284', 'weapon2': '0.318', 'WEAPON3': '1.850', 'weapon3': '3.086', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '63.000'} [2023-02-25 14:19:08,048][36138] Updated weights for policy 0, policy_version 49883 (0.0009) [2023-02-25 14:19:08,158][36141] DAMAGECOUNT value on done: 934573.0 [2023-02-25 14:19:08,158][36141] Sum rewards: 59.347, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.046', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'weapon4': '0.412', 'weapon2': '0.664', 'WEAPON3': '1.050', 'weapon3': '2.600', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '49.000'} [2023-02-25 14:19:08,178][36142] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:19:09,692][36157] DAMAGECOUNT value on done: 952009.0 [2023-02-25 14:19:09,692][36157] Sum rewards: 67.704, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.148', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.106', 'weapon2': '0.154', 'AMMO3': '0.284', 'weapon4': '0.366', 'WEAPON3': '1.650', 'weapon3': '3.136', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.971', 'FRAGCOUNT': '60.000'} [2023-02-25 14:19:09,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 204341248. Throughput: 0: 3346.4. Samples: 13576466. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:19:09,730][36114] Avg episode reward: [(0, '57.643')] [2023-02-25 14:19:10,012][36157] DAMAGECOUNT value on done: 941862.0 [2023-02-25 14:19:10,013][36157] Sum rewards: 65.268, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.152', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.039', 'AMMO3': '0.131', 'weapon5': '0.188', 'AMMO4': '0.195', 'weapon2': '0.322', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '0.800', 'weapon4': '1.054', 'weapon3': '2.158', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '15.387', 'FRAGCOUNT': '55.000'} [2023-02-25 14:19:10,302][36140] DAMAGECOUNT value on done: 946386.0 [2023-02-25 14:19:10,303][36140] Sum rewards: 41.162, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.526', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.064', 'AMMO3': '0.143', 'weapon2': '0.256', 'AMMO4': '0.318', 'weapon5': '0.450', 'WEAPON5': '0.650', 'WEAPON3': '0.800', 'WEAPON4': '0.850', 'weapon4': '1.324', 'weapon3': '1.594', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.361', 'FRAGCOUNT': '35.000'} [2023-02-25 14:19:10,615][36140] DAMAGECOUNT value on done: 929449.0 [2023-02-25 14:19:10,615][36140] Sum rewards: 60.985, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.550', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.043', 'AMMO3': '0.168', 'AMMO4': '0.217', 'weapon2': '0.342', 'weapon5': '0.374', 'weapon4': '0.524', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.410', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '16.650', 'FRAGCOUNT': '52.000'} [2023-02-25 14:19:10,655][36140] DAMAGECOUNT value on done: 939637.0 [2023-02-25 14:19:10,655][36140] Sum rewards: 60.109, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.170', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'WEAPON4': '0.300', 'weapon2': '0.382', 'weapon4': '0.406', 'WEAPON3': '1.150', 'HITCOUNT': '2.900', 'weapon3': '3.058', 'DAMAGECOUNT': '13.425', 'FRAGCOUNT': '53.000'} [2023-02-25 14:19:10,706][36157] DAMAGECOUNT value on done: 950399.0 [2023-02-25 14:19:10,706][36157] Sum rewards: 65.143, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.723', 'AMMO2': '0.019', 'weapon4': '0.078', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.263', 'weapon2': '0.318', 'WEAPON3': '1.500', 'weapon3': '3.394', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '57.000'} [2023-02-25 14:19:10,969][36140] DAMAGECOUNT value on done: 936378.0 [2023-02-25 14:19:10,970][36140] Sum rewards: 47.167, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.992', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon4': '0.386', 'ARMOR': '0.400', 'weapon2': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.766', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.165', 'FRAGCOUNT': '40.000'} [2023-02-25 14:19:11,019][36157] DAMAGECOUNT value on done: 947162.0 [2023-02-25 14:19:11,019][36157] Sum rewards: 62.861, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.734', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.035', 'AMMO3': '0.160', 'AMMO4': '0.176', 'weapon5': '0.210', 'weapon4': '0.284', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.724', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '54.000'} [2023-02-25 14:19:11,085][36138] Updated weights for policy 0, policy_version 49893 (0.0010) [2023-02-25 14:19:11,454][36155] DAMAGECOUNT value on done: 936491.0 [2023-02-25 14:19:11,454][36155] Sum rewards: 52.539, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.168', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon4': '0.262', 'weapon2': '0.410', 'WEAPON3': '1.150', 'HITCOUNT': '2.690', 'weapon3': '3.076', 'DAMAGECOUNT': '13.875', 'FRAGCOUNT': '45.000'} [2023-02-25 14:19:11,770][36155] DAMAGECOUNT value on done: 946532.0 [2023-02-25 14:19:11,771][36155] Sum rewards: 57.013, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.851', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.046', 'weapon5': '0.100', 'AMMO3': '0.149', 'AMMO4': '0.172', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.520', 'WEAPON3': '0.850', 'HITCOUNT': '2.730', 'weapon3': '3.170', 'DAMAGECOUNT': '13.728', 'FRAGCOUNT': '47.000'} [2023-02-25 14:19:12,562][36142] DAMAGECOUNT value on done: 945157.0 [2023-02-25 14:19:12,563][36142] Sum rewards: 42.823, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.366', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon4': '0.148', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.280', 'weapon5': '0.284', 'weapon2': '0.514', 'WEAPON3': '1.650', 'HITCOUNT': '2.720', 'weapon3': '2.744', 'DAMAGECOUNT': '13.455', 'FRAGCOUNT': '41.000'} [2023-02-25 14:19:12,870][36142] DAMAGECOUNT value on done: 927530.0 [2023-02-25 14:19:12,871][36142] Sum rewards: 51.922, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.056', 'AMMO5': '0.006', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.112', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'weapon2': '0.292', 'WEAPON4': '0.300', 'weapon4': '0.512', 'WEAPON3': '1.150', 'weapon3': '2.890', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.130', 'FRAGCOUNT': '44.000'} [2023-02-25 14:19:12,883][36155] DAMAGECOUNT value on done: 954661.0 [2023-02-25 14:19:12,884][36155] Sum rewards: 50.554, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.098', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon5': '0.220', 'weapon2': '0.224', 'AMMO4': '0.226', 'AMMO3': '0.227', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.604', 'WEAPON3': '1.250', 'weapon3': '2.522', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.622', 'FRAGCOUNT': '45.000'} [2023-02-25 14:19:13,190][36142] DAMAGECOUNT value on done: 936840.0 [2023-02-25 14:19:13,191][36142] Sum rewards: 52.910, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.985', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO3': '0.156', 'AMMO4': '0.161', 'weapon2': '0.214', 'weapon5': '0.276', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.452', 'WEAPON3': '1.000', 'weapon3': '2.782', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '14.592', 'FRAGCOUNT': '45.000'} [2023-02-25 14:19:13,203][36155] DAMAGECOUNT value on done: 940992.0 [2023-02-25 14:19:13,204][36155] Sum rewards: 49.573, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.431', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon5': '0.146', 'AMMO4': '0.167', 'weapon4': '0.240', 'AMMO3': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.442', 'WEAPON3': '1.550', 'weapon3': '2.846', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.612', 'FRAGCOUNT': '46.000'} [2023-02-25 14:19:13,439][36139] DAMAGECOUNT value on done: 942389.0 [2023-02-25 14:19:13,440][36139] Sum rewards: 54.452, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.938', 'AMMO5': '0.015', 'AMMO2': '0.059', 'weapon5': '0.088', 'AMMO3': '0.189', 'AMMO4': '0.297', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON4': '0.500', 'weapon4': '0.686', 'WEAPON3': '1.050', 'weapon3': '2.556', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.055', 'FRAGCOUNT': '48.000'} [2023-02-25 14:19:13,502][36142] DAMAGECOUNT value on done: 954302.0 [2023-02-25 14:19:13,503][36142] Sum rewards: 64.761, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.640', 'AMMO5': '0.017', 'AMMO2': '0.039', 'AMMO4': '0.194', 'AMMO3': '0.242', 'weapon5': '0.266', 'weapon4': '0.322', 'weapon2': '0.358', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.664', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '56.000'} [2023-02-25 14:19:13,751][36139] DAMAGECOUNT value on done: 940905.0 [2023-02-25 14:19:13,752][36139] Sum rewards: 58.913, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.967', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.047', 'AMMO3': '0.217', 'AMMO4': '0.237', 'weapon2': '0.256', 'weapon5': '0.294', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.498', 'WEAPON3': '1.200', 'weapon3': '2.612', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '52.000'} [2023-02-25 14:19:14,159][36138] Updated weights for policy 0, policy_version 49903 (0.0009) [2023-02-25 14:19:14,291][36139] DAMAGECOUNT value on done: 955346.0 [2023-02-25 14:19:14,291][36139] Sum rewards: 54.188, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.852', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.102', 'WEAPON5': '0.200', 'AMMO3': '0.283', 'weapon4': '0.284', 'WEAPON4': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.750', 'weapon3': '2.998', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.172', 'FRAGCOUNT': '51.000'} [2023-02-25 14:19:14,476][36156] DAMAGECOUNT value on done: 947821.0 [2023-02-25 14:19:14,476][36156] Sum rewards: 63.897, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.490', 'AMMO2': '0.003', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO4': '0.017', 'WEAPON1': '0.020', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.212', 'ARMOR': '0.458', 'weapon2': '0.890', 'WEAPON3': '1.450', 'weapon3': '2.812', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.066', 'FRAGCOUNT': '55.000'} [2023-02-25 14:19:14,487][36156] DAMAGECOUNT value on done: 954427.0 [2023-02-25 14:19:14,488][36156] Sum rewards: 55.737, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.070', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'weapon4': '0.276', 'weapon2': '0.326', 'WEAPON3': '1.450', 'weapon3': '2.988', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '48.000'} [2023-02-25 14:19:14,609][36139] DAMAGECOUNT value on done: 948789.0 [2023-02-25 14:19:14,609][36139] Sum rewards: 63.712, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.012', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.136', 'AMMO4': '0.166', 'weapon4': '0.182', 'AMMO3': '0.210', 'weapon2': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.152', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '54.000'} [2023-02-25 14:19:14,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 204406784. Throughput: 0: 3347.3. Samples: 13596574. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:19:14,729][36114] Avg episode reward: [(0, '56.979')] [2023-02-25 14:19:14,798][36156] DAMAGECOUNT value on done: 937007.0 [2023-02-25 14:19:14,799][36156] Sum rewards: 50.128, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.900', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon5': '0.190', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.304', 'weapon4': '0.330', 'WEAPON3': '1.350', 'weapon3': '2.906', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.659', 'FRAGCOUNT': '45.000'} [2023-02-25 14:19:14,809][36156] DAMAGECOUNT value on done: 942967.0 [2023-02-25 14:19:14,810][36156] Sum rewards: 38.938, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.222', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO3': '0.156', 'weapon2': '0.214', 'AMMO4': '0.225', 'weapon5': '0.266', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.644', 'WEAPON3': '0.950', 'HITCOUNT': '2.110', 'weapon3': '2.548', 'DAMAGECOUNT': '9.633', 'FRAGCOUNT': '35.500'} [2023-02-25 14:19:17,190][36138] Updated weights for policy 0, policy_version 49913 (0.0009) [2023-02-25 14:19:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.2, 300 sec: 13412.7). Total num frames: 204476416. Throughput: 0: 3349.2. Samples: 13616734. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:19:19,730][36114] Avg episode reward: [(0, '56.826')] [2023-02-25 14:19:19,734][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000049921_204476416.pth... [2023-02-25 14:19:19,787][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000049135_201256960.pth [2023-02-25 14:19:20,262][36138] Updated weights for policy 0, policy_version 49923 (0.0009) [2023-02-25 14:19:23,305][36138] Updated weights for policy 0, policy_version 49933 (0.0010) [2023-02-25 14:19:24,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 204541952. Throughput: 0: 3351.4. Samples: 13626840. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:19:24,729][36114] Avg episode reward: [(0, '56.826')] [2023-02-25 14:19:26,386][36138] Updated weights for policy 0, policy_version 49943 (0.0009) [2023-02-25 14:19:26,917][36154] DAMAGECOUNT value on done: 951469.0 [2023-02-25 14:19:26,917][36154] Sum rewards: 61.041, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.536', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.187', 'weapon5': '0.276', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.550', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.625', 'FRAGCOUNT': '53.000'} [2023-02-25 14:19:27,099][36141] Large shaping reward -2.503 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('weapon5', 0.002)] [2023-02-25 14:19:27,248][36154] DAMAGECOUNT value on done: 936339.0 [2023-02-25 14:19:27,248][36154] Sum rewards: 50.952, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.148', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.285', 'weapon2': '0.312', 'weapon4': '0.320', 'WEAPON3': '1.750', 'HITCOUNT': '2.940', 'weapon3': '3.088', 'DAMAGECOUNT': '13.917', 'FRAGCOUNT': '48.000'} [2023-02-25 14:19:27,342][36154] DAMAGECOUNT value on done: 952334.0 [2023-02-25 14:19:27,343][36154] Sum rewards: 64.090, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.547', 'AMMO5': '0.007', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.166', 'weapon4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.246', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.110', 'weapon3': '3.192', 'DAMAGECOUNT': '14.916', 'FRAGCOUNT': '56.000'} [2023-02-25 14:19:27,507][36141] DAMAGECOUNT value on done: 952169.0 [2023-02-25 14:19:27,507][36141] Sum rewards: 64.182, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.570', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.081', 'weapon5': '0.164', 'WEAPON5': '0.200', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '0.500', 'weapon4': '0.772', 'weapon3': '2.416', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.838', 'FRAGCOUNT': '50.000'} [2023-02-25 14:19:27,646][36154] DAMAGECOUNT value on done: 944431.0 [2023-02-25 14:19:27,647][36154] Sum rewards: 52.524, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.042', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon2': '0.156', 'AMMO4': '0.163', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon4': '0.944', 'WEAPON3': '1.300', 'weapon3': '2.584', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '13.914', 'FRAGCOUNT': '46.000'} [2023-02-25 14:19:27,822][36141] DAMAGECOUNT value on done: 951317.0 [2023-02-25 14:19:27,822][36141] Sum rewards: 44.489, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.510', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.120', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon4': '0.392', 'weapon2': '0.552', 'WEAPON3': '1.350', 'HITCOUNT': '2.710', 'weapon3': '2.844', 'DAMAGECOUNT': '12.216', 'FRAGCOUNT': '41.000'} [2023-02-25 14:19:27,865][36141] DAMAGECOUNT value on done: 942765.0 [2023-02-25 14:19:27,866][36141] Sum rewards: 56.158, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.703', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.018', 'weapon5': '0.048', 'weapon4': '0.088', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.186', 'AMMO3': '0.235', 'WEAPON3': '1.500', 'HITCOUNT': '3.040', 'weapon3': '3.488', 'DAMAGECOUNT': '15.213', 'FRAGCOUNT': '49.000'} [2023-02-25 14:19:28,164][36141] DAMAGECOUNT value on done: 939474.0 [2023-02-25 14:19:28,165][36141] Sum rewards: 49.813, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.236', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.052', 'weapon2': '0.180', 'weapon5': '0.194', 'AMMO3': '0.236', 'AMMO4': '0.259', 'WEAPON5': '0.400', 'weapon4': '0.406', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '2.750', 'weapon3': '2.948', 'DAMAGECOUNT': '14.703', 'FRAGCOUNT': '45.500'} [2023-02-25 14:19:29,434][36138] Updated weights for policy 0, policy_version 49953 (0.0009) [2023-02-25 14:19:29,729][36114] Fps is (10 sec: 13517.0, 60 sec: 13448.6, 300 sec: 13426.6). Total num frames: 204611584. Throughput: 0: 3348.8. Samples: 13646860. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:19:29,730][36114] Avg episode reward: [(0, '57.229')] [2023-02-25 14:19:29,783][36157] DAMAGECOUNT value on done: 956537.0 [2023-02-25 14:19:29,783][36157] Sum rewards: 52.738, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.645', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO4': '0.178', 'AMMO3': '0.185', 'weapon2': '0.188', 'weapon5': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.500', 'weapon4': '0.586', 'WEAPON3': '1.100', 'HITCOUNT': '2.650', 'weapon3': '2.706', 'DAMAGECOUNT': '13.584', 'FRAGCOUNT': '46.000'} [2023-02-25 14:19:30,094][36157] DAMAGECOUNT value on done: 947536.0 [2023-02-25 14:19:30,095][36157] Sum rewards: 66.702, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.352', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon5': '0.076', 'AMMO4': '0.119', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon2': '0.226', 'WEAPON4': '0.250', 'weapon4': '0.266', 'WEAPON3': '1.200', 'weapon3': '3.218', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.022', 'FRAGCOUNT': '56.000'} [2023-02-25 14:19:30,376][36140] DAMAGECOUNT value on done: 950514.0 [2023-02-25 14:19:30,376][36140] Sum rewards: 47.683, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.002', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.184', 'weapon2': '0.204', 'AMMO3': '0.212', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.302', 'WEAPON3': '1.250', 'HITCOUNT': '2.520', 'weapon3': '3.102', 'DAMAGECOUNT': '12.384', 'FRAGCOUNT': '43.000'} [2023-02-25 14:19:30,683][36140] DAMAGECOUNT value on done: 934106.0 [2023-02-25 14:19:30,683][36140] Sum rewards: 55.906, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.254', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.042', 'AMMO3': '0.112', 'AMMO4': '0.208', 'weapon5': '0.228', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.410', 'weapon2': '0.588', 'WEAPON3': '0.700', 'HITCOUNT': '2.600', 'weapon3': '2.630', 'DAMAGECOUNT': '13.971', 'FRAGCOUNT': '44.500'} [2023-02-25 14:19:30,722][36140] DAMAGECOUNT value on done: 944893.0 [2023-02-25 14:19:30,723][36140] Sum rewards: 61.635, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.816', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.034', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'weapon2': '0.226', 'AMMO3': '0.251', 'WEAPON4': '0.350', 'weapon4': '0.628', 'WEAPON3': '1.450', 'weapon3': '2.762', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '55.000'} [2023-02-25 14:19:30,778][36157] DAMAGECOUNT value on done: 956073.0 [2023-02-25 14:19:30,779][36157] Sum rewards: 57.177, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-3.786', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon5': '0.250', 'weapon2': '0.262', 'AMMO4': '0.264', 'AMMO3': '0.298', 'WEAPON5': '0.500', 'weapon4': '0.510', 'WEAPON4': '0.600', 'WEAPON3': '1.650', 'weapon3': '2.560', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '55.000'} [2023-02-25 14:19:31,027][36140] DAMAGECOUNT value on done: 941909.0 [2023-02-25 14:19:31,028][36140] Sum rewards: 65.479, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.343', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.036', 'weapon5': '0.096', 'AMMO4': '0.178', 'weapon2': '0.212', 'AMMO3': '0.229', 'weapon4': '0.306', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.120', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.593', 'FRAGCOUNT': '59.000'} [2023-02-25 14:19:31,075][36157] DAMAGECOUNT value on done: 953375.0 [2023-02-25 14:19:31,076][36157] Sum rewards: 65.479, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.282', 'AMMO5': '0.016', 'AMMO2': '0.038', 'AMMO4': '0.191', 'AMMO3': '0.225', 'weapon2': '0.272', 'weapon5': '0.276', 'weapon4': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.814', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.639', 'FRAGCOUNT': '55.000'} [2023-02-25 14:19:31,359][36155] DAMAGECOUNT value on done: 941186.0 [2023-02-25 14:19:31,359][36155] Sum rewards: 61.694, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.338', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.196', 'weapon2': '0.380', 'WEAPON3': '1.200', 'HITCOUNT': '2.880', 'weapon3': '3.338', 'DAMAGECOUNT': '14.085', 'FRAGCOUNT': '55.000'} [2023-02-25 14:19:31,673][36155] DAMAGECOUNT value on done: 951547.0 [2023-02-25 14:19:31,674][36155] Sum rewards: 60.385, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.100', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.082', 'weapon2': '0.150', 'AMMO3': '0.270', 'WEAPON3': '1.550', 'HITCOUNT': '3.210', 'weapon3': '3.530', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '55.000'} [2023-02-25 14:19:32,462][36138] Updated weights for policy 0, policy_version 49963 (0.0010) [2023-02-25 14:19:32,636][36142] DAMAGECOUNT value on done: 949215.0 [2023-02-25 14:19:32,636][36142] Sum rewards: 48.024, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.670', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.180', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.444', 'weapon2': '0.656', 'WEAPON3': '1.150', 'weapon3': '2.486', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.174', 'FRAGCOUNT': '43.000'} [2023-02-25 14:19:32,824][36155] DAMAGECOUNT value on done: 960511.0 [2023-02-25 14:19:32,824][36155] Sum rewards: 69.607, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.982', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon2': '0.198', 'WEAPON4': '0.200', 'weapon4': '0.274', 'AMMO3': '0.310', 'WEAPON3': '1.800', 'weapon3': '3.286', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '63.000'} [2023-02-25 14:19:32,939][36142] DAMAGECOUNT value on done: 932504.0 [2023-02-25 14:19:32,939][36142] Sum rewards: 58.022, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.530', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.041', 'AMMO3': '0.168', 'AMMO4': '0.203', 'weapon5': '0.208', 'weapon2': '0.290', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon4': '0.620', 'WEAPON3': '1.150', 'weapon3': '2.582', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.922', 'FRAGCOUNT': '50.000'} [2023-02-25 14:19:33,142][36155] DAMAGECOUNT value on done: 945804.0 [2023-02-25 14:19:33,142][36155] Sum rewards: 58.484, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.842', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.040', 'AMMO3': '0.175', 'weapon2': '0.198', 'AMMO4': '0.198', 'weapon5': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.668', 'WEAPON3': '1.100', 'weapon3': '2.464', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.436', 'FRAGCOUNT': '51.000'} [2023-02-25 14:19:33,261][36142] DAMAGECOUNT value on done: 941873.0 [2023-02-25 14:19:33,262][36142] Sum rewards: 51.240, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.787', 'AMMO5': '0.017', 'AMMO2': '0.057', 'AMMO3': '0.176', 'AMMO4': '0.284', 'weapon5': '0.412', 'weapon2': '0.470', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon4': '0.622', 'WEAPON3': '1.050', 'weapon3': '2.140', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.099', 'FRAGCOUNT': '46.000'} [2023-02-25 14:19:33,441][36139] DAMAGECOUNT value on done: 947381.0 [2023-02-25 14:19:33,442][36139] Sum rewards: 61.318, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.075', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.197', 'weapon5': '0.204', 'weapon2': '0.286', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.588', 'WEAPON3': '1.200', 'weapon3': '2.682', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.976', 'FRAGCOUNT': '53.000'} [2023-02-25 14:19:33,553][36142] DAMAGECOUNT value on done: 960110.0 [2023-02-25 14:19:33,553][36142] Sum rewards: 69.281, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.295', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.032', 'weapon5': '0.056', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.216', 'AMMO3': '0.233', 'WEAPON3': '1.450', 'HITCOUNT': '3.320', 'weapon3': '3.500', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '60.000'} [2023-02-25 14:19:33,743][36139] DAMAGECOUNT value on done: 945702.0 [2023-02-25 14:19:33,743][36139] Sum rewards: 60.786, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.100', 'AMMO5': '0.009', 'AMMO2': '0.074', 'AMMO3': '0.177', 'weapon5': '0.190', 'WEAPON5': '0.200', 'AMMO4': '0.371', 'weapon2': '0.422', 'WEAPON4': '0.550', 'WEAPON3': '0.950', 'weapon4': '1.066', 'weapon3': '1.956', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.391', 'FRAGCOUNT': '54.000'} [2023-02-25 14:19:34,231][36139] DAMAGECOUNT value on done: 959973.0 [2023-02-25 14:19:34,231][36139] Sum rewards: 51.591, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.720', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO3': '0.230', 'weapon2': '0.514', 'WEAPON3': '1.400', 'HITCOUNT': '2.710', 'weapon3': '3.340', 'DAMAGECOUNT': '13.881', 'FRAGCOUNT': '44.000'} [2023-02-25 14:19:34,543][36139] DAMAGECOUNT value on done: 953807.0 [2023-02-25 14:19:34,544][36139] Sum rewards: 60.897, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.846', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.132', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.204', 'AMMO3': '0.217', 'weapon2': '0.414', 'WEAPON3': '1.250', 'weapon3': '3.086', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.054', 'FRAGCOUNT': '53.000'} [2023-02-25 14:19:34,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.2, 300 sec: 13412.7). Total num frames: 204677120. Throughput: 0: 3349.6. Samples: 13667018. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:19:34,730][36114] Avg episode reward: [(0, '57.375')] [2023-02-25 14:19:34,748][36156] DAMAGECOUNT value on done: 953817.0 [2023-02-25 14:19:34,748][36156] Sum rewards: 64.614, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.330', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon2': '0.224', 'AMMO3': '0.234', 'weapon5': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.484', 'WEAPON3': '1.450', 'weapon3': '2.708', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '56.000'} [2023-02-25 14:19:34,759][36156] DAMAGECOUNT value on done: 960186.0 [2023-02-25 14:19:34,760][36156] Sum rewards: 73.554, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.013', 'weapon4': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'weapon5': '0.080', 'AMMO3': '0.125', 'HEALTH': '0.176', 'weapon2': '0.650', 'WEAPON3': '0.800', 'weapon3': '3.108', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '58.000'} [2023-02-25 14:19:35,057][36156] DAMAGECOUNT value on done: 941929.0 [2023-02-25 14:19:35,058][36156] Sum rewards: 58.245, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.450', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'weapon5': '0.150', 'AMMO4': '0.188', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.448', 'weapon4': '0.564', 'WEAPON3': '1.350', 'weapon3': '2.494', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.766', 'FRAGCOUNT': '51.500'} [2023-02-25 14:19:35,068][36156] DAMAGECOUNT value on done: 948289.0 [2023-02-25 14:19:35,069][36156] Sum rewards: 58.268, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.992', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.064', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.278', 'AMMO3': '0.281', 'weapon4': '0.372', 'WEAPON3': '1.650', 'weapon3': '2.980', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.966', 'FRAGCOUNT': '53.000'} [2023-02-25 14:19:35,338][36157] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:19:35,531][36138] Updated weights for policy 0, policy_version 49973 (0.0009) [2023-02-25 14:19:38,588][36138] Updated weights for policy 0, policy_version 49983 (0.0010) [2023-02-25 14:19:39,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 204742656. Throughput: 0: 3352.4. Samples: 13677158. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:19:39,730][36114] Avg episode reward: [(0, '57.475')] [2023-02-25 14:19:41,639][36138] Updated weights for policy 0, policy_version 49993 (0.0009) [2023-02-25 14:19:44,726][36138] Updated weights for policy 0, policy_version 50003 (0.0009) [2023-02-25 14:19:44,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13426.6). Total num frames: 204812288. Throughput: 0: 3352.6. Samples: 13697300. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:19:44,730][36114] Avg episode reward: [(0, '57.475')] [2023-02-25 14:19:47,065][36154] DAMAGECOUNT value on done: 956343.0 [2023-02-25 14:19:47,066][36154] Sum rewards: 57.428, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.141', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon5': '0.114', 'weapon2': '0.162', 'AMMO3': '0.197', 'AMMO4': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.402', 'WEAPON3': '1.200', 'weapon3': '2.922', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.622', 'FRAGCOUNT': '50.000'} [2023-02-25 14:19:47,386][36154] DAMAGECOUNT value on done: 940993.0 [2023-02-25 14:19:47,386][36154] Sum rewards: 54.035, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.289', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.146', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.302', 'weapon2': '0.380', 'WEAPON3': '1.000', 'weapon3': '2.800', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.962', 'FRAGCOUNT': '45.000'} [2023-02-25 14:19:47,427][36154] DAMAGECOUNT value on done: 957315.0 [2023-02-25 14:19:47,427][36154] Sum rewards: 59.087, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.616', 'ARMOR': '0.004', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.012', 'AMMO4': '0.062', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.258', 'weapon2': '0.280', 'weapon4': '0.340', 'WEAPON3': '1.600', 'weapon3': '3.174', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.943', 'FRAGCOUNT': '54.000'} [2023-02-25 14:19:47,618][36141] DAMAGECOUNT value on done: 956982.0 [2023-02-25 14:19:47,619][36141] Sum rewards: 59.575, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.250', 'AMMO5': '0.009', 'AMMO2': '0.026', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'weapon5': '0.176', 'weapon4': '0.212', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'weapon2': '0.454', 'WEAPON3': '1.450', 'weapon3': '2.956', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.439', 'FRAGCOUNT': '53.500'} [2023-02-25 14:19:47,730][36154] DAMAGECOUNT value on done: 949090.0 [2023-02-25 14:19:47,730][36154] Sum rewards: 44.131, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.225', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.138', 'weapon2': '0.152', 'AMMO3': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.516', 'WEAPON3': '1.500', 'HITCOUNT': '2.670', 'weapon3': '2.896', 'DAMAGECOUNT': '13.977', 'FRAGCOUNT': '41.000'} [2023-02-25 14:19:47,857][36138] Updated weights for policy 0, policy_version 50013 (0.0009) [2023-02-25 14:19:47,940][36141] DAMAGECOUNT value on done: 956405.0 [2023-02-25 14:19:47,941][36141] Sum rewards: 58.928, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.754', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'weapon4': '0.046', 'AMMO4': '0.071', 'WEAPON4': '0.150', 'weapon5': '0.168', 'AMMO3': '0.203', 'weapon2': '0.266', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.940', 'weapon3': '3.240', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '50.000'} [2023-02-25 14:19:47,972][36141] DAMAGECOUNT value on done: 948019.0 [2023-02-25 14:19:47,972][36141] Sum rewards: 57.509, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.490', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.106', 'AMMO4': '0.112', 'weapon4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.232', 'WEAPON4': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '2.980', 'weapon3': '3.318', 'DAMAGECOUNT': '15.762', 'FRAGCOUNT': '49.000'} [2023-02-25 14:19:48,271][36141] DAMAGECOUNT value on done: 943767.0 [2023-02-25 14:19:48,272][36141] Sum rewards: 50.683, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.339', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon5': '0.216', 'AMMO3': '0.222', 'weapon2': '0.224', 'AMMO4': '0.251', 'WEAPON5': '0.400', 'weapon4': '0.544', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'HITCOUNT': '2.530', 'weapon3': '2.738', 'DAMAGECOUNT': '12.879', 'FRAGCOUNT': '50.000'} [2023-02-25 14:19:49,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 204877824. Throughput: 0: 3347.0. Samples: 13717184. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:19:49,730][36114] Avg episode reward: [(0, '57.310')] [2023-02-25 14:19:49,787][36157] DAMAGECOUNT value on done: 961880.0 [2023-02-25 14:19:49,788][36157] Sum rewards: 59.825, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.138', 'AMMO5': '0.012', 'AMMO2': '0.052', 'weapon5': '0.144', 'weapon2': '0.168', 'AMMO3': '0.183', 'AMMO4': '0.262', 'weapon4': '0.318', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.144', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.029', 'FRAGCOUNT': '51.500'} [2023-02-25 14:19:50,097][36157] DAMAGECOUNT value on done: 952187.0 [2023-02-25 14:19:50,098][36157] Sum rewards: 46.264, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.001', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.039', 'AMMO4': '0.193', 'AMMO3': '0.214', 'weapon5': '0.214', 'WEAPON5': '0.300', 'weapon4': '0.306', 'WEAPON4': '0.350', 'weapon2': '0.738', 'WEAPON3': '1.250', 'weapon3': '2.430', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '13.953', 'FRAGCOUNT': '42.000'} [2023-02-25 14:19:50,500][36140] DAMAGECOUNT value on done: 955227.0 [2023-02-25 14:19:50,501][36140] Sum rewards: 43.576, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.144', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.074', 'AMMO3': '0.196', 'weapon2': '0.226', 'weapon5': '0.370', 'AMMO4': '0.371', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'weapon4': '0.988', 'WEAPON3': '1.150', 'weapon3': '1.860', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '14.124', 'FRAGCOUNT': '39.500'} [2023-02-25 14:19:50,751][36157] DAMAGECOUNT value on done: 961253.0 [2023-02-25 14:19:50,752][36157] Sum rewards: 60.255, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.040', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.110', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon2': '0.202', 'WEAPON4': '0.300', 'weapon4': '0.408', 'WEAPON3': '1.200', 'weapon3': '3.056', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.540', 'FRAGCOUNT': '52.000'} [2023-02-25 14:19:50,820][36140] DAMAGECOUNT value on done: 938844.0 [2023-02-25 14:19:50,820][36140] Sum rewards: 58.972, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.699', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.054', 'weapon5': '0.228', 'AMMO3': '0.231', 'AMMO4': '0.271', 'WEAPON5': '0.350', 'weapon2': '0.458', 'weapon4': '0.472', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.496', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.214', 'FRAGCOUNT': '54.000'} [2023-02-25 14:19:50,867][36140] DAMAGECOUNT value on done: 950416.0 [2023-02-25 14:19:50,867][36140] Sum rewards: 60.189, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.156', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon2': '0.174', 'weapon5': '0.214', 'AMMO3': '0.220', 'AMMO4': '0.222', 'weapon4': '0.388', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.944', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '53.000'} [2023-02-25 14:19:50,898][36138] Updated weights for policy 0, policy_version 50023 (0.0009) [2023-02-25 14:19:51,059][36157] DAMAGECOUNT value on done: 957909.0 [2023-02-25 14:19:51,059][36157] Sum rewards: 51.417, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.760', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.064', 'AMMO4': '0.123', 'weapon2': '0.170', 'weapon4': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.269', 'WEAPON3': '1.550', 'HITCOUNT': '2.860', 'weapon3': '3.260', 'DAMAGECOUNT': '13.602', 'FRAGCOUNT': '48.000'} [2023-02-25 14:19:51,164][36140] DAMAGECOUNT value on done: 946234.0 [2023-02-25 14:19:51,164][36140] Sum rewards: 54.638, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.233', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.062', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.175', 'AMMO3': '0.181', 'weapon2': '0.312', 'weapon4': '0.504', 'WEAPON3': '1.100', 'weapon3': '2.822', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.975', 'FRAGCOUNT': '47.000'} [2023-02-25 14:19:51,530][36155] DAMAGECOUNT value on done: 946095.0 [2023-02-25 14:19:51,531][36155] Sum rewards: 57.583, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.542', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.189', 'AMMO3': '0.231', 'weapon2': '0.232', 'WEAPON4': '0.400', 'weapon4': '0.942', 'WEAPON3': '1.350', 'weapon3': '2.508', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '14.727', 'FRAGCOUNT': '51.000'} [2023-02-25 14:19:51,858][36155] DAMAGECOUNT value on done: 957359.0 [2023-02-25 14:19:51,858][36155] Sum rewards: 73.326, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.989', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon4': '0.032', 'WEAPON4': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.174', 'weapon5': '0.186', 'WEAPON5': '0.200', 'weapon2': '0.454', 'WEAPON3': '1.200', 'weapon3': '3.054', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '61.000'} [2023-02-25 14:19:52,829][36155] DAMAGECOUNT value on done: 965681.0 [2023-02-25 14:19:52,830][36155] Sum rewards: 61.860, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.155', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.132', 'weapon2': '0.194', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.368', 'WEAPON3': '1.200', 'weapon3': '3.034', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '53.000'} [2023-02-25 14:19:52,905][36142] DAMAGECOUNT value on done: 953870.0 [2023-02-25 14:19:52,905][36142] Sum rewards: 53.069, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.410', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.230', 'weapon4': '0.260', 'weapon2': '0.322', 'WEAPON3': '1.450', 'HITCOUNT': '2.940', 'weapon3': '3.166', 'DAMAGECOUNT': '13.965', 'FRAGCOUNT': '48.000'} [2023-02-25 14:19:53,129][36155] DAMAGECOUNT value on done: 950466.0 [2023-02-25 14:19:53,130][36155] Sum rewards: 59.922, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.237', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.136', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon2': '0.338', 'weapon4': '0.538', 'WEAPON3': '1.200', 'weapon3': '2.864', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.986', 'FRAGCOUNT': '52.000'} [2023-02-25 14:19:53,224][36142] DAMAGECOUNT value on done: 937415.0 [2023-02-25 14:19:53,224][36142] Sum rewards: 55.383, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.627', 'AMMO5': '0.005', 'AMMO2': '0.052', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.186', 'AMMO4': '0.262', 'weapon2': '0.526', 'WEAPON4': '0.600', 'weapon4': '0.612', 'WEAPON3': '1.100', 'weapon3': '2.606', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.733', 'FRAGCOUNT': '49.000'} [2023-02-25 14:19:53,384][36139] DAMAGECOUNT value on done: 952642.0 [2023-02-25 14:19:53,385][36139] Sum rewards: 64.345, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.049', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon4': '0.246', 'weapon2': '0.262', 'WEAPON3': '1.200', 'weapon3': '3.270', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.783', 'FRAGCOUNT': '55.000'} [2023-02-25 14:19:53,550][36142] DAMAGECOUNT value on done: 946929.0 [2023-02-25 14:19:53,551][36142] Sum rewards: 60.677, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.740', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.042', 'AMMO3': '0.166', 'AMMO4': '0.212', 'weapon5': '0.226', 'weapon2': '0.398', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.606', 'WEAPON3': '1.050', 'weapon3': '2.440', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.168', 'FRAGCOUNT': '52.000'} [2023-02-25 14:19:53,698][36139] DAMAGECOUNT value on done: 950552.0 [2023-02-25 14:19:53,699][36139] Sum rewards: 55.655, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.134', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon5': '0.056', 'AMMO3': '0.175', 'AMMO4': '0.189', 'WEAPON5': '0.250', 'weapon2': '0.358', 'WEAPON4': '0.450', 'weapon4': '0.592', 'WEAPON3': '1.050', 'weapon3': '2.678', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '14.550', 'FRAGCOUNT': '49.000'} [2023-02-25 14:19:53,786][36139] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:19:53,853][36142] DAMAGECOUNT value on done: 964091.0 [2023-02-25 14:19:53,854][36142] Sum rewards: 42.608, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.380', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.046', 'weapon5': '0.134', 'AMMO4': '0.230', 'AMMO3': '0.258', 'WEAPON5': '0.300', 'weapon4': '0.332', 'weapon2': '0.336', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.700', 'weapon3': '2.828', 'DAMAGECOUNT': '11.943', 'FRAGCOUNT': '42.000'} [2023-02-25 14:19:53,977][36138] Updated weights for policy 0, policy_version 50033 (0.0009) [2023-02-25 14:19:54,159][36139] DAMAGECOUNT value on done: 964949.0 [2023-02-25 14:19:54,160][36139] Sum rewards: 51.507, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.509', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon2': '0.196', 'AMMO4': '0.205', 'AMMO3': '0.217', 'weapon5': '0.238', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.680', 'WEAPON3': '1.250', 'weapon3': '2.626', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.928', 'FRAGCOUNT': '45.500'} [2023-02-25 14:19:54,464][36139] DAMAGECOUNT value on done: 957856.0 [2023-02-25 14:19:54,464][36139] Sum rewards: 41.302, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.370', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.055', 'AMMO3': '0.174', 'weapon5': '0.224', 'weapon2': '0.226', 'AMMO4': '0.274', 'WEAPON5': '0.400', 'WEAPON4': '0.750', 'weapon4': '0.768', 'WEAPON3': '1.100', 'weapon3': '2.416', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '11.646', 'FRAGCOUNT': '39.000'} [2023-02-25 14:19:54,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 204943360. Throughput: 0: 3350.0. Samples: 13727218. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:19:54,730][36114] Avg episode reward: [(0, '56.786')] [2023-02-25 14:19:54,779][36156] DAMAGECOUNT value on done: 959077.0 [2023-02-25 14:19:54,779][36156] Sum rewards: 64.289, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.934', 'AMMO5': '0.017', 'AMMO2': '0.026', 'weapon5': '0.066', 'AMMO4': '0.131', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.394', 'weapon2': '0.418', 'WEAPON3': '1.400', 'weapon3': '2.776', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.780', 'FRAGCOUNT': '57.000'} [2023-02-25 14:19:54,790][36156] DAMAGECOUNT value on done: 965198.0 [2023-02-25 14:19:54,791][36156] Sum rewards: 57.727, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.064', 'ARMOR': '0.004', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'weapon4': '0.132', 'AMMO4': '0.149', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon5': '0.222', 'weapon2': '0.236', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '2.800', 'weapon3': '3.058', 'DAMAGECOUNT': '15.036', 'FRAGCOUNT': '48.000'} [2023-02-25 14:19:55,088][36156] DAMAGECOUNT value on done: 946921.0 [2023-02-25 14:19:55,089][36156] Sum rewards: 62.167, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.870', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon2': '0.206', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'weapon4': '0.370', 'WEAPON3': '1.450', 'weapon3': '3.200', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.976', 'FRAGCOUNT': '56.000'} [2023-02-25 14:19:55,099][36156] DAMAGECOUNT value on done: 953621.0 [2023-02-25 14:19:55,100][36156] Sum rewards: 59.530, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.002', 'AMMO5': '0.017', 'AMMO2': '0.032', 'weapon5': '0.154', 'AMMO4': '0.161', 'weapon4': '0.222', 'AMMO3': '0.229', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.484', 'WEAPON3': '1.450', 'weapon3': '2.896', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '53.000'} [2023-02-25 14:19:57,003][36138] Updated weights for policy 0, policy_version 50043 (0.0009) [2023-02-25 14:19:59,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 205012992. Throughput: 0: 3352.4. Samples: 13747432. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:19:59,729][36114] Avg episode reward: [(0, '56.772')] [2023-02-25 14:20:00,029][36138] Updated weights for policy 0, policy_version 50053 (0.0010) [2023-02-25 14:20:03,050][36138] Updated weights for policy 0, policy_version 50063 (0.0009) [2023-02-25 14:20:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 205078528. Throughput: 0: 3352.1. Samples: 13767578. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:20:04,730][36114] Avg episode reward: [(0, '56.772')] [2023-02-25 14:20:06,080][36138] Updated weights for policy 0, policy_version 50073 (0.0009) [2023-02-25 14:20:07,043][36154] DAMAGECOUNT value on done: 960594.0 [2023-02-25 14:20:07,043][36154] Sum rewards: 51.487, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.767', 'AMMO5': '0.011', 'AMMO2': '0.034', 'AMMO4': '0.171', 'weapon5': '0.176', 'AMMO3': '0.206', 'weapon2': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.740', 'WEAPON3': '1.200', 'HITCOUNT': '2.570', 'weapon3': '2.620', 'DAMAGECOUNT': '12.753', 'FRAGCOUNT': '47.000'} [2023-02-25 14:20:07,298][36154] DAMAGECOUNT value on done: 963167.0 [2023-02-25 14:20:07,298][36154] Sum rewards: 63.991, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.590', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.122', 'AMMO3': '0.216', 'weapon2': '0.232', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.466', 'WEAPON3': '1.350', 'weapon3': '2.932', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.556', 'FRAGCOUNT': '54.500'} [2023-02-25 14:20:07,356][36154] DAMAGECOUNT value on done: 946142.0 [2023-02-25 14:20:07,357][36154] Sum rewards: 56.143, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.966', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.030', 'AMMO4': '0.151', 'AMMO3': '0.218', 'weapon5': '0.300', 'weapon2': '0.334', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.598', 'WEAPON3': '1.200', 'weapon3': '2.396', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '15.327', 'FRAGCOUNT': '48.000'} [2023-02-25 14:20:07,623][36154] DAMAGECOUNT value on done: 954592.0 [2023-02-25 14:20:07,623][36154] Sum rewards: 64.557, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.472', 'AMMO5': '0.014', 'AMMO2': '0.030', 'AMMO4': '0.147', 'weapon5': '0.156', 'AMMO3': '0.166', 'weapon2': '0.190', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.422', 'WEAPON3': '1.100', 'weapon3': '2.948', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.506', 'FRAGCOUNT': '55.000'} [2023-02-25 14:20:07,692][36141] DAMAGECOUNT value on done: 962522.0 [2023-02-25 14:20:07,692][36141] Sum rewards: 63.021, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-0.190', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon5': '0.154', 'AMMO3': '0.218', 'AMMO4': '0.222', 'WEAPON5': '0.300', 'weapon2': '0.362', 'weapon4': '0.410', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.756', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '56.000'} [2023-02-25 14:20:08,001][36141] DAMAGECOUNT value on done: 960945.0 [2023-02-25 14:20:08,001][36141] Sum rewards: 50.743, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.320', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.148', 'weapon4': '0.196', 'WEAPON4': '0.200', 'weapon2': '0.268', 'AMMO3': '0.291', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'HITCOUNT': '2.800', 'weapon3': '3.110', 'DAMAGECOUNT': '13.620', 'FRAGCOUNT': '47.000'} [2023-02-25 14:20:08,036][36141] DAMAGECOUNT value on done: 953264.0 [2023-02-25 14:20:08,036][36141] Sum rewards: 66.505, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.940', 'AMMO5': '0.011', 'AMMO2': '0.031', 'AMMO4': '0.156', 'AMMO3': '0.159', 'weapon5': '0.190', 'weapon4': '0.194', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.134', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.735', 'FRAGCOUNT': '56.500'} [2023-02-25 14:20:08,337][36141] DAMAGECOUNT value on done: 948099.0 [2023-02-25 14:20:08,338][36141] Sum rewards: 45.446, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.050', 'ARMOR': '0.008', 'AMMO5': '0.012', 'weapon5': '0.054', 'AMMO2': '0.068', 'AMMO3': '0.241', 'weapon2': '0.294', 'WEAPON5': '0.300', 'AMMO4': '0.341', 'WEAPON4': '0.550', 'weapon4': '0.860', 'WEAPON3': '1.350', 'weapon3': '2.518', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.789', 'FRAGCOUNT': '44.000'} [2023-02-25 14:20:09,164][36138] Updated weights for policy 0, policy_version 50083 (0.0009) [2023-02-25 14:20:09,729][36114] Fps is (10 sec: 13106.9, 60 sec: 13380.2, 300 sec: 13412.7). Total num frames: 205144064. Throughput: 0: 3348.9. Samples: 13777540. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:20:09,730][36114] Avg episode reward: [(0, '56.968')] [2023-02-25 14:20:09,889][36157] DAMAGECOUNT value on done: 967195.0 [2023-02-25 14:20:09,889][36157] Sum rewards: 65.423, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.964', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.112', 'weapon5': '0.156', 'AMMO3': '0.249', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON4': '0.400', 'weapon4': '0.442', 'WEAPON3': '1.500', 'weapon3': '2.756', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.945', 'FRAGCOUNT': '60.000'} [2023-02-25 14:20:10,207][36157] DAMAGECOUNT value on done: 957786.0 [2023-02-25 14:20:10,208][36157] Sum rewards: 65.460, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.715', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.054', 'AMMO4': '0.080', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.222', 'weapon2': '0.348', 'WEAPON3': '1.250', 'weapon3': '3.200', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.797', 'FRAGCOUNT': '55.000'} [2023-02-25 14:20:10,566][36140] DAMAGECOUNT value on done: 960203.0 [2023-02-25 14:20:10,566][36140] Sum rewards: 56.132, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.078', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.067', 'weapon5': '0.090', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'weapon4': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.522', 'WEAPON3': '0.950', 'weapon3': '2.994', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.928', 'FRAGCOUNT': '46.500'} [2023-02-25 14:20:10,898][36140] DAMAGECOUNT value on done: 944043.0 [2023-02-25 14:20:10,899][36140] Sum rewards: 60.455, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.250', 'AMMO2': '0.021', 'AMMO5': '0.025', 'AMMO4': '0.102', 'weapon2': '0.148', 'AMMO3': '0.200', 'weapon5': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.606', 'WEAPON3': '1.250', 'weapon3': '2.618', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '53.000'} [2023-02-25 14:20:10,906][36157] DAMAGECOUNT value on done: 966394.0 [2023-02-25 14:20:10,907][36157] Sum rewards: 56.303, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.690', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon2': '0.160', 'weapon5': '0.184', 'AMMO3': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.416', 'WEAPON3': '1.550', 'weapon3': '2.796', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '15.108', 'FRAGCOUNT': '51.000'} [2023-02-25 14:20:10,940][36140] DAMAGECOUNT value on done: 955770.0 [2023-02-25 14:20:10,941][36140] Sum rewards: 60.010, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.480', 'AMMO5': '0.011', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.150', 'weapon2': '0.156', 'WEAPON4': '0.250', 'AMMO3': '0.267', 'weapon4': '0.298', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.102', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.062', 'FRAGCOUNT': '54.000'} [2023-02-25 14:20:11,224][36157] DAMAGECOUNT value on done: 962188.0 [2023-02-25 14:20:11,225][36157] Sum rewards: 47.845, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.254', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.162', 'AMMO3': '0.217', 'WEAPON5': '0.300', 'weapon4': '0.348', 'WEAPON4': '0.350', 'weapon2': '0.436', 'WEAPON3': '1.250', 'weapon3': '2.752', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '12.837', 'FRAGCOUNT': '43.000'} [2023-02-25 14:20:11,248][36140] DAMAGECOUNT value on done: 951029.0 [2023-02-25 14:20:11,248][36140] Sum rewards: 58.154, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.957', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'weapon4': '0.522', 'weapon2': '0.572', 'WEAPON3': '1.050', 'weapon3': '2.788', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.385', 'FRAGCOUNT': '48.000'} [2023-02-25 14:20:11,636][36155] DAMAGECOUNT value on done: 950279.0 [2023-02-25 14:20:11,637][36155] Sum rewards: 47.347, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.088', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.098', 'AMMO4': '0.113', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'weapon5': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.636', 'WEAPON3': '0.900', 'HITCOUNT': '2.470', 'weapon3': '2.820', 'DAMAGECOUNT': '12.552', 'FRAGCOUNT': '39.000'} [2023-02-25 14:20:11,899][36140] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:20:11,946][36155] DAMAGECOUNT value on done: 962626.0 [2023-02-25 14:20:11,947][36155] Sum rewards: 65.332, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.877', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.030', 'weapon2': '0.134', 'AMMO4': '0.150', 'weapon5': '0.162', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.534', 'WEAPON3': '1.250', 'weapon3': '2.898', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '55.000'} [2023-02-25 14:20:12,239][36138] Updated weights for policy 0, policy_version 50093 (0.0009) [2023-02-25 14:20:12,905][36155] DAMAGECOUNT value on done: 970102.0 [2023-02-25 14:20:12,905][36155] Sum rewards: 49.131, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.570', 'AMMO5': '0.011', 'AMMO2': '0.037', 'AMMO3': '0.181', 'AMMO4': '0.187', 'weapon2': '0.198', 'weapon5': '0.214', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.530', 'WEAPON3': '1.050', 'HITCOUNT': '2.690', 'weapon3': '2.740', 'DAMAGECOUNT': '13.263', 'FRAGCOUNT': '44.500'} [2023-02-25 14:20:13,047][36142] DAMAGECOUNT value on done: 958856.0 [2023-02-25 14:20:13,048][36142] Sum rewards: 47.970, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-2.614', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon5': '0.146', 'AMMO4': '0.205', 'weapon2': '0.262', 'WEAPON5': '0.300', 'AMMO3': '0.303', 'WEAPON4': '0.450', 'weapon4': '0.488', 'WEAPON3': '1.750', 'weapon3': '2.710', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.958', 'FRAGCOUNT': '47.000'} [2023-02-25 14:20:13,211][36155] DAMAGECOUNT value on done: 955935.0 [2023-02-25 14:20:13,211][36155] Sum rewards: 66.605, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.378', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.102', 'AMMO3': '0.150', 'weapon5': '0.162', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.318', 'weapon4': '0.566', 'WEAPON3': '0.950', 'weapon3': '2.730', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '54.000'} [2023-02-25 14:20:13,362][36142] DAMAGECOUNT value on done: 942221.0 [2023-02-25 14:20:13,362][36142] Sum rewards: 65.240, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.595', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.143', 'AMMO3': '0.145', 'weapon5': '0.156', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.460', 'weapon4': '0.618', 'WEAPON3': '0.900', 'weapon3': '2.484', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '14.418', 'FRAGCOUNT': '56.000'} [2023-02-25 14:20:13,383][36139] DAMAGECOUNT value on done: 957164.0 [2023-02-25 14:20:13,384][36139] Sum rewards: 55.368, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.624', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.078', 'AMMO4': '0.142', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.220', 'WEAPON4': '0.400', 'weapon4': '0.492', 'WEAPON3': '1.300', 'HITCOUNT': '2.870', 'weapon3': '3.014', 'DAMAGECOUNT': '13.269', 'FRAGCOUNT': '50.000'} [2023-02-25 14:20:13,690][36142] DAMAGECOUNT value on done: 952204.0 [2023-02-25 14:20:13,691][36142] Sum rewards: 62.736, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.720', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.176', 'AMMO3': '0.197', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.308', 'weapon4': '0.478', 'WEAPON3': '1.250', 'weapon3': '2.790', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.825', 'FRAGCOUNT': '54.500'} [2023-02-25 14:20:13,693][36139] DAMAGECOUNT value on done: 956152.0 [2023-02-25 14:20:13,693][36139] Sum rewards: 63.305, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.620', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.144', 'AMMO4': '0.203', 'AMMO3': '0.222', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.314', 'weapon4': '0.578', 'WEAPON3': '1.200', 'weapon3': '2.710', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '53.500'} [2023-02-25 14:20:14,001][36142] DAMAGECOUNT value on done: 968976.0 [2023-02-25 14:20:14,001][36142] Sum rewards: 53.885, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.170', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.136', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'weapon4': '0.292', 'WEAPON4': '0.350', 'weapon2': '0.478', 'WEAPON3': '1.400', 'weapon3': '2.826', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.643', 'FRAGCOUNT': '49.000'} [2023-02-25 14:20:14,131][36139] DAMAGECOUNT value on done: 970650.0 [2023-02-25 14:20:14,132][36139] Sum rewards: 65.889, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.475', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.050', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.152', 'AMMO3': '0.338', 'weapon4': '0.340', 'WEAPON3': '2.000', 'weapon3': '3.162', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.073', 'FRAGCOUNT': '62.000'} [2023-02-25 14:20:14,431][36139] DAMAGECOUNT value on done: 962638.0 [2023-02-25 14:20:14,432][36139] Sum rewards: 51.872, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.937', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.084', 'AMMO4': '0.143', 'AMMO3': '0.294', 'WEAPON5': '0.300', 'weapon4': '0.354', 'weapon2': '0.378', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'weapon3': '2.726', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.280', 'FRAGCOUNT': '50.000'} [2023-02-25 14:20:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 205213696. Throughput: 0: 3348.6. Samples: 13797548. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:20:14,729][36114] Avg episode reward: [(0, '57.562')] [2023-02-25 14:20:14,892][36156] DAMAGECOUNT value on done: 964715.0 [2023-02-25 14:20:14,892][36156] Sum rewards: 69.404, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.520', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon5': '0.068', 'AMMO4': '0.084', 'WEAPON4': '0.150', 'weapon4': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.222', 'WEAPON3': '1.300', 'weapon3': '3.306', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '59.000'} [2023-02-25 14:20:14,902][36156] DAMAGECOUNT value on done: 969737.0 [2023-02-25 14:20:14,902][36156] Sum rewards: 56.291, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.130', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon5': '0.138', 'AMMO4': '0.158', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'weapon4': '0.254', 'WEAPON4': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.200', 'weapon3': '3.022', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.617', 'FRAGCOUNT': '50.000'} [2023-02-25 14:20:15,203][36156] DAMAGECOUNT value on done: 950847.0 [2023-02-25 14:20:15,204][36156] Sum rewards: 49.734, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.193', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.123', 'weapon5': '0.236', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.502', 'WEAPON3': '0.800', 'weapon4': '0.968', 'weapon3': '2.046', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '11.778', 'FRAGCOUNT': '41.000'} [2023-02-25 14:20:15,214][36156] DAMAGECOUNT value on done: 958489.0 [2023-02-25 14:20:15,214][36156] Sum rewards: 58.180, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.744', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.104', 'weapon2': '0.146', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.212', 'WEAPON3': '1.150', 'HITCOUNT': '2.700', 'weapon3': '3.288', 'DAMAGECOUNT': '14.604', 'FRAGCOUNT': '49.500'} [2023-02-25 14:20:15,302][36138] Updated weights for policy 0, policy_version 50103 (0.0009) [2023-02-25 14:20:18,328][36138] Updated weights for policy 0, policy_version 50113 (0.0009) [2023-02-25 14:20:19,729][36114] Fps is (10 sec: 13517.0, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 205279232. Throughput: 0: 3350.3. Samples: 13817780. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:20:19,730][36114] Avg episode reward: [(0, '57.480')] [2023-02-25 14:20:21,399][36138] Updated weights for policy 0, policy_version 50123 (0.0009) [2023-02-25 14:20:24,375][36138] Updated weights for policy 0, policy_version 50133 (0.0009) [2023-02-25 14:20:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13426.6). Total num frames: 205348864. Throughput: 0: 3348.0. Samples: 13827820. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:20:24,729][36114] Avg episode reward: [(0, '57.480')] [2023-02-25 14:20:26,952][36154] DAMAGECOUNT value on done: 966341.0 [2023-02-25 14:20:26,953][36154] Sum rewards: 69.951, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.382', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.048', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.186', 'WEAPON4': '0.300', 'weapon2': '0.484', 'weapon4': '0.504', 'WEAPON3': '1.100', 'weapon3': '2.766', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '59.000'} [2023-02-25 14:20:27,208][36154] DAMAGECOUNT value on done: 968830.0 [2023-02-25 14:20:27,208][36154] Sum rewards: 69.082, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.325', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.044', 'weapon5': '0.128', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.208', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '3.350', 'weapon3': '3.374', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '60.000'} [2023-02-25 14:20:27,260][36154] DAMAGECOUNT value on done: 951312.0 [2023-02-25 14:20:27,261][36154] Sum rewards: 58.985, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.518', 'AMMO5': '0.013', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon5': '0.188', 'AMMO3': '0.265', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.446', 'ARMOR': '0.457', 'weapon4': '0.896', 'WEAPON3': '1.500', 'weapon3': '2.122', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '53.000'} [2023-02-25 14:20:27,422][36138] Updated weights for policy 0, policy_version 50143 (0.0009) [2023-02-25 14:20:27,526][36154] DAMAGECOUNT value on done: 959949.0 [2023-02-25 14:20:27,527][36154] Sum rewards: 66.699, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.250', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.150', 'weapon4': '0.160', 'AMMO3': '0.167', 'weapon2': '0.190', 'WEAPON3': '1.100', 'HITCOUNT': '3.280', 'weapon3': '3.318', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '56.000'} [2023-02-25 14:20:27,602][36141] DAMAGECOUNT value on done: 967471.0 [2023-02-25 14:20:27,603][36141] Sum rewards: 60.124, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.292', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO3': '0.121', 'AMMO4': '0.150', 'weapon5': '0.184', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.446', 'weapon4': '0.722', 'WEAPON3': '0.850', 'weapon3': '2.388', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.847', 'FRAGCOUNT': '49.000'} [2023-02-25 14:20:27,901][36141] DAMAGECOUNT value on done: 957640.0 [2023-02-25 14:20:27,901][36141] Sum rewards: 46.838, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.365', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon5': '0.172', 'AMMO4': '0.175', 'AMMO3': '0.196', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.456', 'WEAPON3': '1.150', 'weapon3': '2.736', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.128', 'FRAGCOUNT': '41.500'} [2023-02-25 14:20:27,911][36141] DAMAGECOUNT value on done: 966703.0 [2023-02-25 14:20:27,911][36141] Sum rewards: 64.299, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.610', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.136', 'AMMO4': '0.192', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.312', 'weapon4': '0.494', 'WEAPON3': '1.400', 'weapon3': '2.814', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '55.000'} [2023-02-25 14:20:28,221][36141] DAMAGECOUNT value on done: 953576.0 [2023-02-25 14:20:28,221][36141] Sum rewards: 56.013, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.352', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.106', 'weapon4': '0.110', 'AMMO3': '0.243', 'weapon2': '0.356', 'WEAPON3': '1.350', 'HITCOUNT': '3.070', 'weapon3': '3.174', 'DAMAGECOUNT': '16.431', 'FRAGCOUNT': '47.000'} [2023-02-25 14:20:29,693][36157] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:20:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.2, 300 sec: 13412.7). Total num frames: 205414400. Throughput: 0: 3351.2. Samples: 13848102. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:20:29,730][36114] Avg episode reward: [(0, '57.912')] [2023-02-25 14:20:29,733][36125] Saving new best policy, reward=57.912! [2023-02-25 14:20:29,937][36157] DAMAGECOUNT value on done: 972239.0 [2023-02-25 14:20:29,937][36157] Sum rewards: 46.836, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-4.785', 'AMMO5': '0.030', 'AMMO2': '0.045', 'AMMO4': '0.223', 'weapon2': '0.260', 'AMMO3': '0.281', 'weapon5': '0.292', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'weapon4': '0.878', 'WEAPON3': '1.600', 'weapon3': '2.140', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.132', 'FRAGCOUNT': '46.500'} [2023-02-25 14:20:30,240][36157] DAMAGECOUNT value on done: 962738.0 [2023-02-25 14:20:30,240][36157] Sum rewards: 60.282, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.444', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.020', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'weapon2': '0.322', 'weapon4': '0.396', 'WEAPON3': '1.150', 'HITCOUNT': '2.920', 'weapon3': '2.922', 'DAMAGECOUNT': '14.856', 'FRAGCOUNT': '50.000'} [2023-02-25 14:20:30,476][36138] Updated weights for policy 0, policy_version 50153 (0.0010) [2023-02-25 14:20:30,525][36140] DAMAGECOUNT value on done: 964914.0 [2023-02-25 14:20:30,525][36140] Sum rewards: 54.354, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.743', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.094', 'weapon4': '0.136', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.446', 'WEAPON3': '1.350', 'HITCOUNT': '3.000', 'weapon3': '3.118', 'DAMAGECOUNT': '14.133', 'FRAGCOUNT': '48.000'} [2023-02-25 14:20:30,842][36140] DAMAGECOUNT value on done: 949599.0 [2023-02-25 14:20:30,842][36140] Sum rewards: 63.143, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.158', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.080', 'AMMO4': '0.112', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon2': '0.246', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon4': '0.448', 'WEAPON3': '1.350', 'weapon3': '3.004', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '54.000'} [2023-02-25 14:20:30,884][36140] DAMAGECOUNT value on done: 961265.0 [2023-02-25 14:20:30,884][36140] Sum rewards: 62.287, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.854', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.027', 'weapon5': '0.116', 'AMMO4': '0.134', 'weapon4': '0.198', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'weapon2': '0.320', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.102', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '56.000'} [2023-02-25 14:20:30,916][36157] DAMAGECOUNT value on done: 971721.0 [2023-02-25 14:20:30,917][36157] Sum rewards: 59.278, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.804', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon2': '0.172', 'AMMO4': '0.181', 'weapon5': '0.214', 'AMMO3': '0.248', 'weapon4': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.920', 'weapon3': '3.034', 'DAMAGECOUNT': '15.981', 'FRAGCOUNT': '54.000'} [2023-02-25 14:20:31,192][36140] DAMAGECOUNT value on done: 955520.0 [2023-02-25 14:20:31,192][36140] Sum rewards: 49.199, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.490', 'AMMO5': '0.026', 'AMMO2': '0.067', 'AMMO3': '0.166', 'weapon5': '0.246', 'AMMO4': '0.337', 'weapon4': '0.374', 'weapon2': '0.428', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.050', 'HITCOUNT': '2.570', 'weapon3': '2.652', 'DAMAGECOUNT': '13.473', 'FRAGCOUNT': '42.500'} [2023-02-25 14:20:31,205][36157] DAMAGECOUNT value on done: 966914.0 [2023-02-25 14:20:31,205][36157] Sum rewards: 58.094, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.307', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.047', 'AMMO3': '0.114', 'AMMO4': '0.234', 'weapon5': '0.286', 'weapon2': '0.392', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.556', 'WEAPON3': '0.750', 'weapon3': '2.484', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '14.178', 'FRAGCOUNT': '48.000'} [2023-02-25 14:20:31,493][36155] DAMAGECOUNT value on done: 955069.0 [2023-02-25 14:20:31,493][36155] Sum rewards: 56.904, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.920', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.218', 'weapon4': '0.236', 'AMMO3': '0.251', 'weapon2': '0.254', 'WEAPON3': '1.550', 'HITCOUNT': '2.990', 'weapon3': '3.034', 'DAMAGECOUNT': '14.370', 'FRAGCOUNT': '53.000'} [2023-02-25 14:20:31,816][36155] DAMAGECOUNT value on done: 966847.0 [2023-02-25 14:20:31,817][36155] Sum rewards: 45.521, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.462', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.030', 'AMMO3': '0.144', 'AMMO4': '0.148', 'weapon2': '0.288', 'weapon5': '0.306', 'WEAPON4': '0.400', 'weapon4': '0.410', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'HITCOUNT': '2.500', 'weapon3': '2.678', 'DAMAGECOUNT': '12.552', 'FRAGCOUNT': '38.000'} [2023-02-25 14:20:31,883][36155] Large shaping reward 2.566 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.561, 187.0), ('HEALTH', -0.027, -9.0), ('weapon5', 0.002)] [2023-02-25 14:20:32,763][36155] DAMAGECOUNT value on done: 975743.0 [2023-02-25 14:20:32,763][36155] Sum rewards: 68.999, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.056', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.050', 'AMMO4': '0.062', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'weapon4': '0.186', 'weapon2': '0.206', 'WEAPON3': '1.150', 'HITCOUNT': '3.380', 'weapon3': '3.400', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '57.000'} [2023-02-25 14:20:33,069][36155] DAMAGECOUNT value on done: 959594.0 [2023-02-25 14:20:33,070][36155] Sum rewards: 42.199, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.924', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.106', 'AMMO4': '0.128', 'AMMO3': '0.145', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.702', 'weapon2': '0.768', 'WEAPON3': '0.800', 'weapon3': '1.754', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '10.977', 'FRAGCOUNT': '34.000'} [2023-02-25 14:20:33,111][36142] DAMAGECOUNT value on done: 964633.0 [2023-02-25 14:20:33,111][36142] Sum rewards: 67.686, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.510', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.220', 'weapon2': '0.254', 'AMMO3': '0.260', 'WEAPON3': '1.500', 'weapon3': '3.180', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.331', 'FRAGCOUNT': '59.000'} [2023-02-25 14:20:33,291][36139] DAMAGECOUNT value on done: 961952.0 [2023-02-25 14:20:33,292][36139] Sum rewards: 50.578, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.528', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.036', 'AMMO4': '0.179', 'weapon2': '0.188', 'weapon5': '0.192', 'AMMO3': '0.212', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.532', 'WEAPON3': '1.200', 'weapon3': '2.684', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '14.364', 'FRAGCOUNT': '45.500'} [2023-02-25 14:20:33,427][36142] DAMAGECOUNT value on done: 946313.0 [2023-02-25 14:20:33,427][36142] Sum rewards: 41.819, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.470', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.066', 'AMMO4': '0.159', 'WEAPON5': '0.200', 'weapon2': '0.292', 'AMMO3': '0.293', 'WEAPON4': '0.400', 'weapon4': '0.630', 'WEAPON3': '1.700', 'HITCOUNT': '2.600', 'weapon3': '2.630', 'DAMAGECOUNT': '12.276', 'FRAGCOUNT': '43.000'} [2023-02-25 14:20:33,556][36138] Updated weights for policy 0, policy_version 50163 (0.0009) [2023-02-25 14:20:33,616][36139] DAMAGECOUNT value on done: 961790.0 [2023-02-25 14:20:33,616][36139] Sum rewards: 62.139, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.528', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon4': '0.170', 'weapon5': '0.194', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.250', 'weapon3': '3.066', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '52.000'} [2023-02-25 14:20:33,717][36142] DAMAGECOUNT value on done: 956840.0 [2023-02-25 14:20:33,718][36142] Sum rewards: 49.319, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-2.038', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.067', 'weapon5': '0.218', 'AMMO3': '0.228', 'weapon4': '0.280', 'AMMO4': '0.335', 'weapon2': '0.462', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.400', 'weapon3': '2.644', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.824', 'FRAGCOUNT': '48.500'} [2023-02-25 14:20:33,995][36142] DAMAGECOUNT value on done: 973355.0 [2023-02-25 14:20:33,995][36142] Sum rewards: 55.258, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.695', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.011', 'weapon5': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'weapon4': '0.156', 'AMMO3': '0.220', 'weapon2': '0.256', 'WEAPON3': '1.200', 'HITCOUNT': '2.880', 'weapon3': '3.362', 'DAMAGECOUNT': '13.137', 'FRAGCOUNT': '48.000'} [2023-02-25 14:20:34,005][36139] DAMAGECOUNT value on done: 976057.0 [2023-02-25 14:20:34,006][36139] Sum rewards: 66.631, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.404', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon5': '0.058', 'AMMO4': '0.104', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.498', 'weapon4': '0.752', 'WEAPON3': '1.100', 'weapon3': '2.466', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '16.221', 'FRAGCOUNT': '55.000'} [2023-02-25 14:20:34,302][36139] DAMAGECOUNT value on done: 966945.0 [2023-02-25 14:20:34,302][36139] Sum rewards: 53.089, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.140', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.066', 'AMMO4': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'WEAPON4': '0.250', 'weapon4': '0.396', 'weapon2': '0.580', 'WEAPON3': '1.000', 'weapon3': '2.764', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.921', 'FRAGCOUNT': '45.000'} [2023-02-25 14:20:34,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13426.6). Total num frames: 205484032. Throughput: 0: 3359.7. Samples: 13868370. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:20:34,730][36114] Avg episode reward: [(0, '57.603')] [2023-02-25 14:20:35,009][36156] DAMAGECOUNT value on done: 969785.0 [2023-02-25 14:20:35,010][36156] Sum rewards: 62.992, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.036', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon2': '0.172', 'weapon5': '0.174', 'AMMO3': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.424', 'WEAPON3': '1.400', 'weapon3': '2.946', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '57.000'} [2023-02-25 14:20:35,021][36156] DAMAGECOUNT value on done: 975071.0 [2023-02-25 14:20:35,021][36156] Sum rewards: 61.033, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.218', 'AMMO5': '0.008', 'weapon5': '0.030', 'AMMO2': '0.031', 'weapon4': '0.106', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.241', 'weapon2': '0.290', 'WEAPON3': '1.450', 'HITCOUNT': '3.080', 'weapon3': '3.258', 'DAMAGECOUNT': '16.002', 'FRAGCOUNT': '54.000'} [2023-02-25 14:20:35,312][36156] DAMAGECOUNT value on done: 956091.0 [2023-02-25 14:20:35,312][36156] Sum rewards: 58.536, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.118', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.048', 'weapon5': '0.118', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'weapon2': '0.240', 'WEAPON4': '0.300', 'AMMO3': '0.307', 'WEAPON3': '1.750', 'HITCOUNT': '3.230', 'weapon3': '3.290', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '55.500'} [2023-02-25 14:20:35,325][36156] DAMAGECOUNT value on done: 963886.0 [2023-02-25 14:20:35,326][36156] Sum rewards: 62.374, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.562', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon5': '0.156', 'weapon2': '0.190', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.584', 'WEAPON3': '1.350', 'weapon3': '2.776', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '54.000'} [2023-02-25 14:20:36,512][36138] Updated weights for policy 0, policy_version 50173 (0.0009) [2023-02-25 14:20:39,588][36138] Updated weights for policy 0, policy_version 50183 (0.0009) [2023-02-25 14:20:39,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 205549568. Throughput: 0: 3360.0. Samples: 13878420. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:20:39,730][36114] Avg episode reward: [(0, '57.627')] [2023-02-25 14:20:42,626][36138] Updated weights for policy 0, policy_version 50193 (0.0009) [2023-02-25 14:20:44,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 205615104. Throughput: 0: 3359.2. Samples: 13898594. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:20:44,729][36114] Avg episode reward: [(0, '57.627')] [2023-02-25 14:20:45,003][36155] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:20:45,737][36138] Updated weights for policy 0, policy_version 50203 (0.0009) [2023-02-25 14:20:46,869][36154] DAMAGECOUNT value on done: 971622.0 [2023-02-25 14:20:46,869][36154] Sum rewards: 59.918, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.810', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO3': '0.143', 'AMMO4': '0.183', 'weapon5': '0.248', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.466', 'weapon4': '0.568', 'WEAPON3': '0.900', 'weapon3': '2.418', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.843', 'FRAGCOUNT': '49.000'} [2023-02-25 14:20:47,130][36154] DAMAGECOUNT value on done: 973282.0 [2023-02-25 14:20:47,131][36154] Sum rewards: 55.967, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.373', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.314', 'weapon2': '0.428', 'WEAPON3': '1.100', 'HITCOUNT': '2.690', 'weapon3': '3.038', 'DAMAGECOUNT': '13.356', 'FRAGCOUNT': '47.000'} [2023-02-25 14:20:47,183][36154] DAMAGECOUNT value on done: 956720.0 [2023-02-25 14:20:47,183][36154] Sum rewards: 63.541, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.707', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.027', 'AMMO4': '0.137', 'weapon5': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.216', 'AMMO3': '0.225', 'weapon4': '0.726', 'WEAPON3': '1.400', 'weapon3': '2.646', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '55.000'} [2023-02-25 14:20:47,450][36154] DAMAGECOUNT value on done: 965200.0 [2023-02-25 14:20:47,450][36154] Sum rewards: 61.857, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.476', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.048', 'AMMO4': '0.077', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.388', 'WEAPON3': '1.250', 'HITCOUNT': '3.180', 'weapon3': '3.258', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '52.500'} [2023-02-25 14:20:47,600][36141] DAMAGECOUNT value on done: 972825.0 [2023-02-25 14:20:47,601][36141] Sum rewards: 62.199, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.890', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.032', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.248', 'weapon4': '0.268', 'weapon2': '0.306', 'WEAPON3': '1.450', 'weapon3': '3.184', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.062', 'FRAGCOUNT': '54.500'} [2023-02-25 14:20:47,910][36141] DAMAGECOUNT value on done: 962757.0 [2023-02-25 14:20:47,911][36141] Sum rewards: 57.941, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.622', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.046', 'AMMO3': '0.207', 'AMMO4': '0.229', 'weapon2': '0.234', 'weapon5': '0.244', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.742', 'WEAPON3': '1.200', 'weapon3': '2.496', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '15.351', 'FRAGCOUNT': '51.000'} [2023-02-25 14:20:47,920][36141] DAMAGECOUNT value on done: 971220.0 [2023-02-25 14:20:47,921][36141] Sum rewards: 50.034, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.388', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.062', 'AMMO3': '0.203', 'weapon2': '0.220', 'AMMO4': '0.312', 'weapon5': '0.360', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'weapon4': '0.766', 'WEAPON3': '1.150', 'weapon3': '2.250', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '13.551', 'FRAGCOUNT': '47.000'} [2023-02-25 14:20:48,093][36140] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:20:48,237][36141] DAMAGECOUNT value on done: 958126.0 [2023-02-25 14:20:48,237][36141] Sum rewards: 51.282, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.706', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.067', 'weapon5': '0.146', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.378', 'weapon4': '0.420', 'WEAPON3': '1.250', 'weapon3': '2.816', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.650', 'FRAGCOUNT': '45.000'} [2023-02-25 14:20:48,778][36138] Updated weights for policy 0, policy_version 50213 (0.0009) [2023-02-25 14:20:49,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13426.6). Total num frames: 205684736. Throughput: 0: 3355.6. Samples: 13918580. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:20:49,730][36114] Avg episode reward: [(0, '57.406')] [2023-02-25 14:20:50,012][36157] DAMAGECOUNT value on done: 977327.0 [2023-02-25 14:20:50,012][36157] Sum rewards: 58.623, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.691', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.030', 'AMMO4': '0.149', 'AMMO3': '0.158', 'WEAPON4': '0.350', 'weapon5': '0.390', 'weapon2': '0.392', 'WEAPON5': '0.450', 'weapon4': '0.764', 'WEAPON3': '0.900', 'weapon3': '2.010', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '48.000'} [2023-02-25 14:20:50,331][36157] DAMAGECOUNT value on done: 968156.0 [2023-02-25 14:20:50,331][36157] Sum rewards: 63.108, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.624', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.110', 'AMMO4': '0.116', 'weapon4': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon2': '0.336', 'WEAPON3': '1.350', 'HITCOUNT': '3.100', 'weapon3': '3.126', 'DAMAGECOUNT': '16.254', 'FRAGCOUNT': '55.000'} [2023-02-25 14:20:50,570][36140] DAMAGECOUNT value on done: 969865.0 [2023-02-25 14:20:50,571][36140] Sum rewards: 56.157, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-0.200', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.088', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'weapon2': '0.212', 'WEAPON4': '0.250', 'AMMO3': '0.261', 'weapon4': '0.324', 'WEAPON3': '1.500', 'weapon3': '3.028', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.853', 'FRAGCOUNT': '52.000'} [2023-02-25 14:20:50,875][36140] DAMAGECOUNT value on done: 954401.0 [2023-02-25 14:20:50,876][36140] Sum rewards: 48.680, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.455', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon5': '0.230', 'WEAPON5': '0.250', 'weapon4': '0.256', 'AMMO3': '0.271', 'WEAPON4': '0.350', 'weapon2': '0.376', 'WEAPON3': '1.550', 'weapon3': '2.830', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.406', 'FRAGCOUNT': '45.500'} [2023-02-25 14:20:50,919][36140] DAMAGECOUNT value on done: 966546.0 [2023-02-25 14:20:50,920][36140] Sum rewards: 63.454, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.095', 'AMMO5': '0.015', 'AMMO2': '0.026', 'weapon4': '0.096', 'AMMO4': '0.130', 'AMMO3': '0.172', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon5': '0.406', 'weapon2': '0.458', 'WEAPON3': '1.100', 'weapon3': '2.772', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.834', 'FRAGCOUNT': '55.000'} [2023-02-25 14:20:51,059][36157] DAMAGECOUNT value on done: 977404.0 [2023-02-25 14:20:51,059][36157] Sum rewards: 64.265, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.120', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'weapon5': '0.106', 'AMMO4': '0.127', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon4': '0.250', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.056', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '54.000'} [2023-02-25 14:20:51,232][36140] DAMAGECOUNT value on done: 961311.0 [2023-02-25 14:20:51,233][36140] Sum rewards: 71.736, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.320', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon4': '0.038', 'weapon5': '0.040', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'weapon2': '0.324', 'WEAPON3': '1.200', 'weapon3': '3.426', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '60.000'} [2023-02-25 14:20:51,377][36157] DAMAGECOUNT value on done: 972604.0 [2023-02-25 14:20:51,377][36157] Sum rewards: 67.450, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.940', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.190', 'weapon4': '0.218', 'AMMO3': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.334', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.960', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '61.000'} [2023-02-25 14:20:51,570][36155] DAMAGECOUNT value on done: 960027.0 [2023-02-25 14:20:51,570][36155] Sum rewards: 59.235, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.471', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.137', 'weapon5': '0.154', 'AMMO3': '0.158', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.308', 'weapon4': '0.546', 'WEAPON3': '1.100', 'weapon3': '2.772', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.874', 'FRAGCOUNT': '50.000'} [2023-02-25 14:20:51,883][36155] DAMAGECOUNT value on done: 971197.0 [2023-02-25 14:20:51,884][36155] Sum rewards: 49.891, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.622', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.104', 'AMMO3': '0.176', 'AMMO4': '0.190', 'WEAPON5': '0.250', 'weapon4': '0.286', 'WEAPON4': '0.350', 'weapon2': '0.616', 'WEAPON3': '1.150', 'weapon3': '2.770', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.050', 'FRAGCOUNT': '44.000'} [2023-02-25 14:20:51,908][36138] Updated weights for policy 0, policy_version 50223 (0.0009) [2023-02-25 14:20:52,818][36155] DAMAGECOUNT value on done: 980386.0 [2023-02-25 14:20:52,819][36155] Sum rewards: 53.702, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.480', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO3': '0.181', 'AMMO4': '0.207', 'weapon5': '0.268', 'weapon2': '0.388', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.570', 'WEAPON3': '1.000', 'weapon3': '2.478', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '13.929', 'FRAGCOUNT': '46.000'} [2023-02-25 14:20:53,031][36142] DAMAGECOUNT value on done: 969648.0 [2023-02-25 14:20:53,032][36142] Sum rewards: 59.024, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.410', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon4': '0.080', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.222', 'AMMO3': '0.250', 'WEAPON3': '1.600', 'HITCOUNT': '2.770', 'weapon3': '3.306', 'DAMAGECOUNT': '14.730', 'FRAGCOUNT': '54.000'} [2023-02-25 14:20:53,131][36155] DAMAGECOUNT value on done: 964922.0 [2023-02-25 14:20:53,131][36155] Sum rewards: 63.443, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.169', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.053', 'AMMO3': '0.128', 'weapon2': '0.224', 'WEAPON5': '0.250', 'AMMO4': '0.267', 'weapon5': '0.270', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'weapon4': '1.216', 'weapon3': '1.788', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.891', 'FRAGCOUNT': '52.000'} [2023-02-25 14:20:53,343][36142] DAMAGECOUNT value on done: 950901.0 [2023-02-25 14:20:53,343][36142] Sum rewards: 47.719, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.485', 'AMMO5': '0.016', 'AMMO2': '0.049', 'AMMO3': '0.155', 'weapon5': '0.240', 'AMMO4': '0.245', 'WEAPON5': '0.450', 'weapon4': '0.510', 'WEAPON4': '0.600', 'weapon2': '0.744', 'WEAPON3': '0.900', 'weapon3': '1.970', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.464', 'FRAGCOUNT': '43.000'} [2023-02-25 14:20:53,445][36139] DAMAGECOUNT value on done: 967166.0 [2023-02-25 14:20:53,445][36139] Sum rewards: 59.635, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.436', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.050', 'AMMO3': '0.130', 'AMMO4': '0.250', 'weapon5': '0.294', 'WEAPON5': '0.300', 'weapon2': '0.482', 'WEAPON4': '0.550', 'weapon4': '0.616', 'WEAPON3': '0.900', 'weapon3': '2.252', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '50.000'} [2023-02-25 14:20:53,676][36142] DAMAGECOUNT value on done: 961407.0 [2023-02-25 14:20:53,676][36142] Sum rewards: 51.492, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.290', 'AMMO5': '0.004', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon5': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.211', 'weapon4': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.394', 'WEAPON3': '1.400', 'weapon3': '3.162', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.701', 'FRAGCOUNT': '47.000'} [2023-02-25 14:20:53,746][36139] DAMAGECOUNT value on done: 966129.0 [2023-02-25 14:20:53,746][36139] Sum rewards: 47.208, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.000', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.049', 'AMMO3': '0.142', 'AMMO4': '0.247', 'weapon5': '0.258', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.524', 'weapon4': '0.616', 'WEAPON3': '0.900', 'weapon3': '2.276', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.017', 'FRAGCOUNT': '40.000'} [2023-02-25 14:20:53,986][36142] DAMAGECOUNT value on done: 978081.0 [2023-02-25 14:20:53,987][36142] Sum rewards: 58.653, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.320', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.096', 'AMMO3': '0.113', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.622', 'WEAPON3': '0.750', 'weapon2': '0.808', 'weapon3': '2.238', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.178', 'FRAGCOUNT': '47.000'} [2023-02-25 14:20:54,096][36139] DAMAGECOUNT value on done: 981381.0 [2023-02-25 14:20:54,096][36139] Sum rewards: 60.091, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.174', 'ARMOR': '0.013', 'AMMO5': '0.013', 'AMMO2': '0.065', 'AMMO3': '0.174', 'weapon5': '0.192', 'weapon2': '0.284', 'AMMO4': '0.327', 'WEAPON5': '0.400', 'WEAPON4': '0.700', 'weapon4': '0.908', 'WEAPON3': '1.050', 'weapon3': '2.326', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.972', 'FRAGCOUNT': '53.000'} [2023-02-25 14:20:54,401][36139] DAMAGECOUNT value on done: 971753.0 [2023-02-25 14:20:54,402][36139] Sum rewards: 54.488, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.990', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.122', 'AMMO3': '0.186', 'AMMO4': '0.189', 'weapon4': '0.242', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '2.620', 'weapon3': '3.120', 'DAMAGECOUNT': '14.424', 'FRAGCOUNT': '47.000'} [2023-02-25 14:20:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 205750272. Throughput: 0: 3356.5. Samples: 13928580. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:20:54,729][36114] Avg episode reward: [(0, '57.661')] [2023-02-25 14:20:54,932][36138] Updated weights for policy 0, policy_version 50233 (0.0009) [2023-02-25 14:20:55,061][36156] DAMAGECOUNT value on done: 974700.0 [2023-02-25 14:20:55,062][36156] Sum rewards: 59.906, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.355', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'weapon4': '0.238', 'weapon2': '0.382', 'WEAPON3': '1.200', 'HITCOUNT': '3.060', 'weapon3': '3.116', 'DAMAGECOUNT': '14.745', 'FRAGCOUNT': '50.000'} [2023-02-25 14:20:55,072][36156] DAMAGECOUNT value on done: 980653.0 [2023-02-25 14:20:55,073][36156] Sum rewards: 72.696, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.230', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon4': '0.232', 'weapon2': '0.320', 'WEAPON3': '1.150', 'weapon3': '3.152', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '61.000'} [2023-02-25 14:20:55,385][36156] DAMAGECOUNT value on done: 961076.0 [2023-02-25 14:20:55,386][36156] Sum rewards: 57.289, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.177', 'AMMO5': '0.018', 'AMMO2': '0.061', 'AMMO3': '0.152', 'AMMO4': '0.307', 'weapon5': '0.348', 'WEAPON5': '0.550', 'weapon2': '0.616', 'WEAPON4': '0.650', 'WEAPON3': '0.850', 'weapon4': '0.960', 'weapon3': '1.758', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.955', 'FRAGCOUNT': '51.000'} [2023-02-25 14:20:55,396][36156] DAMAGECOUNT value on done: 968426.0 [2023-02-25 14:20:55,397][36156] Sum rewards: 47.488, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.285', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.098', 'AMMO4': '0.117', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.450', 'weapon2': '0.566', 'weapon4': '0.764', 'WEAPON3': '1.200', 'weapon3': '2.336', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.620', 'FRAGCOUNT': '44.000'} [2023-02-25 14:20:56,577][36142] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:20:57,996][36138] Updated weights for policy 0, policy_version 50243 (0.0009) [2023-02-25 14:20:59,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.2, 300 sec: 13412.7). Total num frames: 205815808. Throughput: 0: 3359.4. Samples: 13948720. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:20:59,730][36114] Avg episode reward: [(0, '58.124')] [2023-02-25 14:20:59,733][36125] Saving new best policy, reward=58.124! [2023-02-25 14:21:01,028][36138] Updated weights for policy 0, policy_version 50253 (0.0010) [2023-02-25 14:21:01,655][36155] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:21:04,115][36138] Updated weights for policy 0, policy_version 50263 (0.0009) [2023-02-25 14:21:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 205885440. Throughput: 0: 3353.7. Samples: 13968696. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:21:04,730][36114] Avg episode reward: [(0, '58.124')] [2023-02-25 14:21:06,994][36154] DAMAGECOUNT value on done: 975862.0 [2023-02-25 14:21:06,994][36154] Sum rewards: 51.509, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.256', 'AMMO5': '0.011', 'AMMO2': '0.028', 'AMMO4': '0.138', 'AMMO3': '0.182', 'weapon5': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.372', 'weapon4': '0.392', 'WEAPON3': '1.100', 'HITCOUNT': '2.780', 'weapon3': '2.784', 'DAMAGECOUNT': '12.720', 'FRAGCOUNT': '45.000'} [2023-02-25 14:21:07,174][36138] Updated weights for policy 0, policy_version 50273 (0.0009) [2023-02-25 14:21:07,250][36154] DAMAGECOUNT value on done: 978287.0 [2023-02-25 14:21:07,251][36154] Sum rewards: 61.983, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.047', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.036', 'weapon5': '0.068', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.188', 'AMMO3': '0.236', 'WEAPON3': '1.450', 'HITCOUNT': '3.130', 'weapon3': '3.506', 'DAMAGECOUNT': '15.015', 'FRAGCOUNT': '55.000'} [2023-02-25 14:21:07,307][36154] DAMAGECOUNT value on done: 961080.0 [2023-02-25 14:21:07,308][36154] Sum rewards: 45.684, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.950', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.072', 'AMMO4': '0.086', 'weapon4': '0.088', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.270', 'weapon2': '0.500', 'WEAPON3': '1.750', 'HITCOUNT': '2.880', 'weapon3': '3.036', 'DAMAGECOUNT': '13.080', 'FRAGCOUNT': '44.000'} [2023-02-25 14:21:07,573][36154] DAMAGECOUNT value on done: 969875.0 [2023-02-25 14:21:07,574][36154] Sum rewards: 55.765, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.426', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.108', 'AMMO4': '0.117', 'weapon4': '0.182', 'WEAPON5': '0.200', 'weapon2': '0.216', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.060', 'weapon3': '3.268', 'DAMAGECOUNT': '14.025', 'FRAGCOUNT': '50.000'} [2023-02-25 14:21:07,719][36141] DAMAGECOUNT value on done: 977504.0 [2023-02-25 14:21:07,719][36141] Sum rewards: 47.118, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.890', 'ARMOR': '0.005', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.122', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.260', 'weapon4': '0.346', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '3.010', 'weapon3': '3.032', 'DAMAGECOUNT': '14.037', 'FRAGCOUNT': '42.000'} [2023-02-25 14:21:08,021][36141] DAMAGECOUNT value on done: 967765.0 [2023-02-25 14:21:08,022][36141] Sum rewards: 55.295, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.920', 'AMMO2': '0.003', 'AMMO4': '0.015', 'weapon4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.219', 'weapon2': '0.854', 'WEAPON3': '1.450', 'weapon3': '2.948', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.024', 'FRAGCOUNT': '48.000'} [2023-02-25 14:21:08,032][36141] DAMAGECOUNT value on done: 976515.0 [2023-02-25 14:21:08,033][36141] Sum rewards: 62.287, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.819', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.150', 'weapon4': '0.162', 'AMMO3': '0.210', 'weapon2': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '2.970', 'weapon3': '3.182', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '53.000'} [2023-02-25 14:21:08,347][36141] DAMAGECOUNT value on done: 963125.0 [2023-02-25 14:21:08,348][36141] Sum rewards: 61.142, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.412', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO4': '0.127', 'AMMO3': '0.172', 'WEAPON4': '0.250', 'weapon2': '0.252', 'ARMOR': '0.404', 'weapon4': '0.526', 'WEAPON3': '1.050', 'weapon3': '2.898', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.952', 'FRAGCOUNT': '50.500'} [2023-02-25 14:21:09,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13412.7). Total num frames: 205950976. Throughput: 0: 3353.7. Samples: 13978736. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:21:09,730][36114] Avg episode reward: [(0, '57.733')] [2023-02-25 14:21:10,066][36157] DAMAGECOUNT value on done: 983567.0 [2023-02-25 14:21:10,066][36157] Sum rewards: 76.484, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.661', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.134', 'AMMO3': '0.196', 'weapon2': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.330', 'WEAPON3': '1.200', 'weapon3': '3.046', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.720', 'FRAGCOUNT': '64.000'} [2023-02-25 14:21:10,203][36138] Updated weights for policy 0, policy_version 50283 (0.0009) [2023-02-25 14:21:10,373][36157] DAMAGECOUNT value on done: 973001.0 [2023-02-25 14:21:10,373][36157] Sum rewards: 54.525, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.400', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.070', 'AMMO4': '0.090', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'weapon2': '0.334', 'WEAPON3': '1.550', 'HITCOUNT': '3.030', 'weapon3': '3.388', 'DAMAGECOUNT': '14.535', 'FRAGCOUNT': '50.000'} [2023-02-25 14:21:10,674][36140] DAMAGECOUNT value on done: 974765.0 [2023-02-25 14:21:10,675][36140] Sum rewards: 56.932, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.250', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.079', 'weapon5': '0.146', 'AMMO3': '0.187', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON4': '0.400', 'weapon4': '0.708', 'WEAPON3': '1.200', 'weapon3': '2.362', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '14.700', 'FRAGCOUNT': '49.000'} [2023-02-25 14:21:10,979][36140] DAMAGECOUNT value on done: 959689.0 [2023-02-25 14:21:10,980][36140] Sum rewards: 64.287, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.017', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.130', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon4': '0.284', 'WEAPON5': '0.350', 'weapon2': '0.460', 'HEALTH': '0.576', 'WEAPON3': '1.050', 'weapon3': '2.876', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.864', 'FRAGCOUNT': '53.000'} [2023-02-25 14:21:11,023][36140] DAMAGECOUNT value on done: 972002.0 [2023-02-25 14:21:11,024][36140] Sum rewards: 64.008, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.798', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.146', 'AMMO4': '0.166', 'AMMO3': '0.178', 'weapon5': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.872', 'WEAPON3': '1.100', 'weapon3': '2.540', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '53.000'} [2023-02-25 14:21:11,105][36157] DAMAGECOUNT value on done: 982379.0 [2023-02-25 14:21:11,105][36157] Sum rewards: 65.223, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.678', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'weapon5': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.240', 'weapon4': '0.274', 'weapon2': '0.312', 'WEAPON3': '1.450', 'weapon3': '3.036', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '14.925', 'FRAGCOUNT': '57.000'} [2023-02-25 14:21:11,342][36140] DAMAGECOUNT value on done: 966343.0 [2023-02-25 14:21:11,342][36140] Sum rewards: 54.615, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-3.932', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.178', 'weapon4': '0.204', 'AMMO3': '0.367', 'WEAPON3': '2.100', 'weapon3': '3.174', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.096', 'FRAGCOUNT': '54.000'} [2023-02-25 14:21:11,421][36157] DAMAGECOUNT value on done: 977108.0 [2023-02-25 14:21:11,421][36157] Sum rewards: 54.874, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.109', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon5': '0.112', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.226', 'weapon2': '0.312', 'WEAPON3': '0.900', 'HITCOUNT': '2.740', 'weapon3': '3.106', 'DAMAGECOUNT': '13.512', 'FRAGCOUNT': '44.000'} [2023-02-25 14:21:11,557][36155] DAMAGECOUNT value on done: 965411.0 [2023-02-25 14:21:11,557][36155] Sum rewards: 59.529, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.648', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.053', 'AMMO3': '0.182', 'weapon5': '0.262', 'AMMO4': '0.267', 'weapon4': '0.500', 'WEAPON5': '0.550', 'WEAPON4': '0.550', 'weapon2': '0.624', 'WEAPON3': '1.200', 'weapon3': '2.226', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '52.000'} [2023-02-25 14:21:11,878][36155] DAMAGECOUNT value on done: 975893.0 [2023-02-25 14:21:11,879][36155] Sum rewards: 61.118, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.196', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.121', 'weapon5': '0.126', 'AMMO4': '0.210', 'WEAPON4': '0.400', 'WEAPON3': '0.750', 'weapon2': '0.764', 'weapon4': '1.060', 'weapon3': '1.818', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.088', 'FRAGCOUNT': '50.000'} [2023-02-25 14:21:12,785][36155] DAMAGECOUNT value on done: 985528.0 [2023-02-25 14:21:12,786][36155] Sum rewards: 59.562, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.965', 'AMMO5': '0.019', 'AMMO2': '0.049', 'AMMO3': '0.132', 'AMMO4': '0.244', 'weapon2': '0.318', 'weapon5': '0.360', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.752', 'WEAPON3': '0.850', 'weapon3': '2.156', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '50.000'} [2023-02-25 14:21:13,084][36155] DAMAGECOUNT value on done: 969952.0 [2023-02-25 14:21:13,085][36155] Sum rewards: 62.686, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.840', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon5': '0.098', 'AMMO3': '0.238', 'AMMO4': '0.253', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON4': '0.650', 'weapon4': '0.676', 'WEAPON3': '1.450', 'weapon3': '2.664', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.090', 'FRAGCOUNT': '58.000'} [2023-02-25 14:21:13,172][36142] DAMAGECOUNT value on done: 974906.0 [2023-02-25 14:21:13,173][36142] Sum rewards: 58.036, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.466', 'AMMO5': '0.019', 'AMMO2': '0.055', 'weapon5': '0.218', 'AMMO3': '0.222', 'weapon4': '0.260', 'AMMO4': '0.274', 'weapon2': '0.384', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.750', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.630', 'FRAGCOUNT': '51.500'} [2023-02-25 14:21:13,251][36138] Updated weights for policy 0, policy_version 50293 (0.0009) [2023-02-25 14:21:13,448][36139] DAMAGECOUNT value on done: 972423.0 [2023-02-25 14:21:13,449][36139] Sum rewards: 57.394, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.996', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.100', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.306', 'weapon2': '0.452', 'WEAPON3': '1.300', 'weapon3': '2.890', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.771', 'FRAGCOUNT': '48.000'} [2023-02-25 14:21:13,492][36142] DAMAGECOUNT value on done: 955824.0 [2023-02-25 14:21:13,493][36142] Sum rewards: 61.887, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.606', 'AMMO5': '0.010', 'AMMO2': '0.011', 'weapon4': '0.046', 'AMMO4': '0.055', 'weapon5': '0.084', 'WEAPON4': '0.150', 'AMMO3': '0.201', 'WEAPON5': '0.250', 'weapon2': '0.468', 'WEAPON3': '1.150', 'weapon3': '3.208', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.769', 'FRAGCOUNT': '53.000'} [2023-02-25 14:21:13,748][36139] DAMAGECOUNT value on done: 970463.0 [2023-02-25 14:21:13,748][36139] Sum rewards: 45.705, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.875', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'weapon4': '0.114', 'weapon5': '0.196', 'AMMO3': '0.243', 'WEAPON5': '0.250', 'weapon2': '0.608', 'WEAPON3': '1.450', 'HITCOUNT': '2.550', 'weapon3': '2.736', 'DAMAGECOUNT': '13.002', 'FRAGCOUNT': '42.000'} [2023-02-25 14:21:13,825][36142] DAMAGECOUNT value on done: 967549.0 [2023-02-25 14:21:13,825][36142] Sum rewards: 70.790, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.570', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.168', 'weapon4': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.390', 'WEAPON3': '1.350', 'weapon3': '2.988', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.426', 'FRAGCOUNT': '59.000'} [2023-02-25 14:21:14,091][36139] DAMAGECOUNT value on done: 986515.0 [2023-02-25 14:21:14,092][36139] Sum rewards: 58.913, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.700', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon2': '0.158', 'weapon5': '0.186', 'AMMO4': '0.211', 'AMMO3': '0.213', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.402', 'WEAPON3': '1.350', 'weapon3': '3.018', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.402', 'FRAGCOUNT': '52.000'} [2023-02-25 14:21:14,135][36142] DAMAGECOUNT value on done: 983543.0 [2023-02-25 14:21:14,135][36142] Sum rewards: 70.820, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.330', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon4': '0.230', 'weapon2': '0.552', 'WEAPON3': '1.000', 'weapon3': '2.884', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.356', 'FRAGCOUNT': '58.000'} [2023-02-25 14:21:14,402][36139] DAMAGECOUNT value on done: 975751.0 [2023-02-25 14:21:14,402][36139] Sum rewards: 45.660, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.670', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.040', 'AMMO3': '0.163', 'weapon2': '0.166', 'weapon5': '0.184', 'AMMO4': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.576', 'WEAPON3': '1.050', 'weapon3': '2.282', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '11.994', 'FRAGCOUNT': '39.500'} [2023-02-25 14:21:14,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 206016512. Throughput: 0: 3350.5. Samples: 13998872. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:21:14,730][36114] Avg episode reward: [(0, '58.211')] [2023-02-25 14:21:14,730][36125] Saving new best policy, reward=58.211! [2023-02-25 14:21:15,309][36156] DAMAGECOUNT value on done: 980346.0 [2023-02-25 14:21:15,309][36156] Sum rewards: 66.272, reward structure: {'DEATHCOUNT': '-15.750', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.205', 'HEALTH': '0.260', 'weapon2': '0.288', 'weapon4': '0.358', 'WEAPON3': '1.150', 'weapon3': '3.028', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '56.000'} [2023-02-25 14:21:15,320][36156] DAMAGECOUNT value on done: 985962.0 [2023-02-25 14:21:15,320][36156] Sum rewards: 52.504, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.425', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.112', 'AMMO3': '0.184', 'weapon5': '0.208', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.428', 'weapon4': '0.712', 'WEAPON3': '1.150', 'weapon3': '2.356', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.927', 'FRAGCOUNT': '44.000'} [2023-02-25 14:21:15,634][36156] DAMAGECOUNT value on done: 966214.0 [2023-02-25 14:21:15,635][36156] Sum rewards: 55.546, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.238', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.152', 'AMMO4': '0.155', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon2': '0.296', 'weapon4': '0.478', 'WEAPON3': '1.150', 'weapon3': '2.692', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.171', 'FRAGCOUNT': '48.000'} [2023-02-25 14:21:15,645][36156] DAMAGECOUNT value on done: 973319.0 [2023-02-25 14:21:15,645][36156] Sum rewards: 65.131, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.148', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'weapon5': '0.044', 'AMMO4': '0.045', 'WEAPON5': '0.050', 'AMMO3': '0.134', 'WEAPON4': '0.150', 'weapon4': '0.454', 'weapon2': '0.634', 'WEAPON3': '0.900', 'weapon3': '2.598', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.679', 'FRAGCOUNT': '53.000'} [2023-02-25 14:21:16,332][36138] Updated weights for policy 0, policy_version 50303 (0.0009) [2023-02-25 14:21:19,380][36138] Updated weights for policy 0, policy_version 50313 (0.0009) [2023-02-25 14:21:19,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 206086144. Throughput: 0: 3346.9. Samples: 14018982. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:21:19,730][36114] Avg episode reward: [(0, '58.256')] [2023-02-25 14:21:19,734][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000050314_206086144.pth... [2023-02-25 14:21:19,788][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000049528_202866688.pth [2023-02-25 14:21:19,794][36125] Saving new best policy, reward=58.256! [2023-02-25 14:21:22,424][36138] Updated weights for policy 0, policy_version 50323 (0.0010) [2023-02-25 14:21:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 206151680. Throughput: 0: 3345.6. Samples: 14028970. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:21:24,729][36114] Avg episode reward: [(0, '58.256')] [2023-02-25 14:21:25,485][36138] Updated weights for policy 0, policy_version 50333 (0.0009) [2023-02-25 14:21:27,055][36154] DAMAGECOUNT value on done: 980708.0 [2023-02-25 14:21:27,055][36154] Sum rewards: 57.047, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.234', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.056', 'AMMO3': '0.145', 'WEAPON5': '0.150', 'AMMO4': '0.183', 'WEAPON4': '0.300', 'weapon2': '0.400', 'weapon4': '0.654', 'WEAPON3': '0.900', 'weapon3': '2.546', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.538', 'FRAGCOUNT': '47.000'} [2023-02-25 14:21:27,321][36154] DAMAGECOUNT value on done: 983056.0 [2023-02-25 14:21:27,322][36154] Sum rewards: 60.240, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.820', 'ARMOR': '0.009', 'AMMO5': '0.010', 'AMMO2': '0.049', 'AMMO3': '0.109', 'weapon5': '0.194', 'AMMO4': '0.247', 'WEAPON5': '0.350', 'weapon2': '0.546', 'WEAPON4': '0.550', 'WEAPON3': '0.750', 'weapon4': '1.010', 'weapon3': '2.018', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '14.307', 'FRAGCOUNT': '49.000'} [2023-02-25 14:21:27,379][36154] DAMAGECOUNT value on done: 966917.0 [2023-02-25 14:21:27,379][36154] Sum rewards: 62.293, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.768', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon5': '0.068', 'weapon4': '0.082', 'AMMO4': '0.104', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.364', 'WEAPON3': '1.350', 'weapon3': '3.254', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.511', 'FRAGCOUNT': '53.000'} [2023-02-25 14:21:27,643][36154] DAMAGECOUNT value on done: 975458.0 [2023-02-25 14:21:27,644][36154] Sum rewards: 64.008, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.590', 'AMMO5': '0.008', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon5': '0.168', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'weapon4': '0.216', 'WEAPON4': '0.300', 'weapon2': '0.638', 'WEAPON3': '1.100', 'weapon3': '2.746', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '54.000'} [2023-02-25 14:21:27,739][36141] DAMAGECOUNT value on done: 981522.0 [2023-02-25 14:21:27,739][36141] Sum rewards: 44.524, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.340', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon4': '0.106', 'AMMO4': '0.118', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon2': '0.252', 'ARMOR': '0.482', 'WEAPON3': '1.350', 'HITCOUNT': '2.620', 'weapon3': '3.366', 'DAMAGECOUNT': '12.054', 'FRAGCOUNT': '41.000'} [2023-02-25 14:21:27,957][36141] DAMAGECOUNT value on done: 971990.0 [2023-02-25 14:21:27,957][36141] Sum rewards: 51.285, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.555', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'WEAPON4': '0.250', 'weapon4': '0.452', 'weapon2': '0.464', 'WEAPON3': '0.950', 'weapon3': '2.766', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '12.675', 'FRAGCOUNT': '43.000'} [2023-02-25 14:21:28,039][36141] DAMAGECOUNT value on done: 981165.0 [2023-02-25 14:21:28,039][36141] Sum rewards: 48.611, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.382', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.043', 'AMMO4': '0.217', 'AMMO3': '0.250', 'weapon5': '0.250', 'weapon2': '0.338', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.662', 'WEAPON3': '1.450', 'weapon3': '2.322', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.950', 'FRAGCOUNT': '45.000'} [2023-02-25 14:21:28,259][36141] DAMAGECOUNT value on done: 967497.0 [2023-02-25 14:21:28,259][36141] Sum rewards: 48.645, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.172', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.044', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.218', 'weapon4': '0.224', 'AMMO3': '0.234', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.850', 'weapon3': '3.106', 'DAMAGECOUNT': '13.116', 'FRAGCOUNT': '46.000'} [2023-02-25 14:21:28,545][36138] Updated weights for policy 0, policy_version 50343 (0.0009) [2023-02-25 14:21:29,729][36114] Fps is (10 sec: 13107.0, 60 sec: 13380.2, 300 sec: 13412.7). Total num frames: 206217216. Throughput: 0: 3342.4. Samples: 14049002. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:21:29,730][36114] Avg episode reward: [(0, '57.639')] [2023-02-25 14:21:30,198][36157] DAMAGECOUNT value on done: 988940.0 [2023-02-25 14:21:30,198][36157] Sum rewards: 65.378, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.145', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.075', 'weapon5': '0.090', 'weapon2': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'WEAPON3': '1.250', 'HITCOUNT': '3.050', 'weapon3': '3.436', 'DAMAGECOUNT': '16.119', 'FRAGCOUNT': '56.000'} [2023-02-25 14:21:30,501][36157] DAMAGECOUNT value on done: 977778.0 [2023-02-25 14:21:30,502][36157] Sum rewards: 57.581, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.772', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.149', 'weapon2': '0.164', 'AMMO4': '0.168', 'weapon5': '0.178', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.750', 'WEAPON3': '0.900', 'weapon3': '2.672', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.244', 'FRAGCOUNT': '49.000'} [2023-02-25 14:21:31,009][36140] DAMAGECOUNT value on done: 980379.0 [2023-02-25 14:21:31,009][36140] Sum rewards: 67.464, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.266', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.162', 'AMMO3': '0.186', 'weapon2': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.362', 'WEAPON3': '1.050', 'weapon3': '2.954', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '56.000'} [2023-02-25 14:21:31,224][36157] DAMAGECOUNT value on done: 987856.0 [2023-02-25 14:21:31,225][36157] Sum rewards: 63.013, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.158', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.102', 'weapon4': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.206', 'weapon2': '0.218', 'AMMO3': '0.247', 'WEAPON3': '1.450', 'weapon3': '3.198', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.431', 'FRAGCOUNT': '56.000'} [2023-02-25 14:21:31,326][36140] DAMAGECOUNT value on done: 965161.0 [2023-02-25 14:21:31,326][36140] Sum rewards: 60.383, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.100', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.146', 'weapon2': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'weapon4': '0.422', 'WEAPON3': '1.450', 'weapon3': '2.876', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '54.000'} [2023-02-25 14:21:31,359][36140] DAMAGECOUNT value on done: 977664.0 [2023-02-25 14:21:31,360][36140] Sum rewards: 67.376, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.614', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO3': '0.135', 'AMMO4': '0.194', 'WEAPON5': '0.250', 'weapon5': '0.268', 'weapon2': '0.278', 'WEAPON4': '0.350', 'weapon4': '0.648', 'WEAPON3': '0.850', 'weapon3': '2.490', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '55.000'} [2023-02-25 14:21:31,540][36157] DAMAGECOUNT value on done: 981688.0 [2023-02-25 14:21:31,541][36157] Sum rewards: 52.724, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.700', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.108', 'AMMO3': '0.135', 'AMMO4': '0.215', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.534', 'weapon4': '0.634', 'WEAPON3': '0.900', 'weapon3': '2.520', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.740', 'FRAGCOUNT': '45.000'} [2023-02-25 14:21:31,542][36155] DAMAGECOUNT value on done: 970585.0 [2023-02-25 14:21:31,542][36155] Sum rewards: 64.319, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.565', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO4': '0.193', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'weapon2': '0.298', 'weapon4': '0.468', 'WEAPON3': '1.400', 'weapon3': '2.892', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.522', 'FRAGCOUNT': '57.000'} [2023-02-25 14:21:31,609][36138] Updated weights for policy 0, policy_version 50353 (0.0009) [2023-02-25 14:21:31,670][36140] DAMAGECOUNT value on done: 971134.0 [2023-02-25 14:21:31,671][36140] Sum rewards: 46.444, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.953', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon5': '0.056', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'weapon2': '0.204', 'WEAPON4': '0.250', 'AMMO3': '0.272', 'weapon4': '0.444', 'WEAPON3': '1.700', 'weapon3': '2.774', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.373', 'FRAGCOUNT': '43.000'} [2023-02-25 14:21:31,859][36155] DAMAGECOUNT value on done: 980980.0 [2023-02-25 14:21:31,860][36155] Sum rewards: 54.103, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.430', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.039', 'AMMO3': '0.135', 'weapon4': '0.140', 'weapon5': '0.146', 'AMMO4': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '0.800', 'weapon2': '0.974', 'weapon3': '2.520', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.261', 'FRAGCOUNT': '43.000'} [2023-02-25 14:21:32,775][36155] DAMAGECOUNT value on done: 989535.0 [2023-02-25 14:21:32,776][36155] Sum rewards: 43.709, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.165', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.046', 'weapon4': '0.162', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'WEAPON4': '0.250', 'weapon2': '0.494', 'WEAPON3': '1.000', 'HITCOUNT': '2.660', 'weapon3': '3.108', 'DAMAGECOUNT': '12.021', 'FRAGCOUNT': '38.000'} [2023-02-25 14:21:33,090][36155] DAMAGECOUNT value on done: 974204.0 [2023-02-25 14:21:33,091][36155] Sum rewards: 55.652, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.870', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'weapon4': '0.042', 'AMMO4': '0.051', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.352', 'WEAPON3': '1.200', 'HITCOUNT': '2.780', 'weapon3': '3.210', 'DAMAGECOUNT': '12.756', 'FRAGCOUNT': '49.000'} [2023-02-25 14:21:33,289][36142] DAMAGECOUNT value on done: 979630.0 [2023-02-25 14:21:33,290][36142] Sum rewards: 52.314, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.230', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.229', 'weapon2': '0.280', 'weapon4': '0.284', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.000', 'weapon3': '3.186', 'DAMAGECOUNT': '14.172', 'FRAGCOUNT': '48.000'} [2023-02-25 14:21:33,474][36139] DAMAGECOUNT value on done: 978371.0 [2023-02-25 14:21:33,475][36139] Sum rewards: 69.220, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.940', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.241', 'weapon4': '0.242', 'weapon2': '0.388', 'WEAPON3': '1.450', 'weapon3': '3.076', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '59.000'} [2023-02-25 14:21:33,596][36142] DAMAGECOUNT value on done: 959903.0 [2023-02-25 14:21:33,596][36142] Sum rewards: 43.679, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.002', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.215', 'weapon2': '0.604', 'WEAPON3': '1.250', 'HITCOUNT': '2.700', 'weapon3': '3.204', 'DAMAGECOUNT': '12.237', 'FRAGCOUNT': '38.000'} [2023-02-25 14:21:33,798][36139] DAMAGECOUNT value on done: 975703.0 [2023-02-25 14:21:33,799][36139] Sum rewards: 56.350, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.352', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.018', 'AMMO4': '0.020', 'weapon5': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.246', 'AMMO3': '0.256', 'WEAPON3': '1.600', 'HITCOUNT': '3.310', 'weapon3': '3.394', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '50.500'} [2023-02-25 14:21:33,915][36142] DAMAGECOUNT value on done: 972351.0 [2023-02-25 14:21:33,915][36142] Sum rewards: 57.233, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.918', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.100', 'AMMO3': '0.161', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.412', 'weapon4': '0.514', 'WEAPON3': '1.000', 'weapon3': '2.742', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.406', 'FRAGCOUNT': '48.000'} [2023-02-25 14:21:34,028][36139] DAMAGECOUNT value on done: 990935.0 [2023-02-25 14:21:34,028][36139] Sum rewards: 48.370, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.587', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.137', 'AMMO3': '0.154', 'weapon5': '0.164', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.646', 'weapon2': '0.740', 'WEAPON3': '1.100', 'weapon3': '2.052', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.260', 'FRAGCOUNT': '42.000'} [2023-02-25 14:21:34,226][36142] DAMAGECOUNT value on done: 988845.0 [2023-02-25 14:21:34,227][36142] Sum rewards: 60.021, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.400', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.013', 'AMMO4': '0.063', 'WEAPON5': '0.100', 'AMMO3': '0.280', 'weapon2': '0.312', 'WEAPON3': '1.700', 'HITCOUNT': '3.320', 'weapon3': '3.466', 'DAMAGECOUNT': '15.906', 'FRAGCOUNT': '53.000'} [2023-02-25 14:21:34,349][36139] DAMAGECOUNT value on done: 979480.0 [2023-02-25 14:21:34,349][36139] Sum rewards: 42.391, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.356', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO4': '0.132', 'AMMO3': '0.172', 'weapon5': '0.276', 'weapon4': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.604', 'WEAPON3': '1.050', 'HITCOUNT': '2.430', 'weapon3': '2.540', 'DAMAGECOUNT': '11.187', 'FRAGCOUNT': '37.000'} [2023-02-25 14:21:34,702][36138] Updated weights for policy 0, policy_version 50363 (0.0010) [2023-02-25 14:21:34,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 206286848. Throughput: 0: 3346.3. Samples: 14069162. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:21:34,730][36114] Avg episode reward: [(0, '57.751')] [2023-02-25 14:21:35,420][36156] DAMAGECOUNT value on done: 985784.0 [2023-02-25 14:21:35,420][36156] Sum rewards: 66.279, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.760', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.098', 'AMMO4': '0.139', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.440', 'weapon4': '0.700', 'WEAPON3': '1.100', 'weapon3': '2.494', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '56.000'} [2023-02-25 14:21:35,439][36156] DAMAGECOUNT value on done: 991401.0 [2023-02-25 14:21:35,439][36156] Sum rewards: 63.238, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.746', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'weapon5': '0.056', 'AMMO4': '0.065', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.402', 'weapon2': '0.430', 'WEAPON3': '1.100', 'weapon3': '2.816', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '53.000'} [2023-02-25 14:21:35,729][36156] DAMAGECOUNT value on done: 970514.0 [2023-02-25 14:21:35,730][36156] Sum rewards: 46.259, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.866', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.090', 'weapon4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.238', 'AMMO3': '0.254', 'WEAPON3': '1.500', 'HITCOUNT': '2.820', 'weapon3': '3.302', 'DAMAGECOUNT': '12.900', 'FRAGCOUNT': '43.000'} [2023-02-25 14:21:35,758][36156] DAMAGECOUNT value on done: 978452.0 [2023-02-25 14:21:35,759][36156] Sum rewards: 58.891, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.650', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.090', 'AMMO4': '0.207', 'AMMO3': '0.223', 'WEAPON5': '0.300', 'weapon4': '0.420', 'WEAPON4': '0.450', 'weapon2': '0.494', 'WEAPON3': '1.450', 'weapon3': '2.782', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.399', 'FRAGCOUNT': '53.000'} [2023-02-25 14:21:37,714][36138] Updated weights for policy 0, policy_version 50373 (0.0009) [2023-02-25 14:21:39,729][36114] Fps is (10 sec: 13517.0, 60 sec: 13380.2, 300 sec: 13412.7). Total num frames: 206352384. Throughput: 0: 3348.6. Samples: 14079268. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:21:39,730][36114] Avg episode reward: [(0, '57.854')] [2023-02-25 14:21:40,783][36138] Updated weights for policy 0, policy_version 50383 (0.0009) [2023-02-25 14:21:43,895][36138] Updated weights for policy 0, policy_version 50393 (0.0009) [2023-02-25 14:21:44,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.2, 300 sec: 13412.7). Total num frames: 206417920. Throughput: 0: 3346.3. Samples: 14099302. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:21:44,730][36114] Avg episode reward: [(0, '57.854')] [2023-02-25 14:21:46,633][36139] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:21:47,125][36138] Updated weights for policy 0, policy_version 50403 (0.0010) [2023-02-25 14:21:47,172][36154] DAMAGECOUNT value on done: 986209.0 [2023-02-25 14:21:47,173][36154] Sum rewards: 63.327, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.648', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.175', 'weapon4': '0.182', 'weapon2': '0.372', 'WEAPON3': '1.100', 'weapon3': '3.108', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '52.000'} [2023-02-25 14:21:47,452][36154] DAMAGECOUNT value on done: 987924.0 [2023-02-25 14:21:47,452][36154] Sum rewards: 59.353, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.145', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.181', 'weapon5': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.384', 'weapon4': '0.428', 'WEAPON3': '1.100', 'weapon3': '2.678', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.604', 'FRAGCOUNT': '51.000'} [2023-02-25 14:21:47,489][36154] DAMAGECOUNT value on done: 971890.0 [2023-02-25 14:21:47,489][36154] Sum rewards: 61.299, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.567', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.132', 'WEAPON4': '0.300', 'weapon2': '0.652', 'weapon4': '0.670', 'WEAPON3': '0.850', 'weapon3': '2.298', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '50.000'} [2023-02-25 14:21:47,762][36154] DAMAGECOUNT value on done: 980581.0 [2023-02-25 14:21:47,763][36154] Sum rewards: 56.017, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.650', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.186', 'weapon5': '0.288', 'weapon2': '0.370', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.576', 'WEAPON3': '1.100', 'weapon3': '2.326', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.369', 'FRAGCOUNT': '46.000'} [2023-02-25 14:21:48,024][36141] DAMAGECOUNT value on done: 987112.0 [2023-02-25 14:21:48,024][36141] Sum rewards: 64.831, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.318', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.083', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'weapon5': '0.238', 'weapon4': '0.284', 'weapon2': '0.392', 'WEAPON3': '1.250', 'weapon3': '2.828', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '55.000'} [2023-02-25 14:21:48,239][36141] DAMAGECOUNT value on done: 976929.0 [2023-02-25 14:21:48,239][36141] Sum rewards: 55.073, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.010', 'AMMO5': '0.014', 'AMMO2': '0.035', 'AMMO4': '0.175', 'AMMO3': '0.179', 'weapon5': '0.234', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON4': '0.400', 'weapon4': '0.530', 'WEAPON3': '1.000', 'weapon3': '2.588', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.817', 'FRAGCOUNT': '48.000'} [2023-02-25 14:21:48,351][36141] DAMAGECOUNT value on done: 985137.0 [2023-02-25 14:21:48,352][36141] Sum rewards: 40.199, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.244', 'ARMOR': '0.004', 'AMMO5': '0.031', 'AMMO2': '0.086', 'AMMO3': '0.147', 'weapon5': '0.320', 'AMMO4': '0.428', 'weapon4': '0.602', 'WEAPON5': '0.750', 'weapon2': '0.798', 'WEAPON3': '0.800', 'WEAPON4': '0.900', 'weapon3': '1.862', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '11.724', 'FRAGCOUNT': '38.000'} [2023-02-25 14:21:48,564][36141] DAMAGECOUNT value on done: 971776.0 [2023-02-25 14:21:48,564][36141] Sum rewards: 47.824, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.690', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO3': '0.174', 'AMMO4': '0.187', 'weapon2': '0.224', 'weapon5': '0.288', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.866', 'WEAPON3': '1.050', 'weapon3': '2.294', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.837', 'FRAGCOUNT': '42.000'} [2023-02-25 14:21:49,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13312.0, 300 sec: 13398.8). Total num frames: 206483456. Throughput: 0: 3331.3. Samples: 14118604. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:21:49,730][36114] Avg episode reward: [(0, '57.471')] [2023-02-25 14:21:50,200][36138] Updated weights for policy 0, policy_version 50413 (0.0009) [2023-02-25 14:21:50,396][36157] DAMAGECOUNT value on done: 994616.0 [2023-02-25 14:21:50,396][36157] Sum rewards: 65.673, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.050', 'AMMO5': '0.012', 'AMMO2': '0.043', 'AMMO3': '0.186', 'weapon5': '0.206', 'AMMO4': '0.215', 'weapon2': '0.224', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.606', 'WEAPON3': '1.100', 'weapon3': '2.692', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '55.000'} [2023-02-25 14:21:50,698][36157] DAMAGECOUNT value on done: 982815.0 [2023-02-25 14:21:50,699][36157] Sum rewards: 55.078, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.679', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.106', 'AMMO4': '0.170', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.302', 'weapon4': '0.348', 'WEAPON3': '1.350', 'weapon3': '2.972', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.111', 'FRAGCOUNT': '49.000'} [2023-02-25 14:21:51,482][36157] DAMAGECOUNT value on done: 992615.0 [2023-02-25 14:21:51,483][36157] Sum rewards: 58.919, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.417', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.172', 'AMMO3': '0.183', 'weapon4': '0.348', 'weapon2': '0.444', 'WEAPON3': '1.050', 'weapon3': '2.800', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.277', 'FRAGCOUNT': '50.000'} [2023-02-25 14:21:51,488][36140] DAMAGECOUNT value on done: 985816.0 [2023-02-25 14:21:51,489][36140] Sum rewards: 62.450, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.360', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon5': '0.184', 'AMMO3': '0.215', 'AMMO4': '0.242', 'weapon4': '0.364', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.486', 'WEAPON3': '1.300', 'weapon3': '2.584', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '56.000'} [2023-02-25 14:21:51,793][36157] DAMAGECOUNT value on done: 986987.0 [2023-02-25 14:21:51,793][36157] Sum rewards: 57.946, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.964', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.030', 'weapon5': '0.088', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'weapon2': '0.362', 'WEAPON3': '1.450', 'HITCOUNT': '3.060', 'weapon3': '3.298', 'DAMAGECOUNT': '15.897', 'FRAGCOUNT': '50.000'} [2023-02-25 14:21:51,796][36140] DAMAGECOUNT value on done: 982707.0 [2023-02-25 14:21:51,796][36140] Sum rewards: 53.758, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.862', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon5': '0.194', 'AMMO3': '0.216', 'weapon2': '0.258', 'AMMO4': '0.273', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.710', 'WEAPON3': '1.200', 'weapon3': '2.508', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.129', 'FRAGCOUNT': '46.000'} [2023-02-25 14:21:51,805][36140] DAMAGECOUNT value on done: 971064.0 [2023-02-25 14:21:51,806][36140] Sum rewards: 70.530, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.170', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.048', 'AMMO3': '0.183', 'weapon2': '0.236', 'AMMO4': '0.240', 'weapon5': '0.296', 'weapon4': '0.436', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.724', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.709', 'FRAGCOUNT': '60.000'} [2023-02-25 14:21:51,855][36155] DAMAGECOUNT value on done: 975035.0 [2023-02-25 14:21:51,856][36155] Sum rewards: 52.304, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.379', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.096', 'weapon4': '0.138', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon2': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.830', 'weapon3': '3.132', 'DAMAGECOUNT': '13.350', 'FRAGCOUNT': '46.000'} [2023-02-25 14:21:52,112][36140] DAMAGECOUNT value on done: 975863.0 [2023-02-25 14:21:52,113][36140] Sum rewards: 52.776, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.412', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.050', 'AMMO3': '0.186', 'weapon5': '0.194', 'AMMO4': '0.248', 'weapon2': '0.346', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.466', 'WEAPON3': '1.100', 'weapon3': '2.692', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.187', 'FRAGCOUNT': '46.000'} [2023-02-25 14:21:52,161][36155] DAMAGECOUNT value on done: 985775.0 [2023-02-25 14:21:52,162][36155] Sum rewards: 55.292, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.246', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.146', 'AMMO3': '0.181', 'weapon2': '0.218', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.482', 'WEAPON3': '1.050', 'weapon3': '2.782', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.385', 'FRAGCOUNT': '47.000'} [2023-02-25 14:21:53,121][36155] DAMAGECOUNT value on done: 994662.0 [2023-02-25 14:21:53,121][36155] Sum rewards: 51.229, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.980', 'ARMOR': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.066', 'AMMO3': '0.141', 'AMMO4': '0.332', 'weapon2': '0.400', 'weapon5': '0.498', 'WEAPON5': '0.700', 'weapon4': '0.770', 'WEAPON3': '0.800', 'WEAPON4': '0.800', 'weapon3': '1.798', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.381', 'FRAGCOUNT': '43.500'} [2023-02-25 14:21:53,269][36138] Updated weights for policy 0, policy_version 50423 (0.0010) [2023-02-25 14:21:53,411][36155] DAMAGECOUNT value on done: 979230.0 [2023-02-25 14:21:53,412][36155] Sum rewards: 60.811, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.895', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.118', 'weapon4': '0.172', 'weapon2': '0.192', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '2.870', 'weapon3': '3.292', 'DAMAGECOUNT': '15.078', 'FRAGCOUNT': '54.000'} [2023-02-25 14:21:53,484][36142] DAMAGECOUNT value on done: 984981.0 [2023-02-25 14:21:53,484][36142] Sum rewards: 61.089, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.089', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.049', 'weapon5': '0.132', 'AMMO3': '0.214', 'AMMO4': '0.245', 'WEAPON5': '0.300', 'weapon2': '0.422', 'weapon4': '0.548', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.568', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '54.000'} [2023-02-25 14:21:53,680][36139] DAMAGECOUNT value on done: 983169.0 [2023-02-25 14:21:53,680][36139] Sum rewards: 51.927, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.695', 'AMMO5': '0.006', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.150', 'AMMO3': '0.251', 'weapon4': '0.260', 'WEAPON3': '1.550', 'HITCOUNT': '3.060', 'weapon3': '3.174', 'DAMAGECOUNT': '14.394', 'FRAGCOUNT': '47.000'} [2023-02-25 14:21:53,791][36142] DAMAGECOUNT value on done: 964559.0 [2023-02-25 14:21:53,791][36142] Sum rewards: 54.954, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.360', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon2': '0.204', 'WEAPON3': '1.300', 'HITCOUNT': '3.030', 'weapon3': '3.542', 'DAMAGECOUNT': '13.968', 'FRAGCOUNT': '48.000'} [2023-02-25 14:21:53,972][36139] DAMAGECOUNT value on done: 981510.0 [2023-02-25 14:21:53,973][36139] Sum rewards: 66.608, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.645', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.050', 'AMMO4': '0.073', 'weapon2': '0.138', 'AMMO3': '0.283', 'WEAPON3': '1.700', 'HITCOUNT': '3.400', 'weapon3': '3.524', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '59.000'} [2023-02-25 14:21:54,071][36139] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:21:54,174][36139] DAMAGECOUNT value on done: 996036.0 [2023-02-25 14:21:54,174][36139] Sum rewards: 51.596, reward structure: {'DEATHCOUNT': '-21.750', 'HEALTH': '-2.792', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon4': '0.050', 'AMMO4': '0.068', 'weapon5': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.349', 'weapon2': '0.622', 'WEAPON3': '2.000', 'weapon3': '2.894', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.303', 'FRAGCOUNT': '51.500'} [2023-02-25 14:21:54,212][36142] DAMAGECOUNT value on done: 977156.0 [2023-02-25 14:21:54,212][36142] Sum rewards: 53.456, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.862', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.050', 'AMMO3': '0.169', 'weapon5': '0.240', 'AMMO4': '0.252', 'WEAPON5': '0.350', 'weapon2': '0.458', 'weapon4': '0.540', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.422', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '14.415', 'FRAGCOUNT': '47.000'} [2023-02-25 14:21:54,458][36139] DAMAGECOUNT value on done: 984133.0 [2023-02-25 14:21:54,458][36139] Sum rewards: 46.221, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.338', 'AMMO5': '0.006', 'weapon5': '0.018', 'AMMO2': '0.027', 'weapon4': '0.116', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'weapon2': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.276', 'WEAPON3': '1.600', 'HITCOUNT': '2.940', 'weapon3': '3.476', 'DAMAGECOUNT': '13.959', 'FRAGCOUNT': '43.500'} [2023-02-25 14:21:54,510][36142] DAMAGECOUNT value on done: 993653.0 [2023-02-25 14:21:54,511][36142] Sum rewards: 52.632, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.645', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.184', 'weapon5': '0.186', 'weapon2': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.636', 'WEAPON3': '1.150', 'weapon3': '2.544', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.364', 'FRAGCOUNT': '44.000'} [2023-02-25 14:21:54,729][36114] Fps is (10 sec: 13107.4, 60 sec: 13312.0, 300 sec: 13398.8). Total num frames: 206548992. Throughput: 0: 3332.5. Samples: 14128700. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:21:54,729][36114] Avg episode reward: [(0, '57.233')] [2023-02-25 14:21:55,687][36156] DAMAGECOUNT value on done: 990388.0 [2023-02-25 14:21:55,688][36156] Sum rewards: 51.369, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.956', 'AMMO5': '0.003', 'weapon7': '0.006', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.050', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.166', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.203', 'weapon2': '0.818', 'WEAPON3': '1.250', 'weapon3': '2.782', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.812', 'FRAGCOUNT': '43.000'} [2023-02-25 14:21:55,736][36156] DAMAGECOUNT value on done: 996450.0 [2023-02-25 14:21:55,737][36156] Sum rewards: 52.719, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.294', 'AMMO5': '0.013', 'AMMO2': '0.050', 'AMMO3': '0.161', 'weapon5': '0.182', 'AMMO4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.426', 'WEAPON4': '0.550', 'weapon2': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.514', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '15.147', 'FRAGCOUNT': '46.000'} [2023-02-25 14:21:56,013][36156] DAMAGECOUNT value on done: 975989.0 [2023-02-25 14:21:56,013][36156] Sum rewards: 67.008, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.570', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.059', 'AMMO3': '0.187', 'weapon5': '0.270', 'AMMO4': '0.295', 'weapon2': '0.440', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.596', 'WEAPON3': '1.150', 'weapon3': '2.176', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '57.000'} [2023-02-25 14:21:56,064][36156] DAMAGECOUNT value on done: 983410.0 [2023-02-25 14:21:56,065][36156] Sum rewards: 55.725, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.912', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon4': '0.102', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.228', 'weapon2': '0.362', 'WEAPON3': '1.100', 'HITCOUNT': '2.940', 'weapon3': '3.090', 'DAMAGECOUNT': '14.874', 'FRAGCOUNT': '46.000'} [2023-02-25 14:21:56,336][36138] Updated weights for policy 0, policy_version 50433 (0.0009) [2023-02-25 14:21:59,407][36138] Updated weights for policy 0, policy_version 50443 (0.0009) [2023-02-25 14:21:59,625][36142] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:21:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 206618624. Throughput: 0: 3332.3. Samples: 14148826. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:21:59,730][36114] Avg episode reward: [(0, '57.297')] [2023-02-25 14:22:02,456][36138] Updated weights for policy 0, policy_version 50453 (0.0010) [2023-02-25 14:22:04,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13312.0, 300 sec: 13398.8). Total num frames: 206684160. Throughput: 0: 3331.3. Samples: 14168890. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:22:04,730][36114] Avg episode reward: [(0, '57.297')] [2023-02-25 14:22:05,530][36138] Updated weights for policy 0, policy_version 50463 (0.0009) [2023-02-25 14:22:07,357][36154] DAMAGECOUNT value on done: 991732.0 [2023-02-25 14:22:07,358][36154] Sum rewards: 62.574, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.140', 'AMMO5': '0.011', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.090', 'AMMO3': '0.229', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.376', 'weapon2': '0.464', 'WEAPON3': '1.500', 'weapon3': '2.772', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '57.000'} [2023-02-25 14:22:07,562][36154] DAMAGECOUNT value on done: 992780.0 [2023-02-25 14:22:07,563][36154] Sum rewards: 50.526, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.612', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.046', 'weapon5': '0.166', 'AMMO3': '0.191', 'AMMO4': '0.232', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'weapon4': '0.702', 'weapon2': '0.726', 'WEAPON3': '1.150', 'weapon3': '2.078', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.568', 'FRAGCOUNT': '45.500'} [2023-02-25 14:22:07,678][36154] DAMAGECOUNT value on done: 977458.0 [2023-02-25 14:22:07,678][36154] Sum rewards: 60.545, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.894', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.063', 'AMMO3': '0.206', 'weapon2': '0.308', 'AMMO4': '0.315', 'weapon5': '0.368', 'weapon4': '0.520', 'WEAPON5': '0.700', 'WEAPON4': '0.750', 'WEAPON3': '1.200', 'weapon3': '2.344', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.704', 'FRAGCOUNT': '54.000'} [2023-02-25 14:22:07,883][36154] DAMAGECOUNT value on done: 986034.0 [2023-02-25 14:22:07,883][36154] Sum rewards: 65.607, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.326', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.136', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon2': '0.232', 'weapon4': '0.530', 'WEAPON3': '1.250', 'weapon3': '2.790', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '56.000'} [2023-02-25 14:22:08,025][36141] DAMAGECOUNT value on done: 991728.0 [2023-02-25 14:22:08,025][36141] Sum rewards: 50.403, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.250', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.160', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.262', 'weapon2': '0.336', 'WEAPON3': '1.450', 'HITCOUNT': '2.890', 'weapon3': '2.910', 'DAMAGECOUNT': '13.773', 'FRAGCOUNT': '46.000'} [2023-02-25 14:22:08,241][36141] DAMAGECOUNT value on done: 980914.0 [2023-02-25 14:22:08,241][36141] Sum rewards: 43.339, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.878', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.040', 'AMMO4': '0.199', 'AMMO3': '0.217', 'weapon5': '0.242', 'weapon2': '0.344', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.704', 'WEAPON3': '1.250', 'weapon3': '2.132', 'HITCOUNT': '2.270', 'DAMAGECOUNT': '11.955', 'FRAGCOUNT': '41.000'} [2023-02-25 14:22:08,345][36141] DAMAGECOUNT value on done: 990278.0 [2023-02-25 14:22:08,345][36141] Sum rewards: 58.706, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.246', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.116', 'WEAPON5': '0.200', 'weapon2': '0.248', 'weapon4': '0.248', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.060', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '52.000'} [2023-02-25 14:22:08,566][36141] DAMAGECOUNT value on done: 976377.0 [2023-02-25 14:22:08,566][36141] Sum rewards: 55.681, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.246', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.034', 'AMMO4': '0.170', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'weapon5': '0.274', 'WEAPON4': '0.350', 'weapon2': '0.452', 'weapon4': '0.460', 'WEAPON3': '1.250', 'weapon3': '2.608', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.803', 'FRAGCOUNT': '50.000'} [2023-02-25 14:22:08,592][36138] Updated weights for policy 0, policy_version 50473 (0.0009) [2023-02-25 14:22:09,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13312.0, 300 sec: 13398.8). Total num frames: 206749696. Throughput: 0: 3334.7. Samples: 14179030. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:22:09,729][36114] Avg episode reward: [(0, '57.248')] [2023-02-25 14:22:10,338][36157] DAMAGECOUNT value on done: 999731.0 [2023-02-25 14:22:10,338][36157] Sum rewards: 56.534, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.612', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon2': '0.188', 'AMMO4': '0.189', 'AMMO3': '0.205', 'weapon5': '0.222', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.838', 'WEAPON3': '1.200', 'weapon3': '2.290', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '50.000'} [2023-02-25 14:22:10,655][36157] DAMAGECOUNT value on done: 987448.0 [2023-02-25 14:22:10,655][36157] Sum rewards: 52.509, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.220', 'AMMO5': '0.029', 'AMMO2': '0.049', 'weapon5': '0.200', 'AMMO3': '0.225', 'weapon4': '0.230', 'AMMO4': '0.247', 'weapon2': '0.402', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'HITCOUNT': '2.710', 'weapon3': '2.838', 'DAMAGECOUNT': '13.899', 'FRAGCOUNT': '48.000'} [2023-02-25 14:22:11,519][36157] DAMAGECOUNT value on done: 997899.0 [2023-02-25 14:22:11,520][36157] Sum rewards: 56.087, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.581', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.176', 'weapon4': '0.198', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.150', 'weapon3': '2.930', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '47.000'} [2023-02-25 14:22:11,567][36140] DAMAGECOUNT value on done: 991795.0 [2023-02-25 14:22:11,567][36140] Sum rewards: 73.523, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.384', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.114', 'AMMO4': '0.191', 'weapon4': '0.198', 'AMMO3': '0.202', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.428', 'WEAPON3': '1.100', 'weapon3': '3.010', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '62.000'} [2023-02-25 14:22:11,621][36138] Updated weights for policy 0, policy_version 50483 (0.0009) [2023-02-25 14:22:11,739][36155] DAMAGECOUNT value on done: 980542.0 [2023-02-25 14:22:11,740][36155] Sum rewards: 61.555, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.462', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.074', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'weapon2': '0.276', 'weapon4': '0.286', 'WEAPON3': '1.300', 'weapon3': '3.114', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.521', 'FRAGCOUNT': '53.000'} [2023-02-25 14:22:11,828][36157] DAMAGECOUNT value on done: 992387.0 [2023-02-25 14:22:11,828][36157] Sum rewards: 59.682, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.360', 'AMMO5': '0.016', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.194', 'weapon4': '0.198', 'AMMO3': '0.232', 'weapon2': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.042', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.200', 'FRAGCOUNT': '52.000'} [2023-02-25 14:22:11,885][36140] DAMAGECOUNT value on done: 987684.0 [2023-02-25 14:22:11,886][36140] Sum rewards: 52.473, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.784', 'AMMO5': '0.022', 'AMMO2': '0.039', 'AMMO4': '0.196', 'AMMO3': '0.232', 'weapon2': '0.246', 'weapon5': '0.272', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon4': '0.578', 'WEAPON3': '1.350', 'weapon3': '2.550', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.931', 'FRAGCOUNT': '47.000'} [2023-02-25 14:22:11,895][36140] DAMAGECOUNT value on done: 976255.0 [2023-02-25 14:22:11,896][36140] Sum rewards: 58.782, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.470', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.148', 'AMMO3': '0.184', 'weapon4': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.266', 'WEAPON3': '1.100', 'weapon3': '3.138', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.573', 'FRAGCOUNT': '49.000'} [2023-02-25 14:22:12,030][36155] DAMAGECOUNT value on done: 990730.0 [2023-02-25 14:22:12,030][36155] Sum rewards: 51.197, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.422', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon5': '0.048', 'AMMO4': '0.179', 'weapon4': '0.202', 'AMMO3': '0.244', 'WEAPON5': '0.300', 'weapon2': '0.392', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.038', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '48.000'} [2023-02-25 14:22:12,201][36140] DAMAGECOUNT value on done: 980782.0 [2023-02-25 14:22:12,201][36140] Sum rewards: 56.732, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.390', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.130', 'AMMO3': '0.131', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON4': '0.350', 'weapon4': '0.702', 'WEAPON3': '0.850', 'weapon3': '2.486', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.757', 'FRAGCOUNT': '46.000'} [2023-02-25 14:22:12,940][36155] DAMAGECOUNT value on done: 999616.0 [2023-02-25 14:22:12,940][36155] Sum rewards: 56.702, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.482', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'weapon5': '0.050', 'AMMO4': '0.065', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.212', 'weapon4': '0.242', 'AMMO3': '0.266', 'WEAPON3': '1.650', 'weapon3': '3.212', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '51.000'} [2023-02-25 14:22:13,221][36155] DAMAGECOUNT value on done: 984148.0 [2023-02-25 14:22:13,221][36155] Sum rewards: 56.089, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.953', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.090', 'AMMO4': '0.157', 'AMMO3': '0.180', 'weapon4': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.000', 'weapon3': '3.030', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.754', 'FRAGCOUNT': '47.000'} [2023-02-25 14:22:13,423][36142] DAMAGECOUNT value on done: 990253.0 [2023-02-25 14:22:13,424][36142] Sum rewards: 61.245, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.046', 'AMMO5': '0.013', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.158', 'AMMO3': '0.207', 'weapon2': '0.346', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.646', 'WEAPON3': '1.200', 'weapon3': '2.568', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '53.000'} [2023-02-25 14:22:13,635][36139] DAMAGECOUNT value on done: 988246.0 [2023-02-25 14:22:13,635][36139] Sum rewards: 56.039, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.392', 'AMMO5': '0.022', 'AMMO2': '0.023', 'AMMO4': '0.117', 'AMMO3': '0.157', 'weapon5': '0.186', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.440', 'weapon2': '0.586', 'WEAPON3': '0.950', 'weapon3': '2.458', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.231', 'FRAGCOUNT': '47.000'} [2023-02-25 14:22:13,738][36142] DAMAGECOUNT value on done: 970478.0 [2023-02-25 14:22:13,739][36142] Sum rewards: 67.298, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.555', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.122', 'AMMO3': '0.173', 'weapon5': '0.184', 'weapon4': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON3': '1.100', 'weapon3': '3.034', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '55.500'} [2023-02-25 14:22:13,931][36139] DAMAGECOUNT value on done: 987141.0 [2023-02-25 14:22:13,932][36139] Sum rewards: 69.530, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.410', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon5': '0.086', 'AMMO4': '0.116', 'weapon4': '0.150', 'AMMO3': '0.173', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.598', 'WEAPON3': '1.200', 'weapon3': '2.982', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '61.000'} [2023-02-25 14:22:14,157][36139] DAMAGECOUNT value on done: 1001088.0 [2023-02-25 14:22:14,157][36139] Sum rewards: 52.667, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.410', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO4': '0.180', 'AMMO3': '0.245', 'weapon5': '0.246', 'weapon2': '0.308', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'weapon4': '0.664', 'WEAPON3': '1.500', 'weapon3': '2.440', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.156', 'FRAGCOUNT': '51.000'} [2023-02-25 14:22:14,222][36142] DAMAGECOUNT value on done: 983444.0 [2023-02-25 14:22:14,222][36142] Sum rewards: 64.916, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.483', 'ARMOR': '0.020', 'AMMO5': '0.021', 'AMMO2': '0.049', 'AMMO3': '0.214', 'AMMO4': '0.247', 'weapon2': '0.268', 'weapon5': '0.304', 'WEAPON5': '0.600', 'weapon4': '0.612', 'WEAPON4': '0.700', 'WEAPON3': '1.400', 'weapon3': '2.450', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.864', 'FRAGCOUNT': '58.000'} [2023-02-25 14:22:14,453][36139] DAMAGECOUNT value on done: 989510.0 [2023-02-25 14:22:14,453][36139] Sum rewards: 59.295, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.040', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.110', 'AMMO4': '0.141', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.304', 'weapon4': '0.378', 'WEAPON3': '1.150', 'weapon3': '2.820', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.131', 'FRAGCOUNT': '49.500'} [2023-02-25 14:22:14,525][36142] DAMAGECOUNT value on done: 997607.0 [2023-02-25 14:22:14,525][36142] Sum rewards: 38.249, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.769', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon5': '0.116', 'AMMO4': '0.158', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.256', 'weapon4': '0.294', 'WEAPON4': '0.350', 'ARMOR': '0.487', 'WEAPON3': '1.200', 'HITCOUNT': '2.460', 'weapon3': '3.078', 'DAMAGECOUNT': '11.862', 'FRAGCOUNT': '35.500'} [2023-02-25 14:22:14,629][36138] Updated weights for policy 0, policy_version 50493 (0.0009) [2023-02-25 14:22:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 206819328. Throughput: 0: 3339.0. Samples: 14199256. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:22:14,730][36114] Avg episode reward: [(0, '57.032')] [2023-02-25 14:22:15,745][36156] DAMAGECOUNT value on done: 995400.0 [2023-02-25 14:22:15,746][36156] Sum rewards: 58.565, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.502', 'AMMO5': '0.005', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'weapon5': '0.130', 'WEAPON4': '0.150', 'AMMO4': '0.150', 'AMMO3': '0.227', 'weapon2': '0.284', 'weapon4': '0.444', 'WEAPON3': '1.450', 'weapon3': '2.950', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.036', 'FRAGCOUNT': '51.000'} [2023-02-25 14:22:15,792][36156] DAMAGECOUNT value on done: 1001790.0 [2023-02-25 14:22:15,792][36156] Sum rewards: 66.929, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.570', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.032', 'weapon5': '0.052', 'weapon4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.218', 'weapon2': '0.228', 'WEAPON3': '1.350', 'HITCOUNT': '3.380', 'weapon3': '3.458', 'DAMAGECOUNT': '15.990', 'FRAGCOUNT': '57.000'} [2023-02-25 14:22:16,053][36156] DAMAGECOUNT value on done: 981347.0 [2023-02-25 14:22:16,054][36156] Sum rewards: 64.122, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.215', 'AMMO5': '0.009', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon4': '0.092', 'weapon5': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'weapon2': '0.412', 'WEAPON3': '1.400', 'weapon3': '3.120', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.074', 'FRAGCOUNT': '56.000'} [2023-02-25 14:22:16,104][36156] DAMAGECOUNT value on done: 987840.0 [2023-02-25 14:22:16,104][36156] Sum rewards: 52.576, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.492', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.193', 'weapon2': '0.250', 'weapon5': '0.252', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.732', 'WEAPON3': '1.150', 'weapon3': '2.498', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.290', 'FRAGCOUNT': '47.000'} [2023-02-25 14:22:17,662][36138] Updated weights for policy 0, policy_version 50503 (0.0010) [2023-02-25 14:22:19,729][36114] Fps is (10 sec: 13516.6, 60 sec: 13312.0, 300 sec: 13398.8). Total num frames: 206884864. Throughput: 0: 3342.6. Samples: 14219580. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:22:19,730][36114] Avg episode reward: [(0, '56.992')] [2023-02-25 14:22:20,693][36138] Updated weights for policy 0, policy_version 50513 (0.0009) [2023-02-25 14:22:20,797][36139] Large shaping reward 2.560 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.528, 176.0), ('weapon5', 0.002)] [2023-02-25 14:22:23,728][36138] Updated weights for policy 0, policy_version 50523 (0.0010) [2023-02-25 14:22:24,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 206954496. Throughput: 0: 3343.5. Samples: 14229726. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:22:24,729][36114] Avg episode reward: [(0, '56.992')] [2023-02-25 14:22:26,771][36138] Updated weights for policy 0, policy_version 50533 (0.0010) [2023-02-25 14:22:27,291][36154] DAMAGECOUNT value on done: 997536.0 [2023-02-25 14:22:27,292][36154] Sum rewards: 70.864, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.123', 'AMMO5': '0.020', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.182', 'weapon4': '0.202', 'weapon5': '0.208', 'WEAPON4': '0.350', 'weapon2': '0.484', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.776', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '60.000'} [2023-02-25 14:22:27,587][36154] DAMAGECOUNT value on done: 997687.0 [2023-02-25 14:22:27,588][36154] Sum rewards: 58.214, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.145', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.054', 'AMMO4': '0.120', 'weapon5': '0.130', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.290', 'WEAPON3': '1.100', 'HITCOUNT': '2.830', 'weapon3': '3.264', 'DAMAGECOUNT': '14.721', 'FRAGCOUNT': '49.000'} [2023-02-25 14:22:27,617][36154] DAMAGECOUNT value on done: 982566.0 [2023-02-25 14:22:27,617][36154] Sum rewards: 65.806, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.736', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.162', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.294', 'weapon4': '0.520', 'WEAPON3': '1.050', 'weapon3': '2.698', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.324', 'FRAGCOUNT': '55.000'} [2023-02-25 14:22:27,894][36154] DAMAGECOUNT value on done: 991335.0 [2023-02-25 14:22:27,895][36154] Sum rewards: 58.469, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.362', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.108', 'AMMO4': '0.115', 'WEAPON5': '0.200', 'weapon4': '0.210', 'WEAPON4': '0.250', 'AMMO3': '0.267', 'weapon2': '0.276', 'WEAPON3': '1.700', 'weapon3': '3.058', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '53.000'} [2023-02-25 14:22:27,915][36141] DAMAGECOUNT value on done: 996134.0 [2023-02-25 14:22:27,916][36141] Sum rewards: 40.662, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.276', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon4': '0.148', 'weapon5': '0.186', 'AMMO3': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.392', 'WEAPON3': '1.550', 'HITCOUNT': '2.840', 'weapon3': '2.948', 'DAMAGECOUNT': '12.975', 'FRAGCOUNT': '39.500'} [2023-02-25 14:22:28,139][36141] DAMAGECOUNT value on done: 986268.0 [2023-02-25 14:22:28,140][36141] Sum rewards: 57.851, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.176', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.036', 'AMMO4': '0.085', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.241', 'weapon2': '0.442', 'WEAPON3': '1.550', 'weapon3': '3.186', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.062', 'FRAGCOUNT': '53.000'} [2023-02-25 14:22:28,229][36141] DAMAGECOUNT value on done: 996120.0 [2023-02-25 14:22:28,229][36141] Sum rewards: 56.686, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.309', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.054', 'AMMO3': '0.227', 'weapon5': '0.268', 'AMMO4': '0.272', 'weapon2': '0.274', 'WEAPON5': '0.450', 'weapon4': '0.466', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.648', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '49.500'} [2023-02-25 14:22:28,447][36141] DAMAGECOUNT value on done: 980374.0 [2023-02-25 14:22:28,447][36141] Sum rewards: 43.831, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.212', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.039', 'AMMO3': '0.104', 'weapon5': '0.160', 'AMMO4': '0.196', 'WEAPON5': '0.500', 'weapon2': '0.532', 'WEAPON4': '0.600', 'WEAPON3': '0.750', 'weapon4': '0.772', 'weapon3': '2.066', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '11.991', 'FRAGCOUNT': '35.500'} [2023-02-25 14:22:28,602][36156] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:22:29,729][36114] Fps is (10 sec: 13517.1, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 207020032. Throughput: 0: 3345.3. Samples: 14249840. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:22:29,729][36114] Avg episode reward: [(0, '56.685')] [2023-02-25 14:22:29,827][36138] Updated weights for policy 0, policy_version 50543 (0.0010) [2023-02-25 14:22:30,238][36157] DAMAGECOUNT value on done: 1005143.0 [2023-02-25 14:22:30,239][36157] Sum rewards: 60.665, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.770', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.041', 'AMMO3': '0.144', 'weapon4': '0.202', 'AMMO4': '0.204', 'weapon5': '0.270', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.720', 'WEAPON3': '0.900', 'weapon3': '2.548', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.236', 'FRAGCOUNT': '50.000'} [2023-02-25 14:22:30,541][36157] DAMAGECOUNT value on done: 992055.0 [2023-02-25 14:22:30,542][36157] Sum rewards: 58.318, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.890', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.150', 'AMMO3': '0.155', 'weapon2': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.620', 'WEAPON3': '0.900', 'weapon3': '2.654', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.821', 'FRAGCOUNT': '49.000'} [2023-02-25 14:22:31,300][36157] DAMAGECOUNT value on done: 1002611.0 [2023-02-25 14:22:31,301][36157] Sum rewards: 54.293, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.893', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon5': '0.094', 'weapon4': '0.132', 'AMMO4': '0.149', 'AMMO3': '0.201', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.400', 'HITCOUNT': '3.060', 'weapon3': '3.162', 'DAMAGECOUNT': '14.136', 'FRAGCOUNT': '49.000'} [2023-02-25 14:22:31,495][36155] DAMAGECOUNT value on done: 984461.0 [2023-02-25 14:22:31,495][36155] Sum rewards: 38.448, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.980', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.062', 'AMMO3': '0.096', 'weapon5': '0.298', 'AMMO4': '0.310', 'WEAPON3': '0.550', 'weapon2': '0.648', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'weapon4': '0.886', 'weapon3': '1.812', 'HITCOUNT': '2.130', 'DAMAGECOUNT': '11.757', 'FRAGCOUNT': '33.000'} [2023-02-25 14:22:31,558][36140] DAMAGECOUNT value on done: 996642.0 [2023-02-25 14:22:31,558][36140] Sum rewards: 50.876, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.560', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon5': '0.184', 'weapon4': '0.190', 'AMMO4': '0.237', 'AMMO3': '0.267', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.924', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.541', 'FRAGCOUNT': '46.000'} [2023-02-25 14:22:31,615][36157] DAMAGECOUNT value on done: 996094.0 [2023-02-25 14:22:31,616][36157] Sum rewards: 40.347, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.398', 'AMMO5': '0.013', 'AMMO2': '0.014', 'AMMO4': '0.067', 'AMMO3': '0.177', 'weapon5': '0.332', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'ARMOR': '0.455', 'weapon2': '0.602', 'weapon4': '0.666', 'WEAPON3': '1.100', 'weapon3': '2.168', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '11.121', 'FRAGCOUNT': '35.500'} [2023-02-25 14:22:31,811][36155] DAMAGECOUNT value on done: 995885.0 [2023-02-25 14:22:31,811][36155] Sum rewards: 57.443, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.069', 'AMMO5': '0.022', 'AMMO2': '0.056', 'AMMO3': '0.215', 'weapon2': '0.240', 'AMMO4': '0.280', 'weapon5': '0.306', 'WEAPON5': '0.600', 'WEAPON4': '0.600', 'weapon4': '0.706', 'WEAPON3': '1.300', 'weapon3': '2.392', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.465', 'FRAGCOUNT': '52.500'} [2023-02-25 14:22:31,856][36140] DAMAGECOUNT value on done: 992831.0 [2023-02-25 14:22:31,857][36140] Sum rewards: 62.780, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.789', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'weapon5': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'weapon2': '0.240', 'weapon4': '0.296', 'WEAPON3': '1.250', 'weapon3': '3.118', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.441', 'FRAGCOUNT': '53.000'} [2023-02-25 14:22:31,866][36140] DAMAGECOUNT value on done: 982136.0 [2023-02-25 14:22:31,867][36140] Sum rewards: 69.209, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.506', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.062', 'weapon5': '0.076', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.321', 'weapon2': '0.524', 'WEAPON3': '1.800', 'weapon3': '3.068', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.643', 'FRAGCOUNT': '64.000'} [2023-02-25 14:22:32,152][36140] DAMAGECOUNT value on done: 986548.0 [2023-02-25 14:22:32,152][36140] Sum rewards: 70.031, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.660', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.080', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'weapon2': '0.316', 'ARMOR': '0.428', 'weapon4': '0.476', 'WEAPON3': '1.450', 'weapon3': '2.880', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '61.000'} [2023-02-25 14:22:32,833][36138] Updated weights for policy 0, policy_version 50553 (0.0010) [2023-02-25 14:22:32,881][36155] DAMAGECOUNT value on done: 1004738.0 [2023-02-25 14:22:32,881][36155] Sum rewards: 57.605, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.770', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.024', 'AMMO4': '0.121', 'AMMO3': '0.167', 'weapon5': '0.232', 'weapon2': '0.254', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon4': '0.700', 'WEAPON3': '1.050', 'weapon3': '2.438', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.366', 'FRAGCOUNT': '48.500'} [2023-02-25 14:22:33,183][36155] DAMAGECOUNT value on done: 989663.0 [2023-02-25 14:22:33,184][36155] Sum rewards: 56.312, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.348', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.156', 'weapon4': '0.174', 'AMMO3': '0.312', 'weapon2': '0.332', 'WEAPON3': '1.900', 'weapon3': '3.064', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '52.000'} [2023-02-25 14:22:33,290][36142] DAMAGECOUNT value on done: 995649.0 [2023-02-25 14:22:33,290][36142] Sum rewards: 60.999, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.632', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.043', 'AMMO3': '0.200', 'AMMO4': '0.217', 'weapon5': '0.224', 'weapon4': '0.260', 'weapon2': '0.280', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.892', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.188', 'FRAGCOUNT': '53.000'} [2023-02-25 14:22:33,438][36139] DAMAGECOUNT value on done: 992882.0 [2023-02-25 14:22:33,439][36139] Sum rewards: 49.006, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.083', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.108', 'AMMO4': '0.148', 'AMMO3': '0.215', 'weapon5': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.200', 'HITCOUNT': '2.940', 'weapon3': '3.126', 'DAMAGECOUNT': '13.908', 'FRAGCOUNT': '43.000'} [2023-02-25 14:22:33,611][36142] DAMAGECOUNT value on done: 976159.0 [2023-02-25 14:22:33,611][36142] Sum rewards: 68.292, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.398', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.140', 'AMMO4': '0.164', 'AMMO3': '0.207', 'weapon4': '0.222', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.066', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '59.000'} [2023-02-25 14:22:33,756][36139] DAMAGECOUNT value on done: 992089.0 [2023-02-25 14:22:33,757][36139] Sum rewards: 56.407, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.833', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.130', 'weapon2': '0.154', 'AMMO3': '0.171', 'AMMO4': '0.183', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.482', 'WEAPON3': '1.050', 'HITCOUNT': '2.930', 'weapon3': '3.046', 'DAMAGECOUNT': '14.844', 'FRAGCOUNT': '48.000'} [2023-02-25 14:22:33,922][36139] DAMAGECOUNT value on done: 1005665.0 [2023-02-25 14:22:33,922][36139] Sum rewards: 53.543, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.600', 'AMMO5': '0.012', 'AMMO2': '0.040', 'AMMO3': '0.170', 'AMMO4': '0.198', 'weapon4': '0.250', 'weapon5': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.636', 'WEAPON3': '1.100', 'weapon3': '2.492', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '13.731', 'FRAGCOUNT': '47.000'} [2023-02-25 14:22:34,211][36142] DAMAGECOUNT value on done: 988651.0 [2023-02-25 14:22:34,211][36142] Sum rewards: 58.854, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.052', 'AMMO5': '0.017', 'AMMO2': '0.049', 'AMMO3': '0.183', 'weapon5': '0.226', 'AMMO4': '0.247', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.484', 'weapon4': '0.654', 'WEAPON3': '1.100', 'weapon3': '2.254', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.621', 'FRAGCOUNT': '50.000'} [2023-02-25 14:22:34,232][36139] DAMAGECOUNT value on done: 995280.0 [2023-02-25 14:22:34,232][36139] Sum rewards: 59.957, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-4.024', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.114', 'AMMO4': '0.132', 'weapon4': '0.264', 'weapon2': '0.286', 'WEAPON5': '0.300', 'AMMO3': '0.304', 'WEAPON4': '0.350', 'WEAPON3': '1.850', 'weapon3': '2.954', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '57.000'} [2023-02-25 14:22:34,529][36142] DAMAGECOUNT value on done: 1001758.0 [2023-02-25 14:22:34,530][36142] Sum rewards: 49.361, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.145', 'AMMO5': '0.016', 'AMMO2': '0.036', 'AMMO3': '0.088', 'AMMO4': '0.181', 'weapon5': '0.292', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.472', 'weapon2': '0.540', 'WEAPON3': '0.600', 'weapon3': '2.448', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '12.423', 'FRAGCOUNT': '39.000'} [2023-02-25 14:22:34,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 207089664. Throughput: 0: 3367.6. Samples: 14270144. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:22:34,730][36114] Avg episode reward: [(0, '56.885')] [2023-02-25 14:22:35,737][36156] DAMAGECOUNT value on done: 1000787.0 [2023-02-25 14:22:35,737][36156] Sum rewards: 64.685, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.440', 'AMMO5': '0.003', 'AMMO2': '0.004', 'ARMOR': '0.004', 'weapon4': '0.010', 'weapon5': '0.014', 'AMMO4': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.235', 'weapon2': '0.248', 'WEAPON3': '1.500', 'HITCOUNT': '3.310', 'weapon3': '3.518', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '57.000'} [2023-02-25 14:22:35,750][36156] DAMAGECOUNT value on done: 1006972.0 [2023-02-25 14:22:35,750][36156] Sum rewards: 57.703, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.247', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.052', 'AMMO4': '0.102', 'weapon5': '0.112', 'weapon2': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'WEAPON3': '1.550', 'HITCOUNT': '3.070', 'weapon3': '3.414', 'DAMAGECOUNT': '15.546', 'FRAGCOUNT': '51.000'} [2023-02-25 14:22:35,853][36138] Updated weights for policy 0, policy_version 50563 (0.0009) [2023-02-25 14:22:36,051][36156] DAMAGECOUNT value on done: 987325.0 [2023-02-25 14:22:36,052][36156] Sum rewards: 70.242, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.486', 'AMMO5': '0.015', 'AMMO2': '0.046', 'AMMO3': '0.142', 'weapon5': '0.156', 'AMMO4': '0.227', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.384', 'weapon2': '0.408', 'WEAPON3': '0.950', 'weapon3': '2.816', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '58.000'} [2023-02-25 14:22:36,063][36156] DAMAGECOUNT value on done: 993138.0 [2023-02-25 14:22:36,063][36156] Sum rewards: 61.275, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.190', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.056', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.278', 'AMMO3': '0.282', 'weapon2': '0.420', 'WEAPON3': '1.700', 'weapon3': '3.014', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.777', 'FRAGCOUNT': '55.000'} [2023-02-25 14:22:38,836][36138] Updated weights for policy 0, policy_version 50573 (0.0010) [2023-02-25 14:22:39,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 207155200. Throughput: 0: 3367.7. Samples: 14280248. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:22:39,729][36114] Avg episode reward: [(0, '57.344')] [2023-02-25 14:22:41,895][36138] Updated weights for policy 0, policy_version 50583 (0.0009) [2023-02-25 14:22:42,088][36142] Large shaping reward 2.568 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.546, 182.0), ('weapon5', 0.002)] [2023-02-25 14:22:44,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13412.7). Total num frames: 207224832. Throughput: 0: 3371.6. Samples: 14300546. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:22:44,730][36114] Avg episode reward: [(0, '57.344')] [2023-02-25 14:22:44,922][36138] Updated weights for policy 0, policy_version 50593 (0.0009) [2023-02-25 14:22:47,071][36157] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:22:47,135][36154] DAMAGECOUNT value on done: 1002077.0 [2023-02-25 14:22:47,135][36154] Sum rewards: 45.947, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-5.410', 'AMMO5': '0.017', 'AMMO2': '0.030', 'weapon5': '0.112', 'AMMO4': '0.152', 'weapon2': '0.268', 'AMMO3': '0.281', 'WEAPON5': '0.300', 'weapon4': '0.346', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'weapon3': '2.938', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.203', 'FRAGCOUNT': '45.000'} [2023-02-25 14:22:47,436][36154] DAMAGECOUNT value on done: 1003266.0 [2023-02-25 14:22:47,436][36154] Sum rewards: 68.564, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.462', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon5': '0.160', 'weapon2': '0.164', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.398', 'WEAPON3': '0.950', 'weapon3': '3.060', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '56.000'} [2023-02-25 14:22:47,445][36154] DAMAGECOUNT value on done: 987746.0 [2023-02-25 14:22:47,446][36154] Sum rewards: 62.803, reward structure: {'DEATHCOUNT': '-12.000', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.090', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'weapon4': '0.262', 'HEALTH': '0.478', 'weapon2': '0.638', 'WEAPON3': '0.900', 'weapon3': '2.854', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.540', 'FRAGCOUNT': '50.000'} [2023-02-25 14:22:47,764][36154] DAMAGECOUNT value on done: 996720.0 [2023-02-25 14:22:47,764][36154] Sum rewards: 59.369, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.000', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.116', 'weapon4': '0.168', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.486', 'WEAPON3': '1.400', 'weapon3': '2.962', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.155', 'FRAGCOUNT': '52.000'} [2023-02-25 14:22:47,861][36141] DAMAGECOUNT value on done: 1001527.0 [2023-02-25 14:22:47,861][36141] Sum rewards: 57.611, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.950', 'AMMO5': '0.023', 'AMMO2': '0.061', 'AMMO3': '0.161', 'weapon5': '0.252', 'AMMO4': '0.303', 'weapon4': '0.394', 'weapon2': '0.416', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'weapon3': '2.542', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '49.000'} [2023-02-25 14:22:47,990][36138] Updated weights for policy 0, policy_version 50603 (0.0010) [2023-02-25 14:22:48,089][36141] DAMAGECOUNT value on done: 991143.0 [2023-02-25 14:22:48,090][36141] Sum rewards: 58.436, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.440', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.175', 'weapon5': '0.176', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.352', 'weapon4': '0.444', 'WEAPON3': '1.150', 'weapon3': '2.720', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.625', 'FRAGCOUNT': '50.000'} [2023-02-25 14:22:48,183][36141] DAMAGECOUNT value on done: 1001417.0 [2023-02-25 14:22:48,183][36141] Sum rewards: 65.812, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.880', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.160', 'AMMO3': '0.240', 'weapon4': '0.298', 'weapon2': '0.352', 'WEAPON3': '1.400', 'weapon3': '3.044', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.891', 'FRAGCOUNT': '56.000'} [2023-02-25 14:22:48,412][36141] DAMAGECOUNT value on done: 985298.0 [2023-02-25 14:22:48,412][36141] Sum rewards: 57.760, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.591', 'AMMO5': '0.019', 'AMMO2': '0.044', 'weapon5': '0.068', 'AMMO3': '0.177', 'AMMO4': '0.221', 'weapon2': '0.236', 'weapon4': '0.346', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.880', 'weapon3': '3.092', 'DAMAGECOUNT': '14.268', 'FRAGCOUNT': '52.000'} [2023-02-25 14:22:49,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 207290368. Throughput: 0: 3373.1. Samples: 14320678. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:22:49,729][36114] Avg episode reward: [(0, '57.360')] [2023-02-25 14:22:50,190][36157] DAMAGECOUNT value on done: 1010257.0 [2023-02-25 14:22:50,191][36157] Sum rewards: 56.150, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.112', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon5': '0.142', 'weapon4': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.268', 'AMMO3': '0.282', 'WEAPON3': '1.650', 'HITCOUNT': '2.940', 'weapon3': '3.042', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '52.000'} [2023-02-25 14:22:50,500][36157] DAMAGECOUNT value on done: 997276.0 [2023-02-25 14:22:50,501][36157] Sum rewards: 61.646, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.132', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO3': '0.154', 'AMMO4': '0.170', 'weapon5': '0.194', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.480', 'weapon4': '0.568', 'WEAPON3': '1.100', 'weapon3': '2.440', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.456', 'FRAGCOUNT': '53.000'} [2023-02-25 14:22:51,027][36138] Updated weights for policy 0, policy_version 50613 (0.0009) [2023-02-25 14:22:51,254][36157] DAMAGECOUNT value on done: 1008040.0 [2023-02-25 14:22:51,254][36157] Sum rewards: 62.718, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.780', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.038', 'weapon5': '0.056', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'weapon2': '0.394', 'WEAPON3': '1.350', 'weapon3': '3.266', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '54.000'} [2023-02-25 14:22:51,405][36155] DAMAGECOUNT value on done: 988330.0 [2023-02-25 14:22:51,406][36155] Sum rewards: 39.781, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.412', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.143', 'WEAPON4': '0.150', 'weapon5': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon4': '0.236', 'weapon2': '0.530', 'WEAPON3': '1.250', 'HITCOUNT': '2.540', 'weapon3': '2.858', 'DAMAGECOUNT': '11.607', 'FRAGCOUNT': '35.500'} [2023-02-25 14:22:51,513][36140] DAMAGECOUNT value on done: 1001318.0 [2023-02-25 14:22:51,513][36140] Sum rewards: 47.432, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.353', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.232', 'weapon5': '0.234', 'weapon2': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.462', 'WEAPON3': '1.300', 'weapon3': '2.760', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '42.500'} [2023-02-25 14:22:51,568][36157] DAMAGECOUNT value on done: 1001738.0 [2023-02-25 14:22:51,568][36157] Sum rewards: 64.431, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.421', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.142', 'AMMO4': '0.156', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON4': '0.350', 'weapon4': '0.586', 'WEAPON3': '1.300', 'weapon3': '2.730', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '56.000'} [2023-02-25 14:22:51,702][36155] DAMAGECOUNT value on done: 1000581.0 [2023-02-25 14:22:51,702][36155] Sum rewards: 49.496, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.095', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.134', 'AMMO3': '0.161', 'AMMO4': '0.213', 'WEAPON5': '0.300', 'weapon4': '0.340', 'WEAPON4': '0.500', 'weapon2': '0.508', 'WEAPON3': '1.000', 'weapon3': '2.770', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '14.088', 'FRAGCOUNT': '43.000'} [2023-02-25 14:22:51,820][36140] DAMAGECOUNT value on done: 998131.0 [2023-02-25 14:22:51,821][36140] Sum rewards: 58.813, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.678', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.048', 'AMMO4': '0.062', 'weapon4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.260', 'weapon2': '0.392', 'WEAPON3': '1.450', 'weapon3': '3.274', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '52.000'} [2023-02-25 14:22:51,829][36140] DAMAGECOUNT value on done: 987526.0 [2023-02-25 14:22:51,830][36140] Sum rewards: 60.393, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.510', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.201', 'WEAPON5': '0.250', 'weapon2': '0.290', 'WEAPON4': '0.350', 'weapon4': '0.368', 'WEAPON3': '1.300', 'HITCOUNT': '2.890', 'weapon3': '2.976', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '52.000'} [2023-02-25 14:22:52,123][36140] DAMAGECOUNT value on done: 991645.0 [2023-02-25 14:22:52,123][36140] Sum rewards: 55.381, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.181', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO3': '0.190', 'AMMO4': '0.203', 'weapon2': '0.214', 'weapon5': '0.330', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.802', 'WEAPON3': '1.150', 'weapon3': '2.350', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.291', 'FRAGCOUNT': '49.000'} [2023-02-25 14:22:52,761][36155] DAMAGECOUNT value on done: 1009809.0 [2023-02-25 14:22:52,762][36155] Sum rewards: 52.700, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.135', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.062', 'weapon4': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'weapon2': '0.218', 'AMMO3': '0.243', 'WEAPON3': '1.500', 'HITCOUNT': '3.230', 'weapon3': '3.296', 'DAMAGECOUNT': '15.213', 'FRAGCOUNT': '48.000'} [2023-02-25 14:22:53,075][36155] DAMAGECOUNT value on done: 994496.0 [2023-02-25 14:22:53,075][36155] Sum rewards: 52.402, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.862', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.142', 'AMMO4': '0.178', 'AMMO3': '0.273', 'weapon2': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.400', 'WEAPON3': '1.650', 'weapon3': '2.840', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.499', 'FRAGCOUNT': '49.000'} [2023-02-25 14:22:53,279][36142] DAMAGECOUNT value on done: 1001388.0 [2023-02-25 14:22:53,280][36142] Sum rewards: 71.884, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.675', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.144', 'AMMO4': '0.182', 'AMMO3': '0.234', 'weapon2': '0.298', 'WEAPON5': '0.300', 'weapon4': '0.318', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.952', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '64.000'} [2023-02-25 14:22:53,369][36139] DAMAGECOUNT value on done: 997565.0 [2023-02-25 14:22:53,370][36139] Sum rewards: 53.896, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.352', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon2': '0.150', 'weapon4': '0.154', 'AMMO4': '0.174', 'AMMO3': '0.191', 'weapon5': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.770', 'weapon3': '3.252', 'DAMAGECOUNT': '13.809', 'FRAGCOUNT': '48.000'} [2023-02-25 14:22:53,605][36142] DAMAGECOUNT value on done: 981856.0 [2023-02-25 14:22:53,605][36142] Sum rewards: 65.993, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.025', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.034', 'AMMO4': '0.044', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.241', 'weapon2': '0.242', 'WEAPON3': '1.500', 'weapon3': '3.436', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '57.000'} [2023-02-25 14:22:53,683][36139] DAMAGECOUNT value on done: 996275.0 [2023-02-25 14:22:53,684][36139] Sum rewards: 41.014, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.390', 'AMMO5': '0.018', 'AMMO2': '0.049', 'weapon5': '0.212', 'AMMO3': '0.227', 'AMMO4': '0.247', 'weapon2': '0.268', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'weapon4': '0.654', 'WEAPON3': '1.350', 'weapon3': '2.310', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '12.558', 'FRAGCOUNT': '40.000'} [2023-02-25 14:22:53,862][36139] DAMAGECOUNT value on done: 1011059.0 [2023-02-25 14:22:53,863][36139] Sum rewards: 56.833, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.450', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.036', 'weapon5': '0.126', 'AMMO4': '0.180', 'weapon4': '0.182', 'AMMO3': '0.298', 'weapon2': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.076', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '53.000'} [2023-02-25 14:22:54,110][36138] Updated weights for policy 0, policy_version 50623 (0.0009) [2023-02-25 14:22:54,163][36139] DAMAGECOUNT value on done: 1000800.0 [2023-02-25 14:22:54,163][36139] Sum rewards: 64.595, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.324', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.048', 'weapon4': '0.130', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.688', 'WEAPON3': '1.250', 'weapon3': '2.872', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.515', 'FRAGCOUNT': '54.000'} [2023-02-25 14:22:54,168][36142] DAMAGECOUNT value on done: 993994.0 [2023-02-25 14:22:54,168][36142] Sum rewards: 57.491, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.310', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.130', 'weapon2': '0.158', 'AMMO3': '0.260', 'weapon4': '0.322', 'WEAPON3': '1.550', 'weapon3': '3.152', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.029', 'FRAGCOUNT': '50.000'} [2023-02-25 14:22:54,480][36142] DAMAGECOUNT value on done: 1006518.0 [2023-02-25 14:22:54,480][36142] Sum rewards: 58.072, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.570', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.086', 'WEAPON4': '0.100', 'weapon4': '0.142', 'AMMO3': '0.191', 'WEAPON5': '0.250', 'weapon2': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.996', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.280', 'FRAGCOUNT': '48.000'} [2023-02-25 14:22:54,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13412.7). Total num frames: 207360000. Throughput: 0: 3371.5. Samples: 14330748. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:22:54,730][36114] Avg episode reward: [(0, '57.279')] [2023-02-25 14:22:55,767][36156] DAMAGECOUNT value on done: 1006438.0 [2023-02-25 14:22:55,767][36156] Sum rewards: 65.466, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.678', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon4': '0.110', 'WEAPON4': '0.150', 'weapon2': '0.166', 'AMMO3': '0.287', 'WEAPON3': '1.650', 'HITCOUNT': '3.490', 'weapon3': '3.502', 'DAMAGECOUNT': '16.953', 'FRAGCOUNT': '59.000'} [2023-02-25 14:22:55,778][36156] DAMAGECOUNT value on done: 1011353.0 [2023-02-25 14:22:55,779][36156] Sum rewards: 45.182, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.710', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'weapon4': '0.170', 'WEAPON4': '0.200', 'AMMO3': '0.250', 'weapon2': '0.388', 'WEAPON3': '1.550', 'HITCOUNT': '2.960', 'weapon3': '3.204', 'DAMAGECOUNT': '13.143', 'FRAGCOUNT': '41.000'} [2023-02-25 14:22:56,089][36156] DAMAGECOUNT value on done: 991929.0 [2023-02-25 14:22:56,089][36156] Sum rewards: 52.329, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.414', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.124', 'AMMO4': '0.174', 'weapon2': '0.178', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.260', 'WEAPON3': '1.200', 'HITCOUNT': '2.870', 'weapon3': '3.114', 'DAMAGECOUNT': '13.812', 'FRAGCOUNT': '46.000'} [2023-02-25 14:22:56,100][36156] DAMAGECOUNT value on done: 998225.0 [2023-02-25 14:22:56,100][36156] Sum rewards: 56.445, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.018', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon4': '0.120', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'weapon5': '0.236', 'WEAPON5': '0.300', 'ARMOR': '0.472', 'weapon2': '0.614', 'WEAPON3': '1.150', 'weapon3': '2.740', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '15.261', 'FRAGCOUNT': '47.000'} [2023-02-25 14:22:57,115][36138] Updated weights for policy 0, policy_version 50633 (0.0009) [2023-02-25 14:22:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 207425536. Throughput: 0: 3373.6. Samples: 14351068. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:22:59,730][36114] Avg episode reward: [(0, '57.434')] [2023-02-25 14:23:00,138][36138] Updated weights for policy 0, policy_version 50643 (0.0010) [2023-02-25 14:23:03,202][36138] Updated weights for policy 0, policy_version 50653 (0.0009) [2023-02-25 14:23:04,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13412.7). Total num frames: 207495168. Throughput: 0: 3370.2. Samples: 14371238. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:23:04,729][36114] Avg episode reward: [(0, '57.434')] [2023-02-25 14:23:06,277][36138] Updated weights for policy 0, policy_version 50663 (0.0010) [2023-02-25 14:23:07,114][36154] DAMAGECOUNT value on done: 1007570.0 [2023-02-25 14:23:07,115][36154] Sum rewards: 64.244, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.585', 'AMMO5': '0.011', 'AMMO2': '0.040', 'AMMO3': '0.120', 'weapon5': '0.186', 'AMMO4': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.712', 'weapon2': '0.846', 'WEAPON3': '0.850', 'weapon3': '2.032', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.972', 'FRAGCOUNT': '53.000'} [2023-02-25 14:23:07,370][36154] DAMAGECOUNT value on done: 1008330.0 [2023-02-25 14:23:07,371][36154] Sum rewards: 56.677, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.842', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.030', 'weapon5': '0.070', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon2': '0.398', 'WEAPON3': '1.150', 'HITCOUNT': '3.060', 'weapon3': '3.300', 'DAMAGECOUNT': '14.892', 'FRAGCOUNT': '47.000'} [2023-02-25 14:23:07,431][36154] DAMAGECOUNT value on done: 993597.0 [2023-02-25 14:23:07,432][36154] Sum rewards: 64.630, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.250', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.048', 'weapon5': '0.136', 'AMMO4': '0.171', 'weapon2': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.272', 'WEAPON3': '1.650', 'HITCOUNT': '3.220', 'weapon3': '3.300', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '58.000'} [2023-02-25 14:23:07,692][36156] Large shaping reward 2.592 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.597, 199.0), ('HEALTH', -0.027, -9.0), ('weapon5', 0.002)] [2023-02-25 14:23:07,695][36154] DAMAGECOUNT value on done: 1001920.0 [2023-02-25 14:23:07,695][36154] Sum rewards: 60.417, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.669', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.032', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'WEAPON4': '0.200', 'weapon5': '0.218', 'weapon4': '0.546', 'weapon2': '0.626', 'WEAPON3': '0.900', 'weapon3': '2.288', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.600', 'FRAGCOUNT': '47.500'} [2023-02-25 14:23:07,906][36141] DAMAGECOUNT value on done: 1006327.0 [2023-02-25 14:23:07,906][36141] Sum rewards: 61.321, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.012', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.046', 'AMMO3': '0.150', 'weapon5': '0.174', 'AMMO4': '0.229', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.630', 'weapon2': '0.638', 'WEAPON3': '1.000', 'weapon3': '2.288', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.400', 'FRAGCOUNT': '51.000'} [2023-02-25 14:23:08,113][36141] DAMAGECOUNT value on done: 996100.0 [2023-02-25 14:23:08,114][36141] Sum rewards: 58.082, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.278', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.100', 'AMMO4': '0.176', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON4': '0.400', 'weapon4': '0.690', 'WEAPON3': '1.300', 'weapon3': '2.566', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.871', 'FRAGCOUNT': '52.000'} [2023-02-25 14:23:08,205][36141] DAMAGECOUNT value on done: 1007215.0 [2023-02-25 14:23:08,205][36141] Sum rewards: 75.477, reward structure: {'DEATHCOUNT': '-10.500', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'AMMO3': '0.122', 'AMMO4': '0.128', 'weapon5': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.422', 'weapon4': '0.482', 'HEALTH': '0.719', 'WEAPON3': '0.750', 'weapon3': '2.740', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '59.000'} [2023-02-25 14:23:08,424][36141] DAMAGECOUNT value on done: 991286.0 [2023-02-25 14:23:08,424][36141] Sum rewards: 71.639, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.122', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon4': '0.016', 'AMMO4': '0.030', 'weapon5': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'weapon2': '0.476', 'WEAPON3': '1.250', 'weapon3': '3.288', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '58.500'} [2023-02-25 14:23:09,269][36138] Updated weights for policy 0, policy_version 50673 (0.0009) [2023-02-25 14:23:09,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13412.7). Total num frames: 207560704. Throughput: 0: 3367.4. Samples: 14381260. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:23:09,730][36114] Avg episode reward: [(0, '57.898')] [2023-02-25 14:23:10,216][36157] DAMAGECOUNT value on done: 1014644.0 [2023-02-25 14:23:10,216][36157] Sum rewards: 42.765, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.355', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.080', 'AMMO3': '0.201', 'weapon5': '0.286', 'weapon2': '0.354', 'AMMO4': '0.399', 'weapon4': '0.460', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '1.250', 'HITCOUNT': '2.420', 'weapon3': '2.586', 'DAMAGECOUNT': '13.161', 'FRAGCOUNT': '41.000'} [2023-02-25 14:23:10,532][36157] DAMAGECOUNT value on done: 1001387.0 [2023-02-25 14:23:10,532][36157] Sum rewards: 50.166, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.295', 'ARMOR': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.039', 'AMMO3': '0.170', 'AMMO4': '0.193', 'weapon5': '0.202', 'weapon2': '0.204', 'WEAPON5': '0.300', 'weapon4': '0.416', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'HITCOUNT': '2.800', 'weapon3': '2.910', 'DAMAGECOUNT': '12.189', 'FRAGCOUNT': '45.000'} [2023-02-25 14:23:11,278][36155] DAMAGECOUNT value on done: 994312.0 [2023-02-25 14:23:11,279][36155] Sum rewards: 72.008, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.710', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon4': '0.048', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.184', 'AMMO3': '0.228', 'weapon2': '0.502', 'WEAPON3': '1.500', 'weapon3': '3.112', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.946', 'FRAGCOUNT': '62.000'} [2023-02-25 14:23:11,279][36157] DAMAGECOUNT value on done: 1013283.0 [2023-02-25 14:23:11,280][36157] Sum rewards: 60.967, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.068', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.034', 'weapon5': '0.044', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'weapon2': '0.302', 'WEAPON3': '1.350', 'HITCOUNT': '3.320', 'weapon3': '3.398', 'DAMAGECOUNT': '15.708', 'FRAGCOUNT': '54.000'} [2023-02-25 14:23:11,560][36140] DAMAGECOUNT value on done: 1006062.0 [2023-02-25 14:23:11,561][36140] Sum rewards: 52.904, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.444', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.165', 'AMMO3': '0.201', 'weapon5': '0.284', 'weapon2': '0.394', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.548', 'WEAPON3': '1.250', 'weapon3': '2.448', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.232', 'FRAGCOUNT': '48.000'} [2023-02-25 14:23:11,587][36155] DAMAGECOUNT value on done: 1004914.0 [2023-02-25 14:23:11,587][36155] Sum rewards: 56.855, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.867', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO2': '0.031', 'AMMO4': '0.156', 'AMMO3': '0.167', 'weapon5': '0.196', 'WEAPON5': '0.200', 'weapon2': '0.426', 'WEAPON4': '0.450', 'weapon4': '0.680', 'WEAPON3': '1.000', 'weapon3': '2.420', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.954', 'FRAGCOUNT': '50.000'} [2023-02-25 14:23:11,590][36157] DAMAGECOUNT value on done: 1006784.0 [2023-02-25 14:23:11,591][36157] Sum rewards: 60.329, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.139', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.102', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'weapon4': '0.176', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'weapon2': '0.380', 'WEAPON3': '1.400', 'HITCOUNT': '3.090', 'weapon3': '3.114', 'DAMAGECOUNT': '15.138', 'FRAGCOUNT': '55.000'} [2023-02-25 14:23:11,870][36140] DAMAGECOUNT value on done: 1002860.0 [2023-02-25 14:23:11,870][36140] Sum rewards: 51.040, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.848', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.054', 'AMMO3': '0.163', 'weapon5': '0.204', 'AMMO4': '0.272', 'weapon2': '0.388', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.754', 'WEAPON3': '0.900', 'weapon3': '2.278', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.184', 'FRAGCOUNT': '43.000'} [2023-02-25 14:23:11,891][36140] DAMAGECOUNT value on done: 992302.0 [2023-02-25 14:23:11,891][36140] Sum rewards: 49.600, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.708', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO4': '0.178', 'weapon5': '0.196', 'AMMO3': '0.229', 'weapon2': '0.306', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '1.038', 'WEAPON3': '1.300', 'weapon3': '2.104', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.328', 'FRAGCOUNT': '43.000'} [2023-02-25 14:23:12,145][36141] Large shaping reward 2.507 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.456, 152.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:23:12,180][36140] DAMAGECOUNT value on done: 996385.0 [2023-02-25 14:23:12,180][36140] Sum rewards: 47.671, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.874', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO4': '0.196', 'AMMO3': '0.234', 'weapon5': '0.242', 'weapon4': '0.288', 'WEAPON5': '0.350', 'weapon2': '0.370', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.780', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.220', 'FRAGCOUNT': '46.000'} [2023-02-25 14:23:12,324][36138] Updated weights for policy 0, policy_version 50683 (0.0009) [2023-02-25 14:23:12,683][36155] DAMAGECOUNT value on done: 1015725.0 [2023-02-25 14:23:12,683][36155] Sum rewards: 69.131, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.934', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.120', 'AMMO4': '0.143', 'weapon4': '0.156', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.186', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '60.000'} [2023-02-25 14:23:12,977][36155] DAMAGECOUNT value on done: 999574.0 [2023-02-25 14:23:12,977][36155] Sum rewards: 64.857, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.709', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.003', 'weapon5': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.184', 'AMMO3': '0.195', 'weapon4': '0.232', 'WEAPON3': '1.250', 'HITCOUNT': '3.060', 'weapon3': '3.390', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '54.000'} [2023-02-25 14:23:13,150][36142] DAMAGECOUNT value on done: 1006569.0 [2023-02-25 14:23:13,150][36142] Sum rewards: 64.683, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.530', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.020', 'weapon5': '0.076', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.164', 'WEAPON3': '0.850', 'weapon2': '1.000', 'weapon3': '2.626', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.543', 'FRAGCOUNT': '52.000'} [2023-02-25 14:23:13,228][36139] DAMAGECOUNT value on done: 1001716.0 [2023-02-25 14:23:13,228][36139] Sum rewards: 53.953, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.060', 'AMMO5': '0.007', 'AMMO2': '0.040', 'AMMO3': '0.146', 'weapon5': '0.174', 'AMMO4': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.378', 'weapon2': '0.712', 'WEAPON3': '1.000', 'weapon3': '2.494', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.453', 'FRAGCOUNT': '47.000'} [2023-02-25 14:23:13,459][36142] DAMAGECOUNT value on done: 986913.0 [2023-02-25 14:23:13,460][36142] Sum rewards: 53.464, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.755', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.065', 'AMMO3': '0.138', 'weapon5': '0.252', 'AMMO4': '0.323', 'weapon4': '0.354', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'weapon2': '0.758', 'WEAPON3': '0.900', 'weapon3': '2.346', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.171', 'FRAGCOUNT': '46.000'} [2023-02-25 14:23:13,519][36139] DAMAGECOUNT value on done: 1001047.0 [2023-02-25 14:23:13,520][36139] Sum rewards: 55.081, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.046', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.082', 'HEALTH': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'weapon2': '0.290', 'WEAPON3': '1.050', 'HITCOUNT': '3.090', 'weapon3': '3.386', 'DAMAGECOUNT': '14.316', 'FRAGCOUNT': '45.000'} [2023-02-25 14:23:13,695][36139] DAMAGECOUNT value on done: 1015699.0 [2023-02-25 14:23:13,695][36139] Sum rewards: 56.219, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.970', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon2': '0.314', 'weapon4': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.880', 'weapon3': '3.050', 'DAMAGECOUNT': '13.920', 'FRAGCOUNT': '50.000'} [2023-02-25 14:23:13,998][36139] DAMAGECOUNT value on done: 1005928.0 [2023-02-25 14:23:13,999][36139] Sum rewards: 58.915, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.914', 'AMMO5': '0.016', 'AMMO2': '0.043', 'AMMO3': '0.168', 'weapon2': '0.168', 'AMMO4': '0.214', 'weapon5': '0.232', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.724', 'WEAPON3': '0.950', 'weapon3': '2.610', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.384', 'FRAGCOUNT': '49.500'} [2023-02-25 14:23:14,055][36142] DAMAGECOUNT value on done: 999570.0 [2023-02-25 14:23:14,056][36142] Sum rewards: 63.827, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.824', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.094', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO4': '0.142', 'WEAPON4': '0.200', 'weapon2': '0.228', 'AMMO3': '0.260', 'WEAPON3': '1.600', 'weapon3': '3.324', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '57.000'} [2023-02-25 14:23:14,377][36142] DAMAGECOUNT value on done: 1011101.0 [2023-02-25 14:23:14,378][36142] Sum rewards: 50.139, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.838', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO3': '0.176', 'AMMO4': '0.224', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon5': '0.476', 'weapon2': '0.512', 'weapon4': '0.554', 'WEAPON3': '1.100', 'weapon3': '2.142', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '13.749', 'FRAGCOUNT': '43.000'} [2023-02-25 14:23:14,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 207626240. Throughput: 0: 3370.0. Samples: 14401492. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:23:14,730][36114] Avg episode reward: [(0, '57.703')] [2023-02-25 14:23:15,355][36138] Updated weights for policy 0, policy_version 50693 (0.0009) [2023-02-25 14:23:15,751][36156] DAMAGECOUNT value on done: 1011707.0 [2023-02-25 14:23:15,751][36156] Sum rewards: 57.783, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.575', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.052', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.234', 'AMMO3': '0.251', 'weapon4': '0.332', 'WEAPON3': '1.500', 'weapon3': '3.070', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.807', 'FRAGCOUNT': '51.000'} [2023-02-25 14:23:15,762][36156] DAMAGECOUNT value on done: 1016635.0 [2023-02-25 14:23:15,762][36156] Sum rewards: 61.871, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.415', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'weapon5': '0.050', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'weapon4': '0.458', 'weapon2': '0.538', 'WEAPON3': '1.150', 'weapon3': '2.692', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '52.000'} [2023-02-25 14:23:16,066][36156] DAMAGECOUNT value on done: 996702.0 [2023-02-25 14:23:16,067][36156] Sum rewards: 49.210, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.847', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.042', 'AMMO3': '0.176', 'AMMO4': '0.208', 'weapon5': '0.314', 'weapon4': '0.482', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon2': '0.646', 'WEAPON3': '1.050', 'weapon3': '2.266', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '14.319', 'FRAGCOUNT': '43.000'} [2023-02-25 14:23:16,078][36156] DAMAGECOUNT value on done: 1002681.0 [2023-02-25 14:23:16,078][36156] Sum rewards: 44.351, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.042', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon2': '0.194', 'AMMO3': '0.257', 'weapon5': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.452', 'WEAPON3': '1.500', 'weapon3': '2.790', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.368', 'FRAGCOUNT': '42.000'} [2023-02-25 14:23:18,386][36138] Updated weights for policy 0, policy_version 50703 (0.0009) [2023-02-25 14:23:18,821][36142] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:23:19,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13412.7). Total num frames: 207695872. Throughput: 0: 3369.3. Samples: 14421764. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:23:19,729][36114] Avg episode reward: [(0, '57.684')] [2023-02-25 14:23:19,733][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000050707_207695872.pth... [2023-02-25 14:23:19,788][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000049921_204476416.pth [2023-02-25 14:23:21,427][36138] Updated weights for policy 0, policy_version 50713 (0.0009) [2023-02-25 14:23:23,333][36139] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:23:24,456][36138] Updated weights for policy 0, policy_version 50723 (0.0009) [2023-02-25 14:23:24,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 207761408. Throughput: 0: 3369.3. Samples: 14431866. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:23:24,730][36114] Avg episode reward: [(0, '57.684')] [2023-02-25 14:23:27,188][36154] DAMAGECOUNT value on done: 1012240.0 [2023-02-25 14:23:27,189][36154] Sum rewards: 60.487, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.082', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.154', 'AMMO3': '0.206', 'weapon4': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.462', 'WEAPON3': '1.300', 'weapon3': '2.872', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.010', 'FRAGCOUNT': '55.000'} [2023-02-25 14:23:27,449][36154] DAMAGECOUNT value on done: 1013975.0 [2023-02-25 14:23:27,449][36154] Sum rewards: 68.375, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.680', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.005', 'weapon5': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.280', 'weapon4': '0.556', 'WEAPON3': '1.400', 'weapon3': '2.864', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '59.000'} [2023-02-25 14:23:27,484][36138] Updated weights for policy 0, policy_version 50733 (0.0010) [2023-02-25 14:23:27,505][36154] DAMAGECOUNT value on done: 998993.0 [2023-02-25 14:23:27,506][36154] Sum rewards: 54.966, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.810', 'AMMO5': '0.013', 'AMMO2': '0.049', 'AMMO3': '0.227', 'weapon2': '0.240', 'AMMO4': '0.244', 'weapon5': '0.444', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.610', 'WEAPON3': '1.350', 'weapon3': '2.370', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.188', 'FRAGCOUNT': '50.000'} [2023-02-25 14:23:27,744][36154] DAMAGECOUNT value on done: 1006808.0 [2023-02-25 14:23:27,745][36154] Sum rewards: 58.205, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.282', 'AMMO2': '0.007', 'AMMO5': '0.009', 'weapon5': '0.016', 'AMMO4': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'weapon2': '0.522', 'WEAPON3': '1.250', 'HITCOUNT': '2.920', 'weapon3': '3.288', 'DAMAGECOUNT': '14.664', 'FRAGCOUNT': '48.000'} [2023-02-25 14:23:27,868][36141] DAMAGECOUNT value on done: 1010645.0 [2023-02-25 14:23:27,868][36141] Sum rewards: 48.966, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.930', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO3': '0.199', 'weapon2': '0.886', 'WEAPON3': '1.250', 'HITCOUNT': '2.830', 'weapon3': '2.894', 'DAMAGECOUNT': '12.954', 'FRAGCOUNT': '41.000'} [2023-02-25 14:23:28,092][36141] DAMAGECOUNT value on done: 1001197.0 [2023-02-25 14:23:28,092][36141] Sum rewards: 61.558, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.490', 'AMMO5': '0.016', 'AMMO2': '0.061', 'weapon5': '0.150', 'AMMO3': '0.155', 'AMMO4': '0.303', 'weapon4': '0.360', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.540', 'WEAPON3': '1.000', 'weapon3': '2.732', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.291', 'FRAGCOUNT': '53.000'} [2023-02-25 14:23:28,181][36141] DAMAGECOUNT value on done: 1012154.0 [2023-02-25 14:23:28,181][36141] Sum rewards: 58.212, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.825', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon4': '0.146', 'WEAPON4': '0.150', 'weapon5': '0.160', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.544', 'WEAPON3': '1.400', 'weapon3': '2.872', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.817', 'FRAGCOUNT': '52.000'} [2023-02-25 14:23:28,394][36141] DAMAGECOUNT value on done: 996567.0 [2023-02-25 14:23:28,395][36141] Sum rewards: 56.171, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.112', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.142', 'AMMO4': '0.160', 'weapon2': '0.228', 'AMMO3': '0.230', 'weapon4': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.080', 'weapon3': '3.102', 'DAMAGECOUNT': '15.843', 'FRAGCOUNT': '49.000'} [2023-02-25 14:23:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13412.7). Total num frames: 207831040. Throughput: 0: 3367.6. Samples: 14452086. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:23:29,729][36114] Avg episode reward: [(0, '57.397')] [2023-02-25 14:23:30,031][36157] DAMAGECOUNT value on done: 1018455.0 [2023-02-25 14:23:30,032][36157] Sum rewards: 45.962, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.130', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO3': '0.170', 'AMMO4': '0.176', 'weapon5': '0.258', 'weapon2': '0.360', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.772', 'WEAPON3': '1.050', 'weapon3': '2.208', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '11.193', 'FRAGCOUNT': '42.000'} [2023-02-25 14:23:30,348][36157] DAMAGECOUNT value on done: 1006711.0 [2023-02-25 14:23:30,348][36157] Sum rewards: 63.205, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.574', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.146', 'AMMO4': '0.148', 'AMMO3': '0.177', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.306', 'weapon4': '0.724', 'WEAPON3': '1.150', 'weapon3': '2.630', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.972', 'FRAGCOUNT': '54.000'} [2023-02-25 14:23:30,511][36138] Updated weights for policy 0, policy_version 50743 (0.0010) [2023-02-25 14:23:30,962][36155] DAMAGECOUNT value on done: 999046.0 [2023-02-25 14:23:30,963][36155] Sum rewards: 56.102, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.808', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon5': '0.072', 'AMMO3': '0.091', 'AMMO4': '0.175', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.522', 'weapon4': '0.522', 'WEAPON3': '0.550', 'weapon3': '2.740', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.202', 'FRAGCOUNT': '44.000'} [2023-02-25 14:23:31,110][36157] DAMAGECOUNT value on done: 1017656.0 [2023-02-25 14:23:31,111][36157] Sum rewards: 51.182, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.470', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO3': '0.222', 'weapon2': '0.404', 'WEAPON3': '1.400', 'HITCOUNT': '2.850', 'weapon3': '3.416', 'DAMAGECOUNT': '13.119', 'FRAGCOUNT': '45.000'} [2023-02-25 14:23:31,263][36155] DAMAGECOUNT value on done: 1009509.0 [2023-02-25 14:23:31,263][36155] Sum rewards: 54.528, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.150', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon5': '0.062', 'weapon4': '0.130', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon2': '0.320', 'WEAPON3': '1.250', 'HITCOUNT': '3.020', 'weapon3': '3.306', 'DAMAGECOUNT': '13.785', 'FRAGCOUNT': '49.000'} [2023-02-25 14:23:31,417][36157] DAMAGECOUNT value on done: 1012053.0 [2023-02-25 14:23:31,418][36157] Sum rewards: 59.615, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.486', 'ARMOR': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon5': '0.174', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.268', 'weapon4': '0.370', 'WEAPON3': '1.100', 'weapon3': '2.922', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.807', 'FRAGCOUNT': '49.000'} [2023-02-25 14:23:31,580][36140] DAMAGECOUNT value on done: 1010604.0 [2023-02-25 14:23:31,581][36140] Sum rewards: 51.230, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.098', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.035', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.134', 'weapon4': '0.144', 'AMMO3': '0.177', 'weapon2': '0.734', 'WEAPON3': '1.050', 'weapon3': '2.836', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.626', 'FRAGCOUNT': '42.000'} [2023-02-25 14:23:31,871][36140] DAMAGECOUNT value on done: 1007840.0 [2023-02-25 14:23:31,872][36140] Sum rewards: 62.259, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.830', 'ARMOR': '0.004', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.189', 'weapon5': '0.190', 'weapon2': '0.282', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon4': '0.520', 'WEAPON3': '1.100', 'weapon3': '2.752', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.940', 'FRAGCOUNT': '54.000'} [2023-02-25 14:23:31,909][36140] DAMAGECOUNT value on done: 997291.0 [2023-02-25 14:23:31,909][36140] Sum rewards: 53.957, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.366', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon2': '0.224', 'AMMO4': '0.225', 'weapon5': '0.246', 'AMMO3': '0.252', 'WEAPON5': '0.300', 'weapon4': '0.308', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '2.890', 'weapon3': '2.902', 'DAMAGECOUNT': '14.967', 'FRAGCOUNT': '51.000'} [2023-02-25 14:23:32,179][36140] DAMAGECOUNT value on done: 1001544.0 [2023-02-25 14:23:32,179][36140] Sum rewards: 57.466, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.195', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon5': '0.132', 'AMMO3': '0.186', 'AMMO4': '0.188', 'weapon2': '0.278', 'WEAPON5': '0.400', 'weapon4': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.952', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '49.000'} [2023-02-25 14:23:32,346][36155] DAMAGECOUNT value on done: 1020698.0 [2023-02-25 14:23:32,346][36155] Sum rewards: 61.890, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.880', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.056', 'AMMO3': '0.189', 'AMMO4': '0.189', 'weapon4': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.536', 'WEAPON3': '1.200', 'weapon3': '2.974', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '55.000'} [2023-02-25 14:23:32,627][36155] DAMAGECOUNT value on done: 1005370.0 [2023-02-25 14:23:32,627][36155] Sum rewards: 67.870, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.008', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.093', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon2': '0.166', 'AMMO3': '0.237', 'weapon4': '0.298', 'WEAPON3': '1.350', 'weapon3': '3.320', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.388', 'FRAGCOUNT': '57.000'} [2023-02-25 14:23:33,060][36139] DAMAGECOUNT value on done: 1006553.0 [2023-02-25 14:23:33,061][36139] Sum rewards: 49.240, reward structure: {'DEATHCOUNT': '-14.250', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.059', 'AMMO3': '0.105', 'HEALTH': '0.108', 'AMMO4': '0.295', 'weapon5': '0.432', 'weapon2': '0.532', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '0.650', 'weapon4': '0.798', 'weapon3': '1.852', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.511', 'FRAGCOUNT': '40.000'} [2023-02-25 14:23:33,209][36142] DAMAGECOUNT value on done: 1011461.0 [2023-02-25 14:23:33,209][36142] Sum rewards: 50.988, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.046', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.038', 'AMMO4': '0.192', 'AMMO3': '0.196', 'weapon5': '0.242', 'weapon2': '0.448', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.660', 'WEAPON3': '1.100', 'weapon3': '2.270', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '45.000'} [2023-02-25 14:23:33,351][36139] DAMAGECOUNT value on done: 1006014.0 [2023-02-25 14:23:33,352][36139] Sum rewards: 47.472, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.102', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.037', 'AMMO4': '0.187', 'AMMO3': '0.216', 'weapon2': '0.264', 'weapon5': '0.282', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.660', 'WEAPON3': '1.300', 'weapon3': '2.362', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.901', 'FRAGCOUNT': '42.000'} [2023-02-25 14:23:33,515][36142] DAMAGECOUNT value on done: 992432.0 [2023-02-25 14:23:33,515][36142] Sum rewards: 64.999, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.713', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.116', 'AMMO4': '0.137', 'weapon5': '0.168', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.562', 'WEAPON3': '1.150', 'weapon3': '2.932', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '54.000'} [2023-02-25 14:23:33,543][36139] DAMAGECOUNT value on done: 1020367.0 [2023-02-25 14:23:33,544][36139] Sum rewards: 52.961, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.100', 'AMMO5': '0.021', 'AMMO2': '0.033', 'weapon5': '0.088', 'AMMO4': '0.163', 'AMMO3': '0.202', 'weapon4': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.376', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.990', 'weapon3': '3.074', 'DAMAGECOUNT': '14.004', 'FRAGCOUNT': '46.000'} [2023-02-25 14:23:33,576][36138] Updated weights for policy 0, policy_version 50753 (0.0010) [2023-02-25 14:23:33,839][36139] DAMAGECOUNT value on done: 1011350.0 [2023-02-25 14:23:33,840][36139] Sum rewards: 69.876, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.070', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon2': '0.128', 'AMMO4': '0.150', 'weapon5': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon4': '0.328', 'WEAPON3': '1.250', 'weapon3': '3.226', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '60.000'} [2023-02-25 14:23:34,119][36142] DAMAGECOUNT value on done: 1004890.0 [2023-02-25 14:23:34,119][36142] Sum rewards: 69.742, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.794', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.152', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.202', 'weapon4': '0.216', 'WEAPON3': '1.100', 'HITCOUNT': '2.980', 'weapon3': '3.224', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '58.000'} [2023-02-25 14:23:34,445][36142] DAMAGECOUNT value on done: 1016625.0 [2023-02-25 14:23:34,446][36142] Sum rewards: 60.977, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.405', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO3': '0.212', 'weapon2': '0.294', 'WEAPON3': '1.450', 'HITCOUNT': '3.360', 'weapon3': '3.504', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '51.000'} [2023-02-25 14:23:34,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 207896576. Throughput: 0: 3372.4. Samples: 14472436. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:23:34,729][36114] Avg episode reward: [(0, '57.812')] [2023-02-25 14:23:35,732][36156] DAMAGECOUNT value on done: 1016336.0 [2023-02-25 14:23:35,732][36156] Sum rewards: 56.697, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.190', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'WEAPON4': '0.150', 'AMMO3': '0.219', 'weapon4': '0.410', 'weapon2': '0.646', 'WEAPON3': '1.250', 'weapon3': '2.706', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.887', 'FRAGCOUNT': '49.000'} [2023-02-25 14:23:35,754][36156] DAMAGECOUNT value on done: 1021589.0 [2023-02-25 14:23:35,754][36156] Sum rewards: 55.199, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.902', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO3': '0.193', 'AMMO4': '0.194', 'weapon5': '0.266', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.468', 'weapon4': '0.616', 'WEAPON3': '1.150', 'weapon3': '2.260', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '49.000'} [2023-02-25 14:23:36,053][36156] DAMAGECOUNT value on done: 1002465.0 [2023-02-25 14:23:36,053][36156] Sum rewards: 65.316, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.763', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.150', 'AMMO3': '0.165', 'AMMO4': '0.197', 'weapon2': '0.256', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.482', 'WEAPON3': '1.000', 'weapon3': '2.888', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '54.000'} [2023-02-25 14:23:36,081][36156] DAMAGECOUNT value on done: 1007658.0 [2023-02-25 14:23:36,082][36156] Sum rewards: 65.409, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.820', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.034', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'weapon2': '0.496', 'weapon4': '0.496', 'ARMOR': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.798', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.931', 'FRAGCOUNT': '53.000'} [2023-02-25 14:23:36,607][36138] Updated weights for policy 0, policy_version 50763 (0.0009) [2023-02-25 14:23:39,662][36138] Updated weights for policy 0, policy_version 50773 (0.0009) [2023-02-25 14:23:39,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13426.6). Total num frames: 207966208. Throughput: 0: 3372.0. Samples: 14482486. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:23:39,730][36114] Avg episode reward: [(0, '58.021')] [2023-02-25 14:23:42,676][36138] Updated weights for policy 0, policy_version 50783 (0.0010) [2023-02-25 14:23:44,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 208031744. Throughput: 0: 3370.9. Samples: 14502760. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:23:44,729][36114] Avg episode reward: [(0, '58.021')] [2023-02-25 14:23:45,712][36138] Updated weights for policy 0, policy_version 50793 (0.0010) [2023-02-25 14:23:46,961][36154] DAMAGECOUNT value on done: 1017561.0 [2023-02-25 14:23:46,962][36154] Sum rewards: 71.779, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.322', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon2': '0.110', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'weapon5': '0.158', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'weapon4': '0.278', 'WEAPON3': '1.050', 'weapon3': '3.206', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.963', 'FRAGCOUNT': '60.000'} [2023-02-25 14:23:47,238][36154] DAMAGECOUNT value on done: 1018068.0 [2023-02-25 14:23:47,239][36154] Sum rewards: 40.522, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.504', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.032', 'AMMO4': '0.162', 'weapon5': '0.218', 'AMMO3': '0.221', 'weapon2': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.434', 'WEAPON3': '1.250', 'HITCOUNT': '2.350', 'weapon3': '2.858', 'DAMAGECOUNT': '12.279', 'FRAGCOUNT': '38.000'} [2023-02-25 14:23:47,283][36154] DAMAGECOUNT value on done: 1004286.0 [2023-02-25 14:23:47,283][36154] Sum rewards: 61.496, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.736', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.037', 'weapon5': '0.098', 'AMMO3': '0.163', 'AMMO4': '0.185', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.438', 'weapon4': '0.562', 'WEAPON3': '1.050', 'weapon3': '2.588', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.879', 'FRAGCOUNT': '50.500'} [2023-02-25 14:23:47,542][36154] DAMAGECOUNT value on done: 1011344.0 [2023-02-25 14:23:47,542][36154] Sum rewards: 50.859, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.720', 'AMMO5': '0.020', 'AMMO2': '0.050', 'AMMO3': '0.209', 'AMMO4': '0.251', 'weapon4': '0.278', 'weapon5': '0.284', 'weapon2': '0.402', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.706', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.608', 'FRAGCOUNT': '47.000'} [2023-02-25 14:23:47,708][36141] DAMAGECOUNT value on done: 1015884.0 [2023-02-25 14:23:47,709][36141] Sum rewards: 61.193, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.850', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.187', 'weapon5': '0.230', 'WEAPON4': '0.300', 'weapon2': '0.354', 'WEAPON5': '0.400', 'weapon4': '0.428', 'WEAPON3': '1.200', 'weapon3': '2.738', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '50.500'} [2023-02-25 14:23:47,921][36141] DAMAGECOUNT value on done: 1005865.0 [2023-02-25 14:23:47,921][36141] Sum rewards: 55.274, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.397', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.140', 'weapon5': '0.144', 'weapon4': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.494', 'WEAPON3': '0.950', 'HITCOUNT': '2.770', 'weapon3': '3.022', 'DAMAGECOUNT': '14.004', 'FRAGCOUNT': '45.000'} [2023-02-25 14:23:48,017][36141] DAMAGECOUNT value on done: 1017301.0 [2023-02-25 14:23:48,017][36141] Sum rewards: 62.187, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.408', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO3': '0.195', 'weapon2': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.060', 'weapon3': '3.196', 'DAMAGECOUNT': '15.441', 'FRAGCOUNT': '53.000'} [2023-02-25 14:23:48,227][36141] DAMAGECOUNT value on done: 1001896.0 [2023-02-25 14:23:48,228][36141] Sum rewards: 64.423, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.479', 'AMMO5': '0.015', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.124', 'weapon2': '0.202', 'AMMO3': '0.259', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'ARMOR': '0.465', 'weapon4': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.854', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.957', 'FRAGCOUNT': '59.000'} [2023-02-25 14:23:48,728][36138] Updated weights for policy 0, policy_version 50803 (0.0009) [2023-02-25 14:23:49,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13426.5). Total num frames: 208101376. Throughput: 0: 3373.2. Samples: 14523032. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:23:49,730][36114] Avg episode reward: [(0, '57.793')] [2023-02-25 14:23:49,905][36157] DAMAGECOUNT value on done: 1023732.0 [2023-02-25 14:23:49,905][36157] Sum rewards: 61.836, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.279', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.047', 'AMMO3': '0.166', 'weapon2': '0.188', 'AMMO4': '0.234', 'weapon5': '0.286', 'weapon4': '0.450', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '0.950', 'HITCOUNT': '2.760', 'weapon3': '2.776', 'DAMAGECOUNT': '15.831', 'FRAGCOUNT': '52.000'} [2023-02-25 14:23:50,207][36157] DAMAGECOUNT value on done: 1011927.0 [2023-02-25 14:23:50,207][36157] Sum rewards: 60.419, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.486', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.036', 'weapon5': '0.162', 'AMMO4': '0.181', 'weapon2': '0.198', 'AMMO3': '0.204', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.646', 'WEAPON3': '1.250', 'weapon3': '2.728', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '53.000'} [2023-02-25 14:23:50,798][36155] DAMAGECOUNT value on done: 1004485.0 [2023-02-25 14:23:50,799][36155] Sum rewards: 64.486, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.448', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.054', 'weapon4': '0.110', 'AMMO4': '0.164', 'weapon2': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.265', 'WEAPON3': '1.550', 'weapon3': '3.362', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '58.000'} [2023-02-25 14:23:50,925][36157] DAMAGECOUNT value on done: 1022530.0 [2023-02-25 14:23:50,925][36157] Sum rewards: 54.824, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-1.772', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon5': '0.118', 'weapon4': '0.148', 'AMMO4': '0.186', 'weapon2': '0.264', 'AMMO3': '0.285', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '2.960', 'weapon3': '3.110', 'DAMAGECOUNT': '14.622', 'FRAGCOUNT': '52.000'} [2023-02-25 14:23:51,119][36155] DAMAGECOUNT value on done: 1014597.0 [2023-02-25 14:23:51,119][36155] Sum rewards: 60.804, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.382', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.007', 'WEAPON5': '0.100', 'AMMO3': '0.256', 'weapon2': '0.272', 'WEAPON3': '1.500', 'HITCOUNT': '3.260', 'weapon3': '3.520', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '53.000'} [2023-02-25 14:23:51,222][36157] DAMAGECOUNT value on done: 1016526.0 [2023-02-25 14:23:51,223][36157] Sum rewards: 52.370, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.360', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.124', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.358', 'weapon2': '0.694', 'WEAPON3': '1.300', 'weapon3': '2.610', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.419', 'FRAGCOUNT': '46.000'} [2023-02-25 14:23:51,548][36140] DAMAGECOUNT value on done: 1015674.0 [2023-02-25 14:23:51,549][36140] Sum rewards: 56.647, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.104', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.039', 'weapon5': '0.050', 'weapon4': '0.074', 'WEAPON5': '0.150', 'AMMO4': '0.197', 'WEAPON4': '0.200', 'AMMO3': '0.268', 'weapon2': '0.284', 'WEAPON3': '1.550', 'HITCOUNT': '3.120', 'weapon3': '3.340', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '51.000'} [2023-02-25 14:23:51,782][36138] Updated weights for policy 0, policy_version 50813 (0.0009) [2023-02-25 14:23:51,830][36140] DAMAGECOUNT value on done: 1013696.0 [2023-02-25 14:23:51,830][36140] Sum rewards: 67.166, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.900', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.248', 'weapon4': '0.264', 'AMMO3': '0.277', 'WEAPON3': '1.550', 'weapon3': '3.040', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '59.500'} [2023-02-25 14:23:51,866][36140] DAMAGECOUNT value on done: 1002004.0 [2023-02-25 14:23:51,866][36140] Sum rewards: 51.283, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.296', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.038', 'AMMO3': '0.151', 'AMMO4': '0.188', 'weapon5': '0.234', 'weapon4': '0.304', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.570', 'WEAPON3': '0.900', 'weapon3': '2.618', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '14.139', 'FRAGCOUNT': '44.000'} [2023-02-25 14:23:52,126][36140] DAMAGECOUNT value on done: 1006423.0 [2023-02-25 14:23:52,127][36140] Sum rewards: 55.462, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.399', 'AMMO5': '0.014', 'AMMO2': '0.041', 'AMMO3': '0.161', 'AMMO4': '0.206', 'weapon5': '0.274', 'weapon2': '0.308', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'weapon4': '1.028', 'weapon3': '2.092', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.637', 'FRAGCOUNT': '46.000'} [2023-02-25 14:23:52,208][36155] DAMAGECOUNT value on done: 1025820.0 [2023-02-25 14:23:52,208][36155] Sum rewards: 56.886, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.575', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.053', 'weapon5': '0.060', 'WEAPON5': '0.150', 'weapon2': '0.220', 'AMMO3': '0.230', 'AMMO4': '0.265', 'weapon4': '0.278', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.940', 'weapon3': '3.238', 'DAMAGECOUNT': '15.066', 'FRAGCOUNT': '51.000'} [2023-02-25 14:23:52,497][36155] DAMAGECOUNT value on done: 1009910.0 [2023-02-25 14:23:52,497][36155] Sum rewards: 64.528, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.890', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'weapon2': '0.242', 'weapon4': '0.526', 'WEAPON3': '0.950', 'HITCOUNT': '2.950', 'weapon3': '2.964', 'DAMAGECOUNT': '13.620', 'FRAGCOUNT': '54.000'} [2023-02-25 14:23:52,902][36139] DAMAGECOUNT value on done: 1011881.0 [2023-02-25 14:23:52,902][36139] Sum rewards: 64.062, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.588', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO4': '0.173', 'AMMO3': '0.183', 'weapon4': '0.254', 'WEAPON4': '0.300', 'weapon2': '0.466', 'WEAPON3': '1.050', 'weapon3': '2.978', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.984', 'FRAGCOUNT': '54.000'} [2023-02-25 14:23:53,208][36139] DAMAGECOUNT value on done: 1010228.0 [2023-02-25 14:23:53,209][36139] Sum rewards: 58.941, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.990', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO3': '0.120', 'AMMO4': '0.121', 'weapon5': '0.156', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.722', 'WEAPON3': '0.750', 'weapon4': '0.776', 'weapon3': '2.048', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.642', 'FRAGCOUNT': '49.000'} [2023-02-25 14:23:53,247][36142] DAMAGECOUNT value on done: 1016725.0 [2023-02-25 14:23:53,248][36142] Sum rewards: 58.914, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.095', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.052', 'AMMO3': '0.117', 'AMMO4': '0.258', 'weapon5': '0.338', 'weapon2': '0.396', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '0.650', 'weapon4': '0.756', 'weapon3': '2.098', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.792', 'FRAGCOUNT': '48.500'} [2023-02-25 14:23:53,426][36139] DAMAGECOUNT value on done: 1025518.0 [2023-02-25 14:23:53,427][36139] Sum rewards: 56.590, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.760', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.009', 'weapon4': '0.040', 'AMMO4': '0.044', 'weapon5': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'weapon2': '0.650', 'WEAPON3': '1.200', 'weapon3': '3.076', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.453', 'FRAGCOUNT': '47.000'} [2023-02-25 14:23:53,543][36142] DAMAGECOUNT value on done: 997795.0 [2023-02-25 14:23:53,543][36142] Sum rewards: 63.492, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.960', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.080', 'weapon4': '0.176', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.298', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.156', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.089', 'FRAGCOUNT': '57.000'} [2023-02-25 14:23:53,741][36139] DAMAGECOUNT value on done: 1016503.0 [2023-02-25 14:23:53,742][36139] Sum rewards: 59.414, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.718', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'weapon5': '0.202', 'WEAPON4': '0.300', 'weapon4': '0.366', 'weapon2': '0.368', 'WEAPON3': '1.200', 'weapon3': '2.842', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.459', 'FRAGCOUNT': '50.500'} [2023-02-25 14:23:54,143][36142] DAMAGECOUNT value on done: 1011260.0 [2023-02-25 14:23:54,144][36142] Sum rewards: 73.535, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.700', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.016', 'AMMO4': '0.049', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.146', 'AMMO3': '0.279', 'WEAPON3': '1.750', 'weapon3': '3.568', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.110', 'FRAGCOUNT': '64.000'} [2023-02-25 14:23:54,450][36142] DAMAGECOUNT value on done: 1022052.0 [2023-02-25 14:23:54,450][36142] Sum rewards: 66.226, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.400', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.044', 'AMMO3': '0.180', 'weapon5': '0.206', 'AMMO4': '0.222', 'weapon2': '0.304', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.594', 'WEAPON3': '1.050', 'weapon3': '2.614', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '57.000'} [2023-02-25 14:23:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13426.6). Total num frames: 208166912. Throughput: 0: 3376.2. Samples: 14533188. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:23:54,730][36114] Avg episode reward: [(0, '58.534')] [2023-02-25 14:23:54,730][36125] Saving new best policy, reward=58.534! [2023-02-25 14:23:54,848][36138] Updated weights for policy 0, policy_version 50823 (0.0009) [2023-02-25 14:23:55,768][36156] DAMAGECOUNT value on done: 1021692.0 [2023-02-25 14:23:55,769][36156] Sum rewards: 68.653, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.850', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.098', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon4': '0.294', 'weapon2': '0.356', 'WEAPON3': '1.200', 'weapon3': '3.048', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '58.000'} [2023-02-25 14:23:55,779][36156] DAMAGECOUNT value on done: 1026681.0 [2023-02-25 14:23:55,780][36156] Sum rewards: 56.580, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.959', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.160', 'AMMO3': '0.173', 'weapon5': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.304', 'weapon2': '0.390', 'WEAPON3': '1.100', 'weapon3': '2.884', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.276', 'FRAGCOUNT': '47.000'} [2023-02-25 14:23:56,091][36156] DAMAGECOUNT value on done: 1008073.0 [2023-02-25 14:23:56,091][36156] Sum rewards: 63.558, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.401', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.032', 'AMMO3': '0.138', 'AMMO4': '0.160', 'WEAPON4': '0.400', 'weapon5': '0.406', 'WEAPON5': '0.450', 'weapon2': '0.532', 'weapon4': '0.618', 'WEAPON3': '0.800', 'weapon3': '2.008', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '51.000'} [2023-02-25 14:23:56,102][36156] DAMAGECOUNT value on done: 1012276.0 [2023-02-25 14:23:56,102][36156] Sum rewards: 55.992, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.172', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.021', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'weapon2': '0.332', 'weapon4': '0.800', 'WEAPON3': '1.000', 'weapon3': '2.530', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.854', 'FRAGCOUNT': '47.000'} [2023-02-25 14:23:57,843][36138] Updated weights for policy 0, policy_version 50833 (0.0008) [2023-02-25 14:23:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13426.5). Total num frames: 208236544. Throughput: 0: 3375.0. Samples: 14553366. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:23:59,730][36114] Avg episode reward: [(0, '58.612')] [2023-02-25 14:23:59,733][36125] Saving new best policy, reward=58.612! [2023-02-25 14:24:00,370][36141] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:24:00,904][36138] Updated weights for policy 0, policy_version 50843 (0.0010) [2023-02-25 14:24:03,948][36138] Updated weights for policy 0, policy_version 50853 (0.0009) [2023-02-25 14:24:04,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13426.6). Total num frames: 208302080. Throughput: 0: 3372.8. Samples: 14573538. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:24:04,730][36114] Avg episode reward: [(0, '58.612')] [2023-02-25 14:24:06,936][36154] DAMAGECOUNT value on done: 1022444.0 [2023-02-25 14:24:06,937][36154] Sum rewards: 57.013, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.130', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO3': '0.212', 'weapon2': '0.642', 'WEAPON3': '1.350', 'HITCOUNT': '3.090', 'weapon3': '3.204', 'DAMAGECOUNT': '14.649', 'FRAGCOUNT': '48.000'} [2023-02-25 14:24:06,969][36138] Updated weights for policy 0, policy_version 50863 (0.0009) [2023-02-25 14:24:07,227][36154] DAMAGECOUNT value on done: 1023238.0 [2023-02-25 14:24:07,228][36154] Sum rewards: 57.344, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.780', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.053', 'AMMO3': '0.221', 'weapon5': '0.246', 'AMMO4': '0.265', 'weapon4': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.422', 'WEAPON3': '1.400', 'weapon3': '2.692', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '52.000'} [2023-02-25 14:24:07,240][36154] DAMAGECOUNT value on done: 1010044.0 [2023-02-25 14:24:07,240][36154] Sum rewards: 71.342, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.440', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.052', 'weapon4': '0.066', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon2': '0.386', 'WEAPON3': '1.200', 'weapon3': '3.208', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '60.000'} [2023-02-25 14:24:07,537][36154] DAMAGECOUNT value on done: 1016389.0 [2023-02-25 14:24:07,538][36154] Sum rewards: 65.746, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.090', 'AMMO5': '0.003', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.184', 'AMMO3': '0.198', 'WEAPON4': '0.300', 'weapon4': '0.468', 'weapon2': '0.530', 'WEAPON3': '1.350', 'weapon3': '2.740', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '57.000'} [2023-02-25 14:24:07,627][36141] DAMAGECOUNT value on done: 1020724.0 [2023-02-25 14:24:07,628][36141] Sum rewards: 55.505, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.122', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon2': '0.104', 'weapon5': '0.122', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.510', 'WEAPON3': '0.950', 'weapon3': '2.756', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '46.000'} [2023-02-25 14:24:07,839][36141] DAMAGECOUNT value on done: 1011213.0 [2023-02-25 14:24:07,839][36141] Sum rewards: 60.421, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.208', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.097', 'AMMO3': '0.180', 'weapon5': '0.224', 'weapon2': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.300', 'WEAPON3': '1.150', 'weapon3': '2.938', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.044', 'FRAGCOUNT': '52.000'} [2023-02-25 14:24:07,966][36141] DAMAGECOUNT value on done: 1021815.0 [2023-02-25 14:24:07,967][36141] Sum rewards: 48.416, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.474', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'weapon5': '0.132', 'AMMO4': '0.139', 'weapon2': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon4': '0.526', 'WEAPON3': '1.150', 'weapon3': '2.560', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '13.542', 'FRAGCOUNT': '41.000'} [2023-02-25 14:24:08,184][36141] DAMAGECOUNT value on done: 1007891.0 [2023-02-25 14:24:08,184][36141] Sum rewards: 69.764, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.015', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.106', 'weapon2': '0.148', 'weapon4': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'WEAPON3': '1.200', 'weapon3': '3.346', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '58.000'} [2023-02-25 14:24:09,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 208367616. Throughput: 0: 3373.2. Samples: 14583658. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:24:09,730][36114] Avg episode reward: [(0, '58.813')] [2023-02-25 14:24:09,733][36125] Saving new best policy, reward=58.813! [2023-02-25 14:24:09,917][36157] DAMAGECOUNT value on done: 1029108.0 [2023-02-25 14:24:09,918][36157] Sum rewards: 63.897, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.062', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.135', 'weapon2': '0.192', 'WEAPON4': '0.250', 'weapon5': '0.296', 'WEAPON5': '0.300', 'weapon4': '0.656', 'WEAPON3': '0.850', 'weapon3': '2.616', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.101', 'FRAGCOUNT': '50.000'} [2023-02-25 14:24:10,059][36138] Updated weights for policy 0, policy_version 50873 (0.0010) [2023-02-25 14:24:10,231][36157] DAMAGECOUNT value on done: 1016900.0 [2023-02-25 14:24:10,232][36157] Sum rewards: 60.151, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.812', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.041', 'AMMO3': '0.189', 'weapon5': '0.192', 'AMMO4': '0.205', 'WEAPON4': '0.250', 'weapon4': '0.348', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.150', 'weapon3': '2.674', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '51.000'} [2023-02-25 14:24:10,622][36155] DAMAGECOUNT value on done: 1009895.0 [2023-02-25 14:24:10,623][36155] Sum rewards: 65.864, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.111', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'weapon5': '0.056', 'WEAPON5': '0.100', 'weapon4': '0.226', 'AMMO3': '0.246', 'weapon2': '0.328', 'WEAPON3': '1.500', 'weapon3': '3.182', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '57.000'} [2023-02-25 14:24:10,912][36157] DAMAGECOUNT value on done: 1028159.0 [2023-02-25 14:24:10,912][36157] Sum rewards: 55.329, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.762', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.025', 'AMMO2': '0.057', 'AMMO3': '0.184', 'weapon2': '0.272', 'AMMO4': '0.284', 'weapon5': '0.386', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon4': '0.738', 'WEAPON3': '1.100', 'weapon3': '2.068', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.942', 'FRAGCOUNT': '49.000'} [2023-02-25 14:24:10,944][36155] DAMAGECOUNT value on done: 1019216.0 [2023-02-25 14:24:10,944][36155] Sum rewards: 51.815, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.884', 'AMMO5': '0.011', 'AMMO2': '0.052', 'weapon5': '0.122', 'AMMO3': '0.140', 'AMMO4': '0.257', 'WEAPON5': '0.350', 'weapon2': '0.446', 'WEAPON4': '0.600', 'weapon4': '0.942', 'WEAPON3': '0.950', 'weapon3': '2.262', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '13.857', 'FRAGCOUNT': '46.000'} [2023-02-25 14:24:11,215][36157] DAMAGECOUNT value on done: 1020968.0 [2023-02-25 14:24:11,216][36157] Sum rewards: 47.192, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.825', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'weapon2': '0.168', 'AMMO4': '0.193', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon5': '0.284', 'weapon4': '0.420', 'WEAPON3': '1.250', 'weapon3': '2.778', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.326', 'FRAGCOUNT': '42.000'} [2023-02-25 14:24:11,509][36140] DAMAGECOUNT value on done: 1020438.0 [2023-02-25 14:24:11,510][36140] Sum rewards: 59.021, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.025', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.026', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.104', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'weapon2': '0.340', 'WEAPON3': '1.500', 'HITCOUNT': '3.120', 'weapon3': '3.236', 'DAMAGECOUNT': '14.292', 'FRAGCOUNT': '55.000'} [2023-02-25 14:24:11,791][36140] DAMAGECOUNT value on done: 1019081.0 [2023-02-25 14:24:11,791][36140] Sum rewards: 61.129, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.765', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO4': '0.178', 'weapon5': '0.186', 'AMMO3': '0.199', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON4': '0.450', 'weapon4': '0.684', 'WEAPON3': '1.100', 'weapon3': '2.486', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.149', 'FRAGCOUNT': '52.500'} [2023-02-25 14:24:11,830][36140] DAMAGECOUNT value on done: 1007123.0 [2023-02-25 14:24:11,831][36140] Sum rewards: 60.894, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.593', 'AMMO5': '0.003', 'weapon5': '0.028', 'AMMO2': '0.033', 'weapon4': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO4': '0.166', 'AMMO3': '0.219', 'weapon2': '0.444', 'WEAPON3': '1.450', 'HITCOUNT': '2.970', 'weapon3': '3.324', 'DAMAGECOUNT': '15.357', 'FRAGCOUNT': '53.000'} [2023-02-25 14:24:12,012][36155] DAMAGECOUNT value on done: 1030508.0 [2023-02-25 14:24:12,012][36155] Sum rewards: 48.343, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.354', 'AMMO5': '0.020', 'AMMO2': '0.054', 'AMMO3': '0.137', 'AMMO4': '0.271', 'weapon2': '0.356', 'ARMOR': '0.408', 'weapon5': '0.424', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.674', 'WEAPON3': '0.800', 'weapon3': '2.258', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '13.764', 'FRAGCOUNT': '41.000'} [2023-02-25 14:24:12,114][36140] DAMAGECOUNT value on done: 1012110.0 [2023-02-25 14:24:12,115][36140] Sum rewards: 66.075, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.830', 'AMMO5': '0.006', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.082', 'weapon2': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon4': '0.352', 'WEAPON3': '1.450', 'weapon3': '3.228', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '57.000'} [2023-02-25 14:24:12,307][36155] DAMAGECOUNT value on done: 1014925.0 [2023-02-25 14:24:12,308][36155] Sum rewards: 61.802, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.533', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.140', 'weapon4': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.540', 'WEAPON3': '1.200', 'HITCOUNT': '2.860', 'weapon3': '2.892', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '54.000'} [2023-02-25 14:24:12,888][36139] DAMAGECOUNT value on done: 1016934.0 [2023-02-25 14:24:12,888][36139] Sum rewards: 56.556, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.070', 'ARMOR': '0.009', 'AMMO5': '0.012', 'AMMO2': '0.051', 'AMMO3': '0.166', 'weapon5': '0.230', 'AMMO4': '0.253', 'weapon2': '0.290', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.624', 'WEAPON3': '1.000', 'weapon3': '2.452', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '15.159', 'FRAGCOUNT': '49.000'} [2023-02-25 14:24:13,111][36138] Updated weights for policy 0, policy_version 50883 (0.0010) [2023-02-25 14:24:13,200][36139] DAMAGECOUNT value on done: 1016131.0 [2023-02-25 14:24:13,200][36139] Sum rewards: 68.591, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.306', 'AMMO5': '0.007', 'AMMO2': '0.052', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.224', 'AMMO3': '0.232', 'AMMO4': '0.262', 'weapon4': '0.324', 'WEAPON3': '1.400', 'weapon3': '3.048', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.709', 'FRAGCOUNT': '59.000'} [2023-02-25 14:24:13,291][36142] DAMAGECOUNT value on done: 1021390.0 [2023-02-25 14:24:13,292][36142] Sum rewards: 53.085, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.084', 'ARMOR': '0.008', 'AMMO5': '0.031', 'AMMO2': '0.089', 'AMMO3': '0.133', 'weapon2': '0.388', 'weapon5': '0.438', 'AMMO4': '0.445', 'WEAPON3': '0.750', 'WEAPON5': '0.800', 'weapon4': '0.870', 'WEAPON4': '0.950', 'weapon3': '1.872', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.995', 'FRAGCOUNT': '47.000'} [2023-02-25 14:24:13,447][36139] DAMAGECOUNT value on done: 1031501.0 [2023-02-25 14:24:13,447][36139] Sum rewards: 68.830, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.542', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.174', 'AMMO4': '0.182', 'AMMO3': '0.213', 'weapon2': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.418', 'WEAPON3': '1.250', 'weapon3': '2.882', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.949', 'FRAGCOUNT': '60.000'} [2023-02-25 14:24:13,604][36142] DAMAGECOUNT value on done: 1003095.0 [2023-02-25 14:24:13,605][36142] Sum rewards: 64.166, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.130', 'AMMO2': '0.016', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'AMMO3': '0.203', 'weapon2': '0.308', 'weapon4': '0.404', 'WEAPON3': '1.250', 'weapon3': '3.146', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '55.000'} [2023-02-25 14:24:13,747][36139] DAMAGECOUNT value on done: 1021652.0 [2023-02-25 14:24:13,747][36139] Sum rewards: 57.502, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.402', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.077', 'weapon5': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.310', 'weapon4': '0.406', 'WEAPON3': '1.350', 'weapon3': '2.970', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.447', 'FRAGCOUNT': '50.000'} [2023-02-25 14:24:14,150][36142] DAMAGECOUNT value on done: 1016277.0 [2023-02-25 14:24:14,150][36142] Sum rewards: 59.219, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.662', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.144', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.250', 'weapon2': '0.294', 'WEAPON3': '1.100', 'HITCOUNT': '2.870', 'weapon3': '3.124', 'DAMAGECOUNT': '15.051', 'FRAGCOUNT': '50.000'} [2023-02-25 14:24:14,464][36142] DAMAGECOUNT value on done: 1027015.0 [2023-02-25 14:24:14,464][36142] Sum rewards: 56.632, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.858', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.057', 'weapon5': '0.174', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.252', 'weapon4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.766', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.889', 'FRAGCOUNT': '49.000'} [2023-02-25 14:24:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13426.6). Total num frames: 208437248. Throughput: 0: 3369.9. Samples: 14603732. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:24:14,730][36114] Avg episode reward: [(0, '58.954')] [2023-02-25 14:24:14,730][36125] Saving new best policy, reward=58.954! [2023-02-25 14:24:15,913][36156] DAMAGECOUNT value on done: 1027414.0 [2023-02-25 14:24:15,914][36156] Sum rewards: 59.912, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.388', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon5': '0.184', 'weapon4': '0.234', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.368', 'WEAPON3': '1.500', 'weapon3': '2.884', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.166', 'FRAGCOUNT': '53.000'} [2023-02-25 14:24:15,924][36156] DAMAGECOUNT value on done: 1032333.0 [2023-02-25 14:24:15,924][36156] Sum rewards: 66.533, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.225', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.144', 'weapon4': '0.250', 'weapon2': '0.444', 'WEAPON3': '0.900', 'weapon3': '3.212', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '51.000'} [2023-02-25 14:24:16,155][36138] Updated weights for policy 0, policy_version 50893 (0.0009) [2023-02-25 14:24:16,232][36156] DAMAGECOUNT value on done: 1012982.0 [2023-02-25 14:24:16,232][36156] Sum rewards: 60.688, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.991', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon2': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.686', 'WEAPON3': '1.150', 'weapon3': '2.684', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.727', 'FRAGCOUNT': '51.000'} [2023-02-25 14:24:16,245][36156] DAMAGECOUNT value on done: 1017248.0 [2023-02-25 14:24:16,245][36156] Sum rewards: 65.020, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.942', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon5': '0.112', 'AMMO4': '0.117', 'AMMO3': '0.145', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.542', 'weapon2': '0.608', 'WEAPON3': '0.850', 'weapon3': '2.516', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.916', 'FRAGCOUNT': '53.000'} [2023-02-25 14:24:19,140][36138] Updated weights for policy 0, policy_version 50903 (0.0009) [2023-02-25 14:24:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 208502784. Throughput: 0: 3367.6. Samples: 14623976. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:24:19,730][36114] Avg episode reward: [(0, '59.185')] [2023-02-25 14:24:19,744][36125] Saving new best policy, reward=59.185! [2023-02-25 14:24:22,176][36138] Updated weights for policy 0, policy_version 50913 (0.0009) [2023-02-25 14:24:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13426.6). Total num frames: 208572416. Throughput: 0: 3367.4. Samples: 14634020. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:24:24,729][36114] Avg episode reward: [(0, '59.185')] [2023-02-25 14:24:25,239][36138] Updated weights for policy 0, policy_version 50923 (0.0009) [2023-02-25 14:24:26,947][36154] DAMAGECOUNT value on done: 1028192.0 [2023-02-25 14:24:26,948][36154] Sum rewards: 68.993, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.615', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.042', 'AMMO4': '0.068', 'weapon5': '0.094', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'weapon2': '0.302', 'WEAPON3': '1.250', 'HITCOUNT': '3.220', 'weapon3': '3.380', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '59.000'} [2023-02-25 14:24:27,245][36154] DAMAGECOUNT value on done: 1028108.0 [2023-02-25 14:24:27,245][36154] Sum rewards: 59.430, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.620', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.090', 'AMMO3': '0.159', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.368', 'weapon2': '0.654', 'WEAPON3': '1.050', 'weapon3': '2.724', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.610', 'FRAGCOUNT': '50.000'} [2023-02-25 14:24:27,254][36154] DAMAGECOUNT value on done: 1014457.0 [2023-02-25 14:24:27,254][36154] Sum rewards: 48.890, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.468', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO3': '0.138', 'AMMO4': '0.139', 'weapon5': '0.150', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.438', 'weapon4': '0.812', 'WEAPON3': '0.900', 'weapon3': '2.384', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '13.239', 'FRAGCOUNT': '40.000'} [2023-02-25 14:24:27,556][36154] DAMAGECOUNT value on done: 1021094.0 [2023-02-25 14:24:27,556][36154] Sum rewards: 56.003, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.470', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.068', 'AMMO4': '0.094', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'weapon2': '0.636', 'WEAPON3': '1.050', 'weapon3': '2.776', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.115', 'FRAGCOUNT': '47.000'} [2023-02-25 14:24:27,568][36155] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:24:27,710][36141] DAMAGECOUNT value on done: 1026699.0 [2023-02-25 14:24:27,710][36141] Sum rewards: 65.816, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.736', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.027', 'weapon5': '0.082', 'AMMO4': '0.133', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon4': '0.344', 'WEAPON4': '0.350', 'weapon2': '0.494', 'WEAPON3': '1.450', 'weapon3': '2.860', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '57.000'} [2023-02-25 14:24:27,916][36141] DAMAGECOUNT value on done: 1016092.0 [2023-02-25 14:24:27,916][36141] Sum rewards: 58.487, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.978', 'AMMO5': '0.007', 'AMMO2': '0.039', 'AMMO3': '0.150', 'weapon5': '0.176', 'AMMO4': '0.193', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON4': '0.350', 'weapon4': '0.854', 'WEAPON3': '1.000', 'weapon3': '2.496', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.637', 'FRAGCOUNT': '49.000'} [2023-02-25 14:24:28,033][36141] DAMAGECOUNT value on done: 1027189.0 [2023-02-25 14:24:28,034][36141] Sum rewards: 65.173, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.154', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.150', 'AMMO3': '0.168', 'weapon4': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.000', 'weapon3': '2.908', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.122', 'FRAGCOUNT': '53.500'} [2023-02-25 14:24:28,232][36141] DAMAGECOUNT value on done: 1013012.0 [2023-02-25 14:24:28,233][36141] Sum rewards: 51.805, reward structure: {'DEATHCOUNT': '-22.500', 'HEALTH': '-2.939', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.052', 'weapon5': '0.174', 'AMMO4': '0.261', 'AMMO3': '0.287', 'WEAPON5': '0.300', 'weapon4': '0.370', 'weapon2': '0.394', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.706', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.363', 'FRAGCOUNT': '52.000'} [2023-02-25 14:24:28,353][36138] Updated weights for policy 0, policy_version 50933 (0.0009) [2023-02-25 14:24:29,729][36114] Fps is (10 sec: 13517.0, 60 sec: 13448.5, 300 sec: 13426.6). Total num frames: 208637952. Throughput: 0: 3361.4. Samples: 14654022. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:24:29,729][36114] Avg episode reward: [(0, '59.379')] [2023-02-25 14:24:29,733][36125] Saving new best policy, reward=59.379! [2023-02-25 14:24:30,051][36157] DAMAGECOUNT value on done: 1034436.0 [2023-02-25 14:24:30,051][36157] Sum rewards: 68.023, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.994', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.061', 'AMMO3': '0.216', 'weapon2': '0.678', 'WEAPON3': '1.250', 'weapon3': '3.146', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.984', 'FRAGCOUNT': '57.000'} [2023-02-25 14:24:30,365][36157] DAMAGECOUNT value on done: 1021816.0 [2023-02-25 14:24:30,365][36157] Sum rewards: 57.505, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.198', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.072', 'weapon5': '0.154', 'AMMO3': '0.186', 'AMMO4': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.680', 'WEAPON3': '1.050', 'HITCOUNT': '2.830', 'weapon3': '2.880', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '48.000'} [2023-02-25 14:24:30,631][36155] DAMAGECOUNT value on done: 1014532.0 [2023-02-25 14:24:30,632][36155] Sum rewards: 53.360, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.798', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.048', 'AMMO4': '0.056', 'WEAPON5': '0.100', 'weapon2': '0.126', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'weapon4': '0.542', 'WEAPON3': '1.300', 'HITCOUNT': '2.750', 'weapon3': '3.136', 'DAMAGECOUNT': '13.911', 'FRAGCOUNT': '47.000'} [2023-02-25 14:24:30,939][36155] DAMAGECOUNT value on done: 1025601.0 [2023-02-25 14:24:30,940][36155] Sum rewards: 76.729, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.480', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.096', 'AMMO4': '0.197', 'AMMO3': '0.211', 'weapon4': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.460', 'WEAPON3': '1.300', 'weapon3': '2.926', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.155', 'FRAGCOUNT': '66.000'} [2023-02-25 14:24:31,034][36157] DAMAGECOUNT value on done: 1033688.0 [2023-02-25 14:24:31,035][36157] Sum rewards: 68.596, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.144', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO4': '0.182', 'weapon4': '0.234', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.364', 'WEAPON3': '1.500', 'weapon3': '3.130', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '61.000'} [2023-02-25 14:24:31,346][36157] DAMAGECOUNT value on done: 1025810.0 [2023-02-25 14:24:31,346][36157] Sum rewards: 52.603, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.088', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon5': '0.130', 'AMMO4': '0.227', 'AMMO3': '0.230', 'weapon4': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.604', 'WEAPON3': '1.400', 'weapon3': '2.668', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.526', 'FRAGCOUNT': '49.000'} [2023-02-25 14:24:31,382][36138] Updated weights for policy 0, policy_version 50943 (0.0009) [2023-02-25 14:24:31,608][36140] DAMAGECOUNT value on done: 1025574.0 [2023-02-25 14:24:31,609][36140] Sum rewards: 55.813, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.312', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.018', 'weapon5': '0.054', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.289', 'weapon2': '0.490', 'WEAPON3': '1.750', 'HITCOUNT': '3.050', 'weapon3': '3.260', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '52.000'} [2023-02-25 14:24:31,899][36140] DAMAGECOUNT value on done: 1025106.0 [2023-02-25 14:24:31,900][36140] Sum rewards: 75.799, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.644', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.074', 'weapon4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'weapon2': '0.348', 'WEAPON3': '1.150', 'weapon3': '3.328', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '63.000'} [2023-02-25 14:24:31,941][36140] DAMAGECOUNT value on done: 1013677.0 [2023-02-25 14:24:31,942][36140] Sum rewards: 78.778, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.564', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.122', 'weapon4': '0.172', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon2': '0.406', 'WEAPON3': '1.100', 'weapon3': '3.186', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.662', 'FRAGCOUNT': '64.000'} [2023-02-25 14:24:32,043][36155] DAMAGECOUNT value on done: 1035365.0 [2023-02-25 14:24:32,043][36155] Sum rewards: 55.228, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.420', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.146', 'AMMO4': '0.158', 'AMMO3': '0.171', 'weapon5': '0.178', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.636', 'WEAPON3': '1.100', 'weapon3': '2.782', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.364', 'FRAGCOUNT': '47.000'} [2023-02-25 14:24:32,213][36140] DAMAGECOUNT value on done: 1015949.0 [2023-02-25 14:24:32,213][36140] Sum rewards: 48.580, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.116', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.132', 'weapon5': '0.180', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.382', 'WEAPON3': '0.800', 'weapon4': '1.180', 'weapon3': '1.910', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '11.517', 'FRAGCOUNT': '41.000'} [2023-02-25 14:24:32,351][36155] DAMAGECOUNT value on done: 1019544.0 [2023-02-25 14:24:32,352][36155] Sum rewards: 54.654, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.402', 'ARMOR': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.125', 'weapon2': '0.324', 'weapon4': '0.648', 'WEAPON3': '0.800', 'weapon3': '2.822', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.857', 'FRAGCOUNT': '43.000'} [2023-02-25 14:24:32,859][36139] DAMAGECOUNT value on done: 1022224.0 [2023-02-25 14:24:32,860][36139] Sum rewards: 62.119, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.315', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.080', 'weapon2': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.174', 'AMMO3': '0.228', 'WEAPON3': '1.450', 'HITCOUNT': '3.170', 'weapon3': '3.432', 'DAMAGECOUNT': '15.870', 'FRAGCOUNT': '54.000'} [2023-02-25 14:24:33,155][36139] DAMAGECOUNT value on done: 1020870.0 [2023-02-25 14:24:33,155][36139] Sum rewards: 50.049, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.550', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.137', 'weapon5': '0.148', 'AMMO3': '0.188', 'WEAPON5': '0.300', 'weapon4': '0.368', 'WEAPON4': '0.400', 'weapon2': '0.738', 'WEAPON3': '1.150', 'weapon3': '2.556', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.217', 'FRAGCOUNT': '44.000'} [2023-02-25 14:24:33,248][36142] DAMAGECOUNT value on done: 1026549.0 [2023-02-25 14:24:33,249][36142] Sum rewards: 65.794, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.322', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.116', 'AMMO3': '0.166', 'weapon2': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.358', 'WEAPON3': '1.050', 'weapon3': '3.128', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '54.000'} [2023-02-25 14:24:33,458][36139] DAMAGECOUNT value on done: 1037268.0 [2023-02-25 14:24:33,458][36139] Sum rewards: 65.329, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.920', 'AMMO5': '0.008', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon5': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon2': '0.268', 'weapon4': '0.452', 'WEAPON3': '1.300', 'weapon3': '2.838', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '17.301', 'FRAGCOUNT': '55.000'} [2023-02-25 14:24:33,571][36142] DAMAGECOUNT value on done: 1008178.0 [2023-02-25 14:24:33,571][36142] Sum rewards: 59.893, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.433', 'AMMO2': '0.016', 'AMMO4': '0.078', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon2': '0.344', 'weapon4': '0.476', 'WEAPON3': '1.250', 'weapon3': '2.926', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.249', 'FRAGCOUNT': '51.000'} [2023-02-25 14:24:33,755][36139] DAMAGECOUNT value on done: 1026874.0 [2023-02-25 14:24:33,755][36139] Sum rewards: 66.911, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.730', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.076', 'AMMO4': '0.085', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'weapon2': '0.452', 'WEAPON3': '1.050', 'HITCOUNT': '3.040', 'weapon3': '3.150', 'DAMAGECOUNT': '15.666', 'FRAGCOUNT': '55.000'} [2023-02-25 14:24:34,068][36142] DAMAGECOUNT value on done: 1021757.0 [2023-02-25 14:24:34,068][36142] Sum rewards: 71.096, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.263', 'AMMO5': '0.005', 'AMMO2': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.100', 'weapon2': '0.146', 'AMMO3': '0.156', 'AMMO4': '0.248', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'weapon4': '0.990', 'weapon3': '2.554', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '58.000'} [2023-02-25 14:24:34,367][36142] DAMAGECOUNT value on done: 1032093.0 [2023-02-25 14:24:34,367][36142] Sum rewards: 62.456, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.490', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.176', 'WEAPON5': '0.200', 'AMMO4': '0.210', 'AMMO3': '0.216', 'weapon2': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.768', 'WEAPON3': '1.200', 'weapon3': '2.450', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '55.000'} [2023-02-25 14:24:34,425][36138] Updated weights for policy 0, policy_version 50953 (0.0010) [2023-02-25 14:24:34,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13440.4). Total num frames: 208707584. Throughput: 0: 3360.1. Samples: 14674236. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:24:34,729][36114] Avg episode reward: [(0, '60.643')] [2023-02-25 14:24:34,730][36125] Saving new best policy, reward=60.643! [2023-02-25 14:24:35,986][36156] DAMAGECOUNT value on done: 1031542.0 [2023-02-25 14:24:35,987][36156] Sum rewards: 47.963, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.885', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.050', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'AMMO3': '0.175', 'WEAPON4': '0.350', 'weapon2': '0.452', 'weapon4': '0.522', 'WEAPON3': '1.000', 'weapon3': '2.802', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '12.384', 'FRAGCOUNT': '42.000'} [2023-02-25 14:24:35,998][36156] DAMAGECOUNT value on done: 1037575.0 [2023-02-25 14:24:35,998][36156] Sum rewards: 61.947, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.972', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon2': '0.148', 'weapon5': '0.204', 'AMMO3': '0.253', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.394', 'WEAPON3': '1.450', 'weapon3': '3.040', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '53.000'} [2023-02-25 14:24:36,312][36156] DAMAGECOUNT value on done: 1022564.0 [2023-02-25 14:24:36,312][36156] Sum rewards: 64.056, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.620', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon2': '0.322', 'weapon4': '0.408', 'WEAPON3': '1.300', 'weapon3': '3.074', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.948', 'FRAGCOUNT': '55.000'} [2023-02-25 14:24:36,324][36156] DAMAGECOUNT value on done: 1017766.0 [2023-02-25 14:24:36,324][36156] Sum rewards: 52.452, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.430', 'AMMO2': '0.039', 'weapon4': '0.162', 'weapon2': '0.192', 'AMMO4': '0.193', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '2.990', 'weapon3': '3.300', 'DAMAGECOUNT': '14.352', 'FRAGCOUNT': '49.000'} [2023-02-25 14:24:37,487][36138] Updated weights for policy 0, policy_version 50963 (0.0009) [2023-02-25 14:24:39,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 208773120. Throughput: 0: 3359.5. Samples: 14684366. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:24:39,730][36114] Avg episode reward: [(0, '60.372')] [2023-02-25 14:24:40,478][36138] Updated weights for policy 0, policy_version 50973 (0.0009) [2023-02-25 14:24:43,525][36138] Updated weights for policy 0, policy_version 50983 (0.0009) [2023-02-25 14:24:44,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13448.5, 300 sec: 13426.6). Total num frames: 208838656. Throughput: 0: 3361.8. Samples: 14704646. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:24:44,730][36114] Avg episode reward: [(0, '60.372')] [2023-02-25 14:24:46,541][36138] Updated weights for policy 0, policy_version 50993 (0.0009) [2023-02-25 14:24:46,835][36154] DAMAGECOUNT value on done: 1032241.0 [2023-02-25 14:24:46,836][36154] Sum rewards: 44.579, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.996', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.168', 'AMMO3': '0.193', 'weapon5': '0.248', 'WEAPON5': '0.350', 'weapon2': '0.394', 'WEAPON4': '0.400', 'weapon4': '0.532', 'WEAPON3': '1.150', 'weapon3': '2.456', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '12.147', 'FRAGCOUNT': '41.000'} [2023-02-25 14:24:47,139][36154] DAMAGECOUNT value on done: 1033036.0 [2023-02-25 14:24:47,140][36154] Sum rewards: 53.484, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.100', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.158', 'AMMO3': '0.201', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.464', 'weapon4': '0.494', 'WEAPON3': '1.250', 'weapon3': '2.644', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.784', 'FRAGCOUNT': '47.000'} [2023-02-25 14:24:47,150][36154] DAMAGECOUNT value on done: 1019353.0 [2023-02-25 14:24:47,150][36154] Sum rewards: 54.119, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.515', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.158', 'AMMO4': '0.160', 'AMMO3': '0.214', 'weapon2': '0.218', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.406', 'WEAPON3': '1.300', 'weapon3': '2.968', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.688', 'FRAGCOUNT': '47.000'} [2023-02-25 14:24:47,467][36154] DAMAGECOUNT value on done: 1026833.0 [2023-02-25 14:24:47,468][36154] Sum rewards: 65.933, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.904', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.128', 'AMMO4': '0.135', 'AMMO3': '0.197', 'weapon2': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.384', 'WEAPON3': '1.150', 'weapon3': '3.018', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '57.000'} [2023-02-25 14:24:47,595][36141] DAMAGECOUNT value on done: 1032820.0 [2023-02-25 14:24:47,595][36141] Sum rewards: 68.834, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.100', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.054', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.202', 'weapon2': '0.228', 'AMMO3': '0.304', 'WEAPON3': '1.800', 'weapon3': '3.254', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.363', 'FRAGCOUNT': '61.000'} [2023-02-25 14:24:47,814][36141] DAMAGECOUNT value on done: 1021262.0 [2023-02-25 14:24:47,815][36141] Sum rewards: 55.941, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.545', 'AMMO5': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.156', 'AMMO3': '0.227', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.626', 'WEAPON3': '1.350', 'weapon3': '2.652', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '49.000'} [2023-02-25 14:24:47,913][36141] DAMAGECOUNT value on done: 1032178.0 [2023-02-25 14:24:47,914][36141] Sum rewards: 59.826, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.986', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.132', 'weapon5': '0.140', 'AMMO3': '0.245', 'WEAPON3': '1.500', 'HITCOUNT': '3.060', 'weapon3': '3.462', 'DAMAGECOUNT': '14.952', 'FRAGCOUNT': '53.000'} [2023-02-25 14:24:48,129][36141] DAMAGECOUNT value on done: 1017852.0 [2023-02-25 14:24:48,130][36141] Sum rewards: 54.263, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.634', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO3': '0.122', 'AMMO4': '0.184', 'weapon5': '0.248', 'weapon2': '0.332', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.708', 'WEAPON3': '0.750', 'weapon3': '2.456', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '45.000'} [2023-02-25 14:24:49,603][36138] Updated weights for policy 0, policy_version 51003 (0.0009) [2023-02-25 14:24:49,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 208908288. Throughput: 0: 3361.1. Samples: 14724788. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:24:49,729][36114] Avg episode reward: [(0, '60.269')] [2023-02-25 14:24:50,034][36157] DAMAGECOUNT value on done: 1039545.0 [2023-02-25 14:24:50,035][36157] Sum rewards: 53.762, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.355', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.192', 'AMMO3': '0.198', 'AMMO4': '0.245', 'weapon2': '0.288', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.786', 'WEAPON3': '1.200', 'weapon3': '2.472', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.327', 'FRAGCOUNT': '48.000'} [2023-02-25 14:24:50,250][36139] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:24:50,341][36157] DAMAGECOUNT value on done: 1026861.0 [2023-02-25 14:24:50,342][36157] Sum rewards: 54.803, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.603', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.190', 'AMMO3': '0.244', 'weapon4': '0.392', 'WEAPON3': '1.500', 'weapon3': '3.216', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '48.000'} [2023-02-25 14:24:50,436][36155] DAMAGECOUNT value on done: 1018538.0 [2023-02-25 14:24:50,436][36155] Sum rewards: 42.508, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.480', 'ARMOR': '0.004', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.042', 'AMMO3': '0.129', 'AMMO4': '0.208', 'weapon5': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.584', 'weapon2': '0.786', 'WEAPON3': '0.850', 'weapon3': '2.072', 'HITCOUNT': '2.390', 'DAMAGECOUNT': '12.018', 'FRAGCOUNT': '36.000'} [2023-02-25 14:24:50,761][36155] DAMAGECOUNT value on done: 1030289.0 [2023-02-25 14:24:50,761][36155] Sum rewards: 54.404, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.148', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.147', 'AMMO4': '0.178', 'WEAPON4': '0.400', 'weapon2': '0.400', 'WEAPON3': '0.850', 'weapon4': '1.040', 'weapon3': '2.296', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.064', 'FRAGCOUNT': '45.000'} [2023-02-25 14:24:51,027][36157] DAMAGECOUNT value on done: 1037956.0 [2023-02-25 14:24:51,027][36157] Sum rewards: 46.034, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.948', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.051', 'AMMO3': '0.184', 'AMMO4': '0.256', 'weapon5': '0.290', 'WEAPON5': '0.300', 'weapon4': '0.498', 'WEAPON4': '0.550', 'weapon2': '0.790', 'WEAPON3': '1.050', 'weapon3': '2.208', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '12.570', 'FRAGCOUNT': '43.000'} [2023-02-25 14:24:51,315][36157] DAMAGECOUNT value on done: 1030544.0 [2023-02-25 14:24:51,316][36157] Sum rewards: 51.247, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.814', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'weapon5': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.322', 'weapon4': '0.854', 'WEAPON3': '1.000', 'weapon3': '2.326', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.202', 'FRAGCOUNT': '42.000'} [2023-02-25 14:24:51,628][36140] DAMAGECOUNT value on done: 1030709.0 [2023-02-25 14:24:51,628][36140] Sum rewards: 62.597, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.674', 'AMMO5': '0.008', 'weapon4': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon5': '0.038', 'WEAPON4': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'weapon2': '0.398', 'WEAPON3': '1.150', 'HITCOUNT': '3.170', 'weapon3': '3.198', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '53.000'} [2023-02-25 14:24:51,865][36155] DAMAGECOUNT value on done: 1040725.0 [2023-02-25 14:24:51,866][36155] Sum rewards: 67.215, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.346', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon2': '0.178', 'AMMO3': '0.209', 'WEAPON4': '0.350', 'weapon4': '0.446', 'WEAPON3': '1.350', 'weapon3': '3.198', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '60.000'} [2023-02-25 14:24:51,917][36140] DAMAGECOUNT value on done: 1029728.0 [2023-02-25 14:24:51,917][36140] Sum rewards: 52.740, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.074', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.048', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'weapon4': '0.178', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'weapon2': '0.518', 'WEAPON3': '1.200', 'weapon3': '3.002', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.866', 'FRAGCOUNT': '45.000'} [2023-02-25 14:24:51,952][36140] DAMAGECOUNT value on done: 1017964.0 [2023-02-25 14:24:51,952][36140] Sum rewards: 53.811, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.000', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.118', 'AMMO3': '0.155', 'AMMO4': '0.160', 'weapon5': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.476', 'WEAPON3': '0.950', 'HITCOUNT': '2.440', 'weapon3': '2.822', 'DAMAGECOUNT': '12.861', 'FRAGCOUNT': '46.000'} [2023-02-25 14:24:52,170][36155] DAMAGECOUNT value on done: 1024370.0 [2023-02-25 14:24:52,171][36155] Sum rewards: 59.690, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.951', 'AMMO5': '0.003', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.147', 'weapon4': '0.230', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.504', 'WEAPON3': '1.450', 'weapon3': '2.976', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.478', 'FRAGCOUNT': '53.000'} [2023-02-25 14:24:52,227][36140] DAMAGECOUNT value on done: 1022133.0 [2023-02-25 14:24:52,227][36140] Sum rewards: 71.843, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.210', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.060', 'weapon4': '0.154', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.260', 'WEAPON3': '1.200', 'weapon3': '3.300', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.552', 'FRAGCOUNT': '60.000'} [2023-02-25 14:24:52,586][36139] DAMAGECOUNT value on done: 1025739.0 [2023-02-25 14:24:52,586][36139] Sum rewards: 37.590, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.012', 'AMMO5': '0.012', 'weapon5': '0.024', 'AMMO2': '0.029', 'weapon7': '0.058', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.142', 'AMMO3': '0.178', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.576', 'weapon4': '0.750', 'WEAPON3': '1.050', 'weapon3': '2.168', 'HITCOUNT': '2.180', 'DAMAGECOUNT': '10.545', 'FRAGCOUNT': '33.500'} [2023-02-25 14:24:52,658][36138] Updated weights for policy 0, policy_version 51013 (0.0009) [2023-02-25 14:24:52,868][36139] DAMAGECOUNT value on done: 1025986.0 [2023-02-25 14:24:52,869][36139] Sum rewards: 62.376, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.046', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.114', 'AMMO4': '0.158', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.228', 'weapon2': '0.522', 'WEAPON3': '1.200', 'weapon3': '2.898', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.348', 'FRAGCOUNT': '53.000'} [2023-02-25 14:24:53,168][36139] DAMAGECOUNT value on done: 1042165.0 [2023-02-25 14:24:53,169][36139] Sum rewards: 56.656, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.936', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon4': '0.084', 'weapon5': '0.092', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'AMMO3': '0.172', 'weapon2': '0.590', 'WEAPON3': '1.050', 'weapon3': '3.042', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.691', 'FRAGCOUNT': '48.000'} [2023-02-25 14:24:53,345][36142] DAMAGECOUNT value on done: 1031579.0 [2023-02-25 14:24:53,345][36142] Sum rewards: 56.688, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.095', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.166', 'weapon2': '0.208', 'AMMO3': '0.228', 'WEAPON3': '1.550', 'HITCOUNT': '3.130', 'weapon3': '3.364', 'DAMAGECOUNT': '15.090', 'FRAGCOUNT': '50.000'} [2023-02-25 14:24:53,476][36139] DAMAGECOUNT value on done: 1030617.0 [2023-02-25 14:24:53,476][36139] Sum rewards: 45.298, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.217', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon2': '0.140', 'AMMO4': '0.157', 'AMMO3': '0.164', 'weapon5': '0.180', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.874', 'WEAPON3': '1.100', 'weapon3': '2.552', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '11.229', 'FRAGCOUNT': '39.000'} [2023-02-25 14:24:53,662][36142] DAMAGECOUNT value on done: 1014322.0 [2023-02-25 14:24:53,663][36142] Sum rewards: 70.770, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.377', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.058', 'AMMO3': '0.209', 'weapon2': '0.222', 'AMMO4': '0.292', 'weapon5': '0.368', 'weapon4': '0.476', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.596', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '62.000'} [2023-02-25 14:24:54,187][36142] DAMAGECOUNT value on done: 1026625.0 [2023-02-25 14:24:54,187][36142] Sum rewards: 53.214, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-4.504', 'AMMO5': '0.016', 'AMMO2': '0.041', 'AMMO4': '0.205', 'weapon4': '0.226', 'AMMO3': '0.282', 'weapon2': '0.392', 'weapon5': '0.428', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'weapon3': '2.594', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '14.604', 'FRAGCOUNT': '53.000'} [2023-02-25 14:24:54,489][36142] DAMAGECOUNT value on done: 1037385.0 [2023-02-25 14:24:54,489][36142] Sum rewards: 62.330, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.838', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.132', 'AMMO4': '0.184', 'AMMO3': '0.210', 'weapon2': '0.262', 'WEAPON5': '0.300', 'weapon4': '0.408', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.936', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.876', 'FRAGCOUNT': '54.000'} [2023-02-25 14:24:54,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13426.6). Total num frames: 208973824. Throughput: 0: 3361.5. Samples: 14734924. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:24:54,730][36114] Avg episode reward: [(0, '59.541')] [2023-02-25 14:24:55,692][36138] Updated weights for policy 0, policy_version 51023 (0.0009) [2023-02-25 14:24:55,845][36156] DAMAGECOUNT value on done: 1041567.0 [2023-02-25 14:24:55,845][36156] Sum rewards: 40.258, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.425', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.082', 'WEAPON5': '0.100', 'weapon2': '0.156', 'WEAPON4': '0.200', 'weapon4': '0.218', 'AMMO3': '0.233', 'WEAPON3': '1.400', 'HITCOUNT': '2.870', 'weapon3': '3.362', 'DAMAGECOUNT': '11.976', 'FRAGCOUNT': '37.000'} [2023-02-25 14:24:55,870][36156] DAMAGECOUNT value on done: 1036176.0 [2023-02-25 14:24:55,870][36156] Sum rewards: 51.896, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.290', 'AMMO5': '0.009', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.170', 'weapon5': '0.176', 'WEAPON4': '0.200', 'weapon4': '0.232', 'WEAPON5': '0.250', 'weapon2': '0.716', 'WEAPON3': '1.050', 'weapon3': '2.488', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.902', 'FRAGCOUNT': '43.000'} [2023-02-25 14:24:56,162][36156] DAMAGECOUNT value on done: 1024199.0 [2023-02-25 14:24:56,163][36156] Sum rewards: 21.697, reward structure: {'DEATHCOUNT': '-3.750', 'ARMOR': '0.004', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO3': '0.057', 'AMMO4': '0.062', 'weapon7': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON3': '0.300', 'weapon2': '0.476', 'weapon4': '0.490', 'HEALTH': '0.618', 'weapon3': '1.000', 'HITCOUNT': '1.080', 'DAMAGECOUNT': '4.905', 'FRAGCOUNT': '16.000'} [2023-02-25 14:24:56,183][36156] DAMAGECOUNT value on done: 1022487.0 [2023-02-25 14:24:56,184][36156] Sum rewards: 54.423, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.442', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.046', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'weapon2': '0.352', 'weapon4': '0.426', 'WEAPON3': '1.450', 'weapon3': '2.988', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.163', 'FRAGCOUNT': '48.000'} [2023-02-25 14:24:57,485][36140] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('ARMOR', -0.001, -1.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:24:58,721][36138] Updated weights for policy 0, policy_version 51033 (0.0009) [2023-02-25 14:24:59,729][36114] Fps is (10 sec: 13516.6, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 209043456. Throughput: 0: 3365.1. Samples: 14755162. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:24:59,730][36114] Avg episode reward: [(0, '58.597')] [2023-02-25 14:25:01,794][36138] Updated weights for policy 0, policy_version 51043 (0.0009) [2023-02-25 14:25:04,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 209108992. Throughput: 0: 3362.1. Samples: 14775268. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:25:04,729][36114] Avg episode reward: [(0, '58.597')] [2023-02-25 14:25:04,847][36138] Updated weights for policy 0, policy_version 51053 (0.0009) [2023-02-25 14:25:06,913][36154] DAMAGECOUNT value on done: 1037141.0 [2023-02-25 14:25:06,913][36154] Sum rewards: 52.921, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.560', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.084', 'AMMO4': '0.089', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'weapon2': '0.496', 'WEAPON3': '1.300', 'HITCOUNT': '2.820', 'weapon3': '3.080', 'DAMAGECOUNT': '14.700', 'FRAGCOUNT': '45.500'} [2023-02-25 14:25:07,217][36154] DAMAGECOUNT value on done: 1038088.0 [2023-02-25 14:25:07,217][36154] Sum rewards: 56.433, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.706', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.074', 'AMMO4': '0.112', 'AMMO3': '0.225', 'weapon4': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.480', 'WEAPON3': '1.300', 'weapon3': '2.986', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.156', 'FRAGCOUNT': '49.000'} [2023-02-25 14:25:07,226][36154] DAMAGECOUNT value on done: 1025027.0 [2023-02-25 14:25:07,227][36154] Sum rewards: 69.374, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.090', 'AMMO5': '0.014', 'AMMO2': '0.038', 'AMMO4': '0.192', 'AMMO3': '0.208', 'weapon2': '0.210', 'weapon5': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.736', 'WEAPON3': '1.250', 'weapon3': '2.544', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.022', 'FRAGCOUNT': '59.000'} [2023-02-25 14:25:07,534][36154] DAMAGECOUNT value on done: 1031974.0 [2023-02-25 14:25:07,534][36154] Sum rewards: 53.009, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.345', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.124', 'AMMO4': '0.153', 'weapon2': '0.214', 'AMMO3': '0.279', 'WEAPON5': '0.300', 'weapon4': '0.312', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.054', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.423', 'FRAGCOUNT': '49.000'} [2023-02-25 14:25:07,538][36141] DAMAGECOUNT value on done: 1038329.0 [2023-02-25 14:25:07,539][36141] Sum rewards: 61.701, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.150', 'AMMO5': '0.011', 'AMMO2': '0.041', 'AMMO3': '0.172', 'weapon5': '0.174', 'AMMO4': '0.207', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.364', 'weapon4': '0.458', 'WEAPON3': '1.100', 'weapon3': '2.696', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '51.000'} [2023-02-25 14:25:07,777][36141] DAMAGECOUNT value on done: 1025643.0 [2023-02-25 14:25:07,777][36141] Sum rewards: 51.836, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.860', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.092', 'AMMO3': '0.136', 'AMMO4': '0.164', 'weapon5': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.568', 'WEAPON3': '0.900', 'HITCOUNT': '2.800', 'weapon3': '2.898', 'DAMAGECOUNT': '13.143', 'FRAGCOUNT': '42.000'} [2023-02-25 14:25:07,877][36141] DAMAGECOUNT value on done: 1036764.0 [2023-02-25 14:25:07,877][36141] Sum rewards: 52.196, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.042', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.116', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.296', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon4': '0.534', 'WEAPON3': '1.250', 'weapon3': '2.716', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.758', 'FRAGCOUNT': '46.000'} [2023-02-25 14:25:07,931][36138] Updated weights for policy 0, policy_version 51063 (0.0009) [2023-02-25 14:25:08,090][36141] DAMAGECOUNT value on done: 1022472.0 [2023-02-25 14:25:08,091][36141] Sum rewards: 47.352, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.013', 'ARMOR': '0.008', 'AMMO5': '0.027', 'AMMO2': '0.077', 'AMMO3': '0.214', 'weapon5': '0.264', 'AMMO4': '0.383', 'WEAPON5': '0.700', 'weapon2': '0.732', 'WEAPON4': '0.750', 'weapon4': '0.782', 'WEAPON3': '1.200', 'weapon3': '1.818', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.860', 'FRAGCOUNT': '45.000'} [2023-02-25 14:25:09,252][36157] Large shaping reward 3.231 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.18, 60.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:25:09,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 209174528. Throughput: 0: 3362.7. Samples: 14785342. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:25:09,730][36114] Avg episode reward: [(0, '58.083')] [2023-02-25 14:25:10,144][36157] DAMAGECOUNT value on done: 1044904.0 [2023-02-25 14:25:10,145][36157] Sum rewards: 68.124, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.560', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.062', 'AMMO4': '0.123', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'weapon2': '0.238', 'WEAPON4': '0.250', 'weapon4': '0.406', 'WEAPON3': '1.250', 'weapon3': '3.080', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.077', 'FRAGCOUNT': '58.000'} [2023-02-25 14:25:10,463][36157] DAMAGECOUNT value on done: 1032354.0 [2023-02-25 14:25:10,463][36157] Sum rewards: 63.105, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.160', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.046', 'AMMO3': '0.207', 'AMMO4': '0.231', 'weapon2': '0.278', 'weapon5': '0.346', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.676', 'WEAPON3': '1.200', 'weapon3': '2.368', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.479', 'FRAGCOUNT': '55.000'} [2023-02-25 14:25:10,477][36155] DAMAGECOUNT value on done: 1023937.0 [2023-02-25 14:25:10,477][36155] Sum rewards: 60.589, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.275', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.058', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon4': '0.324', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.072', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.197', 'FRAGCOUNT': '52.000'} [2023-02-25 14:25:10,781][36155] DAMAGECOUNT value on done: 1034709.0 [2023-02-25 14:25:10,781][36155] Sum rewards: 44.486, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.592', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.195', 'weapon5': '0.288', 'weapon2': '0.380', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '1.020', 'WEAPON3': '1.150', 'weapon3': '1.838', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.260', 'FRAGCOUNT': '40.000'} [2023-02-25 14:25:10,972][36138] Updated weights for policy 0, policy_version 51073 (0.0008) [2023-02-25 14:25:11,142][36157] DAMAGECOUNT value on done: 1042546.0 [2023-02-25 14:25:11,142][36157] Sum rewards: 51.351, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.388', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO3': '0.147', 'AMMO4': '0.160', 'weapon5': '0.276', 'WEAPON5': '0.300', 'weapon2': '0.380', 'WEAPON4': '0.450', 'weapon4': '0.888', 'WEAPON3': '0.900', 'weapon3': '2.210', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.770', 'FRAGCOUNT': '43.000'} [2023-02-25 14:25:11,453][36157] DAMAGECOUNT value on done: 1035840.0 [2023-02-25 14:25:11,454][36157] Sum rewards: 64.560, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.285', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.031', 'AMMO4': '0.157', 'AMMO3': '0.168', 'weapon2': '0.232', 'weapon5': '0.254', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.710', 'WEAPON3': '1.050', 'weapon3': '2.532', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.888', 'FRAGCOUNT': '56.000'} [2023-02-25 14:25:11,655][36140] DAMAGECOUNT value on done: 1034624.0 [2023-02-25 14:25:11,656][36140] Sum rewards: 43.572, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.190', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.041', 'AMMO3': '0.131', 'weapon5': '0.150', 'WEAPON5': '0.200', 'AMMO4': '0.207', 'WEAPON4': '0.350', 'weapon2': '0.592', 'weapon4': '0.670', 'WEAPON3': '0.750', 'weapon3': '2.284', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '11.745', 'FRAGCOUNT': '36.000'} [2023-02-25 14:25:11,912][36155] DAMAGECOUNT value on done: 1045567.0 [2023-02-25 14:25:11,912][36155] Sum rewards: 54.957, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.230', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'weapon5': '0.354', 'weapon2': '0.356', 'ARMOR': '0.461', 'weapon4': '0.492', 'WEAPON3': '1.400', 'weapon3': '2.546', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.526', 'FRAGCOUNT': '49.000'} [2023-02-25 14:25:11,934][36140] DAMAGECOUNT value on done: 1034092.0 [2023-02-25 14:25:11,935][36140] Sum rewards: 42.577, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.720', 'ARMOR': '0.008', 'AMMO5': '0.040', 'AMMO2': '0.094', 'AMMO3': '0.123', 'weapon2': '0.294', 'AMMO4': '0.472', 'weapon5': '0.502', 'WEAPON3': '0.750', 'WEAPON5': '1.100', 'weapon4': '1.188', 'WEAPON4': '1.200', 'weapon3': '1.494', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '13.092', 'FRAGCOUNT': '39.000'} [2023-02-25 14:25:11,968][36140] DAMAGECOUNT value on done: 1022485.0 [2023-02-25 14:25:11,968][36140] Sum rewards: 48.077, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.280', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.128', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.282', 'weapon4': '0.364', 'WEAPON3': '1.200', 'HITCOUNT': '3.000', 'weapon3': '3.014', 'DAMAGECOUNT': '13.563', 'FRAGCOUNT': '42.000'} [2023-02-25 14:25:12,220][36155] DAMAGECOUNT value on done: 1029558.0 [2023-02-25 14:25:12,220][36155] Sum rewards: 59.625, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.383', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.048', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.104', 'weapon2': '0.220', 'AMMO3': '0.225', 'WEAPON3': '1.300', 'HITCOUNT': '3.090', 'weapon3': '3.406', 'DAMAGECOUNT': '15.564', 'FRAGCOUNT': '51.000'} [2023-02-25 14:25:12,247][36140] DAMAGECOUNT value on done: 1026893.0 [2023-02-25 14:25:12,247][36140] Sum rewards: 54.430, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.715', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.098', 'AMMO3': '0.207', 'weapon2': '0.476', 'WEAPON3': '1.400', 'HITCOUNT': '3.060', 'weapon3': '3.234', 'DAMAGECOUNT': '14.280', 'FRAGCOUNT': '47.000'} [2023-02-25 14:25:12,529][36139] DAMAGECOUNT value on done: 1030946.0 [2023-02-25 14:25:12,529][36139] Sum rewards: 58.863, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.080', 'AMMO5': '0.005', 'AMMO2': '0.043', 'weapon4': '0.058', 'weapon5': '0.110', 'WEAPON5': '0.200', 'AMMO4': '0.214', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'weapon2': '0.636', 'WEAPON3': '1.350', 'weapon3': '2.944', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.621', 'FRAGCOUNT': '52.000'} [2023-02-25 14:25:12,844][36139] DAMAGECOUNT value on done: 1031028.0 [2023-02-25 14:25:12,845][36139] Sum rewards: 59.571, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.047', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.140', 'AMMO4': '0.149', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.342', 'weapon2': '0.444', 'WEAPON3': '1.000', 'weapon3': '2.846', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.126', 'FRAGCOUNT': '49.500'} [2023-02-25 14:25:13,165][36139] DAMAGECOUNT value on done: 1046788.0 [2023-02-25 14:25:13,166][36139] Sum rewards: 56.378, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.830', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.166', 'AMMO3': '0.179', 'weapon5': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.462', 'weapon4': '0.824', 'WEAPON3': '1.000', 'weapon3': '2.086', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.869', 'FRAGCOUNT': '48.000'} [2023-02-25 14:25:13,286][36142] DAMAGECOUNT value on done: 1036258.0 [2023-02-25 14:25:13,287][36142] Sum rewards: 54.464, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.758', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.153', 'weapon2': '0.172', 'AMMO3': '0.184', 'weapon5': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.476', 'WEAPON3': '1.200', 'weapon3': '2.904', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.037', 'FRAGCOUNT': '47.000'} [2023-02-25 14:25:13,475][36139] DAMAGECOUNT value on done: 1035301.0 [2023-02-25 14:25:13,476][36139] Sum rewards: 58.281, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.545', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'weapon5': '0.128', 'AMMO3': '0.157', 'weapon2': '0.228', 'weapon4': '0.410', 'WEAPON3': '1.050', 'HITCOUNT': '2.950', 'weapon3': '3.002', 'DAMAGECOUNT': '14.052', 'FRAGCOUNT': '48.000'} [2023-02-25 14:25:13,604][36142] DAMAGECOUNT value on done: 1019673.0 [2023-02-25 14:25:13,604][36142] Sum rewards: 53.946, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.370', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.164', 'WEAPON5': '0.250', 'weapon2': '0.256', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'weapon4': '0.300', 'WEAPON3': '1.600', 'weapon3': '2.964', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '49.000'} [2023-02-25 14:25:14,016][36138] Updated weights for policy 0, policy_version 51083 (0.0009) [2023-02-25 14:25:14,160][36142] DAMAGECOUNT value on done: 1031424.0 [2023-02-25 14:25:14,161][36142] Sum rewards: 56.927, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.915', 'AMMO5': '0.013', 'AMMO2': '0.036', 'AMMO3': '0.179', 'AMMO4': '0.179', 'weapon4': '0.228', 'weapon5': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.620', 'WEAPON3': '1.100', 'weapon3': '2.682', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '14.397', 'FRAGCOUNT': '48.500'} [2023-02-25 14:25:14,475][36142] DAMAGECOUNT value on done: 1041843.0 [2023-02-25 14:25:14,476][36142] Sum rewards: 54.299, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.268', 'AMMO2': '0.019', 'AMMO4': '0.094', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'weapon4': '0.264', 'weapon2': '0.532', 'WEAPON3': '1.000', 'HITCOUNT': '2.690', 'weapon3': '2.984', 'DAMAGECOUNT': '13.374', 'FRAGCOUNT': '44.000'} [2023-02-25 14:25:14,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 209244160. Throughput: 0: 3365.7. Samples: 14805478. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:25:14,729][36114] Avg episode reward: [(0, '57.338')] [2023-02-25 14:25:15,818][36156] DAMAGECOUNT value on done: 1046337.0 [2023-02-25 14:25:15,819][36156] Sum rewards: 55.913, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.343', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.050', 'AMMO4': '0.117', 'AMMO3': '0.158', 'WEAPON5': '0.200', 'weapon2': '0.342', 'WEAPON4': '0.450', 'weapon4': '0.852', 'WEAPON3': '0.950', 'weapon3': '2.426', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.310', 'FRAGCOUNT': '47.000'} [2023-02-25 14:25:15,840][36156] DAMAGECOUNT value on done: 1041393.0 [2023-02-25 14:25:15,840][36156] Sum rewards: 62.064, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.230', 'ARMOR': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.226', 'weapon2': '0.336', 'WEAPON4': '0.400', 'weapon4': '0.462', 'WEAPON3': '1.400', 'weapon3': '2.998', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.651', 'FRAGCOUNT': '56.000'} [2023-02-25 14:25:16,144][36156] DAMAGECOUNT value on done: 1028339.0 [2023-02-25 14:25:16,144][36156] Sum rewards: 46.423, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.597', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon4': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.796', 'WEAPON3': '1.200', 'HITCOUNT': '2.570', 'weapon3': '2.656', 'DAMAGECOUNT': '12.420', 'FRAGCOUNT': '41.000'} [2023-02-25 14:25:16,166][36156] DAMAGECOUNT value on done: 1028266.0 [2023-02-25 14:25:16,167][36156] Sum rewards: 62.262, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.532', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.186', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.398', 'weapon2': '0.460', 'WEAPON3': '1.400', 'weapon3': '2.714', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '53.000'} [2023-02-25 14:25:17,069][36138] Updated weights for policy 0, policy_version 51093 (0.0009) [2023-02-25 14:25:19,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 209309696. Throughput: 0: 3364.9. Samples: 14825656. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:25:19,730][36114] Avg episode reward: [(0, '57.230')] [2023-02-25 14:25:19,735][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000051101_209309696.pth... [2023-02-25 14:25:19,790][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000050314_206086144.pth [2023-02-25 14:25:20,119][36138] Updated weights for policy 0, policy_version 51103 (0.0010) [2023-02-25 14:25:23,146][36138] Updated weights for policy 0, policy_version 51113 (0.0009) [2023-02-25 14:25:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 209379328. Throughput: 0: 3361.8. Samples: 14835646. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:25:24,729][36114] Avg episode reward: [(0, '57.230')] [2023-02-25 14:25:26,193][36138] Updated weights for policy 0, policy_version 51123 (0.0009) [2023-02-25 14:25:27,069][36154] DAMAGECOUNT value on done: 1042624.0 [2023-02-25 14:25:27,070][36154] Sum rewards: 63.570, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.900', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.022', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.225', 'weapon2': '0.454', 'WEAPON3': '1.300', 'weapon3': '3.282', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '54.000'} [2023-02-25 14:25:27,376][36154] DAMAGECOUNT value on done: 1043013.0 [2023-02-25 14:25:27,376][36154] Sum rewards: 64.774, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.000', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.042', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.161', 'WEAPON4': '0.250', 'weapon2': '0.362', 'ARMOR': '0.461', 'weapon4': '0.464', 'WEAPON3': '1.050', 'weapon3': '2.926', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '55.000'} [2023-02-25 14:25:27,386][36154] DAMAGECOUNT value on done: 1030029.0 [2023-02-25 14:25:27,386][36154] Sum rewards: 55.523, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.128', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO3': '0.137', 'weapon5': '0.174', 'AMMO4': '0.196', 'WEAPON5': '0.300', 'weapon4': '0.408', 'WEAPON4': '0.450', 'weapon2': '0.768', 'WEAPON3': '0.800', 'weapon3': '2.256', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.006', 'FRAGCOUNT': '45.500'} [2023-02-25 14:25:27,491][36141] DAMAGECOUNT value on done: 1042618.0 [2023-02-25 14:25:27,492][36141] Sum rewards: 48.960, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.235', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO4': '0.138', 'AMMO3': '0.175', 'WEAPON4': '0.300', 'weapon2': '0.392', 'weapon4': '0.772', 'WEAPON3': '1.050', 'weapon3': '2.536', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '12.867', 'FRAGCOUNT': '43.000'} [2023-02-25 14:25:27,690][36154] DAMAGECOUNT value on done: 1036874.0 [2023-02-25 14:25:27,690][36154] Sum rewards: 48.985, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.716', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.108', 'weapon2': '0.250', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.344', 'WEAPON3': '1.550', 'weapon3': '3.002', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.700', 'FRAGCOUNT': '46.000'} [2023-02-25 14:25:27,698][36141] DAMAGECOUNT value on done: 1031683.0 [2023-02-25 14:25:27,699][36141] Sum rewards: 71.353, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.375', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.038', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon4': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.560', 'WEAPON3': '1.200', 'weapon3': '2.996', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '59.000'} [2023-02-25 14:25:27,816][36141] DAMAGECOUNT value on done: 1042268.0 [2023-02-25 14:25:27,817][36141] Sum rewards: 71.141, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.640', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.112', 'AMMO3': '0.171', 'AMMO4': '0.176', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.426', 'weapon2': '0.482', 'WEAPON3': '1.150', 'weapon3': '2.708', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '59.000'} [2023-02-25 14:25:28,035][36141] DAMAGECOUNT value on done: 1027711.0 [2023-02-25 14:25:28,036][36141] Sum rewards: 51.805, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.590', 'ARMOR': '0.016', 'AMMO5': '0.033', 'AMMO2': '0.081', 'AMMO3': '0.167', 'weapon5': '0.320', 'weapon2': '0.348', 'AMMO4': '0.403', 'weapon4': '0.718', 'WEAPON5': '0.850', 'WEAPON3': '0.950', 'WEAPON4': '0.950', 'weapon3': '2.242', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '46.000'} [2023-02-25 14:25:29,283][36138] Updated weights for policy 0, policy_version 51133 (0.0009) [2023-02-25 14:25:29,729][36114] Fps is (10 sec: 13517.0, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 209444864. Throughput: 0: 3356.1. Samples: 14855672. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:25:29,730][36114] Avg episode reward: [(0, '57.136')] [2023-02-25 14:25:30,249][36157] DAMAGECOUNT value on done: 1049368.0 [2023-02-25 14:25:30,250][36157] Sum rewards: 47.676, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.844', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon5': '0.092', 'weapon4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon2': '0.630', 'WEAPON3': '1.000', 'weapon3': '2.694', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '13.392', 'FRAGCOUNT': '40.000'} [2023-02-25 14:25:30,437][36155] DAMAGECOUNT value on done: 1027905.0 [2023-02-25 14:25:30,437][36155] Sum rewards: 46.432, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.007', 'AMMO2': '0.039', 'AMMO3': '0.105', 'weapon5': '0.108', 'AMMO4': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'HEALTH': '0.488', 'WEAPON3': '0.550', 'weapon2': '0.888', 'weapon4': '1.032', 'weapon3': '1.638', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '11.904', 'FRAGCOUNT': '35.000'} [2023-02-25 14:25:30,546][36157] DAMAGECOUNT value on done: 1037113.0 [2023-02-25 14:25:30,547][36157] Sum rewards: 55.450, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.968', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.144', 'AMMO4': '0.173', 'weapon4': '0.186', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '2.870', 'weapon3': '3.080', 'DAMAGECOUNT': '14.277', 'FRAGCOUNT': '50.000'} [2023-02-25 14:25:30,770][36155] DAMAGECOUNT value on done: 1039603.0 [2023-02-25 14:25:30,770][36155] Sum rewards: 59.815, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.690', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO3': '0.145', 'AMMO4': '0.166', 'weapon5': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.322', 'weapon2': '0.378', 'WEAPON3': '1.000', 'weapon3': '2.920', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.682', 'FRAGCOUNT': '50.000'} [2023-02-25 14:25:31,183][36157] DAMAGECOUNT value on done: 1046723.0 [2023-02-25 14:25:31,183][36157] Sum rewards: 44.372, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.144', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon4': '0.362', 'weapon2': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '2.730', 'weapon3': '2.846', 'DAMAGECOUNT': '12.531', 'FRAGCOUNT': '39.000'} [2023-02-25 14:25:31,516][36157] DAMAGECOUNT value on done: 1040778.0 [2023-02-25 14:25:31,517][36157] Sum rewards: 58.872, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.984', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.150', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.248', 'weapon2': '0.866', 'WEAPON3': '1.000', 'weapon3': '2.484', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '14.814', 'FRAGCOUNT': '48.000'} [2023-02-25 14:25:31,702][36140] DAMAGECOUNT value on done: 1038660.0 [2023-02-25 14:25:31,703][36140] Sum rewards: 47.591, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.545', 'AMMO5': '0.003', 'weapon5': '0.020', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO4': '0.114', 'weapon2': '0.188', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'weapon4': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.450', 'weapon3': '3.182', 'DAMAGECOUNT': '12.108', 'FRAGCOUNT': '43.000'} [2023-02-25 14:25:31,898][36155] DAMAGECOUNT value on done: 1050947.0 [2023-02-25 14:25:31,899][36155] Sum rewards: 63.289, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.916', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'weapon2': '0.518', 'weapon4': '0.560', 'WEAPON3': '1.150', 'weapon3': '2.564', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '16.140', 'FRAGCOUNT': '53.000'} [2023-02-25 14:25:31,974][36140] DAMAGECOUNT value on done: 1038455.0 [2023-02-25 14:25:31,974][36140] Sum rewards: 50.494, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.718', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.100', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.228', 'weapon2': '0.654', 'WEAPON3': '1.150', 'weapon3': '2.820', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '12.834', 'FRAGCOUNT': '42.000'} [2023-02-25 14:25:32,023][36140] DAMAGECOUNT value on done: 1027334.0 [2023-02-25 14:25:32,024][36140] Sum rewards: 58.942, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.221', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon5': '0.180', 'AMMO4': '0.206', 'AMMO3': '0.222', 'weapon2': '0.344', 'WEAPON5': '0.350', 'weapon4': '0.396', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.732', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.547', 'FRAGCOUNT': '52.000'} [2023-02-25 14:25:32,205][36155] DAMAGECOUNT value on done: 1033606.0 [2023-02-25 14:25:32,206][36155] Sum rewards: 45.789, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.205', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.054', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.248', 'weapon4': '0.288', 'weapon2': '0.372', 'WEAPON3': '1.450', 'HITCOUNT': '2.760', 'weapon3': '3.070', 'DAMAGECOUNT': '12.144', 'FRAGCOUNT': '43.000'} [2023-02-25 14:25:32,288][36140] DAMAGECOUNT value on done: 1031104.0 [2023-02-25 14:25:32,288][36140] Sum rewards: 45.020, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.540', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.042', 'AMMO3': '0.149', 'AMMO4': '0.210', 'weapon5': '0.244', 'weapon4': '0.292', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.812', 'WEAPON3': '0.900', 'weapon3': '2.390', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '12.633', 'FRAGCOUNT': '39.000'} [2023-02-25 14:25:32,346][36138] Updated weights for policy 0, policy_version 51143 (0.0009) [2023-02-25 14:25:32,607][36139] DAMAGECOUNT value on done: 1035582.0 [2023-02-25 14:25:32,607][36139] Sum rewards: 50.613, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.580', 'weapon5': '0.002', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.014', 'WEAPON5': '0.050', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon4': '0.426', 'weapon2': '0.784', 'WEAPON3': '1.300', 'weapon3': '2.518', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '13.908', 'FRAGCOUNT': '44.000'} [2023-02-25 14:25:32,919][36139] DAMAGECOUNT value on done: 1035524.0 [2023-02-25 14:25:32,920][36139] Sum rewards: 54.537, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.053', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.008', 'weapon5': '0.048', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'weapon4': '0.300', 'weapon2': '0.438', 'WEAPON3': '1.000', 'weapon3': '2.840', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '13.488', 'FRAGCOUNT': '45.000'} [2023-02-25 14:25:33,231][36139] DAMAGECOUNT value on done: 1051939.0 [2023-02-25 14:25:33,231][36139] Sum rewards: 60.220, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.322', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.042', 'weapon5': '0.046', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'AMMO4': '0.208', 'weapon4': '0.390', 'WEAPON4': '0.400', 'weapon2': '0.664', 'WEAPON3': '1.150', 'weapon3': '2.712', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.453', 'FRAGCOUNT': '52.000'} [2023-02-25 14:25:33,465][36142] DAMAGECOUNT value on done: 1041404.0 [2023-02-25 14:25:33,466][36142] Sum rewards: 57.143, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.370', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON5': '0.100', 'AMMO3': '0.215', 'weapon2': '0.456', 'WEAPON3': '1.450', 'weapon3': '3.346', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.303', 'FRAGCOUNT': '49.000'} [2023-02-25 14:25:33,540][36139] DAMAGECOUNT value on done: 1039839.0 [2023-02-25 14:25:33,540][36139] Sum rewards: 52.912, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.786', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.158', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'weapon2': '0.392', 'weapon4': '0.528', 'WEAPON3': '1.350', 'weapon3': '2.808', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.614', 'FRAGCOUNT': '48.000'} [2023-02-25 14:25:33,758][36142] DAMAGECOUNT value on done: 1024179.0 [2023-02-25 14:25:33,758][36142] Sum rewards: 50.978, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.076', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon5': '0.132', 'AMMO4': '0.179', 'AMMO3': '0.181', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.628', 'weapon2': '0.672', 'WEAPON3': '1.100', 'weapon3': '2.184', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.518', 'FRAGCOUNT': '45.000'} [2023-02-25 14:25:34,315][36142] DAMAGECOUNT value on done: 1036820.0 [2023-02-25 14:25:34,316][36142] Sum rewards: 56.965, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.798', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'weapon4': '0.326', 'weapon2': '0.448', 'WEAPON3': '1.450', 'weapon3': '2.708', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.188', 'FRAGCOUNT': '49.500'} [2023-02-25 14:25:34,612][36142] DAMAGECOUNT value on done: 1047920.0 [2023-02-25 14:25:34,612][36142] Sum rewards: 67.586, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.990', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon2': '0.180', 'weapon5': '0.196', 'AMMO4': '0.200', 'AMMO3': '0.219', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.412', 'WEAPON3': '1.300', 'weapon3': '2.906', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '58.000'} [2023-02-25 14:25:34,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.2, 300 sec: 13426.5). Total num frames: 209510400. Throughput: 0: 3355.9. Samples: 14875804. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:25:34,730][36114] Avg episode reward: [(0, '55.581')] [2023-02-25 14:25:35,355][36138] Updated weights for policy 0, policy_version 51153 (0.0009) [2023-02-25 14:25:35,947][36156] DAMAGECOUNT value on done: 1051087.0 [2023-02-25 14:25:35,948][36156] Sum rewards: 57.587, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.460', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.470', 'weapon2': '0.518', 'WEAPON3': '0.900', 'weapon3': '2.790', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.250', 'FRAGCOUNT': '46.000'} [2023-02-25 14:25:35,973][36156] DAMAGECOUNT value on done: 1046015.0 [2023-02-25 14:25:35,973][36156] Sum rewards: 54.794, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.560', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.054', 'weapon5': '0.098', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'AMMO4': '0.268', 'weapon4': '0.404', 'WEAPON4': '0.500', 'weapon2': '0.734', 'WEAPON3': '1.100', 'weapon3': '2.394', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.866', 'FRAGCOUNT': '48.000'} [2023-02-25 14:25:36,266][36156] DAMAGECOUNT value on done: 1033367.0 [2023-02-25 14:25:36,266][36156] Sum rewards: 54.626, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.870', 'AMMO5': '0.017', 'AMMO2': '0.053', 'AMMO3': '0.179', 'AMMO4': '0.266', 'weapon2': '0.270', 'weapon5': '0.296', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.856', 'WEAPON3': '1.100', 'weapon3': '2.164', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.084', 'FRAGCOUNT': '46.500'} [2023-02-25 14:25:36,292][36156] DAMAGECOUNT value on done: 1033752.0 [2023-02-25 14:25:36,293][36156] Sum rewards: 69.517, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.315', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.020', 'weapon5': '0.048', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.354', 'weapon4': '0.534', 'WEAPON3': '1.250', 'weapon3': '2.856', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '59.000'} [2023-02-25 14:25:38,470][36138] Updated weights for policy 0, policy_version 51163 (0.0010) [2023-02-25 14:25:39,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 209580032. Throughput: 0: 3354.6. Samples: 14885880. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:25:39,730][36114] Avg episode reward: [(0, '55.342')] [2023-02-25 14:25:41,531][36138] Updated weights for policy 0, policy_version 51173 (0.0009) [2023-02-25 14:25:44,595][36138] Updated weights for policy 0, policy_version 51183 (0.0009) [2023-02-25 14:25:44,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 209645568. Throughput: 0: 3351.0. Samples: 14905958. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:25:44,730][36114] Avg episode reward: [(0, '55.342')] [2023-02-25 14:25:47,122][36154] DAMAGECOUNT value on done: 1047984.0 [2023-02-25 14:25:47,122][36154] Sum rewards: 57.907, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.944', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.045', 'AMMO3': '0.208', 'weapon5': '0.220', 'AMMO4': '0.223', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.384', 'weapon2': '0.490', 'WEAPON3': '1.300', 'weapon3': '2.584', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '50.000'} [2023-02-25 14:25:47,427][36154] DAMAGECOUNT value on done: 1047396.0 [2023-02-25 14:25:47,428][36154] Sum rewards: 50.337, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.632', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.142', 'AMMO4': '0.157', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'WEAPON4': '0.350', 'weapon2': '0.420', 'ARMOR': '0.459', 'weapon4': '0.692', 'WEAPON3': '1.250', 'weapon3': '1.984', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.149', 'FRAGCOUNT': '46.000'} [2023-02-25 14:25:47,439][36154] DAMAGECOUNT value on done: 1035016.0 [2023-02-25 14:25:47,439][36154] Sum rewards: 55.703, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.702', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon5': '0.196', 'AMMO3': '0.226', 'AMMO4': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.374', 'weapon4': '0.472', 'WEAPON3': '1.350', 'weapon3': '2.582', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.961', 'FRAGCOUNT': '48.500'} [2023-02-25 14:25:47,607][36141] DAMAGECOUNT value on done: 1046974.0 [2023-02-25 14:25:47,607][36141] Sum rewards: 50.736, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.990', 'AMMO5': '0.013', 'AMMO2': '0.051', 'AMMO3': '0.137', 'AMMO4': '0.254', 'weapon5': '0.264', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON4': '0.500', 'WEAPON3': '0.800', 'weapon4': '0.962', 'weapon3': '2.098', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.068', 'FRAGCOUNT': '42.000'} [2023-02-25 14:25:47,645][36138] Updated weights for policy 0, policy_version 51193 (0.0009) [2023-02-25 14:25:47,749][36154] DAMAGECOUNT value on done: 1042394.0 [2023-02-25 14:25:47,749][36154] Sum rewards: 63.116, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.014', 'AMMO5': '0.010', 'AMMO2': '0.061', 'weapon5': '0.152', 'AMMO3': '0.155', 'WEAPON5': '0.250', 'AMMO4': '0.303', 'weapon4': '0.414', 'weapon2': '0.420', 'WEAPON4': '0.650', 'WEAPON3': '0.900', 'weapon3': '2.734', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.560', 'FRAGCOUNT': '53.000'} [2023-02-25 14:25:47,827][36141] DAMAGECOUNT value on done: 1036661.0 [2023-02-25 14:25:47,827][36141] Sum rewards: 62.073, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.187', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.138', 'AMMO3': '0.151', 'weapon4': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.738', 'WEAPON3': '0.950', 'weapon3': '2.686', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.934', 'FRAGCOUNT': '51.000'} [2023-02-25 14:25:47,932][36141] DAMAGECOUNT value on done: 1047033.0 [2023-02-25 14:25:47,933][36141] Sum rewards: 55.704, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.098', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.164', 'weapon4': '0.180', 'weapon5': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.640', 'WEAPON3': '1.250', 'weapon3': '2.712', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.295', 'FRAGCOUNT': '48.000'} [2023-02-25 14:25:48,147][36141] DAMAGECOUNT value on done: 1032357.0 [2023-02-25 14:25:48,147][36141] Sum rewards: 44.748, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.442', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.057', 'AMMO3': '0.175', 'weapon5': '0.240', 'AMMO4': '0.285', 'weapon2': '0.296', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '1.050', 'weapon4': '1.194', 'weapon3': '1.722', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.938', 'FRAGCOUNT': '40.000'} [2023-02-25 14:25:49,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 209715200. Throughput: 0: 3351.5. Samples: 14926084. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:25:49,730][36114] Avg episode reward: [(0, '55.300')] [2023-02-25 14:25:50,361][36157] DAMAGECOUNT value on done: 1054216.0 [2023-02-25 14:25:50,362][36157] Sum rewards: 51.720, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.517', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.094', 'AMMO4': '0.154', 'weapon2': '0.226', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.278', 'WEAPON3': '1.400', 'HITCOUNT': '3.110', 'weapon3': '3.162', 'DAMAGECOUNT': '14.544', 'FRAGCOUNT': '44.000'} [2023-02-25 14:25:50,384][36155] DAMAGECOUNT value on done: 1032986.0 [2023-02-25 14:25:50,385][36155] Sum rewards: 58.202, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.577', 'ARMOR': '0.004', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON4': '0.150', 'weapon4': '0.190', 'AMMO3': '0.264', 'weapon2': '0.324', 'WEAPON3': '1.600', 'weapon3': '3.284', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.243', 'FRAGCOUNT': '52.000'} [2023-02-25 14:25:50,668][36138] Updated weights for policy 0, policy_version 51203 (0.0009) [2023-02-25 14:25:50,687][36157] DAMAGECOUNT value on done: 1042333.0 [2023-02-25 14:25:50,687][36157] Sum rewards: 50.209, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.755', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.068', 'AMMO3': '0.233', 'weapon5': '0.306', 'weapon2': '0.308', 'AMMO4': '0.339', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'weapon4': '0.666', 'WEAPON3': '1.350', 'weapon3': '2.268', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '47.000'} [2023-02-25 14:25:50,715][36155] DAMAGECOUNT value on done: 1043623.0 [2023-02-25 14:25:50,715][36155] Sum rewards: 45.768, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.430', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.084', 'AMMO3': '0.130', 'AMMO4': '0.133', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.730', 'weapon2': '0.738', 'WEAPON3': '0.800', 'weapon3': '2.246', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.060', 'FRAGCOUNT': '38.000'} [2023-02-25 14:25:51,321][36157] DAMAGECOUNT value on done: 1052160.0 [2023-02-25 14:25:51,322][36157] Sum rewards: 68.726, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.760', 'AMMO2': '0.005', 'AMMO4': '0.027', 'AMMO3': '0.213', 'weapon2': '0.734', 'WEAPON3': '1.350', 'weapon3': '3.096', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '58.000'} [2023-02-25 14:25:51,631][36157] DAMAGECOUNT value on done: 1046557.0 [2023-02-25 14:25:51,632][36157] Sum rewards: 64.693, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.792', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.068', 'AMMO4': '0.124', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'weapon4': '0.232', 'weapon2': '0.252', 'WEAPON4': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.186', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '54.000'} [2023-02-25 14:25:51,736][36140] DAMAGECOUNT value on done: 1043753.0 [2023-02-25 14:25:51,736][36140] Sum rewards: 60.485, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.310', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.110', 'AMMO4': '0.149', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.404', 'weapon4': '0.438', 'WEAPON3': '1.200', 'weapon3': '2.780', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.279', 'FRAGCOUNT': '52.000'} [2023-02-25 14:25:51,783][36155] DAMAGECOUNT value on done: 1055950.0 [2023-02-25 14:25:51,784][36155] Sum rewards: 61.654, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.039', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon5': '0.016', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'weapon4': '0.202', 'weapon2': '0.306', 'WEAPON3': '1.050', 'HITCOUNT': '3.270', 'weapon3': '3.332', 'DAMAGECOUNT': '15.009', 'FRAGCOUNT': '51.000'} [2023-02-25 14:25:52,020][36140] DAMAGECOUNT value on done: 1044032.0 [2023-02-25 14:25:52,020][36140] Sum rewards: 60.414, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.940', 'AMMO5': '0.014', 'AMMO2': '0.024', 'weapon5': '0.116', 'AMMO4': '0.119', 'AMMO3': '0.166', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.430', 'weapon2': '0.544', 'WEAPON3': '1.000', 'weapon3': '2.690', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '49.000'} [2023-02-25 14:25:52,058][36140] DAMAGECOUNT value on done: 1031992.0 [2023-02-25 14:25:52,058][36140] Sum rewards: 51.935, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.514', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'weapon5': '0.106', 'weapon2': '0.184', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon4': '0.386', 'WEAPON3': '1.300', 'HITCOUNT': '2.980', 'weapon3': '3.086', 'DAMAGECOUNT': '13.974', 'FRAGCOUNT': '45.000'} [2023-02-25 14:25:52,079][36155] DAMAGECOUNT value on done: 1038078.0 [2023-02-25 14:25:52,080][36155] Sum rewards: 43.479, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.730', 'ARMOR': '0.004', 'AMMO5': '0.022', 'weapon7': '0.046', 'AMMO2': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.194', 'AMMO4': '0.298', 'weapon5': '0.304', 'WEAPON5': '0.450', 'weapon2': '0.506', 'WEAPON4': '0.750', 'WEAPON3': '1.100', 'weapon4': '1.106', 'weapon3': '1.632', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.416', 'FRAGCOUNT': '41.000'} [2023-02-25 14:25:52,337][36140] DAMAGECOUNT value on done: 1035574.0 [2023-02-25 14:25:52,337][36140] Sum rewards: 41.140, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.600', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.078', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.260', 'WEAPON4': '0.350', 'weapon2': '0.406', 'weapon4': '0.642', 'WEAPON3': '1.500', 'weapon3': '2.612', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.410', 'FRAGCOUNT': '39.000'} [2023-02-25 14:25:52,547][36139] DAMAGECOUNT value on done: 1040486.0 [2023-02-25 14:25:52,547][36139] Sum rewards: 57.402, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.080', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.036', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.181', 'AMMO3': '0.190', 'WEAPON4': '0.300', 'weapon2': '0.304', 'weapon4': '0.790', 'WEAPON3': '1.200', 'weapon3': '2.704', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.712', 'FRAGCOUNT': '50.000'} [2023-02-25 14:25:52,860][36139] DAMAGECOUNT value on done: 1040756.0 [2023-02-25 14:25:52,861][36139] Sum rewards: 63.220, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.201', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'WEAPON4': '0.250', 'weapon2': '0.260', 'weapon4': '0.320', 'WEAPON3': '1.000', 'weapon3': '3.180', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.696', 'FRAGCOUNT': '52.000'} [2023-02-25 14:25:53,149][36139] DAMAGECOUNT value on done: 1057281.0 [2023-02-25 14:25:53,149][36139] Sum rewards: 64.665, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.754', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.142', 'AMMO4': '0.156', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.290', 'weapon4': '0.606', 'WEAPON3': '1.150', 'weapon3': '2.732', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.981', 'FRAGCOUNT': '55.000'} [2023-02-25 14:25:53,464][36139] DAMAGECOUNT value on done: 1044221.0 [2023-02-25 14:25:53,464][36139] Sum rewards: 43.480, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.022', 'AMMO5': '0.010', 'AMMO2': '0.052', 'weapon5': '0.170', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'AMMO4': '0.258', 'WEAPON4': '0.350', 'weapon2': '0.416', 'weapon4': '0.502', 'WEAPON3': '1.200', 'weapon3': '2.572', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.146', 'FRAGCOUNT': '40.500'} [2023-02-25 14:25:53,585][36142] DAMAGECOUNT value on done: 1045875.0 [2023-02-25 14:25:53,586][36142] Sum rewards: 49.821, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.536', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.086', 'AMMO4': '0.103', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon4': '0.256', 'weapon2': '0.790', 'WEAPON3': '1.150', 'weapon3': '2.660', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.413', 'FRAGCOUNT': '45.000'} [2023-02-25 14:25:53,723][36138] Updated weights for policy 0, policy_version 51213 (0.0009) [2023-02-25 14:25:53,901][36142] DAMAGECOUNT value on done: 1029850.0 [2023-02-25 14:25:53,902][36142] Sum rewards: 65.511, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.962', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.132', 'AMMO4': '0.164', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.406', 'weapon2': '0.438', 'WEAPON3': '1.150', 'weapon3': '2.842', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '54.000'} [2023-02-25 14:25:54,468][36142] DAMAGECOUNT value on done: 1041927.0 [2023-02-25 14:25:54,469][36142] Sum rewards: 56.005, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.218', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon4': '0.180', 'AMMO3': '0.199', 'weapon5': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.630', 'WEAPON3': '1.150', 'weapon3': '2.664', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.321', 'FRAGCOUNT': '48.000'} [2023-02-25 14:25:54,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 209780736. Throughput: 0: 3349.3. Samples: 14936062. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:25:54,730][36114] Avg episode reward: [(0, '55.224')] [2023-02-25 14:25:54,772][36142] DAMAGECOUNT value on done: 1052929.0 [2023-02-25 14:25:54,773][36142] Sum rewards: 55.450, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.683', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.043', 'AMMO3': '0.119', 'weapon5': '0.198', 'AMMO4': '0.215', 'weapon2': '0.324', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon4': '0.798', 'WEAPON3': '0.800', 'weapon3': '2.228', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.027', 'FRAGCOUNT': '45.000'} [2023-02-25 14:25:56,089][36156] DAMAGECOUNT value on done: 1055933.0 [2023-02-25 14:25:56,089][36156] Sum rewards: 51.859, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.157', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.059', 'AMMO3': '0.122', 'weapon2': '0.226', 'AMMO4': '0.293', 'weapon5': '0.320', 'WEAPON5': '0.700', 'WEAPON3': '0.700', 'WEAPON4': '0.800', 'weapon4': '1.062', 'weapon3': '2.058', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.538', 'FRAGCOUNT': '44.000'} [2023-02-25 14:25:56,101][36156] DAMAGECOUNT value on done: 1051395.0 [2023-02-25 14:25:56,101][36156] Sum rewards: 59.782, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.170', 'AMMO5': '0.017', 'AMMO2': '0.050', 'AMMO3': '0.198', 'AMMO4': '0.250', 'weapon5': '0.254', 'weapon2': '0.294', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.478', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '16.140', 'FRAGCOUNT': '53.000'} [2023-02-25 14:25:56,412][36156] DAMAGECOUNT value on done: 1038343.0 [2023-02-25 14:25:56,413][36156] Sum rewards: 56.765, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.024', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.136', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.348', 'weapon4': '0.366', 'WEAPON3': '1.250', 'weapon3': '2.952', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.928', 'FRAGCOUNT': '50.000'} [2023-02-25 14:25:56,426][36156] DAMAGECOUNT value on done: 1038462.0 [2023-02-25 14:25:56,426][36156] Sum rewards: 55.363, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.422', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.090', 'AMMO4': '0.144', 'AMMO3': '0.147', 'WEAPON5': '0.150', 'weapon2': '0.222', 'WEAPON4': '0.350', 'ARMOR': '0.404', 'weapon4': '0.742', 'WEAPON3': '0.950', 'weapon3': '2.422', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.130', 'FRAGCOUNT': '46.000'} [2023-02-25 14:25:56,781][36138] Updated weights for policy 0, policy_version 51223 (0.0009) [2023-02-25 14:25:59,114][36156] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:25:59,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13426.6). Total num frames: 209846272. Throughput: 0: 3350.2. Samples: 14956238. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:25:59,730][36114] Avg episode reward: [(0, '55.133')] [2023-02-25 14:25:59,848][36138] Updated weights for policy 0, policy_version 51233 (0.0009) [2023-02-25 14:26:02,884][36138] Updated weights for policy 0, policy_version 51243 (0.0010) [2023-02-25 14:26:03,683][36140] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:26:04,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13426.6). Total num frames: 209911808. Throughput: 0: 3347.7. Samples: 14976302. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:26:04,729][36114] Avg episode reward: [(0, '55.133')] [2023-02-25 14:26:05,971][36138] Updated weights for policy 0, policy_version 51253 (0.0009) [2023-02-25 14:26:07,139][36154] DAMAGECOUNT value on done: 1053070.0 [2023-02-25 14:26:07,139][36154] Sum rewards: 56.487, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.391', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.082', 'weapon5': '0.096', 'AMMO3': '0.197', 'AMMO4': '0.222', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.486', 'WEAPON3': '1.250', 'HITCOUNT': '3.050', 'weapon3': '3.128', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '51.000'} [2023-02-25 14:26:07,444][36154] DAMAGECOUNT value on done: 1051536.0 [2023-02-25 14:26:07,444][36154] Sum rewards: 42.907, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.910', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.058', 'AMMO3': '0.147', 'AMMO4': '0.290', 'weapon5': '0.336', 'weapon2': '0.556', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'weapon4': '0.708', 'WEAPON3': '0.900', 'weapon3': '2.016', 'HITCOUNT': '2.310', 'DAMAGECOUNT': '12.420', 'FRAGCOUNT': '38.000'} [2023-02-25 14:26:07,455][36154] DAMAGECOUNT value on done: 1040268.0 [2023-02-25 14:26:07,455][36154] Sum rewards: 65.886, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.080', 'AMMO5': '0.014', 'AMMO2': '0.045', 'AMMO3': '0.165', 'weapon5': '0.184', 'AMMO4': '0.227', 'weapon4': '0.352', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.594', 'WEAPON3': '0.950', 'weapon3': '2.598', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '54.000'} [2023-02-25 14:26:07,651][36141] DAMAGECOUNT value on done: 1052044.0 [2023-02-25 14:26:07,652][36141] Sum rewards: 61.378, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.900', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.104', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.282', 'weapon2': '0.780', 'WEAPON3': '1.350', 'weapon3': '2.592', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '55.000'} [2023-02-25 14:26:07,768][36154] DAMAGECOUNT value on done: 1047494.0 [2023-02-25 14:26:07,769][36154] Sum rewards: 59.494, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.952', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.138', 'AMMO4': '0.141', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON4': '0.350', 'weapon4': '0.374', 'ARMOR': '0.460', 'WEAPON3': '1.350', 'weapon3': '2.924', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '51.500'} [2023-02-25 14:26:07,910][36141] DAMAGECOUNT value on done: 1041493.0 [2023-02-25 14:26:07,910][36141] Sum rewards: 58.281, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.910', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.070', 'AMMO4': '0.152', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.256', 'weapon2': '0.724', 'WEAPON3': '0.950', 'weapon3': '2.686', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.496', 'FRAGCOUNT': '49.000'} [2023-02-25 14:26:07,977][36141] DAMAGECOUNT value on done: 1052824.0 [2023-02-25 14:26:07,978][36141] Sum rewards: 73.465, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.570', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.100', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.346', 'weapon2': '0.506', 'WEAPON3': '0.900', 'weapon3': '2.838', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '60.000'} [2023-02-25 14:26:08,232][36141] DAMAGECOUNT value on done: 1037443.0 [2023-02-25 14:26:08,232][36141] Sum rewards: 67.056, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.595', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.003', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.199', 'weapon2': '0.302', 'WEAPON3': '1.200', 'HITCOUNT': '3.370', 'weapon3': '3.472', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '57.500'} [2023-02-25 14:26:08,442][36157] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:26:09,013][36138] Updated weights for policy 0, policy_version 51263 (0.0010) [2023-02-25 14:26:09,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 209981440. Throughput: 0: 3349.4. Samples: 14986368. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:26:09,730][36114] Avg episode reward: [(0, '55.983')] [2023-02-25 14:26:10,222][36156] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('ARMOR', -0.001, -1.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:26:10,383][36155] DAMAGECOUNT value on done: 1039051.0 [2023-02-25 14:26:10,384][36155] Sum rewards: 73.244, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.451', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.122', 'AMMO4': '0.134', 'weapon4': '0.144', 'weapon2': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.273', 'WEAPON3': '1.650', 'weapon3': '3.234', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.195', 'FRAGCOUNT': '66.000'} [2023-02-25 14:26:10,450][36157] DAMAGECOUNT value on done: 1058714.0 [2023-02-25 14:26:10,451][36157] Sum rewards: 54.042, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.409', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.144', 'AMMO3': '0.154', 'AMMO4': '0.178', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.430', 'weapon4': '0.714', 'WEAPON3': '1.000', 'weapon3': '2.270', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.494', 'FRAGCOUNT': '45.000'} [2023-02-25 14:26:10,687][36155] DAMAGECOUNT value on done: 1048286.0 [2023-02-25 14:26:10,687][36155] Sum rewards: 59.459, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.714', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.104', 'AMMO4': '0.187', 'weapon2': '0.190', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.462', 'WEAPON3': '1.150', 'HITCOUNT': '2.890', 'weapon3': '2.992', 'DAMAGECOUNT': '13.989', 'FRAGCOUNT': '51.000'} [2023-02-25 14:26:10,764][36157] DAMAGECOUNT value on done: 1046758.0 [2023-02-25 14:26:10,765][36157] Sum rewards: 52.160, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.990', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.106', 'AMMO4': '0.132', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.392', 'weapon4': '0.618', 'WEAPON3': '1.100', 'HITCOUNT': '2.650', 'weapon3': '2.652', 'DAMAGECOUNT': '13.275', 'FRAGCOUNT': '45.000'} [2023-02-25 14:26:11,377][36157] DAMAGECOUNT value on done: 1056977.0 [2023-02-25 14:26:11,377][36157] Sum rewards: 55.679, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.375', 'AMMO5': '0.013', 'AMMO2': '0.053', 'AMMO3': '0.135', 'weapon5': '0.220', 'AMMO4': '0.264', 'WEAPON5': '0.400', 'weapon2': '0.558', 'WEAPON4': '0.600', 'weapon4': '0.726', 'WEAPON3': '0.800', 'weapon3': '2.264', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.451', 'FRAGCOUNT': '46.500'} [2023-02-25 14:26:11,687][36157] DAMAGECOUNT value on done: 1051495.0 [2023-02-25 14:26:11,688][36157] Sum rewards: 53.630, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.150', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon5': '0.132', 'AMMO3': '0.194', 'AMMO4': '0.204', 'weapon2': '0.248', 'weapon4': '0.346', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.910', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.814', 'FRAGCOUNT': '46.000'} [2023-02-25 14:26:11,776][36140] DAMAGECOUNT value on done: 1048904.0 [2023-02-25 14:26:11,777][36140] Sum rewards: 53.344, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.143', 'AMMO5': '0.021', 'AMMO2': '0.071', 'AMMO3': '0.171', 'weapon5': '0.252', 'weapon2': '0.270', 'AMMO4': '0.353', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'weapon4': '0.830', 'WEAPON3': '1.050', 'weapon3': '2.286', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.453', 'FRAGCOUNT': '46.000'} [2023-02-25 14:26:11,802][36155] DAMAGECOUNT value on done: 1061014.0 [2023-02-25 14:26:11,803][36155] Sum rewards: 65.698, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.734', 'AMMO2': '0.009', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'weapon4': '0.160', 'AMMO3': '0.207', 'ARMOR': '0.400', 'weapon2': '0.436', 'WEAPON3': '1.300', 'weapon3': '3.296', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.192', 'FRAGCOUNT': '55.000'} [2023-02-25 14:26:12,044][36140] DAMAGECOUNT value on done: 1048936.0 [2023-02-25 14:26:12,045][36140] Sum rewards: 64.614, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.006', 'AMMO5': '0.004', 'weapon4': '0.016', 'AMMO2': '0.022', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.152', 'weapon2': '0.460', 'WEAPON3': '0.900', 'HITCOUNT': '3.210', 'weapon3': '3.314', 'DAMAGECOUNT': '14.697', 'FRAGCOUNT': '52.000'} [2023-02-25 14:26:12,058][36138] Updated weights for policy 0, policy_version 51273 (0.0009) [2023-02-25 14:26:12,092][36140] DAMAGECOUNT value on done: 1037159.0 [2023-02-25 14:26:12,092][36140] Sum rewards: 56.420, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.766', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.139', 'weapon5': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.320', 'WEAPON4': '0.350', 'weapon2': '0.490', 'WEAPON3': '0.950', 'weapon3': '2.778', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.501', 'FRAGCOUNT': '45.000'} [2023-02-25 14:26:12,099][36155] DAMAGECOUNT value on done: 1044276.0 [2023-02-25 14:26:12,100][36155] Sum rewards: 63.733, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.004', 'AMMO5': '0.015', 'AMMO2': '0.054', 'AMMO3': '0.238', 'weapon5': '0.262', 'AMMO4': '0.269', 'weapon4': '0.280', 'weapon2': '0.318', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.774', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '56.000'} [2023-02-25 14:26:12,371][36140] DAMAGECOUNT value on done: 1040449.0 [2023-02-25 14:26:12,371][36140] Sum rewards: 62.567, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.860', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.185', 'weapon2': '0.260', 'WEAPON3': '1.200', 'HITCOUNT': '3.130', 'weapon3': '3.536', 'DAMAGECOUNT': '14.625', 'FRAGCOUNT': '53.000'} [2023-02-25 14:26:12,477][36139] DAMAGECOUNT value on done: 1046676.0 [2023-02-25 14:26:12,477][36139] Sum rewards: 75.116, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.752', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.056', 'AMMO4': '0.070', 'weapon5': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'weapon2': '0.752', 'WEAPON3': '1.050', 'weapon3': '2.770', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '60.000'} [2023-02-25 14:26:12,773][36139] DAMAGECOUNT value on done: 1046774.0 [2023-02-25 14:26:12,774][36139] Sum rewards: 77.235, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.095', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.172', 'weapon2': '0.260', 'weapon4': '0.326', 'ARMOR': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.212', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.054', 'FRAGCOUNT': '62.000'} [2023-02-25 14:26:13,004][36139] DAMAGECOUNT value on done: 1062113.0 [2023-02-25 14:26:13,005][36139] Sum rewards: 58.843, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.085', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.100', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.222', 'WEAPON4': '0.300', 'weapon4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.836', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.496', 'FRAGCOUNT': '51.000'} [2023-02-25 14:26:13,310][36139] DAMAGECOUNT value on done: 1049243.0 [2023-02-25 14:26:13,311][36139] Sum rewards: 57.015, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.035', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.148', 'weapon2': '0.214', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.338', 'WEAPON3': '1.350', 'weapon3': '3.016', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.066', 'FRAGCOUNT': '49.000'} [2023-02-25 14:26:13,334][36156] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:26:13,638][36142] DAMAGECOUNT value on done: 1051385.0 [2023-02-25 14:26:13,639][36142] Sum rewards: 61.054, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.360', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.099', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon2': '0.232', 'weapon4': '0.378', 'WEAPON3': '1.300', 'weapon3': '3.066', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '53.000'} [2023-02-25 14:26:13,951][36142] DAMAGECOUNT value on done: 1034929.0 [2023-02-25 14:26:13,951][36142] Sum rewards: 60.123, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.912', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.148', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.189', 'WEAPON4': '0.350', 'weapon2': '0.372', 'ARMOR': '0.464', 'weapon4': '0.496', 'WEAPON3': '1.150', 'weapon3': '2.672', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.237', 'FRAGCOUNT': '51.000'} [2023-02-25 14:26:14,485][36142] DAMAGECOUNT value on done: 1046613.0 [2023-02-25 14:26:14,485][36142] Sum rewards: 52.888, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.642', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.086', 'AMMO3': '0.151', 'AMMO4': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.420', 'weapon2': '0.596', 'WEAPON3': '0.950', 'weapon3': '2.684', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.058', 'FRAGCOUNT': '43.000'} [2023-02-25 14:26:14,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.2, 300 sec: 13426.6). Total num frames: 210046976. Throughput: 0: 3352.4. Samples: 15006530. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:26:14,730][36114] Avg episode reward: [(0, '57.118')] [2023-02-25 14:26:14,785][36142] DAMAGECOUNT value on done: 1058107.0 [2023-02-25 14:26:14,786][36142] Sum rewards: 62.597, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.460', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.038', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.160', 'AMMO3': '0.169', 'weapon2': '0.544', 'WEAPON3': '1.150', 'weapon3': '3.158', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.534', 'FRAGCOUNT': '51.000'} [2023-02-25 14:26:15,101][36138] Updated weights for policy 0, policy_version 51283 (0.0009) [2023-02-25 14:26:16,245][36156] DAMAGECOUNT value on done: 1061300.0 [2023-02-25 14:26:16,246][36156] Sum rewards: 61.912, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.660', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon4': '0.030', 'weapon5': '0.054', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon2': '0.596', 'WEAPON3': '1.150', 'weapon3': '3.166', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.101', 'FRAGCOUNT': '50.500'} [2023-02-25 14:26:16,257][36156] DAMAGECOUNT value on done: 1056631.0 [2023-02-25 14:26:16,257][36156] Sum rewards: 61.700, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.035', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.174', 'AMMO3': '0.187', 'AMMO4': '0.237', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.410', 'weapon2': '0.464', 'WEAPON3': '1.150', 'weapon3': '2.286', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.708', 'FRAGCOUNT': '53.000'} [2023-02-25 14:26:16,569][36156] DAMAGECOUNT value on done: 1043450.0 [2023-02-25 14:26:16,570][36156] Sum rewards: 61.380, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.380', 'AMMO5': '0.010', 'AMMO2': '0.064', 'weapon5': '0.148', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'AMMO4': '0.319', 'WEAPON4': '0.350', 'weapon2': '0.548', 'weapon4': '0.592', 'WEAPON3': '1.100', 'weapon3': '2.456', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.321', 'FRAGCOUNT': '52.500'} [2023-02-25 14:26:16,590][36156] DAMAGECOUNT value on done: 1042360.0 [2023-02-25 14:26:16,591][36156] Sum rewards: 44.605, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.380', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.186', 'weapon5': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.306', 'WEAPON4': '0.350', 'weapon4': '0.680', 'WEAPON3': '1.050', 'weapon3': '2.386', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '11.694', 'FRAGCOUNT': '39.000'} [2023-02-25 14:26:17,801][36141] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:26:18,136][36138] Updated weights for policy 0, policy_version 51293 (0.0009) [2023-02-25 14:26:19,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13440.4). Total num frames: 210116608. Throughput: 0: 3356.2. Samples: 15026832. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:26:19,730][36114] Avg episode reward: [(0, '57.261')] [2023-02-25 14:26:21,181][36138] Updated weights for policy 0, policy_version 51303 (0.0009) [2023-02-25 14:26:24,192][36138] Updated weights for policy 0, policy_version 51313 (0.0010) [2023-02-25 14:26:24,729][36114] Fps is (10 sec: 13516.5, 60 sec: 13380.2, 300 sec: 13440.4). Total num frames: 210182144. Throughput: 0: 3356.7. Samples: 15036930. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:26:24,730][36114] Avg episode reward: [(0, '57.261')] [2023-02-25 14:26:27,068][36154] DAMAGECOUNT value on done: 1058737.0 [2023-02-25 14:26:27,068][36154] Sum rewards: 61.383, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.522', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.157', 'AMMO4': '0.188', 'weapon5': '0.244', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.604', 'WEAPON3': '1.100', 'weapon3': '2.604', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '50.000'} [2023-02-25 14:26:27,240][36138] Updated weights for policy 0, policy_version 51323 (0.0009) [2023-02-25 14:26:27,384][36154] DAMAGECOUNT value on done: 1056616.0 [2023-02-25 14:26:27,384][36154] Sum rewards: 57.428, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.541', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.168', 'weapon5': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.332', 'weapon4': '0.398', 'WEAPON3': '1.100', 'weapon3': '2.786', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.240', 'FRAGCOUNT': '48.000'} [2023-02-25 14:26:27,393][36154] DAMAGECOUNT value on done: 1045201.0 [2023-02-25 14:26:27,394][36154] Sum rewards: 57.234, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.220', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.098', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'weapon2': '0.422', 'weapon4': '0.628', 'WEAPON3': '1.150', 'weapon3': '2.644', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.787', 'FRAGCOUNT': '49.000'} [2023-02-25 14:26:27,599][36141] DAMAGECOUNT value on done: 1057897.0 [2023-02-25 14:26:27,600][36141] Sum rewards: 63.228, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.849', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.042', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.182', 'AMMO3': '0.209', 'weapon2': '0.562', 'WEAPON3': '1.300', 'weapon3': '2.940', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.529', 'FRAGCOUNT': '52.000'} [2023-02-25 14:26:27,692][36154] DAMAGECOUNT value on done: 1052886.0 [2023-02-25 14:26:27,693][36154] Sum rewards: 62.005, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.870', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO3': '0.182', 'AMMO4': '0.184', 'weapon5': '0.222', 'weapon2': '0.248', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.628', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.807', 'FRAGCOUNT': '53.000'} [2023-02-25 14:26:27,905][36141] DAMAGECOUNT value on done: 1046560.0 [2023-02-25 14:26:27,905][36141] Sum rewards: 57.257, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.012', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.168', 'weapon2': '0.192', 'AMMO3': '0.212', 'weapon5': '0.218', 'AMMO4': '0.250', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.940', 'weapon3': '3.120', 'DAMAGECOUNT': '15.201', 'FRAGCOUNT': '52.000'} [2023-02-25 14:26:27,932][36141] DAMAGECOUNT value on done: 1058347.0 [2023-02-25 14:26:27,933][36141] Sum rewards: 62.942, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.739', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon5': '0.168', 'AMMO4': '0.191', 'AMMO3': '0.225', 'weapon2': '0.276', 'WEAPON5': '0.400', 'weapon4': '0.440', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.808', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.536', 'FRAGCOUNT': '57.000'} [2023-02-25 14:26:28,219][36141] DAMAGECOUNT value on done: 1042876.0 [2023-02-25 14:26:28,219][36141] Sum rewards: 61.970, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.390', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.042', 'AMMO3': '0.186', 'AMMO4': '0.208', 'weapon5': '0.258', 'weapon2': '0.402', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.608', 'WEAPON3': '1.100', 'weapon3': '2.464', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '53.000'} [2023-02-25 14:26:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13440.4). Total num frames: 210251776. Throughput: 0: 3357.8. Samples: 15057058. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:26:29,729][36114] Avg episode reward: [(0, '57.500')] [2023-02-25 14:26:30,180][36155] DAMAGECOUNT value on done: 1044266.0 [2023-02-25 14:26:30,181][36155] Sum rewards: 56.784, reward structure: {'DEATHCOUNT': '-16.500', 'AMMO5': '0.005', 'ARMOR': '0.008', 'HEALTH': '0.040', 'AMMO2': '0.041', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.167', 'AMMO4': '0.206', 'weapon2': '0.280', 'WEAPON4': '0.550', 'weapon4': '0.822', 'WEAPON3': '0.900', 'weapon3': '2.498', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.645', 'FRAGCOUNT': '48.500'} [2023-02-25 14:26:30,287][36138] Updated weights for policy 0, policy_version 51333 (0.0009) [2023-02-25 14:26:30,405][36157] DAMAGECOUNT value on done: 1064273.0 [2023-02-25 14:26:30,405][36157] Sum rewards: 65.245, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.050', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.102', 'AMMO4': '0.154', 'weapon5': '0.172', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.250', 'weapon3': '3.108', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '56.000'} [2023-02-25 14:26:30,486][36155] DAMAGECOUNT value on done: 1052288.0 [2023-02-25 14:26:30,486][36155] Sum rewards: 41.421, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.100', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.072', 'AMMO4': '0.142', 'AMMO3': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.322', 'WEAPON4': '0.350', 'ARMOR': '0.497', 'weapon2': '0.628', 'WEAPON3': '1.550', 'HITCOUNT': '2.510', 'weapon3': '2.656', 'DAMAGECOUNT': '12.006', 'FRAGCOUNT': '40.000'} [2023-02-25 14:26:30,721][36157] DAMAGECOUNT value on done: 1051599.0 [2023-02-25 14:26:30,721][36157] Sum rewards: 60.431, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.018', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO4': '0.181', 'weapon5': '0.188', 'AMMO3': '0.192', 'weapon4': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.442', 'WEAPON3': '1.250', 'weapon3': '2.966', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.373', 'FRAGCOUNT': '52.000'} [2023-02-25 14:26:31,337][36157] DAMAGECOUNT value on done: 1062373.0 [2023-02-25 14:26:31,337][36157] Sum rewards: 59.563, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.672', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO3': '0.155', 'weapon5': '0.156', 'AMMO4': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.448', 'weapon2': '0.572', 'WEAPON3': '1.000', 'weapon3': '2.596', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.188', 'FRAGCOUNT': '49.000'} [2023-02-25 14:26:31,613][36155] DAMAGECOUNT value on done: 1067041.0 [2023-02-25 14:26:31,613][36155] Sum rewards: 70.824, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.467', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon4': '0.216', 'weapon2': '0.410', 'WEAPON3': '1.400', 'weapon3': '3.014', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '60.000'} [2023-02-25 14:26:31,642][36157] DAMAGECOUNT value on done: 1057434.0 [2023-02-25 14:26:31,642][36157] Sum rewards: 71.736, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.768', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon5': '0.144', 'AMMO3': '0.248', 'weapon4': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.550', 'weapon3': '2.944', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '64.000'} [2023-02-25 14:26:31,742][36140] DAMAGECOUNT value on done: 1054459.0 [2023-02-25 14:26:31,742][36140] Sum rewards: 62.430, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.902', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.040', 'AMMO4': '0.198', 'AMMO3': '0.249', 'weapon5': '0.268', 'weapon4': '0.368', 'weapon2': '0.386', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.554', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '55.000'} [2023-02-25 14:26:31,922][36155] DAMAGECOUNT value on done: 1049295.0 [2023-02-25 14:26:31,922][36155] Sum rewards: 60.511, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.894', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.004', 'AMMO4': '0.021', 'weapon5': '0.048', 'weapon4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.178', 'weapon2': '0.746', 'WEAPON3': '1.150', 'weapon3': '2.984', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.877', 'FRAGCOUNT': '51.000'} [2023-02-25 14:26:32,006][36140] DAMAGECOUNT value on done: 1053608.0 [2023-02-25 14:26:32,007][36140] Sum rewards: 48.595, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.882', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.082', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'weapon4': '0.422', 'weapon2': '0.534', 'WEAPON3': '1.050', 'weapon3': '2.774', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.016', 'FRAGCOUNT': '39.500'} [2023-02-25 14:26:32,052][36140] DAMAGECOUNT value on done: 1042259.0 [2023-02-25 14:26:32,053][36140] Sum rewards: 54.473, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.505', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.148', 'AMMO3': '0.179', 'AMMO4': '0.227', 'WEAPON5': '0.250', 'weapon2': '0.370', 'WEAPON4': '0.400', 'weapon4': '0.648', 'WEAPON3': '1.150', 'weapon3': '2.610', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '46.000'} [2023-02-25 14:26:32,346][36140] DAMAGECOUNT value on done: 1045225.0 [2023-02-25 14:26:32,346][36140] Sum rewards: 53.731, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.185', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.055', 'AMMO3': '0.126', 'weapon5': '0.192', 'AMMO4': '0.274', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.546', 'WEAPON3': '0.750', 'weapon2': '0.844', 'weapon3': '2.184', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.328', 'FRAGCOUNT': '43.000'} [2023-02-25 14:26:32,370][36139] DAMAGECOUNT value on done: 1052724.0 [2023-02-25 14:26:32,371][36139] Sum rewards: 65.291, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.100', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.056', 'weapon5': '0.108', 'AMMO4': '0.141', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.510', 'WEAPON3': '1.250', 'weapon3': '3.066', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '53.500'} [2023-02-25 14:26:32,664][36139] DAMAGECOUNT value on done: 1051280.0 [2023-02-25 14:26:32,665][36139] Sum rewards: 53.950, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.265', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'weapon4': '0.198', 'weapon2': '0.698', 'WEAPON3': '1.100', 'weapon3': '2.870', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.518', 'FRAGCOUNT': '47.000'} [2023-02-25 14:26:32,911][36139] DAMAGECOUNT value on done: 1066784.0 [2023-02-25 14:26:32,912][36139] Sum rewards: 59.466, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.584', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.086', 'AMMO4': '0.115', 'AMMO3': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon2': '0.608', 'WEAPON3': '0.750', 'weapon4': '0.752', 'weapon3': '2.088', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.968', 'FRAGCOUNT': '50.000'} [2023-02-25 14:26:33,214][36139] DAMAGECOUNT value on done: 1054023.0 [2023-02-25 14:26:33,214][36139] Sum rewards: 58.791, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.370', 'AMMO5': '0.006', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon5': '0.102', 'weapon4': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.220', 'AMMO3': '0.246', 'WEAPON3': '1.450', 'HITCOUNT': '2.850', 'weapon3': '3.288', 'DAMAGECOUNT': '14.340', 'FRAGCOUNT': '53.000'} [2023-02-25 14:26:33,329][36138] Updated weights for policy 0, policy_version 51343 (0.0009) [2023-02-25 14:26:33,652][36142] DAMAGECOUNT value on done: 1055810.0 [2023-02-25 14:26:33,652][36142] Sum rewards: 54.141, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.321', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.018', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.165', 'weapon2': '0.392', 'WEAPON3': '1.150', 'HITCOUNT': '2.670', 'weapon3': '3.412', 'DAMAGECOUNT': '13.275', 'FRAGCOUNT': '45.000'} [2023-02-25 14:26:33,956][36142] DAMAGECOUNT value on done: 1040369.0 [2023-02-25 14:26:33,956][36142] Sum rewards: 62.429, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.216', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.194', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.328', 'weapon4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.660', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '54.000'} [2023-02-25 14:26:34,449][36142] DAMAGECOUNT value on done: 1051368.0 [2023-02-25 14:26:34,450][36142] Sum rewards: 51.839, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.523', 'AMMO5': '0.009', 'AMMO2': '0.025', 'AMMO4': '0.126', 'AMMO3': '0.179', 'weapon5': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.358', 'weapon2': '0.420', 'WEAPON3': '1.150', 'weapon3': '2.834', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.265', 'FRAGCOUNT': '44.000'} [2023-02-25 14:26:34,729][36114] Fps is (10 sec: 13517.1, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 210317312. Throughput: 0: 3361.0. Samples: 15077328. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:26:34,730][36114] Avg episode reward: [(0, '58.293')] [2023-02-25 14:26:34,760][36142] DAMAGECOUNT value on done: 1062727.0 [2023-02-25 14:26:34,760][36142] Sum rewards: 51.348, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.670', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.161', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'weapon2': '0.694', 'weapon4': '0.734', 'WEAPON3': '1.200', 'weapon3': '2.200', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.860', 'FRAGCOUNT': '46.000'} [2023-02-25 14:26:36,205][36156] DAMAGECOUNT value on done: 1065854.0 [2023-02-25 14:26:36,205][36156] Sum rewards: 53.141, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.050', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.104', 'AMMO4': '0.175', 'AMMO3': '0.234', 'WEAPON5': '0.350', 'weapon2': '0.382', 'WEAPON4': '0.400', 'weapon4': '0.782', 'WEAPON3': '1.300', 'weapon3': '2.400', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.662', 'FRAGCOUNT': '48.000'} [2023-02-25 14:26:36,217][36156] DAMAGECOUNT value on done: 1061552.0 [2023-02-25 14:26:36,218][36156] Sum rewards: 60.778, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.748', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.100', 'weapon4': '0.110', 'AMMO4': '0.136', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.248', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.020', 'weapon3': '3.294', 'DAMAGECOUNT': '14.763', 'FRAGCOUNT': '54.000'} [2023-02-25 14:26:36,339][36138] Updated weights for policy 0, policy_version 51353 (0.0010) [2023-02-25 14:26:36,547][36156] DAMAGECOUNT value on done: 1049208.0 [2023-02-25 14:26:36,547][36156] Sum rewards: 67.754, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.937', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon5': '0.086', 'AMMO4': '0.100', 'weapon2': '0.130', 'AMMO3': '0.239', 'weapon4': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.170', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '58.000'} [2023-02-25 14:26:36,562][36156] DAMAGECOUNT value on done: 1047078.0 [2023-02-25 14:26:36,563][36156] Sum rewards: 59.423, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.990', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.114', 'AMMO4': '0.147', 'AMMO3': '0.155', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON4': '0.350', 'weapon4': '0.444', 'WEAPON3': '0.950', 'weapon3': '2.848', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.154', 'FRAGCOUNT': '50.000'} [2023-02-25 14:26:39,395][36138] Updated weights for policy 0, policy_version 51363 (0.0009) [2023-02-25 14:26:39,729][36114] Fps is (10 sec: 13516.6, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 210386944. Throughput: 0: 3361.6. Samples: 15087336. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:26:39,730][36114] Avg episode reward: [(0, '58.362')] [2023-02-25 14:26:42,454][36138] Updated weights for policy 0, policy_version 51373 (0.0009) [2023-02-25 14:26:44,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 210452480. Throughput: 0: 3363.9. Samples: 15107616. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:26:44,730][36114] Avg episode reward: [(0, '58.362')] [2023-02-25 14:26:45,531][36138] Updated weights for policy 0, policy_version 51383 (0.0009) [2023-02-25 14:26:47,039][36154] DAMAGECOUNT value on done: 1064138.0 [2023-02-25 14:26:47,040][36154] Sum rewards: 58.761, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.415', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon5': '0.056', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon4': '0.398', 'weapon2': '0.458', 'WEAPON3': '1.350', 'weapon3': '2.836', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '49.000'} [2023-02-25 14:26:47,354][36154] DAMAGECOUNT value on done: 1062301.0 [2023-02-25 14:26:47,355][36154] Sum rewards: 65.527, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.990', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.078', 'AMMO3': '0.170', 'weapon5': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.354', 'weapon2': '0.436', 'WEAPON3': '1.100', 'weapon3': '2.820', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '54.000'} [2023-02-25 14:26:47,362][36154] DAMAGECOUNT value on done: 1049665.0 [2023-02-25 14:26:47,363][36154] Sum rewards: 52.051, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.292', 'ARMOR': '0.008', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon5': '0.110', 'AMMO4': '0.116', 'AMMO3': '0.148', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.558', 'weapon4': '0.594', 'WEAPON3': '1.000', 'weapon3': '2.424', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.392', 'FRAGCOUNT': '45.000'} [2023-02-25 14:26:47,636][36141] DAMAGECOUNT value on done: 1063048.0 [2023-02-25 14:26:47,637][36141] Sum rewards: 63.307, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO3': '0.154', 'AMMO4': '0.159', 'weapon5': '0.202', 'weapon4': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.328', 'HEALTH': '0.346', 'WEAPON3': '0.850', 'weapon3': '2.976', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.453', 'FRAGCOUNT': '52.000'} [2023-02-25 14:26:47,672][36154] DAMAGECOUNT value on done: 1057980.0 [2023-02-25 14:26:47,673][36154] Sum rewards: 60.388, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.475', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.164', 'AMMO4': '0.170', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.374', 'weapon4': '0.496', 'WEAPON3': '1.150', 'weapon3': '2.716', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.282', 'FRAGCOUNT': '52.000'} [2023-02-25 14:26:47,923][36141] DAMAGECOUNT value on done: 1052442.0 [2023-02-25 14:26:47,923][36141] Sum rewards: 70.760, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.530', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.011', 'weapon5': '0.050', 'AMMO4': '0.053', 'WEAPON5': '0.100', 'weapon2': '0.166', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.534', 'WEAPON3': '1.250', 'weapon3': '3.054', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '59.000'} [2023-02-25 14:26:47,957][36141] DAMAGECOUNT value on done: 1063584.0 [2023-02-25 14:26:47,957][36141] Sum rewards: 58.723, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.439', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.062', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'weapon2': '0.182', 'WEAPON4': '0.200', 'weapon4': '0.298', 'WEAPON3': '1.100', 'HITCOUNT': '3.150', 'weapon3': '3.328', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '47.000'} [2023-02-25 14:26:48,226][36141] DAMAGECOUNT value on done: 1048607.0 [2023-02-25 14:26:48,226][36141] Sum rewards: 61.006, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.654', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.043', 'AMMO4': '0.217', 'AMMO3': '0.225', 'weapon5': '0.254', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.672', 'WEAPON3': '1.300', 'weapon3': '2.468', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '52.000'} [2023-02-25 14:26:48,584][36138] Updated weights for policy 0, policy_version 51393 (0.0009) [2023-02-25 14:26:49,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13380.2, 300 sec: 13454.3). Total num frames: 210518016. Throughput: 0: 3365.8. Samples: 15127762. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:26:49,730][36114] Avg episode reward: [(0, '58.755')] [2023-02-25 14:26:49,999][36155] DAMAGECOUNT value on done: 1049814.0 [2023-02-25 14:26:50,000][36155] Sum rewards: 63.347, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.320', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon5': '0.162', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.450', 'weapon2': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.590', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '54.000'} [2023-02-25 14:26:50,308][36155] DAMAGECOUNT value on done: 1056485.0 [2023-02-25 14:26:50,308][36155] Sum rewards: 52.103, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.419', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.092', 'AMMO4': '0.108', 'AMMO3': '0.110', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.616', 'WEAPON3': '0.700', 'weapon4': '0.868', 'weapon3': '2.290', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.591', 'FRAGCOUNT': '40.000'} [2023-02-25 14:26:50,332][36157] DAMAGECOUNT value on done: 1069125.0 [2023-02-25 14:26:50,333][36157] Sum rewards: 55.479, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.580', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.146', 'AMMO3': '0.148', 'weapon4': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.696', 'WEAPON3': '0.950', 'weapon3': '2.744', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.556', 'FRAGCOUNT': '44.000'} [2023-02-25 14:26:50,642][36157] DAMAGECOUNT value on done: 1056904.0 [2023-02-25 14:26:50,643][36157] Sum rewards: 67.461, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'HEALTH': '0.164', 'weapon4': '0.248', 'weapon2': '0.736', 'WEAPON3': '0.850', 'weapon3': '2.748', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.915', 'FRAGCOUNT': '54.000'} [2023-02-25 14:26:51,261][36157] DAMAGECOUNT value on done: 1067789.0 [2023-02-25 14:26:51,261][36157] Sum rewards: 57.602, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.592', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.174', 'AMMO3': '0.233', 'weapon5': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.368', 'weapon4': '0.456', 'WEAPON3': '1.300', 'weapon3': '2.648', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.248', 'FRAGCOUNT': '51.000'} [2023-02-25 14:26:51,442][36155] DAMAGECOUNT value on done: 1071664.0 [2023-02-25 14:26:51,443][36155] Sum rewards: 58.814, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.261', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.060', 'AMMO3': '0.108', 'weapon5': '0.156', 'WEAPON5': '0.250', 'AMMO4': '0.298', 'weapon2': '0.468', 'WEAPON4': '0.500', 'WEAPON3': '0.650', 'weapon4': '1.006', 'weapon3': '2.052', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.869', 'FRAGCOUNT': '48.000'} [2023-02-25 14:26:51,567][36157] DAMAGECOUNT value on done: 1062930.0 [2023-02-25 14:26:51,568][36157] Sum rewards: 66.694, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.585', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.140', 'AMMO4': '0.142', 'AMMO3': '0.158', 'WEAPON4': '0.250', 'weapon4': '0.300', 'weapon2': '0.324', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.016', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '55.000'} [2023-02-25 14:26:51,660][36138] Updated weights for policy 0, policy_version 51403 (0.0009) [2023-02-25 14:26:51,756][36155] DAMAGECOUNT value on done: 1054693.0 [2023-02-25 14:26:51,756][36155] Sum rewards: 62.989, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.190', 'ARMOR': '0.004', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon5': '0.108', 'AMMO4': '0.125', 'AMMO3': '0.193', 'WEAPON5': '0.250', 'weapon4': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.444', 'WEAPON3': '1.200', 'weapon3': '2.968', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.194', 'FRAGCOUNT': '54.000'} [2023-02-25 14:26:51,835][36140] DAMAGECOUNT value on done: 1059918.0 [2023-02-25 14:26:51,835][36140] Sum rewards: 71.674, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.780', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.047', 'AMMO3': '0.155', 'weapon5': '0.156', 'weapon2': '0.236', 'AMMO4': '0.237', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.840', 'WEAPON3': '1.050', 'weapon3': '2.460', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '62.000'} [2023-02-25 14:26:52,111][36140] DAMAGECOUNT value on done: 1058870.0 [2023-02-25 14:26:52,111][36140] Sum rewards: 60.422, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.580', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'weapon4': '0.098', 'WEAPON4': '0.100', 'weapon2': '0.270', 'AMMO3': '0.317', 'WEAPON3': '1.900', 'HITCOUNT': '3.280', 'weapon3': '3.384', 'DAMAGECOUNT': '15.786', 'FRAGCOUNT': '56.000'} [2023-02-25 14:26:52,139][36140] DAMAGECOUNT value on done: 1047537.0 [2023-02-25 14:26:52,139][36140] Sum rewards: 63.130, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.850', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.260', 'weapon2': '0.270', 'weapon4': '0.296', 'WEAPON3': '1.550', 'weapon3': '3.196', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.834', 'FRAGCOUNT': '55.000'} [2023-02-25 14:26:52,346][36139] DAMAGECOUNT value on done: 1057584.0 [2023-02-25 14:26:52,346][36139] Sum rewards: 56.599, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.372', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'weapon2': '0.174', 'AMMO3': '0.206', 'weapon4': '0.588', 'WEAPON3': '1.350', 'weapon3': '2.936', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '49.000'} [2023-02-25 14:26:52,429][36140] DAMAGECOUNT value on done: 1051470.0 [2023-02-25 14:26:52,429][36140] Sum rewards: 75.166, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.590', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.030', 'weapon5': '0.046', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.476', 'WEAPON3': '1.300', 'weapon3': '3.258', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '62.000'} [2023-02-25 14:26:52,660][36139] DAMAGECOUNT value on done: 1055977.0 [2023-02-25 14:26:52,661][36139] Sum rewards: 49.881, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.670', 'AMMO5': '0.017', 'AMMO2': '0.055', 'AMMO3': '0.140', 'weapon5': '0.144', 'AMMO4': '0.277', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.662', 'WEAPON3': '0.850', 'weapon4': '0.852', 'weapon3': '1.922', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.091', 'FRAGCOUNT': '41.000'} [2023-02-25 14:26:52,926][36139] DAMAGECOUNT value on done: 1071534.0 [2023-02-25 14:26:52,927][36139] Sum rewards: 54.085, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.500', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.098', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'weapon4': '0.238', 'weapon2': '0.448', 'WEAPON3': '1.100', 'HITCOUNT': '3.030', 'weapon3': '3.032', 'DAMAGECOUNT': '14.250', 'FRAGCOUNT': '44.000'} [2023-02-25 14:26:53,244][36139] DAMAGECOUNT value on done: 1058910.0 [2023-02-25 14:26:53,245][36139] Sum rewards: 54.032, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.835', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon5': '0.202', 'AMMO3': '0.247', 'weapon4': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.490', 'WEAPON3': '1.500', 'weapon3': '2.746', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.661', 'FRAGCOUNT': '47.000'} [2023-02-25 14:26:53,643][36142] DAMAGECOUNT value on done: 1060297.0 [2023-02-25 14:26:53,644][36142] Sum rewards: 54.119, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.480', 'AMMO5': '0.010', 'AMMO2': '0.048', 'AMMO3': '0.142', 'weapon2': '0.194', 'weapon5': '0.208', 'AMMO4': '0.241', 'WEAPON5': '0.350', 'weapon4': '0.586', 'WEAPON4': '0.600', 'WEAPON3': '0.900', 'weapon3': '2.778', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.461', 'FRAGCOUNT': '47.000'} [2023-02-25 14:26:53,972][36142] DAMAGECOUNT value on done: 1045689.0 [2023-02-25 14:26:53,972][36142] Sum rewards: 62.019, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.540', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.032', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.146', 'AMMO3': '0.213', 'WEAPON3': '1.450', 'HITCOUNT': '3.310', 'weapon3': '3.672', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '54.000'} [2023-02-25 14:26:54,430][36142] DAMAGECOUNT value on done: 1056283.0 [2023-02-25 14:26:54,431][36142] Sum rewards: 58.334, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.904', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon4': '0.120', 'AMMO3': '0.130', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.438', 'WEAPON3': '0.850', 'HITCOUNT': '2.890', 'weapon3': '3.060', 'DAMAGECOUNT': '14.745', 'FRAGCOUNT': '46.000'} [2023-02-25 14:26:54,705][36138] Updated weights for policy 0, policy_version 51413 (0.0010) [2023-02-25 14:26:54,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 210587648. Throughput: 0: 3366.3. Samples: 15137852. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:26:54,729][36114] Avg episode reward: [(0, '59.501')] [2023-02-25 14:26:54,748][36142] DAMAGECOUNT value on done: 1067994.0 [2023-02-25 14:26:54,749][36142] Sum rewards: 71.941, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.694', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.060', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'weapon4': '0.184', 'weapon2': '0.482', 'WEAPON3': '1.100', 'weapon3': '3.130', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '60.000'} [2023-02-25 14:26:56,273][36156] DAMAGECOUNT value on done: 1071607.0 [2023-02-25 14:26:56,274][36156] Sum rewards: 73.163, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.474', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.100', 'AMMO4': '0.116', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.338', 'WEAPON4': '0.350', 'weapon4': '0.446', 'WEAPON3': '1.250', 'weapon3': '2.798', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '61.000'} [2023-02-25 14:26:56,285][36156] DAMAGECOUNT value on done: 1065914.0 [2023-02-25 14:26:56,285][36156] Sum rewards: 49.117, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.880', 'AMMO5': '0.014', 'AMMO2': '0.047', 'AMMO3': '0.163', 'weapon5': '0.180', 'weapon2': '0.214', 'AMMO4': '0.234', 'WEAPON5': '0.400', 'ARMOR': '0.462', 'WEAPON4': '0.550', 'weapon4': '0.756', 'WEAPON3': '1.000', 'weapon3': '2.540', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.086', 'FRAGCOUNT': '42.000'} [2023-02-25 14:26:56,619][36156] DAMAGECOUNT value on done: 1054709.0 [2023-02-25 14:26:56,620][36156] Sum rewards: 59.795, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.212', 'AMMO5': '0.026', 'AMMO2': '0.058', 'weapon4': '0.204', 'AMMO3': '0.210', 'AMMO4': '0.292', 'weapon5': '0.330', 'weapon2': '0.454', 'WEAPON4': '0.600', 'WEAPON5': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.580', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.843', 'FRAGCOUNT': '56.000'} [2023-02-25 14:26:56,630][36156] DAMAGECOUNT value on done: 1051711.0 [2023-02-25 14:26:56,631][36156] Sum rewards: 58.461, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.370', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.152', 'AMMO3': '0.161', 'weapon5': '0.184', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.486', 'weapon4': '0.798', 'WEAPON3': '1.000', 'weapon3': '2.272', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.899', 'FRAGCOUNT': '49.000'} [2023-02-25 14:26:57,756][36138] Updated weights for policy 0, policy_version 51423 (0.0010) [2023-02-25 14:26:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 210653184. Throughput: 0: 3365.1. Samples: 15157958. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:26:59,730][36114] Avg episode reward: [(0, '59.923')] [2023-02-25 14:27:00,301][36156] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:27:00,318][36141] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:27:00,774][36138] Updated weights for policy 0, policy_version 51433 (0.0009) [2023-02-25 14:27:03,341][36154] Large shaping reward 2.538 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.516, 172.0), ('weapon5', 0.002)] [2023-02-25 14:27:03,882][36138] Updated weights for policy 0, policy_version 51443 (0.0009) [2023-02-25 14:27:04,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 210718720. Throughput: 0: 3358.3. Samples: 15177954. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:27:04,730][36114] Avg episode reward: [(0, '59.923')] [2023-02-25 14:27:06,905][36138] Updated weights for policy 0, policy_version 51453 (0.0009) [2023-02-25 14:27:07,107][36154] DAMAGECOUNT value on done: 1069862.0 [2023-02-25 14:27:07,108][36154] Sum rewards: 63.581, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.190', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.035', 'AMMO3': '0.140', 'AMMO4': '0.175', 'weapon5': '0.206', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.428', 'weapon4': '0.494', 'WEAPON3': '0.900', 'weapon3': '2.574', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '51.000'} [2023-02-25 14:27:07,427][36154] DAMAGECOUNT value on done: 1067350.0 [2023-02-25 14:27:07,427][36154] Sum rewards: 57.929, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.520', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.124', 'AMMO3': '0.149', 'weapon4': '0.158', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.510', 'WEAPON3': '0.850', 'weapon3': '2.954', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.147', 'FRAGCOUNT': '46.000'} [2023-02-25 14:27:07,436][36154] DAMAGECOUNT value on done: 1053940.0 [2023-02-25 14:27:07,437][36154] Sum rewards: 52.410, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.928', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.016', 'weapon4': '0.024', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.221', 'weapon2': '0.862', 'WEAPON3': '1.300', 'HITCOUNT': '2.920', 'weapon3': '2.932', 'DAMAGECOUNT': '12.525', 'FRAGCOUNT': '46.000'} [2023-02-25 14:27:07,642][36141] DAMAGECOUNT value on done: 1068002.0 [2023-02-25 14:27:07,642][36141] Sum rewards: 59.863, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.502', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.043', 'AMMO3': '0.155', 'weapon4': '0.206', 'weapon5': '0.210', 'AMMO4': '0.215', 'weapon2': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '3.096', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '50.000'} [2023-02-25 14:27:07,740][36154] DAMAGECOUNT value on done: 1063744.0 [2023-02-25 14:27:07,741][36154] Sum rewards: 69.028, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.102', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.172', 'AMMO4': '0.207', 'AMMO3': '0.211', 'weapon2': '0.214', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon4': '0.566', 'WEAPON3': '1.300', 'weapon3': '2.806', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '58.000'} [2023-02-25 14:27:07,940][36141] DAMAGECOUNT value on done: 1057297.0 [2023-02-25 14:27:07,941][36141] Sum rewards: 54.580, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.880', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.058', 'AMMO3': '0.155', 'weapon5': '0.290', 'AMMO4': '0.292', 'weapon2': '0.536', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'weapon4': '0.730', 'WEAPON3': '0.900', 'weapon3': '2.022', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.550', 'FRAGCOUNT': '47.000'} [2023-02-25 14:27:07,968][36141] DAMAGECOUNT value on done: 1068390.0 [2023-02-25 14:27:07,969][36141] Sum rewards: 56.218, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.930', 'AMMO5': '0.004', 'weapon4': '0.016', 'weapon5': '0.024', 'AMMO2': '0.025', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'weapon2': '0.148', 'AMMO3': '0.219', 'WEAPON3': '1.350', 'HITCOUNT': '2.960', 'weapon3': '3.660', 'DAMAGECOUNT': '14.418', 'FRAGCOUNT': '48.500'} [2023-02-25 14:27:08,258][36141] DAMAGECOUNT value on done: 1052955.0 [2023-02-25 14:27:08,258][36141] Sum rewards: 45.934, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.595', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.144', 'AMMO4': '0.165', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.352', 'weapon2': '0.424', 'WEAPON3': '1.050', 'HITCOUNT': '2.600', 'weapon3': '2.790', 'DAMAGECOUNT': '13.044', 'FRAGCOUNT': '39.000'} [2023-02-25 14:27:09,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13454.3). Total num frames: 210788352. Throughput: 0: 3356.8. Samples: 15187986. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:27:09,730][36114] Avg episode reward: [(0, '60.014')] [2023-02-25 14:27:09,954][36155] DAMAGECOUNT value on done: 1055355.0 [2023-02-25 14:27:09,955][36155] Sum rewards: 75.104, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.680', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.148', 'AMMO3': '0.174', 'weapon2': '0.560', 'WEAPON3': '1.150', 'weapon3': '3.106', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '62.000'} [2023-02-25 14:27:10,018][36138] Updated weights for policy 0, policy_version 51463 (0.0009) [2023-02-25 14:27:10,263][36155] DAMAGECOUNT value on done: 1061244.0 [2023-02-25 14:27:10,264][36155] Sum rewards: 56.101, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.920', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.136', 'WEAPON4': '0.200', 'weapon4': '0.262', 'weapon2': '0.502', 'WEAPON3': '0.850', 'HITCOUNT': '2.970', 'weapon3': '2.992', 'DAMAGECOUNT': '14.277', 'FRAGCOUNT': '45.000'} [2023-02-25 14:27:10,459][36157] DAMAGECOUNT value on done: 1073235.0 [2023-02-25 14:27:10,460][36157] Sum rewards: 50.417, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.031', 'AMMO5': '0.017', 'AMMO2': '0.054', 'AMMO3': '0.170', 'AMMO4': '0.268', 'weapon5': '0.336', 'weapon2': '0.354', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.778', 'WEAPON3': '1.000', 'weapon3': '2.100', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.330', 'FRAGCOUNT': '46.000'} [2023-02-25 14:27:10,772][36157] DAMAGECOUNT value on done: 1062016.0 [2023-02-25 14:27:10,773][36157] Sum rewards: 59.585, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.712', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon5': '0.098', 'AMMO4': '0.126', 'AMMO3': '0.181', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.488', 'WEAPON3': '1.050', 'weapon3': '2.866', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.336', 'FRAGCOUNT': '49.000'} [2023-02-25 14:27:11,389][36157] DAMAGECOUNT value on done: 1072332.0 [2023-02-25 14:27:11,390][36157] Sum rewards: 55.506, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.184', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.189', 'weapon2': '0.268', 'weapon4': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '2.880', 'weapon3': '3.038', 'DAMAGECOUNT': '13.629', 'FRAGCOUNT': '48.000'} [2023-02-25 14:27:11,420][36155] DAMAGECOUNT value on done: 1077701.0 [2023-02-25 14:27:11,420][36155] Sum rewards: 71.723, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.870', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.150', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.392', 'weapon2': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.586', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '60.000'} [2023-02-25 14:27:11,698][36157] DAMAGECOUNT value on done: 1066906.0 [2023-02-25 14:27:11,699][36157] Sum rewards: 44.009, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.147', 'AMMO5': '0.007', 'AMMO2': '0.051', 'AMMO3': '0.124', 'weapon5': '0.150', 'WEAPON5': '0.200', 'AMMO4': '0.257', 'WEAPON4': '0.300', 'weapon2': '0.398', 'WEAPON3': '0.800', 'weapon4': '0.854', 'weapon3': '2.050', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '11.904', 'FRAGCOUNT': '36.000'} [2023-02-25 14:27:11,728][36155] DAMAGECOUNT value on done: 1059038.0 [2023-02-25 14:27:11,729][36155] Sum rewards: 46.377, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.834', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon5': '0.194', 'AMMO4': '0.200', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.338', 'weapon4': '0.388', 'WEAPON3': '1.150', 'HITCOUNT': '2.500', 'weapon3': '2.796', 'DAMAGECOUNT': '13.035', 'FRAGCOUNT': '41.500'} [2023-02-25 14:27:11,891][36140] DAMAGECOUNT value on done: 1064919.0 [2023-02-25 14:27:11,891][36140] Sum rewards: 52.752, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.630', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon5': '0.114', 'AMMO4': '0.140', 'weapon2': '0.194', 'AMMO3': '0.242', 'weapon4': '0.338', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '2.824', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.003', 'FRAGCOUNT': '48.000'} [2023-02-25 14:27:12,200][36140] DAMAGECOUNT value on done: 1053264.0 [2023-02-25 14:27:12,201][36140] Sum rewards: 61.501, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.840', 'ARMOR': '0.004', 'AMMO5': '0.027', 'AMMO2': '0.054', 'AMMO3': '0.157', 'AMMO4': '0.271', 'weapon5': '0.354', 'weapon4': '0.402', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.260', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '52.000'} [2023-02-25 14:27:12,214][36140] DAMAGECOUNT value on done: 1064388.0 [2023-02-25 14:27:12,214][36140] Sum rewards: 61.856, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.056', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon4': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.242', 'weapon2': '0.566', 'WEAPON3': '1.450', 'weapon3': '3.162', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '53.000'} [2023-02-25 14:27:12,520][36140] DAMAGECOUNT value on done: 1056905.0 [2023-02-25 14:27:12,521][36140] Sum rewards: 65.130, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.050', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.060', 'AMMO4': '0.095', 'weapon5': '0.108', 'weapon2': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'WEAPON3': '1.300', 'weapon3': '3.444', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '56.000'} [2023-02-25 14:27:12,543][36139] DAMAGECOUNT value on done: 1062284.0 [2023-02-25 14:27:12,544][36139] Sum rewards: 54.272, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.542', 'AMMO5': '0.015', 'AMMO2': '0.050', 'AMMO3': '0.113', 'weapon5': '0.196', 'AMMO4': '0.249', 'weapon2': '0.390', 'ARMOR': '0.404', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '0.650', 'weapon4': '0.850', 'weapon3': '2.170', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.076', 'FRAGCOUNT': '44.000'} [2023-02-25 14:27:12,846][36139] DAMAGECOUNT value on done: 1061164.0 [2023-02-25 14:27:12,847][36139] Sum rewards: 57.820, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.270', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO4': '0.207', 'AMMO3': '0.210', 'weapon5': '0.232', 'weapon2': '0.348', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.608', 'WEAPON3': '1.250', 'weapon3': '2.508', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.561', 'FRAGCOUNT': '52.000'} [2023-02-25 14:27:13,063][36138] Updated weights for policy 0, policy_version 51473 (0.0009) [2023-02-25 14:27:13,119][36139] DAMAGECOUNT value on done: 1076329.0 [2023-02-25 14:27:13,119][36139] Sum rewards: 63.693, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.373', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.084', 'AMMO4': '0.107', 'AMMO3': '0.155', 'weapon4': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.624', 'WEAPON3': '0.900', 'weapon3': '2.918', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.385', 'FRAGCOUNT': '53.000'} [2023-02-25 14:27:13,421][36139] DAMAGECOUNT value on done: 1065151.0 [2023-02-25 14:27:13,421][36139] Sum rewards: 67.126, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.760', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.122', 'AMMO4': '0.133', 'weapon2': '0.186', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'WEAPON4': '0.350', 'weapon4': '0.568', 'WEAPON3': '1.500', 'weapon3': '2.834', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '18.723', 'FRAGCOUNT': '59.000'} [2023-02-25 14:27:13,430][36155] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:27:13,856][36142] DAMAGECOUNT value on done: 1064754.0 [2023-02-25 14:27:13,856][36142] Sum rewards: 50.533, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.290', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.086', 'AMMO3': '0.138', 'weapon5': '0.204', 'weapon2': '0.376', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'weapon4': '0.864', 'weapon3': '1.976', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.371', 'FRAGCOUNT': '42.500'} [2023-02-25 14:27:14,170][36142] DAMAGECOUNT value on done: 1050590.0 [2023-02-25 14:27:14,170][36142] Sum rewards: 52.784, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.368', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon2': '0.336', 'weapon4': '0.390', 'WEAPON3': '1.250', 'weapon3': '2.938', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.703', 'FRAGCOUNT': '45.000'} [2023-02-25 14:27:14,670][36142] DAMAGECOUNT value on done: 1061641.0 [2023-02-25 14:27:14,670][36142] Sum rewards: 59.005, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.166', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.160', 'AMMO4': '0.182', 'AMMO3': '0.227', 'weapon2': '0.250', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.470', 'WEAPON3': '1.350', 'weapon3': '2.792', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.074', 'FRAGCOUNT': '51.500'} [2023-02-25 14:27:14,729][36114] Fps is (10 sec: 13517.0, 60 sec: 13448.6, 300 sec: 13454.3). Total num frames: 210853888. Throughput: 0: 3355.5. Samples: 15208056. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:27:14,729][36114] Avg episode reward: [(0, '59.226')] [2023-02-25 14:27:14,986][36142] DAMAGECOUNT value on done: 1073407.0 [2023-02-25 14:27:14,986][36142] Sum rewards: 65.944, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.163', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.032', 'AMMO3': '0.150', 'AMMO4': '0.160', 'weapon5': '0.298', 'weapon4': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.494', 'WEAPON3': '1.000', 'weapon3': '2.602', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.236', 'FRAGCOUNT': '55.000'} [2023-02-25 14:27:16,150][36138] Updated weights for policy 0, policy_version 51483 (0.0009) [2023-02-25 14:27:16,324][36156] DAMAGECOUNT value on done: 1077094.0 [2023-02-25 14:27:16,324][36156] Sum rewards: 61.179, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.700', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon4': '0.090', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.258', 'weapon2': '0.274', 'WEAPON3': '1.600', 'HITCOUNT': '3.280', 'weapon3': '3.314', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '54.000'} [2023-02-25 14:27:16,339][36156] DAMAGECOUNT value on done: 1070868.0 [2023-02-25 14:27:16,340][36156] Sum rewards: 58.863, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.954', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO3': '0.095', 'AMMO4': '0.119', 'weapon5': '0.198', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.450', 'weapon4': '0.580', 'WEAPON3': '0.700', 'weapon3': '2.508', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '48.000'} [2023-02-25 14:27:16,652][36156] DAMAGECOUNT value on done: 1059977.0 [2023-02-25 14:27:16,652][36156] Sum rewards: 58.809, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.070', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.166', 'AMMO3': '0.173', 'AMMO4': '0.195', 'weapon2': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.466', 'WEAPON3': '1.000', 'weapon3': '2.856', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.804', 'FRAGCOUNT': '48.000'} [2023-02-25 14:27:16,664][36156] DAMAGECOUNT value on done: 1056754.0 [2023-02-25 14:27:16,664][36156] Sum rewards: 54.474, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.160', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.158', 'weapon2': '0.212', 'weapon5': '0.252', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.468', 'WEAPON3': '0.950', 'weapon3': '2.714', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.940', 'FRAGCOUNT': '46.500'} [2023-02-25 14:27:19,114][36155] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:27:19,166][36138] Updated weights for policy 0, policy_version 51493 (0.0009) [2023-02-25 14:27:19,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13440.4). Total num frames: 210919424. Throughput: 0: 3350.2. Samples: 15228086. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:27:19,730][36114] Avg episode reward: [(0, '59.282')] [2023-02-25 14:27:19,734][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000051494_210919424.pth... [2023-02-25 14:27:19,794][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000050707_207695872.pth [2023-02-25 14:27:22,277][36138] Updated weights for policy 0, policy_version 51503 (0.0010) [2023-02-25 14:27:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13454.3). Total num frames: 210989056. Throughput: 0: 3348.1. Samples: 15238002. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:27:24,730][36114] Avg episode reward: [(0, '59.282')] [2023-02-25 14:27:25,319][36138] Updated weights for policy 0, policy_version 51513 (0.0009) [2023-02-25 14:27:27,387][36154] DAMAGECOUNT value on done: 1074306.0 [2023-02-25 14:27:27,387][36154] Sum rewards: 53.422, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.270', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.156', 'weapon5': '0.198', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.498', 'weapon4': '0.508', 'WEAPON3': '1.000', 'weapon3': '2.572', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '13.332', 'FRAGCOUNT': '46.000'} [2023-02-25 14:27:27,681][36154] DAMAGECOUNT value on done: 1073367.0 [2023-02-25 14:27:27,682][36154] Sum rewards: 60.110, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.080', 'AMMO5': '0.013', 'AMMO2': '0.039', 'AMMO4': '0.194', 'weapon2': '0.218', 'weapon5': '0.234', 'AMMO3': '0.252', 'WEAPON5': '0.400', 'weapon4': '0.526', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.682', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '53.000'} [2023-02-25 14:27:27,708][36154] DAMAGECOUNT value on done: 1059011.0 [2023-02-25 14:27:27,708][36154] Sum rewards: 57.431, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.920', 'AMMO5': '0.009', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon5': '0.144', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'weapon4': '0.270', 'WEAPON5': '0.300', 'weapon2': '0.478', 'WEAPON3': '1.100', 'weapon3': '2.884', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.799', 'FRAGCOUNT': '47.000'} [2023-02-25 14:27:27,847][36141] DAMAGECOUNT value on done: 1072799.0 [2023-02-25 14:27:27,847][36141] Sum rewards: 53.196, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.078', 'AMMO5': '0.012', 'AMMO2': '0.054', 'AMMO3': '0.178', 'weapon2': '0.190', 'weapon5': '0.210', 'AMMO4': '0.272', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.796', 'WEAPON3': '1.050', 'weapon3': '2.440', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.391', 'FRAGCOUNT': '46.000'} [2023-02-25 14:27:27,983][36154] DAMAGECOUNT value on done: 1068236.0 [2023-02-25 14:27:27,984][36154] Sum rewards: 48.987, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.378', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.154', 'AMMO4': '0.173', 'WEAPON5': '0.250', 'AMMO3': '0.272', 'weapon2': '0.302', 'WEAPON4': '0.450', 'weapon4': '0.582', 'WEAPON3': '1.650', 'weapon3': '2.652', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.476', 'FRAGCOUNT': '47.000'} [2023-02-25 14:27:28,136][36141] DAMAGECOUNT value on done: 1062172.0 [2023-02-25 14:27:28,136][36141] Sum rewards: 53.270, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.222', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO3': '0.153', 'weapon5': '0.164', 'AMMO4': '0.169', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.666', 'weapon4': '0.776', 'WEAPON3': '0.950', 'weapon3': '2.120', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.625', 'FRAGCOUNT': '44.500'} [2023-02-25 14:27:28,165][36141] DAMAGECOUNT value on done: 1073350.0 [2023-02-25 14:27:28,165][36141] Sum rewards: 48.740, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.310', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon2': '0.188', 'AMMO4': '0.225', 'AMMO3': '0.231', 'weapon5': '0.240', 'weapon4': '0.446', 'ARMOR': '0.459', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.784', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.880', 'FRAGCOUNT': '45.000'} [2023-02-25 14:27:28,366][36138] Updated weights for policy 0, policy_version 51523 (0.0010) [2023-02-25 14:27:28,448][36141] DAMAGECOUNT value on done: 1058110.0 [2023-02-25 14:27:28,448][36141] Sum rewards: 60.509, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.192', 'AMMO5': '0.024', 'AMMO2': '0.056', 'AMMO3': '0.137', 'AMMO4': '0.278', 'weapon5': '0.358', 'weapon4': '0.426', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'weapon2': '0.694', 'WEAPON3': '0.750', 'weapon3': '2.192', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '15.465', 'FRAGCOUNT': '50.000'} [2023-02-25 14:27:29,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13440.4). Total num frames: 211054592. Throughput: 0: 3344.2. Samples: 15258104. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:27:29,730][36114] Avg episode reward: [(0, '58.950')] [2023-02-25 14:27:29,998][36155] DAMAGECOUNT value on done: 1059804.0 [2023-02-25 14:27:29,998][36155] Sum rewards: 46.635, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.010', 'AMMO5': '0.012', 'AMMO2': '0.040', 'AMMO3': '0.186', 'AMMO4': '0.198', 'weapon5': '0.258', 'weapon2': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.408', 'WEAPON3': '1.200', 'HITCOUNT': '2.610', 'weapon3': '2.788', 'DAMAGECOUNT': '13.347', 'FRAGCOUNT': '41.000'} [2023-02-25 14:27:30,302][36155] DAMAGECOUNT value on done: 1065838.0 [2023-02-25 14:27:30,302][36155] Sum rewards: 46.816, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.381', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.182', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'weapon4': '0.280', 'WEAPON4': '0.300', 'weapon2': '0.502', 'WEAPON3': '1.250', 'HITCOUNT': '2.540', 'weapon3': '2.762', 'DAMAGECOUNT': '13.782', 'FRAGCOUNT': '42.000'} [2023-02-25 14:27:30,638][36157] DAMAGECOUNT value on done: 1078504.0 [2023-02-25 14:27:30,639][36157] Sum rewards: 60.669, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.792', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.048', 'AMMO4': '0.065', 'weapon4': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.232', 'weapon2': '0.308', 'WEAPON3': '1.450', 'HITCOUNT': '3.120', 'weapon3': '3.324', 'DAMAGECOUNT': '15.807', 'FRAGCOUNT': '53.000'} [2023-02-25 14:27:30,954][36157] DAMAGECOUNT value on done: 1067283.0 [2023-02-25 14:27:30,954][36157] Sum rewards: 57.414, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.747', 'AMMO5': '0.026', 'AMMO2': '0.044', 'AMMO3': '0.203', 'AMMO4': '0.218', 'weapon5': '0.320', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon4': '0.606', 'weapon2': '0.610', 'WEAPON3': '1.250', 'weapon3': '2.042', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '50.000'} [2023-02-25 14:27:31,394][36138] Updated weights for policy 0, policy_version 51533 (0.0009) [2023-02-25 14:27:31,464][36155] DAMAGECOUNT value on done: 1082710.0 [2023-02-25 14:27:31,464][36155] Sum rewards: 61.274, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.177', 'ARMOR': '0.004', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.020', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.204', 'weapon4': '0.354', 'WEAPON3': '1.100', 'weapon3': '3.046', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.027', 'FRAGCOUNT': '51.000'} [2023-02-25 14:27:31,568][36157] DAMAGECOUNT value on done: 1077385.0 [2023-02-25 14:27:31,568][36157] Sum rewards: 55.639, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.041', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.160', 'AMMO4': '0.201', 'weapon2': '0.216', 'AMMO3': '0.223', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.638', 'WEAPON3': '1.300', 'weapon3': '2.740', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.159', 'FRAGCOUNT': '48.000'} [2023-02-25 14:27:31,776][36155] DAMAGECOUNT value on done: 1063883.0 [2023-02-25 14:27:31,776][36155] Sum rewards: 54.917, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.370', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon5': '0.044', 'weapon4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.218', 'weapon2': '0.348', 'WEAPON3': '1.400', 'HITCOUNT': '2.820', 'weapon3': '3.352', 'DAMAGECOUNT': '14.535', 'FRAGCOUNT': '48.000'} [2023-02-25 14:27:31,870][36157] DAMAGECOUNT value on done: 1071873.0 [2023-02-25 14:27:31,871][36157] Sum rewards: 62.104, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.328', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.170', 'AMMO3': '0.180', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.304', 'WEAPON3': '1.150', 'weapon3': '3.056', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.901', 'FRAGCOUNT': '55.000'} [2023-02-25 14:27:32,021][36140] DAMAGECOUNT value on done: 1069311.0 [2023-02-25 14:27:32,021][36140] Sum rewards: 54.215, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.290', 'AMMO5': '0.007', 'AMMO2': '0.030', 'AMMO3': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'weapon5': '0.154', 'WEAPON4': '0.250', 'weapon2': '0.398', 'ARMOR': '0.404', 'weapon4': '0.462', 'WEAPON3': '0.750', 'HITCOUNT': '2.570', 'weapon3': '2.638', 'DAMAGECOUNT': '13.176', 'FRAGCOUNT': '43.000'} [2023-02-25 14:27:32,345][36140] DAMAGECOUNT value on done: 1058323.0 [2023-02-25 14:27:32,346][36140] Sum rewards: 67.088, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.350', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.120', 'weapon4': '0.222', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.400', 'weapon3': '3.060', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.177', 'FRAGCOUNT': '60.000'} [2023-02-25 14:27:32,358][36140] DAMAGECOUNT value on done: 1068879.0 [2023-02-25 14:27:32,359][36140] Sum rewards: 48.056, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.970', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.094', 'AMMO4': '0.125', 'weapon4': '0.134', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'weapon2': '0.358', 'WEAPON3': '1.300', 'HITCOUNT': '2.630', 'weapon3': '3.170', 'DAMAGECOUNT': '13.473', 'FRAGCOUNT': '44.000'} [2023-02-25 14:27:32,472][36139] DAMAGECOUNT value on done: 1067115.0 [2023-02-25 14:27:32,472][36139] Sum rewards: 57.060, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.358', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.148', 'AMMO3': '0.161', 'AMMO4': '0.182', 'weapon4': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.308', 'WEAPON3': '0.950', 'HITCOUNT': '3.040', 'weapon3': '3.156', 'DAMAGECOUNT': '14.493', 'FRAGCOUNT': '47.000'} [2023-02-25 14:27:32,675][36140] DAMAGECOUNT value on done: 1061133.0 [2023-02-25 14:27:32,675][36140] Sum rewards: 49.991, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.722', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'AMMO3': '0.220', 'weapon2': '0.334', 'WEAPON4': '0.350', 'ARMOR': '0.404', 'weapon4': '0.860', 'WEAPON3': '1.400', 'weapon3': '2.430', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.684', 'FRAGCOUNT': '46.000'} [2023-02-25 14:27:32,777][36139] DAMAGECOUNT value on done: 1065965.0 [2023-02-25 14:27:32,777][36139] Sum rewards: 50.218, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.155', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon4': '0.124', 'weapon5': '0.148', 'AMMO3': '0.204', 'AMMO4': '0.257', 'WEAPON5': '0.400', 'ARMOR': '0.404', 'weapon2': '0.460', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.750', 'weapon3': '2.956', 'DAMAGECOUNT': '14.403', 'FRAGCOUNT': '45.000'} [2023-02-25 14:27:33,046][36139] DAMAGECOUNT value on done: 1079967.0 [2023-02-25 14:27:33,047][36139] Sum rewards: 45.338, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.700', 'AMMO5': '0.005', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'AMMO3': '0.122', 'AMMO4': '0.175', 'weapon5': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.728', 'WEAPON3': '0.750', 'weapon2': '0.946', 'weapon3': '1.872', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '10.914', 'FRAGCOUNT': '37.000'} [2023-02-25 14:27:33,346][36139] DAMAGECOUNT value on done: 1070199.0 [2023-02-25 14:27:33,347][36139] Sum rewards: 48.119, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.142', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon5': '0.136', 'AMMO4': '0.208', 'weapon2': '0.264', 'AMMO3': '0.279', 'weapon4': '0.280', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.004', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.144', 'FRAGCOUNT': '46.000'} [2023-02-25 14:27:33,943][36142] DAMAGECOUNT value on done: 1069334.0 [2023-02-25 14:27:33,944][36142] Sum rewards: 48.831, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.050', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.149', 'AMMO3': '0.152', 'weapon5': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.662', 'weapon2': '0.710', 'WEAPON3': '0.850', 'weapon3': '2.092', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '13.740', 'FRAGCOUNT': '39.000'} [2023-02-25 14:27:34,253][36142] DAMAGECOUNT value on done: 1054397.0 [2023-02-25 14:27:34,254][36142] Sum rewards: 39.480, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.112', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.104', 'weapon4': '0.120', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'weapon2': '0.972', 'WEAPON3': '1.250', 'HITCOUNT': '2.450', 'weapon3': '2.692', 'DAMAGECOUNT': '11.421', 'FRAGCOUNT': '38.000'} [2023-02-25 14:27:34,465][36138] Updated weights for policy 0, policy_version 51543 (0.0009) [2023-02-25 14:27:34,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13440.4). Total num frames: 211120128. Throughput: 0: 3345.2. Samples: 15278296. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:27:34,729][36114] Avg episode reward: [(0, '57.797')] [2023-02-25 14:27:34,778][36142] DAMAGECOUNT value on done: 1068132.0 [2023-02-25 14:27:34,779][36142] Sum rewards: 76.544, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.388', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon2': '0.178', 'weapon4': '0.178', 'weapon5': '0.178', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.248', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.473', 'FRAGCOUNT': '62.000'} [2023-02-25 14:27:35,088][36142] DAMAGECOUNT value on done: 1077613.0 [2023-02-25 14:27:35,089][36142] Sum rewards: 46.433, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.330', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.228', 'weapon5': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.428', 'weapon4': '0.476', 'WEAPON3': '1.300', 'weapon3': '2.490', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '12.618', 'FRAGCOUNT': '41.000'} [2023-02-25 14:27:36,423][36156] DAMAGECOUNT value on done: 1082372.0 [2023-02-25 14:27:36,424][36156] Sum rewards: 51.888, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.540', 'ARMOR': '0.012', 'AMMO5': '0.028', 'AMMO2': '0.075', 'AMMO3': '0.161', 'weapon5': '0.330', 'AMMO4': '0.375', 'weapon2': '0.596', 'weapon4': '0.604', 'WEAPON5': '0.800', 'WEAPON4': '0.850', 'WEAPON3': '1.000', 'weapon3': '2.128', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.519', 'FRAGCOUNT': '45.000'} [2023-02-25 14:27:36,435][36156] DAMAGECOUNT value on done: 1076027.0 [2023-02-25 14:27:36,436][36156] Sum rewards: 61.663, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.252', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.069', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon2': '0.292', 'WEAPON3': '1.300', 'HITCOUNT': '2.970', 'weapon3': '3.386', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '54.000'} [2023-02-25 14:27:36,731][36156] DAMAGECOUNT value on done: 1064874.0 [2023-02-25 14:27:36,731][36156] Sum rewards: 56.361, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.370', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.152', 'AMMO4': '0.186', 'WEAPON4': '0.200', 'WEAPON3': '0.950', 'weapon2': '1.066', 'weapon3': '2.710', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.691', 'FRAGCOUNT': '45.000'} [2023-02-25 14:27:36,742][36156] DAMAGECOUNT value on done: 1061724.0 [2023-02-25 14:27:36,743][36156] Sum rewards: 59.447, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.685', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.062', 'AMMO4': '0.146', 'AMMO3': '0.201', 'weapon2': '0.224', 'WEAPON5': '0.300', 'weapon4': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.054', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '52.000'} [2023-02-25 14:27:37,458][36138] Updated weights for policy 0, policy_version 51553 (0.0009) [2023-02-25 14:27:39,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13440.4). Total num frames: 211189760. Throughput: 0: 3345.8. Samples: 15288412. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:27:39,730][36114] Avg episode reward: [(0, '57.940')] [2023-02-25 14:27:39,971][36155] Large shaping reward 2.596 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5760000000000001, 192.0)] [2023-02-25 14:27:40,555][36138] Updated weights for policy 0, policy_version 51563 (0.0009) [2023-02-25 14:27:43,598][36138] Updated weights for policy 0, policy_version 51573 (0.0009) [2023-02-25 14:27:44,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13440.4). Total num frames: 211255296. Throughput: 0: 3345.4. Samples: 15308500. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:27:44,729][36114] Avg episode reward: [(0, '57.940')] [2023-02-25 14:27:46,665][36138] Updated weights for policy 0, policy_version 51583 (0.0009) [2023-02-25 14:27:47,354][36154] DAMAGECOUNT value on done: 1079787.0 [2023-02-25 14:27:47,354][36154] Sum rewards: 73.248, reward structure: {'DEATHCOUNT': '-11.250', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.084', 'HEALTH': '0.131', 'AMMO4': '0.132', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'weapon4': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.370', 'WEAPON3': '0.950', 'weapon3': '3.156', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '59.000'} [2023-02-25 14:27:47,609][36154] DAMAGECOUNT value on done: 1078036.0 [2023-02-25 14:27:47,609][36154] Sum rewards: 51.845, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.632', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.228', 'weapon4': '0.342', 'weapon2': '0.616', 'WEAPON3': '1.050', 'weapon3': '2.600', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.007', 'FRAGCOUNT': '43.000'} [2023-02-25 14:27:47,664][36154] DAMAGECOUNT value on done: 1063450.0 [2023-02-25 14:27:47,664][36154] Sum rewards: 45.693, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.700', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon4': '0.070', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.600', 'WEAPON3': '1.350', 'HITCOUNT': '2.800', 'weapon3': '3.064', 'DAMAGECOUNT': '13.317', 'FRAGCOUNT': '40.000'} [2023-02-25 14:27:47,836][36141] DAMAGECOUNT value on done: 1077817.0 [2023-02-25 14:27:47,836][36141] Sum rewards: 56.397, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.150', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.062', 'weapon5': '0.108', 'weapon2': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.220', 'AMMO3': '0.234', 'WEAPON3': '1.300', 'HITCOUNT': '3.060', 'weapon3': '3.316', 'DAMAGECOUNT': '15.054', 'FRAGCOUNT': '48.000'} [2023-02-25 14:27:47,932][36154] DAMAGECOUNT value on done: 1073171.0 [2023-02-25 14:27:47,933][36154] Sum rewards: 53.568, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.850', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO4': '0.178', 'weapon5': '0.190', 'AMMO3': '0.202', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.648', 'weapon4': '0.680', 'WEAPON3': '1.250', 'weapon3': '2.206', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.805', 'FRAGCOUNT': '49.000'} [2023-02-25 14:27:48,116][36141] DAMAGECOUNT value on done: 1067161.0 [2023-02-25 14:27:48,116][36141] Sum rewards: 62.368, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.505', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.162', 'WEAPON5': '0.250', 'weapon2': '0.250', 'weapon5': '0.258', 'WEAPON4': '0.300', 'weapon4': '0.338', 'WEAPON3': '1.050', 'weapon3': '2.884', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.967', 'FRAGCOUNT': '53.000'} [2023-02-25 14:27:48,143][36141] DAMAGECOUNT value on done: 1078663.0 [2023-02-25 14:27:48,143][36141] Sum rewards: 64.293, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.727', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.050', 'AMMO3': '0.159', 'AMMO4': '0.250', 'weapon5': '0.262', 'weapon2': '0.310', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.616', 'WEAPON3': '0.950', 'weapon3': '2.524', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.939', 'FRAGCOUNT': '54.000'} [2023-02-25 14:27:48,428][36141] DAMAGECOUNT value on done: 1062974.0 [2023-02-25 14:27:48,428][36141] Sum rewards: 62.399, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.245', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.070', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'WEAPON5': '0.150', 'weapon4': '0.224', 'WEAPON3': '0.700', 'weapon2': '0.780', 'weapon3': '2.790', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.592', 'FRAGCOUNT': '48.000'} [2023-02-25 14:27:49,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13426.6). Total num frames: 211320832. Throughput: 0: 3347.5. Samples: 15328590. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:27:49,730][36114] Avg episode reward: [(0, '57.831')] [2023-02-25 14:27:49,733][36138] Updated weights for policy 0, policy_version 51593 (0.0009) [2023-02-25 14:27:50,070][36155] DAMAGECOUNT value on done: 1065471.0 [2023-02-25 14:27:50,071][36155] Sum rewards: 66.038, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.336', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.015', 'weapon4': '0.046', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.250', 'weapon5': '0.290', 'weapon2': '0.378', 'WEAPON3': '1.450', 'weapon3': '2.962', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '59.000'} [2023-02-25 14:27:50,377][36155] DAMAGECOUNT value on done: 1070293.0 [2023-02-25 14:27:50,378][36155] Sum rewards: 52.669, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.853', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon2': '0.202', 'AMMO3': '0.208', 'weapon5': '0.210', 'weapon4': '0.336', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.900', 'weapon3': '3.000', 'DAMAGECOUNT': '13.365', 'FRAGCOUNT': '48.000'} [2023-02-25 14:27:50,792][36157] DAMAGECOUNT value on done: 1083255.0 [2023-02-25 14:27:50,793][36157] Sum rewards: 48.324, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.344', 'ARMOR': '0.004', 'AMMO5': '0.026', 'AMMO2': '0.075', 'AMMO3': '0.189', 'weapon5': '0.282', 'AMMO4': '0.375', 'weapon4': '0.440', 'weapon2': '0.530', 'WEAPON5': '0.650', 'WEAPON4': '0.800', 'WEAPON3': '1.100', 'weapon3': '2.354', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.253', 'FRAGCOUNT': '44.000'} [2023-02-25 14:27:51,104][36157] DAMAGECOUNT value on done: 1072300.0 [2023-02-25 14:27:51,105][36157] Sum rewards: 60.154, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.053', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.039', 'AMMO4': '0.195', 'AMMO3': '0.223', 'weapon4': '0.228', 'weapon2': '0.248', 'weapon5': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.928', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.051', 'FRAGCOUNT': '53.000'} [2023-02-25 14:27:51,469][36155] DAMAGECOUNT value on done: 1088601.0 [2023-02-25 14:27:51,470][36155] Sum rewards: 68.991, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.959', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon2': '0.264', 'weapon4': '0.286', 'WEAPON3': '1.150', 'weapon3': '3.064', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '56.000'} [2023-02-25 14:27:51,656][36157] DAMAGECOUNT value on done: 1082283.0 [2023-02-25 14:27:51,657][36157] Sum rewards: 60.581, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.403', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.108', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'weapon4': '0.190', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.552', 'WEAPON3': '1.250', 'weapon3': '2.888', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.664', 'FRAGCOUNT': '52.000'} [2023-02-25 14:27:51,770][36155] DAMAGECOUNT value on done: 1068243.0 [2023-02-25 14:27:51,770][36155] Sum rewards: 49.066, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.530', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon5': '0.100', 'AMMO3': '0.170', 'weapon2': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.602', 'WEAPON3': '1.200', 'HITCOUNT': '2.610', 'weapon3': '2.832', 'DAMAGECOUNT': '13.080', 'FRAGCOUNT': '42.500'} [2023-02-25 14:27:51,964][36157] DAMAGECOUNT value on done: 1077215.0 [2023-02-25 14:27:51,965][36157] Sum rewards: 58.138, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.888', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.177', 'AMMO4': '0.188', 'weapon2': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon5': '0.306', 'weapon4': '0.470', 'WEAPON3': '1.100', 'weapon3': '2.718', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.026', 'FRAGCOUNT': '48.000'} [2023-02-25 14:27:52,077][36140] DAMAGECOUNT value on done: 1073591.0 [2023-02-25 14:27:52,077][36140] Sum rewards: 48.788, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.857', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.031', 'weapon5': '0.112', 'AMMO4': '0.153', 'AMMO3': '0.182', 'weapon4': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.050', 'HITCOUNT': '2.580', 'weapon3': '3.124', 'DAMAGECOUNT': '12.810', 'FRAGCOUNT': '43.000'} [2023-02-25 14:27:52,341][36139] DAMAGECOUNT value on done: 1070898.0 [2023-02-25 14:27:52,342][36139] Sum rewards: 48.912, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.565', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon5': '0.096', 'AMMO3': '0.155', 'AMMO4': '0.167', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.466', 'weapon4': '0.520', 'WEAPON3': '0.900', 'HITCOUNT': '2.430', 'weapon3': '2.692', 'DAMAGECOUNT': '11.349', 'FRAGCOUNT': '42.000'} [2023-02-25 14:27:52,378][36140] DAMAGECOUNT value on done: 1063773.0 [2023-02-25 14:27:52,378][36140] Sum rewards: 56.546, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.140', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon5': '0.192', 'weapon4': '0.194', 'AMMO4': '0.247', 'AMMO3': '0.266', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.912', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '52.500'} [2023-02-25 14:27:52,391][36140] DAMAGECOUNT value on done: 1074937.0 [2023-02-25 14:27:52,391][36140] Sum rewards: 69.944, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.200', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.104', 'weapon5': '0.106', 'AMMO4': '0.109', 'AMMO3': '0.187', 'weapon2': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.310', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.174', 'FRAGCOUNT': '58.000'} [2023-02-25 14:27:52,666][36139] DAMAGECOUNT value on done: 1070458.0 [2023-02-25 14:27:52,666][36139] Sum rewards: 57.355, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.390', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.189', 'weapon4': '0.208', 'weapon2': '0.550', 'WEAPON3': '1.100', 'HITCOUNT': '2.970', 'weapon3': '3.058', 'DAMAGECOUNT': '13.479', 'FRAGCOUNT': '48.000'} [2023-02-25 14:27:52,712][36140] DAMAGECOUNT value on done: 1064861.0 [2023-02-25 14:27:52,712][36140] Sum rewards: 41.570, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.100', 'ARMOR': '0.004', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.041', 'weapon5': '0.138', 'AMMO3': '0.167', 'AMMO4': '0.204', 'weapon2': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.770', 'WEAPON3': '1.000', 'weapon3': '1.838', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '11.184', 'FRAGCOUNT': '37.000'} [2023-02-25 14:27:52,796][36138] Updated weights for policy 0, policy_version 51603 (0.0009) [2023-02-25 14:27:52,920][36139] DAMAGECOUNT value on done: 1085152.0 [2023-02-25 14:27:52,920][36139] Sum rewards: 55.760, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.946', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO4': '0.187', 'weapon5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.220', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.502', 'WEAPON3': '1.250', 'weapon3': '2.792', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '48.000'} [2023-02-25 14:27:53,220][36139] DAMAGECOUNT value on done: 1074549.0 [2023-02-25 14:27:53,221][36139] Sum rewards: 50.539, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.007', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'weapon5': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon4': '0.426', 'weapon2': '0.524', 'WEAPON3': '1.250', 'weapon3': '2.688', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '13.050', 'FRAGCOUNT': '44.500'} [2023-02-25 14:27:54,079][36142] DAMAGECOUNT value on done: 1074238.0 [2023-02-25 14:27:54,079][36142] Sum rewards: 55.868, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.580', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon4': '0.036', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.205', 'weapon2': '0.734', 'WEAPON3': '1.300', 'weapon3': '3.018', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.712', 'FRAGCOUNT': '47.000'} [2023-02-25 14:27:54,399][36142] DAMAGECOUNT value on done: 1059075.0 [2023-02-25 14:27:54,399][36142] Sum rewards: 53.315, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.798', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.192', 'AMMO3': '0.196', 'AMMO4': '0.202', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.554', 'weapon4': '0.738', 'WEAPON3': '1.250', 'weapon3': '2.254', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.034', 'FRAGCOUNT': '48.000'} [2023-02-25 14:27:54,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13440.4). Total num frames: 211390464. Throughput: 0: 3349.3. Samples: 15338706. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:27:54,730][36114] Avg episode reward: [(0, '56.734')] [2023-02-25 14:27:54,903][36142] DAMAGECOUNT value on done: 1073935.0 [2023-02-25 14:27:54,904][36142] Sum rewards: 63.101, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.700', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon5': '0.050', 'AMMO3': '0.230', 'AMMO4': '0.230', 'weapon4': '0.242', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.472', 'WEAPON3': '1.350', 'weapon3': '2.954', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '55.000'} [2023-02-25 14:27:55,215][36142] DAMAGECOUNT value on done: 1082843.0 [2023-02-25 14:27:55,215][36142] Sum rewards: 59.675, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.676', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.150', 'AMMO4': '0.164', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.854', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '51.000'} [2023-02-25 14:27:55,851][36138] Updated weights for policy 0, policy_version 51613 (0.0009) [2023-02-25 14:27:56,397][36156] DAMAGECOUNT value on done: 1086772.0 [2023-02-25 14:27:56,398][36156] Sum rewards: 50.248, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.465', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon4': '0.250', 'weapon2': '0.744', 'WEAPON3': '1.150', 'weapon3': '2.606', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '13.200', 'FRAGCOUNT': '43.000'} [2023-02-25 14:27:56,410][36156] DAMAGECOUNT value on done: 1081578.0 [2023-02-25 14:27:56,411][36156] Sum rewards: 60.719, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.066', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.052', 'weapon5': '0.086', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.222', 'AMMO3': '0.301', 'WEAPON3': '1.700', 'HITCOUNT': '3.190', 'weapon3': '3.302', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '57.000'} [2023-02-25 14:27:56,709][36156] DAMAGECOUNT value on done: 1070762.0 [2023-02-25 14:27:56,710][36156] Sum rewards: 67.391, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.834', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.088', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'weapon4': '0.164', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon2': '0.520', 'WEAPON3': '1.200', 'weapon3': '2.998', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '56.000'} [2023-02-25 14:27:56,725][36156] DAMAGECOUNT value on done: 1066146.0 [2023-02-25 14:27:56,725][36156] Sum rewards: 50.417, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.062', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO3': '0.154', 'AMMO4': '0.186', 'weapon5': '0.256', 'weapon4': '0.314', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.540', 'WEAPON3': '0.900', 'HITCOUNT': '2.620', 'weapon3': '2.634', 'DAMAGECOUNT': '13.071', 'FRAGCOUNT': '45.000'} [2023-02-25 14:27:58,901][36138] Updated weights for policy 0, policy_version 51623 (0.0009) [2023-02-25 14:27:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13426.5). Total num frames: 211456000. Throughput: 0: 3352.9. Samples: 15358938. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:27:59,730][36114] Avg episode reward: [(0, '56.704')] [2023-02-25 14:28:01,464][36142] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:28:01,953][36138] Updated weights for policy 0, policy_version 51633 (0.0009) [2023-02-25 14:28:03,521][36142] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:28:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 211525632. Throughput: 0: 3355.8. Samples: 15379096. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:28:04,730][36114] Avg episode reward: [(0, '56.704')] [2023-02-25 14:28:04,956][36138] Updated weights for policy 0, policy_version 51643 (0.0010) [2023-02-25 14:28:05,371][36154] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:28:07,354][36154] DAMAGECOUNT value on done: 1084605.0 [2023-02-25 14:28:07,355][36154] Sum rewards: 55.776, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.510', 'AMMO5': '0.012', 'AMMO2': '0.041', 'AMMO3': '0.173', 'AMMO4': '0.204', 'weapon5': '0.252', 'weapon2': '0.336', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.772', 'WEAPON3': '1.000', 'weapon3': '2.202', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.334', 'FRAGCOUNT': '49.000'} [2023-02-25 14:28:07,620][36154] DAMAGECOUNT value on done: 1082943.0 [2023-02-25 14:28:07,620][36154] Sum rewards: 55.891, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.984', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.036', 'AMMO4': '0.058', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'weapon4': '0.384', 'weapon2': '0.404', 'WEAPON3': '1.050', 'weapon3': '2.960', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.721', 'FRAGCOUNT': '47.000'} [2023-02-25 14:28:07,684][36154] DAMAGECOUNT value on done: 1067625.0 [2023-02-25 14:28:07,684][36154] Sum rewards: 41.306, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.100', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon5': '0.192', 'AMMO3': '0.217', 'AMMO4': '0.237', 'weapon2': '0.352', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.652', 'WEAPON3': '1.200', 'HITCOUNT': '2.430', 'weapon3': '2.468', 'DAMAGECOUNT': '12.495', 'FRAGCOUNT': '38.000'} [2023-02-25 14:28:07,843][36141] DAMAGECOUNT value on done: 1082986.0 [2023-02-25 14:28:07,843][36141] Sum rewards: 52.512, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.015', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.054', 'AMMO4': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon4': '0.250', 'weapon2': '0.330', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.082', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '47.000'} [2023-02-25 14:28:07,935][36154] DAMAGECOUNT value on done: 1078705.0 [2023-02-25 14:28:07,935][36154] Sum rewards: 62.172, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.452', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.072', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.272', 'weapon4': '0.430', 'WEAPON3': '1.250', 'weapon3': '2.908', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '54.000'} [2023-02-25 14:28:08,014][36138] Updated weights for policy 0, policy_version 51653 (0.0009) [2023-02-25 14:28:08,145][36141] DAMAGECOUNT value on done: 1071842.0 [2023-02-25 14:28:08,145][36141] Sum rewards: 53.234, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.164', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.051', 'weapon5': '0.096', 'AMMO3': '0.194', 'AMMO4': '0.254', 'weapon2': '0.334', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.556', 'WEAPON3': '1.200', 'weapon3': '2.756', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.043', 'FRAGCOUNT': '47.500'} [2023-02-25 14:28:08,176][36141] DAMAGECOUNT value on done: 1083213.0 [2023-02-25 14:28:08,177][36141] Sum rewards: 58.545, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.397', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.050', 'AMMO4': '0.110', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.204', 'weapon2': '0.534', 'WEAPON3': '0.950', 'HITCOUNT': '2.840', 'weapon3': '3.002', 'DAMAGECOUNT': '13.650', 'FRAGCOUNT': '49.000'} [2023-02-25 14:28:08,479][36141] DAMAGECOUNT value on done: 1067432.0 [2023-02-25 14:28:08,479][36141] Sum rewards: 51.754, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.096', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.040', 'AMMO3': '0.189', 'AMMO4': '0.199', 'weapon5': '0.214', 'weapon2': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.570', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.374', 'FRAGCOUNT': '45.000'} [2023-02-25 14:28:09,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13440.4). Total num frames: 211591168. Throughput: 0: 3356.8. Samples: 15389058. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:28:09,729][36114] Avg episode reward: [(0, '56.273')] [2023-02-25 14:28:10,069][36155] DAMAGECOUNT value on done: 1069915.0 [2023-02-25 14:28:10,070][36155] Sum rewards: 51.872, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.089', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'AMMO3': '0.214', 'weapon2': '0.368', 'weapon4': '0.684', 'WEAPON3': '1.300', 'weapon3': '2.428', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.332', 'FRAGCOUNT': '45.000'} [2023-02-25 14:28:10,363][36155] DAMAGECOUNT value on done: 1075638.0 [2023-02-25 14:28:10,364][36155] Sum rewards: 69.780, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.155', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.058', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'weapon2': '0.238', 'weapon4': '0.288', 'WEAPON3': '1.150', 'weapon3': '3.180', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '58.000'} [2023-02-25 14:28:10,887][36157] DAMAGECOUNT value on done: 1088212.0 [2023-02-25 14:28:10,888][36157] Sum rewards: 55.270, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.376', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon2': '0.138', 'WEAPON5': '0.150', 'weapon5': '0.164', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon4': '0.368', 'WEAPON3': '1.250', 'HITCOUNT': '3.000', 'weapon3': '3.092', 'DAMAGECOUNT': '14.871', 'FRAGCOUNT': '48.000'} [2023-02-25 14:28:11,077][36138] Updated weights for policy 0, policy_version 51663 (0.0009) [2023-02-25 14:28:11,194][36157] DAMAGECOUNT value on done: 1076866.0 [2023-02-25 14:28:11,194][36157] Sum rewards: 51.582, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.130', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.048', 'weapon5': '0.054', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon2': '0.500', 'WEAPON3': '1.050', 'HITCOUNT': '2.750', 'weapon3': '3.262', 'DAMAGECOUNT': '13.698', 'FRAGCOUNT': '42.000'} [2023-02-25 14:28:11,455][36155] DAMAGECOUNT value on done: 1092969.0 [2023-02-25 14:28:11,456][36155] Sum rewards: 46.534, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.182', 'AMMO5': '0.011', 'AMMO2': '0.059', 'weapon5': '0.176', 'AMMO3': '0.223', 'AMMO4': '0.294', 'WEAPON5': '0.300', 'weapon2': '0.310', 'weapon4': '0.392', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.836', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.074', 'FRAGCOUNT': '44.000'} [2023-02-25 14:28:11,773][36155] DAMAGECOUNT value on done: 1072810.0 [2023-02-25 14:28:11,774][36155] Sum rewards: 51.841, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.372', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'weapon4': '0.472', 'weapon2': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.522', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.698', 'FRAGCOUNT': '46.000'} [2023-02-25 14:28:11,776][36157] DAMAGECOUNT value on done: 1087565.0 [2023-02-25 14:28:11,777][36157] Sum rewards: 56.665, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.060', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.116', 'AMMO4': '0.161', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'WEAPON4': '0.350', 'weapon2': '0.372', 'weapon4': '0.376', 'WEAPON3': '1.450', 'weapon3': '2.914', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '51.000'} [2023-02-25 14:28:12,085][36140] DAMAGECOUNT value on done: 1078980.0 [2023-02-25 14:28:12,085][36140] Sum rewards: 60.561, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.490', 'AMMO5': '0.015', 'AMMO2': '0.060', 'AMMO3': '0.210', 'weapon2': '0.280', 'weapon5': '0.284', 'AMMO4': '0.299', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.866', 'WEAPON3': '1.200', 'weapon3': '2.110', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '53.000'} [2023-02-25 14:28:12,091][36157] DAMAGECOUNT value on done: 1082884.0 [2023-02-25 14:28:12,092][36157] Sum rewards: 65.085, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.818', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon2': '0.176', 'AMMO3': '0.186', 'AMMO4': '0.189', 'weapon5': '0.244', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.826', 'WEAPON3': '1.150', 'weapon3': '2.484', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.007', 'FRAGCOUNT': '54.000'} [2023-02-25 14:28:12,192][36139] DAMAGECOUNT value on done: 1075772.0 [2023-02-25 14:28:12,193][36139] Sum rewards: 53.417, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.577', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.045', 'AMMO3': '0.139', 'AMMO4': '0.223', 'weapon5': '0.462', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.602', 'weapon2': '0.706', 'WEAPON3': '0.850', 'weapon3': '1.870', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.622', 'FRAGCOUNT': '45.000'} [2023-02-25 14:28:12,401][36140] DAMAGECOUNT value on done: 1069279.0 [2023-02-25 14:28:12,402][36140] Sum rewards: 71.309, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.075', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.181', 'weapon2': '0.234', 'WEAPON3': '1.100', 'HITCOUNT': '3.330', 'weapon3': '3.556', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '59.000'} [2023-02-25 14:28:12,418][36140] DAMAGECOUNT value on done: 1080223.0 [2023-02-25 14:28:12,418][36140] Sum rewards: 63.167, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.830', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon5': '0.132', 'AMMO3': '0.173', 'AMMO4': '0.230', 'weapon2': '0.266', 'weapon4': '0.398', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.994', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.858', 'FRAGCOUNT': '54.000'} [2023-02-25 14:28:12,519][36139] DAMAGECOUNT value on done: 1074624.0 [2023-02-25 14:28:12,520][36139] Sum rewards: 42.972, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.801', 'AMMO5': '0.009', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.138', 'weapon2': '0.164', 'AMMO3': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '1.076', 'WEAPON3': '1.100', 'weapon3': '2.194', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '12.498', 'FRAGCOUNT': '37.000'} [2023-02-25 14:28:12,753][36140] DAMAGECOUNT value on done: 1069666.0 [2023-02-25 14:28:12,754][36140] Sum rewards: 59.441, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.080', 'AMMO5': '0.006', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.092', 'weapon2': '0.138', 'weapon4': '0.190', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.350', 'HITCOUNT': '2.960', 'weapon3': '3.412', 'DAMAGECOUNT': '14.415', 'FRAGCOUNT': '52.000'} [2023-02-25 14:28:12,808][36139] DAMAGECOUNT value on done: 1090707.0 [2023-02-25 14:28:12,809][36139] Sum rewards: 69.820, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.130', 'AMMO2': '0.006', 'AMMO4': '0.030', 'AMMO3': '0.191', 'weapon2': '0.814', 'WEAPON3': '1.250', 'weapon3': '3.034', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '57.000'} [2023-02-25 14:28:12,913][36155] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:28:13,125][36139] DAMAGECOUNT value on done: 1079476.0 [2023-02-25 14:28:13,125][36139] Sum rewards: 58.516, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.224', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.062', 'AMMO3': '0.135', 'AMMO4': '0.310', 'weapon5': '0.326', 'weapon4': '0.406', 'weapon2': '0.444', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '0.800', 'weapon3': '2.460', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.781', 'FRAGCOUNT': '50.000'} [2023-02-25 14:28:14,217][36138] Updated weights for policy 0, policy_version 51673 (0.0009) [2023-02-25 14:28:14,281][36142] DAMAGECOUNT value on done: 1079067.0 [2023-02-25 14:28:14,281][36142] Sum rewards: 49.230, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.042', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.158', 'AMMO3': '0.169', 'WEAPON5': '0.250', 'weapon4': '0.290', 'WEAPON4': '0.300', 'weapon2': '0.482', 'WEAPON3': '1.050', 'HITCOUNT': '2.820', 'weapon3': '2.856', 'DAMAGECOUNT': '14.487', 'FRAGCOUNT': '41.000'} [2023-02-25 14:28:14,577][36142] DAMAGECOUNT value on done: 1063402.0 [2023-02-25 14:28:14,577][36142] Sum rewards: 48.585, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.954', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.188', 'AMMO3': '0.221', 'AMMO4': '0.251', 'weapon2': '0.304', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.458', 'WEAPON3': '1.250', 'HITCOUNT': '2.590', 'weapon3': '2.680', 'DAMAGECOUNT': '12.981', 'FRAGCOUNT': '44.500'} [2023-02-25 14:28:14,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.2, 300 sec: 13426.5). Total num frames: 211656704. Throughput: 0: 3350.3. Samples: 15408868. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:28:14,730][36114] Avg episode reward: [(0, '56.150')] [2023-02-25 14:28:14,994][36142] DAMAGECOUNT value on done: 1078639.0 [2023-02-25 14:28:14,994][36142] Sum rewards: 50.191, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.660', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.051', 'AMMO3': '0.172', 'weapon5': '0.242', 'AMMO4': '0.255', 'weapon2': '0.414', 'weapon4': '0.438', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '0.950', 'weapon3': '2.544', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '13.947', 'FRAGCOUNT': '44.000'} [2023-02-25 14:28:15,302][36142] DAMAGECOUNT value on done: 1087949.0 [2023-02-25 14:28:15,303][36142] Sum rewards: 61.480, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.860', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.116', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'weapon2': '0.402', 'weapon4': '0.424', 'WEAPON3': '1.200', 'weapon3': '2.846', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.318', 'FRAGCOUNT': '52.000'} [2023-02-25 14:28:16,624][36156] DAMAGECOUNT value on done: 1091497.0 [2023-02-25 14:28:16,625][36156] Sum rewards: 51.032, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.506', 'AMMO5': '0.020', 'AMMO2': '0.051', 'weapon7': '0.056', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.148', 'WEAPON7': '0.200', 'AMMO3': '0.218', 'weapon2': '0.228', 'AMMO4': '0.256', 'weapon4': '0.358', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'HITCOUNT': '2.590', 'weapon3': '2.830', 'DAMAGECOUNT': '14.142', 'FRAGCOUNT': '47.000'} [2023-02-25 14:28:16,636][36156] DAMAGECOUNT value on done: 1086578.0 [2023-02-25 14:28:16,637][36156] Sum rewards: 61.000, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.355', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO3': '0.196', 'weapon2': '0.560', 'WEAPON3': '1.250', 'HITCOUNT': '3.150', 'weapon3': '3.240', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '51.000'} [2023-02-25 14:28:16,948][36156] DAMAGECOUNT value on done: 1075954.0 [2023-02-25 14:28:16,949][36156] Sum rewards: 60.202, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.316', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.152', 'weapon2': '0.176', 'AMMO3': '0.250', 'WEAPON3': '1.500', 'HITCOUNT': '3.010', 'weapon3': '3.308', 'DAMAGECOUNT': '15.576', 'FRAGCOUNT': '53.000'} [2023-02-25 14:28:16,963][36156] DAMAGECOUNT value on done: 1071906.0 [2023-02-25 14:28:16,963][36156] Sum rewards: 65.872, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.331', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.176', 'weapon2': '0.186', 'AMMO4': '0.221', 'AMMO3': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.408', 'WEAPON3': '1.400', 'weapon3': '2.836', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '58.000'} [2023-02-25 14:28:17,306][36138] Updated weights for policy 0, policy_version 51683 (0.0009) [2023-02-25 14:28:19,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13426.6). Total num frames: 211722240. Throughput: 0: 3350.1. Samples: 15429052. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:28:19,730][36114] Avg episode reward: [(0, '56.057')] [2023-02-25 14:28:20,366][36138] Updated weights for policy 0, policy_version 51693 (0.0009) [2023-02-25 14:28:23,404][36138] Updated weights for policy 0, policy_version 51703 (0.0009) [2023-02-25 14:28:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13426.5). Total num frames: 211791872. Throughput: 0: 3349.5. Samples: 15439138. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:28:24,729][36114] Avg episode reward: [(0, '56.057')] [2023-02-25 14:28:26,489][36138] Updated weights for policy 0, policy_version 51713 (0.0009) [2023-02-25 14:28:26,720][36154] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:28:27,683][36154] DAMAGECOUNT value on done: 1089172.0 [2023-02-25 14:28:27,683][36154] Sum rewards: 51.954, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.746', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO4': '0.164', 'AMMO3': '0.169', 'weapon5': '0.234', 'weapon2': '0.402', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.488', 'WEAPON3': '1.050', 'weapon3': '2.534', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.701', 'FRAGCOUNT': '45.000'} [2023-02-25 14:28:27,928][36154] DAMAGECOUNT value on done: 1088589.0 [2023-02-25 14:28:27,928][36154] Sum rewards: 60.126, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.347', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon5': '0.194', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'weapon2': '0.256', 'WEAPON4': '0.400', 'weapon4': '0.406', 'WEAPON3': '1.300', 'weapon3': '2.802', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '52.000'} [2023-02-25 14:28:27,973][36141] DAMAGECOUNT value on done: 1088230.0 [2023-02-25 14:28:27,974][36141] Sum rewards: 62.197, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.486', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.160', 'AMMO3': '0.165', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.306', 'weapon2': '0.318', 'WEAPON3': '0.950', 'weapon3': '2.910', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '51.000'} [2023-02-25 14:28:28,000][36154] DAMAGECOUNT value on done: 1072155.0 [2023-02-25 14:28:28,001][36154] Sum rewards: 50.321, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.272', 'AMMO5': '0.014', 'AMMO2': '0.068', 'weapon5': '0.114', 'AMMO3': '0.130', 'weapon2': '0.294', 'WEAPON5': '0.300', 'AMMO4': '0.342', 'WEAPON4': '0.600', 'weapon4': '0.682', 'WEAPON3': '0.800', 'weapon3': '2.458', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '13.590', 'FRAGCOUNT': '44.000'} [2023-02-25 14:28:28,249][36141] DAMAGECOUNT value on done: 1077677.0 [2023-02-25 14:28:28,250][36141] Sum rewards: 68.893, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.433', 'AMMO5': '0.017', 'AMMO2': '0.023', 'AMMO4': '0.112', 'AMMO3': '0.155', 'weapon5': '0.180', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.328', 'weapon4': '0.610', 'WEAPON3': '0.950', 'weapon3': '2.586', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '56.000'} [2023-02-25 14:28:28,258][36154] DAMAGECOUNT value on done: 1084080.0 [2023-02-25 14:28:28,259][36154] Sum rewards: 55.986, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.749', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon5': '0.220', 'AMMO3': '0.259', 'weapon2': '0.354', 'WEAPON4': '0.400', 'weapon4': '0.434', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.630', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '16.125', 'FRAGCOUNT': '51.000'} [2023-02-25 14:28:28,288][36141] DAMAGECOUNT value on done: 1087344.0 [2023-02-25 14:28:28,288][36141] Sum rewards: 47.578, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.640', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.058', 'AMMO3': '0.139', 'AMMO4': '0.192', 'weapon5': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'weapon2': '1.030', 'weapon3': '2.516', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '12.393', 'FRAGCOUNT': '39.000'} [2023-02-25 14:28:28,564][36141] DAMAGECOUNT value on done: 1072948.0 [2023-02-25 14:28:28,564][36141] Sum rewards: 61.191, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.930', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.094', 'AMMO3': '0.206', 'AMMO4': '0.231', 'WEAPON5': '0.350', 'weapon2': '0.446', 'weapon4': '0.448', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.744', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.548', 'FRAGCOUNT': '53.500'} [2023-02-25 14:28:29,538][36138] Updated weights for policy 0, policy_version 51723 (0.0009) [2023-02-25 14:28:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13426.5). Total num frames: 211857408. Throughput: 0: 3347.0. Samples: 15459114. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:28:29,729][36114] Avg episode reward: [(0, '56.065')] [2023-02-25 14:28:30,191][36155] DAMAGECOUNT value on done: 1074885.0 [2023-02-25 14:28:30,192][36155] Sum rewards: 61.067, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.278', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.040', 'weapon4': '0.124', 'weapon5': '0.160', 'AMMO4': '0.198', 'AMMO3': '0.224', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.980', 'weapon3': '3.088', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '54.000'} [2023-02-25 14:28:30,514][36155] DAMAGECOUNT value on done: 1080845.0 [2023-02-25 14:28:30,514][36155] Sum rewards: 59.936, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.158', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.072', 'AMMO3': '0.172', 'weapon2': '0.392', 'WEAPON3': '1.200', 'weapon3': '3.332', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.621', 'FRAGCOUNT': '49.000'} [2023-02-25 14:28:30,980][36157] DAMAGECOUNT value on done: 1093258.0 [2023-02-25 14:28:30,981][36157] Sum rewards: 60.058, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.320', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO3': '0.139', 'weapon5': '0.144', 'AMMO4': '0.184', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.442', 'weapon4': '0.734', 'WEAPON3': '0.800', 'weapon3': '2.262', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.138', 'FRAGCOUNT': '48.000'} [2023-02-25 14:28:31,297][36157] DAMAGECOUNT value on done: 1081664.0 [2023-02-25 14:28:31,297][36157] Sum rewards: 53.886, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.584', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO3': '0.163', 'AMMO4': '0.194', 'weapon5': '0.196', 'weapon2': '0.396', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.672', 'WEAPON3': '0.900', 'weapon3': '2.462', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.394', 'FRAGCOUNT': '45.000'} [2023-02-25 14:28:31,513][36155] DAMAGECOUNT value on done: 1098153.0 [2023-02-25 14:28:31,514][36155] Sum rewards: 57.919, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.890', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.160', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.412', 'weapon2': '0.606', 'WEAPON3': '1.200', 'weapon3': '2.598', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.552', 'FRAGCOUNT': '50.000'} [2023-02-25 14:28:31,832][36155] DAMAGECOUNT value on done: 1077964.0 [2023-02-25 14:28:31,832][36155] Sum rewards: 58.072, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.750', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon4': '0.136', 'weapon5': '0.146', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.484', 'WEAPON3': '1.250', 'weapon3': '2.780', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.462', 'FRAGCOUNT': '49.000'} [2023-02-25 14:28:31,883][36157] DAMAGECOUNT value on done: 1092712.0 [2023-02-25 14:28:31,883][36157] Sum rewards: 57.643, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.802', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon5': '0.130', 'AMMO4': '0.146', 'AMMO3': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.420', 'weapon4': '0.494', 'WEAPON3': '1.300', 'weapon3': '2.666', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.441', 'FRAGCOUNT': '50.500'} [2023-02-25 14:28:32,161][36139] DAMAGECOUNT value on done: 1080537.0 [2023-02-25 14:28:32,161][36139] Sum rewards: 49.999, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.503', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon5': '0.130', 'AMMO4': '0.133', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.466', 'weapon4': '0.718', 'WEAPON3': '1.200', 'weapon3': '2.316', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.295', 'FRAGCOUNT': '42.000'} [2023-02-25 14:28:32,193][36157] DAMAGECOUNT value on done: 1087458.0 [2023-02-25 14:28:32,194][36157] Sum rewards: 51.075, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.680', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon5': '0.198', 'AMMO4': '0.208', 'AMMO3': '0.223', 'weapon2': '0.282', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.620', 'WEAPON3': '1.300', 'weapon3': '2.616', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.722', 'FRAGCOUNT': '48.000'} [2023-02-25 14:28:32,235][36140] DAMAGECOUNT value on done: 1083380.0 [2023-02-25 14:28:32,236][36140] Sum rewards: 48.537, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.553', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.082', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'weapon4': '0.232', 'weapon2': '0.254', 'AMMO3': '0.274', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '2.640', 'weapon3': '3.178', 'DAMAGECOUNT': '13.200', 'FRAGCOUNT': '47.000'} [2023-02-25 14:28:32,474][36139] DAMAGECOUNT value on done: 1078967.0 [2023-02-25 14:28:32,475][36139] Sum rewards: 51.629, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.061', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.034', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.114', 'weapon4': '0.126', 'AMMO3': '0.208', 'weapon2': '0.480', 'WEAPON3': '1.300', 'HITCOUNT': '2.850', 'weapon3': '3.080', 'DAMAGECOUNT': '13.029', 'FRAGCOUNT': '45.000'} [2023-02-25 14:28:32,532][36140] DAMAGECOUNT value on done: 1074504.0 [2023-02-25 14:28:32,533][36140] Sum rewards: 60.932, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.520', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.142', 'AMMO3': '0.185', 'weapon5': '0.212', 'WEAPON5': '0.300', 'weapon2': '0.320', 'weapon4': '0.366', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.832', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.195', 'FRAGCOUNT': '52.000'} [2023-02-25 14:28:32,545][36140] DAMAGECOUNT value on done: 1084695.0 [2023-02-25 14:28:32,545][36140] Sum rewards: 54.623, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.458', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.067', 'AMMO3': '0.119', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.286', 'weapon2': '0.586', 'weapon4': '0.652', 'WEAPON3': '0.800', 'weapon3': '2.170', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '13.416', 'FRAGCOUNT': '43.000'} [2023-02-25 14:28:32,612][36138] Updated weights for policy 0, policy_version 51733 (0.0009) [2023-02-25 14:28:32,756][36139] DAMAGECOUNT value on done: 1095596.0 [2023-02-25 14:28:32,757][36139] Sum rewards: 54.827, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.386', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.038', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'AMMO4': '0.190', 'weapon2': '0.196', 'WEAPON4': '0.200', 'weapon5': '0.304', 'WEAPON3': '1.100', 'weapon4': '1.122', 'weapon3': '1.962', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.667', 'FRAGCOUNT': '46.000'} [2023-02-25 14:28:32,850][36140] DAMAGECOUNT value on done: 1074489.0 [2023-02-25 14:28:32,850][36140] Sum rewards: 56.023, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.875', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.104', 'AMMO4': '0.138', 'weapon2': '0.162', 'weapon4': '0.188', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.900', 'weapon3': '3.350', 'DAMAGECOUNT': '14.469', 'FRAGCOUNT': '49.000'} [2023-02-25 14:28:33,081][36139] DAMAGECOUNT value on done: 1085396.0 [2023-02-25 14:28:33,082][36139] Sum rewards: 72.553, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.002', 'AMMO2': '0.010', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'AMMO3': '0.218', 'weapon2': '0.464', 'WEAPON3': '1.250', 'weapon3': '3.382', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '61.000'} [2023-02-25 14:28:34,377][36142] DAMAGECOUNT value on done: 1085074.0 [2023-02-25 14:28:34,378][36142] Sum rewards: 63.773, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.898', 'ARMOR': '0.004', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.116', 'weapon4': '0.118', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'WEAPON5': '0.300', 'weapon2': '0.406', 'WEAPON3': '1.400', 'weapon3': '2.768', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '54.000'} [2023-02-25 14:28:34,682][36142] DAMAGECOUNT value on done: 1067787.0 [2023-02-25 14:28:34,683][36142] Sum rewards: 51.316, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.076', 'ARMOR': '0.004', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon5': '0.036', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'weapon4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'weapon2': '0.432', 'WEAPON3': '1.000', 'HITCOUNT': '2.880', 'weapon3': '3.254', 'DAMAGECOUNT': '13.155', 'FRAGCOUNT': '43.000'} [2023-02-25 14:28:34,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 211927040. Throughput: 0: 3348.8. Samples: 15479284. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:28:34,730][36114] Avg episode reward: [(0, '56.468')] [2023-02-25 14:28:35,110][36142] DAMAGECOUNT value on done: 1083943.0 [2023-02-25 14:28:35,110][36142] Sum rewards: 52.633, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.730', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.067', 'AMMO3': '0.198', 'weapon2': '0.236', 'AMMO4': '0.335', 'weapon5': '0.336', 'weapon4': '0.636', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.406', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.912', 'FRAGCOUNT': '47.000'} [2023-02-25 14:28:35,410][36142] DAMAGECOUNT value on done: 1093350.0 [2023-02-25 14:28:35,410][36142] Sum rewards: 63.634, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.868', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO3': '0.125', 'AMMO4': '0.136', 'weapon5': '0.238', 'WEAPON5': '0.350', 'weapon2': '0.432', 'WEAPON4': '0.450', 'weapon4': '0.830', 'WEAPON3': '0.900', 'weapon3': '2.216', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '51.000'} [2023-02-25 14:28:35,638][36138] Updated weights for policy 0, policy_version 51743 (0.0009) [2023-02-25 14:28:36,571][36156] DAMAGECOUNT value on done: 1095886.0 [2023-02-25 14:28:36,571][36156] Sum rewards: 47.801, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.828', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'weapon2': '0.188', 'AMMO3': '0.212', 'weapon4': '0.240', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '2.770', 'weapon3': '3.340', 'DAMAGECOUNT': '13.167', 'FRAGCOUNT': '43.000'} [2023-02-25 14:28:36,582][36156] DAMAGECOUNT value on done: 1090909.0 [2023-02-25 14:28:36,582][36156] Sum rewards: 49.463, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.403', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'weapon2': '0.164', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon4': '0.338', 'WEAPON3': '1.200', 'HITCOUNT': '2.750', 'weapon3': '3.210', 'DAMAGECOUNT': '12.993', 'FRAGCOUNT': '43.000'} [2023-02-25 14:28:36,891][36156] DAMAGECOUNT value on done: 1080693.0 [2023-02-25 14:28:36,891][36156] Sum rewards: 55.009, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.090', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'weapon2': '0.162', 'AMMO3': '0.167', 'weapon4': '0.604', 'WEAPON3': '1.000', 'weapon3': '2.582', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.217', 'FRAGCOUNT': '45.000'} [2023-02-25 14:28:36,902][36156] DAMAGECOUNT value on done: 1076655.0 [2023-02-25 14:28:36,902][36156] Sum rewards: 52.487, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.035', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.164', 'AMMO3': '0.177', 'AMMO4': '0.206', 'weapon4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '2.640', 'weapon3': '3.036', 'DAMAGECOUNT': '14.247', 'FRAGCOUNT': '45.000'} [2023-02-25 14:28:38,540][36156] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:28:38,687][36138] Updated weights for policy 0, policy_version 51753 (0.0009) [2023-02-25 14:28:39,730][36114] Fps is (10 sec: 13516.1, 60 sec: 13380.2, 300 sec: 13426.5). Total num frames: 211992576. Throughput: 0: 3347.7. Samples: 15489354. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:28:39,730][36114] Avg episode reward: [(0, '56.630')] [2023-02-25 14:28:41,767][36138] Updated weights for policy 0, policy_version 51763 (0.0009) [2023-02-25 14:28:44,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 212058112. Throughput: 0: 3343.3. Samples: 15509386. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:28:44,730][36114] Avg episode reward: [(0, '56.630')] [2023-02-25 14:28:44,836][36138] Updated weights for policy 0, policy_version 51773 (0.0009) [2023-02-25 14:28:47,737][36154] DAMAGECOUNT value on done: 1094306.0 [2023-02-25 14:28:47,738][36154] Sum rewards: 53.215, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.336', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.046', 'weapon2': '0.166', 'weapon5': '0.238', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.560', 'WEAPON3': '1.450', 'weapon3': '2.512', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.402', 'FRAGCOUNT': '48.000'} [2023-02-25 14:28:47,926][36138] Updated weights for policy 0, policy_version 51783 (0.0009) [2023-02-25 14:28:48,021][36154] DAMAGECOUNT value on done: 1092718.0 [2023-02-25 14:28:48,021][36154] Sum rewards: 48.609, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.574', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO3': '0.109', 'AMMO4': '0.137', 'weapon5': '0.140', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.418', 'weapon2': '0.634', 'WEAPON3': '0.700', 'weapon3': '2.632', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.387', 'FRAGCOUNT': '39.000'} [2023-02-25 14:28:48,026][36141] DAMAGECOUNT value on done: 1092570.0 [2023-02-25 14:28:48,026][36141] Sum rewards: 52.527, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.615', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.150', 'AMMO3': '0.152', 'weapon5': '0.206', 'weapon2': '0.524', 'WEAPON3': '1.050', 'HITCOUNT': '2.730', 'weapon3': '2.990', 'DAMAGECOUNT': '13.020', 'FRAGCOUNT': '43.000'} [2023-02-25 14:28:48,059][36154] DAMAGECOUNT value on done: 1077587.0 [2023-02-25 14:28:48,059][36154] Sum rewards: 63.136, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.172', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.210', 'AMMO3': '0.219', 'weapon4': '0.326', 'WEAPON3': '1.350', 'weapon3': '3.090', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.296', 'FRAGCOUNT': '54.000'} [2023-02-25 14:28:48,335][36141] DAMAGECOUNT value on done: 1092600.0 [2023-02-25 14:28:48,335][36141] Sum rewards: 63.759, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.825', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.158', 'weapon5': '0.168', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON3': '0.900', 'weapon4': '0.906', 'weapon3': '2.294', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.768', 'FRAGCOUNT': '52.000'} [2023-02-25 14:28:48,348][36141] DAMAGECOUNT value on done: 1081867.0 [2023-02-25 14:28:48,349][36141] Sum rewards: 49.755, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.380', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.151', 'weapon5': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.284', 'weapon2': '0.410', 'WEAPON3': '0.950', 'HITCOUNT': '2.690', 'weapon3': '2.912', 'DAMAGECOUNT': '12.570', 'FRAGCOUNT': '41.000'} [2023-02-25 14:28:48,351][36154] DAMAGECOUNT value on done: 1088725.0 [2023-02-25 14:28:48,351][36154] Sum rewards: 51.707, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.048', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.119', 'weapon5': '0.162', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.252', 'weapon4': '0.512', 'WEAPON3': '1.250', 'weapon3': '2.830', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '13.890', 'FRAGCOUNT': '45.000'} [2023-02-25 14:28:48,660][36141] DAMAGECOUNT value on done: 1078023.0 [2023-02-25 14:28:48,660][36141] Sum rewards: 58.575, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.440', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'weapon4': '0.386', 'weapon2': '0.502', 'WEAPON3': '1.400', 'weapon3': '2.644', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.225', 'FRAGCOUNT': '51.000'} [2023-02-25 14:28:49,729][36114] Fps is (10 sec: 13107.7, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 212123648. Throughput: 0: 3340.8. Samples: 15529432. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:28:49,730][36114] Avg episode reward: [(0, '56.478')] [2023-02-25 14:28:50,246][36155] DAMAGECOUNT value on done: 1079320.0 [2023-02-25 14:28:50,246][36155] Sum rewards: 52.880, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.433', 'ARMOR': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.061', 'AMMO3': '0.089', 'weapon5': '0.284', 'AMMO4': '0.303', 'WEAPON3': '0.500', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'weapon2': '0.654', 'weapon3': '1.032', 'weapon4': '1.488', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.305', 'FRAGCOUNT': '43.000'} [2023-02-25 14:28:50,557][36155] DAMAGECOUNT value on done: 1085836.0 [2023-02-25 14:28:50,557][36155] Sum rewards: 50.523, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.738', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon5': '0.112', 'AMMO4': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon4': '0.230', 'WEAPON4': '0.350', 'weapon2': '0.438', 'WEAPON3': '1.400', 'weapon3': '2.916', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '45.000'} [2023-02-25 14:28:50,969][36138] Updated weights for policy 0, policy_version 51793 (0.0009) [2023-02-25 14:28:51,068][36157] DAMAGECOUNT value on done: 1097998.0 [2023-02-25 14:28:51,069][36157] Sum rewards: 61.776, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.308', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'weapon5': '0.162', 'AMMO3': '0.173', 'WEAPON4': '0.300', 'weapon2': '0.310', 'weapon4': '0.324', 'WEAPON3': '1.000', 'weapon3': '2.996', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.220', 'FRAGCOUNT': '52.000'} [2023-02-25 14:28:51,400][36157] DAMAGECOUNT value on done: 1086356.0 [2023-02-25 14:28:51,400][36157] Sum rewards: 55.873, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.615', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.122', 'AMMO3': '0.191', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.352', 'weapon4': '0.406', 'WEAPON3': '1.250', 'weapon3': '2.912', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.046', 'FRAGCOUNT': '49.000'} [2023-02-25 14:28:51,608][36155] DAMAGECOUNT value on done: 1102309.0 [2023-02-25 14:28:51,608][36155] Sum rewards: 46.690, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.794', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.112', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'WEAPON4': '0.350', 'weapon2': '0.524', 'weapon4': '0.634', 'WEAPON3': '1.200', 'weapon3': '2.450', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.468', 'FRAGCOUNT': '43.000'} [2023-02-25 14:28:51,930][36155] DAMAGECOUNT value on done: 1081640.0 [2023-02-25 14:28:51,930][36155] Sum rewards: 44.581, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.085', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.182', 'AMMO3': '0.185', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.392', 'ARMOR': '0.400', 'weapon2': '0.650', 'WEAPON3': '1.000', 'HITCOUNT': '2.360', 'weapon3': '2.466', 'DAMAGECOUNT': '11.028', 'FRAGCOUNT': '39.000'} [2023-02-25 14:28:51,998][36157] DAMAGECOUNT value on done: 1097663.0 [2023-02-25 14:28:51,999][36157] Sum rewards: 58.339, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.452', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'weapon4': '0.178', 'weapon2': '0.528', 'WEAPON3': '1.050', 'weapon3': '3.048', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.853', 'FRAGCOUNT': '48.000'} [2023-02-25 14:28:52,224][36139] DAMAGECOUNT value on done: 1084986.0 [2023-02-25 14:28:52,225][36139] Sum rewards: 48.449, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.448', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.182', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.354', 'weapon4': '0.418', 'WEAPON3': '1.250', 'weapon3': '2.814', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.329', 'FRAGCOUNT': '43.000'} [2023-02-25 14:28:52,312][36157] DAMAGECOUNT value on done: 1092309.0 [2023-02-25 14:28:52,312][36157] Sum rewards: 58.237, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.352', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'AMMO3': '0.133', 'weapon5': '0.164', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.544', 'weapon4': '0.656', 'WEAPON3': '0.900', 'weapon3': '2.298', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.553', 'FRAGCOUNT': '47.000'} [2023-02-25 14:28:52,404][36140] DAMAGECOUNT value on done: 1088080.0 [2023-02-25 14:28:52,405][36140] Sum rewards: 50.208, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.699', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO3': '0.169', 'AMMO4': '0.194', 'weapon2': '0.206', 'weapon5': '0.228', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'weapon4': '1.056', 'weapon3': '2.182', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.100', 'FRAGCOUNT': '43.000'} [2023-02-25 14:28:52,546][36139] DAMAGECOUNT value on done: 1083729.0 [2023-02-25 14:28:52,546][36139] Sum rewards: 57.481, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.145', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon2': '0.164', 'AMMO3': '0.170', 'weapon5': '0.194', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon4': '1.068', 'weapon3': '2.200', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.286', 'FRAGCOUNT': '50.000'} [2023-02-25 14:28:52,724][36140] DAMAGECOUNT value on done: 1079814.0 [2023-02-25 14:28:52,725][36140] Sum rewards: 66.267, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.903', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.134', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.438', 'weapon4': '0.508', 'WEAPON3': '1.250', 'weapon3': '2.694', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.930', 'FRAGCOUNT': '57.000'} [2023-02-25 14:28:52,737][36140] DAMAGECOUNT value on done: 1090071.0 [2023-02-25 14:28:52,737][36140] Sum rewards: 66.525, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.756', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.164', 'weapon4': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.000', 'weapon3': '3.118', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.128', 'FRAGCOUNT': '55.000'} [2023-02-25 14:28:52,846][36139] DAMAGECOUNT value on done: 1100056.0 [2023-02-25 14:28:52,847][36139] Sum rewards: 54.184, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.330', 'AMMO2': '0.000', 'AMMO4': '0.001', 'weapon2': '0.126', 'AMMO3': '0.213', 'WEAPON3': '1.250', 'HITCOUNT': '2.790', 'weapon3': '3.754', 'DAMAGECOUNT': '13.380', 'FRAGCOUNT': '46.000'} [2023-02-25 14:28:53,040][36140] DAMAGECOUNT value on done: 1079146.0 [2023-02-25 14:28:53,040][36140] Sum rewards: 53.996, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.131', 'HEALTH': '0.135', 'AMMO3': '0.147', 'weapon5': '0.154', 'WEAPON5': '0.200', 'weapon2': '0.278', 'WEAPON4': '0.300', 'weapon4': '0.720', 'WEAPON3': '0.850', 'weapon3': '2.576', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '13.971', 'FRAGCOUNT': '44.000'} [2023-02-25 14:28:53,141][36139] DAMAGECOUNT value on done: 1090380.0 [2023-02-25 14:28:53,142][36139] Sum rewards: 52.891, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.055', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.078', 'AMMO3': '0.158', 'weapon5': '0.172', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.432', 'weapon4': '0.604', 'WEAPON3': '0.950', 'weapon3': '2.384', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.952', 'FRAGCOUNT': '44.000'} [2023-02-25 14:28:54,097][36138] Updated weights for policy 0, policy_version 51803 (0.0010) [2023-02-25 14:28:54,583][36142] DAMAGECOUNT value on done: 1089287.0 [2023-02-25 14:28:54,584][36142] Sum rewards: 49.887, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.885', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.140', 'AMMO3': '0.175', 'AMMO4': '0.191', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.384', 'weapon4': '0.518', 'WEAPON3': '1.050', 'weapon3': '2.700', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '12.639', 'FRAGCOUNT': '44.000'} [2023-02-25 14:28:54,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 212193280. Throughput: 0: 3338.0. Samples: 15539266. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:28:54,729][36114] Avg episode reward: [(0, '55.884')] [2023-02-25 14:28:54,894][36142] DAMAGECOUNT value on done: 1073532.0 [2023-02-25 14:28:54,894][36142] Sum rewards: 58.012, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.786', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.192', 'AMMO4': '0.217', 'AMMO3': '0.241', 'weapon4': '0.264', 'weapon2': '0.282', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.922', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '52.000'} [2023-02-25 14:28:55,312][36142] DAMAGECOUNT value on done: 1089679.0 [2023-02-25 14:28:55,313][36142] Sum rewards: 66.946, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.619', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon4': '0.094', 'AMMO4': '0.120', 'AMMO3': '0.163', 'weapon5': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.480', 'WEAPON3': '1.150', 'weapon3': '2.988', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '55.000'} [2023-02-25 14:28:55,630][36142] DAMAGECOUNT value on done: 1098168.0 [2023-02-25 14:28:55,630][36142] Sum rewards: 55.143, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.514', 'AMMO2': '0.016', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'AMMO3': '0.205', 'weapon2': '0.212', 'weapon4': '0.392', 'WEAPON3': '1.300', 'weapon3': '3.110', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '14.454', 'FRAGCOUNT': '47.000'} [2023-02-25 14:28:56,756][36156] DAMAGECOUNT value on done: 1101606.0 [2023-02-25 14:28:56,757][36156] Sum rewards: 63.816, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.725', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.092', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'weapon2': '0.188', 'WEAPON4': '0.250', 'AMMO3': '0.270', 'weapon4': '0.482', 'WEAPON3': '1.650', 'weapon3': '2.932', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '57.000'} [2023-02-25 14:28:56,768][36156] DAMAGECOUNT value on done: 1095668.0 [2023-02-25 14:28:56,768][36156] Sum rewards: 57.174, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.030', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.168', 'weapon4': '0.218', 'weapon2': '0.368', 'WEAPON3': '1.100', 'HITCOUNT': '2.880', 'weapon3': '3.120', 'DAMAGECOUNT': '14.142', 'FRAGCOUNT': '47.000'} [2023-02-25 14:28:57,082][36156] DAMAGECOUNT value on done: 1085230.0 [2023-02-25 14:28:57,083][36156] Sum rewards: 52.157, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.454', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.142', 'AMMO4': '0.160', 'weapon2': '0.180', 'AMMO3': '0.233', 'weapon4': '0.246', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.980', 'weapon3': '3.114', 'DAMAGECOUNT': '13.611', 'FRAGCOUNT': '49.000'} [2023-02-25 14:28:57,099][36156] DAMAGECOUNT value on done: 1081988.0 [2023-02-25 14:28:57,100][36156] Sum rewards: 63.545, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.022', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.096', 'AMMO4': '0.149', 'weapon2': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'weapon4': '0.890', 'WEAPON3': '1.400', 'weapon3': '2.578', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '56.000'} [2023-02-25 14:28:57,142][36138] Updated weights for policy 0, policy_version 51813 (0.0009) [2023-02-25 14:28:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 212258816. Throughput: 0: 3344.1. Samples: 15559354. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:28:59,730][36114] Avg episode reward: [(0, '56.254')] [2023-02-25 14:29:00,194][36138] Updated weights for policy 0, policy_version 51823 (0.0009) [2023-02-25 14:29:03,223][36138] Updated weights for policy 0, policy_version 51833 (0.0009) [2023-02-25 14:29:04,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13312.0, 300 sec: 13412.7). Total num frames: 212324352. Throughput: 0: 3341.9. Samples: 15579436. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:29:04,730][36114] Avg episode reward: [(0, '56.254')] [2023-02-25 14:29:06,312][36138] Updated weights for policy 0, policy_version 51843 (0.0010) [2023-02-25 14:29:07,980][36154] DAMAGECOUNT value on done: 1099767.0 [2023-02-25 14:29:07,981][36154] Sum rewards: 63.726, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.437', 'AMMO5': '0.003', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.109', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon4': '0.390', 'weapon2': '0.422', 'WEAPON3': '1.350', 'weapon3': '2.926', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.383', 'FRAGCOUNT': '54.000'} [2023-02-25 14:29:08,186][36141] DAMAGECOUNT value on done: 1097097.0 [2023-02-25 14:29:08,187][36141] Sum rewards: 47.875, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.606', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO3': '0.137', 'AMMO4': '0.184', 'weapon5': '0.226', 'weapon2': '0.410', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.692', 'WEAPON3': '0.850', 'weapon3': '2.358', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '13.581', 'FRAGCOUNT': '40.000'} [2023-02-25 14:29:08,265][36154] DAMAGECOUNT value on done: 1098300.0 [2023-02-25 14:29:08,266][36154] Sum rewards: 57.701, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.642', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.150', 'AMMO4': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.234', 'AMMO3': '0.264', 'weapon2': '0.296', 'WEAPON3': '1.650', 'weapon3': '3.046', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '50.000'} [2023-02-25 14:29:08,303][36154] DAMAGECOUNT value on done: 1082369.0 [2023-02-25 14:29:08,303][36154] Sum rewards: 56.210, reward structure: {'DEATHCOUNT': '-12.000', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO3': '0.109', 'AMMO4': '0.160', 'weapon5': '0.186', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HEALTH': '0.576', 'WEAPON3': '0.600', 'weapon4': '0.616', 'weapon2': '0.942', 'weapon3': '2.024', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.346', 'FRAGCOUNT': '45.000'} [2023-02-25 14:29:08,493][36141] DAMAGECOUNT value on done: 1087327.0 [2023-02-25 14:29:08,493][36141] Sum rewards: 62.741, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.450', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.118', 'AMMO4': '0.123', 'weapon4': '0.168', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.408', 'WEAPON3': '1.400', 'weapon3': '3.042', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '54.000'} [2023-02-25 14:29:08,513][36141] DAMAGECOUNT value on done: 1097253.0 [2023-02-25 14:29:08,514][36141] Sum rewards: 52.954, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.470', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.037', 'AMMO3': '0.111', 'AMMO4': '0.185', 'weapon5': '0.228', 'WEAPON5': '0.450', 'weapon2': '0.474', 'WEAPON4': '0.550', 'WEAPON3': '0.800', 'weapon4': '1.016', 'weapon3': '1.906', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.959', 'FRAGCOUNT': '44.000'} [2023-02-25 14:29:08,572][36154] DAMAGECOUNT value on done: 1093688.0 [2023-02-25 14:29:08,573][36154] Sum rewards: 58.039, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.330', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.131', 'weapon4': '0.172', 'WEAPON4': '0.200', 'AMMO3': '0.244', 'weapon2': '0.386', 'WEAPON3': '1.350', 'HITCOUNT': '3.000', 'weapon3': '3.012', 'DAMAGECOUNT': '14.889', 'FRAGCOUNT': '52.000'} [2023-02-25 14:29:08,801][36141] DAMAGECOUNT value on done: 1082849.0 [2023-02-25 14:29:08,801][36141] Sum rewards: 60.893, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.912', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.128', 'AMMO4': '0.145', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.438', 'weapon2': '0.486', 'WEAPON3': '1.100', 'weapon3': '2.660', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.478', 'FRAGCOUNT': '53.000'} [2023-02-25 14:29:09,335][36138] Updated weights for policy 0, policy_version 51853 (0.0009) [2023-02-25 14:29:09,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 212393984. Throughput: 0: 3339.2. Samples: 15589404. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:29:09,730][36114] Avg episode reward: [(0, '56.513')] [2023-02-25 14:29:10,518][36155] DAMAGECOUNT value on done: 1083891.0 [2023-02-25 14:29:10,518][36155] Sum rewards: 43.911, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.110', 'ARMOR': '0.008', 'AMMO5': '0.043', 'AMMO2': '0.105', 'AMMO3': '0.143', 'weapon2': '0.392', 'weapon5': '0.434', 'AMMO4': '0.526', 'WEAPON3': '0.900', 'WEAPON5': '0.900', 'WEAPON4': '1.000', 'weapon4': '1.104', 'weapon3': '1.518', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '13.398', 'FRAGCOUNT': '41.000'} [2023-02-25 14:29:10,830][36155] DAMAGECOUNT value on done: 1091216.0 [2023-02-25 14:29:10,830][36155] Sum rewards: 55.657, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.258', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.172', 'AMMO3': '0.221', 'weapon5': '0.302', 'weapon2': '0.308', 'weapon4': '0.400', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.656', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '48.000'} [2023-02-25 14:29:11,200][36157] DAMAGECOUNT value on done: 1102395.0 [2023-02-25 14:29:11,200][36157] Sum rewards: 46.822, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.930', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon4': '0.134', 'weapon5': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon2': '0.518', 'WEAPON3': '1.500', 'weapon3': '2.818', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.191', 'FRAGCOUNT': '44.000'} [2023-02-25 14:29:11,502][36157] DAMAGECOUNT value on done: 1092553.0 [2023-02-25 14:29:11,502][36157] Sum rewards: 70.943, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.954', 'AMMO5': '0.013', 'AMMO2': '0.056', 'AMMO3': '0.159', 'weapon5': '0.230', 'AMMO4': '0.280', 'WEAPON5': '0.350', 'weapon2': '0.422', 'WEAPON4': '0.450', 'weapon4': '0.820', 'WEAPON3': '0.950', 'weapon3': '2.246', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.591', 'FRAGCOUNT': '58.000'} [2023-02-25 14:29:11,847][36155] DAMAGECOUNT value on done: 1107485.0 [2023-02-25 14:29:11,848][36155] Sum rewards: 61.034, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.960', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.169', 'AMMO3': '0.183', 'weapon5': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.442', 'weapon4': '0.572', 'WEAPON3': '1.150', 'weapon3': '2.486', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.528', 'FRAGCOUNT': '52.000'} [2023-02-25 14:29:12,127][36157] DAMAGECOUNT value on done: 1102923.0 [2023-02-25 14:29:12,127][36157] Sum rewards: 62.277, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.368', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.066', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.159', 'weapon2': '0.320', 'weapon4': '0.416', 'WEAPON3': '1.050', 'weapon3': '2.706', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.780', 'FRAGCOUNT': '50.000'} [2023-02-25 14:29:12,149][36139] DAMAGECOUNT value on done: 1090238.0 [2023-02-25 14:29:12,150][36139] Sum rewards: 61.884, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.114', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.170', 'AMMO3': '0.256', 'weapon2': '0.346', 'WEAPON3': '1.450', 'weapon3': '3.152', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '54.000'} [2023-02-25 14:29:12,157][36155] DAMAGECOUNT value on done: 1087007.0 [2023-02-25 14:29:12,158][36155] Sum rewards: 59.366, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.060', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO4': '0.183', 'AMMO3': '0.194', 'weapon5': '0.202', 'weapon4': '0.332', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.624', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '16.044', 'FRAGCOUNT': '51.000'} [2023-02-25 14:29:12,293][36140] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:29:12,429][36138] Updated weights for policy 0, policy_version 51863 (0.0009) [2023-02-25 14:29:12,441][36157] DAMAGECOUNT value on done: 1097290.0 [2023-02-25 14:29:12,441][36157] Sum rewards: 57.437, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.730', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.140', 'AMMO3': '0.168', 'AMMO4': '0.183', 'weapon2': '0.326', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.472', 'WEAPON3': '1.100', 'weapon3': '2.684', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.943', 'FRAGCOUNT': '49.000'} [2023-02-25 14:29:12,460][36139] DAMAGECOUNT value on done: 1089599.0 [2023-02-25 14:29:12,460][36139] Sum rewards: 67.857, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.857', 'ARMOR': '0.008', 'AMMO5': '0.025', 'AMMO2': '0.044', 'AMMO3': '0.176', 'weapon5': '0.190', 'weapon2': '0.196', 'AMMO4': '0.220', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon4': '0.680', 'WEAPON3': '1.150', 'weapon3': '2.524', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '58.000'} [2023-02-25 14:29:12,484][36140] DAMAGECOUNT value on done: 1092746.0 [2023-02-25 14:29:12,485][36140] Sum rewards: 49.291, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.860', 'AMMO5': '0.019', 'AMMO2': '0.071', 'AMMO3': '0.152', 'weapon5': '0.266', 'weapon2': '0.316', 'AMMO4': '0.356', 'ARMOR': '0.446', 'WEAPON5': '0.500', 'WEAPON4': '0.800', 'weapon4': '0.928', 'WEAPON3': '0.950', 'weapon3': '2.194', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.962', 'FRAGCOUNT': '44.000'} [2023-02-25 14:29:12,783][36139] DAMAGECOUNT value on done: 1105187.0 [2023-02-25 14:29:12,783][36139] Sum rewards: 56.964, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.755', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.094', 'AMMO4': '0.149', 'weapon2': '0.188', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.356', 'WEAPON3': '1.300', 'weapon3': '3.110', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.393', 'FRAGCOUNT': '50.000'} [2023-02-25 14:29:12,789][36140] DAMAGECOUNT value on done: 1084388.0 [2023-02-25 14:29:12,790][36140] Sum rewards: 56.474, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.110', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'weapon2': '0.270', 'weapon4': '0.298', 'WEAPON3': '1.050', 'HITCOUNT': '3.070', 'weapon3': '3.120', 'DAMAGECOUNT': '13.722', 'FRAGCOUNT': '48.000'} [2023-02-25 14:29:12,802][36140] DAMAGECOUNT value on done: 1095970.0 [2023-02-25 14:29:12,802][36140] Sum rewards: 68.294, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.265', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.154', 'weapon2': '0.172', 'AMMO3': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.560', 'WEAPON3': '1.600', 'weapon3': '2.778', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '61.000'} [2023-02-25 14:29:13,082][36139] DAMAGECOUNT value on done: 1095551.0 [2023-02-25 14:29:13,082][36139] Sum rewards: 59.223, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.912', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO3': '0.161', 'AMMO4': '0.162', 'weapon5': '0.224', 'weapon2': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.724', 'WEAPON3': '0.950', 'weapon3': '2.176', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '51.000'} [2023-02-25 14:29:13,114][36140] DAMAGECOUNT value on done: 1085303.0 [2023-02-25 14:29:13,114][36140] Sum rewards: 67.480, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.350', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.039', 'AMMO3': '0.191', 'AMMO4': '0.194', 'weapon5': '0.218', 'weapon2': '0.402', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.764', 'WEAPON3': '1.150', 'weapon3': '2.292', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '57.000'} [2023-02-25 14:29:14,721][36142] DAMAGECOUNT value on done: 1094266.0 [2023-02-25 14:29:14,721][36142] Sum rewards: 59.236, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.195', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.070', 'AMMO4': '0.081', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'weapon2': '0.392', 'weapon4': '0.412', 'WEAPON3': '1.100', 'weapon3': '2.888', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.937', 'FRAGCOUNT': '49.000'} [2023-02-25 14:29:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 212459520. Throughput: 0: 3340.4. Samples: 15609430. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:29:14,730][36114] Avg episode reward: [(0, '56.734')] [2023-02-25 14:29:15,028][36142] DAMAGECOUNT value on done: 1079200.0 [2023-02-25 14:29:15,028][36142] Sum rewards: 63.114, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.905', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.112', 'AMMO4': '0.217', 'AMMO3': '0.218', 'weapon2': '0.242', 'WEAPON5': '0.250', 'weapon4': '0.298', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.094', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.004', 'FRAGCOUNT': '55.000'} [2023-02-25 14:29:15,471][36142] DAMAGECOUNT value on done: 1093984.0 [2023-02-25 14:29:15,472][36142] Sum rewards: 47.757, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.930', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.052', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.171', 'weapon4': '0.264', 'weapon2': '0.268', 'WEAPON3': '1.100', 'HITCOUNT': '2.870', 'weapon3': '3.280', 'DAMAGECOUNT': '12.915', 'FRAGCOUNT': '39.000'} [2023-02-25 14:29:15,536][36138] Updated weights for policy 0, policy_version 51873 (0.0009) [2023-02-25 14:29:15,766][36142] DAMAGECOUNT value on done: 1102817.0 [2023-02-25 14:29:15,766][36142] Sum rewards: 55.504, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.064', 'ARMOR': '0.004', 'AMMO5': '0.026', 'AMMO2': '0.052', 'weapon5': '0.188', 'AMMO3': '0.189', 'AMMO4': '0.261', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon2': '0.686', 'weapon4': '0.688', 'WEAPON3': '1.050', 'weapon3': '2.146', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.947', 'FRAGCOUNT': '49.000'} [2023-02-25 14:29:16,954][36156] DAMAGECOUNT value on done: 1106311.0 [2023-02-25 14:29:16,954][36156] Sum rewards: 50.424, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.292', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.158', 'AMMO4': '0.181', 'AMMO3': '0.237', 'weapon4': '0.308', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.452', 'WEAPON3': '1.450', 'weapon3': '2.802', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.115', 'FRAGCOUNT': '46.000'} [2023-02-25 14:29:16,965][36156] DAMAGECOUNT value on done: 1100415.0 [2023-02-25 14:29:16,966][36156] Sum rewards: 49.730, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.340', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.064', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'weapon4': '0.370', 'weapon2': '0.374', 'WEAPON3': '1.400', 'weapon3': '2.916', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.241', 'FRAGCOUNT': '44.000'} [2023-02-25 14:29:17,280][36156] DAMAGECOUNT value on done: 1089290.0 [2023-02-25 14:29:17,280][36156] Sum rewards: 42.114, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.934', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO4': '0.176', 'AMMO3': '0.243', 'weapon5': '0.264', 'weapon2': '0.318', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '1.142', 'WEAPON3': '1.450', 'weapon3': '1.886', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '12.180', 'FRAGCOUNT': '39.000'} [2023-02-25 14:29:17,290][36156] DAMAGECOUNT value on done: 1086420.0 [2023-02-25 14:29:17,291][36156] Sum rewards: 45.863, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.350', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon4': '0.386', 'weapon2': '0.604', 'WEAPON3': '1.400', 'weapon3': '2.546', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.296', 'FRAGCOUNT': '42.000'} [2023-02-25 14:29:17,342][36140] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:29:18,565][36138] Updated weights for policy 0, policy_version 51883 (0.0009) [2023-02-25 14:29:19,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 212525056. Throughput: 0: 3337.4. Samples: 15629468. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:29:19,730][36114] Avg episode reward: [(0, '56.469')] [2023-02-25 14:29:19,736][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000051886_212525056.pth... [2023-02-25 14:29:19,791][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000051101_209309696.pth [2023-02-25 14:29:21,632][36138] Updated weights for policy 0, policy_version 51893 (0.0009) [2023-02-25 14:29:24,723][36138] Updated weights for policy 0, policy_version 51903 (0.0009) [2023-02-25 14:29:24,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 212594688. Throughput: 0: 3334.6. Samples: 15639410. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:29:24,730][36114] Avg episode reward: [(0, '56.469')] [2023-02-25 14:29:27,793][36138] Updated weights for policy 0, policy_version 51913 (0.0009) [2023-02-25 14:29:28,141][36154] DAMAGECOUNT value on done: 1104738.0 [2023-02-25 14:29:28,142][36154] Sum rewards: 57.475, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.090', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'AMMO3': '0.242', 'weapon4': '0.304', 'weapon2': '0.342', 'WEAPON3': '1.450', 'weapon3': '3.154', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.913', 'FRAGCOUNT': '50.500'} [2023-02-25 14:29:28,436][36141] DAMAGECOUNT value on done: 1101611.0 [2023-02-25 14:29:28,436][36141] Sum rewards: 49.434, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.580', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.181', 'AMMO3': '0.232', 'weapon4': '0.270', 'WEAPON4': '0.350', 'weapon2': '0.626', 'WEAPON3': '1.450', 'weapon3': '2.828', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.542', 'FRAGCOUNT': '46.000'} [2023-02-25 14:29:28,437][36154] DAMAGECOUNT value on done: 1103169.0 [2023-02-25 14:29:28,437][36154] Sum rewards: 55.140, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.730', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.154', 'AMMO3': '0.203', 'WEAPON4': '0.350', 'weapon4': '0.506', 'weapon2': '0.590', 'WEAPON3': '1.150', 'weapon3': '2.708', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.607', 'FRAGCOUNT': '47.000'} [2023-02-25 14:29:28,478][36154] DAMAGECOUNT value on done: 1087389.0 [2023-02-25 14:29:28,479][36154] Sum rewards: 65.639, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.458', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'AMMO4': '0.161', 'weapon2': '0.176', 'WEAPON4': '0.200', 'weapon4': '0.860', 'WEAPON3': '1.000', 'weapon3': '2.586', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '55.000'} [2023-02-25 14:29:28,739][36141] DAMAGECOUNT value on done: 1091752.0 [2023-02-25 14:29:28,740][36141] Sum rewards: 53.655, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.950', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon5': '0.154', 'AMMO3': '0.172', 'AMMO4': '0.176', 'weapon4': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.436', 'WEAPON3': '1.150', 'weapon3': '2.904', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.260', 'FRAGCOUNT': '47.000'} [2023-02-25 14:29:28,760][36141] DAMAGECOUNT value on done: 1101589.0 [2023-02-25 14:29:28,760][36141] Sum rewards: 47.968, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.190', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.114', 'AMMO3': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.376', 'weapon2': '0.554', 'WEAPON3': '1.150', 'weapon3': '2.738', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.008', 'FRAGCOUNT': '42.000'} [2023-02-25 14:29:28,775][36154] DAMAGECOUNT value on done: 1098350.0 [2023-02-25 14:29:28,775][36154] Sum rewards: 56.847, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.955', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.036', 'AMMO3': '0.137', 'weapon5': '0.140', 'AMMO4': '0.181', 'WEAPON5': '0.300', 'WEAPON4': '0.550', 'weapon2': '0.630', 'weapon4': '0.676', 'WEAPON3': '0.800', 'weapon3': '2.314', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.986', 'FRAGCOUNT': '48.000'} [2023-02-25 14:29:29,061][36141] DAMAGECOUNT value on done: 1088093.0 [2023-02-25 14:29:29,062][36141] Sum rewards: 60.894, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.262', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon5': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.269', 'weapon2': '0.450', 'weapon4': '0.592', 'WEAPON3': '1.600', 'weapon3': '2.646', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '55.000'} [2023-02-25 14:29:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 212660224. Throughput: 0: 3334.6. Samples: 15659442. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:29:29,729][36114] Avg episode reward: [(0, '56.313')] [2023-02-25 14:29:30,691][36155] DAMAGECOUNT value on done: 1089663.0 [2023-02-25 14:29:30,692][36155] Sum rewards: 72.564, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.677', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.051', 'AMMO3': '0.167', 'weapon5': '0.188', 'AMMO4': '0.254', 'weapon2': '0.320', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.676', 'WEAPON3': '0.950', 'weapon3': '2.548', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.316', 'FRAGCOUNT': '60.000'} [2023-02-25 14:29:30,845][36138] Updated weights for policy 0, policy_version 51923 (0.0009) [2023-02-25 14:29:31,003][36155] DAMAGECOUNT value on done: 1096894.0 [2023-02-25 14:29:31,004][36155] Sum rewards: 68.247, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.647', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon5': '0.178', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.322', 'weapon4': '0.336', 'WEAPON3': '1.300', 'weapon3': '2.938', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '58.000'} [2023-02-25 14:29:31,415][36157] DAMAGECOUNT value on done: 1107505.0 [2023-02-25 14:29:31,416][36157] Sum rewards: 59.386, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.160', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon5': '0.030', 'AMMO4': '0.120', 'AMMO3': '0.167', 'WEAPON5': '0.250', 'weapon4': '0.310', 'WEAPON4': '0.350', 'weapon2': '0.436', 'WEAPON3': '1.050', 'weapon3': '2.974', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '50.000'} [2023-02-25 14:29:31,743][36157] DAMAGECOUNT value on done: 1097076.0 [2023-02-25 14:29:31,744][36157] Sum rewards: 48.971, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.256', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.144', 'AMMO4': '0.197', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.360', 'weapon4': '0.720', 'WEAPON3': '1.300', 'weapon3': '2.480', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.569', 'FRAGCOUNT': '44.000'} [2023-02-25 14:29:32,002][36155] DAMAGECOUNT value on done: 1112245.0 [2023-02-25 14:29:32,003][36155] Sum rewards: 58.357, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.342', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.046', 'AMMO3': '0.158', 'weapon5': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.354', 'weapon4': '0.626', 'WEAPON3': '1.050', 'weapon3': '2.602', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.280', 'FRAGCOUNT': '48.000'} [2023-02-25 14:29:32,224][36139] DAMAGECOUNT value on done: 1095924.0 [2023-02-25 14:29:32,225][36139] Sum rewards: 63.929, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.045', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.174', 'weapon2': '0.182', 'AMMO3': '0.186', 'AMMO4': '0.222', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.574', 'WEAPON3': '1.050', 'weapon3': '2.832', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '54.000'} [2023-02-25 14:29:32,326][36155] DAMAGECOUNT value on done: 1091680.0 [2023-02-25 14:29:32,327][36155] Sum rewards: 51.863, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.530', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.098', 'AMMO4': '0.160', 'weapon5': '0.164', 'AMMO3': '0.190', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.728', 'WEAPON3': '1.200', 'HITCOUNT': '2.740', 'weapon3': '2.772', 'DAMAGECOUNT': '13.599', 'FRAGCOUNT': '47.000'} [2023-02-25 14:29:32,373][36157] DAMAGECOUNT value on done: 1107797.0 [2023-02-25 14:29:32,374][36157] Sum rewards: 62.794, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.378', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.130', 'AMMO4': '0.139', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon4': '0.384', 'weapon2': '0.470', 'WEAPON3': '1.200', 'weapon3': '2.788', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.622', 'FRAGCOUNT': '55.000'} [2023-02-25 14:29:32,543][36139] DAMAGECOUNT value on done: 1093698.0 [2023-02-25 14:29:32,544][36139] Sum rewards: 48.573, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.747', 'AMMO2': '0.005', 'AMMO4': '0.027', 'WEAPON4': '0.100', 'AMMO3': '0.191', 'weapon4': '0.324', 'weapon2': '0.478', 'WEAPON3': '1.050', 'HITCOUNT': '2.770', 'weapon3': '3.078', 'DAMAGECOUNT': '12.297', 'FRAGCOUNT': '41.000'} [2023-02-25 14:29:32,551][36140] DAMAGECOUNT value on done: 1097958.0 [2023-02-25 14:29:32,552][36140] Sum rewards: 63.201, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.498', 'AMMO5': '0.004', 'AMMO2': '0.012', 'weapon4': '0.014', 'weapon5': '0.026', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.231', 'weapon2': '0.328', 'WEAPON3': '1.300', 'weapon3': '3.436', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '54.000'} [2023-02-25 14:29:32,688][36157] DAMAGECOUNT value on done: 1102444.0 [2023-02-25 14:29:32,689][36157] Sum rewards: 59.975, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.123', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.062', 'weapon5': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'WEAPON5': '0.250', 'weapon2': '0.340', 'weapon4': '0.376', 'WEAPON3': '1.150', 'weapon3': '2.982', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.462', 'FRAGCOUNT': '49.000'} [2023-02-25 14:29:32,857][36140] DAMAGECOUNT value on done: 1101021.0 [2023-02-25 14:29:32,858][36140] Sum rewards: 55.235, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.160', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon5': '0.128', 'AMMO4': '0.151', 'AMMO3': '0.199', 'weapon2': '0.228', 'weapon4': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.124', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.153', 'FRAGCOUNT': '48.000'} [2023-02-25 14:29:32,876][36139] DAMAGECOUNT value on done: 1110310.0 [2023-02-25 14:29:32,876][36139] Sum rewards: 63.151, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.276', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.086', 'weapon4': '0.190', 'AMMO3': '0.207', 'weapon2': '0.448', 'WEAPON3': '1.300', 'weapon3': '3.080', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.369', 'FRAGCOUNT': '53.000'} [2023-02-25 14:29:32,878][36140] DAMAGECOUNT value on done: 1089725.0 [2023-02-25 14:29:32,878][36140] Sum rewards: 53.605, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.260', 'AMMO5': '0.018', 'AMMO2': '0.053', 'weapon5': '0.218', 'AMMO3': '0.227', 'AMMO4': '0.264', 'weapon4': '0.302', 'weapon2': '0.490', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.672', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '16.011', 'FRAGCOUNT': '47.000'} [2023-02-25 14:29:33,180][36140] DAMAGECOUNT value on done: 1090866.0 [2023-02-25 14:29:33,180][36140] Sum rewards: 67.282, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.285', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.096', 'AMMO4': '0.149', 'AMMO3': '0.158', 'weapon4': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.390', 'ARMOR': '0.400', 'WEAPON3': '1.000', 'weapon3': '2.916', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.122', 'FRAGCOUNT': '56.000'} [2023-02-25 14:29:33,199][36139] DAMAGECOUNT value on done: 1100735.0 [2023-02-25 14:29:33,200][36139] Sum rewards: 56.933, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.930', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon5': '0.144', 'AMMO3': '0.190', 'AMMO4': '0.213', 'weapon2': '0.338', 'weapon4': '0.440', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.756', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.138', 'FRAGCOUNT': '51.000'} [2023-02-25 14:29:33,975][36138] Updated weights for policy 0, policy_version 51933 (0.0009) [2023-02-25 14:29:34,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13312.0, 300 sec: 13398.8). Total num frames: 212725760. Throughput: 0: 3330.7. Samples: 15679312. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:29:34,729][36114] Avg episode reward: [(0, '56.809')] [2023-02-25 14:29:34,866][36142] DAMAGECOUNT value on done: 1099015.0 [2023-02-25 14:29:34,866][36142] Sum rewards: 59.557, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.690', 'AMMO5': '0.016', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.121', 'weapon5': '0.138', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'ARMOR': '0.457', 'weapon2': '0.468', 'weapon4': '0.494', 'WEAPON3': '0.750', 'weapon3': '2.282', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.247', 'FRAGCOUNT': '48.000'} [2023-02-25 14:29:35,188][36142] DAMAGECOUNT value on done: 1084062.0 [2023-02-25 14:29:35,189][36142] Sum rewards: 57.015, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.800', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.154', 'AMMO3': '0.163', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.338', 'weapon2': '0.388', 'WEAPON3': '0.900', 'weapon3': '2.968', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.190', 'FRAGCOUNT': '47.000'} [2023-02-25 14:29:35,654][36142] DAMAGECOUNT value on done: 1098251.0 [2023-02-25 14:29:35,655][36142] Sum rewards: 49.021, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.355', 'AMMO5': '0.011', 'AMMO2': '0.035', 'AMMO3': '0.170', 'AMMO4': '0.176', 'weapon5': '0.188', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.398', 'weapon2': '0.404', 'WEAPON3': '1.100', 'weapon3': '2.822', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.801', 'FRAGCOUNT': '42.500'} [2023-02-25 14:29:35,959][36142] DAMAGECOUNT value on done: 1106651.0 [2023-02-25 14:29:35,960][36142] Sum rewards: 40.678, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.622', 'AMMO5': '0.013', 'ARMOR': '0.016', 'AMMO2': '0.043', 'AMMO3': '0.143', 'weapon5': '0.210', 'AMMO4': '0.215', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '0.800', 'weapon4': '0.894', 'weapon2': '0.904', 'weapon3': '1.600', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '11.502', 'FRAGCOUNT': '35.000'} [2023-02-25 14:29:37,030][36138] Updated weights for policy 0, policy_version 51943 (0.0009) [2023-02-25 14:29:37,181][36156] DAMAGECOUNT value on done: 1111391.0 [2023-02-25 14:29:37,181][36156] Sum rewards: 56.710, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.620', 'AMMO5': '0.015', 'AMMO2': '0.026', 'weapon4': '0.088', 'weapon5': '0.126', 'AMMO4': '0.128', 'weapon2': '0.248', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '3.270', 'weapon3': '3.280', 'DAMAGECOUNT': '15.240', 'FRAGCOUNT': '51.000'} [2023-02-25 14:29:37,233][36156] DAMAGECOUNT value on done: 1106573.0 [2023-02-25 14:29:37,234][36156] Sum rewards: 62.972, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.476', 'AMMO5': '0.015', 'AMMO2': '0.058', 'weapon5': '0.218', 'weapon4': '0.230', 'AMMO3': '0.231', 'AMMO4': '0.292', 'weapon2': '0.426', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.810', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '56.000'} [2023-02-25 14:29:37,496][36156] DAMAGECOUNT value on done: 1094680.0 [2023-02-25 14:29:37,496][36156] Sum rewards: 61.524, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.614', 'AMMO5': '0.014', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon5': '0.188', 'AMMO3': '0.229', 'weapon2': '0.258', 'weapon4': '0.308', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.956', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '55.000'} [2023-02-25 14:29:37,553][36156] DAMAGECOUNT value on done: 1091632.0 [2023-02-25 14:29:37,554][36156] Sum rewards: 57.297, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.835', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.170', 'weapon2': '0.204', 'AMMO3': '0.247', 'weapon4': '0.358', 'WEAPON3': '1.550', 'weapon3': '3.178', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '49.000'} [2023-02-25 14:29:39,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13312.1, 300 sec: 13398.8). Total num frames: 212791296. Throughput: 0: 3335.9. Samples: 15689380. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:29:39,730][36114] Avg episode reward: [(0, '56.563')] [2023-02-25 14:29:40,067][36138] Updated weights for policy 0, policy_version 51953 (0.0009) [2023-02-25 14:29:41,253][36157] Large shaping reward 2.570 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.06, -20.0)] [2023-02-25 14:29:43,114][36138] Updated weights for policy 0, policy_version 51963 (0.0009) [2023-02-25 14:29:44,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 212860928. Throughput: 0: 3336.8. Samples: 15709512. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:29:44,730][36114] Avg episode reward: [(0, '56.563')] [2023-02-25 14:29:46,155][36138] Updated weights for policy 0, policy_version 51973 (0.0010) [2023-02-25 14:29:48,382][36154] DAMAGECOUNT value on done: 1109825.0 [2023-02-25 14:29:48,383][36154] Sum rewards: 59.220, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.724', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon4': '0.272', 'weapon2': '0.460', 'WEAPON3': '1.350', 'weapon3': '2.782', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.261', 'FRAGCOUNT': '51.000'} [2023-02-25 14:29:48,596][36141] DAMAGECOUNT value on done: 1107462.0 [2023-02-25 14:29:48,597][36141] Sum rewards: 72.900, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.320', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'weapon2': '0.342', 'weapon4': '0.468', 'WEAPON3': '1.150', 'weapon3': '2.942', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '60.000'} [2023-02-25 14:29:48,641][36154] DAMAGECOUNT value on done: 1108915.0 [2023-02-25 14:29:48,641][36154] Sum rewards: 67.363, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.086', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.162', 'AMMO3': '0.177', 'WEAPON4': '0.300', 'weapon2': '0.334', 'weapon4': '0.344', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '2.840', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '54.000'} [2023-02-25 14:29:48,703][36154] DAMAGECOUNT value on done: 1092182.0 [2023-02-25 14:29:48,704][36154] Sum rewards: 53.047, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.777', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.038', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'weapon2': '0.466', 'WEAPON3': '1.150', 'HITCOUNT': '3.140', 'weapon3': '3.330', 'DAMAGECOUNT': '14.049', 'FRAGCOUNT': '44.000'} [2023-02-25 14:29:48,885][36141] DAMAGECOUNT value on done: 1097033.0 [2023-02-25 14:29:48,886][36141] Sum rewards: 57.016, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.602', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon5': '0.166', 'weapon4': '0.234', 'AMMO3': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.480', 'WEAPON3': '1.400', 'weapon3': '2.836', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.777', 'FRAGCOUNT': '51.000'} [2023-02-25 14:29:48,906][36141] DAMAGECOUNT value on done: 1106990.0 [2023-02-25 14:29:48,906][36141] Sum rewards: 59.158, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.080', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon2': '0.146', 'weapon5': '0.154', 'AMMO4': '0.213', 'weapon4': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.286', 'WEAPON3': '1.650', 'HITCOUNT': '3.090', 'weapon3': '3.210', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '53.000'} [2023-02-25 14:29:48,960][36154] DAMAGECOUNT value on done: 1102788.0 [2023-02-25 14:29:48,960][36154] Sum rewards: 56.872, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.676', 'AMMO5': '0.019', 'AMMO2': '0.045', 'weapon5': '0.164', 'AMMO3': '0.194', 'AMMO4': '0.224', 'weapon4': '0.294', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.674', 'WEAPON3': '1.150', 'weapon3': '2.590', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '13.314', 'FRAGCOUNT': '52.000'} [2023-02-25 14:29:49,207][36141] DAMAGECOUNT value on done: 1092896.0 [2023-02-25 14:29:49,208][36141] Sum rewards: 50.705, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.135', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.065', 'AMMO3': '0.161', 'weapon2': '0.188', 'AMMO4': '0.324', 'weapon5': '0.348', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '0.900', 'weapon4': '1.008', 'weapon3': '2.116', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.409', 'FRAGCOUNT': '44.000'} [2023-02-25 14:29:49,261][36138] Updated weights for policy 0, policy_version 51983 (0.0009) [2023-02-25 14:29:49,483][36156] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:29:49,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 212926464. Throughput: 0: 3334.9. Samples: 15729508. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:29:49,730][36114] Avg episode reward: [(0, '57.104')] [2023-02-25 14:29:50,940][36155] DAMAGECOUNT value on done: 1095159.0 [2023-02-25 14:29:50,941][36155] Sum rewards: 66.397, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.868', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.144', 'AMMO3': '0.167', 'AMMO4': '0.185', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.370', 'weapon2': '0.468', 'WEAPON3': '1.000', 'weapon3': '2.780', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '56.000'} [2023-02-25 14:29:51,231][36155] DAMAGECOUNT value on done: 1101724.0 [2023-02-25 14:29:51,231][36155] Sum rewards: 56.812, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.100', 'AMMO5': '0.013', 'AMMO2': '0.043', 'AMMO3': '0.157', 'AMMO4': '0.215', 'weapon5': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.464', 'weapon4': '0.684', 'WEAPON3': '0.950', 'weapon3': '2.278', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.490', 'FRAGCOUNT': '48.000'} [2023-02-25 14:29:51,476][36157] DAMAGECOUNT value on done: 1111985.0 [2023-02-25 14:29:51,477][36157] Sum rewards: 49.415, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.540', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO3': '0.148', 'AMMO4': '0.186', 'weapon5': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.424', 'weapon4': '0.554', 'WEAPON3': '0.850', 'weapon3': '2.456', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.440', 'FRAGCOUNT': '39.000'} [2023-02-25 14:29:51,785][36157] DAMAGECOUNT value on done: 1101445.0 [2023-02-25 14:29:51,786][36157] Sum rewards: 50.687, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.364', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon2': '0.172', 'AMMO3': '0.184', 'weapon5': '0.188', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.906', 'WEAPON3': '1.150', 'weapon3': '2.290', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.107', 'FRAGCOUNT': '44.000'} [2023-02-25 14:29:52,128][36139] DAMAGECOUNT value on done: 1100193.0 [2023-02-25 14:29:52,129][36139] Sum rewards: 51.007, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.328', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.009', 'weapon5': '0.014', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.193', 'weapon4': '0.226', 'weapon2': '0.366', 'WEAPON3': '1.200', 'HITCOUNT': '3.130', 'weapon3': '3.240', 'DAMAGECOUNT': '12.807', 'FRAGCOUNT': '43.000'} [2023-02-25 14:29:52,235][36155] DAMAGECOUNT value on done: 1117293.0 [2023-02-25 14:29:52,235][36155] Sum rewards: 62.757, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.058', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon4': '0.178', 'weapon5': '0.180', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.250', 'HITCOUNT': '2.930', 'weapon3': '3.018', 'DAMAGECOUNT': '15.129', 'FRAGCOUNT': '55.000'} [2023-02-25 14:29:52,328][36138] Updated weights for policy 0, policy_version 51993 (0.0009) [2023-02-25 14:29:52,410][36157] DAMAGECOUNT value on done: 1113114.0 [2023-02-25 14:29:52,410][36157] Sum rewards: 56.914, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.270', 'AMMO5': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon4': '0.100', 'AMMO3': '0.157', 'weapon5': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.000', 'HITCOUNT': '2.980', 'weapon3': '3.050', 'DAMAGECOUNT': '15.930', 'FRAGCOUNT': '46.000'} [2023-02-25 14:29:52,449][36139] DAMAGECOUNT value on done: 1098869.0 [2023-02-25 14:29:52,449][36139] Sum rewards: 51.761, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.347', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.047', 'weapon5': '0.104', 'AMMO3': '0.229', 'AMMO4': '0.234', 'WEAPON5': '0.250', 'weapon4': '0.346', 'weapon2': '0.370', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.938', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.997', 'FRAGCOUNT': '47.000'} [2023-02-25 14:29:52,547][36155] DAMAGECOUNT value on done: 1097551.0 [2023-02-25 14:29:52,547][36155] Sum rewards: 64.668, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.034', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.027', 'weapon5': '0.098', 'AMMO4': '0.133', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'weapon2': '0.346', 'WEAPON4': '0.350', 'weapon4': '0.576', 'WEAPON3': '1.200', 'weapon3': '2.734', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '55.000'} [2023-02-25 14:29:52,687][36140] DAMAGECOUNT value on done: 1103656.0 [2023-02-25 14:29:52,688][36140] Sum rewards: 65.280, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.775', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.016', 'weapon5': '0.068', 'AMMO4': '0.082', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.260', 'WEAPON4': '0.350', 'weapon4': '0.606', 'WEAPON3': '1.200', 'weapon3': '2.832', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '55.000'} [2023-02-25 14:29:52,729][36157] DAMAGECOUNT value on done: 1107635.0 [2023-02-25 14:29:52,729][36157] Sum rewards: 59.308, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.786', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.076', 'AMMO3': '0.136', 'AMMO4': '0.203', 'weapon4': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.504', 'WEAPON3': '0.900', 'weapon3': '2.974', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.573', 'FRAGCOUNT': '48.000'} [2023-02-25 14:29:52,788][36139] DAMAGECOUNT value on done: 1114930.0 [2023-02-25 14:29:52,788][36139] Sum rewards: 58.088, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.149', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon5': '0.124', 'AMMO3': '0.149', 'AMMO4': '0.169', 'weapon2': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.546', 'WEAPON3': '0.850', 'weapon3': '2.854', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.860', 'FRAGCOUNT': '48.000'} [2023-02-25 14:29:52,961][36140] DAMAGECOUNT value on done: 1106563.0 [2023-02-25 14:29:52,962][36140] Sum rewards: 70.376, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.225', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.130', 'AMMO3': '0.199', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.394', 'weapon4': '0.444', 'WEAPON3': '1.150', 'weapon3': '2.778', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '59.000'} [2023-02-25 14:29:53,006][36140] DAMAGECOUNT value on done: 1094360.0 [2023-02-25 14:29:53,007][36140] Sum rewards: 59.290, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.072', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.014', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'weapon2': '0.118', 'AMMO3': '0.132', 'weapon4': '0.364', 'WEAPON3': '1.000', 'HITCOUNT': '3.150', 'weapon3': '3.406', 'DAMAGECOUNT': '13.905', 'FRAGCOUNT': '48.000'} [2023-02-25 14:29:53,117][36139] DAMAGECOUNT value on done: 1105991.0 [2023-02-25 14:29:53,117][36139] Sum rewards: 57.676, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.748', 'AMMO5': '0.011', 'AMMO2': '0.033', 'AMMO4': '0.164', 'weapon2': '0.180', 'AMMO3': '0.226', 'weapon5': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.784', 'WEAPON3': '1.350', 'weapon3': '2.454', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.768', 'FRAGCOUNT': '51.000'} [2023-02-25 14:29:53,294][36140] DAMAGECOUNT value on done: 1096353.0 [2023-02-25 14:29:53,294][36140] Sum rewards: 66.764, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.660', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.074', 'AMMO4': '0.100', 'weapon5': '0.104', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.214', 'WEAPON3': '1.150', 'weapon3': '3.438', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '54.000'} [2023-02-25 14:29:53,330][36141] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:29:54,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13312.0, 300 sec: 13384.9). Total num frames: 212992000. Throughput: 0: 3336.6. Samples: 15739550. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:29:54,730][36114] Avg episode reward: [(0, '57.825')] [2023-02-25 14:29:54,909][36142] DAMAGECOUNT value on done: 1104676.0 [2023-02-25 14:29:54,909][36142] Sum rewards: 62.504, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.050', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.178', 'weapon2': '0.180', 'weapon5': '0.186', 'AMMO4': '0.200', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.188', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '54.000'} [2023-02-25 14:29:55,215][36142] DAMAGECOUNT value on done: 1089635.0 [2023-02-25 14:29:55,216][36142] Sum rewards: 76.545, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.005', 'AMMO2': '0.016', 'HEALTH': '0.026', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO3': '0.131', 'weapon4': '0.274', 'weapon2': '0.346', 'WEAPON3': '0.800', 'weapon3': '3.026', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.719', 'FRAGCOUNT': '61.000'} [2023-02-25 14:29:55,415][36138] Updated weights for policy 0, policy_version 52003 (0.0009) [2023-02-25 14:29:55,702][36142] DAMAGECOUNT value on done: 1102100.0 [2023-02-25 14:29:55,702][36142] Sum rewards: 42.545, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.408', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.032', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.158', 'AMMO3': '0.193', 'weapon2': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.482', 'WEAPON3': '1.250', 'HITCOUNT': '2.370', 'weapon3': '2.902', 'DAMAGECOUNT': '11.547', 'FRAGCOUNT': '38.000'} [2023-02-25 14:29:56,002][36142] DAMAGECOUNT value on done: 1110855.0 [2023-02-25 14:29:56,003][36142] Sum rewards: 48.583, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.341', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'weapon5': '0.186', 'weapon4': '0.194', 'weapon2': '0.724', 'WEAPON3': '1.050', 'weapon3': '2.732', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.612', 'FRAGCOUNT': '41.000'} [2023-02-25 14:29:57,331][36156] DAMAGECOUNT value on done: 1116255.0 [2023-02-25 14:29:57,332][36156] Sum rewards: 53.738, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.142', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.062', 'weapon5': '0.144', 'AMMO3': '0.194', 'WEAPON5': '0.250', 'weapon2': '0.304', 'AMMO4': '0.310', 'WEAPON4': '0.550', 'weapon4': '0.958', 'WEAPON3': '1.150', 'weapon3': '2.322', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.592', 'FRAGCOUNT': '44.500'} [2023-02-25 14:29:57,388][36156] DAMAGECOUNT value on done: 1112031.0 [2023-02-25 14:29:57,388][36156] Sum rewards: 65.921, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.448', 'weapon4': '0.004', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.158', 'weapon2': '0.312', 'WEAPON3': '1.050', 'HITCOUNT': '3.290', 'weapon3': '3.520', 'DAMAGECOUNT': '16.374', 'FRAGCOUNT': '53.000'} [2023-02-25 14:29:57,653][36156] DAMAGECOUNT value on done: 1099696.0 [2023-02-25 14:29:57,654][36156] Sum rewards: 57.789, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.244', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon5': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.520', 'weapon4': '0.580', 'WEAPON3': '1.250', 'weapon3': '2.424', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '50.000'} [2023-02-25 14:29:57,707][36156] DAMAGECOUNT value on done: 1096458.0 [2023-02-25 14:29:57,707][36156] Sum rewards: 52.586, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.110', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'weapon5': '0.284', 'WEAPON4': '0.300', 'weapon2': '0.318', 'weapon4': '0.386', 'WEAPON3': '1.050', 'weapon3': '2.738', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.478', 'FRAGCOUNT': '44.000'} [2023-02-25 14:29:58,469][36138] Updated weights for policy 0, policy_version 52013 (0.0009) [2023-02-25 14:29:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 213061632. Throughput: 0: 3337.4. Samples: 15759614. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:29:59,730][36114] Avg episode reward: [(0, '57.851')] [2023-02-25 14:30:01,572][36138] Updated weights for policy 0, policy_version 52023 (0.0009) [2023-02-25 14:30:04,619][36138] Updated weights for policy 0, policy_version 52033 (0.0009) [2023-02-25 14:30:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 213127168. Throughput: 0: 3334.8. Samples: 15779536. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:30:04,730][36114] Avg episode reward: [(0, '57.851')] [2023-02-25 14:30:07,714][36138] Updated weights for policy 0, policy_version 52043 (0.0009) [2023-02-25 14:30:08,057][36141] Large shaping reward 2.502 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.48, 160.0), ('weapon5', 0.002)] [2023-02-25 14:30:08,572][36154] DAMAGECOUNT value on done: 1114605.0 [2023-02-25 14:30:08,572][36154] Sum rewards: 58.161, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.908', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.036', 'weapon5': '0.046', 'AMMO4': '0.114', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.464', 'WEAPON3': '1.150', 'HITCOUNT': '3.090', 'weapon3': '3.220', 'DAMAGECOUNT': '14.340', 'FRAGCOUNT': '49.000'} [2023-02-25 14:30:08,714][36141] DAMAGECOUNT value on done: 1112670.0 [2023-02-25 14:30:08,715][36141] Sum rewards: 55.350, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.733', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.023', 'weapon5': '0.048', 'weapon4': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'weapon2': '0.762', 'WEAPON3': '1.500', 'weapon3': '2.908', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.624', 'FRAGCOUNT': '49.000'} [2023-02-25 14:30:08,763][36154] DAMAGECOUNT value on done: 1112905.0 [2023-02-25 14:30:08,763][36154] Sum rewards: 48.037, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.545', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.116', 'AMMO3': '0.168', 'AMMO4': '0.189', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.328', 'weapon4': '0.486', 'WEAPON3': '1.050', 'HITCOUNT': '2.870', 'weapon3': '2.908', 'DAMAGECOUNT': '11.970', 'FRAGCOUNT': '41.000'} [2023-02-25 14:30:08,913][36154] DAMAGECOUNT value on done: 1097048.0 [2023-02-25 14:30:08,914][36154] Sum rewards: 54.252, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.170', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO4': '0.178', 'weapon5': '0.192', 'AMMO3': '0.211', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.432', 'weapon2': '0.608', 'WEAPON3': '1.250', 'weapon3': '2.432', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.199', 'FRAGCOUNT': '49.000'} [2023-02-25 14:30:09,017][36141] DAMAGECOUNT value on done: 1102313.0 [2023-02-25 14:30:09,017][36141] Sum rewards: 62.116, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.510', 'AMMO5': '0.017', 'AMMO2': '0.042', 'AMMO3': '0.161', 'AMMO4': '0.211', 'weapon4': '0.262', 'weapon5': '0.272', 'weapon2': '0.388', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.772', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.840', 'FRAGCOUNT': '53.000'} [2023-02-25 14:30:09,037][36141] DAMAGECOUNT value on done: 1112079.0 [2023-02-25 14:30:09,037][36141] Sum rewards: 57.828, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.795', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon5': '0.172', 'weapon4': '0.220', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.642', 'WEAPON3': '1.400', 'weapon3': '2.594', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.267', 'FRAGCOUNT': '51.000'} [2023-02-25 14:30:09,086][36154] DAMAGECOUNT value on done: 1107969.0 [2023-02-25 14:30:09,086][36154] Sum rewards: 58.851, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.188', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.044', 'AMMO3': '0.127', 'weapon2': '0.190', 'AMMO4': '0.221', 'weapon5': '0.262', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '0.750', 'weapon4': '0.782', 'weapon3': '2.496', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.543', 'FRAGCOUNT': '48.000'} [2023-02-25 14:30:09,344][36141] DAMAGECOUNT value on done: 1097557.0 [2023-02-25 14:30:09,344][36141] Sum rewards: 54.267, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.335', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.152', 'AMMO4': '0.156', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.494', 'weapon2': '0.770', 'WEAPON3': '1.050', 'weapon3': '2.372', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.983', 'FRAGCOUNT': '45.000'} [2023-02-25 14:30:09,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13312.0, 300 sec: 13384.9). Total num frames: 213192704. Throughput: 0: 3335.0. Samples: 15789486. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:30:09,729][36114] Avg episode reward: [(0, '57.717')] [2023-02-25 14:30:10,785][36138] Updated weights for policy 0, policy_version 52053 (0.0009) [2023-02-25 14:30:10,965][36155] DAMAGECOUNT value on done: 1099673.0 [2023-02-25 14:30:10,966][36155] Sum rewards: 50.548, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.160', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.134', 'AMMO3': '0.161', 'weapon2': '0.700', 'WEAPON3': '1.100', 'weapon3': '2.928', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.542', 'FRAGCOUNT': '42.000'} [2023-02-25 14:30:11,279][36155] DAMAGECOUNT value on done: 1106072.0 [2023-02-25 14:30:11,279][36155] Sum rewards: 50.130, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.040', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.048', 'AMMO3': '0.153', 'weapon5': '0.230', 'AMMO4': '0.238', 'weapon2': '0.322', 'ARMOR': '0.457', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'weapon4': '0.726', 'WEAPON3': '0.950', 'weapon3': '2.228', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.044', 'FRAGCOUNT': '44.000'} [2023-02-25 14:30:11,653][36157] DAMAGECOUNT value on done: 1117304.0 [2023-02-25 14:30:11,653][36157] Sum rewards: 62.355, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.453', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.048', 'AMMO4': '0.131', 'weapon5': '0.134', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.554', 'WEAPON3': '1.350', 'weapon3': '3.048', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.957', 'FRAGCOUNT': '55.000'} [2023-02-25 14:30:11,952][36157] DAMAGECOUNT value on done: 1106910.0 [2023-02-25 14:30:11,952][36157] Sum rewards: 61.370, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.040', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.076', 'WEAPON5': '0.150', 'weapon2': '0.240', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.296', 'WEAPON3': '1.550', 'weapon3': '3.058', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '55.000'} [2023-02-25 14:30:12,310][36155] DAMAGECOUNT value on done: 1122357.0 [2023-02-25 14:30:12,311][36155] Sum rewards: 56.622, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.982', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.042', 'AMMO3': '0.140', 'AMMO4': '0.209', 'weapon5': '0.292', 'WEAPON5': '0.350', 'weapon2': '0.384', 'WEAPON4': '0.450', 'weapon4': '0.796', 'WEAPON3': '0.850', 'weapon3': '2.100', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.192', 'FRAGCOUNT': '47.000'} [2023-02-25 14:30:12,426][36139] DAMAGECOUNT value on done: 1105000.0 [2023-02-25 14:30:12,427][36139] Sum rewards: 46.912, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.695', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.110', 'AMMO4': '0.145', 'AMMO3': '0.208', 'WEAPON4': '0.350', 'weapon2': '0.560', 'weapon4': '0.674', 'WEAPON3': '1.250', 'weapon3': '2.384', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '14.421', 'FRAGCOUNT': '41.000'} [2023-02-25 14:30:12,537][36157] DAMAGECOUNT value on done: 1117662.0 [2023-02-25 14:30:12,537][36157] Sum rewards: 52.269, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.135', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.032', 'weapon5': '0.044', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon4': '0.326', 'weapon2': '0.808', 'WEAPON3': '1.400', 'weapon3': '2.588', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.644', 'FRAGCOUNT': '48.000'} [2023-02-25 14:30:12,628][36155] DAMAGECOUNT value on done: 1102405.0 [2023-02-25 14:30:12,629][36155] Sum rewards: 59.796, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.990', 'AMMO5': '0.005', 'AMMO2': '0.007', 'ARMOR': '0.008', 'AMMO4': '0.036', 'weapon5': '0.090', 'AMMO3': '0.116', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.650', 'weapon4': '0.656', 'weapon2': '0.762', 'weapon3': '2.164', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.562', 'FRAGCOUNT': '47.000'} [2023-02-25 14:30:12,745][36139] DAMAGECOUNT value on done: 1104168.0 [2023-02-25 14:30:12,745][36139] Sum rewards: 64.796, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.020', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.168', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'weapon2': '0.274', 'WEAPON4': '0.300', 'weapon4': '0.392', 'WEAPON3': '1.100', 'weapon3': '2.922', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.897', 'FRAGCOUNT': '55.000'} [2023-02-25 14:30:12,849][36157] DAMAGECOUNT value on done: 1111856.0 [2023-02-25 14:30:12,850][36157] Sum rewards: 50.788, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.123', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.025', 'weapon5': '0.088', 'AMMO3': '0.124', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.290', 'WEAPON3': '0.850', 'weapon2': '1.072', 'weapon3': '2.324', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.663', 'FRAGCOUNT': '41.000'} [2023-02-25 14:30:12,951][36140] DAMAGECOUNT value on done: 1108087.0 [2023-02-25 14:30:12,951][36140] Sum rewards: 44.120, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.338', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.084', 'AMMO3': '0.178', 'AMMO4': '0.237', 'WEAPON5': '0.250', 'weapon4': '0.280', 'weapon2': '0.548', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'HITCOUNT': '2.790', 'weapon3': '2.882', 'DAMAGECOUNT': '13.293', 'FRAGCOUNT': '40.000'} [2023-02-25 14:30:13,062][36139] DAMAGECOUNT value on done: 1119305.0 [2023-02-25 14:30:13,063][36139] Sum rewards: 52.141, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.600', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.166', 'weapon4': '0.216', 'weapon2': '0.900', 'WEAPON3': '1.000', 'weapon3': '2.692', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.110', 'FRAGCOUNT': '42.000'} [2023-02-25 14:30:13,230][36140] DAMAGECOUNT value on done: 1112148.0 [2023-02-25 14:30:13,231][36140] Sum rewards: 63.556, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.126', 'AMMO5': '0.016', 'AMMO2': '0.040', 'AMMO3': '0.158', 'AMMO4': '0.202', 'weapon5': '0.264', 'weapon2': '0.456', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.656', 'WEAPON3': '0.900', 'weapon3': '2.334', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '53.000'} [2023-02-25 14:30:13,278][36140] DAMAGECOUNT value on done: 1099265.0 [2023-02-25 14:30:13,279][36140] Sum rewards: 55.096, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.916', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon5': '0.168', 'AMMO4': '0.184', 'AMMO3': '0.193', 'weapon2': '0.366', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.642', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.715', 'FRAGCOUNT': '49.000'} [2023-02-25 14:30:13,350][36139] DAMAGECOUNT value on done: 1111436.0 [2023-02-25 14:30:13,351][36139] Sum rewards: 62.849, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.565', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.036', 'weapon5': '0.048', 'AMMO4': '0.050', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.588', 'WEAPON3': '1.200', 'weapon3': '3.090', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '52.000'} [2023-02-25 14:30:13,563][36140] DAMAGECOUNT value on done: 1100801.0 [2023-02-25 14:30:13,563][36140] Sum rewards: 47.190, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.205', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.106', 'AMMO4': '0.181', 'weapon4': '0.226', 'AMMO3': '0.239', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.500', 'HITCOUNT': '2.910', 'weapon3': '3.032', 'DAMAGECOUNT': '13.344', 'FRAGCOUNT': '45.000'} [2023-02-25 14:30:13,884][36138] Updated weights for policy 0, policy_version 52063 (0.0009) [2023-02-25 14:30:14,729][36114] Fps is (10 sec: 13107.0, 60 sec: 13312.0, 300 sec: 13384.9). Total num frames: 213258240. Throughput: 0: 3332.3. Samples: 15809394. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:30:14,730][36114] Avg episode reward: [(0, '57.242')] [2023-02-25 14:30:15,159][36142] DAMAGECOUNT value on done: 1109632.0 [2023-02-25 14:30:15,160][36142] Sum rewards: 60.299, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.150', 'AMMO2': '0.009', 'AMMO4': '0.042', 'WEAPON4': '0.150', 'AMMO3': '0.206', 'weapon4': '0.330', 'weapon2': '0.452', 'WEAPON3': '1.250', 'weapon3': '3.092', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '14.868', 'FRAGCOUNT': '52.000'} [2023-02-25 14:30:15,458][36142] DAMAGECOUNT value on done: 1093955.0 [2023-02-25 14:30:15,458][36142] Sum rewards: 43.840, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.992', 'ARMOR': '0.012', 'AMMO5': '0.016', 'AMMO2': '0.080', 'AMMO3': '0.189', 'weapon5': '0.306', 'AMMO4': '0.399', 'WEAPON5': '0.450', 'weapon2': '0.480', 'weapon4': '0.572', 'WEAPON4': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.228', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '12.960', 'FRAGCOUNT': '42.000'} [2023-02-25 14:30:15,929][36142] DAMAGECOUNT value on done: 1107010.0 [2023-02-25 14:30:15,930][36142] Sum rewards: 56.559, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.292', 'AMMO5': '0.020', 'AMMO2': '0.051', 'AMMO3': '0.181', 'weapon5': '0.218', 'AMMO4': '0.253', 'ARMOR': '0.404', 'weapon2': '0.424', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.450', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.070', 'FRAGCOUNT': '50.000'} [2023-02-25 14:30:16,235][36142] DAMAGECOUNT value on done: 1116479.0 [2023-02-25 14:30:16,235][36142] Sum rewards: 68.596, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.255', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO3': '0.165', 'AMMO4': '0.195', 'weapon5': '0.228', 'weapon4': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.542', 'WEAPON3': '1.000', 'weapon3': '2.648', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '58.000'} [2023-02-25 14:30:16,977][36138] Updated weights for policy 0, policy_version 52073 (0.0009) [2023-02-25 14:30:17,604][36156] DAMAGECOUNT value on done: 1121252.0 [2023-02-25 14:30:17,605][36156] Sum rewards: 56.774, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.414', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon4': '0.526', 'weapon2': '0.634', 'WEAPON3': '1.250', 'weapon3': '2.318', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.991', 'FRAGCOUNT': '48.000'} [2023-02-25 14:30:17,666][36156] DAMAGECOUNT value on done: 1116326.0 [2023-02-25 14:30:17,666][36156] Sum rewards: 37.172, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.248', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.094', 'AMMO4': '0.194', 'WEAPON5': '0.250', 'weapon2': '0.252', 'AMMO3': '0.255', 'WEAPON4': '0.450', 'weapon4': '0.576', 'WEAPON3': '1.450', 'weapon3': '2.674', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.885', 'FRAGCOUNT': '35.000'} [2023-02-25 14:30:17,926][36156] DAMAGECOUNT value on done: 1104266.0 [2023-02-25 14:30:17,927][36156] Sum rewards: 55.402, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.050', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.158', 'weapon2': '0.182', 'weapon5': '0.186', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.582', 'WEAPON3': '1.050', 'weapon3': '2.736', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.710', 'FRAGCOUNT': '47.000'} [2023-02-25 14:30:17,992][36156] DAMAGECOUNT value on done: 1101103.0 [2023-02-25 14:30:17,993][36156] Sum rewards: 53.845, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.290', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.122', 'AMMO3': '0.196', 'weapon5': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.440', 'weapon2': '0.646', 'WEAPON3': '1.150', 'weapon3': '2.202', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.935', 'FRAGCOUNT': '47.000'} [2023-02-25 14:30:19,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13312.0, 300 sec: 13371.0). Total num frames: 213323776. Throughput: 0: 3335.8. Samples: 15829424. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:30:19,729][36114] Avg episode reward: [(0, '56.796')] [2023-02-25 14:30:20,046][36138] Updated weights for policy 0, policy_version 52083 (0.0010) [2023-02-25 14:30:23,109][36138] Updated weights for policy 0, policy_version 52093 (0.0010) [2023-02-25 14:30:24,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13312.0, 300 sec: 13384.9). Total num frames: 213393408. Throughput: 0: 3334.0. Samples: 15839412. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:30:24,729][36114] Avg episode reward: [(0, '56.796')] [2023-02-25 14:30:26,187][36138] Updated weights for policy 0, policy_version 52103 (0.0009) [2023-02-25 14:30:28,880][36154] DAMAGECOUNT value on done: 1120094.0 [2023-02-25 14:30:28,880][36154] Sum rewards: 63.504, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.144', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO3': '0.215', 'weapon2': '0.352', 'WEAPON3': '1.200', 'weapon3': '3.418', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '52.000'} [2023-02-25 14:30:28,996][36141] DAMAGECOUNT value on done: 1117984.0 [2023-02-25 14:30:28,997][36141] Sum rewards: 65.897, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.040', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.014', 'weapon5': '0.050', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'weapon2': '0.360', 'weapon4': '0.696', 'WEAPON3': '1.100', 'weapon3': '2.666', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '55.000'} [2023-02-25 14:30:29,074][36154] DAMAGECOUNT value on done: 1118002.0 [2023-02-25 14:30:29,075][36154] Sum rewards: 57.485, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.575', 'AMMO5': '0.024', 'AMMO2': '0.051', 'AMMO3': '0.129', 'AMMO4': '0.255', 'weapon5': '0.318', 'weapon2': '0.386', 'WEAPON3': '0.750', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'weapon4': '0.872', 'weapon3': '2.094', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.291', 'FRAGCOUNT': '48.000'} [2023-02-25 14:30:29,214][36154] DAMAGECOUNT value on done: 1102737.0 [2023-02-25 14:30:29,214][36154] Sum rewards: 61.156, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.702', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO3': '0.186', 'AMMO4': '0.197', 'weapon5': '0.238', 'weapon4': '0.248', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '2.936', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.067', 'FRAGCOUNT': '51.000'} [2023-02-25 14:30:29,246][36138] Updated weights for policy 0, policy_version 52113 (0.0010) [2023-02-25 14:30:29,299][36141] DAMAGECOUNT value on done: 1107187.0 [2023-02-25 14:30:29,300][36141] Sum rewards: 58.073, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.465', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon5': '0.116', 'AMMO4': '0.122', 'AMMO3': '0.177', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.440', 'weapon2': '0.486', 'WEAPON3': '1.100', 'weapon3': '2.722', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '14.622', 'FRAGCOUNT': '50.000'} [2023-02-25 14:30:29,318][36141] DAMAGECOUNT value on done: 1117605.0 [2023-02-25 14:30:29,319][36141] Sum rewards: 60.454, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.210', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.082', 'AMMO4': '0.108', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.228', 'weapon4': '0.232', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.014', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '51.000'} [2023-02-25 14:30:29,389][36154] DAMAGECOUNT value on done: 1113417.0 [2023-02-25 14:30:29,389][36154] Sum rewards: 59.256, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.244', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.117', 'weapon5': '0.172', 'weapon4': '0.214', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.394', 'WEAPON3': '1.400', 'weapon3': '2.850', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '52.000'} [2023-02-25 14:30:29,610][36141] DAMAGECOUNT value on done: 1101692.0 [2023-02-25 14:30:29,611][36141] Sum rewards: 43.960, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.722', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO4': '0.180', 'weapon5': '0.188', 'AMMO3': '0.224', 'weapon4': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.384', 'WEAPON3': '1.350', 'HITCOUNT': '2.720', 'weapon3': '2.814', 'DAMAGECOUNT': '12.405', 'FRAGCOUNT': '41.000'} [2023-02-25 14:30:29,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13312.0, 300 sec: 13384.9). Total num frames: 213458944. Throughput: 0: 3329.2. Samples: 15859324. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:30:29,730][36114] Avg episode reward: [(0, '57.336')] [2023-02-25 14:30:31,007][36155] DAMAGECOUNT value on done: 1104576.0 [2023-02-25 14:30:31,008][36155] Sum rewards: 54.531, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.184', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.139', 'weapon5': '0.264', 'weapon2': '0.384', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '0.750', 'weapon4': '1.080', 'weapon3': '1.916', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.409', 'FRAGCOUNT': '45.000'} [2023-02-25 14:30:31,342][36155] DAMAGECOUNT value on done: 1111636.0 [2023-02-25 14:30:31,342][36155] Sum rewards: 73.771, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.880', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.007', 'weapon4': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.182', 'weapon2': '0.508', 'WEAPON3': '1.100', 'weapon3': '3.354', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.692', 'FRAGCOUNT': '62.000'} [2023-02-25 14:30:31,786][36157] DAMAGECOUNT value on done: 1121226.0 [2023-02-25 14:30:31,787][36157] Sum rewards: 48.121, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.579', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.138', 'weapon5': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.530', 'WEAPON3': '0.900', 'weapon2': '0.990', 'weapon3': '2.112', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '11.766', 'FRAGCOUNT': '42.000'} [2023-02-25 14:30:32,092][36157] DAMAGECOUNT value on done: 1110864.0 [2023-02-25 14:30:32,092][36157] Sum rewards: 45.664, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.837', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.038', 'AMMO2': '0.043', 'WEAPON5': '0.100', 'AMMO3': '0.143', 'AMMO4': '0.214', 'weapon4': '0.272', 'WEAPON4': '0.400', 'WEAPON3': '0.900', 'weapon2': '0.950', 'weapon3': '2.482', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '11.862', 'FRAGCOUNT': '38.000'} [2023-02-25 14:30:32,301][36138] Updated weights for policy 0, policy_version 52123 (0.0010) [2023-02-25 14:30:32,365][36155] DAMAGECOUNT value on done: 1127583.0 [2023-02-25 14:30:32,365][36155] Sum rewards: 56.873, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.740', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.212', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.358', 'weapon4': '0.442', 'WEAPON3': '1.350', 'weapon3': '2.742', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '49.000'} [2023-02-25 14:30:32,403][36139] DAMAGECOUNT value on done: 1109088.0 [2023-02-25 14:30:32,403][36139] Sum rewards: 45.212, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.984', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.148', 'AMMO4': '0.163', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.534', 'weapon4': '0.648', 'WEAPON3': '0.950', 'weapon3': '2.274', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.264', 'FRAGCOUNT': '37.000'} [2023-02-25 14:30:32,570][36157] DAMAGECOUNT value on done: 1122604.0 [2023-02-25 14:30:32,570][36157] Sum rewards: 50.975, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.274', 'AMMO5': '0.018', 'AMMO2': '0.055', 'AMMO3': '0.191', 'weapon2': '0.236', 'weapon5': '0.266', 'AMMO4': '0.273', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.682', 'WEAPON3': '1.200', 'weapon3': '2.352', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.826', 'FRAGCOUNT': '45.000'} [2023-02-25 14:30:32,668][36155] DAMAGECOUNT value on done: 1107860.0 [2023-02-25 14:30:32,668][36155] Sum rewards: 62.272, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.432', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.104', 'AMMO4': '0.157', 'AMMO3': '0.167', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.352', 'weapon2': '0.412', 'WEAPON3': '1.000', 'weapon3': '2.926', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '51.000'} [2023-02-25 14:30:32,708][36139] DAMAGECOUNT value on done: 1109648.0 [2023-02-25 14:30:32,708][36139] Sum rewards: 61.464, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.732', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.108', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.342', 'weapon2': '0.808', 'WEAPON3': '1.250', 'weapon3': '2.520', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '52.000'} [2023-02-25 14:30:32,885][36157] DAMAGECOUNT value on done: 1116589.0 [2023-02-25 14:30:32,886][36157] Sum rewards: 59.258, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.573', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.104', 'AMMO3': '0.109', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'weapon4': '0.690', 'WEAPON3': '0.700', 'weapon2': '0.804', 'weapon3': '2.238', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.199', 'FRAGCOUNT': '46.000'} [2023-02-25 14:30:33,047][36139] DAMAGECOUNT value on done: 1123996.0 [2023-02-25 14:30:33,048][36139] Sum rewards: 48.178, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.238', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.063', 'weapon5': '0.190', 'AMMO3': '0.257', 'weapon2': '0.272', 'AMMO4': '0.316', 'WEAPON5': '0.400', 'weapon4': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.722', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.073', 'FRAGCOUNT': '47.000'} [2023-02-25 14:30:33,188][36140] DAMAGECOUNT value on done: 1113152.0 [2023-02-25 14:30:33,189][36140] Sum rewards: 57.837, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.124', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.040', 'AMMO3': '0.159', 'AMMO4': '0.202', 'weapon5': '0.212', 'weapon2': '0.414', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.682', 'WEAPON3': '0.950', 'weapon3': '2.236', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.165', 'FRAGCOUNT': '50.000'} [2023-02-25 14:30:33,363][36139] DAMAGECOUNT value on done: 1116414.0 [2023-02-25 14:30:33,363][36139] Sum rewards: 63.084, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.960', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.130', 'AMMO3': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.382', 'weapon4': '0.664', 'WEAPON3': '1.000', 'weapon3': '2.460', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.934', 'FRAGCOUNT': '52.000'} [2023-02-25 14:30:33,479][36140] DAMAGECOUNT value on done: 1117924.0 [2023-02-25 14:30:33,480][36140] Sum rewards: 65.022, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.816', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.190', 'AMMO4': '0.190', 'weapon2': '0.246', 'weapon5': '0.260', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.756', 'WEAPON3': '1.150', 'weapon3': '2.388', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.328', 'FRAGCOUNT': '56.000'} [2023-02-25 14:30:33,504][36140] DAMAGECOUNT value on done: 1104246.0 [2023-02-25 14:30:33,504][36140] Sum rewards: 58.994, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.522', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.150', 'AMMO3': '0.175', 'AMMO4': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.390', 'weapon4': '0.518', 'WEAPON3': '1.050', 'weapon3': '2.688', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.943', 'FRAGCOUNT': '50.000'} [2023-02-25 14:30:33,816][36140] DAMAGECOUNT value on done: 1105451.0 [2023-02-25 14:30:33,816][36140] Sum rewards: 58.815, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.666', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.178', 'weapon2': '0.228', 'weapon4': '0.388', 'WEAPON3': '1.150', 'weapon3': '2.948', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '13.950', 'FRAGCOUNT': '50.000'} [2023-02-25 14:30:33,949][36142] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:30:34,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 213528576. Throughput: 0: 3331.9. Samples: 15879444. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:30:34,729][36114] Avg episode reward: [(0, '57.112')] [2023-02-25 14:30:35,358][36138] Updated weights for policy 0, policy_version 52133 (0.0010) [2023-02-25 14:30:35,425][36142] DAMAGECOUNT value on done: 1114407.0 [2023-02-25 14:30:35,426][36142] Sum rewards: 60.028, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.080', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.039', 'AMMO3': '0.178', 'AMMO4': '0.195', 'weapon5': '0.270', 'weapon2': '0.304', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.766', 'WEAPON3': '0.950', 'weapon3': '2.320', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.325', 'FRAGCOUNT': '51.000'} [2023-02-25 14:30:35,733][36142] DAMAGECOUNT value on done: 1099425.0 [2023-02-25 14:30:35,734][36142] Sum rewards: 60.654, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.370', 'AMMO5': '0.014', 'AMMO2': '0.042', 'AMMO3': '0.148', 'weapon5': '0.182', 'AMMO4': '0.210', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.426', 'weapon4': '0.518', 'WEAPON3': '1.000', 'weapon3': '2.644', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.410', 'FRAGCOUNT': '50.000'} [2023-02-25 14:30:36,218][36142] DAMAGECOUNT value on done: 1111972.0 [2023-02-25 14:30:36,218][36142] Sum rewards: 55.517, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.610', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO3': '0.158', 'weapon5': '0.170', 'AMMO4': '0.179', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.462', 'weapon2': '0.636', 'WEAPON3': '0.950', 'weapon3': '2.496', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.886', 'FRAGCOUNT': '46.000'} [2023-02-25 14:30:36,535][36142] DAMAGECOUNT value on done: 1121841.0 [2023-02-25 14:30:36,536][36142] Sum rewards: 66.172, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.126', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.088', 'weapon4': '0.144', 'AMMO4': '0.160', 'weapon2': '0.178', 'AMMO3': '0.199', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.358', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.086', 'FRAGCOUNT': '57.500'} [2023-02-25 14:30:37,742][36156] DAMAGECOUNT value on done: 1126176.0 [2023-02-25 14:30:37,742][36156] Sum rewards: 57.404, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.650', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.094', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.344', 'weapon4': '0.688', 'WEAPON3': '1.200', 'weapon3': '2.592', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.772', 'FRAGCOUNT': '49.000'} [2023-02-25 14:30:37,819][36156] DAMAGECOUNT value on done: 1120148.0 [2023-02-25 14:30:37,820][36156] Sum rewards: 43.385, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.088', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.069', 'AMMO3': '0.152', 'weapon5': '0.184', 'AMMO4': '0.346', 'weapon4': '0.448', 'WEAPON5': '0.450', 'weapon2': '0.468', 'WEAPON4': '0.500', 'WEAPON3': '0.900', 'weapon3': '2.272', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '11.466', 'FRAGCOUNT': '39.000'} [2023-02-25 14:30:38,077][36156] DAMAGECOUNT value on done: 1108677.0 [2023-02-25 14:30:38,077][36156] Sum rewards: 43.678, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.692', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.166', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.344', 'weapon4': '0.476', 'WEAPON3': '1.200', 'weapon3': '2.650', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '13.068', 'FRAGCOUNT': '38.000'} [2023-02-25 14:30:38,141][36156] DAMAGECOUNT value on done: 1106087.0 [2023-02-25 14:30:38,141][36156] Sum rewards: 56.957, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.385', 'weapon7': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.040', 'AMMO3': '0.172', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.202', 'weapon2': '0.278', 'weapon5': '0.294', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon4': '0.724', 'WEAPON3': '1.000', 'weapon3': '2.358', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.952', 'FRAGCOUNT': '49.000'} [2023-02-25 14:30:38,419][36138] Updated weights for policy 0, policy_version 52143 (0.0009) [2023-02-25 14:30:39,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 213594112. Throughput: 0: 3333.2. Samples: 15889544. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:30:39,730][36114] Avg episode reward: [(0, '57.077')] [2023-02-25 14:30:41,457][36138] Updated weights for policy 0, policy_version 52153 (0.0009) [2023-02-25 14:30:44,534][36138] Updated weights for policy 0, policy_version 52163 (0.0009) [2023-02-25 14:30:44,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13312.0, 300 sec: 13371.0). Total num frames: 213659648. Throughput: 0: 3334.1. Samples: 15909648. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:30:44,730][36114] Avg episode reward: [(0, '57.077')] [2023-02-25 14:30:47,622][36138] Updated weights for policy 0, policy_version 52173 (0.0009) [2023-02-25 14:30:49,030][36154] DAMAGECOUNT value on done: 1124736.0 [2023-02-25 14:30:49,030][36154] Sum rewards: 48.364, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.248', 'AMMO5': '0.015', 'AMMO2': '0.047', 'AMMO3': '0.178', 'weapon5': '0.228', 'AMMO4': '0.236', 'weapon4': '0.354', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.644', 'WEAPON3': '1.050', 'weapon3': '2.464', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.926', 'FRAGCOUNT': '42.000'} [2023-02-25 14:30:49,046][36141] DAMAGECOUNT value on done: 1122957.0 [2023-02-25 14:30:49,047][36141] Sum rewards: 58.144, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.873', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.088', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'weapon4': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon2': '0.476', 'WEAPON3': '1.350', 'HITCOUNT': '3.000', 'weapon3': '3.024', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '52.000'} [2023-02-25 14:30:49,251][36154] DAMAGECOUNT value on done: 1123209.0 [2023-02-25 14:30:49,252][36154] Sum rewards: 57.744, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.127', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.172', 'weapon5': '0.214', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.372', 'WEAPON3': '1.100', 'weapon3': '2.814', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '48.000'} [2023-02-25 14:30:49,329][36141] DAMAGECOUNT value on done: 1112301.0 [2023-02-25 14:30:49,330][36141] Sum rewards: 57.045, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.073', 'AMMO5': '0.022', 'AMMO2': '0.040', 'AMMO3': '0.141', 'AMMO4': '0.202', 'weapon2': '0.240', 'WEAPON4': '0.300', 'weapon5': '0.322', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'weapon4': '0.928', 'weapon3': '2.110', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '46.000'} [2023-02-25 14:30:49,351][36141] DAMAGECOUNT value on done: 1122011.0 [2023-02-25 14:30:49,351][36154] DAMAGECOUNT value on done: 1106782.0 [2023-02-25 14:30:49,352][36141] Sum rewards: 49.471, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.032', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.166', 'AMMO3': '0.170', 'weapon2': '0.182', 'AMMO4': '0.219', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.638', 'WEAPON3': '1.050', 'weapon3': '2.592', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '13.218', 'FRAGCOUNT': '42.000'} [2023-02-25 14:30:49,352][36154] Sum rewards: 48.333, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.158', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.149', 'AMMO3': '0.153', 'weapon5': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.420', 'weapon2': '0.698', 'WEAPON3': '0.900', 'weapon3': '2.362', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.135', 'FRAGCOUNT': '41.000'} [2023-02-25 14:30:49,560][36154] DAMAGECOUNT value on done: 1118563.0 [2023-02-25 14:30:49,561][36154] Sum rewards: 59.901, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.069', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO4': '0.197', 'weapon2': '0.202', 'weapon5': '0.236', 'AMMO3': '0.253', 'weapon4': '0.344', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.838', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.438', 'FRAGCOUNT': '56.000'} [2023-02-25 14:30:49,656][36141] DAMAGECOUNT value on done: 1105555.0 [2023-02-25 14:30:49,656][36141] Sum rewards: 43.460, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.902', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.112', 'weapon5': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.446', 'weapon4': '0.594', 'WEAPON3': '1.200', 'weapon3': '2.322', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '11.589', 'FRAGCOUNT': '39.000'} [2023-02-25 14:30:49,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13312.0, 300 sec: 13371.0). Total num frames: 213725184. Throughput: 0: 3335.7. Samples: 15929644. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:30:49,730][36114] Avg episode reward: [(0, '56.392')] [2023-02-25 14:30:50,686][36138] Updated weights for policy 0, policy_version 52183 (0.0009) [2023-02-25 14:30:51,167][36155] DAMAGECOUNT value on done: 1109134.0 [2023-02-25 14:30:51,167][36155] Sum rewards: 48.304, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.692', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.045', 'AMMO3': '0.135', 'weapon5': '0.174', 'AMMO4': '0.225', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON4': '0.450', 'weapon4': '0.794', 'WEAPON3': '0.800', 'weapon3': '2.196', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '13.674', 'FRAGCOUNT': '40.000'} [2023-02-25 14:30:51,467][36155] DAMAGECOUNT value on done: 1117108.0 [2023-02-25 14:30:51,467][36155] Sum rewards: 61.887, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.965', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.152', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'weapon2': '0.234', 'WEAPON4': '0.300', 'weapon4': '0.482', 'WEAPON3': '1.100', 'weapon3': '2.896', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.401', 'FRAGCOUNT': '52.000'} [2023-02-25 14:30:51,858][36157] DAMAGECOUNT value on done: 1126810.0 [2023-02-25 14:30:51,859][36157] Sum rewards: 63.391, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.071', 'ARMOR': '0.012', 'AMMO5': '0.014', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.188', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.280', 'WEAPON5': '0.300', 'weapon4': '0.578', 'WEAPON3': '1.250', 'weapon3': '2.680', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.752', 'FRAGCOUNT': '53.000'} [2023-02-25 14:30:52,164][36157] DAMAGECOUNT value on done: 1115686.0 [2023-02-25 14:30:52,165][36157] Sum rewards: 54.620, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.195', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.163', 'weapon5': '0.204', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.374', 'weapon4': '0.446', 'WEAPON3': '1.000', 'weapon3': '2.802', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.466', 'FRAGCOUNT': '47.000'} [2023-02-25 14:30:52,397][36139] DAMAGECOUNT value on done: 1113884.0 [2023-02-25 14:30:52,398][36139] Sum rewards: 58.204, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.542', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.126', 'AMMO3': '0.159', 'AMMO4': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.330', 'weapon4': '0.878', 'WEAPON3': '1.050', 'weapon3': '2.390', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.388', 'FRAGCOUNT': '49.000'} [2023-02-25 14:30:52,400][36155] DAMAGECOUNT value on done: 1132588.0 [2023-02-25 14:30:52,400][36155] Sum rewards: 58.811, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.010', 'AMMO2': '0.003', 'AMMO5': '0.009', 'AMMO4': '0.017', 'WEAPON4': '0.050', 'weapon5': '0.104', 'weapon4': '0.124', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'weapon2': '0.502', 'WEAPON3': '1.200', 'weapon3': '3.028', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.015', 'FRAGCOUNT': '48.000'} [2023-02-25 14:30:52,618][36157] DAMAGECOUNT value on done: 1127718.0 [2023-02-25 14:30:52,619][36157] Sum rewards: 61.037, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.624', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.029', 'AMMO3': '0.151', 'weapon5': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.320', 'weapon4': '0.606', 'WEAPON3': '1.050', 'weapon3': '2.560', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '52.000'} [2023-02-25 14:30:52,698][36139] DAMAGECOUNT value on done: 1114950.0 [2023-02-25 14:30:52,698][36139] Sum rewards: 55.917, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.264', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.154', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'weapon2': '0.404', 'weapon4': '0.426', 'WEAPON3': '1.500', 'weapon3': '2.696', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.906', 'FRAGCOUNT': '49.000'} [2023-02-25 14:30:52,712][36155] DAMAGECOUNT value on done: 1112395.0 [2023-02-25 14:30:52,713][36155] Sum rewards: 42.597, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.767', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon2': '0.204', 'weapon5': '0.212', 'AMMO3': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.580', 'WEAPON3': '1.600', 'weapon3': '2.518', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '13.446', 'FRAGCOUNT': '41.000'} [2023-02-25 14:30:52,931][36157] DAMAGECOUNT value on done: 1121437.0 [2023-02-25 14:30:52,932][36157] Sum rewards: 53.679, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.036', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.039', 'AMMO3': '0.157', 'AMMO4': '0.193', 'weapon5': '0.258', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.784', 'weapon4': '0.794', 'WEAPON3': '0.950', 'weapon3': '1.854', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.544', 'FRAGCOUNT': '45.000'} [2023-02-25 14:30:53,010][36139] DAMAGECOUNT value on done: 1128955.0 [2023-02-25 14:30:53,010][36139] Sum rewards: 57.341, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.332', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.434', 'weapon4': '0.560', 'WEAPON3': '1.250', 'weapon3': '2.484', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.835', 'FRAGCOUNT': '51.000'} [2023-02-25 14:30:53,188][36140] DAMAGECOUNT value on done: 1117794.0 [2023-02-25 14:30:53,189][36140] Sum rewards: 49.840, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.122', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.045', 'AMMO3': '0.145', 'weapon5': '0.154', 'AMMO4': '0.227', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.468', 'weapon2': '0.584', 'WEAPON3': '0.950', 'weapon3': '2.506', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.926', 'FRAGCOUNT': '42.000'} [2023-02-25 14:30:53,308][36139] DAMAGECOUNT value on done: 1121189.0 [2023-02-25 14:30:53,308][36139] Sum rewards: 57.211, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.790', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon4': '0.126', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'weapon5': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON3': '0.900', 'HITCOUNT': '2.850', 'weapon3': '3.090', 'DAMAGECOUNT': '14.325', 'FRAGCOUNT': '46.000'} [2023-02-25 14:30:53,479][36140] DAMAGECOUNT value on done: 1122643.0 [2023-02-25 14:30:53,479][36140] Sum rewards: 52.851, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.266', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO3': '0.199', 'weapon4': '0.272', 'weapon2': '0.368', 'WEAPON3': '1.250', 'weapon3': '3.042', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.157', 'FRAGCOUNT': '45.000'} [2023-02-25 14:30:53,501][36140] DAMAGECOUNT value on done: 1109434.0 [2023-02-25 14:30:53,502][36140] Sum rewards: 59.701, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.995', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.013', 'weapon4': '0.028', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'weapon2': '0.840', 'WEAPON3': '1.250', 'weapon3': '2.962', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.564', 'FRAGCOUNT': '49.000'} [2023-02-25 14:30:53,742][36138] Updated weights for policy 0, policy_version 52193 (0.0009) [2023-02-25 14:30:53,808][36140] DAMAGECOUNT value on done: 1110635.0 [2023-02-25 14:30:53,808][36140] Sum rewards: 55.338, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.507', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.092', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'weapon4': '0.240', 'weapon2': '0.320', 'WEAPON3': '1.350', 'weapon3': '3.024', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.552', 'FRAGCOUNT': '49.000'} [2023-02-25 14:30:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 213794816. Throughput: 0: 3339.3. Samples: 15939756. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:30:54,730][36114] Avg episode reward: [(0, '56.131')] [2023-02-25 14:30:55,428][36142] DAMAGECOUNT value on done: 1118612.0 [2023-02-25 14:30:55,429][36142] Sum rewards: 44.437, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.222', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.137', 'AMMO3': '0.195', 'weapon5': '0.200', 'weapon2': '0.290', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.748', 'WEAPON3': '1.100', 'weapon3': '2.362', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '12.615', 'FRAGCOUNT': '39.000'} [2023-02-25 14:30:55,740][36142] DAMAGECOUNT value on done: 1104504.0 [2023-02-25 14:30:55,740][36142] Sum rewards: 60.279, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.500', 'AMMO2': '0.002', 'AMMO4': '0.008', 'WEAPON4': '0.050', 'weapon4': '0.124', 'AMMO3': '0.188', 'weapon2': '0.380', 'WEAPON3': '1.300', 'HITCOUNT': '3.340', 'weapon3': '3.400', 'DAMAGECOUNT': '15.237', 'FRAGCOUNT': '50.000'} [2023-02-25 14:30:56,227][36142] DAMAGECOUNT value on done: 1117738.0 [2023-02-25 14:30:56,228][36142] Sum rewards: 72.795, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.955', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon5': '0.090', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.282', 'weapon2': '0.330', 'WEAPON3': '1.000', 'weapon3': '3.110', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '59.000'} [2023-02-25 14:30:56,533][36142] DAMAGECOUNT value on done: 1127542.0 [2023-02-25 14:30:56,534][36142] Sum rewards: 67.464, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.900', 'AMMO5': '0.013', 'AMMO2': '0.029', 'AMMO4': '0.143', 'AMMO3': '0.206', 'weapon2': '0.220', 'weapon4': '0.224', 'weapon5': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '2.954', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '58.000'} [2023-02-25 14:30:56,753][36138] Updated weights for policy 0, policy_version 52203 (0.0009) [2023-02-25 14:30:57,809][36156] DAMAGECOUNT value on done: 1131352.0 [2023-02-25 14:30:57,810][36156] Sum rewards: 52.639, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.747', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon5': '0.202', 'weapon2': '0.224', 'weapon4': '0.248', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '2.910', 'weapon3': '3.016', 'DAMAGECOUNT': '15.528', 'FRAGCOUNT': '48.000'} [2023-02-25 14:30:57,863][36156] DAMAGECOUNT value on done: 1125766.0 [2023-02-25 14:30:57,864][36156] Sum rewards: 65.811, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.070', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon5': '0.098', 'weapon4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.366', 'WEAPON3': '1.200', 'weapon3': '3.234', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.854', 'FRAGCOUNT': '54.000'} [2023-02-25 14:30:58,113][36156] DAMAGECOUNT value on done: 1113302.0 [2023-02-25 14:30:58,113][36156] Sum rewards: 54.644, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.414', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.118', 'AMMO3': '0.161', 'weapon2': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.418', 'WEAPON3': '1.050', 'HITCOUNT': '2.830', 'weapon3': '2.964', 'DAMAGECOUNT': '13.875', 'FRAGCOUNT': '46.000'} [2023-02-25 14:30:58,170][36156] DAMAGECOUNT value on done: 1110950.0 [2023-02-25 14:30:58,170][36156] Sum rewards: 58.594, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.798', 'AMMO5': '0.010', 'AMMO2': '0.041', 'AMMO3': '0.196', 'AMMO4': '0.203', 'weapon5': '0.204', 'weapon2': '0.224', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'ARMOR': '0.455', 'weapon4': '0.798', 'WEAPON3': '1.100', 'weapon3': '2.432', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '14.589', 'FRAGCOUNT': '51.000'} [2023-02-25 14:30:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13312.0, 300 sec: 13384.9). Total num frames: 213860352. Throughput: 0: 3344.8. Samples: 15959908. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:30:59,730][36114] Avg episode reward: [(0, '56.054')] [2023-02-25 14:30:59,789][36138] Updated weights for policy 0, policy_version 52213 (0.0009) [2023-02-25 14:31:02,863][36138] Updated weights for policy 0, policy_version 52223 (0.0008) [2023-02-25 14:31:03,071][36142] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:31:04,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 213929984. Throughput: 0: 3351.8. Samples: 15980256. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:31:04,730][36114] Avg episode reward: [(0, '56.054')] [2023-02-25 14:31:05,898][36138] Updated weights for policy 0, policy_version 52233 (0.0009) [2023-02-25 14:31:08,922][36138] Updated weights for policy 0, policy_version 52243 (0.0009) [2023-02-25 14:31:08,924][36141] DAMAGECOUNT value on done: 1127898.0 [2023-02-25 14:31:08,925][36141] Sum rewards: 62.284, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.190', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO3': '0.187', 'weapon4': '0.258', 'weapon2': '0.316', 'WEAPON3': '1.100', 'weapon3': '3.114', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.823', 'FRAGCOUNT': '52.000'} [2023-02-25 14:31:08,962][36154] DAMAGECOUNT value on done: 1130658.0 [2023-02-25 14:31:08,962][36154] Sum rewards: 72.478, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.622', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.066', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.236', 'AMMO3': '0.243', 'WEAPON3': '1.450', 'weapon3': '3.450', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.766', 'FRAGCOUNT': '62.000'} [2023-02-25 14:31:09,163][36154] DAMAGECOUNT value on done: 1127569.0 [2023-02-25 14:31:09,164][36154] Sum rewards: 47.702, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.560', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.096', 'AMMO4': '0.177', 'AMMO3': '0.187', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.416', 'weapon2': '0.536', 'WEAPON3': '1.200', 'weapon3': '2.732', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '13.080', 'FRAGCOUNT': '42.000'} [2023-02-25 14:31:09,215][36141] DAMAGECOUNT value on done: 1117669.0 [2023-02-25 14:31:09,215][36141] Sum rewards: 62.060, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.072', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.224', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.336', 'weapon2': '0.362', 'WEAPON3': '1.550', 'weapon3': '2.748', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '56.000'} [2023-02-25 14:31:09,235][36141] DAMAGECOUNT value on done: 1126139.0 [2023-02-25 14:31:09,235][36141] Sum rewards: 47.793, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.636', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.482', 'WEAPON3': '1.250', 'weapon3': '2.738', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.384', 'FRAGCOUNT': '42.000'} [2023-02-25 14:31:09,279][36154] DAMAGECOUNT value on done: 1111687.0 [2023-02-25 14:31:09,280][36154] Sum rewards: 52.690, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.622', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon5': '0.096', 'AMMO4': '0.108', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.390', 'weapon2': '0.614', 'WEAPON3': '1.400', 'weapon3': '2.634', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.715', 'FRAGCOUNT': '47.000'} [2023-02-25 14:31:09,489][36154] DAMAGECOUNT value on done: 1123006.0 [2023-02-25 14:31:09,490][36154] Sum rewards: 58.703, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.007', 'AMMO2': '0.031', 'HEALTH': '0.040', 'AMMO3': '0.112', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'weapon5': '0.230', 'weapon2': '0.264', 'WEAPON4': '0.300', 'WEAPON3': '0.650', 'weapon4': '0.940', 'weapon3': '2.326', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.329', 'FRAGCOUNT': '47.000'} [2023-02-25 14:31:09,534][36141] DAMAGECOUNT value on done: 1109702.0 [2023-02-25 14:31:09,534][36141] Sum rewards: 48.742, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.160', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.044', 'AMMO4': '0.136', 'AMMO3': '0.148', 'WEAPON5': '0.200', 'weapon4': '0.288', 'WEAPON4': '0.300', 'WEAPON3': '0.800', 'weapon2': '1.010', 'weapon3': '2.360', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '12.441', 'FRAGCOUNT': '40.000'} [2023-02-25 14:31:09,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 213995520. Throughput: 0: 3353.8. Samples: 15990334. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:31:09,729][36114] Avg episode reward: [(0, '56.121')] [2023-02-25 14:31:11,133][36155] DAMAGECOUNT value on done: 1113935.0 [2023-02-25 14:31:11,133][36155] Sum rewards: 51.043, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.129', 'AMMO2': '0.013', 'AMMO5': '0.017', 'AMMO4': '0.067', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'weapon5': '0.254', 'WEAPON5': '0.350', 'weapon2': '0.430', 'weapon4': '0.506', 'WEAPON3': '1.150', 'weapon3': '2.574', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '14.403', 'FRAGCOUNT': '44.000'} [2023-02-25 14:31:11,450][36155] DAMAGECOUNT value on done: 1121745.0 [2023-02-25 14:31:11,450][36155] Sum rewards: 50.316, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.810', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.194', 'weapon2': '0.260', 'WEAPON4': '0.300', 'weapon4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.896', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.911', 'FRAGCOUNT': '44.000'} [2023-02-25 14:31:11,772][36157] DAMAGECOUNT value on done: 1130451.0 [2023-02-25 14:31:11,773][36157] Sum rewards: 36.556, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.690', 'AMMO5': '0.013', 'AMMO2': '0.043', 'AMMO3': '0.167', 'AMMO4': '0.216', 'weapon5': '0.270', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.512', 'weapon2': '0.526', 'WEAPON3': '0.950', 'weapon3': '2.218', 'HITCOUNT': '2.370', 'DAMAGECOUNT': '10.761', 'FRAGCOUNT': '35.000'} [2023-02-25 14:31:11,977][36138] Updated weights for policy 0, policy_version 52253 (0.0009) [2023-02-25 14:31:12,085][36157] DAMAGECOUNT value on done: 1120372.0 [2023-02-25 14:31:12,085][36157] Sum rewards: 51.648, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.660', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.106', 'AMMO4': '0.149', 'weapon4': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.522', 'WEAPON3': '1.250', 'HITCOUNT': '2.900', 'weapon3': '2.976', 'DAMAGECOUNT': '14.058', 'FRAGCOUNT': '45.000'} [2023-02-25 14:31:12,323][36155] DAMAGECOUNT value on done: 1137471.0 [2023-02-25 14:31:12,324][36155] Sum rewards: 54.520, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.622', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.142', 'weapon4': '0.170', 'AMMO3': '0.191', 'AMMO4': '0.218', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.970', 'weapon3': '3.124', 'DAMAGECOUNT': '14.649', 'FRAGCOUNT': '50.000'} [2023-02-25 14:31:12,372][36139] DAMAGECOUNT value on done: 1118714.0 [2023-02-25 14:31:12,373][36139] Sum rewards: 57.355, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.146', 'AMMO5': '0.010', 'AMMO2': '0.040', 'AMMO3': '0.121', 'weapon5': '0.136', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'weapon2': '0.212', 'WEAPON4': '0.300', 'WEAPON3': '0.750', 'weapon4': '0.884', 'weapon3': '2.326', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.490', 'FRAGCOUNT': '46.000'} [2023-02-25 14:31:12,537][36157] DAMAGECOUNT value on done: 1132963.0 [2023-02-25 14:31:12,537][36157] Sum rewards: 63.122, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.710', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.100', 'AMMO3': '0.158', 'AMMO4': '0.195', 'WEAPON5': '0.200', 'weapon4': '0.422', 'WEAPON4': '0.450', 'weapon2': '0.490', 'WEAPON3': '0.950', 'weapon3': '2.778', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.735', 'FRAGCOUNT': '53.000'} [2023-02-25 14:31:12,614][36155] DAMAGECOUNT value on done: 1117088.0 [2023-02-25 14:31:12,615][36155] Sum rewards: 58.335, reward structure: {'DEATHCOUNT': '-9.750', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.072', 'HEALTH': '0.090', 'AMMO3': '0.126', 'weapon5': '0.156', 'weapon2': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.750', 'weapon4': '0.750', 'weapon3': '2.654', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '14.079', 'FRAGCOUNT': '46.000'} [2023-02-25 14:31:12,676][36139] DAMAGECOUNT value on done: 1119073.0 [2023-02-25 14:31:12,676][36139] Sum rewards: 42.010, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.128', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.041', 'AMMO4': '0.207', 'weapon5': '0.240', 'AMMO3': '0.248', 'weapon2': '0.332', 'weapon4': '0.340', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'HITCOUNT': '2.250', 'weapon3': '2.768', 'DAMAGECOUNT': '12.039', 'FRAGCOUNT': '41.500'} [2023-02-25 14:31:12,839][36157] DAMAGECOUNT value on done: 1126503.0 [2023-02-25 14:31:12,840][36157] Sum rewards: 56.632, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.220', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.132', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'weapon2': '0.216', 'WEAPON4': '0.250', 'weapon4': '0.528', 'WEAPON3': '1.150', 'weapon3': '2.860', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.198', 'FRAGCOUNT': '49.000'} [2023-02-25 14:31:12,994][36139] DAMAGECOUNT value on done: 1133606.0 [2023-02-25 14:31:12,994][36139] Sum rewards: 53.365, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.876', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon4': '0.068', 'weapon5': '0.132', 'AMMO4': '0.185', 'AMMO3': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.200', 'HITCOUNT': '2.750', 'weapon3': '3.206', 'DAMAGECOUNT': '13.953', 'FRAGCOUNT': '47.000'} [2023-02-25 14:31:13,224][36140] DAMAGECOUNT value on done: 1122843.0 [2023-02-25 14:31:13,225][36140] Sum rewards: 58.823, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.595', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO4': '0.178', 'AMMO3': '0.188', 'weapon5': '0.204', 'weapon4': '0.398', 'weapon2': '0.402', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.696', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.147', 'FRAGCOUNT': '51.000'} [2023-02-25 14:31:13,316][36139] DAMAGECOUNT value on done: 1125453.0 [2023-02-25 14:31:13,316][36139] Sum rewards: 43.313, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.470', 'ARMOR': '0.008', 'AMMO5': '0.027', 'AMMO2': '0.051', 'AMMO3': '0.183', 'AMMO4': '0.255', 'weapon2': '0.374', 'weapon5': '0.406', 'WEAPON5': '0.750', 'WEAPON4': '0.750', 'weapon4': '0.824', 'WEAPON3': '1.050', 'weapon3': '1.962', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '12.792', 'FRAGCOUNT': '41.000'} [2023-02-25 14:31:13,538][36140] DAMAGECOUNT value on done: 1127643.0 [2023-02-25 14:31:13,538][36140] Sum rewards: 60.694, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.070', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO3': '0.230', 'weapon2': '0.286', 'WEAPON3': '1.300', 'HITCOUNT': '3.100', 'weapon3': '3.590', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '51.000'} [2023-02-25 14:31:13,558][36140] DAMAGECOUNT value on done: 1115138.0 [2023-02-25 14:31:13,559][36140] Sum rewards: 64.828, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.316', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.117', 'weapon5': '0.148', 'weapon4': '0.206', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.410', 'WEAPON3': '1.350', 'weapon3': '2.992', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '55.000'} [2023-02-25 14:31:13,858][36140] DAMAGECOUNT value on done: 1115597.0 [2023-02-25 14:31:13,859][36140] Sum rewards: 60.020, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.568', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.134', 'AMMO3': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.568', 'weapon4': '0.782', 'WEAPON3': '0.950', 'weapon3': '2.226', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.886', 'FRAGCOUNT': '49.000'} [2023-02-25 14:31:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13384.9). Total num frames: 214065152. Throughput: 0: 3358.7. Samples: 16010464. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:31:14,729][36114] Avg episode reward: [(0, '55.897')] [2023-02-25 14:31:14,944][36138] Updated weights for policy 0, policy_version 52263 (0.0009) [2023-02-25 14:31:15,389][36142] DAMAGECOUNT value on done: 1123632.0 [2023-02-25 14:31:15,390][36142] Sum rewards: 60.334, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.828', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon5': '0.096', 'AMMO4': '0.118', 'weapon4': '0.118', 'AMMO3': '0.147', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.546', 'WEAPON3': '1.000', 'HITCOUNT': '2.910', 'weapon3': '3.032', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '50.000'} [2023-02-25 14:31:15,701][36142] DAMAGECOUNT value on done: 1109274.0 [2023-02-25 14:31:15,701][36142] Sum rewards: 64.420, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.190', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.032', 'weapon5': '0.074', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'weapon2': '0.744', 'WEAPON3': '1.000', 'HITCOUNT': '2.900', 'weapon3': '2.946', 'DAMAGECOUNT': '14.310', 'FRAGCOUNT': '55.000'} [2023-02-25 14:31:15,901][36140] Large shaping reward 2.597 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5760000000000001, 192.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:31:16,203][36142] DAMAGECOUNT value on done: 1122168.0 [2023-02-25 14:31:16,203][36142] Sum rewards: 52.853, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.160', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.032', 'weapon5': '0.102', 'AMMO4': '0.161', 'AMMO3': '0.173', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.384', 'weapon2': '0.436', 'WEAPON3': '1.050', 'weapon3': '2.702', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.290', 'FRAGCOUNT': '45.500'} [2023-02-25 14:31:16,496][36142] DAMAGECOUNT value on done: 1132513.0 [2023-02-25 14:31:16,497][36142] Sum rewards: 49.387, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.031', 'AMMO5': '0.014', 'AMMO2': '0.052', 'weapon5': '0.216', 'AMMO3': '0.254', 'AMMO4': '0.259', 'weapon2': '0.364', 'WEAPON5': '0.400', 'weapon4': '0.490', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.576', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.913', 'FRAGCOUNT': '47.000'} [2023-02-25 14:31:17,719][36156] DAMAGECOUNT value on done: 1136619.0 [2023-02-25 14:31:17,720][36156] Sum rewards: 62.822, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.932', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.102', 'weapon5': '0.144', 'weapon4': '0.190', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.256', 'WEAPON3': '1.250', 'HITCOUNT': '2.870', 'weapon3': '3.178', 'DAMAGECOUNT': '15.792', 'FRAGCOUNT': '54.000'} [2023-02-25 14:31:17,770][36156] DAMAGECOUNT value on done: 1131163.0 [2023-02-25 14:31:17,771][36156] Sum rewards: 62.267, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.200', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.013', 'weapon5': '0.044', 'AMMO4': '0.066', 'weapon7': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.224', 'weapon2': '0.474', 'weapon4': '0.580', 'WEAPON3': '1.250', 'weapon3': '2.542', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '51.000'} [2023-02-25 14:31:17,955][36138] Updated weights for policy 0, policy_version 52273 (0.0009) [2023-02-25 14:31:18,033][36156] DAMAGECOUNT value on done: 1117983.0 [2023-02-25 14:31:18,034][36156] Sum rewards: 57.424, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.960', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.047', 'AMMO3': '0.177', 'weapon5': '0.194', 'AMMO4': '0.235', 'weapon4': '0.334', 'WEAPON5': '0.350', 'weapon2': '0.388', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.754', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.043', 'FRAGCOUNT': '51.000'} [2023-02-25 14:31:18,082][36156] DAMAGECOUNT value on done: 1116384.0 [2023-02-25 14:31:18,082][36156] Sum rewards: 66.894, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.200', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.132', 'AMMO4': '0.174', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.232', 'weapon4': '0.522', 'WEAPON3': '1.200', 'weapon3': '2.848', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '56.000'} [2023-02-25 14:31:19,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 214130688. Throughput: 0: 3364.0. Samples: 16030824. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:31:19,729][36114] Avg episode reward: [(0, '56.081')] [2023-02-25 14:31:19,733][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000052278_214130688.pth... [2023-02-25 14:31:19,792][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000051494_210919424.pth [2023-02-25 14:31:21,041][36138] Updated weights for policy 0, policy_version 52283 (0.0009) [2023-02-25 14:31:24,095][36138] Updated weights for policy 0, policy_version 52293 (0.0009) [2023-02-25 14:31:24,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 214200320. Throughput: 0: 3359.4. Samples: 16040716. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:31:24,730][36114] Avg episode reward: [(0, '56.081')] [2023-02-25 14:31:27,201][36138] Updated weights for policy 0, policy_version 52303 (0.0009) [2023-02-25 14:31:28,977][36141] DAMAGECOUNT value on done: 1132828.0 [2023-02-25 14:31:28,978][36141] Sum rewards: 62.078, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.160', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO3': '0.145', 'AMMO4': '0.148', 'weapon5': '0.180', 'weapon2': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.362', 'WEAPON3': '0.850', 'weapon3': '2.974', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.790', 'FRAGCOUNT': '51.000'} [2023-02-25 14:31:29,038][36154] DAMAGECOUNT value on done: 1136947.0 [2023-02-25 14:31:29,039][36154] Sum rewards: 73.418, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.478', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon2': '0.176', 'AMMO3': '0.196', 'weapon5': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.542', 'WEAPON3': '1.300', 'weapon3': '2.806', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.867', 'FRAGCOUNT': '62.000'} [2023-02-25 14:31:29,231][36154] DAMAGECOUNT value on done: 1132306.0 [2023-02-25 14:31:29,231][36154] Sum rewards: 56.602, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.020', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.152', 'weapon5': '0.198', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.626', 'WEAPON3': '0.850', 'weapon3': '2.558', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.211', 'FRAGCOUNT': '47.000'} [2023-02-25 14:31:29,289][36141] DAMAGECOUNT value on done: 1122642.0 [2023-02-25 14:31:29,290][36141] Sum rewards: 58.469, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.134', 'AMMO4': '0.191', 'weapon2': '0.208', 'weapon5': '0.226', 'HEALTH': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.398', 'WEAPON3': '0.750', 'weapon3': '2.652', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '48.000'} [2023-02-25 14:31:29,313][36141] DAMAGECOUNT value on done: 1130513.0 [2023-02-25 14:31:29,313][36141] Sum rewards: 46.088, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.770', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon2': '0.134', 'weapon5': '0.150', 'AMMO3': '0.232', 'weapon4': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '2.590', 'weapon3': '3.134', 'DAMAGECOUNT': '13.122', 'FRAGCOUNT': '42.000'} [2023-02-25 14:31:29,345][36154] DAMAGECOUNT value on done: 1117034.0 [2023-02-25 14:31:29,345][36154] Sum rewards: 58.989, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.610', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO4': '0.185', 'weapon5': '0.214', 'AMMO3': '0.238', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.390', 'WEAPON3': '1.400', 'weapon3': '2.830', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '52.000'} [2023-02-25 14:31:29,536][36154] DAMAGECOUNT value on done: 1127502.0 [2023-02-25 14:31:29,536][36154] Sum rewards: 54.655, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.855', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.057', 'weapon5': '0.110', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'weapon2': '0.204', 'WEAPON4': '0.250', 'weapon4': '0.696', 'WEAPON3': '0.950', 'weapon3': '2.784', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.488', 'FRAGCOUNT': '45.000'} [2023-02-25 14:31:29,586][36141] DAMAGECOUNT value on done: 1115448.0 [2023-02-25 14:31:29,587][36141] Sum rewards: 67.735, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.695', 'AMMO5': '0.020', 'AMMO2': '0.046', 'AMMO3': '0.126', 'weapon5': '0.140', 'weapon2': '0.218', 'AMMO4': '0.228', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.722', 'WEAPON3': '0.750', 'weapon3': '2.682', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '54.000'} [2023-02-25 14:31:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 214265856. Throughput: 0: 3358.4. Samples: 16060778. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:31:29,730][36114] Avg episode reward: [(0, '56.349')] [2023-02-25 14:31:30,266][36138] Updated weights for policy 0, policy_version 52313 (0.0009) [2023-02-25 14:31:31,047][36155] DAMAGECOUNT value on done: 1118794.0 [2023-02-25 14:31:31,048][36155] Sum rewards: 62.762, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.520', 'AMMO2': '0.007', 'AMMO4': '0.032', 'weapon4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.202', 'weapon2': '0.236', 'WEAPON3': '1.400', 'HITCOUNT': '3.230', 'weapon3': '3.406', 'DAMAGECOUNT': '14.577', 'FRAGCOUNT': '54.000'} [2023-02-25 14:31:31,382][36155] DAMAGECOUNT value on done: 1125502.0 [2023-02-25 14:31:31,383][36155] Sum rewards: 42.390, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.391', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.137', 'weapon5': '0.144', 'AMMO3': '0.158', 'weapon4': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.736', 'WEAPON3': '0.850', 'HITCOUNT': '2.250', 'weapon3': '2.704', 'DAMAGECOUNT': '11.271', 'FRAGCOUNT': '35.000'} [2023-02-25 14:31:31,931][36157] DAMAGECOUNT value on done: 1135213.0 [2023-02-25 14:31:31,931][36157] Sum rewards: 53.927, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.764', 'AMMO5': '0.019', 'AMMO2': '0.052', 'AMMO3': '0.194', 'weapon2': '0.228', 'weapon5': '0.228', 'AMMO4': '0.258', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.814', 'WEAPON3': '1.150', 'weapon3': '2.332', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '14.286', 'FRAGCOUNT': '49.000'} [2023-02-25 14:31:32,229][36157] DAMAGECOUNT value on done: 1125503.0 [2023-02-25 14:31:32,230][36157] Sum rewards: 60.245, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.932', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.047', 'AMMO3': '0.168', 'AMMO4': '0.233', 'WEAPON5': '0.250', 'weapon5': '0.286', 'WEAPON4': '0.400', 'weapon2': '0.480', 'weapon4': '0.932', 'WEAPON3': '1.000', 'weapon3': '1.772', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.393', 'FRAGCOUNT': '50.500'} [2023-02-25 14:31:32,277][36155] DAMAGECOUNT value on done: 1142626.0 [2023-02-25 14:31:32,278][36155] Sum rewards: 62.349, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.448', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.104', 'AMMO4': '0.113', 'AMMO3': '0.134', 'weapon4': '0.248', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.800', 'HITCOUNT': '3.090', 'weapon3': '3.202', 'DAMAGECOUNT': '15.465', 'FRAGCOUNT': '50.000'} [2023-02-25 14:31:32,387][36139] DAMAGECOUNT value on done: 1123680.0 [2023-02-25 14:31:32,387][36139] Sum rewards: 51.729, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.171', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.136', 'AMMO3': '0.176', 'weapon5': '0.210', 'WEAPON5': '0.300', 'weapon2': '0.442', 'WEAPON4': '0.500', 'weapon4': '0.658', 'WEAPON3': '1.100', 'weapon3': '2.418', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.898', 'FRAGCOUNT': '46.000'} [2023-02-25 14:31:32,588][36155] DAMAGECOUNT value on done: 1122221.0 [2023-02-25 14:31:32,589][36155] Sum rewards: 61.928, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.210', 'ARMOR': '0.005', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon5': '0.090', 'AMMO4': '0.112', 'AMMO3': '0.171', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.402', 'weapon2': '0.506', 'WEAPON3': '1.150', 'weapon3': '2.766', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.399', 'FRAGCOUNT': '53.000'} [2023-02-25 14:31:32,653][36157] DAMAGECOUNT value on done: 1137762.0 [2023-02-25 14:31:32,654][36157] Sum rewards: 55.916, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.496', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon5': '0.124', 'WEAPON4': '0.200', 'weapon2': '0.208', 'AMMO3': '0.210', 'weapon4': '0.620', 'WEAPON3': '1.300', 'weapon3': '2.836', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.397', 'FRAGCOUNT': '48.000'} [2023-02-25 14:31:32,700][36139] DAMAGECOUNT value on done: 1123612.0 [2023-02-25 14:31:32,700][36139] Sum rewards: 55.365, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.430', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.086', 'AMMO3': '0.113', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.354', 'weapon4': '0.762', 'WEAPON3': '0.800', 'weapon3': '2.572', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.617', 'FRAGCOUNT': '44.000'} [2023-02-25 14:31:32,965][36157] DAMAGECOUNT value on done: 1131596.0 [2023-02-25 14:31:32,965][36157] Sum rewards: 58.611, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.609', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO4': '0.111', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'weapon2': '0.304', 'weapon4': '0.758', 'WEAPON3': '1.250', 'weapon3': '2.624', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.279', 'FRAGCOUNT': '51.000'} [2023-02-25 14:31:33,063][36139] DAMAGECOUNT value on done: 1139035.0 [2023-02-25 14:31:33,063][36139] Sum rewards: 62.596, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.199', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon5': '0.164', 'weapon2': '0.190', 'AMMO3': '0.277', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.544', 'WEAPON3': '1.600', 'weapon3': '2.808', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '56.000'} [2023-02-25 14:31:33,362][36139] DAMAGECOUNT value on done: 1130850.0 [2023-02-25 14:31:33,363][36139] Sum rewards: 62.161, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.410', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon2': '0.344', 'WEAPON3': '1.300', 'HITCOUNT': '3.000', 'weapon3': '3.352', 'DAMAGECOUNT': '15.876', 'FRAGCOUNT': '52.000'} [2023-02-25 14:31:33,378][36138] Updated weights for policy 0, policy_version 52323 (0.0009) [2023-02-25 14:31:33,435][36140] DAMAGECOUNT value on done: 1128165.0 [2023-02-25 14:31:33,436][36140] Sum rewards: 54.533, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.110', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.130', 'weapon4': '0.226', 'AMMO3': '0.263', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.710', 'WEAPON3': '1.500', 'weapon3': '2.670', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.966', 'FRAGCOUNT': '48.000'} [2023-02-25 14:31:33,699][36140] DAMAGECOUNT value on done: 1131913.0 [2023-02-25 14:31:33,700][36140] Sum rewards: 48.382, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.372', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon5': '0.194', 'AMMO3': '0.197', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.452', 'weapon2': '0.490', 'WEAPON3': '1.100', 'weapon3': '2.448', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.810', 'FRAGCOUNT': '42.000'} [2023-02-25 14:31:33,735][36140] DAMAGECOUNT value on done: 1120109.0 [2023-02-25 14:31:33,736][36140] Sum rewards: 56.524, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.350', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.133', 'weapon5': '0.264', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.486', 'weapon4': '0.598', 'WEAPON3': '0.900', 'weapon3': '2.298', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.913', 'FRAGCOUNT': '47.000'} [2023-02-25 14:31:34,019][36140] DAMAGECOUNT value on done: 1120020.0 [2023-02-25 14:31:34,019][36140] Sum rewards: 48.660, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.165', 'AMMO5': '0.012', 'AMMO2': '0.048', 'AMMO3': '0.173', 'weapon5': '0.208', 'AMMO4': '0.239', 'weapon4': '0.312', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.796', 'WEAPON3': '1.050', 'weapon3': '2.308', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.269', 'FRAGCOUNT': '43.000'} [2023-02-25 14:31:34,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13371.0). Total num frames: 214331392. Throughput: 0: 3354.8. Samples: 16080612. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:31:34,730][36114] Avg episode reward: [(0, '56.471')] [2023-02-25 14:31:35,637][36142] DAMAGECOUNT value on done: 1128723.0 [2023-02-25 14:31:35,637][36142] Sum rewards: 60.590, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.885', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.122', 'AMMO3': '0.147', 'weapon2': '0.234', 'weapon5': '0.298', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.712', 'WEAPON3': '0.950', 'weapon3': '2.468', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.273', 'FRAGCOUNT': '51.000'} [2023-02-25 14:31:35,949][36142] DAMAGECOUNT value on done: 1114366.0 [2023-02-25 14:31:35,950][36142] Sum rewards: 53.720, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.285', 'AMMO5': '0.007', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon5': '0.160', 'WEAPON5': '0.250', 'AMMO3': '0.263', 'WEAPON4': '0.300', 'weapon2': '0.432', 'weapon4': '0.576', 'WEAPON3': '1.450', 'weapon3': '2.356', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.276', 'FRAGCOUNT': '49.000'} [2023-02-25 14:31:36,422][36138] Updated weights for policy 0, policy_version 52333 (0.0009) [2023-02-25 14:31:36,483][36142] DAMAGECOUNT value on done: 1126547.0 [2023-02-25 14:31:36,483][36142] Sum rewards: 47.441, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.361', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon5': '0.100', 'weapon4': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.332', 'WEAPON3': '1.100', 'HITCOUNT': '2.540', 'weapon3': '3.270', 'DAMAGECOUNT': '13.137', 'FRAGCOUNT': '41.000'} [2023-02-25 14:31:36,784][36142] DAMAGECOUNT value on done: 1137646.0 [2023-02-25 14:31:36,784][36142] Sum rewards: 58.105, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.897', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.040', 'AMMO3': '0.188', 'AMMO4': '0.202', 'weapon2': '0.224', 'weapon5': '0.266', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.532', 'WEAPON3': '1.200', 'weapon3': '2.524', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '15.399', 'FRAGCOUNT': '51.000'} [2023-02-25 14:31:37,866][36156] DAMAGECOUNT value on done: 1141881.0 [2023-02-25 14:31:37,866][36156] Sum rewards: 60.119, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.330', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO4': '0.178', 'weapon5': '0.180', 'AMMO3': '0.249', 'weapon2': '0.264', 'WEAPON5': '0.300', 'weapon4': '0.328', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.932', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.786', 'FRAGCOUNT': '55.000'} [2023-02-25 14:31:37,947][36156] DAMAGECOUNT value on done: 1136536.0 [2023-02-25 14:31:37,948][36156] Sum rewards: 58.750, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.095', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon2': '0.120', 'AMMO4': '0.125', 'weapon5': '0.182', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.336', 'WEAPON3': '1.300', 'HITCOUNT': '3.130', 'weapon3': '3.190', 'DAMAGECOUNT': '16.119', 'FRAGCOUNT': '50.000'} [2023-02-25 14:31:38,201][36156] DAMAGECOUNT value on done: 1121479.0 [2023-02-25 14:31:38,201][36156] Sum rewards: 34.239, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.488', 'AMMO5': '0.017', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.170', 'weapon5': '0.304', 'WEAPON4': '0.400', 'weapon2': '0.474', 'WEAPON5': '0.500', 'weapon4': '0.562', 'WEAPON3': '1.000', 'HITCOUNT': '2.320', 'weapon3': '2.374', 'DAMAGECOUNT': '10.188', 'FRAGCOUNT': '31.000'} [2023-02-25 14:31:38,290][36156] DAMAGECOUNT value on done: 1120614.0 [2023-02-25 14:31:38,290][36156] Sum rewards: 48.311, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.274', 'AMMO5': '0.006', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'weapon2': '0.394', 'weapon4': '0.820', 'WEAPON3': '1.150', 'weapon3': '2.526', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.690', 'FRAGCOUNT': '42.000'} [2023-02-25 14:31:38,730][36141] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:31:39,478][36138] Updated weights for policy 0, policy_version 52343 (0.0009) [2023-02-25 14:31:39,729][36114] Fps is (10 sec: 13106.9, 60 sec: 13380.2, 300 sec: 13371.0). Total num frames: 214396928. Throughput: 0: 3355.0. Samples: 16090734. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:31:39,730][36114] Avg episode reward: [(0, '55.801')] [2023-02-25 14:31:42,535][36138] Updated weights for policy 0, policy_version 52353 (0.0010) [2023-02-25 14:31:43,858][36142] Large shaping reward -2.506 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0)] [2023-02-25 14:31:44,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 214466560. Throughput: 0: 3354.3. Samples: 16110850. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:31:44,730][36114] Avg episode reward: [(0, '55.801')] [2023-02-25 14:31:45,598][36138] Updated weights for policy 0, policy_version 52363 (0.0009) [2023-02-25 14:31:48,664][36138] Updated weights for policy 0, policy_version 52373 (0.0009) [2023-02-25 14:31:49,025][36141] DAMAGECOUNT value on done: 1138220.0 [2023-02-25 14:31:49,026][36141] Sum rewards: 62.914, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.700', 'ARMOR': '0.004', 'AMMO5': '0.017', 'weapon5': '0.040', 'AMMO2': '0.040', 'AMMO4': '0.202', 'weapon2': '0.204', 'AMMO3': '0.237', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.588', 'WEAPON3': '1.350', 'weapon3': '2.826', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '56.000'} [2023-02-25 14:31:49,036][36154] DAMAGECOUNT value on done: 1141898.0 [2023-02-25 14:31:49,037][36154] Sum rewards: 61.469, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.670', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.168', 'AMMO3': '0.186', 'weapon2': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.396', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.930', 'weapon3': '2.950', 'DAMAGECOUNT': '14.853', 'FRAGCOUNT': '53.000'} [2023-02-25 14:31:49,250][36154] DAMAGECOUNT value on done: 1137089.0 [2023-02-25 14:31:49,250][36154] Sum rewards: 56.109, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.070', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.080', 'AMMO4': '0.156', 'AMMO3': '0.178', 'weapon2': '0.192', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.672', 'WEAPON3': '1.100', 'weapon3': '2.738', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '14.349', 'FRAGCOUNT': '48.000'} [2023-02-25 14:31:49,322][36141] DAMAGECOUNT value on done: 1127520.0 [2023-02-25 14:31:49,322][36141] Sum rewards: 56.132, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.300', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.108', 'weapon4': '0.132', 'AMMO3': '0.201', 'weapon2': '0.558', 'WEAPON3': '1.300', 'HITCOUNT': '2.980', 'weapon3': '3.030', 'DAMAGECOUNT': '14.634', 'FRAGCOUNT': '48.000'} [2023-02-25 14:31:49,340][36141] DAMAGECOUNT value on done: 1135088.0 [2023-02-25 14:31:49,340][36141] Sum rewards: 52.079, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.959', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.058', 'AMMO4': '0.110', 'weapon2': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'weapon4': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '2.960', 'weapon3': '3.228', 'DAMAGECOUNT': '13.725', 'FRAGCOUNT': '48.000'} [2023-02-25 14:31:49,362][36154] DAMAGECOUNT value on done: 1122013.0 [2023-02-25 14:31:49,363][36154] Sum rewards: 60.647, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.262', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.084', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'WEAPON4': '0.300', 'weapon4': '0.310', 'weapon2': '0.596', 'WEAPON3': '1.000', 'weapon3': '2.728', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.931', 'FRAGCOUNT': '50.000'} [2023-02-25 14:31:49,582][36154] DAMAGECOUNT value on done: 1132070.0 [2023-02-25 14:31:49,583][36154] Sum rewards: 53.356, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.862', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.139', 'AMMO4': '0.188', 'weapon2': '0.212', 'weapon5': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.542', 'WEAPON3': '0.900', 'weapon3': '2.562', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.704', 'FRAGCOUNT': '45.000'} [2023-02-25 14:31:49,642][36141] DAMAGECOUNT value on done: 1119732.0 [2023-02-25 14:31:49,643][36141] Sum rewards: 49.479, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.181', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.104', 'AMMO3': '0.163', 'weapon2': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.692', 'WEAPON3': '1.050', 'weapon3': '2.618', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '12.786', 'FRAGCOUNT': '42.000'} [2023-02-25 14:31:49,729][36114] Fps is (10 sec: 13517.2, 60 sec: 13448.5, 300 sec: 13371.0). Total num frames: 214532096. Throughput: 0: 3348.0. Samples: 16130916. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:31:49,730][36114] Avg episode reward: [(0, '56.096')] [2023-02-25 14:31:51,175][36155] DAMAGECOUNT value on done: 1124079.0 [2023-02-25 14:31:51,175][36155] Sum rewards: 59.515, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.462', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.172', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.356', 'weapon4': '0.356', 'WEAPON3': '1.200', 'weapon3': '2.858', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '49.000'} [2023-02-25 14:31:51,484][36155] DAMAGECOUNT value on done: 1130556.0 [2023-02-25 14:31:51,484][36155] Sum rewards: 60.366, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.117', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.236', 'weapon4': '0.266', 'WEAPON3': '1.300', 'HITCOUNT': '2.980', 'weapon3': '3.124', 'DAMAGECOUNT': '15.162', 'FRAGCOUNT': '52.000'} [2023-02-25 14:31:51,705][36138] Updated weights for policy 0, policy_version 52383 (0.0009) [2023-02-25 14:31:51,963][36157] DAMAGECOUNT value on done: 1140271.0 [2023-02-25 14:31:51,963][36157] Sum rewards: 60.054, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.232', 'weapon5': '0.002', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.013', 'weapon4': '0.014', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'AMMO3': '0.157', 'WEAPON5': '0.250', 'weapon2': '0.444', 'WEAPON3': '1.050', 'HITCOUNT': '3.120', 'weapon3': '3.384', 'DAMAGECOUNT': '15.174', 'FRAGCOUNT': '48.000'} [2023-02-25 14:31:52,270][36157] DAMAGECOUNT value on done: 1130490.0 [2023-02-25 14:31:52,271][36157] Sum rewards: 59.624, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.400', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.050', 'weapon5': '0.120', 'AMMO4': '0.122', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.624', 'WEAPON3': '1.350', 'weapon3': '2.942', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.961', 'FRAGCOUNT': '53.000'} [2023-02-25 14:31:52,351][36155] DAMAGECOUNT value on done: 1147705.0 [2023-02-25 14:31:52,352][36155] Sum rewards: 53.117, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.400', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.044', 'AMMO4': '0.158', 'weapon4': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'WEAPON4': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.500', 'weapon3': '3.094', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.237', 'FRAGCOUNT': '49.500'} [2023-02-25 14:31:52,516][36139] DAMAGECOUNT value on done: 1128503.0 [2023-02-25 14:31:52,517][36139] Sum rewards: 53.983, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.183', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.039', 'AMMO3': '0.181', 'AMMO4': '0.197', 'weapon2': '0.248', 'weapon5': '0.304', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.586', 'WEAPON3': '1.050', 'weapon3': '2.470', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '14.469', 'FRAGCOUNT': '49.000'} [2023-02-25 14:31:52,662][36155] DAMAGECOUNT value on done: 1126910.0 [2023-02-25 14:31:52,663][36155] Sum rewards: 48.285, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.500', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.041', 'AMMO3': '0.181', 'AMMO4': '0.205', 'weapon5': '0.244', 'weapon2': '0.412', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.660', 'WEAPON3': '1.050', 'weapon3': '2.334', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '14.067', 'FRAGCOUNT': '45.000'} [2023-02-25 14:31:52,704][36157] DAMAGECOUNT value on done: 1142462.0 [2023-02-25 14:31:52,705][36157] Sum rewards: 48.668, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.040', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.035', 'weapon5': '0.146', 'AMMO4': '0.177', 'weapon4': '0.190', 'AMMO3': '0.241', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.630', 'WEAPON3': '1.450', 'weapon3': '2.776', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.100', 'FRAGCOUNT': '46.500'} [2023-02-25 14:31:52,822][36139] DAMAGECOUNT value on done: 1127753.0 [2023-02-25 14:31:52,823][36139] Sum rewards: 47.266, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.920', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO3': '0.169', 'AMMO4': '0.182', 'weapon5': '0.228', 'weapon2': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.466', 'WEAPON3': '0.950', 'weapon3': '2.506', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '12.390', 'FRAGCOUNT': '42.000'} [2023-02-25 14:31:53,006][36157] DAMAGECOUNT value on done: 1135655.0 [2023-02-25 14:31:53,007][36157] Sum rewards: 48.013, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.730', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.044', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.207', 'weapon4': '0.348', 'ARMOR': '0.408', 'weapon2': '0.474', 'WEAPON3': '1.250', 'weapon3': '2.736', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.177', 'FRAGCOUNT': '42.000'} [2023-02-25 14:31:53,155][36139] DAMAGECOUNT value on done: 1143634.0 [2023-02-25 14:31:53,156][36139] Sum rewards: 46.181, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.548', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.174', 'AMMO3': '0.176', 'AMMO4': '0.202', 'weapon2': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.884', 'WEAPON3': '1.150', 'weapon3': '2.378', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.794', 'FRAGCOUNT': '39.000'} [2023-02-25 14:31:53,339][36140] DAMAGECOUNT value on done: 1133129.0 [2023-02-25 14:31:53,339][36140] Sum rewards: 63.234, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.822', 'AMMO2': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon2': '0.366', 'weapon4': '0.446', 'WEAPON3': '1.150', 'weapon3': '2.976', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.892', 'FRAGCOUNT': '52.000'} [2023-02-25 14:31:53,468][36139] DAMAGECOUNT value on done: 1135820.0 [2023-02-25 14:31:53,468][36139] Sum rewards: 58.944, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.014', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.098', 'AMMO3': '0.181', 'AMMO4': '0.185', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.410', 'weapon4': '0.588', 'WEAPON3': '1.050', 'weapon3': '2.662', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '49.000'} [2023-02-25 14:31:53,618][36140] DAMAGECOUNT value on done: 1135405.0 [2023-02-25 14:31:53,619][36140] Sum rewards: 38.700, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.285', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'weapon5': '0.106', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'weapon2': '0.534', 'weapon4': '0.556', 'WEAPON3': '1.150', 'HITCOUNT': '2.230', 'weapon3': '2.580', 'DAMAGECOUNT': '10.476', 'FRAGCOUNT': '37.000'} [2023-02-25 14:31:53,657][36140] DAMAGECOUNT value on done: 1124376.0 [2023-02-25 14:31:53,658][36140] Sum rewards: 57.451, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.822', 'AMMO2': '0.007', 'AMMO5': '0.009', 'AMMO4': '0.036', 'AMMO3': '0.129', 'weapon5': '0.130', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.532', 'weapon4': '0.736', 'WEAPON3': '0.800', 'weapon3': '2.422', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.801', 'FRAGCOUNT': '47.000'} [2023-02-25 14:31:53,939][36140] DAMAGECOUNT value on done: 1124472.0 [2023-02-25 14:31:53,939][36140] Sum rewards: 51.440, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.050', 'AMMO4': '0.055', 'weapon4': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.246', 'HEALTH': '0.370', 'WEAPON3': '1.000', 'HITCOUNT': '2.800', 'weapon3': '3.426', 'DAMAGECOUNT': '13.356', 'FRAGCOUNT': '43.000'} [2023-02-25 14:31:54,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13371.0). Total num frames: 214597632. Throughput: 0: 3347.5. Samples: 16140972. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:31:54,730][36114] Avg episode reward: [(0, '55.976')] [2023-02-25 14:31:54,750][36138] Updated weights for policy 0, policy_version 52393 (0.0009) [2023-02-25 14:31:55,665][36142] DAMAGECOUNT value on done: 1133962.0 [2023-02-25 14:31:55,666][36142] Sum rewards: 58.874, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.674', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.247', 'weapon2': '0.318', 'WEAPON3': '1.500', 'HITCOUNT': '3.320', 'weapon3': '3.370', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '51.000'} [2023-02-25 14:31:55,980][36142] DAMAGECOUNT value on done: 1118220.0 [2023-02-25 14:31:55,981][36142] Sum rewards: 44.975, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.661', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.070', 'AMMO3': '0.156', 'weapon2': '0.192', 'weapon5': '0.294', 'AMMO4': '0.348', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.774', 'WEAPON3': '0.850', 'weapon3': '2.374', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '11.370', 'FRAGCOUNT': '40.000'} [2023-02-25 14:31:56,485][36142] DAMAGECOUNT value on done: 1131872.0 [2023-02-25 14:31:56,485][36142] Sum rewards: 68.987, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.733', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'AMMO3': '0.194', 'weapon2': '0.300', 'ARMOR': '0.400', 'weapon4': '0.544', 'WEAPON3': '1.200', 'weapon3': '2.940', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '58.000'} [2023-02-25 14:31:56,816][36142] DAMAGECOUNT value on done: 1143477.0 [2023-02-25 14:31:56,816][36142] Sum rewards: 64.998, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.895', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.061', 'weapon2': '0.238', 'AMMO3': '0.243', 'weapon5': '0.296', 'AMMO4': '0.306', 'weapon4': '0.368', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.764', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '58.500'} [2023-02-25 14:31:57,771][36138] Updated weights for policy 0, policy_version 52403 (0.0010) [2023-02-25 14:31:57,995][36156] DAMAGECOUNT value on done: 1146109.0 [2023-02-25 14:31:57,995][36156] Sum rewards: 47.176, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.350', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'AMMO3': '0.194', 'weapon4': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.710', 'WEAPON3': '1.100', 'HITCOUNT': '2.590', 'weapon3': '2.722', 'DAMAGECOUNT': '12.684', 'FRAGCOUNT': '41.000'} [2023-02-25 14:31:58,084][36156] DAMAGECOUNT value on done: 1140639.0 [2023-02-25 14:31:58,084][36156] Sum rewards: 44.515, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.550', 'AMMO5': '0.021', 'AMMO2': '0.035', 'AMMO4': '0.177', 'AMMO3': '0.212', 'weapon2': '0.218', 'weapon5': '0.390', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.824', 'WEAPON3': '1.200', 'weapon3': '2.038', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.309', 'FRAGCOUNT': '41.000'} [2023-02-25 14:31:58,317][36156] DAMAGECOUNT value on done: 1126468.0 [2023-02-25 14:31:58,317][36156] Sum rewards: 56.741, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.307', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon5': '0.116', 'AMMO3': '0.206', 'AMMO4': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.424', 'weapon2': '0.662', 'WEAPON3': '1.250', 'weapon3': '2.538', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.967', 'FRAGCOUNT': '50.500'} [2023-02-25 14:31:58,407][36156] DAMAGECOUNT value on done: 1125850.0 [2023-02-25 14:31:58,408][36156] Sum rewards: 56.356, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.639', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.052', 'AMMO3': '0.199', 'weapon5': '0.212', 'AMMO4': '0.259', 'weapon2': '0.348', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'weapon4': '0.864', 'WEAPON3': '1.150', 'weapon3': '2.130', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.708', 'FRAGCOUNT': '51.000'} [2023-02-25 14:31:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 214667264. Throughput: 0: 3351.7. Samples: 16161290. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:31:59,729][36114] Avg episode reward: [(0, '55.702')] [2023-02-25 14:32:00,805][36138] Updated weights for policy 0, policy_version 52413 (0.0009) [2023-02-25 14:32:03,842][36138] Updated weights for policy 0, policy_version 52423 (0.0010) [2023-02-25 14:32:04,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13371.0). Total num frames: 214732800. Throughput: 0: 3348.1. Samples: 16181490. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:32:04,730][36114] Avg episode reward: [(0, '55.702')] [2023-02-25 14:32:06,903][36138] Updated weights for policy 0, policy_version 52433 (0.0009) [2023-02-25 14:32:07,284][36157] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:32:09,002][36154] DAMAGECOUNT value on done: 1147027.0 [2023-02-25 14:32:09,002][36154] Sum rewards: 61.311, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.054', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.177', 'weapon5': '0.184', 'weapon2': '0.204', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.638', 'WEAPON3': '1.050', 'weapon3': '2.682', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.387', 'FRAGCOUNT': '53.000'} [2023-02-25 14:32:09,035][36141] DAMAGECOUNT value on done: 1141922.0 [2023-02-25 14:32:09,035][36141] Sum rewards: 37.809, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.540', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.041', 'AMMO3': '0.151', 'AMMO4': '0.206', 'weapon5': '0.220', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.436', 'weapon2': '0.472', 'WEAPON3': '0.950', 'HITCOUNT': '2.410', 'weapon3': '2.640', 'DAMAGECOUNT': '11.106', 'FRAGCOUNT': '32.000'} [2023-02-25 14:32:09,261][36154] DAMAGECOUNT value on done: 1141963.0 [2023-02-25 14:32:09,261][36154] Sum rewards: 59.673, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.600', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.012', 'WEAPON4': '0.100', 'weapon5': '0.124', 'weapon4': '0.160', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'weapon2': '0.552', 'WEAPON3': '1.150', 'weapon3': '2.948', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.622', 'FRAGCOUNT': '50.000'} [2023-02-25 14:32:09,324][36154] DAMAGECOUNT value on done: 1125910.0 [2023-02-25 14:32:09,325][36154] Sum rewards: 39.378, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.720', 'AMMO5': '0.018', 'AMMO2': '0.049', 'AMMO3': '0.127', 'weapon5': '0.242', 'AMMO4': '0.244', 'weapon2': '0.258', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.564', 'WEAPON3': '0.800', 'HITCOUNT': '2.170', 'weapon3': '2.684', 'DAMAGECOUNT': '11.691', 'FRAGCOUNT': '34.000'} [2023-02-25 14:32:09,335][36141] DAMAGECOUNT value on done: 1133563.0 [2023-02-25 14:32:09,335][36141] Sum rewards: 74.044, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.206', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.128', 'AMMO4': '0.161', 'AMMO3': '0.194', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON4': '0.300', 'weapon4': '0.420', 'WEAPON3': '1.100', 'weapon3': '2.916', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.129', 'FRAGCOUNT': '61.000'} [2023-02-25 14:32:09,364][36141] DAMAGECOUNT value on done: 1139324.0 [2023-02-25 14:32:09,364][36141] Sum rewards: 43.011, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.319', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.126', 'AMMO4': '0.136', 'weapon5': '0.180', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.250', 'HITCOUNT': '2.760', 'weapon3': '3.028', 'DAMAGECOUNT': '12.708', 'FRAGCOUNT': '39.000'} [2023-02-25 14:32:09,571][36154] DAMAGECOUNT value on done: 1136784.0 [2023-02-25 14:32:09,571][36154] Sum rewards: 52.233, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.570', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.062', 'weapon2': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon4': '0.528', 'WEAPON3': '1.450', 'weapon3': '3.012', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.142', 'FRAGCOUNT': '46.000'} [2023-02-25 14:32:09,638][36141] DAMAGECOUNT value on done: 1125353.0 [2023-02-25 14:32:09,638][36141] Sum rewards: 64.582, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.104', 'AMMO5': '0.013', 'AMMO2': '0.048', 'AMMO3': '0.156', 'weapon5': '0.212', 'AMMO4': '0.238', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.518', 'weapon4': '0.808', 'WEAPON3': '1.000', 'weapon3': '2.200', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '55.000'} [2023-02-25 14:32:09,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 214802432. Throughput: 0: 3350.4. Samples: 16191482. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:32:09,730][36114] Avg episode reward: [(0, '55.260')] [2023-02-25 14:32:10,005][36138] Updated weights for policy 0, policy_version 52443 (0.0009) [2023-02-25 14:32:11,060][36155] DAMAGECOUNT value on done: 1129065.0 [2023-02-25 14:32:11,061][36155] Sum rewards: 61.058, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.298', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.276', 'weapon4': '0.480', 'WEAPON3': '1.250', 'weapon3': '2.926', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.958', 'FRAGCOUNT': '52.000'} [2023-02-25 14:32:11,371][36155] DAMAGECOUNT value on done: 1135878.0 [2023-02-25 14:32:11,371][36155] Sum rewards: 62.765, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.108', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.188', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.290', 'weapon2': '0.336', 'WEAPON3': '1.300', 'weapon3': '2.892', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.966', 'FRAGCOUNT': '56.000'} [2023-02-25 14:32:11,956][36157] DAMAGECOUNT value on done: 1145061.0 [2023-02-25 14:32:11,956][36157] Sum rewards: 54.979, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.622', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon4': '0.104', 'weapon5': '0.130', 'WEAPON4': '0.200', 'AMMO3': '0.246', 'WEAPON5': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.600', 'HITCOUNT': '2.990', 'weapon3': '3.132', 'DAMAGECOUNT': '14.370', 'FRAGCOUNT': '50.000'} [2023-02-25 14:32:12,259][36155] DAMAGECOUNT value on done: 1152143.0 [2023-02-25 14:32:12,259][36155] Sum rewards: 51.724, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.088', 'ARMOR': '0.013', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO3': '0.158', 'AMMO4': '0.186', 'weapon2': '0.190', 'weapon5': '0.324', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.648', 'WEAPON3': '0.950', 'weapon3': '2.604', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '13.314', 'FRAGCOUNT': '43.500'} [2023-02-25 14:32:12,267][36157] DAMAGECOUNT value on done: 1135299.0 [2023-02-25 14:32:12,267][36157] Sum rewards: 55.896, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.882', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.142', 'weapon5': '0.188', 'weapon2': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'weapon4': '0.790', 'WEAPON3': '1.250', 'weapon3': '2.554', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.385', 'FRAGCOUNT': '48.000'} [2023-02-25 14:32:12,295][36139] DAMAGECOUNT value on done: 1134046.0 [2023-02-25 14:32:12,295][36139] Sum rewards: 59.688, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.510', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon5': '0.152', 'weapon2': '0.194', 'AMMO3': '0.222', 'AMMO4': '0.233', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.894', 'WEAPON3': '1.350', 'weapon3': '2.408', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '51.000'} [2023-02-25 14:32:12,577][36155] DAMAGECOUNT value on done: 1130999.0 [2023-02-25 14:32:12,577][36155] Sum rewards: 44.658, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.954', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.058', 'weapon4': '0.142', 'AMMO3': '0.205', 'weapon2': '0.534', 'WEAPON3': '1.250', 'HITCOUNT': '2.670', 'weapon3': '3.110', 'DAMAGECOUNT': '12.267', 'FRAGCOUNT': '39.000'} [2023-02-25 14:32:12,599][36139] DAMAGECOUNT value on done: 1131942.0 [2023-02-25 14:32:12,599][36139] Sum rewards: 49.812, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.500', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.054', 'AMMO3': '0.135', 'weapon5': '0.248', 'AMMO4': '0.271', 'weapon4': '0.370', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.638', 'WEAPON3': '0.850', 'weapon3': '2.426', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.567', 'FRAGCOUNT': '42.000'} [2023-02-25 14:32:12,659][36157] DAMAGECOUNT value on done: 1146875.0 [2023-02-25 14:32:12,660][36157] Sum rewards: 51.509, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.852', 'AMMO5': '0.017', 'ARMOR': '0.028', 'AMMO2': '0.052', 'AMMO3': '0.122', 'weapon5': '0.202', 'AMMO4': '0.259', 'WEAPON5': '0.350', 'weapon4': '0.630', 'WEAPON4': '0.650', 'weapon2': '0.668', 'WEAPON3': '0.750', 'weapon3': '2.114', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.239', 'FRAGCOUNT': '44.000'} [2023-02-25 14:32:12,946][36139] DAMAGECOUNT value on done: 1148019.0 [2023-02-25 14:32:12,947][36139] Sum rewards: 45.398, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.289', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon5': '0.098', 'AMMO3': '0.189', 'AMMO4': '0.243', 'weapon4': '0.328', 'WEAPON5': '0.350', 'weapon2': '0.382', 'ARMOR': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.640', 'weapon3': '2.886', 'DAMAGECOUNT': '13.155', 'FRAGCOUNT': '41.000'} [2023-02-25 14:32:12,973][36157] DAMAGECOUNT value on done: 1140067.0 [2023-02-25 14:32:12,974][36157] Sum rewards: 48.896, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.095', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.146', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.318', 'weapon4': '0.482', 'WEAPON3': '1.050', 'HITCOUNT': '2.680', 'weapon3': '2.768', 'DAMAGECOUNT': '13.236', 'FRAGCOUNT': '42.000'} [2023-02-25 14:32:13,045][36138] Updated weights for policy 0, policy_version 52453 (0.0009) [2023-02-25 14:32:13,255][36139] DAMAGECOUNT value on done: 1140222.0 [2023-02-25 14:32:13,255][36139] Sum rewards: 46.695, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.805', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.100', 'AMMO4': '0.171', 'WEAPON5': '0.200', 'weapon2': '0.200', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.324', 'WEAPON3': '1.500', 'HITCOUNT': '2.900', 'weapon3': '3.140', 'DAMAGECOUNT': '13.206', 'FRAGCOUNT': '42.000'} [2023-02-25 14:32:13,495][36140] DAMAGECOUNT value on done: 1138680.0 [2023-02-25 14:32:13,496][36140] Sum rewards: 59.785, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.088', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO4': '0.183', 'AMMO3': '0.211', 'weapon2': '0.238', 'weapon5': '0.278', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'weapon4': '0.996', 'WEAPON3': '1.300', 'weapon3': '2.084', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '52.000'} [2023-02-25 14:32:13,672][36154] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:32:13,767][36140] DAMAGECOUNT value on done: 1141224.0 [2023-02-25 14:32:13,767][36140] Sum rewards: 66.627, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.178', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO3': '0.160', 'AMMO4': '0.178', 'weapon4': '0.182', 'weapon5': '0.184', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.610', 'WEAPON3': '0.950', 'weapon3': '2.760', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '54.000'} [2023-02-25 14:32:13,805][36140] DAMAGECOUNT value on done: 1129315.0 [2023-02-25 14:32:13,805][36140] Sum rewards: 53.576, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.948', 'AMMO5': '0.014', 'AMMO2': '0.036', 'AMMO4': '0.181', 'weapon4': '0.218', 'weapon5': '0.226', 'AMMO3': '0.245', 'weapon2': '0.258', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.870', 'weapon3': '3.008', 'DAMAGECOUNT': '14.817', 'FRAGCOUNT': '49.500'} [2023-02-25 14:32:14,082][36140] DAMAGECOUNT value on done: 1129654.0 [2023-02-25 14:32:14,082][36140] Sum rewards: 52.388, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.170', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.102', 'AMMO3': '0.176', 'AMMO4': '0.180', 'WEAPON5': '0.300', 'weapon4': '0.368', 'weapon2': '0.404', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.772', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.546', 'FRAGCOUNT': '44.000'} [2023-02-25 14:32:14,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.2, 300 sec: 13384.9). Total num frames: 214867968. Throughput: 0: 3350.5. Samples: 16211552. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:32:14,730][36114] Avg episode reward: [(0, '55.498')] [2023-02-25 14:32:15,796][36142] DAMAGECOUNT value on done: 1138828.0 [2023-02-25 14:32:15,797][36142] Sum rewards: 58.504, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.757', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.040', 'AMMO3': '0.155', 'AMMO4': '0.201', 'weapon5': '0.204', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON4': '0.300', 'weapon4': '0.726', 'WEAPON3': '1.000', 'weapon3': '2.550', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.598', 'FRAGCOUNT': '48.000'} [2023-02-25 14:32:16,079][36138] Updated weights for policy 0, policy_version 52463 (0.0009) [2023-02-25 14:32:16,122][36142] DAMAGECOUNT value on done: 1124224.0 [2023-02-25 14:32:16,122][36142] Sum rewards: 75.166, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.766', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.142', 'AMMO4': '0.170', 'weapon5': '0.186', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.360', 'WEAPON3': '0.950', 'weapon3': '2.958', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '61.000'} [2023-02-25 14:32:16,626][36142] DAMAGECOUNT value on done: 1137062.0 [2023-02-25 14:32:16,626][36142] Sum rewards: 57.152, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.110', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon5': '0.068', 'weapon4': '0.100', 'AMMO4': '0.166', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '3.090', 'weapon3': '3.368', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '49.000'} [2023-02-25 14:32:16,935][36142] DAMAGECOUNT value on done: 1148443.0 [2023-02-25 14:32:16,936][36142] Sum rewards: 54.150, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.162', 'AMMO5': '0.016', 'AMMO2': '0.030', 'AMMO3': '0.129', 'AMMO4': '0.149', 'weapon5': '0.284', 'weapon2': '0.340', 'ARMOR': '0.404', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '0.850', 'weapon4': '1.038', 'weapon3': '1.924', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.898', 'FRAGCOUNT': '44.000'} [2023-02-25 14:32:17,957][36156] DAMAGECOUNT value on done: 1150353.0 [2023-02-25 14:32:17,957][36156] Sum rewards: 43.666, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.552', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.040', 'AMMO3': '0.132', 'AMMO4': '0.198', 'weapon5': '0.246', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.736', 'WEAPON3': '0.800', 'weapon4': '0.838', 'weapon3': '1.810', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '12.732', 'FRAGCOUNT': '37.000'} [2023-02-25 14:32:18,056][36156] DAMAGECOUNT value on done: 1144862.0 [2023-02-25 14:32:18,056][36156] Sum rewards: 58.101, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.156', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.022', 'AMMO4': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.139', 'WEAPON3': '0.850', 'weapon2': '0.946', 'HITCOUNT': '2.830', 'weapon3': '2.948', 'DAMAGECOUNT': '12.669', 'FRAGCOUNT': '46.000'} [2023-02-25 14:32:18,265][36156] DAMAGECOUNT value on done: 1131518.0 [2023-02-25 14:32:18,265][36156] Sum rewards: 50.361, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.330', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon5': '0.070', 'AMMO4': '0.076', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon4': '0.356', 'weapon2': '0.728', 'WEAPON3': '1.300', 'weapon3': '2.610', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.727', 'FRAGCOUNT': '45.000'} [2023-02-25 14:32:18,363][36156] DAMAGECOUNT value on done: 1130141.0 [2023-02-25 14:32:18,364][36156] Sum rewards: 45.515, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.344', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.144', 'AMMO4': '0.172', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'weapon2': '0.252', 'WEAPON3': '1.350', 'HITCOUNT': '2.850', 'weapon3': '3.106', 'DAMAGECOUNT': '12.873', 'FRAGCOUNT': '42.000'} [2023-02-25 14:32:19,111][36138] Updated weights for policy 0, policy_version 52473 (0.0010) [2023-02-25 14:32:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 214937600. Throughput: 0: 3362.2. Samples: 16231910. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:32:19,730][36114] Avg episode reward: [(0, '55.366')] [2023-02-25 14:32:22,186][36138] Updated weights for policy 0, policy_version 52483 (0.0009) [2023-02-25 14:32:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 215003136. Throughput: 0: 3360.7. Samples: 16241966. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:32:24,730][36114] Avg episode reward: [(0, '55.366')] [2023-02-25 14:32:25,239][36138] Updated weights for policy 0, policy_version 52493 (0.0010) [2023-02-25 14:32:28,323][36138] Updated weights for policy 0, policy_version 52503 (0.0009) [2023-02-25 14:32:29,040][36154] DAMAGECOUNT value on done: 1151960.0 [2023-02-25 14:32:29,040][36154] Sum rewards: 53.024, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.350', 'AMMO5': '0.013', 'AMMO2': '0.042', 'AMMO3': '0.177', 'AMMO4': '0.209', 'weapon5': '0.224', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.558', 'weapon2': '0.690', 'WEAPON3': '1.050', 'weapon3': '2.232', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.799', 'FRAGCOUNT': '45.500'} [2023-02-25 14:32:29,070][36141] DAMAGECOUNT value on done: 1147360.0 [2023-02-25 14:32:29,071][36141] Sum rewards: 65.254, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.921', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.067', 'AMMO3': '0.154', 'weapon5': '0.200', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.660', 'WEAPON3': '0.900', 'weapon3': '2.364', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '54.000'} [2023-02-25 14:32:29,294][36154] DAMAGECOUNT value on done: 1147175.0 [2023-02-25 14:32:29,294][36154] Sum rewards: 58.454, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.747', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.190', 'AMMO3': '0.206', 'WEAPON5': '0.300', 'weapon2': '0.376', 'WEAPON4': '0.400', 'weapon4': '0.502', 'WEAPON3': '1.250', 'weapon3': '2.640', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '52.000'} [2023-02-25 14:32:29,341][36154] DAMAGECOUNT value on done: 1130757.0 [2023-02-25 14:32:29,341][36154] Sum rewards: 54.762, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.535', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.084', 'AMMO4': '0.129', 'weapon4': '0.202', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '2.970', 'weapon3': '3.232', 'DAMAGECOUNT': '14.412', 'FRAGCOUNT': '48.000'} [2023-02-25 14:32:29,366][36141] DAMAGECOUNT value on done: 1137592.0 [2023-02-25 14:32:29,367][36141] Sum rewards: 50.321, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.738', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON1': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'weapon2': '0.470', 'weapon4': '0.554', 'WEAPON3': '0.950', 'weapon3': '2.464', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.087', 'FRAGCOUNT': '42.000'} [2023-02-25 14:32:29,385][36141] DAMAGECOUNT value on done: 1144115.0 [2023-02-25 14:32:29,386][36141] Sum rewards: 54.602, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.069', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.092', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.224', 'weapon2': '0.228', 'AMMO3': '0.230', 'weapon4': '0.484', 'WEAPON3': '1.350', 'weapon3': '2.932', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.373', 'FRAGCOUNT': '48.000'} [2023-02-25 14:32:29,601][36154] DAMAGECOUNT value on done: 1141689.0 [2023-02-25 14:32:29,601][36154] Sum rewards: 61.341, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.840', 'AMMO2': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.242', 'weapon2': '0.402', 'WEAPON3': '1.400', 'HITCOUNT': '3.230', 'weapon3': '3.398', 'DAMAGECOUNT': '14.715', 'FRAGCOUNT': '53.000'} [2023-02-25 14:32:29,685][36141] DAMAGECOUNT value on done: 1129950.0 [2023-02-25 14:32:29,685][36141] Sum rewards: 57.487, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.735', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.062', 'AMMO3': '0.157', 'weapon5': '0.174', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.418', 'weapon2': '0.478', 'WEAPON3': '0.950', 'weapon3': '2.690', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.791', 'FRAGCOUNT': '49.000'} [2023-02-25 14:32:29,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 215068672. Throughput: 0: 3356.0. Samples: 16261872. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:32:29,729][36114] Avg episode reward: [(0, '54.918')] [2023-02-25 14:32:31,155][36155] DAMAGECOUNT value on done: 1134619.0 [2023-02-25 14:32:31,155][36155] Sum rewards: 59.135, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.481', 'AMMO5': '0.007', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon5': '0.168', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'weapon2': '0.276', 'WEAPON4': '0.300', 'ARMOR': '0.408', 'weapon4': '0.752', 'WEAPON3': '1.150', 'weapon3': '2.494', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '49.000'} [2023-02-25 14:32:31,390][36138] Updated weights for policy 0, policy_version 52513 (0.0009) [2023-02-25 14:32:31,464][36155] DAMAGECOUNT value on done: 1140676.0 [2023-02-25 14:32:31,464][36155] Sum rewards: 62.993, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.420', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.153', 'weapon5': '0.218', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.408', 'weapon2': '0.482', 'WEAPON3': '0.950', 'weapon3': '2.674', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.394', 'FRAGCOUNT': '54.000'} [2023-02-25 14:32:32,043][36157] DAMAGECOUNT value on done: 1149625.0 [2023-02-25 14:32:32,043][36157] Sum rewards: 51.928, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.690', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.155', 'AMMO3': '0.175', 'weapon5': '0.190', 'WEAPON5': '0.350', 'weapon2': '0.466', 'WEAPON4': '0.500', 'weapon4': '0.688', 'WEAPON3': '1.050', 'weapon3': '2.326', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.692', 'FRAGCOUNT': '46.000'} [2023-02-25 14:32:32,274][36139] DAMAGECOUNT value on done: 1138586.0 [2023-02-25 14:32:32,275][36139] Sum rewards: 57.636, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.110', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.092', 'AMMO4': '0.102', 'AMMO3': '0.123', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.322', 'weapon2': '0.674', 'WEAPON3': '0.750', 'weapon3': '2.748', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.620', 'FRAGCOUNT': '46.000'} [2023-02-25 14:32:32,326][36155] DAMAGECOUNT value on done: 1157444.0 [2023-02-25 14:32:32,326][36155] Sum rewards: 61.369, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.559', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.043', 'weapon5': '0.096', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'AMMO4': '0.217', 'WEAPON4': '0.300', 'weapon2': '0.370', 'weapon4': '0.396', 'WEAPON3': '1.100', 'weapon3': '2.930', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '50.000'} [2023-02-25 14:32:32,357][36157] DAMAGECOUNT value on done: 1140427.0 [2023-02-25 14:32:32,357][36157] Sum rewards: 56.581, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.912', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'AMMO3': '0.261', 'weapon4': '0.266', 'weapon2': '0.366', 'ARMOR': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.196', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.384', 'FRAGCOUNT': '50.000'} [2023-02-25 14:32:32,586][36139] DAMAGECOUNT value on done: 1136596.0 [2023-02-25 14:32:32,586][36139] Sum rewards: 52.016, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.959', 'AMMO5': '0.018', 'AMMO2': '0.048', 'AMMO3': '0.150', 'AMMO4': '0.242', 'weapon5': '0.384', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.554', 'weapon4': '0.566', 'WEAPON3': '1.000', 'weapon3': '2.160', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.962', 'FRAGCOUNT': '44.500'} [2023-02-25 14:32:32,634][36155] DAMAGECOUNT value on done: 1135632.0 [2023-02-25 14:32:32,634][36155] Sum rewards: 45.776, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.088', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.117', 'WEAPON4': '0.250', 'weapon2': '0.260', 'weapon5': '0.274', 'AMMO3': '0.278', 'WEAPON5': '0.300', 'weapon4': '0.522', 'WEAPON3': '1.500', 'HITCOUNT': '2.580', 'weapon3': '2.598', 'DAMAGECOUNT': '13.899', 'FRAGCOUNT': '41.000'} [2023-02-25 14:32:32,711][36157] DAMAGECOUNT value on done: 1151628.0 [2023-02-25 14:32:32,711][36157] Sum rewards: 54.793, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.540', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.047', 'AMMO3': '0.181', 'weapon5': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.354', 'weapon4': '0.478', 'WEAPON3': '1.100', 'weapon3': '2.722', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.244', 'FRAGCOUNT': '47.000'} [2023-02-25 14:32:32,946][36139] DAMAGECOUNT value on done: 1152898.0 [2023-02-25 14:32:32,946][36139] Sum rewards: 56.987, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.235', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.013', 'weapon5': '0.016', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon4': '0.246', 'weapon2': '0.548', 'WEAPON3': '1.050', 'weapon3': '2.702', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.637', 'FRAGCOUNT': '48.000'} [2023-02-25 14:32:33,028][36157] DAMAGECOUNT value on done: 1144683.0 [2023-02-25 14:32:33,028][36157] Sum rewards: 59.293, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'HEALTH': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.302', 'WEAPON3': '0.750', 'weapon2': '0.768', 'weapon3': '2.666', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.848', 'FRAGCOUNT': '49.000'} [2023-02-25 14:32:33,267][36139] DAMAGECOUNT value on done: 1145670.0 [2023-02-25 14:32:33,268][36139] Sum rewards: 57.347, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.110', 'AMMO5': '0.022', 'AMMO2': '0.049', 'AMMO3': '0.186', 'AMMO4': '0.242', 'weapon2': '0.282', 'weapon5': '0.360', 'weapon4': '0.460', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.502', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '50.500'} [2023-02-25 14:32:33,491][36140] DAMAGECOUNT value on done: 1142946.0 [2023-02-25 14:32:33,492][36140] Sum rewards: 48.524, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.584', 'AMMO5': '0.004', 'AMMO2': '0.028', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'ARMOR': '0.400', 'weapon4': '0.456', 'weapon2': '0.462', 'WEAPON3': '1.200', 'weapon3': '2.780', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '12.798', 'FRAGCOUNT': '41.000'} [2023-02-25 14:32:33,763][36140] DAMAGECOUNT value on done: 1145824.0 [2023-02-25 14:32:33,764][36140] Sum rewards: 57.578, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'AMMO3': '0.115', 'WEAPON4': '0.150', 'weapon4': '0.512', 'WEAPON3': '0.650', 'HEALTH': '0.705', 'weapon2': '0.796', 'weapon3': '2.504', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.800', 'FRAGCOUNT': '45.000'} [2023-02-25 14:32:33,817][36140] DAMAGECOUNT value on done: 1133679.0 [2023-02-25 14:32:33,817][36140] Sum rewards: 52.626, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.620', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.188', 'weapon2': '0.194', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.410', 'WEAPON3': '1.400', 'weapon3': '2.926', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.092', 'FRAGCOUNT': '49.000'} [2023-02-25 14:32:34,094][36140] DAMAGECOUNT value on done: 1134790.0 [2023-02-25 14:32:34,094][36140] Sum rewards: 65.894, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.275', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon4': '0.076', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'AMMO3': '0.171', 'weapon2': '0.480', 'WEAPON3': '1.000', 'weapon3': '3.238', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '54.000'} [2023-02-25 14:32:34,419][36138] Updated weights for policy 0, policy_version 52523 (0.0009) [2023-02-25 14:32:34,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13371.0). Total num frames: 215134208. Throughput: 0: 3357.6. Samples: 16282010. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:32:34,730][36114] Avg episode reward: [(0, '54.749')] [2023-02-25 14:32:35,857][36142] DAMAGECOUNT value on done: 1142813.0 [2023-02-25 14:32:35,858][36142] Sum rewards: 39.507, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.040', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.175', 'weapon5': '0.202', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.340', 'weapon2': '0.454', 'WEAPON3': '1.300', 'HITCOUNT': '2.450', 'weapon3': '2.516', 'DAMAGECOUNT': '11.730', 'FRAGCOUNT': '38.000'} [2023-02-25 14:32:36,180][36142] DAMAGECOUNT value on done: 1129470.0 [2023-02-25 14:32:36,181][36142] Sum rewards: 61.521, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.450', 'AMMO5': '0.024', 'AMMO2': '0.043', 'AMMO3': '0.177', 'weapon2': '0.196', 'weapon5': '0.198', 'AMMO4': '0.215', 'weapon4': '0.412', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.748', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '54.000'} [2023-02-25 14:32:36,714][36142] DAMAGECOUNT value on done: 1142536.0 [2023-02-25 14:32:36,714][36142] Sum rewards: 62.039, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.960', 'AMMO5': '0.005', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.174', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon4': '0.290', 'weapon2': '0.494', 'WEAPON3': '1.300', 'weapon3': '2.862', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.422', 'FRAGCOUNT': '53.000'} [2023-02-25 14:32:37,020][36142] DAMAGECOUNT value on done: 1153065.0 [2023-02-25 14:32:37,020][36142] Sum rewards: 50.224, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.716', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.112', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.328', 'weapon2': '0.432', 'WEAPON3': '1.150', 'weapon3': '2.882', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.866', 'FRAGCOUNT': '43.000'} [2023-02-25 14:32:37,504][36138] Updated weights for policy 0, policy_version 52533 (0.0010) [2023-02-25 14:32:37,995][36156] DAMAGECOUNT value on done: 1154505.0 [2023-02-25 14:32:37,996][36156] Sum rewards: 49.383, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.849', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.132', 'AMMO3': '0.186', 'weapon2': '0.230', 'weapon4': '0.256', 'WEAPON3': '1.150', 'HITCOUNT': '2.690', 'weapon3': '3.080', 'DAMAGECOUNT': '12.456', 'FRAGCOUNT': '42.000'} [2023-02-25 14:32:38,165][36156] DAMAGECOUNT value on done: 1149201.0 [2023-02-25 14:32:38,166][36156] Sum rewards: 52.487, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'AMMO3': '0.154', 'weapon4': '0.182', 'HEALTH': '0.558', 'WEAPON3': '0.850', 'weapon2': '0.874', 'weapon3': '2.668', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.017', 'FRAGCOUNT': '42.000'} [2023-02-25 14:32:38,310][36156] DAMAGECOUNT value on done: 1137469.0 [2023-02-25 14:32:38,310][36156] Sum rewards: 62.157, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.426', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.176', 'weapon5': '0.178', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.376', 'weapon2': '0.556', 'WEAPON3': '1.150', 'weapon3': '2.652', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '51.000'} [2023-02-25 14:32:38,480][36156] DAMAGECOUNT value on done: 1134487.0 [2023-02-25 14:32:38,481][36156] Sum rewards: 53.488, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.843', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.154', 'weapon5': '0.180', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.436', 'weapon4': '0.442', 'WEAPON3': '1.000', 'weapon3': '2.674', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.038', 'FRAGCOUNT': '46.000'} [2023-02-25 14:32:39,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.6, 300 sec: 13384.9). Total num frames: 215203840. Throughput: 0: 3356.4. Samples: 16292010. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:32:39,730][36114] Avg episode reward: [(0, '54.777')] [2023-02-25 14:32:40,574][36138] Updated weights for policy 0, policy_version 52543 (0.0009) [2023-02-25 14:32:43,612][36138] Updated weights for policy 0, policy_version 52553 (0.0010) [2023-02-25 14:32:44,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 215269376. Throughput: 0: 3352.4. Samples: 16312150. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:32:44,730][36114] Avg episode reward: [(0, '54.777')] [2023-02-25 14:32:45,915][36156] Large shaping reward 2.641 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:32:46,692][36138] Updated weights for policy 0, policy_version 52563 (0.0009) [2023-02-25 14:32:49,138][36154] DAMAGECOUNT value on done: 1157111.0 [2023-02-25 14:32:49,138][36154] Sum rewards: 63.157, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.212', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.248', 'weapon4': '0.272', 'WEAPON3': '1.150', 'HITCOUNT': '3.120', 'weapon3': '3.266', 'DAMAGECOUNT': '15.453', 'FRAGCOUNT': '53.000'} [2023-02-25 14:32:49,225][36141] DAMAGECOUNT value on done: 1152045.0 [2023-02-25 14:32:49,226][36141] Sum rewards: 56.390, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.576', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.054', 'AMMO3': '0.110', 'AMMO4': '0.269', 'weapon5': '0.338', 'weapon2': '0.522', 'WEAPON3': '0.650', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'weapon4': '0.722', 'weapon3': '2.088', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '14.055', 'FRAGCOUNT': '48.000'} [2023-02-25 14:32:49,442][36154] DAMAGECOUNT value on done: 1151953.0 [2023-02-25 14:32:49,443][36154] Sum rewards: 56.467, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.398', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.048', 'AMMO3': '0.161', 'AMMO4': '0.241', 'weapon2': '0.330', 'weapon5': '0.372', 'weapon4': '0.594', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '0.900', 'weapon3': '2.298', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.334', 'FRAGCOUNT': '50.000'} [2023-02-25 14:32:49,450][36154] DAMAGECOUNT value on done: 1136841.0 [2023-02-25 14:32:49,451][36154] Sum rewards: 72.805, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.730', 'AMMO5': '0.011', 'AMMO2': '0.035', 'AMMO3': '0.155', 'weapon5': '0.162', 'AMMO4': '0.174', 'weapon2': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.654', 'WEAPON3': '0.950', 'weapon3': '2.622', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '60.000'} [2023-02-25 14:32:49,529][36141] DAMAGECOUNT value on done: 1142345.0 [2023-02-25 14:32:49,530][36141] Sum rewards: 52.714, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.503', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon5': '0.106', 'weapon4': '0.110', 'AMMO4': '0.162', 'AMMO3': '0.209', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.624', 'WEAPON3': '1.300', 'HITCOUNT': '2.790', 'weapon3': '2.906', 'DAMAGECOUNT': '14.259', 'FRAGCOUNT': '47.000'} [2023-02-25 14:32:49,549][36141] DAMAGECOUNT value on done: 1149311.0 [2023-02-25 14:32:49,550][36141] Sum rewards: 59.233, reward structure: {'DEATHCOUNT': '-16.500', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.080', 'AMMO4': '0.129', 'AMMO3': '0.192', 'weapon4': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HEALTH': '0.480', 'weapon2': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.950', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.546', 'FRAGCOUNT': '51.000'} [2023-02-25 14:32:49,729][36138] Updated weights for policy 0, policy_version 52573 (0.0010) [2023-02-25 14:32:49,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 215339008. Throughput: 0: 3348.0. Samples: 16332150. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:32:49,730][36114] Avg episode reward: [(0, '55.127')] [2023-02-25 14:32:49,763][36154] DAMAGECOUNT value on done: 1145428.0 [2023-02-25 14:32:49,763][36154] Sum rewards: 34.594, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.322', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.184', 'AMMO4': '0.184', 'AMMO3': '0.294', 'weapon4': '0.390', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.458', 'WEAPON3': '1.550', 'HITCOUNT': '2.110', 'weapon3': '2.632', 'DAMAGECOUNT': '11.217', 'FRAGCOUNT': '36.000'} [2023-02-25 14:32:49,838][36141] DAMAGECOUNT value on done: 1134171.0 [2023-02-25 14:32:49,839][36141] Sum rewards: 50.841, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.218', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon5': '0.058', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.160', 'AMMO3': '0.190', 'weapon2': '0.632', 'WEAPON3': '1.050', 'weapon3': '2.784', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.663', 'FRAGCOUNT': '43.000'} [2023-02-25 14:32:51,164][36155] DAMAGECOUNT value on done: 1139760.0 [2023-02-25 14:32:51,165][36155] Sum rewards: 64.768, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.580', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.062', 'AMMO4': '0.098', 'weapon5': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.276', 'WEAPON3': '1.300', 'weapon3': '3.296', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.423', 'FRAGCOUNT': '56.000'} [2023-02-25 14:32:51,475][36155] DAMAGECOUNT value on done: 1146149.0 [2023-02-25 14:32:51,475][36155] Sum rewards: 63.716, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.997', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.086', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'weapon2': '0.238', 'WEAPON4': '0.250', 'weapon4': '0.594', 'WEAPON3': '1.100', 'weapon3': '2.844', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '52.500'} [2023-02-25 14:32:52,155][36157] DAMAGECOUNT value on done: 1155400.0 [2023-02-25 14:32:52,155][36157] Sum rewards: 67.292, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.867', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.184', 'AMMO3': '0.232', 'weapon2': '0.264', 'WEAPON3': '1.500', 'weapon3': '3.418', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '57.000'} [2023-02-25 14:32:52,306][36139] DAMAGECOUNT value on done: 1143820.0 [2023-02-25 14:32:52,307][36139] Sum rewards: 63.285, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.156', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.144', 'AMMO3': '0.178', 'weapon2': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.642', 'WEAPON3': '1.150', 'weapon3': '2.720', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '54.000'} [2023-02-25 14:32:52,353][36155] DAMAGECOUNT value on done: 1161256.0 [2023-02-25 14:32:52,354][36155] Sum rewards: 44.619, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.902', 'ARMOR': '0.005', 'AMMO5': '0.017', 'AMMO2': '0.034', 'AMMO3': '0.102', 'AMMO4': '0.171', 'weapon5': '0.242', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon2': '0.572', 'WEAPON3': '0.600', 'weapon4': '1.162', 'weapon3': '1.560', 'HITCOUNT': '2.370', 'DAMAGECOUNT': '11.436', 'FRAGCOUNT': '37.000'} [2023-02-25 14:32:52,453][36157] DAMAGECOUNT value on done: 1145435.0 [2023-02-25 14:32:52,453][36157] Sum rewards: 51.731, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.520', 'AMMO5': '0.007', 'AMMO2': '0.047', 'weapon5': '0.138', 'AMMO4': '0.234', 'AMMO3': '0.249', 'WEAPON5': '0.250', 'weapon4': '0.302', 'WEAPON4': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.450', 'weapon3': '2.900', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.844', 'FRAGCOUNT': '48.000'} [2023-02-25 14:32:52,620][36139] DAMAGECOUNT value on done: 1141196.0 [2023-02-25 14:32:52,620][36139] Sum rewards: 52.237, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.406', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon2': '0.204', 'AMMO3': '0.216', 'weapon5': '0.240', 'weapon4': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.780', 'weapon3': '2.974', 'DAMAGECOUNT': '13.800', 'FRAGCOUNT': '47.000'} [2023-02-25 14:32:52,669][36155] DAMAGECOUNT value on done: 1141062.0 [2023-02-25 14:32:52,670][36155] Sum rewards: 63.626, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.380', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.080', 'weapon4': '0.090', 'AMMO4': '0.128', 'WEAPON5': '0.200', 'weapon2': '0.220', 'WEAPON4': '0.250', 'AMMO3': '0.294', 'WEAPON3': '1.650', 'weapon3': '3.342', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.290', 'FRAGCOUNT': '58.000'} [2023-02-25 14:32:52,789][36157] DAMAGECOUNT value on done: 1155764.0 [2023-02-25 14:32:52,789][36157] Sum rewards: 49.896, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.762', 'ARMOR': '0.004', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.024', 'weapon5': '0.088', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.356', 'weapon2': '0.426', 'WEAPON3': '0.850', 'HITCOUNT': '2.620', 'weapon3': '2.940', 'DAMAGECOUNT': '12.408', 'FRAGCOUNT': '41.000'} [2023-02-25 14:32:52,790][36138] Updated weights for policy 0, policy_version 52583 (0.0009) [2023-02-25 14:32:52,960][36139] DAMAGECOUNT value on done: 1157057.0 [2023-02-25 14:32:52,960][36139] Sum rewards: 50.004, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.820', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.142', 'AMMO3': '0.208', 'weapon2': '0.242', 'WEAPON5': '0.250', 'weapon4': '0.296', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '2.690', 'weapon3': '3.096', 'DAMAGECOUNT': '12.477', 'FRAGCOUNT': '45.000'} [2023-02-25 14:32:53,094][36157] DAMAGECOUNT value on done: 1149640.0 [2023-02-25 14:32:53,094][36157] Sum rewards: 62.117, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.985', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon4': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.192', 'weapon2': '0.802', 'WEAPON3': '1.300', 'weapon3': '2.948', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '14.871', 'FRAGCOUNT': '53.000'} [2023-02-25 14:32:53,262][36139] DAMAGECOUNT value on done: 1150261.0 [2023-02-25 14:32:53,263][36139] Sum rewards: 56.099, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.035', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.108', 'AMMO3': '0.160', 'weapon4': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.886', 'WEAPON3': '1.050', 'weapon3': '2.664', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.773', 'FRAGCOUNT': '47.000'} [2023-02-25 14:32:53,600][36140] DAMAGECOUNT value on done: 1148597.0 [2023-02-25 14:32:53,601][36140] Sum rewards: 66.329, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.340', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'weapon5': '0.116', 'weapon2': '0.174', 'AMMO3': '0.242', 'WEAPON3': '1.400', 'HITCOUNT': '3.360', 'weapon3': '3.414', 'DAMAGECOUNT': '16.953', 'FRAGCOUNT': '56.000'} [2023-02-25 14:32:53,870][36140] DAMAGECOUNT value on done: 1150607.0 [2023-02-25 14:32:53,870][36140] Sum rewards: 50.126, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.580', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.063', 'AMMO3': '0.150', 'weapon5': '0.228', 'weapon2': '0.304', 'AMMO4': '0.315', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.562', 'WEAPON3': '0.900', 'weapon3': '2.620', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.349', 'FRAGCOUNT': '42.000'} [2023-02-25 14:32:53,916][36156] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:32:53,916][36140] DAMAGECOUNT value on done: 1138770.0 [2023-02-25 14:32:53,917][36140] Sum rewards: 53.481, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.026', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.057', 'AMMO3': '0.131', 'weapon5': '0.250', 'AMMO4': '0.285', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.530', 'WEAPON3': '0.850', 'weapon4': '1.034', 'weapon3': '1.766', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.042', 'FRAGCOUNT': '44.000'} [2023-02-25 14:32:54,178][36140] DAMAGECOUNT value on done: 1139748.0 [2023-02-25 14:32:54,179][36140] Sum rewards: 55.862, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.184', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.156', 'AMMO4': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'weapon2': '0.312', 'weapon4': '0.480', 'WEAPON3': '1.400', 'weapon3': '2.692', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.874', 'FRAGCOUNT': '50.000'} [2023-02-25 14:32:54,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13384.9). Total num frames: 215404544. Throughput: 0: 3351.4. Samples: 16342296. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:32:54,729][36114] Avg episode reward: [(0, '55.372')] [2023-02-25 14:32:55,826][36138] Updated weights for policy 0, policy_version 52593 (0.0009) [2023-02-25 14:32:55,949][36142] DAMAGECOUNT value on done: 1147507.0 [2023-02-25 14:32:55,950][36142] Sum rewards: 52.841, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.382', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.166', 'AMMO3': '0.222', 'weapon2': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.462', 'WEAPON3': '1.350', 'weapon3': '2.828', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.082', 'FRAGCOUNT': '46.000'} [2023-02-25 14:32:56,262][36142] DAMAGECOUNT value on done: 1134951.0 [2023-02-25 14:32:56,262][36142] Sum rewards: 59.293, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.450', 'AMMO2': '0.019', 'weapon4': '0.040', 'AMMO4': '0.092', 'WEAPON4': '0.200', 'AMMO3': '0.273', 'weapon2': '0.372', 'WEAPON3': '1.700', 'weapon3': '3.354', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '54.000'} [2023-02-25 14:32:56,811][36142] DAMAGECOUNT value on done: 1147560.0 [2023-02-25 14:32:56,811][36142] Sum rewards: 56.956, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.458', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.051', 'AMMO3': '0.199', 'weapon2': '0.236', 'AMMO4': '0.256', 'weapon5': '0.278', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'weapon4': '0.800', 'WEAPON3': '1.150', 'weapon3': '2.164', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.072', 'FRAGCOUNT': '51.000'} [2023-02-25 14:32:57,111][36142] DAMAGECOUNT value on done: 1157215.0 [2023-02-25 14:32:57,111][36142] Sum rewards: 52.781, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.928', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'weapon5': '0.108', 'AMMO3': '0.135', 'WEAPON5': '0.200', 'weapon4': '0.272', 'weapon2': '0.704', 'WEAPON3': '0.950', 'weapon3': '2.664', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.450', 'FRAGCOUNT': '44.000'} [2023-02-25 14:32:58,029][36156] DAMAGECOUNT value on done: 1159205.0 [2023-02-25 14:32:58,029][36156] Sum rewards: 44.044, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.074', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.146', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.414', 'weapon2': '0.546', 'WEAPON3': '1.500', 'weapon3': '2.566', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '13.995', 'FRAGCOUNT': '41.000'} [2023-02-25 14:32:58,185][36156] DAMAGECOUNT value on done: 1154006.0 [2023-02-25 14:32:58,185][36156] Sum rewards: 52.777, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.052', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.047', 'AMMO3': '0.170', 'AMMO4': '0.237', 'weapon5': '0.256', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.516', 'weapon2': '0.606', 'WEAPON3': '1.050', 'weapon3': '2.328', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.995', 'FRAGCOUNT': '46.000'} [2023-02-25 14:32:58,347][36156] DAMAGECOUNT value on done: 1141777.0 [2023-02-25 14:32:58,347][36156] Sum rewards: 51.922, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.725', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.018', 'AMMO4': '0.030', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'weapon2': '0.524', 'WEAPON3': '1.200', 'HITCOUNT': '2.810', 'weapon3': '3.194', 'DAMAGECOUNT': '12.924', 'FRAGCOUNT': '44.000'} [2023-02-25 14:32:58,487][36156] DAMAGECOUNT value on done: 1139290.0 [2023-02-25 14:32:58,487][36156] Sum rewards: 47.463, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.598', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.147', 'AMMO3': '0.178', 'weapon2': '0.258', 'weapon5': '0.404', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.612', 'WEAPON3': '1.100', 'weapon3': '2.324', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '14.325', 'FRAGCOUNT': '40.500'} [2023-02-25 14:32:58,876][36138] Updated weights for policy 0, policy_version 52603 (0.0009) [2023-02-25 14:32:59,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13371.0). Total num frames: 215470080. Throughput: 0: 3352.9. Samples: 16362432. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:32:59,729][36114] Avg episode reward: [(0, '55.109')] [2023-02-25 14:33:01,900][36138] Updated weights for policy 0, policy_version 52613 (0.0009) [2023-02-25 14:33:04,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 215539712. Throughput: 0: 3350.1. Samples: 16382666. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:33:04,730][36114] Avg episode reward: [(0, '55.109')] [2023-02-25 14:33:04,961][36138] Updated weights for policy 0, policy_version 52623 (0.0010) [2023-02-25 14:33:08,002][36138] Updated weights for policy 0, policy_version 52633 (0.0009) [2023-02-25 14:33:08,486][36156] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:33:09,091][36141] DAMAGECOUNT value on done: 1157196.0 [2023-02-25 14:33:09,091][36141] Sum rewards: 56.462, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.770', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon5': '0.076', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.261', 'weapon2': '0.478', 'WEAPON3': '1.600', 'weapon3': '3.062', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.453', 'FRAGCOUNT': '51.000'} [2023-02-25 14:33:09,095][36154] DAMAGECOUNT value on done: 1161806.0 [2023-02-25 14:33:09,096][36154] Sum rewards: 52.203, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.910', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.076', 'AMMO4': '0.160', 'AMMO3': '0.184', 'weapon4': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.460', 'WEAPON3': '1.150', 'weapon3': '3.074', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.085', 'FRAGCOUNT': '46.000'} [2023-02-25 14:33:09,378][36141] DAMAGECOUNT value on done: 1146543.0 [2023-02-25 14:33:09,379][36141] Sum rewards: 46.075, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.410', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.142', 'weapon4': '0.556', 'weapon2': '0.604', 'WEAPON3': '0.900', 'weapon3': '2.676', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.594', 'FRAGCOUNT': '36.000'} [2023-02-25 14:33:09,396][36154] DAMAGECOUNT value on done: 1141052.0 [2023-02-25 14:33:09,396][36154] Sum rewards: 47.613, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.398', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.009', 'weapon7': '0.038', 'AMMO4': '0.043', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'weapon2': '0.352', 'weapon4': '0.758', 'WEAPON3': '1.300', 'weapon3': '2.466', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.633', 'FRAGCOUNT': '42.000'} [2023-02-25 14:33:09,398][36141] DAMAGECOUNT value on done: 1154741.0 [2023-02-25 14:33:09,399][36141] Sum rewards: 60.880, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.735', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.016', 'WEAPON4': '0.100', 'weapon4': '0.212', 'AMMO3': '0.231', 'weapon2': '0.322', 'WEAPON3': '1.450', 'weapon3': '3.240', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '52.000'} [2023-02-25 14:33:09,433][36154] DAMAGECOUNT value on done: 1157553.0 [2023-02-25 14:33:09,433][36154] Sum rewards: 61.749, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.305', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.100', 'weapon5': '0.114', 'weapon2': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.263', 'WEAPON3': '1.500', 'HITCOUNT': '3.220', 'weapon3': '3.344', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '54.500'} [2023-02-25 14:33:09,682][36141] DAMAGECOUNT value on done: 1138931.0 [2023-02-25 14:33:09,682][36141] Sum rewards: 48.131, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.360', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.102', 'AMMO3': '0.189', 'weapon4': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.250', 'weapon2': '0.530', 'WEAPON3': '1.100', 'HITCOUNT': '2.760', 'weapon3': '2.780', 'DAMAGECOUNT': '14.280', 'FRAGCOUNT': '42.000'} [2023-02-25 14:33:09,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 215605248. Throughput: 0: 3352.7. Samples: 16392838. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:33:09,730][36114] Avg episode reward: [(0, '55.204')] [2023-02-25 14:33:09,743][36154] DAMAGECOUNT value on done: 1149795.0 [2023-02-25 14:33:09,744][36154] Sum rewards: 49.428, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.592', 'AMMO5': '0.011', 'ARMOR': '0.020', 'AMMO2': '0.047', 'weapon5': '0.156', 'AMMO3': '0.208', 'AMMO4': '0.237', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.502', 'weapon4': '0.514', 'WEAPON3': '1.250', 'weapon3': '2.504', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '13.101', 'FRAGCOUNT': '45.000'} [2023-02-25 14:33:11,062][36138] Updated weights for policy 0, policy_version 52643 (0.0009) [2023-02-25 14:33:11,183][36155] DAMAGECOUNT value on done: 1143825.0 [2023-02-25 14:33:11,183][36155] Sum rewards: 46.548, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.009', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.039', 'AMMO3': '0.175', 'AMMO4': '0.193', 'weapon5': '0.222', 'WEAPON5': '0.400', 'weapon2': '0.412', 'WEAPON4': '0.500', 'weapon4': '0.640', 'WEAPON3': '1.100', 'weapon3': '2.450', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.195', 'FRAGCOUNT': '42.000'} [2023-02-25 14:33:11,485][36155] DAMAGECOUNT value on done: 1152136.0 [2023-02-25 14:33:11,486][36155] Sum rewards: 67.993, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.153', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon2': '0.186', 'weapon5': '0.198', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.588', 'WEAPON3': '1.200', 'weapon3': '2.742', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.961', 'FRAGCOUNT': '57.000'} [2023-02-25 14:33:12,099][36157] DAMAGECOUNT value on done: 1160826.0 [2023-02-25 14:33:12,100][36157] Sum rewards: 60.126, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.863', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.031', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'weapon5': '0.162', 'AMMO3': '0.268', 'weapon2': '0.306', 'WEAPON4': '0.400', 'weapon4': '0.522', 'WEAPON3': '1.600', 'weapon3': '2.692', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.278', 'FRAGCOUNT': '56.000'} [2023-02-25 14:33:12,331][36139] DAMAGECOUNT value on done: 1149020.0 [2023-02-25 14:33:12,332][36139] Sum rewards: 60.803, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.078', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.024', 'AMMO4': '0.105', 'weapon5': '0.126', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.464', 'WEAPON3': '1.050', 'HITCOUNT': '2.960', 'weapon3': '3.128', 'DAMAGECOUNT': '15.600', 'FRAGCOUNT': '51.000'} [2023-02-25 14:33:12,348][36155] DAMAGECOUNT value on done: 1167014.0 [2023-02-25 14:33:12,348][36155] Sum rewards: 67.107, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.413', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon2': '0.166', 'AMMO4': '0.170', 'weapon5': '0.206', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.564', 'WEAPON3': '1.200', 'weapon3': '2.634', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '57.000'} [2023-02-25 14:33:12,413][36157] DAMAGECOUNT value on done: 1150348.0 [2023-02-25 14:33:12,413][36157] Sum rewards: 60.566, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.478', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'weapon2': '0.260', 'weapon4': '0.672', 'WEAPON3': '0.950', 'weapon3': '2.794', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '49.000'} [2023-02-25 14:33:12,650][36155] DAMAGECOUNT value on done: 1145939.0 [2023-02-25 14:33:12,650][36139] DAMAGECOUNT value on done: 1146263.0 [2023-02-25 14:33:12,650][36155] Sum rewards: 59.333, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.970', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.044', 'weapon5': '0.144', 'AMMO4': '0.150', 'AMMO3': '0.156', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.386', 'WEAPON3': '0.950', 'HITCOUNT': '2.770', 'weapon3': '3.282', 'DAMAGECOUNT': '14.631', 'FRAGCOUNT': '50.000'} [2023-02-25 14:33:12,651][36139] Sum rewards: 66.340, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.102', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.138', 'AMMO3': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.250', 'weapon4': '0.290', 'WEAPON3': '1.200', 'weapon3': '3.096', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.201', 'FRAGCOUNT': '57.000'} [2023-02-25 14:33:12,723][36157] DAMAGECOUNT value on done: 1160604.0 [2023-02-25 14:33:12,723][36157] Sum rewards: 61.523, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.690', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.054', 'weapon2': '0.148', 'AMMO3': '0.184', 'AMMO4': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.398', 'WEAPON3': '1.150', 'HITCOUNT': '3.000', 'weapon3': '3.118', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '54.000'} [2023-02-25 14:33:12,979][36139] DAMAGECOUNT value on done: 1162073.0 [2023-02-25 14:33:12,979][36139] Sum rewards: 55.569, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.928', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon2': '0.176', 'weapon5': '0.204', 'AMMO3': '0.222', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.706', 'WEAPON3': '1.300', 'weapon3': '2.670', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.988', 'FRAGCOUNT': '50.000'} [2023-02-25 14:33:13,037][36157] DAMAGECOUNT value on done: 1154036.0 [2023-02-25 14:33:13,037][36157] Sum rewards: 51.976, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.534', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.490', 'weapon4': '0.538', 'WEAPON3': '1.350', 'weapon3': '2.662', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.188', 'FRAGCOUNT': '47.000'} [2023-02-25 14:33:13,280][36139] DAMAGECOUNT value on done: 1155424.0 [2023-02-25 14:33:13,280][36139] Sum rewards: 57.201, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.694', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.043', 'AMMO3': '0.194', 'AMMO4': '0.215', 'weapon5': '0.300', 'weapon2': '0.308', 'WEAPON4': '0.400', 'weapon4': '0.442', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.604', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.489', 'FRAGCOUNT': '49.000'} [2023-02-25 14:33:13,585][36140] DAMAGECOUNT value on done: 1153263.0 [2023-02-25 14:33:13,585][36140] Sum rewards: 55.946, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.235', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.140', 'weapon2': '0.144', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.432', 'WEAPON3': '1.150', 'weapon3': '2.854', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.998', 'FRAGCOUNT': '49.000'} [2023-02-25 14:33:13,813][36140] DAMAGECOUNT value on done: 1155343.0 [2023-02-25 14:33:13,814][36140] Sum rewards: 54.591, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.524', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO3': '0.132', 'AMMO4': '0.196', 'weapon5': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.694', 'WEAPON3': '0.800', 'weapon3': '2.550', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.208', 'FRAGCOUNT': '44.500'} [2023-02-25 14:33:13,911][36140] DAMAGECOUNT value on done: 1143716.0 [2023-02-25 14:33:13,912][36140] Sum rewards: 55.575, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.722', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon5': '0.122', 'AMMO4': '0.147', 'weapon2': '0.204', 'AMMO3': '0.222', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.490', 'WEAPON3': '1.350', 'weapon3': '2.926', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.838', 'FRAGCOUNT': '50.000'} [2023-02-25 14:33:14,118][36138] Updated weights for policy 0, policy_version 52653 (0.0010) [2023-02-25 14:33:14,135][36140] DAMAGECOUNT value on done: 1144973.0 [2023-02-25 14:33:14,135][36140] Sum rewards: 58.547, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.156', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.126', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'AMMO3': '0.191', 'weapon2': '0.262', 'WEAPON4': '0.300', 'weapon4': '0.638', 'WEAPON3': '1.200', 'weapon3': '2.696', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '52.000'} [2023-02-25 14:33:14,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13398.8). Total num frames: 215674880. Throughput: 0: 3356.1. Samples: 16412898. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:33:14,729][36114] Avg episode reward: [(0, '56.033')] [2023-02-25 14:33:15,978][36142] DAMAGECOUNT value on done: 1152201.0 [2023-02-25 14:33:15,978][36142] Sum rewards: 54.118, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.960', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.090', 'WEAPON5': '0.150', 'weapon2': '0.156', 'AMMO3': '0.174', 'WEAPON4': '0.350', 'weapon4': '0.976', 'WEAPON3': '1.000', 'weapon3': '2.422', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.082', 'FRAGCOUNT': '47.000'} [2023-02-25 14:33:16,296][36142] DAMAGECOUNT value on done: 1140722.0 [2023-02-25 14:33:16,296][36142] Sum rewards: 67.458, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.040', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon5': '0.108', 'weapon2': '0.144', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'weapon4': '0.382', 'WEAPON3': '1.500', 'weapon3': '3.114', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '59.000'} [2023-02-25 14:33:16,833][36142] DAMAGECOUNT value on done: 1152779.0 [2023-02-25 14:33:16,834][36142] Sum rewards: 56.267, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.960', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.076', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.210', 'AMMO3': '0.319', 'weapon2': '0.324', 'WEAPON3': '1.750', 'weapon3': '3.134', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.657', 'FRAGCOUNT': '53.000'} [2023-02-25 14:33:17,143][36142] DAMAGECOUNT value on done: 1162342.0 [2023-02-25 14:33:17,143][36142] Sum rewards: 52.479, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.038', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.136', 'AMMO4': '0.201', 'weapon4': '0.206', 'AMMO3': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.402', 'WEAPON3': '1.300', 'weapon3': '2.950', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.381', 'FRAGCOUNT': '47.000'} [2023-02-25 14:33:17,162][36138] Updated weights for policy 0, policy_version 52663 (0.0009) [2023-02-25 14:33:18,091][36156] DAMAGECOUNT value on done: 1164922.0 [2023-02-25 14:33:18,092][36156] Sum rewards: 59.009, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.444', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.120', 'weapon5': '0.124', 'AMMO4': '0.157', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.250', 'weapon3': '3.134', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.151', 'FRAGCOUNT': '51.000'} [2023-02-25 14:33:18,281][36156] DAMAGECOUNT value on done: 1158441.0 [2023-02-25 14:33:18,282][36156] Sum rewards: 50.995, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.694', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon4': '0.544', 'weapon2': '0.830', 'WEAPON3': '1.250', 'weapon3': '2.372', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.305', 'FRAGCOUNT': '46.000'} [2023-02-25 14:33:18,397][36156] DAMAGECOUNT value on done: 1147167.0 [2023-02-25 14:33:18,398][36156] Sum rewards: 66.206, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.252', 'AMMO5': '0.004', 'AMMO2': '0.029', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'AMMO3': '0.163', 'weapon2': '0.188', 'WEAPON4': '0.300', 'weapon4': '0.722', 'WEAPON3': '0.900', 'weapon3': '2.850', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '54.000'} [2023-02-25 14:33:18,593][36156] DAMAGECOUNT value on done: 1144649.0 [2023-02-25 14:33:18,593][36156] Sum rewards: 60.393, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.070', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO3': '0.167', 'AMMO4': '0.182', 'weapon5': '0.328', 'weapon2': '0.386', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.598', 'WEAPON3': '0.950', 'weapon3': '2.292', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '52.000'} [2023-02-25 14:33:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 215740416. Throughput: 0: 3354.6. Samples: 16432966. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:33:19,730][36114] Avg episode reward: [(0, '55.929')] [2023-02-25 14:33:19,734][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000052671_215740416.pth... [2023-02-25 14:33:19,788][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000051886_212525056.pth [2023-02-25 14:33:20,244][36138] Updated weights for policy 0, policy_version 52673 (0.0009) [2023-02-25 14:33:23,024][36155] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:33:23,310][36138] Updated weights for policy 0, policy_version 52683 (0.0010) [2023-02-25 14:33:24,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 215805952. Throughput: 0: 3355.0. Samples: 16442986. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:33:24,729][36114] Avg episode reward: [(0, '55.929')] [2023-02-25 14:33:26,332][36138] Updated weights for policy 0, policy_version 52693 (0.0010) [2023-02-25 14:33:29,091][36154] DAMAGECOUNT value on done: 1165752.0 [2023-02-25 14:33:29,091][36154] Sum rewards: 47.452, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.512', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.102', 'weapon7': '0.144', 'AMMO3': '0.157', 'weapon5': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.374', 'weapon4': '0.712', 'WEAPON3': '1.050', 'weapon3': '2.240', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '11.838', 'FRAGCOUNT': '42.000'} [2023-02-25 14:33:29,183][36141] DAMAGECOUNT value on done: 1162448.0 [2023-02-25 14:33:29,183][36141] Sum rewards: 57.926, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.770', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'weapon4': '0.116', 'AMMO3': '0.229', 'weapon2': '0.356', 'WEAPON3': '1.450', 'weapon3': '3.312', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '50.000'} [2023-02-25 14:33:29,396][36154] DAMAGECOUNT value on done: 1143647.0 [2023-02-25 14:33:29,396][36154] Sum rewards: 35.450, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.006', 'AMMO4': '0.029', 'AMMO3': '0.100', 'HEALTH': '0.312', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'weapon2': '0.714', 'HITCOUNT': '1.530', 'weapon3': '2.324', 'DAMAGECOUNT': '7.785', 'FRAGCOUNT': '27.000'} [2023-02-25 14:33:29,433][36138] Updated weights for policy 0, policy_version 52703 (0.0009) [2023-02-25 14:33:29,470][36154] DAMAGECOUNT value on done: 1163440.0 [2023-02-25 14:33:29,470][36154] Sum rewards: 74.394, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.020', 'weapon5': '0.074', 'weapon4': '0.090', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'weapon2': '0.226', 'HEALTH': '0.594', 'WEAPON3': '0.950', 'weapon3': '3.446', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.661', 'FRAGCOUNT': '60.000'} [2023-02-25 14:33:29,496][36141] DAMAGECOUNT value on done: 1151382.0 [2023-02-25 14:33:29,497][36141] Sum rewards: 50.328, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.586', 'AMMO5': '0.014', 'AMMO2': '0.061', 'AMMO3': '0.205', 'weapon5': '0.208', 'AMMO4': '0.306', 'weapon4': '0.342', 'WEAPON5': '0.400', 'weapon2': '0.458', 'WEAPON4': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.692', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '14.517', 'FRAGCOUNT': '48.000'} [2023-02-25 14:33:29,505][36141] DAMAGECOUNT value on done: 1160506.0 [2023-02-25 14:33:29,505][36141] Sum rewards: 69.231, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.220', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.163', 'weapon5': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.272', 'weapon4': '0.444', 'WEAPON3': '1.100', 'weapon3': '2.860', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '57.000'} [2023-02-25 14:33:29,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13371.0). Total num frames: 215871488. Throughput: 0: 3351.2. Samples: 16462952. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:33:29,729][36114] Avg episode reward: [(0, '56.117')] [2023-02-25 14:33:29,778][36154] DAMAGECOUNT value on done: 1154688.0 [2023-02-25 14:33:29,779][36154] Sum rewards: 57.216, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.100', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon5': '0.128', 'weapon4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon2': '0.664', 'WEAPON3': '1.450', 'weapon3': '2.826', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.679', 'FRAGCOUNT': '53.000'} [2023-02-25 14:33:29,807][36141] DAMAGECOUNT value on done: 1144824.0 [2023-02-25 14:33:29,807][36141] Sum rewards: 65.159, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.954', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.023', 'weapon5': '0.088', 'AMMO4': '0.116', 'weapon2': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.274', 'WEAPON4': '0.350', 'weapon4': '0.558', 'WEAPON3': '1.600', 'weapon3': '2.922', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '57.000'} [2023-02-25 14:33:31,297][36155] DAMAGECOUNT value on done: 1149903.0 [2023-02-25 14:33:31,298][36155] Sum rewards: 73.723, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.241', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon2': '0.162', 'AMMO3': '0.180', 'weapon5': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.698', 'WEAPON3': '1.050', 'weapon3': '2.566', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.234', 'FRAGCOUNT': '61.000'} [2023-02-25 14:33:31,602][36155] DAMAGECOUNT value on done: 1157015.0 [2023-02-25 14:33:31,603][36155] Sum rewards: 58.767, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.251', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.046', 'AMMO4': '0.121', 'AMMO3': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.320', 'WEAPON3': '0.700', 'weapon2': '0.904', 'weapon3': '2.544', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.637', 'FRAGCOUNT': '46.500'} [2023-02-25 14:33:32,298][36157] DAMAGECOUNT value on done: 1165509.0 [2023-02-25 14:33:32,298][36157] Sum rewards: 50.091, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.404', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.050', 'AMMO3': '0.173', 'weapon5': '0.200', 'AMMO4': '0.252', 'weapon2': '0.308', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'weapon4': '0.832', 'WEAPON3': '1.050', 'weapon3': '2.378', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '13.977', 'FRAGCOUNT': '44.000'} [2023-02-25 14:33:32,422][36139] DAMAGECOUNT value on done: 1154134.0 [2023-02-25 14:33:32,422][36139] Sum rewards: 66.375, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.288', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.110', 'AMMO4': '0.127', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.272', 'weapon2': '0.564', 'WEAPON3': '1.100', 'weapon3': '2.834', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '56.000'} [2023-02-25 14:33:32,444][36155] DAMAGECOUNT value on done: 1172111.0 [2023-02-25 14:33:32,444][36155] Sum rewards: 59.847, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.565', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.152', 'AMMO3': '0.169', 'AMMO4': '0.203', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON4': '0.400', 'weapon4': '0.606', 'WEAPON3': '1.100', 'weapon3': '2.702', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.291', 'FRAGCOUNT': '52.000'} [2023-02-25 14:33:32,512][36138] Updated weights for policy 0, policy_version 52713 (0.0009) [2023-02-25 14:33:32,593][36157] DAMAGECOUNT value on done: 1154925.0 [2023-02-25 14:33:32,594][36157] Sum rewards: 50.768, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.826', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.018', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.089', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'weapon4': '0.264', 'weapon2': '0.268', 'WEAPON3': '1.550', 'HITCOUNT': '3.090', 'weapon3': '3.238', 'DAMAGECOUNT': '13.731', 'FRAGCOUNT': '48.000'} [2023-02-25 14:33:32,739][36139] DAMAGECOUNT value on done: 1151146.0 [2023-02-25 14:33:32,739][36139] Sum rewards: 57.581, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.972', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon2': '0.196', 'AMMO3': '0.198', 'AMMO4': '0.204', 'weapon5': '0.244', 'WEAPON5': '0.400', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'weapon4': '1.236', 'weapon3': '1.974', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.547', 'FRAGCOUNT': '51.000'} [2023-02-25 14:33:32,761][36155] DAMAGECOUNT value on done: 1150631.0 [2023-02-25 14:33:32,762][36155] Sum rewards: 50.928, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.492', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.040', 'weapon5': '0.114', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO4': '0.201', 'weapon2': '0.238', 'WEAPON4': '0.250', 'AMMO3': '0.293', 'WEAPON3': '1.700', 'HITCOUNT': '2.730', 'weapon3': '3.204', 'DAMAGECOUNT': '14.076', 'FRAGCOUNT': '49.000'} [2023-02-25 14:33:32,892][36157] DAMAGECOUNT value on done: 1165272.0 [2023-02-25 14:33:32,892][36157] Sum rewards: 56.529, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.795', 'AMMO5': '0.006', 'AMMO2': '0.010', 'AMMO4': '0.052', 'weapon5': '0.102', 'AMMO3': '0.154', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.308', 'weapon4': '0.524', 'WEAPON3': '1.000', 'weapon3': '2.834', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.004', 'FRAGCOUNT': '47.000'} [2023-02-25 14:33:33,052][36139] DAMAGECOUNT value on done: 1166919.0 [2023-02-25 14:33:33,052][36139] Sum rewards: 53.575, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.140', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.042', 'weapon4': '0.138', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'AMMO3': '0.274', 'WEAPON4': '0.300', 'weapon2': '0.446', 'WEAPON3': '1.700', 'weapon3': '3.050', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.538', 'FRAGCOUNT': '51.000'} [2023-02-25 14:33:33,207][36157] DAMAGECOUNT value on done: 1159759.0 [2023-02-25 14:33:33,207][36157] Sum rewards: 71.294, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.750', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.080', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'weapon4': '0.246', 'weapon2': '0.252', 'WEAPON3': '1.250', 'weapon3': '3.260', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.169', 'FRAGCOUNT': '61.000'} [2023-02-25 14:33:33,403][36139] DAMAGECOUNT value on done: 1160231.0 [2023-02-25 14:33:33,404][36139] Sum rewards: 60.537, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.725', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.235', 'weapon2': '0.288', 'WEAPON3': '1.350', 'HITCOUNT': '3.080', 'weapon3': '3.608', 'DAMAGECOUNT': '14.421', 'FRAGCOUNT': '52.000'} [2023-02-25 14:33:33,788][36140] DAMAGECOUNT value on done: 1158083.0 [2023-02-25 14:33:33,789][36140] Sum rewards: 49.745, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.119', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.044', 'AMMO3': '0.189', 'weapon2': '0.204', 'AMMO4': '0.218', 'weapon5': '0.286', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'weapon4': '1.026', 'WEAPON3': '1.050', 'weapon3': '2.170', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.160', 'FRAGCOUNT': '43.000'} [2023-02-25 14:33:33,998][36140] DAMAGECOUNT value on done: 1161215.0 [2023-02-25 14:33:33,998][36140] Sum rewards: 68.037, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.832', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.118', 'AMMO4': '0.159', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'weapon2': '0.232', 'WEAPON4': '0.400', 'weapon4': '0.728', 'WEAPON3': '1.100', 'weapon3': '2.518', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '57.000'} [2023-02-25 14:33:34,102][36140] DAMAGECOUNT value on done: 1149168.0 [2023-02-25 14:33:34,103][36140] Sum rewards: 63.285, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.810', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.106', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'weapon2': '0.216', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'weapon4': '0.452', 'WEAPON3': '1.550', 'weapon3': '2.932', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.356', 'FRAGCOUNT': '56.000'} [2023-02-25 14:33:34,320][36140] DAMAGECOUNT value on done: 1149730.0 [2023-02-25 14:33:34,321][36140] Sum rewards: 57.184, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.000', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon2': '0.268', 'weapon4': '0.570', 'WEAPON3': '1.350', 'weapon3': '2.898', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.271', 'FRAGCOUNT': '50.000'} [2023-02-25 14:33:34,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13384.9). Total num frames: 215941120. Throughput: 0: 3351.6. Samples: 16482970. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:33:34,730][36114] Avg episode reward: [(0, '56.695')] [2023-02-25 14:33:35,542][36138] Updated weights for policy 0, policy_version 52723 (0.0009) [2023-02-25 14:33:36,102][36142] DAMAGECOUNT value on done: 1156099.0 [2023-02-25 14:33:36,103][36142] Sum rewards: 41.118, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.032', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.128', 'AMMO3': '0.150', 'AMMO4': '0.194', 'WEAPON5': '0.250', 'weapon4': '0.330', 'WEAPON4': '0.450', 'weapon2': '0.640', 'WEAPON3': '0.850', 'HITCOUNT': '2.570', 'weapon3': '2.594', 'DAMAGECOUNT': '11.694', 'FRAGCOUNT': '35.000'} [2023-02-25 14:33:36,398][36142] DAMAGECOUNT value on done: 1145961.0 [2023-02-25 14:33:36,398][36142] Sum rewards: 60.417, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.876', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.060', 'weapon4': '0.146', 'weapon2': '0.170', 'AMMO4': '0.211', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.210', 'weapon3': '3.404', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '53.000'} [2023-02-25 14:33:36,936][36142] DAMAGECOUNT value on done: 1157546.0 [2023-02-25 14:33:36,936][36142] Sum rewards: 56.301, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.554', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.016', 'weapon5': '0.066', 'AMMO4': '0.077', 'weapon4': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.202', 'AMMO3': '0.218', 'WEAPON3': '1.350', 'HITCOUNT': '3.090', 'weapon3': '3.442', 'DAMAGECOUNT': '14.301', 'FRAGCOUNT': '49.000'} [2023-02-25 14:33:37,239][36142] DAMAGECOUNT value on done: 1166604.0 [2023-02-25 14:33:37,240][36142] Sum rewards: 45.578, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.870', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.178', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'weapon2': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon4': '1.172', 'weapon3': '2.030', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '12.786', 'FRAGCOUNT': '42.000'} [2023-02-25 14:33:38,102][36156] DAMAGECOUNT value on done: 1169325.0 [2023-02-25 14:33:38,102][36156] Sum rewards: 50.736, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.370', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.104', 'AMMO3': '0.180', 'AMMO4': '0.198', 'WEAPON5': '0.200', 'weapon2': '0.258', 'weapon4': '0.260', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.730', 'weapon3': '3.220', 'DAMAGECOUNT': '13.209', 'FRAGCOUNT': '44.000'} [2023-02-25 14:33:38,305][36156] DAMAGECOUNT value on done: 1163753.0 [2023-02-25 14:33:38,306][36156] Sum rewards: 64.191, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.438', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.186', 'AMMO3': '0.216', 'weapon2': '0.346', 'WEAPON3': '1.300', 'weapon3': '3.154', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.936', 'FRAGCOUNT': '55.000'} [2023-02-25 14:33:38,419][36156] DAMAGECOUNT value on done: 1151908.0 [2023-02-25 14:33:38,420][36156] Sum rewards: 47.575, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.380', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.052', 'weapon5': '0.142', 'AMMO4': '0.259', 'AMMO3': '0.269', 'weapon4': '0.296', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'HITCOUNT': '2.840', 'weapon3': '2.894', 'DAMAGECOUNT': '14.223', 'FRAGCOUNT': '46.000'} [2023-02-25 14:33:38,582][36138] Updated weights for policy 0, policy_version 52733 (0.0009) [2023-02-25 14:33:38,622][36156] DAMAGECOUNT value on done: 1149475.0 [2023-02-25 14:33:38,623][36156] Sum rewards: 50.608, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.840', 'AMMO5': '0.009', 'AMMO2': '0.048', 'weapon5': '0.116', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'AMMO4': '0.238', 'WEAPON4': '0.400', 'weapon2': '0.540', 'weapon4': '0.662', 'WEAPON3': '1.000', 'weapon3': '2.332', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.478', 'FRAGCOUNT': '44.000'} [2023-02-25 14:33:39,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 216006656. Throughput: 0: 3353.3. Samples: 16493194. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:33:39,730][36114] Avg episode reward: [(0, '56.481')] [2023-02-25 14:33:41,651][36138] Updated weights for policy 0, policy_version 52743 (0.0010) [2023-02-25 14:33:44,729][36114] Fps is (10 sec: 13107.0, 60 sec: 13380.2, 300 sec: 13384.9). Total num frames: 216072192. Throughput: 0: 3346.2. Samples: 16513012. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:33:44,730][36114] Avg episode reward: [(0, '56.481')] [2023-02-25 14:33:44,775][36138] Updated weights for policy 0, policy_version 52753 (0.0009) [2023-02-25 14:33:46,878][36141] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:33:47,814][36138] Updated weights for policy 0, policy_version 52763 (0.0009) [2023-02-25 14:33:49,206][36154] DAMAGECOUNT value on done: 1170652.0 [2023-02-25 14:33:49,206][36154] Sum rewards: 60.525, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.465', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon5': '0.040', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'AMMO3': '0.175', 'weapon2': '0.256', 'WEAPON4': '0.350', 'weapon4': '0.654', 'WEAPON3': '0.950', 'weapon3': '2.916', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.700', 'FRAGCOUNT': '50.000'} [2023-02-25 14:33:49,344][36141] DAMAGECOUNT value on done: 1167473.0 [2023-02-25 14:33:49,344][36141] Sum rewards: 66.309, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.346', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.096', 'AMMO3': '0.122', 'AMMO4': '0.125', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.594', 'weapon2': '0.692', 'WEAPON3': '0.750', 'weapon3': '2.434', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.075', 'FRAGCOUNT': '55.000'} [2023-02-25 14:33:49,521][36154] DAMAGECOUNT value on done: 1147939.0 [2023-02-25 14:33:49,521][36154] Sum rewards: 47.481, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.762', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.050', 'AMMO4': '0.154', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'weapon4': '0.428', 'WEAPON4': '0.450', 'weapon2': '0.604', 'WEAPON3': '1.000', 'weapon3': '2.748', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '12.876', 'FRAGCOUNT': '41.000'} [2023-02-25 14:33:49,598][36154] DAMAGECOUNT value on done: 1168749.0 [2023-02-25 14:33:49,599][36154] Sum rewards: 66.330, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.127', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'weapon5': '0.114', 'WEAPON4': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.153', 'weapon2': '0.610', 'weapon4': '0.712', 'WEAPON3': '1.000', 'weapon3': '2.350', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '15.927', 'FRAGCOUNT': '53.000'} [2023-02-25 14:33:49,634][36141] DAMAGECOUNT value on done: 1156083.0 [2023-02-25 14:33:49,634][36141] Sum rewards: 53.622, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.206', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.092', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon2': '0.280', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon4': '0.860', 'WEAPON3': '1.150', 'weapon3': '2.594', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.049', 'FRAGCOUNT': '45.000'} [2023-02-25 14:33:49,643][36141] DAMAGECOUNT value on done: 1165203.0 [2023-02-25 14:33:49,643][36141] Sum rewards: 56.914, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.550', 'AMMO5': '0.004', 'AMMO2': '0.012', 'weapon4': '0.016', 'weapon5': '0.026', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.243', 'weapon2': '0.372', 'WEAPON3': '1.450', 'HITCOUNT': '3.080', 'weapon3': '3.412', 'DAMAGECOUNT': '14.091', 'FRAGCOUNT': '50.500'} [2023-02-25 14:33:49,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 216141824. Throughput: 0: 3343.5. Samples: 16533124. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:33:49,729][36114] Avg episode reward: [(0, '56.623')] [2023-02-25 14:33:49,897][36154] DAMAGECOUNT value on done: 1158875.0 [2023-02-25 14:33:49,897][36154] Sum rewards: 43.322, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.270', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.116', 'AMMO4': '0.140', 'WEAPON5': '0.250', 'weapon2': '0.256', 'AMMO3': '0.279', 'WEAPON4': '0.300', 'weapon4': '0.310', 'WEAPON3': '1.650', 'HITCOUNT': '2.660', 'weapon3': '3.034', 'DAMAGECOUNT': '12.561', 'FRAGCOUNT': '43.000'} [2023-02-25 14:33:49,958][36141] DAMAGECOUNT value on done: 1149587.0 [2023-02-25 14:33:49,959][36141] Sum rewards: 56.918, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.460', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'weapon5': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.202', 'weapon4': '0.350', 'weapon2': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.860', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.289', 'FRAGCOUNT': '50.000'} [2023-02-25 14:33:50,889][36138] Updated weights for policy 0, policy_version 52773 (0.0009) [2023-02-25 14:33:51,345][36155] DAMAGECOUNT value on done: 1155242.0 [2023-02-25 14:33:51,346][36155] Sum rewards: 63.527, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.305', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'WEAPON4': '0.350', 'weapon2': '0.370', 'weapon4': '0.478', 'WEAPON3': '1.300', 'weapon3': '2.774', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '56.000'} [2023-02-25 14:33:51,641][36155] DAMAGECOUNT value on done: 1161106.0 [2023-02-25 14:33:51,641][36155] Sum rewards: 46.657, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.366', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.046', 'AMMO3': '0.125', 'AMMO4': '0.228', 'weapon5': '0.266', 'weapon2': '0.334', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '0.700', 'weapon4': '0.798', 'weapon3': '2.270', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '12.273', 'FRAGCOUNT': '40.000'} [2023-02-25 14:33:52,401][36157] DAMAGECOUNT value on done: 1169283.0 [2023-02-25 14:33:52,402][36157] Sum rewards: 42.177, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.578', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.104', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon2': '0.246', 'WEAPON4': '0.250', 'weapon4': '0.574', 'WEAPON3': '1.100', 'HITCOUNT': '2.350', 'weapon3': '2.660', 'DAMAGECOUNT': '11.322', 'FRAGCOUNT': '37.000'} [2023-02-25 14:33:52,507][36139] DAMAGECOUNT value on done: 1158848.0 [2023-02-25 14:33:52,508][36139] Sum rewards: 53.833, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.300', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'weapon4': '0.176', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'weapon2': '0.336', 'WEAPON3': '1.100', 'HITCOUNT': '2.910', 'weapon3': '3.232', 'DAMAGECOUNT': '14.142', 'FRAGCOUNT': '46.000'} [2023-02-25 14:33:52,512][36155] DAMAGECOUNT value on done: 1176387.0 [2023-02-25 14:33:52,513][36155] Sum rewards: 50.864, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.870', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO3': '0.124', 'AMMO4': '0.164', 'weapon5': '0.192', 'weapon2': '0.316', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'weapon4': '0.806', 'WEAPON3': '0.850', 'weapon3': '2.352', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '12.828', 'FRAGCOUNT': '44.000'} [2023-02-25 14:33:52,709][36157] DAMAGECOUNT value on done: 1159867.0 [2023-02-25 14:33:52,710][36157] Sum rewards: 56.399, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.192', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.027', 'weapon5': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.234', 'weapon2': '0.242', 'WEAPON3': '1.500', 'HITCOUNT': '3.080', 'weapon3': '3.530', 'DAMAGECOUNT': '14.826', 'FRAGCOUNT': '50.000'} [2023-02-25 14:33:52,811][36139] DAMAGECOUNT value on done: 1156385.0 [2023-02-25 14:33:52,812][36139] Sum rewards: 58.854, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.897', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.047', 'AMMO3': '0.150', 'weapon2': '0.174', 'weapon5': '0.182', 'WEAPON5': '0.200', 'AMMO4': '0.234', 'WEAPON4': '0.450', 'WEAPON3': '0.900', 'weapon4': '1.070', 'weapon3': '2.286', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '49.000'} [2023-02-25 14:33:52,828][36155] DAMAGECOUNT value on done: 1155252.0 [2023-02-25 14:33:52,829][36155] Sum rewards: 56.881, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.222', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.046', 'AMMO4': '0.050', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon4': '0.324', 'weapon2': '0.410', 'WEAPON3': '1.300', 'weapon3': '3.016', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.863', 'FRAGCOUNT': '50.000'} [2023-02-25 14:33:53,028][36157] DAMAGECOUNT value on done: 1170057.0 [2023-02-25 14:33:53,028][36157] Sum rewards: 53.515, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.782', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon5': '0.142', 'AMMO4': '0.171', 'AMMO3': '0.187', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.518', 'weapon2': '0.578', 'WEAPON3': '1.150', 'weapon3': '2.516', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '14.355', 'FRAGCOUNT': '49.000'} [2023-02-25 14:33:53,124][36139] DAMAGECOUNT value on done: 1171497.0 [2023-02-25 14:33:53,124][36139] Sum rewards: 42.675, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.760', 'AMMO5': '0.019', 'AMMO2': '0.061', 'AMMO3': '0.191', 'weapon5': '0.242', 'AMMO4': '0.304', 'weapon2': '0.454', 'WEAPON5': '0.500', 'WEAPON4': '0.750', 'weapon4': '1.086', 'WEAPON3': '1.100', 'weapon3': '1.734', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.734', 'FRAGCOUNT': '38.000'} [2023-02-25 14:33:53,332][36157] DAMAGECOUNT value on done: 1165322.0 [2023-02-25 14:33:53,333][36157] Sum rewards: 61.395, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.536', 'AMMO5': '0.017', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.214', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon2': '0.294', 'WEAPON5': '0.350', 'weapon4': '0.364', 'WEAPON3': '1.300', 'weapon3': '2.790', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.689', 'FRAGCOUNT': '52.000'} [2023-02-25 14:33:53,442][36139] DAMAGECOUNT value on done: 1165514.0 [2023-02-25 14:33:53,443][36139] Sum rewards: 52.559, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.510', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.017', 'weapon5': '0.050', 'AMMO4': '0.084', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'weapon7': '0.198', 'AMMO3': '0.249', 'weapon2': '0.258', 'WEAPON4': '0.350', 'weapon4': '0.814', 'WEAPON3': '1.450', 'weapon3': '2.394', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.849', 'FRAGCOUNT': '47.000'} [2023-02-25 14:33:53,865][36140] DAMAGECOUNT value on done: 1162489.0 [2023-02-25 14:33:53,866][36140] Sum rewards: 54.317, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.725', 'AMMO2': '0.012', 'AMMO5': '0.015', 'AMMO4': '0.058', 'weapon5': '0.122', 'AMMO3': '0.145', 'weapon2': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.686', 'WEAPON3': '0.950', 'weapon3': '2.836', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.218', 'FRAGCOUNT': '45.000'} [2023-02-25 14:33:53,927][36138] Updated weights for policy 0, policy_version 52783 (0.0009) [2023-02-25 14:33:54,076][36140] DAMAGECOUNT value on done: 1166863.0 [2023-02-25 14:33:54,077][36140] Sum rewards: 62.751, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.214', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.196', 'AMMO3': '0.239', 'weapon4': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.400', 'weapon3': '2.920', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '55.000'} [2023-02-25 14:33:54,185][36140] DAMAGECOUNT value on done: 1153686.0 [2023-02-25 14:33:54,186][36140] Sum rewards: 56.860, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.216', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.104', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'weapon4': '0.204', 'WEAPON4': '0.300', 'weapon2': '0.438', 'WEAPON3': '1.100', 'HITCOUNT': '2.790', 'weapon3': '3.092', 'DAMAGECOUNT': '13.554', 'FRAGCOUNT': '49.000'} [2023-02-25 14:33:54,386][36140] DAMAGECOUNT value on done: 1153898.0 [2023-02-25 14:33:54,386][36140] Sum rewards: 43.248, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.506', 'AMMO5': '0.013', 'AMMO2': '0.053', 'weapon7': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.180', 'WEAPON7': '0.200', 'weapon5': '0.246', 'AMMO4': '0.265', 'weapon2': '0.448', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.680', 'WEAPON3': '0.950', 'weapon3': '2.148', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '12.354', 'FRAGCOUNT': '39.000'} [2023-02-25 14:33:54,729][36114] Fps is (10 sec: 13517.0, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 216207360. Throughput: 0: 3342.8. Samples: 16543266. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:33:54,729][36114] Avg episode reward: [(0, '56.030')] [2023-02-25 14:33:56,199][36142] DAMAGECOUNT value on done: 1160840.0 [2023-02-25 14:33:56,199][36142] Sum rewards: 48.990, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.072', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon5': '0.140', 'AMMO3': '0.186', 'AMMO4': '0.201', 'WEAPON5': '0.350', 'weapon2': '0.392', 'WEAPON4': '0.400', 'weapon4': '0.460', 'WEAPON3': '1.200', 'weapon3': '2.762', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.223', 'FRAGCOUNT': '43.000'} [2023-02-25 14:33:56,519][36142] DAMAGECOUNT value on done: 1150532.0 [2023-02-25 14:33:56,520][36142] Sum rewards: 52.416, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.400', 'AMMO5': '0.015', 'AMMO2': '0.048', 'AMMO3': '0.145', 'weapon5': '0.204', 'AMMO4': '0.239', 'weapon2': '0.270', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.722', 'WEAPON3': '0.900', 'weapon3': '2.540', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.383', 'FRAGCOUNT': '45.000'} [2023-02-25 14:33:56,944][36138] Updated weights for policy 0, policy_version 52793 (0.0009) [2023-02-25 14:33:57,051][36142] DAMAGECOUNT value on done: 1162691.0 [2023-02-25 14:33:57,052][36142] Sum rewards: 56.257, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.292', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON4': '0.100', 'weapon4': '0.116', 'AMMO3': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.400', 'HITCOUNT': '3.260', 'weapon3': '3.266', 'DAMAGECOUNT': '15.435', 'FRAGCOUNT': '49.000'} [2023-02-25 14:33:57,345][36142] DAMAGECOUNT value on done: 1171129.0 [2023-02-25 14:33:57,345][36142] Sum rewards: 48.258, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.858', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon5': '0.034', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.238', 'AMMO3': '0.269', 'weapon2': '0.492', 'WEAPON3': '1.500', 'weapon3': '2.994', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.575', 'FRAGCOUNT': '44.000'} [2023-02-25 14:33:58,177][36156] DAMAGECOUNT value on done: 1174520.0 [2023-02-25 14:33:58,177][36156] Sum rewards: 55.545, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.467', 'AMMO5': '0.018', 'AMMO2': '0.054', 'AMMO3': '0.219', 'weapon5': '0.246', 'AMMO4': '0.269', 'weapon2': '0.368', 'weapon4': '0.532', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.470', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '51.000'} [2023-02-25 14:33:58,403][36156] DAMAGECOUNT value on done: 1168357.0 [2023-02-25 14:33:58,404][36156] Sum rewards: 50.015, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.705', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.032', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.161', 'AMMO3': '0.192', 'weapon2': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.564', 'WEAPON3': '1.100', 'weapon3': '2.940', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.812', 'FRAGCOUNT': '44.000'} [2023-02-25 14:33:58,491][36156] DAMAGECOUNT value on done: 1156561.0 [2023-02-25 14:33:58,491][36156] Sum rewards: 51.042, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.920', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.106', 'weapon5': '0.158', 'AMMO3': '0.165', 'AMMO4': '0.178', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.466', 'WEAPON3': '1.150', 'HITCOUNT': '2.770', 'weapon3': '3.008', 'DAMAGECOUNT': '13.959', 'FRAGCOUNT': '44.000'} [2023-02-25 14:33:58,720][36156] DAMAGECOUNT value on done: 1154150.0 [2023-02-25 14:33:58,721][36156] Sum rewards: 58.746, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.676', 'AMMO2': '0.002', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO4': '0.008', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.098', 'AMMO3': '0.147', 'ARMOR': '0.400', 'weapon2': '0.452', 'WEAPON3': '1.050', 'HITCOUNT': '2.870', 'weapon3': '3.262', 'DAMAGECOUNT': '14.025', 'FRAGCOUNT': '47.000'} [2023-02-25 14:33:59,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 216276992. Throughput: 0: 3346.5. Samples: 16563490. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:33:59,730][36114] Avg episode reward: [(0, '55.766')] [2023-02-25 14:33:59,957][36138] Updated weights for policy 0, policy_version 52803 (0.0009) [2023-02-25 14:34:02,358][36141] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:34:02,995][36138] Updated weights for policy 0, policy_version 52813 (0.0009) [2023-02-25 14:34:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 216342528. Throughput: 0: 3347.9. Samples: 16583622. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:34:04,730][36114] Avg episode reward: [(0, '55.766')] [2023-02-25 14:34:06,017][36138] Updated weights for policy 0, policy_version 52823 (0.0009) [2023-02-25 14:34:08,552][36140] Large shaping reward 2.511 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.489, 163.0), ('weapon5', 0.002)] [2023-02-25 14:34:09,065][36138] Updated weights for policy 0, policy_version 52833 (0.0009) [2023-02-25 14:34:09,131][36154] DAMAGECOUNT value on done: 1174914.0 [2023-02-25 14:34:09,131][36154] Sum rewards: 51.576, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.340', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.100', 'weapon4': '0.126', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.810', 'WEAPON3': '0.950', 'weapon3': '2.746', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.786', 'FRAGCOUNT': '44.000'} [2023-02-25 14:34:09,304][36141] DAMAGECOUNT value on done: 1171977.0 [2023-02-25 14:34:09,305][36141] Sum rewards: 49.087, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.780', 'AMMO5': '0.007', 'AMMO2': '0.056', 'weapon5': '0.138', 'AMMO3': '0.177', 'WEAPON5': '0.250', 'AMMO4': '0.278', 'weapon2': '0.300', 'WEAPON4': '0.700', 'WEAPON3': '1.000', 'weapon4': '1.350', 'weapon3': '1.764', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '13.467', 'FRAGCOUNT': '44.000'} [2023-02-25 14:34:09,439][36154] DAMAGECOUNT value on done: 1152269.0 [2023-02-25 14:34:09,439][36154] Sum rewards: 47.395, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.710', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.100', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon2': '0.392', 'weapon4': '0.496', 'WEAPON3': '1.100', 'weapon3': '2.746', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.990', 'FRAGCOUNT': '41.000'} [2023-02-25 14:34:09,521][36154] DAMAGECOUNT value on done: 1173312.0 [2023-02-25 14:34:09,522][36154] Sum rewards: 48.633, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.679', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.096', 'AMMO4': '0.099', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon4': '0.342', 'weapon2': '0.370', 'ARMOR': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.868', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.689', 'FRAGCOUNT': '41.000'} [2023-02-25 14:34:09,615][36141] DAMAGECOUNT value on done: 1160054.0 [2023-02-25 14:34:09,615][36141] Sum rewards: 42.874, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.607', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon7': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.158', 'AMMO3': '0.169', 'weapon2': '0.218', 'weapon5': '0.282', 'WEAPON5': '0.400', 'ARMOR': '0.459', 'WEAPON4': '0.500', 'weapon4': '0.848', 'WEAPON3': '1.000', 'weapon3': '2.094', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '11.913', 'FRAGCOUNT': '38.000'} [2023-02-25 14:34:09,624][36141] DAMAGECOUNT value on done: 1170618.0 [2023-02-25 14:34:09,625][36141] Sum rewards: 58.955, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.700', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.056', 'AMMO4': '0.110', 'WEAPON5': '0.200', 'weapon2': '0.202', 'weapon4': '0.206', 'WEAPON4': '0.250', 'AMMO3': '0.307', 'WEAPON3': '1.800', 'weapon3': '3.250', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '55.000'} [2023-02-25 14:34:09,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 216412160. Throughput: 0: 3350.8. Samples: 16593774. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:34:09,730][36114] Avg episode reward: [(0, '55.702')] [2023-02-25 14:34:09,826][36154] DAMAGECOUNT value on done: 1163057.0 [2023-02-25 14:34:09,827][36154] Sum rewards: 48.901, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.430', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.126', 'weapon4': '0.150', 'AMMO4': '0.169', 'AMMO3': '0.219', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.710', 'weapon3': '3.064', 'DAMAGECOUNT': '12.546', 'FRAGCOUNT': '44.000'} [2023-02-25 14:34:09,925][36141] DAMAGECOUNT value on done: 1154027.0 [2023-02-25 14:34:09,926][36141] Sum rewards: 52.012, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.664', 'AMMO5': '0.014', 'AMMO2': '0.045', 'AMMO3': '0.130', 'AMMO4': '0.226', 'weapon5': '0.236', 'WEAPON5': '0.350', 'weapon2': '0.406', 'WEAPON4': '0.500', 'weapon4': '0.682', 'WEAPON3': '0.850', 'weapon3': '2.426', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.320', 'FRAGCOUNT': '44.000'} [2023-02-25 14:34:11,265][36155] DAMAGECOUNT value on done: 1160195.0 [2023-02-25 14:34:11,265][36155] Sum rewards: 65.561, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.574', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.086', 'AMMO4': '0.156', 'weapon4': '0.164', 'AMMO3': '0.210', 'weapon2': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '2.970', 'weapon3': '3.244', 'DAMAGECOUNT': '14.859', 'FRAGCOUNT': '59.000'} [2023-02-25 14:34:11,578][36155] DAMAGECOUNT value on done: 1166505.0 [2023-02-25 14:34:11,579][36155] Sum rewards: 67.980, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.316', 'weapon5': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.212', 'AMMO3': '0.273', 'weapon2': '0.564', 'WEAPON3': '1.750', 'weapon3': '3.008', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.197', 'FRAGCOUNT': '62.000'} [2023-02-25 14:34:12,134][36138] Updated weights for policy 0, policy_version 52843 (0.0009) [2023-02-25 14:34:12,324][36139] DAMAGECOUNT value on done: 1163226.0 [2023-02-25 14:34:12,325][36139] Sum rewards: 53.985, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.978', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.086', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon2': '0.206', 'weapon4': '0.658', 'WEAPON3': '1.150', 'weapon3': '2.748', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.134', 'FRAGCOUNT': '47.000'} [2023-02-25 14:34:12,444][36155] DAMAGECOUNT value on done: 1181271.0 [2023-02-25 14:34:12,445][36155] Sum rewards: 63.400, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.374', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon2': '0.342', 'weapon4': '0.514', 'WEAPON3': '1.050', 'weapon3': '2.806', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.652', 'FRAGCOUNT': '54.000'} [2023-02-25 14:34:12,519][36157] DAMAGECOUNT value on done: 1173852.0 [2023-02-25 14:34:12,520][36157] Sum rewards: 57.272, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.245', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.076', 'WEAPON5': '0.150', 'weapon2': '0.158', 'AMMO4': '0.198', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon4': '0.598', 'WEAPON3': '1.300', 'weapon3': '2.862', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '13.707', 'FRAGCOUNT': '51.000'} [2023-02-25 14:34:12,624][36139] DAMAGECOUNT value on done: 1161157.0 [2023-02-25 14:34:12,625][36139] Sum rewards: 47.847, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.685', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.122', 'AMMO4': '0.133', 'weapon4': '0.208', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.350', 'HITCOUNT': '2.880', 'weapon3': '3.126', 'DAMAGECOUNT': '14.316', 'FRAGCOUNT': '43.000'} [2023-02-25 14:34:12,754][36155] DAMAGECOUNT value on done: 1160455.0 [2023-02-25 14:34:12,755][36155] Sum rewards: 58.811, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.721', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.185', 'weapon5': '0.200', 'weapon2': '0.282', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.664', 'WEAPON3': '1.150', 'weapon3': '2.480', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.609', 'FRAGCOUNT': '51.000'} [2023-02-25 14:34:12,834][36157] DAMAGECOUNT value on done: 1164708.0 [2023-02-25 14:34:12,834][36157] Sum rewards: 56.204, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.090', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.164', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.300', 'weapon4': '0.692', 'WEAPON3': '1.100', 'weapon3': '2.588', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.523', 'FRAGCOUNT': '48.000'} [2023-02-25 14:34:12,967][36139] DAMAGECOUNT value on done: 1175638.0 [2023-02-25 14:34:12,967][36139] Sum rewards: 49.580, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.955', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO3': '0.173', 'weapon2': '0.600', 'WEAPON3': '1.150', 'HITCOUNT': '2.640', 'weapon3': '3.304', 'DAMAGECOUNT': '12.423', 'FRAGCOUNT': '41.000'} [2023-02-25 14:34:13,132][36157] DAMAGECOUNT value on done: 1174851.0 [2023-02-25 14:34:13,132][36157] Sum rewards: 60.072, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.790', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.124', 'weapon4': '0.152', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.550', 'WEAPON3': '1.150', 'HITCOUNT': '2.940', 'weapon3': '2.958', 'DAMAGECOUNT': '14.382', 'FRAGCOUNT': '52.000'} [2023-02-25 14:34:13,279][36139] DAMAGECOUNT value on done: 1170603.0 [2023-02-25 14:34:13,279][36139] Sum rewards: 64.348, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.145', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.056', 'AMMO3': '0.164', 'AMMO4': '0.190', 'weapon5': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.408', 'WEAPON3': '0.950', 'HITCOUNT': '3.100', 'weapon3': '3.132', 'DAMAGECOUNT': '15.267', 'FRAGCOUNT': '54.000'} [2023-02-25 14:34:13,443][36157] DAMAGECOUNT value on done: 1170140.0 [2023-02-25 14:34:13,444][36157] Sum rewards: 58.399, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.211', 'weapon2': '0.228', 'weapon4': '0.256', 'HEALTH': '0.514', 'WEAPON3': '1.150', 'HITCOUNT': '3.050', 'weapon3': '3.266', 'DAMAGECOUNT': '14.454', 'FRAGCOUNT': '50.000'} [2023-02-25 14:34:13,732][36140] DAMAGECOUNT value on done: 1166262.0 [2023-02-25 14:34:13,733][36140] Sum rewards: 43.351, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.265', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon7': '0.048', 'weapon5': '0.066', 'AMMO4': '0.071', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.354', 'WEAPON3': '0.500', 'weapon4': '0.660', 'weapon3': '1.614', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '11.319', 'FRAGCOUNT': '34.000'} [2023-02-25 14:34:13,892][36140] DAMAGECOUNT value on done: 1171768.0 [2023-02-25 14:34:13,893][36140] Sum rewards: 60.210, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.189', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.171', 'WEAPON4': '0.250', 'weapon5': '0.266', 'weapon4': '0.296', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.100', 'weapon3': '2.884', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.715', 'FRAGCOUNT': '51.000'} [2023-02-25 14:34:14,040][36140] DAMAGECOUNT value on done: 1158568.0 [2023-02-25 14:34:14,041][36140] Sum rewards: 56.643, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.060', 'ARMOR': '0.004', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.142', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.200', 'weapon3': '3.228', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.646', 'FRAGCOUNT': '49.000'} [2023-02-25 14:34:14,218][36140] DAMAGECOUNT value on done: 1158602.0 [2023-02-25 14:34:14,218][36140] Sum rewards: 49.863, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.582', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.065', 'AMMO3': '0.161', 'weapon5': '0.224', 'AMMO4': '0.323', 'weapon2': '0.388', 'WEAPON5': '0.550', 'weapon4': '0.598', 'WEAPON4': '0.700', 'WEAPON3': '1.050', 'weapon3': '2.508', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.112', 'FRAGCOUNT': '44.000'} [2023-02-25 14:34:14,729][36114] Fps is (10 sec: 13516.6, 60 sec: 13380.2, 300 sec: 13398.8). Total num frames: 216477696. Throughput: 0: 3356.1. Samples: 16613978. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:34:14,730][36114] Avg episode reward: [(0, '55.557')] [2023-02-25 14:34:15,218][36138] Updated weights for policy 0, policy_version 52853 (0.0009) [2023-02-25 14:34:16,265][36142] DAMAGECOUNT value on done: 1165604.0 [2023-02-25 14:34:16,266][36142] Sum rewards: 51.905, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.626', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.059', 'weapon5': '0.116', 'AMMO3': '0.189', 'AMMO4': '0.294', 'weapon2': '0.382', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'weapon4': '0.872', 'WEAPON3': '1.100', 'weapon3': '2.254', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.292', 'FRAGCOUNT': '47.000'} [2023-02-25 14:34:16,590][36142] DAMAGECOUNT value on done: 1155716.0 [2023-02-25 14:34:16,590][36142] Sum rewards: 67.697, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.836', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.004', 'ARMOR': '0.004', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.178', 'AMMO3': '0.195', 'weapon2': '0.418', 'WEAPON3': '1.200', 'weapon3': '3.208', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.552', 'FRAGCOUNT': '57.000'} [2023-02-25 14:34:17,129][36142] DAMAGECOUNT value on done: 1167891.0 [2023-02-25 14:34:17,130][36142] Sum rewards: 62.729, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.551', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.144', 'AMMO3': '0.180', 'weapon2': '0.424', 'WEAPON3': '1.050', 'weapon3': '3.204', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.600', 'FRAGCOUNT': '51.000'} [2023-02-25 14:34:17,437][36142] DAMAGECOUNT value on done: 1175674.0 [2023-02-25 14:34:17,438][36142] Sum rewards: 49.110, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.860', 'AMMO5': '0.018', 'AMMO2': '0.049', 'AMMO3': '0.170', 'weapon5': '0.214', 'AMMO4': '0.244', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon4': '0.458', 'weapon2': '0.644', 'WEAPON3': '0.950', 'weapon3': '2.428', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '13.635', 'FRAGCOUNT': '42.000'} [2023-02-25 14:34:18,096][36156] DAMAGECOUNT value on done: 1179530.0 [2023-02-25 14:34:18,096][36156] Sum rewards: 61.401, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.327', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'weapon4': '0.186', 'weapon2': '0.584', 'WEAPON3': '1.000', 'weapon3': '3.014', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.030', 'FRAGCOUNT': '50.000'} [2023-02-25 14:34:18,297][36138] Updated weights for policy 0, policy_version 52863 (0.0009) [2023-02-25 14:34:18,370][36156] DAMAGECOUNT value on done: 1172263.0 [2023-02-25 14:34:18,370][36156] Sum rewards: 45.046, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.640', 'AMMO5': '0.011', 'AMMO2': '0.047', 'AMMO3': '0.168', 'weapon5': '0.168', 'AMMO4': '0.237', 'weapon2': '0.292', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'weapon4': '1.020', 'weapon3': '1.944', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '11.718', 'FRAGCOUNT': '40.000'} [2023-02-25 14:34:18,407][36156] DAMAGECOUNT value on done: 1161464.0 [2023-02-25 14:34:18,407][36156] Sum rewards: 58.096, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.702', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.048', 'AMMO3': '0.141', 'weapon5': '0.170', 'AMMO4': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.458', 'weapon4': '0.656', 'WEAPON3': '0.900', 'weapon3': '2.470', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.709', 'FRAGCOUNT': '48.000'} [2023-02-25 14:34:18,684][36156] DAMAGECOUNT value on done: 1159250.0 [2023-02-25 14:34:18,684][36156] Sum rewards: 67.886, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.486', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'weapon5': '0.094', 'AMMO3': '0.131', 'WEAPON5': '0.150', 'weapon4': '0.276', 'weapon2': '0.300', 'WEAPON3': '0.950', 'weapon3': '3.010', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '54.000'} [2023-02-25 14:34:19,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 216543232. Throughput: 0: 3354.5. Samples: 16633924. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:34:19,729][36114] Avg episode reward: [(0, '55.646')] [2023-02-25 14:34:19,917][36154] Large shaping reward 2.601 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.579, 193.0), ('weapon5', 0.002)] [2023-02-25 14:34:21,401][36138] Updated weights for policy 0, policy_version 52873 (0.0009) [2023-02-25 14:34:24,495][36138] Updated weights for policy 0, policy_version 52883 (0.0009) [2023-02-25 14:34:24,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 216608768. Throughput: 0: 3347.6. Samples: 16643838. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:34:24,730][36114] Avg episode reward: [(0, '55.646')] [2023-02-25 14:34:27,550][36138] Updated weights for policy 0, policy_version 52893 (0.0010) [2023-02-25 14:34:29,188][36154] DAMAGECOUNT value on done: 1180165.0 [2023-02-25 14:34:29,188][36154] Sum rewards: 56.087, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.170', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.049', 'AMMO3': '0.149', 'AMMO4': '0.247', 'weapon5': '0.284', 'weapon4': '0.292', 'weapon2': '0.502', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'weapon3': '2.610', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '46.000'} [2023-02-25 14:34:29,411][36141] DAMAGECOUNT value on done: 1176891.0 [2023-02-25 14:34:29,412][36141] Sum rewards: 61.502, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon4': '0.022', 'AMMO4': '0.027', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.201', 'weapon2': '0.354', 'HEALTH': '0.498', 'WEAPON3': '1.150', 'HITCOUNT': '3.050', 'weapon3': '3.304', 'DAMAGECOUNT': '14.742', 'FRAGCOUNT': '53.000'} [2023-02-25 14:34:29,500][36154] DAMAGECOUNT value on done: 1157083.0 [2023-02-25 14:34:29,501][36154] Sum rewards: 58.161, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.270', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.084', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon2': '0.332', 'weapon4': '0.372', 'WEAPON3': '0.950', 'HITCOUNT': '2.660', 'weapon3': '2.908', 'DAMAGECOUNT': '14.442', 'FRAGCOUNT': '48.000'} [2023-02-25 14:34:29,700][36154] DAMAGECOUNT value on done: 1177948.0 [2023-02-25 14:34:29,700][36154] Sum rewards: 58.940, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.788', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.033', 'AMMO3': '0.157', 'weapon5': '0.162', 'AMMO4': '0.165', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.428', 'weapon2': '0.890', 'WEAPON3': '0.950', 'weapon3': '2.062', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.908', 'FRAGCOUNT': '51.000'} [2023-02-25 14:34:29,729][36114] Fps is (10 sec: 13516.6, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 216678400. Throughput: 0: 3353.4. Samples: 16663916. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:34:29,730][36114] Avg episode reward: [(0, '55.627')] [2023-02-25 14:34:29,735][36141] DAMAGECOUNT value on done: 1165741.0 [2023-02-25 14:34:29,735][36141] Sum rewards: 69.586, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.580', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.011', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'weapon4': '0.168', 'weapon2': '0.172', 'AMMO3': '0.273', 'WEAPON3': '1.650', 'weapon3': '3.388', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '62.000'} [2023-02-25 14:34:29,746][36141] DAMAGECOUNT value on done: 1175739.0 [2023-02-25 14:34:29,746][36141] Sum rewards: 60.073, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.732', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.025', 'weapon5': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'weapon4': '0.256', 'weapon2': '0.414', 'WEAPON3': '1.100', 'weapon3': '2.924', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.363', 'FRAGCOUNT': '49.000'} [2023-02-25 14:34:30,003][36154] DAMAGECOUNT value on done: 1167533.0 [2023-02-25 14:34:30,003][36154] Sum rewards: 51.693, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.534', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.177', 'AMMO3': '0.178', 'weapon5': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.410', 'weapon4': '0.698', 'WEAPON3': '1.000', 'weapon3': '2.344', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.428', 'FRAGCOUNT': '43.000'} [2023-02-25 14:34:30,052][36141] DAMAGECOUNT value on done: 1158624.0 [2023-02-25 14:34:30,052][36141] Sum rewards: 62.200, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.838', 'AMMO5': '0.003', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.140', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'weapon2': '0.292', 'weapon4': '0.322', 'WEAPON3': '1.150', 'HITCOUNT': '2.880', 'weapon3': '3.132', 'DAMAGECOUNT': '13.791', 'FRAGCOUNT': '55.000'} [2023-02-25 14:34:30,613][36138] Updated weights for policy 0, policy_version 52903 (0.0009) [2023-02-25 14:34:31,378][36155] DAMAGECOUNT value on done: 1165327.0 [2023-02-25 14:34:31,378][36155] Sum rewards: 61.825, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.474', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.066', 'AMMO4': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon4': '0.254', 'weapon2': '0.460', 'WEAPON3': '1.150', 'weapon3': '3.028', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '53.000'} [2023-02-25 14:34:31,691][36155] DAMAGECOUNT value on done: 1170709.0 [2023-02-25 14:34:31,692][36155] Sum rewards: 52.286, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.150', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.163', 'weapon4': '0.264', 'weapon2': '0.586', 'WEAPON3': '1.050', 'HITCOUNT': '2.680', 'weapon3': '2.866', 'DAMAGECOUNT': '12.612', 'FRAGCOUNT': '44.000'} [2023-02-25 14:34:32,487][36139] DAMAGECOUNT value on done: 1167393.0 [2023-02-25 14:34:32,487][36139] Sum rewards: 49.379, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.672', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.043', 'AMMO3': '0.131', 'AMMO4': '0.213', 'weapon5': '0.274', 'weapon2': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.460', 'WEAPON4': '0.500', 'WEAPON3': '0.800', 'weapon3': '2.576', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.501', 'FRAGCOUNT': '42.000'} [2023-02-25 14:34:32,603][36155] DAMAGECOUNT value on done: 1186270.0 [2023-02-25 14:34:32,604][36155] Sum rewards: 54.439, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.186', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.081', 'AMMO3': '0.197', 'weapon2': '0.224', 'WEAPON5': '0.250', 'weapon5': '0.288', 'WEAPON4': '0.300', 'weapon4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.680', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.997', 'FRAGCOUNT': '46.000'} [2023-02-25 14:34:32,710][36157] DAMAGECOUNT value on done: 1179136.0 [2023-02-25 14:34:32,710][36157] Sum rewards: 61.166, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.785', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.020', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.187', 'weapon2': '0.302', 'WEAPON3': '1.150', 'HITCOUNT': '3.370', 'weapon3': '3.406', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '50.000'} [2023-02-25 14:34:32,805][36139] DAMAGECOUNT value on done: 1166618.0 [2023-02-25 14:34:32,805][36139] Sum rewards: 64.799, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.312', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.176', 'weapon5': '0.202', 'AMMO3': '0.209', 'weapon2': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.832', 'WEAPON3': '1.200', 'weapon3': '2.410', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.383', 'FRAGCOUNT': '57.000'} [2023-02-25 14:34:32,905][36155] DAMAGECOUNT value on done: 1165741.0 [2023-02-25 14:34:32,905][36155] Sum rewards: 64.267, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.629', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'weapon5': '0.224', 'WEAPON5': '0.250', 'weapon2': '0.304', 'weapon4': '0.356', 'WEAPON3': '1.200', 'weapon3': '2.906', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.858', 'FRAGCOUNT': '53.000'} [2023-02-25 14:34:33,009][36157] DAMAGECOUNT value on done: 1168980.0 [2023-02-25 14:34:33,010][36157] Sum rewards: 52.246, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.590', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.035', 'weapon5': '0.050', 'weapon7': '0.086', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.174', 'AMMO4': '0.176', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.494', 'weapon4': '0.534', 'WEAPON3': '1.050', 'weapon3': '2.574', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.816', 'FRAGCOUNT': '45.000'} [2023-02-25 14:34:33,156][36139] DAMAGECOUNT value on done: 1181210.0 [2023-02-25 14:34:33,157][36139] Sum rewards: 64.369, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.760', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon2': '0.172', 'AMMO3': '0.259', 'weapon5': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon4': '0.490', 'WEAPON3': '1.500', 'weapon3': '2.756', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '58.000'} [2023-02-25 14:34:33,275][36157] DAMAGECOUNT value on done: 1181133.0 [2023-02-25 14:34:33,276][36157] Sum rewards: 68.060, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.062', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.067', 'weapon5': '0.192', 'AMMO3': '0.209', 'weapon2': '0.240', 'weapon4': '0.310', 'AMMO4': '0.335', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.980', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '18.846', 'FRAGCOUNT': '59.000'} [2023-02-25 14:34:33,469][36139] DAMAGECOUNT value on done: 1175139.0 [2023-02-25 14:34:33,469][36139] Sum rewards: 51.392, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.640', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.012', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon4': '0.368', 'weapon2': '0.422', 'WEAPON3': '1.100', 'weapon3': '2.916', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.608', 'FRAGCOUNT': '45.000'} [2023-02-25 14:34:33,573][36157] DAMAGECOUNT value on done: 1174893.0 [2023-02-25 14:34:33,574][36157] Sum rewards: 54.454, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.302', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon4': '0.484', 'weapon2': '0.498', 'WEAPON3': '1.150', 'weapon3': '2.706', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.259', 'FRAGCOUNT': '46.000'} [2023-02-25 14:34:33,670][36138] Updated weights for policy 0, policy_version 52913 (0.0009) [2023-02-25 14:34:33,962][36140] DAMAGECOUNT value on done: 1172453.0 [2023-02-25 14:34:33,962][36140] Sum rewards: 70.058, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.585', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.048', 'weapon5': '0.108', 'AMMO4': '0.132', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.378', 'WEAPON3': '1.100', 'weapon3': '3.208', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.573', 'FRAGCOUNT': '57.000'} [2023-02-25 14:34:34,108][36140] DAMAGECOUNT value on done: 1176585.0 [2023-02-25 14:34:34,109][36140] Sum rewards: 57.369, reward structure: {'DEATHCOUNT': '-15.000', 'ARMOR': '0.004', 'AMMO2': '0.011', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'HEALTH': '0.116', 'AMMO3': '0.222', 'weapon4': '0.248', 'weapon2': '0.534', 'WEAPON3': '1.250', 'weapon3': '3.016', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.451', 'FRAGCOUNT': '49.000'} [2023-02-25 14:34:34,288][36140] DAMAGECOUNT value on done: 1163577.0 [2023-02-25 14:34:34,288][36140] Sum rewards: 56.094, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.525', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon4': '0.120', 'AMMO4': '0.172', 'AMMO3': '0.186', 'weapon5': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.714', 'WEAPON3': '1.150', 'weapon3': '2.580', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.027', 'FRAGCOUNT': '48.000'} [2023-02-25 14:34:34,435][36140] DAMAGECOUNT value on done: 1163751.0 [2023-02-25 14:34:34,436][36140] Sum rewards: 65.074, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.932', 'AMMO2': '0.009', 'AMMO5': '0.012', 'weapon4': '0.040', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'weapon5': '0.100', 'AMMO3': '0.181', 'WEAPON5': '0.300', 'weapon2': '0.590', 'WEAPON3': '1.100', 'weapon3': '2.942', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.447', 'FRAGCOUNT': '54.000'} [2023-02-25 14:34:34,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.2, 300 sec: 13398.8). Total num frames: 216743936. Throughput: 0: 3351.2. Samples: 16683928. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:34:34,730][36114] Avg episode reward: [(0, '55.863')] [2023-02-25 14:34:36,449][36142] DAMAGECOUNT value on done: 1170477.0 [2023-02-25 14:34:36,450][36142] Sum rewards: 55.474, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.250', 'AMMO5': '0.003', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.241', 'weapon4': '0.310', 'weapon2': '0.328', 'WEAPON3': '1.450', 'weapon3': '3.060', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.619', 'FRAGCOUNT': '49.000'} [2023-02-25 14:34:36,707][36138] Updated weights for policy 0, policy_version 52923 (0.0009) [2023-02-25 14:34:36,770][36142] DAMAGECOUNT value on done: 1160966.0 [2023-02-25 14:34:36,771][36142] Sum rewards: 57.678, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.052', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon5': '0.100', 'AMMO4': '0.140', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.586', 'WEAPON3': '1.250', 'weapon3': '2.784', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '50.000'} [2023-02-25 14:34:37,256][36142] DAMAGECOUNT value on done: 1172591.0 [2023-02-25 14:34:37,256][36142] Sum rewards: 51.317, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.438', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'weapon4': '0.330', 'weapon2': '0.530', 'WEAPON3': '1.050', 'weapon3': '2.834', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.100', 'FRAGCOUNT': '42.000'} [2023-02-25 14:34:37,574][36142] DAMAGECOUNT value on done: 1180254.0 [2023-02-25 14:34:37,575][36142] Sum rewards: 49.802, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.923', 'AMMO5': '0.018', 'AMMO2': '0.054', 'AMMO3': '0.179', 'weapon5': '0.242', 'AMMO4': '0.269', 'weapon2': '0.466', 'weapon4': '0.468', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.418', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.740', 'FRAGCOUNT': '44.000'} [2023-02-25 14:34:38,260][36156] DAMAGECOUNT value on done: 1184758.0 [2023-02-25 14:34:38,260][36156] Sum rewards: 56.949, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.014', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon4': '0.116', 'weapon5': '0.226', 'AMMO4': '0.258', 'AMMO3': '0.268', 'weapon2': '0.340', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.974', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '54.000'} [2023-02-25 14:34:38,574][36156] DAMAGECOUNT value on done: 1166635.0 [2023-02-25 14:34:38,574][36156] Sum rewards: 61.331, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.056', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'weapon4': '0.178', 'WEAPON4': '0.200', 'AMMO3': '0.247', 'weapon2': '0.248', 'WEAPON3': '1.450', 'weapon3': '3.266', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '55.000'} [2023-02-25 14:34:38,588][36156] DAMAGECOUNT value on done: 1176958.0 [2023-02-25 14:34:38,588][36156] Sum rewards: 50.534, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.687', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.106', 'AMMO4': '0.176', 'AMMO3': '0.225', 'weapon2': '0.232', 'weapon5': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.930', 'weapon3': '3.112', 'DAMAGECOUNT': '14.085', 'FRAGCOUNT': '45.000'} [2023-02-25 14:34:38,908][36156] DAMAGECOUNT value on done: 1164875.0 [2023-02-25 14:34:38,908][36156] Sum rewards: 67.028, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.040', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.160', 'AMMO3': '0.203', 'weapon5': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.296', 'weapon4': '0.430', 'WEAPON3': '1.250', 'weapon3': '2.748', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '57.000'} [2023-02-25 14:34:39,729][36114] Fps is (10 sec: 13107.0, 60 sec: 13380.2, 300 sec: 13384.9). Total num frames: 216809472. Throughput: 0: 3349.5. Samples: 16693996. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:34:39,730][36114] Avg episode reward: [(0, '55.948')] [2023-02-25 14:34:39,778][36138] Updated weights for policy 0, policy_version 52933 (0.0009) [2023-02-25 14:34:42,843][36138] Updated weights for policy 0, policy_version 52943 (0.0009) [2023-02-25 14:34:44,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13398.8). Total num frames: 216879104. Throughput: 0: 3346.4. Samples: 16714080. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:34:44,730][36114] Avg episode reward: [(0, '55.948')] [2023-02-25 14:34:45,937][36138] Updated weights for policy 0, policy_version 52953 (0.0009) [2023-02-25 14:34:48,982][36138] Updated weights for policy 0, policy_version 52963 (0.0009) [2023-02-25 14:34:49,303][36154] DAMAGECOUNT value on done: 1184284.0 [2023-02-25 14:34:49,304][36154] Sum rewards: 47.373, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.894', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon5': '0.126', 'AMMO3': '0.137', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.368', 'WEAPON3': '0.850', 'weapon2': '1.030', 'weapon3': '2.342', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '12.357', 'FRAGCOUNT': '38.500'} [2023-02-25 14:34:49,474][36141] DAMAGECOUNT value on done: 1181479.0 [2023-02-25 14:34:49,475][36141] Sum rewards: 52.975, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.032', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.055', 'AMMO3': '0.121', 'weapon5': '0.230', 'WEAPON5': '0.250', 'AMMO4': '0.274', 'weapon2': '0.304', 'WEAPON4': '0.500', 'WEAPON3': '0.650', 'weapon4': '0.924', 'weapon3': '2.296', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.404', 'FRAGCOUNT': '43.000'} [2023-02-25 14:34:49,615][36154] DAMAGECOUNT value on done: 1162204.0 [2023-02-25 14:34:49,616][36154] Sum rewards: 59.709, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.942', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.050', 'WEAPON5': '0.150', 'weapon5': '0.180', 'AMMO3': '0.203', 'weapon2': '0.220', 'AMMO4': '0.249', 'WEAPON4': '0.300', 'weapon4': '1.008', 'WEAPON3': '1.250', 'weapon3': '2.196', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.363', 'FRAGCOUNT': '50.000'} [2023-02-25 14:34:49,691][36141] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:34:49,729][36114] Fps is (10 sec: 13517.1, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 216944640. Throughput: 0: 3344.0. Samples: 16734104. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:34:49,730][36114] Avg episode reward: [(0, '55.923')] [2023-02-25 14:34:49,789][36141] DAMAGECOUNT value on done: 1170555.0 [2023-02-25 14:34:49,789][36141] Sum rewards: 58.096, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.000', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.052', 'AMMO4': '0.154', 'AMMO3': '0.164', 'weapon4': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.378', 'WEAPON3': '1.150', 'HITCOUNT': '3.020', 'weapon3': '3.198', 'DAMAGECOUNT': '14.442', 'FRAGCOUNT': '48.000'} [2023-02-25 14:34:49,799][36141] DAMAGECOUNT value on done: 1180197.0 [2023-02-25 14:34:49,799][36141] Sum rewards: 51.211, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.920', 'AMMO5': '0.016', 'AMMO2': '0.046', 'AMMO3': '0.157', 'weapon5': '0.220', 'AMMO4': '0.229', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.442', 'weapon4': '0.600', 'WEAPON3': '0.950', 'weapon3': '2.486', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '13.374', 'FRAGCOUNT': '44.000'} [2023-02-25 14:34:49,815][36154] DAMAGECOUNT value on done: 1183192.0 [2023-02-25 14:34:49,815][36154] Sum rewards: 59.277, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.600', 'AMMO5': '0.006', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.074', 'weapon4': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon2': '0.548', 'WEAPON3': '1.450', 'weapon3': '2.972', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '52.000'} [2023-02-25 14:34:50,109][36141] DAMAGECOUNT value on done: 1164680.0 [2023-02-25 14:34:50,110][36141] Sum rewards: 68.839, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.632', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon5': '0.142', 'weapon4': '0.152', 'AMMO3': '0.186', 'weapon2': '0.212', 'AMMO4': '0.242', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.246', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.162', 'FRAGCOUNT': '59.000'} [2023-02-25 14:34:50,127][36154] DAMAGECOUNT value on done: 1173067.0 [2023-02-25 14:34:50,127][36154] Sum rewards: 62.948, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.000', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.096', 'AMMO4': '0.168', 'AMMO3': '0.224', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.314', 'weapon2': '0.338', 'WEAPON3': '1.250', 'weapon3': '2.962', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '54.000'} [2023-02-25 14:34:51,516][36155] DAMAGECOUNT value on done: 1171008.0 [2023-02-25 14:34:51,517][36155] Sum rewards: 66.485, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.738', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO3': '0.176', 'weapon5': '0.190', 'AMMO4': '0.224', 'weapon2': '0.344', 'weapon4': '0.418', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'weapon3': '2.754', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '56.000'} [2023-02-25 14:34:51,830][36155] DAMAGECOUNT value on done: 1174808.0 [2023-02-25 14:34:51,831][36155] Sum rewards: 51.497, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.746', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.066', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.790', 'WEAPON3': '1.150', 'HITCOUNT': '2.410', 'weapon3': '2.986', 'DAMAGECOUNT': '12.297', 'FRAGCOUNT': '44.000'} [2023-02-25 14:34:52,046][36138] Updated weights for policy 0, policy_version 52973 (0.0009) [2023-02-25 14:34:52,564][36139] DAMAGECOUNT value on done: 1171802.0 [2023-02-25 14:34:52,565][36139] Sum rewards: 51.391, reward structure: {'DEATHCOUNT': '-15.750', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.104', 'AMMO3': '0.202', 'weapon2': '0.210', 'AMMO4': '0.226', 'HEALTH': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.466', 'WEAPON3': '1.050', 'HITCOUNT': '2.730', 'weapon3': '2.970', 'DAMAGECOUNT': '13.227', 'FRAGCOUNT': '45.000'} [2023-02-25 14:34:52,719][36155] DAMAGECOUNT value on done: 1191268.0 [2023-02-25 14:34:52,719][36155] Sum rewards: 66.999, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.520', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'weapon4': '0.254', 'weapon2': '0.524', 'WEAPON3': '1.100', 'weapon3': '3.028', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '56.000'} [2023-02-25 14:34:52,885][36139] DAMAGECOUNT value on done: 1171273.0 [2023-02-25 14:34:52,885][36139] Sum rewards: 54.036, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.828', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.082', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'weapon4': '0.314', 'weapon2': '0.464', 'WEAPON3': '1.350', 'weapon3': '2.952', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.965', 'FRAGCOUNT': '48.000'} [2023-02-25 14:34:52,907][36157] DAMAGECOUNT value on done: 1183583.0 [2023-02-25 14:34:52,907][36157] Sum rewards: 53.632, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.802', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.066', 'AMMO3': '0.110', 'weapon5': '0.274', 'AMMO4': '0.328', 'WEAPON5': '0.450', 'weapon2': '0.488', 'WEAPON4': '0.600', 'WEAPON3': '0.700', 'weapon4': '0.714', 'weapon3': '2.272', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.341', 'FRAGCOUNT': '46.000'} [2023-02-25 14:34:53,012][36155] DAMAGECOUNT value on done: 1170586.0 [2023-02-25 14:34:53,012][36155] Sum rewards: 58.561, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.173', 'AMMO5': '0.012', 'AMMO2': '0.048', 'AMMO3': '0.139', 'AMMO4': '0.241', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon5': '0.360', 'weapon2': '0.408', 'weapon4': '0.710', 'WEAPON3': '0.800', 'weapon3': '2.090', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.535', 'FRAGCOUNT': '47.000'} [2023-02-25 14:34:53,218][36157] DAMAGECOUNT value on done: 1174255.0 [2023-02-25 14:34:53,218][36157] Sum rewards: 60.967, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.538', 'weapon5': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.234', 'AMMO3': '0.265', 'weapon2': '0.288', 'WEAPON3': '1.550', 'weapon3': '3.272', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.825', 'FRAGCOUNT': '54.000'} [2023-02-25 14:34:53,219][36139] DAMAGECOUNT value on done: 1185819.0 [2023-02-25 14:34:53,219][36139] Sum rewards: 56.107, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.367', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.028', 'AMMO3': '0.089', 'AMMO4': '0.141', 'weapon5': '0.230', 'weapon4': '0.390', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.562', 'WEAPON3': '0.600', 'weapon3': '2.616', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.827', 'FRAGCOUNT': '45.000'} [2023-02-25 14:34:53,440][36157] DAMAGECOUNT value on done: 1186962.0 [2023-02-25 14:34:53,440][36157] Sum rewards: 64.953, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.240', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.154', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.230', 'weapon2': '0.276', 'WEAPON3': '1.250', 'weapon3': '3.074', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '54.000'} [2023-02-25 14:34:53,515][36139] DAMAGECOUNT value on done: 1180458.0 [2023-02-25 14:34:53,516][36139] Sum rewards: 55.894, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.280', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.043', 'AMMO3': '0.160', 'weapon5': '0.212', 'AMMO4': '0.216', 'weapon2': '0.374', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.558', 'WEAPON3': '0.950', 'weapon3': '2.638', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.957', 'FRAGCOUNT': '47.000'} [2023-02-25 14:34:53,741][36157] DAMAGECOUNT value on done: 1180148.0 [2023-02-25 14:34:53,742][36157] Sum rewards: 50.805, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.612', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.043', 'AMMO3': '0.170', 'AMMO4': '0.214', 'weapon5': '0.338', 'weapon2': '0.354', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'weapon4': '0.796', 'WEAPON3': '1.100', 'weapon3': '2.148', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.765', 'FRAGCOUNT': '45.000'} [2023-02-25 14:34:54,054][36140] DAMAGECOUNT value on done: 1178044.0 [2023-02-25 14:34:54,055][36140] Sum rewards: 67.393, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.930', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.054', 'AMMO3': '0.150', 'AMMO4': '0.271', 'weapon2': '0.274', 'weapon5': '0.324', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.660', 'WEAPON3': '1.000', 'weapon3': '2.426', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '57.000'} [2023-02-25 14:34:54,179][36140] DAMAGECOUNT value on done: 1180841.0 [2023-02-25 14:34:54,180][36140] Sum rewards: 48.819, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.415', 'ARMOR': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon5': '0.096', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'weapon4': '0.516', 'weapon2': '0.528', 'WEAPON3': '0.850', 'HITCOUNT': '2.500', 'weapon3': '2.550', 'DAMAGECOUNT': '12.768', 'FRAGCOUNT': '40.000'} [2023-02-25 14:34:54,367][36140] DAMAGECOUNT value on done: 1169046.0 [2023-02-25 14:34:54,368][36140] Sum rewards: 67.930, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'weapon4': '0.268', 'weapon2': '0.490', 'WEAPON3': '0.850', 'HEALTH': '0.880', 'weapon3': '2.902', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '54.000'} [2023-02-25 14:34:54,504][36140] DAMAGECOUNT value on done: 1168916.0 [2023-02-25 14:34:54,504][36140] Sum rewards: 69.333, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.360', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.136', 'weapon5': '0.158', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.390', 'weapon2': '0.696', 'WEAPON3': '0.900', 'weapon3': '2.564', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '58.000'} [2023-02-25 14:34:54,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 217010176. Throughput: 0: 3339.2. Samples: 16744040. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:34:54,730][36114] Avg episode reward: [(0, '56.961')] [2023-02-25 14:34:55,131][36138] Updated weights for policy 0, policy_version 52983 (0.0009) [2023-02-25 14:34:56,508][36142] DAMAGECOUNT value on done: 1175729.0 [2023-02-25 14:34:56,509][36142] Sum rewards: 60.036, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.414', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.077', 'weapon2': '0.180', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon4': '0.626', 'WEAPON3': '1.150', 'weapon3': '2.880', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '50.000'} [2023-02-25 14:34:56,833][36142] DAMAGECOUNT value on done: 1165643.0 [2023-02-25 14:34:56,833][36142] Sum rewards: 57.568, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.554', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.136', 'weapon2': '0.170', 'AMMO4': '0.212', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.728', 'WEAPON3': '1.350', 'weapon3': '2.758', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.031', 'FRAGCOUNT': '52.000'} [2023-02-25 14:34:57,436][36142] DAMAGECOUNT value on done: 1176798.0 [2023-02-25 14:34:57,437][36142] Sum rewards: 46.898, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.787', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.094', 'AMMO4': '0.202', 'weapon5': '0.222', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.600', 'WEAPON3': '1.300', 'HITCOUNT': '2.740', 'weapon3': '2.812', 'DAMAGECOUNT': '12.591', 'FRAGCOUNT': '43.000'} [2023-02-25 14:34:57,744][36142] DAMAGECOUNT value on done: 1185507.0 [2023-02-25 14:34:57,744][36142] Sum rewards: 62.792, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.980', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.073', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon4': '0.322', 'weapon2': '0.676', 'WEAPON3': '1.300', 'weapon3': '2.756', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '55.000'} [2023-02-25 14:34:58,051][36154] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:34:58,213][36138] Updated weights for policy 0, policy_version 52993 (0.0009) [2023-02-25 14:34:58,525][36156] DAMAGECOUNT value on done: 1188794.0 [2023-02-25 14:34:58,526][36156] Sum rewards: 41.897, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.050', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.271', 'ARMOR': '0.400', 'weapon4': '0.420', 'weapon2': '0.534', 'WEAPON3': '1.550', 'HITCOUNT': '2.720', 'weapon3': '2.794', 'DAMAGECOUNT': '11.943', 'FRAGCOUNT': '41.000'} [2023-02-25 14:34:58,839][36156] DAMAGECOUNT value on done: 1171149.0 [2023-02-25 14:34:58,840][36156] Sum rewards: 45.004, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.828', 'WEAPON1': '0.010', 'ARMOR': '0.016', 'AMMO5': '0.032', 'AMMO2': '0.072', 'AMMO3': '0.208', 'weapon5': '0.286', 'AMMO4': '0.358', 'weapon2': '0.606', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'weapon4': '0.680', 'WEAPON3': '1.150', 'weapon3': '1.972', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '13.542', 'FRAGCOUNT': '42.000'} [2023-02-25 14:34:58,852][36156] DAMAGECOUNT value on done: 1182030.0 [2023-02-25 14:34:58,852][36156] Sum rewards: 60.507, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.148', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.042', 'AMMO3': '0.165', 'AMMO4': '0.208', 'weapon2': '0.260', 'weapon5': '0.384', 'weapon4': '0.386', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.694', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.901', 'FRAGCOUNT': '52.000'} [2023-02-25 14:34:59,172][36156] DAMAGECOUNT value on done: 1169872.0 [2023-02-25 14:34:59,173][36156] Sum rewards: 59.440, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.022', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.098', 'AMMO4': '0.181', 'AMMO3': '0.189', 'weapon2': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon4': '0.670', 'WEAPON3': '1.150', 'weapon3': '2.752', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '14.991', 'FRAGCOUNT': '52.000'} [2023-02-25 14:34:59,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13312.0, 300 sec: 13384.9). Total num frames: 217075712. Throughput: 0: 3336.5. Samples: 16764120. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:34:59,730][36114] Avg episode reward: [(0, '57.072')] [2023-02-25 14:35:01,239][36138] Updated weights for policy 0, policy_version 53003 (0.0009) [2023-02-25 14:35:04,313][36138] Updated weights for policy 0, policy_version 53013 (0.0009) [2023-02-25 14:35:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 217145344. Throughput: 0: 3338.6. Samples: 16784160. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:35:04,730][36114] Avg episode reward: [(0, '57.072')] [2023-02-25 14:35:06,097][36142] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:35:07,386][36138] Updated weights for policy 0, policy_version 53023 (0.0009) [2023-02-25 14:35:09,373][36154] DAMAGECOUNT value on done: 1189662.0 [2023-02-25 14:35:09,373][36154] Sum rewards: 63.806, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.625', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon4': '0.154', 'weapon2': '0.166', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon5': '0.230', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.020', 'weapon3': '3.162', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '55.000'} [2023-02-25 14:35:09,666][36141] DAMAGECOUNT value on done: 1187366.0 [2023-02-25 14:35:09,666][36141] Sum rewards: 66.550, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.960', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.056', 'weapon5': '0.178', 'AMMO3': '0.185', 'weapon2': '0.248', 'AMMO4': '0.278', 'weapon4': '0.418', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.842', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.661', 'FRAGCOUNT': '56.000'} [2023-02-25 14:35:09,671][36154] DAMAGECOUNT value on done: 1166857.0 [2023-02-25 14:35:09,671][36154] Sum rewards: 54.023, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.113', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.081', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon5': '0.240', 'WEAPON5': '0.250', 'weapon2': '0.254', 'weapon4': '0.430', 'WEAPON3': '1.150', 'HITCOUNT': '2.790', 'weapon3': '2.798', 'DAMAGECOUNT': '13.959', 'FRAGCOUNT': '47.000'} [2023-02-25 14:35:09,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13312.0, 300 sec: 13398.8). Total num frames: 217210880. Throughput: 0: 3343.3. Samples: 16794288. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:35:09,729][36114] Avg episode reward: [(0, '57.350')] [2023-02-25 14:35:09,911][36154] DAMAGECOUNT value on done: 1189198.0 [2023-02-25 14:35:09,912][36154] Sum rewards: 68.315, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.255', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.156', 'AMMO3': '0.218', 'AMMO4': '0.222', 'weapon2': '0.294', 'weapon4': '0.380', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.896', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '61.000'} [2023-02-25 14:35:09,960][36141] DAMAGECOUNT value on done: 1175344.0 [2023-02-25 14:35:09,960][36141] Sum rewards: 52.526, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.493', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.064', 'AMMO4': '0.110', 'weapon5': '0.140', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.692', 'WEAPON3': '1.150', 'HITCOUNT': '2.760', 'weapon3': '2.872', 'DAMAGECOUNT': '14.367', 'FRAGCOUNT': '44.000'} [2023-02-25 14:35:09,969][36141] DAMAGECOUNT value on done: 1185025.0 [2023-02-25 14:35:09,970][36141] Sum rewards: 54.395, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.676', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.108', 'AMMO4': '0.140', 'weapon2': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'weapon4': '0.302', 'WEAPON3': '1.250', 'HITCOUNT': '2.890', 'weapon3': '3.198', 'DAMAGECOUNT': '14.484', 'FRAGCOUNT': '47.000'} [2023-02-25 14:35:10,225][36154] DAMAGECOUNT value on done: 1177836.0 [2023-02-25 14:35:10,226][36154] Sum rewards: 52.043, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.042', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.186', 'AMMO4': '0.190', 'AMMO3': '0.205', 'WEAPON5': '0.300', 'weapon4': '0.336', 'weapon2': '0.364', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.806', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.037', 'FRAGCOUNT': '46.000'} [2023-02-25 14:35:10,268][36141] DAMAGECOUNT value on done: 1169021.0 [2023-02-25 14:35:10,268][36141] Sum rewards: 52.206, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.658', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.109', 'AMMO3': '0.152', 'weapon2': '0.176', 'weapon5': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.686', 'WEAPON3': '0.950', 'weapon3': '2.300', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.023', 'FRAGCOUNT': '44.000'} [2023-02-25 14:35:10,431][36138] Updated weights for policy 0, policy_version 53033 (0.0009) [2023-02-25 14:35:11,612][36155] DAMAGECOUNT value on done: 1175387.0 [2023-02-25 14:35:11,612][36155] Sum rewards: 52.155, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.135', 'AMMO5': '0.014', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.165', 'weapon5': '0.190', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.384', 'weapon2': '0.534', 'WEAPON3': '1.050', 'weapon3': '2.702', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.137', 'FRAGCOUNT': '47.000'} [2023-02-25 14:35:11,921][36155] DAMAGECOUNT value on done: 1179493.0 [2023-02-25 14:35:11,921][36155] Sum rewards: 55.035, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.874', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.160', 'AMMO4': '0.173', 'AMMO3': '0.175', 'weapon4': '0.284', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.414', 'WEAPON3': '1.000', 'weapon3': '2.892', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.055', 'FRAGCOUNT': '48.000'} [2023-02-25 14:35:12,567][36139] DAMAGECOUNT value on done: 1176981.0 [2023-02-25 14:35:12,567][36139] Sum rewards: 57.072, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.780', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.034', 'weapon5': '0.100', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.488', 'WEAPON3': '1.450', 'weapon3': '3.150', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '50.000'} [2023-02-25 14:35:12,832][36155] DAMAGECOUNT value on done: 1195745.0 [2023-02-25 14:35:12,833][36155] Sum rewards: 47.446, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.715', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon7': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.102', 'AMMO4': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'WEAPON4': '0.350', 'weapon2': '0.354', 'weapon4': '0.874', 'WEAPON3': '1.250', 'weapon3': '2.224', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '13.425', 'FRAGCOUNT': '43.000'} [2023-02-25 14:35:12,888][36139] DAMAGECOUNT value on done: 1176976.0 [2023-02-25 14:35:12,888][36139] Sum rewards: 71.919, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.759', 'ARMOR': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'AMMO3': '0.141', 'weapon5': '0.142', 'AMMO4': '0.155', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.352', 'weapon2': '0.416', 'WEAPON3': '0.950', 'weapon3': '2.774', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '58.000'} [2023-02-25 14:35:12,957][36157] DAMAGECOUNT value on done: 1188353.0 [2023-02-25 14:35:12,958][36157] Sum rewards: 52.438, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.013', 'AMMO2': '0.038', 'AMMO3': '0.141', 'weapon5': '0.142', 'AMMO4': '0.192', 'HEALTH': '0.214', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.362', 'weapon2': '0.450', 'WEAPON3': '0.750', 'HITCOUNT': '2.620', 'weapon3': '2.840', 'DAMAGECOUNT': '13.776', 'FRAGCOUNT': '43.000'} [2023-02-25 14:35:13,131][36155] DAMAGECOUNT value on done: 1175568.0 [2023-02-25 14:35:13,132][36155] Sum rewards: 55.845, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.288', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'AMMO3': '0.207', 'weapon2': '0.284', 'WEAPON4': '0.300', 'weapon4': '0.364', 'WEAPON3': '1.250', 'weapon3': '2.974', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.682', 'FRAGCOUNT': '50.000'} [2023-02-25 14:35:13,194][36139] DAMAGECOUNT value on done: 1191058.0 [2023-02-25 14:35:13,195][36139] Sum rewards: 59.169, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.422', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.040', 'AMMO4': '0.202', 'AMMO3': '0.216', 'weapon5': '0.246', 'weapon2': '0.336', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.518', 'WEAPON3': '1.150', 'weapon3': '2.580', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '52.000'} [2023-02-25 14:35:13,268][36157] DAMAGECOUNT value on done: 1177813.0 [2023-02-25 14:35:13,269][36157] Sum rewards: 37.915, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.222', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.029', 'AMMO3': '0.142', 'AMMO4': '0.147', 'weapon5': '0.258', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.582', 'weapon2': '0.714', 'WEAPON3': '0.800', 'weapon3': '1.858', 'HITCOUNT': '2.210', 'DAMAGECOUNT': '10.674', 'FRAGCOUNT': '35.000'} [2023-02-25 14:35:13,469][36157] DAMAGECOUNT value on done: 1191300.0 [2023-02-25 14:35:13,469][36157] Sum rewards: 51.092, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.632', 'AMMO5': '0.012', 'AMMO2': '0.060', 'AMMO3': '0.153', 'weapon5': '0.228', 'AMMO4': '0.299', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'weapon4': '0.646', 'weapon2': '0.750', 'WEAPON3': '1.000', 'weapon3': '1.952', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.014', 'FRAGCOUNT': '45.000'} [2023-02-25 14:35:13,470][36138] Updated weights for policy 0, policy_version 53043 (0.0010) [2023-02-25 14:35:13,512][36139] DAMAGECOUNT value on done: 1185384.0 [2023-02-25 14:35:13,512][36139] Sum rewards: 58.822, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.015', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'weapon2': '0.284', 'weapon4': '0.336', 'WEAPON3': '1.200', 'weapon3': '3.004', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.778', 'FRAGCOUNT': '50.000'} [2023-02-25 14:35:13,760][36157] DAMAGECOUNT value on done: 1185369.0 [2023-02-25 14:35:13,761][36157] Sum rewards: 53.334, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.364', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'weapon4': '0.104', 'WEAPON5': '0.150', 'weapon5': '0.178', 'weapon2': '0.244', 'AMMO3': '0.327', 'WEAPON3': '1.950', 'HITCOUNT': '3.160', 'weapon3': '3.188', 'DAMAGECOUNT': '15.663', 'FRAGCOUNT': '51.000'} [2023-02-25 14:35:14,136][36140] DAMAGECOUNT value on done: 1182349.0 [2023-02-25 14:35:14,137][36140] Sum rewards: 48.907, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.966', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.130', 'AMMO4': '0.152', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.406', 'weapon2': '0.488', 'WEAPON3': '1.250', 'HITCOUNT': '2.730', 'weapon3': '2.738', 'DAMAGECOUNT': '12.915', 'FRAGCOUNT': '44.000'} [2023-02-25 14:35:14,212][36140] DAMAGECOUNT value on done: 1185541.0 [2023-02-25 14:35:14,212][36140] Sum rewards: 52.739, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.520', 'AMMO5': '0.017', 'AMMO2': '0.058', 'AMMO3': '0.213', 'AMMO4': '0.290', 'weapon5': '0.324', 'weapon2': '0.364', 'weapon4': '0.438', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.444', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '14.100', 'FRAGCOUNT': '49.000'} [2023-02-25 14:35:14,458][36140] DAMAGECOUNT value on done: 1173436.0 [2023-02-25 14:35:14,459][36140] Sum rewards: 48.215, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.100', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.126', 'weapon2': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.810', 'weapon3': '3.018', 'DAMAGECOUNT': '13.170', 'FRAGCOUNT': '45.000'} [2023-02-25 14:35:14,531][36140] DAMAGECOUNT value on done: 1173595.0 [2023-02-25 14:35:14,531][36140] Sum rewards: 58.354, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.970', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.052', 'AMMO4': '0.073', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon2': '0.212', 'WEAPON4': '0.300', 'weapon4': '0.438', 'WEAPON3': '1.150', 'weapon3': '3.076', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.037', 'FRAGCOUNT': '50.000'} [2023-02-25 14:35:14,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13312.0, 300 sec: 13398.8). Total num frames: 217276416. Throughput: 0: 3343.4. Samples: 16814368. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:35:14,730][36114] Avg episode reward: [(0, '57.133')] [2023-02-25 14:35:16,584][36138] Updated weights for policy 0, policy_version 53053 (0.0009) [2023-02-25 14:35:16,724][36142] DAMAGECOUNT value on done: 1180569.0 [2023-02-25 14:35:16,725][36142] Sum rewards: 53.931, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.718', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.152', 'weapon5': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.550', 'weapon4': '0.720', 'WEAPON3': '0.950', 'weapon3': '2.194', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '45.000'} [2023-02-25 14:35:17,042][36142] DAMAGECOUNT value on done: 1170299.0 [2023-02-25 14:35:17,043][36142] Sum rewards: 53.434, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.280', 'AMMO5': '0.011', 'AMMO2': '0.031', 'AMMO4': '0.157', 'weapon5': '0.190', 'weapon2': '0.230', 'AMMO3': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.786', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.488', 'FRAGCOUNT': '51.000'} [2023-02-25 14:35:17,595][36142] DAMAGECOUNT value on done: 1182451.0 [2023-02-25 14:35:17,596][36142] Sum rewards: 64.427, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.770', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'weapon5': '0.114', 'WEAPON4': '0.200', 'weapon4': '0.228', 'weapon2': '0.264', 'AMMO3': '0.285', 'WEAPON3': '1.650', 'weapon3': '3.142', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '58.000'} [2023-02-25 14:35:17,908][36142] DAMAGECOUNT value on done: 1190509.0 [2023-02-25 14:35:17,908][36142] Sum rewards: 62.058, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.218', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.149', 'weapon5': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.342', 'weapon2': '0.480', 'WEAPON3': '0.900', 'weapon3': '2.746', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.006', 'FRAGCOUNT': '53.000'} [2023-02-25 14:35:18,656][36156] DAMAGECOUNT value on done: 1194326.0 [2023-02-25 14:35:18,657][36156] Sum rewards: 63.884, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.404', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon2': '0.176', 'AMMO3': '0.204', 'weapon5': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.368', 'WEAPON3': '1.350', 'weapon3': '2.986', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '56.000'} [2023-02-25 14:35:18,970][36156] DAMAGECOUNT value on done: 1175797.0 [2023-02-25 14:35:18,970][36156] Sum rewards: 50.794, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.383', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.038', 'AMMO3': '0.131', 'weapon5': '0.154', 'AMMO4': '0.189', 'weapon2': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.732', 'WEAPON3': '0.850', 'weapon3': '2.348', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '13.944', 'FRAGCOUNT': '41.500'} [2023-02-25 14:35:18,984][36156] DAMAGECOUNT value on done: 1186203.0 [2023-02-25 14:35:18,984][36156] Sum rewards: 43.272, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.208', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'AMMO3': '0.154', 'weapon5': '0.196', 'WEAPON5': '0.250', 'weapon2': '0.568', 'weapon4': '0.676', 'WEAPON3': '1.000', 'weapon3': '2.282', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.519', 'FRAGCOUNT': '34.500'} [2023-02-25 14:35:19,290][36156] DAMAGECOUNT value on done: 1173808.0 [2023-02-25 14:35:19,290][36156] Sum rewards: 44.093, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.122', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO4': '0.178', 'weapon5': '0.202', 'AMMO3': '0.233', 'WEAPON5': '0.350', 'weapon2': '0.364', 'WEAPON4': '0.400', 'weapon4': '0.534', 'WEAPON3': '1.350', 'weapon3': '2.576', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '11.808', 'FRAGCOUNT': '42.000'} [2023-02-25 14:35:19,655][36138] Updated weights for policy 0, policy_version 53063 (0.0009) [2023-02-25 14:35:19,729][36114] Fps is (10 sec: 13516.6, 60 sec: 13380.2, 300 sec: 13398.8). Total num frames: 217346048. Throughput: 0: 3340.4. Samples: 16834248. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:35:19,730][36114] Avg episode reward: [(0, '57.077')] [2023-02-25 14:35:19,733][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000053063_217346048.pth... [2023-02-25 14:35:19,787][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000052278_214130688.pth [2023-02-25 14:35:22,731][36138] Updated weights for policy 0, policy_version 53073 (0.0009) [2023-02-25 14:35:22,912][36140] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:35:24,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 217411584. Throughput: 0: 3340.7. Samples: 16844328. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:35:24,730][36114] Avg episode reward: [(0, '57.077')] [2023-02-25 14:35:25,810][36138] Updated weights for policy 0, policy_version 53083 (0.0010) [2023-02-25 14:35:28,905][36138] Updated weights for policy 0, policy_version 53093 (0.0009) [2023-02-25 14:35:29,544][36154] DAMAGECOUNT value on done: 1194416.0 [2023-02-25 14:35:29,545][36154] Sum rewards: 54.511, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.362', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO3': '0.154', 'weapon5': '0.184', 'AMMO4': '0.185', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.560', 'weapon4': '0.658', 'WEAPON3': '1.000', 'weapon3': '2.174', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.262', 'FRAGCOUNT': '48.000'} [2023-02-25 14:35:29,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13312.0, 300 sec: 13384.9). Total num frames: 217477120. Throughput: 0: 3336.0. Samples: 16864200. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:35:29,730][36114] Avg episode reward: [(0, '57.008')] [2023-02-25 14:35:29,750][36141] DAMAGECOUNT value on done: 1192550.0 [2023-02-25 14:35:29,751][36141] Sum rewards: 58.401, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.169', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO3': '0.183', 'AMMO4': '0.226', 'weapon2': '0.302', 'weapon5': '0.312', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.936', 'WEAPON3': '1.050', 'weapon3': '2.058', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.552', 'FRAGCOUNT': '50.000'} [2023-02-25 14:35:29,844][36142] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:35:29,863][36154] DAMAGECOUNT value on done: 1172062.0 [2023-02-25 14:35:29,864][36154] Sum rewards: 55.382, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.369', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO3': '0.163', 'AMMO4': '0.185', 'weapon5': '0.186', 'weapon4': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.404', 'WEAPON3': '1.100', 'weapon3': '2.958', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '45.000'} [2023-02-25 14:35:30,064][36141] DAMAGECOUNT value on done: 1180339.0 [2023-02-25 14:35:30,064][36141] Sum rewards: 58.999, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.864', 'AMMO5': '0.023', 'AMMO2': '0.055', 'weapon4': '0.132', 'weapon5': '0.200', 'weapon2': '0.210', 'AMMO3': '0.211', 'AMMO4': '0.274', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'HITCOUNT': '2.780', 'weapon3': '3.194', 'DAMAGECOUNT': '14.985', 'FRAGCOUNT': '53.000'} [2023-02-25 14:35:30,075][36141] DAMAGECOUNT value on done: 1189863.0 [2023-02-25 14:35:30,075][36141] Sum rewards: 61.066, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.483', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.045', 'AMMO3': '0.152', 'weapon5': '0.176', 'AMMO4': '0.227', 'weapon2': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.546', 'WEAPON3': '0.900', 'weapon3': '2.712', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.514', 'FRAGCOUNT': '52.000'} [2023-02-25 14:35:30,101][36154] DAMAGECOUNT value on done: 1193780.0 [2023-02-25 14:35:30,101][36154] Sum rewards: 53.688, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.244', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON5': '0.150', 'weapon5': '0.162', 'weapon2': '0.196', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon4': '0.764', 'WEAPON3': '1.400', 'weapon3': '2.658', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.746', 'FRAGCOUNT': '48.000'} [2023-02-25 14:35:30,381][36141] DAMAGECOUNT value on done: 1174202.0 [2023-02-25 14:35:30,381][36141] Sum rewards: 61.812, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.193', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.140', 'AMMO4': '0.157', 'weapon5': '0.182', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.348', 'WEAPON3': '1.150', 'weapon3': '3.064', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.543', 'FRAGCOUNT': '52.000'} [2023-02-25 14:35:30,412][36154] DAMAGECOUNT value on done: 1182047.0 [2023-02-25 14:35:30,412][36154] Sum rewards: 46.193, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.712', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.144', 'weapon4': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.270', 'WEAPON3': '1.200', 'HITCOUNT': '2.590', 'weapon3': '3.150', 'DAMAGECOUNT': '12.633', 'FRAGCOUNT': '41.000'} [2023-02-25 14:35:31,774][36155] DAMAGECOUNT value on done: 1180522.0 [2023-02-25 14:35:31,775][36155] Sum rewards: 61.689, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.987', 'AMMO5': '0.020', 'AMMO2': '0.046', 'AMMO3': '0.120', 'AMMO4': '0.231', 'weapon5': '0.232', 'weapon2': '0.308', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon4': '0.998', 'weapon3': '2.116', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '51.000'} [2023-02-25 14:35:31,981][36138] Updated weights for policy 0, policy_version 53103 (0.0009) [2023-02-25 14:35:32,081][36155] DAMAGECOUNT value on done: 1184375.0 [2023-02-25 14:35:32,082][36155] Sum rewards: 55.620, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.840', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.112', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.258', 'AMMO3': '0.270', 'weapon4': '0.358', 'WEAPON3': '1.500', 'weapon3': '3.002', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.646', 'FRAGCOUNT': '50.000'} [2023-02-25 14:35:32,706][36139] DAMAGECOUNT value on done: 1182662.0 [2023-02-25 14:35:32,706][36139] Sum rewards: 65.577, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.391', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'AMMO4': '0.157', 'AMMO3': '0.161', 'weapon5': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.286', 'weapon4': '0.474', 'WEAPON3': '1.050', 'weapon3': '2.482', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '54.000'} [2023-02-25 14:35:32,977][36155] DAMAGECOUNT value on done: 1200442.0 [2023-02-25 14:35:32,977][36155] Sum rewards: 50.789, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.988', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO4': '0.176', 'AMMO3': '0.199', 'weapon2': '0.242', 'weapon5': '0.298', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.972', 'WEAPON3': '1.100', 'weapon3': '2.158', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '13.761', 'FRAGCOUNT': '45.000'} [2023-02-25 14:35:33,010][36139] DAMAGECOUNT value on done: 1181742.0 [2023-02-25 14:35:33,011][36139] Sum rewards: 46.873, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.060', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.176', 'weapon2': '0.204', 'AMMO4': '0.235', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon4': '0.676', 'WEAPON3': '1.500', 'weapon3': '2.636', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.298', 'FRAGCOUNT': '45.000'} [2023-02-25 14:35:33,109][36157] DAMAGECOUNT value on done: 1193447.0 [2023-02-25 14:35:33,110][36157] Sum rewards: 59.483, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.970', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'weapon4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.241', 'weapon2': '0.316', 'WEAPON3': '1.450', 'weapon3': '3.222', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.282', 'FRAGCOUNT': '52.000'} [2023-02-25 14:35:33,282][36155] DAMAGECOUNT value on done: 1179753.0 [2023-02-25 14:35:33,283][36155] Sum rewards: 45.932, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.180', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.132', 'AMMO3': '0.161', 'AMMO4': '0.204', 'WEAPON5': '0.300', 'weapon4': '0.332', 'WEAPON4': '0.400', 'weapon2': '0.516', 'WEAPON3': '1.000', 'HITCOUNT': '2.490', 'weapon3': '2.712', 'DAMAGECOUNT': '12.555', 'FRAGCOUNT': '40.000'} [2023-02-25 14:35:33,306][36139] DAMAGECOUNT value on done: 1196054.0 [2023-02-25 14:35:33,307][36139] Sum rewards: 55.629, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.476', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.172', 'AMMO3': '0.174', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.378', 'WEAPON3': '1.150', 'weapon3': '2.974', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.988', 'FRAGCOUNT': '47.000'} [2023-02-25 14:35:33,418][36157] DAMAGECOUNT value on done: 1183510.0 [2023-02-25 14:35:33,419][36157] Sum rewards: 60.473, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.275', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon5': '0.068', 'weapon4': '0.116', 'AMMO4': '0.118', 'weapon2': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.294', 'WEAPON3': '1.700', 'weapon3': '3.348', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '54.000'} [2023-02-25 14:35:33,584][36157] DAMAGECOUNT value on done: 1196204.0 [2023-02-25 14:35:33,585][36157] Sum rewards: 50.143, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.796', 'AMMO5': '0.003', 'weapon5': '0.024', 'AMMO2': '0.029', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.145', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'weapon4': '0.332', 'weapon2': '0.668', 'WEAPON3': '1.200', 'weapon3': '2.772', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.712', 'FRAGCOUNT': '43.000'} [2023-02-25 14:35:33,619][36139] DAMAGECOUNT value on done: 1190746.0 [2023-02-25 14:35:33,619][36139] Sum rewards: 57.985, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.044', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.110', 'AMMO4': '0.148', 'weapon2': '0.156', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.338', 'WEAPON3': '1.300', 'weapon3': '3.074', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.993', 'FRAGCOUNT': '49.500'} [2023-02-25 14:35:33,881][36139] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:35:33,890][36157] DAMAGECOUNT value on done: 1190244.0 [2023-02-25 14:35:33,891][36157] Sum rewards: 52.269, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.307', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon7': '0.094', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'AMMO3': '0.230', 'weapon2': '0.326', 'weapon4': '0.326', 'WEAPON3': '1.300', 'HITCOUNT': '2.800', 'weapon3': '2.912', 'DAMAGECOUNT': '14.625', 'FRAGCOUNT': '45.000'} [2023-02-25 14:35:34,297][36140] DAMAGECOUNT value on done: 1190850.0 [2023-02-25 14:35:34,298][36140] Sum rewards: 54.380, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.320', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.011', 'weapon5': '0.044', 'AMMO4': '0.054', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon2': '0.240', 'AMMO3': '0.298', 'weapon4': '0.354', 'WEAPON3': '1.800', 'weapon3': '3.082', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.927', 'FRAGCOUNT': '51.000'} [2023-02-25 14:35:34,308][36140] DAMAGECOUNT value on done: 1187569.0 [2023-02-25 14:35:34,309][36140] Sum rewards: 55.802, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.907', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon4': '0.228', 'weapon2': '0.236', 'WEAPON3': '1.300', 'weapon3': '3.178', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '46.000'} [2023-02-25 14:35:34,619][36140] DAMAGECOUNT value on done: 1179192.0 [2023-02-25 14:35:34,619][36140] Sum rewards: 66.686, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.403', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.148', 'AMMO3': '0.184', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.328', 'weapon4': '0.544', 'WEAPON3': '1.200', 'weapon3': '2.710', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '57.000'} [2023-02-25 14:35:34,633][36140] DAMAGECOUNT value on done: 1179097.0 [2023-02-25 14:35:34,634][36140] Sum rewards: 62.299, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.020', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.056', 'AMMO3': '0.125', 'AMMO4': '0.279', 'weapon2': '0.346', 'weapon5': '0.350', 'weapon4': '0.444', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'weapon3': '2.534', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '51.000'} [2023-02-25 14:35:34,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 217546752. Throughput: 0: 3338.8. Samples: 16884352. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:35:34,730][36114] Avg episode reward: [(0, '56.500')] [2023-02-25 14:35:34,986][36138] Updated weights for policy 0, policy_version 53113 (0.0009) [2023-02-25 14:35:36,968][36142] DAMAGECOUNT value on done: 1185836.0 [2023-02-25 14:35:36,969][36142] Sum rewards: 56.170, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.815', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.090', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon2': '0.256', 'AMMO3': '0.277', 'WEAPON3': '1.700', 'weapon3': '3.340', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '52.000'} [2023-02-25 14:35:37,279][36142] DAMAGECOUNT value on done: 1174674.0 [2023-02-25 14:35:37,280][36142] Sum rewards: 52.067, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.396', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.058', 'AMMO3': '0.177', 'weapon5': '0.288', 'AMMO4': '0.291', 'weapon2': '0.346', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'weapon4': '0.954', 'WEAPON3': '1.100', 'weapon3': '1.970', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.125', 'FRAGCOUNT': '48.000'} [2023-02-25 14:35:37,864][36142] DAMAGECOUNT value on done: 1186850.0 [2023-02-25 14:35:37,864][36142] Sum rewards: 46.707, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.452', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.043', 'weapon2': '0.206', 'AMMO4': '0.214', 'AMMO3': '0.239', 'weapon5': '0.322', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.634', 'WEAPON3': '1.350', 'weapon3': '2.506', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '13.197', 'FRAGCOUNT': '44.000'} [2023-02-25 14:35:38,087][36138] Updated weights for policy 0, policy_version 53123 (0.0010) [2023-02-25 14:35:38,173][36142] DAMAGECOUNT value on done: 1196372.0 [2023-02-25 14:35:38,173][36142] Sum rewards: 67.656, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.124', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.192', 'AMMO3': '0.193', 'AMMO4': '0.214', 'weapon2': '0.314', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'ARMOR': '0.408', 'weapon4': '0.654', 'WEAPON3': '1.150', 'weapon3': '2.568', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '56.500'} [2023-02-25 14:35:38,818][36156] DAMAGECOUNT value on done: 1199010.0 [2023-02-25 14:35:38,819][36156] Sum rewards: 55.851, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.875', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO4': '0.168', 'weapon5': '0.190', 'AMMO3': '0.219', 'weapon4': '0.224', 'weapon2': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '2.960', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.052', 'FRAGCOUNT': '52.000'} [2023-02-25 14:35:38,898][36140] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-25 14:35:39,133][36156] DAMAGECOUNT value on done: 1180430.0 [2023-02-25 14:35:39,133][36156] Sum rewards: 55.278, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.391', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.055', 'weapon4': '0.110', 'weapon5': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.211', 'weapon2': '0.380', 'WEAPON3': '1.250', 'HITCOUNT': '2.810', 'weapon3': '3.012', 'DAMAGECOUNT': '13.869', 'FRAGCOUNT': '48.000'} [2023-02-25 14:35:39,145][36156] DAMAGECOUNT value on done: 1190926.0 [2023-02-25 14:35:39,146][36156] Sum rewards: 53.056, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.060', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.057', 'AMMO3': '0.150', 'weapon5': '0.220', 'AMMO4': '0.287', 'WEAPON5': '0.400', 'weapon2': '0.498', 'WEAPON4': '0.750', 'WEAPON3': '0.850', 'weapon4': '0.882', 'weapon3': '2.130', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.863', 'FRAGCOUNT': '47.000'} [2023-02-25 14:35:39,464][36156] DAMAGECOUNT value on done: 1179187.0 [2023-02-25 14:35:39,465][36156] Sum rewards: 55.903, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.525', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.061', 'weapon5': '0.138', 'AMMO3': '0.213', 'AMMO4': '0.304', 'weapon4': '0.346', 'weapon2': '0.356', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.830', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.957', 'FRAGCOUNT': '50.000'} [2023-02-25 14:35:39,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 217612288. Throughput: 0: 3340.0. Samples: 16894338. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:35:39,729][36114] Avg episode reward: [(0, '56.298')] [2023-02-25 14:35:41,113][36138] Updated weights for policy 0, policy_version 53133 (0.0009) [2023-02-25 14:35:44,185][36138] Updated weights for policy 0, policy_version 53143 (0.0009) [2023-02-25 14:35:44,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13312.0, 300 sec: 13398.8). Total num frames: 217677824. Throughput: 0: 3338.2. Samples: 16914338. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:35:44,729][36114] Avg episode reward: [(0, '56.298')] [2023-02-25 14:35:47,268][36138] Updated weights for policy 0, policy_version 53153 (0.0010) [2023-02-25 14:35:49,625][36154] DAMAGECOUNT value on done: 1199334.0 [2023-02-25 14:35:49,626][36154] Sum rewards: 58.778, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.997', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO4': '0.181', 'AMMO3': '0.183', 'weapon5': '0.192', 'WEAPON5': '0.250', 'weapon4': '0.284', 'WEAPON4': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.150', 'weapon3': '2.826', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.754', 'FRAGCOUNT': '50.500'} [2023-02-25 14:35:49,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13312.0, 300 sec: 13384.9). Total num frames: 217743360. Throughput: 0: 3336.3. Samples: 16934294. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:35:49,730][36114] Avg episode reward: [(0, '56.316')] [2023-02-25 14:35:49,885][36141] DAMAGECOUNT value on done: 1198517.0 [2023-02-25 14:35:49,886][36141] Sum rewards: 69.093, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.025', 'AMMO2': '0.015', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'weapon4': '0.172', 'AMMO3': '0.233', 'weapon2': '0.310', 'WEAPON3': '1.450', 'weapon3': '3.350', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '59.000'} [2023-02-25 14:35:49,934][36154] DAMAGECOUNT value on done: 1177244.0 [2023-02-25 14:35:49,934][36154] Sum rewards: 57.854, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.984', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.044', 'weapon4': '0.118', 'weapon2': '0.194', 'AMMO4': '0.220', 'AMMO3': '0.244', 'weapon5': '0.308', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.760', 'weapon3': '3.080', 'DAMAGECOUNT': '15.546', 'FRAGCOUNT': '53.000'} [2023-02-25 14:35:50,194][36141] DAMAGECOUNT value on done: 1185776.0 [2023-02-25 14:35:50,195][36141] Sum rewards: 61.055, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.376', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.020', 'weapon5': '0.042', 'AMMO4': '0.043', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'weapon2': '0.614', 'WEAPON3': '1.350', 'weapon3': '3.124', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '51.000'} [2023-02-25 14:35:50,215][36141] DAMAGECOUNT value on done: 1194164.0 [2023-02-25 14:35:50,216][36141] Sum rewards: 44.129, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.360', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon5': '0.212', 'AMMO3': '0.214', 'weapon4': '0.302', 'weapon2': '0.322', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.620', 'weapon3': '2.924', 'DAMAGECOUNT': '12.903', 'FRAGCOUNT': '40.000'} [2023-02-25 14:35:50,236][36154] DAMAGECOUNT value on done: 1198634.0 [2023-02-25 14:35:50,236][36154] Sum rewards: 56.016, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.999', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.038', 'weapon5': '0.044', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'AMMO4': '0.187', 'weapon2': '0.382', 'WEAPON4': '0.400', 'weapon4': '0.534', 'WEAPON3': '1.050', 'weapon3': '2.822', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.562', 'FRAGCOUNT': '50.000'} [2023-02-25 14:35:50,355][36138] Updated weights for policy 0, policy_version 53163 (0.0009) [2023-02-25 14:35:50,513][36141] DAMAGECOUNT value on done: 1178773.0 [2023-02-25 14:35:50,513][36141] Sum rewards: 52.697, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.978', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.187', 'weapon5': '0.190', 'weapon2': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.378', 'WEAPON3': '1.150', 'weapon3': '2.716', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.713', 'FRAGCOUNT': '46.000'} [2023-02-25 14:35:50,552][36154] DAMAGECOUNT value on done: 1187189.0 [2023-02-25 14:35:50,553][36154] Sum rewards: 62.839, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.380', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.078', 'WEAPON5': '0.150', 'weapon2': '0.150', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon4': '0.476', 'WEAPON3': '1.050', 'weapon3': '3.150', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '52.000'} [2023-02-25 14:35:51,853][36155] DAMAGECOUNT value on done: 1185525.0 [2023-02-25 14:35:51,853][36155] Sum rewards: 51.300, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.726', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.074', 'AMMO4': '0.105', 'weapon4': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.300', 'HITCOUNT': '3.130', 'weapon3': '3.316', 'DAMAGECOUNT': '15.009', 'FRAGCOUNT': '44.000'} [2023-02-25 14:35:52,151][36155] DAMAGECOUNT value on done: 1189603.0 [2023-02-25 14:35:52,151][36155] Sum rewards: 61.734, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.805', 'AMMO5': '0.014', 'AMMO2': '0.043', 'AMMO3': '0.210', 'AMMO4': '0.214', 'weapon2': '0.260', 'weapon5': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.572', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.435', 'FRAGCOUNT': '54.000'} [2023-02-25 14:35:52,817][36139] DAMAGECOUNT value on done: 1187755.0 [2023-02-25 14:35:52,818][36139] Sum rewards: 61.459, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.210', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.056', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'weapon2': '0.406', 'weapon4': '0.436', 'WEAPON3': '1.150', 'weapon3': '2.878', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.186', 'FRAGCOUNT': '51.000'} [2023-02-25 14:35:53,002][36155] DAMAGECOUNT value on done: 1205548.0 [2023-02-25 14:35:53,003][36155] Sum rewards: 60.519, reward structure: {'DEATHCOUNT': '-15.750', 'AMMO5': '0.010', 'AMMO2': '0.036', 'HEALTH': '0.174', 'AMMO4': '0.179', 'AMMO3': '0.186', 'weapon5': '0.216', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON4': '0.400', 'weapon4': '0.448', 'WEAPON3': '1.050', 'weapon3': '2.588', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.318', 'FRAGCOUNT': '52.000'} [2023-02-25 14:35:53,146][36139] DAMAGECOUNT value on done: 1186487.0 [2023-02-25 14:35:53,147][36139] Sum rewards: 55.310, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.070', 'AMMO2': '0.008', 'AMMO5': '0.010', 'weapon5': '0.020', 'AMMO4': '0.040', 'weapon4': '0.050', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.199', 'weapon2': '0.262', 'WEAPON3': '1.150', 'HITCOUNT': '3.200', 'weapon3': '3.506', 'DAMAGECOUNT': '14.235', 'FRAGCOUNT': '46.000'} [2023-02-25 14:35:53,168][36157] DAMAGECOUNT value on done: 1199016.0 [2023-02-25 14:35:53,169][36157] Sum rewards: 61.855, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.265', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.162', 'AMMO3': '0.169', 'AMMO4': '0.172', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.340', 'weapon2': '0.348', 'WEAPON3': '1.050', 'weapon3': '2.870', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.707', 'FRAGCOUNT': '51.000'} [2023-02-25 14:35:53,307][36155] DAMAGECOUNT value on done: 1184841.0 [2023-02-25 14:35:53,307][36155] Sum rewards: 62.396, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.030', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon5': '0.050', 'AMMO4': '0.089', 'AMMO3': '0.137', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.342', 'weapon2': '0.780', 'WEAPON3': '0.950', 'weapon3': '2.626', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '51.000'} [2023-02-25 14:35:53,423][36138] Updated weights for policy 0, policy_version 53173 (0.0009) [2023-02-25 14:35:53,455][36139] DAMAGECOUNT value on done: 1201864.0 [2023-02-25 14:35:53,455][36139] Sum rewards: 69.865, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.565', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.138', 'AMMO3': '0.265', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.310', 'weapon4': '0.324', 'WEAPON3': '1.600', 'weapon3': '2.908', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '62.000'} [2023-02-25 14:35:53,479][36157] DAMAGECOUNT value on done: 1188241.0 [2023-02-25 14:35:53,480][36157] Sum rewards: 49.064, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.713', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.168', 'AMMO4': '0.186', 'weapon4': '0.204', 'AMMO3': '0.293', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.650', 'HITCOUNT': '2.930', 'weapon3': '2.934', 'DAMAGECOUNT': '14.193', 'FRAGCOUNT': '47.000'} [2023-02-25 14:35:53,608][36157] DAMAGECOUNT value on done: 1200824.0 [2023-02-25 14:35:53,609][36157] Sum rewards: 56.752, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.000', 'weapon5': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.122', 'AMMO3': '0.124', 'WEAPON5': '0.150', 'weapon4': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.664', 'WEAPON3': '0.850', 'weapon3': '2.912', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.860', 'FRAGCOUNT': '46.000'} [2023-02-25 14:35:53,751][36139] DAMAGECOUNT value on done: 1196363.0 [2023-02-25 14:35:53,752][36139] Sum rewards: 62.610, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.075', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.166', 'AMMO3': '0.176', 'AMMO4': '0.199', 'weapon4': '0.298', 'weapon2': '0.318', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.956', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.851', 'FRAGCOUNT': '54.000'} [2023-02-25 14:35:53,908][36157] DAMAGECOUNT value on done: 1195337.0 [2023-02-25 14:35:53,908][36157] Sum rewards: 63.195, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.152', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.098', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'WEAPON4': '0.250', 'weapon2': '0.256', 'weapon4': '0.542', 'WEAPON3': '0.950', 'weapon3': '2.890', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.279', 'FRAGCOUNT': '53.000'} [2023-02-25 14:35:54,486][36140] DAMAGECOUNT value on done: 1195878.0 [2023-02-25 14:35:54,486][36140] Sum rewards: 65.114, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.053', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.092', 'AMMO3': '0.154', 'WEAPON5': '0.200', 'AMMO4': '0.214', 'weapon2': '0.324', 'WEAPON4': '0.450', 'weapon4': '0.678', 'WEAPON3': '1.000', 'weapon3': '2.544', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.084', 'FRAGCOUNT': '56.000'} [2023-02-25 14:35:54,497][36140] DAMAGECOUNT value on done: 1192534.0 [2023-02-25 14:35:54,497][36140] Sum rewards: 48.787, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.435', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.050', 'AMMO4': '0.075', 'weapon4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.280', 'weapon2': '0.392', 'WEAPON3': '1.750', 'HITCOUNT': '3.000', 'weapon3': '3.228', 'DAMAGECOUNT': '14.895', 'FRAGCOUNT': '45.000'} [2023-02-25 14:35:54,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 217812992. Throughput: 0: 3334.4. Samples: 16944336. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:35:54,730][36114] Avg episode reward: [(0, '56.413')] [2023-02-25 14:35:54,788][36140] DAMAGECOUNT value on done: 1184041.0 [2023-02-25 14:35:54,789][36140] Sum rewards: 55.119, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.902', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.048', 'AMMO3': '0.178', 'weapon5': '0.234', 'AMMO4': '0.238', 'weapon2': '0.386', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.524', 'WEAPON3': '0.950', 'weapon3': '2.458', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '14.214', 'FRAGCOUNT': '48.000'} [2023-02-25 14:35:54,798][36140] DAMAGECOUNT value on done: 1183735.0 [2023-02-25 14:35:54,799][36140] Sum rewards: 51.883, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.665', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.018', 'AMMO4': '0.026', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.152', 'AMMO3': '0.306', 'WEAPON3': '1.900', 'HITCOUNT': '2.800', 'weapon3': '3.528', 'DAMAGECOUNT': '13.914', 'FRAGCOUNT': '50.000'} [2023-02-25 14:35:56,445][36138] Updated weights for policy 0, policy_version 53183 (0.0009) [2023-02-25 14:35:57,188][36142] DAMAGECOUNT value on done: 1191022.0 [2023-02-25 14:35:57,188][36142] Sum rewards: 58.591, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.680', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.052', 'AMMO3': '0.183', 'weapon2': '0.200', 'AMMO4': '0.258', 'weapon5': '0.302', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.524', 'WEAPON3': '1.100', 'weapon3': '2.672', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.558', 'FRAGCOUNT': '51.000'} [2023-02-25 14:35:57,498][36142] DAMAGECOUNT value on done: 1179593.0 [2023-02-25 14:35:57,498][36142] Sum rewards: 59.945, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.900', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'weapon7': '0.054', 'weapon5': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.139', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.484', 'weapon4': '0.720', 'WEAPON3': '0.850', 'weapon3': '2.364', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.700', 'FRAGCOUNT': '48.000'} [2023-02-25 14:35:58,076][36142] DAMAGECOUNT value on done: 1190925.0 [2023-02-25 14:35:58,076][36142] Sum rewards: 44.175, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.940', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO4': '0.180', 'AMMO3': '0.191', 'weapon5': '0.256', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.574', 'weapon2': '0.584', 'WEAPON3': '1.150', 'weapon3': '2.236', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.225', 'FRAGCOUNT': '41.000'} [2023-02-25 14:35:58,383][36142] DAMAGECOUNT value on done: 1201342.0 [2023-02-25 14:35:58,384][36142] Sum rewards: 58.360, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.675', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO3': '0.149', 'AMMO4': '0.163', 'weapon5': '0.170', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.430', 'weapon4': '0.458', 'WEAPON3': '0.900', 'weapon3': '2.740', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '49.000'} [2023-02-25 14:35:58,989][36156] DAMAGECOUNT value on done: 1204338.0 [2023-02-25 14:35:58,990][36156] Sum rewards: 60.580, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.230', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon4': '0.090', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.234', 'AMMO3': '0.237', 'WEAPON3': '1.450', 'weapon3': '3.340', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.984', 'FRAGCOUNT': '51.000'} [2023-02-25 14:35:59,327][36156] DAMAGECOUNT value on done: 1185205.0 [2023-02-25 14:35:59,327][36156] Sum rewards: 60.812, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.286', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.137', 'AMMO3': '0.176', 'weapon5': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.340', 'weapon2': '0.602', 'WEAPON3': '1.050', 'weapon3': '2.632', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.325', 'FRAGCOUNT': '50.000'} [2023-02-25 14:35:59,350][36156] DAMAGECOUNT value on done: 1196170.0 [2023-02-25 14:35:59,350][36156] Sum rewards: 62.929, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.994', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.170', 'weapon5': '0.180', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.440', 'weapon4': '0.636', 'WEAPON3': '1.300', 'weapon3': '2.346', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '55.000'} [2023-02-25 14:35:59,504][36138] Updated weights for policy 0, policy_version 53193 (0.0010) [2023-02-25 14:35:59,658][36156] DAMAGECOUNT value on done: 1184542.0 [2023-02-25 14:35:59,658][36156] Sum rewards: 60.865, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.982', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon5': '0.174', 'weapon2': '0.186', 'AMMO3': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.514', 'WEAPON3': '1.500', 'weapon3': '2.802', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.065', 'FRAGCOUNT': '56.000'} [2023-02-25 14:35:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 217878528. Throughput: 0: 3336.9. Samples: 16964528. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:35:59,730][36114] Avg episode reward: [(0, '56.271')] [2023-02-25 14:36:02,552][36138] Updated weights for policy 0, policy_version 53203 (0.0009) [2023-02-25 14:36:04,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 217948160. Throughput: 0: 3343.6. Samples: 16984710. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:36:04,730][36114] Avg episode reward: [(0, '56.271')] [2023-02-25 14:36:05,576][36138] Updated weights for policy 0, policy_version 53213 (0.0009) [2023-02-25 14:36:05,956][36141] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:36:08,664][36138] Updated weights for policy 0, policy_version 53223 (0.0009) [2023-02-25 14:36:09,634][36154] DAMAGECOUNT value on done: 1203829.0 [2023-02-25 14:36:09,634][36154] Sum rewards: 53.505, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.535', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'AMMO3': '0.214', 'weapon4': '0.324', 'weapon2': '0.492', 'WEAPON3': '1.250', 'weapon3': '2.944', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.485', 'FRAGCOUNT': '47.000'} [2023-02-25 14:36:09,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 218013696. Throughput: 0: 3342.8. Samples: 16994754. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:36:09,730][36114] Avg episode reward: [(0, '56.387')] [2023-02-25 14:36:09,907][36141] DAMAGECOUNT value on done: 1203551.0 [2023-02-25 14:36:09,908][36141] Sum rewards: 61.575, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.406', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.044', 'AMMO4': '0.052', 'weapon4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'weapon2': '0.382', 'WEAPON3': '1.300', 'HITCOUNT': '3.260', 'weapon3': '3.362', 'DAMAGECOUNT': '15.102', 'FRAGCOUNT': '52.000'} [2023-02-25 14:36:09,938][36154] DAMAGECOUNT value on done: 1182308.0 [2023-02-25 14:36:09,939][36154] Sum rewards: 63.548, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.070', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.104', 'weapon4': '0.130', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'AMMO4': '0.210', 'weapon2': '0.266', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'HITCOUNT': '3.010', 'weapon3': '3.230', 'DAMAGECOUNT': '15.144', 'FRAGCOUNT': '55.000'} [2023-02-25 14:36:10,214][36141] DAMAGECOUNT value on done: 1198527.0 [2023-02-25 14:36:10,215][36141] Sum rewards: 56.584, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.045', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.110', 'AMMO3': '0.121', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.232', 'weapon4': '0.422', 'WEAPON3': '0.800', 'weapon3': '2.608', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.089', 'FRAGCOUNT': '46.000'} [2023-02-25 14:36:10,227][36141] DAMAGECOUNT value on done: 1190998.0 [2023-02-25 14:36:10,227][36141] Sum rewards: 63.979, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.107', 'AMMO3': '0.124', 'WEAPON5': '0.150', 'weapon5': '0.152', 'weapon2': '0.258', 'WEAPON4': '0.300', 'WEAPON3': '0.700', 'HEALTH': '0.719', 'weapon4': '0.736', 'weapon3': '2.648', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.666', 'FRAGCOUNT': '51.000'} [2023-02-25 14:36:10,245][36154] DAMAGECOUNT value on done: 1203902.0 [2023-02-25 14:36:10,246][36154] Sum rewards: 61.932, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.060', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.060', 'weapon5': '0.076', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.370', 'WEAPON3': '1.350', 'HITCOUNT': '3.260', 'weapon3': '3.266', 'DAMAGECOUNT': '15.804', 'FRAGCOUNT': '54.000'} [2023-02-25 14:36:10,511][36141] DAMAGECOUNT value on done: 1184342.0 [2023-02-25 14:36:10,512][36141] Sum rewards: 65.783, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.740', 'AMMO5': '0.010', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'weapon4': '0.102', 'AMMO4': '0.105', 'weapon5': '0.114', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.510', 'WEAPON3': '1.300', 'weapon3': '3.050', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '56.000'} [2023-02-25 14:36:10,558][36154] DAMAGECOUNT value on done: 1192919.0 [2023-02-25 14:36:10,559][36154] Sum rewards: 71.619, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.354', 'AMMO2': '0.020', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'AMMO3': '0.214', 'weapon2': '0.320', 'weapon4': '0.440', 'WEAPON3': '1.300', 'weapon3': '3.042', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '60.000'} [2023-02-25 14:36:11,722][36138] Updated weights for policy 0, policy_version 53233 (0.0010) [2023-02-25 14:36:11,790][36155] DAMAGECOUNT value on done: 1190843.0 [2023-02-25 14:36:11,790][36155] Sum rewards: 63.523, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.669', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.122', 'AMMO3': '0.172', 'weapon5': '0.198', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.748', 'WEAPON3': '1.150', 'weapon3': '2.470', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.954', 'FRAGCOUNT': '53.000'} [2023-02-25 14:36:12,097][36155] DAMAGECOUNT value on done: 1194681.0 [2023-02-25 14:36:12,098][36155] Sum rewards: 57.781, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.412', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO3': '0.224', 'weapon4': '0.254', 'weapon2': '0.622', 'WEAPON3': '1.300', 'weapon3': '2.776', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '50.000'} [2023-02-25 14:36:12,803][36139] DAMAGECOUNT value on done: 1192730.0 [2023-02-25 14:36:12,803][36139] Sum rewards: 63.136, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.350', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.088', 'AMMO4': '0.140', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.438', 'weapon2': '0.598', 'WEAPON3': '0.950', 'weapon3': '2.656', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.925', 'FRAGCOUNT': '52.000'} [2023-02-25 14:36:12,935][36155] DAMAGECOUNT value on done: 1210248.0 [2023-02-25 14:36:12,936][36155] Sum rewards: 52.840, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.742', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.072', 'AMMO4': '0.143', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.312', 'weapon2': '0.482', 'WEAPON3': '1.150', 'HITCOUNT': '2.680', 'weapon3': '2.912', 'DAMAGECOUNT': '14.100', 'FRAGCOUNT': '45.000'} [2023-02-25 14:36:13,111][36139] DAMAGECOUNT value on done: 1191383.0 [2023-02-25 14:36:13,111][36139] Sum rewards: 55.327, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.776', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'AMMO4': '0.245', 'weapon2': '0.290', 'WEAPON4': '0.350', 'weapon4': '0.618', 'WEAPON3': '1.000', 'weapon3': '2.686', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.688', 'FRAGCOUNT': '47.000'} [2023-02-25 14:36:13,171][36157] DAMAGECOUNT value on done: 1203883.0 [2023-02-25 14:36:13,171][36157] Sum rewards: 58.207, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.818', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon5': '0.094', 'AMMO3': '0.205', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.408', 'WEAPON3': '1.350', 'weapon3': '2.902', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '14.601', 'FRAGCOUNT': '52.000'} [2023-02-25 14:36:13,239][36155] DAMAGECOUNT value on done: 1189294.0 [2023-02-25 14:36:13,239][36155] Sum rewards: 45.785, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.990', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon4': '0.214', 'weapon2': '0.362', 'WEAPON3': '1.150', 'HITCOUNT': '2.730', 'weapon3': '3.072', 'DAMAGECOUNT': '13.359', 'FRAGCOUNT': '39.000'} [2023-02-25 14:36:13,342][36139] DAMAGECOUNT value on done: 1206671.0 [2023-02-25 14:36:13,343][36139] Sum rewards: 60.371, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.355', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'AMMO4': '0.138', 'WEAPON4': '0.300', 'weapon2': '0.324', 'WEAPON3': '0.800', 'weapon4': '0.878', 'weapon3': '2.404', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.421', 'FRAGCOUNT': '49.000'} [2023-02-25 14:36:13,492][36157] DAMAGECOUNT value on done: 1193586.0 [2023-02-25 14:36:13,493][36157] Sum rewards: 66.283, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.320', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon4': '0.284', 'weapon2': '0.684', 'WEAPON3': '1.150', 'weapon3': '2.668', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '57.000'} [2023-02-25 14:36:13,646][36157] DAMAGECOUNT value on done: 1205538.0 [2023-02-25 14:36:13,647][36157] Sum rewards: 54.113, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.957', 'AMMO2': '0.011', 'AMMO4': '0.052', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon2': '0.254', 'weapon4': '0.564', 'WEAPON3': '1.200', 'weapon3': '3.026', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.142', 'FRAGCOUNT': '47.000'} [2023-02-25 14:36:13,679][36139] DAMAGECOUNT value on done: 1201294.0 [2023-02-25 14:36:13,679][36139] Sum rewards: 58.113, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.660', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.038', 'AMMO4': '0.136', 'weapon4': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.257', 'weapon2': '0.540', 'WEAPON3': '1.550', 'weapon3': '2.998', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.793', 'FRAGCOUNT': '54.000'} [2023-02-25 14:36:13,962][36157] DAMAGECOUNT value on done: 1200465.0 [2023-02-25 14:36:13,962][36157] Sum rewards: 57.611, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.825', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.035', 'AMMO3': '0.156', 'AMMO4': '0.175', 'weapon5': '0.212', 'weapon4': '0.288', 'weapon2': '0.388', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.870', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.904', 'FRAGCOUNT': '49.000'} [2023-02-25 14:36:14,508][36140] DAMAGECOUNT value on done: 1200839.0 [2023-02-25 14:36:14,509][36140] Sum rewards: 49.622, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.730', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.120', 'AMMO4': '0.125', 'AMMO3': '0.199', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.392', 'weapon4': '0.392', 'WEAPON3': '1.150', 'HITCOUNT': '2.620', 'weapon3': '2.664', 'DAMAGECOUNT': '13.383', 'FRAGCOUNT': '42.000'} [2023-02-25 14:36:14,520][36140] DAMAGECOUNT value on done: 1197269.0 [2023-02-25 14:36:14,520][36140] Sum rewards: 59.825, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.350', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'weapon4': '0.130', 'AMMO3': '0.152', 'WEAPON5': '0.200', 'weapon5': '0.262', 'weapon2': '0.522', 'WEAPON3': '1.050', 'HITCOUNT': '2.830', 'weapon3': '2.880', 'DAMAGECOUNT': '14.205', 'FRAGCOUNT': '50.000'} [2023-02-25 14:36:14,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 218079232. Throughput: 0: 3348.4. Samples: 17014876. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:36:14,730][36114] Avg episode reward: [(0, '57.174')] [2023-02-25 14:36:14,797][36138] Updated weights for policy 0, policy_version 53243 (0.0009) [2023-02-25 14:36:14,831][36140] DAMAGECOUNT value on done: 1189076.0 [2023-02-25 14:36:14,832][36140] Sum rewards: 64.639, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.020', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.014', 'weapon5': '0.020', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.243', 'weapon2': '0.386', 'WEAPON3': '1.550', 'HITCOUNT': '3.330', 'weapon3': '3.382', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '57.000'} [2023-02-25 14:36:14,843][36140] DAMAGECOUNT value on done: 1188599.0 [2023-02-25 14:36:14,844][36140] Sum rewards: 60.747, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.535', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.128', 'AMMO3': '0.152', 'WEAPON5': '0.200', 'AMMO4': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.416', 'weapon4': '0.506', 'WEAPON3': '0.950', 'weapon3': '2.760', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.592', 'FRAGCOUNT': '50.000'} [2023-02-25 14:36:14,946][36154] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:36:17,299][36142] DAMAGECOUNT value on done: 1195408.0 [2023-02-25 14:36:17,299][36142] Sum rewards: 40.391, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.450', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.220', 'weapon5': '0.312', 'weapon2': '0.318', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'weapon4': '1.074', 'WEAPON3': '1.250', 'weapon3': '1.792', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.158', 'FRAGCOUNT': '40.000'} [2023-02-25 14:36:17,597][36142] DAMAGECOUNT value on done: 1185123.0 [2023-02-25 14:36:17,597][36142] Sum rewards: 59.795, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.843', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.084', 'AMMO4': '0.118', 'weapon5': '0.130', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'weapon2': '0.266', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.262', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '53.000'} [2023-02-25 14:36:17,866][36138] Updated weights for policy 0, policy_version 53253 (0.0009) [2023-02-25 14:36:18,162][36142] DAMAGECOUNT value on done: 1195375.0 [2023-02-25 14:36:18,162][36142] Sum rewards: 51.477, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.394', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.100', 'AMMO3': '0.102', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.474', 'weapon4': '0.546', 'WEAPON3': '0.750', 'HITCOUNT': '2.520', 'weapon3': '2.710', 'DAMAGECOUNT': '13.350', 'FRAGCOUNT': '42.000'} [2023-02-25 14:36:18,476][36142] DAMAGECOUNT value on done: 1205588.0 [2023-02-25 14:36:18,476][36142] Sum rewards: 49.934, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.300', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'AMMO4': '0.185', 'WEAPON4': '0.350', 'weapon4': '0.474', 'weapon2': '0.630', 'WEAPON3': '1.100', 'weapon3': '2.612', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.738', 'FRAGCOUNT': '45.000'} [2023-02-25 14:36:19,101][36156] DAMAGECOUNT value on done: 1208872.0 [2023-02-25 14:36:19,102][36156] Sum rewards: 44.969, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.532', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO3': '0.171', 'AMMO4': '0.196', 'weapon5': '0.234', 'weapon2': '0.358', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.586', 'WEAPON3': '1.050', 'weapon3': '2.536', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.602', 'FRAGCOUNT': '40.000'} [2023-02-25 14:36:19,407][36156] DAMAGECOUNT value on done: 1191592.0 [2023-02-25 14:36:19,408][36156] Sum rewards: 68.903, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.915', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.062', 'weapon5': '0.168', 'AMMO4': '0.184', 'AMMO3': '0.187', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.642', 'WEAPON3': '1.250', 'weapon3': '2.812', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '58.000'} [2023-02-25 14:36:19,437][36156] DAMAGECOUNT value on done: 1201615.0 [2023-02-25 14:36:19,438][36156] Sum rewards: 63.757, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.395', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.014', 'weapon5': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.280', 'weapon2': '0.364', 'WEAPON3': '1.650', 'weapon3': '3.336', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '57.000'} [2023-02-25 14:36:19,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 218148864. Throughput: 0: 3347.3. Samples: 17034980. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:36:19,730][36114] Avg episode reward: [(0, '57.298')] [2023-02-25 14:36:19,745][36156] DAMAGECOUNT value on done: 1188770.0 [2023-02-25 14:36:19,746][36156] Sum rewards: 49.623, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.040', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.156', 'AMMO3': '0.177', 'weapon2': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.902', 'WEAPON3': '1.050', 'weapon3': '2.368', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '12.684', 'FRAGCOUNT': '44.000'} [2023-02-25 14:36:20,909][36138] Updated weights for policy 0, policy_version 53263 (0.0009) [2023-02-25 14:36:23,953][36138] Updated weights for policy 0, policy_version 53273 (0.0009) [2023-02-25 14:36:24,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 218214400. Throughput: 0: 3348.0. Samples: 17045000. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:36:24,730][36114] Avg episode reward: [(0, '57.174')] [2023-02-25 14:36:26,989][36138] Updated weights for policy 0, policy_version 53283 (0.0009) [2023-02-25 14:36:29,662][36154] DAMAGECOUNT value on done: 1208544.0 [2023-02-25 14:36:29,663][36154] Sum rewards: 58.604, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.460', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO3': '0.137', 'weapon2': '0.190', 'AMMO4': '0.194', 'weapon5': '0.352', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '0.800', 'weapon4': '1.122', 'weapon3': '2.072', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '14.145', 'FRAGCOUNT': '50.000'} [2023-02-25 14:36:29,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 218279936. Throughput: 0: 3349.7. Samples: 17065076. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:36:29,730][36114] Avg episode reward: [(0, '57.121')] [2023-02-25 14:36:29,958][36154] DAMAGECOUNT value on done: 1187301.0 [2023-02-25 14:36:29,958][36154] Sum rewards: 59.784, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.225', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.029', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon5': '0.178', 'WEAPON4': '0.250', 'weapon4': '0.292', 'weapon2': '0.372', 'WEAPON3': '1.150', 'weapon3': '2.976', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.979', 'FRAGCOUNT': '51.000'} [2023-02-25 14:36:29,990][36141] DAMAGECOUNT value on done: 1208548.0 [2023-02-25 14:36:29,990][36141] Sum rewards: 56.526, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.890', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.130', 'weapon4': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon2': '0.212', 'WEAPON3': '1.300', 'HITCOUNT': '3.220', 'weapon3': '3.328', 'DAMAGECOUNT': '14.991', 'FRAGCOUNT': '48.000'} [2023-02-25 14:36:30,042][36138] Updated weights for policy 0, policy_version 53293 (0.0009) [2023-02-25 14:36:30,264][36141] DAMAGECOUNT value on done: 1196611.0 [2023-02-25 14:36:30,264][36141] Sum rewards: 67.215, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.160', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.048', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'weapon2': '0.202', 'weapon4': '0.216', 'WEAPON3': '1.200', 'HITCOUNT': '3.300', 'weapon3': '3.374', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '55.000'} [2023-02-25 14:36:30,294][36154] DAMAGECOUNT value on done: 1208983.0 [2023-02-25 14:36:30,295][36154] Sum rewards: 64.313, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.890', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.054', 'AMMO3': '0.098', 'weapon5': '0.240', 'AMMO4': '0.272', 'weapon2': '0.466', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '0.600', 'weapon4': '0.974', 'weapon3': '2.024', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.243', 'FRAGCOUNT': '52.000'} [2023-02-25 14:36:30,318][36141] DAMAGECOUNT value on done: 1203669.0 [2023-02-25 14:36:30,319][36141] Sum rewards: 59.439, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.932', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.140', 'AMMO4': '0.149', 'AMMO3': '0.171', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.462', 'weapon4': '0.534', 'WEAPON3': '1.050', 'weapon3': '2.658', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '51.000'} [2023-02-25 14:36:30,581][36141] DAMAGECOUNT value on done: 1190307.0 [2023-02-25 14:36:30,582][36141] Sum rewards: 66.725, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.220', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.162', 'AMMO4': '0.191', 'AMMO3': '0.217', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.460', 'weapon2': '0.526', 'WEAPON3': '1.300', 'weapon3': '2.574', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '57.000'} [2023-02-25 14:36:30,598][36154] DAMAGECOUNT value on done: 1197198.0 [2023-02-25 14:36:30,599][36154] Sum rewards: 55.597, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.470', 'AMMO5': '0.005', 'AMMO2': '0.046', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'weapon2': '0.194', 'AMMO4': '0.231', 'WEAPON4': '0.300', 'weapon4': '0.712', 'WEAPON3': '0.950', 'weapon3': '2.764', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.837', 'FRAGCOUNT': '47.000'} [2023-02-25 14:36:31,774][36155] DAMAGECOUNT value on done: 1195612.0 [2023-02-25 14:36:31,775][36155] Sum rewards: 60.546, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.106', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.038', 'AMMO4': '0.073', 'weapon4': '0.074', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'weapon2': '0.432', 'WEAPON3': '0.950', 'HITCOUNT': '2.960', 'weapon3': '3.328', 'DAMAGECOUNT': '14.307', 'FRAGCOUNT': '50.000'} [2023-02-25 14:36:32,076][36155] DAMAGECOUNT value on done: 1200423.0 [2023-02-25 14:36:32,076][36155] Sum rewards: 62.616, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.722', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.168', 'AMMO3': '0.183', 'WEAPON5': '0.250', 'weapon4': '0.282', 'WEAPON4': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.250', 'weapon3': '2.972', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '53.000'} [2023-02-25 14:36:32,803][36139] DAMAGECOUNT value on done: 1198279.0 [2023-02-25 14:36:32,804][36139] Sum rewards: 62.604, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.286', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon2': '0.292', 'weapon4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.070', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '54.000'} [2023-02-25 14:36:32,909][36155] DAMAGECOUNT value on done: 1215122.0 [2023-02-25 14:36:32,909][36155] Sum rewards: 56.087, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.325', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.016', 'WEAPON4': '0.100', 'weapon5': '0.128', 'AMMO3': '0.197', 'weapon4': '0.264', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.350', 'weapon3': '2.968', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.622', 'FRAGCOUNT': '48.000'} [2023-02-25 14:36:33,097][36138] Updated weights for policy 0, policy_version 53303 (0.0009) [2023-02-25 14:36:33,121][36139] DAMAGECOUNT value on done: 1195577.0 [2023-02-25 14:36:33,121][36139] Sum rewards: 44.573, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.624', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'AMMO2': '0.088', 'AMMO3': '0.152', 'weapon5': '0.282', 'AMMO4': '0.442', 'weapon2': '0.456', 'WEAPON5': '0.600', 'weapon4': '0.862', 'WEAPON4': '1.000', 'WEAPON3': '1.000', 'weapon3': '2.022', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.582', 'FRAGCOUNT': '41.500'} [2023-02-25 14:36:33,222][36155] DAMAGECOUNT value on done: 1194936.0 [2023-02-25 14:36:33,222][36155] Sum rewards: 69.290, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.795', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.090', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'weapon2': '0.364', 'weapon4': '0.556', 'WEAPON3': '1.150', 'weapon3': '2.712', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '58.000'} [2023-02-25 14:36:33,317][36139] DAMAGECOUNT value on done: 1211775.0 [2023-02-25 14:36:33,318][36139] Sum rewards: 58.431, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.160', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.094', 'AMMO4': '0.151', 'AMMO3': '0.202', 'weapon2': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.772', 'WEAPON3': '1.250', 'weapon3': '2.644', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '51.000'} [2023-02-25 14:36:33,338][36157] DAMAGECOUNT value on done: 1208744.0 [2023-02-25 14:36:33,338][36157] Sum rewards: 51.491, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.628', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.128', 'WEAPON5': '0.150', 'AMMO4': '0.182', 'weapon2': '0.206', 'AMMO3': '0.248', 'weapon4': '0.388', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.960', 'weapon3': '3.026', 'DAMAGECOUNT': '14.487', 'FRAGCOUNT': '47.500'} [2023-02-25 14:36:33,643][36139] DAMAGECOUNT value on done: 1205893.0 [2023-02-25 14:36:33,644][36139] Sum rewards: 50.133, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.178', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.042', 'weapon4': '0.122', 'AMMO4': '0.169', 'weapon2': '0.216', 'AMMO3': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.780', 'weapon3': '3.392', 'DAMAGECOUNT': '13.797', 'FRAGCOUNT': '46.000'} [2023-02-25 14:36:33,657][36157] DAMAGECOUNT value on done: 1199055.0 [2023-02-25 14:36:33,657][36157] Sum rewards: 58.407, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.530', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon5': '0.118', 'AMMO4': '0.189', 'AMMO3': '0.217', 'weapon2': '0.258', 'weapon4': '0.258', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '3.070', 'weapon3': '3.114', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '50.000'} [2023-02-25 14:36:33,795][36157] DAMAGECOUNT value on done: 1210983.0 [2023-02-25 14:36:33,796][36157] Sum rewards: 63.180, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.472', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.064', 'AMMO4': '0.119', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon2': '0.306', 'WEAPON3': '1.250', 'weapon3': '3.194', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '53.000'} [2023-02-25 14:36:34,122][36157] DAMAGECOUNT value on done: 1205317.0 [2023-02-25 14:36:34,122][36157] Sum rewards: 62.956, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.560', 'AMMO5': '0.009', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.141', 'weapon5': '0.166', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.544', 'weapon4': '0.646', 'WEAPON3': '0.850', 'weapon3': '2.054', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '14.556', 'FRAGCOUNT': '52.000'} [2023-02-25 14:36:34,510][36140] DAMAGECOUNT value on done: 1202118.0 [2023-02-25 14:36:34,511][36140] Sum rewards: 55.558, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.699', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.044', 'AMMO3': '0.119', 'weapon5': '0.148', 'AMMO4': '0.222', 'WEAPON5': '0.400', 'weapon2': '0.488', 'weapon4': '0.538', 'WEAPON4': '0.550', 'WEAPON3': '0.750', 'weapon3': '2.464', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.547', 'FRAGCOUNT': '46.000'} [2023-02-25 14:36:34,547][36140] DAMAGECOUNT value on done: 1206109.0 [2023-02-25 14:36:34,548][36140] Sum rewards: 63.314, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.558', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon5': '0.114', 'weapon4': '0.160', 'AMMO4': '0.174', 'AMMO3': '0.183', 'WEAPON5': '0.300', 'weapon2': '0.388', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.056', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.810', 'FRAGCOUNT': '55.000'} [2023-02-25 14:36:34,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 218349568. Throughput: 0: 3351.7. Samples: 17085120. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:36:34,730][36114] Avg episode reward: [(0, '58.205')] [2023-02-25 14:36:34,833][36140] DAMAGECOUNT value on done: 1193314.0 [2023-02-25 14:36:34,833][36140] Sum rewards: 50.684, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.838', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.094', 'AMMO4': '0.184', 'WEAPON5': '0.200', 'weapon4': '0.202', 'AMMO3': '0.213', 'WEAPON4': '0.350', 'weapon2': '0.724', 'WEAPON3': '1.300', 'weapon3': '2.744', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '14.145', 'FRAGCOUNT': '46.000'} [2023-02-25 14:36:34,875][36140] DAMAGECOUNT value on done: 1193400.0 [2023-02-25 14:36:34,876][36140] Sum rewards: 51.815, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.630', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.080', 'AMMO4': '0.173', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'weapon2': '0.248', 'WEAPON4': '0.350', 'weapon4': '0.522', 'WEAPON3': '1.100', 'HITCOUNT': '2.870', 'weapon3': '2.956', 'DAMAGECOUNT': '12.972', 'FRAGCOUNT': '46.000'} [2023-02-25 14:36:36,209][36138] Updated weights for policy 0, policy_version 53313 (0.0009) [2023-02-25 14:36:37,456][36142] DAMAGECOUNT value on done: 1200012.0 [2023-02-25 14:36:37,456][36142] Sum rewards: 50.197, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.560', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.098', 'AMMO4': '0.109', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon4': '0.292', 'WEAPON4': '0.300', 'weapon2': '0.470', 'WEAPON3': '1.200', 'HITCOUNT': '2.870', 'weapon3': '2.932', 'DAMAGECOUNT': '13.812', 'FRAGCOUNT': '43.000'} [2023-02-25 14:36:37,772][36142] DAMAGECOUNT value on done: 1190487.0 [2023-02-25 14:36:37,772][36142] Sum rewards: 59.065, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.006', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon4': '0.170', 'WEAPON4': '0.200', 'weapon5': '0.212', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.250', 'weapon3': '2.912', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '51.000'} [2023-02-25 14:36:38,351][36142] DAMAGECOUNT value on done: 1199846.0 [2023-02-25 14:36:38,351][36142] Sum rewards: 49.952, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.932', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.056', 'AMMO4': '0.139', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'weapon2': '0.274', 'WEAPON4': '0.300', 'ARMOR': '0.404', 'weapon4': '0.568', 'WEAPON3': '1.350', 'weapon3': '2.854', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.413', 'FRAGCOUNT': '44.000'} [2023-02-25 14:36:38,669][36142] DAMAGECOUNT value on done: 1210913.0 [2023-02-25 14:36:38,670][36142] Sum rewards: 61.831, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.960', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.134', 'AMMO3': '0.247', 'weapon2': '0.274', 'WEAPON3': '1.500', 'HITCOUNT': '3.290', 'weapon3': '3.322', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '54.000'} [2023-02-25 14:36:39,167][36156] DAMAGECOUNT value on done: 1213132.0 [2023-02-25 14:36:39,167][36156] Sum rewards: 48.349, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.702', 'AMMO2': '0.030', 'AMMO4': '0.148', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'weapon2': '0.366', 'weapon4': '0.606', 'WEAPON3': '1.300', 'weapon3': '2.782', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '12.780', 'FRAGCOUNT': '42.000'} [2023-02-25 14:36:39,234][36138] Updated weights for policy 0, policy_version 53323 (0.0009) [2023-02-25 14:36:39,481][36156] DAMAGECOUNT value on done: 1196468.0 [2023-02-25 14:36:39,481][36156] Sum rewards: 57.657, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.012', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.049', 'AMMO3': '0.143', 'AMMO4': '0.246', 'WEAPON5': '0.350', 'weapon5': '0.366', 'weapon2': '0.410', 'WEAPON4': '0.450', 'weapon4': '0.728', 'WEAPON3': '0.950', 'weapon3': '2.290', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.628', 'FRAGCOUNT': '48.000'} [2023-02-25 14:36:39,519][36156] DAMAGECOUNT value on done: 1206540.0 [2023-02-25 14:36:39,520][36156] Sum rewards: 54.883, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.924', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.038', 'AMMO3': '0.153', 'weapon5': '0.156', 'AMMO4': '0.192', 'WEAPON5': '0.200', 'weapon2': '0.366', 'WEAPON4': '0.400', 'weapon4': '0.878', 'WEAPON3': '0.900', 'weapon3': '2.150', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '46.000'} [2023-02-25 14:36:39,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 218415104. Throughput: 0: 3352.2. Samples: 17095184. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:36:39,729][36114] Avg episode reward: [(0, '58.005')] [2023-02-25 14:36:39,822][36156] DAMAGECOUNT value on done: 1193900.0 [2023-02-25 14:36:39,822][36156] Sum rewards: 62.990, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.781', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.082', 'weapon4': '0.166', 'AMMO3': '0.226', 'weapon2': '0.636', 'WEAPON3': '1.450', 'weapon3': '3.034', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '54.000'} [2023-02-25 14:36:42,297][36138] Updated weights for policy 0, policy_version 53333 (0.0009) [2023-02-25 14:36:44,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 218480640. Throughput: 0: 3349.2. Samples: 17115240. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:36:44,730][36114] Avg episode reward: [(0, '57.959')] [2023-02-25 14:36:45,349][36138] Updated weights for policy 0, policy_version 53343 (0.0010) [2023-02-25 14:36:46,814][36140] Large shaping reward 2.578 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.558, 186.0)] [2023-02-25 14:36:48,431][36138] Updated weights for policy 0, policy_version 53353 (0.0009) [2023-02-25 14:36:49,729][36114] Fps is (10 sec: 13516.6, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 218550272. Throughput: 0: 3346.5. Samples: 17135302. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:36:49,730][36114] Avg episode reward: [(0, '57.959')] [2023-02-25 14:36:49,816][36154] DAMAGECOUNT value on done: 1213941.0 [2023-02-25 14:36:49,817][36154] Sum rewards: 58.686, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.820', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.096', 'AMMO4': '0.143', 'WEAPON5': '0.200', 'weapon4': '0.208', 'AMMO3': '0.276', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.650', 'weapon3': '3.056', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '53.000'} [2023-02-25 14:36:50,068][36141] DAMAGECOUNT value on done: 1213180.0 [2023-02-25 14:36:50,069][36141] Sum rewards: 52.979, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.410', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'WEAPON4': '0.300', 'weapon4': '0.684', 'weapon2': '0.754', 'WEAPON3': '0.900', 'weapon3': '2.298', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.896', 'FRAGCOUNT': '44.000'} [2023-02-25 14:36:50,124][36154] DAMAGECOUNT value on done: 1192123.0 [2023-02-25 14:36:50,125][36154] Sum rewards: 59.983, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.140', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.079', 'weapon4': '0.082', 'AMMO3': '0.193', 'weapon2': '0.710', 'WEAPON3': '1.300', 'weapon3': '3.010', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.466', 'FRAGCOUNT': '51.000'} [2023-02-25 14:36:50,371][36141] DAMAGECOUNT value on done: 1201162.0 [2023-02-25 14:36:50,372][36141] Sum rewards: 52.615, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.062', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon4': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'weapon5': '0.166', 'weapon2': '0.874', 'WEAPON3': '1.000', 'HITCOUNT': '2.680', 'weapon3': '2.686', 'DAMAGECOUNT': '13.653', 'FRAGCOUNT': '44.000'} [2023-02-25 14:36:50,385][36154] DAMAGECOUNT value on done: 1214666.0 [2023-02-25 14:36:50,385][36154] Sum rewards: 62.270, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.330', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.120', 'weapon2': '0.122', 'weapon4': '0.238', 'AMMO3': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.320', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '54.000'} [2023-02-25 14:36:50,392][36141] DAMAGECOUNT value on done: 1208008.0 [2023-02-25 14:36:50,393][36141] Sum rewards: 46.571, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.790', 'ARMOR': '0.004', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.040', 'AMMO3': '0.110', 'weapon4': '0.138', 'AMMO4': '0.198', 'weapon5': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'weapon2': '1.004', 'weapon3': '2.382', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '13.017', 'FRAGCOUNT': '37.000'} [2023-02-25 14:36:50,697][36141] DAMAGECOUNT value on done: 1194495.0 [2023-02-25 14:36:50,698][36141] Sum rewards: 51.628, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.175', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO3': '0.117', 'AMMO4': '0.165', 'weapon5': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.448', 'WEAPON4': '0.450', 'weapon2': '0.552', 'WEAPON3': '0.800', 'weapon3': '2.560', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.564', 'FRAGCOUNT': '44.000'} [2023-02-25 14:36:50,698][36154] DAMAGECOUNT value on done: 1201469.0 [2023-02-25 14:36:50,699][36154] Sum rewards: 46.648, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.882', 'AMMO5': '0.023', 'AMMO2': '0.062', 'AMMO3': '0.195', 'weapon2': '0.250', 'AMMO4': '0.310', 'weapon5': '0.322', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'weapon4': '0.960', 'WEAPON3': '1.050', 'weapon3': '2.072', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '12.576', 'FRAGCOUNT': '44.000'} [2023-02-25 14:36:51,541][36138] Updated weights for policy 0, policy_version 53363 (0.0009) [2023-02-25 14:36:51,908][36155] DAMAGECOUNT value on done: 1200267.0 [2023-02-25 14:36:51,909][36155] Sum rewards: 55.643, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.590', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.120', 'AMMO4': '0.152', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.574', 'weapon2': '0.632', 'WEAPON3': '0.950', 'weapon3': '2.488', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.485', 'FRAGCOUNT': '48.000'} [2023-02-25 14:36:52,224][36155] DAMAGECOUNT value on done: 1205600.0 [2023-02-25 14:36:52,224][36155] Sum rewards: 62.941, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.555', 'AMMO5': '0.004', 'AMMO2': '0.012', 'weapon4': '0.016', 'weapon5': '0.028', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.153', 'weapon2': '0.828', 'WEAPON3': '1.000', 'weapon3': '2.968', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.531', 'FRAGCOUNT': '51.000'} [2023-02-25 14:36:52,812][36139] DAMAGECOUNT value on done: 1202581.0 [2023-02-25 14:36:52,813][36139] Sum rewards: 44.720, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.446', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.084', 'weapon2': '0.186', 'AMMO4': '0.194', 'AMMO3': '0.215', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.480', 'WEAPON3': '1.300', 'HITCOUNT': '2.800', 'weapon3': '2.998', 'DAMAGECOUNT': '12.906', 'FRAGCOUNT': '41.000'} [2023-02-25 14:36:53,115][36155] DAMAGECOUNT value on done: 1219427.0 [2023-02-25 14:36:53,115][36155] Sum rewards: 45.170, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.332', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.045', 'AMMO3': '0.190', 'AMMO4': '0.226', 'weapon5': '0.248', 'weapon2': '0.298', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.932', 'WEAPON3': '1.150', 'weapon3': '2.172', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.915', 'FRAGCOUNT': '39.000'} [2023-02-25 14:36:53,143][36139] DAMAGECOUNT value on done: 1200552.0 [2023-02-25 14:36:53,143][36139] Sum rewards: 53.400, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.532', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.096', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'WEAPON4': '0.300', 'weapon2': '0.412', 'weapon4': '0.626', 'WEAPON3': '1.200', 'weapon3': '2.648', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.925', 'FRAGCOUNT': '44.000'} [2023-02-25 14:36:53,346][36139] DAMAGECOUNT value on done: 1216639.0 [2023-02-25 14:36:53,347][36139] Sum rewards: 52.463, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.920', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.172', 'AMMO3': '0.175', 'weapon7': '0.222', 'weapon2': '0.260', 'AMMO4': '0.281', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.734', 'WEAPON3': '1.100', 'weapon3': '2.176', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '14.592', 'FRAGCOUNT': '46.000'} [2023-02-25 14:36:53,435][36155] DAMAGECOUNT value on done: 1200505.0 [2023-02-25 14:36:53,436][36155] Sum rewards: 62.953, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.360', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.030', 'AMMO4': '0.046', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.221', 'weapon2': '0.494', 'WEAPON3': '1.250', 'HITCOUNT': '3.200', 'weapon3': '3.208', 'DAMAGECOUNT': '16.707', 'FRAGCOUNT': '53.000'} [2023-02-25 14:36:53,555][36157] DAMAGECOUNT value on done: 1213893.0 [2023-02-25 14:36:53,555][36157] Sum rewards: 61.300, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.495', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.090', 'weapon4': '0.134', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.418', 'WEAPON3': '1.300', 'weapon3': '3.154', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.447', 'FRAGCOUNT': '51.000'} [2023-02-25 14:36:53,665][36139] DAMAGECOUNT value on done: 1209525.0 [2023-02-25 14:36:53,665][36139] Sum rewards: 31.425, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.972', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.084', 'AMMO3': '0.184', 'weapon5': '0.258', 'AMMO4': '0.422', 'weapon2': '0.438', 'WEAPON5': '0.550', 'weapon4': '0.826', 'WEAPON4': '0.850', 'WEAPON3': '1.000', 'weapon3': '2.122', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '10.896', 'FRAGCOUNT': '32.000'} [2023-02-25 14:36:53,866][36157] DAMAGECOUNT value on done: 1204303.0 [2023-02-25 14:36:53,867][36157] Sum rewards: 53.936, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.105', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.146', 'weapon2': '0.200', 'AMMO3': '0.303', 'WEAPON3': '1.900', 'weapon3': '3.332', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.744', 'FRAGCOUNT': '50.000'} [2023-02-25 14:36:53,998][36157] DAMAGECOUNT value on done: 1216042.0 [2023-02-25 14:36:53,998][36157] Sum rewards: 65.163, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.420', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.094', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.310', 'weapon4': '0.362', 'WEAPON3': '0.850', 'weapon3': '3.070', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.177', 'FRAGCOUNT': '51.000'} [2023-02-25 14:36:54,309][36157] DAMAGECOUNT value on done: 1209528.0 [2023-02-25 14:36:54,310][36157] Sum rewards: 44.149, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.220', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.042', 'AMMO3': '0.178', 'AMMO4': '0.211', 'weapon5': '0.234', 'WEAPON5': '0.350', 'weapon2': '0.432', 'WEAPON4': '0.500', 'weapon4': '0.692', 'WEAPON3': '1.050', 'weapon3': '2.340', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.633', 'FRAGCOUNT': '38.000'} [2023-02-25 14:36:54,582][36138] Updated weights for policy 0, policy_version 53373 (0.0009) [2023-02-25 14:36:54,647][36140] DAMAGECOUNT value on done: 1210856.0 [2023-02-25 14:36:54,648][36140] Sum rewards: 50.746, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.903', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.052', 'AMMO4': '0.133', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'weapon4': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.450', 'HITCOUNT': '3.000', 'weapon3': '3.110', 'DAMAGECOUNT': '14.241', 'FRAGCOUNT': '46.000'} [2023-02-25 14:36:54,706][36140] DAMAGECOUNT value on done: 1206490.0 [2023-02-25 14:36:54,707][36140] Sum rewards: 56.863, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.470', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.189', 'weapon2': '0.252', 'WEAPON3': '1.200', 'HITCOUNT': '2.750', 'weapon3': '3.590', 'DAMAGECOUNT': '13.116', 'FRAGCOUNT': '49.000'} [2023-02-25 14:36:54,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 218615808. Throughput: 0: 3345.8. Samples: 17145314. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:36:54,730][36114] Avg episode reward: [(0, '56.953')] [2023-02-25 14:36:54,976][36140] DAMAGECOUNT value on done: 1198250.0 [2023-02-25 14:36:54,977][36140] Sum rewards: 51.138, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.857', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.186', 'AMMO3': '0.192', 'AMMO4': '0.195', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.696', 'WEAPON3': '1.200', 'weapon3': '2.520', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '14.550', 'FRAGCOUNT': '44.000'} [2023-02-25 14:36:55,036][36140] DAMAGECOUNT value on done: 1198265.0 [2023-02-25 14:36:55,036][36140] Sum rewards: 57.370, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.602', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon4': '0.310', 'weapon2': '0.378', 'WEAPON3': '1.250', 'HITCOUNT': '2.900', 'weapon3': '2.948', 'DAMAGECOUNT': '14.853', 'FRAGCOUNT': '49.000'} [2023-02-25 14:36:57,495][36142] DAMAGECOUNT value on done: 1204840.0 [2023-02-25 14:36:57,496][36142] Sum rewards: 57.818, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.574', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO4': '0.173', 'AMMO3': '0.188', 'weapon4': '0.206', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '3.120', 'weapon3': '3.140', 'DAMAGECOUNT': '14.469', 'FRAGCOUNT': '51.000'} [2023-02-25 14:36:57,638][36138] Updated weights for policy 0, policy_version 53383 (0.0009) [2023-02-25 14:36:57,804][36142] DAMAGECOUNT value on done: 1194642.0 [2023-02-25 14:36:57,804][36142] Sum rewards: 46.070, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.435', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'AMMO3': '0.207', 'weapon2': '0.264', 'weapon4': '0.314', 'WEAPON3': '1.250', 'HITCOUNT': '2.920', 'weapon3': '3.220', 'DAMAGECOUNT': '12.465', 'FRAGCOUNT': '40.000'} [2023-02-25 14:36:58,366][36142] DAMAGECOUNT value on done: 1205031.0 [2023-02-25 14:36:58,366][36142] Sum rewards: 60.527, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO3': '0.107', 'AMMO4': '0.131', 'weapon5': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.398', 'HEALTH': '0.499', 'WEAPON3': '0.650', 'weapon4': '0.676', 'weapon3': '2.508', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '46.000'} [2023-02-25 14:36:58,678][36142] DAMAGECOUNT value on done: 1215007.0 [2023-02-25 14:36:58,678][36142] Sum rewards: 46.681, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.670', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.122', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon2': '0.420', 'weapon4': '0.710', 'WEAPON3': '1.300', 'weapon3': '2.472', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.282', 'FRAGCOUNT': '42.000'} [2023-02-25 14:36:59,259][36156] DAMAGECOUNT value on done: 1217565.0 [2023-02-25 14:36:59,260][36156] Sum rewards: 52.369, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.755', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'AMMO3': '0.186', 'weapon2': '0.362', 'WEAPON4': '0.400', 'ARMOR': '0.451', 'weapon4': '0.728', 'WEAPON3': '1.150', 'weapon3': '2.598', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.299', 'FRAGCOUNT': '46.000'} [2023-02-25 14:36:59,573][36156] DAMAGECOUNT value on done: 1201021.0 [2023-02-25 14:36:59,574][36156] Sum rewards: 55.127, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.454', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.098', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'weapon2': '0.674', 'WEAPON3': '1.100', 'weapon3': '2.962', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.659', 'FRAGCOUNT': '47.000'} [2023-02-25 14:36:59,586][36156] DAMAGECOUNT value on done: 1211797.0 [2023-02-25 14:36:59,586][36156] Sum rewards: 55.608, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.008', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.092', 'weapon5': '0.160', 'AMMO4': '0.165', 'AMMO3': '0.191', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.528', 'WEAPON3': '1.250', 'weapon3': '2.916', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.771', 'FRAGCOUNT': '48.000'} [2023-02-25 14:36:59,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 218681344. Throughput: 0: 3344.1. Samples: 17165360. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:36:59,730][36114] Avg episode reward: [(0, '56.686')] [2023-02-25 14:36:59,896][36156] DAMAGECOUNT value on done: 1198695.0 [2023-02-25 14:36:59,896][36156] Sum rewards: 56.715, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.428', 'AMMO5': '0.007', 'AMMO2': '0.026', 'WEAPON4': '0.050', 'weapon4': '0.054', 'weapon5': '0.078', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'weapon2': '0.384', 'WEAPON3': '1.000', 'HITCOUNT': '2.900', 'weapon3': '3.318', 'DAMAGECOUNT': '14.385', 'FRAGCOUNT': '45.000'} [2023-02-25 14:37:00,693][36138] Updated weights for policy 0, policy_version 53393 (0.0010) [2023-02-25 14:37:03,762][36138] Updated weights for policy 0, policy_version 53403 (0.0009) [2023-02-25 14:37:04,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 218750976. Throughput: 0: 3344.8. Samples: 17185498. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:37:04,730][36114] Avg episode reward: [(0, '56.670')] [2023-02-25 14:37:06,841][36138] Updated weights for policy 0, policy_version 53413 (0.0009) [2023-02-25 14:37:09,435][36154] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:37:09,621][36141] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('HEALTH', -0.045, -15.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:37:09,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 218816512. Throughput: 0: 3344.4. Samples: 17195496. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:37:09,730][36114] Avg episode reward: [(0, '56.670')] [2023-02-25 14:37:09,918][36138] Updated weights for policy 0, policy_version 53423 (0.0009) [2023-02-25 14:37:09,979][36154] DAMAGECOUNT value on done: 1218764.0 [2023-02-25 14:37:09,979][36154] Sum rewards: 58.429, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.564', 'AMMO5': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.061', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'weapon5': '0.198', 'weapon4': '0.228', 'WEAPON5': '0.250', 'weapon2': '0.646', 'WEAPON3': '0.850', 'weapon3': '2.668', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.469', 'FRAGCOUNT': '47.000'} [2023-02-25 14:37:10,249][36141] DAMAGECOUNT value on done: 1218407.0 [2023-02-25 14:37:10,250][36141] Sum rewards: 54.605, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.282', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.168', 'AMMO4': '0.220', 'weapon4': '0.236', 'AMMO3': '0.246', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.484', 'WEAPON3': '1.400', 'weapon3': '2.768', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.681', 'FRAGCOUNT': '50.500'} [2023-02-25 14:37:10,290][36154] DAMAGECOUNT value on done: 1197145.0 [2023-02-25 14:37:10,290][36154] Sum rewards: 57.366, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.405', 'AMMO5': '0.012', 'AMMO2': '0.054', 'weapon5': '0.164', 'AMMO3': '0.188', 'AMMO4': '0.270', 'weapon4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.534', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.732', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.066', 'FRAGCOUNT': '51.000'} [2023-02-25 14:37:10,551][36141] DAMAGECOUNT value on done: 1205908.0 [2023-02-25 14:37:10,551][36141] Sum rewards: 50.423, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.965', 'AMMO5': '0.008', 'AMMO2': '0.035', 'AMMO3': '0.175', 'AMMO4': '0.177', 'weapon5': '0.188', 'WEAPON5': '0.250', 'weapon4': '0.272', 'WEAPON4': '0.300', 'weapon2': '0.634', 'WEAPON3': '1.050', 'weapon3': '2.520', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.238', 'FRAGCOUNT': '43.000'} [2023-02-25 14:37:10,558][36154] DAMAGECOUNT value on done: 1220091.0 [2023-02-25 14:37:10,558][36154] Sum rewards: 58.521, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.900', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon4': '0.210', 'AMMO3': '0.219', 'weapon5': '0.244', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '2.972', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '51.000'} [2023-02-25 14:37:10,579][36141] DAMAGECOUNT value on done: 1213504.0 [2023-02-25 14:37:10,579][36141] Sum rewards: 62.632, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.961', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon4': '0.028', 'weapon5': '0.036', 'AMMO4': '0.116', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.600', 'WEAPON3': '1.400', 'weapon3': '3.138', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '53.000'} [2023-02-25 14:37:10,852][36141] DAMAGECOUNT value on done: 1198703.0 [2023-02-25 14:37:10,853][36141] Sum rewards: 49.344, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.720', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.042', 'AMMO3': '0.121', 'weapon5': '0.134', 'AMMO4': '0.209', 'WEAPON5': '0.300', 'weapon4': '0.370', 'WEAPON4': '0.500', 'weapon2': '0.784', 'WEAPON3': '0.800', 'weapon3': '2.444', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.624', 'FRAGCOUNT': '42.000'} [2023-02-25 14:37:10,853][36154] DAMAGECOUNT value on done: 1206085.0 [2023-02-25 14:37:10,853][36154] Sum rewards: 50.332, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.370', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.053', 'AMMO3': '0.115', 'AMMO4': '0.267', 'weapon5': '0.316', 'weapon4': '0.378', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon2': '0.744', 'WEAPON3': '0.750', 'weapon3': '2.248', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.758', 'FRAGCOUNT': '42.500'} [2023-02-25 14:37:11,900][36155] DAMAGECOUNT value on done: 1204506.0 [2023-02-25 14:37:11,900][36155] Sum rewards: 50.278, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.315', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO3': '0.137', 'AMMO4': '0.157', 'weapon5': '0.182', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.566', 'WEAPON3': '0.900', 'weapon4': '1.110', 'weapon3': '1.896', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '12.717', 'FRAGCOUNT': '43.000'} [2023-02-25 14:37:12,222][36155] DAMAGECOUNT value on done: 1210256.0 [2023-02-25 14:37:12,223][36155] Sum rewards: 49.888, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.930', 'AMMO5': '0.005', 'AMMO2': '0.043', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.214', 'weapon4': '0.226', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.560', 'WEAPON3': '1.450', 'weapon3': '2.812', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.968', 'FRAGCOUNT': '46.000'} [2023-02-25 14:37:12,819][36139] DAMAGECOUNT value on done: 1207640.0 [2023-02-25 14:37:12,819][36139] Sum rewards: 60.987, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.734', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.124', 'AMMO3': '0.210', 'weapon2': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.412', 'WEAPON3': '1.200', 'weapon3': '2.962', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.177', 'FRAGCOUNT': '52.000'} [2023-02-25 14:37:12,968][36138] Updated weights for policy 0, policy_version 53433 (0.0010) [2023-02-25 14:37:13,124][36139] DAMAGECOUNT value on done: 1205152.0 [2023-02-25 14:37:13,125][36139] Sum rewards: 53.780, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.690', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.169', 'AMMO3': '0.192', 'weapon5': '0.196', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.564', 'weapon4': '0.686', 'WEAPON3': '1.150', 'weapon3': '2.306', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.800', 'FRAGCOUNT': '47.000'} [2023-02-25 14:37:13,139][36155] DAMAGECOUNT value on done: 1224678.0 [2023-02-25 14:37:13,139][36155] Sum rewards: 56.151, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.186', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'weapon4': '0.284', 'weapon2': '0.346', 'WEAPON3': '1.300', 'weapon3': '3.078', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '48.000'} [2023-02-25 14:37:13,310][36139] DAMAGECOUNT value on done: 1220539.0 [2023-02-25 14:37:13,310][36139] Sum rewards: 52.972, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.586', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.029', 'weapon5': '0.104', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'weapon2': '0.526', 'weapon4': '0.600', 'WEAPON3': '0.900', 'weapon3': '2.566', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '11.700', 'FRAGCOUNT': '45.000'} [2023-02-25 14:37:13,468][36155] DAMAGECOUNT value on done: 1205293.0 [2023-02-25 14:37:13,469][36155] Sum rewards: 52.924, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.077', 'AMMO5': '0.012', 'AMMO2': '0.053', 'AMMO3': '0.154', 'weapon5': '0.210', 'AMMO4': '0.263', 'weapon2': '0.318', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'weapon4': '0.800', 'WEAPON3': '1.100', 'weapon3': '2.276', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.124', 'FRAGCOUNT': '47.000'} [2023-02-25 14:37:13,624][36139] DAMAGECOUNT value on done: 1214580.0 [2023-02-25 14:37:13,625][36139] Sum rewards: 63.625, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.302', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.146', 'WEAPON4': '0.250', 'weapon4': '0.478', 'weapon2': '0.722', 'WEAPON3': '1.000', 'weapon3': '2.542', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '15.165', 'FRAGCOUNT': '52.000'} [2023-02-25 14:37:13,843][36157] DAMAGECOUNT value on done: 1219027.0 [2023-02-25 14:37:13,843][36157] Sum rewards: 55.997, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.552', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.136', 'AMMO3': '0.223', 'weapon2': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.464', 'WEAPON3': '1.400', 'weapon3': '2.874', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.372', 'FRAGCOUNT': '49.500'} [2023-02-25 14:37:14,179][36157] DAMAGECOUNT value on done: 1209878.0 [2023-02-25 14:37:14,180][36157] Sum rewards: 70.404, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.060', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.166', 'weapon5': '0.246', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.514', 'WEAPON3': '1.000', 'weapon3': '2.536', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '59.000'} [2023-02-25 14:37:14,310][36157] DAMAGECOUNT value on done: 1221596.0 [2023-02-25 14:37:14,310][36157] Sum rewards: 61.305, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.288', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.100', 'AMMO4': '0.149', 'weapon4': '0.192', 'AMMO3': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.058', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '53.000'} [2023-02-25 14:37:14,608][36157] DAMAGECOUNT value on done: 1214001.0 [2023-02-25 14:37:14,608][36157] Sum rewards: 50.031, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.477', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.060', 'AMMO3': '0.093', 'weapon2': '0.244', 'AMMO4': '0.300', 'weapon5': '0.350', 'WEAPON3': '0.550', 'WEAPON5': '0.600', 'WEAPON4': '0.750', 'weapon4': '1.084', 'weapon3': '1.982', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.419', 'FRAGCOUNT': '42.000'} [2023-02-25 14:37:14,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13371.0). Total num frames: 218882048. Throughput: 0: 3341.8. Samples: 17215458. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:37:14,729][36114] Avg episode reward: [(0, '55.863')] [2023-02-25 14:37:14,790][36140] DAMAGECOUNT value on done: 1215821.0 [2023-02-25 14:37:14,791][36140] Sum rewards: 63.070, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.835', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.155', 'weapon2': '0.456', 'weapon4': '0.474', 'WEAPON3': '0.950', 'weapon3': '2.878', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.670', 'FRAGCOUNT': '52.000'} [2023-02-25 14:37:14,845][36140] DAMAGECOUNT value on done: 1211660.0 [2023-02-25 14:37:14,845][36140] Sum rewards: 63.147, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.980', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO3': '0.201', 'weapon2': '0.306', 'WEAPON3': '1.200', 'HITCOUNT': '3.370', 'weapon3': '3.532', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '52.000'} [2023-02-25 14:37:15,103][36140] DAMAGECOUNT value on done: 1202856.0 [2023-02-25 14:37:15,104][36140] Sum rewards: 59.536, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.418', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO3': '0.127', 'weapon5': '0.148', 'AMMO4': '0.159', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.422', 'weapon2': '0.730', 'WEAPON3': '0.800', 'weapon3': '2.508', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.818', 'FRAGCOUNT': '49.000'} [2023-02-25 14:37:15,151][36140] DAMAGECOUNT value on done: 1203670.0 [2023-02-25 14:37:15,152][36140] Sum rewards: 63.814, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.927', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.136', 'weapon5': '0.190', 'AMMO3': '0.205', 'AMMO4': '0.207', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.538', 'WEAPON3': '1.200', 'weapon3': '2.884', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '53.000'} [2023-02-25 14:37:16,020][36138] Updated weights for policy 0, policy_version 53443 (0.0009) [2023-02-25 14:37:17,552][36142] DAMAGECOUNT value on done: 1209443.0 [2023-02-25 14:37:17,552][36142] Sum rewards: 54.793, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.920', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon5': '0.148', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.354', 'weapon4': '0.506', 'WEAPON3': '1.100', 'weapon3': '2.772', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.809', 'FRAGCOUNT': '46.000'} [2023-02-25 14:37:17,876][36142] DAMAGECOUNT value on done: 1199206.0 [2023-02-25 14:37:17,876][36142] Sum rewards: 47.121, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.658', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.037', 'weapon5': '0.086', 'AMMO4': '0.187', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'weapon2': '0.292', 'WEAPON4': '0.450', 'weapon4': '0.490', 'ARMOR': '0.504', 'WEAPON3': '1.150', 'weapon3': '2.752', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.692', 'FRAGCOUNT': '41.000'} [2023-02-25 14:37:18,456][36142] DAMAGECOUNT value on done: 1209623.0 [2023-02-25 14:37:18,457][36142] Sum rewards: 51.063, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.172', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.116', 'AMMO3': '0.141', 'WEAPON5': '0.200', 'AMMO4': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.602', 'weapon4': '0.646', 'WEAPON3': '0.950', 'weapon3': '2.386', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.776', 'FRAGCOUNT': '42.000'} [2023-02-25 14:37:18,754][36142] DAMAGECOUNT value on done: 1219220.0 [2023-02-25 14:37:18,754][36142] Sum rewards: 43.536, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.922', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.090', 'AMMO3': '0.166', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.484', 'weapon2': '0.716', 'WEAPON3': '1.100', 'weapon3': '2.230', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.639', 'FRAGCOUNT': '36.500'} [2023-02-25 14:37:19,070][36138] Updated weights for policy 0, policy_version 53453 (0.0009) [2023-02-25 14:37:19,392][36156] DAMAGECOUNT value on done: 1222460.0 [2023-02-25 14:37:19,392][36156] Sum rewards: 53.286, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.274', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO4': '0.199', 'weapon5': '0.218', 'AMMO3': '0.221', 'weapon4': '0.290', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.680', 'weapon3': '2.900', 'DAMAGECOUNT': '14.667', 'FRAGCOUNT': '47.500'} [2023-02-25 14:37:19,708][36156] DAMAGECOUNT value on done: 1205726.0 [2023-02-25 14:37:19,708][36156] Sum rewards: 58.778, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.950', 'AMMO2': '0.036', 'AMMO4': '0.181', 'AMMO3': '0.197', 'weapon2': '0.228', 'WEAPON4': '0.300', 'weapon4': '0.372', 'WEAPON3': '1.150', 'weapon3': '3.128', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.115', 'FRAGCOUNT': '52.000'} [2023-02-25 14:37:19,721][36156] DAMAGECOUNT value on done: 1217343.0 [2023-02-25 14:37:19,721][36156] Sum rewards: 63.335, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.711', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.130', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'weapon4': '0.170', 'weapon2': '0.182', 'AMMO3': '0.255', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.220', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '58.000'} [2023-02-25 14:37:19,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.2, 300 sec: 13384.9). Total num frames: 218951680. Throughput: 0: 3345.4. Samples: 17235664. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:37:19,730][36114] Avg episode reward: [(0, '55.852')] [2023-02-25 14:37:19,734][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000053455_218951680.pth... [2023-02-25 14:37:19,787][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000052671_215740416.pth [2023-02-25 14:37:20,065][36156] DAMAGECOUNT value on done: 1203705.0 [2023-02-25 14:37:20,065][36156] Sum rewards: 58.022, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.876', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.038', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'AMMO4': '0.189', 'WEAPON4': '0.350', 'weapon4': '0.458', 'weapon2': '0.776', 'WEAPON3': '1.200', 'weapon3': '2.430', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.030', 'FRAGCOUNT': '51.000'} [2023-02-25 14:37:22,124][36138] Updated weights for policy 0, policy_version 53463 (0.0009) [2023-02-25 14:37:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 219017216. Throughput: 0: 3344.6. Samples: 17245690. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:37:24,730][36114] Avg episode reward: [(0, '55.932')] [2023-02-25 14:37:25,144][36138] Updated weights for policy 0, policy_version 53473 (0.0009) [2023-02-25 14:37:28,241][36138] Updated weights for policy 0, policy_version 53483 (0.0009) [2023-02-25 14:37:29,729][36114] Fps is (10 sec: 13517.0, 60 sec: 13448.6, 300 sec: 13398.8). Total num frames: 219086848. Throughput: 0: 3346.5. Samples: 17265832. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-25 14:37:29,730][36114] Avg episode reward: [(0, '55.932')] [2023-02-25 14:37:29,952][36154] DAMAGECOUNT value on done: 1223195.0 [2023-02-25 14:37:29,952][36154] Sum rewards: 50.813, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.600', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.138', 'AMMO3': '0.153', 'AMMO4': '0.160', 'WEAPON5': '0.250', 'weapon4': '0.298', 'WEAPON4': '0.350', 'weapon2': '0.718', 'WEAPON3': '0.900', 'HITCOUNT': '2.510', 'weapon3': '2.604', 'DAMAGECOUNT': '13.293', 'FRAGCOUNT': '43.000'} [2023-02-25 14:37:30,256][36154] DAMAGECOUNT value on done: 1201605.0 [2023-02-25 14:37:30,256][36154] Sum rewards: 48.139, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.982', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.164', 'weapon5': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.356', 'weapon2': '0.370', 'WEAPON3': '1.050', 'HITCOUNT': '2.440', 'weapon3': '2.700', 'DAMAGECOUNT': '13.380', 'FRAGCOUNT': '42.000'} [2023-02-25 14:37:30,379][36141] DAMAGECOUNT value on done: 1222265.0 [2023-02-25 14:37:30,380][36141] Sum rewards: 48.637, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.136', 'AMMO2': '0.005', 'AMMO5': '0.013', 'weapon4': '0.014', 'AMMO4': '0.026', 'weapon5': '0.028', 'WEAPON4': '0.100', 'AMMO3': '0.159', 'WEAPON5': '0.250', 'weapon2': '0.764', 'WEAPON3': '0.950', 'HITCOUNT': '2.640', 'weapon3': '3.000', 'DAMAGECOUNT': '11.574', 'FRAGCOUNT': '41.000'} [2023-02-25 14:37:30,549][36154] DAMAGECOUNT value on done: 1224762.0 [2023-02-25 14:37:30,549][36154] Sum rewards: 51.528, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.267', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.088', 'AMMO4': '0.138', 'WEAPON5': '0.200', 'weapon4': '0.208', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.350', 'HITCOUNT': '2.830', 'weapon3': '3.044', 'DAMAGECOUNT': '14.013', 'FRAGCOUNT': '46.000'} [2023-02-25 14:37:30,662][36141] DAMAGECOUNT value on done: 1211234.0 [2023-02-25 14:37:30,662][36141] Sum rewards: 59.717, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.409', 'AMMO5': '0.009', 'weapon5': '0.028', 'AMMO2': '0.040', 'AMMO4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'weapon2': '0.334', 'weapon4': '0.404', 'WEAPON3': '1.500', 'weapon3': '2.978', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '53.000'} [2023-02-25 14:37:30,690][36141] DAMAGECOUNT value on done: 1218396.0 [2023-02-25 14:37:30,690][36141] Sum rewards: 59.387, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.530', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon2': '0.152', 'weapon5': '0.174', 'AMMO3': '0.177', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.738', 'WEAPON3': '1.150', 'weapon3': '2.676', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '51.000'} [2023-02-25 14:37:30,861][36154] DAMAGECOUNT value on done: 1211500.0 [2023-02-25 14:37:30,862][36154] Sum rewards: 69.800, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.726', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'weapon2': '0.370', 'weapon4': '0.740', 'WEAPON3': '1.200', 'weapon3': '2.470', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '58.000'} [2023-02-25 14:37:30,986][36141] DAMAGECOUNT value on done: 1203453.0 [2023-02-25 14:37:30,987][36141] Sum rewards: 52.501, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.902', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon5': '0.056', 'AMMO4': '0.100', 'weapon4': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.249', 'WEAPON5': '0.250', 'weapon2': '0.428', 'WEAPON3': '1.400', 'HITCOUNT': '2.970', 'weapon3': '3.122', 'DAMAGECOUNT': '13.914', 'FRAGCOUNT': '48.000'} [2023-02-25 14:37:31,297][36138] Updated weights for policy 0, policy_version 53493 (0.0009) [2023-02-25 14:37:31,967][36155] DAMAGECOUNT value on done: 1209203.0 [2023-02-25 14:37:31,967][36155] Sum rewards: 52.915, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.660', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.086', 'AMMO4': '0.164', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'weapon2': '0.260', 'weapon4': '0.262', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.990', 'weapon3': '3.108', 'DAMAGECOUNT': '14.076', 'FRAGCOUNT': '46.000'} [2023-02-25 14:37:32,278][36155] DAMAGECOUNT value on done: 1215952.0 [2023-02-25 14:37:32,279][36155] Sum rewards: 61.848, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.039', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.156', 'AMMO3': '0.161', 'AMMO4': '0.197', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON4': '0.350', 'weapon4': '0.430', 'WEAPON3': '1.050', 'weapon3': '2.822', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '51.000'} [2023-02-25 14:37:32,665][36139] DAMAGECOUNT value on done: 1212865.0 [2023-02-25 14:37:32,666][36139] Sum rewards: 62.159, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.935', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.150', 'AMMO4': '0.158', 'weapon4': '0.158', 'AMMO3': '0.203', 'weapon2': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '2.940', 'weapon3': '3.256', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '53.000'} [2023-02-25 14:37:32,985][36139] DAMAGECOUNT value on done: 1210223.0 [2023-02-25 14:37:32,985][36139] Sum rewards: 61.408, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.081', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.052', 'weapon4': '0.064', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.157', 'weapon2': '0.672', 'WEAPON3': '1.100', 'weapon3': '3.098', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.213', 'FRAGCOUNT': '50.000'} [2023-02-25 14:37:33,122][36155] DAMAGECOUNT value on done: 1229878.0 [2023-02-25 14:37:33,123][36155] Sum rewards: 60.303, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.460', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.058', 'weapon4': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.248', 'weapon2': '0.410', 'WEAPON3': '1.450', 'HITCOUNT': '3.090', 'weapon3': '3.222', 'DAMAGECOUNT': '15.600', 'FRAGCOUNT': '53.000'} [2023-02-25 14:37:33,170][36139] DAMAGECOUNT value on done: 1225526.0 [2023-02-25 14:37:33,171][36139] Sum rewards: 56.638, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.617', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon4': '0.232', 'weapon2': '0.506', 'WEAPON3': '1.450', 'HITCOUNT': '2.830', 'weapon3': '2.954', 'DAMAGECOUNT': '14.961', 'FRAGCOUNT': '50.000'} [2023-02-25 14:37:33,427][36155] DAMAGECOUNT value on done: 1209937.0 [2023-02-25 14:37:33,428][36155] Sum rewards: 47.908, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.698', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.048', 'AMMO4': '0.065', 'weapon4': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.249', 'weapon2': '0.290', 'WEAPON3': '1.550', 'HITCOUNT': '3.200', 'weapon3': '3.354', 'DAMAGECOUNT': '13.932', 'FRAGCOUNT': '42.500'} [2023-02-25 14:37:33,471][36139] DAMAGECOUNT value on done: 1219331.0 [2023-02-25 14:37:33,471][36139] Sum rewards: 53.168, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.970', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon5': '0.112', 'weapon2': '0.150', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'AMMO4': '0.204', 'WEAPON4': '0.350', 'weapon4': '0.982', 'WEAPON3': '1.050', 'weapon3': '2.596', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.253', 'FRAGCOUNT': '44.500'} [2023-02-25 14:37:33,968][36157] DAMAGECOUNT value on done: 1224214.0 [2023-02-25 14:37:33,969][36157] Sum rewards: 60.581, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.300', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.052', 'AMMO4': '0.062', 'WEAPON5': '0.150', 'weapon2': '0.170', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.344', 'WEAPON3': '1.400', 'weapon3': '3.072', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '15.561', 'FRAGCOUNT': '54.000'} [2023-02-25 14:37:34,284][36157] DAMAGECOUNT value on done: 1214525.0 [2023-02-25 14:37:34,285][36157] Sum rewards: 51.618, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.293', 'AMMO5': '0.014', 'AMMO2': '0.057', 'weapon5': '0.102', 'AMMO3': '0.162', 'AMMO4': '0.283', 'WEAPON5': '0.350', 'weapon2': '0.420', 'WEAPON4': '0.550', 'weapon4': '0.746', 'WEAPON3': '0.950', 'weapon3': '2.396', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.941', 'FRAGCOUNT': '45.000'} [2023-02-25 14:37:34,352][36138] Updated weights for policy 0, policy_version 53503 (0.0009) [2023-02-25 14:37:34,361][36157] DAMAGECOUNT value on done: 1226113.0 [2023-02-25 14:37:34,362][36157] Sum rewards: 55.618, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.749', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO3': '0.119', 'AMMO4': '0.162', 'weapon5': '0.174', 'weapon4': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.432', 'WEAPON3': '0.900', 'weapon3': '2.860', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.551', 'FRAGCOUNT': '45.000'} [2023-02-25 14:37:34,666][36157] DAMAGECOUNT value on done: 1219539.0 [2023-02-25 14:37:34,667][36157] Sum rewards: 65.147, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.990', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.116', 'AMMO4': '0.154', 'AMMO3': '0.215', 'weapon2': '0.244', 'weapon4': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.040', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '56.500'} [2023-02-25 14:37:34,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 219152384. Throughput: 0: 3344.0. Samples: 17285784. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-25 14:37:34,730][36114] Avg episode reward: [(0, '55.420')] [2023-02-25 14:37:34,915][36140] DAMAGECOUNT value on done: 1221634.0 [2023-02-25 14:37:34,915][36140] Sum rewards: 68.042, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.164', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.067', 'AMMO3': '0.150', 'weapon5': '0.270', 'AMMO4': '0.335', 'weapon2': '0.346', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.580', 'WEAPON3': '1.000', 'weapon3': '2.462', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '56.000'} [2023-02-25 14:37:34,967][36140] DAMAGECOUNT value on done: 1215870.0 [2023-02-25 14:37:34,968][36140] Sum rewards: 50.180, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.802', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.009', 'weapon5': '0.044', 'AMMO4': '0.046', 'weapon7': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.140', 'WEAPON7': '0.200', 'weapon4': '0.264', 'weapon2': '0.872', 'WEAPON3': '1.000', 'weapon3': '2.552', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.630', 'FRAGCOUNT': '40.000'} [2023-02-25 14:37:35,245][36140] DAMAGECOUNT value on done: 1208077.0 [2023-02-25 14:37:35,245][36140] Sum rewards: 56.015, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.368', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon5': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'weapon4': '0.298', 'weapon2': '0.672', 'WEAPON3': '1.150', 'weapon3': '2.674', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.663', 'FRAGCOUNT': '45.500'} [2023-02-25 14:37:35,283][36140] DAMAGECOUNT value on done: 1208273.0 [2023-02-25 14:37:35,283][36140] Sum rewards: 53.602, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.150', 'AMMO5': '0.003', 'AMMO2': '0.021', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'weapon2': '0.276', 'AMMO3': '0.295', 'weapon4': '0.496', 'WEAPON3': '1.800', 'weapon3': '3.016', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '13.809', 'FRAGCOUNT': '51.000'} [2023-02-25 14:37:37,397][36138] Updated weights for policy 0, policy_version 53513 (0.0010) [2023-02-25 14:37:37,427][36155] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:37:37,655][36142] DAMAGECOUNT value on done: 1214731.0 [2023-02-25 14:37:37,655][36142] Sum rewards: 58.603, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.740', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.100', 'weapon4': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.244', 'weapon2': '0.274', 'WEAPON3': '1.500', 'weapon3': '3.212', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.864', 'FRAGCOUNT': '52.000'} [2023-02-25 14:37:37,968][36142] DAMAGECOUNT value on done: 1204363.0 [2023-02-25 14:37:37,969][36142] Sum rewards: 55.371, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.828', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.036', 'AMMO3': '0.149', 'AMMO4': '0.179', 'weapon5': '0.236', 'weapon2': '0.370', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.536', 'WEAPON3': '0.900', 'weapon3': '2.572', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.471', 'FRAGCOUNT': '46.000'} [2023-02-25 14:37:38,544][36142] DAMAGECOUNT value on done: 1215452.0 [2023-02-25 14:37:38,544][36142] Sum rewards: 67.476, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.533', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.146', 'weapon5': '0.152', 'WEAPON4': '0.250', 'weapon4': '0.278', 'WEAPON5': '0.300', 'weapon2': '0.394', 'WEAPON3': '1.050', 'weapon3': '2.896', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '54.000'} [2023-02-25 14:37:38,854][36142] DAMAGECOUNT value on done: 1223902.0 [2023-02-25 14:37:38,854][36142] Sum rewards: 43.396, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.412', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.051', 'AMMO3': '0.238', 'AMMO4': '0.256', 'weapon5': '0.318', 'weapon4': '0.420', 'WEAPON5': '0.450', 'weapon2': '0.464', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.452', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '14.046', 'FRAGCOUNT': '41.500'} [2023-02-25 14:37:39,448][36156] DAMAGECOUNT value on done: 1227498.0 [2023-02-25 14:37:39,448][36156] Sum rewards: 56.600, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.610', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.144', 'AMMO3': '0.183', 'AMMO4': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.424', 'weapon4': '0.430', 'WEAPON3': '1.100', 'weapon3': '2.734', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.114', 'FRAGCOUNT': '47.000'} [2023-02-25 14:37:39,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 219217920. Throughput: 0: 3345.9. Samples: 17295878. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-25 14:37:39,730][36114] Avg episode reward: [(0, '55.450')] [2023-02-25 14:37:39,760][36156] DAMAGECOUNT value on done: 1210772.0 [2023-02-25 14:37:39,760][36156] Sum rewards: 58.515, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.952', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.052', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'WEAPON4': '0.250', 'weapon2': '0.336', 'weapon4': '0.662', 'WEAPON3': '1.150', 'weapon3': '2.720', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.138', 'FRAGCOUNT': '49.000'} [2023-02-25 14:37:39,774][36156] DAMAGECOUNT value on done: 1221926.0 [2023-02-25 14:37:39,775][36156] Sum rewards: 54.273, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.389', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.026', 'AMMO3': '0.124', 'AMMO4': '0.128', 'weapon5': '0.148', 'WEAPON5': '0.150', 'weapon4': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.310', 'WEAPON3': '0.850', 'HITCOUNT': '3.060', 'weapon3': '3.122', 'DAMAGECOUNT': '13.749', 'FRAGCOUNT': '44.000'} [2023-02-25 14:37:40,060][36156] DAMAGECOUNT value on done: 1209070.0 [2023-02-25 14:37:40,060][36156] Sum rewards: 57.204, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.454', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.088', 'weapon4': '0.116', 'weapon2': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'WEAPON3': '1.500', 'HITCOUNT': '3.330', 'weapon3': '3.378', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '50.000'} [2023-02-25 14:37:40,444][36138] Updated weights for policy 0, policy_version 53523 (0.0010) [2023-02-25 14:37:43,508][36138] Updated weights for policy 0, policy_version 53533 (0.0009) [2023-02-25 14:37:44,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13371.0). Total num frames: 219283456. Throughput: 0: 3348.7. Samples: 17316050. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-25 14:37:44,730][36114] Avg episode reward: [(0, '55.442')] [2023-02-25 14:37:46,591][36138] Updated weights for policy 0, policy_version 53543 (0.0010) [2023-02-25 14:37:49,701][36138] Updated weights for policy 0, policy_version 53553 (0.0009) [2023-02-25 14:37:49,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 219353088. Throughput: 0: 3342.5. Samples: 17335910. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-25 14:37:49,730][36114] Avg episode reward: [(0, '55.442')] [2023-02-25 14:37:50,121][36154] DAMAGECOUNT value on done: 1227821.0 [2023-02-25 14:37:50,121][36154] Sum rewards: 52.446, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.100', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.112', 'weapon5': '0.158', 'AMMO3': '0.178', 'AMMO4': '0.217', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.778', 'WEAPON3': '1.100', 'weapon3': '2.662', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.878', 'FRAGCOUNT': '46.000'} [2023-02-25 14:37:50,438][36154] DAMAGECOUNT value on done: 1206016.0 [2023-02-25 14:37:50,438][36154] Sum rewards: 50.374, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.030', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.062', 'weapon5': '0.200', 'AMMO3': '0.213', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.422', 'weapon2': '0.496', 'WEAPON3': '1.300', 'weapon3': '2.406', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.233', 'FRAGCOUNT': '45.000'} [2023-02-25 14:37:50,518][36141] DAMAGECOUNT value on done: 1226922.0 [2023-02-25 14:37:50,518][36141] Sum rewards: 55.519, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.175', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon4': '0.018', 'AMMO4': '0.032', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.182', 'weapon2': '0.868', 'WEAPON3': '1.150', 'weapon3': '2.948', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '13.971', 'FRAGCOUNT': '47.000'} [2023-02-25 14:37:50,729][36154] DAMAGECOUNT value on done: 1229317.0 [2023-02-25 14:37:50,729][36154] Sum rewards: 54.834, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.310', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.074', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon4': '0.364', 'weapon2': '0.466', 'WEAPON3': '1.150', 'weapon3': '2.810', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.665', 'FRAGCOUNT': '46.000'} [2023-02-25 14:37:50,803][36141] DAMAGECOUNT value on done: 1216107.0 [2023-02-25 14:37:50,803][36141] Sum rewards: 54.950, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.530', 'AMMO5': '0.003', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.143', 'AMMO3': '0.171', 'WEAPON4': '0.300', 'weapon2': '0.374', 'weapon4': '0.602', 'WEAPON3': '1.100', 'weapon3': '2.602', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.619', 'FRAGCOUNT': '47.000'} [2023-02-25 14:37:50,833][36141] DAMAGECOUNT value on done: 1223148.0 [2023-02-25 14:37:50,833][36141] Sum rewards: 52.968, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.345', 'ARMOR': '0.012', 'AMMO5': '0.021', 'AMMO2': '0.051', 'weapon5': '0.128', 'AMMO3': '0.194', 'AMMO4': '0.253', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.504', 'weapon4': '0.526', 'WEAPON3': '1.200', 'weapon3': '2.528', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.256', 'FRAGCOUNT': '47.500'} [2023-02-25 14:37:51,041][36154] DAMAGECOUNT value on done: 1216404.0 [2023-02-25 14:37:51,042][36154] Sum rewards: 59.044, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.702', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.184', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'weapon4': '0.508', 'weapon2': '0.620', 'WEAPON3': '1.400', 'weapon3': '2.474', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.712', 'FRAGCOUNT': '53.000'} [2023-02-25 14:37:51,130][36141] DAMAGECOUNT value on done: 1208380.0 [2023-02-25 14:37:51,131][36141] Sum rewards: 59.886, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.885', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.109', 'weapon4': '0.154', 'AMMO3': '0.219', 'weapon2': '0.302', 'WEAPON3': '1.350', 'HITCOUNT': '3.190', 'weapon3': '3.242', 'DAMAGECOUNT': '14.781', 'FRAGCOUNT': '51.000'} [2023-02-25 14:37:52,164][36155] DAMAGECOUNT value on done: 1214112.0 [2023-02-25 14:37:52,164][36155] Sum rewards: 57.089, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.189', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon5': '0.100', 'AMMO3': '0.134', 'AMMO4': '0.214', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.566', 'weapon2': '0.712', 'WEAPON3': '0.900', 'weapon3': '2.240', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.727', 'FRAGCOUNT': '48.000'} [2023-02-25 14:37:52,473][36155] DAMAGECOUNT value on done: 1220989.0 [2023-02-25 14:37:52,473][36155] Sum rewards: 58.501, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.550', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon4': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.252', 'weapon2': '0.326', 'WEAPON3': '1.450', 'HITCOUNT': '3.130', 'weapon3': '3.328', 'DAMAGECOUNT': '15.111', 'FRAGCOUNT': '51.000'} [2023-02-25 14:37:52,711][36139] DAMAGECOUNT value on done: 1217396.0 [2023-02-25 14:37:52,711][36139] Sum rewards: 54.228, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.632', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'weapon5': '0.130', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'weapon2': '0.286', 'weapon4': '0.524', 'WEAPON3': '1.100', 'weapon3': '2.792', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.593', 'FRAGCOUNT': '46.000'} [2023-02-25 14:37:52,792][36138] Updated weights for policy 0, policy_version 53563 (0.0009) [2023-02-25 14:37:53,020][36139] DAMAGECOUNT value on done: 1214280.0 [2023-02-25 14:37:53,021][36139] Sum rewards: 38.554, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.620', 'AMMO5': '0.013', 'AMMO2': '0.060', 'weapon5': '0.120', 'AMMO3': '0.217', 'AMMO4': '0.299', 'weapon2': '0.376', 'WEAPON5': '0.400', 'ARMOR': '0.457', 'weapon4': '0.798', 'WEAPON4': '0.800', 'WEAPON3': '1.300', 'weapon3': '2.308', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '12.105', 'FRAGCOUNT': '37.000'} [2023-02-25 14:37:53,294][36155] DAMAGECOUNT value on done: 1235293.0 [2023-02-25 14:37:53,295][36155] Sum rewards: 70.573, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.720', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.067', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon2': '0.276', 'weapon4': '0.712', 'WEAPON3': '1.100', 'weapon3': '2.498', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '59.000'} [2023-02-25 14:37:53,317][36139] DAMAGECOUNT value on done: 1230118.0 [2023-02-25 14:37:53,317][36139] Sum rewards: 51.628, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.820', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.155', 'AMMO3': '0.239', 'WEAPON4': '0.350', 'weapon2': '0.372', 'weapon4': '0.528', 'WEAPON3': '1.450', 'weapon3': '2.800', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.776', 'FRAGCOUNT': '48.000'} [2023-02-25 14:37:53,595][36155] DAMAGECOUNT value on done: 1215848.0 [2023-02-25 14:37:53,595][36155] Sum rewards: 58.084, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-1.972', 'ARMOR': '0.008', 'AMMO5': '0.027', 'AMMO2': '0.051', 'weapon5': '0.226', 'AMMO3': '0.243', 'AMMO4': '0.254', 'weapon4': '0.326', 'weapon2': '0.332', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.736', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '51.500'} [2023-02-25 14:37:53,627][36139] DAMAGECOUNT value on done: 1225046.0 [2023-02-25 14:37:53,627][36139] Sum rewards: 67.721, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.706', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon5': '0.072', 'AMMO4': '0.087', 'weapon4': '0.144', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.330', 'WEAPON3': '1.250', 'weapon3': '3.292', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '56.000'} [2023-02-25 14:37:54,195][36157] DAMAGECOUNT value on done: 1228999.0 [2023-02-25 14:37:54,196][36157] Sum rewards: 53.050, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.255', 'AMMO2': '0.010', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'weapon4': '0.188', 'weapon2': '0.264', 'AMMO3': '0.306', 'WEAPON3': '1.850', 'HITCOUNT': '3.100', 'weapon3': '3.330', 'DAMAGECOUNT': '14.355', 'FRAGCOUNT': '51.000'} [2023-02-25 14:37:54,511][36157] DAMAGECOUNT value on done: 1219829.0 [2023-02-25 14:37:54,511][36157] Sum rewards: 67.060, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.240', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.049', 'AMMO3': '0.165', 'weapon5': '0.200', 'AMMO4': '0.247', 'weapon2': '0.338', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.644', 'WEAPON3': '1.000', 'weapon3': '2.506', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.912', 'FRAGCOUNT': '58.000'} [2023-02-25 14:37:54,570][36157] DAMAGECOUNT value on done: 1230918.0 [2023-02-25 14:37:54,570][36157] Sum rewards: 54.929, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.089', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.122', 'AMMO4': '0.130', 'AMMO3': '0.137', 'WEAPON5': '0.250', 'weapon4': '0.334', 'WEAPON4': '0.350', 'weapon2': '0.504', 'WEAPON3': '0.900', 'weapon3': '2.838', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.415', 'FRAGCOUNT': '45.000'} [2023-02-25 14:37:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 219418624. Throughput: 0: 3341.2. Samples: 17345848. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-25 14:37:54,730][36114] Avg episode reward: [(0, '55.831')] [2023-02-25 14:37:54,869][36157] DAMAGECOUNT value on done: 1224553.0 [2023-02-25 14:37:54,869][36157] Sum rewards: 56.092, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.093', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.148', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'weapon4': '0.270', 'WEAPON4': '0.300', 'weapon2': '0.690', 'WEAPON3': '1.100', 'weapon3': '2.674', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.042', 'FRAGCOUNT': '47.000'} [2023-02-25 14:37:55,032][36140] DAMAGECOUNT value on done: 1227061.0 [2023-02-25 14:37:55,033][36140] Sum rewards: 62.138, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.636', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'weapon5': '0.116', 'WEAPON4': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.173', 'weapon4': '0.214', 'weapon2': '0.232', 'WEAPON3': '1.050', 'HITCOUNT': '3.230', 'weapon3': '3.270', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '50.500'} [2023-02-25 14:37:55,062][36140] DAMAGECOUNT value on done: 1220503.0 [2023-02-25 14:37:55,063][36140] Sum rewards: 50.460, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.495', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.036', 'weapon5': '0.100', 'AMMO4': '0.181', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.266', 'weapon4': '0.288', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '2.970', 'weapon3': '3.134', 'DAMAGECOUNT': '13.899', 'FRAGCOUNT': '45.000'} [2023-02-25 14:37:55,341][36140] DAMAGECOUNT value on done: 1212511.0 [2023-02-25 14:37:55,341][36140] Sum rewards: 44.565, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.460', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.046', 'AMMO3': '0.203', 'AMMO4': '0.228', 'weapon5': '0.294', 'weapon2': '0.416', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.764', 'WEAPON3': '1.200', 'weapon3': '2.216', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.302', 'FRAGCOUNT': '41.000'} [2023-02-25 14:37:55,371][36140] DAMAGECOUNT value on done: 1213890.0 [2023-02-25 14:37:55,371][36140] Sum rewards: 64.237, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.408', 'AMMO5': '0.011', 'AMMO2': '0.035', 'AMMO4': '0.177', 'weapon5': '0.180', 'AMMO3': '0.202', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.386', 'WEAPON3': '1.200', 'weapon3': '2.828', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '16.851', 'FRAGCOUNT': '55.000'} [2023-02-25 14:37:55,812][36138] Updated weights for policy 0, policy_version 53573 (0.0009) [2023-02-25 14:37:57,863][36142] DAMAGECOUNT value on done: 1219376.0 [2023-02-25 14:37:57,863][36142] Sum rewards: 51.295, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.050', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'weapon5': '0.258', 'weapon2': '0.326', 'weapon4': '0.558', 'WEAPON3': '1.350', 'weapon3': '2.430', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.935', 'FRAGCOUNT': '46.000'} [2023-02-25 14:37:58,179][36142] DAMAGECOUNT value on done: 1209648.0 [2023-02-25 14:37:58,179][36142] Sum rewards: 69.195, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.080', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'weapon2': '0.310', 'weapon4': '0.722', 'WEAPON3': '1.350', 'weapon3': '2.514', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '59.000'} [2023-02-25 14:37:58,760][36142] DAMAGECOUNT value on done: 1221203.0 [2023-02-25 14:37:58,761][36142] Sum rewards: 65.071, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.792', 'AMMO5': '0.022', 'AMMO2': '0.044', 'AMMO3': '0.161', 'AMMO4': '0.220', 'weapon5': '0.304', 'weapon2': '0.310', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.710', 'WEAPON3': '0.900', 'weapon3': '2.378', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '53.000'} [2023-02-25 14:37:58,896][36138] Updated weights for policy 0, policy_version 53583 (0.0008) [2023-02-25 14:37:59,065][36142] DAMAGECOUNT value on done: 1227418.0 [2023-02-25 14:37:59,066][36142] Sum rewards: 38.653, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.900', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.057', 'weapon5': '0.146', 'AMMO3': '0.152', 'WEAPON5': '0.250', 'AMMO4': '0.285', 'WEAPON4': '0.500', 'weapon4': '0.752', 'weapon2': '0.812', 'WEAPON3': '0.900', 'weapon3': '1.834', 'HITCOUNT': '2.100', 'DAMAGECOUNT': '10.251', 'FRAGCOUNT': '36.000'} [2023-02-25 14:37:59,547][36142] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:37:59,637][36156] DAMAGECOUNT value on done: 1232835.0 [2023-02-25 14:37:59,637][36156] Sum rewards: 56.883, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.425', 'AMMO5': '0.017', 'AMMO2': '0.047', 'AMMO3': '0.217', 'AMMO4': '0.237', 'weapon5': '0.280', 'weapon4': '0.318', 'weapon2': '0.322', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.728', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '16.011', 'FRAGCOUNT': '52.000'} [2023-02-25 14:37:59,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13371.0). Total num frames: 219484160. Throughput: 0: 3343.1. Samples: 17365896. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-25 14:37:59,730][36114] Avg episode reward: [(0, '56.117')] [2023-02-25 14:37:59,948][36156] DAMAGECOUNT value on done: 1215456.0 [2023-02-25 14:37:59,948][36156] Sum rewards: 57.254, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.550', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.057', 'weapon5': '0.082', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.274', 'weapon4': '0.432', 'WEAPON3': '1.250', 'weapon3': '2.968', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.052', 'FRAGCOUNT': '50.000'} [2023-02-25 14:37:59,962][36156] DAMAGECOUNT value on done: 1226512.0 [2023-02-25 14:37:59,962][36156] Sum rewards: 52.174, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.890', 'AMMO5': '0.019', 'AMMO2': '0.036', 'weapon5': '0.140', 'AMMO3': '0.149', 'AMMO4': '0.181', 'weapon4': '0.378', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.846', 'WEAPON3': '0.900', 'weapon3': '2.406', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.758', 'FRAGCOUNT': '45.000'} [2023-02-25 14:38:00,278][36156] DAMAGECOUNT value on done: 1214133.0 [2023-02-25 14:38:00,279][36156] Sum rewards: 65.951, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.100', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.254', 'weapon2': '0.452', 'WEAPON3': '1.500', 'HITCOUNT': '3.190', 'weapon3': '3.336', 'DAMAGECOUNT': '15.189', 'FRAGCOUNT': '59.000'} [2023-02-25 14:38:01,934][36138] Updated weights for policy 0, policy_version 53593 (0.0009) [2023-02-25 14:38:04,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 219553792. Throughput: 0: 3341.0. Samples: 17386008. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:38:04,729][36114] Avg episode reward: [(0, '56.338')] [2023-02-25 14:38:04,984][36138] Updated weights for policy 0, policy_version 53603 (0.0009) [2023-02-25 14:38:08,053][36138] Updated weights for policy 0, policy_version 53613 (0.0009) [2023-02-25 14:38:09,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13371.0). Total num frames: 219619328. Throughput: 0: 3340.9. Samples: 17396032. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:38:09,730][36114] Avg episode reward: [(0, '56.338')] [2023-02-25 14:38:10,313][36154] DAMAGECOUNT value on done: 1232347.0 [2023-02-25 14:38:10,313][36154] Sum rewards: 59.365, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.338', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.129', 'WEAPON5': '0.150', 'weapon5': '0.158', 'WEAPON4': '0.250', 'weapon2': '0.690', 'WEAPON3': '0.800', 'weapon4': '0.896', 'weapon3': '2.034', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.578', 'FRAGCOUNT': '48.000'} [2023-02-25 14:38:10,558][36141] DAMAGECOUNT value on done: 1232316.0 [2023-02-25 14:38:10,558][36141] Sum rewards: 65.275, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.776', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO3': '0.170', 'AMMO4': '0.181', 'weapon5': '0.208', 'weapon2': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.404', 'weapon4': '0.482', 'WEAPON3': '1.050', 'weapon3': '2.638', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '55.000'} [2023-02-25 14:38:10,618][36154] DAMAGECOUNT value on done: 1211690.0 [2023-02-25 14:38:10,618][36154] Sum rewards: 62.629, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.114', 'AMMO5': '0.011', 'AMMO2': '0.034', 'AMMO4': '0.168', 'AMMO3': '0.182', 'weapon5': '0.184', 'weapon2': '0.346', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'ARMOR': '0.455', 'weapon4': '0.852', 'WEAPON3': '1.150', 'weapon3': '2.288', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.022', 'FRAGCOUNT': '53.000'} [2023-02-25 14:38:10,830][36141] DAMAGECOUNT value on done: 1221735.0 [2023-02-25 14:38:10,830][36141] Sum rewards: 59.482, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.650', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.062', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'weapon2': '0.206', 'weapon4': '0.224', 'WEAPON4': '0.250', 'AMMO3': '0.278', 'WEAPON3': '1.600', 'weapon3': '3.242', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '53.000'} [2023-02-25 14:38:10,865][36141] DAMAGECOUNT value on done: 1227443.0 [2023-02-25 14:38:10,866][36141] Sum rewards: 52.829, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.332', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon5': '0.144', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.400', 'weapon2': '0.408', 'WEAPON3': '0.850', 'weapon4': '1.050', 'weapon3': '2.088', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.885', 'FRAGCOUNT': '44.000'} [2023-02-25 14:38:10,906][36154] DAMAGECOUNT value on done: 1234040.0 [2023-02-25 14:38:10,907][36154] Sum rewards: 48.768, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.260', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.098', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'AMMO4': '0.235', 'weapon4': '0.372', 'weapon2': '0.418', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.788', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.169', 'FRAGCOUNT': '45.000'} [2023-02-25 14:38:11,150][36138] Updated weights for policy 0, policy_version 53623 (0.0009) [2023-02-25 14:38:11,150][36141] DAMAGECOUNT value on done: 1214461.0 [2023-02-25 14:38:11,150][36141] Sum rewards: 67.069, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.402', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.160', 'weapon4': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.226', 'WEAPON3': '1.400', 'weapon3': '3.192', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '57.000'} [2023-02-25 14:38:11,214][36154] DAMAGECOUNT value on done: 1221736.0 [2023-02-25 14:38:11,215][36154] Sum rewards: 59.571, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.138', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.132', 'AMMO4': '0.150', 'weapon2': '0.160', 'weapon4': '0.182', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.160', 'weapon3': '3.276', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '51.500'} [2023-02-25 14:38:12,182][36155] DAMAGECOUNT value on done: 1219271.0 [2023-02-25 14:38:12,183][36155] Sum rewards: 53.416, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-3.970', 'AMMO5': '0.017', 'AMMO2': '0.072', 'weapon5': '0.216', 'weapon2': '0.228', 'AMMO3': '0.239', 'AMMO4': '0.359', 'WEAPON5': '0.500', 'weapon4': '0.584', 'WEAPON4': '0.800', 'WEAPON3': '1.400', 'weapon3': '2.634', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '52.000'} [2023-02-25 14:38:12,493][36155] DAMAGECOUNT value on done: 1225665.0 [2023-02-25 14:38:12,493][36155] Sum rewards: 57.091, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.860', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.086', 'AMMO4': '0.121', 'AMMO3': '0.126', 'weapon4': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.708', 'WEAPON3': '0.750', 'HITCOUNT': '2.800', 'weapon3': '2.906', 'DAMAGECOUNT': '13.548', 'FRAGCOUNT': '46.000'} [2023-02-25 14:38:12,735][36139] DAMAGECOUNT value on done: 1223181.0 [2023-02-25 14:38:12,736][36139] Sum rewards: 61.863, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.362', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon2': '0.208', 'AMMO3': '0.247', 'AMMO4': '0.256', 'weapon5': '0.270', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon4': '0.724', 'WEAPON3': '1.400', 'weapon3': '2.404', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.355', 'FRAGCOUNT': '53.500'} [2023-02-25 14:38:13,061][36139] DAMAGECOUNT value on done: 1218929.0 [2023-02-25 14:38:13,061][36139] Sum rewards: 56.545, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.975', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.122', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon2': '0.454', 'weapon4': '0.498', 'WEAPON3': '1.150', 'weapon3': '2.710', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.947', 'FRAGCOUNT': '48.000'} [2023-02-25 14:38:13,344][36139] DAMAGECOUNT value on done: 1235032.0 [2023-02-25 14:38:13,344][36139] Sum rewards: 56.358, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.087', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.144', 'weapon4': '0.174', 'AMMO4': '0.179', 'AMMO3': '0.185', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.512', 'WEAPON3': '1.100', 'weapon3': '2.826', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.742', 'FRAGCOUNT': '50.000'} [2023-02-25 14:38:13,367][36155] DAMAGECOUNT value on done: 1240700.0 [2023-02-25 14:38:13,368][36155] Sum rewards: 64.978, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.650', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon5': '0.190', 'AMMO3': '0.210', 'weapon2': '0.292', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.404', 'WEAPON3': '1.250', 'weapon3': '2.858', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.221', 'FRAGCOUNT': '57.000'} [2023-02-25 14:38:13,639][36139] DAMAGECOUNT value on done: 1229247.0 [2023-02-25 14:38:13,640][36139] Sum rewards: 53.610, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.189', 'AMMO5': '0.019', 'AMMO2': '0.051', 'AMMO3': '0.117', 'weapon5': '0.248', 'AMMO4': '0.254', 'weapon2': '0.348', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon4': '0.720', 'weapon3': '2.468', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.603', 'FRAGCOUNT': '44.000'} [2023-02-25 14:38:13,673][36155] DAMAGECOUNT value on done: 1220576.0 [2023-02-25 14:38:13,673][36155] Sum rewards: 55.053, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.618', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'weapon4': '0.146', 'AMMO3': '0.231', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.160', 'weapon3': '3.376', 'DAMAGECOUNT': '14.184', 'FRAGCOUNT': '51.000'} [2023-02-25 14:38:14,199][36138] Updated weights for policy 0, policy_version 53633 (0.0009) [2023-02-25 14:38:14,356][36157] DAMAGECOUNT value on done: 1234028.0 [2023-02-25 14:38:14,356][36157] Sum rewards: 58.570, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.190', 'AMMO5': '0.004', 'AMMO2': '0.019', 'weapon5': '0.038', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'weapon2': '0.224', 'WEAPON4': '0.250', 'weapon4': '0.456', 'WEAPON3': '1.150', 'weapon3': '3.114', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.087', 'FRAGCOUNT': '50.000'} [2023-02-25 14:38:14,673][36157] DAMAGECOUNT value on done: 1224841.0 [2023-02-25 14:38:14,673][36157] Sum rewards: 53.532, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.850', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon2': '0.146', 'AMMO4': '0.195', 'AMMO3': '0.230', 'weapon4': '0.232', 'weapon5': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '2.920', 'weapon3': '3.056', 'DAMAGECOUNT': '15.036', 'FRAGCOUNT': '47.000'} [2023-02-25 14:38:14,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13371.0). Total num frames: 219684864. Throughput: 0: 3339.6. Samples: 17416114. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:38:14,729][36114] Avg episode reward: [(0, '56.943')] [2023-02-25 14:38:14,745][36157] DAMAGECOUNT value on done: 1235181.0 [2023-02-25 14:38:14,746][36157] Sum rewards: 47.219, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.942', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.060', 'AMMO3': '0.157', 'weapon5': '0.164', 'weapon2': '0.226', 'AMMO4': '0.299', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.624', 'WEAPON3': '1.000', 'HITCOUNT': '2.560', 'weapon3': '2.708', 'DAMAGECOUNT': '12.789', 'FRAGCOUNT': '42.000'} [2023-02-25 14:38:15,049][36157] DAMAGECOUNT value on done: 1229445.0 [2023-02-25 14:38:15,049][36157] Sum rewards: 56.795, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.706', 'AMMO5': '0.018', 'AMMO2': '0.032', 'weapon5': '0.146', 'AMMO4': '0.160', 'AMMO3': '0.181', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.360', 'weapon2': '0.424', 'WEAPON3': '1.100', 'weapon3': '2.634', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '48.000'} [2023-02-25 14:38:15,187][36140] DAMAGECOUNT value on done: 1232864.0 [2023-02-25 14:38:15,188][36140] Sum rewards: 62.875, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.845', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.042', 'AMMO3': '0.184', 'AMMO4': '0.210', 'weapon5': '0.278', 'weapon2': '0.298', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.558', 'WEAPON3': '1.050', 'weapon3': '2.600', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '52.500'} [2023-02-25 14:38:15,219][36140] DAMAGECOUNT value on done: 1225740.0 [2023-02-25 14:38:15,219][36140] Sum rewards: 61.752, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.979', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'AMMO4': '0.131', 'weapon5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.590', 'WEAPON3': '0.750', 'HITCOUNT': '3.040', 'weapon3': '3.082', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '48.500'} [2023-02-25 14:38:15,519][36140] DAMAGECOUNT value on done: 1217846.0 [2023-02-25 14:38:15,519][36140] Sum rewards: 64.200, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.174', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.193', 'weapon5': '0.210', 'weapon4': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.100', 'HITCOUNT': '2.980', 'weapon3': '3.032', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '55.000'} [2023-02-25 14:38:15,551][36140] DAMAGECOUNT value on done: 1218702.0 [2023-02-25 14:38:15,552][36140] Sum rewards: 47.378, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.562', 'AMMO5': '0.022', 'AMMO2': '0.063', 'AMMO3': '0.161', 'weapon2': '0.234', 'weapon5': '0.280', 'AMMO4': '0.317', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'weapon4': '0.820', 'WEAPON3': '0.950', 'weapon3': '2.326', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.436', 'FRAGCOUNT': '41.000'} [2023-02-25 14:38:16,979][36154] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:38:17,233][36138] Updated weights for policy 0, policy_version 53643 (0.0009) [2023-02-25 14:38:17,935][36142] DAMAGECOUNT value on done: 1223918.0 [2023-02-25 14:38:17,936][36142] Sum rewards: 56.499, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.336', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.184', 'weapon5': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.382', 'weapon2': '0.444', 'WEAPON3': '1.150', 'weapon3': '2.600', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '13.626', 'FRAGCOUNT': '48.500'} [2023-02-25 14:38:18,252][36142] DAMAGECOUNT value on done: 1214975.0 [2023-02-25 14:38:18,252][36142] Sum rewards: 62.152, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.108', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.056', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'weapon2': '0.396', 'weapon4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.868', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '15.981', 'FRAGCOUNT': '54.000'} [2023-02-25 14:38:18,811][36142] DAMAGECOUNT value on done: 1226737.0 [2023-02-25 14:38:18,812][36142] Sum rewards: 61.388, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.272', 'AMMO5': '0.026', 'AMMO2': '0.060', 'AMMO3': '0.206', 'AMMO4': '0.301', 'weapon4': '0.318', 'weapon5': '0.318', 'weapon2': '0.346', 'WEAPON4': '0.600', 'WEAPON5': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.622', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '54.000'} [2023-02-25 14:38:19,127][36142] DAMAGECOUNT value on done: 1232578.0 [2023-02-25 14:38:19,128][36142] Sum rewards: 61.471, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.404', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO3': '0.146', 'AMMO4': '0.159', 'weapon5': '0.188', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON4': '0.350', 'weapon4': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.800', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '51.000'} [2023-02-25 14:38:19,721][36156] DAMAGECOUNT value on done: 1238598.0 [2023-02-25 14:38:19,721][36156] Sum rewards: 66.012, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.210', 'AMMO5': '0.010', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'weapon4': '0.360', 'weapon2': '0.634', 'WEAPON3': '1.100', 'weapon3': '2.832', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '54.000'} [2023-02-25 14:38:19,729][36114] Fps is (10 sec: 13517.0, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 219754496. Throughput: 0: 3341.3. Samples: 17436140. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:38:19,729][36114] Avg episode reward: [(0, '56.834')] [2023-02-25 14:38:20,043][36156] DAMAGECOUNT value on done: 1231881.0 [2023-02-25 14:38:20,043][36156] Sum rewards: 62.088, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.134', 'AMMO5': '0.020', 'AMMO2': '0.047', 'AMMO3': '0.167', 'AMMO4': '0.236', 'weapon2': '0.262', 'weapon5': '0.326', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.890', 'WEAPON3': '1.050', 'weapon3': '2.156', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '53.000'} [2023-02-25 14:38:20,052][36156] DAMAGECOUNT value on done: 1220281.0 [2023-02-25 14:38:20,052][36156] Sum rewards: 54.003, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.201', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.158', 'AMMO3': '0.170', 'AMMO4': '0.237', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON4': '0.550', 'weapon4': '0.630', 'WEAPON3': '1.050', 'weapon3': '2.624', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.475', 'FRAGCOUNT': '47.000'} [2023-02-25 14:38:20,312][36138] Updated weights for policy 0, policy_version 53653 (0.0009) [2023-02-25 14:38:20,367][36156] DAMAGECOUNT value on done: 1219372.0 [2023-02-25 14:38:20,367][36156] Sum rewards: 64.162, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.777', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon2': '0.166', 'weapon5': '0.172', 'AMMO4': '0.173', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.528', 'WEAPON3': '1.200', 'weapon3': '2.766', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '55.000'} [2023-02-25 14:38:23,394][36138] Updated weights for policy 0, policy_version 53663 (0.0009) [2023-02-25 14:38:24,364][36157] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:38:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 219820032. Throughput: 0: 3338.6. Samples: 17446116. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:38:24,730][36114] Avg episode reward: [(0, '57.219')] [2023-02-25 14:38:26,519][36138] Updated weights for policy 0, policy_version 53673 (0.0009) [2023-02-25 14:38:29,583][36138] Updated weights for policy 0, policy_version 53683 (0.0009) [2023-02-25 14:38:29,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13312.0, 300 sec: 13371.0). Total num frames: 219885568. Throughput: 0: 3332.8. Samples: 17466028. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:38:29,729][36114] Avg episode reward: [(0, '57.219')] [2023-02-25 14:38:30,494][36154] DAMAGECOUNT value on done: 1237815.0 [2023-02-25 14:38:30,495][36154] Sum rewards: 61.745, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.027', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.018', 'weapon5': '0.040', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.253', 'weapon2': '0.284', 'WEAPON3': '1.600', 'HITCOUNT': '3.380', 'weapon3': '3.484', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '54.000'} [2023-02-25 14:38:30,676][36141] DAMAGECOUNT value on done: 1238071.0 [2023-02-25 14:38:30,677][36141] Sum rewards: 62.822, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.350', 'AMMO5': '0.004', 'AMMO2': '0.009', 'weapon4': '0.014', 'weapon5': '0.026', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.222', 'AMMO3': '0.289', 'WEAPON3': '1.850', 'weapon3': '3.500', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '56.000'} [2023-02-25 14:38:30,757][36154] DAMAGECOUNT value on done: 1216237.0 [2023-02-25 14:38:30,758][36154] Sum rewards: 49.020, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.820', 'ARMOR': '0.008', 'AMMO5': '0.025', 'AMMO2': '0.061', 'AMMO3': '0.183', 'weapon5': '0.226', 'weapon4': '0.276', 'AMMO4': '0.304', 'weapon2': '0.432', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.050', 'HITCOUNT': '2.730', 'weapon3': '2.788', 'DAMAGECOUNT': '13.557', 'FRAGCOUNT': '44.000'} [2023-02-25 14:38:30,948][36141] DAMAGECOUNT value on done: 1225244.0 [2023-02-25 14:38:30,949][36141] Sum rewards: 43.051, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.118', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.067', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon2': '0.364', 'weapon4': '0.746', 'WEAPON3': '1.100', 'HITCOUNT': '2.410', 'weapon3': '2.640', 'DAMAGECOUNT': '10.527', 'FRAGCOUNT': '38.000'} [2023-02-25 14:38:30,977][36141] DAMAGECOUNT value on done: 1232657.0 [2023-02-25 14:38:30,977][36141] Sum rewards: 60.045, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.220', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.046', 'WEAPON5': '0.150', 'AMMO4': '0.173', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.204', 'AMMO3': '0.246', 'weapon2': '0.254', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.276', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '54.000'} [2023-02-25 14:38:31,035][36154] DAMAGECOUNT value on done: 1238769.0 [2023-02-25 14:38:31,036][36154] Sum rewards: 57.071, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.322', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.069', 'AMMO3': '0.144', 'weapon5': '0.250', 'weapon2': '0.274', 'AMMO4': '0.343', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '0.850', 'weapon4': '1.146', 'weapon3': '2.058', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.187', 'FRAGCOUNT': '48.000'} [2023-02-25 14:38:31,265][36141] DAMAGECOUNT value on done: 1219279.0 [2023-02-25 14:38:31,265][36141] Sum rewards: 60.153, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.985', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.062', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'weapon4': '0.232', 'weapon2': '0.344', 'WEAPON3': '1.100', 'HITCOUNT': '2.900', 'weapon3': '3.176', 'DAMAGECOUNT': '14.454', 'FRAGCOUNT': '51.000'} [2023-02-25 14:38:31,364][36154] DAMAGECOUNT value on done: 1228454.0 [2023-02-25 14:38:31,364][36154] Sum rewards: 83.705, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.931', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.046', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.172', 'WEAPON4': '0.250', 'weapon2': '0.354', 'ARMOR': '0.494', 'weapon4': '0.504', 'WEAPON3': '1.150', 'weapon3': '2.964', 'HITCOUNT': '4.190', 'DAMAGECOUNT': '20.154', 'FRAGCOUNT': '68.000'} [2023-02-25 14:38:32,381][36155] DAMAGECOUNT value on done: 1224567.0 [2023-02-25 14:38:32,381][36155] Sum rewards: 59.905, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.105', 'AMMO5': '0.005', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon2': '0.276', 'weapon4': '0.324', 'WEAPON3': '1.250', 'weapon3': '2.994', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.888', 'FRAGCOUNT': '52.000'} [2023-02-25 14:38:32,585][36138] Updated weights for policy 0, policy_version 53693 (0.0009) [2023-02-25 14:38:32,683][36155] DAMAGECOUNT value on done: 1231587.0 [2023-02-25 14:38:32,684][36155] Sum rewards: 68.549, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.562', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.245', 'weapon4': '0.370', 'weapon2': '0.404', 'WEAPON3': '1.450', 'weapon3': '2.794', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.511', 'FRAGCOUNT': '60.000'} [2023-02-25 14:38:32,858][36139] DAMAGECOUNT value on done: 1227936.0 [2023-02-25 14:38:32,858][36139] Sum rewards: 56.250, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.224', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.128', 'AMMO4': '0.146', 'AMMO3': '0.186', 'WEAPON5': '0.250', 'weapon4': '0.288', 'WEAPON4': '0.350', 'weapon2': '0.376', 'WEAPON3': '1.150', 'HITCOUNT': '2.860', 'weapon3': '2.936', 'DAMAGECOUNT': '14.265', 'FRAGCOUNT': '49.000'} [2023-02-25 14:38:33,166][36139] DAMAGECOUNT value on done: 1224331.0 [2023-02-25 14:38:33,167][36139] Sum rewards: 65.169, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.520', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.210', 'weapon2': '0.240', 'AMMO3': '0.257', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.476', 'WEAPON3': '1.600', 'weapon3': '2.800', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.206', 'FRAGCOUNT': '60.000'} [2023-02-25 14:38:33,340][36139] DAMAGECOUNT value on done: 1240535.0 [2023-02-25 14:38:33,340][36139] Sum rewards: 64.186, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.520', 'AMMO5': '0.006', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.124', 'AMMO3': '0.139', 'weapon4': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.736', 'WEAPON3': '1.000', 'weapon3': '2.830', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '52.000'} [2023-02-25 14:38:33,473][36155] DAMAGECOUNT value on done: 1245862.0 [2023-02-25 14:38:33,474][36155] Sum rewards: 58.821, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.988', 'AMMO5': '0.016', 'AMMO2': '0.041', 'AMMO3': '0.189', 'AMMO4': '0.205', 'weapon4': '0.306', 'weapon2': '0.354', 'weapon5': '0.378', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.624', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '50.500'} [2023-02-25 14:38:33,640][36139] DAMAGECOUNT value on done: 1234627.0 [2023-02-25 14:38:33,640][36139] Sum rewards: 62.919, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.012', 'AMMO2': '0.045', 'HEALTH': '0.054', 'weapon5': '0.138', 'AMMO3': '0.172', 'weapon2': '0.216', 'AMMO4': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.404', 'weapon4': '0.504', 'WEAPON3': '0.950', 'weapon3': '2.850', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.140', 'FRAGCOUNT': '51.000'} [2023-02-25 14:38:33,776][36155] DAMAGECOUNT value on done: 1226025.0 [2023-02-25 14:38:33,776][36155] Sum rewards: 63.929, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.638', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.098', 'AMMO4': '0.116', 'weapon5': '0.130', 'weapon2': '0.186', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.140', 'weapon3': '3.384', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '56.000'} [2023-02-25 14:38:34,433][36157] DAMAGECOUNT value on done: 1238499.0 [2023-02-25 14:38:34,433][36157] Sum rewards: 45.428, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.179', 'AMMO5': '0.014', 'AMMO2': '0.053', 'AMMO3': '0.241', 'weapon5': '0.260', 'AMMO4': '0.267', 'weapon2': '0.290', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.770', 'WEAPON3': '1.400', 'weapon3': '2.368', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.413', 'FRAGCOUNT': '43.000'} [2023-02-25 14:38:34,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 219955200. Throughput: 0: 3342.4. Samples: 17486318. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:38:34,729][36114] Avg episode reward: [(0, '57.721')] [2023-02-25 14:38:34,747][36157] DAMAGECOUNT value on done: 1229694.0 [2023-02-25 14:38:34,747][36157] Sum rewards: 55.947, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.218', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon5': '0.102', 'AMMO4': '0.127', 'AMMO3': '0.177', 'weapon4': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.150', 'HITCOUNT': '3.110', 'weapon3': '3.116', 'DAMAGECOUNT': '14.559', 'FRAGCOUNT': '48.000'} [2023-02-25 14:38:34,868][36157] DAMAGECOUNT value on done: 1239758.0 [2023-02-25 14:38:34,868][36157] Sum rewards: 59.644, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.385', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.046', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'weapon2': '0.500', 'weapon4': '0.634', 'WEAPON3': '1.050', 'weapon3': '2.644', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '13.731', 'FRAGCOUNT': '50.000'} [2023-02-25 14:38:35,176][36157] DAMAGECOUNT value on done: 1234949.0 [2023-02-25 14:38:35,176][36157] Sum rewards: 65.761, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.470', 'AMMO2': '0.028', 'AMMO4': '0.142', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'weapon2': '0.368', 'weapon4': '0.378', 'ARMOR': '0.404', 'WEAPON3': '1.400', 'weapon3': '3.082', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '58.000'} [2023-02-25 14:38:35,259][36140] DAMAGECOUNT value on done: 1237858.0 [2023-02-25 14:38:35,260][36140] Sum rewards: 59.089, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.021', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.088', 'weapon2': '0.160', 'AMMO3': '0.171', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.360', 'WEAPON3': '1.050', 'weapon3': '3.216', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.982', 'FRAGCOUNT': '49.000'} [2023-02-25 14:38:35,282][36140] DAMAGECOUNT value on done: 1231157.0 [2023-02-25 14:38:35,283][36140] Sum rewards: 62.204, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.004', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.014', 'AMMO4': '0.038', 'WEAPON5': '0.050', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.229', 'weapon2': '0.552', 'WEAPON3': '1.400', 'weapon3': '3.144', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.251', 'FRAGCOUNT': '54.000'} [2023-02-25 14:38:35,584][36140] DAMAGECOUNT value on done: 1222073.0 [2023-02-25 14:38:35,585][36140] Sum rewards: 46.993, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.596', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.162', 'weapon5': '0.220', 'AMMO3': '0.222', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.466', 'weapon2': '0.634', 'WEAPON3': '1.350', 'weapon3': '2.352', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '12.681', 'FRAGCOUNT': '45.000'} [2023-02-25 14:38:35,603][36138] Updated weights for policy 0, policy_version 53703 (0.0010) [2023-02-25 14:38:35,605][36140] DAMAGECOUNT value on done: 1222604.0 [2023-02-25 14:38:35,605][36140] Sum rewards: 41.956, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.536', 'AMMO5': '0.013', 'AMMO2': '0.050', 'AMMO3': '0.164', 'weapon5': '0.188', 'AMMO4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.410', 'ARMOR': '0.456', 'weapon4': '0.588', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'HITCOUNT': '2.290', 'weapon3': '2.576', 'DAMAGECOUNT': '11.706', 'FRAGCOUNT': '39.000'} [2023-02-25 14:38:37,993][36142] DAMAGECOUNT value on done: 1229209.0 [2023-02-25 14:38:37,994][36142] Sum rewards: 64.752, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.678', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.016', 'AMMO4': '0.072', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.227', 'weapon2': '0.276', 'WEAPON3': '1.400', 'HITCOUNT': '3.340', 'weapon3': '3.432', 'DAMAGECOUNT': '15.873', 'FRAGCOUNT': '56.000'} [2023-02-25 14:38:38,307][36142] DAMAGECOUNT value on done: 1219729.0 [2023-02-25 14:38:38,307][36142] Sum rewards: 56.943, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.365', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.139', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.226', 'weapon4': '0.358', 'weapon2': '0.514', 'WEAPON3': '0.900', 'weapon3': '2.664', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.262', 'FRAGCOUNT': '47.000'} [2023-02-25 14:38:38,603][36138] Updated weights for policy 0, policy_version 53713 (0.0009) [2023-02-25 14:38:38,879][36142] DAMAGECOUNT value on done: 1231993.0 [2023-02-25 14:38:38,879][36142] Sum rewards: 63.737, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.390', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.092', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.210', 'weapon4': '0.334', 'WEAPON3': '1.300', 'weapon3': '3.142', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.768', 'FRAGCOUNT': '54.000'} [2023-02-25 14:38:39,186][36142] DAMAGECOUNT value on done: 1237408.0 [2023-02-25 14:38:39,186][36142] Sum rewards: 56.217, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.266', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.043', 'AMMO3': '0.087', 'weapon5': '0.116', 'AMMO4': '0.217', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon4': '0.520', 'weapon2': '0.622', 'WEAPON3': '0.650', 'weapon3': '2.436', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.190', 'FRAGCOUNT': '46.500'} [2023-02-25 14:38:39,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 220020736. Throughput: 0: 3345.2. Samples: 17496384. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:38:39,729][36114] Avg episode reward: [(0, '57.869')] [2023-02-25 14:38:39,897][36156] DAMAGECOUNT value on done: 1243773.0 [2023-02-25 14:38:39,897][36156] Sum rewards: 57.004, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.286', 'AMMO5': '0.014', 'ARMOR': '0.016', 'AMMO2': '0.044', 'AMMO3': '0.155', 'AMMO4': '0.221', 'weapon5': '0.242', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.614', 'WEAPON3': '1.000', 'weapon4': '1.022', 'weapon3': '1.836', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.525', 'FRAGCOUNT': '48.000'} [2023-02-25 14:38:40,203][36156] DAMAGECOUNT value on done: 1237246.0 [2023-02-25 14:38:40,204][36156] Sum rewards: 66.204, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.440', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.046', 'AMMO4': '0.149', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.312', 'weapon4': '0.544', 'WEAPON3': '1.100', 'weapon3': '2.896', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '56.000'} [2023-02-25 14:38:40,213][36156] DAMAGECOUNT value on done: 1225453.0 [2023-02-25 14:38:40,213][36156] Sum rewards: 56.811, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.910', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.168', 'AMMO4': '0.182', 'AMMO3': '0.224', 'weapon2': '0.292', 'WEAPON5': '0.350', 'weapon4': '0.392', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.866', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.516', 'FRAGCOUNT': '53.000'} [2023-02-25 14:38:40,529][36156] DAMAGECOUNT value on done: 1224562.0 [2023-02-25 14:38:40,530][36156] Sum rewards: 56.935, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.292', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.256', 'weapon2': '0.456', 'WEAPON3': '1.450', 'HITCOUNT': '3.280', 'weapon3': '3.298', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '50.000'} [2023-02-25 14:38:41,687][36138] Updated weights for policy 0, policy_version 53723 (0.0009) [2023-02-25 14:38:44,729][36114] Fps is (10 sec: 13106.8, 60 sec: 13380.2, 300 sec: 13371.0). Total num frames: 220086272. Throughput: 0: 3344.7. Samples: 17516408. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:38:44,731][36114] Avg episode reward: [(0, '57.990')] [2023-02-25 14:38:44,780][36138] Updated weights for policy 0, policy_version 53733 (0.0009) [2023-02-25 14:38:47,828][36138] Updated weights for policy 0, policy_version 53743 (0.0009) [2023-02-25 14:38:48,405][36139] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:38:49,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 220155904. Throughput: 0: 3343.5. Samples: 17536466. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:38:49,730][36114] Avg episode reward: [(0, '57.990')] [2023-02-25 14:38:50,504][36154] DAMAGECOUNT value on done: 1242947.0 [2023-02-25 14:38:50,504][36154] Sum rewards: 55.779, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.858', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'weapon5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.332', 'weapon4': '0.560', 'WEAPON3': '1.400', 'weapon3': '2.580', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '50.000'} [2023-02-25 14:38:50,706][36141] DAMAGECOUNT value on done: 1242495.0 [2023-02-25 14:38:50,706][36141] Sum rewards: 46.852, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.504', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'AMMO4': '0.191', 'WEAPON4': '0.300', 'weapon4': '0.302', 'weapon2': '0.622', 'WEAPON3': '1.100', 'weapon3': '2.780', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.272', 'FRAGCOUNT': '39.000'} [2023-02-25 14:38:50,826][36154] DAMAGECOUNT value on done: 1221742.0 [2023-02-25 14:38:50,826][36154] Sum rewards: 65.684, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.362', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'weapon2': '0.216', 'weapon4': '0.234', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.214', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.515', 'FRAGCOUNT': '58.000'} [2023-02-25 14:38:50,888][36138] Updated weights for policy 0, policy_version 53753 (0.0009) [2023-02-25 14:38:50,992][36141] DAMAGECOUNT value on done: 1230869.0 [2023-02-25 14:38:50,993][36141] Sum rewards: 71.936, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.361', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'weapon4': '0.078', 'AMMO3': '0.220', 'weapon2': '0.538', 'WEAPON3': '1.250', 'weapon3': '3.216', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '60.000'} [2023-02-25 14:38:51,019][36141] DAMAGECOUNT value on done: 1239015.0 [2023-02-25 14:38:51,019][36141] Sum rewards: 71.588, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.267', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.032', 'weapon5': '0.078', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon2': '0.554', 'WEAPON3': '1.400', 'weapon3': '3.090', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.074', 'FRAGCOUNT': '60.000'} [2023-02-25 14:38:51,109][36154] DAMAGECOUNT value on done: 1244451.0 [2023-02-25 14:38:51,109][36154] Sum rewards: 67.252, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.114', 'AMMO5': '0.019', 'AMMO2': '0.030', 'AMMO4': '0.152', 'AMMO3': '0.172', 'weapon5': '0.180', 'weapon2': '0.228', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.860', 'WEAPON3': '1.000', 'weapon3': '2.478', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '56.000'} [2023-02-25 14:38:51,299][36141] DAMAGECOUNT value on done: 1224317.0 [2023-02-25 14:38:51,299][36141] Sum rewards: 57.437, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.960', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.056', 'AMMO4': '0.075', 'weapon5': '0.098', 'WEAPON4': '0.100', 'weapon2': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.258', 'WEAPON3': '1.550', 'HITCOUNT': '2.850', 'weapon3': '3.406', 'DAMAGECOUNT': '15.114', 'FRAGCOUNT': '52.000'} [2023-02-25 14:38:51,412][36154] DAMAGECOUNT value on done: 1233401.0 [2023-02-25 14:38:51,412][36154] Sum rewards: 59.467, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.414', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.211', 'weapon4': '0.240', 'weapon2': '0.358', 'WEAPON3': '1.250', 'weapon3': '3.166', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.826', 'FRAGCOUNT': '50.000'} [2023-02-25 14:38:52,409][36155] DAMAGECOUNT value on done: 1229262.0 [2023-02-25 14:38:52,409][36155] Sum rewards: 57.215, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.971', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.010', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO4': '0.146', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'weapon2': '0.410', 'weapon4': '0.502', 'WEAPON3': '1.100', 'weapon3': '2.930', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.040', 'FRAGCOUNT': '48.000'} [2023-02-25 14:38:52,718][36155] DAMAGECOUNT value on done: 1235943.0 [2023-02-25 14:38:52,719][36155] Sum rewards: 44.111, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.661', 'AMMO5': '0.021', 'AMMO2': '0.056', 'AMMO3': '0.189', 'weapon5': '0.228', 'AMMO4': '0.281', 'weapon2': '0.396', 'ARMOR': '0.454', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'weapon4': '0.784', 'WEAPON3': '1.200', 'weapon3': '2.234', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '13.068', 'FRAGCOUNT': '40.000'} [2023-02-25 14:38:52,827][36139] DAMAGECOUNT value on done: 1233325.0 [2023-02-25 14:38:52,828][36139] Sum rewards: 62.332, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.440', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.142', 'AMMO3': '0.179', 'AMMO4': '0.195', 'WEAPON5': '0.300', 'weapon2': '0.344', 'weapon4': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.834', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '54.000'} [2023-02-25 14:38:53,135][36139] DAMAGECOUNT value on done: 1229225.0 [2023-02-25 14:38:53,136][36139] Sum rewards: 57.797, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.926', 'ARMOR': '0.012', 'AMMO5': '0.022', 'AMMO2': '0.075', 'AMMO3': '0.142', 'weapon5': '0.184', 'weapon4': '0.270', 'AMMO4': '0.374', 'WEAPON5': '0.600', 'weapon2': '0.664', 'WEAPON4': '0.700', 'WEAPON3': '0.800', 'weapon3': '2.598', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.682', 'FRAGCOUNT': '50.500'} [2023-02-25 14:38:53,334][36139] DAMAGECOUNT value on done: 1245943.0 [2023-02-25 14:38:53,335][36139] Sum rewards: 66.582, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.194', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.062', 'weapon4': '0.112', 'AMMO4': '0.165', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.690', 'WEAPON3': '1.100', 'weapon3': '2.912', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '56.000'} [2023-02-25 14:38:53,509][36155] DAMAGECOUNT value on done: 1251207.0 [2023-02-25 14:38:53,510][36155] Sum rewards: 62.502, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.970', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.076', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'weapon2': '0.164', 'AMMO3': '0.265', 'WEAPON4': '0.300', 'weapon4': '0.488', 'WEAPON3': '1.650', 'weapon3': '3.072', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '57.000'} [2023-02-25 14:38:53,607][36156] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:38:53,638][36139] DAMAGECOUNT value on done: 1239373.0 [2023-02-25 14:38:53,639][36139] Sum rewards: 55.948, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-0.556', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.186', 'AMMO4': '0.186', 'weapon2': '0.230', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'weapon4': '0.424', 'WEAPON3': '1.400', 'weapon3': '2.766', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.238', 'FRAGCOUNT': '52.000'} [2023-02-25 14:38:53,796][36155] DAMAGECOUNT value on done: 1231039.0 [2023-02-25 14:38:53,797][36155] Sum rewards: 59.112, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.962', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon2': '0.560', 'weapon4': '0.578', 'WEAPON3': '1.050', 'weapon3': '2.704', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.042', 'FRAGCOUNT': '49.000'} [2023-02-25 14:38:53,939][36138] Updated weights for policy 0, policy_version 53763 (0.0009) [2023-02-25 14:38:54,459][36157] DAMAGECOUNT value on done: 1242708.0 [2023-02-25 14:38:54,460][36157] Sum rewards: 46.147, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.830', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.152', 'AMMO3': '0.171', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.448', 'weapon2': '0.476', 'WEAPON3': '1.150', 'weapon3': '2.680', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.627', 'FRAGCOUNT': '42.000'} [2023-02-25 14:38:54,729][36114] Fps is (10 sec: 13517.1, 60 sec: 13380.3, 300 sec: 13371.0). Total num frames: 220221440. Throughput: 0: 3344.2. Samples: 17546520. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:38:54,730][36114] Avg episode reward: [(0, '58.611')] [2023-02-25 14:38:54,777][36157] DAMAGECOUNT value on done: 1234486.0 [2023-02-25 14:38:54,778][36157] Sum rewards: 52.129, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.306', 'AMMO5': '0.019', 'AMMO2': '0.057', 'weapon5': '0.192', 'AMMO3': '0.194', 'AMMO4': '0.283', 'ARMOR': '0.408', 'weapon2': '0.462', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.716', 'WEAPON3': '1.100', 'weapon3': '2.328', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.376', 'FRAGCOUNT': '45.000'} [2023-02-25 14:38:54,918][36157] DAMAGECOUNT value on done: 1245277.0 [2023-02-25 14:38:54,918][36157] Sum rewards: 67.914, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.668', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.032', 'weapon5': '0.146', 'AMMO4': '0.160', 'AMMO3': '0.235', 'weapon2': '0.282', 'weapon4': '0.334', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.882', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '60.000'} [2023-02-25 14:38:55,228][36157] DAMAGECOUNT value on done: 1239448.0 [2023-02-25 14:38:55,229][36157] Sum rewards: 48.624, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.722', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon2': '0.202', 'AMMO3': '0.235', 'AMMO4': '0.274', 'weapon5': '0.314', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'weapon4': '0.702', 'WEAPON3': '1.300', 'weapon3': '2.344', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '13.497', 'FRAGCOUNT': '46.000'} [2023-02-25 14:38:55,391][36140] DAMAGECOUNT value on done: 1243310.0 [2023-02-25 14:38:55,392][36140] Sum rewards: 65.189, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.022', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon5': '0.070', 'AMMO3': '0.167', 'weapon4': '0.218', 'AMMO4': '0.224', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'HITCOUNT': '3.140', 'weapon3': '3.208', 'DAMAGECOUNT': '16.356', 'FRAGCOUNT': '55.000'} [2023-02-25 14:38:55,416][36140] DAMAGECOUNT value on done: 1236246.0 [2023-02-25 14:38:55,416][36140] Sum rewards: 53.055, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.534', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.061', 'weapon5': '0.108', 'AMMO3': '0.238', 'weapon2': '0.288', 'AMMO4': '0.304', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'weapon4': '0.698', 'WEAPON3': '1.450', 'weapon3': '2.580', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.267', 'FRAGCOUNT': '50.000'} [2023-02-25 14:38:55,720][36140] DAMAGECOUNT value on done: 1227605.0 [2023-02-25 14:38:55,720][36140] Sum rewards: 66.530, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.656', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.176', 'AMMO3': '0.178', 'AMMO4': '0.193', 'weapon4': '0.324', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.430', 'WEAPON3': '1.200', 'weapon3': '2.780', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '57.000'} [2023-02-25 14:38:55,749][36140] DAMAGECOUNT value on done: 1228014.0 [2023-02-25 14:38:55,750][36140] Sum rewards: 55.579, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.706', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon4': '0.280', 'weapon2': '0.312', 'WEAPON3': '1.150', 'weapon3': '3.126', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '45.500'} [2023-02-25 14:38:57,022][36138] Updated weights for policy 0, policy_version 53773 (0.0009) [2023-02-25 14:38:58,107][36142] DAMAGECOUNT value on done: 1234371.0 [2023-02-25 14:38:58,108][36142] Sum rewards: 56.950, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.624', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon2': '0.176', 'weapon5': '0.182', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.272', 'WEAPON3': '1.500', 'weapon3': '3.126', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '50.000'} [2023-02-25 14:38:58,424][36142] DAMAGECOUNT value on done: 1224212.0 [2023-02-25 14:38:58,425][36142] Sum rewards: 50.504, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.012', 'AMMO2': '0.004', 'ARMOR': '0.004', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'weapon4': '0.110', 'AMMO3': '0.258', 'weapon2': '0.302', 'WEAPON3': '1.500', 'HITCOUNT': '2.680', 'weapon3': '3.390', 'DAMAGECOUNT': '13.449', 'FRAGCOUNT': '45.000'} [2023-02-25 14:38:58,997][36142] DAMAGECOUNT value on done: 1237209.0 [2023-02-25 14:38:58,998][36142] Sum rewards: 63.839, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.984', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.150', 'weapon4': '0.158', 'WEAPON4': '0.200', 'weapon2': '0.208', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.160', 'weapon3': '3.248', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '56.000'} [2023-02-25 14:38:59,314][36142] DAMAGECOUNT value on done: 1242693.0 [2023-02-25 14:38:59,315][36142] Sum rewards: 61.556, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.658', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.150', 'AMMO4': '0.188', 'weapon5': '0.248', 'weapon4': '0.352', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.708', 'WEAPON3': '0.950', 'weapon3': '2.412', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '51.000'} [2023-02-25 14:38:59,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13371.0). Total num frames: 220286976. Throughput: 0: 3343.1. Samples: 17566554. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:38:59,730][36114] Avg episode reward: [(0, '58.730')] [2023-02-25 14:39:00,073][36138] Updated weights for policy 0, policy_version 53783 (0.0009) [2023-02-25 14:39:00,076][36156] DAMAGECOUNT value on done: 1248888.0 [2023-02-25 14:39:00,076][36156] Sum rewards: 58.772, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.340', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.162', 'AMMO4': '0.171', 'AMMO3': '0.178', 'weapon2': '0.242', 'weapon4': '0.250', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.800', 'weapon3': '3.114', 'DAMAGECOUNT': '15.345', 'FRAGCOUNT': '51.000'} [2023-02-25 14:39:00,389][36156] DAMAGECOUNT value on done: 1240968.0 [2023-02-25 14:39:00,390][36156] Sum rewards: 38.644, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.199', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'AMMO3': '0.254', 'weapon4': '0.266', 'weapon2': '0.336', 'WEAPON3': '1.450', 'HITCOUNT': '2.330', 'weapon3': '3.202', 'DAMAGECOUNT': '11.166', 'FRAGCOUNT': '36.000'} [2023-02-25 14:39:00,412][36156] DAMAGECOUNT value on done: 1230805.0 [2023-02-25 14:39:00,412][36156] Sum rewards: 69.629, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.002', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.126', 'AMMO3': '0.152', 'AMMO4': '0.207', 'weapon4': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.512', 'WEAPON3': '0.900', 'weapon3': '2.956', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.056', 'FRAGCOUNT': '56.000'} [2023-02-25 14:39:00,725][36156] DAMAGECOUNT value on done: 1230312.0 [2023-02-25 14:39:00,725][36156] Sum rewards: 64.004, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.918', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.041', 'AMMO4': '0.206', 'AMMO3': '0.233', 'weapon5': '0.248', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.450', 'weapon2': '0.472', 'WEAPON3': '1.450', 'weapon3': '2.518', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '58.000'} [2023-02-25 14:39:03,181][36138] Updated weights for policy 0, policy_version 53793 (0.0009) [2023-02-25 14:39:04,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13371.0). Total num frames: 220356608. Throughput: 0: 3347.2. Samples: 17586766. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:39:04,729][36114] Avg episode reward: [(0, '58.799')] [2023-02-25 14:39:06,231][36138] Updated weights for policy 0, policy_version 53803 (0.0009) [2023-02-25 14:39:09,318][36138] Updated weights for policy 0, policy_version 53813 (0.0009) [2023-02-25 14:39:09,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13371.0). Total num frames: 220422144. Throughput: 0: 3346.7. Samples: 17596718. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:39:09,730][36114] Avg episode reward: [(0, '58.799')] [2023-02-25 14:39:09,849][36142] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-25 14:39:10,082][36154] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:39:10,576][36154] DAMAGECOUNT value on done: 1249104.0 [2023-02-25 14:39:10,576][36154] Sum rewards: 75.658, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.350', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.098', 'weapon4': '0.118', 'AMMO4': '0.136', 'AMMO3': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.412', 'WEAPON3': '0.950', 'weapon3': '3.122', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '60.000'} [2023-02-25 14:39:10,810][36141] DAMAGECOUNT value on done: 1247560.0 [2023-02-25 14:39:10,811][36141] Sum rewards: 53.754, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.922', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.090', 'AMMO4': '0.092', 'weapon4': '0.156', 'weapon2': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.259', 'WEAPON3': '1.500', 'HITCOUNT': '2.970', 'weapon3': '3.290', 'DAMAGECOUNT': '15.195', 'FRAGCOUNT': '48.000'} [2023-02-25 14:39:10,885][36154] DAMAGECOUNT value on done: 1226722.0 [2023-02-25 14:39:10,885][36154] Sum rewards: 67.055, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.667', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.064', 'AMMO4': '0.098', 'AMMO3': '0.137', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.306', 'weapon2': '0.360', 'WEAPON3': '0.850', 'weapon3': '3.038', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.940', 'FRAGCOUNT': '54.000'} [2023-02-25 14:39:11,110][36141] DAMAGECOUNT value on done: 1235907.0 [2023-02-25 14:39:11,110][36141] Sum rewards: 57.614, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.114', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.031', 'AMMO4': '0.157', 'AMMO3': '0.169', 'weapon5': '0.202', 'weapon2': '0.242', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.598', 'WEAPON3': '1.100', 'weapon3': '2.702', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.829', 'FRAGCOUNT': '50.000'} [2023-02-25 14:39:11,143][36141] DAMAGECOUNT value on done: 1244587.0 [2023-02-25 14:39:11,143][36141] Sum rewards: 58.268, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.820', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon5': '0.168', 'weapon4': '0.220', 'AMMO4': '0.246', 'AMMO3': '0.255', 'weapon2': '0.268', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.074', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '52.000'} [2023-02-25 14:39:11,180][36154] DAMAGECOUNT value on done: 1249942.0 [2023-02-25 14:39:11,181][36154] Sum rewards: 59.738, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.050', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.028', 'AMMO4': '0.053', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.250', 'AMMO3': '0.288', 'weapon2': '0.380', 'WEAPON3': '1.750', 'weapon3': '3.060', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.473', 'FRAGCOUNT': '54.000'} [2023-02-25 14:39:11,439][36141] DAMAGECOUNT value on done: 1229019.0 [2023-02-25 14:39:11,439][36141] Sum rewards: 54.806, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.430', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.122', 'weapon4': '0.134', 'AMMO4': '0.147', 'AMMO3': '0.179', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.468', 'WEAPON3': '1.050', 'HITCOUNT': '2.840', 'weapon3': '2.996', 'DAMAGECOUNT': '14.106', 'FRAGCOUNT': '47.000'} [2023-02-25 14:39:11,493][36154] DAMAGECOUNT value on done: 1238333.0 [2023-02-25 14:39:11,494][36154] Sum rewards: 53.854, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.710', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO4': '0.189', 'AMMO3': '0.195', 'weapon5': '0.306', 'WEAPON5': '0.350', 'weapon2': '0.386', 'WEAPON4': '0.600', 'weapon4': '1.130', 'WEAPON3': '1.200', 'weapon3': '1.884', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.796', 'FRAGCOUNT': '49.000'} [2023-02-25 14:39:12,362][36138] Updated weights for policy 0, policy_version 53823 (0.0009) [2023-02-25 14:39:12,474][36155] DAMAGECOUNT value on done: 1234510.0 [2023-02-25 14:39:12,474][36155] Sum rewards: 63.427, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.648', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'weapon5': '0.180', 'WEAPON4': '0.200', 'weapon2': '0.348', 'ARMOR': '0.404', 'weapon4': '0.496', 'WEAPON3': '1.100', 'weapon3': '2.600', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '15.744', 'FRAGCOUNT': '52.000'} [2023-02-25 14:39:12,781][36155] DAMAGECOUNT value on done: 1241264.0 [2023-02-25 14:39:12,782][36155] Sum rewards: 64.602, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.080', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.016', 'weapon5': '0.048', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon2': '0.432', 'weapon4': '0.506', 'WEAPON3': '1.550', 'weapon3': '2.802', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '15.963', 'FRAGCOUNT': '56.000'} [2023-02-25 14:39:12,842][36139] DAMAGECOUNT value on done: 1239226.0 [2023-02-25 14:39:12,842][36139] Sum rewards: 68.037, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.236', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.092', 'AMMO4': '0.128', 'weapon4': '0.180', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.504', 'WEAPON3': '1.400', 'weapon3': '3.022', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '59.000'} [2023-02-25 14:39:13,169][36139] DAMAGECOUNT value on done: 1233867.0 [2023-02-25 14:39:13,170][36139] Sum rewards: 52.397, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.582', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon5': '0.176', 'weapon2': '0.190', 'AMMO3': '0.223', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.730', 'WEAPON3': '1.350', 'weapon3': '2.582', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.926', 'FRAGCOUNT': '46.000'} [2023-02-25 14:39:13,373][36139] DAMAGECOUNT value on done: 1250889.0 [2023-02-25 14:39:13,373][36139] Sum rewards: 56.112, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.960', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.124', 'AMMO3': '0.196', 'AMMO4': '0.215', 'WEAPON5': '0.250', 'weapon2': '0.344', 'weapon4': '0.430', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.880', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.838', 'FRAGCOUNT': '49.000'} [2023-02-25 14:39:13,634][36155] DAMAGECOUNT value on done: 1255580.0 [2023-02-25 14:39:13,634][36155] Sum rewards: 51.242, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.930', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.140', 'weapon2': '0.180', 'AMMO3': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.796', 'WEAPON3': '1.150', 'weapon3': '2.504', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.119', 'FRAGCOUNT': '44.000'} [2023-02-25 14:39:13,693][36139] DAMAGECOUNT value on done: 1244313.0 [2023-02-25 14:39:13,694][36139] Sum rewards: 55.585, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.164', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon5': '0.144', 'AMMO4': '0.157', 'AMMO3': '0.187', 'weapon2': '0.342', 'WEAPON5': '0.400', 'ARMOR': '0.451', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'weapon4': '1.034', 'weapon3': '2.118', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.820', 'FRAGCOUNT': '46.000'} [2023-02-25 14:39:13,946][36155] DAMAGECOUNT value on done: 1236100.0 [2023-02-25 14:39:13,947][36155] Sum rewards: 64.277, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.356', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.070', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'weapon4': '0.246', 'weapon2': '0.318', 'WEAPON3': '1.000', 'HITCOUNT': '3.040', 'weapon3': '3.196', 'DAMAGECOUNT': '15.183', 'FRAGCOUNT': '53.000'} [2023-02-25 14:39:14,526][36157] DAMAGECOUNT value on done: 1248228.0 [2023-02-25 14:39:14,526][36157] Sum rewards: 64.150, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.846', 'AMMO5': '0.017', 'AMMO2': '0.054', 'AMMO3': '0.209', 'AMMO4': '0.268', 'weapon2': '0.276', 'weapon5': '0.322', 'weapon4': '0.404', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.676', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.560', 'FRAGCOUNT': '57.000'} [2023-02-25 14:39:14,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13371.0). Total num frames: 220487680. Throughput: 0: 3349.1. Samples: 17616736. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:39:14,730][36114] Avg episode reward: [(0, '59.079')] [2023-02-25 14:39:14,846][36157] DAMAGECOUNT value on done: 1239192.0 [2023-02-25 14:39:14,847][36157] Sum rewards: 53.031, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.825', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.063', 'weapon5': '0.092', 'weapon2': '0.164', 'weapon4': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.261', 'WEAPON3': '1.600', 'HITCOUNT': '2.920', 'weapon3': '3.252', 'DAMAGECOUNT': '14.118', 'FRAGCOUNT': '47.000'} [2023-02-25 14:39:14,971][36157] DAMAGECOUNT value on done: 1249763.0 [2023-02-25 14:39:14,972][36157] Sum rewards: 57.313, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.641', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'AMMO3': '0.155', 'weapon4': '0.214', 'weapon2': '0.764', 'WEAPON3': '0.950', 'HITCOUNT': '2.890', 'weapon3': '2.914', 'DAMAGECOUNT': '13.458', 'FRAGCOUNT': '47.000'} [2023-02-25 14:39:15,288][36157] DAMAGECOUNT value on done: 1244017.0 [2023-02-25 14:39:15,289][36157] Sum rewards: 52.141, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.460', 'AMMO5': '0.009', 'AMMO2': '0.010', 'weapon5': '0.024', 'WEAPON4': '0.050', 'AMMO4': '0.050', 'WEAPON5': '0.100', 'weapon2': '0.126', 'AMMO3': '0.184', 'weapon4': '0.366', 'WEAPON3': '1.250', 'HITCOUNT': '2.880', 'weapon3': '3.344', 'DAMAGECOUNT': '13.707', 'FRAGCOUNT': '43.000'} [2023-02-25 14:39:15,427][36138] Updated weights for policy 0, policy_version 53833 (0.0009) [2023-02-25 14:39:15,471][36140] DAMAGECOUNT value on done: 1248348.0 [2023-02-25 14:39:15,471][36140] Sum rewards: 53.681, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.918', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.052', 'AMMO3': '0.187', 'AMMO4': '0.222', 'weapon2': '0.228', 'WEAPON5': '0.250', 'weapon4': '0.282', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.040', 'weapon3': '3.220', 'DAMAGECOUNT': '15.114', 'FRAGCOUNT': '45.000'} [2023-02-25 14:39:15,492][36140] DAMAGECOUNT value on done: 1241208.0 [2023-02-25 14:39:15,493][36140] Sum rewards: 48.063, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.900', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO5': '0.027', 'AMMO2': '0.070', 'AMMO3': '0.199', 'weapon2': '0.312', 'AMMO4': '0.349', 'weapon5': '0.372', 'weapon4': '0.470', 'WEAPON5': '0.700', 'WEAPON4': '0.750', 'WEAPON3': '1.150', 'weapon3': '2.382', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '14.868', 'FRAGCOUNT': '43.500'} [2023-02-25 14:39:15,775][36140] DAMAGECOUNT value on done: 1232713.0 [2023-02-25 14:39:15,776][36140] Sum rewards: 58.835, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.932', 'ARMOR': '0.005', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.034', 'AMMO3': '0.160', 'AMMO4': '0.163', 'WEAPON5': '0.200', 'weapon5': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.468', 'WEAPON3': '1.050', 'weapon3': '3.012', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.324', 'FRAGCOUNT': '49.500'} [2023-02-25 14:39:15,796][36140] DAMAGECOUNT value on done: 1233174.0 [2023-02-25 14:39:15,797][36140] Sum rewards: 60.167, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.430', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.082', 'AMMO4': '0.160', 'AMMO3': '0.175', 'weapon4': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'ARMOR': '0.508', 'weapon2': '0.808', 'WEAPON3': '1.050', 'weapon3': '2.662', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.480', 'FRAGCOUNT': '50.000'} [2023-02-25 14:39:18,134][36142] DAMAGECOUNT value on done: 1239119.0 [2023-02-25 14:39:18,135][36142] Sum rewards: 60.659, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.835', 'AMMO2': '0.021', 'weapon4': '0.054', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.185', 'weapon2': '0.348', 'WEAPON3': '1.150', 'HITCOUNT': '3.100', 'weapon3': '3.436', 'DAMAGECOUNT': '14.244', 'FRAGCOUNT': '51.000'} [2023-02-25 14:39:18,449][36142] DAMAGECOUNT value on done: 1229475.0 [2023-02-25 14:39:18,450][36142] Sum rewards: 58.775, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.600', 'AMMO5': '0.007', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'weapon5': '0.140', 'AMMO4': '0.164', 'weapon4': '0.210', 'weapon2': '0.240', 'AMMO3': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'HITCOUNT': '2.860', 'weapon3': '3.144', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '53.000'} [2023-02-25 14:39:18,524][36138] Updated weights for policy 0, policy_version 53843 (0.0010) [2023-02-25 14:39:19,079][36142] DAMAGECOUNT value on done: 1242499.0 [2023-02-25 14:39:19,079][36142] Sum rewards: 59.231, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.302', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.088', 'AMMO4': '0.173', 'AMMO3': '0.180', 'WEAPON5': '0.250', 'weapon2': '0.344', 'WEAPON4': '0.350', 'weapon4': '0.402', 'WEAPON3': '1.100', 'weapon3': '2.996', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '51.000'} [2023-02-25 14:39:19,380][36142] DAMAGECOUNT value on done: 1247015.0 [2023-02-25 14:39:19,381][36142] Sum rewards: 49.877, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.473', 'AMMO5': '0.009', 'AMMO2': '0.031', 'AMMO4': '0.153', 'weapon5': '0.164', 'WEAPON5': '0.200', 'weapon4': '0.210', 'weapon2': '0.232', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '2.740', 'weapon3': '3.144', 'DAMAGECOUNT': '12.966', 'FRAGCOUNT': '47.000'} [2023-02-25 14:39:19,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13312.0, 300 sec: 13371.0). Total num frames: 220553216. Throughput: 0: 3343.8. Samples: 17636790. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:39:19,730][36114] Avg episode reward: [(0, '58.938')] [2023-02-25 14:39:19,734][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000053847_220557312.pth... [2023-02-25 14:39:19,793][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000053063_217346048.pth [2023-02-25 14:39:20,350][36156] DAMAGECOUNT value on done: 1253942.0 [2023-02-25 14:39:20,350][36156] Sum rewards: 59.895, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.375', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.044', 'AMMO4': '0.088', 'weapon4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.398', 'WEAPON3': '1.300', 'weapon3': '3.250', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.162', 'FRAGCOUNT': '51.000'} [2023-02-25 14:39:20,659][36156] DAMAGECOUNT value on done: 1246051.0 [2023-02-25 14:39:20,659][36156] Sum rewards: 62.538, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.805', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.044', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon4': '0.228', 'weapon2': '0.458', 'WEAPON3': '1.050', 'weapon3': '3.102', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.249', 'FRAGCOUNT': '52.000'} [2023-02-25 14:39:20,669][36156] DAMAGECOUNT value on done: 1236564.0 [2023-02-25 14:39:20,669][36156] Sum rewards: 70.289, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.490', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.200', 'AMMO3': '0.203', 'weapon2': '0.210', 'WEAPON3': '1.350', 'weapon3': '3.326', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '59.000'} [2023-02-25 14:39:20,989][36156] DAMAGECOUNT value on done: 1235600.0 [2023-02-25 14:39:20,989][36156] Sum rewards: 54.525, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.324', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.188', 'AMMO3': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.388', 'weapon2': '0.506', 'WEAPON3': '1.350', 'weapon3': '2.662', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.654', 'FRAGCOUNT': '48.000'} [2023-02-25 14:39:21,601][36138] Updated weights for policy 0, policy_version 53853 (0.0009) [2023-02-25 14:39:24,618][36138] Updated weights for policy 0, policy_version 53863 (0.0009) [2023-02-25 14:39:24,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13371.0). Total num frames: 220622848. Throughput: 0: 3342.7. Samples: 17646806. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:39:24,729][36114] Avg episode reward: [(0, '58.995')] [2023-02-25 14:39:25,094][36157] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:39:27,677][36138] Updated weights for policy 0, policy_version 53873 (0.0009) [2023-02-25 14:39:28,826][36139] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:39:29,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13371.0). Total num frames: 220688384. Throughput: 0: 3347.9. Samples: 17667064. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:39:29,730][36114] Avg episode reward: [(0, '58.995')] [2023-02-25 14:39:30,513][36154] DAMAGECOUNT value on done: 1254640.0 [2023-02-25 14:39:30,513][36154] Sum rewards: 61.844, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.096', 'AMMO5': '0.015', 'AMMO2': '0.062', 'AMMO3': '0.122', 'weapon5': '0.198', 'AMMO4': '0.312', 'WEAPON5': '0.350', 'weapon2': '0.454', 'WEAPON4': '0.600', 'WEAPON3': '0.800', 'weapon4': '0.810', 'weapon3': '2.128', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '52.000'} [2023-02-25 14:39:30,728][36138] Updated weights for policy 0, policy_version 53883 (0.0009) [2023-02-25 14:39:30,823][36154] DAMAGECOUNT value on done: 1230820.0 [2023-02-25 14:39:30,824][36154] Sum rewards: 48.076, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.250', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.024', 'AMMO4': '0.121', 'AMMO3': '0.152', 'weapon5': '0.178', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.458', 'weapon4': '0.642', 'WEAPON3': '0.900', 'weapon3': '2.476', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '12.294', 'FRAGCOUNT': '38.500'} [2023-02-25 14:39:30,825][36141] DAMAGECOUNT value on done: 1252794.0 [2023-02-25 14:39:30,825][36141] Sum rewards: 53.941, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.570', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.039', 'AMMO3': '0.154', 'AMMO4': '0.195', 'weapon5': '0.246', 'weapon2': '0.324', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.526', 'WEAPON3': '1.050', 'weapon3': '2.574', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '46.500'} [2023-02-25 14:39:31,119][36154] DAMAGECOUNT value on done: 1255436.0 [2023-02-25 14:39:31,119][36154] Sum rewards: 63.636, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.690', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.068', 'weapon4': '0.090', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'weapon2': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.252', 'WEAPON3': '1.450', 'HITCOUNT': '3.400', 'weapon3': '3.452', 'DAMAGECOUNT': '16.482', 'FRAGCOUNT': '56.000'} [2023-02-25 14:39:31,121][36141] DAMAGECOUNT value on done: 1239898.0 [2023-02-25 14:39:31,121][36141] Sum rewards: 46.067, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.306', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.043', 'AMMO3': '0.168', 'AMMO4': '0.216', 'weapon5': '0.240', 'weapon2': '0.288', 'weapon4': '0.356', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'HITCOUNT': '2.500', 'weapon3': '2.862', 'DAMAGECOUNT': '11.973', 'FRAGCOUNT': '42.000'} [2023-02-25 14:39:31,130][36141] DAMAGECOUNT value on done: 1249635.0 [2023-02-25 14:39:31,130][36141] Sum rewards: 59.360, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.377', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.150', 'AMMO4': '0.150', 'weapon4': '0.208', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.424', 'WEAPON3': '1.300', 'weapon3': '2.980', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.144', 'FRAGCOUNT': '51.000'} [2023-02-25 14:39:31,419][36154] DAMAGECOUNT value on done: 1242945.0 [2023-02-25 14:39:31,420][36154] Sum rewards: 53.005, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.884', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO4': '0.140', 'AMMO3': '0.171', 'weapon4': '0.296', 'WEAPON4': '0.300', 'weapon2': '0.518', 'WEAPON3': '1.000', 'weapon3': '2.860', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.836', 'FRAGCOUNT': '45.000'} [2023-02-25 14:39:31,437][36141] DAMAGECOUNT value on done: 1233840.0 [2023-02-25 14:39:31,438][36141] Sum rewards: 59.480, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.515', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.028', 'weapon5': '0.102', 'AMMO4': '0.140', 'AMMO3': '0.152', 'weapon2': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.724', 'WEAPON3': '0.850', 'weapon3': '2.776', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.463', 'FRAGCOUNT': '51.000'} [2023-02-25 14:39:32,619][36155] DAMAGECOUNT value on done: 1240386.0 [2023-02-25 14:39:32,619][36155] Sum rewards: 71.524, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.262', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon5': '0.058', 'AMMO4': '0.073', 'weapon4': '0.104', 'WEAPON4': '0.150', 'weapon2': '0.172', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'WEAPON3': '1.550', 'HITCOUNT': '3.350', 'weapon3': '3.454', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '62.000'} [2023-02-25 14:39:32,882][36139] DAMAGECOUNT value on done: 1244910.0 [2023-02-25 14:39:32,883][36139] Sum rewards: 68.365, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.300', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'weapon4': '0.386', 'weapon2': '0.662', 'WEAPON3': '1.150', 'weapon3': '2.754', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '57.000'} [2023-02-25 14:39:32,918][36155] DAMAGECOUNT value on done: 1246136.0 [2023-02-25 14:39:32,919][36155] Sum rewards: 50.862, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.122', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'AMMO5': '0.026', 'AMMO2': '0.084', 'AMMO3': '0.148', 'weapon5': '0.172', 'AMMO4': '0.418', 'weapon2': '0.450', 'WEAPON5': '0.700', 'WEAPON4': '0.950', 'WEAPON3': '0.950', 'weapon4': '1.024', 'weapon3': '2.058', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.616', 'FRAGCOUNT': '46.000'} [2023-02-25 14:39:33,186][36139] DAMAGECOUNT value on done: 1239162.0 [2023-02-25 14:39:33,187][36139] Sum rewards: 62.180, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.188', 'AMMO5': '0.005', 'AMMO2': '0.048', 'weapon5': '0.090', 'WEAPON5': '0.150', 'weapon2': '0.160', 'AMMO3': '0.212', 'AMMO4': '0.240', 'WEAPON4': '0.400', 'weapon4': '0.526', 'WEAPON3': '1.350', 'weapon3': '2.962', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '55.000'} [2023-02-25 14:39:33,411][36139] DAMAGECOUNT value on done: 1255416.0 [2023-02-25 14:39:33,411][36139] Sum rewards: 56.788, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.800', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.084', 'AMMO4': '0.176', 'weapon2': '0.212', 'weapon4': '0.220', 'AMMO3': '0.243', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.050', 'weapon3': '3.228', 'DAMAGECOUNT': '13.581', 'FRAGCOUNT': '53.000'} [2023-02-25 14:39:33,709][36155] DAMAGECOUNT value on done: 1260533.0 [2023-02-25 14:39:33,709][36155] Sum rewards: 59.266, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.891', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.184', 'AMMO3': '0.222', 'weapon2': '0.272', 'WEAPON3': '1.350', 'HITCOUNT': '3.010', 'weapon3': '3.240', 'DAMAGECOUNT': '14.859', 'FRAGCOUNT': '51.000'} [2023-02-25 14:39:33,722][36139] DAMAGECOUNT value on done: 1249543.0 [2023-02-25 14:39:33,723][36139] Sum rewards: 60.719, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.957', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.158', 'AMMO3': '0.159', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.498', 'weapon4': '0.514', 'WEAPON3': '0.900', 'weapon3': '2.636', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '50.000'} [2023-02-25 14:39:33,764][36138] Updated weights for policy 0, policy_version 53893 (0.0009) [2023-02-25 14:39:34,004][36155] DAMAGECOUNT value on done: 1241606.0 [2023-02-25 14:39:34,004][36155] Sum rewards: 64.089, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.499', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.063', 'AMMO3': '0.162', 'weapon5': '0.226', 'weapon2': '0.264', 'AMMO4': '0.314', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'weapon4': '0.654', 'WEAPON3': '1.050', 'weapon3': '2.542', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '55.500'} [2023-02-25 14:39:34,512][36157] DAMAGECOUNT value on done: 1252465.0 [2023-02-25 14:39:34,512][36157] Sum rewards: 47.053, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.822', 'ARMOR': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.050', 'weapon5': '0.142', 'weapon2': '0.174', 'AMMO3': '0.205', 'AMMO4': '0.248', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.662', 'WEAPON3': '1.200', 'weapon3': '2.596', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.711', 'FRAGCOUNT': '44.000'} [2023-02-25 14:39:34,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 220758016. Throughput: 0: 3351.7. Samples: 17687292. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:39:34,730][36114] Avg episode reward: [(0, '58.478')] [2023-02-25 14:39:34,812][36157] DAMAGECOUNT value on done: 1244472.0 [2023-02-25 14:39:34,812][36157] Sum rewards: 62.937, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.660', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon5': '0.096', 'weapon4': '0.116', 'AMMO4': '0.127', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.734', 'WEAPON3': '1.250', 'weapon3': '2.780', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.840', 'FRAGCOUNT': '54.000'} [2023-02-25 14:39:34,934][36157] DAMAGECOUNT value on done: 1255023.0 [2023-02-25 14:39:34,935][36157] Sum rewards: 67.283, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.356', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.190', 'weapon2': '0.362', 'weapon4': '0.690', 'WEAPON3': '1.250', 'weapon3': '2.734', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '15.780', 'FRAGCOUNT': '56.000'} [2023-02-25 14:39:35,250][36157] DAMAGECOUNT value on done: 1247041.0 [2023-02-25 14:39:35,251][36157] Sum rewards: 38.779, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.363', 'ARMOR': '0.004', 'AMMO2': '0.020', 'weapon7': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.144', 'WEAPON4': '0.200', 'weapon2': '0.226', 'weapon4': '0.676', 'WEAPON3': '0.800', 'weapon3': '1.600', 'HITCOUNT': '1.940', 'DAMAGECOUNT': '9.072', 'FRAGCOUNT': '33.000'} [2023-02-25 14:39:35,467][36140] DAMAGECOUNT value on done: 1253784.0 [2023-02-25 14:39:35,467][36140] Sum rewards: 68.662, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.333', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.007', 'weapon4': '0.028', 'AMMO4': '0.037', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'weapon2': '0.382', 'WEAPON3': '1.150', 'HITCOUNT': '3.280', 'weapon3': '3.364', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '57.000'} [2023-02-25 14:39:35,489][36140] DAMAGECOUNT value on done: 1246894.0 [2023-02-25 14:39:35,490][36140] Sum rewards: 70.294, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.672', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.149', 'weapon2': '0.740', 'WEAPON3': '0.900', 'weapon3': '2.914', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '56.000'} [2023-02-25 14:39:35,787][36140] DAMAGECOUNT value on done: 1237094.0 [2023-02-25 14:39:35,787][36140] Sum rewards: 46.448, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.388', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.048', 'AMMO3': '0.198', 'weapon5': '0.202', 'AMMO4': '0.241', 'weapon2': '0.246', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.574', 'WEAPON3': '1.150', 'HITCOUNT': '2.600', 'weapon3': '2.666', 'DAMAGECOUNT': '13.143', 'FRAGCOUNT': '42.500'} [2023-02-25 14:39:35,810][36140] DAMAGECOUNT value on done: 1237798.0 [2023-02-25 14:39:35,810][36140] Sum rewards: 53.004, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.788', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon2': '0.184', 'AMMO3': '0.212', 'weapon5': '0.230', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.748', 'WEAPON3': '1.150', 'weapon3': '2.522', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.872', 'FRAGCOUNT': '47.000'} [2023-02-25 14:39:36,784][36138] Updated weights for policy 0, policy_version 53903 (0.0009) [2023-02-25 14:39:38,115][36142] DAMAGECOUNT value on done: 1243670.0 [2023-02-25 14:39:38,116][36142] Sum rewards: 54.427, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.569', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.126', 'weapon4': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'weapon2': '0.234', 'WEAPON3': '1.350', 'HITCOUNT': '2.810', 'weapon3': '3.300', 'DAMAGECOUNT': '13.653', 'FRAGCOUNT': '48.000'} [2023-02-25 14:39:38,437][36142] DAMAGECOUNT value on done: 1234572.0 [2023-02-25 14:39:38,438][36142] Sum rewards: 55.639, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.000', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.271', 'weapon2': '0.406', 'weapon4': '0.610', 'WEAPON3': '1.500', 'weapon3': '2.424', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.291', 'FRAGCOUNT': '50.000'} [2023-02-25 14:39:39,041][36142] DAMAGECOUNT value on done: 1245511.0 [2023-02-25 14:39:39,042][36142] Sum rewards: 31.554, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.757', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.068', 'weapon7': '0.084', 'AMMO4': '0.095', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.152', 'AMMO3': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.784', 'WEAPON3': '1.000', 'HITCOUNT': '1.850', 'weapon3': '2.114', 'DAMAGECOUNT': '9.036', 'FRAGCOUNT': '29.000'} [2023-02-25 14:39:39,341][36142] DAMAGECOUNT value on done: 1250414.0 [2023-02-25 14:39:39,341][36142] Sum rewards: 35.476, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.220', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon5': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon2': '0.304', 'WEAPON4': '0.400', 'weapon4': '0.568', 'WEAPON3': '1.150', 'HITCOUNT': '2.230', 'weapon3': '2.662', 'DAMAGECOUNT': '10.197', 'FRAGCOUNT': '34.000'} [2023-02-25 14:39:39,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13371.0). Total num frames: 220823552. Throughput: 0: 3354.3. Samples: 17697462. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:39:39,729][36114] Avg episode reward: [(0, '58.096')] [2023-02-25 14:39:39,810][36138] Updated weights for policy 0, policy_version 53913 (0.0009) [2023-02-25 14:39:40,199][36156] DAMAGECOUNT value on done: 1257956.0 [2023-02-25 14:39:40,200][36156] Sum rewards: 49.622, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.000', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.122', 'AMMO3': '0.131', 'AMMO4': '0.152', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.300', 'WEAPON3': '0.750', 'weapon4': '0.750', 'HITCOUNT': '2.420', 'weapon3': '2.546', 'DAMAGECOUNT': '11.712', 'FRAGCOUNT': '41.000'} [2023-02-25 14:39:40,503][36156] DAMAGECOUNT value on done: 1241229.0 [2023-02-25 14:39:40,504][36156] Sum rewards: 45.652, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.732', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.044', 'WEAPON5': '0.150', 'AMMO4': '0.192', 'AMMO3': '0.279', 'weapon2': '0.296', 'WEAPON4': '0.400', 'weapon4': '0.528', 'WEAPON3': '1.500', 'weapon3': '2.580', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.995', 'FRAGCOUNT': '43.000'} [2023-02-25 14:39:40,516][36156] DAMAGECOUNT value on done: 1250934.0 [2023-02-25 14:39:40,517][36156] Sum rewards: 54.110, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.220', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'weapon2': '0.168', 'weapon4': '0.202', 'AMMO3': '0.309', 'WEAPON3': '1.800', 'HITCOUNT': '2.980', 'weapon3': '3.354', 'DAMAGECOUNT': '14.649', 'FRAGCOUNT': '50.000'} [2023-02-25 14:39:40,828][36156] DAMAGECOUNT value on done: 1241034.0 [2023-02-25 14:39:40,829][36156] Sum rewards: 66.450, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.513', 'ARMOR': '0.004', 'AMMO2': '0.037', 'AMMO3': '0.181', 'AMMO4': '0.183', 'weapon2': '0.224', 'WEAPON4': '0.350', 'weapon4': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.272', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '56.000'} [2023-02-25 14:39:42,834][36138] Updated weights for policy 0, policy_version 53923 (0.0009) [2023-02-25 14:39:44,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13384.9). Total num frames: 220893184. Throughput: 0: 3359.1. Samples: 17717714. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:39:44,729][36114] Avg episode reward: [(0, '57.838')] [2023-02-25 14:39:45,899][36138] Updated weights for policy 0, policy_version 53933 (0.0009) [2023-02-25 14:39:48,964][36138] Updated weights for policy 0, policy_version 53943 (0.0009) [2023-02-25 14:39:49,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 220958720. Throughput: 0: 3354.1. Samples: 17737700. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:39:49,730][36114] Avg episode reward: [(0, '57.838')] [2023-02-25 14:39:50,560][36154] DAMAGECOUNT value on done: 1259702.0 [2023-02-25 14:39:50,561][36154] Sum rewards: 53.993, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.522', 'AMMO5': '0.020', 'AMMO2': '0.048', 'AMMO3': '0.180', 'AMMO4': '0.241', 'weapon2': '0.248', 'weapon5': '0.304', 'WEAPON5': '0.450', 'weapon4': '0.496', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.600', 'weapon3': '2.642', 'DAMAGECOUNT': '15.186', 'FRAGCOUNT': '45.000'} [2023-02-25 14:39:50,807][36141] DAMAGECOUNT value on done: 1257512.0 [2023-02-25 14:39:50,807][36141] Sum rewards: 56.681, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.212', 'AMMO5': '0.015', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.152', 'WEAPON4': '0.200', 'weapon4': '0.200', 'AMMO3': '0.202', 'WEAPON5': '0.350', 'weapon2': '0.720', 'WEAPON3': '1.200', 'weapon3': '2.682', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.154', 'FRAGCOUNT': '48.000'} [2023-02-25 14:39:50,865][36154] DAMAGECOUNT value on done: 1235618.0 [2023-02-25 14:39:50,866][36154] Sum rewards: 52.502, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.295', 'AMMO5': '0.019', 'AMMO2': '0.047', 'AMMO3': '0.126', 'weapon5': '0.126', 'AMMO4': '0.233', 'WEAPON5': '0.400', 'weapon2': '0.406', 'WEAPON4': '0.550', 'weapon4': '0.646', 'WEAPON3': '0.750', 'weapon3': '2.500', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.394', 'FRAGCOUNT': '44.000'} [2023-02-25 14:39:51,119][36141] DAMAGECOUNT value on done: 1254920.0 [2023-02-25 14:39:51,119][36141] Sum rewards: 61.429, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.120', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON4': '0.150', 'weapon5': '0.178', 'AMMO3': '0.183', 'weapon4': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.344', 'WEAPON3': '1.100', 'weapon3': '3.034', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '50.000'} [2023-02-25 14:39:51,171][36141] DAMAGECOUNT value on done: 1244321.0 [2023-02-25 14:39:51,171][36141] Sum rewards: 52.655, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.025', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.127', 'WEAPON4': '0.300', 'weapon2': '0.428', 'weapon4': '0.754', 'WEAPON3': '0.850', 'weapon3': '2.444', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.269', 'FRAGCOUNT': '43.000'} [2023-02-25 14:39:51,176][36154] DAMAGECOUNT value on done: 1261011.0 [2023-02-25 14:39:51,177][36154] Sum rewards: 69.638, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.842', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.092', 'weapon5': '0.094', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon2': '0.282', 'WEAPON3': '1.500', 'weapon3': '3.320', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '61.000'} [2023-02-25 14:39:51,479][36141] DAMAGECOUNT value on done: 1239327.0 [2023-02-25 14:39:51,480][36141] Sum rewards: 61.831, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.221', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.108', 'AMMO4': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon4': '0.290', 'WEAPON4': '0.300', 'weapon2': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.786', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '53.000'} [2023-02-25 14:39:51,489][36154] DAMAGECOUNT value on done: 1248142.0 [2023-02-25 14:39:51,490][36154] Sum rewards: 53.320, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.539', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.051', 'AMMO3': '0.174', 'weapon2': '0.188', 'AMMO4': '0.257', 'weapon5': '0.282', 'WEAPON5': '0.550', 'weapon4': '0.554', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.676', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '15.561', 'FRAGCOUNT': '44.500'} [2023-02-25 14:39:51,983][36138] Updated weights for policy 0, policy_version 53953 (0.0009) [2023-02-25 14:39:52,509][36155] DAMAGECOUNT value on done: 1246266.0 [2023-02-25 14:39:52,510][36155] Sum rewards: 72.176, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.223', 'AMMO5': '0.010', 'AMMO2': '0.064', 'AMMO3': '0.159', 'weapon2': '0.192', 'weapon5': '0.220', 'AMMO4': '0.321', 'WEAPON5': '0.350', 'WEAPON4': '0.650', 'WEAPON3': '0.950', 'weapon4': '1.004', 'weapon3': '2.258', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '59.000'} [2023-02-25 14:39:52,787][36139] DAMAGECOUNT value on done: 1250469.0 [2023-02-25 14:39:52,787][36139] Sum rewards: 60.499, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.707', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.055', 'AMMO3': '0.137', 'weapon5': '0.156', 'AMMO4': '0.277', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.564', 'weapon4': '0.578', 'WEAPON3': '0.950', 'weapon3': '2.492', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '49.500'} [2023-02-25 14:39:52,830][36155] DAMAGECOUNT value on done: 1250491.0 [2023-02-25 14:39:52,830][36155] Sum rewards: 50.883, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.841', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon5': '0.052', 'weapon4': '0.138', 'AMMO4': '0.173', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.500', 'HITCOUNT': '2.920', 'weapon3': '3.282', 'DAMAGECOUNT': '13.065', 'FRAGCOUNT': '48.000'} [2023-02-25 14:39:53,089][36139] DAMAGECOUNT value on done: 1243726.0 [2023-02-25 14:39:53,089][36139] Sum rewards: 54.905, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.540', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.016', 'weapon5': '0.046', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.334', 'WEAPON3': '1.250', 'HITCOUNT': '2.920', 'weapon3': '3.404', 'DAMAGECOUNT': '13.692', 'FRAGCOUNT': '47.000'} [2023-02-25 14:39:53,371][36139] DAMAGECOUNT value on done: 1260018.0 [2023-02-25 14:39:53,371][36139] Sum rewards: 54.794, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.295', 'AMMO5': '0.016', 'AMMO2': '0.023', 'AMMO4': '0.117', 'weapon5': '0.172', 'AMMO3': '0.197', 'weapon4': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.322', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.950', 'weapon3': '3.022', 'DAMAGECOUNT': '13.806', 'FRAGCOUNT': '48.000'} [2023-02-25 14:39:53,656][36155] DAMAGECOUNT value on done: 1265678.0 [2023-02-25 14:39:53,657][36155] Sum rewards: 58.716, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.646', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.044', 'AMMO3': '0.146', 'weapon5': '0.150', 'WEAPON5': '0.200', 'AMMO4': '0.220', 'weapon2': '0.430', 'WEAPON4': '0.550', 'weapon4': '0.906', 'WEAPON3': '1.000', 'weapon3': '2.328', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.435', 'FRAGCOUNT': '50.000'} [2023-02-25 14:39:53,672][36139] DAMAGECOUNT value on done: 1255138.0 [2023-02-25 14:39:53,672][36139] Sum rewards: 66.588, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.784', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.204', 'AMMO3': '0.215', 'weapon2': '0.404', 'WEAPON3': '1.300', 'weapon3': '3.062', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '56.000'} [2023-02-25 14:39:53,968][36155] DAMAGECOUNT value on done: 1246343.0 [2023-02-25 14:39:53,968][36155] Sum rewards: 53.943, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.192', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon2': '0.148', 'AMMO3': '0.166', 'AMMO4': '0.198', 'weapon5': '0.256', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.524', 'WEAPON3': '1.050', 'weapon3': '2.832', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.211', 'FRAGCOUNT': '45.000'} [2023-02-25 14:39:54,549][36157] DAMAGECOUNT value on done: 1258482.0 [2023-02-25 14:39:54,549][36157] Sum rewards: 63.959, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.000', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.050', 'weapon5': '0.168', 'AMMO3': '0.208', 'AMMO4': '0.249', 'weapon4': '0.322', 'WEAPON5': '0.400', 'weapon2': '0.414', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.792', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.051', 'FRAGCOUNT': '54.000'} [2023-02-25 14:39:54,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 221024256. Throughput: 0: 3356.3. Samples: 17747750. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:39:54,730][36114] Avg episode reward: [(0, '57.613')] [2023-02-25 14:39:54,866][36157] DAMAGECOUNT value on done: 1249786.0 [2023-02-25 14:39:54,866][36157] Sum rewards: 59.267, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.882', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.041', 'AMMO3': '0.107', 'AMMO4': '0.207', 'weapon5': '0.318', 'weapon4': '0.502', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.746', 'WEAPON3': '0.750', 'weapon3': '2.130', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.942', 'FRAGCOUNT': '48.000'} [2023-02-25 14:39:54,986][36157] DAMAGECOUNT value on done: 1260173.0 [2023-02-25 14:39:54,986][36157] Sum rewards: 64.904, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.694', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO3': '0.129', 'AMMO4': '0.143', 'weapon5': '0.208', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'weapon4': '0.896', 'weapon3': '2.246', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '52.000'} [2023-02-25 14:39:55,052][36138] Updated weights for policy 0, policy_version 53963 (0.0009) [2023-02-25 14:39:55,299][36157] DAMAGECOUNT value on done: 1251681.0 [2023-02-25 14:39:55,300][36157] Sum rewards: 59.002, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.760', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon4': '0.354', 'weapon2': '0.494', 'WEAPON3': '1.200', 'weapon3': '2.976', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.920', 'FRAGCOUNT': '51.000'} [2023-02-25 14:39:55,520][36140] DAMAGECOUNT value on done: 1258259.0 [2023-02-25 14:39:55,521][36140] Sum rewards: 48.848, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.430', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.120', 'AMMO4': '0.183', 'WEAPON5': '0.200', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'weapon2': '0.372', 'weapon4': '0.592', 'WEAPON3': '1.450', 'weapon3': '2.592', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.425', 'FRAGCOUNT': '45.000'} [2023-02-25 14:39:55,542][36140] DAMAGECOUNT value on done: 1251994.0 [2023-02-25 14:39:55,543][36140] Sum rewards: 60.365, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.800', 'AMMO5': '0.005', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.244', 'weapon2': '0.264', 'weapon4': '0.556', 'WEAPON3': '1.400', 'weapon3': '2.784', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '53.500'} [2023-02-25 14:39:55,829][36140] DAMAGECOUNT value on done: 1241799.0 [2023-02-25 14:39:55,829][36140] Sum rewards: 56.851, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.754', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.101', 'weapon4': '0.154', 'AMMO3': '0.204', 'weapon2': '0.264', 'WEAPON3': '1.150', 'HITCOUNT': '3.070', 'weapon3': '3.420', 'DAMAGECOUNT': '14.115', 'FRAGCOUNT': '47.000'} [2023-02-25 14:39:55,851][36140] DAMAGECOUNT value on done: 1242731.0 [2023-02-25 14:39:55,852][36140] Sum rewards: 61.178, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.147', 'ARMOR': '0.004', 'AMMO2': '0.022', 'weapon4': '0.082', 'AMMO4': '0.109', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'weapon2': '0.516', 'WEAPON3': '1.100', 'weapon3': '3.250', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.799', 'FRAGCOUNT': '51.000'} [2023-02-25 14:39:58,103][36138] Updated weights for policy 0, policy_version 53973 (0.0009) [2023-02-25 14:39:58,257][36142] DAMAGECOUNT value on done: 1248876.0 [2023-02-25 14:39:58,258][36142] Sum rewards: 67.662, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.158', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.030', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'weapon2': '0.162', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'weapon4': '0.682', 'WEAPON3': '1.150', 'weapon3': '2.896', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '15.618', 'FRAGCOUNT': '57.000'} [2023-02-25 14:39:58,571][36142] DAMAGECOUNT value on done: 1240011.0 [2023-02-25 14:39:58,572][36142] Sum rewards: 56.883, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-1.974', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.098', 'AMMO4': '0.235', 'WEAPON5': '0.250', 'AMMO3': '0.283', 'WEAPON4': '0.350', 'weapon2': '0.472', 'weapon4': '0.502', 'WEAPON3': '1.550', 'weapon3': '2.612', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '53.000'} [2023-02-25 14:39:59,165][36142] DAMAGECOUNT value on done: 1250324.0 [2023-02-25 14:39:59,165][36142] Sum rewards: 56.950, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.644', 'AMMO5': '0.017', 'AMMO2': '0.028', 'weapon4': '0.090', 'weapon5': '0.120', 'AMMO4': '0.138', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.528', 'WEAPON3': '1.250', 'HITCOUNT': '2.860', 'weapon3': '2.968', 'DAMAGECOUNT': '14.439', 'FRAGCOUNT': '51.000'} [2023-02-25 14:39:59,481][36142] DAMAGECOUNT value on done: 1255283.0 [2023-02-25 14:39:59,482][36142] Sum rewards: 62.162, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.600', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.098', 'weapon5': '0.134', 'AMMO4': '0.140', 'AMMO3': '0.204', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.482', 'WEAPON3': '1.300', 'weapon3': '3.078', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.607', 'FRAGCOUNT': '57.000'} [2023-02-25 14:39:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 221093888. Throughput: 0: 3357.3. Samples: 17767816. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:39:59,730][36114] Avg episode reward: [(0, '57.827')] [2023-02-25 14:40:00,383][36156] DAMAGECOUNT value on done: 1263107.0 [2023-02-25 14:40:00,384][36156] Sum rewards: 60.551, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.262', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.096', 'AMMO4': '0.181', 'AMMO3': '0.212', 'weapon2': '0.214', 'WEAPON5': '0.300', 'weapon4': '0.342', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.128', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.453', 'FRAGCOUNT': '54.000'} [2023-02-25 14:40:00,700][36156] DAMAGECOUNT value on done: 1246599.0 [2023-02-25 14:40:00,700][36156] Sum rewards: 61.679, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.141', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.242', 'weapon4': '0.382', 'WEAPON3': '1.400', 'weapon3': '2.942', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '53.000'} [2023-02-25 14:40:00,716][36156] DAMAGECOUNT value on done: 1255955.0 [2023-02-25 14:40:00,716][36156] Sum rewards: 64.840, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.643', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.034', 'weapon5': '0.122', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'weapon2': '0.410', 'WEAPON3': '1.150', 'HITCOUNT': '3.070', 'weapon3': '3.178', 'DAMAGECOUNT': '15.063', 'FRAGCOUNT': '55.500'} [2023-02-25 14:40:01,043][36156] DAMAGECOUNT value on done: 1246099.0 [2023-02-25 14:40:01,043][36156] Sum rewards: 63.822, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.384', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.040', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon4': '0.332', 'weapon2': '0.452', 'WEAPON3': '1.250', 'weapon3': '2.994', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.195', 'FRAGCOUNT': '56.000'} [2023-02-25 14:40:01,146][36138] Updated weights for policy 0, policy_version 53983 (0.0010) [2023-02-25 14:40:04,204][36138] Updated weights for policy 0, policy_version 53993 (0.0009) [2023-02-25 14:40:04,649][36155] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:40:04,729][36114] Fps is (10 sec: 13517.0, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 221159424. Throughput: 0: 3357.0. Samples: 17787854. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:40:04,729][36114] Avg episode reward: [(0, '58.007')] [2023-02-25 14:40:07,259][36138] Updated weights for policy 0, policy_version 54003 (0.0009) [2023-02-25 14:40:08,746][36155] Large shaping reward 2.526 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.504, 168.0), ('weapon5', 0.002)] [2023-02-25 14:40:09,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 221229056. Throughput: 0: 3359.1. Samples: 17797964. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:40:09,730][36114] Avg episode reward: [(0, '58.007')] [2023-02-25 14:40:10,310][36138] Updated weights for policy 0, policy_version 54013 (0.0009) [2023-02-25 14:40:10,473][36154] DAMAGECOUNT value on done: 1264132.0 [2023-02-25 14:40:10,473][36154] Sum rewards: 57.888, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.170', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.129', 'WEAPON4': '0.250', 'weapon4': '0.324', 'weapon2': '0.506', 'WEAPON3': '0.850', 'HITCOUNT': '2.950', 'weapon3': '3.040', 'DAMAGECOUNT': '13.290', 'FRAGCOUNT': '48.000'} [2023-02-25 14:40:10,788][36154] DAMAGECOUNT value on done: 1240656.0 [2023-02-25 14:40:10,788][36154] Sum rewards: 55.648, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.114', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.150', 'AMMO4': '0.200', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'weapon2': '0.322', 'WEAPON4': '0.400', 'weapon4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.672', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '15.069', 'FRAGCOUNT': '51.000'} [2023-02-25 14:40:10,885][36141] DAMAGECOUNT value on done: 1262909.0 [2023-02-25 14:40:10,886][36141] Sum rewards: 56.822, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.752', 'AMMO5': '0.020', 'AMMO2': '0.054', 'AMMO3': '0.187', 'weapon5': '0.214', 'AMMO4': '0.269', 'WEAPON5': '0.500', 'weapon2': '0.516', 'WEAPON4': '0.650', 'weapon4': '0.716', 'WEAPON3': '1.100', 'weapon3': '2.060', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '49.000'} [2023-02-25 14:40:11,098][36154] DAMAGECOUNT value on done: 1266545.0 [2023-02-25 14:40:11,099][36154] Sum rewards: 62.986, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.382', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.029', 'AMMO4': '0.142', 'weapon5': '0.146', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.284', 'weapon2': '0.302', 'WEAPON3': '1.250', 'weapon3': '3.010', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '54.000'} [2023-02-25 14:40:11,199][36141] DAMAGECOUNT value on done: 1260025.0 [2023-02-25 14:40:11,199][36141] Sum rewards: 60.374, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.205', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.109', 'AMMO3': '0.163', 'WEAPON4': '0.250', 'weapon2': '0.412', 'weapon4': '0.570', 'WEAPON3': '1.150', 'weapon3': '2.852', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '51.000'} [2023-02-25 14:40:11,250][36141] DAMAGECOUNT value on done: 1249418.0 [2023-02-25 14:40:11,250][36141] Sum rewards: 61.291, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.627', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'weapon4': '0.054', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon2': '0.292', 'WEAPON3': '1.250', 'HITCOUNT': '3.140', 'weapon3': '3.330', 'DAMAGECOUNT': '15.291', 'FRAGCOUNT': '51.000'} [2023-02-25 14:40:11,413][36154] DAMAGECOUNT value on done: 1253585.0 [2023-02-25 14:40:11,413][36154] Sum rewards: 60.453, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.525', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.102', 'AMMO4': '0.147', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'weapon4': '0.234', 'WEAPON4': '0.300', 'weapon2': '0.558', 'WEAPON3': '1.100', 'weapon3': '2.872', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.329', 'FRAGCOUNT': '50.000'} [2023-02-25 14:40:11,566][36141] DAMAGECOUNT value on done: 1244526.0 [2023-02-25 14:40:11,567][36141] Sum rewards: 65.814, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.645', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.035', 'weapon5': '0.040', 'weapon7': '0.058', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'weapon4': '0.168', 'WEAPON7': '0.200', 'weapon2': '0.894', 'WEAPON3': '0.900', 'weapon3': '2.706', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '54.000'} [2023-02-25 14:40:12,553][36155] DAMAGECOUNT value on done: 1251918.0 [2023-02-25 14:40:12,553][36155] Sum rewards: 63.552, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.614', 'AMMO5': '0.022', 'AMMO2': '0.040', 'AMMO4': '0.198', 'AMMO3': '0.215', 'weapon5': '0.222', 'weapon2': '0.270', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.732', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '55.000'} [2023-02-25 14:40:12,706][36139] DAMAGECOUNT value on done: 1255807.0 [2023-02-25 14:40:12,706][36139] Sum rewards: 65.631, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.582', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.150', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.202', 'weapon4': '0.214', 'WEAPON3': '1.150', 'weapon3': '3.232', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.014', 'FRAGCOUNT': '55.000'} [2023-02-25 14:40:12,873][36155] DAMAGECOUNT value on done: 1254374.0 [2023-02-25 14:40:12,874][36155] Sum rewards: 41.641, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.640', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.168', 'weapon5': '0.172', 'AMMO4': '0.174', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.568', 'weapon4': '0.624', 'WEAPON3': '1.000', 'weapon3': '2.126', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '11.574', 'FRAGCOUNT': '38.000'} [2023-02-25 14:40:13,015][36139] DAMAGECOUNT value on done: 1248992.0 [2023-02-25 14:40:13,015][36139] Sum rewards: 58.775, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.042', 'AMMO5': '0.017', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon5': '0.184', 'AMMO3': '0.190', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.436', 'weapon4': '0.568', 'WEAPON3': '1.200', 'weapon3': '2.528', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.798', 'FRAGCOUNT': '51.500'} [2023-02-25 14:40:13,261][36139] DAMAGECOUNT value on done: 1265456.0 [2023-02-25 14:40:13,262][36139] Sum rewards: 66.977, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.790', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.110', 'AMMO4': '0.157', 'AMMO3': '0.194', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON4': '0.400', 'weapon4': '0.512', 'WEAPON3': '1.150', 'weapon3': '2.886', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '58.000'} [2023-02-25 14:40:13,375][36138] Updated weights for policy 0, policy_version 54023 (0.0009) [2023-02-25 14:40:13,572][36139] DAMAGECOUNT value on done: 1260030.0 [2023-02-25 14:40:13,573][36139] Sum rewards: 52.058, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.060', 'AMMO5': '0.008', 'AMMO2': '0.048', 'AMMO3': '0.142', 'weapon5': '0.158', 'weapon2': '0.212', 'AMMO4': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.550', 'weapon4': '0.836', 'WEAPON3': '0.850', 'weapon3': '2.340', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '44.000'} [2023-02-25 14:40:13,694][36155] DAMAGECOUNT value on done: 1270996.0 [2023-02-25 14:40:13,694][36155] Sum rewards: 67.035, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.125', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.050', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.180', 'AMMO3': '0.203', 'weapon2': '0.832', 'WEAPON3': '1.100', 'weapon3': '2.568', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.954', 'FRAGCOUNT': '56.000'} [2023-02-25 14:40:14,004][36155] DAMAGECOUNT value on done: 1251837.0 [2023-02-25 14:40:14,005][36155] Sum rewards: 62.913, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.620', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.158', 'AMMO4': '0.193', 'AMMO3': '0.220', 'weapon2': '0.290', 'weapon4': '0.320', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.972', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.482', 'FRAGCOUNT': '57.500'} [2023-02-25 14:40:14,601][36157] DAMAGECOUNT value on done: 1264138.0 [2023-02-25 14:40:14,601][36157] Sum rewards: 68.206, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.928', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.158', 'AMMO3': '0.163', 'WEAPON4': '0.250', 'weapon2': '0.256', 'WEAPON5': '0.350', 'weapon4': '0.412', 'WEAPON3': '1.100', 'weapon3': '2.880', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.968', 'FRAGCOUNT': '56.000'} [2023-02-25 14:40:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13384.9). Total num frames: 221294592. Throughput: 0: 3356.0. Samples: 17818084. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:40:14,729][36114] Avg episode reward: [(0, '58.124')] [2023-02-25 14:40:14,904][36157] DAMAGECOUNT value on done: 1254830.0 [2023-02-25 14:40:14,905][36157] Sum rewards: 55.124, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.739', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.128', 'weapon4': '0.154', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.370', 'WEAPON3': '1.350', 'HITCOUNT': '2.980', 'weapon3': '3.128', 'DAMAGECOUNT': '15.132', 'FRAGCOUNT': '48.000'} [2023-02-25 14:40:15,083][36157] DAMAGECOUNT value on done: 1265227.0 [2023-02-25 14:40:15,083][36157] Sum rewards: 52.749, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.016', 'AMMO5': '0.021', 'AMMO2': '0.054', 'weapon4': '0.134', 'AMMO3': '0.213', 'weapon2': '0.256', 'AMMO4': '0.271', 'weapon5': '0.296', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'HITCOUNT': '2.490', 'weapon3': '3.018', 'DAMAGECOUNT': '15.162', 'FRAGCOUNT': '45.500'} [2023-02-25 14:40:15,384][36157] DAMAGECOUNT value on done: 1256558.0 [2023-02-25 14:40:15,385][36157] Sum rewards: 65.097, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.342', 'AMMO5': '0.012', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.158', 'AMMO3': '0.177', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.498', 'weapon4': '0.512', 'WEAPON3': '1.100', 'weapon3': '2.628', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.631', 'FRAGCOUNT': '55.000'} [2023-02-25 14:40:15,656][36140] DAMAGECOUNT value on done: 1263481.0 [2023-02-25 14:40:15,656][36140] Sum rewards: 62.219, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.932', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.241', 'weapon2': '0.248', 'WEAPON4': '0.250', 'weapon4': '0.692', 'WEAPON3': '1.450', 'weapon3': '2.710', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '15.666', 'FRAGCOUNT': '55.000'} [2023-02-25 14:40:15,677][36140] DAMAGECOUNT value on done: 1257732.0 [2023-02-25 14:40:15,677][36140] Sum rewards: 62.706, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.553', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.114', 'AMMO4': '0.174', 'weapon4': '0.188', 'AMMO3': '0.196', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.614', 'WEAPON3': '1.400', 'weapon3': '2.822', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.214', 'FRAGCOUNT': '54.500'} [2023-02-25 14:40:15,989][36140] DAMAGECOUNT value on done: 1246007.0 [2023-02-25 14:40:15,989][36140] Sum rewards: 51.142, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.534', 'AMMO5': '0.015', 'AMMO2': '0.059', 'weapon5': '0.122', 'AMMO3': '0.183', 'AMMO4': '0.295', 'weapon2': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.456', 'ARMOR': '0.464', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.730', 'weapon3': '2.878', 'DAMAGECOUNT': '12.624', 'FRAGCOUNT': '45.000'} [2023-02-25 14:40:16,008][36140] DAMAGECOUNT value on done: 1247507.0 [2023-02-25 14:40:16,009][36140] Sum rewards: 50.401, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.358', 'ARMOR': '0.008', 'AMMO5': '0.021', 'AMMO2': '0.067', 'weapon5': '0.150', 'AMMO3': '0.189', 'AMMO4': '0.333', 'weapon4': '0.420', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon2': '0.734', 'WEAPON3': '1.150', 'weapon3': '2.358', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.328', 'FRAGCOUNT': '46.000'} [2023-02-25 14:40:16,421][36138] Updated weights for policy 0, policy_version 54033 (0.0009) [2023-02-25 14:40:18,319][36142] DAMAGECOUNT value on done: 1253505.0 [2023-02-25 14:40:18,319][36142] Sum rewards: 55.112, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.207', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON4': '0.100', 'weapon4': '0.108', 'AMMO3': '0.238', 'weapon2': '0.362', 'WEAPON3': '1.450', 'HITCOUNT': '3.010', 'weapon3': '3.374', 'DAMAGECOUNT': '13.887', 'FRAGCOUNT': '49.000'} [2023-02-25 14:40:18,626][36142] DAMAGECOUNT value on done: 1244414.0 [2023-02-25 14:40:18,626][36142] Sum rewards: 52.369, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.582', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.120', 'AMMO3': '0.134', 'weapon5': '0.148', 'AMMO4': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.776', 'WEAPON3': '0.950', 'HITCOUNT': '2.530', 'weapon3': '2.814', 'DAMAGECOUNT': '13.209', 'FRAGCOUNT': '44.000'} [2023-02-25 14:40:19,223][36142] DAMAGECOUNT value on done: 1255310.0 [2023-02-25 14:40:19,224][36142] Sum rewards: 54.989, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.221', 'AMMO5': '0.015', 'AMMO2': '0.051', 'AMMO3': '0.128', 'weapon5': '0.216', 'AMMO4': '0.256', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.598', 'WEAPON3': '0.700', 'weapon4': '0.970', 'weapon3': '1.958', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.958', 'FRAGCOUNT': '44.000'} [2023-02-25 14:40:19,444][36138] Updated weights for policy 0, policy_version 54043 (0.0009) [2023-02-25 14:40:19,522][36142] DAMAGECOUNT value on done: 1260597.0 [2023-02-25 14:40:19,523][36142] Sum rewards: 61.586, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.010', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.150', 'AMMO4': '0.171', 'AMMO3': '0.216', 'weapon2': '0.368', 'WEAPON5': '0.400', 'weapon4': '0.440', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.774', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.942', 'FRAGCOUNT': '54.000'} [2023-02-25 14:40:19,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 221360128. Throughput: 0: 3355.8. Samples: 17838304. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:40:19,730][36114] Avg episode reward: [(0, '58.174')] [2023-02-25 14:40:20,454][36156] DAMAGECOUNT value on done: 1268292.0 [2023-02-25 14:40:20,455][36156] Sum rewards: 53.360, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.813', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.044', 'AMMO3': '0.210', 'AMMO4': '0.219', 'weapon5': '0.242', 'weapon2': '0.292', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.562', 'WEAPON3': '1.300', 'weapon3': '2.632', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '46.000'} [2023-02-25 14:40:20,778][36156] DAMAGECOUNT value on done: 1251680.0 [2023-02-25 14:40:20,778][36156] Sum rewards: 57.095, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.475', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.136', 'AMMO3': '0.149', 'AMMO4': '0.184', 'WEAPON5': '0.200', 'weapon4': '0.274', 'weapon2': '0.398', 'WEAPON4': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '2.960', 'weapon3': '2.982', 'DAMAGECOUNT': '15.243', 'FRAGCOUNT': '48.000'} [2023-02-25 14:40:20,791][36156] DAMAGECOUNT value on done: 1261654.0 [2023-02-25 14:40:20,792][36156] Sum rewards: 58.483, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-3.340', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon5': '0.024', 'AMMO4': '0.109', 'WEAPON5': '0.200', 'weapon2': '0.228', 'WEAPON4': '0.250', 'weapon4': '0.268', 'AMMO3': '0.346', 'WEAPON3': '1.950', 'weapon3': '3.130', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '55.000'} [2023-02-25 14:40:21,106][36156] DAMAGECOUNT value on done: 1251193.0 [2023-02-25 14:40:21,106][36156] Sum rewards: 60.756, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.310', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.160', 'AMMO3': '0.173', 'AMMO4': '0.197', 'weapon2': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.562', 'WEAPON3': '1.100', 'weapon3': '2.714', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.282', 'FRAGCOUNT': '53.000'} [2023-02-25 14:40:22,512][36138] Updated weights for policy 0, policy_version 54053 (0.0009) [2023-02-25 14:40:24,729][36114] Fps is (10 sec: 13516.6, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 221429760. Throughput: 0: 3352.4. Samples: 17848320. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:40:24,730][36114] Avg episode reward: [(0, '58.186')] [2023-02-25 14:40:25,610][36138] Updated weights for policy 0, policy_version 54063 (0.0009) [2023-02-25 14:40:28,712][36138] Updated weights for policy 0, policy_version 54073 (0.0009) [2023-02-25 14:40:29,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 221495296. Throughput: 0: 3346.2. Samples: 17868294. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:40:29,730][36114] Avg episode reward: [(0, '58.186')] [2023-02-25 14:40:30,517][36154] DAMAGECOUNT value on done: 1268280.0 [2023-02-25 14:40:30,517][36154] Sum rewards: 44.622, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.360', 'AMMO5': '0.007', 'weapon7': '0.014', 'AMMO2': '0.037', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.128', 'AMMO4': '0.186', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.528', 'weapon2': '0.720', 'WEAPON3': '1.150', 'weapon3': '2.340', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '12.444', 'FRAGCOUNT': '40.000'} [2023-02-25 14:40:30,845][36154] DAMAGECOUNT value on done: 1246011.0 [2023-02-25 14:40:30,845][36154] Sum rewards: 64.206, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.312', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon5': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'weapon4': '0.212', 'weapon2': '0.432', 'WEAPON3': '1.150', 'weapon3': '3.092', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.065', 'FRAGCOUNT': '53.000'} [2023-02-25 14:40:31,102][36141] DAMAGECOUNT value on done: 1269167.0 [2023-02-25 14:40:31,103][36141] Sum rewards: 73.273, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.050', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.118', 'weapon5': '0.148', 'AMMO3': '0.216', 'weapon2': '0.222', 'AMMO4': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.234', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.774', 'FRAGCOUNT': '63.000'} [2023-02-25 14:40:31,187][36154] DAMAGECOUNT value on done: 1271059.0 [2023-02-25 14:40:31,188][36154] Sum rewards: 52.511, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.430', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.040', 'weapon5': '0.138', 'AMMO3': '0.157', 'AMMO4': '0.198', 'weapon2': '0.214', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.740', 'WEAPON3': '1.050', 'weapon3': '2.706', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.542', 'FRAGCOUNT': '46.000'} [2023-02-25 14:40:31,415][36141] DAMAGECOUNT value on done: 1266790.0 [2023-02-25 14:40:31,416][36141] Sum rewards: 84.626, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.290', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'weapon2': '0.238', 'weapon4': '0.274', 'WEAPON3': '1.250', 'weapon3': '3.144', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.295', 'FRAGCOUNT': '70.000'} [2023-02-25 14:40:31,479][36141] DAMAGECOUNT value on done: 1255808.0 [2023-02-25 14:40:31,480][36141] Sum rewards: 73.148, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.858', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'weapon5': '0.114', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon2': '0.240', 'weapon4': '0.442', 'WEAPON3': '1.350', 'weapon3': '3.020', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '60.000'} [2023-02-25 14:40:31,488][36154] DAMAGECOUNT value on done: 1258741.0 [2023-02-25 14:40:31,489][36154] Sum rewards: 55.917, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.342', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.054', 'AMMO3': '0.204', 'weapon5': '0.218', 'weapon2': '0.268', 'AMMO4': '0.269', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.862', 'WEAPON3': '1.200', 'weapon3': '2.402', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.423', 'FRAGCOUNT': '50.000'} [2023-02-25 14:40:31,777][36141] DAMAGECOUNT value on done: 1248648.0 [2023-02-25 14:40:31,778][36141] Sum rewards: 48.791, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.352', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.064', 'AMMO4': '0.157', 'weapon4': '0.172', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.606', 'WEAPON3': '1.100', 'HITCOUNT': '2.500', 'weapon3': '2.958', 'DAMAGECOUNT': '12.366', 'FRAGCOUNT': '43.000'} [2023-02-25 14:40:31,785][36138] Updated weights for policy 0, policy_version 54083 (0.0009) [2023-02-25 14:40:32,618][36155] DAMAGECOUNT value on done: 1257332.0 [2023-02-25 14:40:32,618][36155] Sum rewards: 68.487, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.526', 'AMMO2': '0.003', 'AMMO4': '0.017', 'WEAPON4': '0.100', 'weapon2': '0.192', 'AMMO3': '0.203', 'weapon4': '0.340', 'WEAPON3': '1.200', 'weapon3': '3.296', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.242', 'FRAGCOUNT': '57.000'} [2023-02-25 14:40:32,623][36139] DAMAGECOUNT value on done: 1260766.0 [2023-02-25 14:40:32,624][36139] Sum rewards: 61.332, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.272', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.046', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.151', 'weapon2': '0.904', 'WEAPON3': '0.950', 'weapon3': '2.918', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.877', 'FRAGCOUNT': '50.000'} [2023-02-25 14:40:32,768][36157] Large shaping reward 2.517 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.495, 165.0), ('weapon5', 0.002)] [2023-02-25 14:40:32,939][36155] DAMAGECOUNT value on done: 1259867.0 [2023-02-25 14:40:32,939][36155] Sum rewards: 63.334, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.186', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.108', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.326', 'WEAPON3': '1.300', 'weapon3': '3.150', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.479', 'FRAGCOUNT': '53.500'} [2023-02-25 14:40:32,953][36139] DAMAGECOUNT value on done: 1254148.0 [2023-02-25 14:40:32,954][36139] Sum rewards: 63.014, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.634', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO3': '0.205', 'weapon2': '0.266', 'WEAPON3': '1.250', 'HITCOUNT': '3.080', 'weapon3': '3.634', 'DAMAGECOUNT': '15.468', 'FRAGCOUNT': '52.000'} [2023-02-25 14:40:33,241][36139] DAMAGECOUNT value on done: 1270530.0 [2023-02-25 14:40:33,242][36139] Sum rewards: 59.779, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.460', 'AMMO5': '0.010', 'AMMO2': '0.054', 'weapon5': '0.056', 'weapon2': '0.236', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'AMMO4': '0.272', 'ARMOR': '0.454', 'WEAPON4': '0.600', 'weapon4': '0.814', 'WEAPON3': '1.450', 'weapon3': '2.446', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.222', 'FRAGCOUNT': '56.000'} [2023-02-25 14:40:33,550][36139] DAMAGECOUNT value on done: 1265112.0 [2023-02-25 14:40:33,550][36139] Sum rewards: 58.293, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.225', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.158', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.210', 'weapon2': '0.304', 'WEAPON3': '1.150', 'HITCOUNT': '3.080', 'weapon3': '3.128', 'DAMAGECOUNT': '15.246', 'FRAGCOUNT': '48.500'} [2023-02-25 14:40:33,749][36155] DAMAGECOUNT value on done: 1275780.0 [2023-02-25 14:40:33,750][36155] Sum rewards: 56.611, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.614', 'AMMO5': '0.017', 'AMMO2': '0.066', 'weapon5': '0.130', 'AMMO3': '0.171', 'weapon4': '0.288', 'weapon2': '0.292', 'AMMO4': '0.329', 'WEAPON5': '0.400', 'WEAPON4': '0.700', 'WEAPON3': '1.000', 'HITCOUNT': '2.940', 'weapon3': '3.040', 'DAMAGECOUNT': '14.352', 'FRAGCOUNT': '51.000'} [2023-02-25 14:40:34,055][36155] DAMAGECOUNT value on done: 1257277.0 [2023-02-25 14:40:34,055][36155] Sum rewards: 71.972, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.158', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.193', 'weapon2': '0.276', 'WEAPON3': '1.200', 'HITCOUNT': '3.410', 'weapon3': '3.512', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '60.000'} [2023-02-25 14:40:34,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 221560832. Throughput: 0: 3344.4. Samples: 17888198. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:40:34,730][36114] Avg episode reward: [(0, '58.729')] [2023-02-25 14:40:34,749][36157] DAMAGECOUNT value on done: 1269268.0 [2023-02-25 14:40:34,749][36157] Sum rewards: 63.856, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.420', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.034', 'AMMO4': '0.168', 'weapon5': '0.188', 'AMMO3': '0.195', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.622', 'weapon4': '0.758', 'WEAPON3': '1.200', 'weapon3': '2.106', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '56.000'} [2023-02-25 14:40:34,851][36138] Updated weights for policy 0, policy_version 54093 (0.0009) [2023-02-25 14:40:35,070][36157] DAMAGECOUNT value on done: 1259928.0 [2023-02-25 14:40:35,071][36157] Sum rewards: 60.676, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.718', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'weapon2': '0.200', 'AMMO3': '0.278', 'weapon4': '0.540', 'WEAPON3': '1.550', 'HITCOUNT': '2.990', 'weapon3': '3.026', 'DAMAGECOUNT': '15.294', 'FRAGCOUNT': '54.000'} [2023-02-25 14:40:35,279][36157] DAMAGECOUNT value on done: 1269896.0 [2023-02-25 14:40:35,279][36157] Sum rewards: 57.554, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.937', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.118', 'weapon5': '0.142', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon2': '0.204', 'weapon4': '0.702', 'WEAPON3': '1.050', 'weapon3': '2.766', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.007', 'FRAGCOUNT': '48.000'} [2023-02-25 14:40:35,600][36157] DAMAGECOUNT value on done: 1262166.0 [2023-02-25 14:40:35,601][36157] Sum rewards: 66.653, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.260', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.180', 'AMMO4': '0.188', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.312', 'weapon2': '0.402', 'WEAPON3': '1.150', 'weapon3': '2.890', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '56.000'} [2023-02-25 14:40:35,839][36140] DAMAGECOUNT value on done: 1268563.0 [2023-02-25 14:40:35,839][36140] Sum rewards: 57.690, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.598', 'AMMO5': '0.017', 'AMMO2': '0.062', 'AMMO3': '0.152', 'weapon5': '0.214', 'AMMO4': '0.310', 'weapon4': '0.350', 'WEAPON5': '0.550', 'WEAPON4': '0.550', 'weapon2': '0.618', 'WEAPON3': '0.800', 'weapon3': '2.508', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.246', 'FRAGCOUNT': '49.000'} [2023-02-25 14:40:35,850][36140] DAMAGECOUNT value on done: 1263155.0 [2023-02-25 14:40:35,851][36140] Sum rewards: 67.879, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.177', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.060', 'AMMO4': '0.072', 'AMMO3': '0.137', 'WEAPON5': '0.200', 'weapon2': '0.224', 'WEAPON4': '0.400', 'WEAPON3': '0.800', 'weapon4': '0.820', 'weapon3': '2.698', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.269', 'FRAGCOUNT': '55.000'} [2023-02-25 14:40:36,162][36140] DAMAGECOUNT value on done: 1251344.0 [2023-02-25 14:40:36,162][36140] Sum rewards: 61.892, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.120', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.132', 'weapon5': '0.150', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.368', 'weapon2': '0.382', 'WEAPON3': '1.150', 'weapon3': '2.836', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.011', 'FRAGCOUNT': '50.000'} [2023-02-25 14:40:36,173][36140] DAMAGECOUNT value on done: 1252468.0 [2023-02-25 14:40:36,173][36140] Sum rewards: 55.935, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.147', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.177', 'weapon5': '0.180', 'AMMO3': '0.190', 'weapon2': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.614', 'WEAPON3': '1.150', 'weapon3': '2.720', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.883', 'FRAGCOUNT': '49.000'} [2023-02-25 14:40:37,627][36157] Large shaping reward 2.517 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.495, 165.0), ('weapon5', 0.002)] [2023-02-25 14:40:37,904][36138] Updated weights for policy 0, policy_version 54103 (0.0009) [2023-02-25 14:40:38,599][36142] DAMAGECOUNT value on done: 1258274.0 [2023-02-25 14:40:38,599][36142] Sum rewards: 54.054, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.458', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon5': '0.110', 'WEAPON5': '0.150', 'weapon2': '0.184', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'weapon4': '0.816', 'WEAPON3': '1.350', 'weapon3': '2.578', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.307', 'FRAGCOUNT': '48.000'} [2023-02-25 14:40:38,920][36142] DAMAGECOUNT value on done: 1249190.0 [2023-02-25 14:40:38,921][36142] Sum rewards: 55.316, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.722', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.070', 'AMMO4': '0.120', 'weapon5': '0.168', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.354', 'WEAPON3': '1.250', 'HITCOUNT': '2.640', 'weapon3': '3.118', 'DAMAGECOUNT': '14.328', 'FRAGCOUNT': '48.000'} [2023-02-25 14:40:39,512][36142] DAMAGECOUNT value on done: 1260191.0 [2023-02-25 14:40:39,512][36142] Sum rewards: 52.018, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.476', 'AMMO5': '0.005', 'AMMO2': '0.046', 'weapon5': '0.094', 'WEAPON5': '0.200', 'weapon4': '0.208', 'AMMO4': '0.229', 'AMMO3': '0.253', 'WEAPON4': '0.400', 'weapon2': '0.436', 'WEAPON3': '1.450', 'HITCOUNT': '3.000', 'weapon3': '3.030', 'DAMAGECOUNT': '14.643', 'FRAGCOUNT': '47.000'} [2023-02-25 14:40:39,729][36114] Fps is (10 sec: 13106.9, 60 sec: 13380.2, 300 sec: 13384.9). Total num frames: 221626368. Throughput: 0: 3343.3. Samples: 17898198. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:40:39,730][36114] Avg episode reward: [(0, '58.841')] [2023-02-25 14:40:39,820][36142] DAMAGECOUNT value on done: 1265354.0 [2023-02-25 14:40:39,821][36142] Sum rewards: 51.623, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.630', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.014', 'weapon5': '0.044', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.282', 'AMMO3': '0.289', 'WEAPON3': '1.700', 'HITCOUNT': '2.840', 'weapon3': '3.404', 'DAMAGECOUNT': '14.271', 'FRAGCOUNT': '47.000'} [2023-02-25 14:40:40,538][36156] DAMAGECOUNT value on done: 1273361.0 [2023-02-25 14:40:40,538][36156] Sum rewards: 61.861, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.305', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'weapon5': '0.120', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'weapon2': '0.176', 'weapon4': '0.450', 'WEAPON3': '0.900', 'weapon3': '2.814', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.207', 'FRAGCOUNT': '49.000'} [2023-02-25 14:40:40,843][36156] DAMAGECOUNT value on done: 1256205.0 [2023-02-25 14:40:40,844][36156] Sum rewards: 48.680, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.980', 'AMMO5': '0.016', 'AMMO2': '0.044', 'AMMO3': '0.153', 'AMMO4': '0.218', 'weapon5': '0.266', 'weapon2': '0.366', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.654', 'WEAPON3': '0.950', 'weapon3': '2.398', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '13.575', 'FRAGCOUNT': '40.500'} [2023-02-25 14:40:40,857][36156] DAMAGECOUNT value on done: 1267121.0 [2023-02-25 14:40:40,857][36156] Sum rewards: 66.378, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.480', 'AMMO2': '0.015', 'AMMO4': '0.072', 'AMMO3': '0.279', 'weapon2': '0.294', 'WEAPON4': '0.300', 'ARMOR': '0.457', 'weapon4': '0.496', 'WEAPON3': '1.600', 'weapon3': '3.004', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.401', 'FRAGCOUNT': '60.000'} [2023-02-25 14:40:41,000][36138] Updated weights for policy 0, policy_version 54113 (0.0009) [2023-02-25 14:40:41,158][36156] DAMAGECOUNT value on done: 1256264.0 [2023-02-25 14:40:41,159][36156] Sum rewards: 62.623, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.524', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.010', 'weapon5': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.128', 'AMMO3': '0.204', 'weapon4': '0.266', 'WEAPON3': '1.250', 'HITCOUNT': '3.180', 'weapon3': '3.376', 'DAMAGECOUNT': '15.213', 'FRAGCOUNT': '53.000'} [2023-02-25 14:40:44,075][36138] Updated weights for policy 0, policy_version 54123 (0.0009) [2023-02-25 14:40:44,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 221696000. Throughput: 0: 3344.7. Samples: 17918328. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:40:44,730][36114] Avg episode reward: [(0, '59.452')] [2023-02-25 14:40:47,129][36138] Updated weights for policy 0, policy_version 54133 (0.0010) [2023-02-25 14:40:47,173][36141] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('ARMOR', -0.001, -1.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:40:49,729][36114] Fps is (10 sec: 13517.2, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 221761536. Throughput: 0: 3344.1. Samples: 17938340. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:40:49,729][36114] Avg episode reward: [(0, '59.452')] [2023-02-25 14:40:50,169][36138] Updated weights for policy 0, policy_version 54143 (0.0009) [2023-02-25 14:40:50,596][36154] DAMAGECOUNT value on done: 1272484.0 [2023-02-25 14:40:50,597][36154] Sum rewards: 52.995, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.697', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.106', 'AMMO3': '0.165', 'AMMO4': '0.172', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.526', 'weapon4': '0.744', 'WEAPON3': '1.000', 'weapon3': '2.458', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '12.612', 'FRAGCOUNT': '46.000'} [2023-02-25 14:40:50,905][36154] DAMAGECOUNT value on done: 1249003.0 [2023-02-25 14:40:50,906][36154] Sum rewards: 35.588, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.478', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.078', 'weapon7': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'weapon4': '0.530', 'weapon2': '0.716', 'WEAPON3': '0.800', 'HITCOUNT': '1.850', 'weapon3': '1.986', 'DAMAGECOUNT': '8.976', 'FRAGCOUNT': '30.000'} [2023-02-25 14:40:51,248][36154] DAMAGECOUNT value on done: 1276449.0 [2023-02-25 14:40:51,249][36154] Sum rewards: 64.685, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.386', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.164', 'weapon2': '0.170', 'AMMO3': '0.183', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.328', 'ARMOR': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.148', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '54.500'} [2023-02-25 14:40:51,257][36141] DAMAGECOUNT value on done: 1274676.0 [2023-02-25 14:40:51,257][36141] Sum rewards: 59.894, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.792', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.055', 'AMMO3': '0.208', 'weapon2': '0.210', 'weapon5': '0.224', 'AMMO4': '0.276', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.570', 'WEAPON3': '1.200', 'weapon3': '2.672', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '53.500'} [2023-02-25 14:40:51,554][36141] DAMAGECOUNT value on done: 1272033.0 [2023-02-25 14:40:51,554][36141] Sum rewards: 62.899, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.230', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.080', 'weapon5': '0.148', 'AMMO4': '0.162', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.278', 'AMMO3': '0.280', 'WEAPON3': '1.750', 'HITCOUNT': '3.160', 'weapon3': '3.248', 'DAMAGECOUNT': '15.729', 'FRAGCOUNT': '59.000'} [2023-02-25 14:40:51,560][36154] DAMAGECOUNT value on done: 1263627.0 [2023-02-25 14:40:51,560][36154] Sum rewards: 49.067, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.738', 'AMMO5': '0.008', 'weapon5': '0.042', 'AMMO2': '0.045', 'WEAPON5': '0.200', 'AMMO4': '0.226', 'AMMO3': '0.235', 'weapon2': '0.354', 'WEAPON4': '0.450', 'weapon4': '0.528', 'WEAPON3': '1.300', 'weapon3': '2.808', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.658', 'FRAGCOUNT': '45.000'} [2023-02-25 14:40:51,603][36141] DAMAGECOUNT value on done: 1259959.0 [2023-02-25 14:40:51,604][36141] Sum rewards: 47.656, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.384', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon5': '0.098', 'weapon2': '0.144', 'AMMO3': '0.175', 'AMMO4': '0.220', 'weapon4': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.610', 'weapon3': '3.324', 'DAMAGECOUNT': '12.438', 'FRAGCOUNT': '41.000'} [2023-02-25 14:40:51,911][36141] DAMAGECOUNT value on done: 1253564.0 [2023-02-25 14:40:51,911][36141] Sum rewards: 60.471, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.412', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.058', 'AMMO4': '0.067', 'weapon4': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon2': '0.234', 'WEAPON3': '1.300', 'HITCOUNT': '2.890', 'weapon3': '3.430', 'DAMAGECOUNT': '14.748', 'FRAGCOUNT': '52.000'} [2023-02-25 14:40:52,656][36139] DAMAGECOUNT value on done: 1266202.0 [2023-02-25 14:40:52,656][36139] Sum rewards: 63.133, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.292', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.234', 'WEAPON4': '0.250', 'weapon4': '0.356', 'WEAPON3': '1.300', 'HITCOUNT': '3.070', 'weapon3': '3.078', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '53.000'} [2023-02-25 14:40:52,727][36155] DAMAGECOUNT value on done: 1262762.0 [2023-02-25 14:40:52,727][36155] Sum rewards: 60.247, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.110', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon2': '0.204', 'AMMO3': '0.211', 'weapon5': '0.218', 'AMMO4': '0.222', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.576', 'WEAPON3': '1.250', 'weapon3': '2.704', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.290', 'FRAGCOUNT': '54.000'} [2023-02-25 14:40:52,958][36139] DAMAGECOUNT value on done: 1258637.0 [2023-02-25 14:40:52,958][36139] Sum rewards: 54.843, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.116', 'AMMO5': '0.020', 'AMMO2': '0.038', 'weapon5': '0.152', 'AMMO3': '0.187', 'AMMO4': '0.191', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.532', 'weapon2': '0.560', 'WEAPON3': '1.050', 'weapon3': '2.442', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.467', 'FRAGCOUNT': '46.500'} [2023-02-25 14:40:53,034][36155] DAMAGECOUNT value on done: 1264605.0 [2023-02-25 14:40:53,034][36155] Sum rewards: 56.379, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.270', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon4': '0.268', 'weapon2': '0.406', 'WEAPON3': '1.300', 'HITCOUNT': '2.860', 'weapon3': '3.160', 'DAMAGECOUNT': '14.214', 'FRAGCOUNT': '50.000'} [2023-02-25 14:40:53,240][36138] Updated weights for policy 0, policy_version 54153 (0.0009) [2023-02-25 14:40:53,378][36139] DAMAGECOUNT value on done: 1275390.0 [2023-02-25 14:40:53,378][36139] Sum rewards: 53.370, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.630', 'AMMO5': '0.014', 'AMMO2': '0.058', 'AMMO3': '0.149', 'weapon2': '0.216', 'weapon5': '0.216', 'AMMO4': '0.292', 'WEAPON5': '0.450', 'weapon4': '0.544', 'WEAPON4': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.730', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '46.500'} [2023-02-25 14:40:53,660][36155] DAMAGECOUNT value on done: 1280900.0 [2023-02-25 14:40:53,661][36155] Sum rewards: 52.227, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.770', 'AMMO5': '0.014', 'AMMO2': '0.063', 'weapon5': '0.138', 'AMMO3': '0.186', 'AMMO4': '0.314', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON4': '0.600', 'weapon4': '0.708', 'WEAPON3': '1.050', 'weapon3': '2.458', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.360', 'FRAGCOUNT': '45.000'} [2023-02-25 14:40:53,685][36139] DAMAGECOUNT value on done: 1270309.0 [2023-02-25 14:40:53,686][36139] Sum rewards: 64.639, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.202', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO4': '0.201', 'AMMO3': '0.272', 'weapon2': '0.286', 'weapon4': '0.570', 'WEAPON3': '1.550', 'weapon3': '2.840', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.591', 'FRAGCOUNT': '59.000'} [2023-02-25 14:40:53,968][36155] DAMAGECOUNT value on done: 1262146.0 [2023-02-25 14:40:53,969][36155] Sum rewards: 58.053, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.992', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.078', 'AMMO4': '0.111', 'weapon2': '0.188', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.274', 'WEAPON3': '1.150', 'HITCOUNT': '2.990', 'weapon3': '3.220', 'DAMAGECOUNT': '14.607', 'FRAGCOUNT': '50.000'} [2023-02-25 14:40:54,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 221827072. Throughput: 0: 3342.7. Samples: 17948384. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:40:54,729][36114] Avg episode reward: [(0, '59.250')] [2023-02-25 14:40:54,770][36157] DAMAGECOUNT value on done: 1273114.0 [2023-02-25 14:40:54,770][36157] Sum rewards: 35.734, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.542', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.114', 'weapon4': '0.164', 'AMMO4': '0.173', 'AMMO3': '0.212', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.452', 'WEAPON3': '1.200', 'HITCOUNT': '2.330', 'weapon3': '3.092', 'DAMAGECOUNT': '11.538', 'FRAGCOUNT': '34.000'} [2023-02-25 14:40:55,086][36157] DAMAGECOUNT value on done: 1262904.0 [2023-02-25 14:40:55,086][36157] Sum rewards: 24.178, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.652', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon5': '0.072', 'weapon7': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.200', 'WEAPON7': '0.200', 'AMMO4': '0.274', 'WEAPON5': '0.350', 'ARMOR': '0.458', 'weapon2': '0.460', 'WEAPON4': '0.700', 'weapon4': '0.838', 'WEAPON3': '1.050', 'HITCOUNT': '2.000', 'weapon3': '2.134', 'DAMAGECOUNT': '8.928', 'FRAGCOUNT': '26.000'} [2023-02-25 14:40:55,251][36157] DAMAGECOUNT value on done: 1274654.0 [2023-02-25 14:40:55,251][36157] Sum rewards: 53.187, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.190', 'AMMO5': '0.019', 'AMMO2': '0.040', 'AMMO4': '0.201', 'AMMO3': '0.202', 'weapon5': '0.262', 'weapon4': '0.330', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.690', 'WEAPON3': '1.200', 'weapon3': '2.398', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '14.124', 'FRAGCOUNT': '47.000'} [2023-02-25 14:40:55,566][36157] DAMAGECOUNT value on done: 1268491.0 [2023-02-25 14:40:55,567][36157] Sum rewards: 66.690, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.284', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.155', 'AMMO3': '0.227', 'weapon5': '0.230', 'WEAPON5': '0.350', 'weapon2': '0.406', 'WEAPON4': '0.450', 'weapon4': '0.614', 'WEAPON3': '1.250', 'weapon3': '2.480', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.975', 'FRAGCOUNT': '56.000'} [2023-02-25 14:40:56,039][36140] DAMAGECOUNT value on done: 1273540.0 [2023-02-25 14:40:56,039][36140] Sum rewards: 54.694, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.260', 'AMMO5': '0.010', 'AMMO2': '0.042', 'AMMO3': '0.167', 'weapon5': '0.200', 'AMMO4': '0.211', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.598', 'weapon4': '0.640', 'WEAPON3': '1.000', 'weapon3': '2.294', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.931', 'FRAGCOUNT': '48.000'} [2023-02-25 14:40:56,051][36140] DAMAGECOUNT value on done: 1268829.0 [2023-02-25 14:40:56,052][36140] Sum rewards: 63.051, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.612', 'ARMOR': '0.008', 'AMMO5': '0.024', 'AMMO2': '0.043', 'AMMO3': '0.181', 'weapon5': '0.182', 'AMMO4': '0.213', 'weapon2': '0.304', 'weapon4': '0.328', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.898', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.022', 'FRAGCOUNT': '52.000'} [2023-02-25 14:40:56,296][36138] Updated weights for policy 0, policy_version 54163 (0.0009) [2023-02-25 14:40:56,366][36140] DAMAGECOUNT value on done: 1256698.0 [2023-02-25 14:40:56,367][36140] Sum rewards: 60.940, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.930', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon5': '0.126', 'AMMO4': '0.151', 'weapon4': '0.160', 'AMMO3': '0.175', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.100', 'weapon3': '3.156', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.062', 'FRAGCOUNT': '51.000'} [2023-02-25 14:40:56,377][36140] DAMAGECOUNT value on done: 1256905.0 [2023-02-25 14:40:56,378][36140] Sum rewards: 48.628, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.575', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.168', 'AMMO3': '0.175', 'AMMO4': '0.239', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON4': '0.400', 'weapon4': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.626', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.311', 'FRAGCOUNT': '43.000'} [2023-02-25 14:40:58,760][36142] DAMAGECOUNT value on done: 1263424.0 [2023-02-25 14:40:58,761][36142] Sum rewards: 60.117, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.273', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.063', 'weapon5': '0.106', 'AMMO3': '0.176', 'WEAPON5': '0.300', 'AMMO4': '0.314', 'weapon2': '0.320', 'WEAPON4': '0.500', 'weapon4': '0.580', 'WEAPON3': '1.150', 'weapon3': '2.528', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '52.000'} [2023-02-25 14:40:59,076][36142] DAMAGECOUNT value on done: 1253667.0 [2023-02-25 14:40:59,077][36142] Sum rewards: 52.993, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.441', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon5': '0.090', 'weapon4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.275', 'weapon2': '0.430', 'WEAPON3': '1.550', 'HITCOUNT': '2.760', 'weapon3': '3.134', 'DAMAGECOUNT': '13.431', 'FRAGCOUNT': '49.000'} [2023-02-25 14:40:59,352][36138] Updated weights for policy 0, policy_version 54173 (0.0009) [2023-02-25 14:40:59,673][36142] DAMAGECOUNT value on done: 1264860.0 [2023-02-25 14:40:59,674][36142] Sum rewards: 57.165, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.695', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO3': '0.145', 'AMMO4': '0.176', 'weapon2': '0.252', 'weapon5': '0.302', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'weapon4': '1.244', 'weapon3': '1.816', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.007', 'FRAGCOUNT': '48.000'} [2023-02-25 14:40:59,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 221896704. Throughput: 0: 3343.4. Samples: 17968536. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:40:59,730][36114] Avg episode reward: [(0, '58.551')] [2023-02-25 14:40:59,982][36142] DAMAGECOUNT value on done: 1271026.0 [2023-02-25 14:40:59,982][36142] Sum rewards: 62.303, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.079', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.088', 'AMMO4': '0.091', 'WEAPON5': '0.150', 'weapon2': '0.210', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon4': '0.270', 'WEAPON3': '1.350', 'weapon3': '3.206', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '54.000'} [2023-02-25 14:41:00,588][36156] DAMAGECOUNT value on done: 1277966.0 [2023-02-25 14:41:00,589][36156] Sum rewards: 57.940, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.070', 'AMMO2': '0.005', 'AMMO5': '0.009', 'weapon5': '0.020', 'AMMO4': '0.023', 'WEAPON4': '0.100', 'weapon4': '0.120', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.390', 'WEAPON3': '1.200', 'HITCOUNT': '2.860', 'weapon3': '3.330', 'DAMAGECOUNT': '13.815', 'FRAGCOUNT': '49.000'} [2023-02-25 14:41:00,907][36156] DAMAGECOUNT value on done: 1261955.0 [2023-02-25 14:41:00,907][36156] Sum rewards: 69.763, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.194', 'AMMO5': '0.019', 'AMMO2': '0.040', 'AMMO3': '0.139', 'weapon5': '0.146', 'AMMO4': '0.201', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.456', 'weapon4': '0.652', 'WEAPON3': '0.900', 'weapon3': '2.454', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '58.000'} [2023-02-25 14:41:00,918][36156] DAMAGECOUNT value on done: 1272876.0 [2023-02-25 14:41:00,919][36156] Sum rewards: 62.075, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.070', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon2': '0.164', 'weapon5': '0.216', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'WEAPON4': '0.450', 'weapon4': '0.846', 'WEAPON3': '1.500', 'weapon3': '2.510', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '53.500'} [2023-02-25 14:41:01,226][36156] DAMAGECOUNT value on done: 1262179.0 [2023-02-25 14:41:01,226][36156] Sum rewards: 74.299, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.667', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'weapon2': '0.226', 'WEAPON4': '0.300', 'weapon4': '0.372', 'WEAPON3': '1.100', 'weapon3': '3.074', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '62.000'} [2023-02-25 14:41:02,439][36138] Updated weights for policy 0, policy_version 54183 (0.0010) [2023-02-25 14:41:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 221962240. Throughput: 0: 3337.6. Samples: 17988496. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:41:04,729][36114] Avg episode reward: [(0, '58.767')] [2023-02-25 14:41:05,472][36138] Updated weights for policy 0, policy_version 54193 (0.0009) [2023-02-25 14:41:08,509][36138] Updated weights for policy 0, policy_version 54203 (0.0009) [2023-02-25 14:41:09,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13312.0, 300 sec: 13384.9). Total num frames: 222027776. Throughput: 0: 3338.4. Samples: 17998546. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:41:09,730][36114] Avg episode reward: [(0, '58.767')] [2023-02-25 14:41:10,574][36154] DAMAGECOUNT value on done: 1276651.0 [2023-02-25 14:41:10,574][36154] Sum rewards: 52.244, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.262', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.042', 'AMMO3': '0.142', 'weapon5': '0.174', 'weapon2': '0.190', 'AMMO4': '0.211', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.760', 'WEAPON3': '0.900', 'weapon3': '2.660', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.501', 'FRAGCOUNT': '46.000'} [2023-02-25 14:41:10,879][36154] DAMAGECOUNT value on done: 1254108.0 [2023-02-25 14:41:10,879][36154] Sum rewards: 58.431, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.940', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.048', 'AMMO4': '0.147', 'weapon2': '0.172', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.604', 'WEAPON3': '1.200', 'weapon3': '3.006', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '51.000'} [2023-02-25 14:41:11,214][36154] DAMAGECOUNT value on done: 1281821.0 [2023-02-25 14:41:11,215][36154] Sum rewards: 60.827, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.162', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon5': '0.056', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon2': '0.236', 'weapon4': '0.670', 'WEAPON3': '1.050', 'weapon3': '2.828', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '49.000'} [2023-02-25 14:41:11,342][36141] DAMAGECOUNT value on done: 1279995.0 [2023-02-25 14:41:11,342][36141] Sum rewards: 64.584, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.370', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.068', 'AMMO4': '0.144', 'AMMO3': '0.179', 'weapon4': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.566', 'WEAPON3': '1.150', 'weapon3': '2.956', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.957', 'FRAGCOUNT': '53.000'} [2023-02-25 14:41:11,518][36154] DAMAGECOUNT value on done: 1267888.0 [2023-02-25 14:41:11,518][36154] Sum rewards: 50.994, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.210', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.154', 'weapon2': '0.206', 'WEAPON4': '0.250', 'weapon4': '0.568', 'WEAPON3': '1.000', 'HITCOUNT': '2.530', 'weapon3': '2.932', 'DAMAGECOUNT': '12.783', 'FRAGCOUNT': '43.000'} [2023-02-25 14:41:11,578][36138] Updated weights for policy 0, policy_version 54213 (0.0009) [2023-02-25 14:41:11,654][36141] DAMAGECOUNT value on done: 1276909.0 [2023-02-25 14:41:11,654][36141] Sum rewards: 60.470, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.212', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.092', 'AMMO3': '0.142', 'AMMO4': '0.166', 'weapon5': '0.192', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.464', 'WEAPON3': '0.850', 'HITCOUNT': '2.590', 'weapon3': '3.058', 'DAMAGECOUNT': '14.628', 'FRAGCOUNT': '50.000'} [2023-02-25 14:41:11,725][36141] DAMAGECOUNT value on done: 1264915.0 [2023-02-25 14:41:11,726][36141] Sum rewards: 55.284, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.600', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'weapon5': '0.140', 'weapon4': '0.192', 'weapon2': '0.230', 'AMMO3': '0.271', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '2.850', 'weapon3': '3.168', 'DAMAGECOUNT': '14.868', 'FRAGCOUNT': '52.000'} [2023-02-25 14:41:12,028][36141] DAMAGECOUNT value on done: 1257886.0 [2023-02-25 14:41:12,029][36141] Sum rewards: 54.350, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.355', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'weapon5': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.207', 'weapon4': '0.262', 'weapon2': '0.628', 'WEAPON3': '1.250', 'weapon3': '2.788', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.966', 'FRAGCOUNT': '47.000'} [2023-02-25 14:41:12,704][36155] DAMAGECOUNT value on done: 1267498.0 [2023-02-25 14:41:12,704][36155] Sum rewards: 54.238, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.454', 'AMMO5': '0.017', 'AMMO2': '0.057', 'weapon7': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.170', 'weapon5': '0.224', 'AMMO4': '0.284', 'weapon2': '0.330', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.742', 'WEAPON3': '1.050', 'weapon3': '2.234', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '14.208', 'FRAGCOUNT': '49.000'} [2023-02-25 14:41:12,750][36139] DAMAGECOUNT value on done: 1271293.0 [2023-02-25 14:41:12,750][36139] Sum rewards: 53.770, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.882', 'AMMO5': '0.005', 'AMMO2': '0.045', 'WEAPON5': '0.100', 'weapon2': '0.202', 'AMMO4': '0.226', 'AMMO3': '0.337', 'WEAPON4': '0.400', 'weapon4': '0.402', 'WEAPON3': '1.900', 'weapon3': '3.092', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.273', 'FRAGCOUNT': '52.000'} [2023-02-25 14:41:13,014][36155] DAMAGECOUNT value on done: 1269832.0 [2023-02-25 14:41:13,014][36155] Sum rewards: 61.076, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.028', 'AMMO5': '0.013', 'AMMO2': '0.056', 'weapon5': '0.112', 'AMMO3': '0.192', 'AMMO4': '0.280', 'WEAPON5': '0.300', 'weapon2': '0.354', 'weapon4': '0.366', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.950', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.681', 'FRAGCOUNT': '53.000'} [2023-02-25 14:41:13,064][36139] DAMAGECOUNT value on done: 1263536.0 [2023-02-25 14:41:13,065][36139] Sum rewards: 52.075, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.655', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon5': '0.128', 'AMMO4': '0.134', 'AMMO3': '0.205', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.416', 'weapon4': '0.430', 'WEAPON3': '1.250', 'weapon3': '2.832', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.697', 'FRAGCOUNT': '44.500'} [2023-02-25 14:41:13,500][36139] DAMAGECOUNT value on done: 1280698.0 [2023-02-25 14:41:13,500][36139] Sum rewards: 68.146, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.278', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon4': '0.088', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'weapon5': '0.188', 'WEAPON5': '0.250', 'weapon2': '0.478', 'WEAPON3': '1.050', 'weapon3': '3.056', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.924', 'FRAGCOUNT': '56.000'} [2023-02-25 14:41:13,676][36155] DAMAGECOUNT value on done: 1286070.0 [2023-02-25 14:41:13,676][36155] Sum rewards: 62.827, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.185', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.043', 'weapon5': '0.076', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'weapon2': '0.196', 'AMMO4': '0.216', 'WEAPON4': '0.400', 'weapon4': '0.486', 'WEAPON3': '1.000', 'HITCOUNT': '2.930', 'weapon3': '3.074', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '54.000'} [2023-02-25 14:41:13,807][36139] DAMAGECOUNT value on done: 1275421.0 [2023-02-25 14:41:13,808][36139] Sum rewards: 59.326, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.290', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.037', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.186', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'weapon2': '0.406', 'weapon4': '0.652', 'WEAPON3': '1.200', 'weapon3': '2.670', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.336', 'FRAGCOUNT': '52.000'} [2023-02-25 14:41:13,998][36155] DAMAGECOUNT value on done: 1266920.0 [2023-02-25 14:41:13,998][36155] Sum rewards: 54.095, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.904', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.116', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon4': '0.242', 'weapon2': '0.336', 'WEAPON3': '1.400', 'HITCOUNT': '3.040', 'weapon3': '3.048', 'DAMAGECOUNT': '14.322', 'FRAGCOUNT': '48.000'} [2023-02-25 14:41:14,622][36138] Updated weights for policy 0, policy_version 54223 (0.0009) [2023-02-25 14:41:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 222097408. Throughput: 0: 3343.2. Samples: 18018740. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:41:14,729][36114] Avg episode reward: [(0, '58.376')] [2023-02-25 14:41:14,973][36157] DAMAGECOUNT value on done: 1278532.0 [2023-02-25 14:41:14,974][36157] Sum rewards: 63.206, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.186', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.116', 'WEAPON5': '0.200', 'weapon4': '0.240', 'WEAPON4': '0.250', 'AMMO3': '0.276', 'weapon2': '0.292', 'WEAPON3': '1.550', 'weapon3': '3.066', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.254', 'FRAGCOUNT': '57.000'} [2023-02-25 14:41:15,280][36157] DAMAGECOUNT value on done: 1267562.0 [2023-02-25 14:41:15,280][36157] Sum rewards: 50.012, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.346', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.050', 'weapon5': '0.136', 'AMMO3': '0.222', 'weapon2': '0.224', 'AMMO4': '0.249', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.632', 'WEAPON3': '1.300', 'weapon3': '2.738', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.974', 'FRAGCOUNT': '45.000'} [2023-02-25 14:41:15,455][36157] DAMAGECOUNT value on done: 1280042.0 [2023-02-25 14:41:15,456][36157] Sum rewards: 66.525, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.317', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.088', 'AMMO3': '0.147', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon2': '0.380', 'weapon4': '0.448', 'WEAPON3': '0.950', 'weapon3': '2.692', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.164', 'FRAGCOUNT': '55.000'} [2023-02-25 14:41:15,766][36157] DAMAGECOUNT value on done: 1274370.0 [2023-02-25 14:41:15,767][36157] Sum rewards: 67.939, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.557', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.056', 'AMMO3': '0.180', 'weapon2': '0.248', 'AMMO4': '0.281', 'weapon5': '0.338', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'weapon4': '0.708', 'WEAPON3': '1.150', 'weapon3': '2.372', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '59.000'} [2023-02-25 14:41:16,236][36140] DAMAGECOUNT value on done: 1278250.0 [2023-02-25 14:41:16,236][36140] Sum rewards: 58.702, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.584', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.036', 'AMMO4': '0.180', 'AMMO3': '0.190', 'weapon2': '0.204', 'weapon5': '0.238', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.420', 'WEAPON3': '1.100', 'HITCOUNT': '2.880', 'weapon3': '2.890', 'DAMAGECOUNT': '14.130', 'FRAGCOUNT': '52.000'} [2023-02-25 14:41:16,247][36140] DAMAGECOUNT value on done: 1273826.0 [2023-02-25 14:41:16,247][36140] Sum rewards: 56.187, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.135', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'weapon2': '0.162', 'WEAPON4': '0.250', 'AMMO3': '0.265', 'weapon4': '0.394', 'WEAPON3': '1.550', 'weapon3': '3.184', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.991', 'FRAGCOUNT': '52.000'} [2023-02-25 14:41:16,561][36140] DAMAGECOUNT value on done: 1261926.0 [2023-02-25 14:41:16,561][36140] Sum rewards: 61.142, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.680', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.033', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.210', 'weapon2': '0.240', 'WEAPON4': '0.250', 'weapon4': '0.254', 'WEAPON3': '1.200', 'weapon3': '3.196', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '52.000'} [2023-02-25 14:41:16,571][36140] DAMAGECOUNT value on done: 1262528.0 [2023-02-25 14:41:16,572][36140] Sum rewards: 73.438, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.510', 'AMMO5': '0.020', 'AMMO2': '0.054', 'AMMO3': '0.158', 'weapon5': '0.212', 'AMMO4': '0.269', 'weapon2': '0.342', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.642', 'WEAPON3': '0.900', 'weapon3': '2.512', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.869', 'FRAGCOUNT': '62.000'} [2023-02-25 14:41:17,170][36139] Large shaping reward 2.569 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.537, 179.0), ('weapon5', 0.002)] [2023-02-25 14:41:17,695][36138] Updated weights for policy 0, policy_version 54233 (0.0010) [2023-02-25 14:41:18,128][36139] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:41:18,849][36142] DAMAGECOUNT value on done: 1268741.0 [2023-02-25 14:41:18,849][36142] Sum rewards: 62.134, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.230', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.046', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'weapon2': '0.194', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon4': '0.370', 'WEAPON3': '1.400', 'weapon3': '3.170', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '55.000'} [2023-02-25 14:41:19,174][36142] DAMAGECOUNT value on done: 1258233.0 [2023-02-25 14:41:19,175][36142] Sum rewards: 53.512, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.550', 'AMMO5': '0.014', 'AMMO2': '0.049', 'AMMO3': '0.182', 'weapon5': '0.240', 'AMMO4': '0.246', 'weapon2': '0.302', 'weapon4': '0.350', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'HITCOUNT': '2.700', 'weapon3': '2.830', 'DAMAGECOUNT': '13.698', 'FRAGCOUNT': '47.500'} [2023-02-25 14:41:19,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 222162944. Throughput: 0: 3345.5. Samples: 18038746. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:41:19,730][36114] Avg episode reward: [(0, '58.353')] [2023-02-25 14:41:19,734][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000054239_222162944.pth... [2023-02-25 14:41:19,789][36142] DAMAGECOUNT value on done: 1269698.0 [2023-02-25 14:41:19,789][36142] Sum rewards: 57.265, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.855', 'AMMO5': '0.013', 'AMMO2': '0.027', 'AMMO4': '0.136', 'AMMO3': '0.143', 'weapon5': '0.174', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.466', 'weapon2': '0.680', 'WEAPON3': '0.950', 'weapon3': '2.486', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.514', 'FRAGCOUNT': '47.000'} [2023-02-25 14:41:19,792][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000053455_218951680.pth [2023-02-25 14:41:20,113][36142] DAMAGECOUNT value on done: 1276325.0 [2023-02-25 14:41:20,114][36142] Sum rewards: 63.015, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.426', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.152', 'AMMO3': '0.188', 'weapon2': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '3.030', 'weapon3': '3.076', 'DAMAGECOUNT': '15.897', 'FRAGCOUNT': '54.000'} [2023-02-25 14:41:20,624][36156] DAMAGECOUNT value on done: 1282975.0 [2023-02-25 14:41:20,625][36156] Sum rewards: 55.391, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.154', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.045', 'AMMO3': '0.157', 'AMMO4': '0.226', 'weapon5': '0.270', 'weapon2': '0.426', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.796', 'WEAPON3': '1.000', 'weapon3': '2.178', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.027', 'FRAGCOUNT': '47.000'} [2023-02-25 14:41:20,740][36138] Updated weights for policy 0, policy_version 54243 (0.0009) [2023-02-25 14:41:20,934][36156] DAMAGECOUNT value on done: 1266564.0 [2023-02-25 14:41:20,934][36156] Sum rewards: 54.191, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.992', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.116', 'AMMO3': '0.152', 'weapon4': '0.182', 'weapon2': '0.430', 'WEAPON3': '1.050', 'HITCOUNT': '2.660', 'weapon3': '3.002', 'DAMAGECOUNT': '13.827', 'FRAGCOUNT': '45.000'} [2023-02-25 14:41:20,946][36156] DAMAGECOUNT value on done: 1277661.0 [2023-02-25 14:41:20,947][36156] Sum rewards: 51.817, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.718', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon2': '0.170', 'weapon5': '0.170', 'AMMO4': '0.173', 'AMMO3': '0.252', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.576', 'WEAPON3': '1.400', 'weapon3': '2.786', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.355', 'FRAGCOUNT': '48.000'} [2023-02-25 14:41:21,248][36156] DAMAGECOUNT value on done: 1268341.0 [2023-02-25 14:41:21,249][36156] Sum rewards: 70.880, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.213', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.178', 'AMMO4': '0.192', 'weapon2': '0.228', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.442', 'WEAPON3': '1.450', 'weapon3': '2.828', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '61.000'} [2023-02-25 14:41:23,827][36138] Updated weights for policy 0, policy_version 54253 (0.0009) [2023-02-25 14:41:24,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13312.0, 300 sec: 13384.9). Total num frames: 222228480. Throughput: 0: 3345.3. Samples: 18048736. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:41:24,729][36114] Avg episode reward: [(0, '58.623')] [2023-02-25 14:41:26,926][36138] Updated weights for policy 0, policy_version 54263 (0.0009) [2023-02-25 14:41:29,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 222298112. Throughput: 0: 3342.7. Samples: 18068750. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:41:29,730][36114] Avg episode reward: [(0, '58.623')] [2023-02-25 14:41:29,952][36138] Updated weights for policy 0, policy_version 54273 (0.0009) [2023-02-25 14:41:30,532][36140] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:41:30,697][36154] DAMAGECOUNT value on done: 1281894.0 [2023-02-25 14:41:30,698][36154] Sum rewards: 68.423, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.670', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.060', 'AMMO3': '0.120', 'WEAPON5': '0.200', 'AMMO4': '0.209', 'weapon4': '0.348', 'WEAPON4': '0.400', 'weapon2': '0.442', 'WEAPON3': '0.750', 'weapon3': '2.966', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.699', 'FRAGCOUNT': '56.000'} [2023-02-25 14:41:30,997][36154] DAMAGECOUNT value on done: 1259772.0 [2023-02-25 14:41:30,997][36154] Sum rewards: 67.605, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.580', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.052', 'weapon2': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.254', 'weapon4': '0.364', 'WEAPON3': '1.500', 'weapon3': '3.230', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '58.000'} [2023-02-25 14:41:31,321][36154] DAMAGECOUNT value on done: 1287142.0 [2023-02-25 14:41:31,321][36154] Sum rewards: 66.569, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.790', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon4': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.518', 'WEAPON3': '1.450', 'weapon3': '3.198', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.963', 'FRAGCOUNT': '58.000'} [2023-02-25 14:41:31,392][36141] DAMAGECOUNT value on done: 1285782.0 [2023-02-25 14:41:31,392][36141] Sum rewards: 65.057, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.631', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon5': '0.140', 'AMMO3': '0.190', 'AMMO4': '0.222', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.472', 'weapon2': '0.486', 'WEAPON3': '1.250', 'weapon3': '2.684', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.361', 'FRAGCOUNT': '55.000'} [2023-02-25 14:41:31,648][36154] DAMAGECOUNT value on done: 1273237.0 [2023-02-25 14:41:31,648][36154] Sum rewards: 61.568, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.012', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.132', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'weapon5': '0.262', 'weapon2': '0.274', 'WEAPON4': '0.300', 'weapon4': '0.426', 'WEAPON3': '1.250', 'weapon3': '2.776', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.047', 'FRAGCOUNT': '55.000'} [2023-02-25 14:41:31,722][36141] DAMAGECOUNT value on done: 1281639.0 [2023-02-25 14:41:31,723][36141] Sum rewards: 56.408, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.064', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.175', 'weapon5': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.448', 'weapon2': '0.462', 'WEAPON3': '1.050', 'weapon3': '2.688', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.190', 'FRAGCOUNT': '49.000'} [2023-02-25 14:41:31,831][36141] DAMAGECOUNT value on done: 1270094.0 [2023-02-25 14:41:31,831][36141] Sum rewards: 67.004, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.308', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon2': '0.154', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.306', 'weapon4': '0.864', 'WEAPON3': '1.100', 'weapon3': '2.352', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '58.000'} [2023-02-25 14:41:32,125][36141] DAMAGECOUNT value on done: 1263175.0 [2023-02-25 14:41:32,126][36141] Sum rewards: 64.990, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.592', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.092', 'AMMO4': '0.132', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.400', 'weapon2': '0.440', 'weapon4': '0.750', 'WEAPON3': '1.300', 'weapon3': '2.348', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '57.000'} [2023-02-25 14:41:32,768][36155] DAMAGECOUNT value on done: 1272444.0 [2023-02-25 14:41:32,769][36155] Sum rewards: 54.203, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.200', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.136', 'WEAPON5': '0.200', 'AMMO4': '0.211', 'AMMO3': '0.224', 'weapon2': '0.234', 'WEAPON4': '0.400', 'weapon4': '0.982', 'WEAPON3': '1.250', 'weapon3': '2.376', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '14.838', 'FRAGCOUNT': '49.000'} [2023-02-25 14:41:32,783][36139] DAMAGECOUNT value on done: 1276042.0 [2023-02-25 14:41:32,783][36139] Sum rewards: 59.779, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.182', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.060', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'weapon2': '0.266', 'weapon4': '0.466', 'WEAPON3': '0.850', 'weapon3': '2.796', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.247', 'FRAGCOUNT': '46.000'} [2023-02-25 14:41:33,056][36138] Updated weights for policy 0, policy_version 54283 (0.0009) [2023-02-25 14:41:33,088][36155] DAMAGECOUNT value on done: 1274486.0 [2023-02-25 14:41:33,088][36155] Sum rewards: 56.476, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.727', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.019', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.092', 'AMMO3': '0.156', 'WEAPON4': '0.250', 'weapon2': '0.272', 'weapon4': '0.566', 'WEAPON3': '0.900', 'weapon3': '3.026', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.962', 'FRAGCOUNT': '46.000'} [2023-02-25 14:41:33,097][36139] DAMAGECOUNT value on done: 1268961.0 [2023-02-25 14:41:33,098][36139] Sum rewards: 60.978, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.733', 'AMMO5': '0.007', 'weapon5': '0.016', 'AMMO2': '0.020', 'weapon4': '0.080', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon2': '0.190', 'AMMO3': '0.218', 'WEAPON3': '1.250', 'HITCOUNT': '3.140', 'weapon3': '3.528', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '52.000'} [2023-02-25 14:41:33,567][36139] DAMAGECOUNT value on done: 1285483.0 [2023-02-25 14:41:33,567][36139] Sum rewards: 57.265, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.580', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon2': '0.176', 'AMMO3': '0.191', 'weapon5': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.944', 'WEAPON3': '1.100', 'weapon3': '2.310', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.355', 'FRAGCOUNT': '50.000'} [2023-02-25 14:41:33,712][36155] DAMAGECOUNT value on done: 1291080.0 [2023-02-25 14:41:33,712][36155] Sum rewards: 59.554, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.250', 'AMMO5': '0.016', 'AMMO2': '0.048', 'AMMO3': '0.194', 'AMMO4': '0.241', 'weapon5': '0.320', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.402', 'weapon4': '0.682', 'WEAPON3': '1.150', 'weapon3': '2.330', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '15.030', 'FRAGCOUNT': '52.000'} [2023-02-25 14:41:33,884][36139] DAMAGECOUNT value on done: 1280494.0 [2023-02-25 14:41:33,885][36139] Sum rewards: 51.062, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.576', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.034', 'weapon5': '0.156', 'AMMO4': '0.171', 'AMMO3': '0.224', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.454', 'weapon4': '0.474', 'WEAPON3': '1.300', 'weapon3': '2.666', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '15.219', 'FRAGCOUNT': '45.000'} [2023-02-25 14:41:34,008][36155] DAMAGECOUNT value on done: 1271941.0 [2023-02-25 14:41:34,009][36155] Sum rewards: 60.505, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.475', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.225', 'weapon2': '0.704', 'WEAPON3': '1.250', 'weapon3': '3.048', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.063', 'FRAGCOUNT': '51.000'} [2023-02-25 14:41:34,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 222363648. Throughput: 0: 3342.8. Samples: 18088768. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:41:34,730][36114] Avg episode reward: [(0, '58.568')] [2023-02-25 14:41:35,231][36157] DAMAGECOUNT value on done: 1283324.0 [2023-02-25 14:41:35,232][36157] Sum rewards: 47.421, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.740', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.064', 'AMMO3': '0.165', 'weapon5': '0.194', 'AMMO4': '0.319', 'weapon2': '0.342', 'WEAPON5': '0.450', 'WEAPON4': '0.800', 'weapon4': '0.940', 'WEAPON3': '1.050', 'weapon3': '2.214', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.376', 'FRAGCOUNT': '43.000'} [2023-02-25 14:41:35,539][36157] DAMAGECOUNT value on done: 1272013.0 [2023-02-25 14:41:35,540][36157] Sum rewards: 43.058, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.848', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.053', 'AMMO3': '0.172', 'weapon2': '0.228', 'AMMO4': '0.263', 'weapon5': '0.470', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.816', 'WEAPON3': '1.050', 'weapon3': '2.126', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '13.353', 'FRAGCOUNT': '39.000'} [2023-02-25 14:41:35,702][36157] DAMAGECOUNT value on done: 1285681.0 [2023-02-25 14:41:35,703][36157] Sum rewards: 70.424, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.370', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.022', 'AMMO4': '0.045', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon2': '0.220', 'AMMO3': '0.238', 'WEAPON3': '1.550', 'HITCOUNT': '3.270', 'weapon3': '3.448', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '62.000'} [2023-02-25 14:41:36,005][36157] DAMAGECOUNT value on done: 1280309.0 [2023-02-25 14:41:36,006][36157] Sum rewards: 73.275, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.650', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'weapon5': '0.144', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon2': '0.336', 'weapon4': '0.414', 'WEAPON3': '1.300', 'weapon3': '2.868', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '62.000'} [2023-02-25 14:41:36,075][36138] Updated weights for policy 0, policy_version 54293 (0.0009) [2023-02-25 14:41:36,376][36140] DAMAGECOUNT value on done: 1283865.0 [2023-02-25 14:41:36,377][36140] Sum rewards: 65.548, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.278', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon4': '0.052', 'AMMO4': '0.115', 'weapon5': '0.118', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.506', 'WEAPON3': '1.200', 'weapon3': '3.160', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '54.000'} [2023-02-25 14:41:36,386][36140] DAMAGECOUNT value on done: 1278697.0 [2023-02-25 14:41:36,386][36140] Sum rewards: 54.695, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.182', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon2': '0.162', 'weapon5': '0.170', 'AMMO3': '0.182', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.918', 'WEAPON3': '1.100', 'weapon3': '2.438', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.553', 'FRAGCOUNT': '47.000'} [2023-02-25 14:41:36,675][36140] DAMAGECOUNT value on done: 1266737.0 [2023-02-25 14:41:36,676][36140] Sum rewards: 57.557, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.090', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'weapon5': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon2': '0.342', 'weapon4': '0.594', 'WEAPON3': '1.100', 'HITCOUNT': '2.750', 'weapon3': '2.782', 'DAMAGECOUNT': '14.433', 'FRAGCOUNT': '48.000'} [2023-02-25 14:41:36,686][36140] DAMAGECOUNT value on done: 1266741.0 [2023-02-25 14:41:36,686][36140] Sum rewards: 47.415, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.200', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.124', 'AMMO4': '0.176', 'AMMO3': '0.195', 'weapon5': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.536', 'WEAPON3': '1.050', 'HITCOUNT': '2.640', 'weapon3': '2.916', 'DAMAGECOUNT': '12.639', 'FRAGCOUNT': '41.000'} [2023-02-25 14:41:38,959][36142] DAMAGECOUNT value on done: 1273707.0 [2023-02-25 14:41:38,960][36142] Sum rewards: 60.847, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.394', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon5': '0.090', 'weapon2': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.250', 'weapon4': '0.440', 'WEAPON3': '1.550', 'weapon3': '3.114', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.898', 'FRAGCOUNT': '55.000'} [2023-02-25 14:41:39,131][36138] Updated weights for policy 0, policy_version 54303 (0.0010) [2023-02-25 14:41:39,267][36142] DAMAGECOUNT value on done: 1263769.0 [2023-02-25 14:41:39,267][36142] Sum rewards: 65.328, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.300', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.114', 'AMMO4': '0.153', 'weapon5': '0.162', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.344', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.126', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '56.000'} [2023-02-25 14:41:39,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 222429184. Throughput: 0: 3343.7. Samples: 18098850. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:41:39,730][36114] Avg episode reward: [(0, '58.214')] [2023-02-25 14:41:39,882][36142] DAMAGECOUNT value on done: 1273978.0 [2023-02-25 14:41:39,882][36142] Sum rewards: 57.547, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.125', 'AMMO4': '0.133', 'HEALTH': '0.160', 'weapon2': '0.202', 'WEAPON4': '0.250', 'weapon4': '0.354', 'WEAPON3': '0.750', 'HITCOUNT': '2.810', 'weapon3': '3.316', 'DAMAGECOUNT': '12.840', 'FRAGCOUNT': '47.000'} [2023-02-25 14:41:40,194][36142] DAMAGECOUNT value on done: 1281830.0 [2023-02-25 14:41:40,194][36142] Sum rewards: 65.199, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.010', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon5': '0.018', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'weapon2': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.264', 'weapon4': '0.304', 'WEAPON3': '1.600', 'weapon3': '3.284', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.515', 'FRAGCOUNT': '57.000'} [2023-02-25 14:41:40,847][36156] DAMAGECOUNT value on done: 1288497.0 [2023-02-25 14:41:40,848][36156] Sum rewards: 67.557, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.700', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.162', 'AMMO3': '0.220', 'weapon2': '0.388', 'WEAPON3': '1.300', 'weapon3': '3.234', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '58.000'} [2023-02-25 14:41:41,170][36156] DAMAGECOUNT value on done: 1271486.0 [2023-02-25 14:41:41,170][36156] Sum rewards: 58.064, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.870', 'AMMO5': '0.011', 'AMMO2': '0.016', 'weapon5': '0.070', 'AMMO4': '0.080', 'weapon4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.298', 'WEAPON3': '1.250', 'HITCOUNT': '2.870', 'weapon3': '3.220', 'DAMAGECOUNT': '14.766', 'FRAGCOUNT': '49.000'} [2023-02-25 14:41:41,182][36156] DAMAGECOUNT value on done: 1282746.0 [2023-02-25 14:41:41,183][36156] Sum rewards: 55.989, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.060', 'AMMO5': '0.025', 'AMMO2': '0.064', 'AMMO3': '0.179', 'weapon5': '0.232', 'AMMO4': '0.321', 'weapon2': '0.366', 'weapon4': '0.500', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.050', 'weapon3': '2.536', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.255', 'FRAGCOUNT': '51.000'} [2023-02-25 14:41:41,497][36156] DAMAGECOUNT value on done: 1273208.0 [2023-02-25 14:41:41,497][36156] Sum rewards: 55.448, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.798', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.215', 'weapon5': '0.232', 'weapon4': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.350', 'weapon3': '2.836', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.601', 'FRAGCOUNT': '49.000'} [2023-02-25 14:41:41,693][36142] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:41:42,206][36138] Updated weights for policy 0, policy_version 54313 (0.0009) [2023-02-25 14:41:44,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 222498816. Throughput: 0: 3340.8. Samples: 18118872. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:41:44,730][36114] Avg episode reward: [(0, '58.504')] [2023-02-25 14:41:45,271][36138] Updated weights for policy 0, policy_version 54323 (0.0009) [2023-02-25 14:41:48,325][36138] Updated weights for policy 0, policy_version 54333 (0.0009) [2023-02-25 14:41:49,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 222564352. Throughput: 0: 3345.2. Samples: 18139032. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:41:49,729][36114] Avg episode reward: [(0, '58.504')] [2023-02-25 14:41:50,803][36154] DAMAGECOUNT value on done: 1286719.0 [2023-02-25 14:41:50,803][36154] Sum rewards: 53.182, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.602', 'weapon5': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.036', 'AMMO4': '0.180', 'weapon4': '0.198', 'AMMO3': '0.235', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.462', 'WEAPON3': '1.450', 'HITCOUNT': '2.920', 'weapon3': '3.030', 'DAMAGECOUNT': '14.430', 'FRAGCOUNT': '48.000'} [2023-02-25 14:41:51,125][36154] DAMAGECOUNT value on done: 1265080.0 [2023-02-25 14:41:51,125][36154] Sum rewards: 63.131, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.120', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.150', 'AMMO3': '0.233', 'WEAPON5': '0.250', 'weapon4': '0.322', 'WEAPON4': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.350', 'weapon3': '2.882', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.924', 'FRAGCOUNT': '56.500'} [2023-02-25 14:41:51,396][36138] Updated weights for policy 0, policy_version 54343 (0.0009) [2023-02-25 14:41:51,458][36154] DAMAGECOUNT value on done: 1292903.0 [2023-02-25 14:41:51,459][36154] Sum rewards: 61.086, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.485', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon5': '0.048', 'weapon4': '0.130', 'AMMO4': '0.134', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.300', 'weapon3': '3.248', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '52.500'} [2023-02-25 14:41:51,540][36141] DAMAGECOUNT value on done: 1290846.0 [2023-02-25 14:41:51,540][36141] Sum rewards: 60.060, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.270', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.130', 'weapon2': '0.162', 'AMMO4': '0.185', 'WEAPON5': '0.200', 'AMMO3': '0.252', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '3.070', 'weapon3': '3.482', 'DAMAGECOUNT': '15.192', 'FRAGCOUNT': '55.000'} [2023-02-25 14:41:51,762][36154] DAMAGECOUNT value on done: 1278172.0 [2023-02-25 14:41:51,762][36154] Sum rewards: 54.590, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.485', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.100', 'WEAPON4': '0.250', 'AMMO3': '0.309', 'weapon4': '0.326', 'weapon2': '0.406', 'ARMOR': '0.457', 'WEAPON3': '1.700', 'weapon3': '2.974', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.799', 'FRAGCOUNT': '52.000'} [2023-02-25 14:41:51,858][36141] DAMAGECOUNT value on done: 1286142.0 [2023-02-25 14:41:51,858][36141] Sum rewards: 54.912, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.170', 'AMMO5': '0.014', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.196', 'weapon5': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.280', 'weapon2': '0.302', 'WEAPON3': '1.250', 'HITCOUNT': '2.900', 'weapon3': '2.984', 'DAMAGECOUNT': '13.509', 'FRAGCOUNT': '47.500'} [2023-02-25 14:41:51,986][36141] DAMAGECOUNT value on done: 1274755.0 [2023-02-25 14:41:51,986][36141] Sum rewards: 57.768, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.889', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.088', 'AMMO4': '0.116', 'weapon2': '0.182', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.592', 'WEAPON3': '1.200', 'weapon3': '2.910', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.983', 'FRAGCOUNT': '51.000'} [2023-02-25 14:41:52,275][36141] DAMAGECOUNT value on done: 1267762.0 [2023-02-25 14:41:52,275][36141] Sum rewards: 62.138, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.130', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.155', 'WEAPON4': '0.250', 'weapon2': '0.252', 'weapon4': '0.480', 'WEAPON3': '1.000', 'HITCOUNT': '3.040', 'weapon3': '3.090', 'DAMAGECOUNT': '13.761', 'FRAGCOUNT': '53.000'} [2023-02-25 14:41:52,757][36155] DAMAGECOUNT value on done: 1277189.0 [2023-02-25 14:41:52,757][36155] Sum rewards: 50.976, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.530', 'AMMO5': '0.007', 'AMMO2': '0.040', 'AMMO3': '0.145', 'weapon5': '0.162', 'AMMO4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.274', 'weapon2': '0.372', 'WEAPON4': '0.450', 'WEAPON3': '0.850', 'HITCOUNT': '2.850', 'weapon3': '2.920', 'DAMAGECOUNT': '14.235', 'FRAGCOUNT': '44.000'} [2023-02-25 14:41:52,926][36139] DAMAGECOUNT value on done: 1280665.0 [2023-02-25 14:41:52,927][36139] Sum rewards: 42.422, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.822', 'ARMOR': '0.012', 'AMMO5': '0.023', 'AMMO2': '0.059', 'weapon5': '0.208', 'AMMO3': '0.210', 'AMMO4': '0.295', 'weapon4': '0.298', 'weapon2': '0.456', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.724', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '13.869', 'FRAGCOUNT': '38.500'} [2023-02-25 14:41:53,072][36155] DAMAGECOUNT value on done: 1279923.0 [2023-02-25 14:41:53,072][36155] Sum rewards: 63.258, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.758', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.096', 'AMMO4': '0.165', 'weapon4': '0.170', 'AMMO3': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.050', 'weapon3': '3.110', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '53.000'} [2023-02-25 14:41:53,234][36139] DAMAGECOUNT value on done: 1274850.0 [2023-02-25 14:41:53,234][36139] Sum rewards: 64.426, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.180', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.078', 'AMMO4': '0.143', 'weapon4': '0.196', 'AMMO3': '0.243', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.446', 'WEAPON3': '1.400', 'weapon3': '3.004', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.667', 'FRAGCOUNT': '56.000'} [2023-02-25 14:41:53,660][36139] DAMAGECOUNT value on done: 1291306.0 [2023-02-25 14:41:53,660][36139] Sum rewards: 70.775, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.195', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.039', 'AMMO3': '0.180', 'AMMO4': '0.197', 'weapon5': '0.274', 'weapon2': '0.370', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.464', 'WEAPON3': '1.150', 'weapon3': '2.614', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '59.000'} [2023-02-25 14:41:53,718][36155] DAMAGECOUNT value on done: 1296077.0 [2023-02-25 14:41:53,718][36155] Sum rewards: 55.489, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.373', 'AMMO5': '0.022', 'AMMO2': '0.033', 'AMMO4': '0.166', 'AMMO3': '0.208', 'weapon5': '0.216', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.450', 'weapon2': '0.502', 'WEAPON3': '1.300', 'weapon3': '2.514', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.991', 'FRAGCOUNT': '49.500'} [2023-02-25 14:41:53,965][36139] DAMAGECOUNT value on done: 1286209.0 [2023-02-25 14:41:53,965][36139] Sum rewards: 70.824, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.265', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.024', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.231', 'weapon2': '0.358', 'WEAPON3': '1.400', 'HITCOUNT': '3.330', 'weapon3': '3.424', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '60.500'} [2023-02-25 14:41:54,032][36155] DAMAGECOUNT value on done: 1276316.0 [2023-02-25 14:41:54,033][36155] Sum rewards: 52.802, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.788', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.172', 'weapon4': '0.196', 'WEAPON4': '0.250', 'weapon2': '0.490', 'WEAPON3': '1.000', 'HITCOUNT': '2.780', 'weapon3': '3.040', 'DAMAGECOUNT': '13.125', 'FRAGCOUNT': '45.000'} [2023-02-25 14:41:54,471][36138] Updated weights for policy 0, policy_version 54353 (0.0010) [2023-02-25 14:41:54,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.2, 300 sec: 13384.9). Total num frames: 222629888. Throughput: 0: 3342.3. Samples: 18148950. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:41:54,730][36114] Avg episode reward: [(0, '58.808')] [2023-02-25 14:41:55,273][36157] DAMAGECOUNT value on done: 1289089.0 [2023-02-25 14:41:55,273][36157] Sum rewards: 72.870, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.226', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.069', 'AMMO3': '0.119', 'weapon5': '0.144', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.312', 'weapon4': '0.480', 'WEAPON3': '0.700', 'weapon3': '2.912', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '57.000'} [2023-02-25 14:41:55,582][36157] DAMAGECOUNT value on done: 1277197.0 [2023-02-25 14:41:55,582][36157] Sum rewards: 60.208, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.550', 'AMMO5': '0.006', 'AMMO2': '0.040', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'AMMO4': '0.199', 'weapon2': '0.254', 'WEAPON4': '0.350', 'weapon4': '0.492', 'WEAPON3': '1.100', 'weapon3': '2.954', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.552', 'FRAGCOUNT': '52.000'} [2023-02-25 14:41:55,747][36157] DAMAGECOUNT value on done: 1290800.0 [2023-02-25 14:41:55,747][36157] Sum rewards: 56.774, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.670', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.058', 'weapon4': '0.172', 'AMMO3': '0.215', 'AMMO4': '0.228', 'WEAPON5': '0.300', 'weapon2': '0.406', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.080', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.357', 'FRAGCOUNT': '51.000'} [2023-02-25 14:41:56,063][36157] DAMAGECOUNT value on done: 1285585.0 [2023-02-25 14:41:56,064][36157] Sum rewards: 62.043, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.370', 'weapon5': '0.002', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon4': '0.006', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.208', 'weapon2': '0.624', 'WEAPON3': '1.300', 'weapon3': '3.208', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.828', 'FRAGCOUNT': '53.000'} [2023-02-25 14:41:56,503][36140] DAMAGECOUNT value on done: 1289455.0 [2023-02-25 14:41:56,503][36140] Sum rewards: 72.817, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.930', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON4': '0.100', 'AMMO3': '0.164', 'weapon4': '0.248', 'weapon2': '0.292', 'WEAPON3': '1.100', 'HITCOUNT': '3.250', 'weapon3': '3.276', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '60.000'} [2023-02-25 14:41:56,514][36140] DAMAGECOUNT value on done: 1285039.0 [2023-02-25 14:41:56,515][36140] Sum rewards: 82.710, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.159', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.027', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'AMMO3': '0.140', 'weapon4': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.550', 'WEAPON3': '0.900', 'weapon3': '3.012', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.026', 'FRAGCOUNT': '67.000'} [2023-02-25 14:41:56,609][36157] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:41:56,817][36140] DAMAGECOUNT value on done: 1272098.0 [2023-02-25 14:41:56,818][36140] Sum rewards: 58.436, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.680', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon5': '0.188', 'AMMO4': '0.191', 'AMMO3': '0.216', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.524', 'weapon4': '0.648', 'WEAPON3': '1.350', 'weapon3': '2.374', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '52.000'} [2023-02-25 14:41:56,829][36140] DAMAGECOUNT value on done: 1272364.0 [2023-02-25 14:41:56,829][36140] Sum rewards: 64.665, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.381', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO3': '0.181', 'AMMO4': '0.189', 'weapon5': '0.210', 'weapon2': '0.344', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.508', 'WEAPON3': '1.200', 'weapon3': '2.680', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.869', 'FRAGCOUNT': '55.000'} [2023-02-25 14:41:57,580][36138] Updated weights for policy 0, policy_version 54363 (0.0009) [2023-02-25 14:41:59,175][36142] DAMAGECOUNT value on done: 1278408.0 [2023-02-25 14:41:59,175][36142] Sum rewards: 55.420, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.320', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.056', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'weapon4': '0.232', 'weapon2': '0.430', 'WEAPON3': '1.150', 'HITCOUNT': '2.880', 'weapon3': '3.130', 'DAMAGECOUNT': '14.103', 'FRAGCOUNT': '47.000'} [2023-02-25 14:41:59,480][36142] DAMAGECOUNT value on done: 1268903.0 [2023-02-25 14:41:59,480][36142] Sum rewards: 55.650, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.546', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.055', 'AMMO3': '0.217', 'weapon5': '0.226', 'weapon2': '0.262', 'AMMO4': '0.274', 'weapon4': '0.444', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.692', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '15.402', 'FRAGCOUNT': '50.500'} [2023-02-25 14:41:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 222699520. Throughput: 0: 3338.5. Samples: 18168974. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:41:59,730][36114] Avg episode reward: [(0, '59.966')] [2023-02-25 14:42:00,104][36142] DAMAGECOUNT value on done: 1279880.0 [2023-02-25 14:42:00,105][36142] Sum rewards: 70.391, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.170', 'AMMO5': '0.009', 'AMMO2': '0.010', 'weapon4': '0.038', 'AMMO4': '0.048', 'weapon5': '0.092', 'WEAPON4': '0.100', 'weapon2': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'WEAPON3': '1.350', 'HITCOUNT': '3.390', 'weapon3': '3.468', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '58.500'} [2023-02-25 14:42:00,401][36142] DAMAGECOUNT value on done: 1286479.0 [2023-02-25 14:42:00,402][36142] Sum rewards: 48.089, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.685', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.044', 'weapon5': '0.080', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'AMMO4': '0.220', 'weapon2': '0.436', 'weapon4': '0.552', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.708', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.947', 'FRAGCOUNT': '46.000'} [2023-02-25 14:42:00,606][36138] Updated weights for policy 0, policy_version 54373 (0.0009) [2023-02-25 14:42:01,026][36156] DAMAGECOUNT value on done: 1294162.0 [2023-02-25 14:42:01,026][36156] Sum rewards: 67.163, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.730', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.070', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.210', 'AMMO3': '0.233', 'weapon2': '0.384', 'WEAPON3': '1.450', 'weapon3': '3.098', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '57.000'} [2023-02-25 14:42:01,342][36156] DAMAGECOUNT value on done: 1275806.0 [2023-02-25 14:42:01,343][36156] Sum rewards: 46.578, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.082', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.122', 'AMMO3': '0.177', 'weapon2': '0.178', 'AMMO4': '0.190', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.576', 'WEAPON3': '1.000', 'weapon3': '2.864', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.960', 'FRAGCOUNT': '40.000'} [2023-02-25 14:42:01,355][36156] DAMAGECOUNT value on done: 1288438.0 [2023-02-25 14:42:01,356][36156] Sum rewards: 67.725, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.389', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.098', 'AMMO3': '0.146', 'AMMO4': '0.151', 'weapon2': '0.160', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.604', 'WEAPON3': '0.850', 'weapon3': '2.954', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '56.000'} [2023-02-25 14:42:01,652][36156] DAMAGECOUNT value on done: 1278457.0 [2023-02-25 14:42:01,652][36156] Sum rewards: 58.566, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.540', 'AMMO5': '0.008', 'AMMO2': '0.032', 'AMMO3': '0.160', 'AMMO4': '0.162', 'weapon5': '0.184', 'weapon4': '0.188', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.698', 'WEAPON3': '1.000', 'weapon3': '2.736', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '49.000'} [2023-02-25 14:42:03,654][36138] Updated weights for policy 0, policy_version 54383 (0.0009) [2023-02-25 14:42:04,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 222765056. Throughput: 0: 3342.9. Samples: 18189176. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:42:04,730][36114] Avg episode reward: [(0, '60.129')] [2023-02-25 14:42:06,733][36138] Updated weights for policy 0, policy_version 54393 (0.0009) [2023-02-25 14:42:09,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 222830592. Throughput: 0: 3343.1. Samples: 18199178. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:42:09,730][36114] Avg episode reward: [(0, '60.129')] [2023-02-25 14:42:09,782][36138] Updated weights for policy 0, policy_version 54403 (0.0009) [2023-02-25 14:42:10,918][36154] DAMAGECOUNT value on done: 1291903.0 [2023-02-25 14:42:10,918][36154] Sum rewards: 66.040, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.825', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.176', 'weapon2': '0.242', 'WEAPON4': '0.250', 'weapon4': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.998', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '15.552', 'FRAGCOUNT': '56.000'} [2023-02-25 14:42:11,223][36154] DAMAGECOUNT value on done: 1270280.0 [2023-02-25 14:42:11,224][36154] Sum rewards: 61.028, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.812', 'AMMO5': '0.008', 'AMMO2': '0.053', 'weapon5': '0.158', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'weapon2': '0.266', 'AMMO4': '0.267', 'weapon4': '0.338', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.956', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.600', 'FRAGCOUNT': '56.000'} [2023-02-25 14:42:11,565][36154] DAMAGECOUNT value on done: 1298177.0 [2023-02-25 14:42:11,565][36154] Sum rewards: 66.406, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.616', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.068', 'weapon5': '0.160', 'weapon4': '0.190', 'AMMO3': '0.212', 'weapon2': '0.290', 'AMMO4': '0.342', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.962', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.822', 'FRAGCOUNT': '61.000'} [2023-02-25 14:42:11,720][36141] DAMAGECOUNT value on done: 1294736.0 [2023-02-25 14:42:11,721][36141] Sum rewards: 44.989, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.996', 'AMMO5': '0.018', 'AMMO2': '0.031', 'weapon5': '0.110', 'AMMO4': '0.153', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon4': '0.280', 'weapon2': '0.318', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.610', 'weapon3': '3.082', 'DAMAGECOUNT': '11.670', 'FRAGCOUNT': '41.000'} [2023-02-25 14:42:11,873][36154] DAMAGECOUNT value on done: 1283607.0 [2023-02-25 14:42:11,874][36154] Sum rewards: 59.646, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.716', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.054', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'AMMO3': '0.267', 'weapon2': '0.332', 'WEAPON3': '1.600', 'weapon3': '3.272', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.290', 'FRAGCOUNT': '53.000'} [2023-02-25 14:42:12,015][36141] DAMAGECOUNT value on done: 1291348.0 [2023-02-25 14:42:12,015][36141] Sum rewards: 59.397, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.605', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'weapon5': '0.118', 'AMMO4': '0.124', 'weapon2': '0.144', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'weapon4': '0.560', 'WEAPON3': '1.400', 'weapon3': '2.938', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.498', 'FRAGCOUNT': '53.000'} [2023-02-25 14:42:12,100][36141] DAMAGECOUNT value on done: 1279442.0 [2023-02-25 14:42:12,100][36141] Sum rewards: 56.264, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.149', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO3': '0.137', 'AMMO4': '0.193', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon5': '0.416', 'weapon4': '0.660', 'weapon2': '0.696', 'WEAPON3': '0.700', 'weapon3': '1.996', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '14.061', 'FRAGCOUNT': '44.500'} [2023-02-25 14:42:12,415][36141] DAMAGECOUNT value on done: 1272787.0 [2023-02-25 14:42:12,415][36141] Sum rewards: 54.880, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.229', 'AMMO5': '0.013', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.212', 'weapon2': '0.236', 'weapon4': '0.236', 'AMMO3': '0.263', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '2.990', 'weapon3': '3.040', 'DAMAGECOUNT': '15.075', 'FRAGCOUNT': '51.000'} [2023-02-25 14:42:12,664][36155] DAMAGECOUNT value on done: 1282967.0 [2023-02-25 14:42:12,665][36155] Sum rewards: 65.821, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.411', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.104', 'AMMO3': '0.141', 'AMMO4': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.312', 'weapon4': '0.396', 'WEAPON3': '0.950', 'weapon3': '2.998', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '51.000'} [2023-02-25 14:42:12,811][36139] DAMAGECOUNT value on done: 1285414.0 [2023-02-25 14:42:12,812][36139] Sum rewards: 58.385, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.155', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON5': '0.050', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon4': '0.350', 'weapon2': '0.488', 'WEAPON3': '1.200', 'weapon3': '2.888', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.247', 'FRAGCOUNT': '51.000'} [2023-02-25 14:42:12,829][36138] Updated weights for policy 0, policy_version 54413 (0.0009) [2023-02-25 14:42:12,972][36155] DAMAGECOUNT value on done: 1284866.0 [2023-02-25 14:42:12,972][36155] Sum rewards: 55.327, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.870', 'AMMO5': '0.016', 'AMMO2': '0.054', 'AMMO3': '0.128', 'weapon2': '0.184', 'weapon5': '0.234', 'AMMO4': '0.270', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '0.600', 'weapon4': '0.820', 'weapon3': '2.372', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.829', 'FRAGCOUNT': '44.500'} [2023-02-25 14:42:13,111][36139] DAMAGECOUNT value on done: 1279980.0 [2023-02-25 14:42:13,112][36139] Sum rewards: 63.410, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.750', 'AMMO5': '0.012', 'AMMO2': '0.053', 'AMMO3': '0.182', 'AMMO4': '0.264', 'weapon5': '0.284', 'WEAPON5': '0.350', 'weapon2': '0.372', 'weapon4': '0.532', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.520', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '57.000'} [2023-02-25 14:42:13,561][36139] DAMAGECOUNT value on done: 1297032.0 [2023-02-25 14:42:13,562][36139] Sum rewards: 62.659, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.363', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.063', 'weapon5': '0.178', 'AMMO3': '0.221', 'weapon4': '0.230', 'weapon2': '0.246', 'AMMO4': '0.318', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '3.044', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '56.000'} [2023-02-25 14:42:13,714][36155] DAMAGECOUNT value on done: 1300891.0 [2023-02-25 14:42:13,715][36155] Sum rewards: 52.707, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.396', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.070', 'AMMO4': '0.150', 'weapon2': '0.228', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.294', 'WEAPON3': '1.400', 'HITCOUNT': '3.110', 'weapon3': '3.122', 'DAMAGECOUNT': '14.442', 'FRAGCOUNT': '47.000'} [2023-02-25 14:42:13,869][36139] DAMAGECOUNT value on done: 1291888.0 [2023-02-25 14:42:13,869][36139] Sum rewards: 63.725, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.298', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO4': '0.142', 'AMMO3': '0.185', 'weapon2': '0.246', 'weapon5': '0.276', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.588', 'WEAPON3': '1.100', 'weapon3': '2.498', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '52.500'} [2023-02-25 14:42:14,025][36155] DAMAGECOUNT value on done: 1281625.0 [2023-02-25 14:42:14,025][36155] Sum rewards: 70.391, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.152', 'AMMO4': '0.201', 'WEAPON4': '0.250', 'weapon2': '0.254', 'HEALTH': '0.430', 'weapon4': '0.434', 'WEAPON3': '0.900', 'weapon3': '3.058', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.927', 'FRAGCOUNT': '58.000'} [2023-02-25 14:42:14,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.2, 300 sec: 13384.9). Total num frames: 222900224. Throughput: 0: 3346.4. Samples: 18219340. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:42:14,730][36114] Avg episode reward: [(0, '60.316')] [2023-02-25 14:42:15,309][36157] DAMAGECOUNT value on done: 1294723.0 [2023-02-25 14:42:15,310][36157] Sum rewards: 66.921, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.948', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon5': '0.070', 'AMMO4': '0.146', 'weapon2': '0.204', 'AMMO3': '0.245', 'weapon4': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.192', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.902', 'FRAGCOUNT': '59.000'} [2023-02-25 14:42:15,626][36157] DAMAGECOUNT value on done: 1282043.0 [2023-02-25 14:42:15,627][36157] Sum rewards: 63.869, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.130', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.136', 'weapon5': '0.138', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.474', 'WEAPON3': '0.700', 'weapon4': '0.780', 'weapon3': '2.402', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.538', 'FRAGCOUNT': '52.000'} [2023-02-25 14:42:15,784][36157] DAMAGECOUNT value on done: 1295308.0 [2023-02-25 14:42:15,785][36157] Sum rewards: 58.746, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.632', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon5': '0.170', 'AMMO3': '0.221', 'weapon4': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.576', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.494', 'FRAGCOUNT': '54.000'} [2023-02-25 14:42:15,892][36138] Updated weights for policy 0, policy_version 54423 (0.0009) [2023-02-25 14:42:16,021][36142] Large shaping reward 2.607 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.585, 195.0), ('weapon5', 0.002)] [2023-02-25 14:42:16,100][36157] DAMAGECOUNT value on done: 1290971.0 [2023-02-25 14:42:16,101][36157] Sum rewards: 64.616, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.182', 'AMMO5': '0.009', 'weapon4': '0.014', 'AMMO2': '0.021', 'weapon5': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon2': '0.342', 'WEAPON3': '1.350', 'HITCOUNT': '3.290', 'weapon3': '3.470', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '55.000'} [2023-02-25 14:42:16,612][36140] DAMAGECOUNT value on done: 1295026.0 [2023-02-25 14:42:16,613][36140] Sum rewards: 66.850, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.632', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.024', 'AMMO4': '0.038', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.250', 'weapon2': '0.442', 'WEAPON3': '1.500', 'weapon3': '3.206', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '59.000'} [2023-02-25 14:42:16,636][36140] DAMAGECOUNT value on done: 1289729.0 [2023-02-25 14:42:16,637][36140] Sum rewards: 60.715, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.695', 'AMMO5': '0.013', 'AMMO2': '0.021', 'AMMO4': '0.107', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon4': '0.212', 'weapon5': '0.228', 'WEAPON5': '0.300', 'weapon2': '0.406', 'WEAPON3': '1.250', 'weapon3': '2.872', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.070', 'FRAGCOUNT': '53.000'} [2023-02-25 14:42:16,916][36140] DAMAGECOUNT value on done: 1276720.0 [2023-02-25 14:42:16,916][36140] Sum rewards: 56.004, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.750', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'AMMO3': '0.172', 'weapon4': '0.262', 'weapon2': '0.528', 'WEAPON3': '1.150', 'weapon3': '2.936', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.866', 'FRAGCOUNT': '47.000'} [2023-02-25 14:42:16,937][36140] DAMAGECOUNT value on done: 1277451.0 [2023-02-25 14:42:16,938][36140] Sum rewards: 67.704, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.732', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.080', 'AMMO3': '0.106', 'AMMO4': '0.108', 'WEAPON5': '0.200', 'weapon2': '0.254', 'WEAPON4': '0.350', 'WEAPON3': '0.650', 'weapon4': '0.976', 'weapon3': '2.358', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.261', 'FRAGCOUNT': '53.000'} [2023-02-25 14:42:18,945][36138] Updated weights for policy 0, policy_version 54433 (0.0009) [2023-02-25 14:42:19,288][36142] DAMAGECOUNT value on done: 1283957.0 [2023-02-25 14:42:19,288][36142] Sum rewards: 62.811, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.298', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon5': '0.094', 'weapon4': '0.100', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.496', 'WEAPON3': '1.250', 'weapon3': '3.104', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '52.000'} [2023-02-25 14:42:19,596][36142] DAMAGECOUNT value on done: 1273397.0 [2023-02-25 14:42:19,596][36142] Sum rewards: 49.988, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.124', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon5': '0.170', 'AMMO3': '0.174', 'AMMO4': '0.201', 'weapon2': '0.254', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.580', 'WEAPON3': '1.050', 'weapon3': '2.746', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.482', 'FRAGCOUNT': '43.000'} [2023-02-25 14:42:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 222965760. Throughput: 0: 3347.9. Samples: 18239422. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:42:19,730][36114] Avg episode reward: [(0, '60.429')] [2023-02-25 14:42:20,201][36142] DAMAGECOUNT value on done: 1285957.0 [2023-02-25 14:42:20,201][36142] Sum rewards: 64.014, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.290', 'AMMO5': '0.023', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.212', 'weapon2': '0.228', 'AMMO3': '0.264', 'weapon4': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.906', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '57.000'} [2023-02-25 14:42:20,515][36142] DAMAGECOUNT value on done: 1291523.0 [2023-02-25 14:42:20,516][36142] Sum rewards: 66.321, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.640', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.116', 'AMMO3': '0.148', 'weapon2': '0.160', 'WEAPON5': '0.200', 'weapon5': '0.204', 'WEAPON4': '0.250', 'weapon4': '0.286', 'WEAPON3': '0.950', 'HITCOUNT': '2.780', 'weapon3': '3.200', 'DAMAGECOUNT': '15.132', 'FRAGCOUNT': '55.000'} [2023-02-25 14:42:21,075][36156] DAMAGECOUNT value on done: 1298848.0 [2023-02-25 14:42:21,076][36156] Sum rewards: 54.015, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.870', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon5': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.216', 'AMMO3': '0.239', 'weapon2': '0.322', 'WEAPON3': '1.400', 'HITCOUNT': '2.910', 'weapon3': '3.140', 'DAMAGECOUNT': '14.058', 'FRAGCOUNT': '49.000'} [2023-02-25 14:42:21,387][36156] DAMAGECOUNT value on done: 1280444.0 [2023-02-25 14:42:21,388][36156] Sum rewards: 56.594, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.930', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon5': '0.104', 'AMMO4': '0.156', 'weapon2': '0.158', 'AMMO3': '0.205', 'weapon4': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.750', 'weapon3': '3.308', 'DAMAGECOUNT': '13.914', 'FRAGCOUNT': '51.000'} [2023-02-25 14:42:21,401][36156] DAMAGECOUNT value on done: 1293485.0 [2023-02-25 14:42:21,401][36156] Sum rewards: 55.191, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.680', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.067', 'weapon5': '0.100', 'weapon2': '0.204', 'AMMO3': '0.244', 'WEAPON5': '0.250', 'AMMO4': '0.337', 'WEAPON4': '0.500', 'weapon4': '0.548', 'WEAPON3': '1.450', 'weapon3': '2.884', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.141', 'FRAGCOUNT': '51.000'} [2023-02-25 14:42:21,712][36156] DAMAGECOUNT value on done: 1283970.0 [2023-02-25 14:42:21,712][36156] Sum rewards: 65.676, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.879', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.006', 'weapon4': '0.014', 'AMMO4': '0.032', 'weapon5': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.211', 'weapon2': '0.364', 'WEAPON3': '1.300', 'HITCOUNT': '3.280', 'weapon3': '3.420', 'DAMAGECOUNT': '16.539', 'FRAGCOUNT': '55.000'} [2023-02-25 14:42:21,988][36138] Updated weights for policy 0, policy_version 54443 (0.0009) [2023-02-25 14:42:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 223035392. Throughput: 0: 3347.3. Samples: 18249478. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:42:24,730][36114] Avg episode reward: [(0, '60.342')] [2023-02-25 14:42:25,003][36138] Updated weights for policy 0, policy_version 54453 (0.0010) [2023-02-25 14:42:28,085][36138] Updated weights for policy 0, policy_version 54463 (0.0010) [2023-02-25 14:42:29,729][36114] Fps is (10 sec: 13517.0, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 223100928. Throughput: 0: 3351.6. Samples: 18269696. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:42:29,729][36114] Avg episode reward: [(0, '60.342')] [2023-02-25 14:42:30,926][36154] DAMAGECOUNT value on done: 1296162.0 [2023-02-25 14:42:30,926][36154] Sum rewards: 45.362, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.116', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.138', 'AMMO3': '0.196', 'weapon2': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.622', 'WEAPON3': '1.050', 'HITCOUNT': '2.550', 'weapon3': '2.786', 'DAMAGECOUNT': '12.777', 'FRAGCOUNT': '39.500'} [2023-02-25 14:42:31,156][36138] Updated weights for policy 0, policy_version 54473 (0.0010) [2023-02-25 14:42:31,242][36154] DAMAGECOUNT value on done: 1275156.0 [2023-02-25 14:42:31,242][36154] Sum rewards: 57.508, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.092', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.050', 'weapon5': '0.070', 'AMMO3': '0.169', 'AMMO4': '0.248', 'weapon2': '0.268', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.510', 'WEAPON3': '0.950', 'HITCOUNT': '2.800', 'weapon3': '2.932', 'DAMAGECOUNT': '14.628', 'FRAGCOUNT': '50.000'} [2023-02-25 14:42:31,574][36154] DAMAGECOUNT value on done: 1304451.0 [2023-02-25 14:42:31,575][36154] Sum rewards: 69.340, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.758', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.118', 'WEAPON5': '0.150', 'weapon4': '0.162', 'WEAPON4': '0.200', 'weapon2': '0.224', 'AMMO3': '0.249', 'WEAPON3': '1.550', 'weapon3': '3.276', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.822', 'FRAGCOUNT': '61.000'} [2023-02-25 14:42:31,722][36141] DAMAGECOUNT value on done: 1299690.0 [2023-02-25 14:42:31,722][36141] Sum rewards: 55.813, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.078', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.148', 'AMMO3': '0.214', 'AMMO4': '0.251', 'weapon4': '0.256', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.598', 'WEAPON3': '1.250', 'weapon3': '2.656', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '52.000'} [2023-02-25 14:42:31,880][36154] DAMAGECOUNT value on done: 1288576.0 [2023-02-25 14:42:31,881][36154] Sum rewards: 61.742, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.970', 'ARMOR': '0.004', 'AMMO2': '0.036', 'AMMO3': '0.159', 'AMMO4': '0.178', 'WEAPON4': '0.250', 'weapon2': '0.494', 'weapon4': '0.714', 'WEAPON3': '1.000', 'weapon3': '2.630', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '14.907', 'FRAGCOUNT': '50.000'} [2023-02-25 14:42:32,035][36141] DAMAGECOUNT value on done: 1295782.0 [2023-02-25 14:42:32,035][36141] Sum rewards: 46.468, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.444', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.108', 'weapon4': '0.154', 'AMMO4': '0.194', 'AMMO3': '0.215', 'WEAPON5': '0.300', 'weapon2': '0.378', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.830', 'weapon3': '3.158', 'DAMAGECOUNT': '13.122', 'FRAGCOUNT': '41.000'} [2023-02-25 14:42:32,137][36141] DAMAGECOUNT value on done: 1284398.0 [2023-02-25 14:42:32,137][36141] Sum rewards: 57.314, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.440', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO3': '0.154', 'AMMO4': '0.190', 'WEAPON5': '0.250', 'weapon5': '0.254', 'WEAPON4': '0.300', 'weapon2': '0.512', 'WEAPON3': '0.900', 'weapon4': '0.926', 'weapon3': '2.078', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.868', 'FRAGCOUNT': '46.000'} [2023-02-25 14:42:32,438][36141] DAMAGECOUNT value on done: 1276658.0 [2023-02-25 14:42:32,439][36141] Sum rewards: 50.901, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.422', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon7': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.250', 'weapon4': '0.740', 'WEAPON3': '0.950', 'HITCOUNT': '2.500', 'weapon3': '2.546', 'DAMAGECOUNT': '11.613', 'FRAGCOUNT': '43.000'} [2023-02-25 14:42:32,652][36155] DAMAGECOUNT value on done: 1289027.0 [2023-02-25 14:42:32,653][36155] Sum rewards: 68.606, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.484', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon5': '0.090', 'AMMO4': '0.117', 'weapon4': '0.154', 'WEAPON4': '0.200', 'weapon2': '0.220', 'WEAPON5': '0.250', 'AMMO3': '0.304', 'WEAPON3': '1.750', 'weapon3': '3.190', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '61.000'} [2023-02-25 14:42:32,879][36139] DAMAGECOUNT value on done: 1291302.0 [2023-02-25 14:42:32,879][36139] Sum rewards: 68.363, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.225', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.126', 'AMMO4': '0.127', 'WEAPON5': '0.200', 'weapon4': '0.222', 'weapon2': '0.224', 'WEAPON4': '0.250', 'AMMO3': '0.280', 'WEAPON3': '1.650', 'weapon3': '3.160', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '62.000'} [2023-02-25 14:42:32,969][36155] DAMAGECOUNT value on done: 1290479.0 [2023-02-25 14:42:32,970][36155] Sum rewards: 67.437, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.697', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon5': '0.126', 'AMMO3': '0.137', 'AMMO4': '0.234', 'WEAPON5': '0.350', 'weapon4': '0.386', 'WEAPON4': '0.450', 'weapon2': '0.538', 'WEAPON3': '0.800', 'weapon3': '2.736', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '55.000'} [2023-02-25 14:42:33,196][36139] DAMAGECOUNT value on done: 1284839.0 [2023-02-25 14:42:33,196][36139] Sum rewards: 58.071, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.195', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO3': '0.177', 'weapon5': '0.188', 'AMMO4': '0.190', 'weapon2': '0.216', 'weapon4': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.900', 'weapon3': '3.066', 'DAMAGECOUNT': '14.577', 'FRAGCOUNT': '51.000'} [2023-02-25 14:42:33,584][36139] DAMAGECOUNT value on done: 1302354.0 [2023-02-25 14:42:33,584][36139] Sum rewards: 59.295, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.482', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.049', 'weapon5': '0.154', 'AMMO3': '0.170', 'AMMO4': '0.245', 'WEAPON5': '0.500', 'weapon4': '0.556', 'WEAPON4': '0.600', 'weapon2': '0.856', 'WEAPON3': '1.000', 'weapon3': '2.140', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.921', 'FRAGCOUNT': '52.000'} [2023-02-25 14:42:33,818][36155] DAMAGECOUNT value on done: 1304888.0 [2023-02-25 14:42:33,819][36155] Sum rewards: 40.067, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.250', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO4': '0.186', 'AMMO3': '0.217', 'weapon5': '0.230', 'WEAPON5': '0.350', 'weapon4': '0.370', 'WEAPON4': '0.450', 'ARMOR': '0.500', 'weapon2': '0.652', 'WEAPON3': '1.250', 'HITCOUNT': '2.320', 'weapon3': '2.508', 'DAMAGECOUNT': '11.985', 'FRAGCOUNT': '38.000'} [2023-02-25 14:42:33,908][36139] DAMAGECOUNT value on done: 1297172.0 [2023-02-25 14:42:33,908][36139] Sum rewards: 61.221, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.960', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO3': '0.141', 'AMMO4': '0.187', 'weapon5': '0.306', 'weapon2': '0.320', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'weapon4': '0.906', 'WEAPON3': '0.950', 'weapon3': '2.086', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '53.000'} [2023-02-25 14:42:34,128][36155] DAMAGECOUNT value on done: 1286246.0 [2023-02-25 14:42:34,129][36155] Sum rewards: 47.565, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.766', 'WEAPON1': '0.010', 'AMMO5': '0.023', 'AMMO2': '0.064', 'weapon5': '0.208', 'weapon2': '0.254', 'AMMO3': '0.259', 'AMMO4': '0.321', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'weapon4': '0.672', 'WEAPON3': '1.450', 'weapon3': '2.466', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.863', 'FRAGCOUNT': '46.000'} [2023-02-25 14:42:34,237][36138] Updated weights for policy 0, policy_version 54483 (0.0009) [2023-02-25 14:42:34,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 223166464. Throughput: 0: 3347.7. Samples: 18289680. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:42:34,730][36114] Avg episode reward: [(0, '59.679')] [2023-02-25 14:42:35,226][36157] DAMAGECOUNT value on done: 1299324.0 [2023-02-25 14:42:35,226][36157] Sum rewards: 45.328, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.940', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.092', 'AMMO4': '0.167', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.496', 'weapon2': '0.814', 'WEAPON3': '1.300', 'weapon3': '2.406', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.803', 'FRAGCOUNT': '39.000'} [2023-02-25 14:42:35,537][36157] DAMAGECOUNT value on done: 1287447.0 [2023-02-25 14:42:35,537][36157] Sum rewards: 59.210, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.005', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.108', 'AMMO4': '0.148', 'weapon4': '0.198', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.350', 'weapon3': '3.112', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.212', 'FRAGCOUNT': '50.500'} [2023-02-25 14:42:35,755][36157] DAMAGECOUNT value on done: 1300050.0 [2023-02-25 14:42:35,756][36157] Sum rewards: 46.539, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.882', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.067', 'weapon5': '0.234', 'AMMO3': '0.236', 'weapon2': '0.308', 'AMMO4': '0.333', 'WEAPON5': '0.550', 'weapon4': '0.688', 'WEAPON4': '0.700', 'WEAPON3': '1.400', 'weapon3': '2.416', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.226', 'FRAGCOUNT': '45.000'} [2023-02-25 14:42:36,077][36157] DAMAGECOUNT value on done: 1296038.0 [2023-02-25 14:42:36,077][36157] Sum rewards: 60.009, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.008', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon5': '0.118', 'AMMO3': '0.152', 'AMMO4': '0.171', 'weapon2': '0.282', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.408', 'WEAPON3': '0.900', 'HITCOUNT': '2.770', 'weapon3': '3.016', 'DAMAGECOUNT': '15.201', 'FRAGCOUNT': '50.000'} [2023-02-25 14:42:36,633][36140] DAMAGECOUNT value on done: 1299309.0 [2023-02-25 14:42:36,633][36140] Sum rewards: 51.414, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.239', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'AMMO4': '0.183', 'WEAPON4': '0.350', 'weapon4': '0.410', 'weapon2': '0.692', 'WEAPON3': '1.050', 'HITCOUNT': '2.540', 'weapon3': '2.652', 'DAMAGECOUNT': '12.849', 'FRAGCOUNT': '46.000'} [2023-02-25 14:42:36,645][36140] DAMAGECOUNT value on done: 1294980.0 [2023-02-25 14:42:36,646][36140] Sum rewards: 63.612, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.139', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon4': '0.346', 'weapon2': '0.382', 'WEAPON3': '1.100', 'weapon3': '2.986', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '53.000'} [2023-02-25 14:42:36,949][36140] DAMAGECOUNT value on done: 1282198.0 [2023-02-25 14:42:36,949][36140] Sum rewards: 63.323, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.376', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon5': '0.140', 'AMMO3': '0.197', 'WEAPON5': '0.250', 'AMMO4': '0.265', 'weapon4': '0.282', 'WEAPON4': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.250', 'weapon3': '2.954', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.434', 'FRAGCOUNT': '54.000'} [2023-02-25 14:42:36,960][36140] DAMAGECOUNT value on done: 1281836.0 [2023-02-25 14:42:36,961][36140] Sum rewards: 56.714, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.040', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON5': '0.100', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'weapon2': '0.468', 'weapon4': '0.636', 'WEAPON3': '0.950', 'HITCOUNT': '2.800', 'weapon3': '2.806', 'DAMAGECOUNT': '13.155', 'FRAGCOUNT': '47.000'} [2023-02-25 14:42:37,252][36138] Updated weights for policy 0, policy_version 54493 (0.0009) [2023-02-25 14:42:39,197][36142] DAMAGECOUNT value on done: 1288753.0 [2023-02-25 14:42:39,198][36142] Sum rewards: 55.104, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.994', 'AMMO5': '0.006', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.224', 'weapon4': '0.258', 'AMMO3': '0.275', 'WEAPON3': '1.550', 'HITCOUNT': '2.930', 'weapon3': '3.216', 'DAMAGECOUNT': '14.388', 'FRAGCOUNT': '51.000'} [2023-02-25 14:42:39,511][36142] DAMAGECOUNT value on done: 1279094.0 [2023-02-25 14:42:39,511][36142] Sum rewards: 67.121, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.251', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'WEAPON4': '0.100', 'weapon2': '0.204', 'AMMO3': '0.255', 'weapon4': '0.418', 'WEAPON3': '1.500', 'weapon3': '3.206', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '58.000'} [2023-02-25 14:42:39,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13398.8). Total num frames: 223236096. Throughput: 0: 3353.5. Samples: 18299858. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:42:39,729][36114] Avg episode reward: [(0, '59.535')] [2023-02-25 14:42:40,130][36142] DAMAGECOUNT value on done: 1290684.0 [2023-02-25 14:42:40,130][36142] Sum rewards: 63.918, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.210', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon5': '0.088', 'AMMO3': '0.151', 'AMMO4': '0.184', 'weapon4': '0.346', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.434', 'WEAPON3': '0.850', 'weapon3': '2.910', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.181', 'FRAGCOUNT': '54.000'} [2023-02-25 14:42:40,306][36138] Updated weights for policy 0, policy_version 54503 (0.0009) [2023-02-25 14:42:40,413][36142] DAMAGECOUNT value on done: 1296161.0 [2023-02-25 14:42:40,413][36142] Sum rewards: 53.727, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.039', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.126', 'weapon5': '0.138', 'WEAPON4': '0.300', 'weapon4': '0.408', 'weapon2': '0.534', 'WEAPON3': '0.900', 'weapon3': '2.744', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.914', 'FRAGCOUNT': '44.000'} [2023-02-25 14:42:41,173][36156] DAMAGECOUNT value on done: 1304083.0 [2023-02-25 14:42:41,174][36156] Sum rewards: 51.963, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.750', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.056', 'weapon5': '0.236', 'weapon2': '0.254', 'AMMO3': '0.266', 'AMMO4': '0.278', 'weapon4': '0.434', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.730', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.705', 'FRAGCOUNT': '49.500'} [2023-02-25 14:42:41,491][36156] DAMAGECOUNT value on done: 1285208.0 [2023-02-25 14:42:41,492][36156] Sum rewards: 56.590, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.675', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.048', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'weapon4': '0.164', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon2': '0.390', 'WEAPON3': '1.150', 'HITCOUNT': '2.930', 'weapon3': '3.198', 'DAMAGECOUNT': '14.292', 'FRAGCOUNT': '49.000'} [2023-02-25 14:42:41,534][36156] DAMAGECOUNT value on done: 1299272.0 [2023-02-25 14:42:41,535][36156] Sum rewards: 62.426, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.012', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.045', 'weapon5': '0.220', 'AMMO4': '0.227', 'weapon4': '0.230', 'AMMO3': '0.245', 'weapon2': '0.274', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.940', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.361', 'FRAGCOUNT': '54.500'} [2023-02-25 14:42:41,851][36156] DAMAGECOUNT value on done: 1288020.0 [2023-02-25 14:42:41,852][36156] Sum rewards: 48.249, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.830', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon4': '0.014', 'AMMO2': '0.019', 'weapon5': '0.052', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.266', 'weapon2': '0.514', 'WEAPON3': '1.500', 'HITCOUNT': '2.550', 'weapon3': '3.214', 'DAMAGECOUNT': '12.150', 'FRAGCOUNT': '46.000'} [2023-02-25 14:42:43,374][36138] Updated weights for policy 0, policy_version 54513 (0.0009) [2023-02-25 14:42:44,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 223301632. Throughput: 0: 3359.5. Samples: 18320150. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:42:44,730][36114] Avg episode reward: [(0, '59.364')] [2023-02-25 14:42:46,414][36138] Updated weights for policy 0, policy_version 54523 (0.0009) [2023-02-25 14:42:49,450][36138] Updated weights for policy 0, policy_version 54533 (0.0009) [2023-02-25 14:42:49,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.2, 300 sec: 13384.9). Total num frames: 223367168. Throughput: 0: 3359.5. Samples: 18340354. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:42:49,730][36114] Avg episode reward: [(0, '59.364')] [2023-02-25 14:42:50,900][36154] DAMAGECOUNT value on done: 1300911.0 [2023-02-25 14:42:50,901][36154] Sum rewards: 58.786, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.550', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'weapon2': '0.208', 'weapon4': '0.248', 'WEAPON3': '1.100', 'HITCOUNT': '2.900', 'weapon3': '3.432', 'DAMAGECOUNT': '14.247', 'FRAGCOUNT': '49.000'} [2023-02-25 14:42:51,211][36154] DAMAGECOUNT value on done: 1280423.0 [2023-02-25 14:42:51,211][36154] Sum rewards: 60.584, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.855', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.216', 'AMMO3': '0.221', 'weapon2': '0.348', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.792', 'WEAPON3': '1.300', 'weapon3': '2.366', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '54.000'} [2023-02-25 14:42:51,551][36154] DAMAGECOUNT value on done: 1309951.0 [2023-02-25 14:42:51,552][36154] Sum rewards: 67.254, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.372', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.036', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.158', 'weapon4': '0.246', 'AMMO3': '0.317', 'WEAPON3': '1.900', 'weapon3': '3.296', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '62.000'} [2023-02-25 14:42:51,661][36141] DAMAGECOUNT value on done: 1304889.0 [2023-02-25 14:42:51,661][36141] Sum rewards: 59.912, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.092', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon4': '0.244', 'weapon2': '0.470', 'WEAPON3': '1.300', 'weapon3': '2.972', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '51.000'} [2023-02-25 14:42:51,862][36154] DAMAGECOUNT value on done: 1293213.0 [2023-02-25 14:42:51,863][36154] Sum rewards: 55.019, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.840', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.090', 'weapon5': '0.108', 'AMMO4': '0.204', 'AMMO3': '0.216', 'weapon2': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '2.910', 'weapon3': '3.352', 'DAMAGECOUNT': '13.911', 'FRAGCOUNT': '49.000'} [2023-02-25 14:42:51,967][36141] DAMAGECOUNT value on done: 1300702.0 [2023-02-25 14:42:51,967][36141] Sum rewards: 59.147, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.300', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon5': '0.080', 'AMMO4': '0.085', 'weapon2': '0.122', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.226', 'WEAPON3': '1.150', 'HITCOUNT': '2.990', 'weapon3': '3.440', 'DAMAGECOUNT': '14.760', 'FRAGCOUNT': '50.000'} [2023-02-25 14:42:52,072][36141] DAMAGECOUNT value on done: 1288115.0 [2023-02-25 14:42:52,072][36141] Sum rewards: 44.104, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.855', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'AMMO3': '0.150', 'weapon2': '0.198', 'WEAPON4': '0.400', 'weapon4': '0.794', 'WEAPON3': '0.900', 'weapon3': '2.446', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '11.151', 'FRAGCOUNT': '39.000'} [2023-02-25 14:42:52,389][36141] DAMAGECOUNT value on done: 1281676.0 [2023-02-25 14:42:52,389][36141] Sum rewards: 59.562, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.308', 'AMMO5': '0.008', 'AMMO2': '0.034', 'AMMO4': '0.168', 'AMMO3': '0.204', 'weapon5': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON4': '0.400', 'weapon4': '0.524', 'WEAPON3': '1.250', 'weapon3': '2.690', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.054', 'FRAGCOUNT': '52.000'} [2023-02-25 14:42:52,493][36138] Updated weights for policy 0, policy_version 54543 (0.0009) [2023-02-25 14:42:52,551][36155] DAMAGECOUNT value on done: 1294062.0 [2023-02-25 14:42:52,552][36155] Sum rewards: 53.689, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.960', 'AMMO5': '0.009', 'AMMO2': '0.050', 'weapon5': '0.144', 'AMMO3': '0.200', 'weapon2': '0.244', 'AMMO4': '0.252', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'ARMOR': '0.453', 'weapon4': '0.682', 'WEAPON3': '1.200', 'weapon3': '2.674', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.090', 'FRAGCOUNT': '46.000'} [2023-02-25 14:42:52,864][36139] DAMAGECOUNT value on done: 1295710.0 [2023-02-25 14:42:52,865][36139] Sum rewards: 49.455, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.318', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.116', 'AMMO4': '0.139', 'AMMO3': '0.171', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.282', 'weapon2': '0.488', 'WEAPON3': '1.050', 'HITCOUNT': '2.590', 'weapon3': '2.922', 'DAMAGECOUNT': '13.224', 'FRAGCOUNT': '42.000'} [2023-02-25 14:42:52,867][36155] DAMAGECOUNT value on done: 1295934.0 [2023-02-25 14:42:52,867][36155] Sum rewards: 62.695, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.185', 'AMMO2': '0.012', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.130', 'AMMO3': '0.222', 'weapon2': '0.318', 'WEAPON3': '1.350', 'weapon3': '3.402', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '53.000'} [2023-02-25 14:42:53,165][36139] DAMAGECOUNT value on done: 1291139.0 [2023-02-25 14:42:53,166][36139] Sum rewards: 79.373, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.155', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.156', 'weapon5': '0.172', 'WEAPON5': '0.400', 'weapon2': '0.420', 'WEAPON4': '0.500', 'weapon4': '0.814', 'WEAPON3': '1.050', 'weapon3': '2.314', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '65.000'} [2023-02-25 14:42:53,492][36139] DAMAGECOUNT value on done: 1307752.0 [2023-02-25 14:42:53,492][36139] Sum rewards: 68.686, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.343', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.120', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'weapon2': '0.270', 'weapon4': '0.286', 'WEAPON3': '1.250', 'weapon3': '3.082', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.194', 'FRAGCOUNT': '59.000'} [2023-02-25 14:42:53,535][36155] DAMAGECOUNT value on done: 1309797.0 [2023-02-25 14:42:53,535][36155] Sum rewards: 56.363, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.380', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.064', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'weapon2': '0.202', 'AMMO3': '0.212', 'weapon4': '0.346', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.080', 'weapon3': '3.172', 'DAMAGECOUNT': '14.727', 'FRAGCOUNT': '50.000'} [2023-02-25 14:42:53,788][36139] DAMAGECOUNT value on done: 1302684.0 [2023-02-25 14:42:53,789][36139] Sum rewards: 67.741, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.227', 'AMMO5': '0.003', 'weapon4': '0.026', 'AMMO2': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.162', 'AMMO3': '0.207', 'weapon2': '0.342', 'WEAPON3': '1.250', 'HITCOUNT': '3.310', 'weapon3': '3.446', 'DAMAGECOUNT': '16.536', 'FRAGCOUNT': '57.000'} [2023-02-25 14:42:53,842][36155] DAMAGECOUNT value on done: 1291642.0 [2023-02-25 14:42:53,843][36155] Sum rewards: 63.213, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.520', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon5': '0.098', 'weapon4': '0.182', 'AMMO3': '0.191', 'AMMO4': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.484', 'WEAPON3': '1.200', 'HITCOUNT': '2.990', 'weapon3': '3.050', 'DAMAGECOUNT': '16.188', 'FRAGCOUNT': '54.000'} [2023-02-25 14:42:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 223436800. Throughput: 0: 3360.3. Samples: 18350390. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:42:54,730][36114] Avg episode reward: [(0, '59.770')] [2023-02-25 14:42:55,230][36157] DAMAGECOUNT value on done: 1304782.0 [2023-02-25 14:42:55,231][36157] Sum rewards: 64.312, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.994', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon2': '0.188', 'weapon5': '0.190', 'AMMO4': '0.191', 'AMMO3': '0.257', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.430', 'WEAPON3': '1.550', 'weapon3': '2.892', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.074', 'FRAGCOUNT': '58.000'} [2023-02-25 14:42:55,526][36138] Updated weights for policy 0, policy_version 54553 (0.0009) [2023-02-25 14:42:55,537][36157] DAMAGECOUNT value on done: 1291804.0 [2023-02-25 14:42:55,538][36157] Sum rewards: 51.716, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.460', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon5': '0.066', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'AMMO4': '0.220', 'weapon2': '0.392', 'WEAPON4': '0.450', 'weapon4': '0.694', 'WEAPON3': '1.100', 'weapon3': '2.602', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.071', 'FRAGCOUNT': '45.000'} [2023-02-25 14:42:55,772][36157] DAMAGECOUNT value on done: 1304667.0 [2023-02-25 14:42:55,772][36157] Sum rewards: 56.231, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.695', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon5': '0.070', 'weapon4': '0.106', 'AMMO4': '0.121', 'weapon2': '0.220', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'HITCOUNT': '2.980', 'weapon3': '3.290', 'DAMAGECOUNT': '13.851', 'FRAGCOUNT': '52.000'} [2023-02-25 14:42:56,085][36157] DAMAGECOUNT value on done: 1300375.0 [2023-02-25 14:42:56,086][36157] Sum rewards: 45.201, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.342', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon5': '0.186', 'AMMO3': '0.224', 'AMMO4': '0.234', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON4': '0.450', 'weapon4': '0.582', 'WEAPON3': '1.200', 'weapon3': '2.624', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.011', 'FRAGCOUNT': '41.000'} [2023-02-25 14:42:56,609][36140] DAMAGECOUNT value on done: 1299454.0 [2023-02-25 14:42:56,609][36140] Sum rewards: 54.553, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.105', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO3': '0.213', 'weapon2': '0.320', 'WEAPON3': '1.300', 'HITCOUNT': '2.820', 'weapon3': '3.576', 'DAMAGECOUNT': '13.422', 'FRAGCOUNT': '47.000'} [2023-02-25 14:42:56,638][36140] DAMAGECOUNT value on done: 1304548.0 [2023-02-25 14:42:56,639][36140] Sum rewards: 55.377, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.664', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon5': '0.116', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'weapon4': '0.412', 'weapon2': '0.524', 'WEAPON3': '1.300', 'weapon3': '2.732', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '49.000'} [2023-02-25 14:42:56,931][36140] DAMAGECOUNT value on done: 1286839.0 [2023-02-25 14:42:56,932][36140] Sum rewards: 58.240, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.340', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.011', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.090', 'AMMO3': '0.209', 'weapon2': '0.472', 'WEAPON3': '1.350', 'HITCOUNT': '3.070', 'weapon3': '3.216', 'DAMAGECOUNT': '15.009', 'FRAGCOUNT': '49.000'} [2023-02-25 14:42:56,961][36140] DAMAGECOUNT value on done: 1287094.0 [2023-02-25 14:42:56,962][36140] Sum rewards: 53.737, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.824', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon5': '0.178', 'AMMO3': '0.199', 'AMMO4': '0.249', 'WEAPON5': '0.350', 'weapon2': '0.436', 'WEAPON4': '0.450', 'weapon4': '0.968', 'WEAPON3': '1.150', 'weapon3': '2.082', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '14.688', 'FRAGCOUNT': '47.000'} [2023-02-25 14:42:57,436][36140] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:42:58,630][36138] Updated weights for policy 0, policy_version 54563 (0.0009) [2023-02-25 14:42:59,256][36142] DAMAGECOUNT value on done: 1293815.0 [2023-02-25 14:42:59,256][36142] Sum rewards: 51.136, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.302', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.062', 'weapon5': '0.080', 'weapon4': '0.208', 'AMMO3': '0.273', 'AMMO4': '0.311', 'weapon2': '0.330', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'HITCOUNT': '3.000', 'weapon3': '3.032', 'DAMAGECOUNT': '15.066', 'FRAGCOUNT': '49.000'} [2023-02-25 14:42:59,576][36142] DAMAGECOUNT value on done: 1283321.0 [2023-02-25 14:42:59,577][36142] Sum rewards: 45.827, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.816', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.073', 'AMMO3': '0.154', 'weapon2': '0.182', 'weapon5': '0.294', 'AMMO4': '0.364', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'weapon4': '1.154', 'weapon3': '1.582', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '12.681', 'FRAGCOUNT': '40.000'} [2023-02-25 14:42:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 223502336. Throughput: 0: 3356.9. Samples: 18370402. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:42:59,730][36114] Avg episode reward: [(0, '58.560')] [2023-02-25 14:43:00,190][36142] DAMAGECOUNT value on done: 1296008.0 [2023-02-25 14:43:00,190][36142] Sum rewards: 67.819, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.950', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon4': '0.268', 'weapon2': '0.632', 'WEAPON3': '1.200', 'weapon3': '2.874', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.957', 'FRAGCOUNT': '58.000'} [2023-02-25 14:43:00,504][36142] DAMAGECOUNT value on done: 1301733.0 [2023-02-25 14:43:00,504][36142] Sum rewards: 66.311, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.663', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.160', 'AMMO3': '0.165', 'weapon4': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.864', 'WEAPON3': '1.050', 'weapon3': '2.508', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '55.000'} [2023-02-25 14:43:01,269][36156] DAMAGECOUNT value on done: 1309965.0 [2023-02-25 14:43:01,270][36156] Sum rewards: 69.107, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.295', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.046', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon4': '0.238', 'weapon2': '0.388', 'WEAPON3': '1.250', 'weapon3': '3.152', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '59.000'} [2023-02-25 14:43:01,579][36156] DAMAGECOUNT value on done: 1290377.0 [2023-02-25 14:43:01,579][36156] Sum rewards: 62.313, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.584', 'AMMO5': '0.014', 'AMMO2': '0.043', 'AMMO3': '0.132', 'AMMO4': '0.213', 'weapon5': '0.226', 'weapon2': '0.276', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.796', 'WEAPON3': '0.800', 'weapon3': '2.480', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '52.000'} [2023-02-25 14:43:01,591][36156] DAMAGECOUNT value on done: 1304509.0 [2023-02-25 14:43:01,592][36156] Sum rewards: 54.818, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.409', 'ARMOR': '0.008', 'AMMO5': '0.025', 'AMMO2': '0.051', 'AMMO3': '0.174', 'AMMO4': '0.257', 'weapon2': '0.276', 'weapon5': '0.356', 'weapon4': '0.580', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.358', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '48.500'} [2023-02-25 14:43:01,661][36138] Updated weights for policy 0, policy_version 54573 (0.0009) [2023-02-25 14:43:01,905][36156] DAMAGECOUNT value on done: 1293682.0 [2023-02-25 14:43:01,905][36156] Sum rewards: 71.412, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.645', 'AMMO5': '0.003', 'AMMO2': '0.037', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.174', 'AMMO4': '0.185', 'WEAPON4': '0.200', 'weapon4': '0.214', 'weapon2': '0.430', 'WEAPON3': '1.100', 'weapon3': '3.182', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '60.000'} [2023-02-25 14:43:04,664][36138] Updated weights for policy 0, policy_version 54583 (0.0009) [2023-02-25 14:43:04,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 223571968. Throughput: 0: 3360.4. Samples: 18390638. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:43:04,730][36114] Avg episode reward: [(0, '58.952')] [2023-02-25 14:43:05,489][36154] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:43:07,669][36138] Updated weights for policy 0, policy_version 54593 (0.0010) [2023-02-25 14:43:09,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13398.8). Total num frames: 223637504. Throughput: 0: 3362.8. Samples: 18400806. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:43:09,729][36114] Avg episode reward: [(0, '58.952')] [2023-02-25 14:43:10,721][36138] Updated weights for policy 0, policy_version 54603 (0.0009) [2023-02-25 14:43:10,796][36154] DAMAGECOUNT value on done: 1305702.0 [2023-02-25 14:43:10,797][36154] Sum rewards: 54.144, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.814', 'AMMO5': '0.005', 'AMMO2': '0.049', 'weapon5': '0.074', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'AMMO4': '0.244', 'WEAPON4': '0.400', 'weapon2': '0.484', 'weapon4': '0.632', 'WEAPON3': '1.300', 'weapon3': '2.568', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.373', 'FRAGCOUNT': '50.000'} [2023-02-25 14:43:11,117][36154] DAMAGECOUNT value on done: 1284439.0 [2023-02-25 14:43:11,117][36154] Sum rewards: 37.699, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.970', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.060', 'AMMO3': '0.153', 'weapon2': '0.198', 'AMMO4': '0.302', 'weapon5': '0.322', 'WEAPON5': '0.550', 'WEAPON4': '0.700', 'WEAPON3': '0.900', 'weapon3': '1.498', 'weapon4': '1.722', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.048', 'FRAGCOUNT': '33.000'} [2023-02-25 14:43:11,430][36154] DAMAGECOUNT value on done: 1315500.0 [2023-02-25 14:43:11,430][36154] Sum rewards: 66.071, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.640', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon4': '0.146', 'weapon5': '0.180', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.150', 'weapon3': '3.144', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '56.000'} [2023-02-25 14:43:11,731][36154] DAMAGECOUNT value on done: 1297744.0 [2023-02-25 14:43:11,731][36154] Sum rewards: 57.925, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.507', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon5': '0.106', 'AMMO3': '0.138', 'AMMO4': '0.147', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.346', 'weapon2': '0.480', 'WEAPON3': '0.850', 'HITCOUNT': '2.740', 'weapon3': '2.888', 'DAMAGECOUNT': '13.593', 'FRAGCOUNT': '48.000'} [2023-02-25 14:43:11,833][36141] DAMAGECOUNT value on done: 1310150.0 [2023-02-25 14:43:11,834][36141] Sum rewards: 62.947, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.364', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.100', 'AMMO3': '0.180', 'AMMO4': '0.197', 'weapon2': '0.216', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.702', 'WEAPON3': '1.100', 'weapon3': '2.782', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.783', 'FRAGCOUNT': '55.000'} [2023-02-25 14:43:12,154][36141] DAMAGECOUNT value on done: 1305853.0 [2023-02-25 14:43:12,155][36141] Sum rewards: 63.519, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.155', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.080', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'weapon4': '0.364', 'weapon2': '0.366', 'WEAPON3': '1.450', 'weapon3': '2.988', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.453', 'FRAGCOUNT': '57.000'} [2023-02-25 14:43:12,266][36141] DAMAGECOUNT value on done: 1293849.0 [2023-02-25 14:43:12,266][36141] Sum rewards: 70.701, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.122', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.108', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'AMMO4': '0.209', 'WEAPON4': '0.350', 'weapon4': '0.390', 'weapon2': '0.430', 'WEAPON3': '0.950', 'weapon3': '2.918', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '58.000'} [2023-02-25 14:43:12,582][36155] DAMAGECOUNT value on done: 1299377.0 [2023-02-25 14:43:12,582][36155] Sum rewards: 53.634, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.907', 'AMMO5': '0.013', 'AMMO2': '0.049', 'AMMO3': '0.231', 'AMMO4': '0.245', 'weapon5': '0.258', 'weapon2': '0.264', 'WEAPON5': '0.400', 'weapon4': '0.458', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.698', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '15.945', 'FRAGCOUNT': '49.000'} [2023-02-25 14:43:12,582][36141] DAMAGECOUNT value on done: 1286568.0 [2023-02-25 14:43:12,583][36141] Sum rewards: 55.659, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.570', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.092', 'WEAPON5': '0.200', 'weapon2': '0.206', 'AMMO3': '0.208', 'AMMO4': '0.214', 'ARMOR': '0.460', 'WEAPON4': '0.500', 'weapon4': '0.616', 'WEAPON3': '1.250', 'HITCOUNT': '2.690', 'weapon3': '2.816', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '50.000'} [2023-02-25 14:43:12,754][36139] DAMAGECOUNT value on done: 1301258.0 [2023-02-25 14:43:12,755][36139] Sum rewards: 64.579, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.258', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.204', 'weapon2': '0.224', 'AMMO3': '0.234', 'WEAPON3': '1.350', 'weapon3': '3.214', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '56.000'} [2023-02-25 14:43:12,897][36155] DAMAGECOUNT value on done: 1300706.0 [2023-02-25 14:43:12,897][36155] Sum rewards: 55.273, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.597', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.048', 'AMMO3': '0.127', 'weapon5': '0.190', 'AMMO4': '0.241', 'weapon2': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.600', 'WEAPON3': '0.800', 'weapon4': '0.944', 'weapon3': '2.296', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.316', 'FRAGCOUNT': '47.000'} [2023-02-25 14:43:13,062][36139] DAMAGECOUNT value on done: 1296484.0 [2023-02-25 14:43:13,062][36139] Sum rewards: 57.861, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.744', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.110', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'weapon4': '0.334', 'weapon2': '0.404', 'WEAPON3': '1.400', 'weapon3': '2.844', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '51.000'} [2023-02-25 14:43:13,425][36139] DAMAGECOUNT value on done: 1312944.0 [2023-02-25 14:43:13,425][36139] Sum rewards: 58.771, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.950', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'weapon4': '0.106', 'weapon2': '0.230', 'AMMO3': '0.237', 'WEAPON3': '1.450', 'HITCOUNT': '2.980', 'weapon3': '3.426', 'DAMAGECOUNT': '15.576', 'FRAGCOUNT': '50.000'} [2023-02-25 14:43:13,547][36155] DAMAGECOUNT value on done: 1314965.0 [2023-02-25 14:43:13,548][36155] Sum rewards: 62.854, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.830', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.152', 'weapon5': '0.160', 'weapon2': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.532', 'WEAPON3': '0.950', 'weapon3': '2.858', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.504', 'FRAGCOUNT': '53.000'} [2023-02-25 14:43:13,735][36139] DAMAGECOUNT value on done: 1307953.0 [2023-02-25 14:43:13,736][36139] Sum rewards: 57.616, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.002', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.162', 'AMMO4': '0.165', 'AMMO3': '0.191', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.364', 'weapon4': '0.492', 'WEAPON3': '1.150', 'weapon3': '2.688', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.807', 'FRAGCOUNT': '51.000'} [2023-02-25 14:43:13,830][36138] Updated weights for policy 0, policy_version 54613 (0.0009) [2023-02-25 14:43:13,847][36155] DAMAGECOUNT value on done: 1296484.0 [2023-02-25 14:43:13,848][36155] Sum rewards: 51.173, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-4.302', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon5': '0.122', 'AMMO4': '0.199', 'weapon2': '0.234', 'AMMO3': '0.311', 'WEAPON5': '0.350', 'weapon4': '0.498', 'WEAPON4': '0.500', 'WEAPON3': '1.800', 'weapon3': '2.812', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.526', 'FRAGCOUNT': '51.000'} [2023-02-25 14:43:14,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 223707136. Throughput: 0: 3358.1. Samples: 18420810. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:43:14,729][36114] Avg episode reward: [(0, '58.740')] [2023-02-25 14:43:15,244][36157] DAMAGECOUNT value on done: 1310373.0 [2023-02-25 14:43:15,245][36157] Sum rewards: 64.212, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.055', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.050', 'AMMO4': '0.062', 'weapon5': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.400', 'weapon3': '3.198', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '56.000'} [2023-02-25 14:43:15,546][36157] DAMAGECOUNT value on done: 1297396.0 [2023-02-25 14:43:15,547][36157] Sum rewards: 68.407, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.455', 'AMMO2': '0.012', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.154', 'weapon2': '0.236', 'weapon4': '0.276', 'WEAPON3': '1.100', 'weapon3': '3.340', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '55.000'} [2023-02-25 14:43:15,784][36157] DAMAGECOUNT value on done: 1309430.0 [2023-02-25 14:43:15,785][36157] Sum rewards: 59.231, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.245', 'AMMO5': '0.003', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'WEAPON4': '0.350', 'weapon2': '0.730', 'weapon4': '0.802', 'WEAPON3': '0.900', 'weapon3': '2.128', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.289', 'FRAGCOUNT': '50.000'} [2023-02-25 14:43:16,100][36157] DAMAGECOUNT value on done: 1305179.0 [2023-02-25 14:43:16,100][36157] Sum rewards: 56.257, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.480', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon5': '0.114', 'AMMO3': '0.155', 'AMMO4': '0.226', 'weapon4': '0.270', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.682', 'WEAPON3': '1.050', 'weapon3': '2.700', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.412', 'FRAGCOUNT': '48.000'} [2023-02-25 14:43:16,645][36140] DAMAGECOUNT value on done: 1305188.0 [2023-02-25 14:43:16,646][36140] Sum rewards: 65.396, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.726', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.020', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'weapon4': '0.216', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.506', 'WEAPON3': '1.500', 'weapon3': '2.958', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '57.000'} [2023-02-25 14:43:16,658][36140] DAMAGECOUNT value on done: 1309691.0 [2023-02-25 14:43:16,659][36140] Sum rewards: 60.079, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.305', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon5': '0.136', 'AMMO4': '0.140', 'AMMO3': '0.164', 'weapon4': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.384', 'WEAPON3': '1.050', 'weapon3': '2.930', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.429', 'FRAGCOUNT': '50.500'} [2023-02-25 14:43:16,869][36138] Updated weights for policy 0, policy_version 54623 (0.0009) [2023-02-25 14:43:16,964][36140] DAMAGECOUNT value on done: 1292019.0 [2023-02-25 14:43:16,965][36140] Sum rewards: 57.881, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.490', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.062', 'weapon5': '0.128', 'AMMO4': '0.148', 'weapon2': '0.194', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.190', 'weapon3': '3.392', 'DAMAGECOUNT': '15.540', 'FRAGCOUNT': '52.000'} [2023-02-25 14:43:16,975][36140] DAMAGECOUNT value on done: 1291405.0 [2023-02-25 14:43:16,976][36140] Sum rewards: 47.247, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.668', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'weapon5': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'weapon2': '0.270', 'weapon4': '0.410', 'WEAPON3': '1.100', 'HITCOUNT': '2.790', 'weapon3': '2.996', 'DAMAGECOUNT': '12.933', 'FRAGCOUNT': '39.000'} [2023-02-25 14:43:19,428][36142] DAMAGECOUNT value on done: 1299302.0 [2023-02-25 14:43:19,429][36142] Sum rewards: 64.163, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.841', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.031', 'AMMO4': '0.157', 'weapon5': '0.158', 'AMMO3': '0.182', 'weapon4': '0.398', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.414', 'WEAPON3': '1.050', 'weapon3': '2.752', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '54.000'} [2023-02-25 14:43:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13398.8). Total num frames: 223772672. Throughput: 0: 3360.8. Samples: 18440916. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:43:19,730][36114] Avg episode reward: [(0, '58.463')] [2023-02-25 14:43:19,734][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000054632_223772672.pth... [2023-02-25 14:43:19,794][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000053847_220557312.pth [2023-02-25 14:43:19,800][36142] DAMAGECOUNT value on done: 1288696.0 [2023-02-25 14:43:19,801][36142] Sum rewards: 64.747, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.325', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.054', 'weapon4': '0.088', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'weapon2': '0.648', 'WEAPON3': '1.250', 'weapon3': '3.060', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.125', 'FRAGCOUNT': '54.500'} [2023-02-25 14:43:20,163][36138] Updated weights for policy 0, policy_version 54633 (0.0009) [2023-02-25 14:43:20,538][36142] DAMAGECOUNT value on done: 1301183.0 [2023-02-25 14:43:20,539][36142] Sum rewards: 63.012, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.340', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.118', 'AMMO4': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon4': '0.366', 'weapon2': '0.382', 'WEAPON3': '1.350', 'weapon3': '2.902', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.525', 'FRAGCOUNT': '55.000'} [2023-02-25 14:43:20,899][36142] DAMAGECOUNT value on done: 1306172.0 [2023-02-25 14:43:20,900][36142] Sum rewards: 51.857, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.040', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon2': '0.330', 'weapon4': '0.558', 'WEAPON3': '1.400', 'weapon3': '2.812', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.317', 'FRAGCOUNT': '46.000'} [2023-02-25 14:43:21,642][36156] DAMAGECOUNT value on done: 1315039.0 [2023-02-25 14:43:21,643][36156] Sum rewards: 52.000, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.266', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO3': '0.171', 'weapon2': '0.182', 'AMMO4': '0.195', 'weapon5': '0.350', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.850', 'WEAPON3': '0.950', 'weapon3': '2.328', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.222', 'FRAGCOUNT': '44.000'} [2023-02-25 14:43:21,952][36156] DAMAGECOUNT value on done: 1295724.0 [2023-02-25 14:43:21,953][36156] Sum rewards: 68.459, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.292', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.053', 'weapon5': '0.128', 'AMMO3': '0.142', 'WEAPON5': '0.200', 'AMMO4': '0.263', 'weapon4': '0.384', 'weapon2': '0.390', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'weapon3': '2.896', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '58.000'} [2023-02-25 14:43:21,966][36156] DAMAGECOUNT value on done: 1309127.0 [2023-02-25 14:43:21,967][36156] Sum rewards: 51.159, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.990', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.104', 'AMMO3': '0.288', 'weapon2': '0.438', 'WEAPON3': '1.700', 'HITCOUNT': '2.830', 'weapon3': '3.276', 'DAMAGECOUNT': '13.854', 'FRAGCOUNT': '48.000'} [2023-02-25 14:43:22,277][36156] DAMAGECOUNT value on done: 1298361.0 [2023-02-25 14:43:22,278][36156] Sum rewards: 49.294, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.552', 'AMMO5': '0.009', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.272', 'AMMO3': '0.286', 'weapon2': '0.342', 'WEAPON3': '1.700', 'weapon3': '3.000', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.037', 'FRAGCOUNT': '46.000'} [2023-02-25 14:43:23,304][36138] Updated weights for policy 0, policy_version 54643 (0.0009) [2023-02-25 14:43:23,564][36157] Large shaping reward 3.603 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.552, 184.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:43:24,729][36114] Fps is (10 sec: 12697.5, 60 sec: 13312.0, 300 sec: 13384.9). Total num frames: 223834112. Throughput: 0: 3335.7. Samples: 18449964. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:43:24,730][36114] Avg episode reward: [(0, '58.193')] [2023-02-25 14:43:26,396][36138] Updated weights for policy 0, policy_version 54653 (0.0009) [2023-02-25 14:43:29,416][36138] Updated weights for policy 0, policy_version 54663 (0.0009) [2023-02-25 14:43:29,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13380.2, 300 sec: 13384.9). Total num frames: 223903744. Throughput: 0: 3331.8. Samples: 18470080. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:43:29,730][36114] Avg episode reward: [(0, '58.193')] [2023-02-25 14:43:31,154][36154] DAMAGECOUNT value on done: 1310289.0 [2023-02-25 14:43:31,154][36154] Sum rewards: 48.975, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.455', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon5': '0.098', 'AMMO3': '0.190', 'AMMO4': '0.222', 'weapon2': '0.256', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.448', 'WEAPON3': '1.200', 'weapon3': '2.856', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.761', 'FRAGCOUNT': '43.000'} [2023-02-25 14:43:31,474][36154] DAMAGECOUNT value on done: 1289224.0 [2023-02-25 14:43:31,475][36154] Sum rewards: 61.695, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.711', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.003', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO3': '0.133', 'weapon2': '0.246', 'weapon4': '0.480', 'WEAPON3': '0.850', 'HITCOUNT': '2.970', 'weapon3': '3.056', 'DAMAGECOUNT': '14.355', 'FRAGCOUNT': '49.000'} [2023-02-25 14:43:31,798][36154] DAMAGECOUNT value on done: 1321255.0 [2023-02-25 14:43:31,799][36154] Sum rewards: 66.267, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.720', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'weapon2': '0.176', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'weapon4': '0.456', 'WEAPON3': '1.600', 'weapon3': '3.190', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '59.000'} [2023-02-25 14:43:32,116][36154] DAMAGECOUNT value on done: 1302996.0 [2023-02-25 14:43:32,117][36154] Sum rewards: 53.569, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.545', 'AMMO5': '0.016', 'AMMO2': '0.042', 'AMMO3': '0.178', 'AMMO4': '0.208', 'weapon2': '0.296', 'weapon5': '0.340', 'ARMOR': '0.456', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'weapon4': '0.848', 'WEAPON3': '1.050', 'weapon3': '2.194', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '46.000'} [2023-02-25 14:43:32,243][36141] DAMAGECOUNT value on done: 1315324.0 [2023-02-25 14:43:32,243][36141] Sum rewards: 61.566, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.052', 'AMMO5': '0.009', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.106', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.380', 'weapon4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.786', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.522', 'FRAGCOUNT': '54.000'} [2023-02-25 14:43:32,460][36138] Updated weights for policy 0, policy_version 54673 (0.0009) [2023-02-25 14:43:32,566][36141] DAMAGECOUNT value on done: 1310390.0 [2023-02-25 14:43:32,567][36141] Sum rewards: 55.163, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.725', 'AMMO5': '0.016', 'AMMO2': '0.037', 'AMMO3': '0.151', 'AMMO4': '0.185', 'weapon5': '0.218', 'weapon2': '0.292', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.666', 'WEAPON3': '1.000', 'weapon3': '2.582', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.611', 'FRAGCOUNT': '48.000'} [2023-02-25 14:43:32,662][36141] DAMAGECOUNT value on done: 1299131.0 [2023-02-25 14:43:32,662][36141] Sum rewards: 59.441, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.344', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'weapon5': '0.174', 'weapon4': '0.244', 'weapon2': '0.498', 'WEAPON3': '1.100', 'weapon3': '2.852', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '49.000'} [2023-02-25 14:43:32,744][36155] DAMAGECOUNT value on done: 1303482.0 [2023-02-25 14:43:32,744][36155] Sum rewards: 53.758, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.610', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO3': '0.178', 'weapon2': '0.582', 'WEAPON3': '1.000', 'HITCOUNT': '2.700', 'weapon3': '3.348', 'DAMAGECOUNT': '12.315', 'FRAGCOUNT': '44.000'} [2023-02-25 14:43:32,827][36140] Large shaping reward 2.587 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.597, 199.0), ('HEALTH', -0.042, -14.0), ('weapon5', 0.002)] [2023-02-25 14:43:32,971][36141] DAMAGECOUNT value on done: 1291263.0 [2023-02-25 14:43:32,972][36141] Sum rewards: 59.088, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.640', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.080', 'AMMO4': '0.118', 'weapon2': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.248', 'weapon4': '0.326', 'WEAPON3': '1.400', 'HITCOUNT': '3.000', 'weapon3': '3.254', 'DAMAGECOUNT': '14.085', 'FRAGCOUNT': '52.000'} [2023-02-25 14:43:33,025][36139] DAMAGECOUNT value on done: 1306435.0 [2023-02-25 14:43:33,026][36139] Sum rewards: 62.057, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.796', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.047', 'AMMO3': '0.187', 'weapon5': '0.232', 'AMMO4': '0.236', 'weapon2': '0.324', 'weapon4': '0.468', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.646', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.531', 'FRAGCOUNT': '54.000'} [2023-02-25 14:43:33,052][36155] DAMAGECOUNT value on done: 1306089.0 [2023-02-25 14:43:33,053][36155] Sum rewards: 57.994, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.144', 'AMMO5': '0.020', 'AMMO2': '0.042', 'AMMO3': '0.210', 'AMMO4': '0.210', 'weapon4': '0.248', 'weapon2': '0.264', 'weapon5': '0.332', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.810', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '15.561', 'FRAGCOUNT': '52.000'} [2023-02-25 14:43:33,070][36154] Large shaping reward 2.566 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.534, 178.0), ('weapon5', 0.002)] [2023-02-25 14:43:33,309][36139] DAMAGECOUNT value on done: 1301876.0 [2023-02-25 14:43:33,310][36139] Sum rewards: 67.769, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO3': '0.135', 'AMMO4': '0.147', 'HEALTH': '0.170', 'weapon5': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.354', 'weapon4': '0.384', 'WEAPON3': '0.800', 'weapon3': '2.818', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '55.000'} [2023-02-25 14:43:33,694][36139] DAMAGECOUNT value on done: 1317741.0 [2023-02-25 14:43:33,694][36139] Sum rewards: 54.309, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.275', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.146', 'weapon2': '0.148', 'AMMO3': '0.199', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.446', 'WEAPON3': '1.150', 'HITCOUNT': '2.820', 'weapon3': '3.010', 'DAMAGECOUNT': '14.391', 'FRAGCOUNT': '47.000'} [2023-02-25 14:43:33,756][36155] DAMAGECOUNT value on done: 1320333.0 [2023-02-25 14:43:33,756][36155] Sum rewards: 62.693, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.545', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon2': '0.354', 'weapon4': '0.376', 'WEAPON3': '1.150', 'weapon3': '2.914', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '52.000'} [2023-02-25 14:43:33,975][36139] DAMAGECOUNT value on done: 1312833.0 [2023-02-25 14:43:33,975][36139] Sum rewards: 60.593, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.885', 'AMMO2': '0.016', 'AMMO4': '0.078', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.468', 'ARMOR': '0.480', 'weapon2': '0.520', 'WEAPON3': '1.050', 'weapon3': '2.876', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.640', 'FRAGCOUNT': '50.000'} [2023-02-25 14:43:34,056][36155] DAMAGECOUNT value on done: 1301091.0 [2023-02-25 14:43:34,057][36155] Sum rewards: 55.692, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.840', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.070', 'AMMO4': '0.073', 'weapon5': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.164', 'AMMO3': '0.219', 'WEAPON3': '1.400', 'HITCOUNT': '2.880', 'weapon3': '3.464', 'DAMAGECOUNT': '13.821', 'FRAGCOUNT': '48.000'} [2023-02-25 14:43:34,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 223969280. Throughput: 0: 3331.3. Samples: 18490260. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:43:34,729][36114] Avg episode reward: [(0, '58.215')] [2023-02-25 14:43:35,477][36138] Updated weights for policy 0, policy_version 54683 (0.0010) [2023-02-25 14:43:35,566][36157] DAMAGECOUNT value on done: 1315369.0 [2023-02-25 14:43:35,567][36157] Sum rewards: 52.669, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.404', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.132', 'AMMO4': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.344', 'weapon4': '0.428', 'WEAPON3': '1.450', 'weapon3': '2.858', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.988', 'FRAGCOUNT': '46.000'} [2023-02-25 14:43:35,871][36157] DAMAGECOUNT value on done: 1302640.0 [2023-02-25 14:43:35,872][36157] Sum rewards: 60.256, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.517', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.146', 'weapon4': '0.172', 'weapon2': '0.190', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '2.850', 'weapon3': '3.250', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '53.000'} [2023-02-25 14:43:36,119][36157] DAMAGECOUNT value on done: 1314620.0 [2023-02-25 14:43:36,120][36157] Sum rewards: 52.219, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.287', 'AMMO5': '0.020', 'AMMO2': '0.044', 'AMMO4': '0.219', 'weapon5': '0.220', 'AMMO3': '0.229', 'weapon2': '0.270', 'weapon4': '0.408', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.706', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '47.500'} [2023-02-25 14:43:36,429][36157] DAMAGECOUNT value on done: 1310079.0 [2023-02-25 14:43:36,430][36157] Sum rewards: 63.393, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.692', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.030', 'AMMO3': '0.128', 'AMMO4': '0.151', 'weapon5': '0.208', 'weapon2': '0.308', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.832', 'WEAPON3': '0.850', 'weapon3': '2.404', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.700', 'FRAGCOUNT': '52.000'} [2023-02-25 14:43:36,990][36140] DAMAGECOUNT value on done: 1309974.0 [2023-02-25 14:43:36,990][36140] Sum rewards: 54.227, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.002', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.154', 'AMMO3': '0.175', 'weapon2': '0.248', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.610', 'WEAPON3': '1.150', 'weapon3': '2.762', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.358', 'FRAGCOUNT': '48.000'} [2023-02-25 14:43:37,000][36140] DAMAGECOUNT value on done: 1314321.0 [2023-02-25 14:43:37,000][36140] Sum rewards: 55.849, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.505', 'AMMO5': '0.016', 'AMMO2': '0.047', 'AMMO3': '0.125', 'weapon2': '0.214', 'AMMO4': '0.232', 'weapon5': '0.300', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '0.650', 'weapon4': '0.782', 'weapon3': '2.378', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.890', 'FRAGCOUNT': '48.000'} [2023-02-25 14:43:37,301][36140] DAMAGECOUNT value on done: 1296089.0 [2023-02-25 14:43:37,302][36140] Sum rewards: 40.622, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.384', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.164', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'WEAPON4': '0.350', 'weapon2': '0.482', 'weapon4': '0.560', 'WEAPON3': '1.250', 'weapon3': '2.534', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '12.210', 'FRAGCOUNT': '38.000'} [2023-02-25 14:43:37,314][36140] DAMAGECOUNT value on done: 1296070.0 [2023-02-25 14:43:37,314][36140] Sum rewards: 52.692, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.597', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon4': '0.220', 'weapon2': '0.328', 'WEAPON3': '1.450', 'HITCOUNT': '2.840', 'weapon3': '3.096', 'DAMAGECOUNT': '13.995', 'FRAGCOUNT': '47.000'} [2023-02-25 14:43:38,530][36138] Updated weights for policy 0, policy_version 54693 (0.0009) [2023-02-25 14:43:39,729][36114] Fps is (10 sec: 13107.4, 60 sec: 13312.0, 300 sec: 13384.9). Total num frames: 224034816. Throughput: 0: 3332.3. Samples: 18500344. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-25 14:43:39,729][36114] Avg episode reward: [(0, '58.342')] [2023-02-25 14:43:39,768][36142] DAMAGECOUNT value on done: 1304111.0 [2023-02-25 14:43:39,769][36142] Sum rewards: 48.347, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.320', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.108', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'weapon4': '0.414', 'weapon2': '0.486', 'WEAPON3': '1.350', 'weapon3': '2.740', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.427', 'FRAGCOUNT': '43.000'} [2023-02-25 14:43:40,077][36142] DAMAGECOUNT value on done: 1294352.0 [2023-02-25 14:43:40,078][36142] Sum rewards: 61.299, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.632', 'ARMOR': '0.004', 'AMMO2': '0.026', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'weapon4': '0.222', 'AMMO3': '0.262', 'weapon2': '0.274', 'WEAPON3': '1.500', 'weapon3': '3.276', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.968', 'FRAGCOUNT': '53.000'} [2023-02-25 14:43:40,684][36142] DAMAGECOUNT value on done: 1306362.0 [2023-02-25 14:43:40,685][36142] Sum rewards: 55.993, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.000', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.076', 'weapon5': '0.162', 'AMMO4': '0.198', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '2.960', 'weapon3': '3.246', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '50.000'} [2023-02-25 14:43:40,991][36142] DAMAGECOUNT value on done: 1311542.0 [2023-02-25 14:43:40,991][36142] Sum rewards: 61.157, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.704', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.152', 'AMMO3': '0.199', 'weapon2': '0.232', 'weapon5': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.528', 'WEAPON3': '1.150', 'weapon3': '2.566', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '52.000'} [2023-02-25 14:43:41,544][36156] DAMAGECOUNT value on done: 1319828.0 [2023-02-25 14:43:41,544][36156] Sum rewards: 55.091, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.685', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon2': '0.252', 'weapon4': '0.454', 'WEAPON3': '1.450', 'weapon3': '2.988', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.352', 'FRAGCOUNT': '50.000'} [2023-02-25 14:43:41,561][36138] Updated weights for policy 0, policy_version 54703 (0.0009) [2023-02-25 14:43:41,834][36156] DAMAGECOUNT value on done: 1300267.0 [2023-02-25 14:43:41,835][36156] Sum rewards: 55.166, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.800', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon4': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'weapon5': '0.170', 'weapon2': '0.460', 'WEAPON3': '1.050', 'HITCOUNT': '2.850', 'weapon3': '3.168', 'DAMAGECOUNT': '13.629', 'FRAGCOUNT': '47.000'} [2023-02-25 14:43:41,847][36156] DAMAGECOUNT value on done: 1314073.0 [2023-02-25 14:43:41,848][36156] Sum rewards: 54.670, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.203', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO4': '0.183', 'AMMO3': '0.203', 'weapon5': '0.256', 'weapon2': '0.272', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.558', 'WEAPON3': '1.200', 'weapon3': '2.640', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.838', 'FRAGCOUNT': '48.500'} [2023-02-25 14:43:42,159][36156] DAMAGECOUNT value on done: 1302851.0 [2023-02-25 14:43:42,159][36156] Sum rewards: 54.245, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.450', 'AMMO5': '0.007', 'weapon5': '0.016', 'AMMO2': '0.025', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon4': '0.294', 'weapon2': '0.528', 'WEAPON3': '1.200', 'HITCOUNT': '2.990', 'weapon3': '2.998', 'DAMAGECOUNT': '13.470', 'FRAGCOUNT': '48.000'} [2023-02-25 14:43:44,574][36138] Updated weights for policy 0, policy_version 54713 (0.0009) [2023-02-25 14:43:44,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 224104448. Throughput: 0: 3339.8. Samples: 18520692. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-25 14:43:44,729][36114] Avg episode reward: [(0, '58.053')] [2023-02-25 14:43:47,583][36138] Updated weights for policy 0, policy_version 54723 (0.0009) [2023-02-25 14:43:49,729][36114] Fps is (10 sec: 13926.3, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 224174080. Throughput: 0: 3343.9. Samples: 18541112. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-25 14:43:49,730][36114] Avg episode reward: [(0, '58.053')] [2023-02-25 14:43:50,613][36138] Updated weights for policy 0, policy_version 54733 (0.0009) [2023-02-25 14:43:51,202][36154] DAMAGECOUNT value on done: 1315225.0 [2023-02-25 14:43:51,203][36154] Sum rewards: 53.283, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.280', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.126', 'AMMO4': '0.135', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.366', 'weapon2': '0.394', 'WEAPON3': '1.200', 'weapon3': '2.912', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.808', 'FRAGCOUNT': '46.000'} [2023-02-25 14:43:51,514][36154] DAMAGECOUNT value on done: 1293890.0 [2023-02-25 14:43:51,515][36154] Sum rewards: 50.236, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.903', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.188', 'AMMO4': '0.201', 'AMMO3': '0.210', 'weapon4': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.718', 'WEAPON3': '1.200', 'weapon3': '2.496', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.998', 'FRAGCOUNT': '43.500'} [2023-02-25 14:43:51,837][36154] DAMAGECOUNT value on done: 1326840.0 [2023-02-25 14:43:51,837][36154] Sum rewards: 70.228, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.824', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.158', 'weapon4': '0.188', 'weapon5': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.448', 'WEAPON3': '1.050', 'weapon3': '2.894', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '58.000'} [2023-02-25 14:43:52,139][36154] DAMAGECOUNT value on done: 1308341.0 [2023-02-25 14:43:52,139][36154] Sum rewards: 62.917, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.105', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'weapon5': '0.156', 'AMMO4': '0.158', 'AMMO3': '0.190', 'weapon2': '0.306', 'WEAPON4': '0.400', 'weapon4': '0.798', 'WEAPON3': '1.150', 'weapon3': '2.418', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '54.000'} [2023-02-25 14:43:52,217][36141] DAMAGECOUNT value on done: 1320079.0 [2023-02-25 14:43:52,217][36141] Sum rewards: 47.156, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.217', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.033', 'AMMO3': '0.159', 'AMMO4': '0.163', 'weapon5': '0.242', 'weapon2': '0.330', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.740', 'WEAPON3': '1.000', 'weapon3': '2.448', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '14.265', 'FRAGCOUNT': '39.000'} [2023-02-25 14:43:52,472][36155] DAMAGECOUNT value on done: 1308765.0 [2023-02-25 14:43:52,472][36155] Sum rewards: 55.676, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.186', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon5': '0.194', 'AMMO3': '0.198', 'AMMO4': '0.241', 'WEAPON5': '0.350', 'weapon4': '0.414', 'weapon2': '0.490', 'WEAPON4': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.656', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '15.849', 'FRAGCOUNT': '47.000'} [2023-02-25 14:43:52,530][36141] DAMAGECOUNT value on done: 1315790.0 [2023-02-25 14:43:52,531][36141] Sum rewards: 61.362, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.314', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.155', 'AMMO3': '0.193', 'weapon2': '0.280', 'weapon5': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.420', 'WEAPON3': '1.100', 'weapon3': '2.700', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.200', 'FRAGCOUNT': '52.000'} [2023-02-25 14:43:52,632][36141] DAMAGECOUNT value on done: 1303512.0 [2023-02-25 14:43:52,633][36141] Sum rewards: 55.322, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.500', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.162', 'weapon5': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.398', 'weapon4': '0.516', 'WEAPON3': '1.000', 'weapon3': '2.640', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '13.143', 'FRAGCOUNT': '48.000'} [2023-02-25 14:43:52,778][36155] DAMAGECOUNT value on done: 1310599.0 [2023-02-25 14:43:52,778][36155] Sum rewards: 57.514, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.159', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon7': '0.050', 'AMMO3': '0.085', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.107', 'WEAPON5': '0.200', 'weapon5': '0.268', 'WEAPON4': '0.400', 'weapon2': '0.438', 'WEAPON3': '0.500', 'weapon4': '1.248', 'weapon3': '1.734', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.530', 'FRAGCOUNT': '45.000'} [2023-02-25 14:43:52,810][36139] DAMAGECOUNT value on done: 1311246.0 [2023-02-25 14:43:52,810][36139] Sum rewards: 51.934, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.607', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.070', 'AMMO4': '0.129', 'WEAPON5': '0.200', 'weapon2': '0.202', 'AMMO3': '0.225', 'WEAPON4': '0.400', 'weapon4': '0.762', 'WEAPON3': '1.350', 'weapon3': '2.696', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.433', 'FRAGCOUNT': '46.000'} [2023-02-25 14:43:52,935][36141] DAMAGECOUNT value on done: 1296358.0 [2023-02-25 14:43:52,936][36141] Sum rewards: 57.224, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.908', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'weapon2': '0.220', 'WEAPON4': '0.250', 'AMMO3': '0.263', 'weapon4': '0.516', 'WEAPON3': '1.600', 'weapon3': '2.974', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '52.000'} [2023-02-25 14:43:53,121][36139] DAMAGECOUNT value on done: 1306734.0 [2023-02-25 14:43:53,121][36139] Sum rewards: 62.447, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.898', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.124', 'weapon5': '0.136', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.650', 'weapon2': '0.664', 'WEAPON3': '0.800', 'weapon3': '2.314', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.574', 'FRAGCOUNT': '50.000'} [2023-02-25 14:43:53,501][36139] DAMAGECOUNT value on done: 1322695.0 [2023-02-25 14:43:53,501][36139] Sum rewards: 50.720, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.390', 'ARMOR': '0.008', 'AMMO5': '0.033', 'AMMO2': '0.081', 'AMMO3': '0.188', 'weapon5': '0.380', 'AMMO4': '0.407', 'weapon2': '0.572', 'weapon4': '0.578', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.080', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '45.000'} [2023-02-25 14:43:53,554][36155] DAMAGECOUNT value on done: 1324225.0 [2023-02-25 14:43:53,555][36155] Sum rewards: 44.291, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.855', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.142', 'AMMO3': '0.159', 'WEAPON4': '0.250', 'weapon2': '0.294', 'weapon4': '0.442', 'WEAPON3': '1.050', 'HITCOUNT': '2.830', 'weapon3': '2.918', 'DAMAGECOUNT': '11.676', 'FRAGCOUNT': '39.000'} [2023-02-25 14:43:53,670][36138] Updated weights for policy 0, policy_version 54743 (0.0009) [2023-02-25 14:43:53,812][36139] DAMAGECOUNT value on done: 1317870.0 [2023-02-25 14:43:53,812][36139] Sum rewards: 57.028, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.532', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.051', 'AMMO3': '0.100', 'weapon5': '0.202', 'AMMO4': '0.253', 'WEAPON5': '0.400', 'weapon2': '0.556', 'WEAPON4': '0.700', 'WEAPON3': '0.700', 'weapon4': '1.032', 'weapon3': '1.936', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.111', 'FRAGCOUNT': '48.000'} [2023-02-25 14:43:53,865][36155] DAMAGECOUNT value on done: 1305795.0 [2023-02-25 14:43:53,866][36155] Sum rewards: 48.886, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.070', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.130', 'AMMO4': '0.224', 'AMMO3': '0.227', 'WEAPON5': '0.300', 'weapon2': '0.404', 'WEAPON4': '0.500', 'weapon4': '0.674', 'WEAPON3': '1.350', 'weapon3': '2.438', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.112', 'FRAGCOUNT': '46.000'} [2023-02-25 14:43:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 224239616. Throughput: 0: 3340.5. Samples: 18551128. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-25 14:43:54,729][36114] Avg episode reward: [(0, '57.627')] [2023-02-25 14:43:55,463][36157] DAMAGECOUNT value on done: 1320468.0 [2023-02-25 14:43:55,464][36157] Sum rewards: 61.612, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.842', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon2': '0.220', 'weapon4': '0.384', 'WEAPON3': '1.200', 'weapon3': '3.110', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.297', 'FRAGCOUNT': '52.000'} [2023-02-25 14:43:55,761][36157] DAMAGECOUNT value on done: 1307525.0 [2023-02-25 14:43:55,762][36157] Sum rewards: 55.612, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.144', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO3': '0.162', 'AMMO4': '0.178', 'weapon2': '0.216', 'weapon5': '0.264', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '0.900', 'weapon4': '1.096', 'weapon3': '2.066', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.655', 'FRAGCOUNT': '48.000'} [2023-02-25 14:43:55,994][36157] DAMAGECOUNT value on done: 1319542.0 [2023-02-25 14:43:55,995][36157] Sum rewards: 60.800, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.800', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO4': '0.185', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'weapon5': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.402', 'weapon4': '0.850', 'WEAPON3': '1.100', 'weapon3': '2.262', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.751', 'FRAGCOUNT': '52.000'} [2023-02-25 14:43:56,294][36157] DAMAGECOUNT value on done: 1314969.0 [2023-02-25 14:43:56,294][36157] Sum rewards: 63.056, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon2': '0.126', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'weapon4': '0.224', 'HEALTH': '0.330', 'WEAPON3': '1.050', 'HITCOUNT': '2.980', 'weapon3': '3.514', 'DAMAGECOUNT': '14.670', 'FRAGCOUNT': '54.000'} [2023-02-25 14:43:56,628][36138] Updated weights for policy 0, policy_version 54753 (0.0009) [2023-02-25 14:43:56,718][36140] DAMAGECOUNT value on done: 1319181.0 [2023-02-25 14:43:56,718][36140] Sum rewards: 52.042, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.940', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.193', 'weapon5': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.476', 'weapon2': '0.542', 'WEAPON3': '1.150', 'weapon3': '2.500', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '44.500'} [2023-02-25 14:43:56,758][36140] DAMAGECOUNT value on done: 1315953.0 [2023-02-25 14:43:56,759][36140] Sum rewards: 76.542, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.580', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.032', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.170', 'weapon4': '0.198', 'weapon2': '0.652', 'WEAPON3': '1.050', 'weapon3': '2.960', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '63.000'} [2023-02-25 14:43:57,037][36140] DAMAGECOUNT value on done: 1300539.0 [2023-02-25 14:43:57,038][36140] Sum rewards: 49.233, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.507', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'AMMO3': '0.180', 'WEAPON4': '0.350', 'weapon2': '0.390', 'weapon4': '0.390', 'WEAPON3': '1.100', 'HITCOUNT': '2.860', 'weapon3': '2.978', 'DAMAGECOUNT': '13.407', 'FRAGCOUNT': '43.000'} [2023-02-25 14:43:57,075][36140] DAMAGECOUNT value on done: 1300476.0 [2023-02-25 14:43:57,075][36140] Sum rewards: 51.682, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.002', 'AMMO5': '0.010', 'AMMO2': '0.052', 'AMMO3': '0.115', 'weapon5': '0.162', 'weapon2': '0.210', 'WEAPON5': '0.250', 'AMMO4': '0.260', 'ARMOR': '0.404', 'WEAPON4': '0.500', 'WEAPON3': '0.700', 'weapon4': '0.908', 'weapon3': '2.372', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '13.161', 'FRAGCOUNT': '43.000'} [2023-02-25 14:43:59,648][36138] Updated weights for policy 0, policy_version 54763 (0.0009) [2023-02-25 14:43:59,658][36142] DAMAGECOUNT value on done: 1308478.0 [2023-02-25 14:43:59,659][36142] Sum rewards: 46.018, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.800', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon5': '0.164', 'AMMO3': '0.180', 'AMMO4': '0.203', 'weapon4': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.050', 'HITCOUNT': '2.760', 'weapon3': '2.886', 'DAMAGECOUNT': '13.101', 'FRAGCOUNT': '38.500'} [2023-02-25 14:43:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 224309248. Throughput: 0: 3348.4. Samples: 18571488. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-25 14:43:59,730][36114] Avg episode reward: [(0, '57.513')] [2023-02-25 14:43:59,967][36142] DAMAGECOUNT value on done: 1299273.0 [2023-02-25 14:43:59,968][36142] Sum rewards: 57.036, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.772', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.116', 'AMMO4': '0.144', 'AMMO3': '0.217', 'WEAPON5': '0.300', 'weapon2': '0.348', 'weapon4': '0.382', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.800', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.763', 'FRAGCOUNT': '50.000'} [2023-02-25 14:44:00,584][36142] DAMAGECOUNT value on done: 1310628.0 [2023-02-25 14:44:00,584][36142] Sum rewards: 45.713, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.935', 'ARMOR': '0.008', 'AMMO5': '0.021', 'AMMO2': '0.051', 'AMMO3': '0.169', 'weapon5': '0.200', 'AMMO4': '0.253', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon2': '0.648', 'weapon4': '0.932', 'WEAPON3': '1.050', 'weapon3': '1.928', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.798', 'FRAGCOUNT': '41.000'} [2023-02-25 14:44:00,892][36142] DAMAGECOUNT value on done: 1316290.0 [2023-02-25 14:44:00,892][36142] Sum rewards: 50.682, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.769', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon5': '0.172', 'AMMO4': '0.229', 'AMMO3': '0.249', 'WEAPON5': '0.250', 'weapon2': '0.322', 'weapon4': '0.394', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.806', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.244', 'FRAGCOUNT': '48.000'} [2023-02-25 14:44:01,348][36156] DAMAGECOUNT value on done: 1324425.0 [2023-02-25 14:44:01,349][36156] Sum rewards: 51.878, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.650', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon5': '0.174', 'AMMO3': '0.232', 'AMMO4': '0.247', 'weapon2': '0.300', 'weapon4': '0.394', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.750', 'weapon3': '2.820', 'DAMAGECOUNT': '13.791', 'FRAGCOUNT': '48.000'} [2023-02-25 14:44:01,661][36156] DAMAGECOUNT value on done: 1305994.0 [2023-02-25 14:44:01,661][36156] Sum rewards: 64.521, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.464', 'AMMO5': '0.014', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.177', 'weapon5': '0.264', 'weapon2': '0.310', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.486', 'WEAPON3': '1.150', 'weapon3': '2.670', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '53.000'} [2023-02-25 14:44:01,675][36156] DAMAGECOUNT value on done: 1319418.0 [2023-02-25 14:44:01,675][36156] Sum rewards: 62.691, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.344', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.134', 'WEAPON4': '0.150', 'weapon2': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.268', 'weapon4': '0.308', 'WEAPON3': '1.650', 'weapon3': '3.112', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '57.000'} [2023-02-25 14:44:01,977][36156] DAMAGECOUNT value on done: 1307137.0 [2023-02-25 14:44:01,978][36156] Sum rewards: 50.300, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.445', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.134', 'AMMO3': '0.146', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.298', 'weapon2': '0.450', 'WEAPON3': '0.900', 'weapon3': '2.650', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '12.858', 'FRAGCOUNT': '43.000'} [2023-02-25 14:44:02,699][36138] Updated weights for policy 0, policy_version 54773 (0.0009) [2023-02-25 14:44:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 224374784. Throughput: 0: 3352.3. Samples: 18591770. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-25 14:44:04,729][36114] Avg episode reward: [(0, '57.356')] [2023-02-25 14:44:05,716][36138] Updated weights for policy 0, policy_version 54783 (0.0009) [2023-02-25 14:44:08,719][36138] Updated weights for policy 0, policy_version 54793 (0.0009) [2023-02-25 14:44:09,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 224444416. Throughput: 0: 3378.4. Samples: 18601992. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-25 14:44:09,730][36114] Avg episode reward: [(0, '57.356')] [2023-02-25 14:44:11,046][36154] DAMAGECOUNT value on done: 1319935.0 [2023-02-25 14:44:11,046][36154] Sum rewards: 58.004, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.070', 'AMMO5': '0.006', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.186', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.354', 'weapon4': '0.478', 'WEAPON3': '1.150', 'weapon3': '2.814', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.130', 'FRAGCOUNT': '49.000'} [2023-02-25 14:44:11,358][36154] DAMAGECOUNT value on done: 1299601.0 [2023-02-25 14:44:11,358][36154] Sum rewards: 77.173, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.506', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.088', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.165', 'weapon2': '0.320', 'weapon4': '0.416', 'WEAPON3': '1.100', 'weapon3': '3.026', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '63.000'} [2023-02-25 14:44:11,671][36154] DAMAGECOUNT value on done: 1332702.0 [2023-02-25 14:44:11,671][36154] Sum rewards: 69.395, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.267', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.029', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.144', 'AMMO3': '0.163', 'weapon2': '0.234', 'WEAPON4': '0.400', 'weapon4': '0.954', 'WEAPON3': '1.000', 'weapon3': '2.558', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.586', 'FRAGCOUNT': '58.000'} [2023-02-25 14:44:11,754][36138] Updated weights for policy 0, policy_version 54803 (0.0009) [2023-02-25 14:44:11,980][36154] DAMAGECOUNT value on done: 1313625.0 [2023-02-25 14:44:11,981][36154] Sum rewards: 65.722, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.955', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon2': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon5': '0.190', 'weapon4': '0.358', 'WEAPON3': '1.150', 'weapon3': '3.110', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '55.000'} [2023-02-25 14:44:12,058][36141] DAMAGECOUNT value on done: 1324354.0 [2023-02-25 14:44:12,058][36141] Sum rewards: 45.573, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.790', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.036', 'AMMO3': '0.154', 'weapon4': '0.160', 'AMMO4': '0.179', 'weapon5': '0.180', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.546', 'WEAPON3': '1.050', 'HITCOUNT': '2.630', 'weapon3': '2.884', 'DAMAGECOUNT': '12.825', 'FRAGCOUNT': '39.000'} [2023-02-25 14:44:12,378][36155] DAMAGECOUNT value on done: 1314301.0 [2023-02-25 14:44:12,378][36155] Sum rewards: 67.134, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.455', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.026', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'AMMO3': '0.253', 'weapon2': '0.256', 'WEAPON3': '1.500', 'HITCOUNT': '3.290', 'weapon3': '3.554', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '58.000'} [2023-02-25 14:44:12,385][36141] DAMAGECOUNT value on done: 1320974.0 [2023-02-25 14:44:12,385][36141] Sum rewards: 60.353, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.025', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.102', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.202', 'AMMO3': '0.243', 'weapon4': '0.398', 'WEAPON3': '1.450', 'HITCOUNT': '2.930', 'weapon3': '3.028', 'DAMAGECOUNT': '15.540', 'FRAGCOUNT': '54.000'} [2023-02-25 14:44:12,472][36141] DAMAGECOUNT value on done: 1308366.0 [2023-02-25 14:44:12,472][36141] Sum rewards: 58.294, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.820', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.108', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon4': '0.368', 'weapon2': '0.436', 'WEAPON3': '1.250', 'weapon3': '2.870', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.562', 'FRAGCOUNT': '50.000'} [2023-02-25 14:44:12,636][36139] DAMAGECOUNT value on done: 1316701.0 [2023-02-25 14:44:12,637][36139] Sum rewards: 62.927, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.761', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.092', 'AMMO4': '0.150', 'AMMO3': '0.195', 'weapon4': '0.276', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.010', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '54.000'} [2023-02-25 14:44:12,681][36155] DAMAGECOUNT value on done: 1316321.0 [2023-02-25 14:44:12,682][36155] Sum rewards: 62.697, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.968', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.056', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'weapon2': '0.258', 'AMMO3': '0.282', 'WEAPON4': '0.300', 'weapon4': '0.346', 'WEAPON3': '1.750', 'weapon3': '3.068', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '58.000'} [2023-02-25 14:44:12,783][36141] DAMAGECOUNT value on done: 1301120.0 [2023-02-25 14:44:12,784][36141] Sum rewards: 55.761, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.780', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'weapon5': '0.170', 'weapon4': '0.224', 'WEAPON3': '0.900', 'weapon2': '1.034', 'weapon3': '2.392', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.286', 'FRAGCOUNT': '46.000'} [2023-02-25 14:44:12,940][36139] DAMAGECOUNT value on done: 1312441.0 [2023-02-25 14:44:12,941][36139] Sum rewards: 69.096, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.396', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.037', 'weapon5': '0.096', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.306', 'weapon4': '0.372', 'WEAPON3': '1.150', 'weapon3': '3.016', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '57.000'} [2023-02-25 14:44:13,335][36139] DAMAGECOUNT value on done: 1326703.0 [2023-02-25 14:44:13,336][36139] Sum rewards: 46.123, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.308', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.122', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.276', 'WEAPON4': '0.300', 'weapon4': '0.988', 'WEAPON3': '1.250', 'weapon3': '2.400', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.024', 'FRAGCOUNT': '43.000'} [2023-02-25 14:44:13,477][36155] DAMAGECOUNT value on done: 1329693.0 [2023-02-25 14:44:13,478][36155] Sum rewards: 58.553, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.330', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.005', 'AMMO4': '0.023', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.120', 'AMMO3': '0.201', 'weapon2': '0.426', 'WEAPON3': '1.250', 'weapon3': '3.268', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '48.000'} [2023-02-25 14:44:13,644][36139] DAMAGECOUNT value on done: 1321951.0 [2023-02-25 14:44:13,645][36139] Sum rewards: 48.536, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.574', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.054', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon2': '0.214', 'weapon4': '0.894', 'WEAPON3': '1.100', 'HITCOUNT': '2.320', 'weapon3': '2.722', 'DAMAGECOUNT': '12.243', 'FRAGCOUNT': '42.000'} [2023-02-25 14:44:13,785][36155] DAMAGECOUNT value on done: 1309523.0 [2023-02-25 14:44:13,786][36155] Sum rewards: 42.680, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.007', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.164', 'AMMO3': '0.171', 'AMMO4': '0.191', 'WEAPON5': '0.250', 'weapon4': '0.310', 'weapon2': '0.392', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.350', 'weapon3': '2.930', 'DAMAGECOUNT': '11.184', 'FRAGCOUNT': '38.000'} [2023-02-25 14:44:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 224509952. Throughput: 0: 3379.7. Samples: 18622168. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:44:14,730][36114] Avg episode reward: [(0, '57.260')] [2023-02-25 14:44:14,824][36138] Updated weights for policy 0, policy_version 54813 (0.0009) [2023-02-25 14:44:15,257][36157] DAMAGECOUNT value on done: 1325780.0 [2023-02-25 14:44:15,258][36157] Sum rewards: 63.069, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.042', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.171', 'AMMO3': '0.174', 'weapon5': '0.192', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.422', 'weapon4': '0.720', 'WEAPON3': '1.000', 'weapon3': '2.448', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.936', 'FRAGCOUNT': '52.000'} [2023-02-25 14:44:15,558][36157] DAMAGECOUNT value on done: 1312118.0 [2023-02-25 14:44:15,558][36157] Sum rewards: 52.896, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.990', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.050', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon4': '0.480', 'weapon2': '0.516', 'WEAPON3': '1.150', 'weapon3': '2.706', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '13.779', 'FRAGCOUNT': '45.000'} [2023-02-25 14:44:15,799][36157] DAMAGECOUNT value on done: 1324986.0 [2023-02-25 14:44:15,799][36157] Sum rewards: 65.734, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.028', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.022', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'weapon5': '0.178', 'AMMO3': '0.191', 'weapon2': '0.284', 'WEAPON4': '0.350', 'weapon4': '0.446', 'WEAPON3': '1.150', 'weapon3': '2.758', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.332', 'FRAGCOUNT': '56.000'} [2023-02-25 14:44:16,109][36157] DAMAGECOUNT value on done: 1319796.0 [2023-02-25 14:44:16,109][36157] Sum rewards: 62.584, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.814', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.034', 'weapon5': '0.042', 'weapon7': '0.044', 'WEAPON5': '0.100', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO3': '0.162', 'AMMO4': '0.168', 'WEAPON7': '0.200', 'weapon4': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.592', 'WEAPON3': '0.950', 'weapon3': '2.924', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.481', 'FRAGCOUNT': '51.000'} [2023-02-25 14:44:16,571][36140] DAMAGECOUNT value on done: 1324966.0 [2023-02-25 14:44:16,572][36140] Sum rewards: 70.318, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.994', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.196', 'AMMO3': '0.197', 'weapon4': '0.260', 'ARMOR': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.390', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '58.000'} [2023-02-25 14:44:16,698][36140] DAMAGECOUNT value on done: 1320910.0 [2023-02-25 14:44:16,699][36140] Sum rewards: 53.429, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.826', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.071', 'AMMO3': '0.196', 'weapon5': '0.236', 'AMMO4': '0.354', 'weapon4': '0.374', 'weapon2': '0.452', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.610', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.871', 'FRAGCOUNT': '50.500'} [2023-02-25 14:44:16,885][36140] DAMAGECOUNT value on done: 1305547.0 [2023-02-25 14:44:16,885][36140] Sum rewards: 59.225, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.063', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.062', 'AMMO3': '0.125', 'weapon5': '0.264', 'AMMO4': '0.310', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'weapon2': '0.642', 'WEAPON3': '0.800', 'weapon4': '0.832', 'weapon3': '1.952', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.024', 'FRAGCOUNT': '49.000'} [2023-02-25 14:44:17,019][36140] DAMAGECOUNT value on done: 1305634.0 [2023-02-25 14:44:17,019][36140] Sum rewards: 65.112, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.548', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.104', 'weapon5': '0.120', 'AMMO3': '0.193', 'weapon2': '0.630', 'WEAPON3': '1.350', 'weapon3': '3.092', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.474', 'FRAGCOUNT': '56.000'} [2023-02-25 14:44:17,501][36157] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:44:17,869][36138] Updated weights for policy 0, policy_version 54823 (0.0010) [2023-02-25 14:44:19,567][36142] DAMAGECOUNT value on done: 1313305.0 [2023-02-25 14:44:19,567][36142] Sum rewards: 57.493, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.828', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon5': '0.132', 'AMMO4': '0.216', 'AMMO3': '0.217', 'WEAPON5': '0.350', 'weapon4': '0.370', 'WEAPON4': '0.450', 'weapon2': '0.588', 'WEAPON3': '1.350', 'weapon3': '2.632', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.481', 'FRAGCOUNT': '53.000'} [2023-02-25 14:44:19,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13412.7). Total num frames: 224579584. Throughput: 0: 3382.0. Samples: 18642452. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:44:19,730][36114] Avg episode reward: [(0, '57.319')] [2023-02-25 14:44:19,876][36142] DAMAGECOUNT value on done: 1304323.0 [2023-02-25 14:44:19,876][36142] Sum rewards: 59.418, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.215', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO3': '0.140', 'AMMO4': '0.169', 'weapon2': '0.294', 'weapon5': '0.304', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.672', 'WEAPON3': '0.850', 'weapon3': '2.444', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '15.150', 'FRAGCOUNT': '48.000'} [2023-02-25 14:44:20,491][36142] DAMAGECOUNT value on done: 1316125.0 [2023-02-25 14:44:20,491][36142] Sum rewards: 59.516, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.280', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'weapon5': '0.028', 'weapon4': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.276', 'weapon2': '0.420', 'WEAPON3': '1.700', 'weapon3': '3.322', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.491', 'FRAGCOUNT': '52.000'} [2023-02-25 14:44:20,810][36142] DAMAGECOUNT value on done: 1321168.0 [2023-02-25 14:44:20,810][36142] Sum rewards: 51.617, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.216', 'ARMOR': '0.008', 'AMMO5': '0.023', 'AMMO2': '0.062', 'AMMO3': '0.150', 'AMMO4': '0.309', 'weapon5': '0.372', 'WEAPON5': '0.500', 'weapon2': '0.514', 'weapon4': '0.520', 'WEAPON4': '0.600', 'WEAPON3': '0.950', 'weapon3': '2.250', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '14.634', 'FRAGCOUNT': '45.000'} [2023-02-25 14:44:20,924][36138] Updated weights for policy 0, policy_version 54833 (0.0009) [2023-02-25 14:44:21,325][36156] DAMAGECOUNT value on done: 1329868.0 [2023-02-25 14:44:21,325][36156] Sum rewards: 62.785, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.382', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon5': '0.108', 'weapon4': '0.162', 'AMMO4': '0.165', 'AMMO3': '0.201', 'weapon2': '0.260', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '3.230', 'weapon3': '3.236', 'DAMAGECOUNT': '15.909', 'FRAGCOUNT': '54.000'} [2023-02-25 14:44:21,638][36156] DAMAGECOUNT value on done: 1311267.0 [2023-02-25 14:44:21,639][36156] Sum rewards: 62.162, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.626', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.018', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.089', 'WEAPON4': '0.200', 'weapon2': '0.202', 'weapon4': '0.202', 'AMMO3': '0.234', 'WEAPON3': '1.500', 'weapon3': '3.326', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.819', 'FRAGCOUNT': '55.500'} [2023-02-25 14:44:21,653][36156] DAMAGECOUNT value on done: 1324886.0 [2023-02-25 14:44:21,653][36156] Sum rewards: 62.658, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.260', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.056', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.242', 'AMMO3': '0.294', 'weapon2': '0.460', 'WEAPON3': '1.800', 'weapon3': '2.964', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '58.000'} [2023-02-25 14:44:21,964][36156] DAMAGECOUNT value on done: 1312633.0 [2023-02-25 14:44:21,964][36156] Sum rewards: 59.388, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.212', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon4': '0.168', 'weapon5': '0.170', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.400', 'weapon3': '2.960', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '52.000'} [2023-02-25 14:44:23,967][36138] Updated weights for policy 0, policy_version 54843 (0.0009) [2023-02-25 14:44:24,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13412.7). Total num frames: 224645120. Throughput: 0: 3379.6. Samples: 18652428. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:44:24,730][36114] Avg episode reward: [(0, '57.405')] [2023-02-25 14:44:26,957][36138] Updated weights for policy 0, policy_version 54853 (0.0009) [2023-02-25 14:44:29,168][36157] Large shaping reward 2.608 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.588, 196.0)] [2023-02-25 14:44:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13412.7). Total num frames: 224714752. Throughput: 0: 3381.6. Samples: 18672866. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:44:29,730][36114] Avg episode reward: [(0, '57.405')] [2023-02-25 14:44:29,974][36138] Updated weights for policy 0, policy_version 54863 (0.0010) [2023-02-25 14:44:30,995][36154] DAMAGECOUNT value on done: 1324763.0 [2023-02-25 14:44:30,995][36154] Sum rewards: 52.210, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.191', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.054', 'AMMO3': '0.135', 'AMMO4': '0.272', 'weapon5': '0.306', 'WEAPON5': '0.450', 'weapon2': '0.526', 'WEAPON4': '0.600', 'weapon4': '0.708', 'WEAPON3': '0.800', 'weapon3': '2.150', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.484', 'FRAGCOUNT': '45.500'} [2023-02-25 14:44:31,308][36154] DAMAGECOUNT value on done: 1305319.0 [2023-02-25 14:44:31,308][36154] Sum rewards: 61.612, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.376', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.052', 'AMMO3': '0.242', 'AMMO4': '0.262', 'weapon5': '0.280', 'weapon2': '0.460', 'weapon4': '0.478', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.444', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '55.000'} [2023-02-25 14:44:31,622][36154] DAMAGECOUNT value on done: 1338719.0 [2023-02-25 14:44:31,623][36154] Sum rewards: 77.297, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.384', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.120', 'AMMO4': '0.142', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.242', 'weapon2': '0.488', 'WEAPON3': '0.950', 'weapon3': '3.006', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.051', 'FRAGCOUNT': '62.000'} [2023-02-25 14:44:31,928][36154] DAMAGECOUNT value on done: 1318717.0 [2023-02-25 14:44:31,929][36154] Sum rewards: 65.829, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.586', 'weapon5': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.062', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'weapon2': '0.240', 'WEAPON4': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.270', 'weapon3': '3.470', 'DAMAGECOUNT': '15.276', 'FRAGCOUNT': '58.500'} [2023-02-25 14:44:32,045][36141] DAMAGECOUNT value on done: 1329964.0 [2023-02-25 14:44:32,045][36141] Sum rewards: 61.400, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.554', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO4': '0.137', 'weapon5': '0.222', 'AMMO3': '0.278', 'weapon2': '0.278', 'weapon4': '0.314', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '2.834', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '56.000'} [2023-02-25 14:44:32,286][36155] DAMAGECOUNT value on done: 1319881.0 [2023-02-25 14:44:32,287][36155] Sum rewards: 69.669, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.600', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'weapon2': '0.200', 'AMMO3': '0.274', 'WEAPON3': '1.700', 'HITCOUNT': '3.500', 'weapon3': '3.608', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '62.000'} [2023-02-25 14:44:32,338][36141] DAMAGECOUNT value on done: 1326527.0 [2023-02-25 14:44:32,338][36141] Sum rewards: 65.937, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.289', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.056', 'weapon5': '0.138', 'AMMO4': '0.144', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON3': '1.250', 'weapon3': '3.364', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '56.000'} [2023-02-25 14:44:32,428][36141] DAMAGECOUNT value on done: 1314560.0 [2023-02-25 14:44:32,429][36141] Sum rewards: 74.682, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.552', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon4': '0.200', 'weapon2': '0.552', 'WEAPON3': '1.100', 'weapon3': '2.960', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '62.000'} [2023-02-25 14:44:32,533][36139] DAMAGECOUNT value on done: 1321643.0 [2023-02-25 14:44:32,533][36139] Sum rewards: 53.676, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.622', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.048', 'AMMO3': '0.195', 'weapon4': '0.240', 'AMMO4': '0.241', 'weapon2': '0.246', 'weapon5': '0.258', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.730', 'weapon3': '2.944', 'DAMAGECOUNT': '14.826', 'FRAGCOUNT': '48.000'} [2023-02-25 14:44:32,596][36155] DAMAGECOUNT value on done: 1323066.0 [2023-02-25 14:44:32,597][36155] Sum rewards: 76.988, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.713', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO3': '0.170', 'AMMO4': '0.181', 'weapon5': '0.204', 'weapon2': '0.230', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.476', 'WEAPON3': '1.100', 'weapon3': '2.822', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '20.235', 'FRAGCOUNT': '62.500'} [2023-02-25 14:44:32,749][36141] DAMAGECOUNT value on done: 1306292.0 [2023-02-25 14:44:32,749][36141] Sum rewards: 61.501, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.884', 'AMMO5': '0.006', 'AMMO2': '0.012', 'weapon4': '0.030', 'AMMO4': '0.057', 'weapon5': '0.068', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.540', 'WEAPON3': '1.200', 'weapon3': '3.168', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.516', 'FRAGCOUNT': '52.500'} [2023-02-25 14:44:32,840][36139] DAMAGECOUNT value on done: 1317991.0 [2023-02-25 14:44:32,841][36139] Sum rewards: 64.224, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.135', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.158', 'AMMO3': '0.192', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON4': '0.400', 'weapon4': '0.504', 'WEAPON3': '1.250', 'weapon3': '2.692', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.650', 'FRAGCOUNT': '54.500'} [2023-02-25 14:44:33,029][36138] Updated weights for policy 0, policy_version 54873 (0.0009) [2023-02-25 14:44:33,226][36139] DAMAGECOUNT value on done: 1332203.0 [2023-02-25 14:44:33,226][36139] Sum rewards: 65.015, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.070', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.116', 'weapon2': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.168', 'AMMO3': '0.264', 'WEAPON3': '1.650', 'HITCOUNT': '3.210', 'weapon3': '3.344', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '58.000'} [2023-02-25 14:44:33,407][36155] DAMAGECOUNT value on done: 1335691.0 [2023-02-25 14:44:33,407][36155] Sum rewards: 63.375, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.939', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.032', 'weapon5': '0.090', 'AMMO4': '0.161', 'weapon4': '0.240', 'AMMO3': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.442', 'WEAPON3': '1.550', 'weapon3': '2.984', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '55.000'} [2023-02-25 14:44:33,514][36139] DAMAGECOUNT value on done: 1327717.0 [2023-02-25 14:44:33,515][36139] Sum rewards: 70.187, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.144', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon2': '0.138', 'AMMO3': '0.167', 'weapon5': '0.170', 'weapon4': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.000', 'HITCOUNT': '3.250', 'weapon3': '3.366', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '57.000'} [2023-02-25 14:44:33,701][36155] DAMAGECOUNT value on done: 1315075.0 [2023-02-25 14:44:33,702][36155] Sum rewards: 61.640, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.300', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon5': '0.090', 'weapon2': '0.174', 'weapon4': '0.216', 'AMMO3': '0.234', 'AMMO4': '0.245', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.280', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '55.000'} [2023-02-25 14:44:34,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13412.7). Total num frames: 224780288. Throughput: 0: 3376.7. Samples: 18693062. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:44:34,729][36114] Avg episode reward: [(0, '58.575')] [2023-02-25 14:44:35,114][36157] DAMAGECOUNT value on done: 1330036.0 [2023-02-25 14:44:35,114][36157] Sum rewards: 45.373, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.104', 'AMMO5': '0.020', 'AMMO2': '0.041', 'AMMO3': '0.181', 'AMMO4': '0.203', 'weapon2': '0.240', 'weapon5': '0.322', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.700', 'WEAPON3': '1.100', 'weapon3': '2.292', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '12.768', 'FRAGCOUNT': '41.000'} [2023-02-25 14:44:35,419][36157] DAMAGECOUNT value on done: 1318742.0 [2023-02-25 14:44:35,420][36157] Sum rewards: 80.553, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.710', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.032', 'weapon5': '0.064', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'weapon2': '0.218', 'WEAPON3': '1.050', 'weapon3': '3.560', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.872', 'FRAGCOUNT': '65.000'} [2023-02-25 14:44:35,650][36157] DAMAGECOUNT value on done: 1330533.0 [2023-02-25 14:44:35,650][36157] Sum rewards: 52.581, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.661', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon5': '0.212', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'weapon2': '0.476', 'WEAPON4': '0.500', 'weapon4': '0.802', 'WEAPON3': '1.450', 'weapon3': '2.246', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '48.500'} [2023-02-25 14:44:35,944][36157] DAMAGECOUNT value on done: 1324765.0 [2023-02-25 14:44:35,944][36157] Sum rewards: 65.125, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.003', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.016', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'AMMO3': '0.188', 'weapon4': '0.204', 'weapon2': '0.584', 'WEAPON3': '1.100', 'weapon3': '2.948', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.907', 'FRAGCOUNT': '54.000'} [2023-02-25 14:44:36,061][36138] Updated weights for policy 0, policy_version 54883 (0.0009) [2023-02-25 14:44:36,385][36140] DAMAGECOUNT value on done: 1330265.0 [2023-02-25 14:44:36,386][36140] Sum rewards: 64.672, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.935', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.104', 'weapon2': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.251', 'weapon4': '0.480', 'WEAPON3': '1.400', 'weapon3': '2.872', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.897', 'FRAGCOUNT': '56.000'} [2023-02-25 14:44:36,489][36140] DAMAGECOUNT value on done: 1325562.0 [2023-02-25 14:44:36,490][36140] Sum rewards: 51.844, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.191', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon7': '0.096', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.168', 'AMMO3': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.274', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.616', 'WEAPON3': '1.200', 'weapon3': '2.558', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.956', 'FRAGCOUNT': '45.000'} [2023-02-25 14:44:36,690][36140] DAMAGECOUNT value on done: 1310941.0 [2023-02-25 14:44:36,691][36140] Sum rewards: 65.283, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.372', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.097', 'AMMO3': '0.111', 'weapon4': '0.128', 'WEAPON5': '0.150', 'weapon5': '0.168', 'WEAPON4': '0.200', 'weapon2': '0.522', 'WEAPON3': '0.700', 'HITCOUNT': '2.880', 'weapon3': '2.986', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '52.000'} [2023-02-25 14:44:36,793][36140] DAMAGECOUNT value on done: 1311014.0 [2023-02-25 14:44:36,794][36140] Sum rewards: 65.357, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.590', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.024', 'AMMO2': '0.043', 'WEAPON5': '0.050', 'weapon4': '0.060', 'AMMO3': '0.200', 'AMMO4': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.276', 'WEAPON3': '1.400', 'HITCOUNT': '3.330', 'weapon3': '3.452', 'DAMAGECOUNT': '16.140', 'FRAGCOUNT': '57.000'} [2023-02-25 14:44:39,070][36138] Updated weights for policy 0, policy_version 54893 (0.0009) [2023-02-25 14:44:39,517][36142] DAMAGECOUNT value on done: 1318501.0 [2023-02-25 14:44:39,518][36142] Sum rewards: 57.358, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.772', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.056', 'AMMO3': '0.144', 'weapon5': '0.204', 'weapon2': '0.264', 'AMMO4': '0.279', 'WEAPON5': '0.550', 'weapon4': '0.638', 'WEAPON4': '0.700', 'WEAPON3': '0.950', 'weapon3': '2.384', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '15.588', 'FRAGCOUNT': '49.000'} [2023-02-25 14:44:39,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.0, 300 sec: 13412.7). Total num frames: 224849920. Throughput: 0: 3380.5. Samples: 18703250. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:44:39,729][36114] Avg episode reward: [(0, '58.896')] [2023-02-25 14:44:39,825][36142] DAMAGECOUNT value on done: 1309702.0 [2023-02-25 14:44:39,825][36142] Sum rewards: 62.314, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.026', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.078', 'AMMO4': '0.136', 'weapon5': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.370', 'WEAPON3': '1.300', 'weapon3': '3.158', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '53.000'} [2023-02-25 14:44:40,456][36142] DAMAGECOUNT value on done: 1321842.0 [2023-02-25 14:44:40,457][36142] Sum rewards: 68.599, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.944', 'AMMO5': '0.013', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon5': '0.194', 'AMMO3': '0.209', 'weapon2': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.934', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.151', 'FRAGCOUNT': '59.000'} [2023-02-25 14:44:40,759][36142] DAMAGECOUNT value on done: 1327498.0 [2023-02-25 14:44:40,759][36142] Sum rewards: 77.970, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.040', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO4': '0.088', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.148', 'weapon2': '0.664', 'WEAPON3': '1.100', 'weapon3': '3.028', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '18.990', 'FRAGCOUNT': '64.000'} [2023-02-25 14:44:41,244][36156] DAMAGECOUNT value on done: 1334703.0 [2023-02-25 14:44:41,245][36156] Sum rewards: 52.594, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.042', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.030', 'AMMO4': '0.151', 'AMMO3': '0.152', 'weapon5': '0.152', 'WEAPON5': '0.200', 'weapon2': '0.386', 'WEAPON4': '0.500', 'weapon4': '0.644', 'WEAPON3': '0.950', 'weapon3': '2.520', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.505', 'FRAGCOUNT': '44.000'} [2023-02-25 14:44:41,553][36156] DAMAGECOUNT value on done: 1315510.0 [2023-02-25 14:44:41,554][36156] Sum rewards: 44.308, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.870', 'AMMO5': '0.010', 'AMMO2': '0.046', 'AMMO3': '0.152', 'weapon5': '0.164', 'AMMO4': '0.231', 'WEAPON5': '0.250', 'weapon2': '0.476', 'WEAPON4': '0.600', 'WEAPON3': '1.000', 'weapon4': '1.032', 'weapon3': '2.048', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.729', 'FRAGCOUNT': '40.000'} [2023-02-25 14:44:41,567][36156] DAMAGECOUNT value on done: 1330431.0 [2023-02-25 14:44:41,567][36156] Sum rewards: 67.267, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.594', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon4': '0.234', 'weapon2': '0.310', 'WEAPON3': '1.300', 'weapon3': '3.042', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '60.000'} [2023-02-25 14:44:41,736][36141] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:44:41,869][36156] DAMAGECOUNT value on done: 1317800.0 [2023-02-25 14:44:41,869][36156] Sum rewards: 56.018, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.140', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.170', 'weapon2': '0.184', 'AMMO3': '0.217', 'weapon4': '0.548', 'WEAPON3': '1.300', 'weapon3': '2.860', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.501', 'FRAGCOUNT': '47.000'} [2023-02-25 14:44:42,107][36138] Updated weights for policy 0, policy_version 54903 (0.0009) [2023-02-25 14:44:42,753][36157] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:44:43,639][36156] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:44:44,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13412.7). Total num frames: 224915456. Throughput: 0: 3378.2. Samples: 18723508. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:44:44,730][36114] Avg episode reward: [(0, '59.427')] [2023-02-25 14:44:45,160][36138] Updated weights for policy 0, policy_version 54913 (0.0009) [2023-02-25 14:44:48,162][36138] Updated weights for policy 0, policy_version 54923 (0.0009) [2023-02-25 14:44:49,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13426.6). Total num frames: 224985088. Throughput: 0: 3382.9. Samples: 18744002. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:44:49,730][36114] Avg episode reward: [(0, '59.427')] [2023-02-25 14:44:50,729][36154] DAMAGECOUNT value on done: 1330165.0 [2023-02-25 14:44:50,730][36154] Sum rewards: 58.194, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.839', 'AMMO5': '0.027', 'AMMO2': '0.073', 'AMMO3': '0.217', 'weapon2': '0.252', 'weapon5': '0.314', 'AMMO4': '0.364', 'WEAPON5': '0.600', 'WEAPON4': '0.800', 'weapon4': '0.836', 'WEAPON3': '1.250', 'weapon3': '2.164', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '16.206', 'FRAGCOUNT': '53.000'} [2023-02-25 14:44:51,026][36154] DAMAGECOUNT value on done: 1312054.0 [2023-02-25 14:44:51,026][36154] Sum rewards: 81.371, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.818', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon4': '0.256', 'weapon2': '0.376', 'WEAPON3': '1.250', 'weapon3': '2.996', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.205', 'FRAGCOUNT': '67.000'} [2023-02-25 14:44:51,201][36138] Updated weights for policy 0, policy_version 54933 (0.0009) [2023-02-25 14:44:51,339][36154] DAMAGECOUNT value on done: 1343252.0 [2023-02-25 14:44:51,340][36154] Sum rewards: 54.307, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.440', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.098', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'WEAPON4': '0.350', 'weapon2': '0.406', 'weapon4': '0.654', 'WEAPON3': '1.300', 'weapon3': '2.634', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.599', 'FRAGCOUNT': '48.000'} [2023-02-25 14:44:51,661][36154] DAMAGECOUNT value on done: 1323052.0 [2023-02-25 14:44:51,662][36154] Sum rewards: 47.186, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.010', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.168', 'AMMO3': '0.186', 'weapon4': '0.192', 'weapon5': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.394', 'WEAPON3': '1.200', 'HITCOUNT': '2.760', 'weapon3': '2.908', 'DAMAGECOUNT': '13.005', 'FRAGCOUNT': '41.000'} [2023-02-25 14:44:51,956][36141] DAMAGECOUNT value on done: 1335483.0 [2023-02-25 14:44:51,957][36141] Sum rewards: 67.865, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.416', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO4': '0.163', 'AMMO3': '0.215', 'weapon5': '0.270', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.616', 'WEAPON3': '1.300', 'weapon3': '2.534', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '60.000'} [2023-02-25 14:44:52,036][36140] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:44:52,112][36155] DAMAGECOUNT value on done: 1325147.0 [2023-02-25 14:44:52,112][36155] Sum rewards: 62.287, reward structure: {'DEATHCOUNT': '-13.500', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.043', 'AMMO3': '0.177', 'weapon5': '0.188', 'AMMO4': '0.213', 'HEALTH': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.384', 'weapon4': '0.668', 'WEAPON3': '0.950', 'weapon3': '2.448', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.798', 'FRAGCOUNT': '51.000'} [2023-02-25 14:44:52,267][36141] DAMAGECOUNT value on done: 1331646.0 [2023-02-25 14:44:52,267][36141] Sum rewards: 60.953, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.384', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.049', 'AMMO3': '0.153', 'AMMO4': '0.243', 'weapon5': '0.284', 'weapon2': '0.290', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon4': '0.730', 'WEAPON3': '0.900', 'weapon3': '2.436', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.357', 'FRAGCOUNT': '52.000'} [2023-02-25 14:44:52,338][36141] DAMAGECOUNT value on done: 1320210.0 [2023-02-25 14:44:52,339][36141] Sum rewards: 71.497, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.509', 'AMMO5': '0.004', 'AMMO2': '0.016', 'weapon5': '0.062', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'weapon4': '0.204', 'weapon2': '0.384', 'WEAPON3': '1.150', 'weapon3': '3.164', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '59.000'} [2023-02-25 14:44:52,408][36139] DAMAGECOUNT value on done: 1327385.0 [2023-02-25 14:44:52,408][36139] Sum rewards: 63.810, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.612', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.166', 'AMMO3': '0.178', 'weapon4': '0.188', 'weapon5': '0.258', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '2.952', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '55.000'} [2023-02-25 14:44:52,432][36155] DAMAGECOUNT value on done: 1327677.0 [2023-02-25 14:44:52,432][36155] Sum rewards: 53.203, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.824', 'AMMO5': '0.012', 'AMMO2': '0.040', 'AMMO3': '0.139', 'AMMO4': '0.202', 'weapon5': '0.246', 'weapon2': '0.336', 'WEAPON5': '0.350', 'ARMOR': '0.412', 'WEAPON4': '0.500', 'WEAPON3': '0.900', 'weapon4': '1.050', 'weapon3': '1.996', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.833', 'FRAGCOUNT': '45.500'} [2023-02-25 14:44:52,639][36141] DAMAGECOUNT value on done: 1311324.0 [2023-02-25 14:44:52,640][36141] Sum rewards: 56.171, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.025', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO2': '0.052', 'AMMO3': '0.165', 'weapon2': '0.254', 'AMMO4': '0.258', 'weapon5': '0.314', 'WEAPON5': '0.550', 'weapon4': '0.566', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.384', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.096', 'FRAGCOUNT': '49.000'} [2023-02-25 14:44:52,709][36139] DAMAGECOUNT value on done: 1323635.0 [2023-02-25 14:44:52,710][36139] Sum rewards: 69.331, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.462', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.110', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'weapon2': '0.184', 'WEAPON4': '0.250', 'weapon4': '0.312', 'WEAPON3': '0.950', 'weapon3': '3.248', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '57.000'} [2023-02-25 14:44:53,018][36139] DAMAGECOUNT value on done: 1337905.0 [2023-02-25 14:44:53,019][36139] Sum rewards: 63.992, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.084', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.124', 'weapon4': '0.152', 'AMMO4': '0.170', 'AMMO3': '0.206', 'weapon2': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.144', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '56.000'} [2023-02-25 14:44:53,321][36155] DAMAGECOUNT value on done: 1340779.0 [2023-02-25 14:44:53,321][36155] Sum rewards: 62.739, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.905', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.072', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'weapon4': '0.390', 'weapon2': '0.526', 'WEAPON3': '1.000', 'weapon3': '2.806', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '52.000'} [2023-02-25 14:44:53,324][36139] DAMAGECOUNT value on done: 1332596.0 [2023-02-25 14:44:53,325][36139] Sum rewards: 54.037, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.296', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.063', 'AMMO3': '0.151', 'weapon2': '0.200', 'weapon5': '0.286', 'AMMO4': '0.315', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '0.900', 'weapon4': '1.326', 'weapon3': '1.398', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.592', 'FRAGCOUNT': '47.000'} [2023-02-25 14:44:53,629][36155] DAMAGECOUNT value on done: 1321118.0 [2023-02-25 14:44:53,630][36155] Sum rewards: 67.158, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.872', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon5': '0.172', 'weapon2': '0.196', 'AMMO3': '0.206', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.506', 'WEAPON3': '1.300', 'weapon3': '2.858', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.129', 'FRAGCOUNT': '58.000'} [2023-02-25 14:44:54,235][36138] Updated weights for policy 0, policy_version 54943 (0.0009) [2023-02-25 14:44:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13412.7). Total num frames: 225050624. Throughput: 0: 3379.4. Samples: 18754066. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:44:54,730][36114] Avg episode reward: [(0, '60.323')] [2023-02-25 14:44:54,977][36157] DAMAGECOUNT value on done: 1335861.0 [2023-02-25 14:44:54,978][36157] Sum rewards: 66.587, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.455', 'AMMO5': '0.013', 'AMMO2': '0.029', 'AMMO4': '0.143', 'AMMO3': '0.168', 'weapon5': '0.200', 'weapon4': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.100', 'weapon3': '2.922', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '56.000'} [2023-02-25 14:44:55,291][36157] DAMAGECOUNT value on done: 1324557.0 [2023-02-25 14:44:55,292][36157] Sum rewards: 70.897, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.869', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON5': '0.100', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'weapon4': '0.258', 'weapon2': '0.638', 'WEAPON3': '1.150', 'weapon3': '2.942', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '59.000'} [2023-02-25 14:44:55,559][36157] DAMAGECOUNT value on done: 1335910.0 [2023-02-25 14:44:55,559][36157] Sum rewards: 61.550, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.240', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.045', 'AMMO3': '0.193', 'weapon5': '0.194', 'AMMO4': '0.224', 'weapon4': '0.260', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.902', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.131', 'FRAGCOUNT': '54.000'} [2023-02-25 14:44:55,865][36157] DAMAGECOUNT value on done: 1330913.0 [2023-02-25 14:44:55,866][36157] Sum rewards: 71.223, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.502', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.126', 'AMMO4': '0.169', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.254', 'WEAPON4': '0.300', 'weapon4': '0.444', 'WEAPON3': '1.300', 'weapon3': '2.952', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '60.000'} [2023-02-25 14:44:55,966][36142] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:44:56,138][36140] DAMAGECOUNT value on done: 1335542.0 [2023-02-25 14:44:56,139][36140] Sum rewards: 55.375, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.240', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.128', 'AMMO4': '0.176', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'weapon4': '0.314', 'weapon2': '0.454', 'WEAPON3': '1.550', 'weapon3': '2.838', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.528', 'FRAGCOUNT': '50.000'} [2023-02-25 14:44:56,237][36140] DAMAGECOUNT value on done: 1331561.0 [2023-02-25 14:44:56,237][36140] Sum rewards: 63.981, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.262', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon4': '0.150', 'weapon5': '0.160', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.500', 'weapon3': '3.054', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.997', 'FRAGCOUNT': '57.000'} [2023-02-25 14:44:56,450][36140] DAMAGECOUNT value on done: 1316469.0 [2023-02-25 14:44:56,451][36140] Sum rewards: 58.338, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-5.035', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.070', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.244', 'weapon2': '0.284', 'AMMO3': '0.324', 'WEAPON3': '2.050', 'weapon3': '3.124', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '55.000'} [2023-02-25 14:44:56,549][36140] DAMAGECOUNT value on done: 1316150.0 [2023-02-25 14:44:56,550][36140] Sum rewards: 61.020, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.912', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.122', 'weapon2': '0.166', 'AMMO3': '0.256', 'WEAPON3': '1.550', 'HITCOUNT': '3.240', 'weapon3': '3.504', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '53.000'} [2023-02-25 14:44:57,210][36138] Updated weights for policy 0, policy_version 54953 (0.0009) [2023-02-25 14:44:59,328][36142] DAMAGECOUNT value on done: 1323328.0 [2023-02-25 14:44:59,329][36142] Sum rewards: 52.825, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.986', 'ARMOR': '0.008', 'AMMO5': '0.012', 'weapon5': '0.050', 'AMMO2': '0.053', 'weapon7': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.253', 'AMMO4': '0.264', 'weapon2': '0.266', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.542', 'WEAPON3': '1.500', 'weapon3': '2.620', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.181', 'FRAGCOUNT': '50.500'} [2023-02-25 14:44:59,634][36142] DAMAGECOUNT value on done: 1315917.0 [2023-02-25 14:44:59,635][36142] Sum rewards: 67.211, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.684', 'AMMO5': '0.021', 'AMMO2': '0.041', 'weapon5': '0.190', 'AMMO4': '0.203', 'AMMO3': '0.227', 'weapon2': '0.270', 'weapon4': '0.368', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.850', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.645', 'FRAGCOUNT': '58.000'} [2023-02-25 14:44:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13426.5). Total num frames: 225120256. Throughput: 0: 3382.0. Samples: 18774356. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:44:59,730][36114] Avg episode reward: [(0, '60.908')] [2023-02-25 14:44:59,735][36125] Saving new best policy, reward=60.908! [2023-02-25 14:45:00,257][36138] Updated weights for policy 0, policy_version 54963 (0.0010) [2023-02-25 14:45:00,259][36142] DAMAGECOUNT value on done: 1326936.0 [2023-02-25 14:45:00,259][36142] Sum rewards: 59.293, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.762', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon4': '0.204', 'weapon5': '0.214', 'AMMO3': '0.235', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '2.970', 'weapon3': '2.990', 'DAMAGECOUNT': '15.282', 'FRAGCOUNT': '54.000'} [2023-02-25 14:45:00,565][36142] DAMAGECOUNT value on done: 1332633.0 [2023-02-25 14:45:00,566][36142] Sum rewards: 61.392, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.061', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon2': '0.256', 'weapon4': '0.282', 'WEAPON3': '1.100', 'HITCOUNT': '3.020', 'weapon3': '3.096', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '52.000'} [2023-02-25 14:45:01,191][36156] DAMAGECOUNT value on done: 1340148.0 [2023-02-25 14:45:01,191][36156] Sum rewards: 64.588, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.890', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.014', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO3': '0.251', 'weapon2': '0.478', 'WEAPON3': '1.500', 'weapon3': '3.242', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '56.000'} [2023-02-25 14:45:01,485][36156] DAMAGECOUNT value on done: 1320400.0 [2023-02-25 14:45:01,486][36156] Sum rewards: 56.814, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.340', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO4': '0.120', 'AMMO3': '0.205', 'weapon2': '0.212', 'WEAPON4': '0.250', 'weapon4': '0.736', 'WEAPON3': '1.200', 'weapon3': '2.666', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.670', 'FRAGCOUNT': '49.000'} [2023-02-25 14:45:01,500][36156] DAMAGECOUNT value on done: 1335510.0 [2023-02-25 14:45:01,500][36156] Sum rewards: 59.130, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.439', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.140', 'AMMO4': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.210', 'WEAPON4': '0.400', 'weapon4': '0.670', 'WEAPON3': '1.150', 'weapon3': '2.798', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.237', 'FRAGCOUNT': '52.000'} [2023-02-25 14:45:01,809][36156] DAMAGECOUNT value on done: 1324034.0 [2023-02-25 14:45:01,809][36156] Sum rewards: 73.346, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.980', 'AMMO5': '0.017', 'AMMO2': '0.018', 'AMMO4': '0.092', 'AMMO3': '0.157', 'weapon5': '0.226', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.546', 'weapon4': '0.582', 'WEAPON3': '1.000', 'weapon3': '2.376', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '60.000'} [2023-02-25 14:45:03,255][36138] Updated weights for policy 0, policy_version 54973 (0.0010) [2023-02-25 14:45:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13412.7). Total num frames: 225185792. Throughput: 0: 3383.5. Samples: 18794710. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:45:04,730][36114] Avg episode reward: [(0, '61.650')] [2023-02-25 14:45:04,755][36125] Saving new best policy, reward=61.650! [2023-02-25 14:45:06,279][36138] Updated weights for policy 0, policy_version 54983 (0.0009) [2023-02-25 14:45:09,324][36138] Updated weights for policy 0, policy_version 54993 (0.0009) [2023-02-25 14:45:09,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13426.5). Total num frames: 225255424. Throughput: 0: 3387.2. Samples: 18804850. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:45:09,729][36114] Avg episode reward: [(0, '61.650')] [2023-02-25 14:45:10,627][36154] DAMAGECOUNT value on done: 1335618.0 [2023-02-25 14:45:10,628][36154] Sum rewards: 67.310, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.645', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'WEAPON4': '0.250', 'weapon2': '0.258', 'weapon4': '0.616', 'WEAPON3': '0.900', 'weapon3': '2.764', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '55.000'} [2023-02-25 14:45:10,931][36154] DAMAGECOUNT value on done: 1317951.0 [2023-02-25 14:45:10,932][36154] Sum rewards: 71.522, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.870', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.061', 'AMMO3': '0.170', 'weapon5': '0.186', 'AMMO4': '0.304', 'WEAPON5': '0.400', 'weapon2': '0.412', 'WEAPON4': '0.500', 'weapon4': '0.798', 'WEAPON3': '1.050', 'weapon3': '2.322', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '60.000'} [2023-02-25 14:45:11,248][36154] DAMAGECOUNT value on done: 1348200.0 [2023-02-25 14:45:11,248][36154] Sum rewards: 59.295, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.487', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon4': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.178', 'AMMO3': '0.208', 'weapon2': '0.294', 'WEAPON3': '1.150', 'HITCOUNT': '2.880', 'weapon3': '3.204', 'DAMAGECOUNT': '14.844', 'FRAGCOUNT': '50.000'} [2023-02-25 14:45:11,560][36154] DAMAGECOUNT value on done: 1327909.0 [2023-02-25 14:45:11,561][36154] Sum rewards: 60.375, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.160', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.152', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.382', 'weapon2': '0.426', 'WEAPON3': '1.050', 'weapon3': '2.838', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.571', 'FRAGCOUNT': '51.000'} [2023-02-25 14:45:11,705][36155] DAMAGECOUNT value on done: 1331030.0 [2023-02-25 14:45:11,705][36155] Sum rewards: 66.152, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.376', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.051', 'AMMO3': '0.214', 'weapon2': '0.234', 'AMMO4': '0.254', 'weapon5': '0.398', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.718', 'WEAPON3': '1.200', 'weapon3': '2.274', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '57.000'} [2023-02-25 14:45:11,927][36141] DAMAGECOUNT value on done: 1341577.0 [2023-02-25 14:45:11,927][36141] Sum rewards: 75.357, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.747', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon4': '0.360', 'weapon2': '0.376', 'WEAPON3': '1.000', 'weapon3': '2.932', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '60.000'} [2023-02-25 14:45:11,995][36155] DAMAGECOUNT value on done: 1331752.0 [2023-02-25 14:45:11,996][36155] Sum rewards: 45.936, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.166', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.145', 'weapon5': '0.148', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.288', 'weapon2': '0.540', 'WEAPON3': '0.900', 'HITCOUNT': '2.640', 'weapon3': '2.846', 'DAMAGECOUNT': '12.225', 'FRAGCOUNT': '39.500'} [2023-02-25 14:45:12,206][36139] DAMAGECOUNT value on done: 1332950.0 [2023-02-25 14:45:12,207][36139] Sum rewards: 66.594, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.622', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.084', 'weapon5': '0.118', 'AMMO4': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.574', 'WEAPON3': '1.250', 'weapon3': '2.994', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '58.000'} [2023-02-25 14:45:12,233][36141] DAMAGECOUNT value on done: 1336346.0 [2023-02-25 14:45:12,233][36141] Sum rewards: 53.709, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.096', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.034', 'AMMO3': '0.147', 'AMMO4': '0.172', 'weapon2': '0.218', 'weapon5': '0.276', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '0.800', 'weapon4': '0.976', 'weapon3': '2.190', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.100', 'FRAGCOUNT': '45.000'} [2023-02-25 14:45:12,341][36141] DAMAGECOUNT value on done: 1325682.0 [2023-02-25 14:45:12,341][36141] Sum rewards: 62.761, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-1.658', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO4': '0.189', 'AMMO3': '0.240', 'weapon5': '0.262', 'weapon2': '0.402', 'WEAPON5': '0.450', 'weapon4': '0.528', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.464', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '58.000'} [2023-02-25 14:45:12,366][36138] Updated weights for policy 0, policy_version 55003 (0.0009) [2023-02-25 14:45:12,514][36139] DAMAGECOUNT value on done: 1329623.0 [2023-02-25 14:45:12,515][36139] Sum rewards: 69.926, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.880', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO3': '0.187', 'weapon2': '0.190', 'WEAPON3': '1.200', 'HITCOUNT': '3.580', 'weapon3': '3.690', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '56.000'} [2023-02-25 14:45:12,633][36141] DAMAGECOUNT value on done: 1315498.0 [2023-02-25 14:45:12,633][36141] Sum rewards: 44.852, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.690', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon2': '0.144', 'weapon5': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.314', 'weapon4': '0.452', 'WEAPON3': '1.800', 'HITCOUNT': '2.860', 'weapon3': '2.936', 'DAMAGECOUNT': '12.522', 'FRAGCOUNT': '44.000'} [2023-02-25 14:45:12,822][36139] DAMAGECOUNT value on done: 1342526.0 [2023-02-25 14:45:12,822][36139] Sum rewards: 53.283, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.608', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.168', 'AMMO3': '0.176', 'weapon5': '0.180', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON4': '0.400', 'ARMOR': '0.491', 'weapon4': '0.860', 'WEAPON3': '1.050', 'weapon3': '2.284', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.863', 'FRAGCOUNT': '46.000'} [2023-02-25 14:45:12,898][36155] DAMAGECOUNT value on done: 1345740.0 [2023-02-25 14:45:12,898][36155] Sum rewards: 56.082, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.138', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.124', 'AMMO4': '0.146', 'weapon4': '0.156', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.200', 'HITCOUNT': '2.610', 'weapon3': '2.992', 'DAMAGECOUNT': '14.883', 'FRAGCOUNT': '49.000'} [2023-02-25 14:45:13,129][36139] DAMAGECOUNT value on done: 1338254.0 [2023-02-25 14:45:13,130][36139] Sum rewards: 58.075, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.842', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.051', 'AMMO3': '0.222', 'AMMO4': '0.253', 'weapon5': '0.270', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.468', 'weapon4': '0.704', 'WEAPON3': '1.300', 'weapon3': '2.202', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.974', 'FRAGCOUNT': '50.000'} [2023-02-25 14:45:13,211][36155] DAMAGECOUNT value on done: 1326366.0 [2023-02-25 14:45:13,211][36155] Sum rewards: 56.334, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.975', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.254', 'weapon4': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.810', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.744', 'FRAGCOUNT': '49.500'} [2023-02-25 14:45:14,729][36114] Fps is (10 sec: 13516.5, 60 sec: 13516.7, 300 sec: 13426.5). Total num frames: 225320960. Throughput: 0: 3385.4. Samples: 18825210. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:45:14,730][36114] Avg episode reward: [(0, '61.510')] [2023-02-25 14:45:14,793][36157] DAMAGECOUNT value on done: 1341440.0 [2023-02-25 14:45:14,793][36157] Sum rewards: 65.625, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.785', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon5': '0.160', 'AMMO3': '0.162', 'AMMO4': '0.167', 'WEAPON5': '0.350', 'weapon2': '0.362', 'WEAPON4': '0.450', 'weapon4': '0.710', 'WEAPON3': '1.050', 'weapon3': '2.484', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '54.000'} [2023-02-25 14:45:15,100][36157] DAMAGECOUNT value on done: 1329484.0 [2023-02-25 14:45:15,100][36157] Sum rewards: 59.112, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.127', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.094', 'AMMO4': '0.198', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON4': '0.350', 'weapon4': '0.618', 'WEAPON3': '1.400', 'weapon3': '2.768', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.781', 'FRAGCOUNT': '54.000'} [2023-02-25 14:45:15,371][36157] DAMAGECOUNT value on done: 1341062.0 [2023-02-25 14:45:15,372][36157] Sum rewards: 56.507, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.990', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.174', 'AMMO4': '0.180', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'weapon4': '0.252', 'WEAPON4': '0.350', 'weapon2': '0.544', 'WEAPON3': '1.250', 'weapon3': '2.768', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.366', 'FRAGCOUNT': '49.000'} [2023-02-25 14:45:15,394][36138] Updated weights for policy 0, policy_version 55013 (0.0009) [2023-02-25 14:45:15,676][36157] DAMAGECOUNT value on done: 1335644.0 [2023-02-25 14:45:15,677][36157] Sum rewards: 55.036, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.209', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'weapon5': '0.118', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon4': '0.280', 'weapon2': '0.346', 'WEAPON3': '1.150', 'HITCOUNT': '3.020', 'weapon3': '3.058', 'DAMAGECOUNT': '14.193', 'FRAGCOUNT': '47.000'} [2023-02-25 14:45:15,975][36140] DAMAGECOUNT value on done: 1340645.0 [2023-02-25 14:45:15,976][36140] Sum rewards: 56.635, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.496', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.195', 'weapon5': '0.282', 'WEAPON5': '0.300', 'weapon4': '0.396', 'WEAPON4': '0.400', 'weapon2': '0.474', 'WEAPON3': '1.200', 'weapon3': '2.520', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.309', 'FRAGCOUNT': '49.000'} [2023-02-25 14:45:16,055][36140] DAMAGECOUNT value on done: 1337712.0 [2023-02-25 14:45:16,056][36140] Sum rewards: 68.943, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.420', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'weapon2': '0.210', 'AMMO3': '0.274', 'weapon4': '0.304', 'ARMOR': '0.500', 'WEAPON3': '1.700', 'weapon3': '3.206', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '61.000'} [2023-02-25 14:45:16,302][36140] DAMAGECOUNT value on done: 1322014.0 [2023-02-25 14:45:16,302][36140] Sum rewards: 61.298, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.375', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon5': '0.178', 'AMMO3': '0.186', 'weapon2': '0.230', 'weapon4': '0.292', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.098', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '52.000'} [2023-02-25 14:45:16,371][36140] DAMAGECOUNT value on done: 1321420.0 [2023-02-25 14:45:16,371][36140] Sum rewards: 63.381, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.744', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.042', 'AMMO4': '0.065', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.158', 'AMMO3': '0.242', 'weapon2': '0.428', 'WEAPON3': '1.400', 'HITCOUNT': '3.040', 'weapon3': '3.120', 'DAMAGECOUNT': '15.810', 'FRAGCOUNT': '56.000'} [2023-02-25 14:45:18,430][36138] Updated weights for policy 0, policy_version 55023 (0.0009) [2023-02-25 14:45:19,117][36142] DAMAGECOUNT value on done: 1327488.0 [2023-02-25 14:45:19,118][36142] Sum rewards: 44.495, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.184', 'AMMO5': '0.018', 'AMMO2': '0.047', 'AMMO3': '0.157', 'weapon5': '0.182', 'AMMO4': '0.233', 'WEAPON5': '0.450', 'weapon4': '0.526', 'WEAPON4': '0.550', 'weapon2': '0.588', 'WEAPON3': '0.900', 'weapon3': '2.418', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '12.480', 'FRAGCOUNT': '39.500'} [2023-02-25 14:45:19,426][36142] DAMAGECOUNT value on done: 1320526.0 [2023-02-25 14:45:19,427][36142] Sum rewards: 54.870, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.804', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.148', 'AMMO3': '0.164', 'AMMO4': '0.208', 'weapon2': '0.308', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.500', 'WEAPON3': '0.900', 'weapon3': '2.810', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.827', 'FRAGCOUNT': '46.500'} [2023-02-25 14:45:19,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13426.6). Total num frames: 225390592. Throughput: 0: 3387.0. Samples: 18845478. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:45:19,730][36114] Avg episode reward: [(0, '61.730')] [2023-02-25 14:45:19,733][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000055027_225390592.pth... [2023-02-25 14:45:19,790][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000054239_222162944.pth [2023-02-25 14:45:19,794][36125] Saving new best policy, reward=61.730! [2023-02-25 14:45:20,068][36142] DAMAGECOUNT value on done: 1332046.0 [2023-02-25 14:45:20,068][36142] Sum rewards: 59.207, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.288', 'AMMO5': '0.003', 'weapon5': '0.018', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.092', 'weapon4': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.252', 'weapon2': '0.368', 'WEAPON3': '1.500', 'weapon3': '3.156', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '53.000'} [2023-02-25 14:45:20,374][36142] DAMAGECOUNT value on done: 1338178.0 [2023-02-25 14:45:20,375][36142] Sum rewards: 63.637, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.848', 'AMMO2': '0.004', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.019', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.246', 'weapon4': '0.330', 'weapon2': '0.348', 'WEAPON3': '1.500', 'weapon3': '2.992', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '55.000'} [2023-02-25 14:45:21,196][36156] DAMAGECOUNT value on done: 1345128.0 [2023-02-25 14:45:21,197][36156] Sum rewards: 60.707, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.808', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO3': '0.169', 'weapon5': '0.170', 'AMMO4': '0.207', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON4': '0.450', 'weapon4': '0.752', 'WEAPON3': '1.100', 'weapon3': '2.514', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.940', 'FRAGCOUNT': '53.000'} [2023-02-25 14:45:21,317][36156] DAMAGECOUNT value on done: 1340755.0 [2023-02-25 14:45:21,318][36156] Sum rewards: 53.647, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-1.464', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon5': '0.198', 'AMMO4': '0.229', 'AMMO3': '0.242', 'weapon2': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.750', 'WEAPON3': '1.400', 'weapon3': '2.392', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '15.705', 'FRAGCOUNT': '49.000'} [2023-02-25 14:45:21,430][36138] Updated weights for policy 0, policy_version 55033 (0.0009) [2023-02-25 14:45:21,511][36156] DAMAGECOUNT value on done: 1325793.0 [2023-02-25 14:45:21,512][36156] Sum rewards: 65.821, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.902', 'AMMO5': '0.003', 'AMMO2': '0.003', 'ARMOR': '0.004', 'AMMO4': '0.013', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.066', 'weapon4': '0.166', 'AMMO3': '0.187', 'weapon2': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.200', 'weapon3': '3.252', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '54.000'} [2023-02-25 14:45:21,625][36156] DAMAGECOUNT value on done: 1327959.0 [2023-02-25 14:45:21,626][36156] Sum rewards: 43.758, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.540', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon2': '0.146', 'AMMO4': '0.159', 'weapon5': '0.178', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.606', 'WEAPON3': '1.400', 'HITCOUNT': '2.530', 'weapon3': '2.724', 'DAMAGECOUNT': '11.775', 'FRAGCOUNT': '41.000'} [2023-02-25 14:45:24,464][36138] Updated weights for policy 0, policy_version 55043 (0.0009) [2023-02-25 14:45:24,729][36114] Fps is (10 sec: 13517.1, 60 sec: 13516.8, 300 sec: 13426.5). Total num frames: 225456128. Throughput: 0: 3384.5. Samples: 18855554. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:45:24,730][36114] Avg episode reward: [(0, '61.674')] [2023-02-25 14:45:27,489][36138] Updated weights for policy 0, policy_version 55053 (0.0009) [2023-02-25 14:45:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13440.4). Total num frames: 225525760. Throughput: 0: 3385.3. Samples: 18875848. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:45:29,730][36114] Avg episode reward: [(0, '61.674')] [2023-02-25 14:45:30,504][36154] DAMAGECOUNT value on done: 1340773.0 [2023-02-25 14:45:30,505][36154] Sum rewards: 60.156, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.678', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'weapon5': '0.140', 'weapon2': '0.214', 'WEAPON4': '0.250', 'AMMO3': '0.253', 'WEAPON3': '1.600', 'HITCOUNT': '2.980', 'weapon3': '3.342', 'DAMAGECOUNT': '15.465', 'FRAGCOUNT': '55.000'} [2023-02-25 14:45:30,533][36138] Updated weights for policy 0, policy_version 55063 (0.0009) [2023-02-25 14:45:30,819][36154] DAMAGECOUNT value on done: 1322324.0 [2023-02-25 14:45:30,820][36154] Sum rewards: 52.946, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.786', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.072', 'AMMO4': '0.086', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon4': '0.370', 'weapon2': '0.634', 'WEAPON3': '1.100', 'weapon3': '2.598', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '13.119', 'FRAGCOUNT': '47.000'} [2023-02-25 14:45:31,132][36154] DAMAGECOUNT value on done: 1353526.0 [2023-02-25 14:45:31,133][36154] Sum rewards: 52.876, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-5.418', 'ARMOR': '0.012', 'AMMO5': '0.020', 'AMMO2': '0.076', 'AMMO3': '0.292', 'weapon5': '0.292', 'AMMO4': '0.379', 'weapon2': '0.394', 'WEAPON5': '0.550', 'WEAPON4': '0.750', 'weapon4': '0.818', 'WEAPON3': '1.700', 'weapon3': '2.062', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '52.000'} [2023-02-25 14:45:31,433][36154] DAMAGECOUNT value on done: 1333078.0 [2023-02-25 14:45:31,434][36154] Sum rewards: 65.976, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.235', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon5': '0.116', 'AMMO3': '0.179', 'AMMO4': '0.254', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON4': '0.400', 'weapon4': '0.770', 'WEAPON3': '1.100', 'weapon3': '2.450', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '58.000'} [2023-02-25 14:45:31,588][36155] DAMAGECOUNT value on done: 1336727.0 [2023-02-25 14:45:31,588][36155] Sum rewards: 64.999, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.160', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon5': '0.098', 'AMMO4': '0.101', 'AMMO3': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.320', 'weapon4': '0.356', 'WEAPON3': '1.450', 'weapon3': '2.940', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '58.000'} [2023-02-25 14:45:31,712][36139] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:45:31,900][36155] DAMAGECOUNT value on done: 1337331.0 [2023-02-25 14:45:31,900][36155] Sum rewards: 66.954, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.766', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.110', 'weapon5': '0.152', 'AMMO4': '0.175', 'AMMO3': '0.202', 'weapon2': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.000', 'weapon3': '3.268', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '57.000'} [2023-02-25 14:45:31,920][36141] DAMAGECOUNT value on done: 1346835.0 [2023-02-25 14:45:31,921][36141] Sum rewards: 61.079, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.750', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.168', 'AMMO3': '0.207', 'AMMO4': '0.228', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.358', 'weapon2': '0.488', 'WEAPON3': '1.150', 'weapon3': '2.770', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.774', 'FRAGCOUNT': '52.000'} [2023-02-25 14:45:32,127][36139] DAMAGECOUNT value on done: 1337816.0 [2023-02-25 14:45:32,128][36139] Sum rewards: 57.288, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.185', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.074', 'AMMO4': '0.160', 'weapon5': '0.162', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.484', 'WEAPON3': '1.200', 'weapon3': '3.016', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.598', 'FRAGCOUNT': '50.000'} [2023-02-25 14:45:32,245][36141] DAMAGECOUNT value on done: 1341745.0 [2023-02-25 14:45:32,245][36141] Sum rewards: 56.315, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.030', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.258', 'weapon2': '0.270', 'weapon4': '0.348', 'WEAPON3': '1.500', 'HITCOUNT': '2.970', 'weapon3': '3.030', 'DAMAGECOUNT': '16.197', 'FRAGCOUNT': '49.000'} [2023-02-25 14:45:32,403][36141] DAMAGECOUNT value on done: 1331403.0 [2023-02-25 14:45:32,403][36141] Sum rewards: 68.199, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.536', 'AMMO2': '0.011', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'weapon2': '0.200', 'AMMO3': '0.258', 'WEAPON3': '1.450', 'HITCOUNT': '3.390', 'weapon3': '3.610', 'DAMAGECOUNT': '17.163', 'FRAGCOUNT': '59.000'} [2023-02-25 14:45:32,428][36139] DAMAGECOUNT value on done: 1334549.0 [2023-02-25 14:45:32,428][36139] Sum rewards: 54.184, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.220', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.144', 'AMMO4': '0.168', 'weapon4': '0.196', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.080', 'weapon3': '3.168', 'DAMAGECOUNT': '14.778', 'FRAGCOUNT': '50.000'} [2023-02-25 14:45:32,718][36141] DAMAGECOUNT value on done: 1320985.0 [2023-02-25 14:45:32,718][36141] Sum rewards: 66.343, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.920', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.094', 'AMMO3': '0.175', 'AMMO4': '0.182', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.366', 'weapon2': '0.614', 'WEAPON3': '1.100', 'weapon3': '2.668', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '56.000'} [2023-02-25 14:45:32,720][36139] DAMAGECOUNT value on done: 1347948.0 [2023-02-25 14:45:32,720][36139] Sum rewards: 65.158, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.434', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.112', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon2': '0.374', 'weapon4': '0.420', 'WEAPON3': '1.350', 'weapon3': '2.842', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '58.000'} [2023-02-25 14:45:32,785][36155] DAMAGECOUNT value on done: 1351032.0 [2023-02-25 14:45:32,785][36155] Sum rewards: 60.309, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.666', 'AMMO5': '0.015', 'AMMO2': '0.050', 'AMMO3': '0.169', 'weapon4': '0.250', 'AMMO4': '0.251', 'weapon5': '0.342', 'weapon2': '0.364', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.678', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.876', 'FRAGCOUNT': '51.000'} [2023-02-25 14:45:33,016][36139] DAMAGECOUNT value on done: 1343354.0 [2023-02-25 14:45:33,017][36139] Sum rewards: 54.618, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.216', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.108', 'WEAPON5': '0.150', 'weapon2': '0.160', 'AMMO4': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.312', 'weapon4': '0.508', 'WEAPON3': '1.800', 'weapon3': '2.892', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '50.000'} [2023-02-25 14:45:33,094][36155] DAMAGECOUNT value on done: 1331805.0 [2023-02-25 14:45:33,095][36155] Sum rewards: 64.135, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.752', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.032', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'AMMO4': '0.161', 'weapon2': '0.340', 'WEAPON4': '0.400', 'weapon4': '0.872', 'WEAPON3': '1.100', 'weapon3': '2.504', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '54.000'} [2023-02-25 14:45:33,167][36142] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:45:33,612][36138] Updated weights for policy 0, policy_version 55073 (0.0009) [2023-02-25 14:45:34,726][36157] DAMAGECOUNT value on done: 1346594.0 [2023-02-25 14:45:34,727][36157] Sum rewards: 63.149, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.558', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.151', 'weapon2': '0.158', 'AMMO3': '0.247', 'weapon4': '0.344', 'WEAPON3': '1.300', 'weapon3': '3.176', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.432', 'FRAGCOUNT': '55.000'} [2023-02-25 14:45:34,729][36114] Fps is (10 sec: 13516.6, 60 sec: 13516.8, 300 sec: 13440.4). Total num frames: 225591296. Throughput: 0: 3379.2. Samples: 18896066. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:45:34,730][36114] Avg episode reward: [(0, '61.069')] [2023-02-25 14:45:35,012][36157] DAMAGECOUNT value on done: 1335781.0 [2023-02-25 14:45:35,013][36157] Sum rewards: 78.570, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.734', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.122', 'AMMO4': '0.170', 'AMMO3': '0.181', 'weapon2': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'ARMOR': '0.459', 'weapon4': '0.494', 'WEAPON3': '1.050', 'weapon3': '2.900', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.891', 'FRAGCOUNT': '64.000'} [2023-02-25 14:45:35,298][36157] DAMAGECOUNT value on done: 1345974.0 [2023-02-25 14:45:35,299][36157] Sum rewards: 54.158, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.670', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.166', 'weapon2': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.259', 'weapon4': '0.592', 'WEAPON3': '1.450', 'weapon3': '2.828', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.736', 'FRAGCOUNT': '47.000'} [2023-02-25 14:45:35,605][36157] DAMAGECOUNT value on done: 1341290.0 [2023-02-25 14:45:35,606][36157] Sum rewards: 72.702, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.035', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.035', 'weapon5': '0.040', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.183', 'weapon2': '0.390', 'WEAPON3': '1.250', 'HITCOUNT': '3.300', 'weapon3': '3.374', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '61.000'} [2023-02-25 14:45:35,987][36140] DAMAGECOUNT value on done: 1345447.0 [2023-02-25 14:45:35,988][36140] Sum rewards: 49.861, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.203', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.057', 'AMMO3': '0.242', 'AMMO4': '0.286', 'weapon2': '0.288', 'weapon5': '0.376', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'weapon4': '0.688', 'WEAPON3': '1.450', 'weapon3': '2.214', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.406', 'FRAGCOUNT': '47.000'} [2023-02-25 14:45:36,059][36140] DAMAGECOUNT value on done: 1342787.0 [2023-02-25 14:45:36,059][36140] Sum rewards: 59.960, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.612', 'AMMO5': '0.003', 'AMMO2': '0.039', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.195', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon2': '0.280', 'weapon4': '0.340', 'ARMOR': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '3.100', 'weapon3': '3.154', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '53.000'} [2023-02-25 14:45:36,294][36140] DAMAGECOUNT value on done: 1327400.0 [2023-02-25 14:45:36,295][36140] Sum rewards: 58.799, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.220', 'AMMO5': '0.016', 'AMMO2': '0.043', 'AMMO4': '0.215', 'AMMO3': '0.219', 'weapon5': '0.272', 'weapon2': '0.314', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.594', 'WEAPON3': '1.250', 'weapon3': '2.428', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '52.500'} [2023-02-25 14:45:36,367][36140] DAMAGECOUNT value on done: 1326636.0 [2023-02-25 14:45:36,367][36140] Sum rewards: 59.654, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.719', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.142', 'weapon5': '0.174', 'WEAPON5': '0.250', 'weapon2': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '0.800', 'weapon4': '0.822', 'weapon3': '2.548', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '48.000'} [2023-02-25 14:45:36,593][36138] Updated weights for policy 0, policy_version 55083 (0.0009) [2023-02-25 14:45:39,009][36142] DAMAGECOUNT value on done: 1332079.0 [2023-02-25 14:45:39,009][36142] Sum rewards: 57.694, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.030', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon4': '0.114', 'weapon5': '0.124', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.564', 'WEAPON3': '1.050', 'HITCOUNT': '2.880', 'weapon3': '3.054', 'DAMAGECOUNT': '13.773', 'FRAGCOUNT': '48.000'} [2023-02-25 14:45:39,323][36142] DAMAGECOUNT value on done: 1325432.0 [2023-02-25 14:45:39,324][36142] Sum rewards: 54.562, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.432', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.029', 'weapon5': '0.086', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'weapon2': '0.246', 'AMMO3': '0.272', 'WEAPON4': '0.350', 'weapon4': '0.768', 'WEAPON3': '1.600', 'weapon3': '2.664', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.718', 'FRAGCOUNT': '51.000'} [2023-02-25 14:45:39,599][36138] Updated weights for policy 0, policy_version 55093 (0.0009) [2023-02-25 14:45:39,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13440.4). Total num frames: 225660928. Throughput: 0: 3382.8. Samples: 18906292. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:45:39,730][36114] Avg episode reward: [(0, '60.956')] [2023-02-25 14:45:39,942][36142] DAMAGECOUNT value on done: 1338010.0 [2023-02-25 14:45:39,942][36142] Sum rewards: 69.285, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.832', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'weapon5': '0.174', 'AMMO3': '0.190', 'weapon2': '0.212', 'WEAPON4': '0.300', 'weapon4': '0.422', 'WEAPON3': '1.150', 'weapon3': '2.982', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '59.000'} [2023-02-25 14:45:40,243][36142] DAMAGECOUNT value on done: 1343938.0 [2023-02-25 14:45:40,243][36142] Sum rewards: 67.243, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.371', 'ARMOR': '0.012', 'AMMO5': '0.019', 'AMMO2': '0.065', 'AMMO3': '0.142', 'weapon5': '0.282', 'AMMO4': '0.324', 'WEAPON5': '0.400', 'weapon2': '0.420', 'WEAPON4': '0.600', 'weapon4': '0.804', 'WEAPON3': '0.900', 'weapon3': '2.178', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '57.000'} [2023-02-25 14:45:41,128][36156] DAMAGECOUNT value on done: 1351479.0 [2023-02-25 14:45:41,128][36156] Sum rewards: 72.469, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.740', 'AMMO5': '0.009', 'weapon5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.117', 'WEAPON5': '0.200', 'weapon2': '0.206', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'weapon4': '0.334', 'WEAPON3': '1.300', 'weapon3': '3.256', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.732', 'FRAGCOUNT': '61.000'} [2023-02-25 14:45:41,258][36156] DAMAGECOUNT value on done: 1345823.0 [2023-02-25 14:45:41,259][36156] Sum rewards: 60.308, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.043', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.168', 'AMMO3': '0.204', 'weapon4': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.596', 'WEAPON3': '1.250', 'weapon3': '2.690', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.204', 'FRAGCOUNT': '53.000'} [2023-02-25 14:45:41,441][36156] DAMAGECOUNT value on done: 1331217.0 [2023-02-25 14:45:41,442][36156] Sum rewards: 58.404, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.299', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.174', 'weapon2': '0.202', 'AMMO3': '0.228', 'weapon4': '0.306', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.018', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '50.000'} [2023-02-25 14:45:41,569][36156] DAMAGECOUNT value on done: 1333217.0 [2023-02-25 14:45:41,570][36156] Sum rewards: 68.274, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'AMMO3': '0.139', 'weapon5': '0.144', 'WEAPON4': '0.150', 'AMMO4': '0.165', 'weapon2': '0.252', 'HEALTH': '0.324', 'weapon4': '0.614', 'WEAPON3': '0.800', 'weapon3': '2.822', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.774', 'FRAGCOUNT': '55.000'} [2023-02-25 14:45:42,618][36138] Updated weights for policy 0, policy_version 55103 (0.0010) [2023-02-25 14:45:43,505][36139] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:45:44,729][36114] Fps is (10 sec: 13926.6, 60 sec: 13585.1, 300 sec: 13454.3). Total num frames: 225730560. Throughput: 0: 3385.8. Samples: 18926716. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:45:44,730][36114] Avg episode reward: [(0, '60.947')] [2023-02-25 14:45:45,604][36138] Updated weights for policy 0, policy_version 55113 (0.0009) [2023-02-25 14:45:48,627][36138] Updated weights for policy 0, policy_version 55123 (0.0009) [2023-02-25 14:45:49,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13454.3). Total num frames: 225796096. Throughput: 0: 3387.7. Samples: 18947158. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:45:49,729][36114] Avg episode reward: [(0, '60.947')] [2023-02-25 14:45:50,183][36154] DAMAGECOUNT value on done: 1346475.0 [2023-02-25 14:45:50,184][36154] Sum rewards: 69.477, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.360', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.158', 'AMMO3': '0.209', 'weapon2': '0.304', 'WEAPON3': '1.200', 'HITCOUNT': '3.180', 'weapon3': '3.248', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '59.000'} [2023-02-25 14:45:50,477][36154] DAMAGECOUNT value on done: 1326764.0 [2023-02-25 14:45:50,477][36154] Sum rewards: 50.894, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.490', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon5': '0.030', 'AMMO4': '0.080', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon4': '0.226', 'WEAPON4': '0.250', 'weapon2': '0.680', 'WEAPON3': '1.150', 'weapon3': '2.838', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.320', 'FRAGCOUNT': '45.000'} [2023-02-25 14:45:50,792][36154] DAMAGECOUNT value on done: 1358604.0 [2023-02-25 14:45:50,792][36154] Sum rewards: 59.438, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.332', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.016', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.215', 'weapon2': '0.590', 'WEAPON3': '1.250', 'HITCOUNT': '3.140', 'weapon3': '3.184', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '52.000'} [2023-02-25 14:45:51,106][36154] DAMAGECOUNT value on done: 1338318.0 [2023-02-25 14:45:51,106][36154] Sum rewards: 67.326, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.830', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.048', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'weapon2': '0.138', 'WEAPON4': '0.150', 'weapon4': '0.174', 'AMMO3': '0.200', 'WEAPON3': '1.300', 'HITCOUNT': '3.240', 'weapon3': '3.494', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '58.000'} [2023-02-25 14:45:51,262][36155] DAMAGECOUNT value on done: 1341638.0 [2023-02-25 14:45:51,263][36155] Sum rewards: 52.257, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.690', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.138', 'AMMO3': '0.184', 'weapon5': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.504', 'weapon2': '0.778', 'WEAPON3': '1.100', 'weapon3': '2.284', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.733', 'FRAGCOUNT': '44.000'} [2023-02-25 14:45:51,573][36155] DAMAGECOUNT value on done: 1341622.0 [2023-02-25 14:45:51,573][36155] Sum rewards: 46.444, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.231', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.100', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon4': '0.384', 'weapon2': '0.454', 'WEAPON3': '1.150', 'HITCOUNT': '2.680', 'weapon3': '2.854', 'DAMAGECOUNT': '12.873', 'FRAGCOUNT': '40.000'} [2023-02-25 14:45:51,637][36138] Updated weights for policy 0, policy_version 55133 (0.0010) [2023-02-25 14:45:51,662][36141] DAMAGECOUNT value on done: 1352186.0 [2023-02-25 14:45:51,663][36141] Sum rewards: 55.605, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.180', 'AMMO5': '0.014', 'AMMO2': '0.038', 'AMMO4': '0.191', 'AMMO3': '0.222', 'weapon5': '0.232', 'weapon2': '0.262', 'weapon4': '0.302', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.850', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '49.000'} [2023-02-25 14:45:51,704][36139] DAMAGECOUNT value on done: 1342816.0 [2023-02-25 14:45:51,705][36139] Sum rewards: 55.891, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.635', 'AMMO5': '0.018', 'AMMO2': '0.037', 'AMMO4': '0.184', 'AMMO3': '0.224', 'weapon2': '0.252', 'weapon4': '0.298', 'weapon5': '0.336', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.766', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '50.000'} [2023-02-25 14:45:51,961][36141] DAMAGECOUNT value on done: 1346987.0 [2023-02-25 14:45:51,962][36141] Sum rewards: 58.216, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.775', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon2': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.268', 'weapon4': '0.334', 'WEAPON3': '1.600', 'HITCOUNT': '3.270', 'weapon3': '3.312', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '52.000'} [2023-02-25 14:45:52,008][36139] DAMAGECOUNT value on done: 1339581.0 [2023-02-25 14:45:52,008][36139] Sum rewards: 59.612, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.415', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.136', 'AMMO3': '0.174', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.402', 'weapon4': '0.682', 'WEAPON3': '1.050', 'weapon3': '2.392', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.096', 'FRAGCOUNT': '51.000'} [2023-02-25 14:45:52,049][36141] DAMAGECOUNT value on done: 1336548.0 [2023-02-25 14:45:52,049][36141] Sum rewards: 55.918, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.866', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon5': '0.120', 'AMMO3': '0.158', 'AMMO4': '0.211', 'WEAPON5': '0.300', 'weapon2': '0.344', 'weapon4': '0.438', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.888', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.435', 'FRAGCOUNT': '47.500'} [2023-02-25 14:45:52,260][36139] DAMAGECOUNT value on done: 1352823.0 [2023-02-25 14:45:52,260][36139] Sum rewards: 60.681, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.930', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.020', 'AMMO4': '0.067', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon2': '0.586', 'weapon4': '0.642', 'WEAPON3': '1.050', 'weapon3': '2.572', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.625', 'FRAGCOUNT': '50.000'} [2023-02-25 14:45:52,355][36141] DAMAGECOUNT value on done: 1325254.0 [2023-02-25 14:45:52,356][36141] Sum rewards: 51.934, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.764', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.122', 'weapon2': '0.156', 'AMMO4': '0.160', 'AMMO3': '0.177', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.778', 'WEAPON3': '1.100', 'weapon3': '2.726', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.807', 'FRAGCOUNT': '45.000'} [2023-02-25 14:45:52,475][36155] DAMAGECOUNT value on done: 1355851.0 [2023-02-25 14:45:52,476][36155] Sum rewards: 54.323, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.234', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.078', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.172', 'AMMO3': '0.222', 'weapon2': '0.512', 'WEAPON3': '1.350', 'weapon3': '3.000', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.457', 'FRAGCOUNT': '49.000'} [2023-02-25 14:45:52,579][36139] DAMAGECOUNT value on done: 1348923.0 [2023-02-25 14:45:52,579][36139] Sum rewards: 56.588, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.121', 'AMMO5': '0.013', 'AMMO2': '0.039', 'AMMO3': '0.140', 'AMMO4': '0.196', 'weapon5': '0.286', 'WEAPON5': '0.350', 'ARMOR': '0.453', 'WEAPON4': '0.500', 'weapon2': '0.508', 'weapon4': '0.616', 'WEAPON3': '0.900', 'weapon3': '2.286', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '16.692', 'FRAGCOUNT': '45.500'} [2023-02-25 14:45:52,794][36155] DAMAGECOUNT value on done: 1336936.0 [2023-02-25 14:45:52,794][36155] Sum rewards: 61.993, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.576', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.046', 'AMMO4': '0.056', 'weapon5': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.270', 'weapon2': '0.418', 'WEAPON3': '1.500', 'HITCOUNT': '3.120', 'weapon3': '3.236', 'DAMAGECOUNT': '15.393', 'FRAGCOUNT': '55.000'} [2023-02-25 14:45:54,518][36157] DAMAGECOUNT value on done: 1351860.0 [2023-02-25 14:45:54,518][36157] Sum rewards: 59.910, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.790', 'AMMO2': '0.005', 'AMMO4': '0.024', 'WEAPON4': '0.100', 'AMMO3': '0.252', 'weapon4': '0.280', 'weapon2': '0.456', 'WEAPON3': '1.500', 'weapon3': '3.080', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.633', 'FRAGCOUNT': '53.000'} [2023-02-25 14:45:54,639][36138] Updated weights for policy 0, policy_version 55143 (0.0009) [2023-02-25 14:45:54,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13585.1, 300 sec: 13454.3). Total num frames: 225865728. Throughput: 0: 3388.8. Samples: 18957344. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:45:54,730][36114] Avg episode reward: [(0, '60.409')] [2023-02-25 14:45:54,824][36157] DAMAGECOUNT value on done: 1341114.0 [2023-02-25 14:45:54,824][36157] Sum rewards: 51.768, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.516', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.057', 'AMMO3': '0.137', 'weapon2': '0.240', 'AMMO4': '0.287', 'weapon5': '0.382', 'WEAPON5': '0.500', 'WEAPON4': '0.750', 'WEAPON3': '0.800', 'weapon4': '1.272', 'weapon3': '1.784', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '43.000'} [2023-02-25 14:45:55,106][36157] DAMAGECOUNT value on done: 1350315.0 [2023-02-25 14:45:55,107][36157] Sum rewards: 50.653, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.987', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO3': '0.117', 'AMMO4': '0.124', 'weapon5': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.310', 'weapon4': '0.416', 'WEAPON3': '0.800', 'HITCOUNT': '2.710', 'weapon3': '2.940', 'DAMAGECOUNT': '13.023', 'FRAGCOUNT': '41.000'} [2023-02-25 14:45:55,412][36157] DAMAGECOUNT value on done: 1346120.0 [2023-02-25 14:45:55,413][36157] Sum rewards: 56.680, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.905', 'AMMO5': '0.007', 'AMMO2': '0.030', 'AMMO4': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon5': '0.212', 'WEAPON4': '0.300', 'weapon2': '0.444', 'weapon4': '0.476', 'WEAPON3': '1.300', 'weapon3': '2.654', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.490', 'FRAGCOUNT': '51.000'} [2023-02-25 14:45:55,692][36140] DAMAGECOUNT value on done: 1351261.0 [2023-02-25 14:45:55,692][36140] Sum rewards: 63.534, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.732', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.184', 'AMMO4': '0.197', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.256', 'WEAPON4': '0.300', 'weapon4': '0.506', 'WEAPON3': '1.250', 'weapon3': '2.774', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.442', 'FRAGCOUNT': '55.000'} [2023-02-25 14:45:55,763][36140] DAMAGECOUNT value on done: 1348213.0 [2023-02-25 14:45:55,764][36140] Sum rewards: 58.336, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.313', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.057', 'AMMO3': '0.186', 'weapon2': '0.222', 'AMMO4': '0.283', 'weapon5': '0.398', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'weapon4': '0.948', 'WEAPON3': '1.050', 'weapon3': '2.076', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.278', 'FRAGCOUNT': '50.500'} [2023-02-25 14:45:55,989][36140] DAMAGECOUNT value on done: 1332472.0 [2023-02-25 14:45:55,990][36140] Sum rewards: 60.078, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.008', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO4': '0.181', 'weapon5': '0.192', 'AMMO3': '0.198', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.416', 'weapon4': '0.566', 'WEAPON3': '1.250', 'weapon3': '2.526', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.216', 'FRAGCOUNT': '52.000'} [2023-02-25 14:45:56,065][36140] DAMAGECOUNT value on done: 1331610.0 [2023-02-25 14:45:56,066][36140] Sum rewards: 55.230, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.718', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO4': '0.183', 'AMMO3': '0.235', 'weapon5': '0.242', 'weapon2': '0.350', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.402', 'WEAPON3': '1.450', 'weapon3': '2.678', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.922', 'FRAGCOUNT': '51.000'} [2023-02-25 14:45:57,621][36138] Updated weights for policy 0, policy_version 55153 (0.0009) [2023-02-25 14:45:58,888][36142] DAMAGECOUNT value on done: 1337156.0 [2023-02-25 14:45:58,889][36142] Sum rewards: 58.396, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.500', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon4': '0.042', 'weapon5': '0.118', 'AMMO4': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.253', 'weapon2': '0.340', 'WEAPON3': '1.550', 'HITCOUNT': '3.160', 'weapon3': '3.258', 'DAMAGECOUNT': '15.231', 'FRAGCOUNT': '53.000'} [2023-02-25 14:45:59,208][36142] DAMAGECOUNT value on done: 1330254.0 [2023-02-25 14:45:59,209][36142] Sum rewards: 57.442, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.351', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.031', 'AMMO3': '0.149', 'AMMO4': '0.157', 'weapon5': '0.160', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.632', 'weapon2': '0.756', 'WEAPON3': '0.950', 'weapon3': '2.176', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.466', 'FRAGCOUNT': '47.000'} [2023-02-25 14:45:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13454.3). Total num frames: 225931264. Throughput: 0: 3389.8. Samples: 18977750. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:45:59,730][36114] Avg episode reward: [(0, '59.795')] [2023-02-25 14:45:59,826][36142] DAMAGECOUNT value on done: 1343343.0 [2023-02-25 14:45:59,827][36142] Sum rewards: 55.921, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.351', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.354', 'weapon4': '0.478', 'WEAPON3': '1.300', 'weapon3': '2.762', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '49.000'} [2023-02-25 14:46:00,135][36142] DAMAGECOUNT value on done: 1349136.0 [2023-02-25 14:46:00,135][36142] Sum rewards: 58.957, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.720', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.042', 'AMMO4': '0.211', 'AMMO3': '0.214', 'weapon4': '0.318', 'weapon2': '0.332', 'WEAPON4': '0.400', 'weapon5': '0.406', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.668', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '15.594', 'FRAGCOUNT': '52.000'} [2023-02-25 14:46:00,684][36138] Updated weights for policy 0, policy_version 55163 (0.0010) [2023-02-25 14:46:00,882][36156] DAMAGECOUNT value on done: 1356492.0 [2023-02-25 14:46:00,882][36156] Sum rewards: 64.819, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.245', 'AMMO2': '0.011', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'weapon4': '0.148', 'AMMO3': '0.184', 'weapon2': '0.436', 'WEAPON3': '1.150', 'HITCOUNT': '3.120', 'weapon3': '3.324', 'DAMAGECOUNT': '15.039', 'FRAGCOUNT': '54.000'} [2023-02-25 14:46:01,088][36156] DAMAGECOUNT value on done: 1352019.0 [2023-02-25 14:46:01,089][36156] Sum rewards: 76.504, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.668', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'weapon5': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'weapon2': '0.256', 'weapon4': '0.356', 'WEAPON3': '1.150', 'weapon3': '3.076', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.588', 'FRAGCOUNT': '63.000'} [2023-02-25 14:46:01,205][36156] DAMAGECOUNT value on done: 1336478.0 [2023-02-25 14:46:01,206][36156] Sum rewards: 67.318, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.354', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.004', 'weapon4': '0.016', 'AMMO4': '0.021', 'weapon5': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.223', 'weapon2': '0.460', 'WEAPON3': '1.400', 'HITCOUNT': '3.040', 'weapon3': '3.336', 'DAMAGECOUNT': '15.783', 'FRAGCOUNT': '58.000'} [2023-02-25 14:46:01,410][36156] DAMAGECOUNT value on done: 1338696.0 [2023-02-25 14:46:01,410][36156] Sum rewards: 59.978, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.010', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.102', 'weapon5': '0.138', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.328', 'weapon4': '0.444', 'WEAPON3': '1.400', 'weapon3': '2.760', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.437', 'FRAGCOUNT': '53.000'} [2023-02-25 14:46:03,658][36138] Updated weights for policy 0, policy_version 55173 (0.0009) [2023-02-25 14:46:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13468.2). Total num frames: 226000896. Throughput: 0: 3394.7. Samples: 18998238. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:46:04,730][36114] Avg episode reward: [(0, '60.029')] [2023-02-25 14:46:06,690][36138] Updated weights for policy 0, policy_version 55183 (0.0008) [2023-02-25 14:46:09,695][36138] Updated weights for policy 0, policy_version 55193 (0.0009) [2023-02-25 14:46:09,729][36114] Fps is (10 sec: 13926.4, 60 sec: 13585.0, 300 sec: 13468.2). Total num frames: 226070528. Throughput: 0: 3396.7. Samples: 19008406. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:46:09,730][36114] Avg episode reward: [(0, '60.029')] [2023-02-25 14:46:09,933][36154] DAMAGECOUNT value on done: 1351328.0 [2023-02-25 14:46:09,934][36154] Sum rewards: 62.319, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.542', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.123', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.206', 'weapon4': '0.444', 'weapon2': '0.548', 'WEAPON3': '0.850', 'weapon3': '2.650', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.559', 'FRAGCOUNT': '50.000'} [2023-02-25 14:46:10,241][36154] DAMAGECOUNT value on done: 1331745.0 [2023-02-25 14:46:10,241][36154] Sum rewards: 60.360, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.306', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.130', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'weapon4': '0.194', 'WEAPON4': '0.200', 'weapon2': '0.292', 'WEAPON3': '1.150', 'HITCOUNT': '3.040', 'weapon3': '3.216', 'DAMAGECOUNT': '14.943', 'FRAGCOUNT': '51.000'} [2023-02-25 14:46:10,544][36154] DAMAGECOUNT value on done: 1363691.0 [2023-02-25 14:46:10,545][36154] Sum rewards: 54.601, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.268', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.200', 'AMMO4': '0.208', 'WEAPON5': '0.250', 'AMMO3': '0.272', 'weapon2': '0.344', 'WEAPON4': '0.450', 'weapon4': '0.696', 'WEAPON3': '1.600', 'weapon3': '2.432', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.261', 'FRAGCOUNT': '51.000'} [2023-02-25 14:46:10,851][36154] DAMAGECOUNT value on done: 1343065.0 [2023-02-25 14:46:10,851][36154] Sum rewards: 51.393, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.209', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'weapon2': '0.384', 'weapon4': '0.476', 'WEAPON3': '1.400', 'weapon3': '2.752', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.241', 'FRAGCOUNT': '46.000'} [2023-02-25 14:46:11,009][36155] DAMAGECOUNT value on done: 1346561.0 [2023-02-25 14:46:11,009][36155] Sum rewards: 56.983, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.989', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.126', 'AMMO3': '0.141', 'AMMO4': '0.144', 'weapon4': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON3': '0.850', 'HITCOUNT': '2.870', 'weapon3': '3.074', 'DAMAGECOUNT': '14.769', 'FRAGCOUNT': '46.000'} [2023-02-25 14:46:11,319][36155] DAMAGECOUNT value on done: 1346481.0 [2023-02-25 14:46:11,320][36155] Sum rewards: 54.122, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.685', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.170', 'weapon2': '0.190', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '1.026', 'WEAPON3': '1.400', 'weapon3': '2.328', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.577', 'FRAGCOUNT': '50.000'} [2023-02-25 14:46:11,393][36141] DAMAGECOUNT value on done: 1357163.0 [2023-02-25 14:46:11,394][36141] Sum rewards: 51.559, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.781', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon5': '0.186', 'weapon2': '0.216', 'AMMO4': '0.222', 'AMMO3': '0.277', 'weapon4': '0.290', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.948', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.931', 'FRAGCOUNT': '50.000'} [2023-02-25 14:46:11,459][36139] DAMAGECOUNT value on done: 1348873.0 [2023-02-25 14:46:11,459][36139] Sum rewards: 68.706, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.200', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon5': '0.132', 'weapon2': '0.166', 'AMMO3': '0.168', 'WEAPON5': '0.250', 'weapon4': '0.324', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.174', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.171', 'FRAGCOUNT': '57.000'} [2023-02-25 14:46:11,698][36141] DAMAGECOUNT value on done: 1351928.0 [2023-02-25 14:46:11,699][36141] Sum rewards: 49.942, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.861', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon5': '0.064', 'weapon4': '0.080', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.306', 'weapon2': '0.382', 'WEAPON3': '1.850', 'HITCOUNT': '3.100', 'weapon3': '3.222', 'DAMAGECOUNT': '14.823', 'FRAGCOUNT': '49.000'} [2023-02-25 14:46:11,766][36139] DAMAGECOUNT value on done: 1345405.0 [2023-02-25 14:46:11,767][36139] Sum rewards: 62.461, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.578', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.198', 'weapon5': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.430', 'weapon4': '0.462', 'WEAPON3': '1.250', 'weapon3': '2.590', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '53.000'} [2023-02-25 14:46:11,793][36141] DAMAGECOUNT value on done: 1342226.0 [2023-02-25 14:46:11,793][36141] Sum rewards: 65.304, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.566', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'weapon2': '0.148', 'WEAPON5': '0.150', 'weapon5': '0.180', 'AMMO3': '0.183', 'weapon4': '0.320', 'WEAPON3': '1.150', 'HITCOUNT': '3.140', 'weapon3': '3.158', 'DAMAGECOUNT': '17.004', 'FRAGCOUNT': '54.000'} [2023-02-25 14:46:12,029][36139] DAMAGECOUNT value on done: 1358124.0 [2023-02-25 14:46:12,030][36139] Sum rewards: 56.634, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-1.880', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon5': '0.090', 'AMMO4': '0.178', 'weapon4': '0.182', 'weapon2': '0.258', 'AMMO3': '0.279', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.180', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '52.500'} [2023-02-25 14:46:12,125][36141] DAMAGECOUNT value on done: 1330188.0 [2023-02-25 14:46:12,126][36141] Sum rewards: 56.707, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.900', 'AMMO5': '0.009', 'AMMO2': '0.017', 'weapon4': '0.058', 'weapon5': '0.060', 'AMMO4': '0.085', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.360', 'WEAPON3': '1.250', 'HITCOUNT': '2.780', 'weapon3': '3.350', 'DAMAGECOUNT': '14.802', 'FRAGCOUNT': '49.000'} [2023-02-25 14:46:12,273][36155] DAMAGECOUNT value on done: 1360305.0 [2023-02-25 14:46:12,273][36155] Sum rewards: 47.380, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.437', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon5': '0.168', 'AMMO3': '0.214', 'weapon2': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.620', 'WEAPON3': '1.300', 'HITCOUNT': '2.420', 'weapon3': '2.604', 'DAMAGECOUNT': '13.362', 'FRAGCOUNT': '43.000'} [2023-02-25 14:46:12,328][36139] DAMAGECOUNT value on done: 1354509.0 [2023-02-25 14:46:12,329][36139] Sum rewards: 69.556, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.229', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'AMMO3': '0.185', 'weapon2': '0.440', 'WEAPON3': '1.150', 'HITCOUNT': '3.320', 'weapon3': '3.432', 'DAMAGECOUNT': '16.758', 'FRAGCOUNT': '56.000'} [2023-02-25 14:46:12,564][36155] DAMAGECOUNT value on done: 1341388.0 [2023-02-25 14:46:12,564][36155] Sum rewards: 46.537, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.712', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.055', 'weapon5': '0.146', 'AMMO3': '0.224', 'AMMO4': '0.275', 'weapon4': '0.422', 'WEAPON5': '0.450', 'weapon2': '0.470', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.644', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '13.356', 'FRAGCOUNT': '44.000'} [2023-02-25 14:46:12,734][36138] Updated weights for policy 0, policy_version 55203 (0.0009) [2023-02-25 14:46:14,234][36157] DAMAGECOUNT value on done: 1356933.0 [2023-02-25 14:46:14,235][36157] Sum rewards: 58.286, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.503', 'AMMO5': '0.024', 'AMMO2': '0.050', 'weapon5': '0.176', 'AMMO3': '0.213', 'AMMO4': '0.249', 'weapon4': '0.272', 'weapon2': '0.290', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.936', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.219', 'FRAGCOUNT': '52.500'} [2023-02-25 14:46:14,540][36157] DAMAGECOUNT value on done: 1346113.0 [2023-02-25 14:46:14,541][36157] Sum rewards: 51.680, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.366', 'AMMO5': '0.021', 'AMMO2': '0.060', 'AMMO3': '0.177', 'AMMO4': '0.302', 'weapon5': '0.328', 'weapon2': '0.434', 'WEAPON5': '0.500', 'ARMOR': '0.504', 'weapon4': '0.520', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.432', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '14.997', 'FRAGCOUNT': '44.500'} [2023-02-25 14:46:14,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13585.1, 300 sec: 13468.2). Total num frames: 226136064. Throughput: 0: 3399.2. Samples: 19028812. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:46:14,730][36114] Avg episode reward: [(0, '59.204')] [2023-02-25 14:46:14,832][36157] DAMAGECOUNT value on done: 1355543.0 [2023-02-25 14:46:14,832][36157] Sum rewards: 61.664, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.400', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon5': '0.100', 'weapon2': '0.172', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.812', 'WEAPON3': '1.250', 'weapon3': '2.692', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '54.000'} [2023-02-25 14:46:15,144][36157] DAMAGECOUNT value on done: 1350625.0 [2023-02-25 14:46:15,145][36157] Sum rewards: 52.084, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon4': '0.088', 'weapon5': '0.096', 'WEAPON4': '0.150', 'AMMO3': '0.155', 'WEAPON5': '0.200', 'HEALTH': '0.486', 'weapon2': '0.610', 'WEAPON3': '0.900', 'HITCOUNT': '2.790', 'weapon3': '3.028', 'DAMAGECOUNT': '13.470', 'FRAGCOUNT': '42.000'} [2023-02-25 14:46:15,431][36140] DAMAGECOUNT value on done: 1356113.0 [2023-02-25 14:46:15,432][36140] Sum rewards: 55.379, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.653', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.028', 'AMMO4': '0.038', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.210', 'AMMO3': '0.257', 'weapon2': '0.392', 'WEAPON3': '1.600', 'HITCOUNT': '2.800', 'weapon3': '3.156', 'DAMAGECOUNT': '14.391', 'FRAGCOUNT': '50.000'} [2023-02-25 14:46:15,496][36140] DAMAGECOUNT value on done: 1352837.0 [2023-02-25 14:46:15,496][36140] Sum rewards: 49.441, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.032', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon5': '0.102', 'weapon2': '0.210', 'AMMO3': '0.227', 'AMMO4': '0.266', 'WEAPON5': '0.300', 'WEAPON4': '0.650', 'weapon4': '0.850', 'WEAPON3': '1.300', 'weapon3': '2.536', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.872', 'FRAGCOUNT': '47.000'} [2023-02-25 14:46:15,706][36138] Updated weights for policy 0, policy_version 55213 (0.0009) [2023-02-25 14:46:15,740][36140] DAMAGECOUNT value on done: 1337392.0 [2023-02-25 14:46:15,740][36140] Sum rewards: 55.826, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.602', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.042', 'weapon5': '0.158', 'weapon2': '0.192', 'AMMO4': '0.210', 'AMMO3': '0.226', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.530', 'WEAPON3': '1.300', 'weapon3': '2.756', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.760', 'FRAGCOUNT': '50.000'} [2023-02-25 14:46:15,803][36140] DAMAGECOUNT value on done: 1336852.0 [2023-02-25 14:46:15,804][36140] Sum rewards: 64.217, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.685', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon5': '0.128', 'AMMO3': '0.146', 'AMMO4': '0.163', 'weapon2': '0.332', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.720', 'WEAPON3': '0.900', 'weapon3': '2.626', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '53.000'} [2023-02-25 14:46:18,682][36138] Updated weights for policy 0, policy_version 55223 (0.0009) [2023-02-25 14:46:18,709][36142] DAMAGECOUNT value on done: 1342288.0 [2023-02-25 14:46:18,709][36142] Sum rewards: 57.656, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.068', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.150', 'weapon5': '0.188', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.404', 'weapon2': '0.702', 'WEAPON3': '1.000', 'weapon3': '2.508', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '49.000'} [2023-02-25 14:46:19,014][36142] DAMAGECOUNT value on done: 1335888.0 [2023-02-25 14:46:19,014][36142] Sum rewards: 66.880, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-0.836', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.118', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.295', 'weapon2': '0.340', 'WEAPON3': '1.600', 'weapon3': '3.158', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '61.000'} [2023-02-25 14:46:19,645][36142] DAMAGECOUNT value on done: 1349149.0 [2023-02-25 14:46:19,645][36142] Sum rewards: 62.463, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.594', 'AMMO5': '0.011', 'AMMO2': '0.065', 'weapon2': '0.212', 'weapon5': '0.254', 'AMMO3': '0.281', 'weapon4': '0.282', 'AMMO4': '0.323', 'WEAPON5': '0.400', 'WEAPON4': '0.650', 'WEAPON3': '1.650', 'weapon3': '2.910', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '57.000'} [2023-02-25 14:46:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13482.1). Total num frames: 226205696. Throughput: 0: 3406.0. Samples: 19049334. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:46:19,730][36114] Avg episode reward: [(0, '59.084')] [2023-02-25 14:46:19,953][36142] DAMAGECOUNT value on done: 1354299.0 [2023-02-25 14:46:19,953][36142] Sum rewards: 59.287, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.503', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon5': '0.056', 'weapon4': '0.162', 'AMMO4': '0.192', 'AMMO3': '0.249', 'weapon2': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '3.140', 'weapon3': '3.222', 'DAMAGECOUNT': '15.489', 'FRAGCOUNT': '55.000'} [2023-02-25 14:46:20,486][36156] DAMAGECOUNT value on done: 1362358.0 [2023-02-25 14:46:20,487][36156] Sum rewards: 69.829, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.362', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.118', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.254', 'weapon2': '0.306', 'WEAPON3': '1.400', 'weapon3': '3.050', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.598', 'FRAGCOUNT': '61.000'} [2023-02-25 14:46:20,767][36156] DAMAGECOUNT value on done: 1357208.0 [2023-02-25 14:46:20,767][36156] Sum rewards: 55.327, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.330', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon5': '0.124', 'AMMO3': '0.194', 'AMMO4': '0.218', 'weapon4': '0.264', 'WEAPON5': '0.300', 'weapon2': '0.418', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.906', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '47.500'} [2023-02-25 14:46:20,787][36156] DAMAGECOUNT value on done: 1340681.0 [2023-02-25 14:46:20,787][36156] Sum rewards: 49.299, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.186', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'AMMO4': '0.206', 'weapon2': '0.268', 'WEAPON4': '0.400', 'weapon4': '0.744', 'WEAPON3': '1.050', 'weapon3': '2.624', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '12.609', 'FRAGCOUNT': '43.000'} [2023-02-25 14:46:21,075][36156] DAMAGECOUNT value on done: 1343345.0 [2023-02-25 14:46:21,076][36156] Sum rewards: 57.970, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.121', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.048', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon2': '0.218', 'weapon4': '0.596', 'WEAPON3': '1.200', 'weapon3': '2.910', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.947', 'FRAGCOUNT': '50.000'} [2023-02-25 14:46:21,694][36138] Updated weights for policy 0, policy_version 55233 (0.0009) [2023-02-25 14:46:24,702][36138] Updated weights for policy 0, policy_version 55243 (0.0009) [2023-02-25 14:46:24,729][36114] Fps is (10 sec: 13926.3, 60 sec: 13653.3, 300 sec: 13482.1). Total num frames: 226275328. Throughput: 0: 3405.7. Samples: 19059548. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:46:24,730][36114] Avg episode reward: [(0, '59.145')] [2023-02-25 14:46:27,699][36138] Updated weights for policy 0, policy_version 55253 (0.0009) [2023-02-25 14:46:29,707][36154] DAMAGECOUNT value on done: 1357159.0 [2023-02-25 14:46:29,708][36154] Sum rewards: 68.842, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.675', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.032', 'AMMO4': '0.039', 'WEAPON4': '0.100', 'weapon5': '0.112', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'weapon2': '0.268', 'WEAPON3': '1.200', 'HITCOUNT': '3.210', 'weapon3': '3.402', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '57.000'} [2023-02-25 14:46:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13482.1). Total num frames: 226340864. Throughput: 0: 3407.6. Samples: 19080056. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:46:29,730][36114] Avg episode reward: [(0, '59.227')] [2023-02-25 14:46:30,012][36154] DAMAGECOUNT value on done: 1337234.0 [2023-02-25 14:46:30,013][36154] Sum rewards: 63.877, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.920', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.152', 'WEAPON5': '0.200', 'AMMO4': '0.210', 'AMMO3': '0.222', 'weapon2': '0.224', 'WEAPON4': '0.350', 'weapon4': '0.614', 'WEAPON3': '1.400', 'weapon3': '2.828', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '56.000'} [2023-02-25 14:46:30,322][36154] DAMAGECOUNT value on done: 1368634.0 [2023-02-25 14:46:30,322][36154] Sum rewards: 62.979, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.690', 'ARMOR': '0.004', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon2': '0.148', 'AMMO3': '0.214', 'WEAPON4': '0.350', 'weapon4': '1.070', 'WEAPON3': '1.250', 'weapon3': '2.576', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.829', 'FRAGCOUNT': '55.000'} [2023-02-25 14:46:30,625][36154] DAMAGECOUNT value on done: 1349440.0 [2023-02-25 14:46:30,625][36154] Sum rewards: 85.014, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.397', 'AMMO2': '0.002', 'AMMO4': '0.012', 'AMMO3': '0.195', 'weapon2': '0.290', 'WEAPON3': '1.150', 'weapon3': '3.576', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.125', 'FRAGCOUNT': '70.000'} [2023-02-25 14:46:30,659][36155] DAMAGECOUNT value on done: 1351323.0 [2023-02-25 14:46:30,659][36155] Sum rewards: 53.800, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.932', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.124', 'AMMO4': '0.147', 'AMMO3': '0.179', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.324', 'weapon4': '0.622', 'WEAPON3': '1.050', 'weapon3': '2.716', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.286', 'FRAGCOUNT': '46.000'} [2023-02-25 14:46:30,707][36138] Updated weights for policy 0, policy_version 55263 (0.0009) [2023-02-25 14:46:30,957][36155] DAMAGECOUNT value on done: 1351367.0 [2023-02-25 14:46:30,958][36155] Sum rewards: 56.041, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'WEAPON4': '0.150', 'HEALTH': '0.168', 'AMMO3': '0.200', 'weapon2': '0.334', 'weapon4': '0.404', 'WEAPON3': '1.100', 'weapon3': '3.126', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.658', 'FRAGCOUNT': '46.000'} [2023-02-25 14:46:30,996][36141] DAMAGECOUNT value on done: 1362704.0 [2023-02-25 14:46:30,996][36141] Sum rewards: 67.807, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.625', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.045', 'weapon5': '0.090', 'AMMO3': '0.145', 'AMMO4': '0.224', 'WEAPON5': '0.250', 'weapon2': '0.326', 'WEAPON4': '0.500', 'weapon4': '0.590', 'WEAPON3': '0.900', 'weapon3': '2.796', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.593', 'FRAGCOUNT': '57.000'} [2023-02-25 14:46:31,053][36139] DAMAGECOUNT value on done: 1353784.0 [2023-02-25 14:46:31,053][36139] Sum rewards: 53.723, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.454', 'AMMO5': '0.012', 'AMMO2': '0.049', 'AMMO3': '0.152', 'weapon5': '0.160', 'AMMO4': '0.246', 'WEAPON5': '0.350', 'weapon2': '0.512', 'WEAPON4': '0.600', 'weapon4': '0.876', 'WEAPON3': '0.900', 'weapon3': '2.176', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.733', 'FRAGCOUNT': '47.000'} [2023-02-25 14:46:31,310][36141] DAMAGECOUNT value on done: 1356944.0 [2023-02-25 14:46:31,311][36141] Sum rewards: 60.587, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.850', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.136', 'AMMO4': '0.149', 'weapon2': '0.162', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.930', 'WEAPON3': '1.250', 'weapon3': '2.564', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '53.000'} [2023-02-25 14:46:31,374][36139] DAMAGECOUNT value on done: 1350837.0 [2023-02-25 14:46:31,375][36139] Sum rewards: 61.386, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.901', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon4': '0.188', 'weapon2': '0.190', 'weapon5': '0.192', 'WEAPON4': '0.250', 'AMMO3': '0.253', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.050', 'weapon3': '3.156', 'DAMAGECOUNT': '16.296', 'FRAGCOUNT': '55.000'} [2023-02-25 14:46:31,468][36141] DAMAGECOUNT value on done: 1347356.0 [2023-02-25 14:46:31,469][36141] Sum rewards: 63.204, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.075', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon5': '0.098', 'weapon2': '0.214', 'AMMO4': '0.219', 'AMMO3': '0.220', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.606', 'WEAPON3': '1.400', 'weapon3': '2.838', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '57.000'} [2023-02-25 14:46:31,657][36139] DAMAGECOUNT value on done: 1362721.0 [2023-02-25 14:46:31,658][36139] Sum rewards: 55.215, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.814', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.106', 'AMMO3': '0.115', 'AMMO4': '0.160', 'weapon2': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.500', 'WEAPON3': '0.750', 'weapon4': '1.044', 'weapon3': '2.446', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.791', 'FRAGCOUNT': '46.000'} [2023-02-25 14:46:31,773][36141] DAMAGECOUNT value on done: 1334556.0 [2023-02-25 14:46:31,774][36141] Sum rewards: 51.786, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.937', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO3': '0.133', 'weapon2': '0.140', 'weapon5': '0.142', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.776', 'WEAPON3': '0.800', 'weapon3': '2.460', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '13.098', 'FRAGCOUNT': '43.000'} [2023-02-25 14:46:31,944][36155] DAMAGECOUNT value on done: 1365849.0 [2023-02-25 14:46:31,944][36155] Sum rewards: 66.578, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.475', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.096', 'weapon5': '0.108', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon2': '0.700', 'WEAPON3': '1.000', 'weapon3': '2.884', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '53.000'} [2023-02-25 14:46:31,962][36139] DAMAGECOUNT value on done: 1359860.0 [2023-02-25 14:46:31,963][36139] Sum rewards: 56.820, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.232', 'AMMO5': '0.013', 'AMMO2': '0.062', 'weapon5': '0.162', 'AMMO3': '0.195', 'AMMO4': '0.310', 'WEAPON5': '0.350', 'ARMOR': '0.462', 'weapon2': '0.554', 'weapon4': '0.732', 'WEAPON4': '0.750', 'WEAPON3': '1.200', 'weapon3': '2.268', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '52.000'} [2023-02-25 14:46:32,247][36155] DAMAGECOUNT value on done: 1345986.0 [2023-02-25 14:46:32,247][36155] Sum rewards: 52.433, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.670', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.100', 'AMMO4': '0.130', 'weapon5': '0.154', 'AMMO3': '0.191', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.628', 'WEAPON3': '1.250', 'HITCOUNT': '2.830', 'weapon3': '2.880', 'DAMAGECOUNT': '13.794', 'FRAGCOUNT': '46.000'} [2023-02-25 14:46:33,757][36138] Updated weights for policy 0, policy_version 55273 (0.0010) [2023-02-25 14:46:33,985][36157] DAMAGECOUNT value on done: 1362790.0 [2023-02-25 14:46:33,986][36157] Sum rewards: 75.301, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.380', 'AMMO2': '0.004', 'AMMO4': '0.021', 'AMMO3': '0.178', 'weapon2': '0.644', 'WEAPON3': '1.050', 'weapon3': '3.192', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.571', 'FRAGCOUNT': '60.000'} [2023-02-25 14:46:34,295][36157] DAMAGECOUNT value on done: 1351452.0 [2023-02-25 14:46:34,296][36157] Sum rewards: 60.180, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.344', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon5': '0.156', 'AMMO3': '0.181', 'AMMO4': '0.228', 'WEAPON5': '0.400', 'weapon2': '0.494', 'weapon4': '0.526', 'WEAPON4': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.584', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '53.000'} [2023-02-25 14:46:34,582][36157] DAMAGECOUNT value on done: 1360658.0 [2023-02-25 14:46:34,583][36157] Sum rewards: 56.489, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.464', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.172', 'AMMO4': '0.220', 'AMMO3': '0.252', 'WEAPON5': '0.300', 'weapon2': '0.302', 'weapon4': '0.486', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.720', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.345', 'FRAGCOUNT': '53.000'} [2023-02-25 14:46:34,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13653.4, 300 sec: 13496.0). Total num frames: 226410496. Throughput: 0: 3406.0. Samples: 19100426. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:46:34,729][36114] Avg episode reward: [(0, '59.553')] [2023-02-25 14:46:34,880][36157] DAMAGECOUNT value on done: 1356259.0 [2023-02-25 14:46:34,881][36157] Sum rewards: 65.418, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.475', 'ARMOR': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'weapon5': '0.056', 'AMMO4': '0.079', 'WEAPON5': '0.150', 'weapon2': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon4': '0.488', 'WEAPON3': '1.150', 'weapon3': '3.070', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.902', 'FRAGCOUNT': '55.000'} [2023-02-25 14:46:35,168][36140] DAMAGECOUNT value on done: 1361889.0 [2023-02-25 14:46:35,169][36140] Sum rewards: 70.636, reward structure: {'DEATHCOUNT': '-15.000', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon5': '0.060', 'AMMO4': '0.076', 'weapon2': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'weapon4': '0.292', 'HEALTH': '0.351', 'WEAPON3': '1.050', 'weapon3': '3.312', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.328', 'FRAGCOUNT': '59.000'} [2023-02-25 14:46:35,255][36140] DAMAGECOUNT value on done: 1357967.0 [2023-02-25 14:46:35,255][36140] Sum rewards: 55.539, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.006', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.052', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'AMMO4': '0.258', 'weapon2': '0.388', 'WEAPON4': '0.600', 'WEAPON3': '0.900', 'weapon4': '0.946', 'weapon3': '2.346', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '47.000'} [2023-02-25 14:46:35,485][36140] DAMAGECOUNT value on done: 1343139.0 [2023-02-25 14:46:35,485][36140] Sum rewards: 68.263, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.495', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.072', 'AMMO4': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon4': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.350', 'weapon3': '3.100', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '59.000'} [2023-02-25 14:46:35,512][36141] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:46:35,561][36140] DAMAGECOUNT value on done: 1342105.0 [2023-02-25 14:46:35,561][36140] Sum rewards: 59.353, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.859', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.056', 'weapon5': '0.160', 'weapon2': '0.200', 'AMMO3': '0.255', 'AMMO4': '0.281', 'weapon4': '0.290', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.060', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '54.000'} [2023-02-25 14:46:36,725][36138] Updated weights for policy 0, policy_version 55283 (0.0009) [2023-02-25 14:46:38,451][36142] DAMAGECOUNT value on done: 1346565.0 [2023-02-25 14:46:38,451][36142] Sum rewards: 47.697, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.322', 'ARMOR': '0.008', 'AMMO5': '0.024', 'AMMO2': '0.061', 'AMMO3': '0.138', 'weapon5': '0.256', 'AMMO4': '0.306', 'weapon2': '0.558', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '0.750', 'weapon4': '0.910', 'weapon3': '2.006', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.831', 'FRAGCOUNT': '42.000'} [2023-02-25 14:46:38,539][36155] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:46:38,769][36142] DAMAGECOUNT value on done: 1341023.0 [2023-02-25 14:46:38,770][36142] Sum rewards: 52.393, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.512', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.042', 'AMMO3': '0.188', 'AMMO4': '0.209', 'weapon5': '0.264', 'weapon2': '0.348', 'WEAPON5': '0.450', 'weapon4': '0.482', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.472', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '46.500'} [2023-02-25 14:46:39,414][36142] DAMAGECOUNT value on done: 1353841.0 [2023-02-25 14:46:39,414][36142] Sum rewards: 51.756, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.575', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO3': '0.137', 'AMMO4': '0.159', 'weapon2': '0.212', 'weapon5': '0.306', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.740', 'WEAPON3': '0.950', 'weapon3': '2.406', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.076', 'FRAGCOUNT': '43.500'} [2023-02-25 14:46:39,696][36142] DAMAGECOUNT value on done: 1359657.0 [2023-02-25 14:46:39,696][36142] Sum rewards: 57.675, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.080', 'AMMO5': '0.020', 'AMMO2': '0.042', 'weapon5': '0.108', 'AMMO3': '0.171', 'weapon4': '0.182', 'AMMO4': '0.212', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.640', 'WEAPON3': '1.100', 'weapon3': '2.826', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.564', 'FRAGCOUNT': '50.000'} [2023-02-25 14:46:39,711][36138] Updated weights for policy 0, policy_version 55293 (0.0010) [2023-02-25 14:46:39,729][36114] Fps is (10 sec: 13926.5, 60 sec: 13653.3, 300 sec: 13496.0). Total num frames: 226480128. Throughput: 0: 3406.0. Samples: 19110614. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:46:39,730][36114] Avg episode reward: [(0, '59.230')] [2023-02-25 14:46:40,174][36139] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:46:40,193][36156] DAMAGECOUNT value on done: 1367991.0 [2023-02-25 14:46:40,194][36156] Sum rewards: 67.526, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.105', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.024', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.150', 'AMMO3': '0.261', 'weapon2': '0.548', 'WEAPON3': '1.500', 'weapon3': '3.040', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '59.000'} [2023-02-25 14:46:40,487][36156] DAMAGECOUNT value on done: 1362834.0 [2023-02-25 14:46:40,487][36156] Sum rewards: 59.313, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.453', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.028', 'weapon5': '0.108', 'AMMO4': '0.142', 'AMMO3': '0.152', 'WEAPON5': '0.200', 'weapon2': '0.308', 'WEAPON4': '0.450', 'weapon4': '0.840', 'WEAPON3': '1.000', 'weapon3': '2.550', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.878', 'FRAGCOUNT': '49.000'} [2023-02-25 14:46:40,497][36156] DAMAGECOUNT value on done: 1346301.0 [2023-02-25 14:46:40,497][36156] Sum rewards: 65.376, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.635', 'AMMO2': '0.018', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'AMMO3': '0.220', 'weapon4': '0.274', 'weapon2': '0.290', 'WEAPON3': '1.350', 'weapon3': '3.280', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '56.000'} [2023-02-25 14:46:40,802][36156] DAMAGECOUNT value on done: 1348990.0 [2023-02-25 14:46:40,803][36156] Sum rewards: 65.500, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.545', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.188', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON4': '0.350', 'ARMOR': '0.458', 'weapon4': '0.458', 'WEAPON3': '1.200', 'weapon3': '2.852', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '55.000'} [2023-02-25 14:46:42,701][36138] Updated weights for policy 0, policy_version 55303 (0.0009) [2023-02-25 14:46:44,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13585.1, 300 sec: 13496.0). Total num frames: 226545664. Throughput: 0: 3411.5. Samples: 19131266. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:46:44,729][36114] Avg episode reward: [(0, '59.319')] [2023-02-25 14:46:45,685][36138] Updated weights for policy 0, policy_version 55313 (0.0009) [2023-02-25 14:46:48,760][36138] Updated weights for policy 0, policy_version 55323 (0.0009) [2023-02-25 14:46:49,465][36154] DAMAGECOUNT value on done: 1361855.0 [2023-02-25 14:46:49,466][36154] Sum rewards: 55.478, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.600', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon5': '0.080', 'AMMO3': '0.165', 'AMMO4': '0.172', 'weapon4': '0.192', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'HITCOUNT': '2.840', 'weapon3': '3.196', 'DAMAGECOUNT': '14.088', 'FRAGCOUNT': '47.000'} [2023-02-25 14:46:49,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13653.3, 300 sec: 13509.9). Total num frames: 226615296. Throughput: 0: 3406.4. Samples: 19151524. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:46:49,730][36114] Avg episode reward: [(0, '59.150')] [2023-02-25 14:46:49,768][36154] DAMAGECOUNT value on done: 1342716.0 [2023-02-25 14:46:49,768][36154] Sum rewards: 70.556, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.490', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.128', 'AMMO3': '0.246', 'weapon2': '0.308', 'WEAPON3': '1.500', 'weapon3': '3.248', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.446', 'FRAGCOUNT': '61.000'} [2023-02-25 14:46:50,077][36154] DAMAGECOUNT value on done: 1373909.0 [2023-02-25 14:46:50,078][36154] Sum rewards: 59.771, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.783', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.186', 'AMMO3': '0.245', 'weapon2': '0.260', 'WEAPON3': '1.500', 'HITCOUNT': '3.160', 'weapon3': '3.300', 'DAMAGECOUNT': '15.825', 'FRAGCOUNT': '52.000'} [2023-02-25 14:46:50,376][36155] DAMAGECOUNT value on done: 1356346.0 [2023-02-25 14:46:50,377][36155] Sum rewards: 56.087, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.178', 'AMMO5': '0.005', 'AMMO2': '0.026', 'AMMO4': '0.127', 'weapon5': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon4': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.880', 'weapon3': '2.956', 'DAMAGECOUNT': '15.069', 'FRAGCOUNT': '48.000'} [2023-02-25 14:46:50,381][36154] DAMAGECOUNT value on done: 1354408.0 [2023-02-25 14:46:50,381][36154] Sum rewards: 54.929, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.473', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon2': '0.220', 'weapon5': '0.224', 'AMMO3': '0.248', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.562', 'WEAPON3': '1.500', 'weapon3': '2.642', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.904', 'FRAGCOUNT': '52.000'} [2023-02-25 14:46:50,689][36155] DAMAGECOUNT value on done: 1356687.0 [2023-02-25 14:46:50,690][36155] Sum rewards: 58.297, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.946', 'AMMO5': '0.020', 'AMMO2': '0.038', 'AMMO3': '0.144', 'AMMO4': '0.189', 'weapon5': '0.236', 'weapon4': '0.332', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.550', 'WEAPON3': '0.950', 'weapon3': '2.634', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '47.500'} [2023-02-25 14:46:50,763][36139] DAMAGECOUNT value on done: 1359381.0 [2023-02-25 14:46:50,764][36139] Sum rewards: 68.588, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.368', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.114', 'AMMO4': '0.168', 'AMMO3': '0.223', 'weapon4': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.424', 'WEAPON3': '1.350', 'weapon3': '2.996', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '59.000'} [2023-02-25 14:46:50,783][36141] DAMAGECOUNT value on done: 1367763.0 [2023-02-25 14:46:50,784][36141] Sum rewards: 52.642, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.380', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon4': '0.110', 'weapon5': '0.160', 'AMMO4': '0.213', 'AMMO3': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON3': '1.350', 'HITCOUNT': '3.030', 'weapon3': '3.134', 'DAMAGECOUNT': '15.177', 'FRAGCOUNT': '47.000'} [2023-02-25 14:46:51,077][36139] DAMAGECOUNT value on done: 1355837.0 [2023-02-25 14:46:51,078][36139] Sum rewards: 58.525, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.998', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.080', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.209', 'weapon2': '0.348', 'weapon4': '0.536', 'WEAPON3': '1.050', 'weapon3': '2.818', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '48.500'} [2023-02-25 14:46:51,101][36141] DAMAGECOUNT value on done: 1361552.0 [2023-02-25 14:46:51,102][36141] Sum rewards: 55.857, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.980', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.160', 'weapon2': '0.178', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.348', 'WEAPON3': '1.300', 'HITCOUNT': '2.790', 'weapon3': '3.038', 'DAMAGECOUNT': '13.824', 'FRAGCOUNT': '51.000'} [2023-02-25 14:46:51,281][36141] DAMAGECOUNT value on done: 1352672.0 [2023-02-25 14:46:51,282][36141] Sum rewards: 58.129, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.845', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon2': '0.174', 'AMMO3': '0.202', 'AMMO4': '0.205', 'weapon5': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '1.014', 'WEAPON3': '1.200', 'weapon3': '2.344', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.948', 'FRAGCOUNT': '49.000'} [2023-02-25 14:46:51,373][36139] DAMAGECOUNT value on done: 1368367.0 [2023-02-25 14:46:51,374][36139] Sum rewards: 67.600, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.670', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.054', 'WEAPON5': '0.100', 'weapon2': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.238', 'weapon4': '0.440', 'WEAPON3': '1.450', 'weapon3': '3.118', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '59.000'} [2023-02-25 14:46:51,593][36141] DAMAGECOUNT value on done: 1338487.0 [2023-02-25 14:46:51,593][36141] Sum rewards: 46.548, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.628', 'AMMO5': '0.007', 'AMMO2': '0.040', 'AMMO3': '0.130', 'weapon5': '0.198', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'ARMOR': '0.462', 'WEAPON4': '0.500', 'weapon2': '0.590', 'WEAPON3': '0.700', 'weapon4': '1.054', 'weapon3': '1.810', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '11.553', 'FRAGCOUNT': '39.000'} [2023-02-25 14:46:51,676][36139] DAMAGECOUNT value on done: 1364847.0 [2023-02-25 14:46:51,677][36139] Sum rewards: 53.534, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.362', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.053', 'weapon5': '0.132', 'weapon4': '0.178', 'AMMO3': '0.222', 'AMMO4': '0.265', 'weapon2': '0.402', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.870', 'weapon3': '2.990', 'DAMAGECOUNT': '14.961', 'FRAGCOUNT': '49.000'} [2023-02-25 14:46:51,707][36155] DAMAGECOUNT value on done: 1371093.0 [2023-02-25 14:46:51,708][36155] Sum rewards: 57.195, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.050', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.158', 'AMMO4': '0.187', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'weapon4': '0.296', 'weapon2': '0.424', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.846', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.687', 'FRAGCOUNT': '52.000'} [2023-02-25 14:46:51,812][36138] Updated weights for policy 0, policy_version 55333 (0.0009) [2023-02-25 14:46:52,025][36155] DAMAGECOUNT value on done: 1351343.0 [2023-02-25 14:46:52,025][36155] Sum rewards: 58.774, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.330', 'AMMO5': '0.022', 'AMMO2': '0.060', 'AMMO3': '0.182', 'weapon5': '0.208', 'weapon4': '0.266', 'weapon2': '0.278', 'AMMO4': '0.297', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.930', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '52.500'} [2023-02-25 14:46:53,730][36157] DAMAGECOUNT value on done: 1368390.0 [2023-02-25 14:46:53,731][36157] Sum rewards: 69.816, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.270', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.074', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO3': '0.162', 'weapon2': '0.722', 'WEAPON3': '0.950', 'weapon3': '2.942', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '55.000'} [2023-02-25 14:46:54,034][36157] DAMAGECOUNT value on done: 1357345.0 [2023-02-25 14:46:54,035][36157] Sum rewards: 69.004, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.160', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.052', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.204', 'weapon2': '0.214', 'AMMO3': '0.266', 'WEAPON3': '1.600', 'weapon3': '3.338', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '60.000'} [2023-02-25 14:46:54,320][36157] DAMAGECOUNT value on done: 1366391.0 [2023-02-25 14:46:54,320][36157] Sum rewards: 73.561, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.457', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'weapon4': '0.088', 'weapon2': '0.150', 'AMMO3': '0.183', 'WEAPON3': '1.100', 'HITCOUNT': '3.550', 'weapon3': '3.658', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '60.000'} [2023-02-25 14:46:54,627][36157] DAMAGECOUNT value on done: 1361377.0 [2023-02-25 14:46:54,628][36157] Sum rewards: 58.883, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.120', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO3': '0.116', 'AMMO4': '0.161', 'weapon5': '0.268', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.484', 'weapon4': '0.500', 'WEAPON3': '0.650', 'weapon3': '2.488', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '15.285', 'FRAGCOUNT': '47.500'} [2023-02-25 14:46:54,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13585.1, 300 sec: 13496.0). Total num frames: 226680832. Throughput: 0: 3404.4. Samples: 19161602. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:46:54,729][36114] Avg episode reward: [(0, '59.597')] [2023-02-25 14:46:54,785][36138] Updated weights for policy 0, policy_version 55343 (0.0009) [2023-02-25 14:46:55,034][36140] DAMAGECOUNT value on done: 1367648.0 [2023-02-25 14:46:55,034][36140] Sum rewards: 65.973, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.992', 'AMMO5': '0.018', 'AMMO2': '0.039', 'AMMO4': '0.197', 'weapon2': '0.206', 'AMMO3': '0.229', 'weapon5': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.452', 'WEAPON3': '1.400', 'weapon3': '2.774', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '57.500'} [2023-02-25 14:46:55,144][36140] DAMAGECOUNT value on done: 1363519.0 [2023-02-25 14:46:55,145][36140] Sum rewards: 67.449, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.752', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.090', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.256', 'weapon4': '0.276', 'weapon2': '0.304', 'WEAPON3': '1.450', 'weapon3': '3.050', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '58.000'} [2023-02-25 14:46:55,356][36140] DAMAGECOUNT value on done: 1347997.0 [2023-02-25 14:46:55,357][36140] Sum rewards: 51.350, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.065', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon2': '0.180', 'weapon5': '0.182', 'AMMO4': '0.217', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'weapon4': '0.298', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '2.948', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.574', 'FRAGCOUNT': '47.000'} [2023-02-25 14:46:55,465][36140] DAMAGECOUNT value on done: 1347153.0 [2023-02-25 14:46:55,466][36140] Sum rewards: 57.765, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.600', 'AMMO5': '0.005', 'ARMOR': '0.009', 'AMMO2': '0.023', 'weapon5': '0.098', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'WEAPON4': '0.300', 'weapon4': '0.350', 'weapon2': '0.564', 'WEAPON3': '1.150', 'weapon3': '2.790', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.114', 'FRAGCOUNT': '49.000'} [2023-02-25 14:46:57,853][36138] Updated weights for policy 0, policy_version 55353 (0.0009) [2023-02-25 14:46:58,170][36142] DAMAGECOUNT value on done: 1351893.0 [2023-02-25 14:46:58,171][36142] Sum rewards: 59.634, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.432', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.050', 'AMMO3': '0.122', 'AMMO4': '0.250', 'weapon5': '0.404', 'weapon2': '0.478', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '0.750', 'weapon4': '0.976', 'weapon3': '1.762', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '49.000'} [2023-02-25 14:46:58,484][36142] DAMAGECOUNT value on done: 1346294.0 [2023-02-25 14:46:58,484][36142] Sum rewards: 56.671, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.776', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon5': '0.162', 'AMMO4': '0.192', 'AMMO3': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.388', 'weapon4': '0.512', 'WEAPON3': '1.500', 'weapon3': '2.624', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.813', 'FRAGCOUNT': '52.000'} [2023-02-25 14:46:59,087][36142] DAMAGECOUNT value on done: 1358593.0 [2023-02-25 14:46:59,088][36142] Sum rewards: 57.966, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.973', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.016', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.211', 'weapon2': '0.694', 'WEAPON3': '1.250', 'HITCOUNT': '3.110', 'weapon3': '3.120', 'DAMAGECOUNT': '14.256', 'FRAGCOUNT': '49.000'} [2023-02-25 14:46:59,385][36142] DAMAGECOUNT value on done: 1362889.0 [2023-02-25 14:46:59,385][36142] Sum rewards: 41.649, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.186', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.026', 'weapon5': '0.052', 'weapon7': '0.068', 'AMMO3': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.432', 'WEAPON3': '0.500', 'weapon4': '0.550', 'weapon3': '1.866', 'HITCOUNT': '2.020', 'DAMAGECOUNT': '9.696', 'FRAGCOUNT': '32.500'} [2023-02-25 14:46:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13653.3, 300 sec: 13509.9). Total num frames: 226750464. Throughput: 0: 3404.4. Samples: 19182010. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:46:59,729][36114] Avg episode reward: [(0, '59.619')] [2023-02-25 14:46:59,962][36156] DAMAGECOUNT value on done: 1373175.0 [2023-02-25 14:46:59,962][36156] Sum rewards: 59.105, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.988', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.140', 'AMMO4': '0.143', 'AMMO3': '0.172', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.426', 'weapon4': '0.434', 'WEAPON3': '1.100', 'weapon3': '2.576', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.552', 'FRAGCOUNT': '51.000'} [2023-02-25 14:47:00,274][36156] DAMAGECOUNT value on done: 1367359.0 [2023-02-25 14:47:00,274][36156] Sum rewards: 50.744, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.755', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.160', 'AMMO3': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.690', 'weapon4': '0.778', 'WEAPON3': '1.150', 'weapon3': '2.142', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.575', 'FRAGCOUNT': '43.000'} [2023-02-25 14:47:00,283][36156] DAMAGECOUNT value on done: 1351364.0 [2023-02-25 14:47:00,284][36156] Sum rewards: 59.141, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.064', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon4': '0.072', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon2': '0.282', 'WEAPON3': '1.350', 'HITCOUNT': '3.020', 'weapon3': '3.396', 'DAMAGECOUNT': '15.189', 'FRAGCOUNT': '53.000'} [2023-02-25 14:47:00,581][36156] DAMAGECOUNT value on done: 1354613.0 [2023-02-25 14:47:00,582][36156] Sum rewards: 68.084, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.012', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.036', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.154', 'AMMO3': '0.166', 'AMMO4': '0.178', 'weapon4': '0.186', 'weapon2': '0.646', 'WEAPON3': '0.900', 'weapon3': '2.682', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.869', 'FRAGCOUNT': '54.000'} [2023-02-25 14:47:00,841][36138] Updated weights for policy 0, policy_version 55363 (0.0009) [2023-02-25 14:47:03,872][36138] Updated weights for policy 0, policy_version 55373 (0.0009) [2023-02-25 14:47:04,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13585.1, 300 sec: 13509.9). Total num frames: 226816000. Throughput: 0: 3400.3. Samples: 19202346. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:47:04,729][36114] Avg episode reward: [(0, '59.683')] [2023-02-25 14:47:06,888][36138] Updated weights for policy 0, policy_version 55383 (0.0009) [2023-02-25 14:47:09,473][36154] DAMAGECOUNT value on done: 1366738.0 [2023-02-25 14:47:09,474][36154] Sum rewards: 54.931, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.970', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.058', 'AMMO3': '0.230', 'weapon5': '0.252', 'AMMO4': '0.288', 'weapon2': '0.344', 'weapon4': '0.558', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.518', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.649', 'FRAGCOUNT': '50.000'} [2023-02-25 14:47:09,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13509.9). Total num frames: 226885632. Throughput: 0: 3398.4. Samples: 19212478. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:47:09,729][36114] Avg episode reward: [(0, '59.584')] [2023-02-25 14:47:09,769][36154] DAMAGECOUNT value on done: 1348145.0 [2023-02-25 14:47:09,769][36154] Sum rewards: 62.192, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.146', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.016', 'AMMO4': '0.077', 'AMMO3': '0.159', 'weapon5': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.302', 'weapon4': '0.350', 'WEAPON3': '0.900', 'weapon3': '2.952', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '50.500'} [2023-02-25 14:47:09,915][36138] Updated weights for policy 0, policy_version 55393 (0.0009) [2023-02-25 14:47:10,072][36154] DAMAGECOUNT value on done: 1379571.0 [2023-02-25 14:47:10,072][36154] Sum rewards: 73.094, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.351', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO3': '0.137', 'weapon5': '0.158', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.404', 'weapon4': '0.672', 'WEAPON3': '0.950', 'weapon3': '2.546', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '61.000'} [2023-02-25 14:47:10,166][36155] DAMAGECOUNT value on done: 1362271.0 [2023-02-25 14:47:10,166][36155] Sum rewards: 62.461, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.830', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon5': '0.136', 'AMMO4': '0.198', 'AMMO3': '0.222', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.464', 'weapon4': '0.576', 'WEAPON3': '1.300', 'weapon3': '2.530', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '54.000'} [2023-02-25 14:47:10,380][36154] DAMAGECOUNT value on done: 1360127.0 [2023-02-25 14:47:10,380][36154] Sum rewards: 68.293, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.005', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.118', 'AMMO4': '0.155', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.264', 'WEAPON4': '0.300', 'weapon4': '0.352', 'WEAPON3': '1.300', 'weapon3': '3.056', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.157', 'FRAGCOUNT': '58.000'} [2023-02-25 14:47:10,471][36155] DAMAGECOUNT value on done: 1361405.0 [2023-02-25 14:47:10,471][36155] Sum rewards: 48.380, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.662', 'AMMO5': '0.017', 'AMMO2': '0.031', 'AMMO4': '0.152', 'weapon5': '0.190', 'AMMO3': '0.192', 'weapon4': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.670', 'WEAPON3': '1.150', 'weapon3': '2.588', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.154', 'FRAGCOUNT': '42.000'} [2023-02-25 14:47:10,556][36141] DAMAGECOUNT value on done: 1372865.0 [2023-02-25 14:47:10,556][36141] Sum rewards: 62.438, reward structure: {'DEATHCOUNT': '-9.000', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO3': '0.110', 'HEALTH': '0.112', 'AMMO4': '0.134', 'weapon5': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.448', 'WEAPON3': '0.650', 'weapon4': '0.966', 'weapon3': '2.274', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.006', 'FRAGCOUNT': '48.000'} [2023-02-25 14:47:10,616][36139] DAMAGECOUNT value on done: 1363874.0 [2023-02-25 14:47:10,616][36139] Sum rewards: 53.998, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.761', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.183', 'weapon2': '0.234', 'weapon5': '0.236', 'weapon4': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.730', 'weapon3': '3.008', 'DAMAGECOUNT': '13.479', 'FRAGCOUNT': '48.500'} [2023-02-25 14:47:10,855][36141] DAMAGECOUNT value on done: 1366931.0 [2023-02-25 14:47:10,856][36141] Sum rewards: 68.301, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.746', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'weapon4': '0.200', 'weapon2': '0.418', 'WEAPON3': '1.100', 'weapon3': '3.166', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '57.000'} [2023-02-25 14:47:10,928][36139] DAMAGECOUNT value on done: 1361388.0 [2023-02-25 14:47:10,928][36139] Sum rewards: 66.323, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.522', 'AMMO5': '0.011', 'AMMO2': '0.040', 'AMMO3': '0.170', 'AMMO4': '0.199', 'weapon5': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.482', 'weapon4': '0.628', 'WEAPON3': '1.050', 'weapon3': '2.422', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '56.000'} [2023-02-25 14:47:11,024][36141] DAMAGECOUNT value on done: 1357217.0 [2023-02-25 14:47:11,025][36141] Sum rewards: 54.300, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.560', 'AMMO2': '0.011', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.173', 'weapon4': '0.380', 'weapon2': '0.430', 'WEAPON3': '1.000', 'HITCOUNT': '2.800', 'weapon3': '3.000', 'DAMAGECOUNT': '13.410', 'FRAGCOUNT': '47.000'} [2023-02-25 14:47:11,120][36139] DAMAGECOUNT value on done: 1374272.0 [2023-02-25 14:47:11,121][36139] Sum rewards: 73.869, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.751', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO3': '0.168', 'weapon5': '0.174', 'AMMO4': '0.192', 'weapon4': '0.288', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'weapon3': '2.876', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '63.000'} [2023-02-25 14:47:11,336][36141] DAMAGECOUNT value on done: 1344082.0 [2023-02-25 14:47:11,337][36141] Sum rewards: 65.699, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.172', 'ARMOR': '0.004', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.056', 'AMMO3': '0.159', 'weapon5': '0.230', 'AMMO4': '0.280', 'weapon2': '0.356', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.690', 'WEAPON3': '0.950', 'weapon3': '2.370', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '56.500'} [2023-02-25 14:47:11,433][36139] DAMAGECOUNT value on done: 1371134.0 [2023-02-25 14:47:11,433][36139] Sum rewards: 72.600, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.324', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon4': '0.222', 'weapon2': '0.288', 'WEAPON3': '1.350', 'weapon3': '3.182', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.861', 'FRAGCOUNT': '60.000'} [2023-02-25 14:47:11,525][36155] DAMAGECOUNT value on done: 1377388.0 [2023-02-25 14:47:11,525][36155] Sum rewards: 66.271, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.600', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.034', 'AMMO4': '0.169', 'AMMO3': '0.175', 'weapon2': '0.370', 'weapon4': '0.480', 'WEAPON4': '0.500', 'weapon5': '0.504', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.322', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '54.500'} [2023-02-25 14:47:11,812][36155] DAMAGECOUNT value on done: 1356839.0 [2023-02-25 14:47:11,812][36155] Sum rewards: 68.581, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.699', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'weapon4': '0.116', 'AMMO3': '0.222', 'weapon2': '0.634', 'WEAPON3': '1.300', 'weapon3': '2.976', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '58.000'} [2023-02-25 14:47:12,927][36138] Updated weights for policy 0, policy_version 55403 (0.0009) [2023-02-25 14:47:13,475][36157] DAMAGECOUNT value on done: 1372087.0 [2023-02-25 14:47:13,476][36157] Sum rewards: 41.695, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.058', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon2': '0.144', 'AMMO3': '0.150', 'AMMO4': '0.169', 'weapon5': '0.292', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'weapon4': '0.958', 'weapon3': '1.942', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '11.091', 'FRAGCOUNT': '36.000'} [2023-02-25 14:47:13,792][36157] DAMAGECOUNT value on done: 1362898.0 [2023-02-25 14:47:13,793][36157] Sum rewards: 72.119, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.162', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.214', 'weapon4': '0.278', 'WEAPON3': '1.200', 'weapon3': '3.228', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '61.000'} [2023-02-25 14:47:14,106][36157] DAMAGECOUNT value on done: 1371261.0 [2023-02-25 14:47:14,107][36157] Sum rewards: 52.786, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.931', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.039', 'weapon5': '0.052', 'WEAPON5': '0.100', 'weapon2': '0.170', 'AMMO4': '0.197', 'AMMO3': '0.236', 'WEAPON4': '0.450', 'weapon4': '0.520', 'WEAPON3': '1.500', 'weapon3': '3.066', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.610', 'FRAGCOUNT': '49.000'} [2023-02-25 14:47:14,413][36157] DAMAGECOUNT value on done: 1366562.0 [2023-02-25 14:47:14,414][36157] Sum rewards: 53.782, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.780', 'AMMO5': '0.019', 'AMMO2': '0.063', 'AMMO3': '0.215', 'weapon2': '0.260', 'weapon5': '0.310', 'AMMO4': '0.313', 'ARMOR': '0.460', 'weapon4': '0.468', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.608', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '49.000'} [2023-02-25 14:47:14,729][36114] Fps is (10 sec: 13926.1, 60 sec: 13653.3, 300 sec: 13523.7). Total num frames: 226955264. Throughput: 0: 3396.5. Samples: 19232900. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:47:14,730][36114] Avg episode reward: [(0, '60.272')] [2023-02-25 14:47:14,800][36140] DAMAGECOUNT value on done: 1372969.0 [2023-02-25 14:47:14,801][36140] Sum rewards: 62.876, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.406', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.120', 'AMMO4': '0.131', 'AMMO3': '0.177', 'weapon5': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.468', 'WEAPON3': '1.100', 'weapon3': '2.906', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.963', 'FRAGCOUNT': '53.000'} [2023-02-25 14:47:14,973][36140] DAMAGECOUNT value on done: 1368665.0 [2023-02-25 14:47:14,973][36140] Sum rewards: 53.157, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.645', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.056', 'AMMO3': '0.140', 'weapon4': '0.242', 'AMMO4': '0.281', 'weapon5': '0.300', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.636', 'WEAPON3': '0.950', 'weapon3': '2.492', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '15.237', 'FRAGCOUNT': '45.000'} [2023-02-25 14:47:15,114][36140] DAMAGECOUNT value on done: 1352710.0 [2023-02-25 14:47:15,114][36140] Sum rewards: 58.884, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.105', 'AMMO5': '0.009', 'ARMOR': '0.024', 'AMMO2': '0.047', 'weapon5': '0.116', 'AMMO3': '0.146', 'weapon4': '0.230', 'AMMO4': '0.237', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.724', 'WEAPON3': '0.900', 'weapon3': '2.676', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.139', 'FRAGCOUNT': '49.000'} [2023-02-25 14:47:15,285][36140] DAMAGECOUNT value on done: 1352612.0 [2023-02-25 14:47:15,285][36140] Sum rewards: 62.527, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.100', 'AMMO5': '0.017', 'AMMO2': '0.045', 'AMMO3': '0.186', 'AMMO4': '0.227', 'weapon5': '0.324', 'weapon2': '0.376', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.512', 'WEAPON3': '1.100', 'weapon3': '2.478', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.332', 'FRAGCOUNT': '53.000'} [2023-02-25 14:47:15,894][36138] Updated weights for policy 0, policy_version 55413 (0.0010) [2023-02-25 14:47:17,966][36155] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:47:18,011][36142] DAMAGECOUNT value on done: 1357685.0 [2023-02-25 14:47:18,011][36142] Sum rewards: 67.083, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.704', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.172', 'weapon2': '0.224', 'weapon5': '0.258', 'AMMO3': '0.278', 'WEAPON5': '0.400', 'weapon4': '0.492', 'WEAPON4': '0.500', 'WEAPON3': '1.750', 'weapon3': '2.670', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '63.000'} [2023-02-25 14:47:18,318][36142] DAMAGECOUNT value on done: 1352036.0 [2023-02-25 14:47:18,319][36142] Sum rewards: 68.531, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.748', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.138', 'AMMO3': '0.166', 'weapon2': '0.664', 'WEAPON3': '1.050', 'weapon3': '2.998', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '54.000'} [2023-02-25 14:47:18,911][36138] Updated weights for policy 0, policy_version 55423 (0.0010) [2023-02-25 14:47:18,940][36142] DAMAGECOUNT value on done: 1364453.0 [2023-02-25 14:47:18,940][36142] Sum rewards: 68.651, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.030', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon4': '0.106', 'AMMO3': '0.172', 'AMMO4': '0.240', 'weapon5': '0.262', 'weapon2': '0.448', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.908', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '58.000'} [2023-02-25 14:47:19,254][36142] DAMAGECOUNT value on done: 1368109.0 [2023-02-25 14:47:19,254][36142] Sum rewards: 61.010, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.700', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.094', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.320', 'WEAPON3': '1.450', 'HITCOUNT': '3.210', 'weapon3': '3.370', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '54.000'} [2023-02-25 14:47:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13509.9). Total num frames: 227020800. Throughput: 0: 3397.4. Samples: 19253308. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:47:19,730][36114] Avg episode reward: [(0, '60.814')] [2023-02-25 14:47:19,733][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000055425_227020800.pth... [2023-02-25 14:47:19,792][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000054632_223772672.pth [2023-02-25 14:47:19,811][36156] DAMAGECOUNT value on done: 1378378.0 [2023-02-25 14:47:19,811][36156] Sum rewards: 58.169, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.892', 'AMMO5': '0.021', 'AMMO2': '0.056', 'AMMO3': '0.216', 'weapon5': '0.240', 'weapon4': '0.248', 'AMMO4': '0.279', 'weapon2': '0.296', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.796', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '15.609', 'FRAGCOUNT': '53.000'} [2023-02-25 14:47:20,131][36156] DAMAGECOUNT value on done: 1356849.0 [2023-02-25 14:47:20,132][36156] Sum rewards: 64.440, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.706', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.108', 'AMMO4': '0.166', 'AMMO3': '0.185', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.332', 'weapon4': '0.390', 'WEAPON3': '1.250', 'weapon3': '2.936', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '54.000'} [2023-02-25 14:47:20,144][36156] DAMAGECOUNT value on done: 1373243.0 [2023-02-25 14:47:20,144][36156] Sum rewards: 64.359, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.112', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.098', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'WEAPON4': '0.300', 'weapon4': '0.326', 'weapon2': '0.468', 'WEAPON3': '1.050', 'weapon3': '2.926', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '53.000'} [2023-02-25 14:47:20,450][36156] DAMAGECOUNT value on done: 1359759.0 [2023-02-25 14:47:20,451][36156] Sum rewards: 60.327, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.446', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.151', 'AMMO3': '0.186', 'weapon5': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON4': '0.450', 'weapon4': '0.620', 'WEAPON3': '1.250', 'weapon3': '2.496', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.438', 'FRAGCOUNT': '54.000'} [2023-02-25 14:47:21,962][36138] Updated weights for policy 0, policy_version 55433 (0.0010) [2023-02-25 14:47:24,729][36114] Fps is (10 sec: 13517.0, 60 sec: 13585.1, 300 sec: 13523.7). Total num frames: 227090432. Throughput: 0: 3394.7. Samples: 19263374. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:47:24,730][36114] Avg episode reward: [(0, '60.824')] [2023-02-25 14:47:24,999][36138] Updated weights for policy 0, policy_version 55443 (0.0009) [2023-02-25 14:47:28,025][36138] Updated weights for policy 0, policy_version 55453 (0.0010) [2023-02-25 14:47:29,305][36154] DAMAGECOUNT value on done: 1371701.0 [2023-02-25 14:47:29,306][36154] Sum rewards: 57.857, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.838', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.092', 'AMMO4': '0.152', 'weapon2': '0.208', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'weapon4': '0.394', 'WEAPON3': '1.500', 'weapon3': '3.008', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.889', 'FRAGCOUNT': '53.000'} [2023-02-25 14:47:29,603][36154] DAMAGECOUNT value on done: 1353454.0 [2023-02-25 14:47:29,603][36154] Sum rewards: 62.694, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.903', 'AMMO5': '0.003', 'weapon4': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.108', 'weapon2': '0.264', 'AMMO3': '0.273', 'WEAPON3': '1.600', 'HITCOUNT': '3.290', 'weapon3': '3.422', 'DAMAGECOUNT': '15.927', 'FRAGCOUNT': '56.000'} [2023-02-25 14:47:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13523.7). Total num frames: 227155968. Throughput: 0: 3387.2. Samples: 19283688. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:47:29,730][36114] Avg episode reward: [(0, '60.778')] [2023-02-25 14:47:29,891][36155] DAMAGECOUNT value on done: 1366827.0 [2023-02-25 14:47:29,891][36155] Sum rewards: 55.662, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.628', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.193', 'weapon5': '0.292', 'WEAPON4': '0.300', 'weapon2': '0.340', 'WEAPON5': '0.350', 'weapon4': '0.614', 'WEAPON3': '1.200', 'weapon3': '2.454', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.668', 'FRAGCOUNT': '49.000'} [2023-02-25 14:47:29,901][36154] DAMAGECOUNT value on done: 1384595.0 [2023-02-25 14:47:29,902][36154] Sum rewards: 50.766, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.846', 'ARMOR': '0.012', 'AMMO5': '0.020', 'AMMO2': '0.048', 'AMMO3': '0.180', 'weapon2': '0.192', 'AMMO4': '0.240', 'weapon5': '0.378', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon4': '0.958', 'WEAPON3': '1.000', 'weapon3': '2.132', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.072', 'FRAGCOUNT': '44.000'} [2023-02-25 14:47:30,195][36155] DAMAGECOUNT value on done: 1366556.0 [2023-02-25 14:47:30,195][36155] Sum rewards: 61.053, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.436', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.084', 'weapon4': '0.112', 'AMMO4': '0.177', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.500', 'weapon3': '3.206', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.453', 'FRAGCOUNT': '56.000'} [2023-02-25 14:47:30,208][36154] DAMAGECOUNT value on done: 1365521.0 [2023-02-25 14:47:30,208][36154] Sum rewards: 68.911, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.760', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'AMMO3': '0.201', 'weapon2': '0.272', 'WEAPON3': '1.300', 'HITCOUNT': '3.230', 'weapon3': '3.488', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '58.000'} [2023-02-25 14:47:30,315][36141] DAMAGECOUNT value on done: 1377633.0 [2023-02-25 14:47:30,315][36141] Sum rewards: 53.306, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.690', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.068', 'AMMO3': '0.102', 'weapon2': '0.270', 'AMMO4': '0.342', 'weapon5': '0.398', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '0.700', 'weapon4': '1.226', 'weapon3': '1.708', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.304', 'FRAGCOUNT': '43.000'} [2023-02-25 14:47:30,406][36139] DAMAGECOUNT value on done: 1368868.0 [2023-02-25 14:47:30,406][36139] Sum rewards: 54.177, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.306', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.094', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.184', 'weapon2': '0.220', 'AMMO3': '0.285', 'WEAPON3': '1.700', 'HITCOUNT': '2.910', 'weapon3': '3.242', 'DAMAGECOUNT': '14.667', 'FRAGCOUNT': '51.000'} [2023-02-25 14:47:30,614][36141] DAMAGECOUNT value on done: 1371413.0 [2023-02-25 14:47:30,614][36141] Sum rewards: 44.378, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.987', 'ARMOR': '0.012', 'AMMO5': '0.028', 'AMMO2': '0.070', 'AMMO3': '0.189', 'weapon2': '0.298', 'AMMO4': '0.351', 'weapon4': '0.466', 'weapon5': '0.480', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.100', 'HITCOUNT': '2.210', 'weapon3': '2.364', 'DAMAGECOUNT': '13.446', 'FRAGCOUNT': '42.000'} [2023-02-25 14:47:30,715][36139] DAMAGECOUNT value on done: 1366667.0 [2023-02-25 14:47:30,716][36139] Sum rewards: 62.921, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.473', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon2': '0.154', 'AMMO4': '0.169', 'AMMO3': '0.178', 'WEAPON5': '0.250', 'weapon5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.674', 'WEAPON3': '1.050', 'weapon3': '2.692', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '53.000'} [2023-02-25 14:47:30,850][36139] DAMAGECOUNT value on done: 1379177.0 [2023-02-25 14:47:30,850][36139] Sum rewards: 60.856, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.790', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon5': '0.122', 'AMMO3': '0.170', 'AMMO4': '0.186', 'weapon4': '0.230', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.742', 'WEAPON3': '1.050', 'weapon3': '2.638', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.715', 'FRAGCOUNT': '53.000'} [2023-02-25 14:47:30,858][36141] DAMAGECOUNT value on done: 1362956.0 [2023-02-25 14:47:30,858][36141] Sum rewards: 69.769, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.444', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.356', 'WEAPON3': '1.300', 'weapon3': '2.876', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '62.000'} [2023-02-25 14:47:31,059][36138] Updated weights for policy 0, policy_version 55463 (0.0009) [2023-02-25 14:47:31,148][36141] DAMAGECOUNT value on done: 1348908.0 [2023-02-25 14:47:31,148][36141] Sum rewards: 52.558, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.922', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.152', 'AMMO3': '0.166', 'AMMO4': '0.192', 'weapon5': '0.226', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.568', 'WEAPON3': '1.050', 'weapon3': '2.802', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '14.238', 'FRAGCOUNT': '45.000'} [2023-02-25 14:47:31,151][36139] DAMAGECOUNT value on done: 1375896.0 [2023-02-25 14:47:31,152][36139] Sum rewards: 48.591, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.432', 'ARMOR': '0.004', 'AMMO5': '0.026', 'AMMO2': '0.071', 'AMMO3': '0.183', 'weapon5': '0.298', 'weapon2': '0.336', 'AMMO4': '0.355', 'weapon4': '0.610', 'WEAPON5': '0.650', 'WEAPON4': '0.800', 'WEAPON3': '1.100', 'weapon3': '2.444', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.286', 'FRAGCOUNT': '44.000'} [2023-02-25 14:47:31,241][36155] DAMAGECOUNT value on done: 1382621.0 [2023-02-25 14:47:31,242][36155] Sum rewards: 57.774, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.866', 'ARMOR': '0.012', 'AMMO5': '0.023', 'AMMO2': '0.058', 'AMMO3': '0.181', 'weapon5': '0.188', 'AMMO4': '0.291', 'weapon2': '0.356', 'WEAPON5': '0.550', 'weapon4': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.592', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.699', 'FRAGCOUNT': '51.000'} [2023-02-25 14:47:31,545][36155] DAMAGECOUNT value on done: 1362240.0 [2023-02-25 14:47:31,545][36155] Sum rewards: 63.423, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.094', 'AMMO5': '0.012', 'AMMO2': '0.047', 'AMMO3': '0.177', 'AMMO4': '0.233', 'weapon5': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.458', 'weapon2': '0.458', 'weapon4': '0.628', 'WEAPON3': '1.050', 'weapon3': '2.380', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '53.000'} [2023-02-25 14:47:33,248][36157] DAMAGECOUNT value on done: 1378242.0 [2023-02-25 14:47:33,248][36157] Sum rewards: 74.539, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.426', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.067', 'AMMO3': '0.175', 'weapon5': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.254', 'WEAPON5': '0.300', 'weapon4': '0.404', 'WEAPON3': '1.150', 'weapon3': '2.890', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '61.000'} [2023-02-25 14:47:33,405][36155] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:47:33,559][36157] DAMAGECOUNT value on done: 1367900.0 [2023-02-25 14:47:33,559][36157] Sum rewards: 64.969, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.129', 'AMMO5': '0.005', 'AMMO2': '0.031', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.156', 'weapon5': '0.190', 'WEAPON4': '0.350', 'weapon2': '0.448', 'weapon4': '0.458', 'WEAPON3': '0.900', 'weapon3': '2.710', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '15.006', 'FRAGCOUNT': '54.000'} [2023-02-25 14:47:33,881][36157] DAMAGECOUNT value on done: 1376416.0 [2023-02-25 14:47:33,881][36157] Sum rewards: 63.649, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.562', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon2': '0.212', 'weapon4': '0.430', 'WEAPON3': '1.150', 'weapon3': '2.848', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.465', 'FRAGCOUNT': '54.000'} [2023-02-25 14:47:33,987][36138] Updated weights for policy 0, policy_version 55473 (0.0009) [2023-02-25 14:47:34,188][36157] DAMAGECOUNT value on done: 1370963.0 [2023-02-25 14:47:34,188][36157] Sum rewards: 51.185, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.652', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.067', 'AMMO3': '0.161', 'weapon5': '0.262', 'weapon2': '0.306', 'AMMO4': '0.333', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.852', 'WEAPON3': '0.950', 'weapon3': '2.324', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '13.203', 'FRAGCOUNT': '46.000'} [2023-02-25 14:47:34,592][36140] DAMAGECOUNT value on done: 1378039.0 [2023-02-25 14:47:34,592][36140] Sum rewards: 57.179, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.900', 'AMMO5': '0.009', 'AMMO2': '0.015', 'AMMO4': '0.073', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon2': '0.206', 'weapon5': '0.220', 'ARMOR': '0.454', 'weapon4': '0.680', 'WEAPON3': '1.300', 'weapon3': '2.606', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '48.000'} [2023-02-25 14:47:34,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13523.7). Total num frames: 227225600. Throughput: 0: 3392.2. Samples: 19304174. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:47:34,730][36114] Avg episode reward: [(0, '60.308')] [2023-02-25 14:47:34,778][36140] DAMAGECOUNT value on done: 1373634.0 [2023-02-25 14:47:34,779][36140] Sum rewards: 60.375, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.000', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.092', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'weapon4': '0.534', 'weapon2': '0.622', 'WEAPON3': '1.200', 'weapon3': '2.540', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '52.000'} [2023-02-25 14:47:34,912][36140] DAMAGECOUNT value on done: 1358406.0 [2023-02-25 14:47:34,913][36140] Sum rewards: 64.858, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.890', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.172', 'AMMO3': '0.211', 'weapon2': '0.586', 'WEAPON3': '1.300', 'weapon3': '2.896', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '54.000'} [2023-02-25 14:47:35,102][36140] DAMAGECOUNT value on done: 1358465.0 [2023-02-25 14:47:35,102][36140] Sum rewards: 67.828, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.148', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.124', 'WEAPON4': '0.200', 'weapon2': '0.206', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'weapon4': '0.264', 'WEAPON3': '1.400', 'weapon3': '3.048', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.559', 'FRAGCOUNT': '58.000'} [2023-02-25 14:47:37,005][36138] Updated weights for policy 0, policy_version 55483 (0.0009) [2023-02-25 14:47:37,860][36142] DAMAGECOUNT value on done: 1362294.0 [2023-02-25 14:47:37,860][36142] Sum rewards: 51.992, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.342', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.160', 'AMMO4': '0.169', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'WEAPON4': '0.400', 'weapon2': '0.540', 'weapon4': '0.750', 'WEAPON3': '1.400', 'weapon3': '2.286', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.827', 'FRAGCOUNT': '49.000'} [2023-02-25 14:47:38,141][36142] DAMAGECOUNT value on done: 1357709.0 [2023-02-25 14:47:38,142][36142] Sum rewards: 61.837, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.014', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'weapon4': '0.124', 'AMMO3': '0.295', 'weapon2': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.270', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '56.000'} [2023-02-25 14:47:38,765][36142] DAMAGECOUNT value on done: 1370371.0 [2023-02-25 14:47:38,765][36142] Sum rewards: 63.711, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.894', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.106', 'weapon4': '0.126', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'weapon2': '0.220', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'WEAPON3': '1.500', 'HITCOUNT': '3.270', 'weapon3': '3.292', 'DAMAGECOUNT': '17.754', 'FRAGCOUNT': '55.000'} [2023-02-25 14:47:39,064][36142] DAMAGECOUNT value on done: 1373877.0 [2023-02-25 14:47:39,065][36142] Sum rewards: 68.049, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.696', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.126', 'AMMO4': '0.139', 'AMMO3': '0.200', 'weapon4': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.404', 'WEAPON3': '1.150', 'weapon3': '2.944', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '55.000'} [2023-02-25 14:47:39,722][36156] DAMAGECOUNT value on done: 1383217.0 [2023-02-25 14:47:39,723][36156] Sum rewards: 54.168, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.246', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.102', 'AMMO4': '0.102', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon4': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.366', 'WEAPON3': '1.450', 'HITCOUNT': '2.890', 'weapon3': '3.062', 'DAMAGECOUNT': '14.517', 'FRAGCOUNT': '49.000'} [2023-02-25 14:47:39,729][36114] Fps is (10 sec: 13926.4, 60 sec: 13585.1, 300 sec: 13537.6). Total num frames: 227295232. Throughput: 0: 3395.7. Samples: 19314408. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:47:39,729][36114] Avg episode reward: [(0, '60.335')] [2023-02-25 14:47:39,973][36138] Updated weights for policy 0, policy_version 55493 (0.0009) [2023-02-25 14:47:40,032][36156] DAMAGECOUNT value on done: 1362235.0 [2023-02-25 14:47:40,033][36156] Sum rewards: 60.180, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-1.606', 'AMMO5': '0.017', 'AMMO2': '0.052', 'AMMO3': '0.208', 'weapon2': '0.250', 'AMMO4': '0.258', 'weapon5': '0.296', 'WEAPON5': '0.450', 'ARMOR': '0.455', 'weapon4': '0.578', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.554', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '55.000'} [2023-02-25 14:47:40,044][36156] DAMAGECOUNT value on done: 1377660.0 [2023-02-25 14:47:40,045][36156] Sum rewards: 48.965, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.120', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.035', 'weapon5': '0.084', 'AMMO3': '0.147', 'AMMO4': '0.175', 'WEAPON5': '0.250', 'weapon4': '0.288', 'WEAPON4': '0.300', 'weapon2': '0.802', 'WEAPON3': '1.050', 'weapon3': '2.632', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.221', 'FRAGCOUNT': '42.000'} [2023-02-25 14:47:40,350][36156] DAMAGECOUNT value on done: 1366247.0 [2023-02-25 14:47:40,351][36156] Sum rewards: 77.229, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.849', 'AMMO5': '0.009', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.132', 'weapon2': '0.190', 'AMMO3': '0.199', 'weapon4': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.186', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.464', 'FRAGCOUNT': '64.000'} [2023-02-25 14:47:40,937][36140] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:47:42,992][36138] Updated weights for policy 0, policy_version 55503 (0.0009) [2023-02-25 14:47:44,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13537.6). Total num frames: 227360768. Throughput: 0: 3397.2. Samples: 19334886. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:47:44,729][36114] Avg episode reward: [(0, '60.646')] [2023-02-25 14:47:46,011][36138] Updated weights for policy 0, policy_version 55513 (0.0009) [2023-02-25 14:47:49,014][36138] Updated weights for policy 0, policy_version 55523 (0.0009) [2023-02-25 14:47:49,038][36154] DAMAGECOUNT value on done: 1376666.0 [2023-02-25 14:47:49,038][36154] Sum rewards: 57.304, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.252', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'weapon5': '0.222', 'weapon2': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.440', 'WEAPON3': '1.050', 'weapon3': '2.792', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.895', 'FRAGCOUNT': '47.500'} [2023-02-25 14:47:49,341][36154] DAMAGECOUNT value on done: 1358963.0 [2023-02-25 14:47:49,342][36154] Sum rewards: 65.145, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.210', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.026', 'weapon4': '0.032', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon2': '0.942', 'WEAPON3': '1.000', 'weapon3': '2.838', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '52.000'} [2023-02-25 14:47:49,461][36155] DAMAGECOUNT value on done: 1372024.0 [2023-02-25 14:47:49,461][36155] Sum rewards: 58.850, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.090', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.033', 'weapon4': '0.146', 'AMMO4': '0.167', 'weapon5': '0.196', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.474', 'WEAPON3': '1.250', 'weapon3': '2.940', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.591', 'FRAGCOUNT': '52.000'} [2023-02-25 14:47:49,591][36154] DAMAGECOUNT value on done: 1389929.0 [2023-02-25 14:47:49,591][36154] Sum rewards: 62.762, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.190', 'AMMO5': '0.017', 'AMMO2': '0.035', 'AMMO3': '0.142', 'AMMO4': '0.175', 'weapon5': '0.176', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.498', 'weapon2': '0.504', 'WEAPON3': '0.900', 'weapon3': '2.582', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.002', 'FRAGCOUNT': '53.000'} [2023-02-25 14:47:49,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13585.1, 300 sec: 13537.6). Total num frames: 227430400. Throughput: 0: 3399.3. Samples: 19355316. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:47:49,730][36114] Avg episode reward: [(0, '60.509')] [2023-02-25 14:47:49,779][36155] DAMAGECOUNT value on done: 1371597.0 [2023-02-25 14:47:49,779][36155] Sum rewards: 53.175, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.432', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.069', 'WEAPON4': '0.150', 'weapon2': '0.210', 'AMMO3': '0.230', 'weapon4': '0.294', 'WEAPON3': '1.400', 'HITCOUNT': '3.230', 'weapon3': '3.276', 'DAMAGECOUNT': '14.868', 'FRAGCOUNT': '46.000'} [2023-02-25 14:47:49,887][36154] DAMAGECOUNT value on done: 1370383.0 [2023-02-25 14:47:49,888][36154] Sum rewards: 55.511, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.760', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.060', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.135', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon2': '0.244', 'weapon4': '0.446', 'WEAPON3': '1.250', 'weapon3': '2.934', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.586', 'FRAGCOUNT': '48.000'} [2023-02-25 14:47:50,017][36141] DAMAGECOUNT value on done: 1382178.0 [2023-02-25 14:47:50,018][36141] Sum rewards: 49.359, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.940', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.112', 'AMMO3': '0.196', 'AMMO4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.374', 'WEAPON4': '0.500', 'weapon4': '0.624', 'WEAPON3': '1.200', 'weapon3': '2.638', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.635', 'FRAGCOUNT': '46.000'} [2023-02-25 14:47:50,052][36139] DAMAGECOUNT value on done: 1373986.0 [2023-02-25 14:47:50,053][36139] Sum rewards: 62.051, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.802', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.194', 'weapon2': '0.198', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.386', 'WEAPON3': '1.350', 'weapon3': '2.976', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.354', 'FRAGCOUNT': '55.000'} [2023-02-25 14:47:50,314][36141] DAMAGECOUNT value on done: 1376627.0 [2023-02-25 14:47:50,314][36141] Sum rewards: 50.811, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.718', 'ARMOR': '0.008', 'AMMO5': '0.027', 'AMMO2': '0.067', 'AMMO3': '0.160', 'weapon2': '0.310', 'AMMO4': '0.333', 'weapon5': '0.544', 'WEAPON5': '0.700', 'WEAPON4': '0.750', 'weapon4': '0.934', 'WEAPON3': '0.950', 'weapon3': '1.754', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '44.000'} [2023-02-25 14:47:50,367][36139] DAMAGECOUNT value on done: 1371190.0 [2023-02-25 14:47:50,368][36139] Sum rewards: 52.352, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.290', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon5': '0.120', 'AMMO3': '0.169', 'AMMO4': '0.223', 'weapon2': '0.388', 'WEAPON5': '0.400', 'weapon4': '0.532', 'WEAPON4': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.712', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.569', 'FRAGCOUNT': '47.000'} [2023-02-25 14:47:50,501][36139] DAMAGECOUNT value on done: 1383309.0 [2023-02-25 14:47:50,502][36139] Sum rewards: 54.620, reward structure: {'DEATHCOUNT': '-11.250', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO3': '0.114', 'AMMO4': '0.143', 'weapon5': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.476', 'HEALTH': '0.506', 'weapon4': '0.530', 'WEAPON3': '0.650', 'weapon3': '2.540', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '12.396', 'FRAGCOUNT': '45.000'} [2023-02-25 14:47:50,564][36141] DAMAGECOUNT value on done: 1367714.0 [2023-02-25 14:47:50,565][36141] Sum rewards: 56.450, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.690', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO3': '0.154', 'AMMO4': '0.158', 'weapon5': '0.220', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.470', 'weapon4': '0.794', 'WEAPON3': '1.000', 'weapon3': '2.288', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.274', 'FRAGCOUNT': '48.000'} [2023-02-25 14:47:50,791][36139] DAMAGECOUNT value on done: 1381713.0 [2023-02-25 14:47:50,792][36139] Sum rewards: 68.211, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.848', 'AMMO5': '0.014', 'AMMO2': '0.043', 'AMMO3': '0.143', 'AMMO4': '0.217', 'weapon2': '0.244', 'weapon5': '0.260', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'weapon4': '1.054', 'weapon3': '2.172', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.451', 'FRAGCOUNT': '56.000'} [2023-02-25 14:47:50,829][36155] DAMAGECOUNT value on done: 1388311.0 [2023-02-25 14:47:50,830][36155] Sum rewards: 63.801, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.090', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon5': '0.120', 'weapon4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.236', 'AMMO3': '0.271', 'WEAPON3': '1.600', 'weapon3': '3.244', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '56.000'} [2023-02-25 14:47:50,876][36141] DAMAGECOUNT value on done: 1354005.0 [2023-02-25 14:47:50,876][36141] Sum rewards: 54.897, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.886', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.052', 'weapon5': '0.092', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon2': '0.376', 'WEAPON3': '1.300', 'HITCOUNT': '2.890', 'weapon3': '3.258', 'DAMAGECOUNT': '15.291', 'FRAGCOUNT': '47.000'} [2023-02-25 14:47:51,134][36155] DAMAGECOUNT value on done: 1367609.0 [2023-02-25 14:47:51,135][36155] Sum rewards: 61.653, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.199', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO3': '0.219', 'weapon2': '0.298', 'WEAPON3': '1.450', 'HITCOUNT': '3.250', 'weapon3': '3.544', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '52.000'} [2023-02-25 14:47:52,050][36138] Updated weights for policy 0, policy_version 55533 (0.0009) [2023-02-25 14:47:52,986][36157] DAMAGECOUNT value on done: 1382789.0 [2023-02-25 14:47:52,986][36157] Sum rewards: 53.907, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.432', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO3': '0.169', 'weapon5': '0.172', 'AMMO4': '0.184', 'weapon2': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.704', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.641', 'FRAGCOUNT': '48.000'} [2023-02-25 14:47:53,290][36157] DAMAGECOUNT value on done: 1373701.0 [2023-02-25 14:47:53,291][36157] Sum rewards: 69.786, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.389', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.064', 'AMMO4': '0.081', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.271', 'weapon2': '0.306', 'WEAPON3': '1.550', 'weapon3': '3.276', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '61.500'} [2023-02-25 14:47:53,608][36157] DAMAGECOUNT value on done: 1381831.0 [2023-02-25 14:47:53,609][36157] Sum rewards: 63.530, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.645', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.044', 'AMMO4': '0.055', 'WEAPON5': '0.100', 'weapon2': '0.146', 'WEAPON4': '0.200', 'AMMO3': '0.281', 'weapon4': '0.316', 'WEAPON3': '1.750', 'weapon3': '3.284', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '57.000'} [2023-02-25 14:47:53,922][36157] DAMAGECOUNT value on done: 1375898.0 [2023-02-25 14:47:53,922][36157] Sum rewards: 53.400, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.652', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.096', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'weapon2': '0.178', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon4': '0.486', 'WEAPON3': '1.400', 'HITCOUNT': '2.780', 'weapon3': '3.014', 'DAMAGECOUNT': '14.805', 'FRAGCOUNT': '48.000'} [2023-02-25 14:47:54,296][36140] DAMAGECOUNT value on done: 1382764.0 [2023-02-25 14:47:54,296][36140] Sum rewards: 47.281, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.430', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.112', 'weapon4': '0.186', 'AMMO4': '0.210', 'AMMO3': '0.233', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.464', 'WEAPON3': '1.350', 'HITCOUNT': '2.770', 'weapon3': '3.010', 'DAMAGECOUNT': '14.175', 'FRAGCOUNT': '43.000'} [2023-02-25 14:47:54,496][36140] DAMAGECOUNT value on done: 1378796.0 [2023-02-25 14:47:54,497][36140] Sum rewards: 53.566, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.380', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.038', 'AMMO4': '0.189', 'weapon2': '0.252', 'weapon5': '0.256', 'AMMO3': '0.259', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.564', 'WEAPON3': '1.500', 'weapon3': '2.500', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '51.000'} [2023-02-25 14:47:54,615][36140] DAMAGECOUNT value on done: 1362581.0 [2023-02-25 14:47:54,615][36140] Sum rewards: 44.622, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.527', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.039', 'weapon5': '0.114', 'weapon2': '0.162', 'AMMO3': '0.178', 'AMMO4': '0.193', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.616', 'WEAPON3': '1.150', 'HITCOUNT': '2.740', 'weapon3': '2.908', 'DAMAGECOUNT': '12.525', 'FRAGCOUNT': '40.000'} [2023-02-25 14:47:54,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13585.1, 300 sec: 13537.6). Total num frames: 227495936. Throughput: 0: 3400.0. Samples: 19365480. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:47:54,729][36114] Avg episode reward: [(0, '59.750')] [2023-02-25 14:47:54,812][36140] DAMAGECOUNT value on done: 1363084.0 [2023-02-25 14:47:54,812][36140] Sum rewards: 51.179, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.742', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon2': '0.216', 'AMMO4': '0.228', 'WEAPON4': '0.300', 'weapon4': '0.544', 'WEAPON3': '1.200', 'HITCOUNT': '2.870', 'weapon3': '3.002', 'DAMAGECOUNT': '13.857', 'FRAGCOUNT': '44.500'} [2023-02-25 14:47:55,065][36138] Updated weights for policy 0, policy_version 55543 (0.0009) [2023-02-25 14:47:57,679][36142] DAMAGECOUNT value on done: 1367937.0 [2023-02-25 14:47:57,679][36142] Sum rewards: 68.625, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.620', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'weapon5': '0.142', 'weapon4': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.368', 'WEAPON3': '1.350', 'weapon3': '3.168', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.908', 'FRAGCOUNT': '58.000'} [2023-02-25 14:47:57,998][36142] DAMAGECOUNT value on done: 1363027.0 [2023-02-25 14:47:57,998][36142] Sum rewards: 62.567, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.525', 'AMMO5': '0.023', 'AMMO2': '0.051', 'AMMO3': '0.136', 'AMMO4': '0.257', 'weapon2': '0.324', 'weapon5': '0.430', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'weapon4': '0.776', 'WEAPON3': '0.900', 'weapon3': '2.090', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.954', 'FRAGCOUNT': '53.500'} [2023-02-25 14:47:58,004][36140] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:47:58,070][36138] Updated weights for policy 0, policy_version 55553 (0.0009) [2023-02-25 14:47:58,614][36142] DAMAGECOUNT value on done: 1375711.0 [2023-02-25 14:47:58,615][36142] Sum rewards: 64.142, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.660', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.224', 'WEAPON4': '0.250', 'weapon4': '0.492', 'WEAPON3': '1.400', 'weapon3': '2.946', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '56.000'} [2023-02-25 14:47:58,921][36142] DAMAGECOUNT value on done: 1378703.0 [2023-02-25 14:47:58,922][36142] Sum rewards: 57.227, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.834', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.174', 'AMMO4': '0.186', 'AMMO3': '0.187', 'weapon2': '0.370', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.542', 'WEAPON3': '1.150', 'weapon3': '2.644', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.478', 'FRAGCOUNT': '50.000'} [2023-02-25 14:47:59,490][36156] DAMAGECOUNT value on done: 1389088.0 [2023-02-25 14:47:59,490][36156] Sum rewards: 72.622, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.504', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.138', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon2': '0.434', 'weapon4': '0.516', 'WEAPON3': '0.900', 'weapon3': '2.710', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '57.000'} [2023-02-25 14:47:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13537.6). Total num frames: 227565568. Throughput: 0: 3399.7. Samples: 19385884. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:47:59,730][36114] Avg episode reward: [(0, '59.903')] [2023-02-25 14:47:59,807][36156] DAMAGECOUNT value on done: 1366795.0 [2023-02-25 14:47:59,808][36156] Sum rewards: 53.513, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.144', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.134', 'weapon5': '0.166', 'AMMO4': '0.167', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.300', 'HITCOUNT': '2.930', 'weapon3': '3.018', 'DAMAGECOUNT': '13.680', 'FRAGCOUNT': '48.000'} [2023-02-25 14:47:59,821][36156] DAMAGECOUNT value on done: 1383487.0 [2023-02-25 14:47:59,821][36156] Sum rewards: 63.444, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.057', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.129', 'weapon5': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.398', 'weapon4': '0.572', 'WEAPON3': '0.900', 'weapon3': '2.622', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '51.000'} [2023-02-25 14:48:00,142][36156] DAMAGECOUNT value on done: 1371248.0 [2023-02-25 14:48:00,142][36156] Sum rewards: 56.141, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.600', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.129', 'AMMO3': '0.143', 'WEAPON4': '0.350', 'weapon4': '0.460', 'weapon2': '0.464', 'WEAPON3': '1.000', 'weapon3': '2.844', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.003', 'FRAGCOUNT': '47.000'} [2023-02-25 14:48:01,124][36138] Updated weights for policy 0, policy_version 55563 (0.0009) [2023-02-25 14:48:04,164][36138] Updated weights for policy 0, policy_version 55573 (0.0010) [2023-02-25 14:48:04,729][36114] Fps is (10 sec: 13516.5, 60 sec: 13585.0, 300 sec: 13537.6). Total num frames: 227631104. Throughput: 0: 3395.0. Samples: 19406084. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:48:04,730][36114] Avg episode reward: [(0, '60.071')] [2023-02-25 14:48:07,195][36138] Updated weights for policy 0, policy_version 55583 (0.0009) [2023-02-25 14:48:08,823][36154] DAMAGECOUNT value on done: 1383030.0 [2023-02-25 14:48:08,823][36154] Sum rewards: 74.685, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.185', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.192', 'weapon2': '0.204', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.342', 'WEAPON3': '1.500', 'weapon3': '2.964', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.062', 'FRAGCOUNT': '65.000'} [2023-02-25 14:48:09,143][36154] DAMAGECOUNT value on done: 1364449.0 [2023-02-25 14:48:09,143][36154] Sum rewards: 66.666, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.455', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.070', 'AMMO4': '0.098', 'WEAPON5': '0.150', 'weapon4': '0.160', 'weapon2': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '3.220', 'weapon3': '3.358', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '59.000'} [2023-02-25 14:48:09,361][36155] DAMAGECOUNT value on done: 1376801.0 [2023-02-25 14:48:09,362][36155] Sum rewards: 55.875, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.502', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.166', 'AMMO3': '0.174', 'AMMO4': '0.193', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.438', 'weapon4': '0.540', 'WEAPON3': '0.950', 'weapon3': '2.580', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.331', 'FRAGCOUNT': '47.500'} [2023-02-25 14:48:09,388][36154] DAMAGECOUNT value on done: 1395772.0 [2023-02-25 14:48:09,389][36154] Sum rewards: 69.767, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.672', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.104', 'WEAPON5': '0.150', 'weapon2': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'weapon4': '0.404', 'WEAPON3': '1.350', 'weapon3': '3.030', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '59.000'} [2023-02-25 14:48:09,656][36155] DAMAGECOUNT value on done: 1376596.0 [2023-02-25 14:48:09,657][36155] Sum rewards: 54.531, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.565', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.152', 'AMMO4': '0.162', 'weapon4': '0.210', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.550', 'HITCOUNT': '3.000', 'weapon3': '3.090', 'DAMAGECOUNT': '14.982', 'FRAGCOUNT': '48.000'} [2023-02-25 14:48:09,690][36154] DAMAGECOUNT value on done: 1375460.0 [2023-02-25 14:48:09,691][36154] Sum rewards: 60.045, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.800', 'ARMOR': '0.004', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon4': '0.210', 'weapon2': '0.454', 'WEAPON3': '1.300', 'weapon3': '3.176', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.931', 'FRAGCOUNT': '51.000'} [2023-02-25 14:48:09,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13585.1, 300 sec: 13537.6). Total num frames: 227700736. Throughput: 0: 3396.4. Samples: 19416210. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:48:09,729][36114] Avg episode reward: [(0, '60.345')] [2023-02-25 14:48:09,854][36139] DAMAGECOUNT value on done: 1380362.0 [2023-02-25 14:48:09,854][36139] Sum rewards: 74.310, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.064', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.047', 'weapon5': '0.092', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'AMMO4': '0.236', 'WEAPON4': '0.350', 'weapon4': '0.518', 'weapon2': '0.560', 'WEAPON3': '1.000', 'weapon3': '2.572', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.128', 'FRAGCOUNT': '60.000'} [2023-02-25 14:48:09,877][36141] DAMAGECOUNT value on done: 1386445.0 [2023-02-25 14:48:09,878][36141] Sum rewards: 45.913, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.970', 'AMMO5': '0.025', 'AMMO2': '0.047', 'weapon5': '0.166', 'AMMO3': '0.215', 'AMMO4': '0.233', 'weapon2': '0.382', 'weapon4': '0.430', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.444', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.801', 'FRAGCOUNT': '42.000'} [2023-02-25 14:48:10,172][36139] DAMAGECOUNT value on done: 1375306.0 [2023-02-25 14:48:10,172][36139] Sum rewards: 49.287, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.158', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'WEAPON4': '0.200', 'weapon5': '0.218', 'weapon2': '0.340', 'WEAPON3': '0.750', 'weapon4': '0.884', 'weapon3': '2.386', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.348', 'FRAGCOUNT': '40.000'} [2023-02-25 14:48:10,176][36141] DAMAGECOUNT value on done: 1381724.0 [2023-02-25 14:48:10,176][36141] Sum rewards: 57.192, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.998', 'ARMOR': '0.005', 'AMMO5': '0.017', 'AMMO2': '0.033', 'AMMO3': '0.117', 'AMMO4': '0.166', 'weapon2': '0.184', 'weapon5': '0.266', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '0.700', 'weapon4': '0.976', 'weapon3': '2.332', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.213', 'FRAGCOUNT': '46.000'} [2023-02-25 14:48:10,217][36138] Updated weights for policy 0, policy_version 55593 (0.0010) [2023-02-25 14:48:10,309][36139] DAMAGECOUNT value on done: 1387912.0 [2023-02-25 14:48:10,310][36139] Sum rewards: 55.083, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.332', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon5': '0.166', 'AMMO3': '0.175', 'WEAPON5': '0.250', 'AMMO4': '0.267', 'WEAPON4': '0.400', 'weapon2': '0.456', 'weapon4': '0.826', 'WEAPON3': '1.100', 'weapon3': '2.196', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.809', 'FRAGCOUNT': '49.000'} [2023-02-25 14:48:10,427][36141] DAMAGECOUNT value on done: 1372984.0 [2023-02-25 14:48:10,428][36141] Sum rewards: 59.874, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.379', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon7': '0.064', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO4': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.178', 'weapon2': '0.196', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.730', 'WEAPON3': '1.100', 'weapon3': '2.600', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.810', 'FRAGCOUNT': '50.000'} [2023-02-25 14:48:10,522][36155] DAMAGECOUNT value on done: 1392206.0 [2023-02-25 14:48:10,522][36155] Sum rewards: 49.133, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.926', 'AMMO5': '0.011', 'AMMO2': '0.051', 'AMMO3': '0.173', 'weapon5': '0.182', 'weapon2': '0.242', 'AMMO4': '0.256', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.910', 'WEAPON3': '1.050', 'weapon3': '2.048', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '11.685', 'FRAGCOUNT': '45.000'} [2023-02-25 14:48:10,607][36139] DAMAGECOUNT value on done: 1386693.0 [2023-02-25 14:48:10,608][36139] Sum rewards: 59.131, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.128', 'AMMO5': '0.010', 'AMMO2': '0.050', 'AMMO3': '0.158', 'weapon5': '0.196', 'WEAPON5': '0.250', 'AMMO4': '0.252', 'weapon4': '0.352', 'WEAPON4': '0.450', 'weapon2': '0.662', 'WEAPON3': '0.850', 'weapon3': '2.508', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '14.940', 'FRAGCOUNT': '50.000'} [2023-02-25 14:48:10,734][36141] DAMAGECOUNT value on done: 1358587.0 [2023-02-25 14:48:10,735][36141] Sum rewards: 48.208, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.796', 'AMMO5': '0.011', 'AMMO2': '0.052', 'weapon5': '0.176', 'AMMO3': '0.206', 'AMMO4': '0.258', 'WEAPON5': '0.350', 'weapon2': '0.388', 'weapon4': '0.434', 'ARMOR': '0.455', 'WEAPON4': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.718', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.746', 'FRAGCOUNT': '45.000'} [2023-02-25 14:48:10,837][36155] DAMAGECOUNT value on done: 1371948.0 [2023-02-25 14:48:10,838][36155] Sum rewards: 52.744, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.780', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.201', 'weapon4': '0.376', 'weapon2': '0.418', 'WEAPON3': '1.150', 'HITCOUNT': '2.750', 'weapon3': '2.924', 'DAMAGECOUNT': '13.017', 'FRAGCOUNT': '45.000'} [2023-02-25 14:48:12,778][36157] DAMAGECOUNT value on done: 1388069.0 [2023-02-25 14:48:12,778][36157] Sum rewards: 58.631, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.606', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon2': '0.226', 'weapon4': '0.446', 'WEAPON3': '1.050', 'weapon3': '2.982', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.840', 'FRAGCOUNT': '49.000'} [2023-02-25 14:48:13,090][36157] DAMAGECOUNT value on done: 1378069.0 [2023-02-25 14:48:13,090][36157] Sum rewards: 44.223, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.459', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.073', 'AMMO3': '0.217', 'weapon5': '0.300', 'AMMO4': '0.365', 'weapon4': '0.370', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon2': '0.622', 'WEAPON3': '1.250', 'weapon3': '2.326', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '13.104', 'FRAGCOUNT': '41.000'} [2023-02-25 14:48:13,229][36138] Updated weights for policy 0, policy_version 55603 (0.0009) [2023-02-25 14:48:13,367][36157] DAMAGECOUNT value on done: 1387825.0 [2023-02-25 14:48:13,367][36157] Sum rewards: 73.788, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.380', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.016', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'weapon5': '0.130', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.422', 'WEAPON3': '1.300', 'weapon3': '3.230', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '62.500'} [2023-02-25 14:48:13,688][36157] DAMAGECOUNT value on done: 1381126.0 [2023-02-25 14:48:13,689][36157] Sum rewards: 54.347, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-1.956', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.054', 'weapon5': '0.152', 'AMMO3': '0.246', 'AMMO4': '0.272', 'weapon4': '0.354', 'weapon2': '0.404', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.680', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '51.000'} [2023-02-25 14:48:14,249][36140] DAMAGECOUNT value on done: 1388129.0 [2023-02-25 14:48:14,249][36140] Sum rewards: 58.801, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.370', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.050', 'AMMO4': '0.101', 'weapon4': '0.166', 'weapon2': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.275', 'WEAPON3': '1.550', 'HITCOUNT': '3.250', 'weapon3': '3.310', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '53.000'} [2023-02-25 14:48:14,444][36140] DAMAGECOUNT value on done: 1383877.0 [2023-02-25 14:48:14,444][36140] Sum rewards: 58.257, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.919', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.143', 'AMMO3': '0.189', 'weapon5': '0.218', 'weapon2': '0.336', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.432', 'WEAPON3': '1.150', 'weapon3': '2.744', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.243', 'FRAGCOUNT': '50.000'} [2023-02-25 14:48:14,572][36140] DAMAGECOUNT value on done: 1368220.0 [2023-02-25 14:48:14,572][36140] Sum rewards: 66.584, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.442', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon2': '0.176', 'weapon5': '0.182', 'AMMO3': '0.197', 'AMMO4': '0.221', 'weapon4': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.140', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '57.000'} [2023-02-25 14:48:14,729][36114] Fps is (10 sec: 13517.1, 60 sec: 13516.8, 300 sec: 13537.6). Total num frames: 227766272. Throughput: 0: 3397.4. Samples: 19436570. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:48:14,729][36114] Avg episode reward: [(0, '59.288')] [2023-02-25 14:48:14,760][36140] DAMAGECOUNT value on done: 1368267.0 [2023-02-25 14:48:14,760][36140] Sum rewards: 53.747, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.946', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.128', 'AMMO4': '0.159', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon4': '0.340', 'WEAPON4': '0.350', 'weapon2': '0.392', 'WEAPON3': '1.450', 'weapon3': '2.820', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.531', 'FRAGCOUNT': '49.000'} [2023-02-25 14:48:16,318][36138] Updated weights for policy 0, policy_version 55613 (0.0010) [2023-02-25 14:48:17,683][36142] DAMAGECOUNT value on done: 1373245.0 [2023-02-25 14:48:17,684][36142] Sum rewards: 60.098, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.212', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.118', 'AMMO4': '0.149', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.444', 'weapon2': '0.448', 'WEAPON3': '0.950', 'weapon3': '2.798', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.924', 'FRAGCOUNT': '49.000'} [2023-02-25 14:48:18,000][36142] DAMAGECOUNT value on done: 1368043.0 [2023-02-25 14:48:18,001][36142] Sum rewards: 57.802, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.990', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.174', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'WEAPON4': '0.350', 'weapon2': '0.398', 'weapon4': '0.558', 'WEAPON3': '1.550', 'weapon3': '2.614', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '53.000'} [2023-02-25 14:48:18,627][36142] DAMAGECOUNT value on done: 1381181.0 [2023-02-25 14:48:18,627][36142] Sum rewards: 60.752, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.317', 'AMMO5': '0.006', 'AMMO2': '0.039', 'weapon5': '0.080', 'AMMO4': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon4': '0.268', 'weapon2': '0.298', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.124', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.410', 'FRAGCOUNT': '54.000'} [2023-02-25 14:48:18,929][36142] DAMAGECOUNT value on done: 1384584.0 [2023-02-25 14:48:18,929][36142] Sum rewards: 69.785, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.135', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'weapon4': '0.272', 'weapon2': '0.614', 'WEAPON3': '1.050', 'weapon3': '2.922', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '17.643', 'FRAGCOUNT': '56.000'} [2023-02-25 14:48:19,346][36138] Updated weights for policy 0, policy_version 55623 (0.0009) [2023-02-25 14:48:19,451][36156] DAMAGECOUNT value on done: 1393872.0 [2023-02-25 14:48:19,451][36156] Sum rewards: 54.214, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.423', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.112', 'AMMO3': '0.154', 'AMMO4': '0.176', 'WEAPON5': '0.250', 'weapon2': '0.372', 'WEAPON4': '0.400', 'weapon4': '0.582', 'WEAPON3': '1.100', 'weapon3': '2.694', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.352', 'FRAGCOUNT': '47.000'} [2023-02-25 14:48:19,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 227835904. Throughput: 0: 3389.6. Samples: 19456708. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:48:19,730][36114] Avg episode reward: [(0, '59.269')] [2023-02-25 14:48:19,751][36156] DAMAGECOUNT value on done: 1371233.0 [2023-02-25 14:48:19,752][36156] Sum rewards: 48.652, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.832', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.056', 'AMMO3': '0.109', 'AMMO4': '0.280', 'weapon5': '0.400', 'weapon2': '0.480', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '0.750', 'weapon4': '0.814', 'weapon3': '2.078', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '13.314', 'FRAGCOUNT': '42.000'} [2023-02-25 14:48:19,846][36156] DAMAGECOUNT value on done: 1389182.0 [2023-02-25 14:48:19,847][36156] Sum rewards: 66.290, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.650', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.012', 'weapon4': '0.026', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.218', 'weapon2': '0.392', 'WEAPON3': '1.400', 'weapon3': '3.308', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '56.000'} [2023-02-25 14:48:20,157][36156] DAMAGECOUNT value on done: 1376005.0 [2023-02-25 14:48:20,157][36156] Sum rewards: 46.955, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.880', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.074', 'AMMO3': '0.191', 'weapon5': '0.290', 'AMMO4': '0.372', 'weapon2': '0.574', 'WEAPON5': '0.700', 'weapon4': '0.784', 'WEAPON4': '0.900', 'WEAPON3': '1.100', 'weapon3': '2.020', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '14.271', 'FRAGCOUNT': '44.000'} [2023-02-25 14:48:22,341][36138] Updated weights for policy 0, policy_version 55633 (0.0009) [2023-02-25 14:48:24,480][36156] Large shaping reward 2.551 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.081, -27.0), ('weapon5', 0.002)] [2023-02-25 14:48:24,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13551.5). Total num frames: 227901440. Throughput: 0: 3388.3. Samples: 19466882. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:48:24,730][36114] Avg episode reward: [(0, '58.906')] [2023-02-25 14:48:25,330][36138] Updated weights for policy 0, policy_version 55643 (0.0008) [2023-02-25 14:48:28,323][36138] Updated weights for policy 0, policy_version 55653 (0.0009) [2023-02-25 14:48:28,608][36154] DAMAGECOUNT value on done: 1387849.0 [2023-02-25 14:48:28,609][36154] Sum rewards: 56.889, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.682', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon5': '0.032', 'AMMO4': '0.143', 'AMMO3': '0.213', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.470', 'weapon2': '0.538', 'WEAPON3': '1.300', 'weapon3': '2.652', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.457', 'FRAGCOUNT': '50.000'} [2023-02-25 14:48:28,917][36154] DAMAGECOUNT value on done: 1369984.0 [2023-02-25 14:48:28,918][36154] Sum rewards: 71.791, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.741', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.138', 'AMMO3': '0.163', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.382', 'weapon2': '0.470', 'WEAPON3': '1.050', 'weapon3': '2.804', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.605', 'FRAGCOUNT': '59.000'} [2023-02-25 14:48:29,153][36154] DAMAGECOUNT value on done: 1400956.0 [2023-02-25 14:48:29,154][36154] Sum rewards: 64.264, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.340', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.130', 'weapon4': '0.148', 'AMMO3': '0.166', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.100', 'weapon3': '3.076', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.552', 'FRAGCOUNT': '54.000'} [2023-02-25 14:48:29,180][36155] DAMAGECOUNT value on done: 1381298.0 [2023-02-25 14:48:29,181][36155] Sum rewards: 50.206, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.077', 'weapon5': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO3': '0.174', 'AMMO4': '0.185', 'WEAPON5': '0.200', 'weapon4': '0.378', 'WEAPON4': '0.400', 'weapon2': '0.438', 'WEAPON3': '1.050', 'weapon3': '2.966', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '13.491', 'FRAGCOUNT': '44.000'} [2023-02-25 14:48:29,451][36154] DAMAGECOUNT value on done: 1381061.0 [2023-02-25 14:48:29,451][36154] Sum rewards: 63.779, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.800', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.096', 'weapon5': '0.116', 'AMMO4': '0.171', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.250', 'weapon3': '3.114', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '54.000'} [2023-02-25 14:48:29,491][36155] DAMAGECOUNT value on done: 1381545.0 [2023-02-25 14:48:29,492][36155] Sum rewards: 50.627, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.860', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.052', 'AMMO3': '0.172', 'weapon5': '0.174', 'AMMO4': '0.261', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.536', 'weapon2': '0.674', 'WEAPON3': '0.950', 'weapon3': '2.326', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.847', 'FRAGCOUNT': '42.000'} [2023-02-25 14:48:29,669][36139] DAMAGECOUNT value on done: 1386085.0 [2023-02-25 14:48:29,669][36139] Sum rewards: 64.310, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.448', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.134', 'AMMO4': '0.148', 'weapon2': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.292', 'weapon4': '0.488', 'WEAPON3': '1.750', 'weapon3': '2.654', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.169', 'FRAGCOUNT': '59.000'} [2023-02-25 14:48:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 227971072. Throughput: 0: 3386.1. Samples: 19487262. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:48:29,730][36114] Avg episode reward: [(0, '58.889')] [2023-02-25 14:48:29,866][36141] DAMAGECOUNT value on done: 1391634.0 [2023-02-25 14:48:29,866][36141] Sum rewards: 59.892, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.665', 'AMMO5': '0.017', 'AMMO2': '0.040', 'AMMO3': '0.155', 'AMMO4': '0.201', 'weapon5': '0.210', 'weapon2': '0.254', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.548', 'WEAPON3': '0.800', 'weapon3': '2.474', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '50.500'} [2023-02-25 14:48:29,976][36139] DAMAGECOUNT value on done: 1380495.0 [2023-02-25 14:48:29,977][36139] Sum rewards: 58.771, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-1.650', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.040', 'weapon5': '0.112', 'AMMO4': '0.199', 'WEAPON5': '0.250', 'weapon2': '0.258', 'AMMO3': '0.271', 'weapon4': '0.278', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.024', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '56.000'} [2023-02-25 14:48:30,180][36141] DAMAGECOUNT value on done: 1387235.0 [2023-02-25 14:48:30,180][36141] Sum rewards: 56.749, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.016', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.036', 'weapon4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO3': '0.194', 'weapon2': '0.564', 'WEAPON3': '1.250', 'weapon3': '3.068', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '47.000'} [2023-02-25 14:48:30,186][36139] DAMAGECOUNT value on done: 1393184.0 [2023-02-25 14:48:30,186][36139] Sum rewards: 63.595, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.042', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.108', 'AMMO3': '0.154', 'AMMO4': '0.202', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON4': '0.500', 'weapon4': '0.580', 'WEAPON3': '1.000', 'weapon3': '2.742', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.816', 'FRAGCOUNT': '54.000'} [2023-02-25 14:48:30,302][36155] DAMAGECOUNT value on done: 1396951.0 [2023-02-25 14:48:30,302][36155] Sum rewards: 56.160, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.870', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO3': '0.148', 'AMMO4': '0.178', 'WEAPON4': '0.300', 'weapon2': '0.366', 'weapon4': '0.572', 'WEAPON3': '1.000', 'weapon3': '2.746', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.235', 'FRAGCOUNT': '47.000'} [2023-02-25 14:48:30,423][36141] DAMAGECOUNT value on done: 1377732.0 [2023-02-25 14:48:30,424][36141] Sum rewards: 54.977, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.372', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.042', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon4': '0.194', 'WEAPON4': '0.250', 'weapon2': '0.308', 'WEAPON3': '1.050', 'HITCOUNT': '3.030', 'weapon3': '3.268', 'DAMAGECOUNT': '14.244', 'FRAGCOUNT': '47.000'} [2023-02-25 14:48:30,485][36139] DAMAGECOUNT value on done: 1391154.0 [2023-02-25 14:48:30,485][36139] Sum rewards: 50.330, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.740', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO3': '0.132', 'AMMO4': '0.155', 'weapon5': '0.260', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.662', 'weapon4': '0.728', 'WEAPON3': '0.800', 'weapon3': '2.056', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.383', 'FRAGCOUNT': '42.000'} [2023-02-25 14:48:30,614][36155] DAMAGECOUNT value on done: 1376767.0 [2023-02-25 14:48:30,614][36155] Sum rewards: 55.746, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.984', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO3': '0.167', 'AMMO4': '0.176', 'weapon5': '0.228', 'weapon2': '0.244', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.970', 'WEAPON3': '1.000', 'weapon3': '2.190', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.457', 'FRAGCOUNT': '47.000'} [2023-02-25 14:48:30,734][36141] DAMAGECOUNT value on done: 1364128.0 [2023-02-25 14:48:30,734][36141] Sum rewards: 62.743, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.190', 'AMMO2': '0.013', 'AMMO5': '0.013', 'AMMO4': '0.063', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon4': '0.304', 'weapon2': '0.820', 'WEAPON3': '1.300', 'weapon3': '2.440', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '53.000'} [2023-02-25 14:48:31,382][36138] Updated weights for policy 0, policy_version 55663 (0.0009) [2023-02-25 14:48:32,539][36157] DAMAGECOUNT value on done: 1393856.0 [2023-02-25 14:48:32,540][36157] Sum rewards: 72.620, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.017', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.042', 'AMMO4': '0.094', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon4': '0.248', 'weapon2': '0.388', 'WEAPON3': '1.350', 'weapon3': '3.108', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.361', 'FRAGCOUNT': '62.000'} [2023-02-25 14:48:32,843][36157] DAMAGECOUNT value on done: 1382325.0 [2023-02-25 14:48:32,844][36157] Sum rewards: 49.339, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.987', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.051', 'AMMO3': '0.145', 'weapon5': '0.160', 'AMMO4': '0.255', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.686', 'weapon4': '0.724', 'WEAPON3': '0.800', 'weapon3': '2.070', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '12.768', 'FRAGCOUNT': '43.000'} [2023-02-25 14:48:33,208][36157] DAMAGECOUNT value on done: 1392748.0 [2023-02-25 14:48:33,208][36157] Sum rewards: 59.193, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.747', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.140', 'WEAPON4': '0.300', 'weapon2': '0.336', 'WEAPON3': '0.900', 'weapon4': '1.020', 'weapon3': '2.206', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '14.769', 'FRAGCOUNT': '48.000'} [2023-02-25 14:48:33,507][36157] DAMAGECOUNT value on done: 1385937.0 [2023-02-25 14:48:33,508][36157] Sum rewards: 54.872, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.208', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.046', 'weapon5': '0.070', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.442', 'WEAPON3': '1.350', 'HITCOUNT': '3.070', 'weapon3': '3.180', 'DAMAGECOUNT': '14.433', 'FRAGCOUNT': '48.000'} [2023-02-25 14:48:34,187][36140] DAMAGECOUNT value on done: 1392952.0 [2023-02-25 14:48:34,187][36140] Sum rewards: 56.666, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.538', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon4': '0.124', 'weapon5': '0.140', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.350', 'HITCOUNT': '3.010', 'weapon3': '3.134', 'DAMAGECOUNT': '14.469', 'FRAGCOUNT': '50.000'} [2023-02-25 14:48:34,343][36140] DAMAGECOUNT value on done: 1389097.0 [2023-02-25 14:48:34,343][36140] Sum rewards: 54.403, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.474', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO3': '0.164', 'AMMO4': '0.185', 'weapon5': '0.232', 'WEAPON5': '0.350', 'weapon2': '0.452', 'WEAPON4': '0.550', 'weapon4': '0.656', 'WEAPON3': '1.050', 'weapon3': '2.354', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '45.500'} [2023-02-25 14:48:34,415][36138] Updated weights for policy 0, policy_version 55673 (0.0009) [2023-02-25 14:48:34,507][36140] DAMAGECOUNT value on done: 1373960.0 [2023-02-25 14:48:34,507][36140] Sum rewards: 69.937, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.568', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.148', 'AMMO4': '0.153', 'weapon4': '0.194', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.472', 'WEAPON3': '1.250', 'weapon3': '2.956', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '59.500'} [2023-02-25 14:48:34,660][36140] DAMAGECOUNT value on done: 1373422.0 [2023-02-25 14:48:34,661][36140] Sum rewards: 65.127, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'weapon4': '0.134', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'AMMO4': '0.155', 'HEALTH': '0.534', 'weapon2': '0.552', 'WEAPON3': '0.800', 'weapon3': '3.186', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.465', 'FRAGCOUNT': '51.000'} [2023-02-25 14:48:34,729][36114] Fps is (10 sec: 13926.4, 60 sec: 13585.1, 300 sec: 13579.3). Total num frames: 228040704. Throughput: 0: 3384.3. Samples: 19507610. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:48:34,730][36114] Avg episode reward: [(0, '58.872')] [2023-02-25 14:48:37,399][36138] Updated weights for policy 0, policy_version 55683 (0.0009) [2023-02-25 14:48:37,522][36142] DAMAGECOUNT value on done: 1377695.0 [2023-02-25 14:48:37,522][36142] Sum rewards: 52.831, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.310', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO3': '0.146', 'AMMO4': '0.147', 'weapon5': '0.240', 'weapon2': '0.280', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.792', 'WEAPON3': '0.950', 'weapon3': '2.450', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.350', 'FRAGCOUNT': '45.000'} [2023-02-25 14:48:37,830][36142] DAMAGECOUNT value on done: 1372555.0 [2023-02-25 14:48:37,831][36142] Sum rewards: 53.044, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.453', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.044', 'weapon5': '0.066', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon2': '0.660', 'WEAPON3': '1.000', 'HITCOUNT': '2.600', 'weapon3': '3.006', 'DAMAGECOUNT': '13.536', 'FRAGCOUNT': '44.000'} [2023-02-25 14:48:38,449][36142] DAMAGECOUNT value on done: 1385788.0 [2023-02-25 14:48:38,449][36142] Sum rewards: 54.721, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.693', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO3': '0.125', 'AMMO4': '0.177', 'weapon4': '0.236', 'weapon5': '0.286', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.752', 'WEAPON3': '0.800', 'weapon3': '2.382', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.821', 'FRAGCOUNT': '46.000'} [2023-02-25 14:48:38,750][36142] DAMAGECOUNT value on done: 1389885.0 [2023-02-25 14:48:38,751][36142] Sum rewards: 57.050, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.174', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon5': '0.120', 'AMMO4': '0.220', 'AMMO3': '0.225', 'weapon2': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.402', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.878', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '51.000'} [2023-02-25 14:48:39,159][36156] DAMAGECOUNT value on done: 1399078.0 [2023-02-25 14:48:39,160][36156] Sum rewards: 58.223, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.173', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.173', 'AMMO3': '0.191', 'weapon5': '0.246', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON4': '0.400', 'weapon4': '0.672', 'WEAPON3': '1.150', 'weapon3': '2.372', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.618', 'FRAGCOUNT': '50.000'} [2023-02-25 14:48:39,477][36156] DAMAGECOUNT value on done: 1376999.0 [2023-02-25 14:48:39,478][36156] Sum rewards: 77.450, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.711', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.088', 'weapon4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'weapon2': '0.446', 'WEAPON3': '1.150', 'weapon3': '3.240', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '64.000'} [2023-02-25 14:48:39,612][36156] DAMAGECOUNT value on done: 1393293.0 [2023-02-25 14:48:39,613][36156] Sum rewards: 51.237, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.988', 'AMMO5': '0.006', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'WEAPON4': '0.250', 'weapon4': '0.376', 'weapon2': '0.614', 'WEAPON3': '1.050', 'HITCOUNT': '2.630', 'weapon3': '2.718', 'DAMAGECOUNT': '12.333', 'FRAGCOUNT': '44.000'} [2023-02-25 14:48:39,729][36114] Fps is (10 sec: 13516.6, 60 sec: 13516.7, 300 sec: 13565.4). Total num frames: 228106240. Throughput: 0: 3386.6. Samples: 19517878. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:48:39,730][36114] Avg episode reward: [(0, '58.640')] [2023-02-25 14:48:39,914][36156] DAMAGECOUNT value on done: 1380885.0 [2023-02-25 14:48:39,915][36156] Sum rewards: 58.909, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.166', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.132', 'AMMO4': '0.173', 'weapon5': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.614', 'WEAPON3': '0.750', 'weapon4': '0.772', 'weapon3': '2.142', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.193', 'FRAGCOUNT': '47.000'} [2023-02-25 14:48:40,414][36138] Updated weights for policy 0, policy_version 55693 (0.0009) [2023-02-25 14:48:43,428][36138] Updated weights for policy 0, policy_version 55703 (0.0009) [2023-02-25 14:48:44,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 228175872. Throughput: 0: 3385.8. Samples: 19538246. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:48:44,729][36114] Avg episode reward: [(0, '58.549')] [2023-02-25 14:48:46,478][36138] Updated weights for policy 0, policy_version 55713 (0.0009) [2023-02-25 14:48:48,402][36154] DAMAGECOUNT value on done: 1392416.0 [2023-02-25 14:48:48,402][36154] Sum rewards: 55.386, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.200', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'weapon2': '0.514', 'weapon4': '0.520', 'WEAPON3': '0.950', 'weapon3': '2.438', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.701', 'FRAGCOUNT': '46.000'} [2023-02-25 14:48:48,713][36154] DAMAGECOUNT value on done: 1375807.0 [2023-02-25 14:48:48,713][36154] Sum rewards: 72.391, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.642', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.010', 'weapon5': '0.046', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.189', 'weapon4': '0.254', 'weapon2': '0.342', 'WEAPON3': '1.200', 'weapon3': '3.160', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '58.000'} [2023-02-25 14:48:48,966][36154] DAMAGECOUNT value on done: 1405827.0 [2023-02-25 14:48:48,967][36154] Sum rewards: 58.207, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.105', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO4': '0.032', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon2': '0.126', 'weapon4': '0.198', 'AMMO3': '0.302', 'WEAPON3': '1.750', 'HITCOUNT': '3.140', 'weapon3': '3.488', 'DAMAGECOUNT': '14.613', 'FRAGCOUNT': '54.000'} [2023-02-25 14:48:49,040][36155] DAMAGECOUNT value on done: 1386365.0 [2023-02-25 14:48:49,041][36155] Sum rewards: 55.355, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.506', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.128', 'AMMO4': '0.147', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'weapon4': '0.252', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.038', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.201', 'FRAGCOUNT': '49.000'} [2023-02-25 14:48:49,277][36154] DAMAGECOUNT value on done: 1386541.0 [2023-02-25 14:48:49,278][36154] Sum rewards: 66.899, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.205', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'weapon2': '0.212', 'AMMO3': '0.261', 'weapon4': '0.608', 'WEAPON3': '1.450', 'weapon3': '2.816', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '58.000'} [2023-02-25 14:48:49,342][36155] DAMAGECOUNT value on done: 1387583.0 [2023-02-25 14:48:49,342][36155] Sum rewards: 63.834, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.253', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.068', 'weapon5': '0.100', 'AMMO4': '0.164', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'weapon2': '0.280', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.244', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.114', 'FRAGCOUNT': '56.500'} [2023-02-25 14:48:49,353][36139] DAMAGECOUNT value on done: 1390764.0 [2023-02-25 14:48:49,353][36139] Sum rewards: 51.486, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.750', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.060', 'weapon5': '0.146', 'AMMO3': '0.212', 'AMMO4': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.510', 'weapon4': '0.688', 'WEAPON3': '1.300', 'weapon3': '2.336', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.037', 'FRAGCOUNT': '46.000'} [2023-02-25 14:48:49,542][36138] Updated weights for policy 0, policy_version 55723 (0.0010) [2023-02-25 14:48:49,666][36139] DAMAGECOUNT value on done: 1385816.0 [2023-02-25 14:48:49,667][36139] Sum rewards: 61.730, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.278', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.013', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'weapon4': '0.142', 'AMMO3': '0.176', 'weapon2': '0.398', 'WEAPON3': '1.100', 'weapon3': '3.278', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.963', 'FRAGCOUNT': '51.000'} [2023-02-25 14:48:49,729][36114] Fps is (10 sec: 13517.1, 60 sec: 13516.8, 300 sec: 13565.4). Total num frames: 228241408. Throughput: 0: 3384.7. Samples: 19558396. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:48:49,729][36114] Avg episode reward: [(0, '58.556')] [2023-02-25 14:48:49,840][36141] DAMAGECOUNT value on done: 1396479.0 [2023-02-25 14:48:49,840][36141] Sum rewards: 56.719, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.700', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.104', 'AMMO4': '0.140', 'weapon4': '0.152', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.600', 'HITCOUNT': '3.020', 'weapon3': '3.132', 'DAMAGECOUNT': '14.535', 'FRAGCOUNT': '53.000'} [2023-02-25 14:48:49,868][36139] DAMAGECOUNT value on done: 1398078.0 [2023-02-25 14:48:49,868][36139] Sum rewards: 61.115, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.111', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.021', 'weapon5': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.105', 'AMMO3': '0.190', 'weapon2': '0.556', 'WEAPON3': '1.200', 'HITCOUNT': '3.110', 'weapon3': '3.220', 'DAMAGECOUNT': '14.682', 'FRAGCOUNT': '51.000'} [2023-02-25 14:48:50,097][36155] DAMAGECOUNT value on done: 1403081.0 [2023-02-25 14:48:50,098][36155] Sum rewards: 67.712, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.389', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.117', 'weapon4': '0.134', 'weapon5': '0.224', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.456', 'WEAPON3': '1.400', 'weapon3': '2.942', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '58.000'} [2023-02-25 14:48:50,153][36139] DAMAGECOUNT value on done: 1396652.0 [2023-02-25 14:48:50,153][36141] DAMAGECOUNT value on done: 1393115.0 [2023-02-25 14:48:50,154][36139] Sum rewards: 65.676, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.848', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.148', 'AMMO4': '0.185', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.272', 'weapon4': '0.274', 'WEAPON3': '1.300', 'weapon3': '3.042', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '56.000'} [2023-02-25 14:48:50,154][36141] Sum rewards: 64.017, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.964', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.130', 'AMMO4': '0.145', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'weapon2': '0.504', 'weapon4': '0.514', 'WEAPON3': '1.400', 'weapon3': '2.490', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '55.000'} [2023-02-25 14:48:50,389][36141] DAMAGECOUNT value on done: 1383099.0 [2023-02-25 14:48:50,390][36141] Sum rewards: 61.778, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.599', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.048', 'AMMO3': '0.173', 'weapon4': '0.192', 'weapon5': '0.204', 'AMMO4': '0.239', 'weapon2': '0.470', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.816', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.101', 'FRAGCOUNT': '53.000'} [2023-02-25 14:48:50,406][36155] DAMAGECOUNT value on done: 1382901.0 [2023-02-25 14:48:50,407][36155] Sum rewards: 71.974, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.262', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.134', 'AMMO3': '0.215', 'weapon2': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.592', 'WEAPON3': '1.300', 'weapon3': '2.746', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '18.372', 'FRAGCOUNT': '61.000'} [2023-02-25 14:48:50,688][36141] DAMAGECOUNT value on done: 1368956.0 [2023-02-25 14:48:50,689][36141] Sum rewards: 54.167, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.874', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO4': '0.164', 'weapon5': '0.168', 'AMMO3': '0.208', 'weapon4': '0.218', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.978', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.454', 'FRAGCOUNT': '48.000'} [2023-02-25 14:48:52,354][36157] DAMAGECOUNT value on done: 1399882.0 [2023-02-25 14:48:52,354][36157] Sum rewards: 67.728, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.272', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.039', 'weapon5': '0.132', 'AMMO4': '0.193', 'AMMO3': '0.206', 'weapon2': '0.218', 'WEAPON5': '0.300', 'WEAPON4': '0.550', 'weapon4': '0.608', 'WEAPON3': '1.250', 'weapon3': '2.716', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '59.000'} [2023-02-25 14:48:52,558][36138] Updated weights for policy 0, policy_version 55733 (0.0009) [2023-02-25 14:48:52,663][36157] DAMAGECOUNT value on done: 1387783.0 [2023-02-25 14:48:52,663][36157] Sum rewards: 70.605, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.140', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.042', 'AMMO3': '0.180', 'weapon5': '0.192', 'weapon2': '0.196', 'AMMO4': '0.211', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.468', 'WEAPON3': '1.150', 'weapon3': '2.778', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '61.000'} [2023-02-25 14:48:53,039][36157] DAMAGECOUNT value on done: 1397843.0 [2023-02-25 14:48:53,040][36157] Sum rewards: 59.032, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.990', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.028', 'AMMO4': '0.082', 'weapon5': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'weapon2': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.040', 'weapon3': '3.308', 'DAMAGECOUNT': '15.285', 'FRAGCOUNT': '52.000'} [2023-02-25 14:48:53,347][36157] DAMAGECOUNT value on done: 1390854.0 [2023-02-25 14:48:53,347][36157] Sum rewards: 58.680, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.194', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.120', 'AMMO3': '0.156', 'AMMO4': '0.163', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.312', 'ARMOR': '0.400', 'weapon4': '0.838', 'WEAPON3': '0.950', 'weapon3': '2.386', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.751', 'FRAGCOUNT': '48.000'} [2023-02-25 14:48:54,012][36140] DAMAGECOUNT value on done: 1398307.0 [2023-02-25 14:48:54,012][36140] Sum rewards: 64.275, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.600', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.016', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'weapon2': '0.532', 'WEAPON3': '1.100', 'HITCOUNT': '3.190', 'weapon3': '3.266', 'DAMAGECOUNT': '16.065', 'FRAGCOUNT': '53.000'} [2023-02-25 14:48:54,151][36140] DAMAGECOUNT value on done: 1394055.0 [2023-02-25 14:48:54,152][36140] Sum rewards: 61.800, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.400', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.260', 'weapon2': '0.272', 'WEAPON3': '1.550', 'HITCOUNT': '3.400', 'weapon3': '3.456', 'DAMAGECOUNT': '14.559', 'FRAGCOUNT': '57.000'} [2023-02-25 14:48:54,310][36140] DAMAGECOUNT value on done: 1378865.0 [2023-02-25 14:48:54,310][36140] Sum rewards: 59.037, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.425', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.037', 'weapon5': '0.122', 'AMMO3': '0.155', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.288', 'weapon2': '0.752', 'WEAPON3': '1.050', 'weapon3': '2.638', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.715', 'FRAGCOUNT': '50.000'} [2023-02-25 14:48:54,457][36140] DAMAGECOUNT value on done: 1378817.0 [2023-02-25 14:48:54,457][36140] Sum rewards: 59.425, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.468', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.047', 'AMMO3': '0.222', 'AMMO4': '0.237', 'weapon2': '0.248', 'weapon5': '0.248', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.670', 'WEAPON3': '1.300', 'weapon3': '2.464', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '53.000'} [2023-02-25 14:48:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 228311040. Throughput: 0: 3385.8. Samples: 19568570. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:48:54,730][36114] Avg episode reward: [(0, '59.358')] [2023-02-25 14:48:55,553][36138] Updated weights for policy 0, policy_version 55743 (0.0009) [2023-02-25 14:48:57,389][36142] DAMAGECOUNT value on done: 1383012.0 [2023-02-25 14:48:57,390][36142] Sum rewards: 59.896, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.454', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.192', 'AMMO3': '0.205', 'weapon2': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.440', 'WEAPON3': '1.250', 'weapon3': '2.772', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '51.500'} [2023-02-25 14:48:57,704][36142] DAMAGECOUNT value on done: 1377068.0 [2023-02-25 14:48:57,704][36142] Sum rewards: 46.234, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.620', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.054', 'AMMO3': '0.155', 'AMMO4': '0.187', 'WEAPON5': '0.250', 'weapon2': '0.372', 'WEAPON4': '0.450', 'weapon4': '0.690', 'WEAPON3': '0.950', 'weapon3': '2.540', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.539', 'FRAGCOUNT': '40.500'} [2023-02-25 14:48:58,194][36141] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:48:58,306][36142] DAMAGECOUNT value on done: 1390700.0 [2023-02-25 14:48:58,306][36142] Sum rewards: 58.463, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.945', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.166', 'AMMO3': '0.210', 'AMMO4': '0.223', 'WEAPON5': '0.250', 'weapon2': '0.410', 'WEAPON4': '0.450', 'weapon4': '0.466', 'WEAPON3': '1.150', 'weapon3': '2.662', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.736', 'FRAGCOUNT': '52.000'} [2023-02-25 14:48:58,576][36138] Updated weights for policy 0, policy_version 55753 (0.0009) [2023-02-25 14:48:58,616][36142] DAMAGECOUNT value on done: 1394376.0 [2023-02-25 14:48:58,616][36142] Sum rewards: 53.771, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.564', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.136', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.360', 'weapon4': '0.544', 'WEAPON3': '1.100', 'weapon3': '2.734', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.473', 'FRAGCOUNT': '46.000'} [2023-02-25 14:48:59,138][36156] DAMAGECOUNT value on done: 1404374.0 [2023-02-25 14:48:59,139][36156] Sum rewards: 62.455, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.557', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon5': '0.076', 'AMMO4': '0.077', 'AMMO3': '0.201', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.386', 'weapon2': '0.498', 'WEAPON3': '1.250', 'weapon3': '2.790', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '15.888', 'FRAGCOUNT': '54.000'} [2023-02-25 14:48:59,466][36156] DAMAGECOUNT value on done: 1382796.0 [2023-02-25 14:48:59,467][36156] Sum rewards: 70.700, reward structure: {'DEATHCOUNT': '-15.000', 'ARMOR': '0.008', 'AMMO5': '0.014', 'HEALTH': '0.028', 'AMMO2': '0.038', 'weapon5': '0.136', 'AMMO3': '0.177', 'AMMO4': '0.190', 'weapon2': '0.290', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.640', 'WEAPON3': '1.000', 'weapon3': '2.628', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '59.000'} [2023-02-25 14:48:59,562][36156] DAMAGECOUNT value on done: 1398996.0 [2023-02-25 14:48:59,563][36156] Sum rewards: 67.900, reward structure: {'DEATHCOUNT': '-16.500', 'AMMO2': '0.004', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'weapon4': '0.114', 'AMMO3': '0.241', 'HEALTH': '0.315', 'weapon2': '0.522', 'WEAPON3': '1.300', 'weapon3': '3.156', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '58.000'} [2023-02-25 14:48:59,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13565.4). Total num frames: 228376576. Throughput: 0: 3388.5. Samples: 19589052. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:48:59,729][36114] Avg episode reward: [(0, '59.632')] [2023-02-25 14:48:59,878][36156] DAMAGECOUNT value on done: 1386180.0 [2023-02-25 14:48:59,879][36156] Sum rewards: 63.909, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.493', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'weapon5': '0.164', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.258', 'weapon4': '0.552', 'WEAPON3': '1.300', 'weapon3': '2.756', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '54.000'} [2023-02-25 14:49:01,581][36138] Updated weights for policy 0, policy_version 55763 (0.0009) [2023-02-25 14:49:04,611][36138] Updated weights for policy 0, policy_version 55773 (0.0009) [2023-02-25 14:49:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 228446208. Throughput: 0: 3390.5. Samples: 19609282. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:49:04,730][36114] Avg episode reward: [(0, '59.699')] [2023-02-25 14:49:05,772][36155] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:49:07,654][36138] Updated weights for policy 0, policy_version 55783 (0.0010) [2023-02-25 14:49:08,283][36154] DAMAGECOUNT value on done: 1396581.0 [2023-02-25 14:49:08,283][36154] Sum rewards: 51.370, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.130', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO3': '0.120', 'AMMO4': '0.125', 'weapon5': '0.196', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.504', 'weapon4': '0.628', 'weapon2': '0.644', 'WEAPON3': '0.800', 'weapon3': '2.356', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '12.495', 'FRAGCOUNT': '42.000'} [2023-02-25 14:49:08,593][36154] DAMAGECOUNT value on done: 1380313.0 [2023-02-25 14:49:08,593][36154] Sum rewards: 52.956, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.610', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.039', 'AMMO3': '0.141', 'AMMO4': '0.195', 'weapon4': '0.204', 'weapon5': '0.212', 'weapon2': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.900', 'HITCOUNT': '2.830', 'weapon3': '3.058', 'DAMAGECOUNT': '13.518', 'FRAGCOUNT': '44.500'} [2023-02-25 14:49:08,843][36154] DAMAGECOUNT value on done: 1411074.0 [2023-02-25 14:49:08,844][36154] Sum rewards: 58.756, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.634', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.178', 'AMMO3': '0.204', 'weapon4': '0.330', 'WEAPON4': '0.350', 'weapon2': '0.404', 'WEAPON3': '1.150', 'weapon3': '3.052', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '15.741', 'FRAGCOUNT': '51.000'} [2023-02-25 14:49:08,874][36155] DAMAGECOUNT value on done: 1390114.0 [2023-02-25 14:49:08,874][36155] Sum rewards: 39.828, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.701', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.106', 'AMMO3': '0.188', 'AMMO4': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.400', 'weapon4': '0.614', 'WEAPON3': '1.250', 'HITCOUNT': '2.640', 'weapon3': '2.658', 'DAMAGECOUNT': '11.247', 'FRAGCOUNT': '37.000'} [2023-02-25 14:49:08,962][36139] DAMAGECOUNT value on done: 1395455.0 [2023-02-25 14:49:08,963][36139] Sum rewards: 57.645, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.680', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon2': '0.166', 'AMMO3': '0.190', 'AMMO4': '0.211', 'weapon5': '0.262', 'weapon4': '0.308', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.850', 'weapon3': '3.010', 'DAMAGECOUNT': '14.073', 'FRAGCOUNT': '52.000'} [2023-02-25 14:49:09,137][36154] DAMAGECOUNT value on done: 1392178.0 [2023-02-25 14:49:09,138][36154] Sum rewards: 66.563, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.446', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.086', 'AMMO4': '0.157', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'weapon2': '0.252', 'WEAPON4': '0.300', 'weapon4': '0.594', 'WEAPON3': '1.150', 'weapon3': '2.716', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '56.000'} [2023-02-25 14:49:09,187][36155] DAMAGECOUNT value on done: 1392520.0 [2023-02-25 14:49:09,188][36155] Sum rewards: 55.875, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-0.152', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon4': '0.072', 'AMMO4': '0.151', 'AMMO3': '0.235', 'weapon2': '0.240', 'weapon5': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.920', 'weapon3': '3.100', 'DAMAGECOUNT': '14.811', 'FRAGCOUNT': '51.000'} [2023-02-25 14:49:09,264][36139] DAMAGECOUNT value on done: 1390720.0 [2023-02-25 14:49:09,265][36139] Sum rewards: 54.326, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.596', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.057', 'weapon5': '0.068', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.314', 'weapon4': '0.346', 'WEAPON3': '1.150', 'weapon3': '3.022', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.712', 'FRAGCOUNT': '46.000'} [2023-02-25 14:49:09,467][36139] DAMAGECOUNT value on done: 1402552.0 [2023-02-25 14:49:09,467][36139] Sum rewards: 50.166, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.398', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.141', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'weapon4': '0.354', 'weapon2': '0.840', 'WEAPON3': '1.100', 'weapon3': '2.598', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '13.422', 'FRAGCOUNT': '42.000'} [2023-02-25 14:49:09,545][36141] DAMAGECOUNT value on done: 1401070.0 [2023-02-25 14:49:09,546][36141] Sum rewards: 50.329, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.038', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon4': '0.046', 'weapon5': '0.102', 'AMMO4': '0.131', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.300', 'HITCOUNT': '2.820', 'weapon3': '3.278', 'DAMAGECOUNT': '13.773', 'FRAGCOUNT': '44.000'} [2023-02-25 14:49:09,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13565.4). Total num frames: 228511744. Throughput: 0: 3391.0. Samples: 19619478. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:49:09,730][36114] Avg episode reward: [(0, '58.804')] [2023-02-25 14:49:09,777][36139] DAMAGECOUNT value on done: 1401075.0 [2023-02-25 14:49:09,777][36139] Sum rewards: 42.334, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.564', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.064', 'AMMO3': '0.168', 'weapon5': '0.266', 'weapon2': '0.310', 'AMMO4': '0.322', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.800', 'WEAPON3': '0.950', 'weapon3': '2.300', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.269', 'FRAGCOUNT': '37.000'} [2023-02-25 14:49:09,860][36141] DAMAGECOUNT value on done: 1398316.0 [2023-02-25 14:49:09,860][36141] Sum rewards: 51.523, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.200', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon5': '0.180', 'weapon2': '0.194', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.426', 'WEAPON3': '1.500', 'weapon3': '2.936', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.603', 'FRAGCOUNT': '45.500'} [2023-02-25 14:49:09,864][36155] DAMAGECOUNT value on done: 1407556.0 [2023-02-25 14:49:09,864][36155] Sum rewards: 47.728, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.694', 'AMMO5': '0.011', 'AMMO2': '0.047', 'AMMO3': '0.147', 'weapon5': '0.158', 'AMMO4': '0.235', 'weapon2': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.550', 'weapon4': '0.868', 'WEAPON3': '1.000', 'weapon3': '2.250', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.380', 'FRAGCOUNT': '41.000'} [2023-02-25 14:49:10,159][36141] DAMAGECOUNT value on done: 1388144.0 [2023-02-25 14:49:10,160][36141] Sum rewards: 61.308, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.920', 'AMMO2': '0.026', 'weapon4': '0.102', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'weapon2': '0.420', 'WEAPON3': '1.250', 'HITCOUNT': '3.230', 'weapon3': '3.334', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '52.000'} [2023-02-25 14:49:10,170][36155] DAMAGECOUNT value on done: 1388271.0 [2023-02-25 14:49:10,171][36155] Sum rewards: 63.194, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.510', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO3': '0.159', 'AMMO4': '0.163', 'weapon5': '0.180', 'WEAPON5': '0.450', 'weapon2': '0.476', 'WEAPON4': '0.500', 'weapon4': '0.592', 'WEAPON3': '0.950', 'weapon3': '2.512', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '52.000'} [2023-02-25 14:49:10,468][36141] DAMAGECOUNT value on done: 1373980.0 [2023-02-25 14:49:10,468][36141] Sum rewards: 57.523, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.929', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.046', 'AMMO3': '0.157', 'weapon5': '0.170', 'AMMO4': '0.232', 'WEAPON5': '0.300', 'weapon2': '0.448', 'WEAPON4': '0.550', 'WEAPON3': '0.950', 'weapon4': '0.958', 'weapon3': '2.086', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.072', 'FRAGCOUNT': '49.500'} [2023-02-25 14:49:10,676][36138] Updated weights for policy 0, policy_version 55793 (0.0009) [2023-02-25 14:49:12,125][36157] DAMAGECOUNT value on done: 1404865.0 [2023-02-25 14:49:12,125][36157] Sum rewards: 61.821, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.636', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon5': '0.096', 'weapon4': '0.112', 'AMMO4': '0.159', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.612', 'WEAPON3': '1.300', 'weapon3': '2.942', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.949', 'FRAGCOUNT': '54.000'} [2023-02-25 14:49:12,450][36157] DAMAGECOUNT value on done: 1393084.0 [2023-02-25 14:49:12,451][36157] Sum rewards: 58.184, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.147', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.060', 'AMMO3': '0.127', 'weapon5': '0.196', 'AMMO4': '0.298', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon2': '0.602', 'WEAPON3': '0.800', 'weapon4': '0.816', 'weapon3': '2.058', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '46.000'} [2023-02-25 14:49:12,829][36157] DAMAGECOUNT value on done: 1402793.0 [2023-02-25 14:49:12,829][36157] Sum rewards: 60.820, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.095', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.066', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'weapon2': '0.214', 'WEAPON4': '0.400', 'weapon4': '0.460', 'WEAPON3': '1.100', 'HITCOUNT': '3.000', 'weapon3': '3.088', 'DAMAGECOUNT': '14.850', 'FRAGCOUNT': '53.000'} [2023-02-25 14:49:13,133][36157] DAMAGECOUNT value on done: 1395432.0 [2023-02-25 14:49:13,133][36157] Sum rewards: 52.287, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.362', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.040', 'AMMO3': '0.178', 'AMMO4': '0.202', 'weapon2': '0.262', 'weapon5': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.646', 'WEAPON3': '1.100', 'weapon3': '2.522', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '13.734', 'FRAGCOUNT': '45.000'} [2023-02-25 14:49:13,654][36138] Updated weights for policy 0, policy_version 55803 (0.0009) [2023-02-25 14:49:13,911][36140] DAMAGECOUNT value on done: 1404042.0 [2023-02-25 14:49:13,911][36140] Sum rewards: 63.145, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.585', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.046', 'weapon5': '0.100', 'AMMO4': '0.152', 'weapon2': '0.192', 'AMMO3': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.750', 'weapon3': '3.436', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '57.000'} [2023-02-25 14:49:14,044][36140] DAMAGECOUNT value on done: 1399463.0 [2023-02-25 14:49:14,044][36140] Sum rewards: 58.310, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.960', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.134', 'AMMO4': '0.145', 'AMMO3': '0.175', 'weapon2': '0.290', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.568', 'WEAPON3': '1.150', 'weapon3': '2.836', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '49.000'} [2023-02-25 14:49:14,213][36140] DAMAGECOUNT value on done: 1383794.0 [2023-02-25 14:49:14,214][36140] Sum rewards: 57.595, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.122', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon5': '0.136', 'AMMO3': '0.164', 'weapon2': '0.180', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.776', 'WEAPON3': '1.050', 'weapon3': '2.690', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.787', 'FRAGCOUNT': '48.000'} [2023-02-25 14:49:14,347][36140] DAMAGECOUNT value on done: 1384455.0 [2023-02-25 14:49:14,348][36140] Sum rewards: 65.609, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.130', 'AMMO5': '0.004', 'ARMOR': '0.004', 'weapon4': '0.016', 'AMMO2': '0.021', 'weapon5': '0.028', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'weapon2': '0.172', 'AMMO3': '0.181', 'WEAPON3': '1.200', 'HITCOUNT': '3.460', 'weapon3': '3.686', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '53.000'} [2023-02-25 14:49:14,390][36141] Large shaping reward 2.617 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.003, -1.0)] [2023-02-25 14:49:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 228581376. Throughput: 0: 3389.2. Samples: 19639778. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:49:14,729][36114] Avg episode reward: [(0, '58.999')] [2023-02-25 14:49:16,681][36138] Updated weights for policy 0, policy_version 55813 (0.0009) [2023-02-25 14:49:17,339][36142] DAMAGECOUNT value on done: 1388454.0 [2023-02-25 14:49:17,340][36142] Sum rewards: 64.703, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.670', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon5': '0.112', 'AMMO3': '0.174', 'AMMO4': '0.240', 'weapon2': '0.270', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.872', 'WEAPON3': '1.050', 'weapon3': '2.326', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '55.000'} [2023-02-25 14:49:17,650][36142] DAMAGECOUNT value on done: 1381611.0 [2023-02-25 14:49:17,651][36142] Sum rewards: 56.190, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.884', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon2': '0.490', 'weapon4': '0.704', 'WEAPON3': '1.200', 'weapon3': '2.468', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.629', 'FRAGCOUNT': '49.000'} [2023-02-25 14:49:18,290][36142] DAMAGECOUNT value on done: 1395340.0 [2023-02-25 14:49:18,290][36142] Sum rewards: 58.897, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.750', 'AMMO5': '0.009', 'AMMO2': '0.040', 'AMMO3': '0.144', 'weapon5': '0.188', 'AMMO4': '0.198', 'weapon2': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.550', 'weapon4': '0.750', 'WEAPON3': '0.900', 'weapon3': '2.628', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.755', 'FRAGCOUNT': '51.500'} [2023-02-25 14:49:18,606][36142] DAMAGECOUNT value on done: 1399572.0 [2023-02-25 14:49:18,606][36142] Sum rewards: 54.477, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.280', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.047', 'AMMO3': '0.222', 'AMMO4': '0.237', 'weapon2': '0.284', 'weapon5': '0.286', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'weapon4': '0.822', 'WEAPON3': '1.350', 'weapon3': '2.272', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.588', 'FRAGCOUNT': '50.500'} [2023-02-25 14:49:18,989][36156] DAMAGECOUNT value on done: 1409347.0 [2023-02-25 14:49:18,989][36156] Sum rewards: 54.193, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.332', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.062', 'AMMO3': '0.205', 'weapon5': '0.252', 'AMMO4': '0.308', 'weapon2': '0.486', 'WEAPON4': '0.500', 'weapon4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.390', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.904', 'FRAGCOUNT': '48.000'} [2023-02-25 14:49:19,305][36156] DAMAGECOUNT value on done: 1387399.0 [2023-02-25 14:49:19,306][36156] Sum rewards: 54.211, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.908', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.094', 'AMMO4': '0.114', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.356', 'weapon4': '0.376', 'WEAPON3': '1.300', 'HITCOUNT': '2.770', 'weapon3': '2.954', 'DAMAGECOUNT': '13.809', 'FRAGCOUNT': '48.000'} [2023-02-25 14:49:19,414][36156] DAMAGECOUNT value on done: 1403807.0 [2023-02-25 14:49:19,414][36156] Sum rewards: 55.848, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.895', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.122', 'AMMO4': '0.126', 'AMMO3': '0.159', 'weapon4': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.472', 'WEAPON3': '1.000', 'weapon3': '2.986', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.433', 'FRAGCOUNT': '47.000'} [2023-02-25 14:49:19,716][36138] Updated weights for policy 0, policy_version 55823 (0.0009) [2023-02-25 14:49:19,726][36156] DAMAGECOUNT value on done: 1390656.0 [2023-02-25 14:49:19,726][36156] Sum rewards: 50.037, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.640', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.044', 'AMMO3': '0.159', 'weapon5': '0.170', 'weapon4': '0.212', 'AMMO4': '0.222', 'weapon2': '0.370', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.850', 'weapon3': '2.950', 'DAMAGECOUNT': '13.428', 'FRAGCOUNT': '44.500'} [2023-02-25 14:49:19,729][36114] Fps is (10 sec: 13926.5, 60 sec: 13585.1, 300 sec: 13579.3). Total num frames: 228651008. Throughput: 0: 3389.0. Samples: 19660116. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:49:19,730][36114] Avg episode reward: [(0, '58.824')] [2023-02-25 14:49:19,733][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000055823_228651008.pth... [2023-02-25 14:49:19,791][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000055027_225390592.pth [2023-02-25 14:49:22,030][36156] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:49:22,738][36138] Updated weights for policy 0, policy_version 55833 (0.0009) [2023-02-25 14:49:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 228716544. Throughput: 0: 3387.0. Samples: 19670294. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:49:24,730][36114] Avg episode reward: [(0, '58.627')] [2023-02-25 14:49:25,753][36138] Updated weights for policy 0, policy_version 55843 (0.0009) [2023-02-25 14:49:28,095][36154] DAMAGECOUNT value on done: 1401972.0 [2023-02-25 14:49:28,095][36154] Sum rewards: 64.631, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.572', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.027', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'weapon2': '0.152', 'AMMO3': '0.162', 'WEAPON4': '0.350', 'weapon4': '0.476', 'WEAPON3': '1.000', 'weapon3': '3.086', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.173', 'FRAGCOUNT': '54.000'} [2023-02-25 14:49:28,404][36154] DAMAGECOUNT value on done: 1385707.0 [2023-02-25 14:49:28,405][36154] Sum rewards: 63.205, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.944', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.134', 'AMMO3': '0.158', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.312', 'weapon4': '0.324', 'WEAPON3': '0.950', 'weapon3': '2.988', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '52.000'} [2023-02-25 14:49:28,657][36154] DAMAGECOUNT value on done: 1416056.0 [2023-02-25 14:49:28,657][36154] Sum rewards: 63.304, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.522', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO3': '0.104', 'AMMO4': '0.168', 'weapon5': '0.208', 'weapon2': '0.302', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '0.650', 'weapon4': '0.980', 'weapon3': '2.088', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.946', 'FRAGCOUNT': '53.000'} [2023-02-25 14:49:28,667][36155] DAMAGECOUNT value on done: 1395143.0 [2023-02-25 14:49:28,667][36155] Sum rewards: 55.974, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.592', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon5': '0.172', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.404', 'weapon4': '0.552', 'WEAPON3': '1.300', 'weapon3': '2.616', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.087', 'FRAGCOUNT': '50.000'} [2023-02-25 14:49:28,761][36139] DAMAGECOUNT value on done: 1400447.0 [2023-02-25 14:49:28,761][36139] Sum rewards: 64.352, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.156', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.132', 'AMMO3': '0.171', 'AMMO4': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.272', 'weapon2': '0.444', 'WEAPON3': '1.100', 'weapon3': '3.000', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.976', 'FRAGCOUNT': '56.000'} [2023-02-25 14:49:28,784][36138] Updated weights for policy 0, policy_version 55853 (0.0009) [2023-02-25 14:49:28,961][36154] DAMAGECOUNT value on done: 1395781.0 [2023-02-25 14:49:28,962][36154] Sum rewards: 42.495, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.446', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon7': '0.074', 'AMMO4': '0.075', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.160', 'weapon2': '0.190', 'AMMO3': '0.202', 'weapon4': '0.638', 'WEAPON3': '1.150', 'HITCOUNT': '2.280', 'weapon3': '2.638', 'DAMAGECOUNT': '10.809', 'FRAGCOUNT': '37.000'} [2023-02-25 14:49:28,970][36155] DAMAGECOUNT value on done: 1398074.0 [2023-02-25 14:49:28,970][36155] Sum rewards: 68.253, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.234', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.186', 'AMMO3': '0.217', 'weapon4': '0.418', 'WEAPON3': '1.200', 'weapon3': '3.108', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '57.000'} [2023-02-25 14:49:29,068][36139] DAMAGECOUNT value on done: 1395841.0 [2023-02-25 14:49:29,068][36139] Sum rewards: 51.565, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.270', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon5': '0.046', 'AMMO4': '0.168', 'AMMO3': '0.221', 'weapon4': '0.278', 'weapon2': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.050', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.363', 'FRAGCOUNT': '46.000'} [2023-02-25 14:49:29,282][36139] DAMAGECOUNT value on done: 1407545.0 [2023-02-25 14:49:29,283][36139] Sum rewards: 59.613, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.042', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.158', 'weapon4': '0.222', 'HEALTH': '0.316', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'weapon2': '0.954', 'weapon3': '2.656', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.979', 'FRAGCOUNT': '47.000'} [2023-02-25 14:49:29,413][36141] DAMAGECOUNT value on done: 1406387.0 [2023-02-25 14:49:29,413][36141] Sum rewards: 67.875, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.232', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.149', 'AMMO4': '0.193', 'WEAPON4': '0.200', 'weapon2': '0.220', 'weapon4': '0.696', 'WEAPON3': '1.100', 'weapon3': '2.782', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '57.000'} [2023-02-25 14:49:29,591][36139] DAMAGECOUNT value on done: 1405853.0 [2023-02-25 14:49:29,592][36139] Sum rewards: 54.414, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.134', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.124', 'AMMO4': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.378', 'weapon4': '0.438', 'WEAPON3': '1.300', 'weapon3': '2.794', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.334', 'FRAGCOUNT': '49.000'} [2023-02-25 14:49:29,613][36155] DAMAGECOUNT value on done: 1412584.0 [2023-02-25 14:49:29,614][36155] Sum rewards: 48.367, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.494', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon5': '0.236', 'AMMO4': '0.248', 'AMMO3': '0.259', 'weapon2': '0.384', 'WEAPON5': '0.400', 'weapon4': '0.430', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.538', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.084', 'FRAGCOUNT': '45.000'} [2023-02-25 14:49:29,713][36141] DAMAGECOUNT value on done: 1403009.0 [2023-02-25 14:49:29,714][36141] Sum rewards: 58.529, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.004', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.090', 'weapon2': '0.194', 'AMMO3': '0.208', 'AMMO4': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.960', 'weapon3': '2.982', 'DAMAGECOUNT': '14.079', 'FRAGCOUNT': '52.000'} [2023-02-25 14:49:29,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13585.1, 300 sec: 13579.3). Total num frames: 228786176. Throughput: 0: 3386.2. Samples: 19690626. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:49:29,730][36114] Avg episode reward: [(0, '58.686')] [2023-02-25 14:49:29,921][36155] DAMAGECOUNT value on done: 1393625.0 [2023-02-25 14:49:29,921][36155] Sum rewards: 58.717, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.132', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.108', 'AMMO4': '0.195', 'AMMO3': '0.219', 'weapon2': '0.236', 'WEAPON5': '0.400', 'weapon4': '0.402', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.002', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.062', 'FRAGCOUNT': '52.000'} [2023-02-25 14:49:29,950][36141] DAMAGECOUNT value on done: 1394070.0 [2023-02-25 14:49:29,950][36141] Sum rewards: 68.070, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.056', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'weapon2': '0.180', 'weapon4': '0.264', 'AMMO3': '0.269', 'WEAPON3': '1.550', 'weapon3': '3.240', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '59.000'} [2023-02-25 14:49:30,252][36141] DAMAGECOUNT value on done: 1377750.0 [2023-02-25 14:49:30,253][36141] Sum rewards: 42.883, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.962', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.059', 'weapon5': '0.068', 'AMMO3': '0.183', 'weapon2': '0.208', 'AMMO4': '0.295', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.662', 'WEAPON3': '1.050', 'weapon3': '2.358', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '11.310', 'FRAGCOUNT': '38.000'} [2023-02-25 14:49:31,806][36138] Updated weights for policy 0, policy_version 55863 (0.0009) [2023-02-25 14:49:32,019][36157] DAMAGECOUNT value on done: 1410188.0 [2023-02-25 14:49:32,019][36157] Sum rewards: 61.413, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.849', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.126', 'AMMO4': '0.148', 'AMMO3': '0.167', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.356', 'weapon2': '0.496', 'WEAPON3': '1.100', 'weapon3': '2.760', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '52.000'} [2023-02-25 14:49:32,326][36157] DAMAGECOUNT value on done: 1398432.0 [2023-02-25 14:49:32,326][36157] Sum rewards: 58.533, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.279', 'ARMOR': '0.004', 'AMMO5': '0.026', 'AMMO2': '0.066', 'AMMO3': '0.215', 'weapon5': '0.250', 'AMMO4': '0.332', 'weapon2': '0.470', 'weapon4': '0.606', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.338', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.834', 'FRAGCOUNT': '53.000'} [2023-02-25 14:49:32,743][36157] DAMAGECOUNT value on done: 1409049.0 [2023-02-25 14:49:32,743][36157] Sum rewards: 75.772, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.057', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'AMMO4': '0.202', 'weapon2': '0.236', 'WEAPON4': '0.300', 'weapon4': '0.656', 'WEAPON3': '1.050', 'weapon3': '2.642', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '18.768', 'FRAGCOUNT': '61.000'} [2023-02-25 14:49:33,047][36157] DAMAGECOUNT value on done: 1400289.0 [2023-02-25 14:49:33,048][36157] Sum rewards: 52.873, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.952', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.192', 'AMMO3': '0.216', 'weapon2': '0.272', 'weapon4': '0.528', 'WEAPON3': '1.350', 'weapon3': '2.420', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.571', 'FRAGCOUNT': '46.000'} [2023-02-25 14:49:33,704][36140] DAMAGECOUNT value on done: 1409159.0 [2023-02-25 14:49:33,705][36140] Sum rewards: 57.977, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.635', 'AMMO5': '0.020', 'AMMO2': '0.055', 'weapon5': '0.146', 'AMMO3': '0.204', 'AMMO4': '0.274', 'weapon4': '0.332', 'weapon2': '0.454', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.756', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.351', 'FRAGCOUNT': '52.000'} [2023-02-25 14:49:33,839][36140] DAMAGECOUNT value on done: 1403958.0 [2023-02-25 14:49:33,840][36140] Sum rewards: 55.487, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.282', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.022', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.194', 'weapon2': '0.200', 'WEAPON3': '1.100', 'HITCOUNT': '2.780', 'weapon3': '3.602', 'DAMAGECOUNT': '13.485', 'FRAGCOUNT': '47.000'} [2023-02-25 14:49:34,029][36140] DAMAGECOUNT value on done: 1388011.0 [2023-02-25 14:49:34,029][36140] Sum rewards: 49.685, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.792', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.061', 'AMMO3': '0.147', 'WEAPON5': '0.250', 'weapon5': '0.264', 'WEAPON4': '0.350', 'weapon2': '0.468', 'weapon4': '0.736', 'WEAPON3': '0.850', 'weapon3': '2.342', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.651', 'FRAGCOUNT': '40.000'} [2023-02-25 14:49:34,158][36140] DAMAGECOUNT value on done: 1390330.0 [2023-02-25 14:49:34,158][36140] Sum rewards: 60.598, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.052', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon5': '0.172', 'AMMO4': '0.203', 'weapon4': '0.218', 'AMMO3': '0.264', 'weapon2': '0.328', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.942', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '54.000'} [2023-02-25 14:49:34,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13565.4). Total num frames: 228851712. Throughput: 0: 3388.8. Samples: 19710892. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:49:34,730][36114] Avg episode reward: [(0, '58.743')] [2023-02-25 14:49:34,865][36138] Updated weights for policy 0, policy_version 55873 (0.0009) [2023-02-25 14:49:37,233][36142] DAMAGECOUNT value on done: 1394016.0 [2023-02-25 14:49:37,233][36142] Sum rewards: 72.937, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.877', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.049', 'weapon5': '0.142', 'weapon4': '0.146', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'AMMO4': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.150', 'weapon3': '3.160', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '62.000'} [2023-02-25 14:49:37,545][36142] DAMAGECOUNT value on done: 1387513.0 [2023-02-25 14:49:37,546][36142] Sum rewards: 61.331, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-1.635', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.094', 'weapon5': '0.094', 'AMMO4': '0.170', 'weapon2': '0.174', 'AMMO3': '0.281', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '3.310', 'weapon3': '3.338', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '55.000'} [2023-02-25 14:49:37,906][36138] Updated weights for policy 0, policy_version 55883 (0.0009) [2023-02-25 14:49:38,198][36142] DAMAGECOUNT value on done: 1400794.0 [2023-02-25 14:49:38,199][36142] Sum rewards: 61.354, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.829', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.104', 'weapon5': '0.124', 'AMMO4': '0.161', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.400', 'HITCOUNT': '3.140', 'weapon3': '3.160', 'DAMAGECOUNT': '16.362', 'FRAGCOUNT': '54.000'} [2023-02-25 14:49:38,494][36142] DAMAGECOUNT value on done: 1404524.0 [2023-02-25 14:49:38,494][36142] Sum rewards: 57.855, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.300', 'AMMO5': '0.016', 'AMMO2': '0.048', 'AMMO3': '0.229', 'AMMO4': '0.238', 'weapon5': '0.292', 'weapon2': '0.348', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.774', 'WEAPON3': '1.250', 'weapon3': '2.154', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.856', 'FRAGCOUNT': '53.000'} [2023-02-25 14:49:38,896][36156] DAMAGECOUNT value on done: 1414751.0 [2023-02-25 14:49:38,897][36156] Sum rewards: 53.523, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.964', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.057', 'weapon5': '0.156', 'AMMO3': '0.157', 'AMMO4': '0.286', 'WEAPON5': '0.450', 'weapon4': '0.488', 'weapon2': '0.546', 'WEAPON4': '0.550', 'WEAPON3': '0.950', 'weapon3': '2.490', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.212', 'FRAGCOUNT': '44.000'} [2023-02-25 14:49:39,209][36156] DAMAGECOUNT value on done: 1392448.0 [2023-02-25 14:49:39,209][36156] Sum rewards: 55.496, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.866', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon4': '0.432', 'weapon2': '0.462', 'WEAPON3': '1.300', 'weapon3': '2.744', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.147', 'FRAGCOUNT': '48.000'} [2023-02-25 14:49:39,302][36156] DAMAGECOUNT value on done: 1409156.0 [2023-02-25 14:49:39,302][36156] Sum rewards: 54.582, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.318', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.059', 'weapon4': '0.184', 'AMMO3': '0.213', 'weapon5': '0.268', 'AMMO4': '0.295', 'weapon2': '0.316', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.928', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.047', 'FRAGCOUNT': '48.500'} [2023-02-25 14:49:39,591][36156] DAMAGECOUNT value on done: 1395411.0 [2023-02-25 14:49:39,592][36156] Sum rewards: 51.655, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.544', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO4': '0.169', 'weapon2': '0.216', 'AMMO3': '0.294', 'weapon5': '0.314', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.386', 'WEAPON3': '1.750', 'weapon3': '2.666', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.265', 'FRAGCOUNT': '50.000'} [2023-02-25 14:49:39,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13516.8, 300 sec: 13565.4). Total num frames: 228917248. Throughput: 0: 3386.3. Samples: 19720954. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:49:39,730][36114] Avg episode reward: [(0, '58.792')] [2023-02-25 14:49:40,964][36138] Updated weights for policy 0, policy_version 55893 (0.0009) [2023-02-25 14:49:43,995][36138] Updated weights for policy 0, policy_version 55903 (0.0009) [2023-02-25 14:49:44,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13565.4). Total num frames: 228986880. Throughput: 0: 3380.7. Samples: 19741184. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:49:44,729][36114] Avg episode reward: [(0, '58.792')] [2023-02-25 14:49:47,007][36138] Updated weights for policy 0, policy_version 55913 (0.0009) [2023-02-25 14:49:48,053][36154] DAMAGECOUNT value on done: 1407151.0 [2023-02-25 14:49:48,054][36154] Sum rewards: 60.834, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.700', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.044', 'AMMO3': '0.208', 'weapon2': '0.216', 'weapon5': '0.220', 'AMMO4': '0.221', 'WEAPON5': '0.250', 'weapon4': '0.358', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.878', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '54.000'} [2023-02-25 14:49:48,355][36154] DAMAGECOUNT value on done: 1390410.0 [2023-02-25 14:49:48,356][36154] Sum rewards: 49.546, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.010', 'AMMO5': '0.016', 'AMMO2': '0.057', 'AMMO3': '0.164', 'weapon5': '0.226', 'AMMO4': '0.287', 'weapon2': '0.452', 'weapon4': '0.466', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '0.950', 'weapon3': '2.552', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '14.085', 'FRAGCOUNT': '42.000'} [2023-02-25 14:49:48,613][36155] DAMAGECOUNT value on done: 1399892.0 [2023-02-25 14:49:48,614][36155] Sum rewards: 54.420, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.999', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon7': '0.042', 'AMMO4': '0.057', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO3': '0.172', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.392', 'weapon4': '0.612', 'WEAPON3': '1.050', 'weapon3': '2.604', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.247', 'FRAGCOUNT': '45.000'} [2023-02-25 14:49:48,615][36154] DAMAGECOUNT value on done: 1420748.0 [2023-02-25 14:49:48,616][36154] Sum rewards: 61.947, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.442', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.024', 'AMMO4': '0.046', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.111', 'WEAPON3': '0.750', 'weapon2': '1.032', 'weapon3': '2.780', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.076', 'FRAGCOUNT': '48.000'} [2023-02-25 14:49:48,636][36139] DAMAGECOUNT value on done: 1405884.0 [2023-02-25 14:49:48,636][36139] Sum rewards: 60.298, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.060', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO3': '0.261', 'weapon2': '0.418', 'WEAPON3': '1.550', 'HITCOUNT': '3.400', 'weapon3': '3.434', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '52.000'} [2023-02-25 14:49:48,760][36157] Large shaping reward -2.506 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0)] [2023-02-25 14:49:48,923][36155] DAMAGECOUNT value on done: 1403158.0 [2023-02-25 14:49:48,924][36155] Sum rewards: 58.333, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.950', 'ARMOR': '0.012', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.060', 'weapon5': '0.148', 'AMMO4': '0.204', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.542', 'WEAPON3': '1.400', 'weapon3': '3.018', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.252', 'FRAGCOUNT': '51.000'} [2023-02-25 14:49:48,927][36154] DAMAGECOUNT value on done: 1400821.0 [2023-02-25 14:49:48,927][36154] Sum rewards: 55.332, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.555', 'AMMO5': '0.017', 'AMMO2': '0.055', 'AMMO3': '0.140', 'weapon5': '0.268', 'AMMO4': '0.276', 'WEAPON5': '0.400', 'weapon2': '0.458', 'WEAPON4': '0.600', 'weapon4': '0.810', 'WEAPON3': '0.850', 'weapon3': '2.128', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '15.054', 'FRAGCOUNT': '48.000'} [2023-02-25 14:49:48,937][36139] DAMAGECOUNT value on done: 1401160.0 [2023-02-25 14:49:48,937][36139] Sum rewards: 60.191, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.385', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.190', 'weapon2': '0.192', 'WEAPON5': '0.250', 'AMMO3': '0.266', 'WEAPON4': '0.350', 'weapon4': '0.572', 'WEAPON3': '1.550', 'weapon3': '2.714', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.957', 'FRAGCOUNT': '56.000'} [2023-02-25 14:49:49,240][36139] DAMAGECOUNT value on done: 1412011.0 [2023-02-25 14:49:49,240][36139] Sum rewards: 51.321, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.880', 'AMMO5': '0.006', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon4': '0.076', 'weapon5': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'weapon2': '0.426', 'WEAPON3': '1.500', 'HITCOUNT': '2.900', 'weapon3': '3.176', 'DAMAGECOUNT': '13.398', 'FRAGCOUNT': '47.000'} [2023-02-25 14:49:49,352][36141] DAMAGECOUNT value on done: 1410048.0 [2023-02-25 14:49:49,353][36141] Sum rewards: 44.561, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.470', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.052', 'weapon4': '0.070', 'AMMO4': '0.102', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.584', 'WEAPON3': '1.050', 'HITCOUNT': '2.440', 'weapon3': '3.140', 'DAMAGECOUNT': '10.983', 'FRAGCOUNT': '39.000'} [2023-02-25 14:49:49,531][36155] DAMAGECOUNT value on done: 1417272.0 [2023-02-25 14:49:49,531][36155] Sum rewards: 57.570, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.560', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO4': '0.172', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'weapon2': '0.338', 'weapon4': '0.338', 'WEAPON3': '1.200', 'HITCOUNT': '3.040', 'weapon3': '3.052', 'DAMAGECOUNT': '14.064', 'FRAGCOUNT': '50.000'} [2023-02-25 14:49:49,549][36139] DAMAGECOUNT value on done: 1411648.0 [2023-02-25 14:49:49,550][36139] Sum rewards: 70.390, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.088', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.034', 'AMMO4': '0.168', 'AMMO3': '0.174', 'weapon5': '0.186', 'weapon2': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.606', 'WEAPON3': '1.100', 'weapon3': '2.760', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '59.000'} [2023-02-25 14:49:49,670][36141] DAMAGECOUNT value on done: 1408886.0 [2023-02-25 14:49:49,670][36141] Sum rewards: 72.295, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.373', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.094', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon4': '0.218', 'weapon2': '0.252', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.244', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '61.000'} [2023-02-25 14:49:49,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13565.4). Total num frames: 229052416. Throughput: 0: 3383.3. Samples: 19761530. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:49:49,730][36114] Avg episode reward: [(0, '58.485')] [2023-02-25 14:49:49,832][36155] DAMAGECOUNT value on done: 1398682.0 [2023-02-25 14:49:49,832][36155] Sum rewards: 54.657, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.834', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.068', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'AMMO4': '0.208', 'weapon4': '0.348', 'WEAPON4': '0.400', 'weapon2': '0.572', 'WEAPON3': '1.150', 'weapon3': '2.736', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.171', 'FRAGCOUNT': '47.000'} [2023-02-25 14:49:49,910][36141] DAMAGECOUNT value on done: 1399446.0 [2023-02-25 14:49:49,911][36141] Sum rewards: 62.893, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.903', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.037', 'weapon4': '0.102', 'AMMO3': '0.180', 'AMMO4': '0.184', 'weapon5': '0.186', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.010', 'weapon3': '3.194', 'DAMAGECOUNT': '16.128', 'FRAGCOUNT': '55.000'} [2023-02-25 14:49:50,047][36138] Updated weights for policy 0, policy_version 55923 (0.0009) [2023-02-25 14:49:50,206][36141] DAMAGECOUNT value on done: 1383339.0 [2023-02-25 14:49:50,206][36141] Sum rewards: 69.675, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.490', 'AMMO2': '0.005', 'AMMO4': '0.026', 'AMMO3': '0.260', 'weapon2': '0.422', 'WEAPON3': '1.700', 'weapon3': '3.404', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '62.000'} [2023-02-25 14:49:51,941][36157] DAMAGECOUNT value on done: 1415552.0 [2023-02-25 14:49:51,941][36157] Sum rewards: 63.264, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.218', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.134', 'weapon4': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.306', 'WEAPON3': '1.350', 'weapon3': '3.134', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '55.000'} [2023-02-25 14:49:52,255][36157] DAMAGECOUNT value on done: 1403164.0 [2023-02-25 14:49:52,255][36157] Sum rewards: 56.298, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.190', 'AMMO5': '0.005', 'AMMO2': '0.028', 'AMMO4': '0.137', 'weapon5': '0.168', 'weapon4': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.610', 'WEAPON3': '1.150', 'weapon3': '2.828', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.196', 'FRAGCOUNT': '48.500'} [2023-02-25 14:49:52,666][36157] DAMAGECOUNT value on done: 1414577.0 [2023-02-25 14:49:52,666][36157] Sum rewards: 65.586, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.866', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.090', 'weapon4': '0.092', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'weapon2': '0.348', 'WEAPON3': '1.150', 'weapon3': '3.204', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '55.000'} [2023-02-25 14:49:52,980][36157] DAMAGECOUNT value on done: 1405527.0 [2023-02-25 14:49:52,981][36157] Sum rewards: 54.063, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.262', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO4': '0.205', 'weapon2': '0.236', 'AMMO3': '0.247', 'weapon5': '0.250', 'weapon4': '0.318', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.864', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.714', 'FRAGCOUNT': '49.000'} [2023-02-25 14:49:53,034][36138] Updated weights for policy 0, policy_version 55933 (0.0009) [2023-02-25 14:49:53,570][36140] DAMAGECOUNT value on done: 1414066.0 [2023-02-25 14:49:53,571][36140] Sum rewards: 61.751, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.602', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.050', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon4': '0.378', 'weapon2': '0.564', 'WEAPON3': '1.100', 'weapon3': '2.792', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.721', 'FRAGCOUNT': '54.000'} [2023-02-25 14:49:53,686][36140] DAMAGECOUNT value on done: 1410121.0 [2023-02-25 14:49:53,686][36140] Sum rewards: 72.124, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.390', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.052', 'AMMO3': '0.165', 'AMMO4': '0.260', 'weapon5': '0.326', 'WEAPON5': '0.400', 'weapon2': '0.452', 'WEAPON4': '0.600', 'weapon4': '0.888', 'WEAPON3': '1.000', 'weapon3': '1.960', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.489', 'FRAGCOUNT': '59.500'} [2023-02-25 14:49:53,891][36140] DAMAGECOUNT value on done: 1394016.0 [2023-02-25 14:49:53,892][36140] Sum rewards: 74.840, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.428', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon5': '0.042', 'weapon4': '0.110', 'AMMO4': '0.118', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.300', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.910', 'FRAGCOUNT': '64.000'} [2023-02-25 14:49:54,005][36140] DAMAGECOUNT value on done: 1396035.0 [2023-02-25 14:49:54,005][36140] Sum rewards: 66.803, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.262', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.056', 'AMMO4': '0.095', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.362', 'weapon2': '0.432', 'WEAPON3': '1.050', 'weapon3': '2.632', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '56.000'} [2023-02-25 14:49:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13565.4). Total num frames: 229122048. Throughput: 0: 3383.4. Samples: 19771732. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:49:54,729][36114] Avg episode reward: [(0, '58.479')] [2023-02-25 14:49:56,050][36138] Updated weights for policy 0, policy_version 55943 (0.0009) [2023-02-25 14:49:57,094][36142] DAMAGECOUNT value on done: 1398851.0 [2023-02-25 14:49:57,095][36142] Sum rewards: 54.522, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.070', 'AMMO5': '0.005', 'AMMO2': '0.040', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO4': '0.198', 'weapon2': '0.236', 'AMMO3': '0.276', 'WEAPON4': '0.350', 'weapon4': '0.434', 'WEAPON3': '1.550', 'HITCOUNT': '2.870', 'weapon3': '2.926', 'DAMAGECOUNT': '14.505', 'FRAGCOUNT': '51.000'} [2023-02-25 14:49:57,410][36142] DAMAGECOUNT value on done: 1392321.0 [2023-02-25 14:49:57,410][36142] Sum rewards: 61.301, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.335', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.160', 'AMMO3': '0.170', 'AMMO4': '0.185', 'weapon2': '0.206', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.616', 'WEAPON3': '1.000', 'weapon3': '2.806', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.424', 'FRAGCOUNT': '53.000'} [2023-02-25 14:49:58,048][36142] DAMAGECOUNT value on done: 1405166.0 [2023-02-25 14:49:58,048][36142] Sum rewards: 52.576, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.010', 'AMMO2': '0.047', 'AMMO3': '0.122', 'HEALTH': '0.143', 'WEAPON5': '0.200', 'weapon5': '0.216', 'AMMO4': '0.236', 'WEAPON4': '0.400', 'ARMOR': '0.404', 'weapon2': '0.658', 'WEAPON3': '0.750', 'weapon4': '0.996', 'weapon3': '1.878', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.116', 'FRAGCOUNT': '43.000'} [2023-02-25 14:49:58,334][36142] DAMAGECOUNT value on done: 1409321.0 [2023-02-25 14:49:58,334][36142] Sum rewards: 46.085, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.011', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.118', 'weapon4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.251', 'weapon2': '0.810', 'WEAPON3': '1.550', 'weapon3': '2.740', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.391', 'FRAGCOUNT': '42.500'} [2023-02-25 14:49:58,852][36156] DAMAGECOUNT value on done: 1419684.0 [2023-02-25 14:49:58,853][36156] Sum rewards: 59.181, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.730', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.047', 'AMMO3': '0.108', 'weapon5': '0.174', 'AMMO4': '0.236', 'WEAPON5': '0.250', 'weapon2': '0.394', 'WEAPON4': '0.600', 'WEAPON3': '0.600', 'weapon4': '0.954', 'weapon3': '2.244', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '14.799', 'FRAGCOUNT': '48.000'} [2023-02-25 14:49:59,067][36138] Updated weights for policy 0, policy_version 55953 (0.0009) [2023-02-25 14:49:59,163][36156] DAMAGECOUNT value on done: 1397174.0 [2023-02-25 14:49:59,163][36156] Sum rewards: 53.877, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.404', 'AMMO5': '0.010', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'AMMO3': '0.156', 'weapon2': '0.188', 'weapon5': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.696', 'WEAPON3': '1.000', 'weapon3': '2.392', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '14.178', 'FRAGCOUNT': '46.000'} [2023-02-25 14:49:59,170][36140] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:49:59,279][36156] DAMAGECOUNT value on done: 1414583.0 [2023-02-25 14:49:59,279][36156] Sum rewards: 65.569, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.470', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.162', 'AMMO4': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'weapon4': '0.430', 'weapon2': '0.718', 'WEAPON3': '1.200', 'weapon3': '2.428', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '56.500'} [2023-02-25 14:49:59,586][36156] DAMAGECOUNT value on done: 1400506.0 [2023-02-25 14:49:59,586][36156] Sum rewards: 65.403, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.035', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.134', 'AMMO3': '0.141', 'weapon4': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.894', 'WEAPON3': '1.000', 'weapon3': '2.648', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.285', 'FRAGCOUNT': '53.000'} [2023-02-25 14:49:59,729][36114] Fps is (10 sec: 13926.4, 60 sec: 13585.0, 300 sec: 13579.3). Total num frames: 229191680. Throughput: 0: 3385.5. Samples: 19792124. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:49:59,730][36114] Avg episode reward: [(0, '58.435')] [2023-02-25 14:50:02,087][36138] Updated weights for policy 0, policy_version 55963 (0.0010) [2023-02-25 14:50:03,045][36140] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:50:04,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13565.4). Total num frames: 229257216. Throughput: 0: 3385.1. Samples: 19812444. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:50:04,730][36114] Avg episode reward: [(0, '58.435')] [2023-02-25 14:50:05,126][36138] Updated weights for policy 0, policy_version 55973 (0.0008) [2023-02-25 14:50:07,793][36154] DAMAGECOUNT value on done: 1411506.0 [2023-02-25 14:50:07,794][36154] Sum rewards: 44.720, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.295', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.036', 'AMMO4': '0.182', 'weapon2': '0.208', 'weapon5': '0.224', 'AMMO3': '0.225', 'weapon4': '0.362', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'HITCOUNT': '2.490', 'weapon3': '2.884', 'DAMAGECOUNT': '12.981', 'FRAGCOUNT': '42.000'} [2023-02-25 14:50:08,097][36154] DAMAGECOUNT value on done: 1394536.0 [2023-02-25 14:50:08,098][36154] Sum rewards: 48.178, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.946', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.188', 'AMMO3': '0.192', 'AMMO4': '0.225', 'WEAPON5': '0.350', 'weapon4': '0.386', 'WEAPON4': '0.400', 'weapon2': '0.706', 'WEAPON3': '1.100', 'weapon3': '2.460', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.378', 'FRAGCOUNT': '44.000'} [2023-02-25 14:50:08,134][36138] Updated weights for policy 0, policy_version 55983 (0.0009) [2023-02-25 14:50:08,276][36139] DAMAGECOUNT value on done: 1411317.0 [2023-02-25 14:50:08,277][36139] Sum rewards: 68.488, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.385', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.124', 'AMMO3': '0.178', 'weapon4': '0.308', 'weapon2': '0.572', 'WEAPON3': '1.050', 'weapon3': '2.752', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.194', 'FRAGCOUNT': '56.000'} [2023-02-25 14:50:08,336][36154] DAMAGECOUNT value on done: 1425560.0 [2023-02-25 14:50:08,336][36154] Sum rewards: 55.767, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.250', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.064', 'AMMO4': '0.152', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'weapon2': '0.326', 'WEAPON4': '0.350', 'weapon4': '0.554', 'WEAPON3': '1.200', 'weapon3': '2.804', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.436', 'FRAGCOUNT': '48.000'} [2023-02-25 14:50:08,446][36155] DAMAGECOUNT value on done: 1404774.0 [2023-02-25 14:50:08,447][36155] Sum rewards: 54.441, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.329', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.130', 'weapon2': '0.182', 'AMMO4': '0.193', 'AMMO3': '0.199', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.588', 'WEAPON3': '1.150', 'weapon3': '2.866', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.646', 'FRAGCOUNT': '47.000'} [2023-02-25 14:50:08,585][36139] DAMAGECOUNT value on done: 1406749.0 [2023-02-25 14:50:08,586][36139] Sum rewards: 63.755, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.646', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.152', 'AMMO4': '0.171', 'AMMO3': '0.213', 'weapon2': '0.232', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.438', 'WEAPON3': '1.200', 'weapon3': '2.900', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.752', 'FRAGCOUNT': '55.000'} [2023-02-25 14:50:08,651][36154] DAMAGECOUNT value on done: 1404359.0 [2023-02-25 14:50:08,652][36154] Sum rewards: 41.477, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.263', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.041', 'AMMO3': '0.114', 'AMMO4': '0.205', 'weapon2': '0.242', 'WEAPON5': '0.250', 'weapon5': '0.278', 'WEAPON4': '0.500', 'WEAPON3': '0.700', 'weapon4': '1.002', 'weapon3': '2.150', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '10.614', 'FRAGCOUNT': '36.000'} [2023-02-25 14:50:08,737][36155] DAMAGECOUNT value on done: 1407434.0 [2023-02-25 14:50:08,737][36155] Sum rewards: 50.954, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.884', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.041', 'AMMO3': '0.118', 'weapon5': '0.150', 'WEAPON5': '0.200', 'AMMO4': '0.204', 'WEAPON4': '0.450', 'weapon2': '0.460', 'WEAPON3': '0.750', 'weapon4': '0.816', 'weapon3': '2.272', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.828', 'FRAGCOUNT': '42.000'} [2023-02-25 14:50:09,087][36139] DAMAGECOUNT value on done: 1417549.0 [2023-02-25 14:50:09,087][36139] Sum rewards: 58.808, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.342', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.055', 'AMMO3': '0.151', 'weapon2': '0.240', 'AMMO4': '0.275', 'weapon5': '0.294', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.768', 'WEAPON3': '1.000', 'weapon3': '2.404', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '49.500'} [2023-02-25 14:50:09,096][36141] DAMAGECOUNT value on done: 1414548.0 [2023-02-25 14:50:09,096][36141] Sum rewards: 45.281, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.220', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon2': '0.174', 'AMMO3': '0.176', 'weapon5': '0.188', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.616', 'WEAPON3': '1.000', 'weapon3': '2.706', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.500', 'FRAGCOUNT': '38.000'} [2023-02-25 14:50:09,293][36155] DAMAGECOUNT value on done: 1423084.0 [2023-02-25 14:50:09,293][36155] Sum rewards: 64.834, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.148', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.142', 'weapon5': '0.166', 'weapon2': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'weapon4': '0.628', 'WEAPON3': '1.350', 'weapon3': '2.766', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '55.000'} [2023-02-25 14:50:09,401][36139] DAMAGECOUNT value on done: 1414768.0 [2023-02-25 14:50:09,402][36139] Sum rewards: 39.164, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.077', 'weapon7': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.046', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon2': '0.202', 'AMMO4': '0.228', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'WEAPON3': '1.000', 'weapon4': '1.088', 'weapon3': '2.310', 'HITCOUNT': '2.350', 'DAMAGECOUNT': '9.360', 'FRAGCOUNT': '34.000'} [2023-02-25 14:50:09,408][36141] DAMAGECOUNT value on done: 1414133.0 [2023-02-25 14:50:09,409][36141] Sum rewards: 59.459, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.095', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon5': '0.174', 'AMMO3': '0.235', 'weapon4': '0.246', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.548', 'WEAPON3': '1.500', 'weapon3': '2.772', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.741', 'FRAGCOUNT': '54.000'} [2023-02-25 14:50:09,568][36141] DAMAGECOUNT value on done: 1404517.0 [2023-02-25 14:50:09,569][36141] Sum rewards: 57.425, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.710', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'weapon2': '0.420', 'weapon4': '0.448', 'WEAPON3': '1.250', 'weapon3': '2.680', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.213', 'FRAGCOUNT': '50.000'} [2023-02-25 14:50:09,588][36155] DAMAGECOUNT value on done: 1404385.0 [2023-02-25 14:50:09,588][36155] Sum rewards: 69.157, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.445', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.016', 'weapon5': '0.018', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.149', 'weapon4': '0.158', 'weapon2': '0.544', 'WEAPON3': '0.900', 'weapon3': '3.160', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '55.000'} [2023-02-25 14:50:09,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13585.1, 300 sec: 13579.3). Total num frames: 229326848. Throughput: 0: 3384.8. Samples: 19822610. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:50:09,729][36114] Avg episode reward: [(0, '58.203')] [2023-02-25 14:50:09,876][36141] DAMAGECOUNT value on done: 1388244.0 [2023-02-25 14:50:09,876][36141] Sum rewards: 56.932, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.572', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.190', 'AMMO3': '0.240', 'weapon2': '0.342', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.732', 'WEAPON3': '1.400', 'weapon3': '2.414', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.715', 'FRAGCOUNT': '51.000'} [2023-02-25 14:50:11,136][36138] Updated weights for policy 0, policy_version 55993 (0.0009) [2023-02-25 14:50:11,757][36157] DAMAGECOUNT value on done: 1420717.0 [2023-02-25 14:50:11,758][36157] Sum rewards: 68.639, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.158', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.042', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'AMMO4': '0.209', 'weapon2': '0.244', 'WEAPON4': '0.300', 'weapon5': '0.370', 'weapon4': '0.460', 'WEAPON3': '0.950', 'weapon3': '2.592', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '57.500'} [2023-02-25 14:50:12,063][36157] DAMAGECOUNT value on done: 1409505.0 [2023-02-25 14:50:12,063][36157] Sum rewards: 76.586, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.345', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.064', 'weapon5': '0.090', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.468', 'WEAPON3': '1.250', 'weapon3': '3.158', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.023', 'FRAGCOUNT': '63.000'} [2023-02-25 14:50:12,500][36157] DAMAGECOUNT value on done: 1420511.0 [2023-02-25 14:50:12,501][36157] Sum rewards: 67.852, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.052', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.050', 'AMMO4': '0.071', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.158', 'AMMO3': '0.220', 'weapon2': '0.408', 'WEAPON3': '1.350', 'weapon3': '3.214', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '56.000'} [2023-02-25 14:50:12,794][36157] DAMAGECOUNT value on done: 1410440.0 [2023-02-25 14:50:12,794][36157] Sum rewards: 52.137, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.096', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO4': '0.198', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon4': '0.370', 'weapon2': '0.472', 'WEAPON3': '1.150', 'weapon3': '2.780', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '44.000'} [2023-02-25 14:50:13,488][36140] DAMAGECOUNT value on done: 1419231.0 [2023-02-25 14:50:13,488][36140] Sum rewards: 61.961, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.949', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.131', 'AMMO3': '0.171', 'weapon4': '0.278', 'WEAPON4': '0.300', 'weapon2': '0.606', 'WEAPON3': '1.100', 'weapon3': '2.868', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '53.000'} [2023-02-25 14:50:13,562][36140] DAMAGECOUNT value on done: 1414392.0 [2023-02-25 14:50:13,563][36140] Sum rewards: 47.917, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.166', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.076', 'weapon5': '0.108', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.244', 'weapon2': '0.504', 'WEAPON3': '1.450', 'HITCOUNT': '2.600', 'weapon3': '3.120', 'DAMAGECOUNT': '12.795', 'FRAGCOUNT': '43.000'} [2023-02-25 14:50:13,799][36140] DAMAGECOUNT value on done: 1399032.0 [2023-02-25 14:50:13,800][36140] Sum rewards: 62.400, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.921', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.052', 'weapon5': '0.060', 'AMMO4': '0.087', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.732', 'WEAPON3': '1.200', 'weapon3': '2.988', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '52.500'} [2023-02-25 14:50:13,871][36140] DAMAGECOUNT value on done: 1400482.0 [2023-02-25 14:50:13,872][36140] Sum rewards: 53.159, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.816', 'AMMO5': '0.013', 'AMMO2': '0.049', 'AMMO3': '0.115', 'AMMO4': '0.246', 'weapon5': '0.282', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.542', 'WEAPON3': '0.650', 'weapon4': '0.816', 'weapon3': '2.130', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.341', 'FRAGCOUNT': '44.000'} [2023-02-25 14:50:14,161][36138] Updated weights for policy 0, policy_version 56003 (0.0009) [2023-02-25 14:50:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13565.4). Total num frames: 229392384. Throughput: 0: 3386.3. Samples: 19843008. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:50:14,730][36114] Avg episode reward: [(0, '58.535')] [2023-02-25 14:50:16,957][36142] DAMAGECOUNT value on done: 1404076.0 [2023-02-25 14:50:16,958][36142] Sum rewards: 62.377, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.730', 'AMMO5': '0.019', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.158', 'AMMO3': '0.175', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.318', 'weapon2': '0.404', 'WEAPON3': '1.200', 'weapon3': '2.888', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '53.000'} [2023-02-25 14:50:17,130][36138] Updated weights for policy 0, policy_version 56013 (0.0009) [2023-02-25 14:50:17,273][36142] DAMAGECOUNT value on done: 1397937.0 [2023-02-25 14:50:17,274][36142] Sum rewards: 72.243, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.271', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'weapon4': '0.186', 'weapon2': '0.358', 'WEAPON3': '1.050', 'weapon3': '3.308', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '59.000'} [2023-02-25 14:50:17,390][36142] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:50:17,979][36142] DAMAGECOUNT value on done: 1410695.0 [2023-02-25 14:50:17,979][36142] Sum rewards: 59.474, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.874', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.156', 'AMMO3': '0.245', 'weapon4': '0.308', 'WEAPON3': '1.400', 'weapon3': '3.272', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '51.000'} [2023-02-25 14:50:18,302][36142] DAMAGECOUNT value on done: 1414768.0 [2023-02-25 14:50:18,303][36142] Sum rewards: 57.546, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.358', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.063', 'AMMO3': '0.095', 'weapon5': '0.272', 'AMMO4': '0.315', 'weapon2': '0.328', 'WEAPON5': '0.550', 'WEAPON3': '0.650', 'WEAPON4': '0.700', 'weapon4': '1.088', 'weapon3': '1.946', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.816', 'FRAGCOUNT': '46.000'} [2023-02-25 14:50:18,653][36156] DAMAGECOUNT value on done: 1424884.0 [2023-02-25 14:50:18,654][36156] Sum rewards: 60.400, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.943', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.054', 'AMMO3': '0.134', 'AMMO4': '0.268', 'weapon5': '0.316', 'weapon2': '0.446', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.688', 'WEAPON3': '0.900', 'weapon3': '2.256', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.582', 'FRAGCOUNT': '51.000'} [2023-02-25 14:50:18,962][36156] DAMAGECOUNT value on done: 1399784.0 [2023-02-25 14:50:18,963][36156] Sum rewards: 24.613, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.698', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO3': '0.078', 'AMMO4': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.152', 'weapon5': '0.168', 'WEAPON7': '0.200', 'weapon2': '0.248', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'WEAPON4': '0.550', 'weapon3': '1.102', 'weapon4': '1.350', 'HITCOUNT': '1.740', 'DAMAGECOUNT': '7.830', 'FRAGCOUNT': '19.500'} [2023-02-25 14:50:19,117][36156] DAMAGECOUNT value on done: 1419358.0 [2023-02-25 14:50:19,117][36156] Sum rewards: 59.101, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.454', 'AMMO5': '0.007', 'AMMO2': '0.049', 'weapon5': '0.150', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'weapon2': '0.210', 'AMMO4': '0.246', 'WEAPON4': '0.350', 'weapon4': '0.824', 'WEAPON3': '1.050', 'weapon3': '2.468', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.325', 'FRAGCOUNT': '51.000'} [2023-02-25 14:50:19,416][36156] DAMAGECOUNT value on done: 1405827.0 [2023-02-25 14:50:19,416][36156] Sum rewards: 61.077, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.973', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon4': '0.176', 'AMMO3': '0.241', 'weapon5': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.550', 'weapon3': '2.942', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.963', 'FRAGCOUNT': '56.000'} [2023-02-25 14:50:19,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13579.3). Total num frames: 229462016. Throughput: 0: 3390.7. Samples: 19863474. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:50:19,730][36114] Avg episode reward: [(0, '58.314')] [2023-02-25 14:50:20,118][36138] Updated weights for policy 0, policy_version 56023 (0.0009) [2023-02-25 14:50:22,356][36140] Large shaping reward 2.649 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0)] [2023-02-25 14:50:23,157][36138] Updated weights for policy 0, policy_version 56033 (0.0009) [2023-02-25 14:50:24,729][36114] Fps is (10 sec: 13926.4, 60 sec: 13585.1, 300 sec: 13579.3). Total num frames: 229531648. Throughput: 0: 3395.1. Samples: 19873732. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:50:24,730][36114] Avg episode reward: [(0, '58.314')] [2023-02-25 14:50:26,126][36138] Updated weights for policy 0, policy_version 56043 (0.0009) [2023-02-25 14:50:27,462][36154] DAMAGECOUNT value on done: 1414964.0 [2023-02-25 14:50:27,462][36154] Sum rewards: 44.502, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.310', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.058', 'AMMO4': '0.064', 'weapon7': '0.084', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.129', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.416', 'weapon2': '0.426', 'WEAPON3': '0.800', 'weapon3': '2.056', 'HITCOUNT': '2.150', 'DAMAGECOUNT': '10.374', 'FRAGCOUNT': '36.000'} [2023-02-25 14:50:27,770][36154] DAMAGECOUNT value on done: 1398811.0 [2023-02-25 14:50:27,770][36154] Sum rewards: 47.473, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.636', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.042', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.265', 'weapon2': '0.658', 'WEAPON3': '1.450', 'HITCOUNT': '2.750', 'weapon3': '2.966', 'DAMAGECOUNT': '12.825', 'FRAGCOUNT': '44.000'} [2023-02-25 14:50:27,868][36139] DAMAGECOUNT value on done: 1416143.0 [2023-02-25 14:50:27,868][36139] Sum rewards: 45.415, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.206', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.043', 'AMMO3': '0.199', 'AMMO4': '0.216', 'weapon2': '0.222', 'weapon5': '0.290', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.818', 'WEAPON3': '1.250', 'weapon3': '2.372', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '14.478', 'FRAGCOUNT': '41.500'} [2023-02-25 14:50:27,938][36155] DAMAGECOUNT value on done: 1406822.0 [2023-02-25 14:50:27,938][36155] Sum rewards: 24.577, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.722', 'ARMOR': '0.004', 'AMMO2': '0.040', 'WEAPON4': '0.050', 'weapon7': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.102', 'AMMO4': '0.198', 'weapon2': '0.274', 'weapon4': '0.438', 'WEAPON3': '0.650', 'HITCOUNT': '1.280', 'weapon3': '1.798', 'DAMAGECOUNT': '6.099', 'FRAGCOUNT': '20.000'} [2023-02-25 14:50:28,027][36154] DAMAGECOUNT value on done: 1431551.0 [2023-02-25 14:50:28,027][36154] Sum rewards: 67.106, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.242', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon2': '0.196', 'AMMO3': '0.201', 'weapon5': '0.208', 'AMMO4': '0.275', 'weapon4': '0.388', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.882', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '58.000'} [2023-02-25 14:50:28,175][36139] DAMAGECOUNT value on done: 1412784.0 [2023-02-25 14:50:28,176][36139] Sum rewards: 67.835, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.632', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.029', 'weapon5': '0.092', 'weapon4': '0.140', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.250', 'AMMO3': '0.260', 'WEAPON3': '1.600', 'weapon3': '3.268', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '59.500'} [2023-02-25 14:50:28,241][36155] DAMAGECOUNT value on done: 1412545.0 [2023-02-25 14:50:28,242][36155] Sum rewards: 56.754, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.970', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.019', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'weapon5': '0.114', 'weapon2': '0.178', 'AMMO3': '0.274', 'WEAPON4': '0.300', 'weapon4': '0.342', 'WEAPON3': '1.650', 'weapon3': '3.032', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.333', 'FRAGCOUNT': '51.000'} [2023-02-25 14:50:28,338][36154] DAMAGECOUNT value on done: 1408949.0 [2023-02-25 14:50:28,339][36154] Sum rewards: 53.831, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.932', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO3': '0.160', 'weapon5': '0.160', 'AMMO4': '0.192', 'weapon2': '0.276', 'weapon4': '0.276', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '2.870', 'weapon3': '3.060', 'DAMAGECOUNT': '13.770', 'FRAGCOUNT': '46.000'} [2023-02-25 14:50:28,664][36139] DAMAGECOUNT value on done: 1422801.0 [2023-02-25 14:50:28,664][36139] Sum rewards: 63.296, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.822', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.032', 'AMMO3': '0.152', 'AMMO4': '0.161', 'weapon5': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.480', 'weapon2': '0.512', 'WEAPON3': '0.950', 'weapon3': '2.504', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '53.000'} [2023-02-25 14:50:28,813][36155] DAMAGECOUNT value on done: 1428414.0 [2023-02-25 14:50:28,814][36155] Sum rewards: 64.112, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.610', 'AMMO5': '0.008', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.250', 'weapon4': '0.448', 'WEAPON3': '1.300', 'weapon3': '2.892', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.990', 'FRAGCOUNT': '54.000'} [2023-02-25 14:50:28,931][36141] DAMAGECOUNT value on done: 1419101.0 [2023-02-25 14:50:28,931][36141] Sum rewards: 54.299, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.912', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.047', 'AMMO3': '0.136', 'weapon5': '0.174', 'AMMO4': '0.237', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.522', 'weapon4': '0.622', 'WEAPON3': '0.900', 'weapon3': '2.468', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '13.614', 'FRAGCOUNT': '46.000'} [2023-02-25 14:50:28,958][36139] DAMAGECOUNT value on done: 1419485.0 [2023-02-25 14:50:28,958][36139] Sum rewards: 52.631, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.191', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.050', 'AMMO3': '0.163', 'weapon5': '0.230', 'AMMO4': '0.248', 'weapon2': '0.384', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.672', 'WEAPON3': '1.050', 'weapon3': '2.442', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '14.151', 'FRAGCOUNT': '46.000'} [2023-02-25 14:50:29,123][36155] DAMAGECOUNT value on done: 1408598.0 [2023-02-25 14:50:29,124][36155] Sum rewards: 45.362, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.162', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.122', 'AMMO3': '0.168', 'weapon5': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.378', 'weapon2': '0.546', 'WEAPON3': '1.050', 'weapon3': '2.610', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '12.639', 'FRAGCOUNT': '37.500'} [2023-02-25 14:50:29,146][36138] Updated weights for policy 0, policy_version 56053 (0.0009) [2023-02-25 14:50:29,226][36141] DAMAGECOUNT value on done: 1419148.0 [2023-02-25 14:50:29,226][36141] Sum rewards: 57.379, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.080', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.047', 'AMMO3': '0.161', 'AMMO4': '0.234', 'weapon5': '0.250', 'weapon2': '0.354', 'weapon4': '0.558', 'WEAPON5': '0.600', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.550', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '50.000'} [2023-02-25 14:50:29,352][36141] DAMAGECOUNT value on done: 1410554.0 [2023-02-25 14:50:29,352][36141] Sum rewards: 74.512, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.422', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon5': '0.082', 'AMMO4': '0.177', 'AMMO3': '0.180', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.376', 'weapon4': '0.424', 'WEAPON3': '1.000', 'weapon3': '2.894', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '60.500'} [2023-02-25 14:50:29,653][36141] DAMAGECOUNT value on done: 1392512.0 [2023-02-25 14:50:29,653][36141] Sum rewards: 47.359, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.272', 'ARMOR': '0.012', 'AMMO5': '0.028', 'AMMO2': '0.074', 'AMMO3': '0.184', 'weapon2': '0.220', 'weapon5': '0.252', 'AMMO4': '0.372', 'WEAPON5': '0.650', 'WEAPON4': '0.800', 'WEAPON3': '1.150', 'weapon4': '1.192', 'weapon3': '1.942', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.324', 'FRAGCOUNT': '43.500'} [2023-02-25 14:50:29,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13579.3). Total num frames: 229597184. Throughput: 0: 3398.1. Samples: 19894100. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:50:29,729][36114] Avg episode reward: [(0, '57.795')] [2023-02-25 14:50:31,481][36157] DAMAGECOUNT value on done: 1425839.0 [2023-02-25 14:50:31,481][36157] Sum rewards: 60.746, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.810', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.114', 'AMMO3': '0.171', 'weapon2': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.850', 'WEAPON3': '1.150', 'weapon3': '2.564', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '15.366', 'FRAGCOUNT': '51.000'} [2023-02-25 14:50:31,784][36157] DAMAGECOUNT value on done: 1414430.0 [2023-02-25 14:50:31,785][36157] Sum rewards: 54.447, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.356', 'AMMO5': '0.005', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.179', 'AMMO4': '0.197', 'WEAPON4': '0.300', 'weapon2': '0.480', 'weapon4': '0.558', 'WEAPON3': '1.000', 'weapon3': '2.600', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '45.000'} [2023-02-25 14:50:32,160][36138] Updated weights for policy 0, policy_version 56063 (0.0009) [2023-02-25 14:50:32,249][36157] DAMAGECOUNT value on done: 1426465.0 [2023-02-25 14:50:32,249][36157] Sum rewards: 74.668, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.102', 'HEALTH': '0.130', 'AMMO3': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.542', 'weapon2': '0.594', 'WEAPON3': '0.800', 'weapon3': '2.616', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '58.000'} [2023-02-25 14:50:32,547][36157] DAMAGECOUNT value on done: 1415485.0 [2023-02-25 14:50:32,548][36157] Sum rewards: 58.685, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.045', 'AMMO5': '0.009', 'AMMO2': '0.019', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'weapon5': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon4': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.350', 'weapon3': '3.092', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '51.000'} [2023-02-25 14:50:33,258][36140] DAMAGECOUNT value on done: 1424022.0 [2023-02-25 14:50:33,258][36140] Sum rewards: 45.951, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.288', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.134', 'AMMO3': '0.182', 'AMMO4': '0.224', 'WEAPON5': '0.300', 'weapon4': '0.310', 'weapon2': '0.460', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.796', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.073', 'FRAGCOUNT': '42.500'} [2023-02-25 14:50:33,317][36140] DAMAGECOUNT value on done: 1419925.0 [2023-02-25 14:50:33,318][36140] Sum rewards: 66.635, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.550', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.030', 'weapon5': '0.082', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.208', 'AMMO3': '0.270', 'WEAPON3': '1.650', 'HITCOUNT': '3.100', 'weapon3': '3.460', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '60.000'} [2023-02-25 14:50:33,581][36140] DAMAGECOUNT value on done: 1404580.0 [2023-02-25 14:50:33,582][36140] Sum rewards: 60.946, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.960', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.062', 'AMMO3': '0.178', 'weapon4': '0.260', 'weapon2': '0.264', 'weapon5': '0.286', 'AMMO4': '0.308', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.862', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '53.000'} [2023-02-25 14:50:33,636][36140] DAMAGECOUNT value on done: 1405488.0 [2023-02-25 14:50:33,637][36140] Sum rewards: 56.730, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.655', 'AMMO5': '0.009', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon5': '0.136', 'AMMO3': '0.161', 'weapon4': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.406', 'WEAPON3': '1.000', 'HITCOUNT': '2.930', 'weapon3': '3.036', 'DAMAGECOUNT': '15.018', 'FRAGCOUNT': '47.000'} [2023-02-25 14:50:34,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13585.1, 300 sec: 13579.3). Total num frames: 229666816. Throughput: 0: 3399.3. Samples: 19914498. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:50:34,730][36114] Avg episode reward: [(0, '57.816')] [2023-02-25 14:50:35,202][36138] Updated weights for policy 0, policy_version 56073 (0.0010) [2023-02-25 14:50:36,835][36142] DAMAGECOUNT value on done: 1409199.0 [2023-02-25 14:50:36,836][36142] Sum rewards: 58.798, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.309', 'AMMO5': '0.006', 'AMMO2': '0.012', 'weapon4': '0.030', 'AMMO4': '0.061', 'weapon5': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.454', 'WEAPON3': '1.350', 'weapon3': '3.222', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.369', 'FRAGCOUNT': '51.000'} [2023-02-25 14:50:37,135][36142] DAMAGECOUNT value on done: 1402755.0 [2023-02-25 14:50:37,135][36142] Sum rewards: 51.853, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.290', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.200', 'AMMO4': '0.224', 'AMMO3': '0.238', 'weapon2': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.588', 'WEAPON3': '1.300', 'weapon3': '2.686', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.454', 'FRAGCOUNT': '46.000'} [2023-02-25 14:50:37,838][36142] DAMAGECOUNT value on done: 1415812.0 [2023-02-25 14:50:37,839][36142] Sum rewards: 63.654, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.690', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.037', 'AMMO3': '0.128', 'AMMO4': '0.187', 'weapon5': '0.236', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.520', 'weapon4': '0.570', 'WEAPON3': '0.900', 'weapon3': '2.360', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.351', 'FRAGCOUNT': '53.000'} [2023-02-25 14:50:38,139][36142] DAMAGECOUNT value on done: 1419883.0 [2023-02-25 14:50:38,140][36142] Sum rewards: 54.393, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-3.852', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon5': '0.094', 'weapon4': '0.118', 'AMMO4': '0.120', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.326', 'weapon2': '0.346', 'WEAPON3': '1.950', 'weapon3': '3.122', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.345', 'FRAGCOUNT': '54.000'} [2023-02-25 14:50:38,208][36138] Updated weights for policy 0, policy_version 56083 (0.0009) [2023-02-25 14:50:38,372][36156] DAMAGECOUNT value on done: 1429909.0 [2023-02-25 14:50:38,372][36156] Sum rewards: 59.315, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.052', 'AMMO5': '0.003', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.052', 'weapon4': '0.076', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'weapon2': '0.232', 'AMMO3': '0.259', 'WEAPON3': '1.450', 'HITCOUNT': '3.030', 'weapon3': '3.314', 'DAMAGECOUNT': '15.075', 'FRAGCOUNT': '53.000'} [2023-02-25 14:50:38,678][36156] DAMAGECOUNT value on done: 1403960.0 [2023-02-25 14:50:38,678][36156] Sum rewards: 48.913, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.685', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.146', 'AMMO4': '0.178', 'AMMO3': '0.180', 'weapon4': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.648', 'WEAPON3': '1.100', 'weapon3': '2.598', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '12.528', 'FRAGCOUNT': '44.000'} [2023-02-25 14:50:38,846][36156] DAMAGECOUNT value on done: 1424178.0 [2023-02-25 14:50:38,846][36156] Sum rewards: 49.621, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.130', 'AMMO5': '0.012', 'AMMO2': '0.042', 'AMMO3': '0.187', 'AMMO4': '0.208', 'weapon5': '0.294', 'WEAPON5': '0.400', 'weapon2': '0.526', 'WEAPON4': '0.550', 'weapon4': '0.774', 'WEAPON3': '1.150', 'weapon3': '2.108', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.460', 'FRAGCOUNT': '44.000'} [2023-02-25 14:50:39,146][36156] DAMAGECOUNT value on done: 1411795.0 [2023-02-25 14:50:39,147][36156] Sum rewards: 74.037, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.920', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.048', 'AMMO4': '0.106', 'weapon4': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'WEAPON4': '0.250', 'weapon2': '0.388', 'WEAPON3': '1.150', 'weapon3': '3.256', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.379', 'FRAGCOUNT': '63.000'} [2023-02-25 14:50:39,729][36114] Fps is (10 sec: 13926.3, 60 sec: 13653.3, 300 sec: 13579.3). Total num frames: 229736448. Throughput: 0: 3399.4. Samples: 19924706. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:50:39,730][36114] Avg episode reward: [(0, '57.649')] [2023-02-25 14:50:41,205][36138] Updated weights for policy 0, policy_version 56093 (0.0010) [2023-02-25 14:50:44,235][36138] Updated weights for policy 0, policy_version 56103 (0.0009) [2023-02-25 14:50:44,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13585.1, 300 sec: 13579.3). Total num frames: 229801984. Throughput: 0: 3401.2. Samples: 19945180. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:50:44,730][36114] Avg episode reward: [(0, '57.649')] [2023-02-25 14:50:45,782][36154] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:50:47,158][36154] DAMAGECOUNT value on done: 1419297.0 [2023-02-25 14:50:47,159][36154] Sum rewards: 45.175, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.550', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.054', 'weapon5': '0.174', 'AMMO3': '0.183', 'AMMO4': '0.270', 'weapon2': '0.424', 'WEAPON5': '0.450', 'weapon4': '0.536', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.594', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '12.999', 'FRAGCOUNT': '40.000'} [2023-02-25 14:50:47,270][36138] Updated weights for policy 0, policy_version 56113 (0.0009) [2023-02-25 14:50:47,458][36154] DAMAGECOUNT value on done: 1403687.0 [2023-02-25 14:50:47,459][36154] Sum rewards: 58.105, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.957', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.054', 'AMMO3': '0.185', 'AMMO4': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.380', 'weapon2': '0.552', 'WEAPON3': '1.200', 'weapon3': '2.816', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.628', 'FRAGCOUNT': '50.000'} [2023-02-25 14:50:47,616][36155] DAMAGECOUNT value on done: 1411538.0 [2023-02-25 14:50:47,617][36155] Sum rewards: 53.501, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.496', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon2': '0.202', 'AMMO3': '0.209', 'weapon5': '0.232', 'AMMO4': '0.240', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.660', 'WEAPON3': '1.200', 'weapon3': '2.590', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.013', 'FRAGCOUNT': '46.000'} [2023-02-25 14:50:47,631][36139] DAMAGECOUNT value on done: 1421531.0 [2023-02-25 14:50:47,631][36139] Sum rewards: 65.641, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.718', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.114', 'weapon4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon2': '0.512', 'WEAPON3': '1.300', 'weapon3': '3.074', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.164', 'FRAGCOUNT': '56.000'} [2023-02-25 14:50:47,737][36154] DAMAGECOUNT value on done: 1436810.0 [2023-02-25 14:50:47,737][36154] Sum rewards: 57.281, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.054', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.057', 'weapon5': '0.106', 'AMMO3': '0.217', 'AMMO4': '0.286', 'WEAPON5': '0.400', 'weapon2': '0.462', 'WEAPON4': '0.600', 'weapon4': '0.814', 'WEAPON3': '1.250', 'weapon3': '2.356', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.777', 'FRAGCOUNT': '51.000'} [2023-02-25 14:50:47,934][36155] DAMAGECOUNT value on done: 1416478.0 [2023-02-25 14:50:47,934][36155] Sum rewards: 41.661, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.950', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.043', 'AMMO3': '0.146', 'AMMO4': '0.212', 'weapon5': '0.350', 'weapon4': '0.466', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon2': '0.610', 'WEAPON3': '0.950', 'weapon3': '2.278', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '11.799', 'FRAGCOUNT': '37.000'} [2023-02-25 14:50:47,940][36139] DAMAGECOUNT value on done: 1417668.0 [2023-02-25 14:50:47,940][36139] Sum rewards: 59.274, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.410', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.110', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.400', 'weapon4': '0.424', 'WEAPON3': '1.350', 'weapon3': '2.774', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.652', 'FRAGCOUNT': '53.500'} [2023-02-25 14:50:48,031][36154] DAMAGECOUNT value on done: 1414147.0 [2023-02-25 14:50:48,031][36154] Sum rewards: 60.203, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.049', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.143', 'AMMO3': '0.162', 'weapon5': '0.292', 'weapon2': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.540', 'WEAPON3': '1.000', 'weapon3': '2.572', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.594', 'FRAGCOUNT': '50.000'} [2023-02-25 14:50:48,417][36139] DAMAGECOUNT value on done: 1428730.0 [2023-02-25 14:50:48,417][36139] Sum rewards: 70.320, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.835', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO3': '0.183', 'AMMO4': '0.186', 'weapon5': '0.236', 'weapon2': '0.276', 'weapon4': '0.354', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.884', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '60.000'} [2023-02-25 14:50:48,528][36155] DAMAGECOUNT value on done: 1433366.0 [2023-02-25 14:50:48,529][36155] Sum rewards: 53.375, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.284', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.044', 'AMMO4': '0.144', 'weapon5': '0.164', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.602', 'WEAPON3': '1.150', 'HITCOUNT': '2.970', 'weapon3': '2.980', 'DAMAGECOUNT': '14.856', 'FRAGCOUNT': '46.000'} [2023-02-25 14:50:48,628][36141] DAMAGECOUNT value on done: 1423995.0 [2023-02-25 14:50:48,629][36141] Sum rewards: 51.188, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.131', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon5': '0.166', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.290', 'WEAPON4': '0.450', 'weapon4': '0.706', 'ARMOR': '0.951', 'WEAPON3': '1.100', 'weapon3': '2.366', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.682', 'FRAGCOUNT': '44.000'} [2023-02-25 14:50:48,738][36139] DAMAGECOUNT value on done: 1424512.0 [2023-02-25 14:50:48,739][36139] Sum rewards: 63.260, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.536', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.110', 'AMMO4': '0.173', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'weapon2': '0.270', 'WEAPON4': '0.400', 'ARMOR': '0.400', 'weapon4': '0.772', 'WEAPON3': '1.150', 'weapon3': '2.556', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '15.081', 'FRAGCOUNT': '55.000'} [2023-02-25 14:50:48,821][36155] DAMAGECOUNT value on done: 1413814.0 [2023-02-25 14:50:48,822][36155] Sum rewards: 64.417, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.390', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'WEAPON4': '0.250', 'weapon4': '0.572', 'weapon2': '0.916', 'WEAPON3': '1.150', 'weapon3': '2.192', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '53.000'} [2023-02-25 14:50:48,938][36141] DAMAGECOUNT value on done: 1424176.0 [2023-02-25 14:50:48,939][36141] Sum rewards: 52.999, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.799', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.110', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.264', 'WEAPON4': '0.350', 'weapon4': '0.390', 'WEAPON3': '1.250', 'HITCOUNT': '2.930', 'weapon3': '2.994', 'DAMAGECOUNT': '14.985', 'FRAGCOUNT': '46.000'} [2023-02-25 14:50:49,055][36141] DAMAGECOUNT value on done: 1415405.0 [2023-02-25 14:50:49,055][36141] Sum rewards: 57.698, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.207', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.045', 'AMMO3': '0.158', 'weapon5': '0.180', 'AMMO4': '0.223', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.366', 'weapon2': '0.544', 'WEAPON3': '1.150', 'weapon3': '2.694', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.553', 'FRAGCOUNT': '48.000'} [2023-02-25 14:50:49,192][36155] Large shaping reward 2.635 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.006, -2.0), ('ARMOR', -0.001, -1.0), ('weapon5', 0.002)] [2023-02-25 14:50:49,358][36141] DAMAGECOUNT value on done: 1397074.0 [2023-02-25 14:50:49,358][36141] Sum rewards: 53.863, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.750', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'weapon5': '0.156', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon4': '0.226', 'weapon2': '0.502', 'WEAPON3': '1.250', 'weapon3': '2.902', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.686', 'FRAGCOUNT': '47.000'} [2023-02-25 14:50:49,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13653.3, 300 sec: 13579.3). Total num frames: 229871616. Throughput: 0: 3401.3. Samples: 19965504. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:50:49,730][36114] Avg episode reward: [(0, '57.729')] [2023-02-25 14:50:50,281][36138] Updated weights for policy 0, policy_version 56123 (0.0009) [2023-02-25 14:50:50,483][36155] Large shaping reward 2.539 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.519, 173.0)] [2023-02-25 14:50:51,334][36157] DAMAGECOUNT value on done: 1431401.0 [2023-02-25 14:50:51,335][36157] Sum rewards: 65.735, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.966', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.154', 'weapon5': '0.156', 'WEAPON5': '0.350', 'weapon4': '0.424', 'WEAPON4': '0.450', 'weapon2': '0.642', 'WEAPON3': '1.050', 'weapon3': '2.546', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '56.000'} [2023-02-25 14:50:51,640][36157] DAMAGECOUNT value on done: 1419502.0 [2023-02-25 14:50:51,640][36157] Sum rewards: 58.800, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.205', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.080', 'weapon4': '0.168', 'AMMO3': '0.188', 'AMMO4': '0.199', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.150', 'weapon3': '3.140', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.216', 'FRAGCOUNT': '50.000'} [2023-02-25 14:50:52,103][36157] DAMAGECOUNT value on done: 1432029.0 [2023-02-25 14:50:52,103][36157] Sum rewards: 70.095, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.460', 'AMMO5': '0.006', 'weapon4': '0.016', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.234', 'WEAPON3': '1.250', 'weapon3': '3.428', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.692', 'FRAGCOUNT': '59.000'} [2023-02-25 14:50:52,400][36157] DAMAGECOUNT value on done: 1421260.0 [2023-02-25 14:50:52,400][36157] Sum rewards: 61.143, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.474', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.076', 'AMMO4': '0.150', 'weapon2': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.274', 'WEAPON4': '0.400', 'weapon4': '0.794', 'ARMOR': '0.858', 'WEAPON3': '1.600', 'weapon3': '2.728', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.929', 'FRAGCOUNT': '55.000'} [2023-02-25 14:50:53,062][36140] DAMAGECOUNT value on done: 1429432.0 [2023-02-25 14:50:53,063][36140] Sum rewards: 70.157, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.030', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO3': '0.132', 'AMMO4': '0.151', 'weapon5': '0.202', 'weapon2': '0.272', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.812', 'WEAPON3': '0.850', 'weapon3': '2.428', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '58.000'} [2023-02-25 14:50:53,119][36140] DAMAGECOUNT value on done: 1424401.0 [2023-02-25 14:50:53,119][36140] Sum rewards: 50.725, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.320', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.120', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'weapon2': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.614', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.428', 'FRAGCOUNT': '47.000'} [2023-02-25 14:50:53,286][36138] Updated weights for policy 0, policy_version 56133 (0.0009) [2023-02-25 14:50:53,368][36140] DAMAGECOUNT value on done: 1408669.0 [2023-02-25 14:50:53,368][36140] Sum rewards: 49.041, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.088', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.025', 'AMMO4': '0.126', 'AMMO3': '0.129', 'weapon5': '0.164', 'weapon2': '0.270', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'weapon4': '1.080', 'weapon3': '1.996', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.267', 'FRAGCOUNT': '41.000'} [2023-02-25 14:50:53,421][36140] DAMAGECOUNT value on done: 1411871.0 [2023-02-25 14:50:53,421][36140] Sum rewards: 76.624, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.550', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon2': '0.184', 'AMMO3': '0.284', 'WEAPON3': '1.750', 'weapon3': '3.606', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.149', 'FRAGCOUNT': '66.000'} [2023-02-25 14:50:54,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13585.0, 300 sec: 13579.3). Total num frames: 229937152. Throughput: 0: 3402.2. Samples: 19975708. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:50:54,730][36114] Avg episode reward: [(0, '57.765')] [2023-02-25 14:50:56,329][36138] Updated weights for policy 0, policy_version 56143 (0.0009) [2023-02-25 14:50:56,770][36142] DAMAGECOUNT value on done: 1413917.0 [2023-02-25 14:50:56,770][36142] Sum rewards: 48.821, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.310', 'AMMO5': '0.011', 'AMMO2': '0.054', 'weapon5': '0.128', 'AMMO3': '0.227', 'weapon4': '0.256', 'AMMO4': '0.269', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '2.740', 'weapon3': '3.030', 'DAMAGECOUNT': '14.154', 'FRAGCOUNT': '44.500'} [2023-02-25 14:50:57,075][36142] DAMAGECOUNT value on done: 1407774.0 [2023-02-25 14:50:57,076][36142] Sum rewards: 59.934, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.602', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.183', 'weapon5': '0.236', 'weapon2': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.736', 'WEAPON3': '1.100', 'weapon3': '2.510', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.057', 'FRAGCOUNT': '51.000'} [2023-02-25 14:50:57,778][36142] DAMAGECOUNT value on done: 1421243.0 [2023-02-25 14:50:57,779][36142] Sum rewards: 59.295, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.378', 'AMMO5': '0.013', 'AMMO2': '0.021', 'AMMO4': '0.102', 'AMMO3': '0.174', 'weapon5': '0.196', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.344', 'WEAPON3': '1.150', 'weapon3': '2.950', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '50.000'} [2023-02-25 14:50:58,086][36142] DAMAGECOUNT value on done: 1424572.0 [2023-02-25 14:50:58,086][36142] Sum rewards: 46.485, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.230', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon5': '0.200', 'AMMO4': '0.230', 'AMMO3': '0.240', 'weapon2': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.410', 'WEAPON3': '1.400', 'HITCOUNT': '2.810', 'weapon3': '2.814', 'DAMAGECOUNT': '14.067', 'FRAGCOUNT': '43.500'} [2023-02-25 14:50:58,280][36156] DAMAGECOUNT value on done: 1434964.0 [2023-02-25 14:50:58,280][36156] Sum rewards: 62.965, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.850', 'AMMO5': '0.007', 'AMMO2': '0.034', 'AMMO3': '0.140', 'AMMO4': '0.170', 'weapon5': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.348', 'weapon2': '0.652', 'WEAPON3': '0.850', 'weapon3': '2.576', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.165', 'FRAGCOUNT': '52.000'} [2023-02-25 14:50:58,577][36156] DAMAGECOUNT value on done: 1409914.0 [2023-02-25 14:50:58,577][36156] Sum rewards: 61.342, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.172', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.128', 'AMMO3': '0.181', 'AMMO4': '0.190', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.512', 'weapon2': '0.926', 'WEAPON3': '1.000', 'weapon3': '2.146', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '51.000'} [2023-02-25 14:50:58,743][36156] DAMAGECOUNT value on done: 1429973.0 [2023-02-25 14:50:58,743][36156] Sum rewards: 72.634, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.014', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.030', 'weapon5': '0.090', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon2': '0.284', 'WEAPON3': '1.150', 'HITCOUNT': '3.060', 'weapon3': '3.380', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '61.000'} [2023-02-25 14:50:59,047][36156] DAMAGECOUNT value on done: 1416845.0 [2023-02-25 14:50:59,048][36156] Sum rewards: 55.119, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.376', 'ARMOR': '0.005', 'AMMO5': '0.017', 'AMMO2': '0.034', 'AMMO3': '0.152', 'weapon5': '0.166', 'AMMO4': '0.170', 'weapon2': '0.388', 'weapon4': '0.424', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.900', 'weapon3': '2.808', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.150', 'FRAGCOUNT': '45.000'} [2023-02-25 14:50:59,370][36138] Updated weights for policy 0, policy_version 56153 (0.0009) [2023-02-25 14:50:59,729][36114] Fps is (10 sec: 13517.0, 60 sec: 13585.1, 300 sec: 13579.3). Total num frames: 230006784. Throughput: 0: 3398.1. Samples: 19995920. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:50:59,730][36114] Avg episode reward: [(0, '57.531')] [2023-02-25 14:51:02,399][36138] Updated weights for policy 0, policy_version 56163 (0.0010) [2023-02-25 14:51:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 230072320. Throughput: 0: 3393.2. Samples: 20016168. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:51:04,730][36114] Avg episode reward: [(0, '57.531')] [2023-02-25 14:51:05,468][36138] Updated weights for policy 0, policy_version 56173 (0.0009) [2023-02-25 14:51:07,069][36154] DAMAGECOUNT value on done: 1425250.0 [2023-02-25 14:51:07,070][36154] Sum rewards: 74.030, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.566', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'weapon5': '0.050', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon2': '0.308', 'weapon4': '0.424', 'WEAPON3': '1.300', 'weapon3': '3.062', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '62.000'} [2023-02-25 14:51:07,369][36154] DAMAGECOUNT value on done: 1407707.0 [2023-02-25 14:51:07,370][36154] Sum rewards: 48.931, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.234', 'ARMOR': '0.012', 'AMMO5': '0.019', 'AMMO2': '0.060', 'AMMO3': '0.167', 'weapon5': '0.298', 'AMMO4': '0.301', 'weapon2': '0.384', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.580', 'WEAPON3': '1.000', 'weapon3': '2.444', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '11.790', 'FRAGCOUNT': '43.000'} [2023-02-25 14:51:07,524][36139] DAMAGECOUNT value on done: 1426541.0 [2023-02-25 14:51:07,525][36139] Sum rewards: 52.567, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.130', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.056', 'AMMO3': '0.141', 'weapon2': '0.222', 'weapon5': '0.236', 'AMMO4': '0.278', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '0.850', 'weapon3': '1.468', 'weapon4': '1.492', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.030', 'FRAGCOUNT': '44.000'} [2023-02-25 14:51:07,550][36155] DAMAGECOUNT value on done: 1416186.0 [2023-02-25 14:51:07,550][36155] Sum rewards: 54.690, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.230', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.132', 'AMMO3': '0.144', 'weapon5': '0.156', 'WEAPON5': '0.250', 'weapon2': '0.290', 'WEAPON4': '0.350', 'weapon4': '0.732', 'WEAPON3': '0.800', 'weapon3': '2.572', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.659', 'FRAGCOUNT': '46.000'} [2023-02-25 14:51:07,654][36154] DAMAGECOUNT value on done: 1442521.0 [2023-02-25 14:51:07,655][36154] Sum rewards: 73.944, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.742', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'weapon4': '0.112', 'AMMO3': '0.183', 'weapon2': '0.402', 'WEAPON3': '1.200', 'weapon3': '3.346', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '61.000'} [2023-02-25 14:51:07,835][36139] DAMAGECOUNT value on done: 1423253.0 [2023-02-25 14:51:07,836][36139] Sum rewards: 62.549, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.530', 'AMMO5': '0.017', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon2': '0.168', 'AMMO3': '0.226', 'weapon5': '0.260', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.594', 'WEAPON3': '1.300', 'weapon3': '2.584', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '54.000'} [2023-02-25 14:51:07,857][36155] DAMAGECOUNT value on done: 1422521.0 [2023-02-25 14:51:07,858][36155] Sum rewards: 65.615, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.960', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon2': '0.206', 'AMMO3': '0.231', 'AMMO4': '0.252', 'weapon5': '0.266', 'weapon4': '0.326', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.844', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.129', 'FRAGCOUNT': '58.500'} [2023-02-25 14:51:07,961][36154] DAMAGECOUNT value on done: 1419826.0 [2023-02-25 14:51:07,961][36154] Sum rewards: 60.176, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.286', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.169', 'weapon5': '0.170', 'AMMO3': '0.262', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.322', 'WEAPON3': '1.450', 'weapon3': '2.914', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '53.000'} [2023-02-25 14:51:08,292][36139] DAMAGECOUNT value on done: 1433649.0 [2023-02-25 14:51:08,292][36139] Sum rewards: 56.098, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.720', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.035', 'AMMO4': '0.176', 'AMMO3': '0.215', 'weapon5': '0.218', 'weapon2': '0.278', 'weapon4': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.686', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.757', 'FRAGCOUNT': '51.000'} [2023-02-25 14:51:08,442][36155] DAMAGECOUNT value on done: 1438742.0 [2023-02-25 14:51:08,442][36155] Sum rewards: 62.701, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.655', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon5': '0.118', 'AMMO4': '0.135', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON4': '0.350', 'weapon4': '0.436', 'WEAPON3': '1.200', 'weapon3': '2.916', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.128', 'FRAGCOUNT': '54.000'} [2023-02-25 14:51:08,538][36138] Updated weights for policy 0, policy_version 56183 (0.0010) [2023-02-25 14:51:08,592][36139] DAMAGECOUNT value on done: 1429632.0 [2023-02-25 14:51:08,593][36139] Sum rewards: 57.474, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.208', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.158', 'AMMO3': '0.176', 'weapon2': '0.252', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.568', 'WEAPON3': '1.200', 'weapon3': '2.792', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.360', 'FRAGCOUNT': '49.000'} [2023-02-25 14:51:08,608][36141] DAMAGECOUNT value on done: 1428409.0 [2023-02-25 14:51:08,609][36141] Sum rewards: 52.198, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.510', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.028', 'AMMO4': '0.103', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon2': '0.488', 'WEAPON3': '1.150', 'HITCOUNT': '2.850', 'weapon3': '3.216', 'DAMAGECOUNT': '13.227', 'FRAGCOUNT': '44.000'} [2023-02-25 14:51:08,744][36155] DAMAGECOUNT value on done: 1419360.0 [2023-02-25 14:51:08,745][36155] Sum rewards: 70.622, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.135', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.037', 'AMMO3': '0.164', 'AMMO4': '0.185', 'weapon5': '0.186', 'WEAPON5': '0.200', 'weapon4': '0.258', 'WEAPON4': '0.350', 'weapon2': '0.636', 'WEAPON3': '0.950', 'weapon3': '2.704', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '59.000'} [2023-02-25 14:51:08,909][36141] DAMAGECOUNT value on done: 1420187.0 [2023-02-25 14:51:08,909][36141] Sum rewards: 60.011, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.365', 'AMMO5': '0.005', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'weapon4': '0.442', 'weapon2': '0.806', 'WEAPON3': '0.900', 'weapon3': '2.308', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.346', 'FRAGCOUNT': '49.000'} [2023-02-25 14:51:08,919][36141] DAMAGECOUNT value on done: 1429868.0 [2023-02-25 14:51:08,920][36141] Sum rewards: 64.697, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.462', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.172', 'weapon5': '0.240', 'weapon2': '0.360', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.842', 'WEAPON3': '1.000', 'weapon3': '2.278', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '54.000'} [2023-02-25 14:51:09,230][36141] DAMAGECOUNT value on done: 1402920.0 [2023-02-25 14:51:09,231][36141] Sum rewards: 73.464, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.092', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.056', 'weapon2': '0.186', 'AMMO3': '0.231', 'weapon4': '0.264', 'WEAPON3': '1.350', 'weapon3': '3.314', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '62.000'} [2023-02-25 14:51:09,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13579.3). Total num frames: 230141952. Throughput: 0: 3386.6. Samples: 20026128. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:51:09,729][36114] Avg episode reward: [(0, '58.629')] [2023-02-25 14:51:11,323][36157] DAMAGECOUNT value on done: 1437433.0 [2023-02-25 14:51:11,324][36157] Sum rewards: 66.344, reward structure: {'DEATHCOUNT': '-15.750', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.072', 'AMMO4': '0.075', 'HEALTH': '0.078', 'WEAPON5': '0.100', 'weapon4': '0.198', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.244', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '55.000'} [2023-02-25 14:51:11,484][36138] Updated weights for policy 0, policy_version 56193 (0.0009) [2023-02-25 14:51:11,627][36157] DAMAGECOUNT value on done: 1425020.0 [2023-02-25 14:51:11,628][36157] Sum rewards: 64.762, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.612', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.024', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'WEAPON4': '0.200', 'weapon2': '0.202', 'AMMO3': '0.259', 'weapon4': '0.264', 'WEAPON3': '1.550', 'weapon3': '3.182', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '58.000'} [2023-02-25 14:51:12,096][36157] DAMAGECOUNT value on done: 1437974.0 [2023-02-25 14:51:12,096][36157] Sum rewards: 69.009, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.810', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.112', 'weapon4': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.184', 'weapon2': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.190', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '59.000'} [2023-02-25 14:51:12,412][36157] DAMAGECOUNT value on done: 1427217.0 [2023-02-25 14:51:12,412][36157] Sum rewards: 68.705, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.470', 'AMMO2': '0.005', 'AMMO4': '0.027', 'WEAPON4': '0.100', 'AMMO3': '0.226', 'weapon4': '0.234', 'weapon2': '0.302', 'WEAPON3': '1.400', 'weapon3': '3.290', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '58.000'} [2023-02-25 14:51:12,869][36140] DAMAGECOUNT value on done: 1434163.0 [2023-02-25 14:51:12,869][36140] Sum rewards: 54.555, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.763', 'AMMO5': '0.020', 'AMMO2': '0.048', 'weapon5': '0.122', 'weapon4': '0.152', 'AMMO3': '0.202', 'AMMO4': '0.238', 'weapon2': '0.382', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.920', 'weapon3': '3.010', 'DAMAGECOUNT': '13.773', 'FRAGCOUNT': '50.000'} [2023-02-25 14:51:12,929][36140] DAMAGECOUNT value on done: 1429903.0 [2023-02-25 14:51:12,929][36140] Sum rewards: 66.136, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.440', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.056', 'weapon5': '0.082', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'weapon2': '0.734', 'WEAPON3': '1.100', 'weapon3': '2.960', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.506', 'FRAGCOUNT': '55.500'} [2023-02-25 14:51:13,188][36140] DAMAGECOUNT value on done: 1414097.0 [2023-02-25 14:51:13,188][36140] Sum rewards: 60.768, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.348', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.086', 'AMMO4': '0.136', 'weapon4': '0.174', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.618', 'WEAPON3': '1.300', 'weapon3': '2.936', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '52.000'} [2023-02-25 14:51:13,240][36140] DAMAGECOUNT value on done: 1418404.0 [2023-02-25 14:51:13,240][36140] Sum rewards: 75.567, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.940', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.058', 'AMMO4': '0.146', 'weapon4': '0.190', 'WEAPON5': '0.200', 'weapon2': '0.206', 'AMMO3': '0.249', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.292', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.599', 'FRAGCOUNT': '65.500'} [2023-02-25 14:51:14,524][36138] Updated weights for policy 0, policy_version 56203 (0.0009) [2023-02-25 14:51:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 230207488. Throughput: 0: 3386.2. Samples: 20046480. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:51:14,729][36114] Avg episode reward: [(0, '58.806')] [2023-02-25 14:51:16,731][36142] DAMAGECOUNT value on done: 1419089.0 [2023-02-25 14:51:16,731][36142] Sum rewards: 55.744, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.320', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.116', 'AMMO4': '0.127', 'weapon2': '0.154', 'AMMO3': '0.186', 'WEAPON5': '0.250', 'weapon4': '0.328', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.090', 'weapon3': '3.208', 'DAMAGECOUNT': '15.516', 'FRAGCOUNT': '47.000'} [2023-02-25 14:51:17,021][36142] DAMAGECOUNT value on done: 1412486.0 [2023-02-25 14:51:17,022][36142] Sum rewards: 56.406, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.889', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.010', 'AMMO4': '0.037', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.208', 'weapon4': '0.232', 'weapon2': '0.596', 'WEAPON3': '1.350', 'weapon3': '2.996', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.136', 'FRAGCOUNT': '50.000'} [2023-02-25 14:51:17,494][36138] Updated weights for policy 0, policy_version 56213 (0.0009) [2023-02-25 14:51:17,700][36142] DAMAGECOUNT value on done: 1426824.0 [2023-02-25 14:51:17,700][36142] Sum rewards: 61.868, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.478', 'AMMO5': '0.014', 'AMMO2': '0.024', 'weapon5': '0.110', 'AMMO4': '0.120', 'AMMO3': '0.204', 'weapon2': '0.314', 'weapon4': '0.346', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '2.970', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '53.500'} [2023-02-25 14:51:18,003][36142] DAMAGECOUNT value on done: 1429833.0 [2023-02-25 14:51:18,004][36142] Sum rewards: 62.631, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.922', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.035', 'AMMO3': '0.140', 'AMMO4': '0.174', 'weapon5': '0.182', 'weapon2': '0.206', 'WEAPON5': '0.350', 'WEAPON4': '0.700', 'WEAPON3': '0.850', 'weapon4': '1.296', 'weapon3': '1.956', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '54.000'} [2023-02-25 14:51:18,188][36156] DAMAGECOUNT value on done: 1441346.0 [2023-02-25 14:51:18,189][36156] Sum rewards: 77.051, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.780', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon2': '0.194', 'weapon5': '0.194', 'AMMO3': '0.195', 'weapon4': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.136', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.146', 'FRAGCOUNT': '65.000'} [2023-02-25 14:51:18,490][36156] DAMAGECOUNT value on done: 1415217.0 [2023-02-25 14:51:18,491][36156] Sum rewards: 63.891, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.490', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon2': '0.172', 'AMMO4': '0.173', 'AMMO3': '0.240', 'weapon5': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.634', 'WEAPON3': '1.400', 'weapon3': '2.636', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.909', 'FRAGCOUNT': '56.000'} [2023-02-25 14:51:18,637][36156] DAMAGECOUNT value on done: 1436003.0 [2023-02-25 14:51:18,638][36156] Sum rewards: 68.173, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.796', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.061', 'AMMO3': '0.171', 'weapon5': '0.248', 'AMMO4': '0.303', 'weapon2': '0.326', 'weapon4': '0.530', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.580', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '58.000'} [2023-02-25 14:51:18,949][36156] DAMAGECOUNT value on done: 1422029.0 [2023-02-25 14:51:18,950][36156] Sum rewards: 60.040, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.971', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.074', 'AMMO4': '0.100', 'weapon5': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.218', 'WEAPON3': '1.300', 'HITCOUNT': '2.890', 'weapon3': '3.390', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '52.000'} [2023-02-25 14:51:19,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 230277120. Throughput: 0: 3390.1. Samples: 20067054. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:51:19,729][36114] Avg episode reward: [(0, '59.093')] [2023-02-25 14:51:19,733][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000056220_230277120.pth... [2023-02-25 14:51:19,798][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000055425_227020800.pth [2023-02-25 14:51:20,215][36156] Large shaping reward 2.640 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-25 14:51:20,473][36138] Updated weights for policy 0, policy_version 56223 (0.0009) [2023-02-25 14:51:23,468][36138] Updated weights for policy 0, policy_version 56233 (0.0010) [2023-02-25 14:51:24,729][36114] Fps is (10 sec: 13926.4, 60 sec: 13585.1, 300 sec: 13579.3). Total num frames: 230346752. Throughput: 0: 3390.9. Samples: 20077296. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:51:24,730][36114] Avg episode reward: [(0, '59.093')] [2023-02-25 14:51:26,497][36138] Updated weights for policy 0, policy_version 56243 (0.0009) [2023-02-25 14:51:26,708][36154] DAMAGECOUNT value on done: 1430498.0 [2023-02-25 14:51:26,708][36154] Sum rewards: 67.148, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.580', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.096', 'AMMO4': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'weapon4': '0.164', 'WEAPON4': '0.200', 'weapon2': '0.272', 'WEAPON3': '1.000', 'HITCOUNT': '3.250', 'weapon3': '3.324', 'DAMAGECOUNT': '15.744', 'FRAGCOUNT': '55.500'} [2023-02-25 14:51:27,011][36154] DAMAGECOUNT value on done: 1412731.0 [2023-02-25 14:51:27,012][36154] Sum rewards: 50.766, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.950', 'ARMOR': '0.004', 'AMMO5': '0.027', 'AMMO2': '0.049', 'weapon5': '0.152', 'AMMO3': '0.221', 'AMMO4': '0.243', 'weapon2': '0.304', 'weapon4': '0.420', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.814', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.072', 'FRAGCOUNT': '47.000'} [2023-02-25 14:51:27,051][36155] DAMAGECOUNT value on done: 1421516.0 [2023-02-25 14:51:27,051][36155] Sum rewards: 64.184, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.172', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.046', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'weapon2': '0.198', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon4': '0.532', 'WEAPON3': '1.050', 'weapon3': '3.050', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.990', 'FRAGCOUNT': '53.000'} [2023-02-25 14:51:27,187][36139] DAMAGECOUNT value on done: 1431961.0 [2023-02-25 14:51:27,187][36139] Sum rewards: 65.659, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.420', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'AMMO3': '0.215', 'weapon2': '0.304', 'weapon4': '0.494', 'WEAPON3': '1.200', 'weapon3': '2.932', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '55.000'} [2023-02-25 14:51:27,335][36154] DAMAGECOUNT value on done: 1447430.0 [2023-02-25 14:51:27,336][36154] Sum rewards: 54.222, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.893', 'AMMO5': '0.008', 'AMMO2': '0.049', 'weapon5': '0.086', 'weapon4': '0.220', 'AMMO3': '0.240', 'AMMO4': '0.243', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.576', 'WEAPON3': '1.400', 'weapon3': '2.796', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '14.727', 'FRAGCOUNT': '50.500'} [2023-02-25 14:51:27,355][36155] DAMAGECOUNT value on done: 1428102.0 [2023-02-25 14:51:27,355][36155] Sum rewards: 62.554, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.988', 'AMMO5': '0.011', 'AMMO2': '0.020', 'weapon4': '0.056', 'AMMO4': '0.101', 'weapon5': '0.186', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.670', 'WEAPON3': '1.300', 'weapon3': '2.868', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '54.000'} [2023-02-25 14:51:27,508][36139] DAMAGECOUNT value on done: 1427878.0 [2023-02-25 14:51:27,509][36139] Sum rewards: 47.007, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.948', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon2': '0.162', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.416', 'weapon4': '1.010', 'WEAPON3': '1.100', 'weapon3': '2.146', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.875', 'FRAGCOUNT': '39.000'} [2023-02-25 14:51:27,638][36154] DAMAGECOUNT value on done: 1424510.0 [2023-02-25 14:51:27,639][36154] Sum rewards: 54.253, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.462', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.094', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'weapon2': '0.246', 'WEAPON4': '0.250', 'weapon4': '0.514', 'WEAPON3': '1.350', 'HITCOUNT': '2.810', 'weapon3': '2.882', 'DAMAGECOUNT': '14.052', 'FRAGCOUNT': '49.000'} [2023-02-25 14:51:27,904][36139] DAMAGECOUNT value on done: 1438603.0 [2023-02-25 14:51:27,904][36139] Sum rewards: 55.730, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.680', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.096', 'weapon5': '0.112', 'AMMO4': '0.114', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.544', 'WEAPON3': '1.400', 'weapon3': '3.002', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '51.000'} [2023-02-25 14:51:27,954][36155] DAMAGECOUNT value on done: 1443641.0 [2023-02-25 14:51:27,955][36155] Sum rewards: 54.983, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.142', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.049', 'AMMO3': '0.122', 'AMMO4': '0.243', 'weapon5': '0.334', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon2': '0.628', 'weapon4': '0.760', 'WEAPON3': '0.850', 'weapon3': '2.032', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.697', 'FRAGCOUNT': '47.000'} [2023-02-25 14:51:28,205][36139] DAMAGECOUNT value on done: 1435365.0 [2023-02-25 14:51:28,206][36139] Sum rewards: 68.542, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.146', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.052', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.170', 'AMMO3': '0.214', 'weapon2': '0.534', 'WEAPON3': '1.250', 'weapon3': '2.978', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '57.000'} [2023-02-25 14:51:28,268][36155] DAMAGECOUNT value on done: 1424948.0 [2023-02-25 14:51:28,269][36155] Sum rewards: 68.454, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.100', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon5': '0.072', 'weapon4': '0.146', 'AMMO3': '0.202', 'AMMO4': '0.253', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.738', 'WEAPON3': '1.150', 'weapon3': '2.792', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.704', 'FRAGCOUNT': '59.000'} [2023-02-25 14:51:28,284][36141] DAMAGECOUNT value on done: 1433803.0 [2023-02-25 14:51:28,285][36141] Sum rewards: 59.245, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.909', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.159', 'WEAPON5': '0.200', 'weapon2': '0.216', 'AMMO3': '0.223', 'weapon5': '0.234', 'WEAPON4': '0.300', 'weapon4': '0.480', 'WEAPON3': '1.400', 'weapon3': '2.760', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '51.500'} [2023-02-25 14:51:28,598][36141] DAMAGECOUNT value on done: 1425178.0 [2023-02-25 14:51:28,598][36141] Sum rewards: 55.105, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.290', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.202', 'weapon5': '0.382', 'weapon2': '0.410', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.632', 'WEAPON3': '1.150', 'weapon3': '2.240', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.973', 'FRAGCOUNT': '49.000'} [2023-02-25 14:51:28,606][36141] DAMAGECOUNT value on done: 1434582.0 [2023-02-25 14:51:28,606][36141] Sum rewards: 56.512, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.724', 'ARMOR': '0.004', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon2': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon4': '0.318', 'WEAPON3': '1.150', 'HITCOUNT': '2.920', 'weapon3': '3.362', 'DAMAGECOUNT': '14.112', 'FRAGCOUNT': '49.000'} [2023-02-25 14:51:28,924][36141] DAMAGECOUNT value on done: 1408618.0 [2023-02-25 14:51:28,924][36141] Sum rewards: 63.887, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.300', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon4': '0.226', 'weapon2': '0.534', 'WEAPON3': '1.250', 'weapon3': '2.882', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '53.000'} [2023-02-25 14:51:29,534][36138] Updated weights for policy 0, policy_version 56253 (0.0009) [2023-02-25 14:51:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.0, 300 sec: 13565.4). Total num frames: 230412288. Throughput: 0: 3388.4. Samples: 20097660. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:51:29,730][36114] Avg episode reward: [(0, '60.106')] [2023-02-25 14:51:31,108][36157] DAMAGECOUNT value on done: 1442566.0 [2023-02-25 14:51:31,108][36157] Sum rewards: 61.907, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.678', 'AMMO5': '0.004', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon4': '0.218', 'weapon2': '0.278', 'WEAPON3': '1.300', 'HITCOUNT': '3.160', 'weapon3': '3.292', 'DAMAGECOUNT': '15.399', 'FRAGCOUNT': '53.000'} [2023-02-25 14:51:31,415][36157] DAMAGECOUNT value on done: 1429283.0 [2023-02-25 14:51:31,415][36157] Sum rewards: 56.751, reward structure: {'DEATHCOUNT': '-9.750', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO3': '0.100', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'weapon5': '0.192', 'WEAPON4': '0.200', 'WEAPON3': '0.600', 'weapon2': '0.622', 'weapon4': '0.664', 'HEALTH': '0.894', 'weapon3': '2.382', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.774', 'FRAGCOUNT': '45.000'} [2023-02-25 14:51:31,887][36157] DAMAGECOUNT value on done: 1443230.0 [2023-02-25 14:51:31,887][36157] Sum rewards: 60.348, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.430', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon5': '0.226', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'weapon2': '0.308', 'WEAPON4': '0.350', 'weapon4': '0.502', 'WEAPON3': '1.400', 'weapon3': '2.612', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.768', 'FRAGCOUNT': '54.000'} [2023-02-25 14:51:32,195][36157] DAMAGECOUNT value on done: 1431842.0 [2023-02-25 14:51:32,196][36157] Sum rewards: 56.265, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.785', 'AMMO5': '0.013', 'AMMO2': '0.019', 'weapon4': '0.066', 'AMMO4': '0.097', 'weapon5': '0.126', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.512', 'WEAPON3': '1.200', 'HITCOUNT': '2.640', 'weapon3': '3.058', 'DAMAGECOUNT': '13.875', 'FRAGCOUNT': '50.000'} [2023-02-25 14:51:32,521][36138] Updated weights for policy 0, policy_version 56263 (0.0009) [2023-02-25 14:51:32,676][36140] DAMAGECOUNT value on done: 1439392.0 [2023-02-25 14:51:32,677][36140] Sum rewards: 57.029, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.150', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon4': '0.160', 'AMMO4': '0.217', 'AMMO3': '0.248', 'weapon5': '0.248', 'weapon2': '0.302', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.942', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.687', 'FRAGCOUNT': '53.000'} [2023-02-25 14:51:32,739][36140] DAMAGECOUNT value on done: 1435798.0 [2023-02-25 14:51:32,740][36140] Sum rewards: 71.181, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.351', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.027', 'AMMO3': '0.114', 'weapon5': '0.118', 'AMMO4': '0.134', 'weapon2': '0.214', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '0.650', 'weapon4': '0.764', 'weapon3': '2.752', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '56.000'} [2023-02-25 14:51:32,995][36140] DAMAGECOUNT value on done: 1420125.0 [2023-02-25 14:51:32,995][36140] Sum rewards: 67.352, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.447', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.112', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'weapon5': '0.168', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.484', 'WEAPON3': '1.250', 'weapon3': '2.986', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '57.000'} [2023-02-25 14:51:33,054][36140] DAMAGECOUNT value on done: 1423877.0 [2023-02-25 14:51:33,054][36140] Sum rewards: 64.729, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.815', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO3': '0.187', 'weapon2': '0.266', 'WEAPON3': '1.100', 'HITCOUNT': '3.260', 'weapon3': '3.568', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '52.000'} [2023-02-25 14:51:34,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 230481920. Throughput: 0: 3391.3. Samples: 20118112. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:51:34,730][36114] Avg episode reward: [(0, '60.330')] [2023-02-25 14:51:35,537][36138] Updated weights for policy 0, policy_version 56273 (0.0009) [2023-02-25 14:51:36,436][36142] DAMAGECOUNT value on done: 1424078.0 [2023-02-25 14:51:36,437][36142] Sum rewards: 54.359, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.030', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon4': '0.086', 'weapon5': '0.086', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.293', 'weapon2': '0.330', 'WEAPON3': '1.700', 'HITCOUNT': '3.180', 'weapon3': '3.230', 'DAMAGECOUNT': '14.967', 'FRAGCOUNT': '49.500'} [2023-02-25 14:51:36,750][36142] DAMAGECOUNT value on done: 1416908.0 [2023-02-25 14:51:36,751][36142] Sum rewards: 49.048, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.227', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.128', 'WEAPON5': '0.200', 'weapon2': '0.230', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon5': '0.332', 'weapon4': '0.382', 'WEAPON3': '1.400', 'HITCOUNT': '2.770', 'weapon3': '2.798', 'DAMAGECOUNT': '13.266', 'FRAGCOUNT': '45.000'} [2023-02-25 14:51:37,443][36142] DAMAGECOUNT value on done: 1431418.0 [2023-02-25 14:51:37,444][36142] Sum rewards: 54.732, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.898', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.052', 'AMMO4': '0.127', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.372', 'weapon4': '0.618', 'WEAPON3': '1.200', 'weapon3': '2.404', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.782', 'FRAGCOUNT': '47.000'} [2023-02-25 14:51:37,741][36142] DAMAGECOUNT value on done: 1434248.0 [2023-02-25 14:51:37,742][36142] Sum rewards: 54.788, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.264', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.150', 'AMMO4': '0.236', 'AMMO3': '0.245', 'WEAPON5': '0.350', 'weapon2': '0.364', 'WEAPON4': '0.550', 'weapon4': '0.606', 'WEAPON3': '1.400', 'weapon3': '2.576', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.245', 'FRAGCOUNT': '54.000'} [2023-02-25 14:51:37,998][36156] DAMAGECOUNT value on done: 1446482.0 [2023-02-25 14:51:37,998][36156] Sum rewards: 64.569, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.381', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon7': '0.084', 'weapon5': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.222', 'weapon2': '0.254', 'weapon4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.800', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.246', 'FRAGCOUNT': '56.000'} [2023-02-25 14:51:38,310][36156] DAMAGECOUNT value on done: 1420481.0 [2023-02-25 14:51:38,310][36156] Sum rewards: 52.648, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.778', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.035', 'AMMO3': '0.164', 'AMMO4': '0.177', 'weapon5': '0.252', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.508', 'weapon2': '0.638', 'WEAPON3': '1.050', 'weapon3': '2.298', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.783', 'FRAGCOUNT': '44.500'} [2023-02-25 14:51:38,447][36156] DAMAGECOUNT value on done: 1441837.0 [2023-02-25 14:51:38,448][36156] Sum rewards: 67.980, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.248', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.098', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.196', 'AMMO3': '0.235', 'weapon4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.164', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '58.000'} [2023-02-25 14:51:38,540][36138] Updated weights for policy 0, policy_version 56283 (0.0009) [2023-02-25 14:51:38,743][36156] DAMAGECOUNT value on done: 1426638.0 [2023-02-25 14:51:38,743][36156] Sum rewards: 55.329, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.630', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO3': '0.244', 'weapon2': '0.406', 'WEAPON3': '1.550', 'HITCOUNT': '2.980', 'weapon3': '3.470', 'DAMAGECOUNT': '13.827', 'FRAGCOUNT': '50.000'} [2023-02-25 14:51:39,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13565.4). Total num frames: 230547456. Throughput: 0: 3390.1. Samples: 20128264. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:51:39,729][36114] Avg episode reward: [(0, '60.274')] [2023-02-25 14:51:41,553][36138] Updated weights for policy 0, policy_version 56293 (0.0009) [2023-02-25 14:51:44,649][36138] Updated weights for policy 0, policy_version 56303 (0.0009) [2023-02-25 14:51:44,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 230617088. Throughput: 0: 3393.5. Samples: 20148628. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:51:44,729][36114] Avg episode reward: [(0, '60.274')] [2023-02-25 14:51:46,440][36154] DAMAGECOUNT value on done: 1435515.0 [2023-02-25 14:51:46,441][36154] Sum rewards: 59.686, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.576', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon5': '0.116', 'AMMO4': '0.154', 'AMMO3': '0.196', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.556', 'weapon4': '0.668', 'WEAPON3': '1.250', 'weapon3': '2.356', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.051', 'FRAGCOUNT': '53.000'} [2023-02-25 14:51:46,759][36154] DAMAGECOUNT value on done: 1418704.0 [2023-02-25 14:51:46,759][36154] Sum rewards: 71.167, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.438', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.132', 'weapon4': '0.150', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.560', 'WEAPON3': '1.150', 'weapon3': '2.952', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '59.000'} [2023-02-25 14:51:46,962][36155] DAMAGECOUNT value on done: 1427193.0 [2023-02-25 14:51:46,962][36155] Sum rewards: 68.726, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.354', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.094', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'weapon2': '0.262', 'WEAPON3': '1.400', 'HITCOUNT': '3.210', 'weapon3': '3.398', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '60.000'} [2023-02-25 14:51:47,016][36139] DAMAGECOUNT value on done: 1437131.0 [2023-02-25 14:51:47,016][36139] Sum rewards: 60.797, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.065', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'weapon2': '0.228', 'AMMO3': '0.264', 'weapon4': '0.282', 'WEAPON3': '1.550', 'weapon3': '3.286', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '54.000'} [2023-02-25 14:51:47,105][36154] DAMAGECOUNT value on done: 1451493.0 [2023-02-25 14:51:47,105][36154] Sum rewards: 45.147, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.848', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'weapon2': '0.144', 'AMMO3': '0.170', 'WEAPON4': '0.250', 'weapon4': '0.790', 'WEAPON3': '1.050', 'weapon3': '2.520', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '12.189', 'FRAGCOUNT': '39.000'} [2023-02-25 14:51:47,276][36155] DAMAGECOUNT value on done: 1433706.0 [2023-02-25 14:51:47,277][36155] Sum rewards: 59.195, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.860', 'AMMO5': '0.016', 'AMMO2': '0.040', 'AMMO4': '0.202', 'AMMO3': '0.238', 'weapon2': '0.276', 'weapon5': '0.284', 'weapon4': '0.396', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.720', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.812', 'FRAGCOUNT': '52.500'} [2023-02-25 14:51:47,323][36139] DAMAGECOUNT value on done: 1432828.0 [2023-02-25 14:51:47,323][36139] Sum rewards: 58.553, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.560', 'AMMO5': '0.017', 'AMMO2': '0.039', 'AMMO3': '0.149', 'AMMO4': '0.197', 'weapon2': '0.236', 'weapon5': '0.252', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'weapon4': '0.914', 'weapon3': '2.308', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.850', 'FRAGCOUNT': '49.000'} [2023-02-25 14:51:47,419][36154] DAMAGECOUNT value on done: 1429402.0 [2023-02-25 14:51:47,419][36154] Sum rewards: 58.745, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.870', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.110', 'AMMO3': '0.128', 'AMMO4': '0.211', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.464', 'weapon4': '0.652', 'WEAPON3': '0.750', 'weapon3': '2.402', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '48.500'} [2023-02-25 14:51:47,709][36138] Updated weights for policy 0, policy_version 56313 (0.0009) [2023-02-25 14:51:47,744][36139] DAMAGECOUNT value on done: 1443721.0 [2023-02-25 14:51:47,744][36139] Sum rewards: 53.609, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.022', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.046', 'AMMO3': '0.152', 'AMMO4': '0.229', 'weapon5': '0.286', 'weapon4': '0.348', 'weapon2': '0.394', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.634', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.354', 'FRAGCOUNT': '45.000'} [2023-02-25 14:51:47,901][36155] DAMAGECOUNT value on done: 1448790.0 [2023-02-25 14:51:47,901][36155] Sum rewards: 59.052, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.029', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.048', 'AMMO3': '0.148', 'AMMO4': '0.241', 'weapon5': '0.278', 'WEAPON5': '0.350', 'weapon2': '0.428', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'weapon4': '0.968', 'weapon3': '2.042', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.447', 'FRAGCOUNT': '49.000'} [2023-02-25 14:51:48,057][36139] DAMAGECOUNT value on done: 1440908.0 [2023-02-25 14:51:48,058][36139] Sum rewards: 65.585, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.869', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.148', 'AMMO3': '0.168', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.354', 'weapon4': '0.488', 'WEAPON3': '1.100', 'weapon3': '2.782', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.374', 'FRAGCOUNT': '54.500'} [2023-02-25 14:51:48,129][36141] DAMAGECOUNT value on done: 1438491.0 [2023-02-25 14:51:48,130][36141] Sum rewards: 54.874, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.160', 'AMMO5': '0.007', 'weapon5': '0.030', 'AMMO2': '0.033', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'weapon2': '0.182', 'AMMO3': '0.193', 'WEAPON4': '0.350', 'weapon4': '0.824', 'WEAPON3': '1.200', 'weapon3': '2.786', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.064', 'FRAGCOUNT': '48.000'} [2023-02-25 14:51:48,213][36155] DAMAGECOUNT value on done: 1429712.0 [2023-02-25 14:51:48,213][36155] Sum rewards: 52.566, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.134', 'AMMO5': '0.012', 'AMMO2': '0.016', 'weapon5': '0.048', 'AMMO4': '0.078', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.252', 'weapon4': '0.316', 'WEAPON3': '1.450', 'HITCOUNT': '2.870', 'weapon3': '3.120', 'DAMAGECOUNT': '14.292', 'FRAGCOUNT': '48.000'} [2023-02-25 14:51:48,433][36141] DAMAGECOUNT value on done: 1439759.0 [2023-02-25 14:51:48,433][36141] Sum rewards: 57.128, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.655', 'ARMOR': '0.008', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.078', 'weapon4': '0.104', 'AMMO4': '0.140', 'WEAPON5': '0.200', 'weapon2': '0.258', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '3.210', 'weapon3': '3.302', 'DAMAGECOUNT': '15.531', 'FRAGCOUNT': '53.000'} [2023-02-25 14:51:48,445][36141] DAMAGECOUNT value on done: 1430483.0 [2023-02-25 14:51:48,446][36141] Sum rewards: 59.129, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.560', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.088', 'weapon4': '0.110', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.500', 'HITCOUNT': '3.220', 'weapon3': '3.272', 'DAMAGECOUNT': '15.915', 'FRAGCOUNT': '53.000'} [2023-02-25 14:51:48,746][36141] DAMAGECOUNT value on done: 1413738.0 [2023-02-25 14:51:48,747][36141] Sum rewards: 60.545, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.458', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO3': '0.136', 'AMMO4': '0.144', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.446', 'weapon2': '0.584', 'WEAPON3': '0.900', 'weapon3': '2.762', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.360', 'FRAGCOUNT': '49.000'} [2023-02-25 14:51:49,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13565.4). Total num frames: 230682624. Throughput: 0: 3391.6. Samples: 20168788. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:51:49,730][36114] Avg episode reward: [(0, '60.611')] [2023-02-25 14:51:50,164][36142] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:51:50,706][36138] Updated weights for policy 0, policy_version 56323 (0.0009) [2023-02-25 14:51:51,014][36157] DAMAGECOUNT value on done: 1448633.0 [2023-02-25 14:51:51,015][36157] Sum rewards: 72.978, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.722', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.036', 'AMMO3': '0.127', 'AMMO4': '0.179', 'weapon5': '0.180', 'weapon2': '0.200', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.546', 'WEAPON3': '0.850', 'weapon3': '2.780', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.201', 'FRAGCOUNT': '59.000'} [2023-02-25 14:51:51,325][36157] DAMAGECOUNT value on done: 1434339.0 [2023-02-25 14:51:51,325][36157] Sum rewards: 59.927, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.490', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon2': '0.174', 'AMMO4': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon5': '0.206', 'WEAPON4': '0.300', 'weapon4': '0.542', 'WEAPON3': '1.200', 'weapon3': '2.810', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.168', 'FRAGCOUNT': '52.000'} [2023-02-25 14:51:51,805][36157] DAMAGECOUNT value on done: 1449345.0 [2023-02-25 14:51:51,805][36157] Sum rewards: 73.159, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.890', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.102', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon4': '0.294', 'weapon2': '0.378', 'WEAPON3': '1.500', 'weapon3': '2.998', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '63.000'} [2023-02-25 14:51:52,119][36157] DAMAGECOUNT value on done: 1437289.0 [2023-02-25 14:51:52,120][36157] Sum rewards: 65.053, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.034', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.088', 'AMMO4': '0.128', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon4': '0.284', 'weapon2': '0.464', 'WEAPON3': '1.250', 'weapon3': '2.922', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.341', 'FRAGCOUNT': '56.000'} [2023-02-25 14:51:52,544][36140] DAMAGECOUNT value on done: 1444191.0 [2023-02-25 14:51:52,545][36140] Sum rewards: 60.639, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.920', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.102', 'AMMO4': '0.127', 'AMMO3': '0.169', 'weapon4': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.460', 'WEAPON3': '1.100', 'weapon3': '3.020', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.397', 'FRAGCOUNT': '52.000'} [2023-02-25 14:51:52,628][36140] DAMAGECOUNT value on done: 1441019.0 [2023-02-25 14:51:52,628][36140] Sum rewards: 55.644, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.184', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.154', 'AMMO3': '0.190', 'weapon4': '0.200', 'AMMO4': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.492', 'WEAPON3': '1.150', 'weapon3': '2.918', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.663', 'FRAGCOUNT': '48.000'} [2023-02-25 14:51:52,865][36140] DAMAGECOUNT value on done: 1424049.0 [2023-02-25 14:51:52,866][36140] Sum rewards: 43.753, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.206', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.102', 'AMMO4': '0.180', 'AMMO3': '0.182', 'weapon2': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'ARMOR': '0.404', 'weapon4': '0.772', 'WEAPON3': '1.100', 'weapon3': '2.392', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '11.772', 'FRAGCOUNT': '39.000'} [2023-02-25 14:51:52,953][36140] DAMAGECOUNT value on done: 1429282.0 [2023-02-25 14:51:52,953][36140] Sum rewards: 61.401, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.614', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.054', 'weapon5': '0.170', 'weapon4': '0.180', 'AMMO3': '0.194', 'AMMO4': '0.271', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.698', 'WEAPON3': '1.200', 'weapon3': '2.660', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '55.000'} [2023-02-25 14:51:53,695][36138] Updated weights for policy 0, policy_version 56333 (0.0010) [2023-02-25 14:51:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 230752256. Throughput: 0: 3397.2. Samples: 20179004. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:51:54,730][36114] Avg episode reward: [(0, '60.689')] [2023-02-25 14:51:54,999][36140] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:51:56,260][36142] DAMAGECOUNT value on done: 1428424.0 [2023-02-25 14:51:56,261][36142] Sum rewards: 46.538, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.175', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.071', 'AMMO3': '0.173', 'weapon2': '0.290', 'AMMO4': '0.357', 'weapon5': '0.408', 'WEAPON5': '0.700', 'WEAPON4': '0.800', 'weapon4': '0.894', 'WEAPON3': '1.000', 'weapon3': '1.894', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '13.038', 'FRAGCOUNT': '44.000'} [2023-02-25 14:51:56,566][36142] DAMAGECOUNT value on done: 1421733.0 [2023-02-25 14:51:56,566][36142] Sum rewards: 58.042, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.990', 'AMMO2': '0.009', 'AMMO4': '0.044', 'AMMO3': '0.244', 'weapon2': '0.598', 'WEAPON3': '1.450', 'HITCOUNT': '3.200', 'weapon3': '3.262', 'DAMAGECOUNT': '14.475', 'FRAGCOUNT': '51.000'} [2023-02-25 14:51:56,708][36138] Updated weights for policy 0, policy_version 56343 (0.0009) [2023-02-25 14:51:57,247][36142] DAMAGECOUNT value on done: 1436027.0 [2023-02-25 14:51:57,247][36142] Sum rewards: 53.430, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.694', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.026', 'weapon5': '0.088', 'WEAPON4': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'weapon2': '0.880', 'WEAPON3': '1.100', 'HITCOUNT': '2.720', 'weapon3': '2.854', 'DAMAGECOUNT': '13.827', 'FRAGCOUNT': '43.500'} [2023-02-25 14:51:57,560][36142] DAMAGECOUNT value on done: 1438763.0 [2023-02-25 14:51:57,561][36142] Sum rewards: 56.082, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.891', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.160', 'weapon2': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.290', 'weapon4': '0.380', 'WEAPON3': '1.050', 'HITCOUNT': '2.810', 'weapon3': '2.866', 'DAMAGECOUNT': '13.545', 'FRAGCOUNT': '48.000'} [2023-02-25 14:51:57,799][36156] DAMAGECOUNT value on done: 1451267.0 [2023-02-25 14:51:57,800][36156] Sum rewards: 56.250, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.406', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'AMMO4': '0.187', 'WEAPON4': '0.250', 'weapon2': '0.266', 'weapon4': '0.680', 'WEAPON3': '0.950', 'weapon3': '2.700', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.355', 'FRAGCOUNT': '46.500'} [2023-02-25 14:51:58,070][36142] Large shaping reward 2.550 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.528, 176.0), ('weapon5', 0.002)] [2023-02-25 14:51:58,099][36156] DAMAGECOUNT value on done: 1426206.0 [2023-02-25 14:51:58,100][36156] Sum rewards: 68.460, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.516', 'ARMOR': '0.009', 'AMMO5': '0.012', 'AMMO2': '0.045', 'AMMO3': '0.167', 'weapon5': '0.202', 'AMMO4': '0.224', 'weapon4': '0.242', 'WEAPON5': '0.350', 'weapon2': '0.364', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '2.890', 'weapon3': '2.896', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '58.000'} [2023-02-25 14:51:58,264][36156] DAMAGECOUNT value on done: 1445122.0 [2023-02-25 14:51:58,264][36156] Sum rewards: 39.423, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.349', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO3': '0.132', 'AMMO4': '0.181', 'weapon5': '0.218', 'weapon2': '0.224', 'WEAPON5': '0.300', 'ARMOR': '0.404', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'weapon4': '0.962', 'weapon3': '1.980', 'HITCOUNT': '2.220', 'DAMAGECOUNT': '9.855', 'FRAGCOUNT': '35.000'} [2023-02-25 14:51:58,559][36156] DAMAGECOUNT value on done: 1430973.0 [2023-02-25 14:51:58,559][36156] Sum rewards: 46.230, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.314', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.146', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'AMMO4': '0.251', 'WEAPON4': '0.450', 'weapon4': '0.518', 'weapon2': '0.646', 'WEAPON3': '1.200', 'weapon3': '2.300', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '13.005', 'FRAGCOUNT': '42.000'} [2023-02-25 14:51:59,707][36138] Updated weights for policy 0, policy_version 56353 (0.0009) [2023-02-25 14:51:59,729][36114] Fps is (10 sec: 13926.4, 60 sec: 13585.0, 300 sec: 13579.3). Total num frames: 230821888. Throughput: 0: 3398.0. Samples: 20199390. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:51:59,730][36114] Avg episode reward: [(0, '60.323')] [2023-02-25 14:52:02,730][36138] Updated weights for policy 0, policy_version 56363 (0.0009) [2023-02-25 14:52:03,239][36156] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:52:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 230887424. Throughput: 0: 3394.3. Samples: 20219798. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:52:04,730][36114] Avg episode reward: [(0, '60.323')] [2023-02-25 14:52:05,751][36138] Updated weights for policy 0, policy_version 56373 (0.0009) [2023-02-25 14:52:06,139][36154] DAMAGECOUNT value on done: 1441107.0 [2023-02-25 14:52:06,139][36154] Sum rewards: 64.068, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.756', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.017', 'weapon5': '0.076', 'weapon4': '0.084', 'AMMO4': '0.084', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.279', 'weapon2': '0.346', 'WEAPON3': '1.700', 'weapon3': '3.238', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '58.000'} [2023-02-25 14:52:06,446][36154] DAMAGECOUNT value on done: 1423259.0 [2023-02-25 14:52:06,447][36154] Sum rewards: 52.457, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.270', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'weapon4': '0.122', 'AMMO3': '0.238', 'weapon2': '0.726', 'WEAPON3': '1.400', 'HITCOUNT': '2.980', 'weapon3': '2.990', 'DAMAGECOUNT': '13.440', 'FRAGCOUNT': '46.000'} [2023-02-25 14:52:06,646][36139] DAMAGECOUNT value on done: 1441949.0 [2023-02-25 14:52:06,646][36139] Sum rewards: 62.052, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.185', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.026', 'AMMO4': '0.126', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.208', 'weapon2': '0.266', 'WEAPON3': '1.100', 'HITCOUNT': '3.120', 'weapon3': '3.340', 'DAMAGECOUNT': '14.454', 'FRAGCOUNT': '53.000'} [2023-02-25 14:52:06,757][36155] DAMAGECOUNT value on done: 1433287.0 [2023-02-25 14:52:06,757][36155] Sum rewards: 72.067, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.776', 'AMMO5': '0.013', 'AMMO2': '0.038', 'AMMO3': '0.179', 'weapon5': '0.180', 'AMMO4': '0.189', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.384', 'weapon4': '0.568', 'WEAPON3': '1.100', 'weapon3': '2.580', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '61.000'} [2023-02-25 14:52:06,784][36154] DAMAGECOUNT value on done: 1456338.0 [2023-02-25 14:52:06,785][36154] Sum rewards: 61.936, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.347', 'AMMO5': '0.010', 'AMMO2': '0.043', 'AMMO3': '0.119', 'weapon2': '0.164', 'WEAPON5': '0.200', 'AMMO4': '0.215', 'weapon5': '0.318', 'WEAPON4': '0.400', 'weapon4': '0.674', 'WEAPON3': '0.800', 'weapon3': '2.564', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '14.535', 'FRAGCOUNT': '51.000'} [2023-02-25 14:52:06,893][36139] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:52:06,955][36139] DAMAGECOUNT value on done: 1437295.0 [2023-02-25 14:52:06,955][36139] Sum rewards: 53.668, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.780', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.072', 'AMMO4': '0.105', 'weapon5': '0.122', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.858', 'WEAPON3': '1.000', 'HITCOUNT': '2.560', 'weapon3': '2.736', 'DAMAGECOUNT': '13.401', 'FRAGCOUNT': '45.000'} [2023-02-25 14:52:07,057][36155] DAMAGECOUNT value on done: 1438384.0 [2023-02-25 14:52:07,057][36155] Sum rewards: 52.855, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.746', 'ARMOR': '0.008', 'AMMO5': '0.008', 'AMMO2': '0.070', 'weapon5': '0.120', 'AMMO3': '0.202', 'WEAPON5': '0.300', 'AMMO4': '0.349', 'weapon2': '0.452', 'weapon4': '0.482', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.676', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.034', 'FRAGCOUNT': '47.000'} [2023-02-25 14:52:07,095][36154] DAMAGECOUNT value on done: 1434912.0 [2023-02-25 14:52:07,095][36154] Sum rewards: 60.392, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.370', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.028', 'weapon5': '0.070', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.298', 'weapon2': '0.432', 'WEAPON3': '1.750', 'weapon3': '3.220', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '55.000'} [2023-02-25 14:52:07,366][36139] DAMAGECOUNT value on done: 1448634.0 [2023-02-25 14:52:07,366][36139] Sum rewards: 55.709, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.791', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.208', 'weapon2': '0.212', 'AMMO3': '0.237', 'weapon5': '0.320', 'WEAPON3': '1.450', 'HITCOUNT': '2.870', 'weapon3': '2.934', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '50.000'} [2023-02-25 14:52:07,663][36139] DAMAGECOUNT value on done: 1447455.0 [2023-02-25 14:52:07,664][36139] Sum rewards: 74.493, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.410', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon4': '0.050', 'weapon5': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.136', 'AMMO3': '0.265', 'WEAPON3': '1.550', 'weapon3': '3.508', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.641', 'FRAGCOUNT': '64.000'} [2023-02-25 14:52:07,670][36155] DAMAGECOUNT value on done: 1453439.0 [2023-02-25 14:52:07,671][36155] Sum rewards: 51.001, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.625', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.051', 'AMMO3': '0.171', 'weapon2': '0.250', 'AMMO4': '0.256', 'weapon5': '0.286', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.776', 'WEAPON3': '1.050', 'weapon3': '2.340', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.947', 'FRAGCOUNT': '45.000'} [2023-02-25 14:52:07,939][36141] DAMAGECOUNT value on done: 1443749.0 [2023-02-25 14:52:07,939][36141] Sum rewards: 68.885, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.840', 'AMMO2': '0.003', 'AMMO4': '0.013', 'WEAPON4': '0.050', 'weapon4': '0.098', 'AMMO3': '0.201', 'weapon2': '0.410', 'WEAPON3': '1.200', 'weapon3': '3.316', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.774', 'FRAGCOUNT': '58.000'} [2023-02-25 14:52:07,975][36155] DAMAGECOUNT value on done: 1435277.0 [2023-02-25 14:52:07,976][36155] Sum rewards: 57.747, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.131', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.191', 'weapon5': '0.226', 'weapon2': '0.296', 'weapon4': '0.316', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.906', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '49.000'} [2023-02-25 14:52:08,172][36141] DAMAGECOUNT value on done: 1435105.0 [2023-02-25 14:52:08,172][36141] Sum rewards: 55.231, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.644', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.052', 'weapon5': '0.092', 'AMMO3': '0.148', 'weapon2': '0.232', 'WEAPON5': '0.250', 'AMMO4': '0.258', 'WEAPON4': '0.600', 'weapon4': '0.750', 'WEAPON3': '0.900', 'weapon3': '2.718', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '13.866', 'FRAGCOUNT': '48.000'} [2023-02-25 14:52:08,245][36141] DAMAGECOUNT value on done: 1445244.0 [2023-02-25 14:52:08,245][36141] Sum rewards: 67.612, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.062', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'weapon4': '0.106', 'AMMO3': '0.155', 'weapon2': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '3.130', 'weapon3': '3.310', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '55.000'} [2023-02-25 14:52:08,484][36141] DAMAGECOUNT value on done: 1418506.0 [2023-02-25 14:52:08,485][36141] Sum rewards: 50.005, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.980', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.064', 'AMMO4': '0.188', 'weapon5': '0.206', 'AMMO3': '0.232', 'weapon2': '0.328', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '2.940', 'weapon3': '3.122', 'DAMAGECOUNT': '14.304', 'FRAGCOUNT': '47.000'} [2023-02-25 14:52:08,798][36138] Updated weights for policy 0, policy_version 56383 (0.0009) [2023-02-25 14:52:09,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13585.0, 300 sec: 13565.4). Total num frames: 230957056. Throughput: 0: 3393.8. Samples: 20230016. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:52:09,730][36114] Avg episode reward: [(0, '60.194')] [2023-02-25 14:52:10,897][36157] DAMAGECOUNT value on done: 1453601.0 [2023-02-25 14:52:10,897][36157] Sum rewards: 54.332, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.592', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.052', 'AMMO3': '0.143', 'weapon5': '0.250', 'AMMO4': '0.258', 'weapon2': '0.274', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '0.850', 'weapon4': '0.918', 'weapon3': '2.280', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.904', 'FRAGCOUNT': '46.000'} [2023-02-25 14:52:11,202][36157] DAMAGECOUNT value on done: 1440219.0 [2023-02-25 14:52:11,203][36157] Sum rewards: 66.165, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.625', 'AMMO5': '0.011', 'AMMO2': '0.037', 'AMMO4': '0.185', 'weapon5': '0.186', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.368', 'weapon4': '0.448', 'WEAPON3': '1.250', 'weapon3': '2.662', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '56.000'} [2023-02-25 14:52:11,656][36157] DAMAGECOUNT value on done: 1455106.0 [2023-02-25 14:52:11,656][36157] Sum rewards: 63.846, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.490', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO3': '0.183', 'weapon4': '0.192', 'weapon2': '0.382', 'WEAPON3': '1.250', 'weapon3': '3.204', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '52.000'} [2023-02-25 14:52:11,793][36138] Updated weights for policy 0, policy_version 56393 (0.0009) [2023-02-25 14:52:11,945][36157] DAMAGECOUNT value on done: 1442833.0 [2023-02-25 14:52:11,945][36157] Sum rewards: 66.775, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.540', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON5': '0.050', 'weapon5': '0.056', 'weapon4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.235', 'weapon2': '0.444', 'WEAPON3': '1.550', 'weapon3': '3.158', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '58.000'} [2023-02-25 14:52:12,291][36140] DAMAGECOUNT value on done: 1448867.0 [2023-02-25 14:52:12,292][36140] Sum rewards: 56.655, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.572', 'AMMO5': '0.015', 'AMMO2': '0.048', 'AMMO3': '0.142', 'AMMO4': '0.242', 'weapon5': '0.258', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.718', 'weapon2': '0.738', 'WEAPON3': '1.000', 'weapon3': '1.938', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '49.000'} [2023-02-25 14:52:12,405][36140] DAMAGECOUNT value on done: 1447404.0 [2023-02-25 14:52:12,406][36140] Sum rewards: 72.107, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.586', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.028', 'weapon4': '0.032', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.218', 'AMMO3': '0.262', 'WEAPON3': '1.500', 'HITCOUNT': '3.480', 'weapon3': '3.504', 'DAMAGECOUNT': '19.155', 'FRAGCOUNT': '61.000'} [2023-02-25 14:52:12,600][36140] DAMAGECOUNT value on done: 1429707.0 [2023-02-25 14:52:12,601][36140] Sum rewards: 66.576, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.705', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon5': '0.056', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'weapon2': '0.138', 'WEAPON4': '0.150', 'weapon4': '0.194', 'AMMO3': '0.218', 'ARMOR': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '3.360', 'weapon3': '3.448', 'DAMAGECOUNT': '16.974', 'FRAGCOUNT': '57.000'} [2023-02-25 14:52:12,717][36140] DAMAGECOUNT value on done: 1434751.0 [2023-02-25 14:52:12,718][36140] Sum rewards: 59.325, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.123', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.030', 'AMMO4': '0.045', 'weapon5': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.214', 'weapon2': '0.234', 'WEAPON3': '1.400', 'HITCOUNT': '3.240', 'weapon3': '3.350', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '50.500'} [2023-02-25 14:52:14,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 231022592. Throughput: 0: 3396.3. Samples: 20250494. Policy #0 lag: (min: 0.0, avg: 0.5, max: 1.0) [2023-02-25 14:52:14,730][36114] Avg episode reward: [(0, '59.876')] [2023-02-25 14:52:14,807][36138] Updated weights for policy 0, policy_version 56403 (0.0010) [2023-02-25 14:52:16,112][36142] DAMAGECOUNT value on done: 1433756.0 [2023-02-25 14:52:16,113][36142] Sum rewards: 59.832, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.320', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon5': '0.098', 'AMMO3': '0.150', 'AMMO4': '0.221', 'WEAPON5': '0.300', 'weapon4': '0.412', 'WEAPON4': '0.500', 'weapon2': '0.708', 'WEAPON3': '0.850', 'weapon3': '2.510', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '49.000'} [2023-02-25 14:52:16,424][36142] DAMAGECOUNT value on done: 1426202.0 [2023-02-25 14:52:16,425][36142] Sum rewards: 53.240, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.386', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon4': '0.158', 'weapon2': '0.186', 'AMMO3': '0.212', 'AMMO4': '0.239', 'weapon5': '0.256', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.510', 'weapon3': '3.094', 'DAMAGECOUNT': '13.407', 'FRAGCOUNT': '49.000'} [2023-02-25 14:52:17,106][36142] DAMAGECOUNT value on done: 1440730.0 [2023-02-25 14:52:17,106][36142] Sum rewards: 52.637, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.743', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO4': '0.185', 'AMMO3': '0.192', 'weapon5': '0.234', 'weapon2': '0.378', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.502', 'WEAPON3': '1.150', 'weapon3': '2.590', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.109', 'FRAGCOUNT': '47.000'} [2023-02-25 14:52:17,415][36142] DAMAGECOUNT value on done: 1444365.0 [2023-02-25 14:52:17,415][36142] Sum rewards: 64.582, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.872', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon4': '0.100', 'weapon5': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.208', 'AMMO3': '0.236', 'WEAPON3': '1.450', 'weapon3': '3.342', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '56.000'} [2023-02-25 14:52:17,541][36156] DAMAGECOUNT value on done: 1456917.0 [2023-02-25 14:52:17,541][36156] Sum rewards: 65.296, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.660', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.046', 'AMMO4': '0.112', 'weapon5': '0.120', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.394', 'WEAPON3': '1.350', 'weapon3': '3.238', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '57.000'} [2023-02-25 14:52:17,826][36138] Updated weights for policy 0, policy_version 56413 (0.0009) [2023-02-25 14:52:17,843][36156] DAMAGECOUNT value on done: 1431600.0 [2023-02-25 14:52:17,843][36156] Sum rewards: 62.299, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.247', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.112', 'AMMO4': '0.137', 'AMMO3': '0.205', 'weapon5': '0.214', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.120', 'weapon3': '3.192', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '53.500'} [2023-02-25 14:52:17,938][36156] DAMAGECOUNT value on done: 1450482.0 [2023-02-25 14:52:17,939][36156] Sum rewards: 65.292, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.877', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.046', 'AMMO4': '0.151', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.376', 'weapon4': '0.388', 'WEAPON3': '1.100', 'weapon3': '3.002', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.930', 'FRAGCOUNT': '55.000'} [2023-02-25 14:52:18,241][36156] DAMAGECOUNT value on done: 1435937.0 [2023-02-25 14:52:18,242][36156] Sum rewards: 60.502, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.807', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.167', 'AMMO3': '0.186', 'weapon5': '0.220', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.438', 'weapon4': '0.660', 'WEAPON3': '1.050', 'weapon3': '2.428', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.892', 'FRAGCOUNT': '52.000'} [2023-02-25 14:52:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 231092224. Throughput: 0: 3394.0. Samples: 20270844. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:52:19,730][36114] Avg episode reward: [(0, '59.776')] [2023-02-25 14:52:20,844][36138] Updated weights for policy 0, policy_version 56423 (0.0009) [2023-02-25 14:52:23,581][36139] Large shaping reward -2.510 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.261, -87.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:52:23,877][36138] Updated weights for policy 0, policy_version 56433 (0.0009) [2023-02-25 14:52:24,729][36114] Fps is (10 sec: 13516.5, 60 sec: 13516.8, 300 sec: 13565.4). Total num frames: 231157760. Throughput: 0: 3396.2. Samples: 20281094. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:52:24,730][36114] Avg episode reward: [(0, '59.776')] [2023-02-25 14:52:25,892][36154] DAMAGECOUNT value on done: 1446356.0 [2023-02-25 14:52:25,893][36154] Sum rewards: 59.349, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.184', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.106', 'AMMO4': '0.148', 'AMMO3': '0.186', 'weapon5': '0.220', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.120', 'weapon3': '3.130', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '51.000'} [2023-02-25 14:52:26,200][36154] DAMAGECOUNT value on done: 1428593.0 [2023-02-25 14:52:26,201][36154] Sum rewards: 65.818, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.759', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.152', 'AMMO3': '0.158', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.340', 'weapon4': '0.734', 'WEAPON3': '0.950', 'weapon3': '2.302', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.002', 'FRAGCOUNT': '54.000'} [2023-02-25 14:52:26,359][36139] DAMAGECOUNT value on done: 1447078.0 [2023-02-25 14:52:26,360][36139] Sum rewards: 57.230, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.935', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.122', 'weapon2': '0.180', 'weapon4': '0.184', 'AMMO4': '0.200', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.960', 'weapon3': '3.204', 'DAMAGECOUNT': '15.387', 'FRAGCOUNT': '50.500'} [2023-02-25 14:52:26,399][36155] DAMAGECOUNT value on done: 1439032.0 [2023-02-25 14:52:26,399][36155] Sum rewards: 61.960, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.918', 'AMMO5': '0.019', 'AMMO2': '0.049', 'AMMO3': '0.196', 'weapon5': '0.196', 'weapon4': '0.230', 'AMMO4': '0.245', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.718', 'WEAPON3': '1.200', 'weapon3': '2.494', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '53.000'} [2023-02-25 14:52:26,484][36140] Large shaping reward 2.563 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.531, 177.0), ('weapon5', 0.002)] [2023-02-25 14:52:26,522][36154] DAMAGECOUNT value on done: 1461004.0 [2023-02-25 14:52:26,523][36154] Sum rewards: 51.745, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.725', 'AMMO5': '0.008', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon4': '0.094', 'WEAPON4': '0.150', 'weapon5': '0.186', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'weapon2': '0.614', 'WEAPON3': '1.250', 'HITCOUNT': '2.750', 'weapon3': '2.898', 'DAMAGECOUNT': '13.998', 'FRAGCOUNT': '44.000'} [2023-02-25 14:52:26,672][36139] DAMAGECOUNT value on done: 1442838.0 [2023-02-25 14:52:26,672][36139] Sum rewards: 65.505, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.250', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.030', 'AMMO4': '0.123', 'weapon5': '0.156', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.564', 'WEAPON3': '1.250', 'weapon3': '3.036', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '54.500'} [2023-02-25 14:52:26,705][36155] DAMAGECOUNT value on done: 1443232.0 [2023-02-25 14:52:26,706][36155] Sum rewards: 59.794, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.696', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.094', 'AMMO4': '0.203', 'AMMO3': '0.209', 'weapon5': '0.218', 'weapon2': '0.328', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.700', 'weapon3': '3.042', 'DAMAGECOUNT': '14.544', 'FRAGCOUNT': '53.000'} [2023-02-25 14:52:26,834][36154] DAMAGECOUNT value on done: 1440307.0 [2023-02-25 14:52:26,834][36154] Sum rewards: 61.777, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.580', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon5': '0.160', 'AMMO3': '0.243', 'WEAPON5': '0.250', 'weapon2': '0.374', 'WEAPON4': '0.400', 'weapon4': '0.572', 'WEAPON3': '1.350', 'weapon3': '2.494', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '55.000'} [2023-02-25 14:52:26,914][36138] Updated weights for policy 0, policy_version 56443 (0.0010) [2023-02-25 14:52:27,072][36139] DAMAGECOUNT value on done: 1453707.0 [2023-02-25 14:52:27,073][36139] Sum rewards: 60.762, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.397', 'AMMO5': '0.009', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.166', 'weapon2': '0.248', 'WEAPON4': '0.250', 'weapon5': '0.256', 'weapon4': '0.258', 'WEAPON5': '0.300', 'WEAPON3': '1.000', 'weapon3': '3.012', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.219', 'FRAGCOUNT': '50.000'} [2023-02-25 14:52:27,322][36155] DAMAGECOUNT value on done: 1458995.0 [2023-02-25 14:52:27,323][36155] Sum rewards: 67.573, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.130', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon5': '0.098', 'AMMO4': '0.116', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.322', 'weapon2': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.814', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '57.000'} [2023-02-25 14:52:27,377][36139] DAMAGECOUNT value on done: 1453341.0 [2023-02-25 14:52:27,377][36139] Sum rewards: 68.070, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.370', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO4': '0.142', 'AMMO3': '0.192', 'weapon2': '0.192', 'weapon5': '0.282', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.788', 'WEAPON3': '1.050', 'weapon3': '2.392', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '56.000'} [2023-02-25 14:52:27,625][36155] DAMAGECOUNT value on done: 1441245.0 [2023-02-25 14:52:27,626][36155] Sum rewards: 76.806, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.850', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.003', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'weapon4': '0.216', 'weapon2': '0.344', 'WEAPON3': '1.250', 'weapon3': '3.214', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '65.000'} [2023-02-25 14:52:27,833][36141] DAMAGECOUNT value on done: 1449184.0 [2023-02-25 14:52:27,833][36141] Sum rewards: 66.964, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.254', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO3': '0.161', 'AMMO4': '0.197', 'weapon5': '0.238', 'WEAPON5': '0.250', 'weapon2': '0.310', 'WEAPON4': '0.450', 'WEAPON3': '0.900', 'weapon4': '1.010', 'weapon3': '2.198', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '56.000'} [2023-02-25 14:52:28,076][36141] DAMAGECOUNT value on done: 1440484.0 [2023-02-25 14:52:28,077][36141] Sum rewards: 67.135, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.852', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'weapon5': '0.092', 'weapon4': '0.102', 'AMMO3': '0.228', 'weapon2': '0.492', 'WEAPON3': '1.400', 'weapon3': '3.180', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.128', 'FRAGCOUNT': '57.000'} [2023-02-25 14:52:28,137][36141] DAMAGECOUNT value on done: 1450916.0 [2023-02-25 14:52:28,137][36141] Sum rewards: 65.112, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.480', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'AMMO3': '0.238', 'weapon2': '0.326', 'weapon4': '0.342', 'WEAPON3': '1.300', 'weapon3': '3.032', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '56.000'} [2023-02-25 14:52:28,388][36141] DAMAGECOUNT value on done: 1424559.0 [2023-02-25 14:52:28,389][36141] Sum rewards: 70.720, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.565', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.150', 'AMMO4': '0.174', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'weapon4': '0.292', 'WEAPON4': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.100', 'weapon3': '2.992', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.159', 'FRAGCOUNT': '59.000'} [2023-02-25 14:52:29,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 231227392. Throughput: 0: 3393.9. Samples: 20301354. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:52:29,729][36114] Avg episode reward: [(0, '60.212')] [2023-02-25 14:52:29,918][36154] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:52:29,940][36138] Updated weights for policy 0, policy_version 56453 (0.0009) [2023-02-25 14:52:30,812][36157] DAMAGECOUNT value on done: 1458342.0 [2023-02-25 14:52:30,813][36157] Sum rewards: 51.179, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.960', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.192', 'weapon5': '0.198', 'weapon4': '0.280', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.900', 'weapon3': '2.942', 'DAMAGECOUNT': '14.223', 'FRAGCOUNT': '45.000'} [2023-02-25 14:52:31,130][36157] DAMAGECOUNT value on done: 1445472.0 [2023-02-25 14:52:31,131][36157] Sum rewards: 58.037, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.210', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon2': '0.214', 'AMMO3': '0.230', 'AMMO4': '0.249', 'weapon5': '0.372', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.506', 'WEAPON3': '1.350', 'weapon3': '2.622', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '52.500'} [2023-02-25 14:52:31,533][36157] DAMAGECOUNT value on done: 1459797.0 [2023-02-25 14:52:31,534][36157] Sum rewards: 50.746, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.230', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.018', 'AMMO4': '0.089', 'weapon5': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.338', 'WEAPON3': '1.500', 'HITCOUNT': '2.990', 'weapon3': '3.202', 'DAMAGECOUNT': '14.073', 'FRAGCOUNT': '46.000'} [2023-02-25 14:52:31,838][36157] DAMAGECOUNT value on done: 1449474.0 [2023-02-25 14:52:31,838][36157] Sum rewards: 80.314, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.705', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.072', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.128', 'AMMO3': '0.214', 'weapon2': '0.246', 'WEAPON3': '1.300', 'weapon3': '3.344', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.803', 'FRAGCOUNT': '67.000'} [2023-02-25 14:52:32,151][36140] DAMAGECOUNT value on done: 1454918.0 [2023-02-25 14:52:32,152][36140] Sum rewards: 64.796, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.229', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.246', 'weapon5': '0.278', 'weapon2': '0.390', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.494', 'WEAPON3': '1.550', 'weapon3': '2.486', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '57.000'} [2023-02-25 14:52:32,280][36140] DAMAGECOUNT value on done: 1452073.0 [2023-02-25 14:52:32,281][36140] Sum rewards: 57.457, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.442', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.171', 'weapon5': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.554', 'weapon4': '0.886', 'WEAPON3': '0.950', 'weapon3': '1.984', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.007', 'FRAGCOUNT': '49.000'} [2023-02-25 14:52:32,473][36140] DAMAGECOUNT value on done: 1435432.0 [2023-02-25 14:52:32,474][36140] Sum rewards: 68.692, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.558', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.051', 'AMMO3': '0.156', 'weapon5': '0.180', 'weapon2': '0.242', 'AMMO4': '0.257', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.518', 'WEAPON3': '0.950', 'weapon3': '2.752', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '57.500'} [2023-02-25 14:52:32,605][36140] DAMAGECOUNT value on done: 1439721.0 [2023-02-25 14:52:32,606][36140] Sum rewards: 56.040, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.245', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon5': '0.164', 'AMMO3': '0.197', 'AMMO4': '0.248', 'weapon2': '0.270', 'weapon4': '0.280', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '2.960', 'weapon3': '2.994', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '51.000'} [2023-02-25 14:52:32,969][36138] Updated weights for policy 0, policy_version 56463 (0.0009) [2023-02-25 14:52:34,729][36114] Fps is (10 sec: 13517.1, 60 sec: 13516.8, 300 sec: 13551.5). Total num frames: 231292928. Throughput: 0: 3397.5. Samples: 20321674. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:52:34,729][36114] Avg episode reward: [(0, '60.385')] [2023-02-25 14:52:35,924][36142] DAMAGECOUNT value on done: 1439222.0 [2023-02-25 14:52:35,925][36142] Sum rewards: 60.515, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.355', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.102', 'weapon4': '0.172', 'weapon5': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.276', 'WEAPON3': '1.350', 'weapon3': '3.150', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '51.500'} [2023-02-25 14:52:35,943][36138] Updated weights for policy 0, policy_version 56473 (0.0009) [2023-02-25 14:52:36,239][36142] DAMAGECOUNT value on done: 1432311.0 [2023-02-25 14:52:36,240][36142] Sum rewards: 67.778, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.382', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.044', 'AMMO3': '0.185', 'AMMO4': '0.221', 'weapon5': '0.264', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON4': '0.500', 'weapon4': '0.720', 'WEAPON3': '1.200', 'weapon3': '2.436', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.327', 'FRAGCOUNT': '56.500'} [2023-02-25 14:52:36,907][36142] DAMAGECOUNT value on done: 1446615.0 [2023-02-25 14:52:36,908][36142] Sum rewards: 66.986, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.115', 'AMMO5': '0.015', 'AMMO2': '0.054', 'AMMO3': '0.180', 'AMMO4': '0.272', 'weapon2': '0.300', 'weapon5': '0.346', 'weapon4': '0.426', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.596', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '56.000'} [2023-02-25 14:52:37,212][36142] DAMAGECOUNT value on done: 1449334.0 [2023-02-25 14:52:37,212][36142] Sum rewards: 51.298, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.590', 'AMMO5': '0.015', 'AMMO2': '0.044', 'AMMO4': '0.218', 'weapon5': '0.218', 'weapon4': '0.224', 'AMMO3': '0.246', 'weapon2': '0.280', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.740', 'weapon3': '2.996', 'DAMAGECOUNT': '14.907', 'FRAGCOUNT': '47.000'} [2023-02-25 14:52:37,410][36156] DAMAGECOUNT value on done: 1462160.0 [2023-02-25 14:52:37,411][36156] Sum rewards: 64.807, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.667', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon2': '0.158', 'weapon5': '0.172', 'AMMO3': '0.191', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.644', 'WEAPON3': '1.150', 'weapon3': '2.738', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.729', 'FRAGCOUNT': '56.000'} [2023-02-25 14:52:37,721][36156] DAMAGECOUNT value on done: 1437135.0 [2023-02-25 14:52:37,722][36156] Sum rewards: 61.554, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.430', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.148', 'AMMO4': '0.179', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON4': '0.350', 'weapon4': '0.510', 'WEAPON3': '1.300', 'weapon3': '2.822', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.437', 'FRAGCOUNT': '53.000'} [2023-02-25 14:52:37,803][36156] DAMAGECOUNT value on done: 1455520.0 [2023-02-25 14:52:37,803][36156] Sum rewards: 57.629, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.874', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.098', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'WEAPON4': '0.350', 'weapon4': '0.444', 'weapon2': '0.632', 'WEAPON3': '1.100', 'weapon3': '2.616', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.114', 'FRAGCOUNT': '50.000'} [2023-02-25 14:52:38,110][36156] DAMAGECOUNT value on done: 1440981.0 [2023-02-25 14:52:38,110][36156] Sum rewards: 56.200, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.016', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon2': '0.198', 'weapon5': '0.214', 'AMMO3': '0.219', 'AMMO4': '0.242', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.678', 'WEAPON3': '1.300', 'weapon3': '2.604', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.132', 'FRAGCOUNT': '49.000'} [2023-02-25 14:52:38,989][36138] Updated weights for policy 0, policy_version 56483 (0.0009) [2023-02-25 14:52:39,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 231362560. Throughput: 0: 3396.4. Samples: 20331844. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:52:39,730][36114] Avg episode reward: [(0, '60.520')] [2023-02-25 14:52:42,014][36138] Updated weights for policy 0, policy_version 56493 (0.0009) [2023-02-25 14:52:44,729][36114] Fps is (10 sec: 13926.3, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 231432192. Throughput: 0: 3397.2. Samples: 20352262. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:52:44,730][36114] Avg episode reward: [(0, '60.520')] [2023-02-25 14:52:44,990][36138] Updated weights for policy 0, policy_version 56503 (0.0008) [2023-02-25 14:52:45,676][36154] DAMAGECOUNT value on done: 1450611.0 [2023-02-25 14:52:45,676][36154] Sum rewards: 50.377, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.514', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon4': '0.122', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.296', 'weapon2': '0.804', 'WEAPON3': '1.100', 'weapon3': '2.548', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.765', 'FRAGCOUNT': '45.000'} [2023-02-25 14:52:45,985][36154] DAMAGECOUNT value on done: 1433256.0 [2023-02-25 14:52:45,986][36154] Sum rewards: 51.228, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.110', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.130', 'AMMO3': '0.187', 'AMMO4': '0.226', 'WEAPON5': '0.300', 'weapon4': '0.324', 'WEAPON4': '0.450', 'weapon2': '0.752', 'WEAPON3': '1.150', 'weapon3': '2.594', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '13.989', 'FRAGCOUNT': '44.500'} [2023-02-25 14:52:46,219][36155] DAMAGECOUNT value on done: 1444272.0 [2023-02-25 14:52:46,219][36155] Sum rewards: 55.568, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.922', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon5': '0.166', 'weapon2': '0.178', 'AMMO3': '0.236', 'AMMO4': '0.250', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.480', 'WEAPON3': '1.350', 'weapon3': '2.880', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '49.500'} [2023-02-25 14:52:46,224][36139] DAMAGECOUNT value on done: 1451834.0 [2023-02-25 14:52:46,225][36139] Sum rewards: 47.095, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.355', 'AMMO5': '0.020', 'AMMO2': '0.040', 'weapon2': '0.186', 'weapon5': '0.200', 'AMMO4': '0.202', 'AMMO3': '0.215', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.634', 'WEAPON3': '1.250', 'weapon3': '2.684', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '14.268', 'FRAGCOUNT': '42.500'} [2023-02-25 14:52:46,275][36154] DAMAGECOUNT value on done: 1466881.0 [2023-02-25 14:52:46,276][36154] Sum rewards: 71.732, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.190', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon5': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.106', 'weapon2': '0.200', 'AMMO3': '0.293', 'WEAPON3': '1.750', 'weapon3': '3.352', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '64.000'} [2023-02-25 14:52:46,510][36155] DAMAGECOUNT value on done: 1447615.0 [2023-02-25 14:52:46,510][36155] Sum rewards: 52.990, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.200', 'AMMO2': '0.005', 'AMMO4': '0.023', 'WEAPON4': '0.150', 'AMMO3': '0.231', 'weapon2': '0.276', 'weapon4': '0.320', 'WEAPON3': '1.450', 'HITCOUNT': '2.880', 'weapon3': '3.206', 'DAMAGECOUNT': '13.149', 'FRAGCOUNT': '47.000'} [2023-02-25 14:52:46,541][36139] DAMAGECOUNT value on done: 1448093.0 [2023-02-25 14:52:46,542][36139] Sum rewards: 62.865, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.596', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.174', 'AMMO3': '0.179', 'WEAPON5': '0.250', 'weapon5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.452', 'weapon4': '0.888', 'WEAPON3': '1.000', 'weapon3': '2.070', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.765', 'FRAGCOUNT': '53.000'} [2023-02-25 14:52:46,585][36154] DAMAGECOUNT value on done: 1445696.0 [2023-02-25 14:52:46,585][36154] Sum rewards: 63.088, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.616', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.157', 'AMMO3': '0.179', 'weapon5': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.258', 'WEAPON4': '0.300', 'weapon4': '0.440', 'WEAPON3': '1.150', 'weapon3': '2.822', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '54.500'} [2023-02-25 14:52:46,696][36154] Large shaping reward -2.522 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.273, -91.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:52:46,851][36139] DAMAGECOUNT value on done: 1459267.0 [2023-02-25 14:52:46,851][36139] Sum rewards: 63.105, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.005', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.154', 'AMMO4': '0.198', 'AMMO3': '0.226', 'weapon4': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.524', 'WEAPON3': '1.350', 'weapon3': '2.766', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '55.000'} [2023-02-25 14:52:47,111][36155] DAMAGECOUNT value on done: 1464278.0 [2023-02-25 14:52:47,111][36155] Sum rewards: 65.716, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.754', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.060', 'AMMO3': '0.130', 'WEAPON5': '0.150', 'AMMO4': '0.181', 'WEAPON4': '0.350', 'weapon2': '0.612', 'WEAPON3': '0.750', 'weapon4': '0.952', 'weapon3': '2.128', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.129', 'FRAGCOUNT': '53.000'} [2023-02-25 14:52:47,154][36139] DAMAGECOUNT value on done: 1458652.0 [2023-02-25 14:52:47,154][36139] Sum rewards: 65.178, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.016', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.031', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'weapon5': '0.174', 'weapon2': '0.236', 'weapon4': '0.434', 'WEAPON3': '1.000', 'weapon3': '2.774', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.933', 'FRAGCOUNT': '53.000'} [2023-02-25 14:52:47,408][36155] DAMAGECOUNT value on done: 1446482.0 [2023-02-25 14:52:47,409][36155] Sum rewards: 61.031, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.790', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.054', 'AMMO4': '0.117', 'weapon5': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.276', 'AMMO3': '0.284', 'WEAPON3': '1.650', 'HITCOUNT': '3.080', 'weapon3': '3.192', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '56.000'} [2023-02-25 14:52:47,679][36141] DAMAGECOUNT value on done: 1454882.0 [2023-02-25 14:52:47,680][36141] Sum rewards: 66.228, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.744', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.066', 'AMMO4': '0.100', 'weapon5': '0.146', 'weapon2': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.261', 'WEAPON3': '1.550', 'HITCOUNT': '3.320', 'weapon3': '3.342', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '59.000'} [2023-02-25 14:52:47,944][36141] DAMAGECOUNT value on done: 1444828.0 [2023-02-25 14:52:47,944][36141] Sum rewards: 45.773, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-3.099', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.210', 'AMMO4': '0.213', 'AMMO3': '0.314', 'weapon4': '0.448', 'WEAPON4': '0.450', 'WEAPON3': '1.750', 'HITCOUNT': '2.690', 'weapon3': '2.824', 'DAMAGECOUNT': '13.032', 'FRAGCOUNT': '47.500'} [2023-02-25 14:52:48,004][36141] DAMAGECOUNT value on done: 1455693.0 [2023-02-25 14:52:48,004][36141] Sum rewards: 54.266, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.377', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.092', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'WEAPON4': '0.250', 'weapon4': '0.300', 'weapon2': '0.582', 'WEAPON3': '1.000', 'weapon3': '2.824', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.331', 'FRAGCOUNT': '45.000'} [2023-02-25 14:52:48,013][36138] Updated weights for policy 0, policy_version 56513 (0.0009) [2023-02-25 14:52:48,248][36141] DAMAGECOUNT value on done: 1430031.0 [2023-02-25 14:52:48,248][36141] Sum rewards: 64.872, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.200', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.100', 'AMMO3': '0.184', 'weapon4': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.218', 'WEAPON3': '1.200', 'HITCOUNT': '3.220', 'weapon3': '3.278', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '53.000'} [2023-02-25 14:52:49,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 231497728. Throughput: 0: 3396.6. Samples: 20372646. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 14:52:49,729][36114] Avg episode reward: [(0, '60.375')] [2023-02-25 14:52:50,567][36157] DAMAGECOUNT value on done: 1464244.0 [2023-02-25 14:52:50,568][36157] Sum rewards: 69.801, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.650', 'AMMO5': '0.019', 'AMMO2': '0.061', 'AMMO3': '0.155', 'weapon2': '0.188', 'AMMO4': '0.303', 'weapon5': '0.312', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon4': '0.786', 'WEAPON3': '0.950', 'weapon3': '2.390', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '59.000'} [2023-02-25 14:52:50,875][36157] DAMAGECOUNT value on done: 1450716.0 [2023-02-25 14:52:50,875][36157] Sum rewards: 61.792, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.852', 'AMMO5': '0.015', 'AMMO2': '0.049', 'AMMO3': '0.125', 'AMMO4': '0.247', 'WEAPON5': '0.350', 'weapon5': '0.380', 'WEAPON4': '0.450', 'weapon4': '0.486', 'weapon2': '0.510', 'WEAPON3': '0.800', 'weapon3': '2.304', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '15.417', 'FRAGCOUNT': '50.000'} [2023-02-25 14:52:51,017][36138] Updated weights for policy 0, policy_version 56523 (0.0009) [2023-02-25 14:52:51,262][36157] DAMAGECOUNT value on done: 1463796.0 [2023-02-25 14:52:51,262][36157] Sum rewards: 42.912, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.676', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.034', 'AMMO3': '0.156', 'AMMO4': '0.170', 'weapon2': '0.236', 'weapon5': '0.372', 'WEAPON4': '0.500', 'weapon4': '0.544', 'WEAPON5': '0.550', 'WEAPON3': '0.950', 'weapon3': '2.318', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '11.997', 'FRAGCOUNT': '38.000'} [2023-02-25 14:52:51,574][36157] DAMAGECOUNT value on done: 1455426.0 [2023-02-25 14:52:51,575][36157] Sum rewards: 71.100, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.400', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.138', 'AMMO4': '0.190', 'AMMO3': '0.213', 'weapon2': '0.236', 'WEAPON5': '0.300', 'weapon4': '0.344', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.052', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '61.000'} [2023-02-25 14:52:51,997][36140] DAMAGECOUNT value on done: 1460024.0 [2023-02-25 14:52:51,998][36140] Sum rewards: 60.817, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.550', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.122', 'AMMO3': '0.140', 'weapon5': '0.190', 'weapon4': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.514', 'WEAPON3': '0.850', 'weapon3': '2.906', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.318', 'FRAGCOUNT': '51.000'} [2023-02-25 14:52:52,127][36140] DAMAGECOUNT value on done: 1458552.0 [2023-02-25 14:52:52,128][36140] Sum rewards: 75.797, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.885', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon5': '0.050', 'AMMO4': '0.113', 'weapon2': '0.186', 'WEAPON5': '0.200', 'weapon4': '0.210', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.392', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '64.000'} [2023-02-25 14:52:52,329][36140] DAMAGECOUNT value on done: 1440773.0 [2023-02-25 14:52:52,330][36140] Sum rewards: 54.544, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.195', 'AMMO5': '0.018', 'AMMO2': '0.050', 'AMMO3': '0.226', 'weapon5': '0.228', 'AMMO4': '0.250', 'weapon4': '0.294', 'weapon2': '0.342', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.818', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.023', 'FRAGCOUNT': '50.000'} [2023-02-25 14:52:52,451][36140] DAMAGECOUNT value on done: 1445916.0 [2023-02-25 14:52:52,451][36140] Sum rewards: 70.273, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.730', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon2': '0.146', 'AMMO4': '0.172', 'AMMO3': '0.181', 'weapon5': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.390', 'WEAPON3': '1.250', 'weapon3': '2.996', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '59.000'} [2023-02-25 14:52:54,105][36138] Updated weights for policy 0, policy_version 56533 (0.0009) [2023-02-25 14:52:54,729][36114] Fps is (10 sec: 13516.6, 60 sec: 13585.0, 300 sec: 13565.4). Total num frames: 231567360. Throughput: 0: 3394.5. Samples: 20382768. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:52:54,730][36114] Avg episode reward: [(0, '60.440')] [2023-02-25 14:52:55,778][36142] DAMAGECOUNT value on done: 1443650.0 [2023-02-25 14:52:55,778][36142] Sum rewards: 44.091, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.558', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon5': '0.188', 'AMMO4': '0.198', 'AMMO3': '0.219', 'weapon2': '0.228', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.474', 'WEAPON3': '1.250', 'HITCOUNT': '2.690', 'weapon3': '2.810', 'DAMAGECOUNT': '13.284', 'FRAGCOUNT': '40.000'} [2023-02-25 14:52:56,083][36142] DAMAGECOUNT value on done: 1437197.0 [2023-02-25 14:52:56,083][36142] Sum rewards: 53.658, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.490', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.054', 'AMMO4': '0.072', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'weapon4': '0.384', 'weapon2': '0.658', 'WEAPON3': '1.150', 'weapon3': '2.582', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.658', 'FRAGCOUNT': '45.000'} [2023-02-25 14:52:56,731][36142] DAMAGECOUNT value on done: 1451441.0 [2023-02-25 14:52:56,732][36142] Sum rewards: 56.567, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.767', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.048', 'AMMO4': '0.072', 'weapon4': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.340', 'WEAPON3': '1.200', 'HITCOUNT': '3.000', 'weapon3': '3.342', 'DAMAGECOUNT': '14.478', 'FRAGCOUNT': '48.000'} [2023-02-25 14:52:57,040][36142] DAMAGECOUNT value on done: 1454877.0 [2023-02-25 14:52:57,040][36142] Sum rewards: 68.622, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.526', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.155', 'weapon5': '0.198', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.294', 'WEAPON3': '1.000', 'weapon3': '2.984', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '56.000'} [2023-02-25 14:52:57,126][36138] Updated weights for policy 0, policy_version 56543 (0.0009) [2023-02-25 14:52:57,299][36156] DAMAGECOUNT value on done: 1467806.0 [2023-02-25 14:52:57,299][36156] Sum rewards: 69.223, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.235', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon5': '0.074', 'weapon4': '0.080', 'AMMO4': '0.090', 'weapon2': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'WEAPON3': '1.300', 'HITCOUNT': '3.150', 'weapon3': '3.550', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '59.000'} [2023-02-25 14:52:57,612][36156] DAMAGECOUNT value on done: 1442508.0 [2023-02-25 14:52:57,612][36156] Sum rewards: 68.393, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.000', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.078', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon2': '0.368', 'weapon4': '0.544', 'WEAPON3': '1.200', 'weapon3': '2.798', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.119', 'FRAGCOUNT': '57.000'} [2023-02-25 14:52:57,663][36156] DAMAGECOUNT value on done: 1460780.0 [2023-02-25 14:52:57,663][36156] Sum rewards: 67.978, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.420', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.126', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'weapon2': '0.218', 'WEAPON4': '0.300', 'weapon4': '0.494', 'WEAPON3': '1.200', 'weapon3': '2.988', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.780', 'FRAGCOUNT': '59.000'} [2023-02-25 14:52:57,970][36156] DAMAGECOUNT value on done: 1446746.0 [2023-02-25 14:52:57,971][36156] Sum rewards: 61.368, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.769', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.152', 'AMMO3': '0.172', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.548', 'weapon4': '0.784', 'WEAPON3': '1.100', 'weapon3': '2.296', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '50.000'} [2023-02-25 14:52:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13565.4). Total num frames: 231632896. Throughput: 0: 3387.5. Samples: 20402932. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:52:59,729][36114] Avg episode reward: [(0, '60.984')] [2023-02-25 14:53:00,160][36138] Updated weights for policy 0, policy_version 56553 (0.0009) [2023-02-25 14:53:03,175][36138] Updated weights for policy 0, policy_version 56563 (0.0009) [2023-02-25 14:53:04,729][36114] Fps is (10 sec: 13517.0, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 231702528. Throughput: 0: 3388.9. Samples: 20423346. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:53:04,730][36114] Avg episode reward: [(0, '60.984')] [2023-02-25 14:53:05,545][36154] DAMAGECOUNT value on done: 1454790.0 [2023-02-25 14:53:05,545][36154] Sum rewards: 43.907, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.190', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.052', 'AMMO3': '0.203', 'weapon2': '0.216', 'weapon5': '0.250', 'AMMO4': '0.262', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.830', 'WEAPON3': '1.100', 'HITCOUNT': '2.340', 'weapon3': '2.428', 'DAMAGECOUNT': '12.537', 'FRAGCOUNT': '40.500'} [2023-02-25 14:53:05,853][36154] DAMAGECOUNT value on done: 1437839.0 [2023-02-25 14:53:05,853][36154] Sum rewards: 48.837, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.410', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.144', 'AMMO4': '0.165', 'weapon2': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.258', 'AMMO3': '0.287', 'WEAPON3': '1.650', 'HITCOUNT': '2.380', 'weapon3': '3.122', 'DAMAGECOUNT': '13.749', 'FRAGCOUNT': '47.000'} [2023-02-25 14:53:06,045][36139] DAMAGECOUNT value on done: 1456388.0 [2023-02-25 14:53:06,046][36139] Sum rewards: 52.306, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.565', 'AMMO2': '0.009', 'AMMO5': '0.009', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'weapon4': '0.124', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon5': '0.342', 'weapon2': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.860', 'weapon3': '2.906', 'DAMAGECOUNT': '13.662', 'FRAGCOUNT': '44.500'} [2023-02-25 14:53:06,114][36155] DAMAGECOUNT value on done: 1449840.0 [2023-02-25 14:53:06,114][36155] Sum rewards: 70.590, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.055', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.116', 'weapon4': '0.122', 'AMMO3': '0.152', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.666', 'WEAPON3': '0.950', 'weapon3': '2.908', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.704', 'FRAGCOUNT': '58.000'} [2023-02-25 14:53:06,165][36154] DAMAGECOUNT value on done: 1471808.0 [2023-02-25 14:53:06,165][36154] Sum rewards: 50.748, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.096', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.108', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon4': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.534', 'WEAPON3': '1.400', 'weapon3': '2.902', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.781', 'FRAGCOUNT': '45.000'} [2023-02-25 14:53:06,198][36138] Updated weights for policy 0, policy_version 56573 (0.0009) [2023-02-25 14:53:06,355][36139] DAMAGECOUNT value on done: 1453343.0 [2023-02-25 14:53:06,355][36139] Sum rewards: 54.922, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.362', 'ARMOR': '0.008', 'AMMO5': '0.031', 'AMMO2': '0.069', 'AMMO3': '0.117', 'AMMO4': '0.345', 'weapon5': '0.452', 'weapon2': '0.556', 'weapon4': '0.604', 'WEAPON3': '0.750', 'WEAPON4': '0.850', 'WEAPON5': '0.850', 'weapon3': '1.972', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.750', 'FRAGCOUNT': '47.000'} [2023-02-25 14:53:06,421][36155] DAMAGECOUNT value on done: 1452854.0 [2023-02-25 14:53:06,421][36155] Sum rewards: 62.465, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.680', 'AMMO5': '0.009', 'AMMO2': '0.051', 'weapon5': '0.132', 'weapon4': '0.192', 'AMMO3': '0.201', 'WEAPON5': '0.250', 'AMMO4': '0.257', 'WEAPON4': '0.450', 'weapon2': '0.464', 'WEAPON3': '1.250', 'weapon3': '2.972', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '55.000'} [2023-02-25 14:53:06,457][36154] DAMAGECOUNT value on done: 1450270.0 [2023-02-25 14:53:06,458][36154] Sum rewards: 53.582, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.320', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon5': '0.068', 'AMMO4': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.248', 'WEAPON4': '0.350', 'weapon4': '0.414', 'WEAPON3': '1.250', 'HITCOUNT': '2.930', 'weapon3': '3.030', 'DAMAGECOUNT': '13.722', 'FRAGCOUNT': '48.000'} [2023-02-25 14:53:06,661][36139] DAMAGECOUNT value on done: 1464351.0 [2023-02-25 14:53:06,662][36139] Sum rewards: 57.579, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.724', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'weapon2': '0.162', 'weapon5': '0.192', 'weapon4': '0.210', 'AMMO3': '0.257', 'WEAPON3': '1.400', 'HITCOUNT': '3.140', 'weapon3': '3.222', 'DAMAGECOUNT': '15.252', 'FRAGCOUNT': '50.000'} [2023-02-25 14:53:06,963][36139] DAMAGECOUNT value on done: 1464015.0 [2023-02-25 14:53:06,963][36139] Sum rewards: 67.379, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.844', 'ARMOR': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon2': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'weapon4': '0.782', 'WEAPON3': '1.050', 'weapon3': '2.898', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.089', 'FRAGCOUNT': '56.000'} [2023-02-25 14:53:07,001][36155] DAMAGECOUNT value on done: 1468760.0 [2023-02-25 14:53:07,001][36155] Sum rewards: 53.538, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.605', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.166', 'AMMO3': '0.196', 'weapon4': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.320', 'weapon5': '0.346', 'WEAPON3': '1.150', 'HITCOUNT': '2.640', 'weapon3': '2.888', 'DAMAGECOUNT': '13.446', 'FRAGCOUNT': '46.500'} [2023-02-25 14:53:07,303][36155] DAMAGECOUNT value on done: 1451497.0 [2023-02-25 14:53:07,304][36155] Sum rewards: 64.097, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.858', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO3': '0.257', 'weapon2': '0.268', 'WEAPON3': '1.600', 'HITCOUNT': '3.230', 'weapon3': '3.566', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '58.000'} [2023-02-25 14:53:07,445][36141] DAMAGECOUNT value on done: 1459273.0 [2023-02-25 14:53:07,446][36141] Sum rewards: 47.796, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.314', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon5': '0.058', 'weapon4': '0.188', 'AMMO3': '0.224', 'AMMO4': '0.257', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'HITCOUNT': '2.680', 'weapon3': '3.204', 'DAMAGECOUNT': '13.173', 'FRAGCOUNT': '46.000'} [2023-02-25 14:53:07,709][36141] DAMAGECOUNT value on done: 1449272.0 [2023-02-25 14:53:07,710][36141] Sum rewards: 51.203, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.424', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon4': '0.104', 'weapon2': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.188', 'AMMO3': '0.293', 'WEAPON3': '1.700', 'HITCOUNT': '2.640', 'weapon3': '3.348', 'DAMAGECOUNT': '13.332', 'FRAGCOUNT': '49.000'} [2023-02-25 14:53:07,756][36141] DAMAGECOUNT value on done: 1461066.0 [2023-02-25 14:53:07,756][36141] Sum rewards: 61.969, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.408', 'AMMO5': '0.012', 'AMMO2': '0.059', 'AMMO3': '0.172', 'weapon5': '0.234', 'weapon4': '0.276', 'AMMO4': '0.295', 'weapon2': '0.332', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.918', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '16.119', 'FRAGCOUNT': '54.000'} [2023-02-25 14:53:07,795][36141] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('ARMOR', -0.001, -1.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:53:08,022][36141] DAMAGECOUNT value on done: 1435132.0 [2023-02-25 14:53:08,022][36141] Sum rewards: 62.623, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.370', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.126', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.590', 'weapon2': '0.638', 'WEAPON3': '0.900', 'weapon3': '2.512', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.303', 'FRAGCOUNT': '50.000'} [2023-02-25 14:53:08,117][36156] Large shaping reward -2.503 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('weapon5', 0.002)] [2023-02-25 14:53:08,798][36141] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:53:09,192][36138] Updated weights for policy 0, policy_version 56583 (0.0009) [2023-02-25 14:53:09,730][36114] Fps is (10 sec: 13516.3, 60 sec: 13516.7, 300 sec: 13565.4). Total num frames: 231768064. Throughput: 0: 3387.1. Samples: 20433514. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:53:09,730][36114] Avg episode reward: [(0, '60.620')] [2023-02-25 14:53:10,431][36157] DAMAGECOUNT value on done: 1469637.0 [2023-02-25 14:53:10,432][36157] Sum rewards: 52.253, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.192', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.035', 'AMMO4': '0.177', 'weapon2': '0.238', 'AMMO3': '0.283', 'weapon5': '0.320', 'weapon4': '0.330', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.758', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '49.000'} [2023-02-25 14:53:10,744][36157] DAMAGECOUNT value on done: 1456224.0 [2023-02-25 14:53:10,744][36157] Sum rewards: 65.601, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.550', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.028', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'AMMO3': '0.284', 'weapon2': '0.302', 'WEAPON3': '1.650', 'HITCOUNT': '3.260', 'weapon3': '3.436', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '59.000'} [2023-02-25 14:53:11,132][36157] DAMAGECOUNT value on done: 1468738.0 [2023-02-25 14:53:11,133][36157] Sum rewards: 56.774, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.934', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.098', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon4': '0.248', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.950', 'weapon3': '3.190', 'DAMAGECOUNT': '14.826', 'FRAGCOUNT': '48.500'} [2023-02-25 14:53:11,178][36141] Large shaping reward 2.574 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.552, 184.0), ('weapon5', 0.002)] [2023-02-25 14:53:11,449][36157] DAMAGECOUNT value on done: 1460753.0 [2023-02-25 14:53:11,450][36157] Sum rewards: 63.306, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.732', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.027', 'weapon5': '0.048', 'WEAPON5': '0.100', 'weapon4': '0.122', 'AMMO4': '0.133', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'weapon2': '0.518', 'WEAPON3': '1.050', 'weapon3': '3.122', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.981', 'FRAGCOUNT': '52.000'} [2023-02-25 14:53:11,922][36140] DAMAGECOUNT value on done: 1465085.0 [2023-02-25 14:53:11,922][36140] Sum rewards: 55.591, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.330', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.134', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon5': '0.232', 'weapon2': '0.264', 'WEAPON4': '0.300', 'weapon4': '0.460', 'WEAPON3': '1.300', 'weapon3': '2.782', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.658', 'FRAGCOUNT': '50.000'} [2023-02-25 14:53:12,008][36140] DAMAGECOUNT value on done: 1464058.0 [2023-02-25 14:53:12,008][36140] Sum rewards: 68.110, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.497', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon4': '0.092', 'AMMO3': '0.128', 'WEAPON5': '0.150', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON3': '0.850', 'weapon2': '0.898', 'weapon3': '2.744', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '55.000'} [2023-02-25 14:53:12,158][36138] Updated weights for policy 0, policy_version 56593 (0.0009) [2023-02-25 14:53:12,223][36140] DAMAGECOUNT value on done: 1445235.0 [2023-02-25 14:53:12,223][36140] Sum rewards: 51.480, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.528', 'ARMOR': '0.004', 'AMMO5': '0.009', 'weapon5': '0.016', 'AMMO2': '0.026', 'AMMO4': '0.127', 'weapon2': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'WEAPON4': '0.400', 'weapon4': '0.604', 'WEAPON3': '1.450', 'HITCOUNT': '2.860', 'weapon3': '3.018', 'DAMAGECOUNT': '13.386', 'FRAGCOUNT': '49.000'} [2023-02-25 14:53:12,313][36140] DAMAGECOUNT value on done: 1450631.0 [2023-02-25 14:53:12,314][36140] Sum rewards: 52.866, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.134', 'AMMO5': '0.014', 'AMMO2': '0.036', 'AMMO4': '0.178', 'weapon5': '0.204', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'weapon2': '0.390', 'WEAPON4': '0.400', 'weapon4': '0.750', 'WEAPON3': '1.300', 'weapon3': '2.368', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.145', 'FRAGCOUNT': '48.000'} [2023-02-25 14:53:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 231837696. Throughput: 0: 3390.3. Samples: 20453918. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:53:14,729][36114] Avg episode reward: [(0, '60.463')] [2023-02-25 14:53:15,182][36138] Updated weights for policy 0, policy_version 56603 (0.0009) [2023-02-25 14:53:15,577][36142] DAMAGECOUNT value on done: 1448601.0 [2023-02-25 14:53:15,577][36142] Sum rewards: 58.755, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.196', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.082', 'weapon4': '0.130', 'AMMO4': '0.164', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.200', 'weapon3': '3.284', 'DAMAGECOUNT': '14.853', 'FRAGCOUNT': '52.000'} [2023-02-25 14:53:15,887][36142] DAMAGECOUNT value on done: 1442205.0 [2023-02-25 14:53:15,887][36142] Sum rewards: 59.771, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.418', 'weapon5': '0.002', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'weapon4': '0.172', 'AMMO3': '0.212', 'weapon2': '0.302', 'WEAPON3': '1.300', 'HITCOUNT': '3.110', 'weapon3': '3.340', 'DAMAGECOUNT': '15.024', 'FRAGCOUNT': '51.000'} [2023-02-25 14:53:16,574][36142] DAMAGECOUNT value on done: 1457234.0 [2023-02-25 14:53:16,575][36142] Sum rewards: 66.613, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.200', 'ARMOR': '0.008', 'AMMO5': '0.008', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.182', 'AMMO3': '0.202', 'weapon2': '0.246', 'WEAPON5': '0.300', 'weapon4': '0.388', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.920', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.379', 'FRAGCOUNT': '56.000'} [2023-02-25 14:53:16,867][36142] DAMAGECOUNT value on done: 1460090.0 [2023-02-25 14:53:16,868][36142] Sum rewards: 56.560, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.397', 'AMMO5': '0.012', 'AMMO2': '0.042', 'AMMO3': '0.158', 'weapon2': '0.164', 'AMMO4': '0.212', 'weapon5': '0.216', 'WEAPON5': '0.350', 'ARMOR': '0.404', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'weapon4': '1.082', 'weapon3': '2.338', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '47.000'} [2023-02-25 14:53:17,056][36156] DAMAGECOUNT value on done: 1473359.0 [2023-02-25 14:53:17,057][36156] Sum rewards: 61.315, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.080', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.166', 'weapon4': '0.172', 'AMMO3': '0.217', 'weapon2': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.112', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '52.000'} [2023-02-25 14:53:17,351][36156] DAMAGECOUNT value on done: 1447332.0 [2023-02-25 14:53:17,351][36156] Sum rewards: 57.902, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.004', 'AMMO5': '0.009', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon2': '0.142', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'weapon5': '0.224', 'WEAPON4': '0.300', 'weapon4': '0.580', 'WEAPON3': '1.150', 'weapon3': '2.852', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.472', 'FRAGCOUNT': '49.500'} [2023-02-25 14:53:17,400][36156] DAMAGECOUNT value on done: 1466004.0 [2023-02-25 14:53:17,400][36156] Sum rewards: 67.383, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.356', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.054', 'AMMO3': '0.151', 'weapon5': '0.264', 'AMMO4': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.482', 'weapon4': '0.620', 'WEAPON3': '0.950', 'weapon3': '2.394', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.672', 'FRAGCOUNT': '56.000'} [2023-02-25 14:53:17,706][36156] DAMAGECOUNT value on done: 1451863.0 [2023-02-25 14:53:17,707][36156] Sum rewards: 58.780, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.665', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.151', 'AMMO3': '0.168', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon5': '0.314', 'weapon2': '0.354', 'weapon4': '0.386', 'WEAPON3': '1.050', 'weapon3': '2.680', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.351', 'FRAGCOUNT': '49.000'} [2023-02-25 14:53:18,243][36138] Updated weights for policy 0, policy_version 56613 (0.0009) [2023-02-25 14:53:19,729][36114] Fps is (10 sec: 13517.3, 60 sec: 13516.8, 300 sec: 13565.4). Total num frames: 231903232. Throughput: 0: 3391.6. Samples: 20474298. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:53:19,729][36114] Avg episode reward: [(0, '60.484')] [2023-02-25 14:53:19,759][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000056618_231907328.pth... [2023-02-25 14:53:19,816][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000055823_228651008.pth [2023-02-25 14:53:21,302][36138] Updated weights for policy 0, policy_version 56623 (0.0010) [2023-02-25 14:53:24,329][36138] Updated weights for policy 0, policy_version 56633 (0.0010) [2023-02-25 14:53:24,729][36114] Fps is (10 sec: 13516.6, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 231972864. Throughput: 0: 3389.5. Samples: 20484370. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:53:24,730][36114] Avg episode reward: [(0, '60.484')] [2023-02-25 14:53:25,334][36154] DAMAGECOUNT value on done: 1460527.0 [2023-02-25 14:53:25,334][36154] Sum rewards: 71.220, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.701', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.046', 'weapon4': '0.078', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon2': '0.312', 'WEAPON3': '1.300', 'HITCOUNT': '3.230', 'weapon3': '3.378', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '61.000'} [2023-02-25 14:53:25,632][36154] DAMAGECOUNT value on done: 1443129.0 [2023-02-25 14:53:25,633][36154] Sum rewards: 63.700, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.940', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO3': '0.166', 'AMMO4': '0.167', 'weapon5': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.332', 'weapon4': '0.452', 'WEAPON3': '1.000', 'weapon3': '2.676', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '15.870', 'FRAGCOUNT': '54.000'} [2023-02-25 14:53:25,881][36139] DAMAGECOUNT value on done: 1462010.0 [2023-02-25 14:53:25,881][36139] Sum rewards: 61.898, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.060', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon2': '0.166', 'AMMO3': '0.175', 'weapon5': '0.210', 'weapon4': '0.222', 'AMMO4': '0.232', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '3.040', 'weapon3': '3.186', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '53.000'} [2023-02-25 14:53:25,915][36155] DAMAGECOUNT value on done: 1454911.0 [2023-02-25 14:53:25,916][36155] Sum rewards: 58.145, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.568', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.120', 'AMMO4': '0.142', 'AMMO3': '0.167', 'WEAPON5': '0.250', 'weapon2': '0.368', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon4': '1.432', 'weapon3': '1.864', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.213', 'FRAGCOUNT': '49.000'} [2023-02-25 14:53:26,029][36154] DAMAGECOUNT value on done: 1477217.0 [2023-02-25 14:53:26,030][36154] Sum rewards: 61.364, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.224', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.174', 'weapon5': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.318', 'weapon4': '0.360', 'WEAPON3': '1.000', 'weapon3': '2.870', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '51.000'} [2023-02-25 14:53:26,193][36139] DAMAGECOUNT value on done: 1459384.0 [2023-02-25 14:53:26,194][36139] Sum rewards: 57.434, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.242', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.108', 'weapon5': '0.170', 'AMMO4': '0.191', 'AMMO3': '0.217', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.096', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.123', 'FRAGCOUNT': '49.500'} [2023-02-25 14:53:26,232][36155] DAMAGECOUNT value on done: 1457471.0 [2023-02-25 14:53:26,232][36155] Sum rewards: 51.653, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.850', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.048', 'weapon5': '0.086', 'AMMO4': '0.150', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.574', 'WEAPON3': '1.350', 'HITCOUNT': '2.770', 'weapon3': '3.064', 'DAMAGECOUNT': '13.851', 'FRAGCOUNT': '46.000'} [2023-02-25 14:53:26,335][36154] DAMAGECOUNT value on done: 1455692.0 [2023-02-25 14:53:26,335][36154] Sum rewards: 55.319, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.720', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.058', 'AMMO3': '0.132', 'AMMO4': '0.292', 'weapon5': '0.298', 'weapon2': '0.334', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '0.800', 'weapon4': '0.808', 'weapon3': '2.260', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '45.000'} [2023-02-25 14:53:26,494][36139] DAMAGECOUNT value on done: 1468597.0 [2023-02-25 14:53:26,495][36139] Sum rewards: 50.475, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.860', 'AMMO5': '0.009', 'AMMO2': '0.029', 'AMMO4': '0.142', 'weapon5': '0.166', 'weapon4': '0.228', 'WEAPON5': '0.250', 'AMMO3': '0.273', 'WEAPON4': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.650', 'HITCOUNT': '2.720', 'weapon3': '2.948', 'DAMAGECOUNT': '12.738', 'FRAGCOUNT': '49.000'} [2023-02-25 14:53:26,803][36139] DAMAGECOUNT value on done: 1469252.0 [2023-02-25 14:53:26,803][36139] Sum rewards: 67.006, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.596', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'WEAPON5': '0.100', 'weapon5': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.171', 'weapon4': '0.428', 'weapon2': '0.630', 'WEAPON3': '1.100', 'weapon3': '2.660', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '55.500'} [2023-02-25 14:53:26,831][36155] DAMAGECOUNT value on done: 1474684.0 [2023-02-25 14:53:26,832][36155] Sum rewards: 72.094, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.390', 'weapon5': '0.004', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.021', 'weapon4': '0.102', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.246', 'WEAPON3': '1.150', 'weapon3': '3.480', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '60.000'} [2023-02-25 14:53:27,139][36155] DAMAGECOUNT value on done: 1456045.0 [2023-02-25 14:53:27,139][36155] Sum rewards: 56.779, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.662', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.088', 'AMMO3': '0.121', 'AMMO4': '0.202', 'weapon5': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.766', 'WEAPON3': '0.800', 'weapon3': '2.524', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '13.644', 'FRAGCOUNT': '47.000'} [2023-02-25 14:53:27,270][36141] DAMAGECOUNT value on done: 1463548.0 [2023-02-25 14:53:27,270][36141] Sum rewards: 44.137, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.550', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon5': '0.128', 'AMMO3': '0.185', 'weapon2': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.424', 'WEAPON3': '1.100', 'HITCOUNT': '2.730', 'weapon3': '3.040', 'DAMAGECOUNT': '12.825', 'FRAGCOUNT': '38.000'} [2023-02-25 14:53:27,383][36138] Updated weights for policy 0, policy_version 56643 (0.0010) [2023-02-25 14:53:27,536][36141] DAMAGECOUNT value on done: 1454825.0 [2023-02-25 14:53:27,536][36141] Sum rewards: 69.034, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.991', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon2': '0.274', 'weapon4': '0.442', 'WEAPON3': '1.050', 'weapon3': '2.976', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '55.000'} [2023-02-25 14:53:27,579][36141] DAMAGECOUNT value on done: 1466281.0 [2023-02-25 14:53:27,579][36141] Sum rewards: 57.605, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.276', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.059', 'AMMO3': '0.212', 'weapon5': '0.240', 'AMMO4': '0.296', 'weapon4': '0.308', 'weapon2': '0.332', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.814', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.645', 'FRAGCOUNT': '52.000'} [2023-02-25 14:53:27,851][36141] DAMAGECOUNT value on done: 1439816.0 [2023-02-25 14:53:27,851][36141] Sum rewards: 53.793, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.430', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.004', 'weapon4': '0.014', 'AMMO4': '0.021', 'weapon5': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.253', 'weapon2': '0.374', 'WEAPON3': '1.500', 'HITCOUNT': '2.710', 'weapon3': '3.398', 'DAMAGECOUNT': '14.052', 'FRAGCOUNT': '48.000'} [2023-02-25 14:53:29,108][36156] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:53:29,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13551.5). Total num frames: 232038400. Throughput: 0: 3386.1. Samples: 20504638. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-25 14:53:29,730][36114] Avg episode reward: [(0, '59.903')] [2023-02-25 14:53:30,305][36157] DAMAGECOUNT value on done: 1474937.0 [2023-02-25 14:53:30,305][36157] Sum rewards: 61.288, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.370', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon4': '0.062', 'weapon5': '0.084', 'AMMO4': '0.191', 'AMMO3': '0.213', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.466', 'WEAPON3': '1.300', 'weapon3': '3.168', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '55.000'} [2023-02-25 14:53:30,370][36138] Updated weights for policy 0, policy_version 56653 (0.0009) [2023-02-25 14:53:30,620][36157] DAMAGECOUNT value on done: 1461531.0 [2023-02-25 14:53:30,621][36157] Sum rewards: 61.984, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.312', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.036', 'AMMO3': '0.149', 'AMMO4': '0.181', 'weapon5': '0.218', 'WEAPON5': '0.350', 'weapon4': '0.406', 'WEAPON4': '0.450', 'weapon2': '0.630', 'WEAPON3': '1.000', 'weapon3': '2.452', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.921', 'FRAGCOUNT': '52.000'} [2023-02-25 14:53:31,021][36157] DAMAGECOUNT value on done: 1474326.0 [2023-02-25 14:53:31,022][36157] Sum rewards: 63.930, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.370', 'AMMO5': '0.019', 'AMMO2': '0.053', 'AMMO3': '0.204', 'AMMO4': '0.264', 'weapon5': '0.312', 'weapon2': '0.326', 'WEAPON5': '0.550', 'weapon4': '0.642', 'WEAPON4': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.326', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '58.000'} [2023-02-25 14:53:31,321][36157] DAMAGECOUNT value on done: 1466187.0 [2023-02-25 14:53:31,321][36157] Sum rewards: 61.980, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.445', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.102', 'AMMO3': '0.152', 'AMMO4': '0.179', 'WEAPON5': '0.300', 'weapon2': '0.300', 'weapon5': '0.310', 'WEAPON4': '0.350', 'WEAPON3': '0.950', 'weapon3': '3.090', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '51.000'} [2023-02-25 14:53:31,812][36140] DAMAGECOUNT value on done: 1470424.0 [2023-02-25 14:53:31,812][36140] Sum rewards: 62.162, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.076', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.055', 'AMMO3': '0.148', 'weapon2': '0.190', 'AMMO4': '0.277', 'WEAPON5': '0.350', 'weapon5': '0.438', 'WEAPON4': '0.700', 'WEAPON3': '0.900', 'weapon4': '1.110', 'weapon3': '1.956', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '53.000'} [2023-02-25 14:53:31,920][36140] DAMAGECOUNT value on done: 1469126.0 [2023-02-25 14:53:31,920][36140] Sum rewards: 52.783, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.596', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.079', 'AMMO3': '0.167', 'weapon2': '0.280', 'weapon5': '0.352', 'AMMO4': '0.396', 'weapon4': '0.464', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.050', 'weapon3': '2.598', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.204', 'FRAGCOUNT': '46.000'} [2023-02-25 14:53:32,122][36140] DAMAGECOUNT value on done: 1451118.0 [2023-02-25 14:53:32,122][36140] Sum rewards: 69.028, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.389', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.086', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'weapon4': '0.162', 'weapon2': '0.224', 'WEAPON4': '0.250', 'AMMO3': '0.271', 'WEAPON3': '1.600', 'weapon3': '3.252', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '62.000'} [2023-02-25 14:53:32,225][36140] DAMAGECOUNT value on done: 1456611.0 [2023-02-25 14:53:32,225][36140] Sum rewards: 68.817, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.030', 'AMMO5': '0.017', 'AMMO2': '0.046', 'AMMO3': '0.184', 'weapon5': '0.202', 'AMMO4': '0.231', 'weapon2': '0.356', 'weapon4': '0.408', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.772', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '59.000'} [2023-02-25 14:53:33,061][36154] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:53:33,385][36138] Updated weights for policy 0, policy_version 56663 (0.0009) [2023-02-25 14:53:34,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 232108032. Throughput: 0: 3387.2. Samples: 20525072. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-25 14:53:34,730][36114] Avg episode reward: [(0, '59.820')] [2023-02-25 14:53:35,391][36142] DAMAGECOUNT value on done: 1453736.0 [2023-02-25 14:53:35,391][36142] Sum rewards: 59.636, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.868', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.155', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'weapon2': '0.446', 'weapon4': '0.508', 'WEAPON3': '1.150', 'weapon3': '2.722', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '50.000'} [2023-02-25 14:53:35,706][36142] DAMAGECOUNT value on done: 1447505.0 [2023-02-25 14:53:35,706][36142] Sum rewards: 50.918, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.200', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO4': '0.178', 'weapon2': '0.232', 'AMMO3': '0.266', 'weapon5': '0.272', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.680', 'WEAPON3': '1.500', 'weapon3': '2.490', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '46.500'} [2023-02-25 14:53:36,335][36142] DAMAGECOUNT value on done: 1462608.0 [2023-02-25 14:53:36,336][36142] Sum rewards: 57.833, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.500', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.230', 'AMMO3': '0.240', 'weapon2': '0.448', 'WEAPON3': '1.450', 'weapon3': '2.984', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.122', 'FRAGCOUNT': '50.000'} [2023-02-25 14:53:36,381][36138] Updated weights for policy 0, policy_version 56673 (0.0009) [2023-02-25 14:53:36,650][36142] DAMAGECOUNT value on done: 1465928.0 [2023-02-25 14:53:36,650][36142] Sum rewards: 68.081, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.966', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.003', 'weapon5': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.171', 'weapon4': '0.222', 'weapon2': '0.588', 'WEAPON3': '1.100', 'weapon3': '2.982', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.514', 'FRAGCOUNT': '55.000'} [2023-02-25 14:53:36,916][36156] DAMAGECOUNT value on done: 1478435.0 [2023-02-25 14:53:36,916][36156] Sum rewards: 57.831, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.320', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.198', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.380', 'weapon4': '0.502', 'WEAPON3': '1.500', 'weapon3': '2.674', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '53.000'} [2023-02-25 14:53:37,230][36156] DAMAGECOUNT value on done: 1452539.0 [2023-02-25 14:53:37,231][36156] Sum rewards: 59.031, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.630', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.238', 'weapon4': '0.348', 'WEAPON3': '1.250', 'HITCOUNT': '3.130', 'weapon3': '3.150', 'DAMAGECOUNT': '15.621', 'FRAGCOUNT': '49.000'} [2023-02-25 14:53:37,270][36156] DAMAGECOUNT value on done: 1470675.0 [2023-02-25 14:53:37,270][36156] Sum rewards: 54.395, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.360', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.130', 'AMMO4': '0.131', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.520', 'weapon2': '0.646', 'WEAPON3': '1.100', 'weapon3': '2.496', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.013', 'FRAGCOUNT': '46.000'} [2023-02-25 14:53:37,583][36156] DAMAGECOUNT value on done: 1457144.0 [2023-02-25 14:53:37,584][36156] Sum rewards: 65.938, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.562', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.055', 'AMMO3': '0.118', 'weapon5': '0.198', 'AMMO4': '0.273', 'weapon4': '0.326', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.642', 'WEAPON3': '0.800', 'weapon3': '2.582', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.828', 'FRAGCOUNT': '54.000'} [2023-02-25 14:53:39,393][36138] Updated weights for policy 0, policy_version 56683 (0.0009) [2023-02-25 14:53:39,729][36114] Fps is (10 sec: 13926.5, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 232177664. Throughput: 0: 3387.1. Samples: 20535186. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-25 14:53:39,730][36114] Avg episode reward: [(0, '59.621')] [2023-02-25 14:53:42,416][36138] Updated weights for policy 0, policy_version 56693 (0.0008) [2023-02-25 14:53:44,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13565.4). Total num frames: 232243200. Throughput: 0: 3391.1. Samples: 20555532. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-25 14:53:44,730][36114] Avg episode reward: [(0, '59.621')] [2023-02-25 14:53:45,109][36154] DAMAGECOUNT value on done: 1465234.0 [2023-02-25 14:53:45,110][36154] Sum rewards: 52.433, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.970', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.066', 'weapon2': '0.220', 'AMMO3': '0.235', 'weapon4': '0.236', 'WEAPON3': '1.350', 'HITCOUNT': '2.800', 'weapon3': '3.238', 'DAMAGECOUNT': '14.121', 'FRAGCOUNT': '46.000'} [2023-02-25 14:53:45,391][36138] Updated weights for policy 0, policy_version 56703 (0.0009) [2023-02-25 14:53:45,425][36154] DAMAGECOUNT value on done: 1448053.0 [2023-02-25 14:53:45,425][36154] Sum rewards: 58.849, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.804', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.044', 'AMMO3': '0.185', 'weapon5': '0.186', 'AMMO4': '0.218', 'weapon2': '0.302', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.732', 'WEAPON3': '1.000', 'weapon3': '2.502', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.772', 'FRAGCOUNT': '50.500'} [2023-02-25 14:53:45,616][36139] DAMAGECOUNT value on done: 1467447.0 [2023-02-25 14:53:45,617][36139] Sum rewards: 57.403, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.281', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.113', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon5': '0.238', 'WEAPON5': '0.250', 'weapon4': '0.290', 'weapon2': '0.398', 'WEAPON3': '1.300', 'weapon3': '2.828', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '50.000'} [2023-02-25 14:53:45,669][36155] DAMAGECOUNT value on done: 1459553.0 [2023-02-25 14:53:45,670][36155] Sum rewards: 47.947, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.554', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.132', 'weapon4': '0.222', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.620', 'WEAPON3': '1.400', 'weapon3': '2.756', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.926', 'FRAGCOUNT': '43.000'} [2023-02-25 14:53:45,857][36154] DAMAGECOUNT value on done: 1481799.0 [2023-02-25 14:53:45,858][36154] Sum rewards: 55.021, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.390', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.108', 'weapon4': '0.114', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.444', 'WEAPON3': '1.100', 'HITCOUNT': '3.000', 'weapon3': '3.022', 'DAMAGECOUNT': '13.569', 'FRAGCOUNT': '48.000'} [2023-02-25 14:53:45,933][36139] DAMAGECOUNT value on done: 1464857.0 [2023-02-25 14:53:45,934][36139] Sum rewards: 62.425, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.110', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon5': '0.178', 'weapon4': '0.186', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.200', 'weapon3': '3.052', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '54.000'} [2023-02-25 14:53:45,964][36155] DAMAGECOUNT value on done: 1462326.0 [2023-02-25 14:53:45,964][36155] Sum rewards: 59.679, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.977', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.124', 'AMMO3': '0.129', 'AMMO4': '0.136', 'WEAPON5': '0.300', 'weapon2': '0.412', 'ARMOR': '0.459', 'WEAPON4': '0.500', 'WEAPON3': '0.800', 'weapon4': '0.880', 'weapon3': '2.394', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.565', 'FRAGCOUNT': '49.000'} [2023-02-25 14:53:46,166][36154] DAMAGECOUNT value on done: 1460336.0 [2023-02-25 14:53:46,166][36154] Sum rewards: 53.067, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.416', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.090', 'weapon5': '0.182', 'AMMO4': '0.185', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.508', 'WEAPON3': '1.150', 'weapon3': '2.954', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.602', 'FRAGCOUNT': '47.500'} [2023-02-25 14:53:46,226][36139] DAMAGECOUNT value on done: 1472883.0 [2023-02-25 14:53:46,227][36139] Sum rewards: 49.891, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.120', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.038', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.274', 'weapon4': '0.276', 'weapon2': '0.564', 'WEAPON3': '1.150', 'weapon3': '2.718', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '12.858', 'FRAGCOUNT': '42.500'} [2023-02-25 14:53:46,537][36139] DAMAGECOUNT value on done: 1474433.0 [2023-02-25 14:53:46,538][36139] Sum rewards: 57.704, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.822', 'AMMO5': '0.008', 'AMMO2': '0.052', 'weapon5': '0.152', 'AMMO3': '0.188', 'WEAPON5': '0.250', 'AMMO4': '0.259', 'WEAPON4': '0.350', 'weapon4': '0.478', 'weapon2': '0.582', 'WEAPON3': '1.200', 'weapon3': '2.574', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.543', 'FRAGCOUNT': '50.000'} [2023-02-25 14:53:46,574][36155] DAMAGECOUNT value on done: 1480752.0 [2023-02-25 14:53:46,575][36155] Sum rewards: 73.870, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.370', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.042', 'AMMO4': '0.124', 'weapon5': '0.128', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.494', 'WEAPON3': '1.000', 'weapon3': '3.176', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.204', 'FRAGCOUNT': '59.000'} [2023-02-25 14:53:46,866][36155] DAMAGECOUNT value on done: 1461239.0 [2023-02-25 14:53:46,866][36155] Sum rewards: 56.755, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.651', 'AMMO5': '0.009', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.136', 'AMMO3': '0.184', 'weapon4': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.316', 'WEAPON3': '1.250', 'HITCOUNT': '3.030', 'weapon3': '3.208', 'DAMAGECOUNT': '15.582', 'FRAGCOUNT': '47.000'} [2023-02-25 14:53:47,053][36141] DAMAGECOUNT value on done: 1468720.0 [2023-02-25 14:53:47,053][36141] Sum rewards: 65.983, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.330', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.132', 'weapon2': '0.138', 'AMMO3': '0.153', 'weapon5': '0.174', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.524', 'WEAPON3': '1.000', 'weapon3': '2.984', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.516', 'FRAGCOUNT': '55.000'} [2023-02-25 14:53:47,329][36141] DAMAGECOUNT value on done: 1459834.0 [2023-02-25 14:53:47,330][36141] Sum rewards: 56.530, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.645', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.044', 'AMMO3': '0.104', 'weapon5': '0.164', 'AMMO4': '0.221', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON4': '0.500', 'weapon4': '0.662', 'WEAPON3': '0.750', 'weapon3': '2.542', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '15.027', 'FRAGCOUNT': '46.000'} [2023-02-25 14:53:47,367][36141] DAMAGECOUNT value on done: 1470725.0 [2023-02-25 14:53:47,367][36141] Sum rewards: 53.129, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.580', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.046', 'AMMO3': '0.182', 'AMMO4': '0.229', 'weapon5': '0.350', 'weapon2': '0.394', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.508', 'WEAPON3': '1.150', 'weapon3': '2.282', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.332', 'FRAGCOUNT': '47.000'} [2023-02-25 14:53:47,650][36141] DAMAGECOUNT value on done: 1445624.0 [2023-02-25 14:53:47,651][36141] Sum rewards: 66.727, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.395', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'weapon4': '0.254', 'weapon2': '0.298', 'WEAPON3': '1.300', 'weapon3': '3.058', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '57.000'} [2023-02-25 14:53:48,420][36138] Updated weights for policy 0, policy_version 56713 (0.0009) [2023-02-25 14:53:49,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13585.0, 300 sec: 13565.4). Total num frames: 232312832. Throughput: 0: 3389.6. Samples: 20575878. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-25 14:53:49,730][36114] Avg episode reward: [(0, '59.394')] [2023-02-25 14:53:50,160][36157] DAMAGECOUNT value on done: 1479121.0 [2023-02-25 14:53:50,161][36157] Sum rewards: 41.387, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.894', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.052', 'AMMO3': '0.191', 'AMMO4': '0.261', 'weapon5': '0.270', 'WEAPON5': '0.450', 'weapon4': '0.484', 'WEAPON4': '0.550', 'weapon2': '0.574', 'WEAPON3': '1.100', 'weapon3': '2.384', 'HITCOUNT': '2.390', 'DAMAGECOUNT': '12.552', 'FRAGCOUNT': '38.500'} [2023-02-25 14:53:50,473][36157] DAMAGECOUNT value on done: 1466590.0 [2023-02-25 14:53:50,473][36157] Sum rewards: 53.626, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.058', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon2': '0.192', 'AMMO3': '0.210', 'AMMO4': '0.245', 'WEAPON5': '0.300', 'weapon5': '0.306', 'WEAPON4': '0.450', 'weapon4': '0.838', 'WEAPON3': '1.200', 'weapon3': '2.422', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.165', 'FRAGCOUNT': '47.000'} [2023-02-25 14:53:50,869][36157] DAMAGECOUNT value on done: 1480283.0 [2023-02-25 14:53:50,870][36157] Sum rewards: 62.740, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.548', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.100', 'weapon2': '0.210', 'AMMO4': '0.229', 'AMMO3': '0.240', 'weapon4': '0.272', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.120', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '56.000'} [2023-02-25 14:53:51,190][36157] DAMAGECOUNT value on done: 1471878.0 [2023-02-25 14:53:51,191][36157] Sum rewards: 60.668, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.593', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.172', 'AMMO3': '0.199', 'AMMO4': '0.234', 'WEAPON5': '0.250', 'weapon2': '0.272', 'weapon4': '0.272', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.038', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '51.000'} [2023-02-25 14:53:51,437][36138] Updated weights for policy 0, policy_version 56723 (0.0009) [2023-02-25 14:53:51,670][36140] DAMAGECOUNT value on done: 1476312.0 [2023-02-25 14:53:51,671][36140] Sum rewards: 69.646, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.270', 'AMMO5': '0.017', 'AMMO2': '0.052', 'weapon5': '0.172', 'AMMO3': '0.190', 'weapon2': '0.196', 'AMMO4': '0.260', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.692', 'WEAPON3': '1.150', 'weapon3': '2.692', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '58.000'} [2023-02-25 14:53:51,788][36140] DAMAGECOUNT value on done: 1474345.0 [2023-02-25 14:53:51,788][36140] Sum rewards: 65.960, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.432', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO3': '0.137', 'AMMO4': '0.158', 'weapon5': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.396', 'weapon4': '0.772', 'WEAPON3': '0.900', 'weapon3': '2.388', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.657', 'FRAGCOUNT': '54.000'} [2023-02-25 14:53:51,989][36140] DAMAGECOUNT value on done: 1456394.0 [2023-02-25 14:53:51,989][36140] Sum rewards: 59.515, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.441', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.040', 'AMMO4': '0.202', 'AMMO3': '0.228', 'weapon4': '0.252', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon5': '0.436', 'weapon2': '0.484', 'WEAPON3': '1.400', 'weapon3': '2.546', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.828', 'FRAGCOUNT': '53.500'} [2023-02-25 14:53:52,104][36140] DAMAGECOUNT value on done: 1461474.0 [2023-02-25 14:53:52,105][36140] Sum rewards: 55.819, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.962', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.124', 'AMMO4': '0.197', 'AMMO3': '0.216', 'weapon5': '0.266', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.760', 'weapon3': '2.994', 'DAMAGECOUNT': '14.511', 'FRAGCOUNT': '51.000'} [2023-02-25 14:53:54,455][36138] Updated weights for policy 0, policy_version 56733 (0.0010) [2023-02-25 14:53:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13565.4). Total num frames: 232378368. Throughput: 0: 3390.0. Samples: 20586064. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-25 14:53:54,730][36114] Avg episode reward: [(0, '59.320')] [2023-02-25 14:53:55,191][36142] DAMAGECOUNT value on done: 1458279.0 [2023-02-25 14:53:55,191][36142] Sum rewards: 52.877, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.632', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.116', 'weapon5': '0.120', 'AMMO4': '0.123', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.716', 'WEAPON3': '1.200', 'HITCOUNT': '2.780', 'weapon3': '2.854', 'DAMAGECOUNT': '13.629', 'FRAGCOUNT': '46.000'} [2023-02-25 14:53:55,496][36142] DAMAGECOUNT value on done: 1452249.0 [2023-02-25 14:53:55,496][36142] Sum rewards: 57.132, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.082', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon5': '0.108', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.404', 'weapon2': '0.480', 'WEAPON3': '0.900', 'weapon3': '2.828', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.232', 'FRAGCOUNT': '47.000'} [2023-02-25 14:53:56,127][36142] DAMAGECOUNT value on done: 1467108.0 [2023-02-25 14:53:56,127][36142] Sum rewards: 51.806, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.212', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.020', 'weapon5': '0.036', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'AMMO3': '0.217', 'WEAPON4': '0.350', 'weapon2': '0.534', 'weapon4': '0.676', 'WEAPON3': '1.300', 'weapon3': '2.560', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.500', 'FRAGCOUNT': '48.000'} [2023-02-25 14:53:56,434][36142] DAMAGECOUNT value on done: 1470150.0 [2023-02-25 14:53:56,434][36142] Sum rewards: 52.346, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.628', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'WEAPON4': '0.200', 'AMMO3': '0.265', 'weapon2': '0.270', 'weapon4': '0.332', 'WEAPON3': '1.600', 'HITCOUNT': '3.090', 'weapon3': '3.166', 'DAMAGECOUNT': '12.666', 'FRAGCOUNT': '49.000'} [2023-02-25 14:53:56,819][36156] DAMAGECOUNT value on done: 1483943.0 [2023-02-25 14:53:56,819][36156] Sum rewards: 66.497, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.317', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.090', 'AMMO4': '0.130', 'weapon4': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.346', 'WEAPON3': '1.250', 'weapon3': '3.144', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '57.000'} [2023-02-25 14:53:57,132][36156] DAMAGECOUNT value on done: 1457140.0 [2023-02-25 14:53:57,133][36156] Sum rewards: 55.086, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.475', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.082', 'AMMO3': '0.160', 'AMMO4': '0.194', 'WEAPON5': '0.300', 'weapon2': '0.426', 'weapon4': '0.482', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.790', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.803', 'FRAGCOUNT': '48.000'} [2023-02-25 14:53:57,174][36156] DAMAGECOUNT value on done: 1474989.0 [2023-02-25 14:53:57,174][36156] Sum rewards: 48.757, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.239', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.127', 'weapon2': '0.206', 'weapon5': '0.222', 'AMMO3': '0.227', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.426', 'WEAPON3': '1.300', 'HITCOUNT': '2.510', 'weapon3': '2.796', 'DAMAGECOUNT': '12.942', 'FRAGCOUNT': '45.500'} [2023-02-25 14:53:57,453][36156] DAMAGECOUNT value on done: 1462530.0 [2023-02-25 14:53:57,454][36156] Sum rewards: 59.074, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.818', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.216', 'weapon2': '0.218', 'AMMO4': '0.224', 'AMMO3': '0.226', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'weapon4': '0.754', 'WEAPON3': '1.200', 'weapon3': '2.448', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '54.000'} [2023-02-25 14:53:57,498][36138] Updated weights for policy 0, policy_version 56743 (0.0009) [2023-02-25 14:53:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.0, 300 sec: 13565.4). Total num frames: 232448000. Throughput: 0: 3388.2. Samples: 20606386. Policy #0 lag: (min: 0.0, avg: 0.9, max: 2.0) [2023-02-25 14:53:59,730][36114] Avg episode reward: [(0, '58.912')] [2023-02-25 14:54:00,543][36138] Updated weights for policy 0, policy_version 56753 (0.0009) [2023-02-25 14:54:03,573][36138] Updated weights for policy 0, policy_version 56763 (0.0010) [2023-02-25 14:54:04,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13565.4). Total num frames: 232513536. Throughput: 0: 3384.5. Samples: 20626602. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:54:04,730][36114] Avg episode reward: [(0, '58.912')] [2023-02-25 14:54:05,105][36154] DAMAGECOUNT value on done: 1471985.0 [2023-02-25 14:54:05,105][36154] Sum rewards: 78.011, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.940', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.137', 'weapon5': '0.162', 'AMMO3': '0.236', 'WEAPON5': '0.250', 'weapon2': '0.286', 'weapon4': '0.334', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '2.928', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.253', 'FRAGCOUNT': '67.000'} [2023-02-25 14:54:05,403][36154] DAMAGECOUNT value on done: 1452943.0 [2023-02-25 14:54:05,404][36154] Sum rewards: 60.634, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.480', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'weapon5': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'weapon2': '0.224', 'weapon4': '0.454', 'WEAPON3': '1.000', 'weapon3': '2.912', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.670', 'FRAGCOUNT': '50.000'} [2023-02-25 14:54:05,465][36155] DAMAGECOUNT value on done: 1464906.0 [2023-02-25 14:54:05,465][36155] Sum rewards: 63.301, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.568', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.128', 'weapon4': '0.154', 'weapon2': '0.166', 'AMMO3': '0.303', 'WEAPON3': '1.750', 'HITCOUNT': '3.230', 'weapon3': '3.400', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '57.000'} [2023-02-25 14:54:05,533][36139] DAMAGECOUNT value on done: 1472956.0 [2023-02-25 14:54:05,533][36139] Sum rewards: 58.185, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.120', 'AMMO5': '0.013', 'AMMO2': '0.045', 'AMMO3': '0.165', 'weapon5': '0.208', 'AMMO4': '0.223', 'WEAPON5': '0.450', 'weapon4': '0.460', 'weapon2': '0.530', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.574', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '50.500'} [2023-02-25 14:54:05,727][36154] DAMAGECOUNT value on done: 1486556.0 [2023-02-25 14:54:05,728][36154] Sum rewards: 53.416, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.272', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.169', 'weapon2': '0.250', 'weapon5': '0.292', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.476', 'WEAPON3': '1.100', 'weapon3': '2.668', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.271', 'FRAGCOUNT': '46.000'} [2023-02-25 14:54:05,763][36155] DAMAGECOUNT value on done: 1468383.0 [2023-02-25 14:54:05,763][36155] Sum rewards: 67.576, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.985', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.122', 'AMMO3': '0.182', 'weapon2': '0.194', 'weapon5': '0.242', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.702', 'WEAPON3': '1.100', 'weapon3': '2.616', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.171', 'FRAGCOUNT': '54.500'} [2023-02-25 14:54:05,838][36139] DAMAGECOUNT value on done: 1469675.0 [2023-02-25 14:54:05,839][36139] Sum rewards: 56.422, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.146', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.136', 'weapon4': '0.138', 'AMMO4': '0.163', 'AMMO3': '0.164', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.472', 'WEAPON3': '1.000', 'weapon3': '3.004', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.424', 'FRAGCOUNT': '48.500'} [2023-02-25 14:54:06,044][36154] DAMAGECOUNT value on done: 1465505.0 [2023-02-25 14:54:06,044][36154] Sum rewards: 59.112, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.470', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.137', 'AMMO3': '0.175', 'weapon5': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.420', 'weapon2': '0.702', 'WEAPON3': '1.100', 'weapon3': '2.490', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '50.000'} [2023-02-25 14:54:06,067][36139] DAMAGECOUNT value on done: 1478642.0 [2023-02-25 14:54:06,068][36139] Sum rewards: 64.121, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.310', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon4': '0.028', 'weapon5': '0.086', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.198', 'AMMO3': '0.292', 'WEAPON3': '1.750', 'HITCOUNT': '3.400', 'weapon3': '3.448', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '57.000'} [2023-02-25 14:54:06,348][36155] DAMAGECOUNT value on done: 1485308.0 [2023-02-25 14:54:06,349][36155] Sum rewards: 56.814, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.623', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.049', 'AMMO3': '0.168', 'weapon5': '0.204', 'AMMO4': '0.243', 'weapon2': '0.314', 'WEAPON5': '0.350', 'weapon4': '0.426', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.796', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.668', 'FRAGCOUNT': '50.000'} [2023-02-25 14:54:06,376][36139] DAMAGECOUNT value on done: 1479451.0 [2023-02-25 14:54:06,376][36139] Sum rewards: 63.729, reward structure: {'DEATHCOUNT': '-12.750', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.047', 'AMMO3': '0.132', 'weapon5': '0.230', 'AMMO4': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.386', 'HEALTH': '0.387', 'weapon2': '0.628', 'WEAPON3': '0.750', 'weapon3': '2.472', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.054', 'FRAGCOUNT': '52.500'} [2023-02-25 14:54:06,618][36138] Updated weights for policy 0, policy_version 56773 (0.0009) [2023-02-25 14:54:06,661][36155] DAMAGECOUNT value on done: 1466331.0 [2023-02-25 14:54:06,662][36155] Sum rewards: 60.188, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.332', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.196', 'weapon4': '0.536', 'WEAPON3': '1.200', 'weapon3': '2.932', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.276', 'FRAGCOUNT': '51.000'} [2023-02-25 14:54:07,040][36141] DAMAGECOUNT value on done: 1474016.0 [2023-02-25 14:54:07,040][36141] Sum rewards: 66.101, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.450', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.037', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.152', 'AMMO3': '0.189', 'weapon2': '0.690', 'WEAPON3': '1.150', 'weapon3': '2.764', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.888', 'FRAGCOUNT': '55.000'} [2023-02-25 14:54:07,313][36141] DAMAGECOUNT value on done: 1465587.0 [2023-02-25 14:54:07,314][36141] Sum rewards: 71.421, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.824', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.092', 'AMMO3': '0.206', 'AMMO4': '0.227', 'weapon2': '0.234', 'weapon5': '0.308', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.050', 'weapon3': '3.110', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '61.000'} [2023-02-25 14:54:07,353][36141] DAMAGECOUNT value on done: 1476336.0 [2023-02-25 14:54:07,354][36141] Sum rewards: 70.044, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.013', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.084', 'weapon5': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'AMMO3': '0.242', 'weapon2': '0.270', 'WEAPON3': '1.650', 'weapon3': '3.356', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '61.000'} [2023-02-25 14:54:07,633][36141] DAMAGECOUNT value on done: 1450324.0 [2023-02-25 14:54:07,633][36141] Sum rewards: 51.347, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.647', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.110', 'AMMO4': '0.161', 'AMMO3': '0.211', 'weapon4': '0.236', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.920', 'weapon3': '3.146', 'DAMAGECOUNT': '14.100', 'FRAGCOUNT': '45.000'} [2023-02-25 14:54:09,624][36138] Updated weights for policy 0, policy_version 56783 (0.0009) [2023-02-25 14:54:09,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 232583168. Throughput: 0: 3384.3. Samples: 20636662. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:54:09,730][36114] Avg episode reward: [(0, '59.447')] [2023-02-25 14:54:10,122][36157] DAMAGECOUNT value on done: 1485622.0 [2023-02-25 14:54:10,122][36157] Sum rewards: 67.999, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.658', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.061', 'AMMO3': '0.232', 'weapon4': '0.270', 'AMMO4': '0.306', 'weapon5': '0.342', 'weapon2': '0.520', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.532', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.503', 'FRAGCOUNT': '59.000'} [2023-02-25 14:54:10,412][36157] DAMAGECOUNT value on done: 1471629.0 [2023-02-25 14:54:10,412][36157] Sum rewards: 57.745, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.670', 'AMMO5': '0.017', 'AMMO2': '0.035', 'AMMO3': '0.170', 'AMMO4': '0.174', 'weapon2': '0.374', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.452', 'weapon5': '0.458', 'WEAPON3': '1.000', 'weapon3': '2.308', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.117', 'FRAGCOUNT': '49.500'} [2023-02-25 14:54:10,837][36157] DAMAGECOUNT value on done: 1485317.0 [2023-02-25 14:54:10,837][36157] Sum rewards: 49.067, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.596', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.163', 'AMMO3': '0.192', 'weapon5': '0.288', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.478', 'weapon4': '0.624', 'WEAPON3': '1.150', 'weapon3': '2.290', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.102', 'FRAGCOUNT': '41.000'} [2023-02-25 14:54:11,148][36157] DAMAGECOUNT value on done: 1477270.0 [2023-02-25 14:54:11,148][36157] Sum rewards: 64.734, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.649', 'AMMO5': '0.008', 'ARMOR': '0.016', 'AMMO2': '0.044', 'weapon5': '0.080', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'AMMO4': '0.221', 'WEAPON4': '0.450', 'weapon2': '0.460', 'weapon4': '0.736', 'WEAPON3': '1.150', 'weapon3': '2.502', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '56.000'} [2023-02-25 14:54:11,545][36140] DAMAGECOUNT value on done: 1481616.0 [2023-02-25 14:54:11,546][36140] Sum rewards: 57.935, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.487', 'AMMO5': '0.017', 'AMMO2': '0.054', 'AMMO3': '0.196', 'weapon5': '0.258', 'AMMO4': '0.269', 'weapon2': '0.286', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.576', 'WEAPON3': '1.150', 'weapon3': '2.538', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.327', 'FRAGCOUNT': '51.000'} [2023-02-25 14:54:11,699][36140] DAMAGECOUNT value on done: 1478731.0 [2023-02-25 14:54:11,699][36140] Sum rewards: 46.573, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.028', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.049', 'AMMO3': '0.226', 'AMMO4': '0.243', 'weapon2': '0.326', 'weapon5': '0.336', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.758', 'WEAPON3': '1.250', 'weapon3': '2.298', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.158', 'FRAGCOUNT': '44.000'} [2023-02-25 14:54:11,852][36140] DAMAGECOUNT value on done: 1460546.0 [2023-02-25 14:54:11,853][36140] Sum rewards: 49.546, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.746', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon7': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.158', 'weapon5': '0.162', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.320', 'weapon4': '0.946', 'WEAPON3': '0.950', 'weapon3': '1.926', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.456', 'FRAGCOUNT': '41.000'} [2023-02-25 14:54:12,019][36140] DAMAGECOUNT value on done: 1467383.0 [2023-02-25 14:54:12,020][36140] Sum rewards: 69.062, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.474', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.046', 'AMMO3': '0.170', 'AMMO4': '0.229', 'weapon2': '0.280', 'weapon5': '0.386', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.604', 'WEAPON3': '1.050', 'weapon3': '2.472', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '59.000'} [2023-02-25 14:54:12,671][36138] Updated weights for policy 0, policy_version 56793 (0.0009) [2023-02-25 14:54:14,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13551.5). Total num frames: 232648704. Throughput: 0: 3382.3. Samples: 20656840. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:54:14,730][36114] Avg episode reward: [(0, '59.459')] [2023-02-25 14:54:15,142][36142] DAMAGECOUNT value on done: 1463945.0 [2023-02-25 14:54:15,143][36142] Sum rewards: 56.424, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-3.063', 'AMMO5': '0.015', 'AMMO2': '0.047', 'AMMO4': '0.237', 'AMMO3': '0.246', 'weapon5': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.354', 'weapon4': '0.470', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.544', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.953', 'FRAGCOUNT': '53.000'} [2023-02-25 14:54:15,462][36142] DAMAGECOUNT value on done: 1457335.0 [2023-02-25 14:54:15,463][36142] Sum rewards: 62.126, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.110', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.219', 'weapon2': '0.656', 'WEAPON3': '1.300', 'weapon3': '3.020', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.108', 'FRAGCOUNT': '54.000'} [2023-02-25 14:54:15,713][36138] Updated weights for policy 0, policy_version 56803 (0.0009) [2023-02-25 14:54:15,750][36155] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon2', 0.002)] [2023-02-25 14:54:16,074][36142] DAMAGECOUNT value on done: 1471242.0 [2023-02-25 14:54:16,075][36142] Sum rewards: 49.102, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.440', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'AMMO3': '0.157', 'WEAPON4': '0.400', 'weapon2': '0.422', 'ARMOR': '0.460', 'weapon4': '0.544', 'WEAPON3': '1.000', 'HITCOUNT': '2.760', 'weapon3': '2.822', 'DAMAGECOUNT': '12.402', 'FRAGCOUNT': '43.000'} [2023-02-25 14:54:16,380][36142] DAMAGECOUNT value on done: 1475178.0 [2023-02-25 14:54:16,381][36142] Sum rewards: 57.894, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.402', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.074', 'weapon5': '0.130', 'AMMO4': '0.162', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.372', 'WEAPON3': '1.250', 'HITCOUNT': '3.050', 'weapon3': '3.168', 'DAMAGECOUNT': '15.084', 'FRAGCOUNT': '51.000'} [2023-02-25 14:54:16,714][36156] DAMAGECOUNT value on done: 1488781.0 [2023-02-25 14:54:16,714][36156] Sum rewards: 49.289, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-0.684', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.112', 'AMMO4': '0.199', 'AMMO3': '0.249', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON4': '0.400', 'weapon4': '0.476', 'WEAPON3': '1.350', 'weapon3': '2.758', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.514', 'FRAGCOUNT': '45.000'} [2023-02-25 14:54:17,024][36156] DAMAGECOUNT value on done: 1463435.0 [2023-02-25 14:54:17,024][36156] Sum rewards: 72.359, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.440', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.080', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'weapon4': '0.176', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon2': '0.416', 'WEAPON3': '1.150', 'weapon3': '3.170', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.297', 'FRAGCOUNT': '59.000'} [2023-02-25 14:54:17,054][36156] DAMAGECOUNT value on done: 1480349.0 [2023-02-25 14:54:17,054][36156] Sum rewards: 66.087, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.314', 'AMMO5': '0.017', 'AMMO2': '0.035', 'AMMO3': '0.154', 'weapon5': '0.160', 'weapon2': '0.166', 'AMMO4': '0.175', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.446', 'WEAPON3': '0.900', 'weapon3': '2.998', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '55.000'} [2023-02-25 14:54:17,362][36156] DAMAGECOUNT value on done: 1468267.0 [2023-02-25 14:54:17,362][36156] Sum rewards: 62.964, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.632', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO4': '0.176', 'AMMO3': '0.211', 'weapon5': '0.270', 'weapon4': '0.280', 'weapon2': '0.328', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.820', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '17.172', 'FRAGCOUNT': '55.000'} [2023-02-25 14:54:18,734][36138] Updated weights for policy 0, policy_version 56813 (0.0009) [2023-02-25 14:54:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.0, 300 sec: 13565.4). Total num frames: 232718336. Throughput: 0: 3379.8. Samples: 20677164. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:54:19,730][36114] Avg episode reward: [(0, '59.524')] [2023-02-25 14:54:21,797][36138] Updated weights for policy 0, policy_version 56823 (0.0009) [2023-02-25 14:54:24,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13551.5). Total num frames: 232783872. Throughput: 0: 3378.8. Samples: 20687234. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:54:24,730][36114] Avg episode reward: [(0, '59.524')] [2023-02-25 14:54:24,852][36138] Updated weights for policy 0, policy_version 56833 (0.0009) [2023-02-25 14:54:25,050][36154] DAMAGECOUNT value on done: 1476709.0 [2023-02-25 14:54:25,050][36154] Sum rewards: 54.742, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.270', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.046', 'weapon5': '0.108', 'AMMO3': '0.211', 'AMMO4': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.326', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.950', 'weapon3': '3.278', 'DAMAGECOUNT': '14.172', 'FRAGCOUNT': '48.000'} [2023-02-25 14:54:25,335][36155] DAMAGECOUNT value on done: 1470558.0 [2023-02-25 14:54:25,335][36155] Sum rewards: 66.095, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.578', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.048', 'AMMO3': '0.176', 'AMMO4': '0.239', 'weapon2': '0.248', 'weapon4': '0.258', 'weapon5': '0.320', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.896', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '55.500'} [2023-02-25 14:54:25,351][36154] DAMAGECOUNT value on done: 1457976.0 [2023-02-25 14:54:25,351][36154] Sum rewards: 48.986, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.207', 'AMMO5': '0.011', 'AMMO2': '0.059', 'AMMO3': '0.219', 'weapon5': '0.260', 'AMMO4': '0.293', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.402', 'weapon2': '0.444', 'WEAPON3': '1.300', 'weapon3': '2.616', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.099', 'FRAGCOUNT': '45.000'} [2023-02-25 14:54:25,445][36139] DAMAGECOUNT value on done: 1478325.0 [2023-02-25 14:54:25,446][36139] Sum rewards: 55.913, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.602', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon5': '0.212', 'AMMO4': '0.225', 'AMMO3': '0.252', 'weapon4': '0.312', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.726', 'WEAPON3': '1.450', 'weapon3': '2.406', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '51.000'} [2023-02-25 14:54:25,656][36155] DAMAGECOUNT value on done: 1472691.0 [2023-02-25 14:54:25,657][36155] Sum rewards: 47.651, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.583', 'AMMO5': '0.008', 'AMMO2': '0.053', 'weapon5': '0.092', 'weapon2': '0.188', 'AMMO3': '0.222', 'weapon4': '0.228', 'WEAPON5': '0.250', 'AMMO4': '0.265', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.520', 'weapon3': '2.998', 'DAMAGECOUNT': '12.660', 'FRAGCOUNT': '45.000'} [2023-02-25 14:54:25,676][36154] DAMAGECOUNT value on done: 1491708.0 [2023-02-25 14:54:25,676][36154] Sum rewards: 51.639, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.505', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.080', 'WEAPON4': '0.150', 'weapon4': '0.256', 'AMMO3': '0.289', 'weapon2': '0.438', 'WEAPON3': '1.750', 'weapon3': '2.994', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.411', 'FRAGCOUNT': '47.000'} [2023-02-25 14:54:25,758][36139] DAMAGECOUNT value on done: 1473975.0 [2023-02-25 14:54:25,758][36139] Sum rewards: 46.468, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.180', 'AMMO5': '0.015', 'AMMO2': '0.049', 'AMMO3': '0.130', 'AMMO4': '0.246', 'weapon5': '0.300', 'weapon2': '0.418', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '0.800', 'weapon4': '0.802', 'weapon3': '2.248', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '12.900', 'FRAGCOUNT': '40.000'} [2023-02-25 14:54:25,967][36154] DAMAGECOUNT value on done: 1470641.0 [2023-02-25 14:54:25,967][36154] Sum rewards: 60.467, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.918', 'AMMO5': '0.004', 'AMMO2': '0.025', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'weapon4': '0.174', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon2': '0.384', 'WEAPON3': '1.350', 'HITCOUNT': '3.080', 'weapon3': '3.196', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '53.000'} [2023-02-25 14:54:25,969][36139] DAMAGECOUNT value on done: 1484065.0 [2023-02-25 14:54:25,969][36139] Sum rewards: 65.039, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.776', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.140', 'AMMO4': '0.145', 'weapon5': '0.182', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.456', 'WEAPON3': '1.250', 'weapon3': '2.986', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.269', 'FRAGCOUNT': '57.000'} [2023-02-25 14:54:26,237][36155] DAMAGECOUNT value on done: 1490141.0 [2023-02-25 14:54:26,238][36155] Sum rewards: 54.853, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.529', 'AMMO5': '0.018', 'AMMO2': '0.049', 'AMMO3': '0.196', 'AMMO4': '0.243', 'weapon5': '0.284', 'weapon2': '0.432', 'ARMOR': '0.467', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'weapon4': '0.754', 'WEAPON3': '1.150', 'weapon3': '2.170', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.499', 'FRAGCOUNT': '51.000'} [2023-02-25 14:54:26,283][36139] DAMAGECOUNT value on done: 1484731.0 [2023-02-25 14:54:26,284][36139] Sum rewards: 66.453, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.292', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO3': '0.150', 'AMMO4': '0.156', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.276', 'weapon5': '0.282', 'weapon4': '0.544', 'WEAPON3': '0.900', 'weapon3': '2.656', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.819', 'FRAGCOUNT': '54.000'} [2023-02-25 14:54:26,549][36155] DAMAGECOUNT value on done: 1471670.0 [2023-02-25 14:54:26,550][36155] Sum rewards: 55.679, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.910', 'AMMO5': '0.029', 'AMMO2': '0.059', 'weapon5': '0.092', 'AMMO3': '0.260', 'weapon4': '0.286', 'AMMO4': '0.295', 'weapon2': '0.390', 'WEAPON5': '0.550', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.950', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.957', 'FRAGCOUNT': '53.000'} [2023-02-25 14:54:26,937][36141] DAMAGECOUNT value on done: 1479345.0 [2023-02-25 14:54:26,938][36141] Sum rewards: 64.662, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.620', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon4': '0.172', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon2': '0.684', 'WEAPON3': '1.400', 'weapon3': '2.978', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '56.000'} [2023-02-25 14:54:27,213][36141] DAMAGECOUNT value on done: 1471049.0 [2023-02-25 14:54:27,214][36141] Sum rewards: 63.326, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.532', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.039', 'AMMO3': '0.152', 'weapon2': '0.190', 'AMMO4': '0.193', 'weapon5': '0.228', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.640', 'WEAPON3': '0.950', 'weapon3': '2.598', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '53.000'} [2023-02-25 14:54:27,261][36141] DAMAGECOUNT value on done: 1481454.0 [2023-02-25 14:54:27,262][36141] Sum rewards: 63.589, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.764', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.171', 'weapon5': '0.174', 'AMMO3': '0.189', 'weapon2': '0.202', 'weapon4': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.990', 'weapon3': '3.138', 'DAMAGECOUNT': '15.354', 'FRAGCOUNT': '56.000'} [2023-02-25 14:54:27,530][36141] DAMAGECOUNT value on done: 1455387.0 [2023-02-25 14:54:27,530][36141] Sum rewards: 56.092, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.642', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.050', 'AMMO3': '0.179', 'AMMO4': '0.252', 'weapon5': '0.282', 'weapon2': '0.360', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.676', 'WEAPON3': '1.050', 'weapon3': '2.314', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.189', 'FRAGCOUNT': '49.000'} [2023-02-25 14:54:27,845][36138] Updated weights for policy 0, policy_version 56843 (0.0009) [2023-02-25 14:54:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 232853504. Throughput: 0: 3377.6. Samples: 20707526. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:54:29,730][36114] Avg episode reward: [(0, '59.015')] [2023-02-25 14:54:30,059][36157] DAMAGECOUNT value on done: 1491082.0 [2023-02-25 14:54:30,060][36157] Sum rewards: 63.928, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.666', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.126', 'AMMO4': '0.131', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'weapon4': '0.260', 'weapon2': '0.320', 'WEAPON3': '1.400', 'weapon3': '3.034', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '56.500'} [2023-02-25 14:54:30,362][36157] DAMAGECOUNT value on done: 1476854.0 [2023-02-25 14:54:30,362][36157] Sum rewards: 63.693, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.141', 'AMMO5': '0.010', 'AMMO2': '0.043', 'AMMO3': '0.169', 'weapon5': '0.198', 'AMMO4': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.450', 'weapon4': '0.514', 'WEAPON3': '1.000', 'weapon3': '2.608', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '53.000'} [2023-02-25 14:54:30,773][36157] DAMAGECOUNT value on done: 1490817.0 [2023-02-25 14:54:30,773][36157] Sum rewards: 65.656, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.475', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.024', 'weapon4': '0.032', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'weapon2': '0.180', 'AMMO3': '0.235', 'WEAPON3': '1.450', 'HITCOUNT': '3.360', 'weapon3': '3.468', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '56.000'} [2023-02-25 14:54:30,876][36138] Updated weights for policy 0, policy_version 56853 (0.0009) [2023-02-25 14:54:31,084][36157] DAMAGECOUNT value on done: 1481959.0 [2023-02-25 14:54:31,085][36157] Sum rewards: 51.936, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.510', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.047', 'AMMO3': '0.122', 'weapon2': '0.180', 'weapon5': '0.226', 'AMMO4': '0.233', 'WEAPON5': '0.350', 'weapon4': '0.538', 'WEAPON4': '0.550', 'WEAPON3': '0.850', 'weapon3': '2.852', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.067', 'FRAGCOUNT': '43.500'} [2023-02-25 14:54:31,427][36140] DAMAGECOUNT value on done: 1487111.0 [2023-02-25 14:54:31,428][36140] Sum rewards: 51.241, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.577', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.050', 'AMMO3': '0.209', 'AMMO4': '0.253', 'weapon2': '0.308', 'weapon5': '0.324', 'weapon4': '0.416', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.612', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '47.000'} [2023-02-25 14:54:31,653][36140] DAMAGECOUNT value on done: 1484595.0 [2023-02-25 14:54:31,654][36140] Sum rewards: 57.983, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.968', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon5': '0.208', 'AMMO4': '0.213', 'weapon2': '0.218', 'AMMO3': '0.284', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.516', 'WEAPON3': '1.750', 'weapon3': '2.686', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '53.000'} [2023-02-25 14:54:31,757][36140] DAMAGECOUNT value on done: 1465570.0 [2023-02-25 14:54:31,757][36140] Sum rewards: 53.666, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.150', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.094', 'AMMO4': '0.114', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.244', 'WEAPON4': '0.250', 'weapon4': '0.306', 'WEAPON3': '1.500', 'weapon3': '3.072', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.072', 'FRAGCOUNT': '49.000'} [2023-02-25 14:54:31,832][36157] Large shaping reward 2.611 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.597, 199.0), ('HEALTH', -0.018000000000000002, -6.0), ('weapon5', 0.002)] [2023-02-25 14:54:31,970][36140] DAMAGECOUNT value on done: 1472883.0 [2023-02-25 14:54:31,971][36140] Sum rewards: 67.363, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.645', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.064', 'AMMO4': '0.130', 'AMMO3': '0.131', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.326', 'weapon2': '0.704', 'WEAPON3': '0.900', 'weapon3': '2.644', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '54.000'} [2023-02-25 14:54:33,897][36138] Updated weights for policy 0, policy_version 56863 (0.0009) [2023-02-25 14:54:34,576][36156] Large shaping reward 2.616 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.594, 198.0), ('weapon5', 0.002)] [2023-02-25 14:54:34,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13565.4). Total num frames: 232919040. Throughput: 0: 3377.2. Samples: 20727854. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:54:34,730][36114] Avg episode reward: [(0, '59.033')] [2023-02-25 14:54:35,033][36142] DAMAGECOUNT value on done: 1469144.0 [2023-02-25 14:54:35,034][36142] Sum rewards: 64.583, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.070', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.054', 'AMMO3': '0.146', 'weapon2': '0.220', 'AMMO4': '0.268', 'weapon5': '0.350', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'weapon4': '0.842', 'WEAPON3': '0.850', 'weapon3': '2.260', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '56.000'} [2023-02-25 14:54:35,341][36142] DAMAGECOUNT value on done: 1463252.0 [2023-02-25 14:54:35,341][36142] Sum rewards: 71.276, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.625', 'AMMO5': '0.004', 'AMMO2': '0.008', 'weapon4': '0.014', 'weapon5': '0.034', 'AMMO4': '0.041', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'weapon2': '0.422', 'WEAPON3': '1.150', 'weapon3': '3.392', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '58.000'} [2023-02-25 14:54:35,971][36142] DAMAGECOUNT value on done: 1476111.0 [2023-02-25 14:54:35,972][36142] Sum rewards: 46.550, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.932', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.049', 'AMMO3': '0.190', 'weapon5': '0.212', 'AMMO4': '0.243', 'weapon2': '0.380', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.452', 'WEAPON3': '1.200', 'HITCOUNT': '2.560', 'weapon3': '2.666', 'DAMAGECOUNT': '14.607', 'FRAGCOUNT': '42.500'} [2023-02-25 14:54:36,300][36142] DAMAGECOUNT value on done: 1480337.0 [2023-02-25 14:54:36,301][36142] Sum rewards: 56.901, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.248', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.152', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.340', 'weapon4': '0.576', 'WEAPON3': '1.150', 'weapon3': '2.714', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '49.000'} [2023-02-25 14:54:36,680][36156] DAMAGECOUNT value on done: 1492911.0 [2023-02-25 14:54:36,680][36156] Sum rewards: 51.460, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.640', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.123', 'weapon2': '0.234', 'WEAPON4': '0.350', 'weapon4': '0.678', 'WEAPON3': '0.800', 'weapon3': '2.716', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.390', 'FRAGCOUNT': '44.000'} [2023-02-25 14:54:36,940][36138] Updated weights for policy 0, policy_version 56873 (0.0010) [2023-02-25 14:54:36,990][36156] DAMAGECOUNT value on done: 1469102.0 [2023-02-25 14:54:36,990][36156] Sum rewards: 60.166, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.810', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.056', 'AMMO3': '0.221', 'AMMO4': '0.280', 'weapon2': '0.374', 'weapon5': '0.406', 'weapon4': '0.540', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.228', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '54.500'} [2023-02-25 14:54:37,025][36156] DAMAGECOUNT value on done: 1485839.0 [2023-02-25 14:54:37,025][36156] Sum rewards: 63.658, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.905', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.036', 'AMMO4': '0.125', 'weapon4': '0.130', 'weapon2': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON3': '1.550', 'HITCOUNT': '3.370', 'weapon3': '3.502', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '57.000'} [2023-02-25 14:54:37,328][36156] DAMAGECOUNT value on done: 1474365.0 [2023-02-25 14:54:37,329][36156] Sum rewards: 69.692, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.730', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon2': '0.124', 'WEAPON5': '0.150', 'weapon5': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'weapon4': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.744', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '58.000'} [2023-02-25 14:54:39,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13565.4). Total num frames: 232988672. Throughput: 0: 3373.6. Samples: 20737876. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:54:39,729][36114] Avg episode reward: [(0, '58.983')] [2023-02-25 14:54:39,945][36138] Updated weights for policy 0, policy_version 56883 (0.0009) [2023-02-25 14:54:42,961][36138] Updated weights for policy 0, policy_version 56893 (0.0009) [2023-02-25 14:54:44,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13565.4). Total num frames: 233054208. Throughput: 0: 3376.5. Samples: 20758330. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:54:44,729][36114] Avg episode reward: [(0, '58.983')] [2023-02-25 14:54:44,842][36154] DAMAGECOUNT value on done: 1481147.0 [2023-02-25 14:54:44,842][36154] Sum rewards: 45.776, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.740', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.047', 'AMMO3': '0.188', 'AMMO4': '0.236', 'weapon5': '0.312', 'weapon2': '0.364', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'weapon4': '1.156', 'weapon3': '1.898', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.314', 'FRAGCOUNT': '41.000'} [2023-02-25 14:54:45,112][36139] DAMAGECOUNT value on done: 1482986.0 [2023-02-25 14:54:45,112][36139] Sum rewards: 55.794, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.710', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon5': '0.098', 'AMMO3': '0.155', 'AMMO4': '0.166', 'weapon4': '0.288', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.712', 'WEAPON3': '1.050', 'weapon3': '2.648', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.869', 'FRAGCOUNT': '47.000'} [2023-02-25 14:54:45,147][36154] DAMAGECOUNT value on done: 1463159.0 [2023-02-25 14:54:45,148][36154] Sum rewards: 63.836, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.160', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.072', 'weapon5': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.247', 'weapon2': '0.256', 'WEAPON3': '1.500', 'HITCOUNT': '3.280', 'weapon3': '3.412', 'DAMAGECOUNT': '15.549', 'FRAGCOUNT': '57.000'} [2023-02-25 14:54:45,168][36155] DAMAGECOUNT value on done: 1476263.0 [2023-02-25 14:54:45,168][36155] Sum rewards: 68.748, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.412', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon2': '0.196', 'AMMO3': '0.236', 'weapon5': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.542', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '60.000'} [2023-02-25 14:54:45,412][36139] DAMAGECOUNT value on done: 1478833.0 [2023-02-25 14:54:45,413][36139] Sum rewards: 55.375, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.790', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon2': '0.206', 'AMMO4': '0.216', 'weapon4': '0.216', 'AMMO3': '0.219', 'weapon5': '0.246', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.900', 'weapon3': '2.980', 'DAMAGECOUNT': '14.574', 'FRAGCOUNT': '50.000'} [2023-02-25 14:54:45,468][36154] DAMAGECOUNT value on done: 1495679.0 [2023-02-25 14:54:45,468][36154] Sum rewards: 40.824, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.224', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.041', 'AMMO4': '0.207', 'AMMO3': '0.212', 'weapon5': '0.280', 'WEAPON5': '0.400', 'weapon2': '0.410', 'WEAPON4': '0.500', 'weapon4': '0.606', 'WEAPON3': '1.200', 'weapon3': '2.334', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '11.913', 'FRAGCOUNT': '38.000'} [2023-02-25 14:54:45,472][36155] DAMAGECOUNT value on done: 1477978.0 [2023-02-25 14:54:45,473][36155] Sum rewards: 66.002, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.886', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon4': '0.264', 'weapon2': '0.288', 'WEAPON3': '1.200', 'weapon3': '3.030', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '57.000'} [2023-02-25 14:54:45,631][36139] DAMAGECOUNT value on done: 1489170.0 [2023-02-25 14:54:45,632][36139] Sum rewards: 59.927, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.330', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.041', 'WEAPON5': '0.050', 'AMMO4': '0.204', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon4': '0.390', 'weapon2': '0.472', 'WEAPON3': '1.300', 'weapon3': '2.946', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '52.000'} [2023-02-25 14:54:45,779][36154] DAMAGECOUNT value on done: 1476440.0 [2023-02-25 14:54:45,780][36154] Sum rewards: 68.805, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.840', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.074', 'AMMO4': '0.093', 'WEAPON5': '0.200', 'weapon2': '0.218', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'weapon4': '0.270', 'WEAPON3': '1.400', 'weapon3': '3.222', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '59.500'} [2023-02-25 14:54:45,935][36139] DAMAGECOUNT value on done: 1488960.0 [2023-02-25 14:54:45,936][36139] Sum rewards: 47.760, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.275', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.122', 'AMMO3': '0.183', 'weapon5': '0.298', 'WEAPON5': '0.350', 'weapon2': '0.440', 'WEAPON4': '0.450', 'weapon4': '0.798', 'WEAPON3': '1.000', 'weapon3': '2.152', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.687', 'FRAGCOUNT': '43.000'} [2023-02-25 14:54:46,001][36138] Updated weights for policy 0, policy_version 56903 (0.0009) [2023-02-25 14:54:46,049][36155] DAMAGECOUNT value on done: 1495473.0 [2023-02-25 14:54:46,050][36155] Sum rewards: 63.381, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.191', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.036', 'AMMO4': '0.096', 'AMMO3': '0.155', 'weapon5': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.642', 'WEAPON3': '0.950', 'weapon3': '2.984', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '52.000'} [2023-02-25 14:54:46,347][36155] DAMAGECOUNT value on done: 1476566.0 [2023-02-25 14:54:46,347][36155] Sum rewards: 55.789, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.018', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon4': '0.186', 'WEAPON4': '0.200', 'weapon5': '0.204', 'weapon2': '0.238', 'AMMO3': '0.240', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.060', 'weapon3': '3.068', 'DAMAGECOUNT': '14.688', 'FRAGCOUNT': '50.000'} [2023-02-25 14:54:46,797][36141] DAMAGECOUNT value on done: 1485096.0 [2023-02-25 14:54:46,798][36141] Sum rewards: 64.771, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.538', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.126', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'weapon4': '0.256', 'WEAPON4': '0.300', 'weapon2': '0.504', 'WEAPON3': '1.550', 'weapon3': '2.836', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '57.000'} [2023-02-25 14:54:47,063][36141] DAMAGECOUNT value on done: 1476034.0 [2023-02-25 14:54:47,064][36141] Sum rewards: 58.106, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.316', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon5': '0.132', 'AMMO3': '0.197', 'AMMO4': '0.237', 'weapon4': '0.248', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'ARMOR': '0.459', 'weapon2': '0.476', 'WEAPON3': '1.150', 'weapon3': '2.908', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.955', 'FRAGCOUNT': '50.000'} [2023-02-25 14:54:47,097][36141] DAMAGECOUNT value on done: 1486593.0 [2023-02-25 14:54:47,098][36141] Sum rewards: 57.646, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.837', 'AMMO5': '0.009', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon2': '0.236', 'weapon4': '0.382', 'WEAPON3': '1.300', 'weapon3': '3.064', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.417', 'FRAGCOUNT': '48.500'} [2023-02-25 14:54:47,372][36141] DAMAGECOUNT value on done: 1461743.0 [2023-02-25 14:54:47,373][36141] Sum rewards: 70.969, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.933', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.160', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.266', 'weapon2': '0.348', 'WEAPON3': '1.450', 'weapon3': '2.956', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.068', 'FRAGCOUNT': '61.000'} [2023-02-25 14:54:48,984][36138] Updated weights for policy 0, policy_version 56913 (0.0010) [2023-02-25 14:54:49,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13565.4). Total num frames: 233123840. Throughput: 0: 3383.7. Samples: 20778866. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:54:49,729][36114] Avg episode reward: [(0, '59.196')] [2023-02-25 14:54:49,946][36157] DAMAGECOUNT value on done: 1496185.0 [2023-02-25 14:54:49,946][36157] Sum rewards: 51.527, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.888', 'AMMO5': '0.023', 'AMMO2': '0.065', 'AMMO3': '0.130', 'AMMO4': '0.327', 'weapon5': '0.418', 'weapon2': '0.598', 'weapon4': '0.598', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '0.850', 'weapon3': '2.086', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.309', 'FRAGCOUNT': '43.000'} [2023-02-25 14:54:50,251][36157] DAMAGECOUNT value on done: 1481177.0 [2023-02-25 14:54:50,251][36157] Sum rewards: 46.267, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.494', 'AMMO5': '0.009', 'AMMO2': '0.052', 'AMMO3': '0.138', 'weapon5': '0.162', 'WEAPON5': '0.250', 'AMMO4': '0.262', 'ARMOR': '0.400', 'weapon2': '0.418', 'WEAPON4': '0.500', 'weapon4': '0.762', 'WEAPON3': '0.950', 'weapon3': '2.438', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '12.969', 'FRAGCOUNT': '39.000'} [2023-02-25 14:54:50,650][36157] DAMAGECOUNT value on done: 1495702.0 [2023-02-25 14:54:50,651][36157] Sum rewards: 57.685, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.618', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.247', 'weapon2': '0.462', 'WEAPON3': '1.450', 'HITCOUNT': '3.130', 'weapon3': '3.294', 'DAMAGECOUNT': '14.655', 'FRAGCOUNT': '49.000'} [2023-02-25 14:54:50,961][36157] DAMAGECOUNT value on done: 1488022.0 [2023-02-25 14:54:50,961][36157] Sum rewards: 69.486, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.301', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.134', 'AMMO3': '0.151', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON4': '0.350', 'weapon4': '0.684', 'WEAPON3': '1.000', 'weapon3': '2.680', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '56.000'} [2023-02-25 14:54:51,165][36140] DAMAGECOUNT value on done: 1492048.0 [2023-02-25 14:54:51,165][36140] Sum rewards: 56.759, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.552', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.054', 'weapon4': '0.136', 'weapon5': '0.186', 'AMMO3': '0.218', 'AMMO4': '0.268', 'weapon2': '0.296', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.900', 'weapon3': '3.126', 'DAMAGECOUNT': '14.811', 'FRAGCOUNT': '51.000'} [2023-02-25 14:54:51,397][36140] DAMAGECOUNT value on done: 1489707.0 [2023-02-25 14:54:51,398][36140] Sum rewards: 53.007, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.352', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.050', 'AMMO3': '0.180', 'weapon2': '0.206', 'AMMO4': '0.249', 'weapon5': '0.262', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.594', 'WEAPON3': '1.000', 'weapon3': '2.662', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.916', 'FRAGCOUNT': '46.000'} [2023-02-25 14:54:51,475][36140] DAMAGECOUNT value on done: 1471157.0 [2023-02-25 14:54:51,476][36140] Sum rewards: 66.526, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.376', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.130', 'AMMO3': '0.157', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.074', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '55.000'} [2023-02-25 14:54:51,698][36140] DAMAGECOUNT value on done: 1479333.0 [2023-02-25 14:54:51,699][36140] Sum rewards: 74.373, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.144', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.090', 'weapon4': '0.112', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'weapon2': '0.346', 'WEAPON3': '1.500', 'weapon3': '3.334', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '19.350', 'FRAGCOUNT': '63.000'} [2023-02-25 14:54:52,009][36138] Updated weights for policy 0, policy_version 56923 (0.0009) [2023-02-25 14:54:54,729][36114] Fps is (10 sec: 13926.3, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 233193472. Throughput: 0: 3387.7. Samples: 20789110. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:54:54,730][36114] Avg episode reward: [(0, '59.344')] [2023-02-25 14:54:54,797][36142] DAMAGECOUNT value on done: 1475048.0 [2023-02-25 14:54:54,797][36142] Sum rewards: 72.595, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.010', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon4': '0.252', 'weapon2': '0.298', 'WEAPON3': '1.100', 'weapon3': '3.178', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.712', 'FRAGCOUNT': '60.000'} [2023-02-25 14:54:54,950][36138] Updated weights for policy 0, policy_version 56933 (0.0009) [2023-02-25 14:54:55,099][36142] DAMAGECOUNT value on done: 1468906.0 [2023-02-25 14:54:55,099][36142] Sum rewards: 63.992, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.699', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO3': '0.185', 'AMMO4': '0.203', 'weapon5': '0.348', 'weapon4': '0.420', 'weapon2': '0.476', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.470', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '55.500'} [2023-02-25 14:54:55,701][36142] DAMAGECOUNT value on done: 1481680.0 [2023-02-25 14:54:55,701][36142] Sum rewards: 66.568, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.270', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.122', 'AMMO4': '0.124', 'weapon2': '0.148', 'AMMO3': '0.210', 'weapon4': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.170', 'weapon3': '3.306', 'DAMAGECOUNT': '16.707', 'FRAGCOUNT': '57.000'} [2023-02-25 14:54:56,008][36142] DAMAGECOUNT value on done: 1485982.0 [2023-02-25 14:54:56,008][36142] Sum rewards: 61.446, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.160', 'AMMO5': '0.007', 'AMMO2': '0.047', 'weapon5': '0.090', 'AMMO3': '0.150', 'WEAPON5': '0.200', 'AMMO4': '0.233', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.414', 'weapon4': '0.686', 'WEAPON3': '0.900', 'weapon3': '2.544', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '49.000'} [2023-02-25 14:54:56,288][36156] DAMAGECOUNT value on done: 1496825.0 [2023-02-25 14:54:56,289][36156] Sum rewards: 44.593, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.490', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.045', 'AMMO3': '0.162', 'AMMO4': '0.226', 'weapon5': '0.234', 'weapon4': '0.314', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.524', 'WEAPON3': '1.100', 'HITCOUNT': '2.510', 'weapon3': '2.696', 'DAMAGECOUNT': '11.553', 'FRAGCOUNT': '40.500'} [2023-02-25 14:54:56,601][36156] DAMAGECOUNT value on done: 1474082.0 [2023-02-25 14:54:56,602][36156] Sum rewards: 57.240, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.450', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.054', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon2': '0.392', 'weapon4': '0.538', 'WEAPON3': '1.250', 'weapon3': '2.822', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.940', 'FRAGCOUNT': '49.000'} [2023-02-25 14:54:56,631][36156] DAMAGECOUNT value on done: 1490364.0 [2023-02-25 14:54:56,632][36156] Sum rewards: 49.218, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.273', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.024', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.222', 'weapon2': '0.562', 'WEAPON3': '1.300', 'HITCOUNT': '2.690', 'weapon3': '3.204', 'DAMAGECOUNT': '13.575', 'FRAGCOUNT': '43.000'} [2023-02-25 14:54:56,929][36156] DAMAGECOUNT value on done: 1479729.0 [2023-02-25 14:54:56,929][36156] Sum rewards: 63.466, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.492', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO3': '0.166', 'AMMO4': '0.184', 'weapon5': '0.204', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.454', 'weapon4': '0.572', 'WEAPON3': '1.000', 'weapon3': '2.512', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '53.000'} [2023-02-25 14:54:57,580][36140] Large shaping reward 2.613 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.591, 197.0), ('weapon5', 0.002)] [2023-02-25 14:54:57,962][36138] Updated weights for policy 0, policy_version 56943 (0.0009) [2023-02-25 14:54:59,729][36114] Fps is (10 sec: 13516.4, 60 sec: 13516.8, 300 sec: 13565.4). Total num frames: 233259008. Throughput: 0: 3397.3. Samples: 20809720. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:54:59,731][36114] Avg episode reward: [(0, '59.484')] [2023-02-25 14:55:00,987][36138] Updated weights for policy 0, policy_version 56953 (0.0009) [2023-02-25 14:55:01,245][36155] Large shaping reward 2.544 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.522, 174.0), ('weapon5', 0.002)] [2023-02-25 14:55:04,032][36138] Updated weights for policy 0, policy_version 56963 (0.0009) [2023-02-25 14:55:04,539][36154] DAMAGECOUNT value on done: 1486847.0 [2023-02-25 14:55:04,540][36154] Sum rewards: 72.384, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.285', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon4': '0.044', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.129', 'AMMO3': '0.217', 'weapon2': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.396', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '61.000'} [2023-02-25 14:55:04,713][36155] DAMAGECOUNT value on done: 1481728.0 [2023-02-25 14:55:04,714][36155] Sum rewards: 67.078, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.660', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.070', 'weapon4': '0.112', 'AMMO3': '0.185', 'weapon2': '0.388', 'WEAPON3': '1.150', 'weapon3': '3.262', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '55.000'} [2023-02-25 14:55:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 233328640. Throughput: 0: 3397.3. Samples: 20830040. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:55:04,729][36114] Avg episode reward: [(0, '59.663')] [2023-02-25 14:55:04,825][36139] DAMAGECOUNT value on done: 1488278.0 [2023-02-25 14:55:04,826][36139] Sum rewards: 63.102, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.402', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.036', 'AMMO4': '0.082', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.203', 'weapon2': '0.848', 'WEAPON3': '1.300', 'weapon3': '2.826', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.876', 'FRAGCOUNT': '52.000'} [2023-02-25 14:55:04,850][36154] DAMAGECOUNT value on done: 1467204.0 [2023-02-25 14:55:04,850][36154] Sum rewards: 55.489, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.192', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.036', 'weapon5': '0.056', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'weapon2': '0.550', 'WEAPON3': '1.100', 'HITCOUNT': '2.580', 'weapon3': '3.254', 'DAMAGECOUNT': '12.135', 'FRAGCOUNT': '50.000'} [2023-02-25 14:55:05,022][36155] DAMAGECOUNT value on done: 1483352.0 [2023-02-25 14:55:05,022][36155] Sum rewards: 61.425, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.042', 'AMMO5': '0.014', 'AMMO2': '0.032', 'AMMO4': '0.161', 'weapon2': '0.190', 'weapon4': '0.202', 'AMMO3': '0.211', 'weapon5': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.050', 'weapon3': '3.084', 'DAMAGECOUNT': '16.122', 'FRAGCOUNT': '53.000'} [2023-02-25 14:55:05,135][36139] DAMAGECOUNT value on done: 1484195.0 [2023-02-25 14:55:05,135][36139] Sum rewards: 65.178, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.932', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.014', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO3': '0.213', 'weapon2': '0.394', 'WEAPON3': '1.350', 'HITCOUNT': '3.220', 'weapon3': '3.276', 'DAMAGECOUNT': '16.086', 'FRAGCOUNT': '55.000'} [2023-02-25 14:55:05,186][36154] DAMAGECOUNT value on done: 1501064.0 [2023-02-25 14:55:05,187][36154] Sum rewards: 61.911, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.385', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.114', 'AMMO4': '0.133', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.280', 'weapon4': '0.298', 'WEAPON3': '1.250', 'weapon3': '3.130', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.155', 'FRAGCOUNT': '51.000'} [2023-02-25 14:55:05,358][36139] DAMAGECOUNT value on done: 1494594.0 [2023-02-25 14:55:05,359][36139] Sum rewards: 67.764, reward structure: {'DEATHCOUNT': '-16.500', 'AMMO5': '0.020', 'AMMO2': '0.060', 'AMMO3': '0.155', 'weapon2': '0.234', 'weapon5': '0.242', 'AMMO4': '0.301', 'WEAPON5': '0.400', 'WEAPON4': '0.650', 'HEALTH': '0.654', 'WEAPON3': '0.800', 'weapon4': '0.800', 'weapon3': '2.376', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '58.000'} [2023-02-25 14:55:05,483][36154] DAMAGECOUNT value on done: 1481776.0 [2023-02-25 14:55:05,483][36154] Sum rewards: 64.023, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.680', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.149', 'weapon5': '0.204', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.548', 'weapon2': '0.716', 'WEAPON3': '0.950', 'weapon3': '2.322', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.008', 'FRAGCOUNT': '52.000'} [2023-02-25 14:55:05,585][36155] DAMAGECOUNT value on done: 1499994.0 [2023-02-25 14:55:05,586][36155] Sum rewards: 52.781, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.038', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.130', 'AMMO4': '0.191', 'weapon5': '0.286', 'weapon2': '0.306', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '0.850', 'weapon4': '0.964', 'weapon3': '2.138', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '13.263', 'FRAGCOUNT': '45.000'} [2023-02-25 14:55:05,655][36139] DAMAGECOUNT value on done: 1494215.0 [2023-02-25 14:55:05,655][36139] Sum rewards: 61.707, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.530', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.218', 'AMMO3': '0.268', 'weapon4': '0.272', 'weapon2': '0.380', 'WEAPON3': '1.600', 'weapon3': '2.838', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.765', 'FRAGCOUNT': '57.000'} [2023-02-25 14:55:05,872][36155] DAMAGECOUNT value on done: 1481100.0 [2023-02-25 14:55:05,873][36155] Sum rewards: 53.748, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.485', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.056', 'AMMO3': '0.079', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO4': '0.282', 'weapon2': '0.504', 'WEAPON4': '0.550', 'WEAPON3': '0.600', 'weapon3': '1.524', 'weapon4': '1.698', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '13.602', 'FRAGCOUNT': '43.000'} [2023-02-25 14:55:06,440][36141] DAMAGECOUNT value on done: 1490269.0 [2023-02-25 14:55:06,441][36141] Sum rewards: 61.310, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.595', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.036', 'AMMO3': '0.167', 'AMMO4': '0.182', 'weapon5': '0.198', 'weapon2': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.938', 'WEAPON3': '1.100', 'weapon3': '2.302', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.519', 'FRAGCOUNT': '52.000'} [2023-02-25 14:55:06,708][36141] DAMAGECOUNT value on done: 1481008.0 [2023-02-25 14:55:06,709][36141] Sum rewards: 51.399, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.366', 'ARMOR': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon5': '0.080', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'weapon2': '0.236', 'WEAPON4': '0.250', 'AMMO3': '0.268', 'weapon4': '0.342', 'WEAPON3': '1.550', 'weapon3': '3.116', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.922', 'FRAGCOUNT': '46.000'} [2023-02-25 14:55:06,747][36141] DAMAGECOUNT value on done: 1492064.0 [2023-02-25 14:55:06,747][36141] Sum rewards: 63.616, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.886', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.157', 'AMMO3': '0.195', 'weapon5': '0.212', 'weapon2': '0.266', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.638', 'WEAPON3': '1.100', 'weapon3': '2.544', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.413', 'FRAGCOUNT': '53.500'} [2023-02-25 14:55:06,994][36138] Updated weights for policy 0, policy_version 56973 (0.0009) [2023-02-25 14:55:07,023][36141] DAMAGECOUNT value on done: 1466581.0 [2023-02-25 14:55:07,024][36141] Sum rewards: 54.912, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.254', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.040', 'AMMO3': '0.191', 'AMMO4': '0.197', 'weapon2': '0.220', 'weapon5': '0.246', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.930', 'WEAPON3': '1.150', 'weapon3': '2.170', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.514', 'FRAGCOUNT': '49.000'} [2023-02-25 14:55:09,680][36157] DAMAGECOUNT value on done: 1501522.0 [2023-02-25 14:55:09,681][36157] Sum rewards: 55.677, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.247', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon5': '0.040', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.249', 'weapon2': '0.384', 'weapon4': '0.388', 'WEAPON3': '1.450', 'weapon3': '2.900', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.011', 'FRAGCOUNT': '48.000'} [2023-02-25 14:55:09,729][36114] Fps is (10 sec: 13926.7, 60 sec: 13585.1, 300 sec: 13579.3). Total num frames: 233398272. Throughput: 0: 3400.8. Samples: 20840272. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 14:55:09,730][36114] Avg episode reward: [(0, '59.449')] [2023-02-25 14:55:09,955][36138] Updated weights for policy 0, policy_version 56983 (0.0009) [2023-02-25 14:55:09,987][36157] DAMAGECOUNT value on done: 1486802.0 [2023-02-25 14:55:09,988][36157] Sum rewards: 60.345, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.916', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.148', 'weapon2': '0.160', 'AMMO3': '0.305', 'WEAPON3': '1.850', 'HITCOUNT': '3.230', 'weapon3': '3.308', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '55.000'} [2023-02-25 14:55:10,384][36157] DAMAGECOUNT value on done: 1500691.0 [2023-02-25 14:55:10,384][36157] Sum rewards: 57.394, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.625', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.038', 'AMMO3': '0.156', 'AMMO4': '0.189', 'weapon5': '0.216', 'weapon2': '0.250', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.852', 'WEAPON3': '1.000', 'weapon3': '2.368', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.607', 'FRAGCOUNT': '50.000'} [2023-02-25 14:55:10,676][36157] DAMAGECOUNT value on done: 1493153.0 [2023-02-25 14:55:10,676][36157] Sum rewards: 59.449, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.527', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.032', 'weapon5': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon4': '0.260', 'weapon2': '0.332', 'WEAPON3': '1.250', 'HITCOUNT': '2.990', 'weapon3': '3.116', 'DAMAGECOUNT': '15.378', 'FRAGCOUNT': '50.000'} [2023-02-25 14:55:10,930][36140] DAMAGECOUNT value on done: 1496441.0 [2023-02-25 14:55:10,931][36140] Sum rewards: 49.717, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.402', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.062', 'AMMO3': '0.177', 'weapon2': '0.210', 'weapon5': '0.220', 'AMMO4': '0.311', 'WEAPON5': '0.350', 'WEAPON4': '0.600', 'weapon4': '0.688', 'WEAPON3': '1.000', 'weapon3': '2.610', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.179', 'FRAGCOUNT': '46.000'} [2023-02-25 14:55:11,183][36140] DAMAGECOUNT value on done: 1493820.0 [2023-02-25 14:55:11,183][36140] Sum rewards: 43.932, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.161', 'ARMOR': '0.004', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.142', 'AMMO3': '0.200', 'weapon4': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.050', 'HITCOUNT': '2.340', 'weapon3': '2.950', 'DAMAGECOUNT': '12.339', 'FRAGCOUNT': '38.000'} [2023-02-25 14:55:11,244][36140] DAMAGECOUNT value on done: 1476550.0 [2023-02-25 14:55:11,244][36140] Sum rewards: 62.429, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.719', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.076', 'AMMO4': '0.146', 'AMMO3': '0.208', 'weapon5': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.518', 'WEAPON3': '1.300', 'HITCOUNT': '2.950', 'weapon3': '2.962', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '53.500'} [2023-02-25 14:55:11,487][36140] DAMAGECOUNT value on done: 1484263.0 [2023-02-25 14:55:11,487][36140] Sum rewards: 55.459, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.396', 'AMMO5': '0.009', 'AMMO2': '0.035', 'AMMO3': '0.144', 'weapon5': '0.166', 'AMMO4': '0.173', 'weapon2': '0.186', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.654', 'WEAPON3': '1.000', 'weapon3': '2.788', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.790', 'FRAGCOUNT': '47.000'} [2023-02-25 14:55:12,970][36138] Updated weights for policy 0, policy_version 56993 (0.0009) [2023-02-25 14:55:14,594][36142] DAMAGECOUNT value on done: 1479006.0 [2023-02-25 14:55:14,595][36142] Sum rewards: 44.165, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.125', 'AMMO5': '0.016', 'AMMO2': '0.055', 'AMMO3': '0.175', 'weapon5': '0.196', 'weapon4': '0.218', 'AMMO4': '0.275', 'WEAPON5': '0.450', 'weapon2': '0.482', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'HITCOUNT': '2.450', 'weapon3': '2.848', 'DAMAGECOUNT': '11.874', 'FRAGCOUNT': '40.000'} [2023-02-25 14:55:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 233463808. Throughput: 0: 3404.3. Samples: 20860718. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:55:14,729][36114] Avg episode reward: [(0, '58.875')] [2023-02-25 14:55:14,898][36142] DAMAGECOUNT value on done: 1473093.0 [2023-02-25 14:55:14,898][36142] Sum rewards: 49.211, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.076', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO3': '0.101', 'weapon5': '0.138', 'AMMO4': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.457', 'weapon2': '0.488', 'weapon4': '0.650', 'WEAPON3': '0.700', 'weapon3': '2.452', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.561', 'FRAGCOUNT': '39.000'} [2023-02-25 14:55:15,494][36142] DAMAGECOUNT value on done: 1487051.0 [2023-02-25 14:55:15,495][36142] Sum rewards: 60.650, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.632', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon2': '0.172', 'AMMO3': '0.173', 'AMMO4': '0.181', 'weapon5': '0.336', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'ARMOR': '0.508', 'weapon4': '1.028', 'WEAPON3': '1.050', 'weapon3': '2.102', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.113', 'FRAGCOUNT': '51.000'} [2023-02-25 14:55:15,704][36139] Large shaping reward 2.607 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.015, -5.0), ('weapon5', 0.002)] [2023-02-25 14:55:15,798][36142] DAMAGECOUNT value on done: 1491583.0 [2023-02-25 14:55:15,798][36142] Sum rewards: 61.062, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.228', 'AMMO2': '0.013', 'weapon4': '0.062', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'AMMO3': '0.205', 'weapon2': '0.304', 'WEAPON3': '1.300', 'HITCOUNT': '3.450', 'weapon3': '3.490', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '51.000'} [2023-02-25 14:55:15,982][36138] Updated weights for policy 0, policy_version 57003 (0.0009) [2023-02-25 14:55:16,081][36156] DAMAGECOUNT value on done: 1502452.0 [2023-02-25 14:55:16,081][36156] Sum rewards: 65.292, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.582', 'AMMO5': '0.017', 'AMMO2': '0.049', 'AMMO3': '0.130', 'AMMO4': '0.244', 'weapon5': '0.298', 'weapon2': '0.416', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon4': '0.588', 'WEAPON3': '0.850', 'weapon3': '2.310', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '53.500'} [2023-02-25 14:55:16,383][36156] DAMAGECOUNT value on done: 1479170.0 [2023-02-25 14:55:16,384][36156] Sum rewards: 50.147, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.941', 'AMMO5': '0.017', 'AMMO2': '0.059', 'AMMO3': '0.187', 'weapon5': '0.260', 'AMMO4': '0.294', 'weapon2': '0.334', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.658', 'WEAPON3': '1.100', 'weapon3': '2.384', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '44.000'} [2023-02-25 14:55:16,414][36156] DAMAGECOUNT value on done: 1495570.0 [2023-02-25 14:55:16,415][36156] Sum rewards: 54.167, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.314', 'AMMO5': '0.016', 'AMMO2': '0.035', 'AMMO4': '0.173', 'weapon2': '0.174', 'weapon5': '0.196', 'AMMO3': '0.253', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.508', 'WEAPON3': '1.450', 'weapon3': '2.798', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.618', 'FRAGCOUNT': '48.000'} [2023-02-25 14:55:16,729][36156] DAMAGECOUNT value on done: 1485820.0 [2023-02-25 14:55:16,730][36156] Sum rewards: 71.432, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.254', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO4': '0.179', 'AMMO3': '0.192', 'weapon5': '0.218', 'weapon2': '0.226', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.612', 'WEAPON3': '1.200', 'weapon3': '2.612', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '62.000'} [2023-02-25 14:55:18,999][36138] Updated weights for policy 0, policy_version 57013 (0.0009) [2023-02-25 14:55:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 233533440. Throughput: 0: 3405.7. Samples: 20881112. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:55:19,730][36114] Avg episode reward: [(0, '59.087')] [2023-02-25 14:55:19,734][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000057015_233533440.pth... [2023-02-25 14:55:19,793][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000056220_230277120.pth [2023-02-25 14:55:22,020][36138] Updated weights for policy 0, policy_version 57023 (0.0009) [2023-02-25 14:55:24,249][36154] DAMAGECOUNT value on done: 1492079.0 [2023-02-25 14:55:24,250][36154] Sum rewards: 64.098, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.250', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.142', 'AMMO3': '0.173', 'WEAPON4': '0.300', 'weapon4': '0.302', 'weapon2': '0.326', 'WEAPON3': '1.100', 'weapon3': '3.114', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.696', 'FRAGCOUNT': '55.000'} [2023-02-25 14:55:24,401][36155] DAMAGECOUNT value on done: 1487482.0 [2023-02-25 14:55:24,402][36155] Sum rewards: 67.616, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.850', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'weapon4': '0.098', 'weapon2': '0.196', 'AMMO3': '0.261', 'WEAPON3': '1.550', 'HITCOUNT': '3.410', 'weapon3': '3.464', 'DAMAGECOUNT': '17.247', 'FRAGCOUNT': '58.000'} [2023-02-25 14:55:24,557][36139] DAMAGECOUNT value on done: 1493950.0 [2023-02-25 14:55:24,558][36139] Sum rewards: 69.184, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.818', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon2': '0.156', 'AMMO4': '0.158', 'AMMO3': '0.159', 'weapon5': '0.198', 'WEAPON5': '0.250', 'weapon4': '0.254', 'WEAPON4': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.208', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '57.000'} [2023-02-25 14:55:24,568][36154] DAMAGECOUNT value on done: 1472121.0 [2023-02-25 14:55:24,568][36154] Sum rewards: 55.904, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.490', 'AMMO5': '0.016', 'AMMO2': '0.057', 'weapon5': '0.140', 'weapon4': '0.190', 'AMMO3': '0.219', 'AMMO4': '0.285', 'weapon2': '0.340', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.046', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.751', 'FRAGCOUNT': '50.000'} [2023-02-25 14:55:24,712][36155] DAMAGECOUNT value on done: 1488785.0 [2023-02-25 14:55:24,713][36155] Sum rewards: 65.592, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.850', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO3': '0.155', 'AMMO4': '0.190', 'weapon5': '0.196', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.494', 'weapon4': '0.548', 'WEAPON3': '0.950', 'weapon3': '2.488', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.299', 'FRAGCOUNT': '54.000'} [2023-02-25 14:55:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 233598976. Throughput: 0: 3407.9. Samples: 20891232. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:55:24,729][36114] Avg episode reward: [(0, '59.257')] [2023-02-25 14:55:24,868][36139] DAMAGECOUNT value on done: 1489833.0 [2023-02-25 14:55:24,868][36139] Sum rewards: 67.476, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.422', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.124', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'weapon4': '0.272', 'WEAPON4': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.150', 'weapon3': '3.068', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '57.000'} [2023-02-25 14:55:24,888][36154] DAMAGECOUNT value on done: 1505449.0 [2023-02-25 14:55:24,888][36154] Sum rewards: 51.803, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.530', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.210', 'weapon4': '0.282', 'weapon2': '0.468', 'WEAPON3': '1.250', 'HITCOUNT': '2.980', 'weapon3': '3.018', 'DAMAGECOUNT': '13.155', 'FRAGCOUNT': '45.000'} [2023-02-25 14:55:25,094][36139] DAMAGECOUNT value on done: 1499646.0 [2023-02-25 14:55:25,094][36138] Updated weights for policy 0, policy_version 57033 (0.0009) [2023-02-25 14:55:25,094][36139] Sum rewards: 61.948, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.210', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.089', 'weapon4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.204', 'weapon2': '0.366', 'WEAPON3': '1.300', 'HITCOUNT': '3.080', 'weapon3': '3.328', 'DAMAGECOUNT': '15.156', 'FRAGCOUNT': '53.000'} [2023-02-25 14:55:25,194][36154] DAMAGECOUNT value on done: 1485925.0 [2023-02-25 14:55:25,194][36154] Sum rewards: 53.326, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.694', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO3': '0.137', 'weapon2': '0.338', 'WEAPON3': '0.850', 'HITCOUNT': '2.650', 'weapon3': '3.608', 'DAMAGECOUNT': '12.447', 'FRAGCOUNT': '43.000'} [2023-02-25 14:55:25,347][36155] DAMAGECOUNT value on done: 1504689.0 [2023-02-25 14:55:25,347][36155] Sum rewards: 61.001, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.646', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.076', 'weapon5': '0.096', 'AMMO3': '0.113', 'AMMO4': '0.127', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.750', 'weapon2': '0.804', 'weapon3': '2.782', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.085', 'FRAGCOUNT': '49.000'} [2023-02-25 14:55:25,413][36139] DAMAGECOUNT value on done: 1499136.0 [2023-02-25 14:55:25,414][36139] Sum rewards: 58.405, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.202', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO3': '0.142', 'AMMO4': '0.193', 'WEAPON5': '0.250', 'weapon5': '0.250', 'weapon2': '0.266', 'WEAPON4': '0.400', 'weapon4': '0.752', 'WEAPON3': '0.900', 'weapon3': '2.498', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.763', 'FRAGCOUNT': '49.000'} [2023-02-25 14:55:25,678][36155] DAMAGECOUNT value on done: 1486014.0 [2023-02-25 14:55:25,678][36155] Sum rewards: 58.764, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.355', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.104', 'AMMO4': '0.114', 'weapon2': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'weapon4': '0.618', 'WEAPON3': '1.300', 'weapon3': '2.738', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.742', 'FRAGCOUNT': '52.000'} [2023-02-25 14:55:26,211][36141] DAMAGECOUNT value on done: 1495181.0 [2023-02-25 14:55:26,212][36141] Sum rewards: 58.193, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.360', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.055', 'AMMO3': '0.159', 'weapon5': '0.258', 'AMMO4': '0.273', 'weapon2': '0.358', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '0.900', 'weapon4': '0.962', 'weapon3': '2.122', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.736', 'FRAGCOUNT': '50.000'} [2023-02-25 14:55:26,488][36141] DAMAGECOUNT value on done: 1486651.0 [2023-02-25 14:55:26,489][36141] Sum rewards: 68.329, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.130', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.126', 'AMMO4': '0.146', 'weapon4': '0.174', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.586', 'WEAPON3': '1.100', 'weapon3': '2.864', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.929', 'FRAGCOUNT': '57.000'} [2023-02-25 14:55:26,529][36141] DAMAGECOUNT value on done: 1497802.0 [2023-02-25 14:55:26,530][36141] Sum rewards: 66.902, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.286', 'ARMOR': '0.004', 'AMMO5': '0.010', 'weapon5': '0.022', 'AMMO2': '0.037', 'weapon4': '0.150', 'AMMO4': '0.183', 'WEAPON5': '0.200', 'weapon2': '0.220', 'AMMO3': '0.237', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.382', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.214', 'FRAGCOUNT': '59.500'} [2023-02-25 14:55:26,801][36141] DAMAGECOUNT value on done: 1472229.0 [2023-02-25 14:55:26,802][36141] Sum rewards: 65.906, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.125', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.096', 'AMMO3': '0.149', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.324', 'weapon2': '0.464', 'WEAPON3': '0.850', 'weapon3': '2.942', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '51.000'} [2023-02-25 14:55:28,104][36138] Updated weights for policy 0, policy_version 57043 (0.0009) [2023-02-25 14:55:29,521][36157] DAMAGECOUNT value on done: 1506194.0 [2023-02-25 14:55:29,522][36157] Sum rewards: 53.871, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.326', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'weapon5': '0.154', 'WEAPON4': '0.250', 'weapon4': '0.388', 'WEAPON3': '0.950', 'weapon2': '0.956', 'weapon3': '2.270', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.016', 'FRAGCOUNT': '44.000'} [2023-02-25 14:55:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 233668608. Throughput: 0: 3403.9. Samples: 20911508. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:55:29,730][36114] Avg episode reward: [(0, '59.677')] [2023-02-25 14:55:29,830][36157] DAMAGECOUNT value on done: 1490636.0 [2023-02-25 14:55:29,830][36157] Sum rewards: 42.051, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.495', 'AMMO5': '0.005', 'AMMO2': '0.035', 'AMMO3': '0.153', 'AMMO4': '0.176', 'weapon2': '0.190', 'weapon5': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.560', 'WEAPON3': '0.950', 'HITCOUNT': '2.510', 'weapon3': '2.918', 'DAMAGECOUNT': '11.502', 'FRAGCOUNT': '36.000'} [2023-02-25 14:55:30,233][36157] DAMAGECOUNT value on done: 1505266.0 [2023-02-25 14:55:30,234][36157] Sum rewards: 49.274, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.970', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.190', 'AMMO3': '0.191', 'weapon2': '0.200', 'AMMO4': '0.233', 'WEAPON5': '0.350', 'WEAPON4': '0.600', 'weapon4': '0.910', 'WEAPON3': '1.200', 'weapon3': '2.342', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '13.725', 'FRAGCOUNT': '44.000'} [2023-02-25 14:55:30,536][36157] DAMAGECOUNT value on done: 1498315.0 [2023-02-25 14:55:30,537][36157] Sum rewards: 55.771, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.750', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.186', 'weapon4': '0.244', 'WEAPON4': '0.300', 'AMMO3': '0.307', 'WEAPON5': '0.350', 'weapon2': '0.496', 'WEAPON3': '1.800', 'weapon3': '2.746', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '53.000'} [2023-02-25 14:55:30,813][36140] DAMAGECOUNT value on done: 1501593.0 [2023-02-25 14:55:30,814][36140] Sum rewards: 62.312, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.799', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.094', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'weapon2': '0.702', 'WEAPON3': '1.000', 'weapon3': '3.044', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.456', 'FRAGCOUNT': '50.000'} [2023-02-25 14:55:31,063][36140] DAMAGECOUNT value on done: 1498720.0 [2023-02-25 14:55:31,064][36140] Sum rewards: 51.334, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.369', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.150', 'weapon5': '0.192', 'AMMO4': '0.210', 'weapon2': '0.236', 'AMMO3': '0.249', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'HITCOUNT': '2.850', 'weapon3': '3.108', 'DAMAGECOUNT': '14.700', 'FRAGCOUNT': '48.000'} [2023-02-25 14:55:31,107][36138] Updated weights for policy 0, policy_version 57053 (0.0009) [2023-02-25 14:55:31,136][36140] DAMAGECOUNT value on done: 1481832.0 [2023-02-25 14:55:31,137][36140] Sum rewards: 61.751, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.252', 'AMMO5': '0.023', 'AMMO2': '0.054', 'AMMO3': '0.179', 'weapon5': '0.236', 'AMMO4': '0.270', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon2': '0.616', 'weapon4': '0.676', 'WEAPON3': '1.100', 'weapon3': '2.162', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '55.000'} [2023-02-25 14:55:31,374][36140] DAMAGECOUNT value on done: 1489104.0 [2023-02-25 14:55:31,375][36140] Sum rewards: 54.376, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.447', 'AMMO5': '0.003', 'weapon5': '0.026', 'AMMO2': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.223', 'AMMO4': '0.230', 'ARMOR': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.524', 'weapon4': '0.712', 'WEAPON3': '1.250', 'weapon3': '2.446', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '14.523', 'FRAGCOUNT': '49.000'} [2023-02-25 14:55:34,135][36138] Updated weights for policy 0, policy_version 57063 (0.0009) [2023-02-25 14:55:34,461][36142] DAMAGECOUNT value on done: 1484307.0 [2023-02-25 14:55:34,462][36142] Sum rewards: 68.500, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.612', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.142', 'AMMO3': '0.181', 'weapon4': '0.236', 'WEAPON3': '1.100', 'HITCOUNT': '3.190', 'weapon3': '3.418', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '56.000'} [2023-02-25 14:55:34,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13551.5). Total num frames: 233734144. Throughput: 0: 3400.9. Samples: 20931908. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:55:34,729][36114] Avg episode reward: [(0, '59.336')] [2023-02-25 14:55:34,773][36142] DAMAGECOUNT value on done: 1478738.0 [2023-02-25 14:55:34,773][36142] Sum rewards: 68.902, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.304', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.182', 'weapon4': '0.312', 'weapon2': '0.328', 'WEAPON3': '1.050', 'weapon3': '3.100', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '55.500'} [2023-02-25 14:55:35,407][36142] DAMAGECOUNT value on done: 1492306.0 [2023-02-25 14:55:35,407][36142] Sum rewards: 66.555, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.204', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.100', 'AMMO4': '0.158', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'weapon2': '0.280', 'weapon4': '0.318', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '2.992', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.765', 'FRAGCOUNT': '59.000'} [2023-02-25 14:55:35,715][36142] DAMAGECOUNT value on done: 1496711.0 [2023-02-25 14:55:35,716][36142] Sum rewards: 52.673, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.034', 'AMMO5': '0.010', 'AMMO2': '0.054', 'weapon5': '0.192', 'weapon2': '0.198', 'AMMO3': '0.244', 'AMMO4': '0.272', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.504', 'WEAPON3': '1.350', 'weapon3': '2.838', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.384', 'FRAGCOUNT': '47.000'} [2023-02-25 14:55:36,017][36156] DAMAGECOUNT value on done: 1508008.0 [2023-02-25 14:55:36,017][36156] Sum rewards: 63.863, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.750', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.066', 'AMMO4': '0.148', 'weapon4': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.238', 'WEAPON3': '1.300', 'HITCOUNT': '3.290', 'weapon3': '3.304', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '54.000'} [2023-02-25 14:55:36,341][36156] DAMAGECOUNT value on done: 1484428.0 [2023-02-25 14:55:36,341][36156] Sum rewards: 60.694, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.840', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.094', 'AMMO3': '0.115', 'WEAPON5': '0.150', 'AMMO4': '0.209', 'WEAPON4': '0.250', 'weapon4': '0.356', 'weapon2': '0.370', 'WEAPON3': '0.700', 'weapon3': '2.746', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '49.000'} [2023-02-25 14:55:36,389][36156] DAMAGECOUNT value on done: 1500943.0 [2023-02-25 14:55:36,390][36156] Sum rewards: 65.372, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.125', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.096', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'weapon4': '0.320', 'weapon2': '0.758', 'WEAPON3': '0.950', 'weapon3': '2.668', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.119', 'FRAGCOUNT': '52.000'} [2023-02-25 14:55:36,698][36156] DAMAGECOUNT value on done: 1491191.0 [2023-02-25 14:55:36,698][36156] Sum rewards: 58.423, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.730', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.053', 'AMMO3': '0.188', 'weapon5': '0.202', 'weapon4': '0.242', 'AMMO4': '0.265', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.472', 'WEAPON3': '1.100', 'weapon3': '2.792', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.113', 'FRAGCOUNT': '49.500'} [2023-02-25 14:55:37,151][36138] Updated weights for policy 0, policy_version 57073 (0.0009) [2023-02-25 14:55:39,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 233803776. Throughput: 0: 3399.6. Samples: 20942092. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:55:39,730][36114] Avg episode reward: [(0, '59.518')] [2023-02-25 14:55:40,163][36138] Updated weights for policy 0, policy_version 57083 (0.0009) [2023-02-25 14:55:43,148][36138] Updated weights for policy 0, policy_version 57093 (0.0009) [2023-02-25 14:55:43,948][36154] DAMAGECOUNT value on done: 1497468.0 [2023-02-25 14:55:43,948][36154] Sum rewards: 58.525, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.958', 'AMMO5': '0.018', 'AMMO2': '0.038', 'AMMO3': '0.160', 'AMMO4': '0.191', 'weapon5': '0.216', 'weapon4': '0.328', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.464', 'WEAPON3': '1.050', 'weapon3': '2.730', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '49.500'} [2023-02-25 14:55:44,188][36155] DAMAGECOUNT value on done: 1492422.0 [2023-02-25 14:55:44,188][36155] Sum rewards: 57.816, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.802', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.108', 'AMMO4': '0.142', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'weapon2': '0.358', 'WEAPON4': '0.400', 'weapon4': '0.424', 'WEAPON3': '1.200', 'weapon3': '2.872', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '14.820', 'FRAGCOUNT': '50.000'} [2023-02-25 14:55:44,236][36139] DAMAGECOUNT value on done: 1499408.0 [2023-02-25 14:55:44,237][36139] Sum rewards: 65.380, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.120', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.112', 'AMMO3': '0.128', 'AMMO4': '0.154', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.268', 'WEAPON3': '0.950', 'weapon2': '0.982', 'weapon3': '2.452', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.374', 'FRAGCOUNT': '52.000'} [2023-02-25 14:55:44,260][36154] DAMAGECOUNT value on done: 1476621.0 [2023-02-25 14:55:44,261][36154] Sum rewards: 56.471, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.926', 'AMMO5': '0.003', 'AMMO2': '0.045', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.177', 'AMMO4': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.000', 'weapon4': '1.030', 'weapon3': '2.292', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '13.500', 'FRAGCOUNT': '48.000'} [2023-02-25 14:55:44,497][36155] DAMAGECOUNT value on done: 1493272.0 [2023-02-25 14:55:44,498][36155] Sum rewards: 54.084, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.150', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.046', 'weapon7': '0.048', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.137', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon2': '0.246', 'WEAPON4': '0.300', 'weapon4': '0.722', 'WEAPON3': '0.800', 'weapon3': '2.594', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '13.461', 'FRAGCOUNT': '44.000'} [2023-02-25 14:55:44,546][36139] DAMAGECOUNT value on done: 1494684.0 [2023-02-25 14:55:44,547][36139] Sum rewards: 58.342, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.470', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.098', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.207', 'weapon2': '0.292', 'weapon4': '0.480', 'WEAPON3': '0.850', 'HITCOUNT': '2.570', 'weapon3': '3.018', 'DAMAGECOUNT': '14.553', 'FRAGCOUNT': '46.000'} [2023-02-25 14:55:44,675][36154] DAMAGECOUNT value on done: 1509790.0 [2023-02-25 14:55:44,675][36154] Sum rewards: 43.436, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-4.398', 'AMMO5': '0.016', 'AMMO2': '0.055', 'AMMO3': '0.267', 'AMMO4': '0.275', 'weapon5': '0.294', 'weapon2': '0.386', 'weapon4': '0.420', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.600', 'weapon3': '2.518', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '13.023', 'FRAGCOUNT': '45.500'} [2023-02-25 14:55:44,729][36114] Fps is (10 sec: 13926.3, 60 sec: 13653.3, 300 sec: 13565.4). Total num frames: 233873408. Throughput: 0: 3395.4. Samples: 20962510. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:55:44,730][36114] Avg episode reward: [(0, '59.354')] [2023-02-25 14:55:44,798][36139] DAMAGECOUNT value on done: 1504538.0 [2023-02-25 14:55:44,799][36139] Sum rewards: 51.908, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.976', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO4': '0.186', 'weapon5': '0.192', 'AMMO3': '0.194', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.442', 'weapon4': '0.514', 'WEAPON3': '1.100', 'weapon3': '2.588', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '45.000'} [2023-02-25 14:55:44,984][36154] DAMAGECOUNT value on done: 1491078.0 [2023-02-25 14:55:44,985][36154] Sum rewards: 58.268, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.350', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.112', 'weapon4': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'weapon5': '0.204', 'WEAPON5': '0.250', 'weapon2': '0.428', 'WEAPON3': '1.350', 'weapon3': '3.006', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.459', 'FRAGCOUNT': '49.000'} [2023-02-25 14:55:45,095][36139] DAMAGECOUNT value on done: 1502940.0 [2023-02-25 14:55:45,096][36139] Sum rewards: 41.816, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.190', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.032', 'weapon7': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.270', 'weapon4': '0.622', 'WEAPON3': '1.150', 'HITCOUNT': '2.280', 'weapon3': '2.314', 'DAMAGECOUNT': '11.412', 'FRAGCOUNT': '38.000'} [2023-02-25 14:55:45,148][36155] DAMAGECOUNT value on done: 1509933.0 [2023-02-25 14:55:45,148][36155] Sum rewards: 55.125, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.788', 'ARMOR': '0.008', 'AMMO5': '0.028', 'AMMO2': '0.079', 'AMMO3': '0.216', 'weapon2': '0.234', 'weapon5': '0.350', 'AMMO4': '0.396', 'weapon4': '0.522', 'WEAPON4': '0.800', 'WEAPON5': '0.800', 'WEAPON3': '1.250', 'weapon3': '2.448', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '51.000'} [2023-02-25 14:55:45,454][36155] DAMAGECOUNT value on done: 1490538.0 [2023-02-25 14:55:45,455][36155] Sum rewards: 51.692, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.950', 'AMMO5': '0.021', 'AMMO2': '0.046', 'weapon5': '0.194', 'AMMO3': '0.227', 'AMMO4': '0.228', 'weapon4': '0.534', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.800', 'WEAPON3': '1.350', 'weapon3': '2.174', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.488', 'FRAGCOUNT': '49.000'} [2023-02-25 14:55:45,536][36154] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:55:46,016][36141] DAMAGECOUNT value on done: 1499460.0 [2023-02-25 14:55:46,017][36141] Sum rewards: 45.181, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.868', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.121', 'AMMO3': '0.174', 'weapon5': '0.202', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.516', 'weapon2': '0.540', 'WEAPON3': '1.050', 'weapon3': '2.490', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.837', 'FRAGCOUNT': '39.000'} [2023-02-25 14:55:46,201][36138] Updated weights for policy 0, policy_version 57103 (0.0010) [2023-02-25 14:55:46,314][36141] DAMAGECOUNT value on done: 1491387.0 [2023-02-25 14:55:46,314][36141] Sum rewards: 53.473, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.926', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.100', 'AMMO4': '0.128', 'weapon4': '0.148', 'weapon2': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.285', 'WEAPON3': '1.650', 'HITCOUNT': '2.680', 'weapon3': '3.340', 'DAMAGECOUNT': '14.208', 'FRAGCOUNT': '49.000'} [2023-02-25 14:55:46,353][36141] DAMAGECOUNT value on done: 1503237.0 [2023-02-25 14:55:46,354][36141] Sum rewards: 65.871, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.136', 'AMMO2': '0.004', 'AMMO4': '0.017', 'WEAPON4': '0.050', 'weapon4': '0.138', 'AMMO3': '0.221', 'weapon2': '0.264', 'WEAPON3': '1.350', 'weapon3': '3.438', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '56.000'} [2023-02-25 14:55:46,638][36141] DAMAGECOUNT value on done: 1477342.0 [2023-02-25 14:55:46,639][36141] Sum rewards: 53.382, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.247', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.108', 'weapon4': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'AMMO4': '0.230', 'WEAPON4': '0.350', 'weapon2': '0.542', 'WEAPON3': '1.100', 'HITCOUNT': '2.940', 'weapon3': '3.026', 'DAMAGECOUNT': '15.339', 'FRAGCOUNT': '45.500'} [2023-02-25 14:55:49,241][36138] Updated weights for policy 0, policy_version 57113 (0.0009) [2023-02-25 14:55:49,428][36157] DAMAGECOUNT value on done: 1511695.0 [2023-02-25 14:55:49,428][36157] Sum rewards: 57.856, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.810', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.142', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.280', 'weapon4': '0.284', 'weapon2': '0.324', 'WEAPON3': '1.600', 'weapon3': '2.944', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.089', 'FRAGCOUNT': '52.000'} [2023-02-25 14:55:49,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 233938944. Throughput: 0: 3390.1. Samples: 20982596. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:55:49,730][36114] Avg episode reward: [(0, '58.786')] [2023-02-25 14:55:49,741][36157] DAMAGECOUNT value on done: 1496126.0 [2023-02-25 14:55:49,742][36157] Sum rewards: 66.297, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.711', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.068', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'weapon2': '0.156', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'weapon4': '0.578', 'WEAPON3': '1.100', 'weapon3': '2.766', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '56.000'} [2023-02-25 14:55:50,190][36157] DAMAGECOUNT value on done: 1510776.0 [2023-02-25 14:55:50,190][36157] Sum rewards: 69.748, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.320', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.016', 'weapon5': '0.030', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.216', 'weapon2': '0.536', 'WEAPON3': '1.350', 'weapon3': '3.256', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '59.000'} [2023-02-25 14:55:50,501][36157] DAMAGECOUNT value on done: 1503196.0 [2023-02-25 14:55:50,501][36157] Sum rewards: 59.014, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.120', 'AMMO5': '0.014', 'AMMO2': '0.028', 'weapon5': '0.118', 'AMMO4': '0.141', 'AMMO3': '0.234', 'weapon4': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.400', 'HITCOUNT': '2.980', 'weapon3': '3.014', 'DAMAGECOUNT': '14.643', 'FRAGCOUNT': '54.000'} [2023-02-25 14:55:50,673][36140] DAMAGECOUNT value on done: 1506539.0 [2023-02-25 14:55:50,674][36140] Sum rewards: 60.116, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.409', 'ARMOR': '0.004', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.044', 'weapon5': '0.126', 'AMMO3': '0.153', 'AMMO4': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.514', 'weapon4': '0.608', 'WEAPON3': '0.950', 'weapon3': '2.430', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.838', 'FRAGCOUNT': '52.000'} [2023-02-25 14:55:50,917][36140] DAMAGECOUNT value on done: 1504350.0 [2023-02-25 14:55:50,918][36140] Sum rewards: 68.784, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.775', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.100', 'AMMO4': '0.142', 'weapon5': '0.168', 'AMMO3': '0.194', 'weapon2': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.020', 'weapon3': '3.236', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '59.000'} [2023-02-25 14:55:50,979][36140] DAMAGECOUNT value on done: 1487307.0 [2023-02-25 14:55:50,979][36140] Sum rewards: 63.551, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.988', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon5': '0.192', 'AMMO3': '0.224', 'weapon4': '0.226', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '2.846', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '57.000'} [2023-02-25 14:55:51,220][36140] DAMAGECOUNT value on done: 1493923.0 [2023-02-25 14:55:51,220][36140] Sum rewards: 53.511, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.197', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO3': '0.161', 'AMMO4': '0.194', 'weapon5': '0.202', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.448', 'weapon2': '0.518', 'WEAPON3': '1.000', 'weapon3': '2.594', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.457', 'FRAGCOUNT': '46.000'} [2023-02-25 14:55:52,319][36138] Updated weights for policy 0, policy_version 57123 (0.0010) [2023-02-25 14:55:54,434][36142] DAMAGECOUNT value on done: 1489286.0 [2023-02-25 14:55:54,435][36142] Sum rewards: 51.770, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-2.460', 'AMMO5': '0.023', 'AMMO2': '0.069', 'weapon4': '0.212', 'AMMO3': '0.279', 'weapon2': '0.294', 'AMMO4': '0.345', 'weapon5': '0.358', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.742', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.937', 'FRAGCOUNT': '50.500'} [2023-02-25 14:55:54,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13516.8, 300 sec: 13551.5). Total num frames: 234004480. Throughput: 0: 3386.1. Samples: 20992646. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:55:54,729][36114] Avg episode reward: [(0, '59.030')] [2023-02-25 14:55:54,746][36142] DAMAGECOUNT value on done: 1483251.0 [2023-02-25 14:55:54,747][36142] Sum rewards: 53.564, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.380', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon5': '0.050', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon2': '0.364', 'weapon4': '0.404', 'WEAPON3': '1.300', 'weapon3': '2.974', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.539', 'FRAGCOUNT': '46.500'} [2023-02-25 14:55:55,304][36142] DAMAGECOUNT value on done: 1497480.0 [2023-02-25 14:55:55,304][36142] Sum rewards: 61.322, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.241', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.112', 'AMMO3': '0.129', 'weapon5': '0.140', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.384', 'WEAPON3': '0.750', 'weapon4': '0.880', 'weapon3': '2.262', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.522', 'FRAGCOUNT': '47.000'} [2023-02-25 14:55:55,336][36138] Updated weights for policy 0, policy_version 57133 (0.0009) [2023-02-25 14:55:55,610][36142] DAMAGECOUNT value on done: 1502288.0 [2023-02-25 14:55:55,610][36142] Sum rewards: 65.720, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.635', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon5': '0.074', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.160', 'AMMO3': '0.242', 'weapon2': '0.396', 'WEAPON3': '1.500', 'weapon3': '3.150', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '58.000'} [2023-02-25 14:55:55,794][36156] DAMAGECOUNT value on done: 1512794.0 [2023-02-25 14:55:55,794][36156] Sum rewards: 55.384, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.270', 'AMMO5': '0.014', 'AMMO2': '0.046', 'AMMO3': '0.164', 'weapon5': '0.192', 'AMMO4': '0.229', 'WEAPON5': '0.300', 'weapon2': '0.324', 'ARMOR': '0.465', 'WEAPON4': '0.550', 'weapon4': '0.704', 'WEAPON3': '1.050', 'weapon3': '2.498', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.358', 'FRAGCOUNT': '48.000'} [2023-02-25 14:55:56,108][36156] DAMAGECOUNT value on done: 1489680.0 [2023-02-25 14:55:56,108][36156] Sum rewards: 58.588, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.880', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO3': '0.153', 'AMMO4': '0.165', 'weapon5': '0.202', 'weapon2': '0.288', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.852', 'WEAPON3': '0.900', 'weapon3': '2.416', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '49.000'} [2023-02-25 14:55:56,236][36156] DAMAGECOUNT value on done: 1506432.0 [2023-02-25 14:55:56,237][36156] Sum rewards: 70.315, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.444', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.018', 'weapon5': '0.046', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.218', 'weapon2': '0.454', 'WEAPON3': '1.350', 'weapon3': '3.304', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '60.000'} [2023-02-25 14:55:56,540][36156] DAMAGECOUNT value on done: 1495591.0 [2023-02-25 14:55:56,541][36156] Sum rewards: 52.918, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.372', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'weapon4': '0.148', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'weapon2': '0.824', 'WEAPON3': '0.950', 'weapon3': '2.900', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.200', 'FRAGCOUNT': '43.000'} [2023-02-25 14:55:58,338][36138] Updated weights for policy 0, policy_version 57143 (0.0009) [2023-02-25 14:55:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 234074112. Throughput: 0: 3385.7. Samples: 21013076. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:55:59,730][36114] Avg episode reward: [(0, '58.623')] [2023-02-25 14:56:01,351][36138] Updated weights for policy 0, policy_version 57153 (0.0009) [2023-02-25 14:56:03,923][36154] DAMAGECOUNT value on done: 1502647.0 [2023-02-25 14:56:03,924][36154] Sum rewards: 61.322, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.040', 'AMMO5': '0.016', 'AMMO2': '0.067', 'weapon5': '0.178', 'AMMO3': '0.189', 'weapon2': '0.206', 'AMMO4': '0.335', 'WEAPON5': '0.500', 'weapon4': '0.660', 'WEAPON4': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.696', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.144', 'FRAGCOUNT': '56.000'} [2023-02-25 14:56:03,930][36155] DAMAGECOUNT value on done: 1497106.0 [2023-02-25 14:56:03,930][36155] Sum rewards: 45.504, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.862', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon5': '0.152', 'AMMO3': '0.197', 'AMMO4': '0.257', 'weapon2': '0.312', 'WEAPON5': '0.350', 'WEAPON4': '0.750', 'WEAPON3': '1.050', 'weapon4': '1.156', 'weapon3': '1.908', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.052', 'FRAGCOUNT': '42.000'} [2023-02-25 14:56:04,026][36139] DAMAGECOUNT value on done: 1504595.0 [2023-02-25 14:56:04,027][36139] Sum rewards: 64.646, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.245', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.048', 'weapon4': '0.070', 'AMMO4': '0.132', 'AMMO3': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.302', 'WEAPON3': '1.050', 'HITCOUNT': '3.220', 'weapon3': '3.426', 'DAMAGECOUNT': '15.561', 'FRAGCOUNT': '53.000'} [2023-02-25 14:56:04,238][36154] DAMAGECOUNT value on done: 1482685.0 [2023-02-25 14:56:04,238][36154] Sum rewards: 68.493, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.666', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.168', 'AMMO3': '0.175', 'weapon5': '0.176', 'weapon2': '0.202', 'weapon4': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.156', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '56.000'} [2023-02-25 14:56:04,251][36155] DAMAGECOUNT value on done: 1496824.0 [2023-02-25 14:56:04,251][36155] Sum rewards: 34.132, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.632', 'AMMO5': '0.016', 'AMMO2': '0.058', 'AMMO3': '0.187', 'weapon5': '0.188', 'AMMO4': '0.292', 'ARMOR': '0.471', 'WEAPON5': '0.500', 'weapon2': '0.534', 'WEAPON4': '0.750', 'WEAPON3': '1.000', 'weapon4': '1.082', 'weapon3': '1.720', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '10.656', 'FRAGCOUNT': '34.000'} [2023-02-25 14:56:04,338][36139] DAMAGECOUNT value on done: 1500222.0 [2023-02-25 14:56:04,338][36139] Sum rewards: 63.290, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.767', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.186', 'AMMO4': '0.197', 'AMMO3': '0.209', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON4': '0.350', 'weapon4': '0.494', 'WEAPON3': '1.300', 'weapon3': '2.696', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '55.000'} [2023-02-25 14:56:04,399][36138] Updated weights for policy 0, policy_version 57163 (0.0009) [2023-02-25 14:56:04,572][36139] DAMAGECOUNT value on done: 1509109.0 [2023-02-25 14:56:04,573][36139] Sum rewards: 49.626, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.174', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.048', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.149', 'AMMO4': '0.241', 'WEAPON4': '0.500', 'weapon4': '0.562', 'weapon2': '0.724', 'WEAPON3': '0.950', 'weapon3': '2.368', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.713', 'FRAGCOUNT': '42.000'} [2023-02-25 14:56:04,601][36154] DAMAGECOUNT value on done: 1515718.0 [2023-02-25 14:56:04,601][36154] Sum rewards: 70.224, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.557', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.029', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'weapon2': '0.206', 'AMMO3': '0.234', 'WEAPON4': '0.400', 'weapon4': '0.486', 'WEAPON3': '1.550', 'weapon3': '3.030', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '62.000'} [2023-02-25 14:56:04,729][36114] Fps is (10 sec: 13926.5, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 234143744. Throughput: 0: 3385.2. Samples: 21033446. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:56:04,729][36114] Avg episode reward: [(0, '58.469')] [2023-02-25 14:56:04,871][36139] DAMAGECOUNT value on done: 1507876.0 [2023-02-25 14:56:04,871][36139] Sum rewards: 56.269, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.026', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.168', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.346', 'weapon2': '0.714', 'WEAPON3': '1.100', 'weapon3': '2.542', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.808', 'FRAGCOUNT': '48.000'} [2023-02-25 14:56:04,907][36154] DAMAGECOUNT value on done: 1496286.0 [2023-02-25 14:56:04,908][36154] Sum rewards: 65.657, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.640', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.092', 'AMMO4': '0.093', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon4': '0.432', 'weapon2': '0.504', 'WEAPON3': '1.300', 'weapon3': '2.784', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.624', 'FRAGCOUNT': '57.000'} [2023-02-25 14:56:04,915][36155] DAMAGECOUNT value on done: 1515211.0 [2023-02-25 14:56:04,916][36155] Sum rewards: 58.244, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.316', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon5': '0.056', 'AMMO4': '0.129', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON4': '0.350', 'weapon4': '0.512', 'WEAPON3': '1.350', 'weapon3': '2.914', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.834', 'FRAGCOUNT': '51.000'} [2023-02-25 14:56:05,227][36155] DAMAGECOUNT value on done: 1496529.0 [2023-02-25 14:56:05,227][36155] Sum rewards: 69.794, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.535', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon5': '0.156', 'AMMO3': '0.207', 'AMMO4': '0.267', 'weapon4': '0.306', 'weapon2': '0.322', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.894', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '60.000'} [2023-02-25 14:56:06,008][36141] DAMAGECOUNT value on done: 1504301.0 [2023-02-25 14:56:06,009][36141] Sum rewards: 45.667, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-3.656', 'AMMO5': '0.010', 'AMMO2': '0.054', 'weapon5': '0.176', 'weapon2': '0.246', 'WEAPON5': '0.250', 'AMMO4': '0.272', 'AMMO3': '0.314', 'weapon4': '0.430', 'WEAPON4': '0.450', 'WEAPON3': '1.800', 'weapon3': '2.778', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.523', 'FRAGCOUNT': '46.000'} [2023-02-25 14:56:06,268][36141] DAMAGECOUNT value on done: 1496966.0 [2023-02-25 14:56:06,269][36141] Sum rewards: 66.020, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.330', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'weapon4': '0.138', 'weapon2': '0.182', 'AMMO3': '0.217', 'WEAPON3': '1.350', 'HITCOUNT': '3.300', 'weapon3': '3.434', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '56.000'} [2023-02-25 14:56:06,304][36141] DAMAGECOUNT value on done: 1508939.0 [2023-02-25 14:56:06,304][36141] Sum rewards: 66.685, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.323', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.080', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'weapon4': '0.302', 'weapon2': '0.454', 'WEAPON3': '1.450', 'weapon3': '2.832', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '59.000'} [2023-02-25 14:56:06,578][36141] DAMAGECOUNT value on done: 1482935.0 [2023-02-25 14:56:06,578][36141] Sum rewards: 65.548, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.282', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO4': '0.161', 'weapon5': '0.170', 'AMMO3': '0.198', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.306', 'weapon2': '0.408', 'WEAPON3': '1.200', 'weapon3': '2.870', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '56.000'} [2023-02-25 14:56:07,402][36138] Updated weights for policy 0, policy_version 57173 (0.0009) [2023-02-25 14:56:09,309][36157] DAMAGECOUNT value on done: 1516785.0 [2023-02-25 14:56:09,309][36157] Sum rewards: 62.223, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.689', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon5': '0.114', 'AMMO4': '0.120', 'AMMO3': '0.171', 'WEAPON5': '0.250', 'weapon4': '0.342', 'WEAPON4': '0.350', 'weapon2': '0.388', 'WEAPON3': '1.050', 'weapon3': '2.950', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '53.000'} [2023-02-25 14:56:09,614][36157] DAMAGECOUNT value on done: 1502094.0 [2023-02-25 14:56:09,614][36157] Sum rewards: 63.160, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.726', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon5': '0.186', 'AMMO3': '0.251', 'weapon4': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.450', 'weapon3': '2.886', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '55.500'} [2023-02-25 14:56:09,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13565.4). Total num frames: 234209280. Throughput: 0: 3385.3. Samples: 21043570. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:56:09,730][36114] Avg episode reward: [(0, '58.650')] [2023-02-25 14:56:10,034][36157] DAMAGECOUNT value on done: 1516170.0 [2023-02-25 14:56:10,035][36157] Sum rewards: 64.679, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.851', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.190', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.412', 'weapon4': '0.582', 'WEAPON3': '1.350', 'weapon3': '2.540', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '57.000'} [2023-02-25 14:56:10,341][36157] DAMAGECOUNT value on done: 1507833.0 [2023-02-25 14:56:10,341][36157] Sum rewards: 54.098, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.400', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.180', 'AMMO3': '0.197', 'WEAPON4': '0.350', 'weapon2': '0.384', 'weapon4': '0.868', 'WEAPON3': '1.150', 'weapon3': '2.230', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '13.911', 'FRAGCOUNT': '48.000'} [2023-02-25 14:56:10,437][36140] DAMAGECOUNT value on done: 1512131.0 [2023-02-25 14:56:10,437][36140] Sum rewards: 61.898, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.178', 'AMMO5': '0.017', 'AMMO2': '0.042', 'AMMO3': '0.190', 'AMMO4': '0.207', 'weapon5': '0.220', 'weapon2': '0.236', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.592', 'WEAPON3': '1.150', 'weapon3': '2.576', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '55.000'} [2023-02-25 14:56:10,470][36138] Updated weights for policy 0, policy_version 57183 (0.0008) [2023-02-25 14:56:10,678][36140] DAMAGECOUNT value on done: 1509307.0 [2023-02-25 14:56:10,679][36140] Sum rewards: 54.501, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.780', 'AMMO5': '0.015', 'AMMO2': '0.050', 'AMMO3': '0.146', 'weapon5': '0.180', 'AMMO4': '0.249', 'weapon2': '0.358', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.704', 'WEAPON3': '0.900', 'weapon3': '2.548', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '14.871', 'FRAGCOUNT': '46.000'} [2023-02-25 14:56:10,751][36140] DAMAGECOUNT value on done: 1492639.0 [2023-02-25 14:56:10,751][36140] Sum rewards: 58.347, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.110', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.097', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon4': '0.300', 'weapon2': '0.380', 'WEAPON3': '1.350', 'weapon3': '3.070', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '51.000'} [2023-02-25 14:56:10,984][36140] DAMAGECOUNT value on done: 1499012.0 [2023-02-25 14:56:10,985][36140] Sum rewards: 50.831, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.846', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon5': '0.198', 'WEAPON5': '0.200', 'weapon4': '0.200', 'AMMO3': '0.266', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.006', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.267', 'FRAGCOUNT': '47.000'} [2023-02-25 14:56:13,477][36138] Updated weights for policy 0, policy_version 57193 (0.0009) [2023-02-25 14:56:14,354][36142] DAMAGECOUNT value on done: 1495369.0 [2023-02-25 14:56:14,354][36142] Sum rewards: 73.956, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.477', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.138', 'AMMO3': '0.149', 'weapon2': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.616', 'WEAPON3': '0.950', 'weapon3': '2.786', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '18.249', 'FRAGCOUNT': '61.000'} [2023-02-25 14:56:14,653][36142] DAMAGECOUNT value on done: 1488904.0 [2023-02-25 14:56:14,653][36142] Sum rewards: 60.522, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.210', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.170', 'AMMO3': '0.177', 'AMMO4': '0.228', 'weapon2': '0.284', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.654', 'WEAPON3': '1.100', 'weapon3': '2.674', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '50.500'} [2023-02-25 14:56:14,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 234278912. Throughput: 0: 3387.7. Samples: 21063956. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:56:14,730][36114] Avg episode reward: [(0, '58.988')] [2023-02-25 14:56:15,219][36142] DAMAGECOUNT value on done: 1502436.0 [2023-02-25 14:56:15,220][36142] Sum rewards: 58.311, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.451', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'weapon5': '0.158', 'weapon4': '0.164', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.490', 'WEAPON3': '1.250', 'weapon3': '2.946', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.868', 'FRAGCOUNT': '51.000'} [2023-02-25 14:56:15,247][36154] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:56:15,498][36142] DAMAGECOUNT value on done: 1506679.0 [2023-02-25 14:56:15,499][36142] Sum rewards: 54.812, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.460', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.100', 'weapon5': '0.124', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon2': '0.584', 'WEAPON3': '1.200', 'HITCOUNT': '2.600', 'weapon3': '2.966', 'DAMAGECOUNT': '13.173', 'FRAGCOUNT': '49.000'} [2023-02-25 14:56:15,670][36156] DAMAGECOUNT value on done: 1517860.0 [2023-02-25 14:56:15,670][36156] Sum rewards: 64.130, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.580', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.271', 'weapon2': '0.282', 'WEAPON3': '1.600', 'HITCOUNT': '3.320', 'weapon3': '3.442', 'DAMAGECOUNT': '15.198', 'FRAGCOUNT': '58.000'} [2023-02-25 14:56:15,978][36156] DAMAGECOUNT value on done: 1495553.0 [2023-02-25 14:56:15,978][36156] Sum rewards: 66.447, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.814', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon5': '0.186', 'weapon2': '0.210', 'AMMO3': '0.211', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.468', 'WEAPON3': '1.150', 'weapon3': '2.826', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '56.000'} [2023-02-25 14:56:16,127][36156] DAMAGECOUNT value on done: 1512010.0 [2023-02-25 14:56:16,127][36156] Sum rewards: 64.071, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.032', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.160', 'AMMO3': '0.194', 'weapon5': '0.202', 'weapon2': '0.296', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.584', 'WEAPON3': '1.200', 'weapon3': '2.434', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.734', 'FRAGCOUNT': '56.000'} [2023-02-25 14:56:16,428][36156] DAMAGECOUNT value on done: 1500786.0 [2023-02-25 14:56:16,428][36156] Sum rewards: 68.689, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.260', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.102', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.420', 'weapon4': '0.774', 'WEAPON3': '1.100', 'weapon3': '2.466', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '59.000'} [2023-02-25 14:56:16,492][36138] Updated weights for policy 0, policy_version 57203 (0.0009) [2023-02-25 14:56:19,475][36138] Updated weights for policy 0, policy_version 57213 (0.0008) [2023-02-25 14:56:19,729][36114] Fps is (10 sec: 13516.6, 60 sec: 13516.8, 300 sec: 13551.5). Total num frames: 234344448. Throughput: 0: 3386.7. Samples: 21084312. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:56:19,730][36114] Avg episode reward: [(0, '59.422')] [2023-02-25 14:56:22,527][36138] Updated weights for policy 0, policy_version 57223 (0.0010) [2023-02-25 14:56:23,716][36139] DAMAGECOUNT value on done: 1508661.0 [2023-02-25 14:56:23,716][36139] Sum rewards: 49.212, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.105', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.173', 'WEAPON4': '0.250', 'weapon4': '0.300', 'weapon2': '0.560', 'WEAPON3': '1.050', 'HITCOUNT': '2.530', 'weapon3': '2.962', 'DAMAGECOUNT': '12.198', 'FRAGCOUNT': '43.000'} [2023-02-25 14:56:23,808][36155] DAMAGECOUNT value on done: 1501638.0 [2023-02-25 14:56:23,809][36155] Sum rewards: 54.023, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.785', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.150', 'AMMO3': '0.168', 'weapon2': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.668', 'WEAPON3': '1.000', 'weapon3': '2.486', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '13.596', 'FRAGCOUNT': '46.000'} [2023-02-25 14:56:23,863][36154] DAMAGECOUNT value on done: 1508673.0 [2023-02-25 14:56:23,863][36154] Sum rewards: 67.326, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.170', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.108', 'weapon2': '0.160', 'AMMO4': '0.190', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.084', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.078', 'FRAGCOUNT': '58.000'} [2023-02-25 14:56:24,019][36139] DAMAGECOUNT value on done: 1505123.0 [2023-02-25 14:56:24,020][36139] Sum rewards: 53.628, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.450', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.074', 'AMMO4': '0.181', 'WEAPON5': '0.250', 'AMMO3': '0.275', 'weapon2': '0.280', 'WEAPON4': '0.450', 'weapon4': '0.850', 'WEAPON3': '1.550', 'weapon3': '2.406', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '14.703', 'FRAGCOUNT': '52.000'} [2023-02-25 14:56:24,111][36155] DAMAGECOUNT value on done: 1501833.0 [2023-02-25 14:56:24,112][36155] Sum rewards: 62.284, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.220', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.024', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.202', 'AMMO3': '0.215', 'weapon4': '0.424', 'WEAPON3': '1.250', 'weapon3': '3.062', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.027', 'FRAGCOUNT': '54.000'} [2023-02-25 14:56:24,177][36154] DAMAGECOUNT value on done: 1487540.0 [2023-02-25 14:56:24,177][36154] Sum rewards: 58.955, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.320', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.040', 'weapon5': '0.062', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'weapon2': '0.440', 'WEAPON3': '1.200', 'HITCOUNT': '2.960', 'weapon3': '3.278', 'DAMAGECOUNT': '14.565', 'FRAGCOUNT': '50.000'} [2023-02-25 14:56:24,264][36139] DAMAGECOUNT value on done: 1514361.0 [2023-02-25 14:56:24,264][36139] Sum rewards: 56.755, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.654', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon5': '0.186', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.394', 'weapon2': '0.408', 'WEAPON3': '1.350', 'weapon3': '2.624', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '51.000'} [2023-02-25 14:56:24,516][36154] DAMAGECOUNT value on done: 1521246.0 [2023-02-25 14:56:24,517][36154] Sum rewards: 66.867, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.995', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.100', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.478', 'weapon2': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.582', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '59.000'} [2023-02-25 14:56:24,576][36139] DAMAGECOUNT value on done: 1513326.0 [2023-02-25 14:56:24,577][36139] Sum rewards: 62.067, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.992', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.058', 'weapon5': '0.084', 'AMMO4': '0.125', 'weapon2': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '2.950', 'weapon3': '3.432', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '55.000'} [2023-02-25 14:56:24,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 234414080. Throughput: 0: 3384.6. Samples: 21094400. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:56:24,729][36114] Avg episode reward: [(0, '59.099')] [2023-02-25 14:56:24,765][36155] DAMAGECOUNT value on done: 1519968.0 [2023-02-25 14:56:24,766][36155] Sum rewards: 53.881, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-0.320', 'AMMO5': '0.020', 'AMMO2': '0.072', 'AMMO3': '0.198', 'weapon2': '0.264', 'weapon5': '0.304', 'AMMO4': '0.362', 'ARMOR': '0.404', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '1.100', 'weapon4': '1.166', 'weapon3': '1.870', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '14.271', 'FRAGCOUNT': '49.000'} [2023-02-25 14:56:24,821][36154] DAMAGECOUNT value on done: 1501800.0 [2023-02-25 14:56:24,821][36154] Sum rewards: 62.095, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.070', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.148', 'WEAPON5': '0.150', 'weapon4': '0.226', 'WEAPON4': '0.250', 'weapon2': '0.266', 'AMMO3': '0.292', 'WEAPON3': '1.700', 'weapon3': '3.054', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.542', 'FRAGCOUNT': '57.000'} [2023-02-25 14:56:25,066][36155] DAMAGECOUNT value on done: 1502555.0 [2023-02-25 14:56:25,066][36155] Sum rewards: 71.483, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.780', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.136', 'weapon4': '0.182', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.598', 'WEAPON3': '1.050', 'weapon3': '2.868', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.078', 'FRAGCOUNT': '60.000'} [2023-02-25 14:56:25,553][36138] Updated weights for policy 0, policy_version 57233 (0.0010) [2023-02-25 14:56:25,831][36141] DAMAGECOUNT value on done: 1509120.0 [2023-02-25 14:56:25,831][36141] Sum rewards: 50.803, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.250', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon4': '0.286', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '2.914', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.457', 'FRAGCOUNT': '47.000'} [2023-02-25 14:56:26,103][36141] DAMAGECOUNT value on done: 1502347.0 [2023-02-25 14:56:26,103][36141] Sum rewards: 64.706, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.382', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.052', 'weapon5': '0.084', 'WEAPON5': '0.150', 'weapon2': '0.198', 'AMMO3': '0.216', 'AMMO4': '0.261', 'WEAPON4': '0.400', 'weapon4': '0.544', 'WEAPON3': '1.300', 'weapon3': '2.970', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.143', 'FRAGCOUNT': '57.000'} [2023-02-25 14:56:26,149][36141] DAMAGECOUNT value on done: 1514684.0 [2023-02-25 14:56:26,150][36141] Sum rewards: 65.222, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.455', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO3': '0.142', 'AMMO4': '0.170', 'weapon5': '0.216', 'weapon2': '0.242', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.708', 'WEAPON3': '0.850', 'weapon3': '2.588', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '54.000'} [2023-02-25 14:56:26,408][36141] DAMAGECOUNT value on done: 1487708.0 [2023-02-25 14:56:26,408][36141] Sum rewards: 59.649, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.865', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.094', 'AMMO4': '0.160', 'AMMO3': '0.183', 'weapon4': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.100', 'HITCOUNT': '2.950', 'weapon3': '3.060', 'DAMAGECOUNT': '14.319', 'FRAGCOUNT': '52.000'} [2023-02-25 14:56:28,557][36138] Updated weights for policy 0, policy_version 57243 (0.0009) [2023-02-25 14:56:29,027][36157] DAMAGECOUNT value on done: 1521590.0 [2023-02-25 14:56:29,027][36157] Sum rewards: 55.909, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.352', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.102', 'AMMO3': '0.165', 'weapon2': '0.214', 'AMMO4': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon4': '0.554', 'WEAPON3': '1.000', 'weapon3': '2.828', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.415', 'FRAGCOUNT': '48.000'} [2023-02-25 14:56:29,335][36157] DAMAGECOUNT value on done: 1506987.0 [2023-02-25 14:56:29,335][36157] Sum rewards: 56.511, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.228', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.088', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'weapon2': '0.238', 'WEAPON4': '0.300', 'weapon4': '0.886', 'WEAPON3': '1.300', 'weapon3': '2.566', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.679', 'FRAGCOUNT': '50.000'} [2023-02-25 14:56:29,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13551.5). Total num frames: 234479616. Throughput: 0: 3383.9. Samples: 21114784. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:56:29,730][36114] Avg episode reward: [(0, '59.109')] [2023-02-25 14:56:29,807][36157] DAMAGECOUNT value on done: 1521139.0 [2023-02-25 14:56:29,807][36157] Sum rewards: 53.337, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.610', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.252', 'weapon4': '0.354', 'weapon2': '0.554', 'WEAPON3': '1.500', 'weapon3': '2.724', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.877', 'FRAGCOUNT': '48.000'} [2023-02-25 14:56:30,116][36157] DAMAGECOUNT value on done: 1513016.0 [2023-02-25 14:56:30,116][36157] Sum rewards: 57.331, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.679', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.156', 'weapon2': '0.196', 'AMMO3': '0.244', 'AMMO4': '0.251', 'WEAPON5': '0.300', 'WEAPON4': '0.550', 'weapon4': '0.728', 'WEAPON3': '1.400', 'weapon3': '2.592', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.549', 'FRAGCOUNT': '52.000'} [2023-02-25 14:56:30,262][36140] DAMAGECOUNT value on done: 1517846.0 [2023-02-25 14:56:30,263][36140] Sum rewards: 70.588, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.320', 'AMMO2': '0.027', 'WEAPON4': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.205', 'weapon2': '0.296', 'weapon4': '0.388', 'WEAPON3': '1.150', 'weapon3': '3.054', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '59.000'} [2023-02-25 14:56:30,522][36140] DAMAGECOUNT value on done: 1514219.0 [2023-02-25 14:56:30,523][36140] Sum rewards: 48.523, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.090', 'AMMO5': '0.006', 'AMMO2': '0.037', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO4': '0.186', 'AMMO3': '0.265', 'weapon2': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.460', 'WEAPON3': '1.600', 'weapon3': '2.922', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.736', 'FRAGCOUNT': '47.000'} [2023-02-25 14:56:30,569][36140] DAMAGECOUNT value on done: 1497620.0 [2023-02-25 14:56:30,569][36140] Sum rewards: 63.188, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.078', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.090', 'AMMO3': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.196', 'WEAPON3': '0.850', 'weapon2': '0.990', 'weapon3': '2.594', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.943', 'FRAGCOUNT': '50.000'} [2023-02-25 14:56:30,838][36140] DAMAGECOUNT value on done: 1504768.0 [2023-02-25 14:56:30,839][36140] Sum rewards: 62.834, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.206', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.114', 'AMMO4': '0.178', 'weapon4': '0.242', 'WEAPON5': '0.250', 'AMMO3': '0.274', 'WEAPON4': '0.350', 'weapon2': '0.538', 'WEAPON3': '1.600', 'weapon3': '2.808', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '57.000'} [2023-02-25 14:56:31,533][36138] Updated weights for policy 0, policy_version 57253 (0.0009) [2023-02-25 14:56:34,135][36142] DAMAGECOUNT value on done: 1500452.0 [2023-02-25 14:56:34,135][36142] Sum rewards: 66.035, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.530', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.126', 'AMMO3': '0.139', 'AMMO4': '0.141', 'WEAPON5': '0.200', 'weapon2': '0.286', 'WEAPON4': '0.300', 'weapon4': '0.682', 'WEAPON3': '0.900', 'weapon3': '2.712', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.249', 'FRAGCOUNT': '55.000'} [2023-02-25 14:56:34,436][36142] DAMAGECOUNT value on done: 1494343.0 [2023-02-25 14:56:34,437][36142] Sum rewards: 63.748, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.067', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon4': '0.066', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.282', 'AMMO3': '0.302', 'WEAPON3': '1.800', 'weapon3': '3.262', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '59.000'} [2023-02-25 14:56:34,497][36138] Updated weights for policy 0, policy_version 57263 (0.0009) [2023-02-25 14:56:34,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13585.0, 300 sec: 13565.4). Total num frames: 234549248. Throughput: 0: 3393.9. Samples: 21135320. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:56:34,730][36114] Avg episode reward: [(0, '59.491')] [2023-02-25 14:56:35,015][36142] DAMAGECOUNT value on done: 1507457.0 [2023-02-25 14:56:35,016][36142] Sum rewards: 56.530, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.440', 'AMMO5': '0.005', 'AMMO2': '0.045', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'AMMO4': '0.223', 'WEAPON4': '0.350', 'weapon2': '0.458', 'weapon4': '0.462', 'WEAPON3': '1.000', 'weapon3': '2.810', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.964', 'FRAGCOUNT': '48.000'} [2023-02-25 14:56:35,321][36142] DAMAGECOUNT value on done: 1512698.0 [2023-02-25 14:56:35,322][36142] Sum rewards: 71.361, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.780', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.058', 'AMMO3': '0.170', 'weapon5': '0.272', 'AMMO4': '0.289', 'weapon2': '0.314', 'weapon4': '0.524', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.520', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '60.000'} [2023-02-25 14:56:35,431][36156] DAMAGECOUNT value on done: 1523317.0 [2023-02-25 14:56:35,431][36156] Sum rewards: 65.806, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.235', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.070', 'AMMO3': '0.162', 'AMMO4': '0.191', 'weapon2': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.358', 'WEAPON3': '1.000', 'weapon3': '3.140', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.795', 'FRAGCOUNT': '56.000'} [2023-02-25 14:56:35,731][36156] DAMAGECOUNT value on done: 1501211.0 [2023-02-25 14:56:35,732][36156] Sum rewards: 61.302, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.758', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.044', 'AMMO3': '0.165', 'AMMO4': '0.222', 'weapon2': '0.272', 'weapon5': '0.306', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.880', 'WEAPON3': '1.050', 'weapon3': '2.246', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.974', 'FRAGCOUNT': '51.000'} [2023-02-25 14:56:35,875][36156] DAMAGECOUNT value on done: 1516520.0 [2023-02-25 14:56:35,875][36156] Sum rewards: 52.767, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.660', 'ARMOR': '0.005', 'AMMO5': '0.017', 'AMMO2': '0.032', 'AMMO3': '0.138', 'AMMO4': '0.157', 'weapon5': '0.208', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.528', 'weapon2': '0.534', 'WEAPON3': '0.950', 'weapon3': '2.408', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '13.530', 'FRAGCOUNT': '46.000'} [2023-02-25 14:56:36,193][36156] DAMAGECOUNT value on done: 1505979.0 [2023-02-25 14:56:36,194][36156] Sum rewards: 64.983, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.486', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.130', 'weapon5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.266', 'WEAPON3': '0.750', 'weapon4': '0.852', 'weapon3': '2.588', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.579', 'FRAGCOUNT': '51.000'} [2023-02-25 14:56:37,533][36138] Updated weights for policy 0, policy_version 57273 (0.0009) [2023-02-25 14:56:39,266][36155] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:56:39,729][36114] Fps is (10 sec: 13926.4, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 234618880. Throughput: 0: 3397.2. Samples: 21145520. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:56:39,729][36114] Avg episode reward: [(0, '59.491')] [2023-02-25 14:56:40,604][36138] Updated weights for policy 0, policy_version 57283 (0.0009) [2023-02-25 14:56:42,335][36156] Large shaping reward -2.537 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28800000000000003, -96.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 14:56:43,444][36139] DAMAGECOUNT value on done: 1514239.0 [2023-02-25 14:56:43,445][36139] Sum rewards: 64.525, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.800', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.054', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'AMMO4': '0.219', 'weapon2': '0.224', 'WEAPON4': '0.350', 'weapon4': '0.368', 'WEAPON3': '1.350', 'weapon3': '3.150', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.734', 'FRAGCOUNT': '56.000'} [2023-02-25 14:56:43,525][36155] DAMAGECOUNT value on done: 1506562.0 [2023-02-25 14:56:43,525][36155] Sum rewards: 52.948, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.550', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.120', 'weapon2': '0.156', 'AMMO4': '0.202', 'AMMO3': '0.249', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '2.990', 'weapon3': '3.000', 'DAMAGECOUNT': '14.772', 'FRAGCOUNT': '49.000'} [2023-02-25 14:56:43,619][36154] DAMAGECOUNT value on done: 1513739.0 [2023-02-25 14:56:43,620][36154] Sum rewards: 56.853, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.836', 'AMMO5': '0.012', 'AMMO2': '0.044', 'AMMO3': '0.175', 'AMMO4': '0.218', 'weapon2': '0.352', 'WEAPON5': '0.400', 'weapon5': '0.462', 'WEAPON4': '0.550', 'weapon4': '0.926', 'WEAPON3': '1.000', 'weapon3': '1.942', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.198', 'FRAGCOUNT': '50.000'} [2023-02-25 14:56:43,640][36138] Updated weights for policy 0, policy_version 57293 (0.0010) [2023-02-25 14:56:43,758][36139] DAMAGECOUNT value on done: 1509682.0 [2023-02-25 14:56:43,758][36139] Sum rewards: 52.348, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.024', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon2': '0.292', 'weapon4': '0.398', 'WEAPON3': '1.200', 'HITCOUNT': '2.740', 'weapon3': '2.778', 'DAMAGECOUNT': '13.677', 'FRAGCOUNT': '45.000'} [2023-02-25 14:56:43,835][36155] DAMAGECOUNT value on done: 1506965.0 [2023-02-25 14:56:43,836][36155] Sum rewards: 51.148, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.730', 'ARMOR': '0.008', 'AMMO5': '0.025', 'AMMO2': '0.069', 'AMMO3': '0.201', 'weapon5': '0.202', 'weapon4': '0.260', 'AMMO4': '0.344', 'weapon2': '0.466', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.200', 'weapon3': '2.740', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.273', 'FRAGCOUNT': '47.000'} [2023-02-25 14:56:43,939][36154] DAMAGECOUNT value on done: 1492155.0 [2023-02-25 14:56:43,940][36154] Sum rewards: 58.681, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.247', 'AMMO5': '0.006', 'AMMO2': '0.024', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'weapon2': '0.154', 'weapon5': '0.174', 'weapon4': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'WEAPON3': '1.300', 'HITCOUNT': '2.860', 'weapon3': '3.200', 'DAMAGECOUNT': '13.845', 'FRAGCOUNT': '51.000'} [2023-02-25 14:56:44,055][36139] DAMAGECOUNT value on done: 1519168.0 [2023-02-25 14:56:44,055][36139] Sum rewards: 51.531, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.022', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.150', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.352', 'weapon4': '0.458', 'ARMOR': '0.511', 'WEAPON3': '1.300', 'weapon3': '2.812', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.421', 'FRAGCOUNT': '44.000'} [2023-02-25 14:56:44,279][36154] DAMAGECOUNT value on done: 1526170.0 [2023-02-25 14:56:44,279][36154] Sum rewards: 66.252, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.280', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon5': '0.072', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon2': '0.332', 'weapon4': '0.412', 'WEAPON3': '1.150', 'weapon3': '2.900', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.772', 'FRAGCOUNT': '58.000'} [2023-02-25 14:56:44,355][36139] DAMAGECOUNT value on done: 1518887.0 [2023-02-25 14:56:44,355][36139] Sum rewards: 68.039, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.178', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO3': '0.163', 'AMMO4': '0.187', 'weapon5': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.428', 'weapon4': '0.574', 'WEAPON3': '0.950', 'weapon3': '2.408', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '56.000'} [2023-02-25 14:56:44,474][36155] DAMAGECOUNT value on done: 1524862.0 [2023-02-25 14:56:44,475][36155] Sum rewards: 54.794, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.560', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.098', 'weapon4': '0.112', 'AMMO4': '0.128', 'AMMO3': '0.265', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '2.980', 'weapon3': '3.258', 'DAMAGECOUNT': '14.682', 'FRAGCOUNT': '51.000'} [2023-02-25 14:56:44,588][36154] DAMAGECOUNT value on done: 1507396.0 [2023-02-25 14:56:44,588][36154] Sum rewards: 67.265, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.637', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.008', 'weapon4': '0.014', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.208', 'AMMO3': '0.261', 'WEAPON3': '1.500', 'HITCOUNT': '3.440', 'weapon3': '3.544', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '58.500'} [2023-02-25 14:56:44,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13565.4). Total num frames: 234684416. Throughput: 0: 3391.2. Samples: 21165682. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:56:44,730][36114] Avg episode reward: [(0, '59.511')] [2023-02-25 14:56:44,769][36155] DAMAGECOUNT value on done: 1507558.0 [2023-02-25 14:56:44,770][36155] Sum rewards: 57.940, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.240', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.092', 'weapon5': '0.108', 'AMMO4': '0.151', 'AMMO3': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.736', 'WEAPON3': '1.150', 'weapon3': '2.864', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.009', 'FRAGCOUNT': '51.000'} [2023-02-25 14:56:45,684][36141] DAMAGECOUNT value on done: 1515059.0 [2023-02-25 14:56:45,684][36141] Sum rewards: 62.379, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.280', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.114', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.291', 'weapon2': '0.318', 'weapon4': '0.334', 'WEAPON3': '1.650', 'weapon3': '2.932', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '57.000'} [2023-02-25 14:56:45,943][36141] DAMAGECOUNT value on done: 1507001.0 [2023-02-25 14:56:45,944][36141] Sum rewards: 45.186, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.520', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.042', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.124', 'weapon4': '0.146', 'WEAPON7': '0.200', 'AMMO4': '0.211', 'weapon5': '0.262', 'AMMO3': '0.264', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.534', 'WEAPON3': '1.500', 'weapon3': '2.546', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '13.962', 'FRAGCOUNT': '44.000'} [2023-02-25 14:56:45,988][36141] DAMAGECOUNT value on done: 1520132.0 [2023-02-25 14:56:45,988][36141] Sum rewards: 64.820, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.806', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.030', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.150', 'AMMO4': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.456', 'weapon2': '0.482', 'WEAPON3': '0.950', 'weapon3': '2.840', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '51.000'} [2023-02-25 14:56:46,261][36141] DAMAGECOUNT value on done: 1493314.0 [2023-02-25 14:56:46,262][36141] Sum rewards: 74.106, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.600', 'AMMO2': '0.013', 'weapon4': '0.034', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.190', 'weapon2': '0.302', 'WEAPON3': '1.250', 'weapon3': '3.482', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '62.000'} [2023-02-25 14:56:46,661][36138] Updated weights for policy 0, policy_version 57303 (0.0009) [2023-02-25 14:56:48,848][36157] DAMAGECOUNT value on done: 1526347.0 [2023-02-25 14:56:48,849][36157] Sum rewards: 52.810, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.580', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'AMMO4': '0.175', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'weapon2': '0.358', 'weapon4': '0.488', 'WEAPON3': '1.150', 'weapon3': '3.026', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.271', 'FRAGCOUNT': '45.000'} [2023-02-25 14:56:49,170][36157] DAMAGECOUNT value on done: 1511841.0 [2023-02-25 14:56:49,171][36157] Sum rewards: 60.024, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.540', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.032', 'AMMO4': '0.050', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.224', 'AMMO3': '0.264', 'WEAPON3': '1.550', 'HITCOUNT': '3.120', 'weapon3': '3.472', 'DAMAGECOUNT': '14.562', 'FRAGCOUNT': '54.000'} [2023-02-25 14:56:49,623][36157] DAMAGECOUNT value on done: 1527175.0 [2023-02-25 14:56:49,623][36157] Sum rewards: 70.235, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.415', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO3': '0.180', 'weapon2': '0.242', 'WEAPON4': '0.250', 'weapon4': '0.578', 'WEAPON3': '1.100', 'weapon3': '2.678', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '58.000'} [2023-02-25 14:56:49,728][36138] Updated weights for policy 0, policy_version 57313 (0.0009) [2023-02-25 14:56:49,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 234754048. Throughput: 0: 3388.5. Samples: 21185930. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:56:49,730][36114] Avg episode reward: [(0, '60.152')] [2023-02-25 14:56:49,944][36157] DAMAGECOUNT value on done: 1519283.0 [2023-02-25 14:56:49,945][36157] Sum rewards: 71.133, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.594', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon2': '0.132', 'weapon5': '0.168', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.534', 'WEAPON3': '1.200', 'weapon3': '2.840', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '58.000'} [2023-02-25 14:56:50,188][36140] DAMAGECOUNT value on done: 1523224.0 [2023-02-25 14:56:50,189][36140] Sum rewards: 48.441, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.825', 'ARMOR': '0.008', 'AMMO5': '0.032', 'AMMO2': '0.090', 'AMMO3': '0.194', 'weapon5': '0.284', 'weapon4': '0.378', 'AMMO4': '0.449', 'weapon2': '0.492', 'WEAPON4': '0.900', 'WEAPON5': '0.900', 'WEAPON3': '1.200', 'weapon3': '2.410', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.939', 'FRAGCOUNT': '44.000'} [2023-02-25 14:56:50,468][36140] DAMAGECOUNT value on done: 1520314.0 [2023-02-25 14:56:50,468][36140] Sum rewards: 70.125, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.200', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.052', 'weapon4': '0.178', 'AMMO3': '0.190', 'weapon2': '0.206', 'weapon5': '0.254', 'AMMO4': '0.261', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.098', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '59.500'} [2023-02-25 14:56:50,515][36140] DAMAGECOUNT value on done: 1502501.0 [2023-02-25 14:56:50,516][36140] Sum rewards: 54.424, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.204', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.222', 'AMMO4': '0.290', 'WEAPON4': '0.350', 'weapon2': '0.494', 'weapon4': '1.162', 'WEAPON3': '1.250', 'weapon3': '1.990', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '14.643', 'FRAGCOUNT': '48.000'} [2023-02-25 14:56:50,771][36140] DAMAGECOUNT value on done: 1509705.0 [2023-02-25 14:56:50,771][36140] Sum rewards: 60.861, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.735', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.088', 'AMMO3': '0.119', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.314', 'weapon2': '0.360', 'WEAPON3': '0.750', 'weapon3': '2.786', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.556', 'FRAGCOUNT': '48.000'} [2023-02-25 14:56:52,757][36138] Updated weights for policy 0, policy_version 57323 (0.0009) [2023-02-25 14:56:54,221][36142] DAMAGECOUNT value on done: 1506152.0 [2023-02-25 14:56:54,221][36142] Sum rewards: 71.090, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.719', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.214', 'weapon2': '0.556', 'WEAPON3': '1.300', 'weapon3': '3.174', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '61.000'} [2023-02-25 14:56:54,522][36142] DAMAGECOUNT value on done: 1499916.0 [2023-02-25 14:56:54,523][36142] Sum rewards: 66.384, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.750', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.162', 'AMMO3': '0.183', 'weapon2': '0.236', 'weapon5': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.596', 'WEAPON3': '1.100', 'weapon3': '2.630', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.719', 'FRAGCOUNT': '55.000'} [2023-02-25 14:56:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13551.5). Total num frames: 234819584. Throughput: 0: 3387.0. Samples: 21195986. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:56:54,729][36114] Avg episode reward: [(0, '60.225')] [2023-02-25 14:56:55,097][36142] DAMAGECOUNT value on done: 1512156.0 [2023-02-25 14:56:55,097][36142] Sum rewards: 58.954, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.140', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.058', 'AMMO3': '0.135', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.300', 'weapon2': '0.596', 'WEAPON3': '0.950', 'weapon3': '2.866', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.097', 'FRAGCOUNT': '49.000'} [2023-02-25 14:56:55,402][36142] DAMAGECOUNT value on done: 1518318.0 [2023-02-25 14:56:55,403][36142] Sum rewards: 67.742, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.455', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO4': '0.186', 'AMMO3': '0.195', 'weapon2': '0.214', 'weapon5': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.626', 'WEAPON3': '1.250', 'weapon3': '2.582', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '58.000'} [2023-02-25 14:56:55,462][36156] DAMAGECOUNT value on done: 1528460.0 [2023-02-25 14:56:55,462][36156] Sum rewards: 55.573, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.222', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.041', 'AMMO4': '0.202', 'AMMO3': '0.240', 'weapon5': '0.280', 'weapon2': '0.284', 'weapon4': '0.312', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.776', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.429', 'FRAGCOUNT': '51.000'} [2023-02-25 14:56:55,764][36156] DAMAGECOUNT value on done: 1506423.0 [2023-02-25 14:56:55,765][36156] Sum rewards: 57.885, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.520', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'weapon2': '0.236', 'AMMO3': '0.267', 'weapon4': '0.310', 'WEAPON3': '1.600', 'weapon3': '3.012', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '52.000'} [2023-02-25 14:56:55,823][36138] Updated weights for policy 0, policy_version 57333 (0.0009) [2023-02-25 14:56:55,920][36156] DAMAGECOUNT value on done: 1522086.0 [2023-02-25 14:56:55,921][36156] Sum rewards: 59.193, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.223', 'AMMO5': '0.021', 'AMMO2': '0.044', 'weapon5': '0.082', 'AMMO4': '0.222', 'AMMO3': '0.224', 'weapon2': '0.330', 'ARMOR': '0.400', 'weapon4': '0.434', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.890', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '52.000'} [2023-02-25 14:56:56,236][36156] DAMAGECOUNT value on done: 1511804.0 [2023-02-25 14:56:56,236][36156] Sum rewards: 62.048, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.108', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON6': '0.100', 'AMMO3': '0.185', 'weapon5': '0.192', 'weapon6': '0.192', 'weapon2': '0.200', 'AMMO4': '0.239', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.608', 'WEAPON3': '1.050', 'weapon3': '2.368', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.067', 'FRAGCOUNT': '51.500'} [2023-02-25 14:56:56,643][36141] Large shaping reward 2.509 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.489, 163.0)] [2023-02-25 14:56:58,849][36138] Updated weights for policy 0, policy_version 57343 (0.0008) [2023-02-25 14:56:59,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13516.8, 300 sec: 13551.5). Total num frames: 234885120. Throughput: 0: 3381.7. Samples: 21216134. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:56:59,730][36114] Avg episode reward: [(0, '60.345')] [2023-02-25 14:57:01,870][36138] Updated weights for policy 0, policy_version 57353 (0.0009) [2023-02-25 14:57:03,200][36139] DAMAGECOUNT value on done: 1518553.0 [2023-02-25 14:57:03,200][36139] Sum rewards: 49.818, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.417', 'AMMO5': '0.008', 'AMMO2': '0.035', 'AMMO4': '0.173', 'weapon5': '0.196', 'AMMO3': '0.198', 'WEAPON5': '0.250', 'weapon4': '0.350', 'WEAPON4': '0.450', 'ARMOR': '0.489', 'weapon2': '0.810', 'WEAPON3': '1.250', 'weapon3': '2.394', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '12.912', 'FRAGCOUNT': '44.500'} [2023-02-25 14:57:03,418][36155] DAMAGECOUNT value on done: 1510817.0 [2023-02-25 14:57:03,419][36155] Sum rewards: 47.507, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.972', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.055', 'weapon5': '0.162', 'AMMO3': '0.178', 'WEAPON5': '0.250', 'AMMO4': '0.277', 'weapon2': '0.404', 'WEAPON4': '0.650', 'weapon4': '0.806', 'WEAPON3': '1.000', 'weapon3': '2.308', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.765', 'FRAGCOUNT': '45.000'} [2023-02-25 14:57:03,508][36139] DAMAGECOUNT value on done: 1515555.0 [2023-02-25 14:57:03,508][36139] Sum rewards: 67.537, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.932', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon5': '0.128', 'AMMO4': '0.146', 'AMMO3': '0.180', 'weapon4': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.150', 'weapon3': '3.068', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '56.000'} [2023-02-25 14:57:03,547][36154] DAMAGECOUNT value on done: 1519249.0 [2023-02-25 14:57:03,547][36154] Sum rewards: 69.275, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.652', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.258', 'weapon2': '0.268', 'weapon4': '0.274', 'WEAPON3': '1.550', 'weapon3': '3.194', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '61.000'} [2023-02-25 14:57:03,707][36155] DAMAGECOUNT value on done: 1512482.0 [2023-02-25 14:57:03,707][36155] Sum rewards: 63.867, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.302', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.152', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'AMMO4': '0.216', 'weapon2': '0.316', 'WEAPON4': '0.400', 'weapon4': '0.540', 'WEAPON3': '1.000', 'weapon3': '2.722', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.551', 'FRAGCOUNT': '53.000'} [2023-02-25 14:57:03,839][36139] DAMAGECOUNT value on done: 1524640.0 [2023-02-25 14:57:03,839][36139] Sum rewards: 64.105, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.957', 'ARMOR': '0.012', 'AMMO5': '0.020', 'AMMO2': '0.045', 'AMMO3': '0.120', 'AMMO4': '0.225', 'weapon5': '0.268', 'weapon2': '0.370', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '0.750', 'weapon4': '1.098', 'weapon3': '1.908', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '53.000'} [2023-02-25 14:57:03,860][36154] DAMAGECOUNT value on done: 1498300.0 [2023-02-25 14:57:03,860][36154] Sum rewards: 72.829, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.980', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.134', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.236', 'AMMO3': '0.260', 'weapon4': '0.274', 'WEAPON3': '1.550', 'weapon3': '3.066', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '64.000'} [2023-02-25 14:57:04,129][36139] DAMAGECOUNT value on done: 1524081.0 [2023-02-25 14:57:04,129][36139] Sum rewards: 53.492, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.454', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.045', 'AMMO4': '0.224', 'AMMO3': '0.237', 'weapon2': '0.276', 'weapon5': '0.308', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.612', 'WEAPON3': '1.450', 'weapon3': '2.452', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.582', 'FRAGCOUNT': '49.000'} [2023-02-25 14:57:04,197][36154] DAMAGECOUNT value on done: 1530736.0 [2023-02-25 14:57:04,198][36154] Sum rewards: 53.236, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.791', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.066', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'AMMO3': '0.241', 'weapon2': '0.344', 'WEAPON3': '1.450', 'HITCOUNT': '2.830', 'weapon3': '3.360', 'DAMAGECOUNT': '13.698', 'FRAGCOUNT': '47.000'} [2023-02-25 14:57:04,340][36155] DAMAGECOUNT value on done: 1530024.0 [2023-02-25 14:57:04,341][36155] Sum rewards: 56.113, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.688', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.114', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'WEAPON4': '0.250', 'weapon2': '0.268', 'weapon4': '0.468', 'WEAPON3': '1.050', 'weapon3': '2.662', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '47.500'} [2023-02-25 14:57:04,501][36154] DAMAGECOUNT value on done: 1513454.0 [2023-02-25 14:57:04,502][36154] Sum rewards: 74.419, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.188', 'weapon5': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HEALTH': '0.356', 'weapon4': '0.368', 'weapon2': '0.388', 'WEAPON3': '1.100', 'weapon3': '2.822', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.174', 'FRAGCOUNT': '61.000'} [2023-02-25 14:57:04,634][36155] DAMAGECOUNT value on done: 1512980.0 [2023-02-25 14:57:04,634][36155] Sum rewards: 64.462, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.377', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'AMMO3': '0.260', 'weapon2': '0.518', 'WEAPON3': '1.600', 'weapon3': '3.172', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '58.000'} [2023-02-25 14:57:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13551.5). Total num frames: 234954752. Throughput: 0: 3383.2. Samples: 21236556. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:57:04,729][36114] Avg episode reward: [(0, '60.767')] [2023-02-25 14:57:04,895][36138] Updated weights for policy 0, policy_version 57363 (0.0009) [2023-02-25 14:57:05,477][36141] DAMAGECOUNT value on done: 1519827.0 [2023-02-25 14:57:05,478][36141] Sum rewards: 63.566, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.163', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'weapon2': '0.226', 'weapon4': '0.234', 'WEAPON3': '1.000', 'HITCOUNT': '3.010', 'weapon3': '3.326', 'DAMAGECOUNT': '14.304', 'FRAGCOUNT': '54.000'} [2023-02-25 14:57:05,720][36141] DAMAGECOUNT value on done: 1512938.0 [2023-02-25 14:57:05,720][36141] Sum rewards: 69.770, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.538', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.187', 'weapon5': '0.220', 'WEAPON5': '0.350', 'weapon2': '0.436', 'WEAPON4': '0.450', 'weapon4': '0.548', 'WEAPON3': '1.150', 'weapon3': '2.520', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '60.000'} [2023-02-25 14:57:05,804][36141] DAMAGECOUNT value on done: 1524034.0 [2023-02-25 14:57:05,804][36141] Sum rewards: 38.345, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.606', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon7': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.142', 'AMMO4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.176', 'AMMO3': '0.190', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.752', 'WEAPON3': '1.100', 'HITCOUNT': '2.250', 'weapon3': '2.352', 'DAMAGECOUNT': '11.706', 'FRAGCOUNT': '35.000'} [2023-02-25 14:57:06,056][36141] DAMAGECOUNT value on done: 1498095.0 [2023-02-25 14:57:06,056][36141] Sum rewards: 51.690, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.092', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.043', 'AMMO3': '0.195', 'AMMO4': '0.218', 'weapon4': '0.234', 'weapon5': '0.246', 'weapon2': '0.392', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.630', 'weapon3': '2.802', 'DAMAGECOUNT': '13.755', 'FRAGCOUNT': '47.000'} [2023-02-25 14:57:07,871][36138] Updated weights for policy 0, policy_version 57373 (0.0010) [2023-02-25 14:57:08,657][36157] DAMAGECOUNT value on done: 1531213.0 [2023-02-25 14:57:08,658][36157] Sum rewards: 56.174, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.070', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.150', 'weapon2': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'weapon4': '0.540', 'WEAPON3': '1.550', 'weapon3': '2.730', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.598', 'FRAGCOUNT': '52.000'} [2023-02-25 14:57:08,964][36157] DAMAGECOUNT value on done: 1517141.0 [2023-02-25 14:57:08,964][36157] Sum rewards: 57.784, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.665', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.062', 'AMMO4': '0.121', 'weapon5': '0.122', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'weapon2': '0.260', 'WEAPON3': '1.600', 'HITCOUNT': '3.030', 'weapon3': '3.312', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '52.000'} [2023-02-25 14:57:09,472][36157] DAMAGECOUNT value on done: 1532153.0 [2023-02-25 14:57:09,473][36157] Sum rewards: 58.763, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.265', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.164', 'AMMO4': '0.167', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.394', 'weapon2': '0.420', 'WEAPON3': '1.250', 'weapon3': '2.784', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.934', 'FRAGCOUNT': '52.000'} [2023-02-25 14:57:09,729][36114] Fps is (10 sec: 13926.4, 60 sec: 13585.0, 300 sec: 13565.4). Total num frames: 235024384. Throughput: 0: 3387.5. Samples: 21246838. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:57:09,730][36114] Avg episode reward: [(0, '60.444')] [2023-02-25 14:57:09,781][36157] DAMAGECOUNT value on done: 1523586.0 [2023-02-25 14:57:09,781][36157] Sum rewards: 48.445, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.114', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.058', 'weapon5': '0.162', 'AMMO3': '0.172', 'AMMO4': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'weapon2': '0.830', 'WEAPON3': '1.100', 'HITCOUNT': '2.490', 'weapon3': '2.704', 'DAMAGECOUNT': '12.909', 'FRAGCOUNT': '41.000'} [2023-02-25 14:57:10,121][36140] DAMAGECOUNT value on done: 1528501.0 [2023-02-25 14:57:10,122][36140] Sum rewards: 62.794, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.000', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon5': '0.078', 'AMMO4': '0.164', 'WEAPON5': '0.200', 'weapon4': '0.212', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.400', 'weapon3': '3.158', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.831', 'FRAGCOUNT': '55.000'} [2023-02-25 14:57:10,362][36140] DAMAGECOUNT value on done: 1524940.0 [2023-02-25 14:57:10,362][36140] Sum rewards: 50.575, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.263', 'AMMO5': '0.014', 'AMMO2': '0.047', 'AMMO3': '0.174', 'AMMO4': '0.237', 'weapon5': '0.270', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.518', 'weapon4': '0.572', 'WEAPON3': '1.000', 'weapon3': '2.358', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '13.878', 'FRAGCOUNT': '44.500'} [2023-02-25 14:57:10,410][36140] DAMAGECOUNT value on done: 1507690.0 [2023-02-25 14:57:10,411][36140] Sum rewards: 60.604, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.230', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.042', 'WEAPON5': '0.050', 'weapon5': '0.086', 'WEAPON4': '0.150', 'weapon4': '0.186', 'AMMO3': '0.239', 'weapon2': '0.614', 'WEAPON3': '1.400', 'weapon3': '2.922', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '55.000'} [2023-02-25 14:57:10,672][36140] DAMAGECOUNT value on done: 1515295.0 [2023-02-25 14:57:10,672][36140] Sum rewards: 71.126, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.321', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.048', 'AMMO3': '0.125', 'weapon2': '0.210', 'weapon5': '0.232', 'AMMO4': '0.242', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '0.800', 'weapon4': '0.920', 'weapon3': '2.270', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '59.000'} [2023-02-25 14:57:10,907][36138] Updated weights for policy 0, policy_version 57383 (0.0009) [2023-02-25 14:57:13,938][36138] Updated weights for policy 0, policy_version 57393 (0.0009) [2023-02-25 14:57:14,076][36142] DAMAGECOUNT value on done: 1510731.0 [2023-02-25 14:57:14,077][36142] Sum rewards: 52.138, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.790', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.114', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'weapon2': '0.430', 'weapon4': '0.466', 'WEAPON3': '1.250', 'weapon3': '2.754', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '13.737', 'FRAGCOUNT': '46.000'} [2023-02-25 14:57:14,387][36142] DAMAGECOUNT value on done: 1505532.0 [2023-02-25 14:57:14,388][36142] Sum rewards: 66.689, reward structure: {'DEATHCOUNT': '-14.250', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.154', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.206', 'weapon2': '0.390', 'WEAPON3': '0.900', 'HEALTH': '0.981', 'weapon3': '3.038', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '54.500'} [2023-02-25 14:57:14,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13551.5). Total num frames: 235089920. Throughput: 0: 3386.4. Samples: 21267174. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:57:14,730][36114] Avg episode reward: [(0, '60.307')] [2023-02-25 14:57:14,934][36142] DAMAGECOUNT value on done: 1518190.0 [2023-02-25 14:57:14,934][36142] Sum rewards: 69.229, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.850', 'AMMO5': '0.003', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.308', 'weapon4': '0.366', 'WEAPON3': '1.100', 'weapon3': '3.060', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '58.000'} [2023-02-25 14:57:15,243][36142] DAMAGECOUNT value on done: 1523854.0 [2023-02-25 14:57:15,243][36142] Sum rewards: 64.941, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.540', 'AMMO5': '0.004', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.050', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.228', 'AMMO3': '0.233', 'WEAPON3': '1.350', 'HITCOUNT': '3.240', 'weapon3': '3.488', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '56.000'} [2023-02-25 14:57:15,334][36156] DAMAGECOUNT value on done: 1533423.0 [2023-02-25 14:57:15,334][36156] Sum rewards: 57.903, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.082', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.024', 'weapon5': '0.064', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'AMMO3': '0.216', 'weapon2': '0.408', 'WEAPON3': '1.300', 'HITCOUNT': '2.820', 'weapon3': '3.284', 'DAMAGECOUNT': '14.889', 'FRAGCOUNT': '50.000'} [2023-02-25 14:57:15,654][36156] DAMAGECOUNT value on done: 1512273.0 [2023-02-25 14:57:15,654][36156] Sum rewards: 65.392, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.454', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.092', 'weapon4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.285', 'weapon2': '0.330', 'WEAPON3': '1.650', 'weapon3': '3.178', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '58.000'} [2023-02-25 14:57:15,778][36156] DAMAGECOUNT value on done: 1527321.0 [2023-02-25 14:57:15,778][36156] Sum rewards: 58.264, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.270', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.186', 'AMMO4': '0.215', 'AMMO3': '0.226', 'weapon5': '0.300', 'weapon2': '0.368', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.866', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.705', 'FRAGCOUNT': '52.000'} [2023-02-25 14:57:16,072][36156] DAMAGECOUNT value on done: 1516046.0 [2023-02-25 14:57:16,073][36156] Sum rewards: 49.319, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.978', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.044', 'AMMO3': '0.215', 'AMMO4': '0.222', 'weapon5': '0.270', 'WEAPON5': '0.450', 'weapon2': '0.496', 'weapon4': '0.522', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.340', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.726', 'FRAGCOUNT': '46.000'} [2023-02-25 14:57:17,023][36138] Updated weights for policy 0, policy_version 57403 (0.0009) [2023-02-25 14:57:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13565.4). Total num frames: 235159552. Throughput: 0: 3378.2. Samples: 21287338. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:57:19,730][36114] Avg episode reward: [(0, '60.390')] [2023-02-25 14:57:19,733][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000057412_235159552.pth... [2023-02-25 14:57:19,789][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000056618_231907328.pth [2023-02-25 14:57:20,051][36138] Updated weights for policy 0, policy_version 57413 (0.0009) [2023-02-25 14:57:22,653][36139] Large shaping reward 2.600 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5700000000000001, 190.0)] [2023-02-25 14:57:23,091][36138] Updated weights for policy 0, policy_version 57423 (0.0009) [2023-02-25 14:57:23,092][36139] DAMAGECOUNT value on done: 1524059.0 [2023-02-25 14:57:23,093][36139] Sum rewards: 60.313, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.920', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.146', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'weapon4': '0.316', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '2.942', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '51.000'} [2023-02-25 14:57:23,274][36155] DAMAGECOUNT value on done: 1516124.0 [2023-02-25 14:57:23,275][36155] Sum rewards: 64.738, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.760', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.158', 'AMMO4': '0.161', 'AMMO3': '0.197', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.426', 'weapon4': '0.446', 'WEAPON3': '1.250', 'weapon3': '2.684', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.921', 'FRAGCOUNT': '55.000'} [2023-02-25 14:57:23,396][36139] DAMAGECOUNT value on done: 1521169.0 [2023-02-25 14:57:23,397][36139] Sum rewards: 60.035, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.145', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.146', 'weapon5': '0.166', 'AMMO4': '0.184', 'AMMO3': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.622', 'WEAPON3': '1.250', 'weapon3': '2.720', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '52.500'} [2023-02-25 14:57:23,434][36154] DAMAGECOUNT value on done: 1524867.0 [2023-02-25 14:57:23,435][36154] Sum rewards: 62.438, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.046', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.090', 'AMMO4': '0.136', 'weapon4': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.260', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.230', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.854', 'FRAGCOUNT': '54.000'} [2023-02-25 14:57:23,586][36155] DAMAGECOUNT value on done: 1517845.0 [2023-02-25 14:57:23,586][36155] Sum rewards: 61.014, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.426', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO3': '0.158', 'AMMO4': '0.183', 'weapon5': '0.276', 'weapon4': '0.304', 'WEAPON5': '0.350', 'weapon2': '0.420', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.772', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '16.089', 'FRAGCOUNT': '52.000'} [2023-02-25 14:57:23,726][36139] DAMAGECOUNT value on done: 1529804.0 [2023-02-25 14:57:23,727][36139] Sum rewards: 62.114, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.020', 'AMMO5': '0.010', 'AMMO2': '0.046', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'weapon5': '0.224', 'AMMO4': '0.231', 'weapon4': '0.396', 'WEAPON4': '0.400', 'ARMOR': '0.464', 'weapon2': '0.476', 'WEAPON3': '1.100', 'weapon3': '2.438', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.492', 'FRAGCOUNT': '53.000'} [2023-02-25 14:57:23,746][36154] DAMAGECOUNT value on done: 1502802.0 [2023-02-25 14:57:23,747][36154] Sum rewards: 50.711, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.485', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon5': '0.072', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon2': '0.412', 'ARMOR': '0.455', 'weapon4': '0.464', 'WEAPON3': '1.250', 'weapon3': '2.840', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.506', 'FRAGCOUNT': '45.000'} [2023-02-25 14:57:24,026][36139] DAMAGECOUNT value on done: 1529466.0 [2023-02-25 14:57:24,026][36139] Sum rewards: 63.017, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.827', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.127', 'weapon5': '0.130', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.344', 'WEAPON4': '0.350', 'weapon2': '0.426', 'WEAPON3': '1.350', 'weapon3': '2.858', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.155', 'FRAGCOUNT': '55.000'} [2023-02-25 14:57:24,074][36154] DAMAGECOUNT value on done: 1535965.0 [2023-02-25 14:57:24,074][36154] Sum rewards: 61.271, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.712', 'AMMO5': '0.004', 'ARMOR': '0.004', 'AMMO2': '0.025', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'weapon2': '0.292', 'weapon4': '0.654', 'WEAPON3': '1.450', 'weapon3': '2.782', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.687', 'FRAGCOUNT': '54.000'} [2023-02-25 14:57:24,216][36155] DAMAGECOUNT value on done: 1534833.0 [2023-02-25 14:57:24,217][36155] Sum rewards: 62.785, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.404', 'AMMO5': '0.013', 'AMMO2': '0.055', 'AMMO3': '0.184', 'weapon5': '0.186', 'AMMO4': '0.274', 'weapon4': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.376', 'WEAPON3': '1.050', 'weapon3': '2.886', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.427', 'FRAGCOUNT': '54.000'} [2023-02-25 14:57:24,373][36154] DAMAGECOUNT value on done: 1518542.0 [2023-02-25 14:57:24,374][36154] Sum rewards: 58.362, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.652', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'WEAPON4': '0.150', 'weapon4': '0.172', 'AMMO3': '0.190', 'weapon2': '0.378', 'WEAPON3': '1.200', 'HITCOUNT': '3.050', 'weapon3': '3.194', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '49.000'} [2023-02-25 14:57:24,518][36155] DAMAGECOUNT value on done: 1518856.0 [2023-02-25 14:57:24,519][36155] Sum rewards: 66.319, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.240', 'AMMO5': '0.006', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon5': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.200', 'AMMO3': '0.284', 'weapon4': '0.296', 'WEAPON3': '1.750', 'weapon3': '2.946', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.598', 'FRAGCOUNT': '60.000'} [2023-02-25 14:57:24,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13551.5). Total num frames: 235225088. Throughput: 0: 3375.7. Samples: 21297428. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:57:24,729][36114] Avg episode reward: [(0, '60.397')] [2023-02-25 14:57:25,289][36141] DAMAGECOUNT value on done: 1525563.0 [2023-02-25 14:57:25,289][36141] Sum rewards: 69.507, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.700', 'AMMO5': '0.006', 'AMMO2': '0.039', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'AMMO4': '0.196', 'WEAPON4': '0.250', 'weapon2': '0.310', 'weapon4': '0.834', 'WEAPON3': '1.150', 'weapon3': '2.492', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '58.000'} [2023-02-25 14:57:25,561][36141] DAMAGECOUNT value on done: 1517959.0 [2023-02-25 14:57:25,562][36141] Sum rewards: 57.948, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.796', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'weapon2': '0.354', 'weapon4': '0.738', 'WEAPON3': '1.150', 'weapon3': '2.624', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.063', 'FRAGCOUNT': '49.000'} [2023-02-25 14:57:25,607][36141] DAMAGECOUNT value on done: 1528640.0 [2023-02-25 14:57:25,607][36141] Sum rewards: 56.420, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.712', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.062', 'AMMO4': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'weapon4': '0.318', 'weapon2': '0.676', 'WEAPON3': '0.950', 'HITCOUNT': '2.720', 'weapon3': '2.806', 'DAMAGECOUNT': '13.818', 'FRAGCOUNT': '46.000'} [2023-02-25 14:57:25,881][36141] DAMAGECOUNT value on done: 1503249.0 [2023-02-25 14:57:25,881][36141] Sum rewards: 65.006, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.910', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.020', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.120', 'AMMO3': '0.172', 'WEAPON7': '0.200', 'weapon4': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.142', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.462', 'FRAGCOUNT': '55.000'} [2023-02-25 14:57:26,146][36138] Updated weights for policy 0, policy_version 57433 (0.0009) [2023-02-25 14:57:28,525][36157] DAMAGECOUNT value on done: 1535647.0 [2023-02-25 14:57:28,525][36157] Sum rewards: 57.661, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.406', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.157', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'weapon2': '0.310', 'weapon4': '0.670', 'ARMOR': '0.859', 'WEAPON3': '1.150', 'weapon3': '2.772', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.302', 'FRAGCOUNT': '50.000'} [2023-02-25 14:57:28,833][36157] DAMAGECOUNT value on done: 1521468.0 [2023-02-25 14:57:28,834][36157] Sum rewards: 48.870, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.150', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon4': '0.092', 'WEAPON4': '0.150', 'weapon2': '0.174', 'AMMO3': '0.273', 'WEAPON3': '1.650', 'HITCOUNT': '2.810', 'weapon3': '3.560', 'DAMAGECOUNT': '12.981', 'FRAGCOUNT': '46.000'} [2023-02-25 14:57:29,158][36138] Updated weights for policy 0, policy_version 57443 (0.0009) [2023-02-25 14:57:29,336][36157] DAMAGECOUNT value on done: 1536250.0 [2023-02-25 14:57:29,337][36157] Sum rewards: 52.649, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.064', 'AMMO5': '0.007', 'AMMO2': '0.031', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.102', 'weapon5': '0.106', 'AMMO3': '0.122', 'AMMO4': '0.155', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.256', 'weapon4': '0.638', 'WEAPON3': '0.700', 'weapon3': '2.114', 'HITCOUNT': '2.190', 'DAMAGECOUNT': '12.291', 'FRAGCOUNT': '43.000'} [2023-02-25 14:57:29,659][36157] DAMAGECOUNT value on done: 1528361.0 [2023-02-25 14:57:29,659][36157] Sum rewards: 55.665, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.357', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.036', 'weapon4': '0.136', 'weapon5': '0.166', 'AMMO3': '0.171', 'AMMO4': '0.177', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.414', 'WEAPON3': '1.150', 'HITCOUNT': '2.630', 'weapon3': '2.952', 'DAMAGECOUNT': '14.325', 'FRAGCOUNT': '48.000'} [2023-02-25 14:57:29,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13516.8, 300 sec: 13551.5). Total num frames: 235290624. Throughput: 0: 3377.6. Samples: 21317674. Policy #0 lag: (min: 0.0, avg: 0.5, max: 2.0) [2023-02-25 14:57:29,730][36114] Avg episode reward: [(0, '60.135')] [2023-02-25 14:57:30,151][36140] DAMAGECOUNT value on done: 1534354.0 [2023-02-25 14:57:30,152][36140] Sum rewards: 66.506, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.095', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.072', 'AMMO4': '0.112', 'weapon5': '0.126', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.408', 'WEAPON3': '1.400', 'weapon3': '3.140', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.559', 'FRAGCOUNT': '57.000'} [2023-02-25 14:57:30,408][36140] DAMAGECOUNT value on done: 1529980.0 [2023-02-25 14:57:30,408][36140] Sum rewards: 51.494, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.110', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.136', 'weapon5': '0.156', 'AMMO4': '0.187', 'weapon2': '0.194', 'AMMO3': '0.237', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.770', 'weapon3': '3.254', 'DAMAGECOUNT': '15.120', 'FRAGCOUNT': '46.000'} [2023-02-25 14:57:30,474][36140] DAMAGECOUNT value on done: 1511339.0 [2023-02-25 14:57:30,474][36140] Sum rewards: 37.910, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.798', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.042', 'AMMO3': '0.153', 'weapon7': '0.154', 'weapon2': '0.158', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'AMMO4': '0.208', 'weapon5': '0.380', 'WEAPON4': '0.450', 'weapon4': '0.556', 'WEAPON3': '0.950', 'HITCOUNT': '2.210', 'weapon3': '2.516', 'DAMAGECOUNT': '10.947', 'FRAGCOUNT': '33.000'} [2023-02-25 14:57:30,723][36140] DAMAGECOUNT value on done: 1521225.0 [2023-02-25 14:57:30,724][36140] Sum rewards: 68.252, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.840', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.184', 'AMMO3': '0.271', 'weapon2': '0.452', 'WEAPON3': '1.550', 'weapon3': '2.986', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '60.000'} [2023-02-25 14:57:32,225][36138] Updated weights for policy 0, policy_version 57453 (0.0009) [2023-02-25 14:57:34,196][36142] DAMAGECOUNT value on done: 1516048.0 [2023-02-25 14:57:34,197][36142] Sum rewards: 60.375, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.850', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.172', 'AMMO3': '0.201', 'weapon5': '0.206', 'weapon4': '0.234', 'weapon2': '0.372', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.936', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '53.000'} [2023-02-25 14:57:34,501][36142] DAMAGECOUNT value on done: 1510674.0 [2023-02-25 14:57:34,501][36142] Sum rewards: 55.003, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.112', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.047', 'AMMO4': '0.237', 'AMMO3': '0.246', 'weapon5': '0.248', 'weapon2': '0.310', 'WEAPON5': '0.350', 'weapon4': '0.388', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.722', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '50.000'} [2023-02-25 14:57:34,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13551.5). Total num frames: 235360256. Throughput: 0: 3374.8. Samples: 21337796. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:57:34,730][36114] Avg episode reward: [(0, '60.109')] [2023-02-25 14:57:35,073][36142] DAMAGECOUNT value on done: 1523915.0 [2023-02-25 14:57:35,073][36142] Sum rewards: 67.653, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.036', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.104', 'weapon4': '0.196', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.458', 'WEAPON3': '1.250', 'weapon3': '3.038', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '59.000'} [2023-02-25 14:57:35,202][36156] DAMAGECOUNT value on done: 1538109.0 [2023-02-25 14:57:35,203][36156] Sum rewards: 57.370, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.279', 'ARMOR': '0.012', 'AMMO5': '0.019', 'AMMO2': '0.069', 'AMMO3': '0.103', 'weapon5': '0.264', 'weapon2': '0.268', 'AMMO4': '0.347', 'WEAPON5': '0.450', 'WEAPON3': '0.650', 'WEAPON4': '0.650', 'weapon4': '1.200', 'weapon3': '1.958', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.058', 'FRAGCOUNT': '49.000'} [2023-02-25 14:57:35,242][36138] Updated weights for policy 0, policy_version 57463 (0.0009) [2023-02-25 14:57:35,379][36142] DAMAGECOUNT value on done: 1529577.0 [2023-02-25 14:57:35,379][36142] Sum rewards: 69.044, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.465', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.058', 'AMMO4': '0.073', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon4': '0.298', 'weapon2': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.996', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.169', 'FRAGCOUNT': '60.000'} [2023-02-25 14:57:35,508][36156] DAMAGECOUNT value on done: 1516544.0 [2023-02-25 14:57:35,509][36156] Sum rewards: 50.573, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.055', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon7': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon2': '0.182', 'WEAPON7': '0.200', 'WEAPON4': '0.450', 'ARMOR': '0.459', 'weapon4': '0.872', 'WEAPON3': '1.000', 'weapon3': '2.232', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '12.813', 'FRAGCOUNT': '44.000'} [2023-02-25 14:57:35,620][36156] DAMAGECOUNT value on done: 1532194.0 [2023-02-25 14:57:35,621][36156] Sum rewards: 58.220, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.702', 'ARMOR': '0.008', 'AMMO5': '0.021', 'AMMO2': '0.062', 'AMMO3': '0.224', 'weapon2': '0.278', 'AMMO4': '0.308', 'weapon4': '0.310', 'weapon5': '0.366', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.706', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.619', 'FRAGCOUNT': '54.000'} [2023-02-25 14:57:35,918][36156] DAMAGECOUNT value on done: 1521077.0 [2023-02-25 14:57:35,918][36156] Sum rewards: 58.922, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.138', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.290', 'weapon2': '0.410', 'HEALTH': '0.426', 'WEAPON3': '0.850', 'weapon3': '2.966', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.093', 'FRAGCOUNT': '47.000'} [2023-02-25 14:57:38,282][36138] Updated weights for policy 0, policy_version 57473 (0.0009) [2023-02-25 14:57:39,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13537.6). Total num frames: 235425792. Throughput: 0: 3376.9. Samples: 21347948. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:57:39,729][36114] Avg episode reward: [(0, '59.889')] [2023-02-25 14:57:41,338][36138] Updated weights for policy 0, policy_version 57483 (0.0008) [2023-02-25 14:57:42,989][36139] DAMAGECOUNT value on done: 1529029.0 [2023-02-25 14:57:42,989][36139] Sum rewards: 52.753, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.129', 'AMMO5': '0.015', 'AMMO2': '0.063', 'AMMO3': '0.143', 'weapon5': '0.206', 'weapon2': '0.244', 'AMMO4': '0.317', 'weapon4': '0.412', 'WEAPON5': '0.450', 'WEAPON4': '0.700', 'WEAPON3': '0.850', 'weapon3': '2.902', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '45.000'} [2023-02-25 14:57:43,184][36155] DAMAGECOUNT value on done: 1520785.0 [2023-02-25 14:57:43,185][36155] Sum rewards: 48.460, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.830', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon2': '0.174', 'AMMO3': '0.220', 'AMMO4': '0.226', 'weapon5': '0.250', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.482', 'WEAPON3': '1.350', 'HITCOUNT': '2.720', 'weapon3': '2.820', 'DAMAGECOUNT': '13.983', 'FRAGCOUNT': '44.000'} [2023-02-25 14:57:43,303][36154] DAMAGECOUNT value on done: 1530463.0 [2023-02-25 14:57:43,304][36154] Sum rewards: 65.354, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.370', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.064', 'AMMO4': '0.140', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'weapon4': '0.312', 'WEAPON4': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.200', 'weapon3': '2.992', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '55.000'} [2023-02-25 14:57:43,305][36139] DAMAGECOUNT value on done: 1527139.0 [2023-02-25 14:57:43,306][36139] Sum rewards: 70.449, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.200', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO3': '0.270', 'weapon2': '0.624', 'WEAPON3': '1.600', 'weapon3': '3.056', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.910', 'FRAGCOUNT': '61.000'} [2023-02-25 14:57:43,494][36155] DAMAGECOUNT value on done: 1522977.0 [2023-02-25 14:57:43,495][36155] Sum rewards: 57.167, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.600', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.050', 'AMMO4': '0.075', 'WEAPON5': '0.150', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.250', 'weapon4': '0.276', 'WEAPON3': '1.550', 'HITCOUNT': '3.040', 'weapon3': '3.210', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '52.000'} [2023-02-25 14:57:43,619][36154] DAMAGECOUNT value on done: 1507796.0 [2023-02-25 14:57:43,619][36154] Sum rewards: 55.865, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.338', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.192', 'weapon5': '0.210', 'weapon2': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.442', 'WEAPON3': '1.150', 'weapon3': '2.898', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.982', 'FRAGCOUNT': '47.000'} [2023-02-25 14:57:43,623][36139] DAMAGECOUNT value on done: 1535032.0 [2023-02-25 14:57:43,624][36139] Sum rewards: 59.943, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.204', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.248', 'AMMO3': '0.250', 'weapon2': '0.460', 'WEAPON3': '1.500', 'weapon3': '2.944', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '53.000'} [2023-02-25 14:57:43,930][36139] DAMAGECOUNT value on done: 1535867.0 [2023-02-25 14:57:43,930][36139] Sum rewards: 73.696, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.556', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon4': '0.202', 'AMMO3': '0.205', 'weapon5': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.336', 'WEAPON3': '1.200', 'weapon3': '2.966', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.203', 'FRAGCOUNT': '61.000'} [2023-02-25 14:57:43,976][36154] DAMAGECOUNT value on done: 1541156.0 [2023-02-25 14:57:43,977][36154] Sum rewards: 65.619, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'weapon5': '0.064', 'AMMO3': '0.229', 'weapon2': '0.282', 'weapon4': '0.322', 'HEALTH': '0.606', 'WEAPON3': '1.200', 'weapon3': '3.134', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.573', 'FRAGCOUNT': '55.000'} [2023-02-25 14:57:44,167][36155] DAMAGECOUNT value on done: 1540740.0 [2023-02-25 14:57:44,168][36155] Sum rewards: 65.262, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.226', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon4': '0.132', 'weapon5': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.316', 'WEAPON3': '1.250', 'weapon3': '3.134', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '54.000'} [2023-02-25 14:57:44,279][36154] DAMAGECOUNT value on done: 1523583.0 [2023-02-25 14:57:44,279][36154] Sum rewards: 64.176, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.020', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.091', 'AMMO3': '0.211', 'weapon2': '0.510', 'WEAPON3': '1.350', 'HITCOUNT': '3.190', 'weapon3': '3.270', 'DAMAGECOUNT': '15.123', 'FRAGCOUNT': '55.000'} [2023-02-25 14:57:44,373][36138] Updated weights for policy 0, policy_version 57493 (0.0010) [2023-02-25 14:57:44,471][36155] DAMAGECOUNT value on done: 1524251.0 [2023-02-25 14:57:44,471][36155] Sum rewards: 62.682, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.465', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.049', 'AMMO3': '0.158', 'AMMO4': '0.243', 'weapon2': '0.252', 'weapon5': '0.356', 'weapon4': '0.546', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '0.950', 'weapon3': '2.544', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '53.000'} [2023-02-25 14:57:44,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13551.5). Total num frames: 235495424. Throughput: 0: 3379.0. Samples: 21368190. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:57:44,729][36114] Avg episode reward: [(0, '60.312')] [2023-02-25 14:57:45,258][36141] DAMAGECOUNT value on done: 1530423.0 [2023-02-25 14:57:45,258][36141] Sum rewards: 47.988, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.700', 'AMMO5': '0.014', 'AMMO2': '0.056', 'weapon5': '0.106', 'AMMO3': '0.270', 'AMMO4': '0.279', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.552', 'weapon2': '0.586', 'WEAPON3': '1.600', 'weapon3': '2.478', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.517', 'FRAGCOUNT': '47.000'} [2023-02-25 14:57:45,505][36141] DAMAGECOUNT value on done: 1522739.0 [2023-02-25 14:57:45,505][36141] Sum rewards: 61.517, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.640', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.203', 'weapon2': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.192', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.340', 'FRAGCOUNT': '52.000'} [2023-02-25 14:57:45,566][36141] DAMAGECOUNT value on done: 1533336.0 [2023-02-25 14:57:45,566][36141] Sum rewards: 58.959, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.190', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.205', 'weapon5': '0.230', 'weapon2': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.508', 'WEAPON3': '1.150', 'weapon3': '2.678', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.088', 'FRAGCOUNT': '51.000'} [2023-02-25 14:57:45,820][36141] DAMAGECOUNT value on done: 1508687.0 [2023-02-25 14:57:45,821][36141] Sum rewards: 56.885, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.141', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon2': '0.190', 'AMMO4': '0.207', 'AMMO3': '0.244', 'weapon5': '0.348', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.640', 'WEAPON3': '1.450', 'weapon3': '2.528', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '52.000'} [2023-02-25 14:57:47,334][36138] Updated weights for policy 0, policy_version 57503 (0.0009) [2023-02-25 14:57:48,496][36157] DAMAGECOUNT value on done: 1540858.0 [2023-02-25 14:57:48,497][36157] Sum rewards: 53.562, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.839', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.184', 'weapon2': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.265', 'WEAPON4': '0.300', 'weapon4': '0.360', 'WEAPON3': '1.650', 'weapon3': '2.874', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.633', 'FRAGCOUNT': '50.000'} [2023-02-25 14:57:48,804][36157] DAMAGECOUNT value on done: 1526235.0 [2023-02-25 14:57:48,805][36157] Sum rewards: 60.008, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.555', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.062', 'weapon5': '0.106', 'AMMO4': '0.152', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.754', 'WEAPON3': '1.050', 'weapon3': '2.884', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.301', 'FRAGCOUNT': '52.000'} [2023-02-25 14:57:49,040][36142] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:57:49,256][36157] DAMAGECOUNT value on done: 1542413.0 [2023-02-25 14:57:49,257][36157] Sum rewards: 78.290, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.137', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.161', 'weapon5': '0.166', 'weapon2': '0.202', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.658', 'WEAPON3': '1.300', 'weapon3': '2.706', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.489', 'FRAGCOUNT': '68.000'} [2023-02-25 14:57:49,563][36157] DAMAGECOUNT value on done: 1533997.0 [2023-02-25 14:57:49,563][36157] Sum rewards: 63.580, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.052', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.056', 'AMMO3': '0.205', 'AMMO4': '0.280', 'weapon5': '0.324', 'weapon2': '0.328', 'weapon4': '0.388', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.634', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.908', 'FRAGCOUNT': '55.000'} [2023-02-25 14:57:49,729][36114] Fps is (10 sec: 13516.5, 60 sec: 13448.5, 300 sec: 13537.6). Total num frames: 235560960. Throughput: 0: 3379.2. Samples: 21388622. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:57:49,730][36114] Avg episode reward: [(0, '60.175')] [2023-02-25 14:57:50,097][36140] DAMAGECOUNT value on done: 1540009.0 [2023-02-25 14:57:50,098][36140] Sum rewards: 61.187, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.060', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.060', 'AMMO3': '0.142', 'weapon2': '0.260', 'AMMO4': '0.302', 'weapon5': '0.348', 'WEAPON5': '0.650', 'WEAPON4': '0.800', 'weapon4': '0.876', 'WEAPON3': '0.900', 'weapon3': '2.152', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '51.000'} [2023-02-25 14:57:50,328][36138] Updated weights for policy 0, policy_version 57513 (0.0009) [2023-02-25 14:57:50,340][36140] DAMAGECOUNT value on done: 1534965.0 [2023-02-25 14:57:50,341][36140] Sum rewards: 61.955, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.375', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.130', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.252', 'weapon2': '0.460', 'WEAPON3': '1.150', 'weapon3': '2.928', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.955', 'FRAGCOUNT': '53.000'} [2023-02-25 14:57:50,404][36140] DAMAGECOUNT value on done: 1516444.0 [2023-02-25 14:57:50,405][36140] Sum rewards: 54.416, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.399', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon4': '0.094', 'AMMO4': '0.214', 'weapon5': '0.216', 'AMMO3': '0.260', 'weapon2': '0.412', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '2.860', 'weapon3': '2.936', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '51.000'} [2023-02-25 14:57:50,653][36140] DAMAGECOUNT value on done: 1526208.0 [2023-02-25 14:57:50,654][36140] Sum rewards: 54.497, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.700', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.156', 'AMMO4': '0.187', 'weapon2': '0.206', 'AMMO3': '0.227', 'weapon5': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.010', 'weapon3': '3.118', 'DAMAGECOUNT': '14.949', 'FRAGCOUNT': '49.500'} [2023-02-25 14:57:53,324][36138] Updated weights for policy 0, policy_version 57523 (0.0010) [2023-02-25 14:57:54,048][36142] DAMAGECOUNT value on done: 1521224.0 [2023-02-25 14:57:54,048][36142] Sum rewards: 53.708, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.796', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.052', 'AMMO3': '0.163', 'weapon5': '0.168', 'AMMO4': '0.262', 'weapon4': '0.474', 'weapon2': '0.476', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '0.900', 'weapon3': '2.590', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.243', 'FRAGCOUNT': '46.000'} [2023-02-25 14:57:54,372][36142] DAMAGECOUNT value on done: 1515687.0 [2023-02-25 14:57:54,373][36142] Sum rewards: 53.010, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.060', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.014', 'weapon5': '0.040', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.249', 'weapon2': '0.412', 'WEAPON3': '1.450', 'HITCOUNT': '3.120', 'weapon3': '3.344', 'DAMAGECOUNT': '15.039', 'FRAGCOUNT': '46.000'} [2023-02-25 14:57:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13551.5). Total num frames: 235630592. Throughput: 0: 3378.5. Samples: 21398870. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:57:54,729][36114] Avg episode reward: [(0, '59.835')] [2023-02-25 14:57:54,933][36142] DAMAGECOUNT value on done: 1528587.0 [2023-02-25 14:57:54,933][36142] Sum rewards: 54.459, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.392', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.216', 'weapon2': '0.436', 'WEAPON3': '1.350', 'HITCOUNT': '2.950', 'weapon3': '3.236', 'DAMAGECOUNT': '14.016', 'FRAGCOUNT': '47.000'} [2023-02-25 14:57:55,140][36156] DAMAGECOUNT value on done: 1543731.0 [2023-02-25 14:57:55,140][36156] Sum rewards: 59.939, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.922', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.062', 'weapon5': '0.128', 'AMMO3': '0.251', 'AMMO4': '0.310', 'weapon2': '0.334', 'WEAPON5': '0.350', 'WEAPON4': '0.650', 'weapon4': '0.884', 'WEAPON3': '1.400', 'weapon3': '2.324', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '55.000'} [2023-02-25 14:57:55,231][36142] DAMAGECOUNT value on done: 1535138.0 [2023-02-25 14:57:55,232][36142] Sum rewards: 71.170, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.031', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.046', 'weapon5': '0.052', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'weapon2': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.284', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '60.000'} [2023-02-25 14:57:55,438][36156] DAMAGECOUNT value on done: 1521765.0 [2023-02-25 14:57:55,439][36156] Sum rewards: 66.529, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.350', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.142', 'WEAPON4': '0.200', 'weapon2': '0.242', 'weapon4': '0.606', 'WEAPON3': '0.850', 'weapon3': '2.940', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.663', 'FRAGCOUNT': '54.000'} [2023-02-25 14:57:55,528][36156] DAMAGECOUNT value on done: 1537967.0 [2023-02-25 14:57:55,529][36156] Sum rewards: 69.242, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.151', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.118', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.294', 'WEAPON4': '0.350', 'weapon4': '0.558', 'WEAPON3': '1.200', 'weapon3': '2.816', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '59.000'} [2023-02-25 14:57:55,838][36156] DAMAGECOUNT value on done: 1527717.0 [2023-02-25 14:57:55,839][36156] Sum rewards: 75.142, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.347', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon5': '0.178', 'weapon4': '0.192', 'AMMO3': '0.203', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.250', 'weapon3': '3.012', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.920', 'FRAGCOUNT': '62.000'} [2023-02-25 14:57:56,377][36138] Updated weights for policy 0, policy_version 57533 (0.0009) [2023-02-25 14:57:58,637][36139] Large shaping reward 2.629 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.003, -1.0), ('weapon5', 0.002)] [2023-02-25 14:57:59,419][36138] Updated weights for policy 0, policy_version 57543 (0.0009) [2023-02-25 14:57:59,729][36114] Fps is (10 sec: 13926.7, 60 sec: 13585.1, 300 sec: 13551.5). Total num frames: 235700224. Throughput: 0: 3374.6. Samples: 21419032. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:57:59,730][36114] Avg episode reward: [(0, '60.005')] [2023-02-25 14:58:02,431][36138] Updated weights for policy 0, policy_version 57553 (0.0009) [2023-02-25 14:58:02,739][36139] DAMAGECOUNT value on done: 1533504.0 [2023-02-25 14:58:02,739][36139] Sum rewards: 45.873, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.310', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.058', 'weapon4': '0.062', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.258', 'weapon2': '0.362', 'WEAPON3': '1.550', 'HITCOUNT': '2.720', 'weapon3': '3.268', 'DAMAGECOUNT': '13.380', 'FRAGCOUNT': '42.000'} [2023-02-25 14:58:02,902][36155] DAMAGECOUNT value on done: 1525763.0 [2023-02-25 14:58:02,903][36155] Sum rewards: 54.891, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.192', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.059', 'AMMO3': '0.138', 'AMMO4': '0.297', 'weapon5': '0.336', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.604', 'weapon2': '0.634', 'WEAPON3': '0.800', 'weapon3': '2.116', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '14.934', 'FRAGCOUNT': '46.500'} [2023-02-25 14:58:02,991][36154] DAMAGECOUNT value on done: 1534876.0 [2023-02-25 14:58:02,992][36154] Sum rewards: 48.353, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.908', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO3': '0.146', 'weapon5': '0.218', 'AMMO4': '0.226', 'weapon2': '0.424', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.612', 'WEAPON3': '1.000', 'weapon3': '2.492', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '13.239', 'FRAGCOUNT': '41.000'} [2023-02-25 14:58:03,049][36139] DAMAGECOUNT value on done: 1533530.0 [2023-02-25 14:58:03,049][36139] Sum rewards: 71.110, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.531', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO4': '0.169', 'AMMO3': '0.204', 'weapon5': '0.224', 'weapon4': '0.348', 'weapon2': '0.388', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.716', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '60.000'} [2023-02-25 14:58:03,206][36155] DAMAGECOUNT value on done: 1527181.0 [2023-02-25 14:58:03,207][36155] Sum rewards: 46.984, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.150', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon7': '0.090', 'weapon5': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.226', 'AMMO3': '0.247', 'weapon4': '0.554', 'WEAPON3': '1.400', 'HITCOUNT': '2.560', 'weapon3': '2.570', 'DAMAGECOUNT': '12.609', 'FRAGCOUNT': '43.000'} [2023-02-25 14:58:03,299][36154] DAMAGECOUNT value on done: 1512633.0 [2023-02-25 14:58:03,300][36154] Sum rewards: 58.108, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.998', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.157', 'weapon5': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.368', 'weapon2': '0.668', 'WEAPON3': '0.950', 'weapon3': '2.512', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.511', 'FRAGCOUNT': '48.000'} [2023-02-25 14:58:03,353][36139] DAMAGECOUNT value on done: 1541033.0 [2023-02-25 14:58:03,353][36139] Sum rewards: 67.043, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.325', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.132', 'weapon5': '0.134', 'weapon2': '0.206', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'weapon4': '0.436', 'WEAPON3': '1.500', 'weapon3': '2.894', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '59.000'} [2023-02-25 14:58:03,656][36154] DAMAGECOUNT value on done: 1546040.0 [2023-02-25 14:58:03,657][36154] Sum rewards: 53.509, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.248', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.177', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon4': '0.816', 'weapon2': '0.836', 'WEAPON3': '1.050', 'weapon3': '1.846', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.652', 'FRAGCOUNT': '45.000'} [2023-02-25 14:58:03,662][36139] DAMAGECOUNT value on done: 1541821.0 [2023-02-25 14:58:03,662][36139] Sum rewards: 69.801, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.608', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.140', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.292', 'weapon2': '0.502', 'WEAPON3': '0.900', 'weapon3': '2.858', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '55.000'} [2023-02-25 14:58:03,867][36155] DAMAGECOUNT value on done: 1545629.0 [2023-02-25 14:58:03,867][36155] Sum rewards: 56.696, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.935', 'AMMO5': '0.009', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.158', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.316', 'weapon2': '0.360', 'WEAPON3': '1.100', 'weapon3': '2.950', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.667', 'FRAGCOUNT': '48.000'} [2023-02-25 14:58:03,963][36154] DAMAGECOUNT value on done: 1528488.0 [2023-02-25 14:58:03,964][36154] Sum rewards: 58.941, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.484', 'AMMO2': '0.007', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'weapon2': '0.146', 'AMMO3': '0.210', 'weapon4': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.130', 'weapon3': '3.380', 'DAMAGECOUNT': '14.715', 'FRAGCOUNT': '49.000'} [2023-02-25 14:58:04,172][36155] DAMAGECOUNT value on done: 1529808.0 [2023-02-25 14:58:04,173][36155] Sum rewards: 68.940, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.927', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.084', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'weapon2': '0.150', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'weapon4': '0.934', 'WEAPON3': '1.150', 'weapon3': '2.470', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '59.000'} [2023-02-25 14:58:04,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13551.5). Total num frames: 235765760. Throughput: 0: 3376.0. Samples: 21439258. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:58:04,730][36114] Avg episode reward: [(0, '59.776')] [2023-02-25 14:58:05,117][36141] DAMAGECOUNT value on done: 1534812.0 [2023-02-25 14:58:05,118][36141] Sum rewards: 48.289, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon7': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.162', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.446', 'HEALTH': '0.548', 'weapon2': '0.816', 'WEAPON3': '0.850', 'weapon3': '2.196', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '13.167', 'FRAGCOUNT': '39.000'} [2023-02-25 14:58:05,391][36141] DAMAGECOUNT value on done: 1528117.0 [2023-02-25 14:58:05,392][36141] Sum rewards: 54.395, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.020', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.130', 'weapon4': '0.154', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.880', 'WEAPON3': '1.350', 'weapon3': '2.590', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '47.000'} [2023-02-25 14:58:05,453][36141] DAMAGECOUNT value on done: 1538971.0 [2023-02-25 14:58:05,453][36141] Sum rewards: 61.608, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.962', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon4': '0.078', 'AMMO4': '0.109', 'weapon5': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'weapon2': '0.628', 'WEAPON3': '1.450', 'weapon3': '2.876', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '53.000'} [2023-02-25 14:58:05,459][36138] Updated weights for policy 0, policy_version 57563 (0.0009) [2023-02-25 14:58:05,706][36141] DAMAGECOUNT value on done: 1514359.0 [2023-02-25 14:58:05,706][36141] Sum rewards: 58.105, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.923', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon5': '0.236', 'AMMO3': '0.241', 'AMMO4': '0.265', 'weapon2': '0.334', 'weapon4': '0.454', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.594', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '52.000'} [2023-02-25 14:58:08,344][36157] DAMAGECOUNT value on done: 1546252.0 [2023-02-25 14:58:08,344][36157] Sum rewards: 59.010, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.566', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.088', 'AMMO4': '0.153', 'weapon4': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.256', 'AMMO3': '0.265', 'WEAPON3': '1.550', 'weapon3': '3.206', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '52.500'} [2023-02-25 14:58:08,484][36138] Updated weights for policy 0, policy_version 57573 (0.0009) [2023-02-25 14:58:08,652][36157] DAMAGECOUNT value on done: 1531326.0 [2023-02-25 14:58:08,653][36157] Sum rewards: 58.016, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.830', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.012', 'weapon4': '0.014', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.160', 'AMMO3': '0.348', 'WEAPON3': '1.950', 'HITCOUNT': '3.140', 'weapon3': '3.566', 'DAMAGECOUNT': '15.273', 'FRAGCOUNT': '55.000'} [2023-02-25 14:58:09,101][36157] DAMAGECOUNT value on done: 1548536.0 [2023-02-25 14:58:09,101][36157] Sum rewards: 73.623, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.805', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon4': '0.124', 'AMMO3': '0.157', 'weapon5': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON3': '0.950', 'weapon3': '3.222', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.369', 'FRAGCOUNT': '59.000'} [2023-02-25 14:58:09,415][36157] DAMAGECOUNT value on done: 1539112.0 [2023-02-25 14:58:09,416][36157] Sum rewards: 63.416, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.185', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.062', 'AMMO4': '0.094', 'WEAPON5': '0.150', 'weapon4': '0.170', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.450', 'weapon3': '3.274', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.345', 'FRAGCOUNT': '57.000'} [2023-02-25 14:58:09,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13551.5). Total num frames: 235835392. Throughput: 0: 3379.2. Samples: 21449490. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:58:09,730][36114] Avg episode reward: [(0, '59.825')] [2023-02-25 14:58:10,075][36140] DAMAGECOUNT value on done: 1545822.0 [2023-02-25 14:58:10,076][36140] Sum rewards: 69.798, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.965', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.050', 'AMMO3': '0.126', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'weapon4': '0.194', 'WEAPON4': '0.350', 'WEAPON3': '0.800', 'weapon2': '1.078', 'weapon3': '2.504', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '58.000'} [2023-02-25 14:58:10,302][36140] DAMAGECOUNT value on done: 1540391.0 [2023-02-25 14:58:10,302][36140] Sum rewards: 69.111, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.362', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.049', 'AMMO3': '0.176', 'weapon2': '0.220', 'AMMO4': '0.243', 'weapon5': '0.258', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon4': '1.130', 'weapon3': '2.116', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.278', 'FRAGCOUNT': '59.000'} [2023-02-25 14:58:10,405][36140] DAMAGECOUNT value on done: 1522823.0 [2023-02-25 14:58:10,405][36140] Sum rewards: 73.103, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.365', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.100', 'AMMO4': '0.108', 'weapon2': '0.132', 'WEAPON5': '0.200', 'AMMO3': '0.264', 'weapon4': '0.278', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.268', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.137', 'FRAGCOUNT': '63.000'} [2023-02-25 14:58:10,606][36140] DAMAGECOUNT value on done: 1532273.0 [2023-02-25 14:58:10,607][36140] Sum rewards: 72.694, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.915', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon2': '0.282', 'weapon4': '0.422', 'WEAPON3': '1.400', 'weapon3': '2.994', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.195', 'FRAGCOUNT': '62.000'} [2023-02-25 14:58:11,469][36138] Updated weights for policy 0, policy_version 57583 (0.0009) [2023-02-25 14:58:14,046][36142] DAMAGECOUNT value on done: 1527218.0 [2023-02-25 14:58:14,047][36142] Sum rewards: 66.629, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.458', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'weapon5': '0.058', 'WEAPON4': '0.100', 'weapon2': '0.128', 'weapon4': '0.218', 'AMMO3': '0.269', 'WEAPON3': '1.700', 'weapon3': '3.356', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '58.000'} [2023-02-25 14:58:14,347][36142] DAMAGECOUNT value on done: 1521756.0 [2023-02-25 14:58:14,347][36142] Sum rewards: 75.019, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.355', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'WEAPON4': '0.350', 'weapon2': '0.404', 'weapon4': '0.620', 'WEAPON3': '1.400', 'weapon3': '2.652', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '18.207', 'FRAGCOUNT': '65.000'} [2023-02-25 14:58:14,458][36138] Updated weights for policy 0, policy_version 57593 (0.0009) [2023-02-25 14:58:14,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13551.5). Total num frames: 235900928. Throughput: 0: 3383.5. Samples: 21469930. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:58:14,730][36114] Avg episode reward: [(0, '60.743')] [2023-02-25 14:58:14,906][36142] DAMAGECOUNT value on done: 1533892.0 [2023-02-25 14:58:14,906][36142] Sum rewards: 65.052, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.864', 'AMMO5': '0.014', 'AMMO2': '0.043', 'AMMO3': '0.210', 'weapon2': '0.214', 'AMMO4': '0.215', 'weapon5': '0.240', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.546', 'WEAPON3': '1.300', 'weapon3': '2.688', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.915', 'FRAGCOUNT': '59.000'} [2023-02-25 14:58:15,044][36156] DAMAGECOUNT value on done: 1548717.0 [2023-02-25 14:58:15,045][36156] Sum rewards: 57.236, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.194', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.047', 'AMMO3': '0.127', 'AMMO4': '0.233', 'weapon5': '0.250', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.532', 'weapon4': '0.790', 'WEAPON3': '0.900', 'weapon3': '2.092', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.958', 'FRAGCOUNT': '49.000'} [2023-02-25 14:58:15,192][36142] DAMAGECOUNT value on done: 1540786.0 [2023-02-25 14:58:15,192][36142] Sum rewards: 61.733, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.511', 'AMMO5': '0.013', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.190', 'AMMO3': '0.202', 'weapon2': '0.314', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.402', 'WEAPON3': '1.250', 'weapon3': '2.824', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '53.500'} [2023-02-25 14:58:15,356][36156] DAMAGECOUNT value on done: 1526365.0 [2023-02-25 14:58:15,356][36156] Sum rewards: 49.835, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.020', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.031', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'weapon5': '0.192', 'AMMO3': '0.256', 'weapon2': '0.286', 'WEAPON4': '0.300', 'weapon4': '0.316', 'WEAPON3': '1.550', 'HITCOUNT': '2.670', 'weapon3': '2.890', 'DAMAGECOUNT': '13.800', 'FRAGCOUNT': '48.000'} [2023-02-25 14:58:15,438][36156] DAMAGECOUNT value on done: 1542642.0 [2023-02-25 14:58:15,439][36156] Sum rewards: 58.240, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.964', 'AMMO2': '0.006', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.176', 'weapon4': '0.288', 'weapon2': '0.922', 'WEAPON3': '0.950', 'weapon3': '2.404', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.025', 'FRAGCOUNT': '48.000'} [2023-02-25 14:58:15,748][36156] DAMAGECOUNT value on done: 1532873.0 [2023-02-25 14:58:15,748][36156] Sum rewards: 59.861, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.832', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.084', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'weapon2': '0.316', 'weapon4': '0.452', 'WEAPON3': '1.150', 'weapon3': '2.930', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.468', 'FRAGCOUNT': '52.000'} [2023-02-25 14:58:17,009][36155] Large shaping reward 2.566 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.546, 182.0)] [2023-02-25 14:58:17,509][36138] Updated weights for policy 0, policy_version 57603 (0.0010) [2023-02-25 14:58:19,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13551.5). Total num frames: 235970560. Throughput: 0: 3386.7. Samples: 21490196. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:58:19,730][36114] Avg episode reward: [(0, '60.415')] [2023-02-25 14:58:20,562][36138] Updated weights for policy 0, policy_version 57613 (0.0009) [2023-02-25 14:58:22,407][36139] DAMAGECOUNT value on done: 1538592.0 [2023-02-25 14:58:22,407][36139] Sum rewards: 55.246, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.478', 'AMMO5': '0.021', 'AMMO2': '0.062', 'weapon4': '0.124', 'AMMO3': '0.128', 'AMMO4': '0.308', 'weapon5': '0.336', 'weapon2': '0.454', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '0.950', 'HITCOUNT': '2.720', 'weapon3': '2.806', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '47.000'} [2023-02-25 14:58:22,562][36155] DAMAGECOUNT value on done: 1530811.0 [2023-02-25 14:58:22,562][36155] Sum rewards: 58.798, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.207', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.264', 'AMMO3': '0.265', 'weapon4': '0.278', 'weapon2': '0.398', 'WEAPON3': '1.500', 'weapon3': '2.724', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.144', 'FRAGCOUNT': '54.000'} [2023-02-25 14:58:22,691][36139] DAMAGECOUNT value on done: 1538776.0 [2023-02-25 14:58:22,691][36139] Sum rewards: 55.546, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.488', 'AMMO5': '0.017', 'AMMO2': '0.048', 'AMMO3': '0.169', 'weapon5': '0.178', 'AMMO4': '0.241', 'weapon2': '0.324', 'WEAPON5': '0.500', 'weapon4': '0.568', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.580', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '49.000'} [2023-02-25 14:58:22,861][36154] DAMAGECOUNT value on done: 1540131.0 [2023-02-25 14:58:22,861][36154] Sum rewards: 62.141, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.534', 'AMMO5': '0.004', 'AMMO2': '0.011', 'weapon5': '0.018', 'weapon4': '0.026', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.271', 'weapon2': '0.484', 'WEAPON3': '1.650', 'weapon3': '3.222', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.765', 'FRAGCOUNT': '57.500'} [2023-02-25 14:58:22,864][36155] DAMAGECOUNT value on done: 1532214.0 [2023-02-25 14:58:22,864][36155] Sum rewards: 60.340, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.335', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.068', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.206', 'weapon4': '0.212', 'weapon2': '0.498', 'WEAPON3': '1.200', 'weapon3': '3.002', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.099', 'FRAGCOUNT': '52.000'} [2023-02-25 14:58:23,053][36139] DAMAGECOUNT value on done: 1545860.0 [2023-02-25 14:58:23,054][36139] Sum rewards: 57.830, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.145', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.074', 'weapon2': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon4': '0.348', 'WEAPON3': '1.300', 'HITCOUNT': '3.040', 'weapon3': '3.178', 'DAMAGECOUNT': '14.481', 'FRAGCOUNT': '51.000'} [2023-02-25 14:58:23,161][36154] DAMAGECOUNT value on done: 1517245.0 [2023-02-25 14:58:23,161][36154] Sum rewards: 57.582, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.543', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.126', 'AMMO3': '0.133', 'AMMO4': '0.183', 'weapon5': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.364', 'WEAPON3': '0.850', 'HITCOUNT': '2.950', 'weapon3': '3.010', 'DAMAGECOUNT': '13.836', 'FRAGCOUNT': '48.000'} [2023-02-25 14:58:23,363][36139] DAMAGECOUNT value on done: 1547490.0 [2023-02-25 14:58:23,364][36139] Sum rewards: 67.535, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.936', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.126', 'AMMO4': '0.127', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.238', 'weapon2': '0.304', 'WEAPON3': '1.200', 'weapon3': '3.108', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.007', 'FRAGCOUNT': '55.000'} [2023-02-25 14:58:23,497][36154] DAMAGECOUNT value on done: 1550753.0 [2023-02-25 14:58:23,498][36154] Sum rewards: 55.080, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.675', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon2': '0.158', 'AMMO4': '0.184', 'AMMO3': '0.248', 'weapon5': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.420', 'WEAPON3': '1.350', 'weapon3': '2.762', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.139', 'FRAGCOUNT': '50.000'} [2023-02-25 14:58:23,513][36155] DAMAGECOUNT value on done: 1550336.0 [2023-02-25 14:58:23,513][36155] Sum rewards: 60.532, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.432', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.042', 'AMMO3': '0.099', 'weapon5': '0.144', 'AMMO4': '0.209', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.612', 'weapon4': '0.644', 'WEAPON3': '0.650', 'weapon3': '2.376', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.121', 'FRAGCOUNT': '49.000'} [2023-02-25 14:58:23,573][36138] Updated weights for policy 0, policy_version 57623 (0.0009) [2023-02-25 14:58:23,806][36154] DAMAGECOUNT value on done: 1534134.0 [2023-02-25 14:58:23,806][36154] Sum rewards: 74.081, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.017', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'AMMO3': '0.181', 'weapon2': '0.286', 'weapon4': '0.288', 'WEAPON3': '1.000', 'weapon3': '3.276', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '61.000'} [2023-02-25 14:58:23,812][36155] DAMAGECOUNT value on done: 1535130.0 [2023-02-25 14:58:23,813][36155] Sum rewards: 67.086, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.345', 'AMMO5': '0.009', 'AMMO2': '0.050', 'weapon5': '0.082', 'AMMO3': '0.208', 'weapon4': '0.216', 'AMMO4': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.564', 'WEAPON3': '1.250', 'weapon3': '2.868', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.966', 'FRAGCOUNT': '59.000'} [2023-02-25 14:58:24,729][36114] Fps is (10 sec: 13516.6, 60 sec: 13516.8, 300 sec: 13551.5). Total num frames: 236036096. Throughput: 0: 3388.8. Samples: 21500444. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:58:24,730][36114] Avg episode reward: [(0, '60.581')] [2023-02-25 14:58:24,894][36141] DAMAGECOUNT value on done: 1540594.0 [2023-02-25 14:58:24,895][36141] Sum rewards: 69.228, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.370', 'weapon7': '0.002', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.100', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.312', 'weapon2': '0.446', 'WEAPON3': '1.100', 'weapon3': '2.770', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '58.000'} [2023-02-25 14:58:25,161][36141] DAMAGECOUNT value on done: 1533895.0 [2023-02-25 14:58:25,161][36141] Sum rewards: 64.993, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.635', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.143', 'AMMO3': '0.199', 'weapon5': '0.240', 'weapon2': '0.322', 'weapon4': '0.360', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.768', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '57.000'} [2023-02-25 14:58:25,209][36141] DAMAGECOUNT value on done: 1544089.0 [2023-02-25 14:58:25,209][36141] Sum rewards: 58.754, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.658', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.166', 'AMMO3': '0.179', 'AMMO4': '0.207', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.486', 'weapon4': '0.534', 'WEAPON3': '1.050', 'weapon3': '2.544', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.354', 'FRAGCOUNT': '51.000'} [2023-02-25 14:58:25,465][36141] DAMAGECOUNT value on done: 1520639.0 [2023-02-25 14:58:25,466][36141] Sum rewards: 72.893, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.078', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon5': '0.136', 'AMMO3': '0.192', 'AMMO4': '0.202', 'weapon4': '0.264', 'weapon2': '0.278', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.084', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '62.000'} [2023-02-25 14:58:26,567][36138] Updated weights for policy 0, policy_version 57633 (0.0009) [2023-02-25 14:58:28,173][36157] DAMAGECOUNT value on done: 1551362.0 [2023-02-25 14:58:28,174][36157] Sum rewards: 58.166, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.846', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO3': '0.169', 'AMMO4': '0.172', 'weapon2': '0.184', 'weapon5': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.502', 'WEAPON3': '1.000', 'weapon3': '2.712', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '48.000'} [2023-02-25 14:58:28,470][36157] DAMAGECOUNT value on done: 1537141.0 [2023-02-25 14:58:28,470][36157] Sum rewards: 71.592, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.430', 'AMMO5': '0.017', 'AMMO2': '0.048', 'AMMO3': '0.187', 'AMMO4': '0.240', 'weapon5': '0.246', 'weapon2': '0.322', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.502', 'WEAPON3': '1.100', 'weapon3': '2.494', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '61.000'} [2023-02-25 14:58:28,916][36157] DAMAGECOUNT value on done: 1554737.0 [2023-02-25 14:58:28,916][36157] Sum rewards: 69.362, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.830', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon4': '0.094', 'weapon5': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.214', 'AMMO3': '0.263', 'WEAPON3': '1.700', 'weapon3': '3.366', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.603', 'FRAGCOUNT': '60.000'} [2023-02-25 14:58:29,239][36157] DAMAGECOUNT value on done: 1544905.0 [2023-02-25 14:58:29,239][36157] Sum rewards: 66.595, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.914', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.018', 'weapon5': '0.046', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'weapon4': '0.248', 'weapon2': '0.368', 'WEAPON3': '1.350', 'weapon3': '3.136', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.322', 'FRAGCOUNT': '57.000'} [2023-02-25 14:58:29,601][36138] Updated weights for policy 0, policy_version 57643 (0.0009) [2023-02-25 14:58:29,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13585.1, 300 sec: 13551.5). Total num frames: 236105728. Throughput: 0: 3393.1. Samples: 21520878. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:58:29,729][36114] Avg episode reward: [(0, '60.920')] [2023-02-25 14:58:29,806][36140] DAMAGECOUNT value on done: 1550926.0 [2023-02-25 14:58:29,806][36140] Sum rewards: 60.700, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.970', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon2': '0.122', 'WEAPON4': '0.150', 'weapon4': '0.248', 'AMMO3': '0.256', 'WEAPON3': '1.500', 'HITCOUNT': '3.260', 'weapon3': '3.460', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '54.000'} [2023-02-25 14:58:30,012][36140] DAMAGECOUNT value on done: 1545348.0 [2023-02-25 14:58:30,012][36140] Sum rewards: 61.941, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.350', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.062', 'weapon5': '0.094', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'weapon2': '0.232', 'WEAPON4': '0.300', 'weapon4': '0.712', 'WEAPON3': '1.000', 'weapon3': '2.738', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.871', 'FRAGCOUNT': '52.000'} [2023-02-25 14:58:30,118][36140] DAMAGECOUNT value on done: 1528352.0 [2023-02-25 14:58:30,119][36140] Sum rewards: 62.750, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.835', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon4': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.268', 'weapon2': '0.310', 'WEAPON3': '1.600', 'HITCOUNT': '3.230', 'weapon3': '3.398', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '57.000'} [2023-02-25 14:58:30,340][36140] DAMAGECOUNT value on done: 1537510.0 [2023-02-25 14:58:30,340][36140] Sum rewards: 68.200, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.067', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO3': '0.137', 'AMMO4': '0.185', 'weapon5': '0.196', 'weapon2': '0.306', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '0.850', 'weapon4': '0.966', 'weapon3': '2.202', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '57.000'} [2023-02-25 14:58:32,591][36138] Updated weights for policy 0, policy_version 57653 (0.0009) [2023-02-25 14:58:33,882][36142] DAMAGECOUNT value on done: 1533306.0 [2023-02-25 14:58:33,882][36142] Sum rewards: 72.961, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.456', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.144', 'AMMO3': '0.168', 'weapon2': '0.198', 'AMMO4': '0.247', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.734', 'WEAPON3': '1.000', 'weapon3': '2.700', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '60.000'} [2023-02-25 14:58:34,195][36142] DAMAGECOUNT value on done: 1526398.0 [2023-02-25 14:58:34,196][36142] Sum rewards: 48.335, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.757', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.180', 'AMMO4': '0.184', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.384', 'WEAPON4': '0.450', 'weapon4': '0.494', 'WEAPON3': '1.200', 'weapon3': '2.688', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.926', 'FRAGCOUNT': '43.000'} [2023-02-25 14:58:34,729][36114] Fps is (10 sec: 13926.7, 60 sec: 13585.1, 300 sec: 13551.5). Total num frames: 236175360. Throughput: 0: 3391.8. Samples: 21541252. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:58:34,730][36114] Avg episode reward: [(0, '61.341')] [2023-02-25 14:58:34,762][36142] DAMAGECOUNT value on done: 1539673.0 [2023-02-25 14:58:34,763][36142] Sum rewards: 59.299, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.162', 'AMMO5': '0.024', 'AMMO2': '0.063', 'AMMO3': '0.196', 'AMMO4': '0.313', 'weapon5': '0.426', 'weapon2': '0.460', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.826', 'WEAPON3': '1.100', 'weapon3': '1.950', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '50.000'} [2023-02-25 14:58:34,968][36156] DAMAGECOUNT value on done: 1553893.0 [2023-02-25 14:58:34,969][36156] Sum rewards: 58.302, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.042', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon5': '0.206', 'weapon2': '0.232', 'AMMO4': '0.234', 'AMMO3': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.404', 'WEAPON3': '1.450', 'weapon3': '2.872', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.528', 'FRAGCOUNT': '52.000'} [2023-02-25 14:58:35,072][36142] DAMAGECOUNT value on done: 1545825.0 [2023-02-25 14:58:35,073][36142] Sum rewards: 61.322, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.552', 'AMMO5': '0.005', 'AMMO2': '0.048', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'AMMO4': '0.241', 'WEAPON4': '0.400', 'weapon4': '0.444', 'weapon2': '0.452', 'WEAPON3': '1.100', 'weapon3': '2.832', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.117', 'FRAGCOUNT': '53.000'} [2023-02-25 14:58:35,285][36156] DAMAGECOUNT value on done: 1531657.0 [2023-02-25 14:58:35,286][36156] Sum rewards: 55.476, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.093', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.090', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.256', 'AMMO3': '0.263', 'weapon2': '0.454', 'WEAPON3': '1.600', 'weapon3': '2.924', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.876', 'FRAGCOUNT': '50.000'} [2023-02-25 14:58:35,391][36156] DAMAGECOUNT value on done: 1547487.0 [2023-02-25 14:58:35,392][36156] Sum rewards: 45.350, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.330', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon5': '0.170', 'weapon4': '0.212', 'AMMO3': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.650', 'HITCOUNT': '2.730', 'weapon3': '2.972', 'DAMAGECOUNT': '14.535', 'FRAGCOUNT': '43.000'} [2023-02-25 14:58:35,652][36138] Updated weights for policy 0, policy_version 57663 (0.0009) [2023-02-25 14:58:35,693][36156] DAMAGECOUNT value on done: 1538287.0 [2023-02-25 14:58:35,693][36156] Sum rewards: 60.322, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.092', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.041', 'AMMO3': '0.167', 'AMMO4': '0.207', 'WEAPON5': '0.250', 'weapon5': '0.318', 'WEAPON4': '0.400', 'weapon2': '0.492', 'weapon4': '0.540', 'WEAPON3': '0.950', 'weapon3': '2.432', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.242', 'FRAGCOUNT': '51.000'} [2023-02-25 14:58:36,598][36139] Large shaping reward -2.533 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28200000000000003, -94.0), ('AMMO5', -0.0005, -1.0)] [2023-02-25 14:58:37,792][36139] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 14:58:38,641][36138] Updated weights for policy 0, policy_version 57673 (0.0009) [2023-02-25 14:58:39,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13585.1, 300 sec: 13551.5). Total num frames: 236240896. Throughput: 0: 3391.1. Samples: 21551470. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:58:39,730][36114] Avg episode reward: [(0, '61.276')] [2023-02-25 14:58:41,672][36138] Updated weights for policy 0, policy_version 57683 (0.0009) [2023-02-25 14:58:42,055][36139] DAMAGECOUNT value on done: 1544202.0 [2023-02-25 14:58:42,056][36139] Sum rewards: 60.108, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.120', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon2': '0.166', 'AMMO3': '0.203', 'WEAPON5': '0.300', 'weapon5': '0.378', 'WEAPON4': '0.400', 'weapon4': '0.714', 'WEAPON3': '1.250', 'weapon3': '2.480', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '52.000'} [2023-02-25 14:58:42,290][36155] DAMAGECOUNT value on done: 1536464.0 [2023-02-25 14:58:42,291][36155] Sum rewards: 63.784, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.700', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.050', 'AMMO3': '0.181', 'AMMO4': '0.252', 'weapon2': '0.300', 'weapon5': '0.324', 'weapon4': '0.476', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.510', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '55.000'} [2023-02-25 14:58:42,359][36139] DAMAGECOUNT value on done: 1544565.0 [2023-02-25 14:58:42,359][36139] Sum rewards: 63.788, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.538', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.050', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.120', 'AMMO3': '0.303', 'WEAPON3': '1.800', 'HITCOUNT': '3.510', 'weapon3': '3.620', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '57.500'} [2023-02-25 14:58:42,575][36154] DAMAGECOUNT value on done: 1545009.0 [2023-02-25 14:58:42,576][36154] Sum rewards: 52.033, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-0.715', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon5': '0.198', 'AMMO3': '0.201', 'weapon2': '0.238', 'AMMO4': '0.276', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'weapon4': '0.604', 'WEAPON3': '1.150', 'weapon3': '2.604', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.634', 'FRAGCOUNT': '47.500'} [2023-02-25 14:58:42,590][36155] DAMAGECOUNT value on done: 1537529.0 [2023-02-25 14:58:42,591][36155] Sum rewards: 62.784, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.137', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.027', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'weapon2': '0.198', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'weapon4': '0.664', 'WEAPON3': '1.400', 'weapon3': '2.878', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.945', 'FRAGCOUNT': '56.000'} [2023-02-25 14:58:42,731][36139] DAMAGECOUNT value on done: 1551315.0 [2023-02-25 14:58:42,732][36139] Sum rewards: 65.931, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.646', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO4': '0.184', 'AMMO3': '0.191', 'weapon5': '0.204', 'weapon2': '0.252', 'weapon4': '0.342', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.906', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '16.362', 'FRAGCOUNT': '57.000'} [2023-02-25 14:58:42,876][36154] DAMAGECOUNT value on done: 1523240.0 [2023-02-25 14:58:42,877][36154] Sum rewards: 66.903, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.746', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.098', 'AMMO3': '0.170', 'AMMO4': '0.181', 'WEAPON5': '0.250', 'weapon2': '0.258', 'WEAPON4': '0.400', 'weapon4': '0.474', 'WEAPON3': '1.150', 'weapon3': '2.924', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '57.000'} [2023-02-25 14:58:43,035][36139] DAMAGECOUNT value on done: 1551612.0 [2023-02-25 14:58:43,035][36139] Sum rewards: 53.702, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.402', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.076', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'weapon2': '0.324', 'weapon4': '0.466', 'WEAPON3': '1.150', 'HITCOUNT': '2.670', 'weapon3': '2.940', 'DAMAGECOUNT': '12.366', 'FRAGCOUNT': '49.000'} [2023-02-25 14:58:43,224][36154] DAMAGECOUNT value on done: 1556301.0 [2023-02-25 14:58:43,225][36154] Sum rewards: 65.152, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.054', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'weapon5': '0.120', 'AMMO3': '0.138', 'WEAPON4': '0.250', 'weapon2': '0.292', 'weapon4': '0.820', 'WEAPON3': '0.900', 'weapon3': '2.520', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '52.000'} [2023-02-25 14:58:43,227][36155] DAMAGECOUNT value on done: 1554289.0 [2023-02-25 14:58:43,228][36155] Sum rewards: 46.655, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.822', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.101', 'weapon4': '0.162', 'AMMO3': '0.173', 'WEAPON4': '0.250', 'weapon2': '0.848', 'WEAPON3': '1.100', 'HITCOUNT': '2.630', 'weapon3': '2.818', 'DAMAGECOUNT': '11.814', 'FRAGCOUNT': '42.000'} [2023-02-25 14:58:43,528][36154] DAMAGECOUNT value on done: 1539208.0 [2023-02-25 14:58:43,528][36154] Sum rewards: 64.504, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.876', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.080', 'AMMO4': '0.096', 'AMMO3': '0.150', 'weapon5': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.692', 'WEAPON3': '0.950', 'weapon3': '2.800', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.222', 'FRAGCOUNT': '53.500'} [2023-02-25 14:58:43,533][36155] DAMAGECOUNT value on done: 1540527.0 [2023-02-25 14:58:43,534][36155] Sum rewards: 63.019, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.119', 'AMMO5': '0.013', 'AMMO2': '0.029', 'AMMO4': '0.147', 'AMMO3': '0.187', 'weapon5': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.428', 'weapon4': '0.476', 'WEAPON3': '1.150', 'weapon3': '2.732', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '54.000'} [2023-02-25 14:58:44,672][36141] DAMAGECOUNT value on done: 1544732.0 [2023-02-25 14:58:44,672][36141] Sum rewards: 51.594, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.790', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO3': '0.124', 'AMMO4': '0.197', 'weapon5': '0.230', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON4': '0.550', 'WEAPON3': '0.700', 'weapon4': '1.132', 'weapon3': '2.116', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.414', 'FRAGCOUNT': '45.000'} [2023-02-25 14:58:44,678][36138] Updated weights for policy 0, policy_version 57693 (0.0009) [2023-02-25 14:58:44,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13551.5). Total num frames: 236310528. Throughput: 0: 3395.8. Samples: 21571844. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:58:44,730][36114] Avg episode reward: [(0, '61.215')] [2023-02-25 14:58:44,921][36141] DAMAGECOUNT value on done: 1539033.0 [2023-02-25 14:58:44,922][36141] Sum rewards: 54.529, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.798', 'AMMO5': '0.021', 'AMMO2': '0.062', 'weapon5': '0.190', 'AMMO3': '0.240', 'AMMO4': '0.310', 'weapon4': '0.354', 'weapon2': '0.428', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.668', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '15.414', 'FRAGCOUNT': '51.000'} [2023-02-25 14:58:44,977][36141] DAMAGECOUNT value on done: 1548696.0 [2023-02-25 14:58:44,978][36141] Sum rewards: 65.512, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.195', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.082', 'weapon2': '0.146', 'AMMO3': '0.201', 'weapon4': '0.310', 'WEAPON3': '1.200', 'HITCOUNT': '2.980', 'weapon3': '3.312', 'DAMAGECOUNT': '13.821', 'FRAGCOUNT': '56.000'} [2023-02-25 14:58:45,239][36141] DAMAGECOUNT value on done: 1526075.0 [2023-02-25 14:58:45,239][36141] Sum rewards: 65.883, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.629', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.100', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon4': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.486', 'WEAPON3': '1.350', 'weapon3': '2.966', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '58.000'} [2023-02-25 14:58:47,697][36138] Updated weights for policy 0, policy_version 57703 (0.0010) [2023-02-25 14:58:48,002][36157] DAMAGECOUNT value on done: 1556343.0 [2023-02-25 14:58:48,002][36157] Sum rewards: 57.755, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.652', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon5': '0.124', 'AMMO4': '0.176', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.564', 'weapon4': '0.610', 'WEAPON3': '1.200', 'weapon3': '2.398', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.943', 'FRAGCOUNT': '49.000'} [2023-02-25 14:58:48,303][36157] DAMAGECOUNT value on done: 1541906.0 [2023-02-25 14:58:48,304][36157] Sum rewards: 53.721, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.735', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.154', 'AMMO4': '0.169', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.402', 'weapon4': '1.014', 'WEAPON3': '1.150', 'weapon3': '1.978', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.295', 'FRAGCOUNT': '47.000'} [2023-02-25 14:58:48,754][36157] DAMAGECOUNT value on done: 1560438.0 [2023-02-25 14:58:48,754][36157] Sum rewards: 66.339, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.782', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.192', 'weapon2': '0.216', 'AMMO3': '0.222', 'AMMO4': '0.233', 'WEAPON5': '0.400', 'weapon4': '0.418', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.872', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '59.500'} [2023-02-25 14:58:49,064][36157] DAMAGECOUNT value on done: 1549682.0 [2023-02-25 14:58:49,065][36157] Sum rewards: 54.632, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.411', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.078', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon2': '0.244', 'WEAPON4': '0.300', 'weapon4': '0.454', 'WEAPON3': '1.150', 'weapon3': '3.048', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.331', 'FRAGCOUNT': '47.000'} [2023-02-25 14:58:49,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13551.5). Total num frames: 236376064. Throughput: 0: 3396.3. Samples: 21592090. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:58:49,730][36114] Avg episode reward: [(0, '61.224')] [2023-02-25 14:58:49,740][36140] DAMAGECOUNT value on done: 1556343.0 [2023-02-25 14:58:49,741][36140] Sum rewards: 63.377, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.035', 'AMMO5': '0.005', 'AMMO2': '0.046', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'weapon2': '0.226', 'AMMO4': '0.228', 'WEAPON4': '0.400', 'weapon4': '0.524', 'WEAPON3': '1.250', 'weapon3': '2.932', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '16.251', 'FRAGCOUNT': '56.000'} [2023-02-25 14:58:49,919][36140] DAMAGECOUNT value on done: 1550433.0 [2023-02-25 14:58:49,919][36140] Sum rewards: 55.682, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.786', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO4': '0.132', 'weapon2': '0.170', 'weapon5': '0.186', 'weapon4': '0.232', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.900', 'weapon3': '3.114', 'DAMAGECOUNT': '15.255', 'FRAGCOUNT': '49.500'} [2023-02-25 14:58:50,061][36140] DAMAGECOUNT value on done: 1534367.0 [2023-02-25 14:58:50,061][36140] Sum rewards: 74.247, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.665', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'weapon4': '0.120', 'AMMO4': '0.145', 'AMMO3': '0.198', 'weapon2': '0.258', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.456', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '63.000'} [2023-02-25 14:58:50,249][36140] DAMAGECOUNT value on done: 1543837.0 [2023-02-25 14:58:50,250][36140] Sum rewards: 79.257, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.895', 'ARMOR': '0.004', 'AMMO2': '0.011', 'weapon4': '0.054', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'AMMO3': '0.239', 'weapon2': '0.472', 'WEAPON3': '1.400', 'weapon3': '3.276', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.981', 'FRAGCOUNT': '67.000'} [2023-02-25 14:58:50,722][36138] Updated weights for policy 0, policy_version 57713 (0.0009) [2023-02-25 14:58:53,666][36142] DAMAGECOUNT value on done: 1538779.0 [2023-02-25 14:58:53,666][36142] Sum rewards: 64.092, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.598', 'AMMO5': '0.006', 'AMMO2': '0.013', 'weapon4': '0.028', 'AMMO4': '0.064', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.292', 'weapon2': '0.384', 'WEAPON3': '1.750', 'weapon3': '3.256', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '59.000'} [2023-02-25 14:58:53,765][36138] Updated weights for policy 0, policy_version 57723 (0.0009) [2023-02-25 14:58:53,971][36142] DAMAGECOUNT value on done: 1531398.0 [2023-02-25 14:58:53,972][36142] Sum rewards: 58.379, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.348', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.098', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'weapon4': '0.278', 'weapon2': '0.326', 'WEAPON3': '1.450', 'HITCOUNT': '2.970', 'weapon3': '3.070', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '51.000'} [2023-02-25 14:58:54,559][36142] DAMAGECOUNT value on done: 1544631.0 [2023-02-25 14:58:54,560][36142] Sum rewards: 59.111, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.553', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.175', 'weapon5': '0.206', 'WEAPON4': '0.300', 'weapon2': '0.328', 'WEAPON5': '0.350', 'weapon4': '0.408', 'WEAPON3': '1.000', 'weapon3': '2.832', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.874', 'FRAGCOUNT': '51.000'} [2023-02-25 14:58:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13551.5). Total num frames: 236445696. Throughput: 0: 3394.5. Samples: 21602242. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:58:54,730][36114] Avg episode reward: [(0, '61.435')] [2023-02-25 14:58:54,882][36142] DAMAGECOUNT value on done: 1550484.0 [2023-02-25 14:58:54,883][36142] Sum rewards: 60.464, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.776', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.148', 'weapon5': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.376', 'WEAPON3': '0.850', 'weapon4': '0.960', 'weapon3': '2.064', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.977', 'FRAGCOUNT': '50.000'} [2023-02-25 14:58:54,998][36156] DAMAGECOUNT value on done: 1558589.0 [2023-02-25 14:58:54,998][36156] Sum rewards: 52.504, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.490', 'AMMO5': '0.014', 'AMMO2': '0.041', 'AMMO3': '0.204', 'AMMO4': '0.206', 'weapon5': '0.244', 'weapon2': '0.312', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.830', 'WEAPON3': '1.150', 'weapon3': '2.214', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.088', 'FRAGCOUNT': '45.000'} [2023-02-25 14:58:55,308][36156] DAMAGECOUNT value on done: 1536470.0 [2023-02-25 14:58:55,308][36156] Sum rewards: 53.655, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.392', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.144', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon2': '0.264', 'weapon4': '0.294', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.850', 'weapon3': '3.074', 'DAMAGECOUNT': '14.439', 'FRAGCOUNT': '49.000'} [2023-02-25 14:58:55,380][36156] DAMAGECOUNT value on done: 1554543.0 [2023-02-25 14:58:55,381][36156] Sum rewards: 84.924, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.115', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.060', 'AMMO4': '0.123', 'weapon5': '0.140', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.370', 'WEAPON3': '1.250', 'weapon3': '3.232', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '21.168', 'FRAGCOUNT': '69.000'} [2023-02-25 14:58:55,685][36156] DAMAGECOUNT value on done: 1543272.0 [2023-02-25 14:58:55,686][36156] Sum rewards: 62.461, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.766', 'AMMO2': '0.006', 'AMMO4': '0.029', 'AMMO3': '0.187', 'weapon2': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '3.240', 'weapon3': '3.460', 'DAMAGECOUNT': '14.955', 'FRAGCOUNT': '51.000'} [2023-02-25 14:58:56,792][36138] Updated weights for policy 0, policy_version 57733 (0.0009) [2023-02-25 14:58:57,475][36139] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:58:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13551.5). Total num frames: 236511232. Throughput: 0: 3390.0. Samples: 21622478. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:58:59,729][36114] Avg episode reward: [(0, '61.819')] [2023-02-25 14:58:59,733][36125] Saving new best policy, reward=61.819! [2023-02-25 14:58:59,848][36138] Updated weights for policy 0, policy_version 57743 (0.0009) [2023-02-25 14:59:01,906][36139] DAMAGECOUNT value on done: 1550012.0 [2023-02-25 14:59:01,907][36139] Sum rewards: 69.749, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.719', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.058', 'weapon5': '0.146', 'AMMO3': '0.165', 'AMMO4': '0.289', 'weapon2': '0.384', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.594', 'WEAPON3': '1.150', 'weapon3': '2.622', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '60.000'} [2023-02-25 14:59:02,135][36155] DAMAGECOUNT value on done: 1541428.0 [2023-02-25 14:59:02,135][36155] Sum rewards: 49.452, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.090', 'AMMO5': '0.012', 'ARMOR': '0.032', 'AMMO2': '0.040', 'weapon5': '0.132', 'weapon4': '0.188', 'AMMO4': '0.201', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.464', 'WEAPON3': '1.200', 'HITCOUNT': '2.870', 'weapon3': '2.952', 'DAMAGECOUNT': '14.892', 'FRAGCOUNT': '42.000'} [2023-02-25 14:59:02,230][36139] DAMAGECOUNT value on done: 1550060.0 [2023-02-25 14:59:02,231][36139] Sum rewards: 70.791, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.117', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.171', 'weapon5': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.358', 'weapon4': '0.720', 'WEAPON3': '1.100', 'weapon3': '2.472', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '59.000'} [2023-02-25 14:59:02,453][36155] DAMAGECOUNT value on done: 1542738.0 [2023-02-25 14:59:02,453][36155] Sum rewards: 59.111, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.960', 'AMMO5': '0.011', 'AMMO2': '0.047', 'AMMO3': '0.185', 'weapon5': '0.186', 'AMMO4': '0.234', 'WEAPON5': '0.300', 'weapon4': '0.388', 'weapon2': '0.474', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.638', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '15.627', 'FRAGCOUNT': '51.000'} [2023-02-25 14:59:02,476][36154] DAMAGECOUNT value on done: 1551163.0 [2023-02-25 14:59:02,477][36154] Sum rewards: 67.146, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.222', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.196', 'WEAPON4': '0.400', 'weapon2': '0.450', 'weapon4': '0.538', 'WEAPON3': '1.250', 'weapon3': '2.694', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '56.500'} [2023-02-25 14:59:02,557][36139] DAMAGECOUNT value on done: 1556637.0 [2023-02-25 14:59:02,558][36139] Sum rewards: 64.066, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.525', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO3': '0.135', 'AMMO4': '0.141', 'weapon5': '0.208', 'weapon2': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'weapon4': '0.986', 'weapon3': '2.310', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.966', 'FRAGCOUNT': '51.000'} [2023-02-25 14:59:02,773][36154] DAMAGECOUNT value on done: 1528346.0 [2023-02-25 14:59:02,774][36154] Sum rewards: 63.458, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.270', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO3': '0.158', 'AMMO4': '0.179', 'weapon5': '0.216', 'WEAPON4': '0.300', 'weapon4': '0.338', 'WEAPON5': '0.350', 'weapon2': '0.468', 'WEAPON3': '1.050', 'weapon3': '2.700', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.318', 'FRAGCOUNT': '53.000'} [2023-02-25 14:59:02,865][36139] DAMAGECOUNT value on done: 1556504.0 [2023-02-25 14:59:02,866][36139] Sum rewards: 53.257, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.943', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.126', 'weapon4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.255', 'weapon2': '0.420', 'WEAPON3': '1.500', 'weapon3': '3.152', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '48.000'} [2023-02-25 14:59:02,920][36138] Updated weights for policy 0, policy_version 57753 (0.0010) [2023-02-25 14:59:03,077][36155] DAMAGECOUNT value on done: 1559139.0 [2023-02-25 14:59:03,077][36155] Sum rewards: 51.084, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.278', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.166', 'weapon4': '0.196', 'AMMO4': '0.215', 'AMMO3': '0.242', 'weapon2': '0.298', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.026', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.070', 'FRAGCOUNT': '48.000'} [2023-02-25 14:59:03,136][36154] DAMAGECOUNT value on done: 1561598.0 [2023-02-25 14:59:03,136][36154] Sum rewards: 57.441, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.063', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.171', 'AMMO3': '0.213', 'weapon2': '0.314', 'weapon4': '0.392', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.004', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.891', 'FRAGCOUNT': '50.000'} [2023-02-25 14:59:03,389][36155] DAMAGECOUNT value on done: 1545114.0 [2023-02-25 14:59:03,389][36155] Sum rewards: 56.550, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.255', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.145', 'WEAPON4': '0.300', 'weapon2': '0.382', 'weapon4': '0.442', 'WEAPON3': '0.900', 'weapon3': '2.846', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.761', 'FRAGCOUNT': '47.000'} [2023-02-25 14:59:03,432][36154] DAMAGECOUNT value on done: 1543940.0 [2023-02-25 14:59:03,433][36154] Sum rewards: 55.441, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.617', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.092', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'weapon2': '0.166', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'weapon4': '0.620', 'WEAPON3': '1.200', 'weapon3': '2.692', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.196', 'FRAGCOUNT': '49.000'} [2023-02-25 14:59:04,486][36141] DAMAGECOUNT value on done: 1549919.0 [2023-02-25 14:59:04,486][36141] Sum rewards: 63.343, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.840', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.050', 'AMMO4': '0.099', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon4': '0.294', 'weapon2': '0.308', 'WEAPON3': '1.250', 'weapon3': '3.184', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.561', 'FRAGCOUNT': '54.000'} [2023-02-25 14:59:04,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13551.5). Total num frames: 236580864. Throughput: 0: 3389.1. Samples: 21642706. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:59:04,730][36114] Avg episode reward: [(0, '61.651')] [2023-02-25 14:59:04,798][36141] DAMAGECOUNT value on done: 1544500.0 [2023-02-25 14:59:04,799][36141] Sum rewards: 65.744, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.235', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.051', 'AMMO3': '0.125', 'weapon2': '0.170', 'weapon5': '0.250', 'AMMO4': '0.257', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '0.850', 'weapon4': '0.992', 'weapon3': '2.322', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.401', 'FRAGCOUNT': '55.000'} [2023-02-25 14:59:04,808][36141] DAMAGECOUNT value on done: 1553552.0 [2023-02-25 14:59:04,809][36141] Sum rewards: 58.237, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.000', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.080', 'AMMO4': '0.144', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon2': '0.342', 'weapon4': '0.512', 'WEAPON3': '1.300', 'weapon3': '2.862', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.568', 'FRAGCOUNT': '50.000'} [2023-02-25 14:59:05,114][36141] DAMAGECOUNT value on done: 1531400.0 [2023-02-25 14:59:05,114][36141] Sum rewards: 64.378, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.586', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.030', 'AMMO4': '0.055', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.246', 'weapon2': '0.290', 'WEAPON3': '1.400', 'HITCOUNT': '3.060', 'weapon3': '3.292', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '56.000'} [2023-02-25 14:59:05,894][36138] Updated weights for policy 0, policy_version 57763 (0.0010) [2023-02-25 14:59:07,958][36157] DAMAGECOUNT value on done: 1562252.0 [2023-02-25 14:59:07,959][36157] Sum rewards: 68.705, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.066', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.286', 'WEAPON4': '0.300', 'weapon4': '0.536', 'WEAPON3': '1.200', 'weapon3': '2.862', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '57.000'} [2023-02-25 14:59:08,271][36157] DAMAGECOUNT value on done: 1548783.0 [2023-02-25 14:59:08,271][36157] Sum rewards: 79.008, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.224', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.047', 'AMMO3': '0.132', 'weapon5': '0.216', 'AMMO4': '0.237', 'WEAPON5': '0.300', 'weapon2': '0.378', 'WEAPON4': '0.500', 'weapon4': '0.546', 'WEAPON3': '0.750', 'weapon3': '2.624', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '20.631', 'FRAGCOUNT': '63.000'} [2023-02-25 14:59:08,775][36157] DAMAGECOUNT value on done: 1566318.0 [2023-02-25 14:59:08,775][36157] Sum rewards: 71.666, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.434', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'weapon2': '0.184', 'weapon4': '0.218', 'AMMO3': '0.234', 'WEAPON3': '1.450', 'weapon3': '3.440', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '61.000'} [2023-02-25 14:59:08,919][36138] Updated weights for policy 0, policy_version 57773 (0.0009) [2023-02-25 14:59:09,084][36157] DAMAGECOUNT value on done: 1554488.0 [2023-02-25 14:59:09,084][36157] Sum rewards: 56.782, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.207', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.056', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'AMMO4': '0.214', 'WEAPON4': '0.350', 'weapon2': '0.446', 'weapon4': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.714', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.382', 'FRAGCOUNT': '47.500'} [2023-02-25 14:59:09,700][36140] DAMAGECOUNT value on done: 1560688.0 [2023-02-25 14:59:09,701][36140] Sum rewards: 45.798, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.824', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'weapon2': '0.318', 'weapon4': '0.796', 'WEAPON3': '1.200', 'weapon3': '2.540', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '13.035', 'FRAGCOUNT': '41.000'} [2023-02-25 14:59:09,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13551.5). Total num frames: 236646400. Throughput: 0: 3387.5. Samples: 21652880. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:59:09,729][36114] Avg episode reward: [(0, '62.094')] [2023-02-25 14:59:09,733][36125] Saving new best policy, reward=62.094! [2023-02-25 14:59:09,872][36140] DAMAGECOUNT value on done: 1554798.0 [2023-02-25 14:59:09,872][36140] Sum rewards: 51.537, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.540', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO3': '0.126', 'AMMO4': '0.157', 'weapon5': '0.256', 'weapon2': '0.264', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.450', 'WEAPON3': '0.800', 'HITCOUNT': '2.440', 'weapon3': '2.792', 'DAMAGECOUNT': '13.095', 'FRAGCOUNT': '43.000'} [2023-02-25 14:59:10,020][36140] DAMAGECOUNT value on done: 1538950.0 [2023-02-25 14:59:10,021][36140] Sum rewards: 57.923, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.122', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.036', 'AMMO3': '0.146', 'AMMO4': '0.178', 'weapon5': '0.196', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.564', 'weapon4': '0.750', 'WEAPON3': '1.000', 'weapon3': '2.184', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.749', 'FRAGCOUNT': '51.000'} [2023-02-25 14:59:10,176][36140] DAMAGECOUNT value on done: 1549474.0 [2023-02-25 14:59:10,176][36140] Sum rewards: 65.399, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.114', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.064', 'AMMO4': '0.130', 'weapon5': '0.200', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.544', 'WEAPON3': '1.350', 'weapon3': '2.932', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '57.000'} [2023-02-25 14:59:11,941][36138] Updated weights for policy 0, policy_version 57783 (0.0009) [2023-02-25 14:59:13,690][36142] DAMAGECOUNT value on done: 1544654.0 [2023-02-25 14:59:13,691][36142] Sum rewards: 63.226, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.815', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.169', 'weapon2': '0.174', 'AMMO3': '0.250', 'weapon4': '0.256', 'weapon5': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '2.958', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '56.000'} [2023-02-25 14:59:14,001][36142] DAMAGECOUNT value on done: 1537069.0 [2023-02-25 14:59:14,002][36142] Sum rewards: 65.236, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.322', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.042', 'AMMO3': '0.131', 'weapon5': '0.180', 'AMMO4': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.424', 'WEAPON4': '0.550', 'weapon4': '0.688', 'WEAPON3': '0.800', 'weapon3': '2.506', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '52.000'} [2023-02-25 14:59:14,570][36142] DAMAGECOUNT value on done: 1549299.0 [2023-02-25 14:59:14,570][36142] Sum rewards: 54.923, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.327', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.067', 'AMMO3': '0.170', 'weapon2': '0.226', 'weapon5': '0.230', 'weapon4': '0.238', 'AMMO4': '0.334', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'HITCOUNT': '2.770', 'weapon3': '3.052', 'DAMAGECOUNT': '13.794', 'FRAGCOUNT': '50.000'} [2023-02-25 14:59:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13551.5). Total num frames: 236716032. Throughput: 0: 3382.7. Samples: 21673100. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:59:14,730][36114] Avg episode reward: [(0, '61.606')] [2023-02-25 14:59:14,849][36156] DAMAGECOUNT value on done: 1564211.0 [2023-02-25 14:59:14,849][36156] Sum rewards: 66.161, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.420', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.126', 'AMMO4': '0.138', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.256', 'weapon2': '0.522', 'WEAPON3': '1.450', 'weapon3': '2.808', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '58.000'} [2023-02-25 14:59:14,881][36142] DAMAGECOUNT value on done: 1555754.0 [2023-02-25 14:59:14,881][36142] Sum rewards: 58.229, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.199', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.170', 'weapon5': '0.192', 'weapon2': '0.236', 'AMMO3': '0.265', 'weapon4': '0.374', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.884', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '54.500'} [2023-02-25 14:59:14,975][36138] Updated weights for policy 0, policy_version 57793 (0.0009) [2023-02-25 14:59:15,152][36156] DAMAGECOUNT value on done: 1541827.0 [2023-02-25 14:59:15,153][36156] Sum rewards: 62.020, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.957', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.066', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon4': '0.226', 'WEAPON4': '0.250', 'weapon2': '0.560', 'WEAPON3': '1.300', 'weapon3': '2.860', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '53.000'} [2023-02-25 14:59:15,237][36156] DAMAGECOUNT value on done: 1558878.0 [2023-02-25 14:59:15,237][36156] Sum rewards: 49.782, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.650', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.094', 'AMMO3': '0.140', 'AMMO4': '0.199', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.520', 'weapon4': '0.796', 'WEAPON3': '0.800', 'weapon3': '2.374', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.005', 'FRAGCOUNT': '42.000'} [2023-02-25 14:59:15,538][36156] DAMAGECOUNT value on done: 1548435.0 [2023-02-25 14:59:15,539][36156] Sum rewards: 57.257, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.700', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.092', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'weapon2': '0.590', 'weapon4': '0.676', 'WEAPON3': '1.000', 'weapon3': '2.412', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '15.489', 'FRAGCOUNT': '45.000'} [2023-02-25 14:59:18,010][36138] Updated weights for policy 0, policy_version 57803 (0.0009) [2023-02-25 14:59:18,414][36154] Large shaping reward 2.619 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.597, 199.0), ('weapon5', 0.002)] [2023-02-25 14:59:19,729][36114] Fps is (10 sec: 13516.6, 60 sec: 13516.8, 300 sec: 13551.5). Total num frames: 236781568. Throughput: 0: 3382.3. Samples: 21693458. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:59:19,730][36114] Avg episode reward: [(0, '61.174')] [2023-02-25 14:59:19,734][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000057808_236781568.pth... [2023-02-25 14:59:19,798][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000057015_233533440.pth [2023-02-25 14:59:21,021][36138] Updated weights for policy 0, policy_version 57813 (0.0009) [2023-02-25 14:59:21,670][36139] DAMAGECOUNT value on done: 1554937.0 [2023-02-25 14:59:21,670][36139] Sum rewards: 56.647, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.000', 'AMMO5': '0.003', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.134', 'WEAPON4': '0.250', 'weapon4': '0.500', 'weapon2': '0.706', 'WEAPON3': '0.850', 'weapon3': '2.414', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '45.000'} [2023-02-25 14:59:21,905][36155] DAMAGECOUNT value on done: 1546410.0 [2023-02-25 14:59:21,905][36155] Sum rewards: 60.750, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.440', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.109', 'AMMO3': '0.140', 'weapon5': '0.204', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.468', 'weapon4': '0.798', 'WEAPON3': '0.850', 'weapon3': '2.300', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.871', 'FRAGCOUNT': '50.000'} [2023-02-25 14:59:21,982][36139] DAMAGECOUNT value on done: 1554991.0 [2023-02-25 14:59:21,982][36139] Sum rewards: 58.759, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.298', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.149', 'weapon5': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.374', 'weapon4': '0.736', 'WEAPON3': '0.900', 'weapon3': '2.538', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.793', 'FRAGCOUNT': '48.000'} [2023-02-25 14:59:22,210][36155] DAMAGECOUNT value on done: 1547110.0 [2023-02-25 14:59:22,211][36155] Sum rewards: 46.747, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.360', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO4': '0.183', 'weapon5': '0.190', 'AMMO3': '0.208', 'weapon2': '0.372', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.658', 'WEAPON3': '1.250', 'weapon3': '2.486', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.116', 'FRAGCOUNT': '43.000'} [2023-02-25 14:59:22,266][36154] DAMAGECOUNT value on done: 1556462.0 [2023-02-25 14:59:22,266][36154] Sum rewards: 64.782, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.586', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon4': '0.118', 'weapon2': '0.150', 'weapon5': '0.182', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '3.100', 'weapon3': '3.336', 'DAMAGECOUNT': '15.897', 'FRAGCOUNT': '58.000'} [2023-02-25 14:59:22,404][36139] DAMAGECOUNT value on done: 1562188.0 [2023-02-25 14:59:22,404][36139] Sum rewards: 64.707, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.078', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.038', 'AMMO3': '0.184', 'AMMO4': '0.190', 'weapon5': '0.212', 'weapon2': '0.268', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.654', 'WEAPON3': '1.150', 'weapon3': '2.524', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '57.000'} [2023-02-25 14:59:22,579][36154] DAMAGECOUNT value on done: 1532880.0 [2023-02-25 14:59:22,580][36154] Sum rewards: 44.231, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.284', 'AMMO5': '0.019', 'AMMO2': '0.063', 'AMMO3': '0.186', 'AMMO4': '0.315', 'weapon5': '0.380', 'weapon2': '0.534', 'weapon4': '0.560', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.100', 'weapon3': '2.168', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '13.599', 'FRAGCOUNT': '42.000'} [2023-02-25 14:59:22,705][36139] DAMAGECOUNT value on done: 1561054.0 [2023-02-25 14:59:22,706][36139] Sum rewards: 44.643, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.460', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.054', 'AMMO3': '0.138', 'AMMO4': '0.271', 'weapon2': '0.284', 'weapon5': '0.340', 'WEAPON5': '0.600', 'WEAPON4': '0.750', 'WEAPON3': '0.850', 'weapon4': '1.064', 'weapon3': '1.966', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '13.650', 'FRAGCOUNT': '39.500'} [2023-02-25 14:59:22,845][36155] DAMAGECOUNT value on done: 1564376.0 [2023-02-25 14:59:22,846][36155] Sum rewards: 58.815, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.736', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.084', 'AMMO4': '0.160', 'AMMO3': '0.200', 'weapon2': '0.276', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.460', 'WEAPON3': '1.250', 'weapon3': '2.950', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '50.500'} [2023-02-25 14:59:22,929][36154] DAMAGECOUNT value on done: 1566707.0 [2023-02-25 14:59:22,929][36154] Sum rewards: 60.767, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.780', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon5': '0.232', 'AMMO4': '0.232', 'AMMO3': '0.245', 'weapon2': '0.314', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.566', 'WEAPON3': '1.450', 'weapon3': '2.550', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.327', 'FRAGCOUNT': '56.000'} [2023-02-25 14:59:23,131][36155] DAMAGECOUNT value on done: 1550244.0 [2023-02-25 14:59:23,131][36155] Sum rewards: 60.849, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.870', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.037', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'weapon4': '0.364', 'weapon2': '0.458', 'WEAPON3': '1.000', 'weapon3': '2.966', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '49.000'} [2023-02-25 14:59:23,227][36154] DAMAGECOUNT value on done: 1549012.0 [2023-02-25 14:59:23,227][36154] Sum rewards: 55.981, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.147', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.132', 'AMMO4': '0.141', 'AMMO3': '0.183', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.456', 'weapon4': '0.564', 'WEAPON3': '1.150', 'weapon3': '2.502', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.216', 'FRAGCOUNT': '48.000'} [2023-02-25 14:59:24,026][36138] Updated weights for policy 0, policy_version 57823 (0.0009) [2023-02-25 14:59:24,364][36141] DAMAGECOUNT value on done: 1554605.0 [2023-02-25 14:59:24,365][36141] Sum rewards: 51.220, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.690', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.024', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'weapon2': '0.142', 'AMMO3': '0.219', 'WEAPON4': '0.400', 'weapon4': '0.496', 'WEAPON3': '1.250', 'weapon3': '3.006', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.058', 'FRAGCOUNT': '46.000'} [2023-02-25 14:59:24,660][36141] DAMAGECOUNT value on done: 1548869.0 [2023-02-25 14:59:24,660][36141] Sum rewards: 48.317, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.225', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon4': '0.314', 'weapon2': '0.466', 'WEAPON3': '1.200', 'weapon3': '2.852', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.107', 'FRAGCOUNT': '44.000'} [2023-02-25 14:59:24,668][36141] DAMAGECOUNT value on done: 1558678.0 [2023-02-25 14:59:24,669][36141] Sum rewards: 63.292, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.603', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.102', 'AMMO3': '0.165', 'AMMO4': '0.204', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON4': '0.350', 'weapon4': '0.536', 'WEAPON3': '1.000', 'weapon3': '2.818', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '54.000'} [2023-02-25 14:59:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13551.5). Total num frames: 236851200. Throughput: 0: 3381.1. Samples: 21703620. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:59:24,730][36114] Avg episode reward: [(0, '60.635')] [2023-02-25 14:59:24,973][36141] DAMAGECOUNT value on done: 1536500.0 [2023-02-25 14:59:24,973][36141] Sum rewards: 64.315, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.722', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO3': '0.124', 'AMMO4': '0.146', 'weapon5': '0.168', 'WEAPON5': '0.250', 'weapon2': '0.324', 'WEAPON4': '0.400', 'weapon4': '0.604', 'WEAPON3': '0.800', 'weapon3': '2.628', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '53.000'} [2023-02-25 14:59:27,058][36138] Updated weights for policy 0, policy_version 57833 (0.0009) [2023-02-25 14:59:27,902][36157] DAMAGECOUNT value on done: 1567839.0 [2023-02-25 14:59:27,903][36157] Sum rewards: 67.067, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.590', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon5': '0.208', 'AMMO4': '0.214', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'weapon2': '0.280', 'weapon4': '0.332', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '2.888', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '58.000'} [2023-02-25 14:59:28,214][36157] DAMAGECOUNT value on done: 1553097.0 [2023-02-25 14:59:28,214][36157] Sum rewards: 52.352, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.030', 'AMMO5': '0.021', 'AMMO2': '0.047', 'AMMO3': '0.090', 'weapon2': '0.174', 'AMMO4': '0.233', 'weapon5': '0.264', 'WEAPON3': '0.600', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'weapon4': '1.338', 'weapon3': '1.832', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.942', 'FRAGCOUNT': '44.000'} [2023-02-25 14:59:28,729][36157] DAMAGECOUNT value on done: 1570850.0 [2023-02-25 14:59:28,729][36157] Sum rewards: 50.535, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.496', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.059', 'AMMO3': '0.135', 'AMMO4': '0.296', 'weapon2': '0.458', 'weapon5': '0.484', 'weapon4': '0.528', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '0.800', 'weapon3': '2.088', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '13.596', 'FRAGCOUNT': '44.000'} [2023-02-25 14:59:29,030][36157] DAMAGECOUNT value on done: 1559058.0 [2023-02-25 14:59:29,031][36157] Sum rewards: 51.929, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.042', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO3': '0.167', 'AMMO4': '0.174', 'weapon5': '0.252', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.608', 'weapon4': '0.730', 'WEAPON3': '1.000', 'weapon3': '2.084', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.710', 'FRAGCOUNT': '45.000'} [2023-02-25 14:59:29,472][36140] DAMAGECOUNT value on done: 1565396.0 [2023-02-25 14:59:29,473][36140] Sum rewards: 56.879, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.550', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.096', 'AMMO4': '0.128', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'weapon4': '0.336', 'WEAPON4': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.250', 'weapon3': '2.956', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.124', 'FRAGCOUNT': '52.000'} [2023-02-25 14:59:29,628][36140] DAMAGECOUNT value on done: 1559634.0 [2023-02-25 14:59:29,628][36140] Sum rewards: 59.269, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.886', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.167', 'weapon4': '0.278', 'weapon2': '0.538', 'WEAPON3': '1.000', 'weapon3': '2.910', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.508', 'FRAGCOUNT': '48.000'} [2023-02-25 14:59:29,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13551.5). Total num frames: 236916736. Throughput: 0: 3378.6. Samples: 21723880. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:59:29,730][36114] Avg episode reward: [(0, '60.032')] [2023-02-25 14:59:29,786][36140] DAMAGECOUNT value on done: 1541600.0 [2023-02-25 14:59:29,787][36140] Sum rewards: 30.715, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.235', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon7': '0.058', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.142', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.408', 'weapon4': '0.666', 'WEAPON3': '0.850', 'HITCOUNT': '1.710', 'weapon3': '1.918', 'DAMAGECOUNT': '7.950', 'FRAGCOUNT': '28.500'} [2023-02-25 14:59:29,948][36140] DAMAGECOUNT value on done: 1554434.0 [2023-02-25 14:59:29,949][36140] Sum rewards: 65.428, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.360', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.066', 'AMMO3': '0.115', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.480', 'weapon2': '0.590', 'WEAPON3': '0.700', 'weapon3': '2.734', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.880', 'FRAGCOUNT': '53.000'} [2023-02-25 14:59:30,137][36138] Updated weights for policy 0, policy_version 57843 (0.0009) [2023-02-25 14:59:33,160][36138] Updated weights for policy 0, policy_version 57853 (0.0009) [2023-02-25 14:59:33,515][36142] DAMAGECOUNT value on done: 1549535.0 [2023-02-25 14:59:33,515][36142] Sum rewards: 53.090, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.077', 'AMMO5': '0.008', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon2': '0.154', 'weapon5': '0.168', 'AMMO3': '0.197', 'WEAPON5': '0.250', 'weapon4': '0.312', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.020', 'weapon3': '3.144', 'DAMAGECOUNT': '14.643', 'FRAGCOUNT': '46.000'} [2023-02-25 14:59:33,827][36142] DAMAGECOUNT value on done: 1541024.0 [2023-02-25 14:59:33,827][36142] Sum rewards: 45.775, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.695', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.052', 'AMMO3': '0.086', 'weapon5': '0.174', 'AMMO4': '0.259', 'WEAPON5': '0.400', 'weapon2': '0.480', 'WEAPON3': '0.650', 'WEAPON4': '0.700', 'weapon4': '1.138', 'weapon3': '1.846', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '11.865', 'FRAGCOUNT': '40.000'} [2023-02-25 14:59:34,416][36142] DAMAGECOUNT value on done: 1553282.0 [2023-02-25 14:59:34,416][36142] Sum rewards: 46.293, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.175', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.046', 'weapon5': '0.116', 'AMMO3': '0.151', 'AMMO4': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.498', 'weapon4': '0.784', 'WEAPON3': '0.950', 'weapon3': '2.344', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '11.949', 'FRAGCOUNT': '40.500'} [2023-02-25 14:59:34,596][36156] DAMAGECOUNT value on done: 1569973.0 [2023-02-25 14:59:34,596][36156] Sum rewards: 65.535, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.213', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon4': '0.146', 'weapon5': '0.186', 'AMMO4': '0.197', 'AMMO3': '0.224', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.056', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '57.000'} [2023-02-25 14:59:34,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13551.5). Total num frames: 236986368. Throughput: 0: 3381.6. Samples: 21744264. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:59:34,730][36114] Avg episode reward: [(0, '59.204')] [2023-02-25 14:59:34,730][36142] DAMAGECOUNT value on done: 1560980.0 [2023-02-25 14:59:34,730][36142] Sum rewards: 63.820, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.997', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon5': '0.118', 'AMMO3': '0.181', 'AMMO4': '0.205', 'WEAPON5': '0.350', 'weapon4': '0.362', 'WEAPON4': '0.450', 'weapon2': '0.454', 'WEAPON3': '1.200', 'weapon3': '2.774', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.678', 'FRAGCOUNT': '56.000'} [2023-02-25 14:59:34,896][36156] DAMAGECOUNT value on done: 1546887.0 [2023-02-25 14:59:34,896][36156] Sum rewards: 54.857, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.810', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.102', 'AMMO4': '0.135', 'weapon2': '0.150', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'weapon4': '0.278', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '2.800', 'weapon3': '3.160', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '48.000'} [2023-02-25 14:59:34,986][36156] DAMAGECOUNT value on done: 1564755.0 [2023-02-25 14:59:34,986][36156] Sum rewards: 71.344, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.659', 'AMMO2': '0.000', 'AMMO4': '0.001', 'WEAPON4': '0.100', 'AMMO3': '0.171', 'weapon4': '0.310', 'weapon2': '0.636', 'WEAPON3': '1.100', 'weapon3': '2.864', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '57.000'} [2023-02-25 14:59:35,297][36156] DAMAGECOUNT value on done: 1553632.0 [2023-02-25 14:59:35,298][36156] Sum rewards: 56.035, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.915', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.084', 'weapon4': '0.170', 'AMMO3': '0.202', 'weapon2': '0.306', 'WEAPON3': '1.300', 'HITCOUNT': '3.300', 'weapon3': '3.328', 'DAMAGECOUNT': '15.591', 'FRAGCOUNT': '47.000'} [2023-02-25 14:59:36,206][36138] Updated weights for policy 0, policy_version 57863 (0.0009) [2023-02-25 14:59:37,666][36156] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:59:39,177][36138] Updated weights for policy 0, policy_version 57873 (0.0010) [2023-02-25 14:59:39,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13551.5). Total num frames: 237051904. Throughput: 0: 3382.2. Samples: 21754440. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:59:39,730][36114] Avg episode reward: [(0, '59.276')] [2023-02-25 14:59:41,528][36139] DAMAGECOUNT value on done: 1559799.0 [2023-02-25 14:59:41,529][36139] Sum rewards: 57.337, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.270', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.100', 'weapon2': '0.130', 'weapon5': '0.156', 'AMMO3': '0.263', 'WEAPON3': '1.550', 'HITCOUNT': '3.140', 'weapon3': '3.416', 'DAMAGECOUNT': '14.586', 'FRAGCOUNT': '51.000'} [2023-02-25 14:59:41,630][36155] DAMAGECOUNT value on done: 1551712.0 [2023-02-25 14:59:41,631][36155] Sum rewards: 64.879, reward structure: {'DEATHCOUNT': '-11.250', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.049', 'AMMO3': '0.120', 'weapon5': '0.120', 'WEAPON5': '0.200', 'AMMO4': '0.246', 'weapon4': '0.344', 'WEAPON4': '0.350', 'HEALTH': '0.388', 'weapon2': '0.510', 'WEAPON3': '0.700', 'weapon3': '2.762', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.906', 'FRAGCOUNT': '51.000'} [2023-02-25 14:59:41,846][36139] DAMAGECOUNT value on done: 1560042.0 [2023-02-25 14:59:41,847][36139] Sum rewards: 56.287, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.364', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.029', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.229', 'weapon2': '0.328', 'weapon4': '0.628', 'WEAPON3': '1.350', 'weapon3': '2.664', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.153', 'FRAGCOUNT': '48.000'} [2023-02-25 14:59:41,941][36155] DAMAGECOUNT value on done: 1551644.0 [2023-02-25 14:59:41,942][36155] Sum rewards: 55.027, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.635', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon2': '0.108', 'AMMO4': '0.117', 'weapon5': '0.144', 'AMMO3': '0.162', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.610', 'WEAPON3': '1.000', 'HITCOUNT': '2.790', 'weapon3': '2.848', 'DAMAGECOUNT': '13.602', 'FRAGCOUNT': '46.000'} [2023-02-25 14:59:42,232][36154] DAMAGECOUNT value on done: 1560955.0 [2023-02-25 14:59:42,232][36154] Sum rewards: 56.757, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.440', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.114', 'AMMO4': '0.192', 'AMMO3': '0.204', 'weapon2': '0.246', 'WEAPON5': '0.300', 'weapon4': '0.324', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.810', 'weapon3': '3.030', 'DAMAGECOUNT': '13.479', 'FRAGCOUNT': '51.000'} [2023-02-25 14:59:42,257][36138] Updated weights for policy 0, policy_version 57883 (0.0009) [2023-02-25 14:59:42,331][36139] DAMAGECOUNT value on done: 1567448.0 [2023-02-25 14:59:42,332][36139] Sum rewards: 64.858, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.950', 'weapon4': '0.006', 'AMMO2': '0.018', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.230', 'weapon2': '0.296', 'WEAPON3': '1.350', 'HITCOUNT': '3.430', 'weapon3': '3.506', 'DAMAGECOUNT': '15.780', 'FRAGCOUNT': '56.000'} [2023-02-25 14:59:42,540][36154] DAMAGECOUNT value on done: 1537748.0 [2023-02-25 14:59:42,540][36154] Sum rewards: 59.365, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.554', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.024', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.177', 'weapon2': '0.346', 'weapon4': '0.526', 'WEAPON3': '1.050', 'weapon3': '2.866', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.604', 'FRAGCOUNT': '48.000'} [2023-02-25 14:59:42,560][36155] DAMAGECOUNT value on done: 1568874.0 [2023-02-25 14:59:42,560][36155] Sum rewards: 49.908, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.640', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.072', 'weapon5': '0.096', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.254', 'AMMO3': '0.290', 'weapon4': '0.380', 'WEAPON3': '1.700', 'weapon3': '3.012', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.494', 'FRAGCOUNT': '48.000'} [2023-02-25 14:59:42,641][36139] DAMAGECOUNT value on done: 1566031.0 [2023-02-25 14:59:42,641][36139] Sum rewards: 57.922, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.080', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.157', 'AMMO4': '0.160', 'weapon2': '0.366', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'weapon4': '1.094', 'weapon3': '2.072', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '14.931', 'FRAGCOUNT': '48.000'} [2023-02-25 14:59:42,864][36155] DAMAGECOUNT value on done: 1554637.0 [2023-02-25 14:59:42,865][36155] Sum rewards: 51.270, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.635', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.146', 'AMMO3': '0.150', 'AMMO4': '0.163', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.452', 'weapon2': '0.622', 'WEAPON3': '0.950', 'weapon3': '2.520', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.179', 'FRAGCOUNT': '44.000'} [2023-02-25 14:59:42,888][36154] DAMAGECOUNT value on done: 1571677.0 [2023-02-25 14:59:42,889][36154] Sum rewards: 59.467, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.594', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.088', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon2': '0.410', 'weapon4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.806', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '52.000'} [2023-02-25 14:59:43,179][36154] DAMAGECOUNT value on done: 1554181.0 [2023-02-25 14:59:43,180][36154] Sum rewards: 55.336, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.314', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.043', 'AMMO3': '0.184', 'weapon5': '0.212', 'AMMO4': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.408', 'weapon4': '0.498', 'WEAPON3': '1.050', 'weapon3': '2.538', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '46.000'} [2023-02-25 14:59:44,257][36141] DAMAGECOUNT value on done: 1559858.0 [2023-02-25 14:59:44,258][36141] Sum rewards: 62.060, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.563', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.153', 'AMMO4': '0.174', 'weapon5': '0.206', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.392', 'weapon2': '0.452', 'WEAPON3': '0.850', 'weapon3': '2.682', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '50.000'} [2023-02-25 14:59:44,565][36141] DAMAGECOUNT value on done: 1552872.0 [2023-02-25 14:59:44,566][36141] Sum rewards: 43.335, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.666', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon5': '0.162', 'AMMO3': '0.189', 'AMMO4': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.584', 'weapon4': '0.836', 'WEAPON3': '1.100', 'weapon3': '2.148', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.009', 'FRAGCOUNT': '40.000'} [2023-02-25 14:59:44,575][36141] DAMAGECOUNT value on done: 1563881.0 [2023-02-25 14:59:44,575][36141] Sum rewards: 63.692, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.755', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.126', 'AMMO3': '0.146', 'AMMO4': '0.150', 'weapon4': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.476', 'WEAPON3': '1.000', 'weapon3': '2.994', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.531', 'FRAGCOUNT': '53.000'} [2023-02-25 14:59:44,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13551.5). Total num frames: 237121536. Throughput: 0: 3381.1. Samples: 21774626. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:59:44,730][36114] Avg episode reward: [(0, '58.973')] [2023-02-25 14:59:44,864][36141] DAMAGECOUNT value on done: 1541551.0 [2023-02-25 14:59:44,864][36141] Sum rewards: 59.186, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.148', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.102', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon2': '0.426', 'weapon4': '0.570', 'WEAPON3': '1.350', 'weapon3': '2.694', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.153', 'FRAGCOUNT': '51.000'} [2023-02-25 14:59:45,240][36138] Updated weights for policy 0, policy_version 57893 (0.0009) [2023-02-25 14:59:47,807][36157] DAMAGECOUNT value on done: 1572978.0 [2023-02-25 14:59:47,807][36157] Sum rewards: 59.769, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.300', 'AMMO5': '0.015', 'AMMO2': '0.043', 'AMMO3': '0.177', 'weapon5': '0.200', 'AMMO4': '0.217', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.562', 'weapon4': '0.738', 'WEAPON3': '1.050', 'weapon3': '2.190', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.417', 'FRAGCOUNT': '53.000'} [2023-02-25 14:59:48,116][36157] DAMAGECOUNT value on done: 1557979.0 [2023-02-25 14:59:48,117][36157] Sum rewards: 58.072, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.209', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon4': '0.246', 'weapon2': '0.348', 'ARMOR': '0.404', 'WEAPON3': '1.200', 'HITCOUNT': '2.820', 'weapon3': '2.966', 'DAMAGECOUNT': '14.646', 'FRAGCOUNT': '50.000'} [2023-02-25 14:59:48,243][36138] Updated weights for policy 0, policy_version 57903 (0.0009) [2023-02-25 14:59:48,586][36157] DAMAGECOUNT value on done: 1575847.0 [2023-02-25 14:59:48,586][36157] Sum rewards: 60.694, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.097', 'AMMO5': '0.011', 'AMMO2': '0.034', 'AMMO3': '0.136', 'AMMO4': '0.169', 'weapon5': '0.174', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.376', 'weapon4': '0.658', 'WEAPON3': '0.900', 'weapon3': '2.542', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.991', 'FRAGCOUNT': '50.000'} [2023-02-25 14:59:48,888][36157] DAMAGECOUNT value on done: 1564102.0 [2023-02-25 14:59:48,889][36157] Sum rewards: 59.993, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.690', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO3': '0.102', 'weapon5': '0.128', 'AMMO4': '0.133', 'WEAPON5': '0.350', 'weapon2': '0.504', 'WEAPON4': '0.550', 'WEAPON3': '0.650', 'weapon4': '0.950', 'weapon3': '2.228', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.132', 'FRAGCOUNT': '48.000'} [2023-02-25 14:59:49,384][36140] DAMAGECOUNT value on done: 1570289.0 [2023-02-25 14:59:49,385][36140] Sum rewards: 56.452, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.420', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon5': '0.164', 'AMMO3': '0.192', 'weapon2': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.592', 'WEAPON3': '1.150', 'weapon3': '2.684', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.679', 'FRAGCOUNT': '48.000'} [2023-02-25 14:59:49,546][36140] DAMAGECOUNT value on done: 1565046.0 [2023-02-25 14:59:49,547][36140] Sum rewards: 63.959, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.380', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.046', 'weapon5': '0.112', 'AMMO3': '0.136', 'AMMO4': '0.232', 'WEAPON5': '0.250', 'weapon2': '0.390', 'WEAPON4': '0.450', 'weapon4': '0.460', 'WEAPON3': '0.850', 'weapon3': '2.854', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.221', 'FRAGCOUNT': '52.000'} [2023-02-25 14:59:49,695][36140] DAMAGECOUNT value on done: 1546708.0 [2023-02-25 14:59:49,695][36140] Sum rewards: 63.729, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.707', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.106', 'AMMO3': '0.140', 'AMMO4': '0.142', 'WEAPON5': '0.200', 'WEAPON4': '0.450', 'weapon2': '0.510', 'weapon4': '0.586', 'WEAPON3': '0.850', 'weapon3': '2.538', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '15.324', 'FRAGCOUNT': '53.000'} [2023-02-25 14:59:49,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13537.6). Total num frames: 237187072. Throughput: 0: 3384.0. Samples: 21794984. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:59:49,730][36114] Avg episode reward: [(0, '59.008')] [2023-02-25 14:59:49,867][36140] DAMAGECOUNT value on done: 1559062.0 [2023-02-25 14:59:49,868][36140] Sum rewards: 56.501, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.712', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon5': '0.142', 'AMMO3': '0.164', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.672', 'WEAPON3': '1.050', 'weapon3': '2.690', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.884', 'FRAGCOUNT': '50.000'} [2023-02-25 14:59:51,279][36138] Updated weights for policy 0, policy_version 57913 (0.0009) [2023-02-25 14:59:53,350][36142] DAMAGECOUNT value on done: 1554288.0 [2023-02-25 14:59:53,351][36142] Sum rewards: 54.600, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.150', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon5': '0.142', 'AMMO3': '0.178', 'weapon4': '0.192', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.498', 'WEAPON3': '1.150', 'weapon3': '2.910', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.259', 'FRAGCOUNT': '47.000'} [2023-02-25 14:59:53,662][36142] DAMAGECOUNT value on done: 1546026.0 [2023-02-25 14:59:53,663][36142] Sum rewards: 61.028, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.655', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'weapon2': '0.150', 'AMMO3': '0.188', 'weapon4': '0.506', 'WEAPON3': '1.150', 'weapon3': '2.950', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.006', 'FRAGCOUNT': '51.000'} [2023-02-25 14:59:54,246][36142] DAMAGECOUNT value on done: 1557917.0 [2023-02-25 14:59:54,246][36142] Sum rewards: 54.924, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.325', 'AMMO5': '0.021', 'AMMO2': '0.050', 'AMMO3': '0.178', 'weapon4': '0.238', 'weapon5': '0.246', 'AMMO4': '0.249', 'weapon2': '0.358', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.814', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.905', 'FRAGCOUNT': '50.000'} [2023-02-25 14:59:54,326][36138] Updated weights for policy 0, policy_version 57923 (0.0009) [2023-02-25 14:59:54,429][36154] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 14:59:54,556][36142] DAMAGECOUNT value on done: 1565468.0 [2023-02-25 14:59:54,557][36142] Sum rewards: 52.206, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.520', 'AMMO5': '0.015', 'AMMO2': '0.040', 'AMMO3': '0.140', 'AMMO4': '0.201', 'weapon4': '0.218', 'weapon5': '0.220', 'weapon2': '0.432', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.900', 'HITCOUNT': '2.540', 'weapon3': '2.906', 'DAMAGECOUNT': '13.464', 'FRAGCOUNT': '44.000'} [2023-02-25 14:59:54,649][36156] DAMAGECOUNT value on done: 1575422.0 [2023-02-25 14:59:54,649][36156] Sum rewards: 65.614, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.563', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon4': '0.484', 'weapon2': '0.512', 'WEAPON3': '1.150', 'weapon3': '2.714', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '54.000'} [2023-02-25 14:59:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13551.5). Total num frames: 237256704. Throughput: 0: 3383.3. Samples: 21805130. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 14:59:54,730][36114] Avg episode reward: [(0, '58.544')] [2023-02-25 14:59:54,953][36156] DAMAGECOUNT value on done: 1553342.0 [2023-02-25 14:59:54,953][36156] Sum rewards: 76.121, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.382', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.092', 'AMMO4': '0.150', 'weapon2': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'weapon4': '0.284', 'WEAPON3': '1.450', 'weapon3': '3.206', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.365', 'FRAGCOUNT': '65.000'} [2023-02-25 14:59:55,055][36156] DAMAGECOUNT value on done: 1570544.0 [2023-02-25 14:59:55,055][36156] Sum rewards: 63.991, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.950', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon5': '0.098', 'AMMO4': '0.177', 'weapon2': '0.184', 'AMMO3': '0.229', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.420', 'WEAPON3': '1.400', 'weapon3': '2.962', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '56.000'} [2023-02-25 14:59:55,352][36156] DAMAGECOUNT value on done: 1558691.0 [2023-02-25 14:59:55,352][36156] Sum rewards: 61.442, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.157', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'AMMO3': '0.186', 'weapon2': '0.188', 'WEAPON4': '0.350', 'weapon4': '0.940', 'WEAPON3': '1.150', 'weapon3': '2.530', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.177', 'FRAGCOUNT': '53.000'} [2023-02-25 14:59:57,365][36138] Updated weights for policy 0, policy_version 57933 (0.0009) [2023-02-25 14:59:59,730][36114] Fps is (10 sec: 13516.1, 60 sec: 13516.7, 300 sec: 13537.6). Total num frames: 237322240. Throughput: 0: 3385.6. Samples: 21825452. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 14:59:59,731][36114] Avg episode reward: [(0, '58.780')] [2023-02-25 15:00:00,396][36138] Updated weights for policy 0, policy_version 57943 (0.0010) [2023-02-25 15:00:01,351][36155] DAMAGECOUNT value on done: 1556608.0 [2023-02-25 15:00:01,352][36155] Sum rewards: 58.244, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.090', 'AMMO5': '0.014', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.153', 'weapon5': '0.194', 'WEAPON4': '0.200', 'weapon2': '0.266', 'WEAPON5': '0.300', 'weapon4': '0.412', 'WEAPON3': '1.000', 'HITCOUNT': '2.830', 'weapon3': '2.872', 'DAMAGECOUNT': '14.688', 'FRAGCOUNT': '49.000'} [2023-02-25 15:00:01,363][36139] DAMAGECOUNT value on done: 1565011.0 [2023-02-25 15:00:01,363][36139] Sum rewards: 65.449, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.622', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.054', 'WEAPON5': '0.150', 'AMMO4': '0.192', 'AMMO3': '0.206', 'WEAPON4': '0.350', 'weapon2': '0.508', 'weapon4': '0.598', 'WEAPON3': '1.200', 'weapon3': '2.620', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '57.000'} [2023-02-25 15:00:01,650][36155] DAMAGECOUNT value on done: 1556750.0 [2023-02-25 15:00:01,650][36155] Sum rewards: 58.515, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.240', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon5': '0.186', 'AMMO3': '0.189', 'AMMO4': '0.233', 'WEAPON5': '0.350', 'weapon2': '0.412', 'weapon4': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.602', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.318', 'FRAGCOUNT': '54.000'} [2023-02-25 15:00:01,665][36139] DAMAGECOUNT value on done: 1564830.0 [2023-02-25 15:00:01,665][36139] Sum rewards: 53.375, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.620', 'AMMO5': '0.019', 'AMMO2': '0.038', 'AMMO3': '0.152', 'weapon5': '0.180', 'AMMO4': '0.191', 'weapon2': '0.270', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon4': '0.642', 'WEAPON3': '0.950', 'weapon3': '2.518', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.364', 'FRAGCOUNT': '46.000'} [2023-02-25 15:00:01,996][36154] DAMAGECOUNT value on done: 1565389.0 [2023-02-25 15:00:01,997][36154] Sum rewards: 54.203, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.685', 'AMMO5': '0.004', 'ARMOR': '0.004', 'weapon4': '0.014', 'AMMO2': '0.023', 'weapon5': '0.028', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.142', 'weapon2': '0.750', 'WEAPON3': '0.900', 'HITCOUNT': '2.550', 'weapon3': '3.108', 'DAMAGECOUNT': '13.302', 'FRAGCOUNT': '43.500'} [2023-02-25 15:00:02,130][36139] DAMAGECOUNT value on done: 1572360.0 [2023-02-25 15:00:02,130][36139] Sum rewards: 60.129, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.379', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO4': '0.137', 'weapon5': '0.192', 'AMMO3': '0.205', 'weapon2': '0.266', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.386', 'WEAPON3': '1.300', 'weapon3': '2.880', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.736', 'FRAGCOUNT': '52.000'} [2023-02-25 15:00:02,301][36154] DAMAGECOUNT value on done: 1543873.0 [2023-02-25 15:00:02,301][36154] Sum rewards: 66.663, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.450', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon5': '0.186', 'weapon2': '0.212', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.828', 'WEAPON3': '1.300', 'weapon3': '2.442', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '56.000'} [2023-02-25 15:00:02,423][36155] DAMAGECOUNT value on done: 1573970.0 [2023-02-25 15:00:02,424][36155] Sum rewards: 58.504, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.638', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.033', 'weapon5': '0.150', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.378', 'weapon2': '0.430', 'WEAPON3': '1.150', 'weapon3': '2.818', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.288', 'FRAGCOUNT': '48.000'} [2023-02-25 15:00:02,446][36139] DAMAGECOUNT value on done: 1571039.0 [2023-02-25 15:00:02,447][36139] Sum rewards: 60.418, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.412', 'AMMO5': '0.005', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon2': '0.266', 'WEAPON4': '0.350', 'weapon4': '1.046', 'WEAPON3': '1.100', 'weapon3': '2.294', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.024', 'FRAGCOUNT': '52.000'} [2023-02-25 15:00:02,661][36154] DAMAGECOUNT value on done: 1576891.0 [2023-02-25 15:00:02,661][36154] Sum rewards: 63.328, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.680', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.120', 'AMMO4': '0.124', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'weapon2': '0.218', 'WEAPON4': '0.250', 'weapon4': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.138', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '53.000'} [2023-02-25 15:00:02,744][36155] DAMAGECOUNT value on done: 1560110.0 [2023-02-25 15:00:02,744][36155] Sum rewards: 67.013, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.280', 'weapon5': '0.002', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.024', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.253', 'weapon2': '0.298', 'WEAPON3': '1.600', 'weapon3': '3.490', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '59.000'} [2023-02-25 15:00:02,973][36154] DAMAGECOUNT value on done: 1559003.0 [2023-02-25 15:00:02,973][36154] Sum rewards: 50.646, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.490', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.214', 'weapon2': '0.214', 'weapon5': '0.244', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.682', 'WEAPON3': '1.250', 'weapon3': '2.612', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.466', 'FRAGCOUNT': '44.000'} [2023-02-25 15:00:03,474][36138] Updated weights for policy 0, policy_version 57953 (0.0010) [2023-02-25 15:00:04,094][36141] DAMAGECOUNT value on done: 1564813.0 [2023-02-25 15:00:04,095][36141] Sum rewards: 64.774, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.229', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.084', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.350', 'weapon2': '0.512', 'WEAPON3': '1.000', 'weapon3': '2.730', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '54.000'} [2023-02-25 15:00:04,397][36141] DAMAGECOUNT value on done: 1557973.0 [2023-02-25 15:00:04,397][36141] Sum rewards: 62.237, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.660', 'AMMO5': '0.019', 'AMMO2': '0.051', 'AMMO3': '0.167', 'AMMO4': '0.255', 'weapon5': '0.390', 'weapon2': '0.424', 'WEAPON5': '0.550', 'WEAPON4': '0.550', 'weapon4': '0.764', 'WEAPON3': '1.000', 'weapon3': '2.114', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.303', 'FRAGCOUNT': '55.000'} [2023-02-25 15:00:04,406][36141] DAMAGECOUNT value on done: 1569028.0 [2023-02-25 15:00:04,406][36141] Sum rewards: 57.419, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.416', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon4': '0.126', 'weapon5': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon2': '0.314', 'WEAPON3': '1.500', 'weapon3': '3.096', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.441', 'FRAGCOUNT': '51.000'} [2023-02-25 15:00:04,706][36141] DAMAGECOUNT value on done: 1546232.0 [2023-02-25 15:00:04,706][36141] Sum rewards: 55.283, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.000', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.088', 'weapon5': '0.122', 'AMMO3': '0.154', 'AMMO4': '0.159', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.840', 'WEAPON3': '0.950', 'weapon3': '2.750', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '14.043', 'FRAGCOUNT': '46.000'} [2023-02-25 15:00:04,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13537.6). Total num frames: 237391872. Throughput: 0: 3384.2. Samples: 21845746. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:00:04,729][36114] Avg episode reward: [(0, '58.631')] [2023-02-25 15:00:06,460][36138] Updated weights for policy 0, policy_version 57963 (0.0010) [2023-02-25 15:00:07,710][36157] DAMAGECOUNT value on done: 1578498.0 [2023-02-25 15:00:07,710][36157] Sum rewards: 65.702, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.857', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.170', 'AMMO4': '0.172', 'weapon5': '0.192', 'weapon2': '0.244', 'weapon4': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.000', 'weapon3': '3.058', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '54.500'} [2023-02-25 15:00:08,017][36157] DAMAGECOUNT value on done: 1563859.0 [2023-02-25 15:00:08,018][36157] Sum rewards: 71.136, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.139', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO3': '0.197', 'weapon2': '0.536', 'WEAPON3': '1.200', 'weapon3': '3.336', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '57.000'} [2023-02-25 15:00:08,440][36157] DAMAGECOUNT value on done: 1581164.0 [2023-02-25 15:00:08,441][36157] Sum rewards: 64.624, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.330', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'weapon2': '0.232', 'weapon4': '0.470', 'WEAPON3': '1.300', 'weapon3': '3.002', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '56.000'} [2023-02-25 15:00:08,756][36157] DAMAGECOUNT value on done: 1569523.0 [2023-02-25 15:00:08,756][36157] Sum rewards: 64.886, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.584', 'ARMOR': '0.004', 'AMMO5': '0.004', 'AMMO2': '0.024', 'weapon5': '0.028', 'weapon4': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'WEAPON4': '0.200', 'AMMO3': '0.257', 'weapon2': '0.448', 'WEAPON3': '1.600', 'weapon3': '3.274', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '59.000'} [2023-02-25 15:00:09,264][36140] DAMAGECOUNT value on done: 1575882.0 [2023-02-25 15:00:09,264][36140] Sum rewards: 70.436, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.365', 'AMMO2': '0.006', 'ARMOR': '0.028', 'AMMO4': '0.032', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'weapon4': '0.300', 'weapon2': '0.394', 'WEAPON3': '1.200', 'weapon3': '3.160', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '58.000'} [2023-02-25 15:00:09,392][36140] DAMAGECOUNT value on done: 1570038.0 [2023-02-25 15:00:09,392][36140] Sum rewards: 56.327, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.255', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.146', 'WEAPON5': '0.200', 'weapon2': '0.226', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'weapon4': '0.526', 'WEAPON3': '1.450', 'weapon3': '2.836', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.976', 'FRAGCOUNT': '51.000'} [2023-02-25 15:00:09,468][36138] Updated weights for policy 0, policy_version 57973 (0.0009) [2023-02-25 15:00:09,581][36140] DAMAGECOUNT value on done: 1552024.0 [2023-02-25 15:00:09,581][36140] Sum rewards: 61.167, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.936', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.154', 'AMMO4': '0.159', 'AMMO3': '0.198', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON4': '0.500', 'weapon4': '0.558', 'WEAPON3': '1.200', 'weapon3': '2.660', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.948', 'FRAGCOUNT': '53.500'} [2023-02-25 15:00:09,714][36140] DAMAGECOUNT value on done: 1564802.0 [2023-02-25 15:00:09,715][36140] Sum rewards: 65.926, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.390', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.098', 'AMMO4': '0.175', 'AMMO3': '0.212', 'weapon2': '0.290', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.522', 'WEAPON3': '1.200', 'weapon3': '2.714', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '57.000'} [2023-02-25 15:00:09,729][36114] Fps is (10 sec: 13517.5, 60 sec: 13516.8, 300 sec: 13537.6). Total num frames: 237457408. Throughput: 0: 3384.2. Samples: 21855908. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:00:09,730][36114] Avg episode reward: [(0, '58.554')] [2023-02-25 15:00:12,458][36138] Updated weights for policy 0, policy_version 57983 (0.0009) [2023-02-25 15:00:13,399][36142] DAMAGECOUNT value on done: 1559645.0 [2023-02-25 15:00:13,399][36142] Sum rewards: 52.082, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.780', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.104', 'AMMO4': '0.162', 'weapon4': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'AMMO3': '0.302', 'weapon2': '0.380', 'WEAPON3': '1.750', 'weapon3': '2.968', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '49.000'} [2023-02-25 15:00:13,710][36142] DAMAGECOUNT value on done: 1550696.0 [2023-02-25 15:00:13,711][36142] Sum rewards: 47.563, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.215', 'AMMO5': '0.014', 'AMMO2': '0.054', 'weapon5': '0.204', 'AMMO3': '0.253', 'AMMO4': '0.273', 'weapon2': '0.278', 'weapon4': '0.360', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.842', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.010', 'FRAGCOUNT': '44.500'} [2023-02-25 15:00:14,253][36142] DAMAGECOUNT value on done: 1563079.0 [2023-02-25 15:00:14,254][36142] Sum rewards: 59.690, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.476', 'AMMO5': '0.012', 'AMMO2': '0.043', 'AMMO3': '0.150', 'AMMO4': '0.213', 'weapon5': '0.242', 'weapon2': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.802', 'WEAPON3': '0.900', 'weapon3': '2.386', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '50.000'} [2023-02-25 15:00:14,548][36156] DAMAGECOUNT value on done: 1581144.0 [2023-02-25 15:00:14,549][36156] Sum rewards: 65.124, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.073', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.220', 'weapon2': '0.254', 'weapon4': '0.384', 'WEAPON3': '1.200', 'weapon3': '3.074', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.166', 'FRAGCOUNT': '54.000'} [2023-02-25 15:00:14,562][36142] DAMAGECOUNT value on done: 1570277.0 [2023-02-25 15:00:14,562][36142] Sum rewards: 61.589, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.090', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'weapon4': '0.054', 'AMMO4': '0.061', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO3': '0.207', 'weapon2': '0.662', 'WEAPON3': '1.150', 'weapon3': '2.962', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.427', 'FRAGCOUNT': '53.000'} [2023-02-25 15:00:14,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13537.6). Total num frames: 237527040. Throughput: 0: 3384.9. Samples: 21876200. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:00:14,730][36114] Avg episode reward: [(0, '58.576')] [2023-02-25 15:00:14,859][36156] DAMAGECOUNT value on done: 1558382.0 [2023-02-25 15:00:14,860][36156] Sum rewards: 64.328, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.854', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON4': '0.150', 'weapon2': '0.158', 'AMMO3': '0.234', 'weapon4': '0.456', 'WEAPON3': '1.450', 'weapon3': '3.202', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.120', 'FRAGCOUNT': '57.000'} [2023-02-25 15:00:15,028][36156] DAMAGECOUNT value on done: 1576459.0 [2023-02-25 15:00:15,029][36156] Sum rewards: 71.180, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.169', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon4': '0.288', 'weapon2': '0.490', 'WEAPON3': '1.350', 'weapon3': '2.794', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '62.000'} [2023-02-25 15:00:15,336][36156] DAMAGECOUNT value on done: 1563223.0 [2023-02-25 15:00:15,337][36156] Sum rewards: 53.578, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.002', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.132', 'AMMO4': '0.145', 'AMMO3': '0.151', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.438', 'weapon4': '0.688', 'WEAPON3': '0.950', 'weapon3': '2.382', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.596', 'FRAGCOUNT': '47.000'} [2023-02-25 15:00:15,507][36138] Updated weights for policy 0, policy_version 57993 (0.0009) [2023-02-25 15:00:18,557][36138] Updated weights for policy 0, policy_version 58003 (0.0009) [2023-02-25 15:00:19,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13537.6). Total num frames: 237592576. Throughput: 0: 3379.2. Samples: 21896326. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:00:19,730][36114] Avg episode reward: [(0, '58.604')] [2023-02-25 15:00:21,123][36155] DAMAGECOUNT value on done: 1561389.0 [2023-02-25 15:00:21,123][36155] Sum rewards: 55.775, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.849', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.056', 'AMMO3': '0.163', 'weapon5': '0.172', 'WEAPON5': '0.300', 'weapon2': '0.394', 'WEAPON4': '0.400', 'weapon4': '0.922', 'WEAPON3': '1.000', 'weapon3': '2.200', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.325', 'FRAGCOUNT': '48.000'} [2023-02-25 15:00:21,246][36139] DAMAGECOUNT value on done: 1569861.0 [2023-02-25 15:00:21,246][36139] Sum rewards: 57.620, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.463', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.213', 'weapon4': '0.218', 'weapon2': '0.224', 'WEAPON3': '1.400', 'weapon3': '3.142', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.550', 'FRAGCOUNT': '51.000'} [2023-02-25 15:00:21,446][36155] DAMAGECOUNT value on done: 1561822.0 [2023-02-25 15:00:21,446][36155] Sum rewards: 52.639, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.387', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'weapon2': '0.280', 'weapon4': '0.442', 'WEAPON3': '1.050', 'weapon3': '2.852', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.216', 'FRAGCOUNT': '42.000'} [2023-02-25 15:00:21,530][36139] DAMAGECOUNT value on done: 1569672.0 [2023-02-25 15:00:21,531][36139] Sum rewards: 50.769, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.430', 'AMMO5': '0.012', 'AMMO2': '0.052', 'weapon2': '0.204', 'AMMO3': '0.220', 'weapon5': '0.248', 'AMMO4': '0.259', 'WEAPON5': '0.350', 'weapon4': '0.498', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.560', 'weapon3': '2.720', 'DAMAGECOUNT': '14.526', 'FRAGCOUNT': '47.000'} [2023-02-25 15:00:21,680][36138] Updated weights for policy 0, policy_version 58013 (0.0009) [2023-02-25 15:00:22,059][36154] DAMAGECOUNT value on done: 1570760.0 [2023-02-25 15:00:22,060][36154] Sum rewards: 65.284, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.367', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon5': '0.118', 'AMMO3': '0.168', 'AMMO4': '0.216', 'weapon4': '0.302', 'WEAPON5': '0.350', 'weapon2': '0.406', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.942', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.783', 'FRAGCOUNT': '57.000'} [2023-02-25 15:00:22,068][36139] DAMAGECOUNT value on done: 1578099.0 [2023-02-25 15:00:22,069][36139] Sum rewards: 59.484, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.240', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon5': '0.068', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'weapon4': '0.290', 'weapon2': '0.324', 'WEAPON3': '1.400', 'weapon3': '3.112', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '50.500'} [2023-02-25 15:00:22,326][36155] DAMAGECOUNT value on done: 1579277.0 [2023-02-25 15:00:22,327][36155] Sum rewards: 67.067, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.785', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.024', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.106', 'AMMO3': '0.120', 'weapon2': '0.278', 'WEAPON3': '0.850', 'HITCOUNT': '3.200', 'weapon3': '3.448', 'DAMAGECOUNT': '15.921', 'FRAGCOUNT': '52.000'} [2023-02-25 15:00:22,375][36154] DAMAGECOUNT value on done: 1549894.0 [2023-02-25 15:00:22,376][36154] Sum rewards: 72.399, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.580', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.136', 'weapon2': '0.160', 'AMMO3': '0.224', 'weapon4': '0.314', 'WEAPON3': '1.400', 'weapon3': '3.090', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '61.000'} [2023-02-25 15:00:22,406][36139] DAMAGECOUNT value on done: 1577389.0 [2023-02-25 15:00:22,406][36139] Sum rewards: 71.768, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.845', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.132', 'weapon2': '0.138', 'AMMO4': '0.165', 'AMMO3': '0.207', 'weapon4': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.270', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.050', 'FRAGCOUNT': '60.000'} [2023-02-25 15:00:22,614][36155] DAMAGECOUNT value on done: 1566059.0 [2023-02-25 15:00:22,615][36155] Sum rewards: 72.904, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.210', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO3': '0.218', 'weapon2': '0.410', 'WEAPON3': '1.400', 'weapon3': '3.432', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.847', 'FRAGCOUNT': '61.000'} [2023-02-25 15:00:22,756][36154] DAMAGECOUNT value on done: 1582552.0 [2023-02-25 15:00:22,756][36154] Sum rewards: 55.281, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-3.440', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.157', 'weapon5': '0.192', 'weapon2': '0.228', 'WEAPON5': '0.250', 'AMMO3': '0.345', 'WEAPON4': '0.350', 'weapon4': '0.624', 'WEAPON3': '1.900', 'weapon3': '2.560', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '52.000'} [2023-02-25 15:00:23,063][36154] DAMAGECOUNT value on done: 1563806.0 [2023-02-25 15:00:23,063][36154] Sum rewards: 59.654, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.088', 'AMMO5': '0.016', 'AMMO2': '0.062', 'AMMO3': '0.142', 'AMMO4': '0.310', 'weapon5': '0.312', 'weapon2': '0.414', 'WEAPON5': '0.450', 'weapon4': '0.692', 'WEAPON4': '0.750', 'WEAPON3': '0.900', 'weapon3': '2.254', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.409', 'FRAGCOUNT': '53.000'} [2023-02-25 15:00:24,066][36141] DAMAGECOUNT value on done: 1569318.0 [2023-02-25 15:00:24,067][36141] Sum rewards: 56.561, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.358', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.126', 'weapon5': '0.134', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.454', 'WEAPON3': '0.800', 'weapon4': '0.822', 'weapon3': '2.208', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.515', 'FRAGCOUNT': '48.000'} [2023-02-25 15:00:24,364][36141] DAMAGECOUNT value on done: 1562515.0 [2023-02-25 15:00:24,365][36141] Sum rewards: 56.765, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.746', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO3': '0.154', 'AMMO4': '0.227', 'weapon5': '0.246', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.698', 'WEAPON3': '0.950', 'weapon3': '2.464', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.626', 'FRAGCOUNT': '48.000'} [2023-02-25 15:00:24,387][36141] DAMAGECOUNT value on done: 1574396.0 [2023-02-25 15:00:24,387][36141] Sum rewards: 61.080, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.177', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.128', 'AMMO4': '0.146', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.416', 'weapon4': '0.560', 'WEAPON3': '1.300', 'weapon3': '2.610', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.804', 'FRAGCOUNT': '55.000'} [2023-02-25 15:00:24,684][36141] DAMAGECOUNT value on done: 1551427.0 [2023-02-25 15:00:24,685][36141] Sum rewards: 65.885, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.270', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO3': '0.210', 'weapon2': '0.306', 'WEAPON3': '1.400', 'HITCOUNT': '3.110', 'weapon3': '3.546', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '56.000'} [2023-02-25 15:00:24,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13448.5, 300 sec: 13523.7). Total num frames: 237658112. Throughput: 0: 3372.8. Samples: 21906216. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:00:24,730][36114] Avg episode reward: [(0, '59.363')] [2023-02-25 15:00:24,772][36138] Updated weights for policy 0, policy_version 58023 (0.0009) [2023-02-25 15:00:26,588][36142] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('ARMOR', -0.001, -1.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 15:00:27,745][36157] DAMAGECOUNT value on done: 1583933.0 [2023-02-25 15:00:27,745][36157] Sum rewards: 62.141, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.600', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.162', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.338', 'weapon2': '0.588', 'WEAPON3': '1.300', 'weapon3': '2.708', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '53.000'} [2023-02-25 15:00:27,846][36138] Updated weights for policy 0, policy_version 58033 (0.0009) [2023-02-25 15:00:28,078][36157] DAMAGECOUNT value on done: 1568430.0 [2023-02-25 15:00:28,078][36157] Sum rewards: 50.696, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.785', 'AMMO5': '0.015', 'AMMO2': '0.056', 'weapon5': '0.204', 'AMMO3': '0.207', 'AMMO4': '0.282', 'weapon2': '0.338', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.888', 'WEAPON3': '1.150', 'weapon3': '2.268', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.713', 'FRAGCOUNT': '46.000'} [2023-02-25 15:00:28,478][36157] DAMAGECOUNT value on done: 1586350.0 [2023-02-25 15:00:28,479][36157] Sum rewards: 58.233, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.900', 'AMMO5': '0.018', 'AMMO2': '0.067', 'AMMO3': '0.142', 'weapon2': '0.254', 'weapon5': '0.266', 'AMMO4': '0.334', 'WEAPON5': '0.450', 'ARMOR': '0.451', 'WEAPON4': '0.750', 'WEAPON3': '0.850', 'weapon4': '1.118', 'weapon3': '2.004', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.558', 'FRAGCOUNT': '50.000'} [2023-02-25 15:00:28,799][36157] DAMAGECOUNT value on done: 1574779.0 [2023-02-25 15:00:28,800][36157] Sum rewards: 61.435, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.170', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.058', 'weapon4': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon2': '0.338', 'WEAPON3': '1.200', 'weapon3': '3.286', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.768', 'FRAGCOUNT': '52.000'} [2023-02-25 15:00:29,409][36140] DAMAGECOUNT value on done: 1580594.0 [2023-02-25 15:00:29,410][36140] Sum rewards: 54.233, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.295', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.148', 'AMMO3': '0.165', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.368', 'weapon4': '0.696', 'WEAPON3': '1.000', 'weapon3': '2.348', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.136', 'FRAGCOUNT': '46.000'} [2023-02-25 15:00:29,533][36140] DAMAGECOUNT value on done: 1575412.0 [2023-02-25 15:00:29,534][36140] Sum rewards: 58.501, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.445', 'AMMO5': '0.014', 'AMMO2': '0.053', 'AMMO3': '0.193', 'weapon2': '0.200', 'AMMO4': '0.263', 'weapon4': '0.298', 'weapon5': '0.336', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.900', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.609', 'FRAGCOUNT': '51.000'} [2023-02-25 15:00:29,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13537.6). Total num frames: 237727744. Throughput: 0: 3368.4. Samples: 21926206. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:00:29,730][36114] Avg episode reward: [(0, '59.350')] [2023-02-25 15:00:29,738][36140] DAMAGECOUNT value on done: 1556673.0 [2023-02-25 15:00:29,738][36140] Sum rewards: 57.419, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.120', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon5': '0.136', 'AMMO4': '0.143', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'WEAPON5': '0.250', 'weapon2': '0.262', 'weapon4': '0.446', 'WEAPON3': '0.950', 'HITCOUNT': '2.770', 'weapon3': '2.790', 'DAMAGECOUNT': '13.947', 'FRAGCOUNT': '47.000'} [2023-02-25 15:00:29,860][36140] DAMAGECOUNT value on done: 1569830.0 [2023-02-25 15:00:29,861][36140] Sum rewards: 56.580, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.397', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.120', 'weapon5': '0.122', 'AMMO3': '0.187', 'AMMO4': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.746', 'WEAPON3': '1.100', 'weapon3': '2.820', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.084', 'FRAGCOUNT': '48.000'} [2023-02-25 15:00:30,910][36138] Updated weights for policy 0, policy_version 58043 (0.0009) [2023-02-25 15:00:33,641][36142] DAMAGECOUNT value on done: 1564849.0 [2023-02-25 15:00:33,642][36142] Sum rewards: 55.198, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.018', 'AMMO5': '0.017', 'AMMO2': '0.055', 'AMMO3': '0.159', 'AMMO4': '0.274', 'weapon2': '0.376', 'weapon5': '0.382', 'WEAPON5': '0.550', 'WEAPON4': '0.700', 'weapon4': '0.802', 'WEAPON3': '0.950', 'weapon3': '2.098', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.612', 'FRAGCOUNT': '48.000'} [2023-02-25 15:00:33,952][36142] DAMAGECOUNT value on done: 1555197.0 [2023-02-25 15:00:33,953][36142] Sum rewards: 50.741, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.320', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.102', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.292', 'weapon2': '0.598', 'WEAPON3': '1.400', 'HITCOUNT': '2.790', 'weapon3': '2.798', 'DAMAGECOUNT': '13.503', 'FRAGCOUNT': '45.000'} [2023-02-25 15:00:34,025][36138] Updated weights for policy 0, policy_version 58053 (0.0009) [2023-02-25 15:00:34,497][36142] DAMAGECOUNT value on done: 1568630.0 [2023-02-25 15:00:34,497][36142] Sum rewards: 66.984, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.676', 'AMMO5': '0.017', 'AMMO2': '0.042', 'AMMO3': '0.138', 'weapon5': '0.150', 'AMMO4': '0.211', 'weapon2': '0.302', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.528', 'WEAPON3': '0.900', 'weapon3': '2.710', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '55.000'} [2023-02-25 15:00:34,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13523.7). Total num frames: 237793280. Throughput: 0: 3357.9. Samples: 21946090. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:00:34,730][36114] Avg episode reward: [(0, '59.726')] [2023-02-25 15:00:34,786][36142] DAMAGECOUNT value on done: 1575369.0 [2023-02-25 15:00:34,786][36142] Sum rewards: 56.195, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.465', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO4': '0.160', 'AMMO3': '0.193', 'weapon5': '0.202', 'weapon4': '0.380', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.538', 'WEAPON3': '1.350', 'weapon3': '2.606', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.276', 'FRAGCOUNT': '51.500'} [2023-02-25 15:00:34,882][36156] DAMAGECOUNT value on done: 1586609.0 [2023-02-25 15:00:34,883][36156] Sum rewards: 59.894, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.860', 'AMMO5': '0.010', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'weapon5': '0.122', 'weapon2': '0.154', 'AMMO3': '0.166', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'weapon4': '1.020', 'weapon3': '2.486', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '16.200', 'FRAGCOUNT': '49.000'} [2023-02-25 15:00:35,185][36156] DAMAGECOUNT value on done: 1563703.0 [2023-02-25 15:00:35,185][36156] Sum rewards: 65.731, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.422', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO3': '0.118', 'AMMO4': '0.118', 'weapon5': '0.148', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.444', 'weapon2': '0.590', 'WEAPON3': '0.800', 'weapon3': '2.610', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '15.873', 'FRAGCOUNT': '52.000'} [2023-02-25 15:00:35,315][36156] DAMAGECOUNT value on done: 1581897.0 [2023-02-25 15:00:35,315][36156] Sum rewards: 66.165, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.956', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'weapon2': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'weapon4': '0.294', 'WEAPON3': '1.100', 'HITCOUNT': '3.270', 'weapon3': '3.414', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '54.000'} [2023-02-25 15:00:35,620][36156] DAMAGECOUNT value on done: 1568204.0 [2023-02-25 15:00:35,621][36156] Sum rewards: 59.733, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.463', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.066', 'weapon5': '0.152', 'AMMO3': '0.165', 'weapon2': '0.294', 'AMMO4': '0.328', 'WEAPON5': '0.400', 'WEAPON4': '0.750', 'weapon4': '0.812', 'WEAPON3': '1.000', 'weapon3': '2.396', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.943', 'FRAGCOUNT': '55.000'} [2023-02-25 15:00:36,999][36138] Updated weights for policy 0, policy_version 58063 (0.0009) [2023-02-25 15:00:39,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13523.7). Total num frames: 237862912. Throughput: 0: 3358.7. Samples: 21956270. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:00:39,730][36114] Avg episode reward: [(0, '60.042')] [2023-02-25 15:00:40,043][36138] Updated weights for policy 0, policy_version 58073 (0.0009) [2023-02-25 15:00:40,967][36155] DAMAGECOUNT value on done: 1565841.0 [2023-02-25 15:00:40,968][36155] Sum rewards: 54.584, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.782', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.091', 'AMMO3': '0.128', 'weapon2': '0.310', 'weapon4': '0.312', 'WEAPON3': '0.900', 'HITCOUNT': '2.930', 'weapon3': '3.170', 'DAMAGECOUNT': '13.356', 'FRAGCOUNT': '43.000'} [2023-02-25 15:00:41,181][36139] DAMAGECOUNT value on done: 1574877.0 [2023-02-25 15:00:41,181][36139] Sum rewards: 50.139, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-5.715', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.057', 'AMMO3': '0.252', 'weapon5': '0.260', 'AMMO4': '0.283', 'weapon2': '0.300', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.768', 'WEAPON3': '1.600', 'weapon3': '2.304', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '48.000'} [2023-02-25 15:00:41,282][36155] DAMAGECOUNT value on done: 1566668.0 [2023-02-25 15:00:41,282][36155] Sum rewards: 62.102, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.350', 'AMMO5': '0.005', 'AMMO2': '0.027', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'weapon5': '0.150', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'weapon4': '0.332', 'weapon2': '0.462', 'WEAPON3': '1.000', 'weapon3': '2.824', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.538', 'FRAGCOUNT': '51.000'} [2023-02-25 15:00:41,490][36139] DAMAGECOUNT value on done: 1575099.0 [2023-02-25 15:00:41,490][36139] Sum rewards: 68.782, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.625', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.162', 'weapon4': '0.162', 'weapon5': '0.168', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.406', 'WEAPON3': '1.000', 'weapon3': '3.046', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '57.000'} [2023-02-25 15:00:41,992][36139] DAMAGECOUNT value on done: 1584194.0 [2023-02-25 15:00:41,992][36139] Sum rewards: 75.142, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.372', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.137', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'weapon2': '0.356', 'weapon4': '0.388', 'WEAPON3': '1.100', 'weapon3': '2.896', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '61.500'} [2023-02-25 15:00:42,103][36155] DAMAGECOUNT value on done: 1584046.0 [2023-02-25 15:00:42,103][36155] Sum rewards: 57.413, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.914', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.120', 'WEAPON5': '0.150', 'weapon4': '0.184', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon2': '0.470', 'WEAPON3': '1.400', 'weapon3': '2.962', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.307', 'FRAGCOUNT': '52.000'} [2023-02-25 15:00:42,167][36154] DAMAGECOUNT value on done: 1576358.0 [2023-02-25 15:00:42,167][36154] Sum rewards: 68.133, reward structure: {'DEATHCOUNT': '-12.000', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO3': '0.145', 'weapon5': '0.156', 'AMMO4': '0.187', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.262', 'HEALTH': '0.283', 'weapon4': '0.754', 'WEAPON3': '0.850', 'weapon3': '2.220', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '54.500'} [2023-02-25 15:00:42,307][36139] DAMAGECOUNT value on done: 1582259.0 [2023-02-25 15:00:42,308][36139] Sum rewards: 56.063, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.941', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.138', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'weapon4': '0.294', 'WEAPON4': '0.350', 'weapon2': '0.426', 'WEAPON3': '1.600', 'weapon3': '2.852', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '52.500'} [2023-02-25 15:00:42,423][36155] DAMAGECOUNT value on done: 1571024.0 [2023-02-25 15:00:42,423][36155] Sum rewards: 57.508, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.800', 'AMMO5': '0.015', 'AMMO2': '0.022', 'AMMO4': '0.109', 'AMMO3': '0.169', 'weapon2': '0.172', 'WEAPON5': '0.200', 'weapon5': '0.212', 'WEAPON4': '0.300', 'weapon4': '0.616', 'WEAPON3': '1.000', 'weapon3': '2.778', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.895', 'FRAGCOUNT': '49.000'} [2023-02-25 15:00:42,468][36154] DAMAGECOUNT value on done: 1554918.0 [2023-02-25 15:00:42,469][36154] Sum rewards: 60.895, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.650', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.052', 'AMMO4': '0.069', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.164', 'weapon5': '0.178', 'AMMO3': '0.208', 'WEAPON3': '1.250', 'HITCOUNT': '3.090', 'weapon3': '3.394', 'DAMAGECOUNT': '15.072', 'FRAGCOUNT': '52.000'} [2023-02-25 15:00:42,884][36154] DAMAGECOUNT value on done: 1588144.0 [2023-02-25 15:00:42,885][36154] Sum rewards: 71.567, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.790', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.162', 'AMMO3': '0.216', 'weapon4': '0.430', 'WEAPON3': '1.250', 'weapon3': '2.994', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '61.000'} [2023-02-25 15:00:43,093][36138] Updated weights for policy 0, policy_version 58083 (0.0009) [2023-02-25 15:00:43,193][36154] DAMAGECOUNT value on done: 1568115.0 [2023-02-25 15:00:43,193][36154] Sum rewards: 50.137, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.217', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.134', 'AMMO3': '0.177', 'weapon4': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.890', 'WEAPON3': '1.100', 'weapon3': '2.592', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.927', 'FRAGCOUNT': '43.000'} [2023-02-25 15:00:44,094][36141] DAMAGECOUNT value on done: 1573809.0 [2023-02-25 15:00:44,094][36141] Sum rewards: 53.302, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.631', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.080', 'AMMO4': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon4': '0.382', 'weapon2': '0.518', 'WEAPON3': '1.050', 'weapon3': '2.838', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.473', 'FRAGCOUNT': '45.000'} [2023-02-25 15:00:44,401][36141] DAMAGECOUNT value on done: 1579340.0 [2023-02-25 15:00:44,402][36141] Sum rewards: 58.686, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.362', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.090', 'AMMO4': '0.125', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.342', 'weapon2': '0.424', 'WEAPON3': '1.250', 'weapon3': '2.906', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '14.832', 'FRAGCOUNT': '50.000'} [2023-02-25 15:00:44,414][36141] DAMAGECOUNT value on done: 1568040.0 [2023-02-25 15:00:44,415][36141] Sum rewards: 62.831, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.005', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.098', 'AMMO3': '0.201', 'weapon5': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.324', 'weapon4': '0.854', 'WEAPON3': '1.200', 'weapon3': '2.304', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '53.000'} [2023-02-25 15:00:44,721][36141] DAMAGECOUNT value on done: 1555388.0 [2023-02-25 15:00:44,722][36141] Sum rewards: 42.415, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.240', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.060', 'weapon4': '0.154', 'AMMO3': '0.264', 'weapon2': '0.694', 'WEAPON3': '1.350', 'weapon3': '2.200', 'HITCOUNT': '2.450', 'DAMAGECOUNT': '11.883', 'FRAGCOUNT': '39.000'} [2023-02-25 15:00:44,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13523.7). Total num frames: 237928448. Throughput: 0: 3358.0. Samples: 21976560. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:00:44,730][36114] Avg episode reward: [(0, '60.323')] [2023-02-25 15:00:46,107][36138] Updated weights for policy 0, policy_version 58093 (0.0010) [2023-02-25 15:00:47,836][36157] DAMAGECOUNT value on done: 1588749.0 [2023-02-25 15:00:47,836][36157] Sum rewards: 51.966, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.350', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon5': '0.180', 'AMMO3': '0.187', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.402', 'weapon4': '0.416', 'WEAPON3': '1.150', 'weapon3': '2.688', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.448', 'FRAGCOUNT': '45.000'} [2023-02-25 15:00:48,142][36157] DAMAGECOUNT value on done: 1573403.0 [2023-02-25 15:00:48,143][36157] Sum rewards: 53.755, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.204', 'AMMO5': '0.012', 'AMMO2': '0.040', 'AMMO4': '0.200', 'weapon5': '0.208', 'AMMO3': '0.223', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON4': '0.500', 'weapon4': '0.542', 'WEAPON3': '1.250', 'weapon3': '2.572', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '48.000'} [2023-02-25 15:00:48,568][36157] DAMAGECOUNT value on done: 1592267.0 [2023-02-25 15:00:48,568][36157] Sum rewards: 64.141, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.210', 'ARMOR': '0.012', 'AMMO5': '0.019', 'AMMO2': '0.051', 'AMMO3': '0.176', 'AMMO4': '0.255', 'weapon2': '0.294', 'weapon5': '0.304', 'WEAPON5': '0.600', 'WEAPON4': '0.800', 'weapon4': '0.870', 'WEAPON3': '1.150', 'weapon3': '2.168', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '56.000'} [2023-02-25 15:00:48,877][36157] DAMAGECOUNT value on done: 1579765.0 [2023-02-25 15:00:48,878][36157] Sum rewards: 63.351, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.245', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon5': '0.140', 'AMMO4': '0.154', 'AMMO3': '0.179', 'weapon4': '0.216', 'weapon2': '0.318', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '3.060', 'weapon3': '3.118', 'DAMAGECOUNT': '14.958', 'FRAGCOUNT': '55.000'} [2023-02-25 15:00:49,120][36138] Updated weights for policy 0, policy_version 58103 (0.0009) [2023-02-25 15:00:49,422][36140] DAMAGECOUNT value on done: 1585917.0 [2023-02-25 15:00:49,422][36140] Sum rewards: 62.025, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.010', 'AMMO5': '0.009', 'AMMO2': '0.028', 'AMMO3': '0.133', 'AMMO4': '0.138', 'weapon5': '0.170', 'WEAPON5': '0.250', 'weapon4': '0.270', 'WEAPON4': '0.350', 'weapon2': '0.452', 'ARMOR': '0.458', 'WEAPON3': '0.950', 'weapon3': '2.928', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '51.000'} [2023-02-25 15:00:49,585][36140] DAMAGECOUNT value on done: 1580978.0 [2023-02-25 15:00:49,586][36140] Sum rewards: 63.823, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.285', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.156', 'AMMO4': '0.158', 'AMMO3': '0.204', 'weapon2': '0.212', 'WEAPON5': '0.350', 'weapon4': '0.444', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.964', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '56.000'} [2023-02-25 15:00:49,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13448.5, 300 sec: 13523.7). Total num frames: 237993984. Throughput: 0: 3358.7. Samples: 21996888. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:00:49,730][36114] Avg episode reward: [(0, '60.324')] [2023-02-25 15:00:49,740][36140] DAMAGECOUNT value on done: 1562421.0 [2023-02-25 15:00:49,740][36140] Sum rewards: 61.104, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.590', 'AMMO5': '0.021', 'AMMO2': '0.040', 'AMMO3': '0.185', 'weapon5': '0.196', 'AMMO4': '0.202', 'weapon2': '0.204', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.734', 'WEAPON3': '1.050', 'weapon3': '2.608', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '51.000'} [2023-02-25 15:00:49,907][36140] DAMAGECOUNT value on done: 1574783.0 [2023-02-25 15:00:49,907][36140] Sum rewards: 58.882, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.455', 'AMMO5': '0.012', 'weapon4': '0.030', 'AMMO2': '0.031', 'weapon5': '0.126', 'AMMO4': '0.157', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.200', 'HITCOUNT': '3.110', 'weapon3': '3.306', 'DAMAGECOUNT': '14.859', 'FRAGCOUNT': '50.000'} [2023-02-25 15:00:52,170][36138] Updated weights for policy 0, policy_version 58113 (0.0009) [2023-02-25 15:00:53,504][36142] DAMAGECOUNT value on done: 1569820.0 [2023-02-25 15:00:53,505][36142] Sum rewards: 55.983, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.624', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.051', 'AMMO3': '0.150', 'AMMO4': '0.256', 'weapon5': '0.266', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.544', 'weapon4': '0.604', 'WEAPON3': '1.000', 'weapon3': '2.158', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.913', 'FRAGCOUNT': '48.000'} [2023-02-25 15:00:53,819][36142] DAMAGECOUNT value on done: 1559860.0 [2023-02-25 15:00:53,819][36142] Sum rewards: 49.875, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.260', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.011', 'weapon5': '0.022', 'AMMO4': '0.053', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.184', 'AMMO3': '0.219', 'weapon2': '0.280', 'WEAPON3': '1.400', 'HITCOUNT': '3.090', 'weapon3': '3.276', 'DAMAGECOUNT': '13.989', 'FRAGCOUNT': '44.000'} [2023-02-25 15:00:54,392][36142] DAMAGECOUNT value on done: 1573310.0 [2023-02-25 15:00:54,392][36142] Sum rewards: 54.348, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.102', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon4': '0.170', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'weapon2': '0.252', 'WEAPON5': '0.300', 'weapon5': '0.410', 'WEAPON3': '1.400', 'weapon3': '2.794', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.040', 'FRAGCOUNT': '49.000'} [2023-02-25 15:00:54,695][36142] DAMAGECOUNT value on done: 1580565.0 [2023-02-25 15:00:54,695][36142] Sum rewards: 59.921, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.858', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.042', 'AMMO4': '0.211', 'weapon2': '0.228', 'AMMO3': '0.231', 'weapon5': '0.320', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.652', 'WEAPON3': '1.300', 'weapon3': '2.442', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.588', 'FRAGCOUNT': '53.000'} [2023-02-25 15:00:54,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13523.7). Total num frames: 238063616. Throughput: 0: 3359.2. Samples: 22007072. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:00:54,730][36114] Avg episode reward: [(0, '60.112')] [2023-02-25 15:00:54,786][36156] DAMAGECOUNT value on done: 1591221.0 [2023-02-25 15:00:54,787][36156] Sum rewards: 50.295, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.776', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon7': '0.040', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.184', 'AMMO3': '0.226', 'weapon5': '0.268', 'weapon4': '0.288', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.250', 'weapon3': '2.650', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.836', 'FRAGCOUNT': '46.000'} [2023-02-25 15:00:55,101][36156] DAMAGECOUNT value on done: 1568156.0 [2023-02-25 15:00:55,101][36156] Sum rewards: 50.172, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.572', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.112', 'AMMO3': '0.139', 'weapon5': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.258', 'weapon2': '0.474', 'WEAPON3': '1.050', 'HITCOUNT': '2.790', 'weapon3': '2.884', 'DAMAGECOUNT': '13.359', 'FRAGCOUNT': '43.000'} [2023-02-25 15:00:55,225][36138] Updated weights for policy 0, policy_version 58123 (0.0009) [2023-02-25 15:00:55,239][36156] DAMAGECOUNT value on done: 1587461.0 [2023-02-25 15:00:55,239][36156] Sum rewards: 61.154, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-1.512', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.092', 'AMMO4': '0.134', 'WEAPON5': '0.200', 'AMMO3': '0.274', 'weapon2': '0.290', 'WEAPON4': '0.300', 'weapon4': '0.322', 'WEAPON3': '1.450', 'weapon3': '2.984', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.692', 'FRAGCOUNT': '56.000'} [2023-02-25 15:00:55,546][36156] DAMAGECOUNT value on done: 1573780.0 [2023-02-25 15:00:55,546][36156] Sum rewards: 63.108, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.315', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.212', 'AMMO3': '0.221', 'weapon2': '0.226', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.562', 'WEAPON3': '1.400', 'weapon3': '2.730', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '55.000'} [2023-02-25 15:00:58,211][36138] Updated weights for policy 0, policy_version 58133 (0.0009) [2023-02-25 15:00:59,729][36114] Fps is (10 sec: 13926.4, 60 sec: 13516.9, 300 sec: 13523.7). Total num frames: 238133248. Throughput: 0: 3359.6. Samples: 22027382. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:00:59,730][36114] Avg episode reward: [(0, '60.131')] [2023-02-25 15:01:00,827][36155] DAMAGECOUNT value on done: 1571274.0 [2023-02-25 15:01:00,827][36155] Sum rewards: 67.540, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.769', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.138', 'weapon5': '0.192', 'weapon2': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.700', 'WEAPON3': '0.900', 'weapon3': '2.580', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.299', 'FRAGCOUNT': '56.000'} [2023-02-25 15:01:00,910][36139] DAMAGECOUNT value on done: 1580269.0 [2023-02-25 15:01:00,911][36139] Sum rewards: 62.936, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.304', 'ARMOR': '0.004', 'AMMO2': '0.034', 'WEAPON4': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.260', 'weapon2': '0.316', 'weapon4': '0.498', 'WEAPON3': '1.450', 'weapon3': '2.984', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '55.000'} [2023-02-25 15:01:01,114][36142] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 15:01:01,132][36155] DAMAGECOUNT value on done: 1571160.0 [2023-02-25 15:01:01,132][36155] Sum rewards: 54.411, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.092', 'ARMOR': '0.004', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'weapon4': '0.260', 'weapon2': '0.584', 'WEAPON3': '1.000', 'weapon3': '3.004', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.476', 'FRAGCOUNT': '45.000'} [2023-02-25 15:01:01,212][36139] DAMAGECOUNT value on done: 1581992.0 [2023-02-25 15:01:01,213][36139] Sum rewards: 80.659, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.522', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.137', 'weapon4': '0.164', 'weapon5': '0.182', 'AMMO3': '0.235', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.118', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.673', 'FRAGCOUNT': '69.000'} [2023-02-25 15:01:01,219][36138] Updated weights for policy 0, policy_version 58143 (0.0009) [2023-02-25 15:01:01,700][36139] DAMAGECOUNT value on done: 1588792.0 [2023-02-25 15:01:01,700][36139] Sum rewards: 48.473, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.172', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.058', 'AMMO3': '0.176', 'AMMO4': '0.290', 'weapon2': '0.344', 'weapon5': '0.530', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'weapon4': '0.726', 'WEAPON3': '1.000', 'weapon3': '2.058', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.794', 'FRAGCOUNT': '42.500'} [2023-02-25 15:01:01,867][36155] DAMAGECOUNT value on done: 1589985.0 [2023-02-25 15:01:01,868][36155] Sum rewards: 73.311, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.606', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon5': '0.124', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.248', 'weapon2': '0.610', 'WEAPON3': '0.950', 'weapon3': '2.786', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '59.000'} [2023-02-25 15:01:01,980][36154] DAMAGECOUNT value on done: 1581347.0 [2023-02-25 15:01:01,981][36154] Sum rewards: 58.406, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.418', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.156', 'AMMO3': '0.158', 'weapon2': '0.166', 'WEAPON5': '0.300', 'weapon4': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '0.900', 'HITCOUNT': '3.150', 'weapon3': '3.162', 'DAMAGECOUNT': '14.967', 'FRAGCOUNT': '48.000'} [2023-02-25 15:01:02,019][36139] DAMAGECOUNT value on done: 1587745.0 [2023-02-25 15:01:02,020][36139] Sum rewards: 69.428, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.007', 'AMMO5': '0.006', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'weapon5': '0.090', 'WEAPON5': '0.150', 'weapon4': '0.150', 'AMMO3': '0.195', 'weapon2': '0.250', 'WEAPON3': '1.100', 'weapon3': '3.300', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '57.000'} [2023-02-25 15:01:02,169][36155] DAMAGECOUNT value on done: 1575864.0 [2023-02-25 15:01:02,169][36155] Sum rewards: 55.971, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.944', 'AMMO2': '0.012', 'AMMO5': '0.012', 'weapon4': '0.046', 'weapon5': '0.060', 'AMMO4': '0.061', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'weapon2': '0.604', 'WEAPON3': '1.500', 'weapon3': '3.070', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '51.000'} [2023-02-25 15:01:02,297][36154] DAMAGECOUNT value on done: 1560265.0 [2023-02-25 15:01:02,298][36154] Sum rewards: 65.635, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.307', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'weapon4': '0.228', 'weapon2': '0.608', 'WEAPON3': '0.750', 'weapon3': '2.976', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '50.000'} [2023-02-25 15:01:02,814][36154] DAMAGECOUNT value on done: 1593126.0 [2023-02-25 15:01:02,814][36154] Sum rewards: 58.028, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.776', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon7': '0.082', 'AMMO4': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.154', 'weapon2': '0.158', 'AMMO3': '0.159', 'WEAPON7': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.786', 'WEAPON3': '0.900', 'weapon3': '2.404', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.946', 'FRAGCOUNT': '48.500'} [2023-02-25 15:01:03,126][36154] DAMAGECOUNT value on done: 1573496.0 [2023-02-25 15:01:03,127][36154] Sum rewards: 66.379, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.745', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.154', 'AMMO3': '0.159', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.250', 'weapon2': '0.602', 'WEAPON3': '1.050', 'weapon3': '2.756', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.143', 'FRAGCOUNT': '55.000'} [2023-02-25 15:01:03,987][36141] DAMAGECOUNT value on done: 1579046.0 [2023-02-25 15:01:03,988][36141] Sum rewards: 63.203, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.782', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.032', 'weapon5': '0.044', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'weapon2': '0.548', 'WEAPON3': '1.100', 'weapon3': '3.246', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '51.000'} [2023-02-25 15:01:04,278][36141] DAMAGECOUNT value on done: 1573317.0 [2023-02-25 15:01:04,278][36141] Sum rewards: 61.920, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.942', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.143', 'AMMO4': '0.189', 'weapon5': '0.248', 'weapon2': '0.334', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'weapon4': '1.006', 'weapon3': '2.070', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.831', 'FRAGCOUNT': '50.000'} [2023-02-25 15:01:04,300][36141] DAMAGECOUNT value on done: 1584336.0 [2023-02-25 15:01:04,301][36141] Sum rewards: 61.863, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.808', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.050', 'AMMO3': '0.137', 'weapon2': '0.198', 'AMMO4': '0.249', 'weapon5': '0.274', 'weapon4': '0.564', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '0.800', 'weapon3': '2.536', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.988', 'FRAGCOUNT': '53.000'} [2023-02-25 15:01:04,318][36138] Updated weights for policy 0, policy_version 58153 (0.0009) [2023-02-25 15:01:04,580][36141] DAMAGECOUNT value on done: 1560530.0 [2023-02-25 15:01:04,580][36141] Sum rewards: 58.610, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.202', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.043', 'weapon5': '0.062', 'WEAPON5': '0.150', 'weapon2': '0.180', 'AMMO4': '0.214', 'AMMO3': '0.218', 'WEAPON4': '0.500', 'weapon4': '1.010', 'WEAPON3': '1.350', 'weapon3': '2.530', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '53.000'} [2023-02-25 15:01:04,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13523.7). Total num frames: 238198784. Throughput: 0: 3360.9. Samples: 22047566. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:01:04,730][36114] Avg episode reward: [(0, '60.362')] [2023-02-25 15:01:07,324][36138] Updated weights for policy 0, policy_version 58163 (0.0009) [2023-02-25 15:01:07,774][36157] DAMAGECOUNT value on done: 1594468.0 [2023-02-25 15:01:07,775][36157] Sum rewards: 69.407, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.203', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.106', 'AMMO4': '0.166', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'weapon2': '0.212', 'weapon4': '0.220', 'WEAPON4': '0.250', 'WEAPON3': '1.100', 'HITCOUNT': '3.180', 'weapon3': '3.284', 'DAMAGECOUNT': '17.157', 'FRAGCOUNT': '58.500'} [2023-02-25 15:01:08,085][36157] DAMAGECOUNT value on done: 1578382.0 [2023-02-25 15:01:08,086][36157] Sum rewards: 60.873, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.069', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'AMMO4': '0.147', 'WEAPON4': '0.350', 'weapon2': '0.508', 'weapon4': '0.660', 'WEAPON3': '0.700', 'weapon3': '2.666', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.937', 'FRAGCOUNT': '49.000'} [2023-02-25 15:01:08,500][36157] DAMAGECOUNT value on done: 1597199.0 [2023-02-25 15:01:08,500][36157] Sum rewards: 52.921, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.940', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.142', 'WEAPON5': '0.150', 'weapon2': '0.194', 'AMMO3': '0.223', 'weapon4': '0.240', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '2.900', 'weapon3': '3.202', 'DAMAGECOUNT': '14.796', 'FRAGCOUNT': '45.000'} [2023-02-25 15:01:08,810][36157] DAMAGECOUNT value on done: 1584585.0 [2023-02-25 15:01:08,810][36157] Sum rewards: 47.169, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.532', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'AMMO3': '0.188', 'weapon4': '0.218', 'WEAPON4': '0.350', 'weapon2': '0.540', 'WEAPON3': '1.250', 'weapon3': '2.986', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.325', 'FRAGCOUNT': '40.000'} [2023-02-25 15:01:09,369][36140] DAMAGECOUNT value on done: 1591334.0 [2023-02-25 15:01:09,370][36140] Sum rewards: 59.947, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.440', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.186', 'AMMO3': '0.252', 'weapon2': '0.256', 'WEAPON3': '1.550', 'weapon3': '3.256', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.251', 'FRAGCOUNT': '51.000'} [2023-02-25 15:01:09,551][36140] DAMAGECOUNT value on done: 1586132.0 [2023-02-25 15:01:09,551][36140] Sum rewards: 55.853, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.868', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.047', 'AMMO3': '0.157', 'AMMO4': '0.235', 'weapon5': '0.320', 'weapon4': '0.374', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon2': '0.718', 'WEAPON3': '1.000', 'weapon3': '2.274', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.462', 'FRAGCOUNT': '49.000'} [2023-02-25 15:01:09,676][36140] DAMAGECOUNT value on done: 1566779.0 [2023-02-25 15:01:09,676][36140] Sum rewards: 52.369, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.680', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.102', 'weapon5': '0.112', 'AMMO3': '0.180', 'weapon2': '0.274', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.588', 'WEAPON3': '1.150', 'weapon3': '2.616', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.074', 'FRAGCOUNT': '46.000'} [2023-02-25 15:01:09,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13448.5, 300 sec: 13509.9). Total num frames: 238264320. Throughput: 0: 3366.7. Samples: 22057716. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:01:09,730][36114] Avg episode reward: [(0, '59.936')] [2023-02-25 15:01:09,856][36140] DAMAGECOUNT value on done: 1579609.0 [2023-02-25 15:01:09,857][36140] Sum rewards: 62.722, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.489', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.024', 'AMMO4': '0.036', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.161', 'weapon2': '0.330', 'WEAPON3': '1.100', 'HITCOUNT': '3.110', 'weapon3': '3.462', 'DAMAGECOUNT': '14.478', 'FRAGCOUNT': '52.000'} [2023-02-25 15:01:10,368][36138] Updated weights for policy 0, policy_version 58173 (0.0010) [2023-02-25 15:01:12,086][36154] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 15:01:13,413][36138] Updated weights for policy 0, policy_version 58183 (0.0010) [2023-02-25 15:01:13,452][36142] DAMAGECOUNT value on done: 1574103.0 [2023-02-25 15:01:13,453][36142] Sum rewards: 51.690, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.007', 'AMMO2': '0.035', 'HEALTH': '0.048', 'weapon5': '0.118', 'WEAPON5': '0.150', 'weapon2': '0.162', 'AMMO3': '0.163', 'AMMO4': '0.174', 'WEAPON4': '0.300', 'weapon4': '0.734', 'WEAPON3': '0.950', 'weapon3': '2.740', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.849', 'FRAGCOUNT': '44.000'} [2023-02-25 15:01:13,754][36142] DAMAGECOUNT value on done: 1565941.0 [2023-02-25 15:01:13,754][36142] Sum rewards: 73.958, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.732', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.046', 'AMMO4': '0.050', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon2': '0.202', 'AMMO3': '0.233', 'weapon4': '0.268', 'WEAPON3': '1.450', 'weapon3': '3.206', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '64.000'} [2023-02-25 15:01:14,376][36142] DAMAGECOUNT value on done: 1578144.0 [2023-02-25 15:01:14,376][36142] Sum rewards: 51.005, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.140', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'weapon2': '0.186', 'AMMO3': '0.295', 'WEAPON3': '1.750', 'HITCOUNT': '2.800', 'weapon3': '3.576', 'DAMAGECOUNT': '14.502', 'FRAGCOUNT': '48.000'} [2023-02-25 15:01:14,689][36142] DAMAGECOUNT value on done: 1585679.0 [2023-02-25 15:01:14,690][36142] Sum rewards: 59.134, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.095', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.060', 'AMMO4': '0.064', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon2': '0.370', 'weapon4': '0.578', 'WEAPON3': '1.150', 'weapon3': '2.710', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '49.000'} [2023-02-25 15:01:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13523.7). Total num frames: 238333952. Throughput: 0: 3371.1. Samples: 22077906. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:01:14,730][36114] Avg episode reward: [(0, '59.734')] [2023-02-25 15:01:14,765][36156] DAMAGECOUNT value on done: 1595843.0 [2023-02-25 15:01:14,766][36156] Sum rewards: 50.751, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.792', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.294', 'WEAPON4': '0.300', 'weapon4': '0.420', 'WEAPON3': '1.400', 'weapon3': '2.836', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.866', 'FRAGCOUNT': '46.500'} [2023-02-25 15:01:15,072][36156] DAMAGECOUNT value on done: 1573855.0 [2023-02-25 15:01:15,072][36156] Sum rewards: 64.427, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.125', 'AMMO5': '0.007', 'AMMO2': '0.047', 'weapon5': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'AMMO4': '0.237', 'weapon2': '0.250', 'weapon4': '0.374', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.952', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '56.000'} [2023-02-25 15:01:15,250][36156] DAMAGECOUNT value on done: 1592073.0 [2023-02-25 15:01:15,251][36156] Sum rewards: 57.569, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.980', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.128', 'weapon5': '0.306', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.588', 'WEAPON3': '0.800', 'weapon4': '1.152', 'weapon3': '1.714', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.836', 'FRAGCOUNT': '46.000'} [2023-02-25 15:01:15,559][36156] DAMAGECOUNT value on done: 1578838.0 [2023-02-25 15:01:15,560][36156] Sum rewards: 62.990, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.600', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon4': '0.056', 'weapon5': '0.082', 'AMMO4': '0.148', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.632', 'WEAPON3': '0.950', 'weapon3': '3.074', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.174', 'FRAGCOUNT': '51.000'} [2023-02-25 15:01:16,461][36138] Updated weights for policy 0, policy_version 58193 (0.0009) [2023-02-25 15:01:16,568][36141] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 15:01:19,490][36138] Updated weights for policy 0, policy_version 58203 (0.0009) [2023-02-25 15:01:19,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13509.9). Total num frames: 238399488. Throughput: 0: 3378.4. Samples: 22098120. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:01:19,730][36114] Avg episode reward: [(0, '59.847')] [2023-02-25 15:01:19,733][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000058203_238399488.pth... [2023-02-25 15:01:19,792][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000057412_235159552.pth [2023-02-25 15:01:20,675][36155] DAMAGECOUNT value on done: 1576419.0 [2023-02-25 15:01:20,676][36155] Sum rewards: 60.390, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.189', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.198', 'WEAPON4': '0.350', 'weapon4': '0.354', 'weapon2': '0.396', 'WEAPON3': '1.300', 'weapon3': '3.012', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.435', 'FRAGCOUNT': '53.000'} [2023-02-25 15:01:20,807][36139] DAMAGECOUNT value on done: 1584836.0 [2023-02-25 15:01:20,807][36139] Sum rewards: 54.579, reward structure: {'DEATHCOUNT': '-13.500', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.029', 'HEALTH': '0.100', 'weapon5': '0.108', 'AMMO4': '0.145', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'weapon4': '0.282', 'WEAPON4': '0.300', 'weapon2': '0.734', 'WEAPON3': '0.900', 'weapon3': '2.594', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.701', 'FRAGCOUNT': '46.000'} [2023-02-25 15:01:20,991][36155] DAMAGECOUNT value on done: 1576299.0 [2023-02-25 15:01:20,992][36155] Sum rewards: 68.700, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.859', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.011', 'weapon5': '0.044', 'AMMO4': '0.053', 'WEAPON5': '0.100', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'weapon4': '0.242', 'weapon2': '0.626', 'WEAPON3': '1.000', 'weapon3': '2.966', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.417', 'FRAGCOUNT': '57.000'} [2023-02-25 15:01:21,122][36139] DAMAGECOUNT value on done: 1587134.0 [2023-02-25 15:01:21,123][36139] Sum rewards: 58.346, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.400', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon5': '0.052', 'weapon4': '0.058', 'AMMO4': '0.223', 'AMMO3': '0.234', 'weapon2': '0.308', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '3.310', 'weapon3': '3.326', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '54.000'} [2023-02-25 15:01:21,658][36139] DAMAGECOUNT value on done: 1594661.0 [2023-02-25 15:01:21,659][36139] Sum rewards: 69.125, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.031', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon2': '0.166', 'weapon5': '0.172', 'AMMO3': '0.189', 'weapon4': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.206', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '57.000'} [2023-02-25 15:01:21,715][36155] DAMAGECOUNT value on done: 1594775.0 [2023-02-25 15:01:21,716][36155] Sum rewards: 52.729, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.523', 'AMMO5': '0.018', 'AMMO2': '0.064', 'AMMO3': '0.141', 'weapon5': '0.226', 'AMMO4': '0.319', 'ARMOR': '0.400', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon2': '0.662', 'weapon4': '0.754', 'WEAPON3': '0.800', 'weapon3': '2.118', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.370', 'FRAGCOUNT': '44.500'} [2023-02-25 15:01:21,921][36154] DAMAGECOUNT value on done: 1586323.0 [2023-02-25 15:01:21,921][36154] Sum rewards: 59.021, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.545', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'weapon4': '0.056', 'AMMO4': '0.122', 'weapon5': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'weapon2': '0.888', 'WEAPON3': '1.100', 'weapon3': '2.710', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.928', 'FRAGCOUNT': '50.000'} [2023-02-25 15:01:21,966][36139] DAMAGECOUNT value on done: 1593009.0 [2023-02-25 15:01:21,966][36139] Sum rewards: 59.987, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.725', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.072', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.268', 'weapon4': '0.318', 'WEAPON3': '1.350', 'weapon3': '3.106', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.792', 'FRAGCOUNT': '52.000'} [2023-02-25 15:01:22,018][36155] DAMAGECOUNT value on done: 1580752.0 [2023-02-25 15:01:22,018][36155] Sum rewards: 59.703, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.930', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'weapon4': '0.178', 'weapon2': '0.470', 'WEAPON3': '1.050', 'HITCOUNT': '2.880', 'weapon3': '2.962', 'DAMAGECOUNT': '14.664', 'FRAGCOUNT': '50.000'} [2023-02-25 15:01:22,213][36154] DAMAGECOUNT value on done: 1565939.0 [2023-02-25 15:01:22,214][36154] Sum rewards: 67.515, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.618', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'weapon2': '0.184', 'AMMO3': '0.198', 'WEAPON3': '1.350', 'HITCOUNT': '3.230', 'weapon3': '3.704', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '56.000'} [2023-02-25 15:01:22,548][36138] Updated weights for policy 0, policy_version 58213 (0.0009) [2023-02-25 15:01:22,730][36154] DAMAGECOUNT value on done: 1598023.0 [2023-02-25 15:01:22,731][36154] Sum rewards: 57.508, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.808', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon5': '0.168', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'weapon2': '0.320', 'WEAPON4': '0.400', 'weapon4': '0.490', 'WEAPON3': '1.100', 'weapon3': '2.808', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.691', 'FRAGCOUNT': '50.000'} [2023-02-25 15:01:23,031][36154] DAMAGECOUNT value on done: 1578938.0 [2023-02-25 15:01:23,032][36154] Sum rewards: 69.428, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.570', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.138', 'AMMO3': '0.163', 'weapon4': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.050', 'weapon3': '3.140', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '57.000'} [2023-02-25 15:01:23,982][36141] DAMAGECOUNT value on done: 1584932.0 [2023-02-25 15:01:23,983][36141] Sum rewards: 67.660, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.025', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.159', 'weapon2': '0.226', 'WEAPON4': '0.250', 'weapon5': '0.272', 'WEAPON5': '0.300', 'weapon4': '0.514', 'WEAPON3': '1.000', 'weapon3': '2.678', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '54.000'} [2023-02-25 15:01:24,286][36141] DAMAGECOUNT value on done: 1578061.0 [2023-02-25 15:01:24,287][36141] Sum rewards: 51.069, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.505', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.110', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'AMMO4': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.270', 'weapon2': '0.282', 'WEAPON3': '1.500', 'HITCOUNT': '3.050', 'weapon3': '3.166', 'DAMAGECOUNT': '14.232', 'FRAGCOUNT': '46.000'} [2023-02-25 15:01:24,313][36141] DAMAGECOUNT value on done: 1589648.0 [2023-02-25 15:01:24,313][36141] Sum rewards: 56.844, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.480', 'AMMO5': '0.022', 'AMMO2': '0.061', 'weapon4': '0.142', 'AMMO3': '0.144', 'AMMO4': '0.305', 'weapon5': '0.310', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'weapon2': '0.610', 'WEAPON3': '0.950', 'weapon3': '2.674', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.936', 'FRAGCOUNT': '47.500'} [2023-02-25 15:01:24,618][36141] DAMAGECOUNT value on done: 1564711.0 [2023-02-25 15:01:24,618][36141] Sum rewards: 45.753, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.828', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.132', 'AMMO4': '0.159', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'WEAPON4': '0.400', 'weapon4': '0.458', 'weapon2': '0.496', 'WEAPON3': '1.450', 'weapon3': '2.474', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '12.543', 'FRAGCOUNT': '46.000'} [2023-02-25 15:01:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13523.7). Total num frames: 238469120. Throughput: 0: 3375.5. Samples: 22108168. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:01:24,730][36114] Avg episode reward: [(0, '59.517')] [2023-02-25 15:01:25,566][36138] Updated weights for policy 0, policy_version 58223 (0.0009) [2023-02-25 15:01:27,784][36157] DAMAGECOUNT value on done: 1599000.0 [2023-02-25 15:01:27,784][36157] Sum rewards: 45.634, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.426', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.032', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.158', 'weapon2': '0.202', 'AMMO3': '0.274', 'WEAPON4': '0.350', 'weapon4': '0.382', 'WEAPON3': '1.650', 'weapon3': '3.114', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.596', 'FRAGCOUNT': '44.000'} [2023-02-25 15:01:28,096][36157] DAMAGECOUNT value on done: 1583097.0 [2023-02-25 15:01:28,096][36157] Sum rewards: 55.938, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.997', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.042', 'AMMO3': '0.185', 'AMMO4': '0.212', 'weapon2': '0.270', 'weapon5': '0.270', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'weapon4': '0.974', 'WEAPON3': '1.150', 'weapon3': '1.962', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.145', 'FRAGCOUNT': '50.000'} [2023-02-25 15:01:28,502][36157] DAMAGECOUNT value on done: 1602364.0 [2023-02-25 15:01:28,503][36157] Sum rewards: 62.909, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.450', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.118', 'AMMO3': '0.179', 'weapon2': '0.436', 'WEAPON3': '1.200', 'HITCOUNT': '3.120', 'weapon3': '3.252', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '52.000'} [2023-02-25 15:01:28,579][36138] Updated weights for policy 0, policy_version 58233 (0.0009) [2023-02-25 15:01:28,803][36157] DAMAGECOUNT value on done: 1589416.0 [2023-02-25 15:01:28,803][36157] Sum rewards: 50.072, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.525', 'AMMO5': '0.021', 'AMMO2': '0.034', 'AMMO4': '0.169', 'AMMO3': '0.170', 'weapon5': '0.228', 'weapon2': '0.388', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.000', 'weapon4': '1.022', 'weapon3': '1.972', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.493', 'FRAGCOUNT': '44.000'} [2023-02-25 15:01:29,311][36140] DAMAGECOUNT value on done: 1596595.0 [2023-02-25 15:01:29,312][36140] Sum rewards: 64.973, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.210', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.015', 'AMMO4': '0.076', 'AMMO3': '0.148', 'weapon4': '0.148', 'weapon5': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.524', 'WEAPON3': '1.100', 'weapon3': '2.962', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.783', 'FRAGCOUNT': '53.500'} [2023-02-25 15:01:29,490][36140] DAMAGECOUNT value on done: 1590631.0 [2023-02-25 15:01:29,491][36140] Sum rewards: 42.255, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-3.924', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.079', 'AMMO3': '0.261', 'weapon2': '0.294', 'weapon5': '0.302', 'AMMO4': '0.393', 'weapon4': '0.598', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.500', 'weapon3': '2.376', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '13.497', 'FRAGCOUNT': '43.000'} [2023-02-25 15:01:29,626][36140] DAMAGECOUNT value on done: 1571807.0 [2023-02-25 15:01:29,626][36140] Sum rewards: 58.011, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.955', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon5': '0.088', 'AMMO4': '0.099', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON4': '0.350', 'weapon4': '0.552', 'WEAPON3': '1.250', 'weapon3': '2.806', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.084', 'FRAGCOUNT': '51.000'} [2023-02-25 15:01:29,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13509.9). Total num frames: 238534656. Throughput: 0: 3374.7. Samples: 22128422. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:01:29,730][36114] Avg episode reward: [(0, '59.201')] [2023-02-25 15:01:29,811][36140] DAMAGECOUNT value on done: 1585060.0 [2023-02-25 15:01:29,812][36140] Sum rewards: 61.207, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.734', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.138', 'AMMO4': '0.176', 'AMMO3': '0.181', 'weapon2': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.768', 'WEAPON3': '1.150', 'weapon3': '2.542', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '53.000'} [2023-02-25 15:01:31,611][36138] Updated weights for policy 0, policy_version 58243 (0.0010) [2023-02-25 15:01:33,425][36142] DAMAGECOUNT value on done: 1579100.0 [2023-02-25 15:01:33,426][36142] Sum rewards: 56.185, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.998', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.034', 'weapon5': '0.072', 'AMMO4': '0.168', 'weapon2': '0.196', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'weapon4': '0.362', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '3.140', 'weapon3': '3.142', 'DAMAGECOUNT': '14.991', 'FRAGCOUNT': '49.000'} [2023-02-25 15:01:33,731][36142] DAMAGECOUNT value on done: 1570333.0 [2023-02-25 15:01:33,731][36142] Sum rewards: 52.308, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.767', 'AMMO5': '0.007', 'AMMO2': '0.036', 'AMMO3': '0.155', 'AMMO4': '0.182', 'WEAPON5': '0.250', 'weapon5': '0.272', 'weapon2': '0.390', 'WEAPON4': '0.450', 'ARMOR': '0.472', 'weapon4': '0.696', 'WEAPON3': '0.950', 'weapon3': '2.418', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.176', 'FRAGCOUNT': '45.000'} [2023-02-25 15:01:34,355][36142] DAMAGECOUNT value on done: 1582815.0 [2023-02-25 15:01:34,355][36142] Sum rewards: 49.859, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.122', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon4': '0.268', 'weapon2': '0.364', 'WEAPON3': '1.250', 'weapon3': '2.928', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.013', 'FRAGCOUNT': '42.500'} [2023-02-25 15:01:34,648][36138] Updated weights for policy 0, policy_version 58253 (0.0009) [2023-02-25 15:01:34,658][36142] DAMAGECOUNT value on done: 1589519.0 [2023-02-25 15:01:34,659][36142] Sum rewards: 39.313, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.400', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon5': '0.186', 'AMMO3': '0.197', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.528', 'weapon4': '0.592', 'WEAPON3': '1.200', 'weapon3': '2.418', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '11.520', 'FRAGCOUNT': '36.000'} [2023-02-25 15:01:34,722][36156] DAMAGECOUNT value on done: 1601008.0 [2023-02-25 15:01:34,722][36156] Sum rewards: 62.747, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.607', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon5': '0.144', 'AMMO4': '0.156', 'AMMO3': '0.178', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.390', 'weapon4': '0.530', 'WEAPON3': '1.150', 'weapon3': '2.684', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '54.000'} [2023-02-25 15:01:34,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13509.9). Total num frames: 238604288. Throughput: 0: 3372.8. Samples: 22148666. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:01:34,730][36114] Avg episode reward: [(0, '58.908')] [2023-02-25 15:01:35,024][36156] DAMAGECOUNT value on done: 1577648.0 [2023-02-25 15:01:35,025][36156] Sum rewards: 42.467, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.116', 'AMMO5': '0.018', 'AMMO2': '0.040', 'AMMO3': '0.182', 'AMMO4': '0.202', 'weapon5': '0.282', 'weapon2': '0.300', 'ARMOR': '0.453', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'weapon4': '0.790', 'WEAPON3': '1.100', 'weapon3': '2.086', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '11.379', 'FRAGCOUNT': '40.000'} [2023-02-25 15:01:35,245][36156] DAMAGECOUNT value on done: 1596959.0 [2023-02-25 15:01:35,245][36156] Sum rewards: 61.256, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.850', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.098', 'AMMO3': '0.131', 'AMMO4': '0.131', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.332', 'weapon2': '0.634', 'WEAPON3': '0.850', 'weapon3': '2.744', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.562', 'FRAGCOUNT': '51.000'} [2023-02-25 15:01:35,553][36156] DAMAGECOUNT value on done: 1582965.0 [2023-02-25 15:01:35,554][36156] Sum rewards: 41.475, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.982', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.086', 'weapon4': '0.180', 'AMMO4': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.258', 'AMMO3': '0.270', 'WEAPON3': '1.650', 'HITCOUNT': '2.700', 'weapon3': '3.288', 'DAMAGECOUNT': '12.381', 'FRAGCOUNT': '39.000'} [2023-02-25 15:01:37,693][36156] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 15:01:37,697][36138] Updated weights for policy 0, policy_version 58263 (0.0009) [2023-02-25 15:01:39,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13509.9). Total num frames: 238669824. Throughput: 0: 3372.0. Samples: 22158810. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:01:39,730][36114] Avg episode reward: [(0, '58.697')] [2023-02-25 15:01:40,507][36155] DAMAGECOUNT value on done: 1580045.0 [2023-02-25 15:01:40,507][36155] Sum rewards: 45.944, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.040', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.088', 'AMMO4': '0.133', 'WEAPON4': '0.150', 'AMMO3': '0.154', 'weapon2': '0.230', 'WEAPON5': '0.250', 'weapon4': '0.266', 'WEAPON3': '1.000', 'HITCOUNT': '2.440', 'weapon3': '3.108', 'DAMAGECOUNT': '10.878', 'FRAGCOUNT': '39.000'} [2023-02-25 15:01:40,678][36139] DAMAGECOUNT value on done: 1589766.0 [2023-02-25 15:01:40,679][36139] Sum rewards: 56.828, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.813', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.074', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.222', 'weapon2': '0.352', 'WEAPON3': '1.150', 'HITCOUNT': '2.950', 'weapon3': '3.174', 'DAMAGECOUNT': '14.790', 'FRAGCOUNT': '48.000'} [2023-02-25 15:01:40,740][36138] Updated weights for policy 0, policy_version 58273 (0.0009) [2023-02-25 15:01:40,820][36155] DAMAGECOUNT value on done: 1581499.0 [2023-02-25 15:01:40,821][36155] Sum rewards: 60.208, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.039', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.068', 'WEAPON5': '0.100', 'weapon2': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.265', 'weapon4': '0.298', 'WEAPON3': '1.550', 'HITCOUNT': '3.220', 'weapon3': '3.278', 'DAMAGECOUNT': '15.600', 'FRAGCOUNT': '54.000'} [2023-02-25 15:01:40,999][36139] DAMAGECOUNT value on done: 1593079.0 [2023-02-25 15:01:41,000][36139] Sum rewards: 66.393, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.225', 'AMMO5': '0.008', 'AMMO2': '0.011', 'weapon5': '0.036', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon2': '0.200', 'AMMO3': '0.212', 'weapon4': '0.282', 'WEAPON3': '1.400', 'weapon3': '3.132', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '56.000'} [2023-02-25 15:01:41,461][36139] DAMAGECOUNT value on done: 1598925.0 [2023-02-25 15:01:41,461][36139] Sum rewards: 57.645, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.731', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.100', 'weapon5': '0.136', 'WEAPON3': '0.700', 'weapon2': '0.888', 'weapon3': '2.792', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.792', 'FRAGCOUNT': '44.000'} [2023-02-25 15:01:41,550][36155] DAMAGECOUNT value on done: 1599486.0 [2023-02-25 15:01:41,551][36155] Sum rewards: 46.673, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.100', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon5': '0.174', 'AMMO4': '0.226', 'AMMO3': '0.233', 'weapon4': '0.364', 'WEAPON5': '0.400', 'weapon2': '0.432', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.714', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.133', 'FRAGCOUNT': '43.500'} [2023-02-25 15:01:41,758][36139] DAMAGECOUNT value on done: 1598491.0 [2023-02-25 15:01:41,759][36139] Sum rewards: 63.471, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.778', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.112', 'AMMO3': '0.184', 'weapon5': '0.204', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.512', 'WEAPON3': '1.050', 'weapon3': '2.644', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.446', 'FRAGCOUNT': '53.000'} [2023-02-25 15:01:41,793][36154] DAMAGECOUNT value on done: 1591238.0 [2023-02-25 15:01:41,794][36154] Sum rewards: 62.942, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.375', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'weapon5': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'weapon4': '0.420', 'weapon2': '0.680', 'WEAPON3': '0.950', 'weapon3': '2.602', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.745', 'FRAGCOUNT': '52.000'} [2023-02-25 15:01:41,849][36155] DAMAGECOUNT value on done: 1585284.0 [2023-02-25 15:01:41,850][36155] Sum rewards: 51.508, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.663', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.016', 'weapon5': '0.042', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.260', 'AMMO3': '0.264', 'WEAPON3': '1.450', 'HITCOUNT': '2.790', 'weapon3': '3.480', 'DAMAGECOUNT': '13.596', 'FRAGCOUNT': '46.000'} [2023-02-25 15:01:42,086][36154] DAMAGECOUNT value on done: 1570713.0 [2023-02-25 15:01:42,087][36154] Sum rewards: 55.701, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.309', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.048', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.142', 'weapon4': '0.286', 'weapon2': '0.552', 'WEAPON3': '0.950', 'weapon3': '2.878', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.322', 'FRAGCOUNT': '44.000'} [2023-02-25 15:01:42,626][36154] DAMAGECOUNT value on done: 1602761.0 [2023-02-25 15:01:42,627][36154] Sum rewards: 54.592, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.670', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.042', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.191', 'weapon2': '0.306', 'weapon4': '0.368', 'WEAPON3': '1.250', 'weapon3': '2.958', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.214', 'FRAGCOUNT': '48.000'} [2023-02-25 15:01:42,925][36154] DAMAGECOUNT value on done: 1583720.0 [2023-02-25 15:01:42,926][36154] Sum rewards: 51.080, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.045', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.064', 'AMMO3': '0.184', 'weapon2': '0.192', 'weapon5': '0.302', 'AMMO4': '0.320', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'weapon4': '0.732', 'WEAPON3': '1.100', 'weapon3': '2.450', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.346', 'FRAGCOUNT': '46.000'} [2023-02-25 15:01:43,812][36138] Updated weights for policy 0, policy_version 58283 (0.0009) [2023-02-25 15:01:43,989][36141] DAMAGECOUNT value on done: 1589593.0 [2023-02-25 15:01:43,990][36141] Sum rewards: 51.055, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.945', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.116', 'AMMO4': '0.133', 'AMMO3': '0.186', 'weapon4': '0.198', 'WEAPON5': '0.200', 'weapon2': '0.270', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '2.890', 'weapon3': '3.038', 'DAMAGECOUNT': '13.983', 'FRAGCOUNT': '44.000'} [2023-02-25 15:01:44,296][36141] DAMAGECOUNT value on done: 1582719.0 [2023-02-25 15:01:44,296][36141] Sum rewards: 55.099, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.787', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon2': '0.144', 'AMMO3': '0.164', 'weapon5': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.512', 'WEAPON3': '1.000', 'HITCOUNT': '2.860', 'weapon3': '2.870', 'DAMAGECOUNT': '13.974', 'FRAGCOUNT': '47.000'} [2023-02-25 15:01:44,316][36141] DAMAGECOUNT value on done: 1595508.0 [2023-02-25 15:01:44,317][36141] Sum rewards: 68.370, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.228', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.140', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.364', 'weapon4': '0.432', 'WEAPON3': '1.100', 'weapon3': '2.860', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '55.000'} [2023-02-25 15:01:44,607][36141] DAMAGECOUNT value on done: 1569915.0 [2023-02-25 15:01:44,607][36141] Sum rewards: 69.509, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.940', 'AMMO5': '0.018', 'AMMO2': '0.060', 'AMMO3': '0.145', 'weapon5': '0.266', 'AMMO4': '0.301', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.500', 'weapon4': '0.578', 'WEAPON3': '0.900', 'weapon3': '2.378', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.612', 'FRAGCOUNT': '59.000'} [2023-02-25 15:01:44,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13509.9). Total num frames: 238739456. Throughput: 0: 3368.5. Samples: 22178964. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:01:44,730][36114] Avg episode reward: [(0, '58.027')] [2023-02-25 15:01:46,839][36138] Updated weights for policy 0, policy_version 58293 (0.0009) [2023-02-25 15:01:47,838][36157] DAMAGECOUNT value on done: 1604120.0 [2023-02-25 15:01:47,839][36157] Sum rewards: 56.956, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.565', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.055', 'AMMO3': '0.214', 'weapon5': '0.214', 'weapon2': '0.262', 'AMMO4': '0.275', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.536', 'WEAPON3': '1.250', 'weapon3': '2.624', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.360', 'FRAGCOUNT': '51.000'} [2023-02-25 15:01:48,155][36157] DAMAGECOUNT value on done: 1588643.0 [2023-02-25 15:01:48,156][36157] Sum rewards: 59.885, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.332', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.050', 'AMMO3': '0.121', 'weapon2': '0.196', 'AMMO4': '0.252', 'weapon5': '0.326', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.750', 'weapon4': '1.374', 'weapon3': '1.738', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '48.500'} [2023-02-25 15:01:48,557][36157] DAMAGECOUNT value on done: 1607832.0 [2023-02-25 15:01:48,557][36157] Sum rewards: 66.331, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.787', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.149', 'AMMO3': '0.163', 'weapon5': '0.206', 'weapon2': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.712', 'WEAPON3': '1.100', 'weapon3': '2.592', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '56.000'} [2023-02-25 15:01:48,870][36157] DAMAGECOUNT value on done: 1594491.0 [2023-02-25 15:01:48,870][36157] Sum rewards: 59.231, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.459', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.065', 'AMMO3': '0.143', 'AMMO4': '0.323', 'weapon5': '0.350', 'weapon2': '0.380', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'weapon4': '0.640', 'WEAPON3': '0.800', 'weapon3': '2.214', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '50.000'} [2023-02-25 15:01:49,371][36140] DAMAGECOUNT value on done: 1601538.0 [2023-02-25 15:01:49,372][36140] Sum rewards: 53.238, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.890', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon5': '0.154', 'AMMO3': '0.202', 'AMMO4': '0.211', 'weapon2': '0.258', 'WEAPON5': '0.450', 'weapon4': '0.470', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.842', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.829', 'FRAGCOUNT': '47.000'} [2023-02-25 15:01:49,517][36140] DAMAGECOUNT value on done: 1595691.0 [2023-02-25 15:01:49,518][36140] Sum rewards: 57.319, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.872', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.170', 'AMMO3': '0.247', 'weapon5': '0.262', 'weapon4': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.532', 'WEAPON3': '1.550', 'weapon3': '2.580', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '54.000'} [2023-02-25 15:01:49,716][36140] DAMAGECOUNT value on done: 1576624.0 [2023-02-25 15:01:49,716][36140] Sum rewards: 56.176, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.208', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.042', 'AMMO3': '0.182', 'AMMO4': '0.208', 'weapon2': '0.222', 'weapon5': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.794', 'WEAPON3': '1.150', 'weapon3': '2.256', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.451', 'FRAGCOUNT': '49.000'} [2023-02-25 15:01:49,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13509.9). Total num frames: 238804992. Throughput: 0: 3366.0. Samples: 22199038. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:01:49,730][36114] Avg episode reward: [(0, '58.247')] [2023-02-25 15:01:49,874][36140] DAMAGECOUNT value on done: 1590176.0 [2023-02-25 15:01:49,874][36140] Sum rewards: 60.468, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.459', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'weapon4': '0.326', 'weapon2': '0.532', 'WEAPON3': '0.900', 'weapon3': '3.030', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.348', 'FRAGCOUNT': '49.000'} [2023-02-25 15:01:49,946][36138] Updated weights for policy 0, policy_version 58303 (0.0009) [2023-02-25 15:01:52,997][36138] Updated weights for policy 0, policy_version 58313 (0.0009) [2023-02-25 15:01:53,514][36142] DAMAGECOUNT value on done: 1583739.0 [2023-02-25 15:01:53,515][36142] Sum rewards: 44.348, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.857', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.124', 'weapon5': '0.146', 'weapon2': '0.188', 'AMMO4': '0.210', 'AMMO3': '0.329', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.800', 'HITCOUNT': '2.800', 'weapon3': '3.198', 'DAMAGECOUNT': '13.908', 'FRAGCOUNT': '44.000'} [2023-02-25 15:01:53,832][36142] DAMAGECOUNT value on done: 1575693.0 [2023-02-25 15:01:53,832][36142] Sum rewards: 61.477, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.820', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.138', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.220', 'weapon2': '0.480', 'WEAPON3': '1.250', 'weapon3': '2.894', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '52.000'} [2023-02-25 15:01:54,472][36142] DAMAGECOUNT value on done: 1588193.0 [2023-02-25 15:01:54,473][36142] Sum rewards: 61.288, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.064', 'AMMO5': '0.003', 'weapon4': '0.010', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.204', 'weapon2': '0.340', 'WEAPON3': '1.150', 'HITCOUNT': '3.280', 'weapon3': '3.414', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '50.000'} [2023-02-25 15:01:54,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13448.5, 300 sec: 13509.9). Total num frames: 238870528. Throughput: 0: 3363.4. Samples: 22209070. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:01:54,730][36114] Avg episode reward: [(0, '58.020')] [2023-02-25 15:01:54,783][36142] DAMAGECOUNT value on done: 1593571.0 [2023-02-25 15:01:54,783][36142] Sum rewards: 46.631, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.245', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO3': '0.112', 'AMMO4': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.220', 'weapon2': '0.588', 'WEAPON3': '0.650', 'weapon4': '0.698', 'weapon3': '2.166', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '12.156', 'FRAGCOUNT': '36.000'} [2023-02-25 15:01:54,946][36156] DAMAGECOUNT value on done: 1605814.0 [2023-02-25 15:01:54,947][36156] Sum rewards: 48.237, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.862', 'AMMO5': '0.017', 'AMMO2': '0.046', 'AMMO4': '0.231', 'weapon2': '0.248', 'AMMO3': '0.296', 'weapon5': '0.318', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.548', 'WEAPON3': '1.650', 'weapon3': '2.486', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.118', 'FRAGCOUNT': '47.000'} [2023-02-25 15:01:55,283][36156] DAMAGECOUNT value on done: 1582575.0 [2023-02-25 15:01:55,284][36156] Sum rewards: 59.514, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.612', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.085', 'weapon2': '0.190', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon4': '0.682', 'WEAPON3': '1.200', 'weapon3': '2.822', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.781', 'FRAGCOUNT': '51.000'} [2023-02-25 15:01:55,500][36156] DAMAGECOUNT value on done: 1600695.0 [2023-02-25 15:01:55,500][36156] Sum rewards: 41.612, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.408', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon7': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'AMMO3': '0.212', 'weapon2': '0.240', 'weapon4': '0.688', 'WEAPON3': '1.250', 'HITCOUNT': '2.490', 'weapon3': '2.612', 'DAMAGECOUNT': '11.208', 'FRAGCOUNT': '37.000'} [2023-02-25 15:01:55,851][36156] DAMAGECOUNT value on done: 1588497.0 [2023-02-25 15:01:55,851][36156] Sum rewards: 70.825, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.532', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.122', 'AMMO3': '0.126', 'WEAPON5': '0.250', 'weapon5': '0.282', 'WEAPON4': '0.300', 'weapon2': '0.384', 'weapon4': '0.450', 'WEAPON3': '0.900', 'weapon3': '2.654', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '58.000'} [2023-02-25 15:01:56,221][36138] Updated weights for policy 0, policy_version 58323 (0.0010) [2023-02-25 15:01:59,386][36138] Updated weights for policy 0, policy_version 58333 (0.0010) [2023-02-25 15:01:59,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13496.0). Total num frames: 238936064. Throughput: 0: 3343.4. Samples: 22228360. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:01:59,730][36114] Avg episode reward: [(0, '57.898')] [2023-02-25 15:02:00,865][36155] DAMAGECOUNT value on done: 1584756.0 [2023-02-25 15:02:00,866][36155] Sum rewards: 53.171, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.165', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon5': '0.166', 'AMMO3': '0.180', 'weapon4': '0.350', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.652', 'WEAPON3': '1.150', 'weapon3': '2.620', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '14.133', 'FRAGCOUNT': '46.000'} [2023-02-25 15:02:00,940][36139] DAMAGECOUNT value on done: 1594654.0 [2023-02-25 15:02:00,940][36139] Sum rewards: 60.728, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.898', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.165', 'WEAPON4': '0.300', 'weapon4': '0.670', 'weapon2': '0.710', 'WEAPON3': '1.050', 'weapon3': '2.388', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '14.664', 'FRAGCOUNT': '51.000'} [2023-02-25 15:02:01,233][36155] DAMAGECOUNT value on done: 1586648.0 [2023-02-25 15:02:01,233][36155] Sum rewards: 60.140, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.177', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon5': '0.160', 'AMMO3': '0.218', 'AMMO4': '0.224', 'weapon2': '0.258', 'weapon4': '0.326', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '2.880', 'weapon3': '2.990', 'DAMAGECOUNT': '15.447', 'FRAGCOUNT': '55.000'} [2023-02-25 15:02:01,284][36139] DAMAGECOUNT value on done: 1598419.0 [2023-02-25 15:02:01,284][36139] Sum rewards: 65.262, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.170', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon4': '0.110', 'AMMO3': '0.138', 'weapon5': '0.156', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.540', 'WEAPON3': '0.900', 'weapon3': '2.952', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '53.000'} [2023-02-25 15:02:01,868][36139] DAMAGECOUNT value on done: 1604700.0 [2023-02-25 15:02:01,868][36139] Sum rewards: 65.021, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.397', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.192', 'AMMO3': '0.194', 'weapon2': '0.224', 'WEAPON3': '1.200', 'weapon3': '3.274', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '53.000'} [2023-02-25 15:02:02,017][36155] DAMAGECOUNT value on done: 1604318.0 [2023-02-25 15:02:02,017][36155] Sum rewards: 56.690, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.292', 'AMMO5': '0.004', 'ARMOR': '0.004', 'AMMO2': '0.018', 'weapon5': '0.038', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.174', 'AMMO3': '0.213', 'weapon4': '0.284', 'WEAPON3': '1.200', 'HITCOUNT': '3.100', 'weapon3': '3.360', 'DAMAGECOUNT': '14.496', 'FRAGCOUNT': '48.000'} [2023-02-25 15:02:02,192][36139] DAMAGECOUNT value on done: 1603180.0 [2023-02-25 15:02:02,193][36139] Sum rewards: 55.260, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.200', 'AMMO5': '0.003', 'ARMOR': '0.005', 'AMMO2': '0.039', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.194', 'AMMO3': '0.217', 'weapon4': '0.430', 'WEAPON4': '0.450', 'weapon2': '0.524', 'WEAPON3': '1.350', 'weapon3': '2.786', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.067', 'FRAGCOUNT': '51.000'} [2023-02-25 15:02:02,362][36155] DAMAGECOUNT value on done: 1590445.0 [2023-02-25 15:02:02,363][36155] Sum rewards: 60.417, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.079', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon4': '0.128', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.247', 'weapon2': '0.272', 'WEAPON3': '1.550', 'HITCOUNT': '3.030', 'weapon3': '3.220', 'DAMAGECOUNT': '15.483', 'FRAGCOUNT': '54.000'} [2023-02-25 15:02:02,476][36154] DAMAGECOUNT value on done: 1596404.0 [2023-02-25 15:02:02,476][36154] Sum rewards: 61.547, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.235', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'AMMO4': '0.198', 'weapon2': '0.208', 'WEAPON4': '0.450', 'weapon4': '0.726', 'WEAPON3': '0.950', 'weapon3': '2.602', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.498', 'FRAGCOUNT': '52.000'} [2023-02-25 15:02:02,745][36138] Updated weights for policy 0, policy_version 58343 (0.0010) [2023-02-25 15:02:02,809][36154] DAMAGECOUNT value on done: 1574756.0 [2023-02-25 15:02:02,810][36154] Sum rewards: 44.808, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.334', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.176', 'weapon5': '0.220', 'weapon2': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.888', 'WEAPON3': '1.000', 'weapon3': '2.418', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.129', 'FRAGCOUNT': '39.000'} [2023-02-25 15:02:03,416][36154] DAMAGECOUNT value on done: 1608085.0 [2023-02-25 15:02:03,416][36154] Sum rewards: 60.261, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.030', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.182', 'AMMO3': '0.208', 'AMMO4': '0.224', 'weapon2': '0.282', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.672', 'WEAPON3': '1.200', 'weapon3': '2.444', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.972', 'FRAGCOUNT': '52.000'} [2023-02-25 15:02:03,751][36154] DAMAGECOUNT value on done: 1588635.0 [2023-02-25 15:02:03,752][36154] Sum rewards: 56.051, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.474', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.186', 'AMMO3': '0.192', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.392', 'weapon4': '0.488', 'WEAPON3': '1.200', 'weapon3': '2.638', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.745', 'FRAGCOUNT': '49.000'} [2023-02-25 15:02:04,729][36114] Fps is (10 sec: 12697.7, 60 sec: 13312.0, 300 sec: 13468.2). Total num frames: 238997504. Throughput: 0: 3307.8. Samples: 22246970. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:02:04,729][36114] Avg episode reward: [(0, '57.493')] [2023-02-25 15:02:04,748][36141] DAMAGECOUNT value on done: 1595014.0 [2023-02-25 15:02:04,748][36141] Sum rewards: 58.822, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.304', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.172', 'AMMO3': '0.212', 'weapon5': '0.236', 'weapon4': '0.272', 'weapon2': '0.288', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.922', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '52.000'} [2023-02-25 15:02:05,062][36141] DAMAGECOUNT value on done: 1588133.0 [2023-02-25 15:02:05,063][36141] Sum rewards: 63.543, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.078', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.061', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.322', 'weapon4': '0.406', 'WEAPON3': '1.150', 'weapon3': '2.944', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.242', 'FRAGCOUNT': '53.000'} [2023-02-25 15:02:05,092][36141] DAMAGECOUNT value on done: 1600558.0 [2023-02-25 15:02:05,092][36141] Sum rewards: 60.044, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.614', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.051', 'AMMO3': '0.155', 'weapon4': '0.186', 'weapon5': '0.230', 'AMMO4': '0.253', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.666', 'WEAPON3': '0.950', 'weapon3': '2.610', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.150', 'FRAGCOUNT': '51.000'} [2023-02-25 15:02:05,423][36141] DAMAGECOUNT value on done: 1574093.0 [2023-02-25 15:02:05,424][36141] Sum rewards: 44.601, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.542', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO3': '0.168', 'AMMO4': '0.176', 'weapon2': '0.222', 'weapon5': '0.302', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.738', 'WEAPON3': '0.950', 'weapon3': '2.234', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '12.534', 'FRAGCOUNT': '38.500'} [2023-02-25 15:02:05,978][36138] Updated weights for policy 0, policy_version 58353 (0.0010) [2023-02-25 15:02:08,926][36157] DAMAGECOUNT value on done: 1609834.0 [2023-02-25 15:02:08,927][36157] Sum rewards: 60.860, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.965', 'AMMO5': '0.019', 'AMMO2': '0.041', 'AMMO3': '0.202', 'AMMO4': '0.203', 'weapon2': '0.282', 'weapon5': '0.328', 'WEAPON4': '0.400', 'weapon4': '0.422', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.616', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.142', 'FRAGCOUNT': '52.000'} [2023-02-25 15:02:09,223][36157] DAMAGECOUNT value on done: 1593476.0 [2023-02-25 15:02:09,223][36157] Sum rewards: 54.419, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.100', 'ARMOR': '0.012', 'AMMO5': '0.018', 'AMMO2': '0.034', 'weapon5': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.176', 'weapon2': '0.444', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.638', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.499', 'FRAGCOUNT': '48.000'} [2023-02-25 15:02:09,287][36138] Updated weights for policy 0, policy_version 58363 (0.0009) [2023-02-25 15:02:09,640][36157] DAMAGECOUNT value on done: 1613437.0 [2023-02-25 15:02:09,641][36157] Sum rewards: 58.912, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.700', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO4': '0.193', 'AMMO3': '0.202', 'weapon5': '0.282', 'weapon2': '0.346', 'weapon4': '0.356', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.706', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '51.000'} [2023-02-25 15:02:09,729][36114] Fps is (10 sec: 12287.9, 60 sec: 13243.7, 300 sec: 13454.3). Total num frames: 239058944. Throughput: 0: 3292.4. Samples: 22256328. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:02:09,730][36114] Avg episode reward: [(0, '57.175')] [2023-02-25 15:02:09,956][36157] DAMAGECOUNT value on done: 1599861.0 [2023-02-25 15:02:09,956][36157] Sum rewards: 64.372, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.314', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.164', 'AMMO3': '0.211', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.430', 'weapon2': '0.536', 'WEAPON3': '1.350', 'weapon3': '2.604', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '57.000'} [2023-02-25 15:02:10,274][36140] DAMAGECOUNT value on done: 1606220.0 [2023-02-25 15:02:10,275][36140] Sum rewards: 60.268, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.938', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.140', 'AMMO3': '0.183', 'AMMO4': '0.213', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.376', 'weapon4': '0.670', 'WEAPON3': '1.150', 'weapon3': '2.404', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.046', 'FRAGCOUNT': '52.000'} [2023-02-25 15:02:10,474][36140] DAMAGECOUNT value on done: 1600544.0 [2023-02-25 15:02:10,475][36140] Sum rewards: 62.580, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.585', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO4': '0.141', 'AMMO3': '0.145', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.388', 'weapon5': '0.470', 'WEAPON3': '0.900', 'weapon3': '2.610', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.559', 'FRAGCOUNT': '52.000'} [2023-02-25 15:02:10,597][36140] DAMAGECOUNT value on done: 1581477.0 [2023-02-25 15:02:10,598][36140] Sum rewards: 50.678, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.964', 'AMMO5': '0.016', 'AMMO2': '0.040', 'AMMO4': '0.202', 'weapon4': '0.210', 'weapon5': '0.228', 'AMMO3': '0.236', 'weapon2': '0.332', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.750', 'weapon3': '2.868', 'DAMAGECOUNT': '14.559', 'FRAGCOUNT': '47.000'} [2023-02-25 15:02:10,829][36140] DAMAGECOUNT value on done: 1594376.0 [2023-02-25 15:02:10,829][36140] Sum rewards: 45.777, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.976', 'AMMO5': '0.006', 'AMMO2': '0.036', 'weapon5': '0.060', 'WEAPON5': '0.150', 'AMMO4': '0.178', 'AMMO3': '0.225', 'weapon4': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.588', 'WEAPON3': '1.300', 'HITCOUNT': '2.680', 'weapon3': '2.870', 'DAMAGECOUNT': '12.600', 'FRAGCOUNT': '43.000'} [2023-02-25 15:02:12,356][36138] Updated weights for policy 0, policy_version 58373 (0.0009) [2023-02-25 15:02:14,716][36142] DAMAGECOUNT value on done: 1589027.0 [2023-02-25 15:02:14,716][36142] Sum rewards: 62.740, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.250', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.126', 'AMMO3': '0.153', 'weapon5': '0.196', 'weapon2': '0.222', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.874', 'WEAPON3': '1.000', 'weapon3': '2.380', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.864', 'FRAGCOUNT': '53.000'} [2023-02-25 15:02:14,729][36114] Fps is (10 sec: 12697.6, 60 sec: 13175.5, 300 sec: 13440.4). Total num frames: 239124480. Throughput: 0: 3277.8. Samples: 22275922. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:02:14,729][36114] Avg episode reward: [(0, '57.150')] [2023-02-25 15:02:15,033][36142] DAMAGECOUNT value on done: 1579838.0 [2023-02-25 15:02:15,033][36142] Sum rewards: 50.771, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.390', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.178', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.448', 'weapon4': '0.620', 'WEAPON3': '1.100', 'HITCOUNT': '2.500', 'weapon3': '2.554', 'DAMAGECOUNT': '12.435', 'FRAGCOUNT': '45.000'} [2023-02-25 15:02:15,499][36138] Updated weights for policy 0, policy_version 58383 (0.0009) [2023-02-25 15:02:15,632][36142] DAMAGECOUNT value on done: 1593080.0 [2023-02-25 15:02:15,633][36142] Sum rewards: 54.925, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.440', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.154', 'AMMO3': '0.187', 'weapon2': '0.672', 'WEAPON3': '1.100', 'weapon3': '2.866', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.661', 'FRAGCOUNT': '46.000'} [2023-02-25 15:02:15,948][36142] DAMAGECOUNT value on done: 1599196.0 [2023-02-25 15:02:15,948][36142] Sum rewards: 66.563, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.310', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.195', 'weapon5': '0.252', 'weapon2': '0.290', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.616', 'WEAPON3': '1.200', 'weapon3': '2.548', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '57.000'} [2023-02-25 15:02:16,189][36156] DAMAGECOUNT value on done: 1611275.0 [2023-02-25 15:02:16,190][36156] Sum rewards: 64.265, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.330', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.092', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon4': '0.280', 'weapon2': '0.326', 'WEAPON3': '1.150', 'weapon3': '3.108', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.383', 'FRAGCOUNT': '52.000'} [2023-02-25 15:02:16,517][36156] DAMAGECOUNT value on done: 1587669.0 [2023-02-25 15:02:16,517][36156] Sum rewards: 55.013, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.422', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.136', 'AMMO4': '0.163', 'weapon2': '0.182', 'AMMO3': '0.212', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.766', 'WEAPON3': '1.200', 'weapon3': '2.590', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.282', 'FRAGCOUNT': '48.000'} [2023-02-25 15:02:16,773][36156] DAMAGECOUNT value on done: 1605053.0 [2023-02-25 15:02:16,774][36156] Sum rewards: 49.509, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.428', 'AMMO5': '0.017', 'AMMO2': '0.042', 'AMMO3': '0.175', 'AMMO4': '0.212', 'weapon5': '0.242', 'weapon4': '0.350', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.576', 'WEAPON3': '1.000', 'weapon3': '2.458', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '13.074', 'FRAGCOUNT': '45.000'} [2023-02-25 15:02:17,102][36156] DAMAGECOUNT value on done: 1594126.0 [2023-02-25 15:02:17,102][36156] Sum rewards: 71.863, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.963', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO3': '0.133', 'weapon5': '0.152', 'AMMO4': '0.227', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON4': '0.400', 'weapon4': '0.642', 'WEAPON3': '0.900', 'weapon3': '2.564', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '60.000'} [2023-02-25 15:02:18,666][36138] Updated weights for policy 0, policy_version 58393 (0.0010) [2023-02-25 15:02:19,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13175.5, 300 sec: 13440.4). Total num frames: 239190016. Throughput: 0: 3260.3. Samples: 22295380. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:02:19,730][36114] Avg episode reward: [(0, '57.211')] [2023-02-25 15:02:21,878][36139] DAMAGECOUNT value on done: 1600256.0 [2023-02-25 15:02:21,878][36139] Sum rewards: 71.240, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.583', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.014', 'weapon5': '0.036', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.204', 'weapon2': '0.374', 'WEAPON3': '1.150', 'weapon3': '3.410', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '59.000'} [2023-02-25 15:02:21,879][36138] Updated weights for policy 0, policy_version 58403 (0.0009) [2023-02-25 15:02:21,940][36155] DAMAGECOUNT value on done: 1590116.0 [2023-02-25 15:02:21,940][36155] Sum rewards: 65.826, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.832', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.078', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon2': '0.208', 'weapon4': '0.468', 'WEAPON3': '1.200', 'weapon3': '3.060', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '55.000'} [2023-02-25 15:02:22,189][36139] DAMAGECOUNT value on done: 1602934.0 [2023-02-25 15:02:22,190][36139] Sum rewards: 53.009, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.222', 'ARMOR': '0.012', 'AMMO5': '0.016', 'AMMO2': '0.063', 'AMMO3': '0.142', 'AMMO4': '0.316', 'weapon2': '0.320', 'weapon5': '0.326', 'WEAPON5': '0.500', 'WEAPON4': '0.850', 'WEAPON3': '0.850', 'weapon4': '1.268', 'weapon3': '1.712', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.545', 'FRAGCOUNT': '48.000'} [2023-02-25 15:02:22,274][36155] DAMAGECOUNT value on done: 1591807.0 [2023-02-25 15:02:22,274][36155] Sum rewards: 50.804, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.830', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon5': '0.188', 'AMMO4': '0.191', 'AMMO3': '0.248', 'weapon4': '0.254', 'weapon2': '0.324', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '2.850', 'weapon3': '2.898', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '47.000'} [2023-02-25 15:02:22,656][36139] DAMAGECOUNT value on done: 1610000.0 [2023-02-25 15:02:22,656][36139] Sum rewards: 60.486, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.720', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.152', 'AMMO3': '0.200', 'weapon2': '0.254', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.486', 'WEAPON3': '1.150', 'weapon3': '2.850', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '52.000'} [2023-02-25 15:02:22,970][36139] DAMAGECOUNT value on done: 1607877.0 [2023-02-25 15:02:22,970][36139] Sum rewards: 47.222, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.346', 'AMMO5': '0.019', 'AMMO2': '0.051', 'AMMO3': '0.217', 'weapon2': '0.252', 'AMMO4': '0.257', 'weapon5': '0.402', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'weapon4': '0.998', 'WEAPON3': '1.250', 'weapon3': '1.920', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.091', 'FRAGCOUNT': '44.000'} [2023-02-25 15:02:22,999][36155] DAMAGECOUNT value on done: 1608881.0 [2023-02-25 15:02:22,999][36155] Sum rewards: 53.918, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.238', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.050', 'AMMO3': '0.137', 'weapon2': '0.242', 'AMMO4': '0.250', 'weapon5': '0.308', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.532', 'WEAPON3': '0.900', 'weapon3': '2.510', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '13.689', 'FRAGCOUNT': '46.000'} [2023-02-25 15:02:23,324][36155] DAMAGECOUNT value on done: 1595398.0 [2023-02-25 15:02:23,325][36155] Sum rewards: 60.662, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.166', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon4': '0.196', 'AMMO3': '0.203', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon5': '0.312', 'WEAPON3': '1.250', 'weapon3': '3.020', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.859', 'FRAGCOUNT': '53.000'} [2023-02-25 15:02:23,359][36154] DAMAGECOUNT value on done: 1601197.0 [2023-02-25 15:02:23,360][36154] Sum rewards: 57.828, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.174', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO3': '0.129', 'AMMO4': '0.156', 'weapon5': '0.210', 'weapon2': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '0.800', 'weapon4': '0.818', 'weapon3': '2.450', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.379', 'FRAGCOUNT': '48.000'} [2023-02-25 15:02:23,667][36154] DAMAGECOUNT value on done: 1580761.0 [2023-02-25 15:02:23,667][36154] Sum rewards: 76.775, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.398', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.141', 'AMMO3': '0.151', 'weapon2': '0.210', 'weapon5': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.618', 'WEAPON3': '0.900', 'weapon3': '2.716', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '62.000'} [2023-02-25 15:02:24,263][36154] DAMAGECOUNT value on done: 1613434.0 [2023-02-25 15:02:24,264][36154] Sum rewards: 64.212, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.065', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.030', 'AMMO4': '0.047', 'weapon5': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.176', 'AMMO3': '0.227', 'WEAPON3': '1.350', 'HITCOUNT': '3.100', 'weapon3': '3.520', 'DAMAGECOUNT': '16.047', 'FRAGCOUNT': '55.500'} [2023-02-25 15:02:24,581][36154] DAMAGECOUNT value on done: 1593234.0 [2023-02-25 15:02:24,582][36154] Sum rewards: 53.969, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.390', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon2': '0.150', 'weapon5': '0.158', 'AMMO3': '0.207', 'AMMO4': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.708', 'WEAPON3': '1.250', 'weapon3': '2.502', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '13.692', 'FRAGCOUNT': '47.000'} [2023-02-25 15:02:24,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13107.2, 300 sec: 13440.4). Total num frames: 239255552. Throughput: 0: 3245.9. Samples: 22304876. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:02:24,729][36114] Avg episode reward: [(0, '57.185')] [2023-02-25 15:02:25,018][36138] Updated weights for policy 0, policy_version 58413 (0.0009) [2023-02-25 15:02:25,661][36141] DAMAGECOUNT value on done: 1600570.0 [2023-02-25 15:02:25,661][36141] Sum rewards: 63.831, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.567', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.108', 'weapon2': '0.146', 'AMMO3': '0.188', 'weapon4': '0.556', 'WEAPON3': '1.200', 'weapon3': '2.838', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '52.000'} [2023-02-25 15:02:25,988][36141] DAMAGECOUNT value on done: 1593464.0 [2023-02-25 15:02:25,988][36141] Sum rewards: 66.460, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.707', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.194', 'weapon5': '0.210', 'WEAPON4': '0.300', 'weapon4': '0.332', 'WEAPON5': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.150', 'weapon3': '2.782', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '58.000'} [2023-02-25 15:02:26,017][36141] DAMAGECOUNT value on done: 1606057.0 [2023-02-25 15:02:26,017][36141] Sum rewards: 61.072, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.403', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'AMMO3': '0.266', 'WEAPON4': '0.300', 'weapon4': '0.336', 'weapon2': '0.420', 'WEAPON3': '1.600', 'weapon3': '2.856', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.497', 'FRAGCOUNT': '55.000'} [2023-02-25 15:02:26,330][36141] DAMAGECOUNT value on done: 1579284.0 [2023-02-25 15:02:26,331][36141] Sum rewards: 52.157, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.740', 'ARMOR': '0.008', 'AMMO5': '0.023', 'AMMO2': '0.049', 'AMMO3': '0.195', 'AMMO4': '0.246', 'weapon5': '0.268', 'weapon2': '0.436', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'weapon4': '0.664', 'WEAPON3': '1.050', 'weapon3': '2.204', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '15.573', 'FRAGCOUNT': '45.500'} [2023-02-25 15:02:28,288][36138] Updated weights for policy 0, policy_version 58423 (0.0009) [2023-02-25 15:02:29,729][36114] Fps is (10 sec: 12697.7, 60 sec: 13039.0, 300 sec: 13412.7). Total num frames: 239316992. Throughput: 0: 3221.6. Samples: 22323938. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:02:29,729][36114] Avg episode reward: [(0, '57.078')] [2023-02-25 15:02:29,896][36157] DAMAGECOUNT value on done: 1614916.0 [2023-02-25 15:02:29,897][36157] Sum rewards: 62.225, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.726', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.015', 'AMMO4': '0.072', 'AMMO3': '0.189', 'weapon2': '0.196', 'weapon5': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.474', 'WEAPON3': '1.050', 'weapon3': '2.842', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.246', 'FRAGCOUNT': '53.000'} [2023-02-25 15:02:30,208][36157] DAMAGECOUNT value on done: 1598418.0 [2023-02-25 15:02:30,208][36157] Sum rewards: 59.862, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.045', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.030', 'weapon5': '0.056', 'AMMO4': '0.085', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.410', 'WEAPON3': '1.200', 'HITCOUNT': '3.090', 'weapon3': '3.358', 'DAMAGECOUNT': '14.826', 'FRAGCOUNT': '52.000'} [2023-02-25 15:02:30,595][36157] DAMAGECOUNT value on done: 1618138.0 [2023-02-25 15:02:30,596][36157] Sum rewards: 54.692, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.094', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.078', 'weapon5': '0.106', 'AMMO3': '0.144', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.308', 'WEAPON3': '0.800', 'HITCOUNT': '2.790', 'weapon3': '3.370', 'DAMAGECOUNT': '14.103', 'FRAGCOUNT': '43.000'} [2023-02-25 15:02:30,892][36157] DAMAGECOUNT value on done: 1604572.0 [2023-02-25 15:02:30,892][36157] Sum rewards: 55.292, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.404', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.043', 'AMMO3': '0.157', 'AMMO4': '0.216', 'weapon5': '0.234', 'WEAPON5': '0.300', 'weapon2': '0.380', 'WEAPON4': '0.400', 'weapon4': '0.420', 'WEAPON3': '0.950', 'weapon3': '2.738', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '13.803', 'FRAGCOUNT': '47.000'} [2023-02-25 15:02:31,159][36140] DAMAGECOUNT value on done: 1611154.0 [2023-02-25 15:02:31,160][36140] Sum rewards: 55.150, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.903', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.122', 'AMMO4': '0.139', 'AMMO3': '0.161', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.204', 'weapon2': '0.622', 'WEAPON3': '1.050', 'weapon3': '2.836', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.802', 'FRAGCOUNT': '45.000'} [2023-02-25 15:02:31,376][36140] DAMAGECOUNT value on done: 1605188.0 [2023-02-25 15:02:31,376][36140] Sum rewards: 50.403, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.200', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.034', 'AMMO4': '0.169', 'AMMO3': '0.200', 'weapon2': '0.274', 'weapon5': '0.324', 'WEAPON5': '0.350', 'weapon4': '0.422', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.656', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.932', 'FRAGCOUNT': '44.000'} [2023-02-25 15:02:31,395][36138] Updated weights for policy 0, policy_version 58433 (0.0010) [2023-02-25 15:02:31,490][36140] DAMAGECOUNT value on done: 1587029.0 [2023-02-25 15:02:31,490][36140] Sum rewards: 66.196, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.110', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.088', 'WEAPON5': '0.200', 'weapon2': '0.218', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'weapon4': '0.456', 'WEAPON3': '1.550', 'weapon3': '2.964', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '59.000'} [2023-02-25 15:02:31,705][36140] DAMAGECOUNT value on done: 1599859.0 [2023-02-25 15:02:31,706][36140] Sum rewards: 62.136, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.980', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.046', 'weapon5': '0.168', 'AMMO3': '0.199', 'weapon2': '0.216', 'AMMO4': '0.231', 'weapon4': '0.320', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.014', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '54.000'} [2023-02-25 15:02:34,433][36138] Updated weights for policy 0, policy_version 58443 (0.0009) [2023-02-25 15:02:34,729][36114] Fps is (10 sec: 12697.7, 60 sec: 12970.7, 300 sec: 13412.7). Total num frames: 239382528. Throughput: 0: 3222.9. Samples: 22344070. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:02:34,729][36114] Avg episode reward: [(0, '57.379')] [2023-02-25 15:02:35,503][36142] DAMAGECOUNT value on done: 1594140.0 [2023-02-25 15:02:35,503][36142] Sum rewards: 61.170, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.040', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.153', 'weapon5': '0.216', 'weapon2': '0.288', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.804', 'WEAPON3': '1.000', 'weapon3': '2.260', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.339', 'FRAGCOUNT': '51.000'} [2023-02-25 15:02:35,822][36142] DAMAGECOUNT value on done: 1585168.0 [2023-02-25 15:02:35,823][36142] Sum rewards: 58.920, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.000', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO3': '0.169', 'AMMO4': '0.177', 'weapon2': '0.184', 'weapon5': '0.310', 'weapon4': '0.486', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.704', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.990', 'FRAGCOUNT': '50.000'} [2023-02-25 15:02:36,402][36142] DAMAGECOUNT value on done: 1598254.0 [2023-02-25 15:02:36,402][36142] Sum rewards: 57.368, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.260', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.188', 'AMMO3': '0.201', 'AMMO4': '0.202', 'weapon4': '0.252', 'weapon2': '0.328', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.670', 'weapon3': '2.964', 'DAMAGECOUNT': '15.522', 'FRAGCOUNT': '51.000'} [2023-02-25 15:02:36,501][36139] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 15:02:36,703][36142] DAMAGECOUNT value on done: 1604758.0 [2023-02-25 15:02:36,704][36142] Sum rewards: 60.851, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.906', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.350', 'weapon4': '0.374', 'WEAPON3': '1.350', 'weapon3': '2.818', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '52.000'} [2023-02-25 15:02:36,899][36156] DAMAGECOUNT value on done: 1615831.0 [2023-02-25 15:02:36,900][36156] Sum rewards: 47.522, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.624', 'ARMOR': '0.004', 'AMMO5': '0.036', 'AMMO2': '0.083', 'AMMO3': '0.161', 'weapon2': '0.338', 'AMMO4': '0.416', 'weapon5': '0.586', 'WEAPON3': '0.900', 'WEAPON5': '0.950', 'WEAPON4': '1.050', 'weapon3': '1.104', 'weapon4': '1.284', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.383', 'FRAGCOUNT': '45.000'} [2023-02-25 15:02:37,218][36156] DAMAGECOUNT value on done: 1593083.0 [2023-02-25 15:02:37,218][36156] Sum rewards: 64.869, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.918', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.014', 'AMMO4': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.170', 'weapon2': '0.378', 'WEAPON3': '1.050', 'HITCOUNT': '3.330', 'weapon3': '3.430', 'DAMAGECOUNT': '16.242', 'FRAGCOUNT': '53.000'} [2023-02-25 15:02:37,444][36156] DAMAGECOUNT value on done: 1610904.0 [2023-02-25 15:02:37,445][36156] Sum rewards: 64.446, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.550', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.044', 'AMMO3': '0.180', 'weapon2': '0.180', 'weapon5': '0.180', 'AMMO4': '0.219', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.870', 'WEAPON3': '1.200', 'weapon3': '2.492', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '55.000'} [2023-02-25 15:02:37,504][36138] Updated weights for policy 0, policy_version 58453 (0.0009) [2023-02-25 15:02:37,766][36156] DAMAGECOUNT value on done: 1598898.0 [2023-02-25 15:02:37,767][36156] Sum rewards: 54.667, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.168', 'ARMOR': '0.004', 'AMMO5': '0.036', 'AMMO2': '0.086', 'AMMO3': '0.148', 'weapon2': '0.350', 'weapon5': '0.384', 'AMMO4': '0.430', 'WEAPON3': '0.900', 'WEAPON5': '0.900', 'WEAPON4': '0.950', 'weapon4': '1.074', 'weapon3': '1.766', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.316', 'FRAGCOUNT': '50.000'} [2023-02-25 15:02:39,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13038.9, 300 sec: 13412.7). Total num frames: 239452160. Throughput: 0: 3222.1. Samples: 22354066. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:02:39,729][36114] Avg episode reward: [(0, '57.836')] [2023-02-25 15:02:40,557][36138] Updated weights for policy 0, policy_version 58463 (0.0010) [2023-02-25 15:02:42,156][36155] DAMAGECOUNT value on done: 1595226.0 [2023-02-25 15:02:42,157][36155] Sum rewards: 51.564, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.636', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon5': '0.122', 'AMMO4': '0.189', 'AMMO3': '0.256', 'weapon2': '0.276', 'WEAPON5': '0.350', 'weapon4': '0.518', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.758', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '49.000'} [2023-02-25 15:02:42,226][36139] DAMAGECOUNT value on done: 1606142.0 [2023-02-25 15:02:42,226][36139] Sum rewards: 66.815, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.815', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.046', 'AMMO3': '0.132', 'AMMO4': '0.228', 'weapon5': '0.298', 'WEAPON5': '0.400', 'weapon2': '0.454', 'WEAPON4': '0.500', 'weapon4': '0.766', 'WEAPON3': '0.850', 'weapon3': '2.164', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '54.000'} [2023-02-25 15:02:42,460][36155] DAMAGECOUNT value on done: 1597479.0 [2023-02-25 15:02:42,461][36155] Sum rewards: 69.371, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.832', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'AMMO3': '0.179', 'weapon2': '0.188', 'WEAPON4': '0.400', 'weapon4': '0.576', 'WEAPON3': '1.100', 'weapon3': '2.934', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '59.000'} [2023-02-25 15:02:42,529][36139] DAMAGECOUNT value on done: 1607344.0 [2023-02-25 15:02:42,530][36139] Sum rewards: 51.192, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.722', 'AMMO5': '0.004', 'ARMOR': '0.004', 'AMMO2': '0.019', 'weapon5': '0.030', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.224', 'weapon4': '0.260', 'weapon2': '0.354', 'WEAPON3': '1.350', 'HITCOUNT': '2.740', 'weapon3': '3.106', 'DAMAGECOUNT': '13.230', 'FRAGCOUNT': '45.000'} [2023-02-25 15:02:42,979][36139] DAMAGECOUNT value on done: 1615224.0 [2023-02-25 15:02:42,979][36139] Sum rewards: 60.100, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.829', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon4': '0.098', 'weapon2': '0.128', 'weapon5': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.262', 'WEAPON3': '1.550', 'HITCOUNT': '2.930', 'weapon3': '3.344', 'DAMAGECOUNT': '15.672', 'FRAGCOUNT': '54.000'} [2023-02-25 15:02:43,193][36155] DAMAGECOUNT value on done: 1613676.0 [2023-02-25 15:02:43,194][36155] Sum rewards: 58.271, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.415', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO3': '0.107', 'AMMO4': '0.161', 'weapon5': '0.202', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.652', 'weapon4': '0.696', 'WEAPON3': '0.700', 'weapon3': '2.164', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.385', 'FRAGCOUNT': '48.000'} [2023-02-25 15:02:43,266][36139] DAMAGECOUNT value on done: 1613218.0 [2023-02-25 15:02:43,267][36139] Sum rewards: 64.836, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.752', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO3': '0.162', 'AMMO4': '0.167', 'weapon5': '0.228', 'weapon4': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.516', 'WEAPON3': '1.050', 'weapon3': '2.716', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.023', 'FRAGCOUNT': '55.000'} [2023-02-25 15:02:43,496][36155] DAMAGECOUNT value on done: 1600704.0 [2023-02-25 15:02:43,497][36155] Sum rewards: 59.672, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.886', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.152', 'AMMO4': '0.166', 'weapon5': '0.224', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON3': '1.400', 'weapon3': '3.024', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.918', 'FRAGCOUNT': '53.000'} [2023-02-25 15:02:43,587][36138] Updated weights for policy 0, policy_version 58473 (0.0009) [2023-02-25 15:02:43,654][36154] DAMAGECOUNT value on done: 1607064.0 [2023-02-25 15:02:43,655][36154] Sum rewards: 66.033, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.340', 'AMMO5': '0.012', 'AMMO2': '0.042', 'AMMO3': '0.165', 'AMMO4': '0.210', 'WEAPON5': '0.300', 'weapon5': '0.344', 'WEAPON4': '0.400', 'weapon2': '0.434', 'weapon4': '0.686', 'WEAPON3': '1.100', 'weapon3': '2.238', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '55.000'} [2023-02-25 15:02:43,955][36154] DAMAGECOUNT value on done: 1585606.0 [2023-02-25 15:02:43,955][36154] Sum rewards: 57.232, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.418', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'weapon4': '0.180', 'weapon2': '0.292', 'WEAPON3': '1.100', 'HITCOUNT': '3.080', 'weapon3': '3.304', 'DAMAGECOUNT': '14.535', 'FRAGCOUNT': '47.000'} [2023-02-25 15:02:44,482][36154] DAMAGECOUNT value on done: 1619212.0 [2023-02-25 15:02:44,482][36154] Sum rewards: 61.994, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.785', 'AMMO5': '0.012', 'AMMO2': '0.063', 'weapon2': '0.182', 'AMMO3': '0.189', 'weapon5': '0.296', 'AMMO4': '0.315', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'weapon4': '0.610', 'WEAPON3': '1.100', 'weapon3': '2.598', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '53.500'} [2023-02-25 15:02:44,729][36114] Fps is (10 sec: 13516.7, 60 sec: 12970.7, 300 sec: 13412.7). Total num frames: 239517696. Throughput: 0: 3242.1. Samples: 22374256. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:02:44,730][36114] Avg episode reward: [(0, '58.456')] [2023-02-25 15:02:44,789][36154] DAMAGECOUNT value on done: 1598246.0 [2023-02-25 15:02:44,789][36154] Sum rewards: 56.280, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.685', 'AMMO5': '0.015', 'AMMO2': '0.058', 'AMMO3': '0.168', 'AMMO4': '0.291', 'weapon2': '0.298', 'weapon5': '0.324', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '0.950', 'weapon4': '1.144', 'weapon3': '1.930', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.036', 'FRAGCOUNT': '49.000'} [2023-02-25 15:02:45,508][36154] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 15:02:45,742][36141] DAMAGECOUNT value on done: 1606132.0 [2023-02-25 15:02:45,742][36141] Sum rewards: 65.480, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.076', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO3': '0.154', 'AMMO4': '0.171', 'weapon5': '0.208', 'weapon4': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.442', 'WEAPON3': '1.050', 'weapon3': '2.858', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '54.000'} [2023-02-25 15:02:46,058][36141] DAMAGECOUNT value on done: 1598763.0 [2023-02-25 15:02:46,059][36141] Sum rewards: 55.409, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.035', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon2': '0.170', 'AMMO4': '0.176', 'AMMO3': '0.192', 'weapon5': '0.266', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.688', 'WEAPON3': '1.250', 'weapon3': '2.580', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.897', 'FRAGCOUNT': '48.000'} [2023-02-25 15:02:46,068][36141] DAMAGECOUNT value on done: 1611615.0 [2023-02-25 15:02:46,069][36141] Sum rewards: 67.353, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.558', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.121', 'AMMO3': '0.145', 'weapon5': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.274', 'weapon2': '0.354', 'ARMOR': '0.404', 'WEAPON3': '0.900', 'weapon3': '2.910', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.674', 'FRAGCOUNT': '54.000'} [2023-02-25 15:02:46,370][36141] DAMAGECOUNT value on done: 1584338.0 [2023-02-25 15:02:46,371][36141] Sum rewards: 64.080, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.320', 'AMMO5': '0.020', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.183', 'weapon2': '0.248', 'weapon4': '0.294', 'WEAPON4': '0.350', 'weapon5': '0.376', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.706', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '15.162', 'FRAGCOUNT': '56.000'} [2023-02-25 15:02:46,631][36138] Updated weights for policy 0, policy_version 58483 (0.0009) [2023-02-25 15:02:49,632][36138] Updated weights for policy 0, policy_version 58493 (0.0009) [2023-02-25 15:02:49,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13038.9, 300 sec: 13412.7). Total num frames: 239587328. Throughput: 0: 3280.8. Samples: 22394608. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:02:49,730][36114] Avg episode reward: [(0, '58.784')] [2023-02-25 15:02:49,752][36157] DAMAGECOUNT value on done: 1619389.0 [2023-02-25 15:02:49,752][36157] Sum rewards: 52.046, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.260', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.096', 'AMMO4': '0.111', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon4': '0.356', 'weapon2': '0.358', 'WEAPON3': '1.150', 'HITCOUNT': '2.650', 'weapon3': '2.986', 'DAMAGECOUNT': '13.419', 'FRAGCOUNT': '45.000'} [2023-02-25 15:02:50,051][36157] DAMAGECOUNT value on done: 1603940.0 [2023-02-25 15:02:50,051][36157] Sum rewards: 61.979, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.636', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO4': '0.169', 'AMMO3': '0.229', 'weapon5': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.350', 'weapon4': '0.460', 'WEAPON3': '1.450', 'weapon3': '2.498', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '56.000'} [2023-02-25 15:02:50,556][36157] DAMAGECOUNT value on done: 1623644.0 [2023-02-25 15:02:50,556][36157] Sum rewards: 63.735, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.142', 'AMMO5': '0.016', 'AMMO2': '0.042', 'AMMO3': '0.185', 'AMMO4': '0.210', 'weapon5': '0.214', 'weapon2': '0.352', 'weapon4': '0.376', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.764', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '54.000'} [2023-02-25 15:02:50,851][36157] DAMAGECOUNT value on done: 1609821.0 [2023-02-25 15:02:50,851][36157] Sum rewards: 55.661, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.322', 'AMMO5': '0.014', 'AMMO2': '0.056', 'AMMO3': '0.206', 'weapon5': '0.248', 'AMMO4': '0.281', 'WEAPON5': '0.400', 'weapon2': '0.420', 'weapon4': '0.518', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.382', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '51.000'} [2023-02-25 15:02:51,029][36140] DAMAGECOUNT value on done: 1615565.0 [2023-02-25 15:02:51,030][36140] Sum rewards: 51.629, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.408', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.138', 'AMMO4': '0.142', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.376', 'weapon4': '0.482', 'WEAPON3': '1.100', 'weapon3': '2.762', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.233', 'FRAGCOUNT': '44.000'} [2023-02-25 15:02:51,242][36140] DAMAGECOUNT value on done: 1609716.0 [2023-02-25 15:02:51,242][36140] Sum rewards: 50.812, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.868', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon5': '0.074', 'AMMO4': '0.096', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.312', 'weapon4': '0.470', 'WEAPON3': '1.100', 'HITCOUNT': '2.860', 'weapon3': '2.962', 'DAMAGECOUNT': '13.584', 'FRAGCOUNT': '44.000'} [2023-02-25 15:02:51,344][36140] DAMAGECOUNT value on done: 1591993.0 [2023-02-25 15:02:51,345][36140] Sum rewards: 66.045, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.578', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.250', 'weapon2': '0.252', 'WEAPON3': '1.500', 'HITCOUNT': '3.140', 'weapon3': '3.578', 'DAMAGECOUNT': '14.892', 'FRAGCOUNT': '59.000'} [2023-02-25 15:02:51,559][36140] DAMAGECOUNT value on done: 1604654.0 [2023-02-25 15:02:51,559][36140] Sum rewards: 54.246, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.245', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.050', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.218', 'weapon2': '0.340', 'weapon4': '0.524', 'WEAPON3': '1.350', 'HITCOUNT': '2.870', 'weapon3': '2.914', 'DAMAGECOUNT': '14.385', 'FRAGCOUNT': '47.000'} [2023-02-25 15:02:52,660][36138] Updated weights for policy 0, policy_version 58503 (0.0009) [2023-02-25 15:02:54,729][36114] Fps is (10 sec: 13516.5, 60 sec: 13038.9, 300 sec: 13398.8). Total num frames: 239652864. Throughput: 0: 3299.1. Samples: 22404790. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:02:54,730][36114] Avg episode reward: [(0, '58.481')] [2023-02-25 15:02:55,470][36142] DAMAGECOUNT value on done: 1599335.0 [2023-02-25 15:02:55,471][36142] Sum rewards: 71.962, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'weapon5': '0.012', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.122', 'HEALTH': '0.351', 'weapon2': '0.396', 'WEAPON3': '0.800', 'HITCOUNT': '3.140', 'weapon3': '3.472', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '57.000'} [2023-02-25 15:02:55,696][36138] Updated weights for policy 0, policy_version 58513 (0.0009) [2023-02-25 15:02:55,782][36142] DAMAGECOUNT value on done: 1590582.0 [2023-02-25 15:02:55,782][36142] Sum rewards: 66.984, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.709', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon2': '0.118', 'weapon5': '0.142', 'AMMO3': '0.165', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.634', 'WEAPON3': '1.000', 'weapon3': '2.690', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.242', 'FRAGCOUNT': '55.000'} [2023-02-25 15:02:56,383][36142] DAMAGECOUNT value on done: 1603001.0 [2023-02-25 15:02:56,384][36142] Sum rewards: 52.446, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.820', 'AMMO5': '0.009', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon5': '0.174', 'weapon4': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.400', 'HITCOUNT': '2.970', 'weapon3': '3.024', 'DAMAGECOUNT': '14.241', 'FRAGCOUNT': '47.000'} [2023-02-25 15:02:56,694][36142] DAMAGECOUNT value on done: 1609448.0 [2023-02-25 15:02:56,694][36142] Sum rewards: 56.186, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.739', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.028', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'AMMO3': '0.203', 'WEAPON4': '0.350', 'weapon2': '0.396', 'weapon4': '0.798', 'WEAPON3': '1.100', 'weapon3': '2.388', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.070', 'FRAGCOUNT': '49.000'} [2023-02-25 15:02:56,864][36156] DAMAGECOUNT value on done: 1620737.0 [2023-02-25 15:02:56,864][36156] Sum rewards: 59.061, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.012', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.050', 'AMMO4': '0.118', 'weapon5': '0.128', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.476', 'WEAPON3': '1.250', 'weapon3': '3.074', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.718', 'FRAGCOUNT': '51.000'} [2023-02-25 15:02:57,200][36156] DAMAGECOUNT value on done: 1598243.0 [2023-02-25 15:02:57,200][36156] Sum rewards: 53.341, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.944', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.168', 'AMMO3': '0.208', 'weapon5': '0.222', 'weapon2': '0.260', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.602', 'WEAPON3': '1.300', 'weapon3': '2.604', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.480', 'FRAGCOUNT': '47.000'} [2023-02-25 15:02:57,428][36156] DAMAGECOUNT value on done: 1614964.0 [2023-02-25 15:02:57,428][36156] Sum rewards: 42.802, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.166', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.056', 'AMMO3': '0.151', 'weapon5': '0.214', 'weapon2': '0.238', 'AMMO4': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.750', 'WEAPON3': '0.950', 'weapon4': '1.264', 'weapon3': '1.930', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.180', 'FRAGCOUNT': '39.000'} [2023-02-25 15:02:57,737][36156] DAMAGECOUNT value on done: 1604413.0 [2023-02-25 15:02:57,738][36156] Sum rewards: 64.468, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.042', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon5': '0.162', 'weapon4': '0.180', 'AMMO4': '0.196', 'AMMO3': '0.249', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.598', 'WEAPON3': '1.500', 'weapon3': '2.704', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '59.000'} [2023-02-25 15:02:58,771][36138] Updated weights for policy 0, policy_version 58523 (0.0009) [2023-02-25 15:02:59,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13107.2, 300 sec: 13412.7). Total num frames: 239722496. Throughput: 0: 3309.2. Samples: 22424838. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:02:59,730][36114] Avg episode reward: [(0, '58.744')] [2023-02-25 15:03:01,765][36138] Updated weights for policy 0, policy_version 58533 (0.0009) [2023-02-25 15:03:02,014][36155] DAMAGECOUNT value on done: 1600352.0 [2023-02-25 15:03:02,015][36155] Sum rewards: 60.684, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.248', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.092', 'AMMO4': '0.100', 'weapon4': '0.154', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.656', 'WEAPON3': '1.150', 'weapon3': '2.888', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.378', 'FRAGCOUNT': '53.000'} [2023-02-25 15:03:02,107][36139] DAMAGECOUNT value on done: 1611509.0 [2023-02-25 15:03:02,108][36139] Sum rewards: 64.555, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.759', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon4': '0.178', 'weapon2': '0.182', 'AMMO3': '0.192', 'weapon5': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.970', 'weapon3': '3.040', 'DAMAGECOUNT': '16.101', 'FRAGCOUNT': '55.000'} [2023-02-25 15:03:02,336][36155] DAMAGECOUNT value on done: 1603256.0 [2023-02-25 15:03:02,337][36155] Sum rewards: 66.288, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.220', 'AMMO5': '0.006', 'weapon4': '0.028', 'AMMO2': '0.055', 'weapon5': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.214', 'AMMO3': '0.221', 'AMMO4': '0.273', 'WEAPON3': '1.550', 'HITCOUNT': '3.370', 'weapon3': '3.462', 'DAMAGECOUNT': '17.331', 'FRAGCOUNT': '57.000'} [2023-02-25 15:03:02,414][36139] DAMAGECOUNT value on done: 1612882.0 [2023-02-25 15:03:02,415][36139] Sum rewards: 72.458, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.082', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'AMMO3': '0.160', 'weapon4': '0.246', 'weapon2': '0.564', 'WEAPON3': '1.050', 'weapon3': '2.990', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '60.000'} [2023-02-25 15:03:02,817][36139] DAMAGECOUNT value on done: 1620262.0 [2023-02-25 15:03:02,817][36139] Sum rewards: 54.128, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.980', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.142', 'weapon2': '0.146', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.287', 'weapon4': '0.440', 'WEAPON3': '1.650', 'HITCOUNT': '2.980', 'weapon3': '3.010', 'DAMAGECOUNT': '15.114', 'FRAGCOUNT': '50.000'} [2023-02-25 15:03:03,098][36155] DAMAGECOUNT value on done: 1618273.0 [2023-02-25 15:03:03,099][36155] Sum rewards: 52.621, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.945', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO3': '0.196', 'weapon2': '0.794', 'WEAPON3': '1.200', 'weapon3': '2.756', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.791', 'FRAGCOUNT': '45.000'} [2023-02-25 15:03:03,115][36139] DAMAGECOUNT value on done: 1619597.0 [2023-02-25 15:03:03,115][36139] Sum rewards: 82.578, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.574', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.052', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'weapon2': '0.194', 'AMMO3': '0.230', 'ARMOR': '0.400', 'weapon4': '0.484', 'WEAPON3': '1.350', 'weapon3': '3.018', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '19.137', 'FRAGCOUNT': '69.000'} [2023-02-25 15:03:03,395][36155] DAMAGECOUNT value on done: 1605350.0 [2023-02-25 15:03:03,396][36155] Sum rewards: 57.623, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.010', 'AMMO2': '0.040', 'AMMO3': '0.163', 'weapon5': '0.196', 'AMMO4': '0.202', 'WEAPON5': '0.250', 'HEALTH': '0.270', 'weapon2': '0.318', 'WEAPON4': '0.350', 'weapon4': '0.798', 'WEAPON3': '0.900', 'weapon3': '2.208', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.938', 'FRAGCOUNT': '49.000'} [2023-02-25 15:03:03,518][36154] DAMAGECOUNT value on done: 1613261.0 [2023-02-25 15:03:03,519][36154] Sum rewards: 71.391, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.069', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.140', 'AMMO3': '0.180', 'AMMO4': '0.227', 'weapon2': '0.286', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.436', 'WEAPON3': '1.150', 'weapon3': '2.902', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.591', 'FRAGCOUNT': '59.000'} [2023-02-25 15:03:03,831][36154] DAMAGECOUNT value on done: 1590421.0 [2023-02-25 15:03:03,832][36154] Sum rewards: 58.888, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.515', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon2': '0.140', 'weapon5': '0.164', 'AMMO3': '0.188', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.574', 'WEAPON3': '1.050', 'weapon3': '2.720', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.445', 'FRAGCOUNT': '50.000'} [2023-02-25 15:03:04,328][36154] DAMAGECOUNT value on done: 1624055.0 [2023-02-25 15:03:04,329][36154] Sum rewards: 58.643, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.935', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'weapon4': '0.162', 'AMMO3': '0.199', 'weapon2': '0.362', 'WEAPON3': '1.150', 'HITCOUNT': '3.010', 'weapon3': '3.198', 'DAMAGECOUNT': '14.529', 'FRAGCOUNT': '50.000'} [2023-02-25 15:03:04,639][36154] DAMAGECOUNT value on done: 1602646.0 [2023-02-25 15:03:04,639][36154] Sum rewards: 47.664, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.988', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.054', 'weapon5': '0.072', 'AMMO4': '0.111', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'weapon2': '0.344', 'WEAPON3': '1.550', 'HITCOUNT': '2.810', 'weapon3': '3.226', 'DAMAGECOUNT': '13.200', 'FRAGCOUNT': '45.000'} [2023-02-25 15:03:04,729][36114] Fps is (10 sec: 13517.1, 60 sec: 13175.5, 300 sec: 13398.8). Total num frames: 239788032. Throughput: 0: 3328.3. Samples: 22445154. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:03:04,730][36114] Avg episode reward: [(0, '59.250')] [2023-02-25 15:03:04,829][36138] Updated weights for policy 0, policy_version 58543 (0.0009) [2023-02-25 15:03:05,670][36141] DAMAGECOUNT value on done: 1612222.0 [2023-02-25 15:03:05,671][36141] Sum rewards: 75.572, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.550', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.016', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO3': '0.224', 'weapon2': '0.294', 'weapon4': '0.364', 'WEAPON3': '1.300', 'weapon3': '3.086', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '63.000'} [2023-02-25 15:03:05,966][36141] DAMAGECOUNT value on done: 1604561.0 [2023-02-25 15:03:05,967][36141] Sum rewards: 68.406, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.130', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.124', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.254', 'weapon4': '0.446', 'WEAPON3': '1.150', 'weapon3': '2.948', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '56.500'} [2023-02-25 15:03:05,978][36141] DAMAGECOUNT value on done: 1617622.0 [2023-02-25 15:03:05,979][36141] Sum rewards: 66.677, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.524', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.027', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.223', 'weapon4': '0.228', 'WEAPON4': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.350', 'weapon3': '3.010', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.991', 'FRAGCOUNT': '56.000'} [2023-02-25 15:03:06,281][36141] DAMAGECOUNT value on done: 1590174.0 [2023-02-25 15:03:06,281][36141] Sum rewards: 70.510, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.827', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'weapon4': '0.180', 'AMMO3': '0.191', 'weapon2': '0.374', 'WEAPON3': '1.250', 'weapon3': '3.196', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.508', 'FRAGCOUNT': '58.500'} [2023-02-25 15:03:07,836][36138] Updated weights for policy 0, policy_version 58553 (0.0009) [2023-02-25 15:03:09,599][36157] DAMAGECOUNT value on done: 1624459.0 [2023-02-25 15:03:09,599][36157] Sum rewards: 53.708, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.882', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.168', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.550', 'weapon2': '0.562', 'WEAPON3': '1.100', 'weapon3': '2.486', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '45.000'} [2023-02-25 15:03:09,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13312.0, 300 sec: 13412.7). Total num frames: 239857664. Throughput: 0: 3344.5. Samples: 22455380. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:03:09,730][36114] Avg episode reward: [(0, '59.784')] [2023-02-25 15:03:09,918][36157] DAMAGECOUNT value on done: 1609010.0 [2023-02-25 15:03:09,919][36157] Sum rewards: 56.403, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.370', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO3': '0.159', 'AMMO4': '0.161', 'WEAPON5': '0.250', 'weapon5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.510', 'weapon4': '0.516', 'WEAPON3': '1.000', 'weapon3': '2.464', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '48.000'} [2023-02-25 15:03:10,459][36157] DAMAGECOUNT value on done: 1628381.0 [2023-02-25 15:03:10,459][36157] Sum rewards: 53.465, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.400', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.047', 'weapon5': '0.170', 'weapon4': '0.182', 'AMMO4': '0.234', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.850', 'weapon3': '3.042', 'DAMAGECOUNT': '14.211', 'FRAGCOUNT': '49.000'} [2023-02-25 15:03:10,775][36157] DAMAGECOUNT value on done: 1615186.0 [2023-02-25 15:03:10,776][36157] Sum rewards: 62.122, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.740', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'AMMO4': '0.164', 'AMMO3': '0.208', 'weapon5': '0.252', 'weapon4': '0.330', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.476', 'WEAPON3': '1.250', 'weapon3': '2.630', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.528', 'FRAGCOUNT': '55.000'} [2023-02-25 15:03:10,870][36138] Updated weights for policy 0, policy_version 58563 (0.0009) [2023-02-25 15:03:10,908][36140] DAMAGECOUNT value on done: 1620869.0 [2023-02-25 15:03:10,908][36140] Sum rewards: 64.583, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.031', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.037', 'AMMO4': '0.183', 'AMMO3': '0.209', 'weapon5': '0.236', 'weapon2': '0.254', 'weapon4': '0.342', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.852', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.912', 'FRAGCOUNT': '58.000'} [2023-02-25 15:03:11,123][36140] DAMAGECOUNT value on done: 1614239.0 [2023-02-25 15:03:11,123][36140] Sum rewards: 49.802, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.494', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.168', 'AMMO4': '0.171', 'AMMO3': '0.180', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.450', 'weapon4': '0.606', 'WEAPON3': '1.000', 'weapon3': '2.534', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.569', 'FRAGCOUNT': '42.500'} [2023-02-25 15:03:11,244][36140] DAMAGECOUNT value on done: 1597748.0 [2023-02-25 15:03:11,244][36140] Sum rewards: 73.033, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.876', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.020', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.158', 'AMMO3': '0.211', 'weapon2': '0.340', 'WEAPON3': '1.300', 'weapon3': '3.322', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '61.000'} [2023-02-25 15:03:11,451][36140] DAMAGECOUNT value on done: 1610090.0 [2023-02-25 15:03:11,451][36140] Sum rewards: 72.943, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.420', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'weapon4': '0.130', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.324', 'WEAPON3': '1.050', 'weapon3': '3.306', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '61.000'} [2023-02-25 15:03:11,520][36142] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 15:03:13,467][36141] Large shaping reward 2.565 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.543, 181.0), ('weapon5', 0.002)] [2023-02-25 15:03:13,862][36138] Updated weights for policy 0, policy_version 58573 (0.0010) [2023-02-25 15:03:14,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13312.0, 300 sec: 13398.8). Total num frames: 239923200. Throughput: 0: 3374.0. Samples: 22475768. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:03:14,730][36114] Avg episode reward: [(0, '60.040')] [2023-02-25 15:03:15,095][36156] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 15:03:15,365][36142] DAMAGECOUNT value on done: 1604602.0 [2023-02-25 15:03:15,365][36142] Sum rewards: 67.792, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.016', 'AMMO5': '0.014', 'AMMO2': '0.043', 'AMMO3': '0.184', 'AMMO4': '0.215', 'weapon5': '0.232', 'weapon2': '0.268', 'weapon4': '0.404', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.786', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '59.000'} [2023-02-25 15:03:15,679][36142] DAMAGECOUNT value on done: 1596459.0 [2023-02-25 15:03:15,680][36142] Sum rewards: 64.654, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.332', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.047', 'AMMO3': '0.159', 'AMMO4': '0.237', 'weapon5': '0.266', 'weapon4': '0.390', 'weapon2': '0.416', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.566', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '55.000'} [2023-02-25 15:03:16,290][36142] DAMAGECOUNT value on done: 1607567.0 [2023-02-25 15:03:16,290][36142] Sum rewards: 54.062, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.938', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.207', 'weapon4': '0.266', 'weapon2': '0.398', 'WEAPON3': '1.300', 'HITCOUNT': '2.930', 'weapon3': '3.030', 'DAMAGECOUNT': '13.698', 'FRAGCOUNT': '46.000'} [2023-02-25 15:03:16,601][36142] DAMAGECOUNT value on done: 1615043.0 [2023-02-25 15:03:16,601][36142] Sum rewards: 70.371, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.750', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.064', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon4': '0.238', 'weapon2': '0.358', 'WEAPON3': '1.200', 'weapon3': '3.156', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '59.000'} [2023-02-25 15:03:16,801][36156] DAMAGECOUNT value on done: 1625452.0 [2023-02-25 15:03:16,801][36156] Sum rewards: 51.446, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.824', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.024', 'AMMO4': '0.122', 'AMMO3': '0.190', 'weapon5': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.252', 'WEAPON5': '0.300', 'weapon4': '0.476', 'WEAPON3': '1.100', 'HITCOUNT': '2.670', 'weapon3': '2.830', 'DAMAGECOUNT': '14.145', 'FRAGCOUNT': '44.000'} [2023-02-25 15:03:16,909][36138] Updated weights for policy 0, policy_version 58583 (0.0010) [2023-02-25 15:03:17,103][36156] DAMAGECOUNT value on done: 1603842.0 [2023-02-25 15:03:17,103][36156] Sum rewards: 64.605, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.110', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.098', 'AMMO4': '0.162', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON4': '0.300', 'weapon4': '0.346', 'WEAPON3': '1.300', 'weapon3': '3.048', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.797', 'FRAGCOUNT': '56.000'} [2023-02-25 15:03:17,339][36156] DAMAGECOUNT value on done: 1619919.0 [2023-02-25 15:03:17,339][36156] Sum rewards: 55.414, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.896', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.128', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'weapon2': '0.164', 'WEAPON4': '0.250', 'AMMO3': '0.257', 'weapon4': '0.268', 'WEAPON3': '1.500', 'HITCOUNT': '3.100', 'weapon3': '3.204', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '49.000'} [2023-02-25 15:03:17,643][36156] DAMAGECOUNT value on done: 1609588.0 [2023-02-25 15:03:17,643][36156] Sum rewards: 52.151, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.185', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon2': '0.180', 'AMMO3': '0.190', 'AMMO4': '0.227', 'weapon5': '0.386', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'weapon4': '0.834', 'WEAPON3': '1.200', 'weapon3': '2.106', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.525', 'FRAGCOUNT': '47.000'} [2023-02-25 15:03:19,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13412.7). Total num frames: 239992832. Throughput: 0: 3376.2. Samples: 22496000. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:03:19,729][36114] Avg episode reward: [(0, '60.302')] [2023-02-25 15:03:19,733][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000058592_239992832.pth... [2023-02-25 15:03:19,789][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000057808_236781568.pth [2023-02-25 15:03:19,956][36138] Updated weights for policy 0, policy_version 58593 (0.0009) [2023-02-25 15:03:20,038][36142] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 15:03:21,841][36155] DAMAGECOUNT value on done: 1605828.0 [2023-02-25 15:03:21,842][36155] Sum rewards: 55.819, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.092', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.046', 'AMMO3': '0.210', 'weapon2': '0.214', 'AMMO4': '0.231', 'weapon5': '0.388', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon4': '0.738', 'WEAPON3': '1.200', 'weapon3': '2.218', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '16.428', 'FRAGCOUNT': '50.000'} [2023-02-25 15:03:21,852][36139] DAMAGECOUNT value on done: 1616763.0 [2023-02-25 15:03:21,852][36139] Sum rewards: 56.646, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.470', 'AMMO5': '0.022', 'AMMO2': '0.065', 'AMMO3': '0.201', 'weapon2': '0.244', 'weapon5': '0.322', 'AMMO4': '0.323', 'WEAPON5': '0.550', 'WEAPON4': '0.700', 'weapon4': '0.738', 'WEAPON3': '1.100', 'weapon3': '2.308', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.762', 'FRAGCOUNT': '51.500'} [2023-02-25 15:03:22,162][36155] DAMAGECOUNT value on done: 1608348.0 [2023-02-25 15:03:22,163][36155] Sum rewards: 60.645, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.500', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.184', 'weapon4': '0.208', 'weapon2': '0.302', 'WEAPON3': '1.250', 'HITCOUNT': '3.140', 'weapon3': '3.338', 'DAMAGECOUNT': '15.276', 'FRAGCOUNT': '51.000'} [2023-02-25 15:03:22,166][36139] DAMAGECOUNT value on done: 1617855.0 [2023-02-25 15:03:22,166][36139] Sum rewards: 64.227, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.680', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.072', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO3': '0.137', 'WEAPON5': '0.150', 'weapon2': '0.616', 'WEAPON3': '0.850', 'weapon3': '3.064', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '52.000'} [2023-02-25 15:03:22,629][36139] DAMAGECOUNT value on done: 1625470.0 [2023-02-25 15:03:22,630][36139] Sum rewards: 60.904, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.296', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO3': '0.155', 'AMMO4': '0.160', 'weapon2': '0.244', 'weapon5': '0.324', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.750', 'WEAPON3': '0.900', 'weapon3': '2.358', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.624', 'FRAGCOUNT': '51.000'} [2023-02-25 15:03:22,934][36139] DAMAGECOUNT value on done: 1625234.0 [2023-02-25 15:03:22,935][36139] Sum rewards: 61.411, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.858', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.094', 'AMMO4': '0.095', 'weapon2': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.228', 'AMMO3': '0.236', 'WEAPON3': '1.400', 'weapon3': '3.252', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '53.000'} [2023-02-25 15:03:23,014][36138] Updated weights for policy 0, policy_version 58603 (0.0009) [2023-02-25 15:03:23,016][36155] DAMAGECOUNT value on done: 1623545.0 [2023-02-25 15:03:23,016][36155] Sum rewards: 60.784, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.916', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.094', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'weapon2': '0.226', 'weapon4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.090', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.816', 'FRAGCOUNT': '53.000'} [2023-02-25 15:03:23,338][36155] DAMAGECOUNT value on done: 1610690.0 [2023-02-25 15:03:23,338][36155] Sum rewards: 61.974, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.182', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon2': '0.182', 'AMMO4': '0.189', 'weapon5': '0.236', 'AMMO3': '0.239', 'weapon4': '0.244', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '3.000', 'weapon3': '3.038', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '57.000'} [2023-02-25 15:03:23,392][36154] DAMAGECOUNT value on done: 1618932.0 [2023-02-25 15:03:23,392][36154] Sum rewards: 63.669, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.423', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.040', 'AMMO3': '0.134', 'AMMO4': '0.200', 'weapon2': '0.246', 'weapon5': '0.356', 'weapon4': '0.410', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.900', 'weapon3': '2.722', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '51.000'} [2023-02-25 15:03:23,692][36154] DAMAGECOUNT value on done: 1596112.0 [2023-02-25 15:03:23,692][36154] Sum rewards: 69.891, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.057', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO3': '0.214', 'weapon2': '0.230', 'WEAPON3': '1.400', 'weapon3': '3.376', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.073', 'FRAGCOUNT': '60.000'} [2023-02-25 15:03:24,148][36154] DAMAGECOUNT value on done: 1629363.0 [2023-02-25 15:03:24,149][36154] Sum rewards: 63.026, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.375', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.084', 'AMMO4': '0.152', 'weapon2': '0.160', 'AMMO3': '0.187', 'WEAPON5': '0.250', 'weapon4': '0.270', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.260', 'weapon3': '3.300', 'DAMAGECOUNT': '15.444', 'FRAGCOUNT': '55.000'} [2023-02-25 15:03:24,466][36154] DAMAGECOUNT value on done: 1608304.0 [2023-02-25 15:03:24,467][36154] Sum rewards: 68.150, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.407', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.109', 'weapon5': '0.138', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.320', 'WEAPON3': '0.750', 'weapon2': '0.794', 'weapon3': '2.594', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.974', 'FRAGCOUNT': '53.000'} [2023-02-25 15:03:24,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 240058368. Throughput: 0: 3377.0. Samples: 22506032. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:03:24,730][36114] Avg episode reward: [(0, '60.736')] [2023-02-25 15:03:25,524][36141] DAMAGECOUNT value on done: 1617849.0 [2023-02-25 15:03:25,524][36141] Sum rewards: 73.453, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.065', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO3': '0.241', 'weapon2': '0.338', 'WEAPON3': '1.550', 'weapon3': '3.508', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '64.000'} [2023-02-25 15:03:25,821][36141] DAMAGECOUNT value on done: 1609512.0 [2023-02-25 15:03:25,821][36141] Sum rewards: 59.041, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.586', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.077', 'AMMO3': '0.174', 'weapon5': '0.230', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.944', 'WEAPON3': '1.050', 'weapon3': '2.274', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.853', 'FRAGCOUNT': '49.000'} [2023-02-25 15:03:25,843][36141] DAMAGECOUNT value on done: 1622622.0 [2023-02-25 15:03:25,844][36141] Sum rewards: 49.262, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.502', 'AMMO5': '0.018', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.209', 'weapon5': '0.226', 'WEAPON4': '0.300', 'weapon2': '0.382', 'weapon4': '0.402', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.682', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '14.700', 'FRAGCOUNT': '42.500'} [2023-02-25 15:03:26,072][36138] Updated weights for policy 0, policy_version 58613 (0.0009) [2023-02-25 15:03:26,151][36141] DAMAGECOUNT value on done: 1595554.0 [2023-02-25 15:03:26,151][36141] Sum rewards: 59.389, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.510', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.084', 'AMMO4': '0.126', 'weapon5': '0.134', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.342', 'WEAPON3': '1.050', 'HITCOUNT': '3.090', 'weapon3': '3.220', 'DAMAGECOUNT': '16.140', 'FRAGCOUNT': '48.500'} [2023-02-25 15:03:27,585][36139] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 15:03:29,075][36138] Updated weights for policy 0, policy_version 58623 (0.0009) [2023-02-25 15:03:29,566][36157] DAMAGECOUNT value on done: 1630401.0 [2023-02-25 15:03:29,567][36157] Sum rewards: 70.113, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.187', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.104', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon2': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.436', 'WEAPON3': '1.350', 'weapon3': '2.930', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '60.000'} [2023-02-25 15:03:29,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13398.8). Total num frames: 240128000. Throughput: 0: 3376.2. Samples: 22526184. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:03:29,730][36114] Avg episode reward: [(0, '60.682')] [2023-02-25 15:03:29,883][36157] DAMAGECOUNT value on done: 1614618.0 [2023-02-25 15:03:29,883][36157] Sum rewards: 65.782, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.095', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.040', 'AMMO3': '0.171', 'AMMO4': '0.198', 'weapon2': '0.258', 'weapon5': '0.300', 'weapon4': '0.344', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.800', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '56.000'} [2023-02-25 15:03:30,481][36157] DAMAGECOUNT value on done: 1632814.0 [2023-02-25 15:03:30,482][36157] Sum rewards: 49.343, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.998', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'weapon4': '0.078', 'WEAPON4': '0.150', 'weapon2': '0.250', 'AMMO3': '0.286', 'WEAPON3': '1.750', 'HITCOUNT': '2.730', 'weapon3': '3.356', 'DAMAGECOUNT': '13.299', 'FRAGCOUNT': '47.000'} [2023-02-25 15:03:30,781][36157] DAMAGECOUNT value on done: 1619112.0 [2023-02-25 15:03:30,781][36157] Sum rewards: 44.037, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.312', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.157', 'weapon5': '0.200', 'weapon2': '0.212', 'AMMO3': '0.217', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.790', 'WEAPON3': '1.200', 'weapon3': '2.510', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '11.778', 'FRAGCOUNT': '40.000'} [2023-02-25 15:03:30,820][36140] DAMAGECOUNT value on done: 1625794.0 [2023-02-25 15:03:30,820][36140] Sum rewards: 60.048, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.410', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.074', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.166', 'weapon5': '0.168', 'AMMO3': '0.227', 'WEAPON3': '1.400', 'HITCOUNT': '3.070', 'weapon3': '3.378', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '53.000'} [2023-02-25 15:03:31,022][36140] DAMAGECOUNT value on done: 1619680.0 [2023-02-25 15:03:31,023][36140] Sum rewards: 65.044, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.681', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO3': '0.152', 'AMMO4': '0.158', 'weapon5': '0.272', 'WEAPON4': '0.300', 'weapon2': '0.362', 'WEAPON5': '0.400', 'weapon4': '0.418', 'WEAPON3': '0.850', 'weapon3': '2.674', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.323', 'FRAGCOUNT': '54.000'} [2023-02-25 15:03:31,131][36140] DAMAGECOUNT value on done: 1602767.0 [2023-02-25 15:03:31,131][36140] Sum rewards: 59.350, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.271', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.203', 'weapon2': '0.206', 'weapon4': '0.276', 'WEAPON3': '1.200', 'HITCOUNT': '2.960', 'weapon3': '3.282', 'DAMAGECOUNT': '15.057', 'FRAGCOUNT': '50.000'} [2023-02-25 15:03:31,346][36140] DAMAGECOUNT value on done: 1615317.0 [2023-02-25 15:03:31,346][36140] Sum rewards: 54.668, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.945', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.036', 'weapon4': '0.090', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.186', 'AMMO3': '0.237', 'WEAPON3': '1.400', 'HITCOUNT': '3.110', 'weapon3': '3.428', 'DAMAGECOUNT': '15.681', 'FRAGCOUNT': '47.000'} [2023-02-25 15:03:32,150][36138] Updated weights for policy 0, policy_version 58633 (0.0009) [2023-02-25 15:03:34,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13398.8). Total num frames: 240193536. Throughput: 0: 3374.9. Samples: 22546478. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:03:34,729][36114] Avg episode reward: [(0, '60.547')] [2023-02-25 15:03:35,147][36138] Updated weights for policy 0, policy_version 58643 (0.0009) [2023-02-25 15:03:35,397][36142] DAMAGECOUNT value on done: 1609308.0 [2023-02-25 15:03:35,397][36142] Sum rewards: 54.452, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.682', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.065', 'AMMO3': '0.152', 'weapon5': '0.282', 'weapon2': '0.292', 'AMMO4': '0.325', 'WEAPON5': '0.400', 'WEAPON4': '0.650', 'weapon4': '0.898', 'WEAPON3': '0.900', 'weapon3': '2.092', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.118', 'FRAGCOUNT': '48.000'} [2023-02-25 15:03:35,704][36142] DAMAGECOUNT value on done: 1601514.0 [2023-02-25 15:03:35,705][36142] Sum rewards: 56.020, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.400', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'weapon2': '0.260', 'AMMO3': '0.337', 'WEAPON3': '2.000', 'HITCOUNT': '3.170', 'weapon3': '3.492', 'DAMAGECOUNT': '15.165', 'FRAGCOUNT': '53.000'} [2023-02-25 15:03:36,317][36142] DAMAGECOUNT value on done: 1612751.0 [2023-02-25 15:03:36,318][36142] Sum rewards: 57.171, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.260', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.080', 'weapon4': '0.092', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.448', 'WEAPON3': '1.400', 'weapon3': '3.160', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.552', 'FRAGCOUNT': '50.000'} [2023-02-25 15:03:36,476][36139] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0)] [2023-02-25 15:03:36,612][36142] DAMAGECOUNT value on done: 1620804.0 [2023-02-25 15:03:36,612][36142] Sum rewards: 67.076, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.410', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.136', 'AMMO3': '0.213', 'weapon2': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.598', 'WEAPON3': '1.250', 'weapon3': '2.788', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '57.000'} [2023-02-25 15:03:36,893][36156] DAMAGECOUNT value on done: 1631518.0 [2023-02-25 15:03:36,893][36156] Sum rewards: 68.865, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.370', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.006', 'weapon5': '0.084', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.232', 'AMMO3': '0.263', 'weapon4': '0.530', 'WEAPON3': '1.600', 'weapon3': '2.756', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '60.000'} [2023-02-25 15:03:37,190][36156] DAMAGECOUNT value on done: 1609093.0 [2023-02-25 15:03:37,191][36156] Sum rewards: 61.359, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.948', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.070', 'AMMO4': '0.127', 'weapon2': '0.180', 'weapon4': '0.182', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.080', 'weapon3': '3.310', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '53.500'} [2023-02-25 15:03:37,432][36156] DAMAGECOUNT value on done: 1625476.0 [2023-02-25 15:03:37,432][36156] Sum rewards: 67.199, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.998', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon2': '0.162', 'weapon5': '0.170', 'AMMO3': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.724', 'WEAPON3': '1.150', 'weapon3': '2.604', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '58.000'} [2023-02-25 15:03:37,753][36156] DAMAGECOUNT value on done: 1614791.0 [2023-02-25 15:03:37,753][36156] Sum rewards: 63.547, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.672', 'AMMO5': '0.005', 'AMMO2': '0.046', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'AMMO4': '0.229', 'ARMOR': '0.404', 'weapon4': '0.412', 'WEAPON4': '0.450', 'weapon2': '0.558', 'WEAPON3': '1.000', 'weapon3': '2.672', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.561', 'FRAGCOUNT': '55.000'} [2023-02-25 15:03:38,178][36138] Updated weights for policy 0, policy_version 58653 (0.0009) [2023-02-25 15:03:39,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13398.8). Total num frames: 240263168. Throughput: 0: 3374.5. Samples: 22556644. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:03:39,730][36114] Avg episode reward: [(0, '60.782')] [2023-02-25 15:03:41,254][36138] Updated weights for policy 0, policy_version 58663 (0.0009) [2023-02-25 15:03:41,796][36155] DAMAGECOUNT value on done: 1612183.0 [2023-02-25 15:03:41,796][36155] Sum rewards: 80.965, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.726', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.136', 'AMMO3': '0.157', 'weapon2': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.412', 'WEAPON3': '1.050', 'weapon3': '3.002', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.065', 'FRAGCOUNT': '67.000'} [2023-02-25 15:03:41,828][36139] DAMAGECOUNT value on done: 1621906.0 [2023-02-25 15:03:41,829][36139] Sum rewards: 60.630, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.632', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon5': '0.180', 'AMMO3': '0.234', 'WEAPON5': '0.350', 'weapon4': '0.358', 'WEAPON4': '0.400', 'weapon2': '0.572', 'WEAPON3': '1.300', 'weapon3': '2.588', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.429', 'FRAGCOUNT': '53.000'} [2023-02-25 15:03:42,112][36155] DAMAGECOUNT value on done: 1613246.0 [2023-02-25 15:03:42,112][36155] Sum rewards: 51.120, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-3.082', 'AMMO5': '0.018', 'AMMO2': '0.046', 'weapon2': '0.222', 'AMMO4': '0.229', 'AMMO3': '0.269', 'weapon5': '0.360', 'weapon4': '0.584', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.380', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.694', 'FRAGCOUNT': '50.000'} [2023-02-25 15:03:42,140][36139] DAMAGECOUNT value on done: 1622648.0 [2023-02-25 15:03:42,141][36139] Sum rewards: 48.622, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.410', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.172', 'weapon5': '0.188', 'WEAPON5': '0.250', 'AMMO3': '0.261', 'weapon2': '0.376', 'WEAPON4': '0.450', 'weapon4': '0.568', 'WEAPON3': '1.500', 'weapon3': '2.516', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.379', 'FRAGCOUNT': '46.000'} [2023-02-25 15:03:42,621][36139] DAMAGECOUNT value on done: 1630836.0 [2023-02-25 15:03:42,621][36139] Sum rewards: 66.024, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.700', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.090', 'AMMO4': '0.097', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'weapon4': '0.344', 'weapon2': '0.346', 'WEAPON3': '1.350', 'weapon3': '3.016', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.098', 'FRAGCOUNT': '57.500'} [2023-02-25 15:03:42,923][36139] DAMAGECOUNT value on done: 1630657.0 [2023-02-25 15:03:42,924][36139] Sum rewards: 62.269, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.822', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.060', 'weapon4': '0.118', 'AMMO4': '0.166', 'AMMO3': '0.249', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.476', 'WEAPON3': '1.450', 'weapon3': '3.094', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.269', 'FRAGCOUNT': '55.500'} [2023-02-25 15:03:42,999][36155] DAMAGECOUNT value on done: 1629605.0 [2023-02-25 15:03:42,999][36155] Sum rewards: 72.460, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.310', 'AMMO5': '0.014', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.166', 'AMMO3': '0.206', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.538', 'WEAPON3': '1.200', 'weapon3': '2.706', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '62.000'} [2023-02-25 15:03:43,308][36154] DAMAGECOUNT value on done: 1624446.0 [2023-02-25 15:03:43,309][36154] Sum rewards: 60.903, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.544', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.214', 'weapon2': '0.230', 'weapon4': '0.230', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '3.260', 'weapon3': '3.308', 'DAMAGECOUNT': '16.542', 'FRAGCOUNT': '52.000'} [2023-02-25 15:03:43,317][36155] DAMAGECOUNT value on done: 1616065.0 [2023-02-25 15:03:43,318][36155] Sum rewards: 62.038, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.310', 'AMMO5': '0.025', 'AMMO2': '0.067', 'AMMO3': '0.224', 'weapon2': '0.250', 'weapon5': '0.290', 'AMMO4': '0.335', 'weapon4': '0.354', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.738', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.125', 'FRAGCOUNT': '56.000'} [2023-02-25 15:03:43,623][36154] DAMAGECOUNT value on done: 1599897.0 [2023-02-25 15:03:43,624][36154] Sum rewards: 45.887, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.410', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon5': '0.092', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'weapon2': '0.512', 'weapon4': '0.678', 'WEAPON3': '1.100', 'HITCOUNT': '2.530', 'weapon3': '2.532', 'DAMAGECOUNT': '11.355', 'FRAGCOUNT': '42.000'} [2023-02-25 15:03:44,090][36154] DAMAGECOUNT value on done: 1635298.0 [2023-02-25 15:03:44,090][36154] Sum rewards: 69.681, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.950', 'AMMO5': '0.009', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.164', 'AMMO3': '0.227', 'weapon4': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.400', 'weapon3': '2.848', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '58.000'} [2023-02-25 15:03:44,306][36138] Updated weights for policy 0, policy_version 58673 (0.0010) [2023-02-25 15:03:44,400][36154] DAMAGECOUNT value on done: 1612377.0 [2023-02-25 15:03:44,401][36154] Sum rewards: 46.197, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.182', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.050', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon4': '0.234', 'WEAPON4': '0.300', 'weapon2': '0.760', 'WEAPON3': '1.150', 'weapon3': '2.738', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.219', 'FRAGCOUNT': '41.000'} [2023-02-25 15:03:44,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13398.8). Total num frames: 240328704. Throughput: 0: 3373.4. Samples: 22576640. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:03:44,729][36114] Avg episode reward: [(0, '60.917')] [2023-02-25 15:03:45,516][36141] DAMAGECOUNT value on done: 1623618.0 [2023-02-25 15:03:45,516][36141] Sum rewards: 65.449, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.124', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.108', 'weapon4': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon2': '0.354', 'WEAPON3': '1.400', 'weapon3': '3.204', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.307', 'FRAGCOUNT': '57.000'} [2023-02-25 15:03:45,833][36141] DAMAGECOUNT value on done: 1627665.0 [2023-02-25 15:03:45,833][36141] Sum rewards: 53.163, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.130', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.064', 'AMMO4': '0.160', 'weapon4': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.277', 'WEAPON4': '0.350', 'weapon2': '0.442', 'WEAPON3': '1.700', 'weapon3': '3.004', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.129', 'FRAGCOUNT': '50.500'} [2023-02-25 15:03:45,846][36141] DAMAGECOUNT value on done: 1615136.0 [2023-02-25 15:03:45,846][36141] Sum rewards: 66.659, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.618', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.186', 'weapon5': '0.192', 'WEAPON4': '0.200', 'weapon4': '0.248', 'WEAPON5': '0.250', 'weapon2': '0.326', 'WEAPON3': '1.000', 'weapon3': '3.016', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '55.000'} [2023-02-25 15:03:46,149][36141] DAMAGECOUNT value on done: 1600273.0 [2023-02-25 15:03:46,150][36141] Sum rewards: 47.688, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.856', 'WEAPON1': '0.010', 'AMMO5': '0.024', 'AMMO2': '0.066', 'AMMO3': '0.146', 'weapon5': '0.302', 'AMMO4': '0.329', 'weapon2': '0.528', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '0.850', 'weapon4': '0.970', 'weapon3': '1.892', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.157', 'FRAGCOUNT': '42.000'} [2023-02-25 15:03:47,342][36138] Updated weights for policy 0, policy_version 58683 (0.0009) [2023-02-25 15:03:49,477][36157] DAMAGECOUNT value on done: 1636578.0 [2023-02-25 15:03:49,477][36157] Sum rewards: 70.280, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.230', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon5': '0.188', 'weapon2': '0.212', 'AMMO3': '0.253', 'weapon4': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '2.940', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '60.500'} [2023-02-25 15:03:49,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 240394240. Throughput: 0: 3372.4. Samples: 22596912. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:03:49,729][36114] Avg episode reward: [(0, '60.879')] [2023-02-25 15:03:49,787][36157] DAMAGECOUNT value on done: 1619471.0 [2023-02-25 15:03:49,787][36157] Sum rewards: 56.698, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.337', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.163', 'weapon2': '0.206', 'weapon5': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.542', 'WEAPON3': '0.950', 'weapon3': '2.828', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.559', 'FRAGCOUNT': '47.000'} [2023-02-25 15:03:50,373][36157] DAMAGECOUNT value on done: 1638241.0 [2023-02-25 15:03:50,373][36157] Sum rewards: 60.665, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.618', 'AMMO5': '0.021', 'AMMO2': '0.048', 'weapon5': '0.120', 'AMMO3': '0.182', 'AMMO4': '0.239', 'weapon4': '0.360', 'weapon2': '0.362', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.750', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '52.500'} [2023-02-25 15:03:50,395][36138] Updated weights for policy 0, policy_version 58693 (0.0009) [2023-02-25 15:03:50,690][36157] DAMAGECOUNT value on done: 1624713.0 [2023-02-25 15:03:50,690][36157] Sum rewards: 65.518, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.240', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'weapon4': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'weapon2': '0.514', 'WEAPON3': '1.150', 'weapon3': '3.146', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '54.000'} [2023-02-25 15:03:50,823][36140] DAMAGECOUNT value on done: 1631472.0 [2023-02-25 15:03:50,823][36140] Sum rewards: 59.653, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.734', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.171', 'weapon5': '0.190', 'AMMO3': '0.206', 'WEAPON5': '0.400', 'weapon2': '0.410', 'WEAPON4': '0.500', 'weapon4': '0.598', 'WEAPON3': '1.200', 'weapon3': '2.372', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '51.500'} [2023-02-25 15:03:51,055][36140] DAMAGECOUNT value on done: 1624840.0 [2023-02-25 15:03:51,055][36140] Sum rewards: 59.988, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.714', 'AMMO5': '0.011', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.193', 'weapon5': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.340', 'weapon2': '0.402', 'WEAPON3': '1.150', 'weapon3': '2.800', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.480', 'FRAGCOUNT': '50.500'} [2023-02-25 15:03:51,160][36140] DAMAGECOUNT value on done: 1607950.0 [2023-02-25 15:03:51,160][36140] Sum rewards: 55.719, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.280', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.137', 'weapon5': '0.138', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'weapon4': '0.298', 'WEAPON4': '0.300', 'weapon2': '0.516', 'WEAPON3': '1.400', 'weapon3': '2.772', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '15.549', 'FRAGCOUNT': '51.000'} [2023-02-25 15:03:51,374][36140] DAMAGECOUNT value on done: 1620492.0 [2023-02-25 15:03:51,375][36140] Sum rewards: 59.796, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.072', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO3': '0.148', 'AMMO4': '0.204', 'weapon5': '0.388', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.502', 'weapon4': '0.686', 'WEAPON3': '0.800', 'weapon3': '2.142', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.348', 'FRAGCOUNT': '50.000'} [2023-02-25 15:03:53,490][36138] Updated weights for policy 0, policy_version 58703 (0.0009) [2023-02-25 15:03:54,729][36114] Fps is (10 sec: 13516.6, 60 sec: 13516.8, 300 sec: 13398.8). Total num frames: 240463872. Throughput: 0: 3364.9. Samples: 22606802. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:03:54,730][36114] Avg episode reward: [(0, '60.857')] [2023-02-25 15:03:55,462][36142] DAMAGECOUNT value on done: 1615388.0 [2023-02-25 15:03:55,462][36142] Sum rewards: 69.723, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.750', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.049', 'AMMO3': '0.197', 'AMMO4': '0.246', 'weapon2': '0.264', 'weapon5': '0.294', 'weapon4': '0.452', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.662', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.138', 'FRAGCOUNT': '58.000'} [2023-02-25 15:03:55,768][36142] DAMAGECOUNT value on done: 1606430.0 [2023-02-25 15:03:55,768][36142] Sum rewards: 56.703, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.365', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon2': '0.170', 'AMMO4': '0.170', 'AMMO3': '0.182', 'weapon5': '0.240', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.810', 'WEAPON3': '1.100', 'weapon3': '2.240', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.748', 'FRAGCOUNT': '49.000'} [2023-02-25 15:03:56,359][36142] DAMAGECOUNT value on done: 1618179.0 [2023-02-25 15:03:56,360][36142] Sum rewards: 59.899, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.780', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO3': '0.194', 'weapon4': '0.200', 'AMMO4': '0.206', 'weapon5': '0.270', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.802', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.981', 'FRAGCOUNT': '53.000'} [2023-02-25 15:03:56,540][36138] Updated weights for policy 0, policy_version 58713 (0.0009) [2023-02-25 15:03:56,666][36142] DAMAGECOUNT value on done: 1625507.0 [2023-02-25 15:03:56,666][36142] Sum rewards: 54.781, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.240', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.064', 'WEAPON5': '0.100', 'weapon2': '0.138', 'AMMO4': '0.152', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'weapon4': '0.640', 'WEAPON3': '1.300', 'weapon3': '2.758', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.109', 'FRAGCOUNT': '49.000'} [2023-02-25 15:03:57,102][36156] DAMAGECOUNT value on done: 1637128.0 [2023-02-25 15:03:57,103][36156] Sum rewards: 62.420, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.352', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon5': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon4': '0.342', 'weapon2': '0.428', 'WEAPON3': '1.350', 'weapon3': '2.856', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '53.000'} [2023-02-25 15:03:57,418][36156] DAMAGECOUNT value on done: 1614765.0 [2023-02-25 15:03:57,419][36156] Sum rewards: 60.117, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.015', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.130', 'weapon4': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.392', 'WEAPON3': '1.450', 'weapon3': '3.092', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '52.000'} [2023-02-25 15:03:57,653][36156] DAMAGECOUNT value on done: 1629904.0 [2023-02-25 15:03:57,654][36156] Sum rewards: 51.148, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.395', 'AMMO5': '0.020', 'AMMO2': '0.066', 'AMMO3': '0.100', 'weapon5': '0.288', 'AMMO4': '0.329', 'weapon2': '0.398', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '0.600', 'weapon4': '1.230', 'weapon3': '1.778', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.284', 'FRAGCOUNT': '41.000'} [2023-02-25 15:03:57,957][36156] DAMAGECOUNT value on done: 1620313.0 [2023-02-25 15:03:57,958][36156] Sum rewards: 63.778, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.841', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon2': '0.164', 'weapon5': '0.220', 'weapon4': '0.224', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.058', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '57.000'} [2023-02-25 15:03:59,572][36138] Updated weights for policy 0, policy_version 58723 (0.0009) [2023-02-25 15:03:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 240529408. Throughput: 0: 3360.2. Samples: 22626976. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:03:59,730][36114] Avg episode reward: [(0, '60.939')] [2023-02-25 15:04:01,192][36141] Large shaping reward -2.501 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.252, -84.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 15:04:01,795][36139] DAMAGECOUNT value on done: 1627585.0 [2023-02-25 15:04:01,795][36139] Sum rewards: 69.862, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.695', 'AMMO5': '0.005', 'AMMO2': '0.043', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'AMMO4': '0.213', 'weapon4': '0.294', 'WEAPON4': '0.350', 'weapon2': '0.426', 'WEAPON3': '1.200', 'weapon3': '3.008', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '61.000'} [2023-02-25 15:04:01,813][36155] DAMAGECOUNT value on done: 1617625.0 [2023-02-25 15:04:01,814][36155] Sum rewards: 59.316, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.225', 'AMMO5': '0.021', 'AMMO2': '0.041', 'AMMO3': '0.201', 'AMMO4': '0.206', 'weapon5': '0.280', 'weapon2': '0.368', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.818', 'WEAPON3': '1.200', 'weapon3': '2.170', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '51.500'} [2023-02-25 15:04:02,079][36139] DAMAGECOUNT value on done: 1628191.0 [2023-02-25 15:04:02,080][36139] Sum rewards: 69.631, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.255', 'AMMO5': '0.013', 'AMMO2': '0.052', 'AMMO3': '0.150', 'weapon5': '0.194', 'weapon2': '0.256', 'AMMO4': '0.258', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'weapon4': '0.798', 'WEAPON3': '0.800', 'weapon3': '2.436', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '58.500'} [2023-02-25 15:04:02,116][36155] DAMAGECOUNT value on done: 1618528.0 [2023-02-25 15:04:02,116][36155] Sum rewards: 65.184, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.220', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'weapon4': '0.386', 'weapon2': '0.590', 'WEAPON3': '0.950', 'weapon3': '2.744', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '54.000'} [2023-02-25 15:04:02,530][36139] DAMAGECOUNT value on done: 1635757.0 [2023-02-25 15:04:02,530][36139] Sum rewards: 60.659, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.410', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.074', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'weapon4': '0.168', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon2': '0.836', 'WEAPON3': '1.150', 'weapon3': '2.742', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.763', 'FRAGCOUNT': '52.000'} [2023-02-25 15:04:02,605][36138] Updated weights for policy 0, policy_version 58733 (0.0009) [2023-02-25 15:04:02,822][36139] DAMAGECOUNT value on done: 1636559.0 [2023-02-25 15:04:02,822][36139] Sum rewards: 70.867, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.790', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon5': '0.126', 'AMMO4': '0.147', 'AMMO3': '0.159', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.472', 'weapon2': '0.744', 'WEAPON3': '1.000', 'weapon3': '2.322', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '60.000'} [2023-02-25 15:04:03,010][36155] DAMAGECOUNT value on done: 1634759.0 [2023-02-25 15:04:03,010][36155] Sum rewards: 63.984, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.532', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.180', 'weapon5': '0.188', 'weapon4': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.200', 'weapon3': '2.992', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.462', 'FRAGCOUNT': '56.000'} [2023-02-25 15:04:03,256][36154] DAMAGECOUNT value on done: 1629540.0 [2023-02-25 15:04:03,257][36154] Sum rewards: 56.039, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-1.178', 'AMMO5': '0.011', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.134', 'weapon2': '0.244', 'AMMO3': '0.265', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.306', 'WEAPON3': '1.500', 'weapon3': '2.996', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.282', 'FRAGCOUNT': '52.000'} [2023-02-25 15:04:03,303][36155] DAMAGECOUNT value on done: 1621712.0 [2023-02-25 15:04:03,304][36155] Sum rewards: 63.161, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.615', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.086', 'AMMO4': '0.125', 'weapon2': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'weapon4': '0.472', 'WEAPON3': '1.400', 'weapon3': '3.084', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '53.000'} [2023-02-25 15:04:03,556][36154] DAMAGECOUNT value on done: 1605931.0 [2023-02-25 15:04:03,557][36154] Sum rewards: 72.286, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.020', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.140', 'AMMO3': '0.231', 'weapon2': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.370', 'WEAPON3': '1.450', 'weapon3': '2.956', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '63.000'} [2023-02-25 15:04:03,982][36154] DAMAGECOUNT value on done: 1640658.0 [2023-02-25 15:04:03,983][36154] Sum rewards: 65.504, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.392', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon4': '0.126', 'weapon5': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'weapon2': '0.342', 'WEAPON3': '1.400', 'HITCOUNT': '2.960', 'weapon3': '3.064', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '57.000'} [2023-02-25 15:04:04,296][36154] DAMAGECOUNT value on done: 1617166.0 [2023-02-25 15:04:04,296][36154] Sum rewards: 59.471, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.242', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon4': '0.112', 'weapon5': '0.156', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.844', 'WEAPON3': '1.000', 'weapon3': '2.684', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.367', 'FRAGCOUNT': '49.000'} [2023-02-25 15:04:04,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13398.8). Total num frames: 240599040. Throughput: 0: 3362.0. Samples: 22647292. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:04:04,730][36114] Avg episode reward: [(0, '61.393')] [2023-02-25 15:04:05,467][36141] DAMAGECOUNT value on done: 1629547.0 [2023-02-25 15:04:05,468][36141] Sum rewards: 68.803, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.152', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.138', 'AMMO4': '0.154', 'weapon4': '0.234', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.092', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '60.500'} [2023-02-25 15:04:05,629][36138] Updated weights for policy 0, policy_version 58743 (0.0009) [2023-02-25 15:04:05,769][36141] DAMAGECOUNT value on done: 1620630.0 [2023-02-25 15:04:05,770][36141] Sum rewards: 65.334, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.710', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.054', 'WEAPON4': '0.100', 'AMMO4': '0.128', 'AMMO3': '0.187', 'weapon2': '0.276', 'weapon4': '0.346', 'WEAPON3': '1.200', 'weapon3': '3.122', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.482', 'FRAGCOUNT': '56.000'} [2023-02-25 15:04:05,798][36141] DAMAGECOUNT value on done: 1632718.0 [2023-02-25 15:04:05,798][36141] Sum rewards: 56.367, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.007', 'AMMO5': '0.021', 'AMMO2': '0.036', 'weapon4': '0.128', 'AMMO3': '0.177', 'AMMO4': '0.179', 'weapon5': '0.180', 'weapon2': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.820', 'weapon3': '3.202', 'DAMAGECOUNT': '15.159', 'FRAGCOUNT': '48.500'} [2023-02-25 15:04:06,084][36141] DAMAGECOUNT value on done: 1605423.0 [2023-02-25 15:04:06,084][36141] Sum rewards: 66.146, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.020', 'AMMO2': '0.004', 'ARMOR': '0.005', 'AMMO4': '0.022', 'AMMO3': '0.164', 'weapon2': '0.444', 'WEAPON3': '0.950', 'HITCOUNT': '2.940', 'weapon3': '3.436', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '54.000'} [2023-02-25 15:04:06,563][36141] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 15:04:08,643][36138] Updated weights for policy 0, policy_version 58753 (0.0009) [2023-02-25 15:04:09,477][36157] DAMAGECOUNT value on done: 1642455.0 [2023-02-25 15:04:09,477][36157] Sum rewards: 70.339, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.893', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.088', 'AMMO4': '0.089', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'WEAPON4': '0.250', 'weapon2': '0.308', 'weapon4': '0.364', 'WEAPON3': '0.950', 'weapon3': '3.080', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '56.000'} [2023-02-25 15:04:09,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 240664576. Throughput: 0: 3364.3. Samples: 22657424. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:04:09,730][36114] Avg episode reward: [(0, '61.541')] [2023-02-25 15:04:09,792][36157] DAMAGECOUNT value on done: 1624575.0 [2023-02-25 15:04:09,793][36157] Sum rewards: 59.106, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.292', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon4': '0.168', 'weapon5': '0.190', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.324', 'WEAPON3': '1.250', 'weapon3': '3.050', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '52.000'} [2023-02-25 15:04:10,252][36155] Large shaping reward -2.551 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('ARMOR', -0.001, -1.0), ('AMMO5', -0.0005, -1.0)] [2023-02-25 15:04:10,409][36157] DAMAGECOUNT value on done: 1643555.0 [2023-02-25 15:04:10,410][36157] Sum rewards: 66.799, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.578', 'AMMO5': '0.011', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.108', 'AMMO3': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.220', 'WEAPON5': '0.300', 'weapon2': '0.602', 'WEAPON3': '0.900', 'weapon3': '2.830', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.942', 'FRAGCOUNT': '54.000'} [2023-02-25 15:04:10,672][36140] DAMAGECOUNT value on done: 1636577.0 [2023-02-25 15:04:10,672][36140] Sum rewards: 58.515, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.655', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.064', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.412', 'weapon2': '0.722', 'WEAPON3': '1.300', 'weapon3': '2.600', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '51.000'} [2023-02-25 15:04:10,721][36157] DAMAGECOUNT value on done: 1630507.0 [2023-02-25 15:04:10,721][36157] Sum rewards: 66.338, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.580', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO3': '0.157', 'AMMO4': '0.190', 'weapon2': '0.224', 'weapon5': '0.292', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon4': '0.712', 'WEAPON3': '0.900', 'weapon3': '2.390', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '56.000'} [2023-02-25 15:04:10,884][36140] DAMAGECOUNT value on done: 1629554.0 [2023-02-25 15:04:10,885][36140] Sum rewards: 54.256, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.416', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.130', 'weapon5': '0.150', 'AMMO4': '0.171', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.560', 'WEAPON3': '1.150', 'HITCOUNT': '2.870', 'weapon3': '2.892', 'DAMAGECOUNT': '14.142', 'FRAGCOUNT': '47.000'} [2023-02-25 15:04:10,992][36140] DAMAGECOUNT value on done: 1612959.0 [2023-02-25 15:04:10,993][36140] Sum rewards: 57.582, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.255', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.110', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.518', 'weapon2': '0.766', 'WEAPON3': '0.800', 'weapon3': '2.386', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.027', 'FRAGCOUNT': '45.000'} [2023-02-25 15:04:11,197][36140] DAMAGECOUNT value on done: 1625232.0 [2023-02-25 15:04:11,197][36140] Sum rewards: 53.319, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.902', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.037', 'weapon5': '0.134', 'AMMO4': '0.185', 'AMMO3': '0.194', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON4': '0.450', 'weapon4': '0.614', 'WEAPON3': '1.150', 'weapon3': '2.660', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.220', 'FRAGCOUNT': '47.000'} [2023-02-25 15:04:11,681][36138] Updated weights for policy 0, policy_version 58763 (0.0010) [2023-02-25 15:04:14,680][36138] Updated weights for policy 0, policy_version 58773 (0.0008) [2023-02-25 15:04:14,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13398.8). Total num frames: 240734208. Throughput: 0: 3365.4. Samples: 22677628. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:04:14,730][36114] Avg episode reward: [(0, '61.387')] [2023-02-25 15:04:15,352][36142] DAMAGECOUNT value on done: 1620992.0 [2023-02-25 15:04:15,352][36142] Sum rewards: 64.975, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.872', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.038', 'AMMO3': '0.153', 'AMMO4': '0.189', 'weapon5': '0.206', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON4': '0.400', 'weapon4': '0.552', 'WEAPON3': '0.850', 'weapon3': '2.560', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '53.000'} [2023-02-25 15:04:15,667][36142] DAMAGECOUNT value on done: 1612147.0 [2023-02-25 15:04:15,667][36142] Sum rewards: 66.162, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.768', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.138', 'AMMO4': '0.157', 'WEAPON4': '0.350', 'weapon4': '0.506', 'weapon2': '0.524', 'WEAPON3': '0.950', 'weapon3': '2.734', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.151', 'FRAGCOUNT': '54.500'} [2023-02-25 15:04:16,281][36142] DAMAGECOUNT value on done: 1624071.0 [2023-02-25 15:04:16,282][36142] Sum rewards: 74.042, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.905', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.203', 'weapon2': '0.246', 'weapon4': '0.316', 'WEAPON3': '1.200', 'weapon3': '3.170', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '63.000'} [2023-02-25 15:04:16,589][36142] DAMAGECOUNT value on done: 1630280.0 [2023-02-25 15:04:16,589][36142] Sum rewards: 59.414, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.080', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.150', 'AMMO3': '0.197', 'weapon2': '0.262', 'weapon5': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.446', 'WEAPON3': '1.250', 'weapon3': '2.732', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '14.319', 'FRAGCOUNT': '54.000'} [2023-02-25 15:04:17,164][36156] DAMAGECOUNT value on done: 1642923.0 [2023-02-25 15:04:17,165][36156] Sum rewards: 70.204, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.785', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.014', 'AMMO4': '0.035', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.244', 'weapon2': '0.330', 'WEAPON3': '1.500', 'weapon3': '3.428', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '61.000'} [2023-02-25 15:04:17,477][36156] DAMAGECOUNT value on done: 1620352.0 [2023-02-25 15:04:17,477][36156] Sum rewards: 67.115, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.280', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.205', 'weapon2': '0.254', 'weapon4': '0.382', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.024', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '59.000'} [2023-02-25 15:04:17,712][36156] DAMAGECOUNT value on done: 1636077.0 [2023-02-25 15:04:17,712][36156] Sum rewards: 75.383, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.668', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.142', 'AMMO4': '0.150', 'AMMO3': '0.181', 'weapon2': '0.216', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.484', 'WEAPON3': '1.100', 'weapon3': '2.900', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '64.000'} [2023-02-25 15:04:17,731][36138] Updated weights for policy 0, policy_version 58783 (0.0010) [2023-02-25 15:04:18,028][36156] DAMAGECOUNT value on done: 1625201.0 [2023-02-25 15:04:18,029][36156] Sum rewards: 49.071, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.700', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon5': '0.176', 'AMMO4': '0.254', 'weapon2': '0.262', 'AMMO3': '0.280', 'WEAPON5': '0.350', 'weapon4': '0.422', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.782', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.664', 'FRAGCOUNT': '47.000'} [2023-02-25 15:04:19,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 240799744. Throughput: 0: 3362.9. Samples: 22697810. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:04:19,730][36114] Avg episode reward: [(0, '61.479')] [2023-02-25 15:04:20,777][36138] Updated weights for policy 0, policy_version 58793 (0.0010) [2023-02-25 15:04:21,544][36139] DAMAGECOUNT value on done: 1632733.0 [2023-02-25 15:04:21,545][36139] Sum rewards: 53.958, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.352', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon2': '0.192', 'weapon5': '0.238', 'AMMO3': '0.249', 'weapon4': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.940', 'weapon3': '3.002', 'DAMAGECOUNT': '15.441', 'FRAGCOUNT': '48.000'} [2023-02-25 15:04:21,733][36155] DAMAGECOUNT value on done: 1623307.0 [2023-02-25 15:04:21,733][36155] Sum rewards: 65.413, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.604', 'ARMOR': '0.012', 'AMMO5': '0.020', 'AMMO2': '0.046', 'AMMO3': '0.120', 'weapon2': '0.208', 'AMMO4': '0.231', 'weapon5': '0.392', 'WEAPON5': '0.700', 'WEAPON3': '0.700', 'WEAPON4': '0.750', 'weapon3': '1.450', 'weapon4': '1.492', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '53.500'} [2023-02-25 15:04:21,860][36139] DAMAGECOUNT value on done: 1633197.0 [2023-02-25 15:04:21,860][36139] Sum rewards: 62.640, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.280', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.133', 'weapon5': '0.140', 'weapon2': '0.162', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.800', 'weapon4': '1.012', 'weapon3': '2.264', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.018', 'FRAGCOUNT': '51.000'} [2023-02-25 15:04:22,054][36155] DAMAGECOUNT value on done: 1624305.0 [2023-02-25 15:04:22,054][36155] Sum rewards: 66.812, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.585', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.136', 'AMMO3': '0.195', 'weapon5': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.318', 'weapon2': '0.746', 'WEAPON3': '1.200', 'weapon3': '2.486', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.331', 'FRAGCOUNT': '56.000'} [2023-02-25 15:04:22,333][36139] DAMAGECOUNT value on done: 1640947.0 [2023-02-25 15:04:22,333][36139] Sum rewards: 56.557, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.515', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.126', 'AMMO3': '0.206', 'WEAPON4': '0.350', 'weapon2': '0.472', 'weapon4': '0.628', 'WEAPON3': '1.150', 'weapon3': '2.566', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '49.000'} [2023-02-25 15:04:22,626][36139] DAMAGECOUNT value on done: 1641991.0 [2023-02-25 15:04:22,626][36139] Sum rewards: 61.501, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.370', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.172', 'AMMO3': '0.175', 'weapon2': '0.336', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.468', 'WEAPON3': '1.100', 'weapon3': '2.632', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.296', 'FRAGCOUNT': '52.000'} [2023-02-25 15:04:22,976][36155] DAMAGECOUNT value on done: 1640401.0 [2023-02-25 15:04:22,976][36155] Sum rewards: 65.895, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.020', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.100', 'weapon4': '0.126', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.314', 'WEAPON3': '1.200', 'weapon3': '3.220', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '55.000'} [2023-02-25 15:04:23,251][36154] DAMAGECOUNT value on done: 1635388.0 [2023-02-25 15:04:23,252][36154] Sum rewards: 70.498, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.640', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.094', 'AMMO4': '0.132', 'AMMO3': '0.179', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.508', 'weapon2': '0.560', 'WEAPON3': '1.150', 'weapon3': '2.544', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '59.000'} [2023-02-25 15:04:23,265][36155] DAMAGECOUNT value on done: 1627672.0 [2023-02-25 15:04:23,266][36155] Sum rewards: 68.895, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.164', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.015', 'AMMO4': '0.077', 'AMMO3': '0.150', 'weapon5': '0.308', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.358', 'weapon4': '0.920', 'WEAPON3': '0.950', 'weapon3': '2.184', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '56.000'} [2023-02-25 15:04:23,556][36154] DAMAGECOUNT value on done: 1610840.0 [2023-02-25 15:04:23,556][36154] Sum rewards: 59.927, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.997', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.116', 'AMMO3': '0.172', 'AMMO4': '0.227', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.528', 'weapon4': '0.680', 'WEAPON3': '1.050', 'weapon3': '2.226', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.727', 'FRAGCOUNT': '52.000'} [2023-02-25 15:04:23,836][36138] Updated weights for policy 0, policy_version 58803 (0.0009) [2023-02-25 15:04:24,004][36154] DAMAGECOUNT value on done: 1645434.0 [2023-02-25 15:04:24,005][36154] Sum rewards: 59.643, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.654', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.136', 'AMMO4': '0.159', 'AMMO3': '0.211', 'weapon2': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.316', 'WEAPON3': '1.350', 'weapon3': '3.044', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.328', 'FRAGCOUNT': '53.000'} [2023-02-25 15:04:24,306][36154] DAMAGECOUNT value on done: 1622808.0 [2023-02-25 15:04:24,307][36154] Sum rewards: 61.207, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.254', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.132', 'WEAPON5': '0.200', 'AMMO4': '0.211', 'AMMO3': '0.226', 'weapon4': '0.354', 'WEAPON4': '0.450', 'weapon2': '0.544', 'WEAPON3': '1.450', 'weapon3': '2.708', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '55.000'} [2023-02-25 15:04:24,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 240865280. Throughput: 0: 3360.4. Samples: 22707860. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:04:24,730][36114] Avg episode reward: [(0, '61.948')] [2023-02-25 15:04:25,405][36141] DAMAGECOUNT value on done: 1634617.0 [2023-02-25 15:04:25,406][36141] Sum rewards: 61.559, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.506', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.104', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'weapon2': '0.158', 'AMMO3': '0.217', 'WEAPON4': '0.400', 'ARMOR': '0.404', 'weapon4': '0.998', 'WEAPON3': '1.300', 'weapon3': '2.438', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '54.000'} [2023-02-25 15:04:25,632][36141] DAMAGECOUNT value on done: 1625723.0 [2023-02-25 15:04:25,633][36141] Sum rewards: 55.533, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.445', 'ARMOR': '0.008', 'AMMO5': '0.024', 'AMMO2': '0.059', 'weapon4': '0.120', 'weapon5': '0.120', 'weapon2': '0.226', 'AMMO3': '0.228', 'AMMO4': '0.298', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'HITCOUNT': '2.860', 'weapon3': '3.256', 'DAMAGECOUNT': '15.279', 'FRAGCOUNT': '51.500'} [2023-02-25 15:04:25,722][36141] DAMAGECOUNT value on done: 1638146.0 [2023-02-25 15:04:25,722][36141] Sum rewards: 59.332, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.805', 'AMMO5': '0.010', 'weapon5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.144', 'WEAPON5': '0.200', 'weapon4': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.264', 'AMMO3': '0.286', 'WEAPON3': '1.750', 'weapon3': '3.256', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '55.000'} [2023-02-25 15:04:25,952][36141] DAMAGECOUNT value on done: 1610894.0 [2023-02-25 15:04:25,953][36141] Sum rewards: 61.417, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.500', 'AMMO5': '0.011', 'AMMO2': '0.054', 'AMMO3': '0.138', 'weapon5': '0.160', 'AMMO4': '0.268', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON4': '0.450', 'weapon4': '0.644', 'WEAPON3': '0.900', 'weapon3': '2.626', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.413', 'FRAGCOUNT': '50.000'} [2023-02-25 15:04:26,833][36138] Updated weights for policy 0, policy_version 58813 (0.0009) [2023-02-25 15:04:29,425][36157] DAMAGECOUNT value on done: 1648109.0 [2023-02-25 15:04:29,426][36157] Sum rewards: 62.412, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.634', 'AMMO5': '0.015', 'AMMO2': '0.048', 'AMMO3': '0.236', 'AMMO4': '0.239', 'weapon5': '0.298', 'weapon2': '0.496', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.572', 'WEAPON3': '1.350', 'weapon3': '2.260', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '56.000'} [2023-02-25 15:04:29,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 240934912. Throughput: 0: 3368.3. Samples: 22728212. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:04:29,730][36114] Avg episode reward: [(0, '61.568')] [2023-02-25 15:04:29,735][36157] DAMAGECOUNT value on done: 1630229.0 [2023-02-25 15:04:29,736][36157] Sum rewards: 65.508, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.840', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.140', 'AMMO3': '0.158', 'AMMO4': '0.167', 'weapon2': '0.170', 'WEAPON5': '0.250', 'WEAPON4': '0.600', 'WEAPON3': '0.850', 'weapon4': '1.124', 'weapon3': '1.976', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '54.000'} [2023-02-25 15:04:29,881][36138] Updated weights for policy 0, policy_version 58823 (0.0009) [2023-02-25 15:04:30,356][36157] DAMAGECOUNT value on done: 1649040.0 [2023-02-25 15:04:30,357][36157] Sum rewards: 65.543, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.940', 'ARMOR': '0.004', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon5': '0.062', 'weapon4': '0.072', 'AMMO4': '0.141', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.608', 'WEAPON3': '1.350', 'weapon3': '2.958', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '57.000'} [2023-02-25 15:04:30,629][36140] DAMAGECOUNT value on done: 1641585.0 [2023-02-25 15:04:30,630][36140] Sum rewards: 58.344, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.975', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.044', 'AMMO3': '0.153', 'weapon2': '0.194', 'AMMO4': '0.222', 'weapon5': '0.256', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.800', 'WEAPON3': '0.900', 'weapon3': '2.394', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.024', 'FRAGCOUNT': '49.500'} [2023-02-25 15:04:30,675][36157] DAMAGECOUNT value on done: 1635462.0 [2023-02-25 15:04:30,675][36157] Sum rewards: 52.362, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.794', 'AMMO5': '0.006', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon2': '0.686', 'WEAPON3': '1.100', 'weapon3': '2.962', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '42.500'} [2023-02-25 15:04:30,841][36140] DAMAGECOUNT value on done: 1634276.0 [2023-02-25 15:04:30,842][36140] Sum rewards: 55.321, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.232', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon5': '0.110', 'AMMO3': '0.166', 'weapon2': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.396', 'WEAPON3': '0.950', 'HITCOUNT': '2.980', 'weapon3': '3.048', 'DAMAGECOUNT': '14.166', 'FRAGCOUNT': '45.000'} [2023-02-25 15:04:30,948][36140] DAMAGECOUNT value on done: 1618273.0 [2023-02-25 15:04:30,949][36140] Sum rewards: 67.703, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.724', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.053', 'AMMO3': '0.167', 'weapon5': '0.204', 'weapon2': '0.232', 'AMMO4': '0.266', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.638', 'WEAPON3': '0.950', 'weapon3': '2.602', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.942', 'FRAGCOUNT': '58.000'} [2023-02-25 15:04:31,156][36140] DAMAGECOUNT value on done: 1631124.0 [2023-02-25 15:04:31,157][36140] Sum rewards: 72.707, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.612', 'AMMO5': '0.004', 'AMMO2': '0.027', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.252', 'weapon4': '0.304', 'weapon2': '0.306', 'WEAPON3': '1.450', 'weapon3': '3.108', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '62.000'} [2023-02-25 15:04:32,982][36138] Updated weights for policy 0, policy_version 58833 (0.0009) [2023-02-25 15:04:34,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 241000448. Throughput: 0: 3363.1. Samples: 22748252. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:04:34,730][36114] Avg episode reward: [(0, '61.974')] [2023-02-25 15:04:35,325][36142] DAMAGECOUNT value on done: 1626133.0 [2023-02-25 15:04:35,325][36142] Sum rewards: 50.831, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.338', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.068', 'weapon5': '0.180', 'AMMO3': '0.240', 'AMMO4': '0.338', 'weapon2': '0.398', 'WEAPON5': '0.450', 'weapon4': '0.524', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.556', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.282', 'FRAGCOUNT': '47.000'} [2023-02-25 15:04:35,630][36142] DAMAGECOUNT value on done: 1617203.0 [2023-02-25 15:04:35,631][36142] Sum rewards: 63.218, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.410', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.173', 'weapon5': '0.268', 'weapon4': '0.390', 'WEAPON4': '0.400', 'weapon2': '0.420', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.638', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.168', 'FRAGCOUNT': '54.000'} [2023-02-25 15:04:36,012][36138] Updated weights for policy 0, policy_version 58843 (0.0009) [2023-02-25 15:04:36,222][36142] DAMAGECOUNT value on done: 1628844.0 [2023-02-25 15:04:36,222][36142] Sum rewards: 49.456, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.302', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon2': '0.370', 'weapon4': '0.442', 'WEAPON3': '1.150', 'weapon3': '2.572', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.319', 'FRAGCOUNT': '43.000'} [2023-02-25 15:04:36,544][36142] DAMAGECOUNT value on done: 1635289.0 [2023-02-25 15:04:36,545][36142] Sum rewards: 57.462, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.542', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.067', 'AMMO3': '0.155', 'weapon5': '0.332', 'AMMO4': '0.337', 'weapon2': '0.414', 'WEAPON4': '0.550', 'weapon4': '0.556', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'weapon3': '2.358', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '15.027', 'FRAGCOUNT': '50.000'} [2023-02-25 15:04:37,268][36156] DAMAGECOUNT value on done: 1648471.0 [2023-02-25 15:04:37,269][36156] Sum rewards: 64.855, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.160', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.152', 'AMMO3': '0.223', 'weapon2': '0.248', 'weapon4': '0.456', 'WEAPON3': '1.400', 'weapon3': '2.872', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '55.000'} [2023-02-25 15:04:37,566][36156] DAMAGECOUNT value on done: 1624563.0 [2023-02-25 15:04:37,567][36156] Sum rewards: 50.865, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.720', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon5': '0.038', 'AMMO4': '0.092', 'WEAPON5': '0.150', 'weapon4': '0.178', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.426', 'WEAPON3': '1.300', 'HITCOUNT': '2.630', 'weapon3': '3.144', 'DAMAGECOUNT': '12.633', 'FRAGCOUNT': '46.000'} [2023-02-25 15:04:37,804][36156] DAMAGECOUNT value on done: 1641916.0 [2023-02-25 15:04:37,805][36156] Sum rewards: 64.477, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.320', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.050', 'AMMO4': '0.135', 'WEAPON5': '0.200', 'weapon4': '0.226', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.550', 'weapon3': '3.184', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '57.000'} [2023-02-25 15:04:38,110][36156] DAMAGECOUNT value on done: 1630360.0 [2023-02-25 15:04:38,111][36156] Sum rewards: 60.537, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.076', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.037', 'weapon5': '0.152', 'AMMO3': '0.172', 'AMMO4': '0.187', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.424', 'weapon4': '0.452', 'WEAPON3': '1.100', 'weapon3': '2.726', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '53.000'} [2023-02-25 15:04:39,053][36138] Updated weights for policy 0, policy_version 58853 (0.0009) [2023-02-25 15:04:39,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 241070080. Throughput: 0: 3367.8. Samples: 22758354. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:04:39,730][36114] Avg episode reward: [(0, '61.852')] [2023-02-25 15:04:41,391][36139] DAMAGECOUNT value on done: 1636562.0 [2023-02-25 15:04:41,392][36139] Sum rewards: 39.523, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.396', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.064', 'weapon5': '0.190', 'AMMO3': '0.200', 'weapon2': '0.288', 'AMMO4': '0.320', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.666', 'WEAPON3': '1.250', 'weapon3': '2.370', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '11.487', 'FRAGCOUNT': '39.000'} [2023-02-25 15:04:41,702][36139] DAMAGECOUNT value on done: 1638512.0 [2023-02-25 15:04:41,702][36139] Sum rewards: 66.689, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.562', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'weapon2': '0.154', 'AMMO3': '0.189', 'weapon4': '0.476', 'WEAPON3': '1.200', 'weapon3': '3.102', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.945', 'FRAGCOUNT': '56.000'} [2023-02-25 15:04:41,720][36155] DAMAGECOUNT value on done: 1627421.0 [2023-02-25 15:04:41,720][36155] Sum rewards: 53.750, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.141', 'HEALTH': '0.275', 'weapon2': '0.390', 'weapon4': '0.560', 'WEAPON3': '0.800', 'weapon3': '2.590', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '12.342', 'FRAGCOUNT': '44.000'} [2023-02-25 15:04:42,037][36155] DAMAGECOUNT value on done: 1630312.0 [2023-02-25 15:04:42,037][36155] Sum rewards: 71.630, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.426', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.094', 'AMMO4': '0.142', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.260', 'WEAPON4': '0.350', 'weapon4': '0.684', 'WEAPON3': '1.150', 'weapon3': '2.684', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '61.000'} [2023-02-25 15:04:42,103][36138] Updated weights for policy 0, policy_version 58863 (0.0009) [2023-02-25 15:04:42,210][36139] DAMAGECOUNT value on done: 1645845.0 [2023-02-25 15:04:42,210][36139] Sum rewards: 52.619, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.202', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.050', 'AMMO3': '0.126', 'AMMO4': '0.248', 'weapon5': '0.304', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.550', 'weapon4': '0.656', 'WEAPON3': '0.850', 'weapon3': '2.140', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.694', 'FRAGCOUNT': '44.000'} [2023-02-25 15:04:42,514][36139] DAMAGECOUNT value on done: 1648266.0 [2023-02-25 15:04:42,514][36139] Sum rewards: 81.199, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.916', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.165', 'AMMO3': '0.166', 'weapon5': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.356', 'weapon2': '0.472', 'WEAPON3': '1.150', 'weapon3': '2.702', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '68.000'} [2023-02-25 15:04:42,954][36155] DAMAGECOUNT value on done: 1645703.0 [2023-02-25 15:04:42,954][36155] Sum rewards: 66.458, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.030', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.211', 'weapon4': '0.226', 'weapon2': '0.402', 'WEAPON3': '1.300', 'weapon3': '3.064', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.906', 'FRAGCOUNT': '56.000'} [2023-02-25 15:04:43,166][36154] DAMAGECOUNT value on done: 1639806.0 [2023-02-25 15:04:43,166][36154] Sum rewards: 51.586, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.830', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO3': '0.194', 'WEAPON4': '0.300', 'weapon4': '0.352', 'weapon2': '0.506', 'WEAPON3': '1.150', 'weapon3': '2.742', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.254', 'FRAGCOUNT': '46.000'} [2023-02-25 15:04:43,253][36155] DAMAGECOUNT value on done: 1632614.0 [2023-02-25 15:04:43,253][36155] Sum rewards: 57.394, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.980', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.162', 'AMMO3': '0.179', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.572', 'weapon4': '0.628', 'WEAPON3': '1.050', 'weapon3': '2.356', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '14.826', 'FRAGCOUNT': '48.000'} [2023-02-25 15:04:43,471][36154] DAMAGECOUNT value on done: 1615351.0 [2023-02-25 15:04:43,471][36154] Sum rewards: 48.390, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.552', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.028', 'weapon5': '0.090', 'AMMO4': '0.139', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'weapon2': '0.358', 'WEAPON4': '0.400', 'weapon4': '0.530', 'WEAPON3': '1.050', 'weapon3': '2.776', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.533', 'FRAGCOUNT': '42.000'} [2023-02-25 15:04:43,947][36154] DAMAGECOUNT value on done: 1650482.0 [2023-02-25 15:04:43,948][36154] Sum rewards: 55.387, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.277', 'AMMO5': '0.005', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon2': '0.308', 'weapon4': '0.434', 'WEAPON3': '1.200', 'weapon3': '2.928', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.144', 'FRAGCOUNT': '47.000'} [2023-02-25 15:04:44,259][36154] DAMAGECOUNT value on done: 1627787.0 [2023-02-25 15:04:44,260][36154] Sum rewards: 63.491, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.272', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.014', 'weapon5': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'weapon4': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'weapon2': '1.086', 'WEAPON3': '1.100', 'weapon3': '2.608', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.937', 'FRAGCOUNT': '54.000'} [2023-02-25 15:04:44,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 241135616. Throughput: 0: 3369.0. Samples: 22778580. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:04:44,730][36114] Avg episode reward: [(0, '61.294')] [2023-02-25 15:04:45,170][36138] Updated weights for policy 0, policy_version 58873 (0.0010) [2023-02-25 15:04:45,413][36141] DAMAGECOUNT value on done: 1639883.0 [2023-02-25 15:04:45,413][36141] Sum rewards: 55.850, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.760', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.134', 'AMMO4': '0.166', 'AMMO3': '0.171', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.436', 'weapon2': '0.438', 'WEAPON3': '0.950', 'weapon3': '2.762', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.798', 'FRAGCOUNT': '46.000'} [2023-02-25 15:04:45,635][36141] DAMAGECOUNT value on done: 1630648.0 [2023-02-25 15:04:45,635][36141] Sum rewards: 58.953, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.313', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.044', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'AMMO4': '0.196', 'WEAPON4': '0.350', 'weapon2': '0.372', 'weapon4': '0.646', 'WEAPON3': '1.150', 'weapon3': '2.660', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '51.000'} [2023-02-25 15:04:45,738][36141] DAMAGECOUNT value on done: 1642938.0 [2023-02-25 15:04:45,739][36141] Sum rewards: 52.197, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.750', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.057', 'weapon5': '0.170', 'AMMO3': '0.174', 'WEAPON5': '0.250', 'AMMO4': '0.283', 'WEAPON4': '0.400', 'weapon4': '0.564', 'weapon2': '0.672', 'WEAPON3': '1.100', 'weapon3': '2.304', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.376', 'FRAGCOUNT': '44.500'} [2023-02-25 15:04:45,956][36141] DAMAGECOUNT value on done: 1616367.0 [2023-02-25 15:04:45,956][36141] Sum rewards: 64.918, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.354', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.110', 'weapon5': '0.116', 'AMMO4': '0.140', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.404', 'WEAPON3': '1.250', 'weapon3': '3.142', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '55.000'} [2023-02-25 15:04:48,233][36138] Updated weights for policy 0, policy_version 58883 (0.0009) [2023-02-25 15:04:49,420][36157] DAMAGECOUNT value on done: 1652781.0 [2023-02-25 15:04:49,421][36157] Sum rewards: 58.818, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.874', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.035', 'AMMO3': '0.139', 'AMMO4': '0.173', 'WEAPON4': '0.400', 'weapon4': '0.614', 'weapon2': '0.738', 'WEAPON3': '0.850', 'weapon3': '2.480', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.016', 'FRAGCOUNT': '49.000'} [2023-02-25 15:04:49,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13448.5, 300 sec: 13371.0). Total num frames: 241201152. Throughput: 0: 3364.1. Samples: 22798678. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:04:49,729][36114] Avg episode reward: [(0, '61.309')] [2023-02-25 15:04:49,764][36157] DAMAGECOUNT value on done: 1635978.0 [2023-02-25 15:04:49,764][36157] Sum rewards: 69.828, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.789', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'weapon4': '0.262', 'weapon2': '0.316', 'WEAPON3': '1.200', 'weapon3': '3.180', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.247', 'FRAGCOUNT': '58.000'} [2023-02-25 15:04:50,360][36157] DAMAGECOUNT value on done: 1653965.0 [2023-02-25 15:04:50,361][36157] Sum rewards: 58.516, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.062', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.102', 'AMMO3': '0.118', 'weapon2': '0.170', 'weapon5': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'weapon4': '1.198', 'weapon3': '2.192', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '45.000'} [2023-02-25 15:04:50,593][36140] DAMAGECOUNT value on done: 1647434.0 [2023-02-25 15:04:50,593][36140] Sum rewards: 74.503, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.384', 'AMMO5': '0.014', 'AMMO2': '0.022', 'weapon5': '0.086', 'AMMO4': '0.112', 'AMMO3': '0.155', 'WEAPON5': '0.200', 'weapon4': '0.208', 'WEAPON4': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.000', 'weapon3': '3.150', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.547', 'FRAGCOUNT': '62.000'} [2023-02-25 15:04:50,674][36157] DAMAGECOUNT value on done: 1640284.0 [2023-02-25 15:04:50,675][36157] Sum rewards: 52.715, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.409', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.046', 'AMMO3': '0.184', 'weapon5': '0.186', 'AMMO4': '0.228', 'WEAPON5': '0.400', 'weapon4': '0.430', 'WEAPON4': '0.450', 'weapon2': '0.456', 'WEAPON3': '1.100', 'weapon3': '2.650', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.466', 'FRAGCOUNT': '45.500'} [2023-02-25 15:04:50,732][36140] DAMAGECOUNT value on done: 1638951.0 [2023-02-25 15:04:50,733][36140] Sum rewards: 53.422, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.396', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.143', 'weapon5': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.516', 'weapon2': '0.586', 'WEAPON3': '0.900', 'weapon3': '2.370', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.025', 'FRAGCOUNT': '44.000'} [2023-02-25 15:04:50,909][36140] DAMAGECOUNT value on done: 1622763.0 [2023-02-25 15:04:50,909][36140] Sum rewards: 55.291, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.368', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.092', 'AMMO4': '0.153', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon4': '0.438', 'weapon2': '0.512', 'WEAPON3': '1.000', 'weapon3': '2.642', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.470', 'FRAGCOUNT': '47.000'} [2023-02-25 15:04:51,052][36140] DAMAGECOUNT value on done: 1635710.0 [2023-02-25 15:04:51,053][36140] Sum rewards: 51.741, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.340', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon5': '0.108', 'AMMO3': '0.197', 'AMMO4': '0.242', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.408', 'weapon4': '0.622', 'WEAPON3': '1.100', 'weapon3': '2.446', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.758', 'FRAGCOUNT': '45.000'} [2023-02-25 15:04:51,329][36138] Updated weights for policy 0, policy_version 58893 (0.0009) [2023-02-25 15:04:54,298][36138] Updated weights for policy 0, policy_version 58903 (0.0009) [2023-02-25 15:04:54,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13384.9). Total num frames: 241270784. Throughput: 0: 3361.2. Samples: 22808678. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:04:54,730][36114] Avg episode reward: [(0, '61.262')] [2023-02-25 15:04:55,307][36142] DAMAGECOUNT value on done: 1632309.0 [2023-02-25 15:04:55,308][36142] Sum rewards: 69.012, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.130', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon2': '0.190', 'weapon5': '0.190', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.670', 'WEAPON3': '1.250', 'weapon3': '2.546', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '58.000'} [2023-02-25 15:04:55,608][36142] DAMAGECOUNT value on done: 1621813.0 [2023-02-25 15:04:55,608][36142] Sum rewards: 50.501, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.432', 'ARMOR': '0.008', 'AMMO5': '0.021', 'AMMO2': '0.060', 'AMMO3': '0.115', 'weapon2': '0.240', 'weapon5': '0.256', 'AMMO4': '0.302', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '0.850', 'weapon4': '0.882', 'weapon3': '1.988', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.350', 'FRAGCOUNT': '43.000'} [2023-02-25 15:04:56,255][36142] DAMAGECOUNT value on done: 1634653.0 [2023-02-25 15:04:56,255][36142] Sum rewards: 64.992, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.402', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon5': '0.118', 'AMMO3': '0.144', 'AMMO4': '0.219', 'weapon2': '0.320', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.560', 'WEAPON3': '0.950', 'weapon3': '2.696', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.427', 'FRAGCOUNT': '53.000'} [2023-02-25 15:04:56,553][36142] DAMAGECOUNT value on done: 1641479.0 [2023-02-25 15:04:56,553][36142] Sum rewards: 69.796, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.382', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.053', 'AMMO3': '0.207', 'weapon5': '0.218', 'AMMO4': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.464', 'weapon4': '0.510', 'WEAPON3': '1.200', 'weapon3': '2.498', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '58.000'} [2023-02-25 15:04:57,393][36138] Updated weights for policy 0, policy_version 58913 (0.0009) [2023-02-25 15:04:57,418][36156] DAMAGECOUNT value on done: 1652555.0 [2023-02-25 15:04:57,419][36156] Sum rewards: 44.536, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.416', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon5': '0.132', 'AMMO3': '0.152', 'AMMO4': '0.209', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.562', 'weapon2': '0.774', 'WEAPON3': '0.900', 'weapon3': '2.316', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.252', 'FRAGCOUNT': '37.000'} [2023-02-25 15:04:57,720][36156] DAMAGECOUNT value on done: 1629551.0 [2023-02-25 15:04:57,721][36156] Sum rewards: 61.963, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.410', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.023', 'weapon5': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.165', 'WEAPON4': '0.300', 'weapon4': '0.310', 'WEAPON5': '0.400', 'weapon2': '0.666', 'WEAPON3': '1.200', 'weapon3': '2.588', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '14.964', 'FRAGCOUNT': '53.000'} [2023-02-25 15:04:57,912][36156] DAMAGECOUNT value on done: 1647075.0 [2023-02-25 15:04:57,912][36156] Sum rewards: 61.476, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.940', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.056', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'weapon4': '0.192', 'AMMO3': '0.207', 'weapon2': '0.268', 'WEAPON3': '1.300', 'HITCOUNT': '3.150', 'weapon3': '3.272', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '51.000'} [2023-02-25 15:04:58,208][36156] DAMAGECOUNT value on done: 1635435.0 [2023-02-25 15:04:58,208][36156] Sum rewards: 62.491, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.962', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.008', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.136', 'weapon4': '0.136', 'weapon2': '0.650', 'WEAPON3': '0.900', 'weapon3': '3.062', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.225', 'FRAGCOUNT': '49.000'} [2023-02-25 15:04:59,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13371.0). Total num frames: 241336320. Throughput: 0: 3356.4. Samples: 22828668. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:04:59,730][36114] Avg episode reward: [(0, '61.347')] [2023-02-25 15:05:00,543][36138] Updated weights for policy 0, policy_version 58923 (0.0010) [2023-02-25 15:05:01,603][36139] DAMAGECOUNT value on done: 1641735.0 [2023-02-25 15:05:01,604][36139] Sum rewards: 59.928, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.943', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.138', 'AMMO4': '0.154', 'AMMO3': '0.177', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.340', 'weapon2': '0.456', 'WEAPON3': '1.100', 'weapon3': '2.822', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.519', 'FRAGCOUNT': '50.000'} [2023-02-25 15:05:01,917][36139] DAMAGECOUNT value on done: 1644245.0 [2023-02-25 15:05:01,918][36139] Sum rewards: 70.311, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.520', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.128', 'weapon4': '0.132', 'AMMO4': '0.148', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.200', 'weapon3': '3.162', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '59.000'} [2023-02-25 15:05:01,918][36155] DAMAGECOUNT value on done: 1631708.0 [2023-02-25 15:05:01,918][36155] Sum rewards: 47.817, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.896', 'AMMO5': '0.011', 'AMMO2': '0.033', 'AMMO3': '0.159', 'AMMO4': '0.164', 'weapon5': '0.168', 'weapon2': '0.192', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.806', 'WEAPON3': '0.950', 'weapon3': '2.618', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '12.861', 'FRAGCOUNT': '41.000'} [2023-02-25 15:05:02,231][36155] DAMAGECOUNT value on done: 1635249.0 [2023-02-25 15:05:02,231][36155] Sum rewards: 56.553, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.080', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.126', 'AMMO3': '0.156', 'AMMO4': '0.199', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON4': '0.500', 'weapon4': '0.896', 'WEAPON3': '0.950', 'weapon3': '2.230', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '14.811', 'FRAGCOUNT': '49.000'} [2023-02-25 15:05:02,491][36139] DAMAGECOUNT value on done: 1650112.0 [2023-02-25 15:05:02,491][36139] Sum rewards: 43.610, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-0.700', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon5': '0.178', 'AMMO3': '0.239', 'AMMO4': '0.255', 'WEAPON5': '0.350', 'weapon2': '0.378', 'WEAPON4': '0.450', 'weapon4': '0.542', 'WEAPON3': '1.250', 'weapon3': '2.536', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.801', 'FRAGCOUNT': '42.000'} [2023-02-25 15:05:02,793][36139] DAMAGECOUNT value on done: 1653685.0 [2023-02-25 15:05:02,794][36139] Sum rewards: 66.020, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.146', 'ARMOR': '0.016', 'AMMO5': '0.018', 'AMMO2': '0.044', 'AMMO3': '0.156', 'AMMO4': '0.219', 'weapon5': '0.266', 'WEAPON5': '0.400', 'weapon2': '0.446', 'WEAPON4': '0.550', 'weapon4': '0.716', 'WEAPON3': '1.000', 'weapon3': '2.288', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.257', 'FRAGCOUNT': '56.000'} [2023-02-25 15:05:03,141][36155] DAMAGECOUNT value on done: 1650492.0 [2023-02-25 15:05:03,142][36155] Sum rewards: 54.739, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.114', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.060', 'AMMO3': '0.127', 'AMMO4': '0.299', 'WEAPON5': '0.300', 'weapon5': '0.318', 'WEAPON4': '0.500', 'weapon2': '0.528', 'WEAPON3': '0.750', 'weapon4': '0.750', 'weapon3': '2.122', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.367', 'FRAGCOUNT': '45.000'} [2023-02-25 15:05:03,449][36155] DAMAGECOUNT value on done: 1638653.0 [2023-02-25 15:05:03,450][36155] Sum rewards: 64.791, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.112', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.140', 'weapon2': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.252', 'AMMO3': '0.271', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.070', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '56.500'} [2023-02-25 15:05:03,463][36154] DAMAGECOUNT value on done: 1645918.0 [2023-02-25 15:05:03,464][36154] Sum rewards: 73.471, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.520', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.042', 'AMMO4': '0.069', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'weapon2': '0.266', 'WEAPON3': '1.600', 'weapon3': '3.328', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '64.000'} [2023-02-25 15:05:03,671][36138] Updated weights for policy 0, policy_version 58933 (0.0009) [2023-02-25 15:05:03,770][36154] DAMAGECOUNT value on done: 1620501.0 [2023-02-25 15:05:03,770][36154] Sum rewards: 56.223, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.323', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO3': '0.169', 'AMMO4': '0.185', 'weapon5': '0.248', 'weapon2': '0.304', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.544', 'WEAPON3': '1.000', 'weapon3': '2.464', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '47.500'} [2023-02-25 15:05:04,204][36154] DAMAGECOUNT value on done: 1655409.0 [2023-02-25 15:05:04,205][36154] Sum rewards: 62.445, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.704', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO3': '0.114', 'weapon5': '0.118', 'AMMO4': '0.123', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.412', 'weapon4': '0.426', 'WEAPON3': '0.750', 'weapon3': '2.788', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.781', 'FRAGCOUNT': '49.000'} [2023-02-25 15:05:04,518][36154] DAMAGECOUNT value on done: 1632644.0 [2023-02-25 15:05:04,518][36154] Sum rewards: 52.571, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.900', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.058', 'weapon5': '0.146', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'weapon2': '0.284', 'AMMO4': '0.288', 'WEAPON4': '0.750', 'WEAPON3': '1.000', 'weapon4': '1.152', 'weapon3': '2.054', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '14.571', 'FRAGCOUNT': '47.000'} [2023-02-25 15:05:04,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13371.0). Total num frames: 241401856. Throughput: 0: 3347.1. Samples: 22848430. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:05:04,730][36114] Avg episode reward: [(0, '60.902')] [2023-02-25 15:05:05,642][36141] DAMAGECOUNT value on done: 1643644.0 [2023-02-25 15:05:05,643][36141] Sum rewards: 42.037, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.590', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO4': '0.122', 'AMMO3': '0.159', 'weapon5': '0.250', 'weapon2': '0.360', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.744', 'WEAPON3': '0.900', 'weapon3': '2.340', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '11.283', 'FRAGCOUNT': '38.000'} [2023-02-25 15:05:05,868][36141] DAMAGECOUNT value on done: 1635921.0 [2023-02-25 15:05:05,869][36141] Sum rewards: 55.364, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.274', 'ARMOR': '0.012', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon2': '0.234', 'weapon5': '0.238', 'AMMO3': '0.260', 'AMMO4': '0.274', 'weapon4': '0.334', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.816', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.819', 'FRAGCOUNT': '52.000'} [2023-02-25 15:05:05,989][36141] DAMAGECOUNT value on done: 1647472.0 [2023-02-25 15:05:05,990][36141] Sum rewards: 48.669, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.030', 'AMMO5': '0.020', 'AMMO2': '0.038', 'AMMO3': '0.176', 'AMMO4': '0.190', 'weapon5': '0.324', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.536', 'WEAPON3': '1.100', 'weapon3': '2.428', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.320', 'FRAGCOUNT': '42.500'} [2023-02-25 15:05:06,179][36141] DAMAGECOUNT value on done: 1621247.0 [2023-02-25 15:05:06,179][36141] Sum rewards: 49.454, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.450', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.051', 'AMMO3': '0.165', 'AMMO4': '0.253', 'weapon5': '0.330', 'weapon2': '0.410', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'weapon4': '0.996', 'WEAPON3': '1.050', 'weapon3': '1.872', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.640', 'FRAGCOUNT': '43.000'} [2023-02-25 15:05:06,727][36138] Updated weights for policy 0, policy_version 58943 (0.0009) [2023-02-25 15:05:08,564][36157] Large shaping reward 2.627 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.597, 199.0)] [2023-02-25 15:05:09,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13357.1). Total num frames: 241467392. Throughput: 0: 3344.9. Samples: 22858382. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:05:09,729][36114] Avg episode reward: [(0, '60.253')] [2023-02-25 15:05:09,802][36157] DAMAGECOUNT value on done: 1658072.0 [2023-02-25 15:05:09,803][36157] Sum rewards: 63.217, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.070', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.068', 'AMMO4': '0.156', 'AMMO3': '0.223', 'weapon2': '0.238', 'WEAPON5': '0.250', 'weapon4': '0.338', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.120', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.873', 'FRAGCOUNT': '56.000'} [2023-02-25 15:05:09,917][36138] Updated weights for policy 0, policy_version 58953 (0.0010) [2023-02-25 15:05:10,116][36157] DAMAGECOUNT value on done: 1640542.0 [2023-02-25 15:05:10,117][36157] Sum rewards: 47.199, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.449', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon5': '0.140', 'AMMO4': '0.212', 'AMMO3': '0.223', 'weapon4': '0.280', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.750', 'weapon3': '2.988', 'DAMAGECOUNT': '13.692', 'FRAGCOUNT': '44.000'} [2023-02-25 15:05:10,776][36157] DAMAGECOUNT value on done: 1659297.0 [2023-02-25 15:05:10,776][36157] Sum rewards: 52.429, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.906', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.210', 'AMMO4': '0.218', 'AMMO3': '0.243', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.428', 'weapon4': '0.574', 'WEAPON3': '1.350', 'weapon3': '2.284', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '46.500'} [2023-02-25 15:05:10,967][36140] DAMAGECOUNT value on done: 1652423.0 [2023-02-25 15:05:10,968][36140] Sum rewards: 57.066, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.050', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.052', 'AMMO3': '0.166', 'weapon5': '0.184', 'AMMO4': '0.262', 'WEAPON5': '0.300', 'weapon4': '0.426', 'weapon2': '0.460', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.644', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.967', 'FRAGCOUNT': '50.000'} [2023-02-25 15:05:11,103][36157] DAMAGECOUNT value on done: 1645036.0 [2023-02-25 15:05:11,104][36157] Sum rewards: 59.267, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.830', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.146', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'weapon2': '0.210', 'WEAPON4': '0.300', 'weapon4': '0.586', 'WEAPON3': '1.150', 'weapon3': '2.794', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.256', 'FRAGCOUNT': '51.500'} [2023-02-25 15:05:11,106][36140] DAMAGECOUNT value on done: 1643848.0 [2023-02-25 15:05:11,107][36140] Sum rewards: 56.600, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.332', 'AMMO2': '0.006', 'AMMO4': '0.031', 'AMMO3': '0.221', 'weapon2': '0.536', 'WEAPON3': '1.300', 'HITCOUNT': '3.080', 'weapon3': '3.316', 'DAMAGECOUNT': '14.691', 'FRAGCOUNT': '49.000'} [2023-02-25 15:05:11,299][36140] DAMAGECOUNT value on done: 1627655.0 [2023-02-25 15:05:11,300][36140] Sum rewards: 58.176, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.194', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'AMMO3': '0.199', 'weapon4': '0.286', 'weapon2': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.060', 'weapon3': '3.242', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '49.000'} [2023-02-25 15:05:11,425][36140] DAMAGECOUNT value on done: 1641674.0 [2023-02-25 15:05:11,425][36140] Sum rewards: 67.201, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.107', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.056', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon4': '0.312', 'weapon2': '0.392', 'WEAPON3': '1.400', 'weapon3': '2.946', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '57.000'} [2023-02-25 15:05:13,094][36138] Updated weights for policy 0, policy_version 58963 (0.0010) [2023-02-25 15:05:14,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13312.0, 300 sec: 13357.1). Total num frames: 241532928. Throughput: 0: 3322.1. Samples: 22877706. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:05:14,730][36114] Avg episode reward: [(0, '59.750')] [2023-02-25 15:05:15,777][36142] DAMAGECOUNT value on done: 1636516.0 [2023-02-25 15:05:15,777][36142] Sum rewards: 53.471, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.666', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.096', 'AMMO3': '0.147', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.284', 'weapon4': '0.824', 'WEAPON3': '0.950', 'weapon3': '2.478', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.621', 'FRAGCOUNT': '45.000'} [2023-02-25 15:05:16,095][36142] DAMAGECOUNT value on done: 1625117.0 [2023-02-25 15:05:16,096][36142] Sum rewards: 34.298, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.452', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.058', 'weapon7': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon2': '0.130', 'AMMO3': '0.138', 'AMMO4': '0.167', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.500', 'weapon4': '0.842', 'WEAPON3': '0.850', 'weapon3': '1.714', 'HITCOUNT': '2.180', 'DAMAGECOUNT': '9.912', 'FRAGCOUNT': '30.000'} [2023-02-25 15:05:16,297][36138] Updated weights for policy 0, policy_version 58973 (0.0010) [2023-02-25 15:05:16,709][36142] DAMAGECOUNT value on done: 1637860.0 [2023-02-25 15:05:16,709][36142] Sum rewards: 34.940, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.145', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon7': '0.088', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.126', 'AMMO4': '0.156', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON4': '0.400', 'weapon4': '0.554', 'WEAPON3': '0.650', 'weapon3': '1.734', 'HITCOUNT': '2.010', 'DAMAGECOUNT': '9.621', 'FRAGCOUNT': '30.000'} [2023-02-25 15:05:17,027][36142] DAMAGECOUNT value on done: 1646527.0 [2023-02-25 15:05:17,028][36142] Sum rewards: 60.312, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.620', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.140', 'AMMO3': '0.147', 'weapon2': '0.180', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.766', 'WEAPON3': '1.000', 'weapon3': '2.338', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.144', 'FRAGCOUNT': '51.000'} [2023-02-25 15:05:17,899][36156] DAMAGECOUNT value on done: 1656831.0 [2023-02-25 15:05:17,899][36156] Sum rewards: 54.085, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.084', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'WEAPON4': '0.250', 'weapon2': '0.378', 'ARMOR': '0.400', 'HEALTH': '0.662', 'weapon4': '0.766', 'WEAPON3': '0.800', 'weapon3': '2.426', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '12.828', 'FRAGCOUNT': '44.000'} [2023-02-25 15:05:18,200][36156] DAMAGECOUNT value on done: 1634345.0 [2023-02-25 15:05:18,201][36156] Sum rewards: 55.198, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.239', 'ARMOR': '0.004', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.040', 'AMMO3': '0.162', 'weapon5': '0.178', 'AMMO4': '0.198', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.522', 'weapon4': '0.734', 'WEAPON3': '1.100', 'weapon3': '2.262', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.382', 'FRAGCOUNT': '49.000'} [2023-02-25 15:05:18,363][36156] DAMAGECOUNT value on done: 1652697.0 [2023-02-25 15:05:18,363][36156] Sum rewards: 68.536, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.810', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.038', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.154', 'weapon2': '0.674', 'WEAPON3': '0.950', 'weapon3': '3.102', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '55.000'} [2023-02-25 15:05:18,700][36156] DAMAGECOUNT value on done: 1637878.0 [2023-02-25 15:05:18,700][36156] Sum rewards: 28.043, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.034', 'AMMO5': '0.005', 'AMMO2': '0.006', 'ARMOR': '0.012', 'AMMO4': '0.031', 'weapon7': '0.060', 'weapon5': '0.090', 'AMMO3': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon2': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.700', 'weapon4': '0.718', 'weapon3': '0.948', 'HITCOUNT': '1.560', 'DAMAGECOUNT': '7.329', 'FRAGCOUNT': '25.000'} [2023-02-25 15:05:19,450][36138] Updated weights for policy 0, policy_version 58983 (0.0010) [2023-02-25 15:05:19,729][36114] Fps is (10 sec: 12697.5, 60 sec: 13243.7, 300 sec: 13343.2). Total num frames: 241594368. Throughput: 0: 3306.2. Samples: 22897032. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:05:19,730][36114] Avg episode reward: [(0, '58.678')] [2023-02-25 15:05:19,764][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000058984_241598464.pth... [2023-02-25 15:05:19,821][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000058203_238399488.pth [2023-02-25 15:05:22,245][36139] DAMAGECOUNT value on done: 1647086.0 [2023-02-25 15:05:22,246][36139] Sum rewards: 63.569, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.000', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.142', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.210', 'weapon4': '0.592', 'WEAPON3': '1.200', 'weapon3': '2.920', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '53.000'} [2023-02-25 15:05:22,510][36138] Updated weights for policy 0, policy_version 58993 (0.0009) [2023-02-25 15:05:22,516][36155] DAMAGECOUNT value on done: 1637092.0 [2023-02-25 15:05:22,517][36155] Sum rewards: 63.111, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.468', 'AMMO5': '0.021', 'AMMO2': '0.051', 'AMMO3': '0.128', 'AMMO4': '0.255', 'weapon5': '0.322', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon4': '0.496', 'weapon2': '0.576', 'WEAPON3': '0.850', 'weapon3': '2.306', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '52.000'} [2023-02-25 15:05:22,571][36139] DAMAGECOUNT value on done: 1650541.0 [2023-02-25 15:05:22,571][36139] Sum rewards: 77.604, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.927', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.094', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.230', 'WEAPON4': '0.300', 'weapon4': '0.368', 'WEAPON3': '1.350', 'weapon3': '3.094', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '66.000'} [2023-02-25 15:05:22,837][36155] DAMAGECOUNT value on done: 1640479.0 [2023-02-25 15:05:22,838][36155] Sum rewards: 58.749, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.320', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.140', 'weapon4': '0.210', 'AMMO4': '0.212', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.040', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '52.000'} [2023-02-25 15:05:23,147][36139] DAMAGECOUNT value on done: 1655615.0 [2023-02-25 15:05:23,148][36139] Sum rewards: 61.923, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.920', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.051', 'weapon5': '0.146', 'AMMO3': '0.151', 'AMMO4': '0.257', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON4': '0.600', 'weapon4': '0.884', 'WEAPON3': '0.900', 'weapon3': '2.326', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '52.000'} [2023-02-25 15:05:23,458][36139] DAMAGECOUNT value on done: 1659168.0 [2023-02-25 15:05:23,458][36139] Sum rewards: 65.183, reward structure: {'DEATHCOUNT': '-10.500', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.052', 'AMMO3': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.216', 'WEAPON4': '0.300', 'HEALTH': '0.350', 'weapon4': '0.506', 'weapon2': '0.616', 'WEAPON3': '0.650', 'weapon3': '2.670', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '50.000'} [2023-02-25 15:05:23,757][36155] DAMAGECOUNT value on done: 1655726.0 [2023-02-25 15:05:23,758][36155] Sum rewards: 54.223, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.945', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.056', 'weapon5': '0.178', 'AMMO3': '0.211', 'weapon4': '0.224', 'AMMO4': '0.279', 'weapon2': '0.360', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.938', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '47.500'} [2023-02-25 15:05:24,071][36155] DAMAGECOUNT value on done: 1644033.0 [2023-02-25 15:05:24,071][36155] Sum rewards: 61.124, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.624', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.052', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.191', 'weapon2': '0.682', 'WEAPON3': '1.300', 'weapon3': '3.098', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.140', 'FRAGCOUNT': '50.500'} [2023-02-25 15:05:24,106][36154] DAMAGECOUNT value on done: 1651934.0 [2023-02-25 15:05:24,106][36154] Sum rewards: 69.321, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.804', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'AMMO3': '0.236', 'weapon2': '0.248', 'WEAPON4': '0.250', 'weapon4': '0.472', 'WEAPON3': '1.300', 'weapon3': '2.954', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '59.000'} [2023-02-25 15:05:24,417][36154] DAMAGECOUNT value on done: 1626053.0 [2023-02-25 15:05:24,418][36154] Sum rewards: 64.777, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.600', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.128', 'weapon2': '0.210', 'AMMO4': '0.216', 'AMMO3': '0.265', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.704', 'WEAPON3': '1.550', 'weapon3': '2.618', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '58.000'} [2023-02-25 15:05:24,729][36114] Fps is (10 sec: 13107.3, 60 sec: 13312.0, 300 sec: 13343.2). Total num frames: 241664000. Throughput: 0: 3304.8. Samples: 22907068. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:05:24,729][36114] Avg episode reward: [(0, '58.788')] [2023-02-25 15:05:24,862][36154] DAMAGECOUNT value on done: 1661000.0 [2023-02-25 15:05:24,862][36154] Sum rewards: 63.151, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.476', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.014', 'weapon5': '0.048', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon4': '0.264', 'weapon2': '0.420', 'WEAPON3': '1.500', 'weapon3': '3.086', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '54.000'} [2023-02-25 15:05:25,167][36154] DAMAGECOUNT value on done: 1638473.0 [2023-02-25 15:05:25,167][36154] Sum rewards: 64.154, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.344', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.130', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'weapon4': '0.334', 'weapon2': '0.352', 'WEAPON3': '1.500', 'weapon3': '2.870', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '56.000'} [2023-02-25 15:05:25,608][36138] Updated weights for policy 0, policy_version 59003 (0.0009) [2023-02-25 15:05:26,246][36141] DAMAGECOUNT value on done: 1648427.0 [2023-02-25 15:05:26,247][36141] Sum rewards: 56.242, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.257', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.096', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'weapon2': '0.182', 'WEAPON4': '0.250', 'weapon4': '0.444', 'ARMOR': '0.470', 'WEAPON3': '1.100', 'weapon3': '3.082', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.349', 'FRAGCOUNT': '47.000'} [2023-02-25 15:05:26,391][36141] DAMAGECOUNT value on done: 1641803.0 [2023-02-25 15:05:26,392][36141] Sum rewards: 70.571, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.707', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.056', 'weapon4': '0.136', 'AMMO4': '0.180', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.300', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '60.000'} [2023-02-25 15:05:26,553][36141] DAMAGECOUNT value on done: 1652948.0 [2023-02-25 15:05:26,553][36141] Sum rewards: 67.665, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.875', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.008', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.088', 'AMMO3': '0.209', 'weapon2': '0.514', 'WEAPON3': '1.400', 'weapon3': '3.026', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '16.428', 'FRAGCOUNT': '57.000'} [2023-02-25 15:05:26,698][36141] DAMAGECOUNT value on done: 1627045.0 [2023-02-25 15:05:26,698][36141] Sum rewards: 61.694, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.382', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.050', 'AMMO3': '0.162', 'weapon5': '0.232', 'AMMO4': '0.249', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.616', 'weapon4': '0.626', 'WEAPON3': '0.900', 'weapon3': '2.278', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '49.500'} [2023-02-25 15:05:28,612][36138] Updated weights for policy 0, policy_version 59013 (0.0009) [2023-02-25 15:05:29,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13243.7, 300 sec: 13343.2). Total num frames: 241729536. Throughput: 0: 3297.1. Samples: 22926948. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:05:29,729][36114] Avg episode reward: [(0, '58.762')] [2023-02-25 15:05:30,353][36157] DAMAGECOUNT value on done: 1662774.0 [2023-02-25 15:05:30,354][36157] Sum rewards: 49.791, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.242', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.096', 'AMMO4': '0.114', 'WEAPON5': '0.200', 'AMMO3': '0.251', 'weapon2': '0.364', 'WEAPON4': '0.500', 'weapon4': '0.766', 'WEAPON3': '1.400', 'weapon3': '2.374', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.106', 'FRAGCOUNT': '47.000'} [2023-02-25 15:05:30,671][36157] DAMAGECOUNT value on done: 1645781.0 [2023-02-25 15:05:30,672][36157] Sum rewards: 60.905, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.912', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.144', 'AMMO4': '0.155', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.412', 'weapon2': '0.480', 'WEAPON3': '1.400', 'weapon3': '2.622', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '15.672', 'FRAGCOUNT': '55.000'} [2023-02-25 15:05:31,287][36157] DAMAGECOUNT value on done: 1664528.0 [2023-02-25 15:05:31,288][36157] Sum rewards: 62.299, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.986', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.058', 'AMMO3': '0.177', 'weapon5': '0.216', 'weapon2': '0.254', 'AMMO4': '0.289', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon4': '0.618', 'WEAPON3': '1.100', 'weapon3': '2.562', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.693', 'FRAGCOUNT': '53.000'} [2023-02-25 15:05:31,527][36140] DAMAGECOUNT value on done: 1658865.0 [2023-02-25 15:05:31,528][36140] Sum rewards: 80.641, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.105', 'AMMO2': '0.005', 'AMMO4': '0.022', 'AMMO3': '0.209', 'weapon2': '0.554', 'WEAPON3': '1.150', 'weapon3': '3.310', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.326', 'FRAGCOUNT': '65.000'} [2023-02-25 15:05:31,605][36157] DAMAGECOUNT value on done: 1649914.0 [2023-02-25 15:05:31,606][36157] Sum rewards: 55.528, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.842', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon5': '0.188', 'AMMO3': '0.212', 'AMMO4': '0.247', 'weapon2': '0.314', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.454', 'WEAPON3': '1.150', 'weapon3': '2.744', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '14.634', 'FRAGCOUNT': '50.000'} [2023-02-25 15:05:31,630][36140] DAMAGECOUNT value on done: 1648856.0 [2023-02-25 15:05:31,631][36140] Sum rewards: 54.126, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.920', 'AMMO5': '0.018', 'AMMO2': '0.038', 'AMMO4': '0.191', 'AMMO3': '0.207', 'weapon5': '0.246', 'weapon2': '0.262', 'weapon4': '0.330', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.910', 'weapon3': '2.920', 'DAMAGECOUNT': '15.024', 'FRAGCOUNT': '48.000'} [2023-02-25 15:05:31,700][36138] Updated weights for policy 0, policy_version 59023 (0.0009) [2023-02-25 15:05:31,852][36140] DAMAGECOUNT value on done: 1633045.0 [2023-02-25 15:05:31,852][36140] Sum rewards: 60.820, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.524', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.146', 'AMMO3': '0.176', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.444', 'weapon4': '0.516', 'WEAPON3': '1.100', 'weapon3': '2.646', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '51.000'} [2023-02-25 15:05:31,952][36140] DAMAGECOUNT value on done: 1646937.0 [2023-02-25 15:05:31,952][36140] Sum rewards: 60.717, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.652', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.044', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'weapon2': '0.532', 'WEAPON3': '1.450', 'weapon3': '3.132', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '53.000'} [2023-02-25 15:05:32,008][36157] Large shaping reward -2.507 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.258, -86.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 15:05:34,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13312.0, 300 sec: 13343.2). Total num frames: 241799168. Throughput: 0: 3296.8. Samples: 22947036. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:05:34,729][36114] Avg episode reward: [(0, '58.714')] [2023-02-25 15:05:34,730][36138] Updated weights for policy 0, policy_version 59033 (0.0009) [2023-02-25 15:05:36,128][36142] DAMAGECOUNT value on done: 1642486.0 [2023-02-25 15:05:36,128][36142] Sum rewards: 75.986, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.180', 'AMMO2': '0.021', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'AMMO3': '0.228', 'weapon4': '0.248', 'weapon2': '0.312', 'WEAPON3': '1.350', 'weapon3': '3.242', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '65.000'} [2023-02-25 15:05:36,448][36142] DAMAGECOUNT value on done: 1631035.0 [2023-02-25 15:05:36,448][36142] Sum rewards: 74.432, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.815', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.068', 'weapon4': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.200', 'WEAPON3': '1.350', 'weapon3': '3.426', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.754', 'FRAGCOUNT': '63.000'} [2023-02-25 15:05:37,053][36142] DAMAGECOUNT value on done: 1643278.0 [2023-02-25 15:05:37,054][36142] Sum rewards: 65.604, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.790', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.204', 'weapon2': '0.206', 'AMMO3': '0.210', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.446', 'WEAPON3': '1.200', 'weapon3': '2.862', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.254', 'FRAGCOUNT': '57.000'} [2023-02-25 15:05:37,355][36142] DAMAGECOUNT value on done: 1651946.0 [2023-02-25 15:05:37,355][36142] Sum rewards: 60.086, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.690', 'AMMO5': '0.017', 'AMMO2': '0.047', 'AMMO3': '0.204', 'AMMO4': '0.236', 'weapon5': '0.244', 'WEAPON5': '0.450', 'weapon4': '0.460', 'weapon2': '0.486', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.484', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.257', 'FRAGCOUNT': '54.000'} [2023-02-25 15:05:37,802][36138] Updated weights for policy 0, policy_version 59043 (0.0009) [2023-02-25 15:05:38,102][36156] DAMAGECOUNT value on done: 1662762.0 [2023-02-25 15:05:38,103][36156] Sum rewards: 65.344, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.204', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.086', 'weapon5': '0.118', 'AMMO4': '0.124', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.400', 'weapon3': '3.224', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '56.000'} [2023-02-25 15:05:38,405][36156] DAMAGECOUNT value on done: 1639874.0 [2023-02-25 15:05:38,405][36156] Sum rewards: 66.202, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.410', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon4': '0.402', 'weapon2': '0.410', 'WEAPON3': '1.350', 'weapon3': '2.680', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '58.000'} [2023-02-25 15:05:38,578][36156] DAMAGECOUNT value on done: 1658359.0 [2023-02-25 15:05:38,578][36156] Sum rewards: 70.882, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.317', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.022', 'AMMO4': '0.109', 'AMMO3': '0.154', 'weapon5': '0.172', 'weapon2': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.700', 'WEAPON3': '1.100', 'weapon3': '2.624', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '59.000'} [2023-02-25 15:05:38,887][36156] DAMAGECOUNT value on done: 1644200.0 [2023-02-25 15:05:38,888][36156] Sum rewards: 76.021, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.051', 'AMMO5': '0.014', 'AMMO2': '0.028', 'weapon5': '0.132', 'AMMO4': '0.139', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'weapon2': '0.260', 'WEAPON4': '0.400', 'ARMOR': '0.467', 'weapon4': '0.782', 'WEAPON3': '1.250', 'weapon3': '2.524', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '63.000'} [2023-02-25 15:05:39,729][36114] Fps is (10 sec: 13516.4, 60 sec: 13243.7, 300 sec: 13343.2). Total num frames: 241864704. Throughput: 0: 3297.8. Samples: 22957082. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:05:39,730][36114] Avg episode reward: [(0, '59.569')] [2023-02-25 15:05:40,858][36138] Updated weights for policy 0, policy_version 59053 (0.0010) [2023-02-25 15:05:42,328][36139] DAMAGECOUNT value on done: 1652440.0 [2023-02-25 15:05:42,328][36139] Sum rewards: 62.946, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.750', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.025', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.130', 'AMMO3': '0.262', 'WEAPON3': '1.550', 'HITCOUNT': '3.400', 'weapon3': '3.602', 'DAMAGECOUNT': '16.062', 'FRAGCOUNT': '56.000'} [2023-02-25 15:05:42,492][36155] DAMAGECOUNT value on done: 1642573.0 [2023-02-25 15:05:42,492][36155] Sum rewards: 66.578, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.438', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.138', 'weapon2': '0.144', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.784', 'WEAPON3': '1.250', 'weapon3': '2.654', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '56.000'} [2023-02-25 15:05:42,631][36139] DAMAGECOUNT value on done: 1655323.0 [2023-02-25 15:05:42,632][36139] Sum rewards: 49.695, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.511', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.052', 'weapon4': '0.152', 'weapon5': '0.208', 'AMMO3': '0.219', 'AMMO4': '0.259', 'weapon2': '0.288', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.930', 'weapon3': '3.034', 'DAMAGECOUNT': '14.346', 'FRAGCOUNT': '46.000'} [2023-02-25 15:05:42,802][36155] DAMAGECOUNT value on done: 1645694.0 [2023-02-25 15:05:42,803][36155] Sum rewards: 57.498, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.822', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.263', 'weapon2': '0.296', 'weapon4': '0.306', 'WEAPON3': '1.550', 'weapon3': '3.058', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.645', 'FRAGCOUNT': '51.000'} [2023-02-25 15:05:43,195][36139] DAMAGECOUNT value on done: 1660155.0 [2023-02-25 15:05:43,195][36139] Sum rewards: 48.645, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.456', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.160', 'weapon5': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.434', 'weapon2': '0.440', 'WEAPON3': '0.950', 'weapon3': '2.602', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.620', 'FRAGCOUNT': '41.000'} [2023-02-25 15:05:43,497][36139] DAMAGECOUNT value on done: 1663600.0 [2023-02-25 15:05:43,498][36139] Sum rewards: 46.918, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.777', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.032', 'AMMO4': '0.162', 'weapon5': '0.228', 'AMMO3': '0.236', 'weapon4': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.696', 'WEAPON3': '1.450', 'weapon3': '2.462', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.296', 'FRAGCOUNT': '45.500'} [2023-02-25 15:05:43,712][36155] DAMAGECOUNT value on done: 1661909.0 [2023-02-25 15:05:43,712][36155] Sum rewards: 72.320, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.070', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.272', 'weapon4': '0.302', 'WEAPON3': '1.350', 'weapon3': '3.088', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '62.000'} [2023-02-25 15:05:43,713][36154] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 15:05:43,908][36138] Updated weights for policy 0, policy_version 59063 (0.0009) [2023-02-25 15:05:44,018][36155] DAMAGECOUNT value on done: 1649277.0 [2023-02-25 15:05:44,019][36155] Sum rewards: 59.514, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.540', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.050', 'weapon5': '0.066', 'AMMO4': '0.126', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.261', 'weapon2': '0.304', 'WEAPON3': '1.550', 'HITCOUNT': '3.100', 'weapon3': '3.308', 'DAMAGECOUNT': '15.252', 'FRAGCOUNT': '54.000'} [2023-02-25 15:05:44,117][36154] DAMAGECOUNT value on done: 1656858.0 [2023-02-25 15:05:44,118][36154] Sum rewards: 51.120, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.200', 'AMMO5': '0.022', 'AMMO2': '0.066', 'AMMO3': '0.218', 'weapon5': '0.250', 'AMMO4': '0.329', 'weapon2': '0.418', 'ARMOR': '0.459', 'WEAPON5': '0.600', 'weapon4': '0.644', 'WEAPON4': '0.800', 'WEAPON3': '1.250', 'weapon3': '2.332', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.772', 'FRAGCOUNT': '46.500'} [2023-02-25 15:05:44,425][36154] DAMAGECOUNT value on done: 1631318.0 [2023-02-25 15:05:44,426][36154] Sum rewards: 66.788, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.430', 'AMMO5': '0.003', 'AMMO2': '0.039', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO3': '0.169', 'AMMO4': '0.196', 'WEAPON4': '0.250', 'ARMOR': '0.456', 'weapon2': '0.618', 'weapon4': '0.788', 'WEAPON3': '0.950', 'weapon3': '2.254', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '55.000'} [2023-02-25 15:05:44,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13243.7, 300 sec: 13343.2). Total num frames: 241930240. Throughput: 0: 3304.4. Samples: 22977368. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:05:44,730][36114] Avg episode reward: [(0, '59.327')] [2023-02-25 15:05:44,852][36154] DAMAGECOUNT value on done: 1666784.0 [2023-02-25 15:05:44,853][36154] Sum rewards: 55.852, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.396', 'AMMO5': '0.020', 'AMMO2': '0.060', 'AMMO3': '0.233', 'weapon5': '0.300', 'AMMO4': '0.300', 'weapon2': '0.418', 'weapon4': '0.428', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.446', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.352', 'FRAGCOUNT': '51.000'} [2023-02-25 15:05:45,169][36154] DAMAGECOUNT value on done: 1643071.0 [2023-02-25 15:05:45,170][36154] Sum rewards: 47.156, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.655', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.188', 'AMMO3': '0.242', 'AMMO4': '0.242', 'WEAPON5': '0.300', 'weapon4': '0.342', 'WEAPON4': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.450', 'weapon3': '2.742', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.794', 'FRAGCOUNT': '44.000'} [2023-02-25 15:05:46,091][36141] DAMAGECOUNT value on done: 1653175.0 [2023-02-25 15:05:46,092][36141] Sum rewards: 59.482, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.220', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.064', 'AMMO4': '0.105', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.318', 'weapon2': '0.694', 'WEAPON3': '1.050', 'weapon3': '2.708', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.244', 'FRAGCOUNT': '51.000'} [2023-02-25 15:05:46,230][36141] DAMAGECOUNT value on done: 1647200.0 [2023-02-25 15:05:46,231][36141] Sum rewards: 61.414, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.980', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.058', 'AMMO4': '0.117', 'weapon4': '0.120', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.257', 'weapon2': '0.290', 'WEAPON3': '1.600', 'HITCOUNT': '3.260', 'weapon3': '3.270', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '56.000'} [2023-02-25 15:05:46,404][36141] DAMAGECOUNT value on done: 1657999.0 [2023-02-25 15:05:46,404][36141] Sum rewards: 53.223, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.060', 'AMMO5': '0.019', 'AMMO2': '0.052', 'AMMO3': '0.149', 'AMMO4': '0.260', 'weapon4': '0.364', 'weapon5': '0.364', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.494', 'WEAPON3': '0.900', 'weapon3': '2.448', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.153', 'FRAGCOUNT': '43.000'} [2023-02-25 15:05:46,552][36141] DAMAGECOUNT value on done: 1631543.0 [2023-02-25 15:05:46,552][36141] Sum rewards: 52.775, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.947', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon5': '0.056', 'AMMO4': '0.114', 'weapon2': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon4': '0.492', 'WEAPON3': '1.200', 'HITCOUNT': '2.760', 'weapon3': '3.008', 'DAMAGECOUNT': '13.494', 'FRAGCOUNT': '46.000'} [2023-02-25 15:05:46,976][36138] Updated weights for policy 0, policy_version 59073 (0.0009) [2023-02-25 15:05:49,729][36114] Fps is (10 sec: 13517.1, 60 sec: 13312.0, 300 sec: 13343.2). Total num frames: 241999872. Throughput: 0: 3314.8. Samples: 22997598. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:05:49,730][36114] Avg episode reward: [(0, '59.199')] [2023-02-25 15:05:49,993][36138] Updated weights for policy 0, policy_version 59083 (0.0009) [2023-02-25 15:05:50,386][36157] DAMAGECOUNT value on done: 1668616.0 [2023-02-25 15:05:50,387][36157] Sum rewards: 68.788, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.702', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.149', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'weapon5': '0.206', 'weapon2': '0.220', 'WEAPON4': '0.300', 'weapon4': '0.350', 'WEAPON3': '1.250', 'weapon3': '2.936', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '59.000'} [2023-02-25 15:05:50,690][36157] DAMAGECOUNT value on done: 1650424.0 [2023-02-25 15:05:50,691][36157] Sum rewards: 54.457, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.136', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.040', 'weapon5': '0.088', 'AMMO3': '0.194', 'AMMO4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.308', 'WEAPON4': '0.400', 'weapon2': '0.770', 'WEAPON3': '1.150', 'weapon3': '2.600', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.929', 'FRAGCOUNT': '48.000'} [2023-02-25 15:05:51,296][36157] DAMAGECOUNT value on done: 1670183.0 [2023-02-25 15:05:51,297][36157] Sum rewards: 65.989, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.020', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.044', 'WEAPON4': '0.100', 'weapon4': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon2': '0.420', 'WEAPON3': '1.250', 'weapon3': '3.174', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '54.000'} [2023-02-25 15:05:51,420][36140] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 15:05:51,516][36140] DAMAGECOUNT value on done: 1664800.0 [2023-02-25 15:05:51,517][36140] Sum rewards: 70.607, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.600', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.052', 'weapon4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'AMMO3': '0.258', 'weapon2': '0.324', 'WEAPON3': '1.650', 'weapon3': '3.360', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '61.000'} [2023-02-25 15:05:51,610][36157] DAMAGECOUNT value on done: 1654723.0 [2023-02-25 15:05:51,611][36157] Sum rewards: 51.165, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.228', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.067', 'AMMO3': '0.182', 'weapon2': '0.192', 'AMMO4': '0.333', 'weapon5': '0.380', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'weapon4': '0.900', 'WEAPON3': '1.050', 'weapon3': '2.024', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.427', 'FRAGCOUNT': '44.500'} [2023-02-25 15:05:51,625][36140] DAMAGECOUNT value on done: 1653647.0 [2023-02-25 15:05:51,625][36140] Sum rewards: 51.355, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.174', 'AMMO5': '0.017', 'AMMO2': '0.035', 'AMMO4': '0.177', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'weapon2': '0.320', 'weapon5': '0.362', 'weapon4': '0.388', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.518', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.373', 'FRAGCOUNT': '46.500'} [2023-02-25 15:05:51,832][36140] DAMAGECOUNT value on done: 1637995.0 [2023-02-25 15:05:51,832][36140] Sum rewards: 57.952, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.378', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.059', 'weapon5': '0.140', 'AMMO3': '0.152', 'AMMO4': '0.294', 'WEAPON5': '0.450', 'weapon4': '0.532', 'weapon2': '0.556', 'WEAPON4': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.442', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.850', 'FRAGCOUNT': '51.000'} [2023-02-25 15:05:51,928][36140] DAMAGECOUNT value on done: 1652414.0 [2023-02-25 15:05:51,929][36140] Sum rewards: 63.386, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.629', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.165', 'AMMO4': '0.169', 'weapon5': '0.188', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON4': '0.350', 'ARMOR': '0.404', 'weapon4': '0.650', 'WEAPON3': '0.900', 'weapon3': '2.578', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.329', 'FRAGCOUNT': '52.000'} [2023-02-25 15:05:53,030][36138] Updated weights for policy 0, policy_version 59093 (0.0009) [2023-02-25 15:05:54,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13243.7, 300 sec: 13329.4). Total num frames: 242065408. Throughput: 0: 3317.5. Samples: 23007668. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:05:54,730][36114] Avg episode reward: [(0, '59.100')] [2023-02-25 15:05:56,043][36138] Updated weights for policy 0, policy_version 59103 (0.0009) [2023-02-25 15:05:56,100][36142] DAMAGECOUNT value on done: 1648613.0 [2023-02-25 15:05:56,100][36142] Sum rewards: 70.779, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.248', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon5': '0.072', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.156', 'AMMO3': '0.218', 'weapon2': '0.542', 'WEAPON3': '1.250', 'weapon3': '3.014', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '59.000'} [2023-02-25 15:05:56,410][36142] DAMAGECOUNT value on done: 1636965.0 [2023-02-25 15:05:56,410][36142] Sum rewards: 57.713, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.958', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.048', 'AMMO4': '0.242', 'AMMO3': '0.252', 'weapon5': '0.262', 'WEAPON5': '0.300', 'weapon2': '0.364', 'weapon4': '0.392', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.624', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '52.000'} [2023-02-25 15:05:57,011][36142] DAMAGECOUNT value on done: 1648128.0 [2023-02-25 15:05:57,011][36142] Sum rewards: 56.446, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.220', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon5': '0.048', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'weapon4': '0.340', 'weapon2': '0.466', 'WEAPON3': '1.400', 'weapon3': '2.866', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.385', 'FRAGCOUNT': '50.000'} [2023-02-25 15:05:57,318][36142] DAMAGECOUNT value on done: 1656878.0 [2023-02-25 15:05:57,318][36142] Sum rewards: 56.196, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.522', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon4': '0.168', 'weapon5': '0.198', 'AMMO3': '0.221', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.532', 'WEAPON3': '1.350', 'HITCOUNT': '2.760', 'weapon3': '2.798', 'DAMAGECOUNT': '14.796', 'FRAGCOUNT': '50.000'} [2023-02-25 15:05:58,162][36156] DAMAGECOUNT value on done: 1668104.0 [2023-02-25 15:05:58,162][36156] Sum rewards: 71.086, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.015', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.052', 'weapon4': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'weapon2': '0.522', 'WEAPON3': '1.300', 'weapon3': '3.204', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.026', 'FRAGCOUNT': '61.000'} [2023-02-25 15:05:58,475][36156] DAMAGECOUNT value on done: 1645360.0 [2023-02-25 15:05:58,476][36156] Sum rewards: 64.421, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.390', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.198', 'WEAPON4': '0.200', 'AMMO3': '0.244', 'WEAPON5': '0.300', 'weapon4': '0.346', 'weapon2': '0.524', 'WEAPON3': '1.400', 'weapon3': '2.594', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '58.000'} [2023-02-25 15:05:58,613][36156] DAMAGECOUNT value on done: 1663675.0 [2023-02-25 15:05:58,614][36156] Sum rewards: 54.196, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.475', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.160', 'AMMO4': '0.198', 'weapon2': '0.244', 'AMMO3': '0.267', 'weapon4': '0.270', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.032', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.948', 'FRAGCOUNT': '50.000'} [2023-02-25 15:05:58,923][36156] DAMAGECOUNT value on done: 1648829.0 [2023-02-25 15:05:58,924][36156] Sum rewards: 56.841, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.508', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.154', 'WEAPON4': '0.300', 'ARMOR': '0.455', 'weapon2': '0.556', 'weapon4': '0.776', 'WEAPON3': '1.000', 'weapon3': '2.390', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '13.887', 'FRAGCOUNT': '48.000'} [2023-02-25 15:05:59,055][36138] Updated weights for policy 0, policy_version 59113 (0.0009) [2023-02-25 15:05:59,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13312.0, 300 sec: 13343.2). Total num frames: 242135040. Throughput: 0: 3338.9. Samples: 23027958. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:05:59,730][36114] Avg episode reward: [(0, '59.303')] [2023-02-25 15:06:02,068][36138] Updated weights for policy 0, policy_version 59123 (0.0009) [2023-02-25 15:06:02,081][36139] DAMAGECOUNT value on done: 1657891.0 [2023-02-25 15:06:02,082][36139] Sum rewards: 67.394, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.580', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'weapon4': '0.240', 'weapon2': '0.846', 'WEAPON3': '0.900', 'weapon3': '2.746', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '55.000'} [2023-02-25 15:06:02,348][36155] DAMAGECOUNT value on done: 1648609.0 [2023-02-25 15:06:02,349][36155] Sum rewards: 72.841, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.916', 'ARMOR': '0.004', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.025', 'weapon5': '0.090', 'weapon2': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.258', 'weapon4': '0.296', 'WEAPON3': '1.550', 'weapon3': '3.160', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '63.000'} [2023-02-25 15:06:02,399][36139] DAMAGECOUNT value on done: 1659762.0 [2023-02-25 15:06:02,399][36139] Sum rewards: 56.908, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.166', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'weapon4': '0.180', 'weapon2': '0.536', 'WEAPON3': '1.150', 'HITCOUNT': '2.810', 'weapon3': '3.066', 'DAMAGECOUNT': '13.317', 'FRAGCOUNT': '48.000'} [2023-02-25 15:06:02,645][36155] DAMAGECOUNT value on done: 1650092.0 [2023-02-25 15:06:02,646][36155] Sum rewards: 47.742, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.902', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.044', 'AMMO3': '0.179', 'AMMO4': '0.220', 'weapon4': '0.266', 'weapon5': '0.304', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.638', 'WEAPON3': '1.150', 'weapon3': '2.334', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '13.194', 'FRAGCOUNT': '43.000'} [2023-02-25 15:06:02,949][36139] DAMAGECOUNT value on done: 1664071.0 [2023-02-25 15:06:02,949][36139] Sum rewards: 47.686, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.390', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon4': '0.340', 'weapon2': '0.458', 'WEAPON3': '1.300', 'HITCOUNT': '2.760', 'weapon3': '2.872', 'DAMAGECOUNT': '11.748', 'FRAGCOUNT': '43.000'} [2023-02-25 15:06:03,262][36139] DAMAGECOUNT value on done: 1668085.0 [2023-02-25 15:06:03,263][36139] Sum rewards: 52.992, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.408', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.157', 'AMMO3': '0.190', 'weapon5': '0.198', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.388', 'weapon2': '0.554', 'WEAPON3': '1.150', 'weapon3': '2.516', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '13.455', 'FRAGCOUNT': '46.000'} [2023-02-25 15:06:03,572][36155] DAMAGECOUNT value on done: 1667342.0 [2023-02-25 15:06:03,572][36155] Sum rewards: 72.826, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.115', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO3': '0.165', 'weapon2': '0.346', 'WEAPON3': '1.050', 'HITCOUNT': '3.340', 'weapon3': '3.498', 'DAMAGECOUNT': '16.299', 'FRAGCOUNT': '59.000'} [2023-02-25 15:06:03,900][36155] DAMAGECOUNT value on done: 1653633.0 [2023-02-25 15:06:03,900][36155] Sum rewards: 50.099, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.610', 'ARMOR': '0.012', 'AMMO5': '0.022', 'AMMO2': '0.047', 'AMMO3': '0.200', 'AMMO4': '0.236', 'weapon5': '0.250', 'weapon2': '0.408', 'weapon4': '0.464', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.282', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '13.068', 'FRAGCOUNT': '47.000'} [2023-02-25 15:06:04,019][36154] DAMAGECOUNT value on done: 1660814.0 [2023-02-25 15:06:04,020][36154] Sum rewards: 50.627, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.462', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.044', 'AMMO3': '0.190', 'weapon5': '0.192', 'AMMO4': '0.219', 'WEAPON5': '0.300', 'weapon4': '0.314', 'WEAPON4': '0.450', 'weapon2': '0.588', 'WEAPON3': '1.100', 'weapon3': '2.620', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '11.868', 'FRAGCOUNT': '48.000'} [2023-02-25 15:06:04,320][36154] DAMAGECOUNT value on done: 1636970.0 [2023-02-25 15:06:04,320][36154] Sum rewards: 56.459, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-4.302', 'ARMOR': '0.016', 'AMMO5': '0.017', 'AMMO2': '0.056', 'weapon2': '0.238', 'AMMO3': '0.261', 'weapon5': '0.272', 'AMMO4': '0.282', 'WEAPON5': '0.500', 'weapon4': '0.638', 'WEAPON4': '0.750', 'WEAPON3': '1.550', 'weapon3': '2.454', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '53.000'} [2023-02-25 15:06:04,729][36114] Fps is (10 sec: 13516.9, 60 sec: 13312.0, 300 sec: 13343.2). Total num frames: 242200576. Throughput: 0: 3361.0. Samples: 23048276. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:06:04,729][36114] Avg episode reward: [(0, '59.311')] [2023-02-25 15:06:04,736][36154] DAMAGECOUNT value on done: 1671906.0 [2023-02-25 15:06:04,736][36154] Sum rewards: 57.421, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.481', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon2': '0.318', 'weapon4': '0.392', 'WEAPON3': '1.300', 'weapon3': '2.886', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.366', 'FRAGCOUNT': '49.000'} [2023-02-25 15:06:05,037][36154] DAMAGECOUNT value on done: 1648332.0 [2023-02-25 15:06:05,038][36154] Sum rewards: 60.952, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.216', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.067', 'weapon5': '0.132', 'AMMO3': '0.157', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.356', 'weapon4': '0.590', 'WEAPON3': '1.000', 'weapon3': '2.638', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.783', 'FRAGCOUNT': '48.000'} [2023-02-25 15:06:05,120][36138] Updated weights for policy 0, policy_version 59133 (0.0009) [2023-02-25 15:06:06,020][36141] DAMAGECOUNT value on done: 1658043.0 [2023-02-25 15:06:06,020][36141] Sum rewards: 58.226, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.245', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'weapon4': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'weapon2': '0.646', 'WEAPON3': '1.250', 'weapon3': '2.938', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.604', 'FRAGCOUNT': '50.000'} [2023-02-25 15:06:06,229][36141] DAMAGECOUNT value on done: 1652284.0 [2023-02-25 15:06:06,230][36141] Sum rewards: 58.828, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.494', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon5': '0.080', 'weapon4': '0.096', 'AMMO4': '0.220', 'AMMO3': '0.242', 'WEAPON5': '0.350', 'weapon2': '0.394', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '3.000', 'weapon3': '3.174', 'DAMAGECOUNT': '15.252', 'FRAGCOUNT': '54.000'} [2023-02-25 15:06:06,335][36141] DAMAGECOUNT value on done: 1663812.0 [2023-02-25 15:06:06,335][36141] Sum rewards: 61.244, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.220', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.061', 'AMMO3': '0.211', 'weapon5': '0.280', 'weapon2': '0.304', 'AMMO4': '0.306', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'weapon4': '0.672', 'WEAPON3': '1.350', 'weapon3': '2.372', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '55.000'} [2023-02-25 15:06:06,540][36141] DAMAGECOUNT value on done: 1637057.0 [2023-02-25 15:06:06,540][36141] Sum rewards: 65.611, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.320', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'weapon2': '0.374', 'weapon4': '0.824', 'WEAPON3': '1.200', 'weapon3': '2.344', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '16.542', 'FRAGCOUNT': '56.000'} [2023-02-25 15:06:08,150][36138] Updated weights for policy 0, policy_version 59143 (0.0009) [2023-02-25 15:06:09,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13343.2). Total num frames: 242270208. Throughput: 0: 3362.7. Samples: 23058390. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:06:09,730][36114] Avg episode reward: [(0, '59.292')] [2023-02-25 15:06:10,344][36157] DAMAGECOUNT value on done: 1673523.0 [2023-02-25 15:06:10,345][36157] Sum rewards: 60.677, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.100', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.134', 'weapon5': '0.134', 'AMMO4': '0.150', 'AMMO3': '0.178', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.050', 'HITCOUNT': '2.810', 'weapon3': '3.062', 'DAMAGECOUNT': '14.721', 'FRAGCOUNT': '52.000'} [2023-02-25 15:06:10,636][36157] DAMAGECOUNT value on done: 1655783.0 [2023-02-25 15:06:10,636][36157] Sum rewards: 67.097, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.160', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'weapon2': '0.308', 'weapon4': '0.486', 'WEAPON3': '1.150', 'weapon3': '2.910', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.077', 'FRAGCOUNT': '57.000'} [2023-02-25 15:06:11,192][36138] Updated weights for policy 0, policy_version 59153 (0.0009) [2023-02-25 15:06:11,253][36157] DAMAGECOUNT value on done: 1675739.0 [2023-02-25 15:06:11,254][36157] Sum rewards: 66.037, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.654', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.124', 'AMMO4': '0.126', 'weapon4': '0.128', 'AMMO3': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.380', 'WEAPON3': '1.200', 'weapon3': '3.126', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '57.000'} [2023-02-25 15:06:11,379][36140] DAMAGECOUNT value on done: 1669447.0 [2023-02-25 15:06:11,379][36140] Sum rewards: 53.098, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.060', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.032', 'weapon7': '0.036', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.159', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.285', 'weapon2': '0.292', 'weapon4': '0.568', 'WEAPON3': '1.600', 'weapon3': '2.776', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.941', 'FRAGCOUNT': '49.000'} [2023-02-25 15:06:11,504][36140] DAMAGECOUNT value on done: 1658726.0 [2023-02-25 15:06:11,505][36140] Sum rewards: 52.010, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.060', 'AMMO5': '0.020', 'AMMO2': '0.044', 'AMMO3': '0.122', 'AMMO4': '0.222', 'weapon5': '0.274', 'weapon2': '0.472', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '0.750', 'weapon4': '0.764', 'weapon3': '2.144', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.237', 'FRAGCOUNT': '43.000'} [2023-02-25 15:06:11,577][36157] DAMAGECOUNT value on done: 1659852.0 [2023-02-25 15:06:11,578][36157] Sum rewards: 63.374, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.820', 'AMMO5': '0.010', 'AMMO2': '0.049', 'AMMO3': '0.164', 'weapon5': '0.164', 'weapon4': '0.220', 'AMMO4': '0.247', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'weapon3': '2.974', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.387', 'FRAGCOUNT': '54.000'} [2023-02-25 15:06:11,717][36140] DAMAGECOUNT value on done: 1643563.0 [2023-02-25 15:06:11,717][36140] Sum rewards: 65.203, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.395', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.138', 'AMMO3': '0.226', 'weapon2': '0.228', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.422', 'WEAPON3': '1.300', 'weapon3': '2.816', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.704', 'FRAGCOUNT': '57.000'} [2023-02-25 15:06:11,831][36140] DAMAGECOUNT value on done: 1657520.0 [2023-02-25 15:06:11,832][36140] Sum rewards: 55.836, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.890', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.050', 'AMMO3': '0.180', 'weapon5': '0.182', 'AMMO4': '0.251', 'weapon2': '0.256', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.780', 'WEAPON3': '1.100', 'weapon3': '2.496', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.273', 'FRAGCOUNT': '50.000'} [2023-02-25 15:06:14,302][36138] Updated weights for policy 0, policy_version 59163 (0.0010) [2023-02-25 15:06:14,729][36114] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13343.2). Total num frames: 242335744. Throughput: 0: 3367.3. Samples: 23078478. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:06:14,730][36114] Avg episode reward: [(0, '59.971')] [2023-02-25 15:06:16,021][36142] DAMAGECOUNT value on done: 1653316.0 [2023-02-25 15:06:16,022][36142] Sum rewards: 50.788, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.740', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.213', 'weapon2': '0.216', 'weapon5': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.422', 'WEAPON3': '1.300', 'weapon3': '2.788', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '14.109', 'FRAGCOUNT': '45.500'} [2023-02-25 15:06:16,337][36142] DAMAGECOUNT value on done: 1642757.0 [2023-02-25 15:06:16,338][36142] Sum rewards: 67.778, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.659', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon2': '0.190', 'weapon5': '0.192', 'AMMO4': '0.218', 'AMMO3': '0.259', 'weapon4': '0.388', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.924', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '63.000'} [2023-02-25 15:06:16,948][36142] DAMAGECOUNT value on done: 1652715.0 [2023-02-25 15:06:16,948][36142] Sum rewards: 45.200, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.000', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.114', 'weapon4': '0.188', 'AMMO4': '0.198', 'WEAPON5': '0.250', 'AMMO3': '0.270', 'weapon2': '0.334', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '2.820', 'weapon3': '3.016', 'DAMAGECOUNT': '13.761', 'FRAGCOUNT': '43.000'} [2023-02-25 15:06:17,256][36142] DAMAGECOUNT value on done: 1662404.0 [2023-02-25 15:06:17,257][36142] Sum rewards: 64.078, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.446', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'weapon2': '0.156', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'weapon4': '0.474', 'WEAPON3': '1.450', 'weapon3': '2.982', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '56.000'} [2023-02-25 15:06:17,393][36138] Updated weights for policy 0, policy_version 59173 (0.0010) [2023-02-25 15:06:18,214][36156] DAMAGECOUNT value on done: 1673450.0 [2023-02-25 15:06:18,215][36156] Sum rewards: 60.935, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.462', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.166', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON4': '0.350', 'weapon4': '0.464', 'WEAPON3': '1.100', 'weapon3': '2.796', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '53.000'} [2023-02-25 15:06:18,516][36156] DAMAGECOUNT value on done: 1650245.0 [2023-02-25 15:06:18,516][36156] Sum rewards: 55.614, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.480', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.102', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.269', 'weapon4': '0.298', 'weapon2': '0.356', 'WEAPON3': '1.550', 'weapon3': '2.844', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.655', 'FRAGCOUNT': '50.000'} [2023-02-25 15:06:18,678][36156] DAMAGECOUNT value on done: 1668451.0 [2023-02-25 15:06:18,679][36156] Sum rewards: 54.990, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.882', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.062', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon4': '0.378', 'weapon2': '0.452', 'WEAPON3': '1.250', 'weapon3': '2.786', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.328', 'FRAGCOUNT': '48.000'} [2023-02-25 15:06:18,989][36156] DAMAGECOUNT value on done: 1653968.0 [2023-02-25 15:06:18,989][36156] Sum rewards: 66.183, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.230', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.042', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'AMMO4': '0.204', 'WEAPON4': '0.400', 'weapon4': '0.400', 'weapon2': '0.512', 'WEAPON3': '1.150', 'weapon3': '2.766', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.417', 'FRAGCOUNT': '57.000'} [2023-02-25 15:06:19,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13448.5, 300 sec: 13329.4). Total num frames: 242401280. Throughput: 0: 3363.3. Samples: 23098386. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:06:19,730][36114] Avg episode reward: [(0, '60.384')] [2023-02-25 15:06:20,440][36138] Updated weights for policy 0, policy_version 59183 (0.0009) [2023-02-25 15:06:22,205][36139] DAMAGECOUNT value on done: 1663883.0 [2023-02-25 15:06:22,205][36139] Sum rewards: 69.343, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.250', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon5': '0.194', 'weapon2': '0.212', 'weapon4': '0.222', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.014', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '61.000'} [2023-02-25 15:06:22,425][36155] DAMAGECOUNT value on done: 1654448.0 [2023-02-25 15:06:22,425][36155] Sum rewards: 65.400, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.682', 'AMMO5': '0.007', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'weapon5': '0.158', 'AMMO3': '0.199', 'weapon2': '0.334', 'weapon4': '0.392', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.854', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '56.000'} [2023-02-25 15:06:22,503][36139] DAMAGECOUNT value on done: 1663596.0 [2023-02-25 15:06:22,503][36139] Sum rewards: 47.236, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.651', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.063', 'AMMO3': '0.114', 'weapon5': '0.292', 'AMMO4': '0.315', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon4': '0.688', 'weapon2': '0.888', 'weapon3': '1.712', 'HITCOUNT': '2.340', 'DAMAGECOUNT': '11.502', 'FRAGCOUNT': '39.000'} [2023-02-25 15:06:22,735][36155] DAMAGECOUNT value on done: 1654935.0 [2023-02-25 15:06:22,735][36155] Sum rewards: 59.162, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.000', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon5': '0.146', 'AMMO3': '0.173', 'AMMO4': '0.220', 'WEAPON5': '0.250', 'weapon2': '0.336', 'WEAPON4': '0.400', 'weapon4': '0.494', 'WEAPON3': '1.000', 'weapon3': '2.796', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.529', 'FRAGCOUNT': '51.000'} [2023-02-25 15:06:23,089][36139] DAMAGECOUNT value on done: 1669851.0 [2023-02-25 15:06:23,090][36139] Sum rewards: 67.725, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.892', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO4': '0.185', 'weapon4': '0.190', 'AMMO3': '0.215', 'weapon5': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.484', 'WEAPON3': '1.350', 'weapon3': '2.796', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '58.000'} [2023-02-25 15:06:23,393][36139] DAMAGECOUNT value on done: 1673753.0 [2023-02-25 15:06:23,393][36139] Sum rewards: 62.716, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.560', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.029', 'weapon5': '0.058', 'AMMO4': '0.143', 'weapon4': '0.264', 'AMMO3': '0.288', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.004', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.004', 'FRAGCOUNT': '57.000'} [2023-02-25 15:06:23,480][36138] Updated weights for policy 0, policy_version 59193 (0.0009) [2023-02-25 15:06:23,552][36155] DAMAGECOUNT value on done: 1672714.0 [2023-02-25 15:06:23,553][36155] Sum rewards: 61.026, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.575', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.118', 'AMMO4': '0.169', 'weapon2': '0.220', 'weapon4': '0.226', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.140', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '54.000'} [2023-02-25 15:06:23,852][36155] DAMAGECOUNT value on done: 1658340.0 [2023-02-25 15:06:23,852][36155] Sum rewards: 52.741, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.566', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.044', 'AMMO4': '0.147', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon4': '0.284', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON3': '1.100', 'HITCOUNT': '2.890', 'weapon3': '3.194', 'DAMAGECOUNT': '14.121', 'FRAGCOUNT': '45.000'} [2023-02-25 15:06:24,110][36154] DAMAGECOUNT value on done: 1666466.0 [2023-02-25 15:06:24,110][36154] Sum rewards: 69.377, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.836', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.278', 'weapon4': '0.472', 'WEAPON3': '1.450', 'weapon3': '2.924', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '61.500'} [2023-02-25 15:06:24,418][36154] DAMAGECOUNT value on done: 1641906.0 [2023-02-25 15:06:24,419][36154] Sum rewards: 58.932, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.970', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'AMMO4': '0.191', 'weapon2': '0.286', 'WEAPON4': '0.450', 'weapon4': '0.644', 'WEAPON3': '0.950', 'weapon3': '2.744', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.808', 'FRAGCOUNT': '50.000'} [2023-02-25 15:06:24,729][36114] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13343.2). Total num frames: 242470912. Throughput: 0: 3365.5. Samples: 23108528. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:06:24,730][36114] Avg episode reward: [(0, '60.560')] [2023-02-25 15:06:24,843][36154] DAMAGECOUNT value on done: 1677024.0 [2023-02-25 15:06:24,844][36154] Sum rewards: 57.596, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.230', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.062', 'AMMO3': '0.155', 'weapon5': '0.272', 'AMMO4': '0.311', 'weapon2': '0.440', 'WEAPON5': '0.500', 'weapon4': '0.586', 'WEAPON4': '0.650', 'WEAPON3': '0.950', 'weapon3': '2.384', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.354', 'FRAGCOUNT': '51.000'} [2023-02-25 15:06:25,162][36154] DAMAGECOUNT value on done: 1654563.0 [2023-02-25 15:06:25,162][36154] Sum rewards: 69.399, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.777', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO4': '0.186', 'weapon2': '0.216', 'AMMO3': '0.255', 'weapon5': '0.280', 'WEAPON5': '0.400', 'weapon4': '0.416', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.740', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '63.000'} [2023-02-25 15:06:26,125][36141] DAMAGECOUNT value on done: 1663217.0 [2023-02-25 15:06:26,125][36141] Sum rewards: 58.149, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.646', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.062', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'weapon4': '0.122', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'weapon2': '0.290', 'WEAPON3': '1.450', 'weapon3': '3.310', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.522', 'FRAGCOUNT': '51.000'} [2023-02-25 15:06:26,366][36141] DAMAGECOUNT value on done: 1657736.0 [2023-02-25 15:06:26,367][36141] Sum rewards: 64.972, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'HEALTH': '0.181', 'weapon2': '0.306', 'weapon4': '0.318', 'WEAPON3': '0.950', 'weapon3': '3.018', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.356', 'FRAGCOUNT': '52.000'} [2023-02-25 15:06:26,461][36141] DAMAGECOUNT value on done: 1669470.0 [2023-02-25 15:06:26,462][36141] Sum rewards: 70.671, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.830', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.048', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.218', 'weapon2': '0.224', 'AMMO3': '0.226', 'WEAPON3': '1.300', 'weapon3': '3.288', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.974', 'FRAGCOUNT': '61.000'} [2023-02-25 15:06:26,542][36138] Updated weights for policy 0, policy_version 59203 (0.0009) [2023-02-25 15:06:26,687][36141] DAMAGECOUNT value on done: 1642067.0 [2023-02-25 15:06:26,688][36141] Sum rewards: 59.402, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.410', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.098', 'AMMO3': '0.158', 'weapon5': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.354', 'WEAPON5': '0.400', 'weapon4': '0.574', 'WEAPON3': '1.000', 'weapon3': '2.172', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.030', 'FRAGCOUNT': '50.000'} [2023-02-25 15:06:29,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13380.2, 300 sec: 13315.5). Total num frames: 242532352. Throughput: 0: 3352.3. Samples: 23128222. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:06:29,730][36114] Avg episode reward: [(0, '60.595')] [2023-02-25 15:06:29,762][36138] Updated weights for policy 0, policy_version 59213 (0.0010) [2023-02-25 15:06:30,547][36157] DAMAGECOUNT value on done: 1680094.0 [2023-02-25 15:06:30,547][36157] Sum rewards: 80.320, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.350', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.088', 'AMMO4': '0.135', 'weapon4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'weapon2': '0.486', 'WEAPON3': '1.050', 'weapon3': '3.044', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.713', 'FRAGCOUNT': '64.000'} [2023-02-25 15:06:30,857][36157] DAMAGECOUNT value on done: 1660942.0 [2023-02-25 15:06:30,857][36157] Sum rewards: 65.841, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.816', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.140', 'weapon4': '0.144', 'AMMO4': '0.165', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.116', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '61.000'} [2023-02-25 15:06:31,486][36157] DAMAGECOUNT value on done: 1680793.0 [2023-02-25 15:06:31,487][36157] Sum rewards: 60.994, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'weapon4': '0.216', 'weapon2': '0.404', 'HEALTH': '0.476', 'WEAPON3': '0.900', 'HITCOUNT': '3.040', 'weapon3': '3.108', 'DAMAGECOUNT': '15.162', 'FRAGCOUNT': '49.000'} [2023-02-25 15:06:31,724][36140] DAMAGECOUNT value on done: 1674443.0 [2023-02-25 15:06:31,725][36140] Sum rewards: 53.251, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.750', 'AMMO5': '0.021', 'AMMO2': '0.048', 'AMMO3': '0.215', 'AMMO4': '0.239', 'weapon4': '0.258', 'weapon5': '0.332', 'weapon2': '0.540', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.490', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.988', 'FRAGCOUNT': '48.500'} [2023-02-25 15:06:31,796][36157] DAMAGECOUNT value on done: 1665368.0 [2023-02-25 15:06:31,797][36157] Sum rewards: 65.449, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.570', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.018', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.277', 'weapon2': '0.296', 'WEAPON3': '1.750', 'weapon3': '3.462', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.548', 'FRAGCOUNT': '58.000'} [2023-02-25 15:06:31,831][36140] DAMAGECOUNT value on done: 1664452.0 [2023-02-25 15:06:31,832][36140] Sum rewards: 69.060, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.701', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon5': '0.086', 'AMMO4': '0.095', 'weapon4': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.476', 'WEAPON3': '1.300', 'weapon3': '3.104', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '58.000'} [2023-02-25 15:06:32,052][36140] DAMAGECOUNT value on done: 1649014.0 [2023-02-25 15:06:32,053][36140] Sum rewards: 64.532, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.539', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.158', 'AMMO3': '0.196', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.402', 'weapon4': '0.606', 'WEAPON3': '1.150', 'weapon3': '2.524', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '56.000'} [2023-02-25 15:06:32,157][36140] DAMAGECOUNT value on done: 1662591.0 [2023-02-25 15:06:32,158][36140] Sum rewards: 51.183, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.450', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.052', 'weapon5': '0.108', 'AMMO3': '0.203', 'AMMO4': '0.258', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.508', 'weapon4': '0.548', 'WEAPON3': '1.300', 'weapon3': '2.578', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.213', 'FRAGCOUNT': '45.000'} [2023-02-25 15:06:32,870][36138] Updated weights for policy 0, policy_version 59223 (0.0009) [2023-02-25 15:06:34,729][36114] Fps is (10 sec: 12697.8, 60 sec: 13312.0, 300 sec: 13315.5). Total num frames: 242597888. Throughput: 0: 3339.6. Samples: 23147882. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:06:34,729][36114] Avg episode reward: [(0, '60.603')] [2023-02-25 15:06:36,010][36138] Updated weights for policy 0, policy_version 59233 (0.0010) [2023-02-25 15:06:36,396][36142] DAMAGECOUNT value on done: 1659231.0 [2023-02-25 15:06:36,396][36142] Sum rewards: 68.706, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.908', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.217', 'weapon2': '0.260', 'WEAPON4': '0.300', 'weapon4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.110', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '59.000'} [2023-02-25 15:06:36,705][36142] DAMAGECOUNT value on done: 1648099.0 [2023-02-25 15:06:36,706][36142] Sum rewards: 55.737, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.042', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.140', 'AMMO3': '0.207', 'weapon4': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.300', 'weapon3': '2.922', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.026', 'FRAGCOUNT': '49.000'} [2023-02-25 15:06:37,381][36142] DAMAGECOUNT value on done: 1658070.0 [2023-02-25 15:06:37,382][36142] Sum rewards: 59.711, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.160', 'AMMO5': '0.017', 'AMMO2': '0.044', 'AMMO3': '0.141', 'AMMO4': '0.221', 'weapon5': '0.234', 'WEAPON5': '0.550', 'weapon2': '0.566', 'WEAPON4': '0.750', 'weapon4': '0.786', 'WEAPON3': '0.850', 'weapon3': '2.106', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.065', 'FRAGCOUNT': '50.000'} [2023-02-25 15:06:37,705][36142] DAMAGECOUNT value on done: 1667467.0 [2023-02-25 15:06:37,706][36142] Sum rewards: 57.546, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.528', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO3': '0.169', 'AMMO4': '0.174', 'weapon5': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.464', 'weapon4': '0.896', 'WEAPON3': '1.000', 'weapon3': '2.124', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.189', 'FRAGCOUNT': '47.000'} [2023-02-25 15:06:38,626][36156] DAMAGECOUNT value on done: 1678681.0 [2023-02-25 15:06:38,627][36156] Sum rewards: 59.238, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.265', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.176', 'AMMO4': '0.184', 'AMMO3': '0.185', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon2': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.396', 'WEAPON3': '1.200', 'weapon3': '2.886', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.693', 'FRAGCOUNT': '50.000'} [2023-02-25 15:06:38,949][36156] DAMAGECOUNT value on done: 1655286.0 [2023-02-25 15:06:38,950][36156] Sum rewards: 57.879, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.770', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.038', 'weapon4': '0.052', 'AMMO4': '0.183', 'WEAPON5': '0.200', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'weapon2': '0.342', 'WEAPON3': '1.500', 'HITCOUNT': '3.300', 'weapon3': '3.306', 'DAMAGECOUNT': '15.123', 'FRAGCOUNT': '53.000'} [2023-02-25 15:06:39,170][36156] DAMAGECOUNT value on done: 1674193.0 [2023-02-25 15:06:39,170][36156] Sum rewards: 69.748, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.431', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.146', 'AMMO4': '0.159', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.334', 'weapon4': '0.818', 'WEAPON3': '1.150', 'weapon3': '2.286', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '58.000'} [2023-02-25 15:06:39,202][36138] Updated weights for policy 0, policy_version 59243 (0.0010) [2023-02-25 15:06:39,277][36156] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('ARMOR', -0.001, -1.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 15:06:39,501][36156] DAMAGECOUNT value on done: 1660008.0 [2023-02-25 15:06:39,501][36156] Sum rewards: 72.197, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.140', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.083', 'weapon4': '0.172', 'AMMO3': '0.253', 'weapon2': '0.354', 'WEAPON3': '1.500', 'weapon3': '3.288', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '61.000'} [2023-02-25 15:06:39,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13312.1, 300 sec: 13301.6). Total num frames: 242663424. Throughput: 0: 3332.6. Samples: 23157634. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:06:39,730][36114] Avg episode reward: [(0, '60.537')] [2023-02-25 15:06:42,309][36138] Updated weights for policy 0, policy_version 59253 (0.0009) [2023-02-25 15:06:42,742][36139] DAMAGECOUNT value on done: 1668664.0 [2023-02-25 15:06:42,742][36139] Sum rewards: 57.451, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.320', 'AMMO5': '0.004', 'AMMO2': '0.021', 'weapon5': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.203', 'weapon4': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.614', 'WEAPON3': '1.300', 'weapon3': '2.834', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.343', 'FRAGCOUNT': '50.000'} [2023-02-25 15:06:42,990][36155] DAMAGECOUNT value on done: 1660372.0 [2023-02-25 15:06:42,990][36155] Sum rewards: 58.389, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-4.322', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.054', 'weapon5': '0.204', 'AMMO3': '0.257', 'AMMO4': '0.271', 'weapon2': '0.282', 'WEAPON5': '0.500', 'weapon4': '0.518', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.596', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '54.000'} [2023-02-25 15:06:43,070][36139] DAMAGECOUNT value on done: 1667900.0 [2023-02-25 15:06:43,070][36139] Sum rewards: 51.936, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.945', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.184', 'weapon2': '0.214', 'AMMO3': '0.257', 'WEAPON3': '1.450', 'HITCOUNT': '2.920', 'weapon3': '3.358', 'DAMAGECOUNT': '12.912', 'FRAGCOUNT': '48.000'} [2023-02-25 15:06:43,308][36155] DAMAGECOUNT value on done: 1659581.0 [2023-02-25 15:06:43,309][36155] Sum rewards: 54.297, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.038', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.107', 'AMMO4': '0.177', 'weapon2': '0.216', 'weapon5': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '0.650', 'weapon4': '0.944', 'weapon3': '2.060', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.938', 'FRAGCOUNT': '43.000'} [2023-02-25 15:06:43,702][36139] DAMAGECOUNT value on done: 1674400.0 [2023-02-25 15:06:43,703][36139] Sum rewards: 57.199, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.524', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.079', 'weapon4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'weapon2': '0.564', 'WEAPON3': '0.950', 'HITCOUNT': '2.850', 'weapon3': '3.086', 'DAMAGECOUNT': '13.647', 'FRAGCOUNT': '48.000'} [2023-02-25 15:06:43,958][36139] Large shaping reward 2.600 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.549, 183.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 15:06:44,014][36139] DAMAGECOUNT value on done: 1676882.0 [2023-02-25 15:06:44,015][36139] Sum rewards: 37.214, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.620', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon5': '0.016', 'AMMO4': '0.050', 'WEAPON5': '0.100', 'weapon2': '0.140', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'weapon4': '0.350', 'ARMOR': '0.544', 'WEAPON3': '0.950', 'HITCOUNT': '2.030', 'weapon3': '2.898', 'DAMAGECOUNT': '9.387', 'FRAGCOUNT': '31.000'} [2023-02-25 15:06:44,119][36155] DAMAGECOUNT value on done: 1678580.0 [2023-02-25 15:06:44,119][36155] Sum rewards: 71.776, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.980', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.048', 'AMMO3': '0.153', 'weapon5': '0.226', 'AMMO4': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.478', 'weapon4': '0.826', 'WEAPON3': '1.000', 'weapon3': '2.160', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '60.000'} [2023-02-25 15:06:44,418][36155] DAMAGECOUNT value on done: 1663627.0 [2023-02-25 15:06:44,419][36155] Sum rewards: 66.131, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.424', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.068', 'AMMO4': '0.116', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.322', 'weapon4': '0.534', 'WEAPON3': '1.050', 'weapon3': '2.786', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '54.000'} [2023-02-25 15:06:44,697][36154] DAMAGECOUNT value on done: 1671426.0 [2023-02-25 15:06:44,698][36154] Sum rewards: 56.517, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.583', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.062', 'AMMO3': '0.138', 'weapon5': '0.208', 'AMMO4': '0.309', 'weapon2': '0.338', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.690', 'WEAPON3': '0.850', 'weapon3': '2.508', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.760', 'FRAGCOUNT': '45.500'} [2023-02-25 15:06:44,729][36114] Fps is (10 sec: 13107.1, 60 sec: 13312.0, 300 sec: 13301.6). Total num frames: 242728960. Throughput: 0: 3312.7. Samples: 23177028. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:06:44,731][36114] Avg episode reward: [(0, '60.008')] [2023-02-25 15:06:45,079][36154] DAMAGECOUNT value on done: 1647728.0 [2023-02-25 15:06:45,080][36154] Sum rewards: 64.930, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.379', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.148', 'weapon4': '0.184', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.314', 'WEAPON3': '1.300', 'weapon3': '3.128', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.466', 'FRAGCOUNT': '54.000'} [2023-02-25 15:06:45,574][36138] Updated weights for policy 0, policy_version 59263 (0.0010) [2023-02-25 15:06:45,602][36154] DAMAGECOUNT value on done: 1681990.0 [2023-02-25 15:06:45,603][36154] Sum rewards: 47.216, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.876', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.067', 'AMMO3': '0.157', 'weapon5': '0.298', 'AMMO4': '0.335', 'weapon4': '0.494', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'weapon2': '0.806', 'WEAPON3': '0.950', 'weapon3': '2.056', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.898', 'FRAGCOUNT': '42.000'} [2023-02-25 15:06:45,786][36155] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 15:06:45,955][36154] DAMAGECOUNT value on done: 1659868.0 [2023-02-25 15:06:45,956][36154] Sum rewards: 67.051, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.960', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.050', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon4': '0.264', 'weapon2': '0.414', 'WEAPON3': '1.250', 'weapon3': '2.980', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.915', 'FRAGCOUNT': '57.000'} [2023-02-25 15:06:47,079][36141] DAMAGECOUNT value on done: 1668823.0 [2023-02-25 15:06:47,079][36141] Sum rewards: 64.532, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.572', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.178', 'AMMO4': '0.185', 'weapon4': '0.204', 'AMMO3': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.456', 'WEAPON3': '1.300', 'weapon3': '2.846', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '56.000'} [2023-02-25 15:06:47,336][36141] DAMAGECOUNT value on done: 1662840.0 [2023-02-25 15:06:47,337][36141] Sum rewards: 52.763, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.000', 'AMMO5': '0.013', 'AMMO2': '0.055', 'AMMO3': '0.173', 'weapon5': '0.236', 'AMMO4': '0.275', 'weapon2': '0.420', 'WEAPON5': '0.500', 'weapon4': '0.508', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.560', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '45.000'} [2023-02-25 15:06:47,428][36141] DAMAGECOUNT value on done: 1675035.0 [2023-02-25 15:06:47,429][36141] Sum rewards: 59.505, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.057', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.098', 'AMMO4': '0.144', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'weapon4': '0.382', 'weapon2': '0.392', 'WEAPON3': '1.450', 'weapon3': '2.862', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.410', 'FRAGCOUNT': '53.000'} [2023-02-25 15:06:47,673][36141] DAMAGECOUNT value on done: 1646846.0 [2023-02-25 15:06:47,674][36141] Sum rewards: 54.545, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.040', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.094', 'weapon4': '0.130', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.282', 'WEAPON3': '1.300', 'HITCOUNT': '3.000', 'weapon3': '3.260', 'DAMAGECOUNT': '14.337', 'FRAGCOUNT': '47.000'} [2023-02-25 15:06:48,660][36140] Large shaping reward 2.520 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.498, 166.0), ('weapon5', 0.002)] [2023-02-25 15:06:49,290][36138] Updated weights for policy 0, policy_version 59273 (0.0011) [2023-02-25 15:06:49,729][36114] Fps is (10 sec: 12288.0, 60 sec: 13107.2, 300 sec: 13273.8). Total num frames: 242786304. Throughput: 0: 3246.3. Samples: 23194358. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:06:49,730][36114] Avg episode reward: [(0, '60.117')] [2023-02-25 15:06:52,433][36157] DAMAGECOUNT value on done: 1685851.0 [2023-02-25 15:06:52,434][36157] Sum rewards: 69.773, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.940', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.052', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon4': '0.288', 'weapon2': '0.344', 'WEAPON3': '1.250', 'weapon3': '2.992', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '59.000'} [2023-02-25 15:06:52,835][36157] DAMAGECOUNT value on done: 1665378.0 [2023-02-25 15:06:52,836][36157] Sum rewards: 45.639, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.710', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.033', 'AMMO3': '0.150', 'AMMO4': '0.167', 'weapon5': '0.240', 'weapon2': '0.448', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.516', 'WEAPON3': '1.050', 'weapon3': '2.526', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '13.308', 'FRAGCOUNT': '40.000'} [2023-02-25 15:06:53,200][36138] Updated weights for policy 0, policy_version 59283 (0.0010) [2023-02-25 15:06:53,647][36157] DAMAGECOUNT value on done: 1686865.0 [2023-02-25 15:06:53,648][36157] Sum rewards: 71.652, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.387', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.060', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon4': '0.332', 'weapon2': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.036', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '60.000'} [2023-02-25 15:06:54,008][36157] DAMAGECOUNT value on done: 1670838.0 [2023-02-25 15:06:54,008][36157] Sum rewards: 63.726, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.390', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'weapon4': '0.122', 'AMMO3': '0.134', 'weapon2': '0.272', 'WEAPON3': '0.950', 'HITCOUNT': '3.310', 'weapon3': '3.444', 'DAMAGECOUNT': '16.410', 'FRAGCOUNT': '50.000'} [2023-02-25 15:06:54,100][36140] DAMAGECOUNT value on done: 1679886.0 [2023-02-25 15:06:54,101][36140] Sum rewards: 67.325, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.715', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.098', 'AMMO4': '0.126', 'AMMO3': '0.137', 'WEAPON5': '0.200', 'weapon4': '0.284', 'WEAPON4': '0.300', 'weapon2': '0.532', 'WEAPON3': '0.950', 'weapon3': '2.840', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.329', 'FRAGCOUNT': '55.000'} [2023-02-25 15:06:54,235][36140] DAMAGECOUNT value on done: 1670095.0 [2023-02-25 15:06:54,237][36140] Sum rewards: 65.073, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.970', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.042', 'WEAPON4': '0.150', 'weapon5': '0.174', 'AMMO3': '0.182', 'WEAPON5': '0.250', 'weapon2': '0.348', 'weapon4': '0.368', 'WEAPON3': '1.250', 'weapon3': '2.854', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.929', 'FRAGCOUNT': '54.000'} [2023-02-25 15:06:54,468][36140] DAMAGECOUNT value on done: 1654293.0 [2023-02-25 15:06:54,469][36140] Sum rewards: 62.623, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.226', 'ARMOR': '0.004', 'AMMO5': '0.004', 'weapon5': '0.024', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'weapon2': '0.170', 'WEAPON4': '0.200', 'AMMO3': '0.284', 'weapon4': '0.426', 'WEAPON3': '1.600', 'weapon3': '3.120', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '57.000'} [2023-02-25 15:06:54,602][36140] DAMAGECOUNT value on done: 1668459.0 [2023-02-25 15:06:54,603][36140] Sum rewards: 69.293, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.810', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.172', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.290', 'weapon4': '0.460', 'WEAPON3': '1.500', 'weapon3': '2.784', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '60.000'} [2023-02-25 15:06:54,729][36114] Fps is (10 sec: 11059.2, 60 sec: 12902.4, 300 sec: 13232.2). Total num frames: 242839552. Throughput: 0: 3196.9. Samples: 23202252. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:06:54,730][36114] Avg episode reward: [(0, '60.401')] [2023-02-25 15:06:56,788][36138] Updated weights for policy 0, policy_version 59293 (0.0010) [2023-02-25 15:06:59,119][36141] Large shaping reward 2.502 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.48, 160.0), ('weapon5', 0.002)] [2023-02-25 15:06:59,345][36142] DAMAGECOUNT value on done: 1665427.0 [2023-02-25 15:06:59,346][36142] Sum rewards: 70.403, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-1.982', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.164', 'weapon5': '0.184', 'WEAPON5': '0.200', 'weapon2': '0.218', 'AMMO3': '0.293', 'WEAPON4': '0.300', 'weapon4': '0.304', 'ARMOR': '0.455', 'WEAPON3': '1.700', 'weapon3': '2.866', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.588', 'FRAGCOUNT': '63.000'} [2023-02-25 15:06:59,729][36114] Fps is (10 sec: 11059.2, 60 sec: 12697.6, 300 sec: 13218.3). Total num frames: 242896896. Throughput: 0: 3125.2. Samples: 23219112. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:06:59,730][36114] Avg episode reward: [(0, '60.593')] [2023-02-25 15:06:59,746][36142] DAMAGECOUNT value on done: 1653205.0 [2023-02-25 15:06:59,746][36142] Sum rewards: 60.277, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.344', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.141', 'AMMO3': '0.227', 'weapon2': '0.228', 'weapon5': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.534', 'WEAPON3': '1.300', 'weapon3': '2.588', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.318', 'FRAGCOUNT': '54.000'} [2023-02-25 15:07:00,346][36138] Updated weights for policy 0, policy_version 59303 (0.0009) [2023-02-25 15:07:00,503][36142] DAMAGECOUNT value on done: 1663806.0 [2023-02-25 15:07:00,504][36142] Sum rewards: 69.125, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.015', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.139', 'AMMO3': '0.178', 'WEAPON4': '0.300', 'weapon2': '0.414', 'weapon4': '0.578', 'WEAPON3': '1.050', 'weapon3': '2.786', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '57.000'} [2023-02-25 15:07:00,877][36142] DAMAGECOUNT value on done: 1673463.0 [2023-02-25 15:07:00,878][36142] Sum rewards: 69.417, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.537', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.250', 'weapon4': '0.282', 'WEAPON3': '1.350', 'weapon3': '3.124', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '59.000'} [2023-02-25 15:07:01,818][36156] DAMAGECOUNT value on done: 1683657.0 [2023-02-25 15:07:01,818][36156] Sum rewards: 64.017, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.580', 'AMMO5': '0.006', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon4': '0.066', 'weapon5': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'weapon2': '0.470', 'WEAPON3': '1.300', 'weapon3': '3.162', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.928', 'FRAGCOUNT': '54.000'} [2023-02-25 15:07:02,184][36156] DAMAGECOUNT value on done: 1660445.0 [2023-02-25 15:07:02,185][36156] Sum rewards: 54.495, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.972', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.036', 'AMMO4': '0.179', 'weapon5': '0.204', 'AMMO3': '0.208', 'weapon2': '0.296', 'weapon4': '0.492', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.690', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '46.500'} [2023-02-25 15:07:02,469][36156] DAMAGECOUNT value on done: 1679661.0 [2023-02-25 15:07:02,469][36156] Sum rewards: 63.213, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.609', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'weapon4': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.222', 'AMMO3': '0.275', 'WEAPON3': '1.650', 'HITCOUNT': '3.200', 'weapon3': '3.396', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '56.000'} [2023-02-25 15:07:02,843][36156] DAMAGECOUNT value on done: 1665561.0 [2023-02-25 15:07:02,844][36156] Sum rewards: 70.607, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.417', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO3': '0.138', 'AMMO4': '0.179', 'weapon5': '0.186', 'weapon2': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'weapon4': '0.898', 'weapon3': '2.400', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '58.000'} [2023-02-25 15:07:03,900][36138] Updated weights for policy 0, policy_version 59313 (0.0010) [2023-02-25 15:07:04,729][36114] Fps is (10 sec: 11468.8, 60 sec: 12561.1, 300 sec: 13204.4). Total num frames: 242954240. Throughput: 0: 3064.7. Samples: 23236298. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:07:04,730][36114] Avg episode reward: [(0, '60.967')] [2023-02-25 15:07:06,284][36139] DAMAGECOUNT value on done: 1672848.0 [2023-02-25 15:07:06,285][36139] Sum rewards: 50.665, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.530', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon5': '0.116', 'weapon2': '0.150', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.452', 'WEAPON3': '1.050', 'HITCOUNT': '2.790', 'weapon3': '3.056', 'DAMAGECOUNT': '12.552', 'FRAGCOUNT': '44.000'} [2023-02-25 15:07:06,471][36155] DAMAGECOUNT value on done: 1665666.0 [2023-02-25 15:07:06,472][36155] Sum rewards: 62.035, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.890', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon5': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon4': '0.262', 'weapon2': '0.314', 'WEAPON3': '1.100', 'weapon3': '3.154', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.882', 'FRAGCOUNT': '51.000'} [2023-02-25 15:07:06,629][36139] DAMAGECOUNT value on done: 1672903.0 [2023-02-25 15:07:06,630][36139] Sum rewards: 61.258, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.421', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.106', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'weapon2': '0.230', 'weapon4': '0.702', 'WEAPON3': '0.950', 'weapon3': '2.698', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.009', 'FRAGCOUNT': '50.000'} [2023-02-25 15:07:06,816][36155] DAMAGECOUNT value on done: 1665805.0 [2023-02-25 15:07:06,816][36155] Sum rewards: 66.606, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.010', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.124', 'AMMO4': '0.166', 'AMMO3': '0.202', 'WEAPON5': '0.300', 'weapon2': '0.304', 'weapon4': '0.486', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.658', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '58.000'} [2023-02-25 15:07:07,276][36139] DAMAGECOUNT value on done: 1679744.0 [2023-02-25 15:07:07,277][36139] Sum rewards: 58.196, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.872', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.192', 'AMMO3': '0.248', 'weapon2': '0.340', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.660', 'WEAPON3': '1.400', 'weapon3': '2.222', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.032', 'FRAGCOUNT': '52.000'} [2023-02-25 15:07:07,448][36138] Updated weights for policy 0, policy_version 59323 (0.0010) [2023-02-25 15:07:07,621][36139] DAMAGECOUNT value on done: 1682314.0 [2023-02-25 15:07:07,622][36139] Sum rewards: 57.099, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.617', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon2': '0.190', 'weapon5': '0.196', 'AMMO3': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.596', 'WEAPON3': '1.500', 'weapon3': '2.574', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.296', 'FRAGCOUNT': '50.000'} [2023-02-25 15:07:07,719][36155] DAMAGECOUNT value on done: 1683438.0 [2023-02-25 15:07:07,720][36155] Sum rewards: 54.774, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.720', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.158', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'AMMO4': '0.252', 'weapon2': '0.378', 'weapon4': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.636', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.574', 'FRAGCOUNT': '50.000'} [2023-02-25 15:07:08,072][36155] DAMAGECOUNT value on done: 1668062.0 [2023-02-25 15:07:08,073][36155] Sum rewards: 42.745, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.914', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.082', 'AMMO3': '0.155', 'weapon5': '0.300', 'weapon2': '0.344', 'AMMO4': '0.412', 'WEAPON5': '0.600', 'weapon4': '0.724', 'WEAPON4': '0.850', 'WEAPON3': '0.950', 'weapon3': '2.260', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.825', 'FRAGCOUNT': '39.500'} [2023-02-25 15:07:08,661][36154] DAMAGECOUNT value on done: 1676134.0 [2023-02-25 15:07:08,662][36154] Sum rewards: 58.758, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.422', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'weapon2': '0.358', 'weapon4': '0.418', 'WEAPON3': '1.250', 'weapon3': '2.846', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.121', 'FRAGCOUNT': '50.000'} [2023-02-25 15:07:08,978][36154] DAMAGECOUNT value on done: 1652630.0 [2023-02-25 15:07:08,978][36154] Sum rewards: 57.644, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.454', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.044', 'AMMO4': '0.058', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.282', 'weapon4': '0.296', 'weapon2': '0.304', 'WEAPON3': '1.600', 'weapon3': '2.894', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.706', 'FRAGCOUNT': '54.000'} [2023-02-25 15:07:09,418][36154] DAMAGECOUNT value on done: 1686444.0 [2023-02-25 15:07:09,419][36154] Sum rewards: 47.706, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.495', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon7': '0.066', 'AMMO4': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.144', 'AMMO3': '0.182', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.254', 'weapon4': '0.410', 'WEAPON3': '1.100', 'HITCOUNT': '2.730', 'weapon3': '2.862', 'DAMAGECOUNT': '13.362', 'FRAGCOUNT': '40.000'} [2023-02-25 15:07:09,729][36114] Fps is (10 sec: 11468.8, 60 sec: 12356.3, 300 sec: 13176.6). Total num frames: 243011584. Throughput: 0: 3034.5. Samples: 23245082. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:07:09,730][36114] Avg episode reward: [(0, '60.492')] [2023-02-25 15:07:09,755][36154] DAMAGECOUNT value on done: 1665358.0 [2023-02-25 15:07:09,756][36154] Sum rewards: 64.970, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.648', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.248', 'weapon4': '0.446', 'WEAPON3': '1.350', 'weapon3': '2.820', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '56.000'} [2023-02-25 15:07:10,799][36141] DAMAGECOUNT value on done: 1675073.0 [2023-02-25 15:07:10,800][36141] Sum rewards: 67.527, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.662', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.152', 'weapon5': '0.166', 'AMMO4': '0.172', 'weapon2': '0.208', 'AMMO3': '0.241', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.136', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '59.000'} [2023-02-25 15:07:10,829][36138] Updated weights for policy 0, policy_version 59333 (0.0009) [2023-02-25 15:07:11,034][36141] DAMAGECOUNT value on done: 1668065.0 [2023-02-25 15:07:11,034][36141] Sum rewards: 64.185, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.275', 'ARMOR': '0.004', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'weapon2': '0.870', 'WEAPON3': '1.150', 'weapon3': '2.806', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '54.000'} [2023-02-25 15:07:11,055][36155] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 15:07:11,140][36141] DAMAGECOUNT value on done: 1680338.0 [2023-02-25 15:07:11,140][36141] Sum rewards: 64.609, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.130', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'weapon4': '0.186', 'WEAPON4': '0.250', 'weapon2': '0.660', 'WEAPON3': '1.150', 'weapon3': '2.834', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.909', 'FRAGCOUNT': '53.000'} [2023-02-25 15:07:11,376][36141] DAMAGECOUNT value on done: 1652383.0 [2023-02-25 15:07:11,377][36141] Sum rewards: 60.325, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.482', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.088', 'AMMO4': '0.097', 'WEAPON5': '0.150', 'weapon2': '0.206', 'AMMO3': '0.273', 'WEAPON4': '0.350', 'weapon4': '0.584', 'WEAPON3': '1.550', 'weapon3': '2.784', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.611', 'FRAGCOUNT': '55.000'} [2023-02-25 15:07:14,052][36138] Updated weights for policy 0, policy_version 59343 (0.0010) [2023-02-25 15:07:14,729][36114] Fps is (10 sec: 12288.1, 60 sec: 12356.3, 300 sec: 13176.6). Total num frames: 243077120. Throughput: 0: 3012.9. Samples: 23263802. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:07:14,729][36114] Avg episode reward: [(0, '60.953')] [2023-02-25 15:07:15,174][36157] DAMAGECOUNT value on done: 1690893.0 [2023-02-25 15:07:15,175][36157] Sum rewards: 53.590, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.230', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.200', 'weapon5': '0.202', 'weapon2': '0.326', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.480', 'WEAPON3': '1.200', 'weapon3': '2.724', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.126', 'FRAGCOUNT': '45.500'} [2023-02-25 15:07:15,492][36157] DAMAGECOUNT value on done: 1670381.0 [2023-02-25 15:07:15,493][36157] Sum rewards: 59.875, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.410', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.078', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'weapon2': '0.278', 'weapon4': '0.534', 'WEAPON3': '1.200', 'weapon3': '2.736', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.009', 'FRAGCOUNT': '52.000'} [2023-02-25 15:07:16,153][36157] DAMAGECOUNT value on done: 1692884.0 [2023-02-25 15:07:16,154][36157] Sum rewards: 68.963, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.678', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.096', 'AMMO4': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.334', 'WEAPON4': '0.350', 'weapon4': '0.838', 'WEAPON3': '1.350', 'weapon3': '2.482', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '58.000'} [2023-02-25 15:07:16,466][36157] DAMAGECOUNT value on done: 1676285.0 [2023-02-25 15:07:16,466][36157] Sum rewards: 59.308, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.928', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.054', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'weapon2': '0.326', 'weapon4': '0.332', 'WEAPON3': '1.250', 'weapon3': '3.042', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.341', 'FRAGCOUNT': '50.000'} [2023-02-25 15:07:16,715][36140] DAMAGECOUNT value on done: 1683885.0 [2023-02-25 15:07:16,716][36140] Sum rewards: 39.662, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.624', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.067', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon2': '0.654', 'weapon4': '0.666', 'WEAPON3': '1.200', 'weapon3': '2.292', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '11.997', 'FRAGCOUNT': '36.000'} [2023-02-25 15:07:16,766][36140] DAMAGECOUNT value on done: 1675707.0 [2023-02-25 15:07:16,767][36140] Sum rewards: 65.076, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.802', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.142', 'WEAPON5': '0.150', 'weapon2': '0.188', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon4': '0.936', 'WEAPON3': '1.250', 'weapon3': '2.354', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '55.000'} [2023-02-25 15:07:17,046][36140] DAMAGECOUNT value on done: 1659899.0 [2023-02-25 15:07:17,047][36140] Sum rewards: 55.768, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.165', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.050', 'AMMO3': '0.133', 'weapon5': '0.176', 'AMMO4': '0.251', 'WEAPON5': '0.300', 'weapon2': '0.468', 'WEAPON4': '0.600', 'weapon4': '0.718', 'WEAPON3': '0.900', 'weapon3': '2.362', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '46.500'} [2023-02-25 15:07:17,099][36140] DAMAGECOUNT value on done: 1673738.0 [2023-02-25 15:07:17,099][36140] Sum rewards: 67.438, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.674', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon4': '0.252', 'weapon2': '0.674', 'WEAPON3': '1.150', 'weapon3': '2.770', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '56.000'} [2023-02-25 15:07:17,214][36138] Updated weights for policy 0, policy_version 59353 (0.0009) [2023-02-25 15:07:19,729][36114] Fps is (10 sec: 12697.3, 60 sec: 12288.0, 300 sec: 13162.7). Total num frames: 243138560. Throughput: 0: 3005.1. Samples: 23283114. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:07:19,730][36114] Avg episode reward: [(0, '60.741')] [2023-02-25 15:07:19,774][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000059361_243142656.pth... [2023-02-25 15:07:19,837][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000058592_239992832.pth [2023-02-25 15:07:20,428][36138] Updated weights for policy 0, policy_version 59363 (0.0010) [2023-02-25 15:07:21,517][36142] DAMAGECOUNT value on done: 1671041.0 [2023-02-25 15:07:21,518][36142] Sum rewards: 67.685, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.532', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'weapon4': '0.190', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.300', 'weapon3': '3.206', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '59.000'} [2023-02-25 15:07:21,857][36142] DAMAGECOUNT value on done: 1658919.0 [2023-02-25 15:07:21,857][36142] Sum rewards: 61.634, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.166', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.020', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.192', 'weapon2': '0.244', 'WEAPON4': '0.350', 'weapon4': '0.660', 'WEAPON3': '1.250', 'weapon3': '2.870', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '53.000'} [2023-02-25 15:07:22,534][36142] DAMAGECOUNT value on done: 1667960.0 [2023-02-25 15:07:22,534][36142] Sum rewards: 52.290, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.003', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.017', 'AMMO4': '0.086', 'AMMO3': '0.150', 'weapon5': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.356', 'weapon2': '0.422', 'WEAPON3': '0.900', 'weapon3': '2.192', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.462', 'FRAGCOUNT': '43.000'} [2023-02-25 15:07:22,859][36142] DAMAGECOUNT value on done: 1679152.0 [2023-02-25 15:07:22,860][36142] Sum rewards: 66.122, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.006', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.114', 'AMMO3': '0.215', 'weapon4': '0.278', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.004', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.067', 'FRAGCOUNT': '55.000'} [2023-02-25 15:07:23,967][36156] DAMAGECOUNT value on done: 1688436.0 [2023-02-25 15:07:23,968][36156] Sum rewards: 53.643, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.079', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.049', 'AMMO3': '0.166', 'weapon5': '0.238', 'AMMO4': '0.245', 'weapon2': '0.262', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.606', 'WEAPON3': '0.950', 'weapon3': '2.566', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.818', 'FRAGCOUNT': '47.000'} [2023-02-25 15:07:24,044][36138] Updated weights for policy 0, policy_version 59373 (0.0009) [2023-02-25 15:07:24,317][36156] DAMAGECOUNT value on done: 1665301.0 [2023-02-25 15:07:24,317][36156] Sum rewards: 62.118, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.775', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.200', 'AMMO3': '0.204', 'weapon2': '0.334', 'WEAPON3': '1.250', 'HITCOUNT': '3.030', 'weapon3': '3.164', 'DAMAGECOUNT': '14.523', 'FRAGCOUNT': '53.000'} [2023-02-25 15:07:24,673][36156] DAMAGECOUNT value on done: 1684699.0 [2023-02-25 15:07:24,673][36156] Sum rewards: 59.434, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.895', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'weapon2': '0.208', 'AMMO3': '0.256', 'weapon4': '0.262', 'WEAPON3': '1.600', 'weapon3': '3.330', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.114', 'FRAGCOUNT': '53.000'} [2023-02-25 15:07:24,729][36114] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 13148.9). Total num frames: 243195904. Throughput: 0: 2994.7. Samples: 23292394. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:07:24,729][36114] Avg episode reward: [(0, '60.969')] [2023-02-25 15:07:25,019][36156] DAMAGECOUNT value on done: 1670678.0 [2023-02-25 15:07:25,020][36156] Sum rewards: 58.140, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.910', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.100', 'weapon4': '0.152', 'AMMO4': '0.223', 'AMMO3': '0.265', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '3.170', 'weapon3': '3.208', 'DAMAGECOUNT': '15.351', 'FRAGCOUNT': '52.000'} [2023-02-25 15:07:27,617][36138] Updated weights for policy 0, policy_version 59383 (0.0010) [2023-02-25 15:07:28,091][36139] DAMAGECOUNT value on done: 1677292.0 [2023-02-25 15:07:28,092][36139] Sum rewards: 58.530, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.170', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.142', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'weapon2': '0.258', 'WEAPON4': '0.300', 'weapon4': '0.642', 'WEAPON3': '0.950', 'weapon3': '2.568', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.332', 'FRAGCOUNT': '50.000'} [2023-02-25 15:07:28,471][36139] DAMAGECOUNT value on done: 1677744.0 [2023-02-25 15:07:28,471][36139] Sum rewards: 58.270, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.528', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.092', 'AMMO3': '0.155', 'AMMO4': '0.183', 'WEAPON5': '0.300', 'weapon4': '0.326', 'WEAPON4': '0.350', 'weapon2': '0.536', 'WEAPON3': '1.050', 'weapon3': '2.742', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.523', 'FRAGCOUNT': '49.500'} [2023-02-25 15:07:28,484][36155] DAMAGECOUNT value on done: 1671154.0 [2023-02-25 15:07:28,485][36155] Sum rewards: 62.142, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.696', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.049', 'AMMO3': '0.178', 'weapon5': '0.198', 'AMMO4': '0.245', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON4': '0.450', 'weapon4': '0.712', 'WEAPON3': '1.100', 'weapon3': '2.340', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '54.000'} [2023-02-25 15:07:28,851][36155] DAMAGECOUNT value on done: 1671215.0 [2023-02-25 15:07:28,852][36155] Sum rewards: 61.029, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.650', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.130', 'AMMO3': '0.202', 'AMMO4': '0.219', 'WEAPON5': '0.300', 'weapon4': '0.390', 'weapon2': '0.438', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.794', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '53.000'} [2023-02-25 15:07:29,112][36139] DAMAGECOUNT value on done: 1685464.0 [2023-02-25 15:07:29,113][36139] Sum rewards: 64.891, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.052', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.298', 'weapon4': '0.320', 'WEAPON3': '1.350', 'weapon3': '3.000', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '56.000'} [2023-02-25 15:07:29,429][36141] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 15:07:29,470][36139] DAMAGECOUNT value on done: 1684174.0 [2023-02-25 15:07:29,470][36139] Sum rewards: 21.678, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.058', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon7': '0.084', 'AMMO3': '0.087', 'weapon2': '0.100', 'weapon5': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.550', 'weapon4': '0.752', 'weapon3': '1.080', 'HITCOUNT': '1.240', 'DAMAGECOUNT': '5.580', 'FRAGCOUNT': '19.000'} [2023-02-25 15:07:29,729][36114] Fps is (10 sec: 11469.1, 60 sec: 12014.9, 300 sec: 13121.1). Total num frames: 243253248. Throughput: 0: 2934.3. Samples: 23309070. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:07:29,730][36114] Avg episode reward: [(0, '60.450')] [2023-02-25 15:07:29,920][36155] DAMAGECOUNT value on done: 1688997.0 [2023-02-25 15:07:29,921][36155] Sum rewards: 72.415, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.848', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.168', 'weapon2': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon4': '0.354', 'WEAPON3': '1.350', 'weapon3': '3.258', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '63.000'} [2023-02-25 15:07:30,289][36155] DAMAGECOUNT value on done: 1673435.0 [2023-02-25 15:07:30,290][36155] Sum rewards: 71.156, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.430', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.050', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'weapon4': '0.194', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon2': '0.414', 'WEAPON3': '1.150', 'weapon3': '3.118', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.119', 'FRAGCOUNT': '60.000'} [2023-02-25 15:07:30,789][36154] DAMAGECOUNT value on done: 1680262.0 [2023-02-25 15:07:30,790][36154] Sum rewards: 44.245, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.040', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.041', 'weapon5': '0.092', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.236', 'weapon4': '0.514', 'WEAPON3': '1.300', 'HITCOUNT': '2.710', 'weapon3': '2.870', 'DAMAGECOUNT': '12.384', 'FRAGCOUNT': '39.000'} [2023-02-25 15:07:31,156][36154] DAMAGECOUNT value on done: 1657284.0 [2023-02-25 15:07:31,157][36154] Sum rewards: 51.811, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.238', 'AMMO5': '0.016', 'AMMO2': '0.041', 'AMMO3': '0.156', 'weapon5': '0.168', 'AMMO4': '0.204', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.512', 'weapon4': '0.870', 'WEAPON3': '0.950', 'weapon3': '2.110', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '13.962', 'FRAGCOUNT': '47.000'} [2023-02-25 15:07:31,182][36138] Updated weights for policy 0, policy_version 59393 (0.0010) [2023-02-25 15:07:31,610][36154] DAMAGECOUNT value on done: 1691654.0 [2023-02-25 15:07:31,611][36154] Sum rewards: 60.818, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.900', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon5': '0.146', 'AMMO3': '0.189', 'AMMO4': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON4': '0.350', 'weapon4': '0.854', 'WEAPON3': '1.150', 'weapon3': '2.424', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.630', 'FRAGCOUNT': '52.000'} [2023-02-25 15:07:31,955][36154] DAMAGECOUNT value on done: 1670506.0 [2023-02-25 15:07:31,956][36154] Sum rewards: 56.137, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.135', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.092', 'AMMO4': '0.172', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon2': '0.266', 'WEAPON4': '0.300', 'weapon4': '0.370', 'WEAPON3': '1.200', 'weapon3': '3.036', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.444', 'FRAGCOUNT': '47.000'} [2023-02-25 15:07:33,028][36141] DAMAGECOUNT value on done: 1680165.0 [2023-02-25 15:07:33,028][36141] Sum rewards: 59.538, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.462', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon5': '0.168', 'AMMO3': '0.197', 'weapon4': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.544', 'WEAPON3': '1.100', 'weapon3': '2.744', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.276', 'FRAGCOUNT': '51.000'} [2023-02-25 15:07:33,281][36141] DAMAGECOUNT value on done: 1674007.0 [2023-02-25 15:07:33,281][36141] Sum rewards: 72.721, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.900', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.012', 'AMMO4': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.098', 'AMMO3': '0.221', 'weapon2': '0.652', 'WEAPON3': '1.400', 'weapon3': '3.014', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '61.000'} [2023-02-25 15:07:33,387][36141] DAMAGECOUNT value on done: 1685246.0 [2023-02-25 15:07:33,388][36141] Sum rewards: 58.416, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.500', 'AMMO5': '0.005', 'AMMO2': '0.006', 'ARMOR': '0.024', 'AMMO4': '0.030', 'weapon5': '0.068', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'weapon4': '0.298', 'weapon2': '0.370', 'WEAPON3': '1.400', 'HITCOUNT': '2.920', 'weapon3': '3.072', 'DAMAGECOUNT': '14.679', 'FRAGCOUNT': '51.000'} [2023-02-25 15:07:33,530][36155] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-25 15:07:33,632][36141] DAMAGECOUNT value on done: 1657256.0 [2023-02-25 15:07:33,633][36141] Sum rewards: 53.151, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.780', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.090', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'weapon2': '0.188', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.518', 'WEAPON3': '1.450', 'weapon3': '2.786', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.619', 'FRAGCOUNT': '48.000'} [2023-02-25 15:07:34,568][36138] Updated weights for policy 0, policy_version 59403 (0.0010) [2023-02-25 15:07:34,729][36114] Fps is (10 sec: 11878.3, 60 sec: 11946.7, 300 sec: 13093.3). Total num frames: 243314688. Throughput: 0: 2943.4. Samples: 23326810. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:07:34,730][36114] Avg episode reward: [(0, '60.395')] [2023-02-25 15:07:37,485][36157] DAMAGECOUNT value on done: 1695279.0 [2023-02-25 15:07:37,485][36157] Sum rewards: 51.381, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.920', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.104', 'AMMO4': '0.142', 'AMMO3': '0.194', 'weapon2': '0.224', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.878', 'WEAPON3': '1.150', 'weapon3': '2.080', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.158', 'FRAGCOUNT': '46.000'} [2023-02-25 15:07:37,788][36138] Updated weights for policy 0, policy_version 59413 (0.0010) [2023-02-25 15:07:37,820][36157] DAMAGECOUNT value on done: 1674914.0 [2023-02-25 15:07:37,821][36157] Sum rewards: 55.897, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.830', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.013', 'weapon5': '0.044', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'weapon4': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon2': '0.398', 'WEAPON3': '1.250', 'HITCOUNT': '2.970', 'weapon3': '3.206', 'DAMAGECOUNT': '13.599', 'FRAGCOUNT': '49.000'} [2023-02-25 15:07:38,508][36157] DAMAGECOUNT value on done: 1697629.0 [2023-02-25 15:07:38,509][36157] Sum rewards: 54.171, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.226', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.094', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.245', 'weapon2': '0.254', 'weapon4': '0.396', 'ARMOR': '0.404', 'WEAPON3': '1.450', 'HITCOUNT': '2.960', 'weapon3': '2.986', 'DAMAGECOUNT': '14.235', 'FRAGCOUNT': '48.000'} [2023-02-25 15:07:38,836][36157] DAMAGECOUNT value on done: 1681121.0 [2023-02-25 15:07:38,837][36157] Sum rewards: 61.177, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.790', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.028', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.208', 'AMMO3': '0.217', 'weapon2': '0.462', 'WEAPON3': '1.300', 'weapon3': '3.106', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.508', 'FRAGCOUNT': '54.000'} [2023-02-25 15:07:39,034][36140] DAMAGECOUNT value on done: 1688919.0 [2023-02-25 15:07:39,034][36140] Sum rewards: 52.350, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.022', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.036', 'AMMO4': '0.181', 'AMMO3': '0.193', 'weapon5': '0.216', 'weapon2': '0.394', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.888', 'WEAPON3': '1.150', 'weapon3': '2.132', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.553', 'FRAGCOUNT': '45.000'} [2023-02-25 15:07:39,096][36140] DAMAGECOUNT value on done: 1680551.0 [2023-02-25 15:07:39,096][36140] Sum rewards: 53.896, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.964', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.030', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.220', 'WEAPON4': '0.350', 'weapon2': '0.440', 'weapon4': '0.772', 'WEAPON3': '1.350', 'weapon3': '2.454', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.532', 'FRAGCOUNT': '49.000'} [2023-02-25 15:07:39,373][36140] DAMAGECOUNT value on done: 1664376.0 [2023-02-25 15:07:39,374][36140] Sum rewards: 51.909, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.142', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon7': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.130', 'AMMO4': '0.131', 'AMMO3': '0.149', 'WEAPON7': '0.200', 'weapon2': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.878', 'WEAPON3': '0.900', 'weapon3': '1.996', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.431', 'FRAGCOUNT': '44.000'} [2023-02-25 15:07:39,423][36140] DAMAGECOUNT value on done: 1678831.0 [2023-02-25 15:07:39,423][36140] Sum rewards: 48.457, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.398', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.065', 'weapon2': '0.248', 'AMMO3': '0.274', 'weapon5': '0.284', 'AMMO4': '0.325', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon4': '0.802', 'WEAPON3': '1.550', 'weapon3': '2.224', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.279', 'FRAGCOUNT': '46.000'} [2023-02-25 15:07:39,729][36114] Fps is (10 sec: 12697.6, 60 sec: 11946.7, 300 sec: 13093.3). Total num frames: 243380224. Throughput: 0: 2979.3. Samples: 23336320. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:07:39,729][36114] Avg episode reward: [(0, '59.551')] [2023-02-25 15:07:41,000][36138] Updated weights for policy 0, policy_version 59423 (0.0009) [2023-02-25 15:07:44,055][36142] DAMAGECOUNT value on done: 1676294.0 [2023-02-25 15:07:44,056][36142] Sum rewards: 58.373, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.994', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.096', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.178', 'AMMO3': '0.267', 'weapon2': '0.378', 'WEAPON3': '1.600', 'weapon3': '3.146', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '52.000'} [2023-02-25 15:07:44,242][36138] Updated weights for policy 0, policy_version 59433 (0.0010) [2023-02-25 15:07:44,411][36142] DAMAGECOUNT value on done: 1664276.0 [2023-02-25 15:07:44,412][36142] Sum rewards: 60.076, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.720', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.142', 'weapon2': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.283', 'weapon4': '0.406', 'WEAPON3': '1.650', 'weapon3': '3.010', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '55.000'} [2023-02-25 15:07:44,729][36114] Fps is (10 sec: 12697.5, 60 sec: 11878.4, 300 sec: 13065.5). Total num frames: 243441664. Throughput: 0: 3028.0. Samples: 23355372. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:07:44,730][36114] Avg episode reward: [(0, '59.391')] [2023-02-25 15:07:45,094][36142] DAMAGECOUNT value on done: 1672655.0 [2023-02-25 15:07:45,094][36142] Sum rewards: 54.341, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.072', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.138', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'AMMO4': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.530', 'weapon4': '0.740', 'WEAPON3': '1.050', 'weapon3': '2.054', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.085', 'FRAGCOUNT': '46.000'} [2023-02-25 15:07:45,447][36142] DAMAGECOUNT value on done: 1683640.0 [2023-02-25 15:07:45,447][36142] Sum rewards: 45.051, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.687', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.044', 'AMMO3': '0.163', 'weapon5': '0.190', 'AMMO4': '0.218', 'weapon2': '0.258', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '1.038', 'WEAPON3': '1.050', 'weapon3': '2.002', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.464', 'FRAGCOUNT': '39.000'} [2023-02-25 15:07:45,853][36156] DAMAGECOUNT value on done: 1692831.0 [2023-02-25 15:07:45,854][36156] Sum rewards: 55.392, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.152', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.068', 'AMMO3': '0.156', 'weapon5': '0.190', 'WEAPON5': '0.300', 'AMMO4': '0.340', 'weapon2': '0.354', 'WEAPON4': '0.450', 'weapon4': '0.904', 'WEAPON3': '0.950', 'weapon3': '1.902', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.185', 'FRAGCOUNT': '50.000'} [2023-02-25 15:07:46,211][36156] DAMAGECOUNT value on done: 1669994.0 [2023-02-25 15:07:46,211][36156] Sum rewards: 55.659, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.845', 'AMMO5': '0.005', 'AMMO2': '0.034', 'AMMO3': '0.127', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'WEAPON4': '0.200', 'weapon5': '0.288', 'weapon2': '0.388', 'weapon4': '0.504', 'WEAPON3': '0.850', 'weapon3': '2.580', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.689', 'FRAGCOUNT': '45.000'} [2023-02-25 15:07:46,533][36156] DAMAGECOUNT value on done: 1690266.0 [2023-02-25 15:07:46,534][36156] Sum rewards: 72.585, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.985', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.086', 'AMMO4': '0.099', 'weapon4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon2': '0.240', 'WEAPON3': '1.100', 'weapon3': '3.340', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '60.000'} [2023-02-25 15:07:46,894][36156] DAMAGECOUNT value on done: 1675311.0 [2023-02-25 15:07:46,894][36156] Sum rewards: 56.431, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.690', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.136', 'AMMO3': '0.171', 'weapon5': '0.198', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.580', 'weapon4': '0.690', 'WEAPON3': '1.000', 'weapon3': '2.106', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.899', 'FRAGCOUNT': '49.000'} [2023-02-25 15:07:47,558][36138] Updated weights for policy 0, policy_version 59443 (0.0010) [2023-02-25 15:07:49,729][36114] Fps is (10 sec: 12287.9, 60 sec: 11946.7, 300 sec: 13051.7). Total num frames: 243503104. Throughput: 0: 3060.4. Samples: 23374014. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:07:49,730][36114] Avg episode reward: [(0, '59.211')] [2023-02-25 15:07:49,820][36139] DAMAGECOUNT value on done: 1682286.0 [2023-02-25 15:07:49,820][36139] Sum rewards: 58.825, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.652', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.128', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.292', 'weapon4': '0.522', 'WEAPON3': '1.550', 'weapon3': '2.762', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '14.982', 'FRAGCOUNT': '53.000'} [2023-02-25 15:07:50,138][36139] DAMAGECOUNT value on done: 1682570.0 [2023-02-25 15:07:50,140][36139] Sum rewards: 49.571, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.564', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.177', 'weapon5': '0.234', 'weapon4': '0.430', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.770', 'WEAPON3': '1.000', 'weapon3': '2.324', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.478', 'FRAGCOUNT': '42.000'} [2023-02-25 15:07:50,185][36155] DAMAGECOUNT value on done: 1676198.0 [2023-02-25 15:07:50,185][36155] Sum rewards: 56.333, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.590', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO3': '0.138', 'AMMO4': '0.188', 'weapon2': '0.200', 'weapon5': '0.290', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'WEAPON4': '0.800', 'weapon3': '1.332', 'weapon4': '1.478', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.132', 'FRAGCOUNT': '49.000'} [2023-02-25 15:07:50,611][36155] DAMAGECOUNT value on done: 1676177.0 [2023-02-25 15:07:50,611][36155] Sum rewards: 62.896, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.700', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'weapon4': '0.138', 'AMMO3': '0.157', 'WEAPON4': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.000', 'HITCOUNT': '3.170', 'weapon3': '3.262', 'DAMAGECOUNT': '14.886', 'FRAGCOUNT': '53.000'} [2023-02-25 15:07:50,810][36139] DAMAGECOUNT value on done: 1689818.0 [2023-02-25 15:07:50,811][36139] Sum rewards: 55.096, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.914', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.056', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'WEAPON4': '0.200', 'weapon4': '0.412', 'weapon2': '0.684', 'WEAPON3': '0.800', 'weapon3': '2.694', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.062', 'FRAGCOUNT': '46.000'} [2023-02-25 15:07:50,914][36138] Updated weights for policy 0, policy_version 59453 (0.0010) [2023-02-25 15:07:51,169][36139] DAMAGECOUNT value on done: 1688648.0 [2023-02-25 15:07:51,170][36139] Sum rewards: 56.438, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.492', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'WEAPON4': '0.300', 'weapon2': '0.388', 'weapon4': '0.690', 'WEAPON3': '0.800', 'weapon3': '2.674', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.422', 'FRAGCOUNT': '46.000'} [2023-02-25 15:07:51,626][36155] DAMAGECOUNT value on done: 1694863.0 [2023-02-25 15:07:51,626][36155] Sum rewards: 68.346, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.276', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.148', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'weapon2': '0.284', 'weapon4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.074', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.598', 'FRAGCOUNT': '58.000'} [2023-02-25 15:07:51,966][36155] DAMAGECOUNT value on done: 1678505.0 [2023-02-25 15:07:51,967][36155] Sum rewards: 59.794, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.342', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.094', 'AMMO4': '0.113', 'AMMO3': '0.137', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.402', 'WEAPON3': '0.750', 'weapon2': '0.790', 'weapon3': '2.558', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.970', 'FRAGCOUNT': '47.000'} [2023-02-25 15:07:52,427][36154] DAMAGECOUNT value on done: 1685435.0 [2023-02-25 15:07:52,428][36154] Sum rewards: 55.765, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.453', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.047', 'AMMO3': '0.161', 'weapon2': '0.232', 'AMMO4': '0.237', 'weapon5': '0.246', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'weapon4': '1.190', 'weapon3': '1.952', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.519', 'FRAGCOUNT': '48.500'} [2023-02-25 15:07:52,765][36154] DAMAGECOUNT value on done: 1662048.0 [2023-02-25 15:07:52,765][36154] Sum rewards: 52.626, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.138', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.037', 'AMMO4': '0.185', 'AMMO3': '0.199', 'weapon5': '0.222', 'weapon2': '0.250', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.410', 'WEAPON3': '1.250', 'weapon3': '2.786', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '14.292', 'FRAGCOUNT': '47.500'} [2023-02-25 15:07:53,173][36154] DAMAGECOUNT value on done: 1696976.0 [2023-02-25 15:07:53,174][36154] Sum rewards: 62.768, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.232', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.052', 'weapon7': '0.056', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.264', 'weapon4': '0.588', 'WEAPON3': '0.950', 'weapon3': '2.780', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.784', 'FRAGCOUNT': '51.000'} [2023-02-25 15:07:53,504][36154] DAMAGECOUNT value on done: 1675634.0 [2023-02-25 15:07:53,504][36154] Sum rewards: 61.926, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.980', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.086', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon4': '0.430', 'weapon2': '0.502', 'WEAPON3': '1.200', 'weapon3': '2.768', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.114', 'FRAGCOUNT': '52.000'} [2023-02-25 15:07:54,130][36138] Updated weights for policy 0, policy_version 59463 (0.0010) [2023-02-25 15:07:54,317][36141] DAMAGECOUNT value on done: 1684415.0 [2023-02-25 15:07:54,318][36141] Sum rewards: 51.639, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.962', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon7': '0.076', 'AMMO4': '0.097', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.156', 'AMMO3': '0.159', 'WEAPON7': '0.200', 'weapon2': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.708', 'WEAPON3': '0.950', 'weapon3': '2.072', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '12.750', 'FRAGCOUNT': '43.000'} [2023-02-25 15:07:54,565][36141] DAMAGECOUNT value on done: 1679424.0 [2023-02-25 15:07:54,566][36141] Sum rewards: 64.218, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.440', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.140', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.486', 'weapon2': '0.516', 'WEAPON3': '1.150', 'weapon3': '2.466', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.251', 'FRAGCOUNT': '54.000'} [2023-02-25 15:07:54,635][36141] DAMAGECOUNT value on done: 1690799.0 [2023-02-25 15:07:54,636][36141] Sum rewards: 62.745, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.623', 'ARMOR': '0.004', 'AMMO5': '0.009', 'weapon5': '0.038', 'AMMO2': '0.043', 'AMMO3': '0.154', 'WEAPON5': '0.200', 'weapon4': '0.212', 'AMMO4': '0.216', 'WEAPON4': '0.350', 'weapon2': '0.448', 'WEAPON3': '1.000', 'weapon3': '3.084', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '52.000'} [2023-02-25 15:07:54,729][36114] Fps is (10 sec: 12288.1, 60 sec: 12083.2, 300 sec: 13023.9). Total num frames: 243564544. Throughput: 0: 3067.5. Samples: 23383120. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:07:54,730][36114] Avg episode reward: [(0, '59.180')] [2023-02-25 15:07:54,890][36141] DAMAGECOUNT value on done: 1660114.0 [2023-02-25 15:07:54,891][36141] Sum rewards: 39.484, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.720', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.048', 'AMMO4': '0.062', 'weapon7': '0.072', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.414', 'WEAPON3': '0.600', 'weapon4': '0.880', 'weapon3': '1.606', 'HITCOUNT': '1.910', 'DAMAGECOUNT': '8.559', 'FRAGCOUNT': '35.000'} [2023-02-25 15:07:57,312][36138] Updated weights for policy 0, policy_version 59473 (0.0009) [2023-02-25 15:07:58,915][36157] DAMAGECOUNT value on done: 1700285.0 [2023-02-25 15:07:58,916][36157] Sum rewards: 57.597, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.094', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.132', 'AMMO3': '0.160', 'weapon5': '0.216', 'WEAPON5': '0.250', 'weapon4': '0.276', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'weapon3': '2.914', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.018', 'FRAGCOUNT': '48.000'} [2023-02-25 15:07:59,237][36157] DAMAGECOUNT value on done: 1679796.0 [2023-02-25 15:07:59,237][36157] Sum rewards: 56.969, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.138', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.046', 'AMMO3': '0.154', 'AMMO4': '0.228', 'weapon5': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.524', 'weapon2': '0.628', 'WEAPON3': '0.900', 'weapon3': '2.308', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.646', 'FRAGCOUNT': '45.000'} [2023-02-25 15:07:59,729][36114] Fps is (10 sec: 12697.6, 60 sec: 12219.7, 300 sec: 13023.9). Total num frames: 243630080. Throughput: 0: 3075.7. Samples: 23402210. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:07:59,730][36114] Avg episode reward: [(0, '58.877')] [2023-02-25 15:07:59,870][36157] DAMAGECOUNT value on done: 1702428.0 [2023-02-25 15:07:59,870][36157] Sum rewards: 50.870, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.242', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.112', 'weapon5': '0.150', 'weapon2': '0.212', 'AMMO3': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.482', 'WEAPON3': '1.600', 'weapon3': '2.838', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.397', 'FRAGCOUNT': '47.500'} [2023-02-25 15:08:00,177][36157] DAMAGECOUNT value on done: 1686866.0 [2023-02-25 15:08:00,178][36157] Sum rewards: 63.575, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.415', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon5': '0.166', 'AMMO3': '0.202', 'AMMO4': '0.214', 'weapon2': '0.322', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.482', 'WEAPON3': '1.250', 'weapon3': '2.758', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '54.000'} [2023-02-25 15:08:00,387][36140] DAMAGECOUNT value on done: 1694605.0 [2023-02-25 15:08:00,388][36140] Sum rewards: 70.642, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.495', 'AMMO2': '0.003', 'AMMO4': '0.013', 'weapon4': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.189', 'weapon2': '0.338', 'WEAPON3': '1.200', 'weapon3': '3.466', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '58.000'} [2023-02-25 15:08:00,438][36140] DAMAGECOUNT value on done: 1685148.0 [2023-02-25 15:08:00,439][36140] Sum rewards: 55.189, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.501', 'AMMO5': '0.013', 'AMMO2': '0.038', 'AMMO3': '0.138', 'AMMO4': '0.191', 'weapon5': '0.232', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.466', 'WEAPON4': '0.500', 'WEAPON3': '0.800', 'weapon4': '1.118', 'weapon3': '1.872', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.791', 'FRAGCOUNT': '45.000'} [2023-02-25 15:08:00,485][36138] Updated weights for policy 0, policy_version 59483 (0.0009) [2023-02-25 15:08:00,709][36140] DAMAGECOUNT value on done: 1669648.0 [2023-02-25 15:08:00,709][36140] Sum rewards: 62.841, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.625', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon2': '0.196', 'AMMO3': '0.215', 'weapon5': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.488', 'WEAPON3': '1.250', 'weapon3': '2.672', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.816', 'FRAGCOUNT': '54.000'} [2023-02-25 15:08:00,777][36140] DAMAGECOUNT value on done: 1684107.0 [2023-02-25 15:08:00,778][36140] Sum rewards: 62.535, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.330', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'weapon4': '0.180', 'AMMO3': '0.194', 'weapon2': '0.372', 'WEAPON3': '1.200', 'weapon3': '3.208', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.828', 'FRAGCOUNT': '52.000'} [2023-02-25 15:08:03,178][36154] Large shaping reward 2.552 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.501, 167.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 15:08:03,602][36138] Updated weights for policy 0, policy_version 59493 (0.0009) [2023-02-25 15:08:04,729][36114] Fps is (10 sec: 13107.1, 60 sec: 12356.3, 300 sec: 13010.0). Total num frames: 243695616. Throughput: 0: 3085.9. Samples: 23421978. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:08:04,730][36114] Avg episode reward: [(0, '58.885')] [2023-02-25 15:08:05,277][36142] DAMAGECOUNT value on done: 1681482.0 [2023-02-25 15:08:05,277][36142] Sum rewards: 58.974, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.640', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.172', 'weapon2': '0.182', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.598', 'WEAPON3': '1.300', 'weapon3': '2.790', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.564', 'FRAGCOUNT': '50.000'} [2023-02-25 15:08:05,605][36142] DAMAGECOUNT value on done: 1668856.0 [2023-02-25 15:08:05,605][36142] Sum rewards: 53.711, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.770', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon4': '0.102', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'weapon2': '0.310', 'WEAPON3': '1.200', 'HITCOUNT': '2.910', 'weapon3': '3.390', 'DAMAGECOUNT': '13.740', 'FRAGCOUNT': '46.000'} [2023-02-25 15:08:06,211][36142] DAMAGECOUNT value on done: 1677965.0 [2023-02-25 15:08:06,212][36142] Sum rewards: 62.606, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.581', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.059', 'AMMO3': '0.175', 'weapon2': '0.184', 'weapon5': '0.224', 'AMMO4': '0.294', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.570', 'WEAPON3': '1.050', 'weapon3': '2.752', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.930', 'FRAGCOUNT': '54.000'} [2023-02-25 15:08:06,524][36142] DAMAGECOUNT value on done: 1689280.0 [2023-02-25 15:08:06,525][36142] Sum rewards: 67.173, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.620', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.122', 'AMMO3': '0.197', 'weapon4': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.402', 'WEAPON3': '1.150', 'weapon3': '3.008', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '57.000'} [2023-02-25 15:08:06,728][36138] Updated weights for policy 0, policy_version 59503 (0.0010) [2023-02-25 15:08:06,914][36156] DAMAGECOUNT value on done: 1698718.0 [2023-02-25 15:08:06,915][36156] Sum rewards: 70.121, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.290', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon2': '0.212', 'AMMO3': '0.286', 'WEAPON3': '1.700', 'weapon3': '3.590', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.661', 'FRAGCOUNT': '61.000'} [2023-02-25 15:08:07,221][36156] DAMAGECOUNT value on done: 1675445.0 [2023-02-25 15:08:07,221][36156] Sum rewards: 66.155, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.840', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'weapon4': '0.222', 'AMMO3': '0.224', 'weapon2': '0.494', 'WEAPON3': '1.350', 'weapon3': '3.050', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '56.000'} [2023-02-25 15:08:07,535][36156] DAMAGECOUNT value on done: 1695800.0 [2023-02-25 15:08:07,536][36156] Sum rewards: 65.150, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.445', 'AMMO5': '0.013', 'ARMOR': '0.016', 'AMMO2': '0.036', 'AMMO4': '0.182', 'AMMO3': '0.191', 'weapon5': '0.234', 'weapon2': '0.332', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.876', 'WEAPON3': '1.200', 'weapon3': '2.262', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '55.000'} [2023-02-25 15:08:07,863][36156] DAMAGECOUNT value on done: 1679920.0 [2023-02-25 15:08:07,863][36156] Sum rewards: 59.316, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.637', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.119', 'WEAPON5': '0.200', 'weapon5': '0.238', 'WEAPON4': '0.250', 'weapon4': '0.418', 'weapon2': '0.704', 'WEAPON3': '0.900', 'weapon3': '2.498', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '13.827', 'FRAGCOUNT': '50.000'} [2023-02-25 15:08:09,729][36114] Fps is (10 sec: 13107.3, 60 sec: 12492.8, 300 sec: 13010.0). Total num frames: 243761152. Throughput: 0: 3098.8. Samples: 23431842. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:08:09,730][36114] Avg episode reward: [(0, '58.582')] [2023-02-25 15:08:09,816][36138] Updated weights for policy 0, policy_version 59513 (0.0009) [2023-02-25 15:08:10,626][36139] DAMAGECOUNT value on done: 1686851.0 [2023-02-25 15:08:10,627][36139] Sum rewards: 60.315, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.460', 'AMMO5': '0.003', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon4': '0.088', 'AMMO4': '0.091', 'AMMO3': '0.130', 'weapon2': '0.558', 'WEAPON3': '0.900', 'HITCOUNT': '2.990', 'weapon3': '3.138', 'DAMAGECOUNT': '13.695', 'FRAGCOUNT': '49.000'} [2023-02-25 15:08:10,960][36139] DAMAGECOUNT value on done: 1687583.0 [2023-02-25 15:08:10,960][36139] Sum rewards: 53.181, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.430', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.058', 'AMMO3': '0.209', 'weapon2': '0.226', 'weapon5': '0.284', 'AMMO4': '0.290', 'WEAPON5': '0.550', 'WEAPON4': '0.700', 'weapon4': '0.992', 'WEAPON3': '1.300', 'weapon3': '2.170', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.039', 'FRAGCOUNT': '49.000'} [2023-02-25 15:08:11,130][36155] DAMAGECOUNT value on done: 1681077.0 [2023-02-25 15:08:11,130][36155] Sum rewards: 60.791, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.515', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.072', 'AMMO3': '0.161', 'AMMO4': '0.194', 'WEAPON4': '0.200', 'weapon5': '0.212', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.200', 'HITCOUNT': '2.970', 'weapon3': '3.198', 'DAMAGECOUNT': '14.637', 'FRAGCOUNT': '52.000'} [2023-02-25 15:08:11,437][36155] DAMAGECOUNT value on done: 1681255.0 [2023-02-25 15:08:11,438][36155] Sum rewards: 60.649, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.780', 'AMMO2': '0.024', 'WEAPON4': '0.050', 'weapon4': '0.112', 'AMMO4': '0.119', 'weapon2': '0.234', 'AMMO3': '0.263', 'WEAPON3': '1.700', 'HITCOUNT': '3.460', 'weapon3': '3.484', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '54.000'} [2023-02-25 15:08:11,472][36139] DAMAGECOUNT value on done: 1694988.0 [2023-02-25 15:08:11,473][36139] Sum rewards: 61.703, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.078', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'weapon2': '0.168', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'weapon4': '0.436', 'WEAPON3': '1.400', 'weapon3': '3.060', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '54.000'} [2023-02-25 15:08:11,791][36139] DAMAGECOUNT value on done: 1694845.0 [2023-02-25 15:08:11,791][36139] Sum rewards: 68.568, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.308', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon5': '0.116', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon4': '0.298', 'WEAPON4': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.400', 'weapon3': '2.996', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '59.500'} [2023-02-25 15:08:12,366][36155] DAMAGECOUNT value on done: 1699667.0 [2023-02-25 15:08:12,366][36155] Sum rewards: 55.710, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.769', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon5': '0.102', 'AMMO4': '0.123', 'weapon4': '0.190', 'WEAPON4': '0.250', 'AMMO3': '0.261', 'weapon2': '0.278', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '3.050', 'weapon3': '3.126', 'DAMAGECOUNT': '14.412', 'FRAGCOUNT': '52.000'} [2023-02-25 15:08:12,670][36155] DAMAGECOUNT value on done: 1683992.0 [2023-02-25 15:08:12,670][36155] Sum rewards: 63.102, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.546', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.028', 'weapon5': '0.060', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon2': '0.334', 'WEAPON4': '0.350', 'weapon4': '0.584', 'WEAPON3': '1.200', 'weapon3': '2.784', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '54.000'} [2023-02-25 15:08:12,965][36138] Updated weights for policy 0, policy_version 59523 (0.0009) [2023-02-25 15:08:13,055][36154] DAMAGECOUNT value on done: 1690306.0 [2023-02-25 15:08:13,055][36154] Sum rewards: 56.050, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.858', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.057', 'weapon5': '0.122', 'AMMO3': '0.168', 'weapon2': '0.218', 'AMMO4': '0.284', 'weapon4': '0.306', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '3.108', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.613', 'FRAGCOUNT': '49.000'} [2023-02-25 15:08:13,370][36154] DAMAGECOUNT value on done: 1666141.0 [2023-02-25 15:08:13,371][36154] Sum rewards: 43.170, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.804', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon7': '0.040', 'weapon5': '0.158', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO4': '0.167', 'weapon2': '0.182', 'WEAPON7': '0.200', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.886', 'WEAPON3': '1.350', 'weapon3': '2.338', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '11.994', 'FRAGCOUNT': '40.000'} [2023-02-25 15:08:13,781][36154] DAMAGECOUNT value on done: 1702491.0 [2023-02-25 15:08:13,781][36154] Sum rewards: 65.811, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.391', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.056', 'AMMO4': '0.079', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'weapon2': '0.276', 'weapon4': '0.382', 'WEAPON3': '1.450', 'weapon3': '3.054', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '58.000'} [2023-02-25 15:08:14,090][36154] DAMAGECOUNT value on done: 1681109.0 [2023-02-25 15:08:14,091][36154] Sum rewards: 69.786, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.310', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.010', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'weapon4': '0.208', 'weapon2': '0.222', 'WEAPON3': '1.250', 'weapon3': '3.366', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '58.000'} [2023-02-25 15:08:14,729][36114] Fps is (10 sec: 13107.2, 60 sec: 12492.8, 300 sec: 12996.1). Total num frames: 243826688. Throughput: 0: 3164.7. Samples: 23451480. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:08:14,730][36114] Avg episode reward: [(0, '58.713')] [2023-02-25 15:08:14,908][36141] DAMAGECOUNT value on done: 1689729.0 [2023-02-25 15:08:14,909][36141] Sum rewards: 56.093, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.120', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.031', 'AMMO4': '0.157', 'AMMO3': '0.164', 'weapon5': '0.248', 'weapon2': '0.258', 'WEAPON5': '0.350', 'weapon4': '0.432', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.612', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.942', 'FRAGCOUNT': '47.500'} [2023-02-25 15:08:15,098][36141] DAMAGECOUNT value on done: 1684388.0 [2023-02-25 15:08:15,099][36141] Sum rewards: 55.961, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.600', 'AMMO5': '0.005', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'WEAPON4': '0.250', 'weapon4': '0.344', 'weapon2': '0.434', 'WEAPON3': '1.100', 'weapon3': '2.828', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '14.847', 'FRAGCOUNT': '46.000'} [2023-02-25 15:08:15,225][36141] DAMAGECOUNT value on done: 1695694.0 [2023-02-25 15:08:15,225][36141] Sum rewards: 52.447, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.152', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon5': '0.176', 'weapon2': '0.194', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.818', 'WEAPON3': '1.300', 'weapon3': '2.528', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.325', 'FRAGCOUNT': '46.000'} [2023-02-25 15:08:15,399][36141] DAMAGECOUNT value on done: 1666146.0 [2023-02-25 15:08:15,399][36141] Sum rewards: 73.858, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.242', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.130', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.260', 'weapon2': '0.310', 'WEAPON3': '0.950', 'weapon3': '3.122', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '59.000'} [2023-02-25 15:08:16,096][36138] Updated weights for policy 0, policy_version 59533 (0.0009) [2023-02-25 15:08:19,221][36138] Updated weights for policy 0, policy_version 59543 (0.0009) [2023-02-25 15:08:19,433][36157] DAMAGECOUNT value on done: 1704438.0 [2023-02-25 15:08:19,433][36157] Sum rewards: 50.110, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.002', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon7': '0.048', 'AMMO4': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.124', 'weapon5': '0.198', 'WEAPON7': '0.200', 'weapon2': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '0.800', 'weapon4': '1.162', 'weapon3': '1.952', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.459', 'FRAGCOUNT': '41.500'} [2023-02-25 15:08:19,729][36114] Fps is (10 sec: 13107.1, 60 sec: 12561.1, 300 sec: 12996.1). Total num frames: 243892224. Throughput: 0: 3208.6. Samples: 23471198. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:08:19,730][36114] Avg episode reward: [(0, '58.632')] [2023-02-25 15:08:19,764][36157] DAMAGECOUNT value on done: 1685741.0 [2023-02-25 15:08:19,764][36157] Sum rewards: 66.005, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.530', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.048', 'AMMO4': '0.076', 'weapon4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.227', 'weapon2': '0.368', 'WEAPON3': '1.450', 'weapon3': '3.318', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '55.000'} [2023-02-25 15:08:20,437][36157] DAMAGECOUNT value on done: 1708073.0 [2023-02-25 15:08:20,438][36157] Sum rewards: 66.667, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.798', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.074', 'AMMO4': '0.144', 'weapon5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.290', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '57.000'} [2023-02-25 15:08:20,736][36157] DAMAGECOUNT value on done: 1692265.0 [2023-02-25 15:08:20,737][36157] Sum rewards: 59.784, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.654', 'AMMO5': '0.007', 'ARMOR': '0.013', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.162', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'weapon4': '0.300', 'weapon2': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.902', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.197', 'FRAGCOUNT': '52.000'} [2023-02-25 15:08:20,852][36140] DAMAGECOUNT value on done: 1700475.0 [2023-02-25 15:08:20,852][36140] Sum rewards: 69.286, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.998', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.046', 'weapon5': '0.112', 'AMMO4': '0.151', 'weapon2': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'WEAPON3': '1.450', 'HITCOUNT': '3.320', 'weapon3': '3.494', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '60.000'} [2023-02-25 15:08:20,902][36140] DAMAGECOUNT value on done: 1689885.0 [2023-02-25 15:08:20,903][36140] Sum rewards: 53.958, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.776', 'AMMO5': '0.008', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.148', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.348', 'weapon4': '0.490', 'WEAPON3': '0.950', 'HITCOUNT': '2.720', 'weapon3': '2.816', 'DAMAGECOUNT': '14.211', 'FRAGCOUNT': '45.000'} [2023-02-25 15:08:21,034][36142] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 15:08:21,164][36140] DAMAGECOUNT value on done: 1674535.0 [2023-02-25 15:08:21,164][36140] Sum rewards: 60.747, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.600', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.090', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon2': '0.490', 'weapon4': '0.698', 'WEAPON3': '1.250', 'weapon3': '2.474', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.661', 'FRAGCOUNT': '53.000'} [2023-02-25 15:08:21,212][36140] DAMAGECOUNT value on done: 1689476.0 [2023-02-25 15:08:21,212][36140] Sum rewards: 70.217, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.112', 'weapon4': '0.114', 'AMMO3': '0.134', 'HEALTH': '0.492', 'weapon2': '0.582', 'WEAPON3': '0.850', 'weapon3': '3.038', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.897', 'FRAGCOUNT': '56.000'} [2023-02-25 15:08:22,391][36138] Updated weights for policy 0, policy_version 59553 (0.0010) [2023-02-25 15:08:24,729][36114] Fps is (10 sec: 13107.2, 60 sec: 12697.6, 300 sec: 12982.2). Total num frames: 243957760. Throughput: 0: 3214.8. Samples: 23480986. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 15:08:24,730][36114] Avg episode reward: [(0, '58.790')] [2023-02-25 15:08:25,550][36138] Updated weights for policy 0, policy_version 59563 (0.0010) [2023-02-25 15:08:26,028][36142] DAMAGECOUNT value on done: 1687963.0 [2023-02-25 15:08:26,029][36142] Sum rewards: 71.349, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.320', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon5': '0.168', 'weapon2': '0.194', 'AMMO4': '0.201', 'AMMO3': '0.219', 'weapon4': '0.246', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.048', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.443', 'FRAGCOUNT': '61.000'} [2023-02-25 15:08:26,363][36142] DAMAGECOUNT value on done: 1674556.0 [2023-02-25 15:08:26,363][36142] Sum rewards: 64.636, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.472', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.066', 'weapon4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.236', 'weapon2': '0.482', 'WEAPON3': '1.500', 'weapon3': '3.054', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '56.000'} [2023-02-25 15:08:26,986][36142] DAMAGECOUNT value on done: 1683544.0 [2023-02-25 15:08:26,987][36142] Sum rewards: 63.618, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.512', 'AMMO5': '0.008', 'AMMO2': '0.014', 'weapon4': '0.028', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'weapon5': '0.152', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'weapon2': '0.532', 'WEAPON3': '1.350', 'weapon3': '3.094', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '53.000'} [2023-02-25 15:08:27,320][36142] DAMAGECOUNT value on done: 1694527.0 [2023-02-25 15:08:27,321][36142] Sum rewards: 67.414, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.350', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.114', 'AMMO3': '0.207', 'weapon2': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.240', 'weapon3': '3.372', 'DAMAGECOUNT': '15.741', 'FRAGCOUNT': '57.000'} [2023-02-25 15:08:27,507][36156] DAMAGECOUNT value on done: 1703764.0 [2023-02-25 15:08:27,507][36156] Sum rewards: 62.509, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.030', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.196', 'weapon2': '0.378', 'WEAPON3': '1.300', 'HITCOUNT': '3.180', 'weapon3': '3.336', 'DAMAGECOUNT': '15.138', 'FRAGCOUNT': '53.000'} [2023-02-25 15:08:27,837][36156] DAMAGECOUNT value on done: 1680462.0 [2023-02-25 15:08:27,837][36156] Sum rewards: 62.001, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.790', 'AMMO2': '0.022', 'WEAPON4': '0.100', 'AMMO4': '0.109', 'weapon4': '0.164', 'AMMO3': '0.205', 'weapon2': '0.414', 'WEAPON3': '1.250', 'HITCOUNT': '3.190', 'weapon3': '3.286', 'DAMAGECOUNT': '15.051', 'FRAGCOUNT': '52.000'} [2023-02-25 15:08:28,139][36156] DAMAGECOUNT value on done: 1700751.0 [2023-02-25 15:08:28,140][36156] Sum rewards: 57.622, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.100', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.030', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.206', 'weapon2': '0.276', 'WEAPON3': '1.200', 'HITCOUNT': '3.080', 'weapon3': '3.542', 'DAMAGECOUNT': '14.853', 'FRAGCOUNT': '48.000'} [2023-02-25 15:08:28,279][36157] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 15:08:28,467][36156] DAMAGECOUNT value on done: 1685471.0 [2023-02-25 15:08:28,468][36156] Sum rewards: 67.107, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.995', 'AMMO5': '0.007', 'AMMO2': '0.008', 'weapon4': '0.040', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon2': '0.508', 'WEAPON3': '1.150', 'weapon3': '3.206', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '55.000'} [2023-02-25 15:08:28,799][36138] Updated weights for policy 0, policy_version 59573 (0.0010) [2023-02-25 15:08:29,729][36114] Fps is (10 sec: 12697.8, 60 sec: 12765.9, 300 sec: 12968.4). Total num frames: 244019200. Throughput: 0: 3215.2. Samples: 23500054. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 15:08:29,729][36114] Avg episode reward: [(0, '59.196')] [2023-02-25 15:08:30,911][36157] Large shaping reward 2.517 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.468, 156.0), ('AMMO3', -0.001, -2.0)] [2023-02-25 15:08:31,423][36139] DAMAGECOUNT value on done: 1691360.0 [2023-02-25 15:08:31,424][36139] Sum rewards: 59.438, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.005', 'AMMO2': '0.042', 'HEALTH': '0.055', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.121', 'WEAPON4': '0.150', 'AMMO4': '0.212', 'weapon4': '0.260', 'WEAPON3': '0.700', 'weapon2': '0.844', 'weapon3': '2.664', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.527', 'FRAGCOUNT': '46.000'} [2023-02-25 15:08:31,702][36155] DAMAGECOUNT value on done: 1685982.0 [2023-02-25 15:08:31,703][36155] Sum rewards: 54.158, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.230', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.053', 'AMMO3': '0.143', 'weapon5': '0.244', 'AMMO4': '0.267', 'weapon2': '0.306', 'weapon4': '0.482', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '0.950', 'weapon3': '2.652', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.715', 'FRAGCOUNT': '46.000'} [2023-02-25 15:08:31,750][36139] DAMAGECOUNT value on done: 1692125.0 [2023-02-25 15:08:31,750][36139] Sum rewards: 41.189, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.168', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon2': '0.228', 'weapon5': '0.236', 'AMMO3': '0.244', 'AMMO4': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.488', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.646', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.626', 'FRAGCOUNT': '40.000'} [2023-02-25 15:08:31,948][36138] Updated weights for policy 0, policy_version 59583 (0.0010) [2023-02-25 15:08:32,019][36155] DAMAGECOUNT value on done: 1686428.0 [2023-02-25 15:08:32,020][36155] Sum rewards: 55.901, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.822', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.076', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.228', 'AMMO3': '0.338', 'weapon4': '0.388', 'WEAPON3': '2.050', 'weapon3': '2.962', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.519', 'FRAGCOUNT': '54.000'} [2023-02-25 15:08:32,280][36139] DAMAGECOUNT value on done: 1700336.0 [2023-02-25 15:08:32,280][36139] Sum rewards: 62.356, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.249', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.172', 'AMMO4': '0.179', 'AMMO3': '0.196', 'weapon2': '0.322', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.576', 'WEAPON3': '1.150', 'weapon3': '2.642', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.044', 'FRAGCOUNT': '54.000'} [2023-02-25 15:08:32,602][36139] DAMAGECOUNT value on done: 1699830.0 [2023-02-25 15:08:32,602][36139] Sum rewards: 58.712, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.731', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon5': '0.116', 'AMMO3': '0.199', 'AMMO4': '0.209', 'weapon4': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.532', 'WEAPON3': '1.100', 'weapon3': '2.874', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.955', 'FRAGCOUNT': '50.500'} [2023-02-25 15:08:32,908][36155] DAMAGECOUNT value on done: 1704364.0 [2023-02-25 15:08:32,908][36155] Sum rewards: 60.938, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.852', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.016', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon4': '0.370', 'weapon2': '0.528', 'WEAPON3': '1.100', 'HITCOUNT': '2.920', 'weapon3': '2.930', 'DAMAGECOUNT': '14.091', 'FRAGCOUNT': '52.000'} [2023-02-25 15:08:33,226][36155] DAMAGECOUNT value on done: 1688652.0 [2023-02-25 15:08:33,227][36155] Sum rewards: 58.465, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.778', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.062', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon2': '0.216', 'WEAPON4': '0.300', 'weapon4': '0.586', 'WEAPON3': '1.150', 'weapon3': '2.858', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.980', 'FRAGCOUNT': '51.000'} [2023-02-25 15:08:33,810][36154] DAMAGECOUNT value on done: 1695891.0 [2023-02-25 15:08:33,810][36154] Sum rewards: 61.029, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.092', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.058', 'AMMO3': '0.166', 'weapon2': '0.254', 'weapon5': '0.282', 'AMMO4': '0.292', 'weapon4': '0.414', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '0.950', 'weapon3': '2.704', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '53.000'} [2023-02-25 15:08:34,118][36154] DAMAGECOUNT value on done: 1671377.0 [2023-02-25 15:08:34,119][36154] Sum rewards: 66.881, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.699', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.171', 'WEAPON4': '0.250', 'weapon4': '0.502', 'weapon2': '0.658', 'WEAPON3': '1.100', 'weapon3': '2.532', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '15.708', 'FRAGCOUNT': '55.000'} [2023-02-25 15:08:34,526][36154] DAMAGECOUNT value on done: 1707999.0 [2023-02-25 15:08:34,527][36154] Sum rewards: 66.112, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.635', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO3': '0.153', 'AMMO4': '0.178', 'weapon5': '0.184', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.406', 'weapon2': '0.444', 'WEAPON3': '0.950', 'weapon3': '2.748', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '55.000'} [2023-02-25 15:08:34,733][36114] Fps is (10 sec: 12692.6, 60 sec: 12833.3, 300 sec: 12954.3). Total num frames: 244084736. Throughput: 0: 3233.7. Samples: 23519542. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 15:08:34,733][36114] Avg episode reward: [(0, '59.324')] [2023-02-25 15:08:34,851][36154] DAMAGECOUNT value on done: 1687203.0 [2023-02-25 15:08:34,851][36154] Sum rewards: 71.293, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.255', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon2': '0.166', 'weapon5': '0.178', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.978', 'WEAPON3': '1.200', 'weapon3': '2.452', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '59.000'} [2023-02-25 15:08:35,046][36138] Updated weights for policy 0, policy_version 59593 (0.0009) [2023-02-25 15:08:35,703][36141] DAMAGECOUNT value on done: 1694207.0 [2023-02-25 15:08:35,703][36141] Sum rewards: 52.597, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.245', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon7': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.120', 'AMMO4': '0.176', 'AMMO3': '0.214', 'weapon2': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.620', 'WEAPON3': '1.250', 'weapon3': '2.452', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '13.434', 'FRAGCOUNT': '47.000'} [2023-02-25 15:08:35,874][36141] DAMAGECOUNT value on done: 1688677.0 [2023-02-25 15:08:35,875][36141] Sum rewards: 53.555, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.860', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.098', 'AMMO4': '0.142', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.330', 'weapon2': '0.392', 'WEAPON3': '1.300', 'HITCOUNT': '2.790', 'weapon3': '3.016', 'DAMAGECOUNT': '12.867', 'FRAGCOUNT': '47.000'} [2023-02-25 15:08:36,049][36141] DAMAGECOUNT value on done: 1701398.0 [2023-02-25 15:08:36,049][36141] Sum rewards: 62.754, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.542', 'ARMOR': '0.004', 'AMMO5': '0.028', 'AMMO2': '0.060', 'AMMO3': '0.200', 'weapon2': '0.270', 'AMMO4': '0.298', 'weapon5': '0.368', 'weapon4': '0.504', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.472', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '55.500'} [2023-02-25 15:08:36,219][36141] DAMAGECOUNT value on done: 1671831.0 [2023-02-25 15:08:36,220][36141] Sum rewards: 70.526, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.200', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.222', 'weapon2': '0.404', 'weapon4': '0.436', 'WEAPON3': '1.400', 'weapon3': '2.876', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '59.000'} [2023-02-25 15:08:38,215][36138] Updated weights for policy 0, policy_version 59603 (0.0010) [2023-02-25 15:08:39,729][36114] Fps is (10 sec: 13106.8, 60 sec: 12834.1, 300 sec: 12954.5). Total num frames: 244150272. Throughput: 0: 3247.1. Samples: 23529242. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 15:08:39,730][36114] Avg episode reward: [(0, '59.590')] [2023-02-25 15:08:40,271][36157] DAMAGECOUNT value on done: 1710083.0 [2023-02-25 15:08:40,271][36157] Sum rewards: 63.593, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.640', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.154', 'AMMO4': '0.182', 'weapon4': '0.184', 'AMMO3': '0.226', 'weapon2': '0.272', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.102', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '56.500'} [2023-02-25 15:08:40,598][36157] DAMAGECOUNT value on done: 1690955.0 [2023-02-25 15:08:40,599][36157] Sum rewards: 57.268, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.706', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO4': '0.187', 'AMMO3': '0.192', 'weapon5': '0.226', 'weapon2': '0.366', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.658', 'WEAPON3': '1.100', 'weapon3': '2.316', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.534', 'FRAGCOUNT': '50.000'} [2023-02-25 15:08:41,226][36157] DAMAGECOUNT value on done: 1713617.0 [2023-02-25 15:08:41,226][36157] Sum rewards: 68.405, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.618', 'AMMO5': '0.007', 'AMMO2': '0.031', 'AMMO4': '0.153', 'weapon5': '0.158', 'weapon2': '0.204', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.392', 'WEAPON3': '1.400', 'weapon3': '3.018', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '59.000'} [2023-02-25 15:08:41,366][36138] Updated weights for policy 0, policy_version 59613 (0.0009) [2023-02-25 15:08:41,533][36157] DAMAGECOUNT value on done: 1697029.0 [2023-02-25 15:08:41,533][36157] Sum rewards: 56.592, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.490', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.005', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'weapon2': '0.660', 'WEAPON3': '1.250', 'weapon3': '3.098', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.292', 'FRAGCOUNT': '49.000'} [2023-02-25 15:08:41,621][36140] DAMAGECOUNT value on done: 1694826.0 [2023-02-25 15:08:41,622][36140] Sum rewards: 56.244, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.015', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.142', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.478', 'weapon2': '0.594', 'WEAPON3': '1.000', 'weapon3': '2.578', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.823', 'FRAGCOUNT': '45.500'} [2023-02-25 15:08:41,637][36140] DAMAGECOUNT value on done: 1705841.0 [2023-02-25 15:08:41,637][36140] Sum rewards: 62.428, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.813', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.062', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'weapon4': '0.356', 'weapon2': '0.438', 'WEAPON3': '1.150', 'weapon3': '2.962', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.098', 'FRAGCOUNT': '52.000'} [2023-02-25 15:08:41,983][36140] DAMAGECOUNT value on done: 1694269.0 [2023-02-25 15:08:41,983][36140] Sum rewards: 58.216, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.770', 'AMMO5': '0.007', 'AMMO2': '0.043', 'AMMO3': '0.139', 'AMMO4': '0.217', 'WEAPON5': '0.250', 'weapon5': '0.254', 'weapon2': '0.392', 'WEAPON4': '0.400', 'weapon4': '0.628', 'WEAPON3': '0.850', 'weapon3': '2.276', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.379', 'FRAGCOUNT': '50.000'} [2023-02-25 15:08:41,995][36140] DAMAGECOUNT value on done: 1679760.0 [2023-02-25 15:08:41,995][36140] Sum rewards: 64.041, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.308', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.034', 'AMMO3': '0.153', 'weapon5': '0.158', 'AMMO4': '0.171', 'weapon4': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.478', 'WEAPON3': '0.950', 'weapon3': '2.946', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '53.000'} [2023-02-25 15:08:43,263][36141] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 15:08:44,536][36138] Updated weights for policy 0, policy_version 59623 (0.0009) [2023-02-25 15:08:44,729][36114] Fps is (10 sec: 13112.3, 60 sec: 12902.4, 300 sec: 12954.5). Total num frames: 244215808. Throughput: 0: 3254.1. Samples: 23548644. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 15:08:44,730][36114] Avg episode reward: [(0, '59.793')] [2023-02-25 15:08:46,962][36142] DAMAGECOUNT value on done: 1692889.0 [2023-02-25 15:08:46,962][36142] Sum rewards: 59.263, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.858', 'AMMO5': '0.010', 'AMMO2': '0.043', 'AMMO3': '0.152', 'weapon5': '0.186', 'AMMO4': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.416', 'weapon4': '0.594', 'WEAPON3': '0.900', 'weapon3': '2.528', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.778', 'FRAGCOUNT': '50.000'} [2023-02-25 15:08:47,278][36142] DAMAGECOUNT value on done: 1679914.0 [2023-02-25 15:08:47,279][36142] Sum rewards: 65.823, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.442', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.162', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.418', 'weapon2': '0.438', 'WEAPON3': '1.250', 'weapon3': '2.734', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.074', 'FRAGCOUNT': '57.000'} [2023-02-25 15:08:47,772][36138] Updated weights for policy 0, policy_version 59633 (0.0009) [2023-02-25 15:08:47,864][36142] DAMAGECOUNT value on done: 1689517.0 [2023-02-25 15:08:47,865][36142] Sum rewards: 70.601, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.628', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.171', 'weapon2': '0.228', 'weapon5': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.416', 'WEAPON3': '1.100', 'weapon3': '2.814', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '58.000'} [2023-02-25 15:08:48,180][36142] DAMAGECOUNT value on done: 1699466.0 [2023-02-25 15:08:48,181][36142] Sum rewards: 56.234, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.033', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon7': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.161', 'AMMO4': '0.193', 'weapon2': '0.262', 'weapon5': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.674', 'WEAPON3': '0.900', 'weapon3': '2.152', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.787', 'FRAGCOUNT': '46.000'} [2023-02-25 15:08:48,324][36156] DAMAGECOUNT value on done: 1709411.0 [2023-02-25 15:08:48,324][36156] Sum rewards: 66.736, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.758', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.118', 'weapon2': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.252', 'weapon4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.202', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '59.000'} [2023-02-25 15:08:48,643][36156] DAMAGECOUNT value on done: 1685188.0 [2023-02-25 15:08:48,644][36156] Sum rewards: 55.294, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.170', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon4': '0.094', 'WEAPON4': '0.100', 'weapon2': '0.132', 'weapon5': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'WEAPON3': '1.450', 'HITCOUNT': '2.760', 'weapon3': '3.406', 'DAMAGECOUNT': '14.178', 'FRAGCOUNT': '49.000'} [2023-02-25 15:08:48,961][36156] DAMAGECOUNT value on done: 1706255.0 [2023-02-25 15:08:48,962][36156] Sum rewards: 66.923, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.440', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.042', 'AMMO4': '0.067', 'AMMO3': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.156', 'weapon2': '0.482', 'WEAPON3': '0.950', 'weapon3': '3.074', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '54.000'} [2023-02-25 15:08:49,280][36156] DAMAGECOUNT value on done: 1690952.0 [2023-02-25 15:08:49,280][36156] Sum rewards: 66.907, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.255', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.052', 'AMMO4': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.340', 'weapon4': '0.468', 'WEAPON3': '1.300', 'weapon3': '2.972', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '57.000'} [2023-02-25 15:08:49,729][36114] Fps is (10 sec: 13107.4, 60 sec: 12970.7, 300 sec: 12940.6). Total num frames: 244281344. Throughput: 0: 3242.6. Samples: 23567896. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 15:08:49,730][36114] Avg episode reward: [(0, '60.627')] [2023-02-25 15:08:50,919][36138] Updated weights for policy 0, policy_version 59643 (0.0009) [2023-02-25 15:08:52,084][36139] DAMAGECOUNT value on done: 1696393.0 [2023-02-25 15:08:52,085][36139] Sum rewards: 54.413, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.492', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.064', 'weapon5': '0.116', 'AMMO3': '0.154', 'AMMO4': '0.322', 'WEAPON5': '0.350', 'weapon2': '0.368', 'weapon4': '0.406', 'WEAPON4': '0.600', 'WEAPON3': '0.900', 'weapon3': '2.846', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.940', 'FRAGCOUNT': '46.000'} [2023-02-25 15:08:52,402][36139] DAMAGECOUNT value on done: 1697202.0 [2023-02-25 15:08:52,402][36139] Sum rewards: 61.522, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.902', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon2': '0.206', 'weapon4': '0.216', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'weapon5': '0.304', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.850', 'weapon3': '2.950', 'DAMAGECOUNT': '15.231', 'FRAGCOUNT': '55.000'} [2023-02-25 15:08:52,456][36155] DAMAGECOUNT value on done: 1691117.0 [2023-02-25 15:08:52,456][36155] Sum rewards: 56.473, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.799', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon5': '0.102', 'AMMO3': '0.196', 'AMMO4': '0.203', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.380', 'weapon4': '0.416', 'WEAPON3': '1.200', 'weapon3': '2.860', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '49.000'} [2023-02-25 15:08:52,765][36155] DAMAGECOUNT value on done: 1691931.0 [2023-02-25 15:08:52,766][36155] Sum rewards: 59.933, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.714', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.136', 'AMMO4': '0.147', 'weapon2': '0.196', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.358', 'WEAPON3': '1.450', 'weapon3': '3.048', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '52.000'} [2023-02-25 15:08:52,894][36139] DAMAGECOUNT value on done: 1705492.0 [2023-02-25 15:08:52,895][36139] Sum rewards: 57.472, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.914', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.108', 'weapon2': '0.148', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon4': '0.436', 'WEAPON3': '1.350', 'weapon3': '2.912', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.453', 'FRAGCOUNT': '50.000'} [2023-02-25 15:08:53,221][36139] DAMAGECOUNT value on done: 1705704.0 [2023-02-25 15:08:53,221][36139] Sum rewards: 65.235, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.796', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.148', 'AMMO4': '0.186', 'weapon2': '0.240', 'AMMO3': '0.242', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.508', 'WEAPON3': '1.450', 'weapon3': '2.792', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '57.000'} [2023-02-25 15:08:53,685][36155] DAMAGECOUNT value on done: 1708981.0 [2023-02-25 15:08:53,685][36155] Sum rewards: 51.441, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.670', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.180', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.430', 'weapon2': '0.460', 'WEAPON3': '1.150', 'weapon3': '2.728', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.851', 'FRAGCOUNT': '44.000'} [2023-02-25 15:08:53,983][36155] DAMAGECOUNT value on done: 1693434.0 [2023-02-25 15:08:53,983][36155] Sum rewards: 53.405, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.860', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.042', 'AMMO4': '0.212', 'AMMO3': '0.230', 'weapon5': '0.240', 'weapon2': '0.260', 'WEAPON5': '0.450', 'weapon4': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.666', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.346', 'FRAGCOUNT': '50.000'} [2023-02-25 15:08:54,085][36138] Updated weights for policy 0, policy_version 59653 (0.0009) [2023-02-25 15:08:54,572][36154] DAMAGECOUNT value on done: 1700721.0 [2023-02-25 15:08:54,573][36154] Sum rewards: 58.951, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.740', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.038', 'WEAPON5': '0.150', 'AMMO4': '0.182', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'weapon4': '0.290', 'weapon2': '0.554', 'WEAPON3': '1.050', 'weapon3': '2.958', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.490', 'FRAGCOUNT': '50.500'} [2023-02-25 15:08:54,729][36114] Fps is (10 sec: 13107.2, 60 sec: 13038.9, 300 sec: 12940.6). Total num frames: 244346880. Throughput: 0: 3240.4. Samples: 23577658. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 15:08:54,730][36114] Avg episode reward: [(0, '60.587')] [2023-02-25 15:08:54,892][36154] DAMAGECOUNT value on done: 1677175.0 [2023-02-25 15:08:54,893][36154] Sum rewards: 73.045, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.177', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.159', 'weapon5': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.482', 'weapon2': '0.538', 'WEAPON3': '0.900', 'weapon3': '2.568', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '59.000'} [2023-02-25 15:08:55,311][36154] DAMAGECOUNT value on done: 1712969.0 [2023-02-25 15:08:55,312][36154] Sum rewards: 57.635, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.388', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO3': '0.149', 'AMMO4': '0.193', 'weapon5': '0.218', 'WEAPON5': '0.300', 'weapon2': '0.472', 'WEAPON4': '0.500', 'weapon4': '0.640', 'WEAPON3': '0.950', 'weapon3': '2.404', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '49.000'} [2023-02-25 15:08:55,611][36154] DAMAGECOUNT value on done: 1692616.0 [2023-02-25 15:08:55,611][36154] Sum rewards: 63.520, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.811', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon5': '0.220', 'AMMO3': '0.243', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON4': '0.500', 'weapon4': '0.758', 'WEAPON3': '1.450', 'weapon3': '2.366', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.239', 'FRAGCOUNT': '57.000'} [2023-02-25 15:08:56,510][36141] DAMAGECOUNT value on done: 1699412.0 [2023-02-25 15:08:56,510][36141] Sum rewards: 54.274, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.496', 'AMMO5': '0.023', 'AMMO2': '0.041', 'AMMO3': '0.166', 'AMMO4': '0.206', 'weapon5': '0.244', 'weapon2': '0.458', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon4': '0.688', 'WEAPON3': '1.000', 'weapon3': '2.304', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '47.500'} [2023-02-25 15:08:56,711][36141] DAMAGECOUNT value on done: 1694380.0 [2023-02-25 15:08:56,711][36141] Sum rewards: 60.845, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.000', 'AMMO5': '0.021', 'AMMO2': '0.048', 'weapon4': '0.114', 'AMMO3': '0.192', 'AMMO4': '0.240', 'weapon5': '0.300', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'HITCOUNT': '2.890', 'weapon3': '2.940', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '52.500'} [2023-02-25 15:08:56,848][36141] DAMAGECOUNT value on done: 1707006.0 [2023-02-25 15:08:56,848][36141] Sum rewards: 63.047, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.029', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.230', 'weapon4': '0.404', 'WEAPON3': '1.450', 'weapon3': '2.942', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '54.000'} [2023-02-25 15:08:57,049][36141] DAMAGECOUNT value on done: 1676948.0 [2023-02-25 15:08:57,049][36141] Sum rewards: 59.110, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.730', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO3': '0.168', 'AMMO4': '0.190', 'weapon5': '0.234', 'weapon2': '0.310', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.676', 'WEAPON3': '1.000', 'weapon3': '2.478', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.351', 'FRAGCOUNT': '50.000'} [2023-02-25 15:08:57,245][36138] Updated weights for policy 0, policy_version 59663 (0.0009) [2023-02-25 15:08:59,729][36114] Fps is (10 sec: 12697.6, 60 sec: 12970.7, 300 sec: 12912.8). Total num frames: 244408320. Throughput: 0: 3238.7. Samples: 23597220. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 15:08:59,730][36114] Avg episode reward: [(0, '60.725')] [2023-02-25 15:09:00,400][36138] Updated weights for policy 0, policy_version 59673 (0.0010) [2023-02-25 15:09:01,064][36157] DAMAGECOUNT value on done: 1715199.0 [2023-02-25 15:09:01,065][36157] Sum rewards: 59.768, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.629', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.106', 'AMMO3': '0.146', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.320', 'weapon4': '0.522', 'WEAPON3': '0.900', 'weapon3': '2.810', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.348', 'FRAGCOUNT': '49.000'} [2023-02-25 15:09:01,378][36157] DAMAGECOUNT value on done: 1696211.0 [2023-02-25 15:09:01,378][36157] Sum rewards: 54.571, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.495', 'AMMO5': '0.004', 'weapon5': '0.020', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'weapon4': '0.134', 'weapon2': '0.260', 'AMMO3': '0.268', 'WEAPON4': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.294', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '15.768', 'FRAGCOUNT': '50.000'} [2023-02-25 15:09:02,073][36157] DAMAGECOUNT value on done: 1718416.0 [2023-02-25 15:09:02,073][36157] Sum rewards: 52.427, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.990', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.254', 'weapon4': '0.278', 'WEAPON3': '1.450', 'HITCOUNT': '3.040', 'weapon3': '3.152', 'DAMAGECOUNT': '14.397', 'FRAGCOUNT': '48.000'} [2023-02-25 15:09:02,389][36157] DAMAGECOUNT value on done: 1702969.0 [2023-02-25 15:09:02,390][36157] Sum rewards: 66.801, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.636', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.078', 'AMMO4': '0.102', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon4': '0.362', 'weapon2': '0.440', 'WEAPON3': '1.350', 'weapon3': '2.914', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '57.000'} [2023-02-25 15:09:02,468][36140] DAMAGECOUNT value on done: 1700426.0 [2023-02-25 15:09:02,468][36140] Sum rewards: 70.694, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.050', 'AMMO5': '0.003', 'ARMOR': '0.005', 'AMMO2': '0.018', 'weapon5': '0.056', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'weapon4': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon2': '0.258', 'WEAPON3': '1.300', 'weapon3': '3.326', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '61.000'} [2023-02-25 15:09:02,480][36140] DAMAGECOUNT value on done: 1711240.0 [2023-02-25 15:09:02,480][36140] Sum rewards: 56.784, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.804', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon5': '0.200', 'AMMO3': '0.218', 'AMMO4': '0.230', 'weapon2': '0.344', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.520', 'WEAPON3': '1.200', 'weapon3': '2.604', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '48.500'} [2023-02-25 15:09:02,786][36140] DAMAGECOUNT value on done: 1700476.0 [2023-02-25 15:09:02,786][36140] Sum rewards: 69.875, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.313', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.058', 'AMMO4': '0.107', 'weapon4': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.550', 'weapon3': '3.122', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '60.000'} [2023-02-25 15:09:02,795][36140] DAMAGECOUNT value on done: 1684799.0 [2023-02-25 15:09:02,796][36140] Sum rewards: 57.947, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.874', 'AMMO2': '0.016', 'AMMO5': '0.017', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'weapon5': '0.204', 'weapon4': '0.236', 'AMMO3': '0.281', 'weapon2': '0.282', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '2.956', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.117', 'FRAGCOUNT': '52.500'} [2023-02-25 15:09:03,532][36138] Updated weights for policy 0, policy_version 59683 (0.0009) [2023-02-25 15:09:04,729][36114] Fps is (10 sec: 12697.6, 60 sec: 12970.7, 300 sec: 12912.8). Total num frames: 244473856. Throughput: 0: 3235.6. Samples: 23616798. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:09:04,730][36114] Avg episode reward: [(0, '61.143')] [2023-02-25 15:09:06,725][36138] Updated weights for policy 0, policy_version 59693 (0.0009) [2023-02-25 15:09:07,646][36142] DAMAGECOUNT value on done: 1697650.0 [2023-02-25 15:09:07,647][36142] Sum rewards: 47.674, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.284', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon5': '0.172', 'AMMO3': '0.208', 'AMMO4': '0.237', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON4': '0.400', 'weapon4': '0.906', 'WEAPON3': '1.200', 'weapon3': '2.232', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.283', 'FRAGCOUNT': '43.000'} [2023-02-25 15:09:07,980][36142] DAMAGECOUNT value on done: 1685814.0 [2023-02-25 15:09:07,981][36142] Sum rewards: 75.593, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.661', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.022', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'weapon4': '0.208', 'weapon2': '0.398', 'WEAPON3': '1.000', 'weapon3': '3.274', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '61.000'} [2023-02-25 15:09:08,575][36142] DAMAGECOUNT value on done: 1695121.0 [2023-02-25 15:09:08,576][36142] Sum rewards: 66.709, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.245', 'ARMOR': '0.004', 'AMMO5': '0.004', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON5': '0.100', 'weapon5': '0.144', 'weapon2': '0.194', 'WEAPON4': '0.200', 'AMMO3': '0.276', 'weapon4': '0.378', 'WEAPON3': '1.550', 'weapon3': '3.026', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.812', 'FRAGCOUNT': '60.000'} [2023-02-25 15:09:08,895][36142] DAMAGECOUNT value on done: 1704350.0 [2023-02-25 15:09:08,896][36142] Sum rewards: 63.237, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.300', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon2': '0.120', 'AMMO3': '0.132', 'WEAPON5': '0.150', 'weapon5': '0.172', 'WEAPON4': '0.300', 'WEAPON3': '0.850', 'weapon4': '1.066', 'weapon3': '2.482', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.607', 'FRAGCOUNT': '52.000'} [2023-02-25 15:09:09,178][36156] DAMAGECOUNT value on done: 1714648.0 [2023-02-25 15:09:09,178][36156] Sum rewards: 62.326, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.042', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.117', 'weapon5': '0.162', 'AMMO3': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.326', 'weapon4': '0.448', 'WEAPON3': '1.050', 'weapon3': '2.850', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '52.000'} [2023-02-25 15:09:09,498][36156] DAMAGECOUNT value on done: 1691016.0 [2023-02-25 15:09:09,498][36156] Sum rewards: 69.222, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.687', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.174', 'WEAPON5': '0.200', 'weapon2': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon5': '0.274', 'weapon4': '0.694', 'WEAPON3': '1.150', 'weapon3': '2.606', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '58.000'} [2023-02-25 15:09:09,729][36114] Fps is (10 sec: 13107.2, 60 sec: 12970.7, 300 sec: 12898.9). Total num frames: 244539392. Throughput: 0: 3229.6. Samples: 23626320. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:09:09,730][36114] Avg episode reward: [(0, '61.352')] [2023-02-25 15:09:09,816][36156] DAMAGECOUNT value on done: 1710530.0 [2023-02-25 15:09:09,817][36156] Sum rewards: 44.032, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.174', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.142', 'AMMO3': '0.281', 'weapon4': '0.286', 'weapon2': '0.668', 'WEAPON3': '1.650', 'weapon3': '2.706', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.825', 'FRAGCOUNT': '40.000'} [2023-02-25 15:09:09,953][36138] Updated weights for policy 0, policy_version 59703 (0.0010) [2023-02-25 15:09:10,154][36156] DAMAGECOUNT value on done: 1695751.0 [2023-02-25 15:09:10,155][36156] Sum rewards: 61.101, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.577', 'AMMO2': '0.008', 'AMMO5': '0.008', 'weapon4': '0.014', 'AMMO4': '0.039', 'weapon5': '0.040', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.217', 'weapon2': '0.542', 'WEAPON3': '1.350', 'HITCOUNT': '3.110', 'weapon3': '3.274', 'DAMAGECOUNT': '14.376', 'FRAGCOUNT': '54.000'} [2023-02-25 15:09:12,727][36139] DAMAGECOUNT value on done: 1701432.0 [2023-02-25 15:09:12,728][36139] Sum rewards: 58.295, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.302', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.094', 'AMMO4': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'weapon2': '0.434', 'weapon4': '0.466', 'WEAPON3': '1.350', 'weapon3': '2.772', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '15.087', 'FRAGCOUNT': '52.000'} [2023-02-25 15:09:13,053][36139] DAMAGECOUNT value on done: 1701672.0 [2023-02-25 15:09:13,053][36139] Sum rewards: 42.143, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.650', 'AMMO5': '0.013', 'AMMO2': '0.038', 'AMMO4': '0.192', 'AMMO3': '0.262', 'weapon4': '0.262', 'weapon5': '0.356', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.618', 'WEAPON3': '1.500', 'weapon3': '2.402', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '13.410', 'FRAGCOUNT': '40.500'} [2023-02-25 15:09:13,092][36155] DAMAGECOUNT value on done: 1695403.0 [2023-02-25 15:09:13,092][36155] Sum rewards: 45.986, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.102', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.031', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'weapon2': '0.158', 'weapon5': '0.168', 'weapon4': '0.198', 'WEAPON4': '0.250', 'AMMO3': '0.256', 'WEAPON3': '1.450', 'HITCOUNT': '2.660', 'weapon3': '3.246', 'DAMAGECOUNT': '12.858', 'FRAGCOUNT': '43.000'} [2023-02-25 15:09:13,202][36138] Updated weights for policy 0, policy_version 59713 (0.0010) [2023-02-25 15:09:13,412][36155] DAMAGECOUNT value on done: 1696449.0 [2023-02-25 15:09:13,413][36155] Sum rewards: 53.907, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.427', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.208', 'AMMO4': '0.208', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON4': '0.450', 'weapon4': '0.796', 'WEAPON3': '1.250', 'weapon3': '2.324', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.554', 'FRAGCOUNT': '49.500'} [2023-02-25 15:09:13,585][36139] DAMAGECOUNT value on done: 1710688.0 [2023-02-25 15:09:13,586][36139] Sum rewards: 64.117, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.140', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.156', 'weapon2': '0.214', 'weapon5': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.566', 'WEAPON3': '1.000', 'weapon3': '2.770', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.588', 'FRAGCOUNT': '53.000'} [2023-02-25 15:09:13,687][36139] Large shaping reward 2.529 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.507, 169.0), ('weapon5', 0.002)] [2023-02-25 15:09:13,926][36139] DAMAGECOUNT value on done: 1711115.0 [2023-02-25 15:09:13,926][36139] Sum rewards: 56.409, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.190', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.048', 'weapon5': '0.100', 'AMMO4': '0.240', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'weapon2': '0.290', 'weapon4': '0.360', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.980', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.233', 'FRAGCOUNT': '51.000'} [2023-02-25 15:09:14,383][36155] DAMAGECOUNT value on done: 1713370.0 [2023-02-25 15:09:14,384][36155] Sum rewards: 47.806, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.840', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon5': '0.158', 'AMMO4': '0.186', 'AMMO3': '0.292', 'weapon4': '0.332', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'HITCOUNT': '2.620', 'weapon3': '2.782', 'DAMAGECOUNT': '13.167', 'FRAGCOUNT': '48.000'} [2023-02-25 15:09:14,675][36155] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 15:09:14,729][36114] Fps is (10 sec: 12697.7, 60 sec: 12902.4, 300 sec: 12885.0). Total num frames: 244600832. Throughput: 0: 3228.8. Samples: 23645350. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:09:14,730][36114] Avg episode reward: [(0, '60.442')] [2023-02-25 15:09:14,731][36155] DAMAGECOUNT value on done: 1698662.0 [2023-02-25 15:09:14,732][36155] Sum rewards: 60.584, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.102', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.016', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.079', 'weapon2': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon4': '0.508', 'WEAPON3': '1.400', 'weapon3': '3.090', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '53.000'} [2023-02-25 15:09:15,625][36154] DAMAGECOUNT value on done: 1705449.0 [2023-02-25 15:09:15,626][36154] Sum rewards: 53.727, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.092', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.025', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'WEAPON4': '0.250', 'AMMO3': '0.282', 'weapon4': '0.322', 'weapon2': '0.340', 'WEAPON3': '1.600', 'weapon3': '3.014', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.184', 'FRAGCOUNT': '49.000'} [2023-02-25 15:09:15,964][36154] DAMAGECOUNT value on done: 1682791.0 [2023-02-25 15:09:15,964][36154] Sum rewards: 61.275, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.830', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.072', 'AMMO4': '0.116', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'weapon2': '0.284', 'WEAPON4': '0.400', 'weapon4': '0.492', 'WEAPON3': '1.300', 'weapon3': '2.956', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '52.000'} [2023-02-25 15:09:16,383][36154] DAMAGECOUNT value on done: 1718188.0 [2023-02-25 15:09:16,383][36154] Sum rewards: 50.939, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.035', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon5': '0.102', 'AMMO4': '0.221', 'AMMO3': '0.226', 'WEAPON5': '0.300', 'weapon2': '0.372', 'ARMOR': '0.434', 'WEAPON4': '0.550', 'weapon4': '0.610', 'WEAPON3': '1.350', 'weapon3': '2.654', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.657', 'FRAGCOUNT': '45.500'} [2023-02-25 15:09:16,489][36138] Updated weights for policy 0, policy_version 59723 (0.0009) [2023-02-25 15:09:16,712][36154] DAMAGECOUNT value on done: 1697740.0 [2023-02-25 15:09:16,713][36154] Sum rewards: 57.619, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.380', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.051', 'AMMO3': '0.160', 'AMMO4': '0.255', 'weapon2': '0.282', 'weapon5': '0.286', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.770', 'WEAPON3': '1.050', 'weapon3': '2.302', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '49.000'} [2023-02-25 15:09:17,651][36141] DAMAGECOUNT value on done: 1705913.0 [2023-02-25 15:09:17,652][36141] Sum rewards: 84.491, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon4': '0.052', 'HEALTH': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.207', 'weapon2': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.548', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '19.503', 'FRAGCOUNT': '69.000'} [2023-02-25 15:09:17,854][36141] DAMAGECOUNT value on done: 1699254.0 [2023-02-25 15:09:17,854][36141] Sum rewards: 54.920, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.180', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.054', 'AMMO4': '0.153', 'weapon4': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.400', 'HITCOUNT': '3.120', 'weapon3': '3.240', 'DAMAGECOUNT': '14.622', 'FRAGCOUNT': '49.000'} [2023-02-25 15:09:17,986][36141] DAMAGECOUNT value on done: 1712765.0 [2023-02-25 15:09:17,987][36141] Sum rewards: 58.447, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.438', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon5': '0.182', 'weapon4': '0.190', 'AMMO3': '0.236', 'weapon2': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.002', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '50.500'} [2023-02-25 15:09:18,201][36141] DAMAGECOUNT value on done: 1682332.0 [2023-02-25 15:09:18,201][36141] Sum rewards: 58.066, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.294', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.042', 'weapon4': '0.070', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'weapon2': '0.518', 'WEAPON3': '1.350', 'HITCOUNT': '3.010', 'weapon3': '3.184', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '51.000'} [2023-02-25 15:09:19,358][36139] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-25 15:09:19,729][36114] Fps is (10 sec: 12288.1, 60 sec: 12834.2, 300 sec: 12871.2). Total num frames: 244662272. Throughput: 0: 3210.6. Samples: 23664004. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:09:19,729][36114] Avg episode reward: [(0, '60.397')] [2023-02-25 15:09:19,766][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000059733_244666368.pth... [2023-02-25 15:09:19,768][36138] Updated weights for policy 0, policy_version 59733 (0.0010) [2023-02-25 15:09:19,829][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000058984_241598464.pth [2023-02-25 15:09:22,185][36155] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 15:09:22,410][36157] DAMAGECOUNT value on done: 1719378.0 [2023-02-25 15:09:22,410][36157] Sum rewards: 46.759, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.070', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon4': '0.136', 'AMMO3': '0.152', 'weapon2': '0.494', 'WEAPON3': '1.050', 'HITCOUNT': '2.590', 'weapon3': '3.192', 'DAMAGECOUNT': '12.537', 'FRAGCOUNT': '39.000'} [2023-02-25 15:09:22,779][36157] DAMAGECOUNT value on done: 1700958.0 [2023-02-25 15:09:22,779][36157] Sum rewards: 53.894, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.338', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.027', 'AMMO2': '0.057', 'AMMO3': '0.141', 'weapon5': '0.166', 'AMMO4': '0.287', 'weapon2': '0.570', 'WEAPON4': '0.600', 'WEAPON5': '0.700', 'weapon4': '0.746', 'WEAPON3': '0.850', 'weapon3': '2.242', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.241', 'FRAGCOUNT': '46.500'} [2023-02-25 15:09:23,194][36138] Updated weights for policy 0, policy_version 59743 (0.0009) [2023-02-25 15:09:23,493][36157] DAMAGECOUNT value on done: 1723157.0 [2023-02-25 15:09:23,493][36157] Sum rewards: 56.578, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.664', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.120', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.422', 'weapon2': '0.424', 'WEAPON3': '1.050', 'weapon3': '2.762', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.223', 'FRAGCOUNT': '48.000'} [2023-02-25 15:09:23,805][36157] DAMAGECOUNT value on done: 1708357.0 [2023-02-25 15:09:23,806][36157] Sum rewards: 63.831, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.346', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'weapon2': '0.204', 'AMMO3': '0.285', 'weapon4': '0.380', 'WEAPON3': '1.650', 'weapon3': '2.992', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.834', 'FRAGCOUNT': '59.000'} [2023-02-25 15:09:23,918][36140] DAMAGECOUNT value on done: 1706264.0 [2023-02-25 15:09:23,919][36140] Sum rewards: 67.132, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.550', 'AMMO5': '0.018', 'AMMO2': '0.049', 'AMMO4': '0.245', 'AMMO3': '0.260', 'weapon5': '0.320', 'weapon4': '0.366', 'weapon2': '0.394', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.566', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.514', 'FRAGCOUNT': '60.000'} [2023-02-25 15:09:23,930][36140] DAMAGECOUNT value on done: 1716098.0 [2023-02-25 15:09:23,930][36140] Sum rewards: 53.154, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.713', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'ARMOR': '0.004', 'WEAPON5': '0.050', 'weapon5': '0.052', 'WEAPON4': '0.100', 'weapon2': '0.208', 'AMMO3': '0.212', 'weapon4': '0.244', 'WEAPON3': '1.450', 'weapon3': '3.198', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.574', 'FRAGCOUNT': '45.500'} [2023-02-25 15:09:24,243][36140] DAMAGECOUNT value on done: 1706114.0 [2023-02-25 15:09:24,243][36140] Sum rewards: 58.015, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-4.070', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.068', 'weapon5': '0.144', 'AMMO4': '0.183', 'WEAPON4': '0.250', 'weapon2': '0.308', 'WEAPON5': '0.350', 'AMMO3': '0.365', 'WEAPON3': '2.100', 'weapon3': '3.082', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '56.000'} [2023-02-25 15:09:24,254][36140] DAMAGECOUNT value on done: 1689593.0 [2023-02-25 15:09:24,254][36140] Sum rewards: 53.242, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.073', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.042', 'AMMO4': '0.208', 'AMMO3': '0.263', 'weapon5': '0.332', 'weapon2': '0.358', 'weapon4': '0.388', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.436', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '14.382', 'FRAGCOUNT': '50.000'} [2023-02-25 15:09:24,729][36114] Fps is (10 sec: 12288.1, 60 sec: 12765.9, 300 sec: 12843.4). Total num frames: 244723712. Throughput: 0: 3197.5. Samples: 23673128. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:09:24,730][36114] Avg episode reward: [(0, '60.114')] [2023-02-25 15:09:26,568][36138] Updated weights for policy 0, policy_version 59753 (0.0010) [2023-02-25 15:09:29,504][36142] DAMAGECOUNT value on done: 1702056.0 [2023-02-25 15:09:29,505][36142] Sum rewards: 58.685, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.226', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON5': '0.050', 'weapon5': '0.054', 'WEAPON4': '0.150', 'AMMO3': '0.169', 'weapon2': '0.320', 'ARMOR': '0.456', 'weapon4': '0.506', 'WEAPON3': '1.050', 'HITCOUNT': '2.910', 'weapon3': '2.982', 'DAMAGECOUNT': '13.218', 'FRAGCOUNT': '50.000'} [2023-02-25 15:09:29,729][36114] Fps is (10 sec: 12287.9, 60 sec: 12765.8, 300 sec: 12829.5). Total num frames: 244785152. Throughput: 0: 3163.6. Samples: 23691004. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:09:29,730][36114] Avg episode reward: [(0, '60.008')] [2023-02-25 15:09:29,839][36142] DAMAGECOUNT value on done: 1691429.0 [2023-02-25 15:09:29,840][36142] Sum rewards: 68.324, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.862', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO3': '0.132', 'AMMO4': '0.178', 'weapon5': '0.194', 'weapon2': '0.262', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.702', 'WEAPON3': '0.800', 'weapon3': '2.572', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '57.000'} [2023-02-25 15:09:29,907][36138] Updated weights for policy 0, policy_version 59763 (0.0009) [2023-02-25 15:09:30,442][36142] DAMAGECOUNT value on done: 1700280.0 [2023-02-25 15:09:30,442][36142] Sum rewards: 62.068, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.720', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.060', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'weapon4': '0.228', 'weapon2': '0.426', 'WEAPON3': '1.050', 'weapon3': '3.090', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '50.000'} [2023-02-25 15:09:30,805][36142] DAMAGECOUNT value on done: 1709929.0 [2023-02-25 15:09:30,805][36142] Sum rewards: 64.359, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.956', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.020', 'weapon4': '0.094', 'AMMO4': '0.100', 'weapon5': '0.114', 'weapon2': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON3': '1.350', 'HITCOUNT': '3.190', 'weapon3': '3.404', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '55.500'} [2023-02-25 15:09:31,066][36156] DAMAGECOUNT value on done: 1721141.0 [2023-02-25 15:09:31,067][36156] Sum rewards: 76.416, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.454', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon2': '0.170', 'AMMO4': '0.186', 'weapon5': '0.198', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '1.100', 'WEAPON3': '1.350', 'weapon3': '2.128', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '19.479', 'FRAGCOUNT': '65.000'} [2023-02-25 15:09:31,394][36156] DAMAGECOUNT value on done: 1696416.0 [2023-02-25 15:09:31,395][36156] Sum rewards: 66.851, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.462', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.221', 'weapon2': '0.494', 'WEAPON3': '1.300', 'weapon3': '3.356', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.200', 'FRAGCOUNT': '56.000'} [2023-02-25 15:09:31,719][36156] DAMAGECOUNT value on done: 1716276.0 [2023-02-25 15:09:31,720][36156] Sum rewards: 76.053, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.090', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.032', 'weapon5': '0.114', 'WEAPON5': '0.150', 'weapon2': '0.200', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon4': '0.548', 'WEAPON3': '1.300', 'weapon3': '2.926', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '65.000'} [2023-02-25 15:09:32,060][36156] DAMAGECOUNT value on done: 1701508.0 [2023-02-25 15:09:32,060][36156] Sum rewards: 62.905, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.748', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon2': '0.154', 'AMMO3': '0.185', 'weapon5': '0.186', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.800', 'WEAPON3': '1.150', 'weapon3': '2.434', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '52.000'} [2023-02-25 15:09:32,160][36156] Large shaping reward -2.522 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.273, -91.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 15:09:33,223][36138] Updated weights for policy 0, policy_version 59773 (0.0010) [2023-02-25 15:09:34,623][36139] DAMAGECOUNT value on done: 1706639.0 [2023-02-25 15:09:34,624][36139] Sum rewards: 57.532, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.400', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.061', 'AMMO3': '0.198', 'weapon5': '0.284', 'AMMO4': '0.305', 'weapon2': '0.370', 'WEAPON5': '0.500', 'weapon4': '0.534', 'WEAPON4': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.466', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.621', 'FRAGCOUNT': '53.000'} [2023-02-25 15:09:34,729][36114] Fps is (10 sec: 12287.6, 60 sec: 12698.4, 300 sec: 12801.7). Total num frames: 244846592. Throughput: 0: 3150.2. Samples: 23709656. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:09:34,730][36114] Avg episode reward: [(0, '60.208')] [2023-02-25 15:09:34,971][36155] DAMAGECOUNT value on done: 1700216.0 [2023-02-25 15:09:34,971][36155] Sum rewards: 58.798, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.398', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.164', 'AMMO3': '0.216', 'weapon2': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.286', 'WEAPON3': '1.250', 'HITCOUNT': '2.910', 'weapon3': '3.090', 'DAMAGECOUNT': '14.439', 'FRAGCOUNT': '52.000'} [2023-02-25 15:09:34,984][36139] DAMAGECOUNT value on done: 1707754.0 [2023-02-25 15:09:34,985][36139] Sum rewards: 66.633, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.387', 'AMMO5': '0.010', 'AMMO2': '0.046', 'AMMO3': '0.166', 'weapon5': '0.166', 'AMMO4': '0.228', 'WEAPON5': '0.250', 'weapon4': '0.316', 'weapon2': '0.432', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.836', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '55.000'} [2023-02-25 15:09:35,303][36155] DAMAGECOUNT value on done: 1701814.0 [2023-02-25 15:09:35,303][36155] Sum rewards: 66.036, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.732', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon5': '0.184', 'AMMO3': '0.200', 'weapon4': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.584', 'WEAPON3': '1.200', 'weapon3': '2.712', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '57.500'} [2023-02-25 15:09:35,496][36139] DAMAGECOUNT value on done: 1715901.0 [2023-02-25 15:09:35,497][36139] Sum rewards: 60.228, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.308', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon4': '0.100', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'weapon2': '0.360', 'WEAPON3': '1.350', 'HITCOUNT': '3.170', 'weapon3': '3.182', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '52.000'} [2023-02-25 15:09:35,846][36139] DAMAGECOUNT value on done: 1716145.0 [2023-02-25 15:09:35,847][36139] Sum rewards: 49.415, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.460', 'AMMO5': '0.023', 'AMMO2': '0.071', 'AMMO3': '0.214', 'weapon5': '0.316', 'AMMO4': '0.353', 'weapon4': '0.392', 'weapon2': '0.492', 'WEAPON5': '0.700', 'WEAPON4': '0.750', 'WEAPON3': '1.150', 'weapon3': '2.430', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.874', 'FRAGCOUNT': '46.000'} [2023-02-25 15:09:36,279][36155] DAMAGECOUNT value on done: 1718961.0 [2023-02-25 15:09:36,279][36155] Sum rewards: 63.288, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.860', 'AMMO5': '0.021', 'AMMO2': '0.050', 'AMMO3': '0.151', 'AMMO4': '0.249', 'weapon2': '0.362', 'weapon5': '0.378', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '0.900', 'weapon4': '0.936', 'weapon3': '1.968', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '54.000'} [2023-02-25 15:09:36,556][36138] Updated weights for policy 0, policy_version 59783 (0.0010) [2023-02-25 15:09:36,604][36155] DAMAGECOUNT value on done: 1704073.0 [2023-02-25 15:09:36,605][36155] Sum rewards: 63.931, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.690', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.136', 'AMMO4': '0.151', 'weapon5': '0.180', 'weapon2': '0.226', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.170', 'weapon3': '3.202', 'DAMAGECOUNT': '16.233', 'FRAGCOUNT': '56.000'} [2023-02-25 15:09:37,544][36154] DAMAGECOUNT value on done: 1709643.0 [2023-02-25 15:09:37,544][36154] Sum rewards: 45.973, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.602', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.084', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'AMMO4': '0.249', 'WEAPON4': '0.300', 'weapon4': '0.432', 'weapon2': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.504', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.582', 'FRAGCOUNT': '40.000'} [2023-02-25 15:09:37,889][36154] DAMAGECOUNT value on done: 1688034.0 [2023-02-25 15:09:37,889][36154] Sum rewards: 56.493, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.884', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.122', 'weapon4': '0.234', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON3': '1.400', 'weapon3': '3.082', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.729', 'FRAGCOUNT': '50.000'} [2023-02-25 15:09:38,324][36154] DAMAGECOUNT value on done: 1723148.0 [2023-02-25 15:09:38,325][36154] Sum rewards: 51.861, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.661', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon5': '0.090', 'AMMO4': '0.109', 'weapon4': '0.180', 'weapon2': '0.240', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.110', 'weapon3': '3.232', 'DAMAGECOUNT': '14.880', 'FRAGCOUNT': '46.000'} [2023-02-25 15:09:38,651][36154] DAMAGECOUNT value on done: 1703421.0 [2023-02-25 15:09:38,651][36154] Sum rewards: 67.612, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.230', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon4': '0.082', 'WEAPON4': '0.100', 'weapon2': '0.210', 'AMMO3': '0.237', 'WEAPON3': '1.450', 'HITCOUNT': '3.430', 'weapon3': '3.554', 'DAMAGECOUNT': '16.968', 'FRAGCOUNT': '58.000'} [2023-02-25 15:09:39,604][36141] DAMAGECOUNT value on done: 1710504.0 [2023-02-25 15:09:39,605][36141] Sum rewards: 58.830, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.900', 'AMMO5': '0.011', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.136', 'weapon5': '0.148', 'weapon4': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.428', 'WEAPON3': '0.800', 'weapon3': '2.870', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.473', 'FRAGCOUNT': '49.000'} [2023-02-25 15:09:39,730][36114] Fps is (10 sec: 12287.5, 60 sec: 12629.3, 300 sec: 12787.8). Total num frames: 244908032. Throughput: 0: 3140.5. Samples: 23718980. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:09:39,730][36114] Avg episode reward: [(0, '60.310')] [2023-02-25 15:09:39,800][36138] Updated weights for policy 0, policy_version 59793 (0.0010) [2023-02-25 15:09:39,810][36141] DAMAGECOUNT value on done: 1704548.0 [2023-02-25 15:09:39,811][36141] Sum rewards: 61.067, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.166', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'weapon2': '0.182', 'weapon4': '0.254', 'AMMO3': '0.280', 'WEAPON3': '1.550', 'weapon3': '3.268', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.882', 'FRAGCOUNT': '55.000'} [2023-02-25 15:09:39,947][36141] DAMAGECOUNT value on done: 1717789.0 [2023-02-25 15:09:39,948][36141] Sum rewards: 60.180, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.210', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.162', 'AMMO3': '0.203', 'weapon2': '0.324', 'weapon4': '0.514', 'WEAPON3': '1.200', 'weapon3': '2.760', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.072', 'FRAGCOUNT': '51.000'} [2023-02-25 15:09:40,182][36141] DAMAGECOUNT value on done: 1687474.0 [2023-02-25 15:09:40,182][36141] Sum rewards: 64.329, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.034', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon5': '0.206', 'AMMO3': '0.212', 'AMMO4': '0.251', 'weapon2': '0.254', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.652', 'WEAPON3': '1.200', 'weapon3': '2.540', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '56.000'} [2023-02-25 15:09:43,071][36138] Updated weights for policy 0, policy_version 59803 (0.0010) [2023-02-25 15:09:44,305][36157] DAMAGECOUNT value on done: 1724442.0 [2023-02-25 15:09:44,306][36157] Sum rewards: 58.327, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.667', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.130', 'AMMO4': '0.204', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.306', 'weapon4': '0.630', 'WEAPON3': '1.300', 'weapon3': '2.550', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.790', 'FRAGCOUNT': '52.000'} [2023-02-25 15:09:44,656][36157] DAMAGECOUNT value on done: 1706514.0 [2023-02-25 15:09:44,657][36157] Sum rewards: 69.126, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.118', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.060', 'weapon4': '0.106', 'AMMO4': '0.139', 'weapon2': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.180', 'weapon3': '3.544', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '59.500'} [2023-02-25 15:09:44,729][36114] Fps is (10 sec: 12288.1, 60 sec: 12561.1, 300 sec: 12774.0). Total num frames: 244969472. Throughput: 0: 3122.1. Samples: 23737716. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:09:44,730][36114] Avg episode reward: [(0, '60.336')] [2023-02-25 15:09:45,435][36157] DAMAGECOUNT value on done: 1729522.0 [2023-02-25 15:09:45,436][36157] Sum rewards: 72.467, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.930', 'AMMO2': '0.003', 'AMMO4': '0.016', 'WEAPON4': '0.050', 'weapon4': '0.076', 'AMMO3': '0.233', 'weapon2': '0.396', 'WEAPON3': '1.450', 'weapon3': '3.338', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '60.000'} [2023-02-25 15:09:45,714][36140] DAMAGECOUNT value on done: 1711292.0 [2023-02-25 15:09:45,715][36140] Sum rewards: 52.080, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.298', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.092', 'weapon4': '0.128', 'AMMO4': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.291', 'weapon2': '0.334', 'WEAPON3': '1.600', 'HITCOUNT': '2.940', 'weapon3': '3.164', 'DAMAGECOUNT': '15.084', 'FRAGCOUNT': '48.000'} [2023-02-25 15:09:45,724][36140] DAMAGECOUNT value on done: 1720674.0 [2023-02-25 15:09:45,725][36140] Sum rewards: 48.223, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.624', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.198', 'AMMO3': '0.220', 'weapon2': '0.250', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.486', 'WEAPON3': '1.250', 'weapon3': '2.736', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.593', 'FRAGCOUNT': '44.000'} [2023-02-25 15:09:45,759][36157] DAMAGECOUNT value on done: 1714012.0 [2023-02-25 15:09:45,760][36157] Sum rewards: 72.724, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.081', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.120', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.204', 'AMMO3': '0.207', 'weapon4': '0.564', 'WEAPON3': '1.150', 'weapon3': '2.846', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '61.000'} [2023-02-25 15:09:46,058][36140] DAMAGECOUNT value on done: 1710899.0 [2023-02-25 15:09:46,059][36140] Sum rewards: 60.911, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.049', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.161', 'weapon5': '0.188', 'weapon2': '0.222', 'WEAPON4': '0.300', 'weapon4': '0.326', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '3.020', 'weapon3': '3.068', 'DAMAGECOUNT': '14.355', 'FRAGCOUNT': '51.500'} [2023-02-25 15:09:46,071][36140] DAMAGECOUNT value on done: 1695534.0 [2023-02-25 15:09:46,071][36140] Sum rewards: 69.306, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.250', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.032', 'weapon4': '0.070', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'weapon2': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.277', 'WEAPON3': '1.600', 'weapon3': '3.442', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.823', 'FRAGCOUNT': '62.000'} [2023-02-25 15:09:46,384][36138] Updated weights for policy 0, policy_version 59813 (0.0010) [2023-02-25 15:09:49,596][36138] Updated weights for policy 0, policy_version 59823 (0.0010) [2023-02-25 15:09:49,729][36114] Fps is (10 sec: 12698.1, 60 sec: 12561.1, 300 sec: 12760.1). Total num frames: 245035008. Throughput: 0: 3106.0. Samples: 23756568. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:09:49,730][36114] Avg episode reward: [(0, '60.302')] [2023-02-25 15:09:51,111][36142] DAMAGECOUNT value on done: 1707159.0 [2023-02-25 15:09:51,111][36142] Sum rewards: 59.602, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.312', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.215', 'weapon5': '0.282', 'weapon2': '0.424', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'ARMOR': '0.461', 'weapon4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.352', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.309', 'FRAGCOUNT': '53.000'} [2023-02-25 15:09:51,445][36142] DAMAGECOUNT value on done: 1696423.0 [2023-02-25 15:09:51,446][36142] Sum rewards: 58.955, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.522', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.162', 'AMMO4': '0.177', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.468', 'weapon2': '0.620', 'WEAPON3': '1.050', 'weapon3': '2.540', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.982', 'FRAGCOUNT': '50.000'} [2023-02-25 15:09:52,066][36142] DAMAGECOUNT value on done: 1705668.0 [2023-02-25 15:09:52,066][36142] Sum rewards: 64.165, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.424', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.210', 'AMMO4': '0.213', 'AMMO3': '0.230', 'weapon2': '0.268', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.698', 'WEAPON3': '1.400', 'weapon3': '2.476', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.164', 'FRAGCOUNT': '58.000'} [2023-02-25 15:09:52,378][36142] DAMAGECOUNT value on done: 1714915.0 [2023-02-25 15:09:52,379][36142] Sum rewards: 60.564, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.595', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.090', 'weapon5': '0.112', 'AMMO4': '0.151', 'AMMO3': '0.165', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.406', 'WEAPON3': '1.000', 'HITCOUNT': '2.980', 'weapon3': '3.208', 'DAMAGECOUNT': '14.958', 'FRAGCOUNT': '52.000'} [2023-02-25 15:09:52,641][36156] DAMAGECOUNT value on done: 1726786.0 [2023-02-25 15:09:52,641][36156] Sum rewards: 72.837, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.771', 'AMMO5': '0.004', 'AMMO2': '0.024', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'weapon2': '0.380', 'weapon4': '0.410', 'WEAPON3': '1.100', 'weapon3': '2.960', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '62.000'} [2023-02-25 15:09:52,887][36138] Updated weights for policy 0, policy_version 59833 (0.0010) [2023-02-25 15:09:52,973][36156] DAMAGECOUNT value on done: 1701345.0 [2023-02-25 15:09:52,974][36156] Sum rewards: 58.996, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.375', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.073', 'AMMO3': '0.096', 'weapon5': '0.218', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'weapon4': '0.778', 'weapon3': '2.308', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.787', 'FRAGCOUNT': '47.000'} [2023-02-25 15:09:53,360][36156] DAMAGECOUNT value on done: 1722265.0 [2023-02-25 15:09:53,361][36156] Sum rewards: 62.018, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.541', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.056', 'weapon2': '0.226', 'AMMO3': '0.236', 'AMMO4': '0.281', 'weapon5': '0.320', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon4': '0.654', 'WEAPON3': '1.350', 'weapon3': '2.396', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '56.000'} [2023-02-25 15:09:53,726][36156] DAMAGECOUNT value on done: 1706764.0 [2023-02-25 15:09:53,726][36156] Sum rewards: 61.135, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.620', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.060', 'AMMO4': '0.087', 'weapon5': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.472', 'WEAPON3': '1.450', 'weapon3': '3.006', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.768', 'FRAGCOUNT': '54.000'} [2023-02-25 15:09:54,729][36114] Fps is (10 sec: 12697.7, 60 sec: 12492.8, 300 sec: 12746.2). Total num frames: 245096448. Throughput: 0: 3102.4. Samples: 23765928. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:09:54,730][36114] Avg episode reward: [(0, '60.356')] [2023-02-25 15:09:56,227][36139] DAMAGECOUNT value on done: 1711771.0 [2023-02-25 15:09:56,228][36139] Sum rewards: 54.424, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.450', 'AMMO5': '0.027', 'AMMO2': '0.061', 'AMMO3': '0.147', 'weapon2': '0.208', 'AMMO4': '0.306', 'weapon5': '0.666', 'WEAPON5': '0.800', 'WEAPON4': '0.800', 'WEAPON3': '0.900', 'weapon4': '0.972', 'weapon3': '1.730', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '47.000'} [2023-02-25 15:09:56,356][36138] Updated weights for policy 0, policy_version 59843 (0.0010) [2023-02-25 15:09:56,566][36139] DAMAGECOUNT value on done: 1713378.0 [2023-02-25 15:09:56,567][36139] Sum rewards: 61.357, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.720', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon4': '0.184', 'weapon2': '0.196', 'AMMO3': '0.232', 'AMMO4': '0.267', 'weapon5': '0.268', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '2.940', 'weapon3': '3.048', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '54.000'} [2023-02-25 15:09:56,575][36155] DAMAGECOUNT value on done: 1703617.0 [2023-02-25 15:09:56,575][36155] Sum rewards: 41.986, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.078', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'AMMO3': '0.140', 'weapon5': '0.184', 'WEAPON4': '0.200', 'weapon4': '0.510', 'weapon2': '0.540', 'WEAPON3': '0.850', 'HITCOUNT': '2.380', 'weapon3': '2.634', 'DAMAGECOUNT': '10.203', 'FRAGCOUNT': '35.000'} [2023-02-25 15:09:56,887][36155] DAMAGECOUNT value on done: 1708058.0 [2023-02-25 15:09:56,888][36155] Sum rewards: 72.801, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.628', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'weapon4': '0.270', 'weapon2': '0.354', 'WEAPON3': '1.250', 'weapon3': '3.050', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.732', 'FRAGCOUNT': '60.000'} [2023-02-25 15:09:56,992][36139] DAMAGECOUNT value on done: 1721161.0 [2023-02-25 15:09:56,992][36139] Sum rewards: 63.749, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.965', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.184', 'weapon2': '0.350', 'weapon4': '0.368', 'WEAPON3': '1.150', 'weapon3': '2.956', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.780', 'FRAGCOUNT': '53.000'} [2023-02-25 15:09:57,315][36139] DAMAGECOUNT value on done: 1721374.0 [2023-02-25 15:09:57,315][36139] Sum rewards: 59.043, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.347', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.060', 'weapon5': '0.166', 'AMMO3': '0.222', 'weapon2': '0.264', 'AMMO4': '0.300', 'WEAPON5': '0.400', 'WEAPON4': '0.650', 'weapon4': '0.874', 'WEAPON3': '1.300', 'weapon3': '2.376', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.687', 'FRAGCOUNT': '54.000'} [2023-02-25 15:09:57,744][36155] DAMAGECOUNT value on done: 1724075.0 [2023-02-25 15:09:57,745][36155] Sum rewards: 57.757, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.398', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon2': '0.162', 'weapon5': '0.180', 'AMMO4': '0.186', 'AMMO3': '0.233', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.680', 'WEAPON3': '1.400', 'weapon3': '2.732', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '52.000'} [2023-02-25 15:09:58,044][36155] DAMAGECOUNT value on done: 1709636.0 [2023-02-25 15:09:58,045][36155] Sum rewards: 60.977, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.145', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.106', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.328', 'weapon4': '0.332', 'WEAPON3': '1.450', 'weapon3': '2.992', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.689', 'FRAGCOUNT': '53.000'} [2023-02-25 15:09:59,024][36154] DAMAGECOUNT value on done: 1714710.0 [2023-02-25 15:09:59,024][36154] Sum rewards: 65.155, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.414', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.068', 'AMMO4': '0.093', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'WEAPON4': '0.300', 'weapon2': '0.368', 'weapon4': '0.460', 'WEAPON3': '1.100', 'weapon3': '2.826', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.201', 'FRAGCOUNT': '56.000'} [2023-02-25 15:09:59,347][36154] DAMAGECOUNT value on done: 1693058.0 [2023-02-25 15:09:59,347][36154] Sum rewards: 60.166, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.382', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.033', 'weapon5': '0.038', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'AMMO3': '0.215', 'WEAPON4': '0.350', 'weapon2': '0.362', 'weapon4': '0.660', 'WEAPON3': '1.300', 'weapon3': '2.638', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.072', 'FRAGCOUNT': '54.000'} [2023-02-25 15:09:59,535][36138] Updated weights for policy 0, policy_version 59853 (0.0009) [2023-02-25 15:09:59,729][36114] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 12732.3). Total num frames: 245157888. Throughput: 0: 3089.2. Samples: 23784362. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:09:59,730][36114] Avg episode reward: [(0, '60.221')] [2023-02-25 15:09:59,883][36154] DAMAGECOUNT value on done: 1728208.0 [2023-02-25 15:09:59,884][36154] Sum rewards: 55.487, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.386', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.160', 'AMMO4': '0.170', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'weapon4': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.470', 'WEAPON3': '1.100', 'weapon3': '2.758', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '48.000'} [2023-02-25 15:10:00,208][36154] DAMAGECOUNT value on done: 1708368.0 [2023-02-25 15:10:00,209][36154] Sum rewards: 57.836, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.605', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon5': '0.094', 'AMMO4': '0.187', 'AMMO3': '0.270', 'weapon4': '0.282', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.722', 'WEAPON3': '1.600', 'weapon3': '2.630', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.841', 'FRAGCOUNT': '54.000'} [2023-02-25 15:10:00,926][36141] DAMAGECOUNT value on done: 1715087.0 [2023-02-25 15:10:00,927][36141] Sum rewards: 55.521, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.838', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.164', 'weapon5': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.562', 'weapon2': '0.612', 'WEAPON3': '1.000', 'weapon3': '2.358', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.749', 'FRAGCOUNT': '47.000'} [2023-02-25 15:10:01,118][36141] DAMAGECOUNT value on done: 1710302.0 [2023-02-25 15:10:01,118][36141] Sum rewards: 68.122, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.402', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.110', 'weapon4': '0.210', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon2': '0.340', 'WEAPON3': '1.350', 'weapon3': '3.198', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.262', 'FRAGCOUNT': '58.000'} [2023-02-25 15:10:01,253][36141] DAMAGECOUNT value on done: 1722679.0 [2023-02-25 15:10:01,253][36141] Sum rewards: 52.968, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.292', 'ARMOR': '0.012', 'AMMO5': '0.020', 'AMMO2': '0.064', 'AMMO3': '0.205', 'weapon5': '0.274', 'AMMO4': '0.319', 'weapon2': '0.384', 'weapon4': '0.432', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.500', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.670', 'FRAGCOUNT': '49.000'} [2023-02-25 15:10:01,452][36141] DAMAGECOUNT value on done: 1692599.0 [2023-02-25 15:10:01,453][36141] Sum rewards: 60.760, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.493', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.021', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.154', 'WEAPON4': '0.250', 'weapon2': '0.500', 'weapon4': '0.714', 'WEAPON3': '0.950', 'weapon3': '2.506', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '49.000'} [2023-02-25 15:10:02,084][36142] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 15:10:02,669][36138] Updated weights for policy 0, policy_version 59863 (0.0009) [2023-02-25 15:10:04,729][36114] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12732.3). Total num frames: 245223424. Throughput: 0: 3110.4. Samples: 23803974. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:10:04,730][36114] Avg episode reward: [(0, '60.148')] [2023-02-25 15:10:05,582][36157] DAMAGECOUNT value on done: 1729356.0 [2023-02-25 15:10:05,582][36157] Sum rewards: 63.818, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.578', 'ARMOR': '0.008', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.128', 'AMMO3': '0.193', 'AMMO4': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.416', 'weapon4': '0.574', 'WEAPON3': '1.150', 'weapon3': '2.666', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.460', 'FRAGCOUNT': '54.500'} [2023-02-25 15:10:05,772][36138] Updated weights for policy 0, policy_version 59873 (0.0010) [2023-02-25 15:10:05,908][36157] DAMAGECOUNT value on done: 1712485.0 [2023-02-25 15:10:05,909][36157] Sum rewards: 69.043, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.672', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.042', 'AMMO3': '0.145', 'AMMO4': '0.209', 'weapon5': '0.212', 'WEAPON5': '0.300', 'weapon2': '0.414', 'WEAPON4': '0.450', 'weapon4': '0.786', 'WEAPON3': '0.900', 'weapon3': '2.316', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.913', 'FRAGCOUNT': '56.500'} [2023-02-25 15:10:06,605][36157] DAMAGECOUNT value on done: 1735235.0 [2023-02-25 15:10:06,605][36157] Sum rewards: 70.599, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.673', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.372', 'weapon4': '0.422', 'WEAPON3': '1.250', 'weapon3': '2.856', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '61.000'} [2023-02-25 15:10:06,790][36140] DAMAGECOUNT value on done: 1716130.0 [2023-02-25 15:10:06,791][36140] Sum rewards: 55.331, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.482', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'weapon2': '0.178', 'AMMO3': '0.193', 'WEAPON4': '0.450', 'weapon4': '1.036', 'WEAPON3': '1.100', 'weapon3': '2.276', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.514', 'FRAGCOUNT': '49.000'} [2023-02-25 15:10:06,802][36140] DAMAGECOUNT value on done: 1726502.0 [2023-02-25 15:10:06,803][36140] Sum rewards: 63.530, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.827', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon2': '0.154', 'weapon5': '0.214', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.542', 'WEAPON3': '1.500', 'weapon3': '2.736', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '55.000'} [2023-02-25 15:10:06,931][36157] DAMAGECOUNT value on done: 1718833.0 [2023-02-25 15:10:06,931][36157] Sum rewards: 47.944, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-3.971', 'ARMOR': '0.012', 'AMMO5': '0.016', 'AMMO2': '0.076', 'weapon5': '0.132', 'AMMO3': '0.277', 'weapon4': '0.336', 'AMMO4': '0.378', 'WEAPON5': '0.400', 'weapon2': '0.424', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.740', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '14.463', 'FRAGCOUNT': '48.000'} [2023-02-25 15:10:07,120][36140] DAMAGECOUNT value on done: 1716448.0 [2023-02-25 15:10:07,120][36140] Sum rewards: 64.484, reward structure: {'DEATHCOUNT': '-15.750', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.186', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'weapon2': '0.374', 'HEALTH': '0.426', 'weapon4': '0.426', 'WEAPON3': '1.100', 'weapon3': '2.888', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '54.000'} [2023-02-25 15:10:07,130][36140] DAMAGECOUNT value on done: 1700894.0 [2023-02-25 15:10:07,131][36140] Sum rewards: 60.157, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.603', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon5': '0.178', 'AMMO3': '0.210', 'AMMO4': '0.227', 'weapon2': '0.348', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.572', 'WEAPON3': '1.300', 'weapon3': '2.608', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.573', 'FRAGCOUNT': '52.000'} [2023-02-25 15:10:08,960][36138] Updated weights for policy 0, policy_version 59883 (0.0009) [2023-02-25 15:10:09,729][36114] Fps is (10 sec: 13107.3, 60 sec: 12492.8, 300 sec: 12732.3). Total num frames: 245288960. Throughput: 0: 3127.0. Samples: 23813844. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:10:09,730][36114] Avg episode reward: [(0, '60.389')] [2023-02-25 15:10:12,389][36155] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 15:10:12,489][36138] Updated weights for policy 0, policy_version 59893 (0.0010) [2023-02-25 15:10:12,542][36141] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 15:10:12,704][36142] DAMAGECOUNT value on done: 1713115.0 [2023-02-25 15:10:12,704][36142] Sum rewards: 71.339, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.804', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.112', 'weapon5': '0.130', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.316', 'weapon4': '0.344', 'WEAPON3': '1.250', 'weapon3': '2.950', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '60.000'} [2023-02-25 15:10:13,025][36142] DAMAGECOUNT value on done: 1701252.0 [2023-02-25 15:10:13,025][36142] Sum rewards: 54.104, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.202', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.118', 'weapon5': '0.144', 'AMMO4': '0.226', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.350', 'HITCOUNT': '2.910', 'weapon3': '3.066', 'DAMAGECOUNT': '14.487', 'FRAGCOUNT': '49.000'} [2023-02-25 15:10:13,640][36142] DAMAGECOUNT value on done: 1711219.0 [2023-02-25 15:10:13,641][36142] Sum rewards: 64.694, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.424', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.150', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.420', 'weapon2': '0.554', 'WEAPON3': '1.200', 'weapon3': '2.594', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '55.000'} [2023-02-25 15:10:13,992][36142] DAMAGECOUNT value on done: 1720321.0 [2023-02-25 15:10:13,992][36142] Sum rewards: 58.687, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.872', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon5': '0.170', 'AMMO4': '0.205', 'AMMO3': '0.225', 'weapon2': '0.370', 'weapon4': '0.384', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.728', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.173', 'FRAGCOUNT': '52.000'} [2023-02-25 15:10:14,254][36156] DAMAGECOUNT value on done: 1732219.0 [2023-02-25 15:10:14,255][36156] Sum rewards: 69.279, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.160', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.048', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.232', 'AMMO3': '0.257', 'WEAPON3': '1.500', 'HITCOUNT': '3.330', 'weapon3': '3.496', 'DAMAGECOUNT': '16.299', 'FRAGCOUNT': '61.000'} [2023-02-25 15:10:14,591][36156] DAMAGECOUNT value on done: 1707669.0 [2023-02-25 15:10:14,592][36156] Sum rewards: 77.867, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.226', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.024', 'AMMO4': '0.040', 'WEAPON5': '0.100', 'weapon2': '0.144', 'WEAPON4': '0.150', 'weapon4': '0.226', 'AMMO3': '0.252', 'WEAPON3': '1.450', 'weapon3': '3.382', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.972', 'FRAGCOUNT': '67.000'} [2023-02-25 15:10:14,729][36114] Fps is (10 sec: 12287.7, 60 sec: 12424.5, 300 sec: 12718.4). Total num frames: 245346304. Throughput: 0: 3132.7. Samples: 23831976. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 15:10:14,730][36114] Avg episode reward: [(0, '60.563')] [2023-02-25 15:10:14,925][36156] DAMAGECOUNT value on done: 1727121.0 [2023-02-25 15:10:14,926][36156] Sum rewards: 65.218, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.715', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.044', 'weapon7': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.153', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.512', 'weapon4': '0.770', 'WEAPON3': '0.900', 'weapon3': '2.460', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.538', 'FRAGCOUNT': '55.000'} [2023-02-25 15:10:15,278][36156] DAMAGECOUNT value on done: 1712818.0 [2023-02-25 15:10:15,279][36156] Sum rewards: 70.611, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.016', 'AMMO5': '0.007', 'AMMO2': '0.041', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'weapon5': '0.166', 'AMMO4': '0.205', 'weapon2': '0.344', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon4': '0.990', 'weapon3': '2.254', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '59.000'} [2023-02-25 15:10:15,774][36138] Updated weights for policy 0, policy_version 59903 (0.0010) [2023-02-25 15:10:17,608][36139] DAMAGECOUNT value on done: 1717217.0 [2023-02-25 15:10:17,609][36139] Sum rewards: 60.087, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.350', 'AMMO5': '0.010', 'AMMO2': '0.073', 'weapon5': '0.226', 'AMMO3': '0.230', 'weapon2': '0.236', 'WEAPON5': '0.250', 'AMMO4': '0.364', 'weapon4': '0.434', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.766', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.338', 'FRAGCOUNT': '56.000'} [2023-02-25 15:10:17,752][36155] DAMAGECOUNT value on done: 1708894.0 [2023-02-25 15:10:17,753][36155] Sum rewards: 57.861, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.298', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.217', 'weapon5': '0.240', 'WEAPON5': '0.250', 'weapon2': '0.276', 'WEAPON4': '0.350', 'weapon4': '0.426', 'WEAPON3': '1.300', 'weapon3': '2.816', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.831', 'FRAGCOUNT': '51.000'} [2023-02-25 15:10:17,964][36139] DAMAGECOUNT value on done: 1718396.0 [2023-02-25 15:10:17,965][36139] Sum rewards: 61.454, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.680', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon5': '0.140', 'AMMO3': '0.154', 'AMMO4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.320', 'WEAPON4': '0.400', 'weapon2': '0.536', 'WEAPON3': '1.000', 'weapon3': '2.794', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.054', 'FRAGCOUNT': '52.000'} [2023-02-25 15:10:18,110][36155] DAMAGECOUNT value on done: 1713761.0 [2023-02-25 15:10:18,110][36155] Sum rewards: 61.172, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.070', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon4': '0.188', 'weapon5': '0.238', 'AMMO3': '0.252', 'WEAPON4': '0.300', 'weapon2': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '2.982', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '55.500'} [2023-02-25 15:10:18,376][36139] DAMAGECOUNT value on done: 1726755.0 [2023-02-25 15:10:18,377][36139] Sum rewards: 71.024, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.680', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO3': '0.196', 'weapon2': '0.436', 'WEAPON3': '1.200', 'weapon3': '3.428', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.782', 'FRAGCOUNT': '59.000'} [2023-02-25 15:10:18,759][36139] DAMAGECOUNT value on done: 1727089.0 [2023-02-25 15:10:18,759][36139] Sum rewards: 68.462, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.630', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.174', 'AMMO3': '0.181', 'weapon2': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon5': '0.302', 'weapon4': '0.690', 'WEAPON3': '1.050', 'weapon3': '2.490', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '57.000'} [2023-02-25 15:10:19,057][36155] DAMAGECOUNT value on done: 1730083.0 [2023-02-25 15:10:19,057][36155] Sum rewards: 71.203, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.225', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.094', 'AMMO4': '0.112', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'weapon2': '0.340', 'WEAPON4': '0.400', 'ARMOR': '0.455', 'weapon4': '0.690', 'WEAPON3': '1.050', 'weapon3': '2.594', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '60.000'} [2023-02-25 15:10:19,148][36138] Updated weights for policy 0, policy_version 59913 (0.0010) [2023-02-25 15:10:19,379][36155] DAMAGECOUNT value on done: 1715143.0 [2023-02-25 15:10:19,380][36155] Sum rewards: 63.990, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.180', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.042', 'AMMO4': '0.208', 'weapon5': '0.244', 'AMMO3': '0.246', 'weapon2': '0.256', 'weapon4': '0.384', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.788', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.521', 'FRAGCOUNT': '59.000'} [2023-02-25 15:10:19,727][36139] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 15:10:19,729][36114] Fps is (10 sec: 11878.3, 60 sec: 12424.5, 300 sec: 12690.7). Total num frames: 245407744. Throughput: 0: 3125.6. Samples: 23850308. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 15:10:19,730][36114] Avg episode reward: [(0, '61.404')] [2023-02-25 15:10:20,214][36154] DAMAGECOUNT value on done: 1719517.0 [2023-02-25 15:10:20,214][36154] Sum rewards: 56.333, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.658', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.124', 'AMMO4': '0.132', 'weapon2': '0.192', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'weapon4': '0.348', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.830', 'weapon3': '3.102', 'DAMAGECOUNT': '14.421', 'FRAGCOUNT': '50.000'} [2023-02-25 15:10:20,545][36154] DAMAGECOUNT value on done: 1697374.0 [2023-02-25 15:10:20,545][36154] Sum rewards: 53.986, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.432', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.048', 'weapon4': '0.124', 'AMMO4': '0.127', 'AMMO3': '0.141', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.408', 'WEAPON3': '0.800', 'HITCOUNT': '2.620', 'weapon3': '3.270', 'DAMAGECOUNT': '12.948', 'FRAGCOUNT': '44.000'} [2023-02-25 15:10:21,109][36154] DAMAGECOUNT value on done: 1731823.0 [2023-02-25 15:10:21,109][36154] Sum rewards: 39.689, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.144', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO3': '0.146', 'weapon4': '0.194', 'weapon5': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.666', 'WEAPON3': '0.850', 'HITCOUNT': '1.970', 'weapon3': '2.446', 'DAMAGECOUNT': '10.845', 'FRAGCOUNT': '34.000'} [2023-02-25 15:10:21,431][36154] DAMAGECOUNT value on done: 1712872.0 [2023-02-25 15:10:21,432][36154] Sum rewards: 51.598, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.805', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.078', 'AMMO3': '0.154', 'weapon5': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.672', 'weapon4': '0.826', 'WEAPON3': '0.900', 'weapon3': '2.132', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.512', 'FRAGCOUNT': '42.000'} [2023-02-25 15:10:22,345][36141] DAMAGECOUNT value on done: 1720652.0 [2023-02-25 15:10:22,345][36141] Sum rewards: 69.872, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.825', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.118', 'AMMO4': '0.164', 'AMMO3': '0.178', 'weapon2': '0.238', 'weapon4': '0.258', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.170', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '60.000'} [2023-02-25 15:10:22,419][36138] Updated weights for policy 0, policy_version 59923 (0.0009) [2023-02-25 15:10:22,543][36141] DAMAGECOUNT value on done: 1716142.0 [2023-02-25 15:10:22,543][36141] Sum rewards: 74.981, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.380', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO3': '0.200', 'weapon2': '0.778', 'WEAPON3': '1.150', 'weapon3': '3.088', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '61.000'} [2023-02-25 15:10:22,675][36141] DAMAGECOUNT value on done: 1727153.0 [2023-02-25 15:10:22,676][36141] Sum rewards: 51.815, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.034', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon2': '0.138', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.322', 'weapon4': '0.788', 'WEAPON3': '1.250', 'weapon3': '2.480', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.422', 'FRAGCOUNT': '46.000'} [2023-02-25 15:10:22,872][36141] DAMAGECOUNT value on done: 1697902.0 [2023-02-25 15:10:22,872][36141] Sum rewards: 61.773, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.580', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon5': '0.200', 'weapon4': '0.224', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.450', 'weapon3': '3.072', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '54.000'} [2023-02-25 15:10:24,724][36140] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 15:10:24,729][36114] Fps is (10 sec: 12697.9, 60 sec: 12492.8, 300 sec: 12690.7). Total num frames: 245473280. Throughput: 0: 3128.9. Samples: 23859780. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 15:10:24,730][36114] Avg episode reward: [(0, '61.479')] [2023-02-25 15:10:25,570][36138] Updated weights for policy 0, policy_version 59933 (0.0009) [2023-02-25 15:10:27,139][36157] DAMAGECOUNT value on done: 1733718.0 [2023-02-25 15:10:27,140][36157] Sum rewards: 49.783, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.250', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'weapon4': '0.370', 'weapon2': '0.836', 'WEAPON3': '1.100', 'weapon3': '2.522', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '13.086', 'FRAGCOUNT': '42.000'} [2023-02-25 15:10:27,455][36157] DAMAGECOUNT value on done: 1717422.0 [2023-02-25 15:10:27,455][36157] Sum rewards: 51.889, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.270', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.269', 'weapon2': '0.326', 'WEAPON3': '1.650', 'HITCOUNT': '3.250', 'weapon3': '3.392', 'DAMAGECOUNT': '14.811', 'FRAGCOUNT': '47.000'} [2023-02-25 15:10:28,141][36157] DAMAGECOUNT value on done: 1740515.0 [2023-02-25 15:10:28,142][36157] Sum rewards: 59.642, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.376', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.102', 'weapon5': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.268', 'weapon2': '0.272', 'weapon4': '0.276', 'WEAPON3': '1.550', 'weapon3': '3.070', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.840', 'FRAGCOUNT': '54.000'} [2023-02-25 15:10:28,383][36140] DAMAGECOUNT value on done: 1721301.0 [2023-02-25 15:10:28,384][36140] Sum rewards: 54.468, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.840', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.062', 'weapon5': '0.200', 'AMMO3': '0.216', 'AMMO4': '0.308', 'weapon4': '0.374', 'WEAPON5': '0.400', 'weapon2': '0.582', 'WEAPON4': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.520', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '50.000'} [2023-02-25 15:10:28,395][36140] DAMAGECOUNT value on done: 1731823.0 [2023-02-25 15:10:28,395][36140] Sum rewards: 53.588, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.784', 'ARMOR': '0.012', 'AMMO5': '0.021', 'AMMO2': '0.061', 'AMMO3': '0.189', 'weapon5': '0.274', 'AMMO4': '0.306', 'weapon2': '0.432', 'WEAPON5': '0.500', 'weapon4': '0.562', 'WEAPON4': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.400', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.774', 'FRAGCOUNT': '47.500'} [2023-02-25 15:10:28,450][36157] DAMAGECOUNT value on done: 1723503.0 [2023-02-25 15:10:28,451][36157] Sum rewards: 51.141, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.371', 'AMMO2': '0.016', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'weapon4': '0.112', 'AMMO3': '0.237', 'weapon2': '0.336', 'WEAPON3': '1.500', 'HITCOUNT': '2.960', 'weapon3': '3.414', 'DAMAGECOUNT': '14.010', 'FRAGCOUNT': '46.000'} [2023-02-25 15:10:28,682][36138] Updated weights for policy 0, policy_version 59943 (0.0009) [2023-02-25 15:10:28,708][36140] DAMAGECOUNT value on done: 1721719.0 [2023-02-25 15:10:28,709][36140] Sum rewards: 68.630, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.635', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.074', 'AMMO4': '0.087', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'WEAPON4': '0.300', 'weapon2': '0.374', 'weapon4': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.608', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '15.813', 'FRAGCOUNT': '58.000'} [2023-02-25 15:10:28,722][36140] DAMAGECOUNT value on done: 1704756.0 [2023-02-25 15:10:28,723][36140] Sum rewards: 46.367, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.624', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.116', 'AMMO3': '0.123', 'AMMO4': '0.178', 'weapon4': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.666', 'WEAPON3': '0.850', 'weapon3': '2.756', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '11.586', 'FRAGCOUNT': '38.500'} [2023-02-25 15:10:29,729][36114] Fps is (10 sec: 13107.3, 60 sec: 12561.1, 300 sec: 12676.8). Total num frames: 245538816. Throughput: 0: 3149.3. Samples: 23879432. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 15:10:29,729][36114] Avg episode reward: [(0, '61.065')] [2023-02-25 15:10:31,761][36138] Updated weights for policy 0, policy_version 59953 (0.0009) [2023-02-25 15:10:33,732][36142] DAMAGECOUNT value on done: 1718225.0 [2023-02-25 15:10:33,732][36142] Sum rewards: 60.554, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.604', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.073', 'AMMO3': '0.202', 'weapon2': '0.278', 'WEAPON3': '1.300', 'HITCOUNT': '3.260', 'weapon3': '3.520', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '50.000'} [2023-02-25 15:10:34,059][36142] DAMAGECOUNT value on done: 1705531.0 [2023-02-25 15:10:34,060][36142] Sum rewards: 52.652, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.743', 'AMMO5': '0.014', 'AMMO2': '0.055', 'weapon5': '0.070', 'AMMO3': '0.146', 'AMMO4': '0.273', 'WEAPON5': '0.350', 'weapon2': '0.392', 'ARMOR': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.564', 'WEAPON3': '0.900', 'weapon3': '2.654', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '12.837', 'FRAGCOUNT': '45.000'} [2023-02-25 15:10:34,729][36114] Fps is (10 sec: 13107.2, 60 sec: 12629.4, 300 sec: 12676.8). Total num frames: 245604352. Throughput: 0: 3161.9. Samples: 23898852. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 15:10:34,730][36114] Avg episode reward: [(0, '60.994')] [2023-02-25 15:10:34,764][36142] DAMAGECOUNT value on done: 1716265.0 [2023-02-25 15:10:34,764][36142] Sum rewards: 58.310, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.834', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.138', 'AMMO3': '0.244', 'weapon4': '0.490', 'WEAPON3': '1.550', 'weapon3': '3.058', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.138', 'FRAGCOUNT': '51.000'} [2023-02-25 15:10:35,018][36138] Updated weights for policy 0, policy_version 59963 (0.0010) [2023-02-25 15:10:35,091][36142] DAMAGECOUNT value on done: 1724683.0 [2023-02-25 15:10:35,092][36142] Sum rewards: 55.535, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.810', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.136', 'AMMO4': '0.166', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.282', 'weapon4': '0.312', 'WEAPON3': '1.250', 'HITCOUNT': '2.910', 'weapon3': '3.062', 'DAMAGECOUNT': '13.086', 'FRAGCOUNT': '49.000'} [2023-02-25 15:10:35,255][36156] DAMAGECOUNT value on done: 1737981.0 [2023-02-25 15:10:35,255][36156] Sum rewards: 71.002, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.380', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.154', 'AMMO4': '0.180', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.324', 'weapon4': '0.574', 'WEAPON3': '1.100', 'weapon3': '2.700', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '59.000'} [2023-02-25 15:10:35,605][36156] DAMAGECOUNT value on done: 1711712.0 [2023-02-25 15:10:35,606][36156] Sum rewards: 48.993, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.530', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'weapon2': '0.332', 'ARMOR': '0.495', 'weapon4': '0.540', 'WEAPON3': '1.000', 'HITCOUNT': '2.520', 'weapon3': '2.776', 'DAMAGECOUNT': '12.129', 'FRAGCOUNT': '42.000'} [2023-02-25 15:10:35,966][36156] DAMAGECOUNT value on done: 1732148.0 [2023-02-25 15:10:35,967][36156] Sum rewards: 57.037, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.864', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.140', 'AMMO3': '0.192', 'weapon2': '0.804', 'WEAPON3': '1.100', 'weapon3': '2.784', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.081', 'FRAGCOUNT': '48.000'} [2023-02-25 15:10:36,264][36156] DAMAGECOUNT value on done: 1718056.0 [2023-02-25 15:10:36,265][36156] Sum rewards: 58.990, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.272', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.152', 'AMMO4': '0.160', 'weapon2': '0.178', 'AMMO3': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.504', 'WEAPON3': '1.100', 'weapon3': '2.768', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.699', 'FRAGCOUNT': '49.000'} [2023-02-25 15:10:38,409][36138] Updated weights for policy 0, policy_version 59973 (0.0010) [2023-02-25 15:10:38,772][36139] DAMAGECOUNT value on done: 1722333.0 [2023-02-25 15:10:38,772][36139] Sum rewards: 61.195, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.748', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO3': '0.233', 'weapon2': '0.368', 'WEAPON3': '1.450', 'HITCOUNT': '2.920', 'weapon3': '3.258', 'DAMAGECOUNT': '15.348', 'FRAGCOUNT': '54.000'} [2023-02-25 15:10:38,822][36155] DAMAGECOUNT value on done: 1714826.0 [2023-02-25 15:10:38,823][36155] Sum rewards: 63.989, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.432', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.158', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.300', 'weapon4': '0.666', 'WEAPON3': '1.400', 'weapon3': '2.592', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '54.000'} [2023-02-25 15:10:39,099][36139] DAMAGECOUNT value on done: 1722818.0 [2023-02-25 15:10:39,100][36139] Sum rewards: 48.687, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.444', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.023', 'weapon5': '0.040', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon4': '0.280', 'weapon2': '0.284', 'WEAPON3': '1.250', 'HITCOUNT': '2.550', 'weapon3': '3.208', 'DAMAGECOUNT': '13.266', 'FRAGCOUNT': '43.000'} [2023-02-25 15:10:39,181][36155] DAMAGECOUNT value on done: 1719147.0 [2023-02-25 15:10:39,181][36155] Sum rewards: 63.796, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.548', 'AMMO5': '0.012', 'AMMO2': '0.040', 'AMMO3': '0.199', 'AMMO4': '0.199', 'weapon5': '0.210', 'WEAPON5': '0.300', 'weapon4': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.430', 'WEAPON3': '1.150', 'weapon3': '2.716', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '55.000'} [2023-02-25 15:10:39,431][36139] DAMAGECOUNT value on done: 1731155.0 [2023-02-25 15:10:39,432][36139] Sum rewards: 49.607, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.076', 'AMMO5': '0.017', 'AMMO2': '0.034', 'AMMO4': '0.169', 'AMMO3': '0.173', 'weapon5': '0.198', 'weapon2': '0.258', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.604', 'WEAPON3': '1.100', 'weapon3': '2.460', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '13.200', 'FRAGCOUNT': '43.000'} [2023-02-25 15:10:39,730][36114] Fps is (10 sec: 12287.3, 60 sec: 12561.0, 300 sec: 12649.0). Total num frames: 245661696. Throughput: 0: 3158.8. Samples: 23908074. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 15:10:39,731][36114] Avg episode reward: [(0, '60.321')] [2023-02-25 15:10:39,785][36139] DAMAGECOUNT value on done: 1732044.0 [2023-02-25 15:10:39,785][36139] Sum rewards: 59.877, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.906', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.060', 'AMMO4': '0.176', 'weapon4': '0.238', 'AMMO3': '0.247', 'WEAPON5': '0.250', 'weapon2': '0.392', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.038', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '54.000'} [2023-02-25 15:10:40,188][36155] DAMAGECOUNT value on done: 1735236.0 [2023-02-25 15:10:40,188][36155] Sum rewards: 67.420, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.488', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.046', 'AMMO3': '0.135', 'weapon5': '0.208', 'AMMO4': '0.229', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.710', 'WEAPON3': '0.750', 'weapon3': '2.542', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.459', 'FRAGCOUNT': '56.000'} [2023-02-25 15:10:40,568][36155] DAMAGECOUNT value on done: 1719993.0 [2023-02-25 15:10:40,568][36155] Sum rewards: 53.599, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.266', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.150', 'AMMO3': '0.163', 'weapon5': '0.232', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.584', 'weapon4': '0.678', 'WEAPON3': '0.950', 'weapon3': '2.272', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.550', 'FRAGCOUNT': '44.000'} [2023-02-25 15:10:41,407][36154] DAMAGECOUNT value on done: 1724272.0 [2023-02-25 15:10:41,408][36154] Sum rewards: 53.560, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.857', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon2': '0.168', 'AMMO3': '0.193', 'AMMO4': '0.244', 'weapon5': '0.292', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.710', 'WEAPON3': '1.100', 'weapon3': '2.520', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.265', 'FRAGCOUNT': '47.000'} [2023-02-25 15:10:41,752][36154] DAMAGECOUNT value on done: 1702454.0 [2023-02-25 15:10:41,753][36154] Sum rewards: 63.253, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.954', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.130', 'AMMO3': '0.138', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.530', 'weapon4': '0.718', 'WEAPON3': '0.850', 'weapon3': '2.350', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.240', 'FRAGCOUNT': '51.000'} [2023-02-25 15:10:41,825][36138] Updated weights for policy 0, policy_version 59983 (0.0010) [2023-02-25 15:10:42,395][36154] DAMAGECOUNT value on done: 1737400.0 [2023-02-25 15:10:42,396][36154] Sum rewards: 65.575, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.780', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.140', 'weapon2': '0.142', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon4': '0.322', 'WEAPON3': '1.450', 'weapon3': '3.182', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '58.000'} [2023-02-25 15:10:42,727][36154] DAMAGECOUNT value on done: 1718524.0 [2023-02-25 15:10:42,727][36154] Sum rewards: 70.655, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.760', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.144', 'AMMO3': '0.168', 'weapon2': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.574', 'WEAPON3': '1.100', 'weapon3': '2.654', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '60.000'} [2023-02-25 15:10:43,749][36141] DAMAGECOUNT value on done: 1726098.0 [2023-02-25 15:10:43,749][36141] Sum rewards: 69.932, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.358', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.110', 'weapon4': '0.142', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon2': '0.430', 'WEAPON3': '1.100', 'weapon3': '3.236', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.338', 'FRAGCOUNT': '58.000'} [2023-02-25 15:10:43,906][36141] DAMAGECOUNT value on done: 1721584.0 [2023-02-25 15:10:43,906][36141] Sum rewards: 66.209, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.366', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.128', 'AMMO4': '0.137', 'AMMO3': '0.213', 'weapon4': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.388', 'WEAPON3': '1.350', 'weapon3': '3.012', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '57.000'} [2023-02-25 15:10:44,096][36141] DAMAGECOUNT value on done: 1732866.0 [2023-02-25 15:10:44,097][36141] Sum rewards: 63.459, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.385', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'weapon2': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon4': '0.398', 'WEAPON3': '1.350', 'weapon3': '3.166', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '53.500'} [2023-02-25 15:10:44,261][36141] DAMAGECOUNT value on done: 1702234.0 [2023-02-25 15:10:44,262][36141] Sum rewards: 45.572, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.194', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.034', 'weapon5': '0.098', 'AMMO4': '0.167', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'weapon2': '0.318', 'WEAPON4': '0.450', 'weapon4': '0.914', 'WEAPON3': '1.050', 'weapon3': '2.374', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.996', 'FRAGCOUNT': '40.000'} [2023-02-25 15:10:44,729][36114] Fps is (10 sec: 11878.4, 60 sec: 12561.1, 300 sec: 12621.2). Total num frames: 245723136. Throughput: 0: 3145.7. Samples: 23925918. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 15:10:44,730][36114] Avg episode reward: [(0, '60.609')] [2023-02-25 15:10:45,191][36138] Updated weights for policy 0, policy_version 59993 (0.0010) [2023-02-25 15:10:48,546][36138] Updated weights for policy 0, policy_version 60003 (0.0010) [2023-02-25 15:10:48,808][36157] DAMAGECOUNT value on done: 1739197.0 [2023-02-25 15:10:48,809][36157] Sum rewards: 67.375, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.752', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.104', 'AMMO4': '0.149', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.326', 'weapon2': '0.744', 'WEAPON3': '0.950', 'weapon3': '2.640', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.437', 'FRAGCOUNT': '54.000'} [2023-02-25 15:10:49,151][36157] DAMAGECOUNT value on done: 1722462.0 [2023-02-25 15:10:49,151][36157] Sum rewards: 54.888, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.560', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.160', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'weapon2': '0.232', 'AMMO3': '0.241', 'WEAPON4': '0.350', 'weapon4': '0.618', 'WEAPON3': '1.500', 'weapon3': '2.726', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.120', 'FRAGCOUNT': '49.500'} [2023-02-25 15:10:49,729][36114] Fps is (10 sec: 12288.6, 60 sec: 12492.8, 300 sec: 12607.3). Total num frames: 245784576. Throughput: 0: 3112.0. Samples: 23944012. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 15:10:49,730][36114] Avg episode reward: [(0, '60.633')] [2023-02-25 15:10:49,888][36157] DAMAGECOUNT value on done: 1745935.0 [2023-02-25 15:10:49,889][36157] Sum rewards: 69.961, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.620', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.090', 'AMMO4': '0.119', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'weapon2': '0.356', 'WEAPON4': '0.500', 'weapon4': '0.658', 'WEAPON3': '1.100', 'weapon3': '2.702', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '60.000'} [2023-02-25 15:10:50,225][36157] DAMAGECOUNT value on done: 1728680.0 [2023-02-25 15:10:50,226][36157] Sum rewards: 55.071, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.888', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon5': '0.112', 'AMMO3': '0.204', 'AMMO4': '0.234', 'weapon2': '0.326', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.430', 'WEAPON3': '1.300', 'weapon3': '2.920', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.531', 'FRAGCOUNT': '48.000'} [2023-02-25 15:10:50,300][36140] DAMAGECOUNT value on done: 1726367.0 [2023-02-25 15:10:50,301][36140] Sum rewards: 52.237, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.755', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.102', 'AMMO4': '0.151', 'AMMO3': '0.278', 'WEAPON5': '0.300', 'weapon4': '0.356', 'WEAPON4': '0.400', 'weapon2': '0.462', 'WEAPON3': '1.700', 'weapon3': '2.734', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.198', 'FRAGCOUNT': '50.000'} [2023-02-25 15:10:50,312][36140] DAMAGECOUNT value on done: 1737415.0 [2023-02-25 15:10:50,313][36140] Sum rewards: 54.329, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.304', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.110', 'AMMO4': '0.154', 'weapon2': '0.162', 'AMMO3': '0.279', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon4': '0.570', 'WEAPON3': '1.700', 'weapon3': '2.842', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '49.000'} [2023-02-25 15:10:50,659][36140] DAMAGECOUNT value on done: 1726728.0 [2023-02-25 15:10:50,659][36140] Sum rewards: 52.990, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.640', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon5': '0.188', 'AMMO3': '0.199', 'AMMO4': '0.276', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON4': '0.600', 'weapon4': '0.876', 'WEAPON3': '1.250', 'weapon3': '2.170', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '15.027', 'FRAGCOUNT': '48.000'} [2023-02-25 15:10:50,671][36140] DAMAGECOUNT value on done: 1708709.0 [2023-02-25 15:10:50,671][36140] Sum rewards: 47.095, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.480', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.108', 'AMMO3': '0.180', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.596', 'weapon2': '0.742', 'WEAPON3': '1.100', 'weapon3': '2.334', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '11.859', 'FRAGCOUNT': '42.000'} [2023-02-25 15:10:52,021][36138] Updated weights for policy 0, policy_version 60013 (0.0010) [2023-02-25 15:10:54,729][36114] Fps is (10 sec: 12288.1, 60 sec: 12492.8, 300 sec: 12579.6). Total num frames: 245846016. Throughput: 0: 3086.0. Samples: 23952716. Policy #0 lag: (min: 0.0, avg: 0.4, max: 2.0) [2023-02-25 15:10:54,730][36114] Avg episode reward: [(0, '60.185')] [2023-02-25 15:10:54,774][36155] Large shaping reward 2.563 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.069, -23.0), ('weapon5', 0.002)] [2023-02-25 15:10:55,299][36138] Updated weights for policy 0, policy_version 60023 (0.0009) [2023-02-25 15:10:56,031][36142] DAMAGECOUNT value on done: 1722720.0 [2023-02-25 15:10:56,031][36142] Sum rewards: 49.754, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.075', 'AMMO5': '0.013', 'AMMO2': '0.033', 'AMMO4': '0.166', 'AMMO3': '0.173', 'weapon5': '0.190', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.416', 'weapon4': '0.520', 'WEAPON3': '1.000', 'weapon3': '2.672', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.485', 'FRAGCOUNT': '43.000'} [2023-02-25 15:10:56,357][36142] DAMAGECOUNT value on done: 1710783.0 [2023-02-25 15:10:56,357][36142] Sum rewards: 57.704, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.153', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.104', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.306', 'WEAPON4': '0.400', 'ARMOR': '0.460', 'weapon4': '0.752', 'WEAPON3': '1.350', 'weapon3': '2.492', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '51.000'} [2023-02-25 15:10:56,909][36142] DAMAGECOUNT value on done: 1722140.0 [2023-02-25 15:10:56,910][36142] Sum rewards: 69.115, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.177', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'weapon2': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.886', 'WEAPON3': '0.950', 'weapon3': '2.472', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '57.000'} [2023-02-25 15:10:57,228][36142] DAMAGECOUNT value on done: 1730575.0 [2023-02-25 15:10:57,228][36142] Sum rewards: 71.336, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.463', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'weapon5': '0.122', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'weapon4': '0.476', 'weapon2': '0.778', 'WEAPON3': '1.100', 'weapon3': '2.440', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '58.000'} [2023-02-25 15:10:57,528][36156] DAMAGECOUNT value on done: 1742852.0 [2023-02-25 15:10:57,529][36156] Sum rewards: 58.855, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.625', 'AMMO5': '0.017', 'AMMO2': '0.051', 'AMMO3': '0.116', 'weapon5': '0.210', 'AMMO4': '0.255', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.760', 'WEAPON3': '0.800', 'weapon2': '0.810', 'weapon3': '1.978', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '14.613', 'FRAGCOUNT': '48.000'} [2023-02-25 15:10:57,859][36156] DAMAGECOUNT value on done: 1716730.0 [2023-02-25 15:10:57,859][36156] Sum rewards: 58.216, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.205', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.050', 'AMMO3': '0.138', 'weapon5': '0.186', 'AMMO4': '0.252', 'WEAPON5': '0.350', 'weapon2': '0.416', 'WEAPON4': '0.600', 'weapon4': '0.778', 'WEAPON3': '0.850', 'weapon3': '2.316', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.054', 'FRAGCOUNT': '49.000'} [2023-02-25 15:10:58,210][36156] DAMAGECOUNT value on done: 1736950.0 [2023-02-25 15:10:58,211][36156] Sum rewards: 58.059, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.698', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.094', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.239', 'weapon2': '0.254', 'ARMOR': '0.404', 'weapon4': '0.492', 'WEAPON3': '1.500', 'weapon3': '2.874', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.406', 'FRAGCOUNT': '52.000'} [2023-02-25 15:10:58,436][36138] Updated weights for policy 0, policy_version 60033 (0.0009) [2023-02-25 15:10:58,528][36156] DAMAGECOUNT value on done: 1722838.0 [2023-02-25 15:10:58,529][36156] Sum rewards: 53.008, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-4.525', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.064', 'AMMO4': '0.066', 'weapon4': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.294', 'AMMO3': '0.355', 'WEAPON3': '2.100', 'HITCOUNT': '2.930', 'weapon3': '3.274', 'DAMAGECOUNT': '14.346', 'FRAGCOUNT': '54.000'} [2023-02-25 15:10:59,729][36114] Fps is (10 sec: 12697.7, 60 sec: 12561.1, 300 sec: 12579.6). Total num frames: 245911552. Throughput: 0: 3116.2. Samples: 23972202. Policy #0 lag: (min: 0.0, avg: 0.4, max: 2.0) [2023-02-25 15:10:59,729][36114] Avg episode reward: [(0, '60.001')] [2023-02-25 15:11:00,644][36139] DAMAGECOUNT value on done: 1726708.0 [2023-02-25 15:11:00,645][36139] Sum rewards: 53.482, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.637', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.018', 'weapon5': '0.048', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon4': '0.326', 'weapon2': '0.690', 'WEAPON3': '1.200', 'weapon3': '2.756', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.125', 'FRAGCOUNT': '47.000'} [2023-02-25 15:11:00,704][36155] DAMAGECOUNT value on done: 1721255.0 [2023-02-25 15:11:00,705][36155] Sum rewards: 75.443, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.622', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.057', 'AMMO3': '0.163', 'weapon5': '0.246', 'AMMO4': '0.286', 'weapon2': '0.346', 'WEAPON5': '0.450', 'weapon4': '0.452', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.604', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.287', 'FRAGCOUNT': '62.000'} [2023-02-25 15:11:01,011][36139] DAMAGECOUNT value on done: 1728293.0 [2023-02-25 15:11:01,012][36139] Sum rewards: 66.375, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.695', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon5': '0.114', 'AMMO3': '0.187', 'weapon4': '0.216', 'AMMO4': '0.240', 'WEAPON5': '0.400', 'weapon2': '0.424', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '3.014', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.341', 'FRAGCOUNT': '58.000'} [2023-02-25 15:11:01,068][36155] DAMAGECOUNT value on done: 1723402.0 [2023-02-25 15:11:01,069][36155] Sum rewards: 50.253, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.115', 'AMMO2': '0.004', 'AMMO4': '0.018', 'WEAPON4': '0.050', 'weapon4': '0.162', 'AMMO3': '0.193', 'weapon2': '0.560', 'WEAPON3': '1.350', 'HITCOUNT': '2.870', 'weapon3': '3.146', 'DAMAGECOUNT': '12.765', 'FRAGCOUNT': '45.000'} [2023-02-25 15:11:01,303][36139] DAMAGECOUNT value on done: 1736031.0 [2023-02-25 15:11:01,304][36139] Sum rewards: 52.359, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.322', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon5': '0.166', 'AMMO3': '0.183', 'AMMO4': '0.233', 'WEAPON5': '0.350', 'weapon4': '0.382', 'weapon2': '0.496', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.714', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.478', 'FRAGCOUNT': '46.000'} [2023-02-25 15:11:01,667][36139] DAMAGECOUNT value on done: 1737118.0 [2023-02-25 15:11:01,668][36139] Sum rewards: 56.828, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.522', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.056', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.170', 'AMMO3': '0.296', 'weapon2': '0.390', 'WEAPON3': '1.700', 'weapon3': '3.112', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.222', 'FRAGCOUNT': '52.000'} [2023-02-25 15:11:01,885][36138] Updated weights for policy 0, policy_version 60043 (0.0010) [2023-02-25 15:11:02,090][36155] DAMAGECOUNT value on done: 1740392.0 [2023-02-25 15:11:02,090][36155] Sum rewards: 59.072, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.312', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon4': '0.102', 'weapon5': '0.112', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO4': '0.203', 'AMMO3': '0.225', 'weapon2': '0.412', 'WEAPON3': '1.300', 'HITCOUNT': '3.040', 'weapon3': '3.122', 'DAMAGECOUNT': '15.468', 'FRAGCOUNT': '51.000'} [2023-02-25 15:11:02,400][36155] DAMAGECOUNT value on done: 1725337.0 [2023-02-25 15:11:02,400][36155] Sum rewards: 61.808, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.062', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.090', 'AMMO4': '0.105', 'weapon4': '0.106', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.241', 'weapon2': '0.332', 'WEAPON3': '1.550', 'weapon3': '3.250', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.816', 'FRAGCOUNT': '55.000'} [2023-02-25 15:11:03,435][36154] DAMAGECOUNT value on done: 1729375.0 [2023-02-25 15:11:03,435][36154] Sum rewards: 61.384, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.191', 'weapon5': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HEALTH': '0.302', 'weapon2': '0.416', 'weapon4': '0.502', 'WEAPON3': '1.000', 'weapon3': '2.564', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.309', 'FRAGCOUNT': '52.000'} [2023-02-25 15:11:03,746][36154] DAMAGECOUNT value on done: 1707979.0 [2023-02-25 15:11:03,747][36154] Sum rewards: 60.732, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.166', 'AMMO5': '0.022', 'AMMO2': '0.039', 'AMMO3': '0.171', 'AMMO4': '0.193', 'weapon5': '0.212', 'weapon2': '0.522', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.818', 'WEAPON3': '1.000', 'weapon3': '2.096', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '51.000'} [2023-02-25 15:11:04,302][36154] DAMAGECOUNT value on done: 1742127.0 [2023-02-25 15:11:04,303][36154] Sum rewards: 51.444, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.100', 'ARMOR': '0.009', 'AMMO5': '0.020', 'AMMO2': '0.082', 'AMMO3': '0.175', 'weapon2': '0.230', 'weapon5': '0.332', 'weapon4': '0.392', 'AMMO4': '0.410', 'WEAPON5': '0.700', 'WEAPON4': '0.900', 'WEAPON3': '1.050', 'HITCOUNT': '2.630', 'weapon3': '2.682', 'DAMAGECOUNT': '14.181', 'FRAGCOUNT': '48.000'} [2023-02-25 15:11:04,599][36154] DAMAGECOUNT value on done: 1723157.0 [2023-02-25 15:11:04,600][36154] Sum rewards: 54.879, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.995', 'AMMO2': '0.028', 'AMMO4': '0.138', 'AMMO3': '0.177', 'WEAPON4': '0.300', 'weapon2': '0.410', 'weapon4': '0.684', 'WEAPON3': '1.100', 'weapon3': '2.668', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '13.899', 'FRAGCOUNT': '47.000'} [2023-02-25 15:11:04,729][36114] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12551.8). Total num frames: 245972992. Throughput: 0: 3122.6. Samples: 23990824. Policy #0 lag: (min: 0.0, avg: 0.4, max: 2.0) [2023-02-25 15:11:04,729][36114] Avg episode reward: [(0, '59.770')] [2023-02-25 15:11:04,973][36138] Updated weights for policy 0, policy_version 60053 (0.0009) [2023-02-25 15:11:05,307][36141] DAMAGECOUNT value on done: 1730693.0 [2023-02-25 15:11:05,308][36141] Sum rewards: 55.041, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.410', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.080', 'AMMO4': '0.083', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'WEAPON4': '0.350', 'weapon2': '0.450', 'weapon4': '0.594', 'WEAPON3': '0.850', 'weapon3': '2.608', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.785', 'FRAGCOUNT': '46.000'} [2023-02-25 15:11:05,453][36141] DAMAGECOUNT value on done: 1725693.0 [2023-02-25 15:11:05,454][36141] Sum rewards: 44.009, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.738', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.050', 'AMMO3': '0.187', 'weapon5': '0.192', 'AMMO4': '0.252', 'WEAPON5': '0.450', 'weapon2': '0.508', 'WEAPON4': '0.650', 'weapon4': '0.660', 'WEAPON3': '1.100', 'weapon3': '2.322', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.327', 'FRAGCOUNT': '41.000'} [2023-02-25 15:11:05,637][36141] DAMAGECOUNT value on done: 1738935.0 [2023-02-25 15:11:05,638][36141] Sum rewards: 75.690, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.836', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.134', 'weapon2': '0.148', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.348', 'WEAPON3': '1.400', 'weapon3': '3.086', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '18.207', 'FRAGCOUNT': '65.000'} [2023-02-25 15:11:05,781][36141] DAMAGECOUNT value on done: 1707413.0 [2023-02-25 15:11:05,782][36141] Sum rewards: 65.442, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.930', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.120', 'weapon5': '0.122', 'AMMO3': '0.148', 'AMMO4': '0.161', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.836', 'WEAPON3': '1.050', 'weapon3': '2.744', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '55.000'} [2023-02-25 15:11:08,139][36138] Updated weights for policy 0, policy_version 60063 (0.0009) [2023-02-25 15:11:09,729][36114] Fps is (10 sec: 12287.9, 60 sec: 12424.5, 300 sec: 12537.9). Total num frames: 246034432. Throughput: 0: 3131.8. Samples: 24000710. Policy #0 lag: (min: 0.0, avg: 0.4, max: 2.0) [2023-02-25 15:11:09,730][36114] Avg episode reward: [(0, '59.786')] [2023-02-25 15:11:10,102][36157] DAMAGECOUNT value on done: 1745048.0 [2023-02-25 15:11:10,102][36157] Sum rewards: 67.725, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.850', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.100', 'AMMO4': '0.180', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.320', 'weapon2': '0.604', 'WEAPON3': '1.150', 'weapon3': '2.730', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '57.000'} [2023-02-25 15:11:10,439][36157] DAMAGECOUNT value on done: 1727348.0 [2023-02-25 15:11:10,440][36157] Sum rewards: 56.864, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.898', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon5': '0.134', 'AMMO4': '0.155', 'AMMO3': '0.171', 'weapon2': '0.328', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.850', 'WEAPON3': '0.950', 'weapon3': '2.380', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.658', 'FRAGCOUNT': '48.500'} [2023-02-25 15:11:11,080][36157] DAMAGECOUNT value on done: 1751143.0 [2023-02-25 15:11:11,080][36157] Sum rewards: 60.094, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.885', 'AMMO5': '0.014', 'AMMO2': '0.047', 'AMMO3': '0.146', 'weapon5': '0.224', 'AMMO4': '0.237', 'WEAPON5': '0.450', 'weapon2': '0.476', 'WEAPON4': '0.700', 'WEAPON3': '0.900', 'weapon4': '1.160', 'weapon3': '1.640', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.624', 'FRAGCOUNT': '53.000'} [2023-02-25 15:11:11,299][36138] Updated weights for policy 0, policy_version 60073 (0.0009) [2023-02-25 15:11:11,376][36140] DAMAGECOUNT value on done: 1732160.0 [2023-02-25 15:11:11,376][36140] Sum rewards: 68.166, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.561', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.180', 'weapon5': '0.194', 'WEAPON4': '0.200', 'weapon4': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.446', 'WEAPON3': '1.050', 'weapon3': '2.898', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.379', 'FRAGCOUNT': '55.000'} [2023-02-25 15:11:11,378][36157] DAMAGECOUNT value on done: 1734190.0 [2023-02-25 15:11:11,378][36157] Sum rewards: 70.351, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.390', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.140', 'AMMO3': '0.142', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.408', 'weapon4': '0.628', 'WEAPON3': '1.000', 'weapon3': '2.556', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '58.000'} [2023-02-25 15:11:11,389][36140] DAMAGECOUNT value on done: 1741810.0 [2023-02-25 15:11:11,389][36140] Sum rewards: 46.354, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.278', 'AMMO5': '0.016', 'AMMO2': '0.060', 'AMMO3': '0.143', 'weapon5': '0.238', 'AMMO4': '0.301', 'weapon2': '0.530', 'WEAPON5': '0.550', 'WEAPON4': '0.750', 'WEAPON3': '0.850', 'weapon4': '1.004', 'weapon3': '1.894', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.185', 'FRAGCOUNT': '41.000'} [2023-02-25 15:11:11,702][36140] DAMAGECOUNT value on done: 1732469.0 [2023-02-25 15:11:11,702][36140] Sum rewards: 61.657, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.716', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.042', 'AMMO3': '0.199', 'AMMO4': '0.210', 'weapon5': '0.264', 'weapon2': '0.314', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.592', 'WEAPON3': '1.250', 'weapon3': '2.500', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.223', 'FRAGCOUNT': '53.000'} [2023-02-25 15:11:11,713][36140] DAMAGECOUNT value on done: 1713428.0 [2023-02-25 15:11:11,714][36140] Sum rewards: 56.150, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.960', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO3': '0.228', 'weapon2': '0.846', 'WEAPON3': '1.450', 'weapon3': '3.018', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.157', 'FRAGCOUNT': '49.000'} [2023-02-25 15:11:14,402][36138] Updated weights for policy 0, policy_version 60083 (0.0009) [2023-02-25 15:11:14,729][36114] Fps is (10 sec: 13107.1, 60 sec: 12629.4, 300 sec: 12551.8). Total num frames: 246104064. Throughput: 0: 3131.6. Samples: 24020356. Policy #0 lag: (min: 0.0, avg: 0.4, max: 2.0) [2023-02-25 15:11:14,730][36114] Avg episode reward: [(0, '59.698')] [2023-02-25 15:11:16,799][36142] DAMAGECOUNT value on done: 1727160.0 [2023-02-25 15:11:16,800][36142] Sum rewards: 53.721, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.120', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.024', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.117', 'weapon4': '0.202', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon2': '0.348', 'WEAPON3': '1.300', 'HITCOUNT': '2.980', 'weapon3': '3.278', 'DAMAGECOUNT': '13.305', 'FRAGCOUNT': '48.000'} [2023-02-25 15:11:16,849][36156] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 15:11:17,107][36142] DAMAGECOUNT value on done: 1715764.0 [2023-02-25 15:11:17,108][36142] Sum rewards: 60.274, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.342', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.124', 'AMMO3': '0.192', 'weapon2': '0.266', 'WEAPON4': '0.300', 'weapon4': '0.710', 'WEAPON3': '1.150', 'weapon3': '2.770', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.943', 'FRAGCOUNT': '52.000'} [2023-02-25 15:11:17,491][36138] Updated weights for policy 0, policy_version 60093 (0.0009) [2023-02-25 15:11:17,628][36142] DAMAGECOUNT value on done: 1726857.0 [2023-02-25 15:11:17,628][36142] Sum rewards: 56.704, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.894', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.041', 'AMMO3': '0.114', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.204', 'weapon4': '0.358', 'weapon2': '0.748', 'WEAPON3': '0.750', 'weapon3': '2.582', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.151', 'FRAGCOUNT': '45.000'} [2023-02-25 15:11:17,940][36142] DAMAGECOUNT value on done: 1735782.0 [2023-02-25 15:11:17,940][36142] Sum rewards: 63.819, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.652', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.060', 'AMMO4': '0.143', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'weapon2': '0.268', 'WEAPON4': '0.450', 'weapon4': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.050', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.621', 'FRAGCOUNT': '55.000'} [2023-02-25 15:11:18,533][36156] DAMAGECOUNT value on done: 1748193.0 [2023-02-25 15:11:18,533][36156] Sum rewards: 65.500, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.390', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.017', 'weapon5': '0.048', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon4': '0.374', 'weapon2': '0.416', 'WEAPON3': '1.200', 'weapon3': '2.968', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.023', 'FRAGCOUNT': '56.000'} [2023-02-25 15:11:18,843][36156] DAMAGECOUNT value on done: 1721877.0 [2023-02-25 15:11:18,843][36156] Sum rewards: 60.390, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.770', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon5': '0.082', 'AMMO3': '0.132', 'AMMO4': '0.254', 'WEAPON5': '0.350', 'weapon4': '0.498', 'WEAPON4': '0.600', 'weapon2': '0.630', 'WEAPON3': '1.000', 'weapon3': '2.564', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.441', 'FRAGCOUNT': '52.000'} [2023-02-25 15:11:19,186][36156] DAMAGECOUNT value on done: 1741683.0 [2023-02-25 15:11:19,186][36156] Sum rewards: 50.814, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.964', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon2': '0.204', 'AMMO3': '0.210', 'AMMO4': '0.218', 'weapon5': '0.234', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.718', 'WEAPON3': '1.250', 'weapon3': '2.502', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.199', 'FRAGCOUNT': '45.000'} [2023-02-25 15:11:19,498][36156] DAMAGECOUNT value on done: 1728346.0 [2023-02-25 15:11:19,499][36156] Sum rewards: 62.970, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.644', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.154', 'AMMO3': '0.189', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.508', 'weapon2': '0.656', 'WEAPON3': '1.100', 'weapon3': '2.450', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '53.000'} [2023-02-25 15:11:19,729][36114] Fps is (10 sec: 13516.7, 60 sec: 12697.6, 300 sec: 12537.9). Total num frames: 246169600. Throughput: 0: 3139.2. Samples: 24040114. Policy #0 lag: (min: 0.0, avg: 0.4, max: 2.0) [2023-02-25 15:11:19,730][36114] Avg episode reward: [(0, '59.590')] [2023-02-25 15:11:19,733][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000060100_246169600.pth... [2023-02-25 15:11:19,796][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000059361_243142656.pth [2023-02-25 15:11:20,292][36139] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 15:11:20,640][36138] Updated weights for policy 0, policy_version 60103 (0.0009) [2023-02-25 15:11:21,395][36155] DAMAGECOUNT value on done: 1726615.0 [2023-02-25 15:11:21,397][36155] Sum rewards: 65.455, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.130', 'AMMO2': '0.000', 'AMMO4': '0.003', 'AMMO3': '0.202', 'weapon2': '0.270', 'WEAPON3': '1.250', 'HITCOUNT': '3.230', 'weapon3': '3.550', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '54.000'} [2023-02-25 15:11:21,453][36139] DAMAGECOUNT value on done: 1731255.0 [2023-02-25 15:11:21,453][36139] Sum rewards: 48.811, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.406', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon5': '0.182', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.360', 'weapon4': '0.456', 'WEAPON3': '1.350', 'weapon3': '2.728', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.611', 'FRAGCOUNT': '44.500'} [2023-02-25 15:11:21,762][36155] DAMAGECOUNT value on done: 1728017.0 [2023-02-25 15:11:21,763][36155] Sum rewards: 52.408, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.884', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon5': '0.114', 'AMMO4': '0.120', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.380', 'ARMOR': '0.454', 'weapon4': '0.528', 'WEAPON3': '1.100', 'weapon3': '2.760', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.845', 'FRAGCOUNT': '45.000'} [2023-02-25 15:11:21,808][36139] DAMAGECOUNT value on done: 1733435.0 [2023-02-25 15:11:21,809][36139] Sum rewards: 63.094, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.094', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.047', 'AMMO3': '0.102', 'weapon2': '0.184', 'AMMO4': '0.235', 'weapon5': '0.238', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.700', 'weapon4': '1.104', 'weapon3': '2.114', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.414', 'FRAGCOUNT': '51.000'} [2023-02-25 15:11:22,009][36139] DAMAGECOUNT value on done: 1740783.0 [2023-02-25 15:11:22,010][36139] Sum rewards: 52.983, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.170', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.104', 'weapon4': '0.148', 'AMMO3': '0.178', 'AMMO4': '0.193', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.830', 'WEAPON3': '1.100', 'weapon3': '2.686', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.256', 'FRAGCOUNT': '47.500'} [2023-02-25 15:11:22,357][36139] DAMAGECOUNT value on done: 1742197.0 [2023-02-25 15:11:22,358][36139] Sum rewards: 57.992, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.674', 'AMMO5': '0.017', 'AMMO2': '0.036', 'AMMO4': '0.180', 'AMMO3': '0.184', 'weapon5': '0.212', 'weapon2': '0.228', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.568', 'WEAPON3': '1.200', 'weapon3': '2.684', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.237', 'FRAGCOUNT': '52.000'} [2023-02-25 15:11:22,761][36155] DAMAGECOUNT value on done: 1745761.0 [2023-02-25 15:11:22,762][36155] Sum rewards: 63.403, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.780', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon5': '0.168', 'AMMO3': '0.180', 'weapon2': '0.222', 'AMMO4': '0.235', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.858', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '54.000'} [2023-02-25 15:11:23,098][36155] DAMAGECOUNT value on done: 1730649.0 [2023-02-25 15:11:23,098][36155] Sum rewards: 65.167, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.685', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.062', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon2': '0.302', 'weapon4': '0.496', 'WEAPON3': '1.100', 'weapon3': '2.644', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '15.936', 'FRAGCOUNT': '54.000'} [2023-02-25 15:11:23,946][36138] Updated weights for policy 0, policy_version 60113 (0.0010) [2023-02-25 15:11:24,008][36154] DAMAGECOUNT value on done: 1734223.0 [2023-02-25 15:11:24,009][36154] Sum rewards: 54.852, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.680', 'AMMO5': '0.016', 'AMMO2': '0.034', 'AMMO3': '0.165', 'AMMO4': '0.170', 'weapon2': '0.250', 'weapon5': '0.278', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'weapon4': '0.916', 'WEAPON3': '1.050', 'weapon3': '2.088', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.544', 'FRAGCOUNT': '48.000'} [2023-02-25 15:11:24,337][36154] DAMAGECOUNT value on done: 1713272.0 [2023-02-25 15:11:24,337][36154] Sum rewards: 58.985, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.730', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.088', 'weapon4': '0.134', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'WEAPON4': '0.200', 'AMMO3': '0.300', 'weapon2': '0.640', 'WEAPON3': '1.700', 'weapon3': '2.860', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.879', 'FRAGCOUNT': '53.500'} [2023-02-25 15:11:24,729][36114] Fps is (10 sec: 12697.7, 60 sec: 12629.4, 300 sec: 12537.9). Total num frames: 246231040. Throughput: 0: 3141.7. Samples: 24049450. Policy #0 lag: (min: 0.0, avg: 0.4, max: 2.0) [2023-02-25 15:11:24,730][36114] Avg episode reward: [(0, '58.791')] [2023-02-25 15:11:24,964][36154] DAMAGECOUNT value on done: 1747217.0 [2023-02-25 15:11:24,964][36154] Sum rewards: 59.536, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.504', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.126', 'AMMO3': '0.252', 'WEAPON4': '0.300', 'weapon2': '0.302', 'weapon4': '0.564', 'WEAPON3': '1.450', 'weapon3': '2.834', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '53.000'} [2023-02-25 15:11:25,284][36154] DAMAGECOUNT value on done: 1727714.0 [2023-02-25 15:11:25,284][36154] Sum rewards: 58.810, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.050', 'AMMO2': '0.011', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'AMMO3': '0.225', 'weapon2': '0.346', 'WEAPON3': '1.350', 'HITCOUNT': '3.150', 'weapon3': '3.450', 'DAMAGECOUNT': '13.671', 'FRAGCOUNT': '52.000'} [2023-02-25 15:11:26,052][36141] DAMAGECOUNT value on done: 1736089.0 [2023-02-25 15:11:26,052][36141] Sum rewards: 59.115, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.901', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon5': '0.172', 'AMMO3': '0.239', 'AMMO4': '0.266', 'weapon2': '0.276', 'WEAPON5': '0.450', 'weapon4': '0.520', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.692', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.188', 'FRAGCOUNT': '53.000'} [2023-02-25 15:11:26,204][36141] DAMAGECOUNT value on done: 1730492.0 [2023-02-25 15:11:26,204][36141] Sum rewards: 60.461, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.950', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.136', 'weapon2': '0.142', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.910', 'WEAPON3': '1.100', 'weapon3': '2.508', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.397', 'FRAGCOUNT': '52.000'} [2023-02-25 15:11:26,403][36141] DAMAGECOUNT value on done: 1743120.0 [2023-02-25 15:11:26,404][36141] Sum rewards: 50.263, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.445', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.117', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.280', 'weapon4': '0.306', 'WEAPON3': '1.250', 'HITCOUNT': '2.730', 'weapon3': '2.914', 'DAMAGECOUNT': '12.555', 'FRAGCOUNT': '45.000'} [2023-02-25 15:11:26,556][36141] DAMAGECOUNT value on done: 1712704.0 [2023-02-25 15:11:26,556][36141] Sum rewards: 62.262, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.928', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.102', 'weapon5': '0.128', 'AMMO3': '0.203', 'weapon4': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.200', 'weapon3': '3.004', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.873', 'FRAGCOUNT': '54.000'} [2023-02-25 15:11:27,246][36138] Updated weights for policy 0, policy_version 60123 (0.0010) [2023-02-25 15:11:29,729][36114] Fps is (10 sec: 12288.0, 60 sec: 12561.0, 300 sec: 12524.0). Total num frames: 246292480. Throughput: 0: 3161.9. Samples: 24068204. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:11:29,730][36114] Avg episode reward: [(0, '58.928')] [2023-02-25 15:11:30,451][36138] Updated weights for policy 0, policy_version 60133 (0.0010) [2023-02-25 15:11:30,960][36157] DAMAGECOUNT value on done: 1749692.0 [2023-02-25 15:11:30,960][36157] Sum rewards: 50.796, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.712', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.100', 'AMMO3': '0.163', 'weapon2': '0.232', 'AMMO4': '0.237', 'WEAPON5': '0.350', 'WEAPON4': '0.650', 'WEAPON3': '0.950', 'weapon4': '1.032', 'weapon3': '2.188', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '13.932', 'FRAGCOUNT': '45.000'} [2023-02-25 15:11:31,297][36157] DAMAGECOUNT value on done: 1732763.0 [2023-02-25 15:11:31,297][36157] Sum rewards: 62.186, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.536', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.172', 'AMMO3': '0.188', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.438', 'weapon4': '0.478', 'WEAPON3': '1.200', 'weapon3': '2.642', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '54.000'} [2023-02-25 15:11:31,940][36157] DAMAGECOUNT value on done: 1756326.0 [2023-02-25 15:11:31,940][36157] Sum rewards: 64.308, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.715', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.028', 'weapon5': '0.074', 'AMMO4': '0.103', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.220', 'AMMO3': '0.222', 'WEAPON3': '1.350', 'HITCOUNT': '3.130', 'weapon3': '3.420', 'DAMAGECOUNT': '15.549', 'FRAGCOUNT': '56.500'} [2023-02-25 15:11:32,267][36157] DAMAGECOUNT value on done: 1739184.0 [2023-02-25 15:11:32,267][36157] Sum rewards: 49.580, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.082', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.146', 'AMMO4': '0.212', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'weapon4': '0.572', 'WEAPON4': '0.600', 'weapon2': '0.664', 'WEAPON3': '1.300', 'weapon3': '2.346', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.547', 'FRAGCOUNT': '47.000'} [2023-02-25 15:11:32,394][36140] DAMAGECOUNT value on done: 1737336.0 [2023-02-25 15:11:32,394][36140] Sum rewards: 60.825, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.340', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.062', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'weapon2': '0.448', 'weapon4': '0.682', 'WEAPON3': '1.450', 'weapon3': '2.334', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.528', 'FRAGCOUNT': '54.000'} [2023-02-25 15:11:32,404][36140] DAMAGECOUNT value on done: 1746880.0 [2023-02-25 15:11:32,405][36140] Sum rewards: 61.623, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.510', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.110', 'AMMO4': '0.160', 'AMMO3': '0.191', 'WEAPON5': '0.250', 'weapon4': '0.280', 'WEAPON4': '0.350', 'weapon2': '0.380', 'WEAPON3': '1.200', 'weapon3': '2.960', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '54.000'} [2023-02-25 15:11:32,516][36157] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('ARMOR', -0.001, -1.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 15:11:32,731][36140] DAMAGECOUNT value on done: 1737375.0 [2023-02-25 15:11:32,731][36140] Sum rewards: 54.907, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.890', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon4': '0.490', 'weapon2': '0.634', 'WEAPON3': '1.300', 'weapon3': '2.550', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.718', 'FRAGCOUNT': '48.000'} [2023-02-25 15:11:32,743][36140] DAMAGECOUNT value on done: 1718677.0 [2023-02-25 15:11:32,744][36140] Sum rewards: 56.841, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.232', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.134', 'AMMO4': '0.154', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON4': '0.350', 'weapon4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.868', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '49.000'} [2023-02-25 15:11:33,665][36138] Updated weights for policy 0, policy_version 60143 (0.0009) [2023-02-25 15:11:34,729][36114] Fps is (10 sec: 12697.5, 60 sec: 12561.1, 300 sec: 12524.0). Total num frames: 246358016. Throughput: 0: 3183.9. Samples: 24087288. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:11:34,730][36114] Avg episode reward: [(0, '58.796')] [2023-02-25 15:11:36,953][36138] Updated weights for policy 0, policy_version 60153 (0.0010) [2023-02-25 15:11:37,987][36142] DAMAGECOUNT value on done: 1731514.0 [2023-02-25 15:11:37,987][36142] Sum rewards: 51.423, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.350', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.094', 'AMMO3': '0.182', 'AMMO4': '0.209', 'WEAPON5': '0.300', 'weapon4': '0.356', 'WEAPON4': '0.400', 'weapon2': '0.676', 'WEAPON3': '1.200', 'weapon3': '2.628', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.062', 'FRAGCOUNT': '47.000'} [2023-02-25 15:11:38,305][36142] DAMAGECOUNT value on done: 1721236.0 [2023-02-25 15:11:38,305][36142] Sum rewards: 71.589, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.903', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO3': '0.132', 'weapon4': '0.366', 'weapon2': '0.504', 'WEAPON3': '0.950', 'weapon3': '2.766', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '57.000'} [2023-02-25 15:11:38,866][36142] DAMAGECOUNT value on done: 1733041.0 [2023-02-25 15:11:38,867][36142] Sum rewards: 75.698, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.630', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.184', 'AMMO3': '0.258', 'weapon2': '0.382', 'WEAPON3': '1.550', 'weapon3': '3.166', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.552', 'FRAGCOUNT': '65.000'} [2023-02-25 15:11:39,191][36142] DAMAGECOUNT value on done: 1741537.0 [2023-02-25 15:11:39,191][36142] Sum rewards: 73.695, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.320', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.021', 'weapon5': '0.096', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.376', 'weapon2': '0.470', 'WEAPON3': '1.150', 'weapon3': '2.880', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '60.000'} [2023-02-25 15:11:39,729][36114] Fps is (10 sec: 12697.7, 60 sec: 12629.4, 300 sec: 12510.2). Total num frames: 246419456. Throughput: 0: 3198.4. Samples: 24096644. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:11:39,730][36114] Avg episode reward: [(0, '59.323')] [2023-02-25 15:11:40,046][36156] DAMAGECOUNT value on done: 1753970.0 [2023-02-25 15:11:40,047][36156] Sum rewards: 69.639, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.925', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO3': '0.140', 'AMMO4': '0.164', 'weapon5': '0.220', 'weapon2': '0.250', 'weapon4': '0.340', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.900', 'weapon3': '2.908', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.331', 'FRAGCOUNT': '57.000'} [2023-02-25 15:11:40,302][36138] Updated weights for policy 0, policy_version 60163 (0.0009) [2023-02-25 15:11:40,389][36156] DAMAGECOUNT value on done: 1727721.0 [2023-02-25 15:11:40,390][36156] Sum rewards: 71.294, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.945', 'AMMO2': '0.027', 'WEAPON4': '0.100', 'AMMO4': '0.135', 'weapon2': '0.170', 'AMMO3': '0.239', 'weapon4': '0.298', 'WEAPON3': '1.500', 'weapon3': '3.378', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '61.000'} [2023-02-25 15:11:40,717][36156] DAMAGECOUNT value on done: 1746818.0 [2023-02-25 15:11:40,718][36156] Sum rewards: 58.221, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.640', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.131', 'AMMO3': '0.234', 'weapon2': '0.282', 'WEAPON4': '0.300', 'weapon4': '0.554', 'WEAPON3': '1.350', 'weapon3': '2.716', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.378', 'FRAGCOUNT': '51.000'} [2023-02-25 15:11:41,056][36156] DAMAGECOUNT value on done: 1733498.0 [2023-02-25 15:11:41,056][36156] Sum rewards: 59.212, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.070', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'weapon4': '0.392', 'weapon2': '0.546', 'WEAPON3': '1.350', 'weapon3': '2.738', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.456', 'FRAGCOUNT': '52.000'} [2023-02-25 15:11:42,814][36139] DAMAGECOUNT value on done: 1736059.0 [2023-02-25 15:11:42,814][36139] Sum rewards: 59.629, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.342', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.012', 'weapon4': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.058', 'AMMO3': '0.163', 'weapon2': '0.610', 'WEAPON3': '1.150', 'HITCOUNT': '3.030', 'weapon3': '3.104', 'DAMAGECOUNT': '14.412', 'FRAGCOUNT': '49.000'} [2023-02-25 15:11:42,898][36155] DAMAGECOUNT value on done: 1731551.0 [2023-02-25 15:11:42,899][36155] Sum rewards: 54.772, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.985', 'AMMO5': '0.014', 'AMMO2': '0.036', 'AMMO4': '0.182', 'AMMO3': '0.190', 'weapon5': '0.192', 'weapon2': '0.206', 'weapon4': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.860', 'weapon3': '3.092', 'DAMAGECOUNT': '14.808', 'FRAGCOUNT': '48.000'} [2023-02-25 15:11:43,154][36139] DAMAGECOUNT value on done: 1738368.0 [2023-02-25 15:11:43,155][36139] Sum rewards: 63.969, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.422', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.029', 'weapon5': '0.090', 'AMMO3': '0.120', 'AMMO4': '0.144', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.382', 'weapon4': '0.722', 'WEAPON3': '0.850', 'weapon3': '2.592', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '14.799', 'FRAGCOUNT': '50.000'} [2023-02-25 15:11:43,250][36155] DAMAGECOUNT value on done: 1733490.0 [2023-02-25 15:11:43,250][36155] Sum rewards: 61.824, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.742', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon5': '0.142', 'AMMO4': '0.171', 'AMMO3': '0.174', 'WEAPON5': '0.300', 'weapon2': '0.424', 'WEAPON4': '0.450', 'weapon4': '0.464', 'WEAPON3': '1.050', 'weapon3': '2.692', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '53.000'} [2023-02-25 15:11:43,337][36139] DAMAGECOUNT value on done: 1746237.0 [2023-02-25 15:11:43,337][36139] Sum rewards: 67.832, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.230', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.044', 'weapon5': '0.048', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.244', 'weapon2': '0.484', 'WEAPON3': '1.350', 'weapon3': '3.194', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.362', 'FRAGCOUNT': '58.000'} [2023-02-25 15:11:43,553][36138] Updated weights for policy 0, policy_version 60173 (0.0010) [2023-02-25 15:11:43,663][36139] DAMAGECOUNT value on done: 1746561.0 [2023-02-25 15:11:43,664][36139] Sum rewards: 58.845, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.232', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.138', 'AMMO3': '0.166', 'AMMO4': '0.197', 'WEAPON5': '0.350', 'weapon2': '0.436', 'WEAPON4': '0.450', 'weapon4': '0.552', 'WEAPON3': '1.150', 'weapon3': '2.562', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.092', 'FRAGCOUNT': '55.000'} [2023-02-25 15:11:44,307][36155] DAMAGECOUNT value on done: 1750375.0 [2023-02-25 15:11:44,308][36155] Sum rewards: 44.001, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.710', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon5': '0.158', 'AMMO4': '0.217', 'AMMO3': '0.219', 'WEAPON5': '0.400', 'weapon4': '0.452', 'weapon2': '0.496', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.612', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.818', 'FRAGCOUNT': '41.000'} [2023-02-25 15:11:44,636][36155] DAMAGECOUNT value on done: 1736076.0 [2023-02-25 15:11:44,636][36155] Sum rewards: 60.860, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.479', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.054', 'AMMO3': '0.127', 'AMMO4': '0.272', 'weapon5': '0.294', 'WEAPON5': '0.550', 'weapon2': '0.590', 'WEAPON4': '0.650', 'WEAPON3': '0.750', 'weapon4': '1.092', 'weapon3': '1.600', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '51.000'} [2023-02-25 15:11:44,729][36114] Fps is (10 sec: 12288.1, 60 sec: 12629.3, 300 sec: 12524.0). Total num frames: 246480896. Throughput: 0: 3177.7. Samples: 24115200. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:11:44,730][36114] Avg episode reward: [(0, '59.617')] [2023-02-25 15:11:45,447][36154] DAMAGECOUNT value on done: 1738719.0 [2023-02-25 15:11:45,448][36154] Sum rewards: 55.000, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.410', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'weapon2': '0.286', 'weapon4': '0.898', 'WEAPON3': '1.100', 'weapon3': '2.348', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '13.488', 'FRAGCOUNT': '47.000'} [2023-02-25 15:11:45,784][36154] DAMAGECOUNT value on done: 1718041.0 [2023-02-25 15:11:45,785][36154] Sum rewards: 49.566, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.108', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.067', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon4': '0.320', 'weapon2': '0.330', 'WEAPON3': '1.450', 'HITCOUNT': '2.930', 'weapon3': '3.044', 'DAMAGECOUNT': '14.307', 'FRAGCOUNT': '44.500'} [2023-02-25 15:11:46,365][36154] DAMAGECOUNT value on done: 1752010.0 [2023-02-25 15:11:46,366][36154] Sum rewards: 59.158, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.284', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.094', 'weapon2': '0.130', 'weapon4': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.252', 'WEAPON3': '1.600', 'HITCOUNT': '3.030', 'weapon3': '3.428', 'DAMAGECOUNT': '14.379', 'FRAGCOUNT': '54.000'} [2023-02-25 15:11:46,724][36154] DAMAGECOUNT value on done: 1733362.0 [2023-02-25 15:11:46,724][36154] Sum rewards: 70.266, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.920', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.116', 'AMMO4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'weapon2': '0.270', 'WEAPON4': '0.300', 'weapon4': '0.556', 'WEAPON3': '1.300', 'weapon3': '2.738', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '61.000'} [2023-02-25 15:11:46,857][36138] Updated weights for policy 0, policy_version 60183 (0.0010) [2023-02-25 15:11:47,540][36154] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 15:11:47,705][36141] DAMAGECOUNT value on done: 1741779.0 [2023-02-25 15:11:47,706][36141] Sum rewards: 60.925, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.495', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.196', 'AMMO3': '0.212', 'AMMO4': '0.226', 'weapon5': '0.242', 'weapon2': '0.430', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.812', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '53.500'} [2023-02-25 15:11:47,856][36141] DAMAGECOUNT value on done: 1735441.0 [2023-02-25 15:11:47,856][36141] Sum rewards: 58.872, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.310', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'weapon4': '0.152', 'AMMO3': '0.228', 'weapon2': '0.346', 'WEAPON3': '1.350', 'HITCOUNT': '2.940', 'weapon3': '3.258', 'DAMAGECOUNT': '14.847', 'FRAGCOUNT': '51.000'} [2023-02-25 15:11:48,039][36141] DAMAGECOUNT value on done: 1748600.0 [2023-02-25 15:11:48,039][36141] Sum rewards: 63.376, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.890', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.142', 'weapon2': '0.152', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.536', 'WEAPON3': '1.200', 'weapon3': '2.816', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '54.000'} [2023-02-25 15:11:48,191][36141] DAMAGECOUNT value on done: 1718169.0 [2023-02-25 15:11:48,191][36141] Sum rewards: 56.060, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-5.197', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.198', 'AMMO3': '0.248', 'weapon2': '0.250', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.542', 'WEAPON3': '1.600', 'weapon3': '2.756', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '51.000'} [2023-02-25 15:11:49,729][36114] Fps is (10 sec: 12697.7, 60 sec: 12697.6, 300 sec: 12565.7). Total num frames: 246546432. Throughput: 0: 3187.0. Samples: 24134238. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:11:49,730][36114] Avg episode reward: [(0, '59.514')] [2023-02-25 15:11:50,006][36138] Updated weights for policy 0, policy_version 60193 (0.0010) [2023-02-25 15:11:52,377][36157] DAMAGECOUNT value on done: 1754714.0 [2023-02-25 15:11:52,378][36157] Sum rewards: 56.574, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.765', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.052', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'weapon2': '0.156', 'AMMO3': '0.194', 'WEAPON4': '0.350', 'weapon4': '0.354', 'WEAPON3': '1.250', 'HITCOUNT': '3.180', 'weapon3': '3.198', 'DAMAGECOUNT': '15.066', 'FRAGCOUNT': '49.500'} [2023-02-25 15:11:52,696][36157] DAMAGECOUNT value on done: 1737851.0 [2023-02-25 15:11:52,697][36157] Sum rewards: 59.048, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.035', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.140', 'AMMO4': '0.158', 'AMMO3': '0.189', 'weapon4': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.150', 'weapon3': '2.948', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '51.000'} [2023-02-25 15:11:53,304][36138] Updated weights for policy 0, policy_version 60203 (0.0010) [2023-02-25 15:11:53,413][36157] DAMAGECOUNT value on done: 1761709.0 [2023-02-25 15:11:53,414][36157] Sum rewards: 65.616, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.041', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.039', 'AMMO3': '0.161', 'AMMO4': '0.195', 'weapon5': '0.214', 'weapon2': '0.228', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.544', 'WEAPON3': '1.150', 'weapon3': '2.760', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '16.149', 'FRAGCOUNT': '55.500'} [2023-02-25 15:11:53,751][36157] DAMAGECOUNT value on done: 1743937.0 [2023-02-25 15:11:53,751][36157] Sum rewards: 50.009, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.992', 'AMMO5': '0.019', 'AMMO2': '0.045', 'AMMO3': '0.158', 'weapon5': '0.166', 'AMMO4': '0.225', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.550', 'weapon2': '0.556', 'WEAPON3': '0.950', 'weapon3': '2.442', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.259', 'FRAGCOUNT': '42.000'} [2023-02-25 15:11:53,871][36140] DAMAGECOUNT value on done: 1742810.0 [2023-02-25 15:11:53,871][36140] Sum rewards: 63.450, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.025', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.096', 'weapon2': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.237', 'weapon4': '0.312', 'WEAPON3': '1.550', 'HITCOUNT': '3.270', 'weapon3': '3.306', 'DAMAGECOUNT': '16.422', 'FRAGCOUNT': '55.000'} [2023-02-25 15:11:53,883][36140] DAMAGECOUNT value on done: 1752160.0 [2023-02-25 15:11:53,884][36140] Sum rewards: 64.231, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.170', 'AMMO5': '0.004', 'weapon5': '0.018', 'AMMO2': '0.044', 'weapon4': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.217', 'AMMO4': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.490', 'WEAPON3': '1.300', 'weapon3': '3.232', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.840', 'FRAGCOUNT': '57.000'} [2023-02-25 15:11:54,224][36140] DAMAGECOUNT value on done: 1743070.0 [2023-02-25 15:11:54,224][36140] Sum rewards: 66.159, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.260', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.114', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon4': '0.232', 'WEAPON4': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.400', 'weapon3': '3.132', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '57.000'} [2023-02-25 15:11:54,236][36140] DAMAGECOUNT value on done: 1724013.0 [2023-02-25 15:11:54,237][36140] Sum rewards: 56.161, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.044', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.120', 'AMMO3': '0.212', 'AMMO4': '0.231', 'WEAPON5': '0.250', 'weapon2': '0.444', 'WEAPON4': '0.550', 'weapon4': '0.766', 'WEAPON3': '1.400', 'weapon3': '2.370', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.008', 'FRAGCOUNT': '51.000'} [2023-02-25 15:11:54,729][36114] Fps is (10 sec: 12697.6, 60 sec: 12697.6, 300 sec: 12579.6). Total num frames: 246607872. Throughput: 0: 3175.9. Samples: 24143626. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:11:54,729][36114] Avg episode reward: [(0, '59.401')] [2023-02-25 15:11:55,781][36154] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 15:11:56,629][36138] Updated weights for policy 0, policy_version 60213 (0.0010) [2023-02-25 15:11:59,292][36142] DAMAGECOUNT value on done: 1735875.0 [2023-02-25 15:11:59,293][36142] Sum rewards: 53.364, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.754', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon5': '0.132', 'weapon2': '0.168', 'AMMO4': '0.181', 'weapon4': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'WEAPON3': '1.400', 'HITCOUNT': '2.620', 'weapon3': '3.262', 'DAMAGECOUNT': '13.083', 'FRAGCOUNT': '49.000'} [2023-02-25 15:11:59,616][36142] DAMAGECOUNT value on done: 1726374.0 [2023-02-25 15:11:59,617][36142] Sum rewards: 57.443, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.934', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.112', 'AMMO3': '0.166', 'weapon5': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.454', 'weapon2': '0.822', 'WEAPON3': '1.100', 'weapon3': '2.198', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '48.000'} [2023-02-25 15:11:59,729][36114] Fps is (10 sec: 12287.9, 60 sec: 12629.3, 300 sec: 12593.5). Total num frames: 246669312. Throughput: 0: 3157.2. Samples: 24162430. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:11:59,730][36114] Avg episode reward: [(0, '59.444')] [2023-02-25 15:11:59,809][36138] Updated weights for policy 0, policy_version 60223 (0.0010) [2023-02-25 15:12:00,281][36142] DAMAGECOUNT value on done: 1738035.0 [2023-02-25 15:12:00,282][36142] Sum rewards: 61.896, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.090', 'AMMO5': '0.017', 'AMMO2': '0.042', 'AMMO3': '0.142', 'AMMO4': '0.207', 'weapon5': '0.224', 'weapon2': '0.262', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.612', 'WEAPON3': '0.850', 'weapon3': '2.538', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.982', 'FRAGCOUNT': '53.500'} [2023-02-25 15:12:00,604][36142] DAMAGECOUNT value on done: 1746204.0 [2023-02-25 15:12:00,605][36142] Sum rewards: 58.004, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.984', 'AMMO5': '0.020', 'AMMO2': '0.045', 'weapon5': '0.128', 'AMMO3': '0.167', 'AMMO4': '0.226', 'weapon2': '0.226', 'WEAPON5': '0.400', 'ARMOR': '0.461', 'WEAPON4': '0.550', 'weapon4': '0.724', 'WEAPON3': '1.050', 'weapon3': '2.680', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.001', 'FRAGCOUNT': '49.000'} [2023-02-25 15:12:01,255][36156] DAMAGECOUNT value on done: 1759320.0 [2023-02-25 15:12:01,255][36156] Sum rewards: 64.960, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.535', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.032', 'weapon5': '0.086', 'weapon2': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.252', 'weapon4': '0.344', 'WEAPON3': '1.450', 'weapon3': '3.230', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '57.000'} [2023-02-25 15:12:01,593][36156] DAMAGECOUNT value on done: 1732743.0 [2023-02-25 15:12:01,594][36156] Sum rewards: 61.844, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.320', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.098', 'AMMO4': '0.101', 'weapon4': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon2': '0.648', 'WEAPON3': '1.050', 'weapon3': '2.962', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.066', 'FRAGCOUNT': '52.000'} [2023-02-25 15:12:01,926][36156] DAMAGECOUNT value on done: 1752242.0 [2023-02-25 15:12:01,926][36156] Sum rewards: 65.537, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.180', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.044', 'weapon5': '0.098', 'AMMO3': '0.138', 'AMMO4': '0.222', 'weapon2': '0.304', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.672', 'WEAPON3': '0.850', 'weapon3': '2.704', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '54.000'} [2023-02-25 15:12:02,242][36156] DAMAGECOUNT value on done: 1738433.0 [2023-02-25 15:12:02,242][36156] Sum rewards: 62.312, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.187', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.018', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.089', 'AMMO3': '0.144', 'weapon4': '0.260', 'WEAPON3': '0.950', 'weapon2': '0.960', 'weapon3': '2.618', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.805', 'FRAGCOUNT': '50.000'} [2023-02-25 15:12:03,008][36138] Updated weights for policy 0, policy_version 60233 (0.0009) [2023-02-25 15:12:03,921][36139] DAMAGECOUNT value on done: 1742617.0 [2023-02-25 15:12:03,921][36139] Sum rewards: 75.857, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.724', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.164', 'AMMO3': '0.180', 'weapon5': '0.232', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.430', 'WEAPON3': '1.100', 'weapon3': '2.584', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.584', 'FRAGCOUNT': '62.000'} [2023-02-25 15:12:04,243][36139] DAMAGECOUNT value on done: 1743229.0 [2023-02-25 15:12:04,244][36139] Sum rewards: 57.944, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.102', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.136', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.181', 'weapon2': '0.334', 'WEAPON4': '0.400', 'weapon4': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.586', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.583', 'FRAGCOUNT': '50.000'} [2023-02-25 15:12:04,275][36155] DAMAGECOUNT value on done: 1737037.0 [2023-02-25 15:12:04,276][36155] Sum rewards: 67.795, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.086', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.090', 'AMMO4': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'weapon4': '0.266', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.120', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '60.500'} [2023-02-25 15:12:04,433][36139] DAMAGECOUNT value on done: 1751638.0 [2023-02-25 15:12:04,433][36139] Sum rewards: 64.482, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.126', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon4': '0.212', 'weapon2': '0.412', 'WEAPON3': '1.200', 'HITCOUNT': '2.860', 'weapon3': '3.054', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '53.000'} [2023-02-25 15:12:04,623][36155] DAMAGECOUNT value on done: 1739247.0 [2023-02-25 15:12:04,623][36155] Sum rewards: 71.889, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.987', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.094', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon4': '0.326', 'weapon2': '0.362', 'WEAPON3': '1.300', 'weapon3': '2.914', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '62.000'} [2023-02-25 15:12:04,729][36114] Fps is (10 sec: 12697.6, 60 sec: 12697.6, 300 sec: 12621.2). Total num frames: 246734848. Throughput: 0: 3143.6. Samples: 24181574. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-25 15:12:04,730][36114] Avg episode reward: [(0, '60.273')] [2023-02-25 15:12:04,752][36139] DAMAGECOUNT value on done: 1752035.0 [2023-02-25 15:12:04,752][36139] Sum rewards: 66.716, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.205', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.160', 'weapon5': '0.182', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.534', 'weapon4': '0.570', 'WEAPON3': '1.050', 'weapon3': '2.444', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.422', 'FRAGCOUNT': '56.000'} [2023-02-25 15:12:05,528][36155] DAMAGECOUNT value on done: 1756246.0 [2023-02-25 15:12:05,528][36155] Sum rewards: 60.934, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.928', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.082', 'weapon4': '0.168', 'AMMO4': '0.171', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.712', 'WEAPON3': '1.350', 'weapon3': '2.786', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '53.000'} [2023-02-25 15:12:05,857][36155] DAMAGECOUNT value on done: 1741123.0 [2023-02-25 15:12:05,857][36155] Sum rewards: 56.508, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.822', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.064', 'AMMO3': '0.204', 'AMMO4': '0.322', 'weapon5': '0.348', 'weapon2': '0.416', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon4': '0.616', 'WEAPON3': '1.250', 'weapon3': '2.148', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.141', 'FRAGCOUNT': '50.000'} [2023-02-25 15:12:06,180][36138] Updated weights for policy 0, policy_version 60243 (0.0009) [2023-02-25 15:12:06,709][36154] DAMAGECOUNT value on done: 1743869.0 [2023-02-25 15:12:06,709][36154] Sum rewards: 56.992, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.272', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon5': '0.124', 'AMMO3': '0.184', 'AMMO4': '0.239', 'weapon4': '0.346', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.830', 'WEAPON3': '1.050', 'weapon3': '2.408', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '49.000'} [2023-02-25 15:12:07,041][36154] DAMAGECOUNT value on done: 1723287.0 [2023-02-25 15:12:07,041][36154] Sum rewards: 62.375, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.872', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon4': '0.128', 'weapon5': '0.148', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.300', 'HITCOUNT': '3.020', 'weapon3': '3.122', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '54.000'} [2023-02-25 15:12:07,623][36154] DAMAGECOUNT value on done: 1757675.0 [2023-02-25 15:12:07,623][36154] Sum rewards: 61.379, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.330', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.046', 'AMMO3': '0.221', 'weapon5': '0.226', 'AMMO4': '0.231', 'weapon2': '0.262', 'weapon4': '0.340', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.798', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '55.000'} [2023-02-25 15:12:07,937][36154] DAMAGECOUNT value on done: 1738680.0 [2023-02-25 15:12:07,937][36154] Sum rewards: 58.435, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.273', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.045', 'AMMO3': '0.193', 'AMMO4': '0.226', 'weapon5': '0.338', 'weapon2': '0.394', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon4': '0.614', 'WEAPON3': '1.100', 'weapon3': '2.254', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.954', 'FRAGCOUNT': '50.000'} [2023-02-25 15:12:08,844][36141] DAMAGECOUNT value on done: 1746852.0 [2023-02-25 15:12:08,845][36141] Sum rewards: 67.020, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.105', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon5': '0.068', 'AMMO4': '0.071', 'weapon4': '0.072', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'weapon2': '0.342', 'WEAPON3': '1.250', 'HITCOUNT': '3.220', 'weapon3': '3.320', 'DAMAGECOUNT': '15.219', 'FRAGCOUNT': '57.500'} [2023-02-25 15:12:08,979][36141] DAMAGECOUNT value on done: 1740950.0 [2023-02-25 15:12:08,980][36141] Sum rewards: 59.267, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.944', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.058', 'weapon5': '0.096', 'AMMO4': '0.100', 'weapon2': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.268', 'WEAPON3': '1.700', 'HITCOUNT': '3.170', 'weapon3': '3.466', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '53.500'} [2023-02-25 15:12:09,175][36141] DAMAGECOUNT value on done: 1753836.0 [2023-02-25 15:12:09,175][36141] Sum rewards: 54.031, reward structure: {'DEATHCOUNT': '-21.750', 'HEALTH': '-3.328', 'AMMO5': '0.024', 'AMMO2': '0.059', 'weapon2': '0.238', 'AMMO3': '0.287', 'AMMO4': '0.293', 'weapon4': '0.340', 'weapon5': '0.376', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.650', 'weapon3': '2.564', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '15.708', 'FRAGCOUNT': '53.500'} [2023-02-25 15:12:09,294][36141] DAMAGECOUNT value on done: 1722582.0 [2023-02-25 15:12:09,294][36141] Sum rewards: 48.523, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.460', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.164', 'AMMO3': '0.201', 'AMMO4': '0.252', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.418', 'weapon4': '0.518', 'WEAPON3': '1.300', 'HITCOUNT': '2.630', 'weapon3': '2.646', 'DAMAGECOUNT': '13.239', 'FRAGCOUNT': '44.000'} [2023-02-25 15:12:09,362][36138] Updated weights for policy 0, policy_version 60253 (0.0010) [2023-02-25 15:12:09,729][36114] Fps is (10 sec: 13107.1, 60 sec: 12765.8, 300 sec: 12621.2). Total num frames: 246800384. Throughput: 0: 3150.8. Samples: 24191236. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-25 15:12:09,730][36114] Avg episode reward: [(0, '60.289')] [2023-02-25 15:12:12,655][36138] Updated weights for policy 0, policy_version 60263 (0.0010) [2023-02-25 15:12:13,756][36157] DAMAGECOUNT value on done: 1759673.0 [2023-02-25 15:12:13,756][36157] Sum rewards: 50.664, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.568', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon2': '0.146', 'AMMO4': '0.173', 'weapon5': '0.228', 'AMMO3': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.474', 'WEAPON3': '1.400', 'HITCOUNT': '2.840', 'weapon3': '2.844', 'DAMAGECOUNT': '14.877', 'FRAGCOUNT': '45.000'} [2023-02-25 15:12:14,076][36157] DAMAGECOUNT value on done: 1743845.0 [2023-02-25 15:12:14,077][36157] Sum rewards: 73.144, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.457', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.029', 'weapon2': '0.142', 'AMMO4': '0.143', 'weapon5': '0.150', 'AMMO3': '0.199', 'weapon4': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.110', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '63.000'} [2023-02-25 15:12:14,729][36114] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 12621.2). Total num frames: 246861824. Throughput: 0: 3151.3. Samples: 24210012. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-25 15:12:14,730][36114] Avg episode reward: [(0, '60.536')] [2023-02-25 15:12:14,758][36157] DAMAGECOUNT value on done: 1766355.0 [2023-02-25 15:12:14,758][36157] Sum rewards: 55.938, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.550', 'AMMO5': '0.022', 'AMMO2': '0.041', 'AMMO3': '0.185', 'AMMO4': '0.204', 'weapon5': '0.252', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.502', 'weapon4': '0.560', 'WEAPON3': '1.200', 'weapon3': '2.384', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.938', 'FRAGCOUNT': '48.000'} [2023-02-25 15:12:15,055][36140] DAMAGECOUNT value on done: 1747631.0 [2023-02-25 15:12:15,055][36140] Sum rewards: 56.533, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.410', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.045', 'AMMO3': '0.111', 'weapon5': '0.182', 'AMMO4': '0.224', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON4': '0.550', 'WEAPON3': '0.800', 'weapon4': '0.902', 'weapon3': '2.356', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.463', 'FRAGCOUNT': '47.000'} [2023-02-25 15:12:15,067][36140] DAMAGECOUNT value on done: 1756652.0 [2023-02-25 15:12:15,067][36140] Sum rewards: 55.215, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.862', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.046', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'weapon4': '0.204', 'weapon2': '0.792', 'WEAPON3': '1.000', 'HITCOUNT': '2.750', 'weapon3': '2.824', 'DAMAGECOUNT': '13.476', 'FRAGCOUNT': '45.000'} [2023-02-25 15:12:15,090][36157] DAMAGECOUNT value on done: 1749894.0 [2023-02-25 15:12:15,090][36157] Sum rewards: 70.488, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.951', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'weapon4': '0.206', 'weapon2': '0.228', 'AMMO3': '0.291', 'WEAPON3': '1.700', 'weapon3': '3.262', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '64.000'} [2023-02-25 15:12:15,395][36140] DAMAGECOUNT value on done: 1747502.0 [2023-02-25 15:12:15,396][36140] Sum rewards: 54.520, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.982', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon2': '0.134', 'AMMO3': '0.164', 'weapon5': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.592', 'WEAPON3': '0.950', 'HITCOUNT': '2.650', 'weapon3': '2.928', 'DAMAGECOUNT': '13.296', 'FRAGCOUNT': '46.000'} [2023-02-25 15:12:15,407][36140] DAMAGECOUNT value on done: 1729024.0 [2023-02-25 15:12:15,407][36140] Sum rewards: 60.933, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.666', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon5': '0.176', 'AMMO3': '0.196', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON4': '0.350', 'weapon4': '0.470', 'WEAPON3': '1.150', 'weapon3': '2.788', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.033', 'FRAGCOUNT': '53.000'} [2023-02-25 15:12:15,939][36138] Updated weights for policy 0, policy_version 60273 (0.0010) [2023-02-25 15:12:19,225][36138] Updated weights for policy 0, policy_version 60283 (0.0009) [2023-02-25 15:12:19,729][36114] Fps is (10 sec: 12288.2, 60 sec: 12561.1, 300 sec: 12635.1). Total num frames: 246923264. Throughput: 0: 3147.4. Samples: 24228922. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-25 15:12:19,730][36114] Avg episode reward: [(0, '60.133')] [2023-02-25 15:12:20,684][36142] DAMAGECOUNT value on done: 1740597.0 [2023-02-25 15:12:20,685][36142] Sum rewards: 53.715, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.327', 'AMMO5': '0.019', 'AMMO2': '0.059', 'AMMO3': '0.199', 'AMMO4': '0.296', 'weapon5': '0.360', 'weapon2': '0.392', 'weapon4': '0.432', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.548', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '14.166', 'FRAGCOUNT': '50.000'} [2023-02-25 15:12:21,010][36142] DAMAGECOUNT value on done: 1731065.0 [2023-02-25 15:12:21,010][36142] Sum rewards: 49.398, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.400', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.051', 'AMMO3': '0.232', 'weapon2': '0.254', 'AMMO4': '0.257', 'weapon5': '0.336', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'weapon4': '0.796', 'WEAPON3': '1.350', 'weapon3': '2.234', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '14.073', 'FRAGCOUNT': '44.000'} [2023-02-25 15:12:21,676][36142] DAMAGECOUNT value on done: 1743094.0 [2023-02-25 15:12:21,676][36142] Sum rewards: 58.701, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.070', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.042', 'weapon5': '0.078', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon2': '0.436', 'WEAPON3': '1.150', 'HITCOUNT': '3.000', 'weapon3': '3.254', 'DAMAGECOUNT': '15.177', 'FRAGCOUNT': '51.000'} [2023-02-25 15:12:21,993][36142] DAMAGECOUNT value on done: 1751819.0 [2023-02-25 15:12:21,993][36142] Sum rewards: 69.096, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.926', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.042', 'AMMO3': '0.114', 'AMMO4': '0.208', 'weapon5': '0.282', 'weapon2': '0.306', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.680', 'WEAPON3': '0.800', 'weapon3': '2.460', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '57.000'} [2023-02-25 15:12:22,447][36138] Updated weights for policy 0, policy_version 60293 (0.0010) [2023-02-25 15:12:22,846][36156] DAMAGECOUNT value on done: 1765067.0 [2023-02-25 15:12:22,847][36156] Sum rewards: 64.215, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.766', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.055', 'AMMO3': '0.196', 'AMMO4': '0.274', 'weapon5': '0.322', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.632', 'weapon4': '0.752', 'WEAPON3': '1.200', 'weapon3': '1.960', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '55.000'} [2023-02-25 15:12:23,247][36156] DAMAGECOUNT value on done: 1738226.0 [2023-02-25 15:12:23,248][36156] Sum rewards: 62.623, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.614', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO3': '0.163', 'AMMO4': '0.183', 'weapon5': '0.210', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.418', 'weapon2': '0.448', 'WEAPON3': '1.000', 'weapon3': '2.644', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '51.000'} [2023-02-25 15:12:23,564][36156] DAMAGECOUNT value on done: 1757604.0 [2023-02-25 15:12:23,564][36156] Sum rewards: 65.663, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.111', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'AMMO3': '0.249', 'weapon2': '0.372', 'WEAPON3': '1.600', 'HITCOUNT': '3.270', 'weapon3': '3.444', 'DAMAGECOUNT': '16.086', 'FRAGCOUNT': '58.000'} [2023-02-25 15:12:23,883][36156] DAMAGECOUNT value on done: 1743401.0 [2023-02-25 15:12:23,884][36156] Sum rewards: 64.690, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.020', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.058', 'weapon5': '0.136', 'AMMO4': '0.168', 'AMMO3': '0.223', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON3': '1.350', 'HITCOUNT': '3.130', 'weapon3': '3.138', 'DAMAGECOUNT': '14.904', 'FRAGCOUNT': '60.000'} [2023-02-25 15:12:24,729][36114] Fps is (10 sec: 12288.1, 60 sec: 12561.1, 300 sec: 12649.0). Total num frames: 246984704. Throughput: 0: 3149.6. Samples: 24238376. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-25 15:12:24,730][36114] Avg episode reward: [(0, '60.324')] [2023-02-25 15:12:25,513][36139] DAMAGECOUNT value on done: 1748776.0 [2023-02-25 15:12:25,513][36139] Sum rewards: 69.498, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.184', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.020', 'weapon5': '0.088', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'weapon2': '0.156', 'WEAPON4': '0.250', 'AMMO3': '0.270', 'weapon4': '0.382', 'WEAPON3': '1.550', 'weapon3': '3.044', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '61.000'} [2023-02-25 15:12:25,539][36155] DAMAGECOUNT value on done: 1741664.0 [2023-02-25 15:12:25,540][36155] Sum rewards: 53.262, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.870', 'AMMO5': '0.016', 'AMMO2': '0.029', 'weapon5': '0.136', 'AMMO4': '0.146', 'AMMO3': '0.171', 'weapon4': '0.212', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.506', 'WEAPON3': '1.200', 'HITCOUNT': '2.840', 'weapon3': '2.944', 'DAMAGECOUNT': '13.881', 'FRAGCOUNT': '47.000'} [2023-02-25 15:12:25,926][36139] DAMAGECOUNT value on done: 1748898.0 [2023-02-25 15:12:25,927][36139] Sum rewards: 67.116, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.684', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon5': '0.132', 'AMMO4': '0.205', 'AMMO3': '0.223', 'weapon2': '0.230', 'WEAPON5': '0.250', 'weapon4': '0.262', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.132', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.007', 'FRAGCOUNT': '58.000'} [2023-02-25 15:12:25,938][36155] DAMAGECOUNT value on done: 1743918.0 [2023-02-25 15:12:25,939][36155] Sum rewards: 56.477, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.360', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon5': '0.060', 'weapon4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.160', 'weapon2': '0.596', 'WEAPON3': '1.000', 'HITCOUNT': '2.880', 'weapon3': '3.012', 'DAMAGECOUNT': '14.013', 'FRAGCOUNT': '47.000'} [2023-02-25 15:12:26,042][36138] Updated weights for policy 0, policy_version 60303 (0.0009) [2023-02-25 15:12:26,206][36139] DAMAGECOUNT value on done: 1756519.0 [2023-02-25 15:12:26,207][36139] Sum rewards: 56.323, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.495', 'AMMO5': '0.013', 'AMMO2': '0.044', 'AMMO3': '0.216', 'AMMO4': '0.220', 'weapon5': '0.286', 'weapon4': '0.310', 'weapon2': '0.324', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.812', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.643', 'FRAGCOUNT': '50.000'} [2023-02-25 15:12:26,652][36139] DAMAGECOUNT value on done: 1757117.0 [2023-02-25 15:12:26,652][36139] Sum rewards: 60.433, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.875', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.112', 'AMMO4': '0.121', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.216', 'AMMO3': '0.246', 'ARMOR': '0.400', 'weapon4': '0.694', 'WEAPON3': '1.450', 'weapon3': '2.692', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.246', 'FRAGCOUNT': '53.000'} [2023-02-25 15:12:27,077][36155] DAMAGECOUNT value on done: 1760681.0 [2023-02-25 15:12:27,077][36155] Sum rewards: 52.301, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.002', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO3': '0.162', 'AMMO4': '0.180', 'weapon5': '0.182', 'WEAPON5': '0.200', 'weapon4': '0.270', 'WEAPON4': '0.400', 'weapon2': '0.436', 'WEAPON3': '1.000', 'HITCOUNT': '2.730', 'weapon3': '2.890', 'DAMAGECOUNT': '13.305', 'FRAGCOUNT': '46.000'} [2023-02-25 15:12:27,494][36155] DAMAGECOUNT value on done: 1745617.0 [2023-02-25 15:12:27,495][36155] Sum rewards: 50.345, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.092', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'weapon4': '0.338', 'weapon2': '0.390', 'WEAPON3': '1.100', 'weapon3': '2.626', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.482', 'FRAGCOUNT': '41.500'} [2023-02-25 15:12:29,024][36154] DAMAGECOUNT value on done: 1748993.0 [2023-02-25 15:12:29,024][36154] Sum rewards: 56.204, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.718', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon5': '0.188', 'AMMO3': '0.223', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.602', 'weapon2': '0.690', 'WEAPON3': '1.300', 'weapon3': '2.172', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.372', 'FRAGCOUNT': '50.000'} [2023-02-25 15:12:29,371][36154] DAMAGECOUNT value on done: 1729193.0 [2023-02-25 15:12:29,371][36154] Sum rewards: 69.252, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.485', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.159', 'weapon5': '0.188', 'weapon2': '0.190', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'weapon4': '0.602', 'WEAPON3': '1.000', 'weapon3': '2.662', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '58.000'} [2023-02-25 15:12:29,729][36114] Fps is (10 sec: 11468.8, 60 sec: 12424.5, 300 sec: 12621.2). Total num frames: 247037952. Throughput: 0: 3096.4. Samples: 24254540. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-25 15:12:29,730][36114] Avg episode reward: [(0, '60.432')] [2023-02-25 15:12:29,885][36138] Updated weights for policy 0, policy_version 60313 (0.0010) [2023-02-25 15:12:30,013][36154] DAMAGECOUNT value on done: 1762722.0 [2023-02-25 15:12:30,014][36154] Sum rewards: 55.705, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.634', 'AMMO5': '0.020', 'AMMO2': '0.039', 'AMMO3': '0.187', 'AMMO4': '0.197', 'weapon5': '0.306', 'weapon2': '0.450', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.278', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '15.141', 'FRAGCOUNT': '49.000'} [2023-02-25 15:12:30,392][36154] DAMAGECOUNT value on done: 1744371.0 [2023-02-25 15:12:30,392][36154] Sum rewards: 65.600, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.456', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.084', 'weapon4': '0.136', 'AMMO4': '0.155', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.356', 'WEAPON3': '1.300', 'weapon3': '3.230', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.073', 'FRAGCOUNT': '55.000'} [2023-02-25 15:12:31,346][36141] DAMAGECOUNT value on done: 1751925.0 [2023-02-25 15:12:31,347][36141] Sum rewards: 64.787, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.090', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.088', 'AMMO4': '0.132', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.338', 'weapon4': '0.570', 'WEAPON3': '1.200', 'weapon3': '2.746', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.219', 'FRAGCOUNT': '56.000'} [2023-02-25 15:12:31,495][36141] DAMAGECOUNT value on done: 1745937.0 [2023-02-25 15:12:31,496][36141] Sum rewards: 55.812, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.684', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.120', 'AMMO3': '0.190', 'weapon4': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.678', 'WEAPON3': '1.200', 'weapon3': '2.782', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.961', 'FRAGCOUNT': '46.500'} [2023-02-25 15:12:31,671][36141] DAMAGECOUNT value on done: 1758626.0 [2023-02-25 15:12:31,671][36141] Sum rewards: 60.202, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.160', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.174', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.228', 'weapon4': '0.348', 'WEAPON3': '1.050', 'HITCOUNT': '2.970', 'weapon3': '3.018', 'DAMAGECOUNT': '14.370', 'FRAGCOUNT': '51.000'} [2023-02-25 15:12:31,859][36141] DAMAGECOUNT value on done: 1727901.0 [2023-02-25 15:12:31,859][36141] Sum rewards: 61.486, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.692', 'AMMO5': '0.022', 'AMMO2': '0.061', 'AMMO3': '0.182', 'weapon5': '0.302', 'AMMO4': '0.303', 'weapon2': '0.310', 'ARMOR': '0.465', 'WEAPON5': '0.600', 'weapon4': '0.736', 'WEAPON4': '0.800', 'WEAPON3': '1.100', 'weapon3': '2.270', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.957', 'FRAGCOUNT': '54.000'} [2023-02-25 15:12:33,368][36138] Updated weights for policy 0, policy_version 60323 (0.0009) [2023-02-25 15:12:34,153][36154] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 15:12:34,729][36114] Fps is (10 sec: 11059.2, 60 sec: 12288.0, 300 sec: 12593.5). Total num frames: 247095296. Throughput: 0: 3066.5. Samples: 24272230. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-25 15:12:34,730][36114] Avg episode reward: [(0, '60.460')] [2023-02-25 15:12:35,198][36140] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 15:12:36,315][36157] DAMAGECOUNT value on done: 1764941.0 [2023-02-25 15:12:36,315][36157] Sum rewards: 63.804, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.502', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.046', 'weapon5': '0.090', 'AMMO4': '0.126', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.366', 'WEAPON3': '1.400', 'HITCOUNT': '3.190', 'weapon3': '3.262', 'DAMAGECOUNT': '15.804', 'FRAGCOUNT': '57.500'} [2023-02-25 15:12:36,638][36157] DAMAGECOUNT value on done: 1748820.0 [2023-02-25 15:12:36,639][36157] Sum rewards: 59.235, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.700', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.044', 'AMMO4': '0.045', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'weapon4': '0.180', 'weapon2': '0.264', 'AMMO3': '0.265', 'WEAPON3': '1.600', 'HITCOUNT': '2.830', 'weapon3': '3.320', 'DAMAGECOUNT': '14.925', 'FRAGCOUNT': '55.000'} [2023-02-25 15:12:36,714][36138] Updated weights for policy 0, policy_version 60333 (0.0009) [2023-02-25 15:12:37,319][36157] DAMAGECOUNT value on done: 1771957.0 [2023-02-25 15:12:37,319][36157] Sum rewards: 66.443, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.210', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.032', 'AMMO4': '0.098', 'weapon4': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon2': '0.252', 'WEAPON3': '1.150', 'HITCOUNT': '3.040', 'weapon3': '3.398', 'DAMAGECOUNT': '16.476', 'FRAGCOUNT': '56.000'} [2023-02-25 15:12:37,432][36140] DAMAGECOUNT value on done: 1753286.0 [2023-02-25 15:12:37,433][36140] Sum rewards: 67.402, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.319', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.104', 'AMMO3': '0.142', 'weapon5': '0.142', 'weapon2': '0.772', 'WEAPON3': '0.950', 'weapon3': '2.820', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '54.000'} [2023-02-25 15:12:37,456][36140] DAMAGECOUNT value on done: 1759775.0 [2023-02-25 15:12:37,456][36140] Sum rewards: 41.215, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.635', 'AMMO2': '0.001', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO4': '0.007', 'weapon4': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.141', 'ARMOR': '0.483', 'weapon2': '0.570', 'WEAPON3': '0.700', 'HITCOUNT': '1.930', 'weapon3': '3.028', 'DAMAGECOUNT': '9.369', 'FRAGCOUNT': '33.000'} [2023-02-25 15:12:37,645][36157] DAMAGECOUNT value on done: 1756038.0 [2023-02-25 15:12:37,645][36157] Sum rewards: 71.854, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.592', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon4': '0.168', 'AMMO3': '0.186', 'weapon2': '0.190', 'weapon5': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.154', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '59.000'} [2023-02-25 15:12:37,772][36140] DAMAGECOUNT value on done: 1752615.0 [2023-02-25 15:12:37,773][36140] Sum rewards: 57.804, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-3.900', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.060', 'weapon5': '0.138', 'AMMO4': '0.173', 'weapon2': '0.242', 'AMMO3': '0.283', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'HITCOUNT': '3.000', 'weapon3': '3.222', 'DAMAGECOUNT': '15.339', 'FRAGCOUNT': '57.000'} [2023-02-25 15:12:37,795][36140] DAMAGECOUNT value on done: 1734031.0 [2023-02-25 15:12:37,795][36140] Sum rewards: 53.753, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-3.084', 'ARMOR': '0.008', 'AMMO5': '0.023', 'AMMO2': '0.079', 'AMMO3': '0.216', 'weapon5': '0.244', 'weapon2': '0.290', 'AMMO4': '0.397', 'WEAPON5': '0.550', 'weapon4': '0.772', 'WEAPON4': '0.900', 'WEAPON3': '1.250', 'weapon3': '2.236', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.021', 'FRAGCOUNT': '52.000'} [2023-02-25 15:12:39,729][36114] Fps is (10 sec: 12288.1, 60 sec: 12356.3, 300 sec: 12607.4). Total num frames: 247160832. Throughput: 0: 3069.7. Samples: 24281764. Policy #0 lag: (min: 0.0, avg: 0.7, max: 1.0) [2023-02-25 15:12:39,729][36114] Avg episode reward: [(0, '60.685')] [2023-02-25 15:12:40,023][36138] Updated weights for policy 0, policy_version 60343 (0.0010) [2023-02-25 15:12:40,807][36156] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 15:12:43,786][36138] Updated weights for policy 0, policy_version 60353 (0.0010) [2023-02-25 15:12:43,952][36142] DAMAGECOUNT value on done: 1746531.0 [2023-02-25 15:12:43,953][36142] Sum rewards: 66.595, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.520', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon5': '0.156', 'weapon4': '0.180', 'AMMO3': '0.208', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.356', 'WEAPON3': '1.350', 'weapon3': '3.020', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '57.000'} [2023-02-25 15:12:44,315][36142] DAMAGECOUNT value on done: 1735837.0 [2023-02-25 15:12:44,315][36142] Sum rewards: 53.840, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.372', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.069', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon5': '0.232', 'weapon4': '0.278', 'weapon2': '0.344', 'WEAPON3': '1.150', 'weapon3': '2.900', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.316', 'FRAGCOUNT': '46.000'} [2023-02-25 15:12:44,729][36114] Fps is (10 sec: 11878.4, 60 sec: 12219.7, 300 sec: 12579.6). Total num frames: 247214080. Throughput: 0: 3032.5. Samples: 24298892. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:12:44,730][36114] Avg episode reward: [(0, '60.665')] [2023-02-25 15:12:44,946][36142] DAMAGECOUNT value on done: 1748523.0 [2023-02-25 15:12:44,947][36142] Sum rewards: 55.885, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.397', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.057', 'AMMO3': '0.172', 'weapon2': '0.228', 'AMMO4': '0.284', 'weapon5': '0.422', 'WEAPON5': '0.600', 'weapon4': '0.622', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.354', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '15.921', 'FRAGCOUNT': '48.000'} [2023-02-25 15:12:45,310][36142] DAMAGECOUNT value on done: 1757727.0 [2023-02-25 15:12:45,310][36142] Sum rewards: 70.156, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.252', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.160', 'AMMO3': '0.216', 'weapon2': '0.216', 'WEAPON3': '1.500', 'weapon3': '3.300', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.724', 'FRAGCOUNT': '60.000'} [2023-02-25 15:12:46,156][36156] DAMAGECOUNT value on done: 1769668.0 [2023-02-25 15:12:46,157][36156] Sum rewards: 56.708, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.600', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.064', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon4': '0.314', 'weapon2': '0.316', 'WEAPON3': '1.300', 'HITCOUNT': '2.870', 'weapon3': '3.136', 'DAMAGECOUNT': '13.803', 'FRAGCOUNT': '51.000'} [2023-02-25 15:12:46,513][36156] DAMAGECOUNT value on done: 1742591.0 [2023-02-25 15:12:46,514][36156] Sum rewards: 53.024, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.217', 'AMMO5': '0.012', 'ARMOR': '0.012', 'weapon5': '0.022', 'AMMO2': '0.039', 'AMMO3': '0.159', 'AMMO4': '0.194', 'WEAPON5': '0.200', 'weapon2': '0.366', 'WEAPON4': '0.550', 'weapon4': '0.858', 'WEAPON3': '1.000', 'weapon3': '2.516', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.074', 'FRAGCOUNT': '47.000'} [2023-02-25 15:12:46,857][36156] DAMAGECOUNT value on done: 1761753.0 [2023-02-25 15:12:46,858][36156] Sum rewards: 45.073, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.500', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon5': '0.150', 'AMMO3': '0.188', 'AMMO4': '0.226', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.560', 'weapon4': '0.752', 'WEAPON3': '1.100', 'weapon3': '2.150', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.447', 'FRAGCOUNT': '40.000'} [2023-02-25 15:12:47,208][36156] DAMAGECOUNT value on done: 1747992.0 [2023-02-25 15:12:47,208][36156] Sum rewards: 46.459, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.322', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.114', 'AMMO4': '0.169', 'AMMO3': '0.244', 'WEAPON5': '0.300', 'weapon2': '0.304', 'weapon4': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.720', 'weapon3': '2.920', 'DAMAGECOUNT': '13.758', 'FRAGCOUNT': '43.500'} [2023-02-25 15:12:47,265][36138] Updated weights for policy 0, policy_version 60363 (0.0010) [2023-02-25 15:12:48,387][36155] DAMAGECOUNT value on done: 1746178.0 [2023-02-25 15:12:48,387][36155] Sum rewards: 45.672, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.010', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.037', 'weapon5': '0.102', 'AMMO4': '0.183', 'weapon2': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.251', 'WEAPON4': '0.400', 'weapon4': '0.810', 'WEAPON3': '1.500', 'weapon3': '2.578', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.542', 'FRAGCOUNT': '44.000'} [2023-02-25 15:12:48,640][36139] DAMAGECOUNT value on done: 1754348.0 [2023-02-25 15:12:48,641][36139] Sum rewards: 65.307, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.332', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon4': '0.134', 'weapon5': '0.148', 'weapon2': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'WEAPON3': '1.400', 'HITCOUNT': '3.060', 'weapon3': '3.242', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '57.000'} [2023-02-25 15:12:48,717][36155] DAMAGECOUNT value on done: 1748598.0 [2023-02-25 15:12:48,718][36155] Sum rewards: 56.944, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.006', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.176', 'AMMO4': '0.182', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.292', 'weapon2': '0.608', 'WEAPON3': '1.150', 'weapon3': '2.584', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '14.040', 'FRAGCOUNT': '49.000'} [2023-02-25 15:12:48,961][36139] DAMAGECOUNT value on done: 1754267.0 [2023-02-25 15:12:48,961][36139] Sum rewards: 52.218, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.490', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.046', 'AMMO4': '0.093', 'WEAPON5': '0.150', 'weapon4': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.300', 'weapon2': '0.562', 'WEAPON3': '1.850', 'weapon3': '2.956', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '49.000'} [2023-02-25 15:12:49,228][36139] DAMAGECOUNT value on done: 1761032.0 [2023-02-25 15:12:49,228][36139] Sum rewards: 49.696, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.777', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.110', 'AMMO4': '0.163', 'weapon5': '0.192', 'AMMO3': '0.225', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.386', 'WEAPON3': '1.350', 'HITCOUNT': '2.790', 'weapon3': '2.966', 'DAMAGECOUNT': '13.539', 'FRAGCOUNT': '45.000'} [2023-02-25 15:12:49,544][36139] DAMAGECOUNT value on done: 1763633.0 [2023-02-25 15:12:49,544][36139] Sum rewards: 75.703, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.870', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.164', 'AMMO4': '0.180', 'weapon2': '0.192', 'AMMO3': '0.232', 'weapon4': '0.242', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.134', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.080', 'FRAGCOUNT': '67.000'} [2023-02-25 15:12:49,665][36155] DAMAGECOUNT value on done: 1765771.0 [2023-02-25 15:12:49,666][36155] Sum rewards: 59.864, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.291', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.068', 'weapon4': '0.088', 'AMMO4': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'weapon2': '0.406', 'WEAPON3': '1.400', 'HITCOUNT': '2.840', 'weapon3': '3.170', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '53.000'} [2023-02-25 15:12:49,729][36114] Fps is (10 sec: 11468.8, 60 sec: 12151.5, 300 sec: 12579.6). Total num frames: 247275520. Throughput: 0: 3009.8. Samples: 24317014. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:12:49,729][36114] Avg episode reward: [(0, '59.783')] [2023-02-25 15:12:49,964][36155] DAMAGECOUNT value on done: 1750898.0 [2023-02-25 15:12:49,964][36155] Sum rewards: 59.636, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.968', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO3': '0.148', 'weapon2': '0.200', 'AMMO4': '0.203', 'weapon5': '0.284', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.606', 'WEAPON3': '0.850', 'weapon3': '2.570', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.843', 'FRAGCOUNT': '50.000'} [2023-02-25 15:12:50,457][36138] Updated weights for policy 0, policy_version 60373 (0.0010) [2023-02-25 15:12:51,845][36154] DAMAGECOUNT value on done: 1753300.0 [2023-02-25 15:12:51,846][36154] Sum rewards: 51.520, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.415', 'AMMO5': '0.008', 'AMMO2': '0.050', 'weapon5': '0.124', 'AMMO3': '0.182', 'AMMO4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.348', 'WEAPON4': '0.400', 'weapon4': '0.554', 'WEAPON3': '1.100', 'weapon3': '2.698', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '12.921', 'FRAGCOUNT': '47.000'} [2023-02-25 15:12:52,494][36154] DAMAGECOUNT value on done: 1734347.0 [2023-02-25 15:12:52,495][36154] Sum rewards: 59.016, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.631', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'weapon2': '0.344', 'weapon4': '0.566', 'WEAPON3': '1.100', 'weapon3': '2.828', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.462', 'FRAGCOUNT': '49.000'} [2023-02-25 15:12:53,382][36154] DAMAGECOUNT value on done: 1767865.0 [2023-02-25 15:12:53,382][36154] Sum rewards: 55.980, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.776', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.146', 'AMMO3': '0.228', 'weapon4': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.810', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.429', 'FRAGCOUNT': '50.000'} [2023-02-25 15:12:53,766][36154] DAMAGECOUNT value on done: 1750082.0 [2023-02-25 15:12:53,767][36154] Sum rewards: 67.632, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.674', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'weapon5': '0.092', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.222', 'weapon4': '0.242', 'AMMO3': '0.259', 'WEAPON3': '1.600', 'weapon3': '3.180', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '61.000'} [2023-02-25 15:12:54,471][36141] DAMAGECOUNT value on done: 1756503.0 [2023-02-25 15:12:54,472][36141] Sum rewards: 52.442, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.294', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.070', 'weapon4': '0.096', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.342', 'WEAPON3': '1.300', 'HITCOUNT': '2.890', 'weapon3': '3.262', 'DAMAGECOUNT': '13.734', 'FRAGCOUNT': '47.000'} [2023-02-25 15:12:54,575][36138] Updated weights for policy 0, policy_version 60383 (0.0011) [2023-02-25 15:12:54,650][36141] DAMAGECOUNT value on done: 1750686.0 [2023-02-25 15:12:54,651][36141] Sum rewards: 50.163, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.196', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.148', 'weapon5': '0.174', 'AMMO3': '0.177', 'AMMO4': '0.181', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.418', 'WEAPON3': '1.150', 'HITCOUNT': '2.890', 'weapon3': '2.974', 'DAMAGECOUNT': '14.247', 'FRAGCOUNT': '44.500'} [2023-02-25 15:12:54,729][36114] Fps is (10 sec: 11468.9, 60 sec: 12014.9, 300 sec: 12537.9). Total num frames: 247328768. Throughput: 0: 2971.7. Samples: 24324962. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:12:54,730][36114] Avg episode reward: [(0, '59.768')] [2023-02-25 15:12:54,806][36141] DAMAGECOUNT value on done: 1764445.0 [2023-02-25 15:12:54,807][36141] Sum rewards: 70.079, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.530', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.102', 'AMMO4': '0.118', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon4': '0.260', 'weapon2': '0.376', 'WEAPON3': '1.400', 'weapon3': '3.038', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '60.000'} [2023-02-25 15:12:55,000][36141] DAMAGECOUNT value on done: 1733772.0 [2023-02-25 15:12:55,000][36141] Sum rewards: 72.083, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.060', 'AMMO5': '0.003', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.110', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.201', 'weapon2': '0.362', 'WEAPON3': '1.300', 'weapon3': '3.256', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '60.000'} [2023-02-25 15:12:57,975][36138] Updated weights for policy 0, policy_version 60393 (0.0010) [2023-02-25 15:12:59,376][36157] DAMAGECOUNT value on done: 1770401.0 [2023-02-25 15:12:59,376][36157] Sum rewards: 70.926, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.059', 'weapon4': '0.116', 'AMMO3': '0.142', 'ARMOR': '0.400', 'weapon2': '0.476', 'HEALTH': '0.715', 'WEAPON3': '0.800', 'HITCOUNT': '3.250', 'weapon3': '3.276', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '55.000'} [2023-02-25 15:12:59,680][36157] DAMAGECOUNT value on done: 1754133.0 [2023-02-25 15:12:59,681][36157] Sum rewards: 56.897, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.992', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.054', 'AMMO3': '0.141', 'weapon5': '0.192', 'AMMO4': '0.272', 'weapon4': '0.360', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.742', 'WEAPON3': '0.900', 'weapon3': '2.416', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.939', 'FRAGCOUNT': '47.000'} [2023-02-25 15:12:59,729][36114] Fps is (10 sec: 11468.7, 60 sec: 12014.9, 300 sec: 12524.0). Total num frames: 247390208. Throughput: 0: 2937.7. Samples: 24342210. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:12:59,730][36114] Avg episode reward: [(0, '59.976')] [2023-02-25 15:13:00,335][36157] DAMAGECOUNT value on done: 1777012.0 [2023-02-25 15:13:00,336][36157] Sum rewards: 57.995, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.160', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.176', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'AMMO4': '0.240', 'WEAPON4': '0.300', 'weapon2': '0.372', 'weapon4': '0.896', 'WEAPON3': '1.200', 'weapon3': '2.262', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.165', 'FRAGCOUNT': '50.000'} [2023-02-25 15:13:00,639][36157] DAMAGECOUNT value on done: 1761801.0 [2023-02-25 15:13:00,640][36157] Sum rewards: 75.770, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO2': '0.005', 'AMMO4': '0.024', 'WEAPON4': '0.100', 'AMMO3': '0.140', 'HEALTH': '0.192', 'weapon2': '0.734', 'WEAPON3': '0.800', 'weapon3': '3.136', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '61.000'} [2023-02-25 15:13:00,705][36140] DAMAGECOUNT value on done: 1758111.0 [2023-02-25 15:13:00,705][36140] Sum rewards: 53.225, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.438', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.120', 'AMMO4': '0.123', 'weapon2': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.284', 'weapon4': '0.338', 'WEAPON3': '1.750', 'weapon3': '3.012', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.475', 'FRAGCOUNT': '50.000'} [2023-02-25 15:13:00,750][36139] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2023-02-25 15:13:00,762][36140] DAMAGECOUNT value on done: 1764766.0 [2023-02-25 15:13:00,763][36140] Sum rewards: 57.821, reward structure: {'DEATHCOUNT': '-13.500', 'ARMOR': '0.012', 'AMMO5': '0.020', 'AMMO2': '0.058', 'AMMO3': '0.111', 'HEALTH': '0.142', 'AMMO4': '0.292', 'weapon2': '0.364', 'weapon5': '0.436', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.586', 'WEAPON3': '0.650', 'weapon3': '2.196', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.973', 'FRAGCOUNT': '47.500'} [2023-02-25 15:13:01,025][36140] DAMAGECOUNT value on done: 1757623.0 [2023-02-25 15:13:01,025][36140] Sum rewards: 57.753, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.323', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'weapon2': '0.202', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'weapon4': '0.318', 'WEAPON3': '1.500', 'HITCOUNT': '3.160', 'weapon3': '3.258', 'DAMAGECOUNT': '15.024', 'FRAGCOUNT': '51.000'} [2023-02-25 15:13:01,077][36140] DAMAGECOUNT value on done: 1739962.0 [2023-02-25 15:13:01,078][36140] Sum rewards: 69.556, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.659', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.112', 'AMMO4': '0.179', 'AMMO3': '0.184', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.382', 'weapon4': '0.382', 'WEAPON3': '1.150', 'weapon3': '2.884', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '58.000'} [2023-02-25 15:13:01,208][36138] Updated weights for policy 0, policy_version 60403 (0.0009) [2023-02-25 15:13:04,355][36138] Updated weights for policy 0, policy_version 60413 (0.0009) [2023-02-25 15:13:04,729][36114] Fps is (10 sec: 12697.6, 60 sec: 12014.9, 300 sec: 12524.0). Total num frames: 247455744. Throughput: 0: 2947.9. Samples: 24361578. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:13:04,729][36114] Avg episode reward: [(0, '60.190')] [2023-02-25 15:13:06,299][36142] DAMAGECOUNT value on done: 1751822.0 [2023-02-25 15:13:06,299][36142] Sum rewards: 67.737, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.017', 'weapon5': '0.062', 'weapon4': '0.070', 'AMMO4': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'HEALTH': '0.223', 'weapon2': '0.524', 'WEAPON3': '0.950', 'weapon3': '3.162', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.873', 'FRAGCOUNT': '55.000'} [2023-02-25 15:13:06,639][36142] DAMAGECOUNT value on done: 1740196.0 [2023-02-25 15:13:06,639][36142] Sum rewards: 50.814, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.170', 'AMMO5': '0.012', 'AMMO2': '0.018', 'weapon4': '0.034', 'AMMO4': '0.091', 'weapon5': '0.098', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.740', 'weapon3': '3.404', 'DAMAGECOUNT': '13.077', 'FRAGCOUNT': '44.000'} [2023-02-25 15:13:07,235][36142] DAMAGECOUNT value on done: 1753735.0 [2023-02-25 15:13:07,236][36142] Sum rewards: 52.283, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.554', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.035', 'AMMO4': '0.173', 'weapon5': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'weapon2': '0.276', 'WEAPON4': '0.400', 'weapon4': '0.530', 'WEAPON3': '1.400', 'weapon3': '2.684', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '47.000'} [2023-02-25 15:13:07,543][36142] DAMAGECOUNT value on done: 1763054.0 [2023-02-25 15:13:07,543][36142] Sum rewards: 56.832, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.082', 'AMMO5': '0.017', 'AMMO2': '0.069', 'AMMO3': '0.129', 'AMMO4': '0.344', 'weapon5': '0.376', 'WEAPON5': '0.550', 'weapon4': '0.684', 'WEAPON4': '0.700', 'WEAPON3': '0.700', 'weapon2': '0.744', 'weapon3': '1.854', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '15.936', 'FRAGCOUNT': '48.000'} [2023-02-25 15:13:07,749][36138] Updated weights for policy 0, policy_version 60423 (0.0010) [2023-02-25 15:13:08,577][36156] DAMAGECOUNT value on done: 1773795.0 [2023-02-25 15:13:08,577][36156] Sum rewards: 52.677, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.360', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.108', 'AMMO3': '0.146', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.656', 'weapon4': '0.888', 'WEAPON3': '0.900', 'weapon3': '2.144', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '12.381', 'FRAGCOUNT': '45.000'} [2023-02-25 15:13:08,905][36156] DAMAGECOUNT value on done: 1747891.0 [2023-02-25 15:13:08,905][36156] Sum rewards: 60.664, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.343', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.090', 'weapon4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.210', 'AMMO3': '0.252', 'WEAPON3': '1.450', 'HITCOUNT': '3.240', 'weapon3': '3.370', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '53.000'} [2023-02-25 15:13:09,212][36156] DAMAGECOUNT value on done: 1767202.0 [2023-02-25 15:13:09,212][36156] Sum rewards: 62.231, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.805', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.037', 'AMMO4': '0.183', 'weapon5': '0.190', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.360', 'weapon4': '0.496', 'WEAPON3': '1.300', 'weapon3': '2.664', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '54.000'} [2023-02-25 15:13:09,518][36156] DAMAGECOUNT value on done: 1753085.0 [2023-02-25 15:13:09,519][36156] Sum rewards: 58.737, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.006', 'AMMO5': '0.012', 'AMMO2': '0.043', 'AMMO3': '0.183', 'weapon5': '0.206', 'AMMO4': '0.213', 'WEAPON5': '0.350', 'weapon4': '0.368', 'WEAPON4': '0.400', 'weapon2': '0.670', 'WEAPON3': '1.100', 'weapon3': '2.494', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '50.000'} [2023-02-25 15:13:09,729][36114] Fps is (10 sec: 12697.6, 60 sec: 11946.7, 300 sec: 12510.2). Total num frames: 247517184. Throughput: 0: 2939.9. Samples: 24370670. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:13:09,730][36114] Avg episode reward: [(0, '60.003')] [2023-02-25 15:13:10,691][36155] DAMAGECOUNT value on done: 1751156.0 [2023-02-25 15:13:10,691][36155] Sum rewards: 60.874, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.665', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.014', 'AMMO4': '0.029', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.235', 'weapon2': '0.650', 'WEAPON3': '1.450', 'HITCOUNT': '3.090', 'weapon3': '3.124', 'DAMAGECOUNT': '14.934', 'FRAGCOUNT': '54.000'} [2023-02-25 15:13:10,725][36139] DAMAGECOUNT value on done: 1759498.0 [2023-02-25 15:13:10,726][36139] Sum rewards: 51.600, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.810', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.146', 'AMMO4': '0.149', 'AMMO3': '0.292', 'WEAPON5': '0.300', 'weapon2': '0.424', 'WEAPON4': '0.500', 'weapon4': '0.518', 'WEAPON3': '1.750', 'weapon3': '2.584', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '49.000'} [2023-02-25 15:13:10,931][36138] Updated weights for policy 0, policy_version 60433 (0.0009) [2023-02-25 15:13:10,998][36155] DAMAGECOUNT value on done: 1753596.0 [2023-02-25 15:13:10,999][36155] Sum rewards: 57.276, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.040', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon5': '0.114', 'AMMO3': '0.175', 'weapon2': '0.220', 'AMMO4': '0.226', 'weapon4': '0.436', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.954', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '51.000'} [2023-02-25 15:13:11,046][36139] DAMAGECOUNT value on done: 1759596.0 [2023-02-25 15:13:11,046][36139] Sum rewards: 55.423, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.542', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon5': '0.158', 'AMMO4': '0.177', 'weapon2': '0.206', 'AMMO3': '0.224', 'WEAPON5': '0.400', 'weapon4': '0.408', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.930', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '48.000'} [2023-02-25 15:13:11,372][36139] DAMAGECOUNT value on done: 1766023.0 [2023-02-25 15:13:11,373][36139] Sum rewards: 55.883, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.602', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.048', 'weapon5': '0.110', 'AMMO4': '0.120', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON3': '1.500', 'HITCOUNT': '2.900', 'weapon3': '3.324', 'DAMAGECOUNT': '14.943', 'FRAGCOUNT': '51.000'} [2023-02-25 15:13:11,694][36139] DAMAGECOUNT value on done: 1769619.0 [2023-02-25 15:13:11,694][36139] Sum rewards: 69.505, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.834', 'AMMO5': '0.015', 'AMMO2': '0.048', 'AMMO3': '0.150', 'weapon5': '0.190', 'weapon2': '0.214', 'AMMO4': '0.242', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.688', 'WEAPON3': '0.900', 'weapon3': '2.598', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '56.500'} [2023-02-25 15:13:11,987][36155] DAMAGECOUNT value on done: 1770666.0 [2023-02-25 15:13:11,988][36155] Sum rewards: 45.335, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-1.410', 'ARMOR': '0.004', 'AMMO5': '0.026', 'AMMO2': '0.079', 'AMMO3': '0.230', 'weapon5': '0.238', 'weapon2': '0.362', 'AMMO4': '0.396', 'WEAPON5': '0.550', 'WEAPON4': '0.700', 'weapon4': '0.892', 'WEAPON3': '1.250', 'weapon3': '2.092', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '14.385', 'FRAGCOUNT': '44.000'} [2023-02-25 15:13:12,337][36155] DAMAGECOUNT value on done: 1757020.0 [2023-02-25 15:13:12,338][36155] Sum rewards: 71.485, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.708', 'AMMO5': '0.014', 'AMMO2': '0.043', 'AMMO3': '0.180', 'AMMO4': '0.215', 'weapon5': '0.220', 'weapon4': '0.302', 'WEAPON5': '0.400', 'weapon2': '0.476', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.676', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.366', 'FRAGCOUNT': '62.000'} [2023-02-25 15:13:13,764][36154] DAMAGECOUNT value on done: 1759162.0 [2023-02-25 15:13:13,764][36154] Sum rewards: 69.512, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.010', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'weapon2': '0.322', 'weapon4': '0.420', 'WEAPON3': '1.300', 'weapon3': '3.076', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.586', 'FRAGCOUNT': '58.000'} [2023-02-25 15:13:14,074][36154] DAMAGECOUNT value on done: 1737902.0 [2023-02-25 15:13:14,074][36154] Sum rewards: 45.349, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.158', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.114', 'weapon2': '0.126', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.432', 'weapon4': '0.640', 'WEAPON3': '1.050', 'HITCOUNT': '2.280', 'weapon3': '2.942', 'DAMAGECOUNT': '10.665', 'FRAGCOUNT': '39.000'} [2023-02-25 15:13:14,135][36138] Updated weights for policy 0, policy_version 60443 (0.0009) [2023-02-25 15:13:14,690][36154] DAMAGECOUNT value on done: 1773363.0 [2023-02-25 15:13:14,691][36154] Sum rewards: 69.275, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.985', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.052', 'AMMO3': '0.108', 'weapon5': '0.230', 'AMMO4': '0.260', 'weapon2': '0.340', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.424', 'WEAPON3': '0.750', 'weapon3': '2.778', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '56.000'} [2023-02-25 15:13:14,729][36114] Fps is (10 sec: 12697.5, 60 sec: 12014.9, 300 sec: 12510.2). Total num frames: 247582720. Throughput: 0: 3006.5. Samples: 24389832. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:13:14,730][36114] Avg episode reward: [(0, '59.315')] [2023-02-25 15:13:14,993][36154] DAMAGECOUNT value on done: 1755570.0 [2023-02-25 15:13:14,994][36154] Sum rewards: 66.139, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.644', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon4': '0.130', 'weapon5': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.444', 'WEAPON3': '1.300', 'weapon3': '3.020', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '58.500'} [2023-02-25 15:13:15,630][36141] DAMAGECOUNT value on done: 1761485.0 [2023-02-25 15:13:15,631][36141] Sum rewards: 61.370, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.160', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon2': '0.170', 'weapon5': '0.180', 'AMMO4': '0.189', 'AMMO3': '0.207', 'WEAPON5': '0.400', 'weapon4': '0.418', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.950', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.946', 'FRAGCOUNT': '54.000'} [2023-02-25 15:13:15,775][36141] DAMAGECOUNT value on done: 1755379.0 [2023-02-25 15:13:15,776][36141] Sum rewards: 58.312, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.523', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon5': '0.066', 'AMMO4': '0.107', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.432', 'weapon4': '0.478', 'WEAPON3': '1.150', 'weapon3': '2.744', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.079', 'FRAGCOUNT': '50.000'} [2023-02-25 15:13:15,959][36141] DAMAGECOUNT value on done: 1769752.0 [2023-02-25 15:13:15,959][36141] Sum rewards: 52.839, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.340', 'AMMO5': '0.020', 'AMMO2': '0.080', 'AMMO3': '0.173', 'weapon2': '0.252', 'weapon5': '0.326', 'AMMO4': '0.398', 'WEAPON5': '0.550', 'weapon4': '0.712', 'WEAPON4': '0.800', 'WEAPON3': '1.100', 'weapon3': '2.292', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.915', 'FRAGCOUNT': '47.000'} [2023-02-25 15:13:16,092][36141] DAMAGECOUNT value on done: 1739552.0 [2023-02-25 15:13:16,093][36141] Sum rewards: 65.291, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.608', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.060', 'weapon2': '0.180', 'AMMO3': '0.230', 'WEAPON3': '1.400', 'HITCOUNT': '3.260', 'weapon3': '3.532', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '55.000'} [2023-02-25 15:13:17,200][36138] Updated weights for policy 0, policy_version 60453 (0.0009) [2023-02-25 15:13:19,729][36114] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 12468.5). Total num frames: 247635968. Throughput: 0: 3010.6. Samples: 24407706. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 15:13:19,730][36114] Avg episode reward: [(0, '59.398')] [2023-02-25 15:13:19,733][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000060458_247635968.pth... [2023-02-25 15:13:19,828][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000059733_244666368.pth [2023-02-25 15:13:21,861][36138] Updated weights for policy 0, policy_version 60463 (0.0010) [2023-02-25 15:13:21,893][36157] DAMAGECOUNT value on done: 1775514.0 [2023-02-25 15:13:21,894][36157] Sum rewards: 52.632, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.612', 'AMMO5': '0.012', 'AMMO2': '0.060', 'weapon5': '0.230', 'AMMO3': '0.272', 'AMMO4': '0.298', 'weapon2': '0.362', 'weapon4': '0.390', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.650', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.339', 'FRAGCOUNT': '50.000'} [2023-02-25 15:13:22,340][36157] DAMAGECOUNT value on done: 1758989.0 [2023-02-25 15:13:22,341][36157] Sum rewards: 57.788, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.538', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.050', 'AMMO3': '0.192', 'weapon5': '0.218', 'weapon2': '0.244', 'AMMO4': '0.249', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'weapon4': '0.730', 'WEAPON3': '1.000', 'weapon3': '2.502', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.568', 'FRAGCOUNT': '52.000'} [2023-02-25 15:13:23,241][36157] DAMAGECOUNT value on done: 1781401.0 [2023-02-25 15:13:23,241][36157] Sum rewards: 47.719, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.010', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO3': '0.153', 'AMMO4': '0.193', 'weapon5': '0.230', 'weapon2': '0.330', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '0.900', 'weapon4': '1.010', 'weapon3': '2.140', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '13.167', 'FRAGCOUNT': '40.000'} [2023-02-25 15:13:23,583][36140] DAMAGECOUNT value on done: 1763470.0 [2023-02-25 15:13:23,583][36140] Sum rewards: 50.659, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.424', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.138', 'WEAPON5': '0.200', 'weapon2': '0.250', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'weapon4': '0.308', 'WEAPON3': '1.450', 'HITCOUNT': '2.930', 'weapon3': '3.022', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '45.000'} [2023-02-25 15:13:23,617][36157] DAMAGECOUNT value on done: 1767142.0 [2023-02-25 15:13:23,618][36157] Sum rewards: 60.830, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.575', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.116', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.245', 'weapon4': '0.378', 'weapon2': '0.452', 'WEAPON3': '1.550', 'weapon3': '2.836', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.023', 'FRAGCOUNT': '54.000'} [2023-02-25 15:13:23,665][36140] DAMAGECOUNT value on done: 1770152.0 [2023-02-25 15:13:23,665][36140] Sum rewards: 60.575, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.610', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.181', 'weapon2': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.241', 'weapon4': '0.482', 'WEAPON3': '1.300', 'weapon3': '3.094', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.594', 'FRAGCOUNT': '52.000'} [2023-02-25 15:13:23,985][36140] DAMAGECOUNT value on done: 1763089.0 [2023-02-25 15:13:23,986][36140] Sum rewards: 60.342, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.487', 'AMMO5': '0.005', 'weapon5': '0.024', 'weapon4': '0.028', 'AMMO2': '0.029', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'AMMO3': '0.216', 'weapon2': '0.354', 'WEAPON3': '1.350', 'HITCOUNT': '3.160', 'weapon3': '3.422', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '51.000'} [2023-02-25 15:13:24,062][36140] DAMAGECOUNT value on done: 1745308.0 [2023-02-25 15:13:24,063][36140] Sum rewards: 61.452, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.412', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.108', 'AMMO4': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.310', 'weapon4': '0.342', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '2.990', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '54.000'} [2023-02-25 15:13:24,729][36114] Fps is (10 sec: 9830.4, 60 sec: 11605.3, 300 sec: 12413.0). Total num frames: 247681024. Throughput: 0: 2940.8. Samples: 24414098. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 15:13:24,729][36114] Avg episode reward: [(0, '59.267')] [2023-02-25 15:13:25,587][36157] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2023-02-25 15:13:26,276][36138] Updated weights for policy 0, policy_version 60473 (0.0011) [2023-02-25 15:13:26,905][36157] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.588, 196.0), ('weapon5', 0.002)] [2023-02-25 15:13:29,729][36114] Fps is (10 sec: 9830.4, 60 sec: 11605.3, 300 sec: 12371.5). Total num frames: 247734272. Throughput: 0: 2892.4. Samples: 24429050. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 15:13:29,730][36114] Avg episode reward: [(0, '59.267')] [2023-02-25 15:13:29,998][36138] Updated weights for policy 0, policy_version 60483 (0.0010) [2023-02-25 15:13:30,299][36142] DAMAGECOUNT value on done: 1757158.0 [2023-02-25 15:13:30,299][36142] Sum rewards: 58.610, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.810', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.032', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.186', 'weapon2': '0.508', 'WEAPON3': '1.250', 'weapon3': '3.260', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.008', 'FRAGCOUNT': '47.500'} [2023-02-25 15:13:30,618][36142] DAMAGECOUNT value on done: 1745232.0 [2023-02-25 15:13:30,619][36142] Sum rewards: 56.356, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.630', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.158', 'AMMO3': '0.164', 'weapon4': '0.166', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon5': '0.418', 'weapon2': '0.806', 'WEAPON3': '0.950', 'weapon3': '2.316', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '15.108', 'FRAGCOUNT': '46.000'} [2023-02-25 15:13:31,291][36142] DAMAGECOUNT value on done: 1758145.0 [2023-02-25 15:13:31,291][36142] Sum rewards: 48.466, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.680', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon2': '0.166', 'weapon5': '0.196', 'AMMO3': '0.273', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.458', 'WEAPON3': '1.550', 'HITCOUNT': '2.830', 'weapon3': '2.844', 'DAMAGECOUNT': '13.230', 'FRAGCOUNT': '46.000'} [2023-02-25 15:13:31,708][36142] DAMAGECOUNT value on done: 1768249.0 [2023-02-25 15:13:31,708][36142] Sum rewards: 59.758, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.545', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.050', 'weapon5': '0.064', 'AMMO4': '0.124', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.518', 'WEAPON3': '1.150', 'weapon3': '3.204', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '51.000'} [2023-02-25 15:13:32,765][36156] DAMAGECOUNT value on done: 1778952.0 [2023-02-25 15:13:32,766][36156] Sum rewards: 58.526, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.930', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.090', 'AMMO4': '0.129', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'weapon2': '0.326', 'weapon4': '0.498', 'WEAPON3': '1.400', 'weapon3': '2.784', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.471', 'FRAGCOUNT': '51.000'} [2023-02-25 15:13:33,127][36156] DAMAGECOUNT value on done: 1752515.0 [2023-02-25 15:13:33,127][36156] Sum rewards: 47.840, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.712', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.040', 'AMMO4': '0.198', 'weapon5': '0.230', 'AMMO3': '0.252', 'weapon2': '0.446', 'WEAPON5': '0.450', 'weapon4': '0.540', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.424', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.872', 'FRAGCOUNT': '47.000'} [2023-02-25 15:13:33,401][36138] Updated weights for policy 0, policy_version 60493 (0.0010) [2023-02-25 15:13:33,458][36156] DAMAGECOUNT value on done: 1771824.0 [2023-02-25 15:13:33,458][36156] Sum rewards: 51.200, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.365', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon2': '0.124', 'weapon5': '0.130', 'AMMO3': '0.188', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.902', 'WEAPON3': '1.100', 'weapon3': '2.428', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '13.866', 'FRAGCOUNT': '44.000'} [2023-02-25 15:13:33,797][36156] DAMAGECOUNT value on done: 1758580.0 [2023-02-25 15:13:33,798][36156] Sum rewards: 58.471, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.054', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon5': '0.130', 'AMMO4': '0.176', 'AMMO3': '0.190', 'weapon2': '0.316', 'weapon4': '0.338', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.924', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '51.000'} [2023-02-25 15:13:34,709][36155] DAMAGECOUNT value on done: 1756695.0 [2023-02-25 15:13:34,710][36155] Sum rewards: 67.589, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.534', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.064', 'weapon4': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'AMMO3': '0.194', 'weapon2': '0.850', 'WEAPON3': '1.250', 'weapon3': '2.842', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.617', 'FRAGCOUNT': '57.000'} [2023-02-25 15:13:34,729][36114] Fps is (10 sec: 11468.6, 60 sec: 11673.6, 300 sec: 12357.4). Total num frames: 247795712. Throughput: 0: 2880.1. Samples: 24446620. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 15:13:34,730][36114] Avg episode reward: [(0, '58.972')] [2023-02-25 15:13:35,063][36155] DAMAGECOUNT value on done: 1758308.0 [2023-02-25 15:13:35,063][36155] Sum rewards: 53.027, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.332', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.104', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.236', 'WEAPON4': '0.350', 'weapon4': '0.412', 'ARMOR': '0.455', 'WEAPON3': '1.450', 'HITCOUNT': '2.930', 'weapon3': '2.984', 'DAMAGECOUNT': '14.136', 'FRAGCOUNT': '47.000'} [2023-02-25 15:13:35,126][36139] DAMAGECOUNT value on done: 1764535.0 [2023-02-25 15:13:35,127][36139] Sum rewards: 57.760, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.560', 'AMMO5': '0.010', 'AMMO2': '0.041', 'AMMO3': '0.137', 'AMMO4': '0.205', 'weapon5': '0.218', 'WEAPON5': '0.250', 'ARMOR': '0.404', 'WEAPON4': '0.450', 'weapon4': '0.516', 'weapon2': '0.628', 'WEAPON3': '0.900', 'weapon3': '2.340', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '15.111', 'FRAGCOUNT': '48.000'} [2023-02-25 15:13:35,464][36139] DAMAGECOUNT value on done: 1765049.0 [2023-02-25 15:13:35,465][36139] Sum rewards: 64.381, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.072', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.160', 'weapon5': '0.160', 'weapon2': '0.230', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.588', 'WEAPON3': '0.950', 'weapon3': '2.614', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '53.500'} [2023-02-25 15:13:35,529][36157] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 15:13:35,836][36139] DAMAGECOUNT value on done: 1771842.0 [2023-02-25 15:13:35,837][36139] Sum rewards: 62.851, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.442', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon5': '0.186', 'AMMO3': '0.208', 'AMMO4': '0.244', 'weapon2': '0.380', 'weapon4': '0.422', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.686', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '55.000'} [2023-02-25 15:13:36,129][36155] DAMAGECOUNT value on done: 1776030.0 [2023-02-25 15:13:36,129][36155] Sum rewards: 63.493, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.720', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.090', 'AMMO4': '0.107', 'weapon4': '0.116', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.490', 'WEAPON3': '1.000', 'HITCOUNT': '3.100', 'weapon3': '3.128', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '51.000'} [2023-02-25 15:13:36,256][36139] DAMAGECOUNT value on done: 1774344.0 [2023-02-25 15:13:36,256][36139] Sum rewards: 50.840, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.720', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.055', 'AMMO3': '0.218', 'weapon2': '0.272', 'AMMO4': '0.277', 'weapon5': '0.280', 'weapon4': '0.492', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.560', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.175', 'FRAGCOUNT': '47.000'} [2023-02-25 15:13:36,510][36155] DAMAGECOUNT value on done: 1762741.0 [2023-02-25 15:13:36,511][36155] Sum rewards: 67.625, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.325', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.193', 'weapon2': '0.396', 'WEAPON3': '1.300', 'weapon3': '3.466', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.163', 'FRAGCOUNT': '55.000'} [2023-02-25 15:13:36,928][36138] Updated weights for policy 0, policy_version 60503 (0.0009) [2023-02-25 15:13:38,815][36154] DAMAGECOUNT value on done: 1764289.0 [2023-02-25 15:13:38,816][36154] Sum rewards: 57.693, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.590', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.014', 'weapon5': '0.018', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.238', 'weapon2': '0.486', 'WEAPON3': '1.400', 'HITCOUNT': '3.160', 'weapon3': '3.308', 'DAMAGECOUNT': '15.381', 'FRAGCOUNT': '50.000'} [2023-02-25 15:13:39,172][36154] DAMAGECOUNT value on done: 1743450.0 [2023-02-25 15:13:39,173][36154] Sum rewards: 63.658, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.288', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.044', 'AMMO4': '0.218', 'weapon2': '0.246', 'weapon4': '0.252', 'AMMO3': '0.263', 'weapon5': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '2.854', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '58.000'} [2023-02-25 15:13:39,731][36114] Fps is (10 sec: 11466.6, 60 sec: 11468.4, 300 sec: 12315.7). Total num frames: 247848960. Throughput: 0: 2887.3. Samples: 24454896. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 15:13:39,731][36114] Avg episode reward: [(0, '58.824')] [2023-02-25 15:13:39,973][36154] DAMAGECOUNT value on done: 1778437.0 [2023-02-25 15:13:39,973][36154] Sum rewards: 54.453, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.569', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.154', 'AMMO4': '0.162', 'AMMO3': '0.184', 'weapon2': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.848', 'WEAPON3': '1.150', 'weapon3': '2.494', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.222', 'FRAGCOUNT': '46.000'} [2023-02-25 15:13:40,312][36154] DAMAGECOUNT value on done: 1760815.0 [2023-02-25 15:13:40,312][36154] Sum rewards: 57.252, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.664', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.058', 'AMMO3': '0.255', 'weapon2': '0.644', 'WEAPON3': '1.450', 'weapon3': '3.012', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.735', 'FRAGCOUNT': '49.000'} [2023-02-25 15:13:40,608][36138] Updated weights for policy 0, policy_version 60513 (0.0012) [2023-02-25 15:13:40,841][36141] DAMAGECOUNT value on done: 1766604.0 [2023-02-25 15:13:40,841][36141] Sum rewards: 62.968, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.440', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.056', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon4': '0.220', 'weapon2': '0.394', 'WEAPON3': '1.200', 'weapon3': '3.108', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.357', 'FRAGCOUNT': '53.000'} [2023-02-25 15:13:40,994][36141] DAMAGECOUNT value on done: 1760836.0 [2023-02-25 15:13:40,994][36141] Sum rewards: 65.368, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.150', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'AMMO3': '0.145', 'WEAPON5': '0.150', 'weapon5': '0.214', 'weapon4': '0.258', 'weapon2': '0.606', 'WEAPON3': '0.950', 'weapon3': '2.708', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.371', 'FRAGCOUNT': '52.000'} [2023-02-25 15:13:41,195][36141] DAMAGECOUNT value on done: 1774558.0 [2023-02-25 15:13:41,196][36141] Sum rewards: 51.602, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.112', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon5': '0.154', 'AMMO3': '0.203', 'AMMO4': '0.251', 'weapon4': '0.274', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.518', 'WEAPON3': '1.150', 'weapon3': '2.754', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.418', 'FRAGCOUNT': '46.500'} [2023-02-25 15:13:41,336][36141] DAMAGECOUNT value on done: 1744230.0 [2023-02-25 15:13:41,336][36141] Sum rewards: 54.456, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.255', 'AMMO5': '0.013', 'AMMO2': '0.036', 'AMMO3': '0.158', 'AMMO4': '0.181', 'weapon5': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.578', 'weapon4': '0.618', 'WEAPON3': '0.900', 'weapon3': '2.278', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '14.034', 'FRAGCOUNT': '45.000'} [2023-02-25 15:13:43,602][36156] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200.0), ('weapon7', 0.002)] [2023-02-25 15:13:43,926][36138] Updated weights for policy 0, policy_version 60523 (0.0010) [2023-02-25 15:13:44,729][36114] Fps is (10 sec: 11469.0, 60 sec: 11605.3, 300 sec: 12301.9). Total num frames: 247910400. Throughput: 0: 2895.0. Samples: 24472486. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 15:13:44,730][36114] Avg episode reward: [(0, '58.791')] [2023-02-25 15:13:46,105][36157] DAMAGECOUNT value on done: 1780864.0 [2023-02-25 15:13:46,105][36157] Sum rewards: 66.852, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.040', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.031', 'AMMO3': '0.144', 'AMMO4': '0.154', 'weapon5': '0.156', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.630', 'weapon2': '0.692', 'WEAPON3': '0.800', 'weapon3': '2.214', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '54.000'} [2023-02-25 15:13:46,441][36157] DAMAGECOUNT value on done: 1764287.0 [2023-02-25 15:13:46,442][36157] Sum rewards: 66.645, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.218', 'ARMOR': '0.008', 'AMMO5': '0.023', 'AMMO2': '0.041', 'weapon2': '0.200', 'AMMO4': '0.206', 'AMMO3': '0.216', 'weapon5': '0.282', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'weapon4': '0.962', 'WEAPON3': '1.300', 'weapon3': '2.040', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.894', 'FRAGCOUNT': '60.000'} [2023-02-25 15:13:47,120][36157] DAMAGECOUNT value on done: 1787584.0 [2023-02-25 15:13:47,121][36157] Sum rewards: 67.140, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.948', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.201', 'weapon5': '0.246', 'weapon2': '0.280', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.754', 'WEAPON3': '1.150', 'weapon3': '2.406', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.474', 'FRAGCOUNT': '56.000'} [2023-02-25 15:13:47,161][36140] DAMAGECOUNT value on done: 1768098.0 [2023-02-25 15:13:47,161][36140] Sum rewards: 52.989, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.076', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.162', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.302', 'weapon2': '0.516', 'WEAPON3': '1.050', 'weapon3': '2.766', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.869', 'FRAGCOUNT': '45.000'} [2023-02-25 15:13:47,239][36140] DAMAGECOUNT value on done: 1775055.0 [2023-02-25 15:13:47,239][36140] Sum rewards: 55.958, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.778', 'AMMO5': '0.007', 'AMMO2': '0.033', 'AMMO4': '0.164', 'weapon5': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'weapon2': '0.530', 'weapon4': '0.572', 'WEAPON3': '1.300', 'weapon3': '2.496', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.709', 'FRAGCOUNT': '49.000'} [2023-02-25 15:13:47,269][36138] Updated weights for policy 0, policy_version 60533 (0.0009) [2023-02-25 15:13:47,453][36157] DAMAGECOUNT value on done: 1771719.0 [2023-02-25 15:13:47,453][36157] Sum rewards: 55.063, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.400', 'ARMOR': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.104', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.334', 'weapon4': '0.480', 'WEAPON3': '1.150', 'weapon3': '2.792', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.731', 'FRAGCOUNT': '48.000'} [2023-02-25 15:13:47,531][36140] DAMAGECOUNT value on done: 1768066.0 [2023-02-25 15:13:47,531][36140] Sum rewards: 53.331, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.994', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.060', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'weapon2': '0.234', 'AMMO3': '0.248', 'WEAPON4': '0.400', 'weapon4': '0.424', 'WEAPON3': '1.450', 'weapon3': '3.022', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.931', 'FRAGCOUNT': '49.000'} [2023-02-25 15:13:47,608][36140] DAMAGECOUNT value on done: 1750135.0 [2023-02-25 15:13:47,608][36140] Sum rewards: 59.143, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.190', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon5': '0.098', 'AMMO4': '0.157', 'AMMO3': '0.229', 'weapon2': '0.240', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.892', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.481', 'FRAGCOUNT': '53.000'} [2023-02-25 15:13:49,729][36114] Fps is (10 sec: 11880.6, 60 sec: 11537.0, 300 sec: 12274.1). Total num frames: 247967744. Throughput: 0: 2859.1. Samples: 24490238. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 15:13:49,730][36114] Avg episode reward: [(0, '58.571')] [2023-02-25 15:13:51,184][36138] Updated weights for policy 0, policy_version 60543 (0.0010) [2023-02-25 15:13:53,547][36142] DAMAGECOUNT value on done: 1762092.0 [2023-02-25 15:13:53,548][36142] Sum rewards: 60.081, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.869', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.042', 'weapon4': '0.062', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'weapon2': '0.522', 'WEAPON3': '0.950', 'HITCOUNT': '2.860', 'weapon3': '3.242', 'DAMAGECOUNT': '14.742', 'FRAGCOUNT': '50.000'} [2023-02-25 15:13:53,923][36142] DAMAGECOUNT value on done: 1749875.0 [2023-02-25 15:13:53,924][36142] Sum rewards: 58.815, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.132', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'AMMO3': '0.158', 'weapon2': '0.484', 'weapon4': '0.594', 'WEAPON3': '1.050', 'weapon3': '2.766', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '13.929', 'FRAGCOUNT': '48.000'} [2023-02-25 15:13:54,714][36142] DAMAGECOUNT value on done: 1763675.0 [2023-02-25 15:13:54,715][36142] Sum rewards: 62.732, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.800', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO3': '0.176', 'weapon5': '0.194', 'AMMO4': '0.207', 'weapon2': '0.288', 'WEAPON5': '0.300', 'ARMOR': '0.455', 'WEAPON4': '0.500', 'weapon4': '0.606', 'WEAPON3': '1.050', 'weapon3': '2.582', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '51.000'} [2023-02-25 15:13:54,729][36114] Fps is (10 sec: 11059.1, 60 sec: 11537.0, 300 sec: 12246.3). Total num frames: 248020992. Throughput: 0: 2828.5. Samples: 24497954. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 15:13:54,730][36114] Avg episode reward: [(0, '58.678')] [2023-02-25 15:13:54,820][36138] Updated weights for policy 0, policy_version 60553 (0.0010) [2023-02-25 15:13:55,134][36142] DAMAGECOUNT value on done: 1774496.0 [2023-02-25 15:13:55,135][36142] Sum rewards: 70.114, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.346', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.064', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'weapon4': '0.158', 'WEAPON4': '0.250', 'AMMO3': '0.276', 'weapon2': '0.326', 'WEAPON3': '1.700', 'weapon3': '3.164', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.741', 'FRAGCOUNT': '62.000'} [2023-02-25 15:13:56,094][36156] DAMAGECOUNT value on done: 1783745.0 [2023-02-25 15:13:56,095][36156] Sum rewards: 53.251, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.632', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.054', 'AMMO3': '0.160', 'weapon5': '0.190', 'WEAPON5': '0.250', 'AMMO4': '0.268', 'weapon4': '0.510', 'WEAPON4': '0.600', 'weapon2': '0.826', 'WEAPON3': '0.900', 'weapon3': '2.240', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.379', 'FRAGCOUNT': '45.000'} [2023-02-25 15:13:56,457][36156] DAMAGECOUNT value on done: 1757477.0 [2023-02-25 15:13:56,458][36156] Sum rewards: 56.883, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.815', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.054', 'weapon5': '0.132', 'AMMO3': '0.173', 'weapon2': '0.260', 'AMMO4': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.482', 'WEAPON3': '1.050', 'weapon3': '2.790', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.886', 'FRAGCOUNT': '49.000'} [2023-02-25 15:13:56,759][36156] DAMAGECOUNT value on done: 1773339.0 [2023-02-25 15:13:56,760][36156] Sum rewards: 20.748, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'HEALTH': '0.011', 'AMMO3': '0.066', 'weapon7': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'HITCOUNT': '0.740', 'weapon3': '1.348', 'weapon2': '1.896', 'DAMAGECOUNT': '4.545', 'FRAGCOUNT': '15.000'} [2023-02-25 15:13:57,092][36156] DAMAGECOUNT value on done: 1763300.0 [2023-02-25 15:13:57,092][36156] Sum rewards: 60.276, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.504', 'AMMO5': '0.007', 'weapon5': '0.024', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.320', 'weapon2': '0.344', 'WEAPON3': '0.850', 'HITCOUNT': '2.950', 'weapon3': '3.164', 'DAMAGECOUNT': '14.160', 'FRAGCOUNT': '49.500'} [2023-02-25 15:13:58,264][36155] DAMAGECOUNT value on done: 1760716.0 [2023-02-25 15:13:58,265][36155] Sum rewards: 45.554, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.031', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'AMMO4': '0.169', 'WEAPON4': '0.300', 'weapon2': '0.390', 'weapon4': '0.530', 'WEAPON3': '0.900', 'HITCOUNT': '2.590', 'weapon3': '2.638', 'DAMAGECOUNT': '12.063', 'FRAGCOUNT': '39.000'} [2023-02-25 15:13:58,380][36138] Updated weights for policy 0, policy_version 60563 (0.0010) [2023-02-25 15:13:58,652][36139] DAMAGECOUNT value on done: 1770057.0 [2023-02-25 15:13:58,653][36139] Sum rewards: 64.569, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.338', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.180', 'weapon5': '0.198', 'weapon2': '0.228', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.456', 'WEAPON3': '1.050', 'weapon3': '2.850', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '54.000'} [2023-02-25 15:13:58,667][36155] DAMAGECOUNT value on done: 1763449.0 [2023-02-25 15:13:58,667][36155] Sum rewards: 54.822, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.593', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.118', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon2': '0.224', 'weapon4': '0.370', 'WEAPON3': '1.050', 'HITCOUNT': '2.910', 'weapon3': '2.920', 'DAMAGECOUNT': '15.423', 'FRAGCOUNT': '44.000'} [2023-02-25 15:13:59,042][36139] DAMAGECOUNT value on done: 1770743.0 [2023-02-25 15:13:59,043][36139] Sum rewards: 71.446, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.500', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.088', 'weapon4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon2': '0.566', 'WEAPON3': '1.250', 'weapon3': '2.968', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '59.000'} [2023-02-25 15:13:59,443][36139] DAMAGECOUNT value on done: 1776784.0 [2023-02-25 15:13:59,445][36139] Sum rewards: 58.418, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.977', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.048', 'AMMO4': '0.136', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.320', 'weapon4': '0.658', 'WEAPON3': '0.950', 'weapon3': '2.528', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.826', 'FRAGCOUNT': '48.000'} [2023-02-25 15:13:59,710][36155] DAMAGECOUNT value on done: 1780921.0 [2023-02-25 15:13:59,711][36155] Sum rewards: 52.004, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.486', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.124', 'weapon4': '0.172', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.386', 'WEAPON3': '1.250', 'HITCOUNT': '2.970', 'weapon3': '3.052', 'DAMAGECOUNT': '14.673', 'FRAGCOUNT': '45.000'} [2023-02-25 15:13:59,729][36114] Fps is (10 sec: 11059.2, 60 sec: 11468.8, 300 sec: 12218.6). Total num frames: 248078336. Throughput: 0: 2786.0. Samples: 24515204. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 15:13:59,730][36114] Avg episode reward: [(0, '58.634')] [2023-02-25 15:13:59,849][36139] DAMAGECOUNT value on done: 1778956.0 [2023-02-25 15:13:59,850][36139] Sum rewards: 51.178, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.306', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.046', 'AMMO3': '0.148', 'AMMO4': '0.228', 'weapon5': '0.356', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.548', 'weapon4': '0.748', 'WEAPON3': '0.900', 'weapon3': '2.010', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.836', 'FRAGCOUNT': '44.000'} [2023-02-25 15:14:00,087][36155] DAMAGECOUNT value on done: 1768038.0 [2023-02-25 15:14:00,088][36155] Sum rewards: 59.378, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.642', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon5': '0.160', 'AMMO3': '0.228', 'weapon4': '0.268', 'AMMO4': '0.273', 'WEAPON5': '0.350', 'weapon2': '0.388', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.800', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.891', 'FRAGCOUNT': '53.000'} [2023-02-25 15:14:02,452][36138] Updated weights for policy 0, policy_version 60573 (0.0010) [2023-02-25 15:14:02,680][36154] DAMAGECOUNT value on done: 1769491.0 [2023-02-25 15:14:02,681][36154] Sum rewards: 60.566, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.497', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.122', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.454', 'weapon2': '0.508', 'WEAPON3': '1.100', 'weapon3': '2.698', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '51.500'} [2023-02-25 15:14:03,112][36154] DAMAGECOUNT value on done: 1748641.0 [2023-02-25 15:14:03,112][36154] Sum rewards: 64.002, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.151', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon5': '0.126', 'weapon4': '0.126', 'WEAPON4': '0.200', 'AMMO4': '0.204', 'AMMO3': '0.208', 'WEAPON5': '0.350', 'weapon2': '0.384', 'WEAPON3': '1.250', 'weapon3': '3.046', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.573', 'FRAGCOUNT': '55.000'} [2023-02-25 15:14:03,828][36154] DAMAGECOUNT value on done: 1783844.0 [2023-02-25 15:14:03,829][36154] Sum rewards: 66.064, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.233', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.151', 'AMMO3': '0.165', 'weapon5': '0.194', 'weapon4': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.050', 'weapon3': '2.938', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.930', 'FRAGCOUNT': '55.000'} [2023-02-25 15:14:04,174][36154] DAMAGECOUNT value on done: 1766093.0 [2023-02-25 15:14:04,175][36154] Sum rewards: 63.552, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.708', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon2': '0.186', 'AMMO3': '0.275', 'WEAPON3': '1.500', 'HITCOUNT': '3.300', 'weapon3': '3.630', 'DAMAGECOUNT': '15.834', 'FRAGCOUNT': '56.000'} [2023-02-25 15:14:04,643][36141] DAMAGECOUNT value on done: 1771530.0 [2023-02-25 15:14:04,644][36141] Sum rewards: 57.333, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.702', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.052', 'AMMO3': '0.158', 'weapon5': '0.178', 'AMMO4': '0.261', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.464', 'weapon4': '0.652', 'WEAPON3': '1.000', 'weapon3': '2.418', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.733', 'FRAGCOUNT': '48.000'} [2023-02-25 15:14:04,729][36114] Fps is (10 sec: 11059.4, 60 sec: 11264.0, 300 sec: 12176.9). Total num frames: 248131584. Throughput: 0: 2737.3. Samples: 24530882. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 15:14:04,729][36114] Avg episode reward: [(0, '58.799')] [2023-02-25 15:14:04,775][36141] DAMAGECOUNT value on done: 1765759.0 [2023-02-25 15:14:04,775][36141] Sum rewards: 54.011, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.099', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.263', 'weapon2': '0.298', 'weapon4': '0.386', 'WEAPON3': '1.650', 'weapon3': '2.976', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.769', 'FRAGCOUNT': '49.000'} [2023-02-25 15:14:04,983][36141] DAMAGECOUNT value on done: 1779200.0 [2023-02-25 15:14:04,984][36141] Sum rewards: 58.350, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.996', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.040', 'AMMO3': '0.144', 'weapon5': '0.188', 'AMMO4': '0.201', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON4': '0.450', 'WEAPON3': '0.850', 'weapon4': '1.314', 'weapon3': '1.940', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '13.920', 'FRAGCOUNT': '48.000'} [2023-02-25 15:14:05,113][36141] DAMAGECOUNT value on done: 1748832.0 [2023-02-25 15:14:05,113][36141] Sum rewards: 53.899, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.345', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.030', 'AMMO4': '0.101', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.442', 'weapon2': '0.642', 'WEAPON3': '0.900', 'weapon3': '2.648', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '13.806', 'FRAGCOUNT': '44.000'} [2023-02-25 15:14:05,906][36138] Updated weights for policy 0, policy_version 60583 (0.0010) [2023-02-25 15:14:09,375][36138] Updated weights for policy 0, policy_version 60593 (0.0010) [2023-02-25 15:14:09,729][36114] Fps is (10 sec: 11059.2, 60 sec: 11195.7, 300 sec: 12163.0). Total num frames: 248188928. Throughput: 0: 2804.6. Samples: 24540306. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 15:14:09,730][36114] Avg episode reward: [(0, '58.636')] [2023-02-25 15:14:10,280][36157] DAMAGECOUNT value on done: 1784670.0 [2023-02-25 15:14:10,280][36157] Sum rewards: 41.452, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.694', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.044', 'AMMO3': '0.140', 'weapon5': '0.200', 'AMMO4': '0.218', 'WEAPON5': '0.250', 'weapon4': '0.310', 'WEAPON4': '0.400', 'weapon2': '0.872', 'WEAPON3': '0.900', 'weapon3': '2.344', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '11.418', 'FRAGCOUNT': '37.000'} [2023-02-25 15:14:10,684][36157] DAMAGECOUNT value on done: 1769282.0 [2023-02-25 15:14:10,686][36157] Sum rewards: 59.275, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.370', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.092', 'AMMO3': '0.134', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.538', 'weapon4': '0.654', 'WEAPON3': '0.850', 'weapon3': '2.390', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.985', 'FRAGCOUNT': '47.000'} [2023-02-25 15:14:11,496][36157] DAMAGECOUNT value on done: 1791746.0 [2023-02-25 15:14:11,496][36157] Sum rewards: 45.611, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.907', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.106', 'AMMO3': '0.142', 'AMMO4': '0.193', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON4': '0.350', 'weapon4': '0.510', 'WEAPON3': '0.800', 'weapon3': '2.628', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.486', 'FRAGCOUNT': '38.000'} [2023-02-25 15:14:11,582][36140] DAMAGECOUNT value on done: 1773280.0 [2023-02-25 15:14:11,582][36140] Sum rewards: 60.090, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.174', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.214', 'weapon4': '0.324', 'weapon2': '0.564', 'WEAPON3': '1.300', 'weapon3': '2.594', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.546', 'FRAGCOUNT': '51.500'} [2023-02-25 15:14:11,673][36140] DAMAGECOUNT value on done: 1779545.0 [2023-02-25 15:14:11,673][36140] Sum rewards: 54.467, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.092', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'AMMO5': '0.030', 'AMMO2': '0.058', 'AMMO3': '0.082', 'AMMO4': '0.291', 'weapon2': '0.454', 'weapon5': '0.524', 'WEAPON3': '0.550', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'weapon4': '1.198', 'weapon3': '1.494', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.470', 'FRAGCOUNT': '45.000'} [2023-02-25 15:14:11,987][36157] DAMAGECOUNT value on done: 1777074.0 [2023-02-25 15:14:11,987][36157] Sum rewards: 63.898, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.146', 'AMMO5': '0.008', 'AMMO2': '0.034', 'AMMO3': '0.115', 'AMMO4': '0.168', 'weapon5': '0.194', 'weapon4': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.750', 'weapon2': '0.900', 'weapon3': '2.508', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.065', 'FRAGCOUNT': '50.000'} [2023-02-25 15:14:12,064][36140] DAMAGECOUNT value on done: 1773246.0 [2023-02-25 15:14:12,065][36140] Sum rewards: 66.977, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.007', 'AMMO2': '0.017', 'HEALTH': '0.058', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'weapon5': '0.170', 'weapon4': '0.226', 'weapon2': '0.596', 'WEAPON3': '0.900', 'weapon3': '2.826', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.540', 'FRAGCOUNT': '55.000'} [2023-02-25 15:14:12,148][36140] DAMAGECOUNT value on done: 1755344.0 [2023-02-25 15:14:12,148][36140] Sum rewards: 63.975, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.200', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.050', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'weapon4': '0.264', 'weapon2': '0.420', 'WEAPON3': '1.000', 'weapon3': '3.050', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.627', 'FRAGCOUNT': '54.000'} [2023-02-25 15:14:13,791][36138] Updated weights for policy 0, policy_version 60603 (0.0010) [2023-02-25 15:14:14,729][36114] Fps is (10 sec: 10649.5, 60 sec: 10922.7, 300 sec: 12121.4). Total num frames: 248238080. Throughput: 0: 2805.6. Samples: 24555302. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 15:14:14,730][36114] Avg episode reward: [(0, '58.130')] [2023-02-25 15:14:17,454][36138] Updated weights for policy 0, policy_version 60613 (0.0010) [2023-02-25 15:14:18,191][36142] DAMAGECOUNT value on done: 1767470.0 [2023-02-25 15:14:18,192][36142] Sum rewards: 62.504, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.920', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.007', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.175', 'weapon4': '0.240', 'weapon2': '0.430', 'WEAPON3': '1.100', 'weapon3': '3.128', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '51.000'} [2023-02-25 15:14:18,538][36142] DAMAGECOUNT value on done: 1755194.0 [2023-02-25 15:14:18,538][36142] Sum rewards: 64.707, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.925', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.092', 'AMMO3': '0.116', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.546', 'weapon2': '0.574', 'WEAPON3': '0.700', 'weapon3': '2.614', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.873', 'FRAGCOUNT': '51.000'} [2023-02-25 15:14:19,170][36142] DAMAGECOUNT value on done: 1769325.0 [2023-02-25 15:14:19,170][36142] Sum rewards: 67.203, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.272', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon5': '0.136', 'AMMO3': '0.198', 'AMMO4': '0.219', 'WEAPON5': '0.250', 'weapon2': '0.274', 'WEAPON4': '0.400', 'weapon4': '0.472', 'WEAPON3': '1.250', 'weapon3': '2.868', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '58.000'} [2023-02-25 15:14:19,483][36142] DAMAGECOUNT value on done: 1779374.0 [2023-02-25 15:14:19,483][36142] Sum rewards: 57.042, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.340', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.155', 'weapon4': '0.294', 'WEAPON4': '0.300', 'weapon2': '0.546', 'WEAPON3': '0.950', 'weapon3': '2.958', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.634', 'FRAGCOUNT': '47.000'} [2023-02-25 15:14:19,729][36114] Fps is (10 sec: 11059.4, 60 sec: 11059.2, 300 sec: 12121.4). Total num frames: 248299520. Throughput: 0: 2799.4. Samples: 24572592. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 15:14:19,730][36114] Avg episode reward: [(0, '58.261')] [2023-02-25 15:14:20,382][36156] DAMAGECOUNT value on done: 1787924.0 [2023-02-25 15:14:20,382][36156] Sum rewards: 42.008, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.512', 'ARMOR': '0.009', 'AMMO5': '0.019', 'AMMO2': '0.065', 'AMMO3': '0.172', 'weapon5': '0.198', 'weapon2': '0.216', 'AMMO4': '0.324', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.878', 'WEAPON3': '1.000', 'weapon3': '2.302', 'HITCOUNT': '2.450', 'DAMAGECOUNT': '12.537', 'FRAGCOUNT': '38.000'} [2023-02-25 15:14:20,621][36138] Updated weights for policy 0, policy_version 60623 (0.0010) [2023-02-25 15:14:20,717][36156] DAMAGECOUNT value on done: 1762848.0 [2023-02-25 15:14:20,717][36156] Sum rewards: 60.841, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.193', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO3': '0.120', 'AMMO4': '0.152', 'weapon5': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.450', 'weapon2': '0.552', 'WEAPON3': '0.750', 'weapon3': '2.542', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.113', 'FRAGCOUNT': '46.500'} [2023-02-25 15:14:20,933][36156] DAMAGECOUNT value on done: 1778233.0 [2023-02-25 15:14:20,933][36156] Sum rewards: 60.876, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.302', 'AMMO5': '0.005', 'AMMO2': '0.046', 'WEAPON5': '0.100', 'weapon5': '0.118', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'AMMO4': '0.228', 'weapon2': '0.486', 'weapon4': '0.674', 'WEAPON3': '1.000', 'weapon3': '2.452', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.682', 'FRAGCOUNT': '50.000'} [2023-02-25 15:14:21,238][36156] DAMAGECOUNT value on done: 1768308.0 [2023-02-25 15:14:21,238][36156] Sum rewards: 55.157, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.995', 'AMMO5': '0.004', 'AMMO2': '0.023', 'weapon5': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.194', 'weapon2': '0.234', 'WEAPON4': '0.300', 'weapon4': '0.344', 'WEAPON3': '1.250', 'HITCOUNT': '3.110', 'weapon3': '3.232', 'DAMAGECOUNT': '14.724', 'FRAGCOUNT': '48.000'} [2023-02-25 15:14:22,362][36155] DAMAGECOUNT value on done: 1765265.0 [2023-02-25 15:14:22,362][36155] Sum rewards: 53.218, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.234', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.188', 'WEAPON4': '0.300', 'weapon4': '0.308', 'weapon2': '0.588', 'WEAPON3': '1.100', 'weapon3': '2.858', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.647', 'FRAGCOUNT': '45.000'} [2023-02-25 15:14:22,685][36155] DAMAGECOUNT value on done: 1769449.0 [2023-02-25 15:14:22,685][36155] Sum rewards: 77.554, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.245', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.019', 'weapon4': '0.038', 'weapon5': '0.072', 'AMMO4': '0.092', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.664', 'WEAPON3': '1.000', 'weapon3': '3.052', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '64.000'} [2023-02-25 15:14:22,714][36139] DAMAGECOUNT value on done: 1774686.0 [2023-02-25 15:14:22,715][36139] Sum rewards: 53.870, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.000', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.034', 'weapon5': '0.104', 'AMMO3': '0.146', 'AMMO4': '0.171', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.420', 'weapon4': '0.480', 'WEAPON3': '0.850', 'weapon3': '2.772', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.887', 'FRAGCOUNT': '45.000'} [2023-02-25 15:14:23,031][36139] DAMAGECOUNT value on done: 1777073.0 [2023-02-25 15:14:23,032][36139] Sum rewards: 77.453, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.380', 'AMMO2': '0.011', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.192', 'weapon4': '0.328', 'weapon2': '0.762', 'WEAPON3': '1.200', 'weapon3': '2.728', 'HITCOUNT': '4.220', 'DAMAGECOUNT': '18.990', 'FRAGCOUNT': '63.000'} [2023-02-25 15:14:23,421][36139] DAMAGECOUNT value on done: 1781589.0 [2023-02-25 15:14:23,422][36139] Sum rewards: 54.524, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.650', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.104', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'weapon2': '0.274', 'WEAPON4': '0.300', 'ARMOR': '0.499', 'weapon4': '0.508', 'WEAPON3': '1.200', 'weapon3': '2.904', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.415', 'FRAGCOUNT': '46.000'} [2023-02-25 15:14:23,534][36155] DAMAGECOUNT value on done: 1786315.0 [2023-02-25 15:14:23,534][36155] Sum rewards: 70.021, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.902', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'AMMO3': '0.220', 'weapon4': '0.266', 'weapon2': '0.286', 'WEAPON3': '1.300', 'weapon3': '3.236', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '59.000'} [2023-02-25 15:14:23,783][36139] DAMAGECOUNT value on done: 1783986.0 [2023-02-25 15:14:23,784][36139] Sum rewards: 58.989, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.180', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon4': '0.180', 'WEAPON4': '0.200', 'AMMO3': '0.259', 'weapon2': '0.564', 'WEAPON3': '1.550', 'weapon3': '3.010', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.090', 'FRAGCOUNT': '53.000'} [2023-02-25 15:14:23,893][36138] Updated weights for policy 0, policy_version 60633 (0.0009) [2023-02-25 15:14:23,906][36155] DAMAGECOUNT value on done: 1773173.0 [2023-02-25 15:14:23,906][36155] Sum rewards: 58.357, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.218', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'weapon2': '0.160', 'weapon4': '0.196', 'AMMO3': '0.289', 'WEAPON3': '1.600', 'HITCOUNT': '3.280', 'weapon3': '3.364', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '53.000'} [2023-02-25 15:14:24,729][36114] Fps is (10 sec: 12288.1, 60 sec: 11332.3, 300 sec: 12121.4). Total num frames: 248360960. Throughput: 0: 2829.9. Samples: 24582234. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 15:14:24,730][36114] Avg episode reward: [(0, '58.618')] [2023-02-25 15:14:25,832][36154] DAMAGECOUNT value on done: 1773986.0 [2023-02-25 15:14:25,832][36154] Sum rewards: 51.091, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.670', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.078', 'weapon4': '0.106', 'AMMO4': '0.195', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.788', 'WEAPON3': '1.250', 'weapon3': '2.766', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.185', 'FRAGCOUNT': '45.000'} [2023-02-25 15:14:26,176][36154] DAMAGECOUNT value on done: 1754121.0 [2023-02-25 15:14:26,176][36154] Sum rewards: 62.771, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.799', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.058', 'AMMO3': '0.137', 'AMMO4': '0.288', 'weapon5': '0.328', 'weapon2': '0.468', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.574', 'WEAPON3': '0.850', 'weapon3': '2.328', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '51.500'} [2023-02-25 15:14:26,801][36154] DAMAGECOUNT value on done: 1788553.0 [2023-02-25 15:14:26,801][36154] Sum rewards: 55.080, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.124', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.141', 'weapon5': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.442', 'weapon2': '0.758', 'WEAPON3': '0.800', 'weapon3': '2.368', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.127', 'FRAGCOUNT': '44.000'} [2023-02-25 15:14:27,138][36154] DAMAGECOUNT value on done: 1771102.0 [2023-02-25 15:14:27,138][36154] Sum rewards: 59.933, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.392', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.006', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.137', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'weapon4': '0.378', 'weapon2': '0.598', 'WEAPON3': '1.000', 'weapon3': '2.886', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.027', 'FRAGCOUNT': '48.000'} [2023-02-25 15:14:27,205][36138] Updated weights for policy 0, policy_version 60643 (0.0010) [2023-02-25 15:14:27,913][36141] DAMAGECOUNT value on done: 1777198.0 [2023-02-25 15:14:27,913][36141] Sum rewards: 61.108, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.815', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.144', 'AMMO3': '0.188', 'weapon2': '0.196', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.398', 'WEAPON3': '1.150', 'weapon3': '3.038', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.004', 'FRAGCOUNT': '51.000'} [2023-02-25 15:14:28,024][36141] DAMAGECOUNT value on done: 1771333.0 [2023-02-25 15:14:28,025][36141] Sum rewards: 66.799, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.370', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon4': '0.014', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.210', 'weapon2': '0.684', 'WEAPON3': '1.250', 'weapon3': '3.090', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '55.000'} [2023-02-25 15:14:28,257][36141] DAMAGECOUNT value on done: 1783778.0 [2023-02-25 15:14:28,258][36141] Sum rewards: 54.444, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.984', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'AMMO4': '0.173', 'AMMO3': '0.181', 'weapon5': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.394', 'weapon2': '0.422', 'WEAPON3': '0.900', 'weapon3': '2.568', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.734', 'FRAGCOUNT': '46.000'} [2023-02-25 15:14:28,365][36141] DAMAGECOUNT value on done: 1754057.0 [2023-02-25 15:14:28,366][36141] Sum rewards: 63.578, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.262', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.124', 'AMMO4': '0.133', 'AMMO3': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.678', 'weapon4': '0.786', 'WEAPON3': '0.900', 'weapon3': '2.056', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '51.000'} [2023-02-25 15:14:29,729][36114] Fps is (10 sec: 12287.9, 60 sec: 11468.8, 300 sec: 12121.4). Total num frames: 248422400. Throughput: 0: 2848.2. Samples: 24600654. Policy #0 lag: (min: 0.0, avg: 0.8, max: 2.0) [2023-02-25 15:14:29,730][36114] Avg episode reward: [(0, '58.441')] [2023-02-25 15:14:30,460][36138] Updated weights for policy 0, policy_version 60653 (0.0009) [2023-02-25 15:14:32,956][36157] DAMAGECOUNT value on done: 1789762.0 [2023-02-25 15:14:32,957][36157] Sum rewards: 56.251, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.972', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.160', 'weapon4': '0.170', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.836', 'WEAPON3': '1.150', 'weapon3': '2.600', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.276', 'FRAGCOUNT': '46.000'} [2023-02-25 15:14:33,286][36157] DAMAGECOUNT value on done: 1775116.0 [2023-02-25 15:14:33,287][36157] Sum rewards: 71.593, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.674', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'WEAPON4': '0.100', 'weapon5': '0.108', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon4': '0.450', 'weapon2': '0.492', 'WEAPON3': '1.200', 'weapon3': '2.704', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '59.000'} [2023-02-25 15:14:33,675][36138] Updated weights for policy 0, policy_version 60663 (0.0010) [2023-02-25 15:14:33,795][36140] DAMAGECOUNT value on done: 1778150.0 [2023-02-25 15:14:33,795][36140] Sum rewards: 54.943, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.263', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon5': '0.056', 'AMMO4': '0.189', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.370', 'WEAPON4': '0.400', 'weapon2': '0.498', 'WEAPON3': '1.250', 'weapon3': '2.832', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.610', 'FRAGCOUNT': '49.000'} [2023-02-25 15:14:33,875][36140] DAMAGECOUNT value on done: 1784680.0 [2023-02-25 15:14:33,876][36140] Sum rewards: 60.115, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.755', 'AMMO5': '0.018', 'AMMO2': '0.035', 'AMMO3': '0.137', 'AMMO4': '0.176', 'weapon5': '0.322', 'weapon2': '0.342', 'weapon4': '0.476', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.558', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '49.500'} [2023-02-25 15:14:33,990][36157] DAMAGECOUNT value on done: 1796825.0 [2023-02-25 15:14:33,990][36157] Sum rewards: 50.577, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.049', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.152', 'AMMO4': '0.175', 'weapon2': '0.190', 'WEAPON5': '0.250', 'AMMO3': '0.274', 'weapon4': '0.348', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'HITCOUNT': '3.000', 'weapon3': '3.004', 'DAMAGECOUNT': '15.237', 'FRAGCOUNT': '46.000'} [2023-02-25 15:14:34,140][36140] DAMAGECOUNT value on done: 1778188.0 [2023-02-25 15:14:34,140][36140] Sum rewards: 55.158, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.565', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.094', 'AMMO4': '0.133', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.598', 'weapon2': '0.704', 'WEAPON3': '1.200', 'weapon3': '2.344', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.826', 'FRAGCOUNT': '49.000'} [2023-02-25 15:14:34,215][36140] DAMAGECOUNT value on done: 1759514.0 [2023-02-25 15:14:34,216][36140] Sum rewards: 51.961, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.552', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.118', 'weapon5': '0.172', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.410', 'weapon4': '0.640', 'WEAPON3': '0.750', 'HITCOUNT': '2.510', 'weapon3': '2.530', 'DAMAGECOUNT': '12.510', 'FRAGCOUNT': '42.000'} [2023-02-25 15:14:34,296][36157] DAMAGECOUNT value on done: 1782373.0 [2023-02-25 15:14:34,297][36157] Sum rewards: 58.303, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.418', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.143', 'weapon5': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.508', 'weapon4': '0.642', 'WEAPON3': '0.950', 'weapon3': '2.394', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.897', 'FRAGCOUNT': '47.000'} [2023-02-25 15:14:34,729][36114] Fps is (10 sec: 12697.6, 60 sec: 11537.1, 300 sec: 12135.3). Total num frames: 248487936. Throughput: 0: 2878.8. Samples: 24619782. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:14:34,730][36114] Avg episode reward: [(0, '58.564')] [2023-02-25 15:14:36,872][36138] Updated weights for policy 0, policy_version 60673 (0.0010) [2023-02-25 15:14:39,634][36142] DAMAGECOUNT value on done: 1772267.0 [2023-02-25 15:14:39,634][36142] Sum rewards: 52.821, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.935', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.172', 'AMMO3': '0.221', 'AMMO4': '0.222', 'weapon4': '0.342', 'WEAPON5': '0.350', 'weapon2': '0.370', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.872', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.391', 'FRAGCOUNT': '50.000'} [2023-02-25 15:14:39,729][36114] Fps is (10 sec: 12697.7, 60 sec: 11674.0, 300 sec: 12135.3). Total num frames: 248549376. Throughput: 0: 2915.2. Samples: 24629136. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:14:39,730][36114] Avg episode reward: [(0, '58.484')] [2023-02-25 15:14:39,971][36142] DAMAGECOUNT value on done: 1758740.0 [2023-02-25 15:14:39,972][36142] Sum rewards: 50.083, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.212', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.134', 'weapon5': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.592', 'weapon4': '0.798', 'WEAPON3': '0.850', 'weapon3': '2.166', 'HITCOUNT': '2.390', 'DAMAGECOUNT': '10.638', 'FRAGCOUNT': '45.000'} [2023-02-25 15:14:40,140][36138] Updated weights for policy 0, policy_version 60683 (0.0010) [2023-02-25 15:14:40,584][36142] DAMAGECOUNT value on done: 1774799.0 [2023-02-25 15:14:40,585][36142] Sum rewards: 62.661, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.760', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.124', 'weapon4': '0.130', 'AMMO4': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon2': '0.344', 'WEAPON3': '1.250', 'weapon3': '3.140', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.422', 'FRAGCOUNT': '53.000'} [2023-02-25 15:14:40,908][36142] DAMAGECOUNT value on done: 1784519.0 [2023-02-25 15:14:40,909][36142] Sum rewards: 61.786, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.700', 'AMMO5': '0.007', 'AMMO2': '0.037', 'AMMO3': '0.134', 'weapon5': '0.144', 'AMMO4': '0.186', 'WEAPON5': '0.250', 'weapon2': '0.372', 'WEAPON4': '0.500', 'weapon4': '0.720', 'WEAPON3': '0.800', 'weapon3': '2.530', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.435', 'FRAGCOUNT': '51.000'} [2023-02-25 15:14:41,861][36156] DAMAGECOUNT value on done: 1793921.0 [2023-02-25 15:14:41,862][36156] Sum rewards: 62.264, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.676', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon2': '0.168', 'AMMO3': '0.177', 'AMMO4': '0.208', 'weapon5': '0.254', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'weapon4': '0.994', 'WEAPON3': '1.100', 'weapon3': '2.270', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.991', 'FRAGCOUNT': '53.000'} [2023-02-25 15:14:42,191][36156] DAMAGECOUNT value on done: 1768072.0 [2023-02-25 15:14:42,191][36156] Sum rewards: 64.929, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.550', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.132', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'weapon2': '0.274', 'WEAPON4': '0.300', 'weapon4': '0.382', 'WEAPON3': '1.200', 'weapon3': '2.994', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.672', 'FRAGCOUNT': '56.000'} [2023-02-25 15:14:42,420][36156] DAMAGECOUNT value on done: 1782682.0 [2023-02-25 15:14:42,421][36156] Sum rewards: 50.828, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.152', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.170', 'AMMO3': '0.179', 'AMMO4': '0.198', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON4': '0.350', 'weapon4': '0.748', 'WEAPON3': '1.050', 'weapon3': '2.250', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.347', 'FRAGCOUNT': '44.000'} [2023-02-25 15:14:42,727][36156] DAMAGECOUNT value on done: 1772763.0 [2023-02-25 15:14:42,728][36156] Sum rewards: 53.613, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.130', 'AMMO5': '0.009', 'weapon5': '0.024', 'weapon4': '0.028', 'AMMO2': '0.030', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'weapon2': '0.418', 'WEAPON3': '1.450', 'HITCOUNT': '2.800', 'weapon3': '3.324', 'DAMAGECOUNT': '13.365', 'FRAGCOUNT': '51.000'} [2023-02-25 15:14:43,331][36138] Updated weights for policy 0, policy_version 60693 (0.0009) [2023-02-25 15:14:43,742][36155] DAMAGECOUNT value on done: 1770157.0 [2023-02-25 15:14:43,742][36155] Sum rewards: 55.734, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.920', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.167', 'weapon4': '0.184', 'weapon5': '0.190', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.910', 'weapon3': '2.920', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '50.000'} [2023-02-25 15:14:44,063][36155] DAMAGECOUNT value on done: 1774735.0 [2023-02-25 15:14:44,063][36155] Sum rewards: 56.576, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.394', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.029', 'weapon5': '0.098', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'weapon2': '0.178', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'weapon4': '0.878', 'WEAPON3': '1.350', 'weapon3': '2.526', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '15.858', 'FRAGCOUNT': '49.000'} [2023-02-25 15:14:44,210][36139] DAMAGECOUNT value on done: 1779456.0 [2023-02-25 15:14:44,211][36139] Sum rewards: 52.817, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.296', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.078', 'WEAPON4': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.214', 'weapon2': '0.408', 'WEAPON3': '1.350', 'HITCOUNT': '2.830', 'weapon3': '3.314', 'DAMAGECOUNT': '14.310', 'FRAGCOUNT': '45.000'} [2023-02-25 15:14:44,535][36139] DAMAGECOUNT value on done: 1781986.0 [2023-02-25 15:14:44,535][36139] Sum rewards: 51.303, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.179', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.116', 'weapon4': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.508', 'WEAPON3': '1.350', 'weapon3': '3.028', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '45.000'} [2023-02-25 15:14:44,729][36114] Fps is (10 sec: 12697.6, 60 sec: 11741.9, 300 sec: 12135.3). Total num frames: 248614912. Throughput: 0: 2955.4. Samples: 24648198. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:14:44,730][36114] Avg episode reward: [(0, '58.494')] [2023-02-25 15:14:44,819][36155] DAMAGECOUNT value on done: 1790798.0 [2023-02-25 15:14:44,820][36155] Sum rewards: 52.589, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.242', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.066', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'AMMO3': '0.192', 'weapon4': '0.198', 'weapon2': '0.246', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.020', 'weapon3': '3.308', 'DAMAGECOUNT': '13.449', 'FRAGCOUNT': '46.000'} [2023-02-25 15:14:44,862][36139] DAMAGECOUNT value on done: 1786870.0 [2023-02-25 15:14:44,863][36139] Sum rewards: 61.512, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.505', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon5': '0.094', 'AMMO4': '0.115', 'weapon4': '0.144', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.576', 'WEAPON3': '1.200', 'weapon3': '2.994', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.843', 'FRAGCOUNT': '52.000'} [2023-02-25 15:14:45,134][36155] DAMAGECOUNT value on done: 1778132.0 [2023-02-25 15:14:45,135][36155] Sum rewards: 61.658, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.764', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.074', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.165', 'weapon2': '0.206', 'WEAPON4': '0.550', 'weapon4': '0.724', 'WEAPON3': '1.000', 'weapon3': '2.696', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.877', 'FRAGCOUNT': '53.000'} [2023-02-25 15:14:45,192][36139] DAMAGECOUNT value on done: 1787815.0 [2023-02-25 15:14:45,192][36139] Sum rewards: 41.810, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.000', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.167', 'weapon5': '0.188', 'weapon2': '0.190', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.658', 'WEAPON3': '1.400', 'weapon3': '2.658', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '11.487', 'FRAGCOUNT': '40.000'} [2023-02-25 15:14:45,196][36154] Large shaping reward 2.577 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.045, -15.0), ('weapon5', 0.002)] [2023-02-25 15:14:46,507][36138] Updated weights for policy 0, policy_version 60703 (0.0010) [2023-02-25 15:14:46,975][36154] DAMAGECOUNT value on done: 1778568.0 [2023-02-25 15:14:46,976][36154] Sum rewards: 59.489, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.768', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO3': '0.127', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'weapon5': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.404', 'weapon4': '0.798', 'WEAPON3': '0.850', 'weapon3': '2.338', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '13.746', 'FRAGCOUNT': '48.000'} [2023-02-25 15:14:47,303][36154] DAMAGECOUNT value on done: 1758547.0 [2023-02-25 15:14:47,303][36154] Sum rewards: 48.093, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.510', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO3': '0.148', 'AMMO4': '0.214', 'weapon5': '0.224', 'weapon4': '0.448', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon2': '0.568', 'WEAPON3': '0.900', 'weapon3': '2.476', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.104', 'FRAGCOUNT': '40.500'} [2023-02-25 15:14:47,956][36154] DAMAGECOUNT value on done: 1792640.0 [2023-02-25 15:14:47,957][36154] Sum rewards: 48.035, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.463', 'AMMO5': '0.007', 'AMMO2': '0.055', 'weapon5': '0.124', 'AMMO3': '0.125', 'WEAPON5': '0.200', 'AMMO4': '0.273', 'weapon2': '0.496', 'WEAPON4': '0.550', 'WEAPON3': '0.700', 'weapon4': '1.274', 'weapon3': '1.842', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '12.261', 'FRAGCOUNT': '40.000'} [2023-02-25 15:14:48,287][36154] DAMAGECOUNT value on done: 1776779.0 [2023-02-25 15:14:48,288][36154] Sum rewards: 68.878, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.307', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.173', 'weapon5': '0.206', 'weapon2': '0.276', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.792', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '56.500'} [2023-02-25 15:14:48,911][36141] DAMAGECOUNT value on done: 1782940.0 [2023-02-25 15:14:48,911][36141] Sum rewards: 69.879, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.010', 'AMMO5': '0.017', 'AMMO2': '0.032', 'weapon5': '0.116', 'AMMO4': '0.157', 'AMMO3': '0.192', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.304', 'weapon4': '0.508', 'WEAPON3': '1.200', 'weapon3': '2.782', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '59.000'} [2023-02-25 15:14:49,026][36141] DAMAGECOUNT value on done: 1774024.0 [2023-02-25 15:14:49,026][36141] Sum rewards: 34.420, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.218', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.084', 'AMMO3': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon7': '0.158', 'weapon4': '0.274', 'WEAPON3': '0.600', 'weapon2': '1.310', 'HITCOUNT': '1.580', 'weapon3': '1.828', 'DAMAGECOUNT': '8.073', 'FRAGCOUNT': '27.000'} [2023-02-25 15:14:49,252][36141] DAMAGECOUNT value on done: 1788427.0 [2023-02-25 15:14:49,253][36141] Sum rewards: 54.485, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.572', 'AMMO5': '0.015', 'AMMO2': '0.042', 'AMMO3': '0.196', 'AMMO4': '0.209', 'weapon5': '0.240', 'weapon4': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.492', 'WEAPON3': '1.100', 'weapon3': '2.592', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.947', 'FRAGCOUNT': '49.000'} [2023-02-25 15:14:49,365][36141] DAMAGECOUNT value on done: 1758565.0 [2023-02-25 15:14:49,365][36141] Sum rewards: 48.189, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.139', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon5': '0.188', 'AMMO3': '0.213', 'AMMO4': '0.219', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.460', 'weapon4': '0.668', 'WEAPON3': '1.250', 'weapon3': '2.270', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '13.524', 'FRAGCOUNT': '44.000'} [2023-02-25 15:14:49,727][36138] Updated weights for policy 0, policy_version 60713 (0.0009) [2023-02-25 15:14:49,729][36114] Fps is (10 sec: 13107.1, 60 sec: 11878.4, 300 sec: 12149.2). Total num frames: 248680448. Throughput: 0: 3036.4. Samples: 24667522. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:14:49,730][36114] Avg episode reward: [(0, '57.778')] [2023-02-25 15:14:50,827][36140] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 15:14:52,954][36138] Updated weights for policy 0, policy_version 60723 (0.0009) [2023-02-25 15:14:54,107][36157] DAMAGECOUNT value on done: 1794432.0 [2023-02-25 15:14:54,108][36157] Sum rewards: 57.595, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.730', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.119', 'AMMO4': '0.171', 'weapon5': '0.210', 'WEAPON5': '0.300', 'weapon2': '0.374', 'ARMOR': '0.463', 'WEAPON4': '0.550', 'WEAPON3': '0.750', 'weapon4': '1.380', 'weapon3': '1.814', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '14.010', 'FRAGCOUNT': '47.000'} [2023-02-25 15:14:54,446][36157] DAMAGECOUNT value on done: 1779766.0 [2023-02-25 15:14:54,446][36157] Sum rewards: 53.497, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.441', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon5': '0.148', 'AMMO3': '0.179', 'AMMO4': '0.217', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.368', 'weapon2': '0.496', 'WEAPON3': '1.100', 'weapon3': '2.732', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.950', 'FRAGCOUNT': '47.000'} [2023-02-25 15:14:54,729][36114] Fps is (10 sec: 12697.7, 60 sec: 12015.0, 300 sec: 12149.2). Total num frames: 248741888. Throughput: 0: 3040.1. Samples: 24677110. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:14:54,729][36114] Avg episode reward: [(0, '57.605')] [2023-02-25 15:14:54,931][36140] DAMAGECOUNT value on done: 1782552.0 [2023-02-25 15:14:54,931][36140] Sum rewards: 55.892, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.038', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'weapon5': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.430', 'weapon4': '0.574', 'WEAPON3': '0.950', 'weapon3': '2.362', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.206', 'FRAGCOUNT': '47.000'} [2023-02-25 15:14:55,018][36140] DAMAGECOUNT value on done: 1790050.0 [2023-02-25 15:14:55,019][36140] Sum rewards: 57.619, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.722', 'AMMO5': '0.007', 'AMMO2': '0.047', 'weapon5': '0.150', 'AMMO4': '0.233', 'AMMO3': '0.236', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON4': '0.450', 'weapon4': '0.642', 'WEAPON3': '1.350', 'weapon3': '2.440', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '50.000'} [2023-02-25 15:14:55,118][36157] DAMAGECOUNT value on done: 1801112.0 [2023-02-25 15:14:55,119][36157] Sum rewards: 45.439, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.286', 'AMMO5': '0.004', 'ARMOR': '0.004', 'AMMO2': '0.016', 'weapon5': '0.034', 'weapon4': '0.042', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.268', 'weapon2': '0.526', 'WEAPON3': '1.700', 'HITCOUNT': '2.680', 'weapon3': '3.212', 'DAMAGECOUNT': '12.861', 'FRAGCOUNT': '43.000'} [2023-02-25 15:14:55,277][36140] DAMAGECOUNT value on done: 1782578.0 [2023-02-25 15:14:55,278][36140] Sum rewards: 45.556, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.146', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.112', 'AMMO4': '0.166', 'AMMO3': '0.224', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.418', 'weapon2': '0.434', 'WEAPON3': '1.350', 'weapon3': '2.698', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.170', 'FRAGCOUNT': '43.000'} [2023-02-25 15:14:55,350][36140] DAMAGECOUNT value on done: 1764488.0 [2023-02-25 15:14:55,351][36140] Sum rewards: 56.094, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.906', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon4': '0.106', 'weapon5': '0.110', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.230', 'AMMO3': '0.286', 'WEAPON3': '1.700', 'HITCOUNT': '3.110', 'weapon3': '3.262', 'DAMAGECOUNT': '14.922', 'FRAGCOUNT': '52.000'} [2023-02-25 15:14:55,446][36157] DAMAGECOUNT value on done: 1787855.0 [2023-02-25 15:14:55,447][36157] Sum rewards: 65.138, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.510', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.146', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.248', 'weapon2': '0.808', 'WEAPON3': '1.150', 'weapon3': '2.552', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.446', 'FRAGCOUNT': '54.000'} [2023-02-25 15:14:56,173][36138] Updated weights for policy 0, policy_version 60733 (0.0009) [2023-02-25 15:14:59,291][36138] Updated weights for policy 0, policy_version 60743 (0.0009) [2023-02-25 15:14:59,729][36114] Fps is (10 sec: 12697.8, 60 sec: 12151.5, 300 sec: 12149.2). Total num frames: 248807424. Throughput: 0: 3134.7. Samples: 24696364. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:14:59,730][36114] Avg episode reward: [(0, '57.266')] [2023-02-25 15:15:00,633][36142] DAMAGECOUNT value on done: 1778265.0 [2023-02-25 15:15:00,633][36142] Sum rewards: 69.899, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.635', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'weapon5': '0.154', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'weapon2': '0.222', 'weapon4': '0.436', 'WEAPON3': '1.200', 'weapon3': '2.946', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '57.000'} [2023-02-25 15:15:00,972][36142] DAMAGECOUNT value on done: 1764488.0 [2023-02-25 15:15:00,972][36142] Sum rewards: 71.608, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.676', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.068', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'weapon2': '0.384', 'weapon4': '0.386', 'WEAPON3': '1.000', 'weapon3': '2.938', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '58.000'} [2023-02-25 15:15:01,605][36142] DAMAGECOUNT value on done: 1780094.0 [2023-02-25 15:15:01,606][36142] Sum rewards: 67.242, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.038', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.046', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'weapon4': '0.210', 'weapon2': '0.466', 'WEAPON3': '1.050', 'weapon3': '3.092', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '55.000'} [2023-02-25 15:15:01,915][36142] DAMAGECOUNT value on done: 1788742.0 [2023-02-25 15:15:01,915][36142] Sum rewards: 51.686, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.868', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.141', 'weapon2': '0.270', 'weapon4': '0.302', 'WEAPON3': '0.900', 'HITCOUNT': '2.930', 'weapon3': '3.232', 'DAMAGECOUNT': '12.669', 'FRAGCOUNT': '43.000'} [2023-02-25 15:15:02,503][36138] Updated weights for policy 0, policy_version 60753 (0.0010) [2023-02-25 15:15:02,821][36156] DAMAGECOUNT value on done: 1799100.0 [2023-02-25 15:15:02,821][36156] Sum rewards: 63.118, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.150', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.102', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'WEAPON4': '0.300', 'weapon2': '0.410', 'weapon4': '0.416', 'WEAPON3': '1.000', 'weapon3': '2.798', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '52.000'} [2023-02-25 15:15:03,141][36156] DAMAGECOUNT value on done: 1773462.0 [2023-02-25 15:15:03,141][36156] Sum rewards: 59.691, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.476', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.162', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'AMMO4': '0.228', 'weapon2': '0.344', 'WEAPON4': '0.450', 'weapon4': '0.508', 'WEAPON3': '1.100', 'weapon3': '2.692', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '52.000'} [2023-02-25 15:15:03,369][36156] DAMAGECOUNT value on done: 1787730.0 [2023-02-25 15:15:03,370][36156] Sum rewards: 60.394, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.436', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.161', 'weapon5': '0.240', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.654', 'weapon2': '0.766', 'WEAPON3': '0.950', 'weapon3': '1.906', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.144', 'FRAGCOUNT': '49.000'} [2023-02-25 15:15:03,702][36156] DAMAGECOUNT value on done: 1778169.0 [2023-02-25 15:15:03,702][36156] Sum rewards: 66.230, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.250', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.173', 'weapon2': '0.272', 'weapon4': '0.276', 'WEAPON3': '1.100', 'weapon3': '3.192', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.218', 'FRAGCOUNT': '54.000'} [2023-02-25 15:15:04,586][36155] DAMAGECOUNT value on done: 1775659.0 [2023-02-25 15:15:04,586][36155] Sum rewards: 64.459, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.640', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.012', 'AMMO4': '0.031', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.132', 'weapon2': '0.164', 'AMMO3': '0.225', 'WEAPON3': '1.350', 'HITCOUNT': '3.280', 'weapon3': '3.490', 'DAMAGECOUNT': '16.506', 'FRAGCOUNT': '55.000'} [2023-02-25 15:15:04,729][36114] Fps is (10 sec: 13107.1, 60 sec: 12356.2, 300 sec: 12149.1). Total num frames: 248872960. Throughput: 0: 3181.8. Samples: 24715772. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:15:04,730][36114] Avg episode reward: [(0, '57.724')] [2023-02-25 15:15:04,918][36155] DAMAGECOUNT value on done: 1779917.0 [2023-02-25 15:15:04,918][36155] Sum rewards: 62.424, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.333', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.032', 'AMMO3': '0.150', 'AMMO4': '0.160', 'weapon5': '0.274', 'weapon2': '0.328', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '0.900', 'weapon4': '0.940', 'weapon3': '1.752', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.546', 'FRAGCOUNT': '54.000'} [2023-02-25 15:15:05,038][36139] DAMAGECOUNT value on done: 1784706.0 [2023-02-25 15:15:05,038][36139] Sum rewards: 54.645, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.012', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.126', 'weapon4': '0.142', 'AMMO4': '0.150', 'AMMO3': '0.225', 'weapon2': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.150', 'weapon3': '3.174', 'DAMAGECOUNT': '15.750', 'FRAGCOUNT': '49.000'} [2023-02-25 15:15:05,366][36139] DAMAGECOUNT value on done: 1787326.0 [2023-02-25 15:15:05,366][36139] Sum rewards: 64.530, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.060', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon2': '0.148', 'AMMO3': '0.165', 'weapon5': '0.172', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.472', 'WEAPON3': '1.100', 'weapon3': '3.006', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '55.000'} [2023-02-25 15:15:05,649][36138] Updated weights for policy 0, policy_version 60763 (0.0009) [2023-02-25 15:15:05,687][36155] DAMAGECOUNT value on done: 1796073.0 [2023-02-25 15:15:05,688][36155] Sum rewards: 55.200, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.720', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.054', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'weapon2': '0.420', 'weapon4': '0.506', 'WEAPON3': '1.150', 'weapon3': '2.884', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.825', 'FRAGCOUNT': '45.000'} [2023-02-25 15:15:05,692][36139] DAMAGECOUNT value on done: 1792115.0 [2023-02-25 15:15:05,693][36139] Sum rewards: 58.096, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.658', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.066', 'AMMO3': '0.170', 'weapon5': '0.178', 'weapon4': '0.328', 'AMMO4': '0.332', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'weapon2': '0.690', 'WEAPON3': '1.000', 'weapon3': '2.492', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.735', 'FRAGCOUNT': '49.500'} [2023-02-25 15:15:06,007][36139] DAMAGECOUNT value on done: 1792473.0 [2023-02-25 15:15:06,007][36139] Sum rewards: 59.519, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.634', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.016', 'weapon5': '0.062', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.182', 'weapon2': '0.272', 'WEAPON4': '0.300', 'weapon4': '0.524', 'WEAPON3': '1.100', 'weapon3': '2.724', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.734', 'FRAGCOUNT': '51.000'} [2023-02-25 15:15:06,020][36155] DAMAGECOUNT value on done: 1783032.0 [2023-02-25 15:15:06,020][36155] Sum rewards: 54.872, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.845', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.118', 'AMMO4': '0.122', 'AMMO3': '0.159', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.406', 'weapon4': '0.432', 'WEAPON3': '1.000', 'weapon3': '2.828', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.700', 'FRAGCOUNT': '46.000'} [2023-02-25 15:15:07,922][36154] DAMAGECOUNT value on done: 1783771.0 [2023-02-25 15:15:07,923][36154] Sum rewards: 57.887, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.676', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.086', 'AMMO4': '0.166', 'AMMO3': '0.208', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON4': '0.350', 'weapon4': '0.506', 'WEAPON3': '1.250', 'weapon3': '2.892', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.609', 'FRAGCOUNT': '50.000'} [2023-02-25 15:15:08,254][36154] DAMAGECOUNT value on done: 1762733.0 [2023-02-25 15:15:08,255][36154] Sum rewards: 49.104, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.907', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon4': '0.440', 'weapon2': '0.492', 'WEAPON3': '1.200', 'weapon3': '2.642', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.558', 'FRAGCOUNT': '43.000'} [2023-02-25 15:15:08,371][36156] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 15:15:08,825][36138] Updated weights for policy 0, policy_version 60773 (0.0009) [2023-02-25 15:15:08,890][36154] DAMAGECOUNT value on done: 1797117.0 [2023-02-25 15:15:08,890][36154] Sum rewards: 49.600, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.898', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon4': '0.086', 'weapon5': '0.090', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.694', 'WEAPON3': '1.250', 'HITCOUNT': '2.790', 'weapon3': '2.930', 'DAMAGECOUNT': '13.431', 'FRAGCOUNT': '43.000'} [2023-02-25 15:15:09,210][36154] DAMAGECOUNT value on done: 1780628.0 [2023-02-25 15:15:09,211][36154] Sum rewards: 42.973, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.524', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO4': '0.172', 'AMMO3': '0.223', 'weapon2': '0.228', 'weapon5': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.750', 'WEAPON3': '1.250', 'weapon3': '2.414', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '11.547', 'FRAGCOUNT': '40.000'} [2023-02-25 15:15:09,635][36141] DAMAGECOUNT value on done: 1787390.0 [2023-02-25 15:15:09,636][36141] Sum rewards: 55.497, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.218', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.100', 'AMMO3': '0.135', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'weapon4': '0.478', 'WEAPON3': '0.850', 'weapon2': '0.880', 'weapon3': '2.370', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.350', 'FRAGCOUNT': '46.000'} [2023-02-25 15:15:09,729][36114] Fps is (10 sec: 12697.5, 60 sec: 12424.6, 300 sec: 12163.0). Total num frames: 248934400. Throughput: 0: 3182.3. Samples: 24725438. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:15:09,729][36114] Avg episode reward: [(0, '57.809')] [2023-02-25 15:15:09,748][36141] DAMAGECOUNT value on done: 1778438.0 [2023-02-25 15:15:09,749][36141] Sum rewards: 58.825, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.060', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.015', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon4': '0.210', 'weapon2': '0.678', 'WEAPON3': '0.950', 'HITCOUNT': '2.900', 'weapon3': '2.916', 'DAMAGECOUNT': '13.242', 'FRAGCOUNT': '49.000'} [2023-02-25 15:15:09,835][36140] Large shaping reward -2.506 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0)] [2023-02-25 15:15:09,972][36141] DAMAGECOUNT value on done: 1793544.0 [2023-02-25 15:15:09,972][36141] Sum rewards: 64.842, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.323', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon4': '0.146', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.330', 'weapon2': '0.596', 'WEAPON3': '1.000', 'weapon3': '2.728', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.784', 'FRAGCOUNT': '54.000'} [2023-02-25 15:15:10,097][36141] DAMAGECOUNT value on done: 1763511.0 [2023-02-25 15:15:10,098][36141] Sum rewards: 54.194, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.900', 'AMMO5': '0.022', 'AMMO2': '0.055', 'AMMO3': '0.191', 'AMMO4': '0.277', 'weapon5': '0.308', 'weapon2': '0.406', 'WEAPON5': '0.650', 'WEAPON4': '0.650', 'weapon4': '0.802', 'WEAPON3': '1.100', 'weapon3': '1.994', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.838', 'FRAGCOUNT': '50.000'} [2023-02-25 15:15:11,978][36138] Updated weights for policy 0, policy_version 60783 (0.0009) [2023-02-25 15:15:14,729][36114] Fps is (10 sec: 12697.6, 60 sec: 12697.6, 300 sec: 12176.9). Total num frames: 248999936. Throughput: 0: 3200.4. Samples: 24744670. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 15:15:14,730][36114] Avg episode reward: [(0, '57.652')] [2023-02-25 15:15:15,029][36157] DAMAGECOUNT value on done: 1799649.0 [2023-02-25 15:15:15,029][36157] Sum rewards: 59.785, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.316', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon4': '0.540', 'weapon2': '0.626', 'WEAPON3': '1.200', 'weapon3': '2.544', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.651', 'FRAGCOUNT': '51.000'} [2023-02-25 15:15:15,209][36138] Updated weights for policy 0, policy_version 60793 (0.0010) [2023-02-25 15:15:15,355][36157] DAMAGECOUNT value on done: 1785191.0 [2023-02-25 15:15:15,356][36157] Sum rewards: 63.577, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.215', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.126', 'AMMO4': '0.160', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.512', 'weapon2': '0.622', 'WEAPON3': '1.350', 'weapon3': '2.486', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '56.000'} [2023-02-25 15:15:15,978][36140] DAMAGECOUNT value on done: 1787521.0 [2023-02-25 15:15:15,978][36140] Sum rewards: 56.169, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.281', 'AMMO5': '0.015', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.152', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.400', 'weapon2': '0.652', 'WEAPON3': '1.100', 'weapon3': '2.398', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.697', 'FRAGCOUNT': '47.000'} [2023-02-25 15:15:16,001][36157] DAMAGECOUNT value on done: 1805899.0 [2023-02-25 15:15:16,002][36157] Sum rewards: 52.253, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.994', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO3': '0.159', 'weapon5': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.444', 'WEAPON4': '0.450', 'weapon4': '0.994', 'WEAPON3': '1.000', 'weapon3': '2.026', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.361', 'FRAGCOUNT': '44.000'} [2023-02-25 15:15:16,028][36140] DAMAGECOUNT value on done: 1794557.0 [2023-02-25 15:15:16,029][36140] Sum rewards: 57.102, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.000', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.098', 'AMMO4': '0.149', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.296', 'weapon2': '0.314', 'WEAPON3': '1.150', 'HITCOUNT': '3.000', 'weapon3': '3.086', 'DAMAGECOUNT': '13.521', 'FRAGCOUNT': '50.000'} [2023-02-25 15:15:16,312][36140] DAMAGECOUNT value on done: 1787976.0 [2023-02-25 15:15:16,313][36140] Sum rewards: 60.039, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.972', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.136', 'weapon2': '0.144', 'AMMO4': '0.179', 'WEAPON5': '0.250', 'AMMO3': '0.268', 'weapon4': '0.274', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.228', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.194', 'FRAGCOUNT': '54.500'} [2023-02-25 15:15:16,326][36157] DAMAGECOUNT value on done: 1792727.0 [2023-02-25 15:15:16,327][36157] Sum rewards: 58.006, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.056', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO3': '0.165', 'AMMO4': '0.172', 'weapon5': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.378', 'weapon4': '0.582', 'WEAPON3': '1.000', 'weapon3': '2.612', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.616', 'FRAGCOUNT': '48.500'} [2023-02-25 15:15:16,366][36140] DAMAGECOUNT value on done: 1769881.0 [2023-02-25 15:15:16,366][36140] Sum rewards: 66.870, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.600', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.120', 'AMMO3': '0.168', 'weapon4': '0.370', 'weapon2': '0.520', 'WEAPON3': '0.950', 'weapon3': '2.836', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '53.000'} [2023-02-25 15:15:18,392][36138] Updated weights for policy 0, policy_version 60803 (0.0010) [2023-02-25 15:15:19,729][36114] Fps is (10 sec: 13107.1, 60 sec: 12765.9, 300 sec: 12176.9). Total num frames: 249065472. Throughput: 0: 3203.4. Samples: 24763934. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 15:15:19,730][36114] Avg episode reward: [(0, '58.090')] [2023-02-25 15:15:19,733][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000060807_249065472.pth... [2023-02-25 15:15:19,795][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000060100_246169600.pth [2023-02-25 15:15:21,528][36142] DAMAGECOUNT value on done: 1783907.0 [2023-02-25 15:15:21,529][36142] Sum rewards: 63.596, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.714', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.048', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.222', 'weapon4': '0.314', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.184', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '54.000'} [2023-02-25 15:15:21,635][36138] Updated weights for policy 0, policy_version 60813 (0.0010) [2023-02-25 15:15:21,857][36142] DAMAGECOUNT value on done: 1769173.0 [2023-02-25 15:15:21,858][36142] Sum rewards: 56.173, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.478', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.146', 'AMMO3': '0.170', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.400', 'weapon2': '0.744', 'WEAPON3': '1.100', 'weapon3': '2.460', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '14.055', 'FRAGCOUNT': '49.000'} [2023-02-25 15:15:22,471][36142] DAMAGECOUNT value on done: 1785159.0 [2023-02-25 15:15:22,471][36142] Sum rewards: 60.503, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.980', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.016', 'weapon5': '0.076', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'AMMO3': '0.192', 'WEAPON4': '0.300', 'weapon2': '0.454', 'weapon4': '0.620', 'WEAPON3': '1.150', 'weapon3': '2.644', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.195', 'FRAGCOUNT': '51.000'} [2023-02-25 15:15:22,791][36142] DAMAGECOUNT value on done: 1793195.0 [2023-02-25 15:15:22,792][36142] Sum rewards: 54.257, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.630', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.100', 'AMMO4': '0.140', 'weapon4': '0.168', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.402', 'WEAPON3': '1.100', 'HITCOUNT': '2.990', 'weapon3': '3.158', 'DAMAGECOUNT': '13.359', 'FRAGCOUNT': '48.000'} [2023-02-25 15:15:23,721][36156] DAMAGECOUNT value on done: 1804534.0 [2023-02-25 15:15:23,722][36156] Sum rewards: 63.232, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.084', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.152', 'AMMO3': '0.161', 'weapon5': '0.246', 'WEAPON5': '0.250', 'weapon4': '0.298', 'WEAPON4': '0.300', 'weapon2': '0.472', 'WEAPON3': '1.050', 'weapon3': '2.672', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '53.000'} [2023-02-25 15:15:24,059][36156] DAMAGECOUNT value on done: 1779076.0 [2023-02-25 15:15:24,060][36156] Sum rewards: 63.626, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.430', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.041', 'AMMO3': '0.200', 'AMMO4': '0.207', 'weapon5': '0.274', 'weapon2': '0.420', 'weapon4': '0.424', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.574', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '54.500'} [2023-02-25 15:15:24,295][36156] DAMAGECOUNT value on done: 1793303.0 [2023-02-25 15:15:24,295][36156] Sum rewards: 65.065, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.289', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.094', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'weapon4': '0.174', 'AMMO3': '0.264', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.168', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.719', 'FRAGCOUNT': '59.000'} [2023-02-25 15:15:24,611][36156] DAMAGECOUNT value on done: 1782627.0 [2023-02-25 15:15:24,612][36156] Sum rewards: 47.075, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.979', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.168', 'weapon5': '0.306', 'weapon2': '0.336', 'WEAPON4': '0.350', 'weapon4': '0.356', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '2.560', 'weapon3': '2.756', 'DAMAGECOUNT': '13.374', 'FRAGCOUNT': '40.000'} [2023-02-25 15:15:24,729][36114] Fps is (10 sec: 12697.7, 60 sec: 12765.9, 300 sec: 12163.0). Total num frames: 249126912. Throughput: 0: 3206.3. Samples: 24773418. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 15:15:24,730][36114] Avg episode reward: [(0, '57.817')] [2023-02-25 15:15:24,815][36138] Updated weights for policy 0, policy_version 60823 (0.0009) [2023-02-25 15:15:25,470][36155] DAMAGECOUNT value on done: 1781874.0 [2023-02-25 15:15:25,471][36155] Sum rewards: 74.282, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.582', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.013', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'weapon2': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.267', 'weapon4': '0.272', 'WEAPON3': '1.600', 'weapon3': '3.316', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.645', 'FRAGCOUNT': '65.000'} [2023-02-25 15:15:25,802][36155] DAMAGECOUNT value on done: 1785661.0 [2023-02-25 15:15:25,802][36155] Sum rewards: 73.691, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.018', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.172', 'weapon2': '0.238', 'WEAPON3': '1.200', 'HITCOUNT': '3.460', 'weapon3': '3.658', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '61.000'} [2023-02-25 15:15:26,027][36139] DAMAGECOUNT value on done: 1789516.0 [2023-02-25 15:15:26,028][36139] Sum rewards: 55.471, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.070', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.121', 'weapon4': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'weapon2': '0.424', 'WEAPON3': '1.150', 'HITCOUNT': '2.860', 'weapon3': '3.204', 'DAMAGECOUNT': '14.430', 'FRAGCOUNT': '46.000'} [2023-02-25 15:15:26,362][36139] DAMAGECOUNT value on done: 1792423.0 [2023-02-25 15:15:26,362][36139] Sum rewards: 63.133, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.791', 'ARMOR': '0.004', 'AMMO5': '0.014', 'weapon5': '0.030', 'AMMO2': '0.047', 'AMMO3': '0.144', 'AMMO4': '0.235', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.508', 'weapon4': '0.548', 'WEAPON3': '0.900', 'weapon3': '2.754', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.249', 'FRAGCOUNT': '53.000'} [2023-02-25 15:15:26,548][36155] DAMAGECOUNT value on done: 1801148.0 [2023-02-25 15:15:26,548][36155] Sum rewards: 62.668, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.470', 'AMMO5': '0.009', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon5': '0.120', 'AMMO3': '0.175', 'weapon2': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.508', 'WEAPON3': '1.000', 'weapon3': '2.706', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.225', 'FRAGCOUNT': '53.000'} [2023-02-25 15:15:26,687][36139] DAMAGECOUNT value on done: 1798119.0 [2023-02-25 15:15:26,688][36139] Sum rewards: 72.526, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.759', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.078', 'AMMO4': '0.094', 'weapon5': '0.104', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.372', 'WEAPON3': '1.150', 'weapon3': '3.232', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '59.000'} [2023-02-25 15:15:26,866][36155] DAMAGECOUNT value on done: 1787664.0 [2023-02-25 15:15:26,866][36155] Sum rewards: 49.112, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.990', 'AMMO5': '0.022', 'AMMO2': '0.066', 'AMMO3': '0.169', 'weapon5': '0.314', 'AMMO4': '0.329', 'weapon2': '0.334', 'WEAPON5': '0.650', 'WEAPON4': '0.850', 'weapon4': '0.850', 'WEAPON3': '1.000', 'weapon3': '2.152', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '13.896', 'FRAGCOUNT': '46.000'} [2023-02-25 15:15:26,998][36139] DAMAGECOUNT value on done: 1798176.0 [2023-02-25 15:15:26,999][36139] Sum rewards: 55.747, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.268', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.056', 'AMMO3': '0.163', 'weapon5': '0.172', 'AMMO4': '0.282', 'weapon2': '0.348', 'WEAPON5': '0.450', 'weapon4': '0.696', 'WEAPON4': '0.700', 'WEAPON3': '0.900', 'weapon3': '2.410', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.067', 'FRAGCOUNT': '47.000'} [2023-02-25 15:15:28,058][36138] Updated weights for policy 0, policy_version 60833 (0.0009) [2023-02-25 15:15:28,864][36154] DAMAGECOUNT value on done: 1788504.0 [2023-02-25 15:15:28,864][36154] Sum rewards: 62.771, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.400', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'weapon2': '0.350', 'weapon4': '0.578', 'WEAPON3': '1.000', 'weapon3': '2.734', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.199', 'FRAGCOUNT': '52.000'} [2023-02-25 15:15:29,193][36154] DAMAGECOUNT value on done: 1767949.0 [2023-02-25 15:15:29,193][36154] Sum rewards: 68.001, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.616', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO3': '0.131', 'AMMO4': '0.156', 'weapon5': '0.166', 'weapon2': '0.290', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.632', 'WEAPON3': '0.800', 'weapon3': '2.690', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '56.000'} [2023-02-25 15:15:29,729][36114] Fps is (10 sec: 12697.5, 60 sec: 12834.1, 300 sec: 12163.0). Total num frames: 249192448. Throughput: 0: 3208.0. Samples: 24792560. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 15:15:29,730][36114] Avg episode reward: [(0, '58.136')] [2023-02-25 15:15:29,922][36154] DAMAGECOUNT value on done: 1802087.0 [2023-02-25 15:15:29,923][36154] Sum rewards: 58.204, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.992', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.061', 'AMMO3': '0.119', 'weapon5': '0.272', 'AMMO4': '0.304', 'WEAPON5': '0.350', 'weapon2': '0.386', 'WEAPON4': '0.550', 'weapon4': '0.582', 'WEAPON3': '0.800', 'weapon3': '2.516', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '49.000'} [2023-02-25 15:15:30,253][36154] DAMAGECOUNT value on done: 1786925.0 [2023-02-25 15:15:30,254][36154] Sum rewards: 72.864, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.775', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.098', 'weapon2': '0.142', 'AMMO4': '0.171', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.368', 'WEAPON3': '1.200', 'weapon3': '3.150', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.591', 'FRAGCOUNT': '60.500'} [2023-02-25 15:15:30,840][36141] DAMAGECOUNT value on done: 1793263.0 [2023-02-25 15:15:30,841][36141] Sum rewards: 68.810, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.728', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.048', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'weapon2': '0.156', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'weapon4': '0.586', 'WEAPON3': '1.450', 'weapon3': '2.900', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '60.000'} [2023-02-25 15:15:30,878][36141] DAMAGECOUNT value on done: 1784117.0 [2023-02-25 15:15:30,879][36141] Sum rewards: 64.278, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.317', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.172', 'AMMO4': '0.177', 'weapon5': '0.194', 'AMMO3': '0.219', 'weapon2': '0.376', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.976', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '56.500'} [2023-02-25 15:15:31,163][36141] DAMAGECOUNT value on done: 1797219.0 [2023-02-25 15:15:31,164][36141] Sum rewards: 39.301, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.318', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.090', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'weapon4': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.252', 'weapon2': '0.360', 'WEAPON3': '1.500', 'HITCOUNT': '2.430', 'weapon3': '3.230', 'DAMAGECOUNT': '11.025', 'FRAGCOUNT': '39.000'} [2023-02-25 15:15:31,205][36141] DAMAGECOUNT value on done: 1767915.0 [2023-02-25 15:15:31,206][36141] Sum rewards: 58.957, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.142', 'AMMO5': '0.009', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.138', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.220', 'weapon2': '0.346', 'WEAPON3': '1.050', 'HITCOUNT': '2.900', 'weapon3': '3.008', 'DAMAGECOUNT': '13.212', 'FRAGCOUNT': '51.000'} [2023-02-25 15:15:31,288][36138] Updated weights for policy 0, policy_version 60843 (0.0009) [2023-02-25 15:15:34,380][36138] Updated weights for policy 0, policy_version 60853 (0.0009) [2023-02-25 15:15:34,729][36114] Fps is (10 sec: 13107.2, 60 sec: 12834.1, 300 sec: 12190.8). Total num frames: 249257984. Throughput: 0: 3208.3. Samples: 24811894. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 15:15:34,730][36114] Avg episode reward: [(0, '58.298')] [2023-02-25 15:15:35,470][36142] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon2', 0.002)] [2023-02-25 15:15:36,039][36157] DAMAGECOUNT value on done: 1805027.0 [2023-02-25 15:15:36,039][36157] Sum rewards: 63.263, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.320', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO3': '0.135', 'weapon5': '0.136', 'AMMO4': '0.186', 'weapon2': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.460', 'weapon4': '0.540', 'WEAPON3': '0.950', 'weapon3': '2.708', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '52.000'} [2023-02-25 15:15:36,354][36157] DAMAGECOUNT value on done: 1790668.0 [2023-02-25 15:15:36,354][36157] Sum rewards: 63.378, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.685', 'AMMO5': '0.011', 'AMMO2': '0.043', 'AMMO3': '0.178', 'weapon5': '0.184', 'AMMO4': '0.212', 'weapon2': '0.230', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.682', 'WEAPON3': '1.050', 'weapon3': '2.622', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.431', 'FRAGCOUNT': '53.500'} [2023-02-25 15:15:36,998][36140] DAMAGECOUNT value on done: 1792964.0 [2023-02-25 15:15:36,999][36140] Sum rewards: 62.444, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.015', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.092', 'weapon2': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.257', 'weapon4': '0.374', 'WEAPON3': '1.550', 'weapon3': '3.062', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.329', 'FRAGCOUNT': '55.000'} [2023-02-25 15:15:37,017][36157] DAMAGECOUNT value on done: 1810246.0 [2023-02-25 15:15:37,017][36157] Sum rewards: 49.614, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.530', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.039', 'AMMO3': '0.161', 'weapon5': '0.188', 'AMMO4': '0.197', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.596', 'weapon4': '0.690', 'WEAPON3': '0.950', 'weapon3': '2.266', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '13.041', 'FRAGCOUNT': '43.000'} [2023-02-25 15:15:37,051][36140] DAMAGECOUNT value on done: 1799438.0 [2023-02-25 15:15:37,052][36140] Sum rewards: 60.308, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.426', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO3': '0.134', 'AMMO4': '0.143', 'weapon5': '0.178', 'weapon2': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.732', 'WEAPON3': '0.800', 'weapon3': '2.576', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.637', 'FRAGCOUNT': '49.000'} [2023-02-25 15:15:37,337][36140] DAMAGECOUNT value on done: 1793573.0 [2023-02-25 15:15:37,338][36140] Sum rewards: 66.615, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.152', 'AMMO5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.039', 'weapon5': '0.072', 'AMMO3': '0.178', 'AMMO4': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.480', 'weapon2': '0.536', 'WEAPON3': '1.050', 'weapon3': '2.690', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '56.000'} [2023-02-25 15:15:37,346][36157] DAMAGECOUNT value on done: 1797902.0 [2023-02-25 15:15:37,347][36157] Sum rewards: 64.741, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.950', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.106', 'AMMO4': '0.166', 'AMMO3': '0.212', 'weapon4': '0.248', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.020', 'weapon3': '3.040', 'DAMAGECOUNT': '15.525', 'FRAGCOUNT': '58.000'} [2023-02-25 15:15:37,389][36140] DAMAGECOUNT value on done: 1776056.0 [2023-02-25 15:15:37,389][36140] Sum rewards: 69.785, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.720', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon2': '0.264', 'weapon4': '0.308', 'WEAPON3': '1.350', 'weapon3': '3.062', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '58.000'} [2023-02-25 15:15:37,582][36138] Updated weights for policy 0, policy_version 60863 (0.0010) [2023-02-25 15:15:39,729][36114] Fps is (10 sec: 12697.8, 60 sec: 12834.1, 300 sec: 12190.8). Total num frames: 249319424. Throughput: 0: 3208.0. Samples: 24821470. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 15:15:39,729][36114] Avg episode reward: [(0, '58.411')] [2023-02-25 15:15:40,807][36138] Updated weights for policy 0, policy_version 60873 (0.0009) [2023-02-25 15:15:42,550][36142] DAMAGECOUNT value on done: 1789100.0 [2023-02-25 15:15:42,550][36142] Sum rewards: 58.536, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.724', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.064', 'AMMO3': '0.151', 'AMMO4': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.546', 'WEAPON3': '0.900', 'weapon4': '0.914', 'weapon3': '2.240', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '15.579', 'FRAGCOUNT': '48.000'} [2023-02-25 15:15:42,872][36142] DAMAGECOUNT value on done: 1773344.0 [2023-02-25 15:15:42,872][36142] Sum rewards: 51.623, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.310', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.044', 'AMMO3': '0.127', 'AMMO4': '0.222', 'weapon5': '0.342', 'weapon4': '0.400', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon2': '0.820', 'weapon3': '2.114', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '12.477', 'FRAGCOUNT': '43.000'} [2023-02-25 15:15:43,502][36142] DAMAGECOUNT value on done: 1790438.0 [2023-02-25 15:15:43,502][36142] Sum rewards: 60.228, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.047', 'AMMO5': '0.021', 'AMMO2': '0.062', 'weapon2': '0.218', 'AMMO3': '0.222', 'AMMO4': '0.309', 'weapon5': '0.320', 'weapon4': '0.530', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.426', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '55.000'} [2023-02-25 15:15:43,810][36142] DAMAGECOUNT value on done: 1798367.0 [2023-02-25 15:15:43,811][36142] Sum rewards: 60.903, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.160', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.100', 'AMMO4': '0.126', 'weapon2': '0.178', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.254', 'WEAPON3': '1.250', 'weapon3': '3.178', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.516', 'FRAGCOUNT': '52.000'} [2023-02-25 15:15:44,069][36138] Updated weights for policy 0, policy_version 60883 (0.0010) [2023-02-25 15:15:44,729][36114] Fps is (10 sec: 12697.6, 60 sec: 12834.1, 300 sec: 12204.7). Total num frames: 249384960. Throughput: 0: 3202.7. Samples: 24840486. Policy #0 lag: (min: 0.0, avg: 0.6, max: 1.0) [2023-02-25 15:15:44,729][36114] Avg episode reward: [(0, '58.564')] [2023-02-25 15:15:44,780][36156] DAMAGECOUNT value on done: 1809552.0 [2023-02-25 15:15:44,781][36156] Sum rewards: 62.418, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.645', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'weapon2': '0.168', 'AMMO3': '0.180', 'WEAPON3': '1.200', 'HITCOUNT': '2.990', 'weapon3': '3.724', 'DAMAGECOUNT': '15.054', 'FRAGCOUNT': '52.000'} [2023-02-25 15:15:45,115][36156] DAMAGECOUNT value on done: 1784287.0 [2023-02-25 15:15:45,116][36156] Sum rewards: 61.210, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.980', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.058', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'weapon4': '0.360', 'weapon2': '0.412', 'WEAPON3': '1.350', 'weapon3': '2.934', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.633', 'FRAGCOUNT': '54.000'} [2023-02-25 15:15:45,344][36156] DAMAGECOUNT value on done: 1798124.0 [2023-02-25 15:15:45,344][36156] Sum rewards: 55.386, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.965', 'AMMO5': '0.014', 'weapon7': '0.018', 'AMMO2': '0.041', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.128', 'AMMO4': '0.202', 'weapon5': '0.228', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.550', 'weapon4': '0.626', 'WEAPON3': '0.750', 'weapon3': '2.326', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.448', 'FRAGCOUNT': '45.000'} [2023-02-25 15:15:45,658][36156] DAMAGECOUNT value on done: 1787639.0 [2023-02-25 15:15:45,658][36156] Sum rewards: 59.710, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.916', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon5': '0.162', 'AMMO3': '0.191', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.494', 'weapon4': '0.654', 'WEAPON3': '1.150', 'weapon3': '2.448', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.036', 'FRAGCOUNT': '51.000'} [2023-02-25 15:15:46,424][36155] DAMAGECOUNT value on done: 1787311.0 [2023-02-25 15:15:46,424][36155] Sum rewards: 65.089, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.754', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.149', 'weapon5': '0.180', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.448', 'weapon4': '0.782', 'WEAPON3': '0.850', 'weapon3': '2.190', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '52.000'} [2023-02-25 15:15:46,754][36155] DAMAGECOUNT value on done: 1790842.0 [2023-02-25 15:15:46,755][36155] Sum rewards: 63.755, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.960', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.062', 'weapon5': '0.070', 'AMMO4': '0.108', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.298', 'WEAPON3': '1.150', 'HITCOUNT': '3.030', 'weapon3': '3.324', 'DAMAGECOUNT': '15.543', 'FRAGCOUNT': '54.000'} [2023-02-25 15:15:46,927][36139] DAMAGECOUNT value on done: 1794495.0 [2023-02-25 15:15:46,927][36139] Sum rewards: 55.694, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.705', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'AMMO3': '0.284', 'weapon4': '0.352', 'weapon2': '0.538', 'WEAPON3': '1.700', 'weapon3': '2.838', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.937', 'FRAGCOUNT': '50.000'} [2023-02-25 15:15:47,245][36139] DAMAGECOUNT value on done: 1797265.0 [2023-02-25 15:15:47,245][36139] Sum rewards: 61.123, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.290', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.147', 'weapon5': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.396', 'weapon4': '0.564', 'WEAPON3': '0.900', 'weapon3': '2.440', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.526', 'FRAGCOUNT': '50.000'} [2023-02-25 15:15:47,321][36138] Updated weights for policy 0, policy_version 60893 (0.0010) [2023-02-25 15:15:47,557][36139] DAMAGECOUNT value on done: 1802815.0 [2023-02-25 15:15:47,558][36139] Sum rewards: 61.388, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.235', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.108', 'AMMO3': '0.145', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.348', 'weapon2': '0.586', 'WEAPON3': '1.000', 'weapon3': '2.790', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.088', 'FRAGCOUNT': '52.000'} [2023-02-25 15:15:47,564][36155] DAMAGECOUNT value on done: 1806540.0 [2023-02-25 15:15:47,564][36155] Sum rewards: 61.022, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.810', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.130', 'weapon5': '0.136', 'AMMO4': '0.174', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.552', 'WEAPON3': '1.500', 'weapon3': '2.932', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '54.500'} [2023-02-25 15:15:47,875][36139] DAMAGECOUNT value on done: 1803659.0 [2023-02-25 15:15:47,876][36139] Sum rewards: 56.811, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.865', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO4': '0.181', 'AMMO3': '0.194', 'weapon5': '0.226', 'weapon2': '0.364', 'weapon4': '0.372', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.730', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '16.128', 'FRAGCOUNT': '50.000'} [2023-02-25 15:15:47,881][36155] DAMAGECOUNT value on done: 1793250.0 [2023-02-25 15:15:47,881][36155] Sum rewards: 63.228, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.954', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.065', 'AMMO3': '0.211', 'weapon2': '0.242', 'weapon5': '0.278', 'AMMO4': '0.327', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.626', 'WEAPON3': '1.250', 'weapon3': '2.482', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.758', 'FRAGCOUNT': '54.500'} [2023-02-25 15:15:49,729][36114] Fps is (10 sec: 12697.6, 60 sec: 12765.9, 300 sec: 12204.7). Total num frames: 249446400. Throughput: 0: 3197.2. Samples: 24859648. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:15:49,729][36114] Avg episode reward: [(0, '59.078')] [2023-02-25 15:15:50,064][36154] DAMAGECOUNT value on done: 1794058.0 [2023-02-25 15:15:50,064][36154] Sum rewards: 59.007, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.596', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.132', 'weapon2': '0.170', 'AMMO4': '0.209', 'AMMO3': '0.222', 'weapon5': '0.228', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '3.120', 'weapon3': '3.206', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '52.000'} [2023-02-25 15:15:50,393][36154] DAMAGECOUNT value on done: 1773219.0 [2023-02-25 15:15:50,394][36154] Sum rewards: 60.158, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.260', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon5': '0.142', 'weapon2': '0.184', 'AMMO3': '0.200', 'AMMO4': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.588', 'WEAPON3': '1.250', 'weapon3': '2.690', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.810', 'FRAGCOUNT': '54.000'} [2023-02-25 15:15:50,474][36138] Updated weights for policy 0, policy_version 60903 (0.0009) [2023-02-25 15:15:50,728][36140] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 15:15:51,122][36154] DAMAGECOUNT value on done: 1807769.0 [2023-02-25 15:15:51,123][36154] Sum rewards: 70.266, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.964', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.102', 'AMMO4': '0.166', 'AMMO3': '0.171', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.404', 'weapon2': '0.422', 'weapon4': '0.554', 'WEAPON3': '1.100', 'weapon3': '2.672', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '59.000'} [2023-02-25 15:15:51,422][36154] DAMAGECOUNT value on done: 1792079.0 [2023-02-25 15:15:51,422][36154] Sum rewards: 53.951, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.725', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon5': '0.138', 'AMMO3': '0.196', 'AMMO4': '0.238', 'weapon2': '0.386', 'WEAPON5': '0.400', 'weapon4': '0.460', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.754', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.153', 'FRAGCOUNT': '48.000'} [2023-02-25 15:15:51,773][36141] DAMAGECOUNT value on done: 1798155.0 [2023-02-25 15:15:51,773][36141] Sum rewards: 58.901, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.438', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.102', 'AMMO4': '0.131', 'weapon5': '0.140', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.562', 'WEAPON3': '0.900', 'HITCOUNT': '2.760', 'weapon3': '2.982', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '50.000'} [2023-02-25 15:15:51,847][36141] DAMAGECOUNT value on done: 1788854.0 [2023-02-25 15:15:51,847][36141] Sum rewards: 57.684, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.632', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.032', 'AMMO3': '0.135', 'AMMO4': '0.162', 'weapon5': '0.278', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon4': '0.558', 'weapon2': '0.666', 'WEAPON3': '0.900', 'weapon3': '2.250', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.211', 'FRAGCOUNT': '49.000'} [2023-02-25 15:15:52,104][36141] DAMAGECOUNT value on done: 1801356.0 [2023-02-25 15:15:52,105][36141] Sum rewards: 47.316, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.757', 'AMMO5': '0.009', 'AMMO2': '0.015', 'weapon5': '0.066', 'AMMO4': '0.075', 'AMMO3': '0.195', 'weapon2': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.268', 'WEAPON3': '1.150', 'HITCOUNT': '2.510', 'weapon3': '3.164', 'DAMAGECOUNT': '12.411', 'FRAGCOUNT': '42.000'} [2023-02-25 15:15:52,181][36141] DAMAGECOUNT value on done: 1772963.0 [2023-02-25 15:15:52,182][36141] Sum rewards: 59.783, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.506', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.128', 'AMMO4': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.236', 'WEAPON4': '0.250', 'weapon4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.880', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.144', 'FRAGCOUNT': '51.500'} [2023-02-25 15:15:53,675][36138] Updated weights for policy 0, policy_version 60913 (0.0010) [2023-02-25 15:15:54,729][36114] Fps is (10 sec: 12697.6, 60 sec: 12834.1, 300 sec: 12204.7). Total num frames: 249511936. Throughput: 0: 3196.7. Samples: 24869288. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:15:54,730][36114] Avg episode reward: [(0, '59.328')] [2023-02-25 15:15:55,335][36139] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 15:15:56,873][36138] Updated weights for policy 0, policy_version 60923 (0.0010) [2023-02-25 15:15:57,128][36157] DAMAGECOUNT value on done: 1810417.0 [2023-02-25 15:15:57,129][36157] Sum rewards: 61.967, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.832', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.104', 'weapon4': '0.128', 'weapon2': '0.214', 'AMMO3': '0.288', 'WEAPON3': '1.650', 'HITCOUNT': '3.210', 'weapon3': '3.272', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '55.000'} [2023-02-25 15:15:57,443][36157] DAMAGECOUNT value on done: 1795369.0 [2023-02-25 15:15:57,443][36157] Sum rewards: 59.776, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.330', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.226', 'weapon4': '0.264', 'weapon2': '0.692', 'WEAPON3': '0.900', 'weapon3': '2.570', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.103', 'FRAGCOUNT': '49.000'} [2023-02-25 15:15:58,151][36157] DAMAGECOUNT value on done: 1815974.0 [2023-02-25 15:15:58,152][36157] Sum rewards: 66.138, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.282', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.041', 'AMMO3': '0.194', 'AMMO4': '0.205', 'weapon5': '0.206', 'weapon2': '0.438', 'weapon4': '0.470', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.516', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '58.000'} [2023-02-25 15:15:58,279][36140] DAMAGECOUNT value on done: 1798551.0 [2023-02-25 15:15:58,280][36140] Sum rewards: 67.105, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.385', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.179', 'weapon2': '0.196', 'weapon5': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.658', 'WEAPON3': '1.100', 'weapon3': '2.640', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '56.000'} [2023-02-25 15:15:58,340][36140] DAMAGECOUNT value on done: 1804782.0 [2023-02-25 15:15:58,341][36140] Sum rewards: 65.661, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.103', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO4': '0.179', 'AMMO3': '0.196', 'WEAPON4': '0.400', 'weapon2': '0.430', 'weapon4': '0.470', 'WEAPON3': '1.100', 'weapon3': '2.684', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.032', 'FRAGCOUNT': '58.000'} [2023-02-25 15:15:58,472][36157] DAMAGECOUNT value on done: 1803077.0 [2023-02-25 15:15:58,473][36157] Sum rewards: 55.432, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.236', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO4': '0.182', 'weapon5': '0.204', 'weapon2': '0.206', 'AMMO3': '0.256', 'WEAPON5': '0.350', 'weapon4': '0.424', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.834', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.525', 'FRAGCOUNT': '50.500'} [2023-02-25 15:15:58,614][36140] DAMAGECOUNT value on done: 1798882.0 [2023-02-25 15:15:58,615][36140] Sum rewards: 66.195, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.916', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.096', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.234', 'AMMO3': '0.237', 'weapon2': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.974', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.882', 'FRAGCOUNT': '58.000'} [2023-02-25 15:15:58,683][36140] DAMAGECOUNT value on done: 1781490.0 [2023-02-25 15:15:58,684][36140] Sum rewards: 62.205, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.780', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon2': '0.158', 'weapon5': '0.182', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'weapon4': '0.324', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.058', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '55.000'} [2023-02-25 15:15:59,729][36114] Fps is (10 sec: 12697.6, 60 sec: 12765.9, 300 sec: 12204.7). Total num frames: 249573376. Throughput: 0: 3195.6. Samples: 24888470. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:15:59,730][36114] Avg episode reward: [(0, '60.057')] [2023-02-25 15:16:00,087][36138] Updated weights for policy 0, policy_version 60933 (0.0010) [2023-02-25 15:16:03,312][36138] Updated weights for policy 0, policy_version 60943 (0.0010) [2023-02-25 15:16:03,538][36142] DAMAGECOUNT value on done: 1794123.0 [2023-02-25 15:16:03,538][36142] Sum rewards: 59.506, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.154', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.059', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.160', 'AMMO3': '0.235', 'weapon2': '0.414', 'WEAPON3': '1.450', 'HITCOUNT': '3.040', 'weapon3': '3.214', 'DAMAGECOUNT': '15.069', 'FRAGCOUNT': '52.000'} [2023-02-25 15:16:03,860][36142] DAMAGECOUNT value on done: 1778131.0 [2023-02-25 15:16:03,861][36142] Sum rewards: 47.418, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.940', 'AMMO5': '0.024', 'AMMO2': '0.065', 'weapon2': '0.242', 'AMMO3': '0.253', 'weapon5': '0.298', 'weapon4': '0.314', 'AMMO4': '0.323', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.450', 'HITCOUNT': '2.710', 'weapon3': '2.768', 'DAMAGECOUNT': '14.361', 'FRAGCOUNT': '46.500'} [2023-02-25 15:16:04,482][36142] DAMAGECOUNT value on done: 1795509.0 [2023-02-25 15:16:04,483][36142] Sum rewards: 53.498, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.694', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.120', 'AMMO4': '0.182', 'weapon4': '0.200', 'AMMO3': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.626', 'WEAPON3': '1.250', 'weapon3': '2.772', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.213', 'FRAGCOUNT': '48.000'} [2023-02-25 15:16:04,729][36114] Fps is (10 sec: 12697.7, 60 sec: 12765.9, 300 sec: 12218.6). Total num frames: 249638912. Throughput: 0: 3194.3. Samples: 24907676. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:16:04,729][36114] Avg episode reward: [(0, '60.191')] [2023-02-25 15:16:04,827][36142] DAMAGECOUNT value on done: 1803918.0 [2023-02-25 15:16:04,827][36142] Sum rewards: 71.657, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.730', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.150', 'AMMO3': '0.156', 'AMMO4': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.460', 'weapon2': '0.492', 'WEAPON3': '1.000', 'weapon3': '2.532', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '60.000'} [2023-02-25 15:16:05,677][36156] DAMAGECOUNT value on done: 1814186.0 [2023-02-25 15:16:05,678][36156] Sum rewards: 52.683, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.632', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.166', 'AMMO3': '0.179', 'weapon5': '0.212', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.590', 'weapon4': '0.744', 'WEAPON3': '1.050', 'weapon3': '2.104', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.902', 'FRAGCOUNT': '47.000'} [2023-02-25 15:16:05,996][36156] DAMAGECOUNT value on done: 1788704.0 [2023-02-25 15:16:05,997][36156] Sum rewards: 50.620, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.138', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon5': '0.104', 'AMMO3': '0.175', 'AMMO4': '0.201', 'weapon2': '0.334', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.650', 'WEAPON3': '1.000', 'weapon3': '2.538', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '13.251', 'FRAGCOUNT': '46.000'} [2023-02-25 15:16:06,262][36156] DAMAGECOUNT value on done: 1802890.0 [2023-02-25 15:16:06,262][36156] Sum rewards: 53.339, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.288', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.134', 'AMMO3': '0.171', 'AMMO4': '0.183', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.304', 'weapon4': '0.494', 'WEAPON3': '1.050', 'weapon3': '2.842', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.298', 'FRAGCOUNT': '45.000'} [2023-02-25 15:16:06,540][36138] Updated weights for policy 0, policy_version 60953 (0.0009) [2023-02-25 15:16:06,581][36156] DAMAGECOUNT value on done: 1793230.0 [2023-02-25 15:16:06,582][36156] Sum rewards: 59.117, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.790', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO4': '0.178', 'weapon5': '0.220', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.304', 'weapon4': '0.396', 'WEAPON3': '1.350', 'weapon3': '2.768', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '52.000'} [2023-02-25 15:16:07,380][36155] DAMAGECOUNT value on done: 1792891.0 [2023-02-25 15:16:07,381][36155] Sum rewards: 67.207, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.724', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO3': '0.109', 'AMMO4': '0.187', 'weapon5': '0.280', 'weapon2': '0.470', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '0.700', 'weapon4': '0.880', 'weapon3': '2.028', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '55.000'} [2023-02-25 15:16:07,697][36155] DAMAGECOUNT value on done: 1795461.0 [2023-02-25 15:16:07,698][36155] Sum rewards: 52.674, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.966', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'weapon4': '0.426', 'weapon2': '0.680', 'WEAPON3': '1.000', 'weapon3': '2.360', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.857', 'FRAGCOUNT': '44.000'} [2023-02-25 15:16:07,940][36139] DAMAGECOUNT value on done: 1799229.0 [2023-02-25 15:16:07,941][36139] Sum rewards: 59.358, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.042', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON5': '0.050', 'weapon5': '0.074', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon4': '0.398', 'weapon2': '0.518', 'WEAPON3': '1.250', 'weapon3': '2.812', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.202', 'FRAGCOUNT': '52.000'} [2023-02-25 15:16:08,255][36139] DAMAGECOUNT value on done: 1802388.0 [2023-02-25 15:16:08,255][36139] Sum rewards: 53.753, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.950', 'ARMOR': '0.004', 'AMMO5': '0.019', 'weapon5': '0.044', 'AMMO2': '0.044', 'AMMO4': '0.222', 'AMMO3': '0.232', 'WEAPON5': '0.350', 'weapon4': '0.358', 'weapon2': '0.420', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.890', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.369', 'FRAGCOUNT': '49.500'} [2023-02-25 15:16:08,528][36139] DAMAGECOUNT value on done: 1808291.0 [2023-02-25 15:16:08,529][36139] Sum rewards: 64.968, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.990', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon5': '0.102', 'weapon2': '0.164', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.414', 'WEAPON3': '1.500', 'weapon3': '3.020', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.428', 'FRAGCOUNT': '57.000'} [2023-02-25 15:16:08,539][36155] DAMAGECOUNT value on done: 1812132.0 [2023-02-25 15:16:08,540][36155] Sum rewards: 72.665, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.935', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.088', 'AMMO4': '0.140', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'weapon2': '0.228', 'WEAPON4': '0.350', 'weapon4': '0.578', 'WEAPON3': '1.000', 'weapon3': '2.674', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '61.000'} [2023-02-25 15:16:08,842][36139] DAMAGECOUNT value on done: 1808170.0 [2023-02-25 15:16:08,843][36139] Sum rewards: 50.063, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.545', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon4': '0.106', 'WEAPON4': '0.150', 'weapon5': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.306', 'weapon2': '0.350', 'WEAPON3': '1.800', 'HITCOUNT': '3.020', 'weapon3': '3.044', 'DAMAGECOUNT': '13.533', 'FRAGCOUNT': '48.000'} [2023-02-25 15:16:08,856][36155] DAMAGECOUNT value on done: 1798967.0 [2023-02-25 15:16:08,856][36155] Sum rewards: 72.307, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.647', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.096', 'WEAPON5': '0.150', 'weapon5': '0.152', 'AMMO3': '0.162', 'WEAPON4': '0.250', 'weapon2': '0.316', 'weapon4': '0.646', 'WEAPON3': '1.150', 'weapon3': '2.676', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '61.000'} [2023-02-25 15:16:09,723][36138] Updated weights for policy 0, policy_version 60963 (0.0009) [2023-02-25 15:16:09,729][36114] Fps is (10 sec: 13107.2, 60 sec: 12834.1, 300 sec: 12204.7). Total num frames: 249704448. Throughput: 0: 3195.4. Samples: 24917210. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:16:09,730][36114] Avg episode reward: [(0, '59.784')] [2023-02-25 15:16:11,252][36154] DAMAGECOUNT value on done: 1799116.0 [2023-02-25 15:16:11,253][36154] Sum rewards: 55.831, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.442', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon2': '0.162', 'weapon5': '0.180', 'AMMO4': '0.195', 'AMMO3': '0.198', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.570', 'WEAPON3': '1.250', 'weapon3': '2.714', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.174', 'FRAGCOUNT': '49.000'} [2023-02-25 15:16:11,586][36154] DAMAGECOUNT value on done: 1779112.0 [2023-02-25 15:16:11,587][36154] Sum rewards: 69.894, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.287', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.202', 'weapon5': '0.212', 'AMMO3': '0.229', 'weapon2': '0.258', 'WEAPON3': '1.300', 'weapon3': '3.046', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '60.000'} [2023-02-25 15:16:12,313][36154] DAMAGECOUNT value on done: 1812968.0 [2023-02-25 15:16:12,314][36154] Sum rewards: 60.390, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.499', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.045', 'AMMO3': '0.168', 'AMMO4': '0.222', 'weapon5': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.554', 'weapon4': '0.566', 'WEAPON3': '1.050', 'weapon3': '2.182', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '54.000'} [2023-02-25 15:16:12,625][36154] DAMAGECOUNT value on done: 1797470.0 [2023-02-25 15:16:12,626][36154] Sum rewards: 70.343, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.789', 'AMMO5': '0.014', 'AMMO2': '0.030', 'AMMO3': '0.121', 'AMMO4': '0.150', 'weapon5': '0.202', 'weapon2': '0.424', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.648', 'WEAPON3': '0.750', 'weapon3': '2.500', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.173', 'FRAGCOUNT': '58.000'} [2023-02-25 15:16:12,927][36138] Updated weights for policy 0, policy_version 60973 (0.0009) [2023-02-25 15:16:12,938][36141] DAMAGECOUNT value on done: 1803368.0 [2023-02-25 15:16:12,938][36141] Sum rewards: 53.381, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.286', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.055', 'AMMO3': '0.163', 'AMMO4': '0.274', 'weapon2': '0.306', 'weapon5': '0.398', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.618', 'WEAPON3': '1.000', 'weapon3': '2.294', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '46.000'} [2023-02-25 15:16:12,993][36141] DAMAGECOUNT value on done: 1793725.0 [2023-02-25 15:16:12,994][36141] Sum rewards: 60.503, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.198', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon5': '0.178', 'AMMO4': '0.182', 'AMMO3': '0.191', 'weapon4': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.890', 'weapon3': '2.924', 'DAMAGECOUNT': '14.613', 'FRAGCOUNT': '54.000'} [2023-02-25 15:16:13,305][36141] DAMAGECOUNT value on done: 1805842.0 [2023-02-25 15:16:13,306][36141] Sum rewards: 48.483, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.775', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.188', 'AMMO3': '0.225', 'AMMO4': '0.237', 'weapon2': '0.356', 'WEAPON5': '0.400', 'weapon4': '0.478', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.688', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.458', 'FRAGCOUNT': '45.000'} [2023-02-25 15:16:13,361][36142] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 15:16:13,363][36141] DAMAGECOUNT value on done: 1778357.0 [2023-02-25 15:16:13,364][36141] Sum rewards: 64.832, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.782', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.142', 'weapon4': '0.168', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon2': '0.342', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.142', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '56.000'} [2023-02-25 15:16:14,729][36114] Fps is (10 sec: 12697.4, 60 sec: 12765.9, 300 sec: 12190.8). Total num frames: 249765888. Throughput: 0: 3194.3. Samples: 24936304. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:16:14,730][36114] Avg episode reward: [(0, '60.348')] [2023-02-25 15:16:16,132][36138] Updated weights for policy 0, policy_version 60983 (0.0010) [2023-02-25 15:16:18,050][36157] DAMAGECOUNT value on done: 1814980.0 [2023-02-25 15:16:18,051][36157] Sum rewards: 52.937, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.570', 'AMMO5': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon2': '0.088', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'WEAPON3': '1.400', 'HITCOUNT': '2.670', 'weapon3': '3.610', 'DAMAGECOUNT': '13.689', 'FRAGCOUNT': '46.000'} [2023-02-25 15:16:18,128][36139] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2023-02-25 15:16:18,377][36157] DAMAGECOUNT value on done: 1800509.0 [2023-02-25 15:16:18,377][36157] Sum rewards: 53.503, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.983', 'ARMOR': '0.012', 'AMMO5': '0.019', 'AMMO2': '0.035', 'AMMO3': '0.168', 'AMMO4': '0.174', 'weapon2': '0.230', 'weapon5': '0.338', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.746', 'WEAPON3': '1.050', 'weapon3': '2.334', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '45.000'} [2023-02-25 15:16:19,055][36157] DAMAGECOUNT value on done: 1821376.0 [2023-02-25 15:16:19,055][36157] Sum rewards: 67.456, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.955', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.138', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.338', 'weapon2': '0.548', 'WEAPON3': '0.950', 'weapon3': '2.786', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.206', 'FRAGCOUNT': '54.000'} [2023-02-25 15:16:19,367][36138] Updated weights for policy 0, policy_version 60993 (0.0010) [2023-02-25 15:16:19,404][36157] DAMAGECOUNT value on done: 1808248.0 [2023-02-25 15:16:19,404][36157] Sum rewards: 58.636, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.940', 'AMMO5': '0.017', 'AMMO2': '0.041', 'AMMO3': '0.135', 'AMMO4': '0.205', 'weapon2': '0.260', 'weapon5': '0.310', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '0.850', 'weapon4': '0.894', 'weapon3': '2.190', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '49.500'} [2023-02-25 15:16:19,414][36140] DAMAGECOUNT value on done: 1804394.0 [2023-02-25 15:16:19,415][36140] Sum rewards: 69.129, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.482', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.046', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.182', 'weapon4': '0.264', 'weapon2': '0.274', 'WEAPON3': '1.050', 'weapon3': '3.248', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.529', 'FRAGCOUNT': '56.000'} [2023-02-25 15:16:19,449][36140] DAMAGECOUNT value on done: 1810106.0 [2023-02-25 15:16:19,450][36140] Sum rewards: 62.047, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.624', 'ARMOR': '0.008', 'AMMO5': '0.027', 'AMMO2': '0.051', 'AMMO3': '0.122', 'AMMO4': '0.253', 'weapon5': '0.316', 'weapon2': '0.546', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'weapon4': '0.808', 'WEAPON3': '0.900', 'weapon3': '1.978', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '15.972', 'FRAGCOUNT': '53.000'} [2023-02-25 15:16:19,729][36114] Fps is (10 sec: 12697.5, 60 sec: 12765.9, 300 sec: 12204.7). Total num frames: 249831424. Throughput: 0: 3189.9. Samples: 24955440. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:16:19,730][36114] Avg episode reward: [(0, '60.418')] [2023-02-25 15:16:19,752][36140] DAMAGECOUNT value on done: 1803819.0 [2023-02-25 15:16:19,753][36140] Sum rewards: 54.785, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.822', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.021', 'weapon5': '0.090', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'WEAPON4': '0.400', 'weapon2': '0.526', 'weapon4': '0.736', 'WEAPON3': '0.900', 'weapon3': '2.384', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.811', 'FRAGCOUNT': '47.000'} [2023-02-25 15:16:19,785][36140] DAMAGECOUNT value on done: 1786841.0 [2023-02-25 15:16:19,786][36140] Sum rewards: 60.579, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.190', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon5': '0.080', 'weapon4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.269', 'weapon2': '0.376', 'WEAPON3': '1.600', 'HITCOUNT': '3.070', 'weapon3': '3.228', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '55.000'} [2023-02-25 15:16:22,682][36138] Updated weights for policy 0, policy_version 61003 (0.0010) [2023-02-25 15:16:24,729][36114] Fps is (10 sec: 12697.6, 60 sec: 12765.8, 300 sec: 12204.7). Total num frames: 249892864. Throughput: 0: 3183.8. Samples: 24964742. Policy #0 lag: (min: 0.0, avg: 0.6, max: 2.0) [2023-02-25 15:16:24,730][36114] Avg episode reward: [(0, '60.487')] [2023-02-25 15:16:24,745][36142] DAMAGECOUNT value on done: 1799555.0 [2023-02-25 15:16:24,746][36142] Sum rewards: 57.466, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.178', 'AMMO5': '0.021', 'AMMO2': '0.044', 'weapon5': '0.140', 'AMMO4': '0.218', 'AMMO3': '0.239', 'weapon4': '0.252', 'weapon2': '0.290', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.004', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.296', 'FRAGCOUNT': '51.500'} [2023-02-25 15:16:25,071][36142] DAMAGECOUNT value on done: 1782918.0 [2023-02-25 15:16:25,071][36142] Sum rewards: 60.136, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.010', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.074', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'AMMO3': '0.185', 'WEAPON4': '0.300', 'weapon2': '0.312', 'weapon4': '0.868', 'WEAPON3': '1.200', 'weapon3': '2.466', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.361', 'FRAGCOUNT': '53.000'} [2023-02-25 15:16:25,678][36142] DAMAGECOUNT value on done: 1800352.0 [2023-02-25 15:16:25,679][36142] Sum rewards: 55.323, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.704', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'weapon2': '0.276', 'weapon4': '0.418', 'WEAPON3': '1.550', 'weapon3': '2.952', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.529', 'FRAGCOUNT': '50.000'} [2023-02-25 15:16:25,939][36138] Updated weights for policy 0, policy_version 61013 (0.0010) [2023-02-25 15:16:25,990][36142] DAMAGECOUNT value on done: 1808873.0 [2023-02-25 15:16:25,990][36142] Sum rewards: 54.967, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.206', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon5': '0.214', 'AMMO4': '0.221', 'AMMO3': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.534', 'weapon4': '0.592', 'WEAPON3': '1.400', 'weapon3': '2.320', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '50.000'} [2023-02-25 15:16:26,846][36156] DAMAGECOUNT value on done: 1819731.0 [2023-02-25 15:16:26,846][36156] Sum rewards: 65.315, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.635', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.150', 'AMMO3': '0.243', 'weapon4': '0.252', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.020', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '58.000'} [2023-02-25 15:16:27,173][36156] DAMAGECOUNT value on done: 1793316.0 [2023-02-25 15:16:27,174][36156] Sum rewards: 56.379, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.442', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.033', 'AMMO3': '0.147', 'AMMO4': '0.165', 'weapon5': '0.190', 'weapon2': '0.342', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.622', 'WEAPON3': '0.800', 'weapon3': '2.594', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.836', 'FRAGCOUNT': '47.000'} [2023-02-25 15:16:27,435][36156] DAMAGECOUNT value on done: 1807923.0 [2023-02-25 15:16:27,435][36156] Sum rewards: 60.712, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.055', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon4': '0.400', 'weapon2': '0.544', 'WEAPON3': '1.200', 'weapon3': '2.786', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.099', 'FRAGCOUNT': '51.000'} [2023-02-25 15:16:27,767][36156] DAMAGECOUNT value on done: 1798715.0 [2023-02-25 15:16:27,768][36156] Sum rewards: 62.883, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.626', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon5': '0.144', 'weapon4': '0.180', 'AMMO4': '0.202', 'AMMO3': '0.219', 'weapon2': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.086', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '55.000'} [2023-02-25 15:16:28,588][36155] DAMAGECOUNT value on done: 1797350.0 [2023-02-25 15:16:28,588][36155] Sum rewards: 62.547, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.954', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'AMMO3': '0.103', 'weapon4': '0.412', 'WEAPON3': '0.750', 'weapon2': '0.820', 'weapon3': '2.716', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.347', 'FRAGCOUNT': '49.000'} [2023-02-25 15:16:28,903][36155] DAMAGECOUNT value on done: 1800247.0 [2023-02-25 15:16:28,904][36155] Sum rewards: 53.462, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.150', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon2': '0.176', 'AMMO3': '0.181', 'AMMO4': '0.231', 'weapon5': '0.274', 'weapon4': '0.536', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.662', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '14.358', 'FRAGCOUNT': '48.000'} [2023-02-25 15:16:29,166][36139] DAMAGECOUNT value on done: 1804701.0 [2023-02-25 15:16:29,166][36139] Sum rewards: 68.203, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.740', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.048', 'AMMO4': '0.106', 'weapon5': '0.116', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.506', 'WEAPON3': '1.100', 'HITCOUNT': '3.130', 'weapon3': '3.166', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '59.000'} [2023-02-25 15:16:29,168][36138] Updated weights for policy 0, policy_version 61023 (0.0009) [2023-02-25 15:16:29,491][36139] DAMAGECOUNT value on done: 1806846.0 [2023-02-25 15:16:29,492][36139] Sum rewards: 47.864, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.675', 'AMMO5': '0.014', 'AMMO2': '0.034', 'AMMO3': '0.167', 'AMMO4': '0.170', 'weapon5': '0.212', 'weapon2': '0.312', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.694', 'WEAPON3': '0.950', 'weapon3': '2.462', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '13.374', 'FRAGCOUNT': '42.000'} [2023-02-25 15:16:29,720][36139] DAMAGECOUNT value on done: 1813870.0 [2023-02-25 15:16:29,720][36139] Sum rewards: 64.191, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.952', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.059', 'AMMO3': '0.140', 'weapon2': '0.236', 'weapon5': '0.264', 'AMMO4': '0.295', 'WEAPON5': '0.450', 'WEAPON4': '0.700', 'WEAPON3': '0.800', 'weapon4': '1.082', 'weapon3': '1.976', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '53.000'} [2023-02-25 15:16:29,729][36114] Fps is (10 sec: 12288.1, 60 sec: 12697.6, 300 sec: 12190.8). Total num frames: 249954304. Throughput: 0: 3183.3. Samples: 24983736. Policy #0 lag: (min: 0.0, avg: 0.7, max: 2.0) [2023-02-25 15:16:29,729][36114] Avg episode reward: [(0, '60.284')] [2023-02-25 15:16:29,852][36155] DAMAGECOUNT value on done: 1816356.0 [2023-02-25 15:16:29,852][36155] Sum rewards: 50.419, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.955', 'AMMO5': '0.017', 'AMMO2': '0.032', 'AMMO3': '0.148', 'AMMO4': '0.160', 'weapon5': '0.184', 'weapon2': '0.408', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '0.850', 'weapon4': '1.128', 'weapon3': '2.004', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '12.672', 'FRAGCOUNT': '45.000'} [2023-02-25 15:16:30,046][36139] DAMAGECOUNT value on done: 1813429.0 [2023-02-25 15:16:30,047][36139] Sum rewards: 65.529, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.300', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.146', 'AMMO3': '0.227', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.422', 'weapon4': '0.706', 'WEAPON3': '1.350', 'weapon3': '2.462', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.777', 'FRAGCOUNT': '57.000'} [2023-02-25 15:16:30,174][36155] DAMAGECOUNT value on done: 1804924.0 [2023-02-25 15:16:30,174][36155] Sum rewards: 67.088, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.046', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.252', 'WEAPON4': '0.300', 'ARMOR': '0.404', 'weapon4': '0.544', 'WEAPON3': '1.150', 'weapon3': '2.826', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '56.000'} [2023-02-25 15:16:30,249][36142] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2023-02-25 15:16:32,377][36138] Updated weights for policy 0, policy_version 61033 (0.0010) [2023-02-25 15:16:32,434][36154] DAMAGECOUNT value on done: 1804700.0 [2023-02-25 15:16:32,434][36154] Sum rewards: 64.734, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.740', 'AMMO2': '0.007', 'AMMO4': '0.034', 'AMMO3': '0.223', 'weapon2': '0.404', 'WEAPON3': '1.350', 'weapon3': '3.434', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.752', 'FRAGCOUNT': '54.000'} [2023-02-25 15:16:32,764][36154] DAMAGECOUNT value on done: 1783739.0 [2023-02-25 15:16:32,765][36154] Sum rewards: 55.792, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.842', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.100', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.280', 'weapon2': '0.606', 'WEAPON3': '1.050', 'weapon3': '2.832', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '13.881', 'FRAGCOUNT': '47.000'} [2023-02-25 15:16:33,483][36154] DAMAGECOUNT value on done: 1818518.0 [2023-02-25 15:16:33,483][36154] Sum rewards: 64.125, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.750', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.094', 'AMMO4': '0.098', 'WEAPON5': '0.150', 'weapon4': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'weapon2': '0.380', 'WEAPON3': '1.350', 'weapon3': '3.142', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.650', 'FRAGCOUNT': '56.000'} [2023-02-25 15:16:33,676][36114] Component Batcher_0 stopped! [2023-02-25 15:16:33,676][36125] Stopping Batcher_0... [2023-02-25 15:16:33,676][36125] Loop batcher_evt_loop terminating... [2023-02-25 15:16:33,677][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000061037_250007552.pth... [2023-02-25 15:16:33,699][36138] Weights refcount: 2 0 [2023-02-25 15:16:33,700][36154] Stopping RolloutWorker_w5... [2023-02-25 15:16:33,700][36114] Component RolloutWorker_w5 stopped! [2023-02-25 15:16:33,701][36154] Loop rollout_proc5_evt_loop terminating... [2023-02-25 15:16:33,701][36138] Stopping InferenceWorker_p0-w0... [2023-02-25 15:16:33,701][36114] Component InferenceWorker_p0-w0 stopped! [2023-02-25 15:16:33,701][36138] Loop inference_proc0-0_evt_loop terminating... [2023-02-25 15:16:33,702][36114] Component RolloutWorker_w6 stopped! [2023-02-25 15:16:33,702][36114] Component RolloutWorker_w7 stopped! [2023-02-25 15:16:33,702][36156] Stopping RolloutWorker_w6... [2023-02-25 15:16:33,702][36157] Stopping RolloutWorker_w7... [2023-02-25 15:16:33,703][36157] Loop rollout_proc7_evt_loop terminating... [2023-02-25 15:16:33,703][36156] Loop rollout_proc6_evt_loop terminating... [2023-02-25 15:16:33,705][36114] Component RolloutWorker_w0 stopped! [2023-02-25 15:16:33,705][36139] Stopping RolloutWorker_w0... [2023-02-25 15:16:33,705][36141] Stopping RolloutWorker_w2... [2023-02-25 15:16:33,706][36114] Component RolloutWorker_w2 stopped! [2023-02-25 15:16:33,706][36141] Loop rollout_proc2_evt_loop terminating... [2023-02-25 15:16:33,706][36139] Loop rollout_proc0_evt_loop terminating... [2023-02-25 15:16:33,707][36114] Component RolloutWorker_w3 stopped! [2023-02-25 15:16:33,707][36142] Stopping RolloutWorker_w3... [2023-02-25 15:16:33,707][36142] Loop rollout_proc3_evt_loop terminating... [2023-02-25 15:16:33,711][36155] Stopping RolloutWorker_w4... [2023-02-25 15:16:33,711][36114] Component RolloutWorker_w4 stopped! [2023-02-25 15:16:33,712][36114] Component RolloutWorker_w1 stopped! [2023-02-25 15:16:33,711][36140] Stopping RolloutWorker_w1... [2023-02-25 15:16:33,712][36155] Loop rollout_proc4_evt_loop terminating... [2023-02-25 15:16:33,712][36140] Loop rollout_proc1_evt_loop terminating... [2023-02-25 15:16:33,755][36125] Removing /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000060458_247635968.pth [2023-02-25 15:16:33,763][36125] Saving /home/besa/source/rl/train_dir/default_experiment/checkpoint_p0/checkpoint_000061037_250007552.pth... [2023-02-25 15:16:33,855][36125] Stopping LearnerWorker_p0... [2023-02-25 15:16:33,855][36125] Loop learner_proc0_evt_loop terminating... [2023-02-25 15:16:33,855][36114] Component LearnerWorker_p0 stopped! [2023-02-25 15:16:33,856][36114] Waiting for process learner_proc0 to stop... [2023-02-25 15:16:34,696][36114] Waiting for process inference_proc0-0 to join... [2023-02-25 15:16:34,697][36114] Waiting for process rollout_proc0 to join... [2023-02-25 15:16:34,697][36114] Waiting for process rollout_proc1 to join... [2023-02-25 15:16:34,697][36114] Waiting for process rollout_proc2 to join... [2023-02-25 15:16:34,697][36114] Waiting for process rollout_proc3 to join... [2023-02-25 15:16:34,698][36114] Waiting for process rollout_proc4 to join... [2023-02-25 15:16:34,698][36114] Waiting for process rollout_proc5 to join... [2023-02-25 15:16:34,698][36114] Waiting for process rollout_proc6 to join... [2023-02-25 15:16:34,698][36114] Waiting for process rollout_proc7 to join... [2023-02-25 15:16:34,698][36114] Batcher 0 profile tree view: batching: 357.9739, releasing_batches: 0.4917 [2023-02-25 15:16:34,698][36114] InferenceWorker_p0-w0 profile tree view: wait_policy: 0.0000 wait_policy_total: 77.5027 update_model: 85.4891 weight_update: 0.0010 one_step: 0.0035 handle_policy_step: 7010.1237 deserialize: 324.9382, stack: 36.3208, obs_to_device_normalize: 1830.8660, forward: 3541.8143, send_messages: 314.4733 prepare_outputs: 721.7791 to_cpu: 426.9898 [2023-02-25 15:16:34,698][36114] Learner 0 profile tree view: misc: 0.1267, prepare_batch: 174.4311 train: 772.3259 epoch_init: 0.1185, minibatch_init: 0.1374, losses_postprocess: 5.6360, kl_divergence: 15.9925, after_optimizer: 4.1960 calculate_losses: 308.9057 losses_init: 0.0556, forward_head: 20.0767, bptt_initial: 201.2232, tail: 23.7164, advantages_returns: 3.0429, losses: 37.0290 bptt: 20.1249 bptt_forward_core: 19.3065 update: 426.1418 clip: 20.6787 [2023-02-25 15:16:34,698][36114] RolloutWorker_w0 profile tree view: wait_for_trajectories: 3.2671, enqueue_policy_requests: 207.0413, env_step: 5018.0416, overhead: 225.8121, complete_rollouts: 5.9356 save_policy_outputs: 183.8245 split_output_tensors: 89.9920 [2023-02-25 15:16:34,699][36114] RolloutWorker_w7 profile tree view: wait_for_trajectories: 3.2664, enqueue_policy_requests: 204.8001, env_step: 5016.9739, overhead: 235.0798, complete_rollouts: 5.8448 save_policy_outputs: 184.2947 split_output_tensors: 89.7525 [2023-02-25 15:16:34,699][36114] Loop Runner_EvtLoop terminating... [2023-02-25 15:16:34,699][36114] Runner profile tree view: main_loop: 7513.0799 [2023-02-25 15:16:34,699][36114] Collected {0: 250007552}, FPS: 13310.1